2024-09-16T05:16:41.992 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-16T05:16:42.008 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-16T05:16:42.093 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-09-15_21:00:02-rados-squid-distro-default-smithi/7906147 branch: squid description: rados/cephadm/workunits/{0-distro/ubuntu_22.04 agent/off mon_election/classic task/test_rgw_multisite} email: ceph-qa@ceph.com first_in_suite: false job_id: '7906147' kernel: kdb: 1 sha1: distro ktype: distro last_in_suite: false machine_type: smithi name: teuthology-2024-09-15_21:00:02-rados-squid-distro-default-smithi no_nested_subset: false os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: squid ceph: conf: global: mon election default strategy: 1 mgr: debug mgr: 20 debug ms: 1 mgr/cephadm/use_agent: false mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: debug ms: 1 debug osd: 20 flavor: default log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - MON_DOWN - mons down - mon down - out of quorum log-only-match: - CEPHADM_ sha1: 8921c8ef947807b717db041d85f0761b7914d5fc ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} install: ceph: flavor: default sha1: 8921c8ef947807b717db041d85f0761b7914d5fc workunit: branch: squid sha1: ad35db06e8924912f01e32b35576297c0f1352b4 owner: scheduled_teuthology@teuthology priority: 700 repo: https://git.ceph.com/ceph.git roles: - - host.a - mon.a - mgr.a - osd.0 - - host.b - mon.b - mgr.b - osd.1 - - host.c - mon.c - osd.2 seed: 5616 sha1: 8921c8ef947807b717db041d85f0761b7914d5fc sleep_before_teardown: 0 subset: 15927/100000 suite: rados suite_branch: squid suite_path: /home/teuthworker/src/git.ceph.com_ceph_ad35db06e8924912f01e32b35576297c0f1352b4/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: ad35db06e8924912f01e32b35576297c0f1352b4 targets: smithi047.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCiqKKeer6tY0zbZ3wGYeOsKepT8nl+WWvTpFxcNlQ4EUv5yEjxMqKnqdpXSSIsx+rerTSsb+ZJqJLQsNJke5GU= smithi086.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGHhdMwJpGjv24zZ+z2/TjzgOIAUFdvds69vA9rln7lRDxsNRU+qyU8/lupNSA1X9USwmJ4IRbThtZBPgDqnDzU= smithi157.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCJA4dwV9kTY1E74AEE2Co0cyyj3PbVjRGtSs+8RywdCuB1+TEQtKTiZk+snsTyKk6ferpkfaP1So+E7iX5WpDo= tasks: - install: null - cephadm: null - cephadm.shell: host.a: - ceph mgr module enable rgw - rgw_module.apply: specs: - rgw_realm: myrealm1 rgw_zone: myzone1 rgw_zonegroup: myzonegroup1 spec: rgw_frontend_port: 5500 - cephadm.shell: host.a: - 'set -e set -x while true; do TOKEN=$(ceph rgw realm tokens | jq -r ''.[0].token''); echo $TOKEN; if [ "$TOKEN" != "master zone has no endpoint" ]; then break; fi; sleep 5; done TOKENS=$(ceph rgw realm tokens) echo $TOKENS | jq --exit-status ''.[0].realm == "myrealm1"'' echo $TOKENS | jq --exit-status ''.[0].token'' TOKEN_JSON=$(ceph rgw realm tokens | jq -r ''.[0].token'' | base64 --decode) echo $TOKEN_JSON | jq --exit-status ''.realm_name == "myrealm1"'' echo $TOKEN_JSON | jq --exit-status ''.endpoint | test("http://.+:\\d+")'' echo $TOKEN_JSON | jq --exit-status ''.realm_id | test("^[0-9a-f]{8}-[0-9a-f]{4}-[0-9a-f]{4}-[0-9a-f]{4}-[0-9a-f]{12}$")'' echo $TOKEN_JSON | jq --exit-status ''.access_key'' echo $TOKEN_JSON | jq --exit-status ''.secret'' ' teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-15_21:00:02 tube: smithi user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-16T05:16:42.094 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_ad35db06e8924912f01e32b35576297c0f1352b4/qa; will attempt to use it 2024-09-16T05:16:42.094 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_ad35db06e8924912f01e32b35576297c0f1352b4/qa/tasks 2024-09-16T05:16:42.095 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-16T05:16:42.096 INFO:teuthology.task.internal:Checking packages... 2024-09-16T05:16:42.117 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash '8921c8ef947807b717db041d85f0761b7914d5fc' 2024-09-16T05:16:42.118 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-16T05:16:42.118 INFO:teuthology.packaging:ref: None 2024-09-16T05:16:42.118 INFO:teuthology.packaging:tag: None 2024-09-16T05:16:42.118 INFO:teuthology.packaging:branch: squid 2024-09-16T05:16:42.118 INFO:teuthology.packaging:sha1: 8921c8ef947807b717db041d85f0761b7914d5fc 2024-09-16T05:16:42.118 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=squid 2024-09-16T05:16:42.343 INFO:teuthology.task.internal:Found packages for ceph version 19.1.1-326-g8921c8ef-1jammy 2024-09-16T05:16:42.345 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-16T05:16:42.351 INFO:teuthology.task.internal:no buildpackages task found 2024-09-16T05:16:42.351 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-16T05:16:42.388 INFO:teuthology.task.internal:Saving configuration 2024-09-16T05:16:42.400 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-16T05:16:42.414 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-16T05:16:42.438 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi047.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-15_21:00:02-rados-squid-distro-default-smithi/7906147', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-16 05:10:25.139881', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGEM//Qq1C7tHFxl0Y8C7T18h0ItmRwxNOG7NyTmW2o0'} 2024-09-16T05:16:42.461 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi086.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-15_21:00:02-rados-squid-distro-default-smithi/7906147', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-16 05:10:25.141702', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIJD0muXxij68PYP92FHHIA3YbhzgBHqCNZr/5HeOf2Br'} 2024-09-16T05:16:42.481 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi157.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-15_21:00:02-rados-squid-distro-default-smithi/7906147', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-16 05:10:25.143060', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGT5G32uOz5JIejdDxrbi2uvtJ5UvYR7iPg4u/7+lqm8'} 2024-09-16T05:16:42.481 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-16T05:16:42.487 INFO:teuthology.task.internal:roles: ubuntu@smithi047.front.sepia.ceph.com - ['host.a', 'mon.a', 'mgr.a', 'osd.0'] 2024-09-16T05:16:42.487 INFO:teuthology.task.internal:roles: ubuntu@smithi086.front.sepia.ceph.com - ['host.b', 'mon.b', 'mgr.b', 'osd.1'] 2024-09-16T05:16:42.488 INFO:teuthology.task.internal:roles: ubuntu@smithi157.front.sepia.ceph.com - ['host.c', 'mon.c', 'osd.2'] 2024-09-16T05:16:42.488 INFO:teuthology.run_tasks:Running task console_log... 2024-09-16T05:16:42.601 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f55bcd82e60>, signals=[15]) 2024-09-16T05:16:42.601 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-16T05:16:42.607 INFO:teuthology.task.internal:Opening connections... 2024-09-16T05:16:42.607 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi047.front.sepia.ceph.com 2024-09-16T05:16:42.609 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi047.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T05:16:42.691 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi086.front.sepia.ceph.com 2024-09-16T05:16:42.692 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T05:16:42.770 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi157.front.sepia.ceph.com 2024-09-16T05:16:42.770 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T05:16:42.847 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-16T05:16:42.853 DEBUG:teuthology.orchestra.run.smithi047:> uname -m 2024-09-16T05:16:42.859 INFO:teuthology.orchestra.run.smithi047.stdout:x86_64 2024-09-16T05:16:42.859 DEBUG:teuthology.orchestra.run.smithi047:> cat /etc/os-release 2024-09-16T05:16:42.905 INFO:teuthology.orchestra.run.smithi047.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-09-16T05:16:42.905 INFO:teuthology.orchestra.run.smithi047.stdout:NAME="Ubuntu" 2024-09-16T05:16:42.905 INFO:teuthology.orchestra.run.smithi047.stdout:VERSION_ID="22.04" 2024-09-16T05:16:42.905 INFO:teuthology.orchestra.run.smithi047.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-09-16T05:16:42.906 INFO:teuthology.orchestra.run.smithi047.stdout:VERSION_CODENAME=jammy 2024-09-16T05:16:42.906 INFO:teuthology.orchestra.run.smithi047.stdout:ID=ubuntu 2024-09-16T05:16:42.906 INFO:teuthology.orchestra.run.smithi047.stdout:ID_LIKE=debian 2024-09-16T05:16:42.906 INFO:teuthology.orchestra.run.smithi047.stdout:HOME_URL="https://www.ubuntu.com/" 2024-09-16T05:16:42.906 INFO:teuthology.orchestra.run.smithi047.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-09-16T05:16:42.906 INFO:teuthology.orchestra.run.smithi047.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-09-16T05:16:42.906 INFO:teuthology.orchestra.run.smithi047.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-09-16T05:16:42.906 INFO:teuthology.orchestra.run.smithi047.stdout:UBUNTU_CODENAME=jammy 2024-09-16T05:16:42.907 INFO:teuthology.lock.ops:Updating smithi047.front.sepia.ceph.com on lock server 2024-09-16T05:16:42.929 DEBUG:teuthology.orchestra.run.smithi086:> uname -m 2024-09-16T05:16:42.935 INFO:teuthology.orchestra.run.smithi086.stdout:x86_64 2024-09-16T05:16:42.935 DEBUG:teuthology.orchestra.run.smithi086:> cat /etc/os-release 2024-09-16T05:16:42.981 INFO:teuthology.orchestra.run.smithi086.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-09-16T05:16:42.981 INFO:teuthology.orchestra.run.smithi086.stdout:NAME="Ubuntu" 2024-09-16T05:16:42.981 INFO:teuthology.orchestra.run.smithi086.stdout:VERSION_ID="22.04" 2024-09-16T05:16:42.981 INFO:teuthology.orchestra.run.smithi086.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-09-16T05:16:42.981 INFO:teuthology.orchestra.run.smithi086.stdout:VERSION_CODENAME=jammy 2024-09-16T05:16:42.981 INFO:teuthology.orchestra.run.smithi086.stdout:ID=ubuntu 2024-09-16T05:16:42.981 INFO:teuthology.orchestra.run.smithi086.stdout:ID_LIKE=debian 2024-09-16T05:16:42.981 INFO:teuthology.orchestra.run.smithi086.stdout:HOME_URL="https://www.ubuntu.com/" 2024-09-16T05:16:42.981 INFO:teuthology.orchestra.run.smithi086.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-09-16T05:16:42.981 INFO:teuthology.orchestra.run.smithi086.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-09-16T05:16:42.982 INFO:teuthology.orchestra.run.smithi086.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-09-16T05:16:42.982 INFO:teuthology.orchestra.run.smithi086.stdout:UBUNTU_CODENAME=jammy 2024-09-16T05:16:42.982 INFO:teuthology.lock.ops:Updating smithi086.front.sepia.ceph.com on lock server 2024-09-16T05:16:43.004 DEBUG:teuthology.orchestra.run.smithi157:> uname -m 2024-09-16T05:16:43.010 INFO:teuthology.orchestra.run.smithi157.stdout:x86_64 2024-09-16T05:16:43.010 DEBUG:teuthology.orchestra.run.smithi157:> cat /etc/os-release 2024-09-16T05:16:43.056 INFO:teuthology.orchestra.run.smithi157.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-09-16T05:16:43.056 INFO:teuthology.orchestra.run.smithi157.stdout:NAME="Ubuntu" 2024-09-16T05:16:43.056 INFO:teuthology.orchestra.run.smithi157.stdout:VERSION_ID="22.04" 2024-09-16T05:16:43.056 INFO:teuthology.orchestra.run.smithi157.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-09-16T05:16:43.057 INFO:teuthology.orchestra.run.smithi157.stdout:VERSION_CODENAME=jammy 2024-09-16T05:16:43.057 INFO:teuthology.orchestra.run.smithi157.stdout:ID=ubuntu 2024-09-16T05:16:43.057 INFO:teuthology.orchestra.run.smithi157.stdout:ID_LIKE=debian 2024-09-16T05:16:43.057 INFO:teuthology.orchestra.run.smithi157.stdout:HOME_URL="https://www.ubuntu.com/" 2024-09-16T05:16:43.057 INFO:teuthology.orchestra.run.smithi157.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-09-16T05:16:43.057 INFO:teuthology.orchestra.run.smithi157.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-09-16T05:16:43.057 INFO:teuthology.orchestra.run.smithi157.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-09-16T05:16:43.057 INFO:teuthology.orchestra.run.smithi157.stdout:UBUNTU_CODENAME=jammy 2024-09-16T05:16:43.057 INFO:teuthology.lock.ops:Updating smithi157.front.sepia.ceph.com on lock server 2024-09-16T05:16:43.079 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-16T05:16:43.090 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-16T05:16:43.113 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-16T05:16:43.113 DEBUG:teuthology.orchestra.run.smithi047:> test '!' -e /home/ubuntu/cephtest 2024-09-16T05:16:43.116 DEBUG:teuthology.orchestra.run.smithi086:> test '!' -e /home/ubuntu/cephtest 2024-09-16T05:16:43.118 DEBUG:teuthology.orchestra.run.smithi157:> test '!' -e /home/ubuntu/cephtest 2024-09-16T05:16:43.123 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-16T05:16:43.139 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-16T05:16:43.139 DEBUG:teuthology.orchestra.run.smithi047:> test -z $(ls -A /var/lib/ceph) 2024-09-16T05:16:43.162 DEBUG:teuthology.orchestra.run.smithi086:> test -z $(ls -A /var/lib/ceph) 2024-09-16T05:16:43.166 DEBUG:teuthology.orchestra.run.smithi157:> test -z $(ls -A /var/lib/ceph) 2024-09-16T05:16:43.183 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-16T05:16:43.256 INFO:teuthology.run_tasks:Running task kernel... 2024-09-16T05:16:43.270 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-09-16T05:16:43.271 INFO:teuthology.task.kernel:config {'host.a': {'kdb': 1, 'sha1': 'distro'}, 'host.b': {'kdb': 1, 'sha1': 'distro'}, 'host.c': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-09-16T05:16:43.271 DEBUG:teuthology.orchestra.run.smithi047:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-16T05:16:43.271 DEBUG:teuthology.orchestra.run.smithi086:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-16T05:16:43.272 DEBUG:teuthology.orchestra.run.smithi157:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-16T05:16:43.276 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T05:16:43.277 DEBUG:teuthology.orchestra.run.smithi086:> uname -r 2024-09-16T05:16:43.278 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T05:16:43.278 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T05:16:43.278 DEBUG:teuthology.orchestra.run.smithi157:> uname -r 2024-09-16T05:16:43.279 DEBUG:teuthology.orchestra.run.smithi047:> uname -r 2024-09-16T05:16:43.324 INFO:teuthology.orchestra.run.smithi157.stdout:5.15.0-56-generic 2024-09-16T05:16:43.324 INFO:teuthology.task.kernel:Running kernel on smithi157: 5.15.0-56-generic 2024-09-16T05:16:43.324 DEBUG:teuthology.orchestra.run.smithi157:> sudo apt-get clean 2024-09-16T05:16:43.326 INFO:teuthology.orchestra.run.smithi047.stdout:5.15.0-56-generic 2024-09-16T05:16:43.326 INFO:teuthology.orchestra.run.smithi086.stdout:5.15.0-56-generic 2024-09-16T05:16:43.328 INFO:teuthology.task.kernel:Running kernel on smithi047: 5.15.0-56-generic 2024-09-16T05:16:43.328 DEBUG:teuthology.orchestra.run.smithi047:> sudo apt-get clean 2024-09-16T05:16:43.328 INFO:teuthology.task.kernel:Running kernel on smithi086: 5.15.0-56-generic 2024-09-16T05:16:43.328 DEBUG:teuthology.orchestra.run.smithi086:> sudo apt-get clean 2024-09-16T05:16:43.447 DEBUG:teuthology.orchestra.run.smithi047:> sudo apt-get update 2024-09-16T05:16:43.462 DEBUG:teuthology.orchestra.run.smithi157:> sudo apt-get update 2024-09-16T05:16:43.467 DEBUG:teuthology.orchestra.run.smithi086:> sudo apt-get update 2024-09-16T05:16:43.600 INFO:teuthology.orchestra.run.smithi157.stdout:Get:1 http://security.ubuntu.com/ubuntu jammy-security InRelease [129 kB] 2024-09-16T05:16:43.619 INFO:teuthology.orchestra.run.smithi086.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-16T05:16:43.641 INFO:teuthology.orchestra.run.smithi086.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [128 kB] 2024-09-16T05:16:43.699 INFO:teuthology.orchestra.run.smithi157.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-16T05:16:43.703 INFO:teuthology.orchestra.run.smithi086.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [127 kB] 2024-09-16T05:16:43.713 INFO:teuthology.orchestra.run.smithi047.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-16T05:16:43.713 INFO:teuthology.orchestra.run.smithi047.stdout:Get:2 http://security.ubuntu.com/ubuntu jammy-security InRelease [129 kB] 2024-09-16T05:16:43.733 INFO:teuthology.orchestra.run.smithi086.stdout:Get:4 http://security.ubuntu.com/ubuntu jammy-security InRelease [129 kB] 2024-09-16T05:16:43.781 INFO:teuthology.orchestra.run.smithi157.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [128 kB] 2024-09-16T05:16:43.781 INFO:teuthology.orchestra.run.smithi047.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [128 kB] 2024-09-16T05:16:43.810 INFO:teuthology.orchestra.run.smithi157.stdout:Get:4 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [539 kB] 2024-09-16T05:16:43.853 INFO:teuthology.orchestra.run.smithi086.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [696 kB] 2024-09-16T05:16:43.879 INFO:teuthology.orchestra.run.smithi157.stdout:Get:5 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,806 kB] 2024-09-16T05:16:43.917 INFO:teuthology.orchestra.run.smithi157.stdout:Get:6 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [295 kB] 2024-09-16T05:16:43.919 INFO:teuthology.orchestra.run.smithi157.stdout:Get:7 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [13.3 kB] 2024-09-16T05:16:43.921 INFO:teuthology.orchestra.run.smithi086.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [2,023 kB] 2024-09-16T05:16:43.939 INFO:teuthology.orchestra.run.smithi157.stdout:Get:8 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [37.7 kB] 2024-09-16T05:16:43.939 INFO:teuthology.orchestra.run.smithi157.stdout:Get:9 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [2,377 kB] 2024-09-16T05:16:43.956 INFO:teuthology.orchestra.run.smithi086.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [352 kB] 2024-09-16T05:16:43.959 INFO:teuthology.orchestra.run.smithi086.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [17.8 kB] 2024-09-16T05:16:43.960 INFO:teuthology.orchestra.run.smithi086.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [2,437 kB] 2024-09-16T05:16:43.975 INFO:teuthology.orchestra.run.smithi157.stdout:Get:10 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [409 kB] 2024-09-16T05:16:43.976 INFO:teuthology.orchestra.run.smithi086.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [39.3 kB] 2024-09-16T05:16:43.976 INFO:teuthology.orchestra.run.smithi086.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [419 kB] 2024-09-16T05:16:43.979 INFO:teuthology.orchestra.run.smithi086.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [616 B] 2024-09-16T05:16:43.979 INFO:teuthology.orchestra.run.smithi086.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [732 kB] 2024-09-16T05:16:43.980 INFO:teuthology.orchestra.run.smithi157.stdout:Get:11 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [584 B] 2024-09-16T05:16:43.981 INFO:teuthology.orchestra.run.smithi157.stdout:Get:12 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [627 kB] 2024-09-16T05:16:43.985 INFO:teuthology.orchestra.run.smithi086.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,124 kB] 2024-09-16T05:16:43.987 INFO:teuthology.orchestra.run.smithi157.stdout:Get:13 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [902 kB] 2024-09-16T05:16:43.993 INFO:teuthology.orchestra.run.smithi086.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [261 kB] 2024-09-16T05:16:43.995 INFO:teuthology.orchestra.run.smithi157.stdout:Get:14 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [176 kB] 2024-09-16T05:16:43.996 INFO:teuthology.orchestra.run.smithi086.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [26.1 kB] 2024-09-16T05:16:43.996 INFO:teuthology.orchestra.run.smithi086.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,752 B] 2024-09-16T05:16:43.997 INFO:teuthology.orchestra.run.smithi157.stdout:Get:15 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [19.2 kB] 2024-09-16T05:16:43.997 INFO:teuthology.orchestra.run.smithi157.stdout:Get:16 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-09-16T05:16:43.998 INFO:teuthology.orchestra.run.smithi157.stdout:Get:17 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-09-16T05:16:44.018 INFO:teuthology.orchestra.run.smithi086.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [43.3 kB] 2024-09-16T05:16:44.018 INFO:teuthology.orchestra.run.smithi086.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.8 kB] 2024-09-16T05:16:44.019 INFO:teuthology.orchestra.run.smithi086.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [444 B] 2024-09-16T05:16:44.019 INFO:teuthology.orchestra.run.smithi086.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.8 kB] 2024-09-16T05:16:44.019 INFO:teuthology.orchestra.run.smithi086.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.9 kB] 2024-09-16T05:16:44.020 INFO:teuthology.orchestra.run.smithi086.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.1 kB] 2024-09-16T05:16:44.020 INFO:teuthology.orchestra.run.smithi157.stdout:Get:18 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-09-16T05:16:44.020 INFO:teuthology.orchestra.run.smithi157.stdout:Get:19 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [228 B] 2024-09-16T05:16:44.026 INFO:teuthology.orchestra.run.smithi086.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-09-16T05:16:44.026 INFO:teuthology.orchestra.run.smithi086.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [17.3 kB] 2024-09-16T05:16:44.043 INFO:teuthology.orchestra.run.smithi086.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [28.8 kB] 2024-09-16T05:16:44.044 INFO:teuthology.orchestra.run.smithi086.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.5 kB] 2024-09-16T05:16:44.044 INFO:teuthology.orchestra.run.smithi086.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [672 B] 2024-09-16T05:16:44.136 INFO:teuthology.orchestra.run.smithi157.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [127 kB] 2024-09-16T05:16:44.136 INFO:teuthology.orchestra.run.smithi047.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [127 kB] 2024-09-16T05:16:44.160 INFO:teuthology.orchestra.run.smithi047.stdout:Get:5 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [539 kB] 2024-09-16T05:16:44.170 INFO:teuthology.orchestra.run.smithi086.stdout:Get:29 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [539 kB] 2024-09-16T05:16:44.275 INFO:teuthology.orchestra.run.smithi047.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [2,023 kB] 2024-09-16T05:16:44.277 INFO:teuthology.orchestra.run.smithi157.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [696 kB] 2024-09-16T05:16:44.454 INFO:teuthology.orchestra.run.smithi086.stdout:Get:30 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,806 kB] 2024-09-16T05:16:44.455 INFO:teuthology.orchestra.run.smithi047.stdout:Get:7 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,806 kB] 2024-09-16T05:16:44.474 INFO:teuthology.orchestra.run.smithi157.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [2,023 kB] 2024-09-16T05:16:44.593 INFO:teuthology.orchestra.run.smithi047.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [696 kB] 2024-09-16T05:16:44.627 INFO:teuthology.orchestra.run.smithi086.stdout:Get:31 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [295 kB] 2024-09-16T05:16:44.629 INFO:teuthology.orchestra.run.smithi047.stdout:Get:9 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [295 kB] 2024-09-16T05:16:44.629 INFO:teuthology.orchestra.run.smithi047.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [352 kB] 2024-09-16T05:16:44.634 INFO:teuthology.orchestra.run.smithi157.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [352 kB] 2024-09-16T05:16:44.639 INFO:teuthology.orchestra.run.smithi086.stdout:Get:32 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [13.3 kB] 2024-09-16T05:16:44.640 INFO:teuthology.orchestra.run.smithi086.stdout:Get:33 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [37.7 kB] 2024-09-16T05:16:44.641 INFO:teuthology.orchestra.run.smithi047.stdout:Get:11 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [13.3 kB] 2024-09-16T05:16:44.641 INFO:teuthology.orchestra.run.smithi086.stdout:Get:34 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [2,377 kB] 2024-09-16T05:16:44.642 INFO:teuthology.orchestra.run.smithi047.stdout:Get:12 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [37.7 kB] 2024-09-16T05:16:44.642 INFO:teuthology.orchestra.run.smithi047.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [17.8 kB] 2024-09-16T05:16:44.643 INFO:teuthology.orchestra.run.smithi047.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [39.3 kB] 2024-09-16T05:16:44.644 INFO:teuthology.orchestra.run.smithi047.stdout:Get:15 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [2,377 kB] 2024-09-16T05:16:44.645 INFO:teuthology.orchestra.run.smithi047.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [2,437 kB] 2024-09-16T05:16:44.648 INFO:teuthology.orchestra.run.smithi157.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [17.8 kB] 2024-09-16T05:16:44.649 INFO:teuthology.orchestra.run.smithi157.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [39.3 kB] 2024-09-16T05:16:44.650 INFO:teuthology.orchestra.run.smithi157.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [2,437 kB] 2024-09-16T05:16:44.714 INFO:teuthology.orchestra.run.smithi047.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [419 kB] 2024-09-16T05:16:44.719 INFO:teuthology.orchestra.run.smithi157.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [419 kB] 2024-09-16T05:16:44.725 INFO:teuthology.orchestra.run.smithi086.stdout:Get:35 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [409 kB] 2024-09-16T05:16:44.728 INFO:teuthology.orchestra.run.smithi047.stdout:Get:18 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [409 kB] 2024-09-16T05:16:44.728 INFO:teuthology.orchestra.run.smithi047.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [616 B] 2024-09-16T05:16:44.734 INFO:teuthology.orchestra.run.smithi086.stdout:Get:36 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [584 B] 2024-09-16T05:16:44.734 INFO:teuthology.orchestra.run.smithi086.stdout:Get:37 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [627 kB] 2024-09-16T05:16:44.735 INFO:teuthology.orchestra.run.smithi157.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [616 B] 2024-09-16T05:16:44.735 INFO:teuthology.orchestra.run.smithi157.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,124 kB] 2024-09-16T05:16:44.742 INFO:teuthology.orchestra.run.smithi047.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,124 kB] 2024-09-16T05:16:44.743 INFO:teuthology.orchestra.run.smithi047.stdout:Get:21 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [584 B] 2024-09-16T05:16:44.743 INFO:teuthology.orchestra.run.smithi047.stdout:Get:22 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [902 kB] 2024-09-16T05:16:44.752 INFO:teuthology.orchestra.run.smithi086.stdout:Get:38 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [902 kB] 2024-09-16T05:16:44.763 INFO:teuthology.orchestra.run.smithi047.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [732 kB] 2024-09-16T05:16:44.765 INFO:teuthology.orchestra.run.smithi047.stdout:Get:24 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [627 kB] 2024-09-16T05:16:44.766 INFO:teuthology.orchestra.run.smithi157.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [732 kB] 2024-09-16T05:16:44.781 INFO:teuthology.orchestra.run.smithi047.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [261 kB] 2024-09-16T05:16:44.784 INFO:teuthology.orchestra.run.smithi086.stdout:Get:39 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [176 kB] 2024-09-16T05:16:44.785 INFO:teuthology.orchestra.run.smithi157.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [261 kB] 2024-09-16T05:16:44.786 INFO:teuthology.orchestra.run.smithi047.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [26.1 kB] 2024-09-16T05:16:44.787 INFO:teuthology.orchestra.run.smithi047.stdout:Get:27 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [176 kB] 2024-09-16T05:16:44.787 INFO:teuthology.orchestra.run.smithi047.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [43.3 kB] 2024-09-16T05:16:44.788 INFO:teuthology.orchestra.run.smithi047.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,752 B] 2024-09-16T05:16:44.789 INFO:teuthology.orchestra.run.smithi047.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.8 kB] 2024-09-16T05:16:44.790 INFO:teuthology.orchestra.run.smithi086.stdout:Get:40 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [19.2 kB] 2024-09-16T05:16:44.791 INFO:teuthology.orchestra.run.smithi086.stdout:Get:41 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-09-16T05:16:44.791 INFO:teuthology.orchestra.run.smithi157.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [26.1 kB] 2024-09-16T05:16:44.791 INFO:teuthology.orchestra.run.smithi086.stdout:Get:42 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-09-16T05:16:44.792 INFO:teuthology.orchestra.run.smithi047.stdout:Get:31 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [19.2 kB] 2024-09-16T05:16:44.792 INFO:teuthology.orchestra.run.smithi086.stdout:Get:43 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-09-16T05:16:44.793 INFO:teuthology.orchestra.run.smithi047.stdout:Get:32 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-09-16T05:16:44.794 INFO:teuthology.orchestra.run.smithi047.stdout:Get:33 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-09-16T05:16:44.795 INFO:teuthology.orchestra.run.smithi047.stdout:Get:34 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-09-16T05:16:44.798 INFO:teuthology.orchestra.run.smithi157.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [43.3 kB] 2024-09-16T05:16:44.799 INFO:teuthology.orchestra.run.smithi157.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,752 B] 2024-09-16T05:16:44.799 INFO:teuthology.orchestra.run.smithi157.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.8 kB] 2024-09-16T05:16:44.839 INFO:teuthology.orchestra.run.smithi047.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [444 B] 2024-09-16T05:16:44.839 INFO:teuthology.orchestra.run.smithi047.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.9 kB] 2024-09-16T05:16:44.840 INFO:teuthology.orchestra.run.smithi047.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.8 kB] 2024-09-16T05:16:44.871 INFO:teuthology.orchestra.run.smithi047.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.1 kB] 2024-09-16T05:16:44.872 INFO:teuthology.orchestra.run.smithi086.stdout:Get:44 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [228 B] 2024-09-16T05:16:44.874 INFO:teuthology.orchestra.run.smithi157.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [444 B] 2024-09-16T05:16:44.874 INFO:teuthology.orchestra.run.smithi157.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.9 kB] 2024-09-16T05:16:44.875 INFO:teuthology.orchestra.run.smithi047.stdout:Get:39 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [228 B] 2024-09-16T05:16:44.875 INFO:teuthology.orchestra.run.smithi157.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.8 kB] 2024-09-16T05:16:44.876 INFO:teuthology.orchestra.run.smithi047.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-09-16T05:16:44.877 INFO:teuthology.orchestra.run.smithi157.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.1 kB] 2024-09-16T05:16:44.877 INFO:teuthology.orchestra.run.smithi157.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-09-16T05:16:44.878 INFO:teuthology.orchestra.run.smithi047.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [17.3 kB] 2024-09-16T05:16:44.879 INFO:teuthology.orchestra.run.smithi157.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [28.8 kB] 2024-09-16T05:16:44.880 INFO:teuthology.orchestra.run.smithi047.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [28.8 kB] 2024-09-16T05:16:44.880 INFO:teuthology.orchestra.run.smithi157.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [17.3 kB] 2024-09-16T05:16:44.882 INFO:teuthology.orchestra.run.smithi047.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.5 kB] 2024-09-16T05:16:44.920 INFO:teuthology.orchestra.run.smithi047.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [672 B] 2024-09-16T05:16:44.960 INFO:teuthology.orchestra.run.smithi157.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.5 kB] 2024-09-16T05:16:44.961 INFO:teuthology.orchestra.run.smithi157.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [672 B] 2024-09-16T05:16:50.101 INFO:teuthology.orchestra.run.smithi086.stdout:Fetched 16.0 MB in 2s (7,481 kB/s) 2024-09-16T05:16:50.707 INFO:teuthology.orchestra.run.smithi157.stdout:Fetched 16.0 MB in 2s (7,644 kB/s) 2024-09-16T05:16:51.251 INFO:teuthology.orchestra.run.smithi047.stdout:Fetched 16.0 MB in 3s (5,625 kB/s) 2024-09-16T05:16:51.570 INFO:teuthology.orchestra.run.smithi086.stdout:Reading package lists... 2024-09-16T05:16:51.588 DEBUG:teuthology.orchestra.run.smithi086:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-16T05:16:51.640 INFO:teuthology.orchestra.run.smithi086.stdout:Reading package lists... 2024-09-16T05:16:51.747 INFO:teuthology.orchestra.run.smithi157.stdout:Reading package lists... 2024-09-16T05:16:51.765 DEBUG:teuthology.orchestra.run.smithi157:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-16T05:16:51.828 INFO:teuthology.orchestra.run.smithi086.stdout:Building dependency tree... 2024-09-16T05:16:51.828 INFO:teuthology.orchestra.run.smithi157.stdout:Reading package lists... 2024-09-16T05:16:51.828 INFO:teuthology.orchestra.run.smithi086.stdout:Reading state information... 2024-09-16T05:16:51.994 INFO:teuthology.orchestra.run.smithi086.stdout:The following packages were automatically installed and are no longer required: 2024-09-16T05:16:51.994 INFO:teuthology.orchestra.run.smithi086.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-16T05:16:51.994 INFO:teuthology.orchestra.run.smithi086.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-16T05:16:51.994 INFO:teuthology.orchestra.run.smithi086.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-16T05:16:51.994 INFO:teuthology.orchestra.run.smithi086.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-09-16T05:16:51.995 INFO:teuthology.orchestra.run.smithi086.stdout: python2.7-minimal 2024-09-16T05:16:51.995 INFO:teuthology.orchestra.run.smithi086.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-16T05:16:51.996 INFO:teuthology.orchestra.run.smithi086.stdout:The following additional packages will be installed: 2024-09-16T05:16:51.996 INFO:teuthology.orchestra.run.smithi086.stdout: linux-generic linux-headers-5.15.0-121 linux-headers-5.15.0-121-generic 2024-09-16T05:16:51.996 INFO:teuthology.orchestra.run.smithi086.stdout: linux-headers-generic linux-image-5.15.0-121-generic 2024-09-16T05:16:51.996 INFO:teuthology.orchestra.run.smithi086.stdout: linux-modules-5.15.0-121-generic linux-modules-extra-5.15.0-121-generic 2024-09-16T05:16:51.997 INFO:teuthology.orchestra.run.smithi086.stdout:Suggested packages: 2024-09-16T05:16:51.997 INFO:teuthology.orchestra.run.smithi086.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-09-16T05:16:51.998 INFO:teuthology.orchestra.run.smithi086.stdout:Recommended packages: 2024-09-16T05:16:51.998 INFO:teuthology.orchestra.run.smithi086.stdout: thermald 2024-09-16T05:16:52.021 INFO:teuthology.orchestra.run.smithi157.stdout:Building dependency tree... 2024-09-16T05:16:52.023 INFO:teuthology.orchestra.run.smithi157.stdout:Reading state information... 2024-09-16T05:16:52.058 INFO:teuthology.orchestra.run.smithi086.stdout:The following NEW packages will be installed: 2024-09-16T05:16:52.058 INFO:teuthology.orchestra.run.smithi086.stdout: linux-headers-5.15.0-121 linux-headers-5.15.0-121-generic 2024-09-16T05:16:52.058 INFO:teuthology.orchestra.run.smithi086.stdout: linux-image-5.15.0-121-generic linux-modules-5.15.0-121-generic 2024-09-16T05:16:52.058 INFO:teuthology.orchestra.run.smithi086.stdout: linux-modules-extra-5.15.0-121-generic 2024-09-16T05:16:52.059 INFO:teuthology.orchestra.run.smithi086.stdout:The following packages will be upgraded: 2024-09-16T05:16:52.060 INFO:teuthology.orchestra.run.smithi086.stdout: linux-generic linux-headers-generic linux-image-generic 2024-09-16T05:16:52.188 INFO:teuthology.orchestra.run.smithi157.stdout:The following packages were automatically installed and are no longer required: 2024-09-16T05:16:52.188 INFO:teuthology.orchestra.run.smithi157.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-16T05:16:52.188 INFO:teuthology.orchestra.run.smithi157.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-16T05:16:52.188 INFO:teuthology.orchestra.run.smithi157.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-16T05:16:52.189 INFO:teuthology.orchestra.run.smithi157.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-09-16T05:16:52.189 INFO:teuthology.orchestra.run.smithi157.stdout: python2.7-minimal 2024-09-16T05:16:52.189 INFO:teuthology.orchestra.run.smithi157.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-16T05:16:52.190 INFO:teuthology.orchestra.run.smithi157.stdout:The following additional packages will be installed: 2024-09-16T05:16:52.190 INFO:teuthology.orchestra.run.smithi157.stdout: linux-generic linux-headers-5.15.0-121 linux-headers-5.15.0-121-generic 2024-09-16T05:16:52.190 INFO:teuthology.orchestra.run.smithi157.stdout: linux-headers-generic linux-image-5.15.0-121-generic 2024-09-16T05:16:52.190 INFO:teuthology.orchestra.run.smithi157.stdout: linux-modules-5.15.0-121-generic linux-modules-extra-5.15.0-121-generic 2024-09-16T05:16:52.192 INFO:teuthology.orchestra.run.smithi157.stdout:Suggested packages: 2024-09-16T05:16:52.192 INFO:teuthology.orchestra.run.smithi157.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-09-16T05:16:52.192 INFO:teuthology.orchestra.run.smithi157.stdout:Recommended packages: 2024-09-16T05:16:52.192 INFO:teuthology.orchestra.run.smithi157.stdout: thermald 2024-09-16T05:16:52.237 INFO:teuthology.orchestra.run.smithi157.stdout:The following NEW packages will be installed: 2024-09-16T05:16:52.237 INFO:teuthology.orchestra.run.smithi157.stdout: linux-headers-5.15.0-121 linux-headers-5.15.0-121-generic 2024-09-16T05:16:52.238 INFO:teuthology.orchestra.run.smithi157.stdout: linux-image-5.15.0-121-generic linux-modules-5.15.0-121-generic 2024-09-16T05:16:52.238 INFO:teuthology.orchestra.run.smithi157.stdout: linux-modules-extra-5.15.0-121-generic 2024-09-16T05:16:52.239 INFO:teuthology.orchestra.run.smithi157.stdout:The following packages will be upgraded: 2024-09-16T05:16:52.239 INFO:teuthology.orchestra.run.smithi086.stdout:3 upgraded, 5 newly installed, 0 to remove and 344 not upgraded. 2024-09-16T05:16:52.240 INFO:teuthology.orchestra.run.smithi086.stdout:Need to get 113 MB of archives. 2024-09-16T05:16:52.240 INFO:teuthology.orchestra.run.smithi086.stdout:After this operation, 584 MB of additional disk space will be used. 2024-09-16T05:16:52.240 INFO:teuthology.orchestra.run.smithi086.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-121-generic amd64 5.15.0-121.131 [22.7 MB] 2024-09-16T05:16:52.240 INFO:teuthology.orchestra.run.smithi157.stdout: linux-generic linux-headers-generic linux-image-generic 2024-09-16T05:16:52.292 INFO:teuthology.orchestra.run.smithi157.stdout:3 upgraded, 5 newly installed, 0 to remove and 344 not upgraded. 2024-09-16T05:16:52.293 INFO:teuthology.orchestra.run.smithi157.stdout:Need to get 113 MB of archives. 2024-09-16T05:16:52.293 INFO:teuthology.orchestra.run.smithi157.stdout:After this operation, 584 MB of additional disk space will be used. 2024-09-16T05:16:52.293 INFO:teuthology.orchestra.run.smithi157.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-121-generic amd64 5.15.0-121.131 [22.7 MB] 2024-09-16T05:16:52.730 INFO:teuthology.orchestra.run.smithi157.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-121-generic amd64 5.15.0-121.131 [11.5 MB] 2024-09-16T05:16:52.794 INFO:teuthology.orchestra.run.smithi047.stdout:Reading package lists... 2024-09-16T05:16:52.813 DEBUG:teuthology.orchestra.run.smithi047:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-16T05:16:52.827 INFO:teuthology.orchestra.run.smithi157.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-121-generic amd64 5.15.0-121.131 [63.9 MB] 2024-09-16T05:16:52.922 INFO:teuthology.orchestra.run.smithi047.stdout:Reading package lists... 2024-09-16T05:16:53.140 INFO:teuthology.orchestra.run.smithi047.stdout:Building dependency tree... 2024-09-16T05:16:53.140 INFO:teuthology.orchestra.run.smithi047.stdout:Reading state information... 2024-09-16T05:16:53.336 INFO:teuthology.orchestra.run.smithi047.stdout:The following packages were automatically installed and are no longer required: 2024-09-16T05:16:53.336 INFO:teuthology.orchestra.run.smithi047.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-16T05:16:53.336 INFO:teuthology.orchestra.run.smithi047.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-16T05:16:53.336 INFO:teuthology.orchestra.run.smithi047.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-16T05:16:53.336 INFO:teuthology.orchestra.run.smithi047.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-09-16T05:16:53.337 INFO:teuthology.orchestra.run.smithi047.stdout: python2.7-minimal 2024-09-16T05:16:53.337 INFO:teuthology.orchestra.run.smithi047.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-16T05:16:53.338 INFO:teuthology.orchestra.run.smithi047.stdout:The following additional packages will be installed: 2024-09-16T05:16:53.338 INFO:teuthology.orchestra.run.smithi047.stdout: linux-generic linux-headers-5.15.0-121 linux-headers-5.15.0-121-generic 2024-09-16T05:16:53.338 INFO:teuthology.orchestra.run.smithi047.stdout: linux-headers-generic linux-image-5.15.0-121-generic 2024-09-16T05:16:53.339 INFO:teuthology.orchestra.run.smithi047.stdout: linux-modules-5.15.0-121-generic linux-modules-extra-5.15.0-121-generic 2024-09-16T05:16:53.340 INFO:teuthology.orchestra.run.smithi047.stdout:Suggested packages: 2024-09-16T05:16:53.340 INFO:teuthology.orchestra.run.smithi047.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-09-16T05:16:53.340 INFO:teuthology.orchestra.run.smithi047.stdout:Recommended packages: 2024-09-16T05:16:53.340 INFO:teuthology.orchestra.run.smithi047.stdout: thermald 2024-09-16T05:16:53.393 INFO:teuthology.orchestra.run.smithi047.stdout:The following NEW packages will be installed: 2024-09-16T05:16:53.394 INFO:teuthology.orchestra.run.smithi047.stdout: linux-headers-5.15.0-121 linux-headers-5.15.0-121-generic 2024-09-16T05:16:53.394 INFO:teuthology.orchestra.run.smithi047.stdout: linux-image-5.15.0-121-generic linux-modules-5.15.0-121-generic 2024-09-16T05:16:53.394 INFO:teuthology.orchestra.run.smithi047.stdout: linux-modules-extra-5.15.0-121-generic 2024-09-16T05:16:53.395 INFO:teuthology.orchestra.run.smithi047.stdout:The following packages will be upgraded: 2024-09-16T05:16:53.396 INFO:teuthology.orchestra.run.smithi047.stdout: linux-generic linux-headers-generic linux-image-generic 2024-09-16T05:16:53.576 INFO:teuthology.orchestra.run.smithi047.stdout:3 upgraded, 5 newly installed, 0 to remove and 344 not upgraded. 2024-09-16T05:16:53.576 INFO:teuthology.orchestra.run.smithi047.stdout:Need to get 113 MB of archives. 2024-09-16T05:16:53.577 INFO:teuthology.orchestra.run.smithi047.stdout:After this operation, 584 MB of additional disk space will be used. 2024-09-16T05:16:53.577 INFO:teuthology.orchestra.run.smithi047.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-121-generic amd64 5.15.0-121.131 [22.7 MB] 2024-09-16T05:16:53.668 INFO:teuthology.orchestra.run.smithi157.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.121.121 [1,694 B] 2024-09-16T05:16:53.669 INFO:teuthology.orchestra.run.smithi157.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.121.121 [2,464 B] 2024-09-16T05:16:53.669 INFO:teuthology.orchestra.run.smithi157.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-121 all 5.15.0-121.131 [12.3 MB] 2024-09-16T05:16:53.721 INFO:teuthology.orchestra.run.smithi086.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-121-generic amd64 5.15.0-121.131 [11.5 MB] 2024-09-16T05:16:53.800 INFO:teuthology.orchestra.run.smithi157.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-121-generic amd64 5.15.0-121.131 [2,827 kB] 2024-09-16T05:16:53.872 INFO:teuthology.orchestra.run.smithi157.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.121.121 [2,316 B] 2024-09-16T05:16:54.073 INFO:teuthology.orchestra.run.smithi086.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-121-generic amd64 5.15.0-121.131 [63.9 MB] 2024-09-16T05:16:54.251 INFO:teuthology.orchestra.run.smithi157.stdout:Fetched 113 MB in 2s (69.7 MB/s) 2024-09-16T05:16:54.441 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package linux-modules-5.15.0-121-generic. 2024-09-16T05:16:54.983 INFO:teuthology.orchestra.run.smithi047.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-121-generic amd64 5.15.0-121.131 [11.5 MB] 2024-09-16T05:16:55.349 INFO:teuthology.orchestra.run.smithi047.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-121-generic amd64 5.15.0-121.131 [63.9 MB] 2024-09-16T05:16:56.275 INFO:teuthology.orchestra.run.smithi086.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.121.121 [1,694 B] 2024-09-16T05:16:56.275 INFO:teuthology.orchestra.run.smithi086.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.121.121 [2,464 B] 2024-09-16T05:16:56.276 INFO:teuthology.orchestra.run.smithi086.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-121 all 5.15.0-121.131 [12.3 MB] 2024-09-16T05:16:56.463 INFO:teuthology.orchestra.run.smithi157.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-09-16T05:16:56.468 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../0-linux-modules-5.15.0-121-generic_5.15.0-121.131_amd64.deb ... 2024-09-16T05:16:56.571 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking linux-modules-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-16T05:16:56.632 INFO:teuthology.orchestra.run.smithi086.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-121-generic amd64 5.15.0-121.131 [2,827 kB] 2024-09-16T05:16:56.713 INFO:teuthology.orchestra.run.smithi086.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.121.121 [2,316 B] 2024-09-16T05:16:57.100 INFO:teuthology.orchestra.run.smithi086.stdout:Fetched 113 MB in 5s (24.4 MB/s) 2024-09-16T05:16:57.292 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package linux-modules-5.15.0-121-generic. 2024-09-16T05:16:57.520 INFO:teuthology.orchestra.run.smithi047.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.121.121 [1,694 B] 2024-09-16T05:16:57.520 INFO:teuthology.orchestra.run.smithi047.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.121.121 [2,464 B] 2024-09-16T05:16:57.596 INFO:teuthology.orchestra.run.smithi047.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-121 all 5.15.0-121.131 [12.3 MB] 2024-09-16T05:16:58.105 INFO:teuthology.orchestra.run.smithi047.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-121-generic amd64 5.15.0-121.131 [2,827 kB] 2024-09-16T05:16:58.194 INFO:teuthology.orchestra.run.smithi047.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.121.121 [2,316 B] 2024-09-16T05:16:58.605 INFO:teuthology.orchestra.run.smithi047.stdout:Fetched 113 MB in 5s (23.7 MB/s) 2024-09-16T05:16:58.794 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package linux-modules-5.15.0-121-generic. 2024-09-16T05:16:58.798 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package linux-image-5.15.0-121-generic. 2024-09-16T05:16:58.820 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../1-linux-image-5.15.0-121-generic_5.15.0-121.131_amd64.deb ... 2024-09-16T05:16:58.892 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking linux-image-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-16T05:16:59.259 INFO:teuthology.orchestra.run.smithi086.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-09-16T05:16:59.264 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../0-linux-modules-5.15.0-121-generic_5.15.0-121.131_amd64.deb ... 2024-09-16T05:16:59.318 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-121-generic. 2024-09-16T05:16:59.339 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-121-generic_5.15.0-121.131_amd64.deb ... 2024-09-16T05:16:59.347 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking linux-modules-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-16T05:16:59.376 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking linux-modules-extra-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-16T05:17:00.726 INFO:teuthology.orchestra.run.smithi047.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-09-16T05:17:00.730 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../0-linux-modules-5.15.0-121-generic_5.15.0-121.131_amd64.deb ... 2024-09-16T05:17:00.816 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking linux-modules-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-16T05:17:01.365 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package linux-image-5.15.0-121-generic. 2024-09-16T05:17:01.386 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../1-linux-image-5.15.0-121-generic_5.15.0-121.131_amd64.deb ... 2024-09-16T05:17:01.472 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking linux-image-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-16T05:17:01.893 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-121-generic. 2024-09-16T05:17:01.916 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-121-generic_5.15.0-121.131_amd64.deb ... 2024-09-16T05:17:01.954 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking linux-modules-extra-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-16T05:17:03.084 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package linux-image-5.15.0-121-generic. 2024-09-16T05:17:03.106 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../1-linux-image-5.15.0-121-generic_5.15.0-121.131_amd64.deb ... 2024-09-16T05:17:03.200 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking linux-image-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-16T05:17:03.612 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-121-generic. 2024-09-16T05:17:03.633 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-121-generic_5.15.0-121.131_amd64.deb ... 2024-09-16T05:17:03.662 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking linux-modules-extra-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-16T05:17:06.263 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../3-linux-generic_5.15.0.121.121_amd64.deb ... 2024-09-16T05:17:06.362 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking linux-generic (5.15.0.121.121) over (5.15.0.56.54) ... 2024-09-16T05:17:06.663 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.121.121_amd64.deb ... 2024-09-16T05:17:06.816 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking linux-image-generic (5.15.0.121.121) over (5.15.0.56.54) ... 2024-09-16T05:17:07.119 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package linux-headers-5.15.0-121. 2024-09-16T05:17:07.141 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../5-linux-headers-5.15.0-121_5.15.0-121.131_all.deb ... 2024-09-16T05:17:07.186 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking linux-headers-5.15.0-121 (5.15.0-121.131) ... 2024-09-16T05:17:08.245 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../3-linux-generic_5.15.0.121.121_amd64.deb ... 2024-09-16T05:17:08.370 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking linux-generic (5.15.0.121.121) over (5.15.0.56.54) ... 2024-09-16T05:17:08.736 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.121.121_amd64.deb ... 2024-09-16T05:17:08.865 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking linux-image-generic (5.15.0.121.121) over (5.15.0.56.54) ... 2024-09-16T05:17:09.151 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package linux-headers-5.15.0-121. 2024-09-16T05:17:09.162 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../5-linux-headers-5.15.0-121_5.15.0-121.131_all.deb ... 2024-09-16T05:17:09.193 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking linux-headers-5.15.0-121 (5.15.0-121.131) ... 2024-09-16T05:17:09.505 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../3-linux-generic_5.15.0.121.121_amd64.deb ... 2024-09-16T05:17:09.632 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking linux-generic (5.15.0.121.121) over (5.15.0.56.54) ... 2024-09-16T05:17:09.949 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.121.121_amd64.deb ... 2024-09-16T05:17:10.094 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking linux-image-generic (5.15.0.121.121) over (5.15.0.56.54) ... 2024-09-16T05:17:10.339 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package linux-headers-5.15.0-121. 2024-09-16T05:17:10.349 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../5-linux-headers-5.15.0-121_5.15.0-121.131_all.deb ... 2024-09-16T05:17:10.388 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking linux-headers-5.15.0-121 (5.15.0-121.131) ... 2024-09-16T05:17:13.240 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package linux-headers-5.15.0-121-generic. 2024-09-16T05:17:13.265 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../6-linux-headers-5.15.0-121-generic_5.15.0-121.131_amd64.deb ... 2024-09-16T05:17:13.307 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking linux-headers-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-16T05:17:14.404 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package linux-headers-5.15.0-121-generic. 2024-09-16T05:17:14.440 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../6-linux-headers-5.15.0-121-generic_5.15.0-121.131_amd64.deb ... 2024-09-16T05:17:14.479 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking linux-headers-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-16T05:17:16.053 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.121.121_amd64.deb ... 2024-09-16T05:17:16.175 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking linux-headers-generic (5.15.0.121.121) over (5.15.0.56.54) ... 2024-09-16T05:17:16.197 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package linux-headers-5.15.0-121-generic. 2024-09-16T05:17:16.235 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../6-linux-headers-5.15.0-121-generic_5.15.0-121.131_amd64.deb ... 2024-09-16T05:17:16.263 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking linux-headers-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-16T05:17:16.517 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up linux-headers-5.15.0-121 (5.15.0-121.131) ... 2024-09-16T05:17:16.629 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up linux-headers-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-16T05:17:16.747 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up linux-headers-generic (5.15.0.121.121) ... 2024-09-16T05:17:16.900 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up linux-image-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-16T05:17:17.488 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.121.121_amd64.deb ... 2024-09-16T05:17:17.613 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking linux-headers-generic (5.15.0.121.121) over (5.15.0.56.54) ... 2024-09-16T05:17:17.938 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up linux-headers-5.15.0-121 (5.15.0-121.131) ... 2024-09-16T05:17:18.060 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up linux-headers-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-16T05:17:18.186 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up linux-headers-generic (5.15.0.121.121) ... 2024-09-16T05:17:18.281 INFO:teuthology.orchestra.run.smithi157.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-09-16T05:17:18.281 INFO:teuthology.orchestra.run.smithi157.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-09-16T05:17:18.281 INFO:teuthology.orchestra.run.smithi157.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-121-generic 2024-09-16T05:17:18.282 INFO:teuthology.orchestra.run.smithi157.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-121-generic 2024-09-16T05:17:18.330 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up linux-image-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-16T05:17:18.428 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up linux-modules-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-16T05:17:18.930 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.121.121_amd64.deb ... 2024-09-16T05:17:19.742 INFO:teuthology.orchestra.run.smithi086.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-09-16T05:17:19.742 INFO:teuthology.orchestra.run.smithi086.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-09-16T05:17:19.742 INFO:teuthology.orchestra.run.smithi086.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-121-generic 2024-09-16T05:17:19.742 INFO:teuthology.orchestra.run.smithi086.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-121-generic 2024-09-16T05:17:19.843 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking linux-headers-generic (5.15.0.121.121) over (5.15.0.56.54) ... 2024-09-16T05:17:19.983 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up linux-modules-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-16T05:17:20.142 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up linux-headers-5.15.0-121 (5.15.0-121.131) ... 2024-09-16T05:17:20.264 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up linux-headers-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-16T05:17:20.390 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up linux-headers-generic (5.15.0.121.121) ... 2024-09-16T05:17:20.453 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up linux-modules-extra-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-16T05:17:20.518 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up linux-image-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-16T05:17:21.376 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up linux-modules-extra-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-16T05:17:21.846 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up linux-image-generic (5.15.0.121.121) ... 2024-09-16T05:17:21.867 INFO:teuthology.orchestra.run.smithi047.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-09-16T05:17:21.867 INFO:teuthology.orchestra.run.smithi047.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-09-16T05:17:21.867 INFO:teuthology.orchestra.run.smithi047.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-121-generic 2024-09-16T05:17:21.867 INFO:teuthology.orchestra.run.smithi047.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-121-generic 2024-09-16T05:17:21.997 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up linux-generic (5.15.0.121.121) ... 2024-09-16T05:17:22.021 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up linux-modules-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-16T05:17:22.124 INFO:teuthology.orchestra.run.smithi157.stdout:Processing triggers for linux-image-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-16T05:17:22.198 INFO:teuthology.orchestra.run.smithi157.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-09-16T05:17:22.198 INFO:teuthology.orchestra.run.smithi157.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-121-generic 2024-09-16T05:17:22.743 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up linux-image-generic (5.15.0.121.121) ... 2024-09-16T05:17:22.869 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up linux-generic (5.15.0.121.121) ... 2024-09-16T05:17:22.995 INFO:teuthology.orchestra.run.smithi086.stdout:Processing triggers for linux-image-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-16T05:17:23.051 INFO:teuthology.orchestra.run.smithi086.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-09-16T05:17:23.051 INFO:teuthology.orchestra.run.smithi086.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-121-generic 2024-09-16T05:17:23.472 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up linux-modules-extra-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-16T05:17:25.649 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up linux-image-generic (5.15.0.121.121) ... 2024-09-16T05:17:25.774 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up linux-generic (5.15.0.121.121) ... 2024-09-16T05:17:25.884 INFO:teuthology.orchestra.run.smithi047.stdout:Processing triggers for linux-image-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-16T05:17:25.941 INFO:teuthology.orchestra.run.smithi047.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-09-16T05:17:25.941 INFO:teuthology.orchestra.run.smithi047.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-121-generic 2024-09-16T05:17:36.607 INFO:teuthology.orchestra.run.smithi157.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-09-16T05:17:36.607 INFO:teuthology.orchestra.run.smithi157.stdout:Sourcing file `/etc/default/grub' 2024-09-16T05:17:36.638 INFO:teuthology.orchestra.run.smithi157.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-16T05:17:36.666 INFO:teuthology.orchestra.run.smithi157.stdout:Generating grub configuration file ... 2024-09-16T05:17:36.762 INFO:teuthology.orchestra.run.smithi086.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-09-16T05:17:36.762 INFO:teuthology.orchestra.run.smithi086.stdout:Sourcing file `/etc/default/grub' 2024-09-16T05:17:36.780 INFO:teuthology.orchestra.run.smithi086.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-16T05:17:36.808 INFO:teuthology.orchestra.run.smithi086.stdout:Generating grub configuration file ... 2024-09-16T05:17:36.919 INFO:teuthology.orchestra.run.smithi157.stdout:Found linux image: /boot/vmlinuz-5.15.0-121-generic 2024-09-16T05:17:36.944 INFO:teuthology.orchestra.run.smithi157.stdout:Found initrd image: /boot/initrd.img-5.15.0-121-generic 2024-09-16T05:17:37.056 INFO:teuthology.orchestra.run.smithi086.stdout:Found linux image: /boot/vmlinuz-5.15.0-121-generic 2024-09-16T05:17:37.076 INFO:teuthology.orchestra.run.smithi086.stdout:Found initrd image: /boot/initrd.img-5.15.0-121-generic 2024-09-16T05:17:37.262 INFO:teuthology.orchestra.run.smithi157.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-16T05:17:37.269 INFO:teuthology.orchestra.run.smithi157.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-16T05:17:37.342 INFO:teuthology.orchestra.run.smithi157.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-16T05:17:37.348 INFO:teuthology.orchestra.run.smithi157.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-16T05:17:37.372 INFO:teuthology.orchestra.run.smithi086.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-16T05:17:37.378 INFO:teuthology.orchestra.run.smithi086.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-16T05:17:37.449 INFO:teuthology.orchestra.run.smithi086.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-16T05:17:37.454 INFO:teuthology.orchestra.run.smithi086.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-16T05:17:37.504 INFO:teuthology.orchestra.run.smithi157.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-16T05:17:37.504 INFO:teuthology.orchestra.run.smithi157.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-09-16T05:17:37.504 INFO:teuthology.orchestra.run.smithi157.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-16T05:17:37.543 INFO:teuthology.orchestra.run.smithi157.stdout:done 2024-09-16T05:17:37.628 INFO:teuthology.orchestra.run.smithi086.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-16T05:17:37.628 INFO:teuthology.orchestra.run.smithi086.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-09-16T05:17:37.628 INFO:teuthology.orchestra.run.smithi086.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-16T05:17:37.664 INFO:teuthology.orchestra.run.smithi086.stdout:done 2024-09-16T05:17:38.045 DEBUG:teuthology.orchestra.run.smithi157:> dpkg -s linux-image-generic 2024-09-16T05:17:38.065 INFO:teuthology.orchestra.run.smithi157.stdout:Package: linux-image-generic 2024-09-16T05:17:38.065 INFO:teuthology.orchestra.run.smithi157.stdout:Status: install ok installed 2024-09-16T05:17:38.065 INFO:teuthology.orchestra.run.smithi157.stdout:Priority: optional 2024-09-16T05:17:38.066 INFO:teuthology.orchestra.run.smithi157.stdout:Section: kernel 2024-09-16T05:17:38.066 INFO:teuthology.orchestra.run.smithi157.stdout:Installed-Size: 21 2024-09-16T05:17:38.066 INFO:teuthology.orchestra.run.smithi157.stdout:Maintainer: Ubuntu Kernel Team 2024-09-16T05:17:38.066 INFO:teuthology.orchestra.run.smithi157.stdout:Architecture: amd64 2024-09-16T05:17:38.066 INFO:teuthology.orchestra.run.smithi157.stdout:Source: linux-meta 2024-09-16T05:17:38.066 INFO:teuthology.orchestra.run.smithi157.stdout:Version: 5.15.0.121.121 2024-09-16T05:17:38.066 INFO:teuthology.orchestra.run.smithi157.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-121), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-16T05:17:38.066 INFO:teuthology.orchestra.run.smithi157.stdout:Depends: linux-image-5.15.0-121-generic, linux-modules-extra-5.15.0-121-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-16T05:17:38.066 INFO:teuthology.orchestra.run.smithi157.stdout:Recommends: thermald 2024-09-16T05:17:38.066 INFO:teuthology.orchestra.run.smithi157.stdout:Description: Generic Linux kernel image 2024-09-16T05:17:38.066 INFO:teuthology.orchestra.run.smithi157.stdout: This package will always depend on the latest generic kernel image 2024-09-16T05:17:38.066 INFO:teuthology.orchestra.run.smithi157.stdout: available. 2024-09-16T05:17:38.067 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-121-generic 2024-09-16T05:17:38.067 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-16T05:17:38.067 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-16T05:17:38.067 INFO:teuthology.task.kernel:Installing distro kernel on host.c... 2024-09-16T05:17:38.067 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi157.front.sepia.ceph.com, path=None, version=distro) 2024-09-16T05:17:38.067 DEBUG:teuthology.orchestra.run.smithi157:> sudo apt-get clean 2024-09-16T05:17:38.150 DEBUG:teuthology.orchestra.run.smithi086:> dpkg -s linux-image-generic 2024-09-16T05:17:38.169 INFO:teuthology.orchestra.run.smithi086.stdout:Package: linux-image-generic 2024-09-16T05:17:38.169 INFO:teuthology.orchestra.run.smithi086.stdout:Status: install ok installed 2024-09-16T05:17:38.170 INFO:teuthology.orchestra.run.smithi086.stdout:Priority: optional 2024-09-16T05:17:38.170 INFO:teuthology.orchestra.run.smithi086.stdout:Section: kernel 2024-09-16T05:17:38.170 INFO:teuthology.orchestra.run.smithi086.stdout:Installed-Size: 21 2024-09-16T05:17:38.170 INFO:teuthology.orchestra.run.smithi086.stdout:Maintainer: Ubuntu Kernel Team 2024-09-16T05:17:38.170 INFO:teuthology.orchestra.run.smithi086.stdout:Architecture: amd64 2024-09-16T05:17:38.170 INFO:teuthology.orchestra.run.smithi086.stdout:Source: linux-meta 2024-09-16T05:17:38.170 INFO:teuthology.orchestra.run.smithi086.stdout:Version: 5.15.0.121.121 2024-09-16T05:17:38.170 INFO:teuthology.orchestra.run.smithi086.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-121), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-16T05:17:38.170 INFO:teuthology.orchestra.run.smithi086.stdout:Depends: linux-image-5.15.0-121-generic, linux-modules-extra-5.15.0-121-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-16T05:17:38.170 INFO:teuthology.orchestra.run.smithi086.stdout:Recommends: thermald 2024-09-16T05:17:38.170 INFO:teuthology.orchestra.run.smithi086.stdout:Description: Generic Linux kernel image 2024-09-16T05:17:38.170 INFO:teuthology.orchestra.run.smithi086.stdout: This package will always depend on the latest generic kernel image 2024-09-16T05:17:38.171 INFO:teuthology.orchestra.run.smithi086.stdout: available. 2024-09-16T05:17:38.171 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-121-generic 2024-09-16T05:17:38.171 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-16T05:17:38.171 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-16T05:17:38.171 INFO:teuthology.task.kernel:Installing distro kernel on host.b... 2024-09-16T05:17:38.171 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi086.front.sepia.ceph.com, path=None, version=distro) 2024-09-16T05:17:38.171 DEBUG:teuthology.orchestra.run.smithi086:> sudo apt-get clean 2024-09-16T05:17:38.227 DEBUG:teuthology.orchestra.run.smithi157:> sudo apt-get update 2024-09-16T05:17:38.292 DEBUG:teuthology.orchestra.run.smithi086:> sudo apt-get update 2024-09-16T05:17:38.341 INFO:teuthology.orchestra.run.smithi157.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-16T05:17:38.419 INFO:teuthology.orchestra.run.smithi086.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-16T05:17:38.462 INFO:teuthology.orchestra.run.smithi157.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-16T05:17:38.524 INFO:teuthology.orchestra.run.smithi086.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-16T05:17:38.547 INFO:teuthology.orchestra.run.smithi157.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-16T05:17:38.605 INFO:teuthology.orchestra.run.smithi086.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-16T05:17:38.624 INFO:teuthology.orchestra.run.smithi157.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-16T05:17:38.686 INFO:teuthology.orchestra.run.smithi086.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-16T05:17:39.755 INFO:teuthology.orchestra.run.smithi086.stdout:Reading package lists... 2024-09-16T05:17:39.776 DEBUG:teuthology.orchestra.run.smithi086:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-16T05:17:39.798 INFO:teuthology.orchestra.run.smithi157.stdout:Reading package lists... 2024-09-16T05:17:39.818 DEBUG:teuthology.orchestra.run.smithi157:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-16T05:17:39.839 INFO:teuthology.orchestra.run.smithi086.stdout:Reading package lists... 2024-09-16T05:17:39.879 INFO:teuthology.orchestra.run.smithi157.stdout:Reading package lists... 2024-09-16T05:17:40.059 INFO:teuthology.orchestra.run.smithi086.stdout:Building dependency tree... 2024-09-16T05:17:40.059 INFO:teuthology.orchestra.run.smithi086.stdout:Reading state information... 2024-09-16T05:17:40.100 INFO:teuthology.orchestra.run.smithi157.stdout:Building dependency tree... 2024-09-16T05:17:40.100 INFO:teuthology.orchestra.run.smithi157.stdout:Reading state information... 2024-09-16T05:17:40.101 INFO:teuthology.orchestra.run.smithi047.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-09-16T05:17:40.101 INFO:teuthology.orchestra.run.smithi047.stdout:Sourcing file `/etc/default/grub' 2024-09-16T05:17:40.111 INFO:teuthology.orchestra.run.smithi047.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-16T05:17:40.139 INFO:teuthology.orchestra.run.smithi047.stdout:Generating grub configuration file ... 2024-09-16T05:17:40.243 INFO:teuthology.orchestra.run.smithi086.stdout:linux-image-generic is already the newest version (5.15.0.121.121). 2024-09-16T05:17:40.243 INFO:teuthology.orchestra.run.smithi086.stdout:The following packages were automatically installed and are no longer required: 2024-09-16T05:17:40.243 INFO:teuthology.orchestra.run.smithi086.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-16T05:17:40.243 INFO:teuthology.orchestra.run.smithi086.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-16T05:17:40.244 INFO:teuthology.orchestra.run.smithi086.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-16T05:17:40.244 INFO:teuthology.orchestra.run.smithi086.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-16T05:17:40.244 INFO:teuthology.orchestra.run.smithi086.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-16T05:17:40.244 INFO:teuthology.orchestra.run.smithi086.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-16T05:17:40.283 INFO:teuthology.orchestra.run.smithi086.stdout:0 upgraded, 0 newly installed, 0 to remove and 344 not upgraded. 2024-09-16T05:17:40.285 DEBUG:teuthology.orchestra.run.smithi086:> dpkg -s linux-image-generic 2024-09-16T05:17:40.295 INFO:teuthology.orchestra.run.smithi157.stdout:linux-image-generic is already the newest version (5.15.0.121.121). 2024-09-16T05:17:40.295 INFO:teuthology.orchestra.run.smithi157.stdout:The following packages were automatically installed and are no longer required: 2024-09-16T05:17:40.295 INFO:teuthology.orchestra.run.smithi157.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-16T05:17:40.295 INFO:teuthology.orchestra.run.smithi157.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-16T05:17:40.295 INFO:teuthology.orchestra.run.smithi157.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-16T05:17:40.296 INFO:teuthology.orchestra.run.smithi157.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-16T05:17:40.296 INFO:teuthology.orchestra.run.smithi157.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-16T05:17:40.296 INFO:teuthology.orchestra.run.smithi157.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-16T05:17:40.299 INFO:teuthology.orchestra.run.smithi086.stdout:Package: linux-image-generic 2024-09-16T05:17:40.299 INFO:teuthology.orchestra.run.smithi086.stdout:Status: install ok installed 2024-09-16T05:17:40.300 INFO:teuthology.orchestra.run.smithi086.stdout:Priority: optional 2024-09-16T05:17:40.300 INFO:teuthology.orchestra.run.smithi086.stdout:Section: kernel 2024-09-16T05:17:40.300 INFO:teuthology.orchestra.run.smithi086.stdout:Installed-Size: 21 2024-09-16T05:17:40.300 INFO:teuthology.orchestra.run.smithi086.stdout:Maintainer: Ubuntu Kernel Team 2024-09-16T05:17:40.300 INFO:teuthology.orchestra.run.smithi086.stdout:Architecture: amd64 2024-09-16T05:17:40.300 INFO:teuthology.orchestra.run.smithi086.stdout:Source: linux-meta 2024-09-16T05:17:40.300 INFO:teuthology.orchestra.run.smithi086.stdout:Version: 5.15.0.121.121 2024-09-16T05:17:40.300 INFO:teuthology.orchestra.run.smithi086.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-121), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-16T05:17:40.300 INFO:teuthology.orchestra.run.smithi086.stdout:Depends: linux-image-5.15.0-121-generic, linux-modules-extra-5.15.0-121-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-16T05:17:40.300 INFO:teuthology.orchestra.run.smithi086.stdout:Recommends: thermald 2024-09-16T05:17:40.300 INFO:teuthology.orchestra.run.smithi086.stdout:Description: Generic Linux kernel image 2024-09-16T05:17:40.300 INFO:teuthology.orchestra.run.smithi086.stdout: This package will always depend on the latest generic kernel image 2024-09-16T05:17:40.300 INFO:teuthology.orchestra.run.smithi086.stdout: available. 2024-09-16T05:17:40.301 DEBUG:teuthology.orchestra.run.smithi086:> mktemp 2024-09-16T05:17:40.341 INFO:teuthology.orchestra.run.smithi157.stdout:0 upgraded, 0 newly installed, 0 to remove and 344 not upgraded. 2024-09-16T05:17:40.343 DEBUG:teuthology.orchestra.run.smithi157:> dpkg -s linux-image-generic 2024-09-16T05:17:40.347 INFO:teuthology.orchestra.run.smithi086.stdout:/tmp/tmp.XGtJ8fm1oo 2024-09-16T05:17:40.348 DEBUG:teuthology.orchestra.run.smithi086:> sudo cp /boot/grub/grub.cfg /tmp/tmp.XGtJ8fm1oo 2024-09-16T05:17:40.358 INFO:teuthology.orchestra.run.smithi157.stdout:Package: linux-image-generic 2024-09-16T05:17:40.359 INFO:teuthology.orchestra.run.smithi157.stdout:Status: install ok installed 2024-09-16T05:17:40.359 INFO:teuthology.orchestra.run.smithi157.stdout:Priority: optional 2024-09-16T05:17:40.359 INFO:teuthology.orchestra.run.smithi157.stdout:Section: kernel 2024-09-16T05:17:40.359 INFO:teuthology.orchestra.run.smithi157.stdout:Installed-Size: 21 2024-09-16T05:17:40.359 INFO:teuthology.orchestra.run.smithi157.stdout:Maintainer: Ubuntu Kernel Team 2024-09-16T05:17:40.359 INFO:teuthology.orchestra.run.smithi157.stdout:Architecture: amd64 2024-09-16T05:17:40.359 INFO:teuthology.orchestra.run.smithi157.stdout:Source: linux-meta 2024-09-16T05:17:40.359 INFO:teuthology.orchestra.run.smithi157.stdout:Version: 5.15.0.121.121 2024-09-16T05:17:40.359 INFO:teuthology.orchestra.run.smithi157.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-121), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-16T05:17:40.359 INFO:teuthology.orchestra.run.smithi157.stdout:Depends: linux-image-5.15.0-121-generic, linux-modules-extra-5.15.0-121-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-16T05:17:40.359 INFO:teuthology.orchestra.run.smithi157.stdout:Recommends: thermald 2024-09-16T05:17:40.360 INFO:teuthology.orchestra.run.smithi157.stdout:Description: Generic Linux kernel image 2024-09-16T05:17:40.360 INFO:teuthology.orchestra.run.smithi157.stdout: This package will always depend on the latest generic kernel image 2024-09-16T05:17:40.360 INFO:teuthology.orchestra.run.smithi157.stdout: available. 2024-09-16T05:17:40.360 DEBUG:teuthology.orchestra.run.smithi157:> mktemp 2024-09-16T05:17:40.402 DEBUG:teuthology.orchestra.run.smithi086:> sudo chmod 0666 /tmp/tmp.XGtJ8fm1oo 2024-09-16T05:17:40.405 INFO:teuthology.orchestra.run.smithi047.stdout:Found linux image: /boot/vmlinuz-5.15.0-121-generic 2024-09-16T05:17:40.407 INFO:teuthology.orchestra.run.smithi157.stdout:/tmp/tmp.b2my6pk0vE 2024-09-16T05:17:40.407 DEBUG:teuthology.orchestra.run.smithi157:> sudo cp /boot/grub/grub.cfg /tmp/tmp.b2my6pk0vE 2024-09-16T05:17:40.426 INFO:teuthology.orchestra.run.smithi047.stdout:Found initrd image: /boot/initrd.img-5.15.0-121-generic 2024-09-16T05:17:40.480 DEBUG:teuthology.orchestra.run.smithi157:> sudo chmod 0666 /tmp/tmp.b2my6pk0vE 2024-09-16T05:17:40.524 DEBUG:teuthology.orchestra.remote:smithi086:/tmp/tmp.XGtJ8fm1oo is 10KB 2024-09-16T05:17:40.538 DEBUG:teuthology.orchestra.run.smithi086:> rm -fr /tmp/tmp.XGtJ8fm1oo 2024-09-16T05:17:40.543 DEBUG:teuthology.orchestra.run.smithi086:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-09-16T05:17:40.594 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-09-16T05:17:40.594 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-09-16T05:17:40.594 DEBUG:teuthology.orchestra.run.smithi086:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-09-16T05:17:40.597 DEBUG:teuthology.orchestra.remote:smithi157:/tmp/tmp.b2my6pk0vE is 10KB 2024-09-16T05:17:40.610 DEBUG:teuthology.orchestra.run.smithi157:> rm -fr /tmp/tmp.b2my6pk0vE 2024-09-16T05:17:40.615 DEBUG:teuthology.orchestra.run.smithi157:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-09-16T05:17:40.664 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-121-generic 2024-09-16T05:17:40.665 DEBUG:teuthology.orchestra.run.smithi086:> sudo update-grub 2024-09-16T05:17:40.672 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-09-16T05:17:40.672 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-09-16T05:17:40.672 DEBUG:teuthology.orchestra.run.smithi157:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-09-16T05:17:40.737 INFO:teuthology.orchestra.run.smithi047.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-16T05:17:40.739 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-121-generic 2024-09-16T05:17:40.739 DEBUG:teuthology.orchestra.run.smithi157:> sudo update-grub 2024-09-16T05:17:40.743 INFO:teuthology.orchestra.run.smithi047.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-16T05:17:40.812 INFO:teuthology.orchestra.run.smithi047.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-16T05:17:40.817 INFO:teuthology.orchestra.run.smithi047.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-16T05:17:40.958 INFO:teuthology.orchestra.run.smithi047.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-16T05:17:40.958 INFO:teuthology.orchestra.run.smithi047.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-09-16T05:17:40.958 INFO:teuthology.orchestra.run.smithi047.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-16T05:17:40.989 INFO:teuthology.orchestra.run.smithi047.stdout:done 2024-09-16T05:17:41.469 DEBUG:teuthology.orchestra.run.smithi047:> dpkg -s linux-image-generic 2024-09-16T05:17:41.493 INFO:teuthology.orchestra.run.smithi047.stdout:Package: linux-image-generic 2024-09-16T05:17:41.493 INFO:teuthology.orchestra.run.smithi047.stdout:Status: install ok installed 2024-09-16T05:17:41.493 INFO:teuthology.orchestra.run.smithi047.stdout:Priority: optional 2024-09-16T05:17:41.493 INFO:teuthology.orchestra.run.smithi047.stdout:Section: kernel 2024-09-16T05:17:41.493 INFO:teuthology.orchestra.run.smithi047.stdout:Installed-Size: 21 2024-09-16T05:17:41.494 INFO:teuthology.orchestra.run.smithi047.stdout:Maintainer: Ubuntu Kernel Team 2024-09-16T05:17:41.494 INFO:teuthology.orchestra.run.smithi047.stdout:Architecture: amd64 2024-09-16T05:17:41.494 INFO:teuthology.orchestra.run.smithi047.stdout:Source: linux-meta 2024-09-16T05:17:41.494 INFO:teuthology.orchestra.run.smithi047.stdout:Version: 5.15.0.121.121 2024-09-16T05:17:41.494 INFO:teuthology.orchestra.run.smithi047.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-121), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-16T05:17:41.494 INFO:teuthology.orchestra.run.smithi047.stdout:Depends: linux-image-5.15.0-121-generic, linux-modules-extra-5.15.0-121-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-16T05:17:41.494 INFO:teuthology.orchestra.run.smithi047.stdout:Recommends: thermald 2024-09-16T05:17:41.494 INFO:teuthology.orchestra.run.smithi047.stdout:Description: Generic Linux kernel image 2024-09-16T05:17:41.494 INFO:teuthology.orchestra.run.smithi047.stdout: This package will always depend on the latest generic kernel image 2024-09-16T05:17:41.494 INFO:teuthology.orchestra.run.smithi047.stdout: available. 2024-09-16T05:17:41.495 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-121-generic 2024-09-16T05:17:41.495 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-16T05:17:41.495 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-16T05:17:41.495 INFO:teuthology.task.kernel:Installing distro kernel on host.a... 2024-09-16T05:17:41.495 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi047.front.sepia.ceph.com, path=None, version=distro) 2024-09-16T05:17:41.496 DEBUG:teuthology.orchestra.run.smithi047:> sudo apt-get clean 2024-09-16T05:17:41.676 DEBUG:teuthology.orchestra.run.smithi047:> sudo apt-get update 2024-09-16T05:17:41.789 INFO:teuthology.orchestra.run.smithi047.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-16T05:17:41.793 INFO:teuthology.orchestra.run.smithi047.stdout:Hit:2 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-16T05:17:41.799 INFO:teuthology.orchestra.run.smithi047.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-16T05:17:41.817 INFO:teuthology.orchestra.run.smithi047.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-16T05:17:41.861 INFO:teuthology.orchestra.run.smithi086.stderr:Sourcing file `/etc/default/grub' 2024-09-16T05:17:41.863 INFO:teuthology.orchestra.run.smithi086.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-16T05:17:41.864 INFO:teuthology.orchestra.run.smithi086.stderr:Generating grub configuration file ... 2024-09-16T05:17:41.915 INFO:teuthology.orchestra.run.smithi157.stderr:Sourcing file `/etc/default/grub' 2024-09-16T05:17:41.916 INFO:teuthology.orchestra.run.smithi157.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-16T05:17:41.918 INFO:teuthology.orchestra.run.smithi157.stderr:Generating grub configuration file ... 2024-09-16T05:17:42.034 INFO:teuthology.orchestra.run.smithi086.stderr:Found linux image: /boot/vmlinuz-5.15.0-121-generic 2024-09-16T05:17:42.039 INFO:teuthology.orchestra.run.smithi086.stderr:Found initrd image: /boot/initrd.img-5.15.0-121-generic 2024-09-16T05:17:42.076 INFO:teuthology.orchestra.run.smithi157.stderr:Found linux image: /boot/vmlinuz-5.15.0-121-generic 2024-09-16T05:17:42.082 INFO:teuthology.orchestra.run.smithi157.stderr:Found initrd image: /boot/initrd.img-5.15.0-121-generic 2024-09-16T05:17:42.258 INFO:teuthology.orchestra.run.smithi086.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-16T05:17:42.263 INFO:teuthology.orchestra.run.smithi086.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-16T05:17:42.300 INFO:teuthology.orchestra.run.smithi086.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-16T05:17:42.303 INFO:teuthology.orchestra.run.smithi157.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-16T05:17:42.305 INFO:teuthology.orchestra.run.smithi086.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-16T05:17:42.308 INFO:teuthology.orchestra.run.smithi157.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-16T05:17:42.350 INFO:teuthology.orchestra.run.smithi157.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-16T05:17:42.355 INFO:teuthology.orchestra.run.smithi157.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-16T05:17:42.406 INFO:teuthology.orchestra.run.smithi086.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-16T05:17:42.406 INFO:teuthology.orchestra.run.smithi086.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-09-16T05:17:42.406 INFO:teuthology.orchestra.run.smithi086.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-16T05:17:42.428 INFO:teuthology.orchestra.run.smithi086.stderr:done 2024-09-16T05:17:42.436 DEBUG:teuthology.orchestra.run.smithi086:> sudo shutdown -r now 2024-09-16T05:17:42.472 INFO:teuthology.orchestra.run.smithi157.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-16T05:17:42.472 INFO:teuthology.orchestra.run.smithi157.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-09-16T05:17:42.472 INFO:teuthology.orchestra.run.smithi157.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-16T05:17:42.505 INFO:teuthology.orchestra.run.smithi157.stderr:done 2024-09-16T05:17:42.514 DEBUG:teuthology.orchestra.run.smithi157:> sudo shutdown -r now 2024-09-16T05:17:43.226 INFO:teuthology.orchestra.run.smithi047.stdout:Reading package lists... 2024-09-16T05:17:43.244 DEBUG:teuthology.orchestra.run.smithi047:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-16T05:17:43.298 INFO:teuthology.orchestra.run.smithi047.stdout:Reading package lists... 2024-09-16T05:17:43.505 INFO:teuthology.orchestra.run.smithi047.stdout:Building dependency tree... 2024-09-16T05:17:43.509 INFO:teuthology.orchestra.run.smithi047.stdout:Reading state information... 2024-09-16T05:17:43.679 INFO:teuthology.orchestra.run.smithi047.stdout:linux-image-generic is already the newest version (5.15.0.121.121). 2024-09-16T05:17:43.679 INFO:teuthology.orchestra.run.smithi047.stdout:The following packages were automatically installed and are no longer required: 2024-09-16T05:17:43.679 INFO:teuthology.orchestra.run.smithi047.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-16T05:17:43.679 INFO:teuthology.orchestra.run.smithi047.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-16T05:17:43.680 INFO:teuthology.orchestra.run.smithi047.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-16T05:17:43.680 INFO:teuthology.orchestra.run.smithi047.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-16T05:17:43.680 INFO:teuthology.orchestra.run.smithi047.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-16T05:17:43.680 INFO:teuthology.orchestra.run.smithi047.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-16T05:17:43.722 INFO:teuthology.orchestra.run.smithi047.stdout:0 upgraded, 0 newly installed, 0 to remove and 344 not upgraded. 2024-09-16T05:17:43.724 DEBUG:teuthology.orchestra.run.smithi047:> dpkg -s linux-image-generic 2024-09-16T05:17:43.783 INFO:teuthology.orchestra.run.smithi047.stdout:Package: linux-image-generic 2024-09-16T05:17:43.784 INFO:teuthology.orchestra.run.smithi047.stdout:Status: install ok installed 2024-09-16T05:17:43.784 INFO:teuthology.orchestra.run.smithi047.stdout:Priority: optional 2024-09-16T05:17:43.784 INFO:teuthology.orchestra.run.smithi047.stdout:Section: kernel 2024-09-16T05:17:43.784 INFO:teuthology.orchestra.run.smithi047.stdout:Installed-Size: 21 2024-09-16T05:17:43.784 INFO:teuthology.orchestra.run.smithi047.stdout:Maintainer: Ubuntu Kernel Team 2024-09-16T05:17:43.784 INFO:teuthology.orchestra.run.smithi047.stdout:Architecture: amd64 2024-09-16T05:17:43.784 INFO:teuthology.orchestra.run.smithi047.stdout:Source: linux-meta 2024-09-16T05:17:43.784 INFO:teuthology.orchestra.run.smithi047.stdout:Version: 5.15.0.121.121 2024-09-16T05:17:43.784 INFO:teuthology.orchestra.run.smithi047.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-121), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-16T05:17:43.784 INFO:teuthology.orchestra.run.smithi047.stdout:Depends: linux-image-5.15.0-121-generic, linux-modules-extra-5.15.0-121-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-16T05:17:43.784 INFO:teuthology.orchestra.run.smithi047.stdout:Recommends: thermald 2024-09-16T05:17:43.785 INFO:teuthology.orchestra.run.smithi047.stdout:Description: Generic Linux kernel image 2024-09-16T05:17:43.785 INFO:teuthology.orchestra.run.smithi047.stdout: This package will always depend on the latest generic kernel image 2024-09-16T05:17:43.785 INFO:teuthology.orchestra.run.smithi047.stdout: available. 2024-09-16T05:17:43.785 DEBUG:teuthology.orchestra.run.smithi047:> mktemp 2024-09-16T05:17:43.832 INFO:teuthology.orchestra.run.smithi047.stdout:/tmp/tmp.9liDBAbDxD 2024-09-16T05:17:43.833 DEBUG:teuthology.orchestra.run.smithi047:> sudo cp /boot/grub/grub.cfg /tmp/tmp.9liDBAbDxD 2024-09-16T05:17:43.888 DEBUG:teuthology.orchestra.run.smithi047:> sudo chmod 0666 /tmp/tmp.9liDBAbDxD 2024-09-16T05:17:44.002 DEBUG:teuthology.orchestra.remote:smithi047:/tmp/tmp.9liDBAbDxD is 10KB 2024-09-16T05:17:44.015 DEBUG:teuthology.orchestra.run.smithi047:> rm -fr /tmp/tmp.9liDBAbDxD 2024-09-16T05:17:44.020 DEBUG:teuthology.orchestra.run.smithi047:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-09-16T05:17:44.080 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-09-16T05:17:44.081 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-09-16T05:17:44.081 DEBUG:teuthology.orchestra.run.smithi047:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-09-16T05:17:44.160 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-121-generic 2024-09-16T05:17:44.160 DEBUG:teuthology.orchestra.run.smithi047:> sudo update-grub 2024-09-16T05:17:45.438 INFO:teuthology.orchestra.run.smithi047.stderr:Sourcing file `/etc/default/grub' 2024-09-16T05:17:45.439 INFO:teuthology.orchestra.run.smithi047.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-16T05:17:45.441 INFO:teuthology.orchestra.run.smithi047.stderr:Generating grub configuration file ... 2024-09-16T05:17:45.623 INFO:teuthology.orchestra.run.smithi047.stderr:Found linux image: /boot/vmlinuz-5.15.0-121-generic 2024-09-16T05:17:45.629 INFO:teuthology.orchestra.run.smithi047.stderr:Found initrd image: /boot/initrd.img-5.15.0-121-generic 2024-09-16T05:17:45.844 INFO:teuthology.orchestra.run.smithi047.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-16T05:17:45.849 INFO:teuthology.orchestra.run.smithi047.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-16T05:17:45.890 INFO:teuthology.orchestra.run.smithi047.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-16T05:17:45.896 INFO:teuthology.orchestra.run.smithi047.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-16T05:17:46.002 INFO:teuthology.orchestra.run.smithi047.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-16T05:17:46.002 INFO:teuthology.orchestra.run.smithi047.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-09-16T05:17:46.002 INFO:teuthology.orchestra.run.smithi047.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-16T05:17:46.016 INFO:teuthology.orchestra.run.smithi047.stderr:done 2024-09-16T05:17:46.025 DEBUG:teuthology.orchestra.run.smithi047:> sudo shutdown -r now 2024-09-16T05:18:12.465 INFO:teuthology.task.kernel:Checking client host.b for new kernel version... 2024-09-16T05:18:12.466 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi086.front.sepia.ceph.com' 2024-09-16T05:18:12.467 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T05:18:12.517 INFO:teuthology.task.kernel:Checking client host.c for new kernel version... 2024-09-16T05:18:12.517 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi157.front.sepia.ceph.com' 2024-09-16T05:18:12.518 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T05:18:16.029 INFO:teuthology.task.kernel:Checking client host.a for new kernel version... 2024-09-16T05:18:16.029 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi047.front.sepia.ceph.com' 2024-09-16T05:18:16.029 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi047.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T05:18:30.973 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.86 2024-09-16T05:18:30.973 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.157 2024-09-16T05:18:34.561 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.47 2024-09-16T05:18:39.977 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi086.front.sepia.ceph.com' 2024-09-16T05:18:39.978 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T05:18:39.979 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi157.front.sepia.ceph.com' 2024-09-16T05:18:39.980 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T05:18:43.037 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.86 2024-09-16T05:18:43.037 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.157 2024-09-16T05:18:43.562 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi047.front.sepia.ceph.com' 2024-09-16T05:18:43.563 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi047.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T05:18:55.049 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi086.front.sepia.ceph.com' 2024-09-16T05:18:55.050 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T05:18:55.051 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi157.front.sepia.ceph.com' 2024-09-16T05:18:55.052 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T05:18:58.113 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.157 2024-09-16T05:19:13.125 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi157.front.sepia.ceph.com' 2024-09-16T05:19:13.126 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T05:19:13.469 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.86 2024-09-16T05:19:28.481 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi086.front.sepia.ceph.com' 2024-09-16T05:19:28.482 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T05:19:29.151 DEBUG:teuthology.orchestra.run.smithi086:> true 2024-09-16T05:19:30.620 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi086.front.sepia.ceph.com' 2024-09-16T05:19:30.620 INFO:teuthology.task.kernel:Checking kernel version of host.b, want "5.15.0-121-generic"... 2024-09-16T05:19:30.621 DEBUG:teuthology.orchestra.run.smithi086:> uname -r 2024-09-16T05:19:30.627 INFO:teuthology.orchestra.run.smithi086.stdout:5.15.0-121-generic 2024-09-16T05:19:30.627 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-121-generic vs 5.15.0-121-generic 2024-09-16T05:19:30.627 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-16T05:19:30.627 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-09-16T05:19:31.628 INFO:teuthology.task.kernel:Enabling kdb on host.b... 2024-09-16T05:19:31.629 DEBUG:teuthology.orchestra.run.smithi086:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-16T05:19:31.645 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.157 2024-09-16T05:19:31.800 INFO:teuthology.orchestra.run.smithi086.stdout:ttyS1 2024-09-16T05:19:31.829 DEBUG:teuthology.parallel:result is None 2024-09-16T05:19:43.565 DEBUG:teuthology.orchestra.remote:timed out 2024-09-16T05:19:49.646 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi157.front.sepia.ceph.com' 2024-09-16T05:19:49.647 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T05:19:49.952 DEBUG:teuthology.orchestra.run.smithi157:> true 2024-09-16T05:19:50.659 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi157.front.sepia.ceph.com' 2024-09-16T05:19:50.659 INFO:teuthology.task.kernel:Checking kernel version of host.c, want "5.15.0-121-generic"... 2024-09-16T05:19:50.659 DEBUG:teuthology.orchestra.run.smithi157:> uname -r 2024-09-16T05:19:50.704 INFO:teuthology.orchestra.run.smithi157.stdout:5.15.0-121-generic 2024-09-16T05:19:50.705 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-121-generic vs 5.15.0-121-generic 2024-09-16T05:19:50.705 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-16T05:19:50.705 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-09-16T05:19:51.706 INFO:teuthology.task.kernel:Enabling kdb on host.c... 2024-09-16T05:19:51.706 DEBUG:teuthology.orchestra.run.smithi157:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-16T05:19:51.787 INFO:teuthology.orchestra.run.smithi157.stdout:ttyS1 2024-09-16T05:19:51.818 DEBUG:teuthology.parallel:result is None 2024-09-16T05:19:55.566 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi047.front.sepia.ceph.com' 2024-09-16T05:19:55.567 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi047.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T05:19:55.782 DEBUG:teuthology.orchestra.run.smithi047:> true 2024-09-16T05:19:56.279 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi047.front.sepia.ceph.com' 2024-09-16T05:19:56.280 INFO:teuthology.task.kernel:Checking kernel version of host.a, want "5.15.0-121-generic"... 2024-09-16T05:19:56.280 DEBUG:teuthology.orchestra.run.smithi047:> uname -r 2024-09-16T05:19:56.325 INFO:teuthology.orchestra.run.smithi047.stdout:5.15.0-121-generic 2024-09-16T05:19:56.326 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-121-generic vs 5.15.0-121-generic 2024-09-16T05:19:56.326 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-16T05:19:56.326 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-09-16T05:19:57.327 INFO:teuthology.task.kernel:Enabling kdb on host.a... 2024-09-16T05:19:57.327 DEBUG:teuthology.orchestra.run.smithi047:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-16T05:19:57.400 INFO:teuthology.orchestra.run.smithi047.stdout:ttyS1 2024-09-16T05:19:57.419 DEBUG:teuthology.parallel:result is None 2024-09-16T05:19:57.419 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-16T05:19:57.426 INFO:teuthology.task.internal:Creating test directory... 2024-09-16T05:19:57.426 DEBUG:teuthology.orchestra.run.smithi047:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-16T05:19:57.428 DEBUG:teuthology.orchestra.run.smithi086:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-16T05:19:57.430 DEBUG:teuthology.orchestra.run.smithi157:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-16T05:19:57.437 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-16T05:19:57.453 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-16T05:19:57.496 INFO:teuthology.task.internal:Creating archive directory... 2024-09-16T05:19:57.496 DEBUG:teuthology.orchestra.run.smithi047:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-16T05:19:57.498 DEBUG:teuthology.orchestra.run.smithi086:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-16T05:19:57.500 DEBUG:teuthology.orchestra.run.smithi157:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-16T05:19:57.578 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-16T05:19:57.585 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-16T05:19:57.585 DEBUG:teuthology.orchestra.run.smithi047:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-16T05:19:57.588 DEBUG:teuthology.orchestra.run.smithi086:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-16T05:19:57.590 DEBUG:teuthology.orchestra.run.smithi157:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-16T05:19:57.605 INFO:teuthology.orchestra.run.smithi086.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T05:19:57.607 INFO:teuthology.orchestra.run.smithi047.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T05:19:57.613 INFO:teuthology.orchestra.run.smithi086.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T05:19:57.615 INFO:teuthology.orchestra.run.smithi157.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T05:19:57.615 INFO:teuthology.orchestra.run.smithi047.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T05:19:57.624 INFO:teuthology.orchestra.run.smithi157.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T05:19:57.626 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-16T05:19:57.633 INFO:teuthology.task.internal:Configuring sudo... 2024-09-16T05:19:57.633 DEBUG:teuthology.orchestra.run.smithi047:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-16T05:19:57.662 DEBUG:teuthology.orchestra.run.smithi086:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-16T05:19:57.665 DEBUG:teuthology.orchestra.run.smithi157:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-16T05:19:57.686 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-16T05:19:57.695 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-16T05:19:57.696 DEBUG:teuthology.orchestra.run.smithi047:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-16T05:19:57.731 DEBUG:teuthology.orchestra.run.smithi086:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-16T05:19:57.733 DEBUG:teuthology.orchestra.run.smithi157:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-16T05:19:57.739 DEBUG:teuthology.orchestra.run.smithi047:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-16T05:19:57.782 DEBUG:teuthology.orchestra.run.smithi047:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-16T05:19:57.830 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-09-16T05:19:57.830 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-16T05:19:57.896 DEBUG:teuthology.orchestra.run.smithi086:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-16T05:19:57.901 DEBUG:teuthology.orchestra.run.smithi086:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-16T05:19:57.948 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-09-16T05:19:57.948 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-16T05:19:58.018 DEBUG:teuthology.orchestra.run.smithi157:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-16T05:19:58.024 DEBUG:teuthology.orchestra.run.smithi157:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-16T05:19:58.072 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-09-16T05:19:58.072 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-16T05:19:58.137 DEBUG:teuthology.orchestra.run.smithi047:> sudo service rsyslog restart 2024-09-16T05:19:58.139 DEBUG:teuthology.orchestra.run.smithi086:> sudo service rsyslog restart 2024-09-16T05:19:58.142 DEBUG:teuthology.orchestra.run.smithi157:> sudo service rsyslog restart 2024-09-16T05:19:58.208 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-16T05:19:58.215 INFO:teuthology.task.internal:Starting timer... 2024-09-16T05:19:58.215 INFO:teuthology.run_tasks:Running task pcp... 2024-09-16T05:19:58.258 INFO:teuthology.run_tasks:Running task selinux... 2024-09-16T05:19:58.306 DEBUG:teuthology.task.selinux:Excluding smithi047: OS 'ubuntu' does not support SELinux 2024-09-16T05:19:58.307 DEBUG:teuthology.task.selinux:Excluding smithi086: OS 'ubuntu' does not support SELinux 2024-09-16T05:19:58.307 DEBUG:teuthology.task.selinux:Excluding smithi157: OS 'ubuntu' does not support SELinux 2024-09-16T05:19:58.307 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-16T05:19:58.307 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2024-09-16T05:19:58.307 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-16T05:19:58.307 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-16T05:19:58.356 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-16T05:19:58.376 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-16T05:19:58.377 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi047.front.sepia.ceph.com,smithi086.front.sepia.ceph.com,smithi157.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-16T05:27:35.017 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi047.front.sepia.ceph.com'), Remote(name='ubuntu@smithi086.front.sepia.ceph.com'), Remote(name='ubuntu@smithi157.front.sepia.ceph.com')] 2024-09-16T05:27:35.019 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi047.front.sepia.ceph.com' 2024-09-16T05:27:35.020 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi047.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T05:27:35.105 DEBUG:teuthology.orchestra.run.smithi047:> true 2024-09-16T05:27:35.189 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi047.front.sepia.ceph.com' 2024-09-16T05:27:35.189 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi086.front.sepia.ceph.com' 2024-09-16T05:27:35.190 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T05:27:35.273 DEBUG:teuthology.orchestra.run.smithi086:> true 2024-09-16T05:27:35.348 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi086.front.sepia.ceph.com' 2024-09-16T05:27:35.349 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi157.front.sepia.ceph.com' 2024-09-16T05:27:35.350 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T05:27:35.428 DEBUG:teuthology.orchestra.run.smithi157:> true 2024-09-16T05:27:35.505 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi157.front.sepia.ceph.com' 2024-09-16T05:27:35.506 INFO:teuthology.run_tasks:Running task clock... 2024-09-16T05:27:35.517 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-16T05:27:35.518 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-16T05:27:35.518 DEBUG:teuthology.orchestra.run.smithi047:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-16T05:27:35.521 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-16T05:27:35.521 DEBUG:teuthology.orchestra.run.smithi086:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-16T05:27:35.523 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-16T05:27:35.524 DEBUG:teuthology.orchestra.run.smithi157:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-16T05:27:35.547 INFO:teuthology.orchestra.run.smithi047.stdout:16 Sep 05:27:35 ntpd[18355]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-09-16T05:27:35.548 INFO:teuthology.orchestra.run.smithi047.stdout:16 Sep 05:27:35 ntpd[18355]: Command line: ntpd -gq 2024-09-16T05:27:35.548 INFO:teuthology.orchestra.run.smithi047.stdout:16 Sep 05:27:35 ntpd[18355]: ---------------------------------------------------- 2024-09-16T05:27:35.548 INFO:teuthology.orchestra.run.smithi047.stdout:16 Sep 05:27:35 ntpd[18355]: ntp-4 is maintained by Network Time Foundation, 2024-09-16T05:27:35.548 INFO:teuthology.orchestra.run.smithi047.stdout:16 Sep 05:27:35 ntpd[18355]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-09-16T05:27:35.548 INFO:teuthology.orchestra.run.smithi047.stdout:16 Sep 05:27:35 ntpd[18355]: corporation. Support and training for ntp-4 are 2024-09-16T05:27:35.548 INFO:teuthology.orchestra.run.smithi047.stdout:16 Sep 05:27:35 ntpd[18355]: available at https://www.nwtime.org/support 2024-09-16T05:27:35.548 INFO:teuthology.orchestra.run.smithi047.stdout:16 Sep 05:27:35 ntpd[18355]: ---------------------------------------------------- 2024-09-16T05:27:35.549 INFO:teuthology.orchestra.run.smithi047.stdout:16 Sep 05:27:35 ntpd[18355]: proto: precision = 0.046 usec (-24) 2024-09-16T05:27:35.549 INFO:teuthology.orchestra.run.smithi047.stdout:16 Sep 05:27:35 ntpd[18355]: basedate set to 2022-02-04 2024-09-16T05:27:35.549 INFO:teuthology.orchestra.run.smithi047.stdout:16 Sep 05:27:35 ntpd[18355]: gps base set to 2022-02-06 (week 2196) 2024-09-16T05:27:35.549 INFO:teuthology.orchestra.run.smithi047.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-16T05:27:35.550 INFO:teuthology.orchestra.run.smithi047.stdout:16 Sep 05:27:35 ntpd[18355]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-16T05:27:35.550 INFO:teuthology.orchestra.run.smithi047.stdout:16 Sep 05:27:35 ntpd[18355]: restrict ::: KOD does nothing without LIMITED. 2024-09-16T05:27:35.550 INFO:teuthology.orchestra.run.smithi047.stderr:restrict ::: KOD does nothing without LIMITED. 2024-09-16T05:27:35.551 INFO:teuthology.orchestra.run.smithi047.stdout:16 Sep 05:27:35 ntpd[18355]: Listen and drop on 0 v6wildcard [::]:123 2024-09-16T05:27:35.551 INFO:teuthology.orchestra.run.smithi047.stdout:16 Sep 05:27:35 ntpd[18355]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-09-16T05:27:35.551 INFO:teuthology.orchestra.run.smithi047.stdout:16 Sep 05:27:35 ntpd[18355]: Listen normally on 2 lo 127.0.0.1:123 2024-09-16T05:27:35.551 INFO:teuthology.orchestra.run.smithi047.stdout:16 Sep 05:27:35 ntpd[18355]: Listen normally on 3 ens1f0 172.21.15.47:123 2024-09-16T05:27:35.551 INFO:teuthology.orchestra.run.smithi047.stdout:16 Sep 05:27:35 ntpd[18355]: Listen normally on 4 lo [::1]:123 2024-09-16T05:27:35.551 INFO:teuthology.orchestra.run.smithi047.stdout:16 Sep 05:27:35 ntpd[18355]: Listen normally on 5 ens1f0 [fe80::ec4:7aff:febd:148e%3]:123 2024-09-16T05:27:35.551 INFO:teuthology.orchestra.run.smithi047.stdout:16 Sep 05:27:35 ntpd[18355]: Listening on routing socket on fd #22 for interface updates 2024-09-16T05:27:35.553 INFO:teuthology.orchestra.run.smithi086.stdout:16 Sep 05:27:35 ntpd[18456]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-09-16T05:27:35.553 INFO:teuthology.orchestra.run.smithi086.stdout:16 Sep 05:27:35 ntpd[18456]: Command line: ntpd -gq 2024-09-16T05:27:35.553 INFO:teuthology.orchestra.run.smithi086.stdout:16 Sep 05:27:35 ntpd[18456]: ---------------------------------------------------- 2024-09-16T05:27:35.553 INFO:teuthology.orchestra.run.smithi086.stdout:16 Sep 05:27:35 ntpd[18456]: ntp-4 is maintained by Network Time Foundation, 2024-09-16T05:27:35.553 INFO:teuthology.orchestra.run.smithi086.stdout:16 Sep 05:27:35 ntpd[18456]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-09-16T05:27:35.553 INFO:teuthology.orchestra.run.smithi086.stdout:16 Sep 05:27:35 ntpd[18456]: corporation. Support and training for ntp-4 are 2024-09-16T05:27:35.553 INFO:teuthology.orchestra.run.smithi086.stdout:16 Sep 05:27:35 ntpd[18456]: available at https://www.nwtime.org/support 2024-09-16T05:27:35.553 INFO:teuthology.orchestra.run.smithi086.stdout:16 Sep 05:27:35 ntpd[18456]: ---------------------------------------------------- 2024-09-16T05:27:35.553 INFO:teuthology.orchestra.run.smithi086.stdout:16 Sep 05:27:35 ntpd[18456]: proto: precision = 0.069 usec (-24) 2024-09-16T05:27:35.553 INFO:teuthology.orchestra.run.smithi086.stdout:16 Sep 05:27:35 ntpd[18456]: basedate set to 2022-02-04 2024-09-16T05:27:35.553 INFO:teuthology.orchestra.run.smithi086.stdout:16 Sep 05:27:35 ntpd[18456]: gps base set to 2022-02-06 (week 2196) 2024-09-16T05:27:35.554 INFO:teuthology.orchestra.run.smithi086.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-16T05:27:35.554 INFO:teuthology.orchestra.run.smithi086.stdout:16 Sep 05:27:35 ntpd[18456]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-16T05:27:35.554 INFO:teuthology.orchestra.run.smithi086.stdout:16 Sep 05:27:35 ntpd[18456]: restrict ::: KOD does nothing without LIMITED. 2024-09-16T05:27:35.555 INFO:teuthology.orchestra.run.smithi086.stderr:restrict ::: KOD does nothing without LIMITED. 2024-09-16T05:27:35.556 INFO:teuthology.orchestra.run.smithi086.stdout:16 Sep 05:27:35 ntpd[18456]: Listen and drop on 0 v6wildcard [::]:123 2024-09-16T05:27:35.556 INFO:teuthology.orchestra.run.smithi086.stdout:16 Sep 05:27:35 ntpd[18456]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-09-16T05:27:35.556 INFO:teuthology.orchestra.run.smithi086.stdout:16 Sep 05:27:35 ntpd[18456]: Listen normally on 2 lo 127.0.0.1:123 2024-09-16T05:27:35.556 INFO:teuthology.orchestra.run.smithi086.stdout:16 Sep 05:27:35 ntpd[18456]: Listen normally on 3 enp3s0f1 172.21.15.86:123 2024-09-16T05:27:35.556 INFO:teuthology.orchestra.run.smithi086.stdout:16 Sep 05:27:35 ntpd[18456]: Listen normally on 4 lo [::1]:123 2024-09-16T05:27:35.556 INFO:teuthology.orchestra.run.smithi086.stdout:16 Sep 05:27:35 ntpd[18456]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:d809%5]:123 2024-09-16T05:27:35.556 INFO:teuthology.orchestra.run.smithi086.stdout:16 Sep 05:27:35 ntpd[18456]: Listening on routing socket on fd #22 for interface updates 2024-09-16T05:27:35.576 INFO:teuthology.orchestra.run.smithi157.stdout:16 Sep 05:27:35 ntpd[18457]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-09-16T05:27:35.576 INFO:teuthology.orchestra.run.smithi157.stdout:16 Sep 05:27:35 ntpd[18457]: Command line: ntpd -gq 2024-09-16T05:27:35.576 INFO:teuthology.orchestra.run.smithi157.stdout:16 Sep 05:27:35 ntpd[18457]: ---------------------------------------------------- 2024-09-16T05:27:35.576 INFO:teuthology.orchestra.run.smithi157.stdout:16 Sep 05:27:35 ntpd[18457]: ntp-4 is maintained by Network Time Foundation, 2024-09-16T05:27:35.576 INFO:teuthology.orchestra.run.smithi157.stdout:16 Sep 05:27:35 ntpd[18457]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-09-16T05:27:35.576 INFO:teuthology.orchestra.run.smithi157.stdout:16 Sep 05:27:35 ntpd[18457]: corporation. Support and training for ntp-4 are 2024-09-16T05:27:35.576 INFO:teuthology.orchestra.run.smithi157.stdout:16 Sep 05:27:35 ntpd[18457]: available at https://www.nwtime.org/support 2024-09-16T05:27:35.576 INFO:teuthology.orchestra.run.smithi157.stdout:16 Sep 05:27:35 ntpd[18457]: ---------------------------------------------------- 2024-09-16T05:27:35.577 INFO:teuthology.orchestra.run.smithi157.stdout:16 Sep 05:27:35 ntpd[18457]: proto: precision = 0.063 usec (-24) 2024-09-16T05:27:35.577 INFO:teuthology.orchestra.run.smithi157.stdout:16 Sep 05:27:35 ntpd[18457]: basedate set to 2022-02-04 2024-09-16T05:27:35.577 INFO:teuthology.orchestra.run.smithi157.stdout:16 Sep 05:27:35 ntpd[18457]: gps base set to 2022-02-06 (week 2196) 2024-09-16T05:27:35.577 INFO:teuthology.orchestra.run.smithi157.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-16T05:27:35.578 INFO:teuthology.orchestra.run.smithi157.stdout:16 Sep 05:27:35 ntpd[18457]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-16T05:27:35.578 INFO:teuthology.orchestra.run.smithi157.stderr:restrict ::: KOD does nothing without LIMITED. 2024-09-16T05:27:35.578 INFO:teuthology.orchestra.run.smithi157.stdout:16 Sep 05:27:35 ntpd[18457]: restrict ::: KOD does nothing without LIMITED. 2024-09-16T05:27:35.579 INFO:teuthology.orchestra.run.smithi157.stdout:16 Sep 05:27:35 ntpd[18457]: Listen and drop on 0 v6wildcard [::]:123 2024-09-16T05:27:35.579 INFO:teuthology.orchestra.run.smithi157.stdout:16 Sep 05:27:35 ntpd[18457]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-09-16T05:27:35.579 INFO:teuthology.orchestra.run.smithi157.stdout:16 Sep 05:27:35 ntpd[18457]: Listen normally on 2 lo 127.0.0.1:123 2024-09-16T05:27:35.579 INFO:teuthology.orchestra.run.smithi157.stdout:16 Sep 05:27:35 ntpd[18457]: Listen normally on 3 enp3s0f1 172.21.15.157:123 2024-09-16T05:27:35.579 INFO:teuthology.orchestra.run.smithi157.stdout:16 Sep 05:27:35 ntpd[18457]: Listen normally on 4 lo [::1]:123 2024-09-16T05:27:35.580 INFO:teuthology.orchestra.run.smithi157.stdout:16 Sep 05:27:35 ntpd[18457]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:7ea1%5]:123 2024-09-16T05:27:35.580 INFO:teuthology.orchestra.run.smithi157.stdout:16 Sep 05:27:35 ntpd[18457]: Listening on routing socket on fd #22 for interface updates 2024-09-16T05:27:36.577 INFO:teuthology.orchestra.run.smithi157.stderr:16 Sep 05:27:36 ntpd[18457]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T05:27:36.577 INFO:teuthology.orchestra.run.smithi157.stderr:16 Sep 05:27:36 ntpd[18457]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T05:27:36.577 INFO:teuthology.orchestra.run.smithi157.stderr:16 Sep 05:27:36 ntpd[18457]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T05:27:36.577 INFO:teuthology.orchestra.run.smithi157.stderr:16 Sep 05:27:36 ntpd[18457]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T05:27:36.577 INFO:teuthology.orchestra.run.smithi157.stderr:16 Sep 05:27:36 ntpd[18457]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T05:27:36.577 INFO:teuthology.orchestra.run.smithi157.stderr:16 Sep 05:27:36 ntpd[18457]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T05:27:36.577 INFO:teuthology.orchestra.run.smithi157.stderr:16 Sep 05:27:36 ntpd[18457]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-16T05:27:36.577 INFO:teuthology.orchestra.run.smithi157.stderr:16 Sep 05:27:36 ntpd[18457]: can't open /var/log/ntpstats/peerstats.20240916: Permission denied 2024-09-16T05:27:36.577 INFO:teuthology.orchestra.run.smithi157.stderr:16 Sep 05:27:36 ntpd[18457]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T05:27:36.577 INFO:teuthology.orchestra.run.smithi157.stderr:16 Sep 05:27:36 ntpd[18457]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T05:27:36.577 INFO:teuthology.orchestra.run.smithi157.stderr:16 Sep 05:27:36 ntpd[18457]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-16T05:27:36.577 INFO:teuthology.orchestra.run.smithi157.stderr:16 Sep 05:27:36 ntpd[18457]: can't open /var/log/ntpstats/peerstats.20240916: Permission denied 2024-09-16T05:27:37.549 INFO:teuthology.orchestra.run.smithi047.stderr:16 Sep 05:27:37 ntpd[18355]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T05:27:37.549 INFO:teuthology.orchestra.run.smithi047.stderr:16 Sep 05:27:37 ntpd[18355]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T05:27:37.549 INFO:teuthology.orchestra.run.smithi047.stderr:16 Sep 05:27:37 ntpd[18355]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T05:27:37.549 INFO:teuthology.orchestra.run.smithi047.stderr:16 Sep 05:27:37 ntpd[18355]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T05:27:37.549 INFO:teuthology.orchestra.run.smithi047.stderr:16 Sep 05:27:37 ntpd[18355]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T05:27:37.549 INFO:teuthology.orchestra.run.smithi047.stderr:16 Sep 05:27:37 ntpd[18355]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T05:27:37.549 INFO:teuthology.orchestra.run.smithi047.stderr:16 Sep 05:27:37 ntpd[18355]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-16T05:27:37.549 INFO:teuthology.orchestra.run.smithi047.stderr:16 Sep 05:27:37 ntpd[18355]: can't open /var/log/ntpstats/peerstats.20240916: Permission denied 2024-09-16T05:27:37.552 INFO:teuthology.orchestra.run.smithi086.stderr:16 Sep 05:27:37 ntpd[18456]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T05:27:37.552 INFO:teuthology.orchestra.run.smithi086.stderr:16 Sep 05:27:37 ntpd[18456]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T05:27:37.552 INFO:teuthology.orchestra.run.smithi086.stderr:16 Sep 05:27:37 ntpd[18456]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T05:27:37.552 INFO:teuthology.orchestra.run.smithi086.stderr:16 Sep 05:27:37 ntpd[18456]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T05:27:37.552 INFO:teuthology.orchestra.run.smithi086.stderr:16 Sep 05:27:37 ntpd[18456]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-16T05:27:37.552 INFO:teuthology.orchestra.run.smithi086.stderr:16 Sep 05:27:37 ntpd[18456]: can't open /var/log/ntpstats/peerstats.20240916: Permission denied 2024-09-16T05:27:37.576 INFO:teuthology.orchestra.run.smithi157.stderr:16 Sep 05:27:37 ntpd[18457]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T05:27:37.576 INFO:teuthology.orchestra.run.smithi157.stderr:16 Sep 05:27:37 ntpd[18457]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T05:27:37.577 INFO:teuthology.orchestra.run.smithi157.stderr:16 Sep 05:27:37 ntpd[18457]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T05:27:37.577 INFO:teuthology.orchestra.run.smithi157.stderr:16 Sep 05:27:37 ntpd[18457]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T05:27:37.577 INFO:teuthology.orchestra.run.smithi157.stderr:16 Sep 05:27:37 ntpd[18457]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-16T05:27:37.577 INFO:teuthology.orchestra.run.smithi157.stderr:16 Sep 05:27:37 ntpd[18457]: can't open /var/log/ntpstats/peerstats.20240916: Permission denied 2024-09-16T05:27:38.552 INFO:teuthology.orchestra.run.smithi086.stderr:16 Sep 05:27:38 ntpd[18456]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T05:27:38.552 INFO:teuthology.orchestra.run.smithi086.stderr:16 Sep 05:27:38 ntpd[18456]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T05:27:38.552 INFO:teuthology.orchestra.run.smithi086.stderr:16 Sep 05:27:38 ntpd[18456]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T05:27:38.552 INFO:teuthology.orchestra.run.smithi086.stderr:16 Sep 05:27:38 ntpd[18456]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T05:27:38.552 INFO:teuthology.orchestra.run.smithi086.stderr:16 Sep 05:27:38 ntpd[18456]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-16T05:27:38.553 INFO:teuthology.orchestra.run.smithi086.stderr:16 Sep 05:27:38 ntpd[18456]: can't open /var/log/ntpstats/peerstats.20240916: Permission denied 2024-09-16T05:27:38.577 INFO:teuthology.orchestra.run.smithi157.stderr:16 Sep 05:27:38 ntpd[18457]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T05:27:38.577 INFO:teuthology.orchestra.run.smithi157.stderr:16 Sep 05:27:38 ntpd[18457]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T05:27:38.577 INFO:teuthology.orchestra.run.smithi157.stderr:16 Sep 05:27:38 ntpd[18457]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T05:27:38.577 INFO:teuthology.orchestra.run.smithi157.stderr:16 Sep 05:27:38 ntpd[18457]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T05:27:38.577 INFO:teuthology.orchestra.run.smithi157.stderr:16 Sep 05:27:38 ntpd[18457]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T05:27:38.577 INFO:teuthology.orchestra.run.smithi157.stderr:16 Sep 05:27:38 ntpd[18457]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T05:27:38.577 INFO:teuthology.orchestra.run.smithi157.stderr:16 Sep 05:27:38 ntpd[18457]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T05:27:38.578 INFO:teuthology.orchestra.run.smithi157.stderr:16 Sep 05:27:38 ntpd[18457]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T05:27:38.578 INFO:teuthology.orchestra.run.smithi157.stderr:16 Sep 05:27:38 ntpd[18457]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-16T05:27:38.578 INFO:teuthology.orchestra.run.smithi157.stderr:16 Sep 05:27:38 ntpd[18457]: can't open /var/log/ntpstats/peerstats.20240916: Permission denied 2024-09-16T05:27:38.578 INFO:teuthology.orchestra.run.smithi157.stderr:16 Sep 05:27:38 ntpd[18457]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T05:27:38.578 INFO:teuthology.orchestra.run.smithi157.stderr:16 Sep 05:27:38 ntpd[18457]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T05:27:38.578 INFO:teuthology.orchestra.run.smithi157.stderr:16 Sep 05:27:38 ntpd[18457]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-16T05:27:38.578 INFO:teuthology.orchestra.run.smithi157.stderr:16 Sep 05:27:38 ntpd[18457]: can't open /var/log/ntpstats/peerstats.20240916: Permission denied 2024-09-16T05:27:39.549 INFO:teuthology.orchestra.run.smithi047.stderr:16 Sep 05:27:39 ntpd[18355]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T05:27:39.550 INFO:teuthology.orchestra.run.smithi047.stderr:16 Sep 05:27:39 ntpd[18355]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T05:27:39.550 INFO:teuthology.orchestra.run.smithi047.stderr:16 Sep 05:27:39 ntpd[18355]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T05:27:39.550 INFO:teuthology.orchestra.run.smithi047.stderr:16 Sep 05:27:39 ntpd[18355]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T05:27:39.550 INFO:teuthology.orchestra.run.smithi047.stderr:16 Sep 05:27:39 ntpd[18355]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T05:27:39.550 INFO:teuthology.orchestra.run.smithi047.stderr:16 Sep 05:27:39 ntpd[18355]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T05:27:39.550 INFO:teuthology.orchestra.run.smithi047.stderr:16 Sep 05:27:39 ntpd[18355]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-16T05:27:39.550 INFO:teuthology.orchestra.run.smithi047.stderr:16 Sep 05:27:39 ntpd[18355]: can't open /var/log/ntpstats/peerstats.20240916: Permission denied 2024-09-16T05:27:39.550 INFO:teuthology.orchestra.run.smithi047.stderr:16 Sep 05:27:39 ntpd[18355]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T05:27:39.550 INFO:teuthology.orchestra.run.smithi047.stderr:16 Sep 05:27:39 ntpd[18355]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T05:27:39.550 INFO:teuthology.orchestra.run.smithi047.stderr:16 Sep 05:27:39 ntpd[18355]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-16T05:27:39.550 INFO:teuthology.orchestra.run.smithi047.stderr:16 Sep 05:27:39 ntpd[18355]: can't open /var/log/ntpstats/peerstats.20240916: Permission denied 2024-09-16T05:27:39.552 INFO:teuthology.orchestra.run.smithi086.stderr:16 Sep 05:27:39 ntpd[18456]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T05:27:39.552 INFO:teuthology.orchestra.run.smithi086.stderr:16 Sep 05:27:39 ntpd[18456]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T05:27:39.552 INFO:teuthology.orchestra.run.smithi086.stderr:16 Sep 05:27:39 ntpd[18456]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T05:27:39.552 INFO:teuthology.orchestra.run.smithi086.stderr:16 Sep 05:27:39 ntpd[18456]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T05:27:39.552 INFO:teuthology.orchestra.run.smithi086.stderr:16 Sep 05:27:39 ntpd[18456]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T05:27:39.553 INFO:teuthology.orchestra.run.smithi086.stderr:16 Sep 05:27:39 ntpd[18456]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T05:27:39.553 INFO:teuthology.orchestra.run.smithi086.stderr:16 Sep 05:27:39 ntpd[18456]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-16T05:27:39.553 INFO:teuthology.orchestra.run.smithi086.stderr:16 Sep 05:27:39 ntpd[18456]: can't open /var/log/ntpstats/peerstats.20240916: Permission denied 2024-09-16T05:27:39.577 INFO:teuthology.orchestra.run.smithi157.stderr:16 Sep 05:27:39 ntpd[18457]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T05:27:39.577 INFO:teuthology.orchestra.run.smithi157.stderr:16 Sep 05:27:39 ntpd[18457]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T05:27:39.577 INFO:teuthology.orchestra.run.smithi157.stderr:16 Sep 05:27:39 ntpd[18457]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T05:27:39.577 INFO:teuthology.orchestra.run.smithi157.stderr:16 Sep 05:27:39 ntpd[18457]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T05:27:39.577 INFO:teuthology.orchestra.run.smithi157.stderr:16 Sep 05:27:39 ntpd[18457]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-16T05:27:39.577 INFO:teuthology.orchestra.run.smithi157.stderr:16 Sep 05:27:39 ntpd[18457]: can't open /var/log/ntpstats/peerstats.20240916: Permission denied 2024-09-16T05:27:40.548 INFO:teuthology.orchestra.run.smithi047.stderr:16 Sep 05:27:40 ntpd[18355]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T05:27:40.549 INFO:teuthology.orchestra.run.smithi047.stderr:16 Sep 05:27:40 ntpd[18355]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T05:27:40.549 INFO:teuthology.orchestra.run.smithi047.stderr:16 Sep 05:27:40 ntpd[18355]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T05:27:40.549 INFO:teuthology.orchestra.run.smithi047.stderr:16 Sep 05:27:40 ntpd[18355]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T05:27:40.549 INFO:teuthology.orchestra.run.smithi047.stderr:16 Sep 05:27:40 ntpd[18355]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-16T05:27:40.549 INFO:teuthology.orchestra.run.smithi047.stderr:16 Sep 05:27:40 ntpd[18355]: can't open /var/log/ntpstats/peerstats.20240916: Permission denied 2024-09-16T05:27:40.552 INFO:teuthology.orchestra.run.smithi086.stderr:16 Sep 05:27:40 ntpd[18456]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T05:27:40.553 INFO:teuthology.orchestra.run.smithi086.stderr:16 Sep 05:27:40 ntpd[18456]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T05:27:40.553 INFO:teuthology.orchestra.run.smithi086.stderr:16 Sep 05:27:40 ntpd[18456]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T05:27:40.553 INFO:teuthology.orchestra.run.smithi086.stderr:16 Sep 05:27:40 ntpd[18456]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T05:27:40.553 INFO:teuthology.orchestra.run.smithi086.stderr:16 Sep 05:27:40 ntpd[18456]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T05:27:40.553 INFO:teuthology.orchestra.run.smithi086.stderr:16 Sep 05:27:40 ntpd[18456]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T05:27:40.553 INFO:teuthology.orchestra.run.smithi086.stderr:16 Sep 05:27:40 ntpd[18456]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-16T05:27:40.553 INFO:teuthology.orchestra.run.smithi086.stderr:16 Sep 05:27:40 ntpd[18456]: can't open /var/log/ntpstats/peerstats.20240916: Permission denied 2024-09-16T05:27:40.553 INFO:teuthology.orchestra.run.smithi086.stderr:16 Sep 05:27:40 ntpd[18456]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T05:27:40.553 INFO:teuthology.orchestra.run.smithi086.stderr:16 Sep 05:27:40 ntpd[18456]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T05:27:40.553 INFO:teuthology.orchestra.run.smithi086.stderr:16 Sep 05:27:40 ntpd[18456]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-16T05:27:40.553 INFO:teuthology.orchestra.run.smithi086.stderr:16 Sep 05:27:40 ntpd[18456]: can't open /var/log/ntpstats/peerstats.20240916: Permission denied 2024-09-16T05:27:40.577 INFO:teuthology.orchestra.run.smithi157.stderr:16 Sep 05:27:40 ntpd[18457]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T05:27:40.577 INFO:teuthology.orchestra.run.smithi157.stderr:16 Sep 05:27:40 ntpd[18457]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T05:27:40.577 INFO:teuthology.orchestra.run.smithi157.stderr:16 Sep 05:27:40 ntpd[18457]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T05:27:40.577 INFO:teuthology.orchestra.run.smithi157.stderr:16 Sep 05:27:40 ntpd[18457]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T05:27:40.577 INFO:teuthology.orchestra.run.smithi157.stderr:16 Sep 05:27:40 ntpd[18457]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T05:27:40.577 INFO:teuthology.orchestra.run.smithi157.stderr:16 Sep 05:27:40 ntpd[18457]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T05:27:40.577 INFO:teuthology.orchestra.run.smithi157.stderr:16 Sep 05:27:40 ntpd[18457]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-16T05:27:40.577 INFO:teuthology.orchestra.run.smithi157.stderr:16 Sep 05:27:40 ntpd[18457]: can't open /var/log/ntpstats/peerstats.20240916: Permission denied 2024-09-16T05:27:40.577 INFO:teuthology.orchestra.run.smithi157.stderr:16 Sep 05:27:40 ntpd[18457]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T05:27:40.577 INFO:teuthology.orchestra.run.smithi157.stderr:16 Sep 05:27:40 ntpd[18457]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T05:27:40.577 INFO:teuthology.orchestra.run.smithi157.stderr:16 Sep 05:27:40 ntpd[18457]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-16T05:27:40.577 INFO:teuthology.orchestra.run.smithi157.stderr:16 Sep 05:27:40 ntpd[18457]: can't open /var/log/ntpstats/peerstats.20240916: Permission denied 2024-09-16T05:27:41.549 INFO:teuthology.orchestra.run.smithi047.stderr:16 Sep 05:27:41 ntpd[18355]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T05:27:41.549 INFO:teuthology.orchestra.run.smithi047.stderr:16 Sep 05:27:41 ntpd[18355]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T05:27:41.549 INFO:teuthology.orchestra.run.smithi047.stderr:16 Sep 05:27:41 ntpd[18355]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T05:27:41.549 INFO:teuthology.orchestra.run.smithi047.stderr:16 Sep 05:27:41 ntpd[18355]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T05:27:41.549 INFO:teuthology.orchestra.run.smithi047.stderr:16 Sep 05:27:41 ntpd[18355]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T05:27:41.549 INFO:teuthology.orchestra.run.smithi047.stderr:16 Sep 05:27:41 ntpd[18355]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T05:27:41.550 INFO:teuthology.orchestra.run.smithi047.stderr:16 Sep 05:27:41 ntpd[18355]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-16T05:27:41.550 INFO:teuthology.orchestra.run.smithi047.stderr:16 Sep 05:27:41 ntpd[18355]: can't open /var/log/ntpstats/peerstats.20240916: Permission denied 2024-09-16T05:27:41.550 INFO:teuthology.orchestra.run.smithi047.stderr:16 Sep 05:27:41 ntpd[18355]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T05:27:41.550 INFO:teuthology.orchestra.run.smithi047.stderr:16 Sep 05:27:41 ntpd[18355]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T05:27:41.550 INFO:teuthology.orchestra.run.smithi047.stderr:16 Sep 05:27:41 ntpd[18355]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-16T05:27:41.550 INFO:teuthology.orchestra.run.smithi047.stderr:16 Sep 05:27:41 ntpd[18355]: can't open /var/log/ntpstats/peerstats.20240916: Permission denied 2024-09-16T05:27:41.552 INFO:teuthology.orchestra.run.smithi086.stderr:16 Sep 05:27:41 ntpd[18456]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T05:27:41.552 INFO:teuthology.orchestra.run.smithi086.stderr:16 Sep 05:27:41 ntpd[18456]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T05:27:41.552 INFO:teuthology.orchestra.run.smithi086.stderr:16 Sep 05:27:41 ntpd[18456]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T05:27:41.552 INFO:teuthology.orchestra.run.smithi086.stderr:16 Sep 05:27:41 ntpd[18456]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T05:27:41.552 INFO:teuthology.orchestra.run.smithi086.stderr:16 Sep 05:27:41 ntpd[18456]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-16T05:27:41.552 INFO:teuthology.orchestra.run.smithi086.stderr:16 Sep 05:27:41 ntpd[18456]: can't open /var/log/ntpstats/peerstats.20240916: Permission denied 2024-09-16T05:27:41.576 INFO:teuthology.orchestra.run.smithi157.stderr:16 Sep 05:27:41 ntpd[18457]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T05:27:41.576 INFO:teuthology.orchestra.run.smithi157.stderr:16 Sep 05:27:41 ntpd[18457]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T05:27:41.576 INFO:teuthology.orchestra.run.smithi157.stderr:16 Sep 05:27:41 ntpd[18457]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T05:27:41.577 INFO:teuthology.orchestra.run.smithi157.stderr:16 Sep 05:27:41 ntpd[18457]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T05:27:41.577 INFO:teuthology.orchestra.run.smithi157.stderr:16 Sep 05:27:41 ntpd[18457]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-16T05:27:41.577 INFO:teuthology.orchestra.run.smithi157.stderr:16 Sep 05:27:41 ntpd[18457]: can't open /var/log/ntpstats/peerstats.20240916: Permission denied 2024-09-16T05:27:42.548 INFO:teuthology.orchestra.run.smithi047.stderr:16 Sep 05:27:42 ntpd[18355]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T05:27:42.548 INFO:teuthology.orchestra.run.smithi047.stderr:16 Sep 05:27:42 ntpd[18355]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T05:27:42.548 INFO:teuthology.orchestra.run.smithi047.stderr:16 Sep 05:27:42 ntpd[18355]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T05:27:42.548 INFO:teuthology.orchestra.run.smithi047.stderr:16 Sep 05:27:42 ntpd[18355]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T05:27:42.549 INFO:teuthology.orchestra.run.smithi047.stderr:16 Sep 05:27:42 ntpd[18355]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-16T05:27:42.549 INFO:teuthology.orchestra.run.smithi047.stderr:16 Sep 05:27:42 ntpd[18355]: can't open /var/log/ntpstats/peerstats.20240916: Permission denied 2024-09-16T05:27:42.552 INFO:teuthology.orchestra.run.smithi086.stderr:16 Sep 05:27:42 ntpd[18456]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T05:27:42.552 INFO:teuthology.orchestra.run.smithi086.stderr:16 Sep 05:27:42 ntpd[18456]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T05:27:42.553 INFO:teuthology.orchestra.run.smithi086.stderr:16 Sep 05:27:42 ntpd[18456]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T05:27:42.553 INFO:teuthology.orchestra.run.smithi086.stderr:16 Sep 05:27:42 ntpd[18456]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T05:27:42.553 INFO:teuthology.orchestra.run.smithi086.stderr:16 Sep 05:27:42 ntpd[18456]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T05:27:42.553 INFO:teuthology.orchestra.run.smithi086.stderr:16 Sep 05:27:42 ntpd[18456]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T05:27:42.553 INFO:teuthology.orchestra.run.smithi086.stderr:16 Sep 05:27:42 ntpd[18456]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-16T05:27:42.553 INFO:teuthology.orchestra.run.smithi086.stderr:16 Sep 05:27:42 ntpd[18456]: can't open /var/log/ntpstats/peerstats.20240916: Permission denied 2024-09-16T05:27:42.553 INFO:teuthology.orchestra.run.smithi086.stderr:16 Sep 05:27:42 ntpd[18456]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T05:27:42.553 INFO:teuthology.orchestra.run.smithi086.stderr:16 Sep 05:27:42 ntpd[18456]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T05:27:42.553 INFO:teuthology.orchestra.run.smithi086.stderr:16 Sep 05:27:42 ntpd[18456]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-16T05:27:42.553 INFO:teuthology.orchestra.run.smithi086.stderr:16 Sep 05:27:42 ntpd[18456]: can't open /var/log/ntpstats/peerstats.20240916: Permission denied 2024-09-16T05:27:42.576 INFO:teuthology.orchestra.run.smithi157.stderr:16 Sep 05:27:42 ntpd[18457]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T05:27:42.576 INFO:teuthology.orchestra.run.smithi157.stderr:16 Sep 05:27:42 ntpd[18457]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T05:27:42.576 INFO:teuthology.orchestra.run.smithi157.stderr:16 Sep 05:27:42 ntpd[18457]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T05:27:42.576 INFO:teuthology.orchestra.run.smithi157.stderr:16 Sep 05:27:42 ntpd[18457]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T05:27:42.577 INFO:teuthology.orchestra.run.smithi157.stderr:16 Sep 05:27:42 ntpd[18457]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T05:27:42.577 INFO:teuthology.orchestra.run.smithi157.stderr:16 Sep 05:27:42 ntpd[18457]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T05:27:42.577 INFO:teuthology.orchestra.run.smithi157.stderr:16 Sep 05:27:42 ntpd[18457]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-16T05:27:42.577 INFO:teuthology.orchestra.run.smithi157.stderr:16 Sep 05:27:42 ntpd[18457]: can't open /var/log/ntpstats/peerstats.20240916: Permission denied 2024-09-16T05:27:42.577 INFO:teuthology.orchestra.run.smithi157.stdout:16 Sep 05:27:42 ntpd[18457]: ntpd: time slew -0.000814 s 2024-09-16T05:27:42.577 INFO:teuthology.orchestra.run.smithi157.stdout:ntpd: time slew -0.000814s 2024-09-16T05:27:42.578 INFO:teuthology.orchestra.run.smithi157.stderr:16 Sep 05:27:42 ntpd[18457]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-09-16T05:27:42.578 INFO:teuthology.orchestra.run.smithi157.stderr:16 Sep 05:27:42 ntpd[18457]: can't open /var/log/ntpstats/loopstats.20240916: Permission denied 2024-09-16T05:27:42.631 INFO:teuthology.orchestra.run.smithi157.stdout: remote refid st t when poll reach delay offset jitter 2024-09-16T05:27:42.631 INFO:teuthology.orchestra.run.smithi157.stdout:============================================================================== 2024-09-16T05:27:42.631 INFO:teuthology.orchestra.run.smithi157.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-16T05:27:42.631 INFO:teuthology.orchestra.run.smithi157.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-16T05:27:42.631 INFO:teuthology.orchestra.run.smithi157.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-16T05:27:42.631 INFO:teuthology.orchestra.run.smithi157.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-16T05:27:43.549 INFO:teuthology.orchestra.run.smithi047.stderr:16 Sep 05:27:43 ntpd[18355]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T05:27:43.549 INFO:teuthology.orchestra.run.smithi047.stderr:16 Sep 05:27:43 ntpd[18355]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T05:27:43.549 INFO:teuthology.orchestra.run.smithi047.stderr:16 Sep 05:27:43 ntpd[18355]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T05:27:43.549 INFO:teuthology.orchestra.run.smithi047.stderr:16 Sep 05:27:43 ntpd[18355]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T05:27:43.549 INFO:teuthology.orchestra.run.smithi047.stderr:16 Sep 05:27:43 ntpd[18355]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T05:27:43.549 INFO:teuthology.orchestra.run.smithi047.stderr:16 Sep 05:27:43 ntpd[18355]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T05:27:43.549 INFO:teuthology.orchestra.run.smithi047.stderr:16 Sep 05:27:43 ntpd[18355]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-16T05:27:43.549 INFO:teuthology.orchestra.run.smithi047.stderr:16 Sep 05:27:43 ntpd[18355]: can't open /var/log/ntpstats/peerstats.20240916: Permission denied 2024-09-16T05:27:43.550 INFO:teuthology.orchestra.run.smithi047.stderr:16 Sep 05:27:43 ntpd[18355]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T05:27:43.550 INFO:teuthology.orchestra.run.smithi047.stderr:16 Sep 05:27:43 ntpd[18355]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T05:27:43.550 INFO:teuthology.orchestra.run.smithi047.stderr:16 Sep 05:27:43 ntpd[18355]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-16T05:27:43.550 INFO:teuthology.orchestra.run.smithi047.stderr:16 Sep 05:27:43 ntpd[18355]: can't open /var/log/ntpstats/peerstats.20240916: Permission denied 2024-09-16T05:27:43.550 INFO:teuthology.orchestra.run.smithi047.stdout:16 Sep 05:27:43 ntpd[18355]: ntpd: time slew -0.003678 s 2024-09-16T05:27:43.550 INFO:teuthology.orchestra.run.smithi047.stdout:ntpd: time slew -0.003678s 2024-09-16T05:27:43.550 INFO:teuthology.orchestra.run.smithi047.stderr:16 Sep 05:27:43 ntpd[18355]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-09-16T05:27:43.551 INFO:teuthology.orchestra.run.smithi047.stderr:16 Sep 05:27:43 ntpd[18355]: can't open /var/log/ntpstats/loopstats.20240916: Permission denied 2024-09-16T05:27:43.552 INFO:teuthology.orchestra.run.smithi086.stderr:16 Sep 05:27:43 ntpd[18456]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T05:27:43.552 INFO:teuthology.orchestra.run.smithi086.stderr:16 Sep 05:27:43 ntpd[18456]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T05:27:43.552 INFO:teuthology.orchestra.run.smithi086.stderr:16 Sep 05:27:43 ntpd[18456]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T05:27:43.552 INFO:teuthology.orchestra.run.smithi086.stderr:16 Sep 05:27:43 ntpd[18456]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T05:27:43.552 INFO:teuthology.orchestra.run.smithi086.stderr:16 Sep 05:27:43 ntpd[18456]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-16T05:27:43.552 INFO:teuthology.orchestra.run.smithi086.stderr:16 Sep 05:27:43 ntpd[18456]: can't open /var/log/ntpstats/peerstats.20240916: Permission denied 2024-09-16T05:27:43.553 INFO:teuthology.orchestra.run.smithi086.stdout:16 Sep 05:27:43 ntpd[18456]: ntpd: time slew +0.000388 s 2024-09-16T05:27:43.553 INFO:teuthology.orchestra.run.smithi086.stdout:ntpd: time slew +0.000388s 2024-09-16T05:27:43.553 INFO:teuthology.orchestra.run.smithi086.stderr:16 Sep 05:27:43 ntpd[18456]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-09-16T05:27:43.553 INFO:teuthology.orchestra.run.smithi086.stderr:16 Sep 05:27:43 ntpd[18456]: can't open /var/log/ntpstats/loopstats.20240916: Permission denied 2024-09-16T05:27:43.595 INFO:teuthology.orchestra.run.smithi086.stdout: remote refid st t when poll reach delay offset jitter 2024-09-16T05:27:43.595 INFO:teuthology.orchestra.run.smithi086.stdout:============================================================================== 2024-09-16T05:27:43.595 INFO:teuthology.orchestra.run.smithi086.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-16T05:27:43.595 INFO:teuthology.orchestra.run.smithi086.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-16T05:27:43.595 INFO:teuthology.orchestra.run.smithi086.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-16T05:27:43.595 INFO:teuthology.orchestra.run.smithi086.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-16T05:27:43.600 INFO:teuthology.orchestra.run.smithi047.stdout: remote refid st t when poll reach delay offset jitter 2024-09-16T05:27:43.600 INFO:teuthology.orchestra.run.smithi047.stdout:============================================================================== 2024-09-16T05:27:43.601 INFO:teuthology.orchestra.run.smithi047.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-16T05:27:43.601 INFO:teuthology.orchestra.run.smithi047.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-16T05:27:43.601 INFO:teuthology.orchestra.run.smithi047.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-16T05:27:43.601 INFO:teuthology.orchestra.run.smithi047.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-16T05:27:43.602 INFO:teuthology.run_tasks:Running task install... 2024-09-16T05:27:43.610 DEBUG:teuthology.task.install:project ceph 2024-09-16T05:27:43.610 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '8921c8ef947807b717db041d85f0761b7914d5fc'}} 2024-09-16T05:27:43.610 DEBUG:teuthology.task.install:config {'flavor': 'default', 'sha1': '8921c8ef947807b717db041d85f0761b7914d5fc'} 2024-09-16T05:27:43.611 INFO:teuthology.task.install:Using flavor: default 2024-09-16T05:27:43.616 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-16T05:27:43.616 INFO:teuthology.task.install:extra packages: [] 2024-09-16T05:27:43.617 DEBUG:teuthology.orchestra.run.smithi047:> sudo apt-key list | grep Ceph 2024-09-16T05:27:43.617 DEBUG:teuthology.orchestra.run.smithi086:> sudo apt-key list | grep Ceph 2024-09-16T05:27:43.618 DEBUG:teuthology.orchestra.run.smithi157:> sudo apt-key list | grep Ceph 2024-09-16T05:27:43.678 INFO:teuthology.orchestra.run.smithi157.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-09-16T05:27:43.691 INFO:teuthology.orchestra.run.smithi086.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-09-16T05:27:43.703 INFO:teuthology.orchestra.run.smithi047.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-09-16T05:27:43.704 INFO:teuthology.orchestra.run.smithi157.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-09-16T05:27:43.704 INFO:teuthology.orchestra.run.smithi157.stdout:uid [ unknown] Ceph.com (release key) 2024-09-16T05:27:43.705 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2024-09-16T05:27:43.705 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=8921c8ef947807b717db041d85f0761b7914d5fc 2024-09-16T05:27:43.717 INFO:teuthology.orchestra.run.smithi086.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-09-16T05:27:43.717 INFO:teuthology.orchestra.run.smithi086.stdout:uid [ unknown] Ceph.com (release key) 2024-09-16T05:27:43.718 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2024-09-16T05:27:43.718 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=8921c8ef947807b717db041d85f0761b7914d5fc 2024-09-16T05:27:43.739 INFO:teuthology.orchestra.run.smithi047.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-09-16T05:27:43.739 INFO:teuthology.orchestra.run.smithi047.stdout:uid [ unknown] Ceph.com (release key) 2024-09-16T05:27:43.740 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2024-09-16T05:27:43.740 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=8921c8ef947807b717db041d85f0761b7914d5fc 2024-09-16T05:27:43.855 INFO:teuthology.task.install.deb:Pulling from https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default/ 2024-09-16T05:27:43.855 INFO:teuthology.task.install.deb:Package version is 19.1.1-326-g8921c8ef-1jammy 2024-09-16T05:27:43.859 INFO:teuthology.task.install.deb:Pulling from https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default/ 2024-09-16T05:27:43.860 INFO:teuthology.task.install.deb:Package version is 19.1.1-326-g8921c8ef-1jammy 2024-09-16T05:27:43.894 INFO:teuthology.task.install.deb:Pulling from https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default/ 2024-09-16T05:27:43.895 INFO:teuthology.task.install.deb:Package version is 19.1.1-326-g8921c8ef-1jammy 2024-09-16T05:27:43.966 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-09-16T05:27:43.967 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-09-16T05:27:43.972 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-09-16T05:27:43.972 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-09-16T05:27:43.980 DEBUG:teuthology.orchestra.run.smithi157:> sudo apt-get update 2024-09-16T05:27:43.986 DEBUG:teuthology.orchestra.run.smithi086:> sudo apt-get update 2024-09-16T05:27:44.003 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-09-16T05:27:44.004 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-09-16T05:27:44.018 DEBUG:teuthology.orchestra.run.smithi047:> sudo apt-get update 2024-09-16T05:27:44.156 INFO:teuthology.orchestra.run.smithi086.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-16T05:27:44.205 INFO:teuthology.orchestra.run.smithi157.stdout:Ign:1 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy InRelease 2024-09-16T05:27:44.209 INFO:teuthology.orchestra.run.smithi086.stdout:Ign:2 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy InRelease 2024-09-16T05:27:44.226 INFO:teuthology.orchestra.run.smithi157.stdout:Get:2 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-09-16T05:27:44.230 INFO:teuthology.orchestra.run.smithi086.stdout:Get:3 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-09-16T05:27:44.242 INFO:teuthology.orchestra.run.smithi047.stdout:Ign:1 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy InRelease 2024-09-16T05:27:44.249 INFO:teuthology.orchestra.run.smithi157.stdout:Ign:3 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy Release.gpg 2024-09-16T05:27:44.252 INFO:teuthology.orchestra.run.smithi086.stdout:Ign:4 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy Release.gpg 2024-09-16T05:27:44.264 INFO:teuthology.orchestra.run.smithi047.stdout:Get:2 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-09-16T05:27:44.274 INFO:teuthology.orchestra.run.smithi086.stdout:Get:5 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.9 kB] 2024-09-16T05:27:44.280 INFO:teuthology.orchestra.run.smithi157.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-16T05:27:44.281 INFO:teuthology.orchestra.run.smithi157.stdout:Hit:5 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-16T05:27:44.281 INFO:teuthology.orchestra.run.smithi157.stdout:Get:6 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,422 B] 2024-09-16T05:27:44.281 INFO:teuthology.orchestra.run.smithi086.stdout:Hit:6 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-16T05:27:44.287 INFO:teuthology.orchestra.run.smithi047.stdout:Ign:3 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy Release.gpg 2024-09-16T05:27:44.302 INFO:teuthology.orchestra.run.smithi086.stdout:Get:7 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,422 B] 2024-09-16T05:27:44.308 INFO:teuthology.orchestra.run.smithi157.stdout:Get:7 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.9 kB] 2024-09-16T05:27:44.317 INFO:teuthology.orchestra.run.smithi047.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-16T05:27:44.317 INFO:teuthology.orchestra.run.smithi047.stdout:Hit:5 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-16T05:27:44.317 INFO:teuthology.orchestra.run.smithi047.stdout:Get:6 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,422 B] 2024-09-16T05:27:44.347 INFO:teuthology.orchestra.run.smithi047.stdout:Get:7 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.9 kB] 2024-09-16T05:27:44.351 INFO:teuthology.orchestra.run.smithi157.stdout:Hit:8 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-16T05:27:44.360 INFO:teuthology.orchestra.run.smithi086.stdout:Hit:8 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-16T05:27:44.390 INFO:teuthology.orchestra.run.smithi047.stdout:Hit:8 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-16T05:27:44.433 INFO:teuthology.orchestra.run.smithi157.stdout:Hit:9 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-16T05:27:44.440 INFO:teuthology.orchestra.run.smithi086.stdout:Hit:9 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-16T05:27:44.471 INFO:teuthology.orchestra.run.smithi047.stdout:Hit:9 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-16T05:27:44.584 INFO:teuthology.orchestra.run.smithi086.stdout:Fetched 29.0 kB in 0s (70.2 kB/s) 2024-09-16T05:27:44.634 INFO:teuthology.orchestra.run.smithi157.stdout:Fetched 29.0 kB in 0s (60.5 kB/s) 2024-09-16T05:27:44.695 INFO:teuthology.orchestra.run.smithi047.stdout:Fetched 29.0 kB in 0s (58.7 kB/s) 2024-09-16T05:27:45.582 INFO:teuthology.orchestra.run.smithi086.stdout:Reading package lists... 2024-09-16T05:27:45.599 DEBUG:teuthology.orchestra.run.smithi086:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.1.1-326-g8921c8ef-1jammy cephadm=19.1.1-326-g8921c8ef-1jammy ceph-mds=19.1.1-326-g8921c8ef-1jammy ceph-mgr=19.1.1-326-g8921c8ef-1jammy ceph-common=19.1.1-326-g8921c8ef-1jammy ceph-fuse=19.1.1-326-g8921c8ef-1jammy ceph-test=19.1.1-326-g8921c8ef-1jammy ceph-volume=19.1.1-326-g8921c8ef-1jammy radosgw=19.1.1-326-g8921c8ef-1jammy python3-rados=19.1.1-326-g8921c8ef-1jammy python3-rgw=19.1.1-326-g8921c8ef-1jammy python3-cephfs=19.1.1-326-g8921c8ef-1jammy python3-rbd=19.1.1-326-g8921c8ef-1jammy libcephfs2=19.1.1-326-g8921c8ef-1jammy libcephfs-dev=19.1.1-326-g8921c8ef-1jammy librados2=19.1.1-326-g8921c8ef-1jammy librbd1=19.1.1-326-g8921c8ef-1jammy rbd-fuse=19.1.1-326-g8921c8ef-1jammy 2024-09-16T05:27:45.611 INFO:teuthology.orchestra.run.smithi157.stdout:Reading package lists... 2024-09-16T05:27:45.627 DEBUG:teuthology.orchestra.run.smithi157:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.1.1-326-g8921c8ef-1jammy cephadm=19.1.1-326-g8921c8ef-1jammy ceph-mds=19.1.1-326-g8921c8ef-1jammy ceph-mgr=19.1.1-326-g8921c8ef-1jammy ceph-common=19.1.1-326-g8921c8ef-1jammy ceph-fuse=19.1.1-326-g8921c8ef-1jammy ceph-test=19.1.1-326-g8921c8ef-1jammy ceph-volume=19.1.1-326-g8921c8ef-1jammy radosgw=19.1.1-326-g8921c8ef-1jammy python3-rados=19.1.1-326-g8921c8ef-1jammy python3-rgw=19.1.1-326-g8921c8ef-1jammy python3-cephfs=19.1.1-326-g8921c8ef-1jammy python3-rbd=19.1.1-326-g8921c8ef-1jammy libcephfs2=19.1.1-326-g8921c8ef-1jammy libcephfs-dev=19.1.1-326-g8921c8ef-1jammy librados2=19.1.1-326-g8921c8ef-1jammy librbd1=19.1.1-326-g8921c8ef-1jammy rbd-fuse=19.1.1-326-g8921c8ef-1jammy 2024-09-16T05:27:45.660 INFO:teuthology.orchestra.run.smithi086.stdout:Reading package lists... 2024-09-16T05:27:45.690 INFO:teuthology.orchestra.run.smithi157.stdout:Reading package lists... 2024-09-16T05:27:45.728 INFO:teuthology.orchestra.run.smithi047.stdout:Reading package lists... 2024-09-16T05:27:45.745 DEBUG:teuthology.orchestra.run.smithi047:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.1.1-326-g8921c8ef-1jammy cephadm=19.1.1-326-g8921c8ef-1jammy ceph-mds=19.1.1-326-g8921c8ef-1jammy ceph-mgr=19.1.1-326-g8921c8ef-1jammy ceph-common=19.1.1-326-g8921c8ef-1jammy ceph-fuse=19.1.1-326-g8921c8ef-1jammy ceph-test=19.1.1-326-g8921c8ef-1jammy ceph-volume=19.1.1-326-g8921c8ef-1jammy radosgw=19.1.1-326-g8921c8ef-1jammy python3-rados=19.1.1-326-g8921c8ef-1jammy python3-rgw=19.1.1-326-g8921c8ef-1jammy python3-cephfs=19.1.1-326-g8921c8ef-1jammy python3-rbd=19.1.1-326-g8921c8ef-1jammy libcephfs2=19.1.1-326-g8921c8ef-1jammy libcephfs-dev=19.1.1-326-g8921c8ef-1jammy librados2=19.1.1-326-g8921c8ef-1jammy librbd1=19.1.1-326-g8921c8ef-1jammy rbd-fuse=19.1.1-326-g8921c8ef-1jammy 2024-09-16T05:27:45.808 INFO:teuthology.orchestra.run.smithi047.stdout:Reading package lists... 2024-09-16T05:27:45.870 INFO:teuthology.orchestra.run.smithi086.stdout:Building dependency tree... 2024-09-16T05:27:45.870 INFO:teuthology.orchestra.run.smithi086.stdout:Reading state information... 2024-09-16T05:27:45.898 INFO:teuthology.orchestra.run.smithi157.stdout:Building dependency tree... 2024-09-16T05:27:45.899 INFO:teuthology.orchestra.run.smithi157.stdout:Reading state information... 2024-09-16T05:27:46.030 INFO:teuthology.orchestra.run.smithi047.stdout:Building dependency tree... 2024-09-16T05:27:46.031 INFO:teuthology.orchestra.run.smithi047.stdout:Reading state information... 2024-09-16T05:27:46.070 INFO:teuthology.orchestra.run.smithi086.stdout:The following packages were automatically installed and are no longer required: 2024-09-16T05:27:46.070 INFO:teuthology.orchestra.run.smithi086.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-16T05:27:46.070 INFO:teuthology.orchestra.run.smithi086.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-16T05:27:46.070 INFO:teuthology.orchestra.run.smithi086.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-16T05:27:46.070 INFO:teuthology.orchestra.run.smithi086.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-16T05:27:46.071 INFO:teuthology.orchestra.run.smithi086.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-16T05:27:46.071 INFO:teuthology.orchestra.run.smithi086.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-16T05:27:46.071 INFO:teuthology.orchestra.run.smithi086.stdout:The following additional packages will be installed: 2024-09-16T05:27:46.071 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-09-16T05:27:46.071 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-09-16T05:27:46.073 INFO:teuthology.orchestra.run.smithi086.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-09-16T05:27:46.073 INFO:teuthology.orchestra.run.smithi086.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-09-16T05:27:46.073 INFO:teuthology.orchestra.run.smithi086.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-09-16T05:27:46.073 INFO:teuthology.orchestra.run.smithi086.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-09-16T05:27:46.073 INFO:teuthology.orchestra.run.smithi086.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-09-16T05:27:46.073 INFO:teuthology.orchestra.run.smithi086.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-09-16T05:27:46.073 INFO:teuthology.orchestra.run.smithi086.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-09-16T05:27:46.073 INFO:teuthology.orchestra.run.smithi086.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-09-16T05:27:46.073 INFO:teuthology.orchestra.run.smithi086.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-16T05:27:46.073 INFO:teuthology.orchestra.run.smithi086.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-16T05:27:46.073 INFO:teuthology.orchestra.run.smithi086.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-16T05:27:46.073 INFO:teuthology.orchestra.run.smithi086.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-16T05:27:46.074 INFO:teuthology.orchestra.run.smithi086.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-16T05:27:46.074 INFO:teuthology.orchestra.run.smithi086.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-16T05:27:46.074 INFO:teuthology.orchestra.run.smithi086.stdout: python3-pygments python3-pyinotify python3-pytest python3-repoze.lru 2024-09-16T05:27:46.074 INFO:teuthology.orchestra.run.smithi086.stdout: python3-requests python3-requests-oauthlib python3-routes python3-rsa 2024-09-16T05:27:46.074 INFO:teuthology.orchestra.run.smithi086.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-09-16T05:27:46.074 INFO:teuthology.orchestra.run.smithi086.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-09-16T05:27:46.074 INFO:teuthology.orchestra.run.smithi086.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-09-16T05:27:46.074 INFO:teuthology.orchestra.run.smithi086.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-09-16T05:27:46.074 INFO:teuthology.orchestra.run.smithi086.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n socat unzip 2024-09-16T05:27:46.074 INFO:teuthology.orchestra.run.smithi086.stdout: xmlstarlet zip 2024-09-16T05:27:46.075 INFO:teuthology.orchestra.run.smithi086.stdout:Suggested packages: 2024-09-16T05:27:46.075 INFO:teuthology.orchestra.run.smithi086.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-09-16T05:27:46.075 INFO:teuthology.orchestra.run.smithi086.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-09-16T05:27:46.075 INFO:teuthology.orchestra.run.smithi086.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-09-16T05:27:46.075 INFO:teuthology.orchestra.run.smithi086.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-09-16T05:27:46.075 INFO:teuthology.orchestra.run.smithi086.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-09-16T05:27:46.075 INFO:teuthology.orchestra.run.smithi086.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-09-16T05:27:46.075 INFO:teuthology.orchestra.run.smithi086.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-09-16T05:27:46.075 INFO:teuthology.orchestra.run.smithi086.stdout:Recommended packages: 2024-09-16T05:27:46.075 INFO:teuthology.orchestra.run.smithi086.stdout: btrfs-tools 2024-09-16T05:27:46.109 INFO:teuthology.orchestra.run.smithi157.stdout:The following packages were automatically installed and are no longer required: 2024-09-16T05:27:46.109 INFO:teuthology.orchestra.run.smithi157.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-16T05:27:46.109 INFO:teuthology.orchestra.run.smithi157.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-16T05:27:46.109 INFO:teuthology.orchestra.run.smithi157.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-16T05:27:46.110 INFO:teuthology.orchestra.run.smithi157.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-16T05:27:46.110 INFO:teuthology.orchestra.run.smithi157.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-16T05:27:46.110 INFO:teuthology.orchestra.run.smithi157.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-16T05:27:46.110 INFO:teuthology.orchestra.run.smithi157.stdout:The following additional packages will be installed: 2024-09-16T05:27:46.110 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-09-16T05:27:46.111 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-09-16T05:27:46.111 INFO:teuthology.orchestra.run.smithi157.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-09-16T05:27:46.111 INFO:teuthology.orchestra.run.smithi157.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-09-16T05:27:46.112 INFO:teuthology.orchestra.run.smithi157.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-09-16T05:27:46.112 INFO:teuthology.orchestra.run.smithi157.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-09-16T05:27:46.112 INFO:teuthology.orchestra.run.smithi157.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-09-16T05:27:46.112 INFO:teuthology.orchestra.run.smithi157.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-09-16T05:27:46.113 INFO:teuthology.orchestra.run.smithi157.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-09-16T05:27:46.113 INFO:teuthology.orchestra.run.smithi157.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-09-16T05:27:46.113 INFO:teuthology.orchestra.run.smithi157.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-16T05:27:46.113 INFO:teuthology.orchestra.run.smithi157.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-16T05:27:46.113 INFO:teuthology.orchestra.run.smithi157.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-16T05:27:46.113 INFO:teuthology.orchestra.run.smithi157.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-16T05:27:46.113 INFO:teuthology.orchestra.run.smithi157.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-16T05:27:46.113 INFO:teuthology.orchestra.run.smithi157.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-16T05:27:46.113 INFO:teuthology.orchestra.run.smithi157.stdout: python3-pygments python3-pyinotify python3-pytest python3-repoze.lru 2024-09-16T05:27:46.113 INFO:teuthology.orchestra.run.smithi157.stdout: python3-requests python3-requests-oauthlib python3-routes python3-rsa 2024-09-16T05:27:46.113 INFO:teuthology.orchestra.run.smithi157.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-09-16T05:27:46.113 INFO:teuthology.orchestra.run.smithi157.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-09-16T05:27:46.113 INFO:teuthology.orchestra.run.smithi157.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-09-16T05:27:46.113 INFO:teuthology.orchestra.run.smithi157.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-09-16T05:27:46.114 INFO:teuthology.orchestra.run.smithi157.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n socat unzip 2024-09-16T05:27:46.114 INFO:teuthology.orchestra.run.smithi157.stdout: xmlstarlet zip 2024-09-16T05:27:46.114 INFO:teuthology.orchestra.run.smithi157.stdout:Suggested packages: 2024-09-16T05:27:46.114 INFO:teuthology.orchestra.run.smithi157.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-09-16T05:27:46.114 INFO:teuthology.orchestra.run.smithi157.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-09-16T05:27:46.114 INFO:teuthology.orchestra.run.smithi157.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-09-16T05:27:46.114 INFO:teuthology.orchestra.run.smithi157.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-09-16T05:27:46.114 INFO:teuthology.orchestra.run.smithi157.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-09-16T05:27:46.114 INFO:teuthology.orchestra.run.smithi157.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-09-16T05:27:46.114 INFO:teuthology.orchestra.run.smithi157.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-09-16T05:27:46.115 INFO:teuthology.orchestra.run.smithi157.stdout:Recommended packages: 2024-09-16T05:27:46.115 INFO:teuthology.orchestra.run.smithi157.stdout: btrfs-tools 2024-09-16T05:27:46.176 INFO:teuthology.orchestra.run.smithi086.stdout:The following NEW packages will be installed: 2024-09-16T05:27:46.177 INFO:teuthology.orchestra.run.smithi086.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-09-16T05:27:46.177 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-09-16T05:27:46.177 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm jq 2024-09-16T05:27:46.177 INFO:teuthology.orchestra.run.smithi086.stdout: libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 liblttng-ust1 2024-09-16T05:27:46.177 INFO:teuthology.orchestra.run.smithi086.stdout: liblua5.3-dev liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 2024-09-16T05:27:46.177 INFO:teuthology.orchestra.run.smithi086.stdout: libqt5network5 librados2 libradosstriper1 librbd1 librdkafka1 2024-09-16T05:27:46.178 INFO:teuthology.orchestra.run.smithi086.stdout: libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec 2024-09-16T05:27:46.178 INFO:teuthology.orchestra.run.smithi086.stdout: lua-socket lua5.1 luarocks nvme-cli pkg-config python-asyncssh-doc 2024-09-16T05:27:46.178 INFO:teuthology.orchestra.run.smithi086.stdout: python-babel-localedata python-pastedeploy-tpl python3-asyncssh 2024-09-16T05:27:46.178 INFO:teuthology.orchestra.run.smithi086.stdout: python3-babel python3-bcrypt python3-cachetools python3-ceph-argparse 2024-09-16T05:27:46.178 INFO:teuthology.orchestra.run.smithi086.stdout: python3-ceph-common python3-cephfs python3-certifi python3-cheroot 2024-09-16T05:27:46.178 INFO:teuthology.orchestra.run.smithi086.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-09-16T05:27:46.179 INFO:teuthology.orchestra.run.smithi086.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-16T05:27:46.179 INFO:teuthology.orchestra.run.smithi086.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-16T05:27:46.179 INFO:teuthology.orchestra.run.smithi086.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-16T05:27:46.179 INFO:teuthology.orchestra.run.smithi086.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-16T05:27:46.179 INFO:teuthology.orchestra.run.smithi086.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-16T05:27:46.179 INFO:teuthology.orchestra.run.smithi086.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-16T05:27:46.179 INFO:teuthology.orchestra.run.smithi086.stdout: python3-pygments python3-pyinotify python3-pytest python3-rados python3-rbd 2024-09-16T05:27:46.179 INFO:teuthology.orchestra.run.smithi086.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-rgw 2024-09-16T05:27:46.179 INFO:teuthology.orchestra.run.smithi086.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2024-09-16T05:27:46.179 INFO:teuthology.orchestra.run.smithi086.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-tempita 2024-09-16T05:27:46.179 INFO:teuthology.orchestra.run.smithi086.stdout: python3-tempora python3-threadpoolctl python3-toml python3-urllib3 2024-09-16T05:27:46.179 INFO:teuthology.orchestra.run.smithi086.stdout: python3-waitress python3-wcwidth python3-webob python3-websocket 2024-09-16T05:27:46.179 INFO:teuthology.orchestra.run.smithi086.stdout: python3-webtest python3-werkzeug python3-zc.lockfile qttranslations5-l10n 2024-09-16T05:27:46.179 INFO:teuthology.orchestra.run.smithi086.stdout: radosgw rbd-fuse socat unzip xmlstarlet zip 2024-09-16T05:27:46.218 INFO:teuthology.orchestra.run.smithi157.stdout:The following NEW packages will be installed: 2024-09-16T05:27:46.218 INFO:teuthology.orchestra.run.smithi157.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-09-16T05:27:46.218 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-09-16T05:27:46.218 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm jq 2024-09-16T05:27:46.218 INFO:teuthology.orchestra.run.smithi157.stdout: libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 liblttng-ust1 2024-09-16T05:27:46.219 INFO:teuthology.orchestra.run.smithi157.stdout: liblua5.3-dev liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 2024-09-16T05:27:46.219 INFO:teuthology.orchestra.run.smithi157.stdout: libqt5network5 librados2 libradosstriper1 librbd1 librdkafka1 2024-09-16T05:27:46.220 INFO:teuthology.orchestra.run.smithi157.stdout: libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec 2024-09-16T05:27:46.220 INFO:teuthology.orchestra.run.smithi157.stdout: lua-socket lua5.1 luarocks nvme-cli pkg-config python-asyncssh-doc 2024-09-16T05:27:46.220 INFO:teuthology.orchestra.run.smithi157.stdout: python-babel-localedata python-pastedeploy-tpl python3-asyncssh 2024-09-16T05:27:46.220 INFO:teuthology.orchestra.run.smithi157.stdout: python3-babel python3-bcrypt python3-cachetools python3-ceph-argparse 2024-09-16T05:27:46.220 INFO:teuthology.orchestra.run.smithi157.stdout: python3-ceph-common python3-cephfs python3-certifi python3-cheroot 2024-09-16T05:27:46.221 INFO:teuthology.orchestra.run.smithi157.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-09-16T05:27:46.221 INFO:teuthology.orchestra.run.smithi157.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-16T05:27:46.221 INFO:teuthology.orchestra.run.smithi157.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-16T05:27:46.221 INFO:teuthology.orchestra.run.smithi157.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-16T05:27:46.221 INFO:teuthology.orchestra.run.smithi157.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-16T05:27:46.221 INFO:teuthology.orchestra.run.smithi157.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-16T05:27:46.221 INFO:teuthology.orchestra.run.smithi157.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-16T05:27:46.221 INFO:teuthology.orchestra.run.smithi157.stdout: python3-pygments python3-pyinotify python3-pytest python3-rados python3-rbd 2024-09-16T05:27:46.221 INFO:teuthology.orchestra.run.smithi157.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-rgw 2024-09-16T05:27:46.221 INFO:teuthology.orchestra.run.smithi157.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2024-09-16T05:27:46.221 INFO:teuthology.orchestra.run.smithi157.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-tempita 2024-09-16T05:27:46.222 INFO:teuthology.orchestra.run.smithi157.stdout: python3-tempora python3-threadpoolctl python3-toml python3-urllib3 2024-09-16T05:27:46.222 INFO:teuthology.orchestra.run.smithi157.stdout: python3-waitress python3-wcwidth python3-webob python3-websocket 2024-09-16T05:27:46.222 INFO:teuthology.orchestra.run.smithi157.stdout: python3-webtest python3-werkzeug python3-zc.lockfile qttranslations5-l10n 2024-09-16T05:27:46.222 INFO:teuthology.orchestra.run.smithi157.stdout: radosgw rbd-fuse socat unzip xmlstarlet zip 2024-09-16T05:27:46.250 INFO:teuthology.orchestra.run.smithi047.stdout:The following packages were automatically installed and are no longer required: 2024-09-16T05:27:46.250 INFO:teuthology.orchestra.run.smithi047.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-16T05:27:46.250 INFO:teuthology.orchestra.run.smithi047.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-16T05:27:46.250 INFO:teuthology.orchestra.run.smithi047.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-16T05:27:46.251 INFO:teuthology.orchestra.run.smithi047.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-16T05:27:46.251 INFO:teuthology.orchestra.run.smithi047.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-16T05:27:46.251 INFO:teuthology.orchestra.run.smithi047.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-16T05:27:46.252 INFO:teuthology.orchestra.run.smithi047.stdout:The following additional packages will be installed: 2024-09-16T05:27:46.252 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-09-16T05:27:46.252 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-09-16T05:27:46.252 INFO:teuthology.orchestra.run.smithi047.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-09-16T05:27:46.252 INFO:teuthology.orchestra.run.smithi047.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-09-16T05:27:46.253 INFO:teuthology.orchestra.run.smithi047.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-09-16T05:27:46.254 INFO:teuthology.orchestra.run.smithi047.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-09-16T05:27:46.254 INFO:teuthology.orchestra.run.smithi047.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-09-16T05:27:46.254 INFO:teuthology.orchestra.run.smithi047.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-09-16T05:27:46.254 INFO:teuthology.orchestra.run.smithi047.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-09-16T05:27:46.254 INFO:teuthology.orchestra.run.smithi047.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-09-16T05:27:46.254 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-16T05:27:46.254 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-16T05:27:46.254 INFO:teuthology.orchestra.run.smithi047.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-16T05:27:46.254 INFO:teuthology.orchestra.run.smithi047.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-16T05:27:46.255 INFO:teuthology.orchestra.run.smithi047.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-16T05:27:46.255 INFO:teuthology.orchestra.run.smithi047.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-16T05:27:46.255 INFO:teuthology.orchestra.run.smithi047.stdout: python3-pygments python3-pyinotify python3-pytest python3-repoze.lru 2024-09-16T05:27:46.255 INFO:teuthology.orchestra.run.smithi047.stdout: python3-requests python3-requests-oauthlib python3-routes python3-rsa 2024-09-16T05:27:46.255 INFO:teuthology.orchestra.run.smithi047.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-09-16T05:27:46.255 INFO:teuthology.orchestra.run.smithi047.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-09-16T05:27:46.255 INFO:teuthology.orchestra.run.smithi047.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-09-16T05:27:46.255 INFO:teuthology.orchestra.run.smithi047.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-09-16T05:27:46.255 INFO:teuthology.orchestra.run.smithi047.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n socat unzip 2024-09-16T05:27:46.255 INFO:teuthology.orchestra.run.smithi047.stdout: xmlstarlet zip 2024-09-16T05:27:46.256 INFO:teuthology.orchestra.run.smithi047.stdout:Suggested packages: 2024-09-16T05:27:46.256 INFO:teuthology.orchestra.run.smithi047.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-09-16T05:27:46.256 INFO:teuthology.orchestra.run.smithi047.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-09-16T05:27:46.256 INFO:teuthology.orchestra.run.smithi047.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-09-16T05:27:46.256 INFO:teuthology.orchestra.run.smithi047.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-09-16T05:27:46.256 INFO:teuthology.orchestra.run.smithi047.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-09-16T05:27:46.256 INFO:teuthology.orchestra.run.smithi047.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-09-16T05:27:46.256 INFO:teuthology.orchestra.run.smithi047.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-09-16T05:27:46.256 INFO:teuthology.orchestra.run.smithi047.stdout:Recommended packages: 2024-09-16T05:27:46.257 INFO:teuthology.orchestra.run.smithi047.stdout: btrfs-tools 2024-09-16T05:27:46.324 INFO:teuthology.orchestra.run.smithi086.stdout:0 upgraded, 118 newly installed, 0 to remove and 331 not upgraded. 2024-09-16T05:27:46.324 INFO:teuthology.orchestra.run.smithi086.stdout:Need to get 181 MB of archives. 2024-09-16T05:27:46.324 INFO:teuthology.orchestra.run.smithi086.stdout:After this operation, 829 MB of additional disk space will be used. 2024-09-16T05:27:46.324 INFO:teuthology.orchestra.run.smithi086.stdout:Get:1 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.1.1-326-g8921c8ef-1jammy [3,590 kB] 2024-09-16T05:27:46.362 INFO:teuthology.orchestra.run.smithi157.stdout:0 upgraded, 118 newly installed, 0 to remove and 331 not upgraded. 2024-09-16T05:27:46.362 INFO:teuthology.orchestra.run.smithi157.stdout:Need to get 181 MB of archives. 2024-09-16T05:27:46.362 INFO:teuthology.orchestra.run.smithi157.stdout:After this operation, 829 MB of additional disk space will be used. 2024-09-16T05:27:46.362 INFO:teuthology.orchestra.run.smithi157.stdout:Get:1 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.1.1-326-g8921c8ef-1jammy [3,590 kB] 2024-09-16T05:27:46.363 INFO:teuthology.orchestra.run.smithi047.stdout:The following NEW packages will be installed: 2024-09-16T05:27:46.364 INFO:teuthology.orchestra.run.smithi047.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-09-16T05:27:46.364 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-09-16T05:27:46.365 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm jq 2024-09-16T05:27:46.365 INFO:teuthology.orchestra.run.smithi047.stdout: libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 liblttng-ust1 2024-09-16T05:27:46.365 INFO:teuthology.orchestra.run.smithi047.stdout: liblua5.3-dev liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 2024-09-16T05:27:46.365 INFO:teuthology.orchestra.run.smithi047.stdout: libqt5network5 librados2 libradosstriper1 librbd1 librdkafka1 2024-09-16T05:27:46.366 INFO:teuthology.orchestra.run.smithi047.stdout: libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec 2024-09-16T05:27:46.366 INFO:teuthology.orchestra.run.smithi047.stdout: lua-socket lua5.1 luarocks nvme-cli pkg-config python-asyncssh-doc 2024-09-16T05:27:46.366 INFO:teuthology.orchestra.run.smithi047.stdout: python-babel-localedata python-pastedeploy-tpl python3-asyncssh 2024-09-16T05:27:46.366 INFO:teuthology.orchestra.run.smithi047.stdout: python3-babel python3-bcrypt python3-cachetools python3-ceph-argparse 2024-09-16T05:27:46.366 INFO:teuthology.orchestra.run.smithi047.stdout: python3-ceph-common python3-cephfs python3-certifi python3-cheroot 2024-09-16T05:27:46.366 INFO:teuthology.orchestra.run.smithi047.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-09-16T05:27:46.366 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-16T05:27:46.366 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-16T05:27:46.366 INFO:teuthology.orchestra.run.smithi047.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-16T05:27:46.366 INFO:teuthology.orchestra.run.smithi047.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-16T05:27:46.366 INFO:teuthology.orchestra.run.smithi047.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-16T05:27:46.366 INFO:teuthology.orchestra.run.smithi047.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-16T05:27:46.366 INFO:teuthology.orchestra.run.smithi047.stdout: python3-pygments python3-pyinotify python3-pytest python3-rados python3-rbd 2024-09-16T05:27:46.366 INFO:teuthology.orchestra.run.smithi047.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-rgw 2024-09-16T05:27:46.366 INFO:teuthology.orchestra.run.smithi047.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2024-09-16T05:27:46.367 INFO:teuthology.orchestra.run.smithi047.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-tempita 2024-09-16T05:27:46.367 INFO:teuthology.orchestra.run.smithi047.stdout: python3-tempora python3-threadpoolctl python3-toml python3-urllib3 2024-09-16T05:27:46.367 INFO:teuthology.orchestra.run.smithi047.stdout: python3-waitress python3-wcwidth python3-webob python3-websocket 2024-09-16T05:27:46.367 INFO:teuthology.orchestra.run.smithi047.stdout: python3-webtest python3-werkzeug python3-zc.lockfile qttranslations5-l10n 2024-09-16T05:27:46.367 INFO:teuthology.orchestra.run.smithi047.stdout: radosgw rbd-fuse socat unzip xmlstarlet zip 2024-09-16T05:27:46.368 INFO:teuthology.orchestra.run.smithi086.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-09-16T05:27:46.408 INFO:teuthology.orchestra.run.smithi157.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-09-16T05:27:46.428 INFO:teuthology.orchestra.run.smithi047.stdout:0 upgraded, 118 newly installed, 0 to remove and 331 not upgraded. 2024-09-16T05:27:46.428 INFO:teuthology.orchestra.run.smithi047.stdout:Need to get 181 MB of archives. 2024-09-16T05:27:46.428 INFO:teuthology.orchestra.run.smithi047.stdout:After this operation, 829 MB of additional disk space will be used. 2024-09-16T05:27:46.428 INFO:teuthology.orchestra.run.smithi047.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-09-16T05:27:46.516 INFO:teuthology.orchestra.run.smithi047.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-09-16T05:27:46.519 INFO:teuthology.orchestra.run.smithi047.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-09-16T05:27:46.536 INFO:teuthology.orchestra.run.smithi047.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-09-16T05:27:46.537 INFO:teuthology.orchestra.run.smithi047.stdout:Get:5 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.1.1-326-g8921c8ef-1jammy [3,590 kB] 2024-09-16T05:27:46.539 INFO:teuthology.orchestra.run.smithi086.stdout:Get:3 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.1.1-326-g8921c8ef-1jammy [3,241 kB] 2024-09-16T05:27:46.582 INFO:teuthology.orchestra.run.smithi157.stdout:Get:3 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.1.1-326-g8921c8ef-1jammy [3,241 kB] 2024-09-16T05:27:46.597 INFO:teuthology.orchestra.run.smithi047.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-09-16T05:27:46.602 INFO:teuthology.orchestra.run.smithi047.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-09-16T05:27:46.614 INFO:teuthology.orchestra.run.smithi047.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-09-16T05:27:46.618 INFO:teuthology.orchestra.run.smithi047.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-09-16T05:27:46.619 INFO:teuthology.orchestra.run.smithi047.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-09-16T05:27:46.620 INFO:teuthology.orchestra.run.smithi047.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-09-16T05:27:46.624 INFO:teuthology.orchestra.run.smithi086.stdout:Get:4 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.1.1-326-g8921c8ef-1jammy [719 kB] 2024-09-16T05:27:46.629 INFO:teuthology.orchestra.run.smithi047.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-09-16T05:27:46.631 INFO:teuthology.orchestra.run.smithi047.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-09-16T05:27:46.633 INFO:teuthology.orchestra.run.smithi047.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-09-16T05:27:46.635 INFO:teuthology.orchestra.run.smithi047.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-09-16T05:27:46.635 INFO:teuthology.orchestra.run.smithi047.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-09-16T05:27:46.638 INFO:teuthology.orchestra.run.smithi047.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-09-16T05:27:46.638 INFO:teuthology.orchestra.run.smithi086.stdout:Get:5 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.1.1-326-g8921c8ef-1jammy [356 kB] 2024-09-16T05:27:46.645 INFO:teuthology.orchestra.run.smithi086.stdout:Get:6 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.1.1-326-g8921c8ef-1jammy [32.8 kB] 2024-09-16T05:27:46.646 INFO:teuthology.orchestra.run.smithi086.stdout:Get:7 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.1.1-326-g8921c8ef-1jammy [180 kB] 2024-09-16T05:27:46.650 INFO:teuthology.orchestra.run.smithi086.stdout:Get:8 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.1.1-326-g8921c8ef-1jammy [67.8 kB] 2024-09-16T05:27:46.651 INFO:teuthology.orchestra.run.smithi086.stdout:Get:9 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.1.1-326-g8921c8ef-1jammy [333 kB] 2024-09-16T05:27:46.652 INFO:teuthology.orchestra.run.smithi047.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-09-16T05:27:46.654 INFO:teuthology.orchestra.run.smithi047.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-09-16T05:27:46.655 INFO:teuthology.orchestra.run.smithi047.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-09-16T05:27:46.655 INFO:teuthology.orchestra.run.smithi047.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-09-16T05:27:46.656 INFO:teuthology.orchestra.run.smithi086.stdout:Get:10 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.1.1-326-g8921c8ef-1jammy [6,875 kB] 2024-09-16T05:27:46.657 INFO:teuthology.orchestra.run.smithi047.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-09-16T05:27:46.657 INFO:teuthology.orchestra.run.smithi047.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-09-16T05:27:46.669 INFO:teuthology.orchestra.run.smithi047.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-09-16T05:27:46.670 INFO:teuthology.orchestra.run.smithi047.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-09-16T05:27:46.670 INFO:teuthology.orchestra.run.smithi047.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-09-16T05:27:46.671 INFO:teuthology.orchestra.run.smithi047.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-09-16T05:27:46.684 INFO:teuthology.orchestra.run.smithi157.stdout:Get:4 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.1.1-326-g8921c8ef-1jammy [719 kB] 2024-09-16T05:27:46.687 INFO:teuthology.orchestra.run.smithi047.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-09-16T05:27:46.689 INFO:teuthology.orchestra.run.smithi047.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-09-16T05:27:46.690 INFO:teuthology.orchestra.run.smithi047.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-09-16T05:27:46.690 INFO:teuthology.orchestra.run.smithi047.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-09-16T05:27:46.691 INFO:teuthology.orchestra.run.smithi047.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-09-16T05:27:46.692 INFO:teuthology.orchestra.run.smithi047.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-09-16T05:27:46.704 INFO:teuthology.orchestra.run.smithi047.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-09-16T05:27:46.705 INFO:teuthology.orchestra.run.smithi047.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-webob all 1:1.8.6-1.1ubuntu0.1 [86.7 kB] 2024-09-16T05:27:46.706 INFO:teuthology.orchestra.run.smithi047.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-09-16T05:27:46.707 INFO:teuthology.orchestra.run.smithi047.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-09-16T05:27:46.721 INFO:teuthology.orchestra.run.smithi047.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-09-16T05:27:46.728 INFO:teuthology.orchestra.run.smithi047.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-09-16T05:27:46.728 INFO:teuthology.orchestra.run.smithi047.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-09-16T05:27:46.728 INFO:teuthology.orchestra.run.smithi047.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-09-16T05:27:46.729 INFO:teuthology.orchestra.run.smithi047.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-09-16T05:27:46.730 INFO:teuthology.orchestra.run.smithi047.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-09-16T05:27:46.737 INFO:teuthology.orchestra.run.smithi157.stdout:Get:5 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.1.1-326-g8921c8ef-1jammy [356 kB] 2024-09-16T05:27:46.738 INFO:teuthology.orchestra.run.smithi047.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-idna all 3.3-1ubuntu0.1 [52.1 kB] 2024-09-16T05:27:46.739 INFO:teuthology.orchestra.run.smithi047.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-09-16T05:27:46.741 INFO:teuthology.orchestra.run.smithi047.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-09-16T05:27:46.741 INFO:teuthology.orchestra.run.smithi047.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.2 [181 kB] 2024-09-16T05:27:46.745 INFO:teuthology.orchestra.run.smithi157.stdout:Get:6 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.1.1-326-g8921c8ef-1jammy [32.8 kB] 2024-09-16T05:27:46.746 INFO:teuthology.orchestra.run.smithi157.stdout:Get:7 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.1.1-326-g8921c8ef-1jammy [180 kB] 2024-09-16T05:27:46.750 INFO:teuthology.orchestra.run.smithi157.stdout:Get:8 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.1.1-326-g8921c8ef-1jammy [67.8 kB] 2024-09-16T05:27:46.751 INFO:teuthology.orchestra.run.smithi157.stdout:Get:9 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.1.1-326-g8921c8ef-1jammy [333 kB] 2024-09-16T05:27:46.755 INFO:teuthology.orchestra.run.smithi047.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-09-16T05:27:46.756 INFO:teuthology.orchestra.run.smithi047.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-09-16T05:27:46.757 INFO:teuthology.orchestra.run.smithi047.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-09-16T05:27:46.758 INFO:teuthology.orchestra.run.smithi157.stdout:Get:10 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.1.1-326-g8921c8ef-1jammy [6,875 kB] 2024-09-16T05:27:46.760 INFO:teuthology.orchestra.run.smithi047.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-09-16T05:27:46.792 INFO:teuthology.orchestra.run.smithi086.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-09-16T05:27:46.805 INFO:teuthology.orchestra.run.smithi086.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-09-16T05:27:46.814 INFO:teuthology.orchestra.run.smithi047.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-09-16T05:27:46.815 INFO:teuthology.orchestra.run.smithi047.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.2 [108 kB] 2024-09-16T05:27:46.816 INFO:teuthology.orchestra.run.smithi047.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-09-16T05:27:46.817 INFO:teuthology.orchestra.run.smithi047.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-09-16T05:27:46.818 INFO:teuthology.orchestra.run.smithi047.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-09-16T05:27:46.832 INFO:teuthology.orchestra.run.smithi157.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-09-16T05:27:46.835 INFO:teuthology.orchestra.run.smithi047.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-09-16T05:27:46.837 INFO:teuthology.orchestra.run.smithi047.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-09-16T05:27:46.837 INFO:teuthology.orchestra.run.smithi047.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-09-16T05:27:46.845 INFO:teuthology.orchestra.run.smithi157.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-09-16T05:27:46.852 INFO:teuthology.orchestra.run.smithi047.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-09-16T05:27:46.852 INFO:teuthology.orchestra.run.smithi047.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-09-16T05:27:46.852 INFO:teuthology.orchestra.run.smithi047.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-09-16T05:27:46.853 INFO:teuthology.orchestra.run.smithi047.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-09-16T05:27:46.853 INFO:teuthology.orchestra.run.smithi047.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-09-16T05:27:46.854 INFO:teuthology.orchestra.run.smithi047.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-09-16T05:27:46.867 INFO:teuthology.orchestra.run.smithi047.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-09-16T05:27:46.867 INFO:teuthology.orchestra.run.smithi047.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-09-16T05:27:46.871 INFO:teuthology.orchestra.run.smithi047.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-09-16T05:27:46.884 INFO:teuthology.orchestra.run.smithi047.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-09-16T05:27:46.886 INFO:teuthology.orchestra.run.smithi047.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-09-16T05:27:46.886 INFO:teuthology.orchestra.run.smithi086.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-09-16T05:27:46.886 INFO:teuthology.orchestra.run.smithi047.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-09-16T05:27:46.889 INFO:teuthology.orchestra.run.smithi047.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-09-16T05:27:46.891 INFO:teuthology.orchestra.run.smithi047.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-09-16T05:27:46.892 INFO:teuthology.orchestra.run.smithi047.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-09-16T05:27:46.893 INFO:teuthology.orchestra.run.smithi047.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.3 [474 kB] 2024-09-16T05:27:46.901 INFO:teuthology.orchestra.run.smithi047.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-09-16T05:27:46.902 INFO:teuthology.orchestra.run.smithi047.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-09-16T05:27:46.905 INFO:teuthology.orchestra.run.smithi047.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-09-16T05:27:46.918 INFO:teuthology.orchestra.run.smithi047.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-09-16T05:27:46.919 INFO:teuthology.orchestra.run.smithi086.stdout:Get:14 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.1.1-326-g8921c8ef-1jammy [112 kB] 2024-09-16T05:27:46.919 INFO:teuthology.orchestra.run.smithi047.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-09-16T05:27:46.919 INFO:teuthology.orchestra.run.smithi047.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-09-16T05:27:46.920 INFO:teuthology.orchestra.run.smithi086.stdout:Get:15 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.1.1-326-g8921c8ef-1jammy [472 kB] 2024-09-16T05:27:46.921 INFO:teuthology.orchestra.run.smithi047.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-09-16T05:27:46.921 INFO:teuthology.orchestra.run.smithi047.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-09-16T05:27:46.926 INFO:teuthology.orchestra.run.smithi157.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-09-16T05:27:46.927 INFO:teuthology.orchestra.run.smithi086.stdout:Get:16 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.1.1-326-g8921c8ef-1jammy [25.9 MB] 2024-09-16T05:27:46.927 INFO:teuthology.orchestra.run.smithi047.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-09-16T05:27:46.927 INFO:teuthology.orchestra.run.smithi047.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-09-16T05:27:46.935 INFO:teuthology.orchestra.run.smithi047.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-09-16T05:27:46.937 INFO:teuthology.orchestra.run.smithi047.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-09-16T05:27:46.938 INFO:teuthology.orchestra.run.smithi047.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-09-16T05:27:46.979 INFO:teuthology.orchestra.run.smithi157.stdout:Get:14 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.1.1-326-g8921c8ef-1jammy [112 kB] 2024-09-16T05:27:46.982 INFO:teuthology.orchestra.run.smithi157.stdout:Get:15 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.1.1-326-g8921c8ef-1jammy [472 kB] 2024-09-16T05:27:46.991 INFO:teuthology.orchestra.run.smithi157.stdout:Get:16 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.1.1-326-g8921c8ef-1jammy [25.9 MB] 2024-09-16T05:27:47.115 INFO:teuthology.orchestra.run.smithi086.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-09-16T05:27:47.129 INFO:teuthology.orchestra.run.smithi086.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-09-16T05:27:47.156 INFO:teuthology.orchestra.run.smithi086.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-09-16T05:27:47.157 INFO:teuthology.orchestra.run.smithi157.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-09-16T05:27:47.164 INFO:teuthology.orchestra.run.smithi086.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-09-16T05:27:47.165 INFO:teuthology.orchestra.run.smithi086.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-09-16T05:27:47.167 INFO:teuthology.orchestra.run.smithi086.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-09-16T05:27:47.167 INFO:teuthology.orchestra.run.smithi157.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-09-16T05:27:47.185 INFO:teuthology.orchestra.run.smithi086.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-09-16T05:27:47.189 INFO:teuthology.orchestra.run.smithi086.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-09-16T05:27:47.193 INFO:teuthology.orchestra.run.smithi086.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-09-16T05:27:47.197 INFO:teuthology.orchestra.run.smithi157.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-09-16T05:27:47.197 INFO:teuthology.orchestra.run.smithi086.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-09-16T05:27:47.206 INFO:teuthology.orchestra.run.smithi157.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-09-16T05:27:47.207 INFO:teuthology.orchestra.run.smithi157.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-09-16T05:27:47.208 INFO:teuthology.orchestra.run.smithi157.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-09-16T05:27:47.228 INFO:teuthology.orchestra.run.smithi157.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-09-16T05:27:47.232 INFO:teuthology.orchestra.run.smithi157.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-09-16T05:27:47.236 INFO:teuthology.orchestra.run.smithi157.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-09-16T05:27:47.239 INFO:teuthology.orchestra.run.smithi157.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-09-16T05:27:47.278 INFO:teuthology.orchestra.run.smithi086.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-09-16T05:27:47.282 INFO:teuthology.orchestra.run.smithi086.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-09-16T05:27:47.286 INFO:teuthology.orchestra.run.smithi086.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-09-16T05:27:47.290 INFO:teuthology.orchestra.run.smithi086.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-09-16T05:27:47.291 INFO:teuthology.orchestra.run.smithi086.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-09-16T05:27:47.292 INFO:teuthology.orchestra.run.smithi086.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-09-16T05:27:47.294 INFO:teuthology.orchestra.run.smithi086.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-09-16T05:27:47.294 INFO:teuthology.orchestra.run.smithi086.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-09-16T05:27:47.295 INFO:teuthology.orchestra.run.smithi086.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-09-16T05:27:47.320 INFO:teuthology.orchestra.run.smithi157.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-09-16T05:27:47.324 INFO:teuthology.orchestra.run.smithi157.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-09-16T05:27:47.328 INFO:teuthology.orchestra.run.smithi157.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-09-16T05:27:47.331 INFO:teuthology.orchestra.run.smithi157.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-09-16T05:27:47.333 INFO:teuthology.orchestra.run.smithi157.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-09-16T05:27:47.333 INFO:teuthology.orchestra.run.smithi157.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-09-16T05:27:47.335 INFO:teuthology.orchestra.run.smithi157.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-09-16T05:27:47.360 INFO:teuthology.orchestra.run.smithi086.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-09-16T05:27:47.378 INFO:teuthology.orchestra.run.smithi086.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-09-16T05:27:47.378 INFO:teuthology.orchestra.run.smithi086.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-09-16T05:27:47.379 INFO:teuthology.orchestra.run.smithi086.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-09-16T05:27:47.384 INFO:teuthology.orchestra.run.smithi086.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-09-16T05:27:47.385 INFO:teuthology.orchestra.run.smithi086.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-09-16T05:27:47.402 INFO:teuthology.orchestra.run.smithi157.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-09-16T05:27:47.402 INFO:teuthology.orchestra.run.smithi157.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-09-16T05:27:47.403 INFO:teuthology.orchestra.run.smithi157.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-09-16T05:27:47.442 INFO:teuthology.orchestra.run.smithi086.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-09-16T05:27:47.443 INFO:teuthology.orchestra.run.smithi086.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-09-16T05:27:47.445 INFO:teuthology.orchestra.run.smithi086.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-09-16T05:27:47.445 INFO:teuthology.orchestra.run.smithi086.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-09-16T05:27:47.483 INFO:teuthology.orchestra.run.smithi157.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-09-16T05:27:47.484 INFO:teuthology.orchestra.run.smithi157.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-09-16T05:27:47.484 INFO:teuthology.orchestra.run.smithi157.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-09-16T05:27:47.490 INFO:teuthology.orchestra.run.smithi157.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-09-16T05:27:47.491 INFO:teuthology.orchestra.run.smithi157.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-09-16T05:27:47.492 INFO:teuthology.orchestra.run.smithi157.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-09-16T05:27:47.492 INFO:teuthology.orchestra.run.smithi157.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-09-16T05:27:47.523 INFO:teuthology.orchestra.run.smithi086.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-webob all 1:1.8.6-1.1ubuntu0.1 [86.7 kB] 2024-09-16T05:27:47.525 INFO:teuthology.orchestra.run.smithi086.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-09-16T05:27:47.527 INFO:teuthology.orchestra.run.smithi086.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-09-16T05:27:47.527 INFO:teuthology.orchestra.run.smithi086.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-09-16T05:27:47.538 INFO:teuthology.orchestra.run.smithi086.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-09-16T05:27:47.565 INFO:teuthology.orchestra.run.smithi157.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-09-16T05:27:47.565 INFO:teuthology.orchestra.run.smithi157.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-09-16T05:27:47.566 INFO:teuthology.orchestra.run.smithi157.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-webob all 1:1.8.6-1.1ubuntu0.1 [86.7 kB] 2024-09-16T05:27:47.604 INFO:teuthology.orchestra.run.smithi086.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-09-16T05:27:47.605 INFO:teuthology.orchestra.run.smithi086.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-09-16T05:27:47.606 INFO:teuthology.orchestra.run.smithi086.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-09-16T05:27:47.609 INFO:teuthology.orchestra.run.smithi086.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-09-16T05:27:47.613 INFO:teuthology.orchestra.run.smithi086.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-idna all 3.3-1ubuntu0.1 [52.1 kB] 2024-09-16T05:27:47.646 INFO:teuthology.orchestra.run.smithi157.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-09-16T05:27:47.648 INFO:teuthology.orchestra.run.smithi157.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-09-16T05:27:47.648 INFO:teuthology.orchestra.run.smithi157.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-09-16T05:27:47.659 INFO:teuthology.orchestra.run.smithi157.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-09-16T05:27:47.660 INFO:teuthology.orchestra.run.smithi157.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-09-16T05:27:47.661 INFO:teuthology.orchestra.run.smithi157.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-09-16T05:27:47.662 INFO:teuthology.orchestra.run.smithi157.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-09-16T05:27:47.686 INFO:teuthology.orchestra.run.smithi086.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-09-16T05:27:47.689 INFO:teuthology.orchestra.run.smithi086.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-09-16T05:27:47.690 INFO:teuthology.orchestra.run.smithi086.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.2 [181 kB] 2024-09-16T05:27:47.695 INFO:teuthology.orchestra.run.smithi086.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-09-16T05:27:47.696 INFO:teuthology.orchestra.run.smithi086.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-09-16T05:27:47.728 INFO:teuthology.orchestra.run.smithi157.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-09-16T05:27:47.731 INFO:teuthology.orchestra.run.smithi157.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-idna all 3.3-1ubuntu0.1 [52.1 kB] 2024-09-16T05:27:47.733 INFO:teuthology.orchestra.run.smithi157.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-09-16T05:27:47.768 INFO:teuthology.orchestra.run.smithi086.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-09-16T05:27:47.772 INFO:teuthology.orchestra.run.smithi086.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-09-16T05:27:47.810 INFO:teuthology.orchestra.run.smithi157.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-09-16T05:27:47.811 INFO:teuthology.orchestra.run.smithi157.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.2 [181 kB] 2024-09-16T05:27:47.815 INFO:teuthology.orchestra.run.smithi157.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-09-16T05:27:47.817 INFO:teuthology.orchestra.run.smithi157.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-09-16T05:27:47.818 INFO:teuthology.orchestra.run.smithi157.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-09-16T05:27:47.823 INFO:teuthology.orchestra.run.smithi157.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-09-16T05:27:47.854 INFO:teuthology.orchestra.run.smithi047.stdout:Get:89 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.1.1-326-g8921c8ef-1jammy [3,241 kB] 2024-09-16T05:27:47.895 INFO:teuthology.orchestra.run.smithi157.stdout:Get:63 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.1.1-326-g8921c8ef-1jammy [5,145 kB] 2024-09-16T05:27:47.965 INFO:teuthology.orchestra.run.smithi086.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-09-16T05:27:47.984 INFO:teuthology.orchestra.run.smithi157.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-09-16T05:27:47.985 INFO:teuthology.orchestra.run.smithi157.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.2 [108 kB] 2024-09-16T05:27:47.988 INFO:teuthology.orchestra.run.smithi157.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-09-16T05:27:47.988 INFO:teuthology.orchestra.run.smithi157.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-09-16T05:27:47.990 INFO:teuthology.orchestra.run.smithi157.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-09-16T05:27:48.003 INFO:teuthology.orchestra.run.smithi157.stdout:Get:69 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.1.1-326-g8921c8ef-1jammy [245 kB] 2024-09-16T05:27:48.008 INFO:teuthology.orchestra.run.smithi157.stdout:Get:70 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.1.1-326-g8921c8ef-1jammy [124 kB] 2024-09-16T05:27:48.011 INFO:teuthology.orchestra.run.smithi157.stdout:Get:71 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.1.1-326-g8921c8ef-1jammy [1,555 kB] 2024-09-16T05:27:48.023 INFO:teuthology.orchestra.run.smithi157.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-09-16T05:27:48.033 INFO:teuthology.orchestra.run.smithi086.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.2 [108 kB] 2024-09-16T05:27:48.034 INFO:teuthology.orchestra.run.smithi086.stdout:Get:65 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.1.1-326-g8921c8ef-1jammy [5,145 kB] 2024-09-16T05:27:48.036 INFO:teuthology.orchestra.run.smithi086.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-09-16T05:27:48.036 INFO:teuthology.orchestra.run.smithi086.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-09-16T05:27:48.039 INFO:teuthology.orchestra.run.smithi086.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-09-16T05:27:48.057 INFO:teuthology.orchestra.run.smithi157.stdout:Get:73 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.1.1-326-g8921c8ef-1jammy [6,143 kB] 2024-09-16T05:27:48.059 INFO:teuthology.orchestra.run.smithi157.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-09-16T05:27:48.059 INFO:teuthology.orchestra.run.smithi157.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-09-16T05:27:48.084 INFO:teuthology.orchestra.run.smithi086.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-09-16T05:27:48.086 INFO:teuthology.orchestra.run.smithi157.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-09-16T05:27:48.087 INFO:teuthology.orchestra.run.smithi157.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-09-16T05:27:48.087 INFO:teuthology.orchestra.run.smithi086.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-09-16T05:27:48.088 INFO:teuthology.orchestra.run.smithi086.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-09-16T05:27:48.120 INFO:teuthology.orchestra.run.smithi086.stdout:Get:72 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.1.1-326-g8921c8ef-1jammy [245 kB] 2024-09-16T05:27:48.135 INFO:teuthology.orchestra.run.smithi086.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-09-16T05:27:48.135 INFO:teuthology.orchestra.run.smithi086.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-09-16T05:27:48.139 INFO:teuthology.orchestra.run.smithi086.stdout:Get:75 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.1.1-326-g8921c8ef-1jammy [124 kB] 2024-09-16T05:27:48.141 INFO:teuthology.orchestra.run.smithi086.stdout:Get:76 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.1.1-326-g8921c8ef-1jammy [1,555 kB] 2024-09-16T05:27:48.152 INFO:teuthology.orchestra.run.smithi157.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-09-16T05:27:48.153 INFO:teuthology.orchestra.run.smithi157.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-09-16T05:27:48.154 INFO:teuthology.orchestra.run.smithi157.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-09-16T05:27:48.155 INFO:teuthology.orchestra.run.smithi157.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-09-16T05:27:48.155 INFO:teuthology.orchestra.run.smithi157.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-09-16T05:27:48.156 INFO:teuthology.orchestra.run.smithi157.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-09-16T05:27:48.162 INFO:teuthology.orchestra.run.smithi157.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-09-16T05:27:48.197 INFO:teuthology.orchestra.run.smithi086.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-09-16T05:27:48.199 INFO:teuthology.orchestra.run.smithi086.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-09-16T05:27:48.199 INFO:teuthology.orchestra.run.smithi086.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-09-16T05:27:48.201 INFO:teuthology.orchestra.run.smithi086.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-09-16T05:27:48.201 INFO:teuthology.orchestra.run.smithi086.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-09-16T05:27:48.202 INFO:teuthology.orchestra.run.smithi086.stdout:Get:82 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.1.1-326-g8921c8ef-1jammy [6,143 kB] 2024-09-16T05:27:48.202 INFO:teuthology.orchestra.run.smithi086.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-09-16T05:27:48.210 INFO:teuthology.orchestra.run.smithi086.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-09-16T05:27:48.234 INFO:teuthology.orchestra.run.smithi157.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-09-16T05:27:48.237 INFO:teuthology.orchestra.run.smithi157.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-09-16T05:27:48.238 INFO:teuthology.orchestra.run.smithi157.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-09-16T05:27:48.254 INFO:teuthology.orchestra.run.smithi157.stdout:Get:88 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.1.1-326-g8921c8ef-1jammy [22.8 MB] 2024-09-16T05:27:48.279 INFO:teuthology.orchestra.run.smithi086.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-09-16T05:27:48.282 INFO:teuthology.orchestra.run.smithi086.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-09-16T05:27:48.284 INFO:teuthology.orchestra.run.smithi086.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-09-16T05:27:48.315 INFO:teuthology.orchestra.run.smithi157.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-09-16T05:27:48.322 INFO:teuthology.orchestra.run.smithi157.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-09-16T05:27:48.324 INFO:teuthology.orchestra.run.smithi157.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-09-16T05:27:48.326 INFO:teuthology.orchestra.run.smithi157.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.3 [474 kB] 2024-09-16T05:27:48.337 INFO:teuthology.orchestra.run.smithi157.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-09-16T05:27:48.338 INFO:teuthology.orchestra.run.smithi157.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-09-16T05:27:48.346 INFO:teuthology.orchestra.run.smithi157.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-09-16T05:27:48.350 INFO:teuthology.orchestra.run.smithi047.stdout:Get:90 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.1.1-326-g8921c8ef-1jammy [719 kB] 2024-09-16T05:27:48.360 INFO:teuthology.orchestra.run.smithi086.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-09-16T05:27:48.366 INFO:teuthology.orchestra.run.smithi086.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-09-16T05:27:48.369 INFO:teuthology.orchestra.run.smithi086.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-09-16T05:27:48.370 INFO:teuthology.orchestra.run.smithi086.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.3 [474 kB] 2024-09-16T05:27:48.381 INFO:teuthology.orchestra.run.smithi086.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-09-16T05:27:48.382 INFO:teuthology.orchestra.run.smithi086.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-09-16T05:27:48.390 INFO:teuthology.orchestra.run.smithi086.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-09-16T05:27:48.397 INFO:teuthology.orchestra.run.smithi157.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-09-16T05:27:48.398 INFO:teuthology.orchestra.run.smithi157.stdout:Get:97 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-09-16T05:27:48.399 INFO:teuthology.orchestra.run.smithi157.stdout:Get:98 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-09-16T05:27:48.430 INFO:teuthology.orchestra.run.smithi086.stdout:Get:95 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.1.1-326-g8921c8ef-1jammy [22.8 MB] 2024-09-16T05:27:48.442 INFO:teuthology.orchestra.run.smithi086.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-09-16T05:27:48.443 INFO:teuthology.orchestra.run.smithi086.stdout:Get:97 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-09-16T05:27:48.444 INFO:teuthology.orchestra.run.smithi086.stdout:Get:98 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-09-16T05:27:48.475 INFO:teuthology.orchestra.run.smithi047.stdout:Get:91 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.1.1-326-g8921c8ef-1jammy [356 kB] 2024-09-16T05:27:48.478 INFO:teuthology.orchestra.run.smithi157.stdout:Get:99 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-09-16T05:27:48.480 INFO:teuthology.orchestra.run.smithi157.stdout:Get:100 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-09-16T05:27:48.497 INFO:teuthology.orchestra.run.smithi157.stdout:Get:101 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-09-16T05:27:48.498 INFO:teuthology.orchestra.run.smithi157.stdout:Get:102 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-09-16T05:27:48.499 INFO:teuthology.orchestra.run.smithi157.stdout:Get:103 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-09-16T05:27:48.504 INFO:teuthology.orchestra.run.smithi157.stdout:Get:104 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-09-16T05:27:48.506 INFO:teuthology.orchestra.run.smithi157.stdout:Get:105 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-09-16T05:27:48.523 INFO:teuthology.orchestra.run.smithi086.stdout:Get:99 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-09-16T05:27:48.525 INFO:teuthology.orchestra.run.smithi086.stdout:Get:100 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-09-16T05:27:48.538 INFO:teuthology.orchestra.run.smithi047.stdout:Get:92 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.1.1-326-g8921c8ef-1jammy [32.8 kB] 2024-09-16T05:27:48.540 INFO:teuthology.orchestra.run.smithi047.stdout:Get:93 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.1.1-326-g8921c8ef-1jammy [180 kB] 2024-09-16T05:27:48.542 INFO:teuthology.orchestra.run.smithi086.stdout:Get:101 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-09-16T05:27:48.543 INFO:teuthology.orchestra.run.smithi086.stdout:Get:102 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-09-16T05:27:48.543 INFO:teuthology.orchestra.run.smithi086.stdout:Get:103 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-09-16T05:27:48.544 INFO:teuthology.orchestra.run.smithi047.stdout:Get:94 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.1.1-326-g8921c8ef-1jammy [67.8 kB] 2024-09-16T05:27:48.546 INFO:teuthology.orchestra.run.smithi047.stdout:Get:95 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.1.1-326-g8921c8ef-1jammy [333 kB] 2024-09-16T05:27:48.549 INFO:teuthology.orchestra.run.smithi086.stdout:Get:104 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-09-16T05:27:48.552 INFO:teuthology.orchestra.run.smithi086.stdout:Get:105 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-09-16T05:27:48.607 INFO:teuthology.orchestra.run.smithi047.stdout:Get:96 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.1.1-326-g8921c8ef-1jammy [6,875 kB] 2024-09-16T05:27:49.185 INFO:teuthology.orchestra.run.smithi157.stdout:Get:106 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.1.1-326-g8921c8ef-1jammy [14.1 kB] 2024-09-16T05:27:49.186 INFO:teuthology.orchestra.run.smithi157.stdout:Get:107 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.1.1-326-g8921c8ef-1jammy [877 kB] 2024-09-16T05:27:49.204 INFO:teuthology.orchestra.run.smithi157.stdout:Get:108 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.1.1-326-g8921c8ef-1jammy [2,462 kB] 2024-09-16T05:27:49.243 INFO:teuthology.orchestra.run.smithi157.stdout:Get:109 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.1.1-326-g8921c8ef-1jammy [794 kB] 2024-09-16T05:27:49.273 INFO:teuthology.orchestra.run.smithi157.stdout:Get:110 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.1.1-326-g8921c8ef-1jammy [152 kB] 2024-09-16T05:27:49.276 INFO:teuthology.orchestra.run.smithi157.stdout:Get:111 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.1.1-326-g8921c8ef-1jammy [2,275 kB] 2024-09-16T05:27:49.359 INFO:teuthology.orchestra.run.smithi157.stdout:Get:112 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.1.1-326-g8921c8ef-1jammy [8,625 kB] 2024-09-16T05:27:49.372 INFO:teuthology.orchestra.run.smithi086.stdout:Get:106 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.1.1-326-g8921c8ef-1jammy [14.1 kB] 2024-09-16T05:27:49.372 INFO:teuthology.orchestra.run.smithi086.stdout:Get:107 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.1.1-326-g8921c8ef-1jammy [877 kB] 2024-09-16T05:27:49.389 INFO:teuthology.orchestra.run.smithi086.stdout:Get:108 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.1.1-326-g8921c8ef-1jammy [2,462 kB] 2024-09-16T05:27:49.392 INFO:teuthology.orchestra.run.smithi047.stdout:Get:97 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.1.1-326-g8921c8ef-1jammy [112 kB] 2024-09-16T05:27:49.395 INFO:teuthology.orchestra.run.smithi047.stdout:Get:98 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.1.1-326-g8921c8ef-1jammy [472 kB] 2024-09-16T05:27:49.405 INFO:teuthology.orchestra.run.smithi047.stdout:Get:99 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.1.1-326-g8921c8ef-1jammy [25.9 MB] 2024-09-16T05:27:49.436 INFO:teuthology.orchestra.run.smithi086.stdout:Get:109 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.1.1-326-g8921c8ef-1jammy [794 kB] 2024-09-16T05:27:49.473 INFO:teuthology.orchestra.run.smithi086.stdout:Get:110 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.1.1-326-g8921c8ef-1jammy [152 kB] 2024-09-16T05:27:49.477 INFO:teuthology.orchestra.run.smithi086.stdout:Get:111 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.1.1-326-g8921c8ef-1jammy [2,275 kB] 2024-09-16T05:27:49.580 INFO:teuthology.orchestra.run.smithi086.stdout:Get:112 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.1.1-326-g8921c8ef-1jammy [8,625 kB] 2024-09-16T05:27:49.763 INFO:teuthology.orchestra.run.smithi157.stdout:Get:113 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.1.1-326-g8921c8ef-1jammy [14.2 kB] 2024-09-16T05:27:49.763 INFO:teuthology.orchestra.run.smithi157.stdout:Get:114 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.1.1-326-g8921c8ef-1jammy [51.4 MB] 2024-09-16T05:27:49.957 INFO:teuthology.orchestra.run.smithi086.stdout:Get:113 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.1.1-326-g8921c8ef-1jammy [14.2 kB] 2024-09-16T05:27:49.958 INFO:teuthology.orchestra.run.smithi086.stdout:Get:114 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.1.1-326-g8921c8ef-1jammy [51.4 MB] 2024-09-16T05:27:50.863 INFO:teuthology.orchestra.run.smithi047.stdout:Get:100 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.1.1-326-g8921c8ef-1jammy [5,145 kB] 2024-09-16T05:27:51.022 INFO:teuthology.orchestra.run.smithi047.stdout:Get:101 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.1.1-326-g8921c8ef-1jammy [245 kB] 2024-09-16T05:27:51.027 INFO:teuthology.orchestra.run.smithi047.stdout:Get:102 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.1.1-326-g8921c8ef-1jammy [124 kB] 2024-09-16T05:27:51.031 INFO:teuthology.orchestra.run.smithi047.stdout:Get:103 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.1.1-326-g8921c8ef-1jammy [1,555 kB] 2024-09-16T05:27:51.095 INFO:teuthology.orchestra.run.smithi047.stdout:Get:104 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.1.1-326-g8921c8ef-1jammy [6,143 kB] 2024-09-16T05:27:51.366 INFO:teuthology.orchestra.run.smithi047.stdout:Get:105 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.1.1-326-g8921c8ef-1jammy [22.8 MB] 2024-09-16T05:27:52.451 INFO:teuthology.orchestra.run.smithi047.stdout:Get:106 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.1.1-326-g8921c8ef-1jammy [14.1 kB] 2024-09-16T05:27:52.452 INFO:teuthology.orchestra.run.smithi047.stdout:Get:107 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.1.1-326-g8921c8ef-1jammy [877 kB] 2024-09-16T05:27:52.469 INFO:teuthology.orchestra.run.smithi047.stdout:Get:108 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.1.1-326-g8921c8ef-1jammy [2,462 kB] 2024-09-16T05:27:52.513 INFO:teuthology.orchestra.run.smithi047.stdout:Get:109 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.1.1-326-g8921c8ef-1jammy [794 kB] 2024-09-16T05:27:52.526 INFO:teuthology.orchestra.run.smithi047.stdout:Get:110 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.1.1-326-g8921c8ef-1jammy [152 kB] 2024-09-16T05:27:52.529 INFO:teuthology.orchestra.run.smithi047.stdout:Get:111 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.1.1-326-g8921c8ef-1jammy [2,275 kB] 2024-09-16T05:27:52.541 INFO:teuthology.orchestra.run.smithi086.stdout:Get:115 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.1.1-326-g8921c8ef-1jammy [130 kB] 2024-09-16T05:27:52.543 INFO:teuthology.orchestra.run.smithi086.stdout:Get:116 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.1.1-326-g8921c8ef-1jammy [39.0 kB] 2024-09-16T05:27:52.545 INFO:teuthology.orchestra.run.smithi086.stdout:Get:117 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.1.1-326-g8921c8ef-1jammy [13.6 MB] 2024-09-16T05:27:52.588 INFO:teuthology.orchestra.run.smithi047.stdout:Get:112 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.1.1-326-g8921c8ef-1jammy [8,625 kB] 2024-09-16T05:27:52.938 INFO:teuthology.orchestra.run.smithi157.stdout:Get:115 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.1.1-326-g8921c8ef-1jammy [130 kB] 2024-09-16T05:27:52.938 INFO:teuthology.orchestra.run.smithi047.stdout:Get:113 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.1.1-326-g8921c8ef-1jammy [14.2 kB] 2024-09-16T05:27:52.939 INFO:teuthology.orchestra.run.smithi047.stdout:Get:114 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.1.1-326-g8921c8ef-1jammy [51.4 MB] 2024-09-16T05:27:52.941 INFO:teuthology.orchestra.run.smithi157.stdout:Get:116 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.1.1-326-g8921c8ef-1jammy [39.0 kB] 2024-09-16T05:27:52.942 INFO:teuthology.orchestra.run.smithi157.stdout:Get:117 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.1.1-326-g8921c8ef-1jammy [13.6 MB] 2024-09-16T05:27:52.995 INFO:teuthology.orchestra.run.smithi086.stdout:Get:118 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.1.1-326-g8921c8ef-1jammy [91.5 kB] 2024-09-16T05:27:53.417 INFO:teuthology.orchestra.run.smithi157.stdout:Get:118 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.1.1-326-g8921c8ef-1jammy [91.5 kB] 2024-09-16T05:27:53.568 INFO:teuthology.orchestra.run.smithi086.stdout:Fetched 181 MB in 7s (26.6 MB/s) 2024-09-16T05:27:53.731 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-09-16T05:27:53.830 INFO:teuthology.orchestra.run.smithi086.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165990 files and directories currently installed.) 2024-09-16T05:27:53.836 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../000-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-09-16T05:27:53.913 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-16T05:27:53.994 INFO:teuthology.orchestra.run.smithi157.stdout:Fetched 181 MB in 7s (25.2 MB/s) 2024-09-16T05:27:54.155 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-09-16T05:27:54.210 INFO:teuthology.orchestra.run.smithi047.stdout:Get:115 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.1.1-326-g8921c8ef-1jammy [130 kB] 2024-09-16T05:27:54.213 INFO:teuthology.orchestra.run.smithi047.stdout:Get:116 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.1.1-326-g8921c8ef-1jammy [39.0 kB] 2024-09-16T05:27:54.214 INFO:teuthology.orchestra.run.smithi047.stdout:Get:117 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.1.1-326-g8921c8ef-1jammy [13.6 MB] 2024-09-16T05:27:54.249 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-09-16T05:27:54.254 INFO:teuthology.orchestra.run.smithi157.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165990 files and directories currently installed.) 2024-09-16T05:27:54.260 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../000-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-09-16T05:27:54.275 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-09-16T05:27:54.316 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-16T05:27:54.345 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-16T05:27:54.401 INFO:teuthology.orchestra.run.smithi047.stdout:Get:118 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.1.1-326-g8921c8ef-1jammy [91.5 kB] 2024-09-16T05:27:54.652 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-09-16T05:27:54.678 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../002-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-09-16T05:27:54.707 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-09-16T05:27:54.718 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-16T05:27:54.733 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-09-16T05:27:54.773 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-16T05:27:54.973 INFO:teuthology.orchestra.run.smithi047.stdout:Fetched 181 MB in 8s (22.6 MB/s) 2024-09-16T05:27:55.085 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-09-16T05:27:55.097 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-09-16T05:27:55.111 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../002-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-09-16T05:27:55.124 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../003-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-16T05:27:55.143 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-16T05:27:55.147 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-09-16T05:27:55.163 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-16T05:27:55.250 INFO:teuthology.orchestra.run.smithi047.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165990 files and directories currently installed.) 2024-09-16T05:27:55.256 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../000-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-09-16T05:27:55.337 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-16T05:27:55.525 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-09-16T05:27:55.551 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../004-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-16T05:27:55.571 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-09-16T05:27:55.598 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../003-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-16T05:27:55.599 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-16T05:27:55.646 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-16T05:27:55.649 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-09-16T05:27:55.676 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-09-16T05:27:55.716 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-16T05:27:55.936 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-09-16T05:27:55.962 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../005-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-16T05:27:55.994 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-09-16T05:27:56.002 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-16T05:27:56.020 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../002-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-09-16T05:27:56.049 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-09-16T05:27:56.060 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-16T05:27:56.076 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../004-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-16T05:27:56.116 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-16T05:27:56.355 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-09-16T05:27:56.382 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../006-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-09-16T05:27:56.419 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-09-16T05:27:56.430 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-16T05:27:56.446 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../005-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-16T05:27:56.477 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-16T05:27:56.522 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-09-16T05:27:56.549 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../003-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-16T05:27:56.597 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-16T05:27:56.733 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package librados2. 2024-09-16T05:27:56.759 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../007-librados2_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-16T05:27:56.808 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking librados2 (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T05:27:56.831 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-09-16T05:27:56.854 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../006-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-09-16T05:27:56.897 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-16T05:27:57.000 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-09-16T05:27:57.027 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../004-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-16T05:27:57.066 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-16T05:27:57.192 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package librados2. 2024-09-16T05:27:57.218 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../007-librados2_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-16T05:27:57.235 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package librbd1. 2024-09-16T05:27:57.250 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking librados2 (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T05:27:57.261 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../008-librbd1_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-16T05:27:57.302 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking librbd1 (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T05:27:57.553 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-09-16T05:27:57.581 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../005-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-16T05:27:57.686 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package librbd1. 2024-09-16T05:27:57.703 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-16T05:27:57.713 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../008-librbd1_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-16T05:27:57.753 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking librbd1 (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T05:27:57.780 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package libcephfs2. 2024-09-16T05:27:57.805 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../009-libcephfs2_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-16T05:27:57.846 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking libcephfs2 (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T05:27:58.132 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-rados. 2024-09-16T05:27:58.158 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../010-python3-rados_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-16T05:27:58.173 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-09-16T05:27:58.197 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package libcephfs2. 2024-09-16T05:27:58.198 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-rados (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T05:27:58.199 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../006-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-09-16T05:27:58.223 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../009-libcephfs2_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-16T05:27:58.239 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-16T05:27:58.264 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking libcephfs2 (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T05:27:58.558 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-rados. 2024-09-16T05:27:58.559 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package librados2. 2024-09-16T05:27:58.585 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../010-python3-rados_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-16T05:27:58.585 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../007-librados2_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-16T05:27:58.624 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-rados (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T05:27:58.625 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking librados2 (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T05:27:58.685 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-09-16T05:27:58.711 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../011-python3-ceph-argparse_19.1.1-326-g8921c8ef-1jammy_all.deb ... 2024-09-16T05:27:58.743 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-ceph-argparse (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T05:27:58.919 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-09-16T05:27:58.946 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../011-python3-ceph-argparse_19.1.1-326-g8921c8ef-1jammy_all.deb ... 2024-09-16T05:27:58.970 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-cephfs. 2024-09-16T05:27:58.985 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../012-python3-cephfs_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-16T05:27:58.986 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-ceph-argparse (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T05:27:59.028 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-cephfs (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T05:27:59.036 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package librbd1. 2024-09-16T05:27:59.063 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../008-librbd1_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-16T05:27:59.094 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking librbd1 (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T05:27:59.238 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-cephfs. 2024-09-16T05:27:59.253 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../012-python3-cephfs_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-16T05:27:59.296 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-cephfs (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T05:27:59.339 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-ceph-common. 2024-09-16T05:27:59.365 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../013-python3-ceph-common_19.1.1-326-g8921c8ef-1jammy_all.deb ... 2024-09-16T05:27:59.405 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-ceph-common (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T05:27:59.530 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package libcephfs2. 2024-09-16T05:27:59.557 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../009-libcephfs2_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-16T05:27:59.605 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking libcephfs2 (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T05:27:59.607 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-ceph-common. 2024-09-16T05:27:59.634 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../013-python3-ceph-common_19.1.1-326-g8921c8ef-1jammy_all.deb ... 2024-09-16T05:27:59.674 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-ceph-common (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T05:27:59.750 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-wcwidth. 2024-09-16T05:27:59.776 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../014-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-09-16T05:27:59.817 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-16T05:27:59.891 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-rados. 2024-09-16T05:27:59.918 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../010-python3-rados_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-16T05:27:59.958 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-rados (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T05:28:00.011 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-wcwidth. 2024-09-16T05:28:00.037 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../014-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-09-16T05:28:00.077 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-16T05:28:00.111 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-prettytable. 2024-09-16T05:28:00.138 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../015-python3-prettytable_2.5.0-2_all.deb ... 2024-09-16T05:28:00.169 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-09-16T05:28:00.286 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-09-16T05:28:00.313 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../011-python3-ceph-argparse_19.1.1-326-g8921c8ef-1jammy_all.deb ... 2024-09-16T05:28:00.352 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-ceph-argparse (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T05:28:00.388 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-prettytable. 2024-09-16T05:28:00.413 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-rbd. 2024-09-16T05:28:00.414 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../015-python3-prettytable_2.5.0-2_all.deb ... 2024-09-16T05:28:00.440 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../016-python3-rbd_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-16T05:28:00.455 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-09-16T05:28:00.480 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-rbd (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T05:28:00.604 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-cephfs. 2024-09-16T05:28:00.621 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../012-python3-cephfs_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-16T05:28:00.663 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-cephfs (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T05:28:00.665 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-rbd. 2024-09-16T05:28:00.681 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../016-python3-rbd_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-16T05:28:00.715 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-rbd (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T05:28:00.824 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-09-16T05:28:00.851 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../017-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-09-16T05:28:00.891 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-16T05:28:00.974 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-ceph-common. 2024-09-16T05:28:01.001 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../013-python3-ceph-common_19.1.1-326-g8921c8ef-1jammy_all.deb ... 2024-09-16T05:28:01.040 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-ceph-common (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T05:28:01.052 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-09-16T05:28:01.078 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../017-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-09-16T05:28:01.119 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-16T05:28:01.169 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-09-16T05:28:01.195 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../018-libreadline-dev_8.1.2-1_amd64.deb ... 2024-09-16T05:28:01.235 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-09-16T05:28:01.377 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-wcwidth. 2024-09-16T05:28:01.388 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-09-16T05:28:01.403 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../018-libreadline-dev_8.1.2-1_amd64.deb ... 2024-09-16T05:28:01.404 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../014-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-09-16T05:28:01.443 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-16T05:28:01.446 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-09-16T05:28:01.521 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-09-16T05:28:01.547 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../019-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-09-16T05:28:01.587 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-16T05:28:01.696 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-prettytable. 2024-09-16T05:28:01.712 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../015-python3-prettytable_2.5.0-2_all.deb ... 2024-09-16T05:28:01.746 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-09-16T05:28:01.749 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-09-16T05:28:01.775 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../019-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-09-16T05:28:01.815 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-16T05:28:01.899 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package lua5.1. 2024-09-16T05:28:01.925 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../020-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-09-16T05:28:01.965 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-09-16T05:28:02.023 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-rbd. 2024-09-16T05:28:02.039 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../016-python3-rbd_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-16T05:28:02.082 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-rbd (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T05:28:02.112 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package lua5.1. 2024-09-16T05:28:02.128 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../020-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-09-16T05:28:02.171 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-09-16T05:28:02.277 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package lua-any. 2024-09-16T05:28:02.303 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../021-lua-any_27ubuntu1_all.deb ... 2024-09-16T05:28:02.344 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking lua-any (27ubuntu1) ... 2024-09-16T05:28:02.426 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-09-16T05:28:02.453 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../017-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-09-16T05:28:02.507 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package lua-any. 2024-09-16T05:28:02.519 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-16T05:28:02.533 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../021-lua-any_27ubuntu1_all.deb ... 2024-09-16T05:28:02.571 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package zip. 2024-09-16T05:28:02.573 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking lua-any (27ubuntu1) ... 2024-09-16T05:28:02.586 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../022-zip_3.0-12build2_amd64.deb ... 2024-09-16T05:28:02.629 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking zip (3.0-12build2) ... 2024-09-16T05:28:02.795 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-09-16T05:28:02.811 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../018-libreadline-dev_8.1.2-1_amd64.deb ... 2024-09-16T05:28:02.818 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package zip. 2024-09-16T05:28:02.833 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../022-zip_3.0-12build2_amd64.deb ... 2024-09-16T05:28:02.845 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-09-16T05:28:02.876 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking zip (3.0-12build2) ... 2024-09-16T05:28:02.890 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package unzip. 2024-09-16T05:28:02.905 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../023-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-09-16T05:28:02.940 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-09-16T05:28:03.115 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-09-16T05:28:03.131 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../019-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-09-16T05:28:03.165 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-16T05:28:03.188 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package unzip. 2024-09-16T05:28:03.214 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../023-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-09-16T05:28:03.254 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-09-16T05:28:03.327 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package luarocks. 2024-09-16T05:28:03.354 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../024-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-09-16T05:28:03.394 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-09-16T05:28:03.593 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package lua5.1. 2024-09-16T05:28:03.620 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../020-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-09-16T05:28:03.634 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package luarocks. 2024-09-16T05:28:03.659 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-09-16T05:28:03.660 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../024-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-09-16T05:28:03.908 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-09-16T05:28:03.962 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package lua-any. 2024-09-16T05:28:03.978 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../021-lua-any_27ubuntu1_all.deb ... 2024-09-16T05:28:04.021 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking lua-any (27ubuntu1) ... 2024-09-16T05:28:04.152 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package librgw2. 2024-09-16T05:28:04.178 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../025-librgw2_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-16T05:28:04.218 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking librgw2 (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T05:28:04.282 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package zip. 2024-09-16T05:28:04.282 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package librgw2. 2024-09-16T05:28:04.298 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../022-zip_3.0-12build2_amd64.deb ... 2024-09-16T05:28:04.309 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../025-librgw2_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-16T05:28:04.340 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking zip (3.0-12build2) ... 2024-09-16T05:28:04.349 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking librgw2 (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T05:28:04.660 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package unzip. 2024-09-16T05:28:04.686 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../023-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-09-16T05:28:04.726 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-09-16T05:28:04.745 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-rgw. 2024-09-16T05:28:04.760 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../026-python3-rgw_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-16T05:28:04.803 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-rgw (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T05:28:04.910 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-rgw. 2024-09-16T05:28:04.925 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../026-python3-rgw_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-16T05:28:04.968 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-rgw (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T05:28:05.081 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package liboath0:amd64. 2024-09-16T05:28:05.108 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../027-liboath0_2.6.7-3build1_amd64.deb ... 2024-09-16T05:28:05.122 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package luarocks. 2024-09-16T05:28:05.139 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-09-16T05:28:05.148 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../024-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-09-16T05:28:05.188 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-09-16T05:28:05.280 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package liboath0:amd64. 2024-09-16T05:28:05.306 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../027-liboath0_2.6.7-3build1_amd64.deb ... 2024-09-16T05:28:05.346 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-09-16T05:28:05.442 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package libradosstriper1. 2024-09-16T05:28:05.469 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../028-libradosstriper1_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-16T05:28:05.509 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking libradosstriper1 (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T05:28:05.546 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package librgw2. 2024-09-16T05:28:05.573 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../025-librgw2_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-16T05:28:05.604 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking librgw2 (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T05:28:05.649 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package libradosstriper1. 2024-09-16T05:28:05.675 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../028-libradosstriper1_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-16T05:28:05.715 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking libradosstriper1 (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T05:28:05.948 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package ceph-common. 2024-09-16T05:28:05.972 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../029-ceph-common_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-16T05:28:06.012 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking ceph-common (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T05:28:06.135 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package ceph-common. 2024-09-16T05:28:06.162 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../029-ceph-common_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-16T05:28:06.189 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-rgw. 2024-09-16T05:28:06.216 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../026-python3-rgw_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-16T05:28:06.227 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking ceph-common (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T05:28:06.264 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-rgw (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T05:28:06.559 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package liboath0:amd64. 2024-09-16T05:28:06.586 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../027-liboath0_2.6.7-3build1_amd64.deb ... 2024-09-16T05:28:06.626 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-09-16T05:28:06.962 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package libradosstriper1. 2024-09-16T05:28:06.989 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../028-libradosstriper1_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-16T05:28:07.028 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking libradosstriper1 (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T05:28:07.350 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package ceph-base. 2024-09-16T05:28:07.376 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../030-ceph-base_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-16T05:28:07.426 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking ceph-base (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T05:28:07.456 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package ceph-common. 2024-09-16T05:28:07.483 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../029-ceph-common_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-16T05:28:07.523 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking ceph-common (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T05:28:07.541 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package ceph-base. 2024-09-16T05:28:07.567 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../030-ceph-base_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-16T05:28:07.608 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking ceph-base (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T05:28:07.988 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-09-16T05:28:08.014 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../031-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-09-16T05:28:08.054 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-09-16T05:28:08.178 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-09-16T05:28:08.205 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../031-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-09-16T05:28:08.245 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-09-16T05:28:08.340 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-cheroot. 2024-09-16T05:28:08.366 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../032-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-09-16T05:28:08.406 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-16T05:28:08.548 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-cheroot. 2024-09-16T05:28:08.574 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../032-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-09-16T05:28:08.614 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-16T05:28:08.734 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-09-16T05:28:08.762 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../033-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-09-16T05:28:08.801 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-09-16T05:28:08.920 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package ceph-base. 2024-09-16T05:28:08.942 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-09-16T05:28:08.947 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../030-ceph-base_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-16T05:28:08.969 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../033-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-09-16T05:28:08.996 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking ceph-base (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T05:28:09.008 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-09-16T05:28:09.104 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-jaraco.text. 2024-09-16T05:28:09.130 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../034-python3-jaraco.text_3.6.0-2_all.deb ... 2024-09-16T05:28:09.173 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-09-16T05:28:09.278 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-jaraco.text. 2024-09-16T05:28:09.305 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../034-python3-jaraco.text_3.6.0-2_all.deb ... 2024-09-16T05:28:09.336 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-09-16T05:28:09.515 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-09-16T05:28:09.532 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../031-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-09-16T05:28:09.556 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-09-16T05:28:09.565 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-09-16T05:28:09.583 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../035-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-09-16T05:28:09.614 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-09-16T05:28:09.631 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-09-16T05:28:09.658 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../035-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-09-16T05:28:09.698 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-09-16T05:28:09.836 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-cheroot. 2024-09-16T05:28:09.862 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../032-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-09-16T05:28:09.900 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-tempora. 2024-09-16T05:28:09.901 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-16T05:28:09.927 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../036-python3-tempora_4.1.2-1_all.deb ... 2024-09-16T05:28:09.967 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-09-16T05:28:10.000 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-tempora. 2024-09-16T05:28:10.027 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../036-python3-tempora_4.1.2-1_all.deb ... 2024-09-16T05:28:10.067 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-09-16T05:28:10.238 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-09-16T05:28:10.264 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../033-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-09-16T05:28:10.270 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-portend. 2024-09-16T05:28:10.297 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../037-python3-portend_3.0.0-1_all.deb ... 2024-09-16T05:28:10.304 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-09-16T05:28:10.336 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-09-16T05:28:10.370 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-portend. 2024-09-16T05:28:10.396 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../037-python3-portend_3.0.0-1_all.deb ... 2024-09-16T05:28:10.436 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-09-16T05:28:10.615 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-jaraco.text. 2024-09-16T05:28:10.639 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-09-16T05:28:10.642 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../034-python3-jaraco.text_3.6.0-2_all.deb ... 2024-09-16T05:28:10.665 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../038-python3-zc.lockfile_2.0-1_all.deb ... 2024-09-16T05:28:10.682 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-09-16T05:28:10.705 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-09-16T05:28:10.706 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-09-16T05:28:10.732 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../038-python3-zc.lockfile_2.0-1_all.deb ... 2024-09-16T05:28:10.773 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-09-16T05:28:10.968 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-09-16T05:28:10.983 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-cherrypy3. 2024-09-16T05:28:10.984 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../035-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-09-16T05:28:11.010 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../039-python3-cherrypy3_18.6.1-4_all.deb ... 2024-09-16T05:28:11.018 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-09-16T05:28:11.049 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-09-16T05:28:11.059 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-cherrypy3. 2024-09-16T05:28:11.086 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../039-python3-cherrypy3_18.6.1-4_all.deb ... 2024-09-16T05:28:11.125 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-09-16T05:28:11.262 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-tempora. 2024-09-16T05:28:11.289 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../036-python3-tempora_4.1.2-1_all.deb ... 2024-09-16T05:28:11.329 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-09-16T05:28:11.411 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-natsort. 2024-09-16T05:28:11.438 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../040-python3-natsort_8.0.2-1_all.deb ... 2024-09-16T05:28:11.472 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-natsort. 2024-09-16T05:28:11.478 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-09-16T05:28:11.497 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../040-python3-natsort_8.0.2-1_all.deb ... 2024-09-16T05:28:11.545 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-09-16T05:28:11.631 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-portend. 2024-09-16T05:28:11.658 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../037-python3-portend_3.0.0-1_all.deb ... 2024-09-16T05:28:11.707 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-09-16T05:28:11.798 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-logutils. 2024-09-16T05:28:11.824 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../041-python3-logutils_0.3.3-8_all.deb ... 2024-09-16T05:28:11.864 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-09-16T05:28:11.865 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-logutils. 2024-09-16T05:28:11.892 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../041-python3-logutils_0.3.3-8_all.deb ... 2024-09-16T05:28:11.932 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-09-16T05:28:11.967 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-09-16T05:28:11.983 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../038-python3-zc.lockfile_2.0-1_all.deb ... 2024-09-16T05:28:12.017 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-09-16T05:28:12.125 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-markupsafe. 2024-09-16T05:28:12.151 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../042-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-09-16T05:28:12.191 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-09-16T05:28:12.235 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-markupsafe. 2024-09-16T05:28:12.261 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../042-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-09-16T05:28:12.301 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-09-16T05:28:12.303 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-cherrypy3. 2024-09-16T05:28:12.330 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../039-python3-cherrypy3_18.6.1-4_all.deb ... 2024-09-16T05:28:12.379 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-09-16T05:28:12.469 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-mako. 2024-09-16T05:28:12.497 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../043-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-09-16T05:28:12.536 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-16T05:28:12.579 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-mako. 2024-09-16T05:28:12.606 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../043-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-09-16T05:28:12.646 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-16T05:28:12.732 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-natsort. 2024-09-16T05:28:12.759 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../040-python3-natsort_8.0.2-1_all.deb ... 2024-09-16T05:28:12.801 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-09-16T05:28:12.864 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-simplegeneric. 2024-09-16T05:28:12.891 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../044-python3-simplegeneric_0.8.1-3_all.deb ... 2024-09-16T05:28:12.930 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-09-16T05:28:12.957 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-simplegeneric. 2024-09-16T05:28:12.984 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../044-python3-simplegeneric_0.8.1-3_all.deb ... 2024-09-16T05:28:13.024 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-09-16T05:28:13.216 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-singledispatch. 2024-09-16T05:28:13.243 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../045-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-09-16T05:28:13.252 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-logutils. 2024-09-16T05:28:13.279 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../041-python3-logutils_0.3.3-8_all.deb ... 2024-09-16T05:28:13.283 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-09-16T05:28:13.318 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-09-16T05:28:13.343 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-singledispatch. 2024-09-16T05:28:13.370 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../045-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-09-16T05:28:13.410 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-09-16T05:28:13.569 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-webob. 2024-09-16T05:28:13.587 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-markupsafe. 2024-09-16T05:28:13.595 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../046-python3-webob_1%3a1.8.6-1.1ubuntu0.1_all.deb ... 2024-09-16T05:28:13.615 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../042-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-09-16T05:28:13.635 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-16T05:28:13.646 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-09-16T05:28:13.726 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-webob. 2024-09-16T05:28:13.748 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../046-python3-webob_1%3a1.8.6-1.1ubuntu0.1_all.deb ... 2024-09-16T05:28:13.787 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-16T05:28:13.948 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-mako. 2024-09-16T05:28:13.955 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-waitress. 2024-09-16T05:28:13.975 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../043-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-09-16T05:28:13.982 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../047-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-09-16T05:28:14.016 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-16T05:28:14.023 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-16T05:28:14.157 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-waitress. 2024-09-16T05:28:14.184 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../047-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-09-16T05:28:14.227 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-16T05:28:14.282 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-tempita. 2024-09-16T05:28:14.298 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../048-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-09-16T05:28:14.360 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-simplegeneric. 2024-09-16T05:28:14.387 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../044-python3-simplegeneric_0.8.1-3_all.deb ... 2024-09-16T05:28:14.426 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-09-16T05:28:14.466 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-09-16T05:28:14.668 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-tempita. 2024-09-16T05:28:14.695 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../048-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-09-16T05:28:14.713 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-singledispatch. 2024-09-16T05:28:14.726 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-09-16T05:28:14.740 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../045-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-09-16T05:28:14.769 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-paste. 2024-09-16T05:28:14.779 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-09-16T05:28:14.796 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../049-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-09-16T05:28:14.835 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-09-16T05:28:15.023 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-webob. 2024-09-16T05:28:15.038 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-paste. 2024-09-16T05:28:15.044 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../046-python3-webob_1%3a1.8.6-1.1ubuntu0.1_all.deb ... 2024-09-16T05:28:15.065 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../049-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-09-16T05:28:15.073 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-16T05:28:15.104 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-09-16T05:28:15.121 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-09-16T05:28:15.137 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../050-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-09-16T05:28:15.172 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-09-16T05:28:15.391 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-09-16T05:28:15.407 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../050-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-09-16T05:28:15.418 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-waitress. 2024-09-16T05:28:15.441 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-09-16T05:28:15.445 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../047-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-09-16T05:28:15.466 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-pastedeploy. 2024-09-16T05:28:15.487 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-16T05:28:15.492 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../051-python3-pastedeploy_2.1.1-1_all.deb ... 2024-09-16T05:28:15.532 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-09-16T05:28:15.744 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-pastedeploy. 2024-09-16T05:28:15.771 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../051-python3-pastedeploy_2.1.1-1_all.deb ... 2024-09-16T05:28:15.779 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-tempita. 2024-09-16T05:28:15.806 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../048-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-09-16T05:28:15.810 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-09-16T05:28:15.835 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-webtest. 2024-09-16T05:28:15.837 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-09-16T05:28:15.862 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../052-python3-webtest_2.0.35-1_all.deb ... 2024-09-16T05:28:15.901 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-09-16T05:28:16.097 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-webtest. 2024-09-16T05:28:16.115 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-paste. 2024-09-16T05:28:16.123 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../052-python3-webtest_2.0.35-1_all.deb ... 2024-09-16T05:28:16.142 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../049-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-09-16T05:28:16.163 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-09-16T05:28:16.181 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-09-16T05:28:16.196 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-pecan. 2024-09-16T05:28:16.222 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../053-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-09-16T05:28:16.262 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-09-16T05:28:16.474 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-pecan. 2024-09-16T05:28:16.501 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../053-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-09-16T05:28:16.502 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-09-16T05:28:16.529 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../050-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-09-16T05:28:16.541 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-09-16T05:28:16.568 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-09-16T05:28:16.634 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-certifi. 2024-09-16T05:28:16.660 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../054-python3-certifi_2020.6.20-1_all.deb ... 2024-09-16T05:28:16.700 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-09-16T05:28:16.812 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-pastedeploy. 2024-09-16T05:28:16.828 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../051-python3-pastedeploy_2.1.1-1_all.deb ... 2024-09-16T05:28:16.879 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-09-16T05:28:16.912 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-certifi. 2024-09-16T05:28:16.939 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../054-python3-certifi_2020.6.20-1_all.deb ... 2024-09-16T05:28:16.979 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-09-16T05:28:16.997 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-idna. 2024-09-16T05:28:17.021 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../055-python3-idna_3.3-1ubuntu0.1_all.deb ... 2024-09-16T05:28:17.053 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-idna (3.3-1ubuntu0.1) ... 2024-09-16T05:28:17.181 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-webtest. 2024-09-16T05:28:17.202 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../052-python3-webtest_2.0.35-1_all.deb ... 2024-09-16T05:28:17.240 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-09-16T05:28:17.282 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-idna. 2024-09-16T05:28:17.308 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../055-python3-idna_3.3-1ubuntu0.1_all.deb ... 2024-09-16T05:28:17.348 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-idna (3.3-1ubuntu0.1) ... 2024-09-16T05:28:17.364 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-urllib3. 2024-09-16T05:28:17.390 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../056-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-09-16T05:28:17.430 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-16T05:28:17.543 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-pecan. 2024-09-16T05:28:17.570 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../053-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-09-16T05:28:17.609 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-09-16T05:28:17.660 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-urllib3. 2024-09-16T05:28:17.686 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../056-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-09-16T05:28:17.743 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-16T05:28:17.750 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-requests. 2024-09-16T05:28:17.776 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../057-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-09-16T05:28:17.816 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-16T05:28:17.972 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-certifi. 2024-09-16T05:28:18.000 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../054-python3-certifi_2020.6.20-1_all.deb ... 2024-09-16T05:28:18.039 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-09-16T05:28:18.063 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-requests. 2024-09-16T05:28:18.089 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../057-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-09-16T05:28:18.129 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-16T05:28:18.161 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-werkzeug. 2024-09-16T05:28:18.188 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../058-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.2_all.deb ... 2024-09-16T05:28:18.228 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-16T05:28:18.358 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-idna. 2024-09-16T05:28:18.375 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../055-python3-idna_3.3-1ubuntu0.1_all.deb ... 2024-09-16T05:28:18.408 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-idna (3.3-1ubuntu0.1) ... 2024-09-16T05:28:18.441 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-werkzeug. 2024-09-16T05:28:18.469 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../058-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.2_all.deb ... 2024-09-16T05:28:18.514 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-09-16T05:28:18.541 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../059-ceph-mgr-modules-core_19.1.1-326-g8921c8ef-1jammy_all.deb ... 2024-09-16T05:28:18.580 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking ceph-mgr-modules-core (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T05:28:18.703 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-urllib3. 2024-09-16T05:28:18.730 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../056-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-09-16T05:28:18.769 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-16T05:28:18.899 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-16T05:28:18.952 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-09-16T05:28:18.979 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../060-libsqlite3-mod-ceph_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-16T05:28:19.010 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking libsqlite3-mod-ceph (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T05:28:19.064 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-requests. 2024-09-16T05:28:19.091 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../057-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-09-16T05:28:19.130 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-16T05:28:19.304 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-bcrypt. 2024-09-16T05:28:19.331 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../061-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-09-16T05:28:19.371 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-09-16T05:28:19.569 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-09-16T05:28:19.596 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../059-ceph-mgr-modules-core_19.1.1-326-g8921c8ef-1jammy_all.deb ... 2024-09-16T05:28:19.635 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking ceph-mgr-modules-core (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T05:28:20.001 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-werkzeug. 2024-09-16T05:28:20.028 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../058-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.2_all.deb ... 2024-09-16T05:28:20.032 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-09-16T05:28:20.048 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../060-libsqlite3-mod-ceph_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-16T05:28:20.090 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking libsqlite3-mod-ceph (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T05:28:20.351 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-16T05:28:20.401 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-bcrypt. 2024-09-16T05:28:20.428 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../061-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-09-16T05:28:20.457 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-openssl. 2024-09-16T05:28:20.468 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-09-16T05:28:20.484 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../062-python3-openssl_21.0.0-1_all.deb ... 2024-09-16T05:28:20.524 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-09-16T05:28:20.679 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-09-16T05:28:20.706 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../059-ceph-mgr-modules-core_19.1.1-326-g8921c8ef-1jammy_all.deb ... 2024-09-16T05:28:20.745 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking ceph-mgr-modules-core (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T05:28:20.771 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-openssl. 2024-09-16T05:28:20.797 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../062-python3-openssl_21.0.0-1_all.deb ... 2024-09-16T05:28:20.837 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-09-16T05:28:20.860 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package ceph-mgr. 2024-09-16T05:28:20.887 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../063-ceph-mgr_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-16T05:28:20.927 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking ceph-mgr (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T05:28:21.100 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-09-16T05:28:21.128 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../060-libsqlite3-mod-ceph_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-16T05:28:21.140 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package ceph-mgr. 2024-09-16T05:28:21.158 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking libsqlite3-mod-ceph (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T05:28:21.167 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../063-ceph-mgr_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-16T05:28:21.207 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking ceph-mgr (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T05:28:21.254 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package ceph-mon. 2024-09-16T05:28:21.278 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../064-ceph-mon_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-16T05:28:21.313 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking ceph-mon (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T05:28:21.453 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-bcrypt. 2024-09-16T05:28:21.480 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../061-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-09-16T05:28:21.519 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-09-16T05:28:21.635 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package ceph-mon. 2024-09-16T05:28:21.661 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../064-ceph-mon_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-16T05:28:21.701 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking ceph-mon (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T05:28:21.822 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-openssl. 2024-09-16T05:28:21.849 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../062-python3-openssl_21.0.0-1_all.deb ... 2024-09-16T05:28:21.888 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-09-16T05:28:21.917 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package ceph-osd. 2024-09-16T05:28:21.943 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../065-ceph-osd_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-16T05:28:21.982 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking ceph-osd (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T05:28:22.241 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package ceph-mgr. 2024-09-16T05:28:22.269 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../063-ceph-mgr_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-16T05:28:22.308 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking ceph-mgr (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T05:28:22.313 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package ceph-osd. 2024-09-16T05:28:22.340 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../065-ceph-osd_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-16T05:28:22.380 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking ceph-osd (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T05:28:22.661 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package ceph-mon. 2024-09-16T05:28:22.688 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../064-ceph-mon_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-16T05:28:22.719 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking ceph-mon (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T05:28:23.044 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package ceph. 2024-09-16T05:28:23.071 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../066-ceph_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-16T05:28:23.110 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking ceph (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T05:28:23.331 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package ceph-osd. 2024-09-16T05:28:23.358 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../065-ceph-osd_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-16T05:28:23.397 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking ceph-osd (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T05:28:23.400 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package ceph. 2024-09-16T05:28:23.413 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package ceph-fuse. 2024-09-16T05:28:23.426 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../066-ceph_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-16T05:28:23.440 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../067-ceph-fuse_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-16T05:28:23.466 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking ceph (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T05:28:23.471 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking ceph-fuse (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T05:28:23.786 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package ceph-fuse. 2024-09-16T05:28:23.813 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../067-ceph-fuse_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-16T05:28:23.816 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package ceph-mds. 2024-09-16T05:28:23.843 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../068-ceph-mds_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-16T05:28:23.852 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking ceph-fuse (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T05:28:23.882 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking ceph-mds (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T05:28:24.222 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package ceph-mds. 2024-09-16T05:28:24.249 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../068-ceph-mds_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-16T05:28:24.260 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package cephadm. 2024-09-16T05:28:24.287 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../069-cephadm_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-16T05:28:24.288 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking ceph-mds (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T05:28:24.335 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking cephadm (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T05:28:24.467 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package ceph. 2024-09-16T05:28:24.483 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../066-ceph_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-16T05:28:24.525 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking ceph (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T05:28:24.811 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package ceph-fuse. 2024-09-16T05:28:24.821 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-asyncssh. 2024-09-16T05:28:24.839 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../067-ceph-fuse_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-16T05:28:24.848 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../070-python3-asyncssh_2.5.0-1_all.deb ... 2024-09-16T05:28:24.869 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking ceph-fuse (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T05:28:24.883 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package cephadm. 2024-09-16T05:28:24.887 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-09-16T05:28:24.899 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../069-cephadm_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-16T05:28:24.933 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking cephadm (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T05:28:25.223 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package ceph-mds. 2024-09-16T05:28:25.231 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python-babel-localedata. 2024-09-16T05:28:25.244 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-asyncssh. 2024-09-16T05:28:25.247 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../071-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-09-16T05:28:25.250 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../068-ceph-mds_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-16T05:28:25.271 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../070-python3-asyncssh_2.5.0-1_all.deb ... 2024-09-16T05:28:25.289 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-16T05:28:25.306 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking ceph-mds (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T05:28:25.310 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-09-16T05:28:25.639 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python-babel-localedata. 2024-09-16T05:28:25.666 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../071-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-09-16T05:28:25.705 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-16T05:28:25.717 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package cephadm. 2024-09-16T05:28:25.744 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../069-cephadm_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-16T05:28:25.783 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking cephadm (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T05:28:26.103 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-asyncssh. 2024-09-16T05:28:26.130 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../070-python3-asyncssh_2.5.0-1_all.deb ... 2024-09-16T05:28:26.186 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-09-16T05:28:26.345 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-babel. 2024-09-16T05:28:26.372 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../072-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-09-16T05:28:26.412 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-09-16T05:28:26.497 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python-babel-localedata. 2024-09-16T05:28:26.525 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../071-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-09-16T05:28:26.563 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-16T05:28:26.677 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-babel. 2024-09-16T05:28:26.704 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../072-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-09-16T05:28:26.714 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-jinja2. 2024-09-16T05:28:26.741 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../073-python3-jinja2_3.0.3-1ubuntu0.2_all.deb ... 2024-09-16T05:28:26.743 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-09-16T05:28:26.780 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-16T05:28:27.046 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-jinja2. 2024-09-16T05:28:27.073 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../073-python3-jinja2_3.0.3-1ubuntu0.2_all.deb ... 2024-09-16T05:28:27.083 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-09-16T05:28:27.110 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../074-ceph-mgr-cephadm_19.1.1-326-g8921c8ef-1jammy_all.deb ... 2024-09-16T05:28:27.112 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-16T05:28:27.149 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking ceph-mgr-cephadm (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T05:28:27.454 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-repoze.lru. 2024-09-16T05:28:27.466 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-09-16T05:28:27.471 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../075-python3-repoze.lru_0.7-2_all.deb ... 2024-09-16T05:28:27.493 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../074-ceph-mgr-cephadm_19.1.1-326-g8921c8ef-1jammy_all.deb ... 2024-09-16T05:28:27.504 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-09-16T05:28:27.532 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking ceph-mgr-cephadm (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T05:28:27.610 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-babel. 2024-09-16T05:28:27.638 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../072-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-09-16T05:28:27.668 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-09-16T05:28:27.790 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-routes. 2024-09-16T05:28:27.817 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../076-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-09-16T05:28:27.857 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-09-16T05:28:27.877 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-repoze.lru. 2024-09-16T05:28:27.904 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../075-python3-repoze.lru_0.7-2_all.deb ... 2024-09-16T05:28:27.943 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-09-16T05:28:27.963 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-jinja2. 2024-09-16T05:28:27.990 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../073-python3-jinja2_3.0.3-1ubuntu0.2_all.deb ... 2024-09-16T05:28:28.021 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-16T05:28:28.134 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-09-16T05:28:28.150 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../077-ceph-mgr-dashboard_19.1.1-326-g8921c8ef-1jammy_all.deb ... 2024-09-16T05:28:28.193 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking ceph-mgr-dashboard (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T05:28:28.255 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-routes. 2024-09-16T05:28:28.282 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../076-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-09-16T05:28:28.322 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-09-16T05:28:28.341 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-09-16T05:28:28.368 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../074-ceph-mgr-cephadm_19.1.1-326-g8921c8ef-1jammy_all.deb ... 2024-09-16T05:28:28.573 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking ceph-mgr-cephadm (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T05:28:28.641 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-09-16T05:28:28.668 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../077-ceph-mgr-dashboard_19.1.1-326-g8921c8ef-1jammy_all.deb ... 2024-09-16T05:28:28.707 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking ceph-mgr-dashboard (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T05:28:28.902 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-repoze.lru. 2024-09-16T05:28:28.930 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../075-python3-repoze.lru_0.7-2_all.deb ... 2024-09-16T05:28:28.968 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-09-16T05:28:29.279 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-routes. 2024-09-16T05:28:29.307 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../076-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-09-16T05:28:29.346 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-09-16T05:28:29.464 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-09-16T05:28:29.481 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../078-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-09-16T05:28:29.514 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-16T05:28:29.691 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-09-16T05:28:29.718 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../077-ceph-mgr-dashboard_19.1.1-326-g8921c8ef-1jammy_all.deb ... 2024-09-16T05:28:29.757 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking ceph-mgr-dashboard (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T05:28:29.929 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-09-16T05:28:29.945 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../078-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-09-16T05:28:29.968 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-joblib. 2024-09-16T05:28:29.994 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../079-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-09-16T05:28:29.996 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-16T05:28:30.034 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-09-16T05:28:30.395 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-09-16T05:28:30.423 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../080-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-09-16T05:28:30.433 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-joblib. 2024-09-16T05:28:30.448 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../079-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-09-16T05:28:30.462 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-09-16T05:28:30.483 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-09-16T05:28:30.731 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-sklearn. 2024-09-16T05:28:30.759 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../081-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-09-16T05:28:30.797 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-16T05:28:30.836 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-09-16T05:28:30.863 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../080-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-09-16T05:28:30.903 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-09-16T05:28:30.987 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-09-16T05:28:31.014 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../078-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-09-16T05:28:31.053 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-16T05:28:31.206 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-sklearn. 2024-09-16T05:28:31.233 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../081-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-09-16T05:28:31.272 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-16T05:28:31.464 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-09-16T05:28:31.491 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../082-ceph-mgr-diskprediction-local_19.1.1-326-g8921c8ef-1jammy_all.deb ... 2024-09-16T05:28:31.565 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-joblib. 2024-09-16T05:28:31.593 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../079-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-09-16T05:28:31.599 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking ceph-mgr-diskprediction-local (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T05:28:31.632 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-09-16T05:28:31.956 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-09-16T05:28:31.983 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../082-ceph-mgr-diskprediction-local_19.1.1-326-g8921c8ef-1jammy_all.deb ... 2024-09-16T05:28:32.002 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-09-16T05:28:32.029 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../080-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-09-16T05:28:32.068 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-09-16T05:28:32.108 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking ceph-mgr-diskprediction-local (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T05:28:32.329 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-sklearn. 2024-09-16T05:28:32.357 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../081-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-09-16T05:28:32.387 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-16T05:28:32.603 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-cachetools. 2024-09-16T05:28:32.629 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../083-python3-cachetools_5.0.0-1_all.deb ... 2024-09-16T05:28:32.669 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-09-16T05:28:32.980 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-pyasn1. 2024-09-16T05:28:33.007 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../084-python3-pyasn1_0.4.8-1_all.deb ... 2024-09-16T05:28:33.046 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-09-16T05:28:33.104 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-09-16T05:28:33.111 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-cachetools. 2024-09-16T05:28:33.121 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../082-ceph-mgr-diskprediction-local_19.1.1-326-g8921c8ef-1jammy_all.deb ... 2024-09-16T05:28:33.138 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../083-python3-cachetools_5.0.0-1_all.deb ... 2024-09-16T05:28:33.177 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-09-16T05:28:33.239 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking ceph-mgr-diskprediction-local (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T05:28:33.383 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-09-16T05:28:33.399 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../085-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-09-16T05:28:33.441 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-09-16T05:28:33.489 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-pyasn1. 2024-09-16T05:28:33.516 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../084-python3-pyasn1_0.4.8-1_all.deb ... 2024-09-16T05:28:33.555 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-09-16T05:28:33.752 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-rsa. 2024-09-16T05:28:33.779 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../086-python3-rsa_4.8-1_all.deb ... 2024-09-16T05:28:33.819 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-rsa (4.8-1) ... 2024-09-16T05:28:33.892 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-09-16T05:28:33.919 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../085-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-09-16T05:28:33.958 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-09-16T05:28:34.147 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-google-auth. 2024-09-16T05:28:34.174 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../087-python3-google-auth_1.5.1-3_all.deb ... 2024-09-16T05:28:34.203 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-cachetools. 2024-09-16T05:28:34.214 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-09-16T05:28:34.231 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../083-python3-cachetools_5.0.0-1_all.deb ... 2024-09-16T05:28:34.245 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-rsa. 2024-09-16T05:28:34.270 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-09-16T05:28:34.271 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../086-python3-rsa_4.8-1_all.deb ... 2024-09-16T05:28:34.311 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-rsa (4.8-1) ... 2024-09-16T05:28:34.531 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-pyasn1. 2024-09-16T05:28:34.533 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-09-16T05:28:34.559 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../084-python3-pyasn1_0.4.8-1_all.deb ... 2024-09-16T05:28:34.560 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../088-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-09-16T05:28:34.589 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-09-16T05:28:34.599 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-google-auth. 2024-09-16T05:28:34.600 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-16T05:28:34.626 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../087-python3-google-auth_1.5.1-3_all.deb ... 2024-09-16T05:28:34.665 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-09-16T05:28:34.909 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-09-16T05:28:34.911 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-websocket. 2024-09-16T05:28:34.937 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../085-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-09-16T05:28:34.938 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../089-python3-websocket_1.2.3-1_all.deb ... 2024-09-16T05:28:34.976 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-09-16T05:28:34.977 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-09-16T05:28:34.985 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-09-16T05:28:35.012 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../088-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-09-16T05:28:35.052 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-16T05:28:35.287 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-rsa. 2024-09-16T05:28:35.315 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../086-python3-rsa_4.8-1_all.deb ... 2024-09-16T05:28:35.353 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-rsa (4.8-1) ... 2024-09-16T05:28:35.363 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-websocket. 2024-09-16T05:28:35.390 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../089-python3-websocket_1.2.3-1_all.deb ... 2024-09-16T05:28:35.438 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-09-16T05:28:35.515 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-kubernetes. 2024-09-16T05:28:35.542 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../090-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-09-16T05:28:35.581 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-16T05:28:35.674 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-google-auth. 2024-09-16T05:28:35.701 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../087-python3-google-auth_1.5.1-3_all.deb ... 2024-09-16T05:28:35.740 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-09-16T05:28:35.749 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-kubernetes. 2024-09-16T05:28:35.777 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../090-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-09-16T05:28:35.816 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-16T05:28:36.060 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-09-16T05:28:36.087 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../088-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-09-16T05:28:36.126 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-16T05:28:36.277 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-09-16T05:28:36.294 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../091-ceph-mgr-k8sevents_19.1.1-326-g8921c8ef-1jammy_all.deb ... 2024-09-16T05:28:36.335 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking ceph-mgr-k8sevents (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T05:28:36.404 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-websocket. 2024-09-16T05:28:36.432 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../089-python3-websocket_1.2.3-1_all.deb ... 2024-09-16T05:28:36.462 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-09-16T05:28:36.480 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-09-16T05:28:36.496 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../091-ceph-mgr-k8sevents_19.1.1-326-g8921c8ef-1jammy_all.deb ... 2024-09-16T05:28:36.538 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking ceph-mgr-k8sevents (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T05:28:36.630 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package libonig5:amd64. 2024-09-16T05:28:36.660 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../092-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-09-16T05:28:36.697 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-16T05:28:36.766 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-kubernetes. 2024-09-16T05:28:36.794 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../090-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-09-16T05:28:36.841 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package libonig5:amd64. 2024-09-16T05:28:36.849 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-16T05:28:36.868 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../092-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-09-16T05:28:36.932 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-16T05:28:36.949 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package libjq1:amd64. 2024-09-16T05:28:36.976 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../093-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-09-16T05:28:37.016 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-16T05:28:37.269 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package libjq1:amd64. 2024-09-16T05:28:37.285 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package jq. 2024-09-16T05:28:37.296 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../093-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-09-16T05:28:37.300 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../094-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-09-16T05:28:37.335 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-16T05:28:37.343 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-09-16T05:28:37.571 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-09-16T05:28:37.579 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package jq. 2024-09-16T05:28:37.588 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../091-ceph-mgr-k8sevents_19.1.1-326-g8921c8ef-1jammy_all.deb ... 2024-09-16T05:28:37.595 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../094-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-09-16T05:28:37.595 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package socat. 2024-09-16T05:28:37.611 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../095-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-09-16T05:28:37.621 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking ceph-mgr-k8sevents (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T05:28:37.629 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-09-16T05:28:37.654 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-09-16T05:28:37.832 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package socat. 2024-09-16T05:28:37.859 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../095-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-09-16T05:28:37.865 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package libonig5:amd64. 2024-09-16T05:28:37.882 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../092-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-09-16T05:28:37.899 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-09-16T05:28:37.915 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-16T05:28:37.957 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package xmlstarlet. 2024-09-16T05:28:37.973 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../096-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-09-16T05:28:38.015 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-09-16T05:28:38.210 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package xmlstarlet. 2024-09-16T05:28:38.226 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../096-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-09-16T05:28:38.268 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package libjq1:amd64. 2024-09-16T05:28:38.268 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-09-16T05:28:38.296 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../093-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-09-16T05:28:38.334 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-16T05:28:38.386 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package ceph-test. 2024-09-16T05:28:38.402 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../097-ceph-test_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-16T05:28:38.444 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking ceph-test (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T05:28:38.598 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package ceph-test. 2024-09-16T05:28:38.613 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../097-ceph-test_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-16T05:28:38.647 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking ceph-test (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T05:28:38.772 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package jq. 2024-09-16T05:28:38.801 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../094-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-09-16T05:28:38.879 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-09-16T05:28:39.098 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package socat. 2024-09-16T05:28:39.114 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../095-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-09-16T05:28:39.148 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-09-16T05:28:39.409 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package xmlstarlet. 2024-09-16T05:28:39.425 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../096-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-09-16T05:28:39.459 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-09-16T05:28:39.938 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package ceph-test. 2024-09-16T05:28:39.955 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../097-ceph-test_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-16T05:28:39.996 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking ceph-test (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T05:28:40.715 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package ceph-volume. 2024-09-16T05:28:40.742 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../098-ceph-volume_19.1.1-326-g8921c8ef-1jammy_all.deb ... 2024-09-16T05:28:40.781 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking ceph-volume (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T05:28:40.944 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package ceph-volume. 2024-09-16T05:28:40.971 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../098-ceph-volume_19.1.1-326-g8921c8ef-1jammy_all.deb ... 2024-09-16T05:28:41.010 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking ceph-volume (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T05:28:41.068 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package libcephfs-dev. 2024-09-16T05:28:41.096 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../099-libcephfs-dev_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-16T05:28:41.135 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking libcephfs-dev (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T05:28:41.316 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package libcephfs-dev. 2024-09-16T05:28:41.332 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../099-libcephfs-dev_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-16T05:28:41.374 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking libcephfs-dev (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T05:28:41.446 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package lua-socket:amd64. 2024-09-16T05:28:41.473 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../100-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-09-16T05:28:41.512 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-16T05:28:41.668 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package lua-socket:amd64. 2024-09-16T05:28:41.684 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../100-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-09-16T05:28:41.718 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-16T05:28:41.808 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package lua-sec:amd64. 2024-09-16T05:28:41.835 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../101-lua-sec_1.0.2-1_amd64.deb ... 2024-09-16T05:28:41.866 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-09-16T05:28:41.973 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package lua-sec:amd64. 2024-09-16T05:28:42.000 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../101-lua-sec_1.0.2-1_amd64.deb ... 2024-09-16T05:28:42.031 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-09-16T05:28:42.228 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package nvme-cli. 2024-09-16T05:28:42.255 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../102-nvme-cli_1.16-3ubuntu0.3_amd64.deb ... 2024-09-16T05:28:42.294 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking nvme-cli (1.16-3ubuntu0.3) ... 2024-09-16T05:28:42.334 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package ceph-volume. 2024-09-16T05:28:42.362 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../098-ceph-volume_19.1.1-326-g8921c8ef-1jammy_all.deb ... 2024-09-16T05:28:42.393 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package nvme-cli. 2024-09-16T05:28:42.400 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking ceph-volume (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T05:28:42.420 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../102-nvme-cli_1.16-3ubuntu0.3_amd64.deb ... 2024-09-16T05:28:42.459 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking nvme-cli (1.16-3ubuntu0.3) ... 2024-09-16T05:28:42.712 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package libcephfs-dev. 2024-09-16T05:28:42.724 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package pkg-config. 2024-09-16T05:28:42.729 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../099-libcephfs-dev_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-16T05:28:42.752 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../103-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-09-16T05:28:42.770 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking libcephfs-dev (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T05:28:42.791 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-09-16T05:28:42.848 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package pkg-config. 2024-09-16T05:28:42.875 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../103-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-09-16T05:28:42.914 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-09-16T05:28:43.077 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-09-16T05:28:43.090 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package lua-socket:amd64. 2024-09-16T05:28:43.092 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../104-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-09-16T05:28:43.118 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../100-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-09-16T05:28:43.135 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-09-16T05:28:43.156 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-16T05:28:43.167 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-09-16T05:28:43.183 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../104-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-09-16T05:28:43.226 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-09-16T05:28:43.511 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package lua-sec:amd64. 2024-09-16T05:28:43.539 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../101-lua-sec_1.0.2-1_amd64.deb ... 2024-09-16T05:28:43.580 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-iniconfig. 2024-09-16T05:28:43.585 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-09-16T05:28:43.607 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../105-python3-iniconfig_1.1.1-2_all.deb ... 2024-09-16T05:28:43.646 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-iniconfig. 2024-09-16T05:28:43.654 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-09-16T05:28:43.673 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../105-python3-iniconfig_1.1.1-2_all.deb ... 2024-09-16T05:28:43.712 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-09-16T05:28:43.931 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package nvme-cli. 2024-09-16T05:28:43.957 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-pastescript. 2024-09-16T05:28:43.959 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../102-nvme-cli_1.16-3ubuntu0.3_amd64.deb ... 2024-09-16T05:28:43.984 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../106-python3-pastescript_2.0.2-4_all.deb ... 2024-09-16T05:28:43.997 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking nvme-cli (1.16-3ubuntu0.3) ... 2024-09-16T05:28:43.998 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-pastescript. 2024-09-16T05:28:44.023 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-09-16T05:28:44.025 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../106-python3-pastescript_2.0.2-4_all.deb ... 2024-09-16T05:28:44.064 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-09-16T05:28:44.327 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-pluggy. 2024-09-16T05:28:44.355 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../107-python3-pluggy_0.13.0-7.1_all.deb ... 2024-09-16T05:28:44.393 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-pluggy. 2024-09-16T05:28:44.393 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-09-16T05:28:44.402 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package pkg-config. 2024-09-16T05:28:44.420 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../107-python3-pluggy_0.13.0-7.1_all.deb ... 2024-09-16T05:28:44.431 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../103-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-09-16T05:28:44.459 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-09-16T05:28:44.469 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-09-16T05:28:44.654 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-psutil. 2024-09-16T05:28:44.670 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../108-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-09-16T05:28:44.704 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-09-16T05:28:44.722 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-09-16T05:28:44.739 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../104-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-09-16T05:28:44.746 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-psutil. 2024-09-16T05:28:44.773 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../108-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-09-16T05:28:44.780 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-09-16T05:28:44.804 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-09-16T05:28:44.999 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-py. 2024-09-16T05:28:45.015 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../109-python3-py_1.10.0-1_all.deb ... 2024-09-16T05:28:45.048 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-py (1.10.0-1) ... 2024-09-16T05:28:45.123 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-py. 2024-09-16T05:28:45.151 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../109-python3-py_1.10.0-1_all.deb ... 2024-09-16T05:28:45.190 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-py (1.10.0-1) ... 2024-09-16T05:28:45.208 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-iniconfig. 2024-09-16T05:28:45.225 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../105-python3-iniconfig_1.1.1-2_all.deb ... 2024-09-16T05:28:45.266 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-09-16T05:28:45.360 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-pygments. 2024-09-16T05:28:45.388 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../110-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-09-16T05:28:45.418 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-09-16T05:28:45.477 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-pygments. 2024-09-16T05:28:45.505 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../110-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-09-16T05:28:45.535 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-09-16T05:28:45.568 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-pastescript. 2024-09-16T05:28:45.597 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../106-python3-pastescript_2.0.2-4_all.deb ... 2024-09-16T05:28:45.635 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-09-16T05:28:45.939 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-pyinotify. 2024-09-16T05:28:45.967 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../111-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-09-16T05:28:45.972 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-pluggy. 2024-09-16T05:28:45.988 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../107-python3-pluggy_0.13.0-7.1_all.deb ... 2024-09-16T05:28:46.005 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-09-16T05:28:46.030 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-09-16T05:28:46.108 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-pyinotify. 2024-09-16T05:28:46.133 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../111-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-09-16T05:28:46.172 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-09-16T05:28:46.317 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-psutil. 2024-09-16T05:28:46.317 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-toml. 2024-09-16T05:28:46.344 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../112-python3-toml_0.10.2-1_all.deb ... 2024-09-16T05:28:46.345 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../108-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-09-16T05:28:46.382 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-09-16T05:28:46.383 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-09-16T05:28:46.458 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-toml. 2024-09-16T05:28:46.485 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../112-python3-toml_0.10.2-1_all.deb ... 2024-09-16T05:28:46.524 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-09-16T05:28:46.686 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-pytest. 2024-09-16T05:28:46.713 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../113-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-09-16T05:28:46.744 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-py. 2024-09-16T05:28:46.752 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-09-16T05:28:46.772 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../109-python3-py_1.10.0-1_all.deb ... 2024-09-16T05:28:46.827 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-pytest. 2024-09-16T05:28:46.843 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-py (1.10.0-1) ... 2024-09-16T05:28:46.851 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../113-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-09-16T05:28:46.885 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-09-16T05:28:47.098 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-simplejson. 2024-09-16T05:28:47.125 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../114-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-09-16T05:28:47.147 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-pygments. 2024-09-16T05:28:47.164 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-09-16T05:28:47.175 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../110-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-09-16T05:28:47.213 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-09-16T05:28:47.222 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-simplejson. 2024-09-16T05:28:47.249 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../114-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-09-16T05:28:47.297 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-09-16T05:28:47.442 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-09-16T05:28:47.459 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../115-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-09-16T05:28:47.500 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-09-16T05:28:47.566 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-09-16T05:28:47.593 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../115-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-09-16T05:28:47.632 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-09-16T05:28:47.668 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-pyinotify. 2024-09-16T05:28:47.696 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../111-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-09-16T05:28:47.734 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-09-16T05:28:48.062 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-toml. 2024-09-16T05:28:48.090 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../112-python3-toml_0.10.2-1_all.deb ... 2024-09-16T05:28:48.128 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-09-16T05:28:48.204 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package radosgw. 2024-09-16T05:28:48.232 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../116-radosgw_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-16T05:28:48.270 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking radosgw (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T05:28:48.336 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package radosgw. 2024-09-16T05:28:48.364 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../116-radosgw_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-16T05:28:48.402 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking radosgw (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T05:28:48.431 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-pytest. 2024-09-16T05:28:48.459 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../113-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-09-16T05:28:48.497 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-09-16T05:28:48.843 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-simplejson. 2024-09-16T05:28:48.871 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../114-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-09-16T05:28:48.909 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-09-16T05:28:49.057 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package rbd-fuse. 2024-09-16T05:28:49.073 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../117-rbd-fuse_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-16T05:28:49.116 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking rbd-fuse (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T05:28:49.169 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-09-16T05:28:49.172 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package rbd-fuse. 2024-09-16T05:28:49.185 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../117-rbd-fuse_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-16T05:28:49.186 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../115-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-09-16T05:28:49.222 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking rbd-fuse (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T05:28:49.228 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-09-16T05:28:49.396 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-09-16T05:28:49.518 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-09-16T05:28:49.654 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-16T05:28:49.751 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-16T05:28:49.779 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up nvme-cli (1.16-3ubuntu0.3) ... 2024-09-16T05:28:49.894 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up nvme-cli (1.16-3ubuntu0.3) ... 2024-09-16T05:28:49.974 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package radosgw. 2024-09-16T05:28:50.002 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../116-radosgw_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-16T05:28:50.040 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking radosgw (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T05:28:50.040 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-09-16T05:28:50.141 INFO:teuthology.orchestra.run.smithi086.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-09-16T05:28:50.368 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-09-16T05:28:50.482 INFO:teuthology.orchestra.run.smithi086.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-09-16T05:28:50.777 INFO:teuthology.orchestra.run.smithi157.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-09-16T05:28:50.847 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up cephadm (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T05:28:50.859 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package rbd-fuse. 2024-09-16T05:28:50.882 INFO:teuthology.orchestra.run.smithi086.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-09-16T05:28:50.888 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../117-rbd-fuse_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-16T05:28:50.926 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking rbd-fuse (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T05:28:50.945 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up cephadm (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T05:28:51.247 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-09-16T05:28:51.404 INFO:teuthology.orchestra.run.smithi086.stdout:Adding system user cephadm....done 2024-09-16T05:28:51.497 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-16T05:28:51.535 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-16T05:28:51.605 INFO:teuthology.orchestra.run.smithi157.stdout:Adding system user cephadm....done 2024-09-16T05:28:51.623 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up nvme-cli (1.16-3ubuntu0.3) ... 2024-09-16T05:28:51.754 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-16T05:28:51.803 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-09-16T05:28:51.903 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-09-16T05:28:52.030 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-09-16T05:28:52.054 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-09-16T05:28:52.163 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-09-16T05:28:52.225 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-09-16T05:28:52.298 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-09-16T05:28:52.414 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-09-16T05:28:52.432 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-09-16T05:28:52.631 INFO:teuthology.orchestra.run.smithi047.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-09-16T05:28:52.666 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-09-16T05:28:52.676 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-09-16T05:28:52.709 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up cephadm (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T05:28:52.791 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-py (1.10.0-1) ... 2024-09-16T05:28:52.918 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-09-16T05:28:53.036 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-py (1.10.0-1) ... 2024-09-16T05:28:53.118 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-09-16T05:28:53.233 INFO:teuthology.orchestra.run.smithi047.stdout:Adding system user cephadm....done 2024-09-16T05:28:53.337 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-09-16T05:28:53.356 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-16T05:28:53.478 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-09-16T05:28:53.657 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-09-16T05:28:53.698 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-09-16T05:28:53.739 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-09-16T05:28:53.957 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-09-16T05:28:53.966 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-09-16T05:28:54.014 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-09-16T05:28:54.093 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-09-16T05:28:54.200 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-09-16T05:28:54.299 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-09-16T05:28:54.452 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-09-16T05:28:54.494 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-09-16T05:28:54.549 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-09-16T05:28:54.711 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-09-16T05:28:54.770 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-09-16T05:28:54.800 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-09-16T05:28:54.896 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-py (1.10.0-1) ... 2024-09-16T05:28:54.979 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-09-16T05:28:55.043 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-ceph-argparse (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T05:28:55.238 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-ceph-argparse (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T05:28:55.243 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-09-16T05:28:55.302 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-16T05:28:55.403 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-16T05:28:55.504 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-09-16T05:28:55.514 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-16T05:28:55.617 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-09-16T05:28:55.622 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-09-16T05:28:55.624 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-16T05:28:55.725 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-09-16T05:28:55.834 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-09-16T05:28:55.881 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-09-16T05:28:55.884 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-09-16T05:28:56.110 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-09-16T05:28:56.144 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-09-16T05:28:56.306 INFO:teuthology.orchestra.run.smithi086.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-09-16T05:28:56.338 INFO:teuthology.orchestra.run.smithi086.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-09-16T05:28:56.387 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-09-16T05:28:56.401 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-16T05:28:56.512 INFO:teuthology.orchestra.run.smithi157.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-09-16T05:28:56.527 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-09-16T05:28:56.533 INFO:teuthology.orchestra.run.smithi157.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-09-16T05:28:56.597 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-16T05:28:56.646 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-09-16T05:28:56.722 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-09-16T05:28:56.878 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-16T05:28:56.906 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-09-16T05:28:57.004 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-09-16T05:28:57.091 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-16T05:28:57.165 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-ceph-argparse (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T05:28:57.191 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-09-16T05:28:57.263 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-09-16T05:28:57.425 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-16T05:28:57.451 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-09-16T05:28:57.539 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-09-16T05:28:57.550 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-16T05:28:57.676 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-09-16T05:28:57.710 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-09-16T05:28:57.785 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-09-16T05:28:57.840 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up zip (3.0-12build2) ... 2024-09-16T05:28:57.966 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-09-16T05:28:58.011 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up zip (3.0-12build2) ... 2024-09-16T05:28:58.028 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-09-16T05:28:58.137 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-09-16T05:28:58.428 INFO:teuthology.orchestra.run.smithi047.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-09-16T05:28:58.460 INFO:teuthology.orchestra.run.smithi047.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-09-16T05:28:58.523 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-16T05:28:58.643 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-09-16T05:28:58.649 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-09-16T05:28:58.823 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-09-16T05:28:58.902 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-09-16T05:28:59.003 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-09-16T05:28:59.033 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-16T05:28:59.074 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-09-16T05:28:59.104 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-16T05:28:59.159 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-09-16T05:28:59.183 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-09-16T05:28:59.284 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-16T05:28:59.397 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-09-16T05:28:59.427 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-09-16T05:28:59.585 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-09-16T05:28:59.687 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-09-16T05:28:59.807 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-09-16T05:28:59.978 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-09-16T05:29:00.004 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up zip (3.0-12build2) ... 2024-09-16T05:29:00.057 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-09-16T05:29:00.155 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-09-16T05:29:00.229 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-09-16T05:29:00.417 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-16T05:29:00.597 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-16T05:29:00.693 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-16T05:29:00.860 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-09-16T05:29:00.874 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-16T05:29:01.028 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-09-16T05:29:01.108 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-09-16T05:29:01.208 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-09-16T05:29:01.234 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-09-16T05:29:01.352 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-16T05:29:01.446 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-09-16T05:29:01.460 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-09-16T05:29:01.577 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-ceph-common (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T05:29:01.580 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-ceph-common (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T05:29:01.653 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-09-16T05:29:01.862 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-idna (3.3-1ubuntu0.1) ... 2024-09-16T05:29:01.881 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-idna (3.3-1ubuntu0.1) ... 2024-09-16T05:29:02.046 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-09-16T05:29:02.179 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-16T05:29:02.224 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-16T05:29:02.305 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-09-16T05:29:02.690 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-16T05:29:02.983 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-16T05:29:03.294 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-09-16T05:29:03.334 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-09-16T05:29:03.379 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-09-16T05:29:03.554 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-16T05:29:03.610 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-09-16T05:29:03.631 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-16T05:29:03.688 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-toml (0.10.2-1) ... 2024-09-16T05:29:03.720 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-ceph-common (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T05:29:03.765 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-toml (0.10.2-1) ... 2024-09-16T05:29:03.980 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-16T05:29:04.004 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-idna (3.3-1ubuntu0.1) ... 2024-09-16T05:29:04.033 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-16T05:29:04.090 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-09-16T05:29:04.159 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-09-16T05:29:04.191 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-16T05:29:04.301 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-16T05:29:04.322 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-16T05:29:04.476 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-09-16T05:29:04.594 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-09-16T05:29:04.726 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-09-16T05:29:04.837 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-09-16T05:29:04.978 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-16T05:29:05.071 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-16T05:29:05.104 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-09-16T05:29:05.206 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-09-16T05:29:05.480 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-09-16T05:29:05.527 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-09-16T05:29:05.640 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-09-16T05:29:05.715 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-09-16T05:29:05.737 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-16T05:29:05.872 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-toml (0.10.2-1) ... 2024-09-16T05:29:05.891 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-09-16T05:29:05.957 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-09-16T05:29:06.140 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-16T05:29:06.159 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-09-16T05:29:06.209 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-09-16T05:29:06.265 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-09-16T05:29:06.393 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-16T05:29:06.427 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-09-16T05:29:06.576 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-09-16T05:29:06.678 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-09-16T05:29:06.701 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-09-16T05:29:06.852 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-16T05:29:06.920 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-16T05:29:06.978 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-09-16T05:29:06.985 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-09-16T05:29:07.021 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-09-16T05:29:07.228 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-16T05:29:07.263 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-16T05:29:07.297 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-16T05:29:07.329 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-09-16T05:29:07.381 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-16T05:29:07.423 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-16T05:29:07.639 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-09-16T05:29:07.649 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-16T05:29:07.708 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-16T05:29:07.898 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-09-16T05:29:07.924 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-09-16T05:29:07.992 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-09-16T05:29:08.166 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-09-16T05:29:08.184 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-16T05:29:08.251 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-16T05:29:08.310 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-09-16T05:29:08.377 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-09-16T05:29:08.433 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-09-16T05:29:08.436 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-09-16T05:29:08.503 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-09-16T05:29:08.525 INFO:teuthology.orchestra.run.smithi157.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-09-16T05:29:08.592 INFO:teuthology.orchestra.run.smithi086.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-09-16T05:29:08.693 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-09-16T05:29:08.763 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-16T05:29:08.821 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-16T05:29:08.889 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-09-16T05:29:08.952 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-16T05:29:08.956 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-09-16T05:29:09.061 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-09-16T05:29:09.274 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-09-16T05:29:09.384 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-09-16T05:29:09.385 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-16T05:29:09.447 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-16T05:29:09.516 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up lua-any (27ubuntu1) ... 2024-09-16T05:29:09.600 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up lua-any (27ubuntu1) ... 2024-09-16T05:29:09.642 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-portend (3.0.0-1) ... 2024-09-16T05:29:09.726 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-portend (3.0.0-1) ... 2024-09-16T05:29:09.790 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-16T05:29:09.902 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-16T05:29:09.985 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-16T05:29:10.028 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-16T05:29:10.111 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-16T05:29:10.132 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-09-16T05:29:10.354 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-09-16T05:29:10.392 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-16T05:29:10.412 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-09-16T05:29:10.517 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-09-16T05:29:10.635 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-09-16T05:29:10.663 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-16T05:29:10.705 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-16T05:29:10.707 INFO:teuthology.orchestra.run.smithi047.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-09-16T05:29:10.931 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-09-16T05:29:10.937 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-16T05:29:10.981 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-09-16T05:29:11.032 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-rsa (4.8-1) ... 2024-09-16T05:29:11.047 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-09-16T05:29:11.107 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-rsa (4.8-1) ... 2024-09-16T05:29:11.300 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-09-16T05:29:11.383 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-09-16T05:29:11.481 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-09-16T05:29:11.568 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-16T05:29:11.675 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-16T05:29:11.740 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up lua-any (27ubuntu1) ... 2024-09-16T05:29:11.866 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-portend (3.0.0-1) ... 2024-09-16T05:29:11.913 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-09-16T05:29:12.020 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-09-16T05:29:12.125 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-16T05:29:12.251 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-16T05:29:12.289 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-09-16T05:29:12.397 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-09-16T05:29:12.574 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-09-16T05:29:12.586 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-09-16T05:29:12.673 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-09-16T05:29:12.870 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-16T05:29:12.893 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-16T05:29:13.017 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-16T05:29:13.019 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up librados2 (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T05:29:13.130 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-09-16T05:29:13.143 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up librados2 (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T05:29:13.145 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up libsqlite3-mod-ceph (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T05:29:13.256 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-rsa (4.8-1) ... 2024-09-16T05:29:13.269 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up libsqlite3-mod-ceph (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T05:29:13.271 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-09-16T05:29:13.378 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-09-16T05:29:13.532 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-09-16T05:29:13.566 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up libcephfs2 (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T05:29:13.683 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up libcephfs2 (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T05:29:13.692 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up libradosstriper1 (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T05:29:13.808 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-16T05:29:13.809 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up libradosstriper1 (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T05:29:13.818 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-09-16T05:29:13.935 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-09-16T05:29:14.095 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up librbd1 (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T05:29:14.153 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-09-16T05:29:14.212 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up librbd1 (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T05:29:14.221 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up ceph-mgr-modules-core (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T05:29:14.313 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up ceph-mgr-modules-core (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T05:29:14.347 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up ceph-fuse (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T05:29:14.422 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up ceph-fuse (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T05:29:14.530 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-09-16T05:29:15.025 INFO:teuthology.orchestra.run.smithi086.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-16T05:29:15.025 INFO:teuthology.orchestra.run.smithi086.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-16T05:29:15.025 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-09-16T05:29:15.026 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-16T05:29:15.026 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-16T05:29:15.026 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up libcephfs-dev (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T05:29:15.074 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-rados (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T05:29:15.124 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up libcephfs-dev (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T05:29:15.183 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-16T05:29:15.209 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up librgw2 (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T05:29:15.275 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-rados (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T05:29:15.309 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up librados2 (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T05:29:15.360 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-16T05:29:15.401 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up librgw2 (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T05:29:15.444 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up libsqlite3-mod-ceph (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T05:29:15.527 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-16T05:29:15.553 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-09-16T05:29:15.848 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up libcephfs2 (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T05:29:15.974 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up libradosstriper1 (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T05:29:16.116 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-09-16T05:29:16.401 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up librbd1 (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T05:29:16.510 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up ceph-mgr-modules-core (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T05:29:16.596 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-rbd (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T05:29:16.611 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up ceph-fuse (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T05:29:16.672 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-rbd (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T05:29:16.705 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up rbd-fuse (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T05:29:16.798 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up rbd-fuse (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T05:29:16.815 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-16T05:29:16.815 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-16T05:29:16.815 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-rgw (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T05:29:16.916 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-cephfs (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T05:29:16.924 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-rgw (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T05:29:17.033 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-cephfs (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T05:29:17.042 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up ceph-common (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T05:29:17.159 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up ceph-common (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T05:29:17.271 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up libcephfs-dev (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T05:29:17.397 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-rados (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T05:29:17.523 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up librgw2 (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T05:29:17.577 INFO:teuthology.orchestra.run.smithi157.stdout:Adding group ceph....done 2024-09-16T05:29:17.634 INFO:teuthology.orchestra.run.smithi086.stdout:Adding group ceph....done 2024-09-16T05:29:17.649 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-16T05:29:17.928 INFO:teuthology.orchestra.run.smithi157.stdout:Adding system user ceph....done 2024-09-16T05:29:18.003 INFO:teuthology.orchestra.run.smithi086.stdout:Adding system user ceph....done 2024-09-16T05:29:18.039 INFO:teuthology.orchestra.run.smithi157.stdout:Setting system user ceph properties....done 2024-09-16T05:29:18.059 INFO:teuthology.orchestra.run.smithi157.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-09-16T05:29:18.138 INFO:teuthology.orchestra.run.smithi086.stdout:Setting system user ceph properties....done 2024-09-16T05:29:18.156 INFO:teuthology.orchestra.run.smithi086.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-09-16T05:29:18.196 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-09-16T05:29:18.292 INFO:teuthology.orchestra.run.smithi086.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-09-16T05:29:18.496 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-09-16T05:29:18.631 INFO:teuthology.orchestra.run.smithi086.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-09-16T05:29:18.919 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-rbd (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T05:29:18.960 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up ceph-test (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T05:29:19.029 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up rbd-fuse (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T05:29:19.086 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up radosgw (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T05:29:19.094 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up ceph-test (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T05:29:19.154 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-rgw (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T05:29:19.220 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up radosgw (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T05:29:19.281 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-cephfs (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T05:29:19.406 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up ceph-common (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T05:29:19.572 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-16T05:29:19.573 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-16T05:29:19.684 INFO:teuthology.orchestra.run.smithi086.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-16T05:29:19.684 INFO:teuthology.orchestra.run.smithi086.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-16T05:29:19.950 INFO:teuthology.orchestra.run.smithi047.stdout:Adding group ceph....done 2024-09-16T05:29:20.030 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up ceph-base (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T05:29:20.138 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up ceph-base (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T05:29:20.351 INFO:teuthology.orchestra.run.smithi047.stdout:Adding system user ceph....done 2024-09-16T05:29:20.373 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-09-16T05:29:20.484 INFO:teuthology.orchestra.run.smithi086.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-09-16T05:29:20.486 INFO:teuthology.orchestra.run.smithi047.stdout:Setting system user ceph properties....done 2024-09-16T05:29:20.505 INFO:teuthology.orchestra.run.smithi047.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-09-16T05:29:20.647 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-09-16T05:29:20.823 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up ceph-mds (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T05:29:20.949 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-09-16T05:29:20.973 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up ceph-mds (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T05:29:21.046 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-16T05:29:21.046 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-16T05:29:21.207 INFO:teuthology.orchestra.run.smithi086.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-16T05:29:21.207 INFO:teuthology.orchestra.run.smithi086.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-16T05:29:21.399 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up ceph-test (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T05:29:21.525 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up radosgw (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T05:29:21.559 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up ceph-mgr (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T05:29:21.684 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up ceph-mgr (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T05:29:21.791 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-16T05:29:21.791 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-16T05:29:21.893 INFO:teuthology.orchestra.run.smithi086.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-16T05:29:21.893 INFO:teuthology.orchestra.run.smithi086.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-16T05:29:21.993 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-16T05:29:21.993 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-16T05:29:22.256 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up ceph-osd (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T05:29:22.409 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up ceph-osd (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T05:29:22.452 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up ceph-base (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T05:29:22.509 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-16T05:29:22.509 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-16T05:29:22.683 INFO:teuthology.orchestra.run.smithi086.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-16T05:29:22.683 INFO:teuthology.orchestra.run.smithi086.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-16T05:29:22.821 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-09-16T05:29:23.016 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up ceph-mgr-k8sevents (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T05:29:23.142 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up ceph-mgr-diskprediction-local (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T05:29:23.144 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up ceph-mgr-k8sevents (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T05:29:23.271 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up ceph-mgr-diskprediction-local (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T05:29:23.293 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up ceph-mon (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T05:29:23.365 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up ceph-mds (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T05:29:23.413 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up ceph-mon (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T05:29:23.509 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-16T05:29:23.509 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-16T05:29:23.628 INFO:teuthology.orchestra.run.smithi086.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-16T05:29:23.628 INFO:teuthology.orchestra.run.smithi086.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-16T05:29:23.646 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-16T05:29:23.647 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-16T05:29:24.003 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up ceph-mgr-cephadm (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T05:29:24.100 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up ceph-mgr (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T05:29:24.131 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up ceph-mgr-cephadm (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T05:29:24.154 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up ceph (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T05:29:24.280 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up ceph-mgr-dashboard (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T05:29:24.291 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up ceph (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T05:29:24.324 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-16T05:29:24.324 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-16T05:29:24.401 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up ceph-mgr-dashboard (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T05:29:24.422 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up ceph-volume (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T05:29:24.759 INFO:teuthology.orchestra.run.smithi157.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-09-16T05:29:24.767 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up ceph-osd (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T05:29:24.836 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up ceph-volume (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T05:29:24.860 INFO:teuthology.orchestra.run.smithi157.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-16T05:29:25.043 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-16T05:29:25.044 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-16T05:29:25.045 INFO:teuthology.orchestra.run.smithi157.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-16T05:29:25.188 INFO:teuthology.orchestra.run.smithi086.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-09-16T05:29:25.281 INFO:teuthology.orchestra.run.smithi086.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-16T05:29:25.442 INFO:teuthology.orchestra.run.smithi086.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-16T05:29:25.536 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up ceph-mgr-k8sevents (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T05:29:25.658 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up ceph-mgr-diskprediction-local (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T05:29:25.801 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up ceph-mon (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T05:29:26.017 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-16T05:29:26.017 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-16T05:29:26.229 INFO:teuthology.orchestra.run.smithi157.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-09-16T05:29:26.460 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up ceph-mgr-cephadm (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T05:29:26.593 INFO:teuthology.orchestra.run.smithi086.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-09-16T05:29:26.603 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up ceph (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T05:29:26.746 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up ceph-mgr-dashboard (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T05:29:26.817 INFO:teuthology.orchestra.run.smithi157.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-16T05:29:26.823 DEBUG:teuthology.parallel:result is None 2024-09-16T05:29:26.889 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up ceph-volume (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-16T05:29:27.236 INFO:teuthology.orchestra.run.smithi086.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-16T05:29:27.241 DEBUG:teuthology.parallel:result is None 2024-09-16T05:29:27.292 INFO:teuthology.orchestra.run.smithi047.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-09-16T05:29:27.500 INFO:teuthology.orchestra.run.smithi047.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-16T05:29:27.653 INFO:teuthology.orchestra.run.smithi047.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-16T05:29:28.695 INFO:teuthology.orchestra.run.smithi047.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-09-16T05:29:29.348 INFO:teuthology.orchestra.run.smithi047.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-16T05:29:29.353 DEBUG:teuthology.parallel:result is None 2024-09-16T05:29:29.354 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=8921c8ef947807b717db041d85f0761b7914d5fc 2024-09-16T05:29:29.505 DEBUG:teuthology.orchestra.run.smithi047:> dpkg-query -W -f '${Version}' ceph 2024-09-16T05:29:29.525 INFO:teuthology.orchestra.run.smithi047.stdout:19.1.1-326-g8921c8ef-1jammy 2024-09-16T05:29:29.525 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-326-g8921c8ef-1jammy 2024-09-16T05:29:29.526 INFO:teuthology.task.install:The correct ceph version 19.1.1-326-g8921c8ef-1jammy is installed. 2024-09-16T05:29:29.527 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=8921c8ef947807b717db041d85f0761b7914d5fc 2024-09-16T05:29:29.671 DEBUG:teuthology.orchestra.run.smithi086:> dpkg-query -W -f '${Version}' ceph 2024-09-16T05:29:29.690 INFO:teuthology.orchestra.run.smithi086.stdout:19.1.1-326-g8921c8ef-1jammy 2024-09-16T05:29:29.690 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-326-g8921c8ef-1jammy 2024-09-16T05:29:29.690 INFO:teuthology.task.install:The correct ceph version 19.1.1-326-g8921c8ef-1jammy is installed. 2024-09-16T05:29:29.692 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=8921c8ef947807b717db041d85f0761b7914d5fc 2024-09-16T05:29:29.844 DEBUG:teuthology.orchestra.run.smithi157:> dpkg-query -W -f '${Version}' ceph 2024-09-16T05:29:29.864 INFO:teuthology.orchestra.run.smithi157.stdout:19.1.1-326-g8921c8ef-1jammy 2024-09-16T05:29:29.865 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-326-g8921c8ef-1jammy 2024-09-16T05:29:29.865 INFO:teuthology.task.install:The correct ceph version 19.1.1-326-g8921c8ef-1jammy is installed. 2024-09-16T05:29:29.866 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-16T05:29:29.867 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-09-16T05:29:29.867 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-16T05:29:29.882 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-09-16T05:29:29.882 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-16T05:29:29.896 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-09-16T05:29:29.896 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-16T05:29:29.921 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-16T05:29:29.921 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-09-16T05:29:29.921 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd of=/usr/bin/daemon-helper 2024-09-16T05:29:29.941 DEBUG:teuthology.orchestra.run.smithi047:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-16T05:29:30.002 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-09-16T05:29:30.002 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd of=/usr/bin/daemon-helper 2024-09-16T05:29:30.016 DEBUG:teuthology.orchestra.run.smithi086:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-16T05:29:30.069 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-09-16T05:29:30.069 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd of=/usr/bin/daemon-helper 2024-09-16T05:29:30.082 DEBUG:teuthology.orchestra.run.smithi157:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-16T05:29:30.135 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-16T05:29:30.136 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-09-16T05:29:30.136 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-16T05:29:30.183 DEBUG:teuthology.orchestra.run.smithi047:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-16T05:29:30.238 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-09-16T05:29:30.238 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-16T05:29:30.252 DEBUG:teuthology.orchestra.run.smithi086:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-16T05:29:30.306 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-09-16T05:29:30.306 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-16T05:29:30.319 DEBUG:teuthology.orchestra.run.smithi157:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-16T05:29:30.375 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-16T05:29:30.376 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-09-16T05:29:30.377 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd of=/usr/bin/stdin-killer 2024-09-16T05:29:30.391 DEBUG:teuthology.orchestra.run.smithi047:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-16T05:29:30.449 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-09-16T05:29:30.449 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd of=/usr/bin/stdin-killer 2024-09-16T05:29:30.463 DEBUG:teuthology.orchestra.run.smithi086:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-16T05:29:30.517 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-09-16T05:29:30.517 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd of=/usr/bin/stdin-killer 2024-09-16T05:29:30.531 DEBUG:teuthology.orchestra.run.smithi157:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-16T05:29:30.587 INFO:teuthology.run_tasks:Running task cephadm... 2024-09-16T05:29:30.688 INFO:tasks.cephadm:Config: {'conf': {'global': {'mon election default strategy': 1}, 'mgr': {'debug mgr': 20, 'debug ms': 1, 'mgr/cephadm/use_agent': False}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'debug ms': 1, 'debug osd': 20}}, 'flavor': 'default', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'MON_DOWN', 'mons down', 'mon down', 'out of quorum'], 'log-only-match': ['CEPHADM_'], 'sha1': '8921c8ef947807b717db041d85f0761b7914d5fc'} 2024-09-16T05:29:30.688 INFO:tasks.cephadm:Cluster image is quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc 2024-09-16T05:29:30.689 INFO:tasks.cephadm:Cluster fsid is a6097908-73ec-11ef-bceb-c7b262605968 2024-09-16T05:29:30.689 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-09-16T05:29:30.689 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '172.21.15.47', 'mon.b': '172.21.15.86', 'mon.c': '172.21.15.157'} 2024-09-16T05:29:30.689 INFO:tasks.cephadm:First mon is mon.a on smithi047 2024-09-16T05:29:30.689 INFO:tasks.cephadm:First mgr is a 2024-09-16T05:29:30.689 INFO:tasks.cephadm:Normalizing hostnames... 2024-09-16T05:29:30.689 DEBUG:teuthology.orchestra.run.smithi047:> sudo hostname $(hostname -s) 2024-09-16T05:29:30.704 DEBUG:teuthology.orchestra.run.smithi086:> sudo hostname $(hostname -s) 2024-09-16T05:29:30.721 DEBUG:teuthology.orchestra.run.smithi157:> sudo hostname $(hostname -s) 2024-09-16T05:29:30.736 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra 2024-09-16T05:29:30.736 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=8921c8ef947807b717db041d85f0761b7914d5fc 2024-09-16T05:29:30.884 INFO:tasks.cephadm:builder_project result: [{'status': 'ready', 'sha1': '8921c8ef947807b717db041d85f0761b7914d5fc', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=jammy,DIST=jammy,MACHINE_SIZE=gigantic/56081/', 'root_build_cause': 'SCMTRIGGER', 'version': '19.1.1-326-g8921c8ef', 'node_name': '172.21.5.38+adami08', 'job_name': 'ceph-dev-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=jammy,DIST=jammy,MACHINE_SIZE=gigantic', 'package_manager_version': '19.1.1-326-g8921c8ef-1jammy'}, 'url': 'https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default/', 'distro_codename': 'jammy', 'modified': '2024-09-15 16:01:53.073975', 'distro_version': '22.04', 'project': 'ceph', 'flavor': 'default', 'ref': 'squid', 'chacra_url': 'https://1.chacra.ceph.com/repos/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default/', 'archs': ['x86_64'], 'distro': 'ubuntu'}] 2024-09-16T05:29:31.029 INFO:tasks.util.chacra:got chacra host 1.chacra.ceph.com, ref squid, sha1 8921c8ef947807b717db041d85f0761b7914d5fc from https://shaman.ceph.com/api/search/?project=ceph&distros=ubuntu%2F22.04%2Fx86_64&flavor=default&sha1=8921c8ef947807b717db041d85f0761b7914d5fc 2024-09-16T05:29:31.030 INFO:tasks.cephadm:Discovered cachra url: https://1.chacra.ceph.com/binaries/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/x86_64/flavors/default/cephadm 2024-09-16T05:29:31.030 INFO:tasks.cephadm:Downloading cephadm from url: https://1.chacra.ceph.com/binaries/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/x86_64/flavors/default/cephadm 2024-09-16T05:29:31.030 DEBUG:teuthology.orchestra.run.smithi047:> curl --silent -L https://1.chacra.ceph.com/binaries/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-16T05:29:31.886 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-rw-r-- 1 ubuntu ubuntu 791881 Sep 16 05:29 /home/ubuntu/cephtest/cephadm 2024-09-16T05:29:31.886 DEBUG:teuthology.orchestra.run.smithi086:> curl --silent -L https://1.chacra.ceph.com/binaries/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-16T05:29:33.245 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-rw-r-- 1 ubuntu ubuntu 791881 Sep 16 05:29 /home/ubuntu/cephtest/cephadm 2024-09-16T05:29:33.245 DEBUG:teuthology.orchestra.run.smithi157:> curl --silent -L https://1.chacra.ceph.com/binaries/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-16T05:29:33.939 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-rw-r-- 1 ubuntu ubuntu 791881 Sep 16 05:29 /home/ubuntu/cephtest/cephadm 2024-09-16T05:29:33.940 DEBUG:teuthology.orchestra.run.smithi047:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-16T05:29:33.947 DEBUG:teuthology.orchestra.run.smithi086:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-16T05:29:33.955 DEBUG:teuthology.orchestra.run.smithi157:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-16T05:29:33.974 INFO:tasks.cephadm:Pulling image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc on all hosts... 2024-09-16T05:29:33.974 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc pull 2024-09-16T05:29:33.991 DEBUG:teuthology.orchestra.run.smithi086:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc pull 2024-09-16T05:29:33.999 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc pull 2024-09-16T05:29:34.177 INFO:teuthology.orchestra.run.smithi047.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc... 2024-09-16T05:29:34.180 INFO:teuthology.orchestra.run.smithi086.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc... 2024-09-16T05:29:34.191 INFO:teuthology.orchestra.run.smithi157.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc... 2024-09-16T05:30:29.889 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-16T05:30:29.890 INFO:teuthology.orchestra.run.smithi086.stdout: "ceph_version": "ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable)", 2024-09-16T05:30:29.890 INFO:teuthology.orchestra.run.smithi086.stdout: "image_id": "f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee", 2024-09-16T05:30:29.890 INFO:teuthology.orchestra.run.smithi086.stdout: "repo_digests": [ 2024-09-16T05:30:29.890 INFO:teuthology.orchestra.run.smithi086.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80" 2024-09-16T05:30:29.890 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-16T05:30:29.890 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-16T05:30:29.891 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-16T05:30:29.891 INFO:teuthology.orchestra.run.smithi047.stdout: "ceph_version": "ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable)", 2024-09-16T05:30:29.891 INFO:teuthology.orchestra.run.smithi047.stdout: "image_id": "f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee", 2024-09-16T05:30:29.891 INFO:teuthology.orchestra.run.smithi047.stdout: "repo_digests": [ 2024-09-16T05:30:29.891 INFO:teuthology.orchestra.run.smithi047.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80" 2024-09-16T05:30:29.891 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-16T05:30:29.891 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-16T05:30:36.668 INFO:teuthology.orchestra.run.smithi157.stdout:{ 2024-09-16T05:30:36.669 INFO:teuthology.orchestra.run.smithi157.stdout: "ceph_version": "ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable)", 2024-09-16T05:30:36.669 INFO:teuthology.orchestra.run.smithi157.stdout: "image_id": "f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee", 2024-09-16T05:30:36.669 INFO:teuthology.orchestra.run.smithi157.stdout: "repo_digests": [ 2024-09-16T05:30:36.669 INFO:teuthology.orchestra.run.smithi157.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80" 2024-09-16T05:30:36.669 INFO:teuthology.orchestra.run.smithi157.stdout: ] 2024-09-16T05:30:36.669 INFO:teuthology.orchestra.run.smithi157.stdout:} 2024-09-16T05:30:36.716 DEBUG:teuthology.orchestra.run.smithi047:> sudo mkdir -p /etc/ceph 2024-09-16T05:30:36.731 DEBUG:teuthology.orchestra.run.smithi086:> sudo mkdir -p /etc/ceph 2024-09-16T05:30:36.747 DEBUG:teuthology.orchestra.run.smithi157:> sudo mkdir -p /etc/ceph 2024-09-16T05:30:36.761 DEBUG:teuthology.orchestra.run.smithi047:> sudo chmod 777 /etc/ceph 2024-09-16T05:30:36.785 DEBUG:teuthology.orchestra.run.smithi086:> sudo chmod 777 /etc/ceph 2024-09-16T05:30:36.801 DEBUG:teuthology.orchestra.run.smithi157:> sudo chmod 777 /etc/ceph 2024-09-16T05:30:36.815 INFO:tasks.cephadm:Writing seed config... 2024-09-16T05:30:36.816 INFO:tasks.cephadm: override: [global] mon election default strategy = 1 2024-09-16T05:30:36.817 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-09-16T05:30:36.817 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-09-16T05:30:36.817 INFO:tasks.cephadm: override: [mgr] mgr/cephadm/use_agent = False 2024-09-16T05:30:36.817 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-09-16T05:30:36.817 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-09-16T05:30:36.817 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-09-16T05:30:36.817 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-09-16T05:30:36.817 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-09-16T05:30:36.818 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-09-16T05:30:36.818 DEBUG:teuthology.orchestra.run.smithi047:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-09-16T05:30:36.837 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = a6097908-73ec-11ef-bceb-c7b262605968 mon election default strategy = 1 [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = true bdev debug aio = true osd sloppy crc = true debug ms = 1 debug osd = 20 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false debug mgr = 20 debug ms = 1 mgr/cephadm/use_agent = False [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true 2024-09-16T05:30:36.837 DEBUG:teuthology.orchestra.run.smithi047:mon.a> sudo journalctl -f -n 0 -u ceph-a6097908-73ec-11ef-bceb-c7b262605968@mon.a.service 2024-09-16T05:30:36.882 DEBUG:teuthology.orchestra.run.smithi047:mgr.a> sudo journalctl -f -n 0 -u ceph-a6097908-73ec-11ef-bceb-c7b262605968@mgr.a.service 2024-09-16T05:30:36.930 INFO:tasks.cephadm:Bootstrapping... 2024-09-16T05:30:36.930 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc -v bootstrap --fsid a6097908-73ec-11ef-bceb-c7b262605968 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id a --orphan-initial-daemons --skip-monitoring-stack --mon-ip 172.21.15.47 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-09-16T05:30:37.159 INFO:teuthology.orchestra.run.smithi047.stdout:-------------------------------------------------------------------------------- 2024-09-16T05:30:37.159 INFO:teuthology.orchestra.run.smithi047.stdout:cephadm ['--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc', '-v', 'bootstrap', '--fsid', 'a6097908-73ec-11ef-bceb-c7b262605968', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-id', 'a', '--mgr-id', 'a', '--orphan-initial-daemons', '--skip-monitoring-stack', '--mon-ip', '172.21.15.47', '--skip-admin-label'] 2024-09-16T05:30:37.159 INFO:teuthology.orchestra.run.smithi047.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2024-09-16T05:30:37.160 INFO:teuthology.orchestra.run.smithi047.stdout:Verifying podman|docker is present... 2024-09-16T05:30:37.160 INFO:teuthology.orchestra.run.smithi047.stdout:Verifying lvm2 is present... 2024-09-16T05:30:37.160 INFO:teuthology.orchestra.run.smithi047.stdout:Verifying time synchronization is in place... 2024-09-16T05:30:37.165 INFO:teuthology.orchestra.run.smithi047.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-16T05:30:37.165 INFO:teuthology.orchestra.run.smithi047.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-16T05:30:37.169 INFO:teuthology.orchestra.run.smithi047.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-16T05:30:37.169 INFO:teuthology.orchestra.run.smithi047.stdout:systemctl: stdout inactive 2024-09-16T05:30:37.174 INFO:teuthology.orchestra.run.smithi047.stdout:Non-zero exit code 1 from systemctl is-enabled chronyd.service 2024-09-16T05:30:37.174 INFO:teuthology.orchestra.run.smithi047.stdout:systemctl: stderr Failed to get unit file state for chronyd.service: No such file or directory 2024-09-16T05:30:37.178 INFO:teuthology.orchestra.run.smithi047.stdout:Non-zero exit code 3 from systemctl is-active chronyd.service 2024-09-16T05:30:37.178 INFO:teuthology.orchestra.run.smithi047.stdout:systemctl: stdout inactive 2024-09-16T05:30:37.183 INFO:teuthology.orchestra.run.smithi047.stdout:Non-zero exit code 1 from systemctl is-enabled systemd-timesyncd.service 2024-09-16T05:30:37.183 INFO:teuthology.orchestra.run.smithi047.stdout:systemctl: stdout masked 2024-09-16T05:30:37.187 INFO:teuthology.orchestra.run.smithi047.stdout:Non-zero exit code 3 from systemctl is-active systemd-timesyncd.service 2024-09-16T05:30:37.187 INFO:teuthology.orchestra.run.smithi047.stdout:systemctl: stdout inactive 2024-09-16T05:30:37.190 INFO:teuthology.orchestra.run.smithi047.stdout:Non-zero exit code 1 from systemctl is-enabled ntpd.service 2024-09-16T05:30:37.190 INFO:teuthology.orchestra.run.smithi047.stdout:systemctl: stderr Failed to get unit file state for ntpd.service: No such file or directory 2024-09-16T05:30:37.194 INFO:teuthology.orchestra.run.smithi047.stdout:Non-zero exit code 3 from systemctl is-active ntpd.service 2024-09-16T05:30:37.194 INFO:teuthology.orchestra.run.smithi047.stdout:systemctl: stdout inactive 2024-09-16T05:30:37.198 INFO:teuthology.orchestra.run.smithi047.stdout:systemctl: stdout enabled 2024-09-16T05:30:37.202 INFO:teuthology.orchestra.run.smithi047.stdout:systemctl: stdout active 2024-09-16T05:30:37.202 INFO:teuthology.orchestra.run.smithi047.stdout:Unit ntp.service is enabled and running 2024-09-16T05:30:37.202 INFO:teuthology.orchestra.run.smithi047.stdout:Repeating the final host check... 2024-09-16T05:30:37.202 INFO:teuthology.orchestra.run.smithi047.stdout:docker (/usr/bin/docker) is present 2024-09-16T05:30:37.202 INFO:teuthology.orchestra.run.smithi047.stdout:systemctl is present 2024-09-16T05:30:37.203 INFO:teuthology.orchestra.run.smithi047.stdout:lvcreate is present 2024-09-16T05:30:37.206 INFO:teuthology.orchestra.run.smithi047.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-16T05:30:37.206 INFO:teuthology.orchestra.run.smithi047.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-16T05:30:37.209 INFO:teuthology.orchestra.run.smithi047.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-16T05:30:37.209 INFO:teuthology.orchestra.run.smithi047.stdout:systemctl: stdout inactive 2024-09-16T05:30:37.213 INFO:teuthology.orchestra.run.smithi047.stdout:Non-zero exit code 1 from systemctl is-enabled chronyd.service 2024-09-16T05:30:37.213 INFO:teuthology.orchestra.run.smithi047.stdout:systemctl: stderr Failed to get unit file state for chronyd.service: No such file or directory 2024-09-16T05:30:37.217 INFO:teuthology.orchestra.run.smithi047.stdout:Non-zero exit code 3 from systemctl is-active chronyd.service 2024-09-16T05:30:37.217 INFO:teuthology.orchestra.run.smithi047.stdout:systemctl: stdout inactive 2024-09-16T05:30:37.221 INFO:teuthology.orchestra.run.smithi047.stdout:Non-zero exit code 1 from systemctl is-enabled systemd-timesyncd.service 2024-09-16T05:30:37.222 INFO:teuthology.orchestra.run.smithi047.stdout:systemctl: stdout masked 2024-09-16T05:30:37.225 INFO:teuthology.orchestra.run.smithi047.stdout:Non-zero exit code 3 from systemctl is-active systemd-timesyncd.service 2024-09-16T05:30:37.225 INFO:teuthology.orchestra.run.smithi047.stdout:systemctl: stdout inactive 2024-09-16T05:30:37.229 INFO:teuthology.orchestra.run.smithi047.stdout:Non-zero exit code 1 from systemctl is-enabled ntpd.service 2024-09-16T05:30:37.229 INFO:teuthology.orchestra.run.smithi047.stdout:systemctl: stderr Failed to get unit file state for ntpd.service: No such file or directory 2024-09-16T05:30:37.232 INFO:teuthology.orchestra.run.smithi047.stdout:Non-zero exit code 3 from systemctl is-active ntpd.service 2024-09-16T05:30:37.233 INFO:teuthology.orchestra.run.smithi047.stdout:systemctl: stdout inactive 2024-09-16T05:30:37.237 INFO:teuthology.orchestra.run.smithi047.stdout:systemctl: stdout enabled 2024-09-16T05:30:37.241 INFO:teuthology.orchestra.run.smithi047.stdout:systemctl: stdout active 2024-09-16T05:30:37.241 INFO:teuthology.orchestra.run.smithi047.stdout:Unit ntp.service is enabled and running 2024-09-16T05:30:37.241 INFO:teuthology.orchestra.run.smithi047.stdout:Host looks OK 2024-09-16T05:30:37.241 INFO:teuthology.orchestra.run.smithi047.stdout:Cluster fsid: a6097908-73ec-11ef-bceb-c7b262605968 2024-09-16T05:30:37.241 INFO:teuthology.orchestra.run.smithi047.stdout:Acquiring lock 140142843460432 on /run/cephadm/a6097908-73ec-11ef-bceb-c7b262605968.lock 2024-09-16T05:30:37.241 INFO:teuthology.orchestra.run.smithi047.stdout:Lock 140142843460432 acquired on /run/cephadm/a6097908-73ec-11ef-bceb-c7b262605968.lock 2024-09-16T05:30:37.242 INFO:teuthology.orchestra.run.smithi047.stdout:Verifying IP 172.21.15.47 port 3300 ... 2024-09-16T05:30:37.242 INFO:teuthology.orchestra.run.smithi047.stdout:Verifying IP 172.21.15.47 port 6789 ... 2024-09-16T05:30:37.242 INFO:teuthology.orchestra.run.smithi047.stdout:Base mon IP(s) is [172.21.15.47:3300, 172.21.15.47:6789], mon addrv is [v2:172.21.15.47:3300,v1:172.21.15.47:6789] 2024-09-16T05:30:37.244 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/sbin/ip: stdout default via 172.21.15.254 dev ens1f0 2024-09-16T05:30:37.244 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/sbin/ip: stdout 172.17.0.0/16 dev docker0 proto kernel scope link src 172.17.0.1 linkdown 2024-09-16T05:30:37.244 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/sbin/ip: stdout 172.21.0.0/20 dev ens1f0 proto kernel scope link src 172.21.15.47 2024-09-16T05:30:37.246 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2024-09-16T05:30:37.246 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/sbin/ip: stdout fe80::/64 dev ens1f0 proto kernel metric 256 pref medium 2024-09-16T05:30:37.246 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev ens1f0 proto ra metric 1024 expires 1787sec hoplimit 64 pref medium 2024-09-16T05:30:37.249 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-09-16T05:30:37.249 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/sbin/ip: stdout inet6 ::1/128 scope host 2024-09-16T05:30:37.249 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-16T05:30:37.249 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/sbin/ip: stdout 3: ens1f0: mtu 1500 state UP qlen 1000 2024-09-16T05:30:37.249 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/sbin/ip: stdout inet6 fe80::ec4:7aff:febd:148e/64 scope link 2024-09-16T05:30:37.249 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-16T05:30:37.250 INFO:teuthology.orchestra.run.smithi047.stdout:Mon IP `172.21.15.47` is in CIDR network `172.21.0.0/20` 2024-09-16T05:30:37.250 INFO:teuthology.orchestra.run.smithi047.stdout:Mon IP `172.21.15.47` is in CIDR network `172.21.0.0/20` 2024-09-16T05:30:37.250 INFO:teuthology.orchestra.run.smithi047.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2024-09-16T05:30:37.250 INFO:teuthology.orchestra.run.smithi047.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-09-16T05:30:37.250 INFO:teuthology.orchestra.run.smithi047.stdout:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc... 2024-09-16T05:30:37.508 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/docker: stdout 8921c8ef947807b717db041d85f0761b7914d5fc: Pulling from ceph-ci/ceph 2024-09-16T05:30:37.508 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/docker: stdout Digest: sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 2024-09-16T05:30:37.508 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/docker: stdout Status: Image is up to date for quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc 2024-09-16T05:30:37.508 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/docker: stdout quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc 2024-09-16T05:30:38.969 INFO:teuthology.orchestra.run.smithi047.stdout:ceph: stdout ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable) 2024-09-16T05:30:38.969 INFO:teuthology.orchestra.run.smithi047.stdout:Ceph version: ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable) 2024-09-16T05:30:38.969 INFO:teuthology.orchestra.run.smithi047.stdout:Extracting ceph user uid/gid from container image... 2024-09-16T05:30:40.215 INFO:teuthology.orchestra.run.smithi047.stdout:stat: stdout 167 167 2024-09-16T05:30:40.216 INFO:teuthology.orchestra.run.smithi047.stdout:Creating initial keys... 2024-09-16T05:30:41.565 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-authtool: stdout AQCBwudmaiFaAxAAQktTHqlOLbgddv6hb6UyCg== 2024-09-16T05:30:42.913 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-authtool: stdout AQCCwudm2w+DGRAAUtAidcWvBc47nUZjs7EHjA== 2024-09-16T05:30:44.345 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-authtool: stdout AQCDwudmBbdwNBAA9w9+n5QdvHYXBn86BLz8KA== 2024-09-16T05:30:44.345 INFO:teuthology.orchestra.run.smithi047.stdout:Creating initial monmap... 2024-09-16T05:30:45.758 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-16T05:30:45.759 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = quincy 2024-09-16T05:30:45.759 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to a6097908-73ec-11ef-bceb-c7b262605968 2024-09-16T05:30:45.759 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-16T05:30:45.759 INFO:teuthology.orchestra.run.smithi047.stdout:monmaptool for a [v2:172.21.15.47:3300,v1:172.21.15.47:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-16T05:30:45.759 INFO:teuthology.orchestra.run.smithi047.stdout:setting min_mon_release = quincy 2024-09-16T05:30:45.759 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/monmaptool: set fsid to a6097908-73ec-11ef-bceb-c7b262605968 2024-09-16T05:30:45.759 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-16T05:30:45.759 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-16T05:30:45.759 INFO:teuthology.orchestra.run.smithi047.stdout:Creating mon... 2024-09-16T05:30:47.082 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-16T05:30:46.555+0000 7f7d65bdbc80 0 set uid:gid to 167:167 (ceph:ceph) 2024-09-16T05:30:47.083 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-16T05:30:46.555+0000 7f7d65bdbc80 1 imported monmap: 2024-09-16T05:30:47.083 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr epoch 0 2024-09-16T05:30:47.083 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr fsid a6097908-73ec-11ef-bceb-c7b262605968 2024-09-16T05:30:47.083 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr last_changed 2024-09-16T05:30:45.222800+0000 2024-09-16T05:30:47.083 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr created 2024-09-16T05:30:45.222800+0000 2024-09-16T05:30:47.083 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr min_mon_release 17 (quincy) 2024-09-16T05:30:47.083 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr election_strategy: 1 2024-09-16T05:30:47.083 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr 0: [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] mon.a 2024-09-16T05:30:47.083 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr 2024-09-16T05:30:47.083 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-16T05:30:46.555+0000 7f7d65bdbc80 0 /usr/bin/ceph-mon: set fsid to a6097908-73ec-11ef-bceb-c7b262605968 2024-09-16T05:30:47.083 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-16T05:30:46.559+0000 7f7d65bdbc80 4 rocksdb: RocksDB version: 7.9.2 2024-09-16T05:30:47.113 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr 2024-09-16T05:30:47.113 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-16T05:30:46.559+0000 7f7d65bdbc80 4 rocksdb: Git sha 0 2024-09-16T05:30:47.113 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-16T05:30:46.559+0000 7f7d65bdbc80 4 rocksdb: Compile date 2024-09-15 15:04:35 2024-09-16T05:30:47.113 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-16T05:30:46.559+0000 7f7d65bdbc80 4 rocksdb: DB SUMMARY 2024-09-16T05:30:47.113 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr 2024-09-16T05:30:47.113 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-16T05:30:46.559+0000 7f7d65bdbc80 4 rocksdb: DB Session ID: 04GOPGPJXG6ZLVHH90PR 2024-09-16T05:30:47.113 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr 2024-09-16T05:30:47.113 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-16T05:30:46.559+0000 7f7d65bdbc80 4 rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 0, files: 2024-09-16T05:30:47.113 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr 2024-09-16T05:30:47.114 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-16T05:30:46.559+0000 7f7d65bdbc80 4 rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 2024-09-16T05:30:47.114 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr 2024-09-16T05:30:47.114 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-16T05:30:46.559+0000 7f7d65bdbc80 4 rocksdb: Options.error_if_exists: 0 2024-09-16T05:30:47.114 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-16T05:30:46.559+0000 7f7d65bdbc80 4 rocksdb: Options.create_if_missing: 1 2024-09-16T05:30:47.114 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-16T05:30:46.559+0000 7f7d65bdbc80 4 rocksdb: Options.paranoid_checks: 1 2024-09-16T05:30:47.114 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-16T05:30:46.559+0000 7f7d65bdbc80 4 rocksdb: Options.flush_verify_memtable_count: 1 2024-09-16T05:30:47.114 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-16T05:30:46.559+0000 7f7d65bdbc80 4 rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-16T05:30:47.114 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-16T05:30:46.559+0000 7f7d65bdbc80 4 rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-16T05:30:47.114 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-16T05:30:46.559+0000 7f7d65bdbc80 4 rocksdb: Options.env: 0x558ac6ffb940 2024-09-16T05:30:47.114 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-16T05:30:46.559+0000 7f7d65bdbc80 4 rocksdb: Options.fs: PosixFileSystem 2024-09-16T05:30:47.114 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-16T05:30:46.559+0000 7f7d65bdbc80 4 rocksdb: Options.info_log: 0x558ac8a32bc0 2024-09-16T05:30:47.114 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-16T05:30:46.559+0000 7f7d65bdbc80 4 rocksdb: Options.max_file_opening_threads: 16 2024-09-16T05:30:47.114 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-16T05:30:46.559+0000 7f7d65bdbc80 4 rocksdb: Options.statistics: (nil) 2024-09-16T05:30:47.114 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-16T05:30:46.559+0000 7f7d65bdbc80 4 rocksdb: Options.use_fsync: 0 2024-09-16T05:30:47.115 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-16T05:30:46.559+0000 7f7d65bdbc80 4 rocksdb: Options.max_log_file_size: 0 2024-09-16T05:30:47.115 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-16T05:30:46.559+0000 7f7d65bdbc80 4 rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-16T05:30:47.115 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-16T05:30:46.559+0000 7f7d65bdbc80 4 rocksdb: Options.log_file_time_to_roll: 0 2024-09-16T05:30:47.115 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-16T05:30:46.559+0000 7f7d65bdbc80 4 rocksdb: Options.keep_log_file_num: 1000 2024-09-16T05:30:47.115 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-16T05:30:46.559+0000 7f7d65bdbc80 4 rocksdb: Options.recycle_log_file_num: 0 2024-09-16T05:30:47.115 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-16T05:30:46.559+0000 7f7d65bdbc80 4 rocksdb: Options.allow_fallocate: 1 2024-09-16T05:30:47.115 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-16T05:30:46.559+0000 7f7d65bdbc80 4 rocksdb: Options.allow_mmap_reads: 0 2024-09-16T05:30:47.115 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-16T05:30:46.559+0000 7f7d65bdbc80 4 rocksdb: Options.allow_mmap_writes: 0 2024-09-16T05:30:47.115 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-16T05:30:46.559+0000 7f7d65bdbc80 4 rocksdb: Options.use_direct_reads: 0 2024-09-16T05:30:47.115 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-16T05:30:46.559+0000 7f7d65bdbc80 4 rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-16T05:30:47.115 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-16T05:30:46.559+0000 7f7d65bdbc80 4 rocksdb: Options.create_missing_column_families: 0 2024-09-16T05:30:47.116 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-16T05:30:46.559+0000 7f7d65bdbc80 4 rocksdb: Options.db_log_dir: 2024-09-16T05:30:47.116 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-16T05:30:46.559+0000 7f7d65bdbc80 4 rocksdb: Options.wal_dir: 2024-09-16T05:30:47.116 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-16T05:30:46.559+0000 7f7d65bdbc80 4 rocksdb: Options.table_cache_numshardbits: 6 2024-09-16T05:30:47.116 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-16T05:30:46.559+0000 7f7d65bdbc80 4 rocksdb: Options.WAL_ttl_seconds: 0 2024-09-16T05:30:47.116 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-16T05:30:46.559+0000 7f7d65bdbc80 4 rocksdb: Options.WAL_size_limit_MB: 0 2024-09-16T05:30:47.116 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-16T05:30:46.559+0000 7f7d65bdbc80 4 rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-16T05:30:47.116 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-16T05:30:46.559+0000 7f7d65bdbc80 4 rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-16T05:30:47.116 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-16T05:30:46.559+0000 7f7d65bdbc80 4 rocksdb: Options.is_fd_close_on_exec: 1 2024-09-16T05:30:47.116 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-16T05:30:46.559+0000 7f7d65bdbc80 4 rocksdb: Options.advise_random_on_open: 1 2024-09-16T05:30:47.116 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-16T05:30:46.559+0000 7f7d65bdbc80 4 rocksdb: Options.db_write_buffer_size: 0 2024-09-16T05:30:47.116 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-16T05:30:46.559+0000 7f7d65bdbc80 4 rocksdb: Options.write_buffer_manager: 0x558ac8a394a0 2024-09-16T05:30:47.116 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-16T05:30:46.559+0000 7f7d65bdbc80 4 rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-16T05:30:47.116 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-16T05:30:46.559+0000 7f7d65bdbc80 4 rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-16T05:30:47.117 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-16T05:30:46.559+0000 7f7d65bdbc80 4 rocksdb: Options.use_adaptive_mutex: 0 2024-09-16T05:30:47.117 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-16T05:30:46.559+0000 7f7d65bdbc80 4 rocksdb: Options.rate_limiter: (nil) 2024-09-16T05:30:47.117 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-16T05:30:46.559+0000 7f7d65bdbc80 4 rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-16T05:30:47.117 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-16T05:30:46.559+0000 7f7d65bdbc80 4 rocksdb: Options.wal_recovery_mode: 2 2024-09-16T05:30:47.117 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-16T05:30:46.559+0000 7f7d65bdbc80 4 rocksdb: Options.enable_thread_tracking: 0 2024-09-16T05:30:47.117 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-16T05:30:46.559+0000 7f7d65bdbc80 4 rocksdb: Options.enable_pipelined_write: 0 2024-09-16T05:30:47.117 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-16T05:30:46.559+0000 7f7d65bdbc80 4 rocksdb: Options.unordered_write: 0 2024-09-16T05:30:47.117 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-16T05:30:46.559+0000 7f7d65bdbc80 4 rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-16T05:30:47.117 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-16T05:30:46.559+0000 7f7d65bdbc80 4 rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-16T05:30:47.117 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-16T05:30:46.559+0000 7f7d65bdbc80 4 rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-16T05:30:47.118 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-16T05:30:46.559+0000 7f7d65bdbc80 4 rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-16T05:30:47.118 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-16T05:30:46.559+0000 7f7d65bdbc80 4 rocksdb: Options.row_cache: None 2024-09-16T05:30:47.118 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-16T05:30:46.559+0000 7f7d65bdbc80 4 rocksdb: Options.wal_filter: None 2024-09-16T05:30:47.118 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-16T05:30:46.559+0000 7f7d65bdbc80 4 rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-16T05:30:47.118 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-16T05:30:46.559+0000 7f7d65bdbc80 4 rocksdb: Options.allow_ingest_behind: 0 2024-09-16T05:30:47.118 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-16T05:30:46.559+0000 7f7d65bdbc80 4 rocksdb: Options.two_write_queues: 0 2024-09-16T05:30:47.118 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-16T05:30:46.559+0000 7f7d65bdbc80 4 rocksdb: Options.manual_wal_flush: 0 2024-09-16T05:30:47.118 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-16T05:30:46.559+0000 7f7d65bdbc80 4 rocksdb: Options.wal_compression: 0 2024-09-16T05:30:47.118 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-16T05:30:46.559+0000 7f7d65bdbc80 4 rocksdb: Options.atomic_flush: 0 2024-09-16T05:30:47.118 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-16T05:30:46.559+0000 7f7d65bdbc80 4 rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-16T05:30:47.118 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-16T05:30:46.559+0000 7f7d65bdbc80 4 rocksdb: Options.persist_stats_to_disk: 0 2024-09-16T05:30:47.118 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-16T05:30:46.559+0000 7f7d65bdbc80 4 rocksdb: Options.write_dbid_to_manifest: 0 2024-09-16T05:30:47.118 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-16T05:30:46.559+0000 7f7d65bdbc80 4 rocksdb: Options.log_readahead_size: 0 2024-09-16T05:30:47.119 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-16T05:30:46.559+0000 7f7d65bdbc80 4 rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-16T05:30:47.119 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-16T05:30:46.559+0000 7f7d65bdbc80 4 rocksdb: Options.best_efforts_recovery: 0 2024-09-16T05:30:47.119 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-16T05:30:46.559+0000 7f7d65bdbc80 4 rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-16T05:30:47.119 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-16T05:30:46.559+0000 7f7d65bdbc80 4 rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-16T05:30:47.119 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-16T05:30:46.559+0000 7f7d65bdbc80 4 rocksdb: Options.allow_data_in_errors: 0 2024-09-16T05:30:47.119 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-16T05:30:46.559+0000 7f7d65bdbc80 4 rocksdb: Options.db_host_id: __hostname__ 2024-09-16T05:30:47.119 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-16T05:30:46.559+0000 7f7d65bdbc80 4 rocksdb: Options.enforce_single_del_contracts: true 2024-09-16T05:30:47.119 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-16T05:30:46.559+0000 7f7d65bdbc80 4 rocksdb: Options.max_background_jobs: 2 2024-09-16T05:30:47.119 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-16T05:30:46.559+0000 7f7d65bdbc80 4 rocksdb: Options.max_background_compactions: -1 2024-09-16T05:30:47.119 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-16T05:30:46.559+0000 7f7d65bdbc80 4 rocksdb: Options.max_subcompactions: 1 2024-09-16T05:30:47.119 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-16T05:30:46.559+0000 7f7d65bdbc80 4 rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-16T05:30:47.119 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-16T05:30:46.559+0000 7f7d65bdbc80 4 rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-16T05:30:47.119 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-16T05:30:46.559+0000 7f7d65bdbc80 4 rocksdb: Options.delayed_write_rate : 16777216 2024-09-16T05:30:47.120 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-16T05:30:46.559+0000 7f7d65bdbc80 4 rocksdb: Options.max_total_wal_size: 0 2024-09-16T05:30:47.120 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-16T05:30:46.559+0000 7f7d65bdbc80 4 rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-16T05:30:47.120 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-16T05:30:46.559+0000 7f7d65bdbc80 4 rocksdb: Options.stats_dump_period_sec: 600 2024-09-16T05:30:47.120 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-16T05:30:46.559+0000 7f7d65bdbc80 4 rocksdb: Options.stats_persist_period_sec: 600 2024-09-16T05:30:47.120 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-16T05:30:46.559+0000 7f7d65bdbc80 4 rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-16T05:30:47.120 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-16T05:30:46.559+0000 7f7d65bdbc80 4 rocksdb: Options.max_open_files: -1 2024-09-16T05:30:47.120 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-16T05:30:46.559+0000 7f7d65bdbc80 4 rocksdb: Options.bytes_per_sync: 0 2024-09-16T05:30:47.120 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-16T05:30:46.559+0000 7f7d65bdbc80 4 rocksdb: Options.wal_bytes_per_sync: 0 2024-09-16T05:30:47.120 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-16T05:30:46.559+0000 7f7d65bdbc80 4 rocksdb: Options.strict_bytes_per_sync: 0 2024-09-16T05:30:47.120 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-16T05:30:46.559+0000 7f7d65bdbc80 4 rocksdb: Options.compaction_readahead_size: 0 2024-09-16T05:30:47.120 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-16T05:30:46.559+0000 7f7d65bdbc80 4 rocksdb: Options.max_background_flushes: -1 2024-09-16T05:30:47.121 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-16T05:30:46.559+0000 7f7d65bdbc80 4 rocksdb: Compression algorithms supported: 2024-09-16T05:30:47.121 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-16T05:30:46.559+0000 7f7d65bdbc80 4 rocksdb: kZSTD supported: 0 2024-09-16T05:30:47.121 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-16T05:30:46.559+0000 7f7d65bdbc80 4 rocksdb: kXpressCompression supported: 0 2024-09-16T05:30:47.121 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-16T05:30:46.559+0000 7f7d65bdbc80 4 rocksdb: kBZip2Compression supported: 0 2024-09-16T05:30:47.121 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-16T05:30:46.559+0000 7f7d65bdbc80 4 rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-16T05:30:47.121 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-16T05:30:46.559+0000 7f7d65bdbc80 4 rocksdb: kLZ4Compression supported: 1 2024-09-16T05:30:47.121 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-16T05:30:46.559+0000 7f7d65bdbc80 4 rocksdb: kZlibCompression supported: 1 2024-09-16T05:30:47.121 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-16T05:30:46.559+0000 7f7d65bdbc80 4 rocksdb: kLZ4HCCompression supported: 1 2024-09-16T05:30:47.121 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-16T05:30:46.559+0000 7f7d65bdbc80 4 rocksdb: kSnappyCompression supported: 1 2024-09-16T05:30:47.121 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-16T05:30:46.559+0000 7f7d65bdbc80 4 rocksdb: Fast CRC32 supported: Supported on x86 2024-09-16T05:30:47.121 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-16T05:30:46.559+0000 7f7d65bdbc80 4 rocksdb: DMutex implementation: pthread_mutex_t 2024-09-16T05:30:47.121 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-16T05:30:46.559+0000 7f7d65bdbc80 4 rocksdb: [db/db_impl/db_impl_open.cc:317] Creating manifest 1 2024-09-16T05:30:47.121 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr 2024-09-16T05:30:47.121 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-16T05:30:46.559+0000 7f7d65bdbc80 4 rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000001 2024-09-16T05:30:47.122 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr 2024-09-16T05:30:47.122 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-16T05:30:46.559+0000 7f7d65bdbc80 4 rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-16T05:30:47.122 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr 2024-09-16T05:30:47.122 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-16T05:30:46.559+0000 7f7d65bdbc80 4 rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-16T05:30:47.122 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-16T05:30:46.559+0000 7f7d65bdbc80 4 rocksdb: Options.merge_operator: 2024-09-16T05:30:47.122 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-16T05:30:46.559+0000 7f7d65bdbc80 4 rocksdb: Options.compaction_filter: None 2024-09-16T05:30:47.122 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-16T05:30:46.559+0000 7f7d65bdbc80 4 rocksdb: Options.compaction_filter_factory: None 2024-09-16T05:30:47.122 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-16T05:30:46.559+0000 7f7d65bdbc80 4 rocksdb: Options.sst_partitioner_factory: None 2024-09-16T05:30:47.122 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-16T05:30:46.559+0000 7f7d65bdbc80 4 rocksdb: Options.memtable_factory: SkipListFactory 2024-09-16T05:30:47.122 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-16T05:30:46.559+0000 7f7d65bdbc80 4 rocksdb: Options.table_factory: BlockBasedTable 2024-09-16T05:30:47.122 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-16T05:30:46.559+0000 7f7d65bdbc80 4 rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x558ac8a32800) 2024-09-16T05:30:47.122 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr cache_index_and_filter_blocks: 1 2024-09-16T05:30:47.122 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr cache_index_and_filter_blocks_with_high_priority: 0 2024-09-16T05:30:47.122 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-16T05:30:47.123 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr pin_top_level_index_and_filter: 1 2024-09-16T05:30:47.123 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr index_type: 0 2024-09-16T05:30:47.123 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr data_block_index_type: 0 2024-09-16T05:30:47.123 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr index_shortening: 1 2024-09-16T05:30:47.123 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr data_block_hash_table_util_ratio: 0.750000 2024-09-16T05:30:47.123 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr checksum: 4 2024-09-16T05:30:47.123 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr no_block_cache: 0 2024-09-16T05:30:47.123 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr block_cache: 0x558ac8a1d1f0 2024-09-16T05:30:47.123 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr block_cache_name: BinnedLRUCache 2024-09-16T05:30:47.123 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr block_cache_options: 2024-09-16T05:30:47.123 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr capacity : 536870912 2024-09-16T05:30:47.123 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr num_shard_bits : 4 2024-09-16T05:30:47.123 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr strict_capacity_limit : 0 2024-09-16T05:30:47.123 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr high_pri_pool_ratio: 0.000 2024-09-16T05:30:47.123 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr block_cache_compressed: (nil) 2024-09-16T05:30:47.124 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr persistent_cache: (nil) 2024-09-16T05:30:47.124 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr block_size: 4096 2024-09-16T05:30:47.124 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr block_size_deviation: 10 2024-09-16T05:30:47.124 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr block_restart_interval: 16 2024-09-16T05:30:47.124 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr index_block_restart_interval: 1 2024-09-16T05:30:47.124 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr metadata_block_size: 4096 2024-09-16T05:30:47.124 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr partition_filters: 0 2024-09-16T05:30:47.124 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr use_delta_encoding: 1 2024-09-16T05:30:47.124 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr filter_policy: bloomfilter 2024-09-16T05:30:47.125 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr whole_key_filtering: 1 2024-09-16T05:30:47.125 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr verify_compression: 0 2024-09-16T05:30:47.125 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr read_amp_bytes_per_bit: 0 2024-09-16T05:30:47.125 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr format_version: 5 2024-09-16T05:30:47.125 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr enable_index_compression: 1 2024-09-16T05:30:47.125 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr block_align: 0 2024-09-16T05:30:47.125 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr max_auto_readahead_size: 262144 2024-09-16T05:30:47.125 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr prepopulate_block_cache: 0 2024-09-16T05:30:47.125 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr initial_auto_readahead_size: 8192 2024-09-16T05:30:47.125 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr num_file_reads_for_auto_readahead: 2 2024-09-16T05:30:47.126 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr 2024-09-16T05:30:47.126 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-16T05:30:46.559+0000 7f7d65bdbc80 4 rocksdb: Options.write_buffer_size: 33554432 2024-09-16T05:30:47.126 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-16T05:30:46.559+0000 7f7d65bdbc80 4 rocksdb: Options.max_write_buffer_number: 2 2024-09-16T05:30:47.126 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-16T05:30:46.559+0000 7f7d65bdbc80 4 rocksdb: Options.compression: NoCompression 2024-09-16T05:30:47.126 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-16T05:30:46.559+0000 7f7d65bdbc80 4 rocksdb: Options.bottommost_compression: Disabled 2024-09-16T05:30:47.126 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-16T05:30:46.559+0000 7f7d65bdbc80 4 rocksdb: Options.prefix_extractor: nullptr 2024-09-16T05:30:47.126 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-16T05:30:46.559+0000 7f7d65bdbc80 4 rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-16T05:30:47.126 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-16T05:30:46.559+0000 7f7d65bdbc80 4 rocksdb: Options.num_levels: 7 2024-09-16T05:30:47.126 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-16T05:30:46.559+0000 7f7d65bdbc80 4 rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-16T05:30:47.126 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-16T05:30:46.559+0000 7f7d65bdbc80 4 rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-16T05:30:47.126 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-16T05:30:46.559+0000 7f7d65bdbc80 4 rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-16T05:30:47.126 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-16T05:30:46.559+0000 7f7d65bdbc80 4 rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-16T05:30:47.126 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-16T05:30:46.559+0000 7f7d65bdbc80 4 rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-16T05:30:47.126 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-16T05:30:46.559+0000 7f7d65bdbc80 4 rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-16T05:30:47.126 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-16T05:30:46.559+0000 7f7d65bdbc80 4 rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-16T05:30:47.127 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-16T05:30:46.559+0000 7f7d65bdbc80 4 rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-16T05:30:47.127 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-16T05:30:46.559+0000 7f7d65bdbc80 4 rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-16T05:30:47.127 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-16T05:30:46.559+0000 7f7d65bdbc80 4 rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-16T05:30:47.127 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-16T05:30:46.559+0000 7f7d65bdbc80 4 rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-16T05:30:47.127 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-16T05:30:46.559+0000 7f7d65bdbc80 4 rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-16T05:30:47.127 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-16T05:30:46.559+0000 7f7d65bdbc80 4 rocksdb: Options.compression_opts.window_bits: -14 2024-09-16T05:30:47.127 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-16T05:30:46.559+0000 7f7d65bdbc80 4 rocksdb: Options.compression_opts.level: 32767 2024-09-16T05:30:47.127 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-16T05:30:46.559+0000 7f7d65bdbc80 4 rocksdb: Options.compression_opts.strategy: 0 2024-09-16T05:30:47.127 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-16T05:30:46.559+0000 7f7d65bdbc80 4 rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-16T05:30:47.127 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-16T05:30:46.559+0000 7f7d65bdbc80 4 rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-16T05:30:47.128 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-16T05:30:46.559+0000 7f7d65bdbc80 4 rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-16T05:30:47.128 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-16T05:30:46.559+0000 7f7d65bdbc80 4 rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-16T05:30:47.128 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-16T05:30:46.559+0000 7f7d65bdbc80 4 rocksdb: Options.compression_opts.enabled: false 2024-09-16T05:30:47.128 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-16T05:30:46.559+0000 7f7d65bdbc80 4 rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-16T05:30:47.128 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-16T05:30:46.559+0000 7f7d65bdbc80 4 rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-16T05:30:47.128 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-16T05:30:46.559+0000 7f7d65bdbc80 4 rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-16T05:30:47.128 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-16T05:30:46.559+0000 7f7d65bdbc80 4 rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-16T05:30:47.128 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-16T05:30:46.559+0000 7f7d65bdbc80 4 rocksdb: Options.target_file_size_base: 67108864 2024-09-16T05:30:47.128 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-16T05:30:46.559+0000 7f7d65bdbc80 4 rocksdb: Options.target_file_size_multiplier: 1 2024-09-16T05:30:47.128 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-16T05:30:46.559+0000 7f7d65bdbc80 4 rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-16T05:30:47.128 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-16T05:30:46.559+0000 7f7d65bdbc80 4 rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-16T05:30:47.128 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-16T05:30:46.559+0000 7f7d65bdbc80 4 rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-16T05:30:47.128 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-16T05:30:46.559+0000 7f7d65bdbc80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-16T05:30:47.129 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-16T05:30:46.559+0000 7f7d65bdbc80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-16T05:30:47.129 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-16T05:30:46.559+0000 7f7d65bdbc80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-16T05:30:47.129 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-16T05:30:46.559+0000 7f7d65bdbc80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-16T05:30:47.129 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-16T05:30:46.559+0000 7f7d65bdbc80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-16T05:30:47.129 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-16T05:30:46.559+0000 7f7d65bdbc80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-16T05:30:47.129 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-16T05:30:46.559+0000 7f7d65bdbc80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-16T05:30:47.129 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-16T05:30:46.559+0000 7f7d65bdbc80 4 rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-16T05:30:47.129 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-16T05:30:46.559+0000 7f7d65bdbc80 4 rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-16T05:30:47.129 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-16T05:30:46.559+0000 7f7d65bdbc80 4 rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-16T05:30:47.129 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-16T05:30:46.559+0000 7f7d65bdbc80 4 rocksdb: Options.arena_block_size: 1048576 2024-09-16T05:30:47.129 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-16T05:30:46.559+0000 7f7d65bdbc80 4 rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-16T05:30:47.129 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-16T05:30:46.559+0000 7f7d65bdbc80 4 rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-16T05:30:47.129 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-16T05:30:46.559+0000 7f7d65bdbc80 4 rocksdb: Options.disable_auto_compactions: 0 2024-09-16T05:30:47.129 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-16T05:30:46.559+0000 7f7d65bdbc80 4 rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-16T05:30:47.130 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-16T05:30:46.559+0000 7f7d65bdbc80 4 rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-16T05:30:47.130 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-16T05:30:46.559+0000 7f7d65bdbc80 4 rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-16T05:30:47.130 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-16T05:30:46.559+0000 7f7d65bdbc80 4 rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-16T05:30:47.130 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-16T05:30:46.559+0000 7f7d65bdbc80 4 rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-16T05:30:47.130 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-16T05:30:46.559+0000 7f7d65bdbc80 4 rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-16T05:30:47.130 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-16T05:30:46.559+0000 7f7d65bdbc80 4 rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-16T05:30:47.130 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-16T05:30:46.559+0000 7f7d65bdbc80 4 rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-16T05:30:47.130 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-16T05:30:46.559+0000 7f7d65bdbc80 4 rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-16T05:30:47.130 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-16T05:30:46.559+0000 7f7d65bdbc80 4 rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-16T05:30:47.130 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-16T05:30:46.559+0000 7f7d65bdbc80 4 rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-16T05:30:47.130 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-16T05:30:46.559+0000 7f7d65bdbc80 4 rocksdb: Options.inplace_update_support: 0 2024-09-16T05:30:47.130 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-16T05:30:46.559+0000 7f7d65bdbc80 4 rocksdb: Options.inplace_update_num_locks: 10000 2024-09-16T05:30:47.130 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-16T05:30:46.559+0000 7f7d65bdbc80 4 rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-16T05:30:47.130 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-16T05:30:46.559+0000 7f7d65bdbc80 4 rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-16T05:30:47.131 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-16T05:30:46.559+0000 7f7d65bdbc80 4 rocksdb: Options.memtable_huge_page_size: 0 2024-09-16T05:30:47.131 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-16T05:30:46.559+0000 7f7d65bdbc80 4 rocksdb: Options.bloom_locality: 0 2024-09-16T05:30:47.131 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-16T05:30:46.559+0000 7f7d65bdbc80 4 rocksdb: Options.max_successive_merges: 0 2024-09-16T05:30:47.131 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-16T05:30:46.559+0000 7f7d65bdbc80 4 rocksdb: Options.optimize_filters_for_hits: 0 2024-09-16T05:30:47.131 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-16T05:30:46.559+0000 7f7d65bdbc80 4 rocksdb: Options.paranoid_file_checks: 0 2024-09-16T05:30:47.131 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-16T05:30:46.559+0000 7f7d65bdbc80 4 rocksdb: Options.force_consistency_checks: 1 2024-09-16T05:30:47.131 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-16T05:30:46.559+0000 7f7d65bdbc80 4 rocksdb: Options.report_bg_io_stats: 0 2024-09-16T05:30:47.131 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-16T05:30:46.559+0000 7f7d65bdbc80 4 rocksdb: Options.ttl: 2592000 2024-09-16T05:30:47.131 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-16T05:30:46.559+0000 7f7d65bdbc80 4 rocksdb: Options.periodic_compaction_seconds: 0 2024-09-16T05:30:47.131 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-16T05:30:46.559+0000 7f7d65bdbc80 4 rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-16T05:30:47.131 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-16T05:30:46.559+0000 7f7d65bdbc80 4 rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-16T05:30:47.131 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-16T05:30:46.559+0000 7f7d65bdbc80 4 rocksdb: Options.enable_blob_files: false 2024-09-16T05:30:47.131 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-16T05:30:46.559+0000 7f7d65bdbc80 4 rocksdb: Options.min_blob_size: 0 2024-09-16T05:30:47.131 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-16T05:30:46.559+0000 7f7d65bdbc80 4 rocksdb: Options.blob_file_size: 268435456 2024-09-16T05:30:47.132 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-16T05:30:46.559+0000 7f7d65bdbc80 4 rocksdb: Options.blob_compression_type: NoCompression 2024-09-16T05:30:47.132 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-16T05:30:46.559+0000 7f7d65bdbc80 4 rocksdb: Options.enable_blob_garbage_collection: false 2024-09-16T05:30:47.132 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-16T05:30:46.559+0000 7f7d65bdbc80 4 rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-16T05:30:47.132 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-16T05:30:46.559+0000 7f7d65bdbc80 4 rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-16T05:30:47.132 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-16T05:30:46.559+0000 7f7d65bdbc80 4 rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-16T05:30:47.132 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-16T05:30:46.559+0000 7f7d65bdbc80 4 rocksdb: Options.blob_file_starting_level: 0 2024-09-16T05:30:47.132 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-16T05:30:46.559+0000 7f7d65bdbc80 4 rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-16T05:30:47.132 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-16T05:30:46.559+0000 7f7d65bdbc80 4 rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000001 succeeded,manifest_file_number is 1, next_file_number is 3, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-09-16T05:30:47.132 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr 2024-09-16T05:30:47.132 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-16T05:30:46.559+0000 7f7d65bdbc80 4 rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2024-09-16T05:30:47.132 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr 2024-09-16T05:30:47.132 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-16T05:30:46.559+0000 7f7d65bdbc80 4 rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: efd6a991-d4a0-4725-a66b-a47d33625778 2024-09-16T05:30:47.132 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr 2024-09-16T05:30:47.132 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-16T05:30:46.559+0000 7f7d65bdbc80 4 rocksdb: [db/version_set.cc:5047] Creating manifest 5 2024-09-16T05:30:47.133 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr 2024-09-16T05:30:47.133 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-16T05:30:46.563+0000 7f7d65bdbc80 4 rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x558ac8a4ae00 2024-09-16T05:30:47.133 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-16T05:30:46.563+0000 7f7d65bdbc80 4 rocksdb: DB pointer 0x558ac8b24000 2024-09-16T05:30:47.133 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-16T05:30:46.563+0000 7f7d5d366640 4 rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-16T05:30:47.133 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-16T05:30:46.563+0000 7f7d5d366640 4 rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-16T05:30:47.133 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr ** DB Stats ** 2024-09-16T05:30:47.133 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr Uptime(secs): 0.0 total, 0.0 interval 2024-09-16T05:30:47.133 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-16T05:30:47.133 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-16T05:30:47.133 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-16T05:30:47.133 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-16T05:30:47.133 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-16T05:30:47.133 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-16T05:30:47.134 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr 2024-09-16T05:30:47.134 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr ** Compaction Stats [default] ** 2024-09-16T05:30:47.134 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-16T05:30:47.134 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-16T05:30:47.134 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr Sum 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 2024-09-16T05:30:47.134 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 2024-09-16T05:30:47.135 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr 2024-09-16T05:30:47.135 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr ** Compaction Stats [default] ** 2024-09-16T05:30:47.135 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-16T05:30:47.135 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-16T05:30:47.135 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr 2024-09-16T05:30:47.135 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-16T05:30:47.135 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr 2024-09-16T05:30:47.135 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr Uptime(secs): 0.0 total, 0.0 interval 2024-09-16T05:30:47.135 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr Flush(GB): cumulative 0.000, interval 0.000 2024-09-16T05:30:47.136 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr AddFile(GB): cumulative 0.000, interval 0.000 2024-09-16T05:30:47.136 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr AddFile(Total Files): cumulative 0, interval 0 2024-09-16T05:30:47.136 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr AddFile(L0 Files): cumulative 0, interval 0 2024-09-16T05:30:47.136 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr AddFile(Keys): cumulative 0, interval 0 2024-09-16T05:30:47.136 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr Cumulative compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-16T05:30:47.136 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-16T05:30:47.136 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-16T05:30:47.136 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr Block cache BinnedLRUCache@0x558ac8a1d1f0#7 capacity: 512.00 MB usage: 0.00 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.1e-05 secs_since: 0 2024-09-16T05:30:47.136 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr Block cache entry stats(count,size,portion): Misc(1,0.00 KB,0%) 2024-09-16T05:30:47.137 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr 2024-09-16T05:30:47.137 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr ** File Read Latency Histogram By Level [default] ** 2024-09-16T05:30:47.137 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr 2024-09-16T05:30:47.137 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-16T05:30:46.563+0000 7f7d65bdbc80 4 rocksdb: [db/db_impl/db_impl.cc:496] Shutdown: canceling all background work 2024-09-16T05:30:47.137 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-16T05:30:46.563+0000 7f7d65bdbc80 4 rocksdb: [db/db_impl/db_impl.cc:704] Shutdown complete 2024-09-16T05:30:47.137 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-16T05:30:46.563+0000 7f7d65bdbc80 0 /usr/bin/ceph-mon: created monfs at /var/lib/ceph/mon/ceph-a for mon.a 2024-09-16T05:30:47.137 INFO:teuthology.orchestra.run.smithi047.stdout:create mon.a on 2024-09-16T05:30:47.367 INFO:teuthology.orchestra.run.smithi047.stdout:systemctl: stderr Removed /etc/systemd/system/multi-user.target.wants/ceph.target. 2024-09-16T05:30:47.558 INFO:teuthology.orchestra.run.smithi047.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /etc/systemd/system/ceph.target. 2024-09-16T05:30:47.779 INFO:teuthology.orchestra.run.smithi047.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-a6097908-73ec-11ef-bceb-c7b262605968.target -> /etc/systemd/system/ceph-a6097908-73ec-11ef-bceb-c7b262605968.target. 2024-09-16T05:30:47.779 INFO:teuthology.orchestra.run.smithi047.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-a6097908-73ec-11ef-bceb-c7b262605968.target -> /etc/systemd/system/ceph-a6097908-73ec-11ef-bceb-c7b262605968.target. 2024-09-16T05:30:48.073 INFO:teuthology.orchestra.run.smithi047.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-a6097908-73ec-11ef-bceb-c7b262605968@mon.a 2024-09-16T05:30:48.073 INFO:teuthology.orchestra.run.smithi047.stdout:systemctl: stderr Failed to reset failed state of unit ceph-a6097908-73ec-11ef-bceb-c7b262605968@mon.a.service: Unit ceph-a6097908-73ec-11ef-bceb-c7b262605968@mon.a.service not loaded. 2024-09-16T05:30:48.267 INFO:teuthology.orchestra.run.smithi047.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-a6097908-73ec-11ef-bceb-c7b262605968.target.wants/ceph-a6097908-73ec-11ef-bceb-c7b262605968@mon.a.service -> /etc/systemd/system/ceph-a6097908-73ec-11ef-bceb-c7b262605968@.service. 2024-09-16T05:30:48.277 INFO:teuthology.orchestra.run.smithi047.stdout:firewalld does not appear to be present 2024-09-16T05:30:48.277 INFO:teuthology.orchestra.run.smithi047.stdout:Not possible to enable service . firewalld.service is not available 2024-09-16T05:30:48.277 INFO:teuthology.orchestra.run.smithi047.stdout:Waiting for mon to start... 2024-09-16T05:30:48.277 INFO:teuthology.orchestra.run.smithi047.stdout:Waiting for mon... 2024-09-16T05:30:50.049 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:49 smithi047 bash[22266]: cluster 2024-09-16T05:30:49.813238+0000 mon.a (mon.0) 1 : cluster [INF] mon.a is new leader, mons a in quorum (ranks 0) 2024-09-16T05:30:50.596 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout cluster: 2024-09-16T05:30:50.597 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout id: a6097908-73ec-11ef-bceb-c7b262605968 2024-09-16T05:30:50.597 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2024-09-16T05:30:50.597 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout 2024-09-16T05:30:50.597 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout services: 2024-09-16T05:30:50.597 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum a (age 0.20239s) 2024-09-16T05:30:50.597 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2024-09-16T05:30:50.597 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2024-09-16T05:30:50.597 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout 2024-09-16T05:30:50.597 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout data: 2024-09-16T05:30:50.597 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2024-09-16T05:30:50.597 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2024-09-16T05:30:50.597 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2024-09-16T05:30:50.597 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout pgs: 2024-09-16T05:30:50.597 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout 2024-09-16T05:30:50.598 INFO:teuthology.orchestra.run.smithi047.stdout:mon is available 2024-09-16T05:30:50.598 INFO:teuthology.orchestra.run.smithi047.stdout:Assimilating anything we can from ceph.conf... 2024-09-16T05:30:51.090 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:50 smithi047 bash[22266]: cluster 2024-09-16T05:30:49.834804+0000 mon.a (mon.0) 2 : cluster [INF] mon.a is new leader, mons a in quorum (ranks 0) 2024-09-16T05:30:51.090 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:50 smithi047 bash[22266]: cluster 2024-09-16T05:30:49.835034+0000 mon.a (mon.0) 3 : cluster [DBG] monmap epoch 1 2024-09-16T05:30:51.090 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:50 smithi047 bash[22266]: cluster 2024-09-16T05:30:49.835051+0000 mon.a (mon.0) 4 : cluster [DBG] fsid a6097908-73ec-11ef-bceb-c7b262605968 2024-09-16T05:30:51.090 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:50 smithi047 bash[22266]: cluster 2024-09-16T05:30:49.835064+0000 mon.a (mon.0) 5 : cluster [DBG] last_changed 2024-09-16T05:30:45.222800+0000 2024-09-16T05:30:51.091 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:50 smithi047 bash[22266]: cluster 2024-09-16T05:30:49.835079+0000 mon.a (mon.0) 6 : cluster [DBG] created 2024-09-16T05:30:45.222800+0000 2024-09-16T05:30:51.091 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:50 smithi047 bash[22266]: cluster 2024-09-16T05:30:49.835093+0000 mon.a (mon.0) 7 : cluster [DBG] min_mon_release 19 (squid) 2024-09-16T05:30:51.091 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:50 smithi047 bash[22266]: cluster 2024-09-16T05:30:49.835106+0000 mon.a (mon.0) 8 : cluster [DBG] election_strategy: 1 2024-09-16T05:30:51.091 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:50 smithi047 bash[22266]: cluster 2024-09-16T05:30:49.835120+0000 mon.a (mon.0) 9 : cluster [DBG] 0: [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] mon.a 2024-09-16T05:30:51.091 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:50 smithi047 bash[22266]: cluster 2024-09-16T05:30:49.838062+0000 mon.a (mon.0) 10 : cluster [DBG] fsmap 2024-09-16T05:30:51.091 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:50 smithi047 bash[22266]: cluster 2024-09-16T05:30:49.840489+0000 mon.a (mon.0) 11 : cluster [DBG] osdmap e1: 0 total, 0 up, 0 in 2024-09-16T05:30:51.091 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:50 smithi047 bash[22266]: cluster 2024-09-16T05:30:49.841086+0000 mon.a (mon.0) 12 : cluster [DBG] mgrmap e1: no daemons active 2024-09-16T05:30:51.091 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:50 smithi047 bash[22266]: audit 2024-09-16T05:30:50.037124+0000 mon.a (mon.0) 13 : audit [DBG] from='client.? 172.21.15.47:0/2558174626' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-09-16T05:30:52.090 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:51 smithi047 bash[22266]: audit 2024-09-16T05:30:51.678050+0000 mon.a (mon.0) 14 : audit [INF] from='client.? 172.21.15.47:0/496584769' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-09-16T05:30:52.090 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:51 smithi047 bash[22266]: audit 2024-09-16T05:30:51.682922+0000 mon.a (mon.0) 15 : audit [INF] from='client.? 172.21.15.47:0/496584769' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-09-16T05:30:52.211 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout 2024-09-16T05:30:52.211 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout [global] 2024-09-16T05:30:52.211 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout fsid = a6097908-73ec-11ef-bceb-c7b262605968 2024-09-16T05:30:52.211 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.47:3300,v1:172.21.15.47:6789] 2024-09-16T05:30:52.211 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-16T05:30:52.211 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-16T05:30:52.212 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-16T05:30:52.212 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-16T05:30:52.212 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout 2024-09-16T05:30:52.212 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-16T05:30:52.212 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout mgr/cephadm/use_agent = False 2024-09-16T05:30:52.212 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-16T05:30:52.212 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout 2024-09-16T05:30:52.212 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout [osd] 2024-09-16T05:30:52.212 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-16T05:30:52.212 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-16T05:30:52.212 INFO:teuthology.orchestra.run.smithi047.stdout:Generating new minimal ceph.conf... 2024-09-16T05:30:53.590 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:53 smithi047 bash[22266]: audit 2024-09-16T05:30:53.206617+0000 mon.a (mon.0) 16 : audit [DBG] from='client.? 172.21.15.47:0/131136922' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T05:30:53.717 INFO:teuthology.orchestra.run.smithi047.stdout:Restarting the monitor... 2024-09-16T05:30:54.007 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:53 smithi047 systemd[1]: Stopping Ceph mon.a for a6097908-73ec-11ef-bceb-c7b262605968... 2024-09-16T05:30:54.007 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:53 smithi047 bash[22266]: debug 2024-09-16T05:30:53.839+0000 7f6a52a3e640 -1 received signal: Terminated from /sbin/docker-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-stderr=true (PID: 1) UID: 0 2024-09-16T05:30:54.007 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:53 smithi047 bash[22266]: debug 2024-09-16T05:30:53.839+0000 7f6a52a3e640 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2024-09-16T05:30:54.340 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:54 smithi047 bash[22648]: ceph-a6097908-73ec-11ef-bceb-c7b262605968-mon-a 2024-09-16T05:30:54.393 INFO:teuthology.orchestra.run.smithi047.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2024-09-16T05:30:54.840 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:54 smithi047 bash[22707]: Error response from daemon: No such container: ceph-a6097908-73ec-11ef-bceb-c7b262605968-mon-a 2024-09-16T05:30:54.840 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:54 smithi047 systemd[1]: ceph-a6097908-73ec-11ef-bceb-c7b262605968@mon.a.service: Deactivated successfully. 2024-09-16T05:30:54.840 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:54 smithi047 systemd[1]: Stopped Ceph mon.a for a6097908-73ec-11ef-bceb-c7b262605968. 2024-09-16T05:30:54.840 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:54 smithi047 systemd[1]: Started Ceph mon.a for a6097908-73ec-11ef-bceb-c7b262605968. 2024-09-16T05:30:55.801 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: debug 2024-09-16T05:30:55.779+0000 7efc17853c80 0 set uid:gid to 167:167 (ceph:ceph) 2024-09-16T05:30:55.801 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: debug 2024-09-16T05:30:55.779+0000 7efc17853c80 0 ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable), process ceph-mon, pid 7 2024-09-16T05:30:55.801 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: debug 2024-09-16T05:30:55.779+0000 7efc17853c80 0 pidfile_write: ignore empty --pid-file 2024-09-16T05:30:55.801 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: debug 2024-09-16T05:30:55.783+0000 7efc17853c80 0 load: jerasure load: lrc 2024-09-16T05:30:55.802 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: debug 2024-09-16T05:30:55.783+0000 7efc17853c80 4 rocksdb: RocksDB version: 7.9.2 2024-09-16T05:30:55.802 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: debug 2024-09-16T05:30:55.783+0000 7efc17853c80 4 rocksdb: Git sha 0 2024-09-16T05:30:55.802 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: debug 2024-09-16T05:30:55.783+0000 7efc17853c80 4 rocksdb: Compile date 2024-09-15 15:04:35 2024-09-16T05:30:55.802 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: debug 2024-09-16T05:30:55.783+0000 7efc17853c80 4 rocksdb: DB SUMMARY 2024-09-16T05:30:55.802 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: debug 2024-09-16T05:30:55.783+0000 7efc17853c80 4 rocksdb: DB Session ID: ZEAI2JSOYIP5BGJ3UVUE 2024-09-16T05:30:55.802 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: debug 2024-09-16T05:30:55.783+0000 7efc17853c80 4 rocksdb: CURRENT file: CURRENT 2024-09-16T05:30:55.802 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: debug 2024-09-16T05:30:55.783+0000 7efc17853c80 4 rocksdb: IDENTITY file: IDENTITY 2024-09-16T05:30:55.802 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: debug 2024-09-16T05:30:55.783+0000 7efc17853c80 4 rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2024-09-16T05:30:55.802 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: debug 2024-09-16T05:30:55.783+0000 7efc17853c80 4 rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000008.sst 2024-09-16T05:30:55.803 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: debug 2024-09-16T05:30:55.783+0000 7efc17853c80 4 rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000009.log size: 88769 ; 2024-09-16T05:30:55.803 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: debug 2024-09-16T05:30:55.783+0000 7efc17853c80 4 rocksdb: Options.error_if_exists: 0 2024-09-16T05:30:55.803 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: debug 2024-09-16T05:30:55.783+0000 7efc17853c80 4 rocksdb: Options.create_if_missing: 0 2024-09-16T05:30:55.803 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: debug 2024-09-16T05:30:55.783+0000 7efc17853c80 4 rocksdb: Options.paranoid_checks: 1 2024-09-16T05:30:55.803 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: debug 2024-09-16T05:30:55.783+0000 7efc17853c80 4 rocksdb: Options.flush_verify_memtable_count: 1 2024-09-16T05:30:55.803 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: debug 2024-09-16T05:30:55.783+0000 7efc17853c80 4 rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-16T05:30:55.804 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: debug 2024-09-16T05:30:55.783+0000 7efc17853c80 4 rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-16T05:30:55.804 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: debug 2024-09-16T05:30:55.783+0000 7efc17853c80 4 rocksdb: Options.env: 0x556b3f5d2940 2024-09-16T05:30:55.804 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: debug 2024-09-16T05:30:55.783+0000 7efc17853c80 4 rocksdb: Options.fs: PosixFileSystem 2024-09-16T05:30:55.804 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: debug 2024-09-16T05:30:55.783+0000 7efc17853c80 4 rocksdb: Options.info_log: 0x556b415c16e0 2024-09-16T05:30:55.805 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: debug 2024-09-16T05:30:55.783+0000 7efc17853c80 4 rocksdb: Options.max_file_opening_threads: 16 2024-09-16T05:30:55.805 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: debug 2024-09-16T05:30:55.783+0000 7efc17853c80 4 rocksdb: Options.statistics: (nil) 2024-09-16T05:30:55.805 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: debug 2024-09-16T05:30:55.783+0000 7efc17853c80 4 rocksdb: Options.use_fsync: 0 2024-09-16T05:30:55.805 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: debug 2024-09-16T05:30:55.783+0000 7efc17853c80 4 rocksdb: Options.max_log_file_size: 0 2024-09-16T05:30:55.805 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: debug 2024-09-16T05:30:55.783+0000 7efc17853c80 4 rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-16T05:30:55.805 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: debug 2024-09-16T05:30:55.783+0000 7efc17853c80 4 rocksdb: Options.log_file_time_to_roll: 0 2024-09-16T05:30:55.805 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: debug 2024-09-16T05:30:55.783+0000 7efc17853c80 4 rocksdb: Options.keep_log_file_num: 1000 2024-09-16T05:30:55.806 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: debug 2024-09-16T05:30:55.783+0000 7efc17853c80 4 rocksdb: Options.recycle_log_file_num: 0 2024-09-16T05:30:55.806 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: debug 2024-09-16T05:30:55.783+0000 7efc17853c80 4 rocksdb: Options.allow_fallocate: 1 2024-09-16T05:30:55.806 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: debug 2024-09-16T05:30:55.783+0000 7efc17853c80 4 rocksdb: Options.allow_mmap_reads: 0 2024-09-16T05:30:55.806 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: debug 2024-09-16T05:30:55.783+0000 7efc17853c80 4 rocksdb: Options.allow_mmap_writes: 0 2024-09-16T05:30:55.806 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: debug 2024-09-16T05:30:55.783+0000 7efc17853c80 4 rocksdb: Options.use_direct_reads: 0 2024-09-16T05:30:55.806 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: debug 2024-09-16T05:30:55.783+0000 7efc17853c80 4 rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-16T05:30:55.807 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: debug 2024-09-16T05:30:55.783+0000 7efc17853c80 4 rocksdb: Options.create_missing_column_families: 0 2024-09-16T05:30:55.807 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: debug 2024-09-16T05:30:55.783+0000 7efc17853c80 4 rocksdb: Options.db_log_dir: 2024-09-16T05:30:55.807 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: debug 2024-09-16T05:30:55.783+0000 7efc17853c80 4 rocksdb: Options.wal_dir: 2024-09-16T05:30:55.807 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: debug 2024-09-16T05:30:55.783+0000 7efc17853c80 4 rocksdb: Options.table_cache_numshardbits: 6 2024-09-16T05:30:55.807 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: debug 2024-09-16T05:30:55.783+0000 7efc17853c80 4 rocksdb: Options.WAL_ttl_seconds: 0 2024-09-16T05:30:55.807 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: debug 2024-09-16T05:30:55.783+0000 7efc17853c80 4 rocksdb: Options.WAL_size_limit_MB: 0 2024-09-16T05:30:55.807 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: debug 2024-09-16T05:30:55.783+0000 7efc17853c80 4 rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-16T05:30:55.807 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: debug 2024-09-16T05:30:55.783+0000 7efc17853c80 4 rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-16T05:30:55.808 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: debug 2024-09-16T05:30:55.783+0000 7efc17853c80 4 rocksdb: Options.is_fd_close_on_exec: 1 2024-09-16T05:30:55.808 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: debug 2024-09-16T05:30:55.783+0000 7efc17853c80 4 rocksdb: Options.advise_random_on_open: 1 2024-09-16T05:30:55.808 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: debug 2024-09-16T05:30:55.783+0000 7efc17853c80 4 rocksdb: Options.db_write_buffer_size: 0 2024-09-16T05:30:55.808 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: debug 2024-09-16T05:30:55.783+0000 7efc17853c80 4 rocksdb: Options.write_buffer_manager: 0x556b415d0dc0 2024-09-16T05:30:55.808 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: debug 2024-09-16T05:30:55.783+0000 7efc17853c80 4 rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-16T05:30:55.808 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: debug 2024-09-16T05:30:55.783+0000 7efc17853c80 4 rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-16T05:30:55.809 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: debug 2024-09-16T05:30:55.783+0000 7efc17853c80 4 rocksdb: Options.use_adaptive_mutex: 0 2024-09-16T05:30:55.809 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: debug 2024-09-16T05:30:55.783+0000 7efc17853c80 4 rocksdb: Options.rate_limiter: (nil) 2024-09-16T05:30:55.809 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: debug 2024-09-16T05:30:55.783+0000 7efc17853c80 4 rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-16T05:30:55.809 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: debug 2024-09-16T05:30:55.783+0000 7efc17853c80 4 rocksdb: Options.wal_recovery_mode: 2 2024-09-16T05:30:55.809 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: debug 2024-09-16T05:30:55.783+0000 7efc17853c80 4 rocksdb: Options.enable_thread_tracking: 0 2024-09-16T05:30:55.809 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: debug 2024-09-16T05:30:55.783+0000 7efc17853c80 4 rocksdb: Options.enable_pipelined_write: 0 2024-09-16T05:30:55.810 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: debug 2024-09-16T05:30:55.783+0000 7efc17853c80 4 rocksdb: Options.unordered_write: 0 2024-09-16T05:30:55.810 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: debug 2024-09-16T05:30:55.783+0000 7efc17853c80 4 rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-16T05:30:55.810 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: debug 2024-09-16T05:30:55.783+0000 7efc17853c80 4 rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-16T05:30:55.810 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: debug 2024-09-16T05:30:55.783+0000 7efc17853c80 4 rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-16T05:30:55.810 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: debug 2024-09-16T05:30:55.783+0000 7efc17853c80 4 rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-16T05:30:55.810 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: debug 2024-09-16T05:30:55.783+0000 7efc17853c80 4 rocksdb: Options.row_cache: None 2024-09-16T05:30:55.811 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: debug 2024-09-16T05:30:55.783+0000 7efc17853c80 4 rocksdb: Options.wal_filter: None 2024-09-16T05:30:55.811 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: debug 2024-09-16T05:30:55.783+0000 7efc17853c80 4 rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-16T05:30:55.811 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: debug 2024-09-16T05:30:55.783+0000 7efc17853c80 4 rocksdb: Options.allow_ingest_behind: 0 2024-09-16T05:30:55.811 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: debug 2024-09-16T05:30:55.783+0000 7efc17853c80 4 rocksdb: Options.two_write_queues: 0 2024-09-16T05:30:55.811 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: debug 2024-09-16T05:30:55.783+0000 7efc17853c80 4 rocksdb: Options.manual_wal_flush: 0 2024-09-16T05:30:55.811 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: debug 2024-09-16T05:30:55.783+0000 7efc17853c80 4 rocksdb: Options.wal_compression: 0 2024-09-16T05:30:55.811 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: debug 2024-09-16T05:30:55.783+0000 7efc17853c80 4 rocksdb: Options.atomic_flush: 0 2024-09-16T05:30:55.811 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: debug 2024-09-16T05:30:55.783+0000 7efc17853c80 4 rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-16T05:30:55.812 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: debug 2024-09-16T05:30:55.783+0000 7efc17853c80 4 rocksdb: Options.persist_stats_to_disk: 0 2024-09-16T05:30:55.812 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: debug 2024-09-16T05:30:55.783+0000 7efc17853c80 4 rocksdb: Options.write_dbid_to_manifest: 0 2024-09-16T05:30:55.812 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: debug 2024-09-16T05:30:55.783+0000 7efc17853c80 4 rocksdb: Options.log_readahead_size: 0 2024-09-16T05:30:55.812 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: debug 2024-09-16T05:30:55.783+0000 7efc17853c80 4 rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-16T05:30:55.812 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: debug 2024-09-16T05:30:55.783+0000 7efc17853c80 4 rocksdb: Options.best_efforts_recovery: 0 2024-09-16T05:30:55.812 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: debug 2024-09-16T05:30:55.783+0000 7efc17853c80 4 rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-16T05:30:55.812 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: debug 2024-09-16T05:30:55.783+0000 7efc17853c80 4 rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-16T05:30:55.812 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: debug 2024-09-16T05:30:55.783+0000 7efc17853c80 4 rocksdb: Options.allow_data_in_errors: 0 2024-09-16T05:30:55.812 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: debug 2024-09-16T05:30:55.783+0000 7efc17853c80 4 rocksdb: Options.db_host_id: __hostname__ 2024-09-16T05:30:55.812 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: debug 2024-09-16T05:30:55.783+0000 7efc17853c80 4 rocksdb: Options.enforce_single_del_contracts: true 2024-09-16T05:30:55.812 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: debug 2024-09-16T05:30:55.783+0000 7efc17853c80 4 rocksdb: Options.max_background_jobs: 2 2024-09-16T05:30:55.813 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: debug 2024-09-16T05:30:55.783+0000 7efc17853c80 4 rocksdb: Options.max_background_compactions: -1 2024-09-16T05:30:55.814 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: debug 2024-09-16T05:30:55.783+0000 7efc17853c80 4 rocksdb: Options.max_subcompactions: 1 2024-09-16T05:30:55.814 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: debug 2024-09-16T05:30:55.783+0000 7efc17853c80 4 rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-16T05:30:55.814 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: debug 2024-09-16T05:30:55.783+0000 7efc17853c80 4 rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-16T05:30:55.814 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: debug 2024-09-16T05:30:55.783+0000 7efc17853c80 4 rocksdb: Options.delayed_write_rate : 16777216 2024-09-16T05:30:55.814 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: debug 2024-09-16T05:30:55.783+0000 7efc17853c80 4 rocksdb: Options.max_total_wal_size: 0 2024-09-16T05:30:55.814 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: debug 2024-09-16T05:30:55.783+0000 7efc17853c80 4 rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-16T05:30:55.814 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: debug 2024-09-16T05:30:55.783+0000 7efc17853c80 4 rocksdb: Options.stats_dump_period_sec: 600 2024-09-16T05:30:55.815 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: debug 2024-09-16T05:30:55.783+0000 7efc17853c80 4 rocksdb: Options.stats_persist_period_sec: 600 2024-09-16T05:30:55.815 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: debug 2024-09-16T05:30:55.783+0000 7efc17853c80 4 rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-16T05:30:55.815 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: debug 2024-09-16T05:30:55.783+0000 7efc17853c80 4 rocksdb: Options.max_open_files: -1 2024-09-16T05:30:55.815 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: debug 2024-09-16T05:30:55.783+0000 7efc17853c80 4 rocksdb: Options.bytes_per_sync: 0 2024-09-16T05:30:55.815 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: debug 2024-09-16T05:30:55.783+0000 7efc17853c80 4 rocksdb: Options.wal_bytes_per_sync: 0 2024-09-16T05:30:55.815 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: debug 2024-09-16T05:30:55.783+0000 7efc17853c80 4 rocksdb: Options.strict_bytes_per_sync: 0 2024-09-16T05:30:55.815 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: debug 2024-09-16T05:30:55.783+0000 7efc17853c80 4 rocksdb: Options.compaction_readahead_size: 0 2024-09-16T05:30:55.815 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: debug 2024-09-16T05:30:55.783+0000 7efc17853c80 4 rocksdb: Options.max_background_flushes: -1 2024-09-16T05:30:55.815 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: debug 2024-09-16T05:30:55.783+0000 7efc17853c80 4 rocksdb: Compression algorithms supported: 2024-09-16T05:30:55.815 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: debug 2024-09-16T05:30:55.783+0000 7efc17853c80 4 rocksdb: kZSTD supported: 0 2024-09-16T05:30:55.815 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: debug 2024-09-16T05:30:55.783+0000 7efc17853c80 4 rocksdb: kXpressCompression supported: 0 2024-09-16T05:30:55.815 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: debug 2024-09-16T05:30:55.783+0000 7efc17853c80 4 rocksdb: kBZip2Compression supported: 0 2024-09-16T05:30:55.815 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: debug 2024-09-16T05:30:55.783+0000 7efc17853c80 4 rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-16T05:30:55.816 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: debug 2024-09-16T05:30:55.783+0000 7efc17853c80 4 rocksdb: kLZ4Compression supported: 1 2024-09-16T05:30:55.816 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: debug 2024-09-16T05:30:55.783+0000 7efc17853c80 4 rocksdb: kZlibCompression supported: 1 2024-09-16T05:30:55.816 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: debug 2024-09-16T05:30:55.783+0000 7efc17853c80 4 rocksdb: kLZ4HCCompression supported: 1 2024-09-16T05:30:55.816 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: debug 2024-09-16T05:30:55.783+0000 7efc17853c80 4 rocksdb: kSnappyCompression supported: 1 2024-09-16T05:30:55.816 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: debug 2024-09-16T05:30:55.783+0000 7efc17853c80 4 rocksdb: Fast CRC32 supported: Supported on x86 2024-09-16T05:30:55.816 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: debug 2024-09-16T05:30:55.783+0000 7efc17853c80 4 rocksdb: DMutex implementation: pthread_mutex_t 2024-09-16T05:30:55.816 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: debug 2024-09-16T05:30:55.783+0000 7efc17853c80 4 rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2024-09-16T05:30:55.816 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: debug 2024-09-16T05:30:55.783+0000 7efc17853c80 4 rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-16T05:30:55.816 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: debug 2024-09-16T05:30:55.783+0000 7efc17853c80 4 rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-16T05:30:55.816 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: debug 2024-09-16T05:30:55.783+0000 7efc17853c80 4 rocksdb: Options.merge_operator: 2024-09-16T05:30:55.816 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: debug 2024-09-16T05:30:55.783+0000 7efc17853c80 4 rocksdb: Options.compaction_filter: None 2024-09-16T05:30:55.817 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: debug 2024-09-16T05:30:55.783+0000 7efc17853c80 4 rocksdb: Options.compaction_filter_factory: None 2024-09-16T05:30:55.817 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: debug 2024-09-16T05:30:55.783+0000 7efc17853c80 4 rocksdb: Options.sst_partitioner_factory: None 2024-09-16T05:30:55.817 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: debug 2024-09-16T05:30:55.783+0000 7efc17853c80 4 rocksdb: Options.memtable_factory: SkipListFactory 2024-09-16T05:30:55.817 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: debug 2024-09-16T05:30:55.783+0000 7efc17853c80 4 rocksdb: Options.table_factory: BlockBasedTable 2024-09-16T05:30:55.817 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: debug 2024-09-16T05:30:55.783+0000 7efc17853c80 4 rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x556b415c1320) 2024-09-16T05:30:55.817 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: cache_index_and_filter_blocks: 1 2024-09-16T05:30:55.817 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-16T05:30:55.817 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-16T05:30:55.817 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: pin_top_level_index_and_filter: 1 2024-09-16T05:30:55.817 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: index_type: 0 2024-09-16T05:30:55.817 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: data_block_index_type: 0 2024-09-16T05:30:55.818 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: index_shortening: 1 2024-09-16T05:30:55.818 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: data_block_hash_table_util_ratio: 0.750000 2024-09-16T05:30:55.818 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: checksum: 4 2024-09-16T05:30:55.818 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: no_block_cache: 0 2024-09-16T05:30:55.818 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: block_cache: 0x556b415b71f0 2024-09-16T05:30:55.818 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: block_cache_name: BinnedLRUCache 2024-09-16T05:30:55.818 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: block_cache_options: 2024-09-16T05:30:55.819 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: capacity : 536870912 2024-09-16T05:30:55.819 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: num_shard_bits : 4 2024-09-16T05:30:55.819 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: strict_capacity_limit : 0 2024-09-16T05:30:55.819 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: high_pri_pool_ratio: 0.000 2024-09-16T05:30:55.819 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: block_cache_compressed: (nil) 2024-09-16T05:30:55.819 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: persistent_cache: (nil) 2024-09-16T05:30:55.819 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: block_size: 4096 2024-09-16T05:30:55.819 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: block_size_deviation: 10 2024-09-16T05:30:55.819 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: block_restart_interval: 16 2024-09-16T05:30:55.819 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: index_block_restart_interval: 1 2024-09-16T05:30:55.819 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: metadata_block_size: 4096 2024-09-16T05:30:55.819 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: partition_filters: 0 2024-09-16T05:30:55.819 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: use_delta_encoding: 1 2024-09-16T05:30:55.819 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: filter_policy: bloomfilter 2024-09-16T05:30:55.820 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: whole_key_filtering: 1 2024-09-16T05:30:55.820 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: verify_compression: 0 2024-09-16T05:30:55.820 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: read_amp_bytes_per_bit: 0 2024-09-16T05:30:55.820 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: format_version: 5 2024-09-16T05:30:55.820 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: enable_index_compression: 1 2024-09-16T05:30:55.820 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: block_align: 0 2024-09-16T05:30:55.820 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: max_auto_readahead_size: 262144 2024-09-16T05:30:55.820 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: prepopulate_block_cache: 0 2024-09-16T05:30:55.820 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: initial_auto_readahead_size: 8192 2024-09-16T05:30:55.820 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: num_file_reads_for_auto_readahead: 2 2024-09-16T05:30:55.820 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: debug 2024-09-16T05:30:55.783+0000 7efc17853c80 4 rocksdb: Options.write_buffer_size: 33554432 2024-09-16T05:30:55.820 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: debug 2024-09-16T05:30:55.783+0000 7efc17853c80 4 rocksdb: Options.max_write_buffer_number: 2 2024-09-16T05:30:55.821 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: debug 2024-09-16T05:30:55.783+0000 7efc17853c80 4 rocksdb: Options.compression: NoCompression 2024-09-16T05:30:55.821 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: debug 2024-09-16T05:30:55.783+0000 7efc17853c80 4 rocksdb: Options.bottommost_compression: Disabled 2024-09-16T05:30:55.821 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: debug 2024-09-16T05:30:55.783+0000 7efc17853c80 4 rocksdb: Options.prefix_extractor: nullptr 2024-09-16T05:30:55.821 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: debug 2024-09-16T05:30:55.783+0000 7efc17853c80 4 rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-16T05:30:55.821 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: debug 2024-09-16T05:30:55.783+0000 7efc17853c80 4 rocksdb: Options.num_levels: 7 2024-09-16T05:30:55.821 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: debug 2024-09-16T05:30:55.783+0000 7efc17853c80 4 rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-16T05:30:55.821 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: debug 2024-09-16T05:30:55.783+0000 7efc17853c80 4 rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-16T05:30:55.821 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: debug 2024-09-16T05:30:55.783+0000 7efc17853c80 4 rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-16T05:30:55.821 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: debug 2024-09-16T05:30:55.783+0000 7efc17853c80 4 rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-16T05:30:55.821 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: debug 2024-09-16T05:30:55.783+0000 7efc17853c80 4 rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-16T05:30:55.821 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: debug 2024-09-16T05:30:55.783+0000 7efc17853c80 4 rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-16T05:30:55.821 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: debug 2024-09-16T05:30:55.783+0000 7efc17853c80 4 rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-16T05:30:55.821 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: debug 2024-09-16T05:30:55.783+0000 7efc17853c80 4 rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-16T05:30:55.822 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: debug 2024-09-16T05:30:55.783+0000 7efc17853c80 4 rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-16T05:30:55.822 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: debug 2024-09-16T05:30:55.783+0000 7efc17853c80 4 rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-16T05:30:55.822 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: debug 2024-09-16T05:30:55.783+0000 7efc17853c80 4 rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-16T05:30:55.822 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: debug 2024-09-16T05:30:55.783+0000 7efc17853c80 4 rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-16T05:30:55.822 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: debug 2024-09-16T05:30:55.783+0000 7efc17853c80 4 rocksdb: Options.compression_opts.window_bits: -14 2024-09-16T05:30:55.822 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: debug 2024-09-16T05:30:55.783+0000 7efc17853c80 4 rocksdb: Options.compression_opts.level: 32767 2024-09-16T05:30:55.822 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: debug 2024-09-16T05:30:55.783+0000 7efc17853c80 4 rocksdb: Options.compression_opts.strategy: 0 2024-09-16T05:30:55.822 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: debug 2024-09-16T05:30:55.783+0000 7efc17853c80 4 rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-16T05:30:55.822 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: debug 2024-09-16T05:30:55.783+0000 7efc17853c80 4 rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-16T05:30:55.822 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: debug 2024-09-16T05:30:55.783+0000 7efc17853c80 4 rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-16T05:30:55.822 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: debug 2024-09-16T05:30:55.783+0000 7efc17853c80 4 rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-16T05:30:55.822 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: debug 2024-09-16T05:30:55.783+0000 7efc17853c80 4 rocksdb: Options.compression_opts.enabled: false 2024-09-16T05:30:55.822 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: debug 2024-09-16T05:30:55.783+0000 7efc17853c80 4 rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-16T05:30:55.822 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: debug 2024-09-16T05:30:55.783+0000 7efc17853c80 4 rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-16T05:30:55.823 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: debug 2024-09-16T05:30:55.783+0000 7efc17853c80 4 rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-16T05:30:55.823 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: debug 2024-09-16T05:30:55.783+0000 7efc17853c80 4 rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-16T05:30:55.823 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: debug 2024-09-16T05:30:55.783+0000 7efc17853c80 4 rocksdb: Options.target_file_size_base: 67108864 2024-09-16T05:30:55.823 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: debug 2024-09-16T05:30:55.783+0000 7efc17853c80 4 rocksdb: Options.target_file_size_multiplier: 1 2024-09-16T05:30:55.823 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: debug 2024-09-16T05:30:55.783+0000 7efc17853c80 4 rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-16T05:30:55.823 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: debug 2024-09-16T05:30:55.783+0000 7efc17853c80 4 rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-16T05:30:55.823 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: debug 2024-09-16T05:30:55.783+0000 7efc17853c80 4 rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-16T05:30:55.823 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: debug 2024-09-16T05:30:55.783+0000 7efc17853c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-16T05:30:55.823 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: debug 2024-09-16T05:30:55.783+0000 7efc17853c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-16T05:30:55.823 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: debug 2024-09-16T05:30:55.783+0000 7efc17853c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-16T05:30:55.823 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: debug 2024-09-16T05:30:55.783+0000 7efc17853c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-16T05:30:55.823 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: debug 2024-09-16T05:30:55.783+0000 7efc17853c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-16T05:30:55.824 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: debug 2024-09-16T05:30:55.783+0000 7efc17853c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-16T05:30:55.824 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: debug 2024-09-16T05:30:55.783+0000 7efc17853c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-16T05:30:55.824 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: debug 2024-09-16T05:30:55.783+0000 7efc17853c80 4 rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-16T05:30:55.824 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: debug 2024-09-16T05:30:55.783+0000 7efc17853c80 4 rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-16T05:30:55.824 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: debug 2024-09-16T05:30:55.783+0000 7efc17853c80 4 rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-16T05:30:55.824 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: debug 2024-09-16T05:30:55.783+0000 7efc17853c80 4 rocksdb: Options.arena_block_size: 1048576 2024-09-16T05:30:55.824 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: debug 2024-09-16T05:30:55.783+0000 7efc17853c80 4 rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-16T05:30:55.824 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: debug 2024-09-16T05:30:55.783+0000 7efc17853c80 4 rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-16T05:30:55.824 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: debug 2024-09-16T05:30:55.783+0000 7efc17853c80 4 rocksdb: Options.disable_auto_compactions: 0 2024-09-16T05:30:55.824 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: debug 2024-09-16T05:30:55.783+0000 7efc17853c80 4 rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-16T05:30:55.824 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: debug 2024-09-16T05:30:55.783+0000 7efc17853c80 4 rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-16T05:30:55.824 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: debug 2024-09-16T05:30:55.783+0000 7efc17853c80 4 rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-16T05:30:55.824 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: debug 2024-09-16T05:30:55.783+0000 7efc17853c80 4 rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-16T05:30:55.825 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: debug 2024-09-16T05:30:55.783+0000 7efc17853c80 4 rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-16T05:30:55.825 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: debug 2024-09-16T05:30:55.783+0000 7efc17853c80 4 rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-16T05:30:55.825 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: debug 2024-09-16T05:30:55.783+0000 7efc17853c80 4 rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-16T05:30:55.825 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: debug 2024-09-16T05:30:55.783+0000 7efc17853c80 4 rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-16T05:30:55.825 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: debug 2024-09-16T05:30:55.783+0000 7efc17853c80 4 rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-16T05:30:55.825 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: debug 2024-09-16T05:30:55.783+0000 7efc17853c80 4 rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-16T05:30:55.825 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: debug 2024-09-16T05:30:55.783+0000 7efc17853c80 4 rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-16T05:30:55.825 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: debug 2024-09-16T05:30:55.783+0000 7efc17853c80 4 rocksdb: Options.inplace_update_support: 0 2024-09-16T05:30:55.825 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: debug 2024-09-16T05:30:55.783+0000 7efc17853c80 4 rocksdb: Options.inplace_update_num_locks: 10000 2024-09-16T05:30:55.825 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: debug 2024-09-16T05:30:55.783+0000 7efc17853c80 4 rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-16T05:30:55.825 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: debug 2024-09-16T05:30:55.783+0000 7efc17853c80 4 rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-16T05:30:55.825 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: debug 2024-09-16T05:30:55.783+0000 7efc17853c80 4 rocksdb: Options.memtable_huge_page_size: 0 2024-09-16T05:30:55.825 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: debug 2024-09-16T05:30:55.783+0000 7efc17853c80 4 rocksdb: Options.bloom_locality: 0 2024-09-16T05:30:55.826 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: debug 2024-09-16T05:30:55.783+0000 7efc17853c80 4 rocksdb: Options.max_successive_merges: 0 2024-09-16T05:30:55.826 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: debug 2024-09-16T05:30:55.783+0000 7efc17853c80 4 rocksdb: Options.optimize_filters_for_hits: 0 2024-09-16T05:30:55.826 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: debug 2024-09-16T05:30:55.783+0000 7efc17853c80 4 rocksdb: Options.paranoid_file_checks: 0 2024-09-16T05:30:55.826 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: debug 2024-09-16T05:30:55.783+0000 7efc17853c80 4 rocksdb: Options.force_consistency_checks: 1 2024-09-16T05:30:55.826 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: debug 2024-09-16T05:30:55.783+0000 7efc17853c80 4 rocksdb: Options.report_bg_io_stats: 0 2024-09-16T05:30:55.826 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: debug 2024-09-16T05:30:55.783+0000 7efc17853c80 4 rocksdb: Options.ttl: 2592000 2024-09-16T05:30:55.826 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: debug 2024-09-16T05:30:55.783+0000 7efc17853c80 4 rocksdb: Options.periodic_compaction_seconds: 0 2024-09-16T05:30:55.826 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: debug 2024-09-16T05:30:55.783+0000 7efc17853c80 4 rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-16T05:30:55.826 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: debug 2024-09-16T05:30:55.783+0000 7efc17853c80 4 rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-16T05:30:55.826 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: debug 2024-09-16T05:30:55.783+0000 7efc17853c80 4 rocksdb: Options.enable_blob_files: false 2024-09-16T05:30:55.826 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: debug 2024-09-16T05:30:55.783+0000 7efc17853c80 4 rocksdb: Options.min_blob_size: 0 2024-09-16T05:30:55.826 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: debug 2024-09-16T05:30:55.783+0000 7efc17853c80 4 rocksdb: Options.blob_file_size: 268435456 2024-09-16T05:30:55.827 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: debug 2024-09-16T05:30:55.783+0000 7efc17853c80 4 rocksdb: Options.blob_compression_type: NoCompression 2024-09-16T05:30:55.827 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: debug 2024-09-16T05:30:55.783+0000 7efc17853c80 4 rocksdb: Options.enable_blob_garbage_collection: false 2024-09-16T05:30:55.827 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: debug 2024-09-16T05:30:55.783+0000 7efc17853c80 4 rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-16T05:30:55.827 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: debug 2024-09-16T05:30:55.783+0000 7efc17853c80 4 rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-16T05:30:55.827 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: debug 2024-09-16T05:30:55.783+0000 7efc17853c80 4 rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-16T05:30:55.827 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: debug 2024-09-16T05:30:55.783+0000 7efc17853c80 4 rocksdb: Options.blob_file_starting_level: 0 2024-09-16T05:30:55.827 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: debug 2024-09-16T05:30:55.783+0000 7efc17853c80 4 rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-16T05:30:55.827 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: debug 2024-09-16T05:30:55.787+0000 7efc17853c80 4 rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2024-09-16T05:30:55.827 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: debug 2024-09-16T05:30:55.787+0000 7efc17853c80 4 rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2024-09-16T05:30:55.827 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: debug 2024-09-16T05:30:55.787+0000 7efc17853c80 4 rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: efd6a991-d4a0-4725-a66b-a47d33625778 2024-09-16T05:30:55.827 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: debug 2024-09-16T05:30:55.787+0000 7efc17853c80 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1726464655790612, "job": 1, "event": "recovery_started", "wal_files": [9]} 2024-09-16T05:30:55.827 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: debug 2024-09-16T05:30:55.787+0000 7efc17853c80 4 rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2024-09-16T05:30:55.827 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: debug 2024-09-16T05:30:55.787+0000 7efc17853c80 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1726464655791640, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 85386, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 258, "table_properties": {"data_size": 83533, "index_size": 237, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 581, "raw_key_size": 10201, "raw_average_key_size": 47, "raw_value_size": 77740, "raw_average_value_size": 358, "num_data_blocks": 11, "num_entries": 217, "num_filter_entries": 217, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726464655, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "efd6a991-d4a0-4725-a66b-a47d33625778", "db_session_id": "ZEAI2JSOYIP5BGJ3UVUE", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2024-09-16T05:30:55.828 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: debug 2024-09-16T05:30:55.787+0000 7efc17853c80 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1726464655791753, "job": 1, "event": "recovery_finished"} 2024-09-16T05:30:55.828 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: debug 2024-09-16T05:30:55.787+0000 7efc17853c80 4 rocksdb: [db/version_set.cc:5047] Creating manifest 15 2024-09-16T05:30:55.828 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: debug 2024-09-16T05:30:55.787+0000 7efc17853c80 4 rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-16T05:30:55.828 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: debug 2024-09-16T05:30:55.787+0000 7efc17853c80 4 rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x556b415e2e00 2024-09-16T05:30:55.828 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: debug 2024-09-16T05:30:55.787+0000 7efc17853c80 4 rocksdb: DB pointer 0x556b416e2000 2024-09-16T05:30:55.828 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: debug 2024-09-16T05:30:55.787+0000 7efc0d61c640 4 rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-16T05:30:55.828 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: debug 2024-09-16T05:30:55.787+0000 7efc0d61c640 4 rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-16T05:30:55.828 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: ** DB Stats ** 2024-09-16T05:30:55.828 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: Uptime(secs): 0.0 total, 0.0 interval 2024-09-16T05:30:55.828 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-16T05:30:55.828 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-16T05:30:55.828 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-16T05:30:55.828 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-16T05:30:55.829 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-16T05:30:55.829 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-16T05:30:55.829 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: ** Compaction Stats [default] ** 2024-09-16T05:30:55.829 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-16T05:30:55.829 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-16T05:30:55.829 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: L0 2/0 85.25 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 127.2 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-16T05:30:55.829 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: Sum 2/0 85.25 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 127.2 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-16T05:30:55.829 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 127.2 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-16T05:30:55.829 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: ** Compaction Stats [default] ** 2024-09-16T05:30:55.829 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-16T05:30:55.829 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-16T05:30:55.829 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 127.2 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-16T05:30:55.829 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-16T05:30:55.830 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: Uptime(secs): 0.0 total, 0.0 interval 2024-09-16T05:30:55.830 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: Flush(GB): cumulative 0.000, interval 0.000 2024-09-16T05:30:55.830 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-16T05:30:55.830 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: AddFile(Total Files): cumulative 0, interval 0 2024-09-16T05:30:55.830 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: AddFile(L0 Files): cumulative 0, interval 0 2024-09-16T05:30:55.830 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: AddFile(Keys): cumulative 0, interval 0 2024-09-16T05:30:55.830 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: Cumulative compaction: 0.00 GB write, 19.86 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-16T05:30:55.830 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: Interval compaction: 0.00 GB write, 19.86 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-16T05:30:55.830 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-16T05:30:55.830 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: Block cache BinnedLRUCache@0x556b415b71f0#7 capacity: 512.00 MB usage: 1.19 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.4e-05 secs_since: 0 2024-09-16T05:30:55.830 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: Block cache entry stats(count,size,portion): FilterBlock(2,0.77 KB,0.000146031%) IndexBlock(2,0.42 KB,8.04663e-05%) Misc(1,0.00 KB,0%) 2024-09-16T05:30:55.830 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: ** File Read Latency Histogram By Level [default] ** 2024-09-16T05:30:55.830 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: debug 2024-09-16T05:30:55.787+0000 7efc17853c80 0 starting mon.a rank 0 at public addrs [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] at bind addrs [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid a6097908-73ec-11ef-bceb-c7b262605968 2024-09-16T05:30:55.831 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: debug 2024-09-16T05:30:55.791+0000 7efc17853c80 1 mon.a@-1(???) e1 preinit fsid a6097908-73ec-11ef-bceb-c7b262605968 2024-09-16T05:30:55.831 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: debug 2024-09-16T05:30:55.791+0000 7efc17853c80 0 mon.a@-1(???).mds e1 new map 2024-09-16T05:30:55.831 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: debug 2024-09-16T05:30:55.791+0000 7efc17853c80 0 mon.a@-1(???).mds e1 print_map 2024-09-16T05:30:55.831 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: e1 2024-09-16T05:30:55.831 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: btime 2024-09-16T05:30:49:835564+0000 2024-09-16T05:30:55.831 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: enable_multiple, ever_enabled_multiple: 1,1 2024-09-16T05:30:55.831 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-16T05:30:55.831 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: legacy client fscid: -1 2024-09-16T05:30:55.831 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: 2024-09-16T05:30:55.831 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: No filesystems configured 2024-09-16T05:30:55.831 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: debug 2024-09-16T05:30:55.791+0000 7efc17853c80 0 mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-16T05:30:55.831 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: debug 2024-09-16T05:30:55.791+0000 7efc17853c80 0 mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-16T05:30:55.831 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: debug 2024-09-16T05:30:55.791+0000 7efc17853c80 0 mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-16T05:30:55.831 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: debug 2024-09-16T05:30:55.791+0000 7efc17853c80 0 mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-16T05:30:55.831 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: debug 2024-09-16T05:30:55.791+0000 7efc17853c80 1 mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-09-16T05:30:56.019 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: cluster 2024-09-16T05:30:55.799802+0000 mon.a (mon.0) 1 : cluster [INF] mon.a is new leader, mons a in quorum (ranks 0) 2024-09-16T05:30:56.019 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: cluster 2024-09-16T05:30:55.799872+0000 mon.a (mon.0) 2 : cluster [DBG] monmap epoch 1 2024-09-16T05:30:56.019 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: cluster 2024-09-16T05:30:55.799884+0000 mon.a (mon.0) 3 : cluster [DBG] fsid a6097908-73ec-11ef-bceb-c7b262605968 2024-09-16T05:30:56.019 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: cluster 2024-09-16T05:30:55.799893+0000 mon.a (mon.0) 4 : cluster [DBG] last_changed 2024-09-16T05:30:45.222800+0000 2024-09-16T05:30:56.019 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: cluster 2024-09-16T05:30:55.799914+0000 mon.a (mon.0) 5 : cluster [DBG] created 2024-09-16T05:30:45.222800+0000 2024-09-16T05:30:56.019 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: cluster 2024-09-16T05:30:55.799923+0000 mon.a (mon.0) 6 : cluster [DBG] min_mon_release 19 (squid) 2024-09-16T05:30:56.020 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: cluster 2024-09-16T05:30:55.799930+0000 mon.a (mon.0) 7 : cluster [DBG] election_strategy: 1 2024-09-16T05:30:56.020 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: cluster 2024-09-16T05:30:55.799937+0000 mon.a (mon.0) 8 : cluster [DBG] 0: [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] mon.a 2024-09-16T05:30:56.020 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: cluster 2024-09-16T05:30:55.818881+0000 mon.a (mon.0) 9 : cluster [DBG] fsmap 2024-09-16T05:30:56.020 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: cluster 2024-09-16T05:30:55.818925+0000 mon.a (mon.0) 10 : cluster [DBG] osdmap e1: 0 total, 0 up, 0 in 2024-09-16T05:30:56.020 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:55 smithi047 bash[22744]: cluster 2024-09-16T05:30:55.819361+0000 mon.a (mon.0) 11 : cluster [DBG] mgrmap e1: no daemons active 2024-09-16T05:30:56.536 INFO:teuthology.orchestra.run.smithi047.stdout:Wrote config to /etc/ceph/ceph.conf 2024-09-16T05:30:56.563 INFO:teuthology.orchestra.run.smithi047.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-09-16T05:30:56.564 INFO:teuthology.orchestra.run.smithi047.stdout:Creating mgr... 2024-09-16T05:30:56.564 INFO:teuthology.orchestra.run.smithi047.stdout:Verifying port 0.0.0.0:9283 ... 2024-09-16T05:30:56.564 INFO:teuthology.orchestra.run.smithi047.stdout:Verifying port 0.0.0.0:8765 ... 2024-09-16T05:30:56.926 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:56 smithi047 systemd[1]: /etc/systemd/system/ceph-a6097908-73ec-11ef-bceb-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-16T05:30:56.935 INFO:teuthology.orchestra.run.smithi047.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-a6097908-73ec-11ef-bceb-c7b262605968@mgr.a 2024-09-16T05:30:56.935 INFO:teuthology.orchestra.run.smithi047.stdout:systemctl: stderr Failed to reset failed state of unit ceph-a6097908-73ec-11ef-bceb-c7b262605968@mgr.a.service: Unit ceph-a6097908-73ec-11ef-bceb-c7b262605968@mgr.a.service not loaded. 2024-09-16T05:30:57.136 INFO:teuthology.orchestra.run.smithi047.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-a6097908-73ec-11ef-bceb-c7b262605968.target.wants/ceph-a6097908-73ec-11ef-bceb-c7b262605968@mgr.a.service -> /etc/systemd/system/ceph-a6097908-73ec-11ef-bceb-c7b262605968@.service. 2024-09-16T05:30:57.144 INFO:teuthology.orchestra.run.smithi047.stdout:firewalld does not appear to be present 2024-09-16T05:30:57.145 INFO:teuthology.orchestra.run.smithi047.stdout:Not possible to enable service . firewalld.service is not available 2024-09-16T05:30:57.145 INFO:teuthology.orchestra.run.smithi047.stdout:firewalld does not appear to be present 2024-09-16T05:30:57.145 INFO:teuthology.orchestra.run.smithi047.stdout:Not possible to open ports <[9283, 8765]>. firewalld.service is not available 2024-09-16T05:30:57.145 INFO:teuthology.orchestra.run.smithi047.stdout:Waiting for mgr to start... 2024-09-16T05:30:57.145 INFO:teuthology.orchestra.run.smithi047.stdout:Waiting for mgr... 2024-09-16T05:30:57.277 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:57 smithi047 bash[22744]: audit 2024-09-16T05:30:56.009753+0000 mon.a (mon.0) 12 : audit [INF] from='client.? 172.21.15.47:0/481820763' entity='client.admin' 2024-09-16T05:30:57.278 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:57 smithi047 systemd[1]: /etc/systemd/system/ceph-a6097908-73ec-11ef-bceb-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-16T05:30:57.278 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 05:30:57 smithi047 systemd[1]: Started Ceph mgr.a for a6097908-73ec-11ef-bceb-c7b262605968. 2024-09-16T05:30:58.839 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 05:30:58 smithi047 bash[22994]: debug 2024-09-16T05:30:58.727+0000 7f5246e04040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-16T05:30:59.276 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:30:58 smithi047 bash[22744]: audit 2024-09-16T05:30:58.857657+0000 mon.a (mon.0) 13 : audit [DBG] from='client.? 172.21.15.47:0/3533704326' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-16T05:30:59.409 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout 2024-09-16T05:30:59.410 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout { 2024-09-16T05:30:59.410 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "fsid": "a6097908-73ec-11ef-bceb-c7b262605968", 2024-09-16T05:30:59.410 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "health": { 2024-09-16T05:30:59.410 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-16T05:30:59.410 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-16T05:30:59.410 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-16T05:30:59.410 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout }, 2024-09-16T05:30:59.410 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-16T05:30:59.410 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-16T05:30:59.410 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout 0 2024-09-16T05:30:59.410 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout ], 2024-09-16T05:30:59.410 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-16T05:30:59.411 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "a" 2024-09-16T05:30:59.411 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout ], 2024-09-16T05:30:59.411 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "quorum_age": 3, 2024-09-16T05:30:59.411 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-16T05:30:59.411 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-16T05:30:59.411 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-16T05:30:59.411 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-16T05:30:59.411 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout }, 2024-09-16T05:30:59.411 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-16T05:30:59.411 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-16T05:30:59.411 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-16T05:30:59.411 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-16T05:30:59.411 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-16T05:30:59.411 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-16T05:30:59.411 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-16T05:30:59.412 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-16T05:30:59.415 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout }, 2024-09-16T05:30:59.415 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-16T05:30:59.415 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-16T05:30:59.415 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-16T05:30:59.415 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-16T05:30:59.415 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-16T05:30:59.415 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-16T05:30:59.415 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-16T05:30:59.415 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-16T05:30:59.415 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-16T05:30:59.415 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout }, 2024-09-16T05:30:59.416 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-16T05:30:59.416 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-16T05:30:59.416 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "btime": "2024-09-16T05:30:49:835564+0000", 2024-09-16T05:30:59.416 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-16T05:30:59.416 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-16T05:30:59.416 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout }, 2024-09-16T05:30:59.416 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-16T05:30:59.416 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-16T05:30:59.416 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-16T05:30:59.416 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-16T05:30:59.416 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-16T05:30:59.416 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-16T05:30:59.416 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "restful" 2024-09-16T05:30:59.417 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout ], 2024-09-16T05:30:59.417 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-16T05:30:59.417 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout }, 2024-09-16T05:30:59.417 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-16T05:30:59.417 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-16T05:30:59.417 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "modified": "2024-09-16T05:30:49.836614+0000", 2024-09-16T05:30:59.417 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-16T05:30:59.417 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout }, 2024-09-16T05:30:59.417 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-16T05:30:59.417 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout } 2024-09-16T05:30:59.417 INFO:teuthology.orchestra.run.smithi047.stdout:mgr not available, waiting (1/15)... 2024-09-16T05:31:00.339 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 05:30:59 smithi047 bash[22994]: debug 2024-09-16T05:30:59.983+0000 7f5246e04040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-16T05:31:00.340 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 05:31:00 smithi047 bash[22994]: debug 2024-09-16T05:31:00.051+0000 7f5246e04040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-16T05:31:00.340 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 05:31:00 smithi047 bash[22994]: debug 2024-09-16T05:31:00.211+0000 7f5246e04040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-16T05:31:01.234 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 05:31:00 smithi047 bash[22994]: debug 2024-09-16T05:31:00.891+0000 7f5246e04040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-16T05:31:01.235 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 05:31:00 smithi047 bash[22994]: debug 2024-09-16T05:31:00.967+0000 7f5246e04040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-16T05:31:01.235 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 05:31:01 smithi047 bash[22994]: debug 2024-09-16T05:31:01.035+0000 7f5246e04040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-16T05:31:01.235 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 05:31:01 smithi047 bash[22994]: debug 2024-09-16T05:31:01.231+0000 7f5246e04040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-16T05:31:01.508 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 05:31:01 smithi047 bash[22994]: debug 2024-09-16T05:31:01.311+0000 7f5246e04040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-16T05:31:01.508 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 05:31:01 smithi047 bash[22994]: debug 2024-09-16T05:31:01.383+0000 7f5246e04040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-16T05:31:01.839 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 05:31:01 smithi047 bash[22994]: debug 2024-09-16T05:31:01.651+0000 7f5246e04040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-16T05:31:01.840 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 05:31:01 smithi047 bash[22994]: debug 2024-09-16T05:31:01.719+0000 7f5246e04040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-16T05:31:02.274 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 05:31:01 smithi047 bash[22994]: debug 2024-09-16T05:31:01.927+0000 7f5246e04040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-16T05:31:02.274 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 05:31:02 smithi047 bash[22994]: debug 2024-09-16T05:31:02.007+0000 7f5246e04040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-16T05:31:02.589 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 05:31:02 smithi047 bash[22994]: debug 2024-09-16T05:31:02.271+0000 7f5246e04040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-16T05:31:02.590 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 05:31:02 smithi047 bash[22994]: debug 2024-09-16T05:31:02.463+0000 7f5246e04040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-16T05:31:02.912 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:31:02 smithi047 bash[22744]: audit 2024-09-16T05:31:02.632897+0000 mon.a (mon.0) 14 : audit [DBG] from='client.? 172.21.15.47:0/4149143483' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-16T05:31:02.912 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 05:31:02 smithi047 bash[22994]: debug 2024-09-16T05:31:02.635+0000 7f5246e04040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-16T05:31:02.913 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 05:31:02 smithi047 bash[22994]: debug 2024-09-16T05:31:02.719+0000 7f5246e04040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-16T05:31:03.222 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout 2024-09-16T05:31:03.223 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout { 2024-09-16T05:31:03.223 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "fsid": "a6097908-73ec-11ef-bceb-c7b262605968", 2024-09-16T05:31:03.223 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "health": { 2024-09-16T05:31:03.223 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-16T05:31:03.223 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-16T05:31:03.223 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-16T05:31:03.223 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout }, 2024-09-16T05:31:03.223 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-16T05:31:03.223 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-16T05:31:03.223 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout 0 2024-09-16T05:31:03.223 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout ], 2024-09-16T05:31:03.223 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-16T05:31:03.223 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "a" 2024-09-16T05:31:03.224 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout ], 2024-09-16T05:31:03.224 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "quorum_age": 6, 2024-09-16T05:31:03.224 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-16T05:31:03.224 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-16T05:31:03.224 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-16T05:31:03.224 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-16T05:31:03.224 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout }, 2024-09-16T05:31:03.224 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-16T05:31:03.224 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-16T05:31:03.224 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-16T05:31:03.224 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-16T05:31:03.224 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-16T05:31:03.224 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-16T05:31:03.224 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-16T05:31:03.225 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-16T05:31:03.228 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout }, 2024-09-16T05:31:03.228 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-16T05:31:03.228 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-16T05:31:03.228 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-16T05:31:03.228 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-16T05:31:03.228 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-16T05:31:03.228 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-16T05:31:03.228 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-16T05:31:03.228 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-16T05:31:03.229 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-16T05:31:03.229 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout }, 2024-09-16T05:31:03.229 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-16T05:31:03.229 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-16T05:31:03.229 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "btime": "2024-09-16T05:30:49:835564+0000", 2024-09-16T05:31:03.229 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-16T05:31:03.229 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-16T05:31:03.229 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout }, 2024-09-16T05:31:03.229 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-16T05:31:03.229 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-16T05:31:03.229 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-16T05:31:03.229 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-16T05:31:03.229 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-16T05:31:03.229 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-16T05:31:03.230 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "restful" 2024-09-16T05:31:03.230 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout ], 2024-09-16T05:31:03.230 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-16T05:31:03.230 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout }, 2024-09-16T05:31:03.230 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-16T05:31:03.230 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-16T05:31:03.230 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "modified": "2024-09-16T05:30:49.836614+0000", 2024-09-16T05:31:03.230 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-16T05:31:03.230 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout }, 2024-09-16T05:31:03.230 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-16T05:31:03.230 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout } 2024-09-16T05:31:03.230 INFO:teuthology.orchestra.run.smithi047.stdout:mgr not available, waiting (2/15)... 2024-09-16T05:31:04.066 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 05:31:02 smithi047 bash[22994]: debug 2024-09-16T05:31:02.907+0000 7f5246e04040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-16T05:31:04.066 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 05:31:03 smithi047 bash[22994]: debug 2024-09-16T05:31:03.751+0000 7f5246e04040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-16T05:31:04.066 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 05:31:03 smithi047 bash[22994]: debug 2024-09-16T05:31:03.827+0000 7f5246e04040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-16T05:31:04.339 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 05:31:04 smithi047 bash[22994]: debug 2024-09-16T05:31:04.063+0000 7f5246e04040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-16T05:31:04.340 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 05:31:04 smithi047 bash[22994]: debug 2024-09-16T05:31:04.139+0000 7f5246e04040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-16T05:31:04.840 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 05:31:04 smithi047 bash[22994]: debug 2024-09-16T05:31:04.547+0000 7f5246e04040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-16T05:31:04.840 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 05:31:04 smithi047 bash[22994]: debug 2024-09-16T05:31:04.631+0000 7f5246e04040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-16T05:31:04.840 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:31:04 smithi047 bash[22744]: cluster 2024-09-16T05:31:04.656701+0000 mon.a (mon.0) 15 : cluster [INF] Activating manager daemon a 2024-09-16T05:31:04.840 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:31:04 smithi047 bash[22744]: cluster 2024-09-16T05:31:04.664540+0000 mon.a (mon.0) 16 : cluster [DBG] mgrmap e2: a(active, starting, since 0.0080296s) 2024-09-16T05:31:04.840 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:31:04 smithi047 bash[22744]: audit 2024-09-16T05:31:04.665417+0000 mon.a (mon.0) 17 : audit [DBG] from='mgr.14100 172.21.15.47:0/2569441428' entity='mgr.a' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-16T05:31:04.840 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:31:04 smithi047 bash[22744]: audit 2024-09-16T05:31:04.665625+0000 mon.a (mon.0) 18 : audit [DBG] from='mgr.14100 172.21.15.47:0/2569441428' entity='mgr.a' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-16T05:31:04.841 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:31:04 smithi047 bash[22744]: audit 2024-09-16T05:31:04.665791+0000 mon.a (mon.0) 19 : audit [DBG] from='mgr.14100 172.21.15.47:0/2569441428' entity='mgr.a' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-16T05:31:04.841 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:31:04 smithi047 bash[22744]: audit 2024-09-16T05:31:04.665947+0000 mon.a (mon.0) 20 : audit [DBG] from='mgr.14100 172.21.15.47:0/2569441428' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-16T05:31:04.841 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:31:04 smithi047 bash[22744]: audit 2024-09-16T05:31:04.666690+0000 mon.a (mon.0) 21 : audit [DBG] from='mgr.14100 172.21.15.47:0/2569441428' entity='mgr.a' cmd=[{"prefix": "mgr metadata", "who": "a", "id": "a"}]: dispatch 2024-09-16T05:31:04.841 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:31:04 smithi047 bash[22744]: cluster 2024-09-16T05:31:04.674090+0000 mon.a (mon.0) 22 : cluster [INF] Manager daemon a is now available 2024-09-16T05:31:04.841 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:31:04 smithi047 bash[22744]: audit 2024-09-16T05:31:04.685361+0000 mon.a (mon.0) 23 : audit [INF] from='mgr.14100 172.21.15.47:0/2569441428' entity='mgr.a' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/a/mirror_snapshot_schedule"}]: dispatch 2024-09-16T05:31:04.841 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:31:04 smithi047 bash[22744]: audit 2024-09-16T05:31:04.687488+0000 mon.a (mon.0) 24 : audit [INF] from='mgr.14100 172.21.15.47:0/2569441428' entity='mgr.a' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/a/trash_purge_schedule"}]: dispatch 2024-09-16T05:31:04.841 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:31:04 smithi047 bash[22744]: audit 2024-09-16T05:31:04.688985+0000 mon.a (mon.0) 25 : audit [INF] from='mgr.14100 172.21.15.47:0/2569441428' entity='mgr.a' 2024-09-16T05:31:04.841 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:31:04 smithi047 bash[22744]: audit 2024-09-16T05:31:04.690836+0000 mon.a (mon.0) 26 : audit [INF] from='mgr.14100 172.21.15.47:0/2569441428' entity='mgr.a' 2024-09-16T05:31:04.841 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:31:04 smithi047 bash[22744]: audit 2024-09-16T05:31:04.693344+0000 mon.a (mon.0) 27 : audit [INF] from='mgr.14100 172.21.15.47:0/2569441428' entity='mgr.a' 2024-09-16T05:31:07.013 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:31:06 smithi047 bash[22744]: cluster 2024-09-16T05:31:05.669730+0000 mon.a (mon.0) 28 : cluster [DBG] mgrmap e3: a(active, since 1.01322s) 2024-09-16T05:31:07.371 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout 2024-09-16T05:31:07.372 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout { 2024-09-16T05:31:07.372 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "fsid": "a6097908-73ec-11ef-bceb-c7b262605968", 2024-09-16T05:31:07.372 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "health": { 2024-09-16T05:31:07.373 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-16T05:31:07.373 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-16T05:31:07.373 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-16T05:31:07.373 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout }, 2024-09-16T05:31:07.373 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-16T05:31:07.373 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-16T05:31:07.373 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout 0 2024-09-16T05:31:07.373 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout ], 2024-09-16T05:31:07.375 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-16T05:31:07.375 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "a" 2024-09-16T05:31:07.375 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout ], 2024-09-16T05:31:07.375 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "quorum_age": 11, 2024-09-16T05:31:07.375 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-16T05:31:07.375 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-16T05:31:07.375 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-16T05:31:07.375 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-16T05:31:07.375 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout }, 2024-09-16T05:31:07.375 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-16T05:31:07.375 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-16T05:31:07.375 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-16T05:31:07.377 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-16T05:31:07.377 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-16T05:31:07.377 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-16T05:31:07.377 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-16T05:31:07.377 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-16T05:31:07.378 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout }, 2024-09-16T05:31:07.378 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-16T05:31:07.378 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-16T05:31:07.378 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-16T05:31:07.378 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-16T05:31:07.378 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-16T05:31:07.378 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-16T05:31:07.378 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-16T05:31:07.378 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-16T05:31:07.378 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-16T05:31:07.378 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout }, 2024-09-16T05:31:07.380 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-16T05:31:07.380 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-16T05:31:07.380 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "btime": "2024-09-16T05:30:49:835564+0000", 2024-09-16T05:31:07.381 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-16T05:31:07.381 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-16T05:31:07.381 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout }, 2024-09-16T05:31:07.381 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-16T05:31:07.381 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-16T05:31:07.381 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-16T05:31:07.381 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-16T05:31:07.381 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-16T05:31:07.381 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-16T05:31:07.381 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "restful" 2024-09-16T05:31:07.381 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout ], 2024-09-16T05:31:07.381 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-16T05:31:07.381 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout }, 2024-09-16T05:31:07.381 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-16T05:31:07.382 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-16T05:31:07.382 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "modified": "2024-09-16T05:30:49.836614+0000", 2024-09-16T05:31:07.382 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-16T05:31:07.382 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout }, 2024-09-16T05:31:07.382 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-16T05:31:07.383 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout } 2024-09-16T05:31:07.383 INFO:teuthology.orchestra.run.smithi047.stdout:mgr is available 2024-09-16T05:31:07.840 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:31:07 smithi047 bash[22744]: cluster 2024-09-16T05:31:06.669618+0000 mon.a (mon.0) 29 : cluster [DBG] mgrmap e4: a(active, since 2s) 2024-09-16T05:31:07.840 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:31:07 smithi047 bash[22744]: audit 2024-09-16T05:31:06.809524+0000 mon.a (mon.0) 30 : audit [DBG] from='client.? 172.21.15.47:0/3467564074' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-16T05:31:09.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:31:08 smithi047 bash[22744]: audit 2024-09-16T05:31:08.720972+0000 mon.a (mon.0) 31 : audit [INF] from='client.? 172.21.15.47:0/1546522276' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-09-16T05:31:09.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:31:08 smithi047 bash[22744]: audit 2024-09-16T05:31:08.724567+0000 mon.a (mon.0) 32 : audit [INF] from='client.? 172.21.15.47:0/1546522276' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-09-16T05:31:09.289 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout 2024-09-16T05:31:09.289 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout [global] 2024-09-16T05:31:09.289 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout fsid = a6097908-73ec-11ef-bceb-c7b262605968 2024-09-16T05:31:09.289 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.47:3300,v1:172.21.15.47:6789] 2024-09-16T05:31:09.289 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-16T05:31:09.289 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-16T05:31:09.289 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-16T05:31:09.289 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-16T05:31:09.289 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout 2024-09-16T05:31:09.289 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-16T05:31:09.290 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-16T05:31:09.290 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout 2024-09-16T05:31:09.290 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout [osd] 2024-09-16T05:31:09.290 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-16T05:31:09.290 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-16T05:31:09.290 INFO:teuthology.orchestra.run.smithi047.stdout:Enabling cephadm module... 2024-09-16T05:31:11.090 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:31:10 smithi047 bash[22744]: audit 2024-09-16T05:31:10.665844+0000 mon.a (mon.0) 33 : audit [INF] from='client.? 172.21.15.47:0/3919526864' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2024-09-16T05:31:11.090 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 05:31:10 smithi047 bash[22994]: ignoring --setuser ceph since I am not root 2024-09-16T05:31:11.091 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 05:31:10 smithi047 bash[22994]: ignoring --setgroup ceph since I am not root 2024-09-16T05:31:11.091 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 05:31:10 smithi047 bash[22994]: debug 2024-09-16T05:31:10.870+0000 7fe0b622c040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-16T05:31:12.033 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:31:11 smithi047 bash[22744]: audit 2024-09-16T05:31:10.717832+0000 mon.a (mon.0) 34 : audit [INF] from='client.? 172.21.15.47:0/3919526864' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-09-16T05:31:12.033 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:31:11 smithi047 bash[22744]: cluster 2024-09-16T05:31:10.723564+0000 mon.a (mon.0) 35 : cluster [DBG] mgrmap e5: a(active, since 6s) 2024-09-16T05:31:12.340 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 05:31:12 smithi047 bash[22994]: debug 2024-09-16T05:31:12.118+0000 7fe0b622c040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-16T05:31:12.340 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 05:31:12 smithi047 bash[22994]: debug 2024-09-16T05:31:12.186+0000 7fe0b622c040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-16T05:31:12.659 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 05:31:12 smithi047 bash[22994]: debug 2024-09-16T05:31:12.346+0000 7fe0b622c040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-16T05:31:13.032 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:31:12 smithi047 bash[22744]: audit 2024-09-16T05:31:12.648013+0000 mon.a (mon.0) 36 : audit [DBG] from='client.? 172.21.15.47:0/1481342459' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-09-16T05:31:13.149 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout { 2024-09-16T05:31:13.150 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "epoch": 5, 2024-09-16T05:31:13.150 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-16T05:31:13.150 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "active_name": "a", 2024-09-16T05:31:13.150 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-16T05:31:13.150 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout } 2024-09-16T05:31:13.150 INFO:teuthology.orchestra.run.smithi047.stdout:Waiting for the mgr to restart... 2024-09-16T05:31:13.150 INFO:teuthology.orchestra.run.smithi047.stdout:Waiting for mgr epoch 5... 2024-09-16T05:31:13.340 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 05:31:13 smithi047 bash[22994]: debug 2024-09-16T05:31:13.026+0000 7fe0b622c040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-16T05:31:13.340 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 05:31:13 smithi047 bash[22994]: debug 2024-09-16T05:31:13.098+0000 7fe0b622c040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-16T05:31:13.340 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 05:31:13 smithi047 bash[22994]: debug 2024-09-16T05:31:13.174+0000 7fe0b622c040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-16T05:31:13.791 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 05:31:13 smithi047 bash[22994]: debug 2024-09-16T05:31:13.370+0000 7fe0b622c040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-16T05:31:13.791 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 05:31:13 smithi047 bash[22994]: debug 2024-09-16T05:31:13.450+0000 7fe0b622c040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-16T05:31:13.791 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 05:31:13 smithi047 bash[22994]: debug 2024-09-16T05:31:13.518+0000 7fe0b622c040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-16T05:31:13.791 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 05:31:13 smithi047 bash[22994]: debug 2024-09-16T05:31:13.786+0000 7fe0b622c040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-16T05:31:14.066 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 05:31:13 smithi047 bash[22994]: debug 2024-09-16T05:31:13.858+0000 7fe0b622c040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-16T05:31:14.066 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 05:31:14 smithi047 bash[22994]: debug 2024-09-16T05:31:14.062+0000 7fe0b622c040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-16T05:31:14.340 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 05:31:14 smithi047 bash[22994]: debug 2024-09-16T05:31:14.146+0000 7fe0b622c040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-16T05:31:14.769 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 05:31:14 smithi047 bash[22994]: debug 2024-09-16T05:31:14.410+0000 7fe0b622c040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-16T05:31:14.769 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 05:31:14 smithi047 bash[22994]: debug 2024-09-16T05:31:14.594+0000 7fe0b622c040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-16T05:31:14.769 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 05:31:14 smithi047 bash[22994]: debug 2024-09-16T05:31:14.762+0000 7fe0b622c040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-16T05:31:15.039 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 05:31:14 smithi047 bash[22994]: debug 2024-09-16T05:31:14.846+0000 7fe0b622c040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-16T05:31:15.039 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 05:31:15 smithi047 bash[22994]: debug 2024-09-16T05:31:15.034+0000 7fe0b622c040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-16T05:31:16.194 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 05:31:15 smithi047 bash[22994]: debug 2024-09-16T05:31:15.878+0000 7fe0b622c040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-16T05:31:16.194 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 05:31:15 smithi047 bash[22994]: debug 2024-09-16T05:31:15.954+0000 7fe0b622c040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-16T05:31:16.194 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 05:31:16 smithi047 bash[22994]: debug 2024-09-16T05:31:16.190+0000 7fe0b622c040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-16T05:31:16.590 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 05:31:16 smithi047 bash[22994]: debug 2024-09-16T05:31:16.266+0000 7fe0b622c040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-16T05:31:17.090 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 05:31:16 smithi047 bash[22994]: debug 2024-09-16T05:31:16.674+0000 7fe0b622c040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-16T05:31:17.090 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 05:31:16 smithi047 bash[22994]: debug 2024-09-16T05:31:16.758+0000 7fe0b622c040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-16T05:31:17.091 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:31:16 smithi047 bash[22744]: cluster 2024-09-16T05:31:16.780478+0000 mon.a (mon.0) 37 : cluster [INF] Active manager daemon a restarted 2024-09-16T05:31:17.091 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:31:16 smithi047 bash[22744]: cluster 2024-09-16T05:31:16.780893+0000 mon.a (mon.0) 38 : cluster [INF] Activating manager daemon a 2024-09-16T05:31:17.091 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:31:16 smithi047 bash[22744]: cluster 2024-09-16T05:31:16.787723+0000 mon.a (mon.0) 39 : cluster [DBG] osdmap e2: 0 total, 0 up, 0 in 2024-09-16T05:31:17.091 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:31:16 smithi047 bash[22744]: cluster 2024-09-16T05:31:16.787840+0000 mon.a (mon.0) 40 : cluster [DBG] mgrmap e6: a(active, starting, since 0.00711337s) 2024-09-16T05:31:17.091 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:31:16 smithi047 bash[22744]: audit 2024-09-16T05:31:16.789414+0000 mon.a (mon.0) 41 : audit [DBG] from='mgr.14118 172.21.15.47:0/251211152' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-16T05:31:17.091 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:31:16 smithi047 bash[22744]: audit 2024-09-16T05:31:16.791091+0000 mon.a (mon.0) 42 : audit [DBG] from='mgr.14118 172.21.15.47:0/251211152' entity='mgr.a' cmd=[{"prefix": "mgr metadata", "who": "a", "id": "a"}]: dispatch 2024-09-16T05:31:17.091 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:31:16 smithi047 bash[22744]: audit 2024-09-16T05:31:16.792201+0000 mon.a (mon.0) 43 : audit [DBG] from='mgr.14118 172.21.15.47:0/251211152' entity='mgr.a' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-16T05:31:17.091 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:31:16 smithi047 bash[22744]: audit 2024-09-16T05:31:16.792716+0000 mon.a (mon.0) 44 : audit [DBG] from='mgr.14118 172.21.15.47:0/251211152' entity='mgr.a' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-16T05:31:17.091 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:31:16 smithi047 bash[22744]: audit 2024-09-16T05:31:16.793006+0000 mon.a (mon.0) 45 : audit [DBG] from='mgr.14118 172.21.15.47:0/251211152' entity='mgr.a' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-16T05:31:17.091 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:31:16 smithi047 bash[22744]: cluster 2024-09-16T05:31:16.821121+0000 mon.a (mon.0) 46 : cluster [INF] Manager daemon a is now available 2024-09-16T05:31:18.090 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:31:17 smithi047 bash[22744]: cephadm 2024-09-16T05:31:16.838899+0000 mgr.a (mgr.14118) 1 : cephadm [INF] Found migration_current of "None". Setting to last migration. 2024-09-16T05:31:18.091 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:31:17 smithi047 bash[22744]: audit 2024-09-16T05:31:16.840696+0000 mon.a (mon.0) 47 : audit [INF] from='mgr.14118 172.21.15.47:0/251211152' entity='mgr.a' 2024-09-16T05:31:18.091 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:31:17 smithi047 bash[22744]: audit 2024-09-16T05:31:16.843009+0000 mon.a (mon.0) 48 : audit [INF] from='mgr.14118 172.21.15.47:0/251211152' entity='mgr.a' 2024-09-16T05:31:18.091 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:31:17 smithi047 bash[22744]: audit 2024-09-16T05:31:16.845533+0000 mon.a (mon.0) 49 : audit [DBG] from='mgr.14118 172.21.15.47:0/251211152' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T05:31:18.091 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:31:17 smithi047 bash[22744]: audit 2024-09-16T05:31:16.847284+0000 mon.a (mon.0) 50 : audit [DBG] from='mgr.14118 172.21.15.47:0/251211152' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T05:31:18.091 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:31:17 smithi047 bash[22744]: audit 2024-09-16T05:31:16.859436+0000 mon.a (mon.0) 51 : audit [INF] from='mgr.14118 172.21.15.47:0/251211152' entity='mgr.a' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/a/mirror_snapshot_schedule"}]: dispatch 2024-09-16T05:31:18.091 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:31:17 smithi047 bash[22744]: audit 2024-09-16T05:31:16.862935+0000 mon.a (mon.0) 52 : audit [INF] from='mgr.14118 172.21.15.47:0/251211152' entity='mgr.a' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/a/trash_purge_schedule"}]: dispatch 2024-09-16T05:31:18.091 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:31:17 smithi047 bash[22744]: audit 2024-09-16T05:31:17.571216+0000 mon.a (mon.0) 53 : audit [INF] from='mgr.14118 172.21.15.47:0/251211152' entity='mgr.a' 2024-09-16T05:31:18.091 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:31:17 smithi047 bash[22744]: audit 2024-09-16T05:31:17.575700+0000 mon.a (mon.0) 54 : audit [INF] from='mgr.14118 172.21.15.47:0/251211152' entity='mgr.a' 2024-09-16T05:31:18.091 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:31:17 smithi047 bash[22744]: cluster 2024-09-16T05:31:17.792734+0000 mon.a (mon.0) 55 : cluster [DBG] mgrmap e7: a(active, since 1.01199s) 2024-09-16T05:31:18.373 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout { 2024-09-16T05:31:18.373 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2024-09-16T05:31:18.373 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-16T05:31:18.373 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout } 2024-09-16T05:31:18.373 INFO:teuthology.orchestra.run.smithi047.stdout:mgr epoch 5 is available 2024-09-16T05:31:18.373 INFO:teuthology.orchestra.run.smithi047.stdout:Setting orchestrator backend to cephadm... 2024-09-16T05:31:19.168 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:31:18 smithi047 bash[22744]: audit 2024-09-16T05:31:17.789995+0000 mgr.a (mgr.14118) 2 : audit [DBG] from='client.14122 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-09-16T05:31:19.168 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:31:18 smithi047 bash[22744]: audit 2024-09-16T05:31:17.804943+0000 mgr.a (mgr.14118) 3 : audit [DBG] from='client.14122 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-09-16T05:31:19.168 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:31:18 smithi047 bash[22744]: cephadm 2024-09-16T05:31:18.635760+0000 mgr.a (mgr.14118) 4 : cephadm [INF] [16/Sep/2024:05:31:18] ENGINE Bus STARTING 2024-09-16T05:31:19.168 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:31:18 smithi047 bash[22744]: cephadm 2024-09-16T05:31:18.737361+0000 mgr.a (mgr.14118) 5 : cephadm [INF] [16/Sep/2024:05:31:18] ENGINE Serving on http://172.21.15.47:8765 2024-09-16T05:31:19.168 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 05:31:18 smithi047 bash[22994]: debug 2024-09-16T05:31:18.862+0000 7fe01d56b640 -1 log_channel(cephadm) log [ERR] : [16/Sep/2024:05:31:18] ENGINE Error in HTTPServer.serve 2024-09-16T05:31:19.169 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 05:31:18 smithi047 bash[22994]: Traceback (most recent call last): 2024-09-16T05:31:19.169 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 05:31:18 smithi047 bash[22994]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-16T05:31:19.169 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 05:31:18 smithi047 bash[22994]: self._connections.run(self.expiration_interval) 2024-09-16T05:31:19.169 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 05:31:18 smithi047 bash[22994]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-16T05:31:19.169 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 05:31:18 smithi047 bash[22994]: self._run(expiration_interval) 2024-09-16T05:31:19.169 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 05:31:18 smithi047 bash[22994]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-16T05:31:19.169 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 05:31:18 smithi047 bash[22994]: new_conn = self._from_server_socket(self.server.socket) 2024-09-16T05:31:19.169 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 05:31:18 smithi047 bash[22994]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-16T05:31:19.169 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 05:31:18 smithi047 bash[22994]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-16T05:31:19.169 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 05:31:18 smithi047 bash[22994]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-16T05:31:19.169 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 05:31:18 smithi047 bash[22994]: s = self.context.wrap_socket( 2024-09-16T05:31:19.170 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 05:31:18 smithi047 bash[22994]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-16T05:31:19.170 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 05:31:18 smithi047 bash[22994]: return self.sslsocket_class._create( 2024-09-16T05:31:19.170 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 05:31:18 smithi047 bash[22994]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-16T05:31:19.170 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 05:31:18 smithi047 bash[22994]: self.do_handshake() 2024-09-16T05:31:19.170 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 05:31:18 smithi047 bash[22994]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-16T05:31:19.170 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 05:31:18 smithi047 bash[22994]: self._sslobj.do_handshake() 2024-09-16T05:31:19.170 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 05:31:18 smithi047 bash[22994]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-16T05:31:20.091 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:31:19 smithi047 bash[22744]: cluster 2024-09-16T05:31:18.846511+0000 mon.a (mon.0) 56 : cluster [DBG] mgrmap e8: a(active, since 2s) 2024-09-16T05:31:20.091 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:31:19 smithi047 bash[22744]: cephadm 2024-09-16T05:31:18.862248+0000 mgr.a (mgr.14118) 6 : cephadm [INF] [16/Sep/2024:05:31:18] ENGINE Serving on https://172.21.15.47:7150 2024-09-16T05:31:20.091 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:31:19 smithi047 bash[22744]: cephadm 2024-09-16T05:31:18.862489+0000 mgr.a (mgr.14118) 7 : cephadm [INF] [16/Sep/2024:05:31:18] ENGINE Bus STARTED 2024-09-16T05:31:20.091 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:31:19 smithi047 bash[22744]: audit 2024-09-16T05:31:18.863572+0000 mon.a (mon.0) 57 : audit [DBG] from='mgr.14118 172.21.15.47:0/251211152' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T05:31:20.091 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:31:19 smithi047 bash[22744]: cephadm 2024-09-16T05:31:18.865250+0000 mgr.a (mgr.14118) 8 : cephadm [ERR] [16/Sep/2024:05:31:18] ENGINE Error in HTTPServer.serve 2024-09-16T05:31:20.091 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:31:19 smithi047 bash[22744]: Traceback (most recent call last): 2024-09-16T05:31:20.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:31:19 smithi047 bash[22744]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-16T05:31:20.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:31:19 smithi047 bash[22744]: self._connections.run(self.expiration_interval) 2024-09-16T05:31:20.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:31:19 smithi047 bash[22744]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-16T05:31:20.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:31:19 smithi047 bash[22744]: self._run(expiration_interval) 2024-09-16T05:31:20.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:31:19 smithi047 bash[22744]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-16T05:31:20.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:31:19 smithi047 bash[22744]: new_conn = self._from_server_socket(self.server.socket) 2024-09-16T05:31:20.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:31:19 smithi047 bash[22744]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-16T05:31:20.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:31:19 smithi047 bash[22744]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-16T05:31:20.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:31:19 smithi047 bash[22744]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-16T05:31:20.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:31:19 smithi047 bash[22744]: s = self.context.wrap_socket( 2024-09-16T05:31:20.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:31:19 smithi047 bash[22744]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-16T05:31:20.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:31:19 smithi047 bash[22744]: return self.sslsocket_class._create( 2024-09-16T05:31:20.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:31:19 smithi047 bash[22744]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-16T05:31:20.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:31:19 smithi047 bash[22744]: self.do_handshake() 2024-09-16T05:31:20.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:31:19 smithi047 bash[22744]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-16T05:31:20.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:31:19 smithi047 bash[22744]: self._sslobj.do_handshake() 2024-09-16T05:31:20.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:31:19 smithi047 bash[22744]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-16T05:31:20.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:31:19 smithi047 bash[22744]: audit 2024-09-16T05:31:19.729427+0000 mgr.a (mgr.14118) 9 : audit [DBG] from='client.14130 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:31:20.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:31:19 smithi047 bash[22744]: audit 2024-09-16T05:31:19.733567+0000 mon.a (mon.0) 58 : audit [INF] from='mgr.14118 172.21.15.47:0/251211152' entity='mgr.a' 2024-09-16T05:31:20.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:31:19 smithi047 bash[22744]: audit 2024-09-16T05:31:19.748035+0000 mon.a (mon.0) 59 : audit [DBG] from='mgr.14118 172.21.15.47:0/251211152' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T05:31:22.090 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:31:21 smithi047 bash[22744]: audit 2024-09-16T05:31:21.694564+0000 mgr.a (mgr.14118) 10 : audit [DBG] from='client.14132 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:31:22.255 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout value unchanged 2024-09-16T05:31:22.255 INFO:teuthology.orchestra.run.smithi047.stdout:Generating ssh key... 2024-09-16T05:31:24.085 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:31:23 smithi047 bash[22744]: audit 2024-09-16T05:31:23.529158+0000 mgr.a (mgr.14118) 11 : audit [DBG] from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:31:24.086 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:31:23 smithi047 bash[22744]: cephadm 2024-09-16T05:31:23.529566+0000 mgr.a (mgr.14118) 12 : cephadm [INF] Generating ssh key... 2024-09-16T05:31:24.086 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 05:31:23 smithi047 bash[22994]: Generating public/private rsa key pair. 2024-09-16T05:31:24.086 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 05:31:23 smithi047 bash[22994]: Your identification has been saved in /tmp/tmp6nkme1_s/key 2024-09-16T05:31:24.086 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 05:31:23 smithi047 bash[22994]: Your public key has been saved in /tmp/tmp6nkme1_s/key.pub 2024-09-16T05:31:24.086 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 05:31:23 smithi047 bash[22994]: The key fingerprint is: 2024-09-16T05:31:24.086 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 05:31:23 smithi047 bash[22994]: SHA256:IilowJlZBceyzZySa/0jRpEuG2+60oVj0vzY3PljWbk ceph-a6097908-73ec-11ef-bceb-c7b262605968 2024-09-16T05:31:24.086 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 05:31:23 smithi047 bash[22994]: The key's randomart image is: 2024-09-16T05:31:24.086 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 05:31:23 smithi047 bash[22994]: +---[RSA 3072]----+ 2024-09-16T05:31:24.087 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 05:31:23 smithi047 bash[22994]: | o+o | 2024-09-16T05:31:24.087 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 05:31:23 smithi047 bash[22994]: |. =... | 2024-09-16T05:31:24.087 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 05:31:23 smithi047 bash[22994]: |.= B o | 2024-09-16T05:31:24.087 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 05:31:23 smithi047 bash[22994]: |.. + O | 2024-09-16T05:31:24.087 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 05:31:23 smithi047 bash[22994]: |..+ O o S . | 2024-09-16T05:31:24.087 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 05:31:23 smithi047 bash[22994]: |.. % * . o | 2024-09-16T05:31:24.087 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 05:31:23 smithi047 bash[22994]: | = & o . o . | 2024-09-16T05:31:24.087 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 05:31:23 smithi047 bash[22994]: | . + O = + E | 2024-09-16T05:31:24.087 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 05:31:23 smithi047 bash[22994]: | .o= . +.. | 2024-09-16T05:31:24.087 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 05:31:23 smithi047 bash[22994]: +----[SHA256]-----+ 2024-09-16T05:31:25.233 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:31:24 smithi047 bash[22744]: audit 2024-09-16T05:31:23.871786+0000 mon.a (mon.0) 60 : audit [INF] from='mgr.14118 172.21.15.47:0/251211152' entity='mgr.a' 2024-09-16T05:31:25.233 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:31:24 smithi047 bash[22744]: audit 2024-09-16T05:31:23.876033+0000 mon.a (mon.0) 61 : audit [INF] from='mgr.14118 172.21.15.47:0/251211152' entity='mgr.a' 2024-09-16T05:31:26.090 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:31:25 smithi047 bash[22744]: audit 2024-09-16T05:31:25.770116+0000 mgr.a (mgr.14118) 13 : audit [DBG] from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:31:26.277 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDn21uSsmiIilFSpH/e0qkMSvCZ5+oMR15iS/xwu+Q8mJ+BFr1OUaR8qQ3mh9uPVKr3kGfW0eybtzMq4wI7WnQslowGZ1lkZkcMmfEHKTx0S0wVZlLUk9uluwZD9nrBaBEJKbDJXA4WVF+vBO2rEbtt1jAF0qd/TIzGB8aR72oOM0fWm8ZXL6NyM/puQ6zv0auFV0hscUrLEZw1QZb4S54yi/sxQPNH9aRpCeuNUF3bXwTYhL4Mdqz5EBywYTaf5IOXJCVL7b4c60pEvzcpzAf9m9v0rDQuHCg7b4+ebypppWoSLN/wQUlnAxRMTyOsezWNbr/lbD2P37GnaOUiYScI1ZSGtBPvtKgyNbKPCUtOX1a6mTN85E6ou2MnmQ1+q9qnDfaC4THYlIQMAVV89Aexs5Ilz+VuNgjxnceIq8wfSMWieOqJB5OXB9LZC267n+2DuAeRg86MmtBSz24ot3p0jWs42xlD0bvOk2FIkGuUHQJnZUqpUreF3jF8G5q5y3M= ceph-a6097908-73ec-11ef-bceb-c7b262605968 2024-09-16T05:31:26.277 INFO:teuthology.orchestra.run.smithi047.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-09-16T05:31:26.277 INFO:teuthology.orchestra.run.smithi047.stdout:Adding key to root@localhost authorized_keys... 2024-09-16T05:31:26.278 INFO:teuthology.orchestra.run.smithi047.stdout:Adding host smithi047... 2024-09-16T05:31:28.076 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:31:27 smithi047 bash[22744]: audit 2024-09-16T05:31:27.606645+0000 mgr.a (mgr.14118) 14 : audit [DBG] from='client.14138 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi047", "addr": "172.21.15.47", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:31:30.090 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:31:29 smithi047 bash[22744]: cephadm 2024-09-16T05:31:28.930434+0000 mgr.a (mgr.14118) 15 : cephadm [INF] Deploying cephadm binary to smithi047 2024-09-16T05:31:33.133 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout Added host 'smithi047' with addr '172.21.15.47' 2024-09-16T05:31:33.200 INFO:teuthology.orchestra.run.smithi047.stdout:Deploying unmanaged mon service... 2024-09-16T05:31:33.591 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:31:33 smithi047 bash[22744]: audit 2024-09-16T05:31:32.488377+0000 mon.a (mon.0) 62 : audit [INF] from='mgr.14118 172.21.15.47:0/251211152' entity='mgr.a' 2024-09-16T05:31:33.591 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:31:33 smithi047 bash[22744]: cephadm 2024-09-16T05:31:32.488884+0000 mgr.a (mgr.14118) 16 : cephadm [INF] Added host smithi047 2024-09-16T05:31:33.591 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:31:33 smithi047 bash[22744]: audit 2024-09-16T05:31:32.489271+0000 mon.a (mon.0) 63 : audit [DBG] from='mgr.14118 172.21.15.47:0/251211152' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T05:31:35.923 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2024-09-16T05:31:35.923 INFO:teuthology.orchestra.run.smithi047.stdout:Deploying unmanaged mgr service... 2024-09-16T05:31:36.340 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:31:36 smithi047 bash[22744]: audit 2024-09-16T05:31:35.180507+0000 mgr.a (mgr.14118) 17 : audit [DBG] from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:31:36.341 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:31:36 smithi047 bash[22744]: cephadm 2024-09-16T05:31:35.183420+0000 mgr.a (mgr.14118) 18 : cephadm [INF] Saving service mon spec with placement count:5 2024-09-16T05:31:36.341 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:31:36 smithi047 bash[22744]: audit 2024-09-16T05:31:35.187873+0000 mon.a (mon.0) 64 : audit [INF] from='mgr.14118 172.21.15.47:0/251211152' entity='mgr.a' 2024-09-16T05:31:36.341 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:31:36 smithi047 bash[22744]: audit 2024-09-16T05:31:35.907657+0000 mon.a (mon.0) 65 : audit [INF] from='mgr.14118 172.21.15.47:0/251211152' entity='mgr.a' 2024-09-16T05:31:37.841 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:31:37 smithi047 bash[22744]: audit 2024-09-16T05:31:36.461624+0000 mon.a (mon.0) 66 : audit [INF] from='mgr.14118 172.21.15.47:0/251211152' entity='mgr.a' 2024-09-16T05:31:38.065 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2024-09-16T05:31:38.841 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:31:38 smithi047 bash[22744]: cluster 2024-09-16T05:31:36.793634+0000 mgr.a (mgr.14118) 19 : cluster [DBG] pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T05:31:38.841 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:31:38 smithi047 bash[22744]: audit 2024-09-16T05:31:37.501684+0000 mgr.a (mgr.14118) 20 : audit [DBG] from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:31:38.841 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:31:38 smithi047 bash[22744]: cephadm 2024-09-16T05:31:37.503957+0000 mgr.a (mgr.14118) 21 : cephadm [INF] Saving service mgr spec with placement count:2 2024-09-16T05:31:38.841 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:31:38 smithi047 bash[22744]: audit 2024-09-16T05:31:37.508227+0000 mon.a (mon.0) 67 : audit [INF] from='mgr.14118 172.21.15.47:0/251211152' entity='mgr.a' 2024-09-16T05:31:40.797 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:31:40 smithi047 bash[22744]: cluster 2024-09-16T05:31:38.794034+0000 mgr.a (mgr.14118) 22 : cluster [DBG] pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T05:31:40.797 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:31:40 smithi047 bash[22744]: audit 2024-09-16T05:31:39.442332+0000 mon.a (mon.0) 68 : audit [INF] from='client.? 172.21.15.47:0/2558858042' entity='client.admin' 2024-09-16T05:31:41.836 INFO:teuthology.orchestra.run.smithi047.stdout:Enabling the dashboard module... 2024-09-16T05:31:42.591 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:31:42 smithi047 bash[22744]: cluster 2024-09-16T05:31:40.794466+0000 mgr.a (mgr.14118) 23 : cluster [DBG] pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T05:31:42.591 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:31:42 smithi047 bash[22744]: audit 2024-09-16T05:31:41.321963+0000 mon.a (mon.0) 69 : audit [INF] from='client.? 172.21.15.47:0/4040031913' entity='client.admin' 2024-09-16T05:31:43.590 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:31:43 smithi047 bash[22744]: audit 2024-09-16T05:31:43.283677+0000 mon.a (mon.0) 70 : audit [INF] from='client.? 172.21.15.47:0/2203236946' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2024-09-16T05:31:43.591 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 05:31:43 smithi047 bash[22994]: ignoring --setuser ceph since I am not root 2024-09-16T05:31:43.591 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 05:31:43 smithi047 bash[22994]: ignoring --setgroup ceph since I am not root 2024-09-16T05:31:43.591 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 05:31:43 smithi047 bash[22994]: debug 2024-09-16T05:31:43.481+0000 7fd389310040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-16T05:31:44.590 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:31:44 smithi047 bash[22744]: audit 2024-09-16T05:31:43.323905+0000 mon.a (mon.0) 71 : audit [INF] from='client.? 172.21.15.47:0/2203236946' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-09-16T05:31:44.591 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:31:44 smithi047 bash[22744]: cluster 2024-09-16T05:31:43.330075+0000 mon.a (mon.0) 72 : cluster [DBG] mgrmap e9: a(active, since 26s) 2024-09-16T05:31:44.980 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 05:31:44 smithi047 bash[22994]: debug 2024-09-16T05:31:44.745+0000 7fd389310040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-16T05:31:44.980 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 05:31:44 smithi047 bash[22994]: debug 2024-09-16T05:31:44.817+0000 7fd389310040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-16T05:31:45.340 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 05:31:44 smithi047 bash[22994]: debug 2024-09-16T05:31:44.977+0000 7fd389310040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-16T05:31:45.665 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:31:45 smithi047 bash[22744]: audit 2024-09-16T05:31:45.351063+0000 mon.a (mon.0) 73 : audit [DBG] from='client.? 172.21.15.47:0/2673619524' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-09-16T05:31:45.943 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout { 2024-09-16T05:31:45.943 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "epoch": 9, 2024-09-16T05:31:45.944 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-16T05:31:45.944 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "active_name": "a", 2024-09-16T05:31:45.944 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-16T05:31:45.944 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout } 2024-09-16T05:31:45.944 INFO:teuthology.orchestra.run.smithi047.stdout:Waiting for the mgr to restart... 2024-09-16T05:31:45.944 INFO:teuthology.orchestra.run.smithi047.stdout:Waiting for mgr epoch 9... 2024-09-16T05:31:46.006 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 05:31:45 smithi047 bash[22994]: debug 2024-09-16T05:31:45.661+0000 7fd389310040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-16T05:31:46.006 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 05:31:45 smithi047 bash[22994]: debug 2024-09-16T05:31:45.737+0000 7fd389310040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-16T05:31:46.006 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 05:31:45 smithi047 bash[22994]: debug 2024-09-16T05:31:45.805+0000 7fd389310040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-16T05:31:46.341 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 05:31:46 smithi047 bash[22994]: debug 2024-09-16T05:31:46.005+0000 7fd389310040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-16T05:31:46.341 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 05:31:46 smithi047 bash[22994]: debug 2024-09-16T05:31:46.085+0000 7fd389310040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-16T05:31:46.341 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 05:31:46 smithi047 bash[22994]: debug 2024-09-16T05:31:46.157+0000 7fd389310040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-16T05:31:46.706 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 05:31:46 smithi047 bash[22994]: debug 2024-09-16T05:31:46.425+0000 7fd389310040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-16T05:31:46.706 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 05:31:46 smithi047 bash[22994]: debug 2024-09-16T05:31:46.497+0000 7fd389310040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-16T05:31:46.961 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 05:31:46 smithi047 bash[22994]: debug 2024-09-16T05:31:46.705+0000 7fd389310040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-16T05:31:46.961 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 05:31:46 smithi047 bash[22994]: debug 2024-09-16T05:31:46.785+0000 7fd389310040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-16T05:31:47.341 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 05:31:47 smithi047 bash[22994]: debug 2024-09-16T05:31:47.053+0000 7fd389310040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-16T05:31:47.341 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 05:31:47 smithi047 bash[22994]: debug 2024-09-16T05:31:47.237+0000 7fd389310040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-16T05:31:47.679 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 05:31:47 smithi047 bash[22994]: debug 2024-09-16T05:31:47.409+0000 7fd389310040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-16T05:31:47.680 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 05:31:47 smithi047 bash[22994]: debug 2024-09-16T05:31:47.489+0000 7fd389310040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-16T05:31:48.090 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 05:31:47 smithi047 bash[22994]: debug 2024-09-16T05:31:47.677+0000 7fd389310040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-16T05:31:48.841 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 05:31:48 smithi047 bash[22994]: debug 2024-09-16T05:31:48.529+0000 7fd389310040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-16T05:31:48.841 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 05:31:48 smithi047 bash[22994]: debug 2024-09-16T05:31:48.609+0000 7fd389310040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-16T05:31:49.330 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 05:31:48 smithi047 bash[22994]: debug 2024-09-16T05:31:48.841+0000 7fd389310040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-16T05:31:49.330 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 05:31:48 smithi047 bash[22994]: debug 2024-09-16T05:31:48.917+0000 7fd389310040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-16T05:31:49.591 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 05:31:49 smithi047 bash[22994]: debug 2024-09-16T05:31:49.325+0000 7fd389310040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-16T05:31:49.591 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 05:31:49 smithi047 bash[22994]: debug 2024-09-16T05:31:49.409+0000 7fd389310040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-16T05:31:49.591 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:31:49 smithi047 bash[22744]: cluster 2024-09-16T05:31:49.432996+0000 mon.a (mon.0) 74 : cluster [INF] Active manager daemon a restarted 2024-09-16T05:31:49.591 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:31:49 smithi047 bash[22744]: cluster 2024-09-16T05:31:49.433471+0000 mon.a (mon.0) 75 : cluster [INF] Activating manager daemon a 2024-09-16T05:31:49.591 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:31:49 smithi047 bash[22744]: cluster 2024-09-16T05:31:49.436883+0000 mon.a (mon.0) 76 : cluster [DBG] osdmap e3: 0 total, 0 up, 0 in 2024-09-16T05:31:49.591 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:31:49 smithi047 bash[22744]: cluster 2024-09-16T05:31:49.437008+0000 mon.a (mon.0) 77 : cluster [DBG] mgrmap e10: a(active, starting, since 0.00372522s) 2024-09-16T05:31:49.591 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:31:49 smithi047 bash[22744]: audit 2024-09-16T05:31:49.440449+0000 mon.a (mon.0) 78 : audit [DBG] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-16T05:31:49.591 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:31:49 smithi047 bash[22744]: audit 2024-09-16T05:31:49.441671+0000 mon.a (mon.0) 79 : audit [DBG] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "mgr metadata", "who": "a", "id": "a"}]: dispatch 2024-09-16T05:31:49.591 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:31:49 smithi047 bash[22744]: audit 2024-09-16T05:31:49.443135+0000 mon.a (mon.0) 80 : audit [DBG] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-16T05:31:49.591 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:31:49 smithi047 bash[22744]: audit 2024-09-16T05:31:49.443472+0000 mon.a (mon.0) 81 : audit [DBG] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-16T05:31:49.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:31:49 smithi047 bash[22744]: audit 2024-09-16T05:31:49.443571+0000 mon.a (mon.0) 82 : audit [DBG] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-16T05:31:49.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:31:49 smithi047 bash[22744]: cluster 2024-09-16T05:31:49.468503+0000 mon.a (mon.0) 83 : cluster [INF] Manager daemon a is now available 2024-09-16T05:31:50.841 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:31:50 smithi047 bash[22744]: audit 2024-09-16T05:31:49.484608+0000 mon.a (mon.0) 84 : audit [DBG] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T05:31:50.841 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:31:50 smithi047 bash[22744]: audit 2024-09-16T05:31:49.500192+0000 mon.a (mon.0) 85 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/a/mirror_snapshot_schedule"}]: dispatch 2024-09-16T05:31:50.841 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:31:50 smithi047 bash[22744]: audit 2024-09-16T05:31:49.502695+0000 mon.a (mon.0) 86 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/a/trash_purge_schedule"}]: dispatch 2024-09-16T05:31:50.841 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:31:50 smithi047 bash[22744]: cluster 2024-09-16T05:31:50.445187+0000 mon.a (mon.0) 87 : cluster [DBG] mgrmap e11: a(active, since 1.01187s) 2024-09-16T05:31:51.082 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout { 2024-09-16T05:31:51.082 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2024-09-16T05:31:51.082 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-16T05:31:51.083 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout } 2024-09-16T05:31:51.083 INFO:teuthology.orchestra.run.smithi047.stdout:mgr epoch 9 is available 2024-09-16T05:31:51.083 INFO:teuthology.orchestra.run.smithi047.stdout:Generating a dashboard self-signed certificate... 2024-09-16T05:31:51.495 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 05:31:51 smithi047 bash[22994]: debug 2024-09-16T05:31:51.345+0000 7fd2f4617640 -1 log_channel(cephadm) log [ERR] : [16/Sep/2024:05:31:51] ENGINE Error in HTTPServer.serve 2024-09-16T05:31:51.495 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 05:31:51 smithi047 bash[22994]: Traceback (most recent call last): 2024-09-16T05:31:51.495 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 05:31:51 smithi047 bash[22994]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-16T05:31:51.495 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 05:31:51 smithi047 bash[22994]: self._connections.run(self.expiration_interval) 2024-09-16T05:31:51.495 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 05:31:51 smithi047 bash[22994]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-16T05:31:51.495 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 05:31:51 smithi047 bash[22994]: self._run(expiration_interval) 2024-09-16T05:31:51.495 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 05:31:51 smithi047 bash[22994]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-16T05:31:51.495 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 05:31:51 smithi047 bash[22994]: new_conn = self._from_server_socket(self.server.socket) 2024-09-16T05:31:51.495 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 05:31:51 smithi047 bash[22994]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-16T05:31:51.496 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 05:31:51 smithi047 bash[22994]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-16T05:31:51.496 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 05:31:51 smithi047 bash[22994]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-16T05:31:51.496 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 05:31:51 smithi047 bash[22994]: s = self.context.wrap_socket( 2024-09-16T05:31:51.496 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 05:31:51 smithi047 bash[22994]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-16T05:31:51.496 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 05:31:51 smithi047 bash[22994]: return self.sslsocket_class._create( 2024-09-16T05:31:51.496 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 05:31:51 smithi047 bash[22994]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-16T05:31:51.496 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 05:31:51 smithi047 bash[22994]: self.do_handshake() 2024-09-16T05:31:51.496 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 05:31:51 smithi047 bash[22994]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-16T05:31:51.496 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 05:31:51 smithi047 bash[22994]: self._sslobj.do_handshake() 2024-09-16T05:31:51.496 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 05:31:51 smithi047 bash[22994]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-16T05:31:51.841 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:31:51 smithi047 bash[22744]: cephadm 2024-09-16T05:31:51.220259+0000 mgr.a (mgr.14150) 3 : cephadm [INF] [16/Sep/2024:05:31:51] ENGINE Bus STARTING 2024-09-16T05:31:51.841 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:31:51 smithi047 bash[22744]: cephadm 2024-09-16T05:31:51.344312+0000 mgr.a (mgr.14150) 4 : cephadm [INF] [16/Sep/2024:05:31:51] ENGINE Serving on https://172.21.15.47:7150 2024-09-16T05:31:51.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:31:51 smithi047 bash[22744]: cephadm 2024-09-16T05:31:51.348187+0000 mgr.a (mgr.14150) 5 : cephadm [ERR] [16/Sep/2024:05:31:51] ENGINE Error in HTTPServer.serve 2024-09-16T05:31:51.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:31:51 smithi047 bash[22744]: Traceback (most recent call last): 2024-09-16T05:31:51.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:31:51 smithi047 bash[22744]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-16T05:31:51.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:31:51 smithi047 bash[22744]: self._connections.run(self.expiration_interval) 2024-09-16T05:31:51.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:31:51 smithi047 bash[22744]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-16T05:31:51.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:31:51 smithi047 bash[22744]: self._run(expiration_interval) 2024-09-16T05:31:51.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:31:51 smithi047 bash[22744]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-16T05:31:51.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:31:51 smithi047 bash[22744]: new_conn = self._from_server_socket(self.server.socket) 2024-09-16T05:31:51.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:31:51 smithi047 bash[22744]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-16T05:31:51.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:31:51 smithi047 bash[22744]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-16T05:31:51.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:31:51 smithi047 bash[22744]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-16T05:31:51.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:31:51 smithi047 bash[22744]: s = self.context.wrap_socket( 2024-09-16T05:31:51.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:31:51 smithi047 bash[22744]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-16T05:31:51.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:31:51 smithi047 bash[22744]: return self.sslsocket_class._create( 2024-09-16T05:31:51.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:31:51 smithi047 bash[22744]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-16T05:31:51.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:31:51 smithi047 bash[22744]: self.do_handshake() 2024-09-16T05:31:51.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:31:51 smithi047 bash[22744]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-16T05:31:51.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:31:51 smithi047 bash[22744]: self._sslobj.do_handshake() 2024-09-16T05:31:51.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:31:51 smithi047 bash[22744]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-16T05:31:52.782 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:31:52 smithi047 bash[22744]: cephadm 2024-09-16T05:31:51.445607+0000 mgr.a (mgr.14150) 6 : cephadm [INF] [16/Sep/2024:05:31:51] ENGINE Serving on http://172.21.15.47:8765 2024-09-16T05:31:52.782 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:31:52 smithi047 bash[22744]: cephadm 2024-09-16T05:31:51.445777+0000 mgr.a (mgr.14150) 7 : cephadm [INF] [16/Sep/2024:05:31:51] ENGINE Bus STARTED 2024-09-16T05:31:52.783 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:31:52 smithi047 bash[22744]: cluster 2024-09-16T05:31:51.493209+0000 mon.a (mon.0) 88 : cluster [DBG] mgrmap e12: a(active, since 2s) 2024-09-16T05:31:53.124 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2024-09-16T05:31:53.124 INFO:teuthology.orchestra.run.smithi047.stdout:Creating initial admin user... 2024-09-16T05:31:53.841 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:31:53 smithi047 bash[22744]: audit 2024-09-16T05:31:52.465797+0000 mgr.a (mgr.14150) 8 : audit [DBG] from='client.14162 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:31:53.841 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:31:53 smithi047 bash[22744]: audit 2024-09-16T05:31:52.551984+0000 mon.a (mon.0) 89 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:31:53.841 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:31:53 smithi047 bash[22744]: audit 2024-09-16T05:31:52.554926+0000 mon.a (mon.0) 90 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:31:55.340 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$V4SHZ/spX7Xcb7tMHwLcTecw9OPTWtS2XvsOEBvTdpYhc5CNUhbvW", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1726464714, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-09-16T05:31:55.340 INFO:teuthology.orchestra.run.smithi047.stdout:Fetching dashboard port number... 2024-09-16T05:31:56.091 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:31:55 smithi047 bash[22744]: audit 2024-09-16T05:31:54.511453+0000 mgr.a (mgr.14150) 9 : audit [DBG] from='client.14164 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:31:56.091 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:31:55 smithi047 bash[22744]: audit 2024-09-16T05:31:54.775034+0000 mon.a (mon.0) 91 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:31:56.982 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:31:56 smithi047 bash[22744]: cluster 2024-09-16T05:31:55.784146+0000 mon.a (mon.0) 92 : cluster [DBG] mgrmap e13: a(active, since 6s) 2024-09-16T05:31:56.982 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:31:56 smithi047 bash[22744]: audit 2024-09-16T05:31:56.326381+0000 mon.a (mon.0) 93 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:31:56.982 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:31:56 smithi047 bash[22744]: audit 2024-09-16T05:31:56.631318+0000 mon.a (mon.0) 94 : audit [DBG] from='client.? 172.21.15.47:0/1073299529' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2024-09-16T05:31:57.229 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stdout 8443 2024-09-16T05:31:57.230 INFO:teuthology.orchestra.run.smithi047.stdout:firewalld does not appear to be present 2024-09-16T05:31:57.230 INFO:teuthology.orchestra.run.smithi047.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2024-09-16T05:31:57.232 INFO:teuthology.orchestra.run.smithi047.stdout:Ceph Dashboard is now available at: 2024-09-16T05:31:57.233 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-16T05:31:57.233 INFO:teuthology.orchestra.run.smithi047.stdout: URL: https://smithi047.front.sepia.ceph.com:8443/ 2024-09-16T05:31:57.233 INFO:teuthology.orchestra.run.smithi047.stdout: User: admin 2024-09-16T05:31:57.233 INFO:teuthology.orchestra.run.smithi047.stdout: Password: k97zywgap4 2024-09-16T05:31:57.233 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-16T05:31:57.233 INFO:teuthology.orchestra.run.smithi047.stdout:Saving cluster configuration to /var/lib/ceph/a6097908-73ec-11ef-bceb-c7b262605968/config directory 2024-09-16T05:31:58.841 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:31:58 smithi047 bash[22744]: audit 2024-09-16T05:31:57.471374+0000 mon.a (mon.0) 95 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:31:59.472 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2024-09-16T05:31:59.472 INFO:teuthology.orchestra.run.smithi047.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-09-16T05:31:59.472 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-16T05:31:59.472 INFO:teuthology.orchestra.run.smithi047.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid a6097908-73ec-11ef-bceb-c7b262605968 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-09-16T05:31:59.472 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-16T05:31:59.472 INFO:teuthology.orchestra.run.smithi047.stdout:Or, if you are only running a single cluster on this host: 2024-09-16T05:31:59.472 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-16T05:31:59.472 INFO:teuthology.orchestra.run.smithi047.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2024-09-16T05:31:59.472 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-16T05:31:59.472 INFO:teuthology.orchestra.run.smithi047.stdout:Please consider enabling telemetry to help improve Ceph: 2024-09-16T05:31:59.473 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-16T05:31:59.473 INFO:teuthology.orchestra.run.smithi047.stdout: ceph telemetry on 2024-09-16T05:31:59.473 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-16T05:31:59.473 INFO:teuthology.orchestra.run.smithi047.stdout:For more information see: 2024-09-16T05:31:59.473 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-16T05:31:59.473 INFO:teuthology.orchestra.run.smithi047.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2024-09-16T05:31:59.473 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-16T05:31:59.473 INFO:teuthology.orchestra.run.smithi047.stdout:Bootstrap complete. 2024-09-16T05:31:59.535 INFO:tasks.cephadm:Fetching config... 2024-09-16T05:31:59.536 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-09-16T05:31:59.536 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-09-16T05:31:59.542 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-09-16T05:31:59.543 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-09-16T05:31:59.543 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-09-16T05:31:59.590 INFO:tasks.cephadm:Fetching mon keyring... 2024-09-16T05:31:59.590 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-09-16T05:31:59.590 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd if=/var/lib/ceph/a6097908-73ec-11ef-bceb-c7b262605968/mon.a/keyring of=/dev/stdout 2024-09-16T05:31:59.646 INFO:tasks.cephadm:Fetching pub ssh key... 2024-09-16T05:31:59.646 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-09-16T05:31:59.647 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-09-16T05:31:59.697 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-09-16T05:31:59.698 DEBUG:teuthology.orchestra.run.smithi047:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDn21uSsmiIilFSpH/e0qkMSvCZ5+oMR15iS/xwu+Q8mJ+BFr1OUaR8qQ3mh9uPVKr3kGfW0eybtzMq4wI7WnQslowGZ1lkZkcMmfEHKTx0S0wVZlLUk9uluwZD9nrBaBEJKbDJXA4WVF+vBO2rEbtt1jAF0qd/TIzGB8aR72oOM0fWm8ZXL6NyM/puQ6zv0auFV0hscUrLEZw1QZb4S54yi/sxQPNH9aRpCeuNUF3bXwTYhL4Mdqz5EBywYTaf5IOXJCVL7b4c60pEvzcpzAf9m9v0rDQuHCg7b4+ebypppWoSLN/wQUlnAxRMTyOsezWNbr/lbD2P37GnaOUiYScI1ZSGtBPvtKgyNbKPCUtOX1a6mTN85E6ou2MnmQ1+q9qnDfaC4THYlIQMAVV89Aexs5Ilz+VuNgjxnceIq8wfSMWieOqJB5OXB9LZC267n+2DuAeRg86MmtBSz24ot3p0jWs42xlD0bvOk2FIkGuUHQJnZUqpUreF3jF8G5q5y3M= ceph-a6097908-73ec-11ef-bceb-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-16T05:31:59.762 INFO:teuthology.orchestra.run.smithi047.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDn21uSsmiIilFSpH/e0qkMSvCZ5+oMR15iS/xwu+Q8mJ+BFr1OUaR8qQ3mh9uPVKr3kGfW0eybtzMq4wI7WnQslowGZ1lkZkcMmfEHKTx0S0wVZlLUk9uluwZD9nrBaBEJKbDJXA4WVF+vBO2rEbtt1jAF0qd/TIzGB8aR72oOM0fWm8ZXL6NyM/puQ6zv0auFV0hscUrLEZw1QZb4S54yi/sxQPNH9aRpCeuNUF3bXwTYhL4Mdqz5EBywYTaf5IOXJCVL7b4c60pEvzcpzAf9m9v0rDQuHCg7b4+ebypppWoSLN/wQUlnAxRMTyOsezWNbr/lbD2P37GnaOUiYScI1ZSGtBPvtKgyNbKPCUtOX1a6mTN85E6ou2MnmQ1+q9qnDfaC4THYlIQMAVV89Aexs5Ilz+VuNgjxnceIq8wfSMWieOqJB5OXB9LZC267n+2DuAeRg86MmtBSz24ot3p0jWs42xlD0bvOk2FIkGuUHQJnZUqpUreF3jF8G5q5y3M= ceph-a6097908-73ec-11ef-bceb-c7b262605968 2024-09-16T05:31:59.771 DEBUG:teuthology.orchestra.run.smithi086:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDn21uSsmiIilFSpH/e0qkMSvCZ5+oMR15iS/xwu+Q8mJ+BFr1OUaR8qQ3mh9uPVKr3kGfW0eybtzMq4wI7WnQslowGZ1lkZkcMmfEHKTx0S0wVZlLUk9uluwZD9nrBaBEJKbDJXA4WVF+vBO2rEbtt1jAF0qd/TIzGB8aR72oOM0fWm8ZXL6NyM/puQ6zv0auFV0hscUrLEZw1QZb4S54yi/sxQPNH9aRpCeuNUF3bXwTYhL4Mdqz5EBywYTaf5IOXJCVL7b4c60pEvzcpzAf9m9v0rDQuHCg7b4+ebypppWoSLN/wQUlnAxRMTyOsezWNbr/lbD2P37GnaOUiYScI1ZSGtBPvtKgyNbKPCUtOX1a6mTN85E6ou2MnmQ1+q9qnDfaC4THYlIQMAVV89Aexs5Ilz+VuNgjxnceIq8wfSMWieOqJB5OXB9LZC267n+2DuAeRg86MmtBSz24ot3p0jWs42xlD0bvOk2FIkGuUHQJnZUqpUreF3jF8G5q5y3M= ceph-a6097908-73ec-11ef-bceb-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-16T05:31:59.795 INFO:teuthology.orchestra.run.smithi086.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDn21uSsmiIilFSpH/e0qkMSvCZ5+oMR15iS/xwu+Q8mJ+BFr1OUaR8qQ3mh9uPVKr3kGfW0eybtzMq4wI7WnQslowGZ1lkZkcMmfEHKTx0S0wVZlLUk9uluwZD9nrBaBEJKbDJXA4WVF+vBO2rEbtt1jAF0qd/TIzGB8aR72oOM0fWm8ZXL6NyM/puQ6zv0auFV0hscUrLEZw1QZb4S54yi/sxQPNH9aRpCeuNUF3bXwTYhL4Mdqz5EBywYTaf5IOXJCVL7b4c60pEvzcpzAf9m9v0rDQuHCg7b4+ebypppWoSLN/wQUlnAxRMTyOsezWNbr/lbD2P37GnaOUiYScI1ZSGtBPvtKgyNbKPCUtOX1a6mTN85E6ou2MnmQ1+q9qnDfaC4THYlIQMAVV89Aexs5Ilz+VuNgjxnceIq8wfSMWieOqJB5OXB9LZC267n+2DuAeRg86MmtBSz24ot3p0jWs42xlD0bvOk2FIkGuUHQJnZUqpUreF3jF8G5q5y3M= ceph-a6097908-73ec-11ef-bceb-c7b262605968 2024-09-16T05:31:59.804 DEBUG:teuthology.orchestra.run.smithi157:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDn21uSsmiIilFSpH/e0qkMSvCZ5+oMR15iS/xwu+Q8mJ+BFr1OUaR8qQ3mh9uPVKr3kGfW0eybtzMq4wI7WnQslowGZ1lkZkcMmfEHKTx0S0wVZlLUk9uluwZD9nrBaBEJKbDJXA4WVF+vBO2rEbtt1jAF0qd/TIzGB8aR72oOM0fWm8ZXL6NyM/puQ6zv0auFV0hscUrLEZw1QZb4S54yi/sxQPNH9aRpCeuNUF3bXwTYhL4Mdqz5EBywYTaf5IOXJCVL7b4c60pEvzcpzAf9m9v0rDQuHCg7b4+ebypppWoSLN/wQUlnAxRMTyOsezWNbr/lbD2P37GnaOUiYScI1ZSGtBPvtKgyNbKPCUtOX1a6mTN85E6ou2MnmQ1+q9qnDfaC4THYlIQMAVV89Aexs5Ilz+VuNgjxnceIq8wfSMWieOqJB5OXB9LZC267n+2DuAeRg86MmtBSz24ot3p0jWs42xlD0bvOk2FIkGuUHQJnZUqpUreF3jF8G5q5y3M= ceph-a6097908-73ec-11ef-bceb-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-16T05:31:59.828 INFO:teuthology.orchestra.run.smithi157.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDn21uSsmiIilFSpH/e0qkMSvCZ5+oMR15iS/xwu+Q8mJ+BFr1OUaR8qQ3mh9uPVKr3kGfW0eybtzMq4wI7WnQslowGZ1lkZkcMmfEHKTx0S0wVZlLUk9uluwZD9nrBaBEJKbDJXA4WVF+vBO2rEbtt1jAF0qd/TIzGB8aR72oOM0fWm8ZXL6NyM/puQ6zv0auFV0hscUrLEZw1QZb4S54yi/sxQPNH9aRpCeuNUF3bXwTYhL4Mdqz5EBywYTaf5IOXJCVL7b4c60pEvzcpzAf9m9v0rDQuHCg7b4+ebypppWoSLN/wQUlnAxRMTyOsezWNbr/lbD2P37GnaOUiYScI1ZSGtBPvtKgyNbKPCUtOX1a6mTN85E6ou2MnmQ1+q9qnDfaC4THYlIQMAVV89Aexs5Ilz+VuNgjxnceIq8wfSMWieOqJB5OXB9LZC267n+2DuAeRg86MmtBSz24ot3p0jWs42xlD0bvOk2FIkGuUHQJnZUqpUreF3jF8G5q5y3M= ceph-a6097908-73ec-11ef-bceb-c7b262605968 2024-09-16T05:31:59.838 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a6097908-73ec-11ef-bceb-c7b262605968 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-09-16T05:32:00.341 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:31:59 smithi047 bash[22744]: audit 2024-09-16T05:31:58.914642+0000 mon.a (mon.0) 96 : audit [INF] from='client.? 172.21.15.47:0/1454991717' entity='client.admin' 2024-09-16T05:32:03.990 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/a6097908-73ec-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T05:32:06.678 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-09-16T05:32:06.679 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a6097908-73ec-11ef-bceb-c7b262605968 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-09-16T05:32:07.090 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:32:06 smithi047 bash[22744]: audit 2024-09-16T05:32:05.765016+0000 mon.a (mon.0) 97 : audit [INF] from='client.? 172.21.15.47:0/2820982910' entity='client.admin' 2024-09-16T05:32:09.841 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:32:09 smithi047 bash[22744]: audit 2024-09-16T05:32:08.453969+0000 mon.a (mon.0) 98 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:32:09.841 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:32:09 smithi047 bash[22744]: audit 2024-09-16T05:32:08.459565+0000 mon.a (mon.0) 99 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:32:09.841 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:32:09 smithi047 bash[22744]: audit 2024-09-16T05:32:08.461725+0000 mon.a (mon.0) 100 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd/host:smithi047", "name": "osd_memory_target"}]: dispatch 2024-09-16T05:32:09.841 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:32:09 smithi047 bash[22744]: audit 2024-09-16T05:32:08.469419+0000 mon.a (mon.0) 101 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:32:09.841 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:32:09 smithi047 bash[22744]: audit 2024-09-16T05:32:08.500853+0000 mon.a (mon.0) 102 : audit [DBG] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T05:32:09.841 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:32:09 smithi047 bash[22744]: audit 2024-09-16T05:32:08.509441+0000 mon.a (mon.0) 103 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:32:10.841 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:32:10 smithi047 bash[22744]: cluster 2024-09-16T05:32:09.444772+0000 mgr.a (mgr.14150) 10 : cluster [DBG] pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T05:32:11.901 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/a6097908-73ec-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T05:32:12.836 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:32:12 smithi047 bash[22744]: cluster 2024-09-16T05:32:11.445192+0000 mgr.a (mgr.14150) 11 : cluster [DBG] pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T05:32:13.846 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi086 2024-09-16T05:32:13.846 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-09-16T05:32:13.846 DEBUG:teuthology.orchestra.run.smithi086:> dd of=/etc/ceph/ceph.conf 2024-09-16T05:32:13.853 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-09-16T05:32:13.853 DEBUG:teuthology.orchestra.run.smithi086:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-16T05:32:13.899 INFO:tasks.cephadm:Adding host smithi086 to orchestrator... 2024-09-16T05:32:13.899 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a6097908-73ec-11ef-bceb-c7b262605968 -- ceph orch host add smithi086 2024-09-16T05:32:14.591 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:32:14 smithi047 bash[22744]: audit 2024-09-16T05:32:13.190712+0000 mgr.a (mgr.14150) 12 : audit [DBG] from='client.14172 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:32:14.591 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:32:14 smithi047 bash[22744]: audit 2024-09-16T05:32:13.193824+0000 mon.a (mon.0) 104 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:32:14.591 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:32:14 smithi047 bash[22744]: audit 2024-09-16T05:32:13.194846+0000 mon.a (mon.0) 105 : audit [DBG] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T05:32:14.591 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:32:14 smithi047 bash[22744]: audit 2024-09-16T05:32:13.197132+0000 mon.a (mon.0) 106 : audit [DBG] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T05:32:14.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:32:14 smithi047 bash[22744]: audit 2024-09-16T05:32:13.198206+0000 mon.a (mon.0) 107 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T05:32:14.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:32:14 smithi047 bash[22744]: cephadm 2024-09-16T05:32:13.199615+0000 mgr.a (mgr.14150) 13 : cephadm [INF] Updating smithi047:/etc/ceph/ceph.conf 2024-09-16T05:32:14.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:32:14 smithi047 bash[22744]: cephadm 2024-09-16T05:32:13.288585+0000 mgr.a (mgr.14150) 14 : cephadm [INF] Updating smithi047:/var/lib/ceph/a6097908-73ec-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-16T05:32:14.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:32:14 smithi047 bash[22744]: cephadm 2024-09-16T05:32:13.370078+0000 mgr.a (mgr.14150) 15 : cephadm [INF] Updating smithi047:/etc/ceph/ceph.client.admin.keyring 2024-09-16T05:32:14.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:32:14 smithi047 bash[22744]: audit 2024-09-16T05:32:13.621960+0000 mon.a (mon.0) 108 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:32:14.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:32:14 smithi047 bash[22744]: audit 2024-09-16T05:32:13.624311+0000 mon.a (mon.0) 109 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:32:14.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:32:14 smithi047 bash[22744]: audit 2024-09-16T05:32:13.627676+0000 mon.a (mon.0) 110 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:32:15.591 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:32:15 smithi047 bash[22744]: cluster 2024-09-16T05:32:13.445663+0000 mgr.a (mgr.14150) 16 : cluster [DBG] pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T05:32:15.591 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:32:15 smithi047 bash[22744]: cephadm 2024-09-16T05:32:13.456033+0000 mgr.a (mgr.14150) 17 : cephadm [INF] Updating smithi047:/var/lib/ceph/a6097908-73ec-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-16T05:32:17.591 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:32:17 smithi047 bash[22744]: cluster 2024-09-16T05:32:15.446097+0000 mgr.a (mgr.14150) 18 : cluster [DBG] pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T05:32:18.631 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/a6097908-73ec-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T05:32:19.591 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:32:19 smithi047 bash[22744]: cluster 2024-09-16T05:32:17.446601+0000 mgr.a (mgr.14150) 19 : cluster [DBG] pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T05:32:21.591 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:32:21 smithi047 bash[22744]: cluster 2024-09-16T05:32:19.447079+0000 mgr.a (mgr.14150) 20 : cluster [DBG] pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T05:32:21.591 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:32:21 smithi047 bash[22744]: audit 2024-09-16T05:32:19.987979+0000 mgr.a (mgr.14150) 21 : audit [DBG] from='client.14174 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi086", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:32:22.591 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:32:22 smithi047 bash[22744]: cephadm 2024-09-16T05:32:21.286702+0000 mgr.a (mgr.14150) 22 : cephadm [INF] Deploying cephadm binary to smithi086 2024-09-16T05:32:23.591 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:32:23 smithi047 bash[22744]: cluster 2024-09-16T05:32:21.447439+0000 mgr.a (mgr.14150) 23 : cluster [DBG] pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T05:32:24.970 INFO:teuthology.orchestra.run.smithi047.stdout:Added host 'smithi086' with addr '172.21.15.86' 2024-09-16T05:32:25.341 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:32:25 smithi047 bash[22744]: cluster 2024-09-16T05:32:23.447812+0000 mgr.a (mgr.14150) 24 : cluster [DBG] pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T05:32:25.341 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:32:25 smithi047 bash[22744]: audit 2024-09-16T05:32:24.968611+0000 mon.a (mon.0) 111 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:32:25.341 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:32:25 smithi047 bash[22744]: audit 2024-09-16T05:32:24.970385+0000 mon.a (mon.0) 112 : audit [DBG] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T05:32:25.674 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a6097908-73ec-11ef-bceb-c7b262605968 -- ceph orch host ls --format=json 2024-09-16T05:32:26.591 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:32:26 smithi047 bash[22744]: cephadm 2024-09-16T05:32:24.969531+0000 mgr.a (mgr.14150) 25 : cephadm [INF] Added host smithi086 2024-09-16T05:32:26.591 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:32:26 smithi047 bash[22744]: audit 2024-09-16T05:32:25.519641+0000 mon.a (mon.0) 113 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:32:27.591 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:32:27 smithi047 bash[22744]: cluster 2024-09-16T05:32:25.448221+0000 mgr.a (mgr.14150) 26 : cluster [DBG] pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T05:32:27.591 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:32:27 smithi047 bash[22744]: audit 2024-09-16T05:32:27.048512+0000 mon.a (mon.0) 114 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:32:29.591 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:32:29 smithi047 bash[22744]: cluster 2024-09-16T05:32:27.448705+0000 mgr.a (mgr.14150) 27 : cluster [DBG] pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T05:32:29.591 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:32:29 smithi047 bash[22744]: audit 2024-09-16T05:32:28.283552+0000 mon.a (mon.0) 115 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:32:30.412 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/a6097908-73ec-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T05:32:31.591 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:32:31 smithi047 bash[22744]: cluster 2024-09-16T05:32:29.449212+0000 mgr.a (mgr.14150) 28 : cluster [DBG] pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T05:32:31.722 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-16T05:32:31.722 INFO:teuthology.orchestra.run.smithi047.stdout:[{"addr": "172.21.15.47", "hostname": "smithi047", "labels": [], "status": ""}, {"addr": "172.21.15.86", "hostname": "smithi086", "labels": [], "status": ""}] 2024-09-16T05:32:32.349 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi157 2024-09-16T05:32:32.349 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-09-16T05:32:32.349 DEBUG:teuthology.orchestra.run.smithi157:> dd of=/etc/ceph/ceph.conf 2024-09-16T05:32:32.355 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-09-16T05:32:32.355 DEBUG:teuthology.orchestra.run.smithi157:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-16T05:32:32.402 INFO:tasks.cephadm:Adding host smithi157 to orchestrator... 2024-09-16T05:32:32.403 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a6097908-73ec-11ef-bceb-c7b262605968 -- ceph orch host add smithi157 2024-09-16T05:32:33.591 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:32:33 smithi047 bash[22744]: cluster 2024-09-16T05:32:31.449542+0000 mgr.a (mgr.14150) 29 : cluster [DBG] pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T05:32:33.591 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:32:33 smithi047 bash[22744]: audit 2024-09-16T05:32:31.721514+0000 mgr.a (mgr.14150) 30 : audit [DBG] from='client.14176 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-16T05:32:35.591 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:32:35 smithi047 bash[22744]: cluster 2024-09-16T05:32:33.449921+0000 mgr.a (mgr.14150) 31 : cluster [DBG] pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T05:32:35.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:32:35 smithi047 bash[22744]: audit 2024-09-16T05:32:34.243193+0000 mon.a (mon.0) 116 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:32:35.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:32:35 smithi047 bash[22744]: audit 2024-09-16T05:32:34.248400+0000 mon.a (mon.0) 117 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:32:35.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:32:35 smithi047 bash[22744]: audit 2024-09-16T05:32:34.254214+0000 mon.a (mon.0) 118 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:32:35.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:32:35 smithi047 bash[22744]: audit 2024-09-16T05:32:34.259150+0000 mon.a (mon.0) 119 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:32:35.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:32:35 smithi047 bash[22744]: audit 2024-09-16T05:32:34.260880+0000 mon.a (mon.0) 120 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd/host:smithi086", "name": "osd_memory_target"}]: dispatch 2024-09-16T05:32:35.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:32:35 smithi047 bash[22744]: audit 2024-09-16T05:32:34.262662+0000 mon.a (mon.0) 121 : audit [DBG] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T05:32:35.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:32:35 smithi047 bash[22744]: audit 2024-09-16T05:32:34.264250+0000 mon.a (mon.0) 122 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T05:32:35.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:32:35 smithi047 bash[22744]: cephadm 2024-09-16T05:32:34.266649+0000 mgr.a (mgr.14150) 32 : cephadm [INF] Updating smithi086:/etc/ceph/ceph.conf 2024-09-16T05:32:35.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:32:35 smithi047 bash[22744]: audit 2024-09-16T05:32:34.897104+0000 mon.a (mon.0) 123 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:32:35.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:32:35 smithi047 bash[22744]: audit 2024-09-16T05:32:34.902119+0000 mon.a (mon.0) 124 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:32:35.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:32:35 smithi047 bash[22744]: audit 2024-09-16T05:32:34.907959+0000 mon.a (mon.0) 125 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:32:36.591 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:32:36 smithi047 bash[22744]: cephadm 2024-09-16T05:32:34.453496+0000 mgr.a (mgr.14150) 33 : cephadm [INF] Updating smithi086:/var/lib/ceph/a6097908-73ec-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-16T05:32:36.591 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:32:36 smithi047 bash[22744]: cephadm 2024-09-16T05:32:34.610262+0000 mgr.a (mgr.14150) 34 : cephadm [INF] Updating smithi086:/etc/ceph/ceph.client.admin.keyring 2024-09-16T05:32:36.591 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:32:36 smithi047 bash[22744]: cephadm 2024-09-16T05:32:34.754529+0000 mgr.a (mgr.14150) 35 : cephadm [INF] Updating smithi086:/var/lib/ceph/a6097908-73ec-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-16T05:32:37.138 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/a6097908-73ec-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T05:32:37.591 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:32:37 smithi047 bash[22744]: cluster 2024-09-16T05:32:35.450337+0000 mgr.a (mgr.14150) 36 : cluster [DBG] pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T05:32:39.591 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:32:39 smithi047 bash[22744]: cluster 2024-09-16T05:32:37.450768+0000 mgr.a (mgr.14150) 37 : cluster [DBG] pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T05:32:40.591 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:32:40 smithi047 bash[22744]: audit 2024-09-16T05:32:38.552455+0000 mgr.a (mgr.14150) 38 : audit [DBG] from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi157", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:32:41.591 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:32:41 smithi047 bash[22744]: cluster 2024-09-16T05:32:39.451211+0000 mgr.a (mgr.14150) 39 : cluster [DBG] pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T05:32:41.591 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:32:41 smithi047 bash[22744]: cephadm 2024-09-16T05:32:39.866818+0000 mgr.a (mgr.14150) 40 : cephadm [INF] Deploying cephadm binary to smithi157 2024-09-16T05:32:43.591 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:32:43 smithi047 bash[22744]: cluster 2024-09-16T05:32:41.451554+0000 mgr.a (mgr.14150) 41 : cluster [DBG] pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T05:32:43.606 INFO:teuthology.orchestra.run.smithi047.stdout:Added host 'smithi157' with addr '172.21.15.157' 2024-09-16T05:32:44.345 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a6097908-73ec-11ef-bceb-c7b262605968 -- ceph orch host ls --format=json 2024-09-16T05:32:45.091 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:32:44 smithi047 bash[22744]: cluster 2024-09-16T05:32:43.451965+0000 mgr.a (mgr.14150) 42 : cluster [DBG] pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T05:32:45.091 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:32:44 smithi047 bash[22744]: audit 2024-09-16T05:32:43.605167+0000 mon.a (mon.0) 126 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:32:45.091 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:32:44 smithi047 bash[22744]: cephadm 2024-09-16T05:32:43.605980+0000 mgr.a (mgr.14150) 43 : cephadm [INF] Added host smithi157 2024-09-16T05:32:45.091 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:32:44 smithi047 bash[22744]: audit 2024-09-16T05:32:43.606767+0000 mon.a (mon.0) 127 : audit [DBG] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T05:32:45.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:32:44 smithi047 bash[22744]: audit 2024-09-16T05:32:44.116598+0000 mon.a (mon.0) 128 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:32:47.091 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:32:46 smithi047 bash[22744]: cluster 2024-09-16T05:32:45.452362+0000 mgr.a (mgr.14150) 44 : cluster [DBG] pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T05:32:47.091 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:32:46 smithi047 bash[22744]: audit 2024-09-16T05:32:45.631776+0000 mon.a (mon.0) 129 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:32:48.091 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:32:47 smithi047 bash[22744]: audit 2024-09-16T05:32:46.824170+0000 mon.a (mon.0) 130 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:32:49.081 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/a6097908-73ec-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T05:32:49.091 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:32:48 smithi047 bash[22744]: cluster 2024-09-16T05:32:47.452862+0000 mgr.a (mgr.14150) 45 : cluster [DBG] pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T05:32:50.593 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-16T05:32:50.593 INFO:teuthology.orchestra.run.smithi047.stdout:[{"addr": "172.21.15.47", "hostname": "smithi047", "labels": [], "status": ""}, {"addr": "172.21.15.86", "hostname": "smithi086", "labels": [], "status": ""}, {"addr": "172.21.15.157", "hostname": "smithi157", "labels": [], "status": ""}] 2024-09-16T05:32:51.091 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:32:50 smithi047 bash[22744]: cluster 2024-09-16T05:32:49.453309+0000 mgr.a (mgr.14150) 46 : cluster [DBG] pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T05:32:51.224 INFO:tasks.cephadm:Setting crush tunables to default 2024-09-16T05:32:51.224 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a6097908-73ec-11ef-bceb-c7b262605968 -- ceph osd crush tunables default 2024-09-16T05:32:52.091 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:32:51 smithi047 bash[22744]: audit 2024-09-16T05:32:50.592978+0000 mgr.a (mgr.14150) 47 : audit [DBG] from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-16T05:32:53.091 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:32:52 smithi047 bash[22744]: cluster 2024-09-16T05:32:51.453700+0000 mgr.a (mgr.14150) 48 : cluster [DBG] pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T05:32:53.091 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:32:52 smithi047 bash[22744]: audit 2024-09-16T05:32:52.410840+0000 mon.a (mon.0) 131 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:32:53.091 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:32:52 smithi047 bash[22744]: audit 2024-09-16T05:32:52.416053+0000 mon.a (mon.0) 132 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:32:53.091 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:32:52 smithi047 bash[22744]: audit 2024-09-16T05:32:52.422052+0000 mon.a (mon.0) 133 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:32:53.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:32:52 smithi047 bash[22744]: audit 2024-09-16T05:32:52.427124+0000 mon.a (mon.0) 134 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:32:53.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:32:52 smithi047 bash[22744]: audit 2024-09-16T05:32:52.428856+0000 mon.a (mon.0) 135 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd/host:smithi157", "name": "osd_memory_target"}]: dispatch 2024-09-16T05:32:53.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:32:52 smithi047 bash[22744]: audit 2024-09-16T05:32:52.430869+0000 mon.a (mon.0) 136 : audit [DBG] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T05:32:53.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:32:52 smithi047 bash[22744]: audit 2024-09-16T05:32:52.432545+0000 mon.a (mon.0) 137 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T05:32:54.341 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:32:54 smithi047 bash[22744]: cephadm 2024-09-16T05:32:52.435024+0000 mgr.a (mgr.14150) 49 : cephadm [INF] Updating smithi157:/etc/ceph/ceph.conf 2024-09-16T05:32:54.341 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:32:54 smithi047 bash[22744]: cephadm 2024-09-16T05:32:52.616703+0000 mgr.a (mgr.14150) 50 : cephadm [INF] Updating smithi157:/var/lib/ceph/a6097908-73ec-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-16T05:32:54.341 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:32:54 smithi047 bash[22744]: cephadm 2024-09-16T05:32:52.777115+0000 mgr.a (mgr.14150) 51 : cephadm [INF] Updating smithi157:/etc/ceph/ceph.client.admin.keyring 2024-09-16T05:32:54.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:32:54 smithi047 bash[22744]: cephadm 2024-09-16T05:32:52.930902+0000 mgr.a (mgr.14150) 52 : cephadm [INF] Updating smithi157:/var/lib/ceph/a6097908-73ec-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-16T05:32:54.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:32:54 smithi047 bash[22744]: audit 2024-09-16T05:32:53.083633+0000 mon.a (mon.0) 138 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:32:54.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:32:54 smithi047 bash[22744]: audit 2024-09-16T05:32:53.088719+0000 mon.a (mon.0) 139 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:32:54.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:32:54 smithi047 bash[22744]: audit 2024-09-16T05:32:53.094679+0000 mon.a (mon.0) 140 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:32:55.591 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:32:55 smithi047 bash[22744]: cluster 2024-09-16T05:32:53.454069+0000 mgr.a (mgr.14150) 53 : cluster [DBG] pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T05:32:55.962 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/a6097908-73ec-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T05:32:57.341 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:32:57 smithi047 bash[22744]: cluster 2024-09-16T05:32:55.454494+0000 mgr.a (mgr.14150) 54 : cluster [DBG] pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T05:32:58.104 INFO:teuthology.orchestra.run.smithi047.stderr:adjusted tunables profile to default 2024-09-16T05:32:58.591 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:32:58 smithi047 bash[22744]: audit 2024-09-16T05:32:57.327962+0000 mon.a (mon.0) 141 : audit [INF] from='client.? 172.21.15.47:0/498781588' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-09-16T05:32:58.802 INFO:tasks.cephadm:Adding mon.a on smithi047 2024-09-16T05:32:58.802 INFO:tasks.cephadm:Adding mon.b on smithi086 2024-09-16T05:32:58.802 INFO:tasks.cephadm:Adding mon.c on smithi157 2024-09-16T05:32:58.802 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a6097908-73ec-11ef-bceb-c7b262605968 -- ceph orch apply mon '3;smithi047:172.21.15.47=a;smithi086:172.21.15.86=b;smithi157:172.21.15.157=c' 2024-09-16T05:32:59.591 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:32:59 smithi047 bash[22744]: cluster 2024-09-16T05:32:57.454830+0000 mgr.a (mgr.14150) 55 : cluster [DBG] pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T05:32:59.591 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:32:59 smithi047 bash[22744]: audit 2024-09-16T05:32:58.100684+0000 mon.a (mon.0) 142 : audit [INF] from='client.? 172.21.15.47:0/498781588' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-16T05:32:59.591 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:32:59 smithi047 bash[22744]: cluster 2024-09-16T05:32:58.105093+0000 mon.a (mon.0) 143 : cluster [DBG] osdmap e4: 0 total, 0 up, 0 in 2024-09-16T05:33:00.029 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /var/lib/ceph/a6097908-73ec-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-16T05:33:01.461 INFO:teuthology.orchestra.run.smithi157.stdout:Scheduled mon update... 2024-09-16T05:33:01.591 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:33:01 smithi047 bash[22744]: cluster 2024-09-16T05:32:59.455213+0000 mgr.a (mgr.14150) 56 : cluster [DBG] pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T05:33:02.055 DEBUG:teuthology.orchestra.run.smithi086:mon.b> sudo journalctl -f -n 0 -u ceph-a6097908-73ec-11ef-bceb-c7b262605968@mon.b.service 2024-09-16T05:33:02.057 DEBUG:teuthology.orchestra.run.smithi157:mon.c> sudo journalctl -f -n 0 -u ceph-a6097908-73ec-11ef-bceb-c7b262605968@mon.c.service 2024-09-16T05:33:02.059 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-16T05:33:02.060 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a6097908-73ec-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-16T05:33:02.841 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:33:02 smithi047 bash[22744]: audit 2024-09-16T05:33:01.449927+0000 mgr.a (mgr.14150) 57 : audit [DBG] from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi047:172.21.15.47=a;smithi086:172.21.15.86=b;smithi157:172.21.15.157=c", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:33:02.841 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:33:02 smithi047 bash[22744]: cephadm 2024-09-16T05:33:01.455159+0000 mgr.a (mgr.14150) 58 : cephadm [INF] Saving service mon spec with placement smithi047:172.21.15.47=a;smithi086:172.21.15.86=b;smithi157:172.21.15.157=c;count:3 2024-09-16T05:33:02.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:33:02 smithi047 bash[22744]: cluster 2024-09-16T05:33:01.455705+0000 mgr.a (mgr.14150) 59 : cluster [DBG] pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T05:33:02.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:33:02 smithi047 bash[22744]: audit 2024-09-16T05:33:01.460272+0000 mon.a (mon.0) 144 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:33:02.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:33:02 smithi047 bash[22744]: audit 2024-09-16T05:33:01.462010+0000 mon.a (mon.0) 145 : audit [DBG] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T05:33:02.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:33:02 smithi047 bash[22744]: audit 2024-09-16T05:33:02.191376+0000 mon.a (mon.0) 146 : audit [DBG] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T05:33:02.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:33:02 smithi047 bash[22744]: audit 2024-09-16T05:33:02.192940+0000 mon.a (mon.0) 147 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T05:33:02.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:33:02 smithi047 bash[22744]: audit 2024-09-16T05:33:02.200156+0000 mon.a (mon.0) 148 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:33:02.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:33:02 smithi047 bash[22744]: audit 2024-09-16T05:33:02.203850+0000 mon.a (mon.0) 149 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-16T05:33:02.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:33:02 smithi047 bash[22744]: audit 2024-09-16T05:33:02.205549+0000 mon.a (mon.0) 150 : audit [DBG] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T05:33:02.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:33:02 smithi047 bash[22744]: cephadm 2024-09-16T05:33:02.207336+0000 mgr.a (mgr.14150) 60 : cephadm [INF] Deploying daemon mon.c on smithi157 2024-09-16T05:33:03.326 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /var/lib/ceph/a6097908-73ec-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-16T05:33:04.841 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:33:04 smithi047 bash[22744]: cluster 2024-09-16T05:33:03.456089+0000 mgr.a (mgr.14150) 61 : cluster [DBG] pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T05:33:05.131 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-16T05:33:05.132 INFO:teuthology.orchestra.run.smithi157.stdout:{"epoch":1,"fsid":"a6097908-73ec-11ef-bceb-c7b262605968","modified":"2024-09-16T05:30:45.222800Z","created":"2024-09-16T05:30:45.222800Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:3300","nonce":0},{"type":"v1","addr":"172.21.15.47:6789","nonce":0}]},"addr":"172.21.15.47:6789/0","public_addr":"172.21.15.47:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-16T05:33:05.132 INFO:teuthology.orchestra.run.smithi157.stderr:dumped monmap epoch 1 2024-09-16T05:33:05.841 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:33:05 smithi047 bash[22744]: audit 2024-09-16T05:33:05.131460+0000 mon.a (mon.0) 151 : audit [DBG] from='client.? 172.21.15.157:0/951322436' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-16T05:33:06.841 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:33:06 smithi047 bash[22744]: cluster 2024-09-16T05:33:05.456472+0000 mgr.a (mgr.14150) 62 : cluster [DBG] pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T05:33:07.066 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-16T05:33:07.066 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a6097908-73ec-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-16T05:33:08.291 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /var/lib/ceph/a6097908-73ec-11ef-bceb-c7b262605968/mon.c/config 2024-09-16T05:33:09.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:33:09 smithi047 bash[22744]: cluster 2024-09-16T05:33:07.456885+0000 mgr.a (mgr.14150) 63 : cluster [DBG] pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T05:33:09.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:33:09 smithi047 bash[22744]: audit 2024-09-16T05:33:08.155670+0000 mon.a (mon.0) 152 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:33:09.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:33:09 smithi047 bash[22744]: audit 2024-09-16T05:33:08.160970+0000 mon.a (mon.0) 153 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:33:09.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:33:09 smithi047 bash[22744]: audit 2024-09-16T05:33:08.168289+0000 mon.a (mon.0) 154 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:33:09.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:33:09 smithi047 bash[22744]: audit 2024-09-16T05:33:08.169621+0000 mon.a (mon.0) 155 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-16T05:33:09.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:33:09 smithi047 bash[22744]: audit 2024-09-16T05:33:08.171355+0000 mon.a (mon.0) 156 : audit [DBG] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T05:33:09.594 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:33:09 smithi047 bash[22744]: cephadm 2024-09-16T05:33:08.173301+0000 mgr.a (mgr.14150) 64 : cephadm [INF] Deploying daemon mon.b on smithi086 2024-09-16T05:33:09.874 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:33:09 smithi157 bash[24585]: audit 2024-09-16T05:32:31.721514+0000 mgr.a (mgr.14150) 30 : audit [DBG] from='client.14176 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-16T05:33:09.875 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:33:09 smithi157 bash[24585]: cluster 2024-09-16T05:32:33.449921+0000 mgr.a (mgr.14150) 31 : cluster [DBG] pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T05:33:09.875 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:33:09 smithi157 bash[24585]: audit 2024-09-16T05:32:34.243193+0000 mon.a (mon.0) 116 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:33:09.875 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:33:09 smithi157 bash[24585]: audit 2024-09-16T05:32:34.248400+0000 mon.a (mon.0) 117 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:33:09.875 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:33:09 smithi157 bash[24585]: audit 2024-09-16T05:32:34.254214+0000 mon.a (mon.0) 118 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:33:09.875 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:33:09 smithi157 bash[24585]: audit 2024-09-16T05:32:34.259150+0000 mon.a (mon.0) 119 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:33:10.055 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:33:09 smithi157 bash[24585]: audit 2024-09-16T05:32:34.260880+0000 mon.a (mon.0) 120 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd/host:smithi086", "name": "osd_memory_target"}]: dispatch 2024-09-16T05:33:10.055 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:33:09 smithi157 bash[24585]: audit 2024-09-16T05:32:34.262662+0000 mon.a (mon.0) 121 : audit [DBG] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T05:33:10.055 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:33:09 smithi157 bash[24585]: audit 2024-09-16T05:32:34.264250+0000 mon.a (mon.0) 122 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T05:33:10.055 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:33:09 smithi157 bash[24585]: cephadm 2024-09-16T05:32:34.266649+0000 mgr.a (mgr.14150) 32 : cephadm [INF] Updating smithi086:/etc/ceph/ceph.conf 2024-09-16T05:33:10.055 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:33:09 smithi157 bash[24585]: audit 2024-09-16T05:32:34.897104+0000 mon.a (mon.0) 123 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:33:10.055 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:33:09 smithi157 bash[24585]: audit 2024-09-16T05:32:34.902119+0000 mon.a (mon.0) 124 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:33:10.055 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:33:09 smithi157 bash[24585]: audit 2024-09-16T05:32:34.907959+0000 mon.a (mon.0) 125 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:33:10.055 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:33:09 smithi157 bash[24585]: cephadm 2024-09-16T05:32:34.453496+0000 mgr.a (mgr.14150) 33 : cephadm [INF] Updating smithi086:/var/lib/ceph/a6097908-73ec-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-16T05:33:10.055 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:33:09 smithi157 bash[24585]: cephadm 2024-09-16T05:32:34.610262+0000 mgr.a (mgr.14150) 34 : cephadm [INF] Updating smithi086:/etc/ceph/ceph.client.admin.keyring 2024-09-16T05:33:10.055 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:33:09 smithi157 bash[24585]: cephadm 2024-09-16T05:32:34.754529+0000 mgr.a (mgr.14150) 35 : cephadm [INF] Updating smithi086:/var/lib/ceph/a6097908-73ec-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-16T05:33:10.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:33:09 smithi157 bash[24585]: cluster 2024-09-16T05:32:35.450337+0000 mgr.a (mgr.14150) 36 : cluster [DBG] pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T05:33:10.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:33:09 smithi157 bash[24585]: cluster 2024-09-16T05:32:37.450768+0000 mgr.a (mgr.14150) 37 : cluster [DBG] pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T05:33:10.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:33:09 smithi157 bash[24585]: audit 2024-09-16T05:32:38.552455+0000 mgr.a (mgr.14150) 38 : audit [DBG] from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi157", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:33:10.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:33:09 smithi157 bash[24585]: cluster 2024-09-16T05:32:39.451211+0000 mgr.a (mgr.14150) 39 : cluster [DBG] pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T05:33:10.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:33:09 smithi157 bash[24585]: cephadm 2024-09-16T05:32:39.866818+0000 mgr.a (mgr.14150) 40 : cephadm [INF] Deploying cephadm binary to smithi157 2024-09-16T05:33:10.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:33:09 smithi157 bash[24585]: cluster 2024-09-16T05:32:41.451554+0000 mgr.a (mgr.14150) 41 : cluster [DBG] pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T05:33:10.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:33:09 smithi157 bash[24585]: cluster 2024-09-16T05:32:43.451965+0000 mgr.a (mgr.14150) 42 : cluster [DBG] pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T05:33:10.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:33:09 smithi157 bash[24585]: audit 2024-09-16T05:32:43.605167+0000 mon.a (mon.0) 126 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:33:10.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:33:09 smithi157 bash[24585]: cephadm 2024-09-16T05:32:43.605980+0000 mgr.a (mgr.14150) 43 : cephadm [INF] Added host smithi157 2024-09-16T05:33:10.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:33:09 smithi157 bash[24585]: audit 2024-09-16T05:32:43.606767+0000 mon.a (mon.0) 127 : audit [DBG] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T05:33:10.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:33:09 smithi157 bash[24585]: audit 2024-09-16T05:32:44.116598+0000 mon.a (mon.0) 128 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:33:10.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:33:09 smithi157 bash[24585]: cluster 2024-09-16T05:32:45.452362+0000 mgr.a (mgr.14150) 44 : cluster [DBG] pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T05:33:10.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:33:09 smithi157 bash[24585]: audit 2024-09-16T05:32:45.631776+0000 mon.a (mon.0) 129 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:33:10.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:33:09 smithi157 bash[24585]: audit 2024-09-16T05:32:46.824170+0000 mon.a (mon.0) 130 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:33:10.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:33:09 smithi157 bash[24585]: cluster 2024-09-16T05:32:47.452862+0000 mgr.a (mgr.14150) 45 : cluster [DBG] pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T05:33:10.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:33:09 smithi157 bash[24585]: cluster 2024-09-16T05:32:49.453309+0000 mgr.a (mgr.14150) 46 : cluster [DBG] pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T05:33:10.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:33:09 smithi157 bash[24585]: audit 2024-09-16T05:32:50.592978+0000 mgr.a (mgr.14150) 47 : audit [DBG] from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-16T05:33:10.058 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:33:09 smithi157 bash[24585]: cluster 2024-09-16T05:32:51.453700+0000 mgr.a (mgr.14150) 48 : cluster [DBG] pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T05:33:10.058 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:33:09 smithi157 bash[24585]: audit 2024-09-16T05:32:52.410840+0000 mon.a (mon.0) 131 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:33:10.058 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:33:09 smithi157 bash[24585]: audit 2024-09-16T05:32:52.416053+0000 mon.a (mon.0) 132 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:33:10.058 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:33:09 smithi157 bash[24585]: audit 2024-09-16T05:32:52.422052+0000 mon.a (mon.0) 133 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:33:10.058 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:33:09 smithi157 bash[24585]: audit 2024-09-16T05:32:52.427124+0000 mon.a (mon.0) 134 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:33:10.058 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:33:09 smithi157 bash[24585]: audit 2024-09-16T05:32:52.428856+0000 mon.a (mon.0) 135 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd/host:smithi157", "name": "osd_memory_target"}]: dispatch 2024-09-16T05:33:10.058 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:33:09 smithi157 bash[24585]: audit 2024-09-16T05:32:52.430869+0000 mon.a (mon.0) 136 : audit [DBG] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T05:33:10.058 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:33:09 smithi157 bash[24585]: audit 2024-09-16T05:32:52.432545+0000 mon.a (mon.0) 137 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T05:33:10.058 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:33:09 smithi157 bash[24585]: cephadm 2024-09-16T05:32:52.435024+0000 mgr.a (mgr.14150) 49 : cephadm [INF] Updating smithi157:/etc/ceph/ceph.conf 2024-09-16T05:33:10.058 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:33:09 smithi157 bash[24585]: cephadm 2024-09-16T05:32:52.616703+0000 mgr.a (mgr.14150) 50 : cephadm [INF] Updating smithi157:/var/lib/ceph/a6097908-73ec-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-16T05:33:10.058 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:33:09 smithi157 bash[24585]: cephadm 2024-09-16T05:32:52.777115+0000 mgr.a (mgr.14150) 51 : cephadm [INF] Updating smithi157:/etc/ceph/ceph.client.admin.keyring 2024-09-16T05:33:10.058 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:33:09 smithi157 bash[24585]: cephadm 2024-09-16T05:32:52.930902+0000 mgr.a (mgr.14150) 52 : cephadm [INF] Updating smithi157:/var/lib/ceph/a6097908-73ec-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-16T05:33:10.058 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:33:09 smithi157 bash[24585]: audit 2024-09-16T05:32:53.083633+0000 mon.a (mon.0) 138 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:33:10.059 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:33:09 smithi157 bash[24585]: audit 2024-09-16T05:32:53.088719+0000 mon.a (mon.0) 139 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:33:10.059 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:33:09 smithi157 bash[24585]: audit 2024-09-16T05:32:53.094679+0000 mon.a (mon.0) 140 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:33:10.059 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:33:09 smithi157 bash[24585]: cluster 2024-09-16T05:32:53.454069+0000 mgr.a (mgr.14150) 53 : cluster [DBG] pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T05:33:10.059 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:33:09 smithi157 bash[24585]: cluster 2024-09-16T05:32:55.454494+0000 mgr.a (mgr.14150) 54 : cluster [DBG] pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T05:33:10.059 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:33:09 smithi157 bash[24585]: audit 2024-09-16T05:32:57.327962+0000 mon.a (mon.0) 141 : audit [INF] from='client.? 172.21.15.47:0/498781588' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-09-16T05:33:10.059 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:33:09 smithi157 bash[24585]: cluster 2024-09-16T05:32:57.454830+0000 mgr.a (mgr.14150) 55 : cluster [DBG] pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T05:33:10.059 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:33:09 smithi157 bash[24585]: audit 2024-09-16T05:32:58.100684+0000 mon.a (mon.0) 142 : audit [INF] from='client.? 172.21.15.47:0/498781588' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-16T05:33:10.059 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:33:09 smithi157 bash[24585]: cluster 2024-09-16T05:32:58.105093+0000 mon.a (mon.0) 143 : cluster [DBG] osdmap e4: 0 total, 0 up, 0 in 2024-09-16T05:33:10.059 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:33:09 smithi157 bash[24585]: cluster 2024-09-16T05:32:59.455213+0000 mgr.a (mgr.14150) 56 : cluster [DBG] pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T05:33:10.059 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:33:09 smithi157 bash[24585]: audit 2024-09-16T05:33:01.449927+0000 mgr.a (mgr.14150) 57 : audit [DBG] from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi047:172.21.15.47=a;smithi086:172.21.15.86=b;smithi157:172.21.15.157=c", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:33:10.059 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:33:09 smithi157 bash[24585]: cephadm 2024-09-16T05:33:01.455159+0000 mgr.a (mgr.14150) 58 : cephadm [INF] Saving service mon spec with placement smithi047:172.21.15.47=a;smithi086:172.21.15.86=b;smithi157:172.21.15.157=c;count:3 2024-09-16T05:33:10.059 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:33:09 smithi157 bash[24585]: cluster 2024-09-16T05:33:01.455705+0000 mgr.a (mgr.14150) 59 : cluster [DBG] pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T05:33:10.059 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:33:09 smithi157 bash[24585]: audit 2024-09-16T05:33:01.460272+0000 mon.a (mon.0) 144 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:33:10.059 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:33:09 smithi157 bash[24585]: audit 2024-09-16T05:33:01.462010+0000 mon.a (mon.0) 145 : audit [DBG] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T05:33:10.060 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:33:09 smithi157 bash[24585]: audit 2024-09-16T05:33:02.191376+0000 mon.a (mon.0) 146 : audit [DBG] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T05:33:10.060 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:33:09 smithi157 bash[24585]: audit 2024-09-16T05:33:02.192940+0000 mon.a (mon.0) 147 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T05:33:10.060 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:33:09 smithi157 bash[24585]: audit 2024-09-16T05:33:02.200156+0000 mon.a (mon.0) 148 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:33:10.060 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:33:09 smithi157 bash[24585]: audit 2024-09-16T05:33:02.203850+0000 mon.a (mon.0) 149 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-16T05:33:10.060 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:33:09 smithi157 bash[24585]: audit 2024-09-16T05:33:02.205549+0000 mon.a (mon.0) 150 : audit [DBG] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T05:33:10.060 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:33:09 smithi157 bash[24585]: cephadm 2024-09-16T05:33:02.207336+0000 mgr.a (mgr.14150) 60 : cephadm [INF] Deploying daemon mon.c on smithi157 2024-09-16T05:33:10.060 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:33:09 smithi157 bash[24585]: cluster 2024-09-16T05:33:03.456089+0000 mgr.a (mgr.14150) 61 : cluster [DBG] pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T05:33:10.060 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:33:09 smithi157 bash[24585]: audit 2024-09-16T05:33:05.131460+0000 mon.a (mon.0) 151 : audit [DBG] from='client.? 172.21.15.157:0/951322436' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-16T05:33:10.060 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:33:09 smithi157 bash[24585]: cluster 2024-09-16T05:33:05.456472+0000 mgr.a (mgr.14150) 62 : cluster [DBG] pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T05:33:10.060 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:33:09 smithi157 bash[24585]: cluster 2024-09-16T05:33:07.456885+0000 mgr.a (mgr.14150) 63 : cluster [DBG] pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T05:33:10.060 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:33:09 smithi157 bash[24585]: audit 2024-09-16T05:33:08.155670+0000 mon.a (mon.0) 152 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:33:10.060 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:33:09 smithi157 bash[24585]: audit 2024-09-16T05:33:08.160970+0000 mon.a (mon.0) 153 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:33:10.060 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:33:09 smithi157 bash[24585]: audit 2024-09-16T05:33:08.168289+0000 mon.a (mon.0) 154 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:33:10.061 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:33:09 smithi157 bash[24585]: audit 2024-09-16T05:33:08.169621+0000 mon.a (mon.0) 155 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-16T05:33:10.061 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:33:09 smithi157 bash[24585]: audit 2024-09-16T05:33:08.171355+0000 mon.a (mon.0) 156 : audit [DBG] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T05:33:10.061 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:33:09 smithi157 bash[24585]: cephadm 2024-09-16T05:33:08.173301+0000 mgr.a (mgr.14150) 64 : cephadm [INF] Deploying daemon mon.b on smithi086 2024-09-16T05:33:10.061 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:33:09 smithi157 bash[24585]: debug 2024-09-16T05:33:09.869+0000 7f421ddaf640 1 mon.c@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2024-09-16T05:33:13.928 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:33:13 smithi086 bash[24289]: audit 2024-09-16T05:32:44.116598+0000 mon.a (mon.0) 128 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:33:13.928 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:33:13 smithi086 bash[24289]: cluster 2024-09-16T05:32:45.452362+0000 mgr.a (mgr.14150) 44 : cluster [DBG] pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T05:33:13.928 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:33:13 smithi086 bash[24289]: audit 2024-09-16T05:32:45.631776+0000 mon.a (mon.0) 129 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:33:13.928 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:33:13 smithi086 bash[24289]: audit 2024-09-16T05:32:46.824170+0000 mon.a (mon.0) 130 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:33:14.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:33:13 smithi086 bash[24289]: cluster 2024-09-16T05:32:47.452862+0000 mgr.a (mgr.14150) 45 : cluster [DBG] pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T05:33:14.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:33:13 smithi086 bash[24289]: cluster 2024-09-16T05:32:49.453309+0000 mgr.a (mgr.14150) 46 : cluster [DBG] pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T05:33:14.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:33:13 smithi086 bash[24289]: audit 2024-09-16T05:32:50.592978+0000 mgr.a (mgr.14150) 47 : audit [DBG] from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-16T05:33:14.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:33:13 smithi086 bash[24289]: cluster 2024-09-16T05:32:51.453700+0000 mgr.a (mgr.14150) 48 : cluster [DBG] pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T05:33:14.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:33:13 smithi086 bash[24289]: audit 2024-09-16T05:32:52.410840+0000 mon.a (mon.0) 131 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:33:14.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:33:13 smithi086 bash[24289]: audit 2024-09-16T05:32:52.416053+0000 mon.a (mon.0) 132 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:33:14.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:33:13 smithi086 bash[24289]: audit 2024-09-16T05:32:52.422052+0000 mon.a (mon.0) 133 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:33:14.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:33:13 smithi086 bash[24289]: audit 2024-09-16T05:32:52.427124+0000 mon.a (mon.0) 134 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:33:14.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:33:13 smithi086 bash[24289]: audit 2024-09-16T05:32:52.428856+0000 mon.a (mon.0) 135 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd/host:smithi157", "name": "osd_memory_target"}]: dispatch 2024-09-16T05:33:14.072 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:33:13 smithi086 bash[24289]: audit 2024-09-16T05:32:52.430869+0000 mon.a (mon.0) 136 : audit [DBG] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T05:33:14.072 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:33:13 smithi086 bash[24289]: audit 2024-09-16T05:32:52.432545+0000 mon.a (mon.0) 137 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T05:33:14.072 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:33:13 smithi086 bash[24289]: cephadm 2024-09-16T05:32:52.435024+0000 mgr.a (mgr.14150) 49 : cephadm [INF] Updating smithi157:/etc/ceph/ceph.conf 2024-09-16T05:33:14.072 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:33:13 smithi086 bash[24289]: cephadm 2024-09-16T05:32:52.616703+0000 mgr.a (mgr.14150) 50 : cephadm [INF] Updating smithi157:/var/lib/ceph/a6097908-73ec-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-16T05:33:14.072 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:33:13 smithi086 bash[24289]: cephadm 2024-09-16T05:32:52.777115+0000 mgr.a (mgr.14150) 51 : cephadm [INF] Updating smithi157:/etc/ceph/ceph.client.admin.keyring 2024-09-16T05:33:14.072 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:33:13 smithi086 bash[24289]: cephadm 2024-09-16T05:32:52.930902+0000 mgr.a (mgr.14150) 52 : cephadm [INF] Updating smithi157:/var/lib/ceph/a6097908-73ec-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-16T05:33:14.072 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:33:13 smithi086 bash[24289]: audit 2024-09-16T05:32:53.083633+0000 mon.a (mon.0) 138 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:33:14.072 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:33:13 smithi086 bash[24289]: audit 2024-09-16T05:32:53.088719+0000 mon.a (mon.0) 139 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:33:14.072 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:33:13 smithi086 bash[24289]: audit 2024-09-16T05:32:53.094679+0000 mon.a (mon.0) 140 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:33:14.072 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:33:13 smithi086 bash[24289]: cluster 2024-09-16T05:32:53.454069+0000 mgr.a (mgr.14150) 53 : cluster [DBG] pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T05:33:14.072 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:33:13 smithi086 bash[24289]: cluster 2024-09-16T05:32:55.454494+0000 mgr.a (mgr.14150) 54 : cluster [DBG] pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T05:33:14.072 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:33:13 smithi086 bash[24289]: audit 2024-09-16T05:32:57.327962+0000 mon.a (mon.0) 141 : audit [INF] from='client.? 172.21.15.47:0/498781588' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-09-16T05:33:14.073 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:33:13 smithi086 bash[24289]: cluster 2024-09-16T05:32:57.454830+0000 mgr.a (mgr.14150) 55 : cluster [DBG] pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T05:33:14.073 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:33:13 smithi086 bash[24289]: audit 2024-09-16T05:32:58.100684+0000 mon.a (mon.0) 142 : audit [INF] from='client.? 172.21.15.47:0/498781588' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-16T05:33:14.073 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:33:13 smithi086 bash[24289]: cluster 2024-09-16T05:32:58.105093+0000 mon.a (mon.0) 143 : cluster [DBG] osdmap e4: 0 total, 0 up, 0 in 2024-09-16T05:33:14.073 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:33:13 smithi086 bash[24289]: cluster 2024-09-16T05:32:59.455213+0000 mgr.a (mgr.14150) 56 : cluster [DBG] pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T05:33:14.073 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:33:13 smithi086 bash[24289]: audit 2024-09-16T05:33:01.449927+0000 mgr.a (mgr.14150) 57 : audit [DBG] from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi047:172.21.15.47=a;smithi086:172.21.15.86=b;smithi157:172.21.15.157=c", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:33:14.073 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:33:13 smithi086 bash[24289]: cephadm 2024-09-16T05:33:01.455159+0000 mgr.a (mgr.14150) 58 : cephadm [INF] Saving service mon spec with placement smithi047:172.21.15.47=a;smithi086:172.21.15.86=b;smithi157:172.21.15.157=c;count:3 2024-09-16T05:33:14.074 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:33:13 smithi086 bash[24289]: cluster 2024-09-16T05:33:01.455705+0000 mgr.a (mgr.14150) 59 : cluster [DBG] pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T05:33:14.074 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:33:13 smithi086 bash[24289]: audit 2024-09-16T05:33:01.460272+0000 mon.a (mon.0) 144 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:33:14.074 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:33:13 smithi086 bash[24289]: audit 2024-09-16T05:33:01.462010+0000 mon.a (mon.0) 145 : audit [DBG] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T05:33:14.074 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:33:13 smithi086 bash[24289]: audit 2024-09-16T05:33:02.191376+0000 mon.a (mon.0) 146 : audit [DBG] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T05:33:14.074 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:33:13 smithi086 bash[24289]: audit 2024-09-16T05:33:02.192940+0000 mon.a (mon.0) 147 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T05:33:14.074 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:33:13 smithi086 bash[24289]: audit 2024-09-16T05:33:02.200156+0000 mon.a (mon.0) 148 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:33:14.074 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:33:13 smithi086 bash[24289]: audit 2024-09-16T05:33:02.203850+0000 mon.a (mon.0) 149 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-16T05:33:14.074 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:33:13 smithi086 bash[24289]: audit 2024-09-16T05:33:02.205549+0000 mon.a (mon.0) 150 : audit [DBG] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T05:33:14.074 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:33:13 smithi086 bash[24289]: cephadm 2024-09-16T05:33:02.207336+0000 mgr.a (mgr.14150) 60 : cephadm [INF] Deploying daemon mon.c on smithi157 2024-09-16T05:33:14.074 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:33:13 smithi086 bash[24289]: cluster 2024-09-16T05:33:03.456089+0000 mgr.a (mgr.14150) 61 : cluster [DBG] pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T05:33:14.074 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:33:13 smithi086 bash[24289]: audit 2024-09-16T05:33:05.131460+0000 mon.a (mon.0) 151 : audit [DBG] from='client.? 172.21.15.157:0/951322436' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-16T05:33:14.074 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:33:13 smithi086 bash[24289]: cluster 2024-09-16T05:33:05.456472+0000 mgr.a (mgr.14150) 62 : cluster [DBG] pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T05:33:14.074 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:33:13 smithi086 bash[24289]: cluster 2024-09-16T05:33:07.456885+0000 mgr.a (mgr.14150) 63 : cluster [DBG] pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T05:33:14.075 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:33:13 smithi086 bash[24289]: audit 2024-09-16T05:33:08.155670+0000 mon.a (mon.0) 152 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:33:14.075 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:33:13 smithi086 bash[24289]: audit 2024-09-16T05:33:08.160970+0000 mon.a (mon.0) 153 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:33:14.075 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:33:13 smithi086 bash[24289]: audit 2024-09-16T05:33:08.168289+0000 mon.a (mon.0) 154 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:33:14.075 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:33:13 smithi086 bash[24289]: audit 2024-09-16T05:33:08.169621+0000 mon.a (mon.0) 155 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-16T05:33:14.075 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:33:13 smithi086 bash[24289]: audit 2024-09-16T05:33:08.171355+0000 mon.a (mon.0) 156 : audit [DBG] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T05:33:14.075 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:33:13 smithi086 bash[24289]: cephadm 2024-09-16T05:33:08.173301+0000 mgr.a (mgr.14150) 64 : cephadm [INF] Deploying daemon mon.b on smithi086 2024-09-16T05:33:14.075 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:33:13 smithi086 bash[24289]: debug 2024-09-16T05:33:13.920+0000 7f3f34d35640 1 mon.b@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2024-09-16T05:33:15.305 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:33:15 smithi157 bash[24585]: cluster 2024-09-16T05:33:09.457263+0000 mgr.a (mgr.14150) 65 : cluster [DBG] pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T05:33:15.305 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:33:15 smithi157 bash[24585]: audit 2024-09-16T05:33:09.884554+0000 mon.a (mon.0) 158 : audit [DBG] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-16T05:33:15.305 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:33:15 smithi157 bash[24585]: cluster 2024-09-16T05:33:09.884927+0000 mon.a (mon.0) 159 : cluster [INF] mon.a calling monitor election 2024-09-16T05:33:15.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:33:15 smithi157 bash[24585]: audit 2024-09-16T05:33:09.903578+0000 mon.a (mon.0) 160 : audit [DBG] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-16T05:33:15.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:33:15 smithi157 bash[24585]: audit 2024-09-16T05:33:10.879511+0000 mon.a (mon.0) 161 : audit [DBG] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-16T05:33:15.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:33:15 smithi157 bash[24585]: cluster 2024-09-16T05:33:11.457679+0000 mgr.a (mgr.14150) 66 : cluster [DBG] pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T05:33:15.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:33:15 smithi157 bash[24585]: audit 2024-09-16T05:33:11.879962+0000 mon.a (mon.0) 162 : audit [DBG] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-16T05:33:15.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:33:15 smithi157 bash[24585]: cluster 2024-09-16T05:33:11.882605+0000 mon.c (mon.1) 1 : cluster [INF] mon.c calling monitor election 2024-09-16T05:33:15.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:33:15 smithi157 bash[24585]: audit 2024-09-16T05:33:12.879906+0000 mon.a (mon.0) 163 : audit [DBG] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-16T05:33:15.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:33:15 smithi157 bash[24585]: cluster 2024-09-16T05:33:13.458072+0000 mgr.a (mgr.14150) 67 : cluster [DBG] pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T05:33:15.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:33:15 smithi157 bash[24585]: audit 2024-09-16T05:33:13.880031+0000 mon.a (mon.0) 164 : audit [DBG] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-16T05:33:15.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:33:15 smithi157 bash[24585]: audit 2024-09-16T05:33:13.931640+0000 mon.a (mon.0) 165 : audit [DBG] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-16T05:33:15.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:33:15 smithi157 bash[24585]: audit 2024-09-16T05:33:14.880506+0000 mon.a (mon.0) 166 : audit [DBG] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-16T05:33:15.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:33:15 smithi157 bash[24585]: cluster 2024-09-16T05:33:14.925044+0000 mon.a (mon.0) 167 : cluster [INF] mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-16T05:33:15.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:33:15 smithi157 bash[24585]: cluster 2024-09-16T05:33:14.931236+0000 mon.a (mon.0) 168 : cluster [DBG] monmap epoch 2 2024-09-16T05:33:15.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:33:15 smithi157 bash[24585]: cluster 2024-09-16T05:33:14.931303+0000 mon.a (mon.0) 169 : cluster [DBG] fsid a6097908-73ec-11ef-bceb-c7b262605968 2024-09-16T05:33:15.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:33:15 smithi157 bash[24585]: cluster 2024-09-16T05:33:14.931334+0000 mon.a (mon.0) 170 : cluster [DBG] last_changed 2024-09-16T05:33:09.879316+0000 2024-09-16T05:33:15.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:33:15 smithi157 bash[24585]: cluster 2024-09-16T05:33:14.931354+0000 mon.a (mon.0) 171 : cluster [DBG] created 2024-09-16T05:30:45.222800+0000 2024-09-16T05:33:15.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:33:15 smithi157 bash[24585]: cluster 2024-09-16T05:33:14.931370+0000 mon.a (mon.0) 172 : cluster [DBG] min_mon_release 19 (squid) 2024-09-16T05:33:15.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:33:15 smithi157 bash[24585]: cluster 2024-09-16T05:33:14.931391+0000 mon.a (mon.0) 173 : cluster [DBG] election_strategy: 1 2024-09-16T05:33:15.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:33:15 smithi157 bash[24585]: cluster 2024-09-16T05:33:14.931406+0000 mon.a (mon.0) 174 : cluster [DBG] 0: [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] mon.a 2024-09-16T05:33:15.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:33:15 smithi157 bash[24585]: cluster 2024-09-16T05:33:14.931421+0000 mon.a (mon.0) 175 : cluster [DBG] 1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.c 2024-09-16T05:33:15.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:33:15 smithi157 bash[24585]: cluster 2024-09-16T05:33:14.951254+0000 mon.a (mon.0) 176 : cluster [DBG] fsmap 2024-09-16T05:33:15.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:33:15 smithi157 bash[24585]: cluster 2024-09-16T05:33:14.951309+0000 mon.a (mon.0) 177 : cluster [DBG] osdmap e4: 0 total, 0 up, 0 in 2024-09-16T05:33:15.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:33:15 smithi157 bash[24585]: cluster 2024-09-16T05:33:14.951573+0000 mon.a (mon.0) 178 : cluster [DBG] mgrmap e13: a(active, since 85s) 2024-09-16T05:33:15.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:33:15 smithi157 bash[24585]: cluster 2024-09-16T05:33:14.951817+0000 mon.a (mon.0) 179 : cluster [INF] overall HEALTH_OK 2024-09-16T05:33:15.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:33:15 smithi157 bash[24585]: audit 2024-09-16T05:33:14.957983+0000 mon.a (mon.0) 180 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:33:15.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:33:15 smithi157 bash[24585]: audit 2024-09-16T05:33:14.959238+0000 mon.a (mon.0) 181 : audit [DBG] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-16T05:33:15.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:33:15 smithi157 bash[24585]: audit 2024-09-16T05:33:14.964793+0000 mon.a (mon.0) 182 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:33:15.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:33:15 smithi157 bash[24585]: audit 2024-09-16T05:33:14.973022+0000 mon.a (mon.0) 183 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:33:15.308 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:33:15 smithi157 bash[24585]: audit 2024-09-16T05:33:14.980049+0000 mon.a (mon.0) 184 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:33:15.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:33:15 smithi047 bash[22744]: cluster 2024-09-16T05:33:09.457263+0000 mgr.a (mgr.14150) 65 : cluster [DBG] pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T05:33:15.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:33:15 smithi047 bash[22744]: audit 2024-09-16T05:33:09.884554+0000 mon.a (mon.0) 158 : audit [DBG] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-16T05:33:15.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:33:15 smithi047 bash[22744]: cluster 2024-09-16T05:33:09.884927+0000 mon.a (mon.0) 159 : cluster [INF] mon.a calling monitor election 2024-09-16T05:33:15.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:33:15 smithi047 bash[22744]: audit 2024-09-16T05:33:09.903578+0000 mon.a (mon.0) 160 : audit [DBG] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-16T05:33:15.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:33:15 smithi047 bash[22744]: audit 2024-09-16T05:33:10.879511+0000 mon.a (mon.0) 161 : audit [DBG] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-16T05:33:15.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:33:15 smithi047 bash[22744]: cluster 2024-09-16T05:33:11.457679+0000 mgr.a (mgr.14150) 66 : cluster [DBG] pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T05:33:15.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:33:15 smithi047 bash[22744]: audit 2024-09-16T05:33:11.879962+0000 mon.a (mon.0) 162 : audit [DBG] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-16T05:33:15.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:33:15 smithi047 bash[22744]: cluster 2024-09-16T05:33:11.882605+0000 mon.c (mon.1) 1 : cluster [INF] mon.c calling monitor election 2024-09-16T05:33:15.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:33:15 smithi047 bash[22744]: audit 2024-09-16T05:33:12.879906+0000 mon.a (mon.0) 163 : audit [DBG] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-16T05:33:15.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:33:15 smithi047 bash[22744]: cluster 2024-09-16T05:33:13.458072+0000 mgr.a (mgr.14150) 67 : cluster [DBG] pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T05:33:15.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:33:15 smithi047 bash[22744]: audit 2024-09-16T05:33:13.880031+0000 mon.a (mon.0) 164 : audit [DBG] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-16T05:33:15.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:33:15 smithi047 bash[22744]: audit 2024-09-16T05:33:13.931640+0000 mon.a (mon.0) 165 : audit [DBG] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-16T05:33:15.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:33:15 smithi047 bash[22744]: audit 2024-09-16T05:33:14.880506+0000 mon.a (mon.0) 166 : audit [DBG] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-16T05:33:15.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:33:15 smithi047 bash[22744]: cluster 2024-09-16T05:33:14.925044+0000 mon.a (mon.0) 167 : cluster [INF] mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-16T05:33:15.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:33:15 smithi047 bash[22744]: cluster 2024-09-16T05:33:14.931236+0000 mon.a (mon.0) 168 : cluster [DBG] monmap epoch 2 2024-09-16T05:33:15.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:33:15 smithi047 bash[22744]: cluster 2024-09-16T05:33:14.931303+0000 mon.a (mon.0) 169 : cluster [DBG] fsid a6097908-73ec-11ef-bceb-c7b262605968 2024-09-16T05:33:15.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:33:15 smithi047 bash[22744]: cluster 2024-09-16T05:33:14.931334+0000 mon.a (mon.0) 170 : cluster [DBG] last_changed 2024-09-16T05:33:09.879316+0000 2024-09-16T05:33:15.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:33:15 smithi047 bash[22744]: cluster 2024-09-16T05:33:14.931354+0000 mon.a (mon.0) 171 : cluster [DBG] created 2024-09-16T05:30:45.222800+0000 2024-09-16T05:33:15.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:33:15 smithi047 bash[22744]: cluster 2024-09-16T05:33:14.931370+0000 mon.a (mon.0) 172 : cluster [DBG] min_mon_release 19 (squid) 2024-09-16T05:33:15.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:33:15 smithi047 bash[22744]: cluster 2024-09-16T05:33:14.931391+0000 mon.a (mon.0) 173 : cluster [DBG] election_strategy: 1 2024-09-16T05:33:15.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:33:15 smithi047 bash[22744]: cluster 2024-09-16T05:33:14.931406+0000 mon.a (mon.0) 174 : cluster [DBG] 0: [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] mon.a 2024-09-16T05:33:15.344 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:33:15 smithi047 bash[22744]: cluster 2024-09-16T05:33:14.931421+0000 mon.a (mon.0) 175 : cluster [DBG] 1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.c 2024-09-16T05:33:15.344 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:33:15 smithi047 bash[22744]: cluster 2024-09-16T05:33:14.951254+0000 mon.a (mon.0) 176 : cluster [DBG] fsmap 2024-09-16T05:33:15.344 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:33:15 smithi047 bash[22744]: cluster 2024-09-16T05:33:14.951309+0000 mon.a (mon.0) 177 : cluster [DBG] osdmap e4: 0 total, 0 up, 0 in 2024-09-16T05:33:15.344 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:33:15 smithi047 bash[22744]: cluster 2024-09-16T05:33:14.951573+0000 mon.a (mon.0) 178 : cluster [DBG] mgrmap e13: a(active, since 85s) 2024-09-16T05:33:15.344 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:33:15 smithi047 bash[22744]: cluster 2024-09-16T05:33:14.951817+0000 mon.a (mon.0) 179 : cluster [INF] overall HEALTH_OK 2024-09-16T05:33:15.344 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:33:15 smithi047 bash[22744]: audit 2024-09-16T05:33:14.957983+0000 mon.a (mon.0) 180 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:33:15.344 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:33:15 smithi047 bash[22744]: audit 2024-09-16T05:33:14.959238+0000 mon.a (mon.0) 181 : audit [DBG] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-16T05:33:15.344 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:33:15 smithi047 bash[22744]: audit 2024-09-16T05:33:14.964793+0000 mon.a (mon.0) 182 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:33:15.344 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:33:15 smithi047 bash[22744]: audit 2024-09-16T05:33:14.973022+0000 mon.a (mon.0) 183 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:33:15.344 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:33:15 smithi047 bash[22744]: audit 2024-09-16T05:33:14.980049+0000 mon.a (mon.0) 184 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:33:20.985 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-16T05:33:20.985 INFO:teuthology.orchestra.run.smithi157.stdout:{"epoch":3,"fsid":"a6097908-73ec-11ef-bceb-c7b262605968","modified":"2024-09-16T05:33:15.932677Z","created":"2024-09-16T05:30:45.222800Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:3300","nonce":0},{"type":"v1","addr":"172.21.15.47:6789","nonce":0}]},"addr":"172.21.15.47:6789/0","public_addr":"172.21.15.47:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3300","nonce":0},{"type":"v1","addr":"172.21.15.157:6789","nonce":0}]},"addr":"172.21.15.157:6789/0","public_addr":"172.21.15.157:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:3300","nonce":0},{"type":"v1","addr":"172.21.15.86:6789","nonce":0}]},"addr":"172.21.15.86:6789/0","public_addr":"172.21.15.86:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-16T05:33:20.986 INFO:teuthology.orchestra.run.smithi157.stderr:dumped monmap epoch 3 2024-09-16T05:33:21.305 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:33:21 smithi157 bash[24585]: cluster 2024-09-16T05:33:15.458479+0000 mgr.a (mgr.14150) 68 : cluster [DBG] pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T05:33:21.305 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:33:21 smithi157 bash[24585]: cluster 2024-09-16T05:33:15.938734+0000 mon.c (mon.1) 2 : cluster [INF] mon.c calling monitor election 2024-09-16T05:33:21.305 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:33:21 smithi157 bash[24585]: audit 2024-09-16T05:33:15.939024+0000 mon.a (mon.0) 188 : audit [DBG] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-16T05:33:21.305 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:33:21 smithi157 bash[24585]: cluster 2024-09-16T05:33:15.939654+0000 mon.a (mon.0) 189 : cluster [INF] mon.a calling monitor election 2024-09-16T05:33:21.305 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:33:21 smithi157 bash[24585]: audit 2024-09-16T05:33:15.959776+0000 mon.a (mon.0) 190 : audit [DBG] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-16T05:33:21.305 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:33:21 smithi157 bash[24585]: audit 2024-09-16T05:33:15.960008+0000 mon.a (mon.0) 191 : audit [DBG] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-16T05:33:21.305 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:33:21 smithi157 bash[24585]: audit 2024-09-16T05:33:16.168296+0000 mon.a (mon.0) 192 : audit [DBG] from='client.? 172.21.15.157:0/1865299224' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-16T05:33:21.305 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:33:21 smithi157 bash[24585]: audit 2024-09-16T05:33:16.932518+0000 mon.a (mon.0) 193 : audit [DBG] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-16T05:33:21.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:33:21 smithi157 bash[24585]: cluster 2024-09-16T05:33:17.458854+0000 mgr.a (mgr.14150) 69 : cluster [DBG] pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T05:33:21.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:33:21 smithi157 bash[24585]: audit 2024-09-16T05:33:17.932739+0000 mon.a (mon.0) 194 : audit [DBG] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-16T05:33:21.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:33:21 smithi157 bash[24585]: audit 2024-09-16T05:33:18.932660+0000 mon.a (mon.0) 195 : audit [DBG] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-16T05:33:21.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:33:21 smithi157 bash[24585]: cluster 2024-09-16T05:33:19.459176+0000 mgr.a (mgr.14150) 70 : cluster [DBG] pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T05:33:21.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:33:21 smithi157 bash[24585]: audit 2024-09-16T05:33:19.932981+0000 mon.a (mon.0) 196 : audit [DBG] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-16T05:33:21.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:33:21 smithi157 bash[24585]: audit 2024-09-16T05:33:20.933105+0000 mon.a (mon.0) 197 : audit [DBG] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-16T05:33:21.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:33:21 smithi157 bash[24585]: cluster 2024-09-16T05:33:20.959833+0000 mon.a (mon.0) 198 : cluster [INF] mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-16T05:33:21.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:33:21 smithi157 bash[24585]: cluster 2024-09-16T05:33:20.965606+0000 mon.a (mon.0) 199 : cluster [DBG] monmap epoch 3 2024-09-16T05:33:21.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:33:21 smithi157 bash[24585]: cluster 2024-09-16T05:33:20.965639+0000 mon.a (mon.0) 200 : cluster [DBG] fsid a6097908-73ec-11ef-bceb-c7b262605968 2024-09-16T05:33:21.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:33:21 smithi157 bash[24585]: cluster 2024-09-16T05:33:20.965661+0000 mon.a (mon.0) 201 : cluster [DBG] last_changed 2024-09-16T05:33:15.932677+0000 2024-09-16T05:33:21.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:33:21 smithi157 bash[24585]: cluster 2024-09-16T05:33:20.965678+0000 mon.a (mon.0) 202 : cluster [DBG] created 2024-09-16T05:30:45.222800+0000 2024-09-16T05:33:21.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:33:21 smithi157 bash[24585]: cluster 2024-09-16T05:33:20.965703+0000 mon.a (mon.0) 203 : cluster [DBG] min_mon_release 19 (squid) 2024-09-16T05:33:21.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:33:21 smithi157 bash[24585]: cluster 2024-09-16T05:33:20.965725+0000 mon.a (mon.0) 204 : cluster [DBG] election_strategy: 1 2024-09-16T05:33:21.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:33:21 smithi157 bash[24585]: cluster 2024-09-16T05:33:20.965746+0000 mon.a (mon.0) 205 : cluster [DBG] 0: [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] mon.a 2024-09-16T05:33:21.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:33:21 smithi157 bash[24585]: cluster 2024-09-16T05:33:20.965766+0000 mon.a (mon.0) 206 : cluster [DBG] 1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.c 2024-09-16T05:33:21.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:33:21 smithi157 bash[24585]: cluster 2024-09-16T05:33:20.965787+0000 mon.a (mon.0) 207 : cluster [DBG] 2: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.b 2024-09-16T05:33:21.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:33:21 smithi157 bash[24585]: cluster 2024-09-16T05:33:20.983278+0000 mon.a (mon.0) 208 : cluster [DBG] fsmap 2024-09-16T05:33:21.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:33:21 smithi157 bash[24585]: cluster 2024-09-16T05:33:20.983333+0000 mon.a (mon.0) 209 : cluster [DBG] osdmap e4: 0 total, 0 up, 0 in 2024-09-16T05:33:21.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:33:21 smithi157 bash[24585]: cluster 2024-09-16T05:33:20.983598+0000 mon.a (mon.0) 210 : cluster [DBG] mgrmap e13: a(active, since 91s) 2024-09-16T05:33:21.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:33:21 smithi157 bash[24585]: cluster 2024-09-16T05:33:20.983900+0000 mon.a (mon.0) 211 : cluster [WRN] Health check failed: 1/3 mons down, quorum a,c (MON_DOWN) 2024-09-16T05:33:21.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:33:21 smithi157 bash[24585]: cluster 2024-09-16T05:33:20.991353+0000 mon.a (mon.0) 212 : cluster [WRN] Health detail: HEALTH_WARN 1/3 mons down, quorum a,c 2024-09-16T05:33:21.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:33:21 smithi157 bash[24585]: cluster 2024-09-16T05:33:20.991437+0000 mon.a (mon.0) 213 : cluster [WRN] [WRN] MON_DOWN: 1/3 mons down, quorum a,c 2024-09-16T05:33:21.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:33:21 smithi157 bash[24585]: cluster 2024-09-16T05:33:20.991478+0000 mon.a (mon.0) 214 : cluster [WRN] mon.b (rank 2) addr [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] is down (out of quorum) 2024-09-16T05:33:21.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:33:21 smithi157 bash[24585]: audit 2024-09-16T05:33:20.996321+0000 mon.a (mon.0) 215 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:33:21.308 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:33:21 smithi157 bash[24585]: audit 2024-09-16T05:33:21.002034+0000 mon.a (mon.0) 216 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:33:21.308 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:33:21 smithi157 bash[24585]: audit 2024-09-16T05:33:21.007424+0000 mon.a (mon.0) 217 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:33:21.308 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:33:21 smithi157 bash[24585]: audit 2024-09-16T05:33:21.012984+0000 mon.a (mon.0) 218 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:33:21.308 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:33:21 smithi157 bash[24585]: audit 2024-09-16T05:33:21.018408+0000 mon.a (mon.0) 219 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:33:21.308 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:33:21 smithi157 bash[24585]: audit 2024-09-16T05:33:21.020119+0000 mon.a (mon.0) 220 : audit [DBG] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T05:33:21.308 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:33:21 smithi157 bash[24585]: audit 2024-09-16T05:33:21.021971+0000 mon.a (mon.0) 221 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T05:33:21.341 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:33:21 smithi047 bash[22744]: cluster 2024-09-16T05:33:15.458479+0000 mgr.a (mgr.14150) 68 : cluster [DBG] pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T05:33:21.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:33:21 smithi047 bash[22744]: cluster 2024-09-16T05:33:15.938734+0000 mon.c (mon.1) 2 : cluster [INF] mon.c calling monitor election 2024-09-16T05:33:21.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:33:21 smithi047 bash[22744]: audit 2024-09-16T05:33:15.939024+0000 mon.a (mon.0) 188 : audit [DBG] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-16T05:33:21.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:33:21 smithi047 bash[22744]: cluster 2024-09-16T05:33:15.939654+0000 mon.a (mon.0) 189 : cluster [INF] mon.a calling monitor election 2024-09-16T05:33:21.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:33:21 smithi047 bash[22744]: audit 2024-09-16T05:33:15.959776+0000 mon.a (mon.0) 190 : audit [DBG] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-16T05:33:21.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:33:21 smithi047 bash[22744]: audit 2024-09-16T05:33:15.960008+0000 mon.a (mon.0) 191 : audit [DBG] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-16T05:33:21.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:33:21 smithi047 bash[22744]: audit 2024-09-16T05:33:16.168296+0000 mon.a (mon.0) 192 : audit [DBG] from='client.? 172.21.15.157:0/1865299224' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-16T05:33:21.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:33:21 smithi047 bash[22744]: audit 2024-09-16T05:33:16.932518+0000 mon.a (mon.0) 193 : audit [DBG] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-16T05:33:21.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:33:21 smithi047 bash[22744]: cluster 2024-09-16T05:33:17.458854+0000 mgr.a (mgr.14150) 69 : cluster [DBG] pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T05:33:21.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:33:21 smithi047 bash[22744]: audit 2024-09-16T05:33:17.932739+0000 mon.a (mon.0) 194 : audit [DBG] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-16T05:33:21.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:33:21 smithi047 bash[22744]: audit 2024-09-16T05:33:18.932660+0000 mon.a (mon.0) 195 : audit [DBG] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-16T05:33:21.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:33:21 smithi047 bash[22744]: cluster 2024-09-16T05:33:19.459176+0000 mgr.a (mgr.14150) 70 : cluster [DBG] pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T05:33:21.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:33:21 smithi047 bash[22744]: audit 2024-09-16T05:33:19.932981+0000 mon.a (mon.0) 196 : audit [DBG] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-16T05:33:21.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:33:21 smithi047 bash[22744]: audit 2024-09-16T05:33:20.933105+0000 mon.a (mon.0) 197 : audit [DBG] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-16T05:33:21.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:33:21 smithi047 bash[22744]: cluster 2024-09-16T05:33:20.959833+0000 mon.a (mon.0) 198 : cluster [INF] mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-16T05:33:21.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:33:21 smithi047 bash[22744]: cluster 2024-09-16T05:33:20.965606+0000 mon.a (mon.0) 199 : cluster [DBG] monmap epoch 3 2024-09-16T05:33:21.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:33:21 smithi047 bash[22744]: cluster 2024-09-16T05:33:20.965639+0000 mon.a (mon.0) 200 : cluster [DBG] fsid a6097908-73ec-11ef-bceb-c7b262605968 2024-09-16T05:33:21.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:33:21 smithi047 bash[22744]: cluster 2024-09-16T05:33:20.965661+0000 mon.a (mon.0) 201 : cluster [DBG] last_changed 2024-09-16T05:33:15.932677+0000 2024-09-16T05:33:21.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:33:21 smithi047 bash[22744]: cluster 2024-09-16T05:33:20.965678+0000 mon.a (mon.0) 202 : cluster [DBG] created 2024-09-16T05:30:45.222800+0000 2024-09-16T05:33:21.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:33:21 smithi047 bash[22744]: cluster 2024-09-16T05:33:20.965703+0000 mon.a (mon.0) 203 : cluster [DBG] min_mon_release 19 (squid) 2024-09-16T05:33:21.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:33:21 smithi047 bash[22744]: cluster 2024-09-16T05:33:20.965725+0000 mon.a (mon.0) 204 : cluster [DBG] election_strategy: 1 2024-09-16T05:33:21.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:33:21 smithi047 bash[22744]: cluster 2024-09-16T05:33:20.965746+0000 mon.a (mon.0) 205 : cluster [DBG] 0: [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] mon.a 2024-09-16T05:33:21.344 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:33:21 smithi047 bash[22744]: cluster 2024-09-16T05:33:20.965766+0000 mon.a (mon.0) 206 : cluster [DBG] 1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.c 2024-09-16T05:33:21.344 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:33:21 smithi047 bash[22744]: cluster 2024-09-16T05:33:20.965787+0000 mon.a (mon.0) 207 : cluster [DBG] 2: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.b 2024-09-16T05:33:21.344 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:33:21 smithi047 bash[22744]: cluster 2024-09-16T05:33:20.983278+0000 mon.a (mon.0) 208 : cluster [DBG] fsmap 2024-09-16T05:33:21.344 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:33:21 smithi047 bash[22744]: cluster 2024-09-16T05:33:20.983333+0000 mon.a (mon.0) 209 : cluster [DBG] osdmap e4: 0 total, 0 up, 0 in 2024-09-16T05:33:21.344 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:33:21 smithi047 bash[22744]: cluster 2024-09-16T05:33:20.983598+0000 mon.a (mon.0) 210 : cluster [DBG] mgrmap e13: a(active, since 91s) 2024-09-16T05:33:21.344 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:33:21 smithi047 bash[22744]: cluster 2024-09-16T05:33:20.983900+0000 mon.a (mon.0) 211 : cluster [WRN] Health check failed: 1/3 mons down, quorum a,c (MON_DOWN) 2024-09-16T05:33:21.344 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:33:21 smithi047 bash[22744]: cluster 2024-09-16T05:33:20.991353+0000 mon.a (mon.0) 212 : cluster [WRN] Health detail: HEALTH_WARN 1/3 mons down, quorum a,c 2024-09-16T05:33:21.344 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:33:21 smithi047 bash[22744]: cluster 2024-09-16T05:33:20.991437+0000 mon.a (mon.0) 213 : cluster [WRN] [WRN] MON_DOWN: 1/3 mons down, quorum a,c 2024-09-16T05:33:21.344 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:33:21 smithi047 bash[22744]: cluster 2024-09-16T05:33:20.991478+0000 mon.a (mon.0) 214 : cluster [WRN] mon.b (rank 2) addr [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] is down (out of quorum) 2024-09-16T05:33:21.344 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:33:21 smithi047 bash[22744]: audit 2024-09-16T05:33:20.996321+0000 mon.a (mon.0) 215 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:33:21.345 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:33:21 smithi047 bash[22744]: audit 2024-09-16T05:33:21.002034+0000 mon.a (mon.0) 216 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:33:21.345 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:33:21 smithi047 bash[22744]: audit 2024-09-16T05:33:21.007424+0000 mon.a (mon.0) 217 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:33:21.345 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:33:21 smithi047 bash[22744]: audit 2024-09-16T05:33:21.012984+0000 mon.a (mon.0) 218 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:33:21.345 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:33:21 smithi047 bash[22744]: audit 2024-09-16T05:33:21.018408+0000 mon.a (mon.0) 219 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:33:21.345 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:33:21 smithi047 bash[22744]: audit 2024-09-16T05:33:21.020119+0000 mon.a (mon.0) 220 : audit [DBG] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T05:33:21.345 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:33:21 smithi047 bash[22744]: audit 2024-09-16T05:33:21.021971+0000 mon.a (mon.0) 221 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T05:33:21.649 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-09-16T05:33:21.649 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a6097908-73ec-11ef-bceb-c7b262605968 -- ceph config generate-minimal-conf 2024-09-16T05:33:22.305 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:33:22 smithi157 bash[24585]: cephadm 2024-09-16T05:33:21.024494+0000 mgr.a (mgr.14150) 71 : cephadm [INF] Updating smithi047:/etc/ceph/ceph.conf 2024-09-16T05:33:22.305 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:33:22 smithi157 bash[24585]: cephadm 2024-09-16T05:33:21.025118+0000 mgr.a (mgr.14150) 72 : cephadm [INF] Updating smithi086:/etc/ceph/ceph.conf 2024-09-16T05:33:22.305 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:33:22 smithi157 bash[24585]: cephadm 2024-09-16T05:33:21.025379+0000 mgr.a (mgr.14150) 73 : cephadm [INF] Updating smithi157:/etc/ceph/ceph.conf 2024-09-16T05:33:22.305 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:33:22 smithi157 bash[24585]: cephadm 2024-09-16T05:33:21.250111+0000 mgr.a (mgr.14150) 74 : cephadm [INF] Updating smithi047:/var/lib/ceph/a6097908-73ec-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-16T05:33:22.305 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:33:22 smithi157 bash[24585]: cephadm 2024-09-16T05:33:21.250511+0000 mgr.a (mgr.14150) 75 : cephadm [INF] Updating smithi157:/var/lib/ceph/a6097908-73ec-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-16T05:33:22.305 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:33:22 smithi157 bash[24585]: cephadm 2024-09-16T05:33:21.251031+0000 mgr.a (mgr.14150) 76 : cephadm [INF] Updating smithi086:/var/lib/ceph/a6097908-73ec-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-16T05:33:22.305 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:33:22 smithi157 bash[24585]: audit 2024-09-16T05:33:21.444952+0000 mon.a (mon.0) 222 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:33:22.305 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:33:22 smithi157 bash[24585]: audit 2024-09-16T05:33:21.450530+0000 mon.a (mon.0) 223 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:33:22.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:33:22 smithi157 bash[24585]: audit 2024-09-16T05:33:21.456428+0000 mon.a (mon.0) 224 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:33:22.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:33:22 smithi157 bash[24585]: audit 2024-09-16T05:33:21.461948+0000 mon.a (mon.0) 225 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:33:22.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:33:22 smithi157 bash[24585]: audit 2024-09-16T05:33:21.467015+0000 mon.a (mon.0) 226 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:33:22.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:33:22 smithi157 bash[24585]: audit 2024-09-16T05:33:21.471724+0000 mon.a (mon.0) 227 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:33:22.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:33:22 smithi157 bash[24585]: audit 2024-09-16T05:33:21.477818+0000 mon.a (mon.0) 228 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:33:22.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:33:22 smithi157 bash[24585]: audit 2024-09-16T05:33:21.535081+0000 mon.a (mon.0) 229 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:33:22.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:33:22 smithi157 bash[24585]: audit 2024-09-16T05:33:21.539857+0000 mon.a (mon.0) 230 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:33:22.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:33:22 smithi157 bash[24585]: audit 2024-09-16T05:33:21.544838+0000 mon.a (mon.0) 231 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:33:22.308 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:33:22 smithi157 bash[24585]: audit 2024-09-16T05:33:21.549849+0000 mon.a (mon.0) 232 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:33:22.308 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:33:22 smithi157 bash[24585]: audit 2024-09-16T05:33:21.551103+0000 mon.a (mon.0) 233 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-16T05:33:22.308 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:33:22 smithi157 bash[24585]: audit 2024-09-16T05:33:21.552600+0000 mon.a (mon.0) 234 : audit [DBG] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-16T05:33:22.308 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:33:22 smithi157 bash[24585]: audit 2024-09-16T05:33:21.554108+0000 mon.a (mon.0) 235 : audit [DBG] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T05:33:22.308 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:33:22 smithi157 bash[24585]: audit 2024-09-16T05:33:21.932833+0000 mon.a (mon.0) 236 : audit [DBG] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-16T05:33:22.341 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:33:22 smithi047 bash[22744]: cephadm 2024-09-16T05:33:21.024494+0000 mgr.a (mgr.14150) 71 : cephadm [INF] Updating smithi047:/etc/ceph/ceph.conf 2024-09-16T05:33:22.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:33:22 smithi047 bash[22744]: cephadm 2024-09-16T05:33:21.025118+0000 mgr.a (mgr.14150) 72 : cephadm [INF] Updating smithi086:/etc/ceph/ceph.conf 2024-09-16T05:33:22.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:33:22 smithi047 bash[22744]: cephadm 2024-09-16T05:33:21.025379+0000 mgr.a (mgr.14150) 73 : cephadm [INF] Updating smithi157:/etc/ceph/ceph.conf 2024-09-16T05:33:22.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:33:22 smithi047 bash[22744]: cephadm 2024-09-16T05:33:21.250111+0000 mgr.a (mgr.14150) 74 : cephadm [INF] Updating smithi047:/var/lib/ceph/a6097908-73ec-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-16T05:33:22.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:33:22 smithi047 bash[22744]: cephadm 2024-09-16T05:33:21.250511+0000 mgr.a (mgr.14150) 75 : cephadm [INF] Updating smithi157:/var/lib/ceph/a6097908-73ec-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-16T05:33:22.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:33:22 smithi047 bash[22744]: cephadm 2024-09-16T05:33:21.251031+0000 mgr.a (mgr.14150) 76 : cephadm [INF] Updating smithi086:/var/lib/ceph/a6097908-73ec-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-16T05:33:22.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:33:22 smithi047 bash[22744]: audit 2024-09-16T05:33:21.444952+0000 mon.a (mon.0) 222 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:33:22.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:33:22 smithi047 bash[22744]: audit 2024-09-16T05:33:21.450530+0000 mon.a (mon.0) 223 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:33:22.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:33:22 smithi047 bash[22744]: audit 2024-09-16T05:33:21.456428+0000 mon.a (mon.0) 224 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:33:22.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:33:22 smithi047 bash[22744]: audit 2024-09-16T05:33:21.461948+0000 mon.a (mon.0) 225 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:33:22.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:33:22 smithi047 bash[22744]: audit 2024-09-16T05:33:21.467015+0000 mon.a (mon.0) 226 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:33:22.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:33:22 smithi047 bash[22744]: audit 2024-09-16T05:33:21.471724+0000 mon.a (mon.0) 227 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:33:22.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:33:22 smithi047 bash[22744]: audit 2024-09-16T05:33:21.477818+0000 mon.a (mon.0) 228 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:33:22.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:33:22 smithi047 bash[22744]: audit 2024-09-16T05:33:21.535081+0000 mon.a (mon.0) 229 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:33:22.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:33:22 smithi047 bash[22744]: audit 2024-09-16T05:33:21.539857+0000 mon.a (mon.0) 230 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:33:22.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:33:22 smithi047 bash[22744]: audit 2024-09-16T05:33:21.544838+0000 mon.a (mon.0) 231 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:33:22.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:33:22 smithi047 bash[22744]: audit 2024-09-16T05:33:21.549849+0000 mon.a (mon.0) 232 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:33:22.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:33:22 smithi047 bash[22744]: audit 2024-09-16T05:33:21.551103+0000 mon.a (mon.0) 233 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-16T05:33:22.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:33:22 smithi047 bash[22744]: audit 2024-09-16T05:33:21.552600+0000 mon.a (mon.0) 234 : audit [DBG] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-16T05:33:22.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:33:22 smithi047 bash[22744]: audit 2024-09-16T05:33:21.554108+0000 mon.a (mon.0) 235 : audit [DBG] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T05:33:22.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:33:22 smithi047 bash[22744]: audit 2024-09-16T05:33:21.932833+0000 mon.a (mon.0) 236 : audit [DBG] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-16T05:33:23.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:33:22 smithi086 bash[24289]: cluster 2024-09-16T05:33:09.457263+0000 mgr.a (mgr.14150) 65 : cluster [DBG] pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T05:33:23.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:33:22 smithi086 bash[24289]: audit 2024-09-16T05:33:09.884554+0000 mon.a (mon.0) 158 : audit [DBG] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-16T05:33:23.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:33:22 smithi086 bash[24289]: cluster 2024-09-16T05:33:09.884927+0000 mon.a (mon.0) 159 : cluster [INF] mon.a calling monitor election 2024-09-16T05:33:23.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:33:22 smithi086 bash[24289]: audit 2024-09-16T05:33:09.903578+0000 mon.a (mon.0) 160 : audit [DBG] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-16T05:33:23.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:33:22 smithi086 bash[24289]: audit 2024-09-16T05:33:10.879511+0000 mon.a (mon.0) 161 : audit [DBG] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-16T05:33:23.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:33:22 smithi086 bash[24289]: cluster 2024-09-16T05:33:11.457679+0000 mgr.a (mgr.14150) 66 : cluster [DBG] pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T05:33:23.322 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:33:22 smithi086 bash[24289]: audit 2024-09-16T05:33:11.879962+0000 mon.a (mon.0) 162 : audit [DBG] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-16T05:33:23.322 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:33:22 smithi086 bash[24289]: cluster 2024-09-16T05:33:11.882605+0000 mon.c (mon.1) 1 : cluster [INF] mon.c calling monitor election 2024-09-16T05:33:23.322 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:33:22 smithi086 bash[24289]: audit 2024-09-16T05:33:12.879906+0000 mon.a (mon.0) 163 : audit [DBG] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-16T05:33:23.322 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:33:22 smithi086 bash[24289]: cluster 2024-09-16T05:33:13.458072+0000 mgr.a (mgr.14150) 67 : cluster [DBG] pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T05:33:23.322 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:33:22 smithi086 bash[24289]: audit 2024-09-16T05:33:13.880031+0000 mon.a (mon.0) 164 : audit [DBG] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-16T05:33:23.322 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:33:22 smithi086 bash[24289]: audit 2024-09-16T05:33:13.931640+0000 mon.a (mon.0) 165 : audit [DBG] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-16T05:33:23.322 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:33:22 smithi086 bash[24289]: audit 2024-09-16T05:33:14.880506+0000 mon.a (mon.0) 166 : audit [DBG] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-16T05:33:23.322 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:33:22 smithi086 bash[24289]: cluster 2024-09-16T05:33:14.925044+0000 mon.a (mon.0) 167 : cluster [INF] mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-16T05:33:23.322 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:33:22 smithi086 bash[24289]: cluster 2024-09-16T05:33:14.931236+0000 mon.a (mon.0) 168 : cluster [DBG] monmap epoch 2 2024-09-16T05:33:23.322 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:33:22 smithi086 bash[24289]: cluster 2024-09-16T05:33:14.931303+0000 mon.a (mon.0) 169 : cluster [DBG] fsid a6097908-73ec-11ef-bceb-c7b262605968 2024-09-16T05:33:23.322 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:33:22 smithi086 bash[24289]: cluster 2024-09-16T05:33:14.931334+0000 mon.a (mon.0) 170 : cluster [DBG] last_changed 2024-09-16T05:33:09.879316+0000 2024-09-16T05:33:23.322 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:33:22 smithi086 bash[24289]: cluster 2024-09-16T05:33:14.931354+0000 mon.a (mon.0) 171 : cluster [DBG] created 2024-09-16T05:30:45.222800+0000 2024-09-16T05:33:23.322 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:33:22 smithi086 bash[24289]: cluster 2024-09-16T05:33:14.931370+0000 mon.a (mon.0) 172 : cluster [DBG] min_mon_release 19 (squid) 2024-09-16T05:33:23.322 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:33:22 smithi086 bash[24289]: cluster 2024-09-16T05:33:14.931391+0000 mon.a (mon.0) 173 : cluster [DBG] election_strategy: 1 2024-09-16T05:33:23.323 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:33:22 smithi086 bash[24289]: cluster 2024-09-16T05:33:14.931406+0000 mon.a (mon.0) 174 : cluster [DBG] 0: [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] mon.a 2024-09-16T05:33:23.323 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:33:22 smithi086 bash[24289]: cluster 2024-09-16T05:33:14.931421+0000 mon.a (mon.0) 175 : cluster [DBG] 1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.c 2024-09-16T05:33:23.323 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:33:22 smithi086 bash[24289]: cluster 2024-09-16T05:33:14.951254+0000 mon.a (mon.0) 176 : cluster [DBG] fsmap 2024-09-16T05:33:23.323 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:33:22 smithi086 bash[24289]: cluster 2024-09-16T05:33:14.951309+0000 mon.a (mon.0) 177 : cluster [DBG] osdmap e4: 0 total, 0 up, 0 in 2024-09-16T05:33:23.323 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:33:22 smithi086 bash[24289]: cluster 2024-09-16T05:33:14.951573+0000 mon.a (mon.0) 178 : cluster [DBG] mgrmap e13: a(active, since 85s) 2024-09-16T05:33:23.323 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:33:22 smithi086 bash[24289]: cluster 2024-09-16T05:33:14.951817+0000 mon.a (mon.0) 179 : cluster [INF] overall HEALTH_OK 2024-09-16T05:33:23.324 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:33:22 smithi086 bash[24289]: audit 2024-09-16T05:33:14.957983+0000 mon.a (mon.0) 180 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:33:23.324 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:33:22 smithi086 bash[24289]: audit 2024-09-16T05:33:14.959238+0000 mon.a (mon.0) 181 : audit [DBG] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-16T05:33:23.324 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:33:22 smithi086 bash[24289]: audit 2024-09-16T05:33:14.964793+0000 mon.a (mon.0) 182 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:33:23.324 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:33:22 smithi086 bash[24289]: audit 2024-09-16T05:33:14.973022+0000 mon.a (mon.0) 183 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:33:23.324 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:33:22 smithi086 bash[24289]: audit 2024-09-16T05:33:14.980049+0000 mon.a (mon.0) 184 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:33:23.324 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:33:22 smithi086 bash[24289]: cluster 2024-09-16T05:33:15.458479+0000 mgr.a (mgr.14150) 68 : cluster [DBG] pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T05:33:23.324 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:33:22 smithi086 bash[24289]: cluster 2024-09-16T05:33:15.938734+0000 mon.c (mon.1) 2 : cluster [INF] mon.c calling monitor election 2024-09-16T05:33:23.324 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:33:22 smithi086 bash[24289]: audit 2024-09-16T05:33:15.939024+0000 mon.a (mon.0) 188 : audit [DBG] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-16T05:33:23.324 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:33:22 smithi086 bash[24289]: cluster 2024-09-16T05:33:15.939654+0000 mon.a (mon.0) 189 : cluster [INF] mon.a calling monitor election 2024-09-16T05:33:23.324 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:33:22 smithi086 bash[24289]: audit 2024-09-16T05:33:15.959776+0000 mon.a (mon.0) 190 : audit [DBG] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-16T05:33:23.324 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:33:22 smithi086 bash[24289]: audit 2024-09-16T05:33:15.960008+0000 mon.a (mon.0) 191 : audit [DBG] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-16T05:33:23.324 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:33:22 smithi086 bash[24289]: audit 2024-09-16T05:33:16.168296+0000 mon.a (mon.0) 192 : audit [DBG] from='client.? 172.21.15.157:0/1865299224' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-16T05:33:23.325 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:33:22 smithi086 bash[24289]: audit 2024-09-16T05:33:16.932518+0000 mon.a (mon.0) 193 : audit [DBG] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-16T05:33:23.325 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:33:22 smithi086 bash[24289]: cluster 2024-09-16T05:33:17.458854+0000 mgr.a (mgr.14150) 69 : cluster [DBG] pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T05:33:23.325 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:33:22 smithi086 bash[24289]: audit 2024-09-16T05:33:17.932739+0000 mon.a (mon.0) 194 : audit [DBG] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-16T05:33:23.325 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:33:22 smithi086 bash[24289]: audit 2024-09-16T05:33:18.932660+0000 mon.a (mon.0) 195 : audit [DBG] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-16T05:33:23.325 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:33:22 smithi086 bash[24289]: cluster 2024-09-16T05:33:19.459176+0000 mgr.a (mgr.14150) 70 : cluster [DBG] pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T05:33:23.325 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:33:22 smithi086 bash[24289]: audit 2024-09-16T05:33:19.932981+0000 mon.a (mon.0) 196 : audit [DBG] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-16T05:33:23.325 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:33:22 smithi086 bash[24289]: audit 2024-09-16T05:33:20.933105+0000 mon.a (mon.0) 197 : audit [DBG] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-16T05:33:23.325 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:33:22 smithi086 bash[24289]: cluster 2024-09-16T05:33:20.959833+0000 mon.a (mon.0) 198 : cluster [INF] mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-16T05:33:23.325 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:33:22 smithi086 bash[24289]: cluster 2024-09-16T05:33:20.965606+0000 mon.a (mon.0) 199 : cluster [DBG] monmap epoch 3 2024-09-16T05:33:23.325 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:33:22 smithi086 bash[24289]: cluster 2024-09-16T05:33:20.965639+0000 mon.a (mon.0) 200 : cluster [DBG] fsid a6097908-73ec-11ef-bceb-c7b262605968 2024-09-16T05:33:23.325 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:33:22 smithi086 bash[24289]: cluster 2024-09-16T05:33:20.965661+0000 mon.a (mon.0) 201 : cluster [DBG] last_changed 2024-09-16T05:33:15.932677+0000 2024-09-16T05:33:23.325 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:33:22 smithi086 bash[24289]: cluster 2024-09-16T05:33:20.965678+0000 mon.a (mon.0) 202 : cluster [DBG] created 2024-09-16T05:30:45.222800+0000 2024-09-16T05:33:23.325 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:33:22 smithi086 bash[24289]: cluster 2024-09-16T05:33:20.965703+0000 mon.a (mon.0) 203 : cluster [DBG] min_mon_release 19 (squid) 2024-09-16T05:33:23.326 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:33:22 smithi086 bash[24289]: cluster 2024-09-16T05:33:20.965725+0000 mon.a (mon.0) 204 : cluster [DBG] election_strategy: 1 2024-09-16T05:33:23.326 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:33:22 smithi086 bash[24289]: cluster 2024-09-16T05:33:20.965746+0000 mon.a (mon.0) 205 : cluster [DBG] 0: [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] mon.a 2024-09-16T05:33:23.326 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:33:22 smithi086 bash[24289]: cluster 2024-09-16T05:33:20.965766+0000 mon.a (mon.0) 206 : cluster [DBG] 1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.c 2024-09-16T05:33:23.326 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:33:22 smithi086 bash[24289]: cluster 2024-09-16T05:33:20.965787+0000 mon.a (mon.0) 207 : cluster [DBG] 2: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.b 2024-09-16T05:33:23.326 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:33:22 smithi086 bash[24289]: cluster 2024-09-16T05:33:20.983278+0000 mon.a (mon.0) 208 : cluster [DBG] fsmap 2024-09-16T05:33:23.326 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:33:22 smithi086 bash[24289]: cluster 2024-09-16T05:33:20.983333+0000 mon.a (mon.0) 209 : cluster [DBG] osdmap e4: 0 total, 0 up, 0 in 2024-09-16T05:33:23.326 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:33:22 smithi086 bash[24289]: cluster 2024-09-16T05:33:20.983598+0000 mon.a (mon.0) 210 : cluster [DBG] mgrmap e13: a(active, since 91s) 2024-09-16T05:33:23.326 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:33:22 smithi086 bash[24289]: cluster 2024-09-16T05:33:20.983900+0000 mon.a (mon.0) 211 : cluster [WRN] Health check failed: 1/3 mons down, quorum a,c (MON_DOWN) 2024-09-16T05:33:23.326 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:33:22 smithi086 bash[24289]: cluster 2024-09-16T05:33:20.991353+0000 mon.a (mon.0) 212 : cluster [WRN] Health detail: HEALTH_WARN 1/3 mons down, quorum a,c 2024-09-16T05:33:23.326 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:33:22 smithi086 bash[24289]: cluster 2024-09-16T05:33:20.991437+0000 mon.a (mon.0) 213 : cluster [WRN] [WRN] MON_DOWN: 1/3 mons down, quorum a,c 2024-09-16T05:33:23.326 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:33:22 smithi086 bash[24289]: cluster 2024-09-16T05:33:20.991478+0000 mon.a (mon.0) 214 : cluster [WRN] mon.b (rank 2) addr [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] is down (out of quorum) 2024-09-16T05:33:23.326 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:33:22 smithi086 bash[24289]: audit 2024-09-16T05:33:20.996321+0000 mon.a (mon.0) 215 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:33:23.326 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:33:22 smithi086 bash[24289]: audit 2024-09-16T05:33:21.002034+0000 mon.a (mon.0) 216 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:33:23.327 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:33:22 smithi086 bash[24289]: audit 2024-09-16T05:33:21.007424+0000 mon.a (mon.0) 217 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:33:23.327 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:33:22 smithi086 bash[24289]: audit 2024-09-16T05:33:21.012984+0000 mon.a (mon.0) 218 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:33:23.327 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:33:22 smithi086 bash[24289]: audit 2024-09-16T05:33:21.018408+0000 mon.a (mon.0) 219 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:33:23.327 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:33:22 smithi086 bash[24289]: audit 2024-09-16T05:33:21.020119+0000 mon.a (mon.0) 220 : audit [DBG] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T05:33:23.327 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:33:22 smithi086 bash[24289]: audit 2024-09-16T05:33:21.021971+0000 mon.a (mon.0) 221 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T05:33:23.327 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:33:22 smithi086 bash[24289]: cephadm 2024-09-16T05:33:21.024494+0000 mgr.a (mgr.14150) 71 : cephadm [INF] Updating smithi047:/etc/ceph/ceph.conf 2024-09-16T05:33:23.327 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:33:22 smithi086 bash[24289]: cephadm 2024-09-16T05:33:21.025118+0000 mgr.a (mgr.14150) 72 : cephadm [INF] Updating smithi086:/etc/ceph/ceph.conf 2024-09-16T05:33:23.327 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:33:22 smithi086 bash[24289]: cephadm 2024-09-16T05:33:21.025379+0000 mgr.a (mgr.14150) 73 : cephadm [INF] Updating smithi157:/etc/ceph/ceph.conf 2024-09-16T05:33:23.327 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:33:22 smithi086 bash[24289]: cephadm 2024-09-16T05:33:21.250111+0000 mgr.a (mgr.14150) 74 : cephadm [INF] Updating smithi047:/var/lib/ceph/a6097908-73ec-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-16T05:33:23.327 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:33:22 smithi086 bash[24289]: cephadm 2024-09-16T05:33:21.250511+0000 mgr.a (mgr.14150) 75 : cephadm [INF] Updating smithi157:/var/lib/ceph/a6097908-73ec-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-16T05:33:23.327 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:33:22 smithi086 bash[24289]: cephadm 2024-09-16T05:33:21.251031+0000 mgr.a (mgr.14150) 76 : cephadm [INF] Updating smithi086:/var/lib/ceph/a6097908-73ec-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-16T05:33:23.327 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:33:22 smithi086 bash[24289]: audit 2024-09-16T05:33:21.444952+0000 mon.a (mon.0) 222 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:33:23.327 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:33:22 smithi086 bash[24289]: audit 2024-09-16T05:33:21.450530+0000 mon.a (mon.0) 223 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:33:23.328 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:33:22 smithi086 bash[24289]: audit 2024-09-16T05:33:21.456428+0000 mon.a (mon.0) 224 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:33:23.328 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:33:22 smithi086 bash[24289]: audit 2024-09-16T05:33:21.461948+0000 mon.a (mon.0) 225 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:33:23.328 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:33:22 smithi086 bash[24289]: audit 2024-09-16T05:33:21.467015+0000 mon.a (mon.0) 226 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:33:23.328 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:33:22 smithi086 bash[24289]: audit 2024-09-16T05:33:21.471724+0000 mon.a (mon.0) 227 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:33:23.328 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:33:22 smithi086 bash[24289]: audit 2024-09-16T05:33:21.477818+0000 mon.a (mon.0) 228 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:33:23.328 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:33:22 smithi086 bash[24289]: audit 2024-09-16T05:33:21.535081+0000 mon.a (mon.0) 229 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:33:23.328 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:33:22 smithi086 bash[24289]: audit 2024-09-16T05:33:21.539857+0000 mon.a (mon.0) 230 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:33:23.328 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:33:22 smithi086 bash[24289]: audit 2024-09-16T05:33:21.544838+0000 mon.a (mon.0) 231 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:33:23.328 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:33:22 smithi086 bash[24289]: audit 2024-09-16T05:33:21.549849+0000 mon.a (mon.0) 232 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:33:23.328 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:33:22 smithi086 bash[24289]: audit 2024-09-16T05:33:21.551103+0000 mon.a (mon.0) 233 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-16T05:33:23.328 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:33:22 smithi086 bash[24289]: audit 2024-09-16T05:33:21.552600+0000 mon.a (mon.0) 234 : audit [DBG] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-16T05:33:23.328 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:33:22 smithi086 bash[24289]: audit 2024-09-16T05:33:21.554108+0000 mon.a (mon.0) 235 : audit [DBG] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T05:33:23.328 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:33:22 smithi086 bash[24289]: audit 2024-09-16T05:33:21.932833+0000 mon.a (mon.0) 236 : audit [DBG] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-16T05:33:23.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:33:23 smithi157 bash[24585]: cluster 2024-09-16T05:33:17.932994+0000 mon.b (mon.2) 1 : cluster [INF] mon.b calling monitor election 2024-09-16T05:33:23.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:33:23 smithi157 bash[24585]: cluster 2024-09-16T05:33:22.971036+0000 mon.b (mon.2) 2 : cluster [INF] mon.b calling monitor election 2024-09-16T05:33:23.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:33:23 smithi157 bash[24585]: cluster 2024-09-16T05:33:22.973296+0000 mon.a (mon.0) 238 : cluster [INF] mon.a calling monitor election 2024-09-16T05:33:23.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:33:23 smithi157 bash[24585]: cluster 2024-09-16T05:33:22.973997+0000 mon.c (mon.1) 3 : cluster [INF] mon.c calling monitor election 2024-09-16T05:33:23.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:33:23 smithi157 bash[24585]: cluster 2024-09-16T05:33:22.998244+0000 mon.a (mon.0) 239 : cluster [INF] mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-16T05:33:23.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:33:23 smithi157 bash[24585]: cluster 2024-09-16T05:33:23.009308+0000 mon.a (mon.0) 240 : cluster [DBG] monmap epoch 3 2024-09-16T05:33:23.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:33:23 smithi157 bash[24585]: cluster 2024-09-16T05:33:23.009353+0000 mon.a (mon.0) 241 : cluster [DBG] fsid a6097908-73ec-11ef-bceb-c7b262605968 2024-09-16T05:33:23.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:33:23 smithi157 bash[24585]: cluster 2024-09-16T05:33:23.009393+0000 mon.a (mon.0) 242 : cluster [DBG] last_changed 2024-09-16T05:33:15.932677+0000 2024-09-16T05:33:23.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:33:23 smithi157 bash[24585]: cluster 2024-09-16T05:33:23.009434+0000 mon.a (mon.0) 243 : cluster [DBG] created 2024-09-16T05:30:45.222800+0000 2024-09-16T05:33:23.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:33:23 smithi157 bash[24585]: cluster 2024-09-16T05:33:23.009478+0000 mon.a (mon.0) 244 : cluster [DBG] min_mon_release 19 (squid) 2024-09-16T05:33:23.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:33:23 smithi157 bash[24585]: cluster 2024-09-16T05:33:23.009514+0000 mon.a (mon.0) 245 : cluster [DBG] election_strategy: 1 2024-09-16T05:33:23.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:33:23 smithi157 bash[24585]: cluster 2024-09-16T05:33:23.009552+0000 mon.a (mon.0) 246 : cluster [DBG] 0: [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] mon.a 2024-09-16T05:33:23.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:33:23 smithi157 bash[24585]: cluster 2024-09-16T05:33:23.009592+0000 mon.a (mon.0) 247 : cluster [DBG] 1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.c 2024-09-16T05:33:23.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:33:23 smithi157 bash[24585]: cluster 2024-09-16T05:33:23.009630+0000 mon.a (mon.0) 248 : cluster [DBG] 2: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.b 2024-09-16T05:33:23.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:33:23 smithi157 bash[24585]: cluster 2024-09-16T05:33:23.010731+0000 mon.a (mon.0) 249 : cluster [DBG] fsmap 2024-09-16T05:33:23.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:33:23 smithi157 bash[24585]: cluster 2024-09-16T05:33:23.010816+0000 mon.a (mon.0) 250 : cluster [DBG] osdmap e4: 0 total, 0 up, 0 in 2024-09-16T05:33:23.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:33:23 smithi157 bash[24585]: cluster 2024-09-16T05:33:23.011129+0000 mon.a (mon.0) 251 : cluster [DBG] mgrmap e13: a(active, since 93s) 2024-09-16T05:33:23.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:33:23 smithi157 bash[24585]: cluster 2024-09-16T05:33:23.011499+0000 mon.a (mon.0) 252 : cluster [INF] Health check cleared: MON_DOWN (was: 1/3 mons down, quorum a,c) 2024-09-16T05:33:23.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:33:23 smithi157 bash[24585]: cluster 2024-09-16T05:33:23.011555+0000 mon.a (mon.0) 253 : cluster [INF] Cluster is now healthy 2024-09-16T05:33:23.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:33:23 smithi157 bash[24585]: cluster 2024-09-16T05:33:23.018210+0000 mon.a (mon.0) 254 : cluster [INF] overall HEALTH_OK 2024-09-16T05:33:23.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:33:23 smithi086 bash[24289]: cluster 2024-09-16T05:33:17.932994+0000 mon.b (mon.2) 1 : cluster [INF] mon.b calling monitor election 2024-09-16T05:33:23.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:33:23 smithi086 bash[24289]: cluster 2024-09-16T05:33:22.971036+0000 mon.b (mon.2) 2 : cluster [INF] mon.b calling monitor election 2024-09-16T05:33:23.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:33:23 smithi086 bash[24289]: cluster 2024-09-16T05:33:22.973296+0000 mon.a (mon.0) 238 : cluster [INF] mon.a calling monitor election 2024-09-16T05:33:23.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:33:23 smithi086 bash[24289]: cluster 2024-09-16T05:33:22.973997+0000 mon.c (mon.1) 3 : cluster [INF] mon.c calling monitor election 2024-09-16T05:33:23.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:33:23 smithi086 bash[24289]: cluster 2024-09-16T05:33:22.998244+0000 mon.a (mon.0) 239 : cluster [INF] mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-16T05:33:23.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:33:23 smithi086 bash[24289]: cluster 2024-09-16T05:33:23.009308+0000 mon.a (mon.0) 240 : cluster [DBG] monmap epoch 3 2024-09-16T05:33:23.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:33:23 smithi086 bash[24289]: cluster 2024-09-16T05:33:23.009353+0000 mon.a (mon.0) 241 : cluster [DBG] fsid a6097908-73ec-11ef-bceb-c7b262605968 2024-09-16T05:33:23.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:33:23 smithi086 bash[24289]: cluster 2024-09-16T05:33:23.009393+0000 mon.a (mon.0) 242 : cluster [DBG] last_changed 2024-09-16T05:33:15.932677+0000 2024-09-16T05:33:23.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:33:23 smithi086 bash[24289]: cluster 2024-09-16T05:33:23.009434+0000 mon.a (mon.0) 243 : cluster [DBG] created 2024-09-16T05:30:45.222800+0000 2024-09-16T05:33:23.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:33:23 smithi086 bash[24289]: cluster 2024-09-16T05:33:23.009478+0000 mon.a (mon.0) 244 : cluster [DBG] min_mon_release 19 (squid) 2024-09-16T05:33:23.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:33:23 smithi086 bash[24289]: cluster 2024-09-16T05:33:23.009514+0000 mon.a (mon.0) 245 : cluster [DBG] election_strategy: 1 2024-09-16T05:33:23.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:33:23 smithi086 bash[24289]: cluster 2024-09-16T05:33:23.009552+0000 mon.a (mon.0) 246 : cluster [DBG] 0: [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] mon.a 2024-09-16T05:33:23.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:33:23 smithi086 bash[24289]: cluster 2024-09-16T05:33:23.009592+0000 mon.a (mon.0) 247 : cluster [DBG] 1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.c 2024-09-16T05:33:23.822 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:33:23 smithi086 bash[24289]: cluster 2024-09-16T05:33:23.009630+0000 mon.a (mon.0) 248 : cluster [DBG] 2: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.b 2024-09-16T05:33:23.822 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:33:23 smithi086 bash[24289]: cluster 2024-09-16T05:33:23.010731+0000 mon.a (mon.0) 249 : cluster [DBG] fsmap 2024-09-16T05:33:23.822 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:33:23 smithi086 bash[24289]: cluster 2024-09-16T05:33:23.010816+0000 mon.a (mon.0) 250 : cluster [DBG] osdmap e4: 0 total, 0 up, 0 in 2024-09-16T05:33:23.822 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:33:23 smithi086 bash[24289]: cluster 2024-09-16T05:33:23.011129+0000 mon.a (mon.0) 251 : cluster [DBG] mgrmap e13: a(active, since 93s) 2024-09-16T05:33:23.822 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:33:23 smithi086 bash[24289]: cluster 2024-09-16T05:33:23.011499+0000 mon.a (mon.0) 252 : cluster [INF] Health check cleared: MON_DOWN (was: 1/3 mons down, quorum a,c) 2024-09-16T05:33:23.822 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:33:23 smithi086 bash[24289]: cluster 2024-09-16T05:33:23.011555+0000 mon.a (mon.0) 253 : cluster [INF] Cluster is now healthy 2024-09-16T05:33:23.822 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:33:23 smithi086 bash[24289]: cluster 2024-09-16T05:33:23.018210+0000 mon.a (mon.0) 254 : cluster [INF] overall HEALTH_OK 2024-09-16T05:33:23.841 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:33:23 smithi047 bash[22744]: cluster 2024-09-16T05:33:17.932994+0000 mon.b (mon.2) 1 : cluster [INF] mon.b calling monitor election 2024-09-16T05:33:23.841 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:33:23 smithi047 bash[22744]: cluster 2024-09-16T05:33:22.971036+0000 mon.b (mon.2) 2 : cluster [INF] mon.b calling monitor election 2024-09-16T05:33:23.841 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:33:23 smithi047 bash[22744]: cluster 2024-09-16T05:33:22.973296+0000 mon.a (mon.0) 238 : cluster [INF] mon.a calling monitor election 2024-09-16T05:33:23.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:33:23 smithi047 bash[22744]: cluster 2024-09-16T05:33:22.973997+0000 mon.c (mon.1) 3 : cluster [INF] mon.c calling monitor election 2024-09-16T05:33:23.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:33:23 smithi047 bash[22744]: cluster 2024-09-16T05:33:22.998244+0000 mon.a (mon.0) 239 : cluster [INF] mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-16T05:33:23.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:33:23 smithi047 bash[22744]: cluster 2024-09-16T05:33:23.009308+0000 mon.a (mon.0) 240 : cluster [DBG] monmap epoch 3 2024-09-16T05:33:23.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:33:23 smithi047 bash[22744]: cluster 2024-09-16T05:33:23.009353+0000 mon.a (mon.0) 241 : cluster [DBG] fsid a6097908-73ec-11ef-bceb-c7b262605968 2024-09-16T05:33:23.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:33:23 smithi047 bash[22744]: cluster 2024-09-16T05:33:23.009393+0000 mon.a (mon.0) 242 : cluster [DBG] last_changed 2024-09-16T05:33:15.932677+0000 2024-09-16T05:33:23.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:33:23 smithi047 bash[22744]: cluster 2024-09-16T05:33:23.009434+0000 mon.a (mon.0) 243 : cluster [DBG] created 2024-09-16T05:30:45.222800+0000 2024-09-16T05:33:23.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:33:23 smithi047 bash[22744]: cluster 2024-09-16T05:33:23.009478+0000 mon.a (mon.0) 244 : cluster [DBG] min_mon_release 19 (squid) 2024-09-16T05:33:23.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:33:23 smithi047 bash[22744]: cluster 2024-09-16T05:33:23.009514+0000 mon.a (mon.0) 245 : cluster [DBG] election_strategy: 1 2024-09-16T05:33:23.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:33:23 smithi047 bash[22744]: cluster 2024-09-16T05:33:23.009552+0000 mon.a (mon.0) 246 : cluster [DBG] 0: [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] mon.a 2024-09-16T05:33:23.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:33:23 smithi047 bash[22744]: cluster 2024-09-16T05:33:23.009592+0000 mon.a (mon.0) 247 : cluster [DBG] 1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.c 2024-09-16T05:33:23.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:33:23 smithi047 bash[22744]: cluster 2024-09-16T05:33:23.009630+0000 mon.a (mon.0) 248 : cluster [DBG] 2: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.b 2024-09-16T05:33:23.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:33:23 smithi047 bash[22744]: cluster 2024-09-16T05:33:23.010731+0000 mon.a (mon.0) 249 : cluster [DBG] fsmap 2024-09-16T05:33:23.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:33:23 smithi047 bash[22744]: cluster 2024-09-16T05:33:23.010816+0000 mon.a (mon.0) 250 : cluster [DBG] osdmap e4: 0 total, 0 up, 0 in 2024-09-16T05:33:23.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:33:23 smithi047 bash[22744]: cluster 2024-09-16T05:33:23.011129+0000 mon.a (mon.0) 251 : cluster [DBG] mgrmap e13: a(active, since 93s) 2024-09-16T05:33:23.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:33:23 smithi047 bash[22744]: cluster 2024-09-16T05:33:23.011499+0000 mon.a (mon.0) 252 : cluster [INF] Health check cleared: MON_DOWN (was: 1/3 mons down, quorum a,c) 2024-09-16T05:33:23.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:33:23 smithi047 bash[22744]: cluster 2024-09-16T05:33:23.011555+0000 mon.a (mon.0) 253 : cluster [INF] Cluster is now healthy 2024-09-16T05:33:23.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:33:23 smithi047 bash[22744]: cluster 2024-09-16T05:33:23.018210+0000 mon.a (mon.0) 254 : cluster [INF] overall HEALTH_OK 2024-09-16T05:33:25.055 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:33:24 smithi157 bash[24585]: cluster 2024-09-16T05:33:23.459874+0000 mgr.a (mgr.14150) 80 : cluster [DBG] pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T05:33:25.055 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:33:24 smithi157 bash[24585]: audit 2024-09-16T05:33:23.777557+0000 mon.a (mon.0) 255 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:33:25.055 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:33:24 smithi157 bash[24585]: audit 2024-09-16T05:33:23.782549+0000 mon.a (mon.0) 256 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:33:25.055 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:33:24 smithi157 bash[24585]: cephadm 2024-09-16T05:33:23.783530+0000 mgr.a (mgr.14150) 81 : cephadm [INF] Reconfiguring mon.b (monmap changed)... 2024-09-16T05:33:25.055 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:33:24 smithi157 bash[24585]: audit 2024-09-16T05:33:23.784012+0000 mon.a (mon.0) 257 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-16T05:33:25.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:33:24 smithi157 bash[24585]: audit 2024-09-16T05:33:23.785212+0000 mon.a (mon.0) 258 : audit [DBG] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-16T05:33:25.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:33:24 smithi157 bash[24585]: audit 2024-09-16T05:33:23.786312+0000 mon.a (mon.0) 259 : audit [DBG] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T05:33:25.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:33:24 smithi157 bash[24585]: cephadm 2024-09-16T05:33:23.787718+0000 mgr.a (mgr.14150) 82 : cephadm [INF] Reconfiguring daemon mon.b on smithi086 2024-09-16T05:33:25.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:33:24 smithi157 bash[24585]: audit 2024-09-16T05:33:23.933698+0000 mon.a (mon.0) 260 : audit [DBG] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-16T05:33:25.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:33:24 smithi086 bash[24289]: cluster 2024-09-16T05:33:23.459874+0000 mgr.a (mgr.14150) 80 : cluster [DBG] pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T05:33:25.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:33:24 smithi086 bash[24289]: audit 2024-09-16T05:33:23.777557+0000 mon.a (mon.0) 255 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:33:25.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:33:24 smithi086 bash[24289]: audit 2024-09-16T05:33:23.782549+0000 mon.a (mon.0) 256 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:33:25.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:33:24 smithi086 bash[24289]: cephadm 2024-09-16T05:33:23.783530+0000 mgr.a (mgr.14150) 81 : cephadm [INF] Reconfiguring mon.b (monmap changed)... 2024-09-16T05:33:25.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:33:24 smithi086 bash[24289]: audit 2024-09-16T05:33:23.784012+0000 mon.a (mon.0) 257 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-16T05:33:25.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:33:24 smithi086 bash[24289]: audit 2024-09-16T05:33:23.785212+0000 mon.a (mon.0) 258 : audit [DBG] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-16T05:33:25.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:33:24 smithi086 bash[24289]: audit 2024-09-16T05:33:23.786312+0000 mon.a (mon.0) 259 : audit [DBG] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T05:33:25.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:33:24 smithi086 bash[24289]: cephadm 2024-09-16T05:33:23.787718+0000 mgr.a (mgr.14150) 82 : cephadm [INF] Reconfiguring daemon mon.b on smithi086 2024-09-16T05:33:25.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:33:24 smithi086 bash[24289]: audit 2024-09-16T05:33:23.933698+0000 mon.a (mon.0) 260 : audit [DBG] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-16T05:33:25.091 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:33:24 smithi047 bash[22744]: cluster 2024-09-16T05:33:23.459874+0000 mgr.a (mgr.14150) 80 : cluster [DBG] pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T05:33:25.091 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:33:24 smithi047 bash[22744]: audit 2024-09-16T05:33:23.777557+0000 mon.a (mon.0) 255 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:33:25.091 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:33:24 smithi047 bash[22744]: audit 2024-09-16T05:33:23.782549+0000 mon.a (mon.0) 256 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:33:25.091 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:33:24 smithi047 bash[22744]: cephadm 2024-09-16T05:33:23.783530+0000 mgr.a (mgr.14150) 81 : cephadm [INF] Reconfiguring mon.b (monmap changed)... 2024-09-16T05:33:25.091 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:33:24 smithi047 bash[22744]: audit 2024-09-16T05:33:23.784012+0000 mon.a (mon.0) 257 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-16T05:33:25.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:33:24 smithi047 bash[22744]: audit 2024-09-16T05:33:23.785212+0000 mon.a (mon.0) 258 : audit [DBG] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-16T05:33:25.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:33:24 smithi047 bash[22744]: audit 2024-09-16T05:33:23.786312+0000 mon.a (mon.0) 259 : audit [DBG] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T05:33:25.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:33:24 smithi047 bash[22744]: cephadm 2024-09-16T05:33:23.787718+0000 mgr.a (mgr.14150) 82 : cephadm [INF] Reconfiguring daemon mon.b on smithi086 2024-09-16T05:33:25.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:33:24 smithi047 bash[22744]: audit 2024-09-16T05:33:23.933698+0000 mon.a (mon.0) 260 : audit [DBG] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-16T05:33:26.382 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/a6097908-73ec-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T05:33:27.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:33:27 smithi086 bash[24289]: cluster 2024-09-16T05:33:25.460289+0000 mgr.a (mgr.14150) 83 : cluster [DBG] pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T05:33:27.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:33:27 smithi086 bash[24289]: audit 2024-09-16T05:33:26.062454+0000 mon.a (mon.0) 261 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:33:27.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:33:27 smithi086 bash[24289]: audit 2024-09-16T05:33:26.069368+0000 mon.a (mon.0) 262 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:33:27.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:33:27 smithi086 bash[24289]: cephadm 2024-09-16T05:33:26.070862+0000 mgr.a (mgr.14150) 84 : cephadm [INF] Reconfiguring mon.c (monmap changed)... 2024-09-16T05:33:27.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:33:27 smithi086 bash[24289]: audit 2024-09-16T05:33:26.071468+0000 mon.a (mon.0) 263 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-16T05:33:27.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:33:27 smithi086 bash[24289]: audit 2024-09-16T05:33:26.073110+0000 mon.a (mon.0) 264 : audit [DBG] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-16T05:33:27.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:33:27 smithi086 bash[24289]: audit 2024-09-16T05:33:26.074729+0000 mon.a (mon.0) 265 : audit [DBG] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T05:33:27.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:33:27 smithi086 bash[24289]: cephadm 2024-09-16T05:33:26.076575+0000 mgr.a (mgr.14150) 85 : cephadm [INF] Reconfiguring daemon mon.c on smithi157 2024-09-16T05:33:27.341 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:33:27 smithi047 bash[22744]: cluster 2024-09-16T05:33:25.460289+0000 mgr.a (mgr.14150) 83 : cluster [DBG] pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T05:33:27.341 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:33:27 smithi047 bash[22744]: audit 2024-09-16T05:33:26.062454+0000 mon.a (mon.0) 261 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:33:27.341 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:33:27 smithi047 bash[22744]: audit 2024-09-16T05:33:26.069368+0000 mon.a (mon.0) 262 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:33:27.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:33:27 smithi047 bash[22744]: cephadm 2024-09-16T05:33:26.070862+0000 mgr.a (mgr.14150) 84 : cephadm [INF] Reconfiguring mon.c (monmap changed)... 2024-09-16T05:33:27.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:33:27 smithi047 bash[22744]: audit 2024-09-16T05:33:26.071468+0000 mon.a (mon.0) 263 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-16T05:33:27.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:33:27 smithi047 bash[22744]: audit 2024-09-16T05:33:26.073110+0000 mon.a (mon.0) 264 : audit [DBG] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-16T05:33:27.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:33:27 smithi047 bash[22744]: audit 2024-09-16T05:33:26.074729+0000 mon.a (mon.0) 265 : audit [DBG] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T05:33:27.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:33:27 smithi047 bash[22744]: cephadm 2024-09-16T05:33:26.076575+0000 mgr.a (mgr.14150) 85 : cephadm [INF] Reconfiguring daemon mon.c on smithi157 2024-09-16T05:33:27.449 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:33:27 smithi157 bash[24585]: cluster 2024-09-16T05:33:25.460289+0000 mgr.a (mgr.14150) 83 : cluster [DBG] pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T05:33:27.449 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:33:27 smithi157 bash[24585]: audit 2024-09-16T05:33:26.062454+0000 mon.a (mon.0) 261 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:33:27.450 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:33:27 smithi157 bash[24585]: audit 2024-09-16T05:33:26.069368+0000 mon.a (mon.0) 262 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:33:27.450 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:33:27 smithi157 bash[24585]: cephadm 2024-09-16T05:33:26.070862+0000 mgr.a (mgr.14150) 84 : cephadm [INF] Reconfiguring mon.c (monmap changed)... 2024-09-16T05:33:27.450 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:33:27 smithi157 bash[24585]: audit 2024-09-16T05:33:26.071468+0000 mon.a (mon.0) 263 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-16T05:33:27.450 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:33:27 smithi157 bash[24585]: audit 2024-09-16T05:33:26.073110+0000 mon.a (mon.0) 264 : audit [DBG] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-16T05:33:27.450 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:33:27 smithi157 bash[24585]: audit 2024-09-16T05:33:26.074729+0000 mon.a (mon.0) 265 : audit [DBG] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T05:33:27.450 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:33:27 smithi157 bash[24585]: cephadm 2024-09-16T05:33:26.076575+0000 mgr.a (mgr.14150) 85 : cephadm [INF] Reconfiguring daemon mon.c on smithi157 2024-09-16T05:33:27.710 INFO:teuthology.orchestra.run.smithi047.stdout:# minimal ceph.conf for a6097908-73ec-11ef-bceb-c7b262605968 2024-09-16T05:33:27.710 INFO:teuthology.orchestra.run.smithi047.stdout:[global] 2024-09-16T05:33:27.710 INFO:teuthology.orchestra.run.smithi047.stdout: fsid = a6097908-73ec-11ef-bceb-c7b262605968 2024-09-16T05:33:27.710 INFO:teuthology.orchestra.run.smithi047.stdout: mon_host = [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-09-16T05:33:28.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:33:28 smithi086 bash[24289]: audit 2024-09-16T05:33:27.709805+0000 mon.a (mon.0) 266 : audit [DBG] from='client.? 172.21.15.47:0/743758760' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T05:33:28.341 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:33:28 smithi047 bash[22744]: audit 2024-09-16T05:33:27.709805+0000 mon.a (mon.0) 266 : audit [DBG] from='client.? 172.21.15.47:0/743758760' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T05:33:28.346 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-09-16T05:33:28.346 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-09-16T05:33:28.346 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd of=/etc/ceph/ceph.conf 2024-09-16T05:33:28.360 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-09-16T05:33:28.360 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-16T05:33:28.413 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-09-16T05:33:28.413 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd of=/etc/ceph/ceph.conf 2024-09-16T05:33:28.427 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-09-16T05:33:28.427 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-16T05:33:28.484 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-09-16T05:33:28.484 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd of=/etc/ceph/ceph.conf 2024-09-16T05:33:28.495 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:33:28 smithi157 bash[24585]: audit 2024-09-16T05:33:27.709805+0000 mon.a (mon.0) 266 : audit [DBG] from='client.? 172.21.15.47:0/743758760' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T05:33:28.499 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-09-16T05:33:28.499 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-16T05:33:28.558 INFO:tasks.cephadm:Adding mgr.a on smithi047 2024-09-16T05:33:28.559 INFO:tasks.cephadm:Adding mgr.b on smithi086 2024-09-16T05:33:28.559 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a6097908-73ec-11ef-bceb-c7b262605968 -- ceph orch apply mgr '2;smithi047=a;smithi086=b' 2024-09-16T05:33:29.555 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:33:29 smithi157 bash[24585]: cluster 2024-09-16T05:33:27.460637+0000 mgr.a (mgr.14150) 86 : cluster [DBG] pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T05:33:29.555 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:33:29 smithi157 bash[24585]: audit 2024-09-16T05:33:28.161267+0000 mon.a (mon.0) 267 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:33:29.555 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:33:29 smithi157 bash[24585]: audit 2024-09-16T05:33:28.166261+0000 mon.a (mon.0) 268 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:33:29.555 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:33:29 smithi157 bash[24585]: audit 2024-09-16T05:33:28.167981+0000 mon.a (mon.0) 269 : audit [DBG] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T05:33:29.555 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:33:29 smithi157 bash[24585]: audit 2024-09-16T05:33:28.889504+0000 mon.a (mon.0) 270 : audit [DBG] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T05:33:29.555 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:33:29 smithi157 bash[24585]: audit 2024-09-16T05:33:28.891437+0000 mon.a (mon.0) 271 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T05:33:29.555 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:33:29 smithi157 bash[24585]: audit 2024-09-16T05:33:28.901157+0000 mon.a (mon.0) 272 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:33:29.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:33:29 smithi086 bash[24289]: cluster 2024-09-16T05:33:27.460637+0000 mgr.a (mgr.14150) 86 : cluster [DBG] pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T05:33:29.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:33:29 smithi086 bash[24289]: audit 2024-09-16T05:33:28.161267+0000 mon.a (mon.0) 267 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:33:29.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:33:29 smithi086 bash[24289]: audit 2024-09-16T05:33:28.166261+0000 mon.a (mon.0) 268 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:33:29.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:33:29 smithi086 bash[24289]: audit 2024-09-16T05:33:28.167981+0000 mon.a (mon.0) 269 : audit [DBG] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T05:33:29.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:33:29 smithi086 bash[24289]: audit 2024-09-16T05:33:28.889504+0000 mon.a (mon.0) 270 : audit [DBG] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T05:33:29.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:33:29 smithi086 bash[24289]: audit 2024-09-16T05:33:28.891437+0000 mon.a (mon.0) 271 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T05:33:29.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:33:29 smithi086 bash[24289]: audit 2024-09-16T05:33:28.901157+0000 mon.a (mon.0) 272 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:33:29.591 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:33:29 smithi047 bash[22744]: cluster 2024-09-16T05:33:27.460637+0000 mgr.a (mgr.14150) 86 : cluster [DBG] pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T05:33:29.591 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:33:29 smithi047 bash[22744]: audit 2024-09-16T05:33:28.161267+0000 mon.a (mon.0) 267 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:33:29.591 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:33:29 smithi047 bash[22744]: audit 2024-09-16T05:33:28.166261+0000 mon.a (mon.0) 268 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:33:29.591 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:33:29 smithi047 bash[22744]: audit 2024-09-16T05:33:28.167981+0000 mon.a (mon.0) 269 : audit [DBG] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T05:33:29.591 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:33:29 smithi047 bash[22744]: audit 2024-09-16T05:33:28.889504+0000 mon.a (mon.0) 270 : audit [DBG] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T05:33:29.591 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:33:29 smithi047 bash[22744]: audit 2024-09-16T05:33:28.891437+0000 mon.a (mon.0) 271 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T05:33:29.591 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:33:29 smithi047 bash[22744]: audit 2024-09-16T05:33:28.901157+0000 mon.a (mon.0) 272 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:33:31.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:33:31 smithi157 bash[24585]: cluster 2024-09-16T05:33:29.460999+0000 mgr.a (mgr.14150) 87 : cluster [DBG] pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T05:33:31.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:33:31 smithi086 bash[24289]: cluster 2024-09-16T05:33:29.460999+0000 mgr.a (mgr.14150) 87 : cluster [DBG] pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T05:33:31.591 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:33:31 smithi047 bash[22744]: cluster 2024-09-16T05:33:29.460999+0000 mgr.a (mgr.14150) 87 : cluster [DBG] pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T05:33:32.322 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /var/lib/ceph/a6097908-73ec-11ef-bceb-c7b262605968/mon.c/config 2024-09-16T05:33:33.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:33:33 smithi157 bash[24585]: cluster 2024-09-16T05:33:31.461437+0000 mgr.a (mgr.14150) 88 : cluster [DBG] pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T05:33:33.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:33:33 smithi086 bash[24289]: cluster 2024-09-16T05:33:31.461437+0000 mgr.a (mgr.14150) 88 : cluster [DBG] pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T05:33:33.591 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:33:33 smithi047 bash[22744]: cluster 2024-09-16T05:33:31.461437+0000 mgr.a (mgr.14150) 88 : cluster [DBG] pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T05:33:33.689 INFO:teuthology.orchestra.run.smithi157.stdout:Scheduled mgr update... 2024-09-16T05:33:34.262 DEBUG:teuthology.orchestra.run.smithi086:mgr.b> sudo journalctl -f -n 0 -u ceph-a6097908-73ec-11ef-bceb-c7b262605968@mgr.b.service 2024-09-16T05:33:34.264 INFO:tasks.cephadm:Deploying OSDs... 2024-09-16T05:33:34.265 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-09-16T05:33:34.265 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/scratch_devs of=/dev/stdout 2024-09-16T05:33:34.272 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-16T05:33:34.272 DEBUG:teuthology.orchestra.run.smithi047:> stat /dev/vg_nvme/lv_1 2024-09-16T05:33:34.319 INFO:teuthology.orchestra.run.smithi047.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-16T05:33:34.319 INFO:teuthology.orchestra.run.smithi047.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-16T05:33:34.319 INFO:teuthology.orchestra.run.smithi047.stdout:Device: 5h/5d Inode: 889 Links: 1 2024-09-16T05:33:34.319 INFO:teuthology.orchestra.run.smithi047.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-16T05:33:34.319 INFO:teuthology.orchestra.run.smithi047.stdout:Access: 2024-09-16 05:24:01.246616682 +0000 2024-09-16T05:33:34.319 INFO:teuthology.orchestra.run.smithi047.stdout:Modify: 2024-09-16 05:24:00.982619041 +0000 2024-09-16T05:33:34.319 INFO:teuthology.orchestra.run.smithi047.stdout:Change: 2024-09-16 05:24:00.982619041 +0000 2024-09-16T05:33:34.319 INFO:teuthology.orchestra.run.smithi047.stdout: Birth: - 2024-09-16T05:33:34.320 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-16T05:33:34.373 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2024-09-16T05:33:34.373 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2024-09-16T05:33:34.373 INFO:teuthology.orchestra.run.smithi047.stderr:512 bytes copied, 0.000276331 s, 1.9 MB/s 2024-09-16T05:33:34.375 DEBUG:teuthology.orchestra.run.smithi047:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-16T05:33:34.428 DEBUG:teuthology.orchestra.run.smithi047:> stat /dev/vg_nvme/lv_2 2024-09-16T05:33:34.474 INFO:teuthology.orchestra.run.smithi047.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-16T05:33:34.474 INFO:teuthology.orchestra.run.smithi047.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-16T05:33:34.474 INFO:teuthology.orchestra.run.smithi047.stdout:Device: 5h/5d Inode: 903 Links: 1 2024-09-16T05:33:34.475 INFO:teuthology.orchestra.run.smithi047.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-16T05:33:34.475 INFO:teuthology.orchestra.run.smithi047.stdout:Access: 2024-09-16 05:24:01.770612002 +0000 2024-09-16T05:33:34.475 INFO:teuthology.orchestra.run.smithi047.stdout:Modify: 2024-09-16 05:24:01.486614540 +0000 2024-09-16T05:33:34.475 INFO:teuthology.orchestra.run.smithi047.stdout:Change: 2024-09-16 05:24:01.486614540 +0000 2024-09-16T05:33:34.475 INFO:teuthology.orchestra.run.smithi047.stdout: Birth: - 2024-09-16T05:33:34.475 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-16T05:33:34.529 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2024-09-16T05:33:34.530 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2024-09-16T05:33:34.530 INFO:teuthology.orchestra.run.smithi047.stderr:512 bytes copied, 0.000322167 s, 1.6 MB/s 2024-09-16T05:33:34.531 DEBUG:teuthology.orchestra.run.smithi047:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-16T05:33:34.581 DEBUG:teuthology.orchestra.run.smithi047:> stat /dev/vg_nvme/lv_3 2024-09-16T05:33:34.630 INFO:teuthology.orchestra.run.smithi047.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-16T05:33:34.630 INFO:teuthology.orchestra.run.smithi047.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-16T05:33:34.631 INFO:teuthology.orchestra.run.smithi047.stdout:Device: 5h/5d Inode: 923 Links: 1 2024-09-16T05:33:34.631 INFO:teuthology.orchestra.run.smithi047.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-16T05:33:34.631 INFO:teuthology.orchestra.run.smithi047.stdout:Access: 2024-09-16 05:24:02.214608038 +0000 2024-09-16T05:33:34.631 INFO:teuthology.orchestra.run.smithi047.stdout:Modify: 2024-09-16 05:24:01.982610110 +0000 2024-09-16T05:33:34.631 INFO:teuthology.orchestra.run.smithi047.stdout:Change: 2024-09-16 05:24:01.982610110 +0000 2024-09-16T05:33:34.631 INFO:teuthology.orchestra.run.smithi047.stdout: Birth: - 2024-09-16T05:33:34.631 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-16T05:33:34.685 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2024-09-16T05:33:34.685 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2024-09-16T05:33:34.685 INFO:teuthology.orchestra.run.smithi047.stderr:512 bytes copied, 0.000281934 s, 1.8 MB/s 2024-09-16T05:33:34.686 DEBUG:teuthology.orchestra.run.smithi047:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-16T05:33:34.737 DEBUG:teuthology.orchestra.run.smithi047:> stat /dev/vg_nvme/lv_4 2024-09-16T05:33:34.782 INFO:teuthology.orchestra.run.smithi047.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-16T05:33:34.782 INFO:teuthology.orchestra.run.smithi047.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-16T05:33:34.783 INFO:teuthology.orchestra.run.smithi047.stdout:Device: 5h/5d Inode: 933 Links: 1 2024-09-16T05:33:34.783 INFO:teuthology.orchestra.run.smithi047.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-16T05:33:34.783 INFO:teuthology.orchestra.run.smithi047.stdout:Access: 2024-09-16 05:24:02.738603357 +0000 2024-09-16T05:33:34.783 INFO:teuthology.orchestra.run.smithi047.stdout:Modify: 2024-09-16 05:24:02.446605964 +0000 2024-09-16T05:33:34.783 INFO:teuthology.orchestra.run.smithi047.stdout:Change: 2024-09-16 05:24:02.446605964 +0000 2024-09-16T05:33:34.783 INFO:teuthology.orchestra.run.smithi047.stdout: Birth: - 2024-09-16T05:33:34.783 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-16T05:33:34.837 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2024-09-16T05:33:34.837 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2024-09-16T05:33:34.837 INFO:teuthology.orchestra.run.smithi047.stderr:512 bytes copied, 0.00024717 s, 2.1 MB/s 2024-09-16T05:33:34.839 DEBUG:teuthology.orchestra.run.smithi047:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-16T05:33:34.888 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-09-16T05:33:34.888 DEBUG:teuthology.orchestra.run.smithi086:> dd if=/scratch_devs of=/dev/stdout 2024-09-16T05:33:34.894 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-16T05:33:34.894 DEBUG:teuthology.orchestra.run.smithi086:> stat /dev/vg_nvme/lv_1 2024-09-16T05:33:34.943 INFO:teuthology.orchestra.run.smithi086.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-16T05:33:34.944 INFO:teuthology.orchestra.run.smithi086.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-16T05:33:34.944 INFO:teuthology.orchestra.run.smithi086.stdout:Device: 5h/5d Inode: 887 Links: 1 2024-09-16T05:33:34.944 INFO:teuthology.orchestra.run.smithi086.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-16T05:33:34.944 INFO:teuthology.orchestra.run.smithi086.stdout:Access: 2024-09-16 05:23:57.594360663 +0000 2024-09-16T05:33:34.944 INFO:teuthology.orchestra.run.smithi086.stdout:Modify: 2024-09-16 05:23:57.338362936 +0000 2024-09-16T05:33:34.944 INFO:teuthology.orchestra.run.smithi086.stdout:Change: 2024-09-16 05:23:57.338362936 +0000 2024-09-16T05:33:34.944 INFO:teuthology.orchestra.run.smithi086.stdout: Birth: - 2024-09-16T05:33:34.944 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-16T05:33:34.997 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:33:34 smithi086 bash[24289]: cluster 2024-09-16T05:33:33.461921+0000 mgr.a (mgr.14150) 89 : cluster [DBG] pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T05:33:34.997 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:33:34 smithi086 bash[24289]: audit 2024-09-16T05:33:33.678817+0000 mgr.a (mgr.14150) 90 : audit [DBG] from='client.24109 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "2;smithi047=a;smithi086=b", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:33:34.997 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:33:34 smithi086 bash[24289]: cephadm 2024-09-16T05:33:33.681829+0000 mgr.a (mgr.14150) 91 : cephadm [INF] Saving service mgr spec with placement smithi047=a;smithi086=b;count:2 2024-09-16T05:33:34.997 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:33:34 smithi086 bash[24289]: audit 2024-09-16T05:33:33.688221+0000 mon.a (mon.0) 273 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:33:34.997 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:33:34 smithi086 bash[24289]: audit 2024-09-16T05:33:33.689920+0000 mon.a (mon.0) 274 : audit [DBG] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T05:33:34.998 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:33:34 smithi086 bash[24289]: audit 2024-09-16T05:33:33.693354+0000 mon.a (mon.0) 275 : audit [DBG] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T05:33:34.998 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:33:34 smithi086 bash[24289]: audit 2024-09-16T05:33:33.695065+0000 mon.a (mon.0) 276 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T05:33:34.998 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:33:34 smithi086 bash[24289]: audit 2024-09-16T05:33:33.703868+0000 mon.a (mon.0) 277 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:33:34.998 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:33:34 smithi086 bash[24289]: audit 2024-09-16T05:33:33.706807+0000 mon.a (mon.0) 278 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.b", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-16T05:33:34.998 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:33:34 smithi086 bash[24289]: audit 2024-09-16T05:33:33.709410+0000 mon.a (mon.0) 279 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.b", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-16T05:33:34.998 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:33:34 smithi086 bash[24289]: audit 2024-09-16T05:33:33.713763+0000 mon.a (mon.0) 280 : audit [DBG] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-16T05:33:34.998 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:33:34 smithi086 bash[24289]: audit 2024-09-16T05:33:33.715634+0000 mon.a (mon.0) 281 : audit [DBG] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T05:33:34.998 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:33:34 smithi086 bash[24289]: cephadm 2024-09-16T05:33:33.717542+0000 mgr.a (mgr.14150) 92 : cephadm [INF] Deploying daemon mgr.b on smithi086 2024-09-16T05:33:34.999 INFO:teuthology.orchestra.run.smithi086.stderr:1+0 records in 2024-09-16T05:33:34.999 INFO:teuthology.orchestra.run.smithi086.stderr:1+0 records out 2024-09-16T05:33:35.000 INFO:teuthology.orchestra.run.smithi086.stderr:512 bytes copied, 0.000334378 s, 1.5 MB/s 2024-09-16T05:33:35.000 DEBUG:teuthology.orchestra.run.smithi086:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-16T05:33:35.049 DEBUG:teuthology.orchestra.run.smithi086:> stat /dev/vg_nvme/lv_2 2024-09-16T05:33:35.055 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:33:34 smithi157 bash[24585]: cluster 2024-09-16T05:33:33.461921+0000 mgr.a (mgr.14150) 89 : cluster [DBG] pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T05:33:35.055 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:33:34 smithi157 bash[24585]: audit 2024-09-16T05:33:33.678817+0000 mgr.a (mgr.14150) 90 : audit [DBG] from='client.24109 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "2;smithi047=a;smithi086=b", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:33:35.055 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:33:34 smithi157 bash[24585]: cephadm 2024-09-16T05:33:33.681829+0000 mgr.a (mgr.14150) 91 : cephadm [INF] Saving service mgr spec with placement smithi047=a;smithi086=b;count:2 2024-09-16T05:33:35.055 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:33:34 smithi157 bash[24585]: audit 2024-09-16T05:33:33.688221+0000 mon.a (mon.0) 273 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:33:35.055 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:33:34 smithi157 bash[24585]: audit 2024-09-16T05:33:33.689920+0000 mon.a (mon.0) 274 : audit [DBG] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T05:33:35.055 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:33:34 smithi157 bash[24585]: audit 2024-09-16T05:33:33.693354+0000 mon.a (mon.0) 275 : audit [DBG] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T05:33:35.055 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:33:34 smithi157 bash[24585]: audit 2024-09-16T05:33:33.695065+0000 mon.a (mon.0) 276 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T05:33:35.055 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:33:34 smithi157 bash[24585]: audit 2024-09-16T05:33:33.703868+0000 mon.a (mon.0) 277 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:33:35.055 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:33:34 smithi157 bash[24585]: audit 2024-09-16T05:33:33.706807+0000 mon.a (mon.0) 278 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.b", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-16T05:33:35.055 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:33:34 smithi157 bash[24585]: audit 2024-09-16T05:33:33.709410+0000 mon.a (mon.0) 279 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.b", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-16T05:33:35.055 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:33:34 smithi157 bash[24585]: audit 2024-09-16T05:33:33.713763+0000 mon.a (mon.0) 280 : audit [DBG] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-16T05:33:35.055 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:33:34 smithi157 bash[24585]: audit 2024-09-16T05:33:33.715634+0000 mon.a (mon.0) 281 : audit [DBG] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T05:33:35.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:33:34 smithi157 bash[24585]: cephadm 2024-09-16T05:33:33.717542+0000 mgr.a (mgr.14150) 92 : cephadm [INF] Deploying daemon mgr.b on smithi086 2024-09-16T05:33:35.091 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:33:34 smithi047 bash[22744]: cluster 2024-09-16T05:33:33.461921+0000 mgr.a (mgr.14150) 89 : cluster [DBG] pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T05:33:35.091 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:33:34 smithi047 bash[22744]: audit 2024-09-16T05:33:33.678817+0000 mgr.a (mgr.14150) 90 : audit [DBG] from='client.24109 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "2;smithi047=a;smithi086=b", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:33:35.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:33:34 smithi047 bash[22744]: cephadm 2024-09-16T05:33:33.681829+0000 mgr.a (mgr.14150) 91 : cephadm [INF] Saving service mgr spec with placement smithi047=a;smithi086=b;count:2 2024-09-16T05:33:35.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:33:34 smithi047 bash[22744]: audit 2024-09-16T05:33:33.688221+0000 mon.a (mon.0) 273 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:33:35.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:33:34 smithi047 bash[22744]: audit 2024-09-16T05:33:33.689920+0000 mon.a (mon.0) 274 : audit [DBG] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T05:33:35.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:33:34 smithi047 bash[22744]: audit 2024-09-16T05:33:33.693354+0000 mon.a (mon.0) 275 : audit [DBG] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T05:33:35.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:33:34 smithi047 bash[22744]: audit 2024-09-16T05:33:33.695065+0000 mon.a (mon.0) 276 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T05:33:35.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:33:34 smithi047 bash[22744]: audit 2024-09-16T05:33:33.703868+0000 mon.a (mon.0) 277 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:33:35.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:33:34 smithi047 bash[22744]: audit 2024-09-16T05:33:33.706807+0000 mon.a (mon.0) 278 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.b", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-16T05:33:35.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:33:34 smithi047 bash[22744]: audit 2024-09-16T05:33:33.709410+0000 mon.a (mon.0) 279 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.b", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-16T05:33:35.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:33:34 smithi047 bash[22744]: audit 2024-09-16T05:33:33.713763+0000 mon.a (mon.0) 280 : audit [DBG] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-16T05:33:35.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:33:34 smithi047 bash[22744]: audit 2024-09-16T05:33:33.715634+0000 mon.a (mon.0) 281 : audit [DBG] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T05:33:35.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:33:34 smithi047 bash[22744]: cephadm 2024-09-16T05:33:33.717542+0000 mgr.a (mgr.14150) 92 : cephadm [INF] Deploying daemon mgr.b on smithi086 2024-09-16T05:33:35.098 INFO:teuthology.orchestra.run.smithi086.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-16T05:33:35.099 INFO:teuthology.orchestra.run.smithi086.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-16T05:33:35.099 INFO:teuthology.orchestra.run.smithi086.stdout:Device: 5h/5d Inode: 900 Links: 1 2024-09-16T05:33:35.099 INFO:teuthology.orchestra.run.smithi086.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-16T05:33:35.099 INFO:teuthology.orchestra.run.smithi086.stdout:Access: 2024-09-16 05:23:58.082356333 +0000 2024-09-16T05:33:35.099 INFO:teuthology.orchestra.run.smithi086.stdout:Modify: 2024-09-16 05:23:57.822358640 +0000 2024-09-16T05:33:35.099 INFO:teuthology.orchestra.run.smithi086.stdout:Change: 2024-09-16 05:23:57.822358640 +0000 2024-09-16T05:33:35.099 INFO:teuthology.orchestra.run.smithi086.stdout: Birth: - 2024-09-16T05:33:35.099 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-16T05:33:35.153 INFO:teuthology.orchestra.run.smithi086.stderr:1+0 records in 2024-09-16T05:33:35.153 INFO:teuthology.orchestra.run.smithi086.stderr:1+0 records out 2024-09-16T05:33:35.153 INFO:teuthology.orchestra.run.smithi086.stderr:512 bytes copied, 0.000387347 s, 1.3 MB/s 2024-09-16T05:33:35.154 DEBUG:teuthology.orchestra.run.smithi086:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-16T05:33:35.205 DEBUG:teuthology.orchestra.run.smithi086:> stat /dev/vg_nvme/lv_3 2024-09-16T05:33:35.251 INFO:teuthology.orchestra.run.smithi086.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-16T05:33:35.251 INFO:teuthology.orchestra.run.smithi086.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-16T05:33:35.251 INFO:teuthology.orchestra.run.smithi086.stdout:Device: 5h/5d Inode: 917 Links: 1 2024-09-16T05:33:35.251 INFO:teuthology.orchestra.run.smithi086.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-16T05:33:35.251 INFO:teuthology.orchestra.run.smithi086.stdout:Access: 2024-09-16 05:23:58.586351858 +0000 2024-09-16T05:33:35.251 INFO:teuthology.orchestra.run.smithi086.stdout:Modify: 2024-09-16 05:23:58.314354274 +0000 2024-09-16T05:33:35.252 INFO:teuthology.orchestra.run.smithi086.stdout:Change: 2024-09-16 05:23:58.314354274 +0000 2024-09-16T05:33:35.252 INFO:teuthology.orchestra.run.smithi086.stdout: Birth: - 2024-09-16T05:33:35.252 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-16T05:33:35.305 INFO:teuthology.orchestra.run.smithi086.stderr:1+0 records in 2024-09-16T05:33:35.305 INFO:teuthology.orchestra.run.smithi086.stderr:1+0 records out 2024-09-16T05:33:35.306 INFO:teuthology.orchestra.run.smithi086.stderr:512 bytes copied, 0.000407826 s, 1.3 MB/s 2024-09-16T05:33:35.307 DEBUG:teuthology.orchestra.run.smithi086:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-16T05:33:35.357 DEBUG:teuthology.orchestra.run.smithi086:> stat /dev/vg_nvme/lv_4 2024-09-16T05:33:35.403 INFO:teuthology.orchestra.run.smithi086.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-16T05:33:35.403 INFO:teuthology.orchestra.run.smithi086.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-16T05:33:35.403 INFO:teuthology.orchestra.run.smithi086.stdout:Device: 5h/5d Inode: 938 Links: 1 2024-09-16T05:33:35.403 INFO:teuthology.orchestra.run.smithi086.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-16T05:33:35.403 INFO:teuthology.orchestra.run.smithi086.stdout:Access: 2024-09-16 05:23:59.078347492 +0000 2024-09-16T05:33:35.403 INFO:teuthology.orchestra.run.smithi086.stdout:Modify: 2024-09-16 05:23:58.830349694 +0000 2024-09-16T05:33:35.403 INFO:teuthology.orchestra.run.smithi086.stdout:Change: 2024-09-16 05:23:58.830349694 +0000 2024-09-16T05:33:35.403 INFO:teuthology.orchestra.run.smithi086.stdout: Birth: - 2024-09-16T05:33:35.403 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-16T05:33:35.459 INFO:teuthology.orchestra.run.smithi086.stderr:1+0 records in 2024-09-16T05:33:35.460 INFO:teuthology.orchestra.run.smithi086.stderr:1+0 records out 2024-09-16T05:33:35.460 INFO:teuthology.orchestra.run.smithi086.stderr:512 bytes copied, 0.000237407 s, 2.2 MB/s 2024-09-16T05:33:35.461 DEBUG:teuthology.orchestra.run.smithi086:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-16T05:33:35.507 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-09-16T05:33:35.507 DEBUG:teuthology.orchestra.run.smithi157:> dd if=/scratch_devs of=/dev/stdout 2024-09-16T05:33:35.514 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-16T05:33:35.514 DEBUG:teuthology.orchestra.run.smithi157:> stat /dev/vg_nvme/lv_1 2024-09-16T05:33:35.564 INFO:teuthology.orchestra.run.smithi157.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-16T05:33:35.564 INFO:teuthology.orchestra.run.smithi157.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-16T05:33:35.564 INFO:teuthology.orchestra.run.smithi157.stdout:Device: 5h/5d Inode: 871 Links: 1 2024-09-16T05:33:35.564 INFO:teuthology.orchestra.run.smithi157.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-16T05:33:35.564 INFO:teuthology.orchestra.run.smithi157.stdout:Access: 2024-09-16 05:23:57.664011423 +0000 2024-09-16T05:33:35.564 INFO:teuthology.orchestra.run.smithi157.stdout:Modify: 2024-09-16 05:23:57.416013637 +0000 2024-09-16T05:33:35.564 INFO:teuthology.orchestra.run.smithi157.stdout:Change: 2024-09-16 05:23:57.416013637 +0000 2024-09-16T05:33:35.564 INFO:teuthology.orchestra.run.smithi157.stdout: Birth: - 2024-09-16T05:33:35.565 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-16T05:33:35.618 INFO:teuthology.orchestra.run.smithi157.stderr:1+0 records in 2024-09-16T05:33:35.618 INFO:teuthology.orchestra.run.smithi157.stderr:1+0 records out 2024-09-16T05:33:35.618 INFO:teuthology.orchestra.run.smithi157.stderr:512 bytes copied, 0.000247809 s, 2.1 MB/s 2024-09-16T05:33:35.619 DEBUG:teuthology.orchestra.run.smithi157:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-16T05:33:35.669 DEBUG:teuthology.orchestra.run.smithi157:> stat /dev/vg_nvme/lv_2 2024-09-16T05:33:35.715 INFO:teuthology.orchestra.run.smithi157.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-16T05:33:35.715 INFO:teuthology.orchestra.run.smithi157.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-16T05:33:35.716 INFO:teuthology.orchestra.run.smithi157.stdout:Device: 5h/5d Inode: 890 Links: 1 2024-09-16T05:33:35.716 INFO:teuthology.orchestra.run.smithi157.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-16T05:33:35.716 INFO:teuthology.orchestra.run.smithi157.stdout:Access: 2024-09-16 05:23:58.136007212 +0000 2024-09-16T05:33:35.716 INFO:teuthology.orchestra.run.smithi157.stdout:Modify: 2024-09-16 05:23:57.880009497 +0000 2024-09-16T05:33:35.716 INFO:teuthology.orchestra.run.smithi157.stdout:Change: 2024-09-16 05:23:57.880009497 +0000 2024-09-16T05:33:35.716 INFO:teuthology.orchestra.run.smithi157.stdout: Birth: - 2024-09-16T05:33:35.716 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-16T05:33:35.774 INFO:teuthology.orchestra.run.smithi157.stderr:1+0 records in 2024-09-16T05:33:35.774 INFO:teuthology.orchestra.run.smithi157.stderr:1+0 records out 2024-09-16T05:33:35.774 INFO:teuthology.orchestra.run.smithi157.stderr:512 bytes copied, 0.000272454 s, 1.9 MB/s 2024-09-16T05:33:35.776 DEBUG:teuthology.orchestra.run.smithi157:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-16T05:33:35.824 DEBUG:teuthology.orchestra.run.smithi157:> stat /dev/vg_nvme/lv_3 2024-09-16T05:33:35.871 INFO:teuthology.orchestra.run.smithi157.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-16T05:33:35.871 INFO:teuthology.orchestra.run.smithi157.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-16T05:33:35.872 INFO:teuthology.orchestra.run.smithi157.stdout:Device: 5h/5d Inode: 905 Links: 1 2024-09-16T05:33:35.872 INFO:teuthology.orchestra.run.smithi157.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-16T05:33:35.872 INFO:teuthology.orchestra.run.smithi157.stdout:Access: 2024-09-16 05:23:58.352005283 +0000 2024-09-16T05:33:35.872 INFO:teuthology.orchestra.run.smithi157.stdout:Modify: 2024-09-16 05:23:58.348005318 +0000 2024-09-16T05:33:35.872 INFO:teuthology.orchestra.run.smithi157.stdout:Change: 2024-09-16 05:23:58.348005318 +0000 2024-09-16T05:33:35.872 INFO:teuthology.orchestra.run.smithi157.stdout: Birth: - 2024-09-16T05:33:35.872 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-16T05:33:35.926 INFO:teuthology.orchestra.run.smithi157.stderr:1+0 records in 2024-09-16T05:33:35.926 INFO:teuthology.orchestra.run.smithi157.stderr:1+0 records out 2024-09-16T05:33:35.926 INFO:teuthology.orchestra.run.smithi157.stderr:512 bytes copied, 0.000295189 s, 1.7 MB/s 2024-09-16T05:33:35.927 DEBUG:teuthology.orchestra.run.smithi157:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-16T05:33:35.976 DEBUG:teuthology.orchestra.run.smithi157:> stat /dev/vg_nvme/lv_4 2024-09-16T05:33:36.023 INFO:teuthology.orchestra.run.smithi157.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-16T05:33:36.023 INFO:teuthology.orchestra.run.smithi157.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-16T05:33:36.023 INFO:teuthology.orchestra.run.smithi157.stdout:Device: 5h/5d Inode: 930 Links: 1 2024-09-16T05:33:36.023 INFO:teuthology.orchestra.run.smithi157.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-16T05:33:36.023 INFO:teuthology.orchestra.run.smithi157.stdout:Access: 2024-09-16 05:23:59.075998814 +0000 2024-09-16T05:33:36.023 INFO:teuthology.orchestra.run.smithi157.stdout:Modify: 2024-09-16 05:23:58.828001028 +0000 2024-09-16T05:33:36.024 INFO:teuthology.orchestra.run.smithi157.stdout:Change: 2024-09-16 05:23:58.828001028 +0000 2024-09-16T05:33:36.024 INFO:teuthology.orchestra.run.smithi157.stdout: Birth: - 2024-09-16T05:33:36.024 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-16T05:33:36.077 INFO:teuthology.orchestra.run.smithi157.stderr:1+0 records in 2024-09-16T05:33:36.078 INFO:teuthology.orchestra.run.smithi157.stderr:1+0 records out 2024-09-16T05:33:36.078 INFO:teuthology.orchestra.run.smithi157.stderr:512 bytes copied, 0.000312372 s, 1.6 MB/s 2024-09-16T05:33:36.079 DEBUG:teuthology.orchestra.run.smithi157:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-16T05:33:36.128 INFO:tasks.cephadm:Deploying osd.0 on smithi047 with /dev/vg_nvme/lv_4... 2024-09-16T05:33:36.129 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a6097908-73ec-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-16T05:33:36.431 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:33:36 smithi086 systemd[1]: /etc/systemd/system/ceph-a6097908-73ec-11ef-bceb-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-16T05:33:36.432 INFO:journalctl@ceph.mgr.b.smithi086.stdout:Sep 16 05:33:36 smithi086 systemd[1]: /etc/systemd/system/ceph-a6097908-73ec-11ef-bceb-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-16T05:33:36.432 INFO:journalctl@ceph.mgr.b.smithi086.stdout:Sep 16 05:33:36 smithi086 systemd[1]: /etc/systemd/system/ceph-a6097908-73ec-11ef-bceb-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-16T05:33:36.691 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:33:36 smithi086 systemd[1]: /etc/systemd/system/ceph-a6097908-73ec-11ef-bceb-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-16T05:33:36.692 INFO:journalctl@ceph.mgr.b.smithi086.stdout:Sep 16 05:33:36 smithi086 systemd[1]: /etc/systemd/system/ceph-a6097908-73ec-11ef-bceb-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-16T05:33:36.692 INFO:journalctl@ceph.mgr.b.smithi086.stdout:Sep 16 05:33:36 smithi086 systemd[1]: /etc/systemd/system/ceph-a6097908-73ec-11ef-bceb-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-16T05:33:36.692 INFO:journalctl@ceph.mgr.b.smithi086.stdout:Sep 16 05:33:36 smithi086 systemd[1]: Started Ceph mgr.b for a6097908-73ec-11ef-bceb-c7b262605968. 2024-09-16T05:33:37.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:33:36 smithi157 bash[24585]: cluster 2024-09-16T05:33:35.462468+0000 mgr.a (mgr.14150) 93 : cluster [DBG] pgmap v47: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T05:33:37.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:33:36 smithi086 bash[24289]: cluster 2024-09-16T05:33:35.462468+0000 mgr.a (mgr.14150) 93 : cluster [DBG] pgmap v47: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T05:33:37.091 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:33:36 smithi047 bash[22744]: cluster 2024-09-16T05:33:35.462468+0000 mgr.a (mgr.14150) 93 : cluster [DBG] pgmap v47: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T05:33:38.055 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:33:37 smithi157 bash[24585]: audit 2024-09-16T05:33:36.702078+0000 mon.a (mon.0) 282 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:33:38.055 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:33:37 smithi157 bash[24585]: audit 2024-09-16T05:33:36.709172+0000 mon.a (mon.0) 283 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:33:38.055 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:33:37 smithi157 bash[24585]: audit 2024-09-16T05:33:36.716715+0000 mon.a (mon.0) 284 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:33:38.055 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:33:37 smithi157 bash[24585]: audit 2024-09-16T05:33:36.723944+0000 mon.a (mon.0) 285 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:33:38.055 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:33:37 smithi157 bash[24585]: audit 2024-09-16T05:33:36.813144+0000 mon.a (mon.0) 286 : audit [DBG] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T05:33:38.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:33:37 smithi086 bash[24289]: audit 2024-09-16T05:33:36.702078+0000 mon.a (mon.0) 282 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:33:38.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:33:37 smithi086 bash[24289]: audit 2024-09-16T05:33:36.709172+0000 mon.a (mon.0) 283 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:33:38.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:33:37 smithi086 bash[24289]: audit 2024-09-16T05:33:36.716715+0000 mon.a (mon.0) 284 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:33:38.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:33:37 smithi086 bash[24289]: audit 2024-09-16T05:33:36.723944+0000 mon.a (mon.0) 285 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:33:38.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:33:37 smithi086 bash[24289]: audit 2024-09-16T05:33:36.813144+0000 mon.a (mon.0) 286 : audit [DBG] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T05:33:38.071 INFO:journalctl@ceph.mgr.b.smithi086.stdout:Sep 16 05:33:37 smithi086 bash[24795]: debug 2024-09-16T05:33:37.716+0000 7f2b2b1c7640 1 -- 172.21.15.86:0/924991666 <== mon.2 v2:172.21.15.86:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55e2fa8b50e0 con 0x55e2fa8b7800 2024-09-16T05:33:38.071 INFO:journalctl@ceph.mgr.b.smithi086.stdout:Sep 16 05:33:37 smithi086 bash[24795]: debug 2024-09-16T05:33:37.832+0000 7f2b2da31040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-16T05:33:38.091 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:33:37 smithi047 bash[22744]: audit 2024-09-16T05:33:36.702078+0000 mon.a (mon.0) 282 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:33:38.091 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:33:37 smithi047 bash[22744]: audit 2024-09-16T05:33:36.709172+0000 mon.a (mon.0) 283 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:33:38.091 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:33:37 smithi047 bash[22744]: audit 2024-09-16T05:33:36.716715+0000 mon.a (mon.0) 284 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:33:38.091 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:33:37 smithi047 bash[22744]: audit 2024-09-16T05:33:36.723944+0000 mon.a (mon.0) 285 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:33:38.091 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:33:37 smithi047 bash[22744]: audit 2024-09-16T05:33:36.813144+0000 mon.a (mon.0) 286 : audit [DBG] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T05:33:39.026 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:33:38 smithi086 bash[24289]: cluster 2024-09-16T05:33:37.462857+0000 mgr.a (mgr.14150) 94 : cluster [DBG] pgmap v48: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T05:33:39.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:33:38 smithi157 bash[24585]: cluster 2024-09-16T05:33:37.462857+0000 mgr.a (mgr.14150) 94 : cluster [DBG] pgmap v48: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T05:33:39.091 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:33:38 smithi047 bash[22744]: cluster 2024-09-16T05:33:37.462857+0000 mgr.a (mgr.14150) 94 : cluster [DBG] pgmap v48: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T05:33:39.320 INFO:journalctl@ceph.mgr.b.smithi086.stdout:Sep 16 05:33:39 smithi086 bash[24795]: debug 2024-09-16T05:33:39.020+0000 7f2b2da31040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-16T05:33:39.320 INFO:journalctl@ceph.mgr.b.smithi086.stdout:Sep 16 05:33:39 smithi086 bash[24795]: debug 2024-09-16T05:33:39.084+0000 7f2b2da31040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-16T05:33:39.320 INFO:journalctl@ceph.mgr.b.smithi086.stdout:Sep 16 05:33:39 smithi086 bash[24795]: debug 2024-09-16T05:33:39.236+0000 7f2b2da31040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-16T05:33:40.212 INFO:journalctl@ceph.mgr.b.smithi086.stdout:Sep 16 05:33:39 smithi086 bash[24795]: debug 2024-09-16T05:33:39.884+0000 7f2b2da31040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-16T05:33:40.212 INFO:journalctl@ceph.mgr.b.smithi086.stdout:Sep 16 05:33:39 smithi086 bash[24795]: debug 2024-09-16T05:33:39.956+0000 7f2b2da31040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-16T05:33:40.212 INFO:journalctl@ceph.mgr.b.smithi086.stdout:Sep 16 05:33:40 smithi086 bash[24795]: debug 2024-09-16T05:33:40.024+0000 7f2b2da31040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-16T05:33:40.213 INFO:journalctl@ceph.mgr.b.smithi086.stdout:Sep 16 05:33:40 smithi086 bash[24795]: debug 2024-09-16T05:33:40.208+0000 7f2b2da31040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-16T05:33:40.570 INFO:journalctl@ceph.mgr.b.smithi086.stdout:Sep 16 05:33:40 smithi086 bash[24795]: debug 2024-09-16T05:33:40.284+0000 7f2b2da31040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-16T05:33:40.570 INFO:journalctl@ceph.mgr.b.smithi086.stdout:Sep 16 05:33:40 smithi086 bash[24795]: debug 2024-09-16T05:33:40.352+0000 7f2b2da31040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-16T05:33:40.866 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/a6097908-73ec-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T05:33:40.875 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:33:40 smithi086 bash[24289]: cluster 2024-09-16T05:33:39.463358+0000 mgr.a (mgr.14150) 95 : cluster [DBG] pgmap v49: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T05:33:40.875 INFO:journalctl@ceph.mgr.b.smithi086.stdout:Sep 16 05:33:40 smithi086 bash[24795]: debug 2024-09-16T05:33:40.607+0000 7f2b2da31040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-16T05:33:40.875 INFO:journalctl@ceph.mgr.b.smithi086.stdout:Sep 16 05:33:40 smithi086 bash[24795]: debug 2024-09-16T05:33:40.675+0000 7f2b2da31040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-16T05:33:41.055 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:33:40 smithi157 bash[24585]: cluster 2024-09-16T05:33:39.463358+0000 mgr.a (mgr.14150) 95 : cluster [DBG] pgmap v49: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T05:33:41.091 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:33:40 smithi047 bash[22744]: cluster 2024-09-16T05:33:39.463358+0000 mgr.a (mgr.14150) 95 : cluster [DBG] pgmap v49: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T05:33:41.203 INFO:journalctl@ceph.mgr.b.smithi086.stdout:Sep 16 05:33:40 smithi086 bash[24795]: debug 2024-09-16T05:33:40.871+0000 7f2b2da31040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-16T05:33:41.203 INFO:journalctl@ceph.mgr.b.smithi086.stdout:Sep 16 05:33:40 smithi086 bash[24795]: debug 2024-09-16T05:33:40.947+0000 7f2b2da31040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-16T05:33:41.541 INFO:journalctl@ceph.mgr.b.smithi086.stdout:Sep 16 05:33:41 smithi086 bash[24795]: debug 2024-09-16T05:33:41.195+0000 7f2b2da31040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-16T05:33:41.541 INFO:journalctl@ceph.mgr.b.smithi086.stdout:Sep 16 05:33:41 smithi086 bash[24795]: debug 2024-09-16T05:33:41.375+0000 7f2b2da31040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-16T05:33:41.797 INFO:journalctl@ceph.mgr.b.smithi086.stdout:Sep 16 05:33:41 smithi086 bash[24795]: debug 2024-09-16T05:33:41.535+0000 7f2b2da31040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-16T05:33:41.797 INFO:journalctl@ceph.mgr.b.smithi086.stdout:Sep 16 05:33:41 smithi086 bash[24795]: debug 2024-09-16T05:33:41.615+0000 7f2b2da31040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-16T05:33:42.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:33:42 smithi086 bash[24289]: audit 2024-09-16T05:33:41.009996+0000 mon.a (mon.0) 287 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:33:42.070 INFO:journalctl@ceph.mgr.b.smithi086.stdout:Sep 16 05:33:41 smithi086 bash[24795]: debug 2024-09-16T05:33:41.791+0000 7f2b2da31040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-16T05:33:42.160 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:33:42 smithi047 bash[22744]: audit 2024-09-16T05:33:41.009996+0000 mon.a (mon.0) 287 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:33:42.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:33:42 smithi157 bash[24585]: audit 2024-09-16T05:33:41.009996+0000 mon.a (mon.0) 287 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:33:42.922 INFO:journalctl@ceph.mgr.b.smithi086.stdout:Sep 16 05:33:42 smithi086 bash[24795]: debug 2024-09-16T05:33:42.619+0000 7f2b2da31040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-16T05:33:42.922 INFO:journalctl@ceph.mgr.b.smithi086.stdout:Sep 16 05:33:42 smithi086 bash[24795]: debug 2024-09-16T05:33:42.695+0000 7f2b2da31040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-16T05:33:43.320 INFO:journalctl@ceph.mgr.b.smithi086.stdout:Sep 16 05:33:42 smithi086 bash[24795]: debug 2024-09-16T05:33:42.915+0000 7f2b2da31040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-16T05:33:43.320 INFO:journalctl@ceph.mgr.b.smithi086.stdout:Sep 16 05:33:42 smithi086 bash[24795]: debug 2024-09-16T05:33:42.991+0000 7f2b2da31040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-16T05:33:43.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:33:43 smithi086 bash[24289]: cluster 2024-09-16T05:33:41.463795+0000 mgr.a (mgr.14150) 96 : cluster [DBG] pgmap v50: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T05:33:43.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:33:43 smithi086 bash[24289]: audit 2024-09-16T05:33:42.063234+0000 mon.a (mon.0) 288 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:33:43.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:33:43 smithi086 bash[24289]: audit 2024-09-16T05:33:42.068049+0000 mon.a (mon.0) 289 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:33:43.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:33:43 smithi086 bash[24289]: audit 2024-09-16T05:33:42.069263+0000 mon.a (mon.0) 290 : audit [DBG] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T05:33:43.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:33:43 smithi086 bash[24289]: audit 2024-09-16T05:33:42.070794+0000 mon.a (mon.0) 291 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T05:33:43.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:33:43 smithi086 bash[24289]: audit 2024-09-16T05:33:42.079530+0000 mon.a (mon.0) 292 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:33:43.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:33:43 smithi086 bash[24289]: cephadm 2024-09-16T05:33:42.167035+0000 mgr.a (mgr.14150) 97 : cephadm [INF] Reconfiguring mgr.a (unknown last config time)... 2024-09-16T05:33:43.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:33:43 smithi086 bash[24289]: audit 2024-09-16T05:33:42.167809+0000 mon.a (mon.0) 293 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.a", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-16T05:33:43.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:33:43 smithi086 bash[24289]: audit 2024-09-16T05:33:42.169885+0000 mon.a (mon.0) 294 : audit [DBG] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-16T05:33:43.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:33:43 smithi086 bash[24289]: audit 2024-09-16T05:33:42.171411+0000 mon.a (mon.0) 295 : audit [DBG] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T05:33:43.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:33:43 smithi086 bash[24289]: cephadm 2024-09-16T05:33:42.173136+0000 mgr.a (mgr.14150) 98 : cephadm [INF] Reconfiguring daemon mgr.a on smithi047 2024-09-16T05:33:43.341 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:33:43 smithi047 bash[22744]: cluster 2024-09-16T05:33:41.463795+0000 mgr.a (mgr.14150) 96 : cluster [DBG] pgmap v50: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T05:33:43.341 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:33:43 smithi047 bash[22744]: audit 2024-09-16T05:33:42.063234+0000 mon.a (mon.0) 288 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:33:43.341 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:33:43 smithi047 bash[22744]: audit 2024-09-16T05:33:42.068049+0000 mon.a (mon.0) 289 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:33:43.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:33:43 smithi047 bash[22744]: audit 2024-09-16T05:33:42.069263+0000 mon.a (mon.0) 290 : audit [DBG] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T05:33:43.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:33:43 smithi047 bash[22744]: audit 2024-09-16T05:33:42.070794+0000 mon.a (mon.0) 291 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T05:33:43.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:33:43 smithi047 bash[22744]: audit 2024-09-16T05:33:42.079530+0000 mon.a (mon.0) 292 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:33:43.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:33:43 smithi047 bash[22744]: cephadm 2024-09-16T05:33:42.167035+0000 mgr.a (mgr.14150) 97 : cephadm [INF] Reconfiguring mgr.a (unknown last config time)... 2024-09-16T05:33:43.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:33:43 smithi047 bash[22744]: audit 2024-09-16T05:33:42.167809+0000 mon.a (mon.0) 293 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.a", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-16T05:33:43.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:33:43 smithi047 bash[22744]: audit 2024-09-16T05:33:42.169885+0000 mon.a (mon.0) 294 : audit [DBG] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-16T05:33:43.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:33:43 smithi047 bash[22744]: audit 2024-09-16T05:33:42.171411+0000 mon.a (mon.0) 295 : audit [DBG] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T05:33:43.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:33:43 smithi047 bash[22744]: cephadm 2024-09-16T05:33:42.173136+0000 mgr.a (mgr.14150) 98 : cephadm [INF] Reconfiguring daemon mgr.a on smithi047 2024-09-16T05:33:43.555 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:33:43 smithi157 bash[24585]: cluster 2024-09-16T05:33:41.463795+0000 mgr.a (mgr.14150) 96 : cluster [DBG] pgmap v50: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T05:33:43.555 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:33:43 smithi157 bash[24585]: audit 2024-09-16T05:33:42.063234+0000 mon.a (mon.0) 288 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:33:43.555 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:33:43 smithi157 bash[24585]: audit 2024-09-16T05:33:42.068049+0000 mon.a (mon.0) 289 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:33:43.555 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:33:43 smithi157 bash[24585]: audit 2024-09-16T05:33:42.069263+0000 mon.a (mon.0) 290 : audit [DBG] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T05:33:43.555 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:33:43 smithi157 bash[24585]: audit 2024-09-16T05:33:42.070794+0000 mon.a (mon.0) 291 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T05:33:43.555 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:33:43 smithi157 bash[24585]: audit 2024-09-16T05:33:42.079530+0000 mon.a (mon.0) 292 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:33:43.555 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:33:43 smithi157 bash[24585]: cephadm 2024-09-16T05:33:42.167035+0000 mgr.a (mgr.14150) 97 : cephadm [INF] Reconfiguring mgr.a (unknown last config time)... 2024-09-16T05:33:43.555 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:33:43 smithi157 bash[24585]: audit 2024-09-16T05:33:42.167809+0000 mon.a (mon.0) 293 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.a", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-16T05:33:43.555 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:33:43 smithi157 bash[24585]: audit 2024-09-16T05:33:42.169885+0000 mon.a (mon.0) 294 : audit [DBG] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-16T05:33:43.555 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:33:43 smithi157 bash[24585]: audit 2024-09-16T05:33:42.171411+0000 mon.a (mon.0) 295 : audit [DBG] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T05:33:43.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:33:43 smithi157 bash[24585]: cephadm 2024-09-16T05:33:42.173136+0000 mgr.a (mgr.14150) 98 : cephadm [INF] Reconfiguring daemon mgr.a on smithi047 2024-09-16T05:33:43.820 INFO:journalctl@ceph.mgr.b.smithi086.stdout:Sep 16 05:33:43 smithi086 bash[24795]: debug 2024-09-16T05:33:43.379+0000 7f2b2da31040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-16T05:33:43.820 INFO:journalctl@ceph.mgr.b.smithi086.stdout:Sep 16 05:33:43 smithi086 bash[24795]: debug 2024-09-16T05:33:43.455+0000 7f2b2da31040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-16T05:33:44.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:33:44 smithi086 bash[24289]: audit 2024-09-16T05:33:43.482321+0000 mon.b (mon.2) 3 : audit [DBG] from='mgr.? 172.21.15.86:0/3277947629' entity='mgr.b' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/b/crt"}]: dispatch 2024-09-16T05:33:44.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:33:44 smithi086 bash[24289]: cluster 2024-09-16T05:33:43.482877+0000 mon.a (mon.0) 296 : cluster [DBG] Standby manager daemon b started 2024-09-16T05:33:44.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:33:44 smithi086 bash[24289]: audit 2024-09-16T05:33:43.483059+0000 mon.b (mon.2) 4 : audit [DBG] from='mgr.? 172.21.15.86:0/3277947629' entity='mgr.b' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-16T05:33:44.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:33:44 smithi086 bash[24289]: audit 2024-09-16T05:33:43.484124+0000 mon.b (mon.2) 5 : audit [DBG] from='mgr.? 172.21.15.86:0/3277947629' entity='mgr.b' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/b/key"}]: dispatch 2024-09-16T05:33:44.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:33:44 smithi086 bash[24289]: audit 2024-09-16T05:33:43.484608+0000 mon.b (mon.2) 6 : audit [DBG] from='mgr.? 172.21.15.86:0/3277947629' entity='mgr.b' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-16T05:33:44.341 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:33:44 smithi047 bash[22744]: audit 2024-09-16T05:33:43.482321+0000 mon.b (mon.2) 3 : audit [DBG] from='mgr.? 172.21.15.86:0/3277947629' entity='mgr.b' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/b/crt"}]: dispatch 2024-09-16T05:33:44.341 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:33:44 smithi047 bash[22744]: cluster 2024-09-16T05:33:43.482877+0000 mon.a (mon.0) 296 : cluster [DBG] Standby manager daemon b started 2024-09-16T05:33:44.341 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:33:44 smithi047 bash[22744]: audit 2024-09-16T05:33:43.483059+0000 mon.b (mon.2) 4 : audit [DBG] from='mgr.? 172.21.15.86:0/3277947629' entity='mgr.b' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-16T05:33:44.341 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:33:44 smithi047 bash[22744]: audit 2024-09-16T05:33:43.484124+0000 mon.b (mon.2) 5 : audit [DBG] from='mgr.? 172.21.15.86:0/3277947629' entity='mgr.b' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/b/key"}]: dispatch 2024-09-16T05:33:44.341 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:33:44 smithi047 bash[22744]: audit 2024-09-16T05:33:43.484608+0000 mon.b (mon.2) 6 : audit [DBG] from='mgr.? 172.21.15.86:0/3277947629' entity='mgr.b' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-16T05:33:44.555 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:33:44 smithi157 bash[24585]: audit 2024-09-16T05:33:43.482321+0000 mon.b (mon.2) 3 : audit [DBG] from='mgr.? 172.21.15.86:0/3277947629' entity='mgr.b' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/b/crt"}]: dispatch 2024-09-16T05:33:44.555 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:33:44 smithi157 bash[24585]: cluster 2024-09-16T05:33:43.482877+0000 mon.a (mon.0) 296 : cluster [DBG] Standby manager daemon b started 2024-09-16T05:33:44.555 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:33:44 smithi157 bash[24585]: audit 2024-09-16T05:33:43.483059+0000 mon.b (mon.2) 4 : audit [DBG] from='mgr.? 172.21.15.86:0/3277947629' entity='mgr.b' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-16T05:33:44.555 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:33:44 smithi157 bash[24585]: audit 2024-09-16T05:33:43.484124+0000 mon.b (mon.2) 5 : audit [DBG] from='mgr.? 172.21.15.86:0/3277947629' entity='mgr.b' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/b/key"}]: dispatch 2024-09-16T05:33:44.555 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:33:44 smithi157 bash[24585]: audit 2024-09-16T05:33:43.484608+0000 mon.b (mon.2) 6 : audit [DBG] from='mgr.? 172.21.15.86:0/3277947629' entity='mgr.b' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-16T05:33:44.805 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-16T05:33:44.858 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a6097908-73ec-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi047:vg_nvme/lv_4 2024-09-16T05:33:45.341 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:33:45 smithi047 bash[22744]: cluster 2024-09-16T05:33:43.464219+0000 mgr.a (mgr.14150) 99 : cluster [DBG] pgmap v51: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T05:33:45.341 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:33:45 smithi047 bash[22744]: cluster 2024-09-16T05:33:44.083305+0000 mon.a (mon.0) 297 : cluster [DBG] mgrmap e14: a(active, since 114s), standbys: b 2024-09-16T05:33:45.341 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:33:45 smithi047 bash[22744]: audit 2024-09-16T05:33:44.083585+0000 mon.a (mon.0) 298 : audit [DBG] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "mgr metadata", "who": "b", "id": "b"}]: dispatch 2024-09-16T05:33:45.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:33:45 smithi157 bash[24585]: cluster 2024-09-16T05:33:43.464219+0000 mgr.a (mgr.14150) 99 : cluster [DBG] pgmap v51: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T05:33:45.555 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:33:45 smithi157 bash[24585]: cluster 2024-09-16T05:33:44.083305+0000 mon.a (mon.0) 297 : cluster [DBG] mgrmap e14: a(active, since 114s), standbys: b 2024-09-16T05:33:45.555 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:33:45 smithi157 bash[24585]: audit 2024-09-16T05:33:44.083585+0000 mon.a (mon.0) 298 : audit [DBG] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "mgr metadata", "who": "b", "id": "b"}]: dispatch 2024-09-16T05:33:45.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:33:45 smithi086 bash[24289]: cluster 2024-09-16T05:33:43.464219+0000 mgr.a (mgr.14150) 99 : cluster [DBG] pgmap v51: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T05:33:45.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:33:45 smithi086 bash[24289]: cluster 2024-09-16T05:33:44.083305+0000 mon.a (mon.0) 297 : cluster [DBG] mgrmap e14: a(active, since 114s), standbys: b 2024-09-16T05:33:45.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:33:45 smithi086 bash[24289]: audit 2024-09-16T05:33:44.083585+0000 mon.a (mon.0) 298 : audit [DBG] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "mgr metadata", "who": "b", "id": "b"}]: dispatch 2024-09-16T05:33:47.341 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:33:47 smithi047 bash[22744]: cluster 2024-09-16T05:33:45.464615+0000 mgr.a (mgr.14150) 100 : cluster [DBG] pgmap v52: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T05:33:47.341 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:33:47 smithi047 bash[22744]: audit 2024-09-16T05:33:46.679705+0000 mon.a (mon.0) 299 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:33:47.341 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:33:47 smithi047 bash[22744]: audit 2024-09-16T05:33:46.687164+0000 mon.a (mon.0) 300 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:33:47.341 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:33:47 smithi047 bash[22744]: audit 2024-09-16T05:33:46.689984+0000 mon.a (mon.0) 301 : audit [DBG] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T05:33:47.555 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:33:47 smithi157 bash[24585]: cluster 2024-09-16T05:33:45.464615+0000 mgr.a (mgr.14150) 100 : cluster [DBG] pgmap v52: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T05:33:47.555 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:33:47 smithi157 bash[24585]: audit 2024-09-16T05:33:46.679705+0000 mon.a (mon.0) 299 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:33:47.555 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:33:47 smithi157 bash[24585]: audit 2024-09-16T05:33:46.687164+0000 mon.a (mon.0) 300 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:33:47.555 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:33:47 smithi157 bash[24585]: audit 2024-09-16T05:33:46.689984+0000 mon.a (mon.0) 301 : audit [DBG] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T05:33:47.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:33:47 smithi086 bash[24289]: cluster 2024-09-16T05:33:45.464615+0000 mgr.a (mgr.14150) 100 : cluster [DBG] pgmap v52: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T05:33:47.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:33:47 smithi086 bash[24289]: audit 2024-09-16T05:33:46.679705+0000 mon.a (mon.0) 299 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:33:47.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:33:47 smithi086 bash[24289]: audit 2024-09-16T05:33:46.687164+0000 mon.a (mon.0) 300 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:33:47.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:33:47 smithi086 bash[24289]: audit 2024-09-16T05:33:46.689984+0000 mon.a (mon.0) 301 : audit [DBG] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T05:33:48.341 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:33:48 smithi047 bash[22744]: audit 2024-09-16T05:33:47.406654+0000 mon.a (mon.0) 302 : audit [DBG] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T05:33:48.341 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:33:48 smithi047 bash[22744]: audit 2024-09-16T05:33:47.408356+0000 mon.a (mon.0) 303 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T05:33:48.341 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:33:48 smithi047 bash[22744]: audit 2024-09-16T05:33:47.417750+0000 mon.a (mon.0) 304 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:33:48.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:33:48 smithi157 bash[24585]: audit 2024-09-16T05:33:47.406654+0000 mon.a (mon.0) 302 : audit [DBG] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T05:33:48.555 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:33:48 smithi157 bash[24585]: audit 2024-09-16T05:33:47.408356+0000 mon.a (mon.0) 303 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T05:33:48.555 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:33:48 smithi157 bash[24585]: audit 2024-09-16T05:33:47.417750+0000 mon.a (mon.0) 304 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:33:48.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:33:48 smithi086 bash[24289]: audit 2024-09-16T05:33:47.406654+0000 mon.a (mon.0) 302 : audit [DBG] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T05:33:48.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:33:48 smithi086 bash[24289]: audit 2024-09-16T05:33:47.408356+0000 mon.a (mon.0) 303 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T05:33:48.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:33:48 smithi086 bash[24289]: audit 2024-09-16T05:33:47.417750+0000 mon.a (mon.0) 304 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:33:49.341 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:33:49 smithi047 bash[22744]: cluster 2024-09-16T05:33:47.465008+0000 mgr.a (mgr.14150) 101 : cluster [DBG] pgmap v53: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T05:33:49.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:33:49 smithi157 bash[24585]: cluster 2024-09-16T05:33:47.465008+0000 mgr.a (mgr.14150) 101 : cluster [DBG] pgmap v53: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T05:33:49.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:33:49 smithi086 bash[24289]: cluster 2024-09-16T05:33:47.465008+0000 mgr.a (mgr.14150) 101 : cluster [DBG] pgmap v53: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T05:33:49.584 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/a6097908-73ec-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T05:33:51.341 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:33:51 smithi047 bash[22744]: cluster 2024-09-16T05:33:49.465448+0000 mgr.a (mgr.14150) 102 : cluster [DBG] pgmap v54: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T05:33:51.341 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:33:51 smithi047 bash[22744]: audit 2024-09-16T05:33:50.907639+0000 mon.a (mon.0) 305 : audit [DBG] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-16T05:33:51.341 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:33:51 smithi047 bash[22744]: audit 2024-09-16T05:33:50.911497+0000 mon.a (mon.0) 306 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-16T05:33:51.341 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:33:51 smithi047 bash[22744]: audit 2024-09-16T05:33:50.912653+0000 mon.a (mon.0) 307 : audit [DBG] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T05:33:51.555 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:33:51 smithi157 bash[24585]: cluster 2024-09-16T05:33:49.465448+0000 mgr.a (mgr.14150) 102 : cluster [DBG] pgmap v54: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T05:33:51.555 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:33:51 smithi157 bash[24585]: audit 2024-09-16T05:33:50.907639+0000 mon.a (mon.0) 305 : audit [DBG] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-16T05:33:51.555 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:33:51 smithi157 bash[24585]: audit 2024-09-16T05:33:50.911497+0000 mon.a (mon.0) 306 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-16T05:33:51.555 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:33:51 smithi157 bash[24585]: audit 2024-09-16T05:33:50.912653+0000 mon.a (mon.0) 307 : audit [DBG] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T05:33:51.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:33:51 smithi086 bash[24289]: cluster 2024-09-16T05:33:49.465448+0000 mgr.a (mgr.14150) 102 : cluster [DBG] pgmap v54: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T05:33:51.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:33:51 smithi086 bash[24289]: audit 2024-09-16T05:33:50.907639+0000 mon.a (mon.0) 305 : audit [DBG] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-16T05:33:51.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:33:51 smithi086 bash[24289]: audit 2024-09-16T05:33:50.911497+0000 mon.a (mon.0) 306 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-16T05:33:51.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:33:51 smithi086 bash[24289]: audit 2024-09-16T05:33:50.912653+0000 mon.a (mon.0) 307 : audit [DBG] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T05:33:52.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:33:52 smithi157 bash[24585]: audit 2024-09-16T05:33:50.904808+0000 mgr.a (mgr.14150) 103 : audit [DBG] from='client.14208 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi047:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:33:52.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:33:52 smithi086 bash[24289]: audit 2024-09-16T05:33:50.904808+0000 mgr.a (mgr.14150) 103 : audit [DBG] from='client.14208 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi047:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:33:52.591 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:33:52 smithi047 bash[22744]: audit 2024-09-16T05:33:50.904808+0000 mgr.a (mgr.14150) 103 : audit [DBG] from='client.14208 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi047:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:33:53.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:33:53 smithi157 bash[24585]: cluster 2024-09-16T05:33:51.465872+0000 mgr.a (mgr.14150) 104 : cluster [DBG] pgmap v55: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T05:33:53.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:33:53 smithi086 bash[24289]: cluster 2024-09-16T05:33:51.465872+0000 mgr.a (mgr.14150) 104 : cluster [DBG] pgmap v55: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T05:33:53.591 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:33:53 smithi047 bash[22744]: cluster 2024-09-16T05:33:51.465872+0000 mgr.a (mgr.14150) 104 : cluster [DBG] pgmap v55: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T05:33:55.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:33:55 smithi157 bash[24585]: cluster 2024-09-16T05:33:53.466290+0000 mgr.a (mgr.14150) 105 : cluster [DBG] pgmap v56: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T05:33:55.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:33:55 smithi086 bash[24289]: cluster 2024-09-16T05:33:53.466290+0000 mgr.a (mgr.14150) 105 : cluster [DBG] pgmap v56: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T05:33:55.591 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:33:55 smithi047 bash[22744]: cluster 2024-09-16T05:33:53.466290+0000 mgr.a (mgr.14150) 105 : cluster [DBG] pgmap v56: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T05:33:57.184 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:33:57 smithi047 bash[22744]: cluster 2024-09-16T05:33:55.466712+0000 mgr.a (mgr.14150) 106 : cluster [DBG] pgmap v57: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T05:33:57.555 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:33:57 smithi157 bash[24585]: cluster 2024-09-16T05:33:55.466712+0000 mgr.a (mgr.14150) 106 : cluster [DBG] pgmap v57: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T05:33:57.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:33:57 smithi086 bash[24289]: cluster 2024-09-16T05:33:55.466712+0000 mgr.a (mgr.14150) 106 : cluster [DBG] pgmap v57: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T05:33:59.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:33:59 smithi157 bash[24585]: cluster 2024-09-16T05:33:57.467048+0000 mgr.a (mgr.14150) 107 : cluster [DBG] pgmap v58: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T05:33:59.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:33:59 smithi086 bash[24289]: cluster 2024-09-16T05:33:57.467048+0000 mgr.a (mgr.14150) 107 : cluster [DBG] pgmap v58: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T05:33:59.591 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:33:59 smithi047 bash[22744]: cluster 2024-09-16T05:33:57.467048+0000 mgr.a (mgr.14150) 107 : cluster [DBG] pgmap v58: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T05:34:00.555 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:34:00 smithi157 bash[24585]: audit 2024-09-16T05:33:59.224057+0000 mon.a (mon.0) 308 : audit [INF] from='client.? 172.21.15.47:0/2505476949' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4c5a9762-a13b-44ef-aec2-96695c85a9dc"}]: dispatch 2024-09-16T05:34:00.555 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:34:00 smithi157 bash[24585]: audit 2024-09-16T05:33:59.226951+0000 mon.a (mon.0) 309 : audit [INF] from='client.? 172.21.15.47:0/2505476949' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4c5a9762-a13b-44ef-aec2-96695c85a9dc"}]': finished 2024-09-16T05:34:00.555 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:34:00 smithi157 bash[24585]: cluster 2024-09-16T05:33:59.231662+0000 mon.a (mon.0) 310 : cluster [DBG] osdmap e5: 1 total, 0 up, 1 in 2024-09-16T05:34:00.555 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:34:00 smithi157 bash[24585]: audit 2024-09-16T05:33:59.232370+0000 mon.a (mon.0) 311 : audit [DBG] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-16T05:34:00.555 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:34:00 smithi157 bash[24585]: audit 2024-09-16T05:33:59.859706+0000 mon.a (mon.0) 312 : audit [DBG] from='client.? 172.21.15.47:0/1725940459' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-16T05:34:00.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:34:00 smithi086 bash[24289]: audit 2024-09-16T05:33:59.224057+0000 mon.a (mon.0) 308 : audit [INF] from='client.? 172.21.15.47:0/2505476949' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4c5a9762-a13b-44ef-aec2-96695c85a9dc"}]: dispatch 2024-09-16T05:34:00.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:34:00 smithi086 bash[24289]: audit 2024-09-16T05:33:59.226951+0000 mon.a (mon.0) 309 : audit [INF] from='client.? 172.21.15.47:0/2505476949' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4c5a9762-a13b-44ef-aec2-96695c85a9dc"}]': finished 2024-09-16T05:34:00.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:34:00 smithi086 bash[24289]: cluster 2024-09-16T05:33:59.231662+0000 mon.a (mon.0) 310 : cluster [DBG] osdmap e5: 1 total, 0 up, 1 in 2024-09-16T05:34:00.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:34:00 smithi086 bash[24289]: audit 2024-09-16T05:33:59.232370+0000 mon.a (mon.0) 311 : audit [DBG] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-16T05:34:00.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:34:00 smithi086 bash[24289]: audit 2024-09-16T05:33:59.859706+0000 mon.a (mon.0) 312 : audit [DBG] from='client.? 172.21.15.47:0/1725940459' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-16T05:34:00.591 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:34:00 smithi047 bash[22744]: audit 2024-09-16T05:33:59.224057+0000 mon.a (mon.0) 308 : audit [INF] from='client.? 172.21.15.47:0/2505476949' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4c5a9762-a13b-44ef-aec2-96695c85a9dc"}]: dispatch 2024-09-16T05:34:00.591 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:34:00 smithi047 bash[22744]: audit 2024-09-16T05:33:59.226951+0000 mon.a (mon.0) 309 : audit [INF] from='client.? 172.21.15.47:0/2505476949' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4c5a9762-a13b-44ef-aec2-96695c85a9dc"}]': finished 2024-09-16T05:34:00.591 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:34:00 smithi047 bash[22744]: cluster 2024-09-16T05:33:59.231662+0000 mon.a (mon.0) 310 : cluster [DBG] osdmap e5: 1 total, 0 up, 1 in 2024-09-16T05:34:00.591 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:34:00 smithi047 bash[22744]: audit 2024-09-16T05:33:59.232370+0000 mon.a (mon.0) 311 : audit [DBG] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-16T05:34:00.591 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:34:00 smithi047 bash[22744]: audit 2024-09-16T05:33:59.859706+0000 mon.a (mon.0) 312 : audit [DBG] from='client.? 172.21.15.47:0/1725940459' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-16T05:34:01.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:34:01 smithi157 bash[24585]: cluster 2024-09-16T05:33:59.467483+0000 mgr.a (mgr.14150) 108 : cluster [DBG] pgmap v60: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T05:34:01.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:34:01 smithi086 bash[24289]: cluster 2024-09-16T05:33:59.467483+0000 mgr.a (mgr.14150) 108 : cluster [DBG] pgmap v60: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T05:34:01.590 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:34:01 smithi047 bash[22744]: cluster 2024-09-16T05:33:59.467483+0000 mgr.a (mgr.14150) 108 : cluster [DBG] pgmap v60: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T05:34:03.488 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:34:03 smithi047 bash[22744]: cluster 2024-09-16T05:34:01.467915+0000 mgr.a (mgr.14150) 109 : cluster [DBG] pgmap v61: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T05:34:03.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:34:03 smithi157 bash[24585]: cluster 2024-09-16T05:34:01.467915+0000 mgr.a (mgr.14150) 109 : cluster [DBG] pgmap v61: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T05:34:03.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:34:03 smithi086 bash[24289]: cluster 2024-09-16T05:34:01.467915+0000 mgr.a (mgr.14150) 109 : cluster [DBG] pgmap v61: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T05:34:05.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:34:05 smithi157 bash[24585]: cluster 2024-09-16T05:34:03.468268+0000 mgr.a (mgr.14150) 110 : cluster [DBG] pgmap v62: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T05:34:05.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:34:05 smithi086 bash[24289]: cluster 2024-09-16T05:34:03.468268+0000 mgr.a (mgr.14150) 110 : cluster [DBG] pgmap v62: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T05:34:05.590 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:34:05 smithi047 bash[22744]: cluster 2024-09-16T05:34:03.468268+0000 mgr.a (mgr.14150) 110 : cluster [DBG] pgmap v62: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T05:34:07.555 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:34:07 smithi157 bash[24585]: cluster 2024-09-16T05:34:05.468661+0000 mgr.a (mgr.14150) 111 : cluster [DBG] pgmap v63: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T05:34:07.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:34:07 smithi086 bash[24289]: cluster 2024-09-16T05:34:05.468661+0000 mgr.a (mgr.14150) 111 : cluster [DBG] pgmap v63: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T05:34:07.591 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:34:07 smithi047 bash[22744]: cluster 2024-09-16T05:34:05.468661+0000 mgr.a (mgr.14150) 111 : cluster [DBG] pgmap v63: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T05:34:09.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:34:09 smithi157 bash[24585]: cluster 2024-09-16T05:34:07.469081+0000 mgr.a (mgr.14150) 112 : cluster [DBG] pgmap v64: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T05:34:09.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:34:09 smithi086 bash[24289]: cluster 2024-09-16T05:34:07.469081+0000 mgr.a (mgr.14150) 112 : cluster [DBG] pgmap v64: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T05:34:09.590 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:34:09 smithi047 bash[22744]: cluster 2024-09-16T05:34:07.469081+0000 mgr.a (mgr.14150) 112 : cluster [DBG] pgmap v64: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T05:34:11.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:34:11 smithi157 bash[24585]: cluster 2024-09-16T05:34:09.469524+0000 mgr.a (mgr.14150) 113 : cluster [DBG] pgmap v65: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T05:34:11.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:34:11 smithi086 bash[24289]: cluster 2024-09-16T05:34:09.469524+0000 mgr.a (mgr.14150) 113 : cluster [DBG] pgmap v65: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T05:34:11.590 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:34:11 smithi047 bash[22744]: cluster 2024-09-16T05:34:09.469524+0000 mgr.a (mgr.14150) 113 : cluster [DBG] pgmap v65: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T05:34:13.528 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:34:13 smithi047 bash[22744]: cluster 2024-09-16T05:34:11.469995+0000 mgr.a (mgr.14150) 114 : cluster [DBG] pgmap v66: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T05:34:13.528 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:34:13 smithi047 bash[22744]: audit 2024-09-16T05:34:12.899352+0000 mon.a (mon.0) 313 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-16T05:34:13.528 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:34:13 smithi047 bash[22744]: audit 2024-09-16T05:34:12.900913+0000 mon.a (mon.0) 314 : audit [DBG] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T05:34:13.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:34:13 smithi157 bash[24585]: cluster 2024-09-16T05:34:11.469995+0000 mgr.a (mgr.14150) 114 : cluster [DBG] pgmap v66: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T05:34:13.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:34:13 smithi157 bash[24585]: audit 2024-09-16T05:34:12.899352+0000 mon.a (mon.0) 313 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-16T05:34:13.555 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:34:13 smithi157 bash[24585]: audit 2024-09-16T05:34:12.900913+0000 mon.a (mon.0) 314 : audit [DBG] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T05:34:13.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:34:13 smithi086 bash[24289]: cluster 2024-09-16T05:34:11.469995+0000 mgr.a (mgr.14150) 114 : cluster [DBG] pgmap v66: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T05:34:13.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:34:13 smithi086 bash[24289]: audit 2024-09-16T05:34:12.899352+0000 mon.a (mon.0) 313 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-16T05:34:13.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:34:13 smithi086 bash[24289]: audit 2024-09-16T05:34:12.900913+0000 mon.a (mon.0) 314 : audit [DBG] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T05:34:14.530 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:34:14 smithi047 bash[22744]: cephadm 2024-09-16T05:34:12.902277+0000 mgr.a (mgr.14150) 115 : cephadm [INF] Deploying daemon osd.0 on smithi047 2024-09-16T05:34:14.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:34:14 smithi157 bash[24585]: cephadm 2024-09-16T05:34:12.902277+0000 mgr.a (mgr.14150) 115 : cephadm [INF] Deploying daemon osd.0 on smithi047 2024-09-16T05:34:14.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:34:14 smithi086 bash[24289]: cephadm 2024-09-16T05:34:12.902277+0000 mgr.a (mgr.14150) 115 : cephadm [INF] Deploying daemon osd.0 on smithi047 2024-09-16T05:34:15.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:34:15 smithi157 bash[24585]: cluster 2024-09-16T05:34:13.470396+0000 mgr.a (mgr.14150) 116 : cluster [DBG] pgmap v67: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T05:34:15.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:34:15 smithi086 bash[24289]: cluster 2024-09-16T05:34:13.470396+0000 mgr.a (mgr.14150) 116 : cluster [DBG] pgmap v67: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T05:34:15.590 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:34:15 smithi047 bash[22744]: cluster 2024-09-16T05:34:13.470396+0000 mgr.a (mgr.14150) 116 : cluster [DBG] pgmap v67: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T05:34:17.475 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 05:34:17 smithi047 systemd[1]: /etc/systemd/system/ceph-a6097908-73ec-11ef-bceb-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-16T05:34:17.475 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:34:17 smithi047 systemd[1]: /etc/systemd/system/ceph-a6097908-73ec-11ef-bceb-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-16T05:34:17.475 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:34:17 smithi047 bash[22744]: cluster 2024-09-16T05:34:15.470734+0000 mgr.a (mgr.14150) 117 : cluster [DBG] pgmap v68: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T05:34:17.555 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:34:17 smithi157 bash[24585]: cluster 2024-09-16T05:34:15.470734+0000 mgr.a (mgr.14150) 117 : cluster [DBG] pgmap v68: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T05:34:17.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:34:17 smithi086 bash[24289]: cluster 2024-09-16T05:34:15.470734+0000 mgr.a (mgr.14150) 117 : cluster [DBG] pgmap v68: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T05:34:17.840 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:34:17 smithi047 systemd[1]: /etc/systemd/system/ceph-a6097908-73ec-11ef-bceb-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-16T05:34:17.841 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 05:34:17 smithi047 systemd[1]: /etc/systemd/system/ceph-a6097908-73ec-11ef-bceb-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-16T05:34:18.537 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:34:18 smithi047 bash[22744]: audit 2024-09-16T05:34:17.613581+0000 mon.a (mon.0) 315 : audit [DBG] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T05:34:18.538 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:34:18 smithi047 bash[22744]: audit 2024-09-16T05:34:17.617218+0000 mon.a (mon.0) 316 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:34:18.538 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:34:18 smithi047 bash[22744]: audit 2024-09-16T05:34:17.621351+0000 mon.a (mon.0) 317 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:34:18.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:34:18 smithi157 bash[24585]: audit 2024-09-16T05:34:17.613581+0000 mon.a (mon.0) 315 : audit [DBG] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T05:34:18.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:34:18 smithi157 bash[24585]: audit 2024-09-16T05:34:17.617218+0000 mon.a (mon.0) 316 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:34:18.555 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:34:18 smithi157 bash[24585]: audit 2024-09-16T05:34:17.621351+0000 mon.a (mon.0) 317 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:34:18.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:34:18 smithi086 bash[24289]: audit 2024-09-16T05:34:17.613581+0000 mon.a (mon.0) 315 : audit [DBG] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T05:34:18.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:34:18 smithi086 bash[24289]: audit 2024-09-16T05:34:17.617218+0000 mon.a (mon.0) 316 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:34:18.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:34:18 smithi086 bash[24289]: audit 2024-09-16T05:34:17.621351+0000 mon.a (mon.0) 317 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:34:19.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:34:19 smithi157 bash[24585]: cluster 2024-09-16T05:34:17.471043+0000 mgr.a (mgr.14150) 118 : cluster [DBG] pgmap v69: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T05:34:19.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:34:19 smithi086 bash[24289]: cluster 2024-09-16T05:34:17.471043+0000 mgr.a (mgr.14150) 118 : cluster [DBG] pgmap v69: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T05:34:19.590 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:34:19 smithi047 bash[22744]: cluster 2024-09-16T05:34:17.471043+0000 mgr.a (mgr.14150) 118 : cluster [DBG] pgmap v69: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T05:34:21.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:34:21 smithi157 bash[24585]: cluster 2024-09-16T05:34:19.471442+0000 mgr.a (mgr.14150) 119 : cluster [DBG] pgmap v70: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T05:34:21.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:34:21 smithi086 bash[24289]: cluster 2024-09-16T05:34:19.471442+0000 mgr.a (mgr.14150) 119 : cluster [DBG] pgmap v70: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T05:34:21.590 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:34:21 smithi047 bash[22744]: cluster 2024-09-16T05:34:19.471442+0000 mgr.a (mgr.14150) 119 : cluster [DBG] pgmap v70: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T05:34:23.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:34:23 smithi157 bash[24585]: cluster 2024-09-16T05:34:21.471855+0000 mgr.a (mgr.14150) 120 : cluster [DBG] pgmap v71: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T05:34:23.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:34:23 smithi157 bash[24585]: audit 2024-09-16T05:34:22.892118+0000 mon.a (mon.0) 318 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:34:23.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:34:23 smithi157 bash[24585]: audit 2024-09-16T05:34:22.896131+0000 mon.a (mon.0) 319 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:34:23.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:34:23 smithi086 bash[24289]: cluster 2024-09-16T05:34:21.471855+0000 mgr.a (mgr.14150) 120 : cluster [DBG] pgmap v71: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T05:34:23.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:34:23 smithi086 bash[24289]: audit 2024-09-16T05:34:22.892118+0000 mon.a (mon.0) 318 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:34:23.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:34:23 smithi086 bash[24289]: audit 2024-09-16T05:34:22.896131+0000 mon.a (mon.0) 319 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:34:23.590 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:34:23 smithi047 bash[22744]: cluster 2024-09-16T05:34:21.471855+0000 mgr.a (mgr.14150) 120 : cluster [DBG] pgmap v71: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T05:34:23.590 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:34:23 smithi047 bash[22744]: audit 2024-09-16T05:34:22.892118+0000 mon.a (mon.0) 318 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:34:23.590 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:34:23 smithi047 bash[22744]: audit 2024-09-16T05:34:22.896131+0000 mon.a (mon.0) 319 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:34:24.555 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:34:24 smithi157 bash[24585]: audit 2024-09-16T05:34:23.551282+0000 mon.a (mon.0) 320 : audit [DBG] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T05:34:24.555 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:34:24 smithi157 bash[24585]: audit 2024-09-16T05:34:23.552089+0000 mon.a (mon.0) 321 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T05:34:24.555 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:34:24 smithi157 bash[24585]: audit 2024-09-16T05:34:23.557333+0000 mon.a (mon.0) 322 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:34:24.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:34:24 smithi086 bash[24289]: audit 2024-09-16T05:34:23.551282+0000 mon.a (mon.0) 320 : audit [DBG] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T05:34:24.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:34:24 smithi086 bash[24289]: audit 2024-09-16T05:34:23.552089+0000 mon.a (mon.0) 321 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T05:34:24.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:34:24 smithi086 bash[24289]: audit 2024-09-16T05:34:23.557333+0000 mon.a (mon.0) 322 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:34:24.590 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:34:24 smithi047 bash[22744]: audit 2024-09-16T05:34:23.551282+0000 mon.a (mon.0) 320 : audit [DBG] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T05:34:24.590 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:34:24 smithi047 bash[22744]: audit 2024-09-16T05:34:23.552089+0000 mon.a (mon.0) 321 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T05:34:24.591 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:34:24 smithi047 bash[22744]: audit 2024-09-16T05:34:23.557333+0000 mon.a (mon.0) 322 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:34:25.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:34:25 smithi157 bash[24585]: cluster 2024-09-16T05:34:23.472155+0000 mgr.a (mgr.14150) 121 : cluster [DBG] pgmap v72: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T05:34:25.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:34:25 smithi086 bash[24289]: cluster 2024-09-16T05:34:23.472155+0000 mgr.a (mgr.14150) 121 : cluster [DBG] pgmap v72: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T05:34:25.590 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:34:25 smithi047 bash[22744]: cluster 2024-09-16T05:34:23.472155+0000 mgr.a (mgr.14150) 121 : cluster [DBG] pgmap v72: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T05:34:27.402 INFO:teuthology.orchestra.run.smithi047.stdout:Created osd(s) 0 on host 'smithi047' 2024-09-16T05:34:27.436 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:34:27 smithi047 bash[22744]: cluster 2024-09-16T05:34:25.472418+0000 mgr.a (mgr.14150) 122 : cluster [DBG] pgmap v73: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T05:34:27.436 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:34:27 smithi047 bash[22744]: audit 2024-09-16T05:34:27.181947+0000 mon.a (mon.0) 323 : audit [INF] from='osd.0 [v2:172.21.15.47:6802/299634748,v1:172.21.15.47:6803/299634748]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-16T05:34:27.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:34:27 smithi086 bash[24289]: cluster 2024-09-16T05:34:25.472418+0000 mgr.a (mgr.14150) 122 : cluster [DBG] pgmap v73: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T05:34:27.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:34:27 smithi086 bash[24289]: audit 2024-09-16T05:34:27.181947+0000 mon.a (mon.0) 323 : audit [INF] from='osd.0 [v2:172.21.15.47:6802/299634748,v1:172.21.15.47:6803/299634748]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-16T05:34:27.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:34:27 smithi157 bash[24585]: cluster 2024-09-16T05:34:25.472418+0000 mgr.a (mgr.14150) 122 : cluster [DBG] pgmap v73: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T05:34:27.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:34:27 smithi157 bash[24585]: audit 2024-09-16T05:34:27.181947+0000 mon.a (mon.0) 323 : audit [INF] from='osd.0 [v2:172.21.15.47:6802/299634748,v1:172.21.15.47:6803/299634748]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-16T05:34:28.037 DEBUG:teuthology.orchestra.run.smithi047:osd.0> sudo journalctl -f -n 0 -u ceph-a6097908-73ec-11ef-bceb-c7b262605968@osd.0.service 2024-09-16T05:34:28.041 INFO:tasks.cephadm:Deploying osd.1 on smithi086 with /dev/vg_nvme/lv_4... 2024-09-16T05:34:28.041 DEBUG:teuthology.orchestra.run.smithi086:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a6097908-73ec-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-16T05:34:28.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:34:28 smithi086 bash[24289]: audit 2024-09-16T05:34:27.301759+0000 mon.a (mon.0) 324 : audit [INF] from='osd.0 [v2:172.21.15.47:6802/299634748,v1:172.21.15.47:6803/299634748]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-16T05:34:28.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:34:28 smithi086 bash[24289]: cluster 2024-09-16T05:34:27.306063+0000 mon.a (mon.0) 325 : cluster [DBG] osdmap e6: 1 total, 0 up, 1 in 2024-09-16T05:34:28.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:34:28 smithi086 bash[24289]: audit 2024-09-16T05:34:27.307040+0000 mon.a (mon.0) 326 : audit [INF] from='osd.0 [v2:172.21.15.47:6802/299634748,v1:172.21.15.47:6803/299634748]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi047", "root=default"]}]: dispatch 2024-09-16T05:34:28.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:34:28 smithi086 bash[24289]: audit 2024-09-16T05:34:27.307875+0000 mon.a (mon.0) 327 : audit [DBG] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-16T05:34:28.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:34:28 smithi086 bash[24289]: audit 2024-09-16T05:34:27.382952+0000 mon.a (mon.0) 328 : audit [DBG] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T05:34:28.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:34:28 smithi086 bash[24289]: audit 2024-09-16T05:34:27.390482+0000 mon.a (mon.0) 329 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:34:28.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:34:28 smithi086 bash[24289]: audit 2024-09-16T05:34:27.397861+0000 mon.a (mon.0) 330 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:34:28.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:34:28 smithi086 bash[24289]: audit 2024-09-16T05:34:28.304436+0000 mon.a (mon.0) 331 : audit [INF] from='osd.0 [v2:172.21.15.47:6802/299634748,v1:172.21.15.47:6803/299634748]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi047", "root=default"]}]': finished 2024-09-16T05:34:28.591 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:34:28 smithi047 bash[22744]: audit 2024-09-16T05:34:27.301759+0000 mon.a (mon.0) 324 : audit [INF] from='osd.0 [v2:172.21.15.47:6802/299634748,v1:172.21.15.47:6803/299634748]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-16T05:34:28.591 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:34:28 smithi047 bash[22744]: cluster 2024-09-16T05:34:27.306063+0000 mon.a (mon.0) 325 : cluster [DBG] osdmap e6: 1 total, 0 up, 1 in 2024-09-16T05:34:28.591 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:34:28 smithi047 bash[22744]: audit 2024-09-16T05:34:27.307040+0000 mon.a (mon.0) 326 : audit [INF] from='osd.0 [v2:172.21.15.47:6802/299634748,v1:172.21.15.47:6803/299634748]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi047", "root=default"]}]: dispatch 2024-09-16T05:34:28.591 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:34:28 smithi047 bash[22744]: audit 2024-09-16T05:34:27.307875+0000 mon.a (mon.0) 327 : audit [DBG] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-16T05:34:28.591 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:34:28 smithi047 bash[22744]: audit 2024-09-16T05:34:27.382952+0000 mon.a (mon.0) 328 : audit [DBG] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T05:34:28.591 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:34:28 smithi047 bash[22744]: audit 2024-09-16T05:34:27.390482+0000 mon.a (mon.0) 329 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:34:28.591 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:34:28 smithi047 bash[22744]: audit 2024-09-16T05:34:27.397861+0000 mon.a (mon.0) 330 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:34:28.591 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:34:28 smithi047 bash[22744]: audit 2024-09-16T05:34:28.304436+0000 mon.a (mon.0) 331 : audit [INF] from='osd.0 [v2:172.21.15.47:6802/299634748,v1:172.21.15.47:6803/299634748]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi047", "root=default"]}]': finished 2024-09-16T05:34:28.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:34:28 smithi157 bash[24585]: audit 2024-09-16T05:34:27.301759+0000 mon.a (mon.0) 324 : audit [INF] from='osd.0 [v2:172.21.15.47:6802/299634748,v1:172.21.15.47:6803/299634748]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-16T05:34:28.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:34:28 smithi157 bash[24585]: cluster 2024-09-16T05:34:27.306063+0000 mon.a (mon.0) 325 : cluster [DBG] osdmap e6: 1 total, 0 up, 1 in 2024-09-16T05:34:28.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:34:28 smithi157 bash[24585]: audit 2024-09-16T05:34:27.307040+0000 mon.a (mon.0) 326 : audit [INF] from='osd.0 [v2:172.21.15.47:6802/299634748,v1:172.21.15.47:6803/299634748]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi047", "root=default"]}]: dispatch 2024-09-16T05:34:28.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:34:28 smithi157 bash[24585]: audit 2024-09-16T05:34:27.307875+0000 mon.a (mon.0) 327 : audit [DBG] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-16T05:34:28.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:34:28 smithi157 bash[24585]: audit 2024-09-16T05:34:27.382952+0000 mon.a (mon.0) 328 : audit [DBG] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T05:34:28.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:34:28 smithi157 bash[24585]: audit 2024-09-16T05:34:27.390482+0000 mon.a (mon.0) 329 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:34:28.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:34:28 smithi157 bash[24585]: audit 2024-09-16T05:34:27.397861+0000 mon.a (mon.0) 330 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:34:28.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:34:28 smithi157 bash[24585]: audit 2024-09-16T05:34:28.304436+0000 mon.a (mon.0) 331 : audit [INF] from='osd.0 [v2:172.21.15.47:6802/299634748,v1:172.21.15.47:6803/299634748]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi047", "root=default"]}]': finished 2024-09-16T05:34:29.091 INFO:journalctl@ceph.osd.0.smithi047.stdout:Sep 16 05:34:28 smithi047 bash[32358]: debug 2024-09-16T05:34:28.617+0000 7f6efab07640 -1 osd.0 0 waiting for initial osdmap 2024-09-16T05:34:29.091 INFO:journalctl@ceph.osd.0.smithi047.stdout:Sep 16 05:34:28 smithi047 bash[32358]: debug 2024-09-16T05:34:28.649+0000 7f6ef2927640 -1 osd.0 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-16T05:34:29.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:34:29 smithi086 bash[24289]: cluster 2024-09-16T05:34:27.472657+0000 mgr.a (mgr.14150) 123 : cluster [DBG] pgmap v75: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T05:34:29.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:34:29 smithi086 bash[24289]: cluster 2024-09-16T05:34:28.309314+0000 mon.a (mon.0) 332 : cluster [DBG] osdmap e7: 1 total, 0 up, 1 in 2024-09-16T05:34:29.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:34:29 smithi086 bash[24289]: audit 2024-09-16T05:34:28.312506+0000 mon.a (mon.0) 333 : audit [DBG] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-16T05:34:29.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:34:29 smithi086 bash[24289]: audit 2024-09-16T05:34:28.325450+0000 mon.a (mon.0) 334 : audit [DBG] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-16T05:34:29.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:34:29 smithi086 bash[24289]: audit 2024-09-16T05:34:28.627307+0000 mon.a (mon.0) 335 : audit [INF] from='osd.0 [v2:172.21.15.47:6802/299634748,v1:172.21.15.47:6803/299634748]' entity='osd.0' 2024-09-16T05:34:29.591 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:34:29 smithi047 bash[22744]: cluster 2024-09-16T05:34:27.472657+0000 mgr.a (mgr.14150) 123 : cluster [DBG] pgmap v75: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T05:34:29.591 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:34:29 smithi047 bash[22744]: cluster 2024-09-16T05:34:28.309314+0000 mon.a (mon.0) 332 : cluster [DBG] osdmap e7: 1 total, 0 up, 1 in 2024-09-16T05:34:29.591 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:34:29 smithi047 bash[22744]: audit 2024-09-16T05:34:28.312506+0000 mon.a (mon.0) 333 : audit [DBG] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-16T05:34:29.591 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:34:29 smithi047 bash[22744]: audit 2024-09-16T05:34:28.325450+0000 mon.a (mon.0) 334 : audit [DBG] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-16T05:34:29.591 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:34:29 smithi047 bash[22744]: audit 2024-09-16T05:34:28.627307+0000 mon.a (mon.0) 335 : audit [INF] from='osd.0 [v2:172.21.15.47:6802/299634748,v1:172.21.15.47:6803/299634748]' entity='osd.0' 2024-09-16T05:34:29.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:34:29 smithi157 bash[24585]: cluster 2024-09-16T05:34:27.472657+0000 mgr.a (mgr.14150) 123 : cluster [DBG] pgmap v75: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T05:34:29.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:34:29 smithi157 bash[24585]: cluster 2024-09-16T05:34:28.309314+0000 mon.a (mon.0) 332 : cluster [DBG] osdmap e7: 1 total, 0 up, 1 in 2024-09-16T05:34:29.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:34:29 smithi157 bash[24585]: audit 2024-09-16T05:34:28.312506+0000 mon.a (mon.0) 333 : audit [DBG] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-16T05:34:29.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:34:29 smithi157 bash[24585]: audit 2024-09-16T05:34:28.325450+0000 mon.a (mon.0) 334 : audit [DBG] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-16T05:34:29.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:34:29 smithi157 bash[24585]: audit 2024-09-16T05:34:28.627307+0000 mon.a (mon.0) 335 : audit [INF] from='osd.0 [v2:172.21.15.47:6802/299634748,v1:172.21.15.47:6803/299634748]' entity='osd.0' 2024-09-16T05:34:30.591 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:34:30 smithi047 bash[22744]: cluster 2024-09-16T05:34:28.213319+0000 osd.0 (osd.0) 1 : cluster [DBG] purged_snaps scrub starts 2024-09-16T05:34:30.591 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:34:30 smithi047 bash[22744]: cluster 2024-09-16T05:34:28.213435+0000 osd.0 (osd.0) 2 : cluster [DBG] purged_snaps scrub ok 2024-09-16T05:34:30.591 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:34:30 smithi047 bash[22744]: audit 2024-09-16T05:34:29.323282+0000 mon.a (mon.0) 336 : audit [DBG] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-16T05:34:30.591 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:34:30 smithi047 bash[22744]: cluster 2024-09-16T05:34:29.630629+0000 mon.a (mon.0) 337 : cluster [INF] osd.0 [v2:172.21.15.47:6802/299634748,v1:172.21.15.47:6803/299634748] boot 2024-09-16T05:34:30.591 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:34:30 smithi047 bash[22744]: cluster 2024-09-16T05:34:29.630682+0000 mon.a (mon.0) 338 : cluster [DBG] osdmap e8: 1 total, 1 up, 1 in 2024-09-16T05:34:30.591 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:34:30 smithi047 bash[22744]: audit 2024-09-16T05:34:29.630820+0000 mon.a (mon.0) 339 : audit [DBG] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-16T05:34:30.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:34:30 smithi157 bash[24585]: cluster 2024-09-16T05:34:28.213319+0000 osd.0 (osd.0) 1 : cluster [DBG] purged_snaps scrub starts 2024-09-16T05:34:30.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:34:30 smithi157 bash[24585]: cluster 2024-09-16T05:34:28.213435+0000 osd.0 (osd.0) 2 : cluster [DBG] purged_snaps scrub ok 2024-09-16T05:34:30.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:34:30 smithi157 bash[24585]: audit 2024-09-16T05:34:29.323282+0000 mon.a (mon.0) 336 : audit [DBG] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-16T05:34:30.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:34:30 smithi157 bash[24585]: cluster 2024-09-16T05:34:29.630629+0000 mon.a (mon.0) 337 : cluster [INF] osd.0 [v2:172.21.15.47:6802/299634748,v1:172.21.15.47:6803/299634748] boot 2024-09-16T05:34:30.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:34:30 smithi157 bash[24585]: cluster 2024-09-16T05:34:29.630682+0000 mon.a (mon.0) 338 : cluster [DBG] osdmap e8: 1 total, 1 up, 1 in 2024-09-16T05:34:30.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:34:30 smithi157 bash[24585]: audit 2024-09-16T05:34:29.630820+0000 mon.a (mon.0) 339 : audit [DBG] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-16T05:34:30.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:34:30 smithi086 bash[24289]: cluster 2024-09-16T05:34:28.213319+0000 osd.0 (osd.0) 1 : cluster [DBG] purged_snaps scrub starts 2024-09-16T05:34:30.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:34:30 smithi086 bash[24289]: cluster 2024-09-16T05:34:28.213435+0000 osd.0 (osd.0) 2 : cluster [DBG] purged_snaps scrub ok 2024-09-16T05:34:30.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:34:30 smithi086 bash[24289]: audit 2024-09-16T05:34:29.323282+0000 mon.a (mon.0) 336 : audit [DBG] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-16T05:34:30.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:34:30 smithi086 bash[24289]: cluster 2024-09-16T05:34:29.630629+0000 mon.a (mon.0) 337 : cluster [INF] osd.0 [v2:172.21.15.47:6802/299634748,v1:172.21.15.47:6803/299634748] boot 2024-09-16T05:34:30.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:34:30 smithi086 bash[24289]: cluster 2024-09-16T05:34:29.630682+0000 mon.a (mon.0) 338 : cluster [DBG] osdmap e8: 1 total, 1 up, 1 in 2024-09-16T05:34:30.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:34:30 smithi086 bash[24289]: audit 2024-09-16T05:34:29.630820+0000 mon.a (mon.0) 339 : audit [DBG] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-16T05:34:31.591 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:34:31 smithi047 bash[22744]: cluster 2024-09-16T05:34:29.473032+0000 mgr.a (mgr.14150) 124 : cluster [DBG] pgmap v77: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T05:34:31.591 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:34:31 smithi047 bash[22744]: cluster 2024-09-16T05:34:30.633267+0000 mon.a (mon.0) 340 : cluster [DBG] osdmap e9: 1 total, 1 up, 1 in 2024-09-16T05:34:31.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:34:31 smithi157 bash[24585]: cluster 2024-09-16T05:34:29.473032+0000 mgr.a (mgr.14150) 124 : cluster [DBG] pgmap v77: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T05:34:31.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:34:31 smithi157 bash[24585]: cluster 2024-09-16T05:34:30.633267+0000 mon.a (mon.0) 340 : cluster [DBG] osdmap e9: 1 total, 1 up, 1 in 2024-09-16T05:34:31.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:34:31 smithi086 bash[24289]: cluster 2024-09-16T05:34:29.473032+0000 mgr.a (mgr.14150) 124 : cluster [DBG] pgmap v77: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T05:34:31.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:34:31 smithi086 bash[24289]: cluster 2024-09-16T05:34:30.633267+0000 mon.a (mon.0) 340 : cluster [DBG] osdmap e9: 1 total, 1 up, 1 in 2024-09-16T05:34:32.768 INFO:teuthology.orchestra.run.smithi086.stderr:Inferring config /var/lib/ceph/a6097908-73ec-11ef-bceb-c7b262605968/mon.b/config 2024-09-16T05:34:33.590 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:34:33 smithi047 bash[22744]: cluster 2024-09-16T05:34:31.473503+0000 mgr.a (mgr.14150) 125 : cluster [DBG] pgmap v80: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-16T05:34:33.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:34:33 smithi157 bash[24585]: cluster 2024-09-16T05:34:31.473503+0000 mgr.a (mgr.14150) 125 : cluster [DBG] pgmap v80: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-16T05:34:33.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:34:33 smithi086 bash[24289]: cluster 2024-09-16T05:34:31.473503+0000 mgr.a (mgr.14150) 125 : cluster [DBG] pgmap v80: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-16T05:34:35.590 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:34:35 smithi047 bash[22744]: cluster 2024-09-16T05:34:33.473967+0000 mgr.a (mgr.14150) 126 : cluster [DBG] pgmap v81: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-16T05:34:35.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:34:35 smithi157 bash[24585]: cluster 2024-09-16T05:34:33.473967+0000 mgr.a (mgr.14150) 126 : cluster [DBG] pgmap v81: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-16T05:34:35.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:34:35 smithi086 bash[24289]: cluster 2024-09-16T05:34:33.473967+0000 mgr.a (mgr.14150) 126 : cluster [DBG] pgmap v81: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-16T05:34:36.557 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-16T05:34:36.606 DEBUG:teuthology.orchestra.run.smithi086:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a6097908-73ec-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi086:vg_nvme/lv_4 2024-09-16T05:34:37.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:34:37 smithi157 bash[24585]: cluster 2024-09-16T05:34:35.474284+0000 mgr.a (mgr.14150) 127 : cluster [DBG] pgmap v82: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-16T05:34:37.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:34:37 smithi157 bash[24585]: audit 2024-09-16T05:34:36.729310+0000 mon.a (mon.0) 341 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:34:37.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:34:37 smithi157 bash[24585]: audit 2024-09-16T05:34:36.735287+0000 mon.a (mon.0) 342 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:34:37.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:34:37 smithi157 bash[24585]: audit 2024-09-16T05:34:36.737559+0000 mon.a (mon.0) 343 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-16T05:34:37.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:34:37 smithi157 bash[24585]: audit 2024-09-16T05:34:36.743029+0000 mon.a (mon.0) 344 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:34:37.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:34:37 smithi157 bash[24585]: audit 2024-09-16T05:34:36.745901+0000 mon.a (mon.0) 345 : audit [DBG] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T05:34:37.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:34:37 smithi157 bash[24585]: audit 2024-09-16T05:34:36.747511+0000 mon.a (mon.0) 346 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T05:34:37.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:34:37 smithi157 bash[24585]: audit 2024-09-16T05:34:36.754878+0000 mon.a (mon.0) 347 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:34:37.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:34:37 smithi086 bash[24289]: cluster 2024-09-16T05:34:35.474284+0000 mgr.a (mgr.14150) 127 : cluster [DBG] pgmap v82: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-16T05:34:37.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:34:37 smithi086 bash[24289]: audit 2024-09-16T05:34:36.729310+0000 mon.a (mon.0) 341 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:34:37.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:34:37 smithi086 bash[24289]: audit 2024-09-16T05:34:36.735287+0000 mon.a (mon.0) 342 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:34:37.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:34:37 smithi086 bash[24289]: audit 2024-09-16T05:34:36.737559+0000 mon.a (mon.0) 343 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-16T05:34:37.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:34:37 smithi086 bash[24289]: audit 2024-09-16T05:34:36.743029+0000 mon.a (mon.0) 344 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:34:37.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:34:37 smithi086 bash[24289]: audit 2024-09-16T05:34:36.745901+0000 mon.a (mon.0) 345 : audit [DBG] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T05:34:37.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:34:37 smithi086 bash[24289]: audit 2024-09-16T05:34:36.747511+0000 mon.a (mon.0) 346 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T05:34:37.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:34:37 smithi086 bash[24289]: audit 2024-09-16T05:34:36.754878+0000 mon.a (mon.0) 347 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:34:37.841 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:34:37 smithi047 bash[22744]: cluster 2024-09-16T05:34:35.474284+0000 mgr.a (mgr.14150) 127 : cluster [DBG] pgmap v82: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-16T05:34:37.841 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:34:37 smithi047 bash[22744]: audit 2024-09-16T05:34:36.729310+0000 mon.a (mon.0) 341 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:34:37.841 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:34:37 smithi047 bash[22744]: audit 2024-09-16T05:34:36.735287+0000 mon.a (mon.0) 342 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:34:37.841 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:34:37 smithi047 bash[22744]: audit 2024-09-16T05:34:36.737559+0000 mon.a (mon.0) 343 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-16T05:34:37.841 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:34:37 smithi047 bash[22744]: audit 2024-09-16T05:34:36.743029+0000 mon.a (mon.0) 344 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:34:37.841 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:34:37 smithi047 bash[22744]: audit 2024-09-16T05:34:36.745901+0000 mon.a (mon.0) 345 : audit [DBG] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T05:34:37.841 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:34:37 smithi047 bash[22744]: audit 2024-09-16T05:34:36.747511+0000 mon.a (mon.0) 346 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T05:34:37.841 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:34:37 smithi047 bash[22744]: audit 2024-09-16T05:34:36.754878+0000 mon.a (mon.0) 347 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:34:38.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:34:38 smithi157 bash[24585]: cephadm 2024-09-16T05:34:36.722800+0000 mgr.a (mgr.14150) 128 : cephadm [INF] Detected new or changed devices on smithi047 2024-09-16T05:34:38.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:34:38 smithi157 bash[24585]: cephadm 2024-09-16T05:34:36.738893+0000 mgr.a (mgr.14150) 129 : cephadm [INF] Adjusting osd_memory_target on smithi047 to 17269M 2024-09-16T05:34:38.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:34:38 smithi086 bash[24289]: cephadm 2024-09-16T05:34:36.722800+0000 mgr.a (mgr.14150) 128 : cephadm [INF] Detected new or changed devices on smithi047 2024-09-16T05:34:38.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:34:38 smithi086 bash[24289]: cephadm 2024-09-16T05:34:36.738893+0000 mgr.a (mgr.14150) 129 : cephadm [INF] Adjusting osd_memory_target on smithi047 to 17269M 2024-09-16T05:34:38.840 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:34:38 smithi047 bash[22744]: cephadm 2024-09-16T05:34:36.722800+0000 mgr.a (mgr.14150) 128 : cephadm [INF] Detected new or changed devices on smithi047 2024-09-16T05:34:38.840 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:34:38 smithi047 bash[22744]: cephadm 2024-09-16T05:34:36.738893+0000 mgr.a (mgr.14150) 129 : cephadm [INF] Adjusting osd_memory_target on smithi047 to 17269M 2024-09-16T05:34:39.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:34:39 smithi157 bash[24585]: cluster 2024-09-16T05:34:37.474692+0000 mgr.a (mgr.14150) 130 : cluster [DBG] pgmap v83: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-16T05:34:39.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:34:39 smithi086 bash[24289]: cluster 2024-09-16T05:34:37.474692+0000 mgr.a (mgr.14150) 130 : cluster [DBG] pgmap v83: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-16T05:34:39.840 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:34:39 smithi047 bash[22744]: cluster 2024-09-16T05:34:37.474692+0000 mgr.a (mgr.14150) 130 : cluster [DBG] pgmap v83: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-16T05:34:41.332 INFO:teuthology.orchestra.run.smithi086.stderr:Inferring config /var/lib/ceph/a6097908-73ec-11ef-bceb-c7b262605968/mon.b/config 2024-09-16T05:34:41.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:34:41 smithi157 bash[24585]: cluster 2024-09-16T05:34:39.475152+0000 mgr.a (mgr.14150) 131 : cluster [DBG] pgmap v84: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-16T05:34:41.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:34:41 smithi086 bash[24289]: cluster 2024-09-16T05:34:39.475152+0000 mgr.a (mgr.14150) 131 : cluster [DBG] pgmap v84: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-16T05:34:41.840 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:34:41 smithi047 bash[22744]: cluster 2024-09-16T05:34:39.475152+0000 mgr.a (mgr.14150) 131 : cluster [DBG] pgmap v84: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-16T05:34:43.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:34:43 smithi157 bash[24585]: cluster 2024-09-16T05:34:41.475626+0000 mgr.a (mgr.14150) 132 : cluster [DBG] pgmap v85: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-16T05:34:43.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:34:43 smithi157 bash[24585]: audit 2024-09-16T05:34:42.649189+0000 mon.a (mon.0) 348 : audit [DBG] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-16T05:34:43.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:34:43 smithi157 bash[24585]: audit 2024-09-16T05:34:42.655193+0000 mon.a (mon.0) 349 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-16T05:34:43.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:34:43 smithi157 bash[24585]: audit 2024-09-16T05:34:42.656944+0000 mon.a (mon.0) 350 : audit [DBG] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T05:34:43.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:34:43 smithi086 bash[24289]: cluster 2024-09-16T05:34:41.475626+0000 mgr.a (mgr.14150) 132 : cluster [DBG] pgmap v85: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-16T05:34:43.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:34:43 smithi086 bash[24289]: audit 2024-09-16T05:34:42.649189+0000 mon.a (mon.0) 348 : audit [DBG] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-16T05:34:43.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:34:43 smithi086 bash[24289]: audit 2024-09-16T05:34:42.655193+0000 mon.a (mon.0) 349 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-16T05:34:43.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:34:43 smithi086 bash[24289]: audit 2024-09-16T05:34:42.656944+0000 mon.a (mon.0) 350 : audit [DBG] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T05:34:43.840 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:34:43 smithi047 bash[22744]: cluster 2024-09-16T05:34:41.475626+0000 mgr.a (mgr.14150) 132 : cluster [DBG] pgmap v85: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-16T05:34:43.841 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:34:43 smithi047 bash[22744]: audit 2024-09-16T05:34:42.649189+0000 mon.a (mon.0) 348 : audit [DBG] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-16T05:34:43.841 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:34:43 smithi047 bash[22744]: audit 2024-09-16T05:34:42.655193+0000 mon.a (mon.0) 349 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-16T05:34:43.841 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:34:43 smithi047 bash[22744]: audit 2024-09-16T05:34:42.656944+0000 mon.a (mon.0) 350 : audit [DBG] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T05:34:44.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:34:44 smithi157 bash[24585]: audit 2024-09-16T05:34:42.642415+0000 mgr.a (mgr.14150) 133 : audit [DBG] from='client.24131 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi086:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:34:44.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:34:44 smithi086 bash[24289]: audit 2024-09-16T05:34:42.642415+0000 mgr.a (mgr.14150) 133 : audit [DBG] from='client.24131 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi086:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:34:44.840 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:34:44 smithi047 bash[22744]: audit 2024-09-16T05:34:42.642415+0000 mgr.a (mgr.14150) 133 : audit [DBG] from='client.24131 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi086:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:34:45.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:34:45 smithi157 bash[24585]: cluster 2024-09-16T05:34:43.476063+0000 mgr.a (mgr.14150) 134 : cluster [DBG] pgmap v86: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-16T05:34:45.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:34:45 smithi086 bash[24289]: cluster 2024-09-16T05:34:43.476063+0000 mgr.a (mgr.14150) 134 : cluster [DBG] pgmap v86: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-16T05:34:45.840 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:34:45 smithi047 bash[22744]: cluster 2024-09-16T05:34:43.476063+0000 mgr.a (mgr.14150) 134 : cluster [DBG] pgmap v86: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-16T05:34:47.784 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:34:47 smithi086 bash[24289]: cluster 2024-09-16T05:34:45.476525+0000 mgr.a (mgr.14150) 135 : cluster [DBG] pgmap v87: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-16T05:34:47.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:34:47 smithi157 bash[24585]: cluster 2024-09-16T05:34:45.476525+0000 mgr.a (mgr.14150) 135 : cluster [DBG] pgmap v87: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-16T05:34:47.840 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:34:47 smithi047 bash[22744]: cluster 2024-09-16T05:34:45.476525+0000 mgr.a (mgr.14150) 135 : cluster [DBG] pgmap v87: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-16T05:34:49.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:34:49 smithi157 bash[24585]: cluster 2024-09-16T05:34:47.476975+0000 mgr.a (mgr.14150) 136 : cluster [DBG] pgmap v88: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-16T05:34:49.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:34:49 smithi086 bash[24289]: cluster 2024-09-16T05:34:47.476975+0000 mgr.a (mgr.14150) 136 : cluster [DBG] pgmap v88: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-16T05:34:49.840 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:34:49 smithi047 bash[22744]: cluster 2024-09-16T05:34:47.476975+0000 mgr.a (mgr.14150) 136 : cluster [DBG] pgmap v88: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-16T05:34:51.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:34:51 smithi157 bash[24585]: cluster 2024-09-16T05:34:49.477431+0000 mgr.a (mgr.14150) 137 : cluster [DBG] pgmap v89: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-16T05:34:51.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:34:51 smithi157 bash[24585]: audit 2024-09-16T05:34:51.031721+0000 mon.b (mon.2) 7 : audit [INF] from='client.? 172.21.15.86:0/4000217569' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "10a1acb4-c530-44b2-a9bf-35740cf4cbba"}]: dispatch 2024-09-16T05:34:51.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:34:51 smithi157 bash[24585]: audit 2024-09-16T05:34:51.034469+0000 mon.a (mon.0) 351 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "10a1acb4-c530-44b2-a9bf-35740cf4cbba"}]: dispatch 2024-09-16T05:34:51.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:34:51 smithi157 bash[24585]: audit 2024-09-16T05:34:51.037482+0000 mon.a (mon.0) 352 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "10a1acb4-c530-44b2-a9bf-35740cf4cbba"}]': finished 2024-09-16T05:34:51.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:34:51 smithi157 bash[24585]: cluster 2024-09-16T05:34:51.042553+0000 mon.a (mon.0) 353 : cluster [DBG] osdmap e10: 2 total, 1 up, 2 in 2024-09-16T05:34:51.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:34:51 smithi157 bash[24585]: audit 2024-09-16T05:34:51.042982+0000 mon.a (mon.0) 354 : audit [DBG] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-16T05:34:51.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:34:51 smithi086 bash[24289]: cluster 2024-09-16T05:34:49.477431+0000 mgr.a (mgr.14150) 137 : cluster [DBG] pgmap v89: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-16T05:34:51.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:34:51 smithi086 bash[24289]: audit 2024-09-16T05:34:51.031721+0000 mon.b (mon.2) 7 : audit [INF] from='client.? 172.21.15.86:0/4000217569' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "10a1acb4-c530-44b2-a9bf-35740cf4cbba"}]: dispatch 2024-09-16T05:34:51.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:34:51 smithi086 bash[24289]: audit 2024-09-16T05:34:51.034469+0000 mon.a (mon.0) 351 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "10a1acb4-c530-44b2-a9bf-35740cf4cbba"}]: dispatch 2024-09-16T05:34:51.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:34:51 smithi086 bash[24289]: audit 2024-09-16T05:34:51.037482+0000 mon.a (mon.0) 352 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "10a1acb4-c530-44b2-a9bf-35740cf4cbba"}]': finished 2024-09-16T05:34:51.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:34:51 smithi086 bash[24289]: cluster 2024-09-16T05:34:51.042553+0000 mon.a (mon.0) 353 : cluster [DBG] osdmap e10: 2 total, 1 up, 2 in 2024-09-16T05:34:51.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:34:51 smithi086 bash[24289]: audit 2024-09-16T05:34:51.042982+0000 mon.a (mon.0) 354 : audit [DBG] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-16T05:34:51.840 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:34:51 smithi047 bash[22744]: cluster 2024-09-16T05:34:49.477431+0000 mgr.a (mgr.14150) 137 : cluster [DBG] pgmap v89: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-16T05:34:51.841 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:34:51 smithi047 bash[22744]: audit 2024-09-16T05:34:51.031721+0000 mon.b (mon.2) 7 : audit [INF] from='client.? 172.21.15.86:0/4000217569' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "10a1acb4-c530-44b2-a9bf-35740cf4cbba"}]: dispatch 2024-09-16T05:34:51.841 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:34:51 smithi047 bash[22744]: audit 2024-09-16T05:34:51.034469+0000 mon.a (mon.0) 351 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "10a1acb4-c530-44b2-a9bf-35740cf4cbba"}]: dispatch 2024-09-16T05:34:51.841 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:34:51 smithi047 bash[22744]: audit 2024-09-16T05:34:51.037482+0000 mon.a (mon.0) 352 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "10a1acb4-c530-44b2-a9bf-35740cf4cbba"}]': finished 2024-09-16T05:34:51.841 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:34:51 smithi047 bash[22744]: cluster 2024-09-16T05:34:51.042553+0000 mon.a (mon.0) 353 : cluster [DBG] osdmap e10: 2 total, 1 up, 2 in 2024-09-16T05:34:51.841 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:34:51 smithi047 bash[22744]: audit 2024-09-16T05:34:51.042982+0000 mon.a (mon.0) 354 : audit [DBG] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-16T05:34:52.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:34:52 smithi157 bash[24585]: audit 2024-09-16T05:34:51.683779+0000 mon.b (mon.2) 8 : audit [DBG] from='client.? 172.21.15.86:0/1560965494' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-16T05:34:52.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:34:52 smithi086 bash[24289]: audit 2024-09-16T05:34:51.683779+0000 mon.b (mon.2) 8 : audit [DBG] from='client.? 172.21.15.86:0/1560965494' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-16T05:34:52.840 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:34:52 smithi047 bash[22744]: audit 2024-09-16T05:34:51.683779+0000 mon.b (mon.2) 8 : audit [DBG] from='client.? 172.21.15.86:0/1560965494' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-16T05:34:53.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:34:53 smithi157 bash[24585]: cluster 2024-09-16T05:34:51.477928+0000 mgr.a (mgr.14150) 138 : cluster [DBG] pgmap v91: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-16T05:34:53.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:34:53 smithi086 bash[24289]: cluster 2024-09-16T05:34:51.477928+0000 mgr.a (mgr.14150) 138 : cluster [DBG] pgmap v91: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-16T05:34:53.840 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:34:53 smithi047 bash[22744]: cluster 2024-09-16T05:34:51.477928+0000 mgr.a (mgr.14150) 138 : cluster [DBG] pgmap v91: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-16T05:34:55.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:34:55 smithi157 bash[24585]: cluster 2024-09-16T05:34:53.478458+0000 mgr.a (mgr.14150) 139 : cluster [DBG] pgmap v92: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-16T05:34:55.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:34:55 smithi086 bash[24289]: cluster 2024-09-16T05:34:53.478458+0000 mgr.a (mgr.14150) 139 : cluster [DBG] pgmap v92: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-16T05:34:55.841 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:34:55 smithi047 bash[22744]: cluster 2024-09-16T05:34:53.478458+0000 mgr.a (mgr.14150) 139 : cluster [DBG] pgmap v92: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-16T05:34:57.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:34:57 smithi157 bash[24585]: cluster 2024-09-16T05:34:55.479058+0000 mgr.a (mgr.14150) 140 : cluster [DBG] pgmap v93: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-16T05:34:57.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:34:57 smithi086 bash[24289]: cluster 2024-09-16T05:34:55.479058+0000 mgr.a (mgr.14150) 140 : cluster [DBG] pgmap v93: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-16T05:34:57.840 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:34:57 smithi047 bash[22744]: cluster 2024-09-16T05:34:55.479058+0000 mgr.a (mgr.14150) 140 : cluster [DBG] pgmap v93: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-16T05:34:59.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:34:59 smithi157 bash[24585]: cluster 2024-09-16T05:34:57.479547+0000 mgr.a (mgr.14150) 141 : cluster [DBG] pgmap v94: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-16T05:34:59.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:34:59 smithi086 bash[24289]: cluster 2024-09-16T05:34:57.479547+0000 mgr.a (mgr.14150) 141 : cluster [DBG] pgmap v94: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-16T05:34:59.840 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:34:59 smithi047 bash[22744]: cluster 2024-09-16T05:34:57.479547+0000 mgr.a (mgr.14150) 141 : cluster [DBG] pgmap v94: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-16T05:35:01.739 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:35:01 smithi086 bash[24289]: cluster 2024-09-16T05:34:59.480033+0000 mgr.a (mgr.14150) 142 : cluster [DBG] pgmap v95: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-16T05:35:01.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:35:01 smithi157 bash[24585]: cluster 2024-09-16T05:34:59.480033+0000 mgr.a (mgr.14150) 142 : cluster [DBG] pgmap v95: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-16T05:35:01.840 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:35:01 smithi047 bash[22744]: cluster 2024-09-16T05:34:59.480033+0000 mgr.a (mgr.14150) 142 : cluster [DBG] pgmap v95: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-16T05:35:03.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:35:03 smithi157 bash[24585]: cluster 2024-09-16T05:35:01.480507+0000 mgr.a (mgr.14150) 143 : cluster [DBG] pgmap v96: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-16T05:35:03.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:35:03 smithi086 bash[24289]: cluster 2024-09-16T05:35:01.480507+0000 mgr.a (mgr.14150) 143 : cluster [DBG] pgmap v96: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-16T05:35:03.840 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:35:03 smithi047 bash[22744]: cluster 2024-09-16T05:35:01.480507+0000 mgr.a (mgr.14150) 143 : cluster [DBG] pgmap v96: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-16T05:35:05.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:35:05 smithi157 bash[24585]: cluster 2024-09-16T05:35:03.480999+0000 mgr.a (mgr.14150) 144 : cluster [DBG] pgmap v97: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-16T05:35:05.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:35:05 smithi157 bash[24585]: audit 2024-09-16T05:35:04.514874+0000 mon.a (mon.0) 355 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-16T05:35:05.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:35:05 smithi157 bash[24585]: audit 2024-09-16T05:35:04.516609+0000 mon.a (mon.0) 356 : audit [DBG] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T05:35:05.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:35:05 smithi086 bash[24289]: cluster 2024-09-16T05:35:03.480999+0000 mgr.a (mgr.14150) 144 : cluster [DBG] pgmap v97: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-16T05:35:05.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:35:05 smithi086 bash[24289]: audit 2024-09-16T05:35:04.514874+0000 mon.a (mon.0) 355 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-16T05:35:05.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:35:05 smithi086 bash[24289]: audit 2024-09-16T05:35:04.516609+0000 mon.a (mon.0) 356 : audit [DBG] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T05:35:05.840 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:35:05 smithi047 bash[22744]: cluster 2024-09-16T05:35:03.480999+0000 mgr.a (mgr.14150) 144 : cluster [DBG] pgmap v97: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-16T05:35:05.841 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:35:05 smithi047 bash[22744]: audit 2024-09-16T05:35:04.514874+0000 mon.a (mon.0) 355 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-16T05:35:05.841 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:35:05 smithi047 bash[22744]: audit 2024-09-16T05:35:04.516609+0000 mon.a (mon.0) 356 : audit [DBG] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T05:35:06.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:35:06 smithi086 bash[24289]: cephadm 2024-09-16T05:35:04.518130+0000 mgr.a (mgr.14150) 145 : cephadm [INF] Deploying daemon osd.1 on smithi086 2024-09-16T05:35:06.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:35:06 smithi157 bash[24585]: cephadm 2024-09-16T05:35:04.518130+0000 mgr.a (mgr.14150) 145 : cephadm [INF] Deploying daemon osd.1 on smithi086 2024-09-16T05:35:06.840 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:35:06 smithi047 bash[22744]: cephadm 2024-09-16T05:35:04.518130+0000 mgr.a (mgr.14150) 145 : cephadm [INF] Deploying daemon osd.1 on smithi086 2024-09-16T05:35:07.676 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:35:07 smithi086 bash[24289]: cluster 2024-09-16T05:35:05.481490+0000 mgr.a (mgr.14150) 146 : cluster [DBG] pgmap v98: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-16T05:35:07.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:35:07 smithi157 bash[24585]: cluster 2024-09-16T05:35:05.481490+0000 mgr.a (mgr.14150) 146 : cluster [DBG] pgmap v98: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-16T05:35:07.840 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:35:07 smithi047 bash[22744]: cluster 2024-09-16T05:35:05.481490+0000 mgr.a (mgr.14150) 146 : cluster [DBG] pgmap v98: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-16T05:35:08.773 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:35:08 smithi086 bash[24289]: cluster 2024-09-16T05:35:07.481943+0000 mgr.a (mgr.14150) 147 : cluster [DBG] pgmap v99: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-16T05:35:08.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:35:08 smithi157 bash[24585]: cluster 2024-09-16T05:35:07.481943+0000 mgr.a (mgr.14150) 147 : cluster [DBG] pgmap v99: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-16T05:35:08.840 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:35:08 smithi047 bash[22744]: cluster 2024-09-16T05:35:07.481943+0000 mgr.a (mgr.14150) 147 : cluster [DBG] pgmap v99: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-16T05:35:09.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:35:08 smithi086 systemd[1]: /etc/systemd/system/ceph-a6097908-73ec-11ef-bceb-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-16T05:35:09.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:35:09 smithi086 systemd[1]: /etc/systemd/system/ceph-a6097908-73ec-11ef-bceb-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-16T05:35:09.071 INFO:journalctl@ceph.mgr.b.smithi086.stdout:Sep 16 05:35:08 smithi086 systemd[1]: /etc/systemd/system/ceph-a6097908-73ec-11ef-bceb-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-16T05:35:09.071 INFO:journalctl@ceph.mgr.b.smithi086.stdout:Sep 16 05:35:09 smithi086 systemd[1]: /etc/systemd/system/ceph-a6097908-73ec-11ef-bceb-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-16T05:35:09.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:35:09 smithi157 bash[24585]: audit 2024-09-16T05:35:09.144108+0000 mon.a (mon.0) 357 : audit [DBG] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T05:35:09.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:35:09 smithi157 bash[24585]: audit 2024-09-16T05:35:09.150956+0000 mon.a (mon.0) 358 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:35:09.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:35:09 smithi157 bash[24585]: audit 2024-09-16T05:35:09.158615+0000 mon.a (mon.0) 359 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:35:09.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:35:09 smithi086 bash[24289]: audit 2024-09-16T05:35:09.144108+0000 mon.a (mon.0) 357 : audit [DBG] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T05:35:09.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:35:09 smithi086 bash[24289]: audit 2024-09-16T05:35:09.150956+0000 mon.a (mon.0) 358 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:35:09.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:35:09 smithi086 bash[24289]: audit 2024-09-16T05:35:09.158615+0000 mon.a (mon.0) 359 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:35:09.840 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:35:09 smithi047 bash[22744]: audit 2024-09-16T05:35:09.144108+0000 mon.a (mon.0) 357 : audit [DBG] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T05:35:09.841 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:35:09 smithi047 bash[22744]: audit 2024-09-16T05:35:09.150956+0000 mon.a (mon.0) 358 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:35:09.841 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:35:09 smithi047 bash[22744]: audit 2024-09-16T05:35:09.158615+0000 mon.a (mon.0) 359 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:35:10.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:35:10 smithi157 bash[24585]: cluster 2024-09-16T05:35:09.482421+0000 mgr.a (mgr.14150) 148 : cluster [DBG] pgmap v100: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-16T05:35:10.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:35:10 smithi086 bash[24289]: cluster 2024-09-16T05:35:09.482421+0000 mgr.a (mgr.14150) 148 : cluster [DBG] pgmap v100: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-16T05:35:10.840 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:35:10 smithi047 bash[22744]: cluster 2024-09-16T05:35:09.482421+0000 mgr.a (mgr.14150) 148 : cluster [DBG] pgmap v100: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-16T05:35:12.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:35:12 smithi157 bash[24585]: cluster 2024-09-16T05:35:11.482861+0000 mgr.a (mgr.14150) 149 : cluster [DBG] pgmap v101: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-16T05:35:12.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:35:12 smithi086 bash[24289]: cluster 2024-09-16T05:35:11.482861+0000 mgr.a (mgr.14150) 149 : cluster [DBG] pgmap v101: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-16T05:35:12.840 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:35:12 smithi047 bash[22744]: cluster 2024-09-16T05:35:11.482861+0000 mgr.a (mgr.14150) 149 : cluster [DBG] pgmap v101: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-16T05:35:14.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:35:14 smithi157 bash[24585]: cluster 2024-09-16T05:35:13.483303+0000 mgr.a (mgr.14150) 150 : cluster [DBG] pgmap v102: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-16T05:35:14.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:35:14 smithi157 bash[24585]: audit 2024-09-16T05:35:14.476818+0000 mon.a (mon.0) 360 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:35:14.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:35:14 smithi157 bash[24585]: audit 2024-09-16T05:35:14.485282+0000 mon.a (mon.0) 361 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:35:14.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:35:14 smithi086 bash[24289]: cluster 2024-09-16T05:35:13.483303+0000 mgr.a (mgr.14150) 150 : cluster [DBG] pgmap v102: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-16T05:35:14.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:35:14 smithi086 bash[24289]: audit 2024-09-16T05:35:14.476818+0000 mon.a (mon.0) 360 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:35:14.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:35:14 smithi086 bash[24289]: audit 2024-09-16T05:35:14.485282+0000 mon.a (mon.0) 361 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:35:14.840 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:35:14 smithi047 bash[22744]: cluster 2024-09-16T05:35:13.483303+0000 mgr.a (mgr.14150) 150 : cluster [DBG] pgmap v102: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-16T05:35:14.840 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:35:14 smithi047 bash[22744]: audit 2024-09-16T05:35:14.476818+0000 mon.a (mon.0) 360 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:35:14.841 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:35:14 smithi047 bash[22744]: audit 2024-09-16T05:35:14.485282+0000 mon.a (mon.0) 361 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:35:15.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:35:15 smithi157 bash[24585]: audit 2024-09-16T05:35:15.170201+0000 mon.a (mon.0) 362 : audit [DBG] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T05:35:15.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:35:15 smithi157 bash[24585]: audit 2024-09-16T05:35:15.171482+0000 mon.a (mon.0) 363 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T05:35:15.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:35:15 smithi157 bash[24585]: audit 2024-09-16T05:35:15.180192+0000 mon.a (mon.0) 364 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:35:15.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:35:15 smithi086 bash[24289]: audit 2024-09-16T05:35:15.170201+0000 mon.a (mon.0) 362 : audit [DBG] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T05:35:15.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:35:15 smithi086 bash[24289]: audit 2024-09-16T05:35:15.171482+0000 mon.a (mon.0) 363 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T05:35:15.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:35:15 smithi086 bash[24289]: audit 2024-09-16T05:35:15.180192+0000 mon.a (mon.0) 364 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:35:15.840 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:35:15 smithi047 bash[22744]: audit 2024-09-16T05:35:15.170201+0000 mon.a (mon.0) 362 : audit [DBG] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T05:35:15.840 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:35:15 smithi047 bash[22744]: audit 2024-09-16T05:35:15.171482+0000 mon.a (mon.0) 363 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T05:35:15.840 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:35:15 smithi047 bash[22744]: audit 2024-09-16T05:35:15.180192+0000 mon.a (mon.0) 364 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:35:17.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:35:17 smithi157 bash[24585]: cluster 2024-09-16T05:35:15.483736+0000 mgr.a (mgr.14150) 151 : cluster [DBG] pgmap v103: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-16T05:35:17.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:35:17 smithi086 bash[24289]: cluster 2024-09-16T05:35:15.483736+0000 mgr.a (mgr.14150) 151 : cluster [DBG] pgmap v103: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-16T05:35:17.590 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:35:17 smithi047 bash[22744]: cluster 2024-09-16T05:35:15.483736+0000 mgr.a (mgr.14150) 151 : cluster [DBG] pgmap v103: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-16T05:35:18.847 INFO:teuthology.orchestra.run.smithi086.stdout:Created osd(s) 1 on host 'smithi086' 2024-09-16T05:35:19.432 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:35:19 smithi086 bash[24289]: cluster 2024-09-16T05:35:17.484176+0000 mgr.a (mgr.14150) 152 : cluster [DBG] pgmap v104: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-16T05:35:19.432 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:35:19 smithi086 bash[24289]: audit 2024-09-16T05:35:18.827933+0000 mon.a (mon.0) 365 : audit [DBG] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T05:35:19.432 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:35:19 smithi086 bash[24289]: audit 2024-09-16T05:35:18.834626+0000 mon.a (mon.0) 366 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:35:19.432 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:35:19 smithi086 bash[24289]: audit 2024-09-16T05:35:18.841951+0000 mon.b (mon.2) 9 : audit [INF] from='osd.1 [v2:172.21.15.86:6800/263439805,v1:172.21.15.86:6801/263439805]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-16T05:35:19.432 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:35:19 smithi086 bash[24289]: audit 2024-09-16T05:35:18.842493+0000 mon.a (mon.0) 367 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:35:19.433 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:35:19 smithi086 bash[24289]: audit 2024-09-16T05:35:18.844695+0000 mon.a (mon.0) 368 : audit [INF] from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-16T05:35:19.434 DEBUG:teuthology.orchestra.run.smithi086:osd.1> sudo journalctl -f -n 0 -u ceph-a6097908-73ec-11ef-bceb-c7b262605968@osd.1.service 2024-09-16T05:35:19.436 INFO:tasks.cephadm:Deploying osd.2 on smithi157 with /dev/vg_nvme/lv_4... 2024-09-16T05:35:19.437 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a6097908-73ec-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-16T05:35:19.448 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:35:19 smithi157 bash[24585]: cluster 2024-09-16T05:35:17.484176+0000 mgr.a (mgr.14150) 152 : cluster [DBG] pgmap v104: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-16T05:35:19.448 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:35:19 smithi157 bash[24585]: audit 2024-09-16T05:35:18.827933+0000 mon.a (mon.0) 365 : audit [DBG] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T05:35:19.448 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:35:19 smithi157 bash[24585]: audit 2024-09-16T05:35:18.834626+0000 mon.a (mon.0) 366 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:35:19.448 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:35:19 smithi157 bash[24585]: audit 2024-09-16T05:35:18.841951+0000 mon.b (mon.2) 9 : audit [INF] from='osd.1 [v2:172.21.15.86:6800/263439805,v1:172.21.15.86:6801/263439805]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-16T05:35:19.448 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:35:19 smithi157 bash[24585]: audit 2024-09-16T05:35:18.842493+0000 mon.a (mon.0) 367 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:35:19.448 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:35:19 smithi157 bash[24585]: audit 2024-09-16T05:35:18.844695+0000 mon.a (mon.0) 368 : audit [INF] from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-16T05:35:19.591 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:35:19 smithi047 bash[22744]: cluster 2024-09-16T05:35:17.484176+0000 mgr.a (mgr.14150) 152 : cluster [DBG] pgmap v104: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-16T05:35:19.591 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:35:19 smithi047 bash[22744]: audit 2024-09-16T05:35:18.827933+0000 mon.a (mon.0) 365 : audit [DBG] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T05:35:19.591 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:35:19 smithi047 bash[22744]: audit 2024-09-16T05:35:18.834626+0000 mon.a (mon.0) 366 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:35:19.591 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:35:19 smithi047 bash[22744]: audit 2024-09-16T05:35:18.841951+0000 mon.b (mon.2) 9 : audit [INF] from='osd.1 [v2:172.21.15.86:6800/263439805,v1:172.21.15.86:6801/263439805]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-16T05:35:19.591 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:35:19 smithi047 bash[22744]: audit 2024-09-16T05:35:18.842493+0000 mon.a (mon.0) 367 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:35:19.591 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:35:19 smithi047 bash[22744]: audit 2024-09-16T05:35:18.844695+0000 mon.a (mon.0) 368 : audit [INF] from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-16T05:35:21.305 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:35:20 smithi157 bash[24585]: cluster 2024-09-16T05:35:19.484607+0000 mgr.a (mgr.14150) 153 : cluster [DBG] pgmap v105: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-16T05:35:21.305 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:35:20 smithi157 bash[24585]: audit 2024-09-16T05:35:19.841361+0000 mon.a (mon.0) 369 : audit [INF] from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-16T05:35:21.305 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:35:20 smithi157 bash[24585]: audit 2024-09-16T05:35:19.845336+0000 mon.b (mon.2) 10 : audit [INF] from='osd.1 [v2:172.21.15.86:6800/263439805,v1:172.21.15.86:6801/263439805]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi086", "root=default"]}]: dispatch 2024-09-16T05:35:21.305 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:35:20 smithi157 bash[24585]: cluster 2024-09-16T05:35:19.846691+0000 mon.a (mon.0) 370 : cluster [DBG] osdmap e11: 2 total, 1 up, 2 in 2024-09-16T05:35:21.305 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:35:20 smithi157 bash[24585]: audit 2024-09-16T05:35:19.847307+0000 mon.a (mon.0) 371 : audit [DBG] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-16T05:35:21.305 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:35:20 smithi157 bash[24585]: audit 2024-09-16T05:35:19.847993+0000 mon.a (mon.0) 372 : audit [INF] from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi086", "root=default"]}]: dispatch 2024-09-16T05:35:21.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:35:20 smithi086 bash[24289]: cluster 2024-09-16T05:35:19.484607+0000 mgr.a (mgr.14150) 153 : cluster [DBG] pgmap v105: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-16T05:35:21.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:35:20 smithi086 bash[24289]: audit 2024-09-16T05:35:19.841361+0000 mon.a (mon.0) 369 : audit [INF] from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-16T05:35:21.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:35:20 smithi086 bash[24289]: audit 2024-09-16T05:35:19.845336+0000 mon.b (mon.2) 10 : audit [INF] from='osd.1 [v2:172.21.15.86:6800/263439805,v1:172.21.15.86:6801/263439805]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi086", "root=default"]}]: dispatch 2024-09-16T05:35:21.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:35:20 smithi086 bash[24289]: cluster 2024-09-16T05:35:19.846691+0000 mon.a (mon.0) 370 : cluster [DBG] osdmap e11: 2 total, 1 up, 2 in 2024-09-16T05:35:21.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:35:20 smithi086 bash[24289]: audit 2024-09-16T05:35:19.847307+0000 mon.a (mon.0) 371 : audit [DBG] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-16T05:35:21.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:35:20 smithi086 bash[24289]: audit 2024-09-16T05:35:19.847993+0000 mon.a (mon.0) 372 : audit [INF] from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi086", "root=default"]}]: dispatch 2024-09-16T05:35:21.340 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:35:20 smithi047 bash[22744]: cluster 2024-09-16T05:35:19.484607+0000 mgr.a (mgr.14150) 153 : cluster [DBG] pgmap v105: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-16T05:35:21.340 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:35:20 smithi047 bash[22744]: audit 2024-09-16T05:35:19.841361+0000 mon.a (mon.0) 369 : audit [INF] from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-16T05:35:21.341 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:35:20 smithi047 bash[22744]: audit 2024-09-16T05:35:19.845336+0000 mon.b (mon.2) 10 : audit [INF] from='osd.1 [v2:172.21.15.86:6800/263439805,v1:172.21.15.86:6801/263439805]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi086", "root=default"]}]: dispatch 2024-09-16T05:35:21.341 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:35:20 smithi047 bash[22744]: cluster 2024-09-16T05:35:19.846691+0000 mon.a (mon.0) 370 : cluster [DBG] osdmap e11: 2 total, 1 up, 2 in 2024-09-16T05:35:21.341 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:35:20 smithi047 bash[22744]: audit 2024-09-16T05:35:19.847307+0000 mon.a (mon.0) 371 : audit [DBG] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-16T05:35:21.341 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:35:20 smithi047 bash[22744]: audit 2024-09-16T05:35:19.847993+0000 mon.a (mon.0) 372 : audit [INF] from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi086", "root=default"]}]: dispatch 2024-09-16T05:35:21.820 INFO:journalctl@ceph.osd.1.smithi086.stdout:Sep 16 05:35:21 smithi086 bash[27275]: debug 2024-09-16T05:35:21.367+0000 7f8614d04640 -1 osd.1 0 waiting for initial osdmap 2024-09-16T05:35:21.821 INFO:journalctl@ceph.osd.1.smithi086.stdout:Sep 16 05:35:21 smithi086 bash[27275]: debug 2024-09-16T05:35:21.399+0000 7f860cb24640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-16T05:35:22.305 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:35:21 smithi157 bash[24585]: cluster 2024-09-16T05:35:19.827903+0000 osd.1 (osd.1) 1 : cluster [DBG] purged_snaps scrub starts 2024-09-16T05:35:22.305 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:35:21 smithi157 bash[24585]: cluster 2024-09-16T05:35:19.827997+0000 osd.1 (osd.1) 2 : cluster [DBG] purged_snaps scrub ok 2024-09-16T05:35:22.305 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:35:21 smithi157 bash[24585]: audit 2024-09-16T05:35:20.843609+0000 mon.a (mon.0) 373 : audit [INF] from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi086", "root=default"]}]': finished 2024-09-16T05:35:22.305 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:35:21 smithi157 bash[24585]: cluster 2024-09-16T05:35:20.848683+0000 mon.a (mon.0) 374 : cluster [DBG] osdmap e12: 2 total, 1 up, 2 in 2024-09-16T05:35:22.305 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:35:21 smithi157 bash[24585]: audit 2024-09-16T05:35:20.849599+0000 mon.a (mon.0) 375 : audit [DBG] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-16T05:35:22.305 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:35:21 smithi157 bash[24585]: audit 2024-09-16T05:35:20.857248+0000 mon.a (mon.0) 376 : audit [DBG] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-16T05:35:22.305 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:35:21 smithi157 bash[24585]: audit 2024-09-16T05:35:21.382667+0000 mon.a (mon.0) 377 : audit [INF] from='osd.1 ' entity='osd.1' 2024-09-16T05:35:22.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:35:21 smithi086 bash[24289]: cluster 2024-09-16T05:35:19.827903+0000 osd.1 (osd.1) 1 : cluster [DBG] purged_snaps scrub starts 2024-09-16T05:35:22.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:35:21 smithi086 bash[24289]: cluster 2024-09-16T05:35:19.827997+0000 osd.1 (osd.1) 2 : cluster [DBG] purged_snaps scrub ok 2024-09-16T05:35:22.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:35:21 smithi086 bash[24289]: audit 2024-09-16T05:35:20.843609+0000 mon.a (mon.0) 373 : audit [INF] from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi086", "root=default"]}]': finished 2024-09-16T05:35:22.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:35:21 smithi086 bash[24289]: cluster 2024-09-16T05:35:20.848683+0000 mon.a (mon.0) 374 : cluster [DBG] osdmap e12: 2 total, 1 up, 2 in 2024-09-16T05:35:22.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:35:21 smithi086 bash[24289]: audit 2024-09-16T05:35:20.849599+0000 mon.a (mon.0) 375 : audit [DBG] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-16T05:35:22.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:35:21 smithi086 bash[24289]: audit 2024-09-16T05:35:20.857248+0000 mon.a (mon.0) 376 : audit [DBG] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-16T05:35:22.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:35:21 smithi086 bash[24289]: audit 2024-09-16T05:35:21.382667+0000 mon.a (mon.0) 377 : audit [INF] from='osd.1 ' entity='osd.1' 2024-09-16T05:35:22.340 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:35:21 smithi047 bash[22744]: cluster 2024-09-16T05:35:19.827903+0000 osd.1 (osd.1) 1 : cluster [DBG] purged_snaps scrub starts 2024-09-16T05:35:22.341 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:35:21 smithi047 bash[22744]: cluster 2024-09-16T05:35:19.827997+0000 osd.1 (osd.1) 2 : cluster [DBG] purged_snaps scrub ok 2024-09-16T05:35:22.341 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:35:21 smithi047 bash[22744]: audit 2024-09-16T05:35:20.843609+0000 mon.a (mon.0) 373 : audit [INF] from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi086", "root=default"]}]': finished 2024-09-16T05:35:22.341 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:35:21 smithi047 bash[22744]: cluster 2024-09-16T05:35:20.848683+0000 mon.a (mon.0) 374 : cluster [DBG] osdmap e12: 2 total, 1 up, 2 in 2024-09-16T05:35:22.341 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:35:21 smithi047 bash[22744]: audit 2024-09-16T05:35:20.849599+0000 mon.a (mon.0) 375 : audit [DBG] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-16T05:35:22.341 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:35:21 smithi047 bash[22744]: audit 2024-09-16T05:35:20.857248+0000 mon.a (mon.0) 376 : audit [DBG] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-16T05:35:22.341 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:35:21 smithi047 bash[22744]: audit 2024-09-16T05:35:21.382667+0000 mon.a (mon.0) 377 : audit [INF] from='osd.1 ' entity='osd.1' 2024-09-16T05:35:23.153 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /var/lib/ceph/a6097908-73ec-11ef-bceb-c7b262605968/mon.c/config 2024-09-16T05:35:23.305 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:35:22 smithi157 bash[24585]: cluster 2024-09-16T05:35:21.485048+0000 mgr.a (mgr.14150) 154 : cluster [DBG] pgmap v108: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-16T05:35:23.305 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:35:22 smithi157 bash[24585]: audit 2024-09-16T05:35:21.859708+0000 mon.a (mon.0) 378 : audit [DBG] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-16T05:35:23.305 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:35:22 smithi157 bash[24585]: cluster 2024-09-16T05:35:22.386270+0000 mon.a (mon.0) 379 : cluster [INF] osd.1 [v2:172.21.15.86:6800/263439805,v1:172.21.15.86:6801/263439805] boot 2024-09-16T05:35:23.305 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:35:22 smithi157 bash[24585]: cluster 2024-09-16T05:35:22.386438+0000 mon.a (mon.0) 380 : cluster [DBG] osdmap e13: 2 total, 2 up, 2 in 2024-09-16T05:35:23.305 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:35:22 smithi157 bash[24585]: audit 2024-09-16T05:35:22.387126+0000 mon.a (mon.0) 381 : audit [DBG] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-16T05:35:23.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:35:22 smithi086 bash[24289]: cluster 2024-09-16T05:35:21.485048+0000 mgr.a (mgr.14150) 154 : cluster [DBG] pgmap v108: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-16T05:35:23.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:35:22 smithi086 bash[24289]: audit 2024-09-16T05:35:21.859708+0000 mon.a (mon.0) 378 : audit [DBG] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-16T05:35:23.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:35:22 smithi086 bash[24289]: cluster 2024-09-16T05:35:22.386270+0000 mon.a (mon.0) 379 : cluster [INF] osd.1 [v2:172.21.15.86:6800/263439805,v1:172.21.15.86:6801/263439805] boot 2024-09-16T05:35:23.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:35:22 smithi086 bash[24289]: cluster 2024-09-16T05:35:22.386438+0000 mon.a (mon.0) 380 : cluster [DBG] osdmap e13: 2 total, 2 up, 2 in 2024-09-16T05:35:23.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:35:22 smithi086 bash[24289]: audit 2024-09-16T05:35:22.387126+0000 mon.a (mon.0) 381 : audit [DBG] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-16T05:35:23.341 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:35:22 smithi047 bash[22744]: cluster 2024-09-16T05:35:21.485048+0000 mgr.a (mgr.14150) 154 : cluster [DBG] pgmap v108: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-16T05:35:23.341 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:35:22 smithi047 bash[22744]: audit 2024-09-16T05:35:21.859708+0000 mon.a (mon.0) 378 : audit [DBG] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-16T05:35:23.341 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:35:22 smithi047 bash[22744]: cluster 2024-09-16T05:35:22.386270+0000 mon.a (mon.0) 379 : cluster [INF] osd.1 [v2:172.21.15.86:6800/263439805,v1:172.21.15.86:6801/263439805] boot 2024-09-16T05:35:23.341 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:35:22 smithi047 bash[22744]: cluster 2024-09-16T05:35:22.386438+0000 mon.a (mon.0) 380 : cluster [DBG] osdmap e13: 2 total, 2 up, 2 in 2024-09-16T05:35:23.341 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:35:22 smithi047 bash[22744]: audit 2024-09-16T05:35:22.387126+0000 mon.a (mon.0) 381 : audit [DBG] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-16T05:35:25.268 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:35:24 smithi086 bash[24289]: cluster 2024-09-16T05:35:23.485544+0000 mgr.a (mgr.14150) 155 : cluster [DBG] pgmap v110: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-16T05:35:25.268 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:35:24 smithi086 bash[24289]: cluster 2024-09-16T05:35:23.866886+0000 mon.a (mon.0) 382 : cluster [DBG] osdmap e14: 2 total, 2 up, 2 in 2024-09-16T05:35:25.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:35:24 smithi157 bash[24585]: cluster 2024-09-16T05:35:23.485544+0000 mgr.a (mgr.14150) 155 : cluster [DBG] pgmap v110: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-16T05:35:25.305 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:35:24 smithi157 bash[24585]: cluster 2024-09-16T05:35:23.866886+0000 mon.a (mon.0) 382 : cluster [DBG] osdmap e14: 2 total, 2 up, 2 in 2024-09-16T05:35:25.340 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:35:24 smithi047 bash[22744]: cluster 2024-09-16T05:35:23.485544+0000 mgr.a (mgr.14150) 155 : cluster [DBG] pgmap v110: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-16T05:35:25.341 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:35:24 smithi047 bash[22744]: cluster 2024-09-16T05:35:23.866886+0000 mon.a (mon.0) 382 : cluster [DBG] osdmap e14: 2 total, 2 up, 2 in 2024-09-16T05:35:26.957 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-16T05:35:27.003 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a6097908-73ec-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi157:vg_nvme/lv_4 2024-09-16T05:35:27.305 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:35:26 smithi157 bash[24585]: cluster 2024-09-16T05:35:25.486001+0000 mgr.a (mgr.14150) 156 : cluster [DBG] pgmap v112: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-16T05:35:27.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:35:26 smithi086 bash[24289]: cluster 2024-09-16T05:35:25.486001+0000 mgr.a (mgr.14150) 156 : cluster [DBG] pgmap v112: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-16T05:35:27.340 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:35:26 smithi047 bash[22744]: cluster 2024-09-16T05:35:25.486001+0000 mgr.a (mgr.14150) 156 : cluster [DBG] pgmap v112: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-16T05:35:29.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:35:29 smithi157 bash[24585]: cluster 2024-09-16T05:35:27.486518+0000 mgr.a (mgr.14150) 157 : cluster [DBG] pgmap v113: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-16T05:35:29.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:35:29 smithi157 bash[24585]: cephadm 2024-09-16T05:35:28.414231+0000 mgr.a (mgr.14150) 158 : cephadm [INF] Detected new or changed devices on smithi086 2024-09-16T05:35:29.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:35:29 smithi157 bash[24585]: audit 2024-09-16T05:35:28.422575+0000 mon.a (mon.0) 383 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:35:29.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:35:29 smithi157 bash[24585]: audit 2024-09-16T05:35:28.430294+0000 mon.a (mon.0) 384 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:35:29.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:35:29 smithi157 bash[24585]: audit 2024-09-16T05:35:28.432922+0000 mon.a (mon.0) 385 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-16T05:35:29.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:35:29 smithi157 bash[24585]: audit 2024-09-16T05:35:28.440728+0000 mon.a (mon.0) 386 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:35:29.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:35:29 smithi157 bash[24585]: audit 2024-09-16T05:35:28.445074+0000 mon.a (mon.0) 387 : audit [DBG] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T05:35:29.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:35:29 smithi157 bash[24585]: audit 2024-09-16T05:35:28.446946+0000 mon.a (mon.0) 388 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T05:35:29.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:35:29 smithi157 bash[24585]: audit 2024-09-16T05:35:28.456446+0000 mon.a (mon.0) 389 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:35:29.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:35:29 smithi086 bash[24289]: cluster 2024-09-16T05:35:27.486518+0000 mgr.a (mgr.14150) 157 : cluster [DBG] pgmap v113: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-16T05:35:29.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:35:29 smithi086 bash[24289]: cephadm 2024-09-16T05:35:28.414231+0000 mgr.a (mgr.14150) 158 : cephadm [INF] Detected new or changed devices on smithi086 2024-09-16T05:35:29.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:35:29 smithi086 bash[24289]: audit 2024-09-16T05:35:28.422575+0000 mon.a (mon.0) 383 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:35:29.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:35:29 smithi086 bash[24289]: audit 2024-09-16T05:35:28.430294+0000 mon.a (mon.0) 384 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:35:29.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:35:29 smithi086 bash[24289]: audit 2024-09-16T05:35:28.432922+0000 mon.a (mon.0) 385 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-16T05:35:29.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:35:29 smithi086 bash[24289]: audit 2024-09-16T05:35:28.440728+0000 mon.a (mon.0) 386 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:35:29.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:35:29 smithi086 bash[24289]: audit 2024-09-16T05:35:28.445074+0000 mon.a (mon.0) 387 : audit [DBG] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T05:35:29.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:35:29 smithi086 bash[24289]: audit 2024-09-16T05:35:28.446946+0000 mon.a (mon.0) 388 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T05:35:29.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:35:29 smithi086 bash[24289]: audit 2024-09-16T05:35:28.456446+0000 mon.a (mon.0) 389 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:35:29.840 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:35:29 smithi047 bash[22744]: cluster 2024-09-16T05:35:27.486518+0000 mgr.a (mgr.14150) 157 : cluster [DBG] pgmap v113: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-16T05:35:29.841 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:35:29 smithi047 bash[22744]: cephadm 2024-09-16T05:35:28.414231+0000 mgr.a (mgr.14150) 158 : cephadm [INF] Detected new or changed devices on smithi086 2024-09-16T05:35:29.841 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:35:29 smithi047 bash[22744]: audit 2024-09-16T05:35:28.422575+0000 mon.a (mon.0) 383 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:35:29.841 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:35:29 smithi047 bash[22744]: audit 2024-09-16T05:35:28.430294+0000 mon.a (mon.0) 384 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:35:29.841 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:35:29 smithi047 bash[22744]: audit 2024-09-16T05:35:28.432922+0000 mon.a (mon.0) 385 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-16T05:35:29.841 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:35:29 smithi047 bash[22744]: audit 2024-09-16T05:35:28.440728+0000 mon.a (mon.0) 386 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:35:29.841 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:35:29 smithi047 bash[22744]: audit 2024-09-16T05:35:28.445074+0000 mon.a (mon.0) 387 : audit [DBG] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T05:35:29.841 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:35:29 smithi047 bash[22744]: audit 2024-09-16T05:35:28.446946+0000 mon.a (mon.0) 388 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T05:35:29.841 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:35:29 smithi047 bash[22744]: audit 2024-09-16T05:35:28.456446+0000 mon.a (mon.0) 389 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:35:30.762 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /var/lib/ceph/a6097908-73ec-11ef-bceb-c7b262605968/mon.c/config 2024-09-16T05:35:30.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:35:30 smithi157 bash[24585]: cephadm 2024-09-16T05:35:28.434386+0000 mgr.a (mgr.14150) 159 : cephadm [INF] Adjusting osd_memory_target on smithi086 to 17265M 2024-09-16T05:35:30.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:35:30 smithi086 bash[24289]: cephadm 2024-09-16T05:35:28.434386+0000 mgr.a (mgr.14150) 159 : cephadm [INF] Adjusting osd_memory_target on smithi086 to 17265M 2024-09-16T05:35:30.840 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:35:30 smithi047 bash[22744]: cephadm 2024-09-16T05:35:28.434386+0000 mgr.a (mgr.14150) 159 : cephadm [INF] Adjusting osd_memory_target on smithi086 to 17265M 2024-09-16T05:35:31.746 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:35:31 smithi157 bash[24585]: cluster 2024-09-16T05:35:29.486948+0000 mgr.a (mgr.14150) 160 : cluster [DBG] pgmap v114: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-16T05:35:31.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:35:31 smithi086 bash[24289]: cluster 2024-09-16T05:35:29.486948+0000 mgr.a (mgr.14150) 160 : cluster [DBG] pgmap v114: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-16T05:35:31.840 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:35:31 smithi047 bash[22744]: cluster 2024-09-16T05:35:29.486948+0000 mgr.a (mgr.14150) 160 : cluster [DBG] pgmap v114: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-16T05:35:32.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:35:32 smithi157 bash[24585]: cluster 2024-09-16T05:35:31.487438+0000 mgr.a (mgr.14150) 161 : cluster [DBG] pgmap v115: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-16T05:35:32.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:35:32 smithi157 bash[24585]: audit 2024-09-16T05:35:32.079884+0000 mgr.a (mgr.14150) 162 : audit [DBG] from='client.24145 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi157:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:35:32.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:35:32 smithi157 bash[24585]: audit 2024-09-16T05:35:32.086739+0000 mon.a (mon.0) 390 : audit [DBG] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-16T05:35:32.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:35:32 smithi157 bash[24585]: audit 2024-09-16T05:35:32.093404+0000 mon.a (mon.0) 391 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-16T05:35:32.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:35:32 smithi157 bash[24585]: audit 2024-09-16T05:35:32.095203+0000 mon.a (mon.0) 392 : audit [DBG] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T05:35:32.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:35:32 smithi086 bash[24289]: cluster 2024-09-16T05:35:31.487438+0000 mgr.a (mgr.14150) 161 : cluster [DBG] pgmap v115: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-16T05:35:32.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:35:32 smithi086 bash[24289]: audit 2024-09-16T05:35:32.079884+0000 mgr.a (mgr.14150) 162 : audit [DBG] from='client.24145 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi157:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:35:32.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:35:32 smithi086 bash[24289]: audit 2024-09-16T05:35:32.086739+0000 mon.a (mon.0) 390 : audit [DBG] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-16T05:35:32.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:35:32 smithi086 bash[24289]: audit 2024-09-16T05:35:32.093404+0000 mon.a (mon.0) 391 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-16T05:35:32.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:35:32 smithi086 bash[24289]: audit 2024-09-16T05:35:32.095203+0000 mon.a (mon.0) 392 : audit [DBG] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T05:35:32.840 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:35:32 smithi047 bash[22744]: cluster 2024-09-16T05:35:31.487438+0000 mgr.a (mgr.14150) 161 : cluster [DBG] pgmap v115: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-16T05:35:32.840 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:35:32 smithi047 bash[22744]: audit 2024-09-16T05:35:32.079884+0000 mgr.a (mgr.14150) 162 : audit [DBG] from='client.24145 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi157:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:35:32.841 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:35:32 smithi047 bash[22744]: audit 2024-09-16T05:35:32.086739+0000 mon.a (mon.0) 390 : audit [DBG] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-16T05:35:32.841 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:35:32 smithi047 bash[22744]: audit 2024-09-16T05:35:32.093404+0000 mon.a (mon.0) 391 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-16T05:35:32.841 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:35:32 smithi047 bash[22744]: audit 2024-09-16T05:35:32.095203+0000 mon.a (mon.0) 392 : audit [DBG] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T05:35:34.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:35:34 smithi157 bash[24585]: cluster 2024-09-16T05:35:33.487896+0000 mgr.a (mgr.14150) 163 : cluster [DBG] pgmap v116: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-16T05:35:34.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:35:34 smithi086 bash[24289]: cluster 2024-09-16T05:35:33.487896+0000 mgr.a (mgr.14150) 163 : cluster [DBG] pgmap v116: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-16T05:35:34.840 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:35:34 smithi047 bash[22744]: cluster 2024-09-16T05:35:33.487896+0000 mgr.a (mgr.14150) 163 : cluster [DBG] pgmap v116: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-16T05:35:36.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:35:36 smithi157 bash[24585]: cluster 2024-09-16T05:35:35.488352+0000 mgr.a (mgr.14150) 164 : cluster [DBG] pgmap v117: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-16T05:35:36.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:35:36 smithi086 bash[24289]: cluster 2024-09-16T05:35:35.488352+0000 mgr.a (mgr.14150) 164 : cluster [DBG] pgmap v117: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-16T05:35:36.840 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:35:36 smithi047 bash[22744]: cluster 2024-09-16T05:35:35.488352+0000 mgr.a (mgr.14150) 164 : cluster [DBG] pgmap v117: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-16T05:35:38.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:35:38 smithi157 bash[24585]: cluster 2024-09-16T05:35:37.488817+0000 mgr.a (mgr.14150) 165 : cluster [DBG] pgmap v118: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-16T05:35:38.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:35:38 smithi086 bash[24289]: cluster 2024-09-16T05:35:37.488817+0000 mgr.a (mgr.14150) 165 : cluster [DBG] pgmap v118: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-16T05:35:38.840 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:35:38 smithi047 bash[22744]: cluster 2024-09-16T05:35:37.488817+0000 mgr.a (mgr.14150) 165 : cluster [DBG] pgmap v118: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-16T05:35:40.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:35:40 smithi086 bash[24289]: cluster 2024-09-16T05:35:39.489297+0000 mgr.a (mgr.14150) 166 : cluster [DBG] pgmap v119: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-16T05:35:40.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:35:40 smithi086 bash[24289]: audit 2024-09-16T05:35:40.533802+0000 mon.c (mon.1) 4 : audit [INF] from='client.? 172.21.15.157:0/3127023448' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c7c829b2-ed90-4d89-b1a9-5fa8df57409c"}]: dispatch 2024-09-16T05:35:40.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:35:40 smithi086 bash[24289]: audit 2024-09-16T05:35:40.534550+0000 mon.a (mon.0) 393 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c7c829b2-ed90-4d89-b1a9-5fa8df57409c"}]: dispatch 2024-09-16T05:35:40.822 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:35:40 smithi086 bash[24289]: audit 2024-09-16T05:35:40.537805+0000 mon.a (mon.0) 394 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c7c829b2-ed90-4d89-b1a9-5fa8df57409c"}]': finished 2024-09-16T05:35:40.822 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:35:40 smithi086 bash[24289]: cluster 2024-09-16T05:35:40.542922+0000 mon.a (mon.0) 395 : cluster [DBG] osdmap e15: 3 total, 2 up, 3 in 2024-09-16T05:35:40.822 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:35:40 smithi086 bash[24289]: audit 2024-09-16T05:35:40.543540+0000 mon.a (mon.0) 396 : audit [DBG] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-16T05:35:40.841 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:35:40 smithi047 bash[22744]: cluster 2024-09-16T05:35:39.489297+0000 mgr.a (mgr.14150) 166 : cluster [DBG] pgmap v119: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-16T05:35:40.841 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:35:40 smithi047 bash[22744]: audit 2024-09-16T05:35:40.533802+0000 mon.c (mon.1) 4 : audit [INF] from='client.? 172.21.15.157:0/3127023448' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c7c829b2-ed90-4d89-b1a9-5fa8df57409c"}]: dispatch 2024-09-16T05:35:40.841 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:35:40 smithi047 bash[22744]: audit 2024-09-16T05:35:40.534550+0000 mon.a (mon.0) 393 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c7c829b2-ed90-4d89-b1a9-5fa8df57409c"}]: dispatch 2024-09-16T05:35:40.841 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:35:40 smithi047 bash[22744]: audit 2024-09-16T05:35:40.537805+0000 mon.a (mon.0) 394 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c7c829b2-ed90-4d89-b1a9-5fa8df57409c"}]': finished 2024-09-16T05:35:40.841 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:35:40 smithi047 bash[22744]: cluster 2024-09-16T05:35:40.542922+0000 mon.a (mon.0) 395 : cluster [DBG] osdmap e15: 3 total, 2 up, 3 in 2024-09-16T05:35:40.841 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:35:40 smithi047 bash[22744]: audit 2024-09-16T05:35:40.543540+0000 mon.a (mon.0) 396 : audit [DBG] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-16T05:35:41.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:35:40 smithi157 bash[24585]: cluster 2024-09-16T05:35:39.489297+0000 mgr.a (mgr.14150) 166 : cluster [DBG] pgmap v119: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-16T05:35:41.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:35:40 smithi157 bash[24585]: audit 2024-09-16T05:35:40.533802+0000 mon.c (mon.1) 4 : audit [INF] from='client.? 172.21.15.157:0/3127023448' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c7c829b2-ed90-4d89-b1a9-5fa8df57409c"}]: dispatch 2024-09-16T05:35:41.055 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:35:40 smithi157 bash[24585]: audit 2024-09-16T05:35:40.534550+0000 mon.a (mon.0) 393 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c7c829b2-ed90-4d89-b1a9-5fa8df57409c"}]: dispatch 2024-09-16T05:35:41.055 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:35:40 smithi157 bash[24585]: audit 2024-09-16T05:35:40.537805+0000 mon.a (mon.0) 394 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c7c829b2-ed90-4d89-b1a9-5fa8df57409c"}]': finished 2024-09-16T05:35:41.055 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:35:40 smithi157 bash[24585]: cluster 2024-09-16T05:35:40.542922+0000 mon.a (mon.0) 395 : cluster [DBG] osdmap e15: 3 total, 2 up, 3 in 2024-09-16T05:35:41.055 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:35:40 smithi157 bash[24585]: audit 2024-09-16T05:35:40.543540+0000 mon.a (mon.0) 396 : audit [DBG] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-16T05:35:41.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:35:41 smithi086 bash[24289]: audit 2024-09-16T05:35:41.173979+0000 mon.c (mon.1) 5 : audit [DBG] from='client.? 172.21.15.157:0/1437600391' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-16T05:35:41.840 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:35:41 smithi047 bash[22744]: audit 2024-09-16T05:35:41.173979+0000 mon.c (mon.1) 5 : audit [DBG] from='client.? 172.21.15.157:0/1437600391' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-16T05:35:42.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:35:41 smithi157 bash[24585]: audit 2024-09-16T05:35:41.173979+0000 mon.c (mon.1) 5 : audit [DBG] from='client.? 172.21.15.157:0/1437600391' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-16T05:35:42.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:35:42 smithi086 bash[24289]: cluster 2024-09-16T05:35:41.489796+0000 mgr.a (mgr.14150) 167 : cluster [DBG] pgmap v121: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-16T05:35:42.840 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:35:42 smithi047 bash[22744]: cluster 2024-09-16T05:35:41.489796+0000 mgr.a (mgr.14150) 167 : cluster [DBG] pgmap v121: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-16T05:35:43.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:35:42 smithi157 bash[24585]: cluster 2024-09-16T05:35:41.489796+0000 mgr.a (mgr.14150) 167 : cluster [DBG] pgmap v121: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-16T05:35:44.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:35:44 smithi157 bash[24585]: cluster 2024-09-16T05:35:43.490288+0000 mgr.a (mgr.14150) 168 : cluster [DBG] pgmap v122: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-16T05:35:44.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:35:44 smithi086 bash[24289]: cluster 2024-09-16T05:35:43.490288+0000 mgr.a (mgr.14150) 168 : cluster [DBG] pgmap v122: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-16T05:35:44.840 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:35:44 smithi047 bash[22744]: cluster 2024-09-16T05:35:43.490288+0000 mgr.a (mgr.14150) 168 : cluster [DBG] pgmap v122: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-16T05:35:46.840 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:35:46 smithi047 bash[22744]: cluster 2024-09-16T05:35:45.490755+0000 mgr.a (mgr.14150) 169 : cluster [DBG] pgmap v123: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-16T05:35:47.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:35:46 smithi157 bash[24585]: cluster 2024-09-16T05:35:45.490755+0000 mgr.a (mgr.14150) 169 : cluster [DBG] pgmap v123: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-16T05:35:47.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:35:46 smithi086 bash[24289]: cluster 2024-09-16T05:35:45.490755+0000 mgr.a (mgr.14150) 169 : cluster [DBG] pgmap v123: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-16T05:35:48.841 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:35:48 smithi047 bash[22744]: cluster 2024-09-16T05:35:47.491222+0000 mgr.a (mgr.14150) 170 : cluster [DBG] pgmap v124: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-16T05:35:49.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:35:48 smithi157 bash[24585]: cluster 2024-09-16T05:35:47.491222+0000 mgr.a (mgr.14150) 170 : cluster [DBG] pgmap v124: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-16T05:35:49.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:35:48 smithi086 bash[24289]: cluster 2024-09-16T05:35:47.491222+0000 mgr.a (mgr.14150) 170 : cluster [DBG] pgmap v124: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-16T05:35:50.841 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:35:50 smithi047 bash[22744]: cluster 2024-09-16T05:35:49.491670+0000 mgr.a (mgr.14150) 171 : cluster [DBG] pgmap v125: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-16T05:35:50.980 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:35:50 smithi157 bash[24585]: cluster 2024-09-16T05:35:49.491670+0000 mgr.a (mgr.14150) 171 : cluster [DBG] pgmap v125: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-16T05:35:51.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:35:50 smithi086 bash[24289]: cluster 2024-09-16T05:35:49.491670+0000 mgr.a (mgr.14150) 171 : cluster [DBG] pgmap v125: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-16T05:35:52.841 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:35:52 smithi047 bash[22744]: cluster 2024-09-16T05:35:51.492153+0000 mgr.a (mgr.14150) 172 : cluster [DBG] pgmap v126: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-16T05:35:53.001 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:35:52 smithi157 bash[24585]: cluster 2024-09-16T05:35:51.492153+0000 mgr.a (mgr.14150) 172 : cluster [DBG] pgmap v126: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-16T05:35:53.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:35:52 smithi086 bash[24289]: cluster 2024-09-16T05:35:51.492153+0000 mgr.a (mgr.14150) 172 : cluster [DBG] pgmap v126: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-16T05:35:54.841 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:35:54 smithi047 bash[22744]: cluster 2024-09-16T05:35:53.492643+0000 mgr.a (mgr.14150) 173 : cluster [DBG] pgmap v127: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-16T05:35:54.841 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:35:54 smithi047 bash[22744]: audit 2024-09-16T05:35:53.622385+0000 mon.a (mon.0) 397 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-16T05:35:54.841 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:35:54 smithi047 bash[22744]: audit 2024-09-16T05:35:53.624545+0000 mon.a (mon.0) 398 : audit [DBG] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T05:35:54.841 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:35:54 smithi047 bash[22744]: cephadm 2024-09-16T05:35:53.626234+0000 mgr.a (mgr.14150) 174 : cephadm [INF] Deploying daemon osd.2 on smithi157 2024-09-16T05:35:55.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:35:54 smithi157 bash[24585]: cluster 2024-09-16T05:35:53.492643+0000 mgr.a (mgr.14150) 173 : cluster [DBG] pgmap v127: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-16T05:35:55.055 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:35:54 smithi157 bash[24585]: audit 2024-09-16T05:35:53.622385+0000 mon.a (mon.0) 397 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-16T05:35:55.055 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:35:54 smithi157 bash[24585]: audit 2024-09-16T05:35:53.624545+0000 mon.a (mon.0) 398 : audit [DBG] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T05:35:55.055 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:35:54 smithi157 bash[24585]: cephadm 2024-09-16T05:35:53.626234+0000 mgr.a (mgr.14150) 174 : cephadm [INF] Deploying daemon osd.2 on smithi157 2024-09-16T05:35:55.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:35:54 smithi086 bash[24289]: cluster 2024-09-16T05:35:53.492643+0000 mgr.a (mgr.14150) 173 : cluster [DBG] pgmap v127: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-16T05:35:55.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:35:54 smithi086 bash[24289]: audit 2024-09-16T05:35:53.622385+0000 mon.a (mon.0) 397 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-16T05:35:55.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:35:54 smithi086 bash[24289]: audit 2024-09-16T05:35:53.624545+0000 mon.a (mon.0) 398 : audit [DBG] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T05:35:55.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:35:54 smithi086 bash[24289]: cephadm 2024-09-16T05:35:53.626234+0000 mgr.a (mgr.14150) 174 : cephadm [INF] Deploying daemon osd.2 on smithi157 2024-09-16T05:35:56.957 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:35:56 smithi157 bash[24585]: cluster 2024-09-16T05:35:55.493114+0000 mgr.a (mgr.14150) 175 : cluster [DBG] pgmap v128: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-16T05:35:57.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:35:56 smithi086 bash[24289]: cluster 2024-09-16T05:35:55.493114+0000 mgr.a (mgr.14150) 175 : cluster [DBG] pgmap v128: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-16T05:35:57.090 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:35:56 smithi047 bash[22744]: cluster 2024-09-16T05:35:55.493114+0000 mgr.a (mgr.14150) 175 : cluster [DBG] pgmap v128: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-16T05:35:58.004 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:35:57 smithi157 systemd[1]: /etc/systemd/system/ceph-a6097908-73ec-11ef-bceb-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-16T05:35:58.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:35:58 smithi157 systemd[1]: /etc/systemd/system/ceph-a6097908-73ec-11ef-bceb-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-16T05:35:59.040 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:35:58 smithi157 bash[24585]: cluster 2024-09-16T05:35:57.493574+0000 mgr.a (mgr.14150) 176 : cluster [DBG] pgmap v129: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-16T05:35:59.040 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:35:58 smithi157 bash[24585]: audit 2024-09-16T05:35:58.143594+0000 mon.a (mon.0) 399 : audit [DBG] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T05:35:59.040 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:35:58 smithi157 bash[24585]: audit 2024-09-16T05:35:58.150738+0000 mon.a (mon.0) 400 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:35:59.040 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:35:58 smithi157 bash[24585]: audit 2024-09-16T05:35:58.158099+0000 mon.a (mon.0) 401 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:35:59.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:35:58 smithi086 bash[24289]: cluster 2024-09-16T05:35:57.493574+0000 mgr.a (mgr.14150) 176 : cluster [DBG] pgmap v129: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-16T05:35:59.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:35:58 smithi086 bash[24289]: audit 2024-09-16T05:35:58.143594+0000 mon.a (mon.0) 399 : audit [DBG] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T05:35:59.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:35:58 smithi086 bash[24289]: audit 2024-09-16T05:35:58.150738+0000 mon.a (mon.0) 400 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:35:59.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:35:58 smithi086 bash[24289]: audit 2024-09-16T05:35:58.158099+0000 mon.a (mon.0) 401 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:35:59.090 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:35:58 smithi047 bash[22744]: cluster 2024-09-16T05:35:57.493574+0000 mgr.a (mgr.14150) 176 : cluster [DBG] pgmap v129: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-16T05:35:59.091 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:35:58 smithi047 bash[22744]: audit 2024-09-16T05:35:58.143594+0000 mon.a (mon.0) 399 : audit [DBG] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T05:35:59.091 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:35:58 smithi047 bash[22744]: audit 2024-09-16T05:35:58.150738+0000 mon.a (mon.0) 400 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:35:59.091 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:35:58 smithi047 bash[22744]: audit 2024-09-16T05:35:58.158099+0000 mon.a (mon.0) 401 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:36:00.958 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:36:00 smithi157 bash[24585]: cluster 2024-09-16T05:35:59.494047+0000 mgr.a (mgr.14150) 177 : cluster [DBG] pgmap v130: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-16T05:36:01.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:36:00 smithi086 bash[24289]: cluster 2024-09-16T05:35:59.494047+0000 mgr.a (mgr.14150) 177 : cluster [DBG] pgmap v130: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-16T05:36:01.090 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:36:00 smithi047 bash[22744]: cluster 2024-09-16T05:35:59.494047+0000 mgr.a (mgr.14150) 177 : cluster [DBG] pgmap v130: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-16T05:36:02.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:36:02 smithi157 bash[24585]: cluster 2024-09-16T05:36:01.494555+0000 mgr.a (mgr.14150) 178 : cluster [DBG] pgmap v131: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-16T05:36:03.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:36:02 smithi086 bash[24289]: cluster 2024-09-16T05:36:01.494555+0000 mgr.a (mgr.14150) 178 : cluster [DBG] pgmap v131: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-16T05:36:03.090 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:36:02 smithi047 bash[22744]: cluster 2024-09-16T05:36:01.494555+0000 mgr.a (mgr.14150) 178 : cluster [DBG] pgmap v131: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-16T05:36:05.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:36:04 smithi157 bash[24585]: cluster 2024-09-16T05:36:03.495028+0000 mgr.a (mgr.14150) 179 : cluster [DBG] pgmap v132: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-16T05:36:05.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:36:04 smithi157 bash[24585]: audit 2024-09-16T05:36:04.463983+0000 mon.a (mon.0) 402 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:36:05.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:36:04 smithi157 bash[24585]: audit 2024-09-16T05:36:04.471358+0000 mon.a (mon.0) 403 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:36:05.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:36:04 smithi157 bash[24585]: audit 2024-09-16T05:36:04.472971+0000 mon.a (mon.0) 404 : audit [DBG] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T05:36:05.055 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:36:04 smithi157 bash[24585]: audit 2024-09-16T05:36:04.474768+0000 mon.a (mon.0) 405 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T05:36:05.055 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:36:04 smithi157 bash[24585]: audit 2024-09-16T05:36:04.484386+0000 mon.a (mon.0) 406 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:36:05.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:36:04 smithi086 bash[24289]: cluster 2024-09-16T05:36:03.495028+0000 mgr.a (mgr.14150) 179 : cluster [DBG] pgmap v132: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-16T05:36:05.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:36:04 smithi086 bash[24289]: audit 2024-09-16T05:36:04.463983+0000 mon.a (mon.0) 402 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:36:05.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:36:04 smithi086 bash[24289]: audit 2024-09-16T05:36:04.471358+0000 mon.a (mon.0) 403 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:36:05.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:36:04 smithi086 bash[24289]: audit 2024-09-16T05:36:04.472971+0000 mon.a (mon.0) 404 : audit [DBG] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T05:36:05.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:36:04 smithi086 bash[24289]: audit 2024-09-16T05:36:04.474768+0000 mon.a (mon.0) 405 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T05:36:05.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:36:04 smithi086 bash[24289]: audit 2024-09-16T05:36:04.484386+0000 mon.a (mon.0) 406 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:36:05.090 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:36:04 smithi047 bash[22744]: cluster 2024-09-16T05:36:03.495028+0000 mgr.a (mgr.14150) 179 : cluster [DBG] pgmap v132: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-16T05:36:05.091 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:36:04 smithi047 bash[22744]: audit 2024-09-16T05:36:04.463983+0000 mon.a (mon.0) 402 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:36:05.091 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:36:04 smithi047 bash[22744]: audit 2024-09-16T05:36:04.471358+0000 mon.a (mon.0) 403 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:36:05.091 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:36:04 smithi047 bash[22744]: audit 2024-09-16T05:36:04.472971+0000 mon.a (mon.0) 404 : audit [DBG] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T05:36:05.091 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:36:04 smithi047 bash[22744]: audit 2024-09-16T05:36:04.474768+0000 mon.a (mon.0) 405 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T05:36:05.091 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:36:04 smithi047 bash[22744]: audit 2024-09-16T05:36:04.484386+0000 mon.a (mon.0) 406 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:36:07.012 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:36:06 smithi157 bash[24585]: cluster 2024-09-16T05:36:05.495588+0000 mgr.a (mgr.14150) 180 : cluster [DBG] pgmap v133: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-16T05:36:07.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:36:06 smithi086 bash[24289]: cluster 2024-09-16T05:36:05.495588+0000 mgr.a (mgr.14150) 180 : cluster [DBG] pgmap v133: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-16T05:36:07.090 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:36:06 smithi047 bash[22744]: cluster 2024-09-16T05:36:05.495588+0000 mgr.a (mgr.14150) 180 : cluster [DBG] pgmap v133: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-16T05:36:08.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:36:07 smithi157 bash[24585]: audit 2024-09-16T05:36:07.252824+0000 mon.c (mon.1) 6 : audit [INF] from='osd.2 [v2:172.21.15.157:6800/2902103460,v1:172.21.15.157:6801/2902103460]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-16T05:36:08.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:36:07 smithi157 bash[24585]: audit 2024-09-16T05:36:07.253424+0000 mon.a (mon.0) 407 : audit [INF] from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-16T05:36:08.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:36:07 smithi086 bash[24289]: audit 2024-09-16T05:36:07.252824+0000 mon.c (mon.1) 6 : audit [INF] from='osd.2 [v2:172.21.15.157:6800/2902103460,v1:172.21.15.157:6801/2902103460]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-16T05:36:08.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:36:07 smithi086 bash[24289]: audit 2024-09-16T05:36:07.253424+0000 mon.a (mon.0) 407 : audit [INF] from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-16T05:36:08.090 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:36:07 smithi047 bash[22744]: audit 2024-09-16T05:36:07.252824+0000 mon.c (mon.1) 6 : audit [INF] from='osd.2 [v2:172.21.15.157:6800/2902103460,v1:172.21.15.157:6801/2902103460]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-16T05:36:08.091 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:36:07 smithi047 bash[22744]: audit 2024-09-16T05:36:07.253424+0000 mon.a (mon.0) 407 : audit [INF] from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-16T05:36:09.028 INFO:teuthology.orchestra.run.smithi157.stdout:Created osd(s) 2 on host 'smithi157' 2024-09-16T05:36:09.044 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:36:08 smithi157 bash[24585]: cluster 2024-09-16T05:36:07.496177+0000 mgr.a (mgr.14150) 181 : cluster [DBG] pgmap v134: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-16T05:36:09.044 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:36:08 smithi157 bash[24585]: audit 2024-09-16T05:36:07.621270+0000 mon.a (mon.0) 408 : audit [INF] from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-16T05:36:09.044 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:36:08 smithi157 bash[24585]: audit 2024-09-16T05:36:07.624270+0000 mon.c (mon.1) 7 : audit [INF] from='osd.2 [v2:172.21.15.157:6800/2902103460,v1:172.21.15.157:6801/2902103460]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi157", "root=default"]}]: dispatch 2024-09-16T05:36:09.044 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:36:08 smithi157 bash[24585]: cluster 2024-09-16T05:36:07.627389+0000 mon.a (mon.0) 409 : cluster [DBG] osdmap e16: 3 total, 2 up, 3 in 2024-09-16T05:36:09.044 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:36:08 smithi157 bash[24585]: audit 2024-09-16T05:36:07.627873+0000 mon.a (mon.0) 410 : audit [DBG] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-16T05:36:09.044 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:36:08 smithi157 bash[24585]: audit 2024-09-16T05:36:07.628530+0000 mon.a (mon.0) 411 : audit [INF] from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi157", "root=default"]}]: dispatch 2024-09-16T05:36:09.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:36:08 smithi086 bash[24289]: cluster 2024-09-16T05:36:07.496177+0000 mgr.a (mgr.14150) 181 : cluster [DBG] pgmap v134: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-16T05:36:09.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:36:08 smithi086 bash[24289]: audit 2024-09-16T05:36:07.621270+0000 mon.a (mon.0) 408 : audit [INF] from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-16T05:36:09.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:36:08 smithi086 bash[24289]: audit 2024-09-16T05:36:07.624270+0000 mon.c (mon.1) 7 : audit [INF] from='osd.2 [v2:172.21.15.157:6800/2902103460,v1:172.21.15.157:6801/2902103460]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi157", "root=default"]}]: dispatch 2024-09-16T05:36:09.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:36:08 smithi086 bash[24289]: cluster 2024-09-16T05:36:07.627389+0000 mon.a (mon.0) 409 : cluster [DBG] osdmap e16: 3 total, 2 up, 3 in 2024-09-16T05:36:09.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:36:08 smithi086 bash[24289]: audit 2024-09-16T05:36:07.627873+0000 mon.a (mon.0) 410 : audit [DBG] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-16T05:36:09.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:36:08 smithi086 bash[24289]: audit 2024-09-16T05:36:07.628530+0000 mon.a (mon.0) 411 : audit [INF] from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi157", "root=default"]}]: dispatch 2024-09-16T05:36:09.091 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:36:08 smithi047 bash[22744]: cluster 2024-09-16T05:36:07.496177+0000 mgr.a (mgr.14150) 181 : cluster [DBG] pgmap v134: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-16T05:36:09.091 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:36:08 smithi047 bash[22744]: audit 2024-09-16T05:36:07.621270+0000 mon.a (mon.0) 408 : audit [INF] from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-16T05:36:09.091 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:36:08 smithi047 bash[22744]: audit 2024-09-16T05:36:07.624270+0000 mon.c (mon.1) 7 : audit [INF] from='osd.2 [v2:172.21.15.157:6800/2902103460,v1:172.21.15.157:6801/2902103460]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi157", "root=default"]}]: dispatch 2024-09-16T05:36:09.091 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:36:08 smithi047 bash[22744]: cluster 2024-09-16T05:36:07.627389+0000 mon.a (mon.0) 409 : cluster [DBG] osdmap e16: 3 total, 2 up, 3 in 2024-09-16T05:36:09.091 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:36:08 smithi047 bash[22744]: audit 2024-09-16T05:36:07.627873+0000 mon.a (mon.0) 410 : audit [DBG] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-16T05:36:09.091 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:36:08 smithi047 bash[22744]: audit 2024-09-16T05:36:07.628530+0000 mon.a (mon.0) 411 : audit [INF] from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi157", "root=default"]}]: dispatch 2024-09-16T05:36:09.670 DEBUG:teuthology.orchestra.run.smithi157:osd.2> sudo journalctl -f -n 0 -u ceph-a6097908-73ec-11ef-bceb-c7b262605968@osd.2.service 2024-09-16T05:36:09.673 INFO:tasks.cephadm:Waiting for 3 OSDs to come up... 2024-09-16T05:36:09.673 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a6097908-73ec-11ef-bceb-c7b262605968 -- ceph osd stat -f json 2024-09-16T05:36:10.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:36:09 smithi157 bash[24585]: audit 2024-09-16T05:36:08.623623+0000 mon.a (mon.0) 412 : audit [INF] from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi157", "root=default"]}]': finished 2024-09-16T05:36:10.055 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:36:09 smithi157 bash[24585]: cluster 2024-09-16T05:36:08.628785+0000 mon.a (mon.0) 413 : cluster [DBG] osdmap e17: 3 total, 2 up, 3 in 2024-09-16T05:36:10.055 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:36:09 smithi157 bash[24585]: audit 2024-09-16T05:36:08.629598+0000 mon.a (mon.0) 414 : audit [DBG] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-16T05:36:10.055 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:36:09 smithi157 bash[24585]: audit 2024-09-16T05:36:08.637275+0000 mon.a (mon.0) 415 : audit [DBG] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-16T05:36:10.055 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:36:09 smithi157 bash[24585]: audit 2024-09-16T05:36:09.009237+0000 mon.a (mon.0) 416 : audit [DBG] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T05:36:10.055 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:36:09 smithi157 bash[24585]: audit 2024-09-16T05:36:09.016327+0000 mon.a (mon.0) 417 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:36:10.055 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:36:09 smithi157 bash[24585]: audit 2024-09-16T05:36:09.023922+0000 mon.a (mon.0) 418 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:36:10.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:36:09 smithi086 bash[24289]: audit 2024-09-16T05:36:08.623623+0000 mon.a (mon.0) 412 : audit [INF] from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi157", "root=default"]}]': finished 2024-09-16T05:36:10.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:36:09 smithi086 bash[24289]: cluster 2024-09-16T05:36:08.628785+0000 mon.a (mon.0) 413 : cluster [DBG] osdmap e17: 3 total, 2 up, 3 in 2024-09-16T05:36:10.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:36:09 smithi086 bash[24289]: audit 2024-09-16T05:36:08.629598+0000 mon.a (mon.0) 414 : audit [DBG] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-16T05:36:10.072 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:36:09 smithi086 bash[24289]: audit 2024-09-16T05:36:08.637275+0000 mon.a (mon.0) 415 : audit [DBG] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-16T05:36:10.072 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:36:09 smithi086 bash[24289]: audit 2024-09-16T05:36:09.009237+0000 mon.a (mon.0) 416 : audit [DBG] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T05:36:10.072 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:36:09 smithi086 bash[24289]: audit 2024-09-16T05:36:09.016327+0000 mon.a (mon.0) 417 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:36:10.072 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:36:09 smithi086 bash[24289]: audit 2024-09-16T05:36:09.023922+0000 mon.a (mon.0) 418 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:36:10.091 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:36:09 smithi047 bash[22744]: audit 2024-09-16T05:36:08.623623+0000 mon.a (mon.0) 412 : audit [INF] from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi157", "root=default"]}]': finished 2024-09-16T05:36:10.091 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:36:09 smithi047 bash[22744]: cluster 2024-09-16T05:36:08.628785+0000 mon.a (mon.0) 413 : cluster [DBG] osdmap e17: 3 total, 2 up, 3 in 2024-09-16T05:36:10.091 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:36:09 smithi047 bash[22744]: audit 2024-09-16T05:36:08.629598+0000 mon.a (mon.0) 414 : audit [DBG] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-16T05:36:10.091 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:36:09 smithi047 bash[22744]: audit 2024-09-16T05:36:08.637275+0000 mon.a (mon.0) 415 : audit [DBG] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-16T05:36:10.091 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:36:09 smithi047 bash[22744]: audit 2024-09-16T05:36:09.009237+0000 mon.a (mon.0) 416 : audit [DBG] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T05:36:10.091 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:36:09 smithi047 bash[22744]: audit 2024-09-16T05:36:09.016327+0000 mon.a (mon.0) 417 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:36:10.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:36:09 smithi047 bash[22744]: audit 2024-09-16T05:36:09.023922+0000 mon.a (mon.0) 418 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:36:11.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:36:10 smithi157 bash[24585]: cluster 2024-09-16T05:36:08.275365+0000 osd.2 (osd.2) 1 : cluster [DBG] purged_snaps scrub starts 2024-09-16T05:36:11.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:36:10 smithi157 bash[24585]: cluster 2024-09-16T05:36:08.275447+0000 osd.2 (osd.2) 2 : cluster [DBG] purged_snaps scrub ok 2024-09-16T05:36:11.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:36:10 smithi157 bash[24585]: cluster 2024-09-16T05:36:09.496683+0000 mgr.a (mgr.14150) 182 : cluster [DBG] pgmap v137: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-16T05:36:11.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:36:10 smithi157 bash[24585]: cluster 2024-09-16T05:36:09.639205+0000 mon.a (mon.0) 419 : cluster [INF] osd.2 [v2:172.21.15.157:6800/2902103460,v1:172.21.15.157:6801/2902103460] boot 2024-09-16T05:36:11.055 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:36:10 smithi157 bash[24585]: cluster 2024-09-16T05:36:09.639286+0000 mon.a (mon.0) 420 : cluster [DBG] osdmap e18: 3 total, 3 up, 3 in 2024-09-16T05:36:11.055 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:36:10 smithi157 bash[24585]: audit 2024-09-16T05:36:09.640000+0000 mon.a (mon.0) 421 : audit [DBG] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-16T05:36:11.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:36:10 smithi086 bash[24289]: cluster 2024-09-16T05:36:08.275365+0000 osd.2 (osd.2) 1 : cluster [DBG] purged_snaps scrub starts 2024-09-16T05:36:11.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:36:10 smithi086 bash[24289]: cluster 2024-09-16T05:36:08.275447+0000 osd.2 (osd.2) 2 : cluster [DBG] purged_snaps scrub ok 2024-09-16T05:36:11.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:36:10 smithi086 bash[24289]: cluster 2024-09-16T05:36:09.496683+0000 mgr.a (mgr.14150) 182 : cluster [DBG] pgmap v137: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-16T05:36:11.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:36:10 smithi086 bash[24289]: cluster 2024-09-16T05:36:09.639205+0000 mon.a (mon.0) 419 : cluster [INF] osd.2 [v2:172.21.15.157:6800/2902103460,v1:172.21.15.157:6801/2902103460] boot 2024-09-16T05:36:11.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:36:10 smithi086 bash[24289]: cluster 2024-09-16T05:36:09.639286+0000 mon.a (mon.0) 420 : cluster [DBG] osdmap e18: 3 total, 3 up, 3 in 2024-09-16T05:36:11.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:36:10 smithi086 bash[24289]: audit 2024-09-16T05:36:09.640000+0000 mon.a (mon.0) 421 : audit [DBG] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-16T05:36:11.090 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:36:10 smithi047 bash[22744]: cluster 2024-09-16T05:36:08.275365+0000 osd.2 (osd.2) 1 : cluster [DBG] purged_snaps scrub starts 2024-09-16T05:36:11.091 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:36:10 smithi047 bash[22744]: cluster 2024-09-16T05:36:08.275447+0000 osd.2 (osd.2) 2 : cluster [DBG] purged_snaps scrub ok 2024-09-16T05:36:11.091 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:36:10 smithi047 bash[22744]: cluster 2024-09-16T05:36:09.496683+0000 mgr.a (mgr.14150) 182 : cluster [DBG] pgmap v137: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-16T05:36:11.091 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:36:10 smithi047 bash[22744]: cluster 2024-09-16T05:36:09.639205+0000 mon.a (mon.0) 419 : cluster [INF] osd.2 [v2:172.21.15.157:6800/2902103460,v1:172.21.15.157:6801/2902103460] boot 2024-09-16T05:36:11.091 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:36:10 smithi047 bash[22744]: cluster 2024-09-16T05:36:09.639286+0000 mon.a (mon.0) 420 : cluster [DBG] osdmap e18: 3 total, 3 up, 3 in 2024-09-16T05:36:11.091 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:36:10 smithi047 bash[22744]: audit 2024-09-16T05:36:09.640000+0000 mon.a (mon.0) 421 : audit [DBG] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-16T05:36:12.340 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:36:12 smithi047 bash[22744]: cluster 2024-09-16T05:36:11.029552+0000 mon.a (mon.0) 422 : cluster [DBG] osdmap e19: 3 total, 3 up, 3 in 2024-09-16T05:36:12.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:36:12 smithi157 bash[24585]: cluster 2024-09-16T05:36:11.029552+0000 mon.a (mon.0) 422 : cluster [DBG] osdmap e19: 3 total, 3 up, 3 in 2024-09-16T05:36:12.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:36:12 smithi086 bash[24289]: cluster 2024-09-16T05:36:11.029552+0000 mon.a (mon.0) 422 : cluster [DBG] osdmap e19: 3 total, 3 up, 3 in 2024-09-16T05:36:13.340 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:36:13 smithi047 bash[22744]: cluster 2024-09-16T05:36:11.497142+0000 mgr.a (mgr.14150) 183 : cluster [DBG] pgmap v140: 0 pgs: ; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-16T05:36:13.341 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:36:13 smithi047 bash[22744]: audit 2024-09-16T05:36:11.627036+0000 mon.a (mon.0) 423 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-09-16T05:36:13.341 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:36:13 smithi047 bash[22744]: audit 2024-09-16T05:36:12.126788+0000 mon.a (mon.0) 424 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-16T05:36:13.341 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:36:13 smithi047 bash[22744]: cluster 2024-09-16T05:36:12.130974+0000 mon.a (mon.0) 425 : cluster [DBG] osdmap e20: 3 total, 3 up, 3 in 2024-09-16T05:36:13.341 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:36:13 smithi047 bash[22744]: audit 2024-09-16T05:36:12.132424+0000 mon.a (mon.0) 426 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-16T05:36:13.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:36:13 smithi157 bash[24585]: cluster 2024-09-16T05:36:11.497142+0000 mgr.a (mgr.14150) 183 : cluster [DBG] pgmap v140: 0 pgs: ; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-16T05:36:13.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:36:13 smithi157 bash[24585]: audit 2024-09-16T05:36:11.627036+0000 mon.a (mon.0) 423 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-09-16T05:36:13.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:36:13 smithi157 bash[24585]: audit 2024-09-16T05:36:12.126788+0000 mon.a (mon.0) 424 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-16T05:36:13.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:36:13 smithi157 bash[24585]: cluster 2024-09-16T05:36:12.130974+0000 mon.a (mon.0) 425 : cluster [DBG] osdmap e20: 3 total, 3 up, 3 in 2024-09-16T05:36:13.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:36:13 smithi157 bash[24585]: audit 2024-09-16T05:36:12.132424+0000 mon.a (mon.0) 426 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-16T05:36:13.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:36:13 smithi086 bash[24289]: cluster 2024-09-16T05:36:11.497142+0000 mgr.a (mgr.14150) 183 : cluster [DBG] pgmap v140: 0 pgs: ; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-16T05:36:13.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:36:13 smithi086 bash[24289]: audit 2024-09-16T05:36:11.627036+0000 mon.a (mon.0) 423 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-09-16T05:36:13.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:36:13 smithi086 bash[24289]: audit 2024-09-16T05:36:12.126788+0000 mon.a (mon.0) 424 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-16T05:36:13.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:36:13 smithi086 bash[24289]: cluster 2024-09-16T05:36:12.130974+0000 mon.a (mon.0) 425 : cluster [DBG] osdmap e20: 3 total, 3 up, 3 in 2024-09-16T05:36:13.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:36:13 smithi086 bash[24289]: audit 2024-09-16T05:36:12.132424+0000 mon.a (mon.0) 426 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-16T05:36:14.413 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/a6097908-73ec-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T05:36:14.503 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:36:14 smithi047 bash[22744]: audit 2024-09-16T05:36:13.128957+0000 mon.a (mon.0) 427 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-16T05:36:14.503 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:36:14 smithi047 bash[22744]: cluster 2024-09-16T05:36:13.133206+0000 mon.a (mon.0) 428 : cluster [DBG] osdmap e21: 3 total, 3 up, 3 in 2024-09-16T05:36:14.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:36:14 smithi157 bash[24585]: audit 2024-09-16T05:36:13.128957+0000 mon.a (mon.0) 427 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-16T05:36:14.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:36:14 smithi157 bash[24585]: cluster 2024-09-16T05:36:13.133206+0000 mon.a (mon.0) 428 : cluster [DBG] osdmap e21: 3 total, 3 up, 3 in 2024-09-16T05:36:14.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:36:14 smithi086 bash[24289]: audit 2024-09-16T05:36:13.128957+0000 mon.a (mon.0) 427 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-16T05:36:14.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:36:14 smithi086 bash[24289]: cluster 2024-09-16T05:36:13.133206+0000 mon.a (mon.0) 428 : cluster [DBG] osdmap e21: 3 total, 3 up, 3 in 2024-09-16T05:36:15.396 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:36:15 smithi157 bash[24585]: cluster 2024-09-16T05:36:13.497630+0000 mgr.a (mgr.14150) 184 : cluster [DBG] pgmap v143: 1 pgs: 1 creating+peering; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-16T05:36:15.396 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:36:15 smithi157 bash[24585]: cluster 2024-09-16T05:36:14.147801+0000 mon.a (mon.0) 429 : cluster [DBG] osdmap e22: 3 total, 3 up, 3 in 2024-09-16T05:36:15.396 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:36:15 smithi157 bash[24585]: cluster 2024-09-16T05:36:14.148465+0000 mon.a (mon.0) 430 : cluster [DBG] mgrmap e15: a(active, since 4m), standbys: b 2024-09-16T05:36:15.396 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:36:15 smithi157 bash[24585]: audit 2024-09-16T05:36:14.294653+0000 mon.a (mon.0) 431 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:36:15.555 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:36:15 smithi047 bash[22744]: cluster 2024-09-16T05:36:13.497630+0000 mgr.a (mgr.14150) 184 : cluster [DBG] pgmap v143: 1 pgs: 1 creating+peering; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-16T05:36:15.555 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:36:15 smithi047 bash[22744]: cluster 2024-09-16T05:36:14.147801+0000 mon.a (mon.0) 429 : cluster [DBG] osdmap e22: 3 total, 3 up, 3 in 2024-09-16T05:36:15.555 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:36:15 smithi047 bash[22744]: cluster 2024-09-16T05:36:14.148465+0000 mon.a (mon.0) 430 : cluster [DBG] mgrmap e15: a(active, since 4m), standbys: b 2024-09-16T05:36:15.555 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:36:15 smithi047 bash[22744]: audit 2024-09-16T05:36:14.294653+0000 mon.a (mon.0) 431 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:36:15.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:36:15 smithi086 bash[24289]: cluster 2024-09-16T05:36:13.497630+0000 mgr.a (mgr.14150) 184 : cluster [DBG] pgmap v143: 1 pgs: 1 creating+peering; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-16T05:36:15.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:36:15 smithi086 bash[24289]: cluster 2024-09-16T05:36:14.147801+0000 mon.a (mon.0) 429 : cluster [DBG] osdmap e22: 3 total, 3 up, 3 in 2024-09-16T05:36:15.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:36:15 smithi086 bash[24289]: cluster 2024-09-16T05:36:14.148465+0000 mon.a (mon.0) 430 : cluster [DBG] mgrmap e15: a(active, since 4m), standbys: b 2024-09-16T05:36:15.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:36:15 smithi086 bash[24289]: audit 2024-09-16T05:36:14.294653+0000 mon.a (mon.0) 431 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:36:15.893 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-16T05:36:16.605 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":22,"num_osds":3,"num_up_osds":3,"osd_up_since":1726464969,"num_in_osds":3,"osd_in_since":1726464940,"num_remapped_pgs":0} 2024-09-16T05:36:16.605 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid a6097908-73ec-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-16T05:36:18.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:36:18 smithi157 bash[24585]: audit 2024-09-16T05:36:15.251199+0000 mon.a (mon.0) 432 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:36:18.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:36:18 smithi157 bash[24585]: audit 2024-09-16T05:36:15.894364+0000 mon.a (mon.0) 433 : audit [DBG] from='client.? 172.21.15.47:0/505072730' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-16T05:36:18.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:36:18 smithi157 bash[24585]: audit 2024-09-16T05:36:16.151857+0000 mon.a (mon.0) 434 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:36:18.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:36:18 smithi157 bash[24585]: audit 2024-09-16T05:36:16.154172+0000 mon.a (mon.0) 435 : audit [INF] from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-16T05:36:18.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:36:18 smithi086 bash[24289]: audit 2024-09-16T05:36:15.251199+0000 mon.a (mon.0) 432 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:36:18.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:36:18 smithi086 bash[24289]: audit 2024-09-16T05:36:15.894364+0000 mon.a (mon.0) 433 : audit [DBG] from='client.? 172.21.15.47:0/505072730' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-16T05:36:18.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:36:18 smithi086 bash[24289]: audit 2024-09-16T05:36:16.151857+0000 mon.a (mon.0) 434 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:36:18.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:36:18 smithi086 bash[24289]: audit 2024-09-16T05:36:16.154172+0000 mon.a (mon.0) 435 : audit [INF] from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-16T05:36:18.340 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:36:18 smithi047 bash[22744]: audit 2024-09-16T05:36:15.251199+0000 mon.a (mon.0) 432 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:36:18.341 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:36:18 smithi047 bash[22744]: audit 2024-09-16T05:36:15.894364+0000 mon.a (mon.0) 433 : audit [DBG] from='client.? 172.21.15.47:0/505072730' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-16T05:36:18.341 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:36:18 smithi047 bash[22744]: audit 2024-09-16T05:36:16.151857+0000 mon.a (mon.0) 434 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:36:18.341 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:36:18 smithi047 bash[22744]: audit 2024-09-16T05:36:16.154172+0000 mon.a (mon.0) 435 : audit [INF] from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-16T05:36:19.305 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:36:19 smithi157 bash[24585]: cluster 2024-09-16T05:36:15.498138+0000 mgr.a (mgr.14150) 185 : cluster [DBG] pgmap v145: 1 pgs: 1 creating+peering; 0 B data, 89 MiB used, 268 GiB / 268 GiB avail 2024-09-16T05:36:19.305 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:36:19 smithi157 bash[24585]: audit 2024-09-16T05:36:17.094217+0000 mon.a (mon.0) 436 : audit [INF] from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-16T05:36:19.305 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:36:19 smithi157 bash[24585]: audit 2024-09-16T05:36:17.095259+0000 mon.a (mon.0) 437 : audit [DBG] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-16T05:36:19.305 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:36:19 smithi157 bash[24585]: audit 2024-09-16T05:36:17.095473+0000 mon.a (mon.0) 438 : audit [DBG] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-16T05:36:19.305 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:36:19 smithi157 bash[24585]: audit 2024-09-16T05:36:17.095682+0000 mon.a (mon.0) 439 : audit [DBG] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-16T05:36:19.305 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:36:19 smithi157 bash[24585]: audit 2024-09-16T05:36:17.100077+0000 mon.c (mon.1) 8 : audit [INF] from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-16T05:36:19.305 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:36:19 smithi157 bash[24585]: audit 2024-09-16T05:36:17.100179+0000 mon.a (mon.0) 440 : audit [DBG] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-16T05:36:19.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:36:19 smithi157 bash[24585]: audit 2024-09-16T05:36:17.100542+0000 mon.a (mon.0) 441 : audit [DBG] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-16T05:36:19.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:36:19 smithi157 bash[24585]: audit 2024-09-16T05:36:17.100731+0000 mon.a (mon.0) 442 : audit [DBG] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-16T05:36:19.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:36:19 smithi157 bash[24585]: cluster 2024-09-16T05:36:17.498755+0000 mgr.a (mgr.14150) 186 : cluster [DBG] pgmap v146: 1 pgs: 1 creating+peering; 0 B data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-16T05:36:19.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:36:19 smithi157 bash[24585]: audit 2024-09-16T05:36:18.009320+0000 mon.c (mon.1) 9 : audit [INF] from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-16T05:36:19.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:36:19 smithi157 bash[24585]: audit 2024-09-16T05:36:18.013897+0000 mon.b (mon.2) 11 : audit [INF] from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-16T05:36:19.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:36:19 smithi157 bash[24585]: audit 2024-09-16T05:36:18.017434+0000 mon.a (mon.0) 443 : audit [DBG] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-16T05:36:19.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:36:19 smithi157 bash[24585]: audit 2024-09-16T05:36:18.017752+0000 mon.a (mon.0) 444 : audit [DBG] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-16T05:36:19.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:36:19 smithi157 bash[24585]: audit 2024-09-16T05:36:18.018032+0000 mon.a (mon.0) 445 : audit [DBG] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-16T05:36:19.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:36:19 smithi157 bash[24585]: cephadm 2024-09-16T05:36:18.322950+0000 mgr.a (mgr.14150) 187 : cephadm [INF] Detected new or changed devices on smithi157 2024-09-16T05:36:19.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:36:19 smithi157 bash[24585]: audit 2024-09-16T05:36:18.912983+0000 mon.b (mon.2) 12 : audit [INF] from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-16T05:36:19.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:36:19 smithi157 bash[24585]: audit 2024-09-16T05:36:18.927989+0000 mon.a (mon.0) 446 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:36:19.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:36:19 smithi157 bash[24585]: audit 2024-09-16T05:36:18.937038+0000 mon.a (mon.0) 447 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:36:19.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:36:19 smithi157 bash[24585]: audit 2024-09-16T05:36:18.939364+0000 mon.a (mon.0) 448 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-16T05:36:19.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:36:19 smithi157 bash[24585]: audit 2024-09-16T05:36:18.946966+0000 mon.a (mon.0) 449 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:36:19.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:36:19 smithi157 bash[24585]: audit 2024-09-16T05:36:18.950863+0000 mon.a (mon.0) 450 : audit [DBG] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T05:36:19.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:36:19 smithi157 bash[24585]: audit 2024-09-16T05:36:18.952745+0000 mon.a (mon.0) 451 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T05:36:19.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:36:19 smithi157 bash[24585]: audit 2024-09-16T05:36:18.962597+0000 mon.a (mon.0) 452 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:36:19.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:36:19 smithi086 bash[24289]: cluster 2024-09-16T05:36:15.498138+0000 mgr.a (mgr.14150) 185 : cluster [DBG] pgmap v145: 1 pgs: 1 creating+peering; 0 B data, 89 MiB used, 268 GiB / 268 GiB avail 2024-09-16T05:36:19.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:36:19 smithi086 bash[24289]: audit 2024-09-16T05:36:17.094217+0000 mon.a (mon.0) 436 : audit [INF] from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-16T05:36:19.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:36:19 smithi086 bash[24289]: audit 2024-09-16T05:36:17.095259+0000 mon.a (mon.0) 437 : audit [DBG] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-16T05:36:19.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:36:19 smithi086 bash[24289]: audit 2024-09-16T05:36:17.095473+0000 mon.a (mon.0) 438 : audit [DBG] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-16T05:36:19.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:36:19 smithi086 bash[24289]: audit 2024-09-16T05:36:17.095682+0000 mon.a (mon.0) 439 : audit [DBG] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-16T05:36:19.322 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:36:19 smithi086 bash[24289]: audit 2024-09-16T05:36:17.100077+0000 mon.c (mon.1) 8 : audit [INF] from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-16T05:36:19.322 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:36:19 smithi086 bash[24289]: audit 2024-09-16T05:36:17.100179+0000 mon.a (mon.0) 440 : audit [DBG] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-16T05:36:19.322 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:36:19 smithi086 bash[24289]: audit 2024-09-16T05:36:17.100542+0000 mon.a (mon.0) 441 : audit [DBG] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-16T05:36:19.322 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:36:19 smithi086 bash[24289]: audit 2024-09-16T05:36:17.100731+0000 mon.a (mon.0) 442 : audit [DBG] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-16T05:36:19.322 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:36:19 smithi086 bash[24289]: cluster 2024-09-16T05:36:17.498755+0000 mgr.a (mgr.14150) 186 : cluster [DBG] pgmap v146: 1 pgs: 1 creating+peering; 0 B data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-16T05:36:19.322 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:36:19 smithi086 bash[24289]: audit 2024-09-16T05:36:18.009320+0000 mon.c (mon.1) 9 : audit [INF] from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-16T05:36:19.322 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:36:19 smithi086 bash[24289]: audit 2024-09-16T05:36:18.013897+0000 mon.b (mon.2) 11 : audit [INF] from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-16T05:36:19.322 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:36:19 smithi086 bash[24289]: audit 2024-09-16T05:36:18.017434+0000 mon.a (mon.0) 443 : audit [DBG] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-16T05:36:19.322 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:36:19 smithi086 bash[24289]: audit 2024-09-16T05:36:18.017752+0000 mon.a (mon.0) 444 : audit [DBG] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-16T05:36:19.322 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:36:19 smithi086 bash[24289]: audit 2024-09-16T05:36:18.018032+0000 mon.a (mon.0) 445 : audit [DBG] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-16T05:36:19.322 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:36:19 smithi086 bash[24289]: cephadm 2024-09-16T05:36:18.322950+0000 mgr.a (mgr.14150) 187 : cephadm [INF] Detected new or changed devices on smithi157 2024-09-16T05:36:19.322 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:36:19 smithi086 bash[24289]: audit 2024-09-16T05:36:18.912983+0000 mon.b (mon.2) 12 : audit [INF] from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-16T05:36:19.322 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:36:19 smithi086 bash[24289]: audit 2024-09-16T05:36:18.927989+0000 mon.a (mon.0) 446 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:36:19.322 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:36:19 smithi086 bash[24289]: audit 2024-09-16T05:36:18.937038+0000 mon.a (mon.0) 447 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:36:19.323 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:36:19 smithi086 bash[24289]: audit 2024-09-16T05:36:18.939364+0000 mon.a (mon.0) 448 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-16T05:36:19.323 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:36:19 smithi086 bash[24289]: audit 2024-09-16T05:36:18.946966+0000 mon.a (mon.0) 449 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:36:19.323 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:36:19 smithi086 bash[24289]: audit 2024-09-16T05:36:18.950863+0000 mon.a (mon.0) 450 : audit [DBG] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T05:36:19.323 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:36:19 smithi086 bash[24289]: audit 2024-09-16T05:36:18.952745+0000 mon.a (mon.0) 451 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T05:36:19.323 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:36:19 smithi086 bash[24289]: audit 2024-09-16T05:36:18.962597+0000 mon.a (mon.0) 452 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:36:19.340 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:36:19 smithi047 bash[22744]: cluster 2024-09-16T05:36:15.498138+0000 mgr.a (mgr.14150) 185 : cluster [DBG] pgmap v145: 1 pgs: 1 creating+peering; 0 B data, 89 MiB used, 268 GiB / 268 GiB avail 2024-09-16T05:36:19.340 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:36:19 smithi047 bash[22744]: audit 2024-09-16T05:36:17.094217+0000 mon.a (mon.0) 436 : audit [INF] from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-16T05:36:19.341 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:36:19 smithi047 bash[22744]: audit 2024-09-16T05:36:17.095259+0000 mon.a (mon.0) 437 : audit [DBG] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-16T05:36:19.341 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:36:19 smithi047 bash[22744]: audit 2024-09-16T05:36:17.095473+0000 mon.a (mon.0) 438 : audit [DBG] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-16T05:36:19.341 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:36:19 smithi047 bash[22744]: audit 2024-09-16T05:36:17.095682+0000 mon.a (mon.0) 439 : audit [DBG] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-16T05:36:19.341 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:36:19 smithi047 bash[22744]: audit 2024-09-16T05:36:17.100077+0000 mon.c (mon.1) 8 : audit [INF] from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-16T05:36:19.341 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:36:19 smithi047 bash[22744]: audit 2024-09-16T05:36:17.100179+0000 mon.a (mon.0) 440 : audit [DBG] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-16T05:36:19.341 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:36:19 smithi047 bash[22744]: audit 2024-09-16T05:36:17.100542+0000 mon.a (mon.0) 441 : audit [DBG] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-16T05:36:19.341 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:36:19 smithi047 bash[22744]: audit 2024-09-16T05:36:17.100731+0000 mon.a (mon.0) 442 : audit [DBG] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-16T05:36:19.341 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:36:19 smithi047 bash[22744]: cluster 2024-09-16T05:36:17.498755+0000 mgr.a (mgr.14150) 186 : cluster [DBG] pgmap v146: 1 pgs: 1 creating+peering; 0 B data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-16T05:36:19.341 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:36:19 smithi047 bash[22744]: audit 2024-09-16T05:36:18.009320+0000 mon.c (mon.1) 9 : audit [INF] from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-16T05:36:19.341 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:36:19 smithi047 bash[22744]: audit 2024-09-16T05:36:18.013897+0000 mon.b (mon.2) 11 : audit [INF] from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-16T05:36:19.341 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:36:19 smithi047 bash[22744]: audit 2024-09-16T05:36:18.017434+0000 mon.a (mon.0) 443 : audit [DBG] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-16T05:36:19.341 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:36:19 smithi047 bash[22744]: audit 2024-09-16T05:36:18.017752+0000 mon.a (mon.0) 444 : audit [DBG] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-16T05:36:19.341 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:36:19 smithi047 bash[22744]: audit 2024-09-16T05:36:18.018032+0000 mon.a (mon.0) 445 : audit [DBG] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-16T05:36:19.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:36:19 smithi047 bash[22744]: cephadm 2024-09-16T05:36:18.322950+0000 mgr.a (mgr.14150) 187 : cephadm [INF] Detected new or changed devices on smithi157 2024-09-16T05:36:19.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:36:19 smithi047 bash[22744]: audit 2024-09-16T05:36:18.912983+0000 mon.b (mon.2) 12 : audit [INF] from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-16T05:36:19.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:36:19 smithi047 bash[22744]: audit 2024-09-16T05:36:18.927989+0000 mon.a (mon.0) 446 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:36:19.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:36:19 smithi047 bash[22744]: audit 2024-09-16T05:36:18.937038+0000 mon.a (mon.0) 447 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:36:19.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:36:19 smithi047 bash[22744]: audit 2024-09-16T05:36:18.939364+0000 mon.a (mon.0) 448 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-16T05:36:19.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:36:19 smithi047 bash[22744]: audit 2024-09-16T05:36:18.946966+0000 mon.a (mon.0) 449 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:36:19.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:36:19 smithi047 bash[22744]: audit 2024-09-16T05:36:18.950863+0000 mon.a (mon.0) 450 : audit [DBG] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T05:36:19.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:36:19 smithi047 bash[22744]: audit 2024-09-16T05:36:18.952745+0000 mon.a (mon.0) 451 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T05:36:19.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:36:19 smithi047 bash[22744]: audit 2024-09-16T05:36:18.962597+0000 mon.a (mon.0) 452 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:36:20.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:36:20 smithi157 bash[24585]: cephadm 2024-09-16T05:36:18.940773+0000 mgr.a (mgr.14150) 188 : cephadm [INF] Adjusting osd_memory_target on smithi157 to 21361M 2024-09-16T05:36:20.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:36:20 smithi086 bash[24289]: cephadm 2024-09-16T05:36:18.940773+0000 mgr.a (mgr.14150) 188 : cephadm [INF] Adjusting osd_memory_target on smithi157 to 21361M 2024-09-16T05:36:20.340 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:36:20 smithi047 bash[22744]: cephadm 2024-09-16T05:36:18.940773+0000 mgr.a (mgr.14150) 188 : cephadm [INF] Adjusting osd_memory_target on smithi157 to 21361M 2024-09-16T05:36:21.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:36:21 smithi157 bash[24585]: cluster 2024-09-16T05:36:19.499354+0000 mgr.a (mgr.14150) 189 : cluster [DBG] pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail 2024-09-16T05:36:21.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:36:21 smithi086 bash[24289]: cluster 2024-09-16T05:36:19.499354+0000 mgr.a (mgr.14150) 189 : cluster [DBG] pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail 2024-09-16T05:36:21.340 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:36:21 smithi047 bash[22744]: cluster 2024-09-16T05:36:19.499354+0000 mgr.a (mgr.14150) 189 : cluster [DBG] pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail 2024-09-16T05:36:21.343 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/a6097908-73ec-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T05:36:22.714 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-16T05:36:22.714 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":22,"fsid":"a6097908-73ec-11ef-bceb-c7b262605968","created":"2024-09-16T05:30:49.835835+0000","modified":"2024-09-16T05:36:14.129264+0000","last_up_change":"2024-09-16T05:36:09.630549+0000","last_in_change":"2024-09-16T05:35:40.535494+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":8,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T05:36:12.074171+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":3,"score_stable":3,"optimal_score":1,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4c5a9762-a13b-44ef-aec2-96695c85a9dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":299634748},{"type":"v1","addr":"172.21.15.47:6803","nonce":299634748}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":299634748},{"type":"v1","addr":"172.21.15.47:6805","nonce":299634748}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":299634748},{"type":"v1","addr":"172.21.15.47:6809","nonce":299634748}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":299634748},{"type":"v1","addr":"172.21.15.47:6807","nonce":299634748}]},"public_addr":"172.21.15.47:6803/299634748","cluster_addr":"172.21.15.47:6805/299634748","heartbeat_back_addr":"172.21.15.47:6809/299634748","heartbeat_front_addr":"172.21.15.47:6807/299634748","state":["exists","up"]},{"osd":1,"uuid":"10a1acb4-c530-44b2-a9bf-35740cf4cbba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6800","nonce":263439805},{"type":"v1","addr":"172.21.15.86:6801","nonce":263439805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":263439805},{"type":"v1","addr":"172.21.15.86:6803","nonce":263439805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":263439805},{"type":"v1","addr":"172.21.15.86:6807","nonce":263439805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":263439805},{"type":"v1","addr":"172.21.15.86:6805","nonce":263439805}]},"public_addr":"172.21.15.86:6801/263439805","cluster_addr":"172.21.15.86:6803/263439805","heartbeat_back_addr":"172.21.15.86:6807/263439805","heartbeat_front_addr":"172.21.15.86:6805/263439805","state":["exists","up"]},{"osd":2,"uuid":"c7c829b2-ed90-4d89-b1a9-5fa8df57409c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":2902103460},{"type":"v1","addr":"172.21.15.157:6801","nonce":2902103460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":2902103460},{"type":"v1","addr":"172.21.15.157:6803","nonce":2902103460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":2902103460},{"type":"v1","addr":"172.21.15.157:6807","nonce":2902103460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":2902103460},{"type":"v1","addr":"172.21.15.157:6805","nonce":2902103460}]},"public_addr":"172.21.15.157:6801/2902103460","cluster_addr":"172.21.15.157:6803/2902103460","heartbeat_back_addr":"172.21.15.157:6807/2902103460","heartbeat_front_addr":"172.21.15.157:6805/2902103460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T05:34:28.213440+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T05:35:19.828002+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T05:36:08.275450+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.47:0/126901360":"2024-09-17T05:31:49.433028+0000","172.21.15.47:0/692560437":"2024-09-17T05:31:49.433028+0000","172.21.15.47:0/1142107292":"2024-09-17T05:31:49.433028+0000","172.21.15.47:0/2521615592":"2024-09-17T05:31:16.780506+0000","172.21.15.47:6801/4215135154":"2024-09-17T05:31:16.780506+0000","172.21.15.47:6800/4215135154":"2024-09-17T05:31:16.780506+0000","172.21.15.47:6801/980092451":"2024-09-17T05:31:49.433028+0000","172.21.15.47:6800/980092451":"2024-09-17T05:31:49.433028+0000","172.21.15.47:0/506732191":"2024-09-17T05:31:16.780506+0000","172.21.15.47:0/3764965912":"2024-09-17T05:31:16.780506+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T05:36:23.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:36:23 smithi157 bash[24585]: cluster 2024-09-16T05:36:21.499927+0000 mgr.a (mgr.14150) 190 : cluster [DBG] pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail 2024-09-16T05:36:23.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:36:23 smithi157 bash[24585]: audit 2024-09-16T05:36:22.713757+0000 mon.a (mon.0) 453 : audit [DBG] from='client.? 172.21.15.47:0/774565699' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-16T05:36:23.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:36:23 smithi086 bash[24289]: cluster 2024-09-16T05:36:21.499927+0000 mgr.a (mgr.14150) 190 : cluster [DBG] pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail 2024-09-16T05:36:23.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:36:23 smithi086 bash[24289]: audit 2024-09-16T05:36:22.713757+0000 mon.a (mon.0) 453 : audit [DBG] from='client.? 172.21.15.47:0/774565699' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-16T05:36:23.340 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:36:23 smithi047 bash[22744]: cluster 2024-09-16T05:36:21.499927+0000 mgr.a (mgr.14150) 190 : cluster [DBG] pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail 2024-09-16T05:36:23.340 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:36:23 smithi047 bash[22744]: audit 2024-09-16T05:36:22.713757+0000 mon.a (mon.0) 453 : audit [DBG] from='client.? 172.21.15.47:0/774565699' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-16T05:36:23.390 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-16T05:36:12.074171+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 3, 'score_stable': 3, 'optimal_score': 1, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-16T05:36:23.391 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid a6097908-73ec-11ef-bceb-c7b262605968 -- ceph osd pool get .mgr pg_num 2024-09-16T05:36:25.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:36:25 smithi157 bash[24585]: cluster 2024-09-16T05:36:23.500599+0000 mgr.a (mgr.14150) 191 : cluster [DBG] pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 65 KiB/s wr, 5 op/s 2024-09-16T05:36:25.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:36:25 smithi086 bash[24289]: cluster 2024-09-16T05:36:23.500599+0000 mgr.a (mgr.14150) 191 : cluster [DBG] pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 65 KiB/s wr, 5 op/s 2024-09-16T05:36:25.340 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:36:25 smithi047 bash[22744]: cluster 2024-09-16T05:36:23.500599+0000 mgr.a (mgr.14150) 191 : cluster [DBG] pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 65 KiB/s wr, 5 op/s 2024-09-16T05:36:27.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:36:27 smithi157 bash[24585]: cluster 2024-09-16T05:36:25.501270+0000 mgr.a (mgr.14150) 192 : cluster [DBG] pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 44 KiB/s wr, 3 op/s 2024-09-16T05:36:27.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:36:27 smithi086 bash[24289]: cluster 2024-09-16T05:36:25.501270+0000 mgr.a (mgr.14150) 192 : cluster [DBG] pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 44 KiB/s wr, 3 op/s 2024-09-16T05:36:27.340 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:36:27 smithi047 bash[22744]: cluster 2024-09-16T05:36:25.501270+0000 mgr.a (mgr.14150) 192 : cluster [DBG] pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 44 KiB/s wr, 3 op/s 2024-09-16T05:36:28.129 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/a6097908-73ec-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T05:36:29.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:36:29 smithi157 bash[24585]: cluster 2024-09-16T05:36:27.501887+0000 mgr.a (mgr.14150) 193 : cluster [DBG] pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 33 KiB/s wr, 2 op/s 2024-09-16T05:36:29.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:36:29 smithi086 bash[24289]: cluster 2024-09-16T05:36:27.501887+0000 mgr.a (mgr.14150) 193 : cluster [DBG] pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 33 KiB/s wr, 2 op/s 2024-09-16T05:36:29.340 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:36:29 smithi047 bash[22744]: cluster 2024-09-16T05:36:27.501887+0000 mgr.a (mgr.14150) 193 : cluster [DBG] pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 33 KiB/s wr, 2 op/s 2024-09-16T05:36:29.444 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 1 2024-09-16T05:36:30.109 INFO:tasks.cephadm:Setting up client nodes... 2024-09-16T05:36:30.109 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-16T05:36:30.110 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-09-16T05:36:30.110 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid a6097908-73ec-11ef-bceb-c7b262605968 -- ceph mgr dump --format=json 2024-09-16T05:36:30.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:36:30 smithi157 bash[24585]: audit 2024-09-16T05:36:29.444684+0000 mon.a (mon.0) 454 : audit [DBG] from='client.? 172.21.15.47:0/4121538116' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-16T05:36:30.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:36:30 smithi086 bash[24289]: audit 2024-09-16T05:36:29.444684+0000 mon.a (mon.0) 454 : audit [DBG] from='client.? 172.21.15.47:0/4121538116' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-16T05:36:30.340 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:36:30 smithi047 bash[22744]: audit 2024-09-16T05:36:29.444684+0000 mon.a (mon.0) 454 : audit [DBG] from='client.? 172.21.15.47:0/4121538116' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-16T05:36:31.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:36:31 smithi157 bash[24585]: cluster 2024-09-16T05:36:29.502270+0000 mgr.a (mgr.14150) 194 : cluster [DBG] pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 921 B/s rd, 26 KiB/s wr, 2 op/s 2024-09-16T05:36:31.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:36:31 smithi086 bash[24289]: cluster 2024-09-16T05:36:29.502270+0000 mgr.a (mgr.14150) 194 : cluster [DBG] pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 921 B/s rd, 26 KiB/s wr, 2 op/s 2024-09-16T05:36:31.340 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:36:31 smithi047 bash[22744]: cluster 2024-09-16T05:36:29.502270+0000 mgr.a (mgr.14150) 194 : cluster [DBG] pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 921 B/s rd, 26 KiB/s wr, 2 op/s 2024-09-16T05:36:33.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:36:33 smithi157 bash[24585]: cluster 2024-09-16T05:36:31.502858+0000 mgr.a (mgr.14150) 195 : cluster [DBG] pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 767 B/s rd, 22 KiB/s wr, 1 op/s 2024-09-16T05:36:33.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:36:33 smithi086 bash[24289]: cluster 2024-09-16T05:36:31.502858+0000 mgr.a (mgr.14150) 195 : cluster [DBG] pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 767 B/s rd, 22 KiB/s wr, 1 op/s 2024-09-16T05:36:33.340 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:36:33 smithi047 bash[22744]: cluster 2024-09-16T05:36:31.502858+0000 mgr.a (mgr.14150) 195 : cluster [DBG] pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 767 B/s rd, 22 KiB/s wr, 1 op/s 2024-09-16T05:36:34.848 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/a6097908-73ec-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T05:36:35.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:36:35 smithi086 bash[24289]: cluster 2024-09-16T05:36:33.503510+0000 mgr.a (mgr.14150) 196 : cluster [DBG] pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 767 B/s rd, 22 KiB/s wr, 1 op/s 2024-09-16T05:36:35.340 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:36:35 smithi047 bash[22744]: cluster 2024-09-16T05:36:33.503510+0000 mgr.a (mgr.14150) 196 : cluster [DBG] pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 767 B/s rd, 22 KiB/s wr, 1 op/s 2024-09-16T05:36:35.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:36:35 smithi157 bash[24585]: cluster 2024-09-16T05:36:33.503510+0000 mgr.a (mgr.14150) 196 : cluster [DBG] pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 767 B/s rd, 22 KiB/s wr, 1 op/s 2024-09-16T05:36:36.314 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-16T05:36:36.997 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":15,"flags":0,"active_gid":14150,"active_name":"a","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6800","nonce":2843718786},{"type":"v1","addr":"172.21.15.47:6801","nonce":2843718786}]},"active_addr":"172.21.15.47:6801/2843718786","active_change":"2024-09-16T05:31:49.433275+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":24110,"name":"b","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.47:8443/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":3,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.47:0","nonce":3654554402}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.47:0","nonce":783043594}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.47:0","nonce":2960588524}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.47:0","nonce":1310919431}]}]} 2024-09-16T05:36:37.001 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-09-16T05:36:37.001 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-09-16T05:36:37.002 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid a6097908-73ec-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-16T05:36:37.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:36:37 smithi086 bash[24289]: cluster 2024-09-16T05:36:35.504186+0000 mgr.a (mgr.14150) 197 : cluster [DBG] pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail 2024-09-16T05:36:37.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:36:37 smithi086 bash[24289]: audit 2024-09-16T05:36:36.306530+0000 mon.a (mon.0) 455 : audit [DBG] from='client.? 172.21.15.47:0/4182499441' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-16T05:36:37.340 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:36:37 smithi047 bash[22744]: cluster 2024-09-16T05:36:35.504186+0000 mgr.a (mgr.14150) 197 : cluster [DBG] pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail 2024-09-16T05:36:37.340 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:36:37 smithi047 bash[22744]: audit 2024-09-16T05:36:36.306530+0000 mon.a (mon.0) 455 : audit [DBG] from='client.? 172.21.15.47:0/4182499441' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-16T05:36:37.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:36:37 smithi157 bash[24585]: cluster 2024-09-16T05:36:35.504186+0000 mgr.a (mgr.14150) 197 : cluster [DBG] pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail 2024-09-16T05:36:37.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:36:37 smithi157 bash[24585]: audit 2024-09-16T05:36:36.306530+0000 mon.a (mon.0) 455 : audit [DBG] from='client.? 172.21.15.47:0/4182499441' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-16T05:36:39.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:36:39 smithi086 bash[24289]: cluster 2024-09-16T05:36:37.504760+0000 mgr.a (mgr.14150) 198 : cluster [DBG] pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail 2024-09-16T05:36:39.340 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:36:39 smithi047 bash[22744]: cluster 2024-09-16T05:36:37.504760+0000 mgr.a (mgr.14150) 198 : cluster [DBG] pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail 2024-09-16T05:36:39.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:36:39 smithi157 bash[24585]: cluster 2024-09-16T05:36:37.504760+0000 mgr.a (mgr.14150) 198 : cluster [DBG] pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail 2024-09-16T05:36:41.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:36:41 smithi086 bash[24289]: cluster 2024-09-16T05:36:39.505393+0000 mgr.a (mgr.14150) 199 : cluster [DBG] pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail 2024-09-16T05:36:41.340 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:36:41 smithi047 bash[22744]: cluster 2024-09-16T05:36:39.505393+0000 mgr.a (mgr.14150) 199 : cluster [DBG] pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail 2024-09-16T05:36:41.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:36:41 smithi157 bash[24585]: cluster 2024-09-16T05:36:39.505393+0000 mgr.a (mgr.14150) 199 : cluster [DBG] pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail 2024-09-16T05:36:41.747 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/a6097908-73ec-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T05:36:43.025 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-16T05:36:43.025 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":22,"fsid":"a6097908-73ec-11ef-bceb-c7b262605968","created":"2024-09-16T05:30:49.835835+0000","modified":"2024-09-16T05:36:14.129264+0000","last_up_change":"2024-09-16T05:36:09.630549+0000","last_in_change":"2024-09-16T05:35:40.535494+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":8,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T05:36:12.074171+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":3,"score_stable":3,"optimal_score":1,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4c5a9762-a13b-44ef-aec2-96695c85a9dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":299634748},{"type":"v1","addr":"172.21.15.47:6803","nonce":299634748}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":299634748},{"type":"v1","addr":"172.21.15.47:6805","nonce":299634748}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":299634748},{"type":"v1","addr":"172.21.15.47:6809","nonce":299634748}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":299634748},{"type":"v1","addr":"172.21.15.47:6807","nonce":299634748}]},"public_addr":"172.21.15.47:6803/299634748","cluster_addr":"172.21.15.47:6805/299634748","heartbeat_back_addr":"172.21.15.47:6809/299634748","heartbeat_front_addr":"172.21.15.47:6807/299634748","state":["exists","up"]},{"osd":1,"uuid":"10a1acb4-c530-44b2-a9bf-35740cf4cbba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6800","nonce":263439805},{"type":"v1","addr":"172.21.15.86:6801","nonce":263439805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":263439805},{"type":"v1","addr":"172.21.15.86:6803","nonce":263439805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":263439805},{"type":"v1","addr":"172.21.15.86:6807","nonce":263439805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":263439805},{"type":"v1","addr":"172.21.15.86:6805","nonce":263439805}]},"public_addr":"172.21.15.86:6801/263439805","cluster_addr":"172.21.15.86:6803/263439805","heartbeat_back_addr":"172.21.15.86:6807/263439805","heartbeat_front_addr":"172.21.15.86:6805/263439805","state":["exists","up"]},{"osd":2,"uuid":"c7c829b2-ed90-4d89-b1a9-5fa8df57409c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":2902103460},{"type":"v1","addr":"172.21.15.157:6801","nonce":2902103460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":2902103460},{"type":"v1","addr":"172.21.15.157:6803","nonce":2902103460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":2902103460},{"type":"v1","addr":"172.21.15.157:6807","nonce":2902103460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":2902103460},{"type":"v1","addr":"172.21.15.157:6805","nonce":2902103460}]},"public_addr":"172.21.15.157:6801/2902103460","cluster_addr":"172.21.15.157:6803/2902103460","heartbeat_back_addr":"172.21.15.157:6807/2902103460","heartbeat_front_addr":"172.21.15.157:6805/2902103460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T05:34:28.213440+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T05:35:19.828002+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T05:36:08.275450+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.47:0/126901360":"2024-09-17T05:31:49.433028+0000","172.21.15.47:0/692560437":"2024-09-17T05:31:49.433028+0000","172.21.15.47:0/1142107292":"2024-09-17T05:31:49.433028+0000","172.21.15.47:0/2521615592":"2024-09-17T05:31:16.780506+0000","172.21.15.47:6801/4215135154":"2024-09-17T05:31:16.780506+0000","172.21.15.47:6800/4215135154":"2024-09-17T05:31:16.780506+0000","172.21.15.47:6801/980092451":"2024-09-17T05:31:49.433028+0000","172.21.15.47:6800/980092451":"2024-09-17T05:31:49.433028+0000","172.21.15.47:0/506732191":"2024-09-17T05:31:16.780506+0000","172.21.15.47:0/3764965912":"2024-09-17T05:31:16.780506+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T05:36:43.340 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:36:43 smithi047 bash[22744]: cluster 2024-09-16T05:36:41.506063+0000 mgr.a (mgr.14150) 200 : cluster [DBG] pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail 2024-09-16T05:36:43.340 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:36:43 smithi047 bash[22744]: audit 2024-09-16T05:36:43.025653+0000 mon.a (mon.0) 456 : audit [DBG] from='client.? 172.21.15.47:0/1192063390' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-16T05:36:43.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:36:43 smithi157 bash[24585]: cluster 2024-09-16T05:36:41.506063+0000 mgr.a (mgr.14150) 200 : cluster [DBG] pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail 2024-09-16T05:36:43.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:36:43 smithi157 bash[24585]: audit 2024-09-16T05:36:43.025653+0000 mon.a (mon.0) 456 : audit [DBG] from='client.? 172.21.15.47:0/1192063390' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-16T05:36:43.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:36:43 smithi086 bash[24289]: cluster 2024-09-16T05:36:41.506063+0000 mgr.a (mgr.14150) 200 : cluster [DBG] pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail 2024-09-16T05:36:43.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:36:43 smithi086 bash[24289]: audit 2024-09-16T05:36:43.025653+0000 mon.a (mon.0) 456 : audit [DBG] from='client.? 172.21.15.47:0/1192063390' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-16T05:36:43.735 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-09-16T05:36:43.735 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid a6097908-73ec-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-16T05:36:45.340 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:36:45 smithi047 bash[22744]: cluster 2024-09-16T05:36:43.506697+0000 mgr.a (mgr.14150) 201 : cluster [DBG] pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail 2024-09-16T05:36:45.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:36:45 smithi157 bash[24585]: cluster 2024-09-16T05:36:43.506697+0000 mgr.a (mgr.14150) 201 : cluster [DBG] pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail 2024-09-16T05:36:45.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:36:45 smithi086 bash[24289]: cluster 2024-09-16T05:36:43.506697+0000 mgr.a (mgr.14150) 201 : cluster [DBG] pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail 2024-09-16T05:36:47.340 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:36:47 smithi047 bash[22744]: cluster 2024-09-16T05:36:45.507323+0000 mgr.a (mgr.14150) 202 : cluster [DBG] pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail 2024-09-16T05:36:47.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:36:47 smithi157 bash[24585]: cluster 2024-09-16T05:36:45.507323+0000 mgr.a (mgr.14150) 202 : cluster [DBG] pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail 2024-09-16T05:36:47.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:36:47 smithi086 bash[24289]: cluster 2024-09-16T05:36:45.507323+0000 mgr.a (mgr.14150) 202 : cluster [DBG] pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail 2024-09-16T05:36:48.481 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/a6097908-73ec-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T05:36:49.340 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:36:49 smithi047 bash[22744]: cluster 2024-09-16T05:36:47.507992+0000 mgr.a (mgr.14150) 203 : cluster [DBG] pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail 2024-09-16T05:36:49.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:36:49 smithi157 bash[24585]: cluster 2024-09-16T05:36:47.507992+0000 mgr.a (mgr.14150) 203 : cluster [DBG] pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail 2024-09-16T05:36:49.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:36:49 smithi086 bash[24289]: cluster 2024-09-16T05:36:47.507992+0000 mgr.a (mgr.14150) 203 : cluster [DBG] pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail 2024-09-16T05:36:49.844 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-16T05:36:49.844 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":22,"fsid":"a6097908-73ec-11ef-bceb-c7b262605968","created":"2024-09-16T05:30:49.835835+0000","modified":"2024-09-16T05:36:14.129264+0000","last_up_change":"2024-09-16T05:36:09.630549+0000","last_in_change":"2024-09-16T05:35:40.535494+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":8,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T05:36:12.074171+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":3,"score_stable":3,"optimal_score":1,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4c5a9762-a13b-44ef-aec2-96695c85a9dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":299634748},{"type":"v1","addr":"172.21.15.47:6803","nonce":299634748}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":299634748},{"type":"v1","addr":"172.21.15.47:6805","nonce":299634748}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":299634748},{"type":"v1","addr":"172.21.15.47:6809","nonce":299634748}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":299634748},{"type":"v1","addr":"172.21.15.47:6807","nonce":299634748}]},"public_addr":"172.21.15.47:6803/299634748","cluster_addr":"172.21.15.47:6805/299634748","heartbeat_back_addr":"172.21.15.47:6809/299634748","heartbeat_front_addr":"172.21.15.47:6807/299634748","state":["exists","up"]},{"osd":1,"uuid":"10a1acb4-c530-44b2-a9bf-35740cf4cbba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6800","nonce":263439805},{"type":"v1","addr":"172.21.15.86:6801","nonce":263439805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":263439805},{"type":"v1","addr":"172.21.15.86:6803","nonce":263439805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":263439805},{"type":"v1","addr":"172.21.15.86:6807","nonce":263439805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":263439805},{"type":"v1","addr":"172.21.15.86:6805","nonce":263439805}]},"public_addr":"172.21.15.86:6801/263439805","cluster_addr":"172.21.15.86:6803/263439805","heartbeat_back_addr":"172.21.15.86:6807/263439805","heartbeat_front_addr":"172.21.15.86:6805/263439805","state":["exists","up"]},{"osd":2,"uuid":"c7c829b2-ed90-4d89-b1a9-5fa8df57409c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":2902103460},{"type":"v1","addr":"172.21.15.157:6801","nonce":2902103460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":2902103460},{"type":"v1","addr":"172.21.15.157:6803","nonce":2902103460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":2902103460},{"type":"v1","addr":"172.21.15.157:6807","nonce":2902103460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":2902103460},{"type":"v1","addr":"172.21.15.157:6805","nonce":2902103460}]},"public_addr":"172.21.15.157:6801/2902103460","cluster_addr":"172.21.15.157:6803/2902103460","heartbeat_back_addr":"172.21.15.157:6807/2902103460","heartbeat_front_addr":"172.21.15.157:6805/2902103460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T05:34:28.213440+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T05:35:19.828002+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T05:36:08.275450+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.47:0/126901360":"2024-09-17T05:31:49.433028+0000","172.21.15.47:0/692560437":"2024-09-17T05:31:49.433028+0000","172.21.15.47:0/1142107292":"2024-09-17T05:31:49.433028+0000","172.21.15.47:0/2521615592":"2024-09-17T05:31:16.780506+0000","172.21.15.47:6801/4215135154":"2024-09-17T05:31:16.780506+0000","172.21.15.47:6800/4215135154":"2024-09-17T05:31:16.780506+0000","172.21.15.47:6801/980092451":"2024-09-17T05:31:49.433028+0000","172.21.15.47:6800/980092451":"2024-09-17T05:31:49.433028+0000","172.21.15.47:0/506732191":"2024-09-17T05:31:16.780506+0000","172.21.15.47:0/3764965912":"2024-09-17T05:31:16.780506+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T05:36:50.340 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:36:50 smithi047 bash[22744]: audit 2024-09-16T05:36:49.844705+0000 mon.a (mon.0) 457 : audit [DBG] from='client.? 172.21.15.47:0/1126352878' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-16T05:36:50.529 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid a6097908-73ec-11ef-bceb-c7b262605968 -- ceph tell osd.0 flush_pg_stats 2024-09-16T05:36:50.529 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid a6097908-73ec-11ef-bceb-c7b262605968 -- ceph tell osd.1 flush_pg_stats 2024-09-16T05:36:50.530 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid a6097908-73ec-11ef-bceb-c7b262605968 -- ceph tell osd.2 flush_pg_stats 2024-09-16T05:36:50.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:36:50 smithi157 bash[24585]: audit 2024-09-16T05:36:49.844705+0000 mon.a (mon.0) 457 : audit [DBG] from='client.? 172.21.15.47:0/1126352878' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-16T05:36:50.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:36:50 smithi086 bash[24289]: audit 2024-09-16T05:36:49.844705+0000 mon.a (mon.0) 457 : audit [DBG] from='client.? 172.21.15.47:0/1126352878' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-16T05:36:51.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:36:51 smithi157 bash[24585]: cluster 2024-09-16T05:36:49.508388+0000 mgr.a (mgr.14150) 204 : cluster [DBG] pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail 2024-09-16T05:36:51.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:36:51 smithi086 bash[24289]: cluster 2024-09-16T05:36:49.508388+0000 mgr.a (mgr.14150) 204 : cluster [DBG] pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail 2024-09-16T05:36:51.590 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:36:51 smithi047 bash[22744]: cluster 2024-09-16T05:36:49.508388+0000 mgr.a (mgr.14150) 204 : cluster [DBG] pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail 2024-09-16T05:36:53.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:36:53 smithi157 bash[24585]: cluster 2024-09-16T05:36:51.508948+0000 mgr.a (mgr.14150) 205 : cluster [DBG] pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail 2024-09-16T05:36:53.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:36:53 smithi086 bash[24289]: cluster 2024-09-16T05:36:51.508948+0000 mgr.a (mgr.14150) 205 : cluster [DBG] pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail 2024-09-16T05:36:53.590 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:36:53 smithi047 bash[22744]: cluster 2024-09-16T05:36:51.508948+0000 mgr.a (mgr.14150) 205 : cluster [DBG] pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail 2024-09-16T05:36:55.276 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/a6097908-73ec-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T05:36:55.277 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/a6097908-73ec-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T05:36:55.277 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/a6097908-73ec-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T05:36:55.453 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:36:55 smithi047 bash[22744]: cluster 2024-09-16T05:36:53.509557+0000 mgr.a (mgr.14150) 206 : cluster [DBG] pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail 2024-09-16T05:36:55.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:36:55 smithi157 bash[24585]: cluster 2024-09-16T05:36:53.509557+0000 mgr.a (mgr.14150) 206 : cluster [DBG] pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail 2024-09-16T05:36:55.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:36:55 smithi086 bash[24289]: cluster 2024-09-16T05:36:53.509557+0000 mgr.a (mgr.14150) 206 : cluster [DBG] pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail 2024-09-16T05:36:57.450 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:36:57 smithi047 bash[22744]: cluster 2024-09-16T05:36:55.510163+0000 mgr.a (mgr.14150) 207 : cluster [DBG] pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail 2024-09-16T05:36:57.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:36:57 smithi157 bash[24585]: cluster 2024-09-16T05:36:55.510163+0000 mgr.a (mgr.14150) 207 : cluster [DBG] pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail 2024-09-16T05:36:57.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:36:57 smithi086 bash[24289]: cluster 2024-09-16T05:36:55.510163+0000 mgr.a (mgr.14150) 207 : cluster [DBG] pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail 2024-09-16T05:36:58.354 INFO:teuthology.orchestra.run.smithi047.stdout:55834574870 2024-09-16T05:36:58.354 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid a6097908-73ec-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.1 2024-09-16T05:36:58.459 INFO:teuthology.orchestra.run.smithi047.stdout:34359738401 2024-09-16T05:36:58.460 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid a6097908-73ec-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.0 2024-09-16T05:36:58.600 INFO:teuthology.orchestra.run.smithi047.stdout:77309411341 2024-09-16T05:36:58.600 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid a6097908-73ec-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.2 2024-09-16T05:36:59.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:36:59 smithi157 bash[24585]: cluster 2024-09-16T05:36:57.510850+0000 mgr.a (mgr.14150) 208 : cluster [DBG] pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail 2024-09-16T05:36:59.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:36:59 smithi086 bash[24289]: cluster 2024-09-16T05:36:57.510850+0000 mgr.a (mgr.14150) 208 : cluster [DBG] pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail 2024-09-16T05:36:59.590 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:36:59 smithi047 bash[22744]: cluster 2024-09-16T05:36:57.510850+0000 mgr.a (mgr.14150) 208 : cluster [DBG] pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail 2024-09-16T05:37:01.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:37:01 smithi157 bash[24585]: cluster 2024-09-16T05:36:59.511539+0000 mgr.a (mgr.14150) 209 : cluster [DBG] pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail 2024-09-16T05:37:01.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:37:01 smithi086 bash[24289]: cluster 2024-09-16T05:36:59.511539+0000 mgr.a (mgr.14150) 209 : cluster [DBG] pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail 2024-09-16T05:37:01.590 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:37:01 smithi047 bash[22744]: cluster 2024-09-16T05:36:59.511539+0000 mgr.a (mgr.14150) 209 : cluster [DBG] pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail 2024-09-16T05:37:03.104 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/a6097908-73ec-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T05:37:03.105 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/a6097908-73ec-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T05:37:03.105 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/a6097908-73ec-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T05:37:03.373 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:37:03 smithi047 bash[22744]: cluster 2024-09-16T05:37:01.512212+0000 mgr.a (mgr.14150) 210 : cluster [DBG] pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail 2024-09-16T05:37:03.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:37:03 smithi157 bash[24585]: cluster 2024-09-16T05:37:01.512212+0000 mgr.a (mgr.14150) 210 : cluster [DBG] pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail 2024-09-16T05:37:03.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:37:03 smithi086 bash[24289]: cluster 2024-09-16T05:37:01.512212+0000 mgr.a (mgr.14150) 210 : cluster [DBG] pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail 2024-09-16T05:37:05.165 INFO:teuthology.orchestra.run.smithi047.stdout:55834574872 2024-09-16T05:37:05.340 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:37:05 smithi047 bash[22744]: cluster 2024-09-16T05:37:03.512906+0000 mgr.a (mgr.14150) 211 : cluster [DBG] pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail 2024-09-16T05:37:05.401 INFO:teuthology.orchestra.run.smithi047.stdout:34359738402 2024-09-16T05:37:05.402 INFO:teuthology.orchestra.run.smithi047.stdout:77309411342 2024-09-16T05:37:05.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:37:05 smithi157 bash[24585]: cluster 2024-09-16T05:37:03.512906+0000 mgr.a (mgr.14150) 211 : cluster [DBG] pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail 2024-09-16T05:37:05.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:37:05 smithi086 bash[24289]: cluster 2024-09-16T05:37:03.512906+0000 mgr.a (mgr.14150) 211 : cluster [DBG] pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail 2024-09-16T05:37:05.913 INFO:tasks.cephadm.ceph_manager.ceph:need seq 55834574870 got 55834574872 for osd.1 2024-09-16T05:37:05.913 DEBUG:teuthology.parallel:result is None 2024-09-16T05:37:06.307 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:37:06 smithi047 bash[22744]: audit 2024-09-16T05:37:05.166479+0000 mon.a (mon.0) 458 : audit [DBG] from='client.? 172.21.15.47:0/1658164738' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-16T05:37:06.307 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:37:06 smithi047 bash[22744]: audit 2024-09-16T05:37:05.403116+0000 mon.a (mon.0) 459 : audit [DBG] from='client.? 172.21.15.47:0/838444458' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-16T05:37:06.307 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:37:06 smithi047 bash[22744]: audit 2024-09-16T05:37:05.403781+0000 mon.a (mon.0) 460 : audit [DBG] from='client.? 172.21.15.47:0/519454618' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-16T05:37:06.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:37:06 smithi157 bash[24585]: audit 2024-09-16T05:37:05.166479+0000 mon.a (mon.0) 458 : audit [DBG] from='client.? 172.21.15.47:0/1658164738' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-16T05:37:06.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:37:06 smithi157 bash[24585]: audit 2024-09-16T05:37:05.403116+0000 mon.a (mon.0) 459 : audit [DBG] from='client.? 172.21.15.47:0/838444458' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-16T05:37:06.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:37:06 smithi157 bash[24585]: audit 2024-09-16T05:37:05.403781+0000 mon.a (mon.0) 460 : audit [DBG] from='client.? 172.21.15.47:0/519454618' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-16T05:37:06.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:37:06 smithi086 bash[24289]: audit 2024-09-16T05:37:05.166479+0000 mon.a (mon.0) 458 : audit [DBG] from='client.? 172.21.15.47:0/1658164738' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-16T05:37:06.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:37:06 smithi086 bash[24289]: audit 2024-09-16T05:37:05.403116+0000 mon.a (mon.0) 459 : audit [DBG] from='client.? 172.21.15.47:0/838444458' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-16T05:37:06.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:37:06 smithi086 bash[24289]: audit 2024-09-16T05:37:05.403781+0000 mon.a (mon.0) 460 : audit [DBG] from='client.? 172.21.15.47:0/519454618' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-16T05:37:06.747 INFO:tasks.cephadm.ceph_manager.ceph:need seq 34359738401 got 34359738402 for osd.0 2024-09-16T05:37:06.747 DEBUG:teuthology.parallel:result is None 2024-09-16T05:37:06.799 INFO:tasks.cephadm.ceph_manager.ceph:need seq 77309411341 got 77309411342 for osd.2 2024-09-16T05:37:06.799 DEBUG:teuthology.parallel:result is None 2024-09-16T05:37:06.799 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-16T05:37:06.800 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid a6097908-73ec-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-16T05:37:07.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:37:07 smithi157 bash[24585]: cluster 2024-09-16T05:37:05.513440+0000 mgr.a (mgr.14150) 212 : cluster [DBG] pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail 2024-09-16T05:37:07.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:37:07 smithi086 bash[24289]: cluster 2024-09-16T05:37:05.513440+0000 mgr.a (mgr.14150) 212 : cluster [DBG] pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail 2024-09-16T05:37:07.590 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:37:07 smithi047 bash[22744]: cluster 2024-09-16T05:37:05.513440+0000 mgr.a (mgr.14150) 212 : cluster [DBG] pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail 2024-09-16T05:37:09.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:37:09 smithi157 bash[24585]: cluster 2024-09-16T05:37:07.513960+0000 mgr.a (mgr.14150) 213 : cluster [DBG] pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail 2024-09-16T05:37:09.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:37:09 smithi086 bash[24289]: cluster 2024-09-16T05:37:07.513960+0000 mgr.a (mgr.14150) 213 : cluster [DBG] pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail 2024-09-16T05:37:09.590 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:37:09 smithi047 bash[22744]: cluster 2024-09-16T05:37:07.513960+0000 mgr.a (mgr.14150) 213 : cluster [DBG] pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail 2024-09-16T05:37:11.537 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/a6097908-73ec-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T05:37:11.762 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:37:11 smithi086 bash[24289]: cluster 2024-09-16T05:37:09.514522+0000 mgr.a (mgr.14150) 214 : cluster [DBG] pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail 2024-09-16T05:37:11.762 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:37:11 smithi157 bash[24585]: cluster 2024-09-16T05:37:09.514522+0000 mgr.a (mgr.14150) 214 : cluster [DBG] pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail 2024-09-16T05:37:11.762 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:37:11 smithi047 bash[22744]: cluster 2024-09-16T05:37:09.514522+0000 mgr.a (mgr.14150) 214 : cluster [DBG] pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail 2024-09-16T05:37:12.926 INFO:teuthology.orchestra.run.smithi047.stderr:dumped all 2024-09-16T05:37:12.926 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-16T05:37:13.340 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:37:13 smithi047 bash[22744]: cluster 2024-09-16T05:37:11.515015+0000 mgr.a (mgr.14150) 215 : cluster [DBG] pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail 2024-09-16T05:37:13.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:37:13 smithi157 bash[24585]: cluster 2024-09-16T05:37:11.515015+0000 mgr.a (mgr.14150) 215 : cluster [DBG] pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail 2024-09-16T05:37:13.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:37:13 smithi086 bash[24289]: cluster 2024-09-16T05:37:11.515015+0000 mgr.a (mgr.14150) 215 : cluster [DBG] pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail 2024-09-16T05:37:13.589 INFO:teuthology.orchestra.run.smithi047.stdout:{"pg_ready":true,"pg_map":{"version":173,"stamp":"2024-09-16T05:37:11.514759+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":281235456,"kb_used":92932,"kb_used_data":2292,"kb_used_omap":4,"kb_used_meta":89339,"kb_avail":281142524,"statfs":{"total":287985106944,"available":287889944576,"internally_reserved":0,"allocated":2347008,"data_stored":1944759,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4785,"internal_metadata":91483471},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003553"},"pg_stats":[{"pgid":"1.0","version":"22'137","reported_seq":186,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T05:36:18.932845+0000","last_change":"2024-09-16T05:36:13.136310+0000","last_active":"2024-09-16T05:36:18.932845+0000","last_peered":"2024-09-16T05:36:18.932845+0000","last_clean":"2024-09-16T05:36:18.932845+0000","last_became_active":"2024-09-16T05:36:13.135503+0000","last_became_peered":"2024-09-16T05:36:13.135503+0000","last_unstale":"2024-09-16T05:36:18.932845+0000","last_undegraded":"2024-09-16T05:36:18.932845+0000","last_fullsized":"2024-09-16T05:36:18.932845+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T05:36:12.124401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T05:36:12.124401+0000","last_clean_scrub_stamp":"2024-09-16T05:36:12.124401+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:20:50.164490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":18,"seq":77309411344,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27788,"kb_used_data":764,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717364,"statfs":{"total":95995035648,"available":95966580736,"internally_reserved":0,"allocated":782336,"data_stored":648253,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574873,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32572,"kb_used_data":764,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712580,"statfs":{"total":95995035648,"available":95961681920,"internally_reserved":0,"allocated":782336,"data_stored":648253,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738404,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32572,"kb_used_data":764,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712580,"statfs":{"total":95995035648,"available":95961681920,"internally_reserved":0,"allocated":782336,"data_stored":648253,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T05:37:13.590 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid a6097908-73ec-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-16T05:37:14.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:37:14 smithi157 bash[24585]: audit 2024-09-16T05:37:12.925711+0000 mgr.a (mgr.14150) 216 : audit [DBG] from='client.14346 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-16T05:37:14.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:37:14 smithi086 bash[24289]: audit 2024-09-16T05:37:12.925711+0000 mgr.a (mgr.14150) 216 : audit [DBG] from='client.14346 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-16T05:37:14.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:37:14 smithi047 bash[22744]: audit 2024-09-16T05:37:12.925711+0000 mgr.a (mgr.14150) 216 : audit [DBG] from='client.14346 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-16T05:37:15.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:37:15 smithi157 bash[24585]: cluster 2024-09-16T05:37:13.515538+0000 mgr.a (mgr.14150) 217 : cluster [DBG] pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail 2024-09-16T05:37:15.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:37:15 smithi086 bash[24289]: cluster 2024-09-16T05:37:13.515538+0000 mgr.a (mgr.14150) 217 : cluster [DBG] pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail 2024-09-16T05:37:15.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:37:15 smithi047 bash[22744]: cluster 2024-09-16T05:37:13.515538+0000 mgr.a (mgr.14150) 217 : cluster [DBG] pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail 2024-09-16T05:37:17.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:37:17 smithi157 bash[24585]: cluster 2024-09-16T05:37:15.516076+0000 mgr.a (mgr.14150) 218 : cluster [DBG] pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail 2024-09-16T05:37:17.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:37:17 smithi086 bash[24289]: cluster 2024-09-16T05:37:15.516076+0000 mgr.a (mgr.14150) 218 : cluster [DBG] pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail 2024-09-16T05:37:17.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:37:17 smithi047 bash[22744]: cluster 2024-09-16T05:37:15.516076+0000 mgr.a (mgr.14150) 218 : cluster [DBG] pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail 2024-09-16T05:37:18.337 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/a6097908-73ec-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T05:37:19.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:37:19 smithi157 bash[24585]: cluster 2024-09-16T05:37:17.516618+0000 mgr.a (mgr.14150) 219 : cluster [DBG] pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail 2024-09-16T05:37:19.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:37:19 smithi157 bash[24585]: audit 2024-09-16T05:37:19.056381+0000 mon.a (mon.0) 461 : audit [DBG] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T05:37:19.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:37:19 smithi086 bash[24289]: cluster 2024-09-16T05:37:17.516618+0000 mgr.a (mgr.14150) 219 : cluster [DBG] pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail 2024-09-16T05:37:19.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:37:19 smithi086 bash[24289]: audit 2024-09-16T05:37:19.056381+0000 mon.a (mon.0) 461 : audit [DBG] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T05:37:19.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:37:19 smithi047 bash[22744]: cluster 2024-09-16T05:37:17.516618+0000 mgr.a (mgr.14150) 219 : cluster [DBG] pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail 2024-09-16T05:37:19.590 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:37:19 smithi047 bash[22744]: audit 2024-09-16T05:37:19.056381+0000 mon.a (mon.0) 461 : audit [DBG] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T05:37:19.622 INFO:teuthology.orchestra.run.smithi047.stderr:dumped all 2024-09-16T05:37:19.622 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-16T05:37:20.251 INFO:teuthology.orchestra.run.smithi047.stdout:{"pg_ready":true,"pg_map":{"version":177,"stamp":"2024-09-16T05:37:19.516825+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":281235456,"kb_used":92932,"kb_used_data":2292,"kb_used_omap":4,"kb_used_meta":89339,"kb_avail":281142524,"statfs":{"total":287985106944,"available":287889944576,"internally_reserved":0,"allocated":2347008,"data_stored":1944759,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4785,"internal_metadata":91483471},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003113"},"pg_stats":[{"pgid":"1.0","version":"22'137","reported_seq":186,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T05:36:18.932845+0000","last_change":"2024-09-16T05:36:13.136310+0000","last_active":"2024-09-16T05:36:18.932845+0000","last_peered":"2024-09-16T05:36:18.932845+0000","last_clean":"2024-09-16T05:36:18.932845+0000","last_became_active":"2024-09-16T05:36:13.135503+0000","last_became_peered":"2024-09-16T05:36:13.135503+0000","last_unstale":"2024-09-16T05:36:18.932845+0000","last_undegraded":"2024-09-16T05:36:18.932845+0000","last_fullsized":"2024-09-16T05:36:18.932845+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T05:36:12.124401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T05:36:12.124401+0000","last_clean_scrub_stamp":"2024-09-16T05:36:12.124401+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:20:50.164490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":18,"seq":77309411345,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27788,"kb_used_data":764,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717364,"statfs":{"total":95995035648,"available":95966580736,"internally_reserved":0,"allocated":782336,"data_stored":648253,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574875,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32572,"kb_used_data":764,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712580,"statfs":{"total":95995035648,"available":95961681920,"internally_reserved":0,"allocated":782336,"data_stored":648253,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738405,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32572,"kb_used_data":764,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712580,"statfs":{"total":95995035648,"available":95961681920,"internally_reserved":0,"allocated":782336,"data_stored":648253,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T05:37:20.252 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-16T05:37:20.252 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-16T05:37:20.252 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-09-16T05:37:20.252 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid a6097908-73ec-11ef-bceb-c7b262605968 -- ceph health --format=json 2024-09-16T05:37:20.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:37:20 smithi157 bash[24585]: audit 2024-09-16T05:37:19.858980+0000 mon.a (mon.0) 462 : audit [DBG] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T05:37:20.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:37:20 smithi157 bash[24585]: audit 2024-09-16T05:37:19.860488+0000 mon.a (mon.0) 463 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T05:37:20.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:37:20 smithi157 bash[24585]: audit 2024-09-16T05:37:19.867851+0000 mon.a (mon.0) 464 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:37:20.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:37:20 smithi086 bash[24289]: audit 2024-09-16T05:37:19.858980+0000 mon.a (mon.0) 462 : audit [DBG] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T05:37:20.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:37:20 smithi086 bash[24289]: audit 2024-09-16T05:37:19.860488+0000 mon.a (mon.0) 463 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T05:37:20.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:37:20 smithi086 bash[24289]: audit 2024-09-16T05:37:19.867851+0000 mon.a (mon.0) 464 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:37:20.590 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:37:20 smithi047 bash[22744]: audit 2024-09-16T05:37:19.858980+0000 mon.a (mon.0) 462 : audit [DBG] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T05:37:20.590 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:37:20 smithi047 bash[22744]: audit 2024-09-16T05:37:19.860488+0000 mon.a (mon.0) 463 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T05:37:20.590 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:37:20 smithi047 bash[22744]: audit 2024-09-16T05:37:19.867851+0000 mon.a (mon.0) 464 : audit [INF] from='mgr.14150 172.21.15.47:0/2315555270' entity='mgr.a' 2024-09-16T05:37:21.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:37:21 smithi157 bash[24585]: cluster 2024-09-16T05:37:19.517020+0000 mgr.a (mgr.14150) 220 : cluster [DBG] pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail 2024-09-16T05:37:21.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:37:21 smithi157 bash[24585]: audit 2024-09-16T05:37:19.623445+0000 mgr.a (mgr.14150) 221 : audit [DBG] from='client.14352 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-16T05:37:21.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:37:21 smithi086 bash[24289]: cluster 2024-09-16T05:37:19.517020+0000 mgr.a (mgr.14150) 220 : cluster [DBG] pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail 2024-09-16T05:37:21.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:37:21 smithi086 bash[24289]: audit 2024-09-16T05:37:19.623445+0000 mgr.a (mgr.14150) 221 : audit [DBG] from='client.14352 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-16T05:37:21.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:37:21 smithi047 bash[22744]: cluster 2024-09-16T05:37:19.517020+0000 mgr.a (mgr.14150) 220 : cluster [DBG] pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail 2024-09-16T05:37:21.590 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:37:21 smithi047 bash[22744]: audit 2024-09-16T05:37:19.623445+0000 mgr.a (mgr.14150) 221 : audit [DBG] from='client.14352 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-16T05:37:23.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:37:23 smithi157 bash[24585]: cluster 2024-09-16T05:37:21.517627+0000 mgr.a (mgr.14150) 222 : cluster [DBG] pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail 2024-09-16T05:37:23.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:37:23 smithi086 bash[24289]: cluster 2024-09-16T05:37:21.517627+0000 mgr.a (mgr.14150) 222 : cluster [DBG] pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail 2024-09-16T05:37:23.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:37:23 smithi047 bash[22744]: cluster 2024-09-16T05:37:21.517627+0000 mgr.a (mgr.14150) 222 : cluster [DBG] pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail 2024-09-16T05:37:24.986 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/a6097908-73ec-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T05:37:25.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:37:25 smithi047 bash[22744]: cluster 2024-09-16T05:37:23.518337+0000 mgr.a (mgr.14150) 223 : cluster [DBG] pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail 2024-09-16T05:37:25.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:37:25 smithi157 bash[24585]: cluster 2024-09-16T05:37:23.518337+0000 mgr.a (mgr.14150) 223 : cluster [DBG] pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail 2024-09-16T05:37:25.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:37:25 smithi086 bash[24289]: cluster 2024-09-16T05:37:23.518337+0000 mgr.a (mgr.14150) 223 : cluster [DBG] pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail 2024-09-16T05:37:26.450 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-16T05:37:26.451 INFO:teuthology.orchestra.run.smithi047.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-16T05:37:27.018 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-09-16T05:37:27.018 INFO:tasks.cephadm:Setup complete, yielding 2024-09-16T05:37:27.018 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-16T05:37:27.028 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi047.front.sepia.ceph.com 2024-09-16T05:37:27.028 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a6097908-73ec-11ef-bceb-c7b262605968 -- bash -c 'ceph mgr module enable rgw' 2024-09-16T05:37:27.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:37:27 smithi047 bash[22744]: cluster 2024-09-16T05:37:25.518881+0000 mgr.a (mgr.14150) 224 : cluster [DBG] pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail 2024-09-16T05:37:27.340 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:37:27 smithi047 bash[22744]: audit 2024-09-16T05:37:26.452428+0000 mon.a (mon.0) 465 : audit [DBG] from='client.? 172.21.15.47:0/2058451480' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-16T05:37:27.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:37:27 smithi157 bash[24585]: cluster 2024-09-16T05:37:25.518881+0000 mgr.a (mgr.14150) 224 : cluster [DBG] pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail 2024-09-16T05:37:27.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:37:27 smithi157 bash[24585]: audit 2024-09-16T05:37:26.452428+0000 mon.a (mon.0) 465 : audit [DBG] from='client.? 172.21.15.47:0/2058451480' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-16T05:37:27.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:37:27 smithi086 bash[24289]: cluster 2024-09-16T05:37:25.518881+0000 mgr.a (mgr.14150) 224 : cluster [DBG] pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail 2024-09-16T05:37:27.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:37:27 smithi086 bash[24289]: audit 2024-09-16T05:37:26.452428+0000 mon.a (mon.0) 465 : audit [DBG] from='client.? 172.21.15.47:0/2058451480' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-16T05:37:29.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:37:29 smithi157 bash[24585]: cluster 2024-09-16T05:37:27.519400+0000 mgr.a (mgr.14150) 225 : cluster [DBG] pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail 2024-09-16T05:37:29.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:37:29 smithi086 bash[24289]: cluster 2024-09-16T05:37:27.519400+0000 mgr.a (mgr.14150) 225 : cluster [DBG] pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail 2024-09-16T05:37:29.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:37:29 smithi047 bash[22744]: cluster 2024-09-16T05:37:27.519400+0000 mgr.a (mgr.14150) 225 : cluster [DBG] pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail 2024-09-16T05:37:31.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:37:31 smithi157 bash[24585]: cluster 2024-09-16T05:37:29.520032+0000 mgr.a (mgr.14150) 226 : cluster [DBG] pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail 2024-09-16T05:37:31.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:37:31 smithi086 bash[24289]: cluster 2024-09-16T05:37:29.520032+0000 mgr.a (mgr.14150) 226 : cluster [DBG] pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail 2024-09-16T05:37:31.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:37:31 smithi047 bash[22744]: cluster 2024-09-16T05:37:29.520032+0000 mgr.a (mgr.14150) 226 : cluster [DBG] pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail 2024-09-16T05:37:31.766 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/a6097908-73ec-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T05:37:33.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:37:33 smithi157 bash[24585]: cluster 2024-09-16T05:37:31.520711+0000 mgr.a (mgr.14150) 227 : cluster [DBG] pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail 2024-09-16T05:37:33.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:37:33 smithi086 bash[24289]: cluster 2024-09-16T05:37:31.520711+0000 mgr.a (mgr.14150) 227 : cluster [DBG] pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail 2024-09-16T05:37:33.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:37:33 smithi047 bash[22744]: cluster 2024-09-16T05:37:31.520711+0000 mgr.a (mgr.14150) 227 : cluster [DBG] pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail 2024-09-16T05:37:34.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:37:34 smithi157 bash[24585]: audit 2024-09-16T05:37:33.210057+0000 mon.a (mon.0) 466 : audit [INF] from='client.? 172.21.15.47:0/2112295531' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "rgw"}]: dispatch 2024-09-16T05:37:34.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:37:34 smithi086 bash[24289]: audit 2024-09-16T05:37:33.210057+0000 mon.a (mon.0) 466 : audit [INF] from='client.? 172.21.15.47:0/2112295531' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "rgw"}]: dispatch 2024-09-16T05:37:34.570 INFO:journalctl@ceph.mgr.b.smithi086.stdout:Sep 16 05:37:34 smithi086 bash[24795]: ignoring --setuser ceph since I am not root 2024-09-16T05:37:34.570 INFO:journalctl@ceph.mgr.b.smithi086.stdout:Sep 16 05:37:34 smithi086 bash[24795]: ignoring --setgroup ceph since I am not root 2024-09-16T05:37:34.570 INFO:journalctl@ceph.mgr.b.smithi086.stdout:Sep 16 05:37:34 smithi086 bash[24795]: debug 2024-09-16T05:37:34.262+0000 7f8d47026640 1 -- 172.21.15.86:0/235159733 <== mon.2 v2:172.21.15.86:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5653ef5bf0e0 con 0x5653ef5c1400 2024-09-16T05:37:34.571 INFO:journalctl@ceph.mgr.b.smithi086.stdout:Sep 16 05:37:34 smithi086 bash[24795]: debug 2024-09-16T05:37:34.370+0000 7f8d49882040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-16T05:37:34.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:37:34 smithi047 bash[22744]: audit 2024-09-16T05:37:33.210057+0000 mon.a (mon.0) 466 : audit [INF] from='client.? 172.21.15.47:0/2112295531' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "rgw"}]: dispatch 2024-09-16T05:37:34.589 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 05:37:34 smithi047 bash[22994]: ignoring --setuser ceph since I am not root 2024-09-16T05:37:34.590 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 05:37:34 smithi047 bash[22994]: ignoring --setgroup ceph since I am not root 2024-09-16T05:37:34.590 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 05:37:34 smithi047 bash[22994]: debug 2024-09-16T05:37:34.378+0000 7fa441e70040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-16T05:37:34.852 INFO:teuthology.run_tasks:Running task rgw_module.apply... 2024-09-16T05:37:34.885 INFO:tasks.rgw_module:Applying spec(s): rgw_realm: myrealm1 rgw_zone: myzone1 rgw_zonegroup: myzonegroup1 spec: rgw_frontend_port: 5500 2024-09-16T05:37:34.885 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a6097908-73ec-11ef-bceb-c7b262605968 -- ceph rgw realm bootstrap -i - 2024-09-16T05:37:35.544 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:37:35 smithi086 bash[24289]: audit 2024-09-16T05:37:34.208381+0000 mon.a (mon.0) 467 : audit [INF] from='client.? 172.21.15.47:0/2112295531' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "rgw"}]': finished 2024-09-16T05:37:35.545 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:37:35 smithi086 bash[24289]: cluster 2024-09-16T05:37:34.216647+0000 mon.a (mon.0) 468 : cluster [DBG] mgrmap e16: a(active, since 5m), standbys: b 2024-09-16T05:37:35.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:37:35 smithi157 bash[24585]: audit 2024-09-16T05:37:34.208381+0000 mon.a (mon.0) 467 : audit [INF] from='client.? 172.21.15.47:0/2112295531' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "rgw"}]': finished 2024-09-16T05:37:35.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:37:35 smithi157 bash[24585]: cluster 2024-09-16T05:37:34.216647+0000 mon.a (mon.0) 468 : cluster [DBG] mgrmap e16: a(active, since 5m), standbys: b 2024-09-16T05:37:35.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:37:35 smithi047 bash[22744]: audit 2024-09-16T05:37:34.208381+0000 mon.a (mon.0) 467 : audit [INF] from='client.? 172.21.15.47:0/2112295531' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "rgw"}]': finished 2024-09-16T05:37:35.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:37:35 smithi047 bash[22744]: cluster 2024-09-16T05:37:34.216647+0000 mon.a (mon.0) 468 : cluster [DBG] mgrmap e16: a(active, since 5m), standbys: b 2024-09-16T05:37:35.820 INFO:journalctl@ceph.mgr.b.smithi086.stdout:Sep 16 05:37:35 smithi086 bash[24795]: debug 2024-09-16T05:37:35.538+0000 7f8d49882040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-16T05:37:35.820 INFO:journalctl@ceph.mgr.b.smithi086.stdout:Sep 16 05:37:35 smithi086 bash[24795]: debug 2024-09-16T05:37:35.602+0000 7f8d49882040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-16T05:37:35.820 INFO:journalctl@ceph.mgr.b.smithi086.stdout:Sep 16 05:37:35 smithi086 bash[24795]: debug 2024-09-16T05:37:35.750+0000 7f8d49882040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-16T05:37:36.089 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 05:37:35 smithi047 bash[22994]: debug 2024-09-16T05:37:35.626+0000 7fa441e70040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-16T05:37:36.090 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 05:37:35 smithi047 bash[22994]: debug 2024-09-16T05:37:35.690+0000 7fa441e70040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-16T05:37:36.090 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 05:37:35 smithi047 bash[22994]: debug 2024-09-16T05:37:35.850+0000 7fa441e70040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-16T05:37:36.719 INFO:journalctl@ceph.mgr.b.smithi086.stdout:Sep 16 05:37:36 smithi086 bash[24795]: debug 2024-09-16T05:37:36.394+0000 7f8d49882040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-16T05:37:36.719 INFO:journalctl@ceph.mgr.b.smithi086.stdout:Sep 16 05:37:36 smithi086 bash[24795]: debug 2024-09-16T05:37:36.462+0000 7f8d49882040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-16T05:37:36.719 INFO:journalctl@ceph.mgr.b.smithi086.stdout:Sep 16 05:37:36 smithi086 bash[24795]: debug 2024-09-16T05:37:36.530+0000 7f8d49882040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-16T05:37:36.839 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 05:37:36 smithi047 bash[22994]: debug 2024-09-16T05:37:36.526+0000 7fa441e70040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-16T05:37:36.839 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 05:37:36 smithi047 bash[22994]: debug 2024-09-16T05:37:36.598+0000 7fa441e70040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-16T05:37:36.840 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 05:37:36 smithi047 bash[22994]: debug 2024-09-16T05:37:36.670+0000 7fa441e70040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-16T05:37:37.070 INFO:journalctl@ceph.mgr.b.smithi086.stdout:Sep 16 05:37:36 smithi086 bash[24795]: debug 2024-09-16T05:37:36.714+0000 7f8d49882040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-16T05:37:37.070 INFO:journalctl@ceph.mgr.b.smithi086.stdout:Sep 16 05:37:36 smithi086 bash[24795]: debug 2024-09-16T05:37:36.790+0000 7f8d49882040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-16T05:37:37.070 INFO:journalctl@ceph.mgr.b.smithi086.stdout:Sep 16 05:37:36 smithi086 bash[24795]: debug 2024-09-16T05:37:36.854+0000 7f8d49882040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-16T05:37:37.287 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 05:37:36 smithi047 bash[22994]: debug 2024-09-16T05:37:36.862+0000 7fa441e70040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-16T05:37:37.287 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 05:37:36 smithi047 bash[22994]: debug 2024-09-16T05:37:36.942+0000 7fa441e70040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-16T05:37:37.287 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 05:37:37 smithi047 bash[22994]: debug 2024-09-16T05:37:37.014+0000 7fa441e70040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-16T05:37:37.376 INFO:journalctl@ceph.mgr.b.smithi086.stdout:Sep 16 05:37:37 smithi086 bash[24795]: debug 2024-09-16T05:37:37.106+0000 7f8d49882040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-16T05:37:37.376 INFO:journalctl@ceph.mgr.b.smithi086.stdout:Sep 16 05:37:37 smithi086 bash[24795]: debug 2024-09-16T05:37:37.174+0000 7f8d49882040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-16T05:37:37.561 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 05:37:37 smithi047 bash[22994]: debug 2024-09-16T05:37:37.282+0000 7fa441e70040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-16T05:37:37.561 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 05:37:37 smithi047 bash[22994]: debug 2024-09-16T05:37:37.354+0000 7fa441e70040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-16T05:37:37.699 INFO:journalctl@ceph.mgr.b.smithi086.stdout:Sep 16 05:37:37 smithi086 bash[24795]: debug 2024-09-16T05:37:37.370+0000 7f8d49882040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-16T05:37:37.700 INFO:journalctl@ceph.mgr.b.smithi086.stdout:Sep 16 05:37:37 smithi086 bash[24795]: debug 2024-09-16T05:37:37.446+0000 7f8d49882040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-16T05:37:37.839 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 05:37:37 smithi047 bash[22994]: debug 2024-09-16T05:37:37.558+0000 7fa441e70040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-16T05:37:37.839 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 05:37:37 smithi047 bash[22994]: debug 2024-09-16T05:37:37.638+0000 7fa441e70040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-16T05:37:38.034 INFO:journalctl@ceph.mgr.b.smithi086.stdout:Sep 16 05:37:37 smithi086 bash[24795]: debug 2024-09-16T05:37:37.694+0000 7f8d49882040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-16T05:37:38.034 INFO:journalctl@ceph.mgr.b.smithi086.stdout:Sep 16 05:37:37 smithi086 bash[24795]: debug 2024-09-16T05:37:37.866+0000 7f8d49882040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-16T05:37:38.258 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 05:37:37 smithi047 bash[22994]: debug 2024-09-16T05:37:37.898+0000 7fa441e70040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-16T05:37:38.258 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 05:37:38 smithi047 bash[22994]: debug 2024-09-16T05:37:38.082+0000 7fa441e70040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-16T05:37:38.289 INFO:journalctl@ceph.mgr.b.smithi086.stdout:Sep 16 05:37:38 smithi086 bash[24795]: debug 2024-09-16T05:37:38.026+0000 7f8d49882040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-16T05:37:38.289 INFO:journalctl@ceph.mgr.b.smithi086.stdout:Sep 16 05:37:38 smithi086 bash[24795]: debug 2024-09-16T05:37:38.106+0000 7f8d49882040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-16T05:37:38.527 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 05:37:38 smithi047 bash[22994]: debug 2024-09-16T05:37:38.254+0000 7fa441e70040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-16T05:37:38.527 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 05:37:38 smithi047 bash[22994]: debug 2024-09-16T05:37:38.334+0000 7fa441e70040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-16T05:37:38.570 INFO:journalctl@ceph.mgr.b.smithi086.stdout:Sep 16 05:37:38 smithi086 bash[24795]: debug 2024-09-16T05:37:38.282+0000 7f8d49882040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-16T05:37:38.839 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 05:37:38 smithi047 bash[22994]: debug 2024-09-16T05:37:38.522+0000 7fa441e70040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-16T05:37:39.390 INFO:journalctl@ceph.mgr.b.smithi086.stdout:Sep 16 05:37:39 smithi086 bash[24795]: debug 2024-09-16T05:37:39.086+0000 7f8d49882040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-16T05:37:39.390 INFO:journalctl@ceph.mgr.b.smithi086.stdout:Sep 16 05:37:39 smithi086 bash[24795]: debug 2024-09-16T05:37:39.162+0000 7f8d49882040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-16T05:37:39.619 INFO:teuthology.orchestra.run.smithi047.stdout:Inferring config /var/lib/ceph/a6097908-73ec-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T05:37:39.699 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 05:37:39 smithi047 bash[22994]: debug 2024-09-16T05:37:39.382+0000 7fa441e70040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-16T05:37:39.699 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 05:37:39 smithi047 bash[22994]: debug 2024-09-16T05:37:39.462+0000 7fa441e70040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-16T05:37:39.820 INFO:journalctl@ceph.mgr.b.smithi086.stdout:Sep 16 05:37:39 smithi086 bash[24795]: debug 2024-09-16T05:37:39.382+0000 7f8d49882040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-16T05:37:39.820 INFO:journalctl@ceph.mgr.b.smithi086.stdout:Sep 16 05:37:39 smithi086 bash[24795]: debug 2024-09-16T05:37:39.458+0000 7f8d49882040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-16T05:37:40.014 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 05:37:39 smithi047 bash[22994]: debug 2024-09-16T05:37:39.694+0000 7fa441e70040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-16T05:37:40.014 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 05:37:39 smithi047 bash[22994]: debug 2024-09-16T05:37:39.770+0000 7fa441e70040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-16T05:37:40.268 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 05:37:40 smithi047 bash[22994]: debug 2024-09-16T05:37:40.182+0000 7fa441e70040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-16T05:37:40.268 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:37:40 smithi047 bash[22744]: audit 2024-09-16T05:37:39.946226+0000 mon.b (mon.2) 13 : audit [DBG] from='mgr.? 172.21.15.86:0/2191109972' entity='mgr.b' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/b/crt"}]: dispatch 2024-09-16T05:37:40.269 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:37:40 smithi047 bash[22744]: audit 2024-09-16T05:37:39.947004+0000 mon.b (mon.2) 14 : audit [DBG] from='mgr.? 172.21.15.86:0/2191109972' entity='mgr.b' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-16T05:37:40.269 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:37:40 smithi047 bash[22744]: audit 2024-09-16T05:37:39.948411+0000 mon.b (mon.2) 15 : audit [DBG] from='mgr.? 172.21.15.86:0/2191109972' entity='mgr.b' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/b/key"}]: dispatch 2024-09-16T05:37:40.269 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:37:40 smithi047 bash[22744]: cluster 2024-09-16T05:37:39.948477+0000 mon.a (mon.0) 469 : cluster [DBG] Standby manager daemon b restarted 2024-09-16T05:37:40.269 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:37:40 smithi047 bash[22744]: cluster 2024-09-16T05:37:39.948733+0000 mon.a (mon.0) 470 : cluster [DBG] Standby manager daemon b started 2024-09-16T05:37:40.269 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:37:40 smithi047 bash[22744]: audit 2024-09-16T05:37:39.949097+0000 mon.b (mon.2) 16 : audit [DBG] from='mgr.? 172.21.15.86:0/2191109972' entity='mgr.b' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-16T05:37:40.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:37:40 smithi157 bash[24585]: audit 2024-09-16T05:37:39.946226+0000 mon.b (mon.2) 13 : audit [DBG] from='mgr.? 172.21.15.86:0/2191109972' entity='mgr.b' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/b/crt"}]: dispatch 2024-09-16T05:37:40.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:37:40 smithi157 bash[24585]: audit 2024-09-16T05:37:39.947004+0000 mon.b (mon.2) 14 : audit [DBG] from='mgr.? 172.21.15.86:0/2191109972' entity='mgr.b' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-16T05:37:40.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:37:40 smithi157 bash[24585]: audit 2024-09-16T05:37:39.948411+0000 mon.b (mon.2) 15 : audit [DBG] from='mgr.? 172.21.15.86:0/2191109972' entity='mgr.b' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/b/key"}]: dispatch 2024-09-16T05:37:40.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:37:40 smithi157 bash[24585]: cluster 2024-09-16T05:37:39.948477+0000 mon.a (mon.0) 469 : cluster [DBG] Standby manager daemon b restarted 2024-09-16T05:37:40.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:37:40 smithi157 bash[24585]: cluster 2024-09-16T05:37:39.948733+0000 mon.a (mon.0) 470 : cluster [DBG] Standby manager daemon b started 2024-09-16T05:37:40.305 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:37:40 smithi157 bash[24585]: audit 2024-09-16T05:37:39.949097+0000 mon.b (mon.2) 16 : audit [DBG] from='mgr.? 172.21.15.86:0/2191109972' entity='mgr.b' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-16T05:37:40.320 INFO:journalctl@ceph.mgr.b.smithi086.stdout:Sep 16 05:37:39 smithi086 bash[24795]: debug 2024-09-16T05:37:39.842+0000 7f8d49882040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-16T05:37:40.320 INFO:journalctl@ceph.mgr.b.smithi086.stdout:Sep 16 05:37:39 smithi086 bash[24795]: debug 2024-09-16T05:37:39.918+0000 7f8d49882040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-16T05:37:40.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:37:40 smithi086 bash[24289]: audit 2024-09-16T05:37:39.946226+0000 mon.b (mon.2) 13 : audit [DBG] from='mgr.? 172.21.15.86:0/2191109972' entity='mgr.b' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/b/crt"}]: dispatch 2024-09-16T05:37:40.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:37:40 smithi086 bash[24289]: audit 2024-09-16T05:37:39.947004+0000 mon.b (mon.2) 14 : audit [DBG] from='mgr.? 172.21.15.86:0/2191109972' entity='mgr.b' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-16T05:37:40.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:37:40 smithi086 bash[24289]: audit 2024-09-16T05:37:39.948411+0000 mon.b (mon.2) 15 : audit [DBG] from='mgr.? 172.21.15.86:0/2191109972' entity='mgr.b' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/b/key"}]: dispatch 2024-09-16T05:37:40.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:37:40 smithi086 bash[24289]: cluster 2024-09-16T05:37:39.948477+0000 mon.a (mon.0) 469 : cluster [DBG] Standby manager daemon b restarted 2024-09-16T05:37:40.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:37:40 smithi086 bash[24289]: cluster 2024-09-16T05:37:39.948733+0000 mon.a (mon.0) 470 : cluster [DBG] Standby manager daemon b started 2024-09-16T05:37:40.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:37:40 smithi086 bash[24289]: audit 2024-09-16T05:37:39.949097+0000 mon.b (mon.2) 16 : audit [DBG] from='mgr.? 172.21.15.86:0/2191109972' entity='mgr.b' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-16T05:37:40.559 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 05:37:40 smithi047 bash[22994]: debug 2024-09-16T05:37:40.262+0000 7fa441e70040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-16T05:37:41.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:37:41 smithi157 bash[24585]: cluster 2024-09-16T05:37:40.013454+0000 mon.a (mon.0) 471 : cluster [DBG] mgrmap e17: a(active, since 5m), standbys: b 2024-09-16T05:37:41.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:37:41 smithi157 bash[24585]: cluster 2024-09-16T05:37:40.288267+0000 mon.a (mon.0) 472 : cluster [INF] Active manager daemon a restarted 2024-09-16T05:37:41.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:37:41 smithi157 bash[24585]: cluster 2024-09-16T05:37:40.288647+0000 mon.a (mon.0) 473 : cluster [INF] Activating manager daemon a 2024-09-16T05:37:41.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:37:41 smithi157 bash[24585]: cluster 2024-09-16T05:37:40.299080+0000 mon.a (mon.0) 474 : cluster [DBG] osdmap e23: 3 total, 3 up, 3 in 2024-09-16T05:37:41.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:37:41 smithi157 bash[24585]: audit 2024-09-16T05:37:40.299854+0000 mon.b (mon.2) 17 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-16T05:37:41.305 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:37:41 smithi157 bash[24585]: cluster 2024-09-16T05:37:40.299887+0000 mon.a (mon.0) 475 : cluster [DBG] mgrmap e18: a(active, starting, since 0.011377s), standbys: b 2024-09-16T05:37:41.305 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:37:41 smithi157 bash[24585]: audit 2024-09-16T05:37:40.300280+0000 mon.b (mon.2) 18 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-16T05:37:41.305 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:37:41 smithi157 bash[24585]: audit 2024-09-16T05:37:40.300689+0000 mon.b (mon.2) 19 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-16T05:37:41.305 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:37:41 smithi157 bash[24585]: audit 2024-09-16T05:37:40.302111+0000 mon.b (mon.2) 20 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "mgr metadata", "who": "a", "id": "a"}]: dispatch 2024-09-16T05:37:41.305 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:37:41 smithi157 bash[24585]: audit 2024-09-16T05:37:40.302513+0000 mon.b (mon.2) 21 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "mgr metadata", "who": "b", "id": "b"}]: dispatch 2024-09-16T05:37:41.305 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:37:41 smithi157 bash[24585]: audit 2024-09-16T05:37:40.302922+0000 mon.b (mon.2) 22 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-16T05:37:41.305 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:37:41 smithi157 bash[24585]: audit 2024-09-16T05:37:40.303413+0000 mon.b (mon.2) 23 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-16T05:37:41.305 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:37:41 smithi157 bash[24585]: audit 2024-09-16T05:37:40.303859+0000 mon.b (mon.2) 24 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-16T05:37:41.305 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:37:41 smithi157 bash[24585]: audit 2024-09-16T05:37:40.304341+0000 mon.b (mon.2) 25 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-16T05:37:41.305 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:37:41 smithi157 bash[24585]: audit 2024-09-16T05:37:40.304697+0000 mon.b (mon.2) 26 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-16T05:37:41.305 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:37:41 smithi157 bash[24585]: audit 2024-09-16T05:37:40.305342+0000 mon.b (mon.2) 27 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-16T05:37:41.305 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:37:41 smithi157 bash[24585]: cluster 2024-09-16T05:37:40.334807+0000 mon.a (mon.0) 476 : cluster [INF] Manager daemon a is now available 2024-09-16T05:37:41.305 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:37:41 smithi157 bash[24585]: audit 2024-09-16T05:37:40.351485+0000 mon.b (mon.2) 28 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T05:37:41.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:37:41 smithi157 bash[24585]: audit 2024-09-16T05:37:40.371219+0000 mon.b (mon.2) 29 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/a/mirror_snapshot_schedule"}]: dispatch 2024-09-16T05:37:41.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:37:41 smithi157 bash[24585]: audit 2024-09-16T05:37:40.374771+0000 mon.a (mon.0) 477 : audit [INF] from='mgr.14373 ' entity='mgr.a' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/a/mirror_snapshot_schedule"}]: dispatch 2024-09-16T05:37:41.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:37:41 smithi157 bash[24585]: audit 2024-09-16T05:37:40.377346+0000 mon.b (mon.2) 30 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/a/trash_purge_schedule"}]: dispatch 2024-09-16T05:37:41.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:37:41 smithi157 bash[24585]: audit 2024-09-16T05:37:40.380884+0000 mon.a (mon.0) 478 : audit [INF] from='mgr.14373 ' entity='mgr.a' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/a/trash_purge_schedule"}]: dispatch 2024-09-16T05:37:41.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:37:41 smithi086 bash[24289]: cluster 2024-09-16T05:37:40.013454+0000 mon.a (mon.0) 471 : cluster [DBG] mgrmap e17: a(active, since 5m), standbys: b 2024-09-16T05:37:41.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:37:41 smithi086 bash[24289]: cluster 2024-09-16T05:37:40.288267+0000 mon.a (mon.0) 472 : cluster [INF] Active manager daemon a restarted 2024-09-16T05:37:41.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:37:41 smithi086 bash[24289]: cluster 2024-09-16T05:37:40.288647+0000 mon.a (mon.0) 473 : cluster [INF] Activating manager daemon a 2024-09-16T05:37:41.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:37:41 smithi086 bash[24289]: cluster 2024-09-16T05:37:40.299080+0000 mon.a (mon.0) 474 : cluster [DBG] osdmap e23: 3 total, 3 up, 3 in 2024-09-16T05:37:41.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:37:41 smithi086 bash[24289]: audit 2024-09-16T05:37:40.299854+0000 mon.b (mon.2) 17 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-16T05:37:41.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:37:41 smithi086 bash[24289]: cluster 2024-09-16T05:37:40.299887+0000 mon.a (mon.0) 475 : cluster [DBG] mgrmap e18: a(active, starting, since 0.011377s), standbys: b 2024-09-16T05:37:41.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:37:41 smithi086 bash[24289]: audit 2024-09-16T05:37:40.300280+0000 mon.b (mon.2) 18 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-16T05:37:41.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:37:41 smithi086 bash[24289]: audit 2024-09-16T05:37:40.300689+0000 mon.b (mon.2) 19 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-16T05:37:41.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:37:41 smithi086 bash[24289]: audit 2024-09-16T05:37:40.302111+0000 mon.b (mon.2) 20 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "mgr metadata", "who": "a", "id": "a"}]: dispatch 2024-09-16T05:37:41.322 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:37:41 smithi086 bash[24289]: audit 2024-09-16T05:37:40.302513+0000 mon.b (mon.2) 21 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "mgr metadata", "who": "b", "id": "b"}]: dispatch 2024-09-16T05:37:41.322 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:37:41 smithi086 bash[24289]: audit 2024-09-16T05:37:40.302922+0000 mon.b (mon.2) 22 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-16T05:37:41.322 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:37:41 smithi086 bash[24289]: audit 2024-09-16T05:37:40.303413+0000 mon.b (mon.2) 23 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-16T05:37:41.322 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:37:41 smithi086 bash[24289]: audit 2024-09-16T05:37:40.303859+0000 mon.b (mon.2) 24 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-16T05:37:41.322 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:37:41 smithi086 bash[24289]: audit 2024-09-16T05:37:40.304341+0000 mon.b (mon.2) 25 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-16T05:37:41.322 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:37:41 smithi086 bash[24289]: audit 2024-09-16T05:37:40.304697+0000 mon.b (mon.2) 26 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-16T05:37:41.322 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:37:41 smithi086 bash[24289]: audit 2024-09-16T05:37:40.305342+0000 mon.b (mon.2) 27 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-16T05:37:41.322 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:37:41 smithi086 bash[24289]: cluster 2024-09-16T05:37:40.334807+0000 mon.a (mon.0) 476 : cluster [INF] Manager daemon a is now available 2024-09-16T05:37:41.322 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:37:41 smithi086 bash[24289]: audit 2024-09-16T05:37:40.351485+0000 mon.b (mon.2) 28 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T05:37:41.322 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:37:41 smithi086 bash[24289]: audit 2024-09-16T05:37:40.371219+0000 mon.b (mon.2) 29 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/a/mirror_snapshot_schedule"}]: dispatch 2024-09-16T05:37:41.322 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:37:41 smithi086 bash[24289]: audit 2024-09-16T05:37:40.374771+0000 mon.a (mon.0) 477 : audit [INF] from='mgr.14373 ' entity='mgr.a' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/a/mirror_snapshot_schedule"}]: dispatch 2024-09-16T05:37:41.322 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:37:41 smithi086 bash[24289]: audit 2024-09-16T05:37:40.377346+0000 mon.b (mon.2) 30 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/a/trash_purge_schedule"}]: dispatch 2024-09-16T05:37:41.322 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:37:41 smithi086 bash[24289]: audit 2024-09-16T05:37:40.380884+0000 mon.a (mon.0) 478 : audit [INF] from='mgr.14373 ' entity='mgr.a' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/a/trash_purge_schedule"}]: dispatch 2024-09-16T05:37:41.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:37:41 smithi047 bash[22744]: cluster 2024-09-16T05:37:40.013454+0000 mon.a (mon.0) 471 : cluster [DBG] mgrmap e17: a(active, since 5m), standbys: b 2024-09-16T05:37:41.340 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:37:41 smithi047 bash[22744]: cluster 2024-09-16T05:37:40.288267+0000 mon.a (mon.0) 472 : cluster [INF] Active manager daemon a restarted 2024-09-16T05:37:41.340 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:37:41 smithi047 bash[22744]: cluster 2024-09-16T05:37:40.288647+0000 mon.a (mon.0) 473 : cluster [INF] Activating manager daemon a 2024-09-16T05:37:41.340 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:37:41 smithi047 bash[22744]: cluster 2024-09-16T05:37:40.299080+0000 mon.a (mon.0) 474 : cluster [DBG] osdmap e23: 3 total, 3 up, 3 in 2024-09-16T05:37:41.340 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:37:41 smithi047 bash[22744]: audit 2024-09-16T05:37:40.299854+0000 mon.b (mon.2) 17 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-16T05:37:41.340 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:37:41 smithi047 bash[22744]: cluster 2024-09-16T05:37:40.299887+0000 mon.a (mon.0) 475 : cluster [DBG] mgrmap e18: a(active, starting, since 0.011377s), standbys: b 2024-09-16T05:37:41.340 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:37:41 smithi047 bash[22744]: audit 2024-09-16T05:37:40.300280+0000 mon.b (mon.2) 18 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-16T05:37:41.340 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:37:41 smithi047 bash[22744]: audit 2024-09-16T05:37:40.300689+0000 mon.b (mon.2) 19 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-16T05:37:41.340 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:37:41 smithi047 bash[22744]: audit 2024-09-16T05:37:40.302111+0000 mon.b (mon.2) 20 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "mgr metadata", "who": "a", "id": "a"}]: dispatch 2024-09-16T05:37:41.340 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:37:41 smithi047 bash[22744]: audit 2024-09-16T05:37:40.302513+0000 mon.b (mon.2) 21 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "mgr metadata", "who": "b", "id": "b"}]: dispatch 2024-09-16T05:37:41.340 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:37:41 smithi047 bash[22744]: audit 2024-09-16T05:37:40.302922+0000 mon.b (mon.2) 22 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-16T05:37:41.340 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:37:41 smithi047 bash[22744]: audit 2024-09-16T05:37:40.303413+0000 mon.b (mon.2) 23 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-16T05:37:41.340 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:37:41 smithi047 bash[22744]: audit 2024-09-16T05:37:40.303859+0000 mon.b (mon.2) 24 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-16T05:37:41.341 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:37:41 smithi047 bash[22744]: audit 2024-09-16T05:37:40.304341+0000 mon.b (mon.2) 25 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-16T05:37:41.341 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:37:41 smithi047 bash[22744]: audit 2024-09-16T05:37:40.304697+0000 mon.b (mon.2) 26 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-16T05:37:41.341 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:37:41 smithi047 bash[22744]: audit 2024-09-16T05:37:40.305342+0000 mon.b (mon.2) 27 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-16T05:37:41.341 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:37:41 smithi047 bash[22744]: cluster 2024-09-16T05:37:40.334807+0000 mon.a (mon.0) 476 : cluster [INF] Manager daemon a is now available 2024-09-16T05:37:41.341 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:37:41 smithi047 bash[22744]: audit 2024-09-16T05:37:40.351485+0000 mon.b (mon.2) 28 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T05:37:41.341 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:37:41 smithi047 bash[22744]: audit 2024-09-16T05:37:40.371219+0000 mon.b (mon.2) 29 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/a/mirror_snapshot_schedule"}]: dispatch 2024-09-16T05:37:41.341 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:37:41 smithi047 bash[22744]: audit 2024-09-16T05:37:40.374771+0000 mon.a (mon.0) 477 : audit [INF] from='mgr.14373 ' entity='mgr.a' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/a/mirror_snapshot_schedule"}]: dispatch 2024-09-16T05:37:41.341 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:37:41 smithi047 bash[22744]: audit 2024-09-16T05:37:40.377346+0000 mon.b (mon.2) 30 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/a/trash_purge_schedule"}]: dispatch 2024-09-16T05:37:41.341 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:37:41 smithi047 bash[22744]: audit 2024-09-16T05:37:40.380884+0000 mon.a (mon.0) 478 : audit [INF] from='mgr.14373 ' entity='mgr.a' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/a/trash_purge_schedule"}]: dispatch 2024-09-16T05:37:42.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:37:42 smithi086 bash[24289]: cluster 2024-09-16T05:37:41.301810+0000 mon.a (mon.0) 479 : cluster [DBG] mgrmap e19: a(active, since 1.01332s), standbys: b 2024-09-16T05:37:42.797 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:37:42 smithi086 bash[24289]: audit 2024-09-16T05:37:41.302298+0000 mgr.a (mgr.14373) 1 : audit [DBG] from='client.14400 -' entity='client.admin' cmd=[{"prefix": "rgw realm bootstrap", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:37:42.797 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:37:42 smithi086 bash[24289]: cluster 2024-09-16T05:37:41.316046+0000 mgr.a (mgr.14373) 2 : cluster [DBG] pgmap v3: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-16T05:37:42.798 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:37:42 smithi047 bash[22744]: cluster 2024-09-16T05:37:41.301810+0000 mon.a (mon.0) 479 : cluster [DBG] mgrmap e19: a(active, since 1.01332s), standbys: b 2024-09-16T05:37:42.798 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:37:42 smithi047 bash[22744]: audit 2024-09-16T05:37:41.302298+0000 mgr.a (mgr.14373) 1 : audit [DBG] from='client.14400 -' entity='client.admin' cmd=[{"prefix": "rgw realm bootstrap", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:37:42.798 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:37:42 smithi047 bash[22744]: cluster 2024-09-16T05:37:41.316046+0000 mgr.a (mgr.14373) 2 : cluster [DBG] pgmap v3: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-16T05:37:42.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:37:42 smithi157 bash[24585]: cluster 2024-09-16T05:37:41.301810+0000 mon.a (mon.0) 479 : cluster [DBG] mgrmap e19: a(active, since 1.01332s), standbys: b 2024-09-16T05:37:42.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:37:42 smithi157 bash[24585]: audit 2024-09-16T05:37:41.302298+0000 mgr.a (mgr.14373) 1 : audit [DBG] from='client.14400 -' entity='client.admin' cmd=[{"prefix": "rgw realm bootstrap", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:37:42.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:37:42 smithi157 bash[24585]: cluster 2024-09-16T05:37:41.316046+0000 mgr.a (mgr.14373) 2 : cluster [DBG] pgmap v3: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-16T05:37:43.090 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 05:37:42 smithi047 bash[22994]: debug 2024-09-16T05:37:42.626+0000 7fa39feed640 -1 log_channel(cephadm) log [ERR] : [16/Sep/2024:05:37:42] ENGINE Error in HTTPServer.serve 2024-09-16T05:37:43.090 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 05:37:42 smithi047 bash[22994]: Traceback (most recent call last): 2024-09-16T05:37:43.090 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 05:37:42 smithi047 bash[22994]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-16T05:37:43.090 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 05:37:42 smithi047 bash[22994]: self._connections.run(self.expiration_interval) 2024-09-16T05:37:43.090 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 05:37:42 smithi047 bash[22994]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-16T05:37:43.090 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 05:37:42 smithi047 bash[22994]: self._run(expiration_interval) 2024-09-16T05:37:43.090 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 05:37:42 smithi047 bash[22994]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-16T05:37:43.090 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 05:37:42 smithi047 bash[22994]: new_conn = self._from_server_socket(self.server.socket) 2024-09-16T05:37:43.090 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 05:37:42 smithi047 bash[22994]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-16T05:37:43.091 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 05:37:42 smithi047 bash[22994]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-16T05:37:43.091 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 05:37:42 smithi047 bash[22994]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-16T05:37:43.091 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 05:37:42 smithi047 bash[22994]: s = self.context.wrap_socket( 2024-09-16T05:37:43.091 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 05:37:42 smithi047 bash[22994]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-16T05:37:43.091 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 05:37:42 smithi047 bash[22994]: return self.sslsocket_class._create( 2024-09-16T05:37:43.091 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 05:37:42 smithi047 bash[22994]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-16T05:37:43.091 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 05:37:42 smithi047 bash[22994]: self.do_handshake() 2024-09-16T05:37:43.091 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 05:37:42 smithi047 bash[22994]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-16T05:37:43.091 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 05:37:42 smithi047 bash[22994]: self._sslobj.do_handshake() 2024-09-16T05:37:43.091 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 05:37:42 smithi047 bash[22994]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-16T05:37:43.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:37:43 smithi086 bash[24289]: cluster 2024-09-16T05:37:42.309856+0000 mon.a (mon.0) 480 : cluster [DBG] osdmap e24: 3 total, 3 up, 3 in 2024-09-16T05:37:43.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:37:43 smithi086 bash[24289]: audit 2024-09-16T05:37:42.311019+0000 mon.a (mon.0) 481 : audit [INF] from='client.? 172.21.15.47:0/1419647320' entity='mgr.a' cmd=[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]: dispatch 2024-09-16T05:37:43.572 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:37:43 smithi086 bash[24289]: cephadm 2024-09-16T05:37:42.503478+0000 mgr.a (mgr.14373) 4 : cephadm [INF] [16/Sep/2024:05:37:42] ENGINE Bus STARTING 2024-09-16T05:37:43.572 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:37:43 smithi086 bash[24289]: cephadm 2024-09-16T05:37:42.627560+0000 mgr.a (mgr.14373) 5 : cephadm [INF] [16/Sep/2024:05:37:42] ENGINE Serving on https://172.21.15.47:7150 2024-09-16T05:37:43.572 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:37:43 smithi086 bash[24289]: cephadm 2024-09-16T05:37:42.632964+0000 mgr.a (mgr.14373) 6 : cephadm [ERR] [16/Sep/2024:05:37:42] ENGINE Error in HTTPServer.serve 2024-09-16T05:37:43.572 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:37:43 smithi086 bash[24289]: Traceback (most recent call last): 2024-09-16T05:37:43.572 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:37:43 smithi086 bash[24289]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-16T05:37:43.572 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:37:43 smithi086 bash[24289]: self._connections.run(self.expiration_interval) 2024-09-16T05:37:43.573 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:37:43 smithi086 bash[24289]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-16T05:37:43.573 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:37:43 smithi086 bash[24289]: self._run(expiration_interval) 2024-09-16T05:37:43.573 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:37:43 smithi086 bash[24289]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-16T05:37:43.573 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:37:43 smithi086 bash[24289]: new_conn = self._from_server_socket(self.server.socket) 2024-09-16T05:37:43.573 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:37:43 smithi086 bash[24289]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-16T05:37:43.574 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:37:43 smithi086 bash[24289]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-16T05:37:43.574 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:37:43 smithi086 bash[24289]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-16T05:37:43.574 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:37:43 smithi086 bash[24289]: s = self.context.wrap_socket( 2024-09-16T05:37:43.574 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:37:43 smithi086 bash[24289]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-16T05:37:43.574 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:37:43 smithi086 bash[24289]: return self.sslsocket_class._create( 2024-09-16T05:37:43.574 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:37:43 smithi086 bash[24289]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-16T05:37:43.575 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:37:43 smithi086 bash[24289]: self.do_handshake() 2024-09-16T05:37:43.575 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:37:43 smithi086 bash[24289]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-16T05:37:43.575 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:37:43 smithi086 bash[24289]: self._sslobj.do_handshake() 2024-09-16T05:37:43.576 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:37:43 smithi086 bash[24289]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-16T05:37:43.576 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:37:43 smithi086 bash[24289]: cephadm 2024-09-16T05:37:42.728628+0000 mgr.a (mgr.14373) 7 : cephadm [INF] [16/Sep/2024:05:37:42] ENGINE Serving on http://172.21.15.47:8765 2024-09-16T05:37:43.576 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:37:43 smithi086 bash[24289]: cephadm 2024-09-16T05:37:42.728775+0000 mgr.a (mgr.14373) 8 : cephadm [INF] [16/Sep/2024:05:37:42] ENGINE Bus STARTED 2024-09-16T05:37:43.590 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:37:43 smithi047 bash[22744]: cluster 2024-09-16T05:37:42.309856+0000 mon.a (mon.0) 480 : cluster [DBG] osdmap e24: 3 total, 3 up, 3 in 2024-09-16T05:37:43.590 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:37:43 smithi047 bash[22744]: audit 2024-09-16T05:37:42.311019+0000 mon.a (mon.0) 481 : audit [INF] from='client.? 172.21.15.47:0/1419647320' entity='mgr.a' cmd=[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]: dispatch 2024-09-16T05:37:43.590 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:37:43 smithi047 bash[22744]: cephadm 2024-09-16T05:37:42.503478+0000 mgr.a (mgr.14373) 4 : cephadm [INF] [16/Sep/2024:05:37:42] ENGINE Bus STARTING 2024-09-16T05:37:43.590 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:37:43 smithi047 bash[22744]: cephadm 2024-09-16T05:37:42.627560+0000 mgr.a (mgr.14373) 5 : cephadm [INF] [16/Sep/2024:05:37:42] ENGINE Serving on https://172.21.15.47:7150 2024-09-16T05:37:43.591 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:37:43 smithi047 bash[22744]: cephadm 2024-09-16T05:37:42.632964+0000 mgr.a (mgr.14373) 6 : cephadm [ERR] [16/Sep/2024:05:37:42] ENGINE Error in HTTPServer.serve 2024-09-16T05:37:43.591 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:37:43 smithi047 bash[22744]: Traceback (most recent call last): 2024-09-16T05:37:43.591 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:37:43 smithi047 bash[22744]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-16T05:37:43.591 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:37:43 smithi047 bash[22744]: self._connections.run(self.expiration_interval) 2024-09-16T05:37:43.591 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:37:43 smithi047 bash[22744]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-16T05:37:43.591 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:37:43 smithi047 bash[22744]: self._run(expiration_interval) 2024-09-16T05:37:43.591 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:37:43 smithi047 bash[22744]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-16T05:37:43.591 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:37:43 smithi047 bash[22744]: new_conn = self._from_server_socket(self.server.socket) 2024-09-16T05:37:43.591 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:37:43 smithi047 bash[22744]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-16T05:37:43.591 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:37:43 smithi047 bash[22744]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-16T05:37:43.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:37:43 smithi047 bash[22744]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-16T05:37:43.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:37:43 smithi047 bash[22744]: s = self.context.wrap_socket( 2024-09-16T05:37:43.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:37:43 smithi047 bash[22744]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-16T05:37:43.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:37:43 smithi047 bash[22744]: return self.sslsocket_class._create( 2024-09-16T05:37:43.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:37:43 smithi047 bash[22744]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-16T05:37:43.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:37:43 smithi047 bash[22744]: self.do_handshake() 2024-09-16T05:37:43.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:37:43 smithi047 bash[22744]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-16T05:37:43.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:37:43 smithi047 bash[22744]: self._sslobj.do_handshake() 2024-09-16T05:37:43.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:37:43 smithi047 bash[22744]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-16T05:37:43.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:37:43 smithi047 bash[22744]: cephadm 2024-09-16T05:37:42.728628+0000 mgr.a (mgr.14373) 7 : cephadm [INF] [16/Sep/2024:05:37:42] ENGINE Serving on http://172.21.15.47:8765 2024-09-16T05:37:43.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:37:43 smithi047 bash[22744]: cephadm 2024-09-16T05:37:42.728775+0000 mgr.a (mgr.14373) 8 : cephadm [INF] [16/Sep/2024:05:37:42] ENGINE Bus STARTED 2024-09-16T05:37:43.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:37:43 smithi157 bash[24585]: cluster 2024-09-16T05:37:42.309856+0000 mon.a (mon.0) 480 : cluster [DBG] osdmap e24: 3 total, 3 up, 3 in 2024-09-16T05:37:43.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:37:43 smithi157 bash[24585]: audit 2024-09-16T05:37:42.311019+0000 mon.a (mon.0) 481 : audit [INF] from='client.? 172.21.15.47:0/1419647320' entity='mgr.a' cmd=[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]: dispatch 2024-09-16T05:37:43.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:37:43 smithi157 bash[24585]: cephadm 2024-09-16T05:37:42.503478+0000 mgr.a (mgr.14373) 4 : cephadm [INF] [16/Sep/2024:05:37:42] ENGINE Bus STARTING 2024-09-16T05:37:43.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:37:43 smithi157 bash[24585]: cephadm 2024-09-16T05:37:42.627560+0000 mgr.a (mgr.14373) 5 : cephadm [INF] [16/Sep/2024:05:37:42] ENGINE Serving on https://172.21.15.47:7150 2024-09-16T05:37:43.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:37:43 smithi157 bash[24585]: cephadm 2024-09-16T05:37:42.632964+0000 mgr.a (mgr.14373) 6 : cephadm [ERR] [16/Sep/2024:05:37:42] ENGINE Error in HTTPServer.serve 2024-09-16T05:37:43.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:37:43 smithi157 bash[24585]: Traceback (most recent call last): 2024-09-16T05:37:43.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:37:43 smithi157 bash[24585]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-16T05:37:43.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:37:43 smithi157 bash[24585]: self._connections.run(self.expiration_interval) 2024-09-16T05:37:43.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:37:43 smithi157 bash[24585]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-16T05:37:43.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:37:43 smithi157 bash[24585]: self._run(expiration_interval) 2024-09-16T05:37:43.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:37:43 smithi157 bash[24585]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-16T05:37:43.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:37:43 smithi157 bash[24585]: new_conn = self._from_server_socket(self.server.socket) 2024-09-16T05:37:43.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:37:43 smithi157 bash[24585]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-16T05:37:43.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:37:43 smithi157 bash[24585]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-16T05:37:43.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:37:43 smithi157 bash[24585]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-16T05:37:43.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:37:43 smithi157 bash[24585]: s = self.context.wrap_socket( 2024-09-16T05:37:43.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:37:43 smithi157 bash[24585]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-16T05:37:43.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:37:43 smithi157 bash[24585]: return self.sslsocket_class._create( 2024-09-16T05:37:43.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:37:43 smithi157 bash[24585]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-16T05:37:43.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:37:43 smithi157 bash[24585]: self.do_handshake() 2024-09-16T05:37:43.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:37:43 smithi157 bash[24585]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-16T05:37:43.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:37:43 smithi157 bash[24585]: self._sslobj.do_handshake() 2024-09-16T05:37:43.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:37:43 smithi157 bash[24585]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-16T05:37:43.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:37:43 smithi157 bash[24585]: cephadm 2024-09-16T05:37:42.728628+0000 mgr.a (mgr.14373) 7 : cephadm [INF] [16/Sep/2024:05:37:42] ENGINE Serving on http://172.21.15.47:8765 2024-09-16T05:37:43.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:37:43 smithi157 bash[24585]: cephadm 2024-09-16T05:37:42.728775+0000 mgr.a (mgr.14373) 8 : cephadm [INF] [16/Sep/2024:05:37:42] ENGINE Bus STARTED 2024-09-16T05:37:45.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:37:44 smithi157 bash[24585]: audit 2024-09-16T05:37:43.316332+0000 mon.a (mon.0) 482 : audit [INF] from='client.? 172.21.15.47:0/1419647320' entity='mgr.a' cmd='[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]': finished 2024-09-16T05:37:45.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:37:44 smithi157 bash[24585]: cluster 2024-09-16T05:37:43.334458+0000 mon.a (mon.0) 483 : cluster [DBG] osdmap e25: 3 total, 3 up, 3 in 2024-09-16T05:37:45.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:37:44 smithi157 bash[24585]: cluster 2024-09-16T05:37:43.335647+0000 mon.a (mon.0) 484 : cluster [DBG] mgrmap e20: a(active, since 3s), standbys: b 2024-09-16T05:37:45.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:37:44 smithi086 bash[24289]: audit 2024-09-16T05:37:43.316332+0000 mon.a (mon.0) 482 : audit [INF] from='client.? 172.21.15.47:0/1419647320' entity='mgr.a' cmd='[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]': finished 2024-09-16T05:37:45.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:37:44 smithi086 bash[24289]: cluster 2024-09-16T05:37:43.334458+0000 mon.a (mon.0) 483 : cluster [DBG] osdmap e25: 3 total, 3 up, 3 in 2024-09-16T05:37:45.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:37:44 smithi086 bash[24289]: cluster 2024-09-16T05:37:43.335647+0000 mon.a (mon.0) 484 : cluster [DBG] mgrmap e20: a(active, since 3s), standbys: b 2024-09-16T05:37:45.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:37:44 smithi047 bash[22744]: audit 2024-09-16T05:37:43.316332+0000 mon.a (mon.0) 482 : audit [INF] from='client.? 172.21.15.47:0/1419647320' entity='mgr.a' cmd='[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]': finished 2024-09-16T05:37:45.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:37:44 smithi047 bash[22744]: cluster 2024-09-16T05:37:43.334458+0000 mon.a (mon.0) 483 : cluster [DBG] osdmap e25: 3 total, 3 up, 3 in 2024-09-16T05:37:45.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:37:44 smithi047 bash[22744]: cluster 2024-09-16T05:37:43.335647+0000 mon.a (mon.0) 484 : cluster [DBG] mgrmap e20: a(active, since 3s), standbys: b 2024-09-16T05:37:46.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:37:45 smithi157 bash[24585]: cluster 2024-09-16T05:37:44.306993+0000 mgr.a (mgr.14373) 9 : cluster [DBG] pgmap v7: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-16T05:37:46.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:37:45 smithi157 bash[24585]: cluster 2024-09-16T05:37:44.697877+0000 mon.a (mon.0) 485 : cluster [DBG] osdmap e26: 3 total, 3 up, 3 in 2024-09-16T05:37:46.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:37:45 smithi157 bash[24585]: audit 2024-09-16T05:37:44.700993+0000 mon.a (mon.0) 486 : audit [INF] from='client.? 172.21.15.47:0/2508949969' entity='mgr.a' cmd=[{"prefix": "osd pool application enable","pool": "myzone1.rgw.log","app": "rgw"}]: dispatch 2024-09-16T05:37:46.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:37:45 smithi157 bash[24585]: cluster 2024-09-16T05:37:44.762118+0000 mon.a (mon.0) 487 : cluster [DBG] mgrmap e21: a(active, since 4s), standbys: b 2024-09-16T05:37:46.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:37:45 smithi157 bash[24585]: audit 2024-09-16T05:37:45.698055+0000 mon.a (mon.0) 488 : audit [INF] from='client.? 172.21.15.47:0/2508949969' entity='mgr.a' cmd='[{"prefix": "osd pool application enable","pool": "myzone1.rgw.log","app": "rgw"}]': finished 2024-09-16T05:37:46.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:37:45 smithi157 bash[24585]: cluster 2024-09-16T05:37:45.704760+0000 mon.a (mon.0) 489 : cluster [DBG] osdmap e27: 3 total, 3 up, 3 in 2024-09-16T05:37:46.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:37:45 smithi086 bash[24289]: cluster 2024-09-16T05:37:44.306993+0000 mgr.a (mgr.14373) 9 : cluster [DBG] pgmap v7: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-16T05:37:46.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:37:45 smithi086 bash[24289]: cluster 2024-09-16T05:37:44.697877+0000 mon.a (mon.0) 485 : cluster [DBG] osdmap e26: 3 total, 3 up, 3 in 2024-09-16T05:37:46.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:37:45 smithi086 bash[24289]: audit 2024-09-16T05:37:44.700993+0000 mon.a (mon.0) 486 : audit [INF] from='client.? 172.21.15.47:0/2508949969' entity='mgr.a' cmd=[{"prefix": "osd pool application enable","pool": "myzone1.rgw.log","app": "rgw"}]: dispatch 2024-09-16T05:37:46.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:37:45 smithi086 bash[24289]: cluster 2024-09-16T05:37:44.762118+0000 mon.a (mon.0) 487 : cluster [DBG] mgrmap e21: a(active, since 4s), standbys: b 2024-09-16T05:37:46.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:37:45 smithi086 bash[24289]: audit 2024-09-16T05:37:45.698055+0000 mon.a (mon.0) 488 : audit [INF] from='client.? 172.21.15.47:0/2508949969' entity='mgr.a' cmd='[{"prefix": "osd pool application enable","pool": "myzone1.rgw.log","app": "rgw"}]': finished 2024-09-16T05:37:46.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:37:45 smithi086 bash[24289]: cluster 2024-09-16T05:37:45.704760+0000 mon.a (mon.0) 489 : cluster [DBG] osdmap e27: 3 total, 3 up, 3 in 2024-09-16T05:37:46.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:37:45 smithi047 bash[22744]: cluster 2024-09-16T05:37:44.306993+0000 mgr.a (mgr.14373) 9 : cluster [DBG] pgmap v7: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-16T05:37:46.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:37:45 smithi047 bash[22744]: cluster 2024-09-16T05:37:44.697877+0000 mon.a (mon.0) 485 : cluster [DBG] osdmap e26: 3 total, 3 up, 3 in 2024-09-16T05:37:46.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:37:45 smithi047 bash[22744]: audit 2024-09-16T05:37:44.700993+0000 mon.a (mon.0) 486 : audit [INF] from='client.? 172.21.15.47:0/2508949969' entity='mgr.a' cmd=[{"prefix": "osd pool application enable","pool": "myzone1.rgw.log","app": "rgw"}]: dispatch 2024-09-16T05:37:46.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:37:45 smithi047 bash[22744]: cluster 2024-09-16T05:37:44.762118+0000 mon.a (mon.0) 487 : cluster [DBG] mgrmap e21: a(active, since 4s), standbys: b 2024-09-16T05:37:46.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:37:45 smithi047 bash[22744]: audit 2024-09-16T05:37:45.698055+0000 mon.a (mon.0) 488 : audit [INF] from='client.? 172.21.15.47:0/2508949969' entity='mgr.a' cmd='[{"prefix": "osd pool application enable","pool": "myzone1.rgw.log","app": "rgw"}]': finished 2024-09-16T05:37:46.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:37:45 smithi047 bash[22744]: cluster 2024-09-16T05:37:45.704760+0000 mon.a (mon.0) 489 : cluster [DBG] osdmap e27: 3 total, 3 up, 3 in 2024-09-16T05:37:47.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:37:47 smithi157 bash[24585]: audit 2024-09-16T05:37:46.187233+0000 mon.a (mon.0) 490 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T05:37:47.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:37:47 smithi157 bash[24585]: audit 2024-09-16T05:37:46.192887+0000 mon.a (mon.0) 491 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T05:37:47.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:37:47 smithi157 bash[24585]: audit 2024-09-16T05:37:46.198605+0000 mon.a (mon.0) 492 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T05:37:47.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:37:47 smithi157 bash[24585]: audit 2024-09-16T05:37:46.204407+0000 mon.a (mon.0) 493 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T05:37:47.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:37:47 smithi157 bash[24585]: audit 2024-09-16T05:37:46.210684+0000 mon.a (mon.0) 494 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T05:37:47.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:37:47 smithi157 bash[24585]: audit 2024-09-16T05:37:46.214854+0000 mon.a (mon.0) 495 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T05:37:47.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:37:47 smithi157 bash[24585]: cluster 2024-09-16T05:37:46.718717+0000 mon.a (mon.0) 496 : cluster [DBG] osdmap e28: 3 total, 3 up, 3 in 2024-09-16T05:37:47.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:37:47 smithi157 bash[24585]: audit 2024-09-16T05:37:46.720329+0000 mon.a (mon.0) 497 : audit [INF] from='client.? 172.21.15.47:0/2508949969' entity='mgr.a' cmd=[{"prefix": "osd pool application enable","pool": "myzone1.rgw.control","app": "rgw"}]: dispatch 2024-09-16T05:37:47.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:37:47 smithi086 bash[24289]: audit 2024-09-16T05:37:46.187233+0000 mon.a (mon.0) 490 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T05:37:47.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:37:47 smithi086 bash[24289]: audit 2024-09-16T05:37:46.192887+0000 mon.a (mon.0) 491 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T05:37:47.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:37:47 smithi086 bash[24289]: audit 2024-09-16T05:37:46.198605+0000 mon.a (mon.0) 492 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T05:37:47.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:37:47 smithi086 bash[24289]: audit 2024-09-16T05:37:46.204407+0000 mon.a (mon.0) 493 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T05:37:47.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:37:47 smithi086 bash[24289]: audit 2024-09-16T05:37:46.210684+0000 mon.a (mon.0) 494 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T05:37:47.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:37:47 smithi086 bash[24289]: audit 2024-09-16T05:37:46.214854+0000 mon.a (mon.0) 495 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T05:37:47.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:37:47 smithi086 bash[24289]: cluster 2024-09-16T05:37:46.718717+0000 mon.a (mon.0) 496 : cluster [DBG] osdmap e28: 3 total, 3 up, 3 in 2024-09-16T05:37:47.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:37:47 smithi086 bash[24289]: audit 2024-09-16T05:37:46.720329+0000 mon.a (mon.0) 497 : audit [INF] from='client.? 172.21.15.47:0/2508949969' entity='mgr.a' cmd=[{"prefix": "osd pool application enable","pool": "myzone1.rgw.control","app": "rgw"}]: dispatch 2024-09-16T05:37:47.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:37:47 smithi047 bash[22744]: audit 2024-09-16T05:37:46.187233+0000 mon.a (mon.0) 490 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T05:37:47.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:37:47 smithi047 bash[22744]: audit 2024-09-16T05:37:46.192887+0000 mon.a (mon.0) 491 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T05:37:47.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:37:47 smithi047 bash[22744]: audit 2024-09-16T05:37:46.198605+0000 mon.a (mon.0) 492 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T05:37:47.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:37:47 smithi047 bash[22744]: audit 2024-09-16T05:37:46.204407+0000 mon.a (mon.0) 493 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T05:37:47.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:37:47 smithi047 bash[22744]: audit 2024-09-16T05:37:46.210684+0000 mon.a (mon.0) 494 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T05:37:47.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:37:47 smithi047 bash[22744]: audit 2024-09-16T05:37:46.214854+0000 mon.a (mon.0) 495 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T05:37:47.590 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:37:47 smithi047 bash[22744]: cluster 2024-09-16T05:37:46.718717+0000 mon.a (mon.0) 496 : cluster [DBG] osdmap e28: 3 total, 3 up, 3 in 2024-09-16T05:37:47.590 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:37:47 smithi047 bash[22744]: audit 2024-09-16T05:37:46.720329+0000 mon.a (mon.0) 497 : audit [INF] from='client.? 172.21.15.47:0/2508949969' entity='mgr.a' cmd=[{"prefix": "osd pool application enable","pool": "myzone1.rgw.control","app": "rgw"}]: dispatch 2024-09-16T05:37:48.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:37:48 smithi157 bash[24585]: cluster 2024-09-16T05:37:46.307395+0000 mgr.a (mgr.14373) 10 : cluster [DBG] pgmap v10: 65 pgs: 44 unknown, 21 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 1.5 KiB/s wr, 5 op/s 2024-09-16T05:37:48.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:37:48 smithi157 bash[24585]: audit 2024-09-16T05:37:47.495659+0000 mon.a (mon.0) 498 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T05:37:48.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:37:48 smithi157 bash[24585]: audit 2024-09-16T05:37:47.502617+0000 mon.a (mon.0) 499 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T05:37:48.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:37:48 smithi157 bash[24585]: audit 2024-09-16T05:37:47.536009+0000 mon.a (mon.0) 500 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T05:37:48.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:37:48 smithi157 bash[24585]: audit 2024-09-16T05:37:47.542588+0000 mon.a (mon.0) 501 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T05:37:48.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:37:48 smithi157 bash[24585]: audit 2024-09-16T05:37:47.548162+0000 mon.a (mon.0) 502 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T05:37:48.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:37:48 smithi157 bash[24585]: audit 2024-09-16T05:37:47.555394+0000 mon.a (mon.0) 503 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T05:37:48.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:37:48 smithi157 bash[24585]: audit 2024-09-16T05:37:47.556779+0000 mon.b (mon.2) 31 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T05:37:48.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:37:48 smithi157 bash[24585]: audit 2024-09-16T05:37:47.558286+0000 mon.b (mon.2) 32 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T05:37:48.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:37:48 smithi157 bash[24585]: audit 2024-09-16T05:37:47.715295+0000 mon.a (mon.0) 504 : audit [INF] from='client.? 172.21.15.47:0/2508949969' entity='mgr.a' cmd='[{"prefix": "osd pool application enable","pool": "myzone1.rgw.control","app": "rgw"}]': finished 2024-09-16T05:37:48.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:37:48 smithi157 bash[24585]: cluster 2024-09-16T05:37:47.721784+0000 mon.a (mon.0) 505 : cluster [DBG] osdmap e29: 3 total, 3 up, 3 in 2024-09-16T05:37:48.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:37:48 smithi086 bash[24289]: cluster 2024-09-16T05:37:46.307395+0000 mgr.a (mgr.14373) 10 : cluster [DBG] pgmap v10: 65 pgs: 44 unknown, 21 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 1.5 KiB/s wr, 5 op/s 2024-09-16T05:37:48.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:37:48 smithi086 bash[24289]: audit 2024-09-16T05:37:47.495659+0000 mon.a (mon.0) 498 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T05:37:48.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:37:48 smithi086 bash[24289]: audit 2024-09-16T05:37:47.502617+0000 mon.a (mon.0) 499 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T05:37:48.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:37:48 smithi086 bash[24289]: audit 2024-09-16T05:37:47.536009+0000 mon.a (mon.0) 500 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T05:37:48.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:37:48 smithi086 bash[24289]: audit 2024-09-16T05:37:47.542588+0000 mon.a (mon.0) 501 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T05:37:48.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:37:48 smithi086 bash[24289]: audit 2024-09-16T05:37:47.548162+0000 mon.a (mon.0) 502 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T05:37:48.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:37:48 smithi086 bash[24289]: audit 2024-09-16T05:37:47.555394+0000 mon.a (mon.0) 503 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T05:37:48.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:37:48 smithi086 bash[24289]: audit 2024-09-16T05:37:47.556779+0000 mon.b (mon.2) 31 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T05:37:48.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:37:48 smithi086 bash[24289]: audit 2024-09-16T05:37:47.558286+0000 mon.b (mon.2) 32 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T05:37:48.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:37:48 smithi086 bash[24289]: audit 2024-09-16T05:37:47.715295+0000 mon.a (mon.0) 504 : audit [INF] from='client.? 172.21.15.47:0/2508949969' entity='mgr.a' cmd='[{"prefix": "osd pool application enable","pool": "myzone1.rgw.control","app": "rgw"}]': finished 2024-09-16T05:37:48.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:37:48 smithi086 bash[24289]: cluster 2024-09-16T05:37:47.721784+0000 mon.a (mon.0) 505 : cluster [DBG] osdmap e29: 3 total, 3 up, 3 in 2024-09-16T05:37:48.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:37:48 smithi047 bash[22744]: cluster 2024-09-16T05:37:46.307395+0000 mgr.a (mgr.14373) 10 : cluster [DBG] pgmap v10: 65 pgs: 44 unknown, 21 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 1.5 KiB/s wr, 5 op/s 2024-09-16T05:37:48.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:37:48 smithi047 bash[22744]: audit 2024-09-16T05:37:47.495659+0000 mon.a (mon.0) 498 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T05:37:48.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:37:48 smithi047 bash[22744]: audit 2024-09-16T05:37:47.502617+0000 mon.a (mon.0) 499 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T05:37:48.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:37:48 smithi047 bash[22744]: audit 2024-09-16T05:37:47.536009+0000 mon.a (mon.0) 500 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T05:37:48.590 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:37:48 smithi047 bash[22744]: audit 2024-09-16T05:37:47.542588+0000 mon.a (mon.0) 501 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T05:37:48.590 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:37:48 smithi047 bash[22744]: audit 2024-09-16T05:37:47.548162+0000 mon.a (mon.0) 502 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T05:37:48.590 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:37:48 smithi047 bash[22744]: audit 2024-09-16T05:37:47.555394+0000 mon.a (mon.0) 503 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T05:37:48.590 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:37:48 smithi047 bash[22744]: audit 2024-09-16T05:37:47.556779+0000 mon.b (mon.2) 31 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T05:37:48.590 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:37:48 smithi047 bash[22744]: audit 2024-09-16T05:37:47.558286+0000 mon.b (mon.2) 32 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T05:37:48.590 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:37:48 smithi047 bash[22744]: audit 2024-09-16T05:37:47.715295+0000 mon.a (mon.0) 504 : audit [INF] from='client.? 172.21.15.47:0/2508949969' entity='mgr.a' cmd='[{"prefix": "osd pool application enable","pool": "myzone1.rgw.control","app": "rgw"}]': finished 2024-09-16T05:37:48.590 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:37:48 smithi047 bash[22744]: cluster 2024-09-16T05:37:47.721784+0000 mon.a (mon.0) 505 : cluster [DBG] osdmap e29: 3 total, 3 up, 3 in 2024-09-16T05:37:49.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:37:49 smithi157 bash[24585]: cephadm 2024-09-16T05:37:47.563448+0000 mgr.a (mgr.14373) 11 : cephadm [INF] Updating smithi047:/etc/ceph/ceph.conf 2024-09-16T05:37:49.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:37:49 smithi157 bash[24585]: cephadm 2024-09-16T05:37:47.563934+0000 mgr.a (mgr.14373) 12 : cephadm [INF] Updating smithi086:/etc/ceph/ceph.conf 2024-09-16T05:37:49.555 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:37:49 smithi157 bash[24585]: cephadm 2024-09-16T05:37:47.564239+0000 mgr.a (mgr.14373) 13 : cephadm [INF] Updating smithi157:/etc/ceph/ceph.conf 2024-09-16T05:37:49.555 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:37:49 smithi157 bash[24585]: cephadm 2024-09-16T05:37:47.830286+0000 mgr.a (mgr.14373) 14 : cephadm [INF] Updating smithi047:/var/lib/ceph/a6097908-73ec-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-16T05:37:49.555 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:37:49 smithi157 bash[24585]: cephadm 2024-09-16T05:37:47.830635+0000 mgr.a (mgr.14373) 15 : cephadm [INF] Updating smithi086:/var/lib/ceph/a6097908-73ec-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-16T05:37:49.555 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:37:49 smithi157 bash[24585]: cephadm 2024-09-16T05:37:47.841745+0000 mgr.a (mgr.14373) 16 : cephadm [INF] Updating smithi157:/var/lib/ceph/a6097908-73ec-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-16T05:37:49.555 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:37:49 smithi157 bash[24585]: cephadm 2024-09-16T05:37:48.019042+0000 mgr.a (mgr.14373) 17 : cephadm [INF] Updating smithi047:/etc/ceph/ceph.client.admin.keyring 2024-09-16T05:37:49.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:37:49 smithi157 bash[24585]: cephadm 2024-09-16T05:37:48.019922+0000 mgr.a (mgr.14373) 18 : cephadm [INF] Updating smithi086:/etc/ceph/ceph.client.admin.keyring 2024-09-16T05:37:49.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:37:49 smithi157 bash[24585]: cephadm 2024-09-16T05:37:48.043774+0000 mgr.a (mgr.14373) 19 : cephadm [INF] Updating smithi157:/etc/ceph/ceph.client.admin.keyring 2024-09-16T05:37:49.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:37:49 smithi157 bash[24585]: cephadm 2024-09-16T05:37:48.208421+0000 mgr.a (mgr.14373) 20 : cephadm [INF] Updating smithi047:/var/lib/ceph/a6097908-73ec-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-16T05:37:49.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:37:49 smithi157 bash[24585]: cephadm 2024-09-16T05:37:48.209244+0000 mgr.a (mgr.14373) 21 : cephadm [INF] Updating smithi086:/var/lib/ceph/a6097908-73ec-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-16T05:37:49.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:37:49 smithi157 bash[24585]: cephadm 2024-09-16T05:37:48.232843+0000 mgr.a (mgr.14373) 22 : cephadm [INF] Updating smithi157:/var/lib/ceph/a6097908-73ec-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-16T05:37:49.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:37:49 smithi157 bash[24585]: audit 2024-09-16T05:37:48.385676+0000 mon.a (mon.0) 506 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T05:37:49.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:37:49 smithi157 bash[24585]: audit 2024-09-16T05:37:48.392245+0000 mon.a (mon.0) 507 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T05:37:49.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:37:49 smithi157 bash[24585]: audit 2024-09-16T05:37:48.397778+0000 mon.a (mon.0) 508 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T05:37:49.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:37:49 smithi157 bash[24585]: audit 2024-09-16T05:37:48.403834+0000 mon.a (mon.0) 509 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T05:37:49.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:37:49 smithi157 bash[24585]: audit 2024-09-16T05:37:48.410704+0000 mon.a (mon.0) 510 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T05:37:49.558 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:37:49 smithi157 bash[24585]: audit 2024-09-16T05:37:48.417396+0000 mon.a (mon.0) 511 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T05:37:49.558 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:37:49 smithi157 bash[24585]: audit 2024-09-16T05:37:48.426480+0000 mon.a (mon.0) 512 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T05:37:49.558 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:37:49 smithi157 bash[24585]: audit 2024-09-16T05:37:48.474521+0000 mon.b (mon.2) 33 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T05:37:49.558 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:37:49 smithi157 bash[24585]: audit 2024-09-16T05:37:48.477112+0000 mon.b (mon.2) 34 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T05:37:49.558 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:37:49 smithi157 bash[24585]: audit 2024-09-16T05:37:48.478704+0000 mon.b (mon.2) 35 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T05:37:49.558 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:37:49 smithi157 bash[24585]: audit 2024-09-16T05:37:48.487659+0000 mon.a (mon.0) 513 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T05:37:49.558 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:37:49 smithi157 bash[24585]: cluster 2024-09-16T05:37:48.723918+0000 mon.a (mon.0) 514 : cluster [DBG] osdmap e30: 3 total, 3 up, 3 in 2024-09-16T05:37:49.558 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:37:49 smithi157 bash[24585]: audit 2024-09-16T05:37:48.730864+0000 mon.a (mon.0) 515 : audit [INF] from='client.? 172.21.15.47:0/2508949969' entity='mgr.a' cmd=[{"prefix": "osd pool application enable","pool": "myzone1.rgw.meta","app": "rgw"}]: dispatch 2024-09-16T05:37:49.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:37:49 smithi086 bash[24289]: cephadm 2024-09-16T05:37:47.563448+0000 mgr.a (mgr.14373) 11 : cephadm [INF] Updating smithi047:/etc/ceph/ceph.conf 2024-09-16T05:37:49.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:37:49 smithi086 bash[24289]: cephadm 2024-09-16T05:37:47.563934+0000 mgr.a (mgr.14373) 12 : cephadm [INF] Updating smithi086:/etc/ceph/ceph.conf 2024-09-16T05:37:49.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:37:49 smithi086 bash[24289]: cephadm 2024-09-16T05:37:47.564239+0000 mgr.a (mgr.14373) 13 : cephadm [INF] Updating smithi157:/etc/ceph/ceph.conf 2024-09-16T05:37:49.572 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:37:49 smithi086 bash[24289]: cephadm 2024-09-16T05:37:47.830286+0000 mgr.a (mgr.14373) 14 : cephadm [INF] Updating smithi047:/var/lib/ceph/a6097908-73ec-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-16T05:37:49.572 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:37:49 smithi086 bash[24289]: cephadm 2024-09-16T05:37:47.830635+0000 mgr.a (mgr.14373) 15 : cephadm [INF] Updating smithi086:/var/lib/ceph/a6097908-73ec-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-16T05:37:49.572 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:37:49 smithi086 bash[24289]: cephadm 2024-09-16T05:37:47.841745+0000 mgr.a (mgr.14373) 16 : cephadm [INF] Updating smithi157:/var/lib/ceph/a6097908-73ec-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-16T05:37:49.572 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:37:49 smithi086 bash[24289]: cephadm 2024-09-16T05:37:48.019042+0000 mgr.a (mgr.14373) 17 : cephadm [INF] Updating smithi047:/etc/ceph/ceph.client.admin.keyring 2024-09-16T05:37:49.572 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:37:49 smithi086 bash[24289]: cephadm 2024-09-16T05:37:48.019922+0000 mgr.a (mgr.14373) 18 : cephadm [INF] Updating smithi086:/etc/ceph/ceph.client.admin.keyring 2024-09-16T05:37:49.572 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:37:49 smithi086 bash[24289]: cephadm 2024-09-16T05:37:48.043774+0000 mgr.a (mgr.14373) 19 : cephadm [INF] Updating smithi157:/etc/ceph/ceph.client.admin.keyring 2024-09-16T05:37:49.572 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:37:49 smithi086 bash[24289]: cephadm 2024-09-16T05:37:48.208421+0000 mgr.a (mgr.14373) 20 : cephadm [INF] Updating smithi047:/var/lib/ceph/a6097908-73ec-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-16T05:37:49.572 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:37:49 smithi086 bash[24289]: cephadm 2024-09-16T05:37:48.209244+0000 mgr.a (mgr.14373) 21 : cephadm [INF] Updating smithi086:/var/lib/ceph/a6097908-73ec-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-16T05:37:49.572 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:37:49 smithi086 bash[24289]: cephadm 2024-09-16T05:37:48.232843+0000 mgr.a (mgr.14373) 22 : cephadm [INF] Updating smithi157:/var/lib/ceph/a6097908-73ec-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-16T05:37:49.572 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:37:49 smithi086 bash[24289]: audit 2024-09-16T05:37:48.385676+0000 mon.a (mon.0) 506 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T05:37:49.573 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:37:49 smithi086 bash[24289]: audit 2024-09-16T05:37:48.392245+0000 mon.a (mon.0) 507 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T05:37:49.573 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:37:49 smithi086 bash[24289]: audit 2024-09-16T05:37:48.397778+0000 mon.a (mon.0) 508 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T05:37:49.573 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:37:49 smithi086 bash[24289]: audit 2024-09-16T05:37:48.403834+0000 mon.a (mon.0) 509 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T05:37:49.573 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:37:49 smithi086 bash[24289]: audit 2024-09-16T05:37:48.410704+0000 mon.a (mon.0) 510 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T05:37:49.573 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:37:49 smithi086 bash[24289]: audit 2024-09-16T05:37:48.417396+0000 mon.a (mon.0) 511 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T05:37:49.573 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:37:49 smithi086 bash[24289]: audit 2024-09-16T05:37:48.426480+0000 mon.a (mon.0) 512 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T05:37:49.573 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:37:49 smithi086 bash[24289]: audit 2024-09-16T05:37:48.474521+0000 mon.b (mon.2) 33 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T05:37:49.573 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:37:49 smithi086 bash[24289]: audit 2024-09-16T05:37:48.477112+0000 mon.b (mon.2) 34 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T05:37:49.573 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:37:49 smithi086 bash[24289]: audit 2024-09-16T05:37:48.478704+0000 mon.b (mon.2) 35 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T05:37:49.573 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:37:49 smithi086 bash[24289]: audit 2024-09-16T05:37:48.487659+0000 mon.a (mon.0) 513 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T05:37:49.573 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:37:49 smithi086 bash[24289]: cluster 2024-09-16T05:37:48.723918+0000 mon.a (mon.0) 514 : cluster [DBG] osdmap e30: 3 total, 3 up, 3 in 2024-09-16T05:37:49.573 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:37:49 smithi086 bash[24289]: audit 2024-09-16T05:37:48.730864+0000 mon.a (mon.0) 515 : audit [INF] from='client.? 172.21.15.47:0/2508949969' entity='mgr.a' cmd=[{"prefix": "osd pool application enable","pool": "myzone1.rgw.meta","app": "rgw"}]: dispatch 2024-09-16T05:37:49.590 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:37:49 smithi047 bash[22744]: cephadm 2024-09-16T05:37:47.563448+0000 mgr.a (mgr.14373) 11 : cephadm [INF] Updating smithi047:/etc/ceph/ceph.conf 2024-09-16T05:37:49.590 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:37:49 smithi047 bash[22744]: cephadm 2024-09-16T05:37:47.563934+0000 mgr.a (mgr.14373) 12 : cephadm [INF] Updating smithi086:/etc/ceph/ceph.conf 2024-09-16T05:37:49.590 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:37:49 smithi047 bash[22744]: cephadm 2024-09-16T05:37:47.564239+0000 mgr.a (mgr.14373) 13 : cephadm [INF] Updating smithi157:/etc/ceph/ceph.conf 2024-09-16T05:37:49.590 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:37:49 smithi047 bash[22744]: cephadm 2024-09-16T05:37:47.830286+0000 mgr.a (mgr.14373) 14 : cephadm [INF] Updating smithi047:/var/lib/ceph/a6097908-73ec-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-16T05:37:49.590 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:37:49 smithi047 bash[22744]: cephadm 2024-09-16T05:37:47.830635+0000 mgr.a (mgr.14373) 15 : cephadm [INF] Updating smithi086:/var/lib/ceph/a6097908-73ec-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-16T05:37:49.590 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:37:49 smithi047 bash[22744]: cephadm 2024-09-16T05:37:47.841745+0000 mgr.a (mgr.14373) 16 : cephadm [INF] Updating smithi157:/var/lib/ceph/a6097908-73ec-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-16T05:37:49.591 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:37:49 smithi047 bash[22744]: cephadm 2024-09-16T05:37:48.019042+0000 mgr.a (mgr.14373) 17 : cephadm [INF] Updating smithi047:/etc/ceph/ceph.client.admin.keyring 2024-09-16T05:37:49.591 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:37:49 smithi047 bash[22744]: cephadm 2024-09-16T05:37:48.019922+0000 mgr.a (mgr.14373) 18 : cephadm [INF] Updating smithi086:/etc/ceph/ceph.client.admin.keyring 2024-09-16T05:37:49.591 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:37:49 smithi047 bash[22744]: cephadm 2024-09-16T05:37:48.043774+0000 mgr.a (mgr.14373) 19 : cephadm [INF] Updating smithi157:/etc/ceph/ceph.client.admin.keyring 2024-09-16T05:37:49.591 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:37:49 smithi047 bash[22744]: cephadm 2024-09-16T05:37:48.208421+0000 mgr.a (mgr.14373) 20 : cephadm [INF] Updating smithi047:/var/lib/ceph/a6097908-73ec-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-16T05:37:49.591 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:37:49 smithi047 bash[22744]: cephadm 2024-09-16T05:37:48.209244+0000 mgr.a (mgr.14373) 21 : cephadm [INF] Updating smithi086:/var/lib/ceph/a6097908-73ec-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-16T05:37:49.591 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:37:49 smithi047 bash[22744]: cephadm 2024-09-16T05:37:48.232843+0000 mgr.a (mgr.14373) 22 : cephadm [INF] Updating smithi157:/var/lib/ceph/a6097908-73ec-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-16T05:37:49.591 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:37:49 smithi047 bash[22744]: audit 2024-09-16T05:37:48.385676+0000 mon.a (mon.0) 506 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T05:37:49.591 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:37:49 smithi047 bash[22744]: audit 2024-09-16T05:37:48.392245+0000 mon.a (mon.0) 507 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T05:37:49.591 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:37:49 smithi047 bash[22744]: audit 2024-09-16T05:37:48.397778+0000 mon.a (mon.0) 508 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T05:37:49.591 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:37:49 smithi047 bash[22744]: audit 2024-09-16T05:37:48.403834+0000 mon.a (mon.0) 509 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T05:37:49.591 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:37:49 smithi047 bash[22744]: audit 2024-09-16T05:37:48.410704+0000 mon.a (mon.0) 510 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T05:37:49.591 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:37:49 smithi047 bash[22744]: audit 2024-09-16T05:37:48.417396+0000 mon.a (mon.0) 511 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T05:37:49.591 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:37:49 smithi047 bash[22744]: audit 2024-09-16T05:37:48.426480+0000 mon.a (mon.0) 512 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T05:37:49.591 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:37:49 smithi047 bash[22744]: audit 2024-09-16T05:37:48.474521+0000 mon.b (mon.2) 33 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T05:37:49.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:37:49 smithi047 bash[22744]: audit 2024-09-16T05:37:48.477112+0000 mon.b (mon.2) 34 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T05:37:49.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:37:49 smithi047 bash[22744]: audit 2024-09-16T05:37:48.478704+0000 mon.b (mon.2) 35 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T05:37:49.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:37:49 smithi047 bash[22744]: audit 2024-09-16T05:37:48.487659+0000 mon.a (mon.0) 513 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T05:37:49.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:37:49 smithi047 bash[22744]: cluster 2024-09-16T05:37:48.723918+0000 mon.a (mon.0) 514 : cluster [DBG] osdmap e30: 3 total, 3 up, 3 in 2024-09-16T05:37:49.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:37:49 smithi047 bash[22744]: audit 2024-09-16T05:37:48.730864+0000 mon.a (mon.0) 515 : audit [INF] from='client.? 172.21.15.47:0/2508949969' entity='mgr.a' cmd=[{"prefix": "osd pool application enable","pool": "myzone1.rgw.meta","app": "rgw"}]: dispatch 2024-09-16T05:37:50.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:37:50 smithi157 bash[24585]: cluster 2024-09-16T05:37:48.307820+0000 mgr.a (mgr.14373) 23 : cluster [DBG] pgmap v13: 97 pgs: 32 unknown, 65 active+clean; 579 KiB data, 90 MiB used, 268 GiB / 268 GiB avail; 59 KiB/s rd, 3.5 KiB/s wr, 42 op/s 2024-09-16T05:37:50.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:37:50 smithi157 bash[24585]: audit 2024-09-16T05:37:49.721253+0000 mon.a (mon.0) 516 : audit [INF] from='client.? 172.21.15.47:0/2508949969' entity='mgr.a' cmd='[{"prefix": "osd pool application enable","pool": "myzone1.rgw.meta","app": "rgw"}]': finished 2024-09-16T05:37:50.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:37:50 smithi157 bash[24585]: cluster 2024-09-16T05:37:49.727431+0000 mon.a (mon.0) 517 : cluster [DBG] osdmap e31: 3 total, 3 up, 3 in 2024-09-16T05:37:50.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:37:50 smithi157 bash[24585]: audit 2024-09-16T05:37:49.731334+0000 mon.a (mon.0) 518 : audit [INF] from='client.? 172.21.15.47:0/2508949969' entity='mgr.a' cmd=[{"prefix": "osd pool set", "pool": "myzone1.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2024-09-16T05:37:50.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:37:50 smithi086 bash[24289]: cluster 2024-09-16T05:37:48.307820+0000 mgr.a (mgr.14373) 23 : cluster [DBG] pgmap v13: 97 pgs: 32 unknown, 65 active+clean; 579 KiB data, 90 MiB used, 268 GiB / 268 GiB avail; 59 KiB/s rd, 3.5 KiB/s wr, 42 op/s 2024-09-16T05:37:50.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:37:50 smithi086 bash[24289]: audit 2024-09-16T05:37:49.721253+0000 mon.a (mon.0) 516 : audit [INF] from='client.? 172.21.15.47:0/2508949969' entity='mgr.a' cmd='[{"prefix": "osd pool application enable","pool": "myzone1.rgw.meta","app": "rgw"}]': finished 2024-09-16T05:37:50.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:37:50 smithi086 bash[24289]: cluster 2024-09-16T05:37:49.727431+0000 mon.a (mon.0) 517 : cluster [DBG] osdmap e31: 3 total, 3 up, 3 in 2024-09-16T05:37:50.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:37:50 smithi086 bash[24289]: audit 2024-09-16T05:37:49.731334+0000 mon.a (mon.0) 518 : audit [INF] from='client.? 172.21.15.47:0/2508949969' entity='mgr.a' cmd=[{"prefix": "osd pool set", "pool": "myzone1.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2024-09-16T05:37:50.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:37:50 smithi047 bash[22744]: cluster 2024-09-16T05:37:48.307820+0000 mgr.a (mgr.14373) 23 : cluster [DBG] pgmap v13: 97 pgs: 32 unknown, 65 active+clean; 579 KiB data, 90 MiB used, 268 GiB / 268 GiB avail; 59 KiB/s rd, 3.5 KiB/s wr, 42 op/s 2024-09-16T05:37:50.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:37:50 smithi047 bash[22744]: audit 2024-09-16T05:37:49.721253+0000 mon.a (mon.0) 516 : audit [INF] from='client.? 172.21.15.47:0/2508949969' entity='mgr.a' cmd='[{"prefix": "osd pool application enable","pool": "myzone1.rgw.meta","app": "rgw"}]': finished 2024-09-16T05:37:50.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:37:50 smithi047 bash[22744]: cluster 2024-09-16T05:37:49.727431+0000 mon.a (mon.0) 517 : cluster [DBG] osdmap e31: 3 total, 3 up, 3 in 2024-09-16T05:37:50.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:37:50 smithi047 bash[22744]: audit 2024-09-16T05:37:49.731334+0000 mon.a (mon.0) 518 : audit [INF] from='client.? 172.21.15.47:0/2508949969' entity='mgr.a' cmd=[{"prefix": "osd pool set", "pool": "myzone1.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2024-09-16T05:37:51.621 INFO:teuthology.orchestra.run.smithi047.stdout:Realm(s) created correctly. Please, use 'ceph rgw realm tokens' to get the token. 2024-09-16T05:37:52.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:37:51 smithi157 bash[24585]: cluster 2024-09-16T05:37:50.308457+0000 mgr.a (mgr.14373) 24 : cluster [DBG] pgmap v16: 129 pgs: 64 unknown, 65 active+clean; 579 KiB data, 90 MiB used, 268 GiB / 268 GiB avail; 57 KiB/s rd, 2.0 KiB/s wr, 37 op/s 2024-09-16T05:37:52.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:37:51 smithi157 bash[24585]: audit 2024-09-16T05:37:50.723876+0000 mon.a (mon.0) 519 : audit [INF] from='client.? 172.21.15.47:0/2508949969' entity='mgr.a' cmd='[{"prefix": "osd pool set", "pool": "myzone1.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]': finished 2024-09-16T05:37:52.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:37:51 smithi157 bash[24585]: cluster 2024-09-16T05:37:50.729871+0000 mon.a (mon.0) 520 : cluster [DBG] osdmap e32: 3 total, 3 up, 3 in 2024-09-16T05:37:52.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:37:51 smithi157 bash[24585]: audit 2024-09-16T05:37:51.620614+0000 mon.a (mon.0) 521 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T05:37:52.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:37:51 smithi157 bash[24585]: audit 2024-09-16T05:37:51.620773+0000 mon.b (mon.2) 36 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T05:37:52.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:37:51 smithi157 bash[24585]: audit 2024-09-16T05:37:51.624995+0000 mon.b (mon.2) 37 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T05:37:52.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:37:51 smithi157 bash[24585]: audit 2024-09-16T05:37:51.626670+0000 mon.b (mon.2) 38 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T05:37:52.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:37:51 smithi157 bash[24585]: audit 2024-09-16T05:37:51.639020+0000 mon.a (mon.0) 522 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T05:37:52.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:37:51 smithi157 bash[24585]: audit 2024-09-16T05:37:51.642101+0000 mon.b (mon.2) 39 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.myrealm1.myzone1.smithi086.jwevgv", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-09-16T05:37:52.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:37:51 smithi157 bash[24585]: audit 2024-09-16T05:37:51.645911+0000 mon.a (mon.0) 523 : audit [INF] from='mgr.14373 ' entity='mgr.a' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.myrealm1.myzone1.smithi086.jwevgv", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-09-16T05:37:52.055 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:37:51 smithi157 bash[24585]: audit 2024-09-16T05:37:51.647926+0000 mon.a (mon.0) 524 : audit [INF] from='mgr.14373 ' entity='mgr.a' cmd='[{"prefix": "auth get-or-create", "entity": "client.rgw.myrealm1.myzone1.smithi086.jwevgv", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]': finished 2024-09-16T05:37:52.055 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:37:51 smithi157 bash[24585]: audit 2024-09-16T05:37:51.656720+0000 mon.a (mon.0) 525 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T05:37:52.055 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:37:51 smithi157 bash[24585]: audit 2024-09-16T05:37:51.658931+0000 mon.b (mon.2) 40 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T05:37:52.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:37:51 smithi086 bash[24289]: cluster 2024-09-16T05:37:50.308457+0000 mgr.a (mgr.14373) 24 : cluster [DBG] pgmap v16: 129 pgs: 64 unknown, 65 active+clean; 579 KiB data, 90 MiB used, 268 GiB / 268 GiB avail; 57 KiB/s rd, 2.0 KiB/s wr, 37 op/s 2024-09-16T05:37:52.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:37:51 smithi086 bash[24289]: audit 2024-09-16T05:37:50.723876+0000 mon.a (mon.0) 519 : audit [INF] from='client.? 172.21.15.47:0/2508949969' entity='mgr.a' cmd='[{"prefix": "osd pool set", "pool": "myzone1.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]': finished 2024-09-16T05:37:52.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:37:51 smithi086 bash[24289]: cluster 2024-09-16T05:37:50.729871+0000 mon.a (mon.0) 520 : cluster [DBG] osdmap e32: 3 total, 3 up, 3 in 2024-09-16T05:37:52.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:37:51 smithi086 bash[24289]: audit 2024-09-16T05:37:51.620614+0000 mon.a (mon.0) 521 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T05:37:52.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:37:51 smithi086 bash[24289]: audit 2024-09-16T05:37:51.620773+0000 mon.b (mon.2) 36 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T05:37:52.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:37:51 smithi086 bash[24289]: audit 2024-09-16T05:37:51.624995+0000 mon.b (mon.2) 37 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T05:37:52.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:37:51 smithi086 bash[24289]: audit 2024-09-16T05:37:51.626670+0000 mon.b (mon.2) 38 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T05:37:52.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:37:51 smithi086 bash[24289]: audit 2024-09-16T05:37:51.639020+0000 mon.a (mon.0) 522 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T05:37:52.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:37:51 smithi086 bash[24289]: audit 2024-09-16T05:37:51.642101+0000 mon.b (mon.2) 39 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.myrealm1.myzone1.smithi086.jwevgv", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-09-16T05:37:52.072 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:37:51 smithi086 bash[24289]: audit 2024-09-16T05:37:51.645911+0000 mon.a (mon.0) 523 : audit [INF] from='mgr.14373 ' entity='mgr.a' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.myrealm1.myzone1.smithi086.jwevgv", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-09-16T05:37:52.072 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:37:51 smithi086 bash[24289]: audit 2024-09-16T05:37:51.647926+0000 mon.a (mon.0) 524 : audit [INF] from='mgr.14373 ' entity='mgr.a' cmd='[{"prefix": "auth get-or-create", "entity": "client.rgw.myrealm1.myzone1.smithi086.jwevgv", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]': finished 2024-09-16T05:37:52.072 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:37:51 smithi086 bash[24289]: audit 2024-09-16T05:37:51.656720+0000 mon.a (mon.0) 525 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T05:37:52.072 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:37:51 smithi086 bash[24289]: audit 2024-09-16T05:37:51.658931+0000 mon.b (mon.2) 40 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T05:37:52.090 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:37:51 smithi047 bash[22744]: cluster 2024-09-16T05:37:50.308457+0000 mgr.a (mgr.14373) 24 : cluster [DBG] pgmap v16: 129 pgs: 64 unknown, 65 active+clean; 579 KiB data, 90 MiB used, 268 GiB / 268 GiB avail; 57 KiB/s rd, 2.0 KiB/s wr, 37 op/s 2024-09-16T05:37:52.090 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:37:51 smithi047 bash[22744]: audit 2024-09-16T05:37:50.723876+0000 mon.a (mon.0) 519 : audit [INF] from='client.? 172.21.15.47:0/2508949969' entity='mgr.a' cmd='[{"prefix": "osd pool set", "pool": "myzone1.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]': finished 2024-09-16T05:37:52.090 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:37:51 smithi047 bash[22744]: cluster 2024-09-16T05:37:50.729871+0000 mon.a (mon.0) 520 : cluster [DBG] osdmap e32: 3 total, 3 up, 3 in 2024-09-16T05:37:52.090 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:37:51 smithi047 bash[22744]: audit 2024-09-16T05:37:51.620614+0000 mon.a (mon.0) 521 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T05:37:52.090 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:37:51 smithi047 bash[22744]: audit 2024-09-16T05:37:51.620773+0000 mon.b (mon.2) 36 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T05:37:52.090 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:37:51 smithi047 bash[22744]: audit 2024-09-16T05:37:51.624995+0000 mon.b (mon.2) 37 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T05:37:52.090 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:37:51 smithi047 bash[22744]: audit 2024-09-16T05:37:51.626670+0000 mon.b (mon.2) 38 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T05:37:52.090 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:37:51 smithi047 bash[22744]: audit 2024-09-16T05:37:51.639020+0000 mon.a (mon.0) 522 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T05:37:52.090 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:37:51 smithi047 bash[22744]: audit 2024-09-16T05:37:51.642101+0000 mon.b (mon.2) 39 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.myrealm1.myzone1.smithi086.jwevgv", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-09-16T05:37:52.090 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:37:51 smithi047 bash[22744]: audit 2024-09-16T05:37:51.645911+0000 mon.a (mon.0) 523 : audit [INF] from='mgr.14373 ' entity='mgr.a' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.myrealm1.myzone1.smithi086.jwevgv", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-09-16T05:37:52.091 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:37:51 smithi047 bash[22744]: audit 2024-09-16T05:37:51.647926+0000 mon.a (mon.0) 524 : audit [INF] from='mgr.14373 ' entity='mgr.a' cmd='[{"prefix": "auth get-or-create", "entity": "client.rgw.myrealm1.myzone1.smithi086.jwevgv", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]': finished 2024-09-16T05:37:52.091 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:37:51 smithi047 bash[22744]: audit 2024-09-16T05:37:51.656720+0000 mon.a (mon.0) 525 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T05:37:52.091 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:37:51 smithi047 bash[22744]: audit 2024-09-16T05:37:51.658931+0000 mon.b (mon.2) 40 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T05:37:52.399 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-16T05:37:52.409 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi047.front.sepia.ceph.com 2024-09-16T05:37:52.410 DEBUG:teuthology.orchestra.run.smithi047:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a6097908-73ec-11ef-bceb-c7b262605968 -- bash -c 'set -e 2024-09-16T05:37:52.410 DEBUG:teuthology.orchestra.run.smithi047:> set -x 2024-09-16T05:37:52.410 DEBUG:teuthology.orchestra.run.smithi047:> while true; do TOKEN=$(ceph rgw realm tokens | jq -r '"'"'.[0].token'"'"'); echo $TOKEN; if [ "$TOKEN" != "master zone has no endpoint" ]; then break; fi; sleep 5; done 2024-09-16T05:37:52.410 DEBUG:teuthology.orchestra.run.smithi047:> TOKENS=$(ceph rgw realm tokens) 2024-09-16T05:37:52.410 DEBUG:teuthology.orchestra.run.smithi047:> echo $TOKENS | jq --exit-status '"'"'.[0].realm == "myrealm1"'"'"' 2024-09-16T05:37:52.410 DEBUG:teuthology.orchestra.run.smithi047:> echo $TOKENS | jq --exit-status '"'"'.[0].token'"'"' 2024-09-16T05:37:52.410 DEBUG:teuthology.orchestra.run.smithi047:> TOKEN_JSON=$(ceph rgw realm tokens | jq -r '"'"'.[0].token'"'"' | base64 --decode) 2024-09-16T05:37:52.410 DEBUG:teuthology.orchestra.run.smithi047:> echo $TOKEN_JSON | jq --exit-status '"'"'.realm_name == "myrealm1"'"'"' 2024-09-16T05:37:52.410 DEBUG:teuthology.orchestra.run.smithi047:> echo $TOKEN_JSON | jq --exit-status '"'"'.endpoint | test("http://.+:\\d+")'"'"' 2024-09-16T05:37:52.410 DEBUG:teuthology.orchestra.run.smithi047:> echo $TOKEN_JSON | jq --exit-status '"'"'.realm_id | test("^[0-9a-f]{8}-[0-9a-f]{4}-[0-9a-f]{4}-[0-9a-f]{4}-[0-9a-f]{12}$")'"'"' 2024-09-16T05:37:52.410 DEBUG:teuthology.orchestra.run.smithi047:> echo $TOKEN_JSON | jq --exit-status '"'"'.access_key'"'"' 2024-09-16T05:37:52.410 DEBUG:teuthology.orchestra.run.smithi047:> echo $TOKEN_JSON | jq --exit-status '"'"'.secret'"'"' 2024-09-16T05:37:52.410 DEBUG:teuthology.orchestra.run.smithi047:> ' 2024-09-16T05:37:53.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:37:52 smithi157 bash[24585]: cephadm 2024-09-16T05:37:51.613810+0000 mgr.a (mgr.14373) 25 : cephadm [INF] Saving service rgw.myrealm1.myzone1 spec with placement count:2 2024-09-16T05:37:53.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:37:52 smithi157 bash[24585]: cephadm 2024-09-16T05:37:51.663678+0000 mgr.a (mgr.14373) 26 : cephadm [INF] Deploying daemon rgw.myrealm1.myzone1.smithi086.jwevgv on smithi086 2024-09-16T05:37:53.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:37:52 smithi086 bash[24289]: cephadm 2024-09-16T05:37:51.613810+0000 mgr.a (mgr.14373) 25 : cephadm [INF] Saving service rgw.myrealm1.myzone1 spec with placement count:2 2024-09-16T05:37:53.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:37:52 smithi086 bash[24289]: cephadm 2024-09-16T05:37:51.663678+0000 mgr.a (mgr.14373) 26 : cephadm [INF] Deploying daemon rgw.myrealm1.myzone1.smithi086.jwevgv on smithi086 2024-09-16T05:37:53.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:37:52 smithi047 bash[22744]: cephadm 2024-09-16T05:37:51.613810+0000 mgr.a (mgr.14373) 25 : cephadm [INF] Saving service rgw.myrealm1.myzone1 spec with placement count:2 2024-09-16T05:37:53.090 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:37:52 smithi047 bash[22744]: cephadm 2024-09-16T05:37:51.663678+0000 mgr.a (mgr.14373) 26 : cephadm [INF] Deploying daemon rgw.myrealm1.myzone1.smithi086.jwevgv on smithi086 2024-09-16T05:37:53.991 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:37:53 smithi086 bash[24289]: cluster 2024-09-16T05:37:52.310000+0000 mgr.a (mgr.14373) 27 : cluster [DBG] pgmap v18: 129 pgs: 129 active+clean; 582 KiB data, 94 MiB used, 268 GiB / 268 GiB avail; 9.1 KiB/s rd, 3.7 KiB/s wr, 14 op/s 2024-09-16T05:37:54.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:37:53 smithi157 bash[24585]: cluster 2024-09-16T05:37:52.310000+0000 mgr.a (mgr.14373) 27 : cluster [DBG] pgmap v18: 129 pgs: 129 active+clean; 582 KiB data, 94 MiB used, 268 GiB / 268 GiB avail; 9.1 KiB/s rd, 3.7 KiB/s wr, 14 op/s 2024-09-16T05:37:54.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:37:53 smithi047 bash[22744]: cluster 2024-09-16T05:37:52.310000+0000 mgr.a (mgr.14373) 27 : cluster [DBG] pgmap v18: 129 pgs: 129 active+clean; 582 KiB data, 94 MiB used, 268 GiB / 268 GiB avail; 9.1 KiB/s rd, 3.7 KiB/s wr, 14 op/s 2024-09-16T05:37:54.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:37:54 smithi086 systemd[1]: /etc/systemd/system/ceph-a6097908-73ec-11ef-bceb-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-16T05:37:54.318 INFO:journalctl@ceph.mgr.b.smithi086.stdout:Sep 16 05:37:54 smithi086 systemd[1]: /etc/systemd/system/ceph-a6097908-73ec-11ef-bceb-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-16T05:37:54.318 INFO:journalctl@ceph.osd.1.smithi086.stdout:Sep 16 05:37:54 smithi086 systemd[1]: /etc/systemd/system/ceph-a6097908-73ec-11ef-bceb-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-16T05:37:54.570 INFO:journalctl@ceph.osd.1.smithi086.stdout:Sep 16 05:37:54 smithi086 systemd[1]: /etc/systemd/system/ceph-a6097908-73ec-11ef-bceb-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-16T05:37:54.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:37:54 smithi086 systemd[1]: /etc/systemd/system/ceph-a6097908-73ec-11ef-bceb-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-16T05:37:54.571 INFO:journalctl@ceph.mgr.b.smithi086.stdout:Sep 16 05:37:54 smithi086 systemd[1]: /etc/systemd/system/ceph-a6097908-73ec-11ef-bceb-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-16T05:37:55.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:37:55 smithi157 bash[24585]: cluster 2024-09-16T05:37:54.310659+0000 mgr.a (mgr.14373) 28 : cluster [DBG] pgmap v19: 129 pgs: 129 active+clean; 582 KiB data, 94 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 2.8 KiB/s wr, 11 op/s 2024-09-16T05:37:55.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:37:55 smithi157 bash[24585]: audit 2024-09-16T05:37:54.479913+0000 mon.a (mon.0) 526 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T05:37:55.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:37:55 smithi157 bash[24585]: audit 2024-09-16T05:37:54.489258+0000 mon.a (mon.0) 527 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T05:37:55.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:37:55 smithi157 bash[24585]: audit 2024-09-16T05:37:54.496623+0000 mon.b (mon.2) 41 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.myrealm1.myzone1.smithi157.lplzmt", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-09-16T05:37:55.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:37:55 smithi157 bash[24585]: audit 2024-09-16T05:37:54.498168+0000 mon.a (mon.0) 528 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T05:37:55.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:37:55 smithi157 bash[24585]: audit 2024-09-16T05:37:54.500457+0000 mon.a (mon.0) 529 : audit [INF] from='mgr.14373 ' entity='mgr.a' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.myrealm1.myzone1.smithi157.lplzmt", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-09-16T05:37:55.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:37:55 smithi157 bash[24585]: audit 2024-09-16T05:37:54.503437+0000 mon.a (mon.0) 530 : audit [INF] from='mgr.14373 ' entity='mgr.a' cmd='[{"prefix": "auth get-or-create", "entity": "client.rgw.myrealm1.myzone1.smithi157.lplzmt", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]': finished 2024-09-16T05:37:55.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:37:55 smithi157 bash[24585]: audit 2024-09-16T05:37:54.514792+0000 mon.a (mon.0) 531 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T05:37:55.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:37:55 smithi157 bash[24585]: audit 2024-09-16T05:37:54.515498+0000 mon.b (mon.2) 42 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T05:37:55.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:37:55 smithi157 bash[24585]: cephadm 2024-09-16T05:37:54.520595+0000 mgr.a (mgr.14373) 29 : cephadm [INF] Deploying daemon rgw.myrealm1.myzone1.smithi157.lplzmt on smithi157 2024-09-16T05:37:55.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:37:55 smithi086 bash[24289]: cluster 2024-09-16T05:37:54.310659+0000 mgr.a (mgr.14373) 28 : cluster [DBG] pgmap v19: 129 pgs: 129 active+clean; 582 KiB data, 94 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 2.8 KiB/s wr, 11 op/s 2024-09-16T05:37:55.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:37:55 smithi086 bash[24289]: audit 2024-09-16T05:37:54.479913+0000 mon.a (mon.0) 526 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T05:37:55.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:37:55 smithi086 bash[24289]: audit 2024-09-16T05:37:54.489258+0000 mon.a (mon.0) 527 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T05:37:55.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:37:55 smithi086 bash[24289]: audit 2024-09-16T05:37:54.496623+0000 mon.b (mon.2) 41 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.myrealm1.myzone1.smithi157.lplzmt", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-09-16T05:37:55.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:37:55 smithi086 bash[24289]: audit 2024-09-16T05:37:54.498168+0000 mon.a (mon.0) 528 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T05:37:55.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:37:55 smithi086 bash[24289]: audit 2024-09-16T05:37:54.500457+0000 mon.a (mon.0) 529 : audit [INF] from='mgr.14373 ' entity='mgr.a' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.myrealm1.myzone1.smithi157.lplzmt", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-09-16T05:37:55.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:37:55 smithi086 bash[24289]: audit 2024-09-16T05:37:54.503437+0000 mon.a (mon.0) 530 : audit [INF] from='mgr.14373 ' entity='mgr.a' cmd='[{"prefix": "auth get-or-create", "entity": "client.rgw.myrealm1.myzone1.smithi157.lplzmt", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]': finished 2024-09-16T05:37:55.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:37:55 smithi086 bash[24289]: audit 2024-09-16T05:37:54.514792+0000 mon.a (mon.0) 531 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T05:37:55.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:37:55 smithi086 bash[24289]: audit 2024-09-16T05:37:54.515498+0000 mon.b (mon.2) 42 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T05:37:55.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:37:55 smithi086 bash[24289]: cephadm 2024-09-16T05:37:54.520595+0000 mgr.a (mgr.14373) 29 : cephadm [INF] Deploying daemon rgw.myrealm1.myzone1.smithi157.lplzmt on smithi157 2024-09-16T05:37:55.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:37:55 smithi047 bash[22744]: cluster 2024-09-16T05:37:54.310659+0000 mgr.a (mgr.14373) 28 : cluster [DBG] pgmap v19: 129 pgs: 129 active+clean; 582 KiB data, 94 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 2.8 KiB/s wr, 11 op/s 2024-09-16T05:37:55.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:37:55 smithi047 bash[22744]: audit 2024-09-16T05:37:54.479913+0000 mon.a (mon.0) 526 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T05:37:55.840 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:37:55 smithi047 bash[22744]: audit 2024-09-16T05:37:54.489258+0000 mon.a (mon.0) 527 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T05:37:55.840 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:37:55 smithi047 bash[22744]: audit 2024-09-16T05:37:54.496623+0000 mon.b (mon.2) 41 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.myrealm1.myzone1.smithi157.lplzmt", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-09-16T05:37:55.840 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:37:55 smithi047 bash[22744]: audit 2024-09-16T05:37:54.498168+0000 mon.a (mon.0) 528 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T05:37:55.840 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:37:55 smithi047 bash[22744]: audit 2024-09-16T05:37:54.500457+0000 mon.a (mon.0) 529 : audit [INF] from='mgr.14373 ' entity='mgr.a' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.myrealm1.myzone1.smithi157.lplzmt", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-09-16T05:37:55.840 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:37:55 smithi047 bash[22744]: audit 2024-09-16T05:37:54.503437+0000 mon.a (mon.0) 530 : audit [INF] from='mgr.14373 ' entity='mgr.a' cmd='[{"prefix": "auth get-or-create", "entity": "client.rgw.myrealm1.myzone1.smithi157.lplzmt", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]': finished 2024-09-16T05:37:55.840 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:37:55 smithi047 bash[22744]: audit 2024-09-16T05:37:54.514792+0000 mon.a (mon.0) 531 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T05:37:55.840 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:37:55 smithi047 bash[22744]: audit 2024-09-16T05:37:54.515498+0000 mon.b (mon.2) 42 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T05:37:55.840 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:37:55 smithi047 bash[22744]: cephadm 2024-09-16T05:37:54.520595+0000 mgr.a (mgr.14373) 29 : cephadm [INF] Deploying daemon rgw.myrealm1.myzone1.smithi157.lplzmt on smithi157 2024-09-16T05:37:57.152 INFO:teuthology.orchestra.run.smithi047.stderr:Inferring config /var/lib/ceph/a6097908-73ec-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T05:37:57.298 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:37:57 smithi157 systemd[1]: /etc/systemd/system/ceph-a6097908-73ec-11ef-bceb-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-16T05:37:57.298 INFO:journalctl@ceph.osd.2.smithi157.stdout:Sep 16 05:37:57 smithi157 systemd[1]: /etc/systemd/system/ceph-a6097908-73ec-11ef-bceb-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-16T05:37:57.553 INFO:journalctl@ceph.osd.2.smithi157.stdout:Sep 16 05:37:57 smithi157 systemd[1]: /etc/systemd/system/ceph-a6097908-73ec-11ef-bceb-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-16T05:37:57.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:37:57 smithi157 systemd[1]: /etc/systemd/system/ceph-a6097908-73ec-11ef-bceb-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-16T05:37:57.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:37:57 smithi157 bash[24585]: cluster 2024-09-16T05:37:56.311613+0000 mgr.a (mgr.14373) 30 : cluster [DBG] pgmap v20: 129 pgs: 129 active+clean; 582 KiB data, 94 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 2.8 KiB/s wr, 11 op/s 2024-09-16T05:37:57.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:37:57 smithi157 bash[24585]: cluster 2024-09-16T05:37:56.493644+0000 mon.a (mon.0) 532 : cluster [DBG] osdmap e33: 3 total, 3 up, 3 in 2024-09-16T05:37:57.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:37:57 smithi157 bash[24585]: audit 2024-09-16T05:37:56.494732+0000 mon.b (mon.2) 43 : audit [INF] from='client.? 172.21.15.86:0/1725149525' entity='client.rgw.myrealm1.myzone1.smithi086.jwevgv' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]: dispatch 2024-09-16T05:37:57.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:37:57 smithi157 bash[24585]: audit 2024-09-16T05:37:56.498948+0000 mon.a (mon.0) 533 : audit [INF] from='client.? ' entity='client.rgw.myrealm1.myzone1.smithi086.jwevgv' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]: dispatch 2024-09-16T05:37:57.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:37:57 smithi157 bash[24585]: audit 2024-09-16T05:37:57.448330+0000 mon.a (mon.0) 534 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T05:37:57.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:37:57 smithi157 bash[24585]: audit 2024-09-16T05:37:57.459355+0000 mon.a (mon.0) 535 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T05:37:57.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:37:57 smithi157 bash[24585]: audit 2024-09-16T05:37:57.470213+0000 mon.a (mon.0) 536 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T05:37:57.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:37:57 smithi157 bash[24585]: audit 2024-09-16T05:37:57.470530+0000 mon.b (mon.2) 44 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T05:37:57.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:37:57 smithi086 bash[24289]: cluster 2024-09-16T05:37:56.311613+0000 mgr.a (mgr.14373) 30 : cluster [DBG] pgmap v20: 129 pgs: 129 active+clean; 582 KiB data, 94 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 2.8 KiB/s wr, 11 op/s 2024-09-16T05:37:57.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:37:57 smithi086 bash[24289]: cluster 2024-09-16T05:37:56.493644+0000 mon.a (mon.0) 532 : cluster [DBG] osdmap e33: 3 total, 3 up, 3 in 2024-09-16T05:37:57.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:37:57 smithi086 bash[24289]: audit 2024-09-16T05:37:56.494732+0000 mon.b (mon.2) 43 : audit [INF] from='client.? 172.21.15.86:0/1725149525' entity='client.rgw.myrealm1.myzone1.smithi086.jwevgv' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]: dispatch 2024-09-16T05:37:57.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:37:57 smithi086 bash[24289]: audit 2024-09-16T05:37:56.498948+0000 mon.a (mon.0) 533 : audit [INF] from='client.? ' entity='client.rgw.myrealm1.myzone1.smithi086.jwevgv' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]: dispatch 2024-09-16T05:37:57.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:37:57 smithi086 bash[24289]: audit 2024-09-16T05:37:57.448330+0000 mon.a (mon.0) 534 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T05:37:57.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:37:57 smithi086 bash[24289]: audit 2024-09-16T05:37:57.459355+0000 mon.a (mon.0) 535 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T05:37:57.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:37:57 smithi086 bash[24289]: audit 2024-09-16T05:37:57.470213+0000 mon.a (mon.0) 536 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T05:37:57.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:37:57 smithi086 bash[24289]: audit 2024-09-16T05:37:57.470530+0000 mon.b (mon.2) 44 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T05:37:57.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:37:57 smithi047 bash[22744]: cluster 2024-09-16T05:37:56.311613+0000 mgr.a (mgr.14373) 30 : cluster [DBG] pgmap v20: 129 pgs: 129 active+clean; 582 KiB data, 94 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 2.8 KiB/s wr, 11 op/s 2024-09-16T05:37:57.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:37:57 smithi047 bash[22744]: cluster 2024-09-16T05:37:56.493644+0000 mon.a (mon.0) 532 : cluster [DBG] osdmap e33: 3 total, 3 up, 3 in 2024-09-16T05:37:57.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:37:57 smithi047 bash[22744]: audit 2024-09-16T05:37:56.494732+0000 mon.b (mon.2) 43 : audit [INF] from='client.? 172.21.15.86:0/1725149525' entity='client.rgw.myrealm1.myzone1.smithi086.jwevgv' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]: dispatch 2024-09-16T05:37:57.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:37:57 smithi047 bash[22744]: audit 2024-09-16T05:37:56.498948+0000 mon.a (mon.0) 533 : audit [INF] from='client.? ' entity='client.rgw.myrealm1.myzone1.smithi086.jwevgv' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]: dispatch 2024-09-16T05:37:57.840 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:37:57 smithi047 bash[22744]: audit 2024-09-16T05:37:57.448330+0000 mon.a (mon.0) 534 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T05:37:57.840 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:37:57 smithi047 bash[22744]: audit 2024-09-16T05:37:57.459355+0000 mon.a (mon.0) 535 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T05:37:57.840 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:37:57 smithi047 bash[22744]: audit 2024-09-16T05:37:57.470213+0000 mon.a (mon.0) 536 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T05:37:57.840 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:37:57 smithi047 bash[22744]: audit 2024-09-16T05:37:57.470530+0000 mon.b (mon.2) 44 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T05:37:58.432 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T05:37:58.432 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T05:37:58.432 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T05:37:58.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:37:58 smithi157 bash[24585]: audit 2024-09-16T05:37:57.476231+0000 mgr.a (mgr.14373) 31 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T05:37:58.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:37:58 smithi157 bash[24585]: audit 2024-09-16T05:37:57.492278+0000 mon.a (mon.0) 537 : audit [INF] from='client.? ' entity='client.rgw.myrealm1.myzone1.smithi086.jwevgv' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]': finished 2024-09-16T05:37:58.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:37:58 smithi157 bash[24585]: cluster 2024-09-16T05:37:57.498747+0000 mon.a (mon.0) 538 : cluster [DBG] osdmap e34: 3 total, 3 up, 3 in 2024-09-16T05:37:58.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:37:58 smithi086 bash[24289]: audit 2024-09-16T05:37:57.476231+0000 mgr.a (mgr.14373) 31 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T05:37:58.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:37:58 smithi086 bash[24289]: audit 2024-09-16T05:37:57.492278+0000 mon.a (mon.0) 537 : audit [INF] from='client.? ' entity='client.rgw.myrealm1.myzone1.smithi086.jwevgv' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]': finished 2024-09-16T05:37:58.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:37:58 smithi086 bash[24289]: cluster 2024-09-16T05:37:57.498747+0000 mon.a (mon.0) 538 : cluster [DBG] osdmap e34: 3 total, 3 up, 3 in 2024-09-16T05:37:58.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:37:58 smithi047 bash[22744]: audit 2024-09-16T05:37:57.476231+0000 mgr.a (mgr.14373) 31 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T05:37:58.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:37:58 smithi047 bash[22744]: audit 2024-09-16T05:37:57.492278+0000 mon.a (mon.0) 537 : audit [INF] from='client.? ' entity='client.rgw.myrealm1.myzone1.smithi086.jwevgv' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]': finished 2024-09-16T05:37:58.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:37:58 smithi047 bash[22744]: cluster 2024-09-16T05:37:57.498747+0000 mon.a (mon.0) 538 : cluster [DBG] osdmap e34: 3 total, 3 up, 3 in 2024-09-16T05:37:59.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:37:59 smithi157 bash[24585]: cluster 2024-09-16T05:37:58.312250+0000 mgr.a (mgr.14373) 32 : cluster [DBG] pgmap v23: 161 pgs: 32 unknown, 129 active+clean; 584 KiB data, 94 MiB used, 268 GiB / 268 GiB avail; 13 KiB/s rd, 4.1 KiB/s wr, 17 op/s 2024-09-16T05:37:59.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:37:59 smithi157 bash[24585]: cluster 2024-09-16T05:37:58.517003+0000 mon.a (mon.0) 539 : cluster [DBG] osdmap e35: 3 total, 3 up, 3 in 2024-09-16T05:37:59.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:37:59 smithi157 bash[24585]: audit 2024-09-16T05:37:58.517014+0000 mon.b (mon.2) 45 : audit [INF] from='client.? 172.21.15.86:0/1725149525' entity='client.rgw.myrealm1.myzone1.smithi086.jwevgv' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]: dispatch 2024-09-16T05:37:59.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:37:59 smithi157 bash[24585]: audit 2024-09-16T05:37:58.521176+0000 mon.a (mon.0) 540 : audit [INF] from='client.? ' entity='client.rgw.myrealm1.myzone1.smithi086.jwevgv' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]: dispatch 2024-09-16T05:37:59.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:37:59 smithi157 bash[24585]: audit 2024-09-16T05:37:58.758761+0000 mgr.a (mgr.14373) 33 : audit [DBG] from='client.14772 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:37:59.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:37:59 smithi086 bash[24289]: cluster 2024-09-16T05:37:58.312250+0000 mgr.a (mgr.14373) 32 : cluster [DBG] pgmap v23: 161 pgs: 32 unknown, 129 active+clean; 584 KiB data, 94 MiB used, 268 GiB / 268 GiB avail; 13 KiB/s rd, 4.1 KiB/s wr, 17 op/s 2024-09-16T05:37:59.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:37:59 smithi086 bash[24289]: cluster 2024-09-16T05:37:58.517003+0000 mon.a (mon.0) 539 : cluster [DBG] osdmap e35: 3 total, 3 up, 3 in 2024-09-16T05:37:59.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:37:59 smithi086 bash[24289]: audit 2024-09-16T05:37:58.517014+0000 mon.b (mon.2) 45 : audit [INF] from='client.? 172.21.15.86:0/1725149525' entity='client.rgw.myrealm1.myzone1.smithi086.jwevgv' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]: dispatch 2024-09-16T05:37:59.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:37:59 smithi086 bash[24289]: audit 2024-09-16T05:37:58.521176+0000 mon.a (mon.0) 540 : audit [INF] from='client.? ' entity='client.rgw.myrealm1.myzone1.smithi086.jwevgv' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]: dispatch 2024-09-16T05:37:59.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:37:59 smithi086 bash[24289]: audit 2024-09-16T05:37:58.758761+0000 mgr.a (mgr.14373) 33 : audit [DBG] from='client.14772 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:37:59.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:37:59 smithi047 bash[22744]: cluster 2024-09-16T05:37:58.312250+0000 mgr.a (mgr.14373) 32 : cluster [DBG] pgmap v23: 161 pgs: 32 unknown, 129 active+clean; 584 KiB data, 94 MiB used, 268 GiB / 268 GiB avail; 13 KiB/s rd, 4.1 KiB/s wr, 17 op/s 2024-09-16T05:37:59.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:37:59 smithi047 bash[22744]: cluster 2024-09-16T05:37:58.517003+0000 mon.a (mon.0) 539 : cluster [DBG] osdmap e35: 3 total, 3 up, 3 in 2024-09-16T05:37:59.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:37:59 smithi047 bash[22744]: audit 2024-09-16T05:37:58.517014+0000 mon.b (mon.2) 45 : audit [INF] from='client.? 172.21.15.86:0/1725149525' entity='client.rgw.myrealm1.myzone1.smithi086.jwevgv' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]: dispatch 2024-09-16T05:37:59.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:37:59 smithi047 bash[22744]: audit 2024-09-16T05:37:58.521176+0000 mon.a (mon.0) 540 : audit [INF] from='client.? ' entity='client.rgw.myrealm1.myzone1.smithi086.jwevgv' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]: dispatch 2024-09-16T05:37:59.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:37:59 smithi047 bash[22744]: audit 2024-09-16T05:37:58.758761+0000 mgr.a (mgr.14373) 33 : audit [DBG] from='client.14772 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:38:00.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:38:00 smithi086 bash[24289]: audit 2024-09-16T05:37:59.513725+0000 mon.a (mon.0) 541 : audit [INF] from='client.? ' entity='client.rgw.myrealm1.myzone1.smithi086.jwevgv' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]': finished 2024-09-16T05:38:00.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:38:00 smithi086 bash[24289]: cluster 2024-09-16T05:37:59.519597+0000 mon.a (mon.0) 542 : cluster [DBG] osdmap e36: 3 total, 3 up, 3 in 2024-09-16T05:38:00.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:38:00 smithi047 bash[22744]: audit 2024-09-16T05:37:59.513725+0000 mon.a (mon.0) 541 : audit [INF] from='client.? ' entity='client.rgw.myrealm1.myzone1.smithi086.jwevgv' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]': finished 2024-09-16T05:38:00.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:38:00 smithi047 bash[22744]: cluster 2024-09-16T05:37:59.519597+0000 mon.a (mon.0) 542 : cluster [DBG] osdmap e36: 3 total, 3 up, 3 in 2024-09-16T05:38:01.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:38:00 smithi157 bash[24585]: audit 2024-09-16T05:37:59.513725+0000 mon.a (mon.0) 541 : audit [INF] from='client.? ' entity='client.rgw.myrealm1.myzone1.smithi086.jwevgv' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]': finished 2024-09-16T05:38:01.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:38:00 smithi157 bash[24585]: cluster 2024-09-16T05:37:59.519597+0000 mon.a (mon.0) 542 : cluster [DBG] osdmap e36: 3 total, 3 up, 3 in 2024-09-16T05:38:02.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:38:01 smithi157 bash[24585]: cluster 2024-09-16T05:38:00.312971+0000 mgr.a (mgr.14373) 34 : cluster [DBG] pgmap v26: 193 pgs: 64 unknown, 129 active+clean; 584 KiB data, 94 MiB used, 268 GiB / 268 GiB avail; 11 KiB/s rd, 2.5 KiB/s wr, 12 op/s 2024-09-16T05:38:02.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:38:01 smithi157 bash[24585]: cluster 2024-09-16T05:38:00.582652+0000 mon.a (mon.0) 543 : cluster [DBG] osdmap e37: 3 total, 3 up, 3 in 2024-09-16T05:38:02.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:38:01 smithi157 bash[24585]: audit 2024-09-16T05:38:00.584853+0000 mon.c (mon.1) 10 : audit [INF] from='client.? 172.21.15.157:0/2851797193' entity='client.rgw.myrealm1.myzone1.smithi157.lplzmt' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]: dispatch 2024-09-16T05:38:02.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:38:01 smithi157 bash[24585]: audit 2024-09-16T05:38:00.584929+0000 mon.a (mon.0) 544 : audit [INF] from='client.? 172.21.15.47:0/2721410560' entity='mgr.a' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]: dispatch 2024-09-16T05:38:02.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:38:01 smithi157 bash[24585]: audit 2024-09-16T05:38:00.585558+0000 mon.b (mon.2) 46 : audit [INF] from='client.? 172.21.15.86:0/1725149525' entity='client.rgw.myrealm1.myzone1.smithi086.jwevgv' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]: dispatch 2024-09-16T05:38:02.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:38:01 smithi157 bash[24585]: audit 2024-09-16T05:38:00.585987+0000 mon.a (mon.0) 545 : audit [INF] from='client.? ' entity='client.rgw.myrealm1.myzone1.smithi157.lplzmt' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]: dispatch 2024-09-16T05:38:02.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:38:01 smithi157 bash[24585]: audit 2024-09-16T05:38:00.589717+0000 mon.a (mon.0) 546 : audit [INF] from='client.? ' entity='client.rgw.myrealm1.myzone1.smithi086.jwevgv' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]: dispatch 2024-09-16T05:38:02.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:38:01 smithi086 bash[24289]: cluster 2024-09-16T05:38:00.312971+0000 mgr.a (mgr.14373) 34 : cluster [DBG] pgmap v26: 193 pgs: 64 unknown, 129 active+clean; 584 KiB data, 94 MiB used, 268 GiB / 268 GiB avail; 11 KiB/s rd, 2.5 KiB/s wr, 12 op/s 2024-09-16T05:38:02.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:38:01 smithi086 bash[24289]: cluster 2024-09-16T05:38:00.582652+0000 mon.a (mon.0) 543 : cluster [DBG] osdmap e37: 3 total, 3 up, 3 in 2024-09-16T05:38:02.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:38:01 smithi086 bash[24289]: audit 2024-09-16T05:38:00.584853+0000 mon.c (mon.1) 10 : audit [INF] from='client.? 172.21.15.157:0/2851797193' entity='client.rgw.myrealm1.myzone1.smithi157.lplzmt' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]: dispatch 2024-09-16T05:38:02.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:38:01 smithi086 bash[24289]: audit 2024-09-16T05:38:00.584929+0000 mon.a (mon.0) 544 : audit [INF] from='client.? 172.21.15.47:0/2721410560' entity='mgr.a' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]: dispatch 2024-09-16T05:38:02.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:38:01 smithi086 bash[24289]: audit 2024-09-16T05:38:00.585558+0000 mon.b (mon.2) 46 : audit [INF] from='client.? 172.21.15.86:0/1725149525' entity='client.rgw.myrealm1.myzone1.smithi086.jwevgv' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]: dispatch 2024-09-16T05:38:02.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:38:01 smithi086 bash[24289]: audit 2024-09-16T05:38:00.585987+0000 mon.a (mon.0) 545 : audit [INF] from='client.? ' entity='client.rgw.myrealm1.myzone1.smithi157.lplzmt' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]: dispatch 2024-09-16T05:38:02.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:38:01 smithi086 bash[24289]: audit 2024-09-16T05:38:00.589717+0000 mon.a (mon.0) 546 : audit [INF] from='client.? ' entity='client.rgw.myrealm1.myzone1.smithi086.jwevgv' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]: dispatch 2024-09-16T05:38:02.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:38:01 smithi047 bash[22744]: cluster 2024-09-16T05:38:00.312971+0000 mgr.a (mgr.14373) 34 : cluster [DBG] pgmap v26: 193 pgs: 64 unknown, 129 active+clean; 584 KiB data, 94 MiB used, 268 GiB / 268 GiB avail; 11 KiB/s rd, 2.5 KiB/s wr, 12 op/s 2024-09-16T05:38:02.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:38:01 smithi047 bash[22744]: cluster 2024-09-16T05:38:00.582652+0000 mon.a (mon.0) 543 : cluster [DBG] osdmap e37: 3 total, 3 up, 3 in 2024-09-16T05:38:02.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:38:01 smithi047 bash[22744]: audit 2024-09-16T05:38:00.584853+0000 mon.c (mon.1) 10 : audit [INF] from='client.? 172.21.15.157:0/2851797193' entity='client.rgw.myrealm1.myzone1.smithi157.lplzmt' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]: dispatch 2024-09-16T05:38:02.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:38:01 smithi047 bash[22744]: audit 2024-09-16T05:38:00.584929+0000 mon.a (mon.0) 544 : audit [INF] from='client.? 172.21.15.47:0/2721410560' entity='mgr.a' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]: dispatch 2024-09-16T05:38:02.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:38:01 smithi047 bash[22744]: audit 2024-09-16T05:38:00.585558+0000 mon.b (mon.2) 46 : audit [INF] from='client.? 172.21.15.86:0/1725149525' entity='client.rgw.myrealm1.myzone1.smithi086.jwevgv' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]: dispatch 2024-09-16T05:38:02.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:38:01 smithi047 bash[22744]: audit 2024-09-16T05:38:00.585987+0000 mon.a (mon.0) 545 : audit [INF] from='client.? ' entity='client.rgw.myrealm1.myzone1.smithi157.lplzmt' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]: dispatch 2024-09-16T05:38:02.090 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:38:01 smithi047 bash[22744]: audit 2024-09-16T05:38:00.589717+0000 mon.a (mon.0) 546 : audit [INF] from='client.? ' entity='client.rgw.myrealm1.myzone1.smithi086.jwevgv' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]: dispatch 2024-09-16T05:38:03.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:38:02 smithi157 bash[24585]: audit 2024-09-16T05:38:01.579398+0000 mon.a (mon.0) 547 : audit [INF] from='client.? 172.21.15.47:0/2721410560' entity='mgr.a' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]': finished 2024-09-16T05:38:03.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:38:02 smithi157 bash[24585]: audit 2024-09-16T05:38:01.579510+0000 mon.a (mon.0) 548 : audit [INF] from='client.? ' entity='client.rgw.myrealm1.myzone1.smithi157.lplzmt' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]': finished 2024-09-16T05:38:03.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:38:02 smithi157 bash[24585]: audit 2024-09-16T05:38:01.579607+0000 mon.a (mon.0) 549 : audit [INF] from='client.? ' entity='client.rgw.myrealm1.myzone1.smithi086.jwevgv' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]': finished 2024-09-16T05:38:03.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:38:02 smithi157 bash[24585]: audit 2024-09-16T05:38:01.584927+0000 mon.b (mon.2) 47 : audit [INF] from='client.? 172.21.15.86:0/1725149525' entity='client.rgw.myrealm1.myzone1.smithi086.jwevgv' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2024-09-16T05:38:03.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:38:02 smithi157 bash[24585]: cluster 2024-09-16T05:38:01.586645+0000 mon.a (mon.0) 550 : cluster [DBG] osdmap e38: 3 total, 3 up, 3 in 2024-09-16T05:38:03.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:38:02 smithi157 bash[24585]: audit 2024-09-16T05:38:01.589632+0000 mon.a (mon.0) 551 : audit [INF] from='client.? ' entity='client.rgw.myrealm1.myzone1.smithi086.jwevgv' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2024-09-16T05:38:03.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:38:02 smithi157 bash[24585]: audit 2024-09-16T05:38:01.590236+0000 mon.c (mon.1) 11 : audit [INF] from='client.? 172.21.15.157:0/2851797193' entity='client.rgw.myrealm1.myzone1.smithi157.lplzmt' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2024-09-16T05:38:03.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:38:02 smithi157 bash[24585]: audit 2024-09-16T05:38:01.591557+0000 mon.a (mon.0) 552 : audit [INF] from='client.? 172.21.15.47:0/2721410560' entity='mgr.a' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2024-09-16T05:38:03.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:38:02 smithi157 bash[24585]: audit 2024-09-16T05:38:01.602702+0000 mon.a (mon.0) 553 : audit [INF] from='client.? ' entity='client.rgw.myrealm1.myzone1.smithi157.lplzmt' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2024-09-16T05:38:03.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:38:02 smithi157 bash[24585]: audit 2024-09-16T05:38:02.582099+0000 mon.a (mon.0) 554 : audit [INF] from='client.? ' entity='client.rgw.myrealm1.myzone1.smithi086.jwevgv' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]': finished 2024-09-16T05:38:03.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:38:02 smithi157 bash[24585]: audit 2024-09-16T05:38:02.582282+0000 mon.a (mon.0) 555 : audit [INF] from='client.? 172.21.15.47:0/2721410560' entity='mgr.a' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]': finished 2024-09-16T05:38:03.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:38:02 smithi157 bash[24585]: audit 2024-09-16T05:38:02.582415+0000 mon.a (mon.0) 556 : audit [INF] from='client.? ' entity='client.rgw.myrealm1.myzone1.smithi157.lplzmt' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]': finished 2024-09-16T05:38:03.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:38:02 smithi157 bash[24585]: cluster 2024-09-16T05:38:02.588007+0000 mon.a (mon.0) 557 : cluster [DBG] osdmap e39: 3 total, 3 up, 3 in 2024-09-16T05:38:03.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:38:02 smithi086 bash[24289]: audit 2024-09-16T05:38:01.579398+0000 mon.a (mon.0) 547 : audit [INF] from='client.? 172.21.15.47:0/2721410560' entity='mgr.a' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]': finished 2024-09-16T05:38:03.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:38:02 smithi086 bash[24289]: audit 2024-09-16T05:38:01.579510+0000 mon.a (mon.0) 548 : audit [INF] from='client.? ' entity='client.rgw.myrealm1.myzone1.smithi157.lplzmt' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]': finished 2024-09-16T05:38:03.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:38:02 smithi086 bash[24289]: audit 2024-09-16T05:38:01.579607+0000 mon.a (mon.0) 549 : audit [INF] from='client.? ' entity='client.rgw.myrealm1.myzone1.smithi086.jwevgv' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]': finished 2024-09-16T05:38:03.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:38:02 smithi086 bash[24289]: audit 2024-09-16T05:38:01.584927+0000 mon.b (mon.2) 47 : audit [INF] from='client.? 172.21.15.86:0/1725149525' entity='client.rgw.myrealm1.myzone1.smithi086.jwevgv' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2024-09-16T05:38:03.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:38:02 smithi086 bash[24289]: cluster 2024-09-16T05:38:01.586645+0000 mon.a (mon.0) 550 : cluster [DBG] osdmap e38: 3 total, 3 up, 3 in 2024-09-16T05:38:03.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:38:02 smithi086 bash[24289]: audit 2024-09-16T05:38:01.589632+0000 mon.a (mon.0) 551 : audit [INF] from='client.? ' entity='client.rgw.myrealm1.myzone1.smithi086.jwevgv' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2024-09-16T05:38:03.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:38:02 smithi086 bash[24289]: audit 2024-09-16T05:38:01.590236+0000 mon.c (mon.1) 11 : audit [INF] from='client.? 172.21.15.157:0/2851797193' entity='client.rgw.myrealm1.myzone1.smithi157.lplzmt' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2024-09-16T05:38:03.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:38:02 smithi086 bash[24289]: audit 2024-09-16T05:38:01.591557+0000 mon.a (mon.0) 552 : audit [INF] from='client.? 172.21.15.47:0/2721410560' entity='mgr.a' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2024-09-16T05:38:03.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:38:02 smithi086 bash[24289]: audit 2024-09-16T05:38:01.602702+0000 mon.a (mon.0) 553 : audit [INF] from='client.? ' entity='client.rgw.myrealm1.myzone1.smithi157.lplzmt' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2024-09-16T05:38:03.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:38:02 smithi086 bash[24289]: audit 2024-09-16T05:38:02.582099+0000 mon.a (mon.0) 554 : audit [INF] from='client.? ' entity='client.rgw.myrealm1.myzone1.smithi086.jwevgv' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]': finished 2024-09-16T05:38:03.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:38:02 smithi086 bash[24289]: audit 2024-09-16T05:38:02.582282+0000 mon.a (mon.0) 555 : audit [INF] from='client.? 172.21.15.47:0/2721410560' entity='mgr.a' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]': finished 2024-09-16T05:38:03.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:38:02 smithi086 bash[24289]: audit 2024-09-16T05:38:02.582415+0000 mon.a (mon.0) 556 : audit [INF] from='client.? ' entity='client.rgw.myrealm1.myzone1.smithi157.lplzmt' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]': finished 2024-09-16T05:38:03.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:38:02 smithi086 bash[24289]: cluster 2024-09-16T05:38:02.588007+0000 mon.a (mon.0) 557 : cluster [DBG] osdmap e39: 3 total, 3 up, 3 in 2024-09-16T05:38:03.089 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 05:38:02 smithi047 bash[22994]: debug 2024-09-16T05:38:02.678+0000 7fa3ba9d2640 -1 mgr.server reply reply (152) Unknown error 152 2024-09-16T05:38:03.089 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 05:38:02 smithi047 bash[22994]: debug 2024-09-16T05:38:02.694+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: 2024-09-16T05:38:03.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:38:02 smithi047 bash[22744]: audit 2024-09-16T05:38:01.579398+0000 mon.a (mon.0) 547 : audit [INF] from='client.? 172.21.15.47:0/2721410560' entity='mgr.a' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]': finished 2024-09-16T05:38:03.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:38:02 smithi047 bash[22744]: audit 2024-09-16T05:38:01.579510+0000 mon.a (mon.0) 548 : audit [INF] from='client.? ' entity='client.rgw.myrealm1.myzone1.smithi157.lplzmt' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]': finished 2024-09-16T05:38:03.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:38:02 smithi047 bash[22744]: audit 2024-09-16T05:38:01.579607+0000 mon.a (mon.0) 549 : audit [INF] from='client.? ' entity='client.rgw.myrealm1.myzone1.smithi086.jwevgv' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]': finished 2024-09-16T05:38:03.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:38:02 smithi047 bash[22744]: audit 2024-09-16T05:38:01.584927+0000 mon.b (mon.2) 47 : audit [INF] from='client.? 172.21.15.86:0/1725149525' entity='client.rgw.myrealm1.myzone1.smithi086.jwevgv' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2024-09-16T05:38:03.090 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:38:02 smithi047 bash[22744]: cluster 2024-09-16T05:38:01.586645+0000 mon.a (mon.0) 550 : cluster [DBG] osdmap e38: 3 total, 3 up, 3 in 2024-09-16T05:38:03.090 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:38:02 smithi047 bash[22744]: audit 2024-09-16T05:38:01.589632+0000 mon.a (mon.0) 551 : audit [INF] from='client.? ' entity='client.rgw.myrealm1.myzone1.smithi086.jwevgv' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2024-09-16T05:38:03.090 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:38:02 smithi047 bash[22744]: audit 2024-09-16T05:38:01.590236+0000 mon.c (mon.1) 11 : audit [INF] from='client.? 172.21.15.157:0/2851797193' entity='client.rgw.myrealm1.myzone1.smithi157.lplzmt' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2024-09-16T05:38:03.090 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:38:02 smithi047 bash[22744]: audit 2024-09-16T05:38:01.591557+0000 mon.a (mon.0) 552 : audit [INF] from='client.? 172.21.15.47:0/2721410560' entity='mgr.a' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2024-09-16T05:38:03.090 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:38:02 smithi047 bash[22744]: audit 2024-09-16T05:38:01.602702+0000 mon.a (mon.0) 553 : audit [INF] from='client.? ' entity='client.rgw.myrealm1.myzone1.smithi157.lplzmt' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2024-09-16T05:38:03.090 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:38:02 smithi047 bash[22744]: audit 2024-09-16T05:38:02.582099+0000 mon.a (mon.0) 554 : audit [INF] from='client.? ' entity='client.rgw.myrealm1.myzone1.smithi086.jwevgv' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]': finished 2024-09-16T05:38:03.090 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:38:02 smithi047 bash[22744]: audit 2024-09-16T05:38:02.582282+0000 mon.a (mon.0) 555 : audit [INF] from='client.? 172.21.15.47:0/2721410560' entity='mgr.a' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]': finished 2024-09-16T05:38:03.090 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:38:02 smithi047 bash[22744]: audit 2024-09-16T05:38:02.582415+0000 mon.a (mon.0) 556 : audit [INF] from='client.? ' entity='client.rgw.myrealm1.myzone1.smithi157.lplzmt' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]': finished 2024-09-16T05:38:03.090 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:38:02 smithi047 bash[22744]: cluster 2024-09-16T05:38:02.588007+0000 mon.a (mon.0) 557 : cluster [DBG] osdmap e39: 3 total, 3 up, 3 in 2024-09-16T05:38:03.210 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T05:38:03.210 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T05:38:03.210 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T05:38:03.211 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T05:38:03.211 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T05:38:04.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:38:03 smithi157 bash[24585]: cluster 2024-09-16T05:38:02.313752+0000 mgr.a (mgr.14373) 35 : cluster [DBG] pgmap v29: 225 pgs: 32 creating+peering, 193 active+clean; 585 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 18 KiB/s rd, 1.2 KiB/s wr, 20 op/s 2024-09-16T05:38:04.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:38:03 smithi157 bash[24585]: cephadm 2024-09-16T05:38:02.702330+0000 mgr.a (mgr.14373) 36 : cephadm [ERR] Error when trying to update rgw zone: 2024-09-16T05:38:04.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:38:03 smithi157 bash[24585]: cluster 2024-09-16T05:38:02.705056+0000 mgr.a (mgr.14373) 37 : cluster [DBG] pgmap v31: 225 pgs: 32 creating+peering, 193 active+clean; 585 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 23 KiB/s rd, 1.6 KiB/s wr, 25 op/s 2024-09-16T05:38:04.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:38:03 smithi157 bash[24585]: audit 2024-09-16T05:38:02.710928+0000 mon.a (mon.0) 558 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T05:38:04.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:38:03 smithi157 bash[24585]: audit 2024-09-16T05:38:02.719897+0000 mon.a (mon.0) 559 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T05:38:04.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:38:03 smithi157 bash[24585]: audit 2024-09-16T05:38:02.728084+0000 mon.a (mon.0) 560 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T05:38:04.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:38:03 smithi157 bash[24585]: cephadm 2024-09-16T05:38:02.731695+0000 mgr.a (mgr.14373) 38 : cephadm [INF] Saving service rgw.myrealm1.myzone1 spec with placement count:2 2024-09-16T05:38:04.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:38:03 smithi157 bash[24585]: audit 2024-09-16T05:38:02.736934+0000 mon.a (mon.0) 561 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T05:38:04.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:38:03 smithi157 bash[24585]: audit 2024-09-16T05:38:02.743821+0000 mon.a (mon.0) 562 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T05:38:04.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:38:03 smithi157 bash[24585]: audit 2024-09-16T05:38:02.797660+0000 mon.b (mon.2) 48 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T05:38:04.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:38:03 smithi157 bash[24585]: cluster 2024-09-16T05:38:03.605686+0000 mon.a (mon.0) 563 : cluster [WRN] Health check failed: Cannot update rgw endpoints, error: {err} (CEPHADM_RGW) 2024-09-16T05:38:04.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:38:03 smithi086 bash[24289]: cluster 2024-09-16T05:38:02.313752+0000 mgr.a (mgr.14373) 35 : cluster [DBG] pgmap v29: 225 pgs: 32 creating+peering, 193 active+clean; 585 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 18 KiB/s rd, 1.2 KiB/s wr, 20 op/s 2024-09-16T05:38:04.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:38:03 smithi086 bash[24289]: cephadm 2024-09-16T05:38:02.702330+0000 mgr.a (mgr.14373) 36 : cephadm [ERR] Error when trying to update rgw zone: 2024-09-16T05:38:04.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:38:03 smithi086 bash[24289]: cluster 2024-09-16T05:38:02.705056+0000 mgr.a (mgr.14373) 37 : cluster [DBG] pgmap v31: 225 pgs: 32 creating+peering, 193 active+clean; 585 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 23 KiB/s rd, 1.6 KiB/s wr, 25 op/s 2024-09-16T05:38:04.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:38:03 smithi086 bash[24289]: audit 2024-09-16T05:38:02.710928+0000 mon.a (mon.0) 558 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T05:38:04.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:38:03 smithi086 bash[24289]: audit 2024-09-16T05:38:02.719897+0000 mon.a (mon.0) 559 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T05:38:04.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:38:03 smithi086 bash[24289]: audit 2024-09-16T05:38:02.728084+0000 mon.a (mon.0) 560 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T05:38:04.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:38:03 smithi086 bash[24289]: cephadm 2024-09-16T05:38:02.731695+0000 mgr.a (mgr.14373) 38 : cephadm [INF] Saving service rgw.myrealm1.myzone1 spec with placement count:2 2024-09-16T05:38:04.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:38:03 smithi086 bash[24289]: audit 2024-09-16T05:38:02.736934+0000 mon.a (mon.0) 561 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T05:38:04.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:38:03 smithi086 bash[24289]: audit 2024-09-16T05:38:02.743821+0000 mon.a (mon.0) 562 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T05:38:04.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:38:03 smithi086 bash[24289]: audit 2024-09-16T05:38:02.797660+0000 mon.b (mon.2) 48 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T05:38:04.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:38:03 smithi086 bash[24289]: cluster 2024-09-16T05:38:03.605686+0000 mon.a (mon.0) 563 : cluster [WRN] Health check failed: Cannot update rgw endpoints, error: {err} (CEPHADM_RGW) 2024-09-16T05:38:04.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:38:03 smithi047 bash[22744]: cluster 2024-09-16T05:38:02.313752+0000 mgr.a (mgr.14373) 35 : cluster [DBG] pgmap v29: 225 pgs: 32 creating+peering, 193 active+clean; 585 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 18 KiB/s rd, 1.2 KiB/s wr, 20 op/s 2024-09-16T05:38:04.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:38:03 smithi047 bash[22744]: cephadm 2024-09-16T05:38:02.702330+0000 mgr.a (mgr.14373) 36 : cephadm [ERR] Error when trying to update rgw zone: 2024-09-16T05:38:04.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:38:03 smithi047 bash[22744]: cluster 2024-09-16T05:38:02.705056+0000 mgr.a (mgr.14373) 37 : cluster [DBG] pgmap v31: 225 pgs: 32 creating+peering, 193 active+clean; 585 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 23 KiB/s rd, 1.6 KiB/s wr, 25 op/s 2024-09-16T05:38:04.090 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:38:03 smithi047 bash[22744]: audit 2024-09-16T05:38:02.710928+0000 mon.a (mon.0) 558 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T05:38:04.090 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:38:03 smithi047 bash[22744]: audit 2024-09-16T05:38:02.719897+0000 mon.a (mon.0) 559 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T05:38:04.090 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:38:03 smithi047 bash[22744]: audit 2024-09-16T05:38:02.728084+0000 mon.a (mon.0) 560 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T05:38:04.090 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:38:03 smithi047 bash[22744]: cephadm 2024-09-16T05:38:02.731695+0000 mgr.a (mgr.14373) 38 : cephadm [INF] Saving service rgw.myrealm1.myzone1 spec with placement count:2 2024-09-16T05:38:04.090 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:38:03 smithi047 bash[22744]: audit 2024-09-16T05:38:02.736934+0000 mon.a (mon.0) 561 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T05:38:04.090 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:38:03 smithi047 bash[22744]: audit 2024-09-16T05:38:02.743821+0000 mon.a (mon.0) 562 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T05:38:04.090 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:38:03 smithi047 bash[22744]: audit 2024-09-16T05:38:02.797660+0000 mon.b (mon.2) 48 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T05:38:04.090 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:38:03 smithi047 bash[22744]: cluster 2024-09-16T05:38:03.605686+0000 mon.a (mon.0) 563 : cluster [WRN] Health check failed: Cannot update rgw endpoints, error: {err} (CEPHADM_RGW) 2024-09-16T05:38:06.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:38:05 smithi157 bash[24585]: cluster 2024-09-16T05:38:04.705952+0000 mgr.a (mgr.14373) 39 : cluster [DBG] pgmap v32: 225 pgs: 32 creating+peering, 193 active+clean; 585 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 16 KiB/s rd, 1.1 KiB/s wr, 18 op/s 2024-09-16T05:38:06.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:38:05 smithi157 bash[24585]: audit 2024-09-16T05:38:05.383939+0000 mon.a (mon.0) 564 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T05:38:06.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:38:05 smithi086 bash[24289]: cluster 2024-09-16T05:38:04.705952+0000 mgr.a (mgr.14373) 39 : cluster [DBG] pgmap v32: 225 pgs: 32 creating+peering, 193 active+clean; 585 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 16 KiB/s rd, 1.1 KiB/s wr, 18 op/s 2024-09-16T05:38:06.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:38:05 smithi086 bash[24289]: audit 2024-09-16T05:38:05.383939+0000 mon.a (mon.0) 564 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T05:38:06.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:38:05 smithi047 bash[22744]: cluster 2024-09-16T05:38:04.705952+0000 mgr.a (mgr.14373) 39 : cluster [DBG] pgmap v32: 225 pgs: 32 creating+peering, 193 active+clean; 585 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 16 KiB/s rd, 1.1 KiB/s wr, 18 op/s 2024-09-16T05:38:06.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:38:05 smithi047 bash[22744]: audit 2024-09-16T05:38:05.383939+0000 mon.a (mon.0) 564 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T05:38:08.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:38:07 smithi157 bash[24585]: cluster 2024-09-16T05:38:06.708113+0000 mgr.a (mgr.14373) 40 : cluster [DBG] pgmap v33: 225 pgs: 225 active+clean; 588 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 260 KiB/s rd, 6.5 KiB/s wr, 481 op/s 2024-09-16T05:38:08.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:38:07 smithi086 bash[24289]: cluster 2024-09-16T05:38:06.708113+0000 mgr.a (mgr.14373) 40 : cluster [DBG] pgmap v33: 225 pgs: 225 active+clean; 588 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 260 KiB/s rd, 6.5 KiB/s wr, 481 op/s 2024-09-16T05:38:08.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:38:07 smithi047 bash[22744]: cluster 2024-09-16T05:38:06.708113+0000 mgr.a (mgr.14373) 40 : cluster [DBG] pgmap v33: 225 pgs: 225 active+clean; 588 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 260 KiB/s rd, 6.5 KiB/s wr, 481 op/s 2024-09-16T05:38:08.212 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T05:38:08.212 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T05:38:08.213 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T05:38:08.980 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T05:38:08.980 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T05:38:08.980 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T05:38:08.980 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T05:38:08.980 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T05:38:09.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:38:09 smithi157 bash[24585]: audit 2024-09-16T05:38:08.158252+0000 mon.a (mon.0) 565 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T05:38:09.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:38:09 smithi157 bash[24585]: audit 2024-09-16T05:38:08.167732+0000 mon.a (mon.0) 566 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T05:38:09.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:38:09 smithi157 bash[24585]: audit 2024-09-16T05:38:08.177144+0000 mon.a (mon.0) 567 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T05:38:09.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:38:09 smithi157 bash[24585]: audit 2024-09-16T05:38:08.185129+0000 mon.b (mon.2) 49 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T05:38:09.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:38:09 smithi157 bash[24585]: audit 2024-09-16T05:38:08.185990+0000 mon.a (mon.0) 568 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T05:38:09.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:38:09 smithi157 bash[24585]: audit 2024-09-16T05:38:08.186920+0000 mon.b (mon.2) 50 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T05:38:09.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:38:09 smithi157 bash[24585]: cephadm 2024-09-16T05:38:08.201641+0000 mgr.a (mgr.14373) 41 : cephadm [INF] Checking dashboard <-> RGW credentials 2024-09-16T05:38:09.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:38:09 smithi157 bash[24585]: audit 2024-09-16T05:38:08.671874+0000 mon.a (mon.0) 569 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T05:38:09.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:38:09 smithi157 bash[24585]: audit 2024-09-16T05:38:08.683810+0000 mon.a (mon.0) 570 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T05:38:09.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:38:09 smithi157 bash[24585]: audit 2024-09-16T05:38:08.696032+0000 mon.a (mon.0) 571 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T05:38:09.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:38:09 smithi157 bash[24585]: audit 2024-09-16T05:38:08.705646+0000 mon.b (mon.2) 51 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T05:38:09.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:38:09 smithi086 bash[24289]: audit 2024-09-16T05:38:08.158252+0000 mon.a (mon.0) 565 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T05:38:09.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:38:09 smithi086 bash[24289]: audit 2024-09-16T05:38:08.167732+0000 mon.a (mon.0) 566 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T05:38:09.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:38:09 smithi086 bash[24289]: audit 2024-09-16T05:38:08.177144+0000 mon.a (mon.0) 567 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T05:38:09.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:38:09 smithi086 bash[24289]: audit 2024-09-16T05:38:08.185129+0000 mon.b (mon.2) 49 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T05:38:09.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:38:09 smithi086 bash[24289]: audit 2024-09-16T05:38:08.185990+0000 mon.a (mon.0) 568 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T05:38:09.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:38:09 smithi086 bash[24289]: audit 2024-09-16T05:38:08.186920+0000 mon.b (mon.2) 50 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T05:38:09.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:38:09 smithi086 bash[24289]: cephadm 2024-09-16T05:38:08.201641+0000 mgr.a (mgr.14373) 41 : cephadm [INF] Checking dashboard <-> RGW credentials 2024-09-16T05:38:09.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:38:09 smithi086 bash[24289]: audit 2024-09-16T05:38:08.671874+0000 mon.a (mon.0) 569 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T05:38:09.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:38:09 smithi086 bash[24289]: audit 2024-09-16T05:38:08.683810+0000 mon.a (mon.0) 570 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T05:38:09.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:38:09 smithi086 bash[24289]: audit 2024-09-16T05:38:08.696032+0000 mon.a (mon.0) 571 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T05:38:09.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:38:09 smithi086 bash[24289]: audit 2024-09-16T05:38:08.705646+0000 mon.b (mon.2) 51 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T05:38:09.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:38:09 smithi047 bash[22744]: audit 2024-09-16T05:38:08.158252+0000 mon.a (mon.0) 565 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T05:38:09.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:38:09 smithi047 bash[22744]: audit 2024-09-16T05:38:08.167732+0000 mon.a (mon.0) 566 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T05:38:09.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:38:09 smithi047 bash[22744]: audit 2024-09-16T05:38:08.177144+0000 mon.a (mon.0) 567 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T05:38:09.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:38:09 smithi047 bash[22744]: audit 2024-09-16T05:38:08.185129+0000 mon.b (mon.2) 49 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T05:38:09.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:38:09 smithi047 bash[22744]: audit 2024-09-16T05:38:08.185990+0000 mon.a (mon.0) 568 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T05:38:09.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:38:09 smithi047 bash[22744]: audit 2024-09-16T05:38:08.186920+0000 mon.b (mon.2) 50 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T05:38:09.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:38:09 smithi047 bash[22744]: cephadm 2024-09-16T05:38:08.201641+0000 mgr.a (mgr.14373) 41 : cephadm [INF] Checking dashboard <-> RGW credentials 2024-09-16T05:38:09.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:38:09 smithi047 bash[22744]: audit 2024-09-16T05:38:08.671874+0000 mon.a (mon.0) 569 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T05:38:09.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:38:09 smithi047 bash[22744]: audit 2024-09-16T05:38:08.683810+0000 mon.a (mon.0) 570 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T05:38:09.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:38:09 smithi047 bash[22744]: audit 2024-09-16T05:38:08.696032+0000 mon.a (mon.0) 571 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T05:38:09.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:38:09 smithi047 bash[22744]: audit 2024-09-16T05:38:08.705646+0000 mon.b (mon.2) 51 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T05:38:10.089 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 05:38:09 smithi047 bash[22994]: debug 2024-09-16T05:38:09.622+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T05:38:10.089 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 05:38:09 smithi047 bash[22994]: debug 2024-09-16T05:38:09.626+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T05:38:10.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:38:10 smithi157 bash[24585]: audit 2024-09-16T05:38:08.564120+0000 mgr.a (mgr.14373) 42 : audit [DBG] from='client.14886 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:38:10.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:38:10 smithi157 bash[24585]: cluster 2024-09-16T05:38:08.708880+0000 mgr.a (mgr.14373) 43 : cluster [DBG] pgmap v34: 225 pgs: 225 active+clean; 588 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 213 KiB/s rd, 4.9 KiB/s wr, 401 op/s 2024-09-16T05:38:10.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:38:10 smithi157 bash[24585]: audit 2024-09-16T05:38:08.710729+0000 mgr.a (mgr.14373) 44 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T05:38:10.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:38:10 smithi157 bash[24585]: audit 2024-09-16T05:38:09.697254+0000 mon.b (mon.2) 52 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T05:38:10.555 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:38:10 smithi157 bash[24585]: audit 2024-09-16T05:38:09.700894+0000 mon.b (mon.2) 53 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T05:38:10.555 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:38:10 smithi157 bash[24585]: audit 2024-09-16T05:38:09.702670+0000 mon.b (mon.2) 54 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T05:38:10.555 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:38:10 smithi157 bash[24585]: audit 2024-09-16T05:38:09.982318+0000 mon.a (mon.0) 572 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T05:38:10.555 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:38:10 smithi157 bash[24585]: audit 2024-09-16T05:38:09.984697+0000 mon.b (mon.2) 55 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T05:38:10.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:38:10 smithi086 bash[24289]: audit 2024-09-16T05:38:08.564120+0000 mgr.a (mgr.14373) 42 : audit [DBG] from='client.14886 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:38:10.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:38:10 smithi086 bash[24289]: cluster 2024-09-16T05:38:08.708880+0000 mgr.a (mgr.14373) 43 : cluster [DBG] pgmap v34: 225 pgs: 225 active+clean; 588 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 213 KiB/s rd, 4.9 KiB/s wr, 401 op/s 2024-09-16T05:38:10.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:38:10 smithi086 bash[24289]: audit 2024-09-16T05:38:08.710729+0000 mgr.a (mgr.14373) 44 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T05:38:10.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:38:10 smithi086 bash[24289]: audit 2024-09-16T05:38:09.697254+0000 mon.b (mon.2) 52 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T05:38:10.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:38:10 smithi086 bash[24289]: audit 2024-09-16T05:38:09.700894+0000 mon.b (mon.2) 53 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T05:38:10.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:38:10 smithi086 bash[24289]: audit 2024-09-16T05:38:09.702670+0000 mon.b (mon.2) 54 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T05:38:10.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:38:10 smithi086 bash[24289]: audit 2024-09-16T05:38:09.982318+0000 mon.a (mon.0) 572 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T05:38:10.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:38:10 smithi086 bash[24289]: audit 2024-09-16T05:38:09.984697+0000 mon.b (mon.2) 55 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T05:38:10.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:38:10 smithi047 bash[22744]: audit 2024-09-16T05:38:08.564120+0000 mgr.a (mgr.14373) 42 : audit [DBG] from='client.14886 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:38:10.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:38:10 smithi047 bash[22744]: cluster 2024-09-16T05:38:08.708880+0000 mgr.a (mgr.14373) 43 : cluster [DBG] pgmap v34: 225 pgs: 225 active+clean; 588 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 213 KiB/s rd, 4.9 KiB/s wr, 401 op/s 2024-09-16T05:38:10.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:38:10 smithi047 bash[22744]: audit 2024-09-16T05:38:08.710729+0000 mgr.a (mgr.14373) 44 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T05:38:10.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:38:10 smithi047 bash[22744]: audit 2024-09-16T05:38:09.697254+0000 mon.b (mon.2) 52 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T05:38:10.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:38:10 smithi047 bash[22744]: audit 2024-09-16T05:38:09.700894+0000 mon.b (mon.2) 53 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T05:38:10.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:38:10 smithi047 bash[22744]: audit 2024-09-16T05:38:09.702670+0000 mon.b (mon.2) 54 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T05:38:10.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:38:10 smithi047 bash[22744]: audit 2024-09-16T05:38:09.982318+0000 mon.a (mon.0) 572 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T05:38:10.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:38:10 smithi047 bash[22744]: audit 2024-09-16T05:38:09.984697+0000 mon.b (mon.2) 55 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T05:38:11.089 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 05:38:10 smithi047 bash[22994]: debug 2024-09-16T05:38:10.642+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T05:38:11.089 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 05:38:10 smithi047 bash[22994]: debug 2024-09-16T05:38:10.642+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T05:38:11.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:38:11 smithi157 bash[24585]: audit 2024-09-16T05:38:09.629072+0000 mgr.a (mgr.14373) 45 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T05:38:11.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:38:11 smithi157 bash[24585]: cephadm 2024-09-16T05:38:09.630695+0000 mgr.a (mgr.14373) 46 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T05:38:11.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:38:11 smithi157 bash[24585]: cluster 2024-09-16T05:38:09.631149+0000 mgr.a (mgr.14373) 47 : cluster [DBG] pgmap v35: 225 pgs: 225 active+clean; 588 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 208 KiB/s rd, 4.8 KiB/s wr, 391 op/s 2024-09-16T05:38:11.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:38:11 smithi157 bash[24585]: cephadm 2024-09-16T05:38:09.715406+0000 mgr.a (mgr.14373) 48 : cephadm [INF] Checking dashboard <-> RGW credentials 2024-09-16T05:38:11.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:38:11 smithi157 bash[24585]: audit 2024-09-16T05:38:09.989143+0000 mgr.a (mgr.14373) 49 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T05:38:11.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:38:11 smithi086 bash[24289]: audit 2024-09-16T05:38:09.629072+0000 mgr.a (mgr.14373) 45 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T05:38:11.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:38:11 smithi086 bash[24289]: cephadm 2024-09-16T05:38:09.630695+0000 mgr.a (mgr.14373) 46 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T05:38:11.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:38:11 smithi086 bash[24289]: cluster 2024-09-16T05:38:09.631149+0000 mgr.a (mgr.14373) 47 : cluster [DBG] pgmap v35: 225 pgs: 225 active+clean; 588 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 208 KiB/s rd, 4.8 KiB/s wr, 391 op/s 2024-09-16T05:38:11.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:38:11 smithi086 bash[24289]: cephadm 2024-09-16T05:38:09.715406+0000 mgr.a (mgr.14373) 48 : cephadm [INF] Checking dashboard <-> RGW credentials 2024-09-16T05:38:11.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:38:11 smithi086 bash[24289]: audit 2024-09-16T05:38:09.989143+0000 mgr.a (mgr.14373) 49 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T05:38:11.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:38:11 smithi047 bash[22744]: audit 2024-09-16T05:38:09.629072+0000 mgr.a (mgr.14373) 45 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T05:38:11.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:38:11 smithi047 bash[22744]: cephadm 2024-09-16T05:38:09.630695+0000 mgr.a (mgr.14373) 46 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T05:38:11.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:38:11 smithi047 bash[22744]: cluster 2024-09-16T05:38:09.631149+0000 mgr.a (mgr.14373) 47 : cluster [DBG] pgmap v35: 225 pgs: 225 active+clean; 588 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 208 KiB/s rd, 4.8 KiB/s wr, 391 op/s 2024-09-16T05:38:11.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:38:11 smithi047 bash[22744]: cephadm 2024-09-16T05:38:09.715406+0000 mgr.a (mgr.14373) 48 : cephadm [INF] Checking dashboard <-> RGW credentials 2024-09-16T05:38:11.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:38:11 smithi047 bash[22744]: audit 2024-09-16T05:38:09.989143+0000 mgr.a (mgr.14373) 49 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T05:38:12.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:38:12 smithi157 bash[24585]: audit 2024-09-16T05:38:10.647805+0000 mgr.a (mgr.14373) 50 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T05:38:12.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:38:12 smithi157 bash[24585]: cephadm 2024-09-16T05:38:10.649811+0000 mgr.a (mgr.14373) 51 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T05:38:12.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:38:12 smithi086 bash[24289]: audit 2024-09-16T05:38:10.647805+0000 mgr.a (mgr.14373) 50 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T05:38:12.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:38:12 smithi086 bash[24289]: cephadm 2024-09-16T05:38:10.649811+0000 mgr.a (mgr.14373) 51 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T05:38:12.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:38:12 smithi047 bash[22744]: audit 2024-09-16T05:38:10.647805+0000 mgr.a (mgr.14373) 50 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T05:38:12.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:38:12 smithi047 bash[22744]: cephadm 2024-09-16T05:38:10.649811+0000 mgr.a (mgr.14373) 51 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T05:38:13.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:38:13 smithi157 bash[24585]: cluster 2024-09-16T05:38:11.633326+0000 mgr.a (mgr.14373) 52 : cluster [DBG] pgmap v36: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 191 KiB/s rd, 5.2 KiB/s wr, 339 op/s 2024-09-16T05:38:13.572 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:38:13 smithi086 bash[24289]: cluster 2024-09-16T05:38:11.633326+0000 mgr.a (mgr.14373) 52 : cluster [DBG] pgmap v36: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 191 KiB/s rd, 5.2 KiB/s wr, 339 op/s 2024-09-16T05:38:13.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:38:13 smithi047 bash[22744]: cluster 2024-09-16T05:38:11.633326+0000 mgr.a (mgr.14373) 52 : cluster [DBG] pgmap v36: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 191 KiB/s rd, 5.2 KiB/s wr, 339 op/s 2024-09-16T05:38:13.985 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T05:38:13.985 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T05:38:13.985 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T05:38:14.710 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T05:38:14.711 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T05:38:14.711 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T05:38:14.711 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T05:38:14.711 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T05:38:15.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:38:15 smithi157 bash[24585]: cluster 2024-09-16T05:38:13.634141+0000 mgr.a (mgr.14373) 53 : cluster [DBG] pgmap v37: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 158 KiB/s rd, 4.3 KiB/s wr, 280 op/s 2024-09-16T05:38:15.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:38:15 smithi086 bash[24289]: cluster 2024-09-16T05:38:13.634141+0000 mgr.a (mgr.14373) 53 : cluster [DBG] pgmap v37: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 158 KiB/s rd, 4.3 KiB/s wr, 280 op/s 2024-09-16T05:38:15.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:38:15 smithi047 bash[22744]: cluster 2024-09-16T05:38:13.634141+0000 mgr.a (mgr.14373) 53 : cluster [DBG] pgmap v37: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 158 KiB/s rd, 4.3 KiB/s wr, 280 op/s 2024-09-16T05:38:16.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:38:16 smithi157 bash[24585]: audit 2024-09-16T05:38:14.308888+0000 mgr.a (mgr.14373) 54 : audit [DBG] from='client.15246 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:38:16.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:38:16 smithi157 bash[24585]: audit 2024-09-16T05:38:15.398943+0000 mon.a (mon.0) 573 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T05:38:16.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:38:16 smithi086 bash[24289]: audit 2024-09-16T05:38:14.308888+0000 mgr.a (mgr.14373) 54 : audit [DBG] from='client.15246 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:38:16.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:38:16 smithi086 bash[24289]: audit 2024-09-16T05:38:15.398943+0000 mon.a (mon.0) 573 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T05:38:16.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:38:16 smithi047 bash[22744]: audit 2024-09-16T05:38:14.308888+0000 mgr.a (mgr.14373) 54 : audit [DBG] from='client.15246 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:38:16.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:38:16 smithi047 bash[22744]: audit 2024-09-16T05:38:15.398943+0000 mon.a (mon.0) 573 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T05:38:17.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:38:17 smithi157 bash[24585]: cluster 2024-09-16T05:38:15.635060+0000 mgr.a (mgr.14373) 55 : cluster [DBG] pgmap v38: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 158 KiB/s rd, 4.3 KiB/s wr, 280 op/s 2024-09-16T05:38:17.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:38:17 smithi086 bash[24289]: cluster 2024-09-16T05:38:15.635060+0000 mgr.a (mgr.14373) 55 : cluster [DBG] pgmap v38: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 158 KiB/s rd, 4.3 KiB/s wr, 280 op/s 2024-09-16T05:38:17.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:38:17 smithi047 bash[22744]: cluster 2024-09-16T05:38:15.635060+0000 mgr.a (mgr.14373) 55 : cluster [DBG] pgmap v38: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 158 KiB/s rd, 4.3 KiB/s wr, 280 op/s 2024-09-16T05:38:19.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:38:19 smithi157 bash[24585]: cluster 2024-09-16T05:38:17.637246+0000 mgr.a (mgr.14373) 56 : cluster [DBG] pgmap v39: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 20 KiB/s rd, 1.1 KiB/s wr, 19 op/s 2024-09-16T05:38:19.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:38:19 smithi086 bash[24289]: cluster 2024-09-16T05:38:17.637246+0000 mgr.a (mgr.14373) 56 : cluster [DBG] pgmap v39: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 20 KiB/s rd, 1.1 KiB/s wr, 19 op/s 2024-09-16T05:38:19.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:38:19 smithi047 bash[22744]: cluster 2024-09-16T05:38:17.637246+0000 mgr.a (mgr.14373) 56 : cluster [DBG] pgmap v39: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 20 KiB/s rd, 1.1 KiB/s wr, 19 op/s 2024-09-16T05:38:19.712 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T05:38:19.713 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T05:38:19.713 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T05:38:20.452 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T05:38:20.453 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T05:38:20.453 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T05:38:20.453 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T05:38:20.453 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T05:38:21.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:38:21 smithi157 bash[24585]: cluster 2024-09-16T05:38:19.638040+0000 mgr.a (mgr.14373) 57 : cluster [DBG] pgmap v40: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 20 KiB/s rd, 1.1 KiB/s wr, 19 op/s 2024-09-16T05:38:21.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:38:21 smithi157 bash[24585]: audit 2024-09-16T05:38:20.043661+0000 mgr.a (mgr.14373) 58 : audit [DBG] from='client.15324 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:38:21.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:38:21 smithi086 bash[24289]: cluster 2024-09-16T05:38:19.638040+0000 mgr.a (mgr.14373) 57 : cluster [DBG] pgmap v40: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 20 KiB/s rd, 1.1 KiB/s wr, 19 op/s 2024-09-16T05:38:21.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:38:21 smithi086 bash[24289]: audit 2024-09-16T05:38:20.043661+0000 mgr.a (mgr.14373) 58 : audit [DBG] from='client.15324 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:38:21.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:38:21 smithi047 bash[22744]: cluster 2024-09-16T05:38:19.638040+0000 mgr.a (mgr.14373) 57 : cluster [DBG] pgmap v40: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 20 KiB/s rd, 1.1 KiB/s wr, 19 op/s 2024-09-16T05:38:21.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:38:21 smithi047 bash[22744]: audit 2024-09-16T05:38:20.043661+0000 mgr.a (mgr.14373) 58 : audit [DBG] from='client.15324 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:38:23.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:38:23 smithi157 bash[24585]: cluster 2024-09-16T05:38:21.640326+0000 mgr.a (mgr.14373) 59 : cluster [DBG] pgmap v41: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 19 KiB/s rd, 1023 B/s wr, 18 op/s 2024-09-16T05:38:23.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:38:23 smithi086 bash[24289]: cluster 2024-09-16T05:38:21.640326+0000 mgr.a (mgr.14373) 59 : cluster [DBG] pgmap v41: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 19 KiB/s rd, 1023 B/s wr, 18 op/s 2024-09-16T05:38:23.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:38:23 smithi047 bash[22744]: cluster 2024-09-16T05:38:21.640326+0000 mgr.a (mgr.14373) 59 : cluster [DBG] pgmap v41: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 19 KiB/s rd, 1023 B/s wr, 18 op/s 2024-09-16T05:38:25.454 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T05:38:25.455 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T05:38:25.455 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T05:38:25.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:38:25 smithi157 bash[24585]: cluster 2024-09-16T05:38:23.641171+0000 mgr.a (mgr.14373) 60 : cluster [DBG] pgmap v42: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:38:25.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:38:25 smithi086 bash[24289]: cluster 2024-09-16T05:38:23.641171+0000 mgr.a (mgr.14373) 60 : cluster [DBG] pgmap v42: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:38:25.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:38:25 smithi047 bash[22744]: cluster 2024-09-16T05:38:23.641171+0000 mgr.a (mgr.14373) 60 : cluster [DBG] pgmap v42: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:38:26.238 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T05:38:26.238 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T05:38:26.238 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T05:38:26.238 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T05:38:26.239 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T05:38:27.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:38:27 smithi157 bash[24585]: cluster 2024-09-16T05:38:25.641932+0000 mgr.a (mgr.14373) 61 : cluster [DBG] pgmap v43: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:38:27.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:38:27 smithi157 bash[24585]: audit 2024-09-16T05:38:25.804276+0000 mgr.a (mgr.14373) 62 : audit [DBG] from='client.15399 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:38:27.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:38:27 smithi086 bash[24289]: cluster 2024-09-16T05:38:25.641932+0000 mgr.a (mgr.14373) 61 : cluster [DBG] pgmap v43: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:38:27.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:38:27 smithi086 bash[24289]: audit 2024-09-16T05:38:25.804276+0000 mgr.a (mgr.14373) 62 : audit [DBG] from='client.15399 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:38:27.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:38:27 smithi047 bash[22744]: cluster 2024-09-16T05:38:25.641932+0000 mgr.a (mgr.14373) 61 : cluster [DBG] pgmap v43: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:38:27.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:38:27 smithi047 bash[22744]: audit 2024-09-16T05:38:25.804276+0000 mgr.a (mgr.14373) 62 : audit [DBG] from='client.15399 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:38:29.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:38:29 smithi157 bash[24585]: cluster 2024-09-16T05:38:27.644319+0000 mgr.a (mgr.14373) 63 : cluster [DBG] pgmap v44: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:38:29.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:38:29 smithi086 bash[24289]: cluster 2024-09-16T05:38:27.644319+0000 mgr.a (mgr.14373) 63 : cluster [DBG] pgmap v44: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:38:29.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:38:29 smithi047 bash[22744]: cluster 2024-09-16T05:38:27.644319+0000 mgr.a (mgr.14373) 63 : cluster [DBG] pgmap v44: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:38:31.240 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T05:38:31.240 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T05:38:31.241 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T05:38:31.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:38:31 smithi157 bash[24585]: cluster 2024-09-16T05:38:29.645126+0000 mgr.a (mgr.14373) 64 : cluster [DBG] pgmap v45: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:38:31.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:38:31 smithi086 bash[24289]: cluster 2024-09-16T05:38:29.645126+0000 mgr.a (mgr.14373) 64 : cluster [DBG] pgmap v45: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:38:31.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:38:31 smithi047 bash[22744]: cluster 2024-09-16T05:38:29.645126+0000 mgr.a (mgr.14373) 64 : cluster [DBG] pgmap v45: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:38:31.985 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T05:38:31.985 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T05:38:31.986 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T05:38:31.986 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T05:38:31.986 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T05:38:33.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:38:33 smithi157 bash[24585]: audit 2024-09-16T05:38:31.575882+0000 mgr.a (mgr.14373) 65 : audit [DBG] from='client.15474 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:38:33.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:38:33 smithi157 bash[24585]: cluster 2024-09-16T05:38:31.646425+0000 mgr.a (mgr.14373) 66 : cluster [DBG] pgmap v46: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:38:33.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:38:33 smithi086 bash[24289]: audit 2024-09-16T05:38:31.575882+0000 mgr.a (mgr.14373) 65 : audit [DBG] from='client.15474 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:38:33.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:38:33 smithi086 bash[24289]: cluster 2024-09-16T05:38:31.646425+0000 mgr.a (mgr.14373) 66 : cluster [DBG] pgmap v46: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:38:33.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:38:33 smithi047 bash[22744]: audit 2024-09-16T05:38:31.575882+0000 mgr.a (mgr.14373) 65 : audit [DBG] from='client.15474 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:38:33.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:38:33 smithi047 bash[22744]: cluster 2024-09-16T05:38:31.646425+0000 mgr.a (mgr.14373) 66 : cluster [DBG] pgmap v46: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:38:35.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:38:35 smithi157 bash[24585]: cluster 2024-09-16T05:38:33.647271+0000 mgr.a (mgr.14373) 67 : cluster [DBG] pgmap v47: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T05:38:35.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:38:35 smithi086 bash[24289]: cluster 2024-09-16T05:38:33.647271+0000 mgr.a (mgr.14373) 67 : cluster [DBG] pgmap v47: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T05:38:35.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:38:35 smithi047 bash[22744]: cluster 2024-09-16T05:38:33.647271+0000 mgr.a (mgr.14373) 67 : cluster [DBG] pgmap v47: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T05:38:36.987 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T05:38:36.987 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T05:38:36.987 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T05:38:37.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:38:37 smithi157 bash[24585]: cluster 2024-09-16T05:38:35.648084+0000 mgr.a (mgr.14373) 68 : cluster [DBG] pgmap v48: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T05:38:37.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:38:37 smithi086 bash[24289]: cluster 2024-09-16T05:38:35.648084+0000 mgr.a (mgr.14373) 68 : cluster [DBG] pgmap v48: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T05:38:37.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:38:37 smithi047 bash[22744]: cluster 2024-09-16T05:38:35.648084+0000 mgr.a (mgr.14373) 68 : cluster [DBG] pgmap v48: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T05:38:37.725 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T05:38:37.725 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T05:38:37.725 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T05:38:37.725 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T05:38:37.725 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T05:38:39.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:38:39 smithi157 bash[24585]: audit 2024-09-16T05:38:37.319794+0000 mgr.a (mgr.14373) 69 : audit [DBG] from='client.15552 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:38:39.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:38:39 smithi157 bash[24585]: cluster 2024-09-16T05:38:37.649367+0000 mgr.a (mgr.14373) 70 : cluster [DBG] pgmap v49: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:38:39.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:38:39 smithi086 bash[24289]: audit 2024-09-16T05:38:37.319794+0000 mgr.a (mgr.14373) 69 : audit [DBG] from='client.15552 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:38:39.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:38:39 smithi086 bash[24289]: cluster 2024-09-16T05:38:37.649367+0000 mgr.a (mgr.14373) 70 : cluster [DBG] pgmap v49: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:38:39.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:38:39 smithi047 bash[22744]: audit 2024-09-16T05:38:37.319794+0000 mgr.a (mgr.14373) 69 : audit [DBG] from='client.15552 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:38:39.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:38:39 smithi047 bash[22744]: cluster 2024-09-16T05:38:37.649367+0000 mgr.a (mgr.14373) 70 : cluster [DBG] pgmap v49: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:38:41.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:38:41 smithi157 bash[24585]: cluster 2024-09-16T05:38:39.650128+0000 mgr.a (mgr.14373) 71 : cluster [DBG] pgmap v50: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T05:38:41.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:38:41 smithi086 bash[24289]: cluster 2024-09-16T05:38:39.650128+0000 mgr.a (mgr.14373) 71 : cluster [DBG] pgmap v50: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T05:38:41.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:38:41 smithi047 bash[22744]: cluster 2024-09-16T05:38:39.650128+0000 mgr.a (mgr.14373) 71 : cluster [DBG] pgmap v50: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T05:38:42.726 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T05:38:42.727 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T05:38:42.727 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T05:38:43.493 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T05:38:43.493 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T05:38:43.494 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T05:38:43.494 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T05:38:43.494 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T05:38:43.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:38:43 smithi157 bash[24585]: cluster 2024-09-16T05:38:41.652139+0000 mgr.a (mgr.14373) 72 : cluster [DBG] pgmap v51: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:38:43.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:38:43 smithi086 bash[24289]: cluster 2024-09-16T05:38:41.652139+0000 mgr.a (mgr.14373) 72 : cluster [DBG] pgmap v51: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:38:43.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:38:43 smithi047 bash[22744]: cluster 2024-09-16T05:38:41.652139+0000 mgr.a (mgr.14373) 72 : cluster [DBG] pgmap v51: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:38:44.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:38:44 smithi157 bash[24585]: audit 2024-09-16T05:38:43.064541+0000 mgr.a (mgr.14373) 73 : audit [DBG] from='client.15630 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:38:44.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:38:44 smithi086 bash[24289]: audit 2024-09-16T05:38:43.064541+0000 mgr.a (mgr.14373) 73 : audit [DBG] from='client.15630 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:38:44.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:38:44 smithi047 bash[22744]: audit 2024-09-16T05:38:43.064541+0000 mgr.a (mgr.14373) 73 : audit [DBG] from='client.15630 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:38:45.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:38:45 smithi157 bash[24585]: cluster 2024-09-16T05:38:43.653104+0000 mgr.a (mgr.14373) 74 : cluster [DBG] pgmap v52: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:38:45.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:38:45 smithi086 bash[24289]: cluster 2024-09-16T05:38:43.653104+0000 mgr.a (mgr.14373) 74 : cluster [DBG] pgmap v52: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:38:45.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:38:45 smithi047 bash[22744]: cluster 2024-09-16T05:38:43.653104+0000 mgr.a (mgr.14373) 74 : cluster [DBG] pgmap v52: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:38:47.555 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:38:47 smithi157 bash[24585]: cluster 2024-09-16T05:38:45.653892+0000 mgr.a (mgr.14373) 75 : cluster [DBG] pgmap v53: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:38:47.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:38:47 smithi086 bash[24289]: cluster 2024-09-16T05:38:45.653892+0000 mgr.a (mgr.14373) 75 : cluster [DBG] pgmap v53: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:38:47.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:38:47 smithi047 bash[22744]: cluster 2024-09-16T05:38:45.653892+0000 mgr.a (mgr.14373) 75 : cluster [DBG] pgmap v53: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:38:48.495 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T05:38:48.495 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T05:38:48.496 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T05:38:49.232 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T05:38:49.233 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T05:38:49.233 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T05:38:49.233 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T05:38:49.233 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T05:38:49.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:38:49 smithi157 bash[24585]: cluster 2024-09-16T05:38:47.656092+0000 mgr.a (mgr.14373) 76 : cluster [DBG] pgmap v54: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:38:49.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:38:49 smithi086 bash[24289]: cluster 2024-09-16T05:38:47.656092+0000 mgr.a (mgr.14373) 76 : cluster [DBG] pgmap v54: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:38:49.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:38:49 smithi047 bash[22744]: cluster 2024-09-16T05:38:47.656092+0000 mgr.a (mgr.14373) 76 : cluster [DBG] pgmap v54: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:38:50.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:38:50 smithi157 bash[24585]: audit 2024-09-16T05:38:48.831231+0000 mgr.a (mgr.14373) 77 : audit [DBG] from='client.15708 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:38:50.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:38:50 smithi086 bash[24289]: audit 2024-09-16T05:38:48.831231+0000 mgr.a (mgr.14373) 77 : audit [DBG] from='client.15708 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:38:50.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:38:50 smithi047 bash[22744]: audit 2024-09-16T05:38:48.831231+0000 mgr.a (mgr.14373) 77 : audit [DBG] from='client.15708 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:38:51.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:38:51 smithi157 bash[24585]: cluster 2024-09-16T05:38:49.657153+0000 mgr.a (mgr.14373) 78 : cluster [DBG] pgmap v55: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:38:51.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:38:51 smithi086 bash[24289]: cluster 2024-09-16T05:38:49.657153+0000 mgr.a (mgr.14373) 78 : cluster [DBG] pgmap v55: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:38:51.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:38:51 smithi047 bash[22744]: cluster 2024-09-16T05:38:49.657153+0000 mgr.a (mgr.14373) 78 : cluster [DBG] pgmap v55: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:38:53.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:38:53 smithi157 bash[24585]: cluster 2024-09-16T05:38:51.659411+0000 mgr.a (mgr.14373) 79 : cluster [DBG] pgmap v56: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:38:53.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:38:53 smithi086 bash[24289]: cluster 2024-09-16T05:38:51.659411+0000 mgr.a (mgr.14373) 79 : cluster [DBG] pgmap v56: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:38:53.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:38:53 smithi047 bash[22744]: cluster 2024-09-16T05:38:51.659411+0000 mgr.a (mgr.14373) 79 : cluster [DBG] pgmap v56: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:38:54.234 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T05:38:54.234 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T05:38:54.235 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T05:38:54.998 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T05:38:54.998 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T05:38:54.998 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T05:38:54.998 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T05:38:54.998 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T05:38:55.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:38:55 smithi157 bash[24585]: cluster 2024-09-16T05:38:53.660342+0000 mgr.a (mgr.14373) 80 : cluster [DBG] pgmap v57: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:38:55.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:38:55 smithi086 bash[24289]: cluster 2024-09-16T05:38:53.660342+0000 mgr.a (mgr.14373) 80 : cluster [DBG] pgmap v57: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:38:55.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:38:55 smithi047 bash[22744]: cluster 2024-09-16T05:38:53.660342+0000 mgr.a (mgr.14373) 80 : cluster [DBG] pgmap v57: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:38:56.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:38:56 smithi157 bash[24585]: audit 2024-09-16T05:38:54.577730+0000 mgr.a (mgr.14373) 81 : audit [DBG] from='client.15786 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:38:56.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:38:56 smithi086 bash[24289]: audit 2024-09-16T05:38:54.577730+0000 mgr.a (mgr.14373) 81 : audit [DBG] from='client.15786 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:38:56.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:38:56 smithi047 bash[22744]: audit 2024-09-16T05:38:54.577730+0000 mgr.a (mgr.14373) 81 : audit [DBG] from='client.15786 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:38:57.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:38:57 smithi157 bash[24585]: cluster 2024-09-16T05:38:55.661277+0000 mgr.a (mgr.14373) 82 : cluster [DBG] pgmap v58: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:38:57.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:38:57 smithi086 bash[24289]: cluster 2024-09-16T05:38:55.661277+0000 mgr.a (mgr.14373) 82 : cluster [DBG] pgmap v58: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:38:57.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:38:57 smithi047 bash[22744]: cluster 2024-09-16T05:38:55.661277+0000 mgr.a (mgr.14373) 82 : cluster [DBG] pgmap v58: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:38:59.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:38:59 smithi157 bash[24585]: cluster 2024-09-16T05:38:57.663567+0000 mgr.a (mgr.14373) 83 : cluster [DBG] pgmap v59: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:38:59.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:38:59 smithi086 bash[24289]: cluster 2024-09-16T05:38:57.663567+0000 mgr.a (mgr.14373) 83 : cluster [DBG] pgmap v59: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:38:59.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:38:59 smithi047 bash[22744]: cluster 2024-09-16T05:38:57.663567+0000 mgr.a (mgr.14373) 83 : cluster [DBG] pgmap v59: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:38:59.999 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T05:39:00.000 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T05:39:00.000 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T05:39:00.741 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T05:39:00.742 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T05:39:00.742 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T05:39:00.742 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T05:39:00.742 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T05:39:01.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:39:01 smithi157 bash[24585]: cluster 2024-09-16T05:38:59.664317+0000 mgr.a (mgr.14373) 84 : cluster [DBG] pgmap v60: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:39:01.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:39:01 smithi086 bash[24289]: cluster 2024-09-16T05:38:59.664317+0000 mgr.a (mgr.14373) 84 : cluster [DBG] pgmap v60: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:39:01.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:39:01 smithi047 bash[22744]: cluster 2024-09-16T05:38:59.664317+0000 mgr.a (mgr.14373) 84 : cluster [DBG] pgmap v60: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:39:02.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:39:02 smithi157 bash[24585]: audit 2024-09-16T05:39:00.334933+0000 mgr.a (mgr.14373) 85 : audit [DBG] from='client.15864 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:39:02.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:39:02 smithi086 bash[24289]: audit 2024-09-16T05:39:00.334933+0000 mgr.a (mgr.14373) 85 : audit [DBG] from='client.15864 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:39:02.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:39:02 smithi047 bash[22744]: audit 2024-09-16T05:39:00.334933+0000 mgr.a (mgr.14373) 85 : audit [DBG] from='client.15864 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:39:03.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:39:03 smithi157 bash[24585]: cluster 2024-09-16T05:39:01.666651+0000 mgr.a (mgr.14373) 86 : cluster [DBG] pgmap v61: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:39:03.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:39:03 smithi086 bash[24289]: cluster 2024-09-16T05:39:01.666651+0000 mgr.a (mgr.14373) 86 : cluster [DBG] pgmap v61: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:39:03.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:39:03 smithi047 bash[22744]: cluster 2024-09-16T05:39:01.666651+0000 mgr.a (mgr.14373) 86 : cluster [DBG] pgmap v61: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:39:04.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:39:04 smithi157 bash[24585]: cluster 2024-09-16T05:39:03.667455+0000 mgr.a (mgr.14373) 87 : cluster [DBG] pgmap v62: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:39:04.572 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:39:04 smithi086 bash[24289]: cluster 2024-09-16T05:39:03.667455+0000 mgr.a (mgr.14373) 87 : cluster [DBG] pgmap v62: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:39:04.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:39:04 smithi047 bash[22744]: cluster 2024-09-16T05:39:03.667455+0000 mgr.a (mgr.14373) 87 : cluster [DBG] pgmap v62: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:39:05.743 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T05:39:05.743 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T05:39:05.744 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T05:39:06.508 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T05:39:06.509 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T05:39:06.509 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T05:39:06.509 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T05:39:06.509 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T05:39:07.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:39:06 smithi157 bash[24585]: cluster 2024-09-16T05:39:05.668244+0000 mgr.a (mgr.14373) 88 : cluster [DBG] pgmap v63: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:39:07.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:39:06 smithi157 bash[24585]: audit 2024-09-16T05:39:06.082813+0000 mgr.a (mgr.14373) 89 : audit [DBG] from='client.15942 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:39:07.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:39:06 smithi086 bash[24289]: cluster 2024-09-16T05:39:05.668244+0000 mgr.a (mgr.14373) 88 : cluster [DBG] pgmap v63: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:39:07.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:39:06 smithi086 bash[24289]: audit 2024-09-16T05:39:06.082813+0000 mgr.a (mgr.14373) 89 : audit [DBG] from='client.15942 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:39:07.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:39:06 smithi047 bash[22744]: cluster 2024-09-16T05:39:05.668244+0000 mgr.a (mgr.14373) 88 : cluster [DBG] pgmap v63: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:39:07.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:39:06 smithi047 bash[22744]: audit 2024-09-16T05:39:06.082813+0000 mgr.a (mgr.14373) 89 : audit [DBG] from='client.15942 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:39:09.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:39:08 smithi157 bash[24585]: cluster 2024-09-16T05:39:07.670837+0000 mgr.a (mgr.14373) 90 : cluster [DBG] pgmap v64: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-16T05:39:09.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:39:08 smithi086 bash[24289]: cluster 2024-09-16T05:39:07.670837+0000 mgr.a (mgr.14373) 90 : cluster [DBG] pgmap v64: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-16T05:39:09.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:39:08 smithi047 bash[22744]: cluster 2024-09-16T05:39:07.670837+0000 mgr.a (mgr.14373) 90 : cluster [DBG] pgmap v64: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-16T05:39:11.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:39:10 smithi157 bash[24585]: cluster 2024-09-16T05:39:09.671603+0000 mgr.a (mgr.14373) 91 : cluster [DBG] pgmap v65: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T05:39:11.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:39:10 smithi157 bash[24585]: audit 2024-09-16T05:39:10.700184+0000 mon.b (mon.2) 56 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T05:39:11.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:39:10 smithi086 bash[24289]: cluster 2024-09-16T05:39:09.671603+0000 mgr.a (mgr.14373) 91 : cluster [DBG] pgmap v65: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T05:39:11.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:39:10 smithi086 bash[24289]: audit 2024-09-16T05:39:10.700184+0000 mon.b (mon.2) 56 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T05:39:11.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:39:10 smithi047 bash[22744]: cluster 2024-09-16T05:39:09.671603+0000 mgr.a (mgr.14373) 91 : cluster [DBG] pgmap v65: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T05:39:11.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:39:10 smithi047 bash[22744]: audit 2024-09-16T05:39:10.700184+0000 mon.b (mon.2) 56 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T05:39:11.510 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T05:39:11.510 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T05:39:11.511 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T05:39:12.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:39:11 smithi157 bash[24585]: audit 2024-09-16T05:39:11.527956+0000 mon.b (mon.2) 57 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T05:39:12.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:39:11 smithi157 bash[24585]: audit 2024-09-16T05:39:11.529589+0000 mon.b (mon.2) 58 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T05:39:12.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:39:11 smithi157 bash[24585]: audit 2024-09-16T05:39:11.541057+0000 mon.a (mon.0) 574 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T05:39:12.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:39:11 smithi157 bash[24585]: audit 2024-09-16T05:39:11.544265+0000 mon.b (mon.2) 59 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T05:39:12.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:39:11 smithi086 bash[24289]: audit 2024-09-16T05:39:11.527956+0000 mon.b (mon.2) 57 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T05:39:12.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:39:11 smithi086 bash[24289]: audit 2024-09-16T05:39:11.529589+0000 mon.b (mon.2) 58 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T05:39:12.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:39:11 smithi086 bash[24289]: audit 2024-09-16T05:39:11.541057+0000 mon.a (mon.0) 574 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T05:39:12.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:39:11 smithi086 bash[24289]: audit 2024-09-16T05:39:11.544265+0000 mon.b (mon.2) 59 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T05:39:12.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:39:11 smithi047 bash[22744]: audit 2024-09-16T05:39:11.527956+0000 mon.b (mon.2) 57 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T05:39:12.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:39:11 smithi047 bash[22744]: audit 2024-09-16T05:39:11.529589+0000 mon.b (mon.2) 58 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T05:39:12.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:39:11 smithi047 bash[22744]: audit 2024-09-16T05:39:11.541057+0000 mon.a (mon.0) 574 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T05:39:12.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:39:11 smithi047 bash[22744]: audit 2024-09-16T05:39:11.544265+0000 mon.b (mon.2) 59 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T05:39:12.588 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 05:39:12 smithi047 bash[22994]: debug 2024-09-16T05:39:12.266+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T05:39:12.588 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 05:39:12 smithi047 bash[22994]: debug 2024-09-16T05:39:12.278+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T05:39:12.665 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T05:39:12.665 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T05:39:12.665 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T05:39:12.665 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T05:39:12.665 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T05:39:13.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:39:12 smithi157 bash[24585]: audit 2024-09-16T05:39:11.549686+0000 mgr.a (mgr.14373) 92 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T05:39:13.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:39:12 smithi157 bash[24585]: cluster 2024-09-16T05:39:11.673242+0000 mgr.a (mgr.14373) 93 : cluster [DBG] pgmap v66: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:39:13.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:39:12 smithi157 bash[24585]: audit 2024-09-16T05:39:11.886537+0000 mgr.a (mgr.14373) 94 : audit [DBG] from='client.16020 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:39:13.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:39:12 smithi157 bash[24585]: audit 2024-09-16T05:39:12.268993+0000 mgr.a (mgr.14373) 95 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T05:39:13.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:39:12 smithi157 bash[24585]: cephadm 2024-09-16T05:39:12.280849+0000 mgr.a (mgr.14373) 96 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T05:39:13.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:39:12 smithi086 bash[24289]: audit 2024-09-16T05:39:11.549686+0000 mgr.a (mgr.14373) 92 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T05:39:13.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:39:12 smithi086 bash[24289]: cluster 2024-09-16T05:39:11.673242+0000 mgr.a (mgr.14373) 93 : cluster [DBG] pgmap v66: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:39:13.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:39:12 smithi086 bash[24289]: audit 2024-09-16T05:39:11.886537+0000 mgr.a (mgr.14373) 94 : audit [DBG] from='client.16020 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:39:13.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:39:12 smithi086 bash[24289]: audit 2024-09-16T05:39:12.268993+0000 mgr.a (mgr.14373) 95 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T05:39:13.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:39:12 smithi086 bash[24289]: cephadm 2024-09-16T05:39:12.280849+0000 mgr.a (mgr.14373) 96 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T05:39:13.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:39:12 smithi047 bash[22744]: audit 2024-09-16T05:39:11.549686+0000 mgr.a (mgr.14373) 92 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T05:39:13.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:39:12 smithi047 bash[22744]: cluster 2024-09-16T05:39:11.673242+0000 mgr.a (mgr.14373) 93 : cluster [DBG] pgmap v66: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:39:13.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:39:12 smithi047 bash[22744]: audit 2024-09-16T05:39:11.886537+0000 mgr.a (mgr.14373) 94 : audit [DBG] from='client.16020 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:39:13.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:39:12 smithi047 bash[22744]: audit 2024-09-16T05:39:12.268993+0000 mgr.a (mgr.14373) 95 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T05:39:13.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:39:12 smithi047 bash[22744]: cephadm 2024-09-16T05:39:12.280849+0000 mgr.a (mgr.14373) 96 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T05:39:15.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:39:14 smithi157 bash[24585]: cluster 2024-09-16T05:39:13.674117+0000 mgr.a (mgr.14373) 97 : cluster [DBG] pgmap v67: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T05:39:15.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:39:14 smithi086 bash[24289]: cluster 2024-09-16T05:39:13.674117+0000 mgr.a (mgr.14373) 97 : cluster [DBG] pgmap v67: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T05:39:15.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:39:14 smithi047 bash[22744]: cluster 2024-09-16T05:39:13.674117+0000 mgr.a (mgr.14373) 97 : cluster [DBG] pgmap v67: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T05:39:17.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:39:16 smithi157 bash[24585]: cluster 2024-09-16T05:39:15.674845+0000 mgr.a (mgr.14373) 98 : cluster [DBG] pgmap v68: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T05:39:17.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:39:16 smithi086 bash[24289]: cluster 2024-09-16T05:39:15.674845+0000 mgr.a (mgr.14373) 98 : cluster [DBG] pgmap v68: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T05:39:17.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:39:16 smithi047 bash[22744]: cluster 2024-09-16T05:39:15.674845+0000 mgr.a (mgr.14373) 98 : cluster [DBG] pgmap v68: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T05:39:17.666 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T05:39:17.667 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T05:39:17.667 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T05:39:18.410 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T05:39:18.411 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T05:39:18.411 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T05:39:18.411 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T05:39:18.411 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T05:39:19.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:39:18 smithi157 bash[24585]: cluster 2024-09-16T05:39:17.677026+0000 mgr.a (mgr.14373) 99 : cluster [DBG] pgmap v69: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T05:39:19.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:39:18 smithi157 bash[24585]: audit 2024-09-16T05:39:17.998873+0000 mgr.a (mgr.14373) 100 : audit [DBG] from='client.16197 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:39:19.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:39:18 smithi086 bash[24289]: cluster 2024-09-16T05:39:17.677026+0000 mgr.a (mgr.14373) 99 : cluster [DBG] pgmap v69: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T05:39:19.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:39:18 smithi086 bash[24289]: audit 2024-09-16T05:39:17.998873+0000 mgr.a (mgr.14373) 100 : audit [DBG] from='client.16197 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:39:19.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:39:18 smithi047 bash[22744]: cluster 2024-09-16T05:39:17.677026+0000 mgr.a (mgr.14373) 99 : cluster [DBG] pgmap v69: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T05:39:19.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:39:18 smithi047 bash[22744]: audit 2024-09-16T05:39:17.998873+0000 mgr.a (mgr.14373) 100 : audit [DBG] from='client.16197 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:39:21.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:39:20 smithi157 bash[24585]: cluster 2024-09-16T05:39:19.677933+0000 mgr.a (mgr.14373) 101 : cluster [DBG] pgmap v70: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T05:39:21.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:39:20 smithi086 bash[24289]: cluster 2024-09-16T05:39:19.677933+0000 mgr.a (mgr.14373) 101 : cluster [DBG] pgmap v70: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T05:39:21.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:39:20 smithi047 bash[22744]: cluster 2024-09-16T05:39:19.677933+0000 mgr.a (mgr.14373) 101 : cluster [DBG] pgmap v70: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T05:39:23.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:39:22 smithi157 bash[24585]: cluster 2024-09-16T05:39:21.680040+0000 mgr.a (mgr.14373) 102 : cluster [DBG] pgmap v71: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T05:39:23.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:39:22 smithi086 bash[24289]: cluster 2024-09-16T05:39:21.680040+0000 mgr.a (mgr.14373) 102 : cluster [DBG] pgmap v71: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T05:39:23.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:39:22 smithi047 bash[22744]: cluster 2024-09-16T05:39:21.680040+0000 mgr.a (mgr.14373) 102 : cluster [DBG] pgmap v71: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T05:39:23.412 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T05:39:23.413 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T05:39:23.413 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T05:39:24.175 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T05:39:24.175 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T05:39:24.175 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T05:39:24.176 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T05:39:24.176 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T05:39:25.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:39:24 smithi157 bash[24585]: cluster 2024-09-16T05:39:23.680772+0000 mgr.a (mgr.14373) 103 : cluster [DBG] pgmap v72: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T05:39:25.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:39:24 smithi157 bash[24585]: audit 2024-09-16T05:39:23.757122+0000 mgr.a (mgr.14373) 104 : audit [DBG] from='client.16269 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:39:25.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:39:24 smithi086 bash[24289]: cluster 2024-09-16T05:39:23.680772+0000 mgr.a (mgr.14373) 103 : cluster [DBG] pgmap v72: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T05:39:25.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:39:24 smithi086 bash[24289]: audit 2024-09-16T05:39:23.757122+0000 mgr.a (mgr.14373) 104 : audit [DBG] from='client.16269 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:39:25.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:39:24 smithi047 bash[22744]: cluster 2024-09-16T05:39:23.680772+0000 mgr.a (mgr.14373) 103 : cluster [DBG] pgmap v72: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T05:39:25.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:39:24 smithi047 bash[22744]: audit 2024-09-16T05:39:23.757122+0000 mgr.a (mgr.14373) 104 : audit [DBG] from='client.16269 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:39:27.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:39:26 smithi157 bash[24585]: cluster 2024-09-16T05:39:25.681652+0000 mgr.a (mgr.14373) 105 : cluster [DBG] pgmap v73: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T05:39:27.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:39:26 smithi086 bash[24289]: cluster 2024-09-16T05:39:25.681652+0000 mgr.a (mgr.14373) 105 : cluster [DBG] pgmap v73: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T05:39:27.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:39:26 smithi047 bash[22744]: cluster 2024-09-16T05:39:25.681652+0000 mgr.a (mgr.14373) 105 : cluster [DBG] pgmap v73: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T05:39:29.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:39:28 smithi157 bash[24585]: cluster 2024-09-16T05:39:27.683894+0000 mgr.a (mgr.14373) 106 : cluster [DBG] pgmap v74: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T05:39:29.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:39:28 smithi086 bash[24289]: cluster 2024-09-16T05:39:27.683894+0000 mgr.a (mgr.14373) 106 : cluster [DBG] pgmap v74: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T05:39:29.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:39:28 smithi047 bash[22744]: cluster 2024-09-16T05:39:27.683894+0000 mgr.a (mgr.14373) 106 : cluster [DBG] pgmap v74: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T05:39:29.176 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T05:39:29.177 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T05:39:29.177 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T05:39:29.923 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T05:39:29.923 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T05:39:29.923 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T05:39:29.923 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T05:39:29.923 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T05:39:31.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:39:30 smithi157 bash[24585]: audit 2024-09-16T05:39:29.514395+0000 mgr.a (mgr.14373) 107 : audit [DBG] from='client.16344 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:39:31.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:39:30 smithi157 bash[24585]: cluster 2024-09-16T05:39:29.684462+0000 mgr.a (mgr.14373) 108 : cluster [DBG] pgmap v75: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:39:31.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:39:30 smithi086 bash[24289]: audit 2024-09-16T05:39:29.514395+0000 mgr.a (mgr.14373) 107 : audit [DBG] from='client.16344 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:39:31.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:39:30 smithi086 bash[24289]: cluster 2024-09-16T05:39:29.684462+0000 mgr.a (mgr.14373) 108 : cluster [DBG] pgmap v75: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:39:31.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:39:30 smithi047 bash[22744]: audit 2024-09-16T05:39:29.514395+0000 mgr.a (mgr.14373) 107 : audit [DBG] from='client.16344 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:39:31.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:39:30 smithi047 bash[22744]: cluster 2024-09-16T05:39:29.684462+0000 mgr.a (mgr.14373) 108 : cluster [DBG] pgmap v75: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:39:33.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:39:32 smithi157 bash[24585]: cluster 2024-09-16T05:39:31.686691+0000 mgr.a (mgr.14373) 109 : cluster [DBG] pgmap v76: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:39:33.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:39:32 smithi086 bash[24289]: cluster 2024-09-16T05:39:31.686691+0000 mgr.a (mgr.14373) 109 : cluster [DBG] pgmap v76: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:39:33.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:39:32 smithi047 bash[22744]: cluster 2024-09-16T05:39:31.686691+0000 mgr.a (mgr.14373) 109 : cluster [DBG] pgmap v76: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:39:34.924 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T05:39:34.925 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T05:39:34.925 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T05:39:35.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:39:34 smithi157 bash[24585]: cluster 2024-09-16T05:39:33.687584+0000 mgr.a (mgr.14373) 110 : cluster [DBG] pgmap v77: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:39:35.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:39:34 smithi086 bash[24289]: cluster 2024-09-16T05:39:33.687584+0000 mgr.a (mgr.14373) 110 : cluster [DBG] pgmap v77: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:39:35.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:39:34 smithi047 bash[22744]: cluster 2024-09-16T05:39:33.687584+0000 mgr.a (mgr.14373) 110 : cluster [DBG] pgmap v77: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:39:35.660 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T05:39:35.661 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T05:39:35.661 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T05:39:35.661 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T05:39:35.661 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T05:39:36.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:39:35 smithi157 bash[24585]: audit 2024-09-16T05:39:35.255637+0000 mgr.a (mgr.14373) 111 : audit [DBG] from='client.16422 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:39:36.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:39:35 smithi086 bash[24289]: audit 2024-09-16T05:39:35.255637+0000 mgr.a (mgr.14373) 111 : audit [DBG] from='client.16422 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:39:36.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:39:35 smithi047 bash[22744]: audit 2024-09-16T05:39:35.255637+0000 mgr.a (mgr.14373) 111 : audit [DBG] from='client.16422 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:39:37.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:39:36 smithi157 bash[24585]: cluster 2024-09-16T05:39:35.688255+0000 mgr.a (mgr.14373) 112 : cluster [DBG] pgmap v78: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:39:37.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:39:36 smithi086 bash[24289]: cluster 2024-09-16T05:39:35.688255+0000 mgr.a (mgr.14373) 112 : cluster [DBG] pgmap v78: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:39:37.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:39:36 smithi047 bash[22744]: cluster 2024-09-16T05:39:35.688255+0000 mgr.a (mgr.14373) 112 : cluster [DBG] pgmap v78: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:39:39.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:39:38 smithi157 bash[24585]: cluster 2024-09-16T05:39:37.690507+0000 mgr.a (mgr.14373) 113 : cluster [DBG] pgmap v79: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:39:39.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:39:38 smithi086 bash[24289]: cluster 2024-09-16T05:39:37.690507+0000 mgr.a (mgr.14373) 113 : cluster [DBG] pgmap v79: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:39:39.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:39:38 smithi047 bash[22744]: cluster 2024-09-16T05:39:37.690507+0000 mgr.a (mgr.14373) 113 : cluster [DBG] pgmap v79: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:39:40.662 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T05:39:40.663 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T05:39:40.663 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T05:39:41.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:39:40 smithi157 bash[24585]: cluster 2024-09-16T05:39:39.691420+0000 mgr.a (mgr.14373) 114 : cluster [DBG] pgmap v80: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:39:41.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:39:40 smithi086 bash[24289]: cluster 2024-09-16T05:39:39.691420+0000 mgr.a (mgr.14373) 114 : cluster [DBG] pgmap v80: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:39:41.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:39:40 smithi047 bash[22744]: cluster 2024-09-16T05:39:39.691420+0000 mgr.a (mgr.14373) 114 : cluster [DBG] pgmap v80: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:39:41.435 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T05:39:41.436 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T05:39:41.436 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T05:39:41.436 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T05:39:41.436 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T05:39:42.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:39:41 smithi157 bash[24585]: audit 2024-09-16T05:39:40.999710+0000 mgr.a (mgr.14373) 115 : audit [DBG] from='client.16500 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:39:42.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:39:41 smithi086 bash[24289]: audit 2024-09-16T05:39:40.999710+0000 mgr.a (mgr.14373) 115 : audit [DBG] from='client.16500 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:39:42.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:39:41 smithi047 bash[22744]: audit 2024-09-16T05:39:40.999710+0000 mgr.a (mgr.14373) 115 : audit [DBG] from='client.16500 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:39:43.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:39:42 smithi086 bash[24289]: cluster 2024-09-16T05:39:41.693815+0000 mgr.a (mgr.14373) 116 : cluster [DBG] pgmap v81: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-16T05:39:43.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:39:42 smithi047 bash[22744]: cluster 2024-09-16T05:39:41.693815+0000 mgr.a (mgr.14373) 116 : cluster [DBG] pgmap v81: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-16T05:39:43.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:39:42 smithi157 bash[24585]: cluster 2024-09-16T05:39:41.693815+0000 mgr.a (mgr.14373) 116 : cluster [DBG] pgmap v81: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-16T05:39:45.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:39:44 smithi086 bash[24289]: cluster 2024-09-16T05:39:43.694730+0000 mgr.a (mgr.14373) 117 : cluster [DBG] pgmap v82: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T05:39:45.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:39:44 smithi047 bash[22744]: cluster 2024-09-16T05:39:43.694730+0000 mgr.a (mgr.14373) 117 : cluster [DBG] pgmap v82: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T05:39:45.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:39:44 smithi157 bash[24585]: cluster 2024-09-16T05:39:43.694730+0000 mgr.a (mgr.14373) 117 : cluster [DBG] pgmap v82: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T05:39:46.437 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T05:39:46.437 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T05:39:46.438 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T05:39:47.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:39:46 smithi047 bash[22744]: cluster 2024-09-16T05:39:45.695542+0000 mgr.a (mgr.14373) 118 : cluster [DBG] pgmap v83: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T05:39:47.190 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T05:39:47.190 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T05:39:47.190 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T05:39:47.190 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T05:39:47.190 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T05:39:47.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:39:46 smithi157 bash[24585]: cluster 2024-09-16T05:39:45.695542+0000 mgr.a (mgr.14373) 118 : cluster [DBG] pgmap v83: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T05:39:47.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:39:46 smithi086 bash[24289]: cluster 2024-09-16T05:39:45.695542+0000 mgr.a (mgr.14373) 118 : cluster [DBG] pgmap v83: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T05:39:48.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:39:47 smithi047 bash[22744]: audit 2024-09-16T05:39:46.773842+0000 mgr.a (mgr.14373) 119 : audit [DBG] from='client.16578 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:39:48.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:39:47 smithi157 bash[24585]: audit 2024-09-16T05:39:46.773842+0000 mgr.a (mgr.14373) 119 : audit [DBG] from='client.16578 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:39:48.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:39:47 smithi086 bash[24289]: audit 2024-09-16T05:39:46.773842+0000 mgr.a (mgr.14373) 119 : audit [DBG] from='client.16578 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:39:49.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:39:48 smithi047 bash[22744]: cluster 2024-09-16T05:39:47.698104+0000 mgr.a (mgr.14373) 120 : cluster [DBG] pgmap v84: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:39:49.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:39:48 smithi157 bash[24585]: cluster 2024-09-16T05:39:47.698104+0000 mgr.a (mgr.14373) 120 : cluster [DBG] pgmap v84: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:39:49.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:39:48 smithi086 bash[24289]: cluster 2024-09-16T05:39:47.698104+0000 mgr.a (mgr.14373) 120 : cluster [DBG] pgmap v84: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:39:51.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:39:50 smithi047 bash[22744]: cluster 2024-09-16T05:39:49.698881+0000 mgr.a (mgr.14373) 121 : cluster [DBG] pgmap v85: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T05:39:51.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:39:50 smithi157 bash[24585]: cluster 2024-09-16T05:39:49.698881+0000 mgr.a (mgr.14373) 121 : cluster [DBG] pgmap v85: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T05:39:51.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:39:50 smithi086 bash[24289]: cluster 2024-09-16T05:39:49.698881+0000 mgr.a (mgr.14373) 121 : cluster [DBG] pgmap v85: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T05:39:52.191 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T05:39:52.192 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T05:39:52.192 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T05:39:52.960 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T05:39:52.960 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T05:39:52.960 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T05:39:52.960 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T05:39:52.960 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T05:39:53.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:39:52 smithi157 bash[24585]: cluster 2024-09-16T05:39:51.700812+0000 mgr.a (mgr.14373) 122 : cluster [DBG] pgmap v86: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:39:53.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:39:52 smithi086 bash[24289]: cluster 2024-09-16T05:39:51.700812+0000 mgr.a (mgr.14373) 122 : cluster [DBG] pgmap v86: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:39:53.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:39:52 smithi047 bash[22744]: cluster 2024-09-16T05:39:51.700812+0000 mgr.a (mgr.14373) 122 : cluster [DBG] pgmap v86: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:39:54.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:39:53 smithi157 bash[24585]: audit 2024-09-16T05:39:52.530451+0000 mgr.a (mgr.14373) 123 : audit [DBG] from='client.16656 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:39:54.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:39:53 smithi086 bash[24289]: audit 2024-09-16T05:39:52.530451+0000 mgr.a (mgr.14373) 123 : audit [DBG] from='client.16656 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:39:54.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:39:53 smithi047 bash[22744]: audit 2024-09-16T05:39:52.530451+0000 mgr.a (mgr.14373) 123 : audit [DBG] from='client.16656 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:39:55.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:39:54 smithi157 bash[24585]: cluster 2024-09-16T05:39:53.701849+0000 mgr.a (mgr.14373) 124 : cluster [DBG] pgmap v87: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-16T05:39:55.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:39:54 smithi086 bash[24289]: cluster 2024-09-16T05:39:53.701849+0000 mgr.a (mgr.14373) 124 : cluster [DBG] pgmap v87: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-16T05:39:55.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:39:54 smithi047 bash[22744]: cluster 2024-09-16T05:39:53.701849+0000 mgr.a (mgr.14373) 124 : cluster [DBG] pgmap v87: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-16T05:39:57.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:39:56 smithi157 bash[24585]: cluster 2024-09-16T05:39:55.702878+0000 mgr.a (mgr.14373) 125 : cluster [DBG] pgmap v88: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-16T05:39:57.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:39:56 smithi086 bash[24289]: cluster 2024-09-16T05:39:55.702878+0000 mgr.a (mgr.14373) 125 : cluster [DBG] pgmap v88: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-16T05:39:57.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:39:56 smithi047 bash[22744]: cluster 2024-09-16T05:39:55.702878+0000 mgr.a (mgr.14373) 125 : cluster [DBG] pgmap v88: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-16T05:39:57.961 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T05:39:57.962 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T05:39:57.962 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T05:39:58.702 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T05:39:58.702 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T05:39:58.703 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T05:39:58.703 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T05:39:58.703 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T05:39:59.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:39:58 smithi157 bash[24585]: cluster 2024-09-16T05:39:57.705174+0000 mgr.a (mgr.14373) 126 : cluster [DBG] pgmap v89: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-16T05:39:59.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:39:58 smithi157 bash[24585]: audit 2024-09-16T05:39:58.297378+0000 mgr.a (mgr.14373) 127 : audit [DBG] from='client.16731 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:39:59.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:39:58 smithi086 bash[24289]: cluster 2024-09-16T05:39:57.705174+0000 mgr.a (mgr.14373) 126 : cluster [DBG] pgmap v89: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-16T05:39:59.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:39:58 smithi086 bash[24289]: audit 2024-09-16T05:39:58.297378+0000 mgr.a (mgr.14373) 127 : audit [DBG] from='client.16731 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:39:59.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:39:58 smithi047 bash[22744]: cluster 2024-09-16T05:39:57.705174+0000 mgr.a (mgr.14373) 126 : cluster [DBG] pgmap v89: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-16T05:39:59.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:39:58 smithi047 bash[22744]: audit 2024-09-16T05:39:58.297378+0000 mgr.a (mgr.14373) 127 : audit [DBG] from='client.16731 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:40:01.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:40:00 smithi157 bash[24585]: cluster 2024-09-16T05:39:59.706124+0000 mgr.a (mgr.14373) 128 : cluster [DBG] pgmap v90: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:40:01.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:40:00 smithi157 bash[24585]: cluster 2024-09-16T05:40:00.000146+0000 mon.a (mon.0) 575 : cluster [WRN] Health detail: HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-16T05:40:01.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:40:00 smithi157 bash[24585]: cluster 2024-09-16T05:40:00.000189+0000 mon.a (mon.0) 576 : cluster [WRN] [WRN] CEPHADM_RGW: Cannot update rgw endpoints, error: {err} 2024-09-16T05:40:01.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:40:00 smithi157 bash[24585]: cluster 2024-09-16T05:40:00.000225+0000 mon.a (mon.0) 577 : cluster [WRN] Cannot update rgw endpoints for daemon rgw.myrealm1.myzone1, error: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T05:40:01.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:40:00 smithi086 bash[24289]: cluster 2024-09-16T05:39:59.706124+0000 mgr.a (mgr.14373) 128 : cluster [DBG] pgmap v90: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:40:01.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:40:00 smithi086 bash[24289]: cluster 2024-09-16T05:40:00.000146+0000 mon.a (mon.0) 575 : cluster [WRN] Health detail: HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-16T05:40:01.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:40:00 smithi086 bash[24289]: cluster 2024-09-16T05:40:00.000189+0000 mon.a (mon.0) 576 : cluster [WRN] [WRN] CEPHADM_RGW: Cannot update rgw endpoints, error: {err} 2024-09-16T05:40:01.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:40:00 smithi086 bash[24289]: cluster 2024-09-16T05:40:00.000225+0000 mon.a (mon.0) 577 : cluster [WRN] Cannot update rgw endpoints for daemon rgw.myrealm1.myzone1, error: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T05:40:01.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:40:00 smithi047 bash[22744]: cluster 2024-09-16T05:39:59.706124+0000 mgr.a (mgr.14373) 128 : cluster [DBG] pgmap v90: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:40:01.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:40:00 smithi047 bash[22744]: cluster 2024-09-16T05:40:00.000146+0000 mon.a (mon.0) 575 : cluster [WRN] Health detail: HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-16T05:40:01.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:40:00 smithi047 bash[22744]: cluster 2024-09-16T05:40:00.000189+0000 mon.a (mon.0) 576 : cluster [WRN] [WRN] CEPHADM_RGW: Cannot update rgw endpoints, error: {err} 2024-09-16T05:40:01.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:40:00 smithi047 bash[22744]: cluster 2024-09-16T05:40:00.000225+0000 mon.a (mon.0) 577 : cluster [WRN] Cannot update rgw endpoints for daemon rgw.myrealm1.myzone1, error: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T05:40:03.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:40:02 smithi157 bash[24585]: cluster 2024-09-16T05:40:01.708313+0000 mgr.a (mgr.14373) 129 : cluster [DBG] pgmap v91: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:40:03.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:40:02 smithi086 bash[24289]: cluster 2024-09-16T05:40:01.708313+0000 mgr.a (mgr.14373) 129 : cluster [DBG] pgmap v91: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:40:03.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:40:02 smithi047 bash[22744]: cluster 2024-09-16T05:40:01.708313+0000 mgr.a (mgr.14373) 129 : cluster [DBG] pgmap v91: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:40:03.704 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T05:40:03.704 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T05:40:03.705 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T05:40:04.484 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T05:40:04.484 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T05:40:04.484 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T05:40:04.484 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T05:40:04.485 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T05:40:05.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:40:04 smithi157 bash[24585]: cluster 2024-09-16T05:40:03.708997+0000 mgr.a (mgr.14373) 130 : cluster [DBG] pgmap v92: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:40:05.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:40:04 smithi157 bash[24585]: audit 2024-09-16T05:40:04.049687+0000 mgr.a (mgr.14373) 131 : audit [DBG] from='client.16809 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:40:05.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:40:04 smithi086 bash[24289]: cluster 2024-09-16T05:40:03.708997+0000 mgr.a (mgr.14373) 130 : cluster [DBG] pgmap v92: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:40:05.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:40:04 smithi086 bash[24289]: audit 2024-09-16T05:40:04.049687+0000 mgr.a (mgr.14373) 131 : audit [DBG] from='client.16809 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:40:05.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:40:04 smithi047 bash[22744]: cluster 2024-09-16T05:40:03.708997+0000 mgr.a (mgr.14373) 130 : cluster [DBG] pgmap v92: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:40:05.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:40:04 smithi047 bash[22744]: audit 2024-09-16T05:40:04.049687+0000 mgr.a (mgr.14373) 131 : audit [DBG] from='client.16809 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:40:07.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:40:06 smithi157 bash[24585]: cluster 2024-09-16T05:40:05.709988+0000 mgr.a (mgr.14373) 132 : cluster [DBG] pgmap v93: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:40:07.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:40:06 smithi086 bash[24289]: cluster 2024-09-16T05:40:05.709988+0000 mgr.a (mgr.14373) 132 : cluster [DBG] pgmap v93: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:40:07.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:40:06 smithi047 bash[22744]: cluster 2024-09-16T05:40:05.709988+0000 mgr.a (mgr.14373) 132 : cluster [DBG] pgmap v93: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:40:09.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:40:08 smithi157 bash[24585]: cluster 2024-09-16T05:40:07.712270+0000 mgr.a (mgr.14373) 133 : cluster [DBG] pgmap v94: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:40:09.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:40:08 smithi086 bash[24289]: cluster 2024-09-16T05:40:07.712270+0000 mgr.a (mgr.14373) 133 : cluster [DBG] pgmap v94: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:40:09.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:40:08 smithi047 bash[22744]: cluster 2024-09-16T05:40:07.712270+0000 mgr.a (mgr.14373) 133 : cluster [DBG] pgmap v94: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:40:09.485 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T05:40:09.486 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T05:40:09.486 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T05:40:10.235 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T05:40:10.235 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T05:40:10.236 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T05:40:10.236 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T05:40:10.236 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T05:40:11.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:40:10 smithi157 bash[24585]: cluster 2024-09-16T05:40:09.712947+0000 mgr.a (mgr.14373) 134 : cluster [DBG] pgmap v95: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:40:11.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:40:10 smithi157 bash[24585]: audit 2024-09-16T05:40:09.819892+0000 mgr.a (mgr.14373) 135 : audit [DBG] from='client.16884 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:40:11.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:40:10 smithi086 bash[24289]: cluster 2024-09-16T05:40:09.712947+0000 mgr.a (mgr.14373) 134 : cluster [DBG] pgmap v95: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:40:11.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:40:10 smithi086 bash[24289]: audit 2024-09-16T05:40:09.819892+0000 mgr.a (mgr.14373) 135 : audit [DBG] from='client.16884 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:40:11.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:40:10 smithi047 bash[22744]: cluster 2024-09-16T05:40:09.712947+0000 mgr.a (mgr.14373) 134 : cluster [DBG] pgmap v95: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:40:11.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:40:10 smithi047 bash[22744]: audit 2024-09-16T05:40:09.819892+0000 mgr.a (mgr.14373) 135 : audit [DBG] from='client.16884 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:40:13.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:40:12 smithi157 bash[24585]: cluster 2024-09-16T05:40:11.715281+0000 mgr.a (mgr.14373) 136 : cluster [DBG] pgmap v96: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:40:13.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:40:12 smithi157 bash[24585]: audit 2024-09-16T05:40:12.330513+0000 mon.b (mon.2) 60 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T05:40:13.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:40:12 smithi086 bash[24289]: cluster 2024-09-16T05:40:11.715281+0000 mgr.a (mgr.14373) 136 : cluster [DBG] pgmap v96: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:40:13.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:40:12 smithi086 bash[24289]: audit 2024-09-16T05:40:12.330513+0000 mon.b (mon.2) 60 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T05:40:13.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:40:12 smithi047 bash[22744]: cluster 2024-09-16T05:40:11.715281+0000 mgr.a (mgr.14373) 136 : cluster [DBG] pgmap v96: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:40:13.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:40:12 smithi047 bash[22744]: audit 2024-09-16T05:40:12.330513+0000 mon.b (mon.2) 60 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T05:40:14.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:40:13 smithi157 bash[24585]: audit 2024-09-16T05:40:13.179906+0000 mon.b (mon.2) 61 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T05:40:14.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:40:13 smithi157 bash[24585]: audit 2024-09-16T05:40:13.181832+0000 mon.b (mon.2) 62 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T05:40:14.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:40:13 smithi157 bash[24585]: audit 2024-09-16T05:40:13.195838+0000 mon.a (mon.0) 578 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T05:40:14.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:40:13 smithi157 bash[24585]: audit 2024-09-16T05:40:13.198665+0000 mon.b (mon.2) 63 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T05:40:14.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:40:13 smithi157 bash[24585]: audit 2024-09-16T05:40:13.205710+0000 mgr.a (mgr.14373) 137 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T05:40:14.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:40:13 smithi086 bash[24289]: audit 2024-09-16T05:40:13.179906+0000 mon.b (mon.2) 61 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T05:40:14.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:40:13 smithi086 bash[24289]: audit 2024-09-16T05:40:13.181832+0000 mon.b (mon.2) 62 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T05:40:14.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:40:13 smithi086 bash[24289]: audit 2024-09-16T05:40:13.195838+0000 mon.a (mon.0) 578 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T05:40:14.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:40:13 smithi086 bash[24289]: audit 2024-09-16T05:40:13.198665+0000 mon.b (mon.2) 63 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T05:40:14.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:40:13 smithi086 bash[24289]: audit 2024-09-16T05:40:13.205710+0000 mgr.a (mgr.14373) 137 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T05:40:14.337 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 05:40:13 smithi047 bash[22994]: debug 2024-09-16T05:40:13.929+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T05:40:14.338 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 05:40:13 smithi047 bash[22994]: debug 2024-09-16T05:40:13.933+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T05:40:14.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:40:13 smithi047 bash[22744]: audit 2024-09-16T05:40:13.179906+0000 mon.b (mon.2) 61 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T05:40:14.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:40:13 smithi047 bash[22744]: audit 2024-09-16T05:40:13.181832+0000 mon.b (mon.2) 62 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T05:40:14.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:40:13 smithi047 bash[22744]: audit 2024-09-16T05:40:13.195838+0000 mon.a (mon.0) 578 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T05:40:14.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:40:13 smithi047 bash[22744]: audit 2024-09-16T05:40:13.198665+0000 mon.b (mon.2) 63 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T05:40:14.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:40:13 smithi047 bash[22744]: audit 2024-09-16T05:40:13.205710+0000 mgr.a (mgr.14373) 137 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T05:40:15.237 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T05:40:15.237 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T05:40:15.238 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T05:40:15.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:40:15 smithi157 bash[24585]: cluster 2024-09-16T05:40:13.715817+0000 mgr.a (mgr.14373) 138 : cluster [DBG] pgmap v97: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:40:15.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:40:15 smithi157 bash[24585]: audit 2024-09-16T05:40:13.933613+0000 mgr.a (mgr.14373) 139 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T05:40:15.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:40:15 smithi157 bash[24585]: cephadm 2024-09-16T05:40:13.935711+0000 mgr.a (mgr.14373) 140 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T05:40:15.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:40:15 smithi086 bash[24289]: cluster 2024-09-16T05:40:13.715817+0000 mgr.a (mgr.14373) 138 : cluster [DBG] pgmap v97: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:40:15.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:40:15 smithi086 bash[24289]: audit 2024-09-16T05:40:13.933613+0000 mgr.a (mgr.14373) 139 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T05:40:15.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:40:15 smithi086 bash[24289]: cephadm 2024-09-16T05:40:13.935711+0000 mgr.a (mgr.14373) 140 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T05:40:15.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:40:15 smithi047 bash[22744]: cluster 2024-09-16T05:40:13.715817+0000 mgr.a (mgr.14373) 138 : cluster [DBG] pgmap v97: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:40:15.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:40:15 smithi047 bash[22744]: audit 2024-09-16T05:40:13.933613+0000 mgr.a (mgr.14373) 139 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T05:40:15.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:40:15 smithi047 bash[22744]: cephadm 2024-09-16T05:40:13.935711+0000 mgr.a (mgr.14373) 140 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T05:40:15.992 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T05:40:15.992 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T05:40:15.992 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T05:40:15.993 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T05:40:15.993 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T05:40:17.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:40:17 smithi157 bash[24585]: audit 2024-09-16T05:40:15.579453+0000 mgr.a (mgr.14373) 141 : audit [DBG] from='client.17067 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:40:17.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:40:17 smithi157 bash[24585]: cluster 2024-09-16T05:40:15.716584+0000 mgr.a (mgr.14373) 142 : cluster [DBG] pgmap v98: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:40:17.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:40:17 smithi086 bash[24289]: audit 2024-09-16T05:40:15.579453+0000 mgr.a (mgr.14373) 141 : audit [DBG] from='client.17067 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:40:17.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:40:17 smithi086 bash[24289]: cluster 2024-09-16T05:40:15.716584+0000 mgr.a (mgr.14373) 142 : cluster [DBG] pgmap v98: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:40:17.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:40:17 smithi047 bash[22744]: audit 2024-09-16T05:40:15.579453+0000 mgr.a (mgr.14373) 141 : audit [DBG] from='client.17067 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:40:17.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:40:17 smithi047 bash[22744]: cluster 2024-09-16T05:40:15.716584+0000 mgr.a (mgr.14373) 142 : cluster [DBG] pgmap v98: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:40:19.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:40:19 smithi157 bash[24585]: cluster 2024-09-16T05:40:17.719028+0000 mgr.a (mgr.14373) 143 : cluster [DBG] pgmap v99: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T05:40:19.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:40:19 smithi086 bash[24289]: cluster 2024-09-16T05:40:17.719028+0000 mgr.a (mgr.14373) 143 : cluster [DBG] pgmap v99: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T05:40:19.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:40:19 smithi047 bash[22744]: cluster 2024-09-16T05:40:17.719028+0000 mgr.a (mgr.14373) 143 : cluster [DBG] pgmap v99: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T05:40:20.992 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T05:40:20.993 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T05:40:20.993 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T05:40:21.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:40:21 smithi157 bash[24585]: cluster 2024-09-16T05:40:19.719804+0000 mgr.a (mgr.14373) 144 : cluster [DBG] pgmap v100: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T05:40:21.622 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:40:21 smithi047 bash[22744]: cluster 2024-09-16T05:40:19.719804+0000 mgr.a (mgr.14373) 144 : cluster [DBG] pgmap v100: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T05:40:21.622 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:40:21 smithi086 bash[24289]: cluster 2024-09-16T05:40:19.719804+0000 mgr.a (mgr.14373) 144 : cluster [DBG] pgmap v100: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T05:40:21.751 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T05:40:21.751 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T05:40:21.751 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T05:40:21.751 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T05:40:21.751 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T05:40:23.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:40:23 smithi157 bash[24585]: audit 2024-09-16T05:40:21.330905+0000 mgr.a (mgr.14373) 145 : audit [DBG] from='client.17145 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:40:23.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:40:23 smithi157 bash[24585]: cluster 2024-09-16T05:40:21.721305+0000 mgr.a (mgr.14373) 146 : cluster [DBG] pgmap v101: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T05:40:23.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:40:23 smithi086 bash[24289]: audit 2024-09-16T05:40:21.330905+0000 mgr.a (mgr.14373) 145 : audit [DBG] from='client.17145 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:40:23.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:40:23 smithi086 bash[24289]: cluster 2024-09-16T05:40:21.721305+0000 mgr.a (mgr.14373) 146 : cluster [DBG] pgmap v101: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T05:40:23.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:40:23 smithi047 bash[22744]: audit 2024-09-16T05:40:21.330905+0000 mgr.a (mgr.14373) 145 : audit [DBG] from='client.17145 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:40:23.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:40:23 smithi047 bash[22744]: cluster 2024-09-16T05:40:21.721305+0000 mgr.a (mgr.14373) 146 : cluster [DBG] pgmap v101: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T05:40:25.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:40:25 smithi157 bash[24585]: cluster 2024-09-16T05:40:23.722237+0000 mgr.a (mgr.14373) 147 : cluster [DBG] pgmap v102: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T05:40:25.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:40:25 smithi086 bash[24289]: cluster 2024-09-16T05:40:23.722237+0000 mgr.a (mgr.14373) 147 : cluster [DBG] pgmap v102: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T05:40:25.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:40:25 smithi047 bash[22744]: cluster 2024-09-16T05:40:23.722237+0000 mgr.a (mgr.14373) 147 : cluster [DBG] pgmap v102: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T05:40:26.752 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T05:40:26.754 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T05:40:26.754 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T05:40:27.491 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T05:40:27.491 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T05:40:27.491 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T05:40:27.491 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T05:40:27.491 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T05:40:27.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:40:27 smithi157 bash[24585]: cluster 2024-09-16T05:40:25.723136+0000 mgr.a (mgr.14373) 148 : cluster [DBG] pgmap v103: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T05:40:27.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:40:27 smithi086 bash[24289]: cluster 2024-09-16T05:40:25.723136+0000 mgr.a (mgr.14373) 148 : cluster [DBG] pgmap v103: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T05:40:27.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:40:27 smithi047 bash[22744]: cluster 2024-09-16T05:40:25.723136+0000 mgr.a (mgr.14373) 148 : cluster [DBG] pgmap v103: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T05:40:28.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:40:28 smithi157 bash[24585]: audit 2024-09-16T05:40:27.082997+0000 mgr.a (mgr.14373) 149 : audit [DBG] from='client.17220 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:40:28.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:40:28 smithi086 bash[24289]: audit 2024-09-16T05:40:27.082997+0000 mgr.a (mgr.14373) 149 : audit [DBG] from='client.17220 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:40:28.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:40:28 smithi047 bash[22744]: audit 2024-09-16T05:40:27.082997+0000 mgr.a (mgr.14373) 149 : audit [DBG] from='client.17220 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:40:29.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:40:29 smithi157 bash[24585]: cluster 2024-09-16T05:40:27.725813+0000 mgr.a (mgr.14373) 150 : cluster [DBG] pgmap v104: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T05:40:29.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:40:29 smithi086 bash[24289]: cluster 2024-09-16T05:40:27.725813+0000 mgr.a (mgr.14373) 150 : cluster [DBG] pgmap v104: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T05:40:29.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:40:29 smithi047 bash[22744]: cluster 2024-09-16T05:40:27.725813+0000 mgr.a (mgr.14373) 150 : cluster [DBG] pgmap v104: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T05:40:31.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:40:31 smithi157 bash[24585]: cluster 2024-09-16T05:40:29.726674+0000 mgr.a (mgr.14373) 151 : cluster [DBG] pgmap v105: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T05:40:31.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:40:31 smithi086 bash[24289]: cluster 2024-09-16T05:40:29.726674+0000 mgr.a (mgr.14373) 151 : cluster [DBG] pgmap v105: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T05:40:31.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:40:31 smithi047 bash[22744]: cluster 2024-09-16T05:40:29.726674+0000 mgr.a (mgr.14373) 151 : cluster [DBG] pgmap v105: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T05:40:32.492 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T05:40:32.493 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T05:40:32.493 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T05:40:33.220 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T05:40:33.220 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T05:40:33.220 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T05:40:33.221 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T05:40:33.221 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T05:40:33.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:40:33 smithi157 bash[24585]: cluster 2024-09-16T05:40:31.728657+0000 mgr.a (mgr.14373) 152 : cluster [DBG] pgmap v106: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:40:33.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:40:33 smithi086 bash[24289]: cluster 2024-09-16T05:40:31.728657+0000 mgr.a (mgr.14373) 152 : cluster [DBG] pgmap v106: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:40:33.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:40:33 smithi047 bash[22744]: cluster 2024-09-16T05:40:31.728657+0000 mgr.a (mgr.14373) 152 : cluster [DBG] pgmap v106: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:40:34.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:40:34 smithi157 bash[24585]: audit 2024-09-16T05:40:32.821782+0000 mgr.a (mgr.14373) 153 : audit [DBG] from='client.17298 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:40:34.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:40:34 smithi086 bash[24289]: audit 2024-09-16T05:40:32.821782+0000 mgr.a (mgr.14373) 153 : audit [DBG] from='client.17298 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:40:34.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:40:34 smithi047 bash[22744]: audit 2024-09-16T05:40:32.821782+0000 mgr.a (mgr.14373) 153 : audit [DBG] from='client.17298 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:40:35.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:40:35 smithi157 bash[24585]: cluster 2024-09-16T05:40:33.729813+0000 mgr.a (mgr.14373) 154 : cluster [DBG] pgmap v107: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:40:35.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:40:35 smithi086 bash[24289]: cluster 2024-09-16T05:40:33.729813+0000 mgr.a (mgr.14373) 154 : cluster [DBG] pgmap v107: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:40:35.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:40:35 smithi047 bash[22744]: cluster 2024-09-16T05:40:33.729813+0000 mgr.a (mgr.14373) 154 : cluster [DBG] pgmap v107: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:40:37.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:40:37 smithi157 bash[24585]: cluster 2024-09-16T05:40:35.730659+0000 mgr.a (mgr.14373) 155 : cluster [DBG] pgmap v108: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:40:37.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:40:37 smithi086 bash[24289]: cluster 2024-09-16T05:40:35.730659+0000 mgr.a (mgr.14373) 155 : cluster [DBG] pgmap v108: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:40:37.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:40:37 smithi047 bash[22744]: cluster 2024-09-16T05:40:35.730659+0000 mgr.a (mgr.14373) 155 : cluster [DBG] pgmap v108: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:40:38.222 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T05:40:38.222 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T05:40:38.222 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T05:40:38.964 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T05:40:38.964 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T05:40:38.964 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T05:40:38.964 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T05:40:38.964 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T05:40:39.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:40:39 smithi157 bash[24585]: cluster 2024-09-16T05:40:37.732823+0000 mgr.a (mgr.14373) 156 : cluster [DBG] pgmap v109: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:40:39.572 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:40:39 smithi086 bash[24289]: cluster 2024-09-16T05:40:37.732823+0000 mgr.a (mgr.14373) 156 : cluster [DBG] pgmap v109: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:40:39.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:40:39 smithi047 bash[22744]: cluster 2024-09-16T05:40:37.732823+0000 mgr.a (mgr.14373) 156 : cluster [DBG] pgmap v109: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:40:40.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:40:40 smithi157 bash[24585]: audit 2024-09-16T05:40:38.557634+0000 mgr.a (mgr.14373) 157 : audit [DBG] from='client.17373 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:40:40.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:40:40 smithi086 bash[24289]: audit 2024-09-16T05:40:38.557634+0000 mgr.a (mgr.14373) 157 : audit [DBG] from='client.17373 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:40:40.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:40:40 smithi047 bash[22744]: audit 2024-09-16T05:40:38.557634+0000 mgr.a (mgr.14373) 157 : audit [DBG] from='client.17373 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:40:41.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:40:41 smithi157 bash[24585]: cluster 2024-09-16T05:40:39.733790+0000 mgr.a (mgr.14373) 158 : cluster [DBG] pgmap v110: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:40:41.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:40:41 smithi086 bash[24289]: cluster 2024-09-16T05:40:39.733790+0000 mgr.a (mgr.14373) 158 : cluster [DBG] pgmap v110: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:40:41.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:40:41 smithi047 bash[22744]: cluster 2024-09-16T05:40:39.733790+0000 mgr.a (mgr.14373) 158 : cluster [DBG] pgmap v110: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:40:43.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:40:43 smithi157 bash[24585]: cluster 2024-09-16T05:40:41.736068+0000 mgr.a (mgr.14373) 159 : cluster [DBG] pgmap v111: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:40:43.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:40:43 smithi086 bash[24289]: cluster 2024-09-16T05:40:41.736068+0000 mgr.a (mgr.14373) 159 : cluster [DBG] pgmap v111: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:40:43.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:40:43 smithi047 bash[22744]: cluster 2024-09-16T05:40:41.736068+0000 mgr.a (mgr.14373) 159 : cluster [DBG] pgmap v111: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:40:43.965 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T05:40:43.966 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T05:40:43.966 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T05:40:44.734 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T05:40:44.734 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T05:40:44.735 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T05:40:44.735 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T05:40:44.735 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T05:40:45.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:40:45 smithi157 bash[24585]: cluster 2024-09-16T05:40:43.736980+0000 mgr.a (mgr.14373) 160 : cluster [DBG] pgmap v112: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:40:45.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:40:45 smithi157 bash[24585]: audit 2024-09-16T05:40:44.302498+0000 mgr.a (mgr.14373) 161 : audit [DBG] from='client.17451 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:40:45.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:40:45 smithi086 bash[24289]: cluster 2024-09-16T05:40:43.736980+0000 mgr.a (mgr.14373) 160 : cluster [DBG] pgmap v112: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:40:45.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:40:45 smithi086 bash[24289]: audit 2024-09-16T05:40:44.302498+0000 mgr.a (mgr.14373) 161 : audit [DBG] from='client.17451 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:40:45.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:40:45 smithi047 bash[22744]: cluster 2024-09-16T05:40:43.736980+0000 mgr.a (mgr.14373) 160 : cluster [DBG] pgmap v112: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:40:45.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:40:45 smithi047 bash[22744]: audit 2024-09-16T05:40:44.302498+0000 mgr.a (mgr.14373) 161 : audit [DBG] from='client.17451 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:40:47.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:40:47 smithi157 bash[24585]: cluster 2024-09-16T05:40:45.737969+0000 mgr.a (mgr.14373) 162 : cluster [DBG] pgmap v113: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:40:47.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:40:47 smithi086 bash[24289]: cluster 2024-09-16T05:40:45.737969+0000 mgr.a (mgr.14373) 162 : cluster [DBG] pgmap v113: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:40:47.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:40:47 smithi047 bash[22744]: cluster 2024-09-16T05:40:45.737969+0000 mgr.a (mgr.14373) 162 : cluster [DBG] pgmap v113: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:40:49.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:40:49 smithi157 bash[24585]: cluster 2024-09-16T05:40:47.740262+0000 mgr.a (mgr.14373) 163 : cluster [DBG] pgmap v114: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:40:49.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:40:49 smithi086 bash[24289]: cluster 2024-09-16T05:40:47.740262+0000 mgr.a (mgr.14373) 163 : cluster [DBG] pgmap v114: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:40:49.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:40:49 smithi047 bash[22744]: cluster 2024-09-16T05:40:47.740262+0000 mgr.a (mgr.14373) 163 : cluster [DBG] pgmap v114: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:40:49.736 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T05:40:49.736 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T05:40:49.737 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T05:40:50.506 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T05:40:50.507 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T05:40:50.507 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T05:40:50.507 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T05:40:50.507 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T05:40:51.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:40:51 smithi157 bash[24585]: cluster 2024-09-16T05:40:49.741039+0000 mgr.a (mgr.14373) 164 : cluster [DBG] pgmap v115: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:40:51.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:40:51 smithi157 bash[24585]: audit 2024-09-16T05:40:50.071692+0000 mgr.a (mgr.14373) 165 : audit [DBG] from='client.17529 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:40:51.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:40:51 smithi086 bash[24289]: cluster 2024-09-16T05:40:49.741039+0000 mgr.a (mgr.14373) 164 : cluster [DBG] pgmap v115: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:40:51.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:40:51 smithi086 bash[24289]: audit 2024-09-16T05:40:50.071692+0000 mgr.a (mgr.14373) 165 : audit [DBG] from='client.17529 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:40:51.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:40:51 smithi047 bash[22744]: cluster 2024-09-16T05:40:49.741039+0000 mgr.a (mgr.14373) 164 : cluster [DBG] pgmap v115: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:40:51.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:40:51 smithi047 bash[22744]: audit 2024-09-16T05:40:50.071692+0000 mgr.a (mgr.14373) 165 : audit [DBG] from='client.17529 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:40:53.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:40:53 smithi157 bash[24585]: cluster 2024-09-16T05:40:51.743995+0000 mgr.a (mgr.14373) 166 : cluster [DBG] pgmap v116: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:40:53.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:40:53 smithi086 bash[24289]: cluster 2024-09-16T05:40:51.743995+0000 mgr.a (mgr.14373) 166 : cluster [DBG] pgmap v116: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:40:53.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:40:53 smithi047 bash[22744]: cluster 2024-09-16T05:40:51.743995+0000 mgr.a (mgr.14373) 166 : cluster [DBG] pgmap v116: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:40:55.508 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T05:40:55.509 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T05:40:55.509 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T05:40:55.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:40:55 smithi157 bash[24585]: cluster 2024-09-16T05:40:53.744820+0000 mgr.a (mgr.14373) 167 : cluster [DBG] pgmap v117: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:40:55.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:40:55 smithi086 bash[24289]: cluster 2024-09-16T05:40:53.744820+0000 mgr.a (mgr.14373) 167 : cluster [DBG] pgmap v117: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:40:55.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:40:55 smithi047 bash[22744]: cluster 2024-09-16T05:40:53.744820+0000 mgr.a (mgr.14373) 167 : cluster [DBG] pgmap v117: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:40:56.298 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T05:40:56.298 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T05:40:56.298 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T05:40:56.298 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T05:40:56.298 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T05:40:57.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:40:57 smithi157 bash[24585]: cluster 2024-09-16T05:40:55.745351+0000 mgr.a (mgr.14373) 168 : cluster [DBG] pgmap v118: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:40:57.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:40:57 smithi157 bash[24585]: audit 2024-09-16T05:40:55.854259+0000 mgr.a (mgr.14373) 169 : audit [DBG] from='client.17604 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:40:57.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:40:57 smithi086 bash[24289]: cluster 2024-09-16T05:40:55.745351+0000 mgr.a (mgr.14373) 168 : cluster [DBG] pgmap v118: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:40:57.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:40:57 smithi086 bash[24289]: audit 2024-09-16T05:40:55.854259+0000 mgr.a (mgr.14373) 169 : audit [DBG] from='client.17604 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:40:57.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:40:57 smithi047 bash[22744]: cluster 2024-09-16T05:40:55.745351+0000 mgr.a (mgr.14373) 168 : cluster [DBG] pgmap v118: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:40:57.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:40:57 smithi047 bash[22744]: audit 2024-09-16T05:40:55.854259+0000 mgr.a (mgr.14373) 169 : audit [DBG] from='client.17604 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:40:59.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:40:59 smithi086 bash[24289]: cluster 2024-09-16T05:40:57.747703+0000 mgr.a (mgr.14373) 170 : cluster [DBG] pgmap v119: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:40:59.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:40:59 smithi047 bash[22744]: cluster 2024-09-16T05:40:57.747703+0000 mgr.a (mgr.14373) 170 : cluster [DBG] pgmap v119: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:40:59.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:40:59 smithi157 bash[24585]: cluster 2024-09-16T05:40:57.747703+0000 mgr.a (mgr.14373) 170 : cluster [DBG] pgmap v119: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:41:01.299 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T05:41:01.300 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T05:41:01.300 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T05:41:01.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:41:01 smithi086 bash[24289]: cluster 2024-09-16T05:40:59.748606+0000 mgr.a (mgr.14373) 171 : cluster [DBG] pgmap v120: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:41:01.586 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:41:01 smithi047 bash[22744]: cluster 2024-09-16T05:40:59.748606+0000 mgr.a (mgr.14373) 171 : cluster [DBG] pgmap v120: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:41:01.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:41:01 smithi157 bash[24585]: cluster 2024-09-16T05:40:59.748606+0000 mgr.a (mgr.14373) 171 : cluster [DBG] pgmap v120: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:41:02.056 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T05:41:02.056 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T05:41:02.057 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T05:41:02.057 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T05:41:02.057 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T05:41:03.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:41:03 smithi086 bash[24289]: audit 2024-09-16T05:41:01.642305+0000 mgr.a (mgr.14373) 172 : audit [DBG] from='client.17679 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:41:03.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:41:03 smithi086 bash[24289]: cluster 2024-09-16T05:41:01.749845+0000 mgr.a (mgr.14373) 173 : cluster [DBG] pgmap v121: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:41:03.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:41:03 smithi047 bash[22744]: audit 2024-09-16T05:41:01.642305+0000 mgr.a (mgr.14373) 172 : audit [DBG] from='client.17679 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:41:03.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:41:03 smithi047 bash[22744]: cluster 2024-09-16T05:41:01.749845+0000 mgr.a (mgr.14373) 173 : cluster [DBG] pgmap v121: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:41:03.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:41:03 smithi157 bash[24585]: audit 2024-09-16T05:41:01.642305+0000 mgr.a (mgr.14373) 172 : audit [DBG] from='client.17679 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:41:03.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:41:03 smithi157 bash[24585]: cluster 2024-09-16T05:41:01.749845+0000 mgr.a (mgr.14373) 173 : cluster [DBG] pgmap v121: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:41:05.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:41:05 smithi086 bash[24289]: cluster 2024-09-16T05:41:03.750733+0000 mgr.a (mgr.14373) 174 : cluster [DBG] pgmap v122: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T05:41:05.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:41:05 smithi047 bash[22744]: cluster 2024-09-16T05:41:03.750733+0000 mgr.a (mgr.14373) 174 : cluster [DBG] pgmap v122: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T05:41:05.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:41:05 smithi157 bash[24585]: cluster 2024-09-16T05:41:03.750733+0000 mgr.a (mgr.14373) 174 : cluster [DBG] pgmap v122: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T05:41:07.057 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T05:41:07.058 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T05:41:07.058 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T05:41:07.590 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:41:07 smithi047 bash[22744]: cluster 2024-09-16T05:41:05.751510+0000 mgr.a (mgr.14373) 175 : cluster [DBG] pgmap v123: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T05:41:07.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:41:07 smithi157 bash[24585]: cluster 2024-09-16T05:41:05.751510+0000 mgr.a (mgr.14373) 175 : cluster [DBG] pgmap v123: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T05:41:07.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:41:07 smithi086 bash[24289]: cluster 2024-09-16T05:41:05.751510+0000 mgr.a (mgr.14373) 175 : cluster [DBG] pgmap v123: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T05:41:07.828 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T05:41:07.828 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T05:41:07.829 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T05:41:07.829 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T05:41:07.829 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T05:41:08.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:41:08 smithi047 bash[22744]: audit 2024-09-16T05:41:07.392657+0000 mgr.a (mgr.14373) 176 : audit [DBG] from='client.17751 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:41:08.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:41:08 smithi047 bash[22744]: cluster 2024-09-16T05:41:07.752798+0000 mgr.a (mgr.14373) 177 : cluster [DBG] pgmap v124: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:41:08.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:41:08 smithi157 bash[24585]: audit 2024-09-16T05:41:07.392657+0000 mgr.a (mgr.14373) 176 : audit [DBG] from='client.17751 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:41:08.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:41:08 smithi157 bash[24585]: cluster 2024-09-16T05:41:07.752798+0000 mgr.a (mgr.14373) 177 : cluster [DBG] pgmap v124: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:41:08.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:41:08 smithi086 bash[24289]: audit 2024-09-16T05:41:07.392657+0000 mgr.a (mgr.14373) 176 : audit [DBG] from='client.17751 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:41:08.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:41:08 smithi086 bash[24289]: cluster 2024-09-16T05:41:07.752798+0000 mgr.a (mgr.14373) 177 : cluster [DBG] pgmap v124: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:41:11.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:41:10 smithi086 bash[24289]: cluster 2024-09-16T05:41:09.753484+0000 mgr.a (mgr.14373) 178 : cluster [DBG] pgmap v125: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T05:41:11.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:41:10 smithi047 bash[22744]: cluster 2024-09-16T05:41:09.753484+0000 mgr.a (mgr.14373) 178 : cluster [DBG] pgmap v125: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T05:41:11.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:41:10 smithi157 bash[24585]: cluster 2024-09-16T05:41:09.753484+0000 mgr.a (mgr.14373) 178 : cluster [DBG] pgmap v125: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T05:41:12.830 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T05:41:12.830 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T05:41:12.831 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T05:41:13.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:41:12 smithi086 bash[24289]: cluster 2024-09-16T05:41:11.755413+0000 mgr.a (mgr.14373) 179 : cluster [DBG] pgmap v126: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:41:13.086 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:41:12 smithi047 bash[22744]: cluster 2024-09-16T05:41:11.755413+0000 mgr.a (mgr.14373) 179 : cluster [DBG] pgmap v126: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:41:13.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:41:12 smithi157 bash[24585]: cluster 2024-09-16T05:41:11.755413+0000 mgr.a (mgr.14373) 179 : cluster [DBG] pgmap v126: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:41:13.571 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T05:41:13.571 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T05:41:13.572 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T05:41:13.572 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T05:41:13.572 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T05:41:14.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:41:13 smithi086 bash[24289]: audit 2024-09-16T05:41:13.164528+0000 mgr.a (mgr.14373) 180 : audit [DBG] from='client.17829 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:41:14.086 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:41:13 smithi047 bash[22744]: audit 2024-09-16T05:41:13.164528+0000 mgr.a (mgr.14373) 180 : audit [DBG] from='client.17829 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:41:14.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:41:13 smithi157 bash[24585]: audit 2024-09-16T05:41:13.164528+0000 mgr.a (mgr.14373) 180 : audit [DBG] from='client.17829 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:41:15.086 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:41:14 smithi047 bash[22744]: cluster 2024-09-16T05:41:13.756338+0000 mgr.a (mgr.14373) 181 : cluster [DBG] pgmap v127: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:41:15.086 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:41:14 smithi047 bash[22744]: audit 2024-09-16T05:41:13.981822+0000 mon.b (mon.2) 64 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T05:41:15.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:41:14 smithi157 bash[24585]: cluster 2024-09-16T05:41:13.756338+0000 mgr.a (mgr.14373) 181 : cluster [DBG] pgmap v127: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:41:15.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:41:14 smithi157 bash[24585]: audit 2024-09-16T05:41:13.981822+0000 mon.b (mon.2) 64 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T05:41:15.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:41:14 smithi086 bash[24289]: cluster 2024-09-16T05:41:13.756338+0000 mgr.a (mgr.14373) 181 : cluster [DBG] pgmap v127: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:41:15.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:41:14 smithi086 bash[24289]: audit 2024-09-16T05:41:13.981822+0000 mon.b (mon.2) 64 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T05:41:15.824 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 05:41:15 smithi047 bash[22994]: debug 2024-09-16T05:41:15.552+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T05:41:15.825 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 05:41:15 smithi047 bash[22994]: debug 2024-09-16T05:41:15.556+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T05:41:16.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:41:15 smithi047 bash[22744]: audit 2024-09-16T05:41:14.831474+0000 mon.b (mon.2) 65 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T05:41:16.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:41:15 smithi047 bash[22744]: audit 2024-09-16T05:41:14.833450+0000 mon.b (mon.2) 66 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T05:41:16.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:41:15 smithi047 bash[22744]: audit 2024-09-16T05:41:14.848357+0000 mon.a (mon.0) 579 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T05:41:16.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:41:15 smithi047 bash[22744]: audit 2024-09-16T05:41:14.850136+0000 mon.b (mon.2) 67 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T05:41:16.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:41:15 smithi047 bash[22744]: audit 2024-09-16T05:41:14.857948+0000 mgr.a (mgr.14373) 182 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T05:41:16.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:41:15 smithi157 bash[24585]: audit 2024-09-16T05:41:14.831474+0000 mon.b (mon.2) 65 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T05:41:16.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:41:15 smithi157 bash[24585]: audit 2024-09-16T05:41:14.833450+0000 mon.b (mon.2) 66 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T05:41:16.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:41:15 smithi157 bash[24585]: audit 2024-09-16T05:41:14.848357+0000 mon.a (mon.0) 579 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T05:41:16.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:41:15 smithi157 bash[24585]: audit 2024-09-16T05:41:14.850136+0000 mon.b (mon.2) 67 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T05:41:16.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:41:15 smithi157 bash[24585]: audit 2024-09-16T05:41:14.857948+0000 mgr.a (mgr.14373) 182 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T05:41:16.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:41:15 smithi086 bash[24289]: audit 2024-09-16T05:41:14.831474+0000 mon.b (mon.2) 65 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T05:41:16.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:41:15 smithi086 bash[24289]: audit 2024-09-16T05:41:14.833450+0000 mon.b (mon.2) 66 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T05:41:16.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:41:15 smithi086 bash[24289]: audit 2024-09-16T05:41:14.848357+0000 mon.a (mon.0) 579 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T05:41:16.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:41:15 smithi086 bash[24289]: audit 2024-09-16T05:41:14.850136+0000 mon.b (mon.2) 67 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T05:41:16.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:41:15 smithi086 bash[24289]: audit 2024-09-16T05:41:14.857948+0000 mgr.a (mgr.14373) 182 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T05:41:17.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:41:16 smithi157 bash[24585]: audit 2024-09-16T05:41:15.558229+0000 mgr.a (mgr.14373) 183 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T05:41:17.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:41:16 smithi157 bash[24585]: cephadm 2024-09-16T05:41:15.560324+0000 mgr.a (mgr.14373) 184 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T05:41:17.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:41:16 smithi157 bash[24585]: cluster 2024-09-16T05:41:15.757303+0000 mgr.a (mgr.14373) 185 : cluster [DBG] pgmap v128: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:41:17.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:41:16 smithi086 bash[24289]: audit 2024-09-16T05:41:15.558229+0000 mgr.a (mgr.14373) 183 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T05:41:17.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:41:16 smithi086 bash[24289]: cephadm 2024-09-16T05:41:15.560324+0000 mgr.a (mgr.14373) 184 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T05:41:17.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:41:16 smithi086 bash[24289]: cluster 2024-09-16T05:41:15.757303+0000 mgr.a (mgr.14373) 185 : cluster [DBG] pgmap v128: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:41:17.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:41:16 smithi047 bash[22744]: audit 2024-09-16T05:41:15.558229+0000 mgr.a (mgr.14373) 183 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T05:41:17.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:41:16 smithi047 bash[22744]: cephadm 2024-09-16T05:41:15.560324+0000 mgr.a (mgr.14373) 184 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T05:41:17.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:41:16 smithi047 bash[22744]: cluster 2024-09-16T05:41:15.757303+0000 mgr.a (mgr.14373) 185 : cluster [DBG] pgmap v128: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:41:18.573 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T05:41:18.573 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T05:41:18.574 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T05:41:19.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:41:18 smithi157 bash[24585]: cluster 2024-09-16T05:41:17.760421+0000 mgr.a (mgr.14373) 186 : cluster [DBG] pgmap v129: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T05:41:19.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:41:18 smithi086 bash[24289]: cluster 2024-09-16T05:41:17.760421+0000 mgr.a (mgr.14373) 186 : cluster [DBG] pgmap v129: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T05:41:19.336 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:41:18 smithi047 bash[22744]: cluster 2024-09-16T05:41:17.760421+0000 mgr.a (mgr.14373) 186 : cluster [DBG] pgmap v129: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T05:41:19.353 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T05:41:19.354 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T05:41:19.354 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T05:41:19.354 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T05:41:19.354 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T05:41:20.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:41:19 smithi157 bash[24585]: audit 2024-09-16T05:41:18.914593+0000 mgr.a (mgr.14373) 187 : audit [DBG] from='client.18012 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:41:20.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:41:19 smithi086 bash[24289]: audit 2024-09-16T05:41:18.914593+0000 mgr.a (mgr.14373) 187 : audit [DBG] from='client.18012 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:41:20.336 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:41:19 smithi047 bash[22744]: audit 2024-09-16T05:41:18.914593+0000 mgr.a (mgr.14373) 187 : audit [DBG] from='client.18012 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:41:21.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:41:20 smithi157 bash[24585]: cluster 2024-09-16T05:41:19.761394+0000 mgr.a (mgr.14373) 188 : cluster [DBG] pgmap v130: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T05:41:21.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:41:20 smithi086 bash[24289]: cluster 2024-09-16T05:41:19.761394+0000 mgr.a (mgr.14373) 188 : cluster [DBG] pgmap v130: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T05:41:21.336 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:41:20 smithi047 bash[22744]: cluster 2024-09-16T05:41:19.761394+0000 mgr.a (mgr.14373) 188 : cluster [DBG] pgmap v130: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T05:41:23.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:41:22 smithi157 bash[24585]: cluster 2024-09-16T05:41:21.763570+0000 mgr.a (mgr.14373) 189 : cluster [DBG] pgmap v131: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T05:41:23.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:41:22 smithi086 bash[24289]: cluster 2024-09-16T05:41:21.763570+0000 mgr.a (mgr.14373) 189 : cluster [DBG] pgmap v131: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T05:41:23.336 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:41:22 smithi047 bash[22744]: cluster 2024-09-16T05:41:21.763570+0000 mgr.a (mgr.14373) 189 : cluster [DBG] pgmap v131: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T05:41:24.355 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T05:41:24.356 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T05:41:24.356 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T05:41:25.087 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T05:41:25.088 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T05:41:25.088 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T05:41:25.088 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T05:41:25.088 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T05:41:25.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:41:24 smithi157 bash[24585]: cluster 2024-09-16T05:41:23.764464+0000 mgr.a (mgr.14373) 190 : cluster [DBG] pgmap v132: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T05:41:25.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:41:24 smithi086 bash[24289]: cluster 2024-09-16T05:41:23.764464+0000 mgr.a (mgr.14373) 190 : cluster [DBG] pgmap v132: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T05:41:25.336 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:41:24 smithi047 bash[22744]: cluster 2024-09-16T05:41:23.764464+0000 mgr.a (mgr.14373) 190 : cluster [DBG] pgmap v132: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T05:41:26.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:41:25 smithi157 bash[24585]: audit 2024-09-16T05:41:24.689024+0000 mgr.a (mgr.14373) 191 : audit [DBG] from='client.18090 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:41:26.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:41:25 smithi086 bash[24289]: audit 2024-09-16T05:41:24.689024+0000 mgr.a (mgr.14373) 191 : audit [DBG] from='client.18090 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:41:26.336 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:41:25 smithi047 bash[22744]: audit 2024-09-16T05:41:24.689024+0000 mgr.a (mgr.14373) 191 : audit [DBG] from='client.18090 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:41:27.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:41:26 smithi157 bash[24585]: cluster 2024-09-16T05:41:25.765414+0000 mgr.a (mgr.14373) 192 : cluster [DBG] pgmap v133: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T05:41:27.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:41:26 smithi086 bash[24289]: cluster 2024-09-16T05:41:25.765414+0000 mgr.a (mgr.14373) 192 : cluster [DBG] pgmap v133: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T05:41:27.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:41:26 smithi047 bash[22744]: cluster 2024-09-16T05:41:25.765414+0000 mgr.a (mgr.14373) 192 : cluster [DBG] pgmap v133: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T05:41:29.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:41:28 smithi157 bash[24585]: cluster 2024-09-16T05:41:27.767733+0000 mgr.a (mgr.14373) 193 : cluster [DBG] pgmap v134: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T05:41:29.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:41:28 smithi086 bash[24289]: cluster 2024-09-16T05:41:27.767733+0000 mgr.a (mgr.14373) 193 : cluster [DBG] pgmap v134: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T05:41:29.336 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:41:28 smithi047 bash[22744]: cluster 2024-09-16T05:41:27.767733+0000 mgr.a (mgr.14373) 193 : cluster [DBG] pgmap v134: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T05:41:30.089 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T05:41:30.090 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T05:41:30.090 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T05:41:30.864 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T05:41:30.864 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T05:41:30.864 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T05:41:30.864 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T05:41:30.865 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T05:41:31.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:41:30 smithi157 bash[24585]: cluster 2024-09-16T05:41:29.768486+0000 mgr.a (mgr.14373) 194 : cluster [DBG] pgmap v135: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:41:31.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:41:30 smithi086 bash[24289]: cluster 2024-09-16T05:41:29.768486+0000 mgr.a (mgr.14373) 194 : cluster [DBG] pgmap v135: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:41:31.336 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:41:30 smithi047 bash[22744]: cluster 2024-09-16T05:41:29.768486+0000 mgr.a (mgr.14373) 194 : cluster [DBG] pgmap v135: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:41:32.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:41:31 smithi157 bash[24585]: audit 2024-09-16T05:41:30.429356+0000 mgr.a (mgr.14373) 195 : audit [DBG] from='client.18165 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:41:32.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:41:31 smithi086 bash[24289]: audit 2024-09-16T05:41:30.429356+0000 mgr.a (mgr.14373) 195 : audit [DBG] from='client.18165 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:41:32.336 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:41:31 smithi047 bash[22744]: audit 2024-09-16T05:41:30.429356+0000 mgr.a (mgr.14373) 195 : audit [DBG] from='client.18165 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:41:33.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:41:32 smithi157 bash[24585]: cluster 2024-09-16T05:41:31.770842+0000 mgr.a (mgr.14373) 196 : cluster [DBG] pgmap v136: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:41:33.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:41:32 smithi086 bash[24289]: cluster 2024-09-16T05:41:31.770842+0000 mgr.a (mgr.14373) 196 : cluster [DBG] pgmap v136: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:41:33.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:41:32 smithi047 bash[22744]: cluster 2024-09-16T05:41:31.770842+0000 mgr.a (mgr.14373) 196 : cluster [DBG] pgmap v136: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:41:35.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:41:34 smithi157 bash[24585]: cluster 2024-09-16T05:41:33.771621+0000 mgr.a (mgr.14373) 197 : cluster [DBG] pgmap v137: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:41:35.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:41:34 smithi086 bash[24289]: cluster 2024-09-16T05:41:33.771621+0000 mgr.a (mgr.14373) 197 : cluster [DBG] pgmap v137: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:41:35.336 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:41:34 smithi047 bash[22744]: cluster 2024-09-16T05:41:33.771621+0000 mgr.a (mgr.14373) 197 : cluster [DBG] pgmap v137: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:41:35.865 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T05:41:35.866 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T05:41:35.866 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T05:41:36.610 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T05:41:36.611 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T05:41:36.611 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T05:41:36.611 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T05:41:36.611 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T05:41:37.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:41:36 smithi157 bash[24585]: cluster 2024-09-16T05:41:35.772435+0000 mgr.a (mgr.14373) 198 : cluster [DBG] pgmap v138: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:41:37.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:41:36 smithi157 bash[24585]: audit 2024-09-16T05:41:36.199106+0000 mgr.a (mgr.14373) 199 : audit [DBG] from='client.18240 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:41:37.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:41:36 smithi086 bash[24289]: cluster 2024-09-16T05:41:35.772435+0000 mgr.a (mgr.14373) 198 : cluster [DBG] pgmap v138: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:41:37.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:41:36 smithi086 bash[24289]: audit 2024-09-16T05:41:36.199106+0000 mgr.a (mgr.14373) 199 : audit [DBG] from='client.18240 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:41:37.336 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:41:36 smithi047 bash[22744]: cluster 2024-09-16T05:41:35.772435+0000 mgr.a (mgr.14373) 198 : cluster [DBG] pgmap v138: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:41:37.336 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:41:36 smithi047 bash[22744]: audit 2024-09-16T05:41:36.199106+0000 mgr.a (mgr.14373) 199 : audit [DBG] from='client.18240 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:41:39.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:41:38 smithi157 bash[24585]: cluster 2024-09-16T05:41:37.775119+0000 mgr.a (mgr.14373) 200 : cluster [DBG] pgmap v139: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:41:39.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:41:38 smithi086 bash[24289]: cluster 2024-09-16T05:41:37.775119+0000 mgr.a (mgr.14373) 200 : cluster [DBG] pgmap v139: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:41:39.336 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:41:38 smithi047 bash[22744]: cluster 2024-09-16T05:41:37.775119+0000 mgr.a (mgr.14373) 200 : cluster [DBG] pgmap v139: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:41:41.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:41:40 smithi157 bash[24585]: cluster 2024-09-16T05:41:39.775928+0000 mgr.a (mgr.14373) 201 : cluster [DBG] pgmap v140: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T05:41:41.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:41:40 smithi086 bash[24289]: cluster 2024-09-16T05:41:39.775928+0000 mgr.a (mgr.14373) 201 : cluster [DBG] pgmap v140: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T05:41:41.336 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:41:40 smithi047 bash[22744]: cluster 2024-09-16T05:41:39.775928+0000 mgr.a (mgr.14373) 201 : cluster [DBG] pgmap v140: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T05:41:41.612 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T05:41:41.613 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T05:41:41.613 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T05:41:42.387 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T05:41:42.387 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T05:41:42.387 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T05:41:42.387 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T05:41:42.387 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T05:41:43.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:41:42 smithi157 bash[24585]: cluster 2024-09-16T05:41:41.777915+0000 mgr.a (mgr.14373) 202 : cluster [DBG] pgmap v141: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:41:43.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:41:42 smithi157 bash[24585]: audit 2024-09-16T05:41:41.954137+0000 mgr.a (mgr.14373) 203 : audit [DBG] from='client.18318 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:41:43.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:41:42 smithi086 bash[24289]: cluster 2024-09-16T05:41:41.777915+0000 mgr.a (mgr.14373) 202 : cluster [DBG] pgmap v141: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:41:43.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:41:42 smithi086 bash[24289]: audit 2024-09-16T05:41:41.954137+0000 mgr.a (mgr.14373) 203 : audit [DBG] from='client.18318 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:41:43.336 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:41:42 smithi047 bash[22744]: cluster 2024-09-16T05:41:41.777915+0000 mgr.a (mgr.14373) 202 : cluster [DBG] pgmap v141: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:41:43.336 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:41:42 smithi047 bash[22744]: audit 2024-09-16T05:41:41.954137+0000 mgr.a (mgr.14373) 203 : audit [DBG] from='client.18318 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:41:45.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:41:44 smithi157 bash[24585]: cluster 2024-09-16T05:41:43.778892+0000 mgr.a (mgr.14373) 204 : cluster [DBG] pgmap v142: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T05:41:45.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:41:44 smithi086 bash[24289]: cluster 2024-09-16T05:41:43.778892+0000 mgr.a (mgr.14373) 204 : cluster [DBG] pgmap v142: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T05:41:45.336 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:41:44 smithi047 bash[22744]: cluster 2024-09-16T05:41:43.778892+0000 mgr.a (mgr.14373) 204 : cluster [DBG] pgmap v142: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T05:41:47.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:41:46 smithi157 bash[24585]: cluster 2024-09-16T05:41:45.779700+0000 mgr.a (mgr.14373) 205 : cluster [DBG] pgmap v143: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T05:41:47.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:41:46 smithi086 bash[24289]: cluster 2024-09-16T05:41:45.779700+0000 mgr.a (mgr.14373) 205 : cluster [DBG] pgmap v143: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T05:41:47.336 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:41:46 smithi047 bash[22744]: cluster 2024-09-16T05:41:45.779700+0000 mgr.a (mgr.14373) 205 : cluster [DBG] pgmap v143: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T05:41:47.388 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T05:41:47.389 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T05:41:47.389 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T05:41:48.124 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T05:41:48.124 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T05:41:48.124 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T05:41:48.125 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T05:41:48.125 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T05:41:49.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:41:48 smithi157 bash[24585]: audit 2024-09-16T05:41:47.720648+0000 mgr.a (mgr.14373) 206 : audit [DBG] from='client.18393 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:41:49.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:41:48 smithi157 bash[24585]: cluster 2024-09-16T05:41:47.780972+0000 mgr.a (mgr.14373) 207 : cluster [DBG] pgmap v144: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:41:49.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:41:48 smithi086 bash[24289]: audit 2024-09-16T05:41:47.720648+0000 mgr.a (mgr.14373) 206 : audit [DBG] from='client.18393 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:41:49.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:41:48 smithi086 bash[24289]: cluster 2024-09-16T05:41:47.780972+0000 mgr.a (mgr.14373) 207 : cluster [DBG] pgmap v144: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:41:49.336 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:41:48 smithi047 bash[22744]: audit 2024-09-16T05:41:47.720648+0000 mgr.a (mgr.14373) 206 : audit [DBG] from='client.18393 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:41:49.336 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:41:48 smithi047 bash[22744]: cluster 2024-09-16T05:41:47.780972+0000 mgr.a (mgr.14373) 207 : cluster [DBG] pgmap v144: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:41:51.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:41:50 smithi157 bash[24585]: cluster 2024-09-16T05:41:49.781853+0000 mgr.a (mgr.14373) 208 : cluster [DBG] pgmap v145: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:41:51.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:41:50 smithi086 bash[24289]: cluster 2024-09-16T05:41:49.781853+0000 mgr.a (mgr.14373) 208 : cluster [DBG] pgmap v145: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:41:51.336 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:41:50 smithi047 bash[22744]: cluster 2024-09-16T05:41:49.781853+0000 mgr.a (mgr.14373) 208 : cluster [DBG] pgmap v145: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:41:53.125 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T05:41:53.126 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T05:41:53.127 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T05:41:53.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:41:52 smithi157 bash[24585]: cluster 2024-09-16T05:41:51.784002+0000 mgr.a (mgr.14373) 209 : cluster [DBG] pgmap v146: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:41:53.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:41:52 smithi086 bash[24289]: cluster 2024-09-16T05:41:51.784002+0000 mgr.a (mgr.14373) 209 : cluster [DBG] pgmap v146: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:41:53.336 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:41:52 smithi047 bash[22744]: cluster 2024-09-16T05:41:51.784002+0000 mgr.a (mgr.14373) 209 : cluster [DBG] pgmap v146: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:41:53.897 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T05:41:53.897 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T05:41:53.898 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T05:41:53.898 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T05:41:53.898 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T05:41:55.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:41:54 smithi157 bash[24585]: audit 2024-09-16T05:41:53.465716+0000 mgr.a (mgr.14373) 210 : audit [DBG] from='client.18468 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:41:55.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:41:54 smithi157 bash[24585]: cluster 2024-09-16T05:41:53.784626+0000 mgr.a (mgr.14373) 211 : cluster [DBG] pgmap v147: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:41:55.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:41:54 smithi086 bash[24289]: audit 2024-09-16T05:41:53.465716+0000 mgr.a (mgr.14373) 210 : audit [DBG] from='client.18468 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:41:55.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:41:54 smithi086 bash[24289]: cluster 2024-09-16T05:41:53.784626+0000 mgr.a (mgr.14373) 211 : cluster [DBG] pgmap v147: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:41:55.336 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:41:54 smithi047 bash[22744]: audit 2024-09-16T05:41:53.465716+0000 mgr.a (mgr.14373) 210 : audit [DBG] from='client.18468 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:41:55.336 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:41:54 smithi047 bash[22744]: cluster 2024-09-16T05:41:53.784626+0000 mgr.a (mgr.14373) 211 : cluster [DBG] pgmap v147: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:41:57.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:41:56 smithi157 bash[24585]: cluster 2024-09-16T05:41:55.785561+0000 mgr.a (mgr.14373) 212 : cluster [DBG] pgmap v148: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:41:57.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:41:56 smithi086 bash[24289]: cluster 2024-09-16T05:41:55.785561+0000 mgr.a (mgr.14373) 212 : cluster [DBG] pgmap v148: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:41:57.336 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:41:56 smithi047 bash[22744]: cluster 2024-09-16T05:41:55.785561+0000 mgr.a (mgr.14373) 212 : cluster [DBG] pgmap v148: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:41:58.899 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T05:41:58.899 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T05:41:58.899 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T05:41:59.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:41:58 smithi157 bash[24585]: cluster 2024-09-16T05:41:57.787792+0000 mgr.a (mgr.14373) 213 : cluster [DBG] pgmap v149: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:41:59.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:41:58 smithi086 bash[24289]: cluster 2024-09-16T05:41:57.787792+0000 mgr.a (mgr.14373) 213 : cluster [DBG] pgmap v149: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:41:59.336 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:41:58 smithi047 bash[22744]: cluster 2024-09-16T05:41:57.787792+0000 mgr.a (mgr.14373) 213 : cluster [DBG] pgmap v149: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:41:59.681 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T05:41:59.767 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T05:41:59.768 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T05:41:59.768 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T05:41:59.768 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T05:42:00.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:41:59 smithi157 bash[24585]: audit 2024-09-16T05:41:59.243549+0000 mgr.a (mgr.14373) 214 : audit [DBG] from='client.18543 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:42:00.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:41:59 smithi086 bash[24289]: audit 2024-09-16T05:41:59.243549+0000 mgr.a (mgr.14373) 214 : audit [DBG] from='client.18543 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:42:00.336 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:41:59 smithi047 bash[22744]: audit 2024-09-16T05:41:59.243549+0000 mgr.a (mgr.14373) 214 : audit [DBG] from='client.18543 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:42:01.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:42:00 smithi157 bash[24585]: cluster 2024-09-16T05:41:59.788761+0000 mgr.a (mgr.14373) 215 : cluster [DBG] pgmap v150: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:42:01.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:42:00 smithi086 bash[24289]: cluster 2024-09-16T05:41:59.788761+0000 mgr.a (mgr.14373) 215 : cluster [DBG] pgmap v150: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:42:01.336 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:42:00 smithi047 bash[22744]: cluster 2024-09-16T05:41:59.788761+0000 mgr.a (mgr.14373) 215 : cluster [DBG] pgmap v150: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:42:03.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:42:02 smithi157 bash[24585]: cluster 2024-09-16T05:42:01.790946+0000 mgr.a (mgr.14373) 216 : cluster [DBG] pgmap v151: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:42:03.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:42:02 smithi086 bash[24289]: cluster 2024-09-16T05:42:01.790946+0000 mgr.a (mgr.14373) 216 : cluster [DBG] pgmap v151: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:42:03.336 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:42:02 smithi047 bash[22744]: cluster 2024-09-16T05:42:01.790946+0000 mgr.a (mgr.14373) 216 : cluster [DBG] pgmap v151: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:42:04.683 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T05:42:04.683 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T05:42:04.684 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T05:42:05.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:42:04 smithi157 bash[24585]: cluster 2024-09-16T05:42:03.791732+0000 mgr.a (mgr.14373) 217 : cluster [DBG] pgmap v152: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:42:05.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:42:04 smithi086 bash[24289]: cluster 2024-09-16T05:42:03.791732+0000 mgr.a (mgr.14373) 217 : cluster [DBG] pgmap v152: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:42:05.336 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:42:04 smithi047 bash[22744]: cluster 2024-09-16T05:42:03.791732+0000 mgr.a (mgr.14373) 217 : cluster [DBG] pgmap v152: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:42:05.414 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T05:42:05.414 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T05:42:05.414 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T05:42:05.414 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T05:42:05.414 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T05:42:06.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:42:05 smithi157 bash[24585]: audit 2024-09-16T05:42:05.015803+0000 mgr.a (mgr.14373) 218 : audit [DBG] from='client.18621 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:42:06.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:42:05 smithi086 bash[24289]: audit 2024-09-16T05:42:05.015803+0000 mgr.a (mgr.14373) 218 : audit [DBG] from='client.18621 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:42:06.336 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:42:05 smithi047 bash[22744]: audit 2024-09-16T05:42:05.015803+0000 mgr.a (mgr.14373) 218 : audit [DBG] from='client.18621 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:42:07.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:42:06 smithi157 bash[24585]: cluster 2024-09-16T05:42:05.792638+0000 mgr.a (mgr.14373) 219 : cluster [DBG] pgmap v153: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:42:07.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:42:06 smithi086 bash[24289]: cluster 2024-09-16T05:42:05.792638+0000 mgr.a (mgr.14373) 219 : cluster [DBG] pgmap v153: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:42:07.336 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:42:06 smithi047 bash[22744]: cluster 2024-09-16T05:42:05.792638+0000 mgr.a (mgr.14373) 219 : cluster [DBG] pgmap v153: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:42:09.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:42:08 smithi157 bash[24585]: cluster 2024-09-16T05:42:07.794914+0000 mgr.a (mgr.14373) 220 : cluster [DBG] pgmap v154: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:42:09.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:42:08 smithi086 bash[24289]: cluster 2024-09-16T05:42:07.794914+0000 mgr.a (mgr.14373) 220 : cluster [DBG] pgmap v154: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:42:09.336 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:42:08 smithi047 bash[22744]: cluster 2024-09-16T05:42:07.794914+0000 mgr.a (mgr.14373) 220 : cluster [DBG] pgmap v154: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:42:10.415 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T05:42:10.416 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T05:42:10.416 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T05:42:11.183 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T05:42:11.184 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T05:42:11.184 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T05:42:11.184 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T05:42:11.184 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T05:42:11.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:42:10 smithi157 bash[24585]: cluster 2024-09-16T05:42:09.795687+0000 mgr.a (mgr.14373) 221 : cluster [DBG] pgmap v155: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:42:11.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:42:10 smithi086 bash[24289]: cluster 2024-09-16T05:42:09.795687+0000 mgr.a (mgr.14373) 221 : cluster [DBG] pgmap v155: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:42:11.336 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:42:10 smithi047 bash[22744]: cluster 2024-09-16T05:42:09.795687+0000 mgr.a (mgr.14373) 221 : cluster [DBG] pgmap v155: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:42:12.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:42:12 smithi157 bash[24585]: audit 2024-09-16T05:42:10.762286+0000 mgr.a (mgr.14373) 222 : audit [DBG] from='client.18696 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:42:12.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:42:11 smithi086 bash[24289]: audit 2024-09-16T05:42:10.762286+0000 mgr.a (mgr.14373) 222 : audit [DBG] from='client.18696 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:42:12.336 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:42:12 smithi047 bash[22744]: audit 2024-09-16T05:42:10.762286+0000 mgr.a (mgr.14373) 222 : audit [DBG] from='client.18696 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:42:13.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:42:13 smithi157 bash[24585]: cluster 2024-09-16T05:42:11.798060+0000 mgr.a (mgr.14373) 223 : cluster [DBG] pgmap v156: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:42:13.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:42:13 smithi086 bash[24289]: cluster 2024-09-16T05:42:11.798060+0000 mgr.a (mgr.14373) 223 : cluster [DBG] pgmap v156: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:42:13.336 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:42:13 smithi047 bash[22744]: cluster 2024-09-16T05:42:11.798060+0000 mgr.a (mgr.14373) 223 : cluster [DBG] pgmap v156: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:42:15.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:42:15 smithi157 bash[24585]: cluster 2024-09-16T05:42:13.798866+0000 mgr.a (mgr.14373) 224 : cluster [DBG] pgmap v157: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:42:15.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:42:15 smithi086 bash[24289]: cluster 2024-09-16T05:42:13.798866+0000 mgr.a (mgr.14373) 224 : cluster [DBG] pgmap v157: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:42:15.336 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:42:15 smithi047 bash[22744]: cluster 2024-09-16T05:42:13.798866+0000 mgr.a (mgr.14373) 224 : cluster [DBG] pgmap v157: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:42:16.184 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T05:42:16.185 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T05:42:16.185 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T05:42:16.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:42:16 smithi157 bash[24585]: audit 2024-09-16T05:42:15.606371+0000 mon.b (mon.2) 68 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T05:42:16.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:42:16 smithi086 bash[24289]: audit 2024-09-16T05:42:15.606371+0000 mon.b (mon.2) 68 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T05:42:16.335 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:42:16 smithi047 bash[22744]: audit 2024-09-16T05:42:15.606371+0000 mon.b (mon.2) 68 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T05:42:16.907 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T05:42:16.908 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T05:42:16.908 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T05:42:16.908 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T05:42:16.909 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T05:42:17.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:42:17 smithi157 bash[24585]: cluster 2024-09-16T05:42:15.799574+0000 mgr.a (mgr.14373) 225 : cluster [DBG] pgmap v158: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:42:17.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:42:17 smithi157 bash[24585]: audit 2024-09-16T05:42:16.235489+0000 mon.a (mon.0) 580 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T05:42:17.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:42:17 smithi157 bash[24585]: audit 2024-09-16T05:42:16.243797+0000 mon.a (mon.0) 581 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T05:42:17.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:42:17 smithi157 bash[24585]: audit 2024-09-16T05:42:17.025145+0000 mon.b (mon.2) 69 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T05:42:17.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:42:17 smithi157 bash[24585]: audit 2024-09-16T05:42:17.027563+0000 mon.b (mon.2) 70 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T05:42:17.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:42:17 smithi157 bash[24585]: audit 2024-09-16T05:42:17.043268+0000 mon.a (mon.0) 582 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T05:42:17.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:42:17 smithi157 bash[24585]: audit 2024-09-16T05:42:17.053793+0000 mon.b (mon.2) 71 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T05:42:17.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:42:17 smithi086 bash[24289]: cluster 2024-09-16T05:42:15.799574+0000 mgr.a (mgr.14373) 225 : cluster [DBG] pgmap v158: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:42:17.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:42:17 smithi086 bash[24289]: audit 2024-09-16T05:42:16.235489+0000 mon.a (mon.0) 580 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T05:42:17.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:42:17 smithi086 bash[24289]: audit 2024-09-16T05:42:16.243797+0000 mon.a (mon.0) 581 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T05:42:17.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:42:17 smithi086 bash[24289]: audit 2024-09-16T05:42:17.025145+0000 mon.b (mon.2) 69 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T05:42:17.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:42:17 smithi086 bash[24289]: audit 2024-09-16T05:42:17.027563+0000 mon.b (mon.2) 70 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T05:42:17.572 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:42:17 smithi086 bash[24289]: audit 2024-09-16T05:42:17.043268+0000 mon.a (mon.0) 582 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T05:42:17.572 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:42:17 smithi086 bash[24289]: audit 2024-09-16T05:42:17.053793+0000 mon.b (mon.2) 71 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T05:42:17.586 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:42:17 smithi047 bash[22744]: cluster 2024-09-16T05:42:15.799574+0000 mgr.a (mgr.14373) 225 : cluster [DBG] pgmap v158: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:42:17.586 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:42:17 smithi047 bash[22744]: audit 2024-09-16T05:42:16.235489+0000 mon.a (mon.0) 580 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T05:42:17.586 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:42:17 smithi047 bash[22744]: audit 2024-09-16T05:42:16.243797+0000 mon.a (mon.0) 581 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T05:42:17.586 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:42:17 smithi047 bash[22744]: audit 2024-09-16T05:42:17.025145+0000 mon.b (mon.2) 69 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T05:42:17.586 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:42:17 smithi047 bash[22744]: audit 2024-09-16T05:42:17.027563+0000 mon.b (mon.2) 70 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T05:42:17.586 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:42:17 smithi047 bash[22744]: audit 2024-09-16T05:42:17.043268+0000 mon.a (mon.0) 582 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T05:42:17.586 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:42:17 smithi047 bash[22744]: audit 2024-09-16T05:42:17.053793+0000 mon.b (mon.2) 71 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T05:42:18.086 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 05:42:17 smithi047 bash[22994]: debug 2024-09-16T05:42:17.756+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T05:42:18.086 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 05:42:17 smithi047 bash[22994]: debug 2024-09-16T05:42:17.760+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T05:42:18.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:42:18 smithi157 bash[24585]: audit 2024-09-16T05:42:16.504394+0000 mgr.a (mgr.14373) 226 : audit [DBG] from='client.18774 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:42:18.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:42:18 smithi157 bash[24585]: audit 2024-09-16T05:42:17.061398+0000 mgr.a (mgr.14373) 227 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T05:42:18.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:42:18 smithi086 bash[24289]: audit 2024-09-16T05:42:16.504394+0000 mgr.a (mgr.14373) 226 : audit [DBG] from='client.18774 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:42:18.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:42:18 smithi086 bash[24289]: audit 2024-09-16T05:42:17.061398+0000 mgr.a (mgr.14373) 227 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T05:42:18.586 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:42:18 smithi047 bash[22744]: audit 2024-09-16T05:42:16.504394+0000 mgr.a (mgr.14373) 226 : audit [DBG] from='client.18774 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:42:18.586 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:42:18 smithi047 bash[22744]: audit 2024-09-16T05:42:17.061398+0000 mgr.a (mgr.14373) 227 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T05:42:19.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:42:19 smithi157 bash[24585]: audit 2024-09-16T05:42:17.760991+0000 mgr.a (mgr.14373) 228 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T05:42:19.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:42:19 smithi157 bash[24585]: cephadm 2024-09-16T05:42:17.762900+0000 mgr.a (mgr.14373) 229 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T05:42:19.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:42:19 smithi157 bash[24585]: cluster 2024-09-16T05:42:17.800947+0000 mgr.a (mgr.14373) 230 : cluster [DBG] pgmap v159: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:42:19.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:42:19 smithi086 bash[24289]: audit 2024-09-16T05:42:17.760991+0000 mgr.a (mgr.14373) 228 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T05:42:19.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:42:19 smithi086 bash[24289]: cephadm 2024-09-16T05:42:17.762900+0000 mgr.a (mgr.14373) 229 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T05:42:19.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:42:19 smithi086 bash[24289]: cluster 2024-09-16T05:42:17.800947+0000 mgr.a (mgr.14373) 230 : cluster [DBG] pgmap v159: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:42:19.586 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:42:19 smithi047 bash[22744]: audit 2024-09-16T05:42:17.760991+0000 mgr.a (mgr.14373) 228 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T05:42:19.586 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:42:19 smithi047 bash[22744]: cephadm 2024-09-16T05:42:17.762900+0000 mgr.a (mgr.14373) 229 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T05:42:19.586 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:42:19 smithi047 bash[22744]: cluster 2024-09-16T05:42:17.800947+0000 mgr.a (mgr.14373) 230 : cluster [DBG] pgmap v159: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:42:21.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:42:21 smithi157 bash[24585]: cluster 2024-09-16T05:42:19.801667+0000 mgr.a (mgr.14373) 231 : cluster [DBG] pgmap v160: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T05:42:21.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:42:21 smithi086 bash[24289]: cluster 2024-09-16T05:42:19.801667+0000 mgr.a (mgr.14373) 231 : cluster [DBG] pgmap v160: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T05:42:21.586 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:42:21 smithi047 bash[22744]: cluster 2024-09-16T05:42:19.801667+0000 mgr.a (mgr.14373) 231 : cluster [DBG] pgmap v160: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T05:42:21.909 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T05:42:21.910 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T05:42:21.910 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T05:42:22.679 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T05:42:22.679 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T05:42:22.679 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T05:42:22.679 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T05:42:22.679 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T05:42:23.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:42:23 smithi157 bash[24585]: cluster 2024-09-16T05:42:21.803645+0000 mgr.a (mgr.14373) 232 : cluster [DBG] pgmap v161: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T05:42:23.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:42:23 smithi157 bash[24585]: audit 2024-09-16T05:42:22.246777+0000 mgr.a (mgr.14373) 233 : audit [DBG] from='client.18957 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:42:23.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:42:23 smithi086 bash[24289]: cluster 2024-09-16T05:42:21.803645+0000 mgr.a (mgr.14373) 232 : cluster [DBG] pgmap v161: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T05:42:23.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:42:23 smithi086 bash[24289]: audit 2024-09-16T05:42:22.246777+0000 mgr.a (mgr.14373) 233 : audit [DBG] from='client.18957 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:42:23.586 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:42:23 smithi047 bash[22744]: cluster 2024-09-16T05:42:21.803645+0000 mgr.a (mgr.14373) 232 : cluster [DBG] pgmap v161: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T05:42:23.586 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:42:23 smithi047 bash[22744]: audit 2024-09-16T05:42:22.246777+0000 mgr.a (mgr.14373) 233 : audit [DBG] from='client.18957 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:42:25.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:42:25 smithi157 bash[24585]: cluster 2024-09-16T05:42:23.804682+0000 mgr.a (mgr.14373) 234 : cluster [DBG] pgmap v162: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T05:42:25.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:42:25 smithi086 bash[24289]: cluster 2024-09-16T05:42:23.804682+0000 mgr.a (mgr.14373) 234 : cluster [DBG] pgmap v162: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T05:42:25.586 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:42:25 smithi047 bash[22744]: cluster 2024-09-16T05:42:23.804682+0000 mgr.a (mgr.14373) 234 : cluster [DBG] pgmap v162: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T05:42:27.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:42:27 smithi157 bash[24585]: cluster 2024-09-16T05:42:25.805518+0000 mgr.a (mgr.14373) 235 : cluster [DBG] pgmap v163: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T05:42:27.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:42:27 smithi086 bash[24289]: cluster 2024-09-16T05:42:25.805518+0000 mgr.a (mgr.14373) 235 : cluster [DBG] pgmap v163: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T05:42:27.585 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:42:27 smithi047 bash[22744]: cluster 2024-09-16T05:42:25.805518+0000 mgr.a (mgr.14373) 235 : cluster [DBG] pgmap v163: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T05:42:27.680 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T05:42:27.681 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T05:42:27.681 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T05:42:28.436 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T05:42:28.437 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T05:42:28.437 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T05:42:28.437 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T05:42:28.437 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T05:42:29.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:42:29 smithi157 bash[24585]: cluster 2024-09-16T05:42:27.806597+0000 mgr.a (mgr.14373) 236 : cluster [DBG] pgmap v164: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T05:42:29.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:42:29 smithi157 bash[24585]: audit 2024-09-16T05:42:28.019461+0000 mgr.a (mgr.14373) 237 : audit [DBG] from='client.19035 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:42:29.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:42:29 smithi086 bash[24289]: cluster 2024-09-16T05:42:27.806597+0000 mgr.a (mgr.14373) 236 : cluster [DBG] pgmap v164: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T05:42:29.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:42:29 smithi086 bash[24289]: audit 2024-09-16T05:42:28.019461+0000 mgr.a (mgr.14373) 237 : audit [DBG] from='client.19035 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:42:29.586 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:42:29 smithi047 bash[22744]: cluster 2024-09-16T05:42:27.806597+0000 mgr.a (mgr.14373) 236 : cluster [DBG] pgmap v164: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T05:42:29.586 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:42:29 smithi047 bash[22744]: audit 2024-09-16T05:42:28.019461+0000 mgr.a (mgr.14373) 237 : audit [DBG] from='client.19035 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:42:31.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:42:31 smithi157 bash[24585]: cluster 2024-09-16T05:42:29.807406+0000 mgr.a (mgr.14373) 238 : cluster [DBG] pgmap v165: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T05:42:31.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:42:31 smithi086 bash[24289]: cluster 2024-09-16T05:42:29.807406+0000 mgr.a (mgr.14373) 238 : cluster [DBG] pgmap v165: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T05:42:31.585 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:42:31 smithi047 bash[22744]: cluster 2024-09-16T05:42:29.807406+0000 mgr.a (mgr.14373) 238 : cluster [DBG] pgmap v165: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T05:42:33.438 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T05:42:33.439 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T05:42:33.439 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T05:42:33.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:42:33 smithi157 bash[24585]: cluster 2024-09-16T05:42:31.809578+0000 mgr.a (mgr.14373) 239 : cluster [DBG] pgmap v166: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T05:42:33.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:42:33 smithi086 bash[24289]: cluster 2024-09-16T05:42:31.809578+0000 mgr.a (mgr.14373) 239 : cluster [DBG] pgmap v166: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T05:42:33.585 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:42:33 smithi047 bash[22744]: cluster 2024-09-16T05:42:31.809578+0000 mgr.a (mgr.14373) 239 : cluster [DBG] pgmap v166: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T05:42:34.170 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T05:42:34.171 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T05:42:34.171 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T05:42:34.171 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T05:42:34.171 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T05:42:35.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:42:35 smithi157 bash[24585]: audit 2024-09-16T05:42:33.777858+0000 mgr.a (mgr.14373) 240 : audit [DBG] from='client.19110 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:42:35.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:42:35 smithi157 bash[24585]: cluster 2024-09-16T05:42:33.810645+0000 mgr.a (mgr.14373) 241 : cluster [DBG] pgmap v167: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:42:35.573 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:42:35 smithi086 bash[24289]: audit 2024-09-16T05:42:33.777858+0000 mgr.a (mgr.14373) 240 : audit [DBG] from='client.19110 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:42:35.573 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:42:35 smithi086 bash[24289]: cluster 2024-09-16T05:42:33.810645+0000 mgr.a (mgr.14373) 241 : cluster [DBG] pgmap v167: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:42:35.585 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:42:35 smithi047 bash[22744]: audit 2024-09-16T05:42:33.777858+0000 mgr.a (mgr.14373) 240 : audit [DBG] from='client.19110 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:42:35.586 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:42:35 smithi047 bash[22744]: cluster 2024-09-16T05:42:33.810645+0000 mgr.a (mgr.14373) 241 : cluster [DBG] pgmap v167: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:42:37.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:42:37 smithi157 bash[24585]: cluster 2024-09-16T05:42:35.811579+0000 mgr.a (mgr.14373) 242 : cluster [DBG] pgmap v168: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:42:37.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:42:37 smithi086 bash[24289]: cluster 2024-09-16T05:42:35.811579+0000 mgr.a (mgr.14373) 242 : cluster [DBG] pgmap v168: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:42:37.585 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:42:37 smithi047 bash[22744]: cluster 2024-09-16T05:42:35.811579+0000 mgr.a (mgr.14373) 242 : cluster [DBG] pgmap v168: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:42:39.172 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T05:42:39.172 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T05:42:39.173 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T05:42:39.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:42:39 smithi157 bash[24585]: cluster 2024-09-16T05:42:37.813847+0000 mgr.a (mgr.14373) 243 : cluster [DBG] pgmap v169: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:42:39.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:42:39 smithi086 bash[24289]: cluster 2024-09-16T05:42:37.813847+0000 mgr.a (mgr.14373) 243 : cluster [DBG] pgmap v169: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:42:39.585 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:42:39 smithi047 bash[22744]: cluster 2024-09-16T05:42:37.813847+0000 mgr.a (mgr.14373) 243 : cluster [DBG] pgmap v169: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:42:39.922 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T05:42:39.922 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T05:42:39.922 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T05:42:39.923 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T05:42:39.923 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T05:42:41.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:42:41 smithi157 bash[24585]: audit 2024-09-16T05:42:39.511520+0000 mgr.a (mgr.14373) 244 : audit [DBG] from='client.19185 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:42:41.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:42:41 smithi157 bash[24585]: cluster 2024-09-16T05:42:39.814431+0000 mgr.a (mgr.14373) 245 : cluster [DBG] pgmap v170: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:42:41.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:42:41 smithi086 bash[24289]: audit 2024-09-16T05:42:39.511520+0000 mgr.a (mgr.14373) 244 : audit [DBG] from='client.19185 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:42:41.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:42:41 smithi086 bash[24289]: cluster 2024-09-16T05:42:39.814431+0000 mgr.a (mgr.14373) 245 : cluster [DBG] pgmap v170: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:42:41.585 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:42:41 smithi047 bash[22744]: audit 2024-09-16T05:42:39.511520+0000 mgr.a (mgr.14373) 244 : audit [DBG] from='client.19185 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:42:41.586 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:42:41 smithi047 bash[22744]: cluster 2024-09-16T05:42:39.814431+0000 mgr.a (mgr.14373) 245 : cluster [DBG] pgmap v170: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:42:43.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:42:43 smithi157 bash[24585]: cluster 2024-09-16T05:42:41.816672+0000 mgr.a (mgr.14373) 246 : cluster [DBG] pgmap v171: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:42:43.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:42:43 smithi086 bash[24289]: cluster 2024-09-16T05:42:41.816672+0000 mgr.a (mgr.14373) 246 : cluster [DBG] pgmap v171: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:42:43.585 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:42:43 smithi047 bash[22744]: cluster 2024-09-16T05:42:41.816672+0000 mgr.a (mgr.14373) 246 : cluster [DBG] pgmap v171: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:42:44.924 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T05:42:44.924 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T05:42:44.924 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T05:42:45.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:42:45 smithi086 bash[24289]: cluster 2024-09-16T05:42:43.817467+0000 mgr.a (mgr.14373) 247 : cluster [DBG] pgmap v172: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:42:45.585 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:42:45 smithi047 bash[22744]: cluster 2024-09-16T05:42:43.817467+0000 mgr.a (mgr.14373) 247 : cluster [DBG] pgmap v172: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:42:45.704 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T05:42:45.704 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T05:42:45.704 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T05:42:45.704 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T05:42:45.704 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T05:42:45.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:42:45 smithi157 bash[24585]: cluster 2024-09-16T05:42:43.817467+0000 mgr.a (mgr.14373) 247 : cluster [DBG] pgmap v172: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:42:46.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:42:46 smithi086 bash[24289]: audit 2024-09-16T05:42:45.262206+0000 mgr.a (mgr.14373) 248 : audit [DBG] from='client.19263 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:42:46.585 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:42:46 smithi047 bash[22744]: audit 2024-09-16T05:42:45.262206+0000 mgr.a (mgr.14373) 248 : audit [DBG] from='client.19263 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:42:46.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:42:46 smithi157 bash[24585]: audit 2024-09-16T05:42:45.262206+0000 mgr.a (mgr.14373) 248 : audit [DBG] from='client.19263 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:42:47.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:42:47 smithi086 bash[24289]: cluster 2024-09-16T05:42:45.818498+0000 mgr.a (mgr.14373) 249 : cluster [DBG] pgmap v173: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:42:47.585 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:42:47 smithi047 bash[22744]: cluster 2024-09-16T05:42:45.818498+0000 mgr.a (mgr.14373) 249 : cluster [DBG] pgmap v173: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:42:47.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:42:47 smithi157 bash[24585]: cluster 2024-09-16T05:42:45.818498+0000 mgr.a (mgr.14373) 249 : cluster [DBG] pgmap v173: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:42:49.585 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:42:49 smithi047 bash[22744]: cluster 2024-09-16T05:42:47.820735+0000 mgr.a (mgr.14373) 250 : cluster [DBG] pgmap v174: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:42:49.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:42:49 smithi157 bash[24585]: cluster 2024-09-16T05:42:47.820735+0000 mgr.a (mgr.14373) 250 : cluster [DBG] pgmap v174: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:42:49.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:42:49 smithi086 bash[24289]: cluster 2024-09-16T05:42:47.820735+0000 mgr.a (mgr.14373) 250 : cluster [DBG] pgmap v174: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:42:50.705 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T05:42:50.707 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T05:42:50.708 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T05:42:51.473 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T05:42:51.473 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T05:42:51.473 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T05:42:51.473 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T05:42:51.473 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T05:42:51.585 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:42:51 smithi047 bash[22744]: cluster 2024-09-16T05:42:49.821501+0000 mgr.a (mgr.14373) 251 : cluster [DBG] pgmap v175: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:42:51.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:42:51 smithi157 bash[24585]: cluster 2024-09-16T05:42:49.821501+0000 mgr.a (mgr.14373) 251 : cluster [DBG] pgmap v175: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:42:51.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:42:51 smithi086 bash[24289]: cluster 2024-09-16T05:42:49.821501+0000 mgr.a (mgr.14373) 251 : cluster [DBG] pgmap v175: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:42:52.585 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:42:52 smithi047 bash[22744]: audit 2024-09-16T05:42:51.044340+0000 mgr.a (mgr.14373) 252 : audit [DBG] from='client.19338 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:42:52.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:42:52 smithi157 bash[24585]: audit 2024-09-16T05:42:51.044340+0000 mgr.a (mgr.14373) 252 : audit [DBG] from='client.19338 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:42:52.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:42:52 smithi086 bash[24289]: audit 2024-09-16T05:42:51.044340+0000 mgr.a (mgr.14373) 252 : audit [DBG] from='client.19338 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:42:53.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:42:53 smithi047 bash[22744]: cluster 2024-09-16T05:42:51.823949+0000 mgr.a (mgr.14373) 253 : cluster [DBG] pgmap v176: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-16T05:42:53.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:42:53 smithi157 bash[24585]: cluster 2024-09-16T05:42:51.823949+0000 mgr.a (mgr.14373) 253 : cluster [DBG] pgmap v176: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-16T05:42:53.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:42:53 smithi086 bash[24289]: cluster 2024-09-16T05:42:51.823949+0000 mgr.a (mgr.14373) 253 : cluster [DBG] pgmap v176: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-16T05:42:55.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:42:55 smithi157 bash[24585]: cluster 2024-09-16T05:42:53.824757+0000 mgr.a (mgr.14373) 254 : cluster [DBG] pgmap v177: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T05:42:55.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:42:55 smithi086 bash[24289]: cluster 2024-09-16T05:42:53.824757+0000 mgr.a (mgr.14373) 254 : cluster [DBG] pgmap v177: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T05:42:55.835 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:42:55 smithi047 bash[22744]: cluster 2024-09-16T05:42:53.824757+0000 mgr.a (mgr.14373) 254 : cluster [DBG] pgmap v177: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T05:42:56.474 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T05:42:56.475 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T05:42:56.475 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T05:42:57.218 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T05:42:57.218 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T05:42:57.218 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T05:42:57.218 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T05:42:57.218 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T05:42:57.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:42:57 smithi157 bash[24585]: cluster 2024-09-16T05:42:55.825523+0000 mgr.a (mgr.14373) 255 : cluster [DBG] pgmap v178: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T05:42:57.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:42:57 smithi086 bash[24289]: cluster 2024-09-16T05:42:55.825523+0000 mgr.a (mgr.14373) 255 : cluster [DBG] pgmap v178: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T05:42:57.835 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:42:57 smithi047 bash[22744]: cluster 2024-09-16T05:42:55.825523+0000 mgr.a (mgr.14373) 255 : cluster [DBG] pgmap v178: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T05:42:58.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:42:58 smithi157 bash[24585]: audit 2024-09-16T05:42:56.811455+0000 mgr.a (mgr.14373) 256 : audit [DBG] from='client.19410 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:42:58.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:42:58 smithi086 bash[24289]: audit 2024-09-16T05:42:56.811455+0000 mgr.a (mgr.14373) 256 : audit [DBG] from='client.19410 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:42:58.835 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:42:58 smithi047 bash[22744]: audit 2024-09-16T05:42:56.811455+0000 mgr.a (mgr.14373) 256 : audit [DBG] from='client.19410 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:42:59.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:42:59 smithi157 bash[24585]: cluster 2024-09-16T05:42:57.828145+0000 mgr.a (mgr.14373) 257 : cluster [DBG] pgmap v179: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:42:59.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:42:59 smithi086 bash[24289]: cluster 2024-09-16T05:42:57.828145+0000 mgr.a (mgr.14373) 257 : cluster [DBG] pgmap v179: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:42:59.835 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:42:59 smithi047 bash[22744]: cluster 2024-09-16T05:42:57.828145+0000 mgr.a (mgr.14373) 257 : cluster [DBG] pgmap v179: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:43:00.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:43:00 smithi157 bash[24585]: cluster 2024-09-16T05:42:59.828908+0000 mgr.a (mgr.14373) 258 : cluster [DBG] pgmap v180: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T05:43:00.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:43:00 smithi086 bash[24289]: cluster 2024-09-16T05:42:59.828908+0000 mgr.a (mgr.14373) 258 : cluster [DBG] pgmap v180: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T05:43:00.835 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:43:00 smithi047 bash[22744]: cluster 2024-09-16T05:42:59.828908+0000 mgr.a (mgr.14373) 258 : cluster [DBG] pgmap v180: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T05:43:02.219 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T05:43:02.220 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T05:43:02.220 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T05:43:02.958 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T05:43:02.958 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T05:43:02.959 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T05:43:02.959 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T05:43:02.959 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T05:43:03.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:43:02 smithi157 bash[24585]: cluster 2024-09-16T05:43:01.830953+0000 mgr.a (mgr.14373) 259 : cluster [DBG] pgmap v181: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:43:03.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:43:02 smithi086 bash[24289]: cluster 2024-09-16T05:43:01.830953+0000 mgr.a (mgr.14373) 259 : cluster [DBG] pgmap v181: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:43:03.335 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:43:02 smithi047 bash[22744]: cluster 2024-09-16T05:43:01.830953+0000 mgr.a (mgr.14373) 259 : cluster [DBG] pgmap v181: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:43:04.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:43:03 smithi157 bash[24585]: audit 2024-09-16T05:43:02.554709+0000 mgr.a (mgr.14373) 260 : audit [DBG] from='client.19482 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:43:04.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:43:03 smithi086 bash[24289]: audit 2024-09-16T05:43:02.554709+0000 mgr.a (mgr.14373) 260 : audit [DBG] from='client.19482 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:43:04.335 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:43:03 smithi047 bash[22744]: audit 2024-09-16T05:43:02.554709+0000 mgr.a (mgr.14373) 260 : audit [DBG] from='client.19482 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:43:05.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:43:04 smithi157 bash[24585]: cluster 2024-09-16T05:43:03.831877+0000 mgr.a (mgr.14373) 261 : cluster [DBG] pgmap v182: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-16T05:43:05.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:43:04 smithi086 bash[24289]: cluster 2024-09-16T05:43:03.831877+0000 mgr.a (mgr.14373) 261 : cluster [DBG] pgmap v182: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-16T05:43:05.335 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:43:04 smithi047 bash[22744]: cluster 2024-09-16T05:43:03.831877+0000 mgr.a (mgr.14373) 261 : cluster [DBG] pgmap v182: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-16T05:43:07.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:43:06 smithi157 bash[24585]: cluster 2024-09-16T05:43:05.832628+0000 mgr.a (mgr.14373) 262 : cluster [DBG] pgmap v183: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-16T05:43:07.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:43:06 smithi086 bash[24289]: cluster 2024-09-16T05:43:05.832628+0000 mgr.a (mgr.14373) 262 : cluster [DBG] pgmap v183: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-16T05:43:07.335 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:43:06 smithi047 bash[22744]: cluster 2024-09-16T05:43:05.832628+0000 mgr.a (mgr.14373) 262 : cluster [DBG] pgmap v183: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-16T05:43:07.960 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T05:43:07.960 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T05:43:07.961 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T05:43:08.696 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T05:43:08.696 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T05:43:08.696 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T05:43:08.696 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T05:43:08.696 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T05:43:09.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:43:08 smithi157 bash[24585]: cluster 2024-09-16T05:43:07.834818+0000 mgr.a (mgr.14373) 263 : cluster [DBG] pgmap v184: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-16T05:43:09.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:43:08 smithi157 bash[24585]: audit 2024-09-16T05:43:08.297860+0000 mgr.a (mgr.14373) 264 : audit [DBG] from='client.19560 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:43:09.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:43:08 smithi086 bash[24289]: cluster 2024-09-16T05:43:07.834818+0000 mgr.a (mgr.14373) 263 : cluster [DBG] pgmap v184: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-16T05:43:09.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:43:08 smithi086 bash[24289]: audit 2024-09-16T05:43:08.297860+0000 mgr.a (mgr.14373) 264 : audit [DBG] from='client.19560 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:43:09.335 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:43:08 smithi047 bash[22744]: cluster 2024-09-16T05:43:07.834818+0000 mgr.a (mgr.14373) 263 : cluster [DBG] pgmap v184: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-16T05:43:09.335 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:43:08 smithi047 bash[22744]: audit 2024-09-16T05:43:08.297860+0000 mgr.a (mgr.14373) 264 : audit [DBG] from='client.19560 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:43:11.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:43:10 smithi157 bash[24585]: cluster 2024-09-16T05:43:09.835690+0000 mgr.a (mgr.14373) 265 : cluster [DBG] pgmap v185: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:43:11.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:43:10 smithi086 bash[24289]: cluster 2024-09-16T05:43:09.835690+0000 mgr.a (mgr.14373) 265 : cluster [DBG] pgmap v185: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:43:11.336 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:43:10 smithi047 bash[22744]: cluster 2024-09-16T05:43:09.835690+0000 mgr.a (mgr.14373) 265 : cluster [DBG] pgmap v185: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:43:13.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:43:12 smithi157 bash[24585]: cluster 2024-09-16T05:43:11.837826+0000 mgr.a (mgr.14373) 266 : cluster [DBG] pgmap v186: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:43:13.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:43:12 smithi086 bash[24289]: cluster 2024-09-16T05:43:11.837826+0000 mgr.a (mgr.14373) 266 : cluster [DBG] pgmap v186: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:43:13.335 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:43:12 smithi047 bash[22744]: cluster 2024-09-16T05:43:11.837826+0000 mgr.a (mgr.14373) 266 : cluster [DBG] pgmap v186: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:43:13.697 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T05:43:13.698 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T05:43:13.698 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T05:43:14.452 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T05:43:14.452 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T05:43:14.452 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T05:43:14.452 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T05:43:14.452 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T05:43:15.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:43:14 smithi157 bash[24585]: cluster 2024-09-16T05:43:13.838575+0000 mgr.a (mgr.14373) 267 : cluster [DBG] pgmap v187: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:43:15.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:43:14 smithi157 bash[24585]: audit 2024-09-16T05:43:14.044401+0000 mgr.a (mgr.14373) 268 : audit [DBG] from='client.19635 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:43:15.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:43:14 smithi086 bash[24289]: cluster 2024-09-16T05:43:13.838575+0000 mgr.a (mgr.14373) 267 : cluster [DBG] pgmap v187: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:43:15.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:43:14 smithi086 bash[24289]: audit 2024-09-16T05:43:14.044401+0000 mgr.a (mgr.14373) 268 : audit [DBG] from='client.19635 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:43:15.335 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:43:14 smithi047 bash[22744]: cluster 2024-09-16T05:43:13.838575+0000 mgr.a (mgr.14373) 267 : cluster [DBG] pgmap v187: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:43:15.335 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:43:14 smithi047 bash[22744]: audit 2024-09-16T05:43:14.044401+0000 mgr.a (mgr.14373) 268 : audit [DBG] from='client.19635 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:43:17.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:43:16 smithi157 bash[24585]: cluster 2024-09-16T05:43:15.839454+0000 mgr.a (mgr.14373) 269 : cluster [DBG] pgmap v188: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:43:17.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:43:16 smithi086 bash[24289]: cluster 2024-09-16T05:43:15.839454+0000 mgr.a (mgr.14373) 269 : cluster [DBG] pgmap v188: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:43:17.335 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:43:16 smithi047 bash[22744]: cluster 2024-09-16T05:43:15.839454+0000 mgr.a (mgr.14373) 269 : cluster [DBG] pgmap v188: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:43:18.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:43:17 smithi157 bash[24585]: audit 2024-09-16T05:43:17.805533+0000 mon.b (mon.2) 72 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T05:43:18.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:43:17 smithi086 bash[24289]: audit 2024-09-16T05:43:17.805533+0000 mon.b (mon.2) 72 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T05:43:18.335 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:43:17 smithi047 bash[22744]: audit 2024-09-16T05:43:17.805533+0000 mon.b (mon.2) 72 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T05:43:19.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:43:18 smithi157 bash[24585]: cluster 2024-09-16T05:43:17.840884+0000 mgr.a (mgr.14373) 270 : cluster [DBG] pgmap v189: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:43:19.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:43:18 smithi157 bash[24585]: audit 2024-09-16T05:43:18.434051+0000 mon.a (mon.0) 583 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T05:43:19.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:43:18 smithi157 bash[24585]: audit 2024-09-16T05:43:18.439611+0000 mon.a (mon.0) 584 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T05:43:19.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:43:18 smithi157 bash[24585]: audit 2024-09-16T05:43:18.445882+0000 mon.a (mon.0) 585 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T05:43:19.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:43:18 smithi157 bash[24585]: audit 2024-09-16T05:43:18.455487+0000 mon.a (mon.0) 586 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T05:43:19.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:43:18 smithi086 bash[24289]: cluster 2024-09-16T05:43:17.840884+0000 mgr.a (mgr.14373) 270 : cluster [DBG] pgmap v189: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:43:19.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:43:18 smithi086 bash[24289]: audit 2024-09-16T05:43:18.434051+0000 mon.a (mon.0) 583 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T05:43:19.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:43:18 smithi086 bash[24289]: audit 2024-09-16T05:43:18.439611+0000 mon.a (mon.0) 584 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T05:43:19.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:43:18 smithi086 bash[24289]: audit 2024-09-16T05:43:18.445882+0000 mon.a (mon.0) 585 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T05:43:19.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:43:18 smithi086 bash[24289]: audit 2024-09-16T05:43:18.455487+0000 mon.a (mon.0) 586 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T05:43:19.335 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:43:18 smithi047 bash[22744]: cluster 2024-09-16T05:43:17.840884+0000 mgr.a (mgr.14373) 270 : cluster [DBG] pgmap v189: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:43:19.335 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:43:18 smithi047 bash[22744]: audit 2024-09-16T05:43:18.434051+0000 mon.a (mon.0) 583 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T05:43:19.335 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:43:18 smithi047 bash[22744]: audit 2024-09-16T05:43:18.439611+0000 mon.a (mon.0) 584 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T05:43:19.335 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:43:18 smithi047 bash[22744]: audit 2024-09-16T05:43:18.445882+0000 mon.a (mon.0) 585 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T05:43:19.335 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:43:18 smithi047 bash[22744]: audit 2024-09-16T05:43:18.455487+0000 mon.a (mon.0) 586 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T05:43:19.453 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T05:43:19.453 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T05:43:19.453 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T05:43:20.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:43:19 smithi157 bash[24585]: audit 2024-09-16T05:43:19.245635+0000 mon.b (mon.2) 73 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T05:43:20.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:43:19 smithi157 bash[24585]: audit 2024-09-16T05:43:19.247492+0000 mon.b (mon.2) 74 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T05:43:20.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:43:19 smithi157 bash[24585]: audit 2024-09-16T05:43:19.262037+0000 mon.b (mon.2) 75 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T05:43:20.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:43:19 smithi157 bash[24585]: audit 2024-09-16T05:43:19.263580+0000 mon.a (mon.0) 587 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T05:43:20.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:43:19 smithi157 bash[24585]: audit 2024-09-16T05:43:19.271249+0000 mgr.a (mgr.14373) 271 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T05:43:20.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:43:19 smithi086 bash[24289]: audit 2024-09-16T05:43:19.245635+0000 mon.b (mon.2) 73 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T05:43:20.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:43:19 smithi086 bash[24289]: audit 2024-09-16T05:43:19.247492+0000 mon.b (mon.2) 74 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T05:43:20.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:43:19 smithi086 bash[24289]: audit 2024-09-16T05:43:19.262037+0000 mon.b (mon.2) 75 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T05:43:20.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:43:19 smithi086 bash[24289]: audit 2024-09-16T05:43:19.263580+0000 mon.a (mon.0) 587 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T05:43:20.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:43:19 smithi086 bash[24289]: audit 2024-09-16T05:43:19.271249+0000 mgr.a (mgr.14373) 271 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T05:43:20.335 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 05:43:19 smithi047 bash[22994]: debug 2024-09-16T05:43:19.987+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T05:43:20.335 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 05:43:20 smithi047 bash[22994]: debug 2024-09-16T05:43:19.995+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T05:43:20.335 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:43:19 smithi047 bash[22744]: audit 2024-09-16T05:43:19.245635+0000 mon.b (mon.2) 73 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T05:43:20.335 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:43:19 smithi047 bash[22744]: audit 2024-09-16T05:43:19.247492+0000 mon.b (mon.2) 74 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T05:43:20.335 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:43:19 smithi047 bash[22744]: audit 2024-09-16T05:43:19.262037+0000 mon.b (mon.2) 75 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T05:43:20.335 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:43:19 smithi047 bash[22744]: audit 2024-09-16T05:43:19.263580+0000 mon.a (mon.0) 587 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T05:43:20.335 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:43:19 smithi047 bash[22744]: audit 2024-09-16T05:43:19.271249+0000 mgr.a (mgr.14373) 271 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T05:43:20.375 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T05:43:20.376 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T05:43:20.376 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T05:43:20.376 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T05:43:20.376 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T05:43:21.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:43:21 smithi157 bash[24585]: audit 2024-09-16T05:43:19.794121+0000 mgr.a (mgr.14373) 272 : audit [DBG] from='client.19752 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:43:21.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:43:21 smithi157 bash[24585]: cluster 2024-09-16T05:43:19.841342+0000 mgr.a (mgr.14373) 273 : cluster [DBG] pgmap v190: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:43:21.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:43:21 smithi157 bash[24585]: audit 2024-09-16T05:43:19.990374+0000 mgr.a (mgr.14373) 274 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T05:43:21.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:43:21 smithi157 bash[24585]: cephadm 2024-09-16T05:43:20.000816+0000 mgr.a (mgr.14373) 275 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T05:43:21.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:43:21 smithi086 bash[24289]: audit 2024-09-16T05:43:19.794121+0000 mgr.a (mgr.14373) 272 : audit [DBG] from='client.19752 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:43:21.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:43:21 smithi086 bash[24289]: cluster 2024-09-16T05:43:19.841342+0000 mgr.a (mgr.14373) 273 : cluster [DBG] pgmap v190: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:43:21.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:43:21 smithi086 bash[24289]: audit 2024-09-16T05:43:19.990374+0000 mgr.a (mgr.14373) 274 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T05:43:21.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:43:21 smithi086 bash[24289]: cephadm 2024-09-16T05:43:20.000816+0000 mgr.a (mgr.14373) 275 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T05:43:21.585 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:43:21 smithi047 bash[22744]: audit 2024-09-16T05:43:19.794121+0000 mgr.a (mgr.14373) 272 : audit [DBG] from='client.19752 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:43:21.585 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:43:21 smithi047 bash[22744]: cluster 2024-09-16T05:43:19.841342+0000 mgr.a (mgr.14373) 273 : cluster [DBG] pgmap v190: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:43:21.585 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:43:21 smithi047 bash[22744]: audit 2024-09-16T05:43:19.990374+0000 mgr.a (mgr.14373) 274 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T05:43:21.585 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:43:21 smithi047 bash[22744]: cephadm 2024-09-16T05:43:20.000816+0000 mgr.a (mgr.14373) 275 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T05:43:23.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:43:23 smithi157 bash[24585]: cluster 2024-09-16T05:43:21.843601+0000 mgr.a (mgr.14373) 276 : cluster [DBG] pgmap v191: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T05:43:23.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:43:23 smithi086 bash[24289]: cluster 2024-09-16T05:43:21.843601+0000 mgr.a (mgr.14373) 276 : cluster [DBG] pgmap v191: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T05:43:23.585 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:43:23 smithi047 bash[22744]: cluster 2024-09-16T05:43:21.843601+0000 mgr.a (mgr.14373) 276 : cluster [DBG] pgmap v191: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T05:43:25.377 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T05:43:25.377 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T05:43:25.378 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T05:43:25.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:43:25 smithi157 bash[24585]: cluster 2024-09-16T05:43:23.844364+0000 mgr.a (mgr.14373) 277 : cluster [DBG] pgmap v192: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T05:43:25.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:43:25 smithi086 bash[24289]: cluster 2024-09-16T05:43:23.844364+0000 mgr.a (mgr.14373) 277 : cluster [DBG] pgmap v192: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T05:43:25.585 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:43:25 smithi047 bash[22744]: cluster 2024-09-16T05:43:23.844364+0000 mgr.a (mgr.14373) 277 : cluster [DBG] pgmap v192: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T05:43:26.159 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T05:43:26.159 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T05:43:26.159 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T05:43:26.160 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T05:43:26.160 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T05:43:27.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:43:27 smithi157 bash[24585]: audit 2024-09-16T05:43:25.723181+0000 mgr.a (mgr.14373) 278 : audit [DBG] from='client.19899 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:43:27.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:43:27 smithi157 bash[24585]: cluster 2024-09-16T05:43:25.844907+0000 mgr.a (mgr.14373) 279 : cluster [DBG] pgmap v193: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T05:43:27.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:43:27 smithi086 bash[24289]: audit 2024-09-16T05:43:25.723181+0000 mgr.a (mgr.14373) 278 : audit [DBG] from='client.19899 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:43:27.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:43:27 smithi086 bash[24289]: cluster 2024-09-16T05:43:25.844907+0000 mgr.a (mgr.14373) 279 : cluster [DBG] pgmap v193: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T05:43:27.585 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:43:27 smithi047 bash[22744]: audit 2024-09-16T05:43:25.723181+0000 mgr.a (mgr.14373) 278 : audit [DBG] from='client.19899 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:43:27.585 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:43:27 smithi047 bash[22744]: cluster 2024-09-16T05:43:25.844907+0000 mgr.a (mgr.14373) 279 : cluster [DBG] pgmap v193: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T05:43:29.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:43:29 smithi157 bash[24585]: cluster 2024-09-16T05:43:27.847331+0000 mgr.a (mgr.14373) 280 : cluster [DBG] pgmap v194: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T05:43:29.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:43:29 smithi086 bash[24289]: cluster 2024-09-16T05:43:27.847331+0000 mgr.a (mgr.14373) 280 : cluster [DBG] pgmap v194: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T05:43:29.585 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:43:29 smithi047 bash[22744]: cluster 2024-09-16T05:43:27.847331+0000 mgr.a (mgr.14373) 280 : cluster [DBG] pgmap v194: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T05:43:31.160 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T05:43:31.161 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T05:43:31.161 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T05:43:31.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:43:31 smithi157 bash[24585]: cluster 2024-09-16T05:43:29.848138+0000 mgr.a (mgr.14373) 281 : cluster [DBG] pgmap v195: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T05:43:31.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:43:31 smithi086 bash[24289]: cluster 2024-09-16T05:43:29.848138+0000 mgr.a (mgr.14373) 281 : cluster [DBG] pgmap v195: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T05:43:31.584 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:43:31 smithi047 bash[22744]: cluster 2024-09-16T05:43:29.848138+0000 mgr.a (mgr.14373) 281 : cluster [DBG] pgmap v195: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T05:43:31.923 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T05:43:31.923 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T05:43:31.923 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T05:43:31.923 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T05:43:31.923 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T05:43:33.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:43:33 smithi157 bash[24585]: audit 2024-09-16T05:43:31.505351+0000 mgr.a (mgr.14373) 282 : audit [DBG] from='client.19974 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:43:33.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:43:33 smithi157 bash[24585]: cluster 2024-09-16T05:43:31.849373+0000 mgr.a (mgr.14373) 283 : cluster [DBG] pgmap v196: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T05:43:33.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:43:33 smithi086 bash[24289]: audit 2024-09-16T05:43:31.505351+0000 mgr.a (mgr.14373) 282 : audit [DBG] from='client.19974 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:43:33.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:43:33 smithi086 bash[24289]: cluster 2024-09-16T05:43:31.849373+0000 mgr.a (mgr.14373) 283 : cluster [DBG] pgmap v196: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T05:43:33.585 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:43:33 smithi047 bash[22744]: audit 2024-09-16T05:43:31.505351+0000 mgr.a (mgr.14373) 282 : audit [DBG] from='client.19974 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:43:33.585 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:43:33 smithi047 bash[22744]: cluster 2024-09-16T05:43:31.849373+0000 mgr.a (mgr.14373) 283 : cluster [DBG] pgmap v196: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T05:43:35.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:43:35 smithi157 bash[24585]: cluster 2024-09-16T05:43:33.850081+0000 mgr.a (mgr.14373) 284 : cluster [DBG] pgmap v197: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T05:43:35.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:43:35 smithi086 bash[24289]: cluster 2024-09-16T05:43:33.850081+0000 mgr.a (mgr.14373) 284 : cluster [DBG] pgmap v197: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T05:43:35.585 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:43:35 smithi047 bash[22744]: cluster 2024-09-16T05:43:33.850081+0000 mgr.a (mgr.14373) 284 : cluster [DBG] pgmap v197: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T05:43:36.924 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T05:43:36.925 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T05:43:36.925 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T05:43:37.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:43:37 smithi157 bash[24585]: cluster 2024-09-16T05:43:35.850883+0000 mgr.a (mgr.14373) 285 : cluster [DBG] pgmap v198: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T05:43:37.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:43:37 smithi086 bash[24289]: cluster 2024-09-16T05:43:35.850883+0000 mgr.a (mgr.14373) 285 : cluster [DBG] pgmap v198: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T05:43:37.584 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:43:37 smithi047 bash[22744]: cluster 2024-09-16T05:43:35.850883+0000 mgr.a (mgr.14373) 285 : cluster [DBG] pgmap v198: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T05:43:37.701 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T05:43:37.702 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T05:43:37.702 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T05:43:37.702 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T05:43:37.702 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T05:43:38.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:43:38 smithi157 bash[24585]: audit 2024-09-16T05:43:37.268633+0000 mgr.a (mgr.14373) 286 : audit [DBG] from='client.20052 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:43:38.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:43:38 smithi086 bash[24289]: audit 2024-09-16T05:43:37.268633+0000 mgr.a (mgr.14373) 286 : audit [DBG] from='client.20052 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:43:38.585 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:43:38 smithi047 bash[22744]: audit 2024-09-16T05:43:37.268633+0000 mgr.a (mgr.14373) 286 : audit [DBG] from='client.20052 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:43:39.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:43:39 smithi086 bash[24289]: cluster 2024-09-16T05:43:37.853559+0000 mgr.a (mgr.14373) 287 : cluster [DBG] pgmap v199: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:43:39.585 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:43:39 smithi047 bash[22744]: cluster 2024-09-16T05:43:37.853559+0000 mgr.a (mgr.14373) 287 : cluster [DBG] pgmap v199: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:43:39.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:43:39 smithi157 bash[24585]: cluster 2024-09-16T05:43:37.853559+0000 mgr.a (mgr.14373) 287 : cluster [DBG] pgmap v199: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:43:41.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:43:41 smithi086 bash[24289]: cluster 2024-09-16T05:43:39.854420+0000 mgr.a (mgr.14373) 288 : cluster [DBG] pgmap v200: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T05:43:41.585 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:43:41 smithi047 bash[22744]: cluster 2024-09-16T05:43:39.854420+0000 mgr.a (mgr.14373) 288 : cluster [DBG] pgmap v200: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T05:43:41.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:43:41 smithi157 bash[24585]: cluster 2024-09-16T05:43:39.854420+0000 mgr.a (mgr.14373) 288 : cluster [DBG] pgmap v200: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T05:43:42.703 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T05:43:42.704 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T05:43:42.704 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T05:43:43.441 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T05:43:43.441 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T05:43:43.441 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T05:43:43.441 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T05:43:43.441 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T05:43:43.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:43:43 smithi086 bash[24289]: cluster 2024-09-16T05:43:41.856385+0000 mgr.a (mgr.14373) 289 : cluster [DBG] pgmap v201: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:43:43.584 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:43:43 smithi047 bash[22744]: cluster 2024-09-16T05:43:41.856385+0000 mgr.a (mgr.14373) 289 : cluster [DBG] pgmap v201: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:43:43.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:43:43 smithi157 bash[24585]: cluster 2024-09-16T05:43:41.856385+0000 mgr.a (mgr.14373) 289 : cluster [DBG] pgmap v201: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:43:44.585 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:43:44 smithi047 bash[22744]: audit 2024-09-16T05:43:43.039319+0000 mgr.a (mgr.14373) 290 : audit [DBG] from='client.20127 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:43:44.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:43:44 smithi157 bash[24585]: audit 2024-09-16T05:43:43.039319+0000 mgr.a (mgr.14373) 290 : audit [DBG] from='client.20127 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:43:44.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:43:44 smithi086 bash[24289]: audit 2024-09-16T05:43:43.039319+0000 mgr.a (mgr.14373) 290 : audit [DBG] from='client.20127 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:43:45.585 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:43:45 smithi047 bash[22744]: cluster 2024-09-16T05:43:43.857471+0000 mgr.a (mgr.14373) 291 : cluster [DBG] pgmap v202: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:43:45.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:43:45 smithi157 bash[24585]: cluster 2024-09-16T05:43:43.857471+0000 mgr.a (mgr.14373) 291 : cluster [DBG] pgmap v202: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:43:45.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:43:45 smithi086 bash[24289]: cluster 2024-09-16T05:43:43.857471+0000 mgr.a (mgr.14373) 291 : cluster [DBG] pgmap v202: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:43:47.585 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:43:47 smithi047 bash[22744]: cluster 2024-09-16T05:43:45.858323+0000 mgr.a (mgr.14373) 292 : cluster [DBG] pgmap v203: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:43:47.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:43:47 smithi157 bash[24585]: cluster 2024-09-16T05:43:45.858323+0000 mgr.a (mgr.14373) 292 : cluster [DBG] pgmap v203: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:43:47.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:43:47 smithi086 bash[24289]: cluster 2024-09-16T05:43:45.858323+0000 mgr.a (mgr.14373) 292 : cluster [DBG] pgmap v203: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:43:48.442 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T05:43:48.443 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T05:43:48.443 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T05:43:49.213 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T05:43:49.213 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T05:43:49.213 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T05:43:49.214 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T05:43:49.214 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T05:43:49.584 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:43:49 smithi047 bash[22744]: cluster 2024-09-16T05:43:47.860583+0000 mgr.a (mgr.14373) 293 : cluster [DBG] pgmap v204: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:43:49.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:43:49 smithi157 bash[24585]: cluster 2024-09-16T05:43:47.860583+0000 mgr.a (mgr.14373) 293 : cluster [DBG] pgmap v204: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:43:49.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:43:49 smithi086 bash[24289]: cluster 2024-09-16T05:43:47.860583+0000 mgr.a (mgr.14373) 293 : cluster [DBG] pgmap v204: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:43:50.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:43:50 smithi157 bash[24585]: audit 2024-09-16T05:43:48.785736+0000 mgr.a (mgr.14373) 294 : audit [DBG] from='client.20205 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:43:50.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:43:50 smithi086 bash[24289]: audit 2024-09-16T05:43:48.785736+0000 mgr.a (mgr.14373) 294 : audit [DBG] from='client.20205 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:43:50.834 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:43:50 smithi047 bash[22744]: audit 2024-09-16T05:43:48.785736+0000 mgr.a (mgr.14373) 294 : audit [DBG] from='client.20205 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:43:51.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:43:51 smithi157 bash[24585]: cluster 2024-09-16T05:43:49.861557+0000 mgr.a (mgr.14373) 295 : cluster [DBG] pgmap v205: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:43:51.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:43:51 smithi086 bash[24289]: cluster 2024-09-16T05:43:49.861557+0000 mgr.a (mgr.14373) 295 : cluster [DBG] pgmap v205: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:43:51.834 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:43:51 smithi047 bash[22744]: cluster 2024-09-16T05:43:49.861557+0000 mgr.a (mgr.14373) 295 : cluster [DBG] pgmap v205: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:43:53.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:43:53 smithi157 bash[24585]: cluster 2024-09-16T05:43:51.863823+0000 mgr.a (mgr.14373) 296 : cluster [DBG] pgmap v206: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:43:53.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:43:53 smithi086 bash[24289]: cluster 2024-09-16T05:43:51.863823+0000 mgr.a (mgr.14373) 296 : cluster [DBG] pgmap v206: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:43:53.834 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:43:53 smithi047 bash[22744]: cluster 2024-09-16T05:43:51.863823+0000 mgr.a (mgr.14373) 296 : cluster [DBG] pgmap v206: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:43:54.214 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T05:43:54.215 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T05:43:54.215 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T05:43:54.982 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T05:43:54.982 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T05:43:54.982 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T05:43:54.982 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T05:43:54.982 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T05:43:55.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:43:55 smithi157 bash[24585]: cluster 2024-09-16T05:43:53.864609+0000 mgr.a (mgr.14373) 297 : cluster [DBG] pgmap v207: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:43:55.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:43:55 smithi086 bash[24289]: cluster 2024-09-16T05:43:53.864609+0000 mgr.a (mgr.14373) 297 : cluster [DBG] pgmap v207: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:43:55.834 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:43:55 smithi047 bash[22744]: cluster 2024-09-16T05:43:53.864609+0000 mgr.a (mgr.14373) 297 : cluster [DBG] pgmap v207: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:43:56.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:43:56 smithi157 bash[24585]: audit 2024-09-16T05:43:54.563936+0000 mgr.a (mgr.14373) 298 : audit [DBG] from='client.20280 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:43:56.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:43:56 smithi086 bash[24289]: audit 2024-09-16T05:43:54.563936+0000 mgr.a (mgr.14373) 298 : audit [DBG] from='client.20280 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:43:56.834 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:43:56 smithi047 bash[22744]: audit 2024-09-16T05:43:54.563936+0000 mgr.a (mgr.14373) 298 : audit [DBG] from='client.20280 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:43:57.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:43:57 smithi157 bash[24585]: cluster 2024-09-16T05:43:55.865579+0000 mgr.a (mgr.14373) 299 : cluster [DBG] pgmap v208: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:43:57.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:43:57 smithi086 bash[24289]: cluster 2024-09-16T05:43:55.865579+0000 mgr.a (mgr.14373) 299 : cluster [DBG] pgmap v208: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:43:57.834 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:43:57 smithi047 bash[22744]: cluster 2024-09-16T05:43:55.865579+0000 mgr.a (mgr.14373) 299 : cluster [DBG] pgmap v208: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:43:59.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:43:59 smithi157 bash[24585]: cluster 2024-09-16T05:43:57.867846+0000 mgr.a (mgr.14373) 300 : cluster [DBG] pgmap v209: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:43:59.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:43:59 smithi086 bash[24289]: cluster 2024-09-16T05:43:57.867846+0000 mgr.a (mgr.14373) 300 : cluster [DBG] pgmap v209: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:43:59.834 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:43:59 smithi047 bash[22744]: cluster 2024-09-16T05:43:57.867846+0000 mgr.a (mgr.14373) 300 : cluster [DBG] pgmap v209: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:43:59.983 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T05:43:59.984 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T05:43:59.984 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T05:44:00.734 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T05:44:00.734 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T05:44:00.734 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T05:44:00.735 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T05:44:00.735 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T05:44:00.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:44:00 smithi157 bash[24585]: cluster 2024-09-16T05:43:59.868614+0000 mgr.a (mgr.14373) 301 : cluster [DBG] pgmap v210: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:44:00.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:44:00 smithi157 bash[24585]: audit 2024-09-16T05:44:00.321552+0000 mgr.a (mgr.14373) 302 : audit [DBG] from='client.20355 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:44:00.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:44:00 smithi086 bash[24289]: cluster 2024-09-16T05:43:59.868614+0000 mgr.a (mgr.14373) 301 : cluster [DBG] pgmap v210: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:44:00.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:44:00 smithi086 bash[24289]: audit 2024-09-16T05:44:00.321552+0000 mgr.a (mgr.14373) 302 : audit [DBG] from='client.20355 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:44:00.834 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:44:00 smithi047 bash[22744]: cluster 2024-09-16T05:43:59.868614+0000 mgr.a (mgr.14373) 301 : cluster [DBG] pgmap v210: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:44:00.835 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:44:00 smithi047 bash[22744]: audit 2024-09-16T05:44:00.321552+0000 mgr.a (mgr.14373) 302 : audit [DBG] from='client.20355 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:44:03.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:44:02 smithi157 bash[24585]: cluster 2024-09-16T05:44:01.870977+0000 mgr.a (mgr.14373) 303 : cluster [DBG] pgmap v211: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:44:03.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:44:02 smithi086 bash[24289]: cluster 2024-09-16T05:44:01.870977+0000 mgr.a (mgr.14373) 303 : cluster [DBG] pgmap v211: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:44:03.334 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:44:02 smithi047 bash[22744]: cluster 2024-09-16T05:44:01.870977+0000 mgr.a (mgr.14373) 303 : cluster [DBG] pgmap v211: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:44:05.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:44:04 smithi157 bash[24585]: cluster 2024-09-16T05:44:03.871784+0000 mgr.a (mgr.14373) 304 : cluster [DBG] pgmap v212: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:44:05.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:44:04 smithi086 bash[24289]: cluster 2024-09-16T05:44:03.871784+0000 mgr.a (mgr.14373) 304 : cluster [DBG] pgmap v212: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:44:05.334 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:44:04 smithi047 bash[22744]: cluster 2024-09-16T05:44:03.871784+0000 mgr.a (mgr.14373) 304 : cluster [DBG] pgmap v212: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:44:05.736 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T05:44:05.737 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T05:44:05.737 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T05:44:06.505 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T05:44:06.506 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T05:44:06.506 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T05:44:06.506 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T05:44:06.506 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T05:44:07.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:44:06 smithi157 bash[24585]: cluster 2024-09-16T05:44:05.872246+0000 mgr.a (mgr.14373) 305 : cluster [DBG] pgmap v213: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:44:07.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:44:06 smithi157 bash[24585]: audit 2024-09-16T05:44:06.078220+0000 mgr.a (mgr.14373) 306 : audit [DBG] from='client.20430 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:44:07.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:44:06 smithi086 bash[24289]: cluster 2024-09-16T05:44:05.872246+0000 mgr.a (mgr.14373) 305 : cluster [DBG] pgmap v213: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:44:07.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:44:06 smithi086 bash[24289]: audit 2024-09-16T05:44:06.078220+0000 mgr.a (mgr.14373) 306 : audit [DBG] from='client.20430 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:44:07.334 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:44:06 smithi047 bash[22744]: cluster 2024-09-16T05:44:05.872246+0000 mgr.a (mgr.14373) 305 : cluster [DBG] pgmap v213: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:44:07.334 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:44:06 smithi047 bash[22744]: audit 2024-09-16T05:44:06.078220+0000 mgr.a (mgr.14373) 306 : audit [DBG] from='client.20430 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:44:09.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:44:08 smithi157 bash[24585]: cluster 2024-09-16T05:44:07.874684+0000 mgr.a (mgr.14373) 307 : cluster [DBG] pgmap v214: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-16T05:44:09.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:44:08 smithi086 bash[24289]: cluster 2024-09-16T05:44:07.874684+0000 mgr.a (mgr.14373) 307 : cluster [DBG] pgmap v214: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-16T05:44:09.334 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:44:08 smithi047 bash[22744]: cluster 2024-09-16T05:44:07.874684+0000 mgr.a (mgr.14373) 307 : cluster [DBG] pgmap v214: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-16T05:44:11.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:44:10 smithi157 bash[24585]: cluster 2024-09-16T05:44:09.875475+0000 mgr.a (mgr.14373) 308 : cluster [DBG] pgmap v215: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T05:44:11.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:44:10 smithi086 bash[24289]: cluster 2024-09-16T05:44:09.875475+0000 mgr.a (mgr.14373) 308 : cluster [DBG] pgmap v215: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T05:44:11.334 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:44:10 smithi047 bash[22744]: cluster 2024-09-16T05:44:09.875475+0000 mgr.a (mgr.14373) 308 : cluster [DBG] pgmap v215: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T05:44:11.507 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T05:44:11.507 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T05:44:11.508 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T05:44:12.261 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T05:44:12.261 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T05:44:12.261 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T05:44:12.261 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T05:44:12.261 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T05:44:13.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:44:12 smithi157 bash[24585]: audit 2024-09-16T05:44:11.853648+0000 mgr.a (mgr.14373) 309 : audit [DBG] from='client.20505 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:44:13.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:44:12 smithi157 bash[24585]: cluster 2024-09-16T05:44:11.877845+0000 mgr.a (mgr.14373) 310 : cluster [DBG] pgmap v216: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:44:13.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:44:12 smithi086 bash[24289]: audit 2024-09-16T05:44:11.853648+0000 mgr.a (mgr.14373) 309 : audit [DBG] from='client.20505 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:44:13.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:44:12 smithi086 bash[24289]: cluster 2024-09-16T05:44:11.877845+0000 mgr.a (mgr.14373) 310 : cluster [DBG] pgmap v216: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:44:13.334 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:44:12 smithi047 bash[22744]: audit 2024-09-16T05:44:11.853648+0000 mgr.a (mgr.14373) 309 : audit [DBG] from='client.20505 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:44:13.334 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:44:12 smithi047 bash[22744]: cluster 2024-09-16T05:44:11.877845+0000 mgr.a (mgr.14373) 310 : cluster [DBG] pgmap v216: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:44:15.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:44:14 smithi157 bash[24585]: cluster 2024-09-16T05:44:13.878777+0000 mgr.a (mgr.14373) 311 : cluster [DBG] pgmap v217: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T05:44:15.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:44:14 smithi086 bash[24289]: cluster 2024-09-16T05:44:13.878777+0000 mgr.a (mgr.14373) 311 : cluster [DBG] pgmap v217: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T05:44:15.334 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:44:14 smithi047 bash[22744]: cluster 2024-09-16T05:44:13.878777+0000 mgr.a (mgr.14373) 311 : cluster [DBG] pgmap v217: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T05:44:17.262 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T05:44:17.263 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T05:44:17.263 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T05:44:17.301 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:44:16 smithi157 bash[24585]: cluster 2024-09-16T05:44:15.879602+0000 mgr.a (mgr.14373) 312 : cluster [DBG] pgmap v218: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T05:44:17.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:44:16 smithi086 bash[24289]: cluster 2024-09-16T05:44:15.879602+0000 mgr.a (mgr.14373) 312 : cluster [DBG] pgmap v218: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T05:44:17.334 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:44:16 smithi047 bash[22744]: cluster 2024-09-16T05:44:15.879602+0000 mgr.a (mgr.14373) 312 : cluster [DBG] pgmap v218: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T05:44:18.026 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T05:44:18.027 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T05:44:18.027 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T05:44:18.027 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T05:44:18.027 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T05:44:19.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:44:18 smithi157 bash[24585]: audit 2024-09-16T05:44:17.602930+0000 mgr.a (mgr.14373) 313 : audit [DBG] from='client.20583 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:44:19.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:44:18 smithi157 bash[24585]: cluster 2024-09-16T05:44:17.881591+0000 mgr.a (mgr.14373) 314 : cluster [DBG] pgmap v219: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:44:19.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:44:18 smithi086 bash[24289]: audit 2024-09-16T05:44:17.602930+0000 mgr.a (mgr.14373) 313 : audit [DBG] from='client.20583 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:44:19.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:44:18 smithi086 bash[24289]: cluster 2024-09-16T05:44:17.881591+0000 mgr.a (mgr.14373) 314 : cluster [DBG] pgmap v219: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:44:19.334 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:44:18 smithi047 bash[22744]: audit 2024-09-16T05:44:17.602930+0000 mgr.a (mgr.14373) 313 : audit [DBG] from='client.20583 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:44:19.334 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:44:18 smithi047 bash[22744]: cluster 2024-09-16T05:44:17.881591+0000 mgr.a (mgr.14373) 314 : cluster [DBG] pgmap v219: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:44:21.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:44:20 smithi157 bash[24585]: cluster 2024-09-16T05:44:19.882514+0000 mgr.a (mgr.14373) 315 : cluster [DBG] pgmap v220: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-16T05:44:21.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:44:20 smithi157 bash[24585]: audit 2024-09-16T05:44:20.046310+0000 mon.b (mon.2) 76 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T05:44:21.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:44:20 smithi157 bash[24585]: audit 2024-09-16T05:44:20.889018+0000 mon.b (mon.2) 77 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T05:44:21.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:44:20 smithi157 bash[24585]: audit 2024-09-16T05:44:20.891316+0000 mon.b (mon.2) 78 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T05:44:21.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:44:20 smithi157 bash[24585]: audit 2024-09-16T05:44:20.907845+0000 mon.b (mon.2) 79 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T05:44:21.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:44:20 smithi157 bash[24585]: audit 2024-09-16T05:44:20.910070+0000 mon.a (mon.0) 588 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T05:44:21.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:44:20 smithi086 bash[24289]: cluster 2024-09-16T05:44:19.882514+0000 mgr.a (mgr.14373) 315 : cluster [DBG] pgmap v220: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-16T05:44:21.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:44:20 smithi086 bash[24289]: audit 2024-09-16T05:44:20.046310+0000 mon.b (mon.2) 76 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T05:44:21.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:44:20 smithi086 bash[24289]: audit 2024-09-16T05:44:20.889018+0000 mon.b (mon.2) 77 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T05:44:21.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:44:20 smithi086 bash[24289]: audit 2024-09-16T05:44:20.891316+0000 mon.b (mon.2) 78 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T05:44:21.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:44:20 smithi086 bash[24289]: audit 2024-09-16T05:44:20.907845+0000 mon.b (mon.2) 79 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T05:44:21.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:44:20 smithi086 bash[24289]: audit 2024-09-16T05:44:20.910070+0000 mon.a (mon.0) 588 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T05:44:21.334 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:44:20 smithi047 bash[22744]: cluster 2024-09-16T05:44:19.882514+0000 mgr.a (mgr.14373) 315 : cluster [DBG] pgmap v220: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-16T05:44:21.334 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:44:20 smithi047 bash[22744]: audit 2024-09-16T05:44:20.046310+0000 mon.b (mon.2) 76 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T05:44:21.334 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:44:20 smithi047 bash[22744]: audit 2024-09-16T05:44:20.889018+0000 mon.b (mon.2) 77 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T05:44:21.334 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:44:20 smithi047 bash[22744]: audit 2024-09-16T05:44:20.891316+0000 mon.b (mon.2) 78 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T05:44:21.334 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:44:20 smithi047 bash[22744]: audit 2024-09-16T05:44:20.907845+0000 mon.b (mon.2) 79 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T05:44:21.334 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:44:20 smithi047 bash[22744]: audit 2024-09-16T05:44:20.910070+0000 mon.a (mon.0) 588 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T05:44:21.968 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 05:44:21 smithi047 bash[22994]: debug 2024-09-16T05:44:21.619+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T05:44:21.968 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 05:44:21 smithi047 bash[22994]: debug 2024-09-16T05:44:21.619+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T05:44:22.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:44:21 smithi157 bash[24585]: audit 2024-09-16T05:44:20.917489+0000 mgr.a (mgr.14373) 316 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T05:44:22.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:44:21 smithi086 bash[24289]: audit 2024-09-16T05:44:20.917489+0000 mgr.a (mgr.14373) 316 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T05:44:22.334 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:44:21 smithi047 bash[22744]: audit 2024-09-16T05:44:20.917489+0000 mgr.a (mgr.14373) 316 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T05:44:23.028 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T05:44:23.028 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T05:44:23.029 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T05:44:23.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:44:22 smithi157 bash[24585]: audit 2024-09-16T05:44:21.623174+0000 mgr.a (mgr.14373) 317 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T05:44:23.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:44:22 smithi157 bash[24585]: cephadm 2024-09-16T05:44:21.625404+0000 mgr.a (mgr.14373) 318 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T05:44:23.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:44:22 smithi157 bash[24585]: cluster 2024-09-16T05:44:21.885045+0000 mgr.a (mgr.14373) 319 : cluster [DBG] pgmap v221: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 4.2 KiB/s rd, 255 B/s wr, 4 op/s 2024-09-16T05:44:23.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:44:22 smithi086 bash[24289]: audit 2024-09-16T05:44:21.623174+0000 mgr.a (mgr.14373) 317 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T05:44:23.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:44:22 smithi086 bash[24289]: cephadm 2024-09-16T05:44:21.625404+0000 mgr.a (mgr.14373) 318 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T05:44:23.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:44:22 smithi086 bash[24289]: cluster 2024-09-16T05:44:21.885045+0000 mgr.a (mgr.14373) 319 : cluster [DBG] pgmap v221: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 4.2 KiB/s rd, 255 B/s wr, 4 op/s 2024-09-16T05:44:23.334 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:44:22 smithi047 bash[22744]: audit 2024-09-16T05:44:21.623174+0000 mgr.a (mgr.14373) 317 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T05:44:23.334 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:44:22 smithi047 bash[22744]: cephadm 2024-09-16T05:44:21.625404+0000 mgr.a (mgr.14373) 318 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T05:44:23.334 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:44:22 smithi047 bash[22744]: cluster 2024-09-16T05:44:21.885045+0000 mgr.a (mgr.14373) 319 : cluster [DBG] pgmap v221: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 4.2 KiB/s rd, 255 B/s wr, 4 op/s 2024-09-16T05:44:23.801 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T05:44:23.801 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T05:44:23.801 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T05:44:23.801 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T05:44:23.802 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T05:44:24.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:44:23 smithi157 bash[24585]: audit 2024-09-16T05:44:23.376451+0000 mgr.a (mgr.14373) 320 : audit [DBG] from='client.20763 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:44:24.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:44:23 smithi086 bash[24289]: audit 2024-09-16T05:44:23.376451+0000 mgr.a (mgr.14373) 320 : audit [DBG] from='client.20763 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:44:24.334 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:44:23 smithi047 bash[22744]: audit 2024-09-16T05:44:23.376451+0000 mgr.a (mgr.14373) 320 : audit [DBG] from='client.20763 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:44:25.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:44:24 smithi157 bash[24585]: cluster 2024-09-16T05:44:23.886044+0000 mgr.a (mgr.14373) 321 : cluster [DBG] pgmap v222: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 3.7 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-16T05:44:25.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:44:24 smithi086 bash[24289]: cluster 2024-09-16T05:44:23.886044+0000 mgr.a (mgr.14373) 321 : cluster [DBG] pgmap v222: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 3.7 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-16T05:44:25.334 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:44:24 smithi047 bash[22744]: cluster 2024-09-16T05:44:23.886044+0000 mgr.a (mgr.14373) 321 : cluster [DBG] pgmap v222: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 3.7 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-16T05:44:27.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:44:26 smithi157 bash[24585]: cluster 2024-09-16T05:44:25.886844+0000 mgr.a (mgr.14373) 322 : cluster [DBG] pgmap v223: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 3.7 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-16T05:44:27.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:44:26 smithi086 bash[24289]: cluster 2024-09-16T05:44:25.886844+0000 mgr.a (mgr.14373) 322 : cluster [DBG] pgmap v223: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 3.7 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-16T05:44:27.334 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:44:26 smithi047 bash[22744]: cluster 2024-09-16T05:44:25.886844+0000 mgr.a (mgr.14373) 322 : cluster [DBG] pgmap v223: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 3.7 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-16T05:44:28.804 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T05:44:28.804 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T05:44:28.804 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T05:44:29.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:44:28 smithi157 bash[24585]: cluster 2024-09-16T05:44:27.889179+0000 mgr.a (mgr.14373) 323 : cluster [DBG] pgmap v224: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T05:44:29.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:44:28 smithi086 bash[24289]: cluster 2024-09-16T05:44:27.889179+0000 mgr.a (mgr.14373) 323 : cluster [DBG] pgmap v224: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T05:44:29.334 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:44:28 smithi047 bash[22744]: cluster 2024-09-16T05:44:27.889179+0000 mgr.a (mgr.14373) 323 : cluster [DBG] pgmap v224: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T05:44:29.566 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T05:44:29.566 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T05:44:29.566 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T05:44:29.566 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T05:44:29.566 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T05:44:30.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:44:29 smithi157 bash[24585]: audit 2024-09-16T05:44:29.144495+0000 mgr.a (mgr.14373) 324 : audit [DBG] from='client.20838 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:44:30.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:44:29 smithi086 bash[24289]: audit 2024-09-16T05:44:29.144495+0000 mgr.a (mgr.14373) 324 : audit [DBG] from='client.20838 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:44:30.334 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:44:29 smithi047 bash[22744]: audit 2024-09-16T05:44:29.144495+0000 mgr.a (mgr.14373) 324 : audit [DBG] from='client.20838 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:44:31.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:44:31 smithi157 bash[24585]: cluster 2024-09-16T05:44:29.890199+0000 mgr.a (mgr.14373) 325 : cluster [DBG] pgmap v225: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T05:44:31.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:44:31 smithi086 bash[24289]: cluster 2024-09-16T05:44:29.890199+0000 mgr.a (mgr.14373) 325 : cluster [DBG] pgmap v225: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T05:44:31.334 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:44:31 smithi047 bash[22744]: cluster 2024-09-16T05:44:29.890199+0000 mgr.a (mgr.14373) 325 : cluster [DBG] pgmap v225: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T05:44:33.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:44:33 smithi157 bash[24585]: cluster 2024-09-16T05:44:31.892348+0000 mgr.a (mgr.14373) 326 : cluster [DBG] pgmap v226: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T05:44:33.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:44:33 smithi086 bash[24289]: cluster 2024-09-16T05:44:31.892348+0000 mgr.a (mgr.14373) 326 : cluster [DBG] pgmap v226: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T05:44:33.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:44:33 smithi047 bash[22744]: cluster 2024-09-16T05:44:31.892348+0000 mgr.a (mgr.14373) 326 : cluster [DBG] pgmap v226: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T05:44:34.566 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T05:44:34.566 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T05:44:34.566 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T05:44:35.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:44:35 smithi157 bash[24585]: cluster 2024-09-16T05:44:33.893131+0000 mgr.a (mgr.14373) 327 : cluster [DBG] pgmap v227: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 5.1 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-16T05:44:35.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:44:35 smithi086 bash[24289]: cluster 2024-09-16T05:44:33.893131+0000 mgr.a (mgr.14373) 327 : cluster [DBG] pgmap v227: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 5.1 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-16T05:44:35.334 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T05:44:35.334 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T05:44:35.334 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T05:44:35.334 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T05:44:35.334 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T05:44:35.335 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:44:35 smithi047 bash[22744]: cluster 2024-09-16T05:44:33.893131+0000 mgr.a (mgr.14373) 327 : cluster [DBG] pgmap v227: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 5.1 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-16T05:44:36.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:44:36 smithi157 bash[24585]: audit 2024-09-16T05:44:34.905985+0000 mgr.a (mgr.14373) 328 : audit [DBG] from='client.20916 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:44:36.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:44:36 smithi086 bash[24289]: audit 2024-09-16T05:44:34.905985+0000 mgr.a (mgr.14373) 328 : audit [DBG] from='client.20916 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:44:36.334 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:44:36 smithi047 bash[22744]: audit 2024-09-16T05:44:34.905985+0000 mgr.a (mgr.14373) 328 : audit [DBG] from='client.20916 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:44:37.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:44:37 smithi157 bash[24585]: cluster 2024-09-16T05:44:35.894259+0000 mgr.a (mgr.14373) 329 : cluster [DBG] pgmap v228: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 5.1 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-16T05:44:37.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:44:37 smithi086 bash[24289]: cluster 2024-09-16T05:44:35.894259+0000 mgr.a (mgr.14373) 329 : cluster [DBG] pgmap v228: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 5.1 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-16T05:44:37.334 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:44:37 smithi047 bash[22744]: cluster 2024-09-16T05:44:35.894259+0000 mgr.a (mgr.14373) 329 : cluster [DBG] pgmap v228: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 5.1 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-16T05:44:39.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:44:39 smithi157 bash[24585]: cluster 2024-09-16T05:44:37.896636+0000 mgr.a (mgr.14373) 330 : cluster [DBG] pgmap v229: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 6.0 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-16T05:44:39.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:44:39 smithi086 bash[24289]: cluster 2024-09-16T05:44:37.896636+0000 mgr.a (mgr.14373) 330 : cluster [DBG] pgmap v229: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 6.0 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-16T05:44:39.334 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:44:39 smithi047 bash[22744]: cluster 2024-09-16T05:44:37.896636+0000 mgr.a (mgr.14373) 330 : cluster [DBG] pgmap v229: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 6.0 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-16T05:44:40.335 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T05:44:40.336 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T05:44:40.336 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T05:44:41.102 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T05:44:41.102 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T05:44:41.102 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T05:44:41.102 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T05:44:41.103 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T05:44:41.301 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:44:41 smithi157 bash[24585]: cluster 2024-09-16T05:44:39.897565+0000 mgr.a (mgr.14373) 331 : cluster [DBG] pgmap v230: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:44:41.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:44:41 smithi086 bash[24289]: cluster 2024-09-16T05:44:39.897565+0000 mgr.a (mgr.14373) 331 : cluster [DBG] pgmap v230: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:44:41.334 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:44:41 smithi047 bash[22744]: cluster 2024-09-16T05:44:39.897565+0000 mgr.a (mgr.14373) 331 : cluster [DBG] pgmap v230: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:44:42.301 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:44:42 smithi157 bash[24585]: audit 2024-09-16T05:44:40.688670+0000 mgr.a (mgr.14373) 332 : audit [DBG] from='client.20994 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:44:42.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:44:42 smithi086 bash[24289]: audit 2024-09-16T05:44:40.688670+0000 mgr.a (mgr.14373) 332 : audit [DBG] from='client.20994 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:44:42.334 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:44:42 smithi047 bash[22744]: audit 2024-09-16T05:44:40.688670+0000 mgr.a (mgr.14373) 332 : audit [DBG] from='client.20994 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:44:43.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:44:43 smithi157 bash[24585]: cluster 2024-09-16T05:44:41.900078+0000 mgr.a (mgr.14373) 333 : cluster [DBG] pgmap v231: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:44:43.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:44:43 smithi086 bash[24289]: cluster 2024-09-16T05:44:41.900078+0000 mgr.a (mgr.14373) 333 : cluster [DBG] pgmap v231: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:44:43.334 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:44:43 smithi047 bash[22744]: cluster 2024-09-16T05:44:41.900078+0000 mgr.a (mgr.14373) 333 : cluster [DBG] pgmap v231: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:44:45.301 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:44:45 smithi157 bash[24585]: cluster 2024-09-16T05:44:43.900900+0000 mgr.a (mgr.14373) 334 : cluster [DBG] pgmap v232: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:44:45.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:44:45 smithi086 bash[24289]: cluster 2024-09-16T05:44:43.900900+0000 mgr.a (mgr.14373) 334 : cluster [DBG] pgmap v232: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:44:45.334 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:44:45 smithi047 bash[22744]: cluster 2024-09-16T05:44:43.900900+0000 mgr.a (mgr.14373) 334 : cluster [DBG] pgmap v232: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:44:46.103 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T05:44:46.104 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T05:44:46.104 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T05:44:46.846 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T05:44:46.846 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T05:44:46.846 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T05:44:46.846 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T05:44:46.846 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T05:44:47.301 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:44:47 smithi157 bash[24585]: cluster 2024-09-16T05:44:45.901672+0000 mgr.a (mgr.14373) 335 : cluster [DBG] pgmap v233: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:44:47.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:44:47 smithi086 bash[24289]: cluster 2024-09-16T05:44:45.901672+0000 mgr.a (mgr.14373) 335 : cluster [DBG] pgmap v233: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:44:47.334 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:44:47 smithi047 bash[22744]: cluster 2024-09-16T05:44:45.901672+0000 mgr.a (mgr.14373) 335 : cluster [DBG] pgmap v233: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:44:48.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:44:48 smithi086 bash[24289]: audit 2024-09-16T05:44:46.445211+0000 mgr.a (mgr.14373) 336 : audit [DBG] from='client.21072 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:44:48.334 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:44:48 smithi047 bash[22744]: audit 2024-09-16T05:44:46.445211+0000 mgr.a (mgr.14373) 336 : audit [DBG] from='client.21072 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:44:48.551 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:44:48 smithi157 bash[24585]: audit 2024-09-16T05:44:46.445211+0000 mgr.a (mgr.14373) 336 : audit [DBG] from='client.21072 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:44:49.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:44:49 smithi086 bash[24289]: cluster 2024-09-16T05:44:47.904364+0000 mgr.a (mgr.14373) 337 : cluster [DBG] pgmap v234: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:44:49.334 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:44:49 smithi047 bash[22744]: cluster 2024-09-16T05:44:47.904364+0000 mgr.a (mgr.14373) 337 : cluster [DBG] pgmap v234: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:44:49.551 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:44:49 smithi157 bash[24585]: cluster 2024-09-16T05:44:47.904364+0000 mgr.a (mgr.14373) 337 : cluster [DBG] pgmap v234: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:44:51.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:44:51 smithi086 bash[24289]: cluster 2024-09-16T05:44:49.905180+0000 mgr.a (mgr.14373) 338 : cluster [DBG] pgmap v235: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T05:44:51.334 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:44:51 smithi047 bash[22744]: cluster 2024-09-16T05:44:49.905180+0000 mgr.a (mgr.14373) 338 : cluster [DBG] pgmap v235: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T05:44:51.551 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:44:51 smithi157 bash[24585]: cluster 2024-09-16T05:44:49.905180+0000 mgr.a (mgr.14373) 338 : cluster [DBG] pgmap v235: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T05:44:51.848 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T05:44:51.848 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T05:44:51.849 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T05:44:52.620 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T05:44:52.621 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T05:44:52.621 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T05:44:52.621 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T05:44:52.621 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T05:44:53.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:44:53 smithi086 bash[24289]: cluster 2024-09-16T05:44:51.906571+0000 mgr.a (mgr.14373) 339 : cluster [DBG] pgmap v236: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:44:53.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:44:53 smithi086 bash[24289]: audit 2024-09-16T05:44:52.194550+0000 mgr.a (mgr.14373) 340 : audit [DBG] from='client.21150 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:44:53.334 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:44:53 smithi047 bash[22744]: cluster 2024-09-16T05:44:51.906571+0000 mgr.a (mgr.14373) 339 : cluster [DBG] pgmap v236: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:44:53.334 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:44:53 smithi047 bash[22744]: audit 2024-09-16T05:44:52.194550+0000 mgr.a (mgr.14373) 340 : audit [DBG] from='client.21150 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:44:53.551 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:44:53 smithi157 bash[24585]: cluster 2024-09-16T05:44:51.906571+0000 mgr.a (mgr.14373) 339 : cluster [DBG] pgmap v236: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:44:53.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:44:53 smithi157 bash[24585]: audit 2024-09-16T05:44:52.194550+0000 mgr.a (mgr.14373) 340 : audit [DBG] from='client.21150 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:44:55.334 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:44:55 smithi047 bash[22744]: cluster 2024-09-16T05:44:53.907455+0000 mgr.a (mgr.14373) 341 : cluster [DBG] pgmap v237: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T05:44:55.551 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:44:55 smithi157 bash[24585]: cluster 2024-09-16T05:44:53.907455+0000 mgr.a (mgr.14373) 341 : cluster [DBG] pgmap v237: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T05:44:55.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:44:55 smithi086 bash[24289]: cluster 2024-09-16T05:44:53.907455+0000 mgr.a (mgr.14373) 341 : cluster [DBG] pgmap v237: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T05:44:57.334 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:44:57 smithi047 bash[22744]: cluster 2024-09-16T05:44:55.908254+0000 mgr.a (mgr.14373) 342 : cluster [DBG] pgmap v238: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T05:44:57.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:44:57 smithi157 bash[24585]: cluster 2024-09-16T05:44:55.908254+0000 mgr.a (mgr.14373) 342 : cluster [DBG] pgmap v238: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T05:44:57.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:44:57 smithi086 bash[24289]: cluster 2024-09-16T05:44:55.908254+0000 mgr.a (mgr.14373) 342 : cluster [DBG] pgmap v238: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T05:44:57.622 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T05:44:57.623 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T05:44:57.623 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T05:44:58.385 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T05:44:58.385 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T05:44:58.385 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T05:44:58.385 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T05:44:58.386 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T05:44:59.334 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:44:59 smithi047 bash[22744]: cluster 2024-09-16T05:44:57.910391+0000 mgr.a (mgr.14373) 343 : cluster [DBG] pgmap v239: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:44:59.334 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:44:59 smithi047 bash[22744]: audit 2024-09-16T05:44:57.976832+0000 mgr.a (mgr.14373) 344 : audit [DBG] from='client.21228 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:44:59.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:44:59 smithi157 bash[24585]: cluster 2024-09-16T05:44:57.910391+0000 mgr.a (mgr.14373) 343 : cluster [DBG] pgmap v239: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:44:59.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:44:59 smithi157 bash[24585]: audit 2024-09-16T05:44:57.976832+0000 mgr.a (mgr.14373) 344 : audit [DBG] from='client.21228 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:44:59.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:44:59 smithi086 bash[24289]: cluster 2024-09-16T05:44:57.910391+0000 mgr.a (mgr.14373) 343 : cluster [DBG] pgmap v239: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:44:59.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:44:59 smithi086 bash[24289]: audit 2024-09-16T05:44:57.976832+0000 mgr.a (mgr.14373) 344 : audit [DBG] from='client.21228 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:45:01.404 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:45:01 smithi086 bash[24289]: cluster 2024-09-16T05:44:59.911281+0000 mgr.a (mgr.14373) 345 : cluster [DBG] pgmap v240: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:45:01.478 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:45:01 smithi157 bash[24585]: cluster 2024-09-16T05:44:59.911281+0000 mgr.a (mgr.14373) 345 : cluster [DBG] pgmap v240: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:45:01.584 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:45:01 smithi047 bash[22744]: cluster 2024-09-16T05:44:59.911281+0000 mgr.a (mgr.14373) 345 : cluster [DBG] pgmap v240: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:45:03.387 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T05:45:03.387 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T05:45:03.387 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T05:45:03.551 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:45:03 smithi157 bash[24585]: cluster 2024-09-16T05:45:01.913460+0000 mgr.a (mgr.14373) 346 : cluster [DBG] pgmap v241: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:45:03.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:45:03 smithi086 bash[24289]: cluster 2024-09-16T05:45:01.913460+0000 mgr.a (mgr.14373) 346 : cluster [DBG] pgmap v241: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:45:03.584 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:45:03 smithi047 bash[22744]: cluster 2024-09-16T05:45:01.913460+0000 mgr.a (mgr.14373) 346 : cluster [DBG] pgmap v241: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:45:04.144 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T05:45:04.144 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T05:45:04.144 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T05:45:04.144 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T05:45:04.144 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T05:45:05.551 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:45:05 smithi157 bash[24585]: audit 2024-09-16T05:45:03.728726+0000 mgr.a (mgr.14373) 347 : audit [DBG] from='client.21306 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:45:05.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:45:05 smithi157 bash[24585]: cluster 2024-09-16T05:45:03.914038+0000 mgr.a (mgr.14373) 348 : cluster [DBG] pgmap v242: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:45:05.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:45:05 smithi086 bash[24289]: audit 2024-09-16T05:45:03.728726+0000 mgr.a (mgr.14373) 347 : audit [DBG] from='client.21306 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:45:05.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:45:05 smithi086 bash[24289]: cluster 2024-09-16T05:45:03.914038+0000 mgr.a (mgr.14373) 348 : cluster [DBG] pgmap v242: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:45:05.584 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:45:05 smithi047 bash[22744]: audit 2024-09-16T05:45:03.728726+0000 mgr.a (mgr.14373) 347 : audit [DBG] from='client.21306 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:45:05.584 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:45:05 smithi047 bash[22744]: cluster 2024-09-16T05:45:03.914038+0000 mgr.a (mgr.14373) 348 : cluster [DBG] pgmap v242: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:45:07.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:45:07 smithi157 bash[24585]: cluster 2024-09-16T05:45:05.914914+0000 mgr.a (mgr.14373) 349 : cluster [DBG] pgmap v243: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:45:07.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:45:07 smithi086 bash[24289]: cluster 2024-09-16T05:45:05.914914+0000 mgr.a (mgr.14373) 349 : cluster [DBG] pgmap v243: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:45:07.584 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:45:07 smithi047 bash[22744]: cluster 2024-09-16T05:45:05.914914+0000 mgr.a (mgr.14373) 349 : cluster [DBG] pgmap v243: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:45:09.145 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T05:45:09.146 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T05:45:09.146 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T05:45:09.551 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:45:09 smithi157 bash[24585]: cluster 2024-09-16T05:45:07.917159+0000 mgr.a (mgr.14373) 350 : cluster [DBG] pgmap v244: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:45:09.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:45:09 smithi086 bash[24289]: cluster 2024-09-16T05:45:07.917159+0000 mgr.a (mgr.14373) 350 : cluster [DBG] pgmap v244: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:45:09.583 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:45:09 smithi047 bash[22744]: cluster 2024-09-16T05:45:07.917159+0000 mgr.a (mgr.14373) 350 : cluster [DBG] pgmap v244: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:45:09.908 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T05:45:09.909 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T05:45:09.909 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T05:45:09.909 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T05:45:09.909 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T05:45:11.551 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:45:11 smithi157 bash[24585]: audit 2024-09-16T05:45:09.486020+0000 mgr.a (mgr.14373) 351 : audit [DBG] from='client.21381 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:45:11.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:45:11 smithi157 bash[24585]: cluster 2024-09-16T05:45:09.917865+0000 mgr.a (mgr.14373) 352 : cluster [DBG] pgmap v245: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:45:11.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:45:11 smithi086 bash[24289]: audit 2024-09-16T05:45:09.486020+0000 mgr.a (mgr.14373) 351 : audit [DBG] from='client.21381 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:45:11.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:45:11 smithi086 bash[24289]: cluster 2024-09-16T05:45:09.917865+0000 mgr.a (mgr.14373) 352 : cluster [DBG] pgmap v245: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:45:11.584 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:45:11 smithi047 bash[22744]: audit 2024-09-16T05:45:09.486020+0000 mgr.a (mgr.14373) 351 : audit [DBG] from='client.21381 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:45:11.584 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:45:11 smithi047 bash[22744]: cluster 2024-09-16T05:45:09.917865+0000 mgr.a (mgr.14373) 352 : cluster [DBG] pgmap v245: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:45:13.551 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:45:13 smithi157 bash[24585]: cluster 2024-09-16T05:45:11.919995+0000 mgr.a (mgr.14373) 353 : cluster [DBG] pgmap v246: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:45:13.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:45:13 smithi086 bash[24289]: cluster 2024-09-16T05:45:11.919995+0000 mgr.a (mgr.14373) 353 : cluster [DBG] pgmap v246: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:45:13.584 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:45:13 smithi047 bash[22744]: cluster 2024-09-16T05:45:11.919995+0000 mgr.a (mgr.14373) 353 : cluster [DBG] pgmap v246: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:45:14.910 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T05:45:14.911 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T05:45:14.911 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T05:45:15.551 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:45:15 smithi157 bash[24585]: cluster 2024-09-16T05:45:13.920744+0000 mgr.a (mgr.14373) 354 : cluster [DBG] pgmap v247: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:45:15.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:45:15 smithi086 bash[24289]: cluster 2024-09-16T05:45:13.920744+0000 mgr.a (mgr.14373) 354 : cluster [DBG] pgmap v247: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:45:15.584 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:45:15 smithi047 bash[22744]: cluster 2024-09-16T05:45:13.920744+0000 mgr.a (mgr.14373) 354 : cluster [DBG] pgmap v247: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:45:15.647 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T05:45:15.648 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T05:45:15.648 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T05:45:15.648 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T05:45:15.648 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T05:45:16.551 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:45:16 smithi157 bash[24585]: audit 2024-09-16T05:45:15.242878+0000 mgr.a (mgr.14373) 355 : audit [DBG] from='client.21456 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:45:16.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:45:16 smithi086 bash[24289]: audit 2024-09-16T05:45:15.242878+0000 mgr.a (mgr.14373) 355 : audit [DBG] from='client.21456 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:45:16.584 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:45:16 smithi047 bash[22744]: audit 2024-09-16T05:45:15.242878+0000 mgr.a (mgr.14373) 355 : audit [DBG] from='client.21456 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:45:17.551 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:45:17 smithi157 bash[24585]: cluster 2024-09-16T05:45:15.921711+0000 mgr.a (mgr.14373) 356 : cluster [DBG] pgmap v248: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:45:17.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:45:17 smithi086 bash[24289]: cluster 2024-09-16T05:45:15.921711+0000 mgr.a (mgr.14373) 356 : cluster [DBG] pgmap v248: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:45:17.584 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:45:17 smithi047 bash[22744]: cluster 2024-09-16T05:45:15.921711+0000 mgr.a (mgr.14373) 356 : cluster [DBG] pgmap v248: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:45:19.551 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:45:19 smithi157 bash[24585]: cluster 2024-09-16T05:45:17.924001+0000 mgr.a (mgr.14373) 357 : cluster [DBG] pgmap v249: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:45:19.573 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:45:19 smithi086 bash[24289]: cluster 2024-09-16T05:45:17.924001+0000 mgr.a (mgr.14373) 357 : cluster [DBG] pgmap v249: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:45:19.584 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:45:19 smithi047 bash[22744]: cluster 2024-09-16T05:45:17.924001+0000 mgr.a (mgr.14373) 357 : cluster [DBG] pgmap v249: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:45:20.649 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T05:45:20.650 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T05:45:20.650 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T05:45:21.387 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T05:45:21.388 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T05:45:21.388 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T05:45:21.388 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T05:45:21.388 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T05:45:21.551 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:45:21 smithi157 bash[24585]: cluster 2024-09-16T05:45:19.924803+0000 mgr.a (mgr.14373) 358 : cluster [DBG] pgmap v250: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:45:21.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:45:21 smithi086 bash[24289]: cluster 2024-09-16T05:45:19.924803+0000 mgr.a (mgr.14373) 358 : cluster [DBG] pgmap v250: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:45:21.584 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:45:21 smithi047 bash[22744]: cluster 2024-09-16T05:45:19.924803+0000 mgr.a (mgr.14373) 358 : cluster [DBG] pgmap v250: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:45:22.551 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:45:22 smithi157 bash[24585]: audit 2024-09-16T05:45:20.982661+0000 mgr.a (mgr.14373) 359 : audit [DBG] from='client.21531 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:45:22.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:45:22 smithi157 bash[24585]: audit 2024-09-16T05:45:21.668897+0000 mon.b (mon.2) 80 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T05:45:22.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:45:22 smithi086 bash[24289]: audit 2024-09-16T05:45:20.982661+0000 mgr.a (mgr.14373) 359 : audit [DBG] from='client.21531 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:45:22.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:45:22 smithi086 bash[24289]: audit 2024-09-16T05:45:21.668897+0000 mon.b (mon.2) 80 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T05:45:22.584 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:45:22 smithi047 bash[22744]: audit 2024-09-16T05:45:20.982661+0000 mgr.a (mgr.14373) 359 : audit [DBG] from='client.21531 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:45:22.584 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:45:22 smithi047 bash[22744]: audit 2024-09-16T05:45:21.668897+0000 mon.b (mon.2) 80 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T05:45:23.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:45:23 smithi157 bash[24585]: cluster 2024-09-16T05:45:21.927149+0000 mgr.a (mgr.14373) 360 : cluster [DBG] pgmap v251: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:45:23.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:45:23 smithi157 bash[24585]: audit 2024-09-16T05:45:22.509443+0000 mon.b (mon.2) 81 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T05:45:23.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:45:23 smithi157 bash[24585]: audit 2024-09-16T05:45:22.511703+0000 mon.b (mon.2) 82 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T05:45:23.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:45:23 smithi157 bash[24585]: audit 2024-09-16T05:45:22.526545+0000 mon.b (mon.2) 83 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T05:45:23.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:45:23 smithi157 bash[24585]: audit 2024-09-16T05:45:22.530650+0000 mon.a (mon.0) 589 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T05:45:23.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:45:23 smithi086 bash[24289]: cluster 2024-09-16T05:45:21.927149+0000 mgr.a (mgr.14373) 360 : cluster [DBG] pgmap v251: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:45:23.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:45:23 smithi086 bash[24289]: audit 2024-09-16T05:45:22.509443+0000 mon.b (mon.2) 81 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T05:45:23.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:45:23 smithi086 bash[24289]: audit 2024-09-16T05:45:22.511703+0000 mon.b (mon.2) 82 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T05:45:23.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:45:23 smithi086 bash[24289]: audit 2024-09-16T05:45:22.526545+0000 mon.b (mon.2) 83 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T05:45:23.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:45:23 smithi086 bash[24289]: audit 2024-09-16T05:45:22.530650+0000 mon.a (mon.0) 589 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T05:45:23.584 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 05:45:23 smithi047 bash[22994]: debug 2024-09-16T05:45:23.254+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T05:45:23.584 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 05:45:23 smithi047 bash[22994]: debug 2024-09-16T05:45:23.258+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T05:45:23.584 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:45:23 smithi047 bash[22744]: cluster 2024-09-16T05:45:21.927149+0000 mgr.a (mgr.14373) 360 : cluster [DBG] pgmap v251: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:45:23.584 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:45:23 smithi047 bash[22744]: audit 2024-09-16T05:45:22.509443+0000 mon.b (mon.2) 81 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T05:45:23.584 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:45:23 smithi047 bash[22744]: audit 2024-09-16T05:45:22.511703+0000 mon.b (mon.2) 82 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T05:45:23.585 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:45:23 smithi047 bash[22744]: audit 2024-09-16T05:45:22.526545+0000 mon.b (mon.2) 83 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T05:45:23.585 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:45:23 smithi047 bash[22744]: audit 2024-09-16T05:45:22.530650+0000 mon.a (mon.0) 589 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T05:45:24.551 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:45:24 smithi157 bash[24585]: audit 2024-09-16T05:45:22.535895+0000 mgr.a (mgr.14373) 361 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T05:45:24.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:45:24 smithi157 bash[24585]: audit 2024-09-16T05:45:23.257052+0000 mgr.a (mgr.14373) 362 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T05:45:24.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:45:24 smithi157 bash[24585]: cephadm 2024-09-16T05:45:23.258919+0000 mgr.a (mgr.14373) 363 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T05:45:24.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:45:24 smithi086 bash[24289]: audit 2024-09-16T05:45:22.535895+0000 mgr.a (mgr.14373) 361 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T05:45:24.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:45:24 smithi086 bash[24289]: audit 2024-09-16T05:45:23.257052+0000 mgr.a (mgr.14373) 362 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T05:45:24.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:45:24 smithi086 bash[24289]: cephadm 2024-09-16T05:45:23.258919+0000 mgr.a (mgr.14373) 363 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T05:45:24.584 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:45:24 smithi047 bash[22744]: audit 2024-09-16T05:45:22.535895+0000 mgr.a (mgr.14373) 361 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T05:45:24.584 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:45:24 smithi047 bash[22744]: audit 2024-09-16T05:45:23.257052+0000 mgr.a (mgr.14373) 362 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T05:45:24.584 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:45:24 smithi047 bash[22744]: cephadm 2024-09-16T05:45:23.258919+0000 mgr.a (mgr.14373) 363 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T05:45:25.551 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:45:25 smithi157 bash[24585]: cluster 2024-09-16T05:45:23.928109+0000 mgr.a (mgr.14373) 364 : cluster [DBG] pgmap v252: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:45:25.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:45:25 smithi086 bash[24289]: cluster 2024-09-16T05:45:23.928109+0000 mgr.a (mgr.14373) 364 : cluster [DBG] pgmap v252: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:45:25.584 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:45:25 smithi047 bash[22744]: cluster 2024-09-16T05:45:23.928109+0000 mgr.a (mgr.14373) 364 : cluster [DBG] pgmap v252: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:45:26.389 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T05:45:26.389 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T05:45:26.389 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T05:45:27.148 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T05:45:27.148 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T05:45:27.148 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T05:45:27.148 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T05:45:27.149 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T05:45:27.551 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:45:27 smithi157 bash[24585]: cluster 2024-09-16T05:45:25.928885+0000 mgr.a (mgr.14373) 365 : cluster [DBG] pgmap v253: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:45:27.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:45:27 smithi086 bash[24289]: cluster 2024-09-16T05:45:25.928885+0000 mgr.a (mgr.14373) 365 : cluster [DBG] pgmap v253: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:45:27.584 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:45:27 smithi047 bash[22744]: cluster 2024-09-16T05:45:25.928885+0000 mgr.a (mgr.14373) 365 : cluster [DBG] pgmap v253: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:45:28.551 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:45:28 smithi157 bash[24585]: audit 2024-09-16T05:45:26.731464+0000 mgr.a (mgr.14373) 366 : audit [DBG] from='client.21708 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:45:28.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:45:28 smithi086 bash[24289]: audit 2024-09-16T05:45:26.731464+0000 mgr.a (mgr.14373) 366 : audit [DBG] from='client.21708 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:45:28.584 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:45:28 smithi047 bash[22744]: audit 2024-09-16T05:45:26.731464+0000 mgr.a (mgr.14373) 366 : audit [DBG] from='client.21708 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:45:29.551 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:45:29 smithi157 bash[24585]: cluster 2024-09-16T05:45:27.931584+0000 mgr.a (mgr.14373) 367 : cluster [DBG] pgmap v254: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T05:45:29.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:45:29 smithi086 bash[24289]: cluster 2024-09-16T05:45:27.931584+0000 mgr.a (mgr.14373) 367 : cluster [DBG] pgmap v254: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T05:45:29.584 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:45:29 smithi047 bash[22744]: cluster 2024-09-16T05:45:27.931584+0000 mgr.a (mgr.14373) 367 : cluster [DBG] pgmap v254: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T05:45:31.551 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:45:31 smithi157 bash[24585]: cluster 2024-09-16T05:45:29.932366+0000 mgr.a (mgr.14373) 368 : cluster [DBG] pgmap v255: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T05:45:31.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:45:31 smithi086 bash[24289]: cluster 2024-09-16T05:45:29.932366+0000 mgr.a (mgr.14373) 368 : cluster [DBG] pgmap v255: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T05:45:31.584 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:45:31 smithi047 bash[22744]: cluster 2024-09-16T05:45:29.932366+0000 mgr.a (mgr.14373) 368 : cluster [DBG] pgmap v255: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T05:45:32.149 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T05:45:32.150 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T05:45:32.150 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T05:45:32.893 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T05:45:32.893 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T05:45:32.893 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T05:45:32.893 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T05:45:32.893 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T05:45:33.551 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:45:33 smithi157 bash[24585]: cluster 2024-09-16T05:45:31.934277+0000 mgr.a (mgr.14373) 369 : cluster [DBG] pgmap v256: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T05:45:33.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:45:33 smithi086 bash[24289]: cluster 2024-09-16T05:45:31.934277+0000 mgr.a (mgr.14373) 369 : cluster [DBG] pgmap v256: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T05:45:33.584 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:45:33 smithi047 bash[22744]: cluster 2024-09-16T05:45:31.934277+0000 mgr.a (mgr.14373) 369 : cluster [DBG] pgmap v256: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T05:45:34.551 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:45:34 smithi157 bash[24585]: audit 2024-09-16T05:45:32.487809+0000 mgr.a (mgr.14373) 370 : audit [DBG] from='client.21786 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:45:34.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:45:34 smithi086 bash[24289]: audit 2024-09-16T05:45:32.487809+0000 mgr.a (mgr.14373) 370 : audit [DBG] from='client.21786 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:45:34.584 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:45:34 smithi047 bash[22744]: audit 2024-09-16T05:45:32.487809+0000 mgr.a (mgr.14373) 370 : audit [DBG] from='client.21786 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:45:35.551 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:45:35 smithi157 bash[24585]: cluster 2024-09-16T05:45:33.935219+0000 mgr.a (mgr.14373) 371 : cluster [DBG] pgmap v257: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T05:45:35.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:45:35 smithi086 bash[24289]: cluster 2024-09-16T05:45:33.935219+0000 mgr.a (mgr.14373) 371 : cluster [DBG] pgmap v257: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T05:45:35.584 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:45:35 smithi047 bash[22744]: cluster 2024-09-16T05:45:33.935219+0000 mgr.a (mgr.14373) 371 : cluster [DBG] pgmap v257: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T05:45:37.551 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:45:37 smithi157 bash[24585]: cluster 2024-09-16T05:45:35.936125+0000 mgr.a (mgr.14373) 372 : cluster [DBG] pgmap v258: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T05:45:37.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:45:37 smithi086 bash[24289]: cluster 2024-09-16T05:45:35.936125+0000 mgr.a (mgr.14373) 372 : cluster [DBG] pgmap v258: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T05:45:37.584 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:45:37 smithi047 bash[22744]: cluster 2024-09-16T05:45:35.936125+0000 mgr.a (mgr.14373) 372 : cluster [DBG] pgmap v258: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T05:45:37.894 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T05:45:37.895 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T05:45:37.895 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T05:45:38.663 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T05:45:38.663 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T05:45:38.663 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T05:45:38.664 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T05:45:38.664 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T05:45:39.551 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:45:39 smithi157 bash[24585]: cluster 2024-09-16T05:45:37.938309+0000 mgr.a (mgr.14373) 373 : cluster [DBG] pgmap v259: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T05:45:39.551 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:45:39 smithi157 bash[24585]: audit 2024-09-16T05:45:38.240345+0000 mgr.a (mgr.14373) 374 : audit [DBG] from='client.21864 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:45:39.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:45:39 smithi086 bash[24289]: cluster 2024-09-16T05:45:37.938309+0000 mgr.a (mgr.14373) 373 : cluster [DBG] pgmap v259: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T05:45:39.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:45:39 smithi086 bash[24289]: audit 2024-09-16T05:45:38.240345+0000 mgr.a (mgr.14373) 374 : audit [DBG] from='client.21864 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:45:39.584 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:45:39 smithi047 bash[22744]: cluster 2024-09-16T05:45:37.938309+0000 mgr.a (mgr.14373) 373 : cluster [DBG] pgmap v259: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T05:45:39.584 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:45:39 smithi047 bash[22744]: audit 2024-09-16T05:45:38.240345+0000 mgr.a (mgr.14373) 374 : audit [DBG] from='client.21864 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:45:41.551 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:45:41 smithi157 bash[24585]: cluster 2024-09-16T05:45:39.939267+0000 mgr.a (mgr.14373) 375 : cluster [DBG] pgmap v260: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:45:41.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:45:41 smithi086 bash[24289]: cluster 2024-09-16T05:45:39.939267+0000 mgr.a (mgr.14373) 375 : cluster [DBG] pgmap v260: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:45:41.584 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:45:41 smithi047 bash[22744]: cluster 2024-09-16T05:45:39.939267+0000 mgr.a (mgr.14373) 375 : cluster [DBG] pgmap v260: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:45:43.551 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:45:43 smithi157 bash[24585]: cluster 2024-09-16T05:45:41.941391+0000 mgr.a (mgr.14373) 376 : cluster [DBG] pgmap v261: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:45:43.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:45:43 smithi086 bash[24289]: cluster 2024-09-16T05:45:41.941391+0000 mgr.a (mgr.14373) 376 : cluster [DBG] pgmap v261: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:45:43.584 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:45:43 smithi047 bash[22744]: cluster 2024-09-16T05:45:41.941391+0000 mgr.a (mgr.14373) 376 : cluster [DBG] pgmap v261: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:45:43.664 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T05:45:43.665 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T05:45:43.665 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T05:45:44.441 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T05:45:44.441 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T05:45:44.442 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T05:45:44.442 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T05:45:44.442 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T05:45:45.551 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:45:45 smithi157 bash[24585]: cluster 2024-09-16T05:45:43.942129+0000 mgr.a (mgr.14373) 377 : cluster [DBG] pgmap v262: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:45:45.551 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:45:45 smithi157 bash[24585]: audit 2024-09-16T05:45:44.009724+0000 mgr.a (mgr.14373) 378 : audit [DBG] from='client.21939 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:45:45.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:45:45 smithi086 bash[24289]: cluster 2024-09-16T05:45:43.942129+0000 mgr.a (mgr.14373) 377 : cluster [DBG] pgmap v262: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:45:45.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:45:45 smithi086 bash[24289]: audit 2024-09-16T05:45:44.009724+0000 mgr.a (mgr.14373) 378 : audit [DBG] from='client.21939 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:45:45.584 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:45:45 smithi047 bash[22744]: cluster 2024-09-16T05:45:43.942129+0000 mgr.a (mgr.14373) 377 : cluster [DBG] pgmap v262: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:45:45.584 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:45:45 smithi047 bash[22744]: audit 2024-09-16T05:45:44.009724+0000 mgr.a (mgr.14373) 378 : audit [DBG] from='client.21939 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:45:47.551 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:45:47 smithi157 bash[24585]: cluster 2024-09-16T05:45:45.943033+0000 mgr.a (mgr.14373) 379 : cluster [DBG] pgmap v263: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:45:47.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:45:47 smithi086 bash[24289]: cluster 2024-09-16T05:45:45.943033+0000 mgr.a (mgr.14373) 379 : cluster [DBG] pgmap v263: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:45:47.584 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:45:47 smithi047 bash[22744]: cluster 2024-09-16T05:45:45.943033+0000 mgr.a (mgr.14373) 379 : cluster [DBG] pgmap v263: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:45:49.443 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T05:45:49.443 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T05:45:49.443 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T05:45:49.551 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:45:49 smithi157 bash[24585]: cluster 2024-09-16T05:45:47.945297+0000 mgr.a (mgr.14373) 380 : cluster [DBG] pgmap v264: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:45:49.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:45:49 smithi086 bash[24289]: cluster 2024-09-16T05:45:47.945297+0000 mgr.a (mgr.14373) 380 : cluster [DBG] pgmap v264: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:45:49.583 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:45:49 smithi047 bash[22744]: cluster 2024-09-16T05:45:47.945297+0000 mgr.a (mgr.14373) 380 : cluster [DBG] pgmap v264: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:45:50.183 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T05:45:50.391 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T05:45:50.391 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T05:45:50.392 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T05:45:50.392 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T05:45:51.551 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:45:51 smithi157 bash[24585]: audit 2024-09-16T05:45:49.784137+0000 mgr.a (mgr.14373) 381 : audit [DBG] from='client.22017 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:45:51.551 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:45:51 smithi157 bash[24585]: cluster 2024-09-16T05:45:49.945935+0000 mgr.a (mgr.14373) 382 : cluster [DBG] pgmap v265: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:45:51.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:45:51 smithi086 bash[24289]: audit 2024-09-16T05:45:49.784137+0000 mgr.a (mgr.14373) 381 : audit [DBG] from='client.22017 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:45:51.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:45:51 smithi086 bash[24289]: cluster 2024-09-16T05:45:49.945935+0000 mgr.a (mgr.14373) 382 : cluster [DBG] pgmap v265: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:45:51.584 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:45:51 smithi047 bash[22744]: audit 2024-09-16T05:45:49.784137+0000 mgr.a (mgr.14373) 381 : audit [DBG] from='client.22017 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:45:51.584 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:45:51 smithi047 bash[22744]: cluster 2024-09-16T05:45:49.945935+0000 mgr.a (mgr.14373) 382 : cluster [DBG] pgmap v265: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:45:53.551 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:45:53 smithi157 bash[24585]: cluster 2024-09-16T05:45:51.948194+0000 mgr.a (mgr.14373) 383 : cluster [DBG] pgmap v266: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:45:53.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:45:53 smithi086 bash[24289]: cluster 2024-09-16T05:45:51.948194+0000 mgr.a (mgr.14373) 383 : cluster [DBG] pgmap v266: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:45:53.584 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:45:53 smithi047 bash[22744]: cluster 2024-09-16T05:45:51.948194+0000 mgr.a (mgr.14373) 383 : cluster [DBG] pgmap v266: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:45:55.185 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T05:45:55.185 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T05:45:55.185 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T05:45:55.551 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:45:55 smithi157 bash[24585]: cluster 2024-09-16T05:45:53.948972+0000 mgr.a (mgr.14373) 384 : cluster [DBG] pgmap v267: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:45:55.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:45:55 smithi086 bash[24289]: cluster 2024-09-16T05:45:53.948972+0000 mgr.a (mgr.14373) 384 : cluster [DBG] pgmap v267: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:45:55.584 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:45:55 smithi047 bash[22744]: cluster 2024-09-16T05:45:53.948972+0000 mgr.a (mgr.14373) 384 : cluster [DBG] pgmap v267: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:45:55.950 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T05:45:55.950 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T05:45:55.950 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T05:45:55.950 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T05:45:55.950 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T05:45:57.551 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:45:57 smithi157 bash[24585]: audit 2024-09-16T05:45:55.526812+0000 mgr.a (mgr.14373) 385 : audit [DBG] from='client.22095 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:45:57.551 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:45:57 smithi157 bash[24585]: cluster 2024-09-16T05:45:55.949484+0000 mgr.a (mgr.14373) 386 : cluster [DBG] pgmap v268: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:45:57.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:45:57 smithi086 bash[24289]: audit 2024-09-16T05:45:55.526812+0000 mgr.a (mgr.14373) 385 : audit [DBG] from='client.22095 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:45:57.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:45:57 smithi086 bash[24289]: cluster 2024-09-16T05:45:55.949484+0000 mgr.a (mgr.14373) 386 : cluster [DBG] pgmap v268: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:45:57.584 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:45:57 smithi047 bash[22744]: audit 2024-09-16T05:45:55.526812+0000 mgr.a (mgr.14373) 385 : audit [DBG] from='client.22095 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:45:57.584 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:45:57 smithi047 bash[22744]: cluster 2024-09-16T05:45:55.949484+0000 mgr.a (mgr.14373) 386 : cluster [DBG] pgmap v268: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:45:59.551 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:45:59 smithi157 bash[24585]: cluster 2024-09-16T05:45:57.951681+0000 mgr.a (mgr.14373) 387 : cluster [DBG] pgmap v269: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:45:59.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:45:59 smithi086 bash[24289]: cluster 2024-09-16T05:45:57.951681+0000 mgr.a (mgr.14373) 387 : cluster [DBG] pgmap v269: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:45:59.583 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:45:59 smithi047 bash[22744]: cluster 2024-09-16T05:45:57.951681+0000 mgr.a (mgr.14373) 387 : cluster [DBG] pgmap v269: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:46:00.951 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T05:46:00.952 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T05:46:00.953 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T05:46:01.551 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:46:01 smithi157 bash[24585]: cluster 2024-09-16T05:45:59.952427+0000 mgr.a (mgr.14373) 388 : cluster [DBG] pgmap v270: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:46:01.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:46:01 smithi086 bash[24289]: cluster 2024-09-16T05:45:59.952427+0000 mgr.a (mgr.14373) 388 : cluster [DBG] pgmap v270: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:46:01.583 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:46:01 smithi047 bash[22744]: cluster 2024-09-16T05:45:59.952427+0000 mgr.a (mgr.14373) 388 : cluster [DBG] pgmap v270: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:46:01.714 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T05:46:01.714 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T05:46:01.714 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T05:46:01.714 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T05:46:01.714 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T05:46:02.551 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:46:02 smithi157 bash[24585]: audit 2024-09-16T05:46:01.291185+0000 mgr.a (mgr.14373) 389 : audit [DBG] from='client.22173 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:46:02.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:46:02 smithi086 bash[24289]: audit 2024-09-16T05:46:01.291185+0000 mgr.a (mgr.14373) 389 : audit [DBG] from='client.22173 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:46:02.583 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:46:02 smithi047 bash[22744]: audit 2024-09-16T05:46:01.291185+0000 mgr.a (mgr.14373) 389 : audit [DBG] from='client.22173 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:46:03.551 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:46:03 smithi157 bash[24585]: cluster 2024-09-16T05:46:01.955150+0000 mgr.a (mgr.14373) 390 : cluster [DBG] pgmap v271: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:46:03.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:46:03 smithi086 bash[24289]: cluster 2024-09-16T05:46:01.955150+0000 mgr.a (mgr.14373) 390 : cluster [DBG] pgmap v271: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:46:03.583 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:46:03 smithi047 bash[22744]: cluster 2024-09-16T05:46:01.955150+0000 mgr.a (mgr.14373) 390 : cluster [DBG] pgmap v271: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:46:05.551 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:46:05 smithi157 bash[24585]: cluster 2024-09-16T05:46:03.955931+0000 mgr.a (mgr.14373) 391 : cluster [DBG] pgmap v272: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T05:46:05.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:46:05 smithi086 bash[24289]: cluster 2024-09-16T05:46:03.955931+0000 mgr.a (mgr.14373) 391 : cluster [DBG] pgmap v272: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T05:46:05.583 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:46:05 smithi047 bash[22744]: cluster 2024-09-16T05:46:03.955931+0000 mgr.a (mgr.14373) 391 : cluster [DBG] pgmap v272: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T05:46:06.716 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T05:46:06.717 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T05:46:06.717 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T05:46:07.450 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T05:46:07.451 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T05:46:07.451 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T05:46:07.451 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T05:46:07.451 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T05:46:07.551 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:46:07 smithi157 bash[24585]: cluster 2024-09-16T05:46:05.956732+0000 mgr.a (mgr.14373) 392 : cluster [DBG] pgmap v273: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T05:46:07.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:46:07 smithi086 bash[24289]: cluster 2024-09-16T05:46:05.956732+0000 mgr.a (mgr.14373) 392 : cluster [DBG] pgmap v273: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T05:46:07.584 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:46:07 smithi047 bash[22744]: cluster 2024-09-16T05:46:05.956732+0000 mgr.a (mgr.14373) 392 : cluster [DBG] pgmap v273: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T05:46:08.551 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:46:08 smithi157 bash[24585]: audit 2024-09-16T05:46:07.055412+0000 mgr.a (mgr.14373) 393 : audit [DBG] from='client.22251 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:46:08.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:46:08 smithi086 bash[24289]: audit 2024-09-16T05:46:07.055412+0000 mgr.a (mgr.14373) 393 : audit [DBG] from='client.22251 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:46:08.583 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:46:08 smithi047 bash[22744]: audit 2024-09-16T05:46:07.055412+0000 mgr.a (mgr.14373) 393 : audit [DBG] from='client.22251 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:46:09.551 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:46:09 smithi157 bash[24585]: cluster 2024-09-16T05:46:07.959396+0000 mgr.a (mgr.14373) 394 : cluster [DBG] pgmap v274: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:46:09.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:46:09 smithi086 bash[24289]: cluster 2024-09-16T05:46:07.959396+0000 mgr.a (mgr.14373) 394 : cluster [DBG] pgmap v274: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:46:09.583 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:46:09 smithi047 bash[22744]: cluster 2024-09-16T05:46:07.959396+0000 mgr.a (mgr.14373) 394 : cluster [DBG] pgmap v274: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:46:11.551 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:46:11 smithi157 bash[24585]: cluster 2024-09-16T05:46:09.960170+0000 mgr.a (mgr.14373) 395 : cluster [DBG] pgmap v275: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T05:46:11.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:46:11 smithi086 bash[24289]: cluster 2024-09-16T05:46:09.960170+0000 mgr.a (mgr.14373) 395 : cluster [DBG] pgmap v275: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T05:46:11.583 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:46:11 smithi047 bash[22744]: cluster 2024-09-16T05:46:09.960170+0000 mgr.a (mgr.14373) 395 : cluster [DBG] pgmap v275: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T05:46:12.452 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T05:46:12.452 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T05:46:12.452 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T05:46:13.228 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T05:46:13.229 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T05:46:13.229 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T05:46:13.229 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T05:46:13.229 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T05:46:13.551 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:46:13 smithi157 bash[24585]: cluster 2024-09-16T05:46:11.962129+0000 mgr.a (mgr.14373) 396 : cluster [DBG] pgmap v276: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:46:13.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:46:13 smithi086 bash[24289]: cluster 2024-09-16T05:46:11.962129+0000 mgr.a (mgr.14373) 396 : cluster [DBG] pgmap v276: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:46:13.583 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:46:13 smithi047 bash[22744]: cluster 2024-09-16T05:46:11.962129+0000 mgr.a (mgr.14373) 396 : cluster [DBG] pgmap v276: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:46:14.551 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:46:14 smithi157 bash[24585]: audit 2024-09-16T05:46:12.795965+0000 mgr.a (mgr.14373) 397 : audit [DBG] from='client.22326 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:46:14.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:46:14 smithi086 bash[24289]: audit 2024-09-16T05:46:12.795965+0000 mgr.a (mgr.14373) 397 : audit [DBG] from='client.22326 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:46:14.584 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:46:14 smithi047 bash[22744]: audit 2024-09-16T05:46:12.795965+0000 mgr.a (mgr.14373) 397 : audit [DBG] from='client.22326 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:46:15.551 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:46:15 smithi157 bash[24585]: cluster 2024-09-16T05:46:13.963055+0000 mgr.a (mgr.14373) 398 : cluster [DBG] pgmap v277: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:46:15.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:46:15 smithi086 bash[24289]: cluster 2024-09-16T05:46:13.963055+0000 mgr.a (mgr.14373) 398 : cluster [DBG] pgmap v277: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:46:15.583 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:46:15 smithi047 bash[22744]: cluster 2024-09-16T05:46:13.963055+0000 mgr.a (mgr.14373) 398 : cluster [DBG] pgmap v277: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:46:17.551 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:46:17 smithi157 bash[24585]: cluster 2024-09-16T05:46:15.963832+0000 mgr.a (mgr.14373) 399 : cluster [DBG] pgmap v278: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:46:17.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:46:17 smithi086 bash[24289]: cluster 2024-09-16T05:46:15.963832+0000 mgr.a (mgr.14373) 399 : cluster [DBG] pgmap v278: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:46:17.583 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:46:17 smithi047 bash[22744]: cluster 2024-09-16T05:46:15.963832+0000 mgr.a (mgr.14373) 399 : cluster [DBG] pgmap v278: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:46:18.230 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T05:46:18.230 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T05:46:18.231 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T05:46:18.991 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T05:46:18.991 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T05:46:18.991 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T05:46:18.991 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T05:46:18.991 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T05:46:19.551 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:46:19 smithi157 bash[24585]: cluster 2024-09-16T05:46:17.966017+0000 mgr.a (mgr.14373) 400 : cluster [DBG] pgmap v279: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:46:19.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:46:19 smithi086 bash[24289]: cluster 2024-09-16T05:46:17.966017+0000 mgr.a (mgr.14373) 400 : cluster [DBG] pgmap v279: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:46:19.583 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:46:19 smithi047 bash[22744]: cluster 2024-09-16T05:46:17.966017+0000 mgr.a (mgr.14373) 400 : cluster [DBG] pgmap v279: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:46:20.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:46:20 smithi086 bash[24289]: audit 2024-09-16T05:46:18.573284+0000 mgr.a (mgr.14373) 401 : audit [DBG] from='client.22401 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:46:20.583 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:46:20 smithi047 bash[22744]: audit 2024-09-16T05:46:18.573284+0000 mgr.a (mgr.14373) 401 : audit [DBG] from='client.22401 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:46:20.801 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:46:20 smithi157 bash[24585]: audit 2024-09-16T05:46:18.573284+0000 mgr.a (mgr.14373) 401 : audit [DBG] from='client.22401 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:46:21.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:46:21 smithi086 bash[24289]: cluster 2024-09-16T05:46:19.966934+0000 mgr.a (mgr.14373) 402 : cluster [DBG] pgmap v280: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:46:21.583 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:46:21 smithi047 bash[22744]: cluster 2024-09-16T05:46:19.966934+0000 mgr.a (mgr.14373) 402 : cluster [DBG] pgmap v280: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:46:21.801 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:46:21 smithi157 bash[24585]: cluster 2024-09-16T05:46:19.966934+0000 mgr.a (mgr.14373) 402 : cluster [DBG] pgmap v280: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:46:23.583 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:46:23 smithi047 bash[22744]: cluster 2024-09-16T05:46:21.969119+0000 mgr.a (mgr.14373) 403 : cluster [DBG] pgmap v281: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:46:23.584 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:46:23 smithi047 bash[22744]: audit 2024-09-16T05:46:23.300941+0000 mon.b (mon.2) 84 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T05:46:23.801 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:46:23 smithi157 bash[24585]: cluster 2024-09-16T05:46:21.969119+0000 mgr.a (mgr.14373) 403 : cluster [DBG] pgmap v281: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:46:23.801 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:46:23 smithi157 bash[24585]: audit 2024-09-16T05:46:23.300941+0000 mon.b (mon.2) 84 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T05:46:23.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:46:23 smithi086 bash[24289]: cluster 2024-09-16T05:46:21.969119+0000 mgr.a (mgr.14373) 403 : cluster [DBG] pgmap v281: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:46:23.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:46:23 smithi086 bash[24289]: audit 2024-09-16T05:46:23.300941+0000 mon.b (mon.2) 84 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T05:46:23.993 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T05:46:23.993 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T05:46:23.993 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T05:46:24.583 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:46:24 smithi047 bash[22744]: audit 2024-09-16T05:46:24.162666+0000 mon.b (mon.2) 85 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T05:46:24.583 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:46:24 smithi047 bash[22744]: audit 2024-09-16T05:46:24.164245+0000 mon.b (mon.2) 86 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T05:46:24.584 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:46:24 smithi047 bash[22744]: audit 2024-09-16T05:46:24.179577+0000 mon.b (mon.2) 87 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T05:46:24.584 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:46:24 smithi047 bash[22744]: audit 2024-09-16T05:46:24.182570+0000 mon.a (mon.0) 590 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T05:46:24.801 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:46:24 smithi157 bash[24585]: audit 2024-09-16T05:46:24.162666+0000 mon.b (mon.2) 85 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T05:46:24.801 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:46:24 smithi157 bash[24585]: audit 2024-09-16T05:46:24.164245+0000 mon.b (mon.2) 86 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T05:46:24.801 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:46:24 smithi157 bash[24585]: audit 2024-09-16T05:46:24.179577+0000 mon.b (mon.2) 87 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T05:46:24.801 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:46:24 smithi157 bash[24585]: audit 2024-09-16T05:46:24.182570+0000 mon.a (mon.0) 590 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T05:46:24.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:46:24 smithi086 bash[24289]: audit 2024-09-16T05:46:24.162666+0000 mon.b (mon.2) 85 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T05:46:24.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:46:24 smithi086 bash[24289]: audit 2024-09-16T05:46:24.164245+0000 mon.b (mon.2) 86 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T05:46:24.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:46:24 smithi086 bash[24289]: audit 2024-09-16T05:46:24.179577+0000 mon.b (mon.2) 87 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T05:46:24.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:46:24 smithi086 bash[24289]: audit 2024-09-16T05:46:24.182570+0000 mon.a (mon.0) 590 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T05:46:25.300 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T05:46:25.300 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T05:46:25.300 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T05:46:25.300 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T05:46:25.301 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T05:46:25.327 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 05:46:24 smithi047 bash[22994]: debug 2024-09-16T05:46:24.893+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T05:46:25.327 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 05:46:24 smithi047 bash[22994]: debug 2024-09-16T05:46:24.905+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T05:46:25.584 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:46:25 smithi047 bash[22744]: cluster 2024-09-16T05:46:23.969875+0000 mgr.a (mgr.14373) 404 : cluster [DBG] pgmap v282: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:46:25.584 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:46:25 smithi047 bash[22744]: audit 2024-09-16T05:46:24.190283+0000 mgr.a (mgr.14373) 405 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T05:46:25.584 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:46:25 smithi047 bash[22744]: audit 2024-09-16T05:46:24.320467+0000 mgr.a (mgr.14373) 406 : audit [DBG] from='client.22476 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:46:25.801 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:46:25 smithi157 bash[24585]: cluster 2024-09-16T05:46:23.969875+0000 mgr.a (mgr.14373) 404 : cluster [DBG] pgmap v282: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:46:25.801 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:46:25 smithi157 bash[24585]: audit 2024-09-16T05:46:24.190283+0000 mgr.a (mgr.14373) 405 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T05:46:25.801 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:46:25 smithi157 bash[24585]: audit 2024-09-16T05:46:24.320467+0000 mgr.a (mgr.14373) 406 : audit [DBG] from='client.22476 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:46:25.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:46:25 smithi086 bash[24289]: cluster 2024-09-16T05:46:23.969875+0000 mgr.a (mgr.14373) 404 : cluster [DBG] pgmap v282: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:46:25.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:46:25 smithi086 bash[24289]: audit 2024-09-16T05:46:24.190283+0000 mgr.a (mgr.14373) 405 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T05:46:25.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:46:25 smithi086 bash[24289]: audit 2024-09-16T05:46:24.320467+0000 mgr.a (mgr.14373) 406 : audit [DBG] from='client.22476 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:46:26.584 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:46:26 smithi047 bash[22744]: audit 2024-09-16T05:46:24.897407+0000 mgr.a (mgr.14373) 407 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T05:46:26.584 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:46:26 smithi047 bash[22744]: cephadm 2024-09-16T05:46:24.909711+0000 mgr.a (mgr.14373) 408 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T05:46:26.801 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:46:26 smithi157 bash[24585]: audit 2024-09-16T05:46:24.897407+0000 mgr.a (mgr.14373) 407 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T05:46:26.801 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:46:26 smithi157 bash[24585]: cephadm 2024-09-16T05:46:24.909711+0000 mgr.a (mgr.14373) 408 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T05:46:26.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:46:26 smithi086 bash[24289]: audit 2024-09-16T05:46:24.897407+0000 mgr.a (mgr.14373) 407 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T05:46:26.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:46:26 smithi086 bash[24289]: cephadm 2024-09-16T05:46:24.909711+0000 mgr.a (mgr.14373) 408 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T05:46:27.801 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:46:27 smithi157 bash[24585]: cluster 2024-09-16T05:46:25.970792+0000 mgr.a (mgr.14373) 409 : cluster [DBG] pgmap v283: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:46:27.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:46:27 smithi086 bash[24289]: cluster 2024-09-16T05:46:25.970792+0000 mgr.a (mgr.14373) 409 : cluster [DBG] pgmap v283: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:46:27.833 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:46:27 smithi047 bash[22744]: cluster 2024-09-16T05:46:25.970792+0000 mgr.a (mgr.14373) 409 : cluster [DBG] pgmap v283: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:46:29.801 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:46:29 smithi157 bash[24585]: cluster 2024-09-16T05:46:27.973000+0000 mgr.a (mgr.14373) 410 : cluster [DBG] pgmap v284: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T05:46:29.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:46:29 smithi086 bash[24289]: cluster 2024-09-16T05:46:27.973000+0000 mgr.a (mgr.14373) 410 : cluster [DBG] pgmap v284: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T05:46:29.833 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:46:29 smithi047 bash[22744]: cluster 2024-09-16T05:46:27.973000+0000 mgr.a (mgr.14373) 410 : cluster [DBG] pgmap v284: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T05:46:30.301 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T05:46:30.302 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T05:46:30.302 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T05:46:31.066 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T05:46:31.067 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T05:46:31.067 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T05:46:31.067 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T05:46:31.067 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T05:46:31.801 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:46:31 smithi157 bash[24585]: cluster 2024-09-16T05:46:29.973755+0000 mgr.a (mgr.14373) 411 : cluster [DBG] pgmap v285: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T05:46:31.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:46:31 smithi086 bash[24289]: cluster 2024-09-16T05:46:29.973755+0000 mgr.a (mgr.14373) 411 : cluster [DBG] pgmap v285: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T05:46:31.833 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:46:31 smithi047 bash[22744]: cluster 2024-09-16T05:46:29.973755+0000 mgr.a (mgr.14373) 411 : cluster [DBG] pgmap v285: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T05:46:32.801 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:46:32 smithi157 bash[24585]: audit 2024-09-16T05:46:30.646516+0000 mgr.a (mgr.14373) 412 : audit [DBG] from='client.22659 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:46:32.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:46:32 smithi086 bash[24289]: audit 2024-09-16T05:46:30.646516+0000 mgr.a (mgr.14373) 412 : audit [DBG] from='client.22659 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:46:32.833 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:46:32 smithi047 bash[22744]: audit 2024-09-16T05:46:30.646516+0000 mgr.a (mgr.14373) 412 : audit [DBG] from='client.22659 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:46:33.801 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:46:33 smithi157 bash[24585]: cluster 2024-09-16T05:46:31.976071+0000 mgr.a (mgr.14373) 413 : cluster [DBG] pgmap v286: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T05:46:33.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:46:33 smithi086 bash[24289]: cluster 2024-09-16T05:46:31.976071+0000 mgr.a (mgr.14373) 413 : cluster [DBG] pgmap v286: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T05:46:33.833 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:46:33 smithi047 bash[22744]: cluster 2024-09-16T05:46:31.976071+0000 mgr.a (mgr.14373) 413 : cluster [DBG] pgmap v286: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T05:46:35.801 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:46:35 smithi157 bash[24585]: cluster 2024-09-16T05:46:33.976864+0000 mgr.a (mgr.14373) 414 : cluster [DBG] pgmap v287: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T05:46:35.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:46:35 smithi086 bash[24289]: cluster 2024-09-16T05:46:33.976864+0000 mgr.a (mgr.14373) 414 : cluster [DBG] pgmap v287: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T05:46:35.833 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:46:35 smithi047 bash[22744]: cluster 2024-09-16T05:46:33.976864+0000 mgr.a (mgr.14373) 414 : cluster [DBG] pgmap v287: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T05:46:36.068 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T05:46:36.069 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T05:46:36.069 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T05:46:36.832 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T05:46:36.832 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T05:46:36.832 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T05:46:36.832 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T05:46:36.832 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T05:46:37.801 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:46:37 smithi157 bash[24585]: cluster 2024-09-16T05:46:35.977763+0000 mgr.a (mgr.14373) 415 : cluster [DBG] pgmap v288: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T05:46:37.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:46:37 smithi086 bash[24289]: cluster 2024-09-16T05:46:35.977763+0000 mgr.a (mgr.14373) 415 : cluster [DBG] pgmap v288: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T05:46:37.833 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:46:37 smithi047 bash[22744]: cluster 2024-09-16T05:46:35.977763+0000 mgr.a (mgr.14373) 415 : cluster [DBG] pgmap v288: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T05:46:38.801 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:46:38 smithi157 bash[24585]: audit 2024-09-16T05:46:36.411301+0000 mgr.a (mgr.14373) 416 : audit [DBG] from='client.22737 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:46:38.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:46:38 smithi086 bash[24289]: audit 2024-09-16T05:46:36.411301+0000 mgr.a (mgr.14373) 416 : audit [DBG] from='client.22737 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:46:38.833 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:46:38 smithi047 bash[22744]: audit 2024-09-16T05:46:36.411301+0000 mgr.a (mgr.14373) 416 : audit [DBG] from='client.22737 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:46:39.801 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:46:39 smithi157 bash[24585]: cluster 2024-09-16T05:46:37.980430+0000 mgr.a (mgr.14373) 417 : cluster [DBG] pgmap v289: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T05:46:39.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:46:39 smithi086 bash[24289]: cluster 2024-09-16T05:46:37.980430+0000 mgr.a (mgr.14373) 417 : cluster [DBG] pgmap v289: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T05:46:39.833 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:46:39 smithi047 bash[22744]: cluster 2024-09-16T05:46:37.980430+0000 mgr.a (mgr.14373) 417 : cluster [DBG] pgmap v289: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T05:46:41.801 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:46:41 smithi157 bash[24585]: cluster 2024-09-16T05:46:39.981218+0000 mgr.a (mgr.14373) 418 : cluster [DBG] pgmap v290: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T05:46:41.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:46:41 smithi086 bash[24289]: cluster 2024-09-16T05:46:39.981218+0000 mgr.a (mgr.14373) 418 : cluster [DBG] pgmap v290: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T05:46:41.833 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:46:41 smithi047 bash[22744]: cluster 2024-09-16T05:46:39.981218+0000 mgr.a (mgr.14373) 418 : cluster [DBG] pgmap v290: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T05:46:41.834 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T05:46:41.834 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T05:46:41.834 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T05:46:42.608 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T05:46:42.608 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T05:46:42.608 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T05:46:42.609 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T05:46:42.609 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T05:46:43.801 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:46:43 smithi157 bash[24585]: cluster 2024-09-16T05:46:41.982749+0000 mgr.a (mgr.14373) 419 : cluster [DBG] pgmap v291: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:46:43.801 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:46:43 smithi157 bash[24585]: audit 2024-09-16T05:46:42.182659+0000 mgr.a (mgr.14373) 420 : audit [DBG] from='client.22815 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:46:43.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:46:43 smithi086 bash[24289]: cluster 2024-09-16T05:46:41.982749+0000 mgr.a (mgr.14373) 419 : cluster [DBG] pgmap v291: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:46:43.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:46:43 smithi086 bash[24289]: audit 2024-09-16T05:46:42.182659+0000 mgr.a (mgr.14373) 420 : audit [DBG] from='client.22815 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:46:43.833 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:46:43 smithi047 bash[22744]: cluster 2024-09-16T05:46:41.982749+0000 mgr.a (mgr.14373) 419 : cluster [DBG] pgmap v291: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:46:43.833 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:46:43 smithi047 bash[22744]: audit 2024-09-16T05:46:42.182659+0000 mgr.a (mgr.14373) 420 : audit [DBG] from='client.22815 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:46:45.801 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:46:45 smithi157 bash[24585]: cluster 2024-09-16T05:46:43.983675+0000 mgr.a (mgr.14373) 421 : cluster [DBG] pgmap v292: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T05:46:45.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:46:45 smithi086 bash[24289]: cluster 2024-09-16T05:46:43.983675+0000 mgr.a (mgr.14373) 421 : cluster [DBG] pgmap v292: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T05:46:45.833 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:46:45 smithi047 bash[22744]: cluster 2024-09-16T05:46:43.983675+0000 mgr.a (mgr.14373) 421 : cluster [DBG] pgmap v292: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T05:46:47.609 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T05:46:47.610 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T05:46:47.610 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T05:46:47.801 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:46:47 smithi157 bash[24585]: cluster 2024-09-16T05:46:45.984450+0000 mgr.a (mgr.14373) 422 : cluster [DBG] pgmap v293: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T05:46:47.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:46:47 smithi086 bash[24289]: cluster 2024-09-16T05:46:45.984450+0000 mgr.a (mgr.14373) 422 : cluster [DBG] pgmap v293: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T05:46:47.833 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:46:47 smithi047 bash[22744]: cluster 2024-09-16T05:46:45.984450+0000 mgr.a (mgr.14373) 422 : cluster [DBG] pgmap v293: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T05:46:48.368 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T05:46:48.368 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T05:46:48.368 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T05:46:48.368 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T05:46:48.368 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T05:46:49.801 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:46:49 smithi157 bash[24585]: audit 2024-09-16T05:46:47.949890+0000 mgr.a (mgr.14373) 423 : audit [DBG] from='client.22893 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:46:49.801 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:46:49 smithi157 bash[24585]: cluster 2024-09-16T05:46:47.987305+0000 mgr.a (mgr.14373) 424 : cluster [DBG] pgmap v294: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:46:49.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:46:49 smithi086 bash[24289]: audit 2024-09-16T05:46:47.949890+0000 mgr.a (mgr.14373) 423 : audit [DBG] from='client.22893 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:46:49.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:46:49 smithi086 bash[24289]: cluster 2024-09-16T05:46:47.987305+0000 mgr.a (mgr.14373) 424 : cluster [DBG] pgmap v294: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:46:49.833 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:46:49 smithi047 bash[22744]: audit 2024-09-16T05:46:47.949890+0000 mgr.a (mgr.14373) 423 : audit [DBG] from='client.22893 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:46:49.833 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:46:49 smithi047 bash[22744]: cluster 2024-09-16T05:46:47.987305+0000 mgr.a (mgr.14373) 424 : cluster [DBG] pgmap v294: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:46:51.801 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:46:51 smithi157 bash[24585]: cluster 2024-09-16T05:46:49.988230+0000 mgr.a (mgr.14373) 425 : cluster [DBG] pgmap v295: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:46:51.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:46:51 smithi086 bash[24289]: cluster 2024-09-16T05:46:49.988230+0000 mgr.a (mgr.14373) 425 : cluster [DBG] pgmap v295: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:46:51.833 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:46:51 smithi047 bash[22744]: cluster 2024-09-16T05:46:49.988230+0000 mgr.a (mgr.14373) 425 : cluster [DBG] pgmap v295: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:46:52.801 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:46:52 smithi157 bash[24585]: cluster 2024-09-16T05:46:51.990434+0000 mgr.a (mgr.14373) 426 : cluster [DBG] pgmap v296: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:46:52.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:46:52 smithi086 bash[24289]: cluster 2024-09-16T05:46:51.990434+0000 mgr.a (mgr.14373) 426 : cluster [DBG] pgmap v296: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:46:52.833 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:46:52 smithi047 bash[22744]: cluster 2024-09-16T05:46:51.990434+0000 mgr.a (mgr.14373) 426 : cluster [DBG] pgmap v296: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:46:53.369 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T05:46:53.370 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T05:46:53.370 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T05:46:54.146 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T05:46:54.146 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T05:46:54.147 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T05:46:54.147 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T05:46:54.147 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T05:46:55.301 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:46:55 smithi157 bash[24585]: audit 2024-09-16T05:46:53.711598+0000 mgr.a (mgr.14373) 427 : audit [DBG] from='client.22971 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:46:55.301 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:46:55 smithi157 bash[24585]: cluster 2024-09-16T05:46:53.991105+0000 mgr.a (mgr.14373) 428 : cluster [DBG] pgmap v297: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:46:55.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:46:55 smithi086 bash[24289]: audit 2024-09-16T05:46:53.711598+0000 mgr.a (mgr.14373) 427 : audit [DBG] from='client.22971 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:46:55.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:46:55 smithi086 bash[24289]: cluster 2024-09-16T05:46:53.991105+0000 mgr.a (mgr.14373) 428 : cluster [DBG] pgmap v297: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:46:55.333 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:46:55 smithi047 bash[22744]: audit 2024-09-16T05:46:53.711598+0000 mgr.a (mgr.14373) 427 : audit [DBG] from='client.22971 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:46:55.333 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:46:55 smithi047 bash[22744]: cluster 2024-09-16T05:46:53.991105+0000 mgr.a (mgr.14373) 428 : cluster [DBG] pgmap v297: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:46:57.301 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:46:57 smithi157 bash[24585]: cluster 2024-09-16T05:46:55.991949+0000 mgr.a (mgr.14373) 429 : cluster [DBG] pgmap v298: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:46:57.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:46:57 smithi086 bash[24289]: cluster 2024-09-16T05:46:55.991949+0000 mgr.a (mgr.14373) 429 : cluster [DBG] pgmap v298: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:46:57.333 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:46:57 smithi047 bash[22744]: cluster 2024-09-16T05:46:55.991949+0000 mgr.a (mgr.14373) 429 : cluster [DBG] pgmap v298: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:46:59.148 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T05:46:59.148 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T05:46:59.148 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T05:46:59.301 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:46:59 smithi157 bash[24585]: cluster 2024-09-16T05:46:57.994137+0000 mgr.a (mgr.14373) 430 : cluster [DBG] pgmap v299: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:46:59.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:46:59 smithi086 bash[24289]: cluster 2024-09-16T05:46:57.994137+0000 mgr.a (mgr.14373) 430 : cluster [DBG] pgmap v299: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:46:59.333 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:46:59 smithi047 bash[22744]: cluster 2024-09-16T05:46:57.994137+0000 mgr.a (mgr.14373) 430 : cluster [DBG] pgmap v299: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:46:59.927 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T05:46:59.927 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T05:46:59.927 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T05:46:59.927 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T05:46:59.927 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T05:47:01.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:47:01 smithi086 bash[24289]: audit 2024-09-16T05:46:59.490802+0000 mgr.a (mgr.14373) 431 : audit [DBG] from='client.23049 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:47:01.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:47:01 smithi086 bash[24289]: cluster 2024-09-16T05:46:59.994652+0000 mgr.a (mgr.14373) 432 : cluster [DBG] pgmap v300: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:47:01.333 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:47:01 smithi047 bash[22744]: audit 2024-09-16T05:46:59.490802+0000 mgr.a (mgr.14373) 431 : audit [DBG] from='client.23049 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:47:01.333 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:47:01 smithi047 bash[22744]: cluster 2024-09-16T05:46:59.994652+0000 mgr.a (mgr.14373) 432 : cluster [DBG] pgmap v300: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:47:01.550 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:47:01 smithi157 bash[24585]: audit 2024-09-16T05:46:59.490802+0000 mgr.a (mgr.14373) 431 : audit [DBG] from='client.23049 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:47:01.551 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:47:01 smithi157 bash[24585]: cluster 2024-09-16T05:46:59.994652+0000 mgr.a (mgr.14373) 432 : cluster [DBG] pgmap v300: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:47:03.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:47:03 smithi086 bash[24289]: cluster 2024-09-16T05:47:01.996777+0000 mgr.a (mgr.14373) 433 : cluster [DBG] pgmap v301: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:47:03.333 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:47:03 smithi047 bash[22744]: cluster 2024-09-16T05:47:01.996777+0000 mgr.a (mgr.14373) 433 : cluster [DBG] pgmap v301: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:47:03.550 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:47:03 smithi157 bash[24585]: cluster 2024-09-16T05:47:01.996777+0000 mgr.a (mgr.14373) 433 : cluster [DBG] pgmap v301: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:47:04.928 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T05:47:04.929 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T05:47:04.929 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T05:47:05.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:47:05 smithi086 bash[24289]: cluster 2024-09-16T05:47:03.997512+0000 mgr.a (mgr.14373) 434 : cluster [DBG] pgmap v302: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:47:05.333 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:47:05 smithi047 bash[22744]: cluster 2024-09-16T05:47:03.997512+0000 mgr.a (mgr.14373) 434 : cluster [DBG] pgmap v302: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:47:05.550 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:47:05 smithi157 bash[24585]: cluster 2024-09-16T05:47:03.997512+0000 mgr.a (mgr.14373) 434 : cluster [DBG] pgmap v302: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:47:05.680 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T05:47:05.680 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T05:47:05.680 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T05:47:05.680 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T05:47:05.680 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T05:47:06.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:47:06 smithi086 bash[24289]: audit 2024-09-16T05:47:05.265628+0000 mgr.a (mgr.14373) 435 : audit [DBG] from='client.23127 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:47:06.333 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:47:06 smithi047 bash[22744]: audit 2024-09-16T05:47:05.265628+0000 mgr.a (mgr.14373) 435 : audit [DBG] from='client.23127 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:47:06.550 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:47:06 smithi157 bash[24585]: audit 2024-09-16T05:47:05.265628+0000 mgr.a (mgr.14373) 435 : audit [DBG] from='client.23127 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:47:07.333 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:47:07 smithi047 bash[22744]: cluster 2024-09-16T05:47:05.998422+0000 mgr.a (mgr.14373) 436 : cluster [DBG] pgmap v303: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:47:07.550 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:47:07 smithi157 bash[24585]: cluster 2024-09-16T05:47:05.998422+0000 mgr.a (mgr.14373) 436 : cluster [DBG] pgmap v303: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:47:07.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:47:07 smithi086 bash[24289]: cluster 2024-09-16T05:47:05.998422+0000 mgr.a (mgr.14373) 436 : cluster [DBG] pgmap v303: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:47:09.333 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:47:09 smithi047 bash[22744]: cluster 2024-09-16T05:47:08.000656+0000 mgr.a (mgr.14373) 437 : cluster [DBG] pgmap v304: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:47:09.550 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:47:09 smithi157 bash[24585]: cluster 2024-09-16T05:47:08.000656+0000 mgr.a (mgr.14373) 437 : cluster [DBG] pgmap v304: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:47:09.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:47:09 smithi086 bash[24289]: cluster 2024-09-16T05:47:08.000656+0000 mgr.a (mgr.14373) 437 : cluster [DBG] pgmap v304: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:47:10.681 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T05:47:10.682 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T05:47:10.682 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T05:47:11.333 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:47:11 smithi047 bash[22744]: cluster 2024-09-16T05:47:10.001357+0000 mgr.a (mgr.14373) 438 : cluster [DBG] pgmap v305: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:47:11.424 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T05:47:11.424 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T05:47:11.425 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T05:47:11.425 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T05:47:11.425 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T05:47:11.550 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:47:11 smithi157 bash[24585]: cluster 2024-09-16T05:47:10.001357+0000 mgr.a (mgr.14373) 438 : cluster [DBG] pgmap v305: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:47:11.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:47:11 smithi086 bash[24289]: cluster 2024-09-16T05:47:10.001357+0000 mgr.a (mgr.14373) 438 : cluster [DBG] pgmap v305: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:47:12.550 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:47:12 smithi157 bash[24585]: audit 2024-09-16T05:47:11.021365+0000 mgr.a (mgr.14373) 439 : audit [DBG] from='client.23199 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:47:12.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:47:12 smithi086 bash[24289]: audit 2024-09-16T05:47:11.021365+0000 mgr.a (mgr.14373) 439 : audit [DBG] from='client.23199 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:47:12.583 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:47:12 smithi047 bash[22744]: audit 2024-09-16T05:47:11.021365+0000 mgr.a (mgr.14373) 439 : audit [DBG] from='client.23199 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:47:13.550 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:47:13 smithi157 bash[24585]: cluster 2024-09-16T05:47:12.003699+0000 mgr.a (mgr.14373) 440 : cluster [DBG] pgmap v306: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:47:13.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:47:13 smithi086 bash[24289]: cluster 2024-09-16T05:47:12.003699+0000 mgr.a (mgr.14373) 440 : cluster [DBG] pgmap v306: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:47:13.584 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:47:13 smithi047 bash[22744]: cluster 2024-09-16T05:47:12.003699+0000 mgr.a (mgr.14373) 440 : cluster [DBG] pgmap v306: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:47:15.550 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:47:15 smithi157 bash[24585]: cluster 2024-09-16T05:47:14.004667+0000 mgr.a (mgr.14373) 441 : cluster [DBG] pgmap v307: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:47:15.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:47:15 smithi086 bash[24289]: cluster 2024-09-16T05:47:14.004667+0000 mgr.a (mgr.14373) 441 : cluster [DBG] pgmap v307: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:47:15.583 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:47:15 smithi047 bash[22744]: cluster 2024-09-16T05:47:14.004667+0000 mgr.a (mgr.14373) 441 : cluster [DBG] pgmap v307: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:47:16.426 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T05:47:16.427 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T05:47:16.427 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T05:47:17.148 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T05:47:17.149 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T05:47:17.149 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T05:47:17.149 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T05:47:17.149 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T05:47:17.550 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:47:17 smithi157 bash[24585]: cluster 2024-09-16T05:47:16.005482+0000 mgr.a (mgr.14373) 442 : cluster [DBG] pgmap v308: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:47:17.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:47:17 smithi086 bash[24289]: cluster 2024-09-16T05:47:16.005482+0000 mgr.a (mgr.14373) 442 : cluster [DBG] pgmap v308: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:47:17.583 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:47:17 smithi047 bash[22744]: cluster 2024-09-16T05:47:16.005482+0000 mgr.a (mgr.14373) 442 : cluster [DBG] pgmap v308: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:47:18.550 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:47:18 smithi157 bash[24585]: audit 2024-09-16T05:47:16.762278+0000 mgr.a (mgr.14373) 443 : audit [DBG] from='client.23277 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:47:18.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:47:18 smithi086 bash[24289]: audit 2024-09-16T05:47:16.762278+0000 mgr.a (mgr.14373) 443 : audit [DBG] from='client.23277 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:47:18.584 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:47:18 smithi047 bash[22744]: audit 2024-09-16T05:47:16.762278+0000 mgr.a (mgr.14373) 443 : audit [DBG] from='client.23277 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:47:19.550 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:47:19 smithi157 bash[24585]: cluster 2024-09-16T05:47:18.008188+0000 mgr.a (mgr.14373) 444 : cluster [DBG] pgmap v309: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:47:19.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:47:19 smithi086 bash[24289]: cluster 2024-09-16T05:47:18.008188+0000 mgr.a (mgr.14373) 444 : cluster [DBG] pgmap v309: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:47:19.583 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:47:19 smithi047 bash[22744]: cluster 2024-09-16T05:47:18.008188+0000 mgr.a (mgr.14373) 444 : cluster [DBG] pgmap v309: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:47:21.550 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:47:21 smithi157 bash[24585]: cluster 2024-09-16T05:47:20.008973+0000 mgr.a (mgr.14373) 445 : cluster [DBG] pgmap v310: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T05:47:21.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:47:21 smithi086 bash[24289]: cluster 2024-09-16T05:47:20.008973+0000 mgr.a (mgr.14373) 445 : cluster [DBG] pgmap v310: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T05:47:21.583 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:47:21 smithi047 bash[22744]: cluster 2024-09-16T05:47:20.008973+0000 mgr.a (mgr.14373) 445 : cluster [DBG] pgmap v310: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T05:47:22.150 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T05:47:22.151 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T05:47:22.151 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T05:47:22.891 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T05:47:22.891 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T05:47:22.891 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T05:47:22.891 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T05:47:22.891 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T05:47:23.550 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:47:23 smithi157 bash[24585]: cluster 2024-09-16T05:47:22.010939+0000 mgr.a (mgr.14373) 446 : cluster [DBG] pgmap v311: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:47:23.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:47:23 smithi086 bash[24289]: cluster 2024-09-16T05:47:22.010939+0000 mgr.a (mgr.14373) 446 : cluster [DBG] pgmap v311: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:47:23.583 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:47:23 smithi047 bash[22744]: cluster 2024-09-16T05:47:22.010939+0000 mgr.a (mgr.14373) 446 : cluster [DBG] pgmap v311: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:47:24.550 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:47:24 smithi157 bash[24585]: audit 2024-09-16T05:47:22.484025+0000 mgr.a (mgr.14373) 447 : audit [DBG] from='client.23352 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:47:24.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:47:24 smithi086 bash[24289]: audit 2024-09-16T05:47:22.484025+0000 mgr.a (mgr.14373) 447 : audit [DBG] from='client.23352 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:47:24.583 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:47:24 smithi047 bash[22744]: audit 2024-09-16T05:47:22.484025+0000 mgr.a (mgr.14373) 447 : audit [DBG] from='client.23352 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:47:25.550 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:47:25 smithi157 bash[24585]: cluster 2024-09-16T05:47:24.011898+0000 mgr.a (mgr.14373) 448 : cluster [DBG] pgmap v312: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T05:47:25.551 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:47:25 smithi157 bash[24585]: audit 2024-09-16T05:47:24.956465+0000 mon.b (mon.2) 88 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T05:47:25.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:47:25 smithi086 bash[24289]: cluster 2024-09-16T05:47:24.011898+0000 mgr.a (mgr.14373) 448 : cluster [DBG] pgmap v312: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T05:47:25.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:47:25 smithi086 bash[24289]: audit 2024-09-16T05:47:24.956465+0000 mon.b (mon.2) 88 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T05:47:25.583 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:47:25 smithi047 bash[22744]: cluster 2024-09-16T05:47:24.011898+0000 mgr.a (mgr.14373) 448 : cluster [DBG] pgmap v312: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T05:47:25.583 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:47:25 smithi047 bash[22744]: audit 2024-09-16T05:47:24.956465+0000 mon.b (mon.2) 88 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T05:47:26.530 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:47:26 smithi047 bash[22744]: audit 2024-09-16T05:47:25.798092+0000 mon.b (mon.2) 89 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T05:47:26.531 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:47:26 smithi047 bash[22744]: audit 2024-09-16T05:47:25.800113+0000 mon.b (mon.2) 90 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T05:47:26.531 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:47:26 smithi047 bash[22744]: audit 2024-09-16T05:47:25.817080+0000 mon.b (mon.2) 91 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T05:47:26.531 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:47:26 smithi047 bash[22744]: audit 2024-09-16T05:47:25.818302+0000 mon.a (mon.0) 591 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T05:47:26.550 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:47:26 smithi157 bash[24585]: audit 2024-09-16T05:47:25.798092+0000 mon.b (mon.2) 89 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T05:47:26.551 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:47:26 smithi157 bash[24585]: audit 2024-09-16T05:47:25.800113+0000 mon.b (mon.2) 90 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T05:47:26.551 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:47:26 smithi157 bash[24585]: audit 2024-09-16T05:47:25.817080+0000 mon.b (mon.2) 91 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T05:47:26.551 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:47:26 smithi157 bash[24585]: audit 2024-09-16T05:47:25.818302+0000 mon.a (mon.0) 591 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T05:47:26.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:47:26 smithi086 bash[24289]: audit 2024-09-16T05:47:25.798092+0000 mon.b (mon.2) 89 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T05:47:26.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:47:26 smithi086 bash[24289]: audit 2024-09-16T05:47:25.800113+0000 mon.b (mon.2) 90 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T05:47:26.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:47:26 smithi086 bash[24289]: audit 2024-09-16T05:47:25.817080+0000 mon.b (mon.2) 91 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T05:47:26.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:47:26 smithi086 bash[24289]: audit 2024-09-16T05:47:25.818302+0000 mon.a (mon.0) 591 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T05:47:26.833 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 05:47:26 smithi047 bash[22994]: debug 2024-09-16T05:47:26.536+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T05:47:26.833 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 05:47:26 smithi047 bash[22994]: debug 2024-09-16T05:47:26.536+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T05:47:27.550 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:47:27 smithi157 bash[24585]: audit 2024-09-16T05:47:25.828469+0000 mgr.a (mgr.14373) 449 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T05:47:27.551 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:47:27 smithi157 bash[24585]: cluster 2024-09-16T05:47:26.012400+0000 mgr.a (mgr.14373) 450 : cluster [DBG] pgmap v313: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T05:47:27.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:47:27 smithi086 bash[24289]: audit 2024-09-16T05:47:25.828469+0000 mgr.a (mgr.14373) 449 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T05:47:27.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:47:27 smithi086 bash[24289]: cluster 2024-09-16T05:47:26.012400+0000 mgr.a (mgr.14373) 450 : cluster [DBG] pgmap v313: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T05:47:27.583 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:47:27 smithi047 bash[22744]: audit 2024-09-16T05:47:25.828469+0000 mgr.a (mgr.14373) 449 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T05:47:27.583 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:47:27 smithi047 bash[22744]: cluster 2024-09-16T05:47:26.012400+0000 mgr.a (mgr.14373) 450 : cluster [DBG] pgmap v313: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T05:47:27.893 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T05:47:27.893 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T05:47:27.894 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T05:47:28.550 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:47:28 smithi157 bash[24585]: audit 2024-09-16T05:47:26.538608+0000 mgr.a (mgr.14373) 451 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T05:47:28.551 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:47:28 smithi157 bash[24585]: cephadm 2024-09-16T05:47:26.540263+0000 mgr.a (mgr.14373) 452 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T05:47:28.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:47:28 smithi086 bash[24289]: audit 2024-09-16T05:47:26.538608+0000 mgr.a (mgr.14373) 451 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T05:47:28.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:47:28 smithi086 bash[24289]: cephadm 2024-09-16T05:47:26.540263+0000 mgr.a (mgr.14373) 452 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T05:47:28.583 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:47:28 smithi047 bash[22744]: audit 2024-09-16T05:47:26.538608+0000 mgr.a (mgr.14373) 451 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T05:47:28.583 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:47:28 smithi047 bash[22744]: cephadm 2024-09-16T05:47:26.540263+0000 mgr.a (mgr.14373) 452 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T05:47:28.663 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T05:47:28.663 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T05:47:28.663 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T05:47:28.663 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T05:47:28.663 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T05:47:29.550 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:47:29 smithi157 bash[24585]: cluster 2024-09-16T05:47:28.013696+0000 mgr.a (mgr.14373) 453 : cluster [DBG] pgmap v314: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 5.5 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-16T05:47:29.551 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:47:29 smithi157 bash[24585]: audit 2024-09-16T05:47:28.240427+0000 mgr.a (mgr.14373) 454 : audit [DBG] from='client.23535 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:47:29.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:47:29 smithi086 bash[24289]: cluster 2024-09-16T05:47:28.013696+0000 mgr.a (mgr.14373) 453 : cluster [DBG] pgmap v314: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 5.5 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-16T05:47:29.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:47:29 smithi086 bash[24289]: audit 2024-09-16T05:47:28.240427+0000 mgr.a (mgr.14373) 454 : audit [DBG] from='client.23535 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:47:29.583 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:47:29 smithi047 bash[22744]: cluster 2024-09-16T05:47:28.013696+0000 mgr.a (mgr.14373) 453 : cluster [DBG] pgmap v314: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 5.5 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-16T05:47:29.583 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:47:29 smithi047 bash[22744]: audit 2024-09-16T05:47:28.240427+0000 mgr.a (mgr.14373) 454 : audit [DBG] from='client.23535 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:47:31.550 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:47:31 smithi157 bash[24585]: cluster 2024-09-16T05:47:30.014653+0000 mgr.a (mgr.14373) 455 : cluster [DBG] pgmap v315: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 5.5 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-16T05:47:31.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:47:31 smithi086 bash[24289]: cluster 2024-09-16T05:47:30.014653+0000 mgr.a (mgr.14373) 455 : cluster [DBG] pgmap v315: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 5.5 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-16T05:47:31.583 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:47:31 smithi047 bash[22744]: cluster 2024-09-16T05:47:30.014653+0000 mgr.a (mgr.14373) 455 : cluster [DBG] pgmap v315: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 5.5 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-16T05:47:33.550 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:47:33 smithi157 bash[24585]: cluster 2024-09-16T05:47:32.016910+0000 mgr.a (mgr.14373) 456 : cluster [DBG] pgmap v316: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T05:47:33.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:47:33 smithi086 bash[24289]: cluster 2024-09-16T05:47:32.016910+0000 mgr.a (mgr.14373) 456 : cluster [DBG] pgmap v316: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T05:47:33.583 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:47:33 smithi047 bash[22744]: cluster 2024-09-16T05:47:32.016910+0000 mgr.a (mgr.14373) 456 : cluster [DBG] pgmap v316: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T05:47:33.665 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T05:47:33.665 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T05:47:33.665 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T05:47:34.423 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T05:47:34.423 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T05:47:34.424 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T05:47:34.424 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T05:47:34.424 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T05:47:35.550 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:47:35 smithi157 bash[24585]: audit 2024-09-16T05:47:34.008620+0000 mgr.a (mgr.14373) 457 : audit [DBG] from='client.23610 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:47:35.550 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:47:35 smithi157 bash[24585]: cluster 2024-09-16T05:47:34.020298+0000 mgr.a (mgr.14373) 458 : cluster [DBG] pgmap v317: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T05:47:35.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:47:35 smithi086 bash[24289]: audit 2024-09-16T05:47:34.008620+0000 mgr.a (mgr.14373) 457 : audit [DBG] from='client.23610 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:47:35.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:47:35 smithi086 bash[24289]: cluster 2024-09-16T05:47:34.020298+0000 mgr.a (mgr.14373) 458 : cluster [DBG] pgmap v317: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T05:47:35.583 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:47:35 smithi047 bash[22744]: audit 2024-09-16T05:47:34.008620+0000 mgr.a (mgr.14373) 457 : audit [DBG] from='client.23610 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:47:35.583 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:47:35 smithi047 bash[22744]: cluster 2024-09-16T05:47:34.020298+0000 mgr.a (mgr.14373) 458 : cluster [DBG] pgmap v317: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T05:47:37.550 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:47:37 smithi157 bash[24585]: cluster 2024-09-16T05:47:36.021361+0000 mgr.a (mgr.14373) 459 : cluster [DBG] pgmap v318: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T05:47:37.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:47:37 smithi086 bash[24289]: cluster 2024-09-16T05:47:36.021361+0000 mgr.a (mgr.14373) 459 : cluster [DBG] pgmap v318: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T05:47:37.583 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:47:37 smithi047 bash[22744]: cluster 2024-09-16T05:47:36.021361+0000 mgr.a (mgr.14373) 459 : cluster [DBG] pgmap v318: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T05:47:39.425 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T05:47:39.426 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T05:47:39.426 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T05:47:39.550 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:47:39 smithi157 bash[24585]: cluster 2024-09-16T05:47:38.023604+0000 mgr.a (mgr.14373) 460 : cluster [DBG] pgmap v319: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T05:47:39.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:47:39 smithi086 bash[24289]: cluster 2024-09-16T05:47:38.023604+0000 mgr.a (mgr.14373) 460 : cluster [DBG] pgmap v319: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T05:47:39.583 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:47:39 smithi047 bash[22744]: cluster 2024-09-16T05:47:38.023604+0000 mgr.a (mgr.14373) 460 : cluster [DBG] pgmap v319: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T05:47:40.203 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T05:47:40.203 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T05:47:40.203 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T05:47:40.203 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T05:47:40.203 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T05:47:41.551 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:47:41 smithi157 bash[24585]: audit 2024-09-16T05:47:39.774308+0000 mgr.a (mgr.14373) 461 : audit [DBG] from='client.23685 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:47:41.551 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:47:41 smithi157 bash[24585]: cluster 2024-09-16T05:47:40.024174+0000 mgr.a (mgr.14373) 462 : cluster [DBG] pgmap v320: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 3.3 KiB/s rd, 170 B/s wr, 3 op/s 2024-09-16T05:47:41.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:47:41 smithi086 bash[24289]: audit 2024-09-16T05:47:39.774308+0000 mgr.a (mgr.14373) 461 : audit [DBG] from='client.23685 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:47:41.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:47:41 smithi086 bash[24289]: cluster 2024-09-16T05:47:40.024174+0000 mgr.a (mgr.14373) 462 : cluster [DBG] pgmap v320: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 3.3 KiB/s rd, 170 B/s wr, 3 op/s 2024-09-16T05:47:41.583 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:47:41 smithi047 bash[22744]: audit 2024-09-16T05:47:39.774308+0000 mgr.a (mgr.14373) 461 : audit [DBG] from='client.23685 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:47:41.583 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:47:41 smithi047 bash[22744]: cluster 2024-09-16T05:47:40.024174+0000 mgr.a (mgr.14373) 462 : cluster [DBG] pgmap v320: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 3.3 KiB/s rd, 170 B/s wr, 3 op/s 2024-09-16T05:47:43.550 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:47:43 smithi157 bash[24585]: cluster 2024-09-16T05:47:42.026415+0000 mgr.a (mgr.14373) 463 : cluster [DBG] pgmap v321: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 4.2 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-16T05:47:43.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:47:43 smithi086 bash[24289]: cluster 2024-09-16T05:47:42.026415+0000 mgr.a (mgr.14373) 463 : cluster [DBG] pgmap v321: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 4.2 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-16T05:47:43.583 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:47:43 smithi047 bash[22744]: cluster 2024-09-16T05:47:42.026415+0000 mgr.a (mgr.14373) 463 : cluster [DBG] pgmap v321: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 4.2 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-16T05:47:45.204 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T05:47:45.205 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T05:47:45.205 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T05:47:45.550 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:47:45 smithi157 bash[24585]: cluster 2024-09-16T05:47:44.027146+0000 mgr.a (mgr.14373) 464 : cluster [DBG] pgmap v322: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:47:45.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:47:45 smithi086 bash[24289]: cluster 2024-09-16T05:47:44.027146+0000 mgr.a (mgr.14373) 464 : cluster [DBG] pgmap v322: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:47:45.583 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:47:45 smithi047 bash[22744]: cluster 2024-09-16T05:47:44.027146+0000 mgr.a (mgr.14373) 464 : cluster [DBG] pgmap v322: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:47:45.972 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T05:47:45.972 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T05:47:45.973 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T05:47:45.973 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T05:47:45.973 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T05:47:47.550 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:47:47 smithi157 bash[24585]: audit 2024-09-16T05:47:45.549107+0000 mgr.a (mgr.14373) 465 : audit [DBG] from='client.23763 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:47:47.551 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:47:47 smithi157 bash[24585]: cluster 2024-09-16T05:47:46.028060+0000 mgr.a (mgr.14373) 466 : cluster [DBG] pgmap v323: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:47:47.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:47:47 smithi086 bash[24289]: audit 2024-09-16T05:47:45.549107+0000 mgr.a (mgr.14373) 465 : audit [DBG] from='client.23763 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:47:47.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:47:47 smithi086 bash[24289]: cluster 2024-09-16T05:47:46.028060+0000 mgr.a (mgr.14373) 466 : cluster [DBG] pgmap v323: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:47:47.584 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:47:47 smithi047 bash[22744]: audit 2024-09-16T05:47:45.549107+0000 mgr.a (mgr.14373) 465 : audit [DBG] from='client.23763 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:47:47.584 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:47:47 smithi047 bash[22744]: cluster 2024-09-16T05:47:46.028060+0000 mgr.a (mgr.14373) 466 : cluster [DBG] pgmap v323: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:47:49.550 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:47:49 smithi157 bash[24585]: cluster 2024-09-16T05:47:48.030284+0000 mgr.a (mgr.14373) 467 : cluster [DBG] pgmap v324: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:47:49.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:47:49 smithi086 bash[24289]: cluster 2024-09-16T05:47:48.030284+0000 mgr.a (mgr.14373) 467 : cluster [DBG] pgmap v324: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:47:49.583 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:47:49 smithi047 bash[22744]: cluster 2024-09-16T05:47:48.030284+0000 mgr.a (mgr.14373) 467 : cluster [DBG] pgmap v324: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:47:50.974 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T05:47:50.975 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T05:47:50.975 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T05:47:51.550 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:47:51 smithi157 bash[24585]: cluster 2024-09-16T05:47:50.031052+0000 mgr.a (mgr.14373) 468 : cluster [DBG] pgmap v325: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:47:51.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:47:51 smithi086 bash[24289]: cluster 2024-09-16T05:47:50.031052+0000 mgr.a (mgr.14373) 468 : cluster [DBG] pgmap v325: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:47:51.583 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:47:51 smithi047 bash[22744]: cluster 2024-09-16T05:47:50.031052+0000 mgr.a (mgr.14373) 468 : cluster [DBG] pgmap v325: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:47:51.751 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T05:47:51.752 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T05:47:51.752 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T05:47:51.752 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T05:47:51.752 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T05:47:52.550 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:47:52 smithi157 bash[24585]: audit 2024-09-16T05:47:51.318675+0000 mgr.a (mgr.14373) 469 : audit [DBG] from='client.23838 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:47:52.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:47:52 smithi086 bash[24289]: audit 2024-09-16T05:47:51.318675+0000 mgr.a (mgr.14373) 469 : audit [DBG] from='client.23838 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:47:52.583 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:47:52 smithi047 bash[22744]: audit 2024-09-16T05:47:51.318675+0000 mgr.a (mgr.14373) 469 : audit [DBG] from='client.23838 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:47:53.550 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:47:53 smithi157 bash[24585]: cluster 2024-09-16T05:47:52.033920+0000 mgr.a (mgr.14373) 470 : cluster [DBG] pgmap v326: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:47:53.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:47:53 smithi086 bash[24289]: cluster 2024-09-16T05:47:52.033920+0000 mgr.a (mgr.14373) 470 : cluster [DBG] pgmap v326: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:47:53.583 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:47:53 smithi047 bash[22744]: cluster 2024-09-16T05:47:52.033920+0000 mgr.a (mgr.14373) 470 : cluster [DBG] pgmap v326: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:47:55.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:47:55 smithi157 bash[24585]: cluster 2024-09-16T05:47:54.034908+0000 mgr.a (mgr.14373) 471 : cluster [DBG] pgmap v327: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T05:47:55.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:47:55 smithi086 bash[24289]: cluster 2024-09-16T05:47:54.034908+0000 mgr.a (mgr.14373) 471 : cluster [DBG] pgmap v327: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T05:47:55.583 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:47:55 smithi047 bash[22744]: cluster 2024-09-16T05:47:54.034908+0000 mgr.a (mgr.14373) 471 : cluster [DBG] pgmap v327: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T05:47:56.753 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T05:47:56.753 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T05:47:56.754 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T05:47:57.501 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T05:47:57.501 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T05:47:57.502 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T05:47:57.502 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T05:47:57.502 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T05:47:57.550 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:47:57 smithi157 bash[24585]: cluster 2024-09-16T05:47:56.035834+0000 mgr.a (mgr.14373) 472 : cluster [DBG] pgmap v328: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T05:47:57.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:47:57 smithi086 bash[24289]: cluster 2024-09-16T05:47:56.035834+0000 mgr.a (mgr.14373) 472 : cluster [DBG] pgmap v328: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T05:47:57.583 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:47:57 smithi047 bash[22744]: cluster 2024-09-16T05:47:56.035834+0000 mgr.a (mgr.14373) 472 : cluster [DBG] pgmap v328: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T05:47:58.550 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:47:58 smithi157 bash[24585]: audit 2024-09-16T05:47:57.093963+0000 mgr.a (mgr.14373) 473 : audit [DBG] from='client.23916 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:47:58.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:47:58 smithi086 bash[24289]: audit 2024-09-16T05:47:57.093963+0000 mgr.a (mgr.14373) 473 : audit [DBG] from='client.23916 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:47:58.583 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:47:58 smithi047 bash[22744]: audit 2024-09-16T05:47:57.093963+0000 mgr.a (mgr.14373) 473 : audit [DBG] from='client.23916 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:47:59.550 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:47:59 smithi157 bash[24585]: cluster 2024-09-16T05:47:58.038686+0000 mgr.a (mgr.14373) 474 : cluster [DBG] pgmap v329: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:47:59.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:47:59 smithi086 bash[24289]: cluster 2024-09-16T05:47:58.038686+0000 mgr.a (mgr.14373) 474 : cluster [DBG] pgmap v329: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:47:59.583 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:47:59 smithi047 bash[22744]: cluster 2024-09-16T05:47:58.038686+0000 mgr.a (mgr.14373) 474 : cluster [DBG] pgmap v329: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:48:01.550 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:48:01 smithi157 bash[24585]: cluster 2024-09-16T05:48:00.039429+0000 mgr.a (mgr.14373) 475 : cluster [DBG] pgmap v330: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T05:48:01.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:48:01 smithi086 bash[24289]: cluster 2024-09-16T05:48:00.039429+0000 mgr.a (mgr.14373) 475 : cluster [DBG] pgmap v330: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T05:48:01.583 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:48:01 smithi047 bash[22744]: cluster 2024-09-16T05:48:00.039429+0000 mgr.a (mgr.14373) 475 : cluster [DBG] pgmap v330: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T05:48:02.503 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T05:48:02.504 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T05:48:02.504 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T05:48:03.300 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T05:48:03.300 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T05:48:03.300 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T05:48:03.300 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T05:48:03.300 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T05:48:03.550 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:48:03 smithi157 bash[24585]: cluster 2024-09-16T05:48:02.041383+0000 mgr.a (mgr.14373) 476 : cluster [DBG] pgmap v331: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:48:03.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:48:03 smithi086 bash[24289]: cluster 2024-09-16T05:48:02.041383+0000 mgr.a (mgr.14373) 476 : cluster [DBG] pgmap v331: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:48:03.583 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:48:03 smithi047 bash[22744]: cluster 2024-09-16T05:48:02.041383+0000 mgr.a (mgr.14373) 476 : cluster [DBG] pgmap v331: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:48:04.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:48:04 smithi157 bash[24585]: audit 2024-09-16T05:48:02.847557+0000 mgr.a (mgr.14373) 477 : audit [DBG] from='client.23994 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:48:04.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:48:04 smithi086 bash[24289]: audit 2024-09-16T05:48:02.847557+0000 mgr.a (mgr.14373) 477 : audit [DBG] from='client.23994 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:48:04.583 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:48:04 smithi047 bash[22744]: audit 2024-09-16T05:48:02.847557+0000 mgr.a (mgr.14373) 477 : audit [DBG] from='client.23994 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:48:05.550 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:48:05 smithi157 bash[24585]: cluster 2024-09-16T05:48:04.042390+0000 mgr.a (mgr.14373) 478 : cluster [DBG] pgmap v332: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:48:05.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:48:05 smithi086 bash[24289]: cluster 2024-09-16T05:48:04.042390+0000 mgr.a (mgr.14373) 478 : cluster [DBG] pgmap v332: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:48:05.583 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:48:05 smithi047 bash[22744]: cluster 2024-09-16T05:48:04.042390+0000 mgr.a (mgr.14373) 478 : cluster [DBG] pgmap v332: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:48:07.550 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:48:07 smithi157 bash[24585]: cluster 2024-09-16T05:48:06.043181+0000 mgr.a (mgr.14373) 479 : cluster [DBG] pgmap v333: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:48:07.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:48:07 smithi086 bash[24289]: cluster 2024-09-16T05:48:06.043181+0000 mgr.a (mgr.14373) 479 : cluster [DBG] pgmap v333: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:48:07.583 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:48:07 smithi047 bash[22744]: cluster 2024-09-16T05:48:06.043181+0000 mgr.a (mgr.14373) 479 : cluster [DBG] pgmap v333: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:48:08.302 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T05:48:08.302 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T05:48:08.303 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T05:48:09.070 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T05:48:09.070 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T05:48:09.070 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T05:48:09.070 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T05:48:09.070 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T05:48:09.550 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:48:09 smithi157 bash[24585]: cluster 2024-09-16T05:48:08.045437+0000 mgr.a (mgr.14373) 480 : cluster [DBG] pgmap v334: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 46 KiB/s rd, 0 B/s wr, 75 op/s 2024-09-16T05:48:09.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:48:09 smithi086 bash[24289]: cluster 2024-09-16T05:48:08.045437+0000 mgr.a (mgr.14373) 480 : cluster [DBG] pgmap v334: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 46 KiB/s rd, 0 B/s wr, 75 op/s 2024-09-16T05:48:09.583 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:48:09 smithi047 bash[22744]: cluster 2024-09-16T05:48:08.045437+0000 mgr.a (mgr.14373) 480 : cluster [DBG] pgmap v334: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 46 KiB/s rd, 0 B/s wr, 75 op/s 2024-09-16T05:48:10.550 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:48:10 smithi157 bash[24585]: audit 2024-09-16T05:48:08.643701+0000 mgr.a (mgr.14373) 481 : audit [DBG] from='client.24072 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:48:10.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:48:10 smithi086 bash[24289]: audit 2024-09-16T05:48:08.643701+0000 mgr.a (mgr.14373) 481 : audit [DBG] from='client.24072 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:48:10.583 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:48:10 smithi047 bash[22744]: audit 2024-09-16T05:48:08.643701+0000 mgr.a (mgr.14373) 481 : audit [DBG] from='client.24072 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:48:11.550 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:48:11 smithi157 bash[24585]: cluster 2024-09-16T05:48:10.046407+0000 mgr.a (mgr.14373) 482 : cluster [DBG] pgmap v335: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 46 KiB/s rd, 0 B/s wr, 74 op/s 2024-09-16T05:48:11.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:48:11 smithi086 bash[24289]: cluster 2024-09-16T05:48:10.046407+0000 mgr.a (mgr.14373) 482 : cluster [DBG] pgmap v335: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 46 KiB/s rd, 0 B/s wr, 74 op/s 2024-09-16T05:48:11.583 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:48:11 smithi047 bash[22744]: cluster 2024-09-16T05:48:10.046407+0000 mgr.a (mgr.14373) 482 : cluster [DBG] pgmap v335: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 46 KiB/s rd, 0 B/s wr, 74 op/s 2024-09-16T05:48:13.550 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:48:13 smithi157 bash[24585]: cluster 2024-09-16T05:48:12.048591+0000 mgr.a (mgr.14373) 483 : cluster [DBG] pgmap v336: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 46 KiB/s rd, 0 B/s wr, 75 op/s 2024-09-16T05:48:13.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:48:13 smithi086 bash[24289]: cluster 2024-09-16T05:48:12.048591+0000 mgr.a (mgr.14373) 483 : cluster [DBG] pgmap v336: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 46 KiB/s rd, 0 B/s wr, 75 op/s 2024-09-16T05:48:13.584 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:48:13 smithi047 bash[22744]: cluster 2024-09-16T05:48:12.048591+0000 mgr.a (mgr.14373) 483 : cluster [DBG] pgmap v336: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 46 KiB/s rd, 0 B/s wr, 75 op/s 2024-09-16T05:48:14.072 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T05:48:14.073 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T05:48:14.073 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T05:48:14.838 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T05:48:14.839 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T05:48:14.839 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T05:48:14.839 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T05:48:14.839 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T05:48:15.550 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:48:15 smithi157 bash[24585]: cluster 2024-09-16T05:48:14.049358+0000 mgr.a (mgr.14373) 484 : cluster [DBG] pgmap v337: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 46 KiB/s rd, 0 B/s wr, 74 op/s 2024-09-16T05:48:15.550 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:48:15 smithi157 bash[24585]: audit 2024-09-16T05:48:14.419694+0000 mgr.a (mgr.14373) 485 : audit [DBG] from='client.24141 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:48:15.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:48:15 smithi086 bash[24289]: cluster 2024-09-16T05:48:14.049358+0000 mgr.a (mgr.14373) 484 : cluster [DBG] pgmap v337: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 46 KiB/s rd, 0 B/s wr, 74 op/s 2024-09-16T05:48:15.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:48:15 smithi086 bash[24289]: audit 2024-09-16T05:48:14.419694+0000 mgr.a (mgr.14373) 485 : audit [DBG] from='client.24141 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:48:15.584 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:48:15 smithi047 bash[22744]: cluster 2024-09-16T05:48:14.049358+0000 mgr.a (mgr.14373) 484 : cluster [DBG] pgmap v337: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 46 KiB/s rd, 0 B/s wr, 74 op/s 2024-09-16T05:48:15.585 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:48:15 smithi047 bash[22744]: audit 2024-09-16T05:48:14.419694+0000 mgr.a (mgr.14373) 485 : audit [DBG] from='client.24141 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:48:17.550 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:48:17 smithi157 bash[24585]: cluster 2024-09-16T05:48:16.050332+0000 mgr.a (mgr.14373) 486 : cluster [DBG] pgmap v338: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 46 KiB/s rd, 0 B/s wr, 74 op/s 2024-09-16T05:48:17.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:48:17 smithi086 bash[24289]: cluster 2024-09-16T05:48:16.050332+0000 mgr.a (mgr.14373) 486 : cluster [DBG] pgmap v338: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 46 KiB/s rd, 0 B/s wr, 74 op/s 2024-09-16T05:48:17.583 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:48:17 smithi047 bash[22744]: cluster 2024-09-16T05:48:16.050332+0000 mgr.a (mgr.14373) 486 : cluster [DBG] pgmap v338: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 46 KiB/s rd, 0 B/s wr, 74 op/s 2024-09-16T05:48:19.550 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:48:19 smithi157 bash[24585]: cluster 2024-09-16T05:48:18.052578+0000 mgr.a (mgr.14373) 487 : cluster [DBG] pgmap v339: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 46 KiB/s rd, 0 B/s wr, 75 op/s 2024-09-16T05:48:19.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:48:19 smithi086 bash[24289]: cluster 2024-09-16T05:48:18.052578+0000 mgr.a (mgr.14373) 487 : cluster [DBG] pgmap v339: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 46 KiB/s rd, 0 B/s wr, 75 op/s 2024-09-16T05:48:19.583 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:48:19 smithi047 bash[22744]: cluster 2024-09-16T05:48:18.052578+0000 mgr.a (mgr.14373) 487 : cluster [DBG] pgmap v339: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 46 KiB/s rd, 0 B/s wr, 75 op/s 2024-09-16T05:48:19.840 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T05:48:19.841 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T05:48:19.841 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T05:48:20.578 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T05:48:20.579 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T05:48:20.579 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T05:48:20.579 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T05:48:20.579 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T05:48:21.550 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:48:21 smithi157 bash[24585]: cluster 2024-09-16T05:48:20.053322+0000 mgr.a (mgr.14373) 488 : cluster [DBG] pgmap v340: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:48:21.550 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:48:21 smithi157 bash[24585]: audit 2024-09-16T05:48:20.174100+0000 mgr.a (mgr.14373) 489 : audit [DBG] from='client.24216 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:48:21.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:48:21 smithi086 bash[24289]: cluster 2024-09-16T05:48:20.053322+0000 mgr.a (mgr.14373) 488 : cluster [DBG] pgmap v340: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:48:21.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:48:21 smithi086 bash[24289]: audit 2024-09-16T05:48:20.174100+0000 mgr.a (mgr.14373) 489 : audit [DBG] from='client.24216 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:48:21.583 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:48:21 smithi047 bash[22744]: cluster 2024-09-16T05:48:20.053322+0000 mgr.a (mgr.14373) 488 : cluster [DBG] pgmap v340: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:48:21.584 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:48:21 smithi047 bash[22744]: audit 2024-09-16T05:48:20.174100+0000 mgr.a (mgr.14373) 489 : audit [DBG] from='client.24216 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:48:23.550 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:48:23 smithi157 bash[24585]: cluster 2024-09-16T05:48:22.055629+0000 mgr.a (mgr.14373) 490 : cluster [DBG] pgmap v341: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:48:23.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:48:23 smithi086 bash[24289]: cluster 2024-09-16T05:48:22.055629+0000 mgr.a (mgr.14373) 490 : cluster [DBG] pgmap v341: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:48:23.584 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:48:23 smithi047 bash[22744]: cluster 2024-09-16T05:48:22.055629+0000 mgr.a (mgr.14373) 490 : cluster [DBG] pgmap v341: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:48:25.550 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:48:25 smithi157 bash[24585]: cluster 2024-09-16T05:48:24.056410+0000 mgr.a (mgr.14373) 491 : cluster [DBG] pgmap v342: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:48:25.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:48:25 smithi086 bash[24289]: cluster 2024-09-16T05:48:24.056410+0000 mgr.a (mgr.14373) 491 : cluster [DBG] pgmap v342: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:48:25.580 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T05:48:25.581 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T05:48:25.581 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T05:48:25.583 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:48:25 smithi047 bash[22744]: cluster 2024-09-16T05:48:24.056410+0000 mgr.a (mgr.14373) 491 : cluster [DBG] pgmap v342: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:48:26.337 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T05:48:26.338 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T05:48:26.338 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T05:48:26.338 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T05:48:26.338 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T05:48:27.550 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:48:27 smithi157 bash[24585]: audit 2024-09-16T05:48:25.921135+0000 mgr.a (mgr.14373) 492 : audit [DBG] from='client.24294 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:48:27.550 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:48:27 smithi157 bash[24585]: cluster 2024-09-16T05:48:26.057423+0000 mgr.a (mgr.14373) 493 : cluster [DBG] pgmap v343: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:48:27.550 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:48:27 smithi157 bash[24585]: audit 2024-09-16T05:48:26.583135+0000 mon.b (mon.2) 92 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T05:48:27.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:48:27 smithi086 bash[24289]: audit 2024-09-16T05:48:25.921135+0000 mgr.a (mgr.14373) 492 : audit [DBG] from='client.24294 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:48:27.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:48:27 smithi086 bash[24289]: cluster 2024-09-16T05:48:26.057423+0000 mgr.a (mgr.14373) 493 : cluster [DBG] pgmap v343: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:48:27.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:48:27 smithi086 bash[24289]: audit 2024-09-16T05:48:26.583135+0000 mon.b (mon.2) 92 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T05:48:27.584 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:48:27 smithi047 bash[22744]: audit 2024-09-16T05:48:25.921135+0000 mgr.a (mgr.14373) 492 : audit [DBG] from='client.24294 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:48:27.584 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:48:27 smithi047 bash[22744]: cluster 2024-09-16T05:48:26.057423+0000 mgr.a (mgr.14373) 493 : cluster [DBG] pgmap v343: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:48:27.584 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:48:27 smithi047 bash[22744]: audit 2024-09-16T05:48:26.583135+0000 mon.b (mon.2) 92 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T05:48:29.550 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:48:29 smithi157 bash[24585]: cluster 2024-09-16T05:48:28.059787+0000 mgr.a (mgr.14373) 494 : cluster [DBG] pgmap v344: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:48:29.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:48:29 smithi086 bash[24289]: cluster 2024-09-16T05:48:28.059787+0000 mgr.a (mgr.14373) 494 : cluster [DBG] pgmap v344: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:48:29.584 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:48:29 smithi047 bash[22744]: cluster 2024-09-16T05:48:28.059787+0000 mgr.a (mgr.14373) 494 : cluster [DBG] pgmap v344: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:48:31.339 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T05:48:31.339 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T05:48:31.340 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T05:48:31.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:48:31 smithi086 bash[24289]: cluster 2024-09-16T05:48:30.060722+0000 mgr.a (mgr.14373) 495 : cluster [DBG] pgmap v345: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:48:31.584 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:48:31 smithi047 bash[22744]: cluster 2024-09-16T05:48:30.060722+0000 mgr.a (mgr.14373) 495 : cluster [DBG] pgmap v345: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:48:31.800 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:48:31 smithi157 bash[24585]: cluster 2024-09-16T05:48:30.060722+0000 mgr.a (mgr.14373) 495 : cluster [DBG] pgmap v345: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:48:32.114 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T05:48:32.114 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T05:48:32.114 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T05:48:32.114 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T05:48:32.115 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T05:48:33.301 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:48:32 smithi157 bash[24585]: audit 2024-09-16T05:48:31.682044+0000 mgr.a (mgr.14373) 496 : audit [DBG] from='client.24372 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:48:33.301 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:48:32 smithi157 bash[24585]: audit 2024-09-16T05:48:31.943344+0000 mon.a (mon.0) 592 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T05:48:33.301 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:48:32 smithi157 bash[24585]: audit 2024-09-16T05:48:31.949249+0000 mon.a (mon.0) 593 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T05:48:33.301 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:48:32 smithi157 bash[24585]: audit 2024-09-16T05:48:31.956440+0000 mon.a (mon.0) 594 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T05:48:33.301 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:48:32 smithi157 bash[24585]: audit 2024-09-16T05:48:31.961640+0000 mon.a (mon.0) 595 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T05:48:33.301 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:48:32 smithi157 bash[24585]: audit 2024-09-16T05:48:31.966358+0000 mon.a (mon.0) 596 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T05:48:33.301 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:48:32 smithi157 bash[24585]: audit 2024-09-16T05:48:31.971451+0000 mon.a (mon.0) 597 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T05:48:33.301 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:48:32 smithi157 bash[24585]: cluster 2024-09-16T05:48:32.062037+0000 mgr.a (mgr.14373) 497 : cluster [DBG] pgmap v346: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:48:33.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:48:32 smithi157 bash[24585]: audit 2024-09-16T05:48:32.699643+0000 mon.b (mon.2) 93 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-16T05:48:33.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:48:32 smithi157 bash[24585]: audit 2024-09-16T05:48:32.700208+0000 mon.b (mon.2) 94 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-16T05:48:33.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:48:32 smithi157 bash[24585]: audit 2024-09-16T05:48:32.708650+0000 mon.a (mon.0) 598 : audit [INF] from='mgr.14373 ' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-16T05:48:33.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:48:32 smithi157 bash[24585]: audit 2024-09-16T05:48:32.709604+0000 mon.a (mon.0) 599 : audit [INF] from='mgr.14373 ' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-16T05:48:33.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:48:32 smithi157 bash[24585]: audit 2024-09-16T05:48:32.717470+0000 mon.a (mon.0) 600 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T05:48:33.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:48:32 smithi157 bash[24585]: audit 2024-09-16T05:48:32.724539+0000 mon.b (mon.2) 95 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T05:48:33.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:48:32 smithi157 bash[24585]: audit 2024-09-16T05:48:32.725187+0000 mon.a (mon.0) 601 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T05:48:33.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:48:32 smithi157 bash[24585]: audit 2024-09-16T05:48:32.726608+0000 mon.b (mon.2) 96 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T05:48:33.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:48:32 smithi157 bash[24585]: audit 2024-09-16T05:48:32.744506+0000 mon.b (mon.2) 97 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T05:48:33.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:48:32 smithi157 bash[24585]: audit 2024-09-16T05:48:32.745419+0000 mon.a (mon.0) 602 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T05:48:33.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:48:32 smithi086 bash[24289]: audit 2024-09-16T05:48:31.682044+0000 mgr.a (mgr.14373) 496 : audit [DBG] from='client.24372 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:48:33.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:48:32 smithi086 bash[24289]: audit 2024-09-16T05:48:31.943344+0000 mon.a (mon.0) 592 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T05:48:33.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:48:32 smithi086 bash[24289]: audit 2024-09-16T05:48:31.949249+0000 mon.a (mon.0) 593 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T05:48:33.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:48:32 smithi086 bash[24289]: audit 2024-09-16T05:48:31.956440+0000 mon.a (mon.0) 594 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T05:48:33.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:48:32 smithi086 bash[24289]: audit 2024-09-16T05:48:31.961640+0000 mon.a (mon.0) 595 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T05:48:33.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:48:32 smithi086 bash[24289]: audit 2024-09-16T05:48:31.966358+0000 mon.a (mon.0) 596 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T05:48:33.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:48:32 smithi086 bash[24289]: audit 2024-09-16T05:48:31.971451+0000 mon.a (mon.0) 597 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T05:48:33.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:48:32 smithi086 bash[24289]: cluster 2024-09-16T05:48:32.062037+0000 mgr.a (mgr.14373) 497 : cluster [DBG] pgmap v346: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:48:33.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:48:32 smithi086 bash[24289]: audit 2024-09-16T05:48:32.699643+0000 mon.b (mon.2) 93 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-16T05:48:33.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:48:32 smithi086 bash[24289]: audit 2024-09-16T05:48:32.700208+0000 mon.b (mon.2) 94 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-16T05:48:33.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:48:32 smithi086 bash[24289]: audit 2024-09-16T05:48:32.708650+0000 mon.a (mon.0) 598 : audit [INF] from='mgr.14373 ' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-16T05:48:33.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:48:32 smithi086 bash[24289]: audit 2024-09-16T05:48:32.709604+0000 mon.a (mon.0) 599 : audit [INF] from='mgr.14373 ' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-16T05:48:33.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:48:32 smithi086 bash[24289]: audit 2024-09-16T05:48:32.717470+0000 mon.a (mon.0) 600 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T05:48:33.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:48:32 smithi086 bash[24289]: audit 2024-09-16T05:48:32.724539+0000 mon.b (mon.2) 95 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T05:48:33.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:48:32 smithi086 bash[24289]: audit 2024-09-16T05:48:32.725187+0000 mon.a (mon.0) 601 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T05:48:33.322 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:48:32 smithi086 bash[24289]: audit 2024-09-16T05:48:32.726608+0000 mon.b (mon.2) 96 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T05:48:33.322 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:48:32 smithi086 bash[24289]: audit 2024-09-16T05:48:32.744506+0000 mon.b (mon.2) 97 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T05:48:33.322 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:48:32 smithi086 bash[24289]: audit 2024-09-16T05:48:32.745419+0000 mon.a (mon.0) 602 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T05:48:33.334 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:48:32 smithi047 bash[22744]: audit 2024-09-16T05:48:31.682044+0000 mgr.a (mgr.14373) 496 : audit [DBG] from='client.24372 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:48:33.334 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:48:32 smithi047 bash[22744]: audit 2024-09-16T05:48:31.943344+0000 mon.a (mon.0) 592 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T05:48:33.334 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:48:32 smithi047 bash[22744]: audit 2024-09-16T05:48:31.949249+0000 mon.a (mon.0) 593 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T05:48:33.334 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:48:32 smithi047 bash[22744]: audit 2024-09-16T05:48:31.956440+0000 mon.a (mon.0) 594 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T05:48:33.334 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:48:32 smithi047 bash[22744]: audit 2024-09-16T05:48:31.961640+0000 mon.a (mon.0) 595 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T05:48:33.334 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:48:32 smithi047 bash[22744]: audit 2024-09-16T05:48:31.966358+0000 mon.a (mon.0) 596 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T05:48:33.334 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:48:32 smithi047 bash[22744]: audit 2024-09-16T05:48:31.971451+0000 mon.a (mon.0) 597 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T05:48:33.334 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:48:32 smithi047 bash[22744]: cluster 2024-09-16T05:48:32.062037+0000 mgr.a (mgr.14373) 497 : cluster [DBG] pgmap v346: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:48:33.334 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:48:32 smithi047 bash[22744]: audit 2024-09-16T05:48:32.699643+0000 mon.b (mon.2) 93 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-16T05:48:33.334 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:48:32 smithi047 bash[22744]: audit 2024-09-16T05:48:32.700208+0000 mon.b (mon.2) 94 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-16T05:48:33.334 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:48:32 smithi047 bash[22744]: audit 2024-09-16T05:48:32.708650+0000 mon.a (mon.0) 598 : audit [INF] from='mgr.14373 ' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-16T05:48:33.334 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:48:32 smithi047 bash[22744]: audit 2024-09-16T05:48:32.709604+0000 mon.a (mon.0) 599 : audit [INF] from='mgr.14373 ' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-16T05:48:33.334 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:48:32 smithi047 bash[22744]: audit 2024-09-16T05:48:32.717470+0000 mon.a (mon.0) 600 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T05:48:33.335 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:48:32 smithi047 bash[22744]: audit 2024-09-16T05:48:32.724539+0000 mon.b (mon.2) 95 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T05:48:33.335 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:48:32 smithi047 bash[22744]: audit 2024-09-16T05:48:32.725187+0000 mon.a (mon.0) 601 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T05:48:33.335 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:48:32 smithi047 bash[22744]: audit 2024-09-16T05:48:32.726608+0000 mon.b (mon.2) 96 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T05:48:33.335 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:48:32 smithi047 bash[22744]: audit 2024-09-16T05:48:32.744506+0000 mon.b (mon.2) 97 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T05:48:33.335 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:48:32 smithi047 bash[22744]: audit 2024-09-16T05:48:32.745419+0000 mon.a (mon.0) 602 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T05:48:33.834 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 05:48:33 smithi047 bash[22994]: debug 2024-09-16T05:48:33.446+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T05:48:33.834 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 05:48:33 smithi047 bash[22994]: debug 2024-09-16T05:48:33.446+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T05:48:34.300 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:48:33 smithi157 bash[24585]: cephadm 2024-09-16T05:48:32.710760+0000 mgr.a (mgr.14373) 498 : cephadm [INF] Adjusting osd_memory_target on smithi086 to 16241M 2024-09-16T05:48:34.300 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:48:33 smithi157 bash[24585]: cephadm 2024-09-16T05:48:32.711406+0000 mgr.a (mgr.14373) 499 : cephadm [INF] Adjusting osd_memory_target on smithi157 to 20337M 2024-09-16T05:48:34.300 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:48:33 smithi157 bash[24585]: audit 2024-09-16T05:48:32.754402+0000 mgr.a (mgr.14373) 500 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T05:48:34.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:48:33 smithi086 bash[24289]: cephadm 2024-09-16T05:48:32.710760+0000 mgr.a (mgr.14373) 498 : cephadm [INF] Adjusting osd_memory_target on smithi086 to 16241M 2024-09-16T05:48:34.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:48:33 smithi086 bash[24289]: cephadm 2024-09-16T05:48:32.711406+0000 mgr.a (mgr.14373) 499 : cephadm [INF] Adjusting osd_memory_target on smithi157 to 20337M 2024-09-16T05:48:34.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:48:33 smithi086 bash[24289]: audit 2024-09-16T05:48:32.754402+0000 mgr.a (mgr.14373) 500 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T05:48:34.334 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:48:33 smithi047 bash[22744]: cephadm 2024-09-16T05:48:32.710760+0000 mgr.a (mgr.14373) 498 : cephadm [INF] Adjusting osd_memory_target on smithi086 to 16241M 2024-09-16T05:48:34.334 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:48:33 smithi047 bash[22744]: cephadm 2024-09-16T05:48:32.711406+0000 mgr.a (mgr.14373) 499 : cephadm [INF] Adjusting osd_memory_target on smithi157 to 20337M 2024-09-16T05:48:34.334 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:48:33 smithi047 bash[22744]: audit 2024-09-16T05:48:32.754402+0000 mgr.a (mgr.14373) 500 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T05:48:35.301 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:48:34 smithi157 bash[24585]: audit 2024-09-16T05:48:33.447030+0000 mgr.a (mgr.14373) 501 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T05:48:35.301 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:48:34 smithi157 bash[24585]: cephadm 2024-09-16T05:48:33.449196+0000 mgr.a (mgr.14373) 502 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T05:48:35.301 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:48:34 smithi157 bash[24585]: cluster 2024-09-16T05:48:34.063085+0000 mgr.a (mgr.14373) 503 : cluster [DBG] pgmap v347: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T05:48:35.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:48:34 smithi086 bash[24289]: audit 2024-09-16T05:48:33.447030+0000 mgr.a (mgr.14373) 501 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T05:48:35.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:48:34 smithi086 bash[24289]: cephadm 2024-09-16T05:48:33.449196+0000 mgr.a (mgr.14373) 502 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T05:48:35.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:48:34 smithi086 bash[24289]: cluster 2024-09-16T05:48:34.063085+0000 mgr.a (mgr.14373) 503 : cluster [DBG] pgmap v347: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T05:48:35.334 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:48:34 smithi047 bash[22744]: audit 2024-09-16T05:48:33.447030+0000 mgr.a (mgr.14373) 501 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T05:48:35.334 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:48:34 smithi047 bash[22744]: cephadm 2024-09-16T05:48:33.449196+0000 mgr.a (mgr.14373) 502 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T05:48:35.334 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:48:34 smithi047 bash[22744]: cluster 2024-09-16T05:48:34.063085+0000 mgr.a (mgr.14373) 503 : cluster [DBG] pgmap v347: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T05:48:37.116 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T05:48:37.116 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T05:48:37.116 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T05:48:37.550 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:48:37 smithi157 bash[24585]: cluster 2024-09-16T05:48:36.064056+0000 mgr.a (mgr.14373) 504 : cluster [DBG] pgmap v348: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T05:48:37.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:48:37 smithi086 bash[24289]: cluster 2024-09-16T05:48:36.064056+0000 mgr.a (mgr.14373) 504 : cluster [DBG] pgmap v348: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T05:48:37.584 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:48:37 smithi047 bash[22744]: cluster 2024-09-16T05:48:36.064056+0000 mgr.a (mgr.14373) 504 : cluster [DBG] pgmap v348: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T05:48:37.853 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T05:48:37.853 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T05:48:37.853 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T05:48:37.853 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T05:48:37.853 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T05:48:39.550 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:48:39 smithi157 bash[24585]: audit 2024-09-16T05:48:37.454338+0000 mgr.a (mgr.14373) 505 : audit [DBG] from='client.24555 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:48:39.550 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:48:39 smithi157 bash[24585]: cluster 2024-09-16T05:48:38.066940+0000 mgr.a (mgr.14373) 506 : cluster [DBG] pgmap v349: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T05:48:39.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:48:39 smithi086 bash[24289]: audit 2024-09-16T05:48:37.454338+0000 mgr.a (mgr.14373) 505 : audit [DBG] from='client.24555 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:48:39.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:48:39 smithi086 bash[24289]: cluster 2024-09-16T05:48:38.066940+0000 mgr.a (mgr.14373) 506 : cluster [DBG] pgmap v349: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T05:48:39.584 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:48:39 smithi047 bash[22744]: audit 2024-09-16T05:48:37.454338+0000 mgr.a (mgr.14373) 505 : audit [DBG] from='client.24555 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:48:39.584 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:48:39 smithi047 bash[22744]: cluster 2024-09-16T05:48:38.066940+0000 mgr.a (mgr.14373) 506 : cluster [DBG] pgmap v349: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T05:48:41.550 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:48:41 smithi157 bash[24585]: cluster 2024-09-16T05:48:40.067890+0000 mgr.a (mgr.14373) 507 : cluster [DBG] pgmap v350: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T05:48:41.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:48:41 smithi086 bash[24289]: cluster 2024-09-16T05:48:40.067890+0000 mgr.a (mgr.14373) 507 : cluster [DBG] pgmap v350: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T05:48:41.584 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:48:41 smithi047 bash[22744]: cluster 2024-09-16T05:48:40.067890+0000 mgr.a (mgr.14373) 507 : cluster [DBG] pgmap v350: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T05:48:42.854 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T05:48:42.855 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T05:48:42.855 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T05:48:43.550 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:48:43 smithi157 bash[24585]: cluster 2024-09-16T05:48:42.069980+0000 mgr.a (mgr.14373) 508 : cluster [DBG] pgmap v351: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T05:48:43.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:48:43 smithi086 bash[24289]: cluster 2024-09-16T05:48:42.069980+0000 mgr.a (mgr.14373) 508 : cluster [DBG] pgmap v351: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T05:48:43.584 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:48:43 smithi047 bash[22744]: cluster 2024-09-16T05:48:42.069980+0000 mgr.a (mgr.14373) 508 : cluster [DBG] pgmap v351: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T05:48:43.627 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T05:48:43.628 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T05:48:43.628 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T05:48:43.628 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T05:48:43.628 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T05:48:44.550 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:48:44 smithi157 bash[24585]: audit 2024-09-16T05:48:43.198746+0000 mgr.a (mgr.14373) 509 : audit [DBG] from='client.24633 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:48:44.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:48:44 smithi086 bash[24289]: audit 2024-09-16T05:48:43.198746+0000 mgr.a (mgr.14373) 509 : audit [DBG] from='client.24633 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:48:44.584 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:48:44 smithi047 bash[22744]: audit 2024-09-16T05:48:43.198746+0000 mgr.a (mgr.14373) 509 : audit [DBG] from='client.24633 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:48:45.550 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:48:45 smithi157 bash[24585]: cluster 2024-09-16T05:48:44.070983+0000 mgr.a (mgr.14373) 510 : cluster [DBG] pgmap v352: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T05:48:45.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:48:45 smithi086 bash[24289]: cluster 2024-09-16T05:48:44.070983+0000 mgr.a (mgr.14373) 510 : cluster [DBG] pgmap v352: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T05:48:45.584 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:48:45 smithi047 bash[22744]: cluster 2024-09-16T05:48:44.070983+0000 mgr.a (mgr.14373) 510 : cluster [DBG] pgmap v352: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T05:48:47.550 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:48:47 smithi157 bash[24585]: cluster 2024-09-16T05:48:46.071905+0000 mgr.a (mgr.14373) 511 : cluster [DBG] pgmap v353: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T05:48:47.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:48:47 smithi086 bash[24289]: cluster 2024-09-16T05:48:46.071905+0000 mgr.a (mgr.14373) 511 : cluster [DBG] pgmap v353: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T05:48:47.584 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:48:47 smithi047 bash[22744]: cluster 2024-09-16T05:48:46.071905+0000 mgr.a (mgr.14373) 511 : cluster [DBG] pgmap v353: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T05:48:48.629 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T05:48:48.630 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T05:48:48.630 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T05:48:49.377 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T05:48:49.556 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T05:48:49.556 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T05:48:49.556 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T05:48:49.556 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T05:48:49.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:48:49 smithi157 bash[24585]: cluster 2024-09-16T05:48:48.074164+0000 mgr.a (mgr.14373) 512 : cluster [DBG] pgmap v354: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T05:48:49.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:48:49 smithi086 bash[24289]: cluster 2024-09-16T05:48:48.074164+0000 mgr.a (mgr.14373) 512 : cluster [DBG] pgmap v354: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T05:48:49.584 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:48:49 smithi047 bash[22744]: cluster 2024-09-16T05:48:48.074164+0000 mgr.a (mgr.14373) 512 : cluster [DBG] pgmap v354: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T05:48:50.550 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:48:50 smithi157 bash[24585]: audit 2024-09-16T05:48:48.966088+0000 mgr.a (mgr.14373) 513 : audit [DBG] from='client.24711 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:48:50.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:48:50 smithi086 bash[24289]: audit 2024-09-16T05:48:48.966088+0000 mgr.a (mgr.14373) 513 : audit [DBG] from='client.24711 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:48:50.584 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:48:50 smithi047 bash[22744]: audit 2024-09-16T05:48:48.966088+0000 mgr.a (mgr.14373) 513 : audit [DBG] from='client.24711 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:48:51.550 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:48:51 smithi157 bash[24585]: cluster 2024-09-16T05:48:50.075107+0000 mgr.a (mgr.14373) 514 : cluster [DBG] pgmap v355: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:48:51.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:48:51 smithi086 bash[24289]: cluster 2024-09-16T05:48:50.075107+0000 mgr.a (mgr.14373) 514 : cluster [DBG] pgmap v355: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:48:51.584 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:48:51 smithi047 bash[22744]: cluster 2024-09-16T05:48:50.075107+0000 mgr.a (mgr.14373) 514 : cluster [DBG] pgmap v355: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:48:53.550 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:48:53 smithi157 bash[24585]: cluster 2024-09-16T05:48:52.077368+0000 mgr.a (mgr.14373) 515 : cluster [DBG] pgmap v356: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:48:53.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:48:53 smithi086 bash[24289]: cluster 2024-09-16T05:48:52.077368+0000 mgr.a (mgr.14373) 515 : cluster [DBG] pgmap v356: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:48:53.584 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:48:53 smithi047 bash[22744]: cluster 2024-09-16T05:48:52.077368+0000 mgr.a (mgr.14373) 515 : cluster [DBG] pgmap v356: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:48:54.379 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T05:48:54.380 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T05:48:54.380 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T05:48:55.105 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T05:48:55.105 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T05:48:55.105 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T05:48:55.105 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T05:48:55.105 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T05:48:55.550 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:48:55 smithi157 bash[24585]: cluster 2024-09-16T05:48:54.078133+0000 mgr.a (mgr.14373) 516 : cluster [DBG] pgmap v357: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:48:55.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:48:55 smithi086 bash[24289]: cluster 2024-09-16T05:48:54.078133+0000 mgr.a (mgr.14373) 516 : cluster [DBG] pgmap v357: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:48:55.584 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:48:55 smithi047 bash[22744]: cluster 2024-09-16T05:48:54.078133+0000 mgr.a (mgr.14373) 516 : cluster [DBG] pgmap v357: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:48:56.550 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:48:56 smithi157 bash[24585]: audit 2024-09-16T05:48:54.715984+0000 mgr.a (mgr.14373) 517 : audit [DBG] from='client.24789 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:48:56.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:48:56 smithi086 bash[24289]: audit 2024-09-16T05:48:54.715984+0000 mgr.a (mgr.14373) 517 : audit [DBG] from='client.24789 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:48:56.584 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:48:56 smithi047 bash[22744]: audit 2024-09-16T05:48:54.715984+0000 mgr.a (mgr.14373) 517 : audit [DBG] from='client.24789 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:48:57.550 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:48:57 smithi157 bash[24585]: cluster 2024-09-16T05:48:56.079032+0000 mgr.a (mgr.14373) 518 : cluster [DBG] pgmap v358: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:48:57.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:48:57 smithi086 bash[24289]: cluster 2024-09-16T05:48:56.079032+0000 mgr.a (mgr.14373) 518 : cluster [DBG] pgmap v358: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:48:57.584 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:48:57 smithi047 bash[22744]: cluster 2024-09-16T05:48:56.079032+0000 mgr.a (mgr.14373) 518 : cluster [DBG] pgmap v358: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:48:59.550 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:48:59 smithi157 bash[24585]: cluster 2024-09-16T05:48:58.081298+0000 mgr.a (mgr.14373) 519 : cluster [DBG] pgmap v359: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:48:59.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:48:59 smithi086 bash[24289]: cluster 2024-09-16T05:48:58.081298+0000 mgr.a (mgr.14373) 519 : cluster [DBG] pgmap v359: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:48:59.584 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:48:59 smithi047 bash[22744]: cluster 2024-09-16T05:48:58.081298+0000 mgr.a (mgr.14373) 519 : cluster [DBG] pgmap v359: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:49:00.106 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T05:49:00.107 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T05:49:00.107 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T05:49:00.845 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T05:49:00.846 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T05:49:00.846 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T05:49:00.846 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T05:49:00.846 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T05:49:01.550 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:49:01 smithi157 bash[24585]: cluster 2024-09-16T05:49:00.082063+0000 mgr.a (mgr.14373) 520 : cluster [DBG] pgmap v360: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:49:01.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:49:01 smithi086 bash[24289]: cluster 2024-09-16T05:49:00.082063+0000 mgr.a (mgr.14373) 520 : cluster [DBG] pgmap v360: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:49:01.584 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:49:01 smithi047 bash[22744]: cluster 2024-09-16T05:49:00.082063+0000 mgr.a (mgr.14373) 520 : cluster [DBG] pgmap v360: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:49:02.550 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:49:02 smithi157 bash[24585]: audit 2024-09-16T05:49:00.441513+0000 mgr.a (mgr.14373) 521 : audit [DBG] from='client.24867 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:49:02.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:49:02 smithi086 bash[24289]: audit 2024-09-16T05:49:00.441513+0000 mgr.a (mgr.14373) 521 : audit [DBG] from='client.24867 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:49:02.584 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:49:02 smithi047 bash[22744]: audit 2024-09-16T05:49:00.441513+0000 mgr.a (mgr.14373) 521 : audit [DBG] from='client.24867 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:49:03.550 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:49:03 smithi157 bash[24585]: cluster 2024-09-16T05:49:02.084344+0000 mgr.a (mgr.14373) 522 : cluster [DBG] pgmap v361: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:49:03.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:49:03 smithi086 bash[24289]: cluster 2024-09-16T05:49:02.084344+0000 mgr.a (mgr.14373) 522 : cluster [DBG] pgmap v361: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:49:03.584 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:49:03 smithi047 bash[22744]: cluster 2024-09-16T05:49:02.084344+0000 mgr.a (mgr.14373) 522 : cluster [DBG] pgmap v361: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:49:05.550 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:49:05 smithi157 bash[24585]: cluster 2024-09-16T05:49:04.085117+0000 mgr.a (mgr.14373) 523 : cluster [DBG] pgmap v362: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:49:05.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:49:05 smithi086 bash[24289]: cluster 2024-09-16T05:49:04.085117+0000 mgr.a (mgr.14373) 523 : cluster [DBG] pgmap v362: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:49:05.584 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:49:05 smithi047 bash[22744]: cluster 2024-09-16T05:49:04.085117+0000 mgr.a (mgr.14373) 523 : cluster [DBG] pgmap v362: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:49:05.847 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T05:49:05.849 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T05:49:05.849 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T05:49:06.597 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T05:49:06.597 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T05:49:06.597 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T05:49:06.597 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T05:49:06.597 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T05:49:07.584 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:49:07 smithi047 bash[22744]: cluster 2024-09-16T05:49:06.085837+0000 mgr.a (mgr.14373) 524 : cluster [DBG] pgmap v363: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:49:07.585 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:49:07 smithi047 bash[22744]: audit 2024-09-16T05:49:06.178980+0000 mgr.a (mgr.14373) 525 : audit [DBG] from='client.24945 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:49:07.800 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:49:07 smithi157 bash[24585]: cluster 2024-09-16T05:49:06.085837+0000 mgr.a (mgr.14373) 524 : cluster [DBG] pgmap v363: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:49:07.800 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:49:07 smithi157 bash[24585]: audit 2024-09-16T05:49:06.178980+0000 mgr.a (mgr.14373) 525 : audit [DBG] from='client.24945 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:49:07.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:49:07 smithi086 bash[24289]: cluster 2024-09-16T05:49:06.085837+0000 mgr.a (mgr.14373) 524 : cluster [DBG] pgmap v363: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:49:07.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:49:07 smithi086 bash[24289]: audit 2024-09-16T05:49:06.178980+0000 mgr.a (mgr.14373) 525 : audit [DBG] from='client.24945 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:49:09.584 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:49:09 smithi047 bash[22744]: cluster 2024-09-16T05:49:08.088555+0000 mgr.a (mgr.14373) 526 : cluster [DBG] pgmap v364: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 2 op/s 2024-09-16T05:49:09.800 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:49:09 smithi157 bash[24585]: cluster 2024-09-16T05:49:08.088555+0000 mgr.a (mgr.14373) 526 : cluster [DBG] pgmap v364: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 2 op/s 2024-09-16T05:49:09.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:49:09 smithi086 bash[24289]: cluster 2024-09-16T05:49:08.088555+0000 mgr.a (mgr.14373) 526 : cluster [DBG] pgmap v364: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 2 op/s 2024-09-16T05:49:11.584 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:49:11 smithi047 bash[22744]: cluster 2024-09-16T05:49:10.089369+0000 mgr.a (mgr.14373) 527 : cluster [DBG] pgmap v365: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-16T05:49:11.598 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T05:49:11.599 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T05:49:11.599 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T05:49:11.800 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:49:11 smithi157 bash[24585]: cluster 2024-09-16T05:49:10.089369+0000 mgr.a (mgr.14373) 527 : cluster [DBG] pgmap v365: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-16T05:49:11.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:49:11 smithi086 bash[24289]: cluster 2024-09-16T05:49:10.089369+0000 mgr.a (mgr.14373) 527 : cluster [DBG] pgmap v365: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-16T05:49:12.329 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T05:49:12.329 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T05:49:12.329 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T05:49:12.329 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T05:49:12.329 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T05:49:13.800 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:49:13 smithi157 bash[24585]: audit 2024-09-16T05:49:11.937305+0000 mgr.a (mgr.14373) 528 : audit [DBG] from='client.25020 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:49:13.800 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:49:13 smithi157 bash[24585]: cluster 2024-09-16T05:49:12.090658+0000 mgr.a (mgr.14373) 529 : cluster [DBG] pgmap v366: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:49:13.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:49:13 smithi086 bash[24289]: audit 2024-09-16T05:49:11.937305+0000 mgr.a (mgr.14373) 528 : audit [DBG] from='client.25020 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:49:13.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:49:13 smithi086 bash[24289]: cluster 2024-09-16T05:49:12.090658+0000 mgr.a (mgr.14373) 529 : cluster [DBG] pgmap v366: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:49:13.834 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:49:13 smithi047 bash[22744]: audit 2024-09-16T05:49:11.937305+0000 mgr.a (mgr.14373) 528 : audit [DBG] from='client.25020 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:49:13.835 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:49:13 smithi047 bash[22744]: cluster 2024-09-16T05:49:12.090658+0000 mgr.a (mgr.14373) 529 : cluster [DBG] pgmap v366: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:49:15.800 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:49:15 smithi157 bash[24585]: cluster 2024-09-16T05:49:14.091512+0000 mgr.a (mgr.14373) 530 : cluster [DBG] pgmap v367: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T05:49:15.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:49:15 smithi086 bash[24289]: cluster 2024-09-16T05:49:14.091512+0000 mgr.a (mgr.14373) 530 : cluster [DBG] pgmap v367: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T05:49:15.834 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:49:15 smithi047 bash[22744]: cluster 2024-09-16T05:49:14.091512+0000 mgr.a (mgr.14373) 530 : cluster [DBG] pgmap v367: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T05:49:17.331 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T05:49:17.331 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T05:49:17.331 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T05:49:17.800 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:49:17 smithi157 bash[24585]: cluster 2024-09-16T05:49:16.092323+0000 mgr.a (mgr.14373) 531 : cluster [DBG] pgmap v368: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T05:49:17.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:49:17 smithi086 bash[24289]: cluster 2024-09-16T05:49:16.092323+0000 mgr.a (mgr.14373) 531 : cluster [DBG] pgmap v368: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T05:49:17.834 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:49:17 smithi047 bash[22744]: cluster 2024-09-16T05:49:16.092323+0000 mgr.a (mgr.14373) 531 : cluster [DBG] pgmap v368: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T05:49:18.074 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T05:49:18.074 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T05:49:18.074 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T05:49:18.074 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T05:49:18.074 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T05:49:19.800 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:49:19 smithi157 bash[24585]: audit 2024-09-16T05:49:17.670402+0000 mgr.a (mgr.14373) 532 : audit [DBG] from='client.25092 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:49:19.801 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:49:19 smithi157 bash[24585]: cluster 2024-09-16T05:49:18.093599+0000 mgr.a (mgr.14373) 533 : cluster [DBG] pgmap v369: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:49:19.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:49:19 smithi086 bash[24289]: audit 2024-09-16T05:49:17.670402+0000 mgr.a (mgr.14373) 532 : audit [DBG] from='client.25092 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:49:19.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:49:19 smithi086 bash[24289]: cluster 2024-09-16T05:49:18.093599+0000 mgr.a (mgr.14373) 533 : cluster [DBG] pgmap v369: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:49:19.834 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:49:19 smithi047 bash[22744]: audit 2024-09-16T05:49:17.670402+0000 mgr.a (mgr.14373) 532 : audit [DBG] from='client.25092 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:49:19.835 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:49:19 smithi047 bash[22744]: cluster 2024-09-16T05:49:18.093599+0000 mgr.a (mgr.14373) 533 : cluster [DBG] pgmap v369: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:49:21.800 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:49:21 smithi157 bash[24585]: cluster 2024-09-16T05:49:20.094325+0000 mgr.a (mgr.14373) 534 : cluster [DBG] pgmap v370: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T05:49:21.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:49:21 smithi086 bash[24289]: cluster 2024-09-16T05:49:20.094325+0000 mgr.a (mgr.14373) 534 : cluster [DBG] pgmap v370: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T05:49:21.834 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:49:21 smithi047 bash[22744]: cluster 2024-09-16T05:49:20.094325+0000 mgr.a (mgr.14373) 534 : cluster [DBG] pgmap v370: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T05:49:23.075 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T05:49:23.076 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T05:49:23.076 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T05:49:23.800 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:49:23 smithi157 bash[24585]: cluster 2024-09-16T05:49:22.096282+0000 mgr.a (mgr.14373) 535 : cluster [DBG] pgmap v371: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-16T05:49:23.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:49:23 smithi086 bash[24289]: cluster 2024-09-16T05:49:22.096282+0000 mgr.a (mgr.14373) 535 : cluster [DBG] pgmap v371: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-16T05:49:23.834 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:49:23 smithi047 bash[22744]: cluster 2024-09-16T05:49:22.096282+0000 mgr.a (mgr.14373) 535 : cluster [DBG] pgmap v371: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-16T05:49:23.841 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T05:49:23.842 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T05:49:23.842 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T05:49:23.842 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T05:49:23.842 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T05:49:24.800 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:49:24 smithi157 bash[24585]: audit 2024-09-16T05:49:23.420105+0000 mgr.a (mgr.14373) 536 : audit [DBG] from='client.25161 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:49:24.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:49:24 smithi086 bash[24289]: audit 2024-09-16T05:49:23.420105+0000 mgr.a (mgr.14373) 536 : audit [DBG] from='client.25161 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:49:24.834 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:49:24 smithi047 bash[22744]: audit 2024-09-16T05:49:23.420105+0000 mgr.a (mgr.14373) 536 : audit [DBG] from='client.25161 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:49:25.800 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:49:25 smithi157 bash[24585]: cluster 2024-09-16T05:49:24.097203+0000 mgr.a (mgr.14373) 537 : cluster [DBG] pgmap v372: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:49:25.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:49:25 smithi086 bash[24289]: cluster 2024-09-16T05:49:24.097203+0000 mgr.a (mgr.14373) 537 : cluster [DBG] pgmap v372: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:49:25.834 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:49:25 smithi047 bash[22744]: cluster 2024-09-16T05:49:24.097203+0000 mgr.a (mgr.14373) 537 : cluster [DBG] pgmap v372: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:49:27.800 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:49:27 smithi157 bash[24585]: cluster 2024-09-16T05:49:26.097984+0000 mgr.a (mgr.14373) 538 : cluster [DBG] pgmap v373: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:49:27.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:49:27 smithi086 bash[24289]: cluster 2024-09-16T05:49:26.097984+0000 mgr.a (mgr.14373) 538 : cluster [DBG] pgmap v373: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:49:27.834 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:49:27 smithi047 bash[22744]: cluster 2024-09-16T05:49:26.097984+0000 mgr.a (mgr.14373) 538 : cluster [DBG] pgmap v373: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:49:28.843 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T05:49:28.844 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T05:49:28.844 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T05:49:29.611 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T05:49:29.611 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T05:49:29.611 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T05:49:29.612 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T05:49:29.612 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T05:49:29.800 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:49:29 smithi157 bash[24585]: cluster 2024-09-16T05:49:28.100179+0000 mgr.a (mgr.14373) 539 : cluster [DBG] pgmap v374: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:49:29.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:49:29 smithi086 bash[24289]: cluster 2024-09-16T05:49:28.100179+0000 mgr.a (mgr.14373) 539 : cluster [DBG] pgmap v374: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:49:29.834 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:49:29 smithi047 bash[22744]: cluster 2024-09-16T05:49:28.100179+0000 mgr.a (mgr.14373) 539 : cluster [DBG] pgmap v374: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:49:30.800 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:49:30 smithi157 bash[24585]: audit 2024-09-16T05:49:29.186842+0000 mgr.a (mgr.14373) 540 : audit [DBG] from='client.25239 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:49:30.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:49:30 smithi086 bash[24289]: audit 2024-09-16T05:49:29.186842+0000 mgr.a (mgr.14373) 540 : audit [DBG] from='client.25239 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:49:30.835 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:49:30 smithi047 bash[22744]: audit 2024-09-16T05:49:29.186842+0000 mgr.a (mgr.14373) 540 : audit [DBG] from='client.25239 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:49:31.800 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:49:31 smithi157 bash[24585]: cluster 2024-09-16T05:49:30.101144+0000 mgr.a (mgr.14373) 541 : cluster [DBG] pgmap v375: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:49:31.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:49:31 smithi086 bash[24289]: cluster 2024-09-16T05:49:30.101144+0000 mgr.a (mgr.14373) 541 : cluster [DBG] pgmap v375: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:49:31.834 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:49:31 smithi047 bash[22744]: cluster 2024-09-16T05:49:30.101144+0000 mgr.a (mgr.14373) 541 : cluster [DBG] pgmap v375: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:49:33.800 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:49:33 smithi157 bash[24585]: cluster 2024-09-16T05:49:32.103373+0000 mgr.a (mgr.14373) 542 : cluster [DBG] pgmap v376: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:49:33.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:49:33 smithi086 bash[24289]: cluster 2024-09-16T05:49:32.103373+0000 mgr.a (mgr.14373) 542 : cluster [DBG] pgmap v376: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:49:33.834 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:49:33 smithi047 bash[22744]: cluster 2024-09-16T05:49:32.103373+0000 mgr.a (mgr.14373) 542 : cluster [DBG] pgmap v376: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:49:34.612 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T05:49:34.613 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T05:49:34.613 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T05:49:34.800 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:49:34 smithi157 bash[24585]: audit 2024-09-16T05:49:33.494436+0000 mon.b (mon.2) 98 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T05:49:34.801 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:49:34 smithi157 bash[24585]: audit 2024-09-16T05:49:34.338251+0000 mon.b (mon.2) 99 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T05:49:34.801 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:49:34 smithi157 bash[24585]: audit 2024-09-16T05:49:34.340443+0000 mon.b (mon.2) 100 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T05:49:34.801 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:49:34 smithi157 bash[24585]: audit 2024-09-16T05:49:34.356783+0000 mon.b (mon.2) 101 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T05:49:34.801 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:49:34 smithi157 bash[24585]: audit 2024-09-16T05:49:34.358431+0000 mon.a (mon.0) 603 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T05:49:34.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:49:34 smithi086 bash[24289]: audit 2024-09-16T05:49:33.494436+0000 mon.b (mon.2) 98 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T05:49:34.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:49:34 smithi086 bash[24289]: audit 2024-09-16T05:49:34.338251+0000 mon.b (mon.2) 99 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T05:49:34.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:49:34 smithi086 bash[24289]: audit 2024-09-16T05:49:34.340443+0000 mon.b (mon.2) 100 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T05:49:34.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:49:34 smithi086 bash[24289]: audit 2024-09-16T05:49:34.356783+0000 mon.b (mon.2) 101 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T05:49:34.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:49:34 smithi086 bash[24289]: audit 2024-09-16T05:49:34.358431+0000 mon.a (mon.0) 603 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T05:49:34.834 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:49:34 smithi047 bash[22744]: audit 2024-09-16T05:49:33.494436+0000 mon.b (mon.2) 98 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T05:49:34.835 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:49:34 smithi047 bash[22744]: audit 2024-09-16T05:49:34.338251+0000 mon.b (mon.2) 99 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T05:49:34.835 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:49:34 smithi047 bash[22744]: audit 2024-09-16T05:49:34.340443+0000 mon.b (mon.2) 100 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T05:49:34.835 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:49:34 smithi047 bash[22744]: audit 2024-09-16T05:49:34.356783+0000 mon.b (mon.2) 101 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T05:49:34.835 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:49:34 smithi047 bash[22744]: audit 2024-09-16T05:49:34.358431+0000 mon.a (mon.0) 603 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T05:49:35.334 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 05:49:35 smithi047 bash[22994]: debug 2024-09-16T05:49:35.075+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T05:49:35.335 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 05:49:35 smithi047 bash[22994]: debug 2024-09-16T05:49:35.087+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T05:49:35.474 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T05:49:35.638 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T05:49:35.638 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T05:49:35.638 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T05:49:35.638 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T05:49:35.800 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:49:35 smithi157 bash[24585]: cluster 2024-09-16T05:49:34.104108+0000 mgr.a (mgr.14373) 543 : cluster [DBG] pgmap v377: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:49:35.800 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:49:35 smithi157 bash[24585]: audit 2024-09-16T05:49:34.365430+0000 mgr.a (mgr.14373) 544 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T05:49:35.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:49:35 smithi086 bash[24289]: cluster 2024-09-16T05:49:34.104108+0000 mgr.a (mgr.14373) 543 : cluster [DBG] pgmap v377: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:49:35.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:49:35 smithi086 bash[24289]: audit 2024-09-16T05:49:34.365430+0000 mgr.a (mgr.14373) 544 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T05:49:35.835 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:49:35 smithi047 bash[22744]: cluster 2024-09-16T05:49:34.104108+0000 mgr.a (mgr.14373) 543 : cluster [DBG] pgmap v377: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:49:35.835 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:49:35 smithi047 bash[22744]: audit 2024-09-16T05:49:34.365430+0000 mgr.a (mgr.14373) 544 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T05:49:36.800 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:49:36 smithi157 bash[24585]: audit 2024-09-16T05:49:34.943472+0000 mgr.a (mgr.14373) 545 : audit [DBG] from='client.25371 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:49:36.801 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:49:36 smithi157 bash[24585]: audit 2024-09-16T05:49:35.081893+0000 mgr.a (mgr.14373) 546 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T05:49:36.801 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:49:36 smithi157 bash[24585]: cephadm 2024-09-16T05:49:35.092365+0000 mgr.a (mgr.14373) 547 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T05:49:36.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:49:36 smithi086 bash[24289]: audit 2024-09-16T05:49:34.943472+0000 mgr.a (mgr.14373) 545 : audit [DBG] from='client.25371 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:49:36.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:49:36 smithi086 bash[24289]: audit 2024-09-16T05:49:35.081893+0000 mgr.a (mgr.14373) 546 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T05:49:36.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:49:36 smithi086 bash[24289]: cephadm 2024-09-16T05:49:35.092365+0000 mgr.a (mgr.14373) 547 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T05:49:36.835 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:49:36 smithi047 bash[22744]: audit 2024-09-16T05:49:34.943472+0000 mgr.a (mgr.14373) 545 : audit [DBG] from='client.25371 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:49:36.835 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:49:36 smithi047 bash[22744]: audit 2024-09-16T05:49:35.081893+0000 mgr.a (mgr.14373) 546 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T05:49:36.835 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:49:36 smithi047 bash[22744]: cephadm 2024-09-16T05:49:35.092365+0000 mgr.a (mgr.14373) 547 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T05:49:37.800 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:49:37 smithi157 bash[24585]: cluster 2024-09-16T05:49:36.104990+0000 mgr.a (mgr.14373) 548 : cluster [DBG] pgmap v378: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:49:37.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:49:37 smithi086 bash[24289]: cluster 2024-09-16T05:49:36.104990+0000 mgr.a (mgr.14373) 548 : cluster [DBG] pgmap v378: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:49:37.834 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:49:37 smithi047 bash[22744]: cluster 2024-09-16T05:49:36.104990+0000 mgr.a (mgr.14373) 548 : cluster [DBG] pgmap v378: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:49:39.800 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:49:39 smithi157 bash[24585]: cluster 2024-09-16T05:49:38.107233+0000 mgr.a (mgr.14373) 549 : cluster [DBG] pgmap v379: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T05:49:39.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:49:39 smithi086 bash[24289]: cluster 2024-09-16T05:49:38.107233+0000 mgr.a (mgr.14373) 549 : cluster [DBG] pgmap v379: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T05:49:39.834 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:49:39 smithi047 bash[22744]: cluster 2024-09-16T05:49:38.107233+0000 mgr.a (mgr.14373) 549 : cluster [DBG] pgmap v379: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T05:49:40.476 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T05:49:40.476 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T05:49:40.476 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T05:49:41.253 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T05:49:41.253 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T05:49:41.254 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T05:49:41.254 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T05:49:41.254 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T05:49:41.800 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:49:41 smithi157 bash[24585]: cluster 2024-09-16T05:49:40.108017+0000 mgr.a (mgr.14373) 550 : cluster [DBG] pgmap v380: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T05:49:41.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:49:41 smithi086 bash[24289]: cluster 2024-09-16T05:49:40.108017+0000 mgr.a (mgr.14373) 550 : cluster [DBG] pgmap v380: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T05:49:41.835 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:49:41 smithi047 bash[22744]: cluster 2024-09-16T05:49:40.108017+0000 mgr.a (mgr.14373) 550 : cluster [DBG] pgmap v380: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T05:49:42.800 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:49:42 smithi157 bash[24585]: audit 2024-09-16T05:49:40.824105+0000 mgr.a (mgr.14373) 551 : audit [DBG] from='client.25500 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:49:42.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:49:42 smithi086 bash[24289]: audit 2024-09-16T05:49:40.824105+0000 mgr.a (mgr.14373) 551 : audit [DBG] from='client.25500 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:49:42.835 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:49:42 smithi047 bash[22744]: audit 2024-09-16T05:49:40.824105+0000 mgr.a (mgr.14373) 551 : audit [DBG] from='client.25500 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:49:43.801 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:49:43 smithi157 bash[24585]: cluster 2024-09-16T05:49:42.110734+0000 mgr.a (mgr.14373) 552 : cluster [DBG] pgmap v381: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T05:49:43.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:49:43 smithi086 bash[24289]: cluster 2024-09-16T05:49:42.110734+0000 mgr.a (mgr.14373) 552 : cluster [DBG] pgmap v381: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T05:49:43.835 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:49:43 smithi047 bash[22744]: cluster 2024-09-16T05:49:42.110734+0000 mgr.a (mgr.14373) 552 : cluster [DBG] pgmap v381: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T05:49:45.800 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:49:45 smithi157 bash[24585]: cluster 2024-09-16T05:49:44.111629+0000 mgr.a (mgr.14373) 553 : cluster [DBG] pgmap v382: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T05:49:45.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:49:45 smithi086 bash[24289]: cluster 2024-09-16T05:49:44.111629+0000 mgr.a (mgr.14373) 553 : cluster [DBG] pgmap v382: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T05:49:45.835 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:49:45 smithi047 bash[22744]: cluster 2024-09-16T05:49:44.111629+0000 mgr.a (mgr.14373) 553 : cluster [DBG] pgmap v382: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T05:49:46.255 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T05:49:46.255 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T05:49:46.256 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T05:49:47.002 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T05:49:47.003 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T05:49:47.003 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T05:49:47.003 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T05:49:47.003 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T05:49:47.800 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:49:47 smithi157 bash[24585]: cluster 2024-09-16T05:49:46.112556+0000 mgr.a (mgr.14373) 554 : cluster [DBG] pgmap v383: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T05:49:47.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:49:47 smithi086 bash[24289]: cluster 2024-09-16T05:49:46.112556+0000 mgr.a (mgr.14373) 554 : cluster [DBG] pgmap v383: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T05:49:47.835 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:49:47 smithi047 bash[22744]: cluster 2024-09-16T05:49:46.112556+0000 mgr.a (mgr.14373) 554 : cluster [DBG] pgmap v383: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T05:49:48.800 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:49:48 smithi157 bash[24585]: audit 2024-09-16T05:49:46.592981+0000 mgr.a (mgr.14373) 555 : audit [DBG] from='client.25578 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:49:48.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:49:48 smithi086 bash[24289]: audit 2024-09-16T05:49:46.592981+0000 mgr.a (mgr.14373) 555 : audit [DBG] from='client.25578 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:49:48.835 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:49:48 smithi047 bash[22744]: audit 2024-09-16T05:49:46.592981+0000 mgr.a (mgr.14373) 555 : audit [DBG] from='client.25578 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:49:49.800 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:49:49 smithi157 bash[24585]: cluster 2024-09-16T05:49:48.115295+0000 mgr.a (mgr.14373) 556 : cluster [DBG] pgmap v384: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T05:49:49.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:49:49 smithi086 bash[24289]: cluster 2024-09-16T05:49:48.115295+0000 mgr.a (mgr.14373) 556 : cluster [DBG] pgmap v384: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T05:49:49.835 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:49:49 smithi047 bash[22744]: cluster 2024-09-16T05:49:48.115295+0000 mgr.a (mgr.14373) 556 : cluster [DBG] pgmap v384: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T05:49:50.800 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:49:50 smithi157 bash[24585]: cluster 2024-09-16T05:49:50.116082+0000 mgr.a (mgr.14373) 557 : cluster [DBG] pgmap v385: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T05:49:50.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:49:50 smithi086 bash[24289]: cluster 2024-09-16T05:49:50.116082+0000 mgr.a (mgr.14373) 557 : cluster [DBG] pgmap v385: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T05:49:50.835 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:49:50 smithi047 bash[22744]: cluster 2024-09-16T05:49:50.116082+0000 mgr.a (mgr.14373) 557 : cluster [DBG] pgmap v385: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T05:49:52.004 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T05:49:52.005 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T05:49:52.005 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T05:49:52.750 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T05:49:52.750 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T05:49:52.751 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T05:49:52.751 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T05:49:52.751 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T05:49:53.550 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:49:53 smithi157 bash[24585]: cluster 2024-09-16T05:49:52.117040+0000 mgr.a (mgr.14373) 558 : cluster [DBG] pgmap v386: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:49:53.551 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:49:53 smithi157 bash[24585]: audit 2024-09-16T05:49:52.346923+0000 mgr.a (mgr.14373) 559 : audit [DBG] from='client.25653 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:49:53.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:49:53 smithi086 bash[24289]: cluster 2024-09-16T05:49:52.117040+0000 mgr.a (mgr.14373) 558 : cluster [DBG] pgmap v386: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:49:53.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:49:53 smithi086 bash[24289]: audit 2024-09-16T05:49:52.346923+0000 mgr.a (mgr.14373) 559 : audit [DBG] from='client.25653 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:49:53.585 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:49:53 smithi047 bash[22744]: cluster 2024-09-16T05:49:52.117040+0000 mgr.a (mgr.14373) 558 : cluster [DBG] pgmap v386: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:49:53.585 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:49:53 smithi047 bash[22744]: audit 2024-09-16T05:49:52.346923+0000 mgr.a (mgr.14373) 559 : audit [DBG] from='client.25653 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:49:55.550 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:49:55 smithi157 bash[24585]: cluster 2024-09-16T05:49:54.117999+0000 mgr.a (mgr.14373) 560 : cluster [DBG] pgmap v387: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T05:49:55.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:49:55 smithi086 bash[24289]: cluster 2024-09-16T05:49:54.117999+0000 mgr.a (mgr.14373) 560 : cluster [DBG] pgmap v387: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T05:49:55.585 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:49:55 smithi047 bash[22744]: cluster 2024-09-16T05:49:54.117999+0000 mgr.a (mgr.14373) 560 : cluster [DBG] pgmap v387: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T05:49:57.550 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:49:57 smithi157 bash[24585]: cluster 2024-09-16T05:49:56.118981+0000 mgr.a (mgr.14373) 561 : cluster [DBG] pgmap v388: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T05:49:57.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:49:57 smithi086 bash[24289]: cluster 2024-09-16T05:49:56.118981+0000 mgr.a (mgr.14373) 561 : cluster [DBG] pgmap v388: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T05:49:57.585 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:49:57 smithi047 bash[22744]: cluster 2024-09-16T05:49:56.118981+0000 mgr.a (mgr.14373) 561 : cluster [DBG] pgmap v388: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T05:49:57.752 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T05:49:57.752 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T05:49:57.753 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T05:49:58.525 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T05:49:58.526 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T05:49:58.526 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T05:49:58.526 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T05:49:58.526 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T05:49:59.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:49:59 smithi157 bash[24585]: audit 2024-09-16T05:49:58.097027+0000 mgr.a (mgr.14373) 562 : audit [DBG] from='client.25722 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:49:59.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:49:59 smithi157 bash[24585]: cluster 2024-09-16T05:49:58.120833+0000 mgr.a (mgr.14373) 563 : cluster [DBG] pgmap v389: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:49:59.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:49:59 smithi086 bash[24289]: audit 2024-09-16T05:49:58.097027+0000 mgr.a (mgr.14373) 562 : audit [DBG] from='client.25722 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:49:59.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:49:59 smithi086 bash[24289]: cluster 2024-09-16T05:49:58.120833+0000 mgr.a (mgr.14373) 563 : cluster [DBG] pgmap v389: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:49:59.585 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:49:59 smithi047 bash[22744]: audit 2024-09-16T05:49:58.097027+0000 mgr.a (mgr.14373) 562 : audit [DBG] from='client.25722 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:49:59.585 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:49:59 smithi047 bash[22744]: cluster 2024-09-16T05:49:58.120833+0000 mgr.a (mgr.14373) 563 : cluster [DBG] pgmap v389: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:50:00.550 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:50:00 smithi157 bash[24585]: cluster 2024-09-16T05:50:00.000164+0000 mon.a (mon.0) 604 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-16T05:50:00.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:50:00 smithi086 bash[24289]: cluster 2024-09-16T05:50:00.000164+0000 mon.a (mon.0) 604 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-16T05:50:00.585 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:50:00 smithi047 bash[22744]: cluster 2024-09-16T05:50:00.000164+0000 mon.a (mon.0) 604 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-16T05:50:01.550 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:50:01 smithi157 bash[24585]: cluster 2024-09-16T05:50:00.121697+0000 mgr.a (mgr.14373) 564 : cluster [DBG] pgmap v390: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:50:01.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:50:01 smithi086 bash[24289]: cluster 2024-09-16T05:50:00.121697+0000 mgr.a (mgr.14373) 564 : cluster [DBG] pgmap v390: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:50:01.585 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:50:01 smithi047 bash[22744]: cluster 2024-09-16T05:50:00.121697+0000 mgr.a (mgr.14373) 564 : cluster [DBG] pgmap v390: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:50:03.527 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T05:50:03.528 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T05:50:03.528 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T05:50:03.551 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:50:03 smithi157 bash[24585]: cluster 2024-09-16T05:50:02.123879+0000 mgr.a (mgr.14373) 565 : cluster [DBG] pgmap v391: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:50:03.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:50:03 smithi086 bash[24289]: cluster 2024-09-16T05:50:02.123879+0000 mgr.a (mgr.14373) 565 : cluster [DBG] pgmap v391: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:50:03.585 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:50:03 smithi047 bash[22744]: cluster 2024-09-16T05:50:02.123879+0000 mgr.a (mgr.14373) 565 : cluster [DBG] pgmap v391: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:50:04.295 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T05:50:04.295 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T05:50:04.295 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T05:50:04.295 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T05:50:04.295 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T05:50:05.551 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:50:05 smithi157 bash[24585]: audit 2024-09-16T05:50:03.873988+0000 mgr.a (mgr.14373) 566 : audit [DBG] from='client.25797 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:50:05.551 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:50:05 smithi157 bash[24585]: cluster 2024-09-16T05:50:04.124443+0000 mgr.a (mgr.14373) 567 : cluster [DBG] pgmap v392: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:50:05.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:50:05 smithi086 bash[24289]: audit 2024-09-16T05:50:03.873988+0000 mgr.a (mgr.14373) 566 : audit [DBG] from='client.25797 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:50:05.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:50:05 smithi086 bash[24289]: cluster 2024-09-16T05:50:04.124443+0000 mgr.a (mgr.14373) 567 : cluster [DBG] pgmap v392: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:50:05.585 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:50:05 smithi047 bash[22744]: audit 2024-09-16T05:50:03.873988+0000 mgr.a (mgr.14373) 566 : audit [DBG] from='client.25797 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:50:05.585 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:50:05 smithi047 bash[22744]: cluster 2024-09-16T05:50:04.124443+0000 mgr.a (mgr.14373) 567 : cluster [DBG] pgmap v392: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:50:07.550 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:50:07 smithi157 bash[24585]: cluster 2024-09-16T05:50:06.125298+0000 mgr.a (mgr.14373) 568 : cluster [DBG] pgmap v393: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:50:07.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:50:07 smithi086 bash[24289]: cluster 2024-09-16T05:50:06.125298+0000 mgr.a (mgr.14373) 568 : cluster [DBG] pgmap v393: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:50:07.585 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:50:07 smithi047 bash[22744]: cluster 2024-09-16T05:50:06.125298+0000 mgr.a (mgr.14373) 568 : cluster [DBG] pgmap v393: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:50:09.296 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T05:50:09.297 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T05:50:09.297 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T05:50:09.550 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:50:09 smithi157 bash[24585]: cluster 2024-09-16T05:50:08.127534+0000 mgr.a (mgr.14373) 569 : cluster [DBG] pgmap v394: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:50:09.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:50:09 smithi086 bash[24289]: cluster 2024-09-16T05:50:08.127534+0000 mgr.a (mgr.14373) 569 : cluster [DBG] pgmap v394: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:50:09.585 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:50:09 smithi047 bash[22744]: cluster 2024-09-16T05:50:08.127534+0000 mgr.a (mgr.14373) 569 : cluster [DBG] pgmap v394: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:50:10.067 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T05:50:10.067 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T05:50:10.067 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T05:50:10.067 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T05:50:10.068 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T05:50:11.550 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:50:11 smithi157 bash[24585]: audit 2024-09-16T05:50:09.640431+0000 mgr.a (mgr.14373) 570 : audit [DBG] from='client.25875 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:50:11.551 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:50:11 smithi157 bash[24585]: cluster 2024-09-16T05:50:10.128103+0000 mgr.a (mgr.14373) 571 : cluster [DBG] pgmap v395: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:50:11.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:50:11 smithi086 bash[24289]: audit 2024-09-16T05:50:09.640431+0000 mgr.a (mgr.14373) 570 : audit [DBG] from='client.25875 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:50:11.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:50:11 smithi086 bash[24289]: cluster 2024-09-16T05:50:10.128103+0000 mgr.a (mgr.14373) 571 : cluster [DBG] pgmap v395: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:50:11.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:50:11 smithi047 bash[22744]: audit 2024-09-16T05:50:09.640431+0000 mgr.a (mgr.14373) 570 : audit [DBG] from='client.25875 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:50:11.590 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:50:11 smithi047 bash[22744]: cluster 2024-09-16T05:50:10.128103+0000 mgr.a (mgr.14373) 571 : cluster [DBG] pgmap v395: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:50:13.550 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:50:13 smithi157 bash[24585]: cluster 2024-09-16T05:50:12.130235+0000 mgr.a (mgr.14373) 572 : cluster [DBG] pgmap v396: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:50:13.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:50:13 smithi086 bash[24289]: cluster 2024-09-16T05:50:12.130235+0000 mgr.a (mgr.14373) 572 : cluster [DBG] pgmap v396: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:50:13.585 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:50:13 smithi047 bash[22744]: cluster 2024-09-16T05:50:12.130235+0000 mgr.a (mgr.14373) 572 : cluster [DBG] pgmap v396: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:50:15.069 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T05:50:15.069 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T05:50:15.069 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T05:50:15.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:50:15 smithi157 bash[24585]: cluster 2024-09-16T05:50:14.130974+0000 mgr.a (mgr.14373) 573 : cluster [DBG] pgmap v397: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:50:15.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:50:15 smithi086 bash[24289]: cluster 2024-09-16T05:50:14.130974+0000 mgr.a (mgr.14373) 573 : cluster [DBG] pgmap v397: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:50:15.585 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:50:15 smithi047 bash[22744]: cluster 2024-09-16T05:50:14.130974+0000 mgr.a (mgr.14373) 573 : cluster [DBG] pgmap v397: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:50:15.815 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T05:50:15.816 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T05:50:15.816 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T05:50:15.816 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T05:50:15.816 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T05:50:16.550 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:50:16 smithi157 bash[24585]: audit 2024-09-16T05:50:15.404998+0000 mgr.a (mgr.14373) 574 : audit [DBG] from='client.25953 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:50:16.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:50:16 smithi086 bash[24289]: audit 2024-09-16T05:50:15.404998+0000 mgr.a (mgr.14373) 574 : audit [DBG] from='client.25953 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:50:16.585 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:50:16 smithi047 bash[22744]: audit 2024-09-16T05:50:15.404998+0000 mgr.a (mgr.14373) 574 : audit [DBG] from='client.25953 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:50:17.550 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:50:17 smithi157 bash[24585]: cluster 2024-09-16T05:50:16.131807+0000 mgr.a (mgr.14373) 575 : cluster [DBG] pgmap v398: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:50:17.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:50:17 smithi086 bash[24289]: cluster 2024-09-16T05:50:16.131807+0000 mgr.a (mgr.14373) 575 : cluster [DBG] pgmap v398: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:50:17.585 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:50:17 smithi047 bash[22744]: cluster 2024-09-16T05:50:16.131807+0000 mgr.a (mgr.14373) 575 : cluster [DBG] pgmap v398: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:50:19.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:50:19 smithi157 bash[24585]: cluster 2024-09-16T05:50:18.134044+0000 mgr.a (mgr.14373) 576 : cluster [DBG] pgmap v399: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:50:19.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:50:19 smithi086 bash[24289]: cluster 2024-09-16T05:50:18.134044+0000 mgr.a (mgr.14373) 576 : cluster [DBG] pgmap v399: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:50:19.585 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:50:19 smithi047 bash[22744]: cluster 2024-09-16T05:50:18.134044+0000 mgr.a (mgr.14373) 576 : cluster [DBG] pgmap v399: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:50:20.817 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T05:50:20.818 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T05:50:20.818 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T05:50:21.550 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:50:21 smithi157 bash[24585]: cluster 2024-09-16T05:50:20.134811+0000 mgr.a (mgr.14373) 577 : cluster [DBG] pgmap v400: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:50:21.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:50:21 smithi086 bash[24289]: cluster 2024-09-16T05:50:20.134811+0000 mgr.a (mgr.14373) 577 : cluster [DBG] pgmap v400: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:50:21.585 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:50:21 smithi047 bash[22744]: cluster 2024-09-16T05:50:20.134811+0000 mgr.a (mgr.14373) 577 : cluster [DBG] pgmap v400: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:50:21.595 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T05:50:21.596 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T05:50:21.596 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T05:50:21.596 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T05:50:21.596 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T05:50:22.550 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:50:22 smithi157 bash[24585]: audit 2024-09-16T05:50:21.162124+0000 mgr.a (mgr.14373) 578 : audit [DBG] from='client.26031 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:50:22.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:50:22 smithi086 bash[24289]: audit 2024-09-16T05:50:21.162124+0000 mgr.a (mgr.14373) 578 : audit [DBG] from='client.26031 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:50:22.585 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:50:22 smithi047 bash[22744]: audit 2024-09-16T05:50:21.162124+0000 mgr.a (mgr.14373) 578 : audit [DBG] from='client.26031 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:50:23.550 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:50:23 smithi157 bash[24585]: cluster 2024-09-16T05:50:22.137337+0000 mgr.a (mgr.14373) 579 : cluster [DBG] pgmap v401: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-16T05:50:23.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:50:23 smithi086 bash[24289]: cluster 2024-09-16T05:50:22.137337+0000 mgr.a (mgr.14373) 579 : cluster [DBG] pgmap v401: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-16T05:50:23.585 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:50:23 smithi047 bash[22744]: cluster 2024-09-16T05:50:22.137337+0000 mgr.a (mgr.14373) 579 : cluster [DBG] pgmap v401: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-16T05:50:25.550 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:50:25 smithi157 bash[24585]: cluster 2024-09-16T05:50:24.138174+0000 mgr.a (mgr.14373) 580 : cluster [DBG] pgmap v402: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T05:50:25.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:50:25 smithi086 bash[24289]: cluster 2024-09-16T05:50:24.138174+0000 mgr.a (mgr.14373) 580 : cluster [DBG] pgmap v402: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T05:50:25.585 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:50:25 smithi047 bash[22744]: cluster 2024-09-16T05:50:24.138174+0000 mgr.a (mgr.14373) 580 : cluster [DBG] pgmap v402: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T05:50:26.597 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T05:50:26.597 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T05:50:26.598 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T05:50:27.344 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T05:50:27.345 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T05:50:27.345 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T05:50:27.345 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T05:50:27.345 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T05:50:27.550 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:50:27 smithi157 bash[24585]: cluster 2024-09-16T05:50:26.138929+0000 mgr.a (mgr.14373) 581 : cluster [DBG] pgmap v403: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T05:50:27.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:50:27 smithi086 bash[24289]: cluster 2024-09-16T05:50:26.138929+0000 mgr.a (mgr.14373) 581 : cluster [DBG] pgmap v403: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T05:50:27.585 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:50:27 smithi047 bash[22744]: cluster 2024-09-16T05:50:26.138929+0000 mgr.a (mgr.14373) 581 : cluster [DBG] pgmap v403: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T05:50:28.550 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:50:28 smithi157 bash[24585]: audit 2024-09-16T05:50:26.932127+0000 mgr.a (mgr.14373) 582 : audit [DBG] from='client.26109 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:50:28.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:50:28 smithi086 bash[24289]: audit 2024-09-16T05:50:26.932127+0000 mgr.a (mgr.14373) 582 : audit [DBG] from='client.26109 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:50:28.585 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:50:28 smithi047 bash[22744]: audit 2024-09-16T05:50:26.932127+0000 mgr.a (mgr.14373) 582 : audit [DBG] from='client.26109 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:50:29.550 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:50:29 smithi157 bash[24585]: cluster 2024-09-16T05:50:28.141523+0000 mgr.a (mgr.14373) 583 : cluster [DBG] pgmap v404: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:50:29.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:50:29 smithi086 bash[24289]: cluster 2024-09-16T05:50:28.141523+0000 mgr.a (mgr.14373) 583 : cluster [DBG] pgmap v404: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:50:29.585 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:50:29 smithi047 bash[22744]: cluster 2024-09-16T05:50:28.141523+0000 mgr.a (mgr.14373) 583 : cluster [DBG] pgmap v404: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:50:31.550 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:50:31 smithi157 bash[24585]: cluster 2024-09-16T05:50:30.142279+0000 mgr.a (mgr.14373) 584 : cluster [DBG] pgmap v405: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T05:50:31.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:50:31 smithi086 bash[24289]: cluster 2024-09-16T05:50:30.142279+0000 mgr.a (mgr.14373) 584 : cluster [DBG] pgmap v405: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T05:50:31.585 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:50:31 smithi047 bash[22744]: cluster 2024-09-16T05:50:30.142279+0000 mgr.a (mgr.14373) 584 : cluster [DBG] pgmap v405: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T05:50:32.343 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T05:50:32.344 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T05:50:32.344 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T05:50:33.074 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T05:50:33.075 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T05:50:33.075 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T05:50:33.075 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T05:50:33.075 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T05:50:33.550 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:50:33 smithi157 bash[24585]: cluster 2024-09-16T05:50:32.144354+0000 mgr.a (mgr.14373) 585 : cluster [DBG] pgmap v406: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:50:33.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:50:33 smithi086 bash[24289]: cluster 2024-09-16T05:50:32.144354+0000 mgr.a (mgr.14373) 585 : cluster [DBG] pgmap v406: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:50:33.585 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:50:33 smithi047 bash[22744]: cluster 2024-09-16T05:50:32.144354+0000 mgr.a (mgr.14373) 585 : cluster [DBG] pgmap v406: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:50:34.550 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:50:34 smithi157 bash[24585]: audit 2024-09-16T05:50:32.680088+0000 mgr.a (mgr.14373) 586 : audit [DBG] from='client.26184 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:50:34.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:50:34 smithi086 bash[24289]: audit 2024-09-16T05:50:32.680088+0000 mgr.a (mgr.14373) 586 : audit [DBG] from='client.26184 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:50:34.585 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:50:34 smithi047 bash[22744]: audit 2024-09-16T05:50:32.680088+0000 mgr.a (mgr.14373) 586 : audit [DBG] from='client.26184 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:50:35.550 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:50:35 smithi157 bash[24585]: cluster 2024-09-16T05:50:34.145257+0000 mgr.a (mgr.14373) 587 : cluster [DBG] pgmap v407: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-16T05:50:35.551 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:50:35 smithi157 bash[24585]: audit 2024-09-16T05:50:35.138426+0000 mon.b (mon.2) 102 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T05:50:35.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:50:35 smithi086 bash[24289]: cluster 2024-09-16T05:50:34.145257+0000 mgr.a (mgr.14373) 587 : cluster [DBG] pgmap v407: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-16T05:50:35.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:50:35 smithi086 bash[24289]: audit 2024-09-16T05:50:35.138426+0000 mon.b (mon.2) 102 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T05:50:35.585 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:50:35 smithi047 bash[22744]: cluster 2024-09-16T05:50:34.145257+0000 mgr.a (mgr.14373) 587 : cluster [DBG] pgmap v407: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-16T05:50:35.585 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:50:35 smithi047 bash[22744]: audit 2024-09-16T05:50:35.138426+0000 mon.b (mon.2) 102 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T05:50:36.551 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:50:36 smithi157 bash[24585]: audit 2024-09-16T05:50:35.989537+0000 mon.b (mon.2) 103 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T05:50:36.551 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:50:36 smithi157 bash[24585]: audit 2024-09-16T05:50:35.991471+0000 mon.b (mon.2) 104 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T05:50:36.551 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:50:36 smithi157 bash[24585]: audit 2024-09-16T05:50:36.007777+0000 mon.b (mon.2) 105 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T05:50:36.551 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:50:36 smithi157 bash[24585]: audit 2024-09-16T05:50:36.009060+0000 mon.a (mon.0) 605 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T05:50:36.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:50:36 smithi086 bash[24289]: audit 2024-09-16T05:50:35.989537+0000 mon.b (mon.2) 103 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T05:50:36.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:50:36 smithi086 bash[24289]: audit 2024-09-16T05:50:35.991471+0000 mon.b (mon.2) 104 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T05:50:36.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:50:36 smithi086 bash[24289]: audit 2024-09-16T05:50:36.007777+0000 mon.b (mon.2) 105 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T05:50:36.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:50:36 smithi086 bash[24289]: audit 2024-09-16T05:50:36.009060+0000 mon.a (mon.0) 605 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T05:50:36.585 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:50:36 smithi047 bash[22744]: audit 2024-09-16T05:50:35.989537+0000 mon.b (mon.2) 103 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T05:50:36.585 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:50:36 smithi047 bash[22744]: audit 2024-09-16T05:50:35.991471+0000 mon.b (mon.2) 104 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T05:50:36.585 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:50:36 smithi047 bash[22744]: audit 2024-09-16T05:50:36.007777+0000 mon.b (mon.2) 105 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T05:50:36.585 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:50:36 smithi047 bash[22744]: audit 2024-09-16T05:50:36.009060+0000 mon.a (mon.0) 605 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T05:50:37.085 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 05:50:36 smithi047 bash[22994]: debug 2024-09-16T05:50:36.738+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T05:50:37.086 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 05:50:36 smithi047 bash[22994]: debug 2024-09-16T05:50:36.742+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T05:50:37.551 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:50:37 smithi157 bash[24585]: audit 2024-09-16T05:50:36.016785+0000 mgr.a (mgr.14373) 588 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T05:50:37.551 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:50:37 smithi157 bash[24585]: cluster 2024-09-16T05:50:36.145991+0000 mgr.a (mgr.14373) 589 : cluster [DBG] pgmap v408: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-16T05:50:37.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:50:37 smithi086 bash[24289]: audit 2024-09-16T05:50:36.016785+0000 mgr.a (mgr.14373) 588 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T05:50:37.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:50:37 smithi086 bash[24289]: cluster 2024-09-16T05:50:36.145991+0000 mgr.a (mgr.14373) 589 : cluster [DBG] pgmap v408: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-16T05:50:37.585 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:50:37 smithi047 bash[22744]: audit 2024-09-16T05:50:36.016785+0000 mgr.a (mgr.14373) 588 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T05:50:37.586 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:50:37 smithi047 bash[22744]: cluster 2024-09-16T05:50:36.145991+0000 mgr.a (mgr.14373) 589 : cluster [DBG] pgmap v408: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-16T05:50:38.076 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T05:50:38.076 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T05:50:38.076 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T05:50:38.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:50:38 smithi086 bash[24289]: audit 2024-09-16T05:50:36.742039+0000 mgr.a (mgr.14373) 590 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T05:50:38.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:50:38 smithi086 bash[24289]: cephadm 2024-09-16T05:50:36.744032+0000 mgr.a (mgr.14373) 591 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T05:50:38.585 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:50:38 smithi047 bash[22744]: audit 2024-09-16T05:50:36.742039+0000 mgr.a (mgr.14373) 590 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T05:50:38.585 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:50:38 smithi047 bash[22744]: cephadm 2024-09-16T05:50:36.744032+0000 mgr.a (mgr.14373) 591 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T05:50:38.800 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:50:38 smithi157 bash[24585]: audit 2024-09-16T05:50:36.742039+0000 mgr.a (mgr.14373) 590 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T05:50:38.801 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:50:38 smithi157 bash[24585]: cephadm 2024-09-16T05:50:36.744032+0000 mgr.a (mgr.14373) 591 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T05:50:38.866 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T05:50:38.867 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T05:50:38.867 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T05:50:38.867 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T05:50:38.867 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T05:50:39.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:50:39 smithi086 bash[24289]: cluster 2024-09-16T05:50:38.148580+0000 mgr.a (mgr.14373) 592 : cluster [DBG] pgmap v409: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 4.1 KiB/s rd, 255 B/s wr, 4 op/s 2024-09-16T05:50:39.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:50:39 smithi086 bash[24289]: audit 2024-09-16T05:50:38.431846+0000 mgr.a (mgr.14373) 593 : audit [DBG] from='client.26361 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:50:39.585 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:50:39 smithi047 bash[22744]: cluster 2024-09-16T05:50:38.148580+0000 mgr.a (mgr.14373) 592 : cluster [DBG] pgmap v409: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 4.1 KiB/s rd, 255 B/s wr, 4 op/s 2024-09-16T05:50:39.585 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:50:39 smithi047 bash[22744]: audit 2024-09-16T05:50:38.431846+0000 mgr.a (mgr.14373) 593 : audit [DBG] from='client.26361 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:50:39.800 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:50:39 smithi157 bash[24585]: cluster 2024-09-16T05:50:38.148580+0000 mgr.a (mgr.14373) 592 : cluster [DBG] pgmap v409: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 4.1 KiB/s rd, 255 B/s wr, 4 op/s 2024-09-16T05:50:39.801 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:50:39 smithi157 bash[24585]: audit 2024-09-16T05:50:38.431846+0000 mgr.a (mgr.14373) 593 : audit [DBG] from='client.26361 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:50:41.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:50:41 smithi086 bash[24289]: cluster 2024-09-16T05:50:40.149496+0000 mgr.a (mgr.14373) 594 : cluster [DBG] pgmap v410: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 3.7 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-16T05:50:41.585 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:50:41 smithi047 bash[22744]: cluster 2024-09-16T05:50:40.149496+0000 mgr.a (mgr.14373) 594 : cluster [DBG] pgmap v410: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 3.7 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-16T05:50:41.801 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:50:41 smithi157 bash[24585]: cluster 2024-09-16T05:50:40.149496+0000 mgr.a (mgr.14373) 594 : cluster [DBG] pgmap v410: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 3.7 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-16T05:50:43.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:50:43 smithi086 bash[24289]: cluster 2024-09-16T05:50:42.151667+0000 mgr.a (mgr.14373) 595 : cluster [DBG] pgmap v411: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T05:50:43.585 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:50:43 smithi047 bash[22744]: cluster 2024-09-16T05:50:42.151667+0000 mgr.a (mgr.14373) 595 : cluster [DBG] pgmap v411: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T05:50:43.801 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:50:43 smithi157 bash[24585]: cluster 2024-09-16T05:50:42.151667+0000 mgr.a (mgr.14373) 595 : cluster [DBG] pgmap v411: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T05:50:43.868 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T05:50:43.869 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T05:50:43.870 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T05:50:44.640 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T05:50:44.640 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T05:50:44.640 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T05:50:44.640 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T05:50:44.641 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T05:50:45.585 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:50:45 smithi047 bash[22744]: cluster 2024-09-16T05:50:44.152366+0000 mgr.a (mgr.14373) 596 : cluster [DBG] pgmap v412: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T05:50:45.586 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:50:45 smithi047 bash[22744]: audit 2024-09-16T05:50:44.214413+0000 mgr.a (mgr.14373) 597 : audit [DBG] from='client.26436 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:50:45.801 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:50:45 smithi157 bash[24585]: cluster 2024-09-16T05:50:44.152366+0000 mgr.a (mgr.14373) 596 : cluster [DBG] pgmap v412: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T05:50:45.801 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:50:45 smithi157 bash[24585]: audit 2024-09-16T05:50:44.214413+0000 mgr.a (mgr.14373) 597 : audit [DBG] from='client.26436 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:50:45.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:50:45 smithi086 bash[24289]: cluster 2024-09-16T05:50:44.152366+0000 mgr.a (mgr.14373) 596 : cluster [DBG] pgmap v412: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T05:50:45.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:50:45 smithi086 bash[24289]: audit 2024-09-16T05:50:44.214413+0000 mgr.a (mgr.14373) 597 : audit [DBG] from='client.26436 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:50:47.585 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:50:47 smithi047 bash[22744]: cluster 2024-09-16T05:50:46.153260+0000 mgr.a (mgr.14373) 598 : cluster [DBG] pgmap v413: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T05:50:47.800 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:50:47 smithi157 bash[24585]: cluster 2024-09-16T05:50:46.153260+0000 mgr.a (mgr.14373) 598 : cluster [DBG] pgmap v413: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T05:50:47.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:50:47 smithi086 bash[24289]: cluster 2024-09-16T05:50:46.153260+0000 mgr.a (mgr.14373) 598 : cluster [DBG] pgmap v413: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T05:50:49.585 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:50:49 smithi047 bash[22744]: cluster 2024-09-16T05:50:48.155535+0000 mgr.a (mgr.14373) 599 : cluster [DBG] pgmap v414: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T05:50:49.641 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T05:50:49.642 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T05:50:49.644 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T05:50:49.800 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:50:49 smithi157 bash[24585]: cluster 2024-09-16T05:50:48.155535+0000 mgr.a (mgr.14373) 599 : cluster [DBG] pgmap v414: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T05:50:49.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:50:49 smithi086 bash[24289]: cluster 2024-09-16T05:50:48.155535+0000 mgr.a (mgr.14373) 599 : cluster [DBG] pgmap v414: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T05:50:50.374 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T05:50:50.374 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T05:50:50.374 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T05:50:50.374 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T05:50:50.374 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T05:50:51.585 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:50:51 smithi047 bash[22744]: audit 2024-09-16T05:50:49.975234+0000 mgr.a (mgr.14373) 600 : audit [DBG] from='client.26511 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:50:51.585 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:50:51 smithi047 bash[22744]: cluster 2024-09-16T05:50:50.156171+0000 mgr.a (mgr.14373) 601 : cluster [DBG] pgmap v415: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 5.2 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-16T05:50:51.801 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:50:51 smithi157 bash[24585]: audit 2024-09-16T05:50:49.975234+0000 mgr.a (mgr.14373) 600 : audit [DBG] from='client.26511 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:50:51.801 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:50:51 smithi157 bash[24585]: cluster 2024-09-16T05:50:50.156171+0000 mgr.a (mgr.14373) 601 : cluster [DBG] pgmap v415: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 5.2 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-16T05:50:51.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:50:51 smithi086 bash[24289]: audit 2024-09-16T05:50:49.975234+0000 mgr.a (mgr.14373) 600 : audit [DBG] from='client.26511 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:50:51.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:50:51 smithi086 bash[24289]: cluster 2024-09-16T05:50:50.156171+0000 mgr.a (mgr.14373) 601 : cluster [DBG] pgmap v415: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 5.2 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-16T05:50:53.801 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:50:53 smithi157 bash[24585]: cluster 2024-09-16T05:50:52.158594+0000 mgr.a (mgr.14373) 602 : cluster [DBG] pgmap v416: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-16T05:50:53.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:50:53 smithi086 bash[24289]: cluster 2024-09-16T05:50:52.158594+0000 mgr.a (mgr.14373) 602 : cluster [DBG] pgmap v416: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-16T05:50:53.835 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:50:53 smithi047 bash[22744]: cluster 2024-09-16T05:50:52.158594+0000 mgr.a (mgr.14373) 602 : cluster [DBG] pgmap v416: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-16T05:50:55.375 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T05:50:55.376 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T05:50:55.376 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T05:50:55.800 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:50:55 smithi157 bash[24585]: cluster 2024-09-16T05:50:54.159397+0000 mgr.a (mgr.14373) 603 : cluster [DBG] pgmap v417: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:50:55.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:50:55 smithi086 bash[24289]: cluster 2024-09-16T05:50:54.159397+0000 mgr.a (mgr.14373) 603 : cluster [DBG] pgmap v417: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:50:55.835 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:50:55 smithi047 bash[22744]: cluster 2024-09-16T05:50:54.159397+0000 mgr.a (mgr.14373) 603 : cluster [DBG] pgmap v417: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:50:56.122 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T05:50:56.122 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T05:50:56.122 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T05:50:56.122 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T05:50:56.122 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T05:50:57.801 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:50:57 smithi157 bash[24585]: audit 2024-09-16T05:50:55.711136+0000 mgr.a (mgr.14373) 604 : audit [DBG] from='client.26589 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:50:57.801 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:50:57 smithi157 bash[24585]: cluster 2024-09-16T05:50:56.160082+0000 mgr.a (mgr.14373) 605 : cluster [DBG] pgmap v418: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:50:57.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:50:57 smithi086 bash[24289]: audit 2024-09-16T05:50:55.711136+0000 mgr.a (mgr.14373) 604 : audit [DBG] from='client.26589 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:50:57.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:50:57 smithi086 bash[24289]: cluster 2024-09-16T05:50:56.160082+0000 mgr.a (mgr.14373) 605 : cluster [DBG] pgmap v418: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:50:57.835 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:50:57 smithi047 bash[22744]: audit 2024-09-16T05:50:55.711136+0000 mgr.a (mgr.14373) 604 : audit [DBG] from='client.26589 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:50:57.835 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:50:57 smithi047 bash[22744]: cluster 2024-09-16T05:50:56.160082+0000 mgr.a (mgr.14373) 605 : cluster [DBG] pgmap v418: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:50:59.801 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:50:59 smithi157 bash[24585]: cluster 2024-09-16T05:50:58.162244+0000 mgr.a (mgr.14373) 606 : cluster [DBG] pgmap v419: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:50:59.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:50:59 smithi086 bash[24289]: cluster 2024-09-16T05:50:58.162244+0000 mgr.a (mgr.14373) 606 : cluster [DBG] pgmap v419: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:50:59.835 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:50:59 smithi047 bash[22744]: cluster 2024-09-16T05:50:58.162244+0000 mgr.a (mgr.14373) 606 : cluster [DBG] pgmap v419: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:51:01.123 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T05:51:01.124 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T05:51:01.124 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T05:51:01.801 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:51:01 smithi157 bash[24585]: cluster 2024-09-16T05:51:00.163016+0000 mgr.a (mgr.14373) 607 : cluster [DBG] pgmap v420: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:51:01.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:51:01 smithi086 bash[24289]: cluster 2024-09-16T05:51:00.163016+0000 mgr.a (mgr.14373) 607 : cluster [DBG] pgmap v420: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:51:01.835 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:51:01 smithi047 bash[22744]: cluster 2024-09-16T05:51:00.163016+0000 mgr.a (mgr.14373) 607 : cluster [DBG] pgmap v420: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:51:01.898 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T05:51:01.898 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T05:51:01.898 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T05:51:01.898 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T05:51:01.898 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T05:51:03.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:51:03 smithi157 bash[24585]: audit 2024-09-16T05:51:01.465374+0000 mgr.a (mgr.14373) 608 : audit [DBG] from='client.26667 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:51:03.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:51:03 smithi157 bash[24585]: cluster 2024-09-16T05:51:02.165732+0000 mgr.a (mgr.14373) 609 : cluster [DBG] pgmap v421: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:51:03.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:51:03 smithi086 bash[24289]: audit 2024-09-16T05:51:01.465374+0000 mgr.a (mgr.14373) 608 : audit [DBG] from='client.26667 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:51:03.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:51:03 smithi086 bash[24289]: cluster 2024-09-16T05:51:02.165732+0000 mgr.a (mgr.14373) 609 : cluster [DBG] pgmap v421: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:51:03.835 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:51:03 smithi047 bash[22744]: audit 2024-09-16T05:51:01.465374+0000 mgr.a (mgr.14373) 608 : audit [DBG] from='client.26667 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:51:03.836 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:51:03 smithi047 bash[22744]: cluster 2024-09-16T05:51:02.165732+0000 mgr.a (mgr.14373) 609 : cluster [DBG] pgmap v421: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:51:05.801 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:51:05 smithi157 bash[24585]: cluster 2024-09-16T05:51:04.166551+0000 mgr.a (mgr.14373) 610 : cluster [DBG] pgmap v422: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T05:51:05.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:51:05 smithi086 bash[24289]: cluster 2024-09-16T05:51:04.166551+0000 mgr.a (mgr.14373) 610 : cluster [DBG] pgmap v422: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T05:51:05.835 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:51:05 smithi047 bash[22744]: cluster 2024-09-16T05:51:04.166551+0000 mgr.a (mgr.14373) 610 : cluster [DBG] pgmap v422: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T05:51:06.900 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T05:51:06.900 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T05:51:06.901 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T05:51:07.672 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T05:51:07.672 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T05:51:07.672 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T05:51:07.672 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T05:51:07.672 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T05:51:07.801 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:51:07 smithi157 bash[24585]: cluster 2024-09-16T05:51:06.167433+0000 mgr.a (mgr.14373) 611 : cluster [DBG] pgmap v423: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T05:51:07.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:51:07 smithi086 bash[24289]: cluster 2024-09-16T05:51:06.167433+0000 mgr.a (mgr.14373) 611 : cluster [DBG] pgmap v423: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T05:51:07.835 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:51:07 smithi047 bash[22744]: cluster 2024-09-16T05:51:06.167433+0000 mgr.a (mgr.14373) 611 : cluster [DBG] pgmap v423: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T05:51:08.800 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:51:08 smithi157 bash[24585]: audit 2024-09-16T05:51:07.240662+0000 mgr.a (mgr.14373) 612 : audit [DBG] from='client.26745 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:51:08.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:51:08 smithi086 bash[24289]: audit 2024-09-16T05:51:07.240662+0000 mgr.a (mgr.14373) 612 : audit [DBG] from='client.26745 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:51:08.835 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:51:08 smithi047 bash[22744]: audit 2024-09-16T05:51:07.240662+0000 mgr.a (mgr.14373) 612 : audit [DBG] from='client.26745 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:51:09.801 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:51:09 smithi157 bash[24585]: cluster 2024-09-16T05:51:08.170314+0000 mgr.a (mgr.14373) 613 : cluster [DBG] pgmap v424: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:51:09.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:51:09 smithi086 bash[24289]: cluster 2024-09-16T05:51:08.170314+0000 mgr.a (mgr.14373) 613 : cluster [DBG] pgmap v424: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:51:09.835 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:51:09 smithi047 bash[22744]: cluster 2024-09-16T05:51:08.170314+0000 mgr.a (mgr.14373) 613 : cluster [DBG] pgmap v424: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:51:11.801 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:51:11 smithi157 bash[24585]: cluster 2024-09-16T05:51:10.171248+0000 mgr.a (mgr.14373) 614 : cluster [DBG] pgmap v425: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T05:51:11.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:51:11 smithi086 bash[24289]: cluster 2024-09-16T05:51:10.171248+0000 mgr.a (mgr.14373) 614 : cluster [DBG] pgmap v425: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T05:51:11.835 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:51:11 smithi047 bash[22744]: cluster 2024-09-16T05:51:10.171248+0000 mgr.a (mgr.14373) 614 : cluster [DBG] pgmap v425: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T05:51:12.673 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T05:51:12.674 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T05:51:12.674 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T05:51:13.442 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T05:51:13.443 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T05:51:13.443 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T05:51:13.443 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T05:51:13.443 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T05:51:13.801 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:51:13 smithi157 bash[24585]: cluster 2024-09-16T05:51:12.173286+0000 mgr.a (mgr.14373) 615 : cluster [DBG] pgmap v426: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:51:13.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:51:13 smithi086 bash[24289]: cluster 2024-09-16T05:51:12.173286+0000 mgr.a (mgr.14373) 615 : cluster [DBG] pgmap v426: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:51:13.835 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:51:13 smithi047 bash[22744]: cluster 2024-09-16T05:51:12.173286+0000 mgr.a (mgr.14373) 615 : cluster [DBG] pgmap v426: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:51:14.801 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:51:14 smithi157 bash[24585]: audit 2024-09-16T05:51:13.013464+0000 mgr.a (mgr.14373) 616 : audit [DBG] from='client.26823 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:51:14.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:51:14 smithi086 bash[24289]: audit 2024-09-16T05:51:13.013464+0000 mgr.a (mgr.14373) 616 : audit [DBG] from='client.26823 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:51:14.835 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:51:14 smithi047 bash[22744]: audit 2024-09-16T05:51:13.013464+0000 mgr.a (mgr.14373) 616 : audit [DBG] from='client.26823 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:51:15.801 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:51:15 smithi157 bash[24585]: cluster 2024-09-16T05:51:14.174234+0000 mgr.a (mgr.14373) 617 : cluster [DBG] pgmap v427: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:51:15.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:51:15 smithi086 bash[24289]: cluster 2024-09-16T05:51:14.174234+0000 mgr.a (mgr.14373) 617 : cluster [DBG] pgmap v427: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:51:15.835 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:51:15 smithi047 bash[22744]: cluster 2024-09-16T05:51:14.174234+0000 mgr.a (mgr.14373) 617 : cluster [DBG] pgmap v427: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:51:17.801 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:51:17 smithi157 bash[24585]: cluster 2024-09-16T05:51:16.174956+0000 mgr.a (mgr.14373) 618 : cluster [DBG] pgmap v428: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:51:17.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:51:17 smithi086 bash[24289]: cluster 2024-09-16T05:51:16.174956+0000 mgr.a (mgr.14373) 618 : cluster [DBG] pgmap v428: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:51:17.835 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:51:17 smithi047 bash[22744]: cluster 2024-09-16T05:51:16.174956+0000 mgr.a (mgr.14373) 618 : cluster [DBG] pgmap v428: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:51:18.444 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T05:51:18.445 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T05:51:18.445 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T05:51:19.215 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T05:51:19.215 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T05:51:19.215 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T05:51:19.215 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T05:51:19.215 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T05:51:19.800 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:51:19 smithi157 bash[24585]: cluster 2024-09-16T05:51:18.177230+0000 mgr.a (mgr.14373) 619 : cluster [DBG] pgmap v429: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:51:19.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:51:19 smithi086 bash[24289]: cluster 2024-09-16T05:51:18.177230+0000 mgr.a (mgr.14373) 619 : cluster [DBG] pgmap v429: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:51:19.835 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:51:19 smithi047 bash[22744]: cluster 2024-09-16T05:51:18.177230+0000 mgr.a (mgr.14373) 619 : cluster [DBG] pgmap v429: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:51:20.801 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:51:20 smithi157 bash[24585]: audit 2024-09-16T05:51:18.787964+0000 mgr.a (mgr.14373) 620 : audit [DBG] from='client.26901 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:51:20.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:51:20 smithi086 bash[24289]: audit 2024-09-16T05:51:18.787964+0000 mgr.a (mgr.14373) 620 : audit [DBG] from='client.26901 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:51:20.835 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:51:20 smithi047 bash[22744]: audit 2024-09-16T05:51:18.787964+0000 mgr.a (mgr.14373) 620 : audit [DBG] from='client.26901 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:51:21.800 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:51:21 smithi157 bash[24585]: cluster 2024-09-16T05:51:20.178215+0000 mgr.a (mgr.14373) 621 : cluster [DBG] pgmap v430: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:51:21.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:51:21 smithi086 bash[24289]: cluster 2024-09-16T05:51:20.178215+0000 mgr.a (mgr.14373) 621 : cluster [DBG] pgmap v430: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:51:21.835 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:51:21 smithi047 bash[22744]: cluster 2024-09-16T05:51:20.178215+0000 mgr.a (mgr.14373) 621 : cluster [DBG] pgmap v430: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:51:23.801 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:51:23 smithi157 bash[24585]: cluster 2024-09-16T05:51:22.180423+0000 mgr.a (mgr.14373) 622 : cluster [DBG] pgmap v431: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:51:23.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:51:23 smithi086 bash[24289]: cluster 2024-09-16T05:51:22.180423+0000 mgr.a (mgr.14373) 622 : cluster [DBG] pgmap v431: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:51:23.836 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:51:23 smithi047 bash[22744]: cluster 2024-09-16T05:51:22.180423+0000 mgr.a (mgr.14373) 622 : cluster [DBG] pgmap v431: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:51:24.217 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T05:51:24.217 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T05:51:24.217 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T05:51:24.937 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T05:51:24.937 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T05:51:24.937 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T05:51:24.938 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T05:51:24.938 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T05:51:25.800 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:51:25 smithi157 bash[24585]: cluster 2024-09-16T05:51:24.181190+0000 mgr.a (mgr.14373) 623 : cluster [DBG] pgmap v432: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:51:25.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:51:25 smithi086 bash[24289]: cluster 2024-09-16T05:51:24.181190+0000 mgr.a (mgr.14373) 623 : cluster [DBG] pgmap v432: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:51:25.835 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:51:25 smithi047 bash[22744]: cluster 2024-09-16T05:51:24.181190+0000 mgr.a (mgr.14373) 623 : cluster [DBG] pgmap v432: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:51:26.800 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:51:26 smithi157 bash[24585]: audit 2024-09-16T05:51:24.552755+0000 mgr.a (mgr.14373) 624 : audit [DBG] from='client.26979 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:51:26.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:51:26 smithi086 bash[24289]: audit 2024-09-16T05:51:24.552755+0000 mgr.a (mgr.14373) 624 : audit [DBG] from='client.26979 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:51:26.835 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:51:26 smithi047 bash[22744]: audit 2024-09-16T05:51:24.552755+0000 mgr.a (mgr.14373) 624 : audit [DBG] from='client.26979 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:51:27.801 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:51:27 smithi157 bash[24585]: cluster 2024-09-16T05:51:26.182136+0000 mgr.a (mgr.14373) 625 : cluster [DBG] pgmap v433: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:51:27.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:51:27 smithi086 bash[24289]: cluster 2024-09-16T05:51:26.182136+0000 mgr.a (mgr.14373) 625 : cluster [DBG] pgmap v433: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:51:27.835 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:51:27 smithi047 bash[22744]: cluster 2024-09-16T05:51:26.182136+0000 mgr.a (mgr.14373) 625 : cluster [DBG] pgmap v433: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:51:29.801 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:51:29 smithi157 bash[24585]: cluster 2024-09-16T05:51:28.184464+0000 mgr.a (mgr.14373) 626 : cluster [DBG] pgmap v434: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:51:29.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:51:29 smithi086 bash[24289]: cluster 2024-09-16T05:51:28.184464+0000 mgr.a (mgr.14373) 626 : cluster [DBG] pgmap v434: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:51:29.835 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:51:29 smithi047 bash[22744]: cluster 2024-09-16T05:51:28.184464+0000 mgr.a (mgr.14373) 626 : cluster [DBG] pgmap v434: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:51:29.939 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T05:51:29.939 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T05:51:29.939 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T05:51:30.712 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T05:51:30.712 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T05:51:30.713 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T05:51:30.713 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T05:51:30.713 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T05:51:31.801 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:51:31 smithi157 bash[24585]: cluster 2024-09-16T05:51:30.185018+0000 mgr.a (mgr.14373) 627 : cluster [DBG] pgmap v435: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:51:31.801 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:51:31 smithi157 bash[24585]: audit 2024-09-16T05:51:30.278100+0000 mgr.a (mgr.14373) 628 : audit [DBG] from='client.27054 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:51:31.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:51:31 smithi086 bash[24289]: cluster 2024-09-16T05:51:30.185018+0000 mgr.a (mgr.14373) 627 : cluster [DBG] pgmap v435: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:51:31.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:51:31 smithi086 bash[24289]: audit 2024-09-16T05:51:30.278100+0000 mgr.a (mgr.14373) 628 : audit [DBG] from='client.27054 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:51:31.835 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:51:31 smithi047 bash[22744]: cluster 2024-09-16T05:51:30.185018+0000 mgr.a (mgr.14373) 627 : cluster [DBG] pgmap v435: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:51:31.836 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:51:31 smithi047 bash[22744]: audit 2024-09-16T05:51:30.278100+0000 mgr.a (mgr.14373) 628 : audit [DBG] from='client.27054 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:51:33.801 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:51:33 smithi157 bash[24585]: cluster 2024-09-16T05:51:32.187247+0000 mgr.a (mgr.14373) 629 : cluster [DBG] pgmap v436: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:51:33.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:51:33 smithi086 bash[24289]: cluster 2024-09-16T05:51:32.187247+0000 mgr.a (mgr.14373) 629 : cluster [DBG] pgmap v436: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:51:33.835 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:51:33 smithi047 bash[22744]: cluster 2024-09-16T05:51:32.187247+0000 mgr.a (mgr.14373) 629 : cluster [DBG] pgmap v436: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:51:35.714 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T05:51:35.715 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T05:51:35.715 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T05:51:35.800 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:51:35 smithi157 bash[24585]: cluster 2024-09-16T05:51:34.188040+0000 mgr.a (mgr.14373) 630 : cluster [DBG] pgmap v437: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:51:35.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:51:35 smithi086 bash[24289]: cluster 2024-09-16T05:51:34.188040+0000 mgr.a (mgr.14373) 630 : cluster [DBG] pgmap v437: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:51:35.835 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:51:35 smithi047 bash[22744]: cluster 2024-09-16T05:51:34.188040+0000 mgr.a (mgr.14373) 630 : cluster [DBG] pgmap v437: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:51:36.452 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T05:51:36.453 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T05:51:36.453 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T05:51:36.453 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T05:51:36.453 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T05:51:36.800 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:51:36 smithi157 bash[24585]: audit 2024-09-16T05:51:36.048819+0000 mgr.a (mgr.14373) 631 : audit [DBG] from='client.27132 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:51:36.801 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:51:36 smithi157 bash[24585]: cluster 2024-09-16T05:51:36.188685+0000 mgr.a (mgr.14373) 632 : cluster [DBG] pgmap v438: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:51:36.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:51:36 smithi086 bash[24289]: audit 2024-09-16T05:51:36.048819+0000 mgr.a (mgr.14373) 631 : audit [DBG] from='client.27132 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:51:36.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:51:36 smithi086 bash[24289]: cluster 2024-09-16T05:51:36.188685+0000 mgr.a (mgr.14373) 632 : cluster [DBG] pgmap v438: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:51:36.835 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:51:36 smithi047 bash[22744]: audit 2024-09-16T05:51:36.048819+0000 mgr.a (mgr.14373) 631 : audit [DBG] from='client.27132 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:51:36.835 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:51:36 smithi047 bash[22744]: cluster 2024-09-16T05:51:36.188685+0000 mgr.a (mgr.14373) 632 : cluster [DBG] pgmap v438: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:51:37.801 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:51:37 smithi157 bash[24585]: audit 2024-09-16T05:51:36.790403+0000 mon.b (mon.2) 106 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T05:51:37.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:51:37 smithi086 bash[24289]: audit 2024-09-16T05:51:36.790403+0000 mon.b (mon.2) 106 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T05:51:37.835 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:51:37 smithi047 bash[22744]: audit 2024-09-16T05:51:36.790403+0000 mon.b (mon.2) 106 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T05:51:38.801 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:51:38 smithi157 bash[24585]: audit 2024-09-16T05:51:37.634177+0000 mon.b (mon.2) 107 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T05:51:38.801 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:51:38 smithi157 bash[24585]: audit 2024-09-16T05:51:37.636080+0000 mon.b (mon.2) 108 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T05:51:38.801 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:51:38 smithi157 bash[24585]: audit 2024-09-16T05:51:37.652141+0000 mon.a (mon.0) 606 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T05:51:38.801 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:51:38 smithi157 bash[24585]: audit 2024-09-16T05:51:37.653877+0000 mon.b (mon.2) 109 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T05:51:38.801 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:51:38 smithi157 bash[24585]: audit 2024-09-16T05:51:37.662586+0000 mgr.a (mgr.14373) 633 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T05:51:38.801 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:51:38 smithi157 bash[24585]: cluster 2024-09-16T05:51:38.190612+0000 mgr.a (mgr.14373) 634 : cluster [DBG] pgmap v439: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:51:38.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:51:38 smithi157 bash[24585]: audit 2024-09-16T05:51:38.363237+0000 mgr.a (mgr.14373) 635 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T05:51:38.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:51:38 smithi157 bash[24585]: cephadm 2024-09-16T05:51:38.365469+0000 mgr.a (mgr.14373) 636 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T05:51:38.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:51:38 smithi086 bash[24289]: audit 2024-09-16T05:51:37.634177+0000 mon.b (mon.2) 107 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T05:51:38.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:51:38 smithi086 bash[24289]: audit 2024-09-16T05:51:37.636080+0000 mon.b (mon.2) 108 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T05:51:38.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:51:38 smithi086 bash[24289]: audit 2024-09-16T05:51:37.652141+0000 mon.a (mon.0) 606 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T05:51:38.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:51:38 smithi086 bash[24289]: audit 2024-09-16T05:51:37.653877+0000 mon.b (mon.2) 109 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T05:51:38.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:51:38 smithi086 bash[24289]: audit 2024-09-16T05:51:37.662586+0000 mgr.a (mgr.14373) 633 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T05:51:38.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:51:38 smithi086 bash[24289]: cluster 2024-09-16T05:51:38.190612+0000 mgr.a (mgr.14373) 634 : cluster [DBG] pgmap v439: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:51:38.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:51:38 smithi086 bash[24289]: audit 2024-09-16T05:51:38.363237+0000 mgr.a (mgr.14373) 635 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T05:51:38.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:51:38 smithi086 bash[24289]: cephadm 2024-09-16T05:51:38.365469+0000 mgr.a (mgr.14373) 636 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T05:51:38.836 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 05:51:38 smithi047 bash[22994]: debug 2024-09-16T05:51:38.360+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T05:51:38.836 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 05:51:38 smithi047 bash[22994]: debug 2024-09-16T05:51:38.360+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T05:51:38.836 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:51:38 smithi047 bash[22744]: audit 2024-09-16T05:51:37.634177+0000 mon.b (mon.2) 107 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T05:51:38.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:51:38 smithi047 bash[22744]: audit 2024-09-16T05:51:37.636080+0000 mon.b (mon.2) 108 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T05:51:38.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:51:38 smithi047 bash[22744]: audit 2024-09-16T05:51:37.652141+0000 mon.a (mon.0) 606 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T05:51:38.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:51:38 smithi047 bash[22744]: audit 2024-09-16T05:51:37.653877+0000 mon.b (mon.2) 109 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T05:51:38.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:51:38 smithi047 bash[22744]: audit 2024-09-16T05:51:37.662586+0000 mgr.a (mgr.14373) 633 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T05:51:38.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:51:38 smithi047 bash[22744]: cluster 2024-09-16T05:51:38.190612+0000 mgr.a (mgr.14373) 634 : cluster [DBG] pgmap v439: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:51:38.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:51:38 smithi047 bash[22744]: audit 2024-09-16T05:51:38.363237+0000 mgr.a (mgr.14373) 635 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T05:51:38.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:51:38 smithi047 bash[22744]: cephadm 2024-09-16T05:51:38.365469+0000 mgr.a (mgr.14373) 636 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T05:51:41.454 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T05:51:41.454 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T05:51:41.455 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T05:51:41.550 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:51:41 smithi157 bash[24585]: cluster 2024-09-16T05:51:40.191360+0000 mgr.a (mgr.14373) 637 : cluster [DBG] pgmap v440: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:51:41.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:51:41 smithi086 bash[24289]: cluster 2024-09-16T05:51:40.191360+0000 mgr.a (mgr.14373) 637 : cluster [DBG] pgmap v440: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:51:41.585 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:51:41 smithi047 bash[22744]: cluster 2024-09-16T05:51:40.191360+0000 mgr.a (mgr.14373) 637 : cluster [DBG] pgmap v440: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:51:42.203 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T05:51:42.204 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T05:51:42.204 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T05:51:42.204 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T05:51:42.204 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T05:51:43.551 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:51:43 smithi157 bash[24585]: audit 2024-09-16T05:51:41.794636+0000 mgr.a (mgr.14373) 638 : audit [DBG] from='client.27315 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:51:43.551 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:51:43 smithi157 bash[24585]: cluster 2024-09-16T05:51:42.192526+0000 mgr.a (mgr.14373) 639 : cluster [DBG] pgmap v441: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T05:51:43.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:51:43 smithi086 bash[24289]: audit 2024-09-16T05:51:41.794636+0000 mgr.a (mgr.14373) 638 : audit [DBG] from='client.27315 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:51:43.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:51:43 smithi086 bash[24289]: cluster 2024-09-16T05:51:42.192526+0000 mgr.a (mgr.14373) 639 : cluster [DBG] pgmap v441: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T05:51:43.585 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:51:43 smithi047 bash[22744]: audit 2024-09-16T05:51:41.794636+0000 mgr.a (mgr.14373) 638 : audit [DBG] from='client.27315 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:51:43.586 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:51:43 smithi047 bash[22744]: cluster 2024-09-16T05:51:42.192526+0000 mgr.a (mgr.14373) 639 : cluster [DBG] pgmap v441: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T05:51:45.551 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:51:45 smithi157 bash[24585]: cluster 2024-09-16T05:51:44.193286+0000 mgr.a (mgr.14373) 640 : cluster [DBG] pgmap v442: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T05:51:45.572 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:51:45 smithi086 bash[24289]: cluster 2024-09-16T05:51:44.193286+0000 mgr.a (mgr.14373) 640 : cluster [DBG] pgmap v442: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T05:51:45.585 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:51:45 smithi047 bash[22744]: cluster 2024-09-16T05:51:44.193286+0000 mgr.a (mgr.14373) 640 : cluster [DBG] pgmap v442: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T05:51:47.204 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T05:51:47.205 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T05:51:47.205 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T05:51:47.550 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:51:47 smithi157 bash[24585]: cluster 2024-09-16T05:51:46.194051+0000 mgr.a (mgr.14373) 641 : cluster [DBG] pgmap v443: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T05:51:47.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:51:47 smithi086 bash[24289]: cluster 2024-09-16T05:51:46.194051+0000 mgr.a (mgr.14373) 641 : cluster [DBG] pgmap v443: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T05:51:47.585 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:51:47 smithi047 bash[22744]: cluster 2024-09-16T05:51:46.194051+0000 mgr.a (mgr.14373) 641 : cluster [DBG] pgmap v443: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T05:51:47.977 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T05:51:47.977 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T05:51:47.977 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T05:51:47.977 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T05:51:47.977 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T05:51:49.551 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:51:49 smithi157 bash[24585]: audit 2024-09-16T05:51:47.544388+0000 mgr.a (mgr.14373) 642 : audit [DBG] from='client.27393 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:51:49.551 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:51:49 smithi157 bash[24585]: cluster 2024-09-16T05:51:48.196867+0000 mgr.a (mgr.14373) 643 : cluster [DBG] pgmap v444: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T05:51:49.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:51:49 smithi086 bash[24289]: audit 2024-09-16T05:51:47.544388+0000 mgr.a (mgr.14373) 642 : audit [DBG] from='client.27393 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:51:49.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:51:49 smithi086 bash[24289]: cluster 2024-09-16T05:51:48.196867+0000 mgr.a (mgr.14373) 643 : cluster [DBG] pgmap v444: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T05:51:49.585 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:51:49 smithi047 bash[22744]: audit 2024-09-16T05:51:47.544388+0000 mgr.a (mgr.14373) 642 : audit [DBG] from='client.27393 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:51:49.586 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:51:49 smithi047 bash[22744]: cluster 2024-09-16T05:51:48.196867+0000 mgr.a (mgr.14373) 643 : cluster [DBG] pgmap v444: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T05:51:51.550 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:51:51 smithi157 bash[24585]: cluster 2024-09-16T05:51:50.197699+0000 mgr.a (mgr.14373) 644 : cluster [DBG] pgmap v445: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T05:51:51.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:51:51 smithi086 bash[24289]: cluster 2024-09-16T05:51:50.197699+0000 mgr.a (mgr.14373) 644 : cluster [DBG] pgmap v445: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T05:51:51.585 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:51:51 smithi047 bash[22744]: cluster 2024-09-16T05:51:50.197699+0000 mgr.a (mgr.14373) 644 : cluster [DBG] pgmap v445: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T05:51:52.979 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T05:51:52.979 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T05:51:52.980 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T05:51:53.551 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:51:53 smithi157 bash[24585]: cluster 2024-09-16T05:51:52.199692+0000 mgr.a (mgr.14373) 645 : cluster [DBG] pgmap v446: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T05:51:53.572 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:51:53 smithi086 bash[24289]: cluster 2024-09-16T05:51:52.199692+0000 mgr.a (mgr.14373) 645 : cluster [DBG] pgmap v446: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T05:51:53.585 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:51:53 smithi047 bash[22744]: cluster 2024-09-16T05:51:52.199692+0000 mgr.a (mgr.14373) 645 : cluster [DBG] pgmap v446: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T05:51:53.753 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T05:51:53.754 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T05:51:53.754 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T05:51:53.754 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T05:51:53.754 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T05:51:54.550 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:51:54 smithi157 bash[24585]: audit 2024-09-16T05:51:53.323509+0000 mgr.a (mgr.14373) 646 : audit [DBG] from='client.27471 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:51:54.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:51:54 smithi086 bash[24289]: audit 2024-09-16T05:51:53.323509+0000 mgr.a (mgr.14373) 646 : audit [DBG] from='client.27471 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:51:54.585 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:51:54 smithi047 bash[22744]: audit 2024-09-16T05:51:53.323509+0000 mgr.a (mgr.14373) 646 : audit [DBG] from='client.27471 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:51:55.551 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:51:55 smithi157 bash[24585]: cluster 2024-09-16T05:51:54.200613+0000 mgr.a (mgr.14373) 647 : cluster [DBG] pgmap v447: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:51:55.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:51:55 smithi086 bash[24289]: cluster 2024-09-16T05:51:54.200613+0000 mgr.a (mgr.14373) 647 : cluster [DBG] pgmap v447: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:51:55.585 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:51:55 smithi047 bash[22744]: cluster 2024-09-16T05:51:54.200613+0000 mgr.a (mgr.14373) 647 : cluster [DBG] pgmap v447: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:51:57.550 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:51:57 smithi157 bash[24585]: cluster 2024-09-16T05:51:56.201414+0000 mgr.a (mgr.14373) 648 : cluster [DBG] pgmap v448: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:51:57.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:51:57 smithi086 bash[24289]: cluster 2024-09-16T05:51:56.201414+0000 mgr.a (mgr.14373) 648 : cluster [DBG] pgmap v448: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:51:57.585 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:51:57 smithi047 bash[22744]: cluster 2024-09-16T05:51:56.201414+0000 mgr.a (mgr.14373) 648 : cluster [DBG] pgmap v448: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:51:58.755 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T05:51:58.756 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T05:51:58.756 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T05:51:59.532 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T05:51:59.532 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T05:51:59.532 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T05:51:59.532 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T05:51:59.532 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T05:51:59.550 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:51:59 smithi157 bash[24585]: cluster 2024-09-16T05:51:58.203583+0000 mgr.a (mgr.14373) 649 : cluster [DBG] pgmap v449: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:51:59.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:51:59 smithi086 bash[24289]: cluster 2024-09-16T05:51:58.203583+0000 mgr.a (mgr.14373) 649 : cluster [DBG] pgmap v449: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:51:59.585 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:51:59 smithi047 bash[22744]: cluster 2024-09-16T05:51:58.203583+0000 mgr.a (mgr.14373) 649 : cluster [DBG] pgmap v449: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:52:00.550 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:52:00 smithi157 bash[24585]: audit 2024-09-16T05:51:59.097868+0000 mgr.a (mgr.14373) 650 : audit [DBG] from='client.27546 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:52:00.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:52:00 smithi086 bash[24289]: audit 2024-09-16T05:51:59.097868+0000 mgr.a (mgr.14373) 650 : audit [DBG] from='client.27546 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:52:00.585 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:52:00 smithi047 bash[22744]: audit 2024-09-16T05:51:59.097868+0000 mgr.a (mgr.14373) 650 : audit [DBG] from='client.27546 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:52:01.550 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:52:01 smithi157 bash[24585]: cluster 2024-09-16T05:52:00.204545+0000 mgr.a (mgr.14373) 651 : cluster [DBG] pgmap v450: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:52:01.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:52:01 smithi086 bash[24289]: cluster 2024-09-16T05:52:00.204545+0000 mgr.a (mgr.14373) 651 : cluster [DBG] pgmap v450: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:52:01.585 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:52:01 smithi047 bash[22744]: cluster 2024-09-16T05:52:00.204545+0000 mgr.a (mgr.14373) 651 : cluster [DBG] pgmap v450: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:52:03.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:52:03 smithi086 bash[24289]: cluster 2024-09-16T05:52:02.206798+0000 mgr.a (mgr.14373) 652 : cluster [DBG] pgmap v451: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:52:03.585 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:52:03 smithi047 bash[22744]: cluster 2024-09-16T05:52:02.206798+0000 mgr.a (mgr.14373) 652 : cluster [DBG] pgmap v451: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:52:03.800 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:52:03 smithi157 bash[24585]: cluster 2024-09-16T05:52:02.206798+0000 mgr.a (mgr.14373) 652 : cluster [DBG] pgmap v451: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:52:04.534 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T05:52:04.534 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T05:52:04.534 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T05:52:05.275 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T05:52:05.275 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T05:52:05.275 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T05:52:05.275 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T05:52:05.275 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T05:52:05.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:52:05 smithi086 bash[24289]: cluster 2024-09-16T05:52:04.207558+0000 mgr.a (mgr.14373) 653 : cluster [DBG] pgmap v452: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:52:05.585 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:52:05 smithi047 bash[22744]: cluster 2024-09-16T05:52:04.207558+0000 mgr.a (mgr.14373) 653 : cluster [DBG] pgmap v452: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:52:05.801 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:52:05 smithi157 bash[24585]: cluster 2024-09-16T05:52:04.207558+0000 mgr.a (mgr.14373) 653 : cluster [DBG] pgmap v452: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:52:06.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:52:06 smithi086 bash[24289]: audit 2024-09-16T05:52:04.867539+0000 mgr.a (mgr.14373) 654 : audit [DBG] from='client.27621 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:52:06.585 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:52:06 smithi047 bash[22744]: audit 2024-09-16T05:52:04.867539+0000 mgr.a (mgr.14373) 654 : audit [DBG] from='client.27621 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:52:06.800 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:52:06 smithi157 bash[24585]: audit 2024-09-16T05:52:04.867539+0000 mgr.a (mgr.14373) 654 : audit [DBG] from='client.27621 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:52:07.586 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:52:07 smithi047 bash[22744]: cluster 2024-09-16T05:52:06.208475+0000 mgr.a (mgr.14373) 655 : cluster [DBG] pgmap v453: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:52:07.800 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:52:07 smithi157 bash[24585]: cluster 2024-09-16T05:52:06.208475+0000 mgr.a (mgr.14373) 655 : cluster [DBG] pgmap v453: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:52:07.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:52:07 smithi086 bash[24289]: cluster 2024-09-16T05:52:06.208475+0000 mgr.a (mgr.14373) 655 : cluster [DBG] pgmap v453: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:52:09.586 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:52:09 smithi047 bash[22744]: cluster 2024-09-16T05:52:08.210827+0000 mgr.a (mgr.14373) 656 : cluster [DBG] pgmap v454: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:52:09.801 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:52:09 smithi157 bash[24585]: cluster 2024-09-16T05:52:08.210827+0000 mgr.a (mgr.14373) 656 : cluster [DBG] pgmap v454: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:52:09.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:52:09 smithi086 bash[24289]: cluster 2024-09-16T05:52:08.210827+0000 mgr.a (mgr.14373) 656 : cluster [DBG] pgmap v454: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:52:10.276 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T05:52:10.277 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T05:52:10.277 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T05:52:11.047 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T05:52:11.048 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T05:52:11.048 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T05:52:11.048 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T05:52:11.048 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T05:52:11.586 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:52:11 smithi047 bash[22744]: cluster 2024-09-16T05:52:10.211777+0000 mgr.a (mgr.14373) 657 : cluster [DBG] pgmap v455: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:52:11.801 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:52:11 smithi157 bash[24585]: cluster 2024-09-16T05:52:10.211777+0000 mgr.a (mgr.14373) 657 : cluster [DBG] pgmap v455: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:52:11.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:52:11 smithi086 bash[24289]: cluster 2024-09-16T05:52:10.211777+0000 mgr.a (mgr.14373) 657 : cluster [DBG] pgmap v455: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:52:12.585 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:52:12 smithi047 bash[22744]: audit 2024-09-16T05:52:10.618575+0000 mgr.a (mgr.14373) 658 : audit [DBG] from='client.27696 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:52:12.801 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:52:12 smithi157 bash[24585]: audit 2024-09-16T05:52:10.618575+0000 mgr.a (mgr.14373) 658 : audit [DBG] from='client.27696 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:52:12.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:52:12 smithi086 bash[24289]: audit 2024-09-16T05:52:10.618575+0000 mgr.a (mgr.14373) 658 : audit [DBG] from='client.27696 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:52:13.800 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:52:13 smithi157 bash[24585]: cluster 2024-09-16T05:52:12.214234+0000 mgr.a (mgr.14373) 659 : cluster [DBG] pgmap v456: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:52:13.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:52:13 smithi086 bash[24289]: cluster 2024-09-16T05:52:12.214234+0000 mgr.a (mgr.14373) 659 : cluster [DBG] pgmap v456: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:52:13.835 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:52:13 smithi047 bash[22744]: cluster 2024-09-16T05:52:12.214234+0000 mgr.a (mgr.14373) 659 : cluster [DBG] pgmap v456: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:52:15.800 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:52:15 smithi157 bash[24585]: cluster 2024-09-16T05:52:14.215113+0000 mgr.a (mgr.14373) 660 : cluster [DBG] pgmap v457: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:52:15.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:52:15 smithi086 bash[24289]: cluster 2024-09-16T05:52:14.215113+0000 mgr.a (mgr.14373) 660 : cluster [DBG] pgmap v457: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:52:15.835 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:52:15 smithi047 bash[22744]: cluster 2024-09-16T05:52:14.215113+0000 mgr.a (mgr.14373) 660 : cluster [DBG] pgmap v457: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:52:16.049 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T05:52:16.050 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T05:52:16.050 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T05:52:16.784 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T05:52:16.784 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T05:52:16.784 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T05:52:16.784 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T05:52:16.784 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T05:52:17.800 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:52:17 smithi157 bash[24585]: cluster 2024-09-16T05:52:16.215638+0000 mgr.a (mgr.14373) 661 : cluster [DBG] pgmap v458: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:52:17.801 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:52:17 smithi157 bash[24585]: audit 2024-09-16T05:52:16.377586+0000 mgr.a (mgr.14373) 662 : audit [DBG] from='client.27771 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:52:17.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:52:17 smithi086 bash[24289]: cluster 2024-09-16T05:52:16.215638+0000 mgr.a (mgr.14373) 661 : cluster [DBG] pgmap v458: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:52:17.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:52:17 smithi086 bash[24289]: audit 2024-09-16T05:52:16.377586+0000 mgr.a (mgr.14373) 662 : audit [DBG] from='client.27771 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:52:17.835 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:52:17 smithi047 bash[22744]: cluster 2024-09-16T05:52:16.215638+0000 mgr.a (mgr.14373) 661 : cluster [DBG] pgmap v458: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:52:17.835 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:52:17 smithi047 bash[22744]: audit 2024-09-16T05:52:16.377586+0000 mgr.a (mgr.14373) 662 : audit [DBG] from='client.27771 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:52:19.800 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:52:19 smithi157 bash[24585]: cluster 2024-09-16T05:52:18.218243+0000 mgr.a (mgr.14373) 663 : cluster [DBG] pgmap v459: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:52:19.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:52:19 smithi086 bash[24289]: cluster 2024-09-16T05:52:18.218243+0000 mgr.a (mgr.14373) 663 : cluster [DBG] pgmap v459: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:52:19.835 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:52:19 smithi047 bash[22744]: cluster 2024-09-16T05:52:18.218243+0000 mgr.a (mgr.14373) 663 : cluster [DBG] pgmap v459: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:52:21.785 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T05:52:21.786 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T05:52:21.786 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T05:52:21.800 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:52:21 smithi157 bash[24585]: cluster 2024-09-16T05:52:20.219021+0000 mgr.a (mgr.14373) 664 : cluster [DBG] pgmap v460: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T05:52:21.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:52:21 smithi086 bash[24289]: cluster 2024-09-16T05:52:20.219021+0000 mgr.a (mgr.14373) 664 : cluster [DBG] pgmap v460: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T05:52:21.835 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:52:21 smithi047 bash[22744]: cluster 2024-09-16T05:52:20.219021+0000 mgr.a (mgr.14373) 664 : cluster [DBG] pgmap v460: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T05:52:22.561 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T05:52:22.562 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T05:52:22.562 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T05:52:22.562 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T05:52:22.562 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T05:52:23.800 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:52:23 smithi157 bash[24585]: audit 2024-09-16T05:52:22.126626+0000 mgr.a (mgr.14373) 665 : audit [DBG] from='client.27849 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:52:23.801 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:52:23 smithi157 bash[24585]: cluster 2024-09-16T05:52:22.220867+0000 mgr.a (mgr.14373) 666 : cluster [DBG] pgmap v461: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:52:23.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:52:23 smithi086 bash[24289]: audit 2024-09-16T05:52:22.126626+0000 mgr.a (mgr.14373) 665 : audit [DBG] from='client.27849 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:52:23.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:52:23 smithi086 bash[24289]: cluster 2024-09-16T05:52:22.220867+0000 mgr.a (mgr.14373) 666 : cluster [DBG] pgmap v461: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:52:23.835 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:52:23 smithi047 bash[22744]: audit 2024-09-16T05:52:22.126626+0000 mgr.a (mgr.14373) 665 : audit [DBG] from='client.27849 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:52:23.836 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:52:23 smithi047 bash[22744]: cluster 2024-09-16T05:52:22.220867+0000 mgr.a (mgr.14373) 666 : cluster [DBG] pgmap v461: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:52:25.800 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:52:25 smithi157 bash[24585]: cluster 2024-09-16T05:52:24.221747+0000 mgr.a (mgr.14373) 667 : cluster [DBG] pgmap v462: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T05:52:25.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:52:25 smithi086 bash[24289]: cluster 2024-09-16T05:52:24.221747+0000 mgr.a (mgr.14373) 667 : cluster [DBG] pgmap v462: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T05:52:25.835 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:52:25 smithi047 bash[22744]: cluster 2024-09-16T05:52:24.221747+0000 mgr.a (mgr.14373) 667 : cluster [DBG] pgmap v462: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T05:52:27.563 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T05:52:27.564 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T05:52:27.564 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T05:52:27.800 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:52:27 smithi157 bash[24585]: cluster 2024-09-16T05:52:26.222511+0000 mgr.a (mgr.14373) 668 : cluster [DBG] pgmap v463: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T05:52:27.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:52:27 smithi086 bash[24289]: cluster 2024-09-16T05:52:26.222511+0000 mgr.a (mgr.14373) 668 : cluster [DBG] pgmap v463: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T05:52:27.835 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:52:27 smithi047 bash[22744]: cluster 2024-09-16T05:52:26.222511+0000 mgr.a (mgr.14373) 668 : cluster [DBG] pgmap v463: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T05:52:28.327 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T05:52:28.327 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T05:52:28.327 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T05:52:28.328 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T05:52:28.328 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T05:52:29.801 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:52:29 smithi157 bash[24585]: audit 2024-09-16T05:52:27.907125+0000 mgr.a (mgr.14373) 669 : audit [DBG] from='client.27924 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:52:29.801 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:52:29 smithi157 bash[24585]: cluster 2024-09-16T05:52:28.232772+0000 mgr.a (mgr.14373) 670 : cluster [DBG] pgmap v464: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:52:29.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:52:29 smithi086 bash[24289]: audit 2024-09-16T05:52:27.907125+0000 mgr.a (mgr.14373) 669 : audit [DBG] from='client.27924 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:52:29.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:52:29 smithi086 bash[24289]: cluster 2024-09-16T05:52:28.232772+0000 mgr.a (mgr.14373) 670 : cluster [DBG] pgmap v464: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:52:29.835 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:52:29 smithi047 bash[22744]: audit 2024-09-16T05:52:27.907125+0000 mgr.a (mgr.14373) 669 : audit [DBG] from='client.27924 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:52:29.836 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:52:29 smithi047 bash[22744]: cluster 2024-09-16T05:52:28.232772+0000 mgr.a (mgr.14373) 670 : cluster [DBG] pgmap v464: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:52:31.801 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:52:31 smithi157 bash[24585]: cluster 2024-09-16T05:52:30.233613+0000 mgr.a (mgr.14373) 671 : cluster [DBG] pgmap v465: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:52:31.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:52:31 smithi086 bash[24289]: cluster 2024-09-16T05:52:30.233613+0000 mgr.a (mgr.14373) 671 : cluster [DBG] pgmap v465: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:52:31.835 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:52:31 smithi047 bash[22744]: cluster 2024-09-16T05:52:30.233613+0000 mgr.a (mgr.14373) 671 : cluster [DBG] pgmap v465: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:52:33.329 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T05:52:33.329 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T05:52:33.330 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T05:52:33.801 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:52:33 smithi157 bash[24585]: cluster 2024-09-16T05:52:32.235794+0000 mgr.a (mgr.14373) 672 : cluster [DBG] pgmap v466: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:52:33.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:52:33 smithi086 bash[24289]: cluster 2024-09-16T05:52:32.235794+0000 mgr.a (mgr.14373) 672 : cluster [DBG] pgmap v466: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:52:33.835 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:52:33 smithi047 bash[22744]: cluster 2024-09-16T05:52:32.235794+0000 mgr.a (mgr.14373) 672 : cluster [DBG] pgmap v466: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:52:34.071 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T05:52:34.071 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T05:52:34.072 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T05:52:34.072 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T05:52:34.072 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T05:52:35.801 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:52:35 smithi157 bash[24585]: audit 2024-09-16T05:52:33.666431+0000 mgr.a (mgr.14373) 673 : audit [DBG] from='client.28002 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:52:35.801 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:52:35 smithi157 bash[24585]: cluster 2024-09-16T05:52:34.236776+0000 mgr.a (mgr.14373) 674 : cluster [DBG] pgmap v467: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:52:35.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:52:35 smithi086 bash[24289]: audit 2024-09-16T05:52:33.666431+0000 mgr.a (mgr.14373) 673 : audit [DBG] from='client.28002 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:52:35.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:52:35 smithi086 bash[24289]: cluster 2024-09-16T05:52:34.236776+0000 mgr.a (mgr.14373) 674 : cluster [DBG] pgmap v467: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:52:35.835 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:52:35 smithi047 bash[22744]: audit 2024-09-16T05:52:33.666431+0000 mgr.a (mgr.14373) 673 : audit [DBG] from='client.28002 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:52:35.835 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:52:35 smithi047 bash[22744]: cluster 2024-09-16T05:52:34.236776+0000 mgr.a (mgr.14373) 674 : cluster [DBG] pgmap v467: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:52:37.801 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:52:37 smithi157 bash[24585]: cluster 2024-09-16T05:52:36.237624+0000 mgr.a (mgr.14373) 675 : cluster [DBG] pgmap v468: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:52:37.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:52:37 smithi086 bash[24289]: cluster 2024-09-16T05:52:36.237624+0000 mgr.a (mgr.14373) 675 : cluster [DBG] pgmap v468: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:52:37.835 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:52:37 smithi047 bash[22744]: cluster 2024-09-16T05:52:36.237624+0000 mgr.a (mgr.14373) 675 : cluster [DBG] pgmap v468: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:52:39.072 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T05:52:39.073 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T05:52:39.073 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T05:52:39.800 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:52:39 smithi157 bash[24585]: cluster 2024-09-16T05:52:38.239850+0000 mgr.a (mgr.14373) 676 : cluster [DBG] pgmap v469: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:52:39.801 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:52:39 smithi157 bash[24585]: audit 2024-09-16T05:52:38.411797+0000 mon.b (mon.2) 110 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T05:52:39.801 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:52:39 smithi157 bash[24585]: audit 2024-09-16T05:52:39.046720+0000 mon.a (mon.0) 607 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T05:52:39.801 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:52:39 smithi157 bash[24585]: audit 2024-09-16T05:52:39.053974+0000 mon.a (mon.0) 608 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T05:52:39.805 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T05:52:39.805 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T05:52:39.806 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T05:52:39.806 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T05:52:39.806 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T05:52:39.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:52:39 smithi086 bash[24289]: cluster 2024-09-16T05:52:38.239850+0000 mgr.a (mgr.14373) 676 : cluster [DBG] pgmap v469: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:52:39.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:52:39 smithi086 bash[24289]: audit 2024-09-16T05:52:38.411797+0000 mon.b (mon.2) 110 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T05:52:39.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:52:39 smithi086 bash[24289]: audit 2024-09-16T05:52:39.046720+0000 mon.a (mon.0) 607 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T05:52:39.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:52:39 smithi086 bash[24289]: audit 2024-09-16T05:52:39.053974+0000 mon.a (mon.0) 608 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T05:52:39.835 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:52:39 smithi047 bash[22744]: cluster 2024-09-16T05:52:38.239850+0000 mgr.a (mgr.14373) 676 : cluster [DBG] pgmap v469: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:52:39.836 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:52:39 smithi047 bash[22744]: audit 2024-09-16T05:52:38.411797+0000 mon.b (mon.2) 110 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T05:52:39.836 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:52:39 smithi047 bash[22744]: audit 2024-09-16T05:52:39.046720+0000 mon.a (mon.0) 607 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T05:52:39.836 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:52:39 smithi047 bash[22744]: audit 2024-09-16T05:52:39.053974+0000 mon.a (mon.0) 608 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T05:52:40.801 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:52:40 smithi157 bash[24585]: audit 2024-09-16T05:52:39.393077+0000 mgr.a (mgr.14373) 677 : audit [DBG] from='client.28080 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:52:40.801 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:52:40 smithi157 bash[24585]: audit 2024-09-16T05:52:39.827909+0000 mon.b (mon.2) 111 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T05:52:40.801 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:52:40 smithi157 bash[24585]: audit 2024-09-16T05:52:39.829543+0000 mon.b (mon.2) 112 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T05:52:40.801 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:52:40 smithi157 bash[24585]: audit 2024-09-16T05:52:39.841119+0000 mon.b (mon.2) 113 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T05:52:40.801 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:52:40 smithi157 bash[24585]: audit 2024-09-16T05:52:39.842173+0000 mon.a (mon.0) 609 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T05:52:40.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:52:40 smithi086 bash[24289]: audit 2024-09-16T05:52:39.393077+0000 mgr.a (mgr.14373) 677 : audit [DBG] from='client.28080 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:52:40.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:52:40 smithi086 bash[24289]: audit 2024-09-16T05:52:39.827909+0000 mon.b (mon.2) 111 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T05:52:40.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:52:40 smithi086 bash[24289]: audit 2024-09-16T05:52:39.829543+0000 mon.b (mon.2) 112 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T05:52:40.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:52:40 smithi086 bash[24289]: audit 2024-09-16T05:52:39.841119+0000 mon.b (mon.2) 113 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T05:52:40.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:52:40 smithi086 bash[24289]: audit 2024-09-16T05:52:39.842173+0000 mon.a (mon.0) 609 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T05:52:40.835 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 05:52:40 smithi047 bash[22994]: debug 2024-09-16T05:52:40.510+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T05:52:40.836 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 05:52:40 smithi047 bash[22994]: debug 2024-09-16T05:52:40.514+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T05:52:40.836 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:52:40 smithi047 bash[22744]: audit 2024-09-16T05:52:39.393077+0000 mgr.a (mgr.14373) 677 : audit [DBG] from='client.28080 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:52:40.836 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:52:40 smithi047 bash[22744]: audit 2024-09-16T05:52:39.827909+0000 mon.b (mon.2) 111 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T05:52:40.836 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:52:40 smithi047 bash[22744]: audit 2024-09-16T05:52:39.829543+0000 mon.b (mon.2) 112 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T05:52:40.836 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:52:40 smithi047 bash[22744]: audit 2024-09-16T05:52:39.841119+0000 mon.b (mon.2) 113 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T05:52:40.836 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:52:40 smithi047 bash[22744]: audit 2024-09-16T05:52:39.842173+0000 mon.a (mon.0) 609 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T05:52:41.801 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:52:41 smithi157 bash[24585]: audit 2024-09-16T05:52:39.849495+0000 mgr.a (mgr.14373) 678 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T05:52:41.801 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:52:41 smithi157 bash[24585]: cluster 2024-09-16T05:52:40.240384+0000 mgr.a (mgr.14373) 679 : cluster [DBG] pgmap v470: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:52:41.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:52:41 smithi086 bash[24289]: audit 2024-09-16T05:52:39.849495+0000 mgr.a (mgr.14373) 678 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T05:52:41.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:52:41 smithi086 bash[24289]: cluster 2024-09-16T05:52:40.240384+0000 mgr.a (mgr.14373) 679 : cluster [DBG] pgmap v470: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:52:41.835 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:52:41 smithi047 bash[22744]: audit 2024-09-16T05:52:39.849495+0000 mgr.a (mgr.14373) 678 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T05:52:41.836 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:52:41 smithi047 bash[22744]: cluster 2024-09-16T05:52:40.240384+0000 mgr.a (mgr.14373) 679 : cluster [DBG] pgmap v470: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:52:42.800 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:52:42 smithi157 bash[24585]: audit 2024-09-16T05:52:40.518009+0000 mgr.a (mgr.14373) 680 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T05:52:42.801 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:52:42 smithi157 bash[24585]: cephadm 2024-09-16T05:52:40.519986+0000 mgr.a (mgr.14373) 681 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T05:52:42.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:52:42 smithi086 bash[24289]: audit 2024-09-16T05:52:40.518009+0000 mgr.a (mgr.14373) 680 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T05:52:42.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:52:42 smithi086 bash[24289]: cephadm 2024-09-16T05:52:40.519986+0000 mgr.a (mgr.14373) 681 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T05:52:42.836 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:52:42 smithi047 bash[22744]: audit 2024-09-16T05:52:40.518009+0000 mgr.a (mgr.14373) 680 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T05:52:42.836 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:52:42 smithi047 bash[22744]: cephadm 2024-09-16T05:52:40.519986+0000 mgr.a (mgr.14373) 681 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T05:52:43.801 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:52:43 smithi157 bash[24585]: cluster 2024-09-16T05:52:42.242635+0000 mgr.a (mgr.14373) 682 : cluster [DBG] pgmap v471: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T05:52:43.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:52:43 smithi086 bash[24289]: cluster 2024-09-16T05:52:42.242635+0000 mgr.a (mgr.14373) 682 : cluster [DBG] pgmap v471: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T05:52:43.835 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:52:43 smithi047 bash[22744]: cluster 2024-09-16T05:52:42.242635+0000 mgr.a (mgr.14373) 682 : cluster [DBG] pgmap v471: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T05:52:44.807 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T05:52:44.807 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T05:52:44.807 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T05:52:45.567 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T05:52:45.568 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T05:52:45.568 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T05:52:45.568 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T05:52:45.568 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T05:52:45.800 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:52:45 smithi157 bash[24585]: cluster 2024-09-16T05:52:44.243371+0000 mgr.a (mgr.14373) 683 : cluster [DBG] pgmap v472: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T05:52:45.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:52:45 smithi086 bash[24289]: cluster 2024-09-16T05:52:44.243371+0000 mgr.a (mgr.14373) 683 : cluster [DBG] pgmap v472: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T05:52:45.835 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:52:45 smithi047 bash[22744]: cluster 2024-09-16T05:52:44.243371+0000 mgr.a (mgr.14373) 683 : cluster [DBG] pgmap v472: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T05:52:46.801 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:52:46 smithi157 bash[24585]: audit 2024-09-16T05:52:45.149163+0000 mgr.a (mgr.14373) 684 : audit [DBG] from='client.28263 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:52:46.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:52:46 smithi086 bash[24289]: audit 2024-09-16T05:52:45.149163+0000 mgr.a (mgr.14373) 684 : audit [DBG] from='client.28263 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:52:46.835 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:52:46 smithi047 bash[22744]: audit 2024-09-16T05:52:45.149163+0000 mgr.a (mgr.14373) 684 : audit [DBG] from='client.28263 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:52:47.800 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:52:47 smithi157 bash[24585]: cluster 2024-09-16T05:52:46.244356+0000 mgr.a (mgr.14373) 685 : cluster [DBG] pgmap v473: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T05:52:47.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:52:47 smithi086 bash[24289]: cluster 2024-09-16T05:52:46.244356+0000 mgr.a (mgr.14373) 685 : cluster [DBG] pgmap v473: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T05:52:47.835 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:52:47 smithi047 bash[22744]: cluster 2024-09-16T05:52:46.244356+0000 mgr.a (mgr.14373) 685 : cluster [DBG] pgmap v473: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T05:52:49.800 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:52:49 smithi157 bash[24585]: cluster 2024-09-16T05:52:48.246625+0000 mgr.a (mgr.14373) 686 : cluster [DBG] pgmap v474: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T05:52:49.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:52:49 smithi086 bash[24289]: cluster 2024-09-16T05:52:48.246625+0000 mgr.a (mgr.14373) 686 : cluster [DBG] pgmap v474: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T05:52:49.836 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:52:49 smithi047 bash[22744]: cluster 2024-09-16T05:52:48.246625+0000 mgr.a (mgr.14373) 686 : cluster [DBG] pgmap v474: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T05:52:50.569 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T05:52:50.570 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T05:52:50.570 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T05:52:51.353 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T05:52:51.353 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T05:52:51.354 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T05:52:51.354 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T05:52:51.354 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T05:52:51.800 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:52:51 smithi157 bash[24585]: cluster 2024-09-16T05:52:50.247398+0000 mgr.a (mgr.14373) 687 : cluster [DBG] pgmap v475: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T05:52:51.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:52:51 smithi086 bash[24289]: cluster 2024-09-16T05:52:50.247398+0000 mgr.a (mgr.14373) 687 : cluster [DBG] pgmap v475: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T05:52:51.835 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:52:51 smithi047 bash[22744]: cluster 2024-09-16T05:52:50.247398+0000 mgr.a (mgr.14373) 687 : cluster [DBG] pgmap v475: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T05:52:52.800 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:52:52 smithi157 bash[24585]: audit 2024-09-16T05:52:50.915897+0000 mgr.a (mgr.14373) 688 : audit [DBG] from='client.28341 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:52:52.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:52:52 smithi086 bash[24289]: audit 2024-09-16T05:52:50.915897+0000 mgr.a (mgr.14373) 688 : audit [DBG] from='client.28341 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:52:52.835 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:52:52 smithi047 bash[22744]: audit 2024-09-16T05:52:50.915897+0000 mgr.a (mgr.14373) 688 : audit [DBG] from='client.28341 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:52:53.800 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:52:53 smithi157 bash[24585]: cluster 2024-09-16T05:52:52.249869+0000 mgr.a (mgr.14373) 689 : cluster [DBG] pgmap v476: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T05:52:53.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:52:53 smithi086 bash[24289]: cluster 2024-09-16T05:52:52.249869+0000 mgr.a (mgr.14373) 689 : cluster [DBG] pgmap v476: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T05:52:53.836 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:52:53 smithi047 bash[22744]: cluster 2024-09-16T05:52:52.249869+0000 mgr.a (mgr.14373) 689 : cluster [DBG] pgmap v476: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T05:52:55.801 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:52:55 smithi157 bash[24585]: cluster 2024-09-16T05:52:54.250856+0000 mgr.a (mgr.14373) 690 : cluster [DBG] pgmap v477: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T05:52:55.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:52:55 smithi086 bash[24289]: cluster 2024-09-16T05:52:54.250856+0000 mgr.a (mgr.14373) 690 : cluster [DBG] pgmap v477: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T05:52:55.836 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:52:55 smithi047 bash[22744]: cluster 2024-09-16T05:52:54.250856+0000 mgr.a (mgr.14373) 690 : cluster [DBG] pgmap v477: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T05:52:56.355 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T05:52:56.356 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T05:52:56.357 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T05:52:57.097 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T05:52:57.097 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T05:52:57.097 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T05:52:57.097 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T05:52:57.097 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T05:52:57.800 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:52:57 smithi157 bash[24585]: cluster 2024-09-16T05:52:56.251683+0000 mgr.a (mgr.14373) 691 : cluster [DBG] pgmap v478: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T05:52:57.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:52:57 smithi086 bash[24289]: cluster 2024-09-16T05:52:56.251683+0000 mgr.a (mgr.14373) 691 : cluster [DBG] pgmap v478: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T05:52:57.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:52:57 smithi047 bash[22744]: cluster 2024-09-16T05:52:56.251683+0000 mgr.a (mgr.14373) 691 : cluster [DBG] pgmap v478: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T05:52:58.801 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:52:58 smithi157 bash[24585]: audit 2024-09-16T05:52:56.680207+0000 mgr.a (mgr.14373) 692 : audit [DBG] from='client.28416 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:52:58.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:52:58 smithi086 bash[24289]: audit 2024-09-16T05:52:56.680207+0000 mgr.a (mgr.14373) 692 : audit [DBG] from='client.28416 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:52:58.836 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:52:58 smithi047 bash[22744]: audit 2024-09-16T05:52:56.680207+0000 mgr.a (mgr.14373) 692 : audit [DBG] from='client.28416 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:52:59.800 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:52:59 smithi157 bash[24585]: cluster 2024-09-16T05:52:58.254466+0000 mgr.a (mgr.14373) 693 : cluster [DBG] pgmap v479: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:52:59.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:52:59 smithi086 bash[24289]: cluster 2024-09-16T05:52:58.254466+0000 mgr.a (mgr.14373) 693 : cluster [DBG] pgmap v479: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:52:59.835 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:52:59 smithi047 bash[22744]: cluster 2024-09-16T05:52:58.254466+0000 mgr.a (mgr.14373) 693 : cluster [DBG] pgmap v479: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:53:01.800 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:53:01 smithi157 bash[24585]: cluster 2024-09-16T05:53:00.255429+0000 mgr.a (mgr.14373) 694 : cluster [DBG] pgmap v480: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T05:53:01.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:53:01 smithi086 bash[24289]: cluster 2024-09-16T05:53:00.255429+0000 mgr.a (mgr.14373) 694 : cluster [DBG] pgmap v480: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T05:53:01.835 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:53:01 smithi047 bash[22744]: cluster 2024-09-16T05:53:00.255429+0000 mgr.a (mgr.14373) 694 : cluster [DBG] pgmap v480: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T05:53:02.098 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T05:53:02.100 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T05:53:02.100 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T05:53:02.868 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T05:53:02.868 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T05:53:02.868 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T05:53:02.868 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T05:53:02.868 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T05:53:03.801 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:53:03 smithi157 bash[24585]: cluster 2024-09-16T05:53:02.257400+0000 mgr.a (mgr.14373) 695 : cluster [DBG] pgmap v481: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:53:03.801 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:53:03 smithi157 bash[24585]: audit 2024-09-16T05:53:02.439200+0000 mgr.a (mgr.14373) 696 : audit [DBG] from='client.28494 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:53:03.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:53:03 smithi086 bash[24289]: cluster 2024-09-16T05:53:02.257400+0000 mgr.a (mgr.14373) 695 : cluster [DBG] pgmap v481: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:53:03.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:53:03 smithi086 bash[24289]: audit 2024-09-16T05:53:02.439200+0000 mgr.a (mgr.14373) 696 : audit [DBG] from='client.28494 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:53:03.835 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:53:03 smithi047 bash[22744]: cluster 2024-09-16T05:53:02.257400+0000 mgr.a (mgr.14373) 695 : cluster [DBG] pgmap v481: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:53:03.835 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:53:03 smithi047 bash[22744]: audit 2024-09-16T05:53:02.439200+0000 mgr.a (mgr.14373) 696 : audit [DBG] from='client.28494 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:53:05.800 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:53:05 smithi157 bash[24585]: cluster 2024-09-16T05:53:04.258364+0000 mgr.a (mgr.14373) 697 : cluster [DBG] pgmap v482: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-16T05:53:05.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:53:05 smithi086 bash[24289]: cluster 2024-09-16T05:53:04.258364+0000 mgr.a (mgr.14373) 697 : cluster [DBG] pgmap v482: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-16T05:53:05.835 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:53:05 smithi047 bash[22744]: cluster 2024-09-16T05:53:04.258364+0000 mgr.a (mgr.14373) 697 : cluster [DBG] pgmap v482: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-16T05:53:07.800 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:53:07 smithi157 bash[24585]: cluster 2024-09-16T05:53:06.259150+0000 mgr.a (mgr.14373) 698 : cluster [DBG] pgmap v483: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-16T05:53:07.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:53:07 smithi086 bash[24289]: cluster 2024-09-16T05:53:06.259150+0000 mgr.a (mgr.14373) 698 : cluster [DBG] pgmap v483: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-16T05:53:07.835 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:53:07 smithi047 bash[22744]: cluster 2024-09-16T05:53:06.259150+0000 mgr.a (mgr.14373) 698 : cluster [DBG] pgmap v483: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-16T05:53:07.869 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T05:53:07.870 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T05:53:07.870 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T05:53:08.644 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T05:53:08.644 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T05:53:08.645 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T05:53:08.645 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T05:53:08.645 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T05:53:09.801 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:53:09 smithi157 bash[24585]: audit 2024-09-16T05:53:08.208171+0000 mgr.a (mgr.14373) 699 : audit [DBG] from='client.28569 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:53:09.801 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:53:09 smithi157 bash[24585]: cluster 2024-09-16T05:53:08.262111+0000 mgr.a (mgr.14373) 700 : cluster [DBG] pgmap v484: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-16T05:53:09.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:53:09 smithi086 bash[24289]: audit 2024-09-16T05:53:08.208171+0000 mgr.a (mgr.14373) 699 : audit [DBG] from='client.28569 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:53:09.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:53:09 smithi086 bash[24289]: cluster 2024-09-16T05:53:08.262111+0000 mgr.a (mgr.14373) 700 : cluster [DBG] pgmap v484: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-16T05:53:09.835 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:53:09 smithi047 bash[22744]: audit 2024-09-16T05:53:08.208171+0000 mgr.a (mgr.14373) 699 : audit [DBG] from='client.28569 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:53:09.835 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:53:09 smithi047 bash[22744]: cluster 2024-09-16T05:53:08.262111+0000 mgr.a (mgr.14373) 700 : cluster [DBG] pgmap v484: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-16T05:53:11.801 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:53:11 smithi157 bash[24585]: cluster 2024-09-16T05:53:10.263067+0000 mgr.a (mgr.14373) 701 : cluster [DBG] pgmap v485: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:53:11.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:53:11 smithi086 bash[24289]: cluster 2024-09-16T05:53:10.263067+0000 mgr.a (mgr.14373) 701 : cluster [DBG] pgmap v485: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:53:11.836 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:53:11 smithi047 bash[22744]: cluster 2024-09-16T05:53:10.263067+0000 mgr.a (mgr.14373) 701 : cluster [DBG] pgmap v485: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:53:12.800 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:53:12 smithi157 bash[24585]: cluster 2024-09-16T05:53:12.265310+0000 mgr.a (mgr.14373) 702 : cluster [DBG] pgmap v486: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:53:12.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:53:12 smithi086 bash[24289]: cluster 2024-09-16T05:53:12.265310+0000 mgr.a (mgr.14373) 702 : cluster [DBG] pgmap v486: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:53:12.835 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:53:12 smithi047 bash[22744]: cluster 2024-09-16T05:53:12.265310+0000 mgr.a (mgr.14373) 702 : cluster [DBG] pgmap v486: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:53:13.645 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T05:53:13.648 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T05:53:13.648 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T05:53:14.434 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T05:53:14.434 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T05:53:14.434 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T05:53:14.434 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T05:53:14.435 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T05:53:15.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:53:15 smithi086 bash[24289]: audit 2024-09-16T05:53:13.992846+0000 mgr.a (mgr.14373) 703 : audit [DBG] from='client.28647 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:53:15.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:53:15 smithi086 bash[24289]: cluster 2024-09-16T05:53:14.265984+0000 mgr.a (mgr.14373) 704 : cluster [DBG] pgmap v487: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:53:15.585 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:53:15 smithi047 bash[22744]: audit 2024-09-16T05:53:13.992846+0000 mgr.a (mgr.14373) 703 : audit [DBG] from='client.28647 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:53:15.585 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:53:15 smithi047 bash[22744]: cluster 2024-09-16T05:53:14.265984+0000 mgr.a (mgr.14373) 704 : cluster [DBG] pgmap v487: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:53:15.801 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:53:15 smithi157 bash[24585]: audit 2024-09-16T05:53:13.992846+0000 mgr.a (mgr.14373) 703 : audit [DBG] from='client.28647 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:53:15.801 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:53:15 smithi157 bash[24585]: cluster 2024-09-16T05:53:14.265984+0000 mgr.a (mgr.14373) 704 : cluster [DBG] pgmap v487: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:53:17.586 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:53:17 smithi047 bash[22744]: cluster 2024-09-16T05:53:16.266878+0000 mgr.a (mgr.14373) 705 : cluster [DBG] pgmap v488: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:53:17.801 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:53:17 smithi157 bash[24585]: cluster 2024-09-16T05:53:16.266878+0000 mgr.a (mgr.14373) 705 : cluster [DBG] pgmap v488: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:53:17.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:53:17 smithi086 bash[24289]: cluster 2024-09-16T05:53:16.266878+0000 mgr.a (mgr.14373) 705 : cluster [DBG] pgmap v488: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:53:19.436 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T05:53:19.436 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T05:53:19.436 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T05:53:19.586 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:53:19 smithi047 bash[22744]: cluster 2024-09-16T05:53:18.269086+0000 mgr.a (mgr.14373) 706 : cluster [DBG] pgmap v489: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:53:19.801 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:53:19 smithi157 bash[24585]: cluster 2024-09-16T05:53:18.269086+0000 mgr.a (mgr.14373) 706 : cluster [DBG] pgmap v489: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:53:19.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:53:19 smithi086 bash[24289]: cluster 2024-09-16T05:53:18.269086+0000 mgr.a (mgr.14373) 706 : cluster [DBG] pgmap v489: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:53:20.177 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T05:53:20.177 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T05:53:20.177 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T05:53:20.177 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T05:53:20.178 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T05:53:21.586 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:53:21 smithi047 bash[22744]: audit 2024-09-16T05:53:19.766956+0000 mgr.a (mgr.14373) 707 : audit [DBG] from='client.28722 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:53:21.586 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:53:21 smithi047 bash[22744]: cluster 2024-09-16T05:53:20.270012+0000 mgr.a (mgr.14373) 708 : cluster [DBG] pgmap v490: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:53:21.801 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:53:21 smithi157 bash[24585]: audit 2024-09-16T05:53:19.766956+0000 mgr.a (mgr.14373) 707 : audit [DBG] from='client.28722 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:53:21.801 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:53:21 smithi157 bash[24585]: cluster 2024-09-16T05:53:20.270012+0000 mgr.a (mgr.14373) 708 : cluster [DBG] pgmap v490: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:53:21.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:53:21 smithi086 bash[24289]: audit 2024-09-16T05:53:19.766956+0000 mgr.a (mgr.14373) 707 : audit [DBG] from='client.28722 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:53:21.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:53:21 smithi086 bash[24289]: cluster 2024-09-16T05:53:20.270012+0000 mgr.a (mgr.14373) 708 : cluster [DBG] pgmap v490: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:53:23.586 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:53:23 smithi047 bash[22744]: cluster 2024-09-16T05:53:22.272246+0000 mgr.a (mgr.14373) 709 : cluster [DBG] pgmap v491: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:53:23.801 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:53:23 smithi157 bash[24585]: cluster 2024-09-16T05:53:22.272246+0000 mgr.a (mgr.14373) 709 : cluster [DBG] pgmap v491: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:53:23.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:53:23 smithi086 bash[24289]: cluster 2024-09-16T05:53:22.272246+0000 mgr.a (mgr.14373) 709 : cluster [DBG] pgmap v491: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:53:25.179 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T05:53:25.180 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T05:53:25.180 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T05:53:25.801 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:53:25 smithi157 bash[24585]: cluster 2024-09-16T05:53:24.273010+0000 mgr.a (mgr.14373) 710 : cluster [DBG] pgmap v492: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:53:25.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:53:25 smithi086 bash[24289]: cluster 2024-09-16T05:53:24.273010+0000 mgr.a (mgr.14373) 710 : cluster [DBG] pgmap v492: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:53:25.835 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:53:25 smithi047 bash[22744]: cluster 2024-09-16T05:53:24.273010+0000 mgr.a (mgr.14373) 710 : cluster [DBG] pgmap v492: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:53:25.925 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T05:53:25.925 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T05:53:25.925 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T05:53:25.925 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T05:53:25.925 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T05:53:27.801 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:53:27 smithi157 bash[24585]: audit 2024-09-16T05:53:25.514234+0000 mgr.a (mgr.14373) 711 : audit [DBG] from='client.28800 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:53:27.801 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:53:27 smithi157 bash[24585]: cluster 2024-09-16T05:53:26.273992+0000 mgr.a (mgr.14373) 712 : cluster [DBG] pgmap v493: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:53:27.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:53:27 smithi086 bash[24289]: audit 2024-09-16T05:53:25.514234+0000 mgr.a (mgr.14373) 711 : audit [DBG] from='client.28800 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:53:27.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:53:27 smithi086 bash[24289]: cluster 2024-09-16T05:53:26.273992+0000 mgr.a (mgr.14373) 712 : cluster [DBG] pgmap v493: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:53:27.835 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:53:27 smithi047 bash[22744]: audit 2024-09-16T05:53:25.514234+0000 mgr.a (mgr.14373) 711 : audit [DBG] from='client.28800 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:53:27.836 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:53:27 smithi047 bash[22744]: cluster 2024-09-16T05:53:26.273992+0000 mgr.a (mgr.14373) 712 : cluster [DBG] pgmap v493: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:53:29.738 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:53:29 smithi157 bash[24585]: cluster 2024-09-16T05:53:28.276242+0000 mgr.a (mgr.14373) 713 : cluster [DBG] pgmap v494: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:53:29.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:53:29 smithi086 bash[24289]: cluster 2024-09-16T05:53:28.276242+0000 mgr.a (mgr.14373) 713 : cluster [DBG] pgmap v494: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:53:29.835 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:53:29 smithi047 bash[22744]: cluster 2024-09-16T05:53:28.276242+0000 mgr.a (mgr.14373) 713 : cluster [DBG] pgmap v494: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:53:30.926 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T05:53:30.927 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T05:53:30.927 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T05:53:31.694 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T05:53:31.695 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T05:53:31.695 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T05:53:31.695 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T05:53:31.695 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T05:53:31.801 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:53:31 smithi157 bash[24585]: cluster 2024-09-16T05:53:30.276995+0000 mgr.a (mgr.14373) 714 : cluster [DBG] pgmap v495: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:53:31.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:53:31 smithi086 bash[24289]: cluster 2024-09-16T05:53:30.276995+0000 mgr.a (mgr.14373) 714 : cluster [DBG] pgmap v495: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:53:31.835 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:53:31 smithi047 bash[22744]: cluster 2024-09-16T05:53:30.276995+0000 mgr.a (mgr.14373) 714 : cluster [DBG] pgmap v495: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:53:32.801 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:53:32 smithi157 bash[24585]: audit 2024-09-16T05:53:31.265294+0000 mgr.a (mgr.14373) 715 : audit [DBG] from='client.28878 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:53:32.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:53:32 smithi086 bash[24289]: audit 2024-09-16T05:53:31.265294+0000 mgr.a (mgr.14373) 715 : audit [DBG] from='client.28878 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:53:32.835 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:53:32 smithi047 bash[22744]: audit 2024-09-16T05:53:31.265294+0000 mgr.a (mgr.14373) 715 : audit [DBG] from='client.28878 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:53:33.801 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:53:33 smithi157 bash[24585]: cluster 2024-09-16T05:53:32.279870+0000 mgr.a (mgr.14373) 716 : cluster [DBG] pgmap v496: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:53:33.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:53:33 smithi086 bash[24289]: cluster 2024-09-16T05:53:32.279870+0000 mgr.a (mgr.14373) 716 : cluster [DBG] pgmap v496: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:53:33.835 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:53:33 smithi047 bash[22744]: cluster 2024-09-16T05:53:32.279870+0000 mgr.a (mgr.14373) 716 : cluster [DBG] pgmap v496: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:53:35.801 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:53:35 smithi157 bash[24585]: cluster 2024-09-16T05:53:34.280786+0000 mgr.a (mgr.14373) 717 : cluster [DBG] pgmap v497: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T05:53:35.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:53:35 smithi086 bash[24289]: cluster 2024-09-16T05:53:34.280786+0000 mgr.a (mgr.14373) 717 : cluster [DBG] pgmap v497: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T05:53:35.835 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:53:35 smithi047 bash[22744]: cluster 2024-09-16T05:53:34.280786+0000 mgr.a (mgr.14373) 717 : cluster [DBG] pgmap v497: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T05:53:36.696 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T05:53:36.697 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T05:53:36.697 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T05:53:37.468 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T05:53:37.468 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T05:53:37.468 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T05:53:37.469 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T05:53:37.469 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T05:53:37.801 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:53:37 smithi157 bash[24585]: cluster 2024-09-16T05:53:36.281700+0000 mgr.a (mgr.14373) 718 : cluster [DBG] pgmap v498: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T05:53:37.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:53:37 smithi086 bash[24289]: cluster 2024-09-16T05:53:36.281700+0000 mgr.a (mgr.14373) 718 : cluster [DBG] pgmap v498: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T05:53:37.835 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:53:37 smithi047 bash[22744]: cluster 2024-09-16T05:53:36.281700+0000 mgr.a (mgr.14373) 718 : cluster [DBG] pgmap v498: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T05:53:38.801 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:53:38 smithi157 bash[24585]: audit 2024-09-16T05:53:37.037134+0000 mgr.a (mgr.14373) 719 : audit [DBG] from='client.28953 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:53:38.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:53:38 smithi086 bash[24289]: audit 2024-09-16T05:53:37.037134+0000 mgr.a (mgr.14373) 719 : audit [DBG] from='client.28953 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:53:38.835 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:53:38 smithi047 bash[22744]: audit 2024-09-16T05:53:37.037134+0000 mgr.a (mgr.14373) 719 : audit [DBG] from='client.28953 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:53:39.801 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:53:39 smithi157 bash[24585]: cluster 2024-09-16T05:53:38.284512+0000 mgr.a (mgr.14373) 720 : cluster [DBG] pgmap v499: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:53:39.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:53:39 smithi086 bash[24289]: cluster 2024-09-16T05:53:38.284512+0000 mgr.a (mgr.14373) 720 : cluster [DBG] pgmap v499: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:53:39.835 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:53:39 smithi047 bash[22744]: cluster 2024-09-16T05:53:38.284512+0000 mgr.a (mgr.14373) 720 : cluster [DBG] pgmap v499: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:53:41.801 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:53:41 smithi157 bash[24585]: cluster 2024-09-16T05:53:40.285476+0000 mgr.a (mgr.14373) 721 : cluster [DBG] pgmap v500: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T05:53:41.801 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:53:41 smithi157 bash[24585]: audit 2024-09-16T05:53:40.571150+0000 mon.b (mon.2) 114 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T05:53:41.801 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:53:41 smithi157 bash[24585]: audit 2024-09-16T05:53:41.219293+0000 mon.a (mon.0) 610 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T05:53:41.801 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:53:41 smithi157 bash[24585]: audit 2024-09-16T05:53:41.225053+0000 mon.a (mon.0) 611 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T05:53:41.801 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:53:41 smithi157 bash[24585]: audit 2024-09-16T05:53:41.232183+0000 mon.a (mon.0) 612 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T05:53:41.801 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:53:41 smithi157 bash[24585]: audit 2024-09-16T05:53:41.242086+0000 mon.a (mon.0) 613 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T05:53:41.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:53:41 smithi086 bash[24289]: cluster 2024-09-16T05:53:40.285476+0000 mgr.a (mgr.14373) 721 : cluster [DBG] pgmap v500: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T05:53:41.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:53:41 smithi086 bash[24289]: audit 2024-09-16T05:53:40.571150+0000 mon.b (mon.2) 114 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T05:53:41.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:53:41 smithi086 bash[24289]: audit 2024-09-16T05:53:41.219293+0000 mon.a (mon.0) 610 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T05:53:41.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:53:41 smithi086 bash[24289]: audit 2024-09-16T05:53:41.225053+0000 mon.a (mon.0) 611 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T05:53:41.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:53:41 smithi086 bash[24289]: audit 2024-09-16T05:53:41.232183+0000 mon.a (mon.0) 612 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T05:53:41.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:53:41 smithi086 bash[24289]: audit 2024-09-16T05:53:41.242086+0000 mon.a (mon.0) 613 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T05:53:41.836 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:53:41 smithi047 bash[22744]: cluster 2024-09-16T05:53:40.285476+0000 mgr.a (mgr.14373) 721 : cluster [DBG] pgmap v500: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T05:53:41.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:53:41 smithi047 bash[22744]: audit 2024-09-16T05:53:40.571150+0000 mon.b (mon.2) 114 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T05:53:41.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:53:41 smithi047 bash[22744]: audit 2024-09-16T05:53:41.219293+0000 mon.a (mon.0) 610 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T05:53:41.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:53:41 smithi047 bash[22744]: audit 2024-09-16T05:53:41.225053+0000 mon.a (mon.0) 611 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T05:53:41.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:53:41 smithi047 bash[22744]: audit 2024-09-16T05:53:41.232183+0000 mon.a (mon.0) 612 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T05:53:41.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:53:41 smithi047 bash[22744]: audit 2024-09-16T05:53:41.242086+0000 mon.a (mon.0) 613 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T05:53:42.469 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T05:53:42.469 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T05:53:42.469 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T05:53:42.790 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:53:42 smithi047 bash[22744]: audit 2024-09-16T05:53:42.044026+0000 mon.b (mon.2) 115 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T05:53:42.790 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:53:42 smithi047 bash[22744]: audit 2024-09-16T05:53:42.046210+0000 mon.b (mon.2) 116 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T05:53:42.791 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:53:42 smithi047 bash[22744]: audit 2024-09-16T05:53:42.060037+0000 mon.b (mon.2) 117 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T05:53:42.791 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:53:42 smithi047 bash[22744]: audit 2024-09-16T05:53:42.062556+0000 mon.a (mon.0) 614 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T05:53:42.801 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:53:42 smithi157 bash[24585]: audit 2024-09-16T05:53:42.044026+0000 mon.b (mon.2) 115 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T05:53:42.801 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:53:42 smithi157 bash[24585]: audit 2024-09-16T05:53:42.046210+0000 mon.b (mon.2) 116 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T05:53:42.801 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:53:42 smithi157 bash[24585]: audit 2024-09-16T05:53:42.060037+0000 mon.b (mon.2) 117 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T05:53:42.801 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:53:42 smithi157 bash[24585]: audit 2024-09-16T05:53:42.062556+0000 mon.a (mon.0) 614 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T05:53:42.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:53:42 smithi086 bash[24289]: audit 2024-09-16T05:53:42.044026+0000 mon.b (mon.2) 115 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T05:53:42.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:53:42 smithi086 bash[24289]: audit 2024-09-16T05:53:42.046210+0000 mon.b (mon.2) 116 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T05:53:42.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:53:42 smithi086 bash[24289]: audit 2024-09-16T05:53:42.060037+0000 mon.b (mon.2) 117 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T05:53:42.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:53:42 smithi086 bash[24289]: audit 2024-09-16T05:53:42.062556+0000 mon.a (mon.0) 614 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T05:53:43.085 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 05:53:42 smithi047 bash[22994]: debug 2024-09-16T05:53:42.793+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T05:53:43.085 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 05:53:42 smithi047 bash[22994]: debug 2024-09-16T05:53:42.793+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T05:53:43.191 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T05:53:43.192 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T05:53:43.192 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T05:53:43.192 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T05:53:43.192 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T05:53:43.801 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:53:43 smithi157 bash[24585]: audit 2024-09-16T05:53:42.068302+0000 mgr.a (mgr.14373) 722 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T05:53:43.801 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:53:43 smithi157 bash[24585]: cluster 2024-09-16T05:53:42.293032+0000 mgr.a (mgr.14373) 723 : cluster [DBG] pgmap v501: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:53:43.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:53:43 smithi086 bash[24289]: audit 2024-09-16T05:53:42.068302+0000 mgr.a (mgr.14373) 722 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T05:53:43.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:53:43 smithi086 bash[24289]: cluster 2024-09-16T05:53:42.293032+0000 mgr.a (mgr.14373) 723 : cluster [DBG] pgmap v501: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:53:43.835 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:53:43 smithi047 bash[22744]: audit 2024-09-16T05:53:42.068302+0000 mgr.a (mgr.14373) 722 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T05:53:43.836 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:53:43 smithi047 bash[22744]: cluster 2024-09-16T05:53:42.293032+0000 mgr.a (mgr.14373) 723 : cluster [DBG] pgmap v501: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:53:44.801 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:53:44 smithi157 bash[24585]: audit 2024-09-16T05:53:42.796062+0000 mgr.a (mgr.14373) 724 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T05:53:44.801 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:53:44 smithi157 bash[24585]: cephadm 2024-09-16T05:53:42.797723+0000 mgr.a (mgr.14373) 725 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T05:53:44.801 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:53:44 smithi157 bash[24585]: audit 2024-09-16T05:53:42.802040+0000 mgr.a (mgr.14373) 726 : audit [DBG] from='client.29103 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:53:44.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:53:44 smithi086 bash[24289]: audit 2024-09-16T05:53:42.796062+0000 mgr.a (mgr.14373) 724 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T05:53:44.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:53:44 smithi086 bash[24289]: cephadm 2024-09-16T05:53:42.797723+0000 mgr.a (mgr.14373) 725 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T05:53:44.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:53:44 smithi086 bash[24289]: audit 2024-09-16T05:53:42.802040+0000 mgr.a (mgr.14373) 726 : audit [DBG] from='client.29103 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:53:44.835 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:53:44 smithi047 bash[22744]: audit 2024-09-16T05:53:42.796062+0000 mgr.a (mgr.14373) 724 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T05:53:44.836 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:53:44 smithi047 bash[22744]: cephadm 2024-09-16T05:53:42.797723+0000 mgr.a (mgr.14373) 725 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T05:53:44.836 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:53:44 smithi047 bash[22744]: audit 2024-09-16T05:53:42.802040+0000 mgr.a (mgr.14373) 726 : audit [DBG] from='client.29103 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:53:45.801 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:53:45 smithi157 bash[24585]: cluster 2024-09-16T05:53:44.293903+0000 mgr.a (mgr.14373) 727 : cluster [DBG] pgmap v502: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:53:45.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:53:45 smithi086 bash[24289]: cluster 2024-09-16T05:53:44.293903+0000 mgr.a (mgr.14373) 727 : cluster [DBG] pgmap v502: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:53:45.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:53:45 smithi047 bash[22744]: cluster 2024-09-16T05:53:44.293903+0000 mgr.a (mgr.14373) 727 : cluster [DBG] pgmap v502: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:53:47.801 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:53:47 smithi157 bash[24585]: cluster 2024-09-16T05:53:46.294738+0000 mgr.a (mgr.14373) 728 : cluster [DBG] pgmap v503: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:53:47.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:53:47 smithi086 bash[24289]: cluster 2024-09-16T05:53:46.294738+0000 mgr.a (mgr.14373) 728 : cluster [DBG] pgmap v503: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:53:47.835 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:53:47 smithi047 bash[22744]: cluster 2024-09-16T05:53:46.294738+0000 mgr.a (mgr.14373) 728 : cluster [DBG] pgmap v503: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:53:48.193 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T05:53:48.194 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T05:53:48.194 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T05:53:48.952 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T05:53:48.952 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T05:53:48.952 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T05:53:48.952 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T05:53:48.952 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T05:53:49.801 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:53:49 smithi157 bash[24585]: cluster 2024-09-16T05:53:48.296642+0000 mgr.a (mgr.14373) 729 : cluster [DBG] pgmap v504: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T05:53:49.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:53:49 smithi086 bash[24289]: cluster 2024-09-16T05:53:48.296642+0000 mgr.a (mgr.14373) 729 : cluster [DBG] pgmap v504: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T05:53:49.835 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:53:49 smithi047 bash[22744]: cluster 2024-09-16T05:53:48.296642+0000 mgr.a (mgr.14373) 729 : cluster [DBG] pgmap v504: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T05:53:50.801 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:53:50 smithi157 bash[24585]: audit 2024-09-16T05:53:48.535000+0000 mgr.a (mgr.14373) 730 : audit [DBG] from='client.29208 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:53:50.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:53:50 smithi086 bash[24289]: audit 2024-09-16T05:53:48.535000+0000 mgr.a (mgr.14373) 730 : audit [DBG] from='client.29208 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:53:50.835 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:53:50 smithi047 bash[22744]: audit 2024-09-16T05:53:48.535000+0000 mgr.a (mgr.14373) 730 : audit [DBG] from='client.29208 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:53:51.801 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:53:51 smithi157 bash[24585]: cluster 2024-09-16T05:53:50.297533+0000 mgr.a (mgr.14373) 731 : cluster [DBG] pgmap v505: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T05:53:51.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:53:51 smithi086 bash[24289]: cluster 2024-09-16T05:53:50.297533+0000 mgr.a (mgr.14373) 731 : cluster [DBG] pgmap v505: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T05:53:51.835 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:53:51 smithi047 bash[22744]: cluster 2024-09-16T05:53:50.297533+0000 mgr.a (mgr.14373) 731 : cluster [DBG] pgmap v505: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T05:53:53.801 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:53:53 smithi157 bash[24585]: cluster 2024-09-16T05:53:52.299782+0000 mgr.a (mgr.14373) 732 : cluster [DBG] pgmap v506: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T05:53:53.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:53:53 smithi086 bash[24289]: cluster 2024-09-16T05:53:52.299782+0000 mgr.a (mgr.14373) 732 : cluster [DBG] pgmap v506: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T05:53:53.835 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:53:53 smithi047 bash[22744]: cluster 2024-09-16T05:53:52.299782+0000 mgr.a (mgr.14373) 732 : cluster [DBG] pgmap v506: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T05:53:53.953 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T05:53:53.954 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T05:53:53.954 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T05:53:54.714 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T05:53:54.715 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T05:53:54.715 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T05:53:54.715 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T05:53:54.715 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T05:53:55.801 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:53:55 smithi157 bash[24585]: audit 2024-09-16T05:53:54.291599+0000 mgr.a (mgr.14373) 733 : audit [DBG] from='client.29280 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:53:55.801 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:53:55 smithi157 bash[24585]: cluster 2024-09-16T05:53:54.306550+0000 mgr.a (mgr.14373) 734 : cluster [DBG] pgmap v507: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T05:53:55.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:53:55 smithi086 bash[24289]: audit 2024-09-16T05:53:54.291599+0000 mgr.a (mgr.14373) 733 : audit [DBG] from='client.29280 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:53:55.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:53:55 smithi086 bash[24289]: cluster 2024-09-16T05:53:54.306550+0000 mgr.a (mgr.14373) 734 : cluster [DBG] pgmap v507: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T05:53:55.835 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:53:55 smithi047 bash[22744]: audit 2024-09-16T05:53:54.291599+0000 mgr.a (mgr.14373) 733 : audit [DBG] from='client.29280 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:53:55.836 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:53:55 smithi047 bash[22744]: cluster 2024-09-16T05:53:54.306550+0000 mgr.a (mgr.14373) 734 : cluster [DBG] pgmap v507: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T05:53:57.801 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:53:57 smithi157 bash[24585]: cluster 2024-09-16T05:53:56.307486+0000 mgr.a (mgr.14373) 735 : cluster [DBG] pgmap v508: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T05:53:57.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:53:57 smithi086 bash[24289]: cluster 2024-09-16T05:53:56.307486+0000 mgr.a (mgr.14373) 735 : cluster [DBG] pgmap v508: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T05:53:57.835 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:53:57 smithi047 bash[22744]: cluster 2024-09-16T05:53:56.307486+0000 mgr.a (mgr.14373) 735 : cluster [DBG] pgmap v508: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T05:53:59.716 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T05:53:59.717 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T05:53:59.717 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T05:53:59.801 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:53:59 smithi157 bash[24585]: cluster 2024-09-16T05:53:58.309710+0000 mgr.a (mgr.14373) 736 : cluster [DBG] pgmap v509: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T05:53:59.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:53:59 smithi086 bash[24289]: cluster 2024-09-16T05:53:58.309710+0000 mgr.a (mgr.14373) 736 : cluster [DBG] pgmap v509: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T05:53:59.835 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:53:59 smithi047 bash[22744]: cluster 2024-09-16T05:53:58.309710+0000 mgr.a (mgr.14373) 736 : cluster [DBG] pgmap v509: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T05:54:00.494 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T05:54:00.494 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T05:54:00.494 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T05:54:00.494 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T05:54:00.495 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T05:54:01.801 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:54:01 smithi157 bash[24585]: audit 2024-09-16T05:54:00.056959+0000 mgr.a (mgr.14373) 737 : audit [DBG] from='client.29352 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:54:01.801 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:54:01 smithi157 bash[24585]: cluster 2024-09-16T05:54:00.310264+0000 mgr.a (mgr.14373) 738 : cluster [DBG] pgmap v510: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:54:01.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:54:01 smithi086 bash[24289]: audit 2024-09-16T05:54:00.056959+0000 mgr.a (mgr.14373) 737 : audit [DBG] from='client.29352 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:54:01.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:54:01 smithi086 bash[24289]: cluster 2024-09-16T05:54:00.310264+0000 mgr.a (mgr.14373) 738 : cluster [DBG] pgmap v510: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:54:01.835 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:54:01 smithi047 bash[22744]: audit 2024-09-16T05:54:00.056959+0000 mgr.a (mgr.14373) 737 : audit [DBG] from='client.29352 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:54:01.836 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:54:01 smithi047 bash[22744]: cluster 2024-09-16T05:54:00.310264+0000 mgr.a (mgr.14373) 738 : cluster [DBG] pgmap v510: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:54:03.801 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:54:03 smithi157 bash[24585]: cluster 2024-09-16T05:54:02.312536+0000 mgr.a (mgr.14373) 739 : cluster [DBG] pgmap v511: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:54:03.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:54:03 smithi086 bash[24289]: cluster 2024-09-16T05:54:02.312536+0000 mgr.a (mgr.14373) 739 : cluster [DBG] pgmap v511: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:54:03.835 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:54:03 smithi047 bash[22744]: cluster 2024-09-16T05:54:02.312536+0000 mgr.a (mgr.14373) 739 : cluster [DBG] pgmap v511: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:54:05.496 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T05:54:05.497 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T05:54:05.497 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T05:54:05.801 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:54:05 smithi157 bash[24585]: cluster 2024-09-16T05:54:04.313309+0000 mgr.a (mgr.14373) 740 : cluster [DBG] pgmap v512: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:54:05.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:54:05 smithi086 bash[24289]: cluster 2024-09-16T05:54:04.313309+0000 mgr.a (mgr.14373) 740 : cluster [DBG] pgmap v512: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:54:05.835 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:54:05 smithi047 bash[22744]: cluster 2024-09-16T05:54:04.313309+0000 mgr.a (mgr.14373) 740 : cluster [DBG] pgmap v512: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:54:06.246 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T05:54:06.246 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T05:54:06.247 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T05:54:06.247 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T05:54:06.247 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T05:54:07.801 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:54:07 smithi157 bash[24585]: audit 2024-09-16T05:54:05.836759+0000 mgr.a (mgr.14373) 741 : audit [DBG] from='client.29430 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:54:07.801 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:54:07 smithi157 bash[24585]: cluster 2024-09-16T05:54:06.314097+0000 mgr.a (mgr.14373) 742 : cluster [DBG] pgmap v513: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:54:07.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:54:07 smithi086 bash[24289]: audit 2024-09-16T05:54:05.836759+0000 mgr.a (mgr.14373) 741 : audit [DBG] from='client.29430 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:54:07.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:54:07 smithi086 bash[24289]: cluster 2024-09-16T05:54:06.314097+0000 mgr.a (mgr.14373) 742 : cluster [DBG] pgmap v513: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:54:07.836 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:54:07 smithi047 bash[22744]: audit 2024-09-16T05:54:05.836759+0000 mgr.a (mgr.14373) 741 : audit [DBG] from='client.29430 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:54:07.836 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:54:07 smithi047 bash[22744]: cluster 2024-09-16T05:54:06.314097+0000 mgr.a (mgr.14373) 742 : cluster [DBG] pgmap v513: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:54:09.801 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:54:09 smithi157 bash[24585]: cluster 2024-09-16T05:54:08.316327+0000 mgr.a (mgr.14373) 743 : cluster [DBG] pgmap v514: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:54:09.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:54:09 smithi086 bash[24289]: cluster 2024-09-16T05:54:08.316327+0000 mgr.a (mgr.14373) 743 : cluster [DBG] pgmap v514: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:54:09.836 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:54:09 smithi047 bash[22744]: cluster 2024-09-16T05:54:08.316327+0000 mgr.a (mgr.14373) 743 : cluster [DBG] pgmap v514: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:54:11.247 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T05:54:11.248 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T05:54:11.248 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T05:54:11.801 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:54:11 smithi157 bash[24585]: cluster 2024-09-16T05:54:10.317078+0000 mgr.a (mgr.14373) 744 : cluster [DBG] pgmap v515: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:54:11.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:54:11 smithi086 bash[24289]: cluster 2024-09-16T05:54:10.317078+0000 mgr.a (mgr.14373) 744 : cluster [DBG] pgmap v515: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:54:11.835 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:54:11 smithi047 bash[22744]: cluster 2024-09-16T05:54:10.317078+0000 mgr.a (mgr.14373) 744 : cluster [DBG] pgmap v515: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:54:12.020 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T05:54:12.020 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T05:54:12.020 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T05:54:12.020 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T05:54:12.020 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T05:54:13.801 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:54:13 smithi157 bash[24585]: audit 2024-09-16T05:54:11.593671+0000 mgr.a (mgr.14373) 745 : audit [DBG] from='client.29508 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:54:13.801 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:54:13 smithi157 bash[24585]: cluster 2024-09-16T05:54:12.319705+0000 mgr.a (mgr.14373) 746 : cluster [DBG] pgmap v516: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:54:13.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:54:13 smithi086 bash[24289]: audit 2024-09-16T05:54:11.593671+0000 mgr.a (mgr.14373) 745 : audit [DBG] from='client.29508 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:54:13.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:54:13 smithi086 bash[24289]: cluster 2024-09-16T05:54:12.319705+0000 mgr.a (mgr.14373) 746 : cluster [DBG] pgmap v516: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:54:13.836 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:54:13 smithi047 bash[22744]: audit 2024-09-16T05:54:11.593671+0000 mgr.a (mgr.14373) 745 : audit [DBG] from='client.29508 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:54:13.836 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:54:13 smithi047 bash[22744]: cluster 2024-09-16T05:54:12.319705+0000 mgr.a (mgr.14373) 746 : cluster [DBG] pgmap v516: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:54:15.801 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:54:15 smithi157 bash[24585]: cluster 2024-09-16T05:54:14.320483+0000 mgr.a (mgr.14373) 747 : cluster [DBG] pgmap v517: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T05:54:15.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:54:15 smithi086 bash[24289]: cluster 2024-09-16T05:54:14.320483+0000 mgr.a (mgr.14373) 747 : cluster [DBG] pgmap v517: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T05:54:15.836 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:54:15 smithi047 bash[22744]: cluster 2024-09-16T05:54:14.320483+0000 mgr.a (mgr.14373) 747 : cluster [DBG] pgmap v517: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T05:54:17.021 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T05:54:17.021 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T05:54:17.022 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T05:54:17.787 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T05:54:17.787 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T05:54:17.787 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T05:54:17.787 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T05:54:17.787 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T05:54:17.801 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:54:17 smithi157 bash[24585]: cluster 2024-09-16T05:54:16.321249+0000 mgr.a (mgr.14373) 748 : cluster [DBG] pgmap v518: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T05:54:17.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:54:17 smithi086 bash[24289]: cluster 2024-09-16T05:54:16.321249+0000 mgr.a (mgr.14373) 748 : cluster [DBG] pgmap v518: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T05:54:17.835 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:54:17 smithi047 bash[22744]: cluster 2024-09-16T05:54:16.321249+0000 mgr.a (mgr.14373) 748 : cluster [DBG] pgmap v518: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T05:54:18.801 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:54:18 smithi157 bash[24585]: audit 2024-09-16T05:54:17.356750+0000 mgr.a (mgr.14373) 749 : audit [DBG] from='client.29586 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:54:18.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:54:18 smithi086 bash[24289]: audit 2024-09-16T05:54:17.356750+0000 mgr.a (mgr.14373) 749 : audit [DBG] from='client.29586 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:54:18.836 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:54:18 smithi047 bash[22744]: audit 2024-09-16T05:54:17.356750+0000 mgr.a (mgr.14373) 749 : audit [DBG] from='client.29586 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:54:19.801 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:54:19 smithi157 bash[24585]: cluster 2024-09-16T05:54:18.323901+0000 mgr.a (mgr.14373) 750 : cluster [DBG] pgmap v519: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:54:19.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:54:19 smithi086 bash[24289]: cluster 2024-09-16T05:54:18.323901+0000 mgr.a (mgr.14373) 750 : cluster [DBG] pgmap v519: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:54:19.836 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:54:19 smithi047 bash[22744]: cluster 2024-09-16T05:54:18.323901+0000 mgr.a (mgr.14373) 750 : cluster [DBG] pgmap v519: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:54:21.801 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:54:21 smithi157 bash[24585]: cluster 2024-09-16T05:54:20.324729+0000 mgr.a (mgr.14373) 751 : cluster [DBG] pgmap v520: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T05:54:21.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:54:21 smithi086 bash[24289]: cluster 2024-09-16T05:54:20.324729+0000 mgr.a (mgr.14373) 751 : cluster [DBG] pgmap v520: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T05:54:21.836 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:54:21 smithi047 bash[22744]: cluster 2024-09-16T05:54:20.324729+0000 mgr.a (mgr.14373) 751 : cluster [DBG] pgmap v520: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T05:54:22.788 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T05:54:22.789 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T05:54:22.789 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T05:54:23.570 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T05:54:23.570 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T05:54:23.570 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T05:54:23.570 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T05:54:23.570 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T05:54:23.801 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:54:23 smithi157 bash[24585]: cluster 2024-09-16T05:54:22.326927+0000 mgr.a (mgr.14373) 752 : cluster [DBG] pgmap v521: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:54:23.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:54:23 smithi086 bash[24289]: cluster 2024-09-16T05:54:22.326927+0000 mgr.a (mgr.14373) 752 : cluster [DBG] pgmap v521: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:54:23.836 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:54:23 smithi047 bash[22744]: cluster 2024-09-16T05:54:22.326927+0000 mgr.a (mgr.14373) 752 : cluster [DBG] pgmap v521: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:54:24.801 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:54:24 smithi157 bash[24585]: audit 2024-09-16T05:54:23.135271+0000 mgr.a (mgr.14373) 753 : audit [DBG] from='client.29664 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:54:24.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:54:24 smithi086 bash[24289]: audit 2024-09-16T05:54:23.135271+0000 mgr.a (mgr.14373) 753 : audit [DBG] from='client.29664 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:54:24.836 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:54:24 smithi047 bash[22744]: audit 2024-09-16T05:54:23.135271+0000 mgr.a (mgr.14373) 753 : audit [DBG] from='client.29664 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:54:25.801 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:54:25 smithi157 bash[24585]: cluster 2024-09-16T05:54:24.327941+0000 mgr.a (mgr.14373) 754 : cluster [DBG] pgmap v522: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:54:25.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:54:25 smithi086 bash[24289]: cluster 2024-09-16T05:54:24.327941+0000 mgr.a (mgr.14373) 754 : cluster [DBG] pgmap v522: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:54:25.836 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:54:25 smithi047 bash[22744]: cluster 2024-09-16T05:54:24.327941+0000 mgr.a (mgr.14373) 754 : cluster [DBG] pgmap v522: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:54:26.801 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:54:26 smithi157 bash[24585]: cluster 2024-09-16T05:54:26.328736+0000 mgr.a (mgr.14373) 755 : cluster [DBG] pgmap v523: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:54:26.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:54:26 smithi086 bash[24289]: cluster 2024-09-16T05:54:26.328736+0000 mgr.a (mgr.14373) 755 : cluster [DBG] pgmap v523: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:54:26.836 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:54:26 smithi047 bash[22744]: cluster 2024-09-16T05:54:26.328736+0000 mgr.a (mgr.14373) 755 : cluster [DBG] pgmap v523: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:54:28.571 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T05:54:28.572 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T05:54:28.572 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T05:54:29.319 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T05:54:29.319 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T05:54:29.319 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T05:54:29.319 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T05:54:29.320 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T05:54:29.801 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:54:29 smithi157 bash[24585]: cluster 2024-09-16T05:54:28.330918+0000 mgr.a (mgr.14373) 756 : cluster [DBG] pgmap v524: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:54:29.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:54:29 smithi086 bash[24289]: cluster 2024-09-16T05:54:28.330918+0000 mgr.a (mgr.14373) 756 : cluster [DBG] pgmap v524: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:54:29.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:54:29 smithi047 bash[22744]: cluster 2024-09-16T05:54:28.330918+0000 mgr.a (mgr.14373) 756 : cluster [DBG] pgmap v524: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:54:30.801 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:54:30 smithi157 bash[24585]: audit 2024-09-16T05:54:28.907243+0000 mgr.a (mgr.14373) 757 : audit [DBG] from='client.29739 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:54:30.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:54:30 smithi086 bash[24289]: audit 2024-09-16T05:54:28.907243+0000 mgr.a (mgr.14373) 757 : audit [DBG] from='client.29739 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:54:30.836 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:54:30 smithi047 bash[22744]: audit 2024-09-16T05:54:28.907243+0000 mgr.a (mgr.14373) 757 : audit [DBG] from='client.29739 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:54:31.801 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:54:31 smithi157 bash[24585]: cluster 2024-09-16T05:54:30.331905+0000 mgr.a (mgr.14373) 758 : cluster [DBG] pgmap v525: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:54:31.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:54:31 smithi086 bash[24289]: cluster 2024-09-16T05:54:30.331905+0000 mgr.a (mgr.14373) 758 : cluster [DBG] pgmap v525: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:54:31.836 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:54:31 smithi047 bash[22744]: cluster 2024-09-16T05:54:30.331905+0000 mgr.a (mgr.14373) 758 : cluster [DBG] pgmap v525: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:54:33.801 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:54:33 smithi157 bash[24585]: cluster 2024-09-16T05:54:32.334169+0000 mgr.a (mgr.14373) 759 : cluster [DBG] pgmap v526: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:54:33.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:54:33 smithi086 bash[24289]: cluster 2024-09-16T05:54:32.334169+0000 mgr.a (mgr.14373) 759 : cluster [DBG] pgmap v526: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:54:33.836 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:54:33 smithi047 bash[22744]: cluster 2024-09-16T05:54:32.334169+0000 mgr.a (mgr.14373) 759 : cluster [DBG] pgmap v526: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:54:34.320 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T05:54:34.321 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T05:54:34.321 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T05:54:35.088 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T05:54:35.088 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T05:54:35.088 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T05:54:35.088 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T05:54:35.088 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T05:54:35.801 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:54:35 smithi157 bash[24585]: cluster 2024-09-16T05:54:34.334756+0000 mgr.a (mgr.14373) 760 : cluster [DBG] pgmap v527: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:54:35.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:54:35 smithi086 bash[24289]: cluster 2024-09-16T05:54:34.334756+0000 mgr.a (mgr.14373) 760 : cluster [DBG] pgmap v527: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:54:35.836 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:54:35 smithi047 bash[22744]: cluster 2024-09-16T05:54:34.334756+0000 mgr.a (mgr.14373) 760 : cluster [DBG] pgmap v527: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:54:36.801 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:54:36 smithi157 bash[24585]: audit 2024-09-16T05:54:34.664558+0000 mgr.a (mgr.14373) 761 : audit [DBG] from='client.29814 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:54:36.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:54:36 smithi086 bash[24289]: audit 2024-09-16T05:54:34.664558+0000 mgr.a (mgr.14373) 761 : audit [DBG] from='client.29814 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:54:36.836 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:54:36 smithi047 bash[22744]: audit 2024-09-16T05:54:34.664558+0000 mgr.a (mgr.14373) 761 : audit [DBG] from='client.29814 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:54:37.801 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:54:37 smithi157 bash[24585]: cluster 2024-09-16T05:54:36.336247+0000 mgr.a (mgr.14373) 762 : cluster [DBG] pgmap v528: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-16T05:54:37.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:54:37 smithi086 bash[24289]: cluster 2024-09-16T05:54:36.336247+0000 mgr.a (mgr.14373) 762 : cluster [DBG] pgmap v528: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-16T05:54:37.836 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:54:37 smithi047 bash[22744]: cluster 2024-09-16T05:54:36.336247+0000 mgr.a (mgr.14373) 762 : cluster [DBG] pgmap v528: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-16T05:54:39.801 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:54:39 smithi157 bash[24585]: cluster 2024-09-16T05:54:38.337922+0000 mgr.a (mgr.14373) 763 : cluster [DBG] pgmap v529: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:54:39.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:54:39 smithi086 bash[24289]: cluster 2024-09-16T05:54:38.337922+0000 mgr.a (mgr.14373) 763 : cluster [DBG] pgmap v529: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:54:39.836 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:54:39 smithi047 bash[22744]: cluster 2024-09-16T05:54:38.337922+0000 mgr.a (mgr.14373) 763 : cluster [DBG] pgmap v529: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:54:40.089 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T05:54:40.090 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T05:54:40.090 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T05:54:40.831 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T05:54:40.832 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T05:54:40.832 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T05:54:40.832 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T05:54:40.832 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T05:54:41.801 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:54:41 smithi157 bash[24585]: cluster 2024-09-16T05:54:40.338443+0000 mgr.a (mgr.14373) 764 : cluster [DBG] pgmap v530: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:54:41.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:54:41 smithi157 bash[24585]: audit 2024-09-16T05:54:40.425994+0000 mgr.a (mgr.14373) 765 : audit [DBG] from='client.29889 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:54:41.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:54:41 smithi086 bash[24289]: cluster 2024-09-16T05:54:40.338443+0000 mgr.a (mgr.14373) 764 : cluster [DBG] pgmap v530: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:54:41.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:54:41 smithi086 bash[24289]: audit 2024-09-16T05:54:40.425994+0000 mgr.a (mgr.14373) 765 : audit [DBG] from='client.29889 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:54:41.836 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:54:41 smithi047 bash[22744]: cluster 2024-09-16T05:54:40.338443+0000 mgr.a (mgr.14373) 764 : cluster [DBG] pgmap v530: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:54:41.836 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:54:41 smithi047 bash[22744]: audit 2024-09-16T05:54:40.425994+0000 mgr.a (mgr.14373) 765 : audit [DBG] from='client.29889 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:54:43.801 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:54:43 smithi157 bash[24585]: cluster 2024-09-16T05:54:42.340785+0000 mgr.a (mgr.14373) 766 : cluster [DBG] pgmap v531: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:54:43.801 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:54:43 smithi157 bash[24585]: audit 2024-09-16T05:54:42.853384+0000 mon.b (mon.2) 118 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T05:54:43.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:54:43 smithi086 bash[24289]: cluster 2024-09-16T05:54:42.340785+0000 mgr.a (mgr.14373) 766 : cluster [DBG] pgmap v531: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:54:43.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:54:43 smithi086 bash[24289]: audit 2024-09-16T05:54:42.853384+0000 mon.b (mon.2) 118 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T05:54:43.836 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:54:43 smithi047 bash[22744]: cluster 2024-09-16T05:54:42.340785+0000 mgr.a (mgr.14373) 766 : cluster [DBG] pgmap v531: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:54:43.836 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:54:43 smithi047 bash[22744]: audit 2024-09-16T05:54:42.853384+0000 mon.b (mon.2) 118 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T05:54:44.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:54:44 smithi157 bash[24585]: audit 2024-09-16T05:54:43.700527+0000 mon.b (mon.2) 119 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T05:54:44.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:54:44 smithi157 bash[24585]: audit 2024-09-16T05:54:43.702728+0000 mon.b (mon.2) 120 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T05:54:44.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:54:44 smithi157 bash[24585]: audit 2024-09-16T05:54:43.720053+0000 mon.a (mon.0) 615 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T05:54:44.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:54:44 smithi157 bash[24585]: audit 2024-09-16T05:54:43.720141+0000 mon.b (mon.2) 121 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T05:54:44.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:54:44 smithi086 bash[24289]: audit 2024-09-16T05:54:43.700527+0000 mon.b (mon.2) 119 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T05:54:44.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:54:44 smithi086 bash[24289]: audit 2024-09-16T05:54:43.702728+0000 mon.b (mon.2) 120 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T05:54:44.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:54:44 smithi086 bash[24289]: audit 2024-09-16T05:54:43.720053+0000 mon.a (mon.0) 615 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T05:54:44.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:54:44 smithi086 bash[24289]: audit 2024-09-16T05:54:43.720141+0000 mon.b (mon.2) 121 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T05:54:44.836 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 05:54:44 smithi047 bash[22994]: debug 2024-09-16T05:54:44.435+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T05:54:44.836 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 05:54:44 smithi047 bash[22994]: debug 2024-09-16T05:54:44.439+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T05:54:44.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:54:44 smithi047 bash[22744]: audit 2024-09-16T05:54:43.700527+0000 mon.b (mon.2) 119 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T05:54:44.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:54:44 smithi047 bash[22744]: audit 2024-09-16T05:54:43.702728+0000 mon.b (mon.2) 120 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T05:54:44.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:54:44 smithi047 bash[22744]: audit 2024-09-16T05:54:43.720053+0000 mon.a (mon.0) 615 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T05:54:44.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:54:44 smithi047 bash[22744]: audit 2024-09-16T05:54:43.720141+0000 mon.b (mon.2) 121 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T05:54:45.801 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:54:45 smithi157 bash[24585]: audit 2024-09-16T05:54:43.727860+0000 mgr.a (mgr.14373) 767 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T05:54:45.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:54:45 smithi157 bash[24585]: cluster 2024-09-16T05:54:44.341248+0000 mgr.a (mgr.14373) 768 : cluster [DBG] pgmap v532: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:54:45.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:54:45 smithi157 bash[24585]: audit 2024-09-16T05:54:44.442013+0000 mgr.a (mgr.14373) 769 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T05:54:45.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:54:45 smithi157 bash[24585]: cephadm 2024-09-16T05:54:44.443566+0000 mgr.a (mgr.14373) 770 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T05:54:45.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:54:45 smithi086 bash[24289]: audit 2024-09-16T05:54:43.727860+0000 mgr.a (mgr.14373) 767 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T05:54:45.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:54:45 smithi086 bash[24289]: cluster 2024-09-16T05:54:44.341248+0000 mgr.a (mgr.14373) 768 : cluster [DBG] pgmap v532: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:54:45.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:54:45 smithi086 bash[24289]: audit 2024-09-16T05:54:44.442013+0000 mgr.a (mgr.14373) 769 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T05:54:45.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:54:45 smithi086 bash[24289]: cephadm 2024-09-16T05:54:44.443566+0000 mgr.a (mgr.14373) 770 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T05:54:45.833 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T05:54:45.834 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T05:54:45.834 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T05:54:45.836 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:54:45 smithi047 bash[22744]: audit 2024-09-16T05:54:43.727860+0000 mgr.a (mgr.14373) 767 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T05:54:45.836 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:54:45 smithi047 bash[22744]: cluster 2024-09-16T05:54:44.341248+0000 mgr.a (mgr.14373) 768 : cluster [DBG] pgmap v532: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:54:45.836 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:54:45 smithi047 bash[22744]: audit 2024-09-16T05:54:44.442013+0000 mgr.a (mgr.14373) 769 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T05:54:45.836 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:54:45 smithi047 bash[22744]: cephadm 2024-09-16T05:54:44.443566+0000 mgr.a (mgr.14373) 770 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T05:54:46.562 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T05:54:46.562 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T05:54:46.562 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T05:54:46.562 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T05:54:46.562 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T05:54:47.801 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:54:47 smithi157 bash[24585]: audit 2024-09-16T05:54:46.170231+0000 mgr.a (mgr.14373) 771 : audit [DBG] from='client.30075 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:54:47.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:54:47 smithi157 bash[24585]: cluster 2024-09-16T05:54:46.341985+0000 mgr.a (mgr.14373) 772 : cluster [DBG] pgmap v533: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 3.2 KiB/s rd, 85 B/s wr, 3 op/s 2024-09-16T05:54:47.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:54:47 smithi086 bash[24289]: audit 2024-09-16T05:54:46.170231+0000 mgr.a (mgr.14373) 771 : audit [DBG] from='client.30075 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:54:47.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:54:47 smithi086 bash[24289]: cluster 2024-09-16T05:54:46.341985+0000 mgr.a (mgr.14373) 772 : cluster [DBG] pgmap v533: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 3.2 KiB/s rd, 85 B/s wr, 3 op/s 2024-09-16T05:54:47.836 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:54:47 smithi047 bash[22744]: audit 2024-09-16T05:54:46.170231+0000 mgr.a (mgr.14373) 771 : audit [DBG] from='client.30075 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:54:47.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:54:47 smithi047 bash[22744]: cluster 2024-09-16T05:54:46.341985+0000 mgr.a (mgr.14373) 772 : cluster [DBG] pgmap v533: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 3.2 KiB/s rd, 85 B/s wr, 3 op/s 2024-09-16T05:54:49.801 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:54:49 smithi157 bash[24585]: cluster 2024-09-16T05:54:48.344146+0000 mgr.a (mgr.14373) 773 : cluster [DBG] pgmap v534: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.9 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T05:54:49.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:54:49 smithi086 bash[24289]: cluster 2024-09-16T05:54:48.344146+0000 mgr.a (mgr.14373) 773 : cluster [DBG] pgmap v534: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.9 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T05:54:49.836 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:54:49 smithi047 bash[22744]: cluster 2024-09-16T05:54:48.344146+0000 mgr.a (mgr.14373) 773 : cluster [DBG] pgmap v534: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.9 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T05:54:51.563 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T05:54:51.564 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T05:54:51.564 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T05:54:51.801 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:54:51 smithi157 bash[24585]: cluster 2024-09-16T05:54:50.344926+0000 mgr.a (mgr.14373) 774 : cluster [DBG] pgmap v535: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T05:54:51.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:54:51 smithi086 bash[24289]: cluster 2024-09-16T05:54:50.344926+0000 mgr.a (mgr.14373) 774 : cluster [DBG] pgmap v535: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T05:54:51.836 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:54:51 smithi047 bash[22744]: cluster 2024-09-16T05:54:50.344926+0000 mgr.a (mgr.14373) 774 : cluster [DBG] pgmap v535: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T05:54:52.312 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T05:54:52.313 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T05:54:52.313 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T05:54:52.313 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T05:54:52.313 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T05:54:53.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:54:53 smithi157 bash[24585]: audit 2024-09-16T05:54:51.896923+0000 mgr.a (mgr.14373) 775 : audit [DBG] from='client.30153 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:54:53.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:54:53 smithi157 bash[24585]: cluster 2024-09-16T05:54:52.346176+0000 mgr.a (mgr.14373) 776 : cluster [DBG] pgmap v536: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T05:54:53.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:54:53 smithi086 bash[24289]: audit 2024-09-16T05:54:51.896923+0000 mgr.a (mgr.14373) 775 : audit [DBG] from='client.30153 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:54:53.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:54:53 smithi086 bash[24289]: cluster 2024-09-16T05:54:52.346176+0000 mgr.a (mgr.14373) 776 : cluster [DBG] pgmap v536: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T05:54:53.836 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:54:53 smithi047 bash[22744]: audit 2024-09-16T05:54:51.896923+0000 mgr.a (mgr.14373) 775 : audit [DBG] from='client.30153 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:54:53.836 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:54:53 smithi047 bash[22744]: cluster 2024-09-16T05:54:52.346176+0000 mgr.a (mgr.14373) 776 : cluster [DBG] pgmap v536: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T05:54:55.801 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:54:55 smithi157 bash[24585]: cluster 2024-09-16T05:54:54.346938+0000 mgr.a (mgr.14373) 777 : cluster [DBG] pgmap v537: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T05:54:55.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:54:55 smithi086 bash[24289]: cluster 2024-09-16T05:54:54.346938+0000 mgr.a (mgr.14373) 777 : cluster [DBG] pgmap v537: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T05:54:55.836 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:54:55 smithi047 bash[22744]: cluster 2024-09-16T05:54:54.346938+0000 mgr.a (mgr.14373) 777 : cluster [DBG] pgmap v537: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T05:54:57.312 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T05:54:57.313 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T05:54:57.313 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T05:54:57.801 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:54:57 smithi157 bash[24585]: cluster 2024-09-16T05:54:56.348129+0000 mgr.a (mgr.14373) 778 : cluster [DBG] pgmap v538: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.2 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T05:54:57.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:54:57 smithi086 bash[24289]: cluster 2024-09-16T05:54:56.348129+0000 mgr.a (mgr.14373) 778 : cluster [DBG] pgmap v538: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.2 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T05:54:57.836 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:54:57 smithi047 bash[22744]: cluster 2024-09-16T05:54:56.348129+0000 mgr.a (mgr.14373) 778 : cluster [DBG] pgmap v538: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.2 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T05:54:58.055 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T05:54:58.056 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T05:54:58.056 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T05:54:58.056 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T05:54:58.056 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T05:54:59.801 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:54:59 smithi157 bash[24585]: audit 2024-09-16T05:54:57.650500+0000 mgr.a (mgr.14373) 779 : audit [DBG] from='client.30225 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:54:59.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:54:59 smithi157 bash[24585]: cluster 2024-09-16T05:54:58.350434+0000 mgr.a (mgr.14373) 780 : cluster [DBG] pgmap v539: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 5.6 KiB/s rd, 341 B/s wr, 5 op/s 2024-09-16T05:54:59.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:54:59 smithi086 bash[24289]: audit 2024-09-16T05:54:57.650500+0000 mgr.a (mgr.14373) 779 : audit [DBG] from='client.30225 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:54:59.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:54:59 smithi086 bash[24289]: cluster 2024-09-16T05:54:58.350434+0000 mgr.a (mgr.14373) 780 : cluster [DBG] pgmap v539: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 5.6 KiB/s rd, 341 B/s wr, 5 op/s 2024-09-16T05:54:59.836 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:54:59 smithi047 bash[22744]: audit 2024-09-16T05:54:57.650500+0000 mgr.a (mgr.14373) 779 : audit [DBG] from='client.30225 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:54:59.836 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:54:59 smithi047 bash[22744]: cluster 2024-09-16T05:54:58.350434+0000 mgr.a (mgr.14373) 780 : cluster [DBG] pgmap v539: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 5.6 KiB/s rd, 341 B/s wr, 5 op/s 2024-09-16T05:55:01.801 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:55:01 smithi157 bash[24585]: cluster 2024-09-16T05:55:00.351253+0000 mgr.a (mgr.14373) 781 : cluster [DBG] pgmap v540: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:55:01.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:55:01 smithi086 bash[24289]: cluster 2024-09-16T05:55:00.351253+0000 mgr.a (mgr.14373) 781 : cluster [DBG] pgmap v540: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:55:01.836 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:55:01 smithi047 bash[22744]: cluster 2024-09-16T05:55:00.351253+0000 mgr.a (mgr.14373) 781 : cluster [DBG] pgmap v540: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:55:03.057 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T05:55:03.058 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T05:55:03.058 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T05:55:03.792 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T05:55:03.792 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T05:55:03.792 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T05:55:03.792 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T05:55:03.792 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T05:55:03.801 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:55:03 smithi157 bash[24585]: cluster 2024-09-16T05:55:02.353294+0000 mgr.a (mgr.14373) 782 : cluster [DBG] pgmap v541: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:55:03.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:55:03 smithi086 bash[24289]: cluster 2024-09-16T05:55:02.353294+0000 mgr.a (mgr.14373) 782 : cluster [DBG] pgmap v541: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:55:03.836 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:55:03 smithi047 bash[22744]: cluster 2024-09-16T05:55:02.353294+0000 mgr.a (mgr.14373) 782 : cluster [DBG] pgmap v541: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:55:04.801 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:55:04 smithi157 bash[24585]: audit 2024-09-16T05:55:03.389881+0000 mgr.a (mgr.14373) 783 : audit [DBG] from='client.30297 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:55:04.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:55:04 smithi086 bash[24289]: audit 2024-09-16T05:55:03.389881+0000 mgr.a (mgr.14373) 783 : audit [DBG] from='client.30297 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:55:04.836 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:55:04 smithi047 bash[22744]: audit 2024-09-16T05:55:03.389881+0000 mgr.a (mgr.14373) 783 : audit [DBG] from='client.30297 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:55:05.801 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:55:05 smithi157 bash[24585]: cluster 2024-09-16T05:55:04.354268+0000 mgr.a (mgr.14373) 784 : cluster [DBG] pgmap v542: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:55:05.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:55:05 smithi086 bash[24289]: cluster 2024-09-16T05:55:04.354268+0000 mgr.a (mgr.14373) 784 : cluster [DBG] pgmap v542: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:55:05.836 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:55:05 smithi047 bash[22744]: cluster 2024-09-16T05:55:04.354268+0000 mgr.a (mgr.14373) 784 : cluster [DBG] pgmap v542: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:55:07.801 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:55:07 smithi157 bash[24585]: cluster 2024-09-16T05:55:06.356090+0000 mgr.a (mgr.14373) 785 : cluster [DBG] pgmap v543: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-16T05:55:07.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:55:07 smithi086 bash[24289]: cluster 2024-09-16T05:55:06.356090+0000 mgr.a (mgr.14373) 785 : cluster [DBG] pgmap v543: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-16T05:55:07.836 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:55:07 smithi047 bash[22744]: cluster 2024-09-16T05:55:06.356090+0000 mgr.a (mgr.14373) 785 : cluster [DBG] pgmap v543: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-16T05:55:08.793 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T05:55:08.794 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T05:55:08.794 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T05:55:09.548 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T05:55:09.548 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T05:55:09.548 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T05:55:09.549 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T05:55:09.549 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T05:55:09.801 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:55:09 smithi157 bash[24585]: cluster 2024-09-16T05:55:08.357477+0000 mgr.a (mgr.14373) 786 : cluster [DBG] pgmap v544: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:55:09.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:55:09 smithi086 bash[24289]: cluster 2024-09-16T05:55:08.357477+0000 mgr.a (mgr.14373) 786 : cluster [DBG] pgmap v544: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:55:09.836 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:55:09 smithi047 bash[22744]: cluster 2024-09-16T05:55:08.357477+0000 mgr.a (mgr.14373) 786 : cluster [DBG] pgmap v544: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:55:10.801 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:55:10 smithi157 bash[24585]: audit 2024-09-16T05:55:09.132492+0000 mgr.a (mgr.14373) 787 : audit [DBG] from='client.30369 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:55:10.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:55:10 smithi086 bash[24289]: audit 2024-09-16T05:55:09.132492+0000 mgr.a (mgr.14373) 787 : audit [DBG] from='client.30369 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:55:10.836 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:55:10 smithi047 bash[22744]: audit 2024-09-16T05:55:09.132492+0000 mgr.a (mgr.14373) 787 : audit [DBG] from='client.30369 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:55:11.801 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:55:11 smithi157 bash[24585]: cluster 2024-09-16T05:55:10.358414+0000 mgr.a (mgr.14373) 788 : cluster [DBG] pgmap v545: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:55:11.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:55:11 smithi086 bash[24289]: cluster 2024-09-16T05:55:10.358414+0000 mgr.a (mgr.14373) 788 : cluster [DBG] pgmap v545: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:55:11.836 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:55:11 smithi047 bash[22744]: cluster 2024-09-16T05:55:10.358414+0000 mgr.a (mgr.14373) 788 : cluster [DBG] pgmap v545: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:55:13.801 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:55:13 smithi157 bash[24585]: cluster 2024-09-16T05:55:12.360670+0000 mgr.a (mgr.14373) 789 : cluster [DBG] pgmap v546: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:55:13.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:55:13 smithi086 bash[24289]: cluster 2024-09-16T05:55:12.360670+0000 mgr.a (mgr.14373) 789 : cluster [DBG] pgmap v546: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:55:13.836 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:55:13 smithi047 bash[22744]: cluster 2024-09-16T05:55:12.360670+0000 mgr.a (mgr.14373) 789 : cluster [DBG] pgmap v546: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:55:14.549 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T05:55:14.550 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T05:55:14.550 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T05:55:15.311 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T05:55:15.311 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T05:55:15.311 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T05:55:15.311 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T05:55:15.311 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T05:55:15.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:55:15 smithi157 bash[24585]: cluster 2024-09-16T05:55:14.361597+0000 mgr.a (mgr.14373) 790 : cluster [DBG] pgmap v547: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:55:15.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:55:15 smithi086 bash[24289]: cluster 2024-09-16T05:55:14.361597+0000 mgr.a (mgr.14373) 790 : cluster [DBG] pgmap v547: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:55:15.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:55:15 smithi047 bash[22744]: cluster 2024-09-16T05:55:14.361597+0000 mgr.a (mgr.14373) 790 : cluster [DBG] pgmap v547: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:55:16.801 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:55:16 smithi157 bash[24585]: audit 2024-09-16T05:55:14.887553+0000 mgr.a (mgr.14373) 791 : audit [DBG] from='client.30447 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:55:16.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:55:16 smithi086 bash[24289]: audit 2024-09-16T05:55:14.887553+0000 mgr.a (mgr.14373) 791 : audit [DBG] from='client.30447 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:55:16.836 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:55:16 smithi047 bash[22744]: audit 2024-09-16T05:55:14.887553+0000 mgr.a (mgr.14373) 791 : audit [DBG] from='client.30447 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:55:17.801 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:55:17 smithi157 bash[24585]: cluster 2024-09-16T05:55:16.363980+0000 mgr.a (mgr.14373) 792 : cluster [DBG] pgmap v548: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:55:17.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:55:17 smithi086 bash[24289]: cluster 2024-09-16T05:55:16.363980+0000 mgr.a (mgr.14373) 792 : cluster [DBG] pgmap v548: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:55:17.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:55:17 smithi047 bash[22744]: cluster 2024-09-16T05:55:16.363980+0000 mgr.a (mgr.14373) 792 : cluster [DBG] pgmap v548: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:55:18.801 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:55:18 smithi157 bash[24585]: cluster 2024-09-16T05:55:18.364748+0000 mgr.a (mgr.14373) 793 : cluster [DBG] pgmap v549: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-16T05:55:18.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:55:18 smithi086 bash[24289]: cluster 2024-09-16T05:55:18.364748+0000 mgr.a (mgr.14373) 793 : cluster [DBG] pgmap v549: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-16T05:55:18.836 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:55:18 smithi047 bash[22744]: cluster 2024-09-16T05:55:18.364748+0000 mgr.a (mgr.14373) 793 : cluster [DBG] pgmap v549: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-16T05:55:20.313 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T05:55:20.313 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T05:55:20.314 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T05:55:21.052 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T05:55:21.052 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T05:55:21.052 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T05:55:21.052 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T05:55:21.052 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T05:55:21.801 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:55:21 smithi157 bash[24585]: cluster 2024-09-16T05:55:20.365301+0000 mgr.a (mgr.14373) 794 : cluster [DBG] pgmap v550: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:55:21.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:55:21 smithi086 bash[24289]: cluster 2024-09-16T05:55:20.365301+0000 mgr.a (mgr.14373) 794 : cluster [DBG] pgmap v550: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:55:21.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:55:21 smithi047 bash[22744]: cluster 2024-09-16T05:55:20.365301+0000 mgr.a (mgr.14373) 794 : cluster [DBG] pgmap v550: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:55:22.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:55:22 smithi157 bash[24585]: audit 2024-09-16T05:55:20.640739+0000 mgr.a (mgr.14373) 795 : audit [DBG] from='client.30525 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:55:22.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:55:22 smithi086 bash[24289]: audit 2024-09-16T05:55:20.640739+0000 mgr.a (mgr.14373) 795 : audit [DBG] from='client.30525 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:55:22.836 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:55:22 smithi047 bash[22744]: audit 2024-09-16T05:55:20.640739+0000 mgr.a (mgr.14373) 795 : audit [DBG] from='client.30525 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:55:23.801 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:55:23 smithi157 bash[24585]: cluster 2024-09-16T05:55:22.367699+0000 mgr.a (mgr.14373) 796 : cluster [DBG] pgmap v551: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:55:23.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:55:23 smithi086 bash[24289]: cluster 2024-09-16T05:55:22.367699+0000 mgr.a (mgr.14373) 796 : cluster [DBG] pgmap v551: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:55:23.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:55:23 smithi047 bash[22744]: cluster 2024-09-16T05:55:22.367699+0000 mgr.a (mgr.14373) 796 : cluster [DBG] pgmap v551: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:55:25.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:55:25 smithi157 bash[24585]: cluster 2024-09-16T05:55:24.368485+0000 mgr.a (mgr.14373) 797 : cluster [DBG] pgmap v552: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:55:25.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:55:25 smithi086 bash[24289]: cluster 2024-09-16T05:55:24.368485+0000 mgr.a (mgr.14373) 797 : cluster [DBG] pgmap v552: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:55:25.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:55:25 smithi047 bash[22744]: cluster 2024-09-16T05:55:24.368485+0000 mgr.a (mgr.14373) 797 : cluster [DBG] pgmap v552: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:55:26.053 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T05:55:26.054 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T05:55:26.054 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T05:55:26.795 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T05:55:26.795 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T05:55:26.795 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T05:55:26.795 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T05:55:26.796 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T05:55:27.801 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:55:27 smithi157 bash[24585]: cluster 2024-09-16T05:55:26.370298+0000 mgr.a (mgr.14373) 798 : cluster [DBG] pgmap v553: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:55:27.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:55:27 smithi157 bash[24585]: audit 2024-09-16T05:55:26.387956+0000 mgr.a (mgr.14373) 799 : audit [DBG] from='client.30603 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:55:27.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:55:27 smithi086 bash[24289]: cluster 2024-09-16T05:55:26.370298+0000 mgr.a (mgr.14373) 798 : cluster [DBG] pgmap v553: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:55:27.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:55:27 smithi086 bash[24289]: audit 2024-09-16T05:55:26.387956+0000 mgr.a (mgr.14373) 799 : audit [DBG] from='client.30603 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:55:27.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:55:27 smithi047 bash[22744]: cluster 2024-09-16T05:55:26.370298+0000 mgr.a (mgr.14373) 798 : cluster [DBG] pgmap v553: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:55:27.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:55:27 smithi047 bash[22744]: audit 2024-09-16T05:55:26.387956+0000 mgr.a (mgr.14373) 799 : audit [DBG] from='client.30603 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:55:29.801 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:55:29 smithi157 bash[24585]: cluster 2024-09-16T05:55:28.371142+0000 mgr.a (mgr.14373) 800 : cluster [DBG] pgmap v554: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T05:55:29.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:55:29 smithi086 bash[24289]: cluster 2024-09-16T05:55:28.371142+0000 mgr.a (mgr.14373) 800 : cluster [DBG] pgmap v554: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T05:55:29.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:55:29 smithi047 bash[22744]: cluster 2024-09-16T05:55:28.371142+0000 mgr.a (mgr.14373) 800 : cluster [DBG] pgmap v554: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T05:55:31.797 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T05:55:31.797 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T05:55:31.798 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T05:55:31.801 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:55:31 smithi157 bash[24585]: cluster 2024-09-16T05:55:30.371941+0000 mgr.a (mgr.14373) 801 : cluster [DBG] pgmap v555: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T05:55:31.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:55:31 smithi086 bash[24289]: cluster 2024-09-16T05:55:30.371941+0000 mgr.a (mgr.14373) 801 : cluster [DBG] pgmap v555: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T05:55:31.836 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:55:31 smithi047 bash[22744]: cluster 2024-09-16T05:55:30.371941+0000 mgr.a (mgr.14373) 801 : cluster [DBG] pgmap v555: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T05:55:32.536 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T05:55:32.536 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T05:55:32.536 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T05:55:32.536 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T05:55:32.536 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T05:55:33.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:55:33 smithi157 bash[24585]: audit 2024-09-16T05:55:32.132988+0000 mgr.a (mgr.14373) 802 : audit [DBG] from='client.30681 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:55:33.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:55:33 smithi157 bash[24585]: cluster 2024-09-16T05:55:32.373259+0000 mgr.a (mgr.14373) 803 : cluster [DBG] pgmap v556: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:55:33.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:55:33 smithi086 bash[24289]: audit 2024-09-16T05:55:32.132988+0000 mgr.a (mgr.14373) 802 : audit [DBG] from='client.30681 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:55:33.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:55:33 smithi086 bash[24289]: cluster 2024-09-16T05:55:32.373259+0000 mgr.a (mgr.14373) 803 : cluster [DBG] pgmap v556: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:55:33.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:55:33 smithi047 bash[22744]: audit 2024-09-16T05:55:32.132988+0000 mgr.a (mgr.14373) 802 : audit [DBG] from='client.30681 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:55:33.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:55:33 smithi047 bash[22744]: cluster 2024-09-16T05:55:32.373259+0000 mgr.a (mgr.14373) 803 : cluster [DBG] pgmap v556: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:55:35.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:55:35 smithi157 bash[24585]: cluster 2024-09-16T05:55:34.374157+0000 mgr.a (mgr.14373) 804 : cluster [DBG] pgmap v557: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T05:55:35.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:55:35 smithi086 bash[24289]: cluster 2024-09-16T05:55:34.374157+0000 mgr.a (mgr.14373) 804 : cluster [DBG] pgmap v557: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T05:55:35.836 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:55:35 smithi047 bash[22744]: cluster 2024-09-16T05:55:34.374157+0000 mgr.a (mgr.14373) 804 : cluster [DBG] pgmap v557: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T05:55:37.537 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T05:55:37.538 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T05:55:37.538 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T05:55:37.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:55:37 smithi157 bash[24585]: cluster 2024-09-16T05:55:36.376262+0000 mgr.a (mgr.14373) 805 : cluster [DBG] pgmap v558: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:55:37.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:55:37 smithi086 bash[24289]: cluster 2024-09-16T05:55:36.376262+0000 mgr.a (mgr.14373) 805 : cluster [DBG] pgmap v558: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:55:37.836 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:55:37 smithi047 bash[22744]: cluster 2024-09-16T05:55:36.376262+0000 mgr.a (mgr.14373) 805 : cluster [DBG] pgmap v558: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:55:38.283 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T05:55:38.283 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T05:55:38.284 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T05:55:38.284 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T05:55:38.284 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T05:55:39.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:55:39 smithi157 bash[24585]: audit 2024-09-16T05:55:37.874752+0000 mgr.a (mgr.14373) 806 : audit [DBG] from='client.30759 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:55:39.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:55:39 smithi157 bash[24585]: cluster 2024-09-16T05:55:38.376818+0000 mgr.a (mgr.14373) 807 : cluster [DBG] pgmap v559: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:55:39.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:55:39 smithi086 bash[24289]: audit 2024-09-16T05:55:37.874752+0000 mgr.a (mgr.14373) 806 : audit [DBG] from='client.30759 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:55:39.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:55:39 smithi086 bash[24289]: cluster 2024-09-16T05:55:38.376818+0000 mgr.a (mgr.14373) 807 : cluster [DBG] pgmap v559: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:55:39.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:55:39 smithi047 bash[22744]: audit 2024-09-16T05:55:37.874752+0000 mgr.a (mgr.14373) 806 : audit [DBG] from='client.30759 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:55:39.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:55:39 smithi047 bash[22744]: cluster 2024-09-16T05:55:38.376818+0000 mgr.a (mgr.14373) 807 : cluster [DBG] pgmap v559: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:55:41.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:55:41 smithi157 bash[24585]: cluster 2024-09-16T05:55:40.377524+0000 mgr.a (mgr.14373) 808 : cluster [DBG] pgmap v560: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:55:41.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:55:41 smithi086 bash[24289]: cluster 2024-09-16T05:55:40.377524+0000 mgr.a (mgr.14373) 808 : cluster [DBG] pgmap v560: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:55:41.836 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:55:41 smithi047 bash[22744]: cluster 2024-09-16T05:55:40.377524+0000 mgr.a (mgr.14373) 808 : cluster [DBG] pgmap v560: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:55:43.285 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T05:55:43.286 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T05:55:43.286 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T05:55:43.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:55:43 smithi157 bash[24585]: cluster 2024-09-16T05:55:42.379792+0000 mgr.a (mgr.14373) 809 : cluster [DBG] pgmap v561: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:55:43.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:55:43 smithi086 bash[24289]: cluster 2024-09-16T05:55:42.379792+0000 mgr.a (mgr.14373) 809 : cluster [DBG] pgmap v561: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:55:43.836 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:55:43 smithi047 bash[22744]: cluster 2024-09-16T05:55:42.379792+0000 mgr.a (mgr.14373) 809 : cluster [DBG] pgmap v561: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:55:44.064 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T05:55:44.064 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T05:55:44.064 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T05:55:44.064 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T05:55:44.064 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T05:55:45.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:55:45 smithi157 bash[24585]: audit 2024-09-16T05:55:43.633806+0000 mgr.a (mgr.14373) 810 : audit [DBG] from='client.30837 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:55:45.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:55:45 smithi157 bash[24585]: cluster 2024-09-16T05:55:44.380895+0000 mgr.a (mgr.14373) 811 : cluster [DBG] pgmap v562: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:55:45.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:55:45 smithi157 bash[24585]: audit 2024-09-16T05:55:44.489086+0000 mon.b (mon.2) 122 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T05:55:45.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:55:45 smithi157 bash[24585]: audit 2024-09-16T05:55:45.315798+0000 mon.b (mon.2) 123 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T05:55:45.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:55:45 smithi157 bash[24585]: audit 2024-09-16T05:55:45.317767+0000 mon.b (mon.2) 124 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T05:55:45.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:55:45 smithi157 bash[24585]: audit 2024-09-16T05:55:45.330369+0000 mon.b (mon.2) 125 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T05:55:45.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:55:45 smithi157 bash[24585]: audit 2024-09-16T05:55:45.331794+0000 mon.a (mon.0) 616 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T05:55:45.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:55:45 smithi086 bash[24289]: audit 2024-09-16T05:55:43.633806+0000 mgr.a (mgr.14373) 810 : audit [DBG] from='client.30837 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:55:45.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:55:45 smithi086 bash[24289]: cluster 2024-09-16T05:55:44.380895+0000 mgr.a (mgr.14373) 811 : cluster [DBG] pgmap v562: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:55:45.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:55:45 smithi086 bash[24289]: audit 2024-09-16T05:55:44.489086+0000 mon.b (mon.2) 122 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T05:55:45.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:55:45 smithi086 bash[24289]: audit 2024-09-16T05:55:45.315798+0000 mon.b (mon.2) 123 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T05:55:45.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:55:45 smithi086 bash[24289]: audit 2024-09-16T05:55:45.317767+0000 mon.b (mon.2) 124 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T05:55:45.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:55:45 smithi086 bash[24289]: audit 2024-09-16T05:55:45.330369+0000 mon.b (mon.2) 125 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T05:55:45.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:55:45 smithi086 bash[24289]: audit 2024-09-16T05:55:45.331794+0000 mon.a (mon.0) 616 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T05:55:45.836 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:55:45 smithi047 bash[22744]: audit 2024-09-16T05:55:43.633806+0000 mgr.a (mgr.14373) 810 : audit [DBG] from='client.30837 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:55:45.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:55:45 smithi047 bash[22744]: cluster 2024-09-16T05:55:44.380895+0000 mgr.a (mgr.14373) 811 : cluster [DBG] pgmap v562: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:55:45.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:55:45 smithi047 bash[22744]: audit 2024-09-16T05:55:44.489086+0000 mon.b (mon.2) 122 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T05:55:45.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:55:45 smithi047 bash[22744]: audit 2024-09-16T05:55:45.315798+0000 mon.b (mon.2) 123 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T05:55:45.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:55:45 smithi047 bash[22744]: audit 2024-09-16T05:55:45.317767+0000 mon.b (mon.2) 124 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T05:55:45.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:55:45 smithi047 bash[22744]: audit 2024-09-16T05:55:45.330369+0000 mon.b (mon.2) 125 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T05:55:45.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:55:45 smithi047 bash[22744]: audit 2024-09-16T05:55:45.331794+0000 mon.a (mon.0) 616 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T05:55:46.337 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 05:55:46 smithi047 bash[22994]: debug 2024-09-16T05:55:46.045+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T05:55:46.337 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 05:55:46 smithi047 bash[22994]: debug 2024-09-16T05:55:46.049+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T05:55:46.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:55:46 smithi157 bash[24585]: audit 2024-09-16T05:55:45.337486+0000 mgr.a (mgr.14373) 812 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T05:55:46.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:55:46 smithi086 bash[24289]: audit 2024-09-16T05:55:45.337486+0000 mgr.a (mgr.14373) 812 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T05:55:46.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:55:46 smithi047 bash[22744]: audit 2024-09-16T05:55:45.337486+0000 mgr.a (mgr.14373) 812 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T05:55:47.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:55:47 smithi157 bash[24585]: audit 2024-09-16T05:55:46.048224+0000 mgr.a (mgr.14373) 813 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T05:55:47.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:55:47 smithi157 bash[24585]: cephadm 2024-09-16T05:55:46.050560+0000 mgr.a (mgr.14373) 814 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T05:55:47.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:55:47 smithi157 bash[24585]: cluster 2024-09-16T05:55:46.383328+0000 mgr.a (mgr.14373) 815 : cluster [DBG] pgmap v563: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T05:55:47.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:55:47 smithi086 bash[24289]: audit 2024-09-16T05:55:46.048224+0000 mgr.a (mgr.14373) 813 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T05:55:47.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:55:47 smithi086 bash[24289]: cephadm 2024-09-16T05:55:46.050560+0000 mgr.a (mgr.14373) 814 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T05:55:47.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:55:47 smithi086 bash[24289]: cluster 2024-09-16T05:55:46.383328+0000 mgr.a (mgr.14373) 815 : cluster [DBG] pgmap v563: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T05:55:47.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:55:47 smithi047 bash[22744]: audit 2024-09-16T05:55:46.048224+0000 mgr.a (mgr.14373) 813 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T05:55:47.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:55:47 smithi047 bash[22744]: cephadm 2024-09-16T05:55:46.050560+0000 mgr.a (mgr.14373) 814 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T05:55:47.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:55:47 smithi047 bash[22744]: cluster 2024-09-16T05:55:46.383328+0000 mgr.a (mgr.14373) 815 : cluster [DBG] pgmap v563: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T05:55:49.065 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T05:55:49.066 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T05:55:49.066 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T05:55:49.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:55:49 smithi157 bash[24585]: cluster 2024-09-16T05:55:48.384085+0000 mgr.a (mgr.14373) 816 : cluster [DBG] pgmap v564: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T05:55:49.809 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T05:55:49.809 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T05:55:49.809 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T05:55:49.809 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T05:55:49.809 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T05:55:49.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:55:49 smithi086 bash[24289]: cluster 2024-09-16T05:55:48.384085+0000 mgr.a (mgr.14373) 816 : cluster [DBG] pgmap v564: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T05:55:49.836 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:55:49 smithi047 bash[22744]: cluster 2024-09-16T05:55:48.384085+0000 mgr.a (mgr.14373) 816 : cluster [DBG] pgmap v564: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T05:55:50.801 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:55:50 smithi157 bash[24585]: audit 2024-09-16T05:55:49.401310+0000 mgr.a (mgr.14373) 817 : audit [DBG] from='client.31020 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:55:50.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:55:50 smithi086 bash[24289]: audit 2024-09-16T05:55:49.401310+0000 mgr.a (mgr.14373) 817 : audit [DBG] from='client.31020 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:55:50.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:55:50 smithi047 bash[22744]: audit 2024-09-16T05:55:49.401310+0000 mgr.a (mgr.14373) 817 : audit [DBG] from='client.31020 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:55:51.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:55:51 smithi157 bash[24585]: cluster 2024-09-16T05:55:50.385070+0000 mgr.a (mgr.14373) 818 : cluster [DBG] pgmap v565: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T05:55:51.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:55:51 smithi086 bash[24289]: cluster 2024-09-16T05:55:50.385070+0000 mgr.a (mgr.14373) 818 : cluster [DBG] pgmap v565: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T05:55:51.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:55:51 smithi047 bash[22744]: cluster 2024-09-16T05:55:50.385070+0000 mgr.a (mgr.14373) 818 : cluster [DBG] pgmap v565: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T05:55:53.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:55:53 smithi157 bash[24585]: cluster 2024-09-16T05:55:52.387435+0000 mgr.a (mgr.14373) 819 : cluster [DBG] pgmap v566: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T05:55:53.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:55:53 smithi086 bash[24289]: cluster 2024-09-16T05:55:52.387435+0000 mgr.a (mgr.14373) 819 : cluster [DBG] pgmap v566: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T05:55:53.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:55:53 smithi047 bash[22744]: cluster 2024-09-16T05:55:52.387435+0000 mgr.a (mgr.14373) 819 : cluster [DBG] pgmap v566: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T05:55:54.810 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T05:55:54.811 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T05:55:54.812 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T05:55:55.588 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T05:55:55.588 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T05:55:55.588 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T05:55:55.588 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T05:55:55.588 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T05:55:55.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:55:55 smithi157 bash[24585]: cluster 2024-09-16T05:55:54.388385+0000 mgr.a (mgr.14373) 820 : cluster [DBG] pgmap v567: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T05:55:55.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:55:55 smithi086 bash[24289]: cluster 2024-09-16T05:55:54.388385+0000 mgr.a (mgr.14373) 820 : cluster [DBG] pgmap v567: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T05:55:55.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:55:55 smithi047 bash[22744]: cluster 2024-09-16T05:55:54.388385+0000 mgr.a (mgr.14373) 820 : cluster [DBG] pgmap v567: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T05:55:56.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:55:56 smithi157 bash[24585]: audit 2024-09-16T05:55:55.153344+0000 mgr.a (mgr.14373) 821 : audit [DBG] from='client.31098 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:55:56.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:55:56 smithi086 bash[24289]: audit 2024-09-16T05:55:55.153344+0000 mgr.a (mgr.14373) 821 : audit [DBG] from='client.31098 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:55:56.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:55:56 smithi047 bash[22744]: audit 2024-09-16T05:55:55.153344+0000 mgr.a (mgr.14373) 821 : audit [DBG] from='client.31098 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:55:57.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:55:57 smithi157 bash[24585]: cluster 2024-09-16T05:55:56.390772+0000 mgr.a (mgr.14373) 822 : cluster [DBG] pgmap v568: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T05:55:57.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:55:57 smithi086 bash[24289]: cluster 2024-09-16T05:55:56.390772+0000 mgr.a (mgr.14373) 822 : cluster [DBG] pgmap v568: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T05:55:57.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:55:57 smithi047 bash[22744]: cluster 2024-09-16T05:55:56.390772+0000 mgr.a (mgr.14373) 822 : cluster [DBG] pgmap v568: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T05:55:59.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:55:59 smithi157 bash[24585]: cluster 2024-09-16T05:55:58.391530+0000 mgr.a (mgr.14373) 823 : cluster [DBG] pgmap v569: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:55:59.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:55:59 smithi086 bash[24289]: cluster 2024-09-16T05:55:58.391530+0000 mgr.a (mgr.14373) 823 : cluster [DBG] pgmap v569: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:55:59.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:55:59 smithi047 bash[22744]: cluster 2024-09-16T05:55:58.391530+0000 mgr.a (mgr.14373) 823 : cluster [DBG] pgmap v569: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:56:00.589 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T05:56:00.590 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T05:56:00.590 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T05:56:01.361 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T05:56:01.361 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T05:56:01.361 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T05:56:01.361 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T05:56:01.361 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T05:56:01.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:56:01 smithi157 bash[24585]: cluster 2024-09-16T05:56:00.392298+0000 mgr.a (mgr.14373) 824 : cluster [DBG] pgmap v570: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:56:01.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:56:01 smithi086 bash[24289]: cluster 2024-09-16T05:56:00.392298+0000 mgr.a (mgr.14373) 824 : cluster [DBG] pgmap v570: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:56:01.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:56:01 smithi047 bash[22744]: cluster 2024-09-16T05:56:00.392298+0000 mgr.a (mgr.14373) 824 : cluster [DBG] pgmap v570: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:56:02.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:56:02 smithi157 bash[24585]: audit 2024-09-16T05:56:00.933485+0000 mgr.a (mgr.14373) 825 : audit [DBG] from='client.31173 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:56:02.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:56:02 smithi086 bash[24289]: audit 2024-09-16T05:56:00.933485+0000 mgr.a (mgr.14373) 825 : audit [DBG] from='client.31173 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:56:02.836 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:56:02 smithi047 bash[22744]: audit 2024-09-16T05:56:00.933485+0000 mgr.a (mgr.14373) 825 : audit [DBG] from='client.31173 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:56:03.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:56:03 smithi157 bash[24585]: cluster 2024-09-16T05:56:02.394657+0000 mgr.a (mgr.14373) 826 : cluster [DBG] pgmap v571: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:56:03.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:56:03 smithi086 bash[24289]: cluster 2024-09-16T05:56:02.394657+0000 mgr.a (mgr.14373) 826 : cluster [DBG] pgmap v571: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:56:03.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:56:03 smithi047 bash[22744]: cluster 2024-09-16T05:56:02.394657+0000 mgr.a (mgr.14373) 826 : cluster [DBG] pgmap v571: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:56:04.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:56:04 smithi157 bash[24585]: cluster 2024-09-16T05:56:04.395448+0000 mgr.a (mgr.14373) 827 : cluster [DBG] pgmap v572: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:56:04.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:56:04 smithi086 bash[24289]: cluster 2024-09-16T05:56:04.395448+0000 mgr.a (mgr.14373) 827 : cluster [DBG] pgmap v572: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:56:04.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:56:04 smithi047 bash[22744]: cluster 2024-09-16T05:56:04.395448+0000 mgr.a (mgr.14373) 827 : cluster [DBG] pgmap v572: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:56:06.363 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T05:56:06.364 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T05:56:06.364 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T05:56:07.116 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T05:56:07.116 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T05:56:07.117 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T05:56:07.117 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T05:56:07.117 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T05:56:07.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:56:07 smithi157 bash[24585]: cluster 2024-09-16T05:56:06.396499+0000 mgr.a (mgr.14373) 828 : cluster [DBG] pgmap v573: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:56:07.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:56:07 smithi086 bash[24289]: cluster 2024-09-16T05:56:06.396499+0000 mgr.a (mgr.14373) 828 : cluster [DBG] pgmap v573: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:56:07.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:56:07 smithi047 bash[22744]: cluster 2024-09-16T05:56:06.396499+0000 mgr.a (mgr.14373) 828 : cluster [DBG] pgmap v573: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:56:08.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:56:08 smithi157 bash[24585]: audit 2024-09-16T05:56:06.699058+0000 mgr.a (mgr.14373) 829 : audit [DBG] from='client.31248 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:56:08.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:56:08 smithi086 bash[24289]: audit 2024-09-16T05:56:06.699058+0000 mgr.a (mgr.14373) 829 : audit [DBG] from='client.31248 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:56:08.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:56:08 smithi047 bash[22744]: audit 2024-09-16T05:56:06.699058+0000 mgr.a (mgr.14373) 829 : audit [DBG] from='client.31248 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:56:09.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:56:09 smithi157 bash[24585]: cluster 2024-09-16T05:56:08.397475+0000 mgr.a (mgr.14373) 830 : cluster [DBG] pgmap v574: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T05:56:09.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:56:09 smithi086 bash[24289]: cluster 2024-09-16T05:56:08.397475+0000 mgr.a (mgr.14373) 830 : cluster [DBG] pgmap v574: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T05:56:09.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:56:09 smithi047 bash[22744]: cluster 2024-09-16T05:56:08.397475+0000 mgr.a (mgr.14373) 830 : cluster [DBG] pgmap v574: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T05:56:11.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:56:11 smithi157 bash[24585]: cluster 2024-09-16T05:56:10.398489+0000 mgr.a (mgr.14373) 831 : cluster [DBG] pgmap v575: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T05:56:11.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:56:11 smithi086 bash[24289]: cluster 2024-09-16T05:56:10.398489+0000 mgr.a (mgr.14373) 831 : cluster [DBG] pgmap v575: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T05:56:11.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:56:11 smithi047 bash[22744]: cluster 2024-09-16T05:56:10.398489+0000 mgr.a (mgr.14373) 831 : cluster [DBG] pgmap v575: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T05:56:12.118 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T05:56:12.118 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T05:56:12.118 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T05:56:12.887 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T05:56:12.887 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T05:56:12.887 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T05:56:12.887 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T05:56:12.887 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T05:56:13.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:56:13 smithi157 bash[24585]: cluster 2024-09-16T05:56:12.400770+0000 mgr.a (mgr.14373) 832 : cluster [DBG] pgmap v576: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:56:13.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:56:13 smithi157 bash[24585]: audit 2024-09-16T05:56:12.461174+0000 mgr.a (mgr.14373) 833 : audit [DBG] from='client.31326 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:56:13.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:56:13 smithi086 bash[24289]: cluster 2024-09-16T05:56:12.400770+0000 mgr.a (mgr.14373) 832 : cluster [DBG] pgmap v576: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:56:13.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:56:13 smithi086 bash[24289]: audit 2024-09-16T05:56:12.461174+0000 mgr.a (mgr.14373) 833 : audit [DBG] from='client.31326 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:56:13.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:56:13 smithi047 bash[22744]: cluster 2024-09-16T05:56:12.400770+0000 mgr.a (mgr.14373) 832 : cluster [DBG] pgmap v576: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:56:13.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:56:13 smithi047 bash[22744]: audit 2024-09-16T05:56:12.461174+0000 mgr.a (mgr.14373) 833 : audit [DBG] from='client.31326 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:56:15.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:56:15 smithi157 bash[24585]: cluster 2024-09-16T05:56:14.401715+0000 mgr.a (mgr.14373) 834 : cluster [DBG] pgmap v577: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T05:56:15.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:56:15 smithi086 bash[24289]: cluster 2024-09-16T05:56:14.401715+0000 mgr.a (mgr.14373) 834 : cluster [DBG] pgmap v577: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T05:56:15.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:56:15 smithi047 bash[22744]: cluster 2024-09-16T05:56:14.401715+0000 mgr.a (mgr.14373) 834 : cluster [DBG] pgmap v577: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T05:56:17.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:56:17 smithi157 bash[24585]: cluster 2024-09-16T05:56:16.403860+0000 mgr.a (mgr.14373) 835 : cluster [DBG] pgmap v578: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:56:17.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:56:17 smithi086 bash[24289]: cluster 2024-09-16T05:56:16.403860+0000 mgr.a (mgr.14373) 835 : cluster [DBG] pgmap v578: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:56:17.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:56:17 smithi047 bash[22744]: cluster 2024-09-16T05:56:16.403860+0000 mgr.a (mgr.14373) 835 : cluster [DBG] pgmap v578: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:56:17.888 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T05:56:17.889 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T05:56:17.889 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T05:56:18.638 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T05:56:18.638 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T05:56:18.638 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T05:56:18.639 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T05:56:18.639 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T05:56:19.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:56:19 smithi157 bash[24585]: audit 2024-09-16T05:56:18.224088+0000 mgr.a (mgr.14373) 836 : audit [DBG] from='client.31401 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:56:19.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:56:19 smithi157 bash[24585]: cluster 2024-09-16T05:56:18.404443+0000 mgr.a (mgr.14373) 837 : cluster [DBG] pgmap v579: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:56:19.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:56:19 smithi086 bash[24289]: audit 2024-09-16T05:56:18.224088+0000 mgr.a (mgr.14373) 836 : audit [DBG] from='client.31401 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:56:19.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:56:19 smithi086 bash[24289]: cluster 2024-09-16T05:56:18.404443+0000 mgr.a (mgr.14373) 837 : cluster [DBG] pgmap v579: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:56:19.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:56:19 smithi047 bash[22744]: audit 2024-09-16T05:56:18.224088+0000 mgr.a (mgr.14373) 836 : audit [DBG] from='client.31401 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:56:19.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:56:19 smithi047 bash[22744]: cluster 2024-09-16T05:56:18.404443+0000 mgr.a (mgr.14373) 837 : cluster [DBG] pgmap v579: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:56:21.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:56:21 smithi157 bash[24585]: cluster 2024-09-16T05:56:20.405293+0000 mgr.a (mgr.14373) 838 : cluster [DBG] pgmap v580: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:56:21.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:56:21 smithi086 bash[24289]: cluster 2024-09-16T05:56:20.405293+0000 mgr.a (mgr.14373) 838 : cluster [DBG] pgmap v580: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:56:21.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:56:21 smithi047 bash[22744]: cluster 2024-09-16T05:56:20.405293+0000 mgr.a (mgr.14373) 838 : cluster [DBG] pgmap v580: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:56:23.640 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T05:56:23.641 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T05:56:23.641 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T05:56:23.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:56:23 smithi157 bash[24585]: cluster 2024-09-16T05:56:22.407573+0000 mgr.a (mgr.14373) 839 : cluster [DBG] pgmap v581: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:56:23.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:56:23 smithi086 bash[24289]: cluster 2024-09-16T05:56:22.407573+0000 mgr.a (mgr.14373) 839 : cluster [DBG] pgmap v581: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:56:23.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:56:23 smithi047 bash[22744]: cluster 2024-09-16T05:56:22.407573+0000 mgr.a (mgr.14373) 839 : cluster [DBG] pgmap v581: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:56:24.409 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T05:56:24.409 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T05:56:24.409 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T05:56:24.409 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T05:56:24.409 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T05:56:25.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:56:25 smithi157 bash[24585]: audit 2024-09-16T05:56:23.982163+0000 mgr.a (mgr.14373) 840 : audit [DBG] from='client.31479 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:56:25.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:56:25 smithi157 bash[24585]: cluster 2024-09-16T05:56:24.408160+0000 mgr.a (mgr.14373) 841 : cluster [DBG] pgmap v582: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:56:25.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:56:25 smithi086 bash[24289]: audit 2024-09-16T05:56:23.982163+0000 mgr.a (mgr.14373) 840 : audit [DBG] from='client.31479 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:56:25.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:56:25 smithi086 bash[24289]: cluster 2024-09-16T05:56:24.408160+0000 mgr.a (mgr.14373) 841 : cluster [DBG] pgmap v582: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:56:25.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:56:25 smithi047 bash[22744]: audit 2024-09-16T05:56:23.982163+0000 mgr.a (mgr.14373) 840 : audit [DBG] from='client.31479 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:56:25.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:56:25 smithi047 bash[22744]: cluster 2024-09-16T05:56:24.408160+0000 mgr.a (mgr.14373) 841 : cluster [DBG] pgmap v582: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:56:27.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:56:27 smithi157 bash[24585]: cluster 2024-09-16T05:56:26.410228+0000 mgr.a (mgr.14373) 842 : cluster [DBG] pgmap v583: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:56:27.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:56:27 smithi086 bash[24289]: cluster 2024-09-16T05:56:26.410228+0000 mgr.a (mgr.14373) 842 : cluster [DBG] pgmap v583: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:56:27.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:56:27 smithi047 bash[22744]: cluster 2024-09-16T05:56:26.410228+0000 mgr.a (mgr.14373) 842 : cluster [DBG] pgmap v583: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:56:29.411 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T05:56:29.411 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T05:56:29.412 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T05:56:29.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:56:29 smithi157 bash[24585]: cluster 2024-09-16T05:56:28.410981+0000 mgr.a (mgr.14373) 843 : cluster [DBG] pgmap v584: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:56:29.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:56:29 smithi086 bash[24289]: cluster 2024-09-16T05:56:28.410981+0000 mgr.a (mgr.14373) 843 : cluster [DBG] pgmap v584: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:56:29.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:56:29 smithi047 bash[22744]: cluster 2024-09-16T05:56:28.410981+0000 mgr.a (mgr.14373) 843 : cluster [DBG] pgmap v584: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:56:30.168 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T05:56:30.169 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T05:56:30.169 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T05:56:30.169 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T05:56:30.169 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T05:56:31.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:56:31 smithi157 bash[24585]: audit 2024-09-16T05:56:29.753668+0000 mgr.a (mgr.14373) 844 : audit [DBG] from='client.31557 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:56:31.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:56:31 smithi157 bash[24585]: cluster 2024-09-16T05:56:30.411954+0000 mgr.a (mgr.14373) 845 : cluster [DBG] pgmap v585: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:56:31.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:56:31 smithi086 bash[24289]: audit 2024-09-16T05:56:29.753668+0000 mgr.a (mgr.14373) 844 : audit [DBG] from='client.31557 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:56:31.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:56:31 smithi086 bash[24289]: cluster 2024-09-16T05:56:30.411954+0000 mgr.a (mgr.14373) 845 : cluster [DBG] pgmap v585: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:56:31.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:56:31 smithi047 bash[22744]: audit 2024-09-16T05:56:29.753668+0000 mgr.a (mgr.14373) 844 : audit [DBG] from='client.31557 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:56:31.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:56:31 smithi047 bash[22744]: cluster 2024-09-16T05:56:30.411954+0000 mgr.a (mgr.14373) 845 : cluster [DBG] pgmap v585: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:56:33.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:56:33 smithi157 bash[24585]: cluster 2024-09-16T05:56:32.414210+0000 mgr.a (mgr.14373) 846 : cluster [DBG] pgmap v586: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:56:33.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:56:33 smithi086 bash[24289]: cluster 2024-09-16T05:56:32.414210+0000 mgr.a (mgr.14373) 846 : cluster [DBG] pgmap v586: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:56:33.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:56:33 smithi047 bash[22744]: cluster 2024-09-16T05:56:32.414210+0000 mgr.a (mgr.14373) 846 : cluster [DBG] pgmap v586: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:56:35.170 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T05:56:35.171 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T05:56:35.171 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T05:56:35.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:56:35 smithi157 bash[24585]: cluster 2024-09-16T05:56:34.414972+0000 mgr.a (mgr.14373) 847 : cluster [DBG] pgmap v587: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:56:35.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:56:35 smithi086 bash[24289]: cluster 2024-09-16T05:56:34.414972+0000 mgr.a (mgr.14373) 847 : cluster [DBG] pgmap v587: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:56:35.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:56:35 smithi047 bash[22744]: cluster 2024-09-16T05:56:34.414972+0000 mgr.a (mgr.14373) 847 : cluster [DBG] pgmap v587: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:56:35.914 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T05:56:35.914 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T05:56:35.914 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T05:56:35.914 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T05:56:35.914 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T05:56:36.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:56:36 smithi157 bash[24585]: audit 2024-09-16T05:56:35.502755+0000 mgr.a (mgr.14373) 848 : audit [DBG] from='client.31632 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:56:36.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:56:36 smithi086 bash[24289]: audit 2024-09-16T05:56:35.502755+0000 mgr.a (mgr.14373) 848 : audit [DBG] from='client.31632 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:56:36.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:56:36 smithi047 bash[22744]: audit 2024-09-16T05:56:35.502755+0000 mgr.a (mgr.14373) 848 : audit [DBG] from='client.31632 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:56:37.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:56:37 smithi157 bash[24585]: cluster 2024-09-16T05:56:36.417357+0000 mgr.a (mgr.14373) 849 : cluster [DBG] pgmap v588: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:56:37.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:56:37 smithi086 bash[24289]: cluster 2024-09-16T05:56:36.417357+0000 mgr.a (mgr.14373) 849 : cluster [DBG] pgmap v588: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:56:37.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:56:37 smithi047 bash[22744]: cluster 2024-09-16T05:56:36.417357+0000 mgr.a (mgr.14373) 849 : cluster [DBG] pgmap v588: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:56:39.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:56:39 smithi157 bash[24585]: cluster 2024-09-16T05:56:38.418169+0000 mgr.a (mgr.14373) 850 : cluster [DBG] pgmap v589: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:56:39.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:56:39 smithi086 bash[24289]: cluster 2024-09-16T05:56:38.418169+0000 mgr.a (mgr.14373) 850 : cluster [DBG] pgmap v589: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:56:39.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:56:39 smithi047 bash[22744]: cluster 2024-09-16T05:56:38.418169+0000 mgr.a (mgr.14373) 850 : cluster [DBG] pgmap v589: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:56:40.915 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T05:56:40.916 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T05:56:40.916 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T05:56:41.704 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T05:56:41.704 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T05:56:41.705 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T05:56:41.705 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T05:56:41.705 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T05:56:41.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:56:41 smithi157 bash[24585]: cluster 2024-09-16T05:56:40.418923+0000 mgr.a (mgr.14373) 851 : cluster [DBG] pgmap v590: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:56:41.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:56:41 smithi086 bash[24289]: cluster 2024-09-16T05:56:40.418923+0000 mgr.a (mgr.14373) 851 : cluster [DBG] pgmap v590: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:56:41.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:56:41 smithi047 bash[22744]: cluster 2024-09-16T05:56:40.418923+0000 mgr.a (mgr.14373) 851 : cluster [DBG] pgmap v590: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:56:42.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:56:42 smithi157 bash[24585]: audit 2024-09-16T05:56:41.264415+0000 mgr.a (mgr.14373) 852 : audit [DBG] from='client.31710 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:56:42.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:56:42 smithi086 bash[24289]: audit 2024-09-16T05:56:41.264415+0000 mgr.a (mgr.14373) 852 : audit [DBG] from='client.31710 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:56:42.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:56:42 smithi047 bash[22744]: audit 2024-09-16T05:56:41.264415+0000 mgr.a (mgr.14373) 852 : audit [DBG] from='client.31710 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:56:43.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:56:43 smithi157 bash[24585]: cluster 2024-09-16T05:56:42.421597+0000 mgr.a (mgr.14373) 853 : cluster [DBG] pgmap v591: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:56:43.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:56:43 smithi086 bash[24289]: cluster 2024-09-16T05:56:42.421597+0000 mgr.a (mgr.14373) 853 : cluster [DBG] pgmap v591: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:56:43.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:56:43 smithi047 bash[22744]: cluster 2024-09-16T05:56:42.421597+0000 mgr.a (mgr.14373) 853 : cluster [DBG] pgmap v591: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:56:44.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:56:44 smithi086 bash[24289]: cluster 2024-09-16T05:56:44.422405+0000 mgr.a (mgr.14373) 854 : cluster [DBG] pgmap v592: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T05:56:44.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:56:44 smithi047 bash[22744]: cluster 2024-09-16T05:56:44.422405+0000 mgr.a (mgr.14373) 854 : cluster [DBG] pgmap v592: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T05:56:45.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:56:44 smithi157 bash[24585]: cluster 2024-09-16T05:56:44.422405+0000 mgr.a (mgr.14373) 854 : cluster [DBG] pgmap v592: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T05:56:46.551 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:56:46 smithi157 bash[24585]: audit 2024-09-16T05:56:46.095588+0000 mon.b (mon.2) 126 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T05:56:46.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:56:46 smithi086 bash[24289]: audit 2024-09-16T05:56:46.095588+0000 mon.b (mon.2) 126 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T05:56:46.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:56:46 smithi047 bash[22744]: audit 2024-09-16T05:56:46.095588+0000 mon.b (mon.2) 126 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T05:56:46.706 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T05:56:46.706 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T05:56:46.706 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T05:56:47.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:56:47 smithi157 bash[24585]: cluster 2024-09-16T05:56:46.424282+0000 mgr.a (mgr.14373) 855 : cluster [DBG] pgmap v593: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:56:47.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:56:47 smithi157 bash[24585]: audit 2024-09-16T05:56:46.946760+0000 mon.b (mon.2) 127 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T05:56:47.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:56:47 smithi157 bash[24585]: audit 2024-09-16T05:56:46.948841+0000 mon.b (mon.2) 128 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T05:56:47.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:56:47 smithi157 bash[24585]: audit 2024-09-16T05:56:46.963844+0000 mon.a (mon.0) 617 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T05:56:47.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:56:47 smithi157 bash[24585]: audit 2024-09-16T05:56:46.965100+0000 mon.b (mon.2) 129 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T05:56:47.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:56:47 smithi086 bash[24289]: cluster 2024-09-16T05:56:46.424282+0000 mgr.a (mgr.14373) 855 : cluster [DBG] pgmap v593: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:56:47.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:56:47 smithi086 bash[24289]: audit 2024-09-16T05:56:46.946760+0000 mon.b (mon.2) 127 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T05:56:47.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:56:47 smithi086 bash[24289]: audit 2024-09-16T05:56:46.948841+0000 mon.b (mon.2) 128 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T05:56:47.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:56:47 smithi086 bash[24289]: audit 2024-09-16T05:56:46.963844+0000 mon.a (mon.0) 617 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T05:56:47.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:56:47 smithi086 bash[24289]: audit 2024-09-16T05:56:46.965100+0000 mon.b (mon.2) 129 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T05:56:47.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:56:47 smithi047 bash[22744]: cluster 2024-09-16T05:56:46.424282+0000 mgr.a (mgr.14373) 855 : cluster [DBG] pgmap v593: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:56:47.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:56:47 smithi047 bash[22744]: audit 2024-09-16T05:56:46.946760+0000 mon.b (mon.2) 127 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T05:56:47.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:56:47 smithi047 bash[22744]: audit 2024-09-16T05:56:46.948841+0000 mon.b (mon.2) 128 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T05:56:47.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:56:47 smithi047 bash[22744]: audit 2024-09-16T05:56:46.963844+0000 mon.a (mon.0) 617 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T05:56:47.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:56:47 smithi047 bash[22744]: audit 2024-09-16T05:56:46.965100+0000 mon.b (mon.2) 129 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T05:56:48.049 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T05:56:48.050 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T05:56:48.050 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T05:56:48.050 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T05:56:48.050 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T05:56:48.087 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 05:56:47 smithi047 bash[22994]: debug 2024-09-16T05:56:47.656+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T05:56:48.087 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 05:56:47 smithi047 bash[22994]: debug 2024-09-16T05:56:47.668+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T05:56:48.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:56:48 smithi157 bash[24585]: audit 2024-09-16T05:56:46.971672+0000 mgr.a (mgr.14373) 856 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T05:56:48.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:56:48 smithi157 bash[24585]: audit 2024-09-16T05:56:47.035586+0000 mgr.a (mgr.14373) 857 : audit [DBG] from='client.31788 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:56:48.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:56:48 smithi086 bash[24289]: audit 2024-09-16T05:56:46.971672+0000 mgr.a (mgr.14373) 856 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T05:56:48.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:56:48 smithi086 bash[24289]: audit 2024-09-16T05:56:47.035586+0000 mgr.a (mgr.14373) 857 : audit [DBG] from='client.31788 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:56:48.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:56:48 smithi047 bash[22744]: audit 2024-09-16T05:56:46.971672+0000 mgr.a (mgr.14373) 856 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T05:56:48.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:56:48 smithi047 bash[22744]: audit 2024-09-16T05:56:47.035586+0000 mgr.a (mgr.14373) 857 : audit [DBG] from='client.31788 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:56:49.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:56:49 smithi157 bash[24585]: audit 2024-09-16T05:56:47.660359+0000 mgr.a (mgr.14373) 858 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T05:56:49.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:56:49 smithi157 bash[24585]: cephadm 2024-09-16T05:56:47.671838+0000 mgr.a (mgr.14373) 859 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T05:56:49.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:56:49 smithi157 bash[24585]: cluster 2024-09-16T05:56:48.425237+0000 mgr.a (mgr.14373) 860 : cluster [DBG] pgmap v594: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T05:56:49.572 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:56:49 smithi086 bash[24289]: audit 2024-09-16T05:56:47.660359+0000 mgr.a (mgr.14373) 858 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T05:56:49.573 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:56:49 smithi086 bash[24289]: cephadm 2024-09-16T05:56:47.671838+0000 mgr.a (mgr.14373) 859 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T05:56:49.573 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:56:49 smithi086 bash[24289]: cluster 2024-09-16T05:56:48.425237+0000 mgr.a (mgr.14373) 860 : cluster [DBG] pgmap v594: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T05:56:49.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:56:49 smithi047 bash[22744]: audit 2024-09-16T05:56:47.660359+0000 mgr.a (mgr.14373) 858 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T05:56:49.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:56:49 smithi047 bash[22744]: cephadm 2024-09-16T05:56:47.671838+0000 mgr.a (mgr.14373) 859 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T05:56:49.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:56:49 smithi047 bash[22744]: cluster 2024-09-16T05:56:48.425237+0000 mgr.a (mgr.14373) 860 : cluster [DBG] pgmap v594: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T05:56:51.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:56:51 smithi157 bash[24585]: cluster 2024-09-16T05:56:50.425997+0000 mgr.a (mgr.14373) 861 : cluster [DBG] pgmap v595: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T05:56:51.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:56:51 smithi086 bash[24289]: cluster 2024-09-16T05:56:50.425997+0000 mgr.a (mgr.14373) 861 : cluster [DBG] pgmap v595: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T05:56:51.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:56:51 smithi047 bash[22744]: cluster 2024-09-16T05:56:50.425997+0000 mgr.a (mgr.14373) 861 : cluster [DBG] pgmap v595: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T05:56:53.051 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T05:56:53.051 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T05:56:53.052 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T05:56:53.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:56:53 smithi157 bash[24585]: cluster 2024-09-16T05:56:52.428190+0000 mgr.a (mgr.14373) 862 : cluster [DBG] pgmap v596: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T05:56:53.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:56:53 smithi086 bash[24289]: cluster 2024-09-16T05:56:52.428190+0000 mgr.a (mgr.14373) 862 : cluster [DBG] pgmap v596: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T05:56:53.833 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T05:56:53.833 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T05:56:53.833 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T05:56:53.833 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T05:56:53.833 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T05:56:53.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:56:53 smithi047 bash[22744]: cluster 2024-09-16T05:56:52.428190+0000 mgr.a (mgr.14373) 862 : cluster [DBG] pgmap v596: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T05:56:54.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:56:54 smithi157 bash[24585]: audit 2024-09-16T05:56:53.392751+0000 mgr.a (mgr.14373) 863 : audit [DBG] from='client.31974 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:56:54.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:56:54 smithi086 bash[24289]: audit 2024-09-16T05:56:53.392751+0000 mgr.a (mgr.14373) 863 : audit [DBG] from='client.31974 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:56:54.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:56:54 smithi047 bash[22744]: audit 2024-09-16T05:56:53.392751+0000 mgr.a (mgr.14373) 863 : audit [DBG] from='client.31974 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:56:55.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:56:55 smithi157 bash[24585]: cluster 2024-09-16T05:56:54.429062+0000 mgr.a (mgr.14373) 864 : cluster [DBG] pgmap v597: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T05:56:55.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:56:55 smithi086 bash[24289]: cluster 2024-09-16T05:56:54.429062+0000 mgr.a (mgr.14373) 864 : cluster [DBG] pgmap v597: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T05:56:55.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:56:55 smithi047 bash[22744]: cluster 2024-09-16T05:56:54.429062+0000 mgr.a (mgr.14373) 864 : cluster [DBG] pgmap v597: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T05:56:57.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:56:57 smithi157 bash[24585]: cluster 2024-09-16T05:56:56.431184+0000 mgr.a (mgr.14373) 865 : cluster [DBG] pgmap v598: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T05:56:57.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:56:57 smithi086 bash[24289]: cluster 2024-09-16T05:56:56.431184+0000 mgr.a (mgr.14373) 865 : cluster [DBG] pgmap v598: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T05:56:57.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:56:57 smithi047 bash[22744]: cluster 2024-09-16T05:56:56.431184+0000 mgr.a (mgr.14373) 865 : cluster [DBG] pgmap v598: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T05:56:58.834 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T05:56:58.835 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T05:56:58.835 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T05:56:59.596 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T05:56:59.596 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T05:56:59.596 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T05:56:59.597 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T05:56:59.597 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T05:56:59.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:56:59 smithi157 bash[24585]: cluster 2024-09-16T05:56:58.431946+0000 mgr.a (mgr.14373) 866 : cluster [DBG] pgmap v599: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T05:56:59.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:56:59 smithi086 bash[24289]: cluster 2024-09-16T05:56:58.431946+0000 mgr.a (mgr.14373) 866 : cluster [DBG] pgmap v599: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T05:56:59.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:56:59 smithi047 bash[22744]: cluster 2024-09-16T05:56:58.431946+0000 mgr.a (mgr.14373) 866 : cluster [DBG] pgmap v599: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T05:57:00.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:57:00 smithi157 bash[24585]: audit 2024-09-16T05:56:59.177425+0000 mgr.a (mgr.14373) 867 : audit [DBG] from='client.32052 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:57:00.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:57:00 smithi086 bash[24289]: audit 2024-09-16T05:56:59.177425+0000 mgr.a (mgr.14373) 867 : audit [DBG] from='client.32052 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:57:00.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:57:00 smithi047 bash[22744]: audit 2024-09-16T05:56:59.177425+0000 mgr.a (mgr.14373) 867 : audit [DBG] from='client.32052 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:57:01.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:57:01 smithi157 bash[24585]: cluster 2024-09-16T05:57:00.432841+0000 mgr.a (mgr.14373) 868 : cluster [DBG] pgmap v600: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T05:57:01.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:57:01 smithi086 bash[24289]: cluster 2024-09-16T05:57:00.432841+0000 mgr.a (mgr.14373) 868 : cluster [DBG] pgmap v600: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T05:57:01.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:57:01 smithi047 bash[22744]: cluster 2024-09-16T05:57:00.432841+0000 mgr.a (mgr.14373) 868 : cluster [DBG] pgmap v600: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T05:57:03.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:57:03 smithi157 bash[24585]: cluster 2024-09-16T05:57:02.435115+0000 mgr.a (mgr.14373) 869 : cluster [DBG] pgmap v601: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T05:57:03.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:57:03 smithi086 bash[24289]: cluster 2024-09-16T05:57:02.435115+0000 mgr.a (mgr.14373) 869 : cluster [DBG] pgmap v601: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T05:57:03.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:57:03 smithi047 bash[22744]: cluster 2024-09-16T05:57:02.435115+0000 mgr.a (mgr.14373) 869 : cluster [DBG] pgmap v601: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T05:57:04.598 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T05:57:04.599 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T05:57:04.599 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T05:57:05.360 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T05:57:05.360 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T05:57:05.360 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T05:57:05.360 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T05:57:05.360 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T05:57:05.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:57:05 smithi157 bash[24585]: cluster 2024-09-16T05:57:04.435840+0000 mgr.a (mgr.14373) 870 : cluster [DBG] pgmap v602: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:57:05.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:57:05 smithi086 bash[24289]: cluster 2024-09-16T05:57:04.435840+0000 mgr.a (mgr.14373) 870 : cluster [DBG] pgmap v602: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:57:05.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:57:05 smithi047 bash[22744]: cluster 2024-09-16T05:57:04.435840+0000 mgr.a (mgr.14373) 870 : cluster [DBG] pgmap v602: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:57:06.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:57:06 smithi157 bash[24585]: audit 2024-09-16T05:57:04.941249+0000 mgr.a (mgr.14373) 871 : audit [DBG] from='client.32127 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:57:06.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:57:06 smithi086 bash[24289]: audit 2024-09-16T05:57:04.941249+0000 mgr.a (mgr.14373) 871 : audit [DBG] from='client.32127 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:57:06.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:57:06 smithi047 bash[22744]: audit 2024-09-16T05:57:04.941249+0000 mgr.a (mgr.14373) 871 : audit [DBG] from='client.32127 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:57:07.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:57:07 smithi157 bash[24585]: cluster 2024-09-16T05:57:06.438038+0000 mgr.a (mgr.14373) 872 : cluster [DBG] pgmap v603: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:57:07.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:57:07 smithi086 bash[24289]: cluster 2024-09-16T05:57:06.438038+0000 mgr.a (mgr.14373) 872 : cluster [DBG] pgmap v603: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:57:07.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:57:07 smithi047 bash[22744]: cluster 2024-09-16T05:57:06.438038+0000 mgr.a (mgr.14373) 872 : cluster [DBG] pgmap v603: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:57:09.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:57:09 smithi157 bash[24585]: cluster 2024-09-16T05:57:08.438824+0000 mgr.a (mgr.14373) 873 : cluster [DBG] pgmap v604: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:57:09.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:57:09 smithi086 bash[24289]: cluster 2024-09-16T05:57:08.438824+0000 mgr.a (mgr.14373) 873 : cluster [DBG] pgmap v604: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:57:09.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:57:09 smithi047 bash[22744]: cluster 2024-09-16T05:57:08.438824+0000 mgr.a (mgr.14373) 873 : cluster [DBG] pgmap v604: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:57:10.361 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T05:57:10.362 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T05:57:10.362 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T05:57:11.114 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T05:57:11.114 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T05:57:11.114 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T05:57:11.114 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T05:57:11.114 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T05:57:11.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:57:11 smithi157 bash[24585]: cluster 2024-09-16T05:57:10.439579+0000 mgr.a (mgr.14373) 874 : cluster [DBG] pgmap v605: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:57:11.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:57:11 smithi086 bash[24289]: cluster 2024-09-16T05:57:10.439579+0000 mgr.a (mgr.14373) 874 : cluster [DBG] pgmap v605: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:57:11.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:57:11 smithi047 bash[22744]: cluster 2024-09-16T05:57:10.439579+0000 mgr.a (mgr.14373) 874 : cluster [DBG] pgmap v605: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:57:12.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:57:12 smithi086 bash[24289]: audit 2024-09-16T05:57:10.698430+0000 mgr.a (mgr.14373) 875 : audit [DBG] from='client.32205 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:57:12.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:57:12 smithi047 bash[22744]: audit 2024-09-16T05:57:10.698430+0000 mgr.a (mgr.14373) 875 : audit [DBG] from='client.32205 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:57:13.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:57:12 smithi157 bash[24585]: audit 2024-09-16T05:57:10.698430+0000 mgr.a (mgr.14373) 875 : audit [DBG] from='client.32205 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:57:13.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:57:13 smithi086 bash[24289]: cluster 2024-09-16T05:57:12.441931+0000 mgr.a (mgr.14373) 876 : cluster [DBG] pgmap v606: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:57:13.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:57:13 smithi047 bash[22744]: cluster 2024-09-16T05:57:12.441931+0000 mgr.a (mgr.14373) 876 : cluster [DBG] pgmap v606: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:57:14.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:57:13 smithi157 bash[24585]: cluster 2024-09-16T05:57:12.441931+0000 mgr.a (mgr.14373) 876 : cluster [DBG] pgmap v606: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:57:14.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:57:14 smithi086 bash[24289]: cluster 2024-09-16T05:57:14.442744+0000 mgr.a (mgr.14373) 877 : cluster [DBG] pgmap v607: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:57:14.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:57:14 smithi047 bash[22744]: cluster 2024-09-16T05:57:14.442744+0000 mgr.a (mgr.14373) 877 : cluster [DBG] pgmap v607: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:57:15.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:57:14 smithi157 bash[24585]: cluster 2024-09-16T05:57:14.442744+0000 mgr.a (mgr.14373) 877 : cluster [DBG] pgmap v607: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:57:16.114 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T05:57:16.115 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T05:57:16.115 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T05:57:16.885 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T05:57:16.885 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T05:57:16.885 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T05:57:16.885 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T05:57:16.885 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T05:57:17.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:57:17 smithi157 bash[24585]: cluster 2024-09-16T05:57:16.443952+0000 mgr.a (mgr.14373) 878 : cluster [DBG] pgmap v608: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:57:17.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:57:17 smithi157 bash[24585]: audit 2024-09-16T05:57:16.455639+0000 mgr.a (mgr.14373) 879 : audit [DBG] from='client.32283 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:57:17.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:57:17 smithi086 bash[24289]: cluster 2024-09-16T05:57:16.443952+0000 mgr.a (mgr.14373) 878 : cluster [DBG] pgmap v608: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:57:17.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:57:17 smithi086 bash[24289]: audit 2024-09-16T05:57:16.455639+0000 mgr.a (mgr.14373) 879 : audit [DBG] from='client.32283 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:57:17.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:57:17 smithi047 bash[22744]: cluster 2024-09-16T05:57:16.443952+0000 mgr.a (mgr.14373) 878 : cluster [DBG] pgmap v608: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:57:17.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:57:17 smithi047 bash[22744]: audit 2024-09-16T05:57:16.455639+0000 mgr.a (mgr.14373) 879 : audit [DBG] from='client.32283 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:57:19.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:57:19 smithi157 bash[24585]: cluster 2024-09-16T05:57:18.444782+0000 mgr.a (mgr.14373) 880 : cluster [DBG] pgmap v609: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T05:57:19.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:57:19 smithi086 bash[24289]: cluster 2024-09-16T05:57:18.444782+0000 mgr.a (mgr.14373) 880 : cluster [DBG] pgmap v609: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T05:57:19.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:57:19 smithi047 bash[22744]: cluster 2024-09-16T05:57:18.444782+0000 mgr.a (mgr.14373) 880 : cluster [DBG] pgmap v609: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T05:57:21.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:57:21 smithi157 bash[24585]: cluster 2024-09-16T05:57:20.445546+0000 mgr.a (mgr.14373) 881 : cluster [DBG] pgmap v610: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T05:57:21.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:57:21 smithi086 bash[24289]: cluster 2024-09-16T05:57:20.445546+0000 mgr.a (mgr.14373) 881 : cluster [DBG] pgmap v610: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T05:57:21.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:57:21 smithi047 bash[22744]: cluster 2024-09-16T05:57:20.445546+0000 mgr.a (mgr.14373) 881 : cluster [DBG] pgmap v610: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T05:57:21.886 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T05:57:21.887 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T05:57:21.887 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T05:57:22.631 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T05:57:22.631 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T05:57:22.631 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T05:57:22.631 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T05:57:22.631 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T05:57:23.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:57:23 smithi157 bash[24585]: audit 2024-09-16T05:57:22.225171+0000 mgr.a (mgr.14373) 882 : audit [DBG] from='client.32361 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:57:23.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:57:23 smithi157 bash[24585]: cluster 2024-09-16T05:57:22.447742+0000 mgr.a (mgr.14373) 883 : cluster [DBG] pgmap v611: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:57:23.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:57:23 smithi086 bash[24289]: audit 2024-09-16T05:57:22.225171+0000 mgr.a (mgr.14373) 882 : audit [DBG] from='client.32361 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:57:23.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:57:23 smithi086 bash[24289]: cluster 2024-09-16T05:57:22.447742+0000 mgr.a (mgr.14373) 883 : cluster [DBG] pgmap v611: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:57:23.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:57:23 smithi047 bash[22744]: audit 2024-09-16T05:57:22.225171+0000 mgr.a (mgr.14373) 882 : audit [DBG] from='client.32361 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:57:23.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:57:23 smithi047 bash[22744]: cluster 2024-09-16T05:57:22.447742+0000 mgr.a (mgr.14373) 883 : cluster [DBG] pgmap v611: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:57:25.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:57:25 smithi157 bash[24585]: cluster 2024-09-16T05:57:24.448629+0000 mgr.a (mgr.14373) 884 : cluster [DBG] pgmap v612: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T05:57:25.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:57:25 smithi086 bash[24289]: cluster 2024-09-16T05:57:24.448629+0000 mgr.a (mgr.14373) 884 : cluster [DBG] pgmap v612: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T05:57:25.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:57:25 smithi047 bash[22744]: cluster 2024-09-16T05:57:24.448629+0000 mgr.a (mgr.14373) 884 : cluster [DBG] pgmap v612: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T05:57:27.633 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T05:57:27.633 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T05:57:27.633 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T05:57:27.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:57:27 smithi157 bash[24585]: cluster 2024-09-16T05:57:26.450770+0000 mgr.a (mgr.14373) 885 : cluster [DBG] pgmap v613: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:57:27.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:57:27 smithi086 bash[24289]: cluster 2024-09-16T05:57:26.450770+0000 mgr.a (mgr.14373) 885 : cluster [DBG] pgmap v613: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:57:27.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:57:27 smithi047 bash[22744]: cluster 2024-09-16T05:57:26.450770+0000 mgr.a (mgr.14373) 885 : cluster [DBG] pgmap v613: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:57:28.413 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T05:57:28.414 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T05:57:28.414 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T05:57:28.414 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T05:57:28.414 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T05:57:29.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:57:29 smithi157 bash[24585]: audit 2024-09-16T05:57:27.979156+0000 mgr.a (mgr.14373) 886 : audit [DBG] from='client.32436 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:57:29.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:57:29 smithi157 bash[24585]: cluster 2024-09-16T05:57:28.451726+0000 mgr.a (mgr.14373) 887 : cluster [DBG] pgmap v614: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:57:29.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:57:29 smithi086 bash[24289]: audit 2024-09-16T05:57:27.979156+0000 mgr.a (mgr.14373) 886 : audit [DBG] from='client.32436 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:57:29.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:57:29 smithi086 bash[24289]: cluster 2024-09-16T05:57:28.451726+0000 mgr.a (mgr.14373) 887 : cluster [DBG] pgmap v614: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:57:29.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:57:29 smithi047 bash[22744]: audit 2024-09-16T05:57:27.979156+0000 mgr.a (mgr.14373) 886 : audit [DBG] from='client.32436 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:57:29.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:57:29 smithi047 bash[22744]: cluster 2024-09-16T05:57:28.451726+0000 mgr.a (mgr.14373) 887 : cluster [DBG] pgmap v614: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:57:31.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:57:31 smithi157 bash[24585]: cluster 2024-09-16T05:57:30.452640+0000 mgr.a (mgr.14373) 888 : cluster [DBG] pgmap v615: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:57:31.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:57:31 smithi086 bash[24289]: cluster 2024-09-16T05:57:30.452640+0000 mgr.a (mgr.14373) 888 : cluster [DBG] pgmap v615: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:57:31.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:57:31 smithi047 bash[22744]: cluster 2024-09-16T05:57:30.452640+0000 mgr.a (mgr.14373) 888 : cluster [DBG] pgmap v615: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:57:33.415 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T05:57:33.416 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T05:57:33.416 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T05:57:33.801 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:57:33 smithi157 bash[24585]: cluster 2024-09-16T05:57:32.454885+0000 mgr.a (mgr.14373) 889 : cluster [DBG] pgmap v616: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:57:33.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:57:33 smithi086 bash[24289]: cluster 2024-09-16T05:57:32.454885+0000 mgr.a (mgr.14373) 889 : cluster [DBG] pgmap v616: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:57:33.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:57:33 smithi047 bash[22744]: cluster 2024-09-16T05:57:32.454885+0000 mgr.a (mgr.14373) 889 : cluster [DBG] pgmap v616: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:57:34.187 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T05:57:34.187 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T05:57:34.187 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T05:57:34.187 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T05:57:34.187 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T05:57:35.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:57:35 smithi157 bash[24585]: audit 2024-09-16T05:57:33.755305+0000 mgr.a (mgr.14373) 890 : audit [DBG] from='client.32514 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:57:35.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:57:35 smithi157 bash[24585]: cluster 2024-09-16T05:57:34.455735+0000 mgr.a (mgr.14373) 891 : cluster [DBG] pgmap v617: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:57:35.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:57:35 smithi086 bash[24289]: audit 2024-09-16T05:57:33.755305+0000 mgr.a (mgr.14373) 890 : audit [DBG] from='client.32514 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:57:35.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:57:35 smithi086 bash[24289]: cluster 2024-09-16T05:57:34.455735+0000 mgr.a (mgr.14373) 891 : cluster [DBG] pgmap v617: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:57:35.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:57:35 smithi047 bash[22744]: audit 2024-09-16T05:57:33.755305+0000 mgr.a (mgr.14373) 890 : audit [DBG] from='client.32514 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:57:35.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:57:35 smithi047 bash[22744]: cluster 2024-09-16T05:57:34.455735+0000 mgr.a (mgr.14373) 891 : cluster [DBG] pgmap v617: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:57:37.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:57:37 smithi157 bash[24585]: cluster 2024-09-16T05:57:36.457860+0000 mgr.a (mgr.14373) 892 : cluster [DBG] pgmap v618: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:57:37.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:57:37 smithi086 bash[24289]: cluster 2024-09-16T05:57:36.457860+0000 mgr.a (mgr.14373) 892 : cluster [DBG] pgmap v618: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:57:37.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:57:37 smithi047 bash[22744]: cluster 2024-09-16T05:57:36.457860+0000 mgr.a (mgr.14373) 892 : cluster [DBG] pgmap v618: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:57:39.188 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T05:57:39.189 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T05:57:39.189 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T05:57:39.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:57:39 smithi157 bash[24585]: cluster 2024-09-16T05:57:38.458625+0000 mgr.a (mgr.14373) 893 : cluster [DBG] pgmap v619: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:57:39.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:57:39 smithi086 bash[24289]: cluster 2024-09-16T05:57:38.458625+0000 mgr.a (mgr.14373) 893 : cluster [DBG] pgmap v619: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:57:39.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:57:39 smithi047 bash[22744]: cluster 2024-09-16T05:57:38.458625+0000 mgr.a (mgr.14373) 893 : cluster [DBG] pgmap v619: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:57:39.948 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T05:57:39.948 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T05:57:39.948 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T05:57:39.949 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T05:57:39.949 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T05:57:40.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:57:40 smithi157 bash[24585]: audit 2024-09-16T05:57:39.523676+0000 mgr.a (mgr.14373) 894 : audit [DBG] from='client.32589 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:57:40.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:57:40 smithi086 bash[24289]: audit 2024-09-16T05:57:39.523676+0000 mgr.a (mgr.14373) 894 : audit [DBG] from='client.32589 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:57:40.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:57:40 smithi047 bash[22744]: audit 2024-09-16T05:57:39.523676+0000 mgr.a (mgr.14373) 894 : audit [DBG] from='client.32589 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:57:41.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:57:41 smithi086 bash[24289]: cluster 2024-09-16T05:57:40.459663+0000 mgr.a (mgr.14373) 895 : cluster [DBG] pgmap v620: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:57:41.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:57:41 smithi047 bash[22744]: cluster 2024-09-16T05:57:40.459663+0000 mgr.a (mgr.14373) 895 : cluster [DBG] pgmap v620: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:57:42.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:57:41 smithi157 bash[24585]: cluster 2024-09-16T05:57:40.459663+0000 mgr.a (mgr.14373) 895 : cluster [DBG] pgmap v620: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:57:43.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:57:43 smithi086 bash[24289]: cluster 2024-09-16T05:57:42.462007+0000 mgr.a (mgr.14373) 896 : cluster [DBG] pgmap v621: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:57:43.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:57:43 smithi047 bash[22744]: cluster 2024-09-16T05:57:42.462007+0000 mgr.a (mgr.14373) 896 : cluster [DBG] pgmap v621: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:57:44.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:57:43 smithi157 bash[24585]: cluster 2024-09-16T05:57:42.462007+0000 mgr.a (mgr.14373) 896 : cluster [DBG] pgmap v621: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:57:44.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:57:44 smithi086 bash[24289]: cluster 2024-09-16T05:57:44.462823+0000 mgr.a (mgr.14373) 897 : cluster [DBG] pgmap v622: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:57:44.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:57:44 smithi047 bash[22744]: cluster 2024-09-16T05:57:44.462823+0000 mgr.a (mgr.14373) 897 : cluster [DBG] pgmap v622: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:57:44.949 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T05:57:44.950 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T05:57:44.950 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T05:57:45.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:57:44 smithi157 bash[24585]: cluster 2024-09-16T05:57:44.462823+0000 mgr.a (mgr.14373) 897 : cluster [DBG] pgmap v622: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:57:45.722 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T05:57:45.722 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T05:57:45.722 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T05:57:45.722 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T05:57:45.722 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T05:57:45.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:57:45 smithi086 bash[24289]: audit 2024-09-16T05:57:45.296182+0000 mgr.a (mgr.14373) 898 : audit [DBG] from='client.32664 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:57:45.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:57:45 smithi047 bash[22744]: audit 2024-09-16T05:57:45.296182+0000 mgr.a (mgr.14373) 898 : audit [DBG] from='client.32664 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:57:46.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:57:45 smithi157 bash[24585]: audit 2024-09-16T05:57:45.296182+0000 mgr.a (mgr.14373) 898 : audit [DBG] from='client.32664 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:57:46.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:57:46 smithi047 bash[22744]: cluster 2024-09-16T05:57:46.465056+0000 mgr.a (mgr.14373) 899 : cluster [DBG] pgmap v623: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:57:47.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:57:46 smithi157 bash[24585]: cluster 2024-09-16T05:57:46.465056+0000 mgr.a (mgr.14373) 899 : cluster [DBG] pgmap v623: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:57:47.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:57:46 smithi086 bash[24289]: cluster 2024-09-16T05:57:46.465056+0000 mgr.a (mgr.14373) 899 : cluster [DBG] pgmap v623: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:57:48.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:57:47 smithi157 bash[24585]: audit 2024-09-16T05:57:47.719717+0000 mon.b (mon.2) 130 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T05:57:48.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:57:47 smithi086 bash[24289]: audit 2024-09-16T05:57:47.719717+0000 mon.b (mon.2) 130 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T05:57:48.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:57:47 smithi047 bash[22744]: audit 2024-09-16T05:57:47.719717+0000 mon.b (mon.2) 130 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T05:57:49.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:57:48 smithi157 bash[24585]: cluster 2024-09-16T05:57:48.465770+0000 mgr.a (mgr.14373) 900 : cluster [DBG] pgmap v624: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:57:49.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:57:48 smithi157 bash[24585]: audit 2024-09-16T05:57:48.544384+0000 mon.b (mon.2) 131 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T05:57:49.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:57:48 smithi157 bash[24585]: audit 2024-09-16T05:57:48.545968+0000 mon.b (mon.2) 132 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T05:57:49.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:57:48 smithi157 bash[24585]: audit 2024-09-16T05:57:48.559958+0000 mon.a (mon.0) 618 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T05:57:49.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:57:48 smithi157 bash[24585]: audit 2024-09-16T05:57:48.561371+0000 mon.b (mon.2) 133 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T05:57:49.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:57:48 smithi086 bash[24289]: cluster 2024-09-16T05:57:48.465770+0000 mgr.a (mgr.14373) 900 : cluster [DBG] pgmap v624: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:57:49.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:57:48 smithi086 bash[24289]: audit 2024-09-16T05:57:48.544384+0000 mon.b (mon.2) 131 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T05:57:49.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:57:48 smithi086 bash[24289]: audit 2024-09-16T05:57:48.545968+0000 mon.b (mon.2) 132 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T05:57:49.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:57:48 smithi086 bash[24289]: audit 2024-09-16T05:57:48.559958+0000 mon.a (mon.0) 618 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T05:57:49.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:57:48 smithi086 bash[24289]: audit 2024-09-16T05:57:48.561371+0000 mon.b (mon.2) 133 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T05:57:49.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:57:48 smithi047 bash[22744]: cluster 2024-09-16T05:57:48.465770+0000 mgr.a (mgr.14373) 900 : cluster [DBG] pgmap v624: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:57:49.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:57:48 smithi047 bash[22744]: audit 2024-09-16T05:57:48.544384+0000 mon.b (mon.2) 131 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T05:57:49.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:57:48 smithi047 bash[22744]: audit 2024-09-16T05:57:48.545968+0000 mon.b (mon.2) 132 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T05:57:49.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:57:48 smithi047 bash[22744]: audit 2024-09-16T05:57:48.559958+0000 mon.a (mon.0) 618 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T05:57:49.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:57:48 smithi047 bash[22744]: audit 2024-09-16T05:57:48.561371+0000 mon.b (mon.2) 133 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T05:57:49.590 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 05:57:49 smithi047 bash[22994]: debug 2024-09-16T05:57:49.286+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T05:57:49.590 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 05:57:49 smithi047 bash[22994]: debug 2024-09-16T05:57:49.286+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T05:57:50.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:57:49 smithi157 bash[24585]: audit 2024-09-16T05:57:48.566984+0000 mgr.a (mgr.14373) 901 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T05:57:50.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:57:49 smithi157 bash[24585]: audit 2024-09-16T05:57:49.290800+0000 mgr.a (mgr.14373) 902 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T05:57:50.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:57:49 smithi157 bash[24585]: cephadm 2024-09-16T05:57:49.292931+0000 mgr.a (mgr.14373) 903 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T05:57:50.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:57:49 smithi086 bash[24289]: audit 2024-09-16T05:57:48.566984+0000 mgr.a (mgr.14373) 901 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T05:57:50.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:57:49 smithi086 bash[24289]: audit 2024-09-16T05:57:49.290800+0000 mgr.a (mgr.14373) 902 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T05:57:50.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:57:49 smithi086 bash[24289]: cephadm 2024-09-16T05:57:49.292931+0000 mgr.a (mgr.14373) 903 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T05:57:50.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:57:49 smithi047 bash[22744]: audit 2024-09-16T05:57:48.566984+0000 mgr.a (mgr.14373) 901 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T05:57:50.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:57:49 smithi047 bash[22744]: audit 2024-09-16T05:57:49.290800+0000 mgr.a (mgr.14373) 902 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T05:57:50.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:57:49 smithi047 bash[22744]: cephadm 2024-09-16T05:57:49.292931+0000 mgr.a (mgr.14373) 903 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T05:57:50.723 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T05:57:50.724 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T05:57:50.724 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T05:57:51.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:57:50 smithi157 bash[24585]: cluster 2024-09-16T05:57:50.466651+0000 mgr.a (mgr.14373) 904 : cluster [DBG] pgmap v625: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:57:51.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:57:50 smithi086 bash[24289]: cluster 2024-09-16T05:57:50.466651+0000 mgr.a (mgr.14373) 904 : cluster [DBG] pgmap v625: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:57:51.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:57:50 smithi047 bash[22744]: cluster 2024-09-16T05:57:50.466651+0000 mgr.a (mgr.14373) 904 : cluster [DBG] pgmap v625: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:57:51.480 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T05:57:51.481 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T05:57:51.481 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T05:57:51.481 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T05:57:51.481 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T05:57:52.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:57:51 smithi157 bash[24585]: audit 2024-09-16T05:57:51.065757+0000 mgr.a (mgr.14373) 905 : audit [DBG] from='client.32847 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:57:52.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:57:51 smithi086 bash[24289]: audit 2024-09-16T05:57:51.065757+0000 mgr.a (mgr.14373) 905 : audit [DBG] from='client.32847 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:57:52.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:57:51 smithi047 bash[22744]: audit 2024-09-16T05:57:51.065757+0000 mgr.a (mgr.14373) 905 : audit [DBG] from='client.32847 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:57:53.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:57:52 smithi086 bash[24289]: cluster 2024-09-16T05:57:52.469087+0000 mgr.a (mgr.14373) 906 : cluster [DBG] pgmap v626: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T05:57:53.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:57:52 smithi047 bash[22744]: cluster 2024-09-16T05:57:52.469087+0000 mgr.a (mgr.14373) 906 : cluster [DBG] pgmap v626: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T05:57:53.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:57:52 smithi157 bash[24585]: cluster 2024-09-16T05:57:52.469087+0000 mgr.a (mgr.14373) 906 : cluster [DBG] pgmap v626: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T05:57:55.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:57:55 smithi157 bash[24585]: cluster 2024-09-16T05:57:54.469893+0000 mgr.a (mgr.14373) 907 : cluster [DBG] pgmap v627: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T05:57:55.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:57:55 smithi086 bash[24289]: cluster 2024-09-16T05:57:54.469893+0000 mgr.a (mgr.14373) 907 : cluster [DBG] pgmap v627: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T05:57:55.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:57:55 smithi047 bash[22744]: cluster 2024-09-16T05:57:54.469893+0000 mgr.a (mgr.14373) 907 : cluster [DBG] pgmap v627: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T05:57:56.482 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T05:57:56.483 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T05:57:56.483 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T05:57:57.274 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T05:57:57.274 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T05:57:57.274 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T05:57:57.274 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T05:57:57.274 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T05:57:57.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:57:57 smithi157 bash[24585]: cluster 2024-09-16T05:57:56.471859+0000 mgr.a (mgr.14373) 908 : cluster [DBG] pgmap v628: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T05:57:57.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:57:57 smithi086 bash[24289]: cluster 2024-09-16T05:57:56.471859+0000 mgr.a (mgr.14373) 908 : cluster [DBG] pgmap v628: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T05:57:57.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:57:57 smithi047 bash[22744]: cluster 2024-09-16T05:57:56.471859+0000 mgr.a (mgr.14373) 908 : cluster [DBG] pgmap v628: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T05:57:58.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:57:58 smithi157 bash[24585]: audit 2024-09-16T05:57:56.832380+0000 mgr.a (mgr.14373) 909 : audit [DBG] from='client.32922 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:57:58.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:57:58 smithi086 bash[24289]: audit 2024-09-16T05:57:56.832380+0000 mgr.a (mgr.14373) 909 : audit [DBG] from='client.32922 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:57:58.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:57:58 smithi047 bash[22744]: audit 2024-09-16T05:57:56.832380+0000 mgr.a (mgr.14373) 909 : audit [DBG] from='client.32922 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:57:59.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:57:59 smithi157 bash[24585]: cluster 2024-09-16T05:57:58.472833+0000 mgr.a (mgr.14373) 910 : cluster [DBG] pgmap v629: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T05:57:59.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:57:59 smithi086 bash[24289]: cluster 2024-09-16T05:57:58.472833+0000 mgr.a (mgr.14373) 910 : cluster [DBG] pgmap v629: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T05:57:59.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:57:59 smithi047 bash[22744]: cluster 2024-09-16T05:57:58.472833+0000 mgr.a (mgr.14373) 910 : cluster [DBG] pgmap v629: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T05:58:01.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:58:01 smithi157 bash[24585]: cluster 2024-09-16T05:58:00.473630+0000 mgr.a (mgr.14373) 911 : cluster [DBG] pgmap v630: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T05:58:01.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:58:01 smithi086 bash[24289]: cluster 2024-09-16T05:58:00.473630+0000 mgr.a (mgr.14373) 911 : cluster [DBG] pgmap v630: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T05:58:01.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:58:01 smithi047 bash[22744]: cluster 2024-09-16T05:58:00.473630+0000 mgr.a (mgr.14373) 911 : cluster [DBG] pgmap v630: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T05:58:02.276 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T05:58:02.276 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T05:58:02.277 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T05:58:03.059 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T05:58:03.060 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T05:58:03.060 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T05:58:03.060 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T05:58:03.060 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T05:58:03.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:58:03 smithi157 bash[24585]: cluster 2024-09-16T05:58:02.475811+0000 mgr.a (mgr.14373) 912 : cluster [DBG] pgmap v631: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T05:58:03.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:58:03 smithi086 bash[24289]: cluster 2024-09-16T05:58:02.475811+0000 mgr.a (mgr.14373) 912 : cluster [DBG] pgmap v631: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T05:58:03.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:58:03 smithi047 bash[22744]: cluster 2024-09-16T05:58:02.475811+0000 mgr.a (mgr.14373) 912 : cluster [DBG] pgmap v631: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T05:58:04.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:58:04 smithi086 bash[24289]: audit 2024-09-16T05:58:02.614110+0000 mgr.a (mgr.14373) 913 : audit [DBG] from='client.32994 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:58:04.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:58:04 smithi047 bash[22744]: audit 2024-09-16T05:58:02.614110+0000 mgr.a (mgr.14373) 913 : audit [DBG] from='client.32994 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:58:05.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:58:04 smithi157 bash[24585]: audit 2024-09-16T05:58:02.614110+0000 mgr.a (mgr.14373) 913 : audit [DBG] from='client.32994 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:58:05.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:58:05 smithi086 bash[24289]: cluster 2024-09-16T05:58:04.476819+0000 mgr.a (mgr.14373) 914 : cluster [DBG] pgmap v632: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-16T05:58:05.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:58:05 smithi047 bash[22744]: cluster 2024-09-16T05:58:04.476819+0000 mgr.a (mgr.14373) 914 : cluster [DBG] pgmap v632: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-16T05:58:06.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:58:05 smithi157 bash[24585]: cluster 2024-09-16T05:58:04.476819+0000 mgr.a (mgr.14373) 914 : cluster [DBG] pgmap v632: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-16T05:58:07.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:58:07 smithi086 bash[24289]: cluster 2024-09-16T05:58:06.479007+0000 mgr.a (mgr.14373) 915 : cluster [DBG] pgmap v633: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 48 KiB/s rd, 0 B/s wr, 78 op/s 2024-09-16T05:58:07.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:58:07 smithi047 bash[22744]: cluster 2024-09-16T05:58:06.479007+0000 mgr.a (mgr.14373) 915 : cluster [DBG] pgmap v633: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 48 KiB/s rd, 0 B/s wr, 78 op/s 2024-09-16T05:58:08.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:58:07 smithi157 bash[24585]: cluster 2024-09-16T05:58:06.479007+0000 mgr.a (mgr.14373) 915 : cluster [DBG] pgmap v633: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 48 KiB/s rd, 0 B/s wr, 78 op/s 2024-09-16T05:58:08.061 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T05:58:08.062 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T05:58:08.062 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T05:58:08.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:58:08 smithi047 bash[22744]: audit 2024-09-16T05:58:08.401190+0000 mgr.a (mgr.14373) 916 : audit [DBG] from='client.33072 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:58:08.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:58:08 smithi047 bash[22744]: cluster 2024-09-16T05:58:08.479586+0000 mgr.a (mgr.14373) 917 : cluster [DBG] pgmap v634: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 48 KiB/s rd, 0 B/s wr, 78 op/s 2024-09-16T05:58:08.838 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T05:58:08.839 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T05:58:08.839 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T05:58:08.839 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T05:58:08.839 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T05:58:09.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:58:08 smithi157 bash[24585]: audit 2024-09-16T05:58:08.401190+0000 mgr.a (mgr.14373) 916 : audit [DBG] from='client.33072 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:58:09.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:58:08 smithi157 bash[24585]: cluster 2024-09-16T05:58:08.479586+0000 mgr.a (mgr.14373) 917 : cluster [DBG] pgmap v634: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 48 KiB/s rd, 0 B/s wr, 78 op/s 2024-09-16T05:58:09.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:58:08 smithi086 bash[24289]: audit 2024-09-16T05:58:08.401190+0000 mgr.a (mgr.14373) 916 : audit [DBG] from='client.33072 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:58:09.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:58:08 smithi086 bash[24289]: cluster 2024-09-16T05:58:08.479586+0000 mgr.a (mgr.14373) 917 : cluster [DBG] pgmap v634: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 48 KiB/s rd, 0 B/s wr, 78 op/s 2024-09-16T05:58:11.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:58:11 smithi157 bash[24585]: cluster 2024-09-16T05:58:10.480574+0000 mgr.a (mgr.14373) 918 : cluster [DBG] pgmap v635: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 48 KiB/s rd, 0 B/s wr, 78 op/s 2024-09-16T05:58:11.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:58:11 smithi086 bash[24289]: cluster 2024-09-16T05:58:10.480574+0000 mgr.a (mgr.14373) 918 : cluster [DBG] pgmap v635: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 48 KiB/s rd, 0 B/s wr, 78 op/s 2024-09-16T05:58:11.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:58:11 smithi047 bash[22744]: cluster 2024-09-16T05:58:10.480574+0000 mgr.a (mgr.14373) 918 : cluster [DBG] pgmap v635: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 48 KiB/s rd, 0 B/s wr, 78 op/s 2024-09-16T05:58:13.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:58:13 smithi157 bash[24585]: cluster 2024-09-16T05:58:12.482851+0000 mgr.a (mgr.14373) 919 : cluster [DBG] pgmap v636: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 49 KiB/s rd, 0 B/s wr, 79 op/s 2024-09-16T05:58:13.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:58:13 smithi086 bash[24289]: cluster 2024-09-16T05:58:12.482851+0000 mgr.a (mgr.14373) 919 : cluster [DBG] pgmap v636: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 49 KiB/s rd, 0 B/s wr, 79 op/s 2024-09-16T05:58:13.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:58:13 smithi047 bash[22744]: cluster 2024-09-16T05:58:12.482851+0000 mgr.a (mgr.14373) 919 : cluster [DBG] pgmap v636: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 49 KiB/s rd, 0 B/s wr, 79 op/s 2024-09-16T05:58:13.840 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T05:58:13.841 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T05:58:13.841 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T05:58:14.609 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T05:58:14.609 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T05:58:14.610 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T05:58:14.610 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T05:58:14.610 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T05:58:15.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:58:15 smithi157 bash[24585]: audit 2024-09-16T05:58:14.177673+0000 mgr.a (mgr.14373) 920 : audit [DBG] from='client.33147 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:58:15.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:58:15 smithi157 bash[24585]: cluster 2024-09-16T05:58:14.483338+0000 mgr.a (mgr.14373) 921 : cluster [DBG] pgmap v637: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 48 KiB/s rd, 0 B/s wr, 78 op/s 2024-09-16T05:58:15.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:58:15 smithi086 bash[24289]: audit 2024-09-16T05:58:14.177673+0000 mgr.a (mgr.14373) 920 : audit [DBG] from='client.33147 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:58:15.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:58:15 smithi086 bash[24289]: cluster 2024-09-16T05:58:14.483338+0000 mgr.a (mgr.14373) 921 : cluster [DBG] pgmap v637: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 48 KiB/s rd, 0 B/s wr, 78 op/s 2024-09-16T05:58:15.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:58:15 smithi047 bash[22744]: audit 2024-09-16T05:58:14.177673+0000 mgr.a (mgr.14373) 920 : audit [DBG] from='client.33147 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:58:15.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:58:15 smithi047 bash[22744]: cluster 2024-09-16T05:58:14.483338+0000 mgr.a (mgr.14373) 921 : cluster [DBG] pgmap v637: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 48 KiB/s rd, 0 B/s wr, 78 op/s 2024-09-16T05:58:17.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:58:17 smithi157 bash[24585]: cluster 2024-09-16T05:58:16.485587+0000 mgr.a (mgr.14373) 922 : cluster [DBG] pgmap v638: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 49 KiB/s rd, 0 B/s wr, 79 op/s 2024-09-16T05:58:17.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:58:17 smithi086 bash[24289]: cluster 2024-09-16T05:58:16.485587+0000 mgr.a (mgr.14373) 922 : cluster [DBG] pgmap v638: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 49 KiB/s rd, 0 B/s wr, 79 op/s 2024-09-16T05:58:17.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:58:17 smithi047 bash[22744]: cluster 2024-09-16T05:58:16.485587+0000 mgr.a (mgr.14373) 922 : cluster [DBG] pgmap v638: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 49 KiB/s rd, 0 B/s wr, 79 op/s 2024-09-16T05:58:19.611 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T05:58:19.611 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T05:58:19.611 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T05:58:19.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:58:19 smithi157 bash[24585]: cluster 2024-09-16T05:58:18.486393+0000 mgr.a (mgr.14373) 923 : cluster [DBG] pgmap v639: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:58:19.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:58:19 smithi086 bash[24289]: cluster 2024-09-16T05:58:18.486393+0000 mgr.a (mgr.14373) 923 : cluster [DBG] pgmap v639: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:58:19.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:58:19 smithi047 bash[22744]: cluster 2024-09-16T05:58:18.486393+0000 mgr.a (mgr.14373) 923 : cluster [DBG] pgmap v639: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:58:20.360 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T05:58:20.361 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T05:58:20.361 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T05:58:20.361 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T05:58:20.361 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T05:58:21.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:58:21 smithi086 bash[24289]: audit 2024-09-16T05:58:19.947274+0000 mgr.a (mgr.14373) 924 : audit [DBG] from='client.33222 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:58:21.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:58:21 smithi086 bash[24289]: cluster 2024-09-16T05:58:20.487331+0000 mgr.a (mgr.14373) 925 : cluster [DBG] pgmap v640: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:58:21.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:58:21 smithi047 bash[22744]: audit 2024-09-16T05:58:19.947274+0000 mgr.a (mgr.14373) 924 : audit [DBG] from='client.33222 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:58:21.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:58:21 smithi047 bash[22744]: cluster 2024-09-16T05:58:20.487331+0000 mgr.a (mgr.14373) 925 : cluster [DBG] pgmap v640: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:58:22.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:58:21 smithi157 bash[24585]: audit 2024-09-16T05:58:19.947274+0000 mgr.a (mgr.14373) 924 : audit [DBG] from='client.33222 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:58:22.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:58:21 smithi157 bash[24585]: cluster 2024-09-16T05:58:20.487331+0000 mgr.a (mgr.14373) 925 : cluster [DBG] pgmap v640: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:58:23.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:58:23 smithi086 bash[24289]: cluster 2024-09-16T05:58:22.489623+0000 mgr.a (mgr.14373) 926 : cluster [DBG] pgmap v641: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:58:23.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:58:23 smithi047 bash[22744]: cluster 2024-09-16T05:58:22.489623+0000 mgr.a (mgr.14373) 926 : cluster [DBG] pgmap v641: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:58:24.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:58:23 smithi157 bash[24585]: cluster 2024-09-16T05:58:22.489623+0000 mgr.a (mgr.14373) 926 : cluster [DBG] pgmap v641: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:58:25.362 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T05:58:25.363 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T05:58:25.363 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T05:58:25.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:58:25 smithi086 bash[24289]: cluster 2024-09-16T05:58:24.490432+0000 mgr.a (mgr.14373) 927 : cluster [DBG] pgmap v642: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:58:25.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:58:25 smithi047 bash[22744]: cluster 2024-09-16T05:58:24.490432+0000 mgr.a (mgr.14373) 927 : cluster [DBG] pgmap v642: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:58:26.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:58:25 smithi157 bash[24585]: cluster 2024-09-16T05:58:24.490432+0000 mgr.a (mgr.14373) 927 : cluster [DBG] pgmap v642: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:58:26.115 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T05:58:26.116 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T05:58:26.116 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T05:58:26.116 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T05:58:26.116 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T05:58:27.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:58:26 smithi157 bash[24585]: audit 2024-09-16T05:58:25.702613+0000 mgr.a (mgr.14373) 928 : audit [DBG] from='client.33297 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:58:27.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:58:26 smithi157 bash[24585]: cluster 2024-09-16T05:58:26.492750+0000 mgr.a (mgr.14373) 929 : cluster [DBG] pgmap v643: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:58:27.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:58:26 smithi086 bash[24289]: audit 2024-09-16T05:58:25.702613+0000 mgr.a (mgr.14373) 928 : audit [DBG] from='client.33297 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:58:27.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:58:26 smithi086 bash[24289]: cluster 2024-09-16T05:58:26.492750+0000 mgr.a (mgr.14373) 929 : cluster [DBG] pgmap v643: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:58:27.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:58:26 smithi047 bash[22744]: audit 2024-09-16T05:58:25.702613+0000 mgr.a (mgr.14373) 928 : audit [DBG] from='client.33297 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:58:27.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:58:26 smithi047 bash[22744]: cluster 2024-09-16T05:58:26.492750+0000 mgr.a (mgr.14373) 929 : cluster [DBG] pgmap v643: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:58:29.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:58:29 smithi157 bash[24585]: cluster 2024-09-16T05:58:28.493541+0000 mgr.a (mgr.14373) 930 : cluster [DBG] pgmap v644: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:58:29.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:58:29 smithi086 bash[24289]: cluster 2024-09-16T05:58:28.493541+0000 mgr.a (mgr.14373) 930 : cluster [DBG] pgmap v644: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:58:29.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:58:29 smithi047 bash[22744]: cluster 2024-09-16T05:58:28.493541+0000 mgr.a (mgr.14373) 930 : cluster [DBG] pgmap v644: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:58:31.117 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T05:58:31.118 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T05:58:31.118 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T05:58:31.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:58:31 smithi157 bash[24585]: cluster 2024-09-16T05:58:30.494316+0000 mgr.a (mgr.14373) 931 : cluster [DBG] pgmap v645: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:58:31.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:58:31 smithi086 bash[24289]: cluster 2024-09-16T05:58:30.494316+0000 mgr.a (mgr.14373) 931 : cluster [DBG] pgmap v645: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:58:31.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:58:31 smithi047 bash[22744]: cluster 2024-09-16T05:58:30.494316+0000 mgr.a (mgr.14373) 931 : cluster [DBG] pgmap v645: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:58:31.881 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T05:58:31.881 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T05:58:31.881 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T05:58:31.881 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T05:58:31.881 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T05:58:32.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:58:32 smithi086 bash[24289]: audit 2024-09-16T05:58:31.458108+0000 mgr.a (mgr.14373) 932 : audit [DBG] from='client.33375 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:58:32.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:58:32 smithi047 bash[22744]: audit 2024-09-16T05:58:31.458108+0000 mgr.a (mgr.14373) 932 : audit [DBG] from='client.33375 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:58:33.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:58:32 smithi157 bash[24585]: audit 2024-09-16T05:58:31.458108+0000 mgr.a (mgr.14373) 932 : audit [DBG] from='client.33375 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:58:33.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:58:33 smithi086 bash[24289]: cluster 2024-09-16T05:58:32.497176+0000 mgr.a (mgr.14373) 933 : cluster [DBG] pgmap v646: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:58:33.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:58:33 smithi047 bash[22744]: cluster 2024-09-16T05:58:32.497176+0000 mgr.a (mgr.14373) 933 : cluster [DBG] pgmap v646: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:58:34.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:58:33 smithi157 bash[24585]: cluster 2024-09-16T05:58:32.497176+0000 mgr.a (mgr.14373) 933 : cluster [DBG] pgmap v646: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:58:35.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:58:35 smithi086 bash[24289]: cluster 2024-09-16T05:58:34.497964+0000 mgr.a (mgr.14373) 934 : cluster [DBG] pgmap v647: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T05:58:35.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:58:35 smithi047 bash[22744]: cluster 2024-09-16T05:58:34.497964+0000 mgr.a (mgr.14373) 934 : cluster [DBG] pgmap v647: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T05:58:36.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:58:35 smithi157 bash[24585]: cluster 2024-09-16T05:58:34.497964+0000 mgr.a (mgr.14373) 934 : cluster [DBG] pgmap v647: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T05:58:36.883 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T05:58:36.883 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T05:58:36.883 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T05:58:37.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:58:36 smithi157 bash[24585]: cluster 2024-09-16T05:58:36.499928+0000 mgr.a (mgr.14373) 935 : cluster [DBG] pgmap v648: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:58:37.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:58:36 smithi086 bash[24289]: cluster 2024-09-16T05:58:36.499928+0000 mgr.a (mgr.14373) 935 : cluster [DBG] pgmap v648: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:58:37.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:58:36 smithi047 bash[22744]: cluster 2024-09-16T05:58:36.499928+0000 mgr.a (mgr.14373) 935 : cluster [DBG] pgmap v648: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:58:37.667 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T05:58:37.667 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T05:58:37.667 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T05:58:37.667 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T05:58:37.667 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T05:58:38.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:58:37 smithi157 bash[24585]: audit 2024-09-16T05:58:37.223608+0000 mgr.a (mgr.14373) 936 : audit [DBG] from='client.33453 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:58:38.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:58:37 smithi086 bash[24289]: audit 2024-09-16T05:58:37.223608+0000 mgr.a (mgr.14373) 936 : audit [DBG] from='client.33453 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:58:38.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:58:37 smithi047 bash[22744]: audit 2024-09-16T05:58:37.223608+0000 mgr.a (mgr.14373) 936 : audit [DBG] from='client.33453 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:58:39.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:58:38 smithi157 bash[24585]: cluster 2024-09-16T05:58:38.500846+0000 mgr.a (mgr.14373) 937 : cluster [DBG] pgmap v649: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T05:58:39.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:58:38 smithi086 bash[24289]: cluster 2024-09-16T05:58:38.500846+0000 mgr.a (mgr.14373) 937 : cluster [DBG] pgmap v649: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T05:58:39.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:58:38 smithi047 bash[22744]: cluster 2024-09-16T05:58:38.500846+0000 mgr.a (mgr.14373) 937 : cluster [DBG] pgmap v649: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T05:58:41.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:58:41 smithi086 bash[24289]: cluster 2024-09-16T05:58:40.501636+0000 mgr.a (mgr.14373) 938 : cluster [DBG] pgmap v650: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T05:58:41.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:58:41 smithi047 bash[22744]: cluster 2024-09-16T05:58:40.501636+0000 mgr.a (mgr.14373) 938 : cluster [DBG] pgmap v650: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T05:58:42.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:58:41 smithi157 bash[24585]: cluster 2024-09-16T05:58:40.501636+0000 mgr.a (mgr.14373) 938 : cluster [DBG] pgmap v650: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T05:58:42.668 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T05:58:42.669 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T05:58:42.669 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T05:58:43.432 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T05:58:43.432 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T05:58:43.433 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T05:58:43.433 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T05:58:43.433 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T05:58:43.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:58:43 smithi086 bash[24289]: cluster 2024-09-16T05:58:42.503903+0000 mgr.a (mgr.14373) 939 : cluster [DBG] pgmap v651: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:58:43.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:58:43 smithi047 bash[22744]: cluster 2024-09-16T05:58:42.503903+0000 mgr.a (mgr.14373) 939 : cluster [DBG] pgmap v651: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:58:44.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:58:43 smithi157 bash[24585]: cluster 2024-09-16T05:58:42.503903+0000 mgr.a (mgr.14373) 939 : cluster [DBG] pgmap v651: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:58:44.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:58:44 smithi086 bash[24289]: audit 2024-09-16T05:58:43.004811+0000 mgr.a (mgr.14373) 940 : audit [DBG] from='client.33528 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:58:44.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:58:44 smithi047 bash[22744]: audit 2024-09-16T05:58:43.004811+0000 mgr.a (mgr.14373) 940 : audit [DBG] from='client.33528 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:58:45.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:58:44 smithi157 bash[24585]: audit 2024-09-16T05:58:43.004811+0000 mgr.a (mgr.14373) 940 : audit [DBG] from='client.33528 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:58:45.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:58:45 smithi047 bash[22744]: cluster 2024-09-16T05:58:44.504839+0000 mgr.a (mgr.14373) 941 : cluster [DBG] pgmap v652: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:58:46.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:58:45 smithi157 bash[24585]: cluster 2024-09-16T05:58:44.504839+0000 mgr.a (mgr.14373) 941 : cluster [DBG] pgmap v652: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:58:46.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:58:45 smithi086 bash[24289]: cluster 2024-09-16T05:58:44.504839+0000 mgr.a (mgr.14373) 941 : cluster [DBG] pgmap v652: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:58:46.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:58:46 smithi047 bash[22744]: cluster 2024-09-16T05:58:46.507098+0000 mgr.a (mgr.14373) 942 : cluster [DBG] pgmap v653: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:58:47.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:58:46 smithi157 bash[24585]: cluster 2024-09-16T05:58:46.507098+0000 mgr.a (mgr.14373) 942 : cluster [DBG] pgmap v653: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:58:47.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:58:46 smithi086 bash[24289]: cluster 2024-09-16T05:58:46.507098+0000 mgr.a (mgr.14373) 942 : cluster [DBG] pgmap v653: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:58:48.433 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T05:58:48.434 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T05:58:48.434 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T05:58:49.219 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T05:58:49.220 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T05:58:49.220 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T05:58:49.220 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T05:58:49.220 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T05:58:49.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:58:49 smithi086 bash[24289]: cluster 2024-09-16T05:58:48.507848+0000 mgr.a (mgr.14373) 943 : cluster [DBG] pgmap v654: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:58:49.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:58:49 smithi086 bash[24289]: audit 2024-09-16T05:58:49.337866+0000 mon.b (mon.2) 134 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T05:58:49.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:58:49 smithi047 bash[22744]: cluster 2024-09-16T05:58:48.507848+0000 mgr.a (mgr.14373) 943 : cluster [DBG] pgmap v654: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:58:49.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:58:49 smithi047 bash[22744]: audit 2024-09-16T05:58:49.337866+0000 mon.b (mon.2) 134 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T05:58:50.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:58:49 smithi157 bash[24585]: cluster 2024-09-16T05:58:48.507848+0000 mgr.a (mgr.14373) 943 : cluster [DBG] pgmap v654: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:58:50.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:58:49 smithi157 bash[24585]: audit 2024-09-16T05:58:49.337866+0000 mon.b (mon.2) 134 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T05:58:50.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:58:50 smithi086 bash[24289]: audit 2024-09-16T05:58:48.772525+0000 mgr.a (mgr.14373) 944 : audit [DBG] from='client.33603 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:58:50.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:58:50 smithi047 bash[22744]: audit 2024-09-16T05:58:48.772525+0000 mgr.a (mgr.14373) 944 : audit [DBG] from='client.33603 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:58:51.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:58:50 smithi157 bash[24585]: audit 2024-09-16T05:58:48.772525+0000 mgr.a (mgr.14373) 944 : audit [DBG] from='client.33603 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:58:51.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:58:51 smithi086 bash[24289]: cluster 2024-09-16T05:58:50.508807+0000 mgr.a (mgr.14373) 945 : cluster [DBG] pgmap v655: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:58:51.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:58:51 smithi047 bash[22744]: cluster 2024-09-16T05:58:50.508807+0000 mgr.a (mgr.14373) 945 : cluster [DBG] pgmap v655: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:58:52.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:58:51 smithi157 bash[24585]: cluster 2024-09-16T05:58:50.508807+0000 mgr.a (mgr.14373) 945 : cluster [DBG] pgmap v655: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:58:53.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:58:53 smithi047 bash[22744]: cluster 2024-09-16T05:58:52.510694+0000 mgr.a (mgr.14373) 946 : cluster [DBG] pgmap v656: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:58:54.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:58:53 smithi157 bash[24585]: cluster 2024-09-16T05:58:52.510694+0000 mgr.a (mgr.14373) 946 : cluster [DBG] pgmap v656: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:58:54.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:58:53 smithi086 bash[24289]: cluster 2024-09-16T05:58:52.510694+0000 mgr.a (mgr.14373) 946 : cluster [DBG] pgmap v656: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:58:54.221 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T05:58:54.222 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T05:58:54.222 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T05:58:54.992 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T05:58:54.992 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T05:58:54.992 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T05:58:54.992 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T05:58:54.992 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T05:58:55.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:58:55 smithi047 bash[22744]: cluster 2024-09-16T05:58:54.511183+0000 mgr.a (mgr.14373) 947 : cluster [DBG] pgmap v657: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:58:55.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:58:55 smithi047 bash[22744]: audit 2024-09-16T05:58:54.562819+0000 mgr.a (mgr.14373) 948 : audit [DBG] from='client.33681 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:58:55.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:58:55 smithi047 bash[22744]: audit 2024-09-16T05:58:54.703385+0000 mon.a (mon.0) 619 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T05:58:55.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:58:55 smithi047 bash[22744]: audit 2024-09-16T05:58:54.709365+0000 mon.a (mon.0) 620 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T05:58:55.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:58:55 smithi047 bash[22744]: audit 2024-09-16T05:58:54.716990+0000 mon.a (mon.0) 621 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T05:58:55.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:58:55 smithi047 bash[22744]: audit 2024-09-16T05:58:54.723414+0000 mon.a (mon.0) 622 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T05:58:55.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:58:55 smithi047 bash[22744]: audit 2024-09-16T05:58:54.729171+0000 mon.a (mon.0) 623 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T05:58:55.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:58:55 smithi047 bash[22744]: audit 2024-09-16T05:58:54.734394+0000 mon.a (mon.0) 624 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T05:58:55.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:58:55 smithi047 bash[22744]: audit 2024-09-16T05:58:55.485295+0000 mon.b (mon.2) 135 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T05:58:55.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:58:55 smithi047 bash[22744]: audit 2024-09-16T05:58:55.487480+0000 mon.b (mon.2) 136 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T05:58:55.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:58:55 smithi047 bash[22744]: audit 2024-09-16T05:58:55.502532+0000 mon.a (mon.0) 625 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T05:58:55.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:58:55 smithi047 bash[22744]: audit 2024-09-16T05:58:55.504184+0000 mon.b (mon.2) 137 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T05:58:55.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:58:55 smithi047 bash[22744]: audit 2024-09-16T05:58:55.510880+0000 mgr.a (mgr.14373) 949 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T05:58:56.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:58:55 smithi157 bash[24585]: cluster 2024-09-16T05:58:54.511183+0000 mgr.a (mgr.14373) 947 : cluster [DBG] pgmap v657: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:58:56.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:58:55 smithi157 bash[24585]: audit 2024-09-16T05:58:54.562819+0000 mgr.a (mgr.14373) 948 : audit [DBG] from='client.33681 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:58:56.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:58:55 smithi157 bash[24585]: audit 2024-09-16T05:58:54.703385+0000 mon.a (mon.0) 619 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T05:58:56.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:58:55 smithi157 bash[24585]: audit 2024-09-16T05:58:54.709365+0000 mon.a (mon.0) 620 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T05:58:56.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:58:55 smithi157 bash[24585]: audit 2024-09-16T05:58:54.716990+0000 mon.a (mon.0) 621 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T05:58:56.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:58:55 smithi157 bash[24585]: audit 2024-09-16T05:58:54.723414+0000 mon.a (mon.0) 622 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T05:58:56.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:58:55 smithi157 bash[24585]: audit 2024-09-16T05:58:54.729171+0000 mon.a (mon.0) 623 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T05:58:56.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:58:55 smithi157 bash[24585]: audit 2024-09-16T05:58:54.734394+0000 mon.a (mon.0) 624 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T05:58:56.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:58:55 smithi157 bash[24585]: audit 2024-09-16T05:58:55.485295+0000 mon.b (mon.2) 135 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T05:58:56.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:58:55 smithi157 bash[24585]: audit 2024-09-16T05:58:55.487480+0000 mon.b (mon.2) 136 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T05:58:56.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:58:55 smithi157 bash[24585]: audit 2024-09-16T05:58:55.502532+0000 mon.a (mon.0) 625 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T05:58:56.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:58:55 smithi157 bash[24585]: audit 2024-09-16T05:58:55.504184+0000 mon.b (mon.2) 137 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T05:58:56.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:58:55 smithi157 bash[24585]: audit 2024-09-16T05:58:55.510880+0000 mgr.a (mgr.14373) 949 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T05:58:56.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:58:55 smithi086 bash[24289]: cluster 2024-09-16T05:58:54.511183+0000 mgr.a (mgr.14373) 947 : cluster [DBG] pgmap v657: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:58:56.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:58:55 smithi086 bash[24289]: audit 2024-09-16T05:58:54.562819+0000 mgr.a (mgr.14373) 948 : audit [DBG] from='client.33681 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:58:56.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:58:55 smithi086 bash[24289]: audit 2024-09-16T05:58:54.703385+0000 mon.a (mon.0) 619 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T05:58:56.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:58:55 smithi086 bash[24289]: audit 2024-09-16T05:58:54.709365+0000 mon.a (mon.0) 620 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T05:58:56.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:58:55 smithi086 bash[24289]: audit 2024-09-16T05:58:54.716990+0000 mon.a (mon.0) 621 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T05:58:56.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:58:55 smithi086 bash[24289]: audit 2024-09-16T05:58:54.723414+0000 mon.a (mon.0) 622 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T05:58:56.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:58:55 smithi086 bash[24289]: audit 2024-09-16T05:58:54.729171+0000 mon.a (mon.0) 623 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T05:58:56.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:58:55 smithi086 bash[24289]: audit 2024-09-16T05:58:54.734394+0000 mon.a (mon.0) 624 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T05:58:56.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:58:55 smithi086 bash[24289]: audit 2024-09-16T05:58:55.485295+0000 mon.b (mon.2) 135 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T05:58:56.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:58:55 smithi086 bash[24289]: audit 2024-09-16T05:58:55.487480+0000 mon.b (mon.2) 136 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T05:58:56.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:58:55 smithi086 bash[24289]: audit 2024-09-16T05:58:55.502532+0000 mon.a (mon.0) 625 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T05:58:56.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:58:55 smithi086 bash[24289]: audit 2024-09-16T05:58:55.504184+0000 mon.b (mon.2) 137 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T05:58:56.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:58:55 smithi086 bash[24289]: audit 2024-09-16T05:58:55.510880+0000 mgr.a (mgr.14373) 949 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T05:58:56.581 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 05:58:56 smithi047 bash[22994]: debug 2024-09-16T05:58:56.209+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T05:58:56.581 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 05:58:56 smithi047 bash[22994]: debug 2024-09-16T05:58:56.213+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T05:58:56.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:58:56 smithi047 bash[22744]: audit 2024-09-16T05:58:56.214049+0000 mgr.a (mgr.14373) 950 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T05:58:56.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:58:56 smithi047 bash[22744]: cephadm 2024-09-16T05:58:56.216381+0000 mgr.a (mgr.14373) 951 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T05:58:56.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:58:56 smithi047 bash[22744]: cluster 2024-09-16T05:58:56.513503+0000 mgr.a (mgr.14373) 952 : cluster [DBG] pgmap v658: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T05:58:57.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:58:56 smithi157 bash[24585]: audit 2024-09-16T05:58:56.214049+0000 mgr.a (mgr.14373) 950 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T05:58:57.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:58:56 smithi157 bash[24585]: cephadm 2024-09-16T05:58:56.216381+0000 mgr.a (mgr.14373) 951 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T05:58:57.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:58:56 smithi157 bash[24585]: cluster 2024-09-16T05:58:56.513503+0000 mgr.a (mgr.14373) 952 : cluster [DBG] pgmap v658: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T05:58:57.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:58:56 smithi086 bash[24289]: audit 2024-09-16T05:58:56.214049+0000 mgr.a (mgr.14373) 950 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T05:58:57.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:58:56 smithi086 bash[24289]: cephadm 2024-09-16T05:58:56.216381+0000 mgr.a (mgr.14373) 951 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T05:58:57.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:58:56 smithi086 bash[24289]: cluster 2024-09-16T05:58:56.513503+0000 mgr.a (mgr.14373) 952 : cluster [DBG] pgmap v658: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T05:58:59.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:58:59 smithi086 bash[24289]: cluster 2024-09-16T05:58:58.514268+0000 mgr.a (mgr.14373) 953 : cluster [DBG] pgmap v659: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T05:58:59.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:58:59 smithi047 bash[22744]: cluster 2024-09-16T05:58:58.514268+0000 mgr.a (mgr.14373) 953 : cluster [DBG] pgmap v659: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T05:58:59.994 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T05:58:59.994 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T05:58:59.994 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T05:59:00.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:58:59 smithi157 bash[24585]: cluster 2024-09-16T05:58:58.514268+0000 mgr.a (mgr.14373) 953 : cluster [DBG] pgmap v659: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T05:59:00.746 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T05:59:00.747 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T05:59:00.747 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T05:59:00.747 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T05:59:00.747 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T05:59:01.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:59:01 smithi047 bash[22744]: audit 2024-09-16T05:59:00.332957+0000 mgr.a (mgr.14373) 954 : audit [DBG] from='client.33858 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:59:01.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:59:01 smithi047 bash[22744]: cluster 2024-09-16T05:59:00.514858+0000 mgr.a (mgr.14373) 955 : cluster [DBG] pgmap v660: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T05:59:02.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:59:01 smithi157 bash[24585]: audit 2024-09-16T05:59:00.332957+0000 mgr.a (mgr.14373) 954 : audit [DBG] from='client.33858 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:59:02.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:59:01 smithi157 bash[24585]: cluster 2024-09-16T05:59:00.514858+0000 mgr.a (mgr.14373) 955 : cluster [DBG] pgmap v660: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T05:59:02.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:59:01 smithi086 bash[24289]: audit 2024-09-16T05:59:00.332957+0000 mgr.a (mgr.14373) 954 : audit [DBG] from='client.33858 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:59:02.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:59:01 smithi086 bash[24289]: cluster 2024-09-16T05:59:00.514858+0000 mgr.a (mgr.14373) 955 : cluster [DBG] pgmap v660: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T05:59:03.051 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:59:02 smithi157 bash[24585]: cluster 2024-09-16T05:59:02.517322+0000 mgr.a (mgr.14373) 956 : cluster [DBG] pgmap v661: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T05:59:03.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:59:02 smithi086 bash[24289]: cluster 2024-09-16T05:59:02.517322+0000 mgr.a (mgr.14373) 956 : cluster [DBG] pgmap v661: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T05:59:03.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:59:02 smithi047 bash[22744]: cluster 2024-09-16T05:59:02.517322+0000 mgr.a (mgr.14373) 956 : cluster [DBG] pgmap v661: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T05:59:05.748 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T05:59:05.748 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T05:59:05.749 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T05:59:05.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:59:05 smithi047 bash[22744]: cluster 2024-09-16T05:59:04.518283+0000 mgr.a (mgr.14373) 957 : cluster [DBG] pgmap v662: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T05:59:06.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:59:05 smithi157 bash[24585]: cluster 2024-09-16T05:59:04.518283+0000 mgr.a (mgr.14373) 957 : cluster [DBG] pgmap v662: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T05:59:06.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:59:05 smithi086 bash[24289]: cluster 2024-09-16T05:59:04.518283+0000 mgr.a (mgr.14373) 957 : cluster [DBG] pgmap v662: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T05:59:06.534 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T05:59:06.535 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T05:59:06.535 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T05:59:06.535 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T05:59:06.535 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T05:59:07.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:59:06 smithi157 bash[24585]: audit 2024-09-16T05:59:06.088041+0000 mgr.a (mgr.14373) 958 : audit [DBG] from='client.33936 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:59:07.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:59:06 smithi157 bash[24585]: cluster 2024-09-16T05:59:06.519555+0000 mgr.a (mgr.14373) 959 : cluster [DBG] pgmap v663: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T05:59:07.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:59:06 smithi086 bash[24289]: audit 2024-09-16T05:59:06.088041+0000 mgr.a (mgr.14373) 958 : audit [DBG] from='client.33936 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:59:07.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:59:06 smithi086 bash[24289]: cluster 2024-09-16T05:59:06.519555+0000 mgr.a (mgr.14373) 959 : cluster [DBG] pgmap v663: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T05:59:07.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:59:06 smithi047 bash[22744]: audit 2024-09-16T05:59:06.088041+0000 mgr.a (mgr.14373) 958 : audit [DBG] from='client.33936 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:59:07.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:59:06 smithi047 bash[22744]: cluster 2024-09-16T05:59:06.519555+0000 mgr.a (mgr.14373) 959 : cluster [DBG] pgmap v663: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T05:59:09.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:59:09 smithi047 bash[22744]: cluster 2024-09-16T05:59:08.520288+0000 mgr.a (mgr.14373) 960 : cluster [DBG] pgmap v664: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T05:59:10.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:59:09 smithi157 bash[24585]: cluster 2024-09-16T05:59:08.520288+0000 mgr.a (mgr.14373) 960 : cluster [DBG] pgmap v664: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T05:59:10.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:59:09 smithi086 bash[24289]: cluster 2024-09-16T05:59:08.520288+0000 mgr.a (mgr.14373) 960 : cluster [DBG] pgmap v664: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T05:59:10.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:59:10 smithi047 bash[22744]: cluster 2024-09-16T05:59:10.521047+0000 mgr.a (mgr.14373) 961 : cluster [DBG] pgmap v665: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T05:59:11.051 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:59:10 smithi157 bash[24585]: cluster 2024-09-16T05:59:10.521047+0000 mgr.a (mgr.14373) 961 : cluster [DBG] pgmap v665: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T05:59:11.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:59:10 smithi086 bash[24289]: cluster 2024-09-16T05:59:10.521047+0000 mgr.a (mgr.14373) 961 : cluster [DBG] pgmap v665: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T05:59:11.536 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T05:59:11.537 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T05:59:11.537 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T05:59:12.279 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T05:59:12.279 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T05:59:12.279 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T05:59:12.280 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T05:59:12.280 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T05:59:13.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:59:12 smithi157 bash[24585]: audit 2024-09-16T05:59:11.874023+0000 mgr.a (mgr.14373) 962 : audit [DBG] from='client.34011 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:59:13.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:59:12 smithi157 bash[24585]: cluster 2024-09-16T05:59:12.523791+0000 mgr.a (mgr.14373) 963 : cluster [DBG] pgmap v666: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:59:13.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:59:12 smithi086 bash[24289]: audit 2024-09-16T05:59:11.874023+0000 mgr.a (mgr.14373) 962 : audit [DBG] from='client.34011 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:59:13.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:59:12 smithi086 bash[24289]: cluster 2024-09-16T05:59:12.523791+0000 mgr.a (mgr.14373) 963 : cluster [DBG] pgmap v666: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:59:13.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:59:12 smithi047 bash[22744]: audit 2024-09-16T05:59:11.874023+0000 mgr.a (mgr.14373) 962 : audit [DBG] from='client.34011 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:59:13.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:59:12 smithi047 bash[22744]: cluster 2024-09-16T05:59:12.523791+0000 mgr.a (mgr.14373) 963 : cluster [DBG] pgmap v666: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:59:15.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:59:14 smithi157 bash[24585]: cluster 2024-09-16T05:59:14.524576+0000 mgr.a (mgr.14373) 964 : cluster [DBG] pgmap v667: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T05:59:15.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:59:14 smithi086 bash[24289]: cluster 2024-09-16T05:59:14.524576+0000 mgr.a (mgr.14373) 964 : cluster [DBG] pgmap v667: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T05:59:15.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:59:14 smithi047 bash[22744]: cluster 2024-09-16T05:59:14.524576+0000 mgr.a (mgr.14373) 964 : cluster [DBG] pgmap v667: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T05:59:17.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:59:16 smithi157 bash[24585]: cluster 2024-09-16T05:59:16.526566+0000 mgr.a (mgr.14373) 965 : cluster [DBG] pgmap v668: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:59:17.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:59:16 smithi086 bash[24289]: cluster 2024-09-16T05:59:16.526566+0000 mgr.a (mgr.14373) 965 : cluster [DBG] pgmap v668: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:59:17.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:59:16 smithi047 bash[22744]: cluster 2024-09-16T05:59:16.526566+0000 mgr.a (mgr.14373) 965 : cluster [DBG] pgmap v668: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:59:17.280 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T05:59:17.281 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T05:59:17.281 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T05:59:18.061 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T05:59:18.062 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T05:59:18.062 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T05:59:18.062 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T05:59:18.062 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T05:59:19.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:59:18 smithi157 bash[24585]: audit 2024-09-16T05:59:17.620896+0000 mgr.a (mgr.14373) 966 : audit [DBG] from='client.34089 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:59:19.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:59:18 smithi157 bash[24585]: cluster 2024-09-16T05:59:18.527556+0000 mgr.a (mgr.14373) 967 : cluster [DBG] pgmap v669: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-16T05:59:19.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:59:18 smithi086 bash[24289]: audit 2024-09-16T05:59:17.620896+0000 mgr.a (mgr.14373) 966 : audit [DBG] from='client.34089 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:59:19.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:59:18 smithi086 bash[24289]: cluster 2024-09-16T05:59:18.527556+0000 mgr.a (mgr.14373) 967 : cluster [DBG] pgmap v669: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-16T05:59:19.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:59:18 smithi047 bash[22744]: audit 2024-09-16T05:59:17.620896+0000 mgr.a (mgr.14373) 966 : audit [DBG] from='client.34089 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:59:19.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:59:18 smithi047 bash[22744]: cluster 2024-09-16T05:59:18.527556+0000 mgr.a (mgr.14373) 967 : cluster [DBG] pgmap v669: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-16T05:59:21.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:59:20 smithi157 bash[24585]: cluster 2024-09-16T05:59:20.528352+0000 mgr.a (mgr.14373) 968 : cluster [DBG] pgmap v670: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-16T05:59:21.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:59:20 smithi086 bash[24289]: cluster 2024-09-16T05:59:20.528352+0000 mgr.a (mgr.14373) 968 : cluster [DBG] pgmap v670: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-16T05:59:21.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:59:20 smithi047 bash[22744]: cluster 2024-09-16T05:59:20.528352+0000 mgr.a (mgr.14373) 968 : cluster [DBG] pgmap v670: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-16T05:59:23.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:59:22 smithi157 bash[24585]: cluster 2024-09-16T05:59:22.530641+0000 mgr.a (mgr.14373) 969 : cluster [DBG] pgmap v671: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-16T05:59:23.063 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T05:59:23.064 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T05:59:23.064 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T05:59:23.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:59:22 smithi086 bash[24289]: cluster 2024-09-16T05:59:22.530641+0000 mgr.a (mgr.14373) 969 : cluster [DBG] pgmap v671: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-16T05:59:23.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:59:22 smithi047 bash[22744]: cluster 2024-09-16T05:59:22.530641+0000 mgr.a (mgr.14373) 969 : cluster [DBG] pgmap v671: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-16T05:59:23.817 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T05:59:23.817 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T05:59:23.817 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T05:59:23.818 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T05:59:23.818 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T05:59:24.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:59:23 smithi157 bash[24585]: audit 2024-09-16T05:59:23.402164+0000 mgr.a (mgr.14373) 970 : audit [DBG] from='client.34167 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:59:24.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:59:23 smithi086 bash[24289]: audit 2024-09-16T05:59:23.402164+0000 mgr.a (mgr.14373) 970 : audit [DBG] from='client.34167 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:59:24.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:59:23 smithi047 bash[22744]: audit 2024-09-16T05:59:23.402164+0000 mgr.a (mgr.14373) 970 : audit [DBG] from='client.34167 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:59:25.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:59:24 smithi157 bash[24585]: cluster 2024-09-16T05:59:24.531638+0000 mgr.a (mgr.14373) 971 : cluster [DBG] pgmap v672: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:59:25.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:59:24 smithi086 bash[24289]: cluster 2024-09-16T05:59:24.531638+0000 mgr.a (mgr.14373) 971 : cluster [DBG] pgmap v672: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:59:25.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:59:24 smithi047 bash[22744]: cluster 2024-09-16T05:59:24.531638+0000 mgr.a (mgr.14373) 971 : cluster [DBG] pgmap v672: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:59:27.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:59:26 smithi157 bash[24585]: cluster 2024-09-16T05:59:26.533813+0000 mgr.a (mgr.14373) 972 : cluster [DBG] pgmap v673: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:59:27.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:59:26 smithi086 bash[24289]: cluster 2024-09-16T05:59:26.533813+0000 mgr.a (mgr.14373) 972 : cluster [DBG] pgmap v673: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:59:27.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:59:26 smithi047 bash[22744]: cluster 2024-09-16T05:59:26.533813+0000 mgr.a (mgr.14373) 972 : cluster [DBG] pgmap v673: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:59:28.817 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T05:59:28.817 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T05:59:28.818 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T05:59:29.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:59:28 smithi157 bash[24585]: cluster 2024-09-16T05:59:28.534595+0000 mgr.a (mgr.14373) 973 : cluster [DBG] pgmap v674: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:59:29.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:59:28 smithi086 bash[24289]: cluster 2024-09-16T05:59:28.534595+0000 mgr.a (mgr.14373) 973 : cluster [DBG] pgmap v674: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:59:29.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:59:28 smithi047 bash[22744]: cluster 2024-09-16T05:59:28.534595+0000 mgr.a (mgr.14373) 973 : cluster [DBG] pgmap v674: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:59:29.595 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T05:59:29.596 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T05:59:29.596 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T05:59:29.596 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T05:59:29.596 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T05:59:30.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:59:29 smithi157 bash[24585]: audit 2024-09-16T05:59:29.160976+0000 mgr.a (mgr.14373) 974 : audit [DBG] from='client.34245 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:59:30.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:59:29 smithi086 bash[24289]: audit 2024-09-16T05:59:29.160976+0000 mgr.a (mgr.14373) 974 : audit [DBG] from='client.34245 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:59:30.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:59:29 smithi047 bash[22744]: audit 2024-09-16T05:59:29.160976+0000 mgr.a (mgr.14373) 974 : audit [DBG] from='client.34245 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:59:31.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:59:30 smithi157 bash[24585]: cluster 2024-09-16T05:59:30.535677+0000 mgr.a (mgr.14373) 975 : cluster [DBG] pgmap v675: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:59:31.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:59:30 smithi086 bash[24289]: cluster 2024-09-16T05:59:30.535677+0000 mgr.a (mgr.14373) 975 : cluster [DBG] pgmap v675: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:59:31.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:59:30 smithi047 bash[22744]: cluster 2024-09-16T05:59:30.535677+0000 mgr.a (mgr.14373) 975 : cluster [DBG] pgmap v675: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:59:33.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:59:32 smithi157 bash[24585]: cluster 2024-09-16T05:59:32.537984+0000 mgr.a (mgr.14373) 976 : cluster [DBG] pgmap v676: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:59:33.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:59:32 smithi086 bash[24289]: cluster 2024-09-16T05:59:32.537984+0000 mgr.a (mgr.14373) 976 : cluster [DBG] pgmap v676: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:59:33.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:59:32 smithi047 bash[22744]: cluster 2024-09-16T05:59:32.537984+0000 mgr.a (mgr.14373) 976 : cluster [DBG] pgmap v676: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:59:34.597 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T05:59:34.598 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T05:59:34.598 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T05:59:35.051 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:59:34 smithi157 bash[24585]: cluster 2024-09-16T05:59:34.538766+0000 mgr.a (mgr.14373) 977 : cluster [DBG] pgmap v677: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:59:35.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:59:34 smithi086 bash[24289]: cluster 2024-09-16T05:59:34.538766+0000 mgr.a (mgr.14373) 977 : cluster [DBG] pgmap v677: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:59:35.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:59:34 smithi047 bash[22744]: cluster 2024-09-16T05:59:34.538766+0000 mgr.a (mgr.14373) 977 : cluster [DBG] pgmap v677: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:59:35.364 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T05:59:35.364 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T05:59:35.364 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T05:59:35.364 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T05:59:35.364 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T05:59:36.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:59:35 smithi157 bash[24585]: audit 2024-09-16T05:59:34.942744+0000 mgr.a (mgr.14373) 978 : audit [DBG] from='client.34320 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:59:36.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:59:35 smithi086 bash[24289]: audit 2024-09-16T05:59:34.942744+0000 mgr.a (mgr.14373) 978 : audit [DBG] from='client.34320 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:59:36.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:59:35 smithi047 bash[22744]: audit 2024-09-16T05:59:34.942744+0000 mgr.a (mgr.14373) 978 : audit [DBG] from='client.34320 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:59:37.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:59:36 smithi157 bash[24585]: cluster 2024-09-16T05:59:36.541005+0000 mgr.a (mgr.14373) 979 : cluster [DBG] pgmap v678: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:59:37.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:59:36 smithi086 bash[24289]: cluster 2024-09-16T05:59:36.541005+0000 mgr.a (mgr.14373) 979 : cluster [DBG] pgmap v678: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:59:37.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:59:36 smithi047 bash[22744]: cluster 2024-09-16T05:59:36.541005+0000 mgr.a (mgr.14373) 979 : cluster [DBG] pgmap v678: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:59:39.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:59:38 smithi157 bash[24585]: cluster 2024-09-16T05:59:38.541759+0000 mgr.a (mgr.14373) 980 : cluster [DBG] pgmap v679: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:59:39.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:59:38 smithi086 bash[24289]: cluster 2024-09-16T05:59:38.541759+0000 mgr.a (mgr.14373) 980 : cluster [DBG] pgmap v679: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:59:39.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:59:38 smithi047 bash[22744]: cluster 2024-09-16T05:59:38.541759+0000 mgr.a (mgr.14373) 980 : cluster [DBG] pgmap v679: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:59:40.365 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T05:59:40.366 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T05:59:40.366 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T05:59:41.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:59:40 smithi157 bash[24585]: cluster 2024-09-16T05:59:40.542468+0000 mgr.a (mgr.14373) 981 : cluster [DBG] pgmap v680: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:59:41.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:59:40 smithi086 bash[24289]: cluster 2024-09-16T05:59:40.542468+0000 mgr.a (mgr.14373) 981 : cluster [DBG] pgmap v680: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:59:41.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:59:40 smithi047 bash[22744]: cluster 2024-09-16T05:59:40.542468+0000 mgr.a (mgr.14373) 981 : cluster [DBG] pgmap v680: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:59:41.140 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T05:59:41.141 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T05:59:41.141 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T05:59:41.141 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T05:59:41.141 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T05:59:42.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:59:41 smithi157 bash[24585]: audit 2024-09-16T05:59:40.706420+0000 mgr.a (mgr.14373) 982 : audit [DBG] from='client.34398 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:59:42.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:59:41 smithi086 bash[24289]: audit 2024-09-16T05:59:40.706420+0000 mgr.a (mgr.14373) 982 : audit [DBG] from='client.34398 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:59:42.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:59:41 smithi047 bash[22744]: audit 2024-09-16T05:59:40.706420+0000 mgr.a (mgr.14373) 982 : audit [DBG] from='client.34398 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:59:43.051 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:59:42 smithi157 bash[24585]: cluster 2024-09-16T05:59:42.544804+0000 mgr.a (mgr.14373) 983 : cluster [DBG] pgmap v681: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:59:43.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:59:42 smithi086 bash[24289]: cluster 2024-09-16T05:59:42.544804+0000 mgr.a (mgr.14373) 983 : cluster [DBG] pgmap v681: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:59:43.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:59:42 smithi047 bash[22744]: cluster 2024-09-16T05:59:42.544804+0000 mgr.a (mgr.14373) 983 : cluster [DBG] pgmap v681: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T05:59:45.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:59:44 smithi157 bash[24585]: cluster 2024-09-16T05:59:44.545562+0000 mgr.a (mgr.14373) 984 : cluster [DBG] pgmap v682: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:59:45.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:59:44 smithi086 bash[24289]: cluster 2024-09-16T05:59:44.545562+0000 mgr.a (mgr.14373) 984 : cluster [DBG] pgmap v682: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:59:45.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:59:44 smithi047 bash[22744]: cluster 2024-09-16T05:59:44.545562+0000 mgr.a (mgr.14373) 984 : cluster [DBG] pgmap v682: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:59:46.142 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T05:59:46.143 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T05:59:46.143 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T05:59:46.880 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T05:59:46.880 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T05:59:46.881 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T05:59:46.881 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T05:59:46.881 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T05:59:47.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:59:46 smithi157 bash[24585]: audit 2024-09-16T05:59:46.479592+0000 mgr.a (mgr.14373) 985 : audit [DBG] from='client.34476 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:59:47.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:59:46 smithi157 bash[24585]: cluster 2024-09-16T05:59:46.547410+0000 mgr.a (mgr.14373) 986 : cluster [DBG] pgmap v683: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:59:47.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:59:46 smithi086 bash[24289]: audit 2024-09-16T05:59:46.479592+0000 mgr.a (mgr.14373) 985 : audit [DBG] from='client.34476 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:59:47.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:59:46 smithi086 bash[24289]: cluster 2024-09-16T05:59:46.547410+0000 mgr.a (mgr.14373) 986 : cluster [DBG] pgmap v683: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:59:47.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:59:46 smithi047 bash[22744]: audit 2024-09-16T05:59:46.479592+0000 mgr.a (mgr.14373) 985 : audit [DBG] from='client.34476 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:59:47.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:59:46 smithi047 bash[22744]: cluster 2024-09-16T05:59:46.547410+0000 mgr.a (mgr.14373) 986 : cluster [DBG] pgmap v683: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:59:49.051 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:59:48 smithi157 bash[24585]: cluster 2024-09-16T05:59:48.548310+0000 mgr.a (mgr.14373) 987 : cluster [DBG] pgmap v684: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T05:59:49.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:59:48 smithi086 bash[24289]: cluster 2024-09-16T05:59:48.548310+0000 mgr.a (mgr.14373) 987 : cluster [DBG] pgmap v684: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T05:59:49.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:59:48 smithi047 bash[22744]: cluster 2024-09-16T05:59:48.548310+0000 mgr.a (mgr.14373) 987 : cluster [DBG] pgmap v684: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T05:59:51.051 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:59:50 smithi157 bash[24585]: cluster 2024-09-16T05:59:50.549197+0000 mgr.a (mgr.14373) 988 : cluster [DBG] pgmap v685: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T05:59:51.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:59:50 smithi086 bash[24289]: cluster 2024-09-16T05:59:50.549197+0000 mgr.a (mgr.14373) 988 : cluster [DBG] pgmap v685: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T05:59:51.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:59:50 smithi047 bash[22744]: cluster 2024-09-16T05:59:50.549197+0000 mgr.a (mgr.14373) 988 : cluster [DBG] pgmap v685: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T05:59:51.882 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T05:59:51.882 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T05:59:51.882 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T05:59:52.640 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T05:59:52.640 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T05:59:52.640 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T05:59:52.640 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T05:59:52.641 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T05:59:53.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:59:52 smithi157 bash[24585]: audit 2024-09-16T05:59:52.222181+0000 mgr.a (mgr.14373) 989 : audit [DBG] from='client.34551 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:59:53.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:59:52 smithi157 bash[24585]: cluster 2024-09-16T05:59:52.550585+0000 mgr.a (mgr.14373) 990 : cluster [DBG] pgmap v686: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:59:53.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:59:52 smithi086 bash[24289]: audit 2024-09-16T05:59:52.222181+0000 mgr.a (mgr.14373) 989 : audit [DBG] from='client.34551 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:59:53.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:59:52 smithi086 bash[24289]: cluster 2024-09-16T05:59:52.550585+0000 mgr.a (mgr.14373) 990 : cluster [DBG] pgmap v686: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:59:53.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:59:52 smithi047 bash[22744]: audit 2024-09-16T05:59:52.222181+0000 mgr.a (mgr.14373) 989 : audit [DBG] from='client.34551 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:59:53.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:59:52 smithi047 bash[22744]: cluster 2024-09-16T05:59:52.550585+0000 mgr.a (mgr.14373) 990 : cluster [DBG] pgmap v686: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:59:55.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:59:54 smithi157 bash[24585]: cluster 2024-09-16T05:59:54.551337+0000 mgr.a (mgr.14373) 991 : cluster [DBG] pgmap v687: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T05:59:55.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:59:54 smithi086 bash[24289]: cluster 2024-09-16T05:59:54.551337+0000 mgr.a (mgr.14373) 991 : cluster [DBG] pgmap v687: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T05:59:55.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:59:54 smithi047 bash[22744]: cluster 2024-09-16T05:59:54.551337+0000 mgr.a (mgr.14373) 991 : cluster [DBG] pgmap v687: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T05:59:56.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:59:56 smithi086 bash[24289]: audit 2024-09-16T05:59:56.263103+0000 mon.b (mon.2) 138 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T05:59:56.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:59:56 smithi047 bash[22744]: audit 2024-09-16T05:59:56.263103+0000 mon.b (mon.2) 138 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T05:59:56.801 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:59:56 smithi157 bash[24585]: audit 2024-09-16T05:59:56.263103+0000 mon.b (mon.2) 138 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T05:59:57.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:59:57 smithi047 bash[22744]: cluster 2024-09-16T05:59:56.553410+0000 mgr.a (mgr.14373) 992 : cluster [DBG] pgmap v688: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:59:57.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:59:57 smithi047 bash[22744]: audit 2024-09-16T05:59:57.110052+0000 mon.b (mon.2) 139 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T05:59:57.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:59:57 smithi047 bash[22744]: audit 2024-09-16T05:59:57.112443+0000 mon.b (mon.2) 140 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T05:59:57.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:59:57 smithi047 bash[22744]: audit 2024-09-16T05:59:57.128487+0000 mon.a (mon.0) 626 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T05:59:57.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:59:57 smithi047 bash[22744]: audit 2024-09-16T05:59:57.130548+0000 mon.b (mon.2) 141 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T05:59:57.641 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T05:59:57.641 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T05:59:57.642 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T05:59:57.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:59:57 smithi157 bash[24585]: cluster 2024-09-16T05:59:56.553410+0000 mgr.a (mgr.14373) 992 : cluster [DBG] pgmap v688: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:59:57.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:59:57 smithi157 bash[24585]: audit 2024-09-16T05:59:57.110052+0000 mon.b (mon.2) 139 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T05:59:57.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:59:57 smithi157 bash[24585]: audit 2024-09-16T05:59:57.112443+0000 mon.b (mon.2) 140 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T05:59:57.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:59:57 smithi157 bash[24585]: audit 2024-09-16T05:59:57.128487+0000 mon.a (mon.0) 626 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T05:59:57.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:59:57 smithi157 bash[24585]: audit 2024-09-16T05:59:57.130548+0000 mon.b (mon.2) 141 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T05:59:57.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:59:57 smithi086 bash[24289]: cluster 2024-09-16T05:59:56.553410+0000 mgr.a (mgr.14373) 992 : cluster [DBG] pgmap v688: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:59:57.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:59:57 smithi086 bash[24289]: audit 2024-09-16T05:59:57.110052+0000 mon.b (mon.2) 139 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T05:59:57.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:59:57 smithi086 bash[24289]: audit 2024-09-16T05:59:57.112443+0000 mon.b (mon.2) 140 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T05:59:57.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:59:57 smithi086 bash[24289]: audit 2024-09-16T05:59:57.128487+0000 mon.a (mon.0) 626 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T05:59:57.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:59:57 smithi086 bash[24289]: audit 2024-09-16T05:59:57.130548+0000 mon.b (mon.2) 141 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T05:59:58.327 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 05:59:57 smithi047 bash[22994]: debug 2024-09-16T05:59:57.840+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T05:59:58.327 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 05:59:57 smithi047 bash[22994]: debug 2024-09-16T05:59:57.844+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T05:59:58.370 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T05:59:58.370 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T05:59:58.370 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T05:59:58.370 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T05:59:58.370 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T05:59:58.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:59:58 smithi047 bash[22744]: audit 2024-09-16T05:59:57.137266+0000 mgr.a (mgr.14373) 993 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T05:59:58.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:59:58 smithi157 bash[24585]: audit 2024-09-16T05:59:57.137266+0000 mgr.a (mgr.14373) 993 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T05:59:58.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:59:58 smithi086 bash[24289]: audit 2024-09-16T05:59:57.137266+0000 mgr.a (mgr.14373) 993 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T05:59:59.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:59:59 smithi047 bash[22744]: audit 2024-09-16T05:59:57.844641+0000 mgr.a (mgr.14373) 994 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T05:59:59.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:59:59 smithi047 bash[22744]: cephadm 2024-09-16T05:59:57.846367+0000 mgr.a (mgr.14373) 995 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T05:59:59.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:59:59 smithi047 bash[22744]: audit 2024-09-16T05:59:57.961714+0000 mgr.a (mgr.14373) 996 : audit [DBG] from='client.34737 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:59:59.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 05:59:59 smithi047 bash[22744]: cluster 2024-09-16T05:59:58.554427+0000 mgr.a (mgr.14373) 997 : cluster [DBG] pgmap v689: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:59:59.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:59:59 smithi157 bash[24585]: audit 2024-09-16T05:59:57.844641+0000 mgr.a (mgr.14373) 994 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T05:59:59.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:59:59 smithi157 bash[24585]: cephadm 2024-09-16T05:59:57.846367+0000 mgr.a (mgr.14373) 995 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T05:59:59.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:59:59 smithi157 bash[24585]: audit 2024-09-16T05:59:57.961714+0000 mgr.a (mgr.14373) 996 : audit [DBG] from='client.34737 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:59:59.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 05:59:59 smithi157 bash[24585]: cluster 2024-09-16T05:59:58.554427+0000 mgr.a (mgr.14373) 997 : cluster [DBG] pgmap v689: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T05:59:59.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:59:59 smithi086 bash[24289]: audit 2024-09-16T05:59:57.844641+0000 mgr.a (mgr.14373) 994 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T05:59:59.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:59:59 smithi086 bash[24289]: cephadm 2024-09-16T05:59:57.846367+0000 mgr.a (mgr.14373) 995 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T05:59:59.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:59:59 smithi086 bash[24289]: audit 2024-09-16T05:59:57.961714+0000 mgr.a (mgr.14373) 996 : audit [DBG] from='client.34737 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T05:59:59.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 05:59:59 smithi086 bash[24289]: cluster 2024-09-16T05:59:58.554427+0000 mgr.a (mgr.14373) 997 : cluster [DBG] pgmap v689: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:00:00.801 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:00:00 smithi157 bash[24585]: cluster 2024-09-16T06:00:00.000150+0000 mon.a (mon.0) 627 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-16T06:00:00.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:00:00 smithi086 bash[24289]: cluster 2024-09-16T06:00:00.000150+0000 mon.a (mon.0) 627 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-16T06:00:00.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:00:00 smithi047 bash[22744]: cluster 2024-09-16T06:00:00.000150+0000 mon.a (mon.0) 627 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-16T06:00:01.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:00:01 smithi157 bash[24585]: cluster 2024-09-16T06:00:00.555227+0000 mgr.a (mgr.14373) 998 : cluster [DBG] pgmap v690: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:00:01.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:00:01 smithi086 bash[24289]: cluster 2024-09-16T06:00:00.555227+0000 mgr.a (mgr.14373) 998 : cluster [DBG] pgmap v690: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:00:01.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:00:01 smithi047 bash[22744]: cluster 2024-09-16T06:00:00.555227+0000 mgr.a (mgr.14373) 998 : cluster [DBG] pgmap v690: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:00:03.051 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:00:02 smithi157 bash[24585]: cluster 2024-09-16T06:00:02.557460+0000 mgr.a (mgr.14373) 999 : cluster [DBG] pgmap v691: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:00:03.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:00:02 smithi086 bash[24289]: cluster 2024-09-16T06:00:02.557460+0000 mgr.a (mgr.14373) 999 : cluster [DBG] pgmap v691: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:00:03.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:00:02 smithi047 bash[22744]: cluster 2024-09-16T06:00:02.557460+0000 mgr.a (mgr.14373) 999 : cluster [DBG] pgmap v691: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:00:03.371 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:00:03.372 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:00:03.372 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:00:04.110 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:00:04.111 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:00:04.111 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:00:04.111 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:00:04.111 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:00:05.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:00:04 smithi157 bash[24585]: audit 2024-09-16T06:00:03.700333+0000 mgr.a (mgr.14373) 1000 : audit [DBG] from='client.34815 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:00:05.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:00:04 smithi157 bash[24585]: cluster 2024-09-16T06:00:04.558443+0000 mgr.a (mgr.14373) 1001 : cluster [DBG] pgmap v692: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:00:05.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:00:04 smithi086 bash[24289]: audit 2024-09-16T06:00:03.700333+0000 mgr.a (mgr.14373) 1000 : audit [DBG] from='client.34815 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:00:05.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:00:04 smithi086 bash[24289]: cluster 2024-09-16T06:00:04.558443+0000 mgr.a (mgr.14373) 1001 : cluster [DBG] pgmap v692: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:00:05.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:00:04 smithi047 bash[22744]: audit 2024-09-16T06:00:03.700333+0000 mgr.a (mgr.14373) 1000 : audit [DBG] from='client.34815 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:00:05.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:00:04 smithi047 bash[22744]: cluster 2024-09-16T06:00:04.558443+0000 mgr.a (mgr.14373) 1001 : cluster [DBG] pgmap v692: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:00:07.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:00:06 smithi157 bash[24585]: cluster 2024-09-16T06:00:06.560737+0000 mgr.a (mgr.14373) 1002 : cluster [DBG] pgmap v693: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:00:07.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:00:06 smithi086 bash[24289]: cluster 2024-09-16T06:00:06.560737+0000 mgr.a (mgr.14373) 1002 : cluster [DBG] pgmap v693: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:00:07.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:00:06 smithi047 bash[22744]: cluster 2024-09-16T06:00:06.560737+0000 mgr.a (mgr.14373) 1002 : cluster [DBG] pgmap v693: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:00:09.051 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:00:08 smithi157 bash[24585]: cluster 2024-09-16T06:00:08.561625+0000 mgr.a (mgr.14373) 1003 : cluster [DBG] pgmap v694: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:00:09.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:00:08 smithi086 bash[24289]: cluster 2024-09-16T06:00:08.561625+0000 mgr.a (mgr.14373) 1003 : cluster [DBG] pgmap v694: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:00:09.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:00:08 smithi047 bash[22744]: cluster 2024-09-16T06:00:08.561625+0000 mgr.a (mgr.14373) 1003 : cluster [DBG] pgmap v694: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:00:09.112 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:00:09.113 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:00:09.113 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:00:09.878 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:00:09.879 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:00:09.879 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:00:09.879 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:00:09.879 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:00:10.051 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:00:09 smithi157 bash[24585]: audit 2024-09-16T06:00:09.447841+0000 mgr.a (mgr.14373) 1004 : audit [DBG] from='client.34893 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:00:10.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:00:09 smithi086 bash[24289]: audit 2024-09-16T06:00:09.447841+0000 mgr.a (mgr.14373) 1004 : audit [DBG] from='client.34893 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:00:10.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:00:09 smithi047 bash[22744]: audit 2024-09-16T06:00:09.447841+0000 mgr.a (mgr.14373) 1004 : audit [DBG] from='client.34893 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:00:11.051 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:00:10 smithi157 bash[24585]: cluster 2024-09-16T06:00:10.562594+0000 mgr.a (mgr.14373) 1005 : cluster [DBG] pgmap v695: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:00:11.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:00:10 smithi086 bash[24289]: cluster 2024-09-16T06:00:10.562594+0000 mgr.a (mgr.14373) 1005 : cluster [DBG] pgmap v695: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:00:11.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:00:10 smithi047 bash[22744]: cluster 2024-09-16T06:00:10.562594+0000 mgr.a (mgr.14373) 1005 : cluster [DBG] pgmap v695: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:00:13.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:00:12 smithi157 bash[24585]: cluster 2024-09-16T06:00:12.564858+0000 mgr.a (mgr.14373) 1006 : cluster [DBG] pgmap v696: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:00:13.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:00:12 smithi086 bash[24289]: cluster 2024-09-16T06:00:12.564858+0000 mgr.a (mgr.14373) 1006 : cluster [DBG] pgmap v696: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:00:13.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:00:12 smithi047 bash[22744]: cluster 2024-09-16T06:00:12.564858+0000 mgr.a (mgr.14373) 1006 : cluster [DBG] pgmap v696: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:00:14.880 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:00:14.881 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:00:14.881 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:00:15.051 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:00:14 smithi157 bash[24585]: cluster 2024-09-16T06:00:14.565601+0000 mgr.a (mgr.14373) 1007 : cluster [DBG] pgmap v697: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:00:15.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:00:14 smithi086 bash[24289]: cluster 2024-09-16T06:00:14.565601+0000 mgr.a (mgr.14373) 1007 : cluster [DBG] pgmap v697: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:00:15.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:00:14 smithi047 bash[22744]: cluster 2024-09-16T06:00:14.565601+0000 mgr.a (mgr.14373) 1007 : cluster [DBG] pgmap v697: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:00:15.625 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:00:15.626 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:00:15.626 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:00:15.626 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:00:15.626 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:00:16.051 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:00:15 smithi157 bash[24585]: audit 2024-09-16T06:00:15.212767+0000 mgr.a (mgr.14373) 1008 : audit [DBG] from='client.34965 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:00:16.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:00:15 smithi086 bash[24289]: audit 2024-09-16T06:00:15.212767+0000 mgr.a (mgr.14373) 1008 : audit [DBG] from='client.34965 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:00:16.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:00:15 smithi047 bash[22744]: audit 2024-09-16T06:00:15.212767+0000 mgr.a (mgr.14373) 1008 : audit [DBG] from='client.34965 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:00:17.051 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:00:16 smithi157 bash[24585]: cluster 2024-09-16T06:00:16.567841+0000 mgr.a (mgr.14373) 1009 : cluster [DBG] pgmap v698: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:00:17.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:00:16 smithi086 bash[24289]: cluster 2024-09-16T06:00:16.567841+0000 mgr.a (mgr.14373) 1009 : cluster [DBG] pgmap v698: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:00:17.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:00:16 smithi047 bash[22744]: cluster 2024-09-16T06:00:16.567841+0000 mgr.a (mgr.14373) 1009 : cluster [DBG] pgmap v698: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:00:19.051 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:00:18 smithi157 bash[24585]: cluster 2024-09-16T06:00:18.568590+0000 mgr.a (mgr.14373) 1010 : cluster [DBG] pgmap v699: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:00:19.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:00:18 smithi086 bash[24289]: cluster 2024-09-16T06:00:18.568590+0000 mgr.a (mgr.14373) 1010 : cluster [DBG] pgmap v699: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:00:19.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:00:18 smithi047 bash[22744]: cluster 2024-09-16T06:00:18.568590+0000 mgr.a (mgr.14373) 1010 : cluster [DBG] pgmap v699: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:00:20.627 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:00:20.628 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:00:20.628 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:00:21.051 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:00:20 smithi157 bash[24585]: cluster 2024-09-16T06:00:20.569330+0000 mgr.a (mgr.14373) 1011 : cluster [DBG] pgmap v700: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:00:21.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:00:20 smithi086 bash[24289]: cluster 2024-09-16T06:00:20.569330+0000 mgr.a (mgr.14373) 1011 : cluster [DBG] pgmap v700: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:00:21.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:00:20 smithi047 bash[22744]: cluster 2024-09-16T06:00:20.569330+0000 mgr.a (mgr.14373) 1011 : cluster [DBG] pgmap v700: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:00:21.353 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:00:21.353 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:00:21.354 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:00:21.354 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:00:21.354 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:00:22.051 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:00:21 smithi157 bash[24585]: audit 2024-09-16T06:00:20.954141+0000 mgr.a (mgr.14373) 1012 : audit [DBG] from='client.35043 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:00:22.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:00:21 smithi086 bash[24289]: audit 2024-09-16T06:00:20.954141+0000 mgr.a (mgr.14373) 1012 : audit [DBG] from='client.35043 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:00:22.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:00:21 smithi047 bash[22744]: audit 2024-09-16T06:00:20.954141+0000 mgr.a (mgr.14373) 1012 : audit [DBG] from='client.35043 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:00:23.051 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:00:22 smithi157 bash[24585]: cluster 2024-09-16T06:00:22.571821+0000 mgr.a (mgr.14373) 1013 : cluster [DBG] pgmap v701: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:00:23.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:00:22 smithi086 bash[24289]: cluster 2024-09-16T06:00:22.571821+0000 mgr.a (mgr.14373) 1013 : cluster [DBG] pgmap v701: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:00:23.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:00:22 smithi047 bash[22744]: cluster 2024-09-16T06:00:22.571821+0000 mgr.a (mgr.14373) 1013 : cluster [DBG] pgmap v701: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:00:25.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:00:24 smithi157 bash[24585]: cluster 2024-09-16T06:00:24.572679+0000 mgr.a (mgr.14373) 1014 : cluster [DBG] pgmap v702: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:00:25.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:00:24 smithi086 bash[24289]: cluster 2024-09-16T06:00:24.572679+0000 mgr.a (mgr.14373) 1014 : cluster [DBG] pgmap v702: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:00:25.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:00:24 smithi047 bash[22744]: cluster 2024-09-16T06:00:24.572679+0000 mgr.a (mgr.14373) 1014 : cluster [DBG] pgmap v702: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:00:26.355 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:00:26.356 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:00:26.356 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:00:27.051 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:00:26 smithi157 bash[24585]: cluster 2024-09-16T06:00:26.574655+0000 mgr.a (mgr.14373) 1015 : cluster [DBG] pgmap v703: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:00:27.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:00:26 smithi086 bash[24289]: cluster 2024-09-16T06:00:26.574655+0000 mgr.a (mgr.14373) 1015 : cluster [DBG] pgmap v703: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:00:27.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:00:26 smithi047 bash[22744]: cluster 2024-09-16T06:00:26.574655+0000 mgr.a (mgr.14373) 1015 : cluster [DBG] pgmap v703: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:00:27.111 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:00:27.112 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:00:27.112 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:00:27.112 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:00:27.112 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:00:28.051 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:00:27 smithi157 bash[24585]: audit 2024-09-16T06:00:26.690629+0000 mgr.a (mgr.14373) 1016 : audit [DBG] from='client.35121 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:00:28.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:00:27 smithi086 bash[24289]: audit 2024-09-16T06:00:26.690629+0000 mgr.a (mgr.14373) 1016 : audit [DBG] from='client.35121 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:00:28.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:00:27 smithi047 bash[22744]: audit 2024-09-16T06:00:26.690629+0000 mgr.a (mgr.14373) 1016 : audit [DBG] from='client.35121 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:00:29.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:00:28 smithi157 bash[24585]: cluster 2024-09-16T06:00:28.575531+0000 mgr.a (mgr.14373) 1017 : cluster [DBG] pgmap v704: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:00:29.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:00:28 smithi086 bash[24289]: cluster 2024-09-16T06:00:28.575531+0000 mgr.a (mgr.14373) 1017 : cluster [DBG] pgmap v704: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:00:29.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:00:28 smithi047 bash[22744]: cluster 2024-09-16T06:00:28.575531+0000 mgr.a (mgr.14373) 1017 : cluster [DBG] pgmap v704: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:00:31.051 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:00:30 smithi157 bash[24585]: cluster 2024-09-16T06:00:30.576290+0000 mgr.a (mgr.14373) 1018 : cluster [DBG] pgmap v705: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T06:00:31.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:00:30 smithi086 bash[24289]: cluster 2024-09-16T06:00:30.576290+0000 mgr.a (mgr.14373) 1018 : cluster [DBG] pgmap v705: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T06:00:31.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:00:30 smithi047 bash[22744]: cluster 2024-09-16T06:00:30.576290+0000 mgr.a (mgr.14373) 1018 : cluster [DBG] pgmap v705: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T06:00:32.113 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:00:32.113 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:00:32.114 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:00:32.889 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:00:32.889 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:00:32.889 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:00:32.889 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:00:32.889 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:00:33.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:00:32 smithi157 bash[24585]: audit 2024-09-16T06:00:32.450253+0000 mgr.a (mgr.14373) 1019 : audit [DBG] from='client.35199 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:00:33.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:00:32 smithi157 bash[24585]: cluster 2024-09-16T06:00:32.577721+0000 mgr.a (mgr.14373) 1020 : cluster [DBG] pgmap v706: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:00:33.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:00:32 smithi086 bash[24289]: audit 2024-09-16T06:00:32.450253+0000 mgr.a (mgr.14373) 1019 : audit [DBG] from='client.35199 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:00:33.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:00:32 smithi086 bash[24289]: cluster 2024-09-16T06:00:32.577721+0000 mgr.a (mgr.14373) 1020 : cluster [DBG] pgmap v706: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:00:33.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:00:32 smithi047 bash[22744]: audit 2024-09-16T06:00:32.450253+0000 mgr.a (mgr.14373) 1019 : audit [DBG] from='client.35199 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:00:33.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:00:32 smithi047 bash[22744]: cluster 2024-09-16T06:00:32.577721+0000 mgr.a (mgr.14373) 1020 : cluster [DBG] pgmap v706: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:00:35.051 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:00:34 smithi157 bash[24585]: cluster 2024-09-16T06:00:34.578746+0000 mgr.a (mgr.14373) 1021 : cluster [DBG] pgmap v707: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T06:00:35.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:00:34 smithi086 bash[24289]: cluster 2024-09-16T06:00:34.578746+0000 mgr.a (mgr.14373) 1021 : cluster [DBG] pgmap v707: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T06:00:35.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:00:34 smithi047 bash[22744]: cluster 2024-09-16T06:00:34.578746+0000 mgr.a (mgr.14373) 1021 : cluster [DBG] pgmap v707: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T06:00:37.051 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:00:36 smithi157 bash[24585]: cluster 2024-09-16T06:00:36.581092+0000 mgr.a (mgr.14373) 1022 : cluster [DBG] pgmap v708: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:00:37.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:00:36 smithi086 bash[24289]: cluster 2024-09-16T06:00:36.581092+0000 mgr.a (mgr.14373) 1022 : cluster [DBG] pgmap v708: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:00:37.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:00:36 smithi047 bash[22744]: cluster 2024-09-16T06:00:36.581092+0000 mgr.a (mgr.14373) 1022 : cluster [DBG] pgmap v708: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:00:37.890 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:00:37.891 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:00:37.891 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:00:38.672 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:00:38.672 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:00:38.672 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:00:38.672 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:00:38.672 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:00:39.051 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:00:38 smithi157 bash[24585]: audit 2024-09-16T06:00:38.233550+0000 mgr.a (mgr.14373) 1023 : audit [DBG] from='client.35277 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:00:39.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:00:38 smithi157 bash[24585]: cluster 2024-09-16T06:00:38.581704+0000 mgr.a (mgr.14373) 1024 : cluster [DBG] pgmap v709: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:00:39.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:00:38 smithi086 bash[24289]: audit 2024-09-16T06:00:38.233550+0000 mgr.a (mgr.14373) 1023 : audit [DBG] from='client.35277 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:00:39.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:00:38 smithi086 bash[24289]: cluster 2024-09-16T06:00:38.581704+0000 mgr.a (mgr.14373) 1024 : cluster [DBG] pgmap v709: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:00:39.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:00:38 smithi047 bash[22744]: audit 2024-09-16T06:00:38.233550+0000 mgr.a (mgr.14373) 1023 : audit [DBG] from='client.35277 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:00:39.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:00:38 smithi047 bash[22744]: cluster 2024-09-16T06:00:38.581704+0000 mgr.a (mgr.14373) 1024 : cluster [DBG] pgmap v709: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:00:41.051 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:00:40 smithi157 bash[24585]: cluster 2024-09-16T06:00:40.582458+0000 mgr.a (mgr.14373) 1025 : cluster [DBG] pgmap v710: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:00:41.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:00:40 smithi086 bash[24289]: cluster 2024-09-16T06:00:40.582458+0000 mgr.a (mgr.14373) 1025 : cluster [DBG] pgmap v710: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:00:41.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:00:40 smithi047 bash[22744]: cluster 2024-09-16T06:00:40.582458+0000 mgr.a (mgr.14373) 1025 : cluster [DBG] pgmap v710: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:00:43.051 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:00:42 smithi157 bash[24585]: cluster 2024-09-16T06:00:42.584688+0000 mgr.a (mgr.14373) 1026 : cluster [DBG] pgmap v711: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:00:43.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:00:42 smithi086 bash[24289]: cluster 2024-09-16T06:00:42.584688+0000 mgr.a (mgr.14373) 1026 : cluster [DBG] pgmap v711: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:00:43.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:00:42 smithi047 bash[22744]: cluster 2024-09-16T06:00:42.584688+0000 mgr.a (mgr.14373) 1026 : cluster [DBG] pgmap v711: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:00:43.677 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:00:43.677 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:00:43.677 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:00:44.432 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:00:44.433 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:00:44.433 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:00:44.433 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:00:44.433 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:00:45.051 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:00:44 smithi157 bash[24585]: audit 2024-09-16T06:00:44.014576+0000 mgr.a (mgr.14373) 1027 : audit [DBG] from='client.35355 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:00:45.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:00:44 smithi157 bash[24585]: cluster 2024-09-16T06:00:44.585628+0000 mgr.a (mgr.14373) 1028 : cluster [DBG] pgmap v712: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:00:45.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:00:44 smithi086 bash[24289]: audit 2024-09-16T06:00:44.014576+0000 mgr.a (mgr.14373) 1027 : audit [DBG] from='client.35355 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:00:45.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:00:44 smithi086 bash[24289]: cluster 2024-09-16T06:00:44.585628+0000 mgr.a (mgr.14373) 1028 : cluster [DBG] pgmap v712: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:00:45.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:00:44 smithi047 bash[22744]: audit 2024-09-16T06:00:44.014576+0000 mgr.a (mgr.14373) 1027 : audit [DBG] from='client.35355 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:00:45.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:00:44 smithi047 bash[22744]: cluster 2024-09-16T06:00:44.585628+0000 mgr.a (mgr.14373) 1028 : cluster [DBG] pgmap v712: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:00:47.051 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:00:46 smithi157 bash[24585]: cluster 2024-09-16T06:00:46.587847+0000 mgr.a (mgr.14373) 1029 : cluster [DBG] pgmap v713: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:00:47.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:00:46 smithi086 bash[24289]: cluster 2024-09-16T06:00:46.587847+0000 mgr.a (mgr.14373) 1029 : cluster [DBG] pgmap v713: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:00:47.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:00:46 smithi047 bash[22744]: cluster 2024-09-16T06:00:46.587847+0000 mgr.a (mgr.14373) 1029 : cluster [DBG] pgmap v713: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:00:49.051 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:00:48 smithi157 bash[24585]: cluster 2024-09-16T06:00:48.588584+0000 mgr.a (mgr.14373) 1030 : cluster [DBG] pgmap v714: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:00:49.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:00:48 smithi086 bash[24289]: cluster 2024-09-16T06:00:48.588584+0000 mgr.a (mgr.14373) 1030 : cluster [DBG] pgmap v714: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:00:49.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:00:48 smithi047 bash[22744]: cluster 2024-09-16T06:00:48.588584+0000 mgr.a (mgr.14373) 1030 : cluster [DBG] pgmap v714: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:00:49.434 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:00:49.435 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:00:49.435 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:00:50.183 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:00:50.183 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:00:50.183 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:00:50.183 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:00:50.183 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:00:51.051 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:00:50 smithi157 bash[24585]: audit 2024-09-16T06:00:49.770267+0000 mgr.a (mgr.14373) 1031 : audit [DBG] from='client.35430 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:00:51.051 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:00:50 smithi157 bash[24585]: cluster 2024-09-16T06:00:50.589442+0000 mgr.a (mgr.14373) 1032 : cluster [DBG] pgmap v715: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:00:51.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:00:50 smithi086 bash[24289]: audit 2024-09-16T06:00:49.770267+0000 mgr.a (mgr.14373) 1031 : audit [DBG] from='client.35430 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:00:51.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:00:50 smithi086 bash[24289]: cluster 2024-09-16T06:00:50.589442+0000 mgr.a (mgr.14373) 1032 : cluster [DBG] pgmap v715: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:00:51.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:00:50 smithi047 bash[22744]: audit 2024-09-16T06:00:49.770267+0000 mgr.a (mgr.14373) 1031 : audit [DBG] from='client.35430 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:00:51.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:00:50 smithi047 bash[22744]: cluster 2024-09-16T06:00:50.589442+0000 mgr.a (mgr.14373) 1032 : cluster [DBG] pgmap v715: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:00:53.051 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:00:52 smithi157 bash[24585]: cluster 2024-09-16T06:00:52.591697+0000 mgr.a (mgr.14373) 1033 : cluster [DBG] pgmap v716: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:00:53.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:00:52 smithi086 bash[24289]: cluster 2024-09-16T06:00:52.591697+0000 mgr.a (mgr.14373) 1033 : cluster [DBG] pgmap v716: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:00:53.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:00:52 smithi047 bash[22744]: cluster 2024-09-16T06:00:52.591697+0000 mgr.a (mgr.14373) 1033 : cluster [DBG] pgmap v716: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:00:55.051 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:00:54 smithi157 bash[24585]: cluster 2024-09-16T06:00:54.592449+0000 mgr.a (mgr.14373) 1034 : cluster [DBG] pgmap v717: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:00:55.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:00:54 smithi086 bash[24289]: cluster 2024-09-16T06:00:54.592449+0000 mgr.a (mgr.14373) 1034 : cluster [DBG] pgmap v717: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:00:55.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:00:54 smithi047 bash[22744]: cluster 2024-09-16T06:00:54.592449+0000 mgr.a (mgr.14373) 1034 : cluster [DBG] pgmap v717: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:00:55.184 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:00:55.185 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:00:55.185 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:00:55.925 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:00:55.925 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:00:55.925 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:00:55.925 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:00:55.926 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:00:56.051 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:00:55 smithi157 bash[24585]: audit 2024-09-16T06:00:55.523104+0000 mgr.a (mgr.14373) 1035 : audit [DBG] from='client.35508 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:00:56.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:00:55 smithi086 bash[24289]: audit 2024-09-16T06:00:55.523104+0000 mgr.a (mgr.14373) 1035 : audit [DBG] from='client.35508 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:00:56.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:00:55 smithi047 bash[22744]: audit 2024-09-16T06:00:55.523104+0000 mgr.a (mgr.14373) 1035 : audit [DBG] from='client.35508 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:00:57.051 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:00:56 smithi157 bash[24585]: cluster 2024-09-16T06:00:56.594703+0000 mgr.a (mgr.14373) 1036 : cluster [DBG] pgmap v718: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:00:57.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:00:56 smithi086 bash[24289]: cluster 2024-09-16T06:00:56.594703+0000 mgr.a (mgr.14373) 1036 : cluster [DBG] pgmap v718: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:00:57.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:00:56 smithi047 bash[22744]: cluster 2024-09-16T06:00:56.594703+0000 mgr.a (mgr.14373) 1036 : cluster [DBG] pgmap v718: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:00:58.301 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:00:57 smithi157 bash[24585]: audit 2024-09-16T06:00:57.890285+0000 mon.b (mon.2) 142 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T06:00:58.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:00:57 smithi086 bash[24289]: audit 2024-09-16T06:00:57.890285+0000 mon.b (mon.2) 142 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T06:00:58.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:00:57 smithi047 bash[22744]: audit 2024-09-16T06:00:57.890285+0000 mon.b (mon.2) 142 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T06:00:59.301 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:00:58 smithi157 bash[24585]: cluster 2024-09-16T06:00:58.595116+0000 mgr.a (mgr.14373) 1037 : cluster [DBG] pgmap v719: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:00:59.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:00:58 smithi157 bash[24585]: audit 2024-09-16T06:00:58.728045+0000 mon.b (mon.2) 143 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T06:00:59.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:00:58 smithi157 bash[24585]: audit 2024-09-16T06:00:58.730276+0000 mon.b (mon.2) 144 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T06:00:59.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:00:58 smithi157 bash[24585]: audit 2024-09-16T06:00:58.746280+0000 mon.a (mon.0) 628 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:00:59.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:00:58 smithi157 bash[24585]: audit 2024-09-16T06:00:58.748001+0000 mon.b (mon.2) 145 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:00:59.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:00:58 smithi086 bash[24289]: cluster 2024-09-16T06:00:58.595116+0000 mgr.a (mgr.14373) 1037 : cluster [DBG] pgmap v719: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:00:59.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:00:58 smithi086 bash[24289]: audit 2024-09-16T06:00:58.728045+0000 mon.b (mon.2) 143 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T06:00:59.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:00:58 smithi086 bash[24289]: audit 2024-09-16T06:00:58.730276+0000 mon.b (mon.2) 144 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T06:00:59.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:00:58 smithi086 bash[24289]: audit 2024-09-16T06:00:58.746280+0000 mon.a (mon.0) 628 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:00:59.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:00:58 smithi086 bash[24289]: audit 2024-09-16T06:00:58.748001+0000 mon.b (mon.2) 145 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:00:59.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:00:58 smithi047 bash[22744]: cluster 2024-09-16T06:00:58.595116+0000 mgr.a (mgr.14373) 1037 : cluster [DBG] pgmap v719: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:00:59.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:00:58 smithi047 bash[22744]: audit 2024-09-16T06:00:58.728045+0000 mon.b (mon.2) 143 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T06:00:59.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:00:58 smithi047 bash[22744]: audit 2024-09-16T06:00:58.730276+0000 mon.b (mon.2) 144 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T06:00:59.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:00:58 smithi047 bash[22744]: audit 2024-09-16T06:00:58.746280+0000 mon.a (mon.0) 628 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:00:59.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:00:58 smithi047 bash[22744]: audit 2024-09-16T06:00:58.748001+0000 mon.b (mon.2) 145 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:00:59.837 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 06:00:59 smithi047 bash[22994]: debug 2024-09-16T06:00:59.466+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T06:00:59.837 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 06:00:59 smithi047 bash[22994]: debug 2024-09-16T06:00:59.466+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T06:01:00.301 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:00:59 smithi157 bash[24585]: audit 2024-09-16T06:00:58.754560+0000 mgr.a (mgr.14373) 1038 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:01:00.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:00:59 smithi157 bash[24585]: audit 2024-09-16T06:00:59.472026+0000 mgr.a (mgr.14373) 1039 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T06:01:00.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:00:59 smithi157 bash[24585]: cephadm 2024-09-16T06:00:59.474077+0000 mgr.a (mgr.14373) 1040 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T06:01:00.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:00:59 smithi086 bash[24289]: audit 2024-09-16T06:00:58.754560+0000 mgr.a (mgr.14373) 1038 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:01:00.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:00:59 smithi086 bash[24289]: audit 2024-09-16T06:00:59.472026+0000 mgr.a (mgr.14373) 1039 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T06:01:00.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:00:59 smithi086 bash[24289]: cephadm 2024-09-16T06:00:59.474077+0000 mgr.a (mgr.14373) 1040 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T06:01:00.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:00:59 smithi047 bash[22744]: audit 2024-09-16T06:00:58.754560+0000 mgr.a (mgr.14373) 1038 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:01:00.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:00:59 smithi047 bash[22744]: audit 2024-09-16T06:00:59.472026+0000 mgr.a (mgr.14373) 1039 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T06:01:00.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:00:59 smithi047 bash[22744]: cephadm 2024-09-16T06:00:59.474077+0000 mgr.a (mgr.14373) 1040 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T06:01:00.926 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:01:00.927 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:01:00.928 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:01:01.301 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:01:00 smithi157 bash[24585]: cluster 2024-09-16T06:01:00.595934+0000 mgr.a (mgr.14373) 1041 : cluster [DBG] pgmap v720: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:01:01.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:01:00 smithi086 bash[24289]: cluster 2024-09-16T06:01:00.595934+0000 mgr.a (mgr.14373) 1041 : cluster [DBG] pgmap v720: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:01:01.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:01:00 smithi047 bash[22744]: cluster 2024-09-16T06:01:00.595934+0000 mgr.a (mgr.14373) 1041 : cluster [DBG] pgmap v720: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:01:01.692 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:01:01.692 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:01:01.692 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:01:01.692 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:01:01.692 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:01:02.301 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:01:01 smithi157 bash[24585]: audit 2024-09-16T06:01:01.264234+0000 mgr.a (mgr.14373) 1042 : audit [DBG] from='client.35691 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:01:02.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:01:01 smithi086 bash[24289]: audit 2024-09-16T06:01:01.264234+0000 mgr.a (mgr.14373) 1042 : audit [DBG] from='client.35691 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:01:02.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:01:01 smithi047 bash[22744]: audit 2024-09-16T06:01:01.264234+0000 mgr.a (mgr.14373) 1042 : audit [DBG] from='client.35691 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:01:03.301 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:01:02 smithi157 bash[24585]: cluster 2024-09-16T06:01:02.598661+0000 mgr.a (mgr.14373) 1043 : cluster [DBG] pgmap v721: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:01:03.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:01:02 smithi086 bash[24289]: cluster 2024-09-16T06:01:02.598661+0000 mgr.a (mgr.14373) 1043 : cluster [DBG] pgmap v721: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:01:03.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:01:02 smithi047 bash[22744]: cluster 2024-09-16T06:01:02.598661+0000 mgr.a (mgr.14373) 1043 : cluster [DBG] pgmap v721: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:01:05.051 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:01:04 smithi157 bash[24585]: cluster 2024-09-16T06:01:04.599453+0000 mgr.a (mgr.14373) 1044 : cluster [DBG] pgmap v722: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T06:01:05.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:01:04 smithi086 bash[24289]: cluster 2024-09-16T06:01:04.599453+0000 mgr.a (mgr.14373) 1044 : cluster [DBG] pgmap v722: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T06:01:05.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:01:04 smithi047 bash[22744]: cluster 2024-09-16T06:01:04.599453+0000 mgr.a (mgr.14373) 1044 : cluster [DBG] pgmap v722: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T06:01:06.693 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:01:06.694 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:01:06.694 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:01:07.051 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:01:06 smithi157 bash[24585]: cluster 2024-09-16T06:01:06.601321+0000 mgr.a (mgr.14373) 1045 : cluster [DBG] pgmap v723: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:01:07.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:01:06 smithi086 bash[24289]: cluster 2024-09-16T06:01:06.601321+0000 mgr.a (mgr.14373) 1045 : cluster [DBG] pgmap v723: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:01:07.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:01:06 smithi047 bash[22744]: cluster 2024-09-16T06:01:06.601321+0000 mgr.a (mgr.14373) 1045 : cluster [DBG] pgmap v723: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:01:07.456 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:01:07.456 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:01:07.456 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:01:07.457 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:01:07.457 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:01:08.051 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:01:07 smithi157 bash[24585]: audit 2024-09-16T06:01:07.034108+0000 mgr.a (mgr.14373) 1046 : audit [DBG] from='client.35766 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:01:08.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:01:07 smithi086 bash[24289]: audit 2024-09-16T06:01:07.034108+0000 mgr.a (mgr.14373) 1046 : audit [DBG] from='client.35766 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:01:08.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:01:07 smithi047 bash[22744]: audit 2024-09-16T06:01:07.034108+0000 mgr.a (mgr.14373) 1046 : audit [DBG] from='client.35766 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:01:09.051 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:01:08 smithi157 bash[24585]: cluster 2024-09-16T06:01:08.602222+0000 mgr.a (mgr.14373) 1047 : cluster [DBG] pgmap v724: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T06:01:09.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:01:08 smithi086 bash[24289]: cluster 2024-09-16T06:01:08.602222+0000 mgr.a (mgr.14373) 1047 : cluster [DBG] pgmap v724: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T06:01:09.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:01:08 smithi047 bash[22744]: cluster 2024-09-16T06:01:08.602222+0000 mgr.a (mgr.14373) 1047 : cluster [DBG] pgmap v724: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T06:01:11.051 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:01:10 smithi157 bash[24585]: cluster 2024-09-16T06:01:10.603088+0000 mgr.a (mgr.14373) 1048 : cluster [DBG] pgmap v725: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T06:01:11.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:01:10 smithi086 bash[24289]: cluster 2024-09-16T06:01:10.603088+0000 mgr.a (mgr.14373) 1048 : cluster [DBG] pgmap v725: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T06:01:11.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:01:10 smithi047 bash[22744]: cluster 2024-09-16T06:01:10.603088+0000 mgr.a (mgr.14373) 1048 : cluster [DBG] pgmap v725: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T06:01:12.458 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:01:12.459 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:01:12.459 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:01:13.051 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:01:12 smithi157 bash[24585]: cluster 2024-09-16T06:01:12.604396+0000 mgr.a (mgr.14373) 1049 : cluster [DBG] pgmap v726: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:01:13.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:01:12 smithi086 bash[24289]: cluster 2024-09-16T06:01:12.604396+0000 mgr.a (mgr.14373) 1049 : cluster [DBG] pgmap v726: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:01:13.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:01:12 smithi047 bash[22744]: cluster 2024-09-16T06:01:12.604396+0000 mgr.a (mgr.14373) 1049 : cluster [DBG] pgmap v726: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:01:13.224 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:01:13.224 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:01:13.224 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:01:13.224 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:01:13.224 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:01:14.051 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:01:13 smithi157 bash[24585]: audit 2024-09-16T06:01:12.800298+0000 mgr.a (mgr.14373) 1050 : audit [DBG] from='client.35844 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:01:14.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:01:13 smithi086 bash[24289]: audit 2024-09-16T06:01:12.800298+0000 mgr.a (mgr.14373) 1050 : audit [DBG] from='client.35844 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:01:14.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:01:13 smithi047 bash[22744]: audit 2024-09-16T06:01:12.800298+0000 mgr.a (mgr.14373) 1050 : audit [DBG] from='client.35844 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:01:15.051 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:01:14 smithi157 bash[24585]: cluster 2024-09-16T06:01:14.605231+0000 mgr.a (mgr.14373) 1051 : cluster [DBG] pgmap v727: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:01:15.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:01:14 smithi086 bash[24289]: cluster 2024-09-16T06:01:14.605231+0000 mgr.a (mgr.14373) 1051 : cluster [DBG] pgmap v727: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:01:15.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:01:14 smithi047 bash[22744]: cluster 2024-09-16T06:01:14.605231+0000 mgr.a (mgr.14373) 1051 : cluster [DBG] pgmap v727: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:01:18.051 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:01:17 smithi157 bash[24585]: cluster 2024-09-16T06:01:16.607432+0000 mgr.a (mgr.14373) 1052 : cluster [DBG] pgmap v728: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:01:18.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:01:17 smithi086 bash[24289]: cluster 2024-09-16T06:01:16.607432+0000 mgr.a (mgr.14373) 1052 : cluster [DBG] pgmap v728: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:01:18.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:01:17 smithi047 bash[22744]: cluster 2024-09-16T06:01:16.607432+0000 mgr.a (mgr.14373) 1052 : cluster [DBG] pgmap v728: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:01:18.226 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:01:18.226 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:01:18.227 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:01:18.967 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:01:18.967 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:01:18.967 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:01:18.967 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:01:18.967 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:01:19.051 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:01:18 smithi157 bash[24585]: audit 2024-09-16T06:01:18.561561+0000 mgr.a (mgr.14373) 1053 : audit [DBG] from='client.35922 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:01:19.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:01:18 smithi086 bash[24289]: audit 2024-09-16T06:01:18.561561+0000 mgr.a (mgr.14373) 1053 : audit [DBG] from='client.35922 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:01:19.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:01:18 smithi047 bash[22744]: audit 2024-09-16T06:01:18.561561+0000 mgr.a (mgr.14373) 1053 : audit [DBG] from='client.35922 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:01:20.051 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:01:19 smithi157 bash[24585]: cluster 2024-09-16T06:01:18.608030+0000 mgr.a (mgr.14373) 1054 : cluster [DBG] pgmap v729: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:01:20.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:01:19 smithi086 bash[24289]: cluster 2024-09-16T06:01:18.608030+0000 mgr.a (mgr.14373) 1054 : cluster [DBG] pgmap v729: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:01:20.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:01:19 smithi047 bash[22744]: cluster 2024-09-16T06:01:18.608030+0000 mgr.a (mgr.14373) 1054 : cluster [DBG] pgmap v729: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:01:22.051 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:01:21 smithi157 bash[24585]: cluster 2024-09-16T06:01:20.608877+0000 mgr.a (mgr.14373) 1055 : cluster [DBG] pgmap v730: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:01:22.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:01:21 smithi086 bash[24289]: cluster 2024-09-16T06:01:20.608877+0000 mgr.a (mgr.14373) 1055 : cluster [DBG] pgmap v730: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:01:22.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:01:21 smithi047 bash[22744]: cluster 2024-09-16T06:01:20.608877+0000 mgr.a (mgr.14373) 1055 : cluster [DBG] pgmap v730: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:01:23.968 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:01:23.969 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:01:23.969 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:01:24.051 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:01:23 smithi157 bash[24585]: cluster 2024-09-16T06:01:22.611109+0000 mgr.a (mgr.14373) 1056 : cluster [DBG] pgmap v731: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:01:24.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:01:23 smithi086 bash[24289]: cluster 2024-09-16T06:01:22.611109+0000 mgr.a (mgr.14373) 1056 : cluster [DBG] pgmap v731: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:01:24.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:01:23 smithi047 bash[22744]: cluster 2024-09-16T06:01:22.611109+0000 mgr.a (mgr.14373) 1056 : cluster [DBG] pgmap v731: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:01:24.703 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:01:24.703 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:01:24.703 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:01:24.704 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:01:24.704 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:01:25.051 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:01:24 smithi157 bash[24585]: audit 2024-09-16T06:01:24.295564+0000 mgr.a (mgr.14373) 1057 : audit [DBG] from='client.35994 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:01:25.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:01:24 smithi086 bash[24289]: audit 2024-09-16T06:01:24.295564+0000 mgr.a (mgr.14373) 1057 : audit [DBG] from='client.35994 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:01:25.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:01:24 smithi047 bash[22744]: audit 2024-09-16T06:01:24.295564+0000 mgr.a (mgr.14373) 1057 : audit [DBG] from='client.35994 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:01:26.051 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:01:25 smithi157 bash[24585]: cluster 2024-09-16T06:01:24.611748+0000 mgr.a (mgr.14373) 1058 : cluster [DBG] pgmap v732: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:01:26.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:01:25 smithi086 bash[24289]: cluster 2024-09-16T06:01:24.611748+0000 mgr.a (mgr.14373) 1058 : cluster [DBG] pgmap v732: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:01:26.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:01:25 smithi047 bash[22744]: cluster 2024-09-16T06:01:24.611748+0000 mgr.a (mgr.14373) 1058 : cluster [DBG] pgmap v732: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:01:28.051 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:01:27 smithi157 bash[24585]: cluster 2024-09-16T06:01:26.613837+0000 mgr.a (mgr.14373) 1059 : cluster [DBG] pgmap v733: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:01:28.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:01:27 smithi086 bash[24289]: cluster 2024-09-16T06:01:26.613837+0000 mgr.a (mgr.14373) 1059 : cluster [DBG] pgmap v733: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:01:28.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:01:27 smithi047 bash[22744]: cluster 2024-09-16T06:01:26.613837+0000 mgr.a (mgr.14373) 1059 : cluster [DBG] pgmap v733: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:01:29.705 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:01:29.705 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:01:29.706 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:01:30.051 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:01:29 smithi157 bash[24585]: cluster 2024-09-16T06:01:28.614630+0000 mgr.a (mgr.14373) 1060 : cluster [DBG] pgmap v734: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:01:30.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:01:29 smithi086 bash[24289]: cluster 2024-09-16T06:01:28.614630+0000 mgr.a (mgr.14373) 1060 : cluster [DBG] pgmap v734: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:01:30.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:01:29 smithi047 bash[22744]: cluster 2024-09-16T06:01:28.614630+0000 mgr.a (mgr.14373) 1060 : cluster [DBG] pgmap v734: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:01:30.468 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:01:30.469 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:01:30.469 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:01:30.469 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:01:30.469 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:01:31.051 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:01:30 smithi157 bash[24585]: audit 2024-09-16T06:01:30.040928+0000 mgr.a (mgr.14373) 1061 : audit [DBG] from='client.36072 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:01:31.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:01:30 smithi086 bash[24289]: audit 2024-09-16T06:01:30.040928+0000 mgr.a (mgr.14373) 1061 : audit [DBG] from='client.36072 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:01:31.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:01:30 smithi047 bash[22744]: audit 2024-09-16T06:01:30.040928+0000 mgr.a (mgr.14373) 1061 : audit [DBG] from='client.36072 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:01:32.051 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:01:31 smithi157 bash[24585]: cluster 2024-09-16T06:01:30.615481+0000 mgr.a (mgr.14373) 1062 : cluster [DBG] pgmap v735: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:01:32.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:01:31 smithi086 bash[24289]: cluster 2024-09-16T06:01:30.615481+0000 mgr.a (mgr.14373) 1062 : cluster [DBG] pgmap v735: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:01:32.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:01:31 smithi047 bash[22744]: cluster 2024-09-16T06:01:30.615481+0000 mgr.a (mgr.14373) 1062 : cluster [DBG] pgmap v735: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:01:34.051 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:01:33 smithi157 bash[24585]: cluster 2024-09-16T06:01:32.617707+0000 mgr.a (mgr.14373) 1063 : cluster [DBG] pgmap v736: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:01:34.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:01:33 smithi086 bash[24289]: cluster 2024-09-16T06:01:32.617707+0000 mgr.a (mgr.14373) 1063 : cluster [DBG] pgmap v736: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:01:34.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:01:33 smithi047 bash[22744]: cluster 2024-09-16T06:01:32.617707+0000 mgr.a (mgr.14373) 1063 : cluster [DBG] pgmap v736: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:01:35.470 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:01:35.470 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:01:35.471 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:01:36.051 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:01:35 smithi157 bash[24585]: cluster 2024-09-16T06:01:34.618501+0000 mgr.a (mgr.14373) 1064 : cluster [DBG] pgmap v737: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:01:36.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:01:35 smithi086 bash[24289]: cluster 2024-09-16T06:01:34.618501+0000 mgr.a (mgr.14373) 1064 : cluster [DBG] pgmap v737: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:01:36.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:01:35 smithi047 bash[22744]: cluster 2024-09-16T06:01:34.618501+0000 mgr.a (mgr.14373) 1064 : cluster [DBG] pgmap v737: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:01:36.215 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:01:36.215 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:01:36.215 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:01:36.215 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:01:36.215 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:01:37.051 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:01:36 smithi157 bash[24585]: audit 2024-09-16T06:01:35.806470+0000 mgr.a (mgr.14373) 1065 : audit [DBG] from='client.36150 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:01:37.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:01:36 smithi086 bash[24289]: audit 2024-09-16T06:01:35.806470+0000 mgr.a (mgr.14373) 1065 : audit [DBG] from='client.36150 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:01:37.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:01:36 smithi047 bash[22744]: audit 2024-09-16T06:01:35.806470+0000 mgr.a (mgr.14373) 1065 : audit [DBG] from='client.36150 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:01:38.051 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:01:37 smithi157 bash[24585]: cluster 2024-09-16T06:01:36.620738+0000 mgr.a (mgr.14373) 1066 : cluster [DBG] pgmap v738: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:01:38.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:01:37 smithi086 bash[24289]: cluster 2024-09-16T06:01:36.620738+0000 mgr.a (mgr.14373) 1066 : cluster [DBG] pgmap v738: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:01:38.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:01:37 smithi047 bash[22744]: cluster 2024-09-16T06:01:36.620738+0000 mgr.a (mgr.14373) 1066 : cluster [DBG] pgmap v738: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:01:40.051 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:01:39 smithi157 bash[24585]: cluster 2024-09-16T06:01:38.621642+0000 mgr.a (mgr.14373) 1067 : cluster [DBG] pgmap v739: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:01:40.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:01:39 smithi086 bash[24289]: cluster 2024-09-16T06:01:38.621642+0000 mgr.a (mgr.14373) 1067 : cluster [DBG] pgmap v739: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:01:40.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:01:39 smithi047 bash[22744]: cluster 2024-09-16T06:01:38.621642+0000 mgr.a (mgr.14373) 1067 : cluster [DBG] pgmap v739: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:01:41.216 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:01:41.217 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:01:41.217 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:01:41.985 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:01:41.985 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:01:41.985 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:01:41.985 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:01:41.985 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:01:42.051 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:01:41 smithi157 bash[24585]: cluster 2024-09-16T06:01:40.622551+0000 mgr.a (mgr.14373) 1068 : cluster [DBG] pgmap v740: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:01:42.051 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:01:41 smithi157 bash[24585]: audit 2024-09-16T06:01:41.556976+0000 mgr.a (mgr.14373) 1069 : audit [DBG] from='client.36225 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:01:42.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:01:41 smithi086 bash[24289]: cluster 2024-09-16T06:01:40.622551+0000 mgr.a (mgr.14373) 1068 : cluster [DBG] pgmap v740: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:01:42.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:01:41 smithi086 bash[24289]: audit 2024-09-16T06:01:41.556976+0000 mgr.a (mgr.14373) 1069 : audit [DBG] from='client.36225 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:01:42.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:01:41 smithi047 bash[22744]: cluster 2024-09-16T06:01:40.622551+0000 mgr.a (mgr.14373) 1068 : cluster [DBG] pgmap v740: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:01:42.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:01:41 smithi047 bash[22744]: audit 2024-09-16T06:01:41.556976+0000 mgr.a (mgr.14373) 1069 : audit [DBG] from='client.36225 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:01:44.051 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:01:43 smithi157 bash[24585]: cluster 2024-09-16T06:01:42.625387+0000 mgr.a (mgr.14373) 1070 : cluster [DBG] pgmap v741: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:01:44.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:01:43 smithi086 bash[24289]: cluster 2024-09-16T06:01:42.625387+0000 mgr.a (mgr.14373) 1070 : cluster [DBG] pgmap v741: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:01:44.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:01:43 smithi047 bash[22744]: cluster 2024-09-16T06:01:42.625387+0000 mgr.a (mgr.14373) 1070 : cluster [DBG] pgmap v741: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:01:46.051 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:01:45 smithi157 bash[24585]: cluster 2024-09-16T06:01:44.626174+0000 mgr.a (mgr.14373) 1071 : cluster [DBG] pgmap v742: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:01:46.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:01:45 smithi086 bash[24289]: cluster 2024-09-16T06:01:44.626174+0000 mgr.a (mgr.14373) 1071 : cluster [DBG] pgmap v742: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:01:46.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:01:45 smithi047 bash[22744]: cluster 2024-09-16T06:01:44.626174+0000 mgr.a (mgr.14373) 1071 : cluster [DBG] pgmap v742: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:01:46.986 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:01:46.987 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:01:46.987 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:01:47.744 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:01:47.744 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:01:47.744 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:01:47.744 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:01:47.744 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:01:48.051 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:01:47 smithi157 bash[24585]: cluster 2024-09-16T06:01:46.628103+0000 mgr.a (mgr.14373) 1072 : cluster [DBG] pgmap v743: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:01:48.051 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:01:47 smithi157 bash[24585]: audit 2024-09-16T06:01:47.325921+0000 mgr.a (mgr.14373) 1073 : audit [DBG] from='client.36300 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:01:48.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:01:47 smithi086 bash[24289]: cluster 2024-09-16T06:01:46.628103+0000 mgr.a (mgr.14373) 1072 : cluster [DBG] pgmap v743: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:01:48.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:01:47 smithi086 bash[24289]: audit 2024-09-16T06:01:47.325921+0000 mgr.a (mgr.14373) 1073 : audit [DBG] from='client.36300 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:01:48.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:01:47 smithi047 bash[22744]: cluster 2024-09-16T06:01:46.628103+0000 mgr.a (mgr.14373) 1072 : cluster [DBG] pgmap v743: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:01:48.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:01:47 smithi047 bash[22744]: audit 2024-09-16T06:01:47.325921+0000 mgr.a (mgr.14373) 1073 : audit [DBG] from='client.36300 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:01:50.051 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:01:49 smithi157 bash[24585]: cluster 2024-09-16T06:01:48.629054+0000 mgr.a (mgr.14373) 1074 : cluster [DBG] pgmap v744: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:01:50.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:01:49 smithi086 bash[24289]: cluster 2024-09-16T06:01:48.629054+0000 mgr.a (mgr.14373) 1074 : cluster [DBG] pgmap v744: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:01:50.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:01:49 smithi047 bash[22744]: cluster 2024-09-16T06:01:48.629054+0000 mgr.a (mgr.14373) 1074 : cluster [DBG] pgmap v744: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:01:52.051 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:01:51 smithi157 bash[24585]: cluster 2024-09-16T06:01:50.629855+0000 mgr.a (mgr.14373) 1075 : cluster [DBG] pgmap v745: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T06:01:52.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:01:51 smithi086 bash[24289]: cluster 2024-09-16T06:01:50.629855+0000 mgr.a (mgr.14373) 1075 : cluster [DBG] pgmap v745: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T06:01:52.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:01:51 smithi047 bash[22744]: cluster 2024-09-16T06:01:50.629855+0000 mgr.a (mgr.14373) 1075 : cluster [DBG] pgmap v745: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T06:01:52.745 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:01:52.746 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:01:52.746 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:01:53.498 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:01:53.498 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:01:53.498 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:01:53.498 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:01:53.498 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:01:54.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:01:53 smithi157 bash[24585]: cluster 2024-09-16T06:01:52.632119+0000 mgr.a (mgr.14373) 1076 : cluster [DBG] pgmap v746: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:01:54.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:01:53 smithi157 bash[24585]: audit 2024-09-16T06:01:53.081485+0000 mgr.a (mgr.14373) 1077 : audit [DBG] from='client.36375 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:01:54.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:01:53 smithi086 bash[24289]: cluster 2024-09-16T06:01:52.632119+0000 mgr.a (mgr.14373) 1076 : cluster [DBG] pgmap v746: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:01:54.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:01:53 smithi086 bash[24289]: audit 2024-09-16T06:01:53.081485+0000 mgr.a (mgr.14373) 1077 : audit [DBG] from='client.36375 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:01:54.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:01:53 smithi047 bash[22744]: cluster 2024-09-16T06:01:52.632119+0000 mgr.a (mgr.14373) 1076 : cluster [DBG] pgmap v746: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:01:54.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:01:53 smithi047 bash[22744]: audit 2024-09-16T06:01:53.081485+0000 mgr.a (mgr.14373) 1077 : audit [DBG] from='client.36375 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:01:56.051 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:01:55 smithi157 bash[24585]: cluster 2024-09-16T06:01:54.633064+0000 mgr.a (mgr.14373) 1078 : cluster [DBG] pgmap v747: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:01:56.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:01:55 smithi086 bash[24289]: cluster 2024-09-16T06:01:54.633064+0000 mgr.a (mgr.14373) 1078 : cluster [DBG] pgmap v747: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:01:56.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:01:55 smithi047 bash[22744]: cluster 2024-09-16T06:01:54.633064+0000 mgr.a (mgr.14373) 1078 : cluster [DBG] pgmap v747: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:01:58.051 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:01:57 smithi157 bash[24585]: cluster 2024-09-16T06:01:56.635274+0000 mgr.a (mgr.14373) 1079 : cluster [DBG] pgmap v748: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:01:58.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:01:57 smithi086 bash[24289]: cluster 2024-09-16T06:01:56.635274+0000 mgr.a (mgr.14373) 1079 : cluster [DBG] pgmap v748: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:01:58.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:01:57 smithi047 bash[22744]: cluster 2024-09-16T06:01:56.635274+0000 mgr.a (mgr.14373) 1079 : cluster [DBG] pgmap v748: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:01:58.499 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:01:58.500 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:01:58.500 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:01:59.277 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:01:59.277 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:01:59.278 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:01:59.278 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:01:59.278 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:02:00.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:01:59 smithi157 bash[24585]: cluster 2024-09-16T06:01:58.635712+0000 mgr.a (mgr.14373) 1080 : cluster [DBG] pgmap v749: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:02:00.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:01:59 smithi157 bash[24585]: audit 2024-09-16T06:01:58.841382+0000 mgr.a (mgr.14373) 1081 : audit [DBG] from='client.36453 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:02:00.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:01:59 smithi157 bash[24585]: audit 2024-09-16T06:01:59.522074+0000 mon.b (mon.2) 146 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T06:02:00.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:01:59 smithi086 bash[24289]: cluster 2024-09-16T06:01:58.635712+0000 mgr.a (mgr.14373) 1080 : cluster [DBG] pgmap v749: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:02:00.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:01:59 smithi086 bash[24289]: audit 2024-09-16T06:01:58.841382+0000 mgr.a (mgr.14373) 1081 : audit [DBG] from='client.36453 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:02:00.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:01:59 smithi086 bash[24289]: audit 2024-09-16T06:01:59.522074+0000 mon.b (mon.2) 146 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T06:02:00.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:01:59 smithi047 bash[22744]: cluster 2024-09-16T06:01:58.635712+0000 mgr.a (mgr.14373) 1080 : cluster [DBG] pgmap v749: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:02:00.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:01:59 smithi047 bash[22744]: audit 2024-09-16T06:01:58.841382+0000 mgr.a (mgr.14373) 1081 : audit [DBG] from='client.36453 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:02:00.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:01:59 smithi047 bash[22744]: audit 2024-09-16T06:01:59.522074+0000 mon.b (mon.2) 146 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T06:02:01.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:02:00 smithi157 bash[24585]: audit 2024-09-16T06:02:00.369061+0000 mon.b (mon.2) 147 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T06:02:01.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:02:00 smithi157 bash[24585]: audit 2024-09-16T06:02:00.371256+0000 mon.b (mon.2) 148 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T06:02:01.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:02:00 smithi157 bash[24585]: audit 2024-09-16T06:02:00.384434+0000 mon.a (mon.0) 629 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:02:01.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:02:00 smithi157 bash[24585]: audit 2024-09-16T06:02:00.388505+0000 mon.b (mon.2) 149 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:02:01.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:02:00 smithi157 bash[24585]: audit 2024-09-16T06:02:00.394906+0000 mgr.a (mgr.14373) 1082 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:02:01.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:02:00 smithi086 bash[24289]: audit 2024-09-16T06:02:00.369061+0000 mon.b (mon.2) 147 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T06:02:01.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:02:00 smithi086 bash[24289]: audit 2024-09-16T06:02:00.371256+0000 mon.b (mon.2) 148 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T06:02:01.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:02:00 smithi086 bash[24289]: audit 2024-09-16T06:02:00.384434+0000 mon.a (mon.0) 629 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:02:01.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:02:00 smithi086 bash[24289]: audit 2024-09-16T06:02:00.388505+0000 mon.b (mon.2) 149 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:02:01.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:02:00 smithi086 bash[24289]: audit 2024-09-16T06:02:00.394906+0000 mgr.a (mgr.14373) 1082 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:02:01.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:02:00 smithi047 bash[22744]: audit 2024-09-16T06:02:00.369061+0000 mon.b (mon.2) 147 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T06:02:01.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:02:00 smithi047 bash[22744]: audit 2024-09-16T06:02:00.371256+0000 mon.b (mon.2) 148 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T06:02:01.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:02:00 smithi047 bash[22744]: audit 2024-09-16T06:02:00.384434+0000 mon.a (mon.0) 629 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:02:01.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:02:00 smithi047 bash[22744]: audit 2024-09-16T06:02:00.388505+0000 mon.b (mon.2) 149 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:02:01.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:02:00 smithi047 bash[22744]: audit 2024-09-16T06:02:00.394906+0000 mgr.a (mgr.14373) 1082 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:02:01.588 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 06:02:01 smithi047 bash[22994]: debug 2024-09-16T06:02:01.112+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T06:02:01.588 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 06:02:01 smithi047 bash[22994]: debug 2024-09-16T06:02:01.112+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T06:02:02.801 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:02:02 smithi157 bash[24585]: cluster 2024-09-16T06:02:00.636289+0000 mgr.a (mgr.14373) 1083 : cluster [DBG] pgmap v750: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:02:02.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:02:02 smithi157 bash[24585]: audit 2024-09-16T06:02:01.114973+0000 mgr.a (mgr.14373) 1084 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T06:02:02.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:02:02 smithi157 bash[24585]: cephadm 2024-09-16T06:02:01.116988+0000 mgr.a (mgr.14373) 1085 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T06:02:02.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:02:02 smithi086 bash[24289]: cluster 2024-09-16T06:02:00.636289+0000 mgr.a (mgr.14373) 1083 : cluster [DBG] pgmap v750: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:02:02.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:02:02 smithi086 bash[24289]: audit 2024-09-16T06:02:01.114973+0000 mgr.a (mgr.14373) 1084 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T06:02:02.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:02:02 smithi086 bash[24289]: cephadm 2024-09-16T06:02:01.116988+0000 mgr.a (mgr.14373) 1085 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T06:02:02.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:02:02 smithi047 bash[22744]: cluster 2024-09-16T06:02:00.636289+0000 mgr.a (mgr.14373) 1083 : cluster [DBG] pgmap v750: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:02:02.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:02:02 smithi047 bash[22744]: audit 2024-09-16T06:02:01.114973+0000 mgr.a (mgr.14373) 1084 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T06:02:02.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:02:02 smithi047 bash[22744]: cephadm 2024-09-16T06:02:01.116988+0000 mgr.a (mgr.14373) 1085 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T06:02:04.279 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:02:04.279 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:02:04.279 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:02:04.801 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:02:04 smithi157 bash[24585]: cluster 2024-09-16T06:02:02.638663+0000 mgr.a (mgr.14373) 1086 : cluster [DBG] pgmap v751: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:02:04.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:02:04 smithi086 bash[24289]: cluster 2024-09-16T06:02:02.638663+0000 mgr.a (mgr.14373) 1086 : cluster [DBG] pgmap v751: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:02:04.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:02:04 smithi047 bash[22744]: cluster 2024-09-16T06:02:02.638663+0000 mgr.a (mgr.14373) 1086 : cluster [DBG] pgmap v751: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:02:05.055 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:02:05.056 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:02:05.056 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:02:05.056 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:02:05.056 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:02:06.801 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:02:06 smithi157 bash[24585]: audit 2024-09-16T06:02:04.620730+0000 mgr.a (mgr.14373) 1087 : audit [DBG] from='client.36636 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:02:06.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:02:06 smithi157 bash[24585]: cluster 2024-09-16T06:02:04.639889+0000 mgr.a (mgr.14373) 1088 : cluster [DBG] pgmap v752: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:02:06.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:02:06 smithi086 bash[24289]: audit 2024-09-16T06:02:04.620730+0000 mgr.a (mgr.14373) 1087 : audit [DBG] from='client.36636 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:02:06.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:02:06 smithi086 bash[24289]: cluster 2024-09-16T06:02:04.639889+0000 mgr.a (mgr.14373) 1088 : cluster [DBG] pgmap v752: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:02:06.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:02:06 smithi047 bash[22744]: audit 2024-09-16T06:02:04.620730+0000 mgr.a (mgr.14373) 1087 : audit [DBG] from='client.36636 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:02:06.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:02:06 smithi047 bash[22744]: cluster 2024-09-16T06:02:04.639889+0000 mgr.a (mgr.14373) 1088 : cluster [DBG] pgmap v752: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:02:08.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:02:08 smithi157 bash[24585]: cluster 2024-09-16T06:02:06.642234+0000 mgr.a (mgr.14373) 1089 : cluster [DBG] pgmap v753: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:02:08.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:02:08 smithi086 bash[24289]: cluster 2024-09-16T06:02:06.642234+0000 mgr.a (mgr.14373) 1089 : cluster [DBG] pgmap v753: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:02:08.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:02:08 smithi047 bash[22744]: cluster 2024-09-16T06:02:06.642234+0000 mgr.a (mgr.14373) 1089 : cluster [DBG] pgmap v753: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:02:10.057 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:02:10.058 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:02:10.058 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:02:10.801 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:02:10.801 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:02:10.801 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:02:10.801 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:02:10.801 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:02:10.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:02:10 smithi157 bash[24585]: cluster 2024-09-16T06:02:08.643006+0000 mgr.a (mgr.14373) 1090 : cluster [DBG] pgmap v754: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:02:10.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:02:10 smithi086 bash[24289]: cluster 2024-09-16T06:02:08.643006+0000 mgr.a (mgr.14373) 1090 : cluster [DBG] pgmap v754: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:02:10.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:02:10 smithi047 bash[22744]: cluster 2024-09-16T06:02:08.643006+0000 mgr.a (mgr.14373) 1090 : cluster [DBG] pgmap v754: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:02:11.801 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:02:11 smithi157 bash[24585]: audit 2024-09-16T06:02:10.392746+0000 mgr.a (mgr.14373) 1091 : audit [DBG] from='client.36714 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:02:11.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:02:11 smithi086 bash[24289]: audit 2024-09-16T06:02:10.392746+0000 mgr.a (mgr.14373) 1091 : audit [DBG] from='client.36714 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:02:11.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:02:11 smithi047 bash[22744]: audit 2024-09-16T06:02:10.392746+0000 mgr.a (mgr.14373) 1091 : audit [DBG] from='client.36714 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:02:12.801 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:02:12 smithi157 bash[24585]: cluster 2024-09-16T06:02:10.643636+0000 mgr.a (mgr.14373) 1092 : cluster [DBG] pgmap v755: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:02:12.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:02:12 smithi086 bash[24289]: cluster 2024-09-16T06:02:10.643636+0000 mgr.a (mgr.14373) 1092 : cluster [DBG] pgmap v755: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:02:12.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:02:12 smithi047 bash[22744]: cluster 2024-09-16T06:02:10.643636+0000 mgr.a (mgr.14373) 1092 : cluster [DBG] pgmap v755: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:02:14.801 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:02:14 smithi157 bash[24585]: cluster 2024-09-16T06:02:12.646039+0000 mgr.a (mgr.14373) 1093 : cluster [DBG] pgmap v756: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:02:14.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:02:14 smithi086 bash[24289]: cluster 2024-09-16T06:02:12.646039+0000 mgr.a (mgr.14373) 1093 : cluster [DBG] pgmap v756: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:02:14.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:02:14 smithi047 bash[22744]: cluster 2024-09-16T06:02:12.646039+0000 mgr.a (mgr.14373) 1093 : cluster [DBG] pgmap v756: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:02:15.802 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:02:15.803 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:02:15.803 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:02:16.568 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:02:16.568 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:02:16.568 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:02:16.569 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:02:16.569 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:02:16.801 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:02:16 smithi157 bash[24585]: cluster 2024-09-16T06:02:14.646813+0000 mgr.a (mgr.14373) 1094 : cluster [DBG] pgmap v757: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:02:16.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:02:16 smithi086 bash[24289]: cluster 2024-09-16T06:02:14.646813+0000 mgr.a (mgr.14373) 1094 : cluster [DBG] pgmap v757: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:02:16.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:02:16 smithi047 bash[22744]: cluster 2024-09-16T06:02:14.646813+0000 mgr.a (mgr.14373) 1094 : cluster [DBG] pgmap v757: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:02:17.801 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:02:17 smithi157 bash[24585]: audit 2024-09-16T06:02:16.140616+0000 mgr.a (mgr.14373) 1095 : audit [DBG] from='client.36792 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:02:17.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:02:17 smithi086 bash[24289]: audit 2024-09-16T06:02:16.140616+0000 mgr.a (mgr.14373) 1095 : audit [DBG] from='client.36792 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:02:17.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:02:17 smithi047 bash[22744]: audit 2024-09-16T06:02:16.140616+0000 mgr.a (mgr.14373) 1095 : audit [DBG] from='client.36792 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:02:18.801 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:02:18 smithi157 bash[24585]: cluster 2024-09-16T06:02:16.648184+0000 mgr.a (mgr.14373) 1096 : cluster [DBG] pgmap v758: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-16T06:02:18.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:02:18 smithi086 bash[24289]: cluster 2024-09-16T06:02:16.648184+0000 mgr.a (mgr.14373) 1096 : cluster [DBG] pgmap v758: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-16T06:02:18.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:02:18 smithi047 bash[22744]: cluster 2024-09-16T06:02:16.648184+0000 mgr.a (mgr.14373) 1096 : cluster [DBG] pgmap v758: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-16T06:02:20.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:02:20 smithi157 bash[24585]: cluster 2024-09-16T06:02:18.648913+0000 mgr.a (mgr.14373) 1097 : cluster [DBG] pgmap v759: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T06:02:20.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:02:20 smithi086 bash[24289]: cluster 2024-09-16T06:02:18.648913+0000 mgr.a (mgr.14373) 1097 : cluster [DBG] pgmap v759: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T06:02:20.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:02:20 smithi047 bash[22744]: cluster 2024-09-16T06:02:18.648913+0000 mgr.a (mgr.14373) 1097 : cluster [DBG] pgmap v759: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T06:02:21.570 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:02:21.570 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:02:21.571 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:02:22.308 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:02:22.309 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:02:22.309 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:02:22.309 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:02:22.309 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:02:22.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:02:22 smithi157 bash[24585]: cluster 2024-09-16T06:02:20.649673+0000 mgr.a (mgr.14373) 1098 : cluster [DBG] pgmap v760: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T06:02:22.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:02:22 smithi086 bash[24289]: cluster 2024-09-16T06:02:20.649673+0000 mgr.a (mgr.14373) 1098 : cluster [DBG] pgmap v760: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T06:02:22.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:02:22 smithi047 bash[22744]: cluster 2024-09-16T06:02:20.649673+0000 mgr.a (mgr.14373) 1098 : cluster [DBG] pgmap v760: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T06:02:23.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:02:23 smithi157 bash[24585]: audit 2024-09-16T06:02:21.909124+0000 mgr.a (mgr.14373) 1099 : audit [DBG] from='client.36870 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:02:23.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:02:23 smithi086 bash[24289]: audit 2024-09-16T06:02:21.909124+0000 mgr.a (mgr.14373) 1099 : audit [DBG] from='client.36870 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:02:23.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:02:23 smithi047 bash[22744]: audit 2024-09-16T06:02:21.909124+0000 mgr.a (mgr.14373) 1099 : audit [DBG] from='client.36870 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:02:24.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:02:24 smithi157 bash[24585]: cluster 2024-09-16T06:02:22.652471+0000 mgr.a (mgr.14373) 1100 : cluster [DBG] pgmap v761: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:02:24.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:02:24 smithi086 bash[24289]: cluster 2024-09-16T06:02:22.652471+0000 mgr.a (mgr.14373) 1100 : cluster [DBG] pgmap v761: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:02:24.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:02:24 smithi047 bash[22744]: cluster 2024-09-16T06:02:22.652471+0000 mgr.a (mgr.14373) 1100 : cluster [DBG] pgmap v761: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:02:26.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:02:26 smithi157 bash[24585]: cluster 2024-09-16T06:02:24.653244+0000 mgr.a (mgr.14373) 1101 : cluster [DBG] pgmap v762: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:02:26.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:02:26 smithi086 bash[24289]: cluster 2024-09-16T06:02:24.653244+0000 mgr.a (mgr.14373) 1101 : cluster [DBG] pgmap v762: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:02:26.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:02:26 smithi047 bash[22744]: cluster 2024-09-16T06:02:24.653244+0000 mgr.a (mgr.14373) 1101 : cluster [DBG] pgmap v762: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:02:27.310 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:02:27.311 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:02:27.311 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:02:28.052 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:02:28.052 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:02:28.053 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:02:28.053 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:02:28.053 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:02:28.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:02:28 smithi157 bash[24585]: cluster 2024-09-16T06:02:26.655198+0000 mgr.a (mgr.14373) 1102 : cluster [DBG] pgmap v763: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:02:28.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:02:28 smithi086 bash[24289]: cluster 2024-09-16T06:02:26.655198+0000 mgr.a (mgr.14373) 1102 : cluster [DBG] pgmap v763: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:02:28.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:02:28 smithi047 bash[22744]: cluster 2024-09-16T06:02:26.655198+0000 mgr.a (mgr.14373) 1102 : cluster [DBG] pgmap v763: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:02:29.738 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:02:29 smithi157 bash[24585]: audit 2024-09-16T06:02:27.645752+0000 mgr.a (mgr.14373) 1103 : audit [DBG] from='client.36948 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:02:29.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:02:29 smithi086 bash[24289]: audit 2024-09-16T06:02:27.645752+0000 mgr.a (mgr.14373) 1103 : audit [DBG] from='client.36948 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:02:29.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:02:29 smithi047 bash[22744]: audit 2024-09-16T06:02:27.645752+0000 mgr.a (mgr.14373) 1103 : audit [DBG] from='client.36948 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:02:30.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:02:30 smithi157 bash[24585]: cluster 2024-09-16T06:02:28.656154+0000 mgr.a (mgr.14373) 1104 : cluster [DBG] pgmap v764: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-16T06:02:30.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:02:30 smithi086 bash[24289]: cluster 2024-09-16T06:02:28.656154+0000 mgr.a (mgr.14373) 1104 : cluster [DBG] pgmap v764: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-16T06:02:30.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:02:30 smithi047 bash[22744]: cluster 2024-09-16T06:02:28.656154+0000 mgr.a (mgr.14373) 1104 : cluster [DBG] pgmap v764: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-16T06:02:32.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:02:32 smithi157 bash[24585]: cluster 2024-09-16T06:02:30.656955+0000 mgr.a (mgr.14373) 1105 : cluster [DBG] pgmap v765: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-16T06:02:32.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:02:32 smithi086 bash[24289]: cluster 2024-09-16T06:02:30.656955+0000 mgr.a (mgr.14373) 1105 : cluster [DBG] pgmap v765: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-16T06:02:32.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:02:32 smithi047 bash[22744]: cluster 2024-09-16T06:02:30.656955+0000 mgr.a (mgr.14373) 1105 : cluster [DBG] pgmap v765: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-16T06:02:33.053 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:02:33.054 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:02:33.054 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:02:33.831 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:02:33.831 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:02:33.831 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:02:33.831 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:02:33.831 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:02:34.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:02:34 smithi157 bash[24585]: cluster 2024-09-16T06:02:32.659214+0000 mgr.a (mgr.14373) 1106 : cluster [DBG] pgmap v766: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-16T06:02:34.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:02:34 smithi157 bash[24585]: audit 2024-09-16T06:02:33.394834+0000 mgr.a (mgr.14373) 1107 : audit [DBG] from='client.37026 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:02:34.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:02:34 smithi086 bash[24289]: cluster 2024-09-16T06:02:32.659214+0000 mgr.a (mgr.14373) 1106 : cluster [DBG] pgmap v766: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-16T06:02:34.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:02:34 smithi086 bash[24289]: audit 2024-09-16T06:02:33.394834+0000 mgr.a (mgr.14373) 1107 : audit [DBG] from='client.37026 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:02:34.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:02:34 smithi047 bash[22744]: cluster 2024-09-16T06:02:32.659214+0000 mgr.a (mgr.14373) 1106 : cluster [DBG] pgmap v766: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-16T06:02:34.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:02:34 smithi047 bash[22744]: audit 2024-09-16T06:02:33.394834+0000 mgr.a (mgr.14373) 1107 : audit [DBG] from='client.37026 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:02:36.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:02:36 smithi157 bash[24585]: cluster 2024-09-16T06:02:34.660180+0000 mgr.a (mgr.14373) 1108 : cluster [DBG] pgmap v767: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:02:36.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:02:36 smithi086 bash[24289]: cluster 2024-09-16T06:02:34.660180+0000 mgr.a (mgr.14373) 1108 : cluster [DBG] pgmap v767: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:02:36.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:02:36 smithi047 bash[22744]: cluster 2024-09-16T06:02:34.660180+0000 mgr.a (mgr.14373) 1108 : cluster [DBG] pgmap v767: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:02:38.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:02:38 smithi157 bash[24585]: cluster 2024-09-16T06:02:36.662420+0000 mgr.a (mgr.14373) 1109 : cluster [DBG] pgmap v768: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:02:38.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:02:38 smithi086 bash[24289]: cluster 2024-09-16T06:02:36.662420+0000 mgr.a (mgr.14373) 1109 : cluster [DBG] pgmap v768: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:02:38.832 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:02:38.833 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:02:38.833 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:02:38.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:02:38 smithi047 bash[22744]: cluster 2024-09-16T06:02:36.662420+0000 mgr.a (mgr.14373) 1109 : cluster [DBG] pgmap v768: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:02:39.609 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:02:39.609 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:02:39.610 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:02:39.610 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:02:39.610 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:02:40.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:02:40 smithi157 bash[24585]: cluster 2024-09-16T06:02:38.663200+0000 mgr.a (mgr.14373) 1110 : cluster [DBG] pgmap v769: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:02:40.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:02:40 smithi157 bash[24585]: audit 2024-09-16T06:02:39.175692+0000 mgr.a (mgr.14373) 1111 : audit [DBG] from='client.37101 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:02:40.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:02:40 smithi086 bash[24289]: cluster 2024-09-16T06:02:38.663200+0000 mgr.a (mgr.14373) 1110 : cluster [DBG] pgmap v769: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:02:40.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:02:40 smithi086 bash[24289]: audit 2024-09-16T06:02:39.175692+0000 mgr.a (mgr.14373) 1111 : audit [DBG] from='client.37101 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:02:40.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:02:40 smithi047 bash[22744]: cluster 2024-09-16T06:02:38.663200+0000 mgr.a (mgr.14373) 1110 : cluster [DBG] pgmap v769: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:02:40.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:02:40 smithi047 bash[22744]: audit 2024-09-16T06:02:39.175692+0000 mgr.a (mgr.14373) 1111 : audit [DBG] from='client.37101 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:02:42.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:02:42 smithi157 bash[24585]: cluster 2024-09-16T06:02:40.664084+0000 mgr.a (mgr.14373) 1112 : cluster [DBG] pgmap v770: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:02:42.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:02:42 smithi086 bash[24289]: cluster 2024-09-16T06:02:40.664084+0000 mgr.a (mgr.14373) 1112 : cluster [DBG] pgmap v770: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:02:42.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:02:42 smithi047 bash[22744]: cluster 2024-09-16T06:02:40.664084+0000 mgr.a (mgr.14373) 1112 : cluster [DBG] pgmap v770: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:02:44.611 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:02:44.611 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:02:44.612 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:02:44.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:02:44 smithi157 bash[24585]: cluster 2024-09-16T06:02:42.666318+0000 mgr.a (mgr.14373) 1113 : cluster [DBG] pgmap v771: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:02:44.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:02:44 smithi086 bash[24289]: cluster 2024-09-16T06:02:42.666318+0000 mgr.a (mgr.14373) 1113 : cluster [DBG] pgmap v771: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:02:44.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:02:44 smithi047 bash[22744]: cluster 2024-09-16T06:02:42.666318+0000 mgr.a (mgr.14373) 1113 : cluster [DBG] pgmap v771: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:02:45.381 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:02:45.381 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:02:45.381 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:02:45.381 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:02:45.382 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:02:46.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:02:46 smithi157 bash[24585]: cluster 2024-09-16T06:02:44.667108+0000 mgr.a (mgr.14373) 1114 : cluster [DBG] pgmap v772: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:02:46.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:02:46 smithi157 bash[24585]: audit 2024-09-16T06:02:44.950541+0000 mgr.a (mgr.14373) 1115 : audit [DBG] from='client.37170 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:02:46.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:02:46 smithi086 bash[24289]: cluster 2024-09-16T06:02:44.667108+0000 mgr.a (mgr.14373) 1114 : cluster [DBG] pgmap v772: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:02:46.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:02:46 smithi086 bash[24289]: audit 2024-09-16T06:02:44.950541+0000 mgr.a (mgr.14373) 1115 : audit [DBG] from='client.37170 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:02:46.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:02:46 smithi047 bash[22744]: cluster 2024-09-16T06:02:44.667108+0000 mgr.a (mgr.14373) 1114 : cluster [DBG] pgmap v772: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:02:46.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:02:46 smithi047 bash[22744]: audit 2024-09-16T06:02:44.950541+0000 mgr.a (mgr.14373) 1115 : audit [DBG] from='client.37170 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:02:48.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:02:48 smithi157 bash[24585]: cluster 2024-09-16T06:02:46.669421+0000 mgr.a (mgr.14373) 1116 : cluster [DBG] pgmap v773: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:02:48.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:02:48 smithi086 bash[24289]: cluster 2024-09-16T06:02:46.669421+0000 mgr.a (mgr.14373) 1116 : cluster [DBG] pgmap v773: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:02:48.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:02:48 smithi047 bash[22744]: cluster 2024-09-16T06:02:46.669421+0000 mgr.a (mgr.14373) 1116 : cluster [DBG] pgmap v773: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:02:50.383 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:02:50.383 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:02:50.383 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:02:50.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:02:50 smithi157 bash[24585]: cluster 2024-09-16T06:02:48.670194+0000 mgr.a (mgr.14373) 1117 : cluster [DBG] pgmap v774: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:02:50.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:02:50 smithi086 bash[24289]: cluster 2024-09-16T06:02:48.670194+0000 mgr.a (mgr.14373) 1117 : cluster [DBG] pgmap v774: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:02:50.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:02:50 smithi047 bash[22744]: cluster 2024-09-16T06:02:48.670194+0000 mgr.a (mgr.14373) 1117 : cluster [DBG] pgmap v774: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:02:51.145 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:02:51.145 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:02:51.145 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:02:51.145 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:02:51.146 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:02:52.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:02:52 smithi157 bash[24585]: cluster 2024-09-16T06:02:50.670729+0000 mgr.a (mgr.14373) 1118 : cluster [DBG] pgmap v775: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:02:52.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:02:52 smithi157 bash[24585]: audit 2024-09-16T06:02:50.720757+0000 mgr.a (mgr.14373) 1119 : audit [DBG] from='client.37245 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:02:52.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:02:52 smithi086 bash[24289]: cluster 2024-09-16T06:02:50.670729+0000 mgr.a (mgr.14373) 1118 : cluster [DBG] pgmap v775: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:02:52.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:02:52 smithi086 bash[24289]: audit 2024-09-16T06:02:50.720757+0000 mgr.a (mgr.14373) 1119 : audit [DBG] from='client.37245 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:02:52.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:02:52 smithi047 bash[22744]: cluster 2024-09-16T06:02:50.670729+0000 mgr.a (mgr.14373) 1118 : cluster [DBG] pgmap v775: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:02:52.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:02:52 smithi047 bash[22744]: audit 2024-09-16T06:02:50.720757+0000 mgr.a (mgr.14373) 1119 : audit [DBG] from='client.37245 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:02:54.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:02:54 smithi157 bash[24585]: cluster 2024-09-16T06:02:52.673055+0000 mgr.a (mgr.14373) 1120 : cluster [DBG] pgmap v776: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:02:54.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:02:54 smithi086 bash[24289]: cluster 2024-09-16T06:02:52.673055+0000 mgr.a (mgr.14373) 1120 : cluster [DBG] pgmap v776: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:02:54.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:02:54 smithi047 bash[22744]: cluster 2024-09-16T06:02:52.673055+0000 mgr.a (mgr.14373) 1120 : cluster [DBG] pgmap v776: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:02:56.147 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:02:56.148 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:02:56.148 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:02:56.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:02:56 smithi157 bash[24585]: cluster 2024-09-16T06:02:54.673821+0000 mgr.a (mgr.14373) 1121 : cluster [DBG] pgmap v777: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:02:56.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:02:56 smithi086 bash[24289]: cluster 2024-09-16T06:02:54.673821+0000 mgr.a (mgr.14373) 1121 : cluster [DBG] pgmap v777: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:02:56.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:02:56 smithi047 bash[22744]: cluster 2024-09-16T06:02:54.673821+0000 mgr.a (mgr.14373) 1121 : cluster [DBG] pgmap v777: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:02:56.902 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:02:56.902 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:02:56.902 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:02:56.902 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:02:56.902 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:02:57.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:02:57 smithi157 bash[24585]: audit 2024-09-16T06:02:56.485096+0000 mgr.a (mgr.14373) 1122 : audit [DBG] from='client.37323 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:02:57.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:02:57 smithi086 bash[24289]: audit 2024-09-16T06:02:56.485096+0000 mgr.a (mgr.14373) 1122 : audit [DBG] from='client.37323 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:02:57.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:02:57 smithi047 bash[22744]: audit 2024-09-16T06:02:56.485096+0000 mgr.a (mgr.14373) 1122 : audit [DBG] from='client.37323 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:02:58.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:02:58 smithi157 bash[24585]: cluster 2024-09-16T06:02:56.675214+0000 mgr.a (mgr.14373) 1123 : cluster [DBG] pgmap v778: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:02:58.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:02:58 smithi086 bash[24289]: cluster 2024-09-16T06:02:56.675214+0000 mgr.a (mgr.14373) 1123 : cluster [DBG] pgmap v778: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:02:58.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:02:58 smithi047 bash[22744]: cluster 2024-09-16T06:02:56.675214+0000 mgr.a (mgr.14373) 1123 : cluster [DBG] pgmap v778: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:03:00.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:03:00 smithi157 bash[24585]: cluster 2024-09-16T06:02:58.676097+0000 mgr.a (mgr.14373) 1124 : cluster [DBG] pgmap v779: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T06:03:00.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:03:00 smithi086 bash[24289]: cluster 2024-09-16T06:02:58.676097+0000 mgr.a (mgr.14373) 1124 : cluster [DBG] pgmap v779: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T06:03:00.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:03:00 smithi047 bash[22744]: cluster 2024-09-16T06:02:58.676097+0000 mgr.a (mgr.14373) 1124 : cluster [DBG] pgmap v779: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T06:03:01.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:03:01 smithi086 bash[24289]: audit 2024-09-16T06:03:01.164254+0000 mon.b (mon.2) 150 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T06:03:01.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:03:01 smithi047 bash[22744]: audit 2024-09-16T06:03:01.164254+0000 mon.b (mon.2) 150 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T06:03:01.903 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:03:01.904 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:03:01.905 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:03:02.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:03:01 smithi157 bash[24585]: audit 2024-09-16T06:03:01.164254+0000 mon.b (mon.2) 150 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T06:03:02.673 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:03:02.674 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:03:02.674 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:03:02.674 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:03:02.674 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:03:02.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:03:02 smithi086 bash[24289]: cluster 2024-09-16T06:03:00.676884+0000 mgr.a (mgr.14373) 1125 : cluster [DBG] pgmap v780: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T06:03:02.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:03:02 smithi086 bash[24289]: audit 2024-09-16T06:03:01.794916+0000 mon.a (mon.0) 630 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:03:02.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:03:02 smithi086 bash[24289]: audit 2024-09-16T06:03:01.799941+0000 mon.a (mon.0) 631 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:03:02.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:03:02 smithi047 bash[22744]: cluster 2024-09-16T06:03:00.676884+0000 mgr.a (mgr.14373) 1125 : cluster [DBG] pgmap v780: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T06:03:02.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:03:02 smithi047 bash[22744]: audit 2024-09-16T06:03:01.794916+0000 mon.a (mon.0) 630 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:03:02.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:03:02 smithi047 bash[22744]: audit 2024-09-16T06:03:01.799941+0000 mon.a (mon.0) 631 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:03:03.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:03:02 smithi157 bash[24585]: cluster 2024-09-16T06:03:00.676884+0000 mgr.a (mgr.14373) 1125 : cluster [DBG] pgmap v780: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T06:03:03.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:03:02 smithi157 bash[24585]: audit 2024-09-16T06:03:01.794916+0000 mon.a (mon.0) 630 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:03:03.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:03:02 smithi157 bash[24585]: audit 2024-09-16T06:03:01.799941+0000 mon.a (mon.0) 631 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:03:03.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:03:03 smithi086 bash[24289]: audit 2024-09-16T06:03:02.236190+0000 mgr.a (mgr.14373) 1126 : audit [DBG] from='client.37401 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:03:03.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:03:03 smithi086 bash[24289]: audit 2024-09-16T06:03:02.614665+0000 mon.b (mon.2) 151 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T06:03:03.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:03:03 smithi086 bash[24289]: audit 2024-09-16T06:03:02.616288+0000 mon.b (mon.2) 152 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T06:03:03.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:03:03 smithi086 bash[24289]: audit 2024-09-16T06:03:02.626223+0000 mon.a (mon.0) 632 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:03:03.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:03:03 smithi086 bash[24289]: audit 2024-09-16T06:03:02.629881+0000 mon.b (mon.2) 153 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:03:03.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:03:03 smithi086 bash[24289]: audit 2024-09-16T06:03:02.635105+0000 mgr.a (mgr.14373) 1127 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:03:03.838 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 06:03:03 smithi047 bash[22994]: debug 2024-09-16T06:03:03.339+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T06:03:03.838 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 06:03:03 smithi047 bash[22994]: debug 2024-09-16T06:03:03.343+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T06:03:03.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:03:03 smithi047 bash[22744]: audit 2024-09-16T06:03:02.236190+0000 mgr.a (mgr.14373) 1126 : audit [DBG] from='client.37401 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:03:03.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:03:03 smithi047 bash[22744]: audit 2024-09-16T06:03:02.614665+0000 mon.b (mon.2) 151 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T06:03:03.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:03:03 smithi047 bash[22744]: audit 2024-09-16T06:03:02.616288+0000 mon.b (mon.2) 152 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T06:03:03.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:03:03 smithi047 bash[22744]: audit 2024-09-16T06:03:02.626223+0000 mon.a (mon.0) 632 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:03:03.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:03:03 smithi047 bash[22744]: audit 2024-09-16T06:03:02.629881+0000 mon.b (mon.2) 153 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:03:03.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:03:03 smithi047 bash[22744]: audit 2024-09-16T06:03:02.635105+0000 mgr.a (mgr.14373) 1127 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:03:04.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:03:03 smithi157 bash[24585]: audit 2024-09-16T06:03:02.236190+0000 mgr.a (mgr.14373) 1126 : audit [DBG] from='client.37401 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:03:04.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:03:03 smithi157 bash[24585]: audit 2024-09-16T06:03:02.614665+0000 mon.b (mon.2) 151 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T06:03:04.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:03:03 smithi157 bash[24585]: audit 2024-09-16T06:03:02.616288+0000 mon.b (mon.2) 152 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T06:03:04.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:03:03 smithi157 bash[24585]: audit 2024-09-16T06:03:02.626223+0000 mon.a (mon.0) 632 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:03:04.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:03:03 smithi157 bash[24585]: audit 2024-09-16T06:03:02.629881+0000 mon.b (mon.2) 153 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:03:04.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:03:03 smithi157 bash[24585]: audit 2024-09-16T06:03:02.635105+0000 mgr.a (mgr.14373) 1127 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:03:05.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:03:04 smithi157 bash[24585]: cluster 2024-09-16T06:03:02.678504+0000 mgr.a (mgr.14373) 1128 : cluster [DBG] pgmap v781: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:03:05.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:03:04 smithi157 bash[24585]: audit 2024-09-16T06:03:03.346320+0000 mgr.a (mgr.14373) 1129 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T06:03:05.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:03:04 smithi157 bash[24585]: cephadm 2024-09-16T06:03:03.348145+0000 mgr.a (mgr.14373) 1130 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T06:03:05.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:03:04 smithi086 bash[24289]: cluster 2024-09-16T06:03:02.678504+0000 mgr.a (mgr.14373) 1128 : cluster [DBG] pgmap v781: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:03:05.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:03:04 smithi086 bash[24289]: audit 2024-09-16T06:03:03.346320+0000 mgr.a (mgr.14373) 1129 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T06:03:05.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:03:04 smithi086 bash[24289]: cephadm 2024-09-16T06:03:03.348145+0000 mgr.a (mgr.14373) 1130 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T06:03:05.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:03:04 smithi047 bash[22744]: cluster 2024-09-16T06:03:02.678504+0000 mgr.a (mgr.14373) 1128 : cluster [DBG] pgmap v781: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:03:05.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:03:04 smithi047 bash[22744]: audit 2024-09-16T06:03:03.346320+0000 mgr.a (mgr.14373) 1129 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T06:03:05.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:03:04 smithi047 bash[22744]: cephadm 2024-09-16T06:03:03.348145+0000 mgr.a (mgr.14373) 1130 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T06:03:07.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:03:06 smithi157 bash[24585]: cluster 2024-09-16T06:03:04.679306+0000 mgr.a (mgr.14373) 1131 : cluster [DBG] pgmap v782: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T06:03:07.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:03:06 smithi086 bash[24289]: cluster 2024-09-16T06:03:04.679306+0000 mgr.a (mgr.14373) 1131 : cluster [DBG] pgmap v782: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T06:03:07.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:03:06 smithi047 bash[22744]: cluster 2024-09-16T06:03:04.679306+0000 mgr.a (mgr.14373) 1131 : cluster [DBG] pgmap v782: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T06:03:07.675 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:03:07.676 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:03:07.676 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:03:08.442 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:03:08.443 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:03:08.443 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:03:08.443 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:03:08.443 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:03:09.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:03:08 smithi157 bash[24585]: cluster 2024-09-16T06:03:06.681500+0000 mgr.a (mgr.14373) 1132 : cluster [DBG] pgmap v783: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:03:09.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:03:08 smithi086 bash[24289]: cluster 2024-09-16T06:03:06.681500+0000 mgr.a (mgr.14373) 1132 : cluster [DBG] pgmap v783: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:03:09.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:03:08 smithi047 bash[22744]: cluster 2024-09-16T06:03:06.681500+0000 mgr.a (mgr.14373) 1132 : cluster [DBG] pgmap v783: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:03:10.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:03:09 smithi157 bash[24585]: audit 2024-09-16T06:03:08.014601+0000 mgr.a (mgr.14373) 1133 : audit [DBG] from='client.37578 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:03:10.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:03:09 smithi086 bash[24289]: audit 2024-09-16T06:03:08.014601+0000 mgr.a (mgr.14373) 1133 : audit [DBG] from='client.37578 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:03:10.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:03:09 smithi047 bash[22744]: audit 2024-09-16T06:03:08.014601+0000 mgr.a (mgr.14373) 1133 : audit [DBG] from='client.37578 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:03:11.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:03:10 smithi157 bash[24585]: cluster 2024-09-16T06:03:08.682448+0000 mgr.a (mgr.14373) 1134 : cluster [DBG] pgmap v784: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:03:11.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:03:10 smithi086 bash[24289]: cluster 2024-09-16T06:03:08.682448+0000 mgr.a (mgr.14373) 1134 : cluster [DBG] pgmap v784: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:03:11.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:03:10 smithi047 bash[22744]: cluster 2024-09-16T06:03:08.682448+0000 mgr.a (mgr.14373) 1134 : cluster [DBG] pgmap v784: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:03:12.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:03:11 smithi157 bash[24585]: cluster 2024-09-16T06:03:10.683189+0000 mgr.a (mgr.14373) 1135 : cluster [DBG] pgmap v785: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:03:12.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:03:11 smithi086 bash[24289]: cluster 2024-09-16T06:03:10.683189+0000 mgr.a (mgr.14373) 1135 : cluster [DBG] pgmap v785: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:03:12.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:03:11 smithi047 bash[22744]: cluster 2024-09-16T06:03:10.683189+0000 mgr.a (mgr.14373) 1135 : cluster [DBG] pgmap v785: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:03:13.444 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:03:13.445 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:03:13.445 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:03:14.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:03:13 smithi157 bash[24585]: cluster 2024-09-16T06:03:12.685533+0000 mgr.a (mgr.14373) 1136 : cluster [DBG] pgmap v786: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:03:14.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:03:13 smithi086 bash[24289]: cluster 2024-09-16T06:03:12.685533+0000 mgr.a (mgr.14373) 1136 : cluster [DBG] pgmap v786: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:03:14.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:03:13 smithi047 bash[22744]: cluster 2024-09-16T06:03:12.685533+0000 mgr.a (mgr.14373) 1136 : cluster [DBG] pgmap v786: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:03:14.202 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:03:14.202 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:03:14.202 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:03:14.202 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:03:14.202 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:03:15.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:03:14 smithi157 bash[24585]: audit 2024-09-16T06:03:13.783508+0000 mgr.a (mgr.14373) 1137 : audit [DBG] from='client.37656 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:03:15.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:03:14 smithi086 bash[24289]: audit 2024-09-16T06:03:13.783508+0000 mgr.a (mgr.14373) 1137 : audit [DBG] from='client.37656 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:03:15.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:03:14 smithi047 bash[22744]: audit 2024-09-16T06:03:13.783508+0000 mgr.a (mgr.14373) 1137 : audit [DBG] from='client.37656 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:03:16.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:03:15 smithi157 bash[24585]: cluster 2024-09-16T06:03:14.686567+0000 mgr.a (mgr.14373) 1138 : cluster [DBG] pgmap v787: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:03:16.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:03:15 smithi086 bash[24289]: cluster 2024-09-16T06:03:14.686567+0000 mgr.a (mgr.14373) 1138 : cluster [DBG] pgmap v787: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:03:16.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:03:15 smithi047 bash[22744]: cluster 2024-09-16T06:03:14.686567+0000 mgr.a (mgr.14373) 1138 : cluster [DBG] pgmap v787: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:03:18.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:03:17 smithi157 bash[24585]: cluster 2024-09-16T06:03:16.688708+0000 mgr.a (mgr.14373) 1139 : cluster [DBG] pgmap v788: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:03:18.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:03:17 smithi086 bash[24289]: cluster 2024-09-16T06:03:16.688708+0000 mgr.a (mgr.14373) 1139 : cluster [DBG] pgmap v788: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:03:18.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:03:17 smithi047 bash[22744]: cluster 2024-09-16T06:03:16.688708+0000 mgr.a (mgr.14373) 1139 : cluster [DBG] pgmap v788: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:03:19.203 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:03:19.204 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:03:19.204 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:03:19.968 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:03:19.969 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:03:19.969 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:03:19.969 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:03:19.969 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:03:20.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:03:19 smithi157 bash[24585]: cluster 2024-09-16T06:03:18.689448+0000 mgr.a (mgr.14373) 1140 : cluster [DBG] pgmap v789: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:03:20.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:03:19 smithi157 bash[24585]: audit 2024-09-16T06:03:19.544259+0000 mgr.a (mgr.14373) 1141 : audit [DBG] from='client.37734 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:03:20.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:03:19 smithi086 bash[24289]: cluster 2024-09-16T06:03:18.689448+0000 mgr.a (mgr.14373) 1140 : cluster [DBG] pgmap v789: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:03:20.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:03:19 smithi086 bash[24289]: audit 2024-09-16T06:03:19.544259+0000 mgr.a (mgr.14373) 1141 : audit [DBG] from='client.37734 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:03:20.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:03:19 smithi047 bash[22744]: cluster 2024-09-16T06:03:18.689448+0000 mgr.a (mgr.14373) 1140 : cluster [DBG] pgmap v789: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:03:20.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:03:19 smithi047 bash[22744]: audit 2024-09-16T06:03:19.544259+0000 mgr.a (mgr.14373) 1141 : audit [DBG] from='client.37734 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:03:22.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:03:21 smithi157 bash[24585]: cluster 2024-09-16T06:03:20.690429+0000 mgr.a (mgr.14373) 1142 : cluster [DBG] pgmap v790: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:03:22.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:03:21 smithi086 bash[24289]: cluster 2024-09-16T06:03:20.690429+0000 mgr.a (mgr.14373) 1142 : cluster [DBG] pgmap v790: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:03:22.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:03:21 smithi047 bash[22744]: cluster 2024-09-16T06:03:20.690429+0000 mgr.a (mgr.14373) 1142 : cluster [DBG] pgmap v790: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:03:24.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:03:23 smithi157 bash[24585]: cluster 2024-09-16T06:03:22.692731+0000 mgr.a (mgr.14373) 1143 : cluster [DBG] pgmap v791: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:03:24.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:03:23 smithi086 bash[24289]: cluster 2024-09-16T06:03:22.692731+0000 mgr.a (mgr.14373) 1143 : cluster [DBG] pgmap v791: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:03:24.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:03:23 smithi047 bash[22744]: cluster 2024-09-16T06:03:22.692731+0000 mgr.a (mgr.14373) 1143 : cluster [DBG] pgmap v791: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:03:24.970 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:03:24.971 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:03:24.971 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:03:25.742 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:03:25.742 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:03:25.742 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:03:25.742 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:03:25.742 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:03:26.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:03:25 smithi157 bash[24585]: cluster 2024-09-16T06:03:24.693526+0000 mgr.a (mgr.14373) 1144 : cluster [DBG] pgmap v792: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:03:26.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:03:25 smithi157 bash[24585]: audit 2024-09-16T06:03:25.306107+0000 mgr.a (mgr.14373) 1145 : audit [DBG] from='client.37812 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:03:26.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:03:25 smithi086 bash[24289]: cluster 2024-09-16T06:03:24.693526+0000 mgr.a (mgr.14373) 1144 : cluster [DBG] pgmap v792: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:03:26.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:03:25 smithi086 bash[24289]: audit 2024-09-16T06:03:25.306107+0000 mgr.a (mgr.14373) 1145 : audit [DBG] from='client.37812 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:03:26.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:03:25 smithi047 bash[22744]: cluster 2024-09-16T06:03:24.693526+0000 mgr.a (mgr.14373) 1144 : cluster [DBG] pgmap v792: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:03:26.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:03:25 smithi047 bash[22744]: audit 2024-09-16T06:03:25.306107+0000 mgr.a (mgr.14373) 1145 : audit [DBG] from='client.37812 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:03:28.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:03:27 smithi157 bash[24585]: cluster 2024-09-16T06:03:26.695981+0000 mgr.a (mgr.14373) 1146 : cluster [DBG] pgmap v793: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:03:28.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:03:27 smithi086 bash[24289]: cluster 2024-09-16T06:03:26.695981+0000 mgr.a (mgr.14373) 1146 : cluster [DBG] pgmap v793: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:03:28.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:03:27 smithi047 bash[22744]: cluster 2024-09-16T06:03:26.695981+0000 mgr.a (mgr.14373) 1146 : cluster [DBG] pgmap v793: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:03:30.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:03:29 smithi157 bash[24585]: cluster 2024-09-16T06:03:28.696909+0000 mgr.a (mgr.14373) 1147 : cluster [DBG] pgmap v794: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:03:30.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:03:29 smithi086 bash[24289]: cluster 2024-09-16T06:03:28.696909+0000 mgr.a (mgr.14373) 1147 : cluster [DBG] pgmap v794: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:03:30.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:03:29 smithi047 bash[22744]: cluster 2024-09-16T06:03:28.696909+0000 mgr.a (mgr.14373) 1147 : cluster [DBG] pgmap v794: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:03:30.743 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:03:30.744 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:03:30.744 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:03:31.500 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:03:31.500 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:03:31.500 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:03:31.500 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:03:31.501 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:03:32.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:03:31 smithi157 bash[24585]: cluster 2024-09-16T06:03:30.697814+0000 mgr.a (mgr.14373) 1148 : cluster [DBG] pgmap v795: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:03:32.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:03:31 smithi157 bash[24585]: audit 2024-09-16T06:03:31.079662+0000 mgr.a (mgr.14373) 1149 : audit [DBG] from='client.37887 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:03:32.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:03:31 smithi086 bash[24289]: cluster 2024-09-16T06:03:30.697814+0000 mgr.a (mgr.14373) 1148 : cluster [DBG] pgmap v795: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:03:32.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:03:31 smithi086 bash[24289]: audit 2024-09-16T06:03:31.079662+0000 mgr.a (mgr.14373) 1149 : audit [DBG] from='client.37887 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:03:32.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:03:31 smithi047 bash[22744]: cluster 2024-09-16T06:03:30.697814+0000 mgr.a (mgr.14373) 1148 : cluster [DBG] pgmap v795: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:03:32.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:03:31 smithi047 bash[22744]: audit 2024-09-16T06:03:31.079662+0000 mgr.a (mgr.14373) 1149 : audit [DBG] from='client.37887 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:03:34.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:03:33 smithi157 bash[24585]: cluster 2024-09-16T06:03:32.700321+0000 mgr.a (mgr.14373) 1150 : cluster [DBG] pgmap v796: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-16T06:03:34.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:03:33 smithi086 bash[24289]: cluster 2024-09-16T06:03:32.700321+0000 mgr.a (mgr.14373) 1150 : cluster [DBG] pgmap v796: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-16T06:03:34.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:03:33 smithi047 bash[22744]: cluster 2024-09-16T06:03:32.700321+0000 mgr.a (mgr.14373) 1150 : cluster [DBG] pgmap v796: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-16T06:03:36.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:03:35 smithi157 bash[24585]: cluster 2024-09-16T06:03:34.701108+0000 mgr.a (mgr.14373) 1151 : cluster [DBG] pgmap v797: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T06:03:36.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:03:35 smithi086 bash[24289]: cluster 2024-09-16T06:03:34.701108+0000 mgr.a (mgr.14373) 1151 : cluster [DBG] pgmap v797: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T06:03:36.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:03:35 smithi047 bash[22744]: cluster 2024-09-16T06:03:34.701108+0000 mgr.a (mgr.14373) 1151 : cluster [DBG] pgmap v797: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T06:03:36.501 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:03:36.502 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:03:36.502 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:03:37.268 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:03:37.268 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:03:37.268 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:03:37.269 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:03:37.269 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:03:38.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:03:37 smithi157 bash[24585]: cluster 2024-09-16T06:03:36.703123+0000 mgr.a (mgr.14373) 1152 : cluster [DBG] pgmap v798: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:03:38.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:03:37 smithi157 bash[24585]: audit 2024-09-16T06:03:36.842406+0000 mgr.a (mgr.14373) 1153 : audit [DBG] from='client.37965 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:03:38.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:03:37 smithi086 bash[24289]: cluster 2024-09-16T06:03:36.703123+0000 mgr.a (mgr.14373) 1152 : cluster [DBG] pgmap v798: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:03:38.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:03:37 smithi086 bash[24289]: audit 2024-09-16T06:03:36.842406+0000 mgr.a (mgr.14373) 1153 : audit [DBG] from='client.37965 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:03:38.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:03:37 smithi047 bash[22744]: cluster 2024-09-16T06:03:36.703123+0000 mgr.a (mgr.14373) 1152 : cluster [DBG] pgmap v798: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:03:38.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:03:37 smithi047 bash[22744]: audit 2024-09-16T06:03:36.842406+0000 mgr.a (mgr.14373) 1153 : audit [DBG] from='client.37965 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:03:40.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:03:39 smithi086 bash[24289]: cluster 2024-09-16T06:03:38.704016+0000 mgr.a (mgr.14373) 1154 : cluster [DBG] pgmap v799: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:03:40.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:03:39 smithi047 bash[22744]: cluster 2024-09-16T06:03:38.704016+0000 mgr.a (mgr.14373) 1154 : cluster [DBG] pgmap v799: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:03:40.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:03:39 smithi157 bash[24585]: cluster 2024-09-16T06:03:38.704016+0000 mgr.a (mgr.14373) 1154 : cluster [DBG] pgmap v799: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:03:42.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:03:41 smithi086 bash[24289]: cluster 2024-09-16T06:03:40.704800+0000 mgr.a (mgr.14373) 1155 : cluster [DBG] pgmap v800: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T06:03:42.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:03:41 smithi047 bash[22744]: cluster 2024-09-16T06:03:40.704800+0000 mgr.a (mgr.14373) 1155 : cluster [DBG] pgmap v800: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T06:03:42.270 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:03:42.270 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:03:42.271 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:03:42.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:03:41 smithi157 bash[24585]: cluster 2024-09-16T06:03:40.704800+0000 mgr.a (mgr.14373) 1155 : cluster [DBG] pgmap v800: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T06:03:43.049 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:03:43.050 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:03:43.050 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:03:43.050 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:03:43.050 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:03:43.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:03:42 smithi086 bash[24289]: audit 2024-09-16T06:03:42.607859+0000 mgr.a (mgr.14373) 1156 : audit [DBG] from='client.38040 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:03:43.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:03:42 smithi047 bash[22744]: audit 2024-09-16T06:03:42.607859+0000 mgr.a (mgr.14373) 1156 : audit [DBG] from='client.38040 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:03:43.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:03:42 smithi157 bash[24585]: audit 2024-09-16T06:03:42.607859+0000 mgr.a (mgr.14373) 1156 : audit [DBG] from='client.38040 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:03:44.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:03:43 smithi086 bash[24289]: cluster 2024-09-16T06:03:42.706257+0000 mgr.a (mgr.14373) 1157 : cluster [DBG] pgmap v801: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:03:44.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:03:43 smithi047 bash[22744]: cluster 2024-09-16T06:03:42.706257+0000 mgr.a (mgr.14373) 1157 : cluster [DBG] pgmap v801: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:03:44.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:03:43 smithi157 bash[24585]: cluster 2024-09-16T06:03:42.706257+0000 mgr.a (mgr.14373) 1157 : cluster [DBG] pgmap v801: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:03:46.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:03:45 smithi047 bash[22744]: cluster 2024-09-16T06:03:44.707123+0000 mgr.a (mgr.14373) 1158 : cluster [DBG] pgmap v802: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-16T06:03:46.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:03:45 smithi157 bash[24585]: cluster 2024-09-16T06:03:44.707123+0000 mgr.a (mgr.14373) 1158 : cluster [DBG] pgmap v802: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-16T06:03:46.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:03:45 smithi086 bash[24289]: cluster 2024-09-16T06:03:44.707123+0000 mgr.a (mgr.14373) 1158 : cluster [DBG] pgmap v802: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-16T06:03:48.051 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:03:48.052 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:03:48.052 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:03:48.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:03:47 smithi047 bash[22744]: cluster 2024-09-16T06:03:46.709218+0000 mgr.a (mgr.14373) 1159 : cluster [DBG] pgmap v803: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-16T06:03:48.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:03:47 smithi157 bash[24585]: cluster 2024-09-16T06:03:46.709218+0000 mgr.a (mgr.14373) 1159 : cluster [DBG] pgmap v803: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-16T06:03:48.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:03:47 smithi086 bash[24289]: cluster 2024-09-16T06:03:46.709218+0000 mgr.a (mgr.14373) 1159 : cluster [DBG] pgmap v803: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-16T06:03:48.820 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:03:48.820 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:03:48.821 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:03:48.821 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:03:48.821 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:03:49.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:03:48 smithi047 bash[22744]: audit 2024-09-16T06:03:48.391879+0000 mgr.a (mgr.14373) 1160 : audit [DBG] from='client.38118 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:03:49.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:03:48 smithi157 bash[24585]: audit 2024-09-16T06:03:48.391879+0000 mgr.a (mgr.14373) 1160 : audit [DBG] from='client.38118 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:03:49.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:03:48 smithi086 bash[24289]: audit 2024-09-16T06:03:48.391879+0000 mgr.a (mgr.14373) 1160 : audit [DBG] from='client.38118 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:03:50.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:03:49 smithi047 bash[22744]: cluster 2024-09-16T06:03:48.709729+0000 mgr.a (mgr.14373) 1161 : cluster [DBG] pgmap v804: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:03:50.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:03:49 smithi157 bash[24585]: cluster 2024-09-16T06:03:48.709729+0000 mgr.a (mgr.14373) 1161 : cluster [DBG] pgmap v804: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:03:50.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:03:49 smithi086 bash[24289]: cluster 2024-09-16T06:03:48.709729+0000 mgr.a (mgr.14373) 1161 : cluster [DBG] pgmap v804: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:03:52.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:03:52 smithi157 bash[24585]: cluster 2024-09-16T06:03:50.710631+0000 mgr.a (mgr.14373) 1162 : cluster [DBG] pgmap v805: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:03:52.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:03:52 smithi086 bash[24289]: cluster 2024-09-16T06:03:50.710631+0000 mgr.a (mgr.14373) 1162 : cluster [DBG] pgmap v805: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:03:52.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:03:52 smithi047 bash[22744]: cluster 2024-09-16T06:03:50.710631+0000 mgr.a (mgr.14373) 1162 : cluster [DBG] pgmap v805: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:03:53.822 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:03:53.822 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:03:53.823 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:03:54.557 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:03:54.557 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:03:54.557 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:03:54.557 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:03:54.557 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:03:54.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:03:54 smithi157 bash[24585]: cluster 2024-09-16T06:03:52.712876+0000 mgr.a (mgr.14373) 1163 : cluster [DBG] pgmap v806: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:03:54.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:03:54 smithi086 bash[24289]: cluster 2024-09-16T06:03:52.712876+0000 mgr.a (mgr.14373) 1163 : cluster [DBG] pgmap v806: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:03:54.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:03:54 smithi047 bash[22744]: cluster 2024-09-16T06:03:52.712876+0000 mgr.a (mgr.14373) 1163 : cluster [DBG] pgmap v806: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:03:55.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:03:55 smithi157 bash[24585]: audit 2024-09-16T06:03:54.152189+0000 mgr.a (mgr.14373) 1164 : audit [DBG] from='client.38193 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:03:55.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:03:55 smithi086 bash[24289]: audit 2024-09-16T06:03:54.152189+0000 mgr.a (mgr.14373) 1164 : audit [DBG] from='client.38193 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:03:55.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:03:55 smithi047 bash[22744]: audit 2024-09-16T06:03:54.152189+0000 mgr.a (mgr.14373) 1164 : audit [DBG] from='client.38193 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:03:56.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:03:56 smithi086 bash[24289]: cluster 2024-09-16T06:03:54.713811+0000 mgr.a (mgr.14373) 1165 : cluster [DBG] pgmap v807: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:03:56.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:03:56 smithi047 bash[22744]: cluster 2024-09-16T06:03:54.713811+0000 mgr.a (mgr.14373) 1165 : cluster [DBG] pgmap v807: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:03:57.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:03:56 smithi157 bash[24585]: cluster 2024-09-16T06:03:54.713811+0000 mgr.a (mgr.14373) 1165 : cluster [DBG] pgmap v807: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:03:58.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:03:58 smithi086 bash[24289]: cluster 2024-09-16T06:03:56.716049+0000 mgr.a (mgr.14373) 1166 : cluster [DBG] pgmap v808: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:03:58.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:03:58 smithi047 bash[22744]: cluster 2024-09-16T06:03:56.716049+0000 mgr.a (mgr.14373) 1166 : cluster [DBG] pgmap v808: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:03:59.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:03:58 smithi157 bash[24585]: cluster 2024-09-16T06:03:56.716049+0000 mgr.a (mgr.14373) 1166 : cluster [DBG] pgmap v808: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:03:59.558 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:03:59.559 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:03:59.559 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:04:00.314 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:04:00.314 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:04:00.314 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:04:00.314 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:04:00.314 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:04:00.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:04:00 smithi086 bash[24289]: cluster 2024-09-16T06:03:58.716825+0000 mgr.a (mgr.14373) 1167 : cluster [DBG] pgmap v809: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:04:00.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:04:00 smithi047 bash[22744]: cluster 2024-09-16T06:03:58.716825+0000 mgr.a (mgr.14373) 1167 : cluster [DBG] pgmap v809: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:04:01.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:04:00 smithi157 bash[24585]: cluster 2024-09-16T06:03:58.716825+0000 mgr.a (mgr.14373) 1167 : cluster [DBG] pgmap v809: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:04:01.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:04:01 smithi047 bash[22744]: audit 2024-09-16T06:03:59.900450+0000 mgr.a (mgr.14373) 1168 : audit [DBG] from='client.38271 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:04:02.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:04:01 smithi157 bash[24585]: audit 2024-09-16T06:03:59.900450+0000 mgr.a (mgr.14373) 1168 : audit [DBG] from='client.38271 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:04:02.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:04:01 smithi086 bash[24289]: audit 2024-09-16T06:03:59.900450+0000 mgr.a (mgr.14373) 1168 : audit [DBG] from='client.38271 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:04:02.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:04:02 smithi047 bash[22744]: cluster 2024-09-16T06:04:00.717751+0000 mgr.a (mgr.14373) 1169 : cluster [DBG] pgmap v810: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:04:03.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:04:02 smithi157 bash[24585]: cluster 2024-09-16T06:04:00.717751+0000 mgr.a (mgr.14373) 1169 : cluster [DBG] pgmap v810: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:04:03.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:04:02 smithi086 bash[24289]: cluster 2024-09-16T06:04:00.717751+0000 mgr.a (mgr.14373) 1169 : cluster [DBG] pgmap v810: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:04:03.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:04:03 smithi047 bash[22744]: audit 2024-09-16T06:04:03.395904+0000 mon.b (mon.2) 154 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T06:04:04.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:04:03 smithi157 bash[24585]: audit 2024-09-16T06:04:03.395904+0000 mon.b (mon.2) 154 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T06:04:04.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:04:03 smithi086 bash[24289]: audit 2024-09-16T06:04:03.395904+0000 mon.b (mon.2) 154 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T06:04:04.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:04:04 smithi047 bash[22744]: cluster 2024-09-16T06:04:02.720044+0000 mgr.a (mgr.14373) 1170 : cluster [DBG] pgmap v811: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:04:04.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:04:04 smithi047 bash[22744]: audit 2024-09-16T06:04:04.018597+0000 mon.a (mon.0) 633 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:04:04.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:04:04 smithi047 bash[22744]: audit 2024-09-16T06:04:04.024901+0000 mon.a (mon.0) 634 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:04:04.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:04:04 smithi047 bash[22744]: audit 2024-09-16T06:04:04.031846+0000 mon.a (mon.0) 635 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:04:04.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:04:04 smithi047 bash[22744]: audit 2024-09-16T06:04:04.041667+0000 mon.a (mon.0) 636 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:04:05.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:04:04 smithi157 bash[24585]: cluster 2024-09-16T06:04:02.720044+0000 mgr.a (mgr.14373) 1170 : cluster [DBG] pgmap v811: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:04:05.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:04:04 smithi157 bash[24585]: audit 2024-09-16T06:04:04.018597+0000 mon.a (mon.0) 633 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:04:05.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:04:04 smithi157 bash[24585]: audit 2024-09-16T06:04:04.024901+0000 mon.a (mon.0) 634 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:04:05.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:04:04 smithi157 bash[24585]: audit 2024-09-16T06:04:04.031846+0000 mon.a (mon.0) 635 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:04:05.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:04:04 smithi157 bash[24585]: audit 2024-09-16T06:04:04.041667+0000 mon.a (mon.0) 636 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:04:05.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:04:04 smithi086 bash[24289]: cluster 2024-09-16T06:04:02.720044+0000 mgr.a (mgr.14373) 1170 : cluster [DBG] pgmap v811: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:04:05.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:04:04 smithi086 bash[24289]: audit 2024-09-16T06:04:04.018597+0000 mon.a (mon.0) 633 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:04:05.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:04:04 smithi086 bash[24289]: audit 2024-09-16T06:04:04.024901+0000 mon.a (mon.0) 634 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:04:05.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:04:04 smithi086 bash[24289]: audit 2024-09-16T06:04:04.031846+0000 mon.a (mon.0) 635 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:04:05.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:04:04 smithi086 bash[24289]: audit 2024-09-16T06:04:04.041667+0000 mon.a (mon.0) 636 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:04:05.315 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:04:05.316 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:04:05.316 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:04:05.838 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 06:04:05 smithi047 bash[22994]: debug 2024-09-16T06:04:05.614+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T06:04:05.838 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 06:04:05 smithi047 bash[22994]: debug 2024-09-16T06:04:05.618+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T06:04:05.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:04:05 smithi047 bash[22744]: audit 2024-09-16T06:04:04.862686+0000 mon.b (mon.2) 155 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T06:04:05.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:04:05 smithi047 bash[22744]: audit 2024-09-16T06:04:04.864605+0000 mon.b (mon.2) 156 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T06:04:05.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:04:05 smithi047 bash[22744]: audit 2024-09-16T06:04:04.876058+0000 mon.a (mon.0) 637 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:04:05.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:04:05 smithi047 bash[22744]: audit 2024-09-16T06:04:04.877733+0000 mon.b (mon.2) 157 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:04:06.043 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:04:06.043 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:04:06.043 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:04:06.043 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:04:06.043 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:04:06.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:04:05 smithi157 bash[24585]: audit 2024-09-16T06:04:04.862686+0000 mon.b (mon.2) 155 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T06:04:06.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:04:05 smithi157 bash[24585]: audit 2024-09-16T06:04:04.864605+0000 mon.b (mon.2) 156 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T06:04:06.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:04:05 smithi157 bash[24585]: audit 2024-09-16T06:04:04.876058+0000 mon.a (mon.0) 637 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:04:06.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:04:05 smithi157 bash[24585]: audit 2024-09-16T06:04:04.877733+0000 mon.b (mon.2) 157 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:04:06.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:04:05 smithi086 bash[24289]: audit 2024-09-16T06:04:04.862686+0000 mon.b (mon.2) 155 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T06:04:06.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:04:05 smithi086 bash[24289]: audit 2024-09-16T06:04:04.864605+0000 mon.b (mon.2) 156 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T06:04:06.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:04:05 smithi086 bash[24289]: audit 2024-09-16T06:04:04.876058+0000 mon.a (mon.0) 637 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:04:06.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:04:05 smithi086 bash[24289]: audit 2024-09-16T06:04:04.877733+0000 mon.b (mon.2) 157 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:04:07.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:04:06 smithi157 bash[24585]: cluster 2024-09-16T06:04:04.720772+0000 mgr.a (mgr.14373) 1171 : cluster [DBG] pgmap v812: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:04:07.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:04:06 smithi157 bash[24585]: audit 2024-09-16T06:04:04.882626+0000 mgr.a (mgr.14373) 1172 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:04:07.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:04:06 smithi157 bash[24585]: audit 2024-09-16T06:04:05.616896+0000 mgr.a (mgr.14373) 1173 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T06:04:07.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:04:06 smithi157 bash[24585]: cephadm 2024-09-16T06:04:05.618579+0000 mgr.a (mgr.14373) 1174 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T06:04:07.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:04:06 smithi086 bash[24289]: cluster 2024-09-16T06:04:04.720772+0000 mgr.a (mgr.14373) 1171 : cluster [DBG] pgmap v812: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:04:07.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:04:06 smithi086 bash[24289]: audit 2024-09-16T06:04:04.882626+0000 mgr.a (mgr.14373) 1172 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:04:07.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:04:06 smithi086 bash[24289]: audit 2024-09-16T06:04:05.616896+0000 mgr.a (mgr.14373) 1173 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T06:04:07.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:04:06 smithi086 bash[24289]: cephadm 2024-09-16T06:04:05.618579+0000 mgr.a (mgr.14373) 1174 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T06:04:07.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:04:06 smithi047 bash[22744]: cluster 2024-09-16T06:04:04.720772+0000 mgr.a (mgr.14373) 1171 : cluster [DBG] pgmap v812: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:04:07.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:04:06 smithi047 bash[22744]: audit 2024-09-16T06:04:04.882626+0000 mgr.a (mgr.14373) 1172 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:04:07.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:04:06 smithi047 bash[22744]: audit 2024-09-16T06:04:05.616896+0000 mgr.a (mgr.14373) 1173 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T06:04:07.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:04:06 smithi047 bash[22744]: cephadm 2024-09-16T06:04:05.618579+0000 mgr.a (mgr.14373) 1174 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T06:04:08.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:04:07 smithi157 bash[24585]: audit 2024-09-16T06:04:05.649912+0000 mgr.a (mgr.14373) 1175 : audit [DBG] from='client.38439 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:04:08.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:04:07 smithi086 bash[24289]: audit 2024-09-16T06:04:05.649912+0000 mgr.a (mgr.14373) 1175 : audit [DBG] from='client.38439 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:04:08.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:04:07 smithi047 bash[22744]: audit 2024-09-16T06:04:05.649912+0000 mgr.a (mgr.14373) 1175 : audit [DBG] from='client.38439 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:04:09.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:04:08 smithi157 bash[24585]: cluster 2024-09-16T06:04:06.723127+0000 mgr.a (mgr.14373) 1176 : cluster [DBG] pgmap v813: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:04:09.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:04:08 smithi086 bash[24289]: cluster 2024-09-16T06:04:06.723127+0000 mgr.a (mgr.14373) 1176 : cluster [DBG] pgmap v813: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:04:09.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:04:08 smithi047 bash[22744]: cluster 2024-09-16T06:04:06.723127+0000 mgr.a (mgr.14373) 1176 : cluster [DBG] pgmap v813: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:04:11.044 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:04:11.045 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:04:11.045 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:04:11.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:04:10 smithi157 bash[24585]: cluster 2024-09-16T06:04:08.723876+0000 mgr.a (mgr.14373) 1177 : cluster [DBG] pgmap v814: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:04:11.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:04:10 smithi086 bash[24289]: cluster 2024-09-16T06:04:08.723876+0000 mgr.a (mgr.14373) 1177 : cluster [DBG] pgmap v814: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:04:11.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:04:10 smithi047 bash[22744]: cluster 2024-09-16T06:04:08.723876+0000 mgr.a (mgr.14373) 1177 : cluster [DBG] pgmap v814: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:04:11.781 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:04:11.782 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:04:11.782 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:04:11.782 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:04:11.782 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:04:13.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:04:12 smithi157 bash[24585]: cluster 2024-09-16T06:04:10.724614+0000 mgr.a (mgr.14373) 1178 : cluster [DBG] pgmap v815: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:04:13.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:04:12 smithi157 bash[24585]: audit 2024-09-16T06:04:11.379195+0000 mgr.a (mgr.14373) 1179 : audit [DBG] from='client.38535 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:04:13.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:04:12 smithi086 bash[24289]: cluster 2024-09-16T06:04:10.724614+0000 mgr.a (mgr.14373) 1178 : cluster [DBG] pgmap v815: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:04:13.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:04:12 smithi086 bash[24289]: audit 2024-09-16T06:04:11.379195+0000 mgr.a (mgr.14373) 1179 : audit [DBG] from='client.38535 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:04:13.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:04:12 smithi047 bash[22744]: cluster 2024-09-16T06:04:10.724614+0000 mgr.a (mgr.14373) 1178 : cluster [DBG] pgmap v815: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:04:13.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:04:12 smithi047 bash[22744]: audit 2024-09-16T06:04:11.379195+0000 mgr.a (mgr.14373) 1179 : audit [DBG] from='client.38535 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:04:15.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:04:14 smithi157 bash[24585]: cluster 2024-09-16T06:04:12.727440+0000 mgr.a (mgr.14373) 1180 : cluster [DBG] pgmap v816: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:04:15.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:04:14 smithi086 bash[24289]: cluster 2024-09-16T06:04:12.727440+0000 mgr.a (mgr.14373) 1180 : cluster [DBG] pgmap v816: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:04:15.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:04:14 smithi047 bash[22744]: cluster 2024-09-16T06:04:12.727440+0000 mgr.a (mgr.14373) 1180 : cluster [DBG] pgmap v816: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:04:16.783 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:04:16.784 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:04:16.784 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:04:17.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:04:16 smithi157 bash[24585]: cluster 2024-09-16T06:04:14.728410+0000 mgr.a (mgr.14373) 1181 : cluster [DBG] pgmap v817: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T06:04:17.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:04:16 smithi086 bash[24289]: cluster 2024-09-16T06:04:14.728410+0000 mgr.a (mgr.14373) 1181 : cluster [DBG] pgmap v817: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T06:04:17.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:04:16 smithi047 bash[22744]: cluster 2024-09-16T06:04:14.728410+0000 mgr.a (mgr.14373) 1181 : cluster [DBG] pgmap v817: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T06:04:17.550 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:04:17.550 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:04:17.550 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:04:17.550 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:04:17.550 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:04:19.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:04:18 smithi157 bash[24585]: cluster 2024-09-16T06:04:16.730560+0000 mgr.a (mgr.14373) 1182 : cluster [DBG] pgmap v818: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:04:19.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:04:18 smithi157 bash[24585]: audit 2024-09-16T06:04:17.119741+0000 mgr.a (mgr.14373) 1183 : audit [DBG] from='client.38613 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:04:19.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:04:18 smithi086 bash[24289]: cluster 2024-09-16T06:04:16.730560+0000 mgr.a (mgr.14373) 1182 : cluster [DBG] pgmap v818: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:04:19.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:04:18 smithi086 bash[24289]: audit 2024-09-16T06:04:17.119741+0000 mgr.a (mgr.14373) 1183 : audit [DBG] from='client.38613 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:04:19.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:04:18 smithi047 bash[22744]: cluster 2024-09-16T06:04:16.730560+0000 mgr.a (mgr.14373) 1182 : cluster [DBG] pgmap v818: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:04:19.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:04:18 smithi047 bash[22744]: audit 2024-09-16T06:04:17.119741+0000 mgr.a (mgr.14373) 1183 : audit [DBG] from='client.38613 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:04:21.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:04:20 smithi157 bash[24585]: cluster 2024-09-16T06:04:18.731486+0000 mgr.a (mgr.14373) 1184 : cluster [DBG] pgmap v819: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:04:21.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:04:20 smithi086 bash[24289]: cluster 2024-09-16T06:04:18.731486+0000 mgr.a (mgr.14373) 1184 : cluster [DBG] pgmap v819: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:04:21.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:04:20 smithi047 bash[22744]: cluster 2024-09-16T06:04:18.731486+0000 mgr.a (mgr.14373) 1184 : cluster [DBG] pgmap v819: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:04:22.552 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:04:22.552 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:04:22.552 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:04:23.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:04:22 smithi157 bash[24585]: cluster 2024-09-16T06:04:20.732243+0000 mgr.a (mgr.14373) 1185 : cluster [DBG] pgmap v820: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T06:04:23.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:04:22 smithi086 bash[24289]: cluster 2024-09-16T06:04:20.732243+0000 mgr.a (mgr.14373) 1185 : cluster [DBG] pgmap v820: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T06:04:23.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:04:22 smithi047 bash[22744]: cluster 2024-09-16T06:04:20.732243+0000 mgr.a (mgr.14373) 1185 : cluster [DBG] pgmap v820: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T06:04:23.297 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:04:23.297 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:04:23.297 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:04:23.297 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:04:23.297 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:04:25.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:04:24 smithi157 bash[24585]: cluster 2024-09-16T06:04:22.733598+0000 mgr.a (mgr.14373) 1186 : cluster [DBG] pgmap v821: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:04:25.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:04:24 smithi157 bash[24585]: audit 2024-09-16T06:04:22.888896+0000 mgr.a (mgr.14373) 1187 : audit [DBG] from='client.38691 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:04:25.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:04:24 smithi086 bash[24289]: cluster 2024-09-16T06:04:22.733598+0000 mgr.a (mgr.14373) 1186 : cluster [DBG] pgmap v821: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:04:25.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:04:24 smithi086 bash[24289]: audit 2024-09-16T06:04:22.888896+0000 mgr.a (mgr.14373) 1187 : audit [DBG] from='client.38691 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:04:25.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:04:24 smithi047 bash[22744]: cluster 2024-09-16T06:04:22.733598+0000 mgr.a (mgr.14373) 1186 : cluster [DBG] pgmap v821: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:04:25.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:04:24 smithi047 bash[22744]: audit 2024-09-16T06:04:22.888896+0000 mgr.a (mgr.14373) 1187 : audit [DBG] from='client.38691 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:04:27.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:04:26 smithi157 bash[24585]: cluster 2024-09-16T06:04:24.734634+0000 mgr.a (mgr.14373) 1188 : cluster [DBG] pgmap v822: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:04:27.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:04:26 smithi086 bash[24289]: cluster 2024-09-16T06:04:24.734634+0000 mgr.a (mgr.14373) 1188 : cluster [DBG] pgmap v822: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:04:27.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:04:26 smithi047 bash[22744]: cluster 2024-09-16T06:04:24.734634+0000 mgr.a (mgr.14373) 1188 : cluster [DBG] pgmap v822: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:04:28.298 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:04:28.299 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:04:28.299 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:04:29.041 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:04:29.041 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:04:29.042 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:04:29.042 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:04:29.042 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:04:29.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:04:28 smithi157 bash[24585]: cluster 2024-09-16T06:04:26.736912+0000 mgr.a (mgr.14373) 1189 : cluster [DBG] pgmap v823: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:04:29.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:04:28 smithi086 bash[24289]: cluster 2024-09-16T06:04:26.736912+0000 mgr.a (mgr.14373) 1189 : cluster [DBG] pgmap v823: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:04:29.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:04:28 smithi047 bash[22744]: cluster 2024-09-16T06:04:26.736912+0000 mgr.a (mgr.14373) 1189 : cluster [DBG] pgmap v823: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:04:30.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:04:29 smithi157 bash[24585]: audit 2024-09-16T06:04:28.628517+0000 mgr.a (mgr.14373) 1190 : audit [DBG] from='client.38769 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:04:30.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:04:29 smithi157 bash[24585]: cluster 2024-09-16T06:04:28.737404+0000 mgr.a (mgr.14373) 1191 : cluster [DBG] pgmap v824: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:04:30.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:04:29 smithi086 bash[24289]: audit 2024-09-16T06:04:28.628517+0000 mgr.a (mgr.14373) 1190 : audit [DBG] from='client.38769 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:04:30.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:04:29 smithi086 bash[24289]: cluster 2024-09-16T06:04:28.737404+0000 mgr.a (mgr.14373) 1191 : cluster [DBG] pgmap v824: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:04:30.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:04:29 smithi047 bash[22744]: audit 2024-09-16T06:04:28.628517+0000 mgr.a (mgr.14373) 1190 : audit [DBG] from='client.38769 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:04:30.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:04:29 smithi047 bash[22744]: cluster 2024-09-16T06:04:28.737404+0000 mgr.a (mgr.14373) 1191 : cluster [DBG] pgmap v824: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:04:32.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:04:31 smithi157 bash[24585]: cluster 2024-09-16T06:04:30.738240+0000 mgr.a (mgr.14373) 1192 : cluster [DBG] pgmap v825: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:04:32.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:04:31 smithi086 bash[24289]: cluster 2024-09-16T06:04:30.738240+0000 mgr.a (mgr.14373) 1192 : cluster [DBG] pgmap v825: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:04:32.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:04:31 smithi047 bash[22744]: cluster 2024-09-16T06:04:30.738240+0000 mgr.a (mgr.14373) 1192 : cluster [DBG] pgmap v825: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:04:34.043 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:04:34.043 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:04:34.044 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:04:34.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:04:33 smithi157 bash[24585]: cluster 2024-09-16T06:04:32.740487+0000 mgr.a (mgr.14373) 1193 : cluster [DBG] pgmap v826: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:04:34.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:04:33 smithi086 bash[24289]: cluster 2024-09-16T06:04:32.740487+0000 mgr.a (mgr.14373) 1193 : cluster [DBG] pgmap v826: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:04:34.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:04:33 smithi047 bash[22744]: cluster 2024-09-16T06:04:32.740487+0000 mgr.a (mgr.14373) 1193 : cluster [DBG] pgmap v826: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:04:34.799 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:04:34.800 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:04:34.800 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:04:34.800 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:04:34.800 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:04:35.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:04:34 smithi086 bash[24289]: audit 2024-09-16T06:04:34.377087+0000 mgr.a (mgr.14373) 1194 : audit [DBG] from='client.38844 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:04:35.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:04:34 smithi047 bash[22744]: audit 2024-09-16T06:04:34.377087+0000 mgr.a (mgr.14373) 1194 : audit [DBG] from='client.38844 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:04:35.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:04:34 smithi157 bash[24585]: audit 2024-09-16T06:04:34.377087+0000 mgr.a (mgr.14373) 1194 : audit [DBG] from='client.38844 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:04:36.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:04:35 smithi086 bash[24289]: cluster 2024-09-16T06:04:34.741019+0000 mgr.a (mgr.14373) 1195 : cluster [DBG] pgmap v827: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:04:36.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:04:35 smithi047 bash[22744]: cluster 2024-09-16T06:04:34.741019+0000 mgr.a (mgr.14373) 1195 : cluster [DBG] pgmap v827: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:04:36.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:04:35 smithi157 bash[24585]: cluster 2024-09-16T06:04:34.741019+0000 mgr.a (mgr.14373) 1195 : cluster [DBG] pgmap v827: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:04:38.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:04:37 smithi086 bash[24289]: cluster 2024-09-16T06:04:36.743190+0000 mgr.a (mgr.14373) 1196 : cluster [DBG] pgmap v828: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:04:38.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:04:37 smithi047 bash[22744]: cluster 2024-09-16T06:04:36.743190+0000 mgr.a (mgr.14373) 1196 : cluster [DBG] pgmap v828: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:04:38.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:04:37 smithi157 bash[24585]: cluster 2024-09-16T06:04:36.743190+0000 mgr.a (mgr.14373) 1196 : cluster [DBG] pgmap v828: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:04:39.801 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:04:39.802 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:04:39.802 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:04:40.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:04:39 smithi086 bash[24289]: cluster 2024-09-16T06:04:38.743912+0000 mgr.a (mgr.14373) 1197 : cluster [DBG] pgmap v829: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:04:40.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:04:39 smithi047 bash[22744]: cluster 2024-09-16T06:04:38.743912+0000 mgr.a (mgr.14373) 1197 : cluster [DBG] pgmap v829: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:04:40.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:04:39 smithi157 bash[24585]: cluster 2024-09-16T06:04:38.743912+0000 mgr.a (mgr.14373) 1197 : cluster [DBG] pgmap v829: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:04:40.578 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:04:40.578 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:04:40.578 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:04:40.579 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:04:40.579 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:04:41.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:04:40 smithi086 bash[24289]: audit 2024-09-16T06:04:40.143510+0000 mgr.a (mgr.14373) 1198 : audit [DBG] from='client.38916 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:04:41.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:04:40 smithi047 bash[22744]: audit 2024-09-16T06:04:40.143510+0000 mgr.a (mgr.14373) 1198 : audit [DBG] from='client.38916 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:04:41.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:04:40 smithi157 bash[24585]: audit 2024-09-16T06:04:40.143510+0000 mgr.a (mgr.14373) 1198 : audit [DBG] from='client.38916 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:04:42.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:04:41 smithi047 bash[22744]: cluster 2024-09-16T06:04:40.744725+0000 mgr.a (mgr.14373) 1199 : cluster [DBG] pgmap v830: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:04:42.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:04:41 smithi157 bash[24585]: cluster 2024-09-16T06:04:40.744725+0000 mgr.a (mgr.14373) 1199 : cluster [DBG] pgmap v830: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:04:42.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:04:41 smithi086 bash[24289]: cluster 2024-09-16T06:04:40.744725+0000 mgr.a (mgr.14373) 1199 : cluster [DBG] pgmap v830: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:04:44.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:04:43 smithi047 bash[22744]: cluster 2024-09-16T06:04:42.746952+0000 mgr.a (mgr.14373) 1200 : cluster [DBG] pgmap v831: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:04:44.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:04:43 smithi157 bash[24585]: cluster 2024-09-16T06:04:42.746952+0000 mgr.a (mgr.14373) 1200 : cluster [DBG] pgmap v831: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:04:44.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:04:43 smithi086 bash[24289]: cluster 2024-09-16T06:04:42.746952+0000 mgr.a (mgr.14373) 1200 : cluster [DBG] pgmap v831: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:04:45.580 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:04:45.581 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:04:45.581 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:04:46.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:04:45 smithi047 bash[22744]: cluster 2024-09-16T06:04:44.747692+0000 mgr.a (mgr.14373) 1201 : cluster [DBG] pgmap v832: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:04:46.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:04:45 smithi157 bash[24585]: cluster 2024-09-16T06:04:44.747692+0000 mgr.a (mgr.14373) 1201 : cluster [DBG] pgmap v832: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:04:46.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:04:45 smithi086 bash[24289]: cluster 2024-09-16T06:04:44.747692+0000 mgr.a (mgr.14373) 1201 : cluster [DBG] pgmap v832: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:04:46.346 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:04:46.346 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:04:46.346 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:04:46.346 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:04:46.347 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:04:47.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:04:46 smithi157 bash[24585]: audit 2024-09-16T06:04:45.918570+0000 mgr.a (mgr.14373) 1202 : audit [DBG] from='client.38991 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:04:47.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:04:46 smithi086 bash[24289]: audit 2024-09-16T06:04:45.918570+0000 mgr.a (mgr.14373) 1202 : audit [DBG] from='client.38991 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:04:47.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:04:46 smithi047 bash[22744]: audit 2024-09-16T06:04:45.918570+0000 mgr.a (mgr.14373) 1202 : audit [DBG] from='client.38991 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:04:48.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:04:47 smithi157 bash[24585]: cluster 2024-09-16T06:04:46.750086+0000 mgr.a (mgr.14373) 1203 : cluster [DBG] pgmap v833: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:04:48.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:04:47 smithi086 bash[24289]: cluster 2024-09-16T06:04:46.750086+0000 mgr.a (mgr.14373) 1203 : cluster [DBG] pgmap v833: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:04:48.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:04:47 smithi047 bash[22744]: cluster 2024-09-16T06:04:46.750086+0000 mgr.a (mgr.14373) 1203 : cluster [DBG] pgmap v833: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:04:50.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:04:49 smithi157 bash[24585]: cluster 2024-09-16T06:04:48.751018+0000 mgr.a (mgr.14373) 1204 : cluster [DBG] pgmap v834: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:04:50.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:04:49 smithi086 bash[24289]: cluster 2024-09-16T06:04:48.751018+0000 mgr.a (mgr.14373) 1204 : cluster [DBG] pgmap v834: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:04:50.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:04:49 smithi047 bash[22744]: cluster 2024-09-16T06:04:48.751018+0000 mgr.a (mgr.14373) 1204 : cluster [DBG] pgmap v834: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:04:51.348 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:04:51.348 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:04:51.348 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:04:52.116 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:04:52.117 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:04:52.117 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:04:52.117 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:04:52.117 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:04:52.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:04:51 smithi157 bash[24585]: cluster 2024-09-16T06:04:50.751921+0000 mgr.a (mgr.14373) 1205 : cluster [DBG] pgmap v835: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:04:52.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:04:51 smithi086 bash[24289]: cluster 2024-09-16T06:04:50.751921+0000 mgr.a (mgr.14373) 1205 : cluster [DBG] pgmap v835: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:04:52.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:04:51 smithi047 bash[22744]: cluster 2024-09-16T06:04:50.751921+0000 mgr.a (mgr.14373) 1205 : cluster [DBG] pgmap v835: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:04:53.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:04:52 smithi157 bash[24585]: audit 2024-09-16T06:04:51.686421+0000 mgr.a (mgr.14373) 1206 : audit [DBG] from='client.39069 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:04:53.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:04:52 smithi086 bash[24289]: audit 2024-09-16T06:04:51.686421+0000 mgr.a (mgr.14373) 1206 : audit [DBG] from='client.39069 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:04:53.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:04:52 smithi047 bash[22744]: audit 2024-09-16T06:04:51.686421+0000 mgr.a (mgr.14373) 1206 : audit [DBG] from='client.39069 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:04:54.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:04:53 smithi157 bash[24585]: cluster 2024-09-16T06:04:52.754648+0000 mgr.a (mgr.14373) 1207 : cluster [DBG] pgmap v836: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:04:54.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:04:53 smithi086 bash[24289]: cluster 2024-09-16T06:04:52.754648+0000 mgr.a (mgr.14373) 1207 : cluster [DBG] pgmap v836: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:04:54.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:04:53 smithi047 bash[22744]: cluster 2024-09-16T06:04:52.754648+0000 mgr.a (mgr.14373) 1207 : cluster [DBG] pgmap v836: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:04:56.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:04:55 smithi157 bash[24585]: cluster 2024-09-16T06:04:54.755401+0000 mgr.a (mgr.14373) 1208 : cluster [DBG] pgmap v837: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:04:56.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:04:55 smithi086 bash[24289]: cluster 2024-09-16T06:04:54.755401+0000 mgr.a (mgr.14373) 1208 : cluster [DBG] pgmap v837: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:04:56.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:04:55 smithi047 bash[22744]: cluster 2024-09-16T06:04:54.755401+0000 mgr.a (mgr.14373) 1208 : cluster [DBG] pgmap v837: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:04:57.118 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:04:57.118 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:04:57.119 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:04:57.875 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:04:57.875 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:04:57.875 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:04:57.875 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:04:57.875 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:04:58.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:04:58 smithi086 bash[24289]: cluster 2024-09-16T06:04:56.757362+0000 mgr.a (mgr.14373) 1209 : cluster [DBG] pgmap v838: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:04:58.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:04:58 smithi086 bash[24289]: audit 2024-09-16T06:04:57.454296+0000 mgr.a (mgr.14373) 1210 : audit [DBG] from='client.39147 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:04:58.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:04:58 smithi047 bash[22744]: cluster 2024-09-16T06:04:56.757362+0000 mgr.a (mgr.14373) 1209 : cluster [DBG] pgmap v838: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:04:58.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:04:58 smithi047 bash[22744]: audit 2024-09-16T06:04:57.454296+0000 mgr.a (mgr.14373) 1210 : audit [DBG] from='client.39147 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:04:59.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:04:58 smithi157 bash[24585]: cluster 2024-09-16T06:04:56.757362+0000 mgr.a (mgr.14373) 1209 : cluster [DBG] pgmap v838: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:04:59.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:04:58 smithi157 bash[24585]: audit 2024-09-16T06:04:57.454296+0000 mgr.a (mgr.14373) 1210 : audit [DBG] from='client.39147 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:05:00.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:05:00 smithi086 bash[24289]: cluster 2024-09-16T06:04:58.758405+0000 mgr.a (mgr.14373) 1211 : cluster [DBG] pgmap v839: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:05:00.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:05:00 smithi047 bash[22744]: cluster 2024-09-16T06:04:58.758405+0000 mgr.a (mgr.14373) 1211 : cluster [DBG] pgmap v839: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:05:01.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:05:00 smithi157 bash[24585]: cluster 2024-09-16T06:04:58.758405+0000 mgr.a (mgr.14373) 1211 : cluster [DBG] pgmap v839: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:05:02.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:05:02 smithi047 bash[22744]: cluster 2024-09-16T06:05:00.759221+0000 mgr.a (mgr.14373) 1212 : cluster [DBG] pgmap v840: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T06:05:02.876 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:05:02.877 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:05:02.878 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:05:03.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:05:02 smithi157 bash[24585]: cluster 2024-09-16T06:05:00.759221+0000 mgr.a (mgr.14373) 1212 : cluster [DBG] pgmap v840: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T06:05:03.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:05:02 smithi086 bash[24289]: cluster 2024-09-16T06:05:00.759221+0000 mgr.a (mgr.14373) 1212 : cluster [DBG] pgmap v840: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T06:05:03.634 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:05:03.634 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:05:03.634 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:05:03.635 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:05:03.635 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:05:04.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:05:04 smithi047 bash[22744]: cluster 2024-09-16T06:05:02.761452+0000 mgr.a (mgr.14373) 1213 : cluster [DBG] pgmap v841: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:05:04.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:05:04 smithi047 bash[22744]: audit 2024-09-16T06:05:03.205720+0000 mgr.a (mgr.14373) 1214 : audit [DBG] from='client.39222 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:05:05.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:05:04 smithi157 bash[24585]: cluster 2024-09-16T06:05:02.761452+0000 mgr.a (mgr.14373) 1213 : cluster [DBG] pgmap v841: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:05:05.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:05:04 smithi157 bash[24585]: audit 2024-09-16T06:05:03.205720+0000 mgr.a (mgr.14373) 1214 : audit [DBG] from='client.39222 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:05:05.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:05:04 smithi086 bash[24289]: cluster 2024-09-16T06:05:02.761452+0000 mgr.a (mgr.14373) 1213 : cluster [DBG] pgmap v841: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:05:05.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:05:04 smithi086 bash[24289]: audit 2024-09-16T06:05:03.205720+0000 mgr.a (mgr.14373) 1214 : audit [DBG] from='client.39222 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:05:06.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:05:06 smithi047 bash[22744]: cluster 2024-09-16T06:05:04.762332+0000 mgr.a (mgr.14373) 1215 : cluster [DBG] pgmap v842: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:05:06.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:05:06 smithi047 bash[22744]: audit 2024-09-16T06:05:05.684149+0000 mon.b (mon.2) 158 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T06:05:07.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:05:06 smithi157 bash[24585]: cluster 2024-09-16T06:05:04.762332+0000 mgr.a (mgr.14373) 1215 : cluster [DBG] pgmap v842: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:05:07.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:05:06 smithi157 bash[24585]: audit 2024-09-16T06:05:05.684149+0000 mon.b (mon.2) 158 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T06:05:07.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:05:06 smithi086 bash[24289]: cluster 2024-09-16T06:05:04.762332+0000 mgr.a (mgr.14373) 1215 : cluster [DBG] pgmap v842: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:05:07.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:05:06 smithi086 bash[24289]: audit 2024-09-16T06:05:05.684149+0000 mon.b (mon.2) 158 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T06:05:08.636 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:05:08.636 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:05:08.636 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:05:08.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:05:08 smithi047 bash[22744]: cluster 2024-09-16T06:05:06.764444+0000 mgr.a (mgr.14373) 1216 : cluster [DBG] pgmap v843: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:05:09.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:05:08 smithi157 bash[24585]: cluster 2024-09-16T06:05:06.764444+0000 mgr.a (mgr.14373) 1216 : cluster [DBG] pgmap v843: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:05:09.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:05:08 smithi086 bash[24289]: cluster 2024-09-16T06:05:06.764444+0000 mgr.a (mgr.14373) 1216 : cluster [DBG] pgmap v843: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:05:09.372 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:05:09.372 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:05:09.372 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:05:09.372 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:05:09.372 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:05:11.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:05:10 smithi157 bash[24585]: cluster 2024-09-16T06:05:08.764962+0000 mgr.a (mgr.14373) 1217 : cluster [DBG] pgmap v844: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:05:11.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:05:10 smithi157 bash[24585]: audit 2024-09-16T06:05:08.971054+0000 mgr.a (mgr.14373) 1218 : audit [DBG] from='client.39297 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:05:11.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:05:10 smithi086 bash[24289]: cluster 2024-09-16T06:05:08.764962+0000 mgr.a (mgr.14373) 1217 : cluster [DBG] pgmap v844: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:05:11.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:05:10 smithi086 bash[24289]: audit 2024-09-16T06:05:08.971054+0000 mgr.a (mgr.14373) 1218 : audit [DBG] from='client.39297 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:05:11.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:05:10 smithi047 bash[22744]: cluster 2024-09-16T06:05:08.764962+0000 mgr.a (mgr.14373) 1217 : cluster [DBG] pgmap v844: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:05:11.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:05:10 smithi047 bash[22744]: audit 2024-09-16T06:05:08.971054+0000 mgr.a (mgr.14373) 1218 : audit [DBG] from='client.39297 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:05:12.868 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:05:12 smithi047 bash[22744]: cluster 2024-09-16T06:05:10.765918+0000 mgr.a (mgr.14373) 1219 : cluster [DBG] pgmap v845: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:05:13.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:05:12 smithi157 bash[24585]: cluster 2024-09-16T06:05:10.765918+0000 mgr.a (mgr.14373) 1219 : cluster [DBG] pgmap v845: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:05:13.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:05:12 smithi086 bash[24289]: cluster 2024-09-16T06:05:10.765918+0000 mgr.a (mgr.14373) 1219 : cluster [DBG] pgmap v845: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:05:14.373 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:05:14.374 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:05:14.374 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:05:14.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:05:14 smithi047 bash[22744]: cluster 2024-09-16T06:05:12.767106+0000 mgr.a (mgr.14373) 1220 : cluster [DBG] pgmap v846: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:05:15.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:05:14 smithi157 bash[24585]: cluster 2024-09-16T06:05:12.767106+0000 mgr.a (mgr.14373) 1220 : cluster [DBG] pgmap v846: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:05:15.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:05:14 smithi086 bash[24289]: cluster 2024-09-16T06:05:12.767106+0000 mgr.a (mgr.14373) 1220 : cluster [DBG] pgmap v846: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:05:15.183 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:05:15.183 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:05:15.183 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:05:15.183 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:05:15.183 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:05:17.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:05:16 smithi157 bash[24585]: audit 2024-09-16T06:05:14.720670+0000 mgr.a (mgr.14373) 1221 : audit [DBG] from='client.39375 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:05:17.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:05:16 smithi157 bash[24585]: cluster 2024-09-16T06:05:14.768049+0000 mgr.a (mgr.14373) 1222 : cluster [DBG] pgmap v847: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:05:17.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:05:16 smithi157 bash[24585]: audit 2024-09-16T06:05:15.973710+0000 mon.a (mon.0) 638 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:05:17.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:05:16 smithi157 bash[24585]: audit 2024-09-16T06:05:15.983606+0000 mon.a (mon.0) 639 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:05:17.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:05:16 smithi157 bash[24585]: audit 2024-09-16T06:05:15.984564+0000 mon.b (mon.2) 159 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T06:05:17.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:05:16 smithi157 bash[24585]: audit 2024-09-16T06:05:15.986519+0000 mon.b (mon.2) 160 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T06:05:17.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:05:16 smithi157 bash[24585]: audit 2024-09-16T06:05:16.000931+0000 mon.a (mon.0) 640 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:05:17.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:05:16 smithi157 bash[24585]: audit 2024-09-16T06:05:16.003337+0000 mon.b (mon.2) 161 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:05:17.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:05:16 smithi086 bash[24289]: audit 2024-09-16T06:05:14.720670+0000 mgr.a (mgr.14373) 1221 : audit [DBG] from='client.39375 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:05:17.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:05:16 smithi086 bash[24289]: cluster 2024-09-16T06:05:14.768049+0000 mgr.a (mgr.14373) 1222 : cluster [DBG] pgmap v847: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:05:17.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:05:16 smithi086 bash[24289]: audit 2024-09-16T06:05:15.973710+0000 mon.a (mon.0) 638 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:05:17.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:05:16 smithi086 bash[24289]: audit 2024-09-16T06:05:15.983606+0000 mon.a (mon.0) 639 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:05:17.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:05:16 smithi086 bash[24289]: audit 2024-09-16T06:05:15.984564+0000 mon.b (mon.2) 159 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T06:05:17.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:05:16 smithi086 bash[24289]: audit 2024-09-16T06:05:15.986519+0000 mon.b (mon.2) 160 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T06:05:17.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:05:16 smithi086 bash[24289]: audit 2024-09-16T06:05:16.000931+0000 mon.a (mon.0) 640 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:05:17.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:05:16 smithi086 bash[24289]: audit 2024-09-16T06:05:16.003337+0000 mon.b (mon.2) 161 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:05:17.088 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 06:05:16 smithi047 bash[22994]: debug 2024-09-16T06:05:16.732+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T06:05:17.088 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 06:05:16 smithi047 bash[22994]: debug 2024-09-16T06:05:16.736+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T06:05:17.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:05:16 smithi047 bash[22744]: audit 2024-09-16T06:05:14.720670+0000 mgr.a (mgr.14373) 1221 : audit [DBG] from='client.39375 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:05:17.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:05:16 smithi047 bash[22744]: cluster 2024-09-16T06:05:14.768049+0000 mgr.a (mgr.14373) 1222 : cluster [DBG] pgmap v847: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:05:17.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:05:16 smithi047 bash[22744]: audit 2024-09-16T06:05:15.973710+0000 mon.a (mon.0) 638 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:05:17.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:05:16 smithi047 bash[22744]: audit 2024-09-16T06:05:15.983606+0000 mon.a (mon.0) 639 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:05:17.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:05:16 smithi047 bash[22744]: audit 2024-09-16T06:05:15.984564+0000 mon.b (mon.2) 159 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T06:05:17.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:05:16 smithi047 bash[22744]: audit 2024-09-16T06:05:15.986519+0000 mon.b (mon.2) 160 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T06:05:17.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:05:16 smithi047 bash[22744]: audit 2024-09-16T06:05:16.000931+0000 mon.a (mon.0) 640 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:05:17.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:05:16 smithi047 bash[22744]: audit 2024-09-16T06:05:16.003337+0000 mon.b (mon.2) 161 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:05:18.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:05:17 smithi157 bash[24585]: audit 2024-09-16T06:05:16.009126+0000 mgr.a (mgr.14373) 1223 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:05:18.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:05:17 smithi086 bash[24289]: audit 2024-09-16T06:05:16.009126+0000 mgr.a (mgr.14373) 1223 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:05:18.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:05:17 smithi047 bash[22744]: audit 2024-09-16T06:05:16.009126+0000 mgr.a (mgr.14373) 1223 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:05:19.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:05:18 smithi157 bash[24585]: audit 2024-09-16T06:05:16.737233+0000 mgr.a (mgr.14373) 1224 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T06:05:19.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:05:18 smithi157 bash[24585]: cephadm 2024-09-16T06:05:16.739101+0000 mgr.a (mgr.14373) 1225 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T06:05:19.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:05:18 smithi157 bash[24585]: cluster 2024-09-16T06:05:16.769477+0000 mgr.a (mgr.14373) 1226 : cluster [DBG] pgmap v848: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 4.6 KiB/s rd, 255 B/s wr, 4 op/s 2024-09-16T06:05:19.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:05:18 smithi086 bash[24289]: audit 2024-09-16T06:05:16.737233+0000 mgr.a (mgr.14373) 1224 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T06:05:19.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:05:18 smithi086 bash[24289]: cephadm 2024-09-16T06:05:16.739101+0000 mgr.a (mgr.14373) 1225 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T06:05:19.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:05:18 smithi086 bash[24289]: cluster 2024-09-16T06:05:16.769477+0000 mgr.a (mgr.14373) 1226 : cluster [DBG] pgmap v848: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 4.6 KiB/s rd, 255 B/s wr, 4 op/s 2024-09-16T06:05:19.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:05:18 smithi047 bash[22744]: audit 2024-09-16T06:05:16.737233+0000 mgr.a (mgr.14373) 1224 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T06:05:19.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:05:18 smithi047 bash[22744]: cephadm 2024-09-16T06:05:16.739101+0000 mgr.a (mgr.14373) 1225 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T06:05:19.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:05:18 smithi047 bash[22744]: cluster 2024-09-16T06:05:16.769477+0000 mgr.a (mgr.14373) 1226 : cluster [DBG] pgmap v848: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 4.6 KiB/s rd, 255 B/s wr, 4 op/s 2024-09-16T06:05:20.184 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:05:20.185 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:05:20.185 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:05:20.953 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:05:20.953 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:05:20.953 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:05:20.953 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:05:20.953 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:05:21.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:05:20 smithi157 bash[24585]: cluster 2024-09-16T06:05:18.770207+0000 mgr.a (mgr.14373) 1227 : cluster [DBG] pgmap v849: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 3.7 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-16T06:05:21.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:05:20 smithi086 bash[24289]: cluster 2024-09-16T06:05:18.770207+0000 mgr.a (mgr.14373) 1227 : cluster [DBG] pgmap v849: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 3.7 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-16T06:05:21.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:05:20 smithi047 bash[22744]: cluster 2024-09-16T06:05:18.770207+0000 mgr.a (mgr.14373) 1227 : cluster [DBG] pgmap v849: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 3.7 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-16T06:05:22.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:05:21 smithi157 bash[24585]: audit 2024-09-16T06:05:20.521896+0000 mgr.a (mgr.14373) 1228 : audit [DBG] from='client.39549 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:05:22.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:05:21 smithi086 bash[24289]: audit 2024-09-16T06:05:20.521896+0000 mgr.a (mgr.14373) 1228 : audit [DBG] from='client.39549 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:05:22.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:05:21 smithi047 bash[22744]: audit 2024-09-16T06:05:20.521896+0000 mgr.a (mgr.14373) 1228 : audit [DBG] from='client.39549 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:05:23.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:05:22 smithi157 bash[24585]: cluster 2024-09-16T06:05:20.770867+0000 mgr.a (mgr.14373) 1229 : cluster [DBG] pgmap v850: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 3.7 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-16T06:05:23.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:05:22 smithi086 bash[24289]: cluster 2024-09-16T06:05:20.770867+0000 mgr.a (mgr.14373) 1229 : cluster [DBG] pgmap v850: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 3.7 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-16T06:05:23.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:05:22 smithi047 bash[22744]: cluster 2024-09-16T06:05:20.770867+0000 mgr.a (mgr.14373) 1229 : cluster [DBG] pgmap v850: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 3.7 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-16T06:05:25.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:05:24 smithi157 bash[24585]: cluster 2024-09-16T06:05:22.773160+0000 mgr.a (mgr.14373) 1230 : cluster [DBG] pgmap v851: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:05:25.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:05:24 smithi086 bash[24289]: cluster 2024-09-16T06:05:22.773160+0000 mgr.a (mgr.14373) 1230 : cluster [DBG] pgmap v851: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:05:25.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:05:24 smithi047 bash[22744]: cluster 2024-09-16T06:05:22.773160+0000 mgr.a (mgr.14373) 1230 : cluster [DBG] pgmap v851: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:05:25.954 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:05:25.955 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:05:25.955 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:05:26.728 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:05:26.729 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:05:26.729 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:05:26.729 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:05:26.729 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:05:27.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:05:26 smithi157 bash[24585]: cluster 2024-09-16T06:05:24.773938+0000 mgr.a (mgr.14373) 1231 : cluster [DBG] pgmap v852: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:05:27.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:05:26 smithi086 bash[24289]: cluster 2024-09-16T06:05:24.773938+0000 mgr.a (mgr.14373) 1231 : cluster [DBG] pgmap v852: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:05:27.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:05:26 smithi047 bash[22744]: cluster 2024-09-16T06:05:24.773938+0000 mgr.a (mgr.14373) 1231 : cluster [DBG] pgmap v852: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:05:28.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:05:27 smithi157 bash[24585]: audit 2024-09-16T06:05:26.294238+0000 mgr.a (mgr.14373) 1232 : audit [DBG] from='client.39624 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:05:28.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:05:27 smithi086 bash[24289]: audit 2024-09-16T06:05:26.294238+0000 mgr.a (mgr.14373) 1232 : audit [DBG] from='client.39624 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:05:28.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:05:27 smithi047 bash[22744]: audit 2024-09-16T06:05:26.294238+0000 mgr.a (mgr.14373) 1232 : audit [DBG] from='client.39624 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:05:29.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:05:28 smithi157 bash[24585]: cluster 2024-09-16T06:05:26.775356+0000 mgr.a (mgr.14373) 1233 : cluster [DBG] pgmap v853: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:05:29.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:05:28 smithi086 bash[24289]: cluster 2024-09-16T06:05:26.775356+0000 mgr.a (mgr.14373) 1233 : cluster [DBG] pgmap v853: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:05:29.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:05:28 smithi047 bash[22744]: cluster 2024-09-16T06:05:26.775356+0000 mgr.a (mgr.14373) 1233 : cluster [DBG] pgmap v853: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:05:31.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:05:30 smithi157 bash[24585]: cluster 2024-09-16T06:05:28.776100+0000 mgr.a (mgr.14373) 1234 : cluster [DBG] pgmap v854: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 4.2 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-16T06:05:31.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:05:30 smithi086 bash[24289]: cluster 2024-09-16T06:05:28.776100+0000 mgr.a (mgr.14373) 1234 : cluster [DBG] pgmap v854: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 4.2 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-16T06:05:31.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:05:30 smithi047 bash[22744]: cluster 2024-09-16T06:05:28.776100+0000 mgr.a (mgr.14373) 1234 : cluster [DBG] pgmap v854: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 4.2 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-16T06:05:31.730 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:05:31.731 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:05:31.731 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:05:32.496 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:05:32.496 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:05:32.497 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:05:32.497 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:05:32.497 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:05:33.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:05:32 smithi157 bash[24585]: cluster 2024-09-16T06:05:30.776862+0000 mgr.a (mgr.14373) 1235 : cluster [DBG] pgmap v855: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 4.2 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-16T06:05:33.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:05:32 smithi086 bash[24289]: cluster 2024-09-16T06:05:30.776862+0000 mgr.a (mgr.14373) 1235 : cluster [DBG] pgmap v855: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 4.2 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-16T06:05:33.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:05:32 smithi047 bash[22744]: cluster 2024-09-16T06:05:30.776862+0000 mgr.a (mgr.14373) 1235 : cluster [DBG] pgmap v855: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 4.2 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-16T06:05:34.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:05:33 smithi157 bash[24585]: audit 2024-09-16T06:05:32.069155+0000 mgr.a (mgr.14373) 1236 : audit [DBG] from='client.39699 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:05:34.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:05:33 smithi086 bash[24289]: audit 2024-09-16T06:05:32.069155+0000 mgr.a (mgr.14373) 1236 : audit [DBG] from='client.39699 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:05:34.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:05:33 smithi047 bash[22744]: audit 2024-09-16T06:05:32.069155+0000 mgr.a (mgr.14373) 1236 : audit [DBG] from='client.39699 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:05:35.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:05:34 smithi157 bash[24585]: cluster 2024-09-16T06:05:32.779670+0000 mgr.a (mgr.14373) 1237 : cluster [DBG] pgmap v856: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 5.2 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-16T06:05:35.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:05:34 smithi086 bash[24289]: cluster 2024-09-16T06:05:32.779670+0000 mgr.a (mgr.14373) 1237 : cluster [DBG] pgmap v856: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 5.2 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-16T06:05:35.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:05:34 smithi047 bash[22744]: cluster 2024-09-16T06:05:32.779670+0000 mgr.a (mgr.14373) 1237 : cluster [DBG] pgmap v856: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 5.2 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-16T06:05:37.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:05:36 smithi157 bash[24585]: cluster 2024-09-16T06:05:34.780443+0000 mgr.a (mgr.14373) 1238 : cluster [DBG] pgmap v857: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:05:37.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:05:36 smithi086 bash[24289]: cluster 2024-09-16T06:05:34.780443+0000 mgr.a (mgr.14373) 1238 : cluster [DBG] pgmap v857: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:05:37.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:05:36 smithi047 bash[22744]: cluster 2024-09-16T06:05:34.780443+0000 mgr.a (mgr.14373) 1238 : cluster [DBG] pgmap v857: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:05:37.498 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:05:37.498 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:05:37.499 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:05:38.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:05:37 smithi157 bash[24585]: cluster 2024-09-16T06:05:36.782471+0000 mgr.a (mgr.14373) 1239 : cluster [DBG] pgmap v858: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:05:38.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:05:37 smithi086 bash[24289]: cluster 2024-09-16T06:05:36.782471+0000 mgr.a (mgr.14373) 1239 : cluster [DBG] pgmap v858: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:05:38.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:05:37 smithi047 bash[22744]: cluster 2024-09-16T06:05:36.782471+0000 mgr.a (mgr.14373) 1239 : cluster [DBG] pgmap v858: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:05:38.239 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:05:38.239 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:05:38.239 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:05:38.239 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:05:38.239 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:05:39.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:05:38 smithi157 bash[24585]: audit 2024-09-16T06:05:37.839150+0000 mgr.a (mgr.14373) 1240 : audit [DBG] from='client.39777 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:05:39.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:05:38 smithi086 bash[24289]: audit 2024-09-16T06:05:37.839150+0000 mgr.a (mgr.14373) 1240 : audit [DBG] from='client.39777 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:05:39.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:05:38 smithi047 bash[22744]: audit 2024-09-16T06:05:37.839150+0000 mgr.a (mgr.14373) 1240 : audit [DBG] from='client.39777 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:05:40.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:05:39 smithi157 bash[24585]: cluster 2024-09-16T06:05:38.783452+0000 mgr.a (mgr.14373) 1241 : cluster [DBG] pgmap v859: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:05:40.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:05:39 smithi086 bash[24289]: cluster 2024-09-16T06:05:38.783452+0000 mgr.a (mgr.14373) 1241 : cluster [DBG] pgmap v859: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:05:40.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:05:39 smithi047 bash[22744]: cluster 2024-09-16T06:05:38.783452+0000 mgr.a (mgr.14373) 1241 : cluster [DBG] pgmap v859: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:05:42.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:05:41 smithi157 bash[24585]: cluster 2024-09-16T06:05:40.784250+0000 mgr.a (mgr.14373) 1242 : cluster [DBG] pgmap v860: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:05:42.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:05:41 smithi086 bash[24289]: cluster 2024-09-16T06:05:40.784250+0000 mgr.a (mgr.14373) 1242 : cluster [DBG] pgmap v860: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:05:42.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:05:41 smithi047 bash[22744]: cluster 2024-09-16T06:05:40.784250+0000 mgr.a (mgr.14373) 1242 : cluster [DBG] pgmap v860: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:05:43.240 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:05:43.241 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:05:43.241 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:05:43.984 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:05:43.984 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:05:43.984 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:05:43.984 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:05:43.984 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:05:44.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:05:43 smithi157 bash[24585]: cluster 2024-09-16T06:05:42.786487+0000 mgr.a (mgr.14373) 1243 : cluster [DBG] pgmap v861: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:05:44.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:05:43 smithi157 bash[24585]: audit 2024-09-16T06:05:43.574158+0000 mgr.a (mgr.14373) 1244 : audit [DBG] from='client.39852 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:05:44.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:05:43 smithi086 bash[24289]: cluster 2024-09-16T06:05:42.786487+0000 mgr.a (mgr.14373) 1243 : cluster [DBG] pgmap v861: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:05:44.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:05:43 smithi086 bash[24289]: audit 2024-09-16T06:05:43.574158+0000 mgr.a (mgr.14373) 1244 : audit [DBG] from='client.39852 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:05:44.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:05:43 smithi047 bash[22744]: cluster 2024-09-16T06:05:42.786487+0000 mgr.a (mgr.14373) 1243 : cluster [DBG] pgmap v861: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:05:44.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:05:43 smithi047 bash[22744]: audit 2024-09-16T06:05:43.574158+0000 mgr.a (mgr.14373) 1244 : audit [DBG] from='client.39852 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:05:46.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:05:45 smithi157 bash[24585]: cluster 2024-09-16T06:05:44.787395+0000 mgr.a (mgr.14373) 1245 : cluster [DBG] pgmap v862: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:05:46.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:05:45 smithi086 bash[24289]: cluster 2024-09-16T06:05:44.787395+0000 mgr.a (mgr.14373) 1245 : cluster [DBG] pgmap v862: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:05:46.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:05:45 smithi047 bash[22744]: cluster 2024-09-16T06:05:44.787395+0000 mgr.a (mgr.14373) 1245 : cluster [DBG] pgmap v862: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:05:48.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:05:47 smithi157 bash[24585]: cluster 2024-09-16T06:05:46.789559+0000 mgr.a (mgr.14373) 1246 : cluster [DBG] pgmap v863: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:05:48.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:05:47 smithi086 bash[24289]: cluster 2024-09-16T06:05:46.789559+0000 mgr.a (mgr.14373) 1246 : cluster [DBG] pgmap v863: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:05:48.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:05:47 smithi047 bash[22744]: cluster 2024-09-16T06:05:46.789559+0000 mgr.a (mgr.14373) 1246 : cluster [DBG] pgmap v863: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:05:48.985 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:05:48.986 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:05:48.986 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:05:49.760 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:05:49.760 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:05:49.761 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:05:49.761 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:05:49.761 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:05:50.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:05:49 smithi157 bash[24585]: cluster 2024-09-16T06:05:48.790311+0000 mgr.a (mgr.14373) 1247 : cluster [DBG] pgmap v864: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:05:50.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:05:49 smithi157 bash[24585]: audit 2024-09-16T06:05:49.324941+0000 mgr.a (mgr.14373) 1248 : audit [DBG] from='client.39930 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:05:50.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:05:49 smithi086 bash[24289]: cluster 2024-09-16T06:05:48.790311+0000 mgr.a (mgr.14373) 1247 : cluster [DBG] pgmap v864: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:05:50.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:05:49 smithi086 bash[24289]: audit 2024-09-16T06:05:49.324941+0000 mgr.a (mgr.14373) 1248 : audit [DBG] from='client.39930 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:05:50.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:05:49 smithi047 bash[22744]: cluster 2024-09-16T06:05:48.790311+0000 mgr.a (mgr.14373) 1247 : cluster [DBG] pgmap v864: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:05:50.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:05:49 smithi047 bash[22744]: audit 2024-09-16T06:05:49.324941+0000 mgr.a (mgr.14373) 1248 : audit [DBG] from='client.39930 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:05:52.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:05:52 smithi047 bash[22744]: cluster 2024-09-16T06:05:50.791307+0000 mgr.a (mgr.14373) 1249 : cluster [DBG] pgmap v865: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:05:53.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:05:52 smithi157 bash[24585]: cluster 2024-09-16T06:05:50.791307+0000 mgr.a (mgr.14373) 1249 : cluster [DBG] pgmap v865: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:05:53.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:05:52 smithi086 bash[24289]: cluster 2024-09-16T06:05:50.791307+0000 mgr.a (mgr.14373) 1249 : cluster [DBG] pgmap v865: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:05:54.762 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:05:54.762 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:05:54.762 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:05:54.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:05:54 smithi047 bash[22744]: cluster 2024-09-16T06:05:52.793575+0000 mgr.a (mgr.14373) 1250 : cluster [DBG] pgmap v866: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:05:55.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:05:54 smithi157 bash[24585]: cluster 2024-09-16T06:05:52.793575+0000 mgr.a (mgr.14373) 1250 : cluster [DBG] pgmap v866: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:05:55.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:05:54 smithi086 bash[24289]: cluster 2024-09-16T06:05:52.793575+0000 mgr.a (mgr.14373) 1250 : cluster [DBG] pgmap v866: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:05:55.506 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:05:55.506 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:05:55.506 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:05:55.507 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:05:55.507 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:05:56.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:05:56 smithi047 bash[22744]: cluster 2024-09-16T06:05:54.794376+0000 mgr.a (mgr.14373) 1251 : cluster [DBG] pgmap v867: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:05:56.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:05:56 smithi047 bash[22744]: audit 2024-09-16T06:05:55.099912+0000 mgr.a (mgr.14373) 1252 : audit [DBG] from='client.40005 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:05:57.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:05:56 smithi157 bash[24585]: cluster 2024-09-16T06:05:54.794376+0000 mgr.a (mgr.14373) 1251 : cluster [DBG] pgmap v867: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:05:57.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:05:56 smithi157 bash[24585]: audit 2024-09-16T06:05:55.099912+0000 mgr.a (mgr.14373) 1252 : audit [DBG] from='client.40005 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:05:57.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:05:56 smithi086 bash[24289]: cluster 2024-09-16T06:05:54.794376+0000 mgr.a (mgr.14373) 1251 : cluster [DBG] pgmap v867: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:05:57.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:05:56 smithi086 bash[24289]: audit 2024-09-16T06:05:55.099912+0000 mgr.a (mgr.14373) 1252 : audit [DBG] from='client.40005 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:05:59.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:05:58 smithi157 bash[24585]: cluster 2024-09-16T06:05:56.796782+0000 mgr.a (mgr.14373) 1253 : cluster [DBG] pgmap v868: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:05:59.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:05:58 smithi086 bash[24289]: cluster 2024-09-16T06:05:56.796782+0000 mgr.a (mgr.14373) 1253 : cluster [DBG] pgmap v868: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:05:59.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:05:58 smithi047 bash[22744]: cluster 2024-09-16T06:05:56.796782+0000 mgr.a (mgr.14373) 1253 : cluster [DBG] pgmap v868: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:06:00.508 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:06:00.508 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:06:00.508 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:06:01.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:06:00 smithi157 bash[24585]: cluster 2024-09-16T06:05:58.797606+0000 mgr.a (mgr.14373) 1254 : cluster [DBG] pgmap v869: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:06:01.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:06:00 smithi086 bash[24289]: cluster 2024-09-16T06:05:58.797606+0000 mgr.a (mgr.14373) 1254 : cluster [DBG] pgmap v869: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:06:01.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:06:00 smithi047 bash[22744]: cluster 2024-09-16T06:05:58.797606+0000 mgr.a (mgr.14373) 1254 : cluster [DBG] pgmap v869: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:06:01.256 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:06:01.257 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:06:01.257 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:06:01.257 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:06:01.257 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:06:03.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:06:02 smithi157 bash[24585]: cluster 2024-09-16T06:06:00.798384+0000 mgr.a (mgr.14373) 1255 : cluster [DBG] pgmap v870: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:06:03.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:06:02 smithi157 bash[24585]: audit 2024-09-16T06:06:00.844111+0000 mgr.a (mgr.14373) 1256 : audit [DBG] from='client.40083 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:06:03.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:06:02 smithi086 bash[24289]: cluster 2024-09-16T06:06:00.798384+0000 mgr.a (mgr.14373) 1255 : cluster [DBG] pgmap v870: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:06:03.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:06:02 smithi086 bash[24289]: audit 2024-09-16T06:06:00.844111+0000 mgr.a (mgr.14373) 1256 : audit [DBG] from='client.40083 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:06:03.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:06:02 smithi047 bash[22744]: cluster 2024-09-16T06:06:00.798384+0000 mgr.a (mgr.14373) 1255 : cluster [DBG] pgmap v870: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:06:03.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:06:02 smithi047 bash[22744]: audit 2024-09-16T06:06:00.844111+0000 mgr.a (mgr.14373) 1256 : audit [DBG] from='client.40083 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:06:05.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:06:04 smithi157 bash[24585]: cluster 2024-09-16T06:06:02.800723+0000 mgr.a (mgr.14373) 1257 : cluster [DBG] pgmap v871: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:06:05.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:06:04 smithi086 bash[24289]: cluster 2024-09-16T06:06:02.800723+0000 mgr.a (mgr.14373) 1257 : cluster [DBG] pgmap v871: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:06:05.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:06:04 smithi047 bash[22744]: cluster 2024-09-16T06:06:02.800723+0000 mgr.a (mgr.14373) 1257 : cluster [DBG] pgmap v871: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:06:06.258 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:06:06.259 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:06:06.259 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:06:07.034 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:06:07.034 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:06:07.034 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:06:07.034 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:06:07.034 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:06:07.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:06:06 smithi157 bash[24585]: cluster 2024-09-16T06:06:04.801495+0000 mgr.a (mgr.14373) 1258 : cluster [DBG] pgmap v872: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:06:07.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:06:06 smithi086 bash[24289]: cluster 2024-09-16T06:06:04.801495+0000 mgr.a (mgr.14373) 1258 : cluster [DBG] pgmap v872: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:06:07.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:06:06 smithi047 bash[22744]: cluster 2024-09-16T06:06:04.801495+0000 mgr.a (mgr.14373) 1258 : cluster [DBG] pgmap v872: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:06:08.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:06:07 smithi157 bash[24585]: audit 2024-09-16T06:06:06.594647+0000 mgr.a (mgr.14373) 1259 : audit [DBG] from='client.40161 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:06:08.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:06:07 smithi086 bash[24289]: audit 2024-09-16T06:06:06.594647+0000 mgr.a (mgr.14373) 1259 : audit [DBG] from='client.40161 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:06:08.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:06:07 smithi047 bash[22744]: audit 2024-09-16T06:06:06.594647+0000 mgr.a (mgr.14373) 1259 : audit [DBG] from='client.40161 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:06:09.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:06:08 smithi157 bash[24585]: cluster 2024-09-16T06:06:06.802876+0000 mgr.a (mgr.14373) 1260 : cluster [DBG] pgmap v873: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:06:09.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:06:08 smithi086 bash[24289]: cluster 2024-09-16T06:06:06.802876+0000 mgr.a (mgr.14373) 1260 : cluster [DBG] pgmap v873: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:06:09.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:06:08 smithi047 bash[22744]: cluster 2024-09-16T06:06:06.802876+0000 mgr.a (mgr.14373) 1260 : cluster [DBG] pgmap v873: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:06:11.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:06:10 smithi157 bash[24585]: cluster 2024-09-16T06:06:08.803753+0000 mgr.a (mgr.14373) 1261 : cluster [DBG] pgmap v874: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T06:06:11.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:06:10 smithi086 bash[24289]: cluster 2024-09-16T06:06:08.803753+0000 mgr.a (mgr.14373) 1261 : cluster [DBG] pgmap v874: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T06:06:11.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:06:10 smithi047 bash[22744]: cluster 2024-09-16T06:06:08.803753+0000 mgr.a (mgr.14373) 1261 : cluster [DBG] pgmap v874: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T06:06:12.036 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:06:12.036 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:06:12.037 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:06:12.808 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:06:12.808 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:06:12.809 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:06:12.809 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:06:12.809 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:06:13.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:06:12 smithi157 bash[24585]: cluster 2024-09-16T06:06:10.804532+0000 mgr.a (mgr.14373) 1262 : cluster [DBG] pgmap v875: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T06:06:13.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:06:12 smithi086 bash[24289]: cluster 2024-09-16T06:06:10.804532+0000 mgr.a (mgr.14373) 1262 : cluster [DBG] pgmap v875: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T06:06:13.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:06:12 smithi047 bash[22744]: cluster 2024-09-16T06:06:10.804532+0000 mgr.a (mgr.14373) 1262 : cluster [DBG] pgmap v875: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T06:06:14.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:06:13 smithi157 bash[24585]: audit 2024-09-16T06:06:12.376552+0000 mgr.a (mgr.14373) 1263 : audit [DBG] from='client.40239 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:06:14.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:06:13 smithi086 bash[24289]: audit 2024-09-16T06:06:12.376552+0000 mgr.a (mgr.14373) 1263 : audit [DBG] from='client.40239 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:06:14.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:06:13 smithi047 bash[22744]: audit 2024-09-16T06:06:12.376552+0000 mgr.a (mgr.14373) 1263 : audit [DBG] from='client.40239 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:06:15.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:06:14 smithi157 bash[24585]: cluster 2024-09-16T06:06:12.805680+0000 mgr.a (mgr.14373) 1264 : cluster [DBG] pgmap v876: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:06:15.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:06:14 smithi086 bash[24289]: cluster 2024-09-16T06:06:12.805680+0000 mgr.a (mgr.14373) 1264 : cluster [DBG] pgmap v876: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:06:15.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:06:14 smithi047 bash[22744]: cluster 2024-09-16T06:06:12.805680+0000 mgr.a (mgr.14373) 1264 : cluster [DBG] pgmap v876: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:06:17.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:06:16 smithi157 bash[24585]: cluster 2024-09-16T06:06:14.806446+0000 mgr.a (mgr.14373) 1265 : cluster [DBG] pgmap v877: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T06:06:17.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:06:16 smithi086 bash[24289]: cluster 2024-09-16T06:06:14.806446+0000 mgr.a (mgr.14373) 1265 : cluster [DBG] pgmap v877: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T06:06:17.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:06:16 smithi047 bash[22744]: cluster 2024-09-16T06:06:14.806446+0000 mgr.a (mgr.14373) 1265 : cluster [DBG] pgmap v877: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T06:06:17.810 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:06:17.810 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:06:17.810 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:06:18.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:06:17 smithi157 bash[24585]: audit 2024-09-16T06:06:16.787972+0000 mon.b (mon.2) 162 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T06:06:18.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:06:17 smithi086 bash[24289]: audit 2024-09-16T06:06:16.787972+0000 mon.b (mon.2) 162 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T06:06:18.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:06:17 smithi047 bash[22744]: audit 2024-09-16T06:06:16.787972+0000 mon.b (mon.2) 162 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T06:06:18.565 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:06:18.565 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:06:18.565 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:06:18.565 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:06:18.565 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:06:19.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:06:18 smithi157 bash[24585]: cluster 2024-09-16T06:06:16.809233+0000 mgr.a (mgr.14373) 1266 : cluster [DBG] pgmap v878: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:06:19.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:06:18 smithi086 bash[24289]: cluster 2024-09-16T06:06:16.809233+0000 mgr.a (mgr.14373) 1266 : cluster [DBG] pgmap v878: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:06:19.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:06:18 smithi047 bash[22744]: cluster 2024-09-16T06:06:16.809233+0000 mgr.a (mgr.14373) 1266 : cluster [DBG] pgmap v878: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:06:20.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:06:19 smithi157 bash[24585]: audit 2024-09-16T06:06:18.147084+0000 mgr.a (mgr.14373) 1267 : audit [DBG] from='client.40314 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:06:20.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:06:19 smithi086 bash[24289]: audit 2024-09-16T06:06:18.147084+0000 mgr.a (mgr.14373) 1267 : audit [DBG] from='client.40314 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:06:20.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:06:19 smithi047 bash[22744]: audit 2024-09-16T06:06:18.147084+0000 mgr.a (mgr.14373) 1267 : audit [DBG] from='client.40314 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:06:21.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:06:20 smithi157 bash[24585]: cluster 2024-09-16T06:06:18.810308+0000 mgr.a (mgr.14373) 1268 : cluster [DBG] pgmap v879: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:06:21.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:06:20 smithi086 bash[24289]: cluster 2024-09-16T06:06:18.810308+0000 mgr.a (mgr.14373) 1268 : cluster [DBG] pgmap v879: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:06:21.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:06:20 smithi047 bash[22744]: cluster 2024-09-16T06:06:18.810308+0000 mgr.a (mgr.14373) 1268 : cluster [DBG] pgmap v879: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:06:23.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:06:22 smithi157 bash[24585]: cluster 2024-09-16T06:06:20.811290+0000 mgr.a (mgr.14373) 1269 : cluster [DBG] pgmap v880: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:06:23.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:06:22 smithi086 bash[24289]: cluster 2024-09-16T06:06:20.811290+0000 mgr.a (mgr.14373) 1269 : cluster [DBG] pgmap v880: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:06:23.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:06:22 smithi047 bash[22744]: cluster 2024-09-16T06:06:20.811290+0000 mgr.a (mgr.14373) 1269 : cluster [DBG] pgmap v880: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:06:23.566 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:06:23.567 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:06:23.568 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:06:24.323 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:06:24.323 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:06:24.323 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:06:24.324 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:06:24.324 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:06:24.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:06:24 smithi086 bash[24289]: cluster 2024-09-16T06:06:22.813672+0000 mgr.a (mgr.14373) 1270 : cluster [DBG] pgmap v881: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:06:25.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:06:24 smithi157 bash[24585]: cluster 2024-09-16T06:06:22.813672+0000 mgr.a (mgr.14373) 1270 : cluster [DBG] pgmap v881: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:06:25.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:06:24 smithi047 bash[22744]: cluster 2024-09-16T06:06:22.813672+0000 mgr.a (mgr.14373) 1270 : cluster [DBG] pgmap v881: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:06:26.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:06:25 smithi157 bash[24585]: audit 2024-09-16T06:06:23.906811+0000 mgr.a (mgr.14373) 1271 : audit [DBG] from='client.40383 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:06:26.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:06:25 smithi086 bash[24289]: audit 2024-09-16T06:06:23.906811+0000 mgr.a (mgr.14373) 1271 : audit [DBG] from='client.40383 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:06:26.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:06:25 smithi047 bash[22744]: audit 2024-09-16T06:06:23.906811+0000 mgr.a (mgr.14373) 1271 : audit [DBG] from='client.40383 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:06:27.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:06:26 smithi157 bash[24585]: cluster 2024-09-16T06:06:24.814715+0000 mgr.a (mgr.14373) 1272 : cluster [DBG] pgmap v882: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:06:27.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:06:26 smithi086 bash[24289]: cluster 2024-09-16T06:06:24.814715+0000 mgr.a (mgr.14373) 1272 : cluster [DBG] pgmap v882: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:06:27.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:06:26 smithi047 bash[22744]: cluster 2024-09-16T06:06:24.814715+0000 mgr.a (mgr.14373) 1272 : cluster [DBG] pgmap v882: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:06:28.088 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 06:06:27 smithi047 bash[22994]: debug 2024-09-16T06:06:27.807+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T06:06:28.088 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 06:06:27 smithi047 bash[22994]: debug 2024-09-16T06:06:27.807+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T06:06:28.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:06:28 smithi047 bash[22744]: cluster 2024-09-16T06:06:26.816917+0000 mgr.a (mgr.14373) 1273 : cluster [DBG] pgmap v883: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:06:28.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:06:28 smithi047 bash[22744]: audit 2024-09-16T06:06:27.029678+0000 mon.a (mon.0) 641 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:06:28.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:06:28 smithi047 bash[22744]: audit 2024-09-16T06:06:27.040804+0000 mon.b (mon.2) 163 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T06:06:28.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:06:28 smithi047 bash[22744]: audit 2024-09-16T06:06:27.041215+0000 mon.a (mon.0) 642 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:06:28.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:06:28 smithi047 bash[22744]: audit 2024-09-16T06:06:27.042940+0000 mon.b (mon.2) 164 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T06:06:28.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:06:28 smithi047 bash[22744]: audit 2024-09-16T06:06:27.058256+0000 mon.a (mon.0) 643 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:06:28.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:06:28 smithi047 bash[22744]: audit 2024-09-16T06:06:27.060307+0000 mon.b (mon.2) 165 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:06:28.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:06:28 smithi047 bash[22744]: audit 2024-09-16T06:06:27.066328+0000 mgr.a (mgr.14373) 1274 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:06:28.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:06:28 smithi157 bash[24585]: cluster 2024-09-16T06:06:26.816917+0000 mgr.a (mgr.14373) 1273 : cluster [DBG] pgmap v883: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:06:28.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:06:28 smithi157 bash[24585]: audit 2024-09-16T06:06:27.029678+0000 mon.a (mon.0) 641 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:06:28.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:06:28 smithi157 bash[24585]: audit 2024-09-16T06:06:27.040804+0000 mon.b (mon.2) 163 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T06:06:28.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:06:28 smithi157 bash[24585]: audit 2024-09-16T06:06:27.041215+0000 mon.a (mon.0) 642 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:06:28.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:06:28 smithi157 bash[24585]: audit 2024-09-16T06:06:27.042940+0000 mon.b (mon.2) 164 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T06:06:28.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:06:28 smithi157 bash[24585]: audit 2024-09-16T06:06:27.058256+0000 mon.a (mon.0) 643 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:06:28.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:06:28 smithi157 bash[24585]: audit 2024-09-16T06:06:27.060307+0000 mon.b (mon.2) 165 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:06:28.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:06:28 smithi157 bash[24585]: audit 2024-09-16T06:06:27.066328+0000 mgr.a (mgr.14373) 1274 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:06:28.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:06:28 smithi086 bash[24289]: cluster 2024-09-16T06:06:26.816917+0000 mgr.a (mgr.14373) 1273 : cluster [DBG] pgmap v883: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:06:28.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:06:28 smithi086 bash[24289]: audit 2024-09-16T06:06:27.029678+0000 mon.a (mon.0) 641 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:06:28.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:06:28 smithi086 bash[24289]: audit 2024-09-16T06:06:27.040804+0000 mon.b (mon.2) 163 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T06:06:28.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:06:28 smithi086 bash[24289]: audit 2024-09-16T06:06:27.041215+0000 mon.a (mon.0) 642 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:06:28.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:06:28 smithi086 bash[24289]: audit 2024-09-16T06:06:27.042940+0000 mon.b (mon.2) 164 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T06:06:28.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:06:28 smithi086 bash[24289]: audit 2024-09-16T06:06:27.058256+0000 mon.a (mon.0) 643 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:06:28.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:06:28 smithi086 bash[24289]: audit 2024-09-16T06:06:27.060307+0000 mon.b (mon.2) 165 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:06:28.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:06:28 smithi086 bash[24289]: audit 2024-09-16T06:06:27.066328+0000 mgr.a (mgr.14373) 1274 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:06:29.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:06:29 smithi157 bash[24585]: audit 2024-09-16T06:06:27.811531+0000 mgr.a (mgr.14373) 1275 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T06:06:29.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:06:29 smithi157 bash[24585]: cephadm 2024-09-16T06:06:27.813429+0000 mgr.a (mgr.14373) 1276 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T06:06:29.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:06:29 smithi086 bash[24289]: audit 2024-09-16T06:06:27.811531+0000 mgr.a (mgr.14373) 1275 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T06:06:29.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:06:29 smithi086 bash[24289]: cephadm 2024-09-16T06:06:27.813429+0000 mgr.a (mgr.14373) 1276 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T06:06:29.324 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:06:29.325 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:06:29.325 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:06:29.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:06:29 smithi047 bash[22744]: audit 2024-09-16T06:06:27.811531+0000 mgr.a (mgr.14373) 1275 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T06:06:29.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:06:29 smithi047 bash[22744]: cephadm 2024-09-16T06:06:27.813429+0000 mgr.a (mgr.14373) 1276 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T06:06:30.100 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:06:30.100 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:06:30.100 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:06:30.100 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:06:30.100 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:06:30.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:06:30 smithi157 bash[24585]: cluster 2024-09-16T06:06:28.817847+0000 mgr.a (mgr.14373) 1277 : cluster [DBG] pgmap v884: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:06:30.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:06:30 smithi157 bash[24585]: audit 2024-09-16T06:06:29.667516+0000 mgr.a (mgr.14373) 1278 : audit [DBG] from='client.40569 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:06:30.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:06:30 smithi086 bash[24289]: cluster 2024-09-16T06:06:28.817847+0000 mgr.a (mgr.14373) 1277 : cluster [DBG] pgmap v884: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:06:30.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:06:30 smithi086 bash[24289]: audit 2024-09-16T06:06:29.667516+0000 mgr.a (mgr.14373) 1278 : audit [DBG] from='client.40569 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:06:30.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:06:30 smithi047 bash[22744]: cluster 2024-09-16T06:06:28.817847+0000 mgr.a (mgr.14373) 1277 : cluster [DBG] pgmap v884: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:06:30.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:06:30 smithi047 bash[22744]: audit 2024-09-16T06:06:29.667516+0000 mgr.a (mgr.14373) 1278 : audit [DBG] from='client.40569 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:06:32.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:06:32 smithi157 bash[24585]: cluster 2024-09-16T06:06:30.818842+0000 mgr.a (mgr.14373) 1279 : cluster [DBG] pgmap v885: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:06:32.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:06:32 smithi086 bash[24289]: cluster 2024-09-16T06:06:30.818842+0000 mgr.a (mgr.14373) 1279 : cluster [DBG] pgmap v885: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:06:32.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:06:32 smithi047 bash[22744]: cluster 2024-09-16T06:06:30.818842+0000 mgr.a (mgr.14373) 1279 : cluster [DBG] pgmap v885: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:06:34.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:06:34 smithi157 bash[24585]: cluster 2024-09-16T06:06:32.821166+0000 mgr.a (mgr.14373) 1280 : cluster [DBG] pgmap v886: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:06:34.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:06:34 smithi086 bash[24289]: cluster 2024-09-16T06:06:32.821166+0000 mgr.a (mgr.14373) 1280 : cluster [DBG] pgmap v886: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:06:34.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:06:34 smithi047 bash[22744]: cluster 2024-09-16T06:06:32.821166+0000 mgr.a (mgr.14373) 1280 : cluster [DBG] pgmap v886: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:06:35.101 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:06:35.102 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:06:35.102 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:06:35.842 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:06:35.843 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:06:35.843 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:06:35.843 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:06:35.843 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:06:36.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:06:36 smithi157 bash[24585]: cluster 2024-09-16T06:06:34.822089+0000 mgr.a (mgr.14373) 1281 : cluster [DBG] pgmap v887: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:06:36.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:06:36 smithi157 bash[24585]: audit 2024-09-16T06:06:35.434954+0000 mgr.a (mgr.14373) 1282 : audit [DBG] from='client.40647 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:06:36.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:06:36 smithi086 bash[24289]: cluster 2024-09-16T06:06:34.822089+0000 mgr.a (mgr.14373) 1281 : cluster [DBG] pgmap v887: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:06:36.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:06:36 smithi086 bash[24289]: audit 2024-09-16T06:06:35.434954+0000 mgr.a (mgr.14373) 1282 : audit [DBG] from='client.40647 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:06:36.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:06:36 smithi047 bash[22744]: cluster 2024-09-16T06:06:34.822089+0000 mgr.a (mgr.14373) 1281 : cluster [DBG] pgmap v887: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:06:36.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:06:36 smithi047 bash[22744]: audit 2024-09-16T06:06:35.434954+0000 mgr.a (mgr.14373) 1282 : audit [DBG] from='client.40647 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:06:38.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:06:38 smithi157 bash[24585]: cluster 2024-09-16T06:06:36.824611+0000 mgr.a (mgr.14373) 1283 : cluster [DBG] pgmap v888: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:06:38.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:06:38 smithi086 bash[24289]: cluster 2024-09-16T06:06:36.824611+0000 mgr.a (mgr.14373) 1283 : cluster [DBG] pgmap v888: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:06:38.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:06:38 smithi047 bash[22744]: cluster 2024-09-16T06:06:36.824611+0000 mgr.a (mgr.14373) 1283 : cluster [DBG] pgmap v888: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:06:40.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:06:40 smithi086 bash[24289]: cluster 2024-09-16T06:06:38.825550+0000 mgr.a (mgr.14373) 1284 : cluster [DBG] pgmap v889: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:06:40.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:06:40 smithi047 bash[22744]: cluster 2024-09-16T06:06:38.825550+0000 mgr.a (mgr.14373) 1284 : cluster [DBG] pgmap v889: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:06:40.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:06:40 smithi157 bash[24585]: cluster 2024-09-16T06:06:38.825550+0000 mgr.a (mgr.14373) 1284 : cluster [DBG] pgmap v889: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:06:40.844 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:06:40.845 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:06:40.845 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:06:41.614 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:06:41.615 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:06:41.615 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:06:41.615 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:06:41.615 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:06:42.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:06:42 smithi086 bash[24289]: cluster 2024-09-16T06:06:40.826477+0000 mgr.a (mgr.14373) 1285 : cluster [DBG] pgmap v890: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:06:42.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:06:42 smithi086 bash[24289]: audit 2024-09-16T06:06:41.184470+0000 mgr.a (mgr.14373) 1286 : audit [DBG] from='client.40725 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:06:42.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:06:42 smithi047 bash[22744]: cluster 2024-09-16T06:06:40.826477+0000 mgr.a (mgr.14373) 1285 : cluster [DBG] pgmap v890: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:06:42.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:06:42 smithi047 bash[22744]: audit 2024-09-16T06:06:41.184470+0000 mgr.a (mgr.14373) 1286 : audit [DBG] from='client.40725 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:06:42.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:06:42 smithi157 bash[24585]: cluster 2024-09-16T06:06:40.826477+0000 mgr.a (mgr.14373) 1285 : cluster [DBG] pgmap v890: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:06:42.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:06:42 smithi157 bash[24585]: audit 2024-09-16T06:06:41.184470+0000 mgr.a (mgr.14373) 1286 : audit [DBG] from='client.40725 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:06:44.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:06:44 smithi086 bash[24289]: cluster 2024-09-16T06:06:42.828882+0000 mgr.a (mgr.14373) 1287 : cluster [DBG] pgmap v891: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:06:44.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:06:44 smithi047 bash[22744]: cluster 2024-09-16T06:06:42.828882+0000 mgr.a (mgr.14373) 1287 : cluster [DBG] pgmap v891: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:06:44.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:06:44 smithi157 bash[24585]: cluster 2024-09-16T06:06:42.828882+0000 mgr.a (mgr.14373) 1287 : cluster [DBG] pgmap v891: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:06:46.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:06:46 smithi086 bash[24289]: cluster 2024-09-16T06:06:44.829679+0000 mgr.a (mgr.14373) 1288 : cluster [DBG] pgmap v892: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T06:06:46.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:06:46 smithi047 bash[22744]: cluster 2024-09-16T06:06:44.829679+0000 mgr.a (mgr.14373) 1288 : cluster [DBG] pgmap v892: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T06:06:46.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:06:46 smithi157 bash[24585]: cluster 2024-09-16T06:06:44.829679+0000 mgr.a (mgr.14373) 1288 : cluster [DBG] pgmap v892: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T06:06:46.616 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:06:46.616 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:06:46.616 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:06:47.365 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:06:47.365 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:06:47.365 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:06:47.365 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:06:47.365 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:06:48.340 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:06:48 smithi047 bash[22744]: cluster 2024-09-16T06:06:46.831678+0000 mgr.a (mgr.14373) 1289 : cluster [DBG] pgmap v893: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:06:48.340 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:06:48 smithi047 bash[22744]: audit 2024-09-16T06:06:46.950292+0000 mgr.a (mgr.14373) 1290 : audit [DBG] from='client.40803 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:06:48.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:06:48 smithi157 bash[24585]: cluster 2024-09-16T06:06:46.831678+0000 mgr.a (mgr.14373) 1289 : cluster [DBG] pgmap v893: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:06:48.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:06:48 smithi157 bash[24585]: audit 2024-09-16T06:06:46.950292+0000 mgr.a (mgr.14373) 1290 : audit [DBG] from='client.40803 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:06:48.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:06:48 smithi086 bash[24289]: cluster 2024-09-16T06:06:46.831678+0000 mgr.a (mgr.14373) 1289 : cluster [DBG] pgmap v893: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:06:48.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:06:48 smithi086 bash[24289]: audit 2024-09-16T06:06:46.950292+0000 mgr.a (mgr.14373) 1290 : audit [DBG] from='client.40803 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:06:50.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:06:50 smithi047 bash[22744]: cluster 2024-09-16T06:06:48.832699+0000 mgr.a (mgr.14373) 1291 : cluster [DBG] pgmap v894: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:06:50.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:06:50 smithi157 bash[24585]: cluster 2024-09-16T06:06:48.832699+0000 mgr.a (mgr.14373) 1291 : cluster [DBG] pgmap v894: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:06:50.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:06:50 smithi086 bash[24289]: cluster 2024-09-16T06:06:48.832699+0000 mgr.a (mgr.14373) 1291 : cluster [DBG] pgmap v894: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:06:52.366 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:06:52.367 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:06:52.367 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:06:53.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:06:52 smithi157 bash[24585]: cluster 2024-09-16T06:06:50.833516+0000 mgr.a (mgr.14373) 1292 : cluster [DBG] pgmap v895: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T06:06:53.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:06:52 smithi086 bash[24289]: cluster 2024-09-16T06:06:50.833516+0000 mgr.a (mgr.14373) 1292 : cluster [DBG] pgmap v895: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T06:06:53.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:06:52 smithi047 bash[22744]: cluster 2024-09-16T06:06:50.833516+0000 mgr.a (mgr.14373) 1292 : cluster [DBG] pgmap v895: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T06:06:53.109 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:06:53.109 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:06:53.109 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:06:53.109 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:06:53.109 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:06:55.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:06:54 smithi157 bash[24585]: audit 2024-09-16T06:06:52.702662+0000 mgr.a (mgr.14373) 1293 : audit [DBG] from='client.40878 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:06:55.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:06:54 smithi157 bash[24585]: cluster 2024-09-16T06:06:52.838026+0000 mgr.a (mgr.14373) 1294 : cluster [DBG] pgmap v896: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:06:55.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:06:54 smithi086 bash[24289]: audit 2024-09-16T06:06:52.702662+0000 mgr.a (mgr.14373) 1293 : audit [DBG] from='client.40878 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:06:55.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:06:54 smithi086 bash[24289]: cluster 2024-09-16T06:06:52.838026+0000 mgr.a (mgr.14373) 1294 : cluster [DBG] pgmap v896: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:06:55.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:06:54 smithi047 bash[22744]: audit 2024-09-16T06:06:52.702662+0000 mgr.a (mgr.14373) 1293 : audit [DBG] from='client.40878 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:06:55.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:06:54 smithi047 bash[22744]: cluster 2024-09-16T06:06:52.838026+0000 mgr.a (mgr.14373) 1294 : cluster [DBG] pgmap v896: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:06:57.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:06:56 smithi157 bash[24585]: cluster 2024-09-16T06:06:54.839109+0000 mgr.a (mgr.14373) 1295 : cluster [DBG] pgmap v897: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-16T06:06:57.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:06:56 smithi086 bash[24289]: cluster 2024-09-16T06:06:54.839109+0000 mgr.a (mgr.14373) 1295 : cluster [DBG] pgmap v897: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-16T06:06:57.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:06:56 smithi047 bash[22744]: cluster 2024-09-16T06:06:54.839109+0000 mgr.a (mgr.14373) 1295 : cluster [DBG] pgmap v897: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-16T06:06:58.111 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:06:58.111 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:06:58.111 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:06:58.882 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:06:58.882 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:06:58.882 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:06:58.882 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:06:58.882 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:06:59.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:06:58 smithi157 bash[24585]: cluster 2024-09-16T06:06:56.841362+0000 mgr.a (mgr.14373) 1296 : cluster [DBG] pgmap v898: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-16T06:06:59.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:06:58 smithi086 bash[24289]: cluster 2024-09-16T06:06:56.841362+0000 mgr.a (mgr.14373) 1296 : cluster [DBG] pgmap v898: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-16T06:06:59.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:06:58 smithi047 bash[22744]: cluster 2024-09-16T06:06:56.841362+0000 mgr.a (mgr.14373) 1296 : cluster [DBG] pgmap v898: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-16T06:07:00.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:06:59 smithi157 bash[24585]: audit 2024-09-16T06:06:58.451789+0000 mgr.a (mgr.14373) 1297 : audit [DBG] from='client.40950 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:07:00.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:06:59 smithi086 bash[24289]: audit 2024-09-16T06:06:58.451789+0000 mgr.a (mgr.14373) 1297 : audit [DBG] from='client.40950 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:07:00.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:06:59 smithi047 bash[22744]: audit 2024-09-16T06:06:58.451789+0000 mgr.a (mgr.14373) 1297 : audit [DBG] from='client.40950 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:07:01.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:07:00 smithi157 bash[24585]: cluster 2024-09-16T06:06:58.842083+0000 mgr.a (mgr.14373) 1298 : cluster [DBG] pgmap v899: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:07:01.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:07:00 smithi086 bash[24289]: cluster 2024-09-16T06:06:58.842083+0000 mgr.a (mgr.14373) 1298 : cluster [DBG] pgmap v899: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:07:01.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:07:00 smithi047 bash[22744]: cluster 2024-09-16T06:06:58.842083+0000 mgr.a (mgr.14373) 1298 : cluster [DBG] pgmap v899: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:07:03.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:07:02 smithi157 bash[24585]: cluster 2024-09-16T06:07:00.842856+0000 mgr.a (mgr.14373) 1299 : cluster [DBG] pgmap v900: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:07:03.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:07:02 smithi086 bash[24289]: cluster 2024-09-16T06:07:00.842856+0000 mgr.a (mgr.14373) 1299 : cluster [DBG] pgmap v900: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:07:03.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:07:02 smithi047 bash[22744]: cluster 2024-09-16T06:07:00.842856+0000 mgr.a (mgr.14373) 1299 : cluster [DBG] pgmap v900: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:07:03.883 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:07:03.884 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:07:03.884 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:07:04.653 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:07:04.653 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:07:04.653 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:07:04.654 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:07:04.654 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:07:05.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:07:04 smithi157 bash[24585]: cluster 2024-09-16T06:07:02.845115+0000 mgr.a (mgr.14373) 1300 : cluster [DBG] pgmap v901: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:07:05.080 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:07:04 smithi086 bash[24289]: cluster 2024-09-16T06:07:02.845115+0000 mgr.a (mgr.14373) 1300 : cluster [DBG] pgmap v901: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:07:05.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:07:04 smithi047 bash[22744]: cluster 2024-09-16T06:07:02.845115+0000 mgr.a (mgr.14373) 1300 : cluster [DBG] pgmap v901: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:07:06.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:07:05 smithi157 bash[24585]: audit 2024-09-16T06:07:04.225590+0000 mgr.a (mgr.14373) 1301 : audit [DBG] from='client.41028 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:07:06.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:07:05 smithi086 bash[24289]: audit 2024-09-16T06:07:04.225590+0000 mgr.a (mgr.14373) 1301 : audit [DBG] from='client.41028 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:07:06.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:07:05 smithi047 bash[22744]: audit 2024-09-16T06:07:04.225590+0000 mgr.a (mgr.14373) 1301 : audit [DBG] from='client.41028 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:07:07.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:07:06 smithi157 bash[24585]: cluster 2024-09-16T06:07:04.846025+0000 mgr.a (mgr.14373) 1302 : cluster [DBG] pgmap v902: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:07:07.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:07:06 smithi086 bash[24289]: cluster 2024-09-16T06:07:04.846025+0000 mgr.a (mgr.14373) 1302 : cluster [DBG] pgmap v902: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:07:07.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:07:06 smithi047 bash[22744]: cluster 2024-09-16T06:07:04.846025+0000 mgr.a (mgr.14373) 1302 : cluster [DBG] pgmap v902: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:07:09.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:07:08 smithi157 bash[24585]: cluster 2024-09-16T06:07:06.848396+0000 mgr.a (mgr.14373) 1303 : cluster [DBG] pgmap v903: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:07:09.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:07:08 smithi086 bash[24289]: cluster 2024-09-16T06:07:06.848396+0000 mgr.a (mgr.14373) 1303 : cluster [DBG] pgmap v903: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:07:09.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:07:08 smithi047 bash[22744]: cluster 2024-09-16T06:07:06.848396+0000 mgr.a (mgr.14373) 1303 : cluster [DBG] pgmap v903: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:07:09.655 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:07:09.655 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:07:09.655 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:07:10.428 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:07:10.429 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:07:10.429 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:07:10.429 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:07:10.429 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:07:11.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:07:10 smithi157 bash[24585]: cluster 2024-09-16T06:07:08.849309+0000 mgr.a (mgr.14373) 1304 : cluster [DBG] pgmap v904: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:07:11.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:07:10 smithi086 bash[24289]: cluster 2024-09-16T06:07:08.849309+0000 mgr.a (mgr.14373) 1304 : cluster [DBG] pgmap v904: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:07:11.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:07:10 smithi047 bash[22744]: cluster 2024-09-16T06:07:08.849309+0000 mgr.a (mgr.14373) 1304 : cluster [DBG] pgmap v904: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:07:12.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:07:11 smithi157 bash[24585]: audit 2024-09-16T06:07:09.994303+0000 mgr.a (mgr.14373) 1305 : audit [DBG] from='client.41103 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:07:12.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:07:11 smithi086 bash[24289]: audit 2024-09-16T06:07:09.994303+0000 mgr.a (mgr.14373) 1305 : audit [DBG] from='client.41103 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:07:12.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:07:11 smithi047 bash[22744]: audit 2024-09-16T06:07:09.994303+0000 mgr.a (mgr.14373) 1305 : audit [DBG] from='client.41103 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:07:13.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:07:12 smithi157 bash[24585]: cluster 2024-09-16T06:07:10.850302+0000 mgr.a (mgr.14373) 1306 : cluster [DBG] pgmap v905: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:07:13.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:07:12 smithi086 bash[24289]: cluster 2024-09-16T06:07:10.850302+0000 mgr.a (mgr.14373) 1306 : cluster [DBG] pgmap v905: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:07:13.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:07:12 smithi047 bash[22744]: cluster 2024-09-16T06:07:10.850302+0000 mgr.a (mgr.14373) 1306 : cluster [DBG] pgmap v905: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:07:15.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:07:14 smithi157 bash[24585]: cluster 2024-09-16T06:07:12.852508+0000 mgr.a (mgr.14373) 1307 : cluster [DBG] pgmap v906: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:07:15.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:07:14 smithi086 bash[24289]: cluster 2024-09-16T06:07:12.852508+0000 mgr.a (mgr.14373) 1307 : cluster [DBG] pgmap v906: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:07:15.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:07:14 smithi047 bash[22744]: cluster 2024-09-16T06:07:12.852508+0000 mgr.a (mgr.14373) 1307 : cluster [DBG] pgmap v906: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:07:15.430 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:07:15.431 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:07:15.431 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:07:16.167 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:07:16.168 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:07:16.168 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:07:16.168 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:07:16.168 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:07:17.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:07:16 smithi157 bash[24585]: cluster 2024-09-16T06:07:14.853265+0000 mgr.a (mgr.14373) 1308 : cluster [DBG] pgmap v907: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:07:17.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:07:16 smithi086 bash[24289]: cluster 2024-09-16T06:07:14.853265+0000 mgr.a (mgr.14373) 1308 : cluster [DBG] pgmap v907: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:07:17.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:07:16 smithi047 bash[22744]: cluster 2024-09-16T06:07:14.853265+0000 mgr.a (mgr.14373) 1308 : cluster [DBG] pgmap v907: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:07:18.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:07:17 smithi157 bash[24585]: audit 2024-09-16T06:07:15.767154+0000 mgr.a (mgr.14373) 1309 : audit [DBG] from='client.41181 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:07:18.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:07:17 smithi086 bash[24289]: audit 2024-09-16T06:07:15.767154+0000 mgr.a (mgr.14373) 1309 : audit [DBG] from='client.41181 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:07:18.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:07:17 smithi047 bash[22744]: audit 2024-09-16T06:07:15.767154+0000 mgr.a (mgr.14373) 1309 : audit [DBG] from='client.41181 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:07:19.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:07:18 smithi157 bash[24585]: cluster 2024-09-16T06:07:16.855806+0000 mgr.a (mgr.14373) 1310 : cluster [DBG] pgmap v908: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:07:19.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:07:18 smithi086 bash[24289]: cluster 2024-09-16T06:07:16.855806+0000 mgr.a (mgr.14373) 1310 : cluster [DBG] pgmap v908: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:07:19.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:07:18 smithi047 bash[22744]: cluster 2024-09-16T06:07:16.855806+0000 mgr.a (mgr.14373) 1310 : cluster [DBG] pgmap v908: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:07:21.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:07:20 smithi157 bash[24585]: cluster 2024-09-16T06:07:18.856760+0000 mgr.a (mgr.14373) 1311 : cluster [DBG] pgmap v909: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:07:21.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:07:20 smithi086 bash[24289]: cluster 2024-09-16T06:07:18.856760+0000 mgr.a (mgr.14373) 1311 : cluster [DBG] pgmap v909: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:07:21.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:07:20 smithi047 bash[22744]: cluster 2024-09-16T06:07:18.856760+0000 mgr.a (mgr.14373) 1311 : cluster [DBG] pgmap v909: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:07:21.169 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:07:21.170 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:07:21.170 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:07:21.926 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:07:21.926 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:07:21.926 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:07:21.927 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:07:21.927 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:07:23.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:07:22 smithi157 bash[24585]: cluster 2024-09-16T06:07:20.857671+0000 mgr.a (mgr.14373) 1312 : cluster [DBG] pgmap v910: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:07:23.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:07:22 smithi157 bash[24585]: audit 2024-09-16T06:07:21.508941+0000 mgr.a (mgr.14373) 1313 : audit [DBG] from='client.41259 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:07:23.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:07:22 smithi086 bash[24289]: cluster 2024-09-16T06:07:20.857671+0000 mgr.a (mgr.14373) 1312 : cluster [DBG] pgmap v910: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:07:23.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:07:22 smithi086 bash[24289]: audit 2024-09-16T06:07:21.508941+0000 mgr.a (mgr.14373) 1313 : audit [DBG] from='client.41259 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:07:23.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:07:22 smithi047 bash[22744]: cluster 2024-09-16T06:07:20.857671+0000 mgr.a (mgr.14373) 1312 : cluster [DBG] pgmap v910: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:07:23.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:07:22 smithi047 bash[22744]: audit 2024-09-16T06:07:21.508941+0000 mgr.a (mgr.14373) 1313 : audit [DBG] from='client.41259 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:07:25.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:07:24 smithi157 bash[24585]: cluster 2024-09-16T06:07:22.860485+0000 mgr.a (mgr.14373) 1314 : cluster [DBG] pgmap v911: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:07:25.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:07:24 smithi086 bash[24289]: cluster 2024-09-16T06:07:22.860485+0000 mgr.a (mgr.14373) 1314 : cluster [DBG] pgmap v911: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:07:25.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:07:24 smithi047 bash[22744]: cluster 2024-09-16T06:07:22.860485+0000 mgr.a (mgr.14373) 1314 : cluster [DBG] pgmap v911: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:07:26.928 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:07:26.928 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:07:26.928 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:07:27.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:07:26 smithi157 bash[24585]: cluster 2024-09-16T06:07:24.861432+0000 mgr.a (mgr.14373) 1315 : cluster [DBG] pgmap v912: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:07:27.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:07:26 smithi086 bash[24289]: cluster 2024-09-16T06:07:24.861432+0000 mgr.a (mgr.14373) 1315 : cluster [DBG] pgmap v912: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:07:27.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:07:26 smithi047 bash[22744]: cluster 2024-09-16T06:07:24.861432+0000 mgr.a (mgr.14373) 1315 : cluster [DBG] pgmap v912: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:07:27.675 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:07:27.676 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:07:27.676 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:07:27.676 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:07:27.676 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:07:29.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:07:28 smithi157 bash[24585]: cluster 2024-09-16T06:07:26.863486+0000 mgr.a (mgr.14373) 1316 : cluster [DBG] pgmap v913: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:07:29.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:07:28 smithi157 bash[24585]: audit 2024-09-16T06:07:27.257355+0000 mgr.a (mgr.14373) 1317 : audit [DBG] from='client.41337 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:07:29.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:07:28 smithi157 bash[24585]: audit 2024-09-16T06:07:27.868009+0000 mon.b (mon.2) 166 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T06:07:29.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:07:28 smithi086 bash[24289]: cluster 2024-09-16T06:07:26.863486+0000 mgr.a (mgr.14373) 1316 : cluster [DBG] pgmap v913: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:07:29.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:07:28 smithi086 bash[24289]: audit 2024-09-16T06:07:27.257355+0000 mgr.a (mgr.14373) 1317 : audit [DBG] from='client.41337 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:07:29.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:07:28 smithi086 bash[24289]: audit 2024-09-16T06:07:27.868009+0000 mon.b (mon.2) 166 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T06:07:29.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:07:28 smithi047 bash[22744]: cluster 2024-09-16T06:07:26.863486+0000 mgr.a (mgr.14373) 1316 : cluster [DBG] pgmap v913: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:07:29.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:07:28 smithi047 bash[22744]: audit 2024-09-16T06:07:27.257355+0000 mgr.a (mgr.14373) 1317 : audit [DBG] from='client.41337 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:07:29.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:07:28 smithi047 bash[22744]: audit 2024-09-16T06:07:27.868009+0000 mon.b (mon.2) 166 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T06:07:31.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:07:30 smithi157 bash[24585]: cluster 2024-09-16T06:07:28.864353+0000 mgr.a (mgr.14373) 1318 : cluster [DBG] pgmap v914: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:07:31.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:07:30 smithi086 bash[24289]: cluster 2024-09-16T06:07:28.864353+0000 mgr.a (mgr.14373) 1318 : cluster [DBG] pgmap v914: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:07:31.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:07:30 smithi047 bash[22744]: cluster 2024-09-16T06:07:28.864353+0000 mgr.a (mgr.14373) 1318 : cluster [DBG] pgmap v914: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:07:32.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:07:31 smithi157 bash[24585]: cluster 2024-09-16T06:07:30.865125+0000 mgr.a (mgr.14373) 1319 : cluster [DBG] pgmap v915: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T06:07:32.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:07:31 smithi086 bash[24289]: cluster 2024-09-16T06:07:30.865125+0000 mgr.a (mgr.14373) 1319 : cluster [DBG] pgmap v915: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T06:07:32.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:07:31 smithi047 bash[22744]: cluster 2024-09-16T06:07:30.865125+0000 mgr.a (mgr.14373) 1319 : cluster [DBG] pgmap v915: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T06:07:32.677 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:07:32.678 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:07:32.678 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:07:33.452 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:07:33.452 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:07:33.452 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:07:33.452 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:07:33.452 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:07:34.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:07:33 smithi157 bash[24585]: cluster 2024-09-16T06:07:32.867280+0000 mgr.a (mgr.14373) 1320 : cluster [DBG] pgmap v916: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:07:34.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:07:33 smithi157 bash[24585]: audit 2024-09-16T06:07:33.020754+0000 mgr.a (mgr.14373) 1321 : audit [DBG] from='client.41412 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:07:34.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:07:33 smithi086 bash[24289]: cluster 2024-09-16T06:07:32.867280+0000 mgr.a (mgr.14373) 1320 : cluster [DBG] pgmap v916: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:07:34.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:07:33 smithi086 bash[24289]: audit 2024-09-16T06:07:33.020754+0000 mgr.a (mgr.14373) 1321 : audit [DBG] from='client.41412 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:07:34.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:07:33 smithi047 bash[22744]: cluster 2024-09-16T06:07:32.867280+0000 mgr.a (mgr.14373) 1320 : cluster [DBG] pgmap v916: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:07:34.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:07:33 smithi047 bash[22744]: audit 2024-09-16T06:07:33.020754+0000 mgr.a (mgr.14373) 1321 : audit [DBG] from='client.41412 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:07:36.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:07:35 smithi157 bash[24585]: cluster 2024-09-16T06:07:34.868171+0000 mgr.a (mgr.14373) 1322 : cluster [DBG] pgmap v917: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:07:36.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:07:35 smithi086 bash[24289]: cluster 2024-09-16T06:07:34.868171+0000 mgr.a (mgr.14373) 1322 : cluster [DBG] pgmap v917: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:07:36.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:07:35 smithi047 bash[22744]: cluster 2024-09-16T06:07:34.868171+0000 mgr.a (mgr.14373) 1322 : cluster [DBG] pgmap v917: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:07:38.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:07:37 smithi157 bash[24585]: cluster 2024-09-16T06:07:36.870318+0000 mgr.a (mgr.14373) 1323 : cluster [DBG] pgmap v918: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:07:38.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:07:37 smithi086 bash[24289]: cluster 2024-09-16T06:07:36.870318+0000 mgr.a (mgr.14373) 1323 : cluster [DBG] pgmap v918: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:07:38.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:07:37 smithi047 bash[22744]: cluster 2024-09-16T06:07:36.870318+0000 mgr.a (mgr.14373) 1323 : cluster [DBG] pgmap v918: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:07:38.453 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:07:38.454 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:07:38.454 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:07:39.307 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:07:39.308 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:07:39.308 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:07:39.308 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:07:39.308 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:07:39.337 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 06:07:38 smithi047 bash[22994]: debug 2024-09-16T06:07:38.909+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T06:07:39.337 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 06:07:38 smithi047 bash[22994]: debug 2024-09-16T06:07:38.921+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T06:07:39.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:07:39 smithi047 bash[22744]: audit 2024-09-16T06:07:38.128673+0000 mon.a (mon.0) 644 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:07:39.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:07:39 smithi047 bash[22744]: audit 2024-09-16T06:07:38.138827+0000 mon.b (mon.2) 167 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T06:07:39.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:07:39 smithi047 bash[22744]: audit 2024-09-16T06:07:38.139130+0000 mon.a (mon.0) 645 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:07:39.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:07:39 smithi047 bash[22744]: audit 2024-09-16T06:07:38.141162+0000 mon.b (mon.2) 168 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T06:07:39.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:07:39 smithi047 bash[22744]: audit 2024-09-16T06:07:38.156851+0000 mon.a (mon.0) 646 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:07:39.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:07:39 smithi047 bash[22744]: audit 2024-09-16T06:07:38.159239+0000 mon.b (mon.2) 169 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:07:39.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:07:39 smithi047 bash[22744]: audit 2024-09-16T06:07:38.165568+0000 mgr.a (mgr.14373) 1324 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:07:39.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:07:39 smithi157 bash[24585]: audit 2024-09-16T06:07:38.128673+0000 mon.a (mon.0) 644 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:07:39.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:07:39 smithi157 bash[24585]: audit 2024-09-16T06:07:38.138827+0000 mon.b (mon.2) 167 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T06:07:39.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:07:39 smithi157 bash[24585]: audit 2024-09-16T06:07:38.139130+0000 mon.a (mon.0) 645 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:07:39.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:07:39 smithi157 bash[24585]: audit 2024-09-16T06:07:38.141162+0000 mon.b (mon.2) 168 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T06:07:39.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:07:39 smithi157 bash[24585]: audit 2024-09-16T06:07:38.156851+0000 mon.a (mon.0) 646 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:07:39.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:07:39 smithi157 bash[24585]: audit 2024-09-16T06:07:38.159239+0000 mon.b (mon.2) 169 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:07:39.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:07:39 smithi157 bash[24585]: audit 2024-09-16T06:07:38.165568+0000 mgr.a (mgr.14373) 1324 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:07:39.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:07:39 smithi086 bash[24289]: audit 2024-09-16T06:07:38.128673+0000 mon.a (mon.0) 644 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:07:39.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:07:39 smithi086 bash[24289]: audit 2024-09-16T06:07:38.138827+0000 mon.b (mon.2) 167 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T06:07:39.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:07:39 smithi086 bash[24289]: audit 2024-09-16T06:07:38.139130+0000 mon.a (mon.0) 645 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:07:39.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:07:39 smithi086 bash[24289]: audit 2024-09-16T06:07:38.141162+0000 mon.b (mon.2) 168 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T06:07:39.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:07:39 smithi086 bash[24289]: audit 2024-09-16T06:07:38.156851+0000 mon.a (mon.0) 646 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:07:39.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:07:39 smithi086 bash[24289]: audit 2024-09-16T06:07:38.159239+0000 mon.b (mon.2) 169 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:07:39.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:07:39 smithi086 bash[24289]: audit 2024-09-16T06:07:38.165568+0000 mgr.a (mgr.14373) 1324 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:07:40.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:07:40 smithi157 bash[24585]: audit 2024-09-16T06:07:38.795847+0000 mgr.a (mgr.14373) 1325 : audit [DBG] from='client.41544 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:07:40.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:07:40 smithi157 bash[24585]: cluster 2024-09-16T06:07:38.870834+0000 mgr.a (mgr.14373) 1326 : cluster [DBG] pgmap v919: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:07:40.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:07:40 smithi157 bash[24585]: audit 2024-09-16T06:07:38.913191+0000 mgr.a (mgr.14373) 1327 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T06:07:40.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:07:40 smithi157 bash[24585]: cephadm 2024-09-16T06:07:38.924534+0000 mgr.a (mgr.14373) 1328 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T06:07:40.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:07:40 smithi086 bash[24289]: audit 2024-09-16T06:07:38.795847+0000 mgr.a (mgr.14373) 1325 : audit [DBG] from='client.41544 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:07:40.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:07:40 smithi086 bash[24289]: cluster 2024-09-16T06:07:38.870834+0000 mgr.a (mgr.14373) 1326 : cluster [DBG] pgmap v919: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:07:40.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:07:40 smithi086 bash[24289]: audit 2024-09-16T06:07:38.913191+0000 mgr.a (mgr.14373) 1327 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T06:07:40.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:07:40 smithi086 bash[24289]: cephadm 2024-09-16T06:07:38.924534+0000 mgr.a (mgr.14373) 1328 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T06:07:40.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:07:40 smithi047 bash[22744]: audit 2024-09-16T06:07:38.795847+0000 mgr.a (mgr.14373) 1325 : audit [DBG] from='client.41544 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:07:40.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:07:40 smithi047 bash[22744]: cluster 2024-09-16T06:07:38.870834+0000 mgr.a (mgr.14373) 1326 : cluster [DBG] pgmap v919: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:07:40.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:07:40 smithi047 bash[22744]: audit 2024-09-16T06:07:38.913191+0000 mgr.a (mgr.14373) 1327 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T06:07:40.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:07:40 smithi047 bash[22744]: cephadm 2024-09-16T06:07:38.924534+0000 mgr.a (mgr.14373) 1328 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T06:07:42.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:07:42 smithi157 bash[24585]: cluster 2024-09-16T06:07:40.871616+0000 mgr.a (mgr.14373) 1329 : cluster [DBG] pgmap v920: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:07:42.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:07:42 smithi086 bash[24289]: cluster 2024-09-16T06:07:40.871616+0000 mgr.a (mgr.14373) 1329 : cluster [DBG] pgmap v920: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:07:42.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:07:42 smithi047 bash[22744]: cluster 2024-09-16T06:07:40.871616+0000 mgr.a (mgr.14373) 1329 : cluster [DBG] pgmap v920: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:07:44.309 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:07:44.310 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:07:44.310 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:07:44.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:07:44 smithi157 bash[24585]: cluster 2024-09-16T06:07:42.873796+0000 mgr.a (mgr.14373) 1330 : cluster [DBG] pgmap v921: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:07:44.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:07:44 smithi086 bash[24289]: cluster 2024-09-16T06:07:42.873796+0000 mgr.a (mgr.14373) 1330 : cluster [DBG] pgmap v921: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:07:44.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:07:44 smithi047 bash[22744]: cluster 2024-09-16T06:07:42.873796+0000 mgr.a (mgr.14373) 1330 : cluster [DBG] pgmap v921: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:07:45.052 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:07:45.052 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:07:45.052 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:07:45.053 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:07:45.053 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:07:45.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:07:45 smithi157 bash[24585]: audit 2024-09-16T06:07:44.645919+0000 mgr.a (mgr.14373) 1331 : audit [DBG] from='client.41670 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:07:45.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:07:45 smithi086 bash[24289]: audit 2024-09-16T06:07:44.645919+0000 mgr.a (mgr.14373) 1331 : audit [DBG] from='client.41670 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:07:45.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:07:45 smithi047 bash[22744]: audit 2024-09-16T06:07:44.645919+0000 mgr.a (mgr.14373) 1331 : audit [DBG] from='client.41670 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:07:46.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:07:46 smithi157 bash[24585]: cluster 2024-09-16T06:07:44.874448+0000 mgr.a (mgr.14373) 1332 : cluster [DBG] pgmap v922: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:07:46.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:07:46 smithi086 bash[24289]: cluster 2024-09-16T06:07:44.874448+0000 mgr.a (mgr.14373) 1332 : cluster [DBG] pgmap v922: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:07:46.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:07:46 smithi047 bash[22744]: cluster 2024-09-16T06:07:44.874448+0000 mgr.a (mgr.14373) 1332 : cluster [DBG] pgmap v922: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:07:48.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:07:48 smithi157 bash[24585]: cluster 2024-09-16T06:07:46.876705+0000 mgr.a (mgr.14373) 1333 : cluster [DBG] pgmap v923: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:07:48.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:07:48 smithi086 bash[24289]: cluster 2024-09-16T06:07:46.876705+0000 mgr.a (mgr.14373) 1333 : cluster [DBG] pgmap v923: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:07:48.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:07:48 smithi047 bash[22744]: cluster 2024-09-16T06:07:46.876705+0000 mgr.a (mgr.14373) 1333 : cluster [DBG] pgmap v923: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:07:50.054 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:07:50.055 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:07:50.055 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:07:50.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:07:50 smithi157 bash[24585]: cluster 2024-09-16T06:07:48.877505+0000 mgr.a (mgr.14373) 1334 : cluster [DBG] pgmap v924: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:07:50.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:07:50 smithi086 bash[24289]: cluster 2024-09-16T06:07:48.877505+0000 mgr.a (mgr.14373) 1334 : cluster [DBG] pgmap v924: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:07:50.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:07:50 smithi047 bash[22744]: cluster 2024-09-16T06:07:48.877505+0000 mgr.a (mgr.14373) 1334 : cluster [DBG] pgmap v924: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:07:50.829 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:07:50.830 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:07:50.830 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:07:50.830 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:07:50.830 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:07:51.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:07:51 smithi157 bash[24585]: audit 2024-09-16T06:07:50.394605+0000 mgr.a (mgr.14373) 1335 : audit [DBG] from='client.41748 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:07:51.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:07:51 smithi086 bash[24289]: audit 2024-09-16T06:07:50.394605+0000 mgr.a (mgr.14373) 1335 : audit [DBG] from='client.41748 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:07:51.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:07:51 smithi047 bash[22744]: audit 2024-09-16T06:07:50.394605+0000 mgr.a (mgr.14373) 1335 : audit [DBG] from='client.41748 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:07:52.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:07:52 smithi157 bash[24585]: cluster 2024-09-16T06:07:50.878479+0000 mgr.a (mgr.14373) 1336 : cluster [DBG] pgmap v925: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:07:52.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:07:52 smithi086 bash[24289]: cluster 2024-09-16T06:07:50.878479+0000 mgr.a (mgr.14373) 1336 : cluster [DBG] pgmap v925: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:07:52.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:07:52 smithi047 bash[22744]: cluster 2024-09-16T06:07:50.878479+0000 mgr.a (mgr.14373) 1336 : cluster [DBG] pgmap v925: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:07:54.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:07:54 smithi157 bash[24585]: cluster 2024-09-16T06:07:52.880727+0000 mgr.a (mgr.14373) 1337 : cluster [DBG] pgmap v926: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:07:54.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:07:54 smithi086 bash[24289]: cluster 2024-09-16T06:07:52.880727+0000 mgr.a (mgr.14373) 1337 : cluster [DBG] pgmap v926: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:07:54.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:07:54 smithi047 bash[22744]: cluster 2024-09-16T06:07:52.880727+0000 mgr.a (mgr.14373) 1337 : cluster [DBG] pgmap v926: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:07:55.831 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:07:55.832 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:07:55.832 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:07:56.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:07:56 smithi157 bash[24585]: cluster 2024-09-16T06:07:54.881503+0000 mgr.a (mgr.14373) 1338 : cluster [DBG] pgmap v927: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:07:56.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:07:56 smithi086 bash[24289]: cluster 2024-09-16T06:07:54.881503+0000 mgr.a (mgr.14373) 1338 : cluster [DBG] pgmap v927: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:07:56.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:07:56 smithi047 bash[22744]: cluster 2024-09-16T06:07:54.881503+0000 mgr.a (mgr.14373) 1338 : cluster [DBG] pgmap v927: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:07:56.618 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:07:56.618 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:07:56.618 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:07:56.618 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:07:56.618 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:07:57.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:07:57 smithi157 bash[24585]: audit 2024-09-16T06:07:56.176999+0000 mgr.a (mgr.14373) 1339 : audit [DBG] from='client.41826 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:07:57.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:07:57 smithi086 bash[24289]: audit 2024-09-16T06:07:56.176999+0000 mgr.a (mgr.14373) 1339 : audit [DBG] from='client.41826 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:07:57.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:07:57 smithi047 bash[22744]: audit 2024-09-16T06:07:56.176999+0000 mgr.a (mgr.14373) 1339 : audit [DBG] from='client.41826 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:07:58.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:07:58 smithi157 bash[24585]: cluster 2024-09-16T06:07:56.884018+0000 mgr.a (mgr.14373) 1340 : cluster [DBG] pgmap v928: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-16T06:07:58.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:07:58 smithi086 bash[24289]: cluster 2024-09-16T06:07:56.884018+0000 mgr.a (mgr.14373) 1340 : cluster [DBG] pgmap v928: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-16T06:07:58.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:07:58 smithi047 bash[22744]: cluster 2024-09-16T06:07:56.884018+0000 mgr.a (mgr.14373) 1340 : cluster [DBG] pgmap v928: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-16T06:08:00.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:08:00 smithi157 bash[24585]: cluster 2024-09-16T06:07:58.884943+0000 mgr.a (mgr.14373) 1341 : cluster [DBG] pgmap v929: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T06:08:00.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:08:00 smithi086 bash[24289]: cluster 2024-09-16T06:07:58.884943+0000 mgr.a (mgr.14373) 1341 : cluster [DBG] pgmap v929: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T06:08:00.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:08:00 smithi047 bash[22744]: cluster 2024-09-16T06:07:58.884943+0000 mgr.a (mgr.14373) 1341 : cluster [DBG] pgmap v929: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T06:08:01.619 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:08:01.620 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:08:01.620 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:08:02.394 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:08:02.395 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:08:02.395 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:08:02.395 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:08:02.395 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:08:02.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:08:02 smithi157 bash[24585]: cluster 2024-09-16T06:08:00.885865+0000 mgr.a (mgr.14373) 1342 : cluster [DBG] pgmap v930: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T06:08:02.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:08:02 smithi086 bash[24289]: cluster 2024-09-16T06:08:00.885865+0000 mgr.a (mgr.14373) 1342 : cluster [DBG] pgmap v930: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T06:08:02.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:08:02 smithi047 bash[22744]: cluster 2024-09-16T06:08:00.885865+0000 mgr.a (mgr.14373) 1342 : cluster [DBG] pgmap v930: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T06:08:03.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:08:03 smithi157 bash[24585]: audit 2024-09-16T06:08:01.962088+0000 mgr.a (mgr.14373) 1343 : audit [DBG] from='client.41904 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:08:03.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:08:03 smithi086 bash[24289]: audit 2024-09-16T06:08:01.962088+0000 mgr.a (mgr.14373) 1343 : audit [DBG] from='client.41904 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:08:03.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:08:03 smithi047 bash[22744]: audit 2024-09-16T06:08:01.962088+0000 mgr.a (mgr.14373) 1343 : audit [DBG] from='client.41904 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:08:04.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:08:04 smithi157 bash[24585]: cluster 2024-09-16T06:08:02.888610+0000 mgr.a (mgr.14373) 1344 : cluster [DBG] pgmap v931: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:08:04.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:08:04 smithi086 bash[24289]: cluster 2024-09-16T06:08:02.888610+0000 mgr.a (mgr.14373) 1344 : cluster [DBG] pgmap v931: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:08:04.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:08:04 smithi047 bash[22744]: cluster 2024-09-16T06:08:02.888610+0000 mgr.a (mgr.14373) 1344 : cluster [DBG] pgmap v931: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:08:06.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:08:06 smithi157 bash[24585]: cluster 2024-09-16T06:08:04.889597+0000 mgr.a (mgr.14373) 1345 : cluster [DBG] pgmap v932: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:08:06.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:08:06 smithi086 bash[24289]: cluster 2024-09-16T06:08:04.889597+0000 mgr.a (mgr.14373) 1345 : cluster [DBG] pgmap v932: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:08:06.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:08:06 smithi047 bash[22744]: cluster 2024-09-16T06:08:04.889597+0000 mgr.a (mgr.14373) 1345 : cluster [DBG] pgmap v932: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:08:07.396 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:08:07.397 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:08:07.397 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:08:08.176 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:08:08.176 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:08:08.176 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:08:08.176 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:08:08.176 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:08:08.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:08:08 smithi157 bash[24585]: cluster 2024-09-16T06:08:06.891592+0000 mgr.a (mgr.14373) 1346 : cluster [DBG] pgmap v933: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 69 KiB/s rd, 0 B/s wr, 114 op/s 2024-09-16T06:08:08.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:08:08 smithi086 bash[24289]: cluster 2024-09-16T06:08:06.891592+0000 mgr.a (mgr.14373) 1346 : cluster [DBG] pgmap v933: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 69 KiB/s rd, 0 B/s wr, 114 op/s 2024-09-16T06:08:08.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:08:08 smithi047 bash[22744]: cluster 2024-09-16T06:08:06.891592+0000 mgr.a (mgr.14373) 1346 : cluster [DBG] pgmap v933: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 69 KiB/s rd, 0 B/s wr, 114 op/s 2024-09-16T06:08:09.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:08:09 smithi157 bash[24585]: audit 2024-09-16T06:08:07.737842+0000 mgr.a (mgr.14373) 1347 : audit [DBG] from='client.41982 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:08:09.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:08:09 smithi086 bash[24289]: audit 2024-09-16T06:08:07.737842+0000 mgr.a (mgr.14373) 1347 : audit [DBG] from='client.41982 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:08:09.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:08:09 smithi047 bash[22744]: audit 2024-09-16T06:08:07.737842+0000 mgr.a (mgr.14373) 1347 : audit [DBG] from='client.41982 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:08:10.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:08:10 smithi157 bash[24585]: cluster 2024-09-16T06:08:08.892502+0000 mgr.a (mgr.14373) 1348 : cluster [DBG] pgmap v934: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 69 KiB/s rd, 0 B/s wr, 113 op/s 2024-09-16T06:08:10.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:08:10 smithi086 bash[24289]: cluster 2024-09-16T06:08:08.892502+0000 mgr.a (mgr.14373) 1348 : cluster [DBG] pgmap v934: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 69 KiB/s rd, 0 B/s wr, 113 op/s 2024-09-16T06:08:10.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:08:10 smithi047 bash[22744]: cluster 2024-09-16T06:08:08.892502+0000 mgr.a (mgr.14373) 1348 : cluster [DBG] pgmap v934: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 69 KiB/s rd, 0 B/s wr, 113 op/s 2024-09-16T06:08:12.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:08:12 smithi157 bash[24585]: cluster 2024-09-16T06:08:10.893300+0000 mgr.a (mgr.14373) 1349 : cluster [DBG] pgmap v935: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 69 KiB/s rd, 0 B/s wr, 113 op/s 2024-09-16T06:08:12.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:08:12 smithi086 bash[24289]: cluster 2024-09-16T06:08:10.893300+0000 mgr.a (mgr.14373) 1349 : cluster [DBG] pgmap v935: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 69 KiB/s rd, 0 B/s wr, 113 op/s 2024-09-16T06:08:12.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:08:12 smithi047 bash[22744]: cluster 2024-09-16T06:08:10.893300+0000 mgr.a (mgr.14373) 1349 : cluster [DBG] pgmap v935: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 69 KiB/s rd, 0 B/s wr, 113 op/s 2024-09-16T06:08:13.177 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:08:13.178 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:08:13.178 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:08:13.915 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:08:13.915 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:08:13.915 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:08:13.915 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:08:13.916 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:08:14.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:08:14 smithi157 bash[24585]: cluster 2024-09-16T06:08:12.895515+0000 mgr.a (mgr.14373) 1350 : cluster [DBG] pgmap v936: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 70 KiB/s rd, 0 B/s wr, 114 op/s 2024-09-16T06:08:14.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:08:14 smithi157 bash[24585]: audit 2024-09-16T06:08:13.514112+0000 mgr.a (mgr.14373) 1351 : audit [DBG] from='client.42057 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:08:14.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:08:14 smithi086 bash[24289]: cluster 2024-09-16T06:08:12.895515+0000 mgr.a (mgr.14373) 1350 : cluster [DBG] pgmap v936: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 70 KiB/s rd, 0 B/s wr, 114 op/s 2024-09-16T06:08:14.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:08:14 smithi086 bash[24289]: audit 2024-09-16T06:08:13.514112+0000 mgr.a (mgr.14373) 1351 : audit [DBG] from='client.42057 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:08:14.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:08:14 smithi047 bash[22744]: cluster 2024-09-16T06:08:12.895515+0000 mgr.a (mgr.14373) 1350 : cluster [DBG] pgmap v936: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 70 KiB/s rd, 0 B/s wr, 114 op/s 2024-09-16T06:08:14.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:08:14 smithi047 bash[22744]: audit 2024-09-16T06:08:13.514112+0000 mgr.a (mgr.14373) 1351 : audit [DBG] from='client.42057 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:08:16.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:08:16 smithi157 bash[24585]: cluster 2024-09-16T06:08:14.896437+0000 mgr.a (mgr.14373) 1352 : cluster [DBG] pgmap v937: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 69 KiB/s rd, 0 B/s wr, 114 op/s 2024-09-16T06:08:16.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:08:16 smithi086 bash[24289]: cluster 2024-09-16T06:08:14.896437+0000 mgr.a (mgr.14373) 1352 : cluster [DBG] pgmap v937: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 69 KiB/s rd, 0 B/s wr, 114 op/s 2024-09-16T06:08:16.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:08:16 smithi047 bash[22744]: cluster 2024-09-16T06:08:14.896437+0000 mgr.a (mgr.14373) 1352 : cluster [DBG] pgmap v937: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 69 KiB/s rd, 0 B/s wr, 114 op/s 2024-09-16T06:08:18.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:08:18 smithi157 bash[24585]: cluster 2024-09-16T06:08:16.898626+0000 mgr.a (mgr.14373) 1353 : cluster [DBG] pgmap v938: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 70 KiB/s rd, 0 B/s wr, 114 op/s 2024-09-16T06:08:18.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:08:18 smithi086 bash[24289]: cluster 2024-09-16T06:08:16.898626+0000 mgr.a (mgr.14373) 1353 : cluster [DBG] pgmap v938: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 70 KiB/s rd, 0 B/s wr, 114 op/s 2024-09-16T06:08:18.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:08:18 smithi047 bash[22744]: cluster 2024-09-16T06:08:16.898626+0000 mgr.a (mgr.14373) 1353 : cluster [DBG] pgmap v938: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 70 KiB/s rd, 0 B/s wr, 114 op/s 2024-09-16T06:08:18.916 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:08:18.917 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:08:18.917 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:08:19.655 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:08:19.655 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:08:19.655 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:08:19.656 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:08:19.656 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:08:20.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:08:20 smithi157 bash[24585]: cluster 2024-09-16T06:08:18.899396+0000 mgr.a (mgr.14373) 1354 : cluster [DBG] pgmap v939: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:08:20.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:08:20 smithi157 bash[24585]: audit 2024-09-16T06:08:19.249562+0000 mgr.a (mgr.14373) 1355 : audit [DBG] from='client.42132 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:08:20.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:08:20 smithi086 bash[24289]: cluster 2024-09-16T06:08:18.899396+0000 mgr.a (mgr.14373) 1354 : cluster [DBG] pgmap v939: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:08:20.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:08:20 smithi086 bash[24289]: audit 2024-09-16T06:08:19.249562+0000 mgr.a (mgr.14373) 1355 : audit [DBG] from='client.42132 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:08:20.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:08:20 smithi047 bash[22744]: cluster 2024-09-16T06:08:18.899396+0000 mgr.a (mgr.14373) 1354 : cluster [DBG] pgmap v939: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:08:20.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:08:20 smithi047 bash[22744]: audit 2024-09-16T06:08:19.249562+0000 mgr.a (mgr.14373) 1355 : audit [DBG] from='client.42132 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:08:22.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:08:22 smithi157 bash[24585]: cluster 2024-09-16T06:08:20.900222+0000 mgr.a (mgr.14373) 1356 : cluster [DBG] pgmap v940: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:08:22.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:08:22 smithi086 bash[24289]: cluster 2024-09-16T06:08:20.900222+0000 mgr.a (mgr.14373) 1356 : cluster [DBG] pgmap v940: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:08:22.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:08:22 smithi047 bash[22744]: cluster 2024-09-16T06:08:20.900222+0000 mgr.a (mgr.14373) 1356 : cluster [DBG] pgmap v940: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:08:24.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:08:24 smithi157 bash[24585]: cluster 2024-09-16T06:08:22.902472+0000 mgr.a (mgr.14373) 1357 : cluster [DBG] pgmap v941: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:08:24.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:08:24 smithi086 bash[24289]: cluster 2024-09-16T06:08:22.902472+0000 mgr.a (mgr.14373) 1357 : cluster [DBG] pgmap v941: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:08:24.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:08:24 smithi047 bash[22744]: cluster 2024-09-16T06:08:22.902472+0000 mgr.a (mgr.14373) 1357 : cluster [DBG] pgmap v941: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:08:24.657 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:08:24.657 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:08:24.657 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:08:25.435 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:08:25.435 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:08:25.436 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:08:25.436 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:08:25.436 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:08:26.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:08:26 smithi157 bash[24585]: cluster 2024-09-16T06:08:24.903288+0000 mgr.a (mgr.14373) 1358 : cluster [DBG] pgmap v942: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:08:26.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:08:26 smithi157 bash[24585]: audit 2024-09-16T06:08:24.996295+0000 mgr.a (mgr.14373) 1359 : audit [DBG] from='client.42210 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:08:26.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:08:26 smithi086 bash[24289]: cluster 2024-09-16T06:08:24.903288+0000 mgr.a (mgr.14373) 1358 : cluster [DBG] pgmap v942: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:08:26.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:08:26 smithi086 bash[24289]: audit 2024-09-16T06:08:24.996295+0000 mgr.a (mgr.14373) 1359 : audit [DBG] from='client.42210 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:08:26.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:08:26 smithi047 bash[22744]: cluster 2024-09-16T06:08:24.903288+0000 mgr.a (mgr.14373) 1358 : cluster [DBG] pgmap v942: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:08:26.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:08:26 smithi047 bash[22744]: audit 2024-09-16T06:08:24.996295+0000 mgr.a (mgr.14373) 1359 : audit [DBG] from='client.42210 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:08:28.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:08:28 smithi157 bash[24585]: cluster 2024-09-16T06:08:26.905555+0000 mgr.a (mgr.14373) 1360 : cluster [DBG] pgmap v943: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:08:28.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:08:28 smithi086 bash[24289]: cluster 2024-09-16T06:08:26.905555+0000 mgr.a (mgr.14373) 1360 : cluster [DBG] pgmap v943: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:08:28.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:08:28 smithi047 bash[22744]: cluster 2024-09-16T06:08:26.905555+0000 mgr.a (mgr.14373) 1360 : cluster [DBG] pgmap v943: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:08:30.437 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:08:30.438 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:08:30.438 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:08:30.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:08:30 smithi157 bash[24585]: cluster 2024-09-16T06:08:28.906339+0000 mgr.a (mgr.14373) 1361 : cluster [DBG] pgmap v944: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:08:30.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:08:30 smithi086 bash[24289]: cluster 2024-09-16T06:08:28.906339+0000 mgr.a (mgr.14373) 1361 : cluster [DBG] pgmap v944: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:08:30.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:08:30 smithi047 bash[22744]: cluster 2024-09-16T06:08:28.906339+0000 mgr.a (mgr.14373) 1361 : cluster [DBG] pgmap v944: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:08:31.182 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:08:31.182 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:08:31.182 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:08:31.182 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:08:31.182 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:08:32.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:08:32 smithi157 bash[24585]: audit 2024-09-16T06:08:30.770636+0000 mgr.a (mgr.14373) 1362 : audit [DBG] from='client.42285 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:08:32.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:08:32 smithi157 bash[24585]: cluster 2024-09-16T06:08:30.907090+0000 mgr.a (mgr.14373) 1363 : cluster [DBG] pgmap v945: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:08:32.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:08:32 smithi086 bash[24289]: audit 2024-09-16T06:08:30.770636+0000 mgr.a (mgr.14373) 1362 : audit [DBG] from='client.42285 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:08:32.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:08:32 smithi086 bash[24289]: cluster 2024-09-16T06:08:30.907090+0000 mgr.a (mgr.14373) 1363 : cluster [DBG] pgmap v945: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:08:32.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:08:32 smithi047 bash[22744]: audit 2024-09-16T06:08:30.770636+0000 mgr.a (mgr.14373) 1362 : audit [DBG] from='client.42285 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:08:32.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:08:32 smithi047 bash[22744]: cluster 2024-09-16T06:08:30.907090+0000 mgr.a (mgr.14373) 1363 : cluster [DBG] pgmap v945: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:08:34.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:08:34 smithi086 bash[24289]: cluster 2024-09-16T06:08:32.909398+0000 mgr.a (mgr.14373) 1364 : cluster [DBG] pgmap v946: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:08:34.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:08:34 smithi047 bash[22744]: cluster 2024-09-16T06:08:32.909398+0000 mgr.a (mgr.14373) 1364 : cluster [DBG] pgmap v946: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:08:34.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:08:34 smithi157 bash[24585]: cluster 2024-09-16T06:08:32.909398+0000 mgr.a (mgr.14373) 1364 : cluster [DBG] pgmap v946: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:08:36.183 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:08:36.184 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:08:36.185 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:08:36.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:08:36 smithi086 bash[24289]: cluster 2024-09-16T06:08:34.910150+0000 mgr.a (mgr.14373) 1365 : cluster [DBG] pgmap v947: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:08:36.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:08:36 smithi047 bash[22744]: cluster 2024-09-16T06:08:34.910150+0000 mgr.a (mgr.14373) 1365 : cluster [DBG] pgmap v947: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:08:36.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:08:36 smithi157 bash[24585]: cluster 2024-09-16T06:08:34.910150+0000 mgr.a (mgr.14373) 1365 : cluster [DBG] pgmap v947: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:08:36.920 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:08:36.921 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:08:36.921 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:08:36.921 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:08:36.921 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:08:37.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:08:37 smithi047 bash[22744]: audit 2024-09-16T06:08:36.517249+0000 mgr.a (mgr.14373) 1366 : audit [DBG] from='client.42360 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:08:37.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:08:37 smithi157 bash[24585]: audit 2024-09-16T06:08:36.517249+0000 mgr.a (mgr.14373) 1366 : audit [DBG] from='client.42360 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:08:37.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:08:37 smithi086 bash[24289]: audit 2024-09-16T06:08:36.517249+0000 mgr.a (mgr.14373) 1366 : audit [DBG] from='client.42360 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:08:38.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:08:38 smithi047 bash[22744]: cluster 2024-09-16T06:08:36.911311+0000 mgr.a (mgr.14373) 1367 : cluster [DBG] pgmap v948: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:08:38.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:08:38 smithi157 bash[24585]: cluster 2024-09-16T06:08:36.911311+0000 mgr.a (mgr.14373) 1367 : cluster [DBG] pgmap v948: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:08:38.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:08:38 smithi086 bash[24289]: cluster 2024-09-16T06:08:36.911311+0000 mgr.a (mgr.14373) 1367 : cluster [DBG] pgmap v948: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:08:39.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:08:39 smithi047 bash[22744]: audit 2024-09-16T06:08:38.979093+0000 mon.b (mon.2) 170 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T06:08:39.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:08:39 smithi157 bash[24585]: audit 2024-09-16T06:08:38.979093+0000 mon.b (mon.2) 170 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T06:08:39.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:08:39 smithi086 bash[24289]: audit 2024-09-16T06:08:38.979093+0000 mon.b (mon.2) 170 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T06:08:40.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:08:40 smithi047 bash[22744]: cluster 2024-09-16T06:08:38.912129+0000 mgr.a (mgr.14373) 1368 : cluster [DBG] pgmap v949: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T06:08:40.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:08:40 smithi157 bash[24585]: cluster 2024-09-16T06:08:38.912129+0000 mgr.a (mgr.14373) 1368 : cluster [DBG] pgmap v949: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T06:08:40.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:08:40 smithi086 bash[24289]: cluster 2024-09-16T06:08:38.912129+0000 mgr.a (mgr.14373) 1368 : cluster [DBG] pgmap v949: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T06:08:41.587 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 06:08:41 smithi047 bash[22994]: debug 2024-09-16T06:08:41.108+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T06:08:41.587 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 06:08:41 smithi047 bash[22994]: debug 2024-09-16T06:08:41.108+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T06:08:41.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:08:41 smithi047 bash[22744]: audit 2024-09-16T06:08:40.344117+0000 mon.a (mon.0) 647 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:08:41.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:08:41 smithi047 bash[22744]: audit 2024-09-16T06:08:40.350389+0000 mon.a (mon.0) 648 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:08:41.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:08:41 smithi047 bash[22744]: audit 2024-09-16T06:08:40.356399+0000 mon.a (mon.0) 649 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:08:41.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:08:41 smithi047 bash[22744]: audit 2024-09-16T06:08:40.360808+0000 mon.a (mon.0) 650 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:08:41.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:08:41 smithi047 bash[22744]: audit 2024-09-16T06:08:40.363832+0000 mon.a (mon.0) 651 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:08:41.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:08:41 smithi047 bash[22744]: audit 2024-09-16T06:08:40.367619+0000 mon.b (mon.2) 171 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T06:08:41.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:08:41 smithi047 bash[22744]: audit 2024-09-16T06:08:40.368586+0000 mon.b (mon.2) 172 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T06:08:41.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:08:41 smithi047 bash[22744]: audit 2024-09-16T06:08:40.369873+0000 mon.a (mon.0) 652 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:08:41.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:08:41 smithi047 bash[22744]: audit 2024-09-16T06:08:40.380127+0000 mon.a (mon.0) 653 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:08:41.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:08:41 smithi047 bash[22744]: audit 2024-09-16T06:08:40.380990+0000 mon.b (mon.2) 173 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:08:41.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:08:41 smithi047 bash[22744]: audit 2024-09-16T06:08:40.387380+0000 mgr.a (mgr.14373) 1369 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:08:41.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:08:41 smithi157 bash[24585]: audit 2024-09-16T06:08:40.344117+0000 mon.a (mon.0) 647 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:08:41.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:08:41 smithi157 bash[24585]: audit 2024-09-16T06:08:40.350389+0000 mon.a (mon.0) 648 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:08:41.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:08:41 smithi157 bash[24585]: audit 2024-09-16T06:08:40.356399+0000 mon.a (mon.0) 649 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:08:41.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:08:41 smithi157 bash[24585]: audit 2024-09-16T06:08:40.360808+0000 mon.a (mon.0) 650 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:08:41.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:08:41 smithi157 bash[24585]: audit 2024-09-16T06:08:40.363832+0000 mon.a (mon.0) 651 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:08:41.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:08:41 smithi157 bash[24585]: audit 2024-09-16T06:08:40.367619+0000 mon.b (mon.2) 171 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T06:08:41.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:08:41 smithi157 bash[24585]: audit 2024-09-16T06:08:40.368586+0000 mon.b (mon.2) 172 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T06:08:41.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:08:41 smithi157 bash[24585]: audit 2024-09-16T06:08:40.369873+0000 mon.a (mon.0) 652 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:08:41.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:08:41 smithi157 bash[24585]: audit 2024-09-16T06:08:40.380127+0000 mon.a (mon.0) 653 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:08:41.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:08:41 smithi157 bash[24585]: audit 2024-09-16T06:08:40.380990+0000 mon.b (mon.2) 173 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:08:41.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:08:41 smithi157 bash[24585]: audit 2024-09-16T06:08:40.387380+0000 mgr.a (mgr.14373) 1369 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:08:41.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:08:41 smithi086 bash[24289]: audit 2024-09-16T06:08:40.344117+0000 mon.a (mon.0) 647 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:08:41.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:08:41 smithi086 bash[24289]: audit 2024-09-16T06:08:40.350389+0000 mon.a (mon.0) 648 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:08:41.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:08:41 smithi086 bash[24289]: audit 2024-09-16T06:08:40.356399+0000 mon.a (mon.0) 649 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:08:41.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:08:41 smithi086 bash[24289]: audit 2024-09-16T06:08:40.360808+0000 mon.a (mon.0) 650 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:08:41.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:08:41 smithi086 bash[24289]: audit 2024-09-16T06:08:40.363832+0000 mon.a (mon.0) 651 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:08:41.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:08:41 smithi086 bash[24289]: audit 2024-09-16T06:08:40.367619+0000 mon.b (mon.2) 171 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T06:08:41.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:08:41 smithi086 bash[24289]: audit 2024-09-16T06:08:40.368586+0000 mon.b (mon.2) 172 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T06:08:41.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:08:41 smithi086 bash[24289]: audit 2024-09-16T06:08:40.369873+0000 mon.a (mon.0) 652 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:08:41.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:08:41 smithi086 bash[24289]: audit 2024-09-16T06:08:40.380127+0000 mon.a (mon.0) 653 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:08:41.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:08:41 smithi086 bash[24289]: audit 2024-09-16T06:08:40.380990+0000 mon.b (mon.2) 173 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:08:41.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:08:41 smithi086 bash[24289]: audit 2024-09-16T06:08:40.387380+0000 mgr.a (mgr.14373) 1369 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:08:41.922 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:08:41.923 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:08:41.923 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:08:42.655 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:08:42.655 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:08:42.655 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:08:42.655 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:08:42.655 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:08:42.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:08:42 smithi157 bash[24585]: cluster 2024-09-16T06:08:40.912839+0000 mgr.a (mgr.14373) 1370 : cluster [DBG] pgmap v950: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T06:08:42.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:08:42 smithi157 bash[24585]: audit 2024-09-16T06:08:41.111615+0000 mgr.a (mgr.14373) 1371 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T06:08:42.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:08:42 smithi157 bash[24585]: cephadm 2024-09-16T06:08:41.113850+0000 mgr.a (mgr.14373) 1372 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T06:08:42.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:08:42 smithi086 bash[24289]: cluster 2024-09-16T06:08:40.912839+0000 mgr.a (mgr.14373) 1370 : cluster [DBG] pgmap v950: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T06:08:42.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:08:42 smithi086 bash[24289]: audit 2024-09-16T06:08:41.111615+0000 mgr.a (mgr.14373) 1371 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T06:08:42.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:08:42 smithi086 bash[24289]: cephadm 2024-09-16T06:08:41.113850+0000 mgr.a (mgr.14373) 1372 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T06:08:42.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:08:42 smithi047 bash[22744]: cluster 2024-09-16T06:08:40.912839+0000 mgr.a (mgr.14373) 1370 : cluster [DBG] pgmap v950: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T06:08:42.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:08:42 smithi047 bash[22744]: audit 2024-09-16T06:08:41.111615+0000 mgr.a (mgr.14373) 1371 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T06:08:42.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:08:42 smithi047 bash[22744]: cephadm 2024-09-16T06:08:41.113850+0000 mgr.a (mgr.14373) 1372 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T06:08:43.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:08:43 smithi157 bash[24585]: audit 2024-09-16T06:08:42.252322+0000 mgr.a (mgr.14373) 1373 : audit [DBG] from='client.42543 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:08:43.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:08:43 smithi086 bash[24289]: audit 2024-09-16T06:08:42.252322+0000 mgr.a (mgr.14373) 1373 : audit [DBG] from='client.42543 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:08:43.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:08:43 smithi047 bash[22744]: audit 2024-09-16T06:08:42.252322+0000 mgr.a (mgr.14373) 1373 : audit [DBG] from='client.42543 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:08:44.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:08:44 smithi157 bash[24585]: cluster 2024-09-16T06:08:42.915712+0000 mgr.a (mgr.14373) 1374 : cluster [DBG] pgmap v951: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:08:44.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:08:44 smithi086 bash[24289]: cluster 2024-09-16T06:08:42.915712+0000 mgr.a (mgr.14373) 1374 : cluster [DBG] pgmap v951: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:08:44.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:08:44 smithi047 bash[22744]: cluster 2024-09-16T06:08:42.915712+0000 mgr.a (mgr.14373) 1374 : cluster [DBG] pgmap v951: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:08:46.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:08:46 smithi157 bash[24585]: cluster 2024-09-16T06:08:44.916630+0000 mgr.a (mgr.14373) 1375 : cluster [DBG] pgmap v952: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T06:08:46.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:08:46 smithi086 bash[24289]: cluster 2024-09-16T06:08:44.916630+0000 mgr.a (mgr.14373) 1375 : cluster [DBG] pgmap v952: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T06:08:46.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:08:46 smithi047 bash[22744]: cluster 2024-09-16T06:08:44.916630+0000 mgr.a (mgr.14373) 1375 : cluster [DBG] pgmap v952: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T06:08:47.656 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:08:47.657 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:08:47.657 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:08:48.434 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:08:48.434 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:08:48.434 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:08:48.434 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:08:48.434 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:08:48.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:08:48 smithi157 bash[24585]: cluster 2024-09-16T06:08:46.918744+0000 mgr.a (mgr.14373) 1376 : cluster [DBG] pgmap v953: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:08:48.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:08:48 smithi086 bash[24289]: cluster 2024-09-16T06:08:46.918744+0000 mgr.a (mgr.14373) 1376 : cluster [DBG] pgmap v953: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:08:48.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:08:48 smithi047 bash[22744]: cluster 2024-09-16T06:08:46.918744+0000 mgr.a (mgr.14373) 1376 : cluster [DBG] pgmap v953: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:08:49.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:08:49 smithi157 bash[24585]: audit 2024-09-16T06:08:47.999985+0000 mgr.a (mgr.14373) 1377 : audit [DBG] from='client.42618 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:08:49.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:08:49 smithi086 bash[24289]: audit 2024-09-16T06:08:47.999985+0000 mgr.a (mgr.14373) 1377 : audit [DBG] from='client.42618 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:08:49.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:08:49 smithi047 bash[22744]: audit 2024-09-16T06:08:47.999985+0000 mgr.a (mgr.14373) 1377 : audit [DBG] from='client.42618 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:08:50.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:08:50 smithi157 bash[24585]: cluster 2024-09-16T06:08:48.919724+0000 mgr.a (mgr.14373) 1378 : cluster [DBG] pgmap v954: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:08:50.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:08:50 smithi086 bash[24289]: cluster 2024-09-16T06:08:48.919724+0000 mgr.a (mgr.14373) 1378 : cluster [DBG] pgmap v954: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:08:50.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:08:50 smithi047 bash[22744]: cluster 2024-09-16T06:08:48.919724+0000 mgr.a (mgr.14373) 1378 : cluster [DBG] pgmap v954: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:08:52.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:08:52 smithi157 bash[24585]: cluster 2024-09-16T06:08:50.920515+0000 mgr.a (mgr.14373) 1379 : cluster [DBG] pgmap v955: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:08:52.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:08:52 smithi086 bash[24289]: cluster 2024-09-16T06:08:50.920515+0000 mgr.a (mgr.14373) 1379 : cluster [DBG] pgmap v955: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:08:52.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:08:52 smithi047 bash[22744]: cluster 2024-09-16T06:08:50.920515+0000 mgr.a (mgr.14373) 1379 : cluster [DBG] pgmap v955: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:08:53.435 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:08:53.436 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:08:53.436 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:08:54.193 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:08:54.194 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:08:54.194 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:08:54.194 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:08:54.194 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:08:54.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:08:54 smithi157 bash[24585]: cluster 2024-09-16T06:08:52.922863+0000 mgr.a (mgr.14373) 1380 : cluster [DBG] pgmap v956: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:08:54.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:08:54 smithi086 bash[24289]: cluster 2024-09-16T06:08:52.922863+0000 mgr.a (mgr.14373) 1380 : cluster [DBG] pgmap v956: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:08:54.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:08:54 smithi047 bash[22744]: cluster 2024-09-16T06:08:52.922863+0000 mgr.a (mgr.14373) 1380 : cluster [DBG] pgmap v956: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:08:55.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:08:55 smithi157 bash[24585]: audit 2024-09-16T06:08:53.776705+0000 mgr.a (mgr.14373) 1381 : audit [DBG] from='client.42696 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:08:55.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:08:55 smithi086 bash[24289]: audit 2024-09-16T06:08:53.776705+0000 mgr.a (mgr.14373) 1381 : audit [DBG] from='client.42696 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:08:55.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:08:55 smithi047 bash[22744]: audit 2024-09-16T06:08:53.776705+0000 mgr.a (mgr.14373) 1381 : audit [DBG] from='client.42696 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:08:56.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:08:56 smithi157 bash[24585]: cluster 2024-09-16T06:08:54.923813+0000 mgr.a (mgr.14373) 1382 : cluster [DBG] pgmap v957: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:08:56.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:08:56 smithi086 bash[24289]: cluster 2024-09-16T06:08:54.923813+0000 mgr.a (mgr.14373) 1382 : cluster [DBG] pgmap v957: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:08:56.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:08:56 smithi047 bash[22744]: cluster 2024-09-16T06:08:54.923813+0000 mgr.a (mgr.14373) 1382 : cluster [DBG] pgmap v957: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:08:58.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:08:58 smithi157 bash[24585]: cluster 2024-09-16T06:08:56.925978+0000 mgr.a (mgr.14373) 1383 : cluster [DBG] pgmap v958: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:08:58.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:08:58 smithi086 bash[24289]: cluster 2024-09-16T06:08:56.925978+0000 mgr.a (mgr.14373) 1383 : cluster [DBG] pgmap v958: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:08:58.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:08:58 smithi047 bash[22744]: cluster 2024-09-16T06:08:56.925978+0000 mgr.a (mgr.14373) 1383 : cluster [DBG] pgmap v958: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:08:59.195 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:08:59.196 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:08:59.196 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:08:59.968 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:08:59.968 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:08:59.969 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:08:59.969 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:08:59.969 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:09:00.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:09:00 smithi157 bash[24585]: cluster 2024-09-16T06:08:58.926755+0000 mgr.a (mgr.14373) 1384 : cluster [DBG] pgmap v959: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:09:00.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:09:00 smithi157 bash[24585]: audit 2024-09-16T06:08:59.533398+0000 mgr.a (mgr.14373) 1385 : audit [DBG] from='client.42774 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:09:00.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:09:00 smithi086 bash[24289]: cluster 2024-09-16T06:08:58.926755+0000 mgr.a (mgr.14373) 1384 : cluster [DBG] pgmap v959: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:09:00.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:09:00 smithi086 bash[24289]: audit 2024-09-16T06:08:59.533398+0000 mgr.a (mgr.14373) 1385 : audit [DBG] from='client.42774 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:09:00.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:09:00 smithi047 bash[22744]: cluster 2024-09-16T06:08:58.926755+0000 mgr.a (mgr.14373) 1384 : cluster [DBG] pgmap v959: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:09:00.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:09:00 smithi047 bash[22744]: audit 2024-09-16T06:08:59.533398+0000 mgr.a (mgr.14373) 1385 : audit [DBG] from='client.42774 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:09:02.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:09:02 smithi157 bash[24585]: cluster 2024-09-16T06:09:00.927700+0000 mgr.a (mgr.14373) 1386 : cluster [DBG] pgmap v960: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:09:02.861 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:09:02 smithi047 bash[22744]: cluster 2024-09-16T06:09:00.927700+0000 mgr.a (mgr.14373) 1386 : cluster [DBG] pgmap v960: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:09:02.862 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:09:02 smithi086 bash[24289]: cluster 2024-09-16T06:09:00.927700+0000 mgr.a (mgr.14373) 1386 : cluster [DBG] pgmap v960: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:09:04.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:09:04 smithi157 bash[24585]: cluster 2024-09-16T06:09:02.930010+0000 mgr.a (mgr.14373) 1387 : cluster [DBG] pgmap v961: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:09:04.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:09:04 smithi086 bash[24289]: cluster 2024-09-16T06:09:02.930010+0000 mgr.a (mgr.14373) 1387 : cluster [DBG] pgmap v961: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:09:04.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:09:04 smithi047 bash[22744]: cluster 2024-09-16T06:09:02.930010+0000 mgr.a (mgr.14373) 1387 : cluster [DBG] pgmap v961: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:09:04.969 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:09:04.970 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:09:04.970 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:09:05.740 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:09:05.740 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:09:05.740 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:09:05.740 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:09:05.740 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:09:06.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:09:06 smithi157 bash[24585]: cluster 2024-09-16T06:09:04.930800+0000 mgr.a (mgr.14373) 1388 : cluster [DBG] pgmap v962: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:09:06.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:09:06 smithi157 bash[24585]: audit 2024-09-16T06:09:05.309263+0000 mgr.a (mgr.14373) 1389 : audit [DBG] from='client.42846 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:09:06.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:09:06 smithi086 bash[24289]: cluster 2024-09-16T06:09:04.930800+0000 mgr.a (mgr.14373) 1388 : cluster [DBG] pgmap v962: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:09:06.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:09:06 smithi086 bash[24289]: audit 2024-09-16T06:09:05.309263+0000 mgr.a (mgr.14373) 1389 : audit [DBG] from='client.42846 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:09:06.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:09:06 smithi047 bash[22744]: cluster 2024-09-16T06:09:04.930800+0000 mgr.a (mgr.14373) 1388 : cluster [DBG] pgmap v962: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:09:06.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:09:06 smithi047 bash[22744]: audit 2024-09-16T06:09:05.309263+0000 mgr.a (mgr.14373) 1389 : audit [DBG] from='client.42846 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:09:08.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:09:08 smithi157 bash[24585]: cluster 2024-09-16T06:09:06.933163+0000 mgr.a (mgr.14373) 1390 : cluster [DBG] pgmap v963: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:09:08.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:09:08 smithi086 bash[24289]: cluster 2024-09-16T06:09:06.933163+0000 mgr.a (mgr.14373) 1390 : cluster [DBG] pgmap v963: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:09:08.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:09:08 smithi047 bash[22744]: cluster 2024-09-16T06:09:06.933163+0000 mgr.a (mgr.14373) 1390 : cluster [DBG] pgmap v963: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:09:10.741 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:09:10.742 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:09:10.742 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:09:10.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:09:10 smithi157 bash[24585]: cluster 2024-09-16T06:09:08.933933+0000 mgr.a (mgr.14373) 1391 : cluster [DBG] pgmap v964: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:09:10.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:09:10 smithi086 bash[24289]: cluster 2024-09-16T06:09:08.933933+0000 mgr.a (mgr.14373) 1391 : cluster [DBG] pgmap v964: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:09:10.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:09:10 smithi047 bash[22744]: cluster 2024-09-16T06:09:08.933933+0000 mgr.a (mgr.14373) 1391 : cluster [DBG] pgmap v964: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:09:11.495 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:09:11.495 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:09:11.495 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:09:11.495 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:09:11.495 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:09:12.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:09:12 smithi157 bash[24585]: cluster 2024-09-16T06:09:10.934687+0000 mgr.a (mgr.14373) 1392 : cluster [DBG] pgmap v965: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:09:12.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:09:12 smithi157 bash[24585]: audit 2024-09-16T06:09:11.083313+0000 mgr.a (mgr.14373) 1393 : audit [DBG] from='client.42921 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:09:12.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:09:12 smithi086 bash[24289]: cluster 2024-09-16T06:09:10.934687+0000 mgr.a (mgr.14373) 1392 : cluster [DBG] pgmap v965: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:09:12.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:09:12 smithi086 bash[24289]: audit 2024-09-16T06:09:11.083313+0000 mgr.a (mgr.14373) 1393 : audit [DBG] from='client.42921 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:09:12.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:09:12 smithi047 bash[22744]: cluster 2024-09-16T06:09:10.934687+0000 mgr.a (mgr.14373) 1392 : cluster [DBG] pgmap v965: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:09:12.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:09:12 smithi047 bash[22744]: audit 2024-09-16T06:09:11.083313+0000 mgr.a (mgr.14373) 1393 : audit [DBG] from='client.42921 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:09:14.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:09:14 smithi157 bash[24585]: cluster 2024-09-16T06:09:12.937001+0000 mgr.a (mgr.14373) 1394 : cluster [DBG] pgmap v966: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-16T06:09:14.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:09:14 smithi086 bash[24289]: cluster 2024-09-16T06:09:12.937001+0000 mgr.a (mgr.14373) 1394 : cluster [DBG] pgmap v966: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-16T06:09:14.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:09:14 smithi047 bash[22744]: cluster 2024-09-16T06:09:12.937001+0000 mgr.a (mgr.14373) 1394 : cluster [DBG] pgmap v966: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-16T06:09:16.496 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:09:16.497 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:09:16.497 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:09:16.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:09:16 smithi157 bash[24585]: cluster 2024-09-16T06:09:14.937753+0000 mgr.a (mgr.14373) 1395 : cluster [DBG] pgmap v967: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-16T06:09:16.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:09:16 smithi086 bash[24289]: cluster 2024-09-16T06:09:14.937753+0000 mgr.a (mgr.14373) 1395 : cluster [DBG] pgmap v967: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-16T06:09:16.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:09:16 smithi047 bash[22744]: cluster 2024-09-16T06:09:14.937753+0000 mgr.a (mgr.14373) 1395 : cluster [DBG] pgmap v967: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-16T06:09:17.272 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:09:17.273 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:09:17.273 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:09:17.273 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:09:17.273 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:09:18.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:09:18 smithi157 bash[24585]: audit 2024-09-16T06:09:16.834830+0000 mgr.a (mgr.14373) 1396 : audit [DBG] from='client.42999 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:09:18.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:09:18 smithi157 bash[24585]: cluster 2024-09-16T06:09:16.939041+0000 mgr.a (mgr.14373) 1397 : cluster [DBG] pgmap v968: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:09:18.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:09:18 smithi086 bash[24289]: audit 2024-09-16T06:09:16.834830+0000 mgr.a (mgr.14373) 1396 : audit [DBG] from='client.42999 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:09:18.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:09:18 smithi086 bash[24289]: cluster 2024-09-16T06:09:16.939041+0000 mgr.a (mgr.14373) 1397 : cluster [DBG] pgmap v968: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:09:18.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:09:18 smithi047 bash[22744]: audit 2024-09-16T06:09:16.834830+0000 mgr.a (mgr.14373) 1396 : audit [DBG] from='client.42999 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:09:18.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:09:18 smithi047 bash[22744]: cluster 2024-09-16T06:09:16.939041+0000 mgr.a (mgr.14373) 1397 : cluster [DBG] pgmap v968: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:09:20.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:09:20 smithi157 bash[24585]: cluster 2024-09-16T06:09:18.939962+0000 mgr.a (mgr.14373) 1398 : cluster [DBG] pgmap v969: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T06:09:20.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:09:20 smithi086 bash[24289]: cluster 2024-09-16T06:09:18.939962+0000 mgr.a (mgr.14373) 1398 : cluster [DBG] pgmap v969: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T06:09:20.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:09:20 smithi047 bash[22744]: cluster 2024-09-16T06:09:18.939962+0000 mgr.a (mgr.14373) 1398 : cluster [DBG] pgmap v969: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T06:09:22.274 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:09:22.275 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:09:22.275 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:09:22.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:09:22 smithi157 bash[24585]: cluster 2024-09-16T06:09:20.940736+0000 mgr.a (mgr.14373) 1399 : cluster [DBG] pgmap v970: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T06:09:22.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:09:22 smithi086 bash[24289]: cluster 2024-09-16T06:09:20.940736+0000 mgr.a (mgr.14373) 1399 : cluster [DBG] pgmap v970: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T06:09:22.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:09:22 smithi047 bash[22744]: cluster 2024-09-16T06:09:20.940736+0000 mgr.a (mgr.14373) 1399 : cluster [DBG] pgmap v970: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T06:09:23.025 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:09:23.025 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:09:23.025 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:09:23.025 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:09:23.025 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:09:23.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:09:23 smithi157 bash[24585]: audit 2024-09-16T06:09:22.610158+0000 mgr.a (mgr.14373) 1400 : audit [DBG] from='client.43077 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:09:23.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:09:23 smithi086 bash[24289]: audit 2024-09-16T06:09:22.610158+0000 mgr.a (mgr.14373) 1400 : audit [DBG] from='client.43077 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:09:23.840 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:09:23 smithi047 bash[22744]: audit 2024-09-16T06:09:22.610158+0000 mgr.a (mgr.14373) 1400 : audit [DBG] from='client.43077 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:09:24.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:09:24 smithi157 bash[24585]: cluster 2024-09-16T06:09:22.942097+0000 mgr.a (mgr.14373) 1401 : cluster [DBG] pgmap v971: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:09:24.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:09:24 smithi086 bash[24289]: cluster 2024-09-16T06:09:22.942097+0000 mgr.a (mgr.14373) 1401 : cluster [DBG] pgmap v971: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:09:24.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:09:24 smithi047 bash[22744]: cluster 2024-09-16T06:09:22.942097+0000 mgr.a (mgr.14373) 1401 : cluster [DBG] pgmap v971: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:09:26.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:09:26 smithi157 bash[24585]: cluster 2024-09-16T06:09:24.942862+0000 mgr.a (mgr.14373) 1402 : cluster [DBG] pgmap v972: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T06:09:26.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:09:26 smithi086 bash[24289]: cluster 2024-09-16T06:09:24.942862+0000 mgr.a (mgr.14373) 1402 : cluster [DBG] pgmap v972: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T06:09:26.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:09:26 smithi047 bash[22744]: cluster 2024-09-16T06:09:24.942862+0000 mgr.a (mgr.14373) 1402 : cluster [DBG] pgmap v972: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T06:09:28.026 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:09:28.027 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:09:28.027 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:09:28.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:09:28 smithi157 bash[24585]: cluster 2024-09-16T06:09:26.944821+0000 mgr.a (mgr.14373) 1403 : cluster [DBG] pgmap v973: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-16T06:09:28.813 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:09:28.814 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:09:28.814 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:09:28.814 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:09:28.814 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:09:28.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:09:28 smithi086 bash[24289]: cluster 2024-09-16T06:09:26.944821+0000 mgr.a (mgr.14373) 1403 : cluster [DBG] pgmap v973: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-16T06:09:28.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:09:28 smithi047 bash[22744]: cluster 2024-09-16T06:09:26.944821+0000 mgr.a (mgr.14373) 1403 : cluster [DBG] pgmap v973: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-16T06:09:29.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:09:29 smithi157 bash[24585]: audit 2024-09-16T06:09:28.368898+0000 mgr.a (mgr.14373) 1404 : audit [DBG] from='client.43155 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:09:29.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:09:29 smithi086 bash[24289]: audit 2024-09-16T06:09:28.368898+0000 mgr.a (mgr.14373) 1404 : audit [DBG] from='client.43155 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:09:29.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:09:29 smithi047 bash[22744]: audit 2024-09-16T06:09:28.368898+0000 mgr.a (mgr.14373) 1404 : audit [DBG] from='client.43155 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:09:30.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:09:30 smithi157 bash[24585]: cluster 2024-09-16T06:09:28.945840+0000 mgr.a (mgr.14373) 1405 : cluster [DBG] pgmap v974: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:09:30.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:09:30 smithi086 bash[24289]: cluster 2024-09-16T06:09:28.945840+0000 mgr.a (mgr.14373) 1405 : cluster [DBG] pgmap v974: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:09:30.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:09:30 smithi047 bash[22744]: cluster 2024-09-16T06:09:28.945840+0000 mgr.a (mgr.14373) 1405 : cluster [DBG] pgmap v974: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:09:32.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:09:32 smithi157 bash[24585]: cluster 2024-09-16T06:09:30.946654+0000 mgr.a (mgr.14373) 1406 : cluster [DBG] pgmap v975: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:09:32.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:09:32 smithi086 bash[24289]: cluster 2024-09-16T06:09:30.946654+0000 mgr.a (mgr.14373) 1406 : cluster [DBG] pgmap v975: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:09:32.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:09:32 smithi047 bash[22744]: cluster 2024-09-16T06:09:30.946654+0000 mgr.a (mgr.14373) 1406 : cluster [DBG] pgmap v975: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:09:33.815 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:09:33.816 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:09:33.816 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:09:34.555 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:09:34.556 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:09:34.556 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:09:34.556 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:09:34.556 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:09:34.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:09:34 smithi157 bash[24585]: cluster 2024-09-16T06:09:32.948833+0000 mgr.a (mgr.14373) 1407 : cluster [DBG] pgmap v976: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:09:34.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:09:34 smithi086 bash[24289]: cluster 2024-09-16T06:09:32.948833+0000 mgr.a (mgr.14373) 1407 : cluster [DBG] pgmap v976: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:09:34.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:09:34 smithi047 bash[22744]: cluster 2024-09-16T06:09:32.948833+0000 mgr.a (mgr.14373) 1407 : cluster [DBG] pgmap v976: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:09:35.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:09:35 smithi157 bash[24585]: audit 2024-09-16T06:09:34.152985+0000 mgr.a (mgr.14373) 1408 : audit [DBG] from='client.43233 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:09:35.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:09:35 smithi086 bash[24289]: audit 2024-09-16T06:09:34.152985+0000 mgr.a (mgr.14373) 1408 : audit [DBG] from='client.43233 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:09:35.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:09:35 smithi047 bash[22744]: audit 2024-09-16T06:09:34.152985+0000 mgr.a (mgr.14373) 1408 : audit [DBG] from='client.43233 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:09:36.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:09:36 smithi157 bash[24585]: cluster 2024-09-16T06:09:34.949716+0000 mgr.a (mgr.14373) 1409 : cluster [DBG] pgmap v977: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:09:36.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:09:36 smithi086 bash[24289]: cluster 2024-09-16T06:09:34.949716+0000 mgr.a (mgr.14373) 1409 : cluster [DBG] pgmap v977: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:09:36.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:09:36 smithi047 bash[22744]: cluster 2024-09-16T06:09:34.949716+0000 mgr.a (mgr.14373) 1409 : cluster [DBG] pgmap v977: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:09:38.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:09:38 smithi157 bash[24585]: cluster 2024-09-16T06:09:36.951911+0000 mgr.a (mgr.14373) 1410 : cluster [DBG] pgmap v978: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:09:38.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:09:38 smithi086 bash[24289]: cluster 2024-09-16T06:09:36.951911+0000 mgr.a (mgr.14373) 1410 : cluster [DBG] pgmap v978: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:09:38.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:09:38 smithi047 bash[22744]: cluster 2024-09-16T06:09:36.951911+0000 mgr.a (mgr.14373) 1410 : cluster [DBG] pgmap v978: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:09:39.557 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:09:39.558 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:09:39.558 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:09:40.334 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:09:40.335 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:09:40.335 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:09:40.335 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:09:40.336 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:09:40.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:09:40 smithi157 bash[24585]: cluster 2024-09-16T06:09:38.952695+0000 mgr.a (mgr.14373) 1411 : cluster [DBG] pgmap v979: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:09:40.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:09:40 smithi086 bash[24289]: cluster 2024-09-16T06:09:38.952695+0000 mgr.a (mgr.14373) 1411 : cluster [DBG] pgmap v979: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:09:40.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:09:40 smithi047 bash[22744]: cluster 2024-09-16T06:09:38.952695+0000 mgr.a (mgr.14373) 1411 : cluster [DBG] pgmap v979: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:09:41.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:09:41 smithi157 bash[24585]: audit 2024-09-16T06:09:39.898864+0000 mgr.a (mgr.14373) 1412 : audit [DBG] from='client.43311 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:09:41.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:09:41 smithi157 bash[24585]: audit 2024-09-16T06:09:41.187617+0000 mon.b (mon.2) 174 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T06:09:41.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:09:41 smithi086 bash[24289]: audit 2024-09-16T06:09:39.898864+0000 mgr.a (mgr.14373) 1412 : audit [DBG] from='client.43311 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:09:41.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:09:41 smithi086 bash[24289]: audit 2024-09-16T06:09:41.187617+0000 mon.b (mon.2) 174 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T06:09:41.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:09:41 smithi047 bash[22744]: audit 2024-09-16T06:09:39.898864+0000 mgr.a (mgr.14373) 1412 : audit [DBG] from='client.43311 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:09:41.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:09:41 smithi047 bash[22744]: audit 2024-09-16T06:09:41.187617+0000 mon.b (mon.2) 174 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T06:09:42.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:09:42 smithi157 bash[24585]: cluster 2024-09-16T06:09:40.953576+0000 mgr.a (mgr.14373) 1413 : cluster [DBG] pgmap v980: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:09:42.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:09:42 smithi086 bash[24289]: cluster 2024-09-16T06:09:40.953576+0000 mgr.a (mgr.14373) 1413 : cluster [DBG] pgmap v980: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:09:42.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:09:42 smithi047 bash[22744]: cluster 2024-09-16T06:09:40.953576+0000 mgr.a (mgr.14373) 1413 : cluster [DBG] pgmap v980: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:09:44.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:09:44 smithi157 bash[24585]: cluster 2024-09-16T06:09:42.955835+0000 mgr.a (mgr.14373) 1414 : cluster [DBG] pgmap v981: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:09:44.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:09:44 smithi086 bash[24289]: cluster 2024-09-16T06:09:42.955835+0000 mgr.a (mgr.14373) 1414 : cluster [DBG] pgmap v981: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:09:44.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:09:44 smithi047 bash[22744]: cluster 2024-09-16T06:09:42.955835+0000 mgr.a (mgr.14373) 1414 : cluster [DBG] pgmap v981: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:09:45.336 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:09:45.337 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:09:45.337 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:09:46.113 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:09:46.113 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:09:46.114 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:09:46.114 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:09:46.114 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:09:46.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:09:46 smithi086 bash[24289]: cluster 2024-09-16T06:09:44.956571+0000 mgr.a (mgr.14373) 1415 : cluster [DBG] pgmap v982: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:09:46.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:09:46 smithi086 bash[24289]: audit 2024-09-16T06:09:45.676351+0000 mgr.a (mgr.14373) 1416 : audit [DBG] from='client.43386 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:09:46.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:09:46 smithi086 bash[24289]: audit 2024-09-16T06:09:46.537289+0000 mon.a (mon.0) 654 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:09:46.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:09:46 smithi086 bash[24289]: audit 2024-09-16T06:09:46.544050+0000 mon.a (mon.0) 655 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:09:46.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:09:46 smithi047 bash[22744]: cluster 2024-09-16T06:09:44.956571+0000 mgr.a (mgr.14373) 1415 : cluster [DBG] pgmap v982: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:09:46.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:09:46 smithi047 bash[22744]: audit 2024-09-16T06:09:45.676351+0000 mgr.a (mgr.14373) 1416 : audit [DBG] from='client.43386 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:09:46.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:09:46 smithi047 bash[22744]: audit 2024-09-16T06:09:46.537289+0000 mon.a (mon.0) 654 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:09:46.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:09:46 smithi047 bash[22744]: audit 2024-09-16T06:09:46.544050+0000 mon.a (mon.0) 655 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:09:47.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:09:46 smithi157 bash[24585]: cluster 2024-09-16T06:09:44.956571+0000 mgr.a (mgr.14373) 1415 : cluster [DBG] pgmap v982: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:09:47.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:09:46 smithi157 bash[24585]: audit 2024-09-16T06:09:45.676351+0000 mgr.a (mgr.14373) 1416 : audit [DBG] from='client.43386 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:09:47.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:09:46 smithi157 bash[24585]: audit 2024-09-16T06:09:46.537289+0000 mon.a (mon.0) 654 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:09:47.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:09:46 smithi157 bash[24585]: audit 2024-09-16T06:09:46.544050+0000 mon.a (mon.0) 655 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:09:47.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:09:47 smithi086 bash[24289]: audit 2024-09-16T06:09:46.568331+0000 mon.a (mon.0) 656 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:09:47.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:09:47 smithi086 bash[24289]: audit 2024-09-16T06:09:46.572101+0000 mon.a (mon.0) 657 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:09:47.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:09:47 smithi086 bash[24289]: audit 2024-09-16T06:09:46.574514+0000 mon.a (mon.0) 658 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:09:47.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:09:47 smithi086 bash[24289]: audit 2024-09-16T06:09:46.578100+0000 mon.a (mon.0) 659 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:09:47.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:09:47 smithi086 bash[24289]: audit 2024-09-16T06:09:47.276298+0000 mon.b (mon.2) 175 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T06:09:47.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:09:47 smithi086 bash[24289]: audit 2024-09-16T06:09:47.278558+0000 mon.b (mon.2) 176 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T06:09:47.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:09:47 smithi086 bash[24289]: audit 2024-09-16T06:09:47.294088+0000 mon.a (mon.0) 660 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:09:47.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:09:47 smithi086 bash[24289]: audit 2024-09-16T06:09:47.295228+0000 mon.b (mon.2) 177 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:09:47.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:09:47 smithi047 bash[22744]: audit 2024-09-16T06:09:46.568331+0000 mon.a (mon.0) 656 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:09:47.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:09:47 smithi047 bash[22744]: audit 2024-09-16T06:09:46.572101+0000 mon.a (mon.0) 657 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:09:47.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:09:47 smithi047 bash[22744]: audit 2024-09-16T06:09:46.574514+0000 mon.a (mon.0) 658 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:09:47.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:09:47 smithi047 bash[22744]: audit 2024-09-16T06:09:46.578100+0000 mon.a (mon.0) 659 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:09:47.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:09:47 smithi047 bash[22744]: audit 2024-09-16T06:09:47.276298+0000 mon.b (mon.2) 175 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T06:09:47.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:09:47 smithi047 bash[22744]: audit 2024-09-16T06:09:47.278558+0000 mon.b (mon.2) 176 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T06:09:47.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:09:47 smithi047 bash[22744]: audit 2024-09-16T06:09:47.294088+0000 mon.a (mon.0) 660 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:09:47.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:09:47 smithi047 bash[22744]: audit 2024-09-16T06:09:47.295228+0000 mon.b (mon.2) 177 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:09:48.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:09:47 smithi157 bash[24585]: audit 2024-09-16T06:09:46.568331+0000 mon.a (mon.0) 656 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:09:48.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:09:47 smithi157 bash[24585]: audit 2024-09-16T06:09:46.572101+0000 mon.a (mon.0) 657 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:09:48.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:09:47 smithi157 bash[24585]: audit 2024-09-16T06:09:46.574514+0000 mon.a (mon.0) 658 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:09:48.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:09:47 smithi157 bash[24585]: audit 2024-09-16T06:09:46.578100+0000 mon.a (mon.0) 659 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:09:48.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:09:47 smithi157 bash[24585]: audit 2024-09-16T06:09:47.276298+0000 mon.b (mon.2) 175 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T06:09:48.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:09:47 smithi157 bash[24585]: audit 2024-09-16T06:09:47.278558+0000 mon.b (mon.2) 176 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T06:09:48.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:09:47 smithi157 bash[24585]: audit 2024-09-16T06:09:47.294088+0000 mon.a (mon.0) 660 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:09:48.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:09:47 smithi157 bash[24585]: audit 2024-09-16T06:09:47.295228+0000 mon.b (mon.2) 177 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:09:48.337 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 06:09:48 smithi047 bash[22994]: debug 2024-09-16T06:09:48.015+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T06:09:48.337 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 06:09:48 smithi047 bash[22994]: debug 2024-09-16T06:09:48.019+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T06:09:48.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:09:48 smithi047 bash[22744]: cluster 2024-09-16T06:09:46.958934+0000 mgr.a (mgr.14373) 1417 : cluster [DBG] pgmap v983: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:09:48.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:09:48 smithi047 bash[22744]: audit 2024-09-16T06:09:47.301491+0000 mgr.a (mgr.14373) 1418 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:09:49.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:09:48 smithi157 bash[24585]: cluster 2024-09-16T06:09:46.958934+0000 mgr.a (mgr.14373) 1417 : cluster [DBG] pgmap v983: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:09:49.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:09:48 smithi157 bash[24585]: audit 2024-09-16T06:09:47.301491+0000 mgr.a (mgr.14373) 1418 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:09:49.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:09:48 smithi086 bash[24289]: cluster 2024-09-16T06:09:46.958934+0000 mgr.a (mgr.14373) 1417 : cluster [DBG] pgmap v983: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:09:49.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:09:48 smithi086 bash[24289]: audit 2024-09-16T06:09:47.301491+0000 mgr.a (mgr.14373) 1418 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:09:49.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:09:49 smithi047 bash[22744]: audit 2024-09-16T06:09:48.021861+0000 mgr.a (mgr.14373) 1419 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T06:09:49.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:09:49 smithi047 bash[22744]: cephadm 2024-09-16T06:09:48.023849+0000 mgr.a (mgr.14373) 1420 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T06:09:50.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:09:49 smithi157 bash[24585]: audit 2024-09-16T06:09:48.021861+0000 mgr.a (mgr.14373) 1419 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T06:09:50.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:09:49 smithi157 bash[24585]: cephadm 2024-09-16T06:09:48.023849+0000 mgr.a (mgr.14373) 1420 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T06:09:50.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:09:49 smithi086 bash[24289]: audit 2024-09-16T06:09:48.021861+0000 mgr.a (mgr.14373) 1419 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T06:09:50.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:09:49 smithi086 bash[24289]: cephadm 2024-09-16T06:09:48.023849+0000 mgr.a (mgr.14373) 1420 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T06:09:51.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:09:50 smithi157 bash[24585]: cluster 2024-09-16T06:09:48.960028+0000 mgr.a (mgr.14373) 1421 : cluster [DBG] pgmap v984: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:09:51.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:09:50 smithi086 bash[24289]: cluster 2024-09-16T06:09:48.960028+0000 mgr.a (mgr.14373) 1421 : cluster [DBG] pgmap v984: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:09:51.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:09:50 smithi047 bash[22744]: cluster 2024-09-16T06:09:48.960028+0000 mgr.a (mgr.14373) 1421 : cluster [DBG] pgmap v984: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:09:51.115 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:09:51.116 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:09:51.116 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:09:51.888 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:09:51.888 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:09:51.889 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:09:51.889 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:09:51.889 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:09:53.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:09:52 smithi157 bash[24585]: cluster 2024-09-16T06:09:50.960945+0000 mgr.a (mgr.14373) 1422 : cluster [DBG] pgmap v985: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:09:53.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:09:52 smithi157 bash[24585]: audit 2024-09-16T06:09:51.454954+0000 mgr.a (mgr.14373) 1423 : audit [DBG] from='client.43569 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:09:53.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:09:52 smithi086 bash[24289]: cluster 2024-09-16T06:09:50.960945+0000 mgr.a (mgr.14373) 1422 : cluster [DBG] pgmap v985: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:09:53.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:09:52 smithi086 bash[24289]: audit 2024-09-16T06:09:51.454954+0000 mgr.a (mgr.14373) 1423 : audit [DBG] from='client.43569 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:09:53.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:09:52 smithi047 bash[22744]: cluster 2024-09-16T06:09:50.960945+0000 mgr.a (mgr.14373) 1422 : cluster [DBG] pgmap v985: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:09:53.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:09:52 smithi047 bash[22744]: audit 2024-09-16T06:09:51.454954+0000 mgr.a (mgr.14373) 1423 : audit [DBG] from='client.43569 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:09:55.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:09:54 smithi157 bash[24585]: cluster 2024-09-16T06:09:52.963774+0000 mgr.a (mgr.14373) 1424 : cluster [DBG] pgmap v986: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:09:55.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:09:54 smithi086 bash[24289]: cluster 2024-09-16T06:09:52.963774+0000 mgr.a (mgr.14373) 1424 : cluster [DBG] pgmap v986: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:09:55.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:09:54 smithi047 bash[22744]: cluster 2024-09-16T06:09:52.963774+0000 mgr.a (mgr.14373) 1424 : cluster [DBG] pgmap v986: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:09:56.890 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:09:56.891 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:09:56.891 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:09:57.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:09:56 smithi157 bash[24585]: cluster 2024-09-16T06:09:54.964538+0000 mgr.a (mgr.14373) 1425 : cluster [DBG] pgmap v987: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T06:09:57.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:09:56 smithi086 bash[24289]: cluster 2024-09-16T06:09:54.964538+0000 mgr.a (mgr.14373) 1425 : cluster [DBG] pgmap v987: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T06:09:57.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:09:56 smithi047 bash[22744]: cluster 2024-09-16T06:09:54.964538+0000 mgr.a (mgr.14373) 1425 : cluster [DBG] pgmap v987: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T06:09:57.644 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:09:57.645 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:09:57.645 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:09:57.645 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:09:57.645 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:09:59.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:09:58 smithi157 bash[24585]: cluster 2024-09-16T06:09:56.966561+0000 mgr.a (mgr.14373) 1426 : cluster [DBG] pgmap v988: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:09:59.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:09:58 smithi157 bash[24585]: audit 2024-09-16T06:09:57.226077+0000 mgr.a (mgr.14373) 1427 : audit [DBG] from='client.43647 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:09:59.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:09:58 smithi086 bash[24289]: cluster 2024-09-16T06:09:56.966561+0000 mgr.a (mgr.14373) 1426 : cluster [DBG] pgmap v988: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:09:59.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:09:58 smithi086 bash[24289]: audit 2024-09-16T06:09:57.226077+0000 mgr.a (mgr.14373) 1427 : audit [DBG] from='client.43647 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:09:59.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:09:58 smithi047 bash[22744]: cluster 2024-09-16T06:09:56.966561+0000 mgr.a (mgr.14373) 1426 : cluster [DBG] pgmap v988: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:09:59.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:09:58 smithi047 bash[22744]: audit 2024-09-16T06:09:57.226077+0000 mgr.a (mgr.14373) 1427 : audit [DBG] from='client.43647 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:10:01.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:10:00 smithi157 bash[24585]: cluster 2024-09-16T06:09:58.967433+0000 mgr.a (mgr.14373) 1428 : cluster [DBG] pgmap v989: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T06:10:01.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:10:00 smithi157 bash[24585]: cluster 2024-09-16T06:10:00.000110+0000 mon.a (mon.0) 661 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-16T06:10:01.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:10:00 smithi086 bash[24289]: cluster 2024-09-16T06:09:58.967433+0000 mgr.a (mgr.14373) 1428 : cluster [DBG] pgmap v989: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T06:10:01.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:10:00 smithi086 bash[24289]: cluster 2024-09-16T06:10:00.000110+0000 mon.a (mon.0) 661 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-16T06:10:01.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:10:00 smithi047 bash[22744]: cluster 2024-09-16T06:09:58.967433+0000 mgr.a (mgr.14373) 1428 : cluster [DBG] pgmap v989: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T06:10:01.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:10:00 smithi047 bash[22744]: cluster 2024-09-16T06:10:00.000110+0000 mon.a (mon.0) 661 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-16T06:10:02.646 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:10:02.647 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:10:02.647 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:10:03.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:10:02 smithi157 bash[24585]: cluster 2024-09-16T06:10:00.968323+0000 mgr.a (mgr.14373) 1429 : cluster [DBG] pgmap v990: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T06:10:03.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:10:02 smithi086 bash[24289]: cluster 2024-09-16T06:10:00.968323+0000 mgr.a (mgr.14373) 1429 : cluster [DBG] pgmap v990: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T06:10:03.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:10:02 smithi047 bash[22744]: cluster 2024-09-16T06:10:00.968323+0000 mgr.a (mgr.14373) 1429 : cluster [DBG] pgmap v990: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T06:10:03.395 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:10:03.395 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:10:03.396 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:10:03.396 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:10:03.396 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:10:05.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:10:04 smithi157 bash[24585]: cluster 2024-09-16T06:10:02.970496+0000 mgr.a (mgr.14373) 1430 : cluster [DBG] pgmap v991: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:10:05.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:10:04 smithi157 bash[24585]: audit 2024-09-16T06:10:02.984831+0000 mgr.a (mgr.14373) 1431 : audit [DBG] from='client.43722 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:10:05.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:10:04 smithi086 bash[24289]: cluster 2024-09-16T06:10:02.970496+0000 mgr.a (mgr.14373) 1430 : cluster [DBG] pgmap v991: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:10:05.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:10:04 smithi086 bash[24289]: audit 2024-09-16T06:10:02.984831+0000 mgr.a (mgr.14373) 1431 : audit [DBG] from='client.43722 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:10:05.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:10:04 smithi047 bash[22744]: cluster 2024-09-16T06:10:02.970496+0000 mgr.a (mgr.14373) 1430 : cluster [DBG] pgmap v991: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:10:05.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:10:04 smithi047 bash[22744]: audit 2024-09-16T06:10:02.984831+0000 mgr.a (mgr.14373) 1431 : audit [DBG] from='client.43722 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:10:07.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:10:06 smithi157 bash[24585]: cluster 2024-09-16T06:10:04.971356+0000 mgr.a (mgr.14373) 1432 : cluster [DBG] pgmap v992: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:10:07.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:10:06 smithi086 bash[24289]: cluster 2024-09-16T06:10:04.971356+0000 mgr.a (mgr.14373) 1432 : cluster [DBG] pgmap v992: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:10:07.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:10:06 smithi047 bash[22744]: cluster 2024-09-16T06:10:04.971356+0000 mgr.a (mgr.14373) 1432 : cluster [DBG] pgmap v992: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:10:08.397 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:10:08.398 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:10:08.398 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:10:09.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:10:08 smithi157 bash[24585]: cluster 2024-09-16T06:10:06.973553+0000 mgr.a (mgr.14373) 1433 : cluster [DBG] pgmap v993: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:10:09.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:10:08 smithi086 bash[24289]: cluster 2024-09-16T06:10:06.973553+0000 mgr.a (mgr.14373) 1433 : cluster [DBG] pgmap v993: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:10:09.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:10:08 smithi047 bash[22744]: cluster 2024-09-16T06:10:06.973553+0000 mgr.a (mgr.14373) 1433 : cluster [DBG] pgmap v993: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:10:09.173 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:10:09.173 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:10:09.174 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:10:09.174 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:10:09.174 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:10:11.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:10:10 smithi157 bash[24585]: audit 2024-09-16T06:10:08.741167+0000 mgr.a (mgr.14373) 1434 : audit [DBG] from='client.43800 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:10:11.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:10:10 smithi157 bash[24585]: cluster 2024-09-16T06:10:08.980643+0000 mgr.a (mgr.14373) 1435 : cluster [DBG] pgmap v994: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:10:11.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:10:10 smithi086 bash[24289]: audit 2024-09-16T06:10:08.741167+0000 mgr.a (mgr.14373) 1434 : audit [DBG] from='client.43800 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:10:11.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:10:10 smithi086 bash[24289]: cluster 2024-09-16T06:10:08.980643+0000 mgr.a (mgr.14373) 1435 : cluster [DBG] pgmap v994: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:10:11.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:10:10 smithi047 bash[22744]: audit 2024-09-16T06:10:08.741167+0000 mgr.a (mgr.14373) 1434 : audit [DBG] from='client.43800 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:10:11.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:10:10 smithi047 bash[22744]: cluster 2024-09-16T06:10:08.980643+0000 mgr.a (mgr.14373) 1435 : cluster [DBG] pgmap v994: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:10:13.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:10:12 smithi157 bash[24585]: cluster 2024-09-16T06:10:10.981538+0000 mgr.a (mgr.14373) 1436 : cluster [DBG] pgmap v995: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:10:13.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:10:12 smithi086 bash[24289]: cluster 2024-09-16T06:10:10.981538+0000 mgr.a (mgr.14373) 1436 : cluster [DBG] pgmap v995: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:10:13.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:10:12 smithi047 bash[22744]: cluster 2024-09-16T06:10:10.981538+0000 mgr.a (mgr.14373) 1436 : cluster [DBG] pgmap v995: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:10:14.175 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:10:14.176 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:10:14.176 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:10:14.924 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:10:14.924 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:10:14.924 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:10:14.924 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:10:14.924 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:10:15.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:10:14 smithi157 bash[24585]: cluster 2024-09-16T06:10:12.983744+0000 mgr.a (mgr.14373) 1437 : cluster [DBG] pgmap v996: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:10:15.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:10:14 smithi086 bash[24289]: cluster 2024-09-16T06:10:12.983744+0000 mgr.a (mgr.14373) 1437 : cluster [DBG] pgmap v996: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:10:15.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:10:14 smithi047 bash[22744]: cluster 2024-09-16T06:10:12.983744+0000 mgr.a (mgr.14373) 1437 : cluster [DBG] pgmap v996: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:10:16.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:10:15 smithi157 bash[24585]: audit 2024-09-16T06:10:14.510946+0000 mgr.a (mgr.14373) 1438 : audit [DBG] from='client.43875 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:10:16.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:10:15 smithi086 bash[24289]: audit 2024-09-16T06:10:14.510946+0000 mgr.a (mgr.14373) 1438 : audit [DBG] from='client.43875 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:10:16.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:10:15 smithi047 bash[22744]: audit 2024-09-16T06:10:14.510946+0000 mgr.a (mgr.14373) 1438 : audit [DBG] from='client.43875 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:10:17.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:10:16 smithi157 bash[24585]: cluster 2024-09-16T06:10:14.984301+0000 mgr.a (mgr.14373) 1439 : cluster [DBG] pgmap v997: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:10:17.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:10:16 smithi086 bash[24289]: cluster 2024-09-16T06:10:14.984301+0000 mgr.a (mgr.14373) 1439 : cluster [DBG] pgmap v997: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:10:17.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:10:16 smithi047 bash[22744]: cluster 2024-09-16T06:10:14.984301+0000 mgr.a (mgr.14373) 1439 : cluster [DBG] pgmap v997: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:10:19.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:10:18 smithi157 bash[24585]: cluster 2024-09-16T06:10:16.985966+0000 mgr.a (mgr.14373) 1440 : cluster [DBG] pgmap v998: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:10:19.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:10:18 smithi086 bash[24289]: cluster 2024-09-16T06:10:16.985966+0000 mgr.a (mgr.14373) 1440 : cluster [DBG] pgmap v998: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:10:19.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:10:18 smithi047 bash[22744]: cluster 2024-09-16T06:10:16.985966+0000 mgr.a (mgr.14373) 1440 : cluster [DBG] pgmap v998: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:10:19.925 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:10:19.926 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:10:19.926 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:10:20.676 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:10:20.676 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:10:20.676 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:10:20.677 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:10:20.677 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:10:21.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:10:20 smithi157 bash[24585]: cluster 2024-09-16T06:10:18.986906+0000 mgr.a (mgr.14373) 1441 : cluster [DBG] pgmap v999: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:10:21.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:10:20 smithi086 bash[24289]: cluster 2024-09-16T06:10:18.986906+0000 mgr.a (mgr.14373) 1441 : cluster [DBG] pgmap v999: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:10:21.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:10:20 smithi047 bash[22744]: cluster 2024-09-16T06:10:18.986906+0000 mgr.a (mgr.14373) 1441 : cluster [DBG] pgmap v999: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:10:22.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:10:21 smithi157 bash[24585]: audit 2024-09-16T06:10:20.259044+0000 mgr.a (mgr.14373) 1442 : audit [DBG] from='client.43953 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:10:22.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:10:21 smithi086 bash[24289]: audit 2024-09-16T06:10:20.259044+0000 mgr.a (mgr.14373) 1442 : audit [DBG] from='client.43953 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:10:22.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:10:21 smithi047 bash[22744]: audit 2024-09-16T06:10:20.259044+0000 mgr.a (mgr.14373) 1442 : audit [DBG] from='client.43953 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:10:23.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:10:22 smithi157 bash[24585]: cluster 2024-09-16T06:10:20.987879+0000 mgr.a (mgr.14373) 1443 : cluster [DBG] pgmap v1000: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:10:23.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:10:22 smithi086 bash[24289]: cluster 2024-09-16T06:10:20.987879+0000 mgr.a (mgr.14373) 1443 : cluster [DBG] pgmap v1000: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:10:23.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:10:22 smithi047 bash[22744]: cluster 2024-09-16T06:10:20.987879+0000 mgr.a (mgr.14373) 1443 : cluster [DBG] pgmap v1000: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:10:25.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:10:24 smithi157 bash[24585]: cluster 2024-09-16T06:10:22.990112+0000 mgr.a (mgr.14373) 1444 : cluster [DBG] pgmap v1001: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:10:25.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:10:24 smithi086 bash[24289]: cluster 2024-09-16T06:10:22.990112+0000 mgr.a (mgr.14373) 1444 : cluster [DBG] pgmap v1001: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:10:25.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:10:24 smithi047 bash[22744]: cluster 2024-09-16T06:10:22.990112+0000 mgr.a (mgr.14373) 1444 : cluster [DBG] pgmap v1001: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:10:25.678 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:10:25.678 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:10:25.679 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:10:26.453 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:10:26.453 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:10:26.453 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:10:26.454 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:10:26.454 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:10:27.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:10:26 smithi157 bash[24585]: cluster 2024-09-16T06:10:24.990919+0000 mgr.a (mgr.14373) 1445 : cluster [DBG] pgmap v1002: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:10:27.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:10:26 smithi086 bash[24289]: cluster 2024-09-16T06:10:24.990919+0000 mgr.a (mgr.14373) 1445 : cluster [DBG] pgmap v1002: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:10:27.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:10:26 smithi047 bash[22744]: cluster 2024-09-16T06:10:24.990919+0000 mgr.a (mgr.14373) 1445 : cluster [DBG] pgmap v1002: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:10:28.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:10:27 smithi157 bash[24585]: audit 2024-09-16T06:10:26.017062+0000 mgr.a (mgr.14373) 1446 : audit [DBG] from='client.44028 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:10:28.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:10:27 smithi086 bash[24289]: audit 2024-09-16T06:10:26.017062+0000 mgr.a (mgr.14373) 1446 : audit [DBG] from='client.44028 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:10:28.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:10:27 smithi047 bash[22744]: audit 2024-09-16T06:10:26.017062+0000 mgr.a (mgr.14373) 1446 : audit [DBG] from='client.44028 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:10:29.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:10:28 smithi157 bash[24585]: cluster 2024-09-16T06:10:26.993272+0000 mgr.a (mgr.14373) 1447 : cluster [DBG] pgmap v1003: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:10:29.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:10:28 smithi086 bash[24289]: cluster 2024-09-16T06:10:26.993272+0000 mgr.a (mgr.14373) 1447 : cluster [DBG] pgmap v1003: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:10:29.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:10:28 smithi047 bash[22744]: cluster 2024-09-16T06:10:26.993272+0000 mgr.a (mgr.14373) 1447 : cluster [DBG] pgmap v1003: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:10:31.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:10:30 smithi157 bash[24585]: cluster 2024-09-16T06:10:28.994037+0000 mgr.a (mgr.14373) 1448 : cluster [DBG] pgmap v1004: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-16T06:10:31.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:10:30 smithi086 bash[24289]: cluster 2024-09-16T06:10:28.994037+0000 mgr.a (mgr.14373) 1448 : cluster [DBG] pgmap v1004: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-16T06:10:31.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:10:30 smithi047 bash[22744]: cluster 2024-09-16T06:10:28.994037+0000 mgr.a (mgr.14373) 1448 : cluster [DBG] pgmap v1004: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-16T06:10:31.455 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:10:31.455 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:10:31.455 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:10:32.221 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:10:32.222 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:10:32.222 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:10:32.222 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:10:32.222 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:10:33.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:10:32 smithi157 bash[24585]: cluster 2024-09-16T06:10:30.994814+0000 mgr.a (mgr.14373) 1449 : cluster [DBG] pgmap v1005: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-16T06:10:33.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:10:32 smithi086 bash[24289]: cluster 2024-09-16T06:10:30.994814+0000 mgr.a (mgr.14373) 1449 : cluster [DBG] pgmap v1005: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-16T06:10:33.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:10:32 smithi047 bash[22744]: cluster 2024-09-16T06:10:30.994814+0000 mgr.a (mgr.14373) 1449 : cluster [DBG] pgmap v1005: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-16T06:10:34.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:10:33 smithi157 bash[24585]: audit 2024-09-16T06:10:31.797035+0000 mgr.a (mgr.14373) 1450 : audit [DBG] from='client.44103 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:10:34.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:10:33 smithi086 bash[24289]: audit 2024-09-16T06:10:31.797035+0000 mgr.a (mgr.14373) 1450 : audit [DBG] from='client.44103 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:10:34.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:10:33 smithi047 bash[22744]: audit 2024-09-16T06:10:31.797035+0000 mgr.a (mgr.14373) 1450 : audit [DBG] from='client.44103 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:10:35.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:10:34 smithi157 bash[24585]: cluster 2024-09-16T06:10:32.997599+0000 mgr.a (mgr.14373) 1451 : cluster [DBG] pgmap v1006: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:10:35.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:10:34 smithi086 bash[24289]: cluster 2024-09-16T06:10:32.997599+0000 mgr.a (mgr.14373) 1451 : cluster [DBG] pgmap v1006: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:10:35.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:10:34 smithi047 bash[22744]: cluster 2024-09-16T06:10:32.997599+0000 mgr.a (mgr.14373) 1451 : cluster [DBG] pgmap v1006: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:10:37.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:10:36 smithi157 bash[24585]: cluster 2024-09-16T06:10:34.998417+0000 mgr.a (mgr.14373) 1452 : cluster [DBG] pgmap v1007: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:10:37.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:10:36 smithi086 bash[24289]: cluster 2024-09-16T06:10:34.998417+0000 mgr.a (mgr.14373) 1452 : cluster [DBG] pgmap v1007: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:10:37.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:10:36 smithi047 bash[22744]: cluster 2024-09-16T06:10:34.998417+0000 mgr.a (mgr.14373) 1452 : cluster [DBG] pgmap v1007: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:10:37.223 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:10:37.224 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:10:37.224 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:10:37.989 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:10:37.989 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:10:37.989 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:10:37.989 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:10:37.989 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:10:39.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:10:38 smithi157 bash[24585]: cluster 2024-09-16T06:10:37.000391+0000 mgr.a (mgr.14373) 1453 : cluster [DBG] pgmap v1008: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:10:39.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:10:38 smithi157 bash[24585]: audit 2024-09-16T06:10:37.561033+0000 mgr.a (mgr.14373) 1454 : audit [DBG] from='client.44181 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:10:39.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:10:38 smithi086 bash[24289]: cluster 2024-09-16T06:10:37.000391+0000 mgr.a (mgr.14373) 1453 : cluster [DBG] pgmap v1008: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:10:39.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:10:38 smithi086 bash[24289]: audit 2024-09-16T06:10:37.561033+0000 mgr.a (mgr.14373) 1454 : audit [DBG] from='client.44181 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:10:39.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:10:38 smithi047 bash[22744]: cluster 2024-09-16T06:10:37.000391+0000 mgr.a (mgr.14373) 1453 : cluster [DBG] pgmap v1008: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:10:39.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:10:38 smithi047 bash[22744]: audit 2024-09-16T06:10:37.561033+0000 mgr.a (mgr.14373) 1454 : audit [DBG] from='client.44181 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:10:41.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:10:40 smithi157 bash[24585]: cluster 2024-09-16T06:10:39.001275+0000 mgr.a (mgr.14373) 1455 : cluster [DBG] pgmap v1009: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-16T06:10:41.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:10:40 smithi086 bash[24289]: cluster 2024-09-16T06:10:39.001275+0000 mgr.a (mgr.14373) 1455 : cluster [DBG] pgmap v1009: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-16T06:10:41.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:10:40 smithi047 bash[22744]: cluster 2024-09-16T06:10:39.001275+0000 mgr.a (mgr.14373) 1455 : cluster [DBG] pgmap v1009: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-16T06:10:42.990 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:10:42.991 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:10:42.991 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:10:43.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:10:42 smithi157 bash[24585]: cluster 2024-09-16T06:10:41.002176+0000 mgr.a (mgr.14373) 1456 : cluster [DBG] pgmap v1010: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-16T06:10:43.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:10:42 smithi086 bash[24289]: cluster 2024-09-16T06:10:41.002176+0000 mgr.a (mgr.14373) 1456 : cluster [DBG] pgmap v1010: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-16T06:10:43.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:10:42 smithi047 bash[22744]: cluster 2024-09-16T06:10:41.002176+0000 mgr.a (mgr.14373) 1456 : cluster [DBG] pgmap v1010: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-16T06:10:43.761 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:10:43.761 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:10:43.761 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:10:43.761 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:10:43.761 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:10:45.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:10:44 smithi157 bash[24585]: cluster 2024-09-16T06:10:43.003558+0000 mgr.a (mgr.14373) 1457 : cluster [DBG] pgmap v1011: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-16T06:10:45.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:10:44 smithi157 bash[24585]: audit 2024-09-16T06:10:43.335437+0000 mgr.a (mgr.14373) 1458 : audit [DBG] from='client.44256 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:10:45.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:10:44 smithi086 bash[24289]: cluster 2024-09-16T06:10:43.003558+0000 mgr.a (mgr.14373) 1457 : cluster [DBG] pgmap v1011: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-16T06:10:45.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:10:44 smithi086 bash[24289]: audit 2024-09-16T06:10:43.335437+0000 mgr.a (mgr.14373) 1458 : audit [DBG] from='client.44256 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:10:45.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:10:44 smithi047 bash[22744]: cluster 2024-09-16T06:10:43.003558+0000 mgr.a (mgr.14373) 1457 : cluster [DBG] pgmap v1011: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-16T06:10:45.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:10:44 smithi047 bash[22744]: audit 2024-09-16T06:10:43.335437+0000 mgr.a (mgr.14373) 1458 : audit [DBG] from='client.44256 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:10:47.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:10:46 smithi157 bash[24585]: cluster 2024-09-16T06:10:45.004573+0000 mgr.a (mgr.14373) 1459 : cluster [DBG] pgmap v1012: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:10:47.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:10:46 smithi086 bash[24289]: cluster 2024-09-16T06:10:45.004573+0000 mgr.a (mgr.14373) 1459 : cluster [DBG] pgmap v1012: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:10:47.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:10:46 smithi047 bash[22744]: cluster 2024-09-16T06:10:45.004573+0000 mgr.a (mgr.14373) 1459 : cluster [DBG] pgmap v1012: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:10:48.762 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:10:48.762 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:10:48.763 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:10:49.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:10:48 smithi157 bash[24585]: cluster 2024-09-16T06:10:47.006943+0000 mgr.a (mgr.14373) 1460 : cluster [DBG] pgmap v1013: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:10:49.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:10:48 smithi157 bash[24585]: audit 2024-09-16T06:10:48.071903+0000 mon.b (mon.2) 178 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T06:10:49.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:10:48 smithi086 bash[24289]: cluster 2024-09-16T06:10:47.006943+0000 mgr.a (mgr.14373) 1460 : cluster [DBG] pgmap v1013: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:10:49.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:10:48 smithi086 bash[24289]: audit 2024-09-16T06:10:48.071903+0000 mon.b (mon.2) 178 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T06:10:49.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:10:48 smithi047 bash[22744]: cluster 2024-09-16T06:10:47.006943+0000 mgr.a (mgr.14373) 1460 : cluster [DBG] pgmap v1013: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:10:49.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:10:48 smithi047 bash[22744]: audit 2024-09-16T06:10:48.071903+0000 mon.b (mon.2) 178 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T06:10:50.039 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:10:50.040 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:10:50.040 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:10:50.040 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:10:50.040 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:10:50.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:10:49 smithi157 bash[24585]: audit 2024-09-16T06:10:48.914358+0000 mon.b (mon.2) 179 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T06:10:50.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:10:49 smithi157 bash[24585]: audit 2024-09-16T06:10:48.916228+0000 mon.b (mon.2) 180 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T06:10:50.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:10:49 smithi157 bash[24585]: audit 2024-09-16T06:10:48.928427+0000 mon.a (mon.0) 662 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:10:50.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:10:49 smithi157 bash[24585]: audit 2024-09-16T06:10:48.933698+0000 mon.b (mon.2) 181 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:10:50.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:10:49 smithi086 bash[24289]: audit 2024-09-16T06:10:48.914358+0000 mon.b (mon.2) 179 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T06:10:50.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:10:49 smithi086 bash[24289]: audit 2024-09-16T06:10:48.916228+0000 mon.b (mon.2) 180 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T06:10:50.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:10:49 smithi086 bash[24289]: audit 2024-09-16T06:10:48.928427+0000 mon.a (mon.0) 662 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:10:50.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:10:49 smithi086 bash[24289]: audit 2024-09-16T06:10:48.933698+0000 mon.b (mon.2) 181 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:10:50.088 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 06:10:49 smithi047 bash[22994]: debug 2024-09-16T06:10:49.633+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T06:10:50.088 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 06:10:49 smithi047 bash[22994]: debug 2024-09-16T06:10:49.649+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T06:10:50.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:10:49 smithi047 bash[22744]: audit 2024-09-16T06:10:48.914358+0000 mon.b (mon.2) 179 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T06:10:50.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:10:49 smithi047 bash[22744]: audit 2024-09-16T06:10:48.916228+0000 mon.b (mon.2) 180 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T06:10:50.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:10:49 smithi047 bash[22744]: audit 2024-09-16T06:10:48.928427+0000 mon.a (mon.0) 662 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:10:50.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:10:49 smithi047 bash[22744]: audit 2024-09-16T06:10:48.933698+0000 mon.b (mon.2) 181 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:10:51.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:10:50 smithi157 bash[24585]: audit 2024-09-16T06:10:48.938516+0000 mgr.a (mgr.14373) 1461 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:10:51.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:10:50 smithi157 bash[24585]: cluster 2024-09-16T06:10:49.007524+0000 mgr.a (mgr.14373) 1462 : cluster [DBG] pgmap v1014: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:10:51.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:10:50 smithi157 bash[24585]: audit 2024-09-16T06:10:49.098780+0000 mgr.a (mgr.14373) 1463 : audit [DBG] from='client.44334 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:10:51.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:10:50 smithi157 bash[24585]: audit 2024-09-16T06:10:49.637770+0000 mgr.a (mgr.14373) 1464 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T06:10:51.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:10:50 smithi157 bash[24585]: cephadm 2024-09-16T06:10:49.650853+0000 mgr.a (mgr.14373) 1465 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T06:10:51.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:10:50 smithi086 bash[24289]: audit 2024-09-16T06:10:48.938516+0000 mgr.a (mgr.14373) 1461 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:10:51.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:10:50 smithi086 bash[24289]: cluster 2024-09-16T06:10:49.007524+0000 mgr.a (mgr.14373) 1462 : cluster [DBG] pgmap v1014: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:10:51.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:10:50 smithi086 bash[24289]: audit 2024-09-16T06:10:49.098780+0000 mgr.a (mgr.14373) 1463 : audit [DBG] from='client.44334 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:10:51.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:10:50 smithi086 bash[24289]: audit 2024-09-16T06:10:49.637770+0000 mgr.a (mgr.14373) 1464 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T06:10:51.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:10:50 smithi086 bash[24289]: cephadm 2024-09-16T06:10:49.650853+0000 mgr.a (mgr.14373) 1465 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T06:10:51.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:10:50 smithi047 bash[22744]: audit 2024-09-16T06:10:48.938516+0000 mgr.a (mgr.14373) 1461 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:10:51.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:10:50 smithi047 bash[22744]: cluster 2024-09-16T06:10:49.007524+0000 mgr.a (mgr.14373) 1462 : cluster [DBG] pgmap v1014: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:10:51.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:10:50 smithi047 bash[22744]: audit 2024-09-16T06:10:49.098780+0000 mgr.a (mgr.14373) 1463 : audit [DBG] from='client.44334 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:10:51.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:10:50 smithi047 bash[22744]: audit 2024-09-16T06:10:49.637770+0000 mgr.a (mgr.14373) 1464 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T06:10:51.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:10:50 smithi047 bash[22744]: cephadm 2024-09-16T06:10:49.650853+0000 mgr.a (mgr.14373) 1465 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T06:10:53.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:10:52 smithi157 bash[24585]: cluster 2024-09-16T06:10:51.008359+0000 mgr.a (mgr.14373) 1466 : cluster [DBG] pgmap v1015: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:10:53.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:10:52 smithi086 bash[24289]: cluster 2024-09-16T06:10:51.008359+0000 mgr.a (mgr.14373) 1466 : cluster [DBG] pgmap v1015: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:10:53.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:10:52 smithi047 bash[22744]: cluster 2024-09-16T06:10:51.008359+0000 mgr.a (mgr.14373) 1466 : cluster [DBG] pgmap v1015: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:10:55.041 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:10:55.042 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:10:55.042 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:10:55.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:10:54 smithi157 bash[24585]: cluster 2024-09-16T06:10:53.010615+0000 mgr.a (mgr.14373) 1467 : cluster [DBG] pgmap v1016: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:10:55.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:10:54 smithi086 bash[24289]: cluster 2024-09-16T06:10:53.010615+0000 mgr.a (mgr.14373) 1467 : cluster [DBG] pgmap v1016: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:10:55.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:10:54 smithi047 bash[22744]: cluster 2024-09-16T06:10:53.010615+0000 mgr.a (mgr.14373) 1467 : cluster [DBG] pgmap v1016: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:10:55.795 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:10:55.795 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:10:55.795 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:10:55.795 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:10:55.795 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:10:56.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:10:55 smithi157 bash[24585]: cluster 2024-09-16T06:10:55.011367+0000 mgr.a (mgr.14373) 1468 : cluster [DBG] pgmap v1017: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:10:56.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:10:55 smithi157 bash[24585]: audit 2024-09-16T06:10:55.374554+0000 mgr.a (mgr.14373) 1469 : audit [DBG] from='client.44520 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:10:56.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:10:55 smithi086 bash[24289]: cluster 2024-09-16T06:10:55.011367+0000 mgr.a (mgr.14373) 1468 : cluster [DBG] pgmap v1017: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:10:56.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:10:55 smithi086 bash[24289]: audit 2024-09-16T06:10:55.374554+0000 mgr.a (mgr.14373) 1469 : audit [DBG] from='client.44520 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:10:56.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:10:55 smithi047 bash[22744]: cluster 2024-09-16T06:10:55.011367+0000 mgr.a (mgr.14373) 1468 : cluster [DBG] pgmap v1017: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:10:56.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:10:55 smithi047 bash[22744]: audit 2024-09-16T06:10:55.374554+0000 mgr.a (mgr.14373) 1469 : audit [DBG] from='client.44520 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:10:58.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:10:58 smithi086 bash[24289]: cluster 2024-09-16T06:10:57.013594+0000 mgr.a (mgr.14373) 1470 : cluster [DBG] pgmap v1018: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:10:58.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:10:58 smithi047 bash[22744]: cluster 2024-09-16T06:10:57.013594+0000 mgr.a (mgr.14373) 1470 : cluster [DBG] pgmap v1018: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:10:58.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:10:58 smithi157 bash[24585]: cluster 2024-09-16T06:10:57.013594+0000 mgr.a (mgr.14373) 1470 : cluster [DBG] pgmap v1018: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:11:00.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:11:00 smithi047 bash[22744]: cluster 2024-09-16T06:10:59.014428+0000 mgr.a (mgr.14373) 1471 : cluster [DBG] pgmap v1019: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:11:00.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:11:00 smithi157 bash[24585]: cluster 2024-09-16T06:10:59.014428+0000 mgr.a (mgr.14373) 1471 : cluster [DBG] pgmap v1019: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:11:00.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:11:00 smithi086 bash[24289]: cluster 2024-09-16T06:10:59.014428+0000 mgr.a (mgr.14373) 1471 : cluster [DBG] pgmap v1019: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:11:00.796 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:11:00.797 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:11:00.798 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:11:01.544 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:11:01.544 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:11:01.545 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:11:01.545 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:11:01.545 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:11:02.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:11:02 smithi047 bash[22744]: cluster 2024-09-16T06:11:01.015180+0000 mgr.a (mgr.14373) 1472 : cluster [DBG] pgmap v1020: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:11:02.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:11:02 smithi047 bash[22744]: audit 2024-09-16T06:11:01.130754+0000 mgr.a (mgr.14373) 1473 : audit [DBG] from='client.44598 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:11:02.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:11:02 smithi157 bash[24585]: cluster 2024-09-16T06:11:01.015180+0000 mgr.a (mgr.14373) 1472 : cluster [DBG] pgmap v1020: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:11:02.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:11:02 smithi157 bash[24585]: audit 2024-09-16T06:11:01.130754+0000 mgr.a (mgr.14373) 1473 : audit [DBG] from='client.44598 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:11:02.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:11:02 smithi086 bash[24289]: cluster 2024-09-16T06:11:01.015180+0000 mgr.a (mgr.14373) 1472 : cluster [DBG] pgmap v1020: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:11:02.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:11:02 smithi086 bash[24289]: audit 2024-09-16T06:11:01.130754+0000 mgr.a (mgr.14373) 1473 : audit [DBG] from='client.44598 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:11:04.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:11:04 smithi047 bash[22744]: cluster 2024-09-16T06:11:03.017544+0000 mgr.a (mgr.14373) 1474 : cluster [DBG] pgmap v1021: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:11:04.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:11:04 smithi157 bash[24585]: cluster 2024-09-16T06:11:03.017544+0000 mgr.a (mgr.14373) 1474 : cluster [DBG] pgmap v1021: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:11:04.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:11:04 smithi086 bash[24289]: cluster 2024-09-16T06:11:03.017544+0000 mgr.a (mgr.14373) 1474 : cluster [DBG] pgmap v1021: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:11:06.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:11:06 smithi047 bash[22744]: cluster 2024-09-16T06:11:05.018234+0000 mgr.a (mgr.14373) 1475 : cluster [DBG] pgmap v1022: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-16T06:11:06.546 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:11:06.546 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:11:06.547 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:11:06.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:11:06 smithi157 bash[24585]: cluster 2024-09-16T06:11:05.018234+0000 mgr.a (mgr.14373) 1475 : cluster [DBG] pgmap v1022: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-16T06:11:06.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:11:06 smithi086 bash[24289]: cluster 2024-09-16T06:11:05.018234+0000 mgr.a (mgr.14373) 1475 : cluster [DBG] pgmap v1022: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-16T06:11:07.313 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:11:07.313 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:11:07.313 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:11:07.313 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:11:07.313 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:11:08.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:11:08 smithi047 bash[22744]: audit 2024-09-16T06:11:06.882121+0000 mgr.a (mgr.14373) 1476 : audit [DBG] from='client.44676 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:11:08.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:11:08 smithi047 bash[22744]: cluster 2024-09-16T06:11:07.028753+0000 mgr.a (mgr.14373) 1477 : cluster [DBG] pgmap v1023: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:11:08.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:11:08 smithi157 bash[24585]: audit 2024-09-16T06:11:06.882121+0000 mgr.a (mgr.14373) 1476 : audit [DBG] from='client.44676 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:11:08.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:11:08 smithi157 bash[24585]: cluster 2024-09-16T06:11:07.028753+0000 mgr.a (mgr.14373) 1477 : cluster [DBG] pgmap v1023: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:11:08.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:11:08 smithi086 bash[24289]: audit 2024-09-16T06:11:06.882121+0000 mgr.a (mgr.14373) 1476 : audit [DBG] from='client.44676 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:11:08.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:11:08 smithi086 bash[24289]: cluster 2024-09-16T06:11:07.028753+0000 mgr.a (mgr.14373) 1477 : cluster [DBG] pgmap v1023: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:11:10.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:11:10 smithi157 bash[24585]: cluster 2024-09-16T06:11:09.029786+0000 mgr.a (mgr.14373) 1478 : cluster [DBG] pgmap v1024: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:11:10.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:11:10 smithi086 bash[24289]: cluster 2024-09-16T06:11:09.029786+0000 mgr.a (mgr.14373) 1478 : cluster [DBG] pgmap v1024: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:11:10.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:11:10 smithi047 bash[22744]: cluster 2024-09-16T06:11:09.029786+0000 mgr.a (mgr.14373) 1478 : cluster [DBG] pgmap v1024: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:11:12.314 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:11:12.315 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:11:12.315 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:11:12.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:11:12 smithi157 bash[24585]: cluster 2024-09-16T06:11:11.030748+0000 mgr.a (mgr.14373) 1479 : cluster [DBG] pgmap v1025: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:11:12.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:11:12 smithi086 bash[24289]: cluster 2024-09-16T06:11:11.030748+0000 mgr.a (mgr.14373) 1479 : cluster [DBG] pgmap v1025: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:11:12.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:11:12 smithi047 bash[22744]: cluster 2024-09-16T06:11:11.030748+0000 mgr.a (mgr.14373) 1479 : cluster [DBG] pgmap v1025: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:11:13.077 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:11:13.077 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:11:13.078 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:11:13.078 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:11:13.078 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:11:13.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:11:13 smithi157 bash[24585]: audit 2024-09-16T06:11:12.648946+0000 mgr.a (mgr.14373) 1480 : audit [DBG] from='client.44754 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:11:13.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:11:13 smithi086 bash[24289]: audit 2024-09-16T06:11:12.648946+0000 mgr.a (mgr.14373) 1480 : audit [DBG] from='client.44754 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:11:13.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:11:13 smithi047 bash[22744]: audit 2024-09-16T06:11:12.648946+0000 mgr.a (mgr.14373) 1480 : audit [DBG] from='client.44754 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:11:14.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:11:14 smithi157 bash[24585]: cluster 2024-09-16T06:11:13.032058+0000 mgr.a (mgr.14373) 1481 : cluster [DBG] pgmap v1026: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:11:14.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:11:14 smithi086 bash[24289]: cluster 2024-09-16T06:11:13.032058+0000 mgr.a (mgr.14373) 1481 : cluster [DBG] pgmap v1026: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:11:14.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:11:14 smithi047 bash[22744]: cluster 2024-09-16T06:11:13.032058+0000 mgr.a (mgr.14373) 1481 : cluster [DBG] pgmap v1026: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:11:16.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:11:16 smithi157 bash[24585]: cluster 2024-09-16T06:11:15.032779+0000 mgr.a (mgr.14373) 1482 : cluster [DBG] pgmap v1027: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T06:11:16.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:11:16 smithi086 bash[24289]: cluster 2024-09-16T06:11:15.032779+0000 mgr.a (mgr.14373) 1482 : cluster [DBG] pgmap v1027: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T06:11:16.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:11:16 smithi047 bash[22744]: cluster 2024-09-16T06:11:15.032779+0000 mgr.a (mgr.14373) 1482 : cluster [DBG] pgmap v1027: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T06:11:18.079 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:11:18.080 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:11:18.080 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:11:18.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:11:18 smithi157 bash[24585]: cluster 2024-09-16T06:11:17.034763+0000 mgr.a (mgr.14373) 1483 : cluster [DBG] pgmap v1028: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-16T06:11:18.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:11:18 smithi086 bash[24289]: cluster 2024-09-16T06:11:17.034763+0000 mgr.a (mgr.14373) 1483 : cluster [DBG] pgmap v1028: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-16T06:11:18.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:11:18 smithi047 bash[22744]: cluster 2024-09-16T06:11:17.034763+0000 mgr.a (mgr.14373) 1483 : cluster [DBG] pgmap v1028: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-16T06:11:18.829 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:11:18.830 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:11:18.830 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:11:18.830 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:11:18.830 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:11:19.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:11:19 smithi157 bash[24585]: audit 2024-09-16T06:11:18.417696+0000 mgr.a (mgr.14373) 1484 : audit [DBG] from='client.44832 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:11:19.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:11:19 smithi086 bash[24289]: audit 2024-09-16T06:11:18.417696+0000 mgr.a (mgr.14373) 1484 : audit [DBG] from='client.44832 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:11:19.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:11:19 smithi047 bash[22744]: audit 2024-09-16T06:11:18.417696+0000 mgr.a (mgr.14373) 1484 : audit [DBG] from='client.44832 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:11:20.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:11:20 smithi157 bash[24585]: cluster 2024-09-16T06:11:19.035827+0000 mgr.a (mgr.14373) 1485 : cluster [DBG] pgmap v1029: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:11:20.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:11:20 smithi086 bash[24289]: cluster 2024-09-16T06:11:19.035827+0000 mgr.a (mgr.14373) 1485 : cluster [DBG] pgmap v1029: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:11:20.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:11:20 smithi047 bash[22744]: cluster 2024-09-16T06:11:19.035827+0000 mgr.a (mgr.14373) 1485 : cluster [DBG] pgmap v1029: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:11:22.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:11:22 smithi157 bash[24585]: cluster 2024-09-16T06:11:21.036654+0000 mgr.a (mgr.14373) 1486 : cluster [DBG] pgmap v1030: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:11:22.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:11:22 smithi086 bash[24289]: cluster 2024-09-16T06:11:21.036654+0000 mgr.a (mgr.14373) 1486 : cluster [DBG] pgmap v1030: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:11:22.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:11:22 smithi047 bash[22744]: cluster 2024-09-16T06:11:21.036654+0000 mgr.a (mgr.14373) 1486 : cluster [DBG] pgmap v1030: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:11:23.831 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:11:23.832 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:11:23.832 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:11:24.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:11:24 smithi157 bash[24585]: cluster 2024-09-16T06:11:23.038889+0000 mgr.a (mgr.14373) 1487 : cluster [DBG] pgmap v1031: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:11:24.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:11:24 smithi086 bash[24289]: cluster 2024-09-16T06:11:23.038889+0000 mgr.a (mgr.14373) 1487 : cluster [DBG] pgmap v1031: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:11:24.578 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:11:24.578 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:11:24.578 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:11:24.578 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:11:24.578 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:11:24.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:11:24 smithi047 bash[22744]: cluster 2024-09-16T06:11:23.038889+0000 mgr.a (mgr.14373) 1487 : cluster [DBG] pgmap v1031: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:11:25.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:11:25 smithi157 bash[24585]: audit 2024-09-16T06:11:24.168057+0000 mgr.a (mgr.14373) 1488 : audit [DBG] from='client.44910 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:11:25.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:11:25 smithi086 bash[24289]: audit 2024-09-16T06:11:24.168057+0000 mgr.a (mgr.14373) 1488 : audit [DBG] from='client.44910 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:11:25.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:11:25 smithi047 bash[22744]: audit 2024-09-16T06:11:24.168057+0000 mgr.a (mgr.14373) 1488 : audit [DBG] from='client.44910 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:11:26.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:11:26 smithi157 bash[24585]: cluster 2024-09-16T06:11:25.039768+0000 mgr.a (mgr.14373) 1489 : cluster [DBG] pgmap v1032: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:11:26.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:11:26 smithi086 bash[24289]: cluster 2024-09-16T06:11:25.039768+0000 mgr.a (mgr.14373) 1489 : cluster [DBG] pgmap v1032: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:11:26.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:11:26 smithi047 bash[22744]: cluster 2024-09-16T06:11:25.039768+0000 mgr.a (mgr.14373) 1489 : cluster [DBG] pgmap v1032: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:11:28.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:11:28 smithi157 bash[24585]: cluster 2024-09-16T06:11:27.041876+0000 mgr.a (mgr.14373) 1490 : cluster [DBG] pgmap v1033: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:11:28.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:11:28 smithi086 bash[24289]: cluster 2024-09-16T06:11:27.041876+0000 mgr.a (mgr.14373) 1490 : cluster [DBG] pgmap v1033: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:11:28.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:11:28 smithi047 bash[22744]: cluster 2024-09-16T06:11:27.041876+0000 mgr.a (mgr.14373) 1490 : cluster [DBG] pgmap v1033: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:11:29.579 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:11:29.580 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:11:29.580 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:11:30.356 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:11:30.356 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:11:30.356 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:11:30.356 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:11:30.357 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:11:30.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:11:30 smithi157 bash[24585]: cluster 2024-09-16T06:11:29.042645+0000 mgr.a (mgr.14373) 1491 : cluster [DBG] pgmap v1034: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:11:30.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:11:30 smithi086 bash[24289]: cluster 2024-09-16T06:11:29.042645+0000 mgr.a (mgr.14373) 1491 : cluster [DBG] pgmap v1034: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:11:30.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:11:30 smithi047 bash[22744]: cluster 2024-09-16T06:11:29.042645+0000 mgr.a (mgr.14373) 1491 : cluster [DBG] pgmap v1034: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:11:31.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:11:31 smithi157 bash[24585]: audit 2024-09-16T06:11:29.920800+0000 mgr.a (mgr.14373) 1492 : audit [DBG] from='client.44985 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:11:31.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:11:31 smithi086 bash[24289]: audit 2024-09-16T06:11:29.920800+0000 mgr.a (mgr.14373) 1492 : audit [DBG] from='client.44985 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:11:31.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:11:31 smithi047 bash[22744]: audit 2024-09-16T06:11:29.920800+0000 mgr.a (mgr.14373) 1492 : audit [DBG] from='client.44985 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:11:32.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:11:32 smithi157 bash[24585]: cluster 2024-09-16T06:11:31.043539+0000 mgr.a (mgr.14373) 1493 : cluster [DBG] pgmap v1035: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:11:32.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:11:32 smithi086 bash[24289]: cluster 2024-09-16T06:11:31.043539+0000 mgr.a (mgr.14373) 1493 : cluster [DBG] pgmap v1035: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:11:32.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:11:32 smithi047 bash[22744]: cluster 2024-09-16T06:11:31.043539+0000 mgr.a (mgr.14373) 1493 : cluster [DBG] pgmap v1035: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:11:34.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:11:34 smithi157 bash[24585]: cluster 2024-09-16T06:11:33.045776+0000 mgr.a (mgr.14373) 1494 : cluster [DBG] pgmap v1036: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:11:34.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:11:34 smithi086 bash[24289]: cluster 2024-09-16T06:11:33.045776+0000 mgr.a (mgr.14373) 1494 : cluster [DBG] pgmap v1036: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:11:34.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:11:34 smithi047 bash[22744]: cluster 2024-09-16T06:11:33.045776+0000 mgr.a (mgr.14373) 1494 : cluster [DBG] pgmap v1036: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:11:35.357 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:11:35.358 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:11:35.358 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:11:36.110 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:11:36.110 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:11:36.110 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:11:36.110 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:11:36.110 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:11:36.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:11:36 smithi157 bash[24585]: cluster 2024-09-16T06:11:35.046581+0000 mgr.a (mgr.14373) 1495 : cluster [DBG] pgmap v1037: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:11:36.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:11:36 smithi157 bash[24585]: audit 2024-09-16T06:11:35.696885+0000 mgr.a (mgr.14373) 1496 : audit [DBG] from='client.45060 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:11:36.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:11:36 smithi086 bash[24289]: cluster 2024-09-16T06:11:35.046581+0000 mgr.a (mgr.14373) 1495 : cluster [DBG] pgmap v1037: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:11:36.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:11:36 smithi086 bash[24289]: audit 2024-09-16T06:11:35.696885+0000 mgr.a (mgr.14373) 1496 : audit [DBG] from='client.45060 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:11:36.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:11:36 smithi047 bash[22744]: cluster 2024-09-16T06:11:35.046581+0000 mgr.a (mgr.14373) 1495 : cluster [DBG] pgmap v1037: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:11:36.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:11:36 smithi047 bash[22744]: audit 2024-09-16T06:11:35.696885+0000 mgr.a (mgr.14373) 1496 : audit [DBG] from='client.45060 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:11:38.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:11:38 smithi157 bash[24585]: cluster 2024-09-16T06:11:37.048892+0000 mgr.a (mgr.14373) 1497 : cluster [DBG] pgmap v1038: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:11:38.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:11:38 smithi086 bash[24289]: cluster 2024-09-16T06:11:37.048892+0000 mgr.a (mgr.14373) 1497 : cluster [DBG] pgmap v1038: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:11:38.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:11:38 smithi047 bash[22744]: cluster 2024-09-16T06:11:37.048892+0000 mgr.a (mgr.14373) 1497 : cluster [DBG] pgmap v1038: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:11:40.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:11:40 smithi157 bash[24585]: cluster 2024-09-16T06:11:39.049690+0000 mgr.a (mgr.14373) 1498 : cluster [DBG] pgmap v1039: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:11:40.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:11:40 smithi086 bash[24289]: cluster 2024-09-16T06:11:39.049690+0000 mgr.a (mgr.14373) 1498 : cluster [DBG] pgmap v1039: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:11:40.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:11:40 smithi047 bash[22744]: cluster 2024-09-16T06:11:39.049690+0000 mgr.a (mgr.14373) 1498 : cluster [DBG] pgmap v1039: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:11:41.112 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:11:41.112 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:11:41.112 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:11:41.857 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:11:41.857 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:11:41.857 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:11:41.858 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:11:41.858 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:11:42.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:11:42 smithi157 bash[24585]: cluster 2024-09-16T06:11:41.050673+0000 mgr.a (mgr.14373) 1499 : cluster [DBG] pgmap v1040: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:11:42.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:11:42 smithi157 bash[24585]: audit 2024-09-16T06:11:41.443013+0000 mgr.a (mgr.14373) 1500 : audit [DBG] from='client.45135 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:11:42.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:11:42 smithi086 bash[24289]: cluster 2024-09-16T06:11:41.050673+0000 mgr.a (mgr.14373) 1499 : cluster [DBG] pgmap v1040: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:11:42.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:11:42 smithi086 bash[24289]: audit 2024-09-16T06:11:41.443013+0000 mgr.a (mgr.14373) 1500 : audit [DBG] from='client.45135 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:11:42.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:11:42 smithi047 bash[22744]: cluster 2024-09-16T06:11:41.050673+0000 mgr.a (mgr.14373) 1499 : cluster [DBG] pgmap v1040: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:11:42.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:11:42 smithi047 bash[22744]: audit 2024-09-16T06:11:41.443013+0000 mgr.a (mgr.14373) 1500 : audit [DBG] from='client.45135 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:11:44.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:11:44 smithi157 bash[24585]: cluster 2024-09-16T06:11:43.053374+0000 mgr.a (mgr.14373) 1501 : cluster [DBG] pgmap v1041: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:11:44.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:11:44 smithi086 bash[24289]: cluster 2024-09-16T06:11:43.053374+0000 mgr.a (mgr.14373) 1501 : cluster [DBG] pgmap v1041: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:11:44.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:11:44 smithi047 bash[22744]: cluster 2024-09-16T06:11:43.053374+0000 mgr.a (mgr.14373) 1501 : cluster [DBG] pgmap v1041: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:11:46.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:11:46 smithi157 bash[24585]: cluster 2024-09-16T06:11:45.054146+0000 mgr.a (mgr.14373) 1502 : cluster [DBG] pgmap v1042: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:11:46.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:11:46 smithi086 bash[24289]: cluster 2024-09-16T06:11:45.054146+0000 mgr.a (mgr.14373) 1502 : cluster [DBG] pgmap v1042: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:11:46.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:11:46 smithi047 bash[22744]: cluster 2024-09-16T06:11:45.054146+0000 mgr.a (mgr.14373) 1502 : cluster [DBG] pgmap v1042: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:11:46.859 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:11:46.859 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:11:46.859 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:11:47.609 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:11:47.609 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:11:47.609 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:11:47.609 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:11:47.609 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:11:48.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:11:48 smithi157 bash[24585]: cluster 2024-09-16T06:11:47.055097+0000 mgr.a (mgr.14373) 1503 : cluster [DBG] pgmap v1043: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:11:48.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:11:48 smithi157 bash[24585]: audit 2024-09-16T06:11:47.195640+0000 mgr.a (mgr.14373) 1504 : audit [DBG] from='client.45210 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:11:48.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:11:48 smithi086 bash[24289]: cluster 2024-09-16T06:11:47.055097+0000 mgr.a (mgr.14373) 1503 : cluster [DBG] pgmap v1043: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:11:48.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:11:48 smithi086 bash[24289]: audit 2024-09-16T06:11:47.195640+0000 mgr.a (mgr.14373) 1504 : audit [DBG] from='client.45210 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:11:48.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:11:48 smithi047 bash[22744]: cluster 2024-09-16T06:11:47.055097+0000 mgr.a (mgr.14373) 1503 : cluster [DBG] pgmap v1043: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:11:48.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:11:48 smithi047 bash[22744]: audit 2024-09-16T06:11:47.195640+0000 mgr.a (mgr.14373) 1504 : audit [DBG] from='client.45210 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:11:50.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:11:50 smithi157 bash[24585]: cluster 2024-09-16T06:11:49.056085+0000 mgr.a (mgr.14373) 1505 : cluster [DBG] pgmap v1044: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T06:11:50.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:11:50 smithi157 bash[24585]: audit 2024-09-16T06:11:49.702309+0000 mon.b (mon.2) 182 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T06:11:50.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:11:50 smithi086 bash[24289]: cluster 2024-09-16T06:11:49.056085+0000 mgr.a (mgr.14373) 1505 : cluster [DBG] pgmap v1044: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T06:11:50.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:11:50 smithi086 bash[24289]: audit 2024-09-16T06:11:49.702309+0000 mon.b (mon.2) 182 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T06:11:50.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:11:50 smithi047 bash[22744]: cluster 2024-09-16T06:11:49.056085+0000 mgr.a (mgr.14373) 1505 : cluster [DBG] pgmap v1044: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T06:11:50.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:11:50 smithi047 bash[22744]: audit 2024-09-16T06:11:49.702309+0000 mon.b (mon.2) 182 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T06:11:51.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:11:51 smithi157 bash[24585]: audit 2024-09-16T06:11:50.526643+0000 mon.b (mon.2) 183 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T06:11:51.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:11:51 smithi157 bash[24585]: audit 2024-09-16T06:11:50.528368+0000 mon.b (mon.2) 184 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T06:11:51.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:11:51 smithi157 bash[24585]: audit 2024-09-16T06:11:50.541298+0000 mon.a (mon.0) 663 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:11:51.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:11:51 smithi157 bash[24585]: audit 2024-09-16T06:11:50.544923+0000 mon.b (mon.2) 185 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:11:51.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:11:51 smithi157 bash[24585]: audit 2024-09-16T06:11:50.549433+0000 mgr.a (mgr.14373) 1506 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:11:51.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:11:51 smithi086 bash[24289]: audit 2024-09-16T06:11:50.526643+0000 mon.b (mon.2) 183 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T06:11:51.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:11:51 smithi086 bash[24289]: audit 2024-09-16T06:11:50.528368+0000 mon.b (mon.2) 184 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T06:11:51.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:11:51 smithi086 bash[24289]: audit 2024-09-16T06:11:50.541298+0000 mon.a (mon.0) 663 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:11:51.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:11:51 smithi086 bash[24289]: audit 2024-09-16T06:11:50.544923+0000 mon.b (mon.2) 185 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:11:51.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:11:51 smithi086 bash[24289]: audit 2024-09-16T06:11:50.549433+0000 mgr.a (mgr.14373) 1506 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:11:51.588 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 06:11:51 smithi047 bash[22994]: debug 2024-09-16T06:11:51.267+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T06:11:51.588 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 06:11:51 smithi047 bash[22994]: debug 2024-09-16T06:11:51.267+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T06:11:51.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:11:51 smithi047 bash[22744]: audit 2024-09-16T06:11:50.526643+0000 mon.b (mon.2) 183 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T06:11:51.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:11:51 smithi047 bash[22744]: audit 2024-09-16T06:11:50.528368+0000 mon.b (mon.2) 184 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T06:11:51.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:11:51 smithi047 bash[22744]: audit 2024-09-16T06:11:50.541298+0000 mon.a (mon.0) 663 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:11:51.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:11:51 smithi047 bash[22744]: audit 2024-09-16T06:11:50.544923+0000 mon.b (mon.2) 185 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:11:51.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:11:51 smithi047 bash[22744]: audit 2024-09-16T06:11:50.549433+0000 mgr.a (mgr.14373) 1506 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:11:52.610 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:11:52.611 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:11:52.611 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:11:52.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:11:52 smithi157 bash[24585]: cluster 2024-09-16T06:11:51.064508+0000 mgr.a (mgr.14373) 1507 : cluster [DBG] pgmap v1045: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:11:52.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:11:52 smithi157 bash[24585]: audit 2024-09-16T06:11:51.270913+0000 mgr.a (mgr.14373) 1508 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T06:11:52.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:11:52 smithi157 bash[24585]: cephadm 2024-09-16T06:11:51.272917+0000 mgr.a (mgr.14373) 1509 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T06:11:52.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:11:52 smithi086 bash[24289]: cluster 2024-09-16T06:11:51.064508+0000 mgr.a (mgr.14373) 1507 : cluster [DBG] pgmap v1045: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:11:52.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:11:52 smithi086 bash[24289]: audit 2024-09-16T06:11:51.270913+0000 mgr.a (mgr.14373) 1508 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T06:11:52.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:11:52 smithi086 bash[24289]: cephadm 2024-09-16T06:11:51.272917+0000 mgr.a (mgr.14373) 1509 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T06:11:52.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:11:52 smithi047 bash[22744]: cluster 2024-09-16T06:11:51.064508+0000 mgr.a (mgr.14373) 1507 : cluster [DBG] pgmap v1045: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:11:52.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:11:52 smithi047 bash[22744]: audit 2024-09-16T06:11:51.270913+0000 mgr.a (mgr.14373) 1508 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T06:11:52.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:11:52 smithi047 bash[22744]: cephadm 2024-09-16T06:11:51.272917+0000 mgr.a (mgr.14373) 1509 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T06:11:53.353 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:11:53.353 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:11:53.353 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:11:53.353 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:11:53.353 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:11:54.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:11:54 smithi157 bash[24585]: audit 2024-09-16T06:11:52.950047+0000 mgr.a (mgr.14373) 1510 : audit [DBG] from='client.45393 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:11:54.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:11:54 smithi157 bash[24585]: cluster 2024-09-16T06:11:53.065689+0000 mgr.a (mgr.14373) 1511 : cluster [DBG] pgmap v1046: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:11:54.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:11:54 smithi086 bash[24289]: audit 2024-09-16T06:11:52.950047+0000 mgr.a (mgr.14373) 1510 : audit [DBG] from='client.45393 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:11:54.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:11:54 smithi086 bash[24289]: cluster 2024-09-16T06:11:53.065689+0000 mgr.a (mgr.14373) 1511 : cluster [DBG] pgmap v1046: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:11:54.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:11:54 smithi047 bash[22744]: audit 2024-09-16T06:11:52.950047+0000 mgr.a (mgr.14373) 1510 : audit [DBG] from='client.45393 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:11:54.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:11:54 smithi047 bash[22744]: cluster 2024-09-16T06:11:53.065689+0000 mgr.a (mgr.14373) 1511 : cluster [DBG] pgmap v1046: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:11:56.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:11:56 smithi157 bash[24585]: cluster 2024-09-16T06:11:55.066538+0000 mgr.a (mgr.14373) 1512 : cluster [DBG] pgmap v1047: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:11:56.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:11:56 smithi086 bash[24289]: cluster 2024-09-16T06:11:55.066538+0000 mgr.a (mgr.14373) 1512 : cluster [DBG] pgmap v1047: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:11:56.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:11:56 smithi047 bash[22744]: cluster 2024-09-16T06:11:55.066538+0000 mgr.a (mgr.14373) 1512 : cluster [DBG] pgmap v1047: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:11:58.354 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:11:58.355 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:11:58.355 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:11:59.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:11:58 smithi157 bash[24585]: cluster 2024-09-16T06:11:57.068736+0000 mgr.a (mgr.14373) 1513 : cluster [DBG] pgmap v1048: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:11:59.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:11:58 smithi086 bash[24289]: cluster 2024-09-16T06:11:57.068736+0000 mgr.a (mgr.14373) 1513 : cluster [DBG] pgmap v1048: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:11:59.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:11:58 smithi047 bash[22744]: cluster 2024-09-16T06:11:57.068736+0000 mgr.a (mgr.14373) 1513 : cluster [DBG] pgmap v1048: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:11:59.100 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:11:59.101 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:11:59.101 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:11:59.101 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:11:59.101 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:12:00.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:11:59 smithi157 bash[24585]: audit 2024-09-16T06:11:58.689159+0000 mgr.a (mgr.14373) 1514 : audit [DBG] from='client.45468 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:12:00.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:11:59 smithi086 bash[24289]: audit 2024-09-16T06:11:58.689159+0000 mgr.a (mgr.14373) 1514 : audit [DBG] from='client.45468 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:12:00.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:11:59 smithi047 bash[22744]: audit 2024-09-16T06:11:58.689159+0000 mgr.a (mgr.14373) 1514 : audit [DBG] from='client.45468 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:12:01.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:12:00 smithi157 bash[24585]: cluster 2024-09-16T06:11:59.069222+0000 mgr.a (mgr.14373) 1515 : cluster [DBG] pgmap v1049: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:12:01.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:12:00 smithi086 bash[24289]: cluster 2024-09-16T06:11:59.069222+0000 mgr.a (mgr.14373) 1515 : cluster [DBG] pgmap v1049: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:12:01.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:12:00 smithi047 bash[22744]: cluster 2024-09-16T06:11:59.069222+0000 mgr.a (mgr.14373) 1515 : cluster [DBG] pgmap v1049: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:12:03.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:12:02 smithi157 bash[24585]: cluster 2024-09-16T06:12:01.069948+0000 mgr.a (mgr.14373) 1516 : cluster [DBG] pgmap v1050: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:12:03.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:12:02 smithi086 bash[24289]: cluster 2024-09-16T06:12:01.069948+0000 mgr.a (mgr.14373) 1516 : cluster [DBG] pgmap v1050: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:12:03.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:12:02 smithi047 bash[22744]: cluster 2024-09-16T06:12:01.069948+0000 mgr.a (mgr.14373) 1516 : cluster [DBG] pgmap v1050: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:12:04.102 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:12:04.103 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:12:04.103 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:12:04.820 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:12:04.820 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:12:04.820 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:12:04.820 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:12:04.820 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:12:05.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:12:04 smithi157 bash[24585]: cluster 2024-09-16T06:12:03.072155+0000 mgr.a (mgr.14373) 1517 : cluster [DBG] pgmap v1051: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:12:05.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:12:04 smithi086 bash[24289]: cluster 2024-09-16T06:12:03.072155+0000 mgr.a (mgr.14373) 1517 : cluster [DBG] pgmap v1051: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:12:05.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:12:04 smithi047 bash[22744]: cluster 2024-09-16T06:12:03.072155+0000 mgr.a (mgr.14373) 1517 : cluster [DBG] pgmap v1051: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:12:06.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:12:05 smithi157 bash[24585]: audit 2024-09-16T06:12:04.425230+0000 mgr.a (mgr.14373) 1518 : audit [DBG] from='client.45546 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:12:06.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:12:05 smithi086 bash[24289]: audit 2024-09-16T06:12:04.425230+0000 mgr.a (mgr.14373) 1518 : audit [DBG] from='client.45546 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:12:06.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:12:05 smithi047 bash[22744]: audit 2024-09-16T06:12:04.425230+0000 mgr.a (mgr.14373) 1518 : audit [DBG] from='client.45546 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:12:07.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:12:06 smithi157 bash[24585]: cluster 2024-09-16T06:12:05.073009+0000 mgr.a (mgr.14373) 1519 : cluster [DBG] pgmap v1052: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:12:07.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:12:06 smithi086 bash[24289]: cluster 2024-09-16T06:12:05.073009+0000 mgr.a (mgr.14373) 1519 : cluster [DBG] pgmap v1052: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:12:07.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:12:06 smithi047 bash[22744]: cluster 2024-09-16T06:12:05.073009+0000 mgr.a (mgr.14373) 1519 : cluster [DBG] pgmap v1052: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:12:09.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:12:08 smithi157 bash[24585]: cluster 2024-09-16T06:12:07.075209+0000 mgr.a (mgr.14373) 1520 : cluster [DBG] pgmap v1053: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:12:09.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:12:08 smithi086 bash[24289]: cluster 2024-09-16T06:12:07.075209+0000 mgr.a (mgr.14373) 1520 : cluster [DBG] pgmap v1053: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:12:09.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:12:08 smithi047 bash[22744]: cluster 2024-09-16T06:12:07.075209+0000 mgr.a (mgr.14373) 1520 : cluster [DBG] pgmap v1053: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:12:09.822 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:12:09.823 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:12:09.823 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:12:10.573 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:12:10.574 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:12:10.574 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:12:10.574 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:12:10.574 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:12:11.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:12:10 smithi157 bash[24585]: cluster 2024-09-16T06:12:09.076058+0000 mgr.a (mgr.14373) 1521 : cluster [DBG] pgmap v1054: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:12:11.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:12:10 smithi086 bash[24289]: cluster 2024-09-16T06:12:09.076058+0000 mgr.a (mgr.14373) 1521 : cluster [DBG] pgmap v1054: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:12:11.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:12:10 smithi047 bash[22744]: cluster 2024-09-16T06:12:09.076058+0000 mgr.a (mgr.14373) 1521 : cluster [DBG] pgmap v1054: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:12:12.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:12:11 smithi157 bash[24585]: audit 2024-09-16T06:12:10.153323+0000 mgr.a (mgr.14373) 1522 : audit [DBG] from='client.45624 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:12:12.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:12:11 smithi086 bash[24289]: audit 2024-09-16T06:12:10.153323+0000 mgr.a (mgr.14373) 1522 : audit [DBG] from='client.45624 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:12:12.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:12:11 smithi047 bash[22744]: audit 2024-09-16T06:12:10.153323+0000 mgr.a (mgr.14373) 1522 : audit [DBG] from='client.45624 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:12:13.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:12:12 smithi157 bash[24585]: cluster 2024-09-16T06:12:11.076977+0000 mgr.a (mgr.14373) 1523 : cluster [DBG] pgmap v1055: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:12:13.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:12:12 smithi086 bash[24289]: cluster 2024-09-16T06:12:11.076977+0000 mgr.a (mgr.14373) 1523 : cluster [DBG] pgmap v1055: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:12:13.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:12:12 smithi047 bash[22744]: cluster 2024-09-16T06:12:11.076977+0000 mgr.a (mgr.14373) 1523 : cluster [DBG] pgmap v1055: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:12:15.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:12:14 smithi157 bash[24585]: cluster 2024-09-16T06:12:13.079187+0000 mgr.a (mgr.14373) 1524 : cluster [DBG] pgmap v1056: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:12:15.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:12:14 smithi086 bash[24289]: cluster 2024-09-16T06:12:13.079187+0000 mgr.a (mgr.14373) 1524 : cluster [DBG] pgmap v1056: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:12:15.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:12:14 smithi047 bash[22744]: cluster 2024-09-16T06:12:13.079187+0000 mgr.a (mgr.14373) 1524 : cluster [DBG] pgmap v1056: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:12:15.575 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:12:15.575 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:12:15.575 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:12:16.322 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:12:16.323 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:12:16.323 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:12:16.323 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:12:16.323 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:12:17.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:12:16 smithi157 bash[24585]: cluster 2024-09-16T06:12:15.079943+0000 mgr.a (mgr.14373) 1525 : cluster [DBG] pgmap v1057: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:12:17.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:12:16 smithi086 bash[24289]: cluster 2024-09-16T06:12:15.079943+0000 mgr.a (mgr.14373) 1525 : cluster [DBG] pgmap v1057: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:12:17.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:12:16 smithi047 bash[22744]: cluster 2024-09-16T06:12:15.079943+0000 mgr.a (mgr.14373) 1525 : cluster [DBG] pgmap v1057: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:12:18.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:12:17 smithi157 bash[24585]: audit 2024-09-16T06:12:15.910001+0000 mgr.a (mgr.14373) 1526 : audit [DBG] from='client.45702 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:12:18.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:12:17 smithi086 bash[24289]: audit 2024-09-16T06:12:15.910001+0000 mgr.a (mgr.14373) 1526 : audit [DBG] from='client.45702 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:12:18.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:12:17 smithi047 bash[22744]: audit 2024-09-16T06:12:15.910001+0000 mgr.a (mgr.14373) 1526 : audit [DBG] from='client.45702 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:12:19.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:12:18 smithi157 bash[24585]: cluster 2024-09-16T06:12:17.082221+0000 mgr.a (mgr.14373) 1527 : cluster [DBG] pgmap v1058: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:12:19.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:12:18 smithi086 bash[24289]: cluster 2024-09-16T06:12:17.082221+0000 mgr.a (mgr.14373) 1527 : cluster [DBG] pgmap v1058: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:12:19.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:12:18 smithi047 bash[22744]: cluster 2024-09-16T06:12:17.082221+0000 mgr.a (mgr.14373) 1527 : cluster [DBG] pgmap v1058: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:12:21.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:12:20 smithi157 bash[24585]: cluster 2024-09-16T06:12:19.082949+0000 mgr.a (mgr.14373) 1528 : cluster [DBG] pgmap v1059: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:12:21.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:12:20 smithi086 bash[24289]: cluster 2024-09-16T06:12:19.082949+0000 mgr.a (mgr.14373) 1528 : cluster [DBG] pgmap v1059: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:12:21.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:12:20 smithi047 bash[22744]: cluster 2024-09-16T06:12:19.082949+0000 mgr.a (mgr.14373) 1528 : cluster [DBG] pgmap v1059: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:12:21.324 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:12:21.325 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:12:21.325 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:12:22.094 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:12:22.095 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:12:22.095 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:12:22.095 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:12:22.095 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:12:23.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:12:22 smithi157 bash[24585]: cluster 2024-09-16T06:12:21.083727+0000 mgr.a (mgr.14373) 1529 : cluster [DBG] pgmap v1060: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:12:23.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:12:22 smithi157 bash[24585]: audit 2024-09-16T06:12:21.665541+0000 mgr.a (mgr.14373) 1530 : audit [DBG] from='client.45774 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:12:23.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:12:22 smithi086 bash[24289]: cluster 2024-09-16T06:12:21.083727+0000 mgr.a (mgr.14373) 1529 : cluster [DBG] pgmap v1060: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:12:23.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:12:22 smithi086 bash[24289]: audit 2024-09-16T06:12:21.665541+0000 mgr.a (mgr.14373) 1530 : audit [DBG] from='client.45774 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:12:23.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:12:22 smithi047 bash[22744]: cluster 2024-09-16T06:12:21.083727+0000 mgr.a (mgr.14373) 1529 : cluster [DBG] pgmap v1060: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:12:23.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:12:22 smithi047 bash[22744]: audit 2024-09-16T06:12:21.665541+0000 mgr.a (mgr.14373) 1530 : audit [DBG] from='client.45774 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:12:25.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:12:24 smithi157 bash[24585]: cluster 2024-09-16T06:12:23.086496+0000 mgr.a (mgr.14373) 1531 : cluster [DBG] pgmap v1061: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:12:25.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:12:24 smithi086 bash[24289]: cluster 2024-09-16T06:12:23.086496+0000 mgr.a (mgr.14373) 1531 : cluster [DBG] pgmap v1061: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:12:25.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:12:24 smithi047 bash[22744]: cluster 2024-09-16T06:12:23.086496+0000 mgr.a (mgr.14373) 1531 : cluster [DBG] pgmap v1061: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:12:27.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:12:26 smithi157 bash[24585]: cluster 2024-09-16T06:12:25.087280+0000 mgr.a (mgr.14373) 1532 : cluster [DBG] pgmap v1062: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:12:27.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:12:26 smithi086 bash[24289]: cluster 2024-09-16T06:12:25.087280+0000 mgr.a (mgr.14373) 1532 : cluster [DBG] pgmap v1062: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:12:27.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:12:26 smithi047 bash[22744]: cluster 2024-09-16T06:12:25.087280+0000 mgr.a (mgr.14373) 1532 : cluster [DBG] pgmap v1062: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:12:27.096 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:12:27.097 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:12:27.097 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:12:27.838 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:12:27.838 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:12:27.838 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:12:27.838 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:12:27.838 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:12:29.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:12:28 smithi157 bash[24585]: cluster 2024-09-16T06:12:27.089271+0000 mgr.a (mgr.14373) 1533 : cluster [DBG] pgmap v1063: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:12:29.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:12:28 smithi157 bash[24585]: audit 2024-09-16T06:12:27.428754+0000 mgr.a (mgr.14373) 1534 : audit [DBG] from='client.45852 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:12:29.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:12:28 smithi086 bash[24289]: cluster 2024-09-16T06:12:27.089271+0000 mgr.a (mgr.14373) 1533 : cluster [DBG] pgmap v1063: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:12:29.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:12:28 smithi086 bash[24289]: audit 2024-09-16T06:12:27.428754+0000 mgr.a (mgr.14373) 1534 : audit [DBG] from='client.45852 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:12:29.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:12:28 smithi047 bash[22744]: cluster 2024-09-16T06:12:27.089271+0000 mgr.a (mgr.14373) 1533 : cluster [DBG] pgmap v1063: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:12:29.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:12:28 smithi047 bash[22744]: audit 2024-09-16T06:12:27.428754+0000 mgr.a (mgr.14373) 1534 : audit [DBG] from='client.45852 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:12:31.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:12:30 smithi157 bash[24585]: cluster 2024-09-16T06:12:29.090222+0000 mgr.a (mgr.14373) 1535 : cluster [DBG] pgmap v1064: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:12:31.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:12:30 smithi086 bash[24289]: cluster 2024-09-16T06:12:29.090222+0000 mgr.a (mgr.14373) 1535 : cluster [DBG] pgmap v1064: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:12:31.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:12:30 smithi047 bash[22744]: cluster 2024-09-16T06:12:29.090222+0000 mgr.a (mgr.14373) 1535 : cluster [DBG] pgmap v1064: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:12:32.840 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:12:32.840 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:12:32.841 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:12:33.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:12:32 smithi157 bash[24585]: cluster 2024-09-16T06:12:31.090989+0000 mgr.a (mgr.14373) 1536 : cluster [DBG] pgmap v1065: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T06:12:33.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:12:32 smithi086 bash[24289]: cluster 2024-09-16T06:12:31.090989+0000 mgr.a (mgr.14373) 1536 : cluster [DBG] pgmap v1065: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T06:12:33.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:12:32 smithi047 bash[22744]: cluster 2024-09-16T06:12:31.090989+0000 mgr.a (mgr.14373) 1536 : cluster [DBG] pgmap v1065: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T06:12:33.586 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:12:33.586 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:12:33.587 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:12:33.587 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:12:33.587 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:12:35.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:12:34 smithi157 bash[24585]: cluster 2024-09-16T06:12:33.093171+0000 mgr.a (mgr.14373) 1537 : cluster [DBG] pgmap v1066: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:12:35.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:12:34 smithi157 bash[24585]: audit 2024-09-16T06:12:33.174387+0000 mgr.a (mgr.14373) 1538 : audit [DBG] from='client.45927 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:12:35.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:12:34 smithi086 bash[24289]: cluster 2024-09-16T06:12:33.093171+0000 mgr.a (mgr.14373) 1537 : cluster [DBG] pgmap v1066: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:12:35.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:12:34 smithi086 bash[24289]: audit 2024-09-16T06:12:33.174387+0000 mgr.a (mgr.14373) 1538 : audit [DBG] from='client.45927 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:12:35.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:12:34 smithi047 bash[22744]: cluster 2024-09-16T06:12:33.093171+0000 mgr.a (mgr.14373) 1537 : cluster [DBG] pgmap v1066: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:12:35.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:12:34 smithi047 bash[22744]: audit 2024-09-16T06:12:33.174387+0000 mgr.a (mgr.14373) 1538 : audit [DBG] from='client.45927 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:12:37.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:12:36 smithi157 bash[24585]: cluster 2024-09-16T06:12:35.094273+0000 mgr.a (mgr.14373) 1539 : cluster [DBG] pgmap v1067: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:12:37.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:12:36 smithi086 bash[24289]: cluster 2024-09-16T06:12:35.094273+0000 mgr.a (mgr.14373) 1539 : cluster [DBG] pgmap v1067: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:12:37.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:12:36 smithi047 bash[22744]: cluster 2024-09-16T06:12:35.094273+0000 mgr.a (mgr.14373) 1539 : cluster [DBG] pgmap v1067: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:12:38.588 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:12:38.589 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:12:38.589 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:12:39.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:12:38 smithi157 bash[24585]: cluster 2024-09-16T06:12:37.096495+0000 mgr.a (mgr.14373) 1540 : cluster [DBG] pgmap v1068: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:12:39.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:12:38 smithi086 bash[24289]: cluster 2024-09-16T06:12:37.096495+0000 mgr.a (mgr.14373) 1540 : cluster [DBG] pgmap v1068: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:12:39.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:12:38 smithi047 bash[22744]: cluster 2024-09-16T06:12:37.096495+0000 mgr.a (mgr.14373) 1540 : cluster [DBG] pgmap v1068: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:12:39.348 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:12:39.348 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:12:39.348 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:12:39.348 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:12:39.348 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:12:40.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:12:39 smithi047 bash[22744]: audit 2024-09-16T06:12:38.925882+0000 mgr.a (mgr.14373) 1541 : audit [DBG] from='client.46005 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:12:40.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:12:39 smithi047 bash[22744]: cluster 2024-09-16T06:12:39.097061+0000 mgr.a (mgr.14373) 1542 : cluster [DBG] pgmap v1069: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:12:40.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:12:39 smithi157 bash[24585]: audit 2024-09-16T06:12:38.925882+0000 mgr.a (mgr.14373) 1541 : audit [DBG] from='client.46005 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:12:40.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:12:39 smithi157 bash[24585]: cluster 2024-09-16T06:12:39.097061+0000 mgr.a (mgr.14373) 1542 : cluster [DBG] pgmap v1069: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:12:40.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:12:39 smithi086 bash[24289]: audit 2024-09-16T06:12:38.925882+0000 mgr.a (mgr.14373) 1541 : audit [DBG] from='client.46005 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:12:40.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:12:39 smithi086 bash[24289]: cluster 2024-09-16T06:12:39.097061+0000 mgr.a (mgr.14373) 1542 : cluster [DBG] pgmap v1069: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:12:42.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:12:42 smithi157 bash[24585]: cluster 2024-09-16T06:12:41.098008+0000 mgr.a (mgr.14373) 1543 : cluster [DBG] pgmap v1070: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:12:42.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:12:42 smithi086 bash[24289]: cluster 2024-09-16T06:12:41.098008+0000 mgr.a (mgr.14373) 1543 : cluster [DBG] pgmap v1070: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:12:42.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:12:42 smithi047 bash[22744]: cluster 2024-09-16T06:12:41.098008+0000 mgr.a (mgr.14373) 1543 : cluster [DBG] pgmap v1070: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:12:44.349 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:12:44.350 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:12:44.350 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:12:44.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:12:44 smithi157 bash[24585]: cluster 2024-09-16T06:12:43.100376+0000 mgr.a (mgr.14373) 1544 : cluster [DBG] pgmap v1071: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:12:44.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:12:44 smithi086 bash[24289]: cluster 2024-09-16T06:12:43.100376+0000 mgr.a (mgr.14373) 1544 : cluster [DBG] pgmap v1071: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:12:44.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:12:44 smithi047 bash[22744]: cluster 2024-09-16T06:12:43.100376+0000 mgr.a (mgr.14373) 1544 : cluster [DBG] pgmap v1071: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:12:45.089 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:12:45.090 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:12:45.090 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:12:45.090 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:12:45.090 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:12:45.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:12:45 smithi157 bash[24585]: audit 2024-09-16T06:12:44.682323+0000 mgr.a (mgr.14373) 1545 : audit [DBG] from='client.46080 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:12:45.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:12:45 smithi086 bash[24289]: audit 2024-09-16T06:12:44.682323+0000 mgr.a (mgr.14373) 1545 : audit [DBG] from='client.46080 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:12:45.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:12:45 smithi047 bash[22744]: audit 2024-09-16T06:12:44.682323+0000 mgr.a (mgr.14373) 1545 : audit [DBG] from='client.46080 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:12:46.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:12:46 smithi157 bash[24585]: cluster 2024-09-16T06:12:45.101015+0000 mgr.a (mgr.14373) 1546 : cluster [DBG] pgmap v1072: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:12:46.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:12:46 smithi086 bash[24289]: cluster 2024-09-16T06:12:45.101015+0000 mgr.a (mgr.14373) 1546 : cluster [DBG] pgmap v1072: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:12:46.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:12:46 smithi047 bash[22744]: cluster 2024-09-16T06:12:45.101015+0000 mgr.a (mgr.14373) 1546 : cluster [DBG] pgmap v1072: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:12:48.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:12:48 smithi157 bash[24585]: cluster 2024-09-16T06:12:47.103130+0000 mgr.a (mgr.14373) 1547 : cluster [DBG] pgmap v1073: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:12:48.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:12:48 smithi086 bash[24289]: cluster 2024-09-16T06:12:47.103130+0000 mgr.a (mgr.14373) 1547 : cluster [DBG] pgmap v1073: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:12:48.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:12:48 smithi047 bash[22744]: cluster 2024-09-16T06:12:47.103130+0000 mgr.a (mgr.14373) 1547 : cluster [DBG] pgmap v1073: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:12:50.091 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:12:50.092 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:12:50.092 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:12:50.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:12:50 smithi157 bash[24585]: cluster 2024-09-16T06:12:49.103842+0000 mgr.a (mgr.14373) 1548 : cluster [DBG] pgmap v1074: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:12:50.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:12:50 smithi086 bash[24289]: cluster 2024-09-16T06:12:49.103842+0000 mgr.a (mgr.14373) 1548 : cluster [DBG] pgmap v1074: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:12:50.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:12:50 smithi047 bash[22744]: cluster 2024-09-16T06:12:49.103842+0000 mgr.a (mgr.14373) 1548 : cluster [DBG] pgmap v1074: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:12:50.858 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:12:50.858 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:12:50.858 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:12:50.858 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:12:50.858 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:12:51.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:12:51 smithi157 bash[24585]: audit 2024-09-16T06:12:50.426959+0000 mgr.a (mgr.14373) 1549 : audit [DBG] from='client.46155 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:12:51.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:12:51 smithi086 bash[24289]: audit 2024-09-16T06:12:50.426959+0000 mgr.a (mgr.14373) 1549 : audit [DBG] from='client.46155 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:12:51.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:12:51 smithi047 bash[22744]: audit 2024-09-16T06:12:50.426959+0000 mgr.a (mgr.14373) 1549 : audit [DBG] from='client.46155 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:12:52.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:12:52 smithi157 bash[24585]: cluster 2024-09-16T06:12:51.104828+0000 mgr.a (mgr.14373) 1550 : cluster [DBG] pgmap v1075: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:12:52.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:12:52 smithi157 bash[24585]: audit 2024-09-16T06:12:51.321762+0000 mon.b (mon.2) 186 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T06:12:52.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:12:52 smithi157 bash[24585]: audit 2024-09-16T06:12:52.167222+0000 mon.b (mon.2) 187 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T06:12:52.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:12:52 smithi157 bash[24585]: audit 2024-09-16T06:12:52.169262+0000 mon.b (mon.2) 188 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T06:12:52.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:12:52 smithi157 bash[24585]: audit 2024-09-16T06:12:52.183434+0000 mon.a (mon.0) 664 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:12:52.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:12:52 smithi086 bash[24289]: cluster 2024-09-16T06:12:51.104828+0000 mgr.a (mgr.14373) 1550 : cluster [DBG] pgmap v1075: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:12:52.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:12:52 smithi086 bash[24289]: audit 2024-09-16T06:12:51.321762+0000 mon.b (mon.2) 186 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T06:12:52.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:12:52 smithi086 bash[24289]: audit 2024-09-16T06:12:52.167222+0000 mon.b (mon.2) 187 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T06:12:52.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:12:52 smithi086 bash[24289]: audit 2024-09-16T06:12:52.169262+0000 mon.b (mon.2) 188 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T06:12:52.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:12:52 smithi086 bash[24289]: audit 2024-09-16T06:12:52.183434+0000 mon.a (mon.0) 664 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:12:52.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:12:52 smithi047 bash[22744]: cluster 2024-09-16T06:12:51.104828+0000 mgr.a (mgr.14373) 1550 : cluster [DBG] pgmap v1075: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:12:52.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:12:52 smithi047 bash[22744]: audit 2024-09-16T06:12:51.321762+0000 mon.b (mon.2) 186 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T06:12:52.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:12:52 smithi047 bash[22744]: audit 2024-09-16T06:12:52.167222+0000 mon.b (mon.2) 187 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T06:12:52.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:12:52 smithi047 bash[22744]: audit 2024-09-16T06:12:52.169262+0000 mon.b (mon.2) 188 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T06:12:52.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:12:52 smithi047 bash[22744]: audit 2024-09-16T06:12:52.183434+0000 mon.a (mon.0) 664 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:12:53.195 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 06:12:52 smithi047 bash[22994]: debug 2024-09-16T06:12:52.906+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T06:12:53.195 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 06:12:52 smithi047 bash[22994]: debug 2024-09-16T06:12:52.906+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T06:12:53.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:12:53 smithi157 bash[24585]: audit 2024-09-16T06:12:52.191295+0000 mon.b (mon.2) 189 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:12:53.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:12:53 smithi157 bash[24585]: audit 2024-09-16T06:12:52.196267+0000 mgr.a (mgr.14373) 1551 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:12:53.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:12:53 smithi086 bash[24289]: audit 2024-09-16T06:12:52.191295+0000 mon.b (mon.2) 189 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:12:53.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:12:53 smithi086 bash[24289]: audit 2024-09-16T06:12:52.196267+0000 mgr.a (mgr.14373) 1551 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:12:53.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:12:53 smithi047 bash[22744]: audit 2024-09-16T06:12:52.191295+0000 mon.b (mon.2) 189 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:12:53.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:12:53 smithi047 bash[22744]: audit 2024-09-16T06:12:52.196267+0000 mgr.a (mgr.14373) 1551 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:12:54.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:12:54 smithi157 bash[24585]: audit 2024-09-16T06:12:52.907733+0000 mgr.a (mgr.14373) 1552 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T06:12:54.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:12:54 smithi157 bash[24585]: cephadm 2024-09-16T06:12:52.910238+0000 mgr.a (mgr.14373) 1553 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T06:12:54.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:12:54 smithi157 bash[24585]: cluster 2024-09-16T06:12:53.107595+0000 mgr.a (mgr.14373) 1554 : cluster [DBG] pgmap v1076: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:12:54.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:12:54 smithi086 bash[24289]: audit 2024-09-16T06:12:52.907733+0000 mgr.a (mgr.14373) 1552 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T06:12:54.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:12:54 smithi086 bash[24289]: cephadm 2024-09-16T06:12:52.910238+0000 mgr.a (mgr.14373) 1553 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T06:12:54.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:12:54 smithi086 bash[24289]: cluster 2024-09-16T06:12:53.107595+0000 mgr.a (mgr.14373) 1554 : cluster [DBG] pgmap v1076: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:12:54.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:12:54 smithi047 bash[22744]: audit 2024-09-16T06:12:52.907733+0000 mgr.a (mgr.14373) 1552 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T06:12:54.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:12:54 smithi047 bash[22744]: cephadm 2024-09-16T06:12:52.910238+0000 mgr.a (mgr.14373) 1553 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T06:12:54.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:12:54 smithi047 bash[22744]: cluster 2024-09-16T06:12:53.107595+0000 mgr.a (mgr.14373) 1554 : cluster [DBG] pgmap v1076: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:12:55.860 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:12:55.861 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:12:55.861 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:12:56.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:12:56 smithi157 bash[24585]: cluster 2024-09-16T06:12:55.108375+0000 mgr.a (mgr.14373) 1555 : cluster [DBG] pgmap v1077: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:12:56.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:12:56 smithi086 bash[24289]: cluster 2024-09-16T06:12:55.108375+0000 mgr.a (mgr.14373) 1555 : cluster [DBG] pgmap v1077: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:12:56.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:12:56 smithi047 bash[22744]: cluster 2024-09-16T06:12:55.108375+0000 mgr.a (mgr.14373) 1555 : cluster [DBG] pgmap v1077: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:12:56.604 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:12:56.605 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:12:56.605 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:12:56.605 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:12:56.605 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:12:57.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:12:57 smithi157 bash[24585]: audit 2024-09-16T06:12:56.184655+0000 mgr.a (mgr.14373) 1556 : audit [DBG] from='client.46338 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:12:57.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:12:57 smithi086 bash[24289]: audit 2024-09-16T06:12:56.184655+0000 mgr.a (mgr.14373) 1556 : audit [DBG] from='client.46338 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:12:57.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:12:57 smithi047 bash[22744]: audit 2024-09-16T06:12:56.184655+0000 mgr.a (mgr.14373) 1556 : audit [DBG] from='client.46338 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:12:58.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:12:58 smithi157 bash[24585]: cluster 2024-09-16T06:12:57.110855+0000 mgr.a (mgr.14373) 1557 : cluster [DBG] pgmap v1078: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:12:58.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:12:58 smithi086 bash[24289]: cluster 2024-09-16T06:12:57.110855+0000 mgr.a (mgr.14373) 1557 : cluster [DBG] pgmap v1078: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:12:58.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:12:58 smithi047 bash[22744]: cluster 2024-09-16T06:12:57.110855+0000 mgr.a (mgr.14373) 1557 : cluster [DBG] pgmap v1078: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:13:00.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:13:00 smithi157 bash[24585]: cluster 2024-09-16T06:12:59.111679+0000 mgr.a (mgr.14373) 1558 : cluster [DBG] pgmap v1079: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T06:13:00.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:13:00 smithi086 bash[24289]: cluster 2024-09-16T06:12:59.111679+0000 mgr.a (mgr.14373) 1558 : cluster [DBG] pgmap v1079: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T06:13:00.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:13:00 smithi047 bash[22744]: cluster 2024-09-16T06:12:59.111679+0000 mgr.a (mgr.14373) 1558 : cluster [DBG] pgmap v1079: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T06:13:01.606 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:13:01.607 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:13:01.607 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:13:02.378 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:13:02.379 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:13:02.379 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:13:02.379 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:13:02.379 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:13:02.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:13:02 smithi157 bash[24585]: cluster 2024-09-16T06:13:01.112470+0000 mgr.a (mgr.14373) 1559 : cluster [DBG] pgmap v1080: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T06:13:02.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:13:02 smithi086 bash[24289]: cluster 2024-09-16T06:13:01.112470+0000 mgr.a (mgr.14373) 1559 : cluster [DBG] pgmap v1080: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T06:13:02.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:13:02 smithi047 bash[22744]: cluster 2024-09-16T06:13:01.112470+0000 mgr.a (mgr.14373) 1559 : cluster [DBG] pgmap v1080: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T06:13:03.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:13:03 smithi157 bash[24585]: audit 2024-09-16T06:13:01.947123+0000 mgr.a (mgr.14373) 1560 : audit [DBG] from='client.46416 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:13:03.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:13:03 smithi086 bash[24289]: audit 2024-09-16T06:13:01.947123+0000 mgr.a (mgr.14373) 1560 : audit [DBG] from='client.46416 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:13:03.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:13:03 smithi047 bash[22744]: audit 2024-09-16T06:13:01.947123+0000 mgr.a (mgr.14373) 1560 : audit [DBG] from='client.46416 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:13:04.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:13:04 smithi157 bash[24585]: cluster 2024-09-16T06:13:03.115292+0000 mgr.a (mgr.14373) 1561 : cluster [DBG] pgmap v1081: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:13:04.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:13:04 smithi086 bash[24289]: cluster 2024-09-16T06:13:03.115292+0000 mgr.a (mgr.14373) 1561 : cluster [DBG] pgmap v1081: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:13:04.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:13:04 smithi047 bash[22744]: cluster 2024-09-16T06:13:03.115292+0000 mgr.a (mgr.14373) 1561 : cluster [DBG] pgmap v1081: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:13:06.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:13:06 smithi157 bash[24585]: cluster 2024-09-16T06:13:05.116103+0000 mgr.a (mgr.14373) 1562 : cluster [DBG] pgmap v1082: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T06:13:06.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:13:06 smithi086 bash[24289]: cluster 2024-09-16T06:13:05.116103+0000 mgr.a (mgr.14373) 1562 : cluster [DBG] pgmap v1082: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T06:13:06.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:13:06 smithi047 bash[22744]: cluster 2024-09-16T06:13:05.116103+0000 mgr.a (mgr.14373) 1562 : cluster [DBG] pgmap v1082: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T06:13:07.380 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:13:07.381 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:13:07.381 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:13:08.127 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:13:08.127 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:13:08.127 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:13:08.127 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:13:08.128 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:13:08.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:13:08 smithi157 bash[24585]: cluster 2024-09-16T06:13:07.118076+0000 mgr.a (mgr.14373) 1563 : cluster [DBG] pgmap v1083: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:13:08.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:13:08 smithi157 bash[24585]: audit 2024-09-16T06:13:07.718825+0000 mgr.a (mgr.14373) 1564 : audit [DBG] from='client.46494 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:13:08.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:13:08 smithi086 bash[24289]: cluster 2024-09-16T06:13:07.118076+0000 mgr.a (mgr.14373) 1563 : cluster [DBG] pgmap v1083: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:13:08.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:13:08 smithi086 bash[24289]: audit 2024-09-16T06:13:07.718825+0000 mgr.a (mgr.14373) 1564 : audit [DBG] from='client.46494 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:13:08.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:13:08 smithi047 bash[22744]: cluster 2024-09-16T06:13:07.118076+0000 mgr.a (mgr.14373) 1563 : cluster [DBG] pgmap v1083: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:13:08.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:13:08 smithi047 bash[22744]: audit 2024-09-16T06:13:07.718825+0000 mgr.a (mgr.14373) 1564 : audit [DBG] from='client.46494 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:13:10.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:13:10 smithi157 bash[24585]: cluster 2024-09-16T06:13:09.119089+0000 mgr.a (mgr.14373) 1565 : cluster [DBG] pgmap v1084: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T06:13:10.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:13:10 smithi086 bash[24289]: cluster 2024-09-16T06:13:09.119089+0000 mgr.a (mgr.14373) 1565 : cluster [DBG] pgmap v1084: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T06:13:10.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:13:10 smithi047 bash[22744]: cluster 2024-09-16T06:13:09.119089+0000 mgr.a (mgr.14373) 1565 : cluster [DBG] pgmap v1084: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T06:13:12.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:13:12 smithi157 bash[24585]: cluster 2024-09-16T06:13:11.119875+0000 mgr.a (mgr.14373) 1566 : cluster [DBG] pgmap v1085: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T06:13:12.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:13:12 smithi086 bash[24289]: cluster 2024-09-16T06:13:11.119875+0000 mgr.a (mgr.14373) 1566 : cluster [DBG] pgmap v1085: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T06:13:12.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:13:12 smithi047 bash[22744]: cluster 2024-09-16T06:13:11.119875+0000 mgr.a (mgr.14373) 1566 : cluster [DBG] pgmap v1085: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T06:13:13.129 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:13:13.130 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:13:13.130 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:13:13.890 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:13:13.890 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:13:13.890 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:13:13.890 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:13:13.890 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:13:14.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:13:14 smithi157 bash[24585]: cluster 2024-09-16T06:13:13.122069+0000 mgr.a (mgr.14373) 1567 : cluster [DBG] pgmap v1086: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-16T06:13:14.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:13:14 smithi157 bash[24585]: audit 2024-09-16T06:13:13.465173+0000 mgr.a (mgr.14373) 1568 : audit [DBG] from='client.46569 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:13:14.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:13:14 smithi086 bash[24289]: cluster 2024-09-16T06:13:13.122069+0000 mgr.a (mgr.14373) 1567 : cluster [DBG] pgmap v1086: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-16T06:13:14.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:13:14 smithi086 bash[24289]: audit 2024-09-16T06:13:13.465173+0000 mgr.a (mgr.14373) 1568 : audit [DBG] from='client.46569 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:13:14.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:13:14 smithi047 bash[22744]: cluster 2024-09-16T06:13:13.122069+0000 mgr.a (mgr.14373) 1567 : cluster [DBG] pgmap v1086: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-16T06:13:14.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:13:14 smithi047 bash[22744]: audit 2024-09-16T06:13:13.465173+0000 mgr.a (mgr.14373) 1568 : audit [DBG] from='client.46569 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:13:16.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:13:16 smithi157 bash[24585]: cluster 2024-09-16T06:13:15.123054+0000 mgr.a (mgr.14373) 1569 : cluster [DBG] pgmap v1087: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:13:16.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:13:16 smithi086 bash[24289]: cluster 2024-09-16T06:13:15.123054+0000 mgr.a (mgr.14373) 1569 : cluster [DBG] pgmap v1087: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:13:16.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:13:16 smithi047 bash[22744]: cluster 2024-09-16T06:13:15.123054+0000 mgr.a (mgr.14373) 1569 : cluster [DBG] pgmap v1087: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:13:18.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:13:18 smithi157 bash[24585]: cluster 2024-09-16T06:13:17.125256+0000 mgr.a (mgr.14373) 1570 : cluster [DBG] pgmap v1088: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:13:18.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:13:18 smithi086 bash[24289]: cluster 2024-09-16T06:13:17.125256+0000 mgr.a (mgr.14373) 1570 : cluster [DBG] pgmap v1088: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:13:18.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:13:18 smithi047 bash[22744]: cluster 2024-09-16T06:13:17.125256+0000 mgr.a (mgr.14373) 1570 : cluster [DBG] pgmap v1088: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:13:18.891 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:13:18.892 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:13:18.893 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:13:19.682 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:13:19.683 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:13:19.683 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:13:19.683 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:13:19.683 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:13:20.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:13:20 smithi157 bash[24585]: cluster 2024-09-16T06:13:19.125987+0000 mgr.a (mgr.14373) 1571 : cluster [DBG] pgmap v1089: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:13:20.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:13:20 smithi157 bash[24585]: audit 2024-09-16T06:13:19.236509+0000 mgr.a (mgr.14373) 1572 : audit [DBG] from='client.46647 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:13:20.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:13:20 smithi086 bash[24289]: cluster 2024-09-16T06:13:19.125987+0000 mgr.a (mgr.14373) 1571 : cluster [DBG] pgmap v1089: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:13:20.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:13:20 smithi086 bash[24289]: audit 2024-09-16T06:13:19.236509+0000 mgr.a (mgr.14373) 1572 : audit [DBG] from='client.46647 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:13:20.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:13:20 smithi047 bash[22744]: cluster 2024-09-16T06:13:19.125987+0000 mgr.a (mgr.14373) 1571 : cluster [DBG] pgmap v1089: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:13:20.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:13:20 smithi047 bash[22744]: audit 2024-09-16T06:13:19.236509+0000 mgr.a (mgr.14373) 1572 : audit [DBG] from='client.46647 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:13:22.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:13:22 smithi157 bash[24585]: cluster 2024-09-16T06:13:21.126872+0000 mgr.a (mgr.14373) 1573 : cluster [DBG] pgmap v1090: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:13:22.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:13:22 smithi086 bash[24289]: cluster 2024-09-16T06:13:21.126872+0000 mgr.a (mgr.14373) 1573 : cluster [DBG] pgmap v1090: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:13:22.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:13:22 smithi047 bash[22744]: cluster 2024-09-16T06:13:21.126872+0000 mgr.a (mgr.14373) 1573 : cluster [DBG] pgmap v1090: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:13:24.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:13:24 smithi157 bash[24585]: cluster 2024-09-16T06:13:23.129097+0000 mgr.a (mgr.14373) 1574 : cluster [DBG] pgmap v1091: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:13:24.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:13:24 smithi086 bash[24289]: cluster 2024-09-16T06:13:23.129097+0000 mgr.a (mgr.14373) 1574 : cluster [DBG] pgmap v1091: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:13:24.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:13:24 smithi047 bash[22744]: cluster 2024-09-16T06:13:23.129097+0000 mgr.a (mgr.14373) 1574 : cluster [DBG] pgmap v1091: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:13:24.684 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:13:24.685 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:13:24.685 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:13:25.420 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:13:25.420 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:13:25.420 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:13:25.420 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:13:25.420 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:13:26.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:13:26 smithi157 bash[24585]: audit 2024-09-16T06:13:25.015091+0000 mgr.a (mgr.14373) 1575 : audit [DBG] from='client.46725 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:13:26.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:13:26 smithi157 bash[24585]: cluster 2024-09-16T06:13:25.129593+0000 mgr.a (mgr.14373) 1576 : cluster [DBG] pgmap v1092: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:13:26.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:13:26 smithi086 bash[24289]: audit 2024-09-16T06:13:25.015091+0000 mgr.a (mgr.14373) 1575 : audit [DBG] from='client.46725 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:13:26.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:13:26 smithi086 bash[24289]: cluster 2024-09-16T06:13:25.129593+0000 mgr.a (mgr.14373) 1576 : cluster [DBG] pgmap v1092: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:13:26.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:13:26 smithi047 bash[22744]: audit 2024-09-16T06:13:25.015091+0000 mgr.a (mgr.14373) 1575 : audit [DBG] from='client.46725 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:13:26.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:13:26 smithi047 bash[22744]: cluster 2024-09-16T06:13:25.129593+0000 mgr.a (mgr.14373) 1576 : cluster [DBG] pgmap v1092: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:13:28.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:13:28 smithi157 bash[24585]: cluster 2024-09-16T06:13:27.131945+0000 mgr.a (mgr.14373) 1577 : cluster [DBG] pgmap v1093: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:13:28.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:13:28 smithi086 bash[24289]: cluster 2024-09-16T06:13:27.131945+0000 mgr.a (mgr.14373) 1577 : cluster [DBG] pgmap v1093: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:13:28.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:13:28 smithi047 bash[22744]: cluster 2024-09-16T06:13:27.131945+0000 mgr.a (mgr.14373) 1577 : cluster [DBG] pgmap v1093: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:13:30.421 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:13:30.422 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:13:30.422 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:13:30.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:13:30 smithi157 bash[24585]: cluster 2024-09-16T06:13:29.132901+0000 mgr.a (mgr.14373) 1578 : cluster [DBG] pgmap v1094: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:13:30.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:13:30 smithi086 bash[24289]: cluster 2024-09-16T06:13:29.132901+0000 mgr.a (mgr.14373) 1578 : cluster [DBG] pgmap v1094: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:13:30.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:13:30 smithi047 bash[22744]: cluster 2024-09-16T06:13:29.132901+0000 mgr.a (mgr.14373) 1578 : cluster [DBG] pgmap v1094: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:13:31.193 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:13:31.193 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:13:31.194 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:13:31.194 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:13:31.194 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:13:31.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:13:31 smithi157 bash[24585]: audit 2024-09-16T06:13:30.762644+0000 mgr.a (mgr.14373) 1579 : audit [DBG] from='client.46803 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:13:31.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:13:31 smithi086 bash[24289]: audit 2024-09-16T06:13:30.762644+0000 mgr.a (mgr.14373) 1579 : audit [DBG] from='client.46803 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:13:31.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:13:31 smithi047 bash[22744]: audit 2024-09-16T06:13:30.762644+0000 mgr.a (mgr.14373) 1579 : audit [DBG] from='client.46803 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:13:32.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:13:32 smithi157 bash[24585]: cluster 2024-09-16T06:13:31.133548+0000 mgr.a (mgr.14373) 1580 : cluster [DBG] pgmap v1095: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:13:32.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:13:32 smithi086 bash[24289]: cluster 2024-09-16T06:13:31.133548+0000 mgr.a (mgr.14373) 1580 : cluster [DBG] pgmap v1095: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:13:32.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:13:32 smithi047 bash[22744]: cluster 2024-09-16T06:13:31.133548+0000 mgr.a (mgr.14373) 1580 : cluster [DBG] pgmap v1095: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:13:34.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:13:34 smithi157 bash[24585]: cluster 2024-09-16T06:13:33.135799+0000 mgr.a (mgr.14373) 1581 : cluster [DBG] pgmap v1096: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:13:34.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:13:34 smithi086 bash[24289]: cluster 2024-09-16T06:13:33.135799+0000 mgr.a (mgr.14373) 1581 : cluster [DBG] pgmap v1096: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:13:34.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:13:34 smithi047 bash[22744]: cluster 2024-09-16T06:13:33.135799+0000 mgr.a (mgr.14373) 1581 : cluster [DBG] pgmap v1096: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:13:36.195 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:13:36.195 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:13:36.196 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:13:36.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:13:36 smithi086 bash[24289]: cluster 2024-09-16T06:13:35.136556+0000 mgr.a (mgr.14373) 1582 : cluster [DBG] pgmap v1097: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:13:36.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:13:36 smithi047 bash[22744]: cluster 2024-09-16T06:13:35.136556+0000 mgr.a (mgr.14373) 1582 : cluster [DBG] pgmap v1097: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:13:36.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:13:36 smithi157 bash[24585]: cluster 2024-09-16T06:13:35.136556+0000 mgr.a (mgr.14373) 1582 : cluster [DBG] pgmap v1097: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:13:36.953 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:13:36.953 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:13:36.953 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:13:36.953 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:13:36.953 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:13:37.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:13:37 smithi086 bash[24289]: audit 2024-09-16T06:13:36.534917+0000 mgr.a (mgr.14373) 1583 : audit [DBG] from='client.46878 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:13:37.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:13:37 smithi047 bash[22744]: audit 2024-09-16T06:13:36.534917+0000 mgr.a (mgr.14373) 1583 : audit [DBG] from='client.46878 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:13:37.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:13:37 smithi157 bash[24585]: audit 2024-09-16T06:13:36.534917+0000 mgr.a (mgr.14373) 1583 : audit [DBG] from='client.46878 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:13:38.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:13:38 smithi086 bash[24289]: cluster 2024-09-16T06:13:37.139343+0000 mgr.a (mgr.14373) 1584 : cluster [DBG] pgmap v1098: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:13:38.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:13:38 smithi047 bash[22744]: cluster 2024-09-16T06:13:37.139343+0000 mgr.a (mgr.14373) 1584 : cluster [DBG] pgmap v1098: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:13:38.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:13:38 smithi157 bash[24585]: cluster 2024-09-16T06:13:37.139343+0000 mgr.a (mgr.14373) 1584 : cluster [DBG] pgmap v1098: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:13:40.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:13:40 smithi047 bash[22744]: cluster 2024-09-16T06:13:39.140132+0000 mgr.a (mgr.14373) 1585 : cluster [DBG] pgmap v1099: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:13:40.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:13:40 smithi157 bash[24585]: cluster 2024-09-16T06:13:39.140132+0000 mgr.a (mgr.14373) 1585 : cluster [DBG] pgmap v1099: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:13:40.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:13:40 smithi086 bash[24289]: cluster 2024-09-16T06:13:39.140132+0000 mgr.a (mgr.14373) 1585 : cluster [DBG] pgmap v1099: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:13:41.954 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:13:41.955 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:13:41.955 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:13:42.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:13:42 smithi047 bash[22744]: cluster 2024-09-16T06:13:41.140866+0000 mgr.a (mgr.14373) 1586 : cluster [DBG] pgmap v1100: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T06:13:42.692 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:13:42.693 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:13:42.693 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:13:42.693 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:13:42.693 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:13:42.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:13:42 smithi157 bash[24585]: cluster 2024-09-16T06:13:41.140866+0000 mgr.a (mgr.14373) 1586 : cluster [DBG] pgmap v1100: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T06:13:42.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:13:42 smithi086 bash[24289]: cluster 2024-09-16T06:13:41.140866+0000 mgr.a (mgr.14373) 1586 : cluster [DBG] pgmap v1100: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T06:13:43.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:13:43 smithi047 bash[22744]: audit 2024-09-16T06:13:42.287899+0000 mgr.a (mgr.14373) 1587 : audit [DBG] from='client.46953 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:13:43.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:13:43 smithi157 bash[24585]: audit 2024-09-16T06:13:42.287899+0000 mgr.a (mgr.14373) 1587 : audit [DBG] from='client.46953 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:13:43.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:13:43 smithi086 bash[24289]: audit 2024-09-16T06:13:42.287899+0000 mgr.a (mgr.14373) 1587 : audit [DBG] from='client.46953 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:13:44.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:13:44 smithi047 bash[22744]: cluster 2024-09-16T06:13:43.143591+0000 mgr.a (mgr.14373) 1588 : cluster [DBG] pgmap v1101: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:13:44.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:13:44 smithi157 bash[24585]: cluster 2024-09-16T06:13:43.143591+0000 mgr.a (mgr.14373) 1588 : cluster [DBG] pgmap v1101: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:13:44.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:13:44 smithi086 bash[24289]: cluster 2024-09-16T06:13:43.143591+0000 mgr.a (mgr.14373) 1588 : cluster [DBG] pgmap v1101: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:13:46.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:13:46 smithi157 bash[24585]: cluster 2024-09-16T06:13:45.144350+0000 mgr.a (mgr.14373) 1589 : cluster [DBG] pgmap v1102: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:13:46.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:13:46 smithi086 bash[24289]: cluster 2024-09-16T06:13:45.144350+0000 mgr.a (mgr.14373) 1589 : cluster [DBG] pgmap v1102: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:13:46.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:13:46 smithi047 bash[22744]: cluster 2024-09-16T06:13:45.144350+0000 mgr.a (mgr.14373) 1589 : cluster [DBG] pgmap v1102: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:13:47.694 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:13:47.694 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:13:47.695 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:13:48.434 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:13:48.434 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:13:48.434 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:13:48.434 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:13:48.434 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:13:48.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:13:48 smithi157 bash[24585]: cluster 2024-09-16T06:13:47.146304+0000 mgr.a (mgr.14373) 1590 : cluster [DBG] pgmap v1103: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:13:48.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:13:48 smithi086 bash[24289]: cluster 2024-09-16T06:13:47.146304+0000 mgr.a (mgr.14373) 1590 : cluster [DBG] pgmap v1103: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:13:48.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:13:48 smithi047 bash[22744]: cluster 2024-09-16T06:13:47.146304+0000 mgr.a (mgr.14373) 1590 : cluster [DBG] pgmap v1103: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:13:49.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:13:49 smithi157 bash[24585]: audit 2024-09-16T06:13:48.024202+0000 mgr.a (mgr.14373) 1591 : audit [DBG] from='client.47031 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:13:49.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:13:49 smithi086 bash[24289]: audit 2024-09-16T06:13:48.024202+0000 mgr.a (mgr.14373) 1591 : audit [DBG] from='client.47031 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:13:49.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:13:49 smithi047 bash[22744]: audit 2024-09-16T06:13:48.024202+0000 mgr.a (mgr.14373) 1591 : audit [DBG] from='client.47031 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:13:50.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:13:50 smithi157 bash[24585]: cluster 2024-09-16T06:13:49.147325+0000 mgr.a (mgr.14373) 1592 : cluster [DBG] pgmap v1104: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:13:50.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:13:50 smithi086 bash[24289]: cluster 2024-09-16T06:13:49.147325+0000 mgr.a (mgr.14373) 1592 : cluster [DBG] pgmap v1104: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:13:50.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:13:50 smithi047 bash[22744]: cluster 2024-09-16T06:13:49.147325+0000 mgr.a (mgr.14373) 1592 : cluster [DBG] pgmap v1104: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:13:52.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:13:52 smithi157 bash[24585]: cluster 2024-09-16T06:13:51.148121+0000 mgr.a (mgr.14373) 1593 : cluster [DBG] pgmap v1105: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:13:52.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:13:52 smithi086 bash[24289]: cluster 2024-09-16T06:13:51.148121+0000 mgr.a (mgr.14373) 1593 : cluster [DBG] pgmap v1105: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:13:52.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:13:52 smithi047 bash[22744]: cluster 2024-09-16T06:13:51.148121+0000 mgr.a (mgr.14373) 1593 : cluster [DBG] pgmap v1105: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:13:53.435 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:13:53.436 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:13:53.436 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:13:53.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:13:53 smithi157 bash[24585]: audit 2024-09-16T06:13:52.964364+0000 mon.b (mon.2) 190 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T06:13:53.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:13:53 smithi086 bash[24289]: audit 2024-09-16T06:13:52.964364+0000 mon.b (mon.2) 190 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T06:13:53.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:13:53 smithi047 bash[22744]: audit 2024-09-16T06:13:52.964364+0000 mon.b (mon.2) 190 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T06:13:54.189 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:13:54.189 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:13:54.189 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:13:54.189 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:13:54.189 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:13:55.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:13:54 smithi157 bash[24585]: cluster 2024-09-16T06:13:53.150288+0000 mgr.a (mgr.14373) 1594 : cluster [DBG] pgmap v1106: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:13:55.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:13:54 smithi157 bash[24585]: audit 2024-09-16T06:13:53.593326+0000 mon.a (mon.0) 665 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:13:55.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:13:54 smithi157 bash[24585]: audit 2024-09-16T06:13:53.605876+0000 mon.a (mon.0) 666 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:13:55.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:13:54 smithi157 bash[24585]: audit 2024-09-16T06:13:53.783891+0000 mgr.a (mgr.14373) 1595 : audit [DBG] from='client.47109 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:13:55.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:13:54 smithi157 bash[24585]: audit 2024-09-16T06:13:54.360502+0000 mon.b (mon.2) 191 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T06:13:55.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:13:54 smithi157 bash[24585]: audit 2024-09-16T06:13:54.362952+0000 mon.b (mon.2) 192 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T06:13:55.055 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:13:54 smithi157 bash[24585]: audit 2024-09-16T06:13:54.373959+0000 mon.a (mon.0) 667 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:13:55.055 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:13:54 smithi157 bash[24585]: audit 2024-09-16T06:13:54.377905+0000 mon.b (mon.2) 193 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:13:55.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:13:54 smithi086 bash[24289]: cluster 2024-09-16T06:13:53.150288+0000 mgr.a (mgr.14373) 1594 : cluster [DBG] pgmap v1106: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:13:55.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:13:54 smithi086 bash[24289]: audit 2024-09-16T06:13:53.593326+0000 mon.a (mon.0) 665 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:13:55.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:13:54 smithi086 bash[24289]: audit 2024-09-16T06:13:53.605876+0000 mon.a (mon.0) 666 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:13:55.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:13:54 smithi086 bash[24289]: audit 2024-09-16T06:13:53.783891+0000 mgr.a (mgr.14373) 1595 : audit [DBG] from='client.47109 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:13:55.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:13:54 smithi086 bash[24289]: audit 2024-09-16T06:13:54.360502+0000 mon.b (mon.2) 191 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T06:13:55.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:13:54 smithi086 bash[24289]: audit 2024-09-16T06:13:54.362952+0000 mon.b (mon.2) 192 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T06:13:55.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:13:54 smithi086 bash[24289]: audit 2024-09-16T06:13:54.373959+0000 mon.a (mon.0) 667 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:13:55.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:13:54 smithi086 bash[24289]: audit 2024-09-16T06:13:54.377905+0000 mon.b (mon.2) 193 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:13:55.073 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:13:54 smithi047 bash[22744]: cluster 2024-09-16T06:13:53.150288+0000 mgr.a (mgr.14373) 1594 : cluster [DBG] pgmap v1106: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:13:55.073 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:13:54 smithi047 bash[22744]: audit 2024-09-16T06:13:53.593326+0000 mon.a (mon.0) 665 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:13:55.073 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:13:54 smithi047 bash[22744]: audit 2024-09-16T06:13:53.605876+0000 mon.a (mon.0) 666 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:13:55.074 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:13:54 smithi047 bash[22744]: audit 2024-09-16T06:13:53.783891+0000 mgr.a (mgr.14373) 1595 : audit [DBG] from='client.47109 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:13:55.074 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:13:54 smithi047 bash[22744]: audit 2024-09-16T06:13:54.360502+0000 mon.b (mon.2) 191 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T06:13:55.074 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:13:54 smithi047 bash[22744]: audit 2024-09-16T06:13:54.362952+0000 mon.b (mon.2) 192 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T06:13:55.074 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:13:54 smithi047 bash[22744]: audit 2024-09-16T06:13:54.373959+0000 mon.a (mon.0) 667 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:13:55.074 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:13:54 smithi047 bash[22744]: audit 2024-09-16T06:13:54.377905+0000 mon.b (mon.2) 193 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:13:55.339 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 06:13:55 smithi047 bash[22994]: debug 2024-09-16T06:13:55.072+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T06:13:55.339 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 06:13:55 smithi047 bash[22994]: debug 2024-09-16T06:13:55.072+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T06:13:56.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:13:55 smithi157 bash[24585]: audit 2024-09-16T06:13:54.383065+0000 mgr.a (mgr.14373) 1596 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:13:56.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:13:55 smithi086 bash[24289]: audit 2024-09-16T06:13:54.383065+0000 mgr.a (mgr.14373) 1596 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:13:56.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:13:55 smithi047 bash[22744]: audit 2024-09-16T06:13:54.383065+0000 mgr.a (mgr.14373) 1596 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:13:57.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:13:56 smithi157 bash[24585]: audit 2024-09-16T06:13:55.076127+0000 mgr.a (mgr.14373) 1597 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T06:13:57.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:13:56 smithi157 bash[24585]: cephadm 2024-09-16T06:13:55.078073+0000 mgr.a (mgr.14373) 1598 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T06:13:57.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:13:56 smithi157 bash[24585]: cluster 2024-09-16T06:13:55.150965+0000 mgr.a (mgr.14373) 1599 : cluster [DBG] pgmap v1107: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:13:57.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:13:56 smithi086 bash[24289]: audit 2024-09-16T06:13:55.076127+0000 mgr.a (mgr.14373) 1597 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T06:13:57.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:13:56 smithi086 bash[24289]: cephadm 2024-09-16T06:13:55.078073+0000 mgr.a (mgr.14373) 1598 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T06:13:57.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:13:56 smithi086 bash[24289]: cluster 2024-09-16T06:13:55.150965+0000 mgr.a (mgr.14373) 1599 : cluster [DBG] pgmap v1107: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:13:57.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:13:56 smithi047 bash[22744]: audit 2024-09-16T06:13:55.076127+0000 mgr.a (mgr.14373) 1597 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T06:13:57.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:13:56 smithi047 bash[22744]: cephadm 2024-09-16T06:13:55.078073+0000 mgr.a (mgr.14373) 1598 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T06:13:57.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:13:56 smithi047 bash[22744]: cluster 2024-09-16T06:13:55.150965+0000 mgr.a (mgr.14373) 1599 : cluster [DBG] pgmap v1107: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:13:59.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:13:58 smithi157 bash[24585]: cluster 2024-09-16T06:13:57.153076+0000 mgr.a (mgr.14373) 1600 : cluster [DBG] pgmap v1108: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:13:59.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:13:58 smithi086 bash[24289]: cluster 2024-09-16T06:13:57.153076+0000 mgr.a (mgr.14373) 1600 : cluster [DBG] pgmap v1108: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:13:59.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:13:58 smithi047 bash[22744]: cluster 2024-09-16T06:13:57.153076+0000 mgr.a (mgr.14373) 1600 : cluster [DBG] pgmap v1108: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:13:59.190 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:13:59.191 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:13:59.191 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:13:59.942 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:13:59.942 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:13:59.942 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:13:59.942 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:13:59.942 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:14:01.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:14:00 smithi157 bash[24585]: cluster 2024-09-16T06:13:59.154001+0000 mgr.a (mgr.14373) 1601 : cluster [DBG] pgmap v1109: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:14:01.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:14:00 smithi157 bash[24585]: audit 2024-09-16T06:13:59.525974+0000 mgr.a (mgr.14373) 1602 : audit [DBG] from='client.47286 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:14:01.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:14:00 smithi086 bash[24289]: cluster 2024-09-16T06:13:59.154001+0000 mgr.a (mgr.14373) 1601 : cluster [DBG] pgmap v1109: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:14:01.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:14:00 smithi086 bash[24289]: audit 2024-09-16T06:13:59.525974+0000 mgr.a (mgr.14373) 1602 : audit [DBG] from='client.47286 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:14:01.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:14:00 smithi047 bash[22744]: cluster 2024-09-16T06:13:59.154001+0000 mgr.a (mgr.14373) 1601 : cluster [DBG] pgmap v1109: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:14:01.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:14:00 smithi047 bash[22744]: audit 2024-09-16T06:13:59.525974+0000 mgr.a (mgr.14373) 1602 : audit [DBG] from='client.47286 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:14:03.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:14:02 smithi157 bash[24585]: cluster 2024-09-16T06:14:01.154944+0000 mgr.a (mgr.14373) 1603 : cluster [DBG] pgmap v1110: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:14:03.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:14:02 smithi086 bash[24289]: cluster 2024-09-16T06:14:01.154944+0000 mgr.a (mgr.14373) 1603 : cluster [DBG] pgmap v1110: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:14:03.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:14:02 smithi047 bash[22744]: cluster 2024-09-16T06:14:01.154944+0000 mgr.a (mgr.14373) 1603 : cluster [DBG] pgmap v1110: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:14:04.943 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:14:04.944 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:14:04.944 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:14:05.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:14:04 smithi157 bash[24585]: cluster 2024-09-16T06:14:03.157192+0000 mgr.a (mgr.14373) 1604 : cluster [DBG] pgmap v1111: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:14:05.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:14:04 smithi086 bash[24289]: cluster 2024-09-16T06:14:03.157192+0000 mgr.a (mgr.14373) 1604 : cluster [DBG] pgmap v1111: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:14:05.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:14:04 smithi047 bash[22744]: cluster 2024-09-16T06:14:03.157192+0000 mgr.a (mgr.14373) 1604 : cluster [DBG] pgmap v1111: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:14:05.727 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:14:05.727 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:14:05.727 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:14:05.728 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:14:05.728 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:14:07.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:14:06 smithi157 bash[24585]: cluster 2024-09-16T06:14:05.157751+0000 mgr.a (mgr.14373) 1605 : cluster [DBG] pgmap v1112: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:14:07.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:14:06 smithi157 bash[24585]: audit 2024-09-16T06:14:05.284896+0000 mgr.a (mgr.14373) 1606 : audit [DBG] from='client.47364 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:14:07.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:14:06 smithi086 bash[24289]: cluster 2024-09-16T06:14:05.157751+0000 mgr.a (mgr.14373) 1605 : cluster [DBG] pgmap v1112: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:14:07.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:14:06 smithi086 bash[24289]: audit 2024-09-16T06:14:05.284896+0000 mgr.a (mgr.14373) 1606 : audit [DBG] from='client.47364 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:14:07.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:14:06 smithi047 bash[22744]: cluster 2024-09-16T06:14:05.157751+0000 mgr.a (mgr.14373) 1605 : cluster [DBG] pgmap v1112: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:14:07.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:14:06 smithi047 bash[22744]: audit 2024-09-16T06:14:05.284896+0000 mgr.a (mgr.14373) 1606 : audit [DBG] from='client.47364 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:14:09.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:14:08 smithi157 bash[24585]: cluster 2024-09-16T06:14:07.160030+0000 mgr.a (mgr.14373) 1607 : cluster [DBG] pgmap v1113: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:14:09.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:14:08 smithi086 bash[24289]: cluster 2024-09-16T06:14:07.160030+0000 mgr.a (mgr.14373) 1607 : cluster [DBG] pgmap v1113: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:14:09.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:14:08 smithi047 bash[22744]: cluster 2024-09-16T06:14:07.160030+0000 mgr.a (mgr.14373) 1607 : cluster [DBG] pgmap v1113: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:14:10.729 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:14:10.730 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:14:10.730 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:14:11.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:14:10 smithi157 bash[24585]: cluster 2024-09-16T06:14:09.160732+0000 mgr.a (mgr.14373) 1608 : cluster [DBG] pgmap v1114: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:14:11.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:14:10 smithi086 bash[24289]: cluster 2024-09-16T06:14:09.160732+0000 mgr.a (mgr.14373) 1608 : cluster [DBG] pgmap v1114: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:14:11.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:14:10 smithi047 bash[22744]: cluster 2024-09-16T06:14:09.160732+0000 mgr.a (mgr.14373) 1608 : cluster [DBG] pgmap v1114: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:14:11.464 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:14:11.464 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:14:11.464 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:14:11.464 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:14:11.464 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:14:13.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:14:12 smithi157 bash[24585]: audit 2024-09-16T06:14:11.060516+0000 mgr.a (mgr.14373) 1609 : audit [DBG] from='client.47439 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:14:13.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:14:12 smithi157 bash[24585]: cluster 2024-09-16T06:14:11.161227+0000 mgr.a (mgr.14373) 1610 : cluster [DBG] pgmap v1115: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:14:13.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:14:12 smithi086 bash[24289]: audit 2024-09-16T06:14:11.060516+0000 mgr.a (mgr.14373) 1609 : audit [DBG] from='client.47439 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:14:13.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:14:12 smithi086 bash[24289]: cluster 2024-09-16T06:14:11.161227+0000 mgr.a (mgr.14373) 1610 : cluster [DBG] pgmap v1115: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:14:13.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:14:12 smithi047 bash[22744]: audit 2024-09-16T06:14:11.060516+0000 mgr.a (mgr.14373) 1609 : audit [DBG] from='client.47439 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:14:13.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:14:12 smithi047 bash[22744]: cluster 2024-09-16T06:14:11.161227+0000 mgr.a (mgr.14373) 1610 : cluster [DBG] pgmap v1115: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:14:15.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:14:14 smithi157 bash[24585]: cluster 2024-09-16T06:14:13.163603+0000 mgr.a (mgr.14373) 1611 : cluster [DBG] pgmap v1116: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:14:15.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:14:14 smithi086 bash[24289]: cluster 2024-09-16T06:14:13.163603+0000 mgr.a (mgr.14373) 1611 : cluster [DBG] pgmap v1116: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:14:15.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:14:14 smithi047 bash[22744]: cluster 2024-09-16T06:14:13.163603+0000 mgr.a (mgr.14373) 1611 : cluster [DBG] pgmap v1116: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:14:16.465 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:14:16.466 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:14:16.466 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:14:17.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:14:16 smithi157 bash[24585]: cluster 2024-09-16T06:14:15.164348+0000 mgr.a (mgr.14373) 1612 : cluster [DBG] pgmap v1117: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-16T06:14:17.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:14:16 smithi086 bash[24289]: cluster 2024-09-16T06:14:15.164348+0000 mgr.a (mgr.14373) 1612 : cluster [DBG] pgmap v1117: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-16T06:14:17.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:14:16 smithi047 bash[22744]: cluster 2024-09-16T06:14:15.164348+0000 mgr.a (mgr.14373) 1612 : cluster [DBG] pgmap v1117: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-16T06:14:17.237 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:14:17.238 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:14:17.238 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:14:17.238 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:14:17.238 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:14:19.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:14:18 smithi157 bash[24585]: audit 2024-09-16T06:14:16.805754+0000 mgr.a (mgr.14373) 1613 : audit [DBG] from='client.47514 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:14:19.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:14:18 smithi157 bash[24585]: cluster 2024-09-16T06:14:17.165654+0000 mgr.a (mgr.14373) 1614 : cluster [DBG] pgmap v1118: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:14:19.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:14:18 smithi086 bash[24289]: audit 2024-09-16T06:14:16.805754+0000 mgr.a (mgr.14373) 1613 : audit [DBG] from='client.47514 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:14:19.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:14:18 smithi086 bash[24289]: cluster 2024-09-16T06:14:17.165654+0000 mgr.a (mgr.14373) 1614 : cluster [DBG] pgmap v1118: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:14:19.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:14:18 smithi047 bash[22744]: audit 2024-09-16T06:14:16.805754+0000 mgr.a (mgr.14373) 1613 : audit [DBG] from='client.47514 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:14:19.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:14:18 smithi047 bash[22744]: cluster 2024-09-16T06:14:17.165654+0000 mgr.a (mgr.14373) 1614 : cluster [DBG] pgmap v1118: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:14:21.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:14:20 smithi157 bash[24585]: cluster 2024-09-16T06:14:19.166424+0000 mgr.a (mgr.14373) 1615 : cluster [DBG] pgmap v1119: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T06:14:21.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:14:20 smithi086 bash[24289]: cluster 2024-09-16T06:14:19.166424+0000 mgr.a (mgr.14373) 1615 : cluster [DBG] pgmap v1119: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T06:14:21.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:14:20 smithi047 bash[22744]: cluster 2024-09-16T06:14:19.166424+0000 mgr.a (mgr.14373) 1615 : cluster [DBG] pgmap v1119: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T06:14:22.239 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:14:22.240 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:14:22.240 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:14:23.024 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:14:23.025 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:14:23.025 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:14:23.025 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:14:23.025 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:14:23.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:14:22 smithi157 bash[24585]: cluster 2024-09-16T06:14:21.167173+0000 mgr.a (mgr.14373) 1616 : cluster [DBG] pgmap v1120: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T06:14:23.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:14:22 smithi086 bash[24289]: cluster 2024-09-16T06:14:21.167173+0000 mgr.a (mgr.14373) 1616 : cluster [DBG] pgmap v1120: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T06:14:23.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:14:22 smithi047 bash[22744]: cluster 2024-09-16T06:14:21.167173+0000 mgr.a (mgr.14373) 1616 : cluster [DBG] pgmap v1120: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T06:14:24.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:14:23 smithi157 bash[24585]: audit 2024-09-16T06:14:22.580646+0000 mgr.a (mgr.14373) 1617 : audit [DBG] from='client.47592 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:14:24.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:14:23 smithi086 bash[24289]: audit 2024-09-16T06:14:22.580646+0000 mgr.a (mgr.14373) 1617 : audit [DBG] from='client.47592 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:14:24.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:14:23 smithi047 bash[22744]: audit 2024-09-16T06:14:22.580646+0000 mgr.a (mgr.14373) 1617 : audit [DBG] from='client.47592 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:14:25.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:14:24 smithi157 bash[24585]: cluster 2024-09-16T06:14:23.169922+0000 mgr.a (mgr.14373) 1618 : cluster [DBG] pgmap v1121: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:14:25.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:14:24 smithi086 bash[24289]: cluster 2024-09-16T06:14:23.169922+0000 mgr.a (mgr.14373) 1618 : cluster [DBG] pgmap v1121: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:14:25.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:14:24 smithi047 bash[22744]: cluster 2024-09-16T06:14:23.169922+0000 mgr.a (mgr.14373) 1618 : cluster [DBG] pgmap v1121: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:14:27.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:14:26 smithi157 bash[24585]: cluster 2024-09-16T06:14:25.170734+0000 mgr.a (mgr.14373) 1619 : cluster [DBG] pgmap v1122: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-16T06:14:27.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:14:26 smithi086 bash[24289]: cluster 2024-09-16T06:14:25.170734+0000 mgr.a (mgr.14373) 1619 : cluster [DBG] pgmap v1122: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-16T06:14:27.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:14:26 smithi047 bash[22744]: cluster 2024-09-16T06:14:25.170734+0000 mgr.a (mgr.14373) 1619 : cluster [DBG] pgmap v1122: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-16T06:14:28.026 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:14:28.027 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:14:28.027 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:14:28.798 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:14:28.799 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:14:28.799 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:14:28.799 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:14:28.799 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:14:29.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:14:28 smithi157 bash[24585]: cluster 2024-09-16T06:14:27.172735+0000 mgr.a (mgr.14373) 1620 : cluster [DBG] pgmap v1123: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-16T06:14:29.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:14:28 smithi086 bash[24289]: cluster 2024-09-16T06:14:27.172735+0000 mgr.a (mgr.14373) 1620 : cluster [DBG] pgmap v1123: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-16T06:14:29.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:14:28 smithi047 bash[22744]: cluster 2024-09-16T06:14:27.172735+0000 mgr.a (mgr.14373) 1620 : cluster [DBG] pgmap v1123: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-16T06:14:30.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:14:29 smithi157 bash[24585]: audit 2024-09-16T06:14:28.360779+0000 mgr.a (mgr.14373) 1621 : audit [DBG] from='client.47670 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:14:30.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:14:29 smithi086 bash[24289]: audit 2024-09-16T06:14:28.360779+0000 mgr.a (mgr.14373) 1621 : audit [DBG] from='client.47670 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:14:30.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:14:29 smithi047 bash[22744]: audit 2024-09-16T06:14:28.360779+0000 mgr.a (mgr.14373) 1621 : audit [DBG] from='client.47670 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:14:31.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:14:30 smithi157 bash[24585]: cluster 2024-09-16T06:14:29.173657+0000 mgr.a (mgr.14373) 1622 : cluster [DBG] pgmap v1124: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:14:31.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:14:30 smithi086 bash[24289]: cluster 2024-09-16T06:14:29.173657+0000 mgr.a (mgr.14373) 1622 : cluster [DBG] pgmap v1124: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:14:31.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:14:30 smithi047 bash[22744]: cluster 2024-09-16T06:14:29.173657+0000 mgr.a (mgr.14373) 1622 : cluster [DBG] pgmap v1124: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:14:33.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:14:32 smithi157 bash[24585]: cluster 2024-09-16T06:14:31.174458+0000 mgr.a (mgr.14373) 1623 : cluster [DBG] pgmap v1125: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:14:33.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:14:32 smithi086 bash[24289]: cluster 2024-09-16T06:14:31.174458+0000 mgr.a (mgr.14373) 1623 : cluster [DBG] pgmap v1125: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:14:33.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:14:32 smithi047 bash[22744]: cluster 2024-09-16T06:14:31.174458+0000 mgr.a (mgr.14373) 1623 : cluster [DBG] pgmap v1125: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:14:33.800 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:14:33.801 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:14:33.801 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:14:34.558 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:14:34.558 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:14:34.558 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:14:34.558 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:14:34.558 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:14:35.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:14:34 smithi157 bash[24585]: cluster 2024-09-16T06:14:33.176673+0000 mgr.a (mgr.14373) 1624 : cluster [DBG] pgmap v1126: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:14:35.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:14:34 smithi086 bash[24289]: cluster 2024-09-16T06:14:33.176673+0000 mgr.a (mgr.14373) 1624 : cluster [DBG] pgmap v1126: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:14:35.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:14:34 smithi047 bash[22744]: cluster 2024-09-16T06:14:33.176673+0000 mgr.a (mgr.14373) 1624 : cluster [DBG] pgmap v1126: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:14:36.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:14:35 smithi157 bash[24585]: audit 2024-09-16T06:14:34.140386+0000 mgr.a (mgr.14373) 1625 : audit [DBG] from='client.47745 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:14:36.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:14:35 smithi086 bash[24289]: audit 2024-09-16T06:14:34.140386+0000 mgr.a (mgr.14373) 1625 : audit [DBG] from='client.47745 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:14:36.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:14:35 smithi047 bash[22744]: audit 2024-09-16T06:14:34.140386+0000 mgr.a (mgr.14373) 1625 : audit [DBG] from='client.47745 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:14:37.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:14:36 smithi157 bash[24585]: cluster 2024-09-16T06:14:35.177631+0000 mgr.a (mgr.14373) 1626 : cluster [DBG] pgmap v1127: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:14:37.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:14:36 smithi086 bash[24289]: cluster 2024-09-16T06:14:35.177631+0000 mgr.a (mgr.14373) 1626 : cluster [DBG] pgmap v1127: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:14:37.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:14:36 smithi047 bash[22744]: cluster 2024-09-16T06:14:35.177631+0000 mgr.a (mgr.14373) 1626 : cluster [DBG] pgmap v1127: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:14:39.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:14:38 smithi157 bash[24585]: cluster 2024-09-16T06:14:37.179886+0000 mgr.a (mgr.14373) 1627 : cluster [DBG] pgmap v1128: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:14:39.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:14:38 smithi086 bash[24289]: cluster 2024-09-16T06:14:37.179886+0000 mgr.a (mgr.14373) 1627 : cluster [DBG] pgmap v1128: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:14:39.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:14:38 smithi047 bash[22744]: cluster 2024-09-16T06:14:37.179886+0000 mgr.a (mgr.14373) 1627 : cluster [DBG] pgmap v1128: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:14:39.559 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:14:39.560 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:14:39.560 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:14:40.340 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:14:40.341 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:14:40.341 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:14:40.341 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:14:40.341 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:14:41.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:14:40 smithi157 bash[24585]: cluster 2024-09-16T06:14:39.180656+0000 mgr.a (mgr.14373) 1628 : cluster [DBG] pgmap v1129: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:14:41.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:14:40 smithi086 bash[24289]: cluster 2024-09-16T06:14:39.180656+0000 mgr.a (mgr.14373) 1628 : cluster [DBG] pgmap v1129: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:14:41.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:14:40 smithi047 bash[22744]: cluster 2024-09-16T06:14:39.180656+0000 mgr.a (mgr.14373) 1628 : cluster [DBG] pgmap v1129: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:14:42.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:14:41 smithi157 bash[24585]: audit 2024-09-16T06:14:39.898829+0000 mgr.a (mgr.14373) 1629 : audit [DBG] from='client.47823 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:14:42.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:14:41 smithi086 bash[24289]: audit 2024-09-16T06:14:39.898829+0000 mgr.a (mgr.14373) 1629 : audit [DBG] from='client.47823 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:14:42.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:14:41 smithi047 bash[22744]: audit 2024-09-16T06:14:39.898829+0000 mgr.a (mgr.14373) 1629 : audit [DBG] from='client.47823 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:14:43.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:14:42 smithi157 bash[24585]: cluster 2024-09-16T06:14:41.181472+0000 mgr.a (mgr.14373) 1630 : cluster [DBG] pgmap v1130: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:14:43.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:14:42 smithi086 bash[24289]: cluster 2024-09-16T06:14:41.181472+0000 mgr.a (mgr.14373) 1630 : cluster [DBG] pgmap v1130: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:14:43.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:14:42 smithi047 bash[22744]: cluster 2024-09-16T06:14:41.181472+0000 mgr.a (mgr.14373) 1630 : cluster [DBG] pgmap v1130: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:14:45.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:14:44 smithi157 bash[24585]: cluster 2024-09-16T06:14:43.183715+0000 mgr.a (mgr.14373) 1631 : cluster [DBG] pgmap v1131: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:14:45.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:14:44 smithi086 bash[24289]: cluster 2024-09-16T06:14:43.183715+0000 mgr.a (mgr.14373) 1631 : cluster [DBG] pgmap v1131: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:14:45.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:14:44 smithi047 bash[22744]: cluster 2024-09-16T06:14:43.183715+0000 mgr.a (mgr.14373) 1631 : cluster [DBG] pgmap v1131: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:14:45.342 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:14:45.343 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:14:45.343 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:14:46.103 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:14:46.103 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:14:46.103 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:14:46.103 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:14:46.104 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:14:47.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:14:46 smithi157 bash[24585]: cluster 2024-09-16T06:14:45.184474+0000 mgr.a (mgr.14373) 1632 : cluster [DBG] pgmap v1132: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:14:47.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:14:46 smithi157 bash[24585]: audit 2024-09-16T06:14:45.681034+0000 mgr.a (mgr.14373) 1633 : audit [DBG] from='client.47898 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:14:47.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:14:46 smithi086 bash[24289]: cluster 2024-09-16T06:14:45.184474+0000 mgr.a (mgr.14373) 1632 : cluster [DBG] pgmap v1132: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:14:47.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:14:46 smithi086 bash[24289]: audit 2024-09-16T06:14:45.681034+0000 mgr.a (mgr.14373) 1633 : audit [DBG] from='client.47898 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:14:47.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:14:46 smithi047 bash[22744]: cluster 2024-09-16T06:14:45.184474+0000 mgr.a (mgr.14373) 1632 : cluster [DBG] pgmap v1132: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:14:47.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:14:46 smithi047 bash[22744]: audit 2024-09-16T06:14:45.681034+0000 mgr.a (mgr.14373) 1633 : audit [DBG] from='client.47898 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:14:49.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:14:48 smithi157 bash[24585]: cluster 2024-09-16T06:14:47.186788+0000 mgr.a (mgr.14373) 1634 : cluster [DBG] pgmap v1133: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:14:49.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:14:48 smithi086 bash[24289]: cluster 2024-09-16T06:14:47.186788+0000 mgr.a (mgr.14373) 1634 : cluster [DBG] pgmap v1133: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:14:49.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:14:48 smithi047 bash[22744]: cluster 2024-09-16T06:14:47.186788+0000 mgr.a (mgr.14373) 1634 : cluster [DBG] pgmap v1133: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:14:51.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:14:50 smithi157 bash[24585]: cluster 2024-09-16T06:14:49.187600+0000 mgr.a (mgr.14373) 1635 : cluster [DBG] pgmap v1134: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:14:51.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:14:50 smithi086 bash[24289]: cluster 2024-09-16T06:14:49.187600+0000 mgr.a (mgr.14373) 1635 : cluster [DBG] pgmap v1134: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:14:51.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:14:50 smithi047 bash[22744]: cluster 2024-09-16T06:14:49.187600+0000 mgr.a (mgr.14373) 1635 : cluster [DBG] pgmap v1134: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:14:51.104 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:14:51.105 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:14:51.106 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:14:51.863 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:14:51.863 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:14:51.863 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:14:51.863 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:14:51.863 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:14:53.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:14:52 smithi086 bash[24289]: cluster 2024-09-16T06:14:51.188380+0000 mgr.a (mgr.14373) 1636 : cluster [DBG] pgmap v1135: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:14:53.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:14:52 smithi086 bash[24289]: audit 2024-09-16T06:14:51.442235+0000 mgr.a (mgr.14373) 1637 : audit [DBG] from='client.47973 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:14:53.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:14:52 smithi047 bash[22744]: cluster 2024-09-16T06:14:51.188380+0000 mgr.a (mgr.14373) 1636 : cluster [DBG] pgmap v1135: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:14:53.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:14:52 smithi047 bash[22744]: audit 2024-09-16T06:14:51.442235+0000 mgr.a (mgr.14373) 1637 : audit [DBG] from='client.47973 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:14:53.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:14:52 smithi157 bash[24585]: cluster 2024-09-16T06:14:51.188380+0000 mgr.a (mgr.14373) 1636 : cluster [DBG] pgmap v1135: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:14:53.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:14:52 smithi157 bash[24585]: audit 2024-09-16T06:14:51.442235+0000 mgr.a (mgr.14373) 1637 : audit [DBG] from='client.47973 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:14:54.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:14:53 smithi157 bash[24585]: cluster 2024-09-16T06:14:53.191171+0000 mgr.a (mgr.14373) 1638 : cluster [DBG] pgmap v1136: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:14:54.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:14:53 smithi086 bash[24289]: cluster 2024-09-16T06:14:53.191171+0000 mgr.a (mgr.14373) 1638 : cluster [DBG] pgmap v1136: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:14:54.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:14:53 smithi047 bash[22744]: cluster 2024-09-16T06:14:53.191171+0000 mgr.a (mgr.14373) 1638 : cluster [DBG] pgmap v1136: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:14:55.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:14:55 smithi157 bash[24585]: audit 2024-09-16T06:14:55.136385+0000 mon.b (mon.2) 194 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T06:14:55.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:14:55 smithi086 bash[24289]: audit 2024-09-16T06:14:55.136385+0000 mon.b (mon.2) 194 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T06:14:55.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:14:55 smithi047 bash[22744]: audit 2024-09-16T06:14:55.136385+0000 mon.b (mon.2) 194 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T06:14:56.864 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:14:56.865 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:14:56.865 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:14:57.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:14:56 smithi157 bash[24585]: cluster 2024-09-16T06:14:55.191733+0000 mgr.a (mgr.14373) 1639 : cluster [DBG] pgmap v1137: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:14:57.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:14:56 smithi157 bash[24585]: audit 2024-09-16T06:14:55.783611+0000 mon.a (mon.0) 668 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:14:57.055 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:14:56 smithi157 bash[24585]: audit 2024-09-16T06:14:55.787821+0000 mon.a (mon.0) 669 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:14:57.055 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:14:56 smithi157 bash[24585]: audit 2024-09-16T06:14:55.794079+0000 mon.a (mon.0) 670 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:14:57.055 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:14:56 smithi157 bash[24585]: audit 2024-09-16T06:14:55.800887+0000 mon.a (mon.0) 671 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:14:57.055 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:14:56 smithi157 bash[24585]: audit 2024-09-16T06:14:56.447626+0000 mon.b (mon.2) 195 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T06:14:57.055 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:14:56 smithi157 bash[24585]: audit 2024-09-16T06:14:56.449707+0000 mon.b (mon.2) 196 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T06:14:57.055 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:14:56 smithi157 bash[24585]: audit 2024-09-16T06:14:56.463341+0000 mon.a (mon.0) 672 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:14:57.055 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:14:56 smithi157 bash[24585]: audit 2024-09-16T06:14:56.472759+0000 mon.b (mon.2) 197 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:14:57.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:14:56 smithi086 bash[24289]: cluster 2024-09-16T06:14:55.191733+0000 mgr.a (mgr.14373) 1639 : cluster [DBG] pgmap v1137: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:14:57.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:14:56 smithi086 bash[24289]: audit 2024-09-16T06:14:55.783611+0000 mon.a (mon.0) 668 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:14:57.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:14:56 smithi086 bash[24289]: audit 2024-09-16T06:14:55.787821+0000 mon.a (mon.0) 669 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:14:57.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:14:56 smithi086 bash[24289]: audit 2024-09-16T06:14:55.794079+0000 mon.a (mon.0) 670 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:14:57.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:14:56 smithi086 bash[24289]: audit 2024-09-16T06:14:55.800887+0000 mon.a (mon.0) 671 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:14:57.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:14:56 smithi086 bash[24289]: audit 2024-09-16T06:14:56.447626+0000 mon.b (mon.2) 195 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T06:14:57.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:14:56 smithi086 bash[24289]: audit 2024-09-16T06:14:56.449707+0000 mon.b (mon.2) 196 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T06:14:57.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:14:56 smithi086 bash[24289]: audit 2024-09-16T06:14:56.463341+0000 mon.a (mon.0) 672 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:14:57.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:14:56 smithi086 bash[24289]: audit 2024-09-16T06:14:56.472759+0000 mon.b (mon.2) 197 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:14:57.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:14:56 smithi047 bash[22744]: cluster 2024-09-16T06:14:55.191733+0000 mgr.a (mgr.14373) 1639 : cluster [DBG] pgmap v1137: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:14:57.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:14:56 smithi047 bash[22744]: audit 2024-09-16T06:14:55.783611+0000 mon.a (mon.0) 668 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:14:57.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:14:56 smithi047 bash[22744]: audit 2024-09-16T06:14:55.787821+0000 mon.a (mon.0) 669 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:14:57.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:14:56 smithi047 bash[22744]: audit 2024-09-16T06:14:55.794079+0000 mon.a (mon.0) 670 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:14:57.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:14:56 smithi047 bash[22744]: audit 2024-09-16T06:14:55.800887+0000 mon.a (mon.0) 671 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:14:57.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:14:56 smithi047 bash[22744]: audit 2024-09-16T06:14:56.447626+0000 mon.b (mon.2) 195 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T06:14:57.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:14:56 smithi047 bash[22744]: audit 2024-09-16T06:14:56.449707+0000 mon.b (mon.2) 196 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T06:14:57.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:14:56 smithi047 bash[22744]: audit 2024-09-16T06:14:56.463341+0000 mon.a (mon.0) 672 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:14:57.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:14:56 smithi047 bash[22744]: audit 2024-09-16T06:14:56.472759+0000 mon.b (mon.2) 197 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:14:57.589 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 06:14:57 smithi047 bash[22994]: debug 2024-09-16T06:14:57.194+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T06:14:57.589 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 06:14:57 smithi047 bash[22994]: debug 2024-09-16T06:14:57.206+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T06:14:57.590 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:14:57.590 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:14:57.590 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:14:57.590 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:14:57.590 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:14:58.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:14:57 smithi157 bash[24585]: audit 2024-09-16T06:14:56.477252+0000 mgr.a (mgr.14373) 1640 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:14:58.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:14:57 smithi086 bash[24289]: audit 2024-09-16T06:14:56.477252+0000 mgr.a (mgr.14373) 1640 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:14:58.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:14:57 smithi047 bash[22744]: audit 2024-09-16T06:14:56.477252+0000 mgr.a (mgr.14373) 1640 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:14:59.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:14:58 smithi157 bash[24585]: audit 2024-09-16T06:14:57.188970+0000 mgr.a (mgr.14373) 1641 : audit [DBG] from='client.48123 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:14:59.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:14:58 smithi157 bash[24585]: cluster 2024-09-16T06:14:57.193133+0000 mgr.a (mgr.14373) 1642 : cluster [DBG] pgmap v1138: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-16T06:14:59.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:14:58 smithi157 bash[24585]: audit 2024-09-16T06:14:57.201448+0000 mgr.a (mgr.14373) 1643 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T06:14:59.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:14:58 smithi157 bash[24585]: cephadm 2024-09-16T06:14:57.211797+0000 mgr.a (mgr.14373) 1644 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T06:14:59.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:14:58 smithi086 bash[24289]: audit 2024-09-16T06:14:57.188970+0000 mgr.a (mgr.14373) 1641 : audit [DBG] from='client.48123 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:14:59.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:14:58 smithi086 bash[24289]: cluster 2024-09-16T06:14:57.193133+0000 mgr.a (mgr.14373) 1642 : cluster [DBG] pgmap v1138: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-16T06:14:59.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:14:58 smithi086 bash[24289]: audit 2024-09-16T06:14:57.201448+0000 mgr.a (mgr.14373) 1643 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T06:14:59.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:14:58 smithi086 bash[24289]: cephadm 2024-09-16T06:14:57.211797+0000 mgr.a (mgr.14373) 1644 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T06:14:59.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:14:58 smithi047 bash[22744]: audit 2024-09-16T06:14:57.188970+0000 mgr.a (mgr.14373) 1641 : audit [DBG] from='client.48123 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:14:59.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:14:58 smithi047 bash[22744]: cluster 2024-09-16T06:14:57.193133+0000 mgr.a (mgr.14373) 1642 : cluster [DBG] pgmap v1138: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-16T06:14:59.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:14:58 smithi047 bash[22744]: audit 2024-09-16T06:14:57.201448+0000 mgr.a (mgr.14373) 1643 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T06:14:59.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:14:58 smithi047 bash[22744]: cephadm 2024-09-16T06:14:57.211797+0000 mgr.a (mgr.14373) 1644 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T06:15:01.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:15:00 smithi157 bash[24585]: cluster 2024-09-16T06:14:59.194123+0000 mgr.a (mgr.14373) 1645 : cluster [DBG] pgmap v1139: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T06:15:01.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:15:00 smithi086 bash[24289]: cluster 2024-09-16T06:14:59.194123+0000 mgr.a (mgr.14373) 1645 : cluster [DBG] pgmap v1139: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T06:15:01.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:15:00 smithi047 bash[22744]: cluster 2024-09-16T06:14:59.194123+0000 mgr.a (mgr.14373) 1645 : cluster [DBG] pgmap v1139: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T06:15:02.592 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:15:02.592 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:15:02.593 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:15:03.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:15:02 smithi157 bash[24585]: cluster 2024-09-16T06:15:01.194825+0000 mgr.a (mgr.14373) 1646 : cluster [DBG] pgmap v1140: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T06:15:03.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:15:02 smithi086 bash[24289]: cluster 2024-09-16T06:15:01.194825+0000 mgr.a (mgr.14373) 1646 : cluster [DBG] pgmap v1140: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T06:15:03.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:15:02 smithi047 bash[22744]: cluster 2024-09-16T06:15:01.194825+0000 mgr.a (mgr.14373) 1646 : cluster [DBG] pgmap v1140: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T06:15:03.328 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:15:03.328 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:15:03.328 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:15:03.328 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:15:03.328 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:15:05.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:15:04 smithi086 bash[24289]: audit 2024-09-16T06:15:02.922523+0000 mgr.a (mgr.14373) 1647 : audit [DBG] from='client.48234 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:15:05.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:15:04 smithi086 bash[24289]: cluster 2024-09-16T06:15:03.196124+0000 mgr.a (mgr.14373) 1648 : cluster [DBG] pgmap v1141: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:15:05.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:15:04 smithi047 bash[22744]: audit 2024-09-16T06:15:02.922523+0000 mgr.a (mgr.14373) 1647 : audit [DBG] from='client.48234 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:15:05.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:15:04 smithi047 bash[22744]: cluster 2024-09-16T06:15:03.196124+0000 mgr.a (mgr.14373) 1648 : cluster [DBG] pgmap v1141: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:15:05.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:15:04 smithi157 bash[24585]: audit 2024-09-16T06:15:02.922523+0000 mgr.a (mgr.14373) 1647 : audit [DBG] from='client.48234 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:15:05.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:15:04 smithi157 bash[24585]: cluster 2024-09-16T06:15:03.196124+0000 mgr.a (mgr.14373) 1648 : cluster [DBG] pgmap v1141: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:15:07.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:15:06 smithi086 bash[24289]: cluster 2024-09-16T06:15:05.196971+0000 mgr.a (mgr.14373) 1649 : cluster [DBG] pgmap v1142: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:15:07.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:15:06 smithi047 bash[22744]: cluster 2024-09-16T06:15:05.196971+0000 mgr.a (mgr.14373) 1649 : cluster [DBG] pgmap v1142: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:15:07.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:15:06 smithi157 bash[24585]: cluster 2024-09-16T06:15:05.196971+0000 mgr.a (mgr.14373) 1649 : cluster [DBG] pgmap v1142: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:15:08.330 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:15:08.330 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:15:08.330 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:15:09.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:15:08 smithi086 bash[24289]: cluster 2024-09-16T06:15:07.199217+0000 mgr.a (mgr.14373) 1650 : cluster [DBG] pgmap v1143: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:15:09.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:15:08 smithi047 bash[22744]: cluster 2024-09-16T06:15:07.199217+0000 mgr.a (mgr.14373) 1650 : cluster [DBG] pgmap v1143: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:15:09.106 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:15:09.106 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:15:09.106 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:15:09.106 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:15:09.107 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:15:09.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:15:08 smithi157 bash[24585]: cluster 2024-09-16T06:15:07.199217+0000 mgr.a (mgr.14373) 1650 : cluster [DBG] pgmap v1143: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:15:10.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:15:09 smithi086 bash[24289]: audit 2024-09-16T06:15:08.667412+0000 mgr.a (mgr.14373) 1651 : audit [DBG] from='client.48312 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:15:10.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:15:09 smithi086 bash[24289]: cluster 2024-09-16T06:15:09.200305+0000 mgr.a (mgr.14373) 1652 : cluster [DBG] pgmap v1144: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T06:15:10.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:15:09 smithi047 bash[22744]: audit 2024-09-16T06:15:08.667412+0000 mgr.a (mgr.14373) 1651 : audit [DBG] from='client.48312 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:15:10.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:15:09 smithi047 bash[22744]: cluster 2024-09-16T06:15:09.200305+0000 mgr.a (mgr.14373) 1652 : cluster [DBG] pgmap v1144: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T06:15:10.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:15:09 smithi157 bash[24585]: audit 2024-09-16T06:15:08.667412+0000 mgr.a (mgr.14373) 1651 : audit [DBG] from='client.48312 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:15:10.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:15:09 smithi157 bash[24585]: cluster 2024-09-16T06:15:09.200305+0000 mgr.a (mgr.14373) 1652 : cluster [DBG] pgmap v1144: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T06:15:12.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:15:12 smithi157 bash[24585]: cluster 2024-09-16T06:15:11.201293+0000 mgr.a (mgr.14373) 1653 : cluster [DBG] pgmap v1145: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T06:15:12.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:15:12 smithi086 bash[24289]: cluster 2024-09-16T06:15:11.201293+0000 mgr.a (mgr.14373) 1653 : cluster [DBG] pgmap v1145: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T06:15:12.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:15:12 smithi047 bash[22744]: cluster 2024-09-16T06:15:11.201293+0000 mgr.a (mgr.14373) 1653 : cluster [DBG] pgmap v1145: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T06:15:14.108 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:15:14.109 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:15:14.109 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:15:14.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:15:14 smithi157 bash[24585]: cluster 2024-09-16T06:15:13.203658+0000 mgr.a (mgr.14373) 1654 : cluster [DBG] pgmap v1146: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.6 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:15:14.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:15:14 smithi086 bash[24289]: cluster 2024-09-16T06:15:13.203658+0000 mgr.a (mgr.14373) 1654 : cluster [DBG] pgmap v1146: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.6 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:15:14.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:15:14 smithi047 bash[22744]: cluster 2024-09-16T06:15:13.203658+0000 mgr.a (mgr.14373) 1654 : cluster [DBG] pgmap v1146: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.6 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:15:14.885 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:15:14.885 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:15:14.885 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:15:14.885 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:15:14.885 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:15:15.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:15:15 smithi157 bash[24585]: audit 2024-09-16T06:15:14.452539+0000 mgr.a (mgr.14373) 1655 : audit [DBG] from='client.48390 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:15:15.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:15:15 smithi086 bash[24289]: audit 2024-09-16T06:15:14.452539+0000 mgr.a (mgr.14373) 1655 : audit [DBG] from='client.48390 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:15:15.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:15:15 smithi047 bash[22744]: audit 2024-09-16T06:15:14.452539+0000 mgr.a (mgr.14373) 1655 : audit [DBG] from='client.48390 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:15:16.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:15:16 smithi157 bash[24585]: cluster 2024-09-16T06:15:15.204556+0000 mgr.a (mgr.14373) 1656 : cluster [DBG] pgmap v1147: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:15:16.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:15:16 smithi086 bash[24289]: cluster 2024-09-16T06:15:15.204556+0000 mgr.a (mgr.14373) 1656 : cluster [DBG] pgmap v1147: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:15:16.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:15:16 smithi047 bash[22744]: cluster 2024-09-16T06:15:15.204556+0000 mgr.a (mgr.14373) 1656 : cluster [DBG] pgmap v1147: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:15:18.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:15:18 smithi157 bash[24585]: cluster 2024-09-16T06:15:17.206720+0000 mgr.a (mgr.14373) 1657 : cluster [DBG] pgmap v1148: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:15:18.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:15:18 smithi086 bash[24289]: cluster 2024-09-16T06:15:17.206720+0000 mgr.a (mgr.14373) 1657 : cluster [DBG] pgmap v1148: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:15:18.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:15:18 smithi047 bash[22744]: cluster 2024-09-16T06:15:17.206720+0000 mgr.a (mgr.14373) 1657 : cluster [DBG] pgmap v1148: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:15:19.886 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:15:19.887 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:15:19.887 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:15:20.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:15:20 smithi157 bash[24585]: cluster 2024-09-16T06:15:19.207468+0000 mgr.a (mgr.14373) 1658 : cluster [DBG] pgmap v1149: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:15:20.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:15:20 smithi086 bash[24289]: cluster 2024-09-16T06:15:19.207468+0000 mgr.a (mgr.14373) 1658 : cluster [DBG] pgmap v1149: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:15:20.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:15:20 smithi047 bash[22744]: cluster 2024-09-16T06:15:19.207468+0000 mgr.a (mgr.14373) 1658 : cluster [DBG] pgmap v1149: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:15:20.659 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:15:20.660 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:15:20.660 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:15:20.660 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:15:20.660 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:15:21.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:15:21 smithi157 bash[24585]: audit 2024-09-16T06:15:20.225409+0000 mgr.a (mgr.14373) 1659 : audit [DBG] from='client.48465 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:15:21.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:15:21 smithi086 bash[24289]: audit 2024-09-16T06:15:20.225409+0000 mgr.a (mgr.14373) 1659 : audit [DBG] from='client.48465 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:15:21.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:15:21 smithi047 bash[22744]: audit 2024-09-16T06:15:20.225409+0000 mgr.a (mgr.14373) 1659 : audit [DBG] from='client.48465 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:15:22.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:15:22 smithi157 bash[24585]: cluster 2024-09-16T06:15:21.208356+0000 mgr.a (mgr.14373) 1660 : cluster [DBG] pgmap v1150: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:15:22.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:15:22 smithi086 bash[24289]: cluster 2024-09-16T06:15:21.208356+0000 mgr.a (mgr.14373) 1660 : cluster [DBG] pgmap v1150: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:15:22.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:15:22 smithi047 bash[22744]: cluster 2024-09-16T06:15:21.208356+0000 mgr.a (mgr.14373) 1660 : cluster [DBG] pgmap v1150: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:15:24.555 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:15:24 smithi157 bash[24585]: cluster 2024-09-16T06:15:23.210604+0000 mgr.a (mgr.14373) 1661 : cluster [DBG] pgmap v1151: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:15:24.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:15:24 smithi086 bash[24289]: cluster 2024-09-16T06:15:23.210604+0000 mgr.a (mgr.14373) 1661 : cluster [DBG] pgmap v1151: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:15:24.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:15:24 smithi047 bash[22744]: cluster 2024-09-16T06:15:23.210604+0000 mgr.a (mgr.14373) 1661 : cluster [DBG] pgmap v1151: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:15:25.661 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:15:25.662 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:15:25.662 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:15:26.406 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:15:26.407 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:15:26.407 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:15:26.407 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:15:26.407 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:15:26.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:15:26 smithi157 bash[24585]: cluster 2024-09-16T06:15:25.211395+0000 mgr.a (mgr.14373) 1662 : cluster [DBG] pgmap v1152: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:15:26.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:15:26 smithi086 bash[24289]: cluster 2024-09-16T06:15:25.211395+0000 mgr.a (mgr.14373) 1662 : cluster [DBG] pgmap v1152: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:15:26.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:15:26 smithi047 bash[22744]: cluster 2024-09-16T06:15:25.211395+0000 mgr.a (mgr.14373) 1662 : cluster [DBG] pgmap v1152: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:15:27.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:15:27 smithi086 bash[24289]: audit 2024-09-16T06:15:25.998367+0000 mgr.a (mgr.14373) 1663 : audit [DBG] from='client.48537 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:15:27.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:15:27 smithi047 bash[22744]: audit 2024-09-16T06:15:25.998367+0000 mgr.a (mgr.14373) 1663 : audit [DBG] from='client.48537 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:15:27.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:15:27 smithi157 bash[24585]: audit 2024-09-16T06:15:25.998367+0000 mgr.a (mgr.14373) 1663 : audit [DBG] from='client.48537 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:15:28.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:15:28 smithi086 bash[24289]: cluster 2024-09-16T06:15:27.213673+0000 mgr.a (mgr.14373) 1664 : cluster [DBG] pgmap v1153: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:15:28.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:15:28 smithi047 bash[22744]: cluster 2024-09-16T06:15:27.213673+0000 mgr.a (mgr.14373) 1664 : cluster [DBG] pgmap v1153: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:15:28.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:15:28 smithi157 bash[24585]: cluster 2024-09-16T06:15:27.213673+0000 mgr.a (mgr.14373) 1664 : cluster [DBG] pgmap v1153: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:15:30.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:15:30 smithi086 bash[24289]: cluster 2024-09-16T06:15:29.214465+0000 mgr.a (mgr.14373) 1665 : cluster [DBG] pgmap v1154: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:15:30.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:15:30 smithi047 bash[22744]: cluster 2024-09-16T06:15:29.214465+0000 mgr.a (mgr.14373) 1665 : cluster [DBG] pgmap v1154: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:15:30.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:15:30 smithi157 bash[24585]: cluster 2024-09-16T06:15:29.214465+0000 mgr.a (mgr.14373) 1665 : cluster [DBG] pgmap v1154: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:15:31.408 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:15:31.409 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:15:31.409 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:15:32.172 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:15:32.172 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:15:32.172 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:15:32.173 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:15:32.173 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:15:32.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:15:32 smithi086 bash[24289]: cluster 2024-09-16T06:15:31.215188+0000 mgr.a (mgr.14373) 1666 : cluster [DBG] pgmap v1155: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:15:32.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:15:32 smithi086 bash[24289]: audit 2024-09-16T06:15:31.746147+0000 mgr.a (mgr.14373) 1667 : audit [DBG] from='client.48609 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:15:32.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:15:32 smithi047 bash[22744]: cluster 2024-09-16T06:15:31.215188+0000 mgr.a (mgr.14373) 1666 : cluster [DBG] pgmap v1155: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:15:32.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:15:32 smithi047 bash[22744]: audit 2024-09-16T06:15:31.746147+0000 mgr.a (mgr.14373) 1667 : audit [DBG] from='client.48609 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:15:32.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:15:32 smithi157 bash[24585]: cluster 2024-09-16T06:15:31.215188+0000 mgr.a (mgr.14373) 1666 : cluster [DBG] pgmap v1155: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:15:32.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:15:32 smithi157 bash[24585]: audit 2024-09-16T06:15:31.746147+0000 mgr.a (mgr.14373) 1667 : audit [DBG] from='client.48609 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:15:34.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:15:34 smithi047 bash[22744]: cluster 2024-09-16T06:15:33.217867+0000 mgr.a (mgr.14373) 1668 : cluster [DBG] pgmap v1156: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:15:34.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:15:34 smithi157 bash[24585]: cluster 2024-09-16T06:15:33.217867+0000 mgr.a (mgr.14373) 1668 : cluster [DBG] pgmap v1156: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:15:34.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:15:34 smithi086 bash[24289]: cluster 2024-09-16T06:15:33.217867+0000 mgr.a (mgr.14373) 1668 : cluster [DBG] pgmap v1156: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:15:36.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:15:36 smithi047 bash[22744]: cluster 2024-09-16T06:15:35.218667+0000 mgr.a (mgr.14373) 1669 : cluster [DBG] pgmap v1157: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:15:36.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:15:36 smithi157 bash[24585]: cluster 2024-09-16T06:15:35.218667+0000 mgr.a (mgr.14373) 1669 : cluster [DBG] pgmap v1157: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:15:36.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:15:36 smithi086 bash[24289]: cluster 2024-09-16T06:15:35.218667+0000 mgr.a (mgr.14373) 1669 : cluster [DBG] pgmap v1157: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:15:37.173 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:15:37.174 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:15:37.175 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:15:37.928 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:15:37.928 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:15:37.928 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:15:37.928 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:15:37.928 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:15:38.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:15:38 smithi047 bash[22744]: cluster 2024-09-16T06:15:37.219898+0000 mgr.a (mgr.14373) 1670 : cluster [DBG] pgmap v1158: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:15:38.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:15:38 smithi047 bash[22744]: audit 2024-09-16T06:15:37.510948+0000 mgr.a (mgr.14373) 1671 : audit [DBG] from='client.48687 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:15:38.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:15:38 smithi157 bash[24585]: cluster 2024-09-16T06:15:37.219898+0000 mgr.a (mgr.14373) 1670 : cluster [DBG] pgmap v1158: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:15:38.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:15:38 smithi157 bash[24585]: audit 2024-09-16T06:15:37.510948+0000 mgr.a (mgr.14373) 1671 : audit [DBG] from='client.48687 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:15:38.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:15:38 smithi086 bash[24289]: cluster 2024-09-16T06:15:37.219898+0000 mgr.a (mgr.14373) 1670 : cluster [DBG] pgmap v1158: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:15:38.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:15:38 smithi086 bash[24289]: audit 2024-09-16T06:15:37.510948+0000 mgr.a (mgr.14373) 1671 : audit [DBG] from='client.48687 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:15:40.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:15:40 smithi047 bash[22744]: cluster 2024-09-16T06:15:39.220758+0000 mgr.a (mgr.14373) 1672 : cluster [DBG] pgmap v1159: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T06:15:40.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:15:40 smithi157 bash[24585]: cluster 2024-09-16T06:15:39.220758+0000 mgr.a (mgr.14373) 1672 : cluster [DBG] pgmap v1159: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T06:15:40.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:15:40 smithi086 bash[24289]: cluster 2024-09-16T06:15:39.220758+0000 mgr.a (mgr.14373) 1672 : cluster [DBG] pgmap v1159: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T06:15:42.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:15:42 smithi047 bash[22744]: cluster 2024-09-16T06:15:41.221531+0000 mgr.a (mgr.14373) 1673 : cluster [DBG] pgmap v1160: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T06:15:42.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:15:42 smithi157 bash[24585]: cluster 2024-09-16T06:15:41.221531+0000 mgr.a (mgr.14373) 1673 : cluster [DBG] pgmap v1160: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T06:15:42.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:15:42 smithi086 bash[24289]: cluster 2024-09-16T06:15:41.221531+0000 mgr.a (mgr.14373) 1673 : cluster [DBG] pgmap v1160: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T06:15:42.929 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:15:42.930 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:15:42.930 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:15:43.706 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:15:43.706 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:15:43.706 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:15:43.706 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:15:43.706 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:15:44.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:15:44 smithi157 bash[24585]: cluster 2024-09-16T06:15:43.223647+0000 mgr.a (mgr.14373) 1674 : cluster [DBG] pgmap v1161: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:15:44.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:15:44 smithi157 bash[24585]: audit 2024-09-16T06:15:43.265799+0000 mgr.a (mgr.14373) 1675 : audit [DBG] from='client.48762 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:15:44.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:15:44 smithi086 bash[24289]: cluster 2024-09-16T06:15:43.223647+0000 mgr.a (mgr.14373) 1674 : cluster [DBG] pgmap v1161: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:15:44.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:15:44 smithi086 bash[24289]: audit 2024-09-16T06:15:43.265799+0000 mgr.a (mgr.14373) 1675 : audit [DBG] from='client.48762 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:15:44.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:15:44 smithi047 bash[22744]: cluster 2024-09-16T06:15:43.223647+0000 mgr.a (mgr.14373) 1674 : cluster [DBG] pgmap v1161: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:15:44.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:15:44 smithi047 bash[22744]: audit 2024-09-16T06:15:43.265799+0000 mgr.a (mgr.14373) 1675 : audit [DBG] from='client.48762 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:15:46.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:15:46 smithi157 bash[24585]: cluster 2024-09-16T06:15:45.224541+0000 mgr.a (mgr.14373) 1676 : cluster [DBG] pgmap v1162: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:15:46.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:15:46 smithi086 bash[24289]: cluster 2024-09-16T06:15:45.224541+0000 mgr.a (mgr.14373) 1676 : cluster [DBG] pgmap v1162: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:15:46.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:15:46 smithi047 bash[22744]: cluster 2024-09-16T06:15:45.224541+0000 mgr.a (mgr.14373) 1676 : cluster [DBG] pgmap v1162: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:15:48.707 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:15:48.708 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:15:48.708 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:15:48.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:15:48 smithi157 bash[24585]: cluster 2024-09-16T06:15:47.226683+0000 mgr.a (mgr.14373) 1677 : cluster [DBG] pgmap v1163: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:15:48.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:15:48 smithi086 bash[24289]: cluster 2024-09-16T06:15:47.226683+0000 mgr.a (mgr.14373) 1677 : cluster [DBG] pgmap v1163: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:15:48.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:15:48 smithi047 bash[22744]: cluster 2024-09-16T06:15:47.226683+0000 mgr.a (mgr.14373) 1677 : cluster [DBG] pgmap v1163: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:15:49.475 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:15:49.476 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:15:49.476 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:15:49.476 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:15:49.476 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:15:50.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:15:50 smithi157 bash[24585]: audit 2024-09-16T06:15:49.043855+0000 mgr.a (mgr.14373) 1678 : audit [DBG] from='client.48840 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:15:50.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:15:50 smithi157 bash[24585]: cluster 2024-09-16T06:15:49.227164+0000 mgr.a (mgr.14373) 1679 : cluster [DBG] pgmap v1164: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:15:50.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:15:50 smithi086 bash[24289]: audit 2024-09-16T06:15:49.043855+0000 mgr.a (mgr.14373) 1678 : audit [DBG] from='client.48840 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:15:50.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:15:50 smithi086 bash[24289]: cluster 2024-09-16T06:15:49.227164+0000 mgr.a (mgr.14373) 1679 : cluster [DBG] pgmap v1164: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:15:50.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:15:50 smithi047 bash[22744]: audit 2024-09-16T06:15:49.043855+0000 mgr.a (mgr.14373) 1678 : audit [DBG] from='client.48840 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:15:50.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:15:50 smithi047 bash[22744]: cluster 2024-09-16T06:15:49.227164+0000 mgr.a (mgr.14373) 1679 : cluster [DBG] pgmap v1164: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:15:52.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:15:52 smithi157 bash[24585]: cluster 2024-09-16T06:15:51.228025+0000 mgr.a (mgr.14373) 1680 : cluster [DBG] pgmap v1165: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:15:52.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:15:52 smithi086 bash[24289]: cluster 2024-09-16T06:15:51.228025+0000 mgr.a (mgr.14373) 1680 : cluster [DBG] pgmap v1165: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:15:52.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:15:52 smithi047 bash[22744]: cluster 2024-09-16T06:15:51.228025+0000 mgr.a (mgr.14373) 1680 : cluster [DBG] pgmap v1165: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:15:54.477 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:15:54.478 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:15:54.478 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:15:54.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:15:54 smithi157 bash[24585]: cluster 2024-09-16T06:15:53.230206+0000 mgr.a (mgr.14373) 1681 : cluster [DBG] pgmap v1166: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:15:54.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:15:54 smithi086 bash[24289]: cluster 2024-09-16T06:15:53.230206+0000 mgr.a (mgr.14373) 1681 : cluster [DBG] pgmap v1166: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:15:54.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:15:54 smithi047 bash[22744]: cluster 2024-09-16T06:15:53.230206+0000 mgr.a (mgr.14373) 1681 : cluster [DBG] pgmap v1166: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:15:55.211 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:15:55.212 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:15:55.212 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:15:55.212 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:15:55.212 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:15:55.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:15:55 smithi157 bash[24585]: audit 2024-09-16T06:15:54.803285+0000 mgr.a (mgr.14373) 1682 : audit [DBG] from='client.48918 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:15:55.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:15:55 smithi086 bash[24289]: audit 2024-09-16T06:15:54.803285+0000 mgr.a (mgr.14373) 1682 : audit [DBG] from='client.48918 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:15:55.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:15:55 smithi047 bash[22744]: audit 2024-09-16T06:15:54.803285+0000 mgr.a (mgr.14373) 1682 : audit [DBG] from='client.48918 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:15:56.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:15:56 smithi157 bash[24585]: cluster 2024-09-16T06:15:55.230836+0000 mgr.a (mgr.14373) 1683 : cluster [DBG] pgmap v1167: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:15:56.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:15:56 smithi086 bash[24289]: cluster 2024-09-16T06:15:55.230836+0000 mgr.a (mgr.14373) 1683 : cluster [DBG] pgmap v1167: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:15:56.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:15:56 smithi047 bash[22744]: cluster 2024-09-16T06:15:55.230836+0000 mgr.a (mgr.14373) 1683 : cluster [DBG] pgmap v1167: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:15:57.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:15:57 smithi157 bash[24585]: audit 2024-09-16T06:15:57.261678+0000 mon.b (mon.2) 198 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T06:15:57.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:15:57 smithi086 bash[24289]: audit 2024-09-16T06:15:57.261678+0000 mon.b (mon.2) 198 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T06:15:57.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:15:57 smithi047 bash[22744]: audit 2024-09-16T06:15:57.261678+0000 mon.b (mon.2) 198 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T06:15:58.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:15:58 smithi157 bash[24585]: cluster 2024-09-16T06:15:57.232915+0000 mgr.a (mgr.14373) 1684 : cluster [DBG] pgmap v1168: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:15:58.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:15:58 smithi157 bash[24585]: audit 2024-09-16T06:15:58.106826+0000 mon.b (mon.2) 199 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T06:15:58.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:15:58 smithi157 bash[24585]: audit 2024-09-16T06:15:58.109074+0000 mon.b (mon.2) 200 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T06:15:58.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:15:58 smithi157 bash[24585]: audit 2024-09-16T06:15:58.122202+0000 mon.a (mon.0) 673 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:15:58.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:15:58 smithi157 bash[24585]: audit 2024-09-16T06:15:58.125875+0000 mon.b (mon.2) 201 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:15:58.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:15:58 smithi086 bash[24289]: cluster 2024-09-16T06:15:57.232915+0000 mgr.a (mgr.14373) 1684 : cluster [DBG] pgmap v1168: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:15:58.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:15:58 smithi086 bash[24289]: audit 2024-09-16T06:15:58.106826+0000 mon.b (mon.2) 199 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T06:15:58.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:15:58 smithi086 bash[24289]: audit 2024-09-16T06:15:58.109074+0000 mon.b (mon.2) 200 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T06:15:58.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:15:58 smithi086 bash[24289]: audit 2024-09-16T06:15:58.122202+0000 mon.a (mon.0) 673 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:15:58.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:15:58 smithi086 bash[24289]: audit 2024-09-16T06:15:58.125875+0000 mon.b (mon.2) 201 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:15:58.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:15:58 smithi047 bash[22744]: cluster 2024-09-16T06:15:57.232915+0000 mgr.a (mgr.14373) 1684 : cluster [DBG] pgmap v1168: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:15:58.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:15:58 smithi047 bash[22744]: audit 2024-09-16T06:15:58.106826+0000 mon.b (mon.2) 199 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T06:15:58.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:15:58 smithi047 bash[22744]: audit 2024-09-16T06:15:58.109074+0000 mon.b (mon.2) 200 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T06:15:58.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:15:58 smithi047 bash[22744]: audit 2024-09-16T06:15:58.122202+0000 mon.a (mon.0) 673 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:15:58.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:15:58 smithi047 bash[22744]: audit 2024-09-16T06:15:58.125875+0000 mon.b (mon.2) 201 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:15:59.339 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 06:15:58 smithi047 bash[22994]: debug 2024-09-16T06:15:58.853+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T06:15:59.339 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 06:15:58 smithi047 bash[22994]: debug 2024-09-16T06:15:58.857+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T06:15:59.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:15:59 smithi157 bash[24585]: audit 2024-09-16T06:15:58.130164+0000 mgr.a (mgr.14373) 1685 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:15:59.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:15:59 smithi086 bash[24289]: audit 2024-09-16T06:15:58.130164+0000 mgr.a (mgr.14373) 1685 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:15:59.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:15:59 smithi047 bash[22744]: audit 2024-09-16T06:15:58.130164+0000 mgr.a (mgr.14373) 1685 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:16:00.213 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:16:00.214 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:16:00.214 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:16:00.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:16:00 smithi157 bash[24585]: audit 2024-09-16T06:15:58.856511+0000 mgr.a (mgr.14373) 1686 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T06:16:00.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:16:00 smithi157 bash[24585]: cephadm 2024-09-16T06:15:58.858669+0000 mgr.a (mgr.14373) 1687 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T06:16:00.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:16:00 smithi157 bash[24585]: cluster 2024-09-16T06:15:59.233886+0000 mgr.a (mgr.14373) 1688 : cluster [DBG] pgmap v1169: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:16:00.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:16:00 smithi086 bash[24289]: audit 2024-09-16T06:15:58.856511+0000 mgr.a (mgr.14373) 1686 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T06:16:00.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:16:00 smithi086 bash[24289]: cephadm 2024-09-16T06:15:58.858669+0000 mgr.a (mgr.14373) 1687 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T06:16:00.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:16:00 smithi086 bash[24289]: cluster 2024-09-16T06:15:59.233886+0000 mgr.a (mgr.14373) 1688 : cluster [DBG] pgmap v1169: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:16:00.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:16:00 smithi047 bash[22744]: audit 2024-09-16T06:15:58.856511+0000 mgr.a (mgr.14373) 1686 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T06:16:00.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:16:00 smithi047 bash[22744]: cephadm 2024-09-16T06:15:58.858669+0000 mgr.a (mgr.14373) 1687 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T06:16:00.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:16:00 smithi047 bash[22744]: cluster 2024-09-16T06:15:59.233886+0000 mgr.a (mgr.14373) 1688 : cluster [DBG] pgmap v1169: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:16:00.951 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:16:00.951 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:16:00.951 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:16:00.951 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:16:00.951 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:16:01.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:16:01 smithi157 bash[24585]: audit 2024-09-16T06:16:00.544111+0000 mgr.a (mgr.14373) 1689 : audit [DBG] from='client.49104 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:16:01.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:16:01 smithi086 bash[24289]: audit 2024-09-16T06:16:00.544111+0000 mgr.a (mgr.14373) 1689 : audit [DBG] from='client.49104 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:16:01.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:16:01 smithi047 bash[22744]: audit 2024-09-16T06:16:00.544111+0000 mgr.a (mgr.14373) 1689 : audit [DBG] from='client.49104 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:16:03.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:16:02 smithi157 bash[24585]: cluster 2024-09-16T06:16:01.234857+0000 mgr.a (mgr.14373) 1690 : cluster [DBG] pgmap v1170: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:16:03.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:16:02 smithi086 bash[24289]: cluster 2024-09-16T06:16:01.234857+0000 mgr.a (mgr.14373) 1690 : cluster [DBG] pgmap v1170: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:16:03.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:16:02 smithi047 bash[22744]: cluster 2024-09-16T06:16:01.234857+0000 mgr.a (mgr.14373) 1690 : cluster [DBG] pgmap v1170: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:16:05.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:16:04 smithi157 bash[24585]: cluster 2024-09-16T06:16:03.237224+0000 mgr.a (mgr.14373) 1691 : cluster [DBG] pgmap v1171: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:16:05.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:16:04 smithi086 bash[24289]: cluster 2024-09-16T06:16:03.237224+0000 mgr.a (mgr.14373) 1691 : cluster [DBG] pgmap v1171: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:16:05.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:16:04 smithi047 bash[22744]: cluster 2024-09-16T06:16:03.237224+0000 mgr.a (mgr.14373) 1691 : cluster [DBG] pgmap v1171: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:16:05.952 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:16:05.953 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:16:05.953 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:16:06.698 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:16:06.698 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:16:06.698 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:16:06.699 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:16:06.699 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:16:07.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:16:06 smithi157 bash[24585]: cluster 2024-09-16T06:16:05.238167+0000 mgr.a (mgr.14373) 1692 : cluster [DBG] pgmap v1172: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:16:07.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:16:06 smithi086 bash[24289]: cluster 2024-09-16T06:16:05.238167+0000 mgr.a (mgr.14373) 1692 : cluster [DBG] pgmap v1172: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:16:07.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:16:06 smithi047 bash[22744]: cluster 2024-09-16T06:16:05.238167+0000 mgr.a (mgr.14373) 1692 : cluster [DBG] pgmap v1172: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:16:08.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:16:07 smithi157 bash[24585]: audit 2024-09-16T06:16:06.284812+0000 mgr.a (mgr.14373) 1693 : audit [DBG] from='client.49182 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:16:08.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:16:07 smithi086 bash[24289]: audit 2024-09-16T06:16:06.284812+0000 mgr.a (mgr.14373) 1693 : audit [DBG] from='client.49182 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:16:08.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:16:07 smithi047 bash[22744]: audit 2024-09-16T06:16:06.284812+0000 mgr.a (mgr.14373) 1693 : audit [DBG] from='client.49182 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:16:09.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:16:08 smithi157 bash[24585]: cluster 2024-09-16T06:16:07.240807+0000 mgr.a (mgr.14373) 1694 : cluster [DBG] pgmap v1173: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.3 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:16:09.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:16:08 smithi086 bash[24289]: cluster 2024-09-16T06:16:07.240807+0000 mgr.a (mgr.14373) 1694 : cluster [DBG] pgmap v1173: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.3 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:16:09.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:16:08 smithi047 bash[22744]: cluster 2024-09-16T06:16:07.240807+0000 mgr.a (mgr.14373) 1694 : cluster [DBG] pgmap v1173: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.3 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:16:11.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:16:10 smithi157 bash[24585]: cluster 2024-09-16T06:16:09.241769+0000 mgr.a (mgr.14373) 1695 : cluster [DBG] pgmap v1174: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 6.4 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T06:16:11.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:16:10 smithi086 bash[24289]: cluster 2024-09-16T06:16:09.241769+0000 mgr.a (mgr.14373) 1695 : cluster [DBG] pgmap v1174: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 6.4 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T06:16:11.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:16:10 smithi047 bash[22744]: cluster 2024-09-16T06:16:09.241769+0000 mgr.a (mgr.14373) 1695 : cluster [DBG] pgmap v1174: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 6.4 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T06:16:11.700 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:16:11.700 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:16:11.700 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:16:12.450 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:16:12.451 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:16:12.451 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:16:12.451 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:16:12.451 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:16:13.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:16:12 smithi157 bash[24585]: cluster 2024-09-16T06:16:11.242744+0000 mgr.a (mgr.14373) 1696 : cluster [DBG] pgmap v1175: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 6.4 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T06:16:13.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:16:12 smithi086 bash[24289]: cluster 2024-09-16T06:16:11.242744+0000 mgr.a (mgr.14373) 1696 : cluster [DBG] pgmap v1175: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 6.4 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T06:16:13.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:16:12 smithi047 bash[22744]: cluster 2024-09-16T06:16:11.242744+0000 mgr.a (mgr.14373) 1696 : cluster [DBG] pgmap v1175: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 6.4 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T06:16:14.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:16:13 smithi157 bash[24585]: audit 2024-09-16T06:16:12.036041+0000 mgr.a (mgr.14373) 1697 : audit [DBG] from='client.49260 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:16:14.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:16:13 smithi086 bash[24289]: audit 2024-09-16T06:16:12.036041+0000 mgr.a (mgr.14373) 1697 : audit [DBG] from='client.49260 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:16:14.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:16:13 smithi047 bash[22744]: audit 2024-09-16T06:16:12.036041+0000 mgr.a (mgr.14373) 1697 : audit [DBG] from='client.49260 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:16:15.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:16:14 smithi157 bash[24585]: cluster 2024-09-16T06:16:13.245563+0000 mgr.a (mgr.14373) 1698 : cluster [DBG] pgmap v1176: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:16:15.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:16:14 smithi086 bash[24289]: cluster 2024-09-16T06:16:13.245563+0000 mgr.a (mgr.14373) 1698 : cluster [DBG] pgmap v1176: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:16:15.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:16:14 smithi047 bash[22744]: cluster 2024-09-16T06:16:13.245563+0000 mgr.a (mgr.14373) 1698 : cluster [DBG] pgmap v1176: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:16:17.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:16:16 smithi157 bash[24585]: cluster 2024-09-16T06:16:15.246365+0000 mgr.a (mgr.14373) 1699 : cluster [DBG] pgmap v1177: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:16:17.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:16:16 smithi086 bash[24289]: cluster 2024-09-16T06:16:15.246365+0000 mgr.a (mgr.14373) 1699 : cluster [DBG] pgmap v1177: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:16:17.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:16:16 smithi047 bash[22744]: cluster 2024-09-16T06:16:15.246365+0000 mgr.a (mgr.14373) 1699 : cluster [DBG] pgmap v1177: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:16:17.452 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:16:17.453 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:16:17.453 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:16:18.197 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:16:18.198 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:16:18.198 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:16:18.198 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:16:18.198 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:16:19.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:16:18 smithi157 bash[24585]: cluster 2024-09-16T06:16:17.248365+0000 mgr.a (mgr.14373) 1700 : cluster [DBG] pgmap v1178: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:16:19.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:16:18 smithi157 bash[24585]: audit 2024-09-16T06:16:17.789776+0000 mgr.a (mgr.14373) 1701 : audit [DBG] from='client.49338 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:16:19.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:16:18 smithi086 bash[24289]: cluster 2024-09-16T06:16:17.248365+0000 mgr.a (mgr.14373) 1700 : cluster [DBG] pgmap v1178: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:16:19.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:16:18 smithi086 bash[24289]: audit 2024-09-16T06:16:17.789776+0000 mgr.a (mgr.14373) 1701 : audit [DBG] from='client.49338 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:16:19.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:16:18 smithi047 bash[22744]: cluster 2024-09-16T06:16:17.248365+0000 mgr.a (mgr.14373) 1700 : cluster [DBG] pgmap v1178: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:16:19.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:16:18 smithi047 bash[22744]: audit 2024-09-16T06:16:17.789776+0000 mgr.a (mgr.14373) 1701 : audit [DBG] from='client.49338 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:16:21.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:16:20 smithi157 bash[24585]: cluster 2024-09-16T06:16:19.249330+0000 mgr.a (mgr.14373) 1702 : cluster [DBG] pgmap v1179: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-09-16T06:16:21.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:16:20 smithi086 bash[24289]: cluster 2024-09-16T06:16:19.249330+0000 mgr.a (mgr.14373) 1702 : cluster [DBG] pgmap v1179: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-09-16T06:16:21.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:16:20 smithi047 bash[22744]: cluster 2024-09-16T06:16:19.249330+0000 mgr.a (mgr.14373) 1702 : cluster [DBG] pgmap v1179: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-09-16T06:16:23.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:16:22 smithi157 bash[24585]: cluster 2024-09-16T06:16:21.250123+0000 mgr.a (mgr.14373) 1703 : cluster [DBG] pgmap v1180: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-09-16T06:16:23.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:16:22 smithi086 bash[24289]: cluster 2024-09-16T06:16:21.250123+0000 mgr.a (mgr.14373) 1703 : cluster [DBG] pgmap v1180: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-09-16T06:16:23.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:16:22 smithi047 bash[22744]: cluster 2024-09-16T06:16:21.250123+0000 mgr.a (mgr.14373) 1703 : cluster [DBG] pgmap v1180: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-09-16T06:16:23.199 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:16:23.199 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:16:23.200 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:16:23.947 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:16:23.947 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:16:23.948 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:16:23.948 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:16:23.948 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:16:25.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:16:24 smithi157 bash[24585]: cluster 2024-09-16T06:16:23.251636+0000 mgr.a (mgr.14373) 1704 : cluster [DBG] pgmap v1181: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.4 KiB/s rd, 2 op/s 2024-09-16T06:16:25.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:16:24 smithi157 bash[24585]: audit 2024-09-16T06:16:23.534695+0000 mgr.a (mgr.14373) 1705 : audit [DBG] from='client.49413 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:16:25.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:16:24 smithi086 bash[24289]: cluster 2024-09-16T06:16:23.251636+0000 mgr.a (mgr.14373) 1704 : cluster [DBG] pgmap v1181: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.4 KiB/s rd, 2 op/s 2024-09-16T06:16:25.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:16:24 smithi086 bash[24289]: audit 2024-09-16T06:16:23.534695+0000 mgr.a (mgr.14373) 1705 : audit [DBG] from='client.49413 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:16:25.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:16:24 smithi047 bash[22744]: cluster 2024-09-16T06:16:23.251636+0000 mgr.a (mgr.14373) 1704 : cluster [DBG] pgmap v1181: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.4 KiB/s rd, 2 op/s 2024-09-16T06:16:25.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:16:24 smithi047 bash[22744]: audit 2024-09-16T06:16:23.534695+0000 mgr.a (mgr.14373) 1705 : audit [DBG] from='client.49413 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:16:27.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:16:26 smithi157 bash[24585]: cluster 2024-09-16T06:16:25.252595+0000 mgr.a (mgr.14373) 1706 : cluster [DBG] pgmap v1182: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:16:27.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:16:26 smithi086 bash[24289]: cluster 2024-09-16T06:16:25.252595+0000 mgr.a (mgr.14373) 1706 : cluster [DBG] pgmap v1182: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:16:27.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:16:26 smithi047 bash[22744]: cluster 2024-09-16T06:16:25.252595+0000 mgr.a (mgr.14373) 1706 : cluster [DBG] pgmap v1182: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:16:28.949 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:16:28.950 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:16:28.950 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:16:29.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:16:28 smithi157 bash[24585]: cluster 2024-09-16T06:16:27.254913+0000 mgr.a (mgr.14373) 1707 : cluster [DBG] pgmap v1183: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:16:29.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:16:28 smithi086 bash[24289]: cluster 2024-09-16T06:16:27.254913+0000 mgr.a (mgr.14373) 1707 : cluster [DBG] pgmap v1183: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:16:29.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:16:28 smithi047 bash[22744]: cluster 2024-09-16T06:16:27.254913+0000 mgr.a (mgr.14373) 1707 : cluster [DBG] pgmap v1183: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:16:29.725 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:16:29.725 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:16:29.725 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:16:29.725 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:16:29.726 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:16:31.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:16:30 smithi157 bash[24585]: cluster 2024-09-16T06:16:29.255672+0000 mgr.a (mgr.14373) 1708 : cluster [DBG] pgmap v1184: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:16:31.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:16:30 smithi157 bash[24585]: audit 2024-09-16T06:16:29.285847+0000 mgr.a (mgr.14373) 1709 : audit [DBG] from='client.49491 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:16:31.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:16:30 smithi086 bash[24289]: cluster 2024-09-16T06:16:29.255672+0000 mgr.a (mgr.14373) 1708 : cluster [DBG] pgmap v1184: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:16:31.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:16:30 smithi086 bash[24289]: audit 2024-09-16T06:16:29.285847+0000 mgr.a (mgr.14373) 1709 : audit [DBG] from='client.49491 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:16:31.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:16:30 smithi047 bash[22744]: cluster 2024-09-16T06:16:29.255672+0000 mgr.a (mgr.14373) 1708 : cluster [DBG] pgmap v1184: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:16:31.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:16:30 smithi047 bash[22744]: audit 2024-09-16T06:16:29.285847+0000 mgr.a (mgr.14373) 1709 : audit [DBG] from='client.49491 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:16:33.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:16:32 smithi157 bash[24585]: cluster 2024-09-16T06:16:31.256663+0000 mgr.a (mgr.14373) 1710 : cluster [DBG] pgmap v1185: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:16:33.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:16:32 smithi086 bash[24289]: cluster 2024-09-16T06:16:31.256663+0000 mgr.a (mgr.14373) 1710 : cluster [DBG] pgmap v1185: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:16:33.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:16:32 smithi047 bash[22744]: cluster 2024-09-16T06:16:31.256663+0000 mgr.a (mgr.14373) 1710 : cluster [DBG] pgmap v1185: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:16:34.727 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:16:34.728 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:16:34.728 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:16:35.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:16:34 smithi157 bash[24585]: cluster 2024-09-16T06:16:33.259035+0000 mgr.a (mgr.14373) 1711 : cluster [DBG] pgmap v1186: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:16:35.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:16:34 smithi086 bash[24289]: cluster 2024-09-16T06:16:33.259035+0000 mgr.a (mgr.14373) 1711 : cluster [DBG] pgmap v1186: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:16:35.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:16:34 smithi047 bash[22744]: cluster 2024-09-16T06:16:33.259035+0000 mgr.a (mgr.14373) 1711 : cluster [DBG] pgmap v1186: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:16:35.512 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:16:35.513 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:16:35.513 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:16:35.513 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:16:35.513 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:16:37.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:16:36 smithi086 bash[24289]: audit 2024-09-16T06:16:35.065042+0000 mgr.a (mgr.14373) 1712 : audit [DBG] from='client.49569 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:16:37.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:16:36 smithi086 bash[24289]: cluster 2024-09-16T06:16:35.259752+0000 mgr.a (mgr.14373) 1713 : cluster [DBG] pgmap v1187: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:16:37.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:16:36 smithi047 bash[22744]: audit 2024-09-16T06:16:35.065042+0000 mgr.a (mgr.14373) 1712 : audit [DBG] from='client.49569 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:16:37.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:16:36 smithi047 bash[22744]: cluster 2024-09-16T06:16:35.259752+0000 mgr.a (mgr.14373) 1713 : cluster [DBG] pgmap v1187: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:16:37.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:16:36 smithi157 bash[24585]: audit 2024-09-16T06:16:35.065042+0000 mgr.a (mgr.14373) 1712 : audit [DBG] from='client.49569 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:16:37.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:16:36 smithi157 bash[24585]: cluster 2024-09-16T06:16:35.259752+0000 mgr.a (mgr.14373) 1713 : cluster [DBG] pgmap v1187: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:16:39.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:16:38 smithi086 bash[24289]: cluster 2024-09-16T06:16:37.262022+0000 mgr.a (mgr.14373) 1714 : cluster [DBG] pgmap v1188: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:16:39.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:16:38 smithi047 bash[22744]: cluster 2024-09-16T06:16:37.262022+0000 mgr.a (mgr.14373) 1714 : cluster [DBG] pgmap v1188: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:16:39.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:16:38 smithi157 bash[24585]: cluster 2024-09-16T06:16:37.262022+0000 mgr.a (mgr.14373) 1714 : cluster [DBG] pgmap v1188: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:16:40.514 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:16:40.515 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:16:40.515 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:16:41.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:16:40 smithi086 bash[24289]: cluster 2024-09-16T06:16:39.262820+0000 mgr.a (mgr.14373) 1715 : cluster [DBG] pgmap v1189: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:16:41.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:16:40 smithi047 bash[22744]: cluster 2024-09-16T06:16:39.262820+0000 mgr.a (mgr.14373) 1715 : cluster [DBG] pgmap v1189: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:16:41.285 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:16:41.285 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:16:41.285 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:16:41.285 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:16:41.285 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:16:41.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:16:40 smithi157 bash[24585]: cluster 2024-09-16T06:16:39.262820+0000 mgr.a (mgr.14373) 1715 : cluster [DBG] pgmap v1189: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:16:43.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:16:42 smithi047 bash[22744]: audit 2024-09-16T06:16:40.856429+0000 mgr.a (mgr.14373) 1716 : audit [DBG] from='client.49647 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:16:43.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:16:42 smithi047 bash[22744]: cluster 2024-09-16T06:16:41.263333+0000 mgr.a (mgr.14373) 1717 : cluster [DBG] pgmap v1190: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:16:43.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:16:42 smithi157 bash[24585]: audit 2024-09-16T06:16:40.856429+0000 mgr.a (mgr.14373) 1716 : audit [DBG] from='client.49647 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:16:43.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:16:42 smithi157 bash[24585]: cluster 2024-09-16T06:16:41.263333+0000 mgr.a (mgr.14373) 1717 : cluster [DBG] pgmap v1190: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:16:43.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:16:42 smithi086 bash[24289]: audit 2024-09-16T06:16:40.856429+0000 mgr.a (mgr.14373) 1716 : audit [DBG] from='client.49647 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:16:43.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:16:42 smithi086 bash[24289]: cluster 2024-09-16T06:16:41.263333+0000 mgr.a (mgr.14373) 1717 : cluster [DBG] pgmap v1190: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:16:45.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:16:44 smithi047 bash[22744]: cluster 2024-09-16T06:16:43.265515+0000 mgr.a (mgr.14373) 1718 : cluster [DBG] pgmap v1191: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:16:45.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:16:44 smithi157 bash[24585]: cluster 2024-09-16T06:16:43.265515+0000 mgr.a (mgr.14373) 1718 : cluster [DBG] pgmap v1191: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:16:45.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:16:44 smithi086 bash[24289]: cluster 2024-09-16T06:16:43.265515+0000 mgr.a (mgr.14373) 1718 : cluster [DBG] pgmap v1191: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:16:46.286 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:16:46.287 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:16:46.287 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:16:47.069 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:16:47.069 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:16:47.069 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:16:47.069 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:16:47.070 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:16:47.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:16:46 smithi047 bash[22744]: cluster 2024-09-16T06:16:45.266302+0000 mgr.a (mgr.14373) 1719 : cluster [DBG] pgmap v1192: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:16:47.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:16:46 smithi157 bash[24585]: cluster 2024-09-16T06:16:45.266302+0000 mgr.a (mgr.14373) 1719 : cluster [DBG] pgmap v1192: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:16:47.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:16:46 smithi086 bash[24289]: cluster 2024-09-16T06:16:45.266302+0000 mgr.a (mgr.14373) 1719 : cluster [DBG] pgmap v1192: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:16:48.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:16:47 smithi047 bash[22744]: audit 2024-09-16T06:16:46.627171+0000 mgr.a (mgr.14373) 1720 : audit [DBG] from='client.49719 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:16:48.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:16:47 smithi157 bash[24585]: audit 2024-09-16T06:16:46.627171+0000 mgr.a (mgr.14373) 1720 : audit [DBG] from='client.49719 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:16:48.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:16:47 smithi086 bash[24289]: audit 2024-09-16T06:16:46.627171+0000 mgr.a (mgr.14373) 1720 : audit [DBG] from='client.49719 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:16:49.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:16:48 smithi047 bash[22744]: cluster 2024-09-16T06:16:47.269126+0000 mgr.a (mgr.14373) 1721 : cluster [DBG] pgmap v1193: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:16:49.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:16:48 smithi157 bash[24585]: cluster 2024-09-16T06:16:47.269126+0000 mgr.a (mgr.14373) 1721 : cluster [DBG] pgmap v1193: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:16:49.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:16:48 smithi086 bash[24289]: cluster 2024-09-16T06:16:47.269126+0000 mgr.a (mgr.14373) 1721 : cluster [DBG] pgmap v1193: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:16:50.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:16:49 smithi157 bash[24585]: cluster 2024-09-16T06:16:49.269918+0000 mgr.a (mgr.14373) 1722 : cluster [DBG] pgmap v1194: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:16:50.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:16:49 smithi086 bash[24289]: cluster 2024-09-16T06:16:49.269918+0000 mgr.a (mgr.14373) 1722 : cluster [DBG] pgmap v1194: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:16:50.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:16:49 smithi047 bash[22744]: cluster 2024-09-16T06:16:49.269918+0000 mgr.a (mgr.14373) 1722 : cluster [DBG] pgmap v1194: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:16:52.071 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:16:52.072 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:16:52.072 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:16:52.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:16:52 smithi047 bash[22744]: cluster 2024-09-16T06:16:51.270848+0000 mgr.a (mgr.14373) 1723 : cluster [DBG] pgmap v1195: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T06:16:52.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:16:52 smithi157 bash[24585]: cluster 2024-09-16T06:16:51.270848+0000 mgr.a (mgr.14373) 1723 : cluster [DBG] pgmap v1195: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T06:16:52.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:16:52 smithi086 bash[24289]: cluster 2024-09-16T06:16:51.270848+0000 mgr.a (mgr.14373) 1723 : cluster [DBG] pgmap v1195: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T06:16:52.845 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:16:52.845 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:16:52.845 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:16:52.845 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:16:52.845 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:16:53.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:16:53 smithi047 bash[22744]: audit 2024-09-16T06:16:52.411453+0000 mgr.a (mgr.14373) 1724 : audit [DBG] from='client.49794 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:16:53.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:16:53 smithi157 bash[24585]: audit 2024-09-16T06:16:52.411453+0000 mgr.a (mgr.14373) 1724 : audit [DBG] from='client.49794 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:16:53.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:16:53 smithi086 bash[24289]: audit 2024-09-16T06:16:52.411453+0000 mgr.a (mgr.14373) 1724 : audit [DBG] from='client.49794 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:16:54.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:16:54 smithi047 bash[22744]: cluster 2024-09-16T06:16:53.273617+0000 mgr.a (mgr.14373) 1725 : cluster [DBG] pgmap v1196: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:16:54.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:16:54 smithi157 bash[24585]: cluster 2024-09-16T06:16:53.273617+0000 mgr.a (mgr.14373) 1725 : cluster [DBG] pgmap v1196: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:16:54.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:16:54 smithi086 bash[24289]: cluster 2024-09-16T06:16:53.273617+0000 mgr.a (mgr.14373) 1725 : cluster [DBG] pgmap v1196: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:16:56.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:16:56 smithi157 bash[24585]: cluster 2024-09-16T06:16:55.274549+0000 mgr.a (mgr.14373) 1726 : cluster [DBG] pgmap v1197: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:16:56.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:16:56 smithi086 bash[24289]: cluster 2024-09-16T06:16:55.274549+0000 mgr.a (mgr.14373) 1726 : cluster [DBG] pgmap v1197: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:16:56.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:16:56 smithi047 bash[22744]: cluster 2024-09-16T06:16:55.274549+0000 mgr.a (mgr.14373) 1726 : cluster [DBG] pgmap v1197: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:16:57.846 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:16:57.847 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:16:57.847 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:16:58.581 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:16:58.581 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:16:58.582 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:16:58.582 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:16:58.582 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:16:58.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:16:58 smithi157 bash[24585]: cluster 2024-09-16T06:16:57.276646+0000 mgr.a (mgr.14373) 1727 : cluster [DBG] pgmap v1198: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:16:58.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:16:58 smithi086 bash[24289]: cluster 2024-09-16T06:16:57.276646+0000 mgr.a (mgr.14373) 1727 : cluster [DBG] pgmap v1198: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:16:58.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:16:58 smithi047 bash[22744]: cluster 2024-09-16T06:16:57.276646+0000 mgr.a (mgr.14373) 1727 : cluster [DBG] pgmap v1198: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:16:59.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:16:59 smithi157 bash[24585]: audit 2024-09-16T06:16:58.174682+0000 mgr.a (mgr.14373) 1728 : audit [DBG] from='client.49866 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:16:59.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:16:59 smithi157 bash[24585]: audit 2024-09-16T06:16:58.911319+0000 mon.b (mon.2) 202 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T06:16:59.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:16:59 smithi086 bash[24289]: audit 2024-09-16T06:16:58.174682+0000 mgr.a (mgr.14373) 1728 : audit [DBG] from='client.49866 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:16:59.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:16:59 smithi086 bash[24289]: audit 2024-09-16T06:16:58.911319+0000 mon.b (mon.2) 202 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T06:16:59.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:16:59 smithi047 bash[22744]: audit 2024-09-16T06:16:58.174682+0000 mgr.a (mgr.14373) 1728 : audit [DBG] from='client.49866 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:16:59.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:16:59 smithi047 bash[22744]: audit 2024-09-16T06:16:58.911319+0000 mon.b (mon.2) 202 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T06:17:00.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:17:00 smithi157 bash[24585]: cluster 2024-09-16T06:16:59.277687+0000 mgr.a (mgr.14373) 1729 : cluster [DBG] pgmap v1199: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:17:00.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:17:00 smithi157 bash[24585]: audit 2024-09-16T06:16:59.735659+0000 mon.b (mon.2) 203 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T06:17:00.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:17:00 smithi157 bash[24585]: audit 2024-09-16T06:16:59.737610+0000 mon.b (mon.2) 204 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T06:17:00.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:17:00 smithi157 bash[24585]: audit 2024-09-16T06:16:59.751055+0000 mon.a (mon.0) 674 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:17:00.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:17:00 smithi157 bash[24585]: audit 2024-09-16T06:16:59.754507+0000 mon.b (mon.2) 205 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:17:00.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:17:00 smithi157 bash[24585]: audit 2024-09-16T06:16:59.759059+0000 mgr.a (mgr.14373) 1730 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:17:00.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:17:00 smithi086 bash[24289]: cluster 2024-09-16T06:16:59.277687+0000 mgr.a (mgr.14373) 1729 : cluster [DBG] pgmap v1199: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:17:00.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:17:00 smithi086 bash[24289]: audit 2024-09-16T06:16:59.735659+0000 mon.b (mon.2) 203 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T06:17:00.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:17:00 smithi086 bash[24289]: audit 2024-09-16T06:16:59.737610+0000 mon.b (mon.2) 204 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T06:17:00.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:17:00 smithi086 bash[24289]: audit 2024-09-16T06:16:59.751055+0000 mon.a (mon.0) 674 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:17:00.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:17:00 smithi086 bash[24289]: audit 2024-09-16T06:16:59.754507+0000 mon.b (mon.2) 205 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:17:00.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:17:00 smithi086 bash[24289]: audit 2024-09-16T06:16:59.759059+0000 mgr.a (mgr.14373) 1730 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:17:00.839 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 06:17:00 smithi047 bash[22994]: debug 2024-09-16T06:17:00.459+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T06:17:00.839 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 06:17:00 smithi047 bash[22994]: debug 2024-09-16T06:17:00.463+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T06:17:00.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:17:00 smithi047 bash[22744]: cluster 2024-09-16T06:16:59.277687+0000 mgr.a (mgr.14373) 1729 : cluster [DBG] pgmap v1199: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:17:00.840 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:17:00 smithi047 bash[22744]: audit 2024-09-16T06:16:59.735659+0000 mon.b (mon.2) 203 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T06:17:00.840 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:17:00 smithi047 bash[22744]: audit 2024-09-16T06:16:59.737610+0000 mon.b (mon.2) 204 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T06:17:00.840 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:17:00 smithi047 bash[22744]: audit 2024-09-16T06:16:59.751055+0000 mon.a (mon.0) 674 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:17:00.840 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:17:00 smithi047 bash[22744]: audit 2024-09-16T06:16:59.754507+0000 mon.b (mon.2) 205 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:17:00.840 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:17:00 smithi047 bash[22744]: audit 2024-09-16T06:16:59.759059+0000 mgr.a (mgr.14373) 1730 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:17:01.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:17:01 smithi047 bash[22744]: audit 2024-09-16T06:17:00.464758+0000 mgr.a (mgr.14373) 1731 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T06:17:01.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:17:01 smithi047 bash[22744]: cephadm 2024-09-16T06:17:00.466567+0000 mgr.a (mgr.14373) 1732 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T06:17:01.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:17:01 smithi157 bash[24585]: audit 2024-09-16T06:17:00.464758+0000 mgr.a (mgr.14373) 1731 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T06:17:01.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:17:01 smithi157 bash[24585]: cephadm 2024-09-16T06:17:00.466567+0000 mgr.a (mgr.14373) 1732 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T06:17:01.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:17:01 smithi086 bash[24289]: audit 2024-09-16T06:17:00.464758+0000 mgr.a (mgr.14373) 1731 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T06:17:01.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:17:01 smithi086 bash[24289]: cephadm 2024-09-16T06:17:00.466567+0000 mgr.a (mgr.14373) 1732 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T06:17:02.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:17:02 smithi157 bash[24585]: cluster 2024-09-16T06:17:01.278857+0000 mgr.a (mgr.14373) 1733 : cluster [DBG] pgmap v1200: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:17:02.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:17:02 smithi086 bash[24289]: cluster 2024-09-16T06:17:01.278857+0000 mgr.a (mgr.14373) 1733 : cluster [DBG] pgmap v1200: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:17:02.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:17:02 smithi047 bash[22744]: cluster 2024-09-16T06:17:01.278857+0000 mgr.a (mgr.14373) 1733 : cluster [DBG] pgmap v1200: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:17:03.583 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:17:03.584 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:17:03.584 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:17:04.347 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:17:04.347 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:17:04.347 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:17:04.347 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:17:04.347 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:17:04.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:17:04 smithi157 bash[24585]: cluster 2024-09-16T06:17:03.281242+0000 mgr.a (mgr.14373) 1734 : cluster [DBG] pgmap v1201: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:17:04.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:17:04 smithi086 bash[24289]: cluster 2024-09-16T06:17:03.281242+0000 mgr.a (mgr.14373) 1734 : cluster [DBG] pgmap v1201: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:17:04.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:17:04 smithi047 bash[22744]: cluster 2024-09-16T06:17:03.281242+0000 mgr.a (mgr.14373) 1734 : cluster [DBG] pgmap v1201: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:17:05.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:17:05 smithi157 bash[24585]: audit 2024-09-16T06:17:03.921002+0000 mgr.a (mgr.14373) 1735 : audit [DBG] from='client.50052 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:17:05.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:17:05 smithi086 bash[24289]: audit 2024-09-16T06:17:03.921002+0000 mgr.a (mgr.14373) 1735 : audit [DBG] from='client.50052 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:17:05.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:17:05 smithi047 bash[22744]: audit 2024-09-16T06:17:03.921002+0000 mgr.a (mgr.14373) 1735 : audit [DBG] from='client.50052 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:17:06.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:17:06 smithi157 bash[24585]: cluster 2024-09-16T06:17:05.282234+0000 mgr.a (mgr.14373) 1736 : cluster [DBG] pgmap v1202: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:17:06.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:17:06 smithi086 bash[24289]: cluster 2024-09-16T06:17:05.282234+0000 mgr.a (mgr.14373) 1736 : cluster [DBG] pgmap v1202: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:17:06.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:17:06 smithi047 bash[22744]: cluster 2024-09-16T06:17:05.282234+0000 mgr.a (mgr.14373) 1736 : cluster [DBG] pgmap v1202: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:17:08.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:17:08 smithi157 bash[24585]: cluster 2024-09-16T06:17:07.284437+0000 mgr.a (mgr.14373) 1737 : cluster [DBG] pgmap v1203: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:17:08.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:17:08 smithi086 bash[24289]: cluster 2024-09-16T06:17:07.284437+0000 mgr.a (mgr.14373) 1737 : cluster [DBG] pgmap v1203: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:17:08.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:17:08 smithi047 bash[22744]: cluster 2024-09-16T06:17:07.284437+0000 mgr.a (mgr.14373) 1737 : cluster [DBG] pgmap v1203: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:17:09.348 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:17:09.349 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:17:09.350 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:17:10.113 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:17:10.113 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:17:10.113 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:17:10.114 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:17:10.114 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:17:10.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:17:10 smithi157 bash[24585]: cluster 2024-09-16T06:17:09.285233+0000 mgr.a (mgr.14373) 1738 : cluster [DBG] pgmap v1204: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:17:10.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:17:10 smithi157 bash[24585]: audit 2024-09-16T06:17:09.680349+0000 mgr.a (mgr.14373) 1739 : audit [DBG] from='client.50130 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:17:10.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:17:10 smithi086 bash[24289]: cluster 2024-09-16T06:17:09.285233+0000 mgr.a (mgr.14373) 1738 : cluster [DBG] pgmap v1204: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:17:10.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:17:10 smithi086 bash[24289]: audit 2024-09-16T06:17:09.680349+0000 mgr.a (mgr.14373) 1739 : audit [DBG] from='client.50130 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:17:10.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:17:10 smithi047 bash[22744]: cluster 2024-09-16T06:17:09.285233+0000 mgr.a (mgr.14373) 1738 : cluster [DBG] pgmap v1204: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:17:10.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:17:10 smithi047 bash[22744]: audit 2024-09-16T06:17:09.680349+0000 mgr.a (mgr.14373) 1739 : audit [DBG] from='client.50130 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:17:12.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:17:12 smithi157 bash[24585]: cluster 2024-09-16T06:17:11.286202+0000 mgr.a (mgr.14373) 1740 : cluster [DBG] pgmap v1205: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:17:12.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:17:12 smithi086 bash[24289]: cluster 2024-09-16T06:17:11.286202+0000 mgr.a (mgr.14373) 1740 : cluster [DBG] pgmap v1205: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:17:12.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:17:12 smithi047 bash[22744]: cluster 2024-09-16T06:17:11.286202+0000 mgr.a (mgr.14373) 1740 : cluster [DBG] pgmap v1205: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:17:14.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:17:14 smithi157 bash[24585]: cluster 2024-09-16T06:17:13.288432+0000 mgr.a (mgr.14373) 1741 : cluster [DBG] pgmap v1206: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:17:14.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:17:14 smithi086 bash[24289]: cluster 2024-09-16T06:17:13.288432+0000 mgr.a (mgr.14373) 1741 : cluster [DBG] pgmap v1206: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:17:14.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:17:14 smithi047 bash[22744]: cluster 2024-09-16T06:17:13.288432+0000 mgr.a (mgr.14373) 1741 : cluster [DBG] pgmap v1206: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:17:15.114 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:17:15.115 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:17:15.115 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:17:15.878 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:17:15.879 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:17:15.879 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:17:15.879 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:17:15.879 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:17:16.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:17:16 smithi157 bash[24585]: cluster 2024-09-16T06:17:15.289173+0000 mgr.a (mgr.14373) 1742 : cluster [DBG] pgmap v1207: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:17:16.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:17:16 smithi157 bash[24585]: audit 2024-09-16T06:17:15.448846+0000 mgr.a (mgr.14373) 1743 : audit [DBG] from='client.50208 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:17:16.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:17:16 smithi086 bash[24289]: cluster 2024-09-16T06:17:15.289173+0000 mgr.a (mgr.14373) 1742 : cluster [DBG] pgmap v1207: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:17:16.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:17:16 smithi086 bash[24289]: audit 2024-09-16T06:17:15.448846+0000 mgr.a (mgr.14373) 1743 : audit [DBG] from='client.50208 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:17:16.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:17:16 smithi047 bash[22744]: cluster 2024-09-16T06:17:15.289173+0000 mgr.a (mgr.14373) 1742 : cluster [DBG] pgmap v1207: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:17:16.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:17:16 smithi047 bash[22744]: audit 2024-09-16T06:17:15.448846+0000 mgr.a (mgr.14373) 1743 : audit [DBG] from='client.50208 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:17:18.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:17:18 smithi157 bash[24585]: cluster 2024-09-16T06:17:17.291436+0000 mgr.a (mgr.14373) 1744 : cluster [DBG] pgmap v1208: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:17:18.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:17:18 smithi086 bash[24289]: cluster 2024-09-16T06:17:17.291436+0000 mgr.a (mgr.14373) 1744 : cluster [DBG] pgmap v1208: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:17:18.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:17:18 smithi047 bash[22744]: cluster 2024-09-16T06:17:17.291436+0000 mgr.a (mgr.14373) 1744 : cluster [DBG] pgmap v1208: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:17:20.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:17:20 smithi157 bash[24585]: cluster 2024-09-16T06:17:19.292192+0000 mgr.a (mgr.14373) 1745 : cluster [DBG] pgmap v1209: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:17:20.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:17:20 smithi086 bash[24289]: cluster 2024-09-16T06:17:19.292192+0000 mgr.a (mgr.14373) 1745 : cluster [DBG] pgmap v1209: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:17:20.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:17:20 smithi047 bash[22744]: cluster 2024-09-16T06:17:19.292192+0000 mgr.a (mgr.14373) 1745 : cluster [DBG] pgmap v1209: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:17:20.880 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:17:20.881 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:17:20.881 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:17:21.649 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:17:21.649 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:17:21.649 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:17:21.649 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:17:21.649 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:17:22.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:17:22 smithi157 bash[24585]: audit 2024-09-16T06:17:21.211350+0000 mgr.a (mgr.14373) 1746 : audit [DBG] from='client.50283 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:17:22.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:17:22 smithi157 bash[24585]: cluster 2024-09-16T06:17:21.292885+0000 mgr.a (mgr.14373) 1747 : cluster [DBG] pgmap v1210: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:17:22.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:17:22 smithi086 bash[24289]: audit 2024-09-16T06:17:21.211350+0000 mgr.a (mgr.14373) 1746 : audit [DBG] from='client.50283 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:17:22.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:17:22 smithi086 bash[24289]: cluster 2024-09-16T06:17:21.292885+0000 mgr.a (mgr.14373) 1747 : cluster [DBG] pgmap v1210: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:17:22.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:17:22 smithi047 bash[22744]: audit 2024-09-16T06:17:21.211350+0000 mgr.a (mgr.14373) 1746 : audit [DBG] from='client.50283 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:17:22.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:17:22 smithi047 bash[22744]: cluster 2024-09-16T06:17:21.292885+0000 mgr.a (mgr.14373) 1747 : cluster [DBG] pgmap v1210: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:17:24.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:17:24 smithi157 bash[24585]: cluster 2024-09-16T06:17:23.295280+0000 mgr.a (mgr.14373) 1748 : cluster [DBG] pgmap v1211: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-16T06:17:24.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:17:24 smithi086 bash[24289]: cluster 2024-09-16T06:17:23.295280+0000 mgr.a (mgr.14373) 1748 : cluster [DBG] pgmap v1211: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-16T06:17:24.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:17:24 smithi047 bash[22744]: cluster 2024-09-16T06:17:23.295280+0000 mgr.a (mgr.14373) 1748 : cluster [DBG] pgmap v1211: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-16T06:17:26.650 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:17:26.651 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:17:26.651 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:17:26.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:17:26 smithi157 bash[24585]: cluster 2024-09-16T06:17:25.296076+0000 mgr.a (mgr.14373) 1749 : cluster [DBG] pgmap v1212: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-16T06:17:26.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:17:26 smithi086 bash[24289]: cluster 2024-09-16T06:17:25.296076+0000 mgr.a (mgr.14373) 1749 : cluster [DBG] pgmap v1212: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-16T06:17:26.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:17:26 smithi047 bash[22744]: cluster 2024-09-16T06:17:25.296076+0000 mgr.a (mgr.14373) 1749 : cluster [DBG] pgmap v1212: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-16T06:17:27.424 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:17:27.424 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:17:27.424 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:17:27.424 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:17:27.424 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:17:28.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:17:28 smithi157 bash[24585]: audit 2024-09-16T06:17:26.989143+0000 mgr.a (mgr.14373) 1750 : audit [DBG] from='client.50358 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:17:28.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:17:28 smithi157 bash[24585]: cluster 2024-09-16T06:17:27.297775+0000 mgr.a (mgr.14373) 1751 : cluster [DBG] pgmap v1213: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:17:28.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:17:28 smithi086 bash[24289]: audit 2024-09-16T06:17:26.989143+0000 mgr.a (mgr.14373) 1750 : audit [DBG] from='client.50358 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:17:28.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:17:28 smithi086 bash[24289]: cluster 2024-09-16T06:17:27.297775+0000 mgr.a (mgr.14373) 1751 : cluster [DBG] pgmap v1213: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:17:28.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:17:28 smithi047 bash[22744]: audit 2024-09-16T06:17:26.989143+0000 mgr.a (mgr.14373) 1750 : audit [DBG] from='client.50358 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:17:28.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:17:28 smithi047 bash[22744]: cluster 2024-09-16T06:17:27.297775+0000 mgr.a (mgr.14373) 1751 : cluster [DBG] pgmap v1213: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:17:30.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:17:30 smithi157 bash[24585]: cluster 2024-09-16T06:17:29.298632+0000 mgr.a (mgr.14373) 1752 : cluster [DBG] pgmap v1214: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:17:30.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:17:30 smithi086 bash[24289]: cluster 2024-09-16T06:17:29.298632+0000 mgr.a (mgr.14373) 1752 : cluster [DBG] pgmap v1214: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:17:30.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:17:30 smithi047 bash[22744]: cluster 2024-09-16T06:17:29.298632+0000 mgr.a (mgr.14373) 1752 : cluster [DBG] pgmap v1214: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:17:32.425 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:17:32.427 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:17:32.427 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:17:32.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:17:32 smithi157 bash[24585]: cluster 2024-09-16T06:17:31.299404+0000 mgr.a (mgr.14373) 1753 : cluster [DBG] pgmap v1215: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T06:17:32.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:17:32 smithi086 bash[24289]: cluster 2024-09-16T06:17:31.299404+0000 mgr.a (mgr.14373) 1753 : cluster [DBG] pgmap v1215: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T06:17:32.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:17:32 smithi047 bash[22744]: cluster 2024-09-16T06:17:31.299404+0000 mgr.a (mgr.14373) 1753 : cluster [DBG] pgmap v1215: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T06:17:33.205 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:17:33.206 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:17:33.206 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:17:33.206 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:17:33.206 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:17:33.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:17:33 smithi157 bash[24585]: audit 2024-09-16T06:17:32.762720+0000 mgr.a (mgr.14373) 1754 : audit [DBG] from='client.50433 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:17:33.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:17:33 smithi086 bash[24289]: audit 2024-09-16T06:17:32.762720+0000 mgr.a (mgr.14373) 1754 : audit [DBG] from='client.50433 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:17:33.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:17:33 smithi047 bash[22744]: audit 2024-09-16T06:17:32.762720+0000 mgr.a (mgr.14373) 1754 : audit [DBG] from='client.50433 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:17:34.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:17:34 smithi157 bash[24585]: cluster 2024-09-16T06:17:33.302238+0000 mgr.a (mgr.14373) 1755 : cluster [DBG] pgmap v1216: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:17:34.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:17:34 smithi086 bash[24289]: cluster 2024-09-16T06:17:33.302238+0000 mgr.a (mgr.14373) 1755 : cluster [DBG] pgmap v1216: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:17:34.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:17:34 smithi047 bash[22744]: cluster 2024-09-16T06:17:33.302238+0000 mgr.a (mgr.14373) 1755 : cluster [DBG] pgmap v1216: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:17:36.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:17:36 smithi157 bash[24585]: cluster 2024-09-16T06:17:35.303067+0000 mgr.a (mgr.14373) 1756 : cluster [DBG] pgmap v1217: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T06:17:36.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:17:36 smithi086 bash[24289]: cluster 2024-09-16T06:17:35.303067+0000 mgr.a (mgr.14373) 1756 : cluster [DBG] pgmap v1217: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T06:17:36.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:17:36 smithi047 bash[22744]: cluster 2024-09-16T06:17:35.303067+0000 mgr.a (mgr.14373) 1756 : cluster [DBG] pgmap v1217: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T06:17:38.207 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:17:38.208 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:17:38.208 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:17:38.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:17:38 smithi157 bash[24585]: cluster 2024-09-16T06:17:37.305004+0000 mgr.a (mgr.14373) 1757 : cluster [DBG] pgmap v1218: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-16T06:17:38.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:17:38 smithi086 bash[24289]: cluster 2024-09-16T06:17:37.305004+0000 mgr.a (mgr.14373) 1757 : cluster [DBG] pgmap v1218: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-16T06:17:38.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:17:38 smithi047 bash[22744]: cluster 2024-09-16T06:17:37.305004+0000 mgr.a (mgr.14373) 1757 : cluster [DBG] pgmap v1218: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-16T06:17:38.945 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:17:38.946 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:17:38.946 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:17:38.946 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:17:38.946 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:17:39.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:17:39 smithi157 bash[24585]: audit 2024-09-16T06:17:38.540632+0000 mgr.a (mgr.14373) 1758 : audit [DBG] from='client.50511 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:17:39.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:17:39 smithi086 bash[24289]: audit 2024-09-16T06:17:38.540632+0000 mgr.a (mgr.14373) 1758 : audit [DBG] from='client.50511 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:17:39.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:17:39 smithi047 bash[22744]: audit 2024-09-16T06:17:38.540632+0000 mgr.a (mgr.14373) 1758 : audit [DBG] from='client.50511 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:17:40.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:17:40 smithi157 bash[24585]: cluster 2024-09-16T06:17:39.306091+0000 mgr.a (mgr.14373) 1759 : cluster [DBG] pgmap v1219: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:17:40.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:17:40 smithi086 bash[24289]: cluster 2024-09-16T06:17:39.306091+0000 mgr.a (mgr.14373) 1759 : cluster [DBG] pgmap v1219: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:17:40.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:17:40 smithi047 bash[22744]: cluster 2024-09-16T06:17:39.306091+0000 mgr.a (mgr.14373) 1759 : cluster [DBG] pgmap v1219: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:17:42.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:17:42 smithi157 bash[24585]: cluster 2024-09-16T06:17:41.306933+0000 mgr.a (mgr.14373) 1760 : cluster [DBG] pgmap v1220: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:17:42.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:17:42 smithi086 bash[24289]: cluster 2024-09-16T06:17:41.306933+0000 mgr.a (mgr.14373) 1760 : cluster [DBG] pgmap v1220: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:17:42.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:17:42 smithi047 bash[22744]: cluster 2024-09-16T06:17:41.306933+0000 mgr.a (mgr.14373) 1760 : cluster [DBG] pgmap v1220: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:17:43.947 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:17:43.948 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:17:43.948 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:17:44.715 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:17:44.715 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:17:44.715 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:17:44.716 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:17:44.716 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:17:44.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:17:44 smithi157 bash[24585]: cluster 2024-09-16T06:17:43.309200+0000 mgr.a (mgr.14373) 1761 : cluster [DBG] pgmap v1221: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:17:44.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:17:44 smithi086 bash[24289]: cluster 2024-09-16T06:17:43.309200+0000 mgr.a (mgr.14373) 1761 : cluster [DBG] pgmap v1221: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:17:44.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:17:44 smithi047 bash[22744]: cluster 2024-09-16T06:17:43.309200+0000 mgr.a (mgr.14373) 1761 : cluster [DBG] pgmap v1221: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:17:45.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:17:45 smithi157 bash[24585]: audit 2024-09-16T06:17:44.283213+0000 mgr.a (mgr.14373) 1762 : audit [DBG] from='client.50589 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:17:45.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:17:45 smithi086 bash[24289]: audit 2024-09-16T06:17:44.283213+0000 mgr.a (mgr.14373) 1762 : audit [DBG] from='client.50589 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:17:45.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:17:45 smithi047 bash[22744]: audit 2024-09-16T06:17:44.283213+0000 mgr.a (mgr.14373) 1762 : audit [DBG] from='client.50589 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:17:46.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:17:46 smithi157 bash[24585]: cluster 2024-09-16T06:17:45.310186+0000 mgr.a (mgr.14373) 1763 : cluster [DBG] pgmap v1222: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:17:46.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:17:46 smithi086 bash[24289]: cluster 2024-09-16T06:17:45.310186+0000 mgr.a (mgr.14373) 1763 : cluster [DBG] pgmap v1222: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:17:46.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:17:46 smithi047 bash[22744]: cluster 2024-09-16T06:17:45.310186+0000 mgr.a (mgr.14373) 1763 : cluster [DBG] pgmap v1222: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:17:48.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:17:48 smithi157 bash[24585]: cluster 2024-09-16T06:17:47.312485+0000 mgr.a (mgr.14373) 1764 : cluster [DBG] pgmap v1223: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:17:48.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:17:48 smithi086 bash[24289]: cluster 2024-09-16T06:17:47.312485+0000 mgr.a (mgr.14373) 1764 : cluster [DBG] pgmap v1223: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:17:48.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:17:48 smithi047 bash[22744]: cluster 2024-09-16T06:17:47.312485+0000 mgr.a (mgr.14373) 1764 : cluster [DBG] pgmap v1223: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:17:49.717 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:17:49.718 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:17:49.718 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:17:50.464 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:17:50.464 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:17:50.464 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:17:50.464 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:17:50.464 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:17:50.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:17:50 smithi157 bash[24585]: cluster 2024-09-16T06:17:49.313408+0000 mgr.a (mgr.14373) 1765 : cluster [DBG] pgmap v1224: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:17:50.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:17:50 smithi086 bash[24289]: cluster 2024-09-16T06:17:49.313408+0000 mgr.a (mgr.14373) 1765 : cluster [DBG] pgmap v1224: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:17:50.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:17:50 smithi047 bash[22744]: cluster 2024-09-16T06:17:49.313408+0000 mgr.a (mgr.14373) 1765 : cluster [DBG] pgmap v1224: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:17:51.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:17:51 smithi157 bash[24585]: audit 2024-09-16T06:17:50.052287+0000 mgr.a (mgr.14373) 1766 : audit [DBG] from='client.50667 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:17:51.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:17:51 smithi086 bash[24289]: audit 2024-09-16T06:17:50.052287+0000 mgr.a (mgr.14373) 1766 : audit [DBG] from='client.50667 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:17:51.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:17:51 smithi047 bash[22744]: audit 2024-09-16T06:17:50.052287+0000 mgr.a (mgr.14373) 1766 : audit [DBG] from='client.50667 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:17:52.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:17:52 smithi157 bash[24585]: cluster 2024-09-16T06:17:51.314385+0000 mgr.a (mgr.14373) 1767 : cluster [DBG] pgmap v1225: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:17:52.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:17:52 smithi086 bash[24289]: cluster 2024-09-16T06:17:51.314385+0000 mgr.a (mgr.14373) 1767 : cluster [DBG] pgmap v1225: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:17:52.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:17:52 smithi047 bash[22744]: cluster 2024-09-16T06:17:51.314385+0000 mgr.a (mgr.14373) 1767 : cluster [DBG] pgmap v1225: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:17:54.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:17:54 smithi157 bash[24585]: cluster 2024-09-16T06:17:53.316624+0000 mgr.a (mgr.14373) 1768 : cluster [DBG] pgmap v1226: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:17:54.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:17:54 smithi086 bash[24289]: cluster 2024-09-16T06:17:53.316624+0000 mgr.a (mgr.14373) 1768 : cluster [DBG] pgmap v1226: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:17:54.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:17:54 smithi047 bash[22744]: cluster 2024-09-16T06:17:53.316624+0000 mgr.a (mgr.14373) 1768 : cluster [DBG] pgmap v1226: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:17:55.465 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:17:55.466 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:17:55.466 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:17:56.214 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:17:56.214 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:17:56.214 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:17:56.214 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:17:56.215 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:17:56.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:17:56 smithi157 bash[24585]: cluster 2024-09-16T06:17:55.317393+0000 mgr.a (mgr.14373) 1769 : cluster [DBG] pgmap v1227: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:17:56.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:17:56 smithi157 bash[24585]: audit 2024-09-16T06:17:55.797974+0000 mgr.a (mgr.14373) 1770 : audit [DBG] from='client.50742 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:17:56.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:17:56 smithi086 bash[24289]: cluster 2024-09-16T06:17:55.317393+0000 mgr.a (mgr.14373) 1769 : cluster [DBG] pgmap v1227: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:17:56.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:17:56 smithi086 bash[24289]: audit 2024-09-16T06:17:55.797974+0000 mgr.a (mgr.14373) 1770 : audit [DBG] from='client.50742 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:17:56.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:17:56 smithi047 bash[22744]: cluster 2024-09-16T06:17:55.317393+0000 mgr.a (mgr.14373) 1769 : cluster [DBG] pgmap v1227: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:17:56.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:17:56 smithi047 bash[22744]: audit 2024-09-16T06:17:55.797974+0000 mgr.a (mgr.14373) 1770 : audit [DBG] from='client.50742 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:17:58.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:17:58 smithi157 bash[24585]: cluster 2024-09-16T06:17:57.319688+0000 mgr.a (mgr.14373) 1771 : cluster [DBG] pgmap v1228: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:17:58.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:17:58 smithi086 bash[24289]: cluster 2024-09-16T06:17:57.319688+0000 mgr.a (mgr.14373) 1771 : cluster [DBG] pgmap v1228: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:17:58.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:17:58 smithi047 bash[22744]: cluster 2024-09-16T06:17:57.319688+0000 mgr.a (mgr.14373) 1771 : cluster [DBG] pgmap v1228: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:18:00.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:18:00 smithi157 bash[24585]: cluster 2024-09-16T06:17:59.320489+0000 mgr.a (mgr.14373) 1772 : cluster [DBG] pgmap v1229: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:18:00.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:18:00 smithi157 bash[24585]: audit 2024-09-16T06:18:00.516981+0000 mon.b (mon.2) 206 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T06:18:00.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:18:00 smithi086 bash[24289]: cluster 2024-09-16T06:17:59.320489+0000 mgr.a (mgr.14373) 1772 : cluster [DBG] pgmap v1229: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:18:00.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:18:00 smithi086 bash[24289]: audit 2024-09-16T06:18:00.516981+0000 mon.b (mon.2) 206 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T06:18:00.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:18:00 smithi047 bash[22744]: cluster 2024-09-16T06:17:59.320489+0000 mgr.a (mgr.14373) 1772 : cluster [DBG] pgmap v1229: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:18:00.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:18:00 smithi047 bash[22744]: audit 2024-09-16T06:18:00.516981+0000 mon.b (mon.2) 206 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T06:18:01.215 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:18:01.216 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:18:01.216 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:18:01.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:18:01 smithi157 bash[24585]: audit 2024-09-16T06:18:01.362329+0000 mon.b (mon.2) 207 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T06:18:01.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:18:01 smithi157 bash[24585]: audit 2024-09-16T06:18:01.364213+0000 mon.b (mon.2) 208 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T06:18:01.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:18:01 smithi157 bash[24585]: audit 2024-09-16T06:18:01.376330+0000 mon.a (mon.0) 675 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:18:01.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:18:01 smithi157 bash[24585]: audit 2024-09-16T06:18:01.379805+0000 mon.b (mon.2) 209 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:18:01.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:18:01 smithi086 bash[24289]: audit 2024-09-16T06:18:01.362329+0000 mon.b (mon.2) 207 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T06:18:01.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:18:01 smithi086 bash[24289]: audit 2024-09-16T06:18:01.364213+0000 mon.b (mon.2) 208 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T06:18:01.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:18:01 smithi086 bash[24289]: audit 2024-09-16T06:18:01.376330+0000 mon.a (mon.0) 675 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:18:01.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:18:01 smithi086 bash[24289]: audit 2024-09-16T06:18:01.379805+0000 mon.b (mon.2) 209 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:18:01.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:18:01 smithi047 bash[22744]: audit 2024-09-16T06:18:01.362329+0000 mon.b (mon.2) 207 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T06:18:01.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:18:01 smithi047 bash[22744]: audit 2024-09-16T06:18:01.364213+0000 mon.b (mon.2) 208 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T06:18:01.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:18:01 smithi047 bash[22744]: audit 2024-09-16T06:18:01.376330+0000 mon.a (mon.0) 675 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:18:01.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:18:01 smithi047 bash[22744]: audit 2024-09-16T06:18:01.379805+0000 mon.b (mon.2) 209 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:18:02.339 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 06:18:02 smithi047 bash[22994]: debug 2024-09-16T06:18:02.078+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T06:18:02.339 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 06:18:02 smithi047 bash[22994]: debug 2024-09-16T06:18:02.090+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T06:18:02.475 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:18:02.475 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:18:02.475 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:18:02.475 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:18:02.475 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:18:02.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:18:02 smithi157 bash[24585]: cluster 2024-09-16T06:18:01.320911+0000 mgr.a (mgr.14373) 1773 : cluster [DBG] pgmap v1230: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:18:02.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:18:02 smithi157 bash[24585]: audit 2024-09-16T06:18:01.383868+0000 mgr.a (mgr.14373) 1774 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:18:02.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:18:02 smithi157 bash[24585]: audit 2024-09-16T06:18:01.546627+0000 mgr.a (mgr.14373) 1775 : audit [DBG] from='client.50820 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:18:02.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:18:02 smithi086 bash[24289]: cluster 2024-09-16T06:18:01.320911+0000 mgr.a (mgr.14373) 1773 : cluster [DBG] pgmap v1230: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:18:02.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:18:02 smithi086 bash[24289]: audit 2024-09-16T06:18:01.383868+0000 mgr.a (mgr.14373) 1774 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:18:02.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:18:02 smithi086 bash[24289]: audit 2024-09-16T06:18:01.546627+0000 mgr.a (mgr.14373) 1775 : audit [DBG] from='client.50820 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:18:02.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:18:02 smithi047 bash[22744]: cluster 2024-09-16T06:18:01.320911+0000 mgr.a (mgr.14373) 1773 : cluster [DBG] pgmap v1230: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:18:02.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:18:02 smithi047 bash[22744]: audit 2024-09-16T06:18:01.383868+0000 mgr.a (mgr.14373) 1774 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:18:02.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:18:02 smithi047 bash[22744]: audit 2024-09-16T06:18:01.546627+0000 mgr.a (mgr.14373) 1775 : audit [DBG] from='client.50820 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:18:03.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:18:03 smithi157 bash[24585]: audit 2024-09-16T06:18:02.084596+0000 mgr.a (mgr.14373) 1776 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T06:18:03.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:18:03 smithi157 bash[24585]: cephadm 2024-09-16T06:18:02.096971+0000 mgr.a (mgr.14373) 1777 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T06:18:03.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:18:03 smithi086 bash[24289]: audit 2024-09-16T06:18:02.084596+0000 mgr.a (mgr.14373) 1776 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T06:18:03.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:18:03 smithi086 bash[24289]: cephadm 2024-09-16T06:18:02.096971+0000 mgr.a (mgr.14373) 1777 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T06:18:03.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:18:03 smithi047 bash[22744]: audit 2024-09-16T06:18:02.084596+0000 mgr.a (mgr.14373) 1776 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T06:18:03.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:18:03 smithi047 bash[22744]: cephadm 2024-09-16T06:18:02.096971+0000 mgr.a (mgr.14373) 1777 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T06:18:04.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:18:04 smithi157 bash[24585]: cluster 2024-09-16T06:18:03.323573+0000 mgr.a (mgr.14373) 1778 : cluster [DBG] pgmap v1231: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 3.2 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-16T06:18:04.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:18:04 smithi086 bash[24289]: cluster 2024-09-16T06:18:03.323573+0000 mgr.a (mgr.14373) 1778 : cluster [DBG] pgmap v1231: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 3.2 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-16T06:18:04.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:18:04 smithi047 bash[22744]: cluster 2024-09-16T06:18:03.323573+0000 mgr.a (mgr.14373) 1778 : cluster [DBG] pgmap v1231: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 3.2 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-16T06:18:06.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:18:06 smithi086 bash[24289]: cluster 2024-09-16T06:18:05.324552+0000 mgr.a (mgr.14373) 1779 : cluster [DBG] pgmap v1232: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-16T06:18:06.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:18:06 smithi047 bash[22744]: cluster 2024-09-16T06:18:05.324552+0000 mgr.a (mgr.14373) 1779 : cluster [DBG] pgmap v1232: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-16T06:18:07.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:18:06 smithi157 bash[24585]: cluster 2024-09-16T06:18:05.324552+0000 mgr.a (mgr.14373) 1779 : cluster [DBG] pgmap v1232: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-16T06:18:07.476 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:18:07.477 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:18:07.477 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:18:08.263 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:18:08.263 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:18:08.264 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:18:08.264 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:18:08.264 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:18:08.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:18:08 smithi086 bash[24289]: cluster 2024-09-16T06:18:07.326570+0000 mgr.a (mgr.14373) 1780 : cluster [DBG] pgmap v1233: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 74 KiB/s rd, 426 B/s wr, 119 op/s 2024-09-16T06:18:08.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:18:08 smithi086 bash[24289]: audit 2024-09-16T06:18:07.817904+0000 mgr.a (mgr.14373) 1781 : audit [DBG] from='client.51006 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:18:08.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:18:08 smithi047 bash[22744]: cluster 2024-09-16T06:18:07.326570+0000 mgr.a (mgr.14373) 1780 : cluster [DBG] pgmap v1233: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 74 KiB/s rd, 426 B/s wr, 119 op/s 2024-09-16T06:18:08.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:18:08 smithi047 bash[22744]: audit 2024-09-16T06:18:07.817904+0000 mgr.a (mgr.14373) 1781 : audit [DBG] from='client.51006 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:18:09.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:18:08 smithi157 bash[24585]: cluster 2024-09-16T06:18:07.326570+0000 mgr.a (mgr.14373) 1780 : cluster [DBG] pgmap v1233: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 74 KiB/s rd, 426 B/s wr, 119 op/s 2024-09-16T06:18:09.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:18:08 smithi157 bash[24585]: audit 2024-09-16T06:18:07.817904+0000 mgr.a (mgr.14373) 1781 : audit [DBG] from='client.51006 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:18:10.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:18:10 smithi086 bash[24289]: cluster 2024-09-16T06:18:09.327461+0000 mgr.a (mgr.14373) 1782 : cluster [DBG] pgmap v1234: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 74 KiB/s rd, 426 B/s wr, 118 op/s 2024-09-16T06:18:10.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:18:10 smithi047 bash[22744]: cluster 2024-09-16T06:18:09.327461+0000 mgr.a (mgr.14373) 1782 : cluster [DBG] pgmap v1234: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 74 KiB/s rd, 426 B/s wr, 118 op/s 2024-09-16T06:18:11.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:18:10 smithi157 bash[24585]: cluster 2024-09-16T06:18:09.327461+0000 mgr.a (mgr.14373) 1782 : cluster [DBG] pgmap v1234: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 74 KiB/s rd, 426 B/s wr, 118 op/s 2024-09-16T06:18:12.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:18:12 smithi047 bash[22744]: cluster 2024-09-16T06:18:11.328252+0000 mgr.a (mgr.14373) 1783 : cluster [DBG] pgmap v1235: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 74 KiB/s rd, 426 B/s wr, 118 op/s 2024-09-16T06:18:13.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:18:12 smithi157 bash[24585]: cluster 2024-09-16T06:18:11.328252+0000 mgr.a (mgr.14373) 1783 : cluster [DBG] pgmap v1235: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 74 KiB/s rd, 426 B/s wr, 118 op/s 2024-09-16T06:18:13.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:18:12 smithi086 bash[24289]: cluster 2024-09-16T06:18:11.328252+0000 mgr.a (mgr.14373) 1783 : cluster [DBG] pgmap v1235: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 74 KiB/s rd, 426 B/s wr, 118 op/s 2024-09-16T06:18:13.265 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:18:13.265 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:18:13.266 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:18:14.004 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:18:14.005 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:18:14.005 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:18:14.005 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:18:14.005 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:18:14.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:18:14 smithi047 bash[22744]: cluster 2024-09-16T06:18:13.330441+0000 mgr.a (mgr.14373) 1784 : cluster [DBG] pgmap v1236: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 74 KiB/s rd, 426 B/s wr, 119 op/s 2024-09-16T06:18:14.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:18:14 smithi047 bash[22744]: audit 2024-09-16T06:18:13.602947+0000 mgr.a (mgr.14373) 1785 : audit [DBG] from='client.51084 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:18:15.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:18:14 smithi157 bash[24585]: cluster 2024-09-16T06:18:13.330441+0000 mgr.a (mgr.14373) 1784 : cluster [DBG] pgmap v1236: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 74 KiB/s rd, 426 B/s wr, 119 op/s 2024-09-16T06:18:15.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:18:14 smithi157 bash[24585]: audit 2024-09-16T06:18:13.602947+0000 mgr.a (mgr.14373) 1785 : audit [DBG] from='client.51084 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:18:15.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:18:14 smithi086 bash[24289]: cluster 2024-09-16T06:18:13.330441+0000 mgr.a (mgr.14373) 1784 : cluster [DBG] pgmap v1236: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 74 KiB/s rd, 426 B/s wr, 119 op/s 2024-09-16T06:18:15.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:18:14 smithi086 bash[24289]: audit 2024-09-16T06:18:13.602947+0000 mgr.a (mgr.14373) 1785 : audit [DBG] from='client.51084 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:18:16.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:18:16 smithi047 bash[22744]: cluster 2024-09-16T06:18:15.331290+0000 mgr.a (mgr.14373) 1786 : cluster [DBG] pgmap v1237: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 73 KiB/s rd, 170 B/s wr, 117 op/s 2024-09-16T06:18:17.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:18:16 smithi157 bash[24585]: cluster 2024-09-16T06:18:15.331290+0000 mgr.a (mgr.14373) 1786 : cluster [DBG] pgmap v1237: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 73 KiB/s rd, 170 B/s wr, 117 op/s 2024-09-16T06:18:17.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:18:16 smithi086 bash[24289]: cluster 2024-09-16T06:18:15.331290+0000 mgr.a (mgr.14373) 1786 : cluster [DBG] pgmap v1237: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 73 KiB/s rd, 170 B/s wr, 117 op/s 2024-09-16T06:18:18.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:18:18 smithi047 bash[22744]: cluster 2024-09-16T06:18:17.333440+0000 mgr.a (mgr.14373) 1787 : cluster [DBG] pgmap v1238: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 74 KiB/s rd, 170 B/s wr, 118 op/s 2024-09-16T06:18:19.006 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:18:19.007 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:18:19.007 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:18:19.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:18:18 smithi157 bash[24585]: cluster 2024-09-16T06:18:17.333440+0000 mgr.a (mgr.14373) 1787 : cluster [DBG] pgmap v1238: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 74 KiB/s rd, 170 B/s wr, 118 op/s 2024-09-16T06:18:19.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:18:18 smithi086 bash[24289]: cluster 2024-09-16T06:18:17.333440+0000 mgr.a (mgr.14373) 1787 : cluster [DBG] pgmap v1238: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 74 KiB/s rd, 170 B/s wr, 118 op/s 2024-09-16T06:18:19.783 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:18:19.783 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:18:19.783 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:18:19.783 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:18:19.784 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:18:20.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:18:20 smithi047 bash[22744]: cluster 2024-09-16T06:18:19.334176+0000 mgr.a (mgr.14373) 1788 : cluster [DBG] pgmap v1239: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:18:20.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:18:20 smithi047 bash[22744]: audit 2024-09-16T06:18:19.346543+0000 mgr.a (mgr.14373) 1789 : audit [DBG] from='client.51162 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:18:21.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:18:20 smithi157 bash[24585]: cluster 2024-09-16T06:18:19.334176+0000 mgr.a (mgr.14373) 1788 : cluster [DBG] pgmap v1239: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:18:21.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:18:20 smithi157 bash[24585]: audit 2024-09-16T06:18:19.346543+0000 mgr.a (mgr.14373) 1789 : audit [DBG] from='client.51162 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:18:21.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:18:20 smithi086 bash[24289]: cluster 2024-09-16T06:18:19.334176+0000 mgr.a (mgr.14373) 1788 : cluster [DBG] pgmap v1239: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:18:21.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:18:20 smithi086 bash[24289]: audit 2024-09-16T06:18:19.346543+0000 mgr.a (mgr.14373) 1789 : audit [DBG] from='client.51162 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:18:22.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:18:22 smithi047 bash[22744]: cluster 2024-09-16T06:18:21.335055+0000 mgr.a (mgr.14373) 1790 : cluster [DBG] pgmap v1240: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:18:23.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:18:22 smithi157 bash[24585]: cluster 2024-09-16T06:18:21.335055+0000 mgr.a (mgr.14373) 1790 : cluster [DBG] pgmap v1240: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:18:23.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:18:22 smithi086 bash[24289]: cluster 2024-09-16T06:18:21.335055+0000 mgr.a (mgr.14373) 1790 : cluster [DBG] pgmap v1240: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:18:24.785 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:18:24.785 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:18:24.785 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:18:25.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:18:24 smithi157 bash[24585]: cluster 2024-09-16T06:18:23.337271+0000 mgr.a (mgr.14373) 1791 : cluster [DBG] pgmap v1241: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:18:25.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:18:24 smithi086 bash[24289]: cluster 2024-09-16T06:18:23.337271+0000 mgr.a (mgr.14373) 1791 : cluster [DBG] pgmap v1241: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:18:25.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:18:24 smithi047 bash[22744]: cluster 2024-09-16T06:18:23.337271+0000 mgr.a (mgr.14373) 1791 : cluster [DBG] pgmap v1241: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:18:25.529 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:18:25.530 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:18:25.530 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:18:25.530 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:18:25.530 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:18:27.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:18:26 smithi157 bash[24585]: audit 2024-09-16T06:18:25.119059+0000 mgr.a (mgr.14373) 1792 : audit [DBG] from='client.51240 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:18:27.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:18:26 smithi157 bash[24585]: cluster 2024-09-16T06:18:25.344950+0000 mgr.a (mgr.14373) 1793 : cluster [DBG] pgmap v1242: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:18:27.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:18:26 smithi086 bash[24289]: audit 2024-09-16T06:18:25.119059+0000 mgr.a (mgr.14373) 1792 : audit [DBG] from='client.51240 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:18:27.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:18:26 smithi086 bash[24289]: cluster 2024-09-16T06:18:25.344950+0000 mgr.a (mgr.14373) 1793 : cluster [DBG] pgmap v1242: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:18:27.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:18:26 smithi047 bash[22744]: audit 2024-09-16T06:18:25.119059+0000 mgr.a (mgr.14373) 1792 : audit [DBG] from='client.51240 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:18:27.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:18:26 smithi047 bash[22744]: cluster 2024-09-16T06:18:25.344950+0000 mgr.a (mgr.14373) 1793 : cluster [DBG] pgmap v1242: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:18:29.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:18:28 smithi157 bash[24585]: cluster 2024-09-16T06:18:27.347260+0000 mgr.a (mgr.14373) 1794 : cluster [DBG] pgmap v1243: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:18:29.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:18:28 smithi086 bash[24289]: cluster 2024-09-16T06:18:27.347260+0000 mgr.a (mgr.14373) 1794 : cluster [DBG] pgmap v1243: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:18:29.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:18:28 smithi047 bash[22744]: cluster 2024-09-16T06:18:27.347260+0000 mgr.a (mgr.14373) 1794 : cluster [DBG] pgmap v1243: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:18:30.531 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:18:30.532 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:18:30.532 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:18:31.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:18:30 smithi157 bash[24585]: cluster 2024-09-16T06:18:29.348012+0000 mgr.a (mgr.14373) 1795 : cluster [DBG] pgmap v1244: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:18:31.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:18:30 smithi086 bash[24289]: cluster 2024-09-16T06:18:29.348012+0000 mgr.a (mgr.14373) 1795 : cluster [DBG] pgmap v1244: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:18:31.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:18:30 smithi047 bash[22744]: cluster 2024-09-16T06:18:29.348012+0000 mgr.a (mgr.14373) 1795 : cluster [DBG] pgmap v1244: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:18:31.294 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:18:31.294 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:18:31.294 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:18:31.294 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:18:31.294 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:18:33.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:18:32 smithi157 bash[24585]: audit 2024-09-16T06:18:30.867782+0000 mgr.a (mgr.14373) 1796 : audit [DBG] from='client.51315 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:18:33.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:18:32 smithi157 bash[24585]: cluster 2024-09-16T06:18:31.348624+0000 mgr.a (mgr.14373) 1797 : cluster [DBG] pgmap v1245: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:18:33.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:18:32 smithi086 bash[24289]: audit 2024-09-16T06:18:30.867782+0000 mgr.a (mgr.14373) 1796 : audit [DBG] from='client.51315 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:18:33.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:18:32 smithi086 bash[24289]: cluster 2024-09-16T06:18:31.348624+0000 mgr.a (mgr.14373) 1797 : cluster [DBG] pgmap v1245: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:18:33.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:18:32 smithi047 bash[22744]: audit 2024-09-16T06:18:30.867782+0000 mgr.a (mgr.14373) 1796 : audit [DBG] from='client.51315 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:18:33.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:18:32 smithi047 bash[22744]: cluster 2024-09-16T06:18:31.348624+0000 mgr.a (mgr.14373) 1797 : cluster [DBG] pgmap v1245: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:18:35.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:18:34 smithi157 bash[24585]: cluster 2024-09-16T06:18:33.350809+0000 mgr.a (mgr.14373) 1798 : cluster [DBG] pgmap v1246: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:18:35.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:18:34 smithi086 bash[24289]: cluster 2024-09-16T06:18:33.350809+0000 mgr.a (mgr.14373) 1798 : cluster [DBG] pgmap v1246: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:18:35.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:18:34 smithi047 bash[22744]: cluster 2024-09-16T06:18:33.350809+0000 mgr.a (mgr.14373) 1798 : cluster [DBG] pgmap v1246: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:18:36.295 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:18:36.296 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:18:36.296 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:18:37.041 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:18:37.042 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:18:37.042 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:18:37.042 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:18:37.042 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:18:37.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:18:36 smithi157 bash[24585]: cluster 2024-09-16T06:18:35.351579+0000 mgr.a (mgr.14373) 1799 : cluster [DBG] pgmap v1247: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:18:37.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:18:36 smithi086 bash[24289]: cluster 2024-09-16T06:18:35.351579+0000 mgr.a (mgr.14373) 1799 : cluster [DBG] pgmap v1247: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:18:37.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:18:36 smithi047 bash[22744]: cluster 2024-09-16T06:18:35.351579+0000 mgr.a (mgr.14373) 1799 : cluster [DBG] pgmap v1247: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:18:38.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:18:37 smithi157 bash[24585]: audit 2024-09-16T06:18:36.628469+0000 mgr.a (mgr.14373) 1800 : audit [DBG] from='client.51393 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:18:38.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:18:37 smithi086 bash[24289]: audit 2024-09-16T06:18:36.628469+0000 mgr.a (mgr.14373) 1800 : audit [DBG] from='client.51393 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:18:38.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:18:37 smithi047 bash[22744]: audit 2024-09-16T06:18:36.628469+0000 mgr.a (mgr.14373) 1800 : audit [DBG] from='client.51393 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:18:39.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:18:38 smithi157 bash[24585]: cluster 2024-09-16T06:18:37.354306+0000 mgr.a (mgr.14373) 1801 : cluster [DBG] pgmap v1248: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:18:39.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:18:38 smithi086 bash[24289]: cluster 2024-09-16T06:18:37.354306+0000 mgr.a (mgr.14373) 1801 : cluster [DBG] pgmap v1248: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:18:39.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:18:38 smithi047 bash[22744]: cluster 2024-09-16T06:18:37.354306+0000 mgr.a (mgr.14373) 1801 : cluster [DBG] pgmap v1248: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:18:41.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:18:40 smithi157 bash[24585]: cluster 2024-09-16T06:18:39.355080+0000 mgr.a (mgr.14373) 1802 : cluster [DBG] pgmap v1249: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:18:41.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:18:40 smithi086 bash[24289]: cluster 2024-09-16T06:18:39.355080+0000 mgr.a (mgr.14373) 1802 : cluster [DBG] pgmap v1249: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:18:41.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:18:40 smithi047 bash[22744]: cluster 2024-09-16T06:18:39.355080+0000 mgr.a (mgr.14373) 1802 : cluster [DBG] pgmap v1249: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:18:42.043 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:18:42.044 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:18:42.044 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:18:42.792 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:18:42.793 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:18:42.793 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:18:42.793 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:18:42.793 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:18:43.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:18:42 smithi157 bash[24585]: cluster 2024-09-16T06:18:41.355788+0000 mgr.a (mgr.14373) 1803 : cluster [DBG] pgmap v1250: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T06:18:43.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:18:42 smithi086 bash[24289]: cluster 2024-09-16T06:18:41.355788+0000 mgr.a (mgr.14373) 1803 : cluster [DBG] pgmap v1250: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T06:18:43.091 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:18:42 smithi047 bash[22744]: cluster 2024-09-16T06:18:41.355788+0000 mgr.a (mgr.14373) 1803 : cluster [DBG] pgmap v1250: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T06:18:44.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:18:43 smithi157 bash[24585]: audit 2024-09-16T06:18:42.374055+0000 mgr.a (mgr.14373) 1804 : audit [DBG] from='client.51468 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:18:44.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:18:43 smithi086 bash[24289]: audit 2024-09-16T06:18:42.374055+0000 mgr.a (mgr.14373) 1804 : audit [DBG] from='client.51468 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:18:44.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:18:43 smithi047 bash[22744]: audit 2024-09-16T06:18:42.374055+0000 mgr.a (mgr.14373) 1804 : audit [DBG] from='client.51468 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:18:45.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:18:44 smithi157 bash[24585]: cluster 2024-09-16T06:18:43.358469+0000 mgr.a (mgr.14373) 1805 : cluster [DBG] pgmap v1251: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:18:45.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:18:44 smithi086 bash[24289]: cluster 2024-09-16T06:18:43.358469+0000 mgr.a (mgr.14373) 1805 : cluster [DBG] pgmap v1251: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:18:45.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:18:44 smithi047 bash[22744]: cluster 2024-09-16T06:18:43.358469+0000 mgr.a (mgr.14373) 1805 : cluster [DBG] pgmap v1251: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:18:47.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:18:46 smithi157 bash[24585]: cluster 2024-09-16T06:18:45.359219+0000 mgr.a (mgr.14373) 1806 : cluster [DBG] pgmap v1252: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:18:47.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:18:46 smithi086 bash[24289]: cluster 2024-09-16T06:18:45.359219+0000 mgr.a (mgr.14373) 1806 : cluster [DBG] pgmap v1252: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:18:47.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:18:46 smithi047 bash[22744]: cluster 2024-09-16T06:18:45.359219+0000 mgr.a (mgr.14373) 1806 : cluster [DBG] pgmap v1252: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:18:47.796 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:18:47.797 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:18:47.797 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:18:48.542 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:18:48.542 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:18:48.543 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:18:48.543 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:18:48.543 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:18:49.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:18:48 smithi157 bash[24585]: cluster 2024-09-16T06:18:47.361143+0000 mgr.a (mgr.14373) 1807 : cluster [DBG] pgmap v1253: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:18:49.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:18:48 smithi086 bash[24289]: cluster 2024-09-16T06:18:47.361143+0000 mgr.a (mgr.14373) 1807 : cluster [DBG] pgmap v1253: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:18:49.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:18:48 smithi047 bash[22744]: cluster 2024-09-16T06:18:47.361143+0000 mgr.a (mgr.14373) 1807 : cluster [DBG] pgmap v1253: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:18:50.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:18:49 smithi157 bash[24585]: audit 2024-09-16T06:18:48.124451+0000 mgr.a (mgr.14373) 1808 : audit [DBG] from='client.51543 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:18:50.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:18:49 smithi086 bash[24289]: audit 2024-09-16T06:18:48.124451+0000 mgr.a (mgr.14373) 1808 : audit [DBG] from='client.51543 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:18:50.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:18:49 smithi047 bash[22744]: audit 2024-09-16T06:18:48.124451+0000 mgr.a (mgr.14373) 1808 : audit [DBG] from='client.51543 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:18:51.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:18:50 smithi157 bash[24585]: cluster 2024-09-16T06:18:49.362045+0000 mgr.a (mgr.14373) 1809 : cluster [DBG] pgmap v1254: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:18:51.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:18:50 smithi086 bash[24289]: cluster 2024-09-16T06:18:49.362045+0000 mgr.a (mgr.14373) 1809 : cluster [DBG] pgmap v1254: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:18:51.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:18:50 smithi047 bash[22744]: cluster 2024-09-16T06:18:49.362045+0000 mgr.a (mgr.14373) 1809 : cluster [DBG] pgmap v1254: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:18:53.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:18:52 smithi157 bash[24585]: cluster 2024-09-16T06:18:51.362831+0000 mgr.a (mgr.14373) 1810 : cluster [DBG] pgmap v1255: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:18:53.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:18:52 smithi086 bash[24289]: cluster 2024-09-16T06:18:51.362831+0000 mgr.a (mgr.14373) 1810 : cluster [DBG] pgmap v1255: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:18:53.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:18:52 smithi047 bash[22744]: cluster 2024-09-16T06:18:51.362831+0000 mgr.a (mgr.14373) 1810 : cluster [DBG] pgmap v1255: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:18:53.544 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:18:53.544 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:18:53.545 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:18:54.289 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:18:54.289 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:18:54.289 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:18:54.290 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:18:54.290 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:18:55.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:18:54 smithi157 bash[24585]: cluster 2024-09-16T06:18:53.365044+0000 mgr.a (mgr.14373) 1811 : cluster [DBG] pgmap v1256: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:18:55.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:18:54 smithi086 bash[24289]: cluster 2024-09-16T06:18:53.365044+0000 mgr.a (mgr.14373) 1811 : cluster [DBG] pgmap v1256: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:18:55.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:18:54 smithi047 bash[22744]: cluster 2024-09-16T06:18:53.365044+0000 mgr.a (mgr.14373) 1811 : cluster [DBG] pgmap v1256: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:18:56.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:18:55 smithi157 bash[24585]: audit 2024-09-16T06:18:53.884107+0000 mgr.a (mgr.14373) 1812 : audit [DBG] from='client.51621 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:18:56.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:18:55 smithi086 bash[24289]: audit 2024-09-16T06:18:53.884107+0000 mgr.a (mgr.14373) 1812 : audit [DBG] from='client.51621 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:18:56.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:18:55 smithi047 bash[22744]: audit 2024-09-16T06:18:53.884107+0000 mgr.a (mgr.14373) 1812 : audit [DBG] from='client.51621 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:18:57.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:18:56 smithi157 bash[24585]: cluster 2024-09-16T06:18:55.365951+0000 mgr.a (mgr.14373) 1813 : cluster [DBG] pgmap v1257: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:18:57.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:18:56 smithi086 bash[24289]: cluster 2024-09-16T06:18:55.365951+0000 mgr.a (mgr.14373) 1813 : cluster [DBG] pgmap v1257: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:18:57.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:18:56 smithi047 bash[22744]: cluster 2024-09-16T06:18:55.365951+0000 mgr.a (mgr.14373) 1813 : cluster [DBG] pgmap v1257: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:18:59.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:18:58 smithi157 bash[24585]: cluster 2024-09-16T06:18:57.368186+0000 mgr.a (mgr.14373) 1814 : cluster [DBG] pgmap v1258: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:18:59.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:18:58 smithi086 bash[24289]: cluster 2024-09-16T06:18:57.368186+0000 mgr.a (mgr.14373) 1814 : cluster [DBG] pgmap v1258: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:18:59.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:18:58 smithi047 bash[22744]: cluster 2024-09-16T06:18:57.368186+0000 mgr.a (mgr.14373) 1814 : cluster [DBG] pgmap v1258: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:18:59.290 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:18:59.292 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:18:59.292 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:19:00.050 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:19:00.050 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:19:00.050 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:19:00.050 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:19:00.050 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:19:01.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:19:00 smithi157 bash[24585]: cluster 2024-09-16T06:18:59.368933+0000 mgr.a (mgr.14373) 1815 : cluster [DBG] pgmap v1259: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:19:01.055 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:19:00 smithi157 bash[24585]: audit 2024-09-16T06:18:59.620778+0000 mgr.a (mgr.14373) 1816 : audit [DBG] from='client.51696 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:19:01.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:19:00 smithi086 bash[24289]: cluster 2024-09-16T06:18:59.368933+0000 mgr.a (mgr.14373) 1815 : cluster [DBG] pgmap v1259: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:19:01.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:19:00 smithi086 bash[24289]: audit 2024-09-16T06:18:59.620778+0000 mgr.a (mgr.14373) 1816 : audit [DBG] from='client.51696 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:19:01.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:19:00 smithi047 bash[22744]: cluster 2024-09-16T06:18:59.368933+0000 mgr.a (mgr.14373) 1815 : cluster [DBG] pgmap v1259: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:19:01.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:19:00 smithi047 bash[22744]: audit 2024-09-16T06:18:59.620778+0000 mgr.a (mgr.14373) 1816 : audit [DBG] from='client.51696 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:19:03.055 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:19:02 smithi157 bash[24585]: cluster 2024-09-16T06:19:01.369813+0000 mgr.a (mgr.14373) 1817 : cluster [DBG] pgmap v1260: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:19:03.055 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:19:02 smithi157 bash[24585]: audit 2024-09-16T06:19:02.147856+0000 mon.b (mon.2) 210 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T06:19:03.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:19:02 smithi086 bash[24289]: cluster 2024-09-16T06:19:01.369813+0000 mgr.a (mgr.14373) 1817 : cluster [DBG] pgmap v1260: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:19:03.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:19:02 smithi086 bash[24289]: audit 2024-09-16T06:19:02.147856+0000 mon.b (mon.2) 210 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T06:19:03.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:19:02 smithi047 bash[22744]: cluster 2024-09-16T06:19:01.369813+0000 mgr.a (mgr.14373) 1817 : cluster [DBG] pgmap v1260: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:19:03.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:19:02 smithi047 bash[22744]: audit 2024-09-16T06:19:02.147856+0000 mon.b (mon.2) 210 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T06:19:04.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:19:03 smithi157 bash[24585]: audit 2024-09-16T06:19:02.973681+0000 mon.b (mon.2) 211 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T06:19:04.055 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:19:03 smithi157 bash[24585]: audit 2024-09-16T06:19:02.975461+0000 mon.b (mon.2) 212 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T06:19:04.055 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:19:03 smithi157 bash[24585]: audit 2024-09-16T06:19:02.985233+0000 mon.a (mon.0) 676 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:19:04.055 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:19:03 smithi157 bash[24585]: audit 2024-09-16T06:19:02.988171+0000 mon.b (mon.2) 213 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:19:04.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:19:03 smithi086 bash[24289]: audit 2024-09-16T06:19:02.973681+0000 mon.b (mon.2) 211 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T06:19:04.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:19:03 smithi086 bash[24289]: audit 2024-09-16T06:19:02.975461+0000 mon.b (mon.2) 212 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T06:19:04.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:19:03 smithi086 bash[24289]: audit 2024-09-16T06:19:02.985233+0000 mon.a (mon.0) 676 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:19:04.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:19:03 smithi086 bash[24289]: audit 2024-09-16T06:19:02.988171+0000 mon.b (mon.2) 213 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:19:04.089 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 06:19:03 smithi047 bash[22994]: debug 2024-09-16T06:19:03.721+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T06:19:04.089 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 06:19:03 smithi047 bash[22994]: debug 2024-09-16T06:19:03.721+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T06:19:04.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:19:03 smithi047 bash[22744]: audit 2024-09-16T06:19:02.973681+0000 mon.b (mon.2) 211 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T06:19:04.090 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:19:03 smithi047 bash[22744]: audit 2024-09-16T06:19:02.975461+0000 mon.b (mon.2) 212 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T06:19:04.090 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:19:03 smithi047 bash[22744]: audit 2024-09-16T06:19:02.985233+0000 mon.a (mon.0) 676 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:19:04.090 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:19:03 smithi047 bash[22744]: audit 2024-09-16T06:19:02.988171+0000 mon.b (mon.2) 213 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:19:05.051 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:19:05.052 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:19:05.052 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:19:05.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:19:04 smithi157 bash[24585]: audit 2024-09-16T06:19:02.992362+0000 mgr.a (mgr.14373) 1818 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:19:05.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:19:04 smithi157 bash[24585]: cluster 2024-09-16T06:19:03.371165+0000 mgr.a (mgr.14373) 1819 : cluster [DBG] pgmap v1261: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:19:05.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:19:04 smithi157 bash[24585]: audit 2024-09-16T06:19:03.724151+0000 mgr.a (mgr.14373) 1820 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T06:19:05.055 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:19:04 smithi157 bash[24585]: cephadm 2024-09-16T06:19:03.726324+0000 mgr.a (mgr.14373) 1821 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T06:19:05.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:19:04 smithi086 bash[24289]: audit 2024-09-16T06:19:02.992362+0000 mgr.a (mgr.14373) 1818 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:19:05.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:19:04 smithi086 bash[24289]: cluster 2024-09-16T06:19:03.371165+0000 mgr.a (mgr.14373) 1819 : cluster [DBG] pgmap v1261: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:19:05.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:19:04 smithi086 bash[24289]: audit 2024-09-16T06:19:03.724151+0000 mgr.a (mgr.14373) 1820 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T06:19:05.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:19:04 smithi086 bash[24289]: cephadm 2024-09-16T06:19:03.726324+0000 mgr.a (mgr.14373) 1821 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T06:19:05.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:19:04 smithi047 bash[22744]: audit 2024-09-16T06:19:02.992362+0000 mgr.a (mgr.14373) 1818 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:19:05.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:19:04 smithi047 bash[22744]: cluster 2024-09-16T06:19:03.371165+0000 mgr.a (mgr.14373) 1819 : cluster [DBG] pgmap v1261: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:19:05.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:19:04 smithi047 bash[22744]: audit 2024-09-16T06:19:03.724151+0000 mgr.a (mgr.14373) 1820 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T06:19:05.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:19:04 smithi047 bash[22744]: cephadm 2024-09-16T06:19:03.726324+0000 mgr.a (mgr.14373) 1821 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T06:19:05.788 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:19:05.788 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:19:05.788 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:19:05.789 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:19:05.789 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:19:07.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:19:06 smithi086 bash[24289]: cluster 2024-09-16T06:19:05.371993+0000 mgr.a (mgr.14373) 1822 : cluster [DBG] pgmap v1262: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:19:07.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:19:06 smithi086 bash[24289]: audit 2024-09-16T06:19:05.375000+0000 mgr.a (mgr.14373) 1823 : audit [DBG] from='client.51879 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:19:07.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:19:06 smithi047 bash[22744]: cluster 2024-09-16T06:19:05.371993+0000 mgr.a (mgr.14373) 1822 : cluster [DBG] pgmap v1262: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:19:07.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:19:06 smithi047 bash[22744]: audit 2024-09-16T06:19:05.375000+0000 mgr.a (mgr.14373) 1823 : audit [DBG] from='client.51879 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:19:07.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:19:06 smithi157 bash[24585]: cluster 2024-09-16T06:19:05.371993+0000 mgr.a (mgr.14373) 1822 : cluster [DBG] pgmap v1262: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:19:07.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:19:06 smithi157 bash[24585]: audit 2024-09-16T06:19:05.375000+0000 mgr.a (mgr.14373) 1823 : audit [DBG] from='client.51879 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:19:09.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:19:08 smithi086 bash[24289]: cluster 2024-09-16T06:19:07.374325+0000 mgr.a (mgr.14373) 1824 : cluster [DBG] pgmap v1263: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:19:09.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:19:08 smithi047 bash[22744]: cluster 2024-09-16T06:19:07.374325+0000 mgr.a (mgr.14373) 1824 : cluster [DBG] pgmap v1263: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:19:09.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:19:08 smithi157 bash[24585]: cluster 2024-09-16T06:19:07.374325+0000 mgr.a (mgr.14373) 1824 : cluster [DBG] pgmap v1263: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:19:10.789 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:19:10.790 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:19:10.790 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:19:11.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:19:10 smithi086 bash[24289]: cluster 2024-09-16T06:19:09.375082+0000 mgr.a (mgr.14373) 1825 : cluster [DBG] pgmap v1264: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:19:11.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:19:10 smithi047 bash[22744]: cluster 2024-09-16T06:19:09.375082+0000 mgr.a (mgr.14373) 1825 : cluster [DBG] pgmap v1264: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:19:11.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:19:10 smithi157 bash[24585]: cluster 2024-09-16T06:19:09.375082+0000 mgr.a (mgr.14373) 1825 : cluster [DBG] pgmap v1264: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:19:11.551 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:19:11.551 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:19:11.551 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:19:11.551 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:19:11.552 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:19:13.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:19:12 smithi086 bash[24289]: audit 2024-09-16T06:19:11.122889+0000 mgr.a (mgr.14373) 1826 : audit [DBG] from='client.51954 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:19:13.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:19:12 smithi086 bash[24289]: cluster 2024-09-16T06:19:11.375566+0000 mgr.a (mgr.14373) 1827 : cluster [DBG] pgmap v1265: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:19:13.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:19:12 smithi047 bash[22744]: audit 2024-09-16T06:19:11.122889+0000 mgr.a (mgr.14373) 1826 : audit [DBG] from='client.51954 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:19:13.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:19:12 smithi047 bash[22744]: cluster 2024-09-16T06:19:11.375566+0000 mgr.a (mgr.14373) 1827 : cluster [DBG] pgmap v1265: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:19:13.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:19:12 smithi157 bash[24585]: audit 2024-09-16T06:19:11.122889+0000 mgr.a (mgr.14373) 1826 : audit [DBG] from='client.51954 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:19:13.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:19:12 smithi157 bash[24585]: cluster 2024-09-16T06:19:11.375566+0000 mgr.a (mgr.14373) 1827 : cluster [DBG] pgmap v1265: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:19:15.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:19:14 smithi047 bash[22744]: cluster 2024-09-16T06:19:13.377834+0000 mgr.a (mgr.14373) 1828 : cluster [DBG] pgmap v1266: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.8 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:19:15.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:19:14 smithi157 bash[24585]: cluster 2024-09-16T06:19:13.377834+0000 mgr.a (mgr.14373) 1828 : cluster [DBG] pgmap v1266: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.8 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:19:15.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:19:14 smithi086 bash[24289]: cluster 2024-09-16T06:19:13.377834+0000 mgr.a (mgr.14373) 1828 : cluster [DBG] pgmap v1266: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.8 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:19:16.553 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:19:16.553 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:19:16.553 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:19:17.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:19:16 smithi047 bash[22744]: cluster 2024-09-16T06:19:15.378651+0000 mgr.a (mgr.14373) 1829 : cluster [DBG] pgmap v1267: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 6.9 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T06:19:17.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:19:16 smithi157 bash[24585]: cluster 2024-09-16T06:19:15.378651+0000 mgr.a (mgr.14373) 1829 : cluster [DBG] pgmap v1267: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 6.9 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T06:19:17.318 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:19:17.318 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:19:17.318 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:19:17.318 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:19:17.318 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:19:17.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:19:16 smithi086 bash[24289]: cluster 2024-09-16T06:19:15.378651+0000 mgr.a (mgr.14373) 1829 : cluster [DBG] pgmap v1267: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 6.9 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T06:19:19.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:19:18 smithi047 bash[22744]: audit 2024-09-16T06:19:16.882381+0000 mgr.a (mgr.14373) 1830 : audit [DBG] from='client.52032 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:19:19.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:19:18 smithi047 bash[22744]: cluster 2024-09-16T06:19:17.379806+0000 mgr.a (mgr.14373) 1831 : cluster [DBG] pgmap v1268: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:19:19.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:19:18 smithi157 bash[24585]: audit 2024-09-16T06:19:16.882381+0000 mgr.a (mgr.14373) 1830 : audit [DBG] from='client.52032 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:19:19.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:19:18 smithi157 bash[24585]: cluster 2024-09-16T06:19:17.379806+0000 mgr.a (mgr.14373) 1831 : cluster [DBG] pgmap v1268: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:19:19.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:19:18 smithi086 bash[24289]: audit 2024-09-16T06:19:16.882381+0000 mgr.a (mgr.14373) 1830 : audit [DBG] from='client.52032 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:19:19.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:19:18 smithi086 bash[24289]: cluster 2024-09-16T06:19:17.379806+0000 mgr.a (mgr.14373) 1831 : cluster [DBG] pgmap v1268: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:19:21.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:19:20 smithi047 bash[22744]: cluster 2024-09-16T06:19:19.380523+0000 mgr.a (mgr.14373) 1832 : cluster [DBG] pgmap v1269: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T06:19:21.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:19:20 smithi157 bash[24585]: cluster 2024-09-16T06:19:19.380523+0000 mgr.a (mgr.14373) 1832 : cluster [DBG] pgmap v1269: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T06:19:21.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:19:20 smithi086 bash[24289]: cluster 2024-09-16T06:19:19.380523+0000 mgr.a (mgr.14373) 1832 : cluster [DBG] pgmap v1269: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T06:19:22.319 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:19:22.320 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:19:22.320 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:19:23.119 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:19:23.119 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:19:23.119 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:19:23.119 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:19:23.120 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:19:23.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:19:22 smithi157 bash[24585]: cluster 2024-09-16T06:19:21.381272+0000 mgr.a (mgr.14373) 1833 : cluster [DBG] pgmap v1270: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T06:19:23.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:19:22 smithi086 bash[24289]: cluster 2024-09-16T06:19:21.381272+0000 mgr.a (mgr.14373) 1833 : cluster [DBG] pgmap v1270: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T06:19:23.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:19:22 smithi047 bash[22744]: cluster 2024-09-16T06:19:21.381272+0000 mgr.a (mgr.14373) 1833 : cluster [DBG] pgmap v1270: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T06:19:24.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:19:23 smithi157 bash[24585]: audit 2024-09-16T06:19:22.658601+0000 mgr.a (mgr.14373) 1834 : audit [DBG] from='client.52110 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:19:24.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:19:23 smithi086 bash[24289]: audit 2024-09-16T06:19:22.658601+0000 mgr.a (mgr.14373) 1834 : audit [DBG] from='client.52110 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:19:24.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:19:23 smithi047 bash[22744]: audit 2024-09-16T06:19:22.658601+0000 mgr.a (mgr.14373) 1834 : audit [DBG] from='client.52110 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:19:25.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:19:24 smithi157 bash[24585]: cluster 2024-09-16T06:19:23.383983+0000 mgr.a (mgr.14373) 1835 : cluster [DBG] pgmap v1271: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:19:25.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:19:24 smithi086 bash[24289]: cluster 2024-09-16T06:19:23.383983+0000 mgr.a (mgr.14373) 1835 : cluster [DBG] pgmap v1271: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:19:25.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:19:24 smithi047 bash[22744]: cluster 2024-09-16T06:19:23.383983+0000 mgr.a (mgr.14373) 1835 : cluster [DBG] pgmap v1271: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:19:27.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:19:26 smithi157 bash[24585]: cluster 2024-09-16T06:19:25.384753+0000 mgr.a (mgr.14373) 1836 : cluster [DBG] pgmap v1272: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-16T06:19:27.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:19:26 smithi086 bash[24289]: cluster 2024-09-16T06:19:25.384753+0000 mgr.a (mgr.14373) 1836 : cluster [DBG] pgmap v1272: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-16T06:19:27.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:19:26 smithi047 bash[22744]: cluster 2024-09-16T06:19:25.384753+0000 mgr.a (mgr.14373) 1836 : cluster [DBG] pgmap v1272: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-16T06:19:28.121 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:19:28.122 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:19:28.122 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:19:28.903 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:19:28.904 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:19:28.904 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:19:28.904 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:19:28.904 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:19:29.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:19:28 smithi157 bash[24585]: cluster 2024-09-16T06:19:27.386738+0000 mgr.a (mgr.14373) 1837 : cluster [DBG] pgmap v1273: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-16T06:19:29.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:19:28 smithi086 bash[24289]: cluster 2024-09-16T06:19:27.386738+0000 mgr.a (mgr.14373) 1837 : cluster [DBG] pgmap v1273: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-16T06:19:29.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:19:28 smithi047 bash[22744]: cluster 2024-09-16T06:19:27.386738+0000 mgr.a (mgr.14373) 1837 : cluster [DBG] pgmap v1273: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-16T06:19:30.305 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:19:29 smithi157 bash[24585]: audit 2024-09-16T06:19:28.454915+0000 mgr.a (mgr.14373) 1838 : audit [DBG] from='client.52182 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:19:30.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:19:29 smithi086 bash[24289]: audit 2024-09-16T06:19:28.454915+0000 mgr.a (mgr.14373) 1838 : audit [DBG] from='client.52182 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:19:30.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:19:29 smithi047 bash[22744]: audit 2024-09-16T06:19:28.454915+0000 mgr.a (mgr.14373) 1838 : audit [DBG] from='client.52182 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:19:31.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:19:30 smithi157 bash[24585]: cluster 2024-09-16T06:19:29.387744+0000 mgr.a (mgr.14373) 1839 : cluster [DBG] pgmap v1274: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:19:31.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:19:30 smithi086 bash[24289]: cluster 2024-09-16T06:19:29.387744+0000 mgr.a (mgr.14373) 1839 : cluster [DBG] pgmap v1274: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:19:31.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:19:30 smithi047 bash[22744]: cluster 2024-09-16T06:19:29.387744+0000 mgr.a (mgr.14373) 1839 : cluster [DBG] pgmap v1274: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:19:32.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:19:31 smithi157 bash[24585]: cluster 2024-09-16T06:19:31.388684+0000 mgr.a (mgr.14373) 1840 : cluster [DBG] pgmap v1275: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:19:32.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:19:31 smithi086 bash[24289]: cluster 2024-09-16T06:19:31.388684+0000 mgr.a (mgr.14373) 1840 : cluster [DBG] pgmap v1275: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:19:32.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:19:31 smithi047 bash[22744]: cluster 2024-09-16T06:19:31.388684+0000 mgr.a (mgr.14373) 1840 : cluster [DBG] pgmap v1275: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:19:33.905 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:19:33.906 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:19:33.906 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:19:34.659 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:19:34.659 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:19:34.659 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:19:34.659 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:19:34.659 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:19:34.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:19:34 smithi157 bash[24585]: cluster 2024-09-16T06:19:33.391073+0000 mgr.a (mgr.14373) 1841 : cluster [DBG] pgmap v1276: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:19:34.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:19:34 smithi086 bash[24289]: cluster 2024-09-16T06:19:33.391073+0000 mgr.a (mgr.14373) 1841 : cluster [DBG] pgmap v1276: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:19:34.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:19:34 smithi047 bash[22744]: cluster 2024-09-16T06:19:33.391073+0000 mgr.a (mgr.14373) 1841 : cluster [DBG] pgmap v1276: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:19:35.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:19:35 smithi157 bash[24585]: audit 2024-09-16T06:19:34.237373+0000 mgr.a (mgr.14373) 1842 : audit [DBG] from='client.52260 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:19:35.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:19:35 smithi086 bash[24289]: audit 2024-09-16T06:19:34.237373+0000 mgr.a (mgr.14373) 1842 : audit [DBG] from='client.52260 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:19:35.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:19:35 smithi047 bash[22744]: audit 2024-09-16T06:19:34.237373+0000 mgr.a (mgr.14373) 1842 : audit [DBG] from='client.52260 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:19:36.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:19:36 smithi157 bash[24585]: cluster 2024-09-16T06:19:35.392182+0000 mgr.a (mgr.14373) 1843 : cluster [DBG] pgmap v1277: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:19:36.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:19:36 smithi086 bash[24289]: cluster 2024-09-16T06:19:35.392182+0000 mgr.a (mgr.14373) 1843 : cluster [DBG] pgmap v1277: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:19:36.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:19:36 smithi047 bash[22744]: cluster 2024-09-16T06:19:35.392182+0000 mgr.a (mgr.14373) 1843 : cluster [DBG] pgmap v1277: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:19:38.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:19:38 smithi157 bash[24585]: cluster 2024-09-16T06:19:37.394536+0000 mgr.a (mgr.14373) 1844 : cluster [DBG] pgmap v1278: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:19:38.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:19:38 smithi086 bash[24289]: cluster 2024-09-16T06:19:37.394536+0000 mgr.a (mgr.14373) 1844 : cluster [DBG] pgmap v1278: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:19:38.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:19:38 smithi047 bash[22744]: cluster 2024-09-16T06:19:37.394536+0000 mgr.a (mgr.14373) 1844 : cluster [DBG] pgmap v1278: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:19:39.661 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:19:39.661 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:19:39.661 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:19:40.398 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:19:40.398 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:19:40.398 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:19:40.398 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:19:40.398 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:19:40.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:19:40 smithi157 bash[24585]: cluster 2024-09-16T06:19:39.395471+0000 mgr.a (mgr.14373) 1845 : cluster [DBG] pgmap v1279: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:19:40.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:19:40 smithi086 bash[24289]: cluster 2024-09-16T06:19:39.395471+0000 mgr.a (mgr.14373) 1845 : cluster [DBG] pgmap v1279: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:19:40.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:19:40 smithi047 bash[22744]: cluster 2024-09-16T06:19:39.395471+0000 mgr.a (mgr.14373) 1845 : cluster [DBG] pgmap v1279: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:19:41.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:19:41 smithi157 bash[24585]: audit 2024-09-16T06:19:39.996656+0000 mgr.a (mgr.14373) 1846 : audit [DBG] from='client.52335 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:19:41.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:19:41 smithi086 bash[24289]: audit 2024-09-16T06:19:39.996656+0000 mgr.a (mgr.14373) 1846 : audit [DBG] from='client.52335 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:19:41.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:19:41 smithi047 bash[22744]: audit 2024-09-16T06:19:39.996656+0000 mgr.a (mgr.14373) 1846 : audit [DBG] from='client.52335 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:19:42.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:19:42 smithi157 bash[24585]: cluster 2024-09-16T06:19:41.396376+0000 mgr.a (mgr.14373) 1847 : cluster [DBG] pgmap v1280: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:19:42.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:19:42 smithi086 bash[24289]: cluster 2024-09-16T06:19:41.396376+0000 mgr.a (mgr.14373) 1847 : cluster [DBG] pgmap v1280: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:19:42.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:19:42 smithi047 bash[22744]: cluster 2024-09-16T06:19:41.396376+0000 mgr.a (mgr.14373) 1847 : cluster [DBG] pgmap v1280: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:19:44.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:19:44 smithi157 bash[24585]: cluster 2024-09-16T06:19:43.398631+0000 mgr.a (mgr.14373) 1848 : cluster [DBG] pgmap v1281: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:19:44.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:19:44 smithi086 bash[24289]: cluster 2024-09-16T06:19:43.398631+0000 mgr.a (mgr.14373) 1848 : cluster [DBG] pgmap v1281: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:19:44.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:19:44 smithi047 bash[22744]: cluster 2024-09-16T06:19:43.398631+0000 mgr.a (mgr.14373) 1848 : cluster [DBG] pgmap v1281: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:19:45.399 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:19:45.400 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:19:45.400 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:19:46.138 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:19:46.138 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:19:46.139 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:19:46.139 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:19:46.139 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:19:46.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:19:46 smithi157 bash[24585]: cluster 2024-09-16T06:19:45.399395+0000 mgr.a (mgr.14373) 1849 : cluster [DBG] pgmap v1282: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:19:46.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:19:46 smithi157 bash[24585]: audit 2024-09-16T06:19:45.736675+0000 mgr.a (mgr.14373) 1850 : audit [DBG] from='client.52413 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:19:46.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:19:46 smithi086 bash[24289]: cluster 2024-09-16T06:19:45.399395+0000 mgr.a (mgr.14373) 1849 : cluster [DBG] pgmap v1282: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:19:46.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:19:46 smithi086 bash[24289]: audit 2024-09-16T06:19:45.736675+0000 mgr.a (mgr.14373) 1850 : audit [DBG] from='client.52413 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:19:46.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:19:46 smithi047 bash[22744]: cluster 2024-09-16T06:19:45.399395+0000 mgr.a (mgr.14373) 1849 : cluster [DBG] pgmap v1282: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:19:46.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:19:46 smithi047 bash[22744]: audit 2024-09-16T06:19:45.736675+0000 mgr.a (mgr.14373) 1850 : audit [DBG] from='client.52413 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:19:48.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:19:48 smithi157 bash[24585]: cluster 2024-09-16T06:19:47.401726+0000 mgr.a (mgr.14373) 1851 : cluster [DBG] pgmap v1283: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:19:48.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:19:48 smithi086 bash[24289]: cluster 2024-09-16T06:19:47.401726+0000 mgr.a (mgr.14373) 1851 : cluster [DBG] pgmap v1283: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:19:48.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:19:48 smithi047 bash[22744]: cluster 2024-09-16T06:19:47.401726+0000 mgr.a (mgr.14373) 1851 : cluster [DBG] pgmap v1283: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:19:50.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:19:50 smithi157 bash[24585]: cluster 2024-09-16T06:19:49.402488+0000 mgr.a (mgr.14373) 1852 : cluster [DBG] pgmap v1284: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:19:50.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:19:50 smithi086 bash[24289]: cluster 2024-09-16T06:19:49.402488+0000 mgr.a (mgr.14373) 1852 : cluster [DBG] pgmap v1284: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:19:50.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:19:50 smithi047 bash[22744]: cluster 2024-09-16T06:19:49.402488+0000 mgr.a (mgr.14373) 1852 : cluster [DBG] pgmap v1284: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:19:51.140 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:19:51.140 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:19:51.141 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:19:51.877 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:19:51.877 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:19:51.877 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:19:51.877 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:19:51.877 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:19:52.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:19:52 smithi157 bash[24585]: cluster 2024-09-16T06:19:51.403187+0000 mgr.a (mgr.14373) 1853 : cluster [DBG] pgmap v1285: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:19:52.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:19:52 smithi157 bash[24585]: audit 2024-09-16T06:19:51.472573+0000 mgr.a (mgr.14373) 1854 : audit [DBG] from='client.52491 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:19:52.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:19:52 smithi086 bash[24289]: cluster 2024-09-16T06:19:51.403187+0000 mgr.a (mgr.14373) 1853 : cluster [DBG] pgmap v1285: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:19:52.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:19:52 smithi086 bash[24289]: audit 2024-09-16T06:19:51.472573+0000 mgr.a (mgr.14373) 1854 : audit [DBG] from='client.52491 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:19:52.840 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:19:52 smithi047 bash[22744]: cluster 2024-09-16T06:19:51.403187+0000 mgr.a (mgr.14373) 1853 : cluster [DBG] pgmap v1285: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:19:52.840 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:19:52 smithi047 bash[22744]: audit 2024-09-16T06:19:51.472573+0000 mgr.a (mgr.14373) 1854 : audit [DBG] from='client.52491 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:19:54.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:19:54 smithi157 bash[24585]: cluster 2024-09-16T06:19:53.405921+0000 mgr.a (mgr.14373) 1855 : cluster [DBG] pgmap v1286: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-16T06:19:54.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:19:54 smithi086 bash[24289]: cluster 2024-09-16T06:19:53.405921+0000 mgr.a (mgr.14373) 1855 : cluster [DBG] pgmap v1286: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-16T06:19:54.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:19:54 smithi047 bash[22744]: cluster 2024-09-16T06:19:53.405921+0000 mgr.a (mgr.14373) 1855 : cluster [DBG] pgmap v1286: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-16T06:19:56.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:19:56 smithi157 bash[24585]: cluster 2024-09-16T06:19:55.406726+0000 mgr.a (mgr.14373) 1856 : cluster [DBG] pgmap v1287: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T06:19:56.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:19:56 smithi086 bash[24289]: cluster 2024-09-16T06:19:55.406726+0000 mgr.a (mgr.14373) 1856 : cluster [DBG] pgmap v1287: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T06:19:56.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:19:56 smithi047 bash[22744]: cluster 2024-09-16T06:19:55.406726+0000 mgr.a (mgr.14373) 1856 : cluster [DBG] pgmap v1287: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T06:19:56.878 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:19:56.879 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:19:56.879 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:19:57.651 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:19:57.651 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:19:57.652 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:19:57.652 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:19:57.652 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:19:58.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:19:58 smithi157 bash[24585]: audit 2024-09-16T06:19:57.214457+0000 mgr.a (mgr.14373) 1857 : audit [DBG] from='client.52569 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:19:58.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:19:58 smithi157 bash[24585]: cluster 2024-09-16T06:19:57.408034+0000 mgr.a (mgr.14373) 1858 : cluster [DBG] pgmap v1288: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:19:58.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:19:58 smithi086 bash[24289]: audit 2024-09-16T06:19:57.214457+0000 mgr.a (mgr.14373) 1857 : audit [DBG] from='client.52569 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:19:58.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:19:58 smithi086 bash[24289]: cluster 2024-09-16T06:19:57.408034+0000 mgr.a (mgr.14373) 1858 : cluster [DBG] pgmap v1288: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:19:58.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:19:58 smithi047 bash[22744]: audit 2024-09-16T06:19:57.214457+0000 mgr.a (mgr.14373) 1857 : audit [DBG] from='client.52569 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:19:58.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:19:58 smithi047 bash[22744]: cluster 2024-09-16T06:19:57.408034+0000 mgr.a (mgr.14373) 1858 : cluster [DBG] pgmap v1288: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:20:00.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:20:00 smithi157 bash[24585]: cluster 2024-09-16T06:19:59.408919+0000 mgr.a (mgr.14373) 1859 : cluster [DBG] pgmap v1289: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:20:00.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:20:00 smithi157 bash[24585]: cluster 2024-09-16T06:20:00.000159+0000 mon.a (mon.0) 677 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-16T06:20:00.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:20:00 smithi086 bash[24289]: cluster 2024-09-16T06:19:59.408919+0000 mgr.a (mgr.14373) 1859 : cluster [DBG] pgmap v1289: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:20:00.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:20:00 smithi086 bash[24289]: cluster 2024-09-16T06:20:00.000159+0000 mon.a (mon.0) 677 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-16T06:20:00.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:20:00 smithi047 bash[22744]: cluster 2024-09-16T06:19:59.408919+0000 mgr.a (mgr.14373) 1859 : cluster [DBG] pgmap v1289: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:20:00.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:20:00 smithi047 bash[22744]: cluster 2024-09-16T06:20:00.000159+0000 mon.a (mon.0) 677 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-16T06:20:02.656 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:20:02.656 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:20:02.656 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:20:02.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:20:02 smithi157 bash[24585]: cluster 2024-09-16T06:20:01.409667+0000 mgr.a (mgr.14373) 1860 : cluster [DBG] pgmap v1290: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T06:20:02.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:20:02 smithi086 bash[24289]: cluster 2024-09-16T06:20:01.409667+0000 mgr.a (mgr.14373) 1860 : cluster [DBG] pgmap v1290: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T06:20:02.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:20:02 smithi047 bash[22744]: cluster 2024-09-16T06:20:01.409667+0000 mgr.a (mgr.14373) 1860 : cluster [DBG] pgmap v1290: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T06:20:03.448 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:20:03.448 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:20:03.448 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:20:03.448 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:20:03.448 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:20:04.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:20:04 smithi157 bash[24585]: audit 2024-09-16T06:20:02.995110+0000 mgr.a (mgr.14373) 1861 : audit [DBG] from='client.52647 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:20:04.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:20:04 smithi157 bash[24585]: cluster 2024-09-16T06:20:03.411214+0000 mgr.a (mgr.14373) 1862 : cluster [DBG] pgmap v1291: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:20:04.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:20:04 smithi157 bash[24585]: audit 2024-09-16T06:20:03.778718+0000 mon.b (mon.2) 214 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T06:20:04.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:20:04 smithi086 bash[24289]: audit 2024-09-16T06:20:02.995110+0000 mgr.a (mgr.14373) 1861 : audit [DBG] from='client.52647 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:20:04.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:20:04 smithi086 bash[24289]: cluster 2024-09-16T06:20:03.411214+0000 mgr.a (mgr.14373) 1862 : cluster [DBG] pgmap v1291: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:20:04.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:20:04 smithi086 bash[24289]: audit 2024-09-16T06:20:03.778718+0000 mon.b (mon.2) 214 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T06:20:04.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:20:04 smithi047 bash[22744]: audit 2024-09-16T06:20:02.995110+0000 mgr.a (mgr.14373) 1861 : audit [DBG] from='client.52647 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:20:04.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:20:04 smithi047 bash[22744]: cluster 2024-09-16T06:20:03.411214+0000 mgr.a (mgr.14373) 1862 : cluster [DBG] pgmap v1291: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:20:04.840 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:20:04 smithi047 bash[22744]: audit 2024-09-16T06:20:03.778718+0000 mon.b (mon.2) 214 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T06:20:06.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:20:06 smithi157 bash[24585]: cluster 2024-09-16T06:20:05.412118+0000 mgr.a (mgr.14373) 1863 : cluster [DBG] pgmap v1292: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-16T06:20:06.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:20:06 smithi086 bash[24289]: cluster 2024-09-16T06:20:05.412118+0000 mgr.a (mgr.14373) 1863 : cluster [DBG] pgmap v1292: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-16T06:20:06.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:20:06 smithi047 bash[22744]: cluster 2024-09-16T06:20:05.412118+0000 mgr.a (mgr.14373) 1863 : cluster [DBG] pgmap v1292: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-16T06:20:08.449 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:20:08.450 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:20:08.450 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:20:08.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:20:08 smithi157 bash[24585]: cluster 2024-09-16T06:20:07.414175+0000 mgr.a (mgr.14373) 1864 : cluster [DBG] pgmap v1293: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-16T06:20:08.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:20:08 smithi086 bash[24289]: cluster 2024-09-16T06:20:07.414175+0000 mgr.a (mgr.14373) 1864 : cluster [DBG] pgmap v1293: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-16T06:20:08.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:20:08 smithi047 bash[22744]: cluster 2024-09-16T06:20:07.414175+0000 mgr.a (mgr.14373) 1864 : cluster [DBG] pgmap v1293: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-16T06:20:09.230 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:20:09.230 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:20:09.230 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:20:09.230 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:20:09.230 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:20:09.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:20:09 smithi157 bash[24585]: audit 2024-09-16T06:20:08.782995+0000 mgr.a (mgr.14373) 1865 : audit [DBG] from='client.52725 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:20:09.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:20:09 smithi157 bash[24585]: audit 2024-09-16T06:20:09.142134+0000 mon.a (mon.0) 678 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:20:09.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:20:09 smithi157 bash[24585]: audit 2024-09-16T06:20:09.146041+0000 mon.a (mon.0) 679 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:20:09.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:20:09 smithi157 bash[24585]: audit 2024-09-16T06:20:09.151607+0000 mon.a (mon.0) 680 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:20:09.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:20:09 smithi157 bash[24585]: audit 2024-09-16T06:20:09.155505+0000 mon.a (mon.0) 681 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:20:09.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:20:09 smithi157 bash[24585]: audit 2024-09-16T06:20:09.158208+0000 mon.a (mon.0) 682 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:20:09.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:20:09 smithi157 bash[24585]: audit 2024-09-16T06:20:09.163902+0000 mon.a (mon.0) 683 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:20:09.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:20:09 smithi086 bash[24289]: audit 2024-09-16T06:20:08.782995+0000 mgr.a (mgr.14373) 1865 : audit [DBG] from='client.52725 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:20:09.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:20:09 smithi086 bash[24289]: audit 2024-09-16T06:20:09.142134+0000 mon.a (mon.0) 678 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:20:09.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:20:09 smithi086 bash[24289]: audit 2024-09-16T06:20:09.146041+0000 mon.a (mon.0) 679 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:20:09.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:20:09 smithi086 bash[24289]: audit 2024-09-16T06:20:09.151607+0000 mon.a (mon.0) 680 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:20:09.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:20:09 smithi086 bash[24289]: audit 2024-09-16T06:20:09.155505+0000 mon.a (mon.0) 681 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:20:09.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:20:09 smithi086 bash[24289]: audit 2024-09-16T06:20:09.158208+0000 mon.a (mon.0) 682 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:20:09.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:20:09 smithi086 bash[24289]: audit 2024-09-16T06:20:09.163902+0000 mon.a (mon.0) 683 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:20:09.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:20:09 smithi047 bash[22744]: audit 2024-09-16T06:20:08.782995+0000 mgr.a (mgr.14373) 1865 : audit [DBG] from='client.52725 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:20:09.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:20:09 smithi047 bash[22744]: audit 2024-09-16T06:20:09.142134+0000 mon.a (mon.0) 678 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:20:09.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:20:09 smithi047 bash[22744]: audit 2024-09-16T06:20:09.146041+0000 mon.a (mon.0) 679 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:20:09.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:20:09 smithi047 bash[22744]: audit 2024-09-16T06:20:09.151607+0000 mon.a (mon.0) 680 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:20:09.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:20:09 smithi047 bash[22744]: audit 2024-09-16T06:20:09.155505+0000 mon.a (mon.0) 681 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:20:09.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:20:09 smithi047 bash[22744]: audit 2024-09-16T06:20:09.158208+0000 mon.a (mon.0) 682 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:20:09.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:20:09 smithi047 bash[22744]: audit 2024-09-16T06:20:09.163902+0000 mon.a (mon.0) 683 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:20:10.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:20:10 smithi157 bash[24585]: cluster 2024-09-16T06:20:09.415051+0000 mgr.a (mgr.14373) 1866 : cluster [DBG] pgmap v1294: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:20:10.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:20:10 smithi157 bash[24585]: audit 2024-09-16T06:20:09.927986+0000 mon.b (mon.2) 215 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T06:20:10.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:20:10 smithi157 bash[24585]: audit 2024-09-16T06:20:09.930085+0000 mon.b (mon.2) 216 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T06:20:10.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:20:10 smithi157 bash[24585]: audit 2024-09-16T06:20:09.943485+0000 mon.a (mon.0) 684 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:20:10.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:20:10 smithi157 bash[24585]: audit 2024-09-16T06:20:09.947347+0000 mon.b (mon.2) 217 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:20:10.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:20:10 smithi086 bash[24289]: cluster 2024-09-16T06:20:09.415051+0000 mgr.a (mgr.14373) 1866 : cluster [DBG] pgmap v1294: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:20:10.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:20:10 smithi086 bash[24289]: audit 2024-09-16T06:20:09.927986+0000 mon.b (mon.2) 215 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T06:20:10.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:20:10 smithi086 bash[24289]: audit 2024-09-16T06:20:09.930085+0000 mon.b (mon.2) 216 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T06:20:10.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:20:10 smithi086 bash[24289]: audit 2024-09-16T06:20:09.943485+0000 mon.a (mon.0) 684 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:20:10.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:20:10 smithi086 bash[24289]: audit 2024-09-16T06:20:09.947347+0000 mon.b (mon.2) 217 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:20:10.839 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 06:20:10 smithi047 bash[22994]: debug 2024-09-16T06:20:10.667+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T06:20:10.839 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 06:20:10 smithi047 bash[22994]: debug 2024-09-16T06:20:10.671+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T06:20:10.840 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:20:10 smithi047 bash[22744]: cluster 2024-09-16T06:20:09.415051+0000 mgr.a (mgr.14373) 1866 : cluster [DBG] pgmap v1294: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:20:10.840 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:20:10 smithi047 bash[22744]: audit 2024-09-16T06:20:09.927986+0000 mon.b (mon.2) 215 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T06:20:10.840 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:20:10 smithi047 bash[22744]: audit 2024-09-16T06:20:09.930085+0000 mon.b (mon.2) 216 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T06:20:10.840 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:20:10 smithi047 bash[22744]: audit 2024-09-16T06:20:09.943485+0000 mon.a (mon.0) 684 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:20:10.840 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:20:10 smithi047 bash[22744]: audit 2024-09-16T06:20:09.947347+0000 mon.b (mon.2) 217 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:20:11.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:20:11 smithi157 bash[24585]: audit 2024-09-16T06:20:09.951602+0000 mgr.a (mgr.14373) 1867 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:20:11.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:20:11 smithi157 bash[24585]: audit 2024-09-16T06:20:10.674094+0000 mgr.a (mgr.14373) 1868 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T06:20:11.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:20:11 smithi157 bash[24585]: cephadm 2024-09-16T06:20:10.676101+0000 mgr.a (mgr.14373) 1869 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T06:20:11.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:20:11 smithi086 bash[24289]: audit 2024-09-16T06:20:09.951602+0000 mgr.a (mgr.14373) 1867 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:20:11.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:20:11 smithi086 bash[24289]: audit 2024-09-16T06:20:10.674094+0000 mgr.a (mgr.14373) 1868 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T06:20:11.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:20:11 smithi086 bash[24289]: cephadm 2024-09-16T06:20:10.676101+0000 mgr.a (mgr.14373) 1869 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T06:20:11.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:20:11 smithi047 bash[22744]: audit 2024-09-16T06:20:09.951602+0000 mgr.a (mgr.14373) 1867 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:20:11.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:20:11 smithi047 bash[22744]: audit 2024-09-16T06:20:10.674094+0000 mgr.a (mgr.14373) 1868 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T06:20:11.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:20:11 smithi047 bash[22744]: cephadm 2024-09-16T06:20:10.676101+0000 mgr.a (mgr.14373) 1869 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T06:20:12.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:20:12 smithi157 bash[24585]: cluster 2024-09-16T06:20:11.416026+0000 mgr.a (mgr.14373) 1870 : cluster [DBG] pgmap v1295: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:20:12.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:20:12 smithi086 bash[24289]: cluster 2024-09-16T06:20:11.416026+0000 mgr.a (mgr.14373) 1870 : cluster [DBG] pgmap v1295: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:20:12.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:20:12 smithi047 bash[22744]: cluster 2024-09-16T06:20:11.416026+0000 mgr.a (mgr.14373) 1870 : cluster [DBG] pgmap v1295: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:20:14.231 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:20:14.232 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:20:14.232 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:20:14.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:20:14 smithi157 bash[24585]: cluster 2024-09-16T06:20:13.418256+0000 mgr.a (mgr.14373) 1871 : cluster [DBG] pgmap v1296: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:20:14.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:20:14 smithi086 bash[24289]: cluster 2024-09-16T06:20:13.418256+0000 mgr.a (mgr.14373) 1871 : cluster [DBG] pgmap v1296: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:20:14.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:20:14 smithi047 bash[22744]: cluster 2024-09-16T06:20:13.418256+0000 mgr.a (mgr.14373) 1871 : cluster [DBG] pgmap v1296: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:20:15.004 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:20:15.004 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:20:15.004 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:20:15.005 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:20:15.005 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:20:15.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:20:15 smithi086 bash[24289]: audit 2024-09-16T06:20:14.567836+0000 mgr.a (mgr.14373) 1872 : audit [DBG] from='client.52908 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:20:15.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:20:15 smithi047 bash[22744]: audit 2024-09-16T06:20:14.567836+0000 mgr.a (mgr.14373) 1872 : audit [DBG] from='client.52908 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:20:16.055 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:20:15 smithi157 bash[24585]: audit 2024-09-16T06:20:14.567836+0000 mgr.a (mgr.14373) 1872 : audit [DBG] from='client.52908 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:20:16.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:20:16 smithi086 bash[24289]: cluster 2024-09-16T06:20:15.419182+0000 mgr.a (mgr.14373) 1873 : cluster [DBG] pgmap v1297: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:20:16.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:20:16 smithi047 bash[22744]: cluster 2024-09-16T06:20:15.419182+0000 mgr.a (mgr.14373) 1873 : cluster [DBG] pgmap v1297: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:20:17.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:20:16 smithi157 bash[24585]: cluster 2024-09-16T06:20:15.419182+0000 mgr.a (mgr.14373) 1873 : cluster [DBG] pgmap v1297: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:20:18.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:20:18 smithi086 bash[24289]: cluster 2024-09-16T06:20:17.421472+0000 mgr.a (mgr.14373) 1874 : cluster [DBG] pgmap v1298: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:20:18.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:20:18 smithi047 bash[22744]: cluster 2024-09-16T06:20:17.421472+0000 mgr.a (mgr.14373) 1874 : cluster [DBG] pgmap v1298: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:20:19.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:20:18 smithi157 bash[24585]: cluster 2024-09-16T06:20:17.421472+0000 mgr.a (mgr.14373) 1874 : cluster [DBG] pgmap v1298: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:20:20.006 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:20:20.006 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:20:20.007 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:20:20.784 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:20:20.784 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:20:20.784 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:20:20.784 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:20:20.785 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:20:20.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:20:20 smithi047 bash[22744]: cluster 2024-09-16T06:20:19.422381+0000 mgr.a (mgr.14373) 1875 : cluster [DBG] pgmap v1299: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:20:21.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:20:20 smithi157 bash[24585]: cluster 2024-09-16T06:20:19.422381+0000 mgr.a (mgr.14373) 1875 : cluster [DBG] pgmap v1299: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:20:21.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:20:20 smithi086 bash[24289]: cluster 2024-09-16T06:20:19.422381+0000 mgr.a (mgr.14373) 1875 : cluster [DBG] pgmap v1299: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:20:21.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:20:21 smithi047 bash[22744]: audit 2024-09-16T06:20:20.340451+0000 mgr.a (mgr.14373) 1876 : audit [DBG] from='client.52986 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:20:22.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:20:21 smithi157 bash[24585]: audit 2024-09-16T06:20:20.340451+0000 mgr.a (mgr.14373) 1876 : audit [DBG] from='client.52986 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:20:22.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:20:21 smithi086 bash[24289]: audit 2024-09-16T06:20:20.340451+0000 mgr.a (mgr.14373) 1876 : audit [DBG] from='client.52986 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:20:22.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:20:22 smithi047 bash[22744]: cluster 2024-09-16T06:20:21.423343+0000 mgr.a (mgr.14373) 1877 : cluster [DBG] pgmap v1300: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:20:23.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:20:22 smithi157 bash[24585]: cluster 2024-09-16T06:20:21.423343+0000 mgr.a (mgr.14373) 1877 : cluster [DBG] pgmap v1300: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:20:23.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:20:22 smithi086 bash[24289]: cluster 2024-09-16T06:20:21.423343+0000 mgr.a (mgr.14373) 1877 : cluster [DBG] pgmap v1300: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:20:24.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:20:24 smithi047 bash[22744]: cluster 2024-09-16T06:20:23.425494+0000 mgr.a (mgr.14373) 1878 : cluster [DBG] pgmap v1301: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:20:25.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:20:24 smithi157 bash[24585]: cluster 2024-09-16T06:20:23.425494+0000 mgr.a (mgr.14373) 1878 : cluster [DBG] pgmap v1301: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:20:25.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:20:24 smithi086 bash[24289]: cluster 2024-09-16T06:20:23.425494+0000 mgr.a (mgr.14373) 1878 : cluster [DBG] pgmap v1301: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:20:25.785 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:20:25.786 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:20:25.786 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:20:26.535 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:20:26.536 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:20:26.536 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:20:26.536 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:20:26.536 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:20:27.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:20:26 smithi157 bash[24585]: cluster 2024-09-16T06:20:25.426245+0000 mgr.a (mgr.14373) 1879 : cluster [DBG] pgmap v1302: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:20:27.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:20:26 smithi086 bash[24289]: cluster 2024-09-16T06:20:25.426245+0000 mgr.a (mgr.14373) 1879 : cluster [DBG] pgmap v1302: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:20:27.090 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:20:26 smithi047 bash[22744]: cluster 2024-09-16T06:20:25.426245+0000 mgr.a (mgr.14373) 1879 : cluster [DBG] pgmap v1302: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:20:28.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:20:27 smithi157 bash[24585]: audit 2024-09-16T06:20:26.123540+0000 mgr.a (mgr.14373) 1880 : audit [DBG] from='client.53064 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:20:28.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:20:27 smithi086 bash[24289]: audit 2024-09-16T06:20:26.123540+0000 mgr.a (mgr.14373) 1880 : audit [DBG] from='client.53064 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:20:28.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:20:27 smithi047 bash[22744]: audit 2024-09-16T06:20:26.123540+0000 mgr.a (mgr.14373) 1880 : audit [DBG] from='client.53064 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:20:29.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:20:28 smithi157 bash[24585]: cluster 2024-09-16T06:20:27.428686+0000 mgr.a (mgr.14373) 1881 : cluster [DBG] pgmap v1303: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:20:29.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:20:28 smithi086 bash[24289]: cluster 2024-09-16T06:20:27.428686+0000 mgr.a (mgr.14373) 1881 : cluster [DBG] pgmap v1303: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:20:29.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:20:28 smithi047 bash[22744]: cluster 2024-09-16T06:20:27.428686+0000 mgr.a (mgr.14373) 1881 : cluster [DBG] pgmap v1303: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:20:31.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:20:30 smithi157 bash[24585]: cluster 2024-09-16T06:20:29.429481+0000 mgr.a (mgr.14373) 1882 : cluster [DBG] pgmap v1304: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-16T06:20:31.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:20:30 smithi086 bash[24289]: cluster 2024-09-16T06:20:29.429481+0000 mgr.a (mgr.14373) 1882 : cluster [DBG] pgmap v1304: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-16T06:20:31.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:20:30 smithi047 bash[22744]: cluster 2024-09-16T06:20:29.429481+0000 mgr.a (mgr.14373) 1882 : cluster [DBG] pgmap v1304: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-16T06:20:31.537 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:20:31.538 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:20:31.538 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:20:32.312 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:20:32.312 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:20:32.312 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:20:32.312 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:20:32.312 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:20:33.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:20:32 smithi157 bash[24585]: cluster 2024-09-16T06:20:31.430419+0000 mgr.a (mgr.14373) 1883 : cluster [DBG] pgmap v1305: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-16T06:20:33.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:20:32 smithi086 bash[24289]: cluster 2024-09-16T06:20:31.430419+0000 mgr.a (mgr.14373) 1883 : cluster [DBG] pgmap v1305: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-16T06:20:33.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:20:32 smithi047 bash[22744]: cluster 2024-09-16T06:20:31.430419+0000 mgr.a (mgr.14373) 1883 : cluster [DBG] pgmap v1305: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-16T06:20:34.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:20:33 smithi157 bash[24585]: audit 2024-09-16T06:20:31.879334+0000 mgr.a (mgr.14373) 1884 : audit [DBG] from='client.53142 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:20:34.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:20:33 smithi086 bash[24289]: audit 2024-09-16T06:20:31.879334+0000 mgr.a (mgr.14373) 1884 : audit [DBG] from='client.53142 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:20:34.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:20:33 smithi047 bash[22744]: audit 2024-09-16T06:20:31.879334+0000 mgr.a (mgr.14373) 1884 : audit [DBG] from='client.53142 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:20:35.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:20:34 smithi157 bash[24585]: cluster 2024-09-16T06:20:33.433169+0000 mgr.a (mgr.14373) 1885 : cluster [DBG] pgmap v1306: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:20:35.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:20:34 smithi086 bash[24289]: cluster 2024-09-16T06:20:33.433169+0000 mgr.a (mgr.14373) 1885 : cluster [DBG] pgmap v1306: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:20:35.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:20:34 smithi047 bash[22744]: cluster 2024-09-16T06:20:33.433169+0000 mgr.a (mgr.14373) 1885 : cluster [DBG] pgmap v1306: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:20:37.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:20:36 smithi157 bash[24585]: cluster 2024-09-16T06:20:35.434096+0000 mgr.a (mgr.14373) 1886 : cluster [DBG] pgmap v1307: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:20:37.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:20:36 smithi086 bash[24289]: cluster 2024-09-16T06:20:35.434096+0000 mgr.a (mgr.14373) 1886 : cluster [DBG] pgmap v1307: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:20:37.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:20:36 smithi047 bash[22744]: cluster 2024-09-16T06:20:35.434096+0000 mgr.a (mgr.14373) 1886 : cluster [DBG] pgmap v1307: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:20:37.313 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:20:37.314 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:20:37.314 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:20:38.087 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:20:38.088 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:20:38.088 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:20:38.088 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:20:38.088 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:20:39.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:20:38 smithi157 bash[24585]: cluster 2024-09-16T06:20:37.435161+0000 mgr.a (mgr.14373) 1887 : cluster [DBG] pgmap v1308: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:20:39.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:20:38 smithi157 bash[24585]: audit 2024-09-16T06:20:37.652131+0000 mgr.a (mgr.14373) 1888 : audit [DBG] from='client.53217 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:20:39.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:20:38 smithi086 bash[24289]: cluster 2024-09-16T06:20:37.435161+0000 mgr.a (mgr.14373) 1887 : cluster [DBG] pgmap v1308: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:20:39.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:20:38 smithi086 bash[24289]: audit 2024-09-16T06:20:37.652131+0000 mgr.a (mgr.14373) 1888 : audit [DBG] from='client.53217 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:20:39.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:20:38 smithi047 bash[22744]: cluster 2024-09-16T06:20:37.435161+0000 mgr.a (mgr.14373) 1887 : cluster [DBG] pgmap v1308: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:20:39.090 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:20:38 smithi047 bash[22744]: audit 2024-09-16T06:20:37.652131+0000 mgr.a (mgr.14373) 1888 : audit [DBG] from='client.53217 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:20:41.055 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:20:40 smithi157 bash[24585]: cluster 2024-09-16T06:20:39.436017+0000 mgr.a (mgr.14373) 1889 : cluster [DBG] pgmap v1309: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-16T06:20:41.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:20:40 smithi086 bash[24289]: cluster 2024-09-16T06:20:39.436017+0000 mgr.a (mgr.14373) 1889 : cluster [DBG] pgmap v1309: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-16T06:20:41.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:20:40 smithi047 bash[22744]: cluster 2024-09-16T06:20:39.436017+0000 mgr.a (mgr.14373) 1889 : cluster [DBG] pgmap v1309: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-16T06:20:43.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:20:42 smithi157 bash[24585]: cluster 2024-09-16T06:20:41.436908+0000 mgr.a (mgr.14373) 1890 : cluster [DBG] pgmap v1310: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-16T06:20:43.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:20:42 smithi086 bash[24289]: cluster 2024-09-16T06:20:41.436908+0000 mgr.a (mgr.14373) 1890 : cluster [DBG] pgmap v1310: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-16T06:20:43.089 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:20:43.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:20:42 smithi047 bash[22744]: cluster 2024-09-16T06:20:41.436908+0000 mgr.a (mgr.14373) 1890 : cluster [DBG] pgmap v1310: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-16T06:20:43.090 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:20:43.090 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:20:43.835 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:20:43.835 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:20:43.836 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:20:43.836 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:20:43.836 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:20:45.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:20:44 smithi157 bash[24585]: audit 2024-09-16T06:20:43.421014+0000 mgr.a (mgr.14373) 1891 : audit [DBG] from='client.53292 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:20:45.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:20:44 smithi157 bash[24585]: cluster 2024-09-16T06:20:43.439075+0000 mgr.a (mgr.14373) 1892 : cluster [DBG] pgmap v1311: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-16T06:20:45.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:20:44 smithi086 bash[24289]: audit 2024-09-16T06:20:43.421014+0000 mgr.a (mgr.14373) 1891 : audit [DBG] from='client.53292 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:20:45.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:20:44 smithi086 bash[24289]: cluster 2024-09-16T06:20:43.439075+0000 mgr.a (mgr.14373) 1892 : cluster [DBG] pgmap v1311: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-16T06:20:45.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:20:44 smithi047 bash[22744]: audit 2024-09-16T06:20:43.421014+0000 mgr.a (mgr.14373) 1891 : audit [DBG] from='client.53292 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:20:45.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:20:44 smithi047 bash[22744]: cluster 2024-09-16T06:20:43.439075+0000 mgr.a (mgr.14373) 1892 : cluster [DBG] pgmap v1311: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-16T06:20:47.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:20:46 smithi157 bash[24585]: cluster 2024-09-16T06:20:45.439983+0000 mgr.a (mgr.14373) 1893 : cluster [DBG] pgmap v1312: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:20:47.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:20:46 smithi086 bash[24289]: cluster 2024-09-16T06:20:45.439983+0000 mgr.a (mgr.14373) 1893 : cluster [DBG] pgmap v1312: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:20:47.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:20:46 smithi047 bash[22744]: cluster 2024-09-16T06:20:45.439983+0000 mgr.a (mgr.14373) 1893 : cluster [DBG] pgmap v1312: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:20:48.837 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:20:48.837 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:20:48.838 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:20:49.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:20:48 smithi157 bash[24585]: cluster 2024-09-16T06:20:47.442135+0000 mgr.a (mgr.14373) 1894 : cluster [DBG] pgmap v1313: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:20:49.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:20:48 smithi086 bash[24289]: cluster 2024-09-16T06:20:47.442135+0000 mgr.a (mgr.14373) 1894 : cluster [DBG] pgmap v1313: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:20:49.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:20:48 smithi047 bash[22744]: cluster 2024-09-16T06:20:47.442135+0000 mgr.a (mgr.14373) 1894 : cluster [DBG] pgmap v1313: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:20:49.591 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:20:49.592 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:20:49.592 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:20:49.592 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:20:49.592 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:20:51.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:20:50 smithi157 bash[24585]: audit 2024-09-16T06:20:49.170278+0000 mgr.a (mgr.14373) 1895 : audit [DBG] from='client.53370 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:20:51.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:20:50 smithi157 bash[24585]: cluster 2024-09-16T06:20:49.442663+0000 mgr.a (mgr.14373) 1896 : cluster [DBG] pgmap v1314: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:20:51.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:20:50 smithi086 bash[24289]: audit 2024-09-16T06:20:49.170278+0000 mgr.a (mgr.14373) 1895 : audit [DBG] from='client.53370 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:20:51.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:20:50 smithi086 bash[24289]: cluster 2024-09-16T06:20:49.442663+0000 mgr.a (mgr.14373) 1896 : cluster [DBG] pgmap v1314: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:20:51.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:20:50 smithi047 bash[22744]: audit 2024-09-16T06:20:49.170278+0000 mgr.a (mgr.14373) 1895 : audit [DBG] from='client.53370 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:20:51.090 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:20:50 smithi047 bash[22744]: cluster 2024-09-16T06:20:49.442663+0000 mgr.a (mgr.14373) 1896 : cluster [DBG] pgmap v1314: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:20:53.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:20:52 smithi157 bash[24585]: cluster 2024-09-16T06:20:51.443531+0000 mgr.a (mgr.14373) 1897 : cluster [DBG] pgmap v1315: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:20:53.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:20:52 smithi086 bash[24289]: cluster 2024-09-16T06:20:51.443531+0000 mgr.a (mgr.14373) 1897 : cluster [DBG] pgmap v1315: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:20:53.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:20:52 smithi047 bash[22744]: cluster 2024-09-16T06:20:51.443531+0000 mgr.a (mgr.14373) 1897 : cluster [DBG] pgmap v1315: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:20:54.593 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:20:54.594 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:20:54.594 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:20:55.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:20:54 smithi157 bash[24585]: cluster 2024-09-16T06:20:53.445778+0000 mgr.a (mgr.14373) 1898 : cluster [DBG] pgmap v1316: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:20:55.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:20:54 smithi086 bash[24289]: cluster 2024-09-16T06:20:53.445778+0000 mgr.a (mgr.14373) 1898 : cluster [DBG] pgmap v1316: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:20:55.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:20:54 smithi047 bash[22744]: cluster 2024-09-16T06:20:53.445778+0000 mgr.a (mgr.14373) 1898 : cluster [DBG] pgmap v1316: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:20:55.347 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:20:55.347 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:20:55.347 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:20:55.348 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:20:55.348 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:20:57.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:20:56 smithi157 bash[24585]: audit 2024-09-16T06:20:54.932598+0000 mgr.a (mgr.14373) 1899 : audit [DBG] from='client.53445 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:20:57.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:20:56 smithi157 bash[24585]: cluster 2024-09-16T06:20:55.446753+0000 mgr.a (mgr.14373) 1900 : cluster [DBG] pgmap v1317: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:20:57.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:20:56 smithi086 bash[24289]: audit 2024-09-16T06:20:54.932598+0000 mgr.a (mgr.14373) 1899 : audit [DBG] from='client.53445 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:20:57.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:20:56 smithi086 bash[24289]: cluster 2024-09-16T06:20:55.446753+0000 mgr.a (mgr.14373) 1900 : cluster [DBG] pgmap v1317: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:20:57.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:20:56 smithi047 bash[22744]: audit 2024-09-16T06:20:54.932598+0000 mgr.a (mgr.14373) 1899 : audit [DBG] from='client.53445 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:20:57.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:20:56 smithi047 bash[22744]: cluster 2024-09-16T06:20:55.446753+0000 mgr.a (mgr.14373) 1900 : cluster [DBG] pgmap v1317: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:20:59.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:20:58 smithi157 bash[24585]: cluster 2024-09-16T06:20:57.448942+0000 mgr.a (mgr.14373) 1901 : cluster [DBG] pgmap v1318: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:20:59.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:20:58 smithi086 bash[24289]: cluster 2024-09-16T06:20:57.448942+0000 mgr.a (mgr.14373) 1901 : cluster [DBG] pgmap v1318: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:20:59.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:20:58 smithi047 bash[22744]: cluster 2024-09-16T06:20:57.448942+0000 mgr.a (mgr.14373) 1901 : cluster [DBG] pgmap v1318: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:21:00.349 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:21:00.349 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:21:00.350 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:21:01.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:21:00 smithi157 bash[24585]: cluster 2024-09-16T06:20:59.449646+0000 mgr.a (mgr.14373) 1902 : cluster [DBG] pgmap v1319: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:21:01.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:21:00 smithi086 bash[24289]: cluster 2024-09-16T06:20:59.449646+0000 mgr.a (mgr.14373) 1902 : cluster [DBG] pgmap v1319: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:21:01.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:21:00 smithi047 bash[22744]: cluster 2024-09-16T06:20:59.449646+0000 mgr.a (mgr.14373) 1902 : cluster [DBG] pgmap v1319: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:21:01.101 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:21:01.101 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:21:01.101 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:21:01.101 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:21:01.101 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:21:02.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:21:01 smithi157 bash[24585]: audit 2024-09-16T06:21:00.682515+0000 mgr.a (mgr.14373) 1903 : audit [DBG] from='client.53523 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:21:02.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:21:01 smithi086 bash[24289]: audit 2024-09-16T06:21:00.682515+0000 mgr.a (mgr.14373) 1903 : audit [DBG] from='client.53523 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:21:02.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:21:01 smithi047 bash[22744]: audit 2024-09-16T06:21:00.682515+0000 mgr.a (mgr.14373) 1903 : audit [DBG] from='client.53523 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:21:03.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:21:02 smithi157 bash[24585]: cluster 2024-09-16T06:21:01.450605+0000 mgr.a (mgr.14373) 1904 : cluster [DBG] pgmap v1320: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:21:03.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:21:02 smithi086 bash[24289]: cluster 2024-09-16T06:21:01.450605+0000 mgr.a (mgr.14373) 1904 : cluster [DBG] pgmap v1320: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:21:03.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:21:02 smithi047 bash[22744]: cluster 2024-09-16T06:21:01.450605+0000 mgr.a (mgr.14373) 1904 : cluster [DBG] pgmap v1320: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:21:05.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:21:04 smithi157 bash[24585]: cluster 2024-09-16T06:21:03.452856+0000 mgr.a (mgr.14373) 1905 : cluster [DBG] pgmap v1321: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:21:05.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:21:04 smithi086 bash[24289]: cluster 2024-09-16T06:21:03.452856+0000 mgr.a (mgr.14373) 1905 : cluster [DBG] pgmap v1321: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:21:05.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:21:04 smithi047 bash[22744]: cluster 2024-09-16T06:21:03.452856+0000 mgr.a (mgr.14373) 1905 : cluster [DBG] pgmap v1321: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:21:06.103 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:21:06.104 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:21:06.104 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:21:06.847 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:21:06.847 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:21:06.847 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:21:06.847 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:21:06.847 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:21:07.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:21:06 smithi157 bash[24585]: cluster 2024-09-16T06:21:05.453623+0000 mgr.a (mgr.14373) 1906 : cluster [DBG] pgmap v1322: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:21:07.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:21:06 smithi086 bash[24289]: cluster 2024-09-16T06:21:05.453623+0000 mgr.a (mgr.14373) 1906 : cluster [DBG] pgmap v1322: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:21:07.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:21:06 smithi047 bash[22744]: cluster 2024-09-16T06:21:05.453623+0000 mgr.a (mgr.14373) 1906 : cluster [DBG] pgmap v1322: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:21:08.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:21:07 smithi157 bash[24585]: audit 2024-09-16T06:21:06.435423+0000 mgr.a (mgr.14373) 1907 : audit [DBG] from='client.53601 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:21:08.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:21:07 smithi086 bash[24289]: audit 2024-09-16T06:21:06.435423+0000 mgr.a (mgr.14373) 1907 : audit [DBG] from='client.53601 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:21:08.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:21:07 smithi047 bash[22744]: audit 2024-09-16T06:21:06.435423+0000 mgr.a (mgr.14373) 1907 : audit [DBG] from='client.53601 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:21:09.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:21:08 smithi157 bash[24585]: cluster 2024-09-16T06:21:07.456454+0000 mgr.a (mgr.14373) 1908 : cluster [DBG] pgmap v1323: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-16T06:21:09.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:21:08 smithi086 bash[24289]: cluster 2024-09-16T06:21:07.456454+0000 mgr.a (mgr.14373) 1908 : cluster [DBG] pgmap v1323: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-16T06:21:09.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:21:08 smithi047 bash[22744]: cluster 2024-09-16T06:21:07.456454+0000 mgr.a (mgr.14373) 1908 : cluster [DBG] pgmap v1323: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-16T06:21:11.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:21:10 smithi157 bash[24585]: cluster 2024-09-16T06:21:09.457262+0000 mgr.a (mgr.14373) 1909 : cluster [DBG] pgmap v1324: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T06:21:11.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:21:10 smithi086 bash[24289]: cluster 2024-09-16T06:21:09.457262+0000 mgr.a (mgr.14373) 1909 : cluster [DBG] pgmap v1324: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T06:21:11.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:21:10 smithi047 bash[22744]: cluster 2024-09-16T06:21:09.457262+0000 mgr.a (mgr.14373) 1909 : cluster [DBG] pgmap v1324: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T06:21:11.848 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:21:11.848 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:21:11.848 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:21:12.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:21:11 smithi157 bash[24585]: audit 2024-09-16T06:21:10.724780+0000 mon.b (mon.2) 218 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T06:21:12.055 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:21:11 smithi157 bash[24585]: audit 2024-09-16T06:21:11.569661+0000 mon.b (mon.2) 219 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T06:21:12.055 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:21:11 smithi157 bash[24585]: audit 2024-09-16T06:21:11.571782+0000 mon.b (mon.2) 220 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T06:21:12.055 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:21:11 smithi157 bash[24585]: audit 2024-09-16T06:21:11.584429+0000 mon.a (mon.0) 685 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:21:12.055 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:21:11 smithi157 bash[24585]: audit 2024-09-16T06:21:11.588441+0000 mon.b (mon.2) 221 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:21:12.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:21:11 smithi086 bash[24289]: audit 2024-09-16T06:21:10.724780+0000 mon.b (mon.2) 218 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T06:21:12.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:21:11 smithi086 bash[24289]: audit 2024-09-16T06:21:11.569661+0000 mon.b (mon.2) 219 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T06:21:12.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:21:11 smithi086 bash[24289]: audit 2024-09-16T06:21:11.571782+0000 mon.b (mon.2) 220 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T06:21:12.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:21:11 smithi086 bash[24289]: audit 2024-09-16T06:21:11.584429+0000 mon.a (mon.0) 685 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:21:12.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:21:11 smithi086 bash[24289]: audit 2024-09-16T06:21:11.588441+0000 mon.b (mon.2) 221 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:21:12.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:21:11 smithi047 bash[22744]: audit 2024-09-16T06:21:10.724780+0000 mon.b (mon.2) 218 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T06:21:12.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:21:11 smithi047 bash[22744]: audit 2024-09-16T06:21:11.569661+0000 mon.b (mon.2) 219 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T06:21:12.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:21:11 smithi047 bash[22744]: audit 2024-09-16T06:21:11.571782+0000 mon.b (mon.2) 220 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T06:21:12.090 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:21:11 smithi047 bash[22744]: audit 2024-09-16T06:21:11.584429+0000 mon.a (mon.0) 685 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:21:12.090 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:21:11 smithi047 bash[22744]: audit 2024-09-16T06:21:11.588441+0000 mon.b (mon.2) 221 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:21:12.589 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 06:21:12 smithi047 bash[22994]: debug 2024-09-16T06:21:12.326+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T06:21:12.589 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 06:21:12 smithi047 bash[22994]: debug 2024-09-16T06:21:12.342+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T06:21:12.746 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:21:12.746 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:21:12.746 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:21:12.746 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:21:12.746 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:21:13.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:21:12 smithi157 bash[24585]: cluster 2024-09-16T06:21:11.457736+0000 mgr.a (mgr.14373) 1910 : cluster [DBG] pgmap v1325: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T06:21:13.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:21:12 smithi157 bash[24585]: audit 2024-09-16T06:21:11.592443+0000 mgr.a (mgr.14373) 1911 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:21:13.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:21:12 smithi086 bash[24289]: cluster 2024-09-16T06:21:11.457736+0000 mgr.a (mgr.14373) 1910 : cluster [DBG] pgmap v1325: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T06:21:13.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:21:12 smithi086 bash[24289]: audit 2024-09-16T06:21:11.592443+0000 mgr.a (mgr.14373) 1911 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:21:13.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:21:12 smithi047 bash[22744]: cluster 2024-09-16T06:21:11.457736+0000 mgr.a (mgr.14373) 1910 : cluster [DBG] pgmap v1325: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T06:21:13.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:21:12 smithi047 bash[22744]: audit 2024-09-16T06:21:11.592443+0000 mgr.a (mgr.14373) 1911 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:21:14.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:21:13 smithi157 bash[24585]: audit 2024-09-16T06:21:12.189407+0000 mgr.a (mgr.14373) 1912 : audit [DBG] from='client.53730 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:21:14.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:21:13 smithi157 bash[24585]: audit 2024-09-16T06:21:12.329579+0000 mgr.a (mgr.14373) 1913 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T06:21:14.055 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:21:13 smithi157 bash[24585]: cephadm 2024-09-16T06:21:12.345817+0000 mgr.a (mgr.14373) 1914 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T06:21:14.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:21:13 smithi086 bash[24289]: audit 2024-09-16T06:21:12.189407+0000 mgr.a (mgr.14373) 1912 : audit [DBG] from='client.53730 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:21:14.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:21:13 smithi086 bash[24289]: audit 2024-09-16T06:21:12.329579+0000 mgr.a (mgr.14373) 1913 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T06:21:14.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:21:13 smithi086 bash[24289]: cephadm 2024-09-16T06:21:12.345817+0000 mgr.a (mgr.14373) 1914 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T06:21:14.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:21:13 smithi047 bash[22744]: audit 2024-09-16T06:21:12.189407+0000 mgr.a (mgr.14373) 1912 : audit [DBG] from='client.53730 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:21:14.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:21:13 smithi047 bash[22744]: audit 2024-09-16T06:21:12.329579+0000 mgr.a (mgr.14373) 1913 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T06:21:14.090 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:21:13 smithi047 bash[22744]: cephadm 2024-09-16T06:21:12.345817+0000 mgr.a (mgr.14373) 1914 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T06:21:15.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:21:14 smithi157 bash[24585]: cluster 2024-09-16T06:21:13.460516+0000 mgr.a (mgr.14373) 1915 : cluster [DBG] pgmap v1326: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-16T06:21:15.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:21:14 smithi086 bash[24289]: cluster 2024-09-16T06:21:13.460516+0000 mgr.a (mgr.14373) 1915 : cluster [DBG] pgmap v1326: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-16T06:21:15.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:21:14 smithi047 bash[22744]: cluster 2024-09-16T06:21:13.460516+0000 mgr.a (mgr.14373) 1915 : cluster [DBG] pgmap v1326: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-16T06:21:17.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:21:16 smithi157 bash[24585]: cluster 2024-09-16T06:21:15.461309+0000 mgr.a (mgr.14373) 1916 : cluster [DBG] pgmap v1327: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T06:21:17.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:21:16 smithi086 bash[24289]: cluster 2024-09-16T06:21:15.461309+0000 mgr.a (mgr.14373) 1916 : cluster [DBG] pgmap v1327: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T06:21:17.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:21:16 smithi047 bash[22744]: cluster 2024-09-16T06:21:15.461309+0000 mgr.a (mgr.14373) 1916 : cluster [DBG] pgmap v1327: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T06:21:17.747 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:21:17.748 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:21:17.748 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:21:18.491 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:21:18.491 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:21:18.492 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:21:18.492 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:21:18.492 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:21:19.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:21:18 smithi157 bash[24585]: cluster 2024-09-16T06:21:17.463364+0000 mgr.a (mgr.14373) 1917 : cluster [DBG] pgmap v1328: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:21:19.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:21:18 smithi086 bash[24289]: cluster 2024-09-16T06:21:17.463364+0000 mgr.a (mgr.14373) 1917 : cluster [DBG] pgmap v1328: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:21:19.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:21:18 smithi047 bash[22744]: cluster 2024-09-16T06:21:17.463364+0000 mgr.a (mgr.14373) 1917 : cluster [DBG] pgmap v1328: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:21:20.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:21:19 smithi157 bash[24585]: audit 2024-09-16T06:21:18.076560+0000 mgr.a (mgr.14373) 1918 : audit [DBG] from='client.53853 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:21:20.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:21:19 smithi086 bash[24289]: audit 2024-09-16T06:21:18.076560+0000 mgr.a (mgr.14373) 1918 : audit [DBG] from='client.53853 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:21:20.090 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:21:19 smithi047 bash[22744]: audit 2024-09-16T06:21:18.076560+0000 mgr.a (mgr.14373) 1918 : audit [DBG] from='client.53853 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:21:21.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:21:20 smithi157 bash[24585]: cluster 2024-09-16T06:21:19.464241+0000 mgr.a (mgr.14373) 1919 : cluster [DBG] pgmap v1329: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T06:21:21.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:21:20 smithi086 bash[24289]: cluster 2024-09-16T06:21:19.464241+0000 mgr.a (mgr.14373) 1919 : cluster [DBG] pgmap v1329: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T06:21:21.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:21:20 smithi047 bash[22744]: cluster 2024-09-16T06:21:19.464241+0000 mgr.a (mgr.14373) 1919 : cluster [DBG] pgmap v1329: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T06:21:23.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:21:22 smithi157 bash[24585]: cluster 2024-09-16T06:21:21.465006+0000 mgr.a (mgr.14373) 1920 : cluster [DBG] pgmap v1330: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T06:21:23.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:21:22 smithi086 bash[24289]: cluster 2024-09-16T06:21:21.465006+0000 mgr.a (mgr.14373) 1920 : cluster [DBG] pgmap v1330: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T06:21:23.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:21:22 smithi047 bash[22744]: cluster 2024-09-16T06:21:21.465006+0000 mgr.a (mgr.14373) 1920 : cluster [DBG] pgmap v1330: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T06:21:23.493 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:21:23.493 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:21:23.494 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:21:24.270 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:21:24.270 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:21:24.271 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:21:24.271 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:21:24.271 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:21:25.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:21:24 smithi157 bash[24585]: cluster 2024-09-16T06:21:23.467231+0000 mgr.a (mgr.14373) 1921 : cluster [DBG] pgmap v1331: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:21:25.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:21:24 smithi157 bash[24585]: audit 2024-09-16T06:21:23.834726+0000 mgr.a (mgr.14373) 1922 : audit [DBG] from='client.53931 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:21:25.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:21:24 smithi086 bash[24289]: cluster 2024-09-16T06:21:23.467231+0000 mgr.a (mgr.14373) 1921 : cluster [DBG] pgmap v1331: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:21:25.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:21:24 smithi086 bash[24289]: audit 2024-09-16T06:21:23.834726+0000 mgr.a (mgr.14373) 1922 : audit [DBG] from='client.53931 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:21:25.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:21:24 smithi047 bash[22744]: cluster 2024-09-16T06:21:23.467231+0000 mgr.a (mgr.14373) 1921 : cluster [DBG] pgmap v1331: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:21:25.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:21:24 smithi047 bash[22744]: audit 2024-09-16T06:21:23.834726+0000 mgr.a (mgr.14373) 1922 : audit [DBG] from='client.53931 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:21:27.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:21:26 smithi157 bash[24585]: cluster 2024-09-16T06:21:25.468137+0000 mgr.a (mgr.14373) 1923 : cluster [DBG] pgmap v1332: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T06:21:27.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:21:26 smithi086 bash[24289]: cluster 2024-09-16T06:21:25.468137+0000 mgr.a (mgr.14373) 1923 : cluster [DBG] pgmap v1332: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T06:21:27.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:21:26 smithi047 bash[22744]: cluster 2024-09-16T06:21:25.468137+0000 mgr.a (mgr.14373) 1923 : cluster [DBG] pgmap v1332: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T06:21:29.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:21:28 smithi157 bash[24585]: cluster 2024-09-16T06:21:27.470409+0000 mgr.a (mgr.14373) 1924 : cluster [DBG] pgmap v1333: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.6 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:21:29.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:21:28 smithi086 bash[24289]: cluster 2024-09-16T06:21:27.470409+0000 mgr.a (mgr.14373) 1924 : cluster [DBG] pgmap v1333: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.6 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:21:29.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:21:28 smithi047 bash[22744]: cluster 2024-09-16T06:21:27.470409+0000 mgr.a (mgr.14373) 1924 : cluster [DBG] pgmap v1333: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.6 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:21:29.272 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:21:29.272 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:21:29.273 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:21:30.058 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:21:30.058 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:21:30.058 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:21:30.058 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:21:30.058 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:21:31.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:21:30 smithi157 bash[24585]: cluster 2024-09-16T06:21:29.471131+0000 mgr.a (mgr.14373) 1925 : cluster [DBG] pgmap v1334: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:21:31.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:21:30 smithi157 bash[24585]: audit 2024-09-16T06:21:29.608982+0000 mgr.a (mgr.14373) 1926 : audit [DBG] from='client.54009 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:21:31.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:21:30 smithi086 bash[24289]: cluster 2024-09-16T06:21:29.471131+0000 mgr.a (mgr.14373) 1925 : cluster [DBG] pgmap v1334: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:21:31.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:21:30 smithi086 bash[24289]: audit 2024-09-16T06:21:29.608982+0000 mgr.a (mgr.14373) 1926 : audit [DBG] from='client.54009 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:21:31.090 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:21:30 smithi047 bash[22744]: cluster 2024-09-16T06:21:29.471131+0000 mgr.a (mgr.14373) 1925 : cluster [DBG] pgmap v1334: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:21:31.090 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:21:30 smithi047 bash[22744]: audit 2024-09-16T06:21:29.608982+0000 mgr.a (mgr.14373) 1926 : audit [DBG] from='client.54009 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:21:33.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:21:32 smithi157 bash[24585]: cluster 2024-09-16T06:21:31.471997+0000 mgr.a (mgr.14373) 1927 : cluster [DBG] pgmap v1335: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:21:33.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:21:32 smithi086 bash[24289]: cluster 2024-09-16T06:21:31.471997+0000 mgr.a (mgr.14373) 1927 : cluster [DBG] pgmap v1335: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:21:33.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:21:32 smithi047 bash[22744]: cluster 2024-09-16T06:21:31.471997+0000 mgr.a (mgr.14373) 1927 : cluster [DBG] pgmap v1335: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:21:35.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:21:34 smithi157 bash[24585]: cluster 2024-09-16T06:21:33.474252+0000 mgr.a (mgr.14373) 1928 : cluster [DBG] pgmap v1336: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:21:35.059 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:21:35.060 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:21:35.060 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:21:35.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:21:34 smithi086 bash[24289]: cluster 2024-09-16T06:21:33.474252+0000 mgr.a (mgr.14373) 1928 : cluster [DBG] pgmap v1336: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:21:35.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:21:34 smithi047 bash[22744]: cluster 2024-09-16T06:21:33.474252+0000 mgr.a (mgr.14373) 1928 : cluster [DBG] pgmap v1336: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:21:35.807 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:21:35.808 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:21:35.808 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:21:35.808 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:21:35.808 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:21:37.055 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:21:36 smithi157 bash[24585]: audit 2024-09-16T06:21:35.391651+0000 mgr.a (mgr.14373) 1929 : audit [DBG] from='client.54084 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:21:37.055 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:21:36 smithi157 bash[24585]: cluster 2024-09-16T06:21:35.474811+0000 mgr.a (mgr.14373) 1930 : cluster [DBG] pgmap v1337: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:21:37.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:21:36 smithi086 bash[24289]: audit 2024-09-16T06:21:35.391651+0000 mgr.a (mgr.14373) 1929 : audit [DBG] from='client.54084 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:21:37.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:21:36 smithi086 bash[24289]: cluster 2024-09-16T06:21:35.474811+0000 mgr.a (mgr.14373) 1930 : cluster [DBG] pgmap v1337: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:21:37.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:21:36 smithi047 bash[22744]: audit 2024-09-16T06:21:35.391651+0000 mgr.a (mgr.14373) 1929 : audit [DBG] from='client.54084 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:21:37.090 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:21:36 smithi047 bash[22744]: cluster 2024-09-16T06:21:35.474811+0000 mgr.a (mgr.14373) 1930 : cluster [DBG] pgmap v1337: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:21:39.055 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:21:38 smithi157 bash[24585]: cluster 2024-09-16T06:21:37.477090+0000 mgr.a (mgr.14373) 1931 : cluster [DBG] pgmap v1338: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:21:39.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:21:38 smithi086 bash[24289]: cluster 2024-09-16T06:21:37.477090+0000 mgr.a (mgr.14373) 1931 : cluster [DBG] pgmap v1338: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:21:39.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:21:38 smithi047 bash[22744]: cluster 2024-09-16T06:21:37.477090+0000 mgr.a (mgr.14373) 1931 : cluster [DBG] pgmap v1338: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:21:40.808 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:21:40.809 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:21:40.809 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:21:41.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:21:40 smithi157 bash[24585]: cluster 2024-09-16T06:21:39.477851+0000 mgr.a (mgr.14373) 1932 : cluster [DBG] pgmap v1339: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:21:41.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:21:40 smithi086 bash[24289]: cluster 2024-09-16T06:21:39.477851+0000 mgr.a (mgr.14373) 1932 : cluster [DBG] pgmap v1339: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:21:41.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:21:40 smithi047 bash[22744]: cluster 2024-09-16T06:21:39.477851+0000 mgr.a (mgr.14373) 1932 : cluster [DBG] pgmap v1339: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:21:41.578 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:21:41.578 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:21:41.578 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:21:41.579 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:21:41.579 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:21:43.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:21:42 smithi157 bash[24585]: audit 2024-09-16T06:21:41.144602+0000 mgr.a (mgr.14373) 1933 : audit [DBG] from='client.54162 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:21:43.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:21:42 smithi157 bash[24585]: cluster 2024-09-16T06:21:41.484002+0000 mgr.a (mgr.14373) 1934 : cluster [DBG] pgmap v1340: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:21:43.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:21:42 smithi086 bash[24289]: audit 2024-09-16T06:21:41.144602+0000 mgr.a (mgr.14373) 1933 : audit [DBG] from='client.54162 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:21:43.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:21:42 smithi086 bash[24289]: cluster 2024-09-16T06:21:41.484002+0000 mgr.a (mgr.14373) 1934 : cluster [DBG] pgmap v1340: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:21:43.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:21:42 smithi047 bash[22744]: audit 2024-09-16T06:21:41.144602+0000 mgr.a (mgr.14373) 1933 : audit [DBG] from='client.54162 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:21:43.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:21:42 smithi047 bash[22744]: cluster 2024-09-16T06:21:41.484002+0000 mgr.a (mgr.14373) 1934 : cluster [DBG] pgmap v1340: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:21:45.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:21:44 smithi157 bash[24585]: cluster 2024-09-16T06:21:43.486220+0000 mgr.a (mgr.14373) 1935 : cluster [DBG] pgmap v1341: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:21:45.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:21:44 smithi086 bash[24289]: cluster 2024-09-16T06:21:43.486220+0000 mgr.a (mgr.14373) 1935 : cluster [DBG] pgmap v1341: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:21:45.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:21:44 smithi047 bash[22744]: cluster 2024-09-16T06:21:43.486220+0000 mgr.a (mgr.14373) 1935 : cluster [DBG] pgmap v1341: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:21:46.580 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:21:46.580 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:21:46.581 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:21:47.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:21:46 smithi157 bash[24585]: cluster 2024-09-16T06:21:45.486994+0000 mgr.a (mgr.14373) 1936 : cluster [DBG] pgmap v1342: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-16T06:21:47.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:21:46 smithi086 bash[24289]: cluster 2024-09-16T06:21:45.486994+0000 mgr.a (mgr.14373) 1936 : cluster [DBG] pgmap v1342: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-16T06:21:47.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:21:46 smithi047 bash[22744]: cluster 2024-09-16T06:21:45.486994+0000 mgr.a (mgr.14373) 1936 : cluster [DBG] pgmap v1342: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-16T06:21:47.362 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:21:47.363 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:21:47.363 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:21:47.363 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:21:47.363 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:21:49.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:21:48 smithi086 bash[24289]: audit 2024-09-16T06:21:46.920933+0000 mgr.a (mgr.14373) 1937 : audit [DBG] from='client.54240 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:21:49.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:21:48 smithi086 bash[24289]: cluster 2024-09-16T06:21:47.489769+0000 mgr.a (mgr.14373) 1938 : cluster [DBG] pgmap v1343: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:21:49.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:21:48 smithi047 bash[22744]: audit 2024-09-16T06:21:46.920933+0000 mgr.a (mgr.14373) 1937 : audit [DBG] from='client.54240 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:21:49.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:21:48 smithi047 bash[22744]: cluster 2024-09-16T06:21:47.489769+0000 mgr.a (mgr.14373) 1938 : cluster [DBG] pgmap v1343: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:21:49.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:21:48 smithi157 bash[24585]: audit 2024-09-16T06:21:46.920933+0000 mgr.a (mgr.14373) 1937 : audit [DBG] from='client.54240 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:21:49.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:21:48 smithi157 bash[24585]: cluster 2024-09-16T06:21:47.489769+0000 mgr.a (mgr.14373) 1938 : cluster [DBG] pgmap v1343: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:21:51.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:21:50 smithi086 bash[24289]: cluster 2024-09-16T06:21:49.490716+0000 mgr.a (mgr.14373) 1939 : cluster [DBG] pgmap v1344: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:21:51.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:21:50 smithi047 bash[22744]: cluster 2024-09-16T06:21:49.490716+0000 mgr.a (mgr.14373) 1939 : cluster [DBG] pgmap v1344: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:21:51.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:21:50 smithi157 bash[24585]: cluster 2024-09-16T06:21:49.490716+0000 mgr.a (mgr.14373) 1939 : cluster [DBG] pgmap v1344: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:21:52.364 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:21:52.365 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:21:52.365 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:21:53.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:21:52 smithi086 bash[24289]: cluster 2024-09-16T06:21:51.491626+0000 mgr.a (mgr.14373) 1940 : cluster [DBG] pgmap v1345: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:21:53.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:21:52 smithi047 bash[22744]: cluster 2024-09-16T06:21:51.491626+0000 mgr.a (mgr.14373) 1940 : cluster [DBG] pgmap v1345: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:21:53.118 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:21:53.118 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:21:53.118 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:21:53.118 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:21:53.118 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:21:53.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:21:52 smithi157 bash[24585]: cluster 2024-09-16T06:21:51.491626+0000 mgr.a (mgr.14373) 1940 : cluster [DBG] pgmap v1345: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:21:54.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:21:53 smithi086 bash[24289]: audit 2024-09-16T06:21:52.694113+0000 mgr.a (mgr.14373) 1941 : audit [DBG] from='client.54318 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:21:54.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:21:53 smithi047 bash[22744]: audit 2024-09-16T06:21:52.694113+0000 mgr.a (mgr.14373) 1941 : audit [DBG] from='client.54318 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:21:54.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:21:53 smithi157 bash[24585]: audit 2024-09-16T06:21:52.694113+0000 mgr.a (mgr.14373) 1941 : audit [DBG] from='client.54318 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:21:55.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:21:54 smithi047 bash[22744]: cluster 2024-09-16T06:21:53.494458+0000 mgr.a (mgr.14373) 1942 : cluster [DBG] pgmap v1346: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:21:55.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:21:54 smithi157 bash[24585]: cluster 2024-09-16T06:21:53.494458+0000 mgr.a (mgr.14373) 1942 : cluster [DBG] pgmap v1346: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:21:55.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:21:54 smithi086 bash[24289]: cluster 2024-09-16T06:21:53.494458+0000 mgr.a (mgr.14373) 1942 : cluster [DBG] pgmap v1346: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:21:57.090 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:21:56 smithi047 bash[22744]: cluster 2024-09-16T06:21:55.495251+0000 mgr.a (mgr.14373) 1943 : cluster [DBG] pgmap v1347: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-16T06:21:57.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:21:56 smithi157 bash[24585]: cluster 2024-09-16T06:21:55.495251+0000 mgr.a (mgr.14373) 1943 : cluster [DBG] pgmap v1347: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-16T06:21:57.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:21:56 smithi086 bash[24289]: cluster 2024-09-16T06:21:55.495251+0000 mgr.a (mgr.14373) 1943 : cluster [DBG] pgmap v1347: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-16T06:21:58.119 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:21:58.120 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:21:58.120 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:21:58.905 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:21:58.905 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:21:58.905 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:21:58.905 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:21:58.905 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:21:59.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:21:58 smithi047 bash[22744]: cluster 2024-09-16T06:21:57.497303+0000 mgr.a (mgr.14373) 1944 : cluster [DBG] pgmap v1348: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-16T06:21:59.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:21:58 smithi157 bash[24585]: cluster 2024-09-16T06:21:57.497303+0000 mgr.a (mgr.14373) 1944 : cluster [DBG] pgmap v1348: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-16T06:21:59.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:21:58 smithi086 bash[24289]: cluster 2024-09-16T06:21:57.497303+0000 mgr.a (mgr.14373) 1944 : cluster [DBG] pgmap v1348: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-16T06:22:00.090 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:21:59 smithi047 bash[22744]: audit 2024-09-16T06:21:58.458830+0000 mgr.a (mgr.14373) 1945 : audit [DBG] from='client.54393 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:22:00.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:21:59 smithi157 bash[24585]: audit 2024-09-16T06:21:58.458830+0000 mgr.a (mgr.14373) 1945 : audit [DBG] from='client.54393 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:22:00.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:21:59 smithi086 bash[24289]: audit 2024-09-16T06:21:58.458830+0000 mgr.a (mgr.14373) 1945 : audit [DBG] from='client.54393 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:22:01.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:22:00 smithi157 bash[24585]: cluster 2024-09-16T06:21:59.498202+0000 mgr.a (mgr.14373) 1946 : cluster [DBG] pgmap v1349: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:22:01.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:22:00 smithi086 bash[24289]: cluster 2024-09-16T06:21:59.498202+0000 mgr.a (mgr.14373) 1946 : cluster [DBG] pgmap v1349: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:22:01.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:22:00 smithi047 bash[22744]: cluster 2024-09-16T06:21:59.498202+0000 mgr.a (mgr.14373) 1946 : cluster [DBG] pgmap v1349: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:22:03.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:22:02 smithi157 bash[24585]: cluster 2024-09-16T06:22:01.498968+0000 mgr.a (mgr.14373) 1947 : cluster [DBG] pgmap v1350: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:22:03.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:22:02 smithi086 bash[24289]: cluster 2024-09-16T06:22:01.498968+0000 mgr.a (mgr.14373) 1947 : cluster [DBG] pgmap v1350: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:22:03.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:22:02 smithi047 bash[22744]: cluster 2024-09-16T06:22:01.498968+0000 mgr.a (mgr.14373) 1947 : cluster [DBG] pgmap v1350: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:22:03.905 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:22:03.905 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:22:03.906 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:22:04.650 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:22:04.651 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:22:04.651 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:22:04.651 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:22:04.651 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:22:05.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:22:04 smithi157 bash[24585]: cluster 2024-09-16T06:22:03.501168+0000 mgr.a (mgr.14373) 1948 : cluster [DBG] pgmap v1351: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:22:05.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:22:04 smithi086 bash[24289]: cluster 2024-09-16T06:22:03.501168+0000 mgr.a (mgr.14373) 1948 : cluster [DBG] pgmap v1351: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:22:05.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:22:04 smithi047 bash[22744]: cluster 2024-09-16T06:22:03.501168+0000 mgr.a (mgr.14373) 1948 : cluster [DBG] pgmap v1351: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:22:06.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:22:05 smithi157 bash[24585]: audit 2024-09-16T06:22:04.234105+0000 mgr.a (mgr.14373) 1949 : audit [DBG] from='client.54471 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:22:06.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:22:05 smithi086 bash[24289]: audit 2024-09-16T06:22:04.234105+0000 mgr.a (mgr.14373) 1949 : audit [DBG] from='client.54471 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:22:06.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:22:05 smithi047 bash[22744]: audit 2024-09-16T06:22:04.234105+0000 mgr.a (mgr.14373) 1949 : audit [DBG] from='client.54471 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:22:07.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:22:06 smithi157 bash[24585]: cluster 2024-09-16T06:22:05.502174+0000 mgr.a (mgr.14373) 1950 : cluster [DBG] pgmap v1352: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:22:07.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:22:06 smithi086 bash[24289]: cluster 2024-09-16T06:22:05.502174+0000 mgr.a (mgr.14373) 1950 : cluster [DBG] pgmap v1352: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:22:07.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:22:06 smithi047 bash[22744]: cluster 2024-09-16T06:22:05.502174+0000 mgr.a (mgr.14373) 1950 : cluster [DBG] pgmap v1352: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:22:09.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:22:08 smithi157 bash[24585]: cluster 2024-09-16T06:22:07.504541+0000 mgr.a (mgr.14373) 1951 : cluster [DBG] pgmap v1353: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:22:09.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:22:08 smithi086 bash[24289]: cluster 2024-09-16T06:22:07.504541+0000 mgr.a (mgr.14373) 1951 : cluster [DBG] pgmap v1353: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:22:09.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:22:08 smithi047 bash[22744]: cluster 2024-09-16T06:22:07.504541+0000 mgr.a (mgr.14373) 1951 : cluster [DBG] pgmap v1353: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:22:09.652 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:22:09.652 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:22:09.653 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:22:10.394 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:22:10.394 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:22:10.394 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:22:10.395 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:22:10.395 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:22:11.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:22:10 smithi157 bash[24585]: cluster 2024-09-16T06:22:09.505444+0000 mgr.a (mgr.14373) 1952 : cluster [DBG] pgmap v1354: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:22:11.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:22:10 smithi086 bash[24289]: cluster 2024-09-16T06:22:09.505444+0000 mgr.a (mgr.14373) 1952 : cluster [DBG] pgmap v1354: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:22:11.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:22:10 smithi047 bash[22744]: cluster 2024-09-16T06:22:09.505444+0000 mgr.a (mgr.14373) 1952 : cluster [DBG] pgmap v1354: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:22:12.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:22:11 smithi157 bash[24585]: audit 2024-09-16T06:22:09.980583+0000 mgr.a (mgr.14373) 1953 : audit [DBG] from='client.54543 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:22:12.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:22:11 smithi086 bash[24289]: audit 2024-09-16T06:22:09.980583+0000 mgr.a (mgr.14373) 1953 : audit [DBG] from='client.54543 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:22:12.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:22:11 smithi047 bash[22744]: audit 2024-09-16T06:22:09.980583+0000 mgr.a (mgr.14373) 1953 : audit [DBG] from='client.54543 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:22:13.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:22:12 smithi157 bash[24585]: cluster 2024-09-16T06:22:11.506374+0000 mgr.a (mgr.14373) 1954 : cluster [DBG] pgmap v1355: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:22:13.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:22:12 smithi157 bash[24585]: audit 2024-09-16T06:22:12.406818+0000 mon.b (mon.2) 222 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T06:22:13.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:22:12 smithi086 bash[24289]: cluster 2024-09-16T06:22:11.506374+0000 mgr.a (mgr.14373) 1954 : cluster [DBG] pgmap v1355: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:22:13.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:22:12 smithi086 bash[24289]: audit 2024-09-16T06:22:12.406818+0000 mon.b (mon.2) 222 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T06:22:13.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:22:12 smithi047 bash[22744]: cluster 2024-09-16T06:22:11.506374+0000 mgr.a (mgr.14373) 1954 : cluster [DBG] pgmap v1355: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:22:13.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:22:12 smithi047 bash[22744]: audit 2024-09-16T06:22:12.406818+0000 mon.b (mon.2) 222 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T06:22:14.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:22:13 smithi157 bash[24585]: audit 2024-09-16T06:22:13.247131+0000 mon.b (mon.2) 223 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T06:22:14.305 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:22:13 smithi157 bash[24585]: audit 2024-09-16T06:22:13.249272+0000 mon.b (mon.2) 224 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T06:22:14.305 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:22:13 smithi157 bash[24585]: audit 2024-09-16T06:22:13.260273+0000 mon.a (mon.0) 686 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:22:14.305 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:22:13 smithi157 bash[24585]: audit 2024-09-16T06:22:13.267616+0000 mon.b (mon.2) 225 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:22:14.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:22:13 smithi086 bash[24289]: audit 2024-09-16T06:22:13.247131+0000 mon.b (mon.2) 223 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T06:22:14.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:22:13 smithi086 bash[24289]: audit 2024-09-16T06:22:13.249272+0000 mon.b (mon.2) 224 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T06:22:14.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:22:13 smithi086 bash[24289]: audit 2024-09-16T06:22:13.260273+0000 mon.a (mon.0) 686 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:22:14.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:22:13 smithi086 bash[24289]: audit 2024-09-16T06:22:13.267616+0000 mon.b (mon.2) 225 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:22:14.340 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 06:22:13 smithi047 bash[22994]: debug 2024-09-16T06:22:13.980+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T06:22:14.340 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 06:22:13 smithi047 bash[22994]: debug 2024-09-16T06:22:13.984+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T06:22:14.340 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:22:13 smithi047 bash[22744]: audit 2024-09-16T06:22:13.247131+0000 mon.b (mon.2) 223 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T06:22:14.340 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:22:13 smithi047 bash[22744]: audit 2024-09-16T06:22:13.249272+0000 mon.b (mon.2) 224 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T06:22:14.340 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:22:13 smithi047 bash[22744]: audit 2024-09-16T06:22:13.260273+0000 mon.a (mon.0) 686 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:22:14.340 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:22:13 smithi047 bash[22744]: audit 2024-09-16T06:22:13.267616+0000 mon.b (mon.2) 225 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:22:15.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:22:14 smithi157 bash[24585]: audit 2024-09-16T06:22:13.270686+0000 mgr.a (mgr.14373) 1955 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:22:15.305 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:22:14 smithi157 bash[24585]: cluster 2024-09-16T06:22:13.507645+0000 mgr.a (mgr.14373) 1956 : cluster [DBG] pgmap v1356: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:22:15.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:22:14 smithi086 bash[24289]: audit 2024-09-16T06:22:13.270686+0000 mgr.a (mgr.14373) 1955 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:22:15.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:22:14 smithi086 bash[24289]: cluster 2024-09-16T06:22:13.507645+0000 mgr.a (mgr.14373) 1956 : cluster [DBG] pgmap v1356: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:22:15.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:22:14 smithi047 bash[22744]: audit 2024-09-16T06:22:13.270686+0000 mgr.a (mgr.14373) 1955 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:22:15.340 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:22:14 smithi047 bash[22744]: cluster 2024-09-16T06:22:13.507645+0000 mgr.a (mgr.14373) 1956 : cluster [DBG] pgmap v1356: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:22:15.396 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:22:15.396 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:22:15.396 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:22:16.149 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:22:16.149 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:22:16.149 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:22:16.149 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:22:16.149 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:22:16.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:22:15 smithi157 bash[24585]: audit 2024-09-16T06:22:13.985883+0000 mgr.a (mgr.14373) 1957 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T06:22:16.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:22:15 smithi157 bash[24585]: cephadm 2024-09-16T06:22:13.987607+0000 mgr.a (mgr.14373) 1958 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T06:22:16.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:22:15 smithi086 bash[24289]: audit 2024-09-16T06:22:13.985883+0000 mgr.a (mgr.14373) 1957 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T06:22:16.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:22:15 smithi086 bash[24289]: cephadm 2024-09-16T06:22:13.987607+0000 mgr.a (mgr.14373) 1958 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T06:22:16.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:22:15 smithi047 bash[22744]: audit 2024-09-16T06:22:13.985883+0000 mgr.a (mgr.14373) 1957 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T06:22:16.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:22:15 smithi047 bash[22744]: cephadm 2024-09-16T06:22:13.987607+0000 mgr.a (mgr.14373) 1958 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T06:22:17.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:22:16 smithi157 bash[24585]: cluster 2024-09-16T06:22:15.508101+0000 mgr.a (mgr.14373) 1959 : cluster [DBG] pgmap v1357: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:22:17.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:22:16 smithi157 bash[24585]: audit 2024-09-16T06:22:15.727812+0000 mgr.a (mgr.14373) 1960 : audit [DBG] from='client.54729 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:22:17.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:22:16 smithi086 bash[24289]: cluster 2024-09-16T06:22:15.508101+0000 mgr.a (mgr.14373) 1959 : cluster [DBG] pgmap v1357: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:22:17.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:22:16 smithi086 bash[24289]: audit 2024-09-16T06:22:15.727812+0000 mgr.a (mgr.14373) 1960 : audit [DBG] from='client.54729 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:22:17.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:22:16 smithi047 bash[22744]: cluster 2024-09-16T06:22:15.508101+0000 mgr.a (mgr.14373) 1959 : cluster [DBG] pgmap v1357: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:22:17.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:22:16 smithi047 bash[22744]: audit 2024-09-16T06:22:15.727812+0000 mgr.a (mgr.14373) 1960 : audit [DBG] from='client.54729 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:22:18.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:22:17 smithi157 bash[24585]: cluster 2024-09-16T06:22:17.510397+0000 mgr.a (mgr.14373) 1961 : cluster [DBG] pgmap v1358: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:22:18.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:22:17 smithi086 bash[24289]: cluster 2024-09-16T06:22:17.510397+0000 mgr.a (mgr.14373) 1961 : cluster [DBG] pgmap v1358: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:22:18.340 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:22:17 smithi047 bash[22744]: cluster 2024-09-16T06:22:17.510397+0000 mgr.a (mgr.14373) 1961 : cluster [DBG] pgmap v1358: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:22:20.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:22:20 smithi086 bash[24289]: cluster 2024-09-16T06:22:19.511113+0000 mgr.a (mgr.14373) 1962 : cluster [DBG] pgmap v1359: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:22:20.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:22:20 smithi047 bash[22744]: cluster 2024-09-16T06:22:19.511113+0000 mgr.a (mgr.14373) 1962 : cluster [DBG] pgmap v1359: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:22:21.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:22:20 smithi157 bash[24585]: cluster 2024-09-16T06:22:19.511113+0000 mgr.a (mgr.14373) 1962 : cluster [DBG] pgmap v1359: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:22:21.150 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:22:21.151 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:22:21.152 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:22:22.190 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:22:22.191 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:22:22.191 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:22:22.191 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:22:22.191 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:22:22.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:22:22 smithi047 bash[22744]: audit 2024-09-16T06:22:21.490774+0000 mgr.a (mgr.14373) 1963 : audit [DBG] from='client.54807 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:22:22.840 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:22:22 smithi047 bash[22744]: cluster 2024-09-16T06:22:21.512145+0000 mgr.a (mgr.14373) 1964 : cluster [DBG] pgmap v1360: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:22:23.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:22:22 smithi157 bash[24585]: audit 2024-09-16T06:22:21.490774+0000 mgr.a (mgr.14373) 1963 : audit [DBG] from='client.54807 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:22:23.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:22:22 smithi157 bash[24585]: cluster 2024-09-16T06:22:21.512145+0000 mgr.a (mgr.14373) 1964 : cluster [DBG] pgmap v1360: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:22:23.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:22:22 smithi086 bash[24289]: audit 2024-09-16T06:22:21.490774+0000 mgr.a (mgr.14373) 1963 : audit [DBG] from='client.54807 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:22:23.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:22:22 smithi086 bash[24289]: cluster 2024-09-16T06:22:21.512145+0000 mgr.a (mgr.14373) 1964 : cluster [DBG] pgmap v1360: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:22:24.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:22:24 smithi047 bash[22744]: cluster 2024-09-16T06:22:23.514951+0000 mgr.a (mgr.14373) 1965 : cluster [DBG] pgmap v1361: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:22:25.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:22:24 smithi157 bash[24585]: cluster 2024-09-16T06:22:23.514951+0000 mgr.a (mgr.14373) 1965 : cluster [DBG] pgmap v1361: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:22:25.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:22:24 smithi086 bash[24289]: cluster 2024-09-16T06:22:23.514951+0000 mgr.a (mgr.14373) 1965 : cluster [DBG] pgmap v1361: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:22:26.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:22:26 smithi047 bash[22744]: cluster 2024-09-16T06:22:25.515715+0000 mgr.a (mgr.14373) 1966 : cluster [DBG] pgmap v1362: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T06:22:27.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:22:26 smithi157 bash[24585]: cluster 2024-09-16T06:22:25.515715+0000 mgr.a (mgr.14373) 1966 : cluster [DBG] pgmap v1362: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T06:22:27.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:22:26 smithi086 bash[24289]: cluster 2024-09-16T06:22:25.515715+0000 mgr.a (mgr.14373) 1966 : cluster [DBG] pgmap v1362: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T06:22:27.191 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:22:27.192 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:22:27.192 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:22:27.985 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:22:27.985 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:22:27.985 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:22:27.985 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:22:27.985 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:22:28.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:22:28 smithi047 bash[22744]: cluster 2024-09-16T06:22:27.517661+0000 mgr.a (mgr.14373) 1967 : cluster [DBG] pgmap v1363: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:22:28.840 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:22:28 smithi047 bash[22744]: audit 2024-09-16T06:22:27.527189+0000 mgr.a (mgr.14373) 1968 : audit [DBG] from='client.54882 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:22:29.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:22:28 smithi157 bash[24585]: cluster 2024-09-16T06:22:27.517661+0000 mgr.a (mgr.14373) 1967 : cluster [DBG] pgmap v1363: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:22:29.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:22:28 smithi157 bash[24585]: audit 2024-09-16T06:22:27.527189+0000 mgr.a (mgr.14373) 1968 : audit [DBG] from='client.54882 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:22:29.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:22:28 smithi086 bash[24289]: cluster 2024-09-16T06:22:27.517661+0000 mgr.a (mgr.14373) 1967 : cluster [DBG] pgmap v1363: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:22:29.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:22:28 smithi086 bash[24289]: audit 2024-09-16T06:22:27.527189+0000 mgr.a (mgr.14373) 1968 : audit [DBG] from='client.54882 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:22:30.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:22:30 smithi047 bash[22744]: cluster 2024-09-16T06:22:29.518558+0000 mgr.a (mgr.14373) 1969 : cluster [DBG] pgmap v1364: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:22:31.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:22:30 smithi157 bash[24585]: cluster 2024-09-16T06:22:29.518558+0000 mgr.a (mgr.14373) 1969 : cluster [DBG] pgmap v1364: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:22:31.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:22:30 smithi086 bash[24289]: cluster 2024-09-16T06:22:29.518558+0000 mgr.a (mgr.14373) 1969 : cluster [DBG] pgmap v1364: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:22:32.986 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:22:32.987 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:22:32.987 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:22:33.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:22:32 smithi086 bash[24289]: cluster 2024-09-16T06:22:31.519470+0000 mgr.a (mgr.14373) 1970 : cluster [DBG] pgmap v1365: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T06:22:33.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:22:32 smithi047 bash[22744]: cluster 2024-09-16T06:22:31.519470+0000 mgr.a (mgr.14373) 1970 : cluster [DBG] pgmap v1365: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T06:22:33.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:22:32 smithi157 bash[24585]: cluster 2024-09-16T06:22:31.519470+0000 mgr.a (mgr.14373) 1970 : cluster [DBG] pgmap v1365: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T06:22:33.728 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:22:33.728 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:22:33.728 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:22:33.728 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:22:33.729 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:22:35.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:22:34 smithi047 bash[22744]: audit 2024-09-16T06:22:33.314535+0000 mgr.a (mgr.14373) 1971 : audit [DBG] from='client.54957 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:22:35.090 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:22:34 smithi047 bash[22744]: cluster 2024-09-16T06:22:33.521076+0000 mgr.a (mgr.14373) 1972 : cluster [DBG] pgmap v1366: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:22:35.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:22:34 smithi157 bash[24585]: audit 2024-09-16T06:22:33.314535+0000 mgr.a (mgr.14373) 1971 : audit [DBG] from='client.54957 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:22:35.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:22:34 smithi157 bash[24585]: cluster 2024-09-16T06:22:33.521076+0000 mgr.a (mgr.14373) 1972 : cluster [DBG] pgmap v1366: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:22:35.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:22:34 smithi086 bash[24289]: audit 2024-09-16T06:22:33.314535+0000 mgr.a (mgr.14373) 1971 : audit [DBG] from='client.54957 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:22:35.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:22:34 smithi086 bash[24289]: cluster 2024-09-16T06:22:33.521076+0000 mgr.a (mgr.14373) 1972 : cluster [DBG] pgmap v1366: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:22:37.090 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:22:36 smithi047 bash[22744]: cluster 2024-09-16T06:22:35.521952+0000 mgr.a (mgr.14373) 1973 : cluster [DBG] pgmap v1367: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:22:37.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:22:36 smithi157 bash[24585]: cluster 2024-09-16T06:22:35.521952+0000 mgr.a (mgr.14373) 1973 : cluster [DBG] pgmap v1367: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:22:37.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:22:36 smithi086 bash[24289]: cluster 2024-09-16T06:22:35.521952+0000 mgr.a (mgr.14373) 1973 : cluster [DBG] pgmap v1367: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:22:38.729 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:22:38.730 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:22:38.730 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:22:39.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:22:38 smithi047 bash[22744]: cluster 2024-09-16T06:22:37.524159+0000 mgr.a (mgr.14373) 1974 : cluster [DBG] pgmap v1368: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:22:39.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:22:38 smithi157 bash[24585]: cluster 2024-09-16T06:22:37.524159+0000 mgr.a (mgr.14373) 1974 : cluster [DBG] pgmap v1368: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:22:39.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:22:38 smithi086 bash[24289]: cluster 2024-09-16T06:22:37.524159+0000 mgr.a (mgr.14373) 1974 : cluster [DBG] pgmap v1368: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:22:39.512 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:22:39.513 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:22:39.513 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:22:39.513 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:22:39.513 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:22:41.090 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:22:40 smithi047 bash[22744]: audit 2024-09-16T06:22:39.075836+0000 mgr.a (mgr.14373) 1975 : audit [DBG] from='client.55035 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:22:41.090 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:22:40 smithi047 bash[22744]: cluster 2024-09-16T06:22:39.524693+0000 mgr.a (mgr.14373) 1976 : cluster [DBG] pgmap v1369: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:22:41.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:22:40 smithi157 bash[24585]: audit 2024-09-16T06:22:39.075836+0000 mgr.a (mgr.14373) 1975 : audit [DBG] from='client.55035 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:22:41.305 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:22:40 smithi157 bash[24585]: cluster 2024-09-16T06:22:39.524693+0000 mgr.a (mgr.14373) 1976 : cluster [DBG] pgmap v1369: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:22:41.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:22:40 smithi086 bash[24289]: audit 2024-09-16T06:22:39.075836+0000 mgr.a (mgr.14373) 1975 : audit [DBG] from='client.55035 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:22:41.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:22:40 smithi086 bash[24289]: cluster 2024-09-16T06:22:39.524693+0000 mgr.a (mgr.14373) 1976 : cluster [DBG] pgmap v1369: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:22:43.090 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:22:42 smithi047 bash[22744]: cluster 2024-09-16T06:22:41.526758+0000 mgr.a (mgr.14373) 1977 : cluster [DBG] pgmap v1370: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:22:43.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:22:42 smithi157 bash[24585]: cluster 2024-09-16T06:22:41.526758+0000 mgr.a (mgr.14373) 1977 : cluster [DBG] pgmap v1370: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:22:43.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:22:42 smithi086 bash[24289]: cluster 2024-09-16T06:22:41.526758+0000 mgr.a (mgr.14373) 1977 : cluster [DBG] pgmap v1370: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:22:44.514 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:22:44.515 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:22:44.515 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:22:45.295 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:22:45.295 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:22:45.295 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:22:45.295 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:22:45.296 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:22:45.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:22:44 smithi157 bash[24585]: cluster 2024-09-16T06:22:43.527507+0000 mgr.a (mgr.14373) 1978 : cluster [DBG] pgmap v1371: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:22:45.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:22:44 smithi086 bash[24289]: cluster 2024-09-16T06:22:43.527507+0000 mgr.a (mgr.14373) 1978 : cluster [DBG] pgmap v1371: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:22:45.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:22:44 smithi047 bash[22744]: cluster 2024-09-16T06:22:43.527507+0000 mgr.a (mgr.14373) 1978 : cluster [DBG] pgmap v1371: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:22:46.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:22:45 smithi157 bash[24585]: audit 2024-09-16T06:22:44.853820+0000 mgr.a (mgr.14373) 1979 : audit [DBG] from='client.55113 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:22:46.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:22:45 smithi086 bash[24289]: audit 2024-09-16T06:22:44.853820+0000 mgr.a (mgr.14373) 1979 : audit [DBG] from='client.55113 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:22:46.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:22:45 smithi047 bash[22744]: audit 2024-09-16T06:22:44.853820+0000 mgr.a (mgr.14373) 1979 : audit [DBG] from='client.55113 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:22:47.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:22:46 smithi157 bash[24585]: cluster 2024-09-16T06:22:45.528420+0000 mgr.a (mgr.14373) 1980 : cluster [DBG] pgmap v1372: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:22:47.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:22:46 smithi086 bash[24289]: cluster 2024-09-16T06:22:45.528420+0000 mgr.a (mgr.14373) 1980 : cluster [DBG] pgmap v1372: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:22:47.340 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:22:46 smithi047 bash[22744]: cluster 2024-09-16T06:22:45.528420+0000 mgr.a (mgr.14373) 1980 : cluster [DBG] pgmap v1372: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:22:49.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:22:48 smithi157 bash[24585]: cluster 2024-09-16T06:22:47.530707+0000 mgr.a (mgr.14373) 1981 : cluster [DBG] pgmap v1373: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:22:49.306 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:22:48 smithi047 bash[22744]: cluster 2024-09-16T06:22:47.530707+0000 mgr.a (mgr.14373) 1981 : cluster [DBG] pgmap v1373: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:22:49.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:22:48 smithi086 bash[24289]: cluster 2024-09-16T06:22:47.530707+0000 mgr.a (mgr.14373) 1981 : cluster [DBG] pgmap v1373: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:22:50.297 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:22:50.297 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:22:50.297 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:22:51.057 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:22:51.057 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:22:51.057 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:22:51.058 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:22:51.058 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:22:51.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:22:50 smithi157 bash[24585]: cluster 2024-09-16T06:22:49.531485+0000 mgr.a (mgr.14373) 1982 : cluster [DBG] pgmap v1374: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:22:51.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:22:50 smithi086 bash[24289]: cluster 2024-09-16T06:22:49.531485+0000 mgr.a (mgr.14373) 1982 : cluster [DBG] pgmap v1374: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:22:51.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:22:50 smithi047 bash[22744]: cluster 2024-09-16T06:22:49.531485+0000 mgr.a (mgr.14373) 1982 : cluster [DBG] pgmap v1374: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:22:52.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:22:51 smithi157 bash[24585]: audit 2024-09-16T06:22:50.632923+0000 mgr.a (mgr.14373) 1983 : audit [DBG] from='client.55191 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:22:52.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:22:51 smithi086 bash[24289]: audit 2024-09-16T06:22:50.632923+0000 mgr.a (mgr.14373) 1983 : audit [DBG] from='client.55191 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:22:52.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:22:51 smithi047 bash[22744]: audit 2024-09-16T06:22:50.632923+0000 mgr.a (mgr.14373) 1983 : audit [DBG] from='client.55191 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:22:53.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:22:52 smithi157 bash[24585]: cluster 2024-09-16T06:22:51.533914+0000 mgr.a (mgr.14373) 1984 : cluster [DBG] pgmap v1375: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:22:53.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:22:52 smithi086 bash[24289]: cluster 2024-09-16T06:22:51.533914+0000 mgr.a (mgr.14373) 1984 : cluster [DBG] pgmap v1375: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:22:53.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:22:52 smithi047 bash[22744]: cluster 2024-09-16T06:22:51.533914+0000 mgr.a (mgr.14373) 1984 : cluster [DBG] pgmap v1375: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:22:55.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:22:54 smithi157 bash[24585]: cluster 2024-09-16T06:22:53.534742+0000 mgr.a (mgr.14373) 1985 : cluster [DBG] pgmap v1376: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:22:55.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:22:54 smithi086 bash[24289]: cluster 2024-09-16T06:22:53.534742+0000 mgr.a (mgr.14373) 1985 : cluster [DBG] pgmap v1376: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:22:55.341 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:22:54 smithi047 bash[22744]: cluster 2024-09-16T06:22:53.534742+0000 mgr.a (mgr.14373) 1985 : cluster [DBG] pgmap v1376: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:22:56.059 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:22:56.059 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:22:56.059 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:22:56.802 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:22:56.802 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:22:56.802 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:22:56.802 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:22:56.802 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:22:57.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:22:56 smithi157 bash[24585]: cluster 2024-09-16T06:22:55.535487+0000 mgr.a (mgr.14373) 1986 : cluster [DBG] pgmap v1377: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:22:57.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:22:56 smithi086 bash[24289]: cluster 2024-09-16T06:22:55.535487+0000 mgr.a (mgr.14373) 1986 : cluster [DBG] pgmap v1377: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:22:57.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:22:56 smithi047 bash[22744]: cluster 2024-09-16T06:22:55.535487+0000 mgr.a (mgr.14373) 1986 : cluster [DBG] pgmap v1377: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:22:58.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:22:57 smithi157 bash[24585]: audit 2024-09-16T06:22:56.395005+0000 mgr.a (mgr.14373) 1987 : audit [DBG] from='client.55269 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:22:58.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:22:57 smithi086 bash[24289]: audit 2024-09-16T06:22:56.395005+0000 mgr.a (mgr.14373) 1987 : audit [DBG] from='client.55269 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:22:58.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:22:57 smithi047 bash[22744]: audit 2024-09-16T06:22:56.395005+0000 mgr.a (mgr.14373) 1987 : audit [DBG] from='client.55269 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:22:59.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:22:58 smithi157 bash[24585]: cluster 2024-09-16T06:22:57.538131+0000 mgr.a (mgr.14373) 1988 : cluster [DBG] pgmap v1378: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:22:59.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:22:58 smithi086 bash[24289]: cluster 2024-09-16T06:22:57.538131+0000 mgr.a (mgr.14373) 1988 : cluster [DBG] pgmap v1378: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:22:59.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:22:58 smithi047 bash[22744]: cluster 2024-09-16T06:22:57.538131+0000 mgr.a (mgr.14373) 1988 : cluster [DBG] pgmap v1378: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:23:01.305 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:23:00 smithi157 bash[24585]: cluster 2024-09-16T06:22:59.538956+0000 mgr.a (mgr.14373) 1989 : cluster [DBG] pgmap v1379: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:23:01.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:23:00 smithi086 bash[24289]: cluster 2024-09-16T06:22:59.538956+0000 mgr.a (mgr.14373) 1989 : cluster [DBG] pgmap v1379: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:23:01.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:23:00 smithi047 bash[22744]: cluster 2024-09-16T06:22:59.538956+0000 mgr.a (mgr.14373) 1989 : cluster [DBG] pgmap v1379: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:23:01.803 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:23:01.804 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:23:01.804 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:23:02.559 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:23:02.559 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:23:02.559 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:23:02.559 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:23:02.560 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:23:03.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:23:02 smithi157 bash[24585]: cluster 2024-09-16T06:23:01.540903+0000 mgr.a (mgr.14373) 1990 : cluster [DBG] pgmap v1380: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:23:03.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:23:02 smithi086 bash[24289]: cluster 2024-09-16T06:23:01.540903+0000 mgr.a (mgr.14373) 1990 : cluster [DBG] pgmap v1380: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:23:03.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:23:02 smithi047 bash[22744]: cluster 2024-09-16T06:23:01.540903+0000 mgr.a (mgr.14373) 1990 : cluster [DBG] pgmap v1380: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:23:04.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:23:03 smithi157 bash[24585]: audit 2024-09-16T06:23:02.137184+0000 mgr.a (mgr.14373) 1991 : audit [DBG] from='client.55341 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:23:04.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:23:03 smithi086 bash[24289]: audit 2024-09-16T06:23:02.137184+0000 mgr.a (mgr.14373) 1991 : audit [DBG] from='client.55341 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:23:04.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:23:03 smithi047 bash[22744]: audit 2024-09-16T06:23:02.137184+0000 mgr.a (mgr.14373) 1991 : audit [DBG] from='client.55341 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:23:05.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:23:04 smithi157 bash[24585]: cluster 2024-09-16T06:23:03.541975+0000 mgr.a (mgr.14373) 1992 : cluster [DBG] pgmap v1381: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:23:05.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:23:04 smithi086 bash[24289]: cluster 2024-09-16T06:23:03.541975+0000 mgr.a (mgr.14373) 1992 : cluster [DBG] pgmap v1381: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:23:05.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:23:04 smithi047 bash[22744]: cluster 2024-09-16T06:23:03.541975+0000 mgr.a (mgr.14373) 1992 : cluster [DBG] pgmap v1381: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:23:06.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:23:05 smithi157 bash[24585]: cluster 2024-09-16T06:23:05.542825+0000 mgr.a (mgr.14373) 1993 : cluster [DBG] pgmap v1382: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T06:23:06.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:23:05 smithi086 bash[24289]: cluster 2024-09-16T06:23:05.542825+0000 mgr.a (mgr.14373) 1993 : cluster [DBG] pgmap v1382: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T06:23:06.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:23:05 smithi047 bash[22744]: cluster 2024-09-16T06:23:05.542825+0000 mgr.a (mgr.14373) 1993 : cluster [DBG] pgmap v1382: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T06:23:07.561 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:23:07.561 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:23:07.562 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:23:08.321 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:23:08.321 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:23:08.322 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:23:08.322 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:23:08.322 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:23:09.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:23:08 smithi157 bash[24585]: cluster 2024-09-16T06:23:07.544939+0000 mgr.a (mgr.14373) 1994 : cluster [DBG] pgmap v1383: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:23:09.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:23:08 smithi157 bash[24585]: audit 2024-09-16T06:23:07.898566+0000 mgr.a (mgr.14373) 1995 : audit [DBG] from='client.55416 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:23:09.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:23:08 smithi086 bash[24289]: cluster 2024-09-16T06:23:07.544939+0000 mgr.a (mgr.14373) 1994 : cluster [DBG] pgmap v1383: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:23:09.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:23:08 smithi086 bash[24289]: audit 2024-09-16T06:23:07.898566+0000 mgr.a (mgr.14373) 1995 : audit [DBG] from='client.55416 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:23:09.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:23:08 smithi047 bash[22744]: cluster 2024-09-16T06:23:07.544939+0000 mgr.a (mgr.14373) 1994 : cluster [DBG] pgmap v1383: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:23:09.090 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:23:08 smithi047 bash[22744]: audit 2024-09-16T06:23:07.898566+0000 mgr.a (mgr.14373) 1995 : audit [DBG] from='client.55416 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:23:11.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:23:10 smithi157 bash[24585]: cluster 2024-09-16T06:23:09.545808+0000 mgr.a (mgr.14373) 1996 : cluster [DBG] pgmap v1384: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:23:11.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:23:10 smithi086 bash[24289]: cluster 2024-09-16T06:23:09.545808+0000 mgr.a (mgr.14373) 1996 : cluster [DBG] pgmap v1384: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:23:11.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:23:10 smithi047 bash[22744]: cluster 2024-09-16T06:23:09.545808+0000 mgr.a (mgr.14373) 1996 : cluster [DBG] pgmap v1384: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:23:13.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:23:12 smithi157 bash[24585]: cluster 2024-09-16T06:23:11.547993+0000 mgr.a (mgr.14373) 1997 : cluster [DBG] pgmap v1385: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:23:13.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:23:12 smithi086 bash[24289]: cluster 2024-09-16T06:23:11.547993+0000 mgr.a (mgr.14373) 1997 : cluster [DBG] pgmap v1385: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:23:13.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:23:12 smithi047 bash[22744]: cluster 2024-09-16T06:23:11.547993+0000 mgr.a (mgr.14373) 1997 : cluster [DBG] pgmap v1385: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:23:13.323 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:23:13.324 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:23:13.324 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:23:14.111 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:23:14.112 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:23:14.112 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:23:14.112 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:23:14.112 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:23:15.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:23:14 smithi157 bash[24585]: cluster 2024-09-16T06:23:13.548740+0000 mgr.a (mgr.14373) 1998 : cluster [DBG] pgmap v1386: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:23:15.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:23:14 smithi157 bash[24585]: audit 2024-09-16T06:23:13.659158+0000 mgr.a (mgr.14373) 1999 : audit [DBG] from='client.55494 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:23:15.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:23:14 smithi157 bash[24585]: audit 2024-09-16T06:23:14.037181+0000 mon.b (mon.2) 226 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T06:23:15.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:23:14 smithi086 bash[24289]: cluster 2024-09-16T06:23:13.548740+0000 mgr.a (mgr.14373) 1998 : cluster [DBG] pgmap v1386: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:23:15.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:23:14 smithi086 bash[24289]: audit 2024-09-16T06:23:13.659158+0000 mgr.a (mgr.14373) 1999 : audit [DBG] from='client.55494 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:23:15.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:23:14 smithi086 bash[24289]: audit 2024-09-16T06:23:14.037181+0000 mon.b (mon.2) 226 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T06:23:15.090 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:23:14 smithi047 bash[22744]: cluster 2024-09-16T06:23:13.548740+0000 mgr.a (mgr.14373) 1998 : cluster [DBG] pgmap v1386: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:23:15.090 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:23:14 smithi047 bash[22744]: audit 2024-09-16T06:23:13.659158+0000 mgr.a (mgr.14373) 1999 : audit [DBG] from='client.55494 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:23:15.090 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:23:14 smithi047 bash[22744]: audit 2024-09-16T06:23:14.037181+0000 mon.b (mon.2) 226 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T06:23:15.839 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 06:23:15 smithi047 bash[22994]: debug 2024-09-16T06:23:15.579+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T06:23:15.840 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 06:23:15 smithi047 bash[22994]: debug 2024-09-16T06:23:15.579+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T06:23:15.840 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:23:15 smithi047 bash[22744]: audit 2024-09-16T06:23:14.822242+0000 mon.b (mon.2) 227 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T06:23:15.840 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:23:15 smithi047 bash[22744]: audit 2024-09-16T06:23:14.824218+0000 mon.b (mon.2) 228 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T06:23:15.840 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:23:15 smithi047 bash[22744]: audit 2024-09-16T06:23:14.836854+0000 mon.a (mon.0) 687 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:23:15.840 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:23:15 smithi047 bash[22744]: audit 2024-09-16T06:23:14.840699+0000 mon.b (mon.2) 229 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:23:15.840 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:23:15 smithi047 bash[22744]: audit 2024-09-16T06:23:14.844712+0000 mgr.a (mgr.14373) 2000 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:23:16.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:23:15 smithi157 bash[24585]: audit 2024-09-16T06:23:14.822242+0000 mon.b (mon.2) 227 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T06:23:16.055 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:23:15 smithi157 bash[24585]: audit 2024-09-16T06:23:14.824218+0000 mon.b (mon.2) 228 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T06:23:16.055 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:23:15 smithi157 bash[24585]: audit 2024-09-16T06:23:14.836854+0000 mon.a (mon.0) 687 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:23:16.055 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:23:15 smithi157 bash[24585]: audit 2024-09-16T06:23:14.840699+0000 mon.b (mon.2) 229 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:23:16.055 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:23:15 smithi157 bash[24585]: audit 2024-09-16T06:23:14.844712+0000 mgr.a (mgr.14373) 2000 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:23:16.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:23:15 smithi086 bash[24289]: audit 2024-09-16T06:23:14.822242+0000 mon.b (mon.2) 227 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T06:23:16.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:23:15 smithi086 bash[24289]: audit 2024-09-16T06:23:14.824218+0000 mon.b (mon.2) 228 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T06:23:16.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:23:15 smithi086 bash[24289]: audit 2024-09-16T06:23:14.836854+0000 mon.a (mon.0) 687 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:23:16.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:23:15 smithi086 bash[24289]: audit 2024-09-16T06:23:14.840699+0000 mon.b (mon.2) 229 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:23:16.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:23:15 smithi086 bash[24289]: audit 2024-09-16T06:23:14.844712+0000 mgr.a (mgr.14373) 2000 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:23:17.090 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:23:16 smithi047 bash[22744]: cluster 2024-09-16T06:23:15.549236+0000 mgr.a (mgr.14373) 2001 : cluster [DBG] pgmap v1387: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:23:17.090 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:23:16 smithi047 bash[22744]: audit 2024-09-16T06:23:15.583342+0000 mgr.a (mgr.14373) 2002 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T06:23:17.090 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:23:16 smithi047 bash[22744]: cephadm 2024-09-16T06:23:15.585252+0000 mgr.a (mgr.14373) 2003 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T06:23:17.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:23:16 smithi157 bash[24585]: cluster 2024-09-16T06:23:15.549236+0000 mgr.a (mgr.14373) 2001 : cluster [DBG] pgmap v1387: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:23:17.305 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:23:16 smithi157 bash[24585]: audit 2024-09-16T06:23:15.583342+0000 mgr.a (mgr.14373) 2002 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T06:23:17.305 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:23:16 smithi157 bash[24585]: cephadm 2024-09-16T06:23:15.585252+0000 mgr.a (mgr.14373) 2003 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T06:23:17.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:23:16 smithi086 bash[24289]: cluster 2024-09-16T06:23:15.549236+0000 mgr.a (mgr.14373) 2001 : cluster [DBG] pgmap v1387: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:23:17.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:23:16 smithi086 bash[24289]: audit 2024-09-16T06:23:15.583342+0000 mgr.a (mgr.14373) 2002 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T06:23:17.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:23:16 smithi086 bash[24289]: cephadm 2024-09-16T06:23:15.585252+0000 mgr.a (mgr.14373) 2003 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T06:23:19.113 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:23:19.114 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:23:19.114 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:23:19.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:23:18 smithi157 bash[24585]: cluster 2024-09-16T06:23:17.551486+0000 mgr.a (mgr.14373) 2004 : cluster [DBG] pgmap v1388: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:23:19.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:23:18 smithi086 bash[24289]: cluster 2024-09-16T06:23:17.551486+0000 mgr.a (mgr.14373) 2004 : cluster [DBG] pgmap v1388: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:23:19.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:23:18 smithi047 bash[22744]: cluster 2024-09-16T06:23:17.551486+0000 mgr.a (mgr.14373) 2004 : cluster [DBG] pgmap v1388: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:23:19.898 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:23:19.899 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:23:19.899 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:23:19.899 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:23:19.899 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:23:21.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:23:20 smithi157 bash[24585]: audit 2024-09-16T06:23:19.450235+0000 mgr.a (mgr.14373) 2005 : audit [DBG] from='client.55680 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:23:21.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:23:20 smithi157 bash[24585]: cluster 2024-09-16T06:23:19.552050+0000 mgr.a (mgr.14373) 2006 : cluster [DBG] pgmap v1389: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:23:21.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:23:20 smithi086 bash[24289]: audit 2024-09-16T06:23:19.450235+0000 mgr.a (mgr.14373) 2005 : audit [DBG] from='client.55680 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:23:21.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:23:20 smithi086 bash[24289]: cluster 2024-09-16T06:23:19.552050+0000 mgr.a (mgr.14373) 2006 : cluster [DBG] pgmap v1389: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:23:21.340 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:23:20 smithi047 bash[22744]: audit 2024-09-16T06:23:19.450235+0000 mgr.a (mgr.14373) 2005 : audit [DBG] from='client.55680 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:23:21.340 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:23:20 smithi047 bash[22744]: cluster 2024-09-16T06:23:19.552050+0000 mgr.a (mgr.14373) 2006 : cluster [DBG] pgmap v1389: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:23:23.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:23:22 smithi157 bash[24585]: cluster 2024-09-16T06:23:21.554337+0000 mgr.a (mgr.14373) 2007 : cluster [DBG] pgmap v1390: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:23:23.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:23:22 smithi086 bash[24289]: cluster 2024-09-16T06:23:21.554337+0000 mgr.a (mgr.14373) 2007 : cluster [DBG] pgmap v1390: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:23:23.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:23:22 smithi047 bash[22744]: cluster 2024-09-16T06:23:21.554337+0000 mgr.a (mgr.14373) 2007 : cluster [DBG] pgmap v1390: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:23:24.900 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:23:24.901 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:23:24.901 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:23:25.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:23:24 smithi157 bash[24585]: cluster 2024-09-16T06:23:23.555100+0000 mgr.a (mgr.14373) 2008 : cluster [DBG] pgmap v1391: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:23:25.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:23:24 smithi086 bash[24289]: cluster 2024-09-16T06:23:23.555100+0000 mgr.a (mgr.14373) 2008 : cluster [DBG] pgmap v1391: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:23:25.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:23:24 smithi047 bash[22744]: cluster 2024-09-16T06:23:23.555100+0000 mgr.a (mgr.14373) 2008 : cluster [DBG] pgmap v1391: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:23:25.660 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:23:25.660 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:23:25.660 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:23:25.660 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:23:25.660 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:23:27.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:23:26 smithi157 bash[24585]: audit 2024-09-16T06:23:25.229070+0000 mgr.a (mgr.14373) 2009 : audit [DBG] from='client.55758 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:23:27.305 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:23:26 smithi157 bash[24585]: cluster 2024-09-16T06:23:25.558134+0000 mgr.a (mgr.14373) 2010 : cluster [DBG] pgmap v1392: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:23:27.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:23:26 smithi086 bash[24289]: audit 2024-09-16T06:23:25.229070+0000 mgr.a (mgr.14373) 2009 : audit [DBG] from='client.55758 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:23:27.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:23:26 smithi086 bash[24289]: cluster 2024-09-16T06:23:25.558134+0000 mgr.a (mgr.14373) 2010 : cluster [DBG] pgmap v1392: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:23:27.340 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:23:26 smithi047 bash[22744]: audit 2024-09-16T06:23:25.229070+0000 mgr.a (mgr.14373) 2009 : audit [DBG] from='client.55758 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:23:27.340 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:23:26 smithi047 bash[22744]: cluster 2024-09-16T06:23:25.558134+0000 mgr.a (mgr.14373) 2010 : cluster [DBG] pgmap v1392: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:23:29.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:23:28 smithi157 bash[24585]: cluster 2024-09-16T06:23:27.560307+0000 mgr.a (mgr.14373) 2011 : cluster [DBG] pgmap v1393: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:23:29.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:23:28 smithi086 bash[24289]: cluster 2024-09-16T06:23:27.560307+0000 mgr.a (mgr.14373) 2011 : cluster [DBG] pgmap v1393: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:23:29.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:23:28 smithi047 bash[22744]: cluster 2024-09-16T06:23:27.560307+0000 mgr.a (mgr.14373) 2011 : cluster [DBG] pgmap v1393: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:23:30.661 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:23:30.662 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:23:30.662 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:23:31.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:23:30 smithi157 bash[24585]: cluster 2024-09-16T06:23:29.561110+0000 mgr.a (mgr.14373) 2012 : cluster [DBG] pgmap v1394: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:23:31.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:23:30 smithi086 bash[24289]: cluster 2024-09-16T06:23:29.561110+0000 mgr.a (mgr.14373) 2012 : cluster [DBG] pgmap v1394: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:23:31.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:23:30 smithi047 bash[22744]: cluster 2024-09-16T06:23:29.561110+0000 mgr.a (mgr.14373) 2012 : cluster [DBG] pgmap v1394: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:23:31.439 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:23:31.440 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:23:31.440 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:23:31.440 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:23:31.440 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:23:33.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:23:32 smithi157 bash[24585]: audit 2024-09-16T06:23:31.005327+0000 mgr.a (mgr.14373) 2013 : audit [DBG] from='client.55836 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:23:33.305 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:23:32 smithi157 bash[24585]: cluster 2024-09-16T06:23:31.563525+0000 mgr.a (mgr.14373) 2014 : cluster [DBG] pgmap v1395: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-16T06:23:33.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:23:32 smithi086 bash[24289]: audit 2024-09-16T06:23:31.005327+0000 mgr.a (mgr.14373) 2013 : audit [DBG] from='client.55836 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:23:33.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:23:32 smithi086 bash[24289]: cluster 2024-09-16T06:23:31.563525+0000 mgr.a (mgr.14373) 2014 : cluster [DBG] pgmap v1395: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-16T06:23:33.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:23:32 smithi047 bash[22744]: audit 2024-09-16T06:23:31.005327+0000 mgr.a (mgr.14373) 2013 : audit [DBG] from='client.55836 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:23:33.340 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:23:32 smithi047 bash[22744]: cluster 2024-09-16T06:23:31.563525+0000 mgr.a (mgr.14373) 2014 : cluster [DBG] pgmap v1395: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-16T06:23:35.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:23:34 smithi157 bash[24585]: cluster 2024-09-16T06:23:33.564328+0000 mgr.a (mgr.14373) 2015 : cluster [DBG] pgmap v1396: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T06:23:35.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:23:34 smithi086 bash[24289]: cluster 2024-09-16T06:23:33.564328+0000 mgr.a (mgr.14373) 2015 : cluster [DBG] pgmap v1396: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T06:23:35.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:23:34 smithi047 bash[22744]: cluster 2024-09-16T06:23:33.564328+0000 mgr.a (mgr.14373) 2015 : cluster [DBG] pgmap v1396: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T06:23:36.441 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:23:36.442 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:23:36.442 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:23:37.221 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:23:37.221 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:23:37.221 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:23:37.221 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:23:37.221 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:23:37.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:23:36 smithi157 bash[24585]: cluster 2024-09-16T06:23:35.565119+0000 mgr.a (mgr.14373) 2016 : cluster [DBG] pgmap v1397: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T06:23:37.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:23:36 smithi086 bash[24289]: cluster 2024-09-16T06:23:35.565119+0000 mgr.a (mgr.14373) 2016 : cluster [DBG] pgmap v1397: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T06:23:37.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:23:36 smithi047 bash[22744]: cluster 2024-09-16T06:23:35.565119+0000 mgr.a (mgr.14373) 2016 : cluster [DBG] pgmap v1397: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T06:23:38.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:23:37 smithi157 bash[24585]: audit 2024-09-16T06:23:36.784323+0000 mgr.a (mgr.14373) 2017 : audit [DBG] from='client.55914 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:23:38.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:23:37 smithi086 bash[24289]: audit 2024-09-16T06:23:36.784323+0000 mgr.a (mgr.14373) 2017 : audit [DBG] from='client.55914 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:23:38.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:23:37 smithi047 bash[22744]: audit 2024-09-16T06:23:36.784323+0000 mgr.a (mgr.14373) 2017 : audit [DBG] from='client.55914 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:23:39.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:23:38 smithi157 bash[24585]: cluster 2024-09-16T06:23:37.567942+0000 mgr.a (mgr.14373) 2018 : cluster [DBG] pgmap v1398: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:23:39.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:23:38 smithi086 bash[24289]: cluster 2024-09-16T06:23:37.567942+0000 mgr.a (mgr.14373) 2018 : cluster [DBG] pgmap v1398: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:23:39.341 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:23:38 smithi047 bash[22744]: cluster 2024-09-16T06:23:37.567942+0000 mgr.a (mgr.14373) 2018 : cluster [DBG] pgmap v1398: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:23:41.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:23:40 smithi157 bash[24585]: cluster 2024-09-16T06:23:39.568743+0000 mgr.a (mgr.14373) 2019 : cluster [DBG] pgmap v1399: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:23:41.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:23:40 smithi086 bash[24289]: cluster 2024-09-16T06:23:39.568743+0000 mgr.a (mgr.14373) 2019 : cluster [DBG] pgmap v1399: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:23:41.340 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:23:40 smithi047 bash[22744]: cluster 2024-09-16T06:23:39.568743+0000 mgr.a (mgr.14373) 2019 : cluster [DBG] pgmap v1399: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:23:42.223 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:23:42.224 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:23:42.224 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:23:42.984 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:23:42.984 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:23:42.985 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:23:42.985 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:23:42.985 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:23:43.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:23:42 smithi157 bash[24585]: cluster 2024-09-16T06:23:41.570737+0000 mgr.a (mgr.14373) 2020 : cluster [DBG] pgmap v1400: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:23:43.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:23:42 smithi086 bash[24289]: cluster 2024-09-16T06:23:41.570737+0000 mgr.a (mgr.14373) 2020 : cluster [DBG] pgmap v1400: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:23:43.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:23:42 smithi047 bash[22744]: cluster 2024-09-16T06:23:41.570737+0000 mgr.a (mgr.14373) 2020 : cluster [DBG] pgmap v1400: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:23:44.305 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:23:43 smithi157 bash[24585]: audit 2024-09-16T06:23:42.556723+0000 mgr.a (mgr.14373) 2021 : audit [DBG] from='client.55989 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:23:44.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:23:43 smithi086 bash[24289]: audit 2024-09-16T06:23:42.556723+0000 mgr.a (mgr.14373) 2021 : audit [DBG] from='client.55989 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:23:44.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:23:43 smithi047 bash[22744]: audit 2024-09-16T06:23:42.556723+0000 mgr.a (mgr.14373) 2021 : audit [DBG] from='client.55989 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:23:45.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:23:44 smithi157 bash[24585]: cluster 2024-09-16T06:23:43.571735+0000 mgr.a (mgr.14373) 2022 : cluster [DBG] pgmap v1401: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-16T06:23:45.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:23:44 smithi086 bash[24289]: cluster 2024-09-16T06:23:43.571735+0000 mgr.a (mgr.14373) 2022 : cluster [DBG] pgmap v1401: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-16T06:23:45.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:23:44 smithi047 bash[22744]: cluster 2024-09-16T06:23:43.571735+0000 mgr.a (mgr.14373) 2022 : cluster [DBG] pgmap v1401: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-16T06:23:47.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:23:46 smithi157 bash[24585]: cluster 2024-09-16T06:23:45.572527+0000 mgr.a (mgr.14373) 2023 : cluster [DBG] pgmap v1402: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-16T06:23:47.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:23:46 smithi086 bash[24289]: cluster 2024-09-16T06:23:45.572527+0000 mgr.a (mgr.14373) 2023 : cluster [DBG] pgmap v1402: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-16T06:23:47.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:23:46 smithi047 bash[22744]: cluster 2024-09-16T06:23:45.572527+0000 mgr.a (mgr.14373) 2023 : cluster [DBG] pgmap v1402: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-16T06:23:47.986 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:23:47.987 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:23:47.987 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:23:48.730 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:23:48.730 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:23:48.730 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:23:48.730 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:23:48.730 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:23:49.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:23:48 smithi157 bash[24585]: cluster 2024-09-16T06:23:47.574742+0000 mgr.a (mgr.14373) 2024 : cluster [DBG] pgmap v1403: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-16T06:23:49.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:23:48 smithi086 bash[24289]: cluster 2024-09-16T06:23:47.574742+0000 mgr.a (mgr.14373) 2024 : cluster [DBG] pgmap v1403: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-16T06:23:49.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:23:48 smithi047 bash[22744]: cluster 2024-09-16T06:23:47.574742+0000 mgr.a (mgr.14373) 2024 : cluster [DBG] pgmap v1403: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-16T06:23:50.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:23:49 smithi157 bash[24585]: audit 2024-09-16T06:23:48.316561+0000 mgr.a (mgr.14373) 2025 : audit [DBG] from='client.56064 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:23:50.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:23:49 smithi086 bash[24289]: audit 2024-09-16T06:23:48.316561+0000 mgr.a (mgr.14373) 2025 : audit [DBG] from='client.56064 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:23:50.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:23:49 smithi047 bash[22744]: audit 2024-09-16T06:23:48.316561+0000 mgr.a (mgr.14373) 2025 : audit [DBG] from='client.56064 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:23:51.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:23:50 smithi157 bash[24585]: cluster 2024-09-16T06:23:49.575688+0000 mgr.a (mgr.14373) 2026 : cluster [DBG] pgmap v1404: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:23:51.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:23:50 smithi086 bash[24289]: cluster 2024-09-16T06:23:49.575688+0000 mgr.a (mgr.14373) 2026 : cluster [DBG] pgmap v1404: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:23:51.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:23:50 smithi047 bash[22744]: cluster 2024-09-16T06:23:49.575688+0000 mgr.a (mgr.14373) 2026 : cluster [DBG] pgmap v1404: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:23:52.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:23:51 smithi157 bash[24585]: cluster 2024-09-16T06:23:51.577876+0000 mgr.a (mgr.14373) 2027 : cluster [DBG] pgmap v1405: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:23:52.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:23:51 smithi086 bash[24289]: cluster 2024-09-16T06:23:51.577876+0000 mgr.a (mgr.14373) 2027 : cluster [DBG] pgmap v1405: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:23:52.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:23:51 smithi047 bash[22744]: cluster 2024-09-16T06:23:51.577876+0000 mgr.a (mgr.14373) 2027 : cluster [DBG] pgmap v1405: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:23:53.732 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:23:53.732 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:23:53.732 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:23:54.468 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:23:54.468 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:23:54.468 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:23:54.468 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:23:54.468 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:23:55.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:23:54 smithi157 bash[24585]: cluster 2024-09-16T06:23:53.578682+0000 mgr.a (mgr.14373) 2028 : cluster [DBG] pgmap v1406: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:23:55.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:23:54 smithi086 bash[24289]: cluster 2024-09-16T06:23:53.578682+0000 mgr.a (mgr.14373) 2028 : cluster [DBG] pgmap v1406: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:23:55.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:23:54 smithi047 bash[22744]: cluster 2024-09-16T06:23:53.578682+0000 mgr.a (mgr.14373) 2028 : cluster [DBG] pgmap v1406: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:23:56.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:23:55 smithi157 bash[24585]: audit 2024-09-16T06:23:54.064935+0000 mgr.a (mgr.14373) 2029 : audit [DBG] from='client.56139 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:23:56.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:23:55 smithi086 bash[24289]: audit 2024-09-16T06:23:54.064935+0000 mgr.a (mgr.14373) 2029 : audit [DBG] from='client.56139 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:23:56.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:23:55 smithi047 bash[22744]: audit 2024-09-16T06:23:54.064935+0000 mgr.a (mgr.14373) 2029 : audit [DBG] from='client.56139 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:23:57.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:23:56 smithi157 bash[24585]: cluster 2024-09-16T06:23:55.579783+0000 mgr.a (mgr.14373) 2030 : cluster [DBG] pgmap v1407: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:23:57.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:23:56 smithi086 bash[24289]: cluster 2024-09-16T06:23:55.579783+0000 mgr.a (mgr.14373) 2030 : cluster [DBG] pgmap v1407: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:23:57.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:23:56 smithi047 bash[22744]: cluster 2024-09-16T06:23:55.579783+0000 mgr.a (mgr.14373) 2030 : cluster [DBG] pgmap v1407: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:23:59.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:23:58 smithi157 bash[24585]: cluster 2024-09-16T06:23:57.582154+0000 mgr.a (mgr.14373) 2031 : cluster [DBG] pgmap v1408: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:23:59.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:23:58 smithi086 bash[24289]: cluster 2024-09-16T06:23:57.582154+0000 mgr.a (mgr.14373) 2031 : cluster [DBG] pgmap v1408: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:23:59.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:23:58 smithi047 bash[22744]: cluster 2024-09-16T06:23:57.582154+0000 mgr.a (mgr.14373) 2031 : cluster [DBG] pgmap v1408: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:23:59.469 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:23:59.470 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:23:59.470 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:24:00.244 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:24:00.245 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:24:00.245 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:24:00.245 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:24:00.245 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:24:01.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:24:00 smithi157 bash[24585]: cluster 2024-09-16T06:23:59.582622+0000 mgr.a (mgr.14373) 2032 : cluster [DBG] pgmap v1409: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:24:01.055 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:24:00 smithi157 bash[24585]: audit 2024-09-16T06:23:59.809673+0000 mgr.a (mgr.14373) 2033 : audit [DBG] from='client.56214 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:24:01.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:24:00 smithi086 bash[24289]: cluster 2024-09-16T06:23:59.582622+0000 mgr.a (mgr.14373) 2032 : cluster [DBG] pgmap v1409: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:24:01.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:24:00 smithi086 bash[24289]: audit 2024-09-16T06:23:59.809673+0000 mgr.a (mgr.14373) 2033 : audit [DBG] from='client.56214 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:24:01.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:24:00 smithi047 bash[22744]: cluster 2024-09-16T06:23:59.582622+0000 mgr.a (mgr.14373) 2032 : cluster [DBG] pgmap v1409: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:24:01.090 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:24:00 smithi047 bash[22744]: audit 2024-09-16T06:23:59.809673+0000 mgr.a (mgr.14373) 2033 : audit [DBG] from='client.56214 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:24:03.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:24:02 smithi157 bash[24585]: cluster 2024-09-16T06:24:01.584994+0000 mgr.a (mgr.14373) 2034 : cluster [DBG] pgmap v1410: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:24:03.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:24:02 smithi086 bash[24289]: cluster 2024-09-16T06:24:01.584994+0000 mgr.a (mgr.14373) 2034 : cluster [DBG] pgmap v1410: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:24:03.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:24:02 smithi047 bash[22744]: cluster 2024-09-16T06:24:01.584994+0000 mgr.a (mgr.14373) 2034 : cluster [DBG] pgmap v1410: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:24:05.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:24:04 smithi157 bash[24585]: cluster 2024-09-16T06:24:03.585959+0000 mgr.a (mgr.14373) 2035 : cluster [DBG] pgmap v1411: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:24:05.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:24:04 smithi086 bash[24289]: cluster 2024-09-16T06:24:03.585959+0000 mgr.a (mgr.14373) 2035 : cluster [DBG] pgmap v1411: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:24:05.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:24:04 smithi047 bash[22744]: cluster 2024-09-16T06:24:03.585959+0000 mgr.a (mgr.14373) 2035 : cluster [DBG] pgmap v1411: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:24:05.246 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:24:05.247 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:24:05.247 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:24:06.019 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:24:06.019 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:24:06.019 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:24:06.019 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:24:06.019 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:24:07.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:24:06 smithi157 bash[24585]: audit 2024-09-16T06:24:05.581642+0000 mgr.a (mgr.14373) 2036 : audit [DBG] from='client.56292 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:24:07.055 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:24:06 smithi157 bash[24585]: cluster 2024-09-16T06:24:05.597504+0000 mgr.a (mgr.14373) 2037 : cluster [DBG] pgmap v1412: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:24:07.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:24:06 smithi086 bash[24289]: audit 2024-09-16T06:24:05.581642+0000 mgr.a (mgr.14373) 2036 : audit [DBG] from='client.56292 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:24:07.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:24:06 smithi086 bash[24289]: cluster 2024-09-16T06:24:05.597504+0000 mgr.a (mgr.14373) 2037 : cluster [DBG] pgmap v1412: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:24:07.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:24:06 smithi047 bash[22744]: audit 2024-09-16T06:24:05.581642+0000 mgr.a (mgr.14373) 2036 : audit [DBG] from='client.56292 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:24:07.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:24:06 smithi047 bash[22744]: cluster 2024-09-16T06:24:05.597504+0000 mgr.a (mgr.14373) 2037 : cluster [DBG] pgmap v1412: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:24:09.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:24:08 smithi157 bash[24585]: cluster 2024-09-16T06:24:07.599931+0000 mgr.a (mgr.14373) 2038 : cluster [DBG] pgmap v1413: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:24:09.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:24:08 smithi086 bash[24289]: cluster 2024-09-16T06:24:07.599931+0000 mgr.a (mgr.14373) 2038 : cluster [DBG] pgmap v1413: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:24:09.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:24:08 smithi047 bash[22744]: cluster 2024-09-16T06:24:07.599931+0000 mgr.a (mgr.14373) 2038 : cluster [DBG] pgmap v1413: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:24:11.020 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:24:11.021 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:24:11.021 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:24:11.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:24:10 smithi157 bash[24585]: cluster 2024-09-16T06:24:09.600735+0000 mgr.a (mgr.14373) 2039 : cluster [DBG] pgmap v1414: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:24:11.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:24:10 smithi086 bash[24289]: cluster 2024-09-16T06:24:09.600735+0000 mgr.a (mgr.14373) 2039 : cluster [DBG] pgmap v1414: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:24:11.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:24:10 smithi047 bash[22744]: cluster 2024-09-16T06:24:09.600735+0000 mgr.a (mgr.14373) 2039 : cluster [DBG] pgmap v1414: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:24:11.791 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:24:11.791 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:24:11.791 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:24:11.791 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:24:11.791 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:24:13.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:24:12 smithi157 bash[24585]: audit 2024-09-16T06:24:11.360833+0000 mgr.a (mgr.14373) 2040 : audit [DBG] from='client.56370 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:24:13.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:24:12 smithi157 bash[24585]: cluster 2024-09-16T06:24:11.602648+0000 mgr.a (mgr.14373) 2041 : cluster [DBG] pgmap v1415: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:24:13.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:24:12 smithi086 bash[24289]: audit 2024-09-16T06:24:11.360833+0000 mgr.a (mgr.14373) 2040 : audit [DBG] from='client.56370 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:24:13.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:24:12 smithi086 bash[24289]: cluster 2024-09-16T06:24:11.602648+0000 mgr.a (mgr.14373) 2041 : cluster [DBG] pgmap v1415: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:24:13.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:24:12 smithi047 bash[22744]: audit 2024-09-16T06:24:11.360833+0000 mgr.a (mgr.14373) 2040 : audit [DBG] from='client.56370 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:24:13.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:24:12 smithi047 bash[22744]: cluster 2024-09-16T06:24:11.602648+0000 mgr.a (mgr.14373) 2041 : cluster [DBG] pgmap v1415: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:24:15.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:24:14 smithi157 bash[24585]: cluster 2024-09-16T06:24:13.603685+0000 mgr.a (mgr.14373) 2042 : cluster [DBG] pgmap v1416: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:24:15.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:24:14 smithi086 bash[24289]: cluster 2024-09-16T06:24:13.603685+0000 mgr.a (mgr.14373) 2042 : cluster [DBG] pgmap v1416: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:24:15.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:24:14 smithi047 bash[22744]: cluster 2024-09-16T06:24:13.603685+0000 mgr.a (mgr.14373) 2042 : cluster [DBG] pgmap v1416: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:24:16.055 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:24:15 smithi157 bash[24585]: audit 2024-09-16T06:24:15.636894+0000 mon.b (mon.2) 230 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T06:24:16.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:24:15 smithi086 bash[24289]: audit 2024-09-16T06:24:15.636894+0000 mon.b (mon.2) 230 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T06:24:16.090 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:24:15 smithi047 bash[22744]: audit 2024-09-16T06:24:15.636894+0000 mon.b (mon.2) 230 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T06:24:16.792 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:24:16.793 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:24:16.793 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:24:17.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:24:16 smithi157 bash[24585]: cluster 2024-09-16T06:24:15.604646+0000 mgr.a (mgr.14373) 2043 : cluster [DBG] pgmap v1417: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:24:17.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:24:16 smithi157 bash[24585]: audit 2024-09-16T06:24:16.273876+0000 mon.a (mon.0) 688 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:24:17.055 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:24:16 smithi157 bash[24585]: audit 2024-09-16T06:24:16.279389+0000 mon.a (mon.0) 689 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:24:17.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:24:16 smithi086 bash[24289]: cluster 2024-09-16T06:24:15.604646+0000 mgr.a (mgr.14373) 2043 : cluster [DBG] pgmap v1417: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:24:17.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:24:16 smithi086 bash[24289]: audit 2024-09-16T06:24:16.273876+0000 mon.a (mon.0) 688 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:24:17.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:24:16 smithi086 bash[24289]: audit 2024-09-16T06:24:16.279389+0000 mon.a (mon.0) 689 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:24:17.090 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:24:16 smithi047 bash[22744]: cluster 2024-09-16T06:24:15.604646+0000 mgr.a (mgr.14373) 2043 : cluster [DBG] pgmap v1417: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:24:17.090 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:24:16 smithi047 bash[22744]: audit 2024-09-16T06:24:16.273876+0000 mon.a (mon.0) 688 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:24:17.090 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:24:16 smithi047 bash[22744]: audit 2024-09-16T06:24:16.279389+0000 mon.a (mon.0) 689 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:24:18.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:24:17 smithi157 bash[24585]: audit 2024-09-16T06:24:17.033631+0000 mon.b (mon.2) 231 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T06:24:18.055 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:24:17 smithi157 bash[24585]: audit 2024-09-16T06:24:17.035242+0000 mon.b (mon.2) 232 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T06:24:18.055 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:24:17 smithi157 bash[24585]: audit 2024-09-16T06:24:17.045485+0000 mon.a (mon.0) 690 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:24:18.055 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:24:17 smithi157 bash[24585]: audit 2024-09-16T06:24:17.050254+0000 mon.b (mon.2) 233 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:24:18.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:24:17 smithi086 bash[24289]: audit 2024-09-16T06:24:17.033631+0000 mon.b (mon.2) 231 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T06:24:18.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:24:17 smithi086 bash[24289]: audit 2024-09-16T06:24:17.035242+0000 mon.b (mon.2) 232 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T06:24:18.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:24:17 smithi086 bash[24289]: audit 2024-09-16T06:24:17.045485+0000 mon.a (mon.0) 690 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:24:18.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:24:17 smithi086 bash[24289]: audit 2024-09-16T06:24:17.050254+0000 mon.b (mon.2) 233 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:24:18.089 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 06:24:17 smithi047 bash[22994]: debug 2024-09-16T06:24:17.794+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T06:24:18.089 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 06:24:17 smithi047 bash[22994]: debug 2024-09-16T06:24:17.806+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T06:24:18.090 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:24:17 smithi047 bash[22744]: audit 2024-09-16T06:24:17.033631+0000 mon.b (mon.2) 231 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T06:24:18.090 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:24:17 smithi047 bash[22744]: audit 2024-09-16T06:24:17.035242+0000 mon.b (mon.2) 232 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T06:24:18.090 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:24:17 smithi047 bash[22744]: audit 2024-09-16T06:24:17.045485+0000 mon.a (mon.0) 690 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:24:18.090 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:24:17 smithi047 bash[22744]: audit 2024-09-16T06:24:17.050254+0000 mon.b (mon.2) 233 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:24:18.207 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:24:18.207 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:24:18.207 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:24:18.207 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:24:18.207 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:24:19.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:24:18 smithi157 bash[24585]: audit 2024-09-16T06:24:17.054051+0000 mgr.a (mgr.14373) 2044 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:24:19.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:24:18 smithi157 bash[24585]: audit 2024-09-16T06:24:17.115381+0000 mgr.a (mgr.14373) 2045 : audit [DBG] from='client.56445 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:24:19.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:24:18 smithi157 bash[24585]: cluster 2024-09-16T06:24:17.606469+0000 mgr.a (mgr.14373) 2046 : cluster [DBG] pgmap v1418: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:24:19.055 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:24:18 smithi157 bash[24585]: audit 2024-09-16T06:24:17.795592+0000 mgr.a (mgr.14373) 2047 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T06:24:19.055 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:24:18 smithi157 bash[24585]: cephadm 2024-09-16T06:24:17.808709+0000 mgr.a (mgr.14373) 2048 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T06:24:19.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:24:18 smithi086 bash[24289]: audit 2024-09-16T06:24:17.054051+0000 mgr.a (mgr.14373) 2044 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:24:19.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:24:18 smithi086 bash[24289]: audit 2024-09-16T06:24:17.115381+0000 mgr.a (mgr.14373) 2045 : audit [DBG] from='client.56445 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:24:19.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:24:18 smithi086 bash[24289]: cluster 2024-09-16T06:24:17.606469+0000 mgr.a (mgr.14373) 2046 : cluster [DBG] pgmap v1418: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:24:19.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:24:18 smithi086 bash[24289]: audit 2024-09-16T06:24:17.795592+0000 mgr.a (mgr.14373) 2047 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T06:24:19.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:24:18 smithi086 bash[24289]: cephadm 2024-09-16T06:24:17.808709+0000 mgr.a (mgr.14373) 2048 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T06:24:19.090 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:24:18 smithi047 bash[22744]: audit 2024-09-16T06:24:17.054051+0000 mgr.a (mgr.14373) 2044 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:24:19.090 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:24:18 smithi047 bash[22744]: audit 2024-09-16T06:24:17.115381+0000 mgr.a (mgr.14373) 2045 : audit [DBG] from='client.56445 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:24:19.090 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:24:18 smithi047 bash[22744]: cluster 2024-09-16T06:24:17.606469+0000 mgr.a (mgr.14373) 2046 : cluster [DBG] pgmap v1418: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:24:19.090 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:24:18 smithi047 bash[22744]: audit 2024-09-16T06:24:17.795592+0000 mgr.a (mgr.14373) 2047 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T06:24:19.090 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:24:18 smithi047 bash[22744]: cephadm 2024-09-16T06:24:17.808709+0000 mgr.a (mgr.14373) 2048 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T06:24:21.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:24:20 smithi157 bash[24585]: cluster 2024-09-16T06:24:19.607283+0000 mgr.a (mgr.14373) 2049 : cluster [DBG] pgmap v1419: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:24:21.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:24:20 smithi086 bash[24289]: cluster 2024-09-16T06:24:19.607283+0000 mgr.a (mgr.14373) 2049 : cluster [DBG] pgmap v1419: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:24:21.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:24:20 smithi047 bash[22744]: cluster 2024-09-16T06:24:19.607283+0000 mgr.a (mgr.14373) 2049 : cluster [DBG] pgmap v1419: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:24:23.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:24:22 smithi157 bash[24585]: cluster 2024-09-16T06:24:21.609397+0000 mgr.a (mgr.14373) 2050 : cluster [DBG] pgmap v1420: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:24:23.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:24:22 smithi086 bash[24289]: cluster 2024-09-16T06:24:21.609397+0000 mgr.a (mgr.14373) 2050 : cluster [DBG] pgmap v1420: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:24:23.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:24:22 smithi047 bash[22744]: cluster 2024-09-16T06:24:21.609397+0000 mgr.a (mgr.14373) 2050 : cluster [DBG] pgmap v1420: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:24:23.209 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:24:23.209 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:24:23.209 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:24:23.966 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:24:23.967 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:24:23.967 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:24:23.967 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:24:23.967 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:24:25.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:24:24 smithi157 bash[24585]: audit 2024-09-16T06:24:23.547074+0000 mgr.a (mgr.14373) 2051 : audit [DBG] from='client.56631 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:24:25.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:24:24 smithi157 bash[24585]: cluster 2024-09-16T06:24:23.610010+0000 mgr.a (mgr.14373) 2052 : cluster [DBG] pgmap v1421: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:24:25.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:24:24 smithi086 bash[24289]: audit 2024-09-16T06:24:23.547074+0000 mgr.a (mgr.14373) 2051 : audit [DBG] from='client.56631 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:24:25.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:24:24 smithi086 bash[24289]: cluster 2024-09-16T06:24:23.610010+0000 mgr.a (mgr.14373) 2052 : cluster [DBG] pgmap v1421: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:24:25.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:24:24 smithi047 bash[22744]: audit 2024-09-16T06:24:23.547074+0000 mgr.a (mgr.14373) 2051 : audit [DBG] from='client.56631 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:24:25.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:24:24 smithi047 bash[22744]: cluster 2024-09-16T06:24:23.610010+0000 mgr.a (mgr.14373) 2052 : cluster [DBG] pgmap v1421: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:24:27.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:24:26 smithi157 bash[24585]: cluster 2024-09-16T06:24:25.610953+0000 mgr.a (mgr.14373) 2053 : cluster [DBG] pgmap v1422: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:24:27.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:24:26 smithi086 bash[24289]: cluster 2024-09-16T06:24:25.610953+0000 mgr.a (mgr.14373) 2053 : cluster [DBG] pgmap v1422: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:24:27.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:24:26 smithi047 bash[22744]: cluster 2024-09-16T06:24:25.610953+0000 mgr.a (mgr.14373) 2053 : cluster [DBG] pgmap v1422: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:24:28.968 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:24:28.968 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:24:28.969 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:24:29.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:24:28 smithi157 bash[24585]: cluster 2024-09-16T06:24:27.613166+0000 mgr.a (mgr.14373) 2054 : cluster [DBG] pgmap v1423: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:24:29.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:24:28 smithi086 bash[24289]: cluster 2024-09-16T06:24:27.613166+0000 mgr.a (mgr.14373) 2054 : cluster [DBG] pgmap v1423: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:24:29.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:24:28 smithi047 bash[22744]: cluster 2024-09-16T06:24:27.613166+0000 mgr.a (mgr.14373) 2054 : cluster [DBG] pgmap v1423: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:24:29.758 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:24:29.758 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:24:29.758 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:24:29.758 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:24:29.758 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:24:31.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:24:30 smithi157 bash[24585]: audit 2024-09-16T06:24:29.307602+0000 mgr.a (mgr.14373) 2055 : audit [DBG] from='client.56709 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:24:31.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:24:30 smithi157 bash[24585]: cluster 2024-09-16T06:24:29.613806+0000 mgr.a (mgr.14373) 2056 : cluster [DBG] pgmap v1424: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:24:31.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:24:30 smithi086 bash[24289]: audit 2024-09-16T06:24:29.307602+0000 mgr.a (mgr.14373) 2055 : audit [DBG] from='client.56709 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:24:31.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:24:30 smithi086 bash[24289]: cluster 2024-09-16T06:24:29.613806+0000 mgr.a (mgr.14373) 2056 : cluster [DBG] pgmap v1424: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:24:31.090 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:24:30 smithi047 bash[22744]: audit 2024-09-16T06:24:29.307602+0000 mgr.a (mgr.14373) 2055 : audit [DBG] from='client.56709 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:24:31.090 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:24:30 smithi047 bash[22744]: cluster 2024-09-16T06:24:29.613806+0000 mgr.a (mgr.14373) 2056 : cluster [DBG] pgmap v1424: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:24:33.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:24:32 smithi157 bash[24585]: cluster 2024-09-16T06:24:31.616090+0000 mgr.a (mgr.14373) 2057 : cluster [DBG] pgmap v1425: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:24:33.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:24:32 smithi086 bash[24289]: cluster 2024-09-16T06:24:31.616090+0000 mgr.a (mgr.14373) 2057 : cluster [DBG] pgmap v1425: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:24:33.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:24:32 smithi047 bash[22744]: cluster 2024-09-16T06:24:31.616090+0000 mgr.a (mgr.14373) 2057 : cluster [DBG] pgmap v1425: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:24:34.759 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:24:34.760 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:24:34.760 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:24:35.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:24:34 smithi157 bash[24585]: cluster 2024-09-16T06:24:33.616871+0000 mgr.a (mgr.14373) 2058 : cluster [DBG] pgmap v1426: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:24:35.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:24:34 smithi086 bash[24289]: cluster 2024-09-16T06:24:33.616871+0000 mgr.a (mgr.14373) 2058 : cluster [DBG] pgmap v1426: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:24:35.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:24:34 smithi047 bash[22744]: cluster 2024-09-16T06:24:33.616871+0000 mgr.a (mgr.14373) 2058 : cluster [DBG] pgmap v1426: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:24:35.528 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:24:35.529 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:24:35.529 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:24:35.529 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:24:35.529 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:24:37.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:24:36 smithi157 bash[24585]: audit 2024-09-16T06:24:35.094890+0000 mgr.a (mgr.14373) 2059 : audit [DBG] from='client.56784 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:24:37.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:24:36 smithi157 bash[24585]: cluster 2024-09-16T06:24:35.617791+0000 mgr.a (mgr.14373) 2060 : cluster [DBG] pgmap v1427: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:24:37.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:24:36 smithi086 bash[24289]: audit 2024-09-16T06:24:35.094890+0000 mgr.a (mgr.14373) 2059 : audit [DBG] from='client.56784 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:24:37.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:24:36 smithi086 bash[24289]: cluster 2024-09-16T06:24:35.617791+0000 mgr.a (mgr.14373) 2060 : cluster [DBG] pgmap v1427: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:24:37.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:24:36 smithi047 bash[22744]: audit 2024-09-16T06:24:35.094890+0000 mgr.a (mgr.14373) 2059 : audit [DBG] from='client.56784 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:24:37.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:24:36 smithi047 bash[22744]: cluster 2024-09-16T06:24:35.617791+0000 mgr.a (mgr.14373) 2060 : cluster [DBG] pgmap v1427: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:24:39.055 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:24:38 smithi157 bash[24585]: cluster 2024-09-16T06:24:37.620065+0000 mgr.a (mgr.14373) 2061 : cluster [DBG] pgmap v1428: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:24:39.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:24:38 smithi086 bash[24289]: cluster 2024-09-16T06:24:37.620065+0000 mgr.a (mgr.14373) 2061 : cluster [DBG] pgmap v1428: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:24:39.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:24:38 smithi047 bash[22744]: cluster 2024-09-16T06:24:37.620065+0000 mgr.a (mgr.14373) 2061 : cluster [DBG] pgmap v1428: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:24:40.530 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:24:40.531 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:24:40.531 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:24:41.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:24:40 smithi157 bash[24585]: cluster 2024-09-16T06:24:39.620813+0000 mgr.a (mgr.14373) 2062 : cluster [DBG] pgmap v1429: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:24:41.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:24:40 smithi086 bash[24289]: cluster 2024-09-16T06:24:39.620813+0000 mgr.a (mgr.14373) 2062 : cluster [DBG] pgmap v1429: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:24:41.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:24:40 smithi047 bash[22744]: cluster 2024-09-16T06:24:39.620813+0000 mgr.a (mgr.14373) 2062 : cluster [DBG] pgmap v1429: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:24:41.278 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:24:41.278 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:24:41.278 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:24:41.278 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:24:41.278 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:24:42.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:24:41 smithi157 bash[24585]: audit 2024-09-16T06:24:40.862900+0000 mgr.a (mgr.14373) 2063 : audit [DBG] from='client.56859 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:24:42.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:24:41 smithi086 bash[24289]: audit 2024-09-16T06:24:40.862900+0000 mgr.a (mgr.14373) 2063 : audit [DBG] from='client.56859 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:24:42.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:24:41 smithi047 bash[22744]: audit 2024-09-16T06:24:40.862900+0000 mgr.a (mgr.14373) 2063 : audit [DBG] from='client.56859 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:24:43.055 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:24:42 smithi157 bash[24585]: cluster 2024-09-16T06:24:41.623079+0000 mgr.a (mgr.14373) 2064 : cluster [DBG] pgmap v1430: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:24:43.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:24:42 smithi086 bash[24289]: cluster 2024-09-16T06:24:41.623079+0000 mgr.a (mgr.14373) 2064 : cluster [DBG] pgmap v1430: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:24:43.091 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:24:42 smithi047 bash[22744]: cluster 2024-09-16T06:24:41.623079+0000 mgr.a (mgr.14373) 2064 : cluster [DBG] pgmap v1430: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:24:45.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:24:44 smithi157 bash[24585]: cluster 2024-09-16T06:24:43.623858+0000 mgr.a (mgr.14373) 2065 : cluster [DBG] pgmap v1431: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:24:45.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:24:44 smithi086 bash[24289]: cluster 2024-09-16T06:24:43.623858+0000 mgr.a (mgr.14373) 2065 : cluster [DBG] pgmap v1431: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:24:45.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:24:44 smithi047 bash[22744]: cluster 2024-09-16T06:24:43.623858+0000 mgr.a (mgr.14373) 2065 : cluster [DBG] pgmap v1431: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:24:46.281 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:24:46.281 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:24:46.281 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:24:47.021 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:24:47.021 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:24:47.021 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:24:47.021 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:24:47.021 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:24:47.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:24:46 smithi157 bash[24585]: cluster 2024-09-16T06:24:45.624614+0000 mgr.a (mgr.14373) 2066 : cluster [DBG] pgmap v1432: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:24:47.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:24:46 smithi086 bash[24289]: cluster 2024-09-16T06:24:45.624614+0000 mgr.a (mgr.14373) 2066 : cluster [DBG] pgmap v1432: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:24:47.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:24:46 smithi047 bash[22744]: cluster 2024-09-16T06:24:45.624614+0000 mgr.a (mgr.14373) 2066 : cluster [DBG] pgmap v1432: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:24:48.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:24:47 smithi157 bash[24585]: audit 2024-09-16T06:24:46.610441+0000 mgr.a (mgr.14373) 2067 : audit [DBG] from='client.56934 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:24:48.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:24:47 smithi086 bash[24289]: audit 2024-09-16T06:24:46.610441+0000 mgr.a (mgr.14373) 2067 : audit [DBG] from='client.56934 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:24:48.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:24:47 smithi047 bash[22744]: audit 2024-09-16T06:24:46.610441+0000 mgr.a (mgr.14373) 2067 : audit [DBG] from='client.56934 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:24:49.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:24:48 smithi157 bash[24585]: cluster 2024-09-16T06:24:47.627423+0000 mgr.a (mgr.14373) 2068 : cluster [DBG] pgmap v1433: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:24:49.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:24:48 smithi086 bash[24289]: cluster 2024-09-16T06:24:47.627423+0000 mgr.a (mgr.14373) 2068 : cluster [DBG] pgmap v1433: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:24:49.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:24:48 smithi047 bash[22744]: cluster 2024-09-16T06:24:47.627423+0000 mgr.a (mgr.14373) 2068 : cluster [DBG] pgmap v1433: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:24:51.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:24:50 smithi157 bash[24585]: cluster 2024-09-16T06:24:49.628205+0000 mgr.a (mgr.14373) 2069 : cluster [DBG] pgmap v1434: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:24:51.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:24:50 smithi086 bash[24289]: cluster 2024-09-16T06:24:49.628205+0000 mgr.a (mgr.14373) 2069 : cluster [DBG] pgmap v1434: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:24:51.090 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:24:50 smithi047 bash[22744]: cluster 2024-09-16T06:24:49.628205+0000 mgr.a (mgr.14373) 2069 : cluster [DBG] pgmap v1434: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:24:52.022 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:24:52.023 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:24:52.023 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:24:52.800 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:24:52.800 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:24:52.800 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:24:52.800 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:24:52.800 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:24:53.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:24:52 smithi157 bash[24585]: cluster 2024-09-16T06:24:51.630141+0000 mgr.a (mgr.14373) 2070 : cluster [DBG] pgmap v1435: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:24:53.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:24:52 smithi086 bash[24289]: cluster 2024-09-16T06:24:51.630141+0000 mgr.a (mgr.14373) 2070 : cluster [DBG] pgmap v1435: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:24:53.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:24:52 smithi047 bash[22744]: cluster 2024-09-16T06:24:51.630141+0000 mgr.a (mgr.14373) 2070 : cluster [DBG] pgmap v1435: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:24:54.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:24:53 smithi157 bash[24585]: audit 2024-09-16T06:24:52.363431+0000 mgr.a (mgr.14373) 2071 : audit [DBG] from='client.57012 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:24:54.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:24:53 smithi086 bash[24289]: audit 2024-09-16T06:24:52.363431+0000 mgr.a (mgr.14373) 2071 : audit [DBG] from='client.57012 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:24:54.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:24:53 smithi047 bash[22744]: audit 2024-09-16T06:24:52.363431+0000 mgr.a (mgr.14373) 2071 : audit [DBG] from='client.57012 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:24:55.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:24:54 smithi157 bash[24585]: cluster 2024-09-16T06:24:53.631120+0000 mgr.a (mgr.14373) 2072 : cluster [DBG] pgmap v1436: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:24:55.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:24:54 smithi086 bash[24289]: cluster 2024-09-16T06:24:53.631120+0000 mgr.a (mgr.14373) 2072 : cluster [DBG] pgmap v1436: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:24:55.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:24:54 smithi047 bash[22744]: cluster 2024-09-16T06:24:53.631120+0000 mgr.a (mgr.14373) 2072 : cluster [DBG] pgmap v1436: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:24:57.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:24:56 smithi157 bash[24585]: cluster 2024-09-16T06:24:55.631892+0000 mgr.a (mgr.14373) 2073 : cluster [DBG] pgmap v1437: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T06:24:57.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:24:56 smithi086 bash[24289]: cluster 2024-09-16T06:24:55.631892+0000 mgr.a (mgr.14373) 2073 : cluster [DBG] pgmap v1437: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T06:24:57.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:24:56 smithi047 bash[22744]: cluster 2024-09-16T06:24:55.631892+0000 mgr.a (mgr.14373) 2073 : cluster [DBG] pgmap v1437: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T06:24:57.801 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:24:57.802 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:24:57.802 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:24:58.551 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:24:58.551 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:24:58.551 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:24:58.551 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:24:58.551 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:24:59.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:24:58 smithi157 bash[24585]: cluster 2024-09-16T06:24:57.634087+0000 mgr.a (mgr.14373) 2074 : cluster [DBG] pgmap v1438: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:24:59.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:24:58 smithi086 bash[24289]: cluster 2024-09-16T06:24:57.634087+0000 mgr.a (mgr.14373) 2074 : cluster [DBG] pgmap v1438: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:24:59.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:24:58 smithi047 bash[22744]: cluster 2024-09-16T06:24:57.634087+0000 mgr.a (mgr.14373) 2074 : cluster [DBG] pgmap v1438: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:25:00.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:24:59 smithi086 bash[24289]: audit 2024-09-16T06:24:58.134714+0000 mgr.a (mgr.14373) 2075 : audit [DBG] from='client.57090 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:25:00.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:24:59 smithi047 bash[22744]: audit 2024-09-16T06:24:58.134714+0000 mgr.a (mgr.14373) 2075 : audit [DBG] from='client.57090 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:25:00.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:24:59 smithi157 bash[24585]: audit 2024-09-16T06:24:58.134714+0000 mgr.a (mgr.14373) 2075 : audit [DBG] from='client.57090 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:25:01.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:25:00 smithi086 bash[24289]: cluster 2024-09-16T06:24:59.634972+0000 mgr.a (mgr.14373) 2076 : cluster [DBG] pgmap v1439: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:25:01.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:25:00 smithi047 bash[22744]: cluster 2024-09-16T06:24:59.634972+0000 mgr.a (mgr.14373) 2076 : cluster [DBG] pgmap v1439: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:25:01.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:25:00 smithi157 bash[24585]: cluster 2024-09-16T06:24:59.634972+0000 mgr.a (mgr.14373) 2076 : cluster [DBG] pgmap v1439: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:25:03.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:25:02 smithi086 bash[24289]: cluster 2024-09-16T06:25:01.637167+0000 mgr.a (mgr.14373) 2077 : cluster [DBG] pgmap v1440: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:25:03.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:25:02 smithi047 bash[22744]: cluster 2024-09-16T06:25:01.637167+0000 mgr.a (mgr.14373) 2077 : cluster [DBG] pgmap v1440: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:25:03.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:25:02 smithi157 bash[24585]: cluster 2024-09-16T06:25:01.637167+0000 mgr.a (mgr.14373) 2077 : cluster [DBG] pgmap v1440: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:25:03.552 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:25:03.553 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:25:03.553 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:25:04.328 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:25:04.328 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:25:04.328 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:25:04.328 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:25:04.328 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:25:05.090 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:25:04 smithi047 bash[22744]: cluster 2024-09-16T06:25:03.637638+0000 mgr.a (mgr.14373) 2078 : cluster [DBG] pgmap v1441: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:25:05.090 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:25:04 smithi047 bash[22744]: audit 2024-09-16T06:25:03.889426+0000 mgr.a (mgr.14373) 2079 : audit [DBG] from='client.57168 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:25:05.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:25:04 smithi157 bash[24585]: cluster 2024-09-16T06:25:03.637638+0000 mgr.a (mgr.14373) 2078 : cluster [DBG] pgmap v1441: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:25:05.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:25:04 smithi157 bash[24585]: audit 2024-09-16T06:25:03.889426+0000 mgr.a (mgr.14373) 2079 : audit [DBG] from='client.57168 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:25:05.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:25:04 smithi086 bash[24289]: cluster 2024-09-16T06:25:03.637638+0000 mgr.a (mgr.14373) 2078 : cluster [DBG] pgmap v1441: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:25:05.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:25:04 smithi086 bash[24289]: audit 2024-09-16T06:25:03.889426+0000 mgr.a (mgr.14373) 2079 : audit [DBG] from='client.57168 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:25:07.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:25:06 smithi047 bash[22744]: cluster 2024-09-16T06:25:05.638532+0000 mgr.a (mgr.14373) 2080 : cluster [DBG] pgmap v1442: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:25:07.305 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:25:06 smithi157 bash[24585]: cluster 2024-09-16T06:25:05.638532+0000 mgr.a (mgr.14373) 2080 : cluster [DBG] pgmap v1442: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:25:07.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:25:06 smithi086 bash[24289]: cluster 2024-09-16T06:25:05.638532+0000 mgr.a (mgr.14373) 2080 : cluster [DBG] pgmap v1442: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:25:09.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:25:08 smithi047 bash[22744]: cluster 2024-09-16T06:25:07.640778+0000 mgr.a (mgr.14373) 2081 : cluster [DBG] pgmap v1443: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:25:09.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:25:08 smithi157 bash[24585]: cluster 2024-09-16T06:25:07.640778+0000 mgr.a (mgr.14373) 2081 : cluster [DBG] pgmap v1443: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:25:09.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:25:08 smithi086 bash[24289]: cluster 2024-09-16T06:25:07.640778+0000 mgr.a (mgr.14373) 2081 : cluster [DBG] pgmap v1443: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:25:09.329 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:25:09.330 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:25:09.330 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:25:10.095 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:25:10.095 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:25:10.095 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:25:10.095 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:25:10.095 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:25:11.090 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:25:10 smithi047 bash[22744]: cluster 2024-09-16T06:25:09.641500+0000 mgr.a (mgr.14373) 2082 : cluster [DBG] pgmap v1444: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:25:11.090 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:25:10 smithi047 bash[22744]: audit 2024-09-16T06:25:09.668234+0000 mgr.a (mgr.14373) 2083 : audit [DBG] from='client.57246 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:25:11.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:25:10 smithi157 bash[24585]: cluster 2024-09-16T06:25:09.641500+0000 mgr.a (mgr.14373) 2082 : cluster [DBG] pgmap v1444: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:25:11.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:25:10 smithi157 bash[24585]: audit 2024-09-16T06:25:09.668234+0000 mgr.a (mgr.14373) 2083 : audit [DBG] from='client.57246 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:25:11.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:25:10 smithi086 bash[24289]: cluster 2024-09-16T06:25:09.641500+0000 mgr.a (mgr.14373) 2082 : cluster [DBG] pgmap v1444: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:25:11.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:25:10 smithi086 bash[24289]: audit 2024-09-16T06:25:09.668234+0000 mgr.a (mgr.14373) 2083 : audit [DBG] from='client.57246 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:25:13.096 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:25:12 smithi047 bash[22744]: cluster 2024-09-16T06:25:11.643736+0000 mgr.a (mgr.14373) 2084 : cluster [DBG] pgmap v1445: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:25:13.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:25:12 smithi157 bash[24585]: cluster 2024-09-16T06:25:11.643736+0000 mgr.a (mgr.14373) 2084 : cluster [DBG] pgmap v1445: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:25:13.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:25:12 smithi086 bash[24289]: cluster 2024-09-16T06:25:11.643736+0000 mgr.a (mgr.14373) 2084 : cluster [DBG] pgmap v1445: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:25:15.096 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:25:15.097 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:25:15.097 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:25:15.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:25:14 smithi157 bash[24585]: cluster 2024-09-16T06:25:13.644507+0000 mgr.a (mgr.14373) 2085 : cluster [DBG] pgmap v1446: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:25:15.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:25:14 smithi086 bash[24289]: cluster 2024-09-16T06:25:13.644507+0000 mgr.a (mgr.14373) 2085 : cluster [DBG] pgmap v1446: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:25:15.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:25:14 smithi047 bash[22744]: cluster 2024-09-16T06:25:13.644507+0000 mgr.a (mgr.14373) 2085 : cluster [DBG] pgmap v1446: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:25:15.837 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:25:15.837 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:25:15.838 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:25:15.838 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:25:15.838 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:25:17.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:25:16 smithi157 bash[24585]: audit 2024-09-16T06:25:15.425897+0000 mgr.a (mgr.14373) 2086 : audit [DBG] from='client.57321 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:25:17.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:25:16 smithi157 bash[24585]: cluster 2024-09-16T06:25:15.649905+0000 mgr.a (mgr.14373) 2087 : cluster [DBG] pgmap v1447: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:25:17.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:25:16 smithi086 bash[24289]: audit 2024-09-16T06:25:15.425897+0000 mgr.a (mgr.14373) 2086 : audit [DBG] from='client.57321 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:25:17.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:25:16 smithi086 bash[24289]: cluster 2024-09-16T06:25:15.649905+0000 mgr.a (mgr.14373) 2087 : cluster [DBG] pgmap v1447: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:25:17.340 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:25:16 smithi047 bash[22744]: audit 2024-09-16T06:25:15.425897+0000 mgr.a (mgr.14373) 2086 : audit [DBG] from='client.57321 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:25:17.340 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:25:16 smithi047 bash[22744]: cluster 2024-09-16T06:25:15.649905+0000 mgr.a (mgr.14373) 2087 : cluster [DBG] pgmap v1447: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:25:19.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:25:18 smithi157 bash[24585]: cluster 2024-09-16T06:25:17.652237+0000 mgr.a (mgr.14373) 2088 : cluster [DBG] pgmap v1448: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:25:19.305 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:25:18 smithi157 bash[24585]: audit 2024-09-16T06:25:17.867078+0000 mon.b (mon.2) 234 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T06:25:19.305 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:25:18 smithi157 bash[24585]: audit 2024-09-16T06:25:18.480347+0000 mon.a (mon.0) 691 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:25:19.305 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:25:18 smithi157 bash[24585]: audit 2024-09-16T06:25:18.485911+0000 mon.a (mon.0) 692 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:25:19.305 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:25:18 smithi157 bash[24585]: audit 2024-09-16T06:25:18.489107+0000 mon.a (mon.0) 693 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:25:19.305 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:25:18 smithi157 bash[24585]: audit 2024-09-16T06:25:18.494898+0000 mon.a (mon.0) 694 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:25:19.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:25:18 smithi086 bash[24289]: cluster 2024-09-16T06:25:17.652237+0000 mgr.a (mgr.14373) 2088 : cluster [DBG] pgmap v1448: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:25:19.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:25:18 smithi086 bash[24289]: audit 2024-09-16T06:25:17.867078+0000 mon.b (mon.2) 234 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T06:25:19.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:25:18 smithi086 bash[24289]: audit 2024-09-16T06:25:18.480347+0000 mon.a (mon.0) 691 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:25:19.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:25:18 smithi086 bash[24289]: audit 2024-09-16T06:25:18.485911+0000 mon.a (mon.0) 692 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:25:19.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:25:18 smithi086 bash[24289]: audit 2024-09-16T06:25:18.489107+0000 mon.a (mon.0) 693 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:25:19.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:25:18 smithi086 bash[24289]: audit 2024-09-16T06:25:18.494898+0000 mon.a (mon.0) 694 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:25:19.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:25:18 smithi047 bash[22744]: cluster 2024-09-16T06:25:17.652237+0000 mgr.a (mgr.14373) 2088 : cluster [DBG] pgmap v1448: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:25:19.340 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:25:18 smithi047 bash[22744]: audit 2024-09-16T06:25:17.867078+0000 mon.b (mon.2) 234 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T06:25:19.340 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:25:18 smithi047 bash[22744]: audit 2024-09-16T06:25:18.480347+0000 mon.a (mon.0) 691 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:25:19.340 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:25:18 smithi047 bash[22744]: audit 2024-09-16T06:25:18.485911+0000 mon.a (mon.0) 692 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:25:19.340 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:25:18 smithi047 bash[22744]: audit 2024-09-16T06:25:18.489107+0000 mon.a (mon.0) 693 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:25:19.340 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:25:18 smithi047 bash[22744]: audit 2024-09-16T06:25:18.494898+0000 mon.a (mon.0) 694 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:25:20.305 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:25:19 smithi157 bash[24585]: audit 2024-09-16T06:25:19.294688+0000 mon.b (mon.2) 235 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T06:25:20.305 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:25:19 smithi157 bash[24585]: audit 2024-09-16T06:25:19.296711+0000 mon.b (mon.2) 236 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T06:25:20.305 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:25:19 smithi157 bash[24585]: audit 2024-09-16T06:25:19.309772+0000 mon.a (mon.0) 695 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:25:20.305 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:25:19 smithi157 bash[24585]: audit 2024-09-16T06:25:19.313580+0000 mon.b (mon.2) 237 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:25:20.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:25:19 smithi086 bash[24289]: audit 2024-09-16T06:25:19.294688+0000 mon.b (mon.2) 235 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T06:25:20.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:25:19 smithi086 bash[24289]: audit 2024-09-16T06:25:19.296711+0000 mon.b (mon.2) 236 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T06:25:20.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:25:19 smithi086 bash[24289]: audit 2024-09-16T06:25:19.309772+0000 mon.a (mon.0) 695 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:25:20.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:25:19 smithi086 bash[24289]: audit 2024-09-16T06:25:19.313580+0000 mon.b (mon.2) 237 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:25:20.340 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 06:25:20 smithi047 bash[22994]: debug 2024-09-16T06:25:20.064+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T06:25:20.340 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 06:25:20 smithi047 bash[22994]: debug 2024-09-16T06:25:20.064+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T06:25:20.340 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:25:19 smithi047 bash[22744]: audit 2024-09-16T06:25:19.294688+0000 mon.b (mon.2) 235 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T06:25:20.340 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:25:19 smithi047 bash[22744]: audit 2024-09-16T06:25:19.296711+0000 mon.b (mon.2) 236 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T06:25:20.340 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:25:19 smithi047 bash[22744]: audit 2024-09-16T06:25:19.309772+0000 mon.a (mon.0) 695 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:25:20.340 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:25:19 smithi047 bash[22744]: audit 2024-09-16T06:25:19.313580+0000 mon.b (mon.2) 237 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:25:20.839 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:25:20.840 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:25:20.840 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:25:21.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:25:20 smithi157 bash[24585]: audit 2024-09-16T06:25:19.317400+0000 mgr.a (mgr.14373) 2089 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:25:21.305 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:25:20 smithi157 bash[24585]: cluster 2024-09-16T06:25:19.656279+0000 mgr.a (mgr.14373) 2090 : cluster [DBG] pgmap v1449: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:25:21.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:25:20 smithi086 bash[24289]: audit 2024-09-16T06:25:19.317400+0000 mgr.a (mgr.14373) 2089 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:25:21.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:25:20 smithi086 bash[24289]: cluster 2024-09-16T06:25:19.656279+0000 mgr.a (mgr.14373) 2090 : cluster [DBG] pgmap v1449: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:25:21.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:25:20 smithi047 bash[22744]: audit 2024-09-16T06:25:19.317400+0000 mgr.a (mgr.14373) 2089 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:25:21.340 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:25:20 smithi047 bash[22744]: cluster 2024-09-16T06:25:19.656279+0000 mgr.a (mgr.14373) 2090 : cluster [DBG] pgmap v1449: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:25:21.607 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:25:21.607 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:25:21.607 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:25:21.607 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:25:21.608 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:25:22.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:25:21 smithi157 bash[24585]: audit 2024-09-16T06:25:20.066988+0000 mgr.a (mgr.14373) 2091 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T06:25:22.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:25:21 smithi157 bash[24585]: cephadm 2024-09-16T06:25:20.068909+0000 mgr.a (mgr.14373) 2092 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T06:25:22.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:25:21 smithi086 bash[24289]: audit 2024-09-16T06:25:20.066988+0000 mgr.a (mgr.14373) 2091 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T06:25:22.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:25:21 smithi086 bash[24289]: cephadm 2024-09-16T06:25:20.068909+0000 mgr.a (mgr.14373) 2092 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T06:25:22.340 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:25:21 smithi047 bash[22744]: audit 2024-09-16T06:25:20.066988+0000 mgr.a (mgr.14373) 2091 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T06:25:22.340 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:25:21 smithi047 bash[22744]: cephadm 2024-09-16T06:25:20.068909+0000 mgr.a (mgr.14373) 2092 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T06:25:23.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:25:22 smithi157 bash[24585]: audit 2024-09-16T06:25:21.177507+0000 mgr.a (mgr.14373) 2093 : audit [DBG] from='client.57504 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:25:23.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:25:22 smithi157 bash[24585]: cluster 2024-09-16T06:25:21.657610+0000 mgr.a (mgr.14373) 2094 : cluster [DBG] pgmap v1450: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:25:23.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:25:22 smithi086 bash[24289]: audit 2024-09-16T06:25:21.177507+0000 mgr.a (mgr.14373) 2093 : audit [DBG] from='client.57504 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:25:23.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:25:22 smithi086 bash[24289]: cluster 2024-09-16T06:25:21.657610+0000 mgr.a (mgr.14373) 2094 : cluster [DBG] pgmap v1450: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:25:23.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:25:22 smithi047 bash[22744]: audit 2024-09-16T06:25:21.177507+0000 mgr.a (mgr.14373) 2093 : audit [DBG] from='client.57504 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:25:23.340 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:25:22 smithi047 bash[22744]: cluster 2024-09-16T06:25:21.657610+0000 mgr.a (mgr.14373) 2094 : cluster [DBG] pgmap v1450: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:25:25.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:25:24 smithi157 bash[24585]: cluster 2024-09-16T06:25:23.658360+0000 mgr.a (mgr.14373) 2095 : cluster [DBG] pgmap v1451: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T06:25:25.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:25:24 smithi086 bash[24289]: cluster 2024-09-16T06:25:23.658360+0000 mgr.a (mgr.14373) 2095 : cluster [DBG] pgmap v1451: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T06:25:25.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:25:24 smithi047 bash[22744]: cluster 2024-09-16T06:25:23.658360+0000 mgr.a (mgr.14373) 2095 : cluster [DBG] pgmap v1451: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T06:25:26.608 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:25:26.609 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:25:26.609 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:25:27.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:25:26 smithi157 bash[24585]: cluster 2024-09-16T06:25:25.659229+0000 mgr.a (mgr.14373) 2096 : cluster [DBG] pgmap v1452: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T06:25:27.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:25:26 smithi086 bash[24289]: cluster 2024-09-16T06:25:25.659229+0000 mgr.a (mgr.14373) 2096 : cluster [DBG] pgmap v1452: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T06:25:27.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:25:26 smithi047 bash[22744]: cluster 2024-09-16T06:25:25.659229+0000 mgr.a (mgr.14373) 2096 : cluster [DBG] pgmap v1452: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T06:25:27.349 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:25:27.349 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:25:27.349 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:25:27.349 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:25:27.350 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:25:29.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:25:28 smithi157 bash[24585]: audit 2024-09-16T06:25:26.944318+0000 mgr.a (mgr.14373) 2097 : audit [DBG] from='client.57582 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:25:29.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:25:28 smithi157 bash[24585]: cluster 2024-09-16T06:25:27.662156+0000 mgr.a (mgr.14373) 2098 : cluster [DBG] pgmap v1453: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:25:29.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:25:28 smithi086 bash[24289]: audit 2024-09-16T06:25:26.944318+0000 mgr.a (mgr.14373) 2097 : audit [DBG] from='client.57582 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:25:29.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:25:28 smithi086 bash[24289]: cluster 2024-09-16T06:25:27.662156+0000 mgr.a (mgr.14373) 2098 : cluster [DBG] pgmap v1453: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:25:29.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:25:28 smithi047 bash[22744]: audit 2024-09-16T06:25:26.944318+0000 mgr.a (mgr.14373) 2097 : audit [DBG] from='client.57582 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:25:29.340 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:25:28 smithi047 bash[22744]: cluster 2024-09-16T06:25:27.662156+0000 mgr.a (mgr.14373) 2098 : cluster [DBG] pgmap v1453: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:25:31.308 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:25:30 smithi157 bash[24585]: cluster 2024-09-16T06:25:29.663122+0000 mgr.a (mgr.14373) 2099 : cluster [DBG] pgmap v1454: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T06:25:31.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:25:30 smithi086 bash[24289]: cluster 2024-09-16T06:25:29.663122+0000 mgr.a (mgr.14373) 2099 : cluster [DBG] pgmap v1454: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T06:25:31.340 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:25:30 smithi047 bash[22744]: cluster 2024-09-16T06:25:29.663122+0000 mgr.a (mgr.14373) 2099 : cluster [DBG] pgmap v1454: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T06:25:32.351 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:25:32.352 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:25:32.352 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:25:33.101 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:25:33.101 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:25:33.101 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:25:33.102 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:25:33.102 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:25:33.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:25:32 smithi157 bash[24585]: cluster 2024-09-16T06:25:31.665235+0000 mgr.a (mgr.14373) 2100 : cluster [DBG] pgmap v1455: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:25:33.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:25:32 smithi086 bash[24289]: cluster 2024-09-16T06:25:31.665235+0000 mgr.a (mgr.14373) 2100 : cluster [DBG] pgmap v1455: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:25:33.340 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:25:32 smithi047 bash[22744]: cluster 2024-09-16T06:25:31.665235+0000 mgr.a (mgr.14373) 2100 : cluster [DBG] pgmap v1455: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:25:34.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:25:33 smithi157 bash[24585]: audit 2024-09-16T06:25:32.675936+0000 mgr.a (mgr.14373) 2101 : audit [DBG] from='client.57660 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:25:34.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:25:33 smithi086 bash[24289]: audit 2024-09-16T06:25:32.675936+0000 mgr.a (mgr.14373) 2101 : audit [DBG] from='client.57660 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:25:34.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:25:33 smithi047 bash[22744]: audit 2024-09-16T06:25:32.675936+0000 mgr.a (mgr.14373) 2101 : audit [DBG] from='client.57660 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:25:35.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:25:34 smithi157 bash[24585]: cluster 2024-09-16T06:25:33.666216+0000 mgr.a (mgr.14373) 2102 : cluster [DBG] pgmap v1456: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:25:35.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:25:34 smithi086 bash[24289]: cluster 2024-09-16T06:25:33.666216+0000 mgr.a (mgr.14373) 2102 : cluster [DBG] pgmap v1456: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:25:35.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:25:34 smithi047 bash[22744]: cluster 2024-09-16T06:25:33.666216+0000 mgr.a (mgr.14373) 2102 : cluster [DBG] pgmap v1456: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:25:37.305 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:25:36 smithi157 bash[24585]: cluster 2024-09-16T06:25:35.666990+0000 mgr.a (mgr.14373) 2103 : cluster [DBG] pgmap v1457: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:25:37.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:25:36 smithi086 bash[24289]: cluster 2024-09-16T06:25:35.666990+0000 mgr.a (mgr.14373) 2103 : cluster [DBG] pgmap v1457: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:25:37.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:25:36 smithi047 bash[22744]: cluster 2024-09-16T06:25:35.666990+0000 mgr.a (mgr.14373) 2103 : cluster [DBG] pgmap v1457: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:25:38.102 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:25:38.103 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:25:38.103 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:25:38.871 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:25:38.871 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:25:38.871 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:25:38.871 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:25:38.872 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:25:39.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:25:38 smithi157 bash[24585]: cluster 2024-09-16T06:25:37.669292+0000 mgr.a (mgr.14373) 2104 : cluster [DBG] pgmap v1458: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:25:39.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:25:38 smithi086 bash[24289]: cluster 2024-09-16T06:25:37.669292+0000 mgr.a (mgr.14373) 2104 : cluster [DBG] pgmap v1458: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:25:39.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:25:38 smithi047 bash[22744]: cluster 2024-09-16T06:25:37.669292+0000 mgr.a (mgr.14373) 2104 : cluster [DBG] pgmap v1458: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:25:40.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:25:39 smithi157 bash[24585]: audit 2024-09-16T06:25:38.439648+0000 mgr.a (mgr.14373) 2105 : audit [DBG] from='client.57735 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:25:40.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:25:39 smithi086 bash[24289]: audit 2024-09-16T06:25:38.439648+0000 mgr.a (mgr.14373) 2105 : audit [DBG] from='client.57735 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:25:40.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:25:39 smithi047 bash[22744]: audit 2024-09-16T06:25:38.439648+0000 mgr.a (mgr.14373) 2105 : audit [DBG] from='client.57735 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:25:41.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:25:40 smithi157 bash[24585]: cluster 2024-09-16T06:25:39.670241+0000 mgr.a (mgr.14373) 2106 : cluster [DBG] pgmap v1459: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:25:41.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:25:40 smithi086 bash[24289]: cluster 2024-09-16T06:25:39.670241+0000 mgr.a (mgr.14373) 2106 : cluster [DBG] pgmap v1459: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:25:41.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:25:40 smithi047 bash[22744]: cluster 2024-09-16T06:25:39.670241+0000 mgr.a (mgr.14373) 2106 : cluster [DBG] pgmap v1459: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:25:43.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:25:42 smithi157 bash[24585]: cluster 2024-09-16T06:25:41.672348+0000 mgr.a (mgr.14373) 2107 : cluster [DBG] pgmap v1460: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:25:43.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:25:42 smithi086 bash[24289]: cluster 2024-09-16T06:25:41.672348+0000 mgr.a (mgr.14373) 2107 : cluster [DBG] pgmap v1460: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:25:43.340 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:25:42 smithi047 bash[22744]: cluster 2024-09-16T06:25:41.672348+0000 mgr.a (mgr.14373) 2107 : cluster [DBG] pgmap v1460: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:25:43.873 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:25:43.873 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:25:43.874 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:25:44.613 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:25:44.613 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:25:44.613 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:25:44.613 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:25:44.613 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:25:45.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:25:44 smithi157 bash[24585]: cluster 2024-09-16T06:25:43.673108+0000 mgr.a (mgr.14373) 2108 : cluster [DBG] pgmap v1461: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:25:45.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:25:44 smithi086 bash[24289]: cluster 2024-09-16T06:25:43.673108+0000 mgr.a (mgr.14373) 2108 : cluster [DBG] pgmap v1461: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:25:45.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:25:44 smithi047 bash[22744]: cluster 2024-09-16T06:25:43.673108+0000 mgr.a (mgr.14373) 2108 : cluster [DBG] pgmap v1461: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:25:46.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:25:45 smithi157 bash[24585]: audit 2024-09-16T06:25:44.206955+0000 mgr.a (mgr.14373) 2109 : audit [DBG] from='client.57810 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:25:46.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:25:45 smithi086 bash[24289]: audit 2024-09-16T06:25:44.206955+0000 mgr.a (mgr.14373) 2109 : audit [DBG] from='client.57810 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:25:46.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:25:45 smithi047 bash[22744]: audit 2024-09-16T06:25:44.206955+0000 mgr.a (mgr.14373) 2109 : audit [DBG] from='client.57810 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:25:47.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:25:46 smithi157 bash[24585]: cluster 2024-09-16T06:25:45.673956+0000 mgr.a (mgr.14373) 2110 : cluster [DBG] pgmap v1462: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:25:47.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:25:46 smithi086 bash[24289]: cluster 2024-09-16T06:25:45.673956+0000 mgr.a (mgr.14373) 2110 : cluster [DBG] pgmap v1462: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:25:47.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:25:46 smithi047 bash[22744]: cluster 2024-09-16T06:25:45.673956+0000 mgr.a (mgr.14373) 2110 : cluster [DBG] pgmap v1462: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:25:49.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:25:48 smithi157 bash[24585]: cluster 2024-09-16T06:25:47.676204+0000 mgr.a (mgr.14373) 2111 : cluster [DBG] pgmap v1463: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:25:49.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:25:48 smithi086 bash[24289]: cluster 2024-09-16T06:25:47.676204+0000 mgr.a (mgr.14373) 2111 : cluster [DBG] pgmap v1463: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:25:49.340 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:25:48 smithi047 bash[22744]: cluster 2024-09-16T06:25:47.676204+0000 mgr.a (mgr.14373) 2111 : cluster [DBG] pgmap v1463: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:25:49.614 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:25:49.615 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:25:49.615 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:25:50.339 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:25:50.339 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:25:50.339 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:25:50.339 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:25:50.339 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:25:51.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:25:50 smithi157 bash[24585]: cluster 2024-09-16T06:25:49.676783+0000 mgr.a (mgr.14373) 2112 : cluster [DBG] pgmap v1464: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:25:51.305 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:25:50 smithi157 bash[24585]: audit 2024-09-16T06:25:49.939351+0000 mgr.a (mgr.14373) 2113 : audit [DBG] from='client.57885 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:25:51.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:25:50 smithi086 bash[24289]: cluster 2024-09-16T06:25:49.676783+0000 mgr.a (mgr.14373) 2112 : cluster [DBG] pgmap v1464: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:25:51.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:25:50 smithi086 bash[24289]: audit 2024-09-16T06:25:49.939351+0000 mgr.a (mgr.14373) 2113 : audit [DBG] from='client.57885 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:25:51.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:25:50 smithi047 bash[22744]: cluster 2024-09-16T06:25:49.676783+0000 mgr.a (mgr.14373) 2112 : cluster [DBG] pgmap v1464: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:25:51.340 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:25:50 smithi047 bash[22744]: audit 2024-09-16T06:25:49.939351+0000 mgr.a (mgr.14373) 2113 : audit [DBG] from='client.57885 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:25:53.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:25:52 smithi157 bash[24585]: cluster 2024-09-16T06:25:51.679067+0000 mgr.a (mgr.14373) 2114 : cluster [DBG] pgmap v1465: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:25:53.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:25:52 smithi086 bash[24289]: cluster 2024-09-16T06:25:51.679067+0000 mgr.a (mgr.14373) 2114 : cluster [DBG] pgmap v1465: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:25:53.340 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:25:52 smithi047 bash[22744]: cluster 2024-09-16T06:25:51.679067+0000 mgr.a (mgr.14373) 2114 : cluster [DBG] pgmap v1465: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:25:55.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:25:54 smithi157 bash[24585]: cluster 2024-09-16T06:25:53.679806+0000 mgr.a (mgr.14373) 2115 : cluster [DBG] pgmap v1466: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:25:55.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:25:54 smithi086 bash[24289]: cluster 2024-09-16T06:25:53.679806+0000 mgr.a (mgr.14373) 2115 : cluster [DBG] pgmap v1466: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:25:55.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:25:54 smithi047 bash[22744]: cluster 2024-09-16T06:25:53.679806+0000 mgr.a (mgr.14373) 2115 : cluster [DBG] pgmap v1466: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:25:55.340 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:25:55.341 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:25:55.341 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:25:56.121 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:25:56.121 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:25:56.122 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:25:56.122 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:25:56.122 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:25:57.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:25:56 smithi157 bash[24585]: audit 2024-09-16T06:25:55.679063+0000 mgr.a (mgr.14373) 2116 : audit [DBG] from='client.57963 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:25:57.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:25:56 smithi157 bash[24585]: cluster 2024-09-16T06:25:55.697387+0000 mgr.a (mgr.14373) 2117 : cluster [DBG] pgmap v1467: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:25:57.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:25:56 smithi086 bash[24289]: audit 2024-09-16T06:25:55.679063+0000 mgr.a (mgr.14373) 2116 : audit [DBG] from='client.57963 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:25:57.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:25:56 smithi086 bash[24289]: cluster 2024-09-16T06:25:55.697387+0000 mgr.a (mgr.14373) 2117 : cluster [DBG] pgmap v1467: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:25:57.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:25:56 smithi047 bash[22744]: audit 2024-09-16T06:25:55.679063+0000 mgr.a (mgr.14373) 2116 : audit [DBG] from='client.57963 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:25:57.340 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:25:56 smithi047 bash[22744]: cluster 2024-09-16T06:25:55.697387+0000 mgr.a (mgr.14373) 2117 : cluster [DBG] pgmap v1467: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:25:59.305 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:25:58 smithi157 bash[24585]: cluster 2024-09-16T06:25:57.699943+0000 mgr.a (mgr.14373) 2118 : cluster [DBG] pgmap v1468: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:25:59.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:25:58 smithi086 bash[24289]: cluster 2024-09-16T06:25:57.699943+0000 mgr.a (mgr.14373) 2118 : cluster [DBG] pgmap v1468: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:25:59.340 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:25:58 smithi047 bash[22744]: cluster 2024-09-16T06:25:57.699943+0000 mgr.a (mgr.14373) 2118 : cluster [DBG] pgmap v1468: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:26:01.123 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:26:01.124 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:26:01.124 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:26:01.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:26:00 smithi157 bash[24585]: cluster 2024-09-16T06:25:59.700848+0000 mgr.a (mgr.14373) 2119 : cluster [DBG] pgmap v1469: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:26:01.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:26:00 smithi086 bash[24289]: cluster 2024-09-16T06:25:59.700848+0000 mgr.a (mgr.14373) 2119 : cluster [DBG] pgmap v1469: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:26:01.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:26:00 smithi047 bash[22744]: cluster 2024-09-16T06:25:59.700848+0000 mgr.a (mgr.14373) 2119 : cluster [DBG] pgmap v1469: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:26:01.880 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:26:01.880 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:26:01.880 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:26:01.881 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:26:01.881 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:26:03.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:26:02 smithi157 bash[24585]: audit 2024-09-16T06:26:01.455562+0000 mgr.a (mgr.14373) 2120 : audit [DBG] from='client.58041 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:26:03.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:26:02 smithi157 bash[24585]: cluster 2024-09-16T06:26:01.702185+0000 mgr.a (mgr.14373) 2121 : cluster [DBG] pgmap v1470: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:26:03.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:26:02 smithi086 bash[24289]: audit 2024-09-16T06:26:01.455562+0000 mgr.a (mgr.14373) 2120 : audit [DBG] from='client.58041 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:26:03.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:26:02 smithi086 bash[24289]: cluster 2024-09-16T06:26:01.702185+0000 mgr.a (mgr.14373) 2121 : cluster [DBG] pgmap v1470: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:26:03.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:26:02 smithi047 bash[22744]: audit 2024-09-16T06:26:01.455562+0000 mgr.a (mgr.14373) 2120 : audit [DBG] from='client.58041 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:26:03.340 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:26:02 smithi047 bash[22744]: cluster 2024-09-16T06:26:01.702185+0000 mgr.a (mgr.14373) 2121 : cluster [DBG] pgmap v1470: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:26:05.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:26:04 smithi157 bash[24585]: cluster 2024-09-16T06:26:03.703047+0000 mgr.a (mgr.14373) 2122 : cluster [DBG] pgmap v1471: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 936 B/s rd, 0 op/s 2024-09-16T06:26:05.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:26:04 smithi086 bash[24289]: cluster 2024-09-16T06:26:03.703047+0000 mgr.a (mgr.14373) 2122 : cluster [DBG] pgmap v1471: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 936 B/s rd, 0 op/s 2024-09-16T06:26:05.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:26:04 smithi047 bash[22744]: cluster 2024-09-16T06:26:03.703047+0000 mgr.a (mgr.14373) 2122 : cluster [DBG] pgmap v1471: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 936 B/s rd, 0 op/s 2024-09-16T06:26:06.882 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:26:06.882 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:26:06.882 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:26:07.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:26:06 smithi157 bash[24585]: cluster 2024-09-16T06:26:05.703838+0000 mgr.a (mgr.14373) 2123 : cluster [DBG] pgmap v1472: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 936 B/s rd, 0 op/s 2024-09-16T06:26:07.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:26:06 smithi086 bash[24289]: cluster 2024-09-16T06:26:05.703838+0000 mgr.a (mgr.14373) 2123 : cluster [DBG] pgmap v1472: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 936 B/s rd, 0 op/s 2024-09-16T06:26:07.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:26:06 smithi047 bash[22744]: cluster 2024-09-16T06:26:05.703838+0000 mgr.a (mgr.14373) 2123 : cluster [DBG] pgmap v1472: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 936 B/s rd, 0 op/s 2024-09-16T06:26:07.668 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:26:07.669 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:26:07.669 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:26:07.669 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:26:07.669 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:26:09.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:26:08 smithi157 bash[24585]: audit 2024-09-16T06:26:07.224504+0000 mgr.a (mgr.14373) 2124 : audit [DBG] from='client.58119 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:26:09.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:26:08 smithi157 bash[24585]: cluster 2024-09-16T06:26:07.705154+0000 mgr.a (mgr.14373) 2125 : cluster [DBG] pgmap v1473: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:26:09.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:26:08 smithi086 bash[24289]: audit 2024-09-16T06:26:07.224504+0000 mgr.a (mgr.14373) 2124 : audit [DBG] from='client.58119 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:26:09.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:26:08 smithi086 bash[24289]: cluster 2024-09-16T06:26:07.705154+0000 mgr.a (mgr.14373) 2125 : cluster [DBG] pgmap v1473: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:26:09.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:26:08 smithi047 bash[22744]: audit 2024-09-16T06:26:07.224504+0000 mgr.a (mgr.14373) 2124 : audit [DBG] from='client.58119 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:26:09.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:26:08 smithi047 bash[22744]: cluster 2024-09-16T06:26:07.705154+0000 mgr.a (mgr.14373) 2125 : cluster [DBG] pgmap v1473: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:26:11.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:26:10 smithi157 bash[24585]: cluster 2024-09-16T06:26:09.705899+0000 mgr.a (mgr.14373) 2126 : cluster [DBG] pgmap v1474: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T06:26:11.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:26:10 smithi086 bash[24289]: cluster 2024-09-16T06:26:09.705899+0000 mgr.a (mgr.14373) 2126 : cluster [DBG] pgmap v1474: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T06:26:11.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:26:10 smithi047 bash[22744]: cluster 2024-09-16T06:26:09.705899+0000 mgr.a (mgr.14373) 2126 : cluster [DBG] pgmap v1474: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T06:26:12.670 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:26:12.671 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:26:12.671 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:26:13.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:26:12 smithi157 bash[24585]: cluster 2024-09-16T06:26:11.707841+0000 mgr.a (mgr.14373) 2127 : cluster [DBG] pgmap v1475: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:26:13.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:26:12 smithi086 bash[24289]: cluster 2024-09-16T06:26:11.707841+0000 mgr.a (mgr.14373) 2127 : cluster [DBG] pgmap v1475: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:26:13.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:26:12 smithi047 bash[22744]: cluster 2024-09-16T06:26:11.707841+0000 mgr.a (mgr.14373) 2127 : cluster [DBG] pgmap v1475: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:26:13.427 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:26:13.428 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:26:13.428 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:26:13.428 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:26:13.428 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:26:15.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:26:14 smithi157 bash[24585]: audit 2024-09-16T06:26:13.006913+0000 mgr.a (mgr.14373) 2128 : audit [DBG] from='client.58197 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:26:15.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:26:14 smithi157 bash[24585]: cluster 2024-09-16T06:26:13.708711+0000 mgr.a (mgr.14373) 2129 : cluster [DBG] pgmap v1476: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:26:15.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:26:14 smithi086 bash[24289]: audit 2024-09-16T06:26:13.006913+0000 mgr.a (mgr.14373) 2128 : audit [DBG] from='client.58197 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:26:15.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:26:14 smithi086 bash[24289]: cluster 2024-09-16T06:26:13.708711+0000 mgr.a (mgr.14373) 2129 : cluster [DBG] pgmap v1476: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:26:15.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:26:14 smithi047 bash[22744]: audit 2024-09-16T06:26:13.006913+0000 mgr.a (mgr.14373) 2128 : audit [DBG] from='client.58197 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:26:15.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:26:14 smithi047 bash[22744]: cluster 2024-09-16T06:26:13.708711+0000 mgr.a (mgr.14373) 2129 : cluster [DBG] pgmap v1476: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:26:17.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:26:16 smithi157 bash[24585]: cluster 2024-09-16T06:26:15.709522+0000 mgr.a (mgr.14373) 2130 : cluster [DBG] pgmap v1477: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:26:17.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:26:16 smithi086 bash[24289]: cluster 2024-09-16T06:26:15.709522+0000 mgr.a (mgr.14373) 2130 : cluster [DBG] pgmap v1477: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:26:17.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:26:16 smithi047 bash[22744]: cluster 2024-09-16T06:26:15.709522+0000 mgr.a (mgr.14373) 2130 : cluster [DBG] pgmap v1477: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:26:18.429 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:26:18.430 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:26:18.430 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:26:19.198 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:26:19.199 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:26:19.199 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:26:19.199 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:26:19.199 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:26:19.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:26:18 smithi157 bash[24585]: cluster 2024-09-16T06:26:17.711733+0000 mgr.a (mgr.14373) 2131 : cluster [DBG] pgmap v1478: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:26:19.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:26:18 smithi086 bash[24289]: cluster 2024-09-16T06:26:17.711733+0000 mgr.a (mgr.14373) 2131 : cluster [DBG] pgmap v1478: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:26:19.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:26:18 smithi047 bash[22744]: cluster 2024-09-16T06:26:17.711733+0000 mgr.a (mgr.14373) 2131 : cluster [DBG] pgmap v1478: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:26:20.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:26:19 smithi157 bash[24585]: audit 2024-09-16T06:26:18.768796+0000 mgr.a (mgr.14373) 2132 : audit [DBG] from='client.58272 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:26:20.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:26:19 smithi086 bash[24289]: audit 2024-09-16T06:26:18.768796+0000 mgr.a (mgr.14373) 2132 : audit [DBG] from='client.58272 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:26:20.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:26:19 smithi047 bash[22744]: audit 2024-09-16T06:26:18.768796+0000 mgr.a (mgr.14373) 2132 : audit [DBG] from='client.58272 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:26:21.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:26:20 smithi157 bash[24585]: cluster 2024-09-16T06:26:19.712624+0000 mgr.a (mgr.14373) 2133 : cluster [DBG] pgmap v1479: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:26:21.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:26:20 smithi157 bash[24585]: audit 2024-09-16T06:26:20.117233+0000 mon.b (mon.2) 238 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T06:26:21.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:26:20 smithi086 bash[24289]: cluster 2024-09-16T06:26:19.712624+0000 mgr.a (mgr.14373) 2133 : cluster [DBG] pgmap v1479: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:26:21.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:26:20 smithi086 bash[24289]: audit 2024-09-16T06:26:20.117233+0000 mon.b (mon.2) 238 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T06:26:21.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:26:20 smithi047 bash[22744]: cluster 2024-09-16T06:26:19.712624+0000 mgr.a (mgr.14373) 2133 : cluster [DBG] pgmap v1479: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:26:21.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:26:20 smithi047 bash[22744]: audit 2024-09-16T06:26:20.117233+0000 mon.b (mon.2) 238 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T06:26:22.090 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 06:26:21 smithi047 bash[22994]: debug 2024-09-16T06:26:21.707+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T06:26:22.090 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 06:26:21 smithi047 bash[22994]: debug 2024-09-16T06:26:21.707+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T06:26:22.090 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:26:21 smithi047 bash[22744]: audit 2024-09-16T06:26:20.968136+0000 mon.b (mon.2) 239 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T06:26:22.090 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:26:21 smithi047 bash[22744]: audit 2024-09-16T06:26:20.970324+0000 mon.b (mon.2) 240 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T06:26:22.090 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:26:21 smithi047 bash[22744]: audit 2024-09-16T06:26:20.982833+0000 mon.a (mon.0) 696 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:26:22.090 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:26:21 smithi047 bash[22744]: audit 2024-09-16T06:26:20.986789+0000 mon.b (mon.2) 241 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:26:22.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:26:21 smithi157 bash[24585]: audit 2024-09-16T06:26:20.968136+0000 mon.b (mon.2) 239 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T06:26:22.305 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:26:21 smithi157 bash[24585]: audit 2024-09-16T06:26:20.970324+0000 mon.b (mon.2) 240 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T06:26:22.305 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:26:21 smithi157 bash[24585]: audit 2024-09-16T06:26:20.982833+0000 mon.a (mon.0) 696 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:26:22.305 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:26:21 smithi157 bash[24585]: audit 2024-09-16T06:26:20.986789+0000 mon.b (mon.2) 241 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:26:22.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:26:21 smithi086 bash[24289]: audit 2024-09-16T06:26:20.968136+0000 mon.b (mon.2) 239 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T06:26:22.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:26:21 smithi086 bash[24289]: audit 2024-09-16T06:26:20.970324+0000 mon.b (mon.2) 240 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T06:26:22.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:26:21 smithi086 bash[24289]: audit 2024-09-16T06:26:20.982833+0000 mon.a (mon.0) 696 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:26:22.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:26:21 smithi086 bash[24289]: audit 2024-09-16T06:26:20.986789+0000 mon.b (mon.2) 241 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:26:23.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:26:22 smithi157 bash[24585]: audit 2024-09-16T06:26:20.990724+0000 mgr.a (mgr.14373) 2134 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:26:23.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:26:22 smithi157 bash[24585]: audit 2024-09-16T06:26:21.711944+0000 mgr.a (mgr.14373) 2135 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T06:26:23.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:26:22 smithi157 bash[24585]: cephadm 2024-09-16T06:26:21.714011+0000 mgr.a (mgr.14373) 2136 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T06:26:23.305 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:26:22 smithi157 bash[24585]: cluster 2024-09-16T06:26:21.714359+0000 mgr.a (mgr.14373) 2137 : cluster [DBG] pgmap v1480: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 4.3 KiB/s rd, 255 B/s wr, 4 op/s 2024-09-16T06:26:23.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:26:22 smithi086 bash[24289]: audit 2024-09-16T06:26:20.990724+0000 mgr.a (mgr.14373) 2134 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:26:23.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:26:22 smithi086 bash[24289]: audit 2024-09-16T06:26:21.711944+0000 mgr.a (mgr.14373) 2135 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T06:26:23.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:26:22 smithi086 bash[24289]: cephadm 2024-09-16T06:26:21.714011+0000 mgr.a (mgr.14373) 2136 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T06:26:23.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:26:22 smithi086 bash[24289]: cluster 2024-09-16T06:26:21.714359+0000 mgr.a (mgr.14373) 2137 : cluster [DBG] pgmap v1480: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 4.3 KiB/s rd, 255 B/s wr, 4 op/s 2024-09-16T06:26:23.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:26:22 smithi047 bash[22744]: audit 2024-09-16T06:26:20.990724+0000 mgr.a (mgr.14373) 2134 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:26:23.340 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:26:22 smithi047 bash[22744]: audit 2024-09-16T06:26:21.711944+0000 mgr.a (mgr.14373) 2135 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T06:26:23.340 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:26:22 smithi047 bash[22744]: cephadm 2024-09-16T06:26:21.714011+0000 mgr.a (mgr.14373) 2136 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T06:26:23.340 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:26:22 smithi047 bash[22744]: cluster 2024-09-16T06:26:21.714359+0000 mgr.a (mgr.14373) 2137 : cluster [DBG] pgmap v1480: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 4.3 KiB/s rd, 255 B/s wr, 4 op/s 2024-09-16T06:26:24.200 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:26:24.201 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:26:24.201 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:26:24.964 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:26:24.964 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:26:24.964 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:26:24.964 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:26:24.965 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:26:25.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:26:24 smithi157 bash[24585]: cluster 2024-09-16T06:26:23.715053+0000 mgr.a (mgr.14373) 2138 : cluster [DBG] pgmap v1481: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 3.4 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-16T06:26:25.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:26:24 smithi086 bash[24289]: cluster 2024-09-16T06:26:23.715053+0000 mgr.a (mgr.14373) 2138 : cluster [DBG] pgmap v1481: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 3.4 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-16T06:26:25.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:26:24 smithi047 bash[22744]: cluster 2024-09-16T06:26:23.715053+0000 mgr.a (mgr.14373) 2138 : cluster [DBG] pgmap v1481: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 3.4 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-16T06:26:26.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:26:25 smithi157 bash[24585]: audit 2024-09-16T06:26:24.532933+0000 mgr.a (mgr.14373) 2139 : audit [DBG] from='client.58458 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:26:26.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:26:25 smithi086 bash[24289]: audit 2024-09-16T06:26:24.532933+0000 mgr.a (mgr.14373) 2139 : audit [DBG] from='client.58458 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:26:26.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:26:25 smithi047 bash[22744]: audit 2024-09-16T06:26:24.532933+0000 mgr.a (mgr.14373) 2139 : audit [DBG] from='client.58458 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:26:27.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:26:26 smithi157 bash[24585]: cluster 2024-09-16T06:26:25.715966+0000 mgr.a (mgr.14373) 2140 : cluster [DBG] pgmap v1482: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 3.4 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-16T06:26:27.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:26:26 smithi086 bash[24289]: cluster 2024-09-16T06:26:25.715966+0000 mgr.a (mgr.14373) 2140 : cluster [DBG] pgmap v1482: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 3.4 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-16T06:26:27.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:26:26 smithi047 bash[22744]: cluster 2024-09-16T06:26:25.715966+0000 mgr.a (mgr.14373) 2140 : cluster [DBG] pgmap v1482: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 3.4 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-16T06:26:29.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:26:28 smithi157 bash[24585]: cluster 2024-09-16T06:26:27.718188+0000 mgr.a (mgr.14373) 2141 : cluster [DBG] pgmap v1483: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:26:29.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:26:28 smithi086 bash[24289]: cluster 2024-09-16T06:26:27.718188+0000 mgr.a (mgr.14373) 2141 : cluster [DBG] pgmap v1483: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:26:29.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:26:28 smithi047 bash[22744]: cluster 2024-09-16T06:26:27.718188+0000 mgr.a (mgr.14373) 2141 : cluster [DBG] pgmap v1483: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:26:29.965 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:26:29.966 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:26:29.966 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:26:30.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:26:30 smithi157 bash[24585]: cluster 2024-09-16T06:26:29.719084+0000 mgr.a (mgr.14373) 2142 : cluster [DBG] pgmap v1484: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:26:30.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:26:30 smithi086 bash[24289]: cluster 2024-09-16T06:26:29.719084+0000 mgr.a (mgr.14373) 2142 : cluster [DBG] pgmap v1484: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:26:30.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:26:30 smithi047 bash[22744]: cluster 2024-09-16T06:26:29.719084+0000 mgr.a (mgr.14373) 2142 : cluster [DBG] pgmap v1484: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:26:30.707 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:26:30.708 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:26:30.708 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:26:30.708 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:26:30.708 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:26:31.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:26:31 smithi157 bash[24585]: audit 2024-09-16T06:26:30.298576+0000 mgr.a (mgr.14373) 2143 : audit [DBG] from='client.58536 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:26:31.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:26:31 smithi086 bash[24289]: audit 2024-09-16T06:26:30.298576+0000 mgr.a (mgr.14373) 2143 : audit [DBG] from='client.58536 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:26:31.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:26:31 smithi047 bash[22744]: audit 2024-09-16T06:26:30.298576+0000 mgr.a (mgr.14373) 2143 : audit [DBG] from='client.58536 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:26:32.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:26:32 smithi157 bash[24585]: cluster 2024-09-16T06:26:31.721447+0000 mgr.a (mgr.14373) 2144 : cluster [DBG] pgmap v1485: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:26:32.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:26:32 smithi086 bash[24289]: cluster 2024-09-16T06:26:31.721447+0000 mgr.a (mgr.14373) 2144 : cluster [DBG] pgmap v1485: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:26:32.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:26:32 smithi047 bash[22744]: cluster 2024-09-16T06:26:31.721447+0000 mgr.a (mgr.14373) 2144 : cluster [DBG] pgmap v1485: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:26:35.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:26:34 smithi157 bash[24585]: cluster 2024-09-16T06:26:33.722221+0000 mgr.a (mgr.14373) 2145 : cluster [DBG] pgmap v1486: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 5.4 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-16T06:26:35.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:26:34 smithi086 bash[24289]: cluster 2024-09-16T06:26:33.722221+0000 mgr.a (mgr.14373) 2145 : cluster [DBG] pgmap v1486: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 5.4 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-16T06:26:35.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:26:34 smithi047 bash[22744]: cluster 2024-09-16T06:26:33.722221+0000 mgr.a (mgr.14373) 2145 : cluster [DBG] pgmap v1486: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 5.4 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-16T06:26:35.708 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:26:35.709 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:26:35.709 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:26:36.473 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:26:36.474 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:26:36.474 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:26:36.474 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:26:36.474 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:26:37.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:26:36 smithi157 bash[24585]: cluster 2024-09-16T06:26:35.722914+0000 mgr.a (mgr.14373) 2146 : cluster [DBG] pgmap v1487: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 5.4 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-16T06:26:37.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:26:36 smithi086 bash[24289]: cluster 2024-09-16T06:26:35.722914+0000 mgr.a (mgr.14373) 2146 : cluster [DBG] pgmap v1487: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 5.4 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-16T06:26:37.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:26:36 smithi047 bash[22744]: cluster 2024-09-16T06:26:35.722914+0000 mgr.a (mgr.14373) 2146 : cluster [DBG] pgmap v1487: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 5.4 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-16T06:26:38.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:26:37 smithi157 bash[24585]: audit 2024-09-16T06:26:36.049259+0000 mgr.a (mgr.14373) 2147 : audit [DBG] from='client.58614 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:26:38.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:26:37 smithi086 bash[24289]: audit 2024-09-16T06:26:36.049259+0000 mgr.a (mgr.14373) 2147 : audit [DBG] from='client.58614 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:26:38.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:26:37 smithi047 bash[22744]: audit 2024-09-16T06:26:36.049259+0000 mgr.a (mgr.14373) 2147 : audit [DBG] from='client.58614 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:26:39.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:26:38 smithi157 bash[24585]: cluster 2024-09-16T06:26:37.725238+0000 mgr.a (mgr.14373) 2148 : cluster [DBG] pgmap v1488: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 5.9 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-16T06:26:39.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:26:38 smithi086 bash[24289]: cluster 2024-09-16T06:26:37.725238+0000 mgr.a (mgr.14373) 2148 : cluster [DBG] pgmap v1488: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 5.9 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-16T06:26:39.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:26:38 smithi047 bash[22744]: cluster 2024-09-16T06:26:37.725238+0000 mgr.a (mgr.14373) 2148 : cluster [DBG] pgmap v1488: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 5.9 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-16T06:26:41.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:26:40 smithi157 bash[24585]: cluster 2024-09-16T06:26:39.726027+0000 mgr.a (mgr.14373) 2149 : cluster [DBG] pgmap v1489: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T06:26:41.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:26:40 smithi086 bash[24289]: cluster 2024-09-16T06:26:39.726027+0000 mgr.a (mgr.14373) 2149 : cluster [DBG] pgmap v1489: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T06:26:41.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:26:40 smithi047 bash[22744]: cluster 2024-09-16T06:26:39.726027+0000 mgr.a (mgr.14373) 2149 : cluster [DBG] pgmap v1489: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T06:26:41.475 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:26:41.476 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:26:41.476 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:26:42.249 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:26:42.250 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:26:42.250 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:26:42.250 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:26:42.250 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:26:43.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:26:42 smithi157 bash[24585]: cluster 2024-09-16T06:26:41.728093+0000 mgr.a (mgr.14373) 2150 : cluster [DBG] pgmap v1490: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:26:43.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:26:42 smithi157 bash[24585]: audit 2024-09-16T06:26:41.817964+0000 mgr.a (mgr.14373) 2151 : audit [DBG] from='client.58692 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:26:43.073 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:26:42 smithi086 bash[24289]: cluster 2024-09-16T06:26:41.728093+0000 mgr.a (mgr.14373) 2150 : cluster [DBG] pgmap v1490: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:26:43.073 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:26:42 smithi086 bash[24289]: audit 2024-09-16T06:26:41.817964+0000 mgr.a (mgr.14373) 2151 : audit [DBG] from='client.58692 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:26:43.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:26:42 smithi047 bash[22744]: cluster 2024-09-16T06:26:41.728093+0000 mgr.a (mgr.14373) 2150 : cluster [DBG] pgmap v1490: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:26:43.090 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:26:42 smithi047 bash[22744]: audit 2024-09-16T06:26:41.817964+0000 mgr.a (mgr.14373) 2151 : audit [DBG] from='client.58692 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:26:45.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:26:44 smithi086 bash[24289]: cluster 2024-09-16T06:26:43.728992+0000 mgr.a (mgr.14373) 2152 : cluster [DBG] pgmap v1491: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:26:45.090 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:26:44 smithi047 bash[22744]: cluster 2024-09-16T06:26:43.728992+0000 mgr.a (mgr.14373) 2152 : cluster [DBG] pgmap v1491: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:26:45.305 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:26:44 smithi157 bash[24585]: cluster 2024-09-16T06:26:43.728992+0000 mgr.a (mgr.14373) 2152 : cluster [DBG] pgmap v1491: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:26:47.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:26:46 smithi086 bash[24289]: cluster 2024-09-16T06:26:45.729794+0000 mgr.a (mgr.14373) 2153 : cluster [DBG] pgmap v1492: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T06:26:47.090 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:26:46 smithi047 bash[22744]: cluster 2024-09-16T06:26:45.729794+0000 mgr.a (mgr.14373) 2153 : cluster [DBG] pgmap v1492: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T06:26:47.251 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:26:47.252 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:26:47.252 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:26:47.305 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:26:46 smithi157 bash[24585]: cluster 2024-09-16T06:26:45.729794+0000 mgr.a (mgr.14373) 2153 : cluster [DBG] pgmap v1492: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T06:26:48.020 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:26:48.020 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:26:48.020 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:26:48.020 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:26:48.021 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:26:49.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:26:48 smithi086 bash[24289]: audit 2024-09-16T06:26:47.591249+0000 mgr.a (mgr.14373) 2154 : audit [DBG] from='client.58770 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:26:49.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:26:48 smithi086 bash[24289]: cluster 2024-09-16T06:26:47.731521+0000 mgr.a (mgr.14373) 2155 : cluster [DBG] pgmap v1493: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:26:49.090 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:26:48 smithi047 bash[22744]: audit 2024-09-16T06:26:47.591249+0000 mgr.a (mgr.14373) 2154 : audit [DBG] from='client.58770 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:26:49.090 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:26:48 smithi047 bash[22744]: cluster 2024-09-16T06:26:47.731521+0000 mgr.a (mgr.14373) 2155 : cluster [DBG] pgmap v1493: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:26:49.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:26:48 smithi157 bash[24585]: audit 2024-09-16T06:26:47.591249+0000 mgr.a (mgr.14373) 2154 : audit [DBG] from='client.58770 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:26:49.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:26:48 smithi157 bash[24585]: cluster 2024-09-16T06:26:47.731521+0000 mgr.a (mgr.14373) 2155 : cluster [DBG] pgmap v1493: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:26:51.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:26:50 smithi086 bash[24289]: cluster 2024-09-16T06:26:49.732497+0000 mgr.a (mgr.14373) 2156 : cluster [DBG] pgmap v1494: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-16T06:26:51.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:26:50 smithi047 bash[22744]: cluster 2024-09-16T06:26:49.732497+0000 mgr.a (mgr.14373) 2156 : cluster [DBG] pgmap v1494: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-16T06:26:51.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:26:50 smithi157 bash[24585]: cluster 2024-09-16T06:26:49.732497+0000 mgr.a (mgr.14373) 2156 : cluster [DBG] pgmap v1494: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-16T06:26:53.021 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:26:53.025 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:26:53.025 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:26:53.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:26:52 smithi157 bash[24585]: cluster 2024-09-16T06:26:51.734708+0000 mgr.a (mgr.14373) 2157 : cluster [DBG] pgmap v1495: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-16T06:26:53.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:26:52 smithi086 bash[24289]: cluster 2024-09-16T06:26:51.734708+0000 mgr.a (mgr.14373) 2157 : cluster [DBG] pgmap v1495: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-16T06:26:53.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:26:52 smithi047 bash[22744]: cluster 2024-09-16T06:26:51.734708+0000 mgr.a (mgr.14373) 2157 : cluster [DBG] pgmap v1495: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-16T06:26:53.796 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:26:53.796 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:26:53.796 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:26:53.796 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:26:53.797 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:26:55.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:26:54 smithi157 bash[24585]: audit 2024-09-16T06:26:53.358929+0000 mgr.a (mgr.14373) 2158 : audit [DBG] from='client.58848 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:26:55.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:26:54 smithi157 bash[24585]: cluster 2024-09-16T06:26:53.735248+0000 mgr.a (mgr.14373) 2159 : cluster [DBG] pgmap v1496: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:26:55.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:26:54 smithi086 bash[24289]: audit 2024-09-16T06:26:53.358929+0000 mgr.a (mgr.14373) 2158 : audit [DBG] from='client.58848 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:26:55.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:26:54 smithi086 bash[24289]: cluster 2024-09-16T06:26:53.735248+0000 mgr.a (mgr.14373) 2159 : cluster [DBG] pgmap v1496: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:26:55.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:26:54 smithi047 bash[22744]: audit 2024-09-16T06:26:53.358929+0000 mgr.a (mgr.14373) 2158 : audit [DBG] from='client.58848 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:26:55.340 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:26:54 smithi047 bash[22744]: cluster 2024-09-16T06:26:53.735248+0000 mgr.a (mgr.14373) 2159 : cluster [DBG] pgmap v1496: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:26:57.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:26:56 smithi157 bash[24585]: cluster 2024-09-16T06:26:55.736074+0000 mgr.a (mgr.14373) 2160 : cluster [DBG] pgmap v1497: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:26:57.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:26:56 smithi086 bash[24289]: cluster 2024-09-16T06:26:55.736074+0000 mgr.a (mgr.14373) 2160 : cluster [DBG] pgmap v1497: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:26:57.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:26:56 smithi047 bash[22744]: cluster 2024-09-16T06:26:55.736074+0000 mgr.a (mgr.14373) 2160 : cluster [DBG] pgmap v1497: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:26:58.798 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:26:58.798 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:26:58.798 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:26:59.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:26:58 smithi157 bash[24585]: cluster 2024-09-16T06:26:57.738330+0000 mgr.a (mgr.14373) 2161 : cluster [DBG] pgmap v1498: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:26:59.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:26:58 smithi086 bash[24289]: cluster 2024-09-16T06:26:57.738330+0000 mgr.a (mgr.14373) 2161 : cluster [DBG] pgmap v1498: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:26:59.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:26:58 smithi047 bash[22744]: cluster 2024-09-16T06:26:57.738330+0000 mgr.a (mgr.14373) 2161 : cluster [DBG] pgmap v1498: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:26:59.547 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:26:59.547 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:26:59.548 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:26:59.548 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:26:59.548 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:27:01.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:27:00 smithi157 bash[24585]: audit 2024-09-16T06:26:59.133556+0000 mgr.a (mgr.14373) 2162 : audit [DBG] from='client.58920 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:27:01.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:27:00 smithi157 bash[24585]: cluster 2024-09-16T06:26:59.739231+0000 mgr.a (mgr.14373) 2163 : cluster [DBG] pgmap v1499: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:27:01.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:27:00 smithi086 bash[24289]: audit 2024-09-16T06:26:59.133556+0000 mgr.a (mgr.14373) 2162 : audit [DBG] from='client.58920 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:27:01.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:27:00 smithi086 bash[24289]: cluster 2024-09-16T06:26:59.739231+0000 mgr.a (mgr.14373) 2163 : cluster [DBG] pgmap v1499: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:27:01.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:27:00 smithi047 bash[22744]: audit 2024-09-16T06:26:59.133556+0000 mgr.a (mgr.14373) 2162 : audit [DBG] from='client.58920 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:27:01.340 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:27:00 smithi047 bash[22744]: cluster 2024-09-16T06:26:59.739231+0000 mgr.a (mgr.14373) 2163 : cluster [DBG] pgmap v1499: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:27:03.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:27:02 smithi157 bash[24585]: cluster 2024-09-16T06:27:01.741494+0000 mgr.a (mgr.14373) 2164 : cluster [DBG] pgmap v1500: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:27:03.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:27:02 smithi086 bash[24289]: cluster 2024-09-16T06:27:01.741494+0000 mgr.a (mgr.14373) 2164 : cluster [DBG] pgmap v1500: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:27:03.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:27:02 smithi047 bash[22744]: cluster 2024-09-16T06:27:01.741494+0000 mgr.a (mgr.14373) 2164 : cluster [DBG] pgmap v1500: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:27:04.549 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:27:04.550 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:27:04.550 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:27:05.282 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:27:05.283 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:27:05.283 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:27:05.283 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:27:05.283 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:27:05.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:27:04 smithi157 bash[24585]: cluster 2024-09-16T06:27:03.742257+0000 mgr.a (mgr.14373) 2165 : cluster [DBG] pgmap v1501: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:27:05.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:27:04 smithi086 bash[24289]: cluster 2024-09-16T06:27:03.742257+0000 mgr.a (mgr.14373) 2165 : cluster [DBG] pgmap v1501: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:27:05.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:27:04 smithi047 bash[22744]: cluster 2024-09-16T06:27:03.742257+0000 mgr.a (mgr.14373) 2165 : cluster [DBG] pgmap v1501: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:27:06.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:27:05 smithi157 bash[24585]: audit 2024-09-16T06:27:04.877776+0000 mgr.a (mgr.14373) 2166 : audit [DBG] from='client.58998 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:27:06.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:27:05 smithi086 bash[24289]: audit 2024-09-16T06:27:04.877776+0000 mgr.a (mgr.14373) 2166 : audit [DBG] from='client.58998 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:27:06.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:27:05 smithi047 bash[22744]: audit 2024-09-16T06:27:04.877776+0000 mgr.a (mgr.14373) 2166 : audit [DBG] from='client.58998 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:27:07.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:27:06 smithi157 bash[24585]: cluster 2024-09-16T06:27:05.743398+0000 mgr.a (mgr.14373) 2167 : cluster [DBG] pgmap v1502: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:27:07.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:27:06 smithi086 bash[24289]: cluster 2024-09-16T06:27:05.743398+0000 mgr.a (mgr.14373) 2167 : cluster [DBG] pgmap v1502: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:27:07.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:27:06 smithi047 bash[22744]: cluster 2024-09-16T06:27:05.743398+0000 mgr.a (mgr.14373) 2167 : cluster [DBG] pgmap v1502: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:27:09.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:27:08 smithi157 bash[24585]: cluster 2024-09-16T06:27:07.745699+0000 mgr.a (mgr.14373) 2168 : cluster [DBG] pgmap v1503: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:27:09.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:27:08 smithi086 bash[24289]: cluster 2024-09-16T06:27:07.745699+0000 mgr.a (mgr.14373) 2168 : cluster [DBG] pgmap v1503: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:27:09.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:27:08 smithi047 bash[22744]: cluster 2024-09-16T06:27:07.745699+0000 mgr.a (mgr.14373) 2168 : cluster [DBG] pgmap v1503: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:27:10.284 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:27:10.285 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:27:10.285 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:27:11.067 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:27:11.067 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:27:11.067 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:27:11.067 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:27:11.067 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:27:11.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:27:10 smithi157 bash[24585]: cluster 2024-09-16T06:27:09.746493+0000 mgr.a (mgr.14373) 2169 : cluster [DBG] pgmap v1504: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:27:11.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:27:10 smithi086 bash[24289]: cluster 2024-09-16T06:27:09.746493+0000 mgr.a (mgr.14373) 2169 : cluster [DBG] pgmap v1504: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:27:11.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:27:10 smithi047 bash[22744]: cluster 2024-09-16T06:27:09.746493+0000 mgr.a (mgr.14373) 2169 : cluster [DBG] pgmap v1504: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:27:12.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:27:11 smithi157 bash[24585]: audit 2024-09-16T06:27:10.624823+0000 mgr.a (mgr.14373) 2170 : audit [DBG] from='client.59076 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:27:12.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:27:11 smithi086 bash[24289]: audit 2024-09-16T06:27:10.624823+0000 mgr.a (mgr.14373) 2170 : audit [DBG] from='client.59076 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:27:12.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:27:11 smithi047 bash[22744]: audit 2024-09-16T06:27:10.624823+0000 mgr.a (mgr.14373) 2170 : audit [DBG] from='client.59076 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:27:13.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:27:12 smithi157 bash[24585]: cluster 2024-09-16T06:27:11.748854+0000 mgr.a (mgr.14373) 2171 : cluster [DBG] pgmap v1505: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:27:13.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:27:12 smithi086 bash[24289]: cluster 2024-09-16T06:27:11.748854+0000 mgr.a (mgr.14373) 2171 : cluster [DBG] pgmap v1505: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:27:13.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:27:12 smithi047 bash[22744]: cluster 2024-09-16T06:27:11.748854+0000 mgr.a (mgr.14373) 2171 : cluster [DBG] pgmap v1505: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:27:15.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:27:14 smithi157 bash[24585]: cluster 2024-09-16T06:27:13.749618+0000 mgr.a (mgr.14373) 2172 : cluster [DBG] pgmap v1506: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:27:15.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:27:14 smithi086 bash[24289]: cluster 2024-09-16T06:27:13.749618+0000 mgr.a (mgr.14373) 2172 : cluster [DBG] pgmap v1506: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:27:15.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:27:14 smithi047 bash[22744]: cluster 2024-09-16T06:27:13.749618+0000 mgr.a (mgr.14373) 2172 : cluster [DBG] pgmap v1506: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:27:16.069 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:27:16.069 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:27:16.070 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:27:16.833 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:27:16.833 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:27:16.833 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:27:16.833 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:27:16.833 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:27:17.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:27:16 smithi157 bash[24585]: cluster 2024-09-16T06:27:15.750393+0000 mgr.a (mgr.14373) 2173 : cluster [DBG] pgmap v1507: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:27:17.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:27:16 smithi086 bash[24289]: cluster 2024-09-16T06:27:15.750393+0000 mgr.a (mgr.14373) 2173 : cluster [DBG] pgmap v1507: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:27:17.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:27:16 smithi047 bash[22744]: cluster 2024-09-16T06:27:15.750393+0000 mgr.a (mgr.14373) 2173 : cluster [DBG] pgmap v1507: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:27:18.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:27:17 smithi157 bash[24585]: audit 2024-09-16T06:27:16.408764+0000 mgr.a (mgr.14373) 2174 : audit [DBG] from='client.59154 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:27:18.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:27:17 smithi086 bash[24289]: audit 2024-09-16T06:27:16.408764+0000 mgr.a (mgr.14373) 2174 : audit [DBG] from='client.59154 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:27:18.340 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:27:17 smithi047 bash[22744]: audit 2024-09-16T06:27:16.408764+0000 mgr.a (mgr.14373) 2174 : audit [DBG] from='client.59154 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:27:19.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:27:18 smithi157 bash[24585]: cluster 2024-09-16T06:27:17.753193+0000 mgr.a (mgr.14373) 2175 : cluster [DBG] pgmap v1508: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:27:19.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:27:18 smithi086 bash[24289]: cluster 2024-09-16T06:27:17.753193+0000 mgr.a (mgr.14373) 2175 : cluster [DBG] pgmap v1508: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:27:19.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:27:18 smithi047 bash[22744]: cluster 2024-09-16T06:27:17.753193+0000 mgr.a (mgr.14373) 2175 : cluster [DBG] pgmap v1508: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:27:21.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:27:20 smithi157 bash[24585]: cluster 2024-09-16T06:27:19.754010+0000 mgr.a (mgr.14373) 2176 : cluster [DBG] pgmap v1509: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:27:21.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:27:20 smithi086 bash[24289]: cluster 2024-09-16T06:27:19.754010+0000 mgr.a (mgr.14373) 2176 : cluster [DBG] pgmap v1509: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:27:21.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:27:20 smithi047 bash[22744]: cluster 2024-09-16T06:27:19.754010+0000 mgr.a (mgr.14373) 2176 : cluster [DBG] pgmap v1509: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:27:21.834 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:27:21.835 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:27:21.835 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:27:22.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:27:21 smithi157 bash[24585]: audit 2024-09-16T06:27:21.763578+0000 mon.b (mon.2) 242 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T06:27:22.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:27:21 smithi086 bash[24289]: audit 2024-09-16T06:27:21.763578+0000 mon.b (mon.2) 242 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T06:27:22.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:27:21 smithi047 bash[22744]: audit 2024-09-16T06:27:21.763578+0000 mon.b (mon.2) 242 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T06:27:22.595 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:27:22.595 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:27:22.595 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:27:22.595 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:27:22.595 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:27:23.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:27:22 smithi157 bash[24585]: cluster 2024-09-16T06:27:21.756039+0000 mgr.a (mgr.14373) 2177 : cluster [DBG] pgmap v1510: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:27:23.305 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:27:22 smithi157 bash[24585]: audit 2024-09-16T06:27:22.170047+0000 mgr.a (mgr.14373) 2178 : audit [DBG] from='client.59232 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:27:23.305 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:27:22 smithi157 bash[24585]: audit 2024-09-16T06:27:22.621682+0000 mon.b (mon.2) 243 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T06:27:23.305 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:27:22 smithi157 bash[24585]: audit 2024-09-16T06:27:22.623879+0000 mon.b (mon.2) 244 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T06:27:23.305 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:27:22 smithi157 bash[24585]: audit 2024-09-16T06:27:22.634791+0000 mon.a (mon.0) 697 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:27:23.305 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:27:22 smithi157 bash[24585]: audit 2024-09-16T06:27:22.636468+0000 mon.b (mon.2) 245 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:27:23.305 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:27:22 smithi157 bash[24585]: audit 2024-09-16T06:27:22.639095+0000 mgr.a (mgr.14373) 2179 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:27:23.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:27:22 smithi086 bash[24289]: cluster 2024-09-16T06:27:21.756039+0000 mgr.a (mgr.14373) 2177 : cluster [DBG] pgmap v1510: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:27:23.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:27:22 smithi086 bash[24289]: audit 2024-09-16T06:27:22.170047+0000 mgr.a (mgr.14373) 2178 : audit [DBG] from='client.59232 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:27:23.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:27:22 smithi086 bash[24289]: audit 2024-09-16T06:27:22.621682+0000 mon.b (mon.2) 243 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T06:27:23.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:27:22 smithi086 bash[24289]: audit 2024-09-16T06:27:22.623879+0000 mon.b (mon.2) 244 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T06:27:23.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:27:22 smithi086 bash[24289]: audit 2024-09-16T06:27:22.634791+0000 mon.a (mon.0) 697 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:27:23.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:27:22 smithi086 bash[24289]: audit 2024-09-16T06:27:22.636468+0000 mon.b (mon.2) 245 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:27:23.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:27:22 smithi086 bash[24289]: audit 2024-09-16T06:27:22.639095+0000 mgr.a (mgr.14373) 2179 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:27:23.326 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:27:22 smithi047 bash[22744]: cluster 2024-09-16T06:27:21.756039+0000 mgr.a (mgr.14373) 2177 : cluster [DBG] pgmap v1510: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:27:23.326 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:27:22 smithi047 bash[22744]: audit 2024-09-16T06:27:22.170047+0000 mgr.a (mgr.14373) 2178 : audit [DBG] from='client.59232 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:27:23.326 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:27:22 smithi047 bash[22744]: audit 2024-09-16T06:27:22.621682+0000 mon.b (mon.2) 243 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T06:27:23.327 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:27:22 smithi047 bash[22744]: audit 2024-09-16T06:27:22.623879+0000 mon.b (mon.2) 244 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T06:27:23.327 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:27:22 smithi047 bash[22744]: audit 2024-09-16T06:27:22.634791+0000 mon.a (mon.0) 697 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:27:23.327 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:27:22 smithi047 bash[22744]: audit 2024-09-16T06:27:22.636468+0000 mon.b (mon.2) 245 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:27:23.327 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:27:22 smithi047 bash[22744]: audit 2024-09-16T06:27:22.639095+0000 mgr.a (mgr.14373) 2179 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:27:23.590 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 06:27:23 smithi047 bash[22994]: debug 2024-09-16T06:27:23.325+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T06:27:23.590 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 06:27:23 smithi047 bash[22994]: debug 2024-09-16T06:27:23.325+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T06:27:24.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:27:23 smithi157 bash[24585]: audit 2024-09-16T06:27:23.327979+0000 mgr.a (mgr.14373) 2180 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T06:27:24.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:27:23 smithi157 bash[24585]: cephadm 2024-09-16T06:27:23.329941+0000 mgr.a (mgr.14373) 2181 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T06:27:24.305 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:27:23 smithi157 bash[24585]: cluster 2024-09-16T06:27:23.756983+0000 mgr.a (mgr.14373) 2182 : cluster [DBG] pgmap v1511: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:27:24.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:27:23 smithi086 bash[24289]: audit 2024-09-16T06:27:23.327979+0000 mgr.a (mgr.14373) 2180 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T06:27:24.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:27:23 smithi086 bash[24289]: cephadm 2024-09-16T06:27:23.329941+0000 mgr.a (mgr.14373) 2181 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T06:27:24.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:27:23 smithi086 bash[24289]: cluster 2024-09-16T06:27:23.756983+0000 mgr.a (mgr.14373) 2182 : cluster [DBG] pgmap v1511: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:27:24.340 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:27:23 smithi047 bash[22744]: audit 2024-09-16T06:27:23.327979+0000 mgr.a (mgr.14373) 2180 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T06:27:24.340 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:27:23 smithi047 bash[22744]: cephadm 2024-09-16T06:27:23.329941+0000 mgr.a (mgr.14373) 2181 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T06:27:24.340 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:27:23 smithi047 bash[22744]: cluster 2024-09-16T06:27:23.756983+0000 mgr.a (mgr.14373) 2182 : cluster [DBG] pgmap v1511: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:27:27.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:27:26 smithi086 bash[24289]: cluster 2024-09-16T06:27:25.757768+0000 mgr.a (mgr.14373) 2183 : cluster [DBG] pgmap v1512: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T06:27:27.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:27:26 smithi047 bash[22744]: cluster 2024-09-16T06:27:25.757768+0000 mgr.a (mgr.14373) 2183 : cluster [DBG] pgmap v1512: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T06:27:27.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:27:26 smithi157 bash[24585]: cluster 2024-09-16T06:27:25.757768+0000 mgr.a (mgr.14373) 2183 : cluster [DBG] pgmap v1512: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T06:27:27.596 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:27:27.597 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:27:27.598 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:27:28.377 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:27:28.377 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:27:28.377 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:27:28.378 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:27:28.378 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:27:29.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:27:28 smithi086 bash[24289]: cluster 2024-09-16T06:27:27.759973+0000 mgr.a (mgr.14373) 2184 : cluster [DBG] pgmap v1513: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:27:29.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:27:28 smithi086 bash[24289]: audit 2024-09-16T06:27:27.935088+0000 mgr.a (mgr.14373) 2185 : audit [DBG] from='client.59415 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:27:29.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:27:28 smithi047 bash[22744]: cluster 2024-09-16T06:27:27.759973+0000 mgr.a (mgr.14373) 2184 : cluster [DBG] pgmap v1513: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:27:29.090 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:27:28 smithi047 bash[22744]: audit 2024-09-16T06:27:27.935088+0000 mgr.a (mgr.14373) 2185 : audit [DBG] from='client.59415 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:27:29.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:27:28 smithi157 bash[24585]: cluster 2024-09-16T06:27:27.759973+0000 mgr.a (mgr.14373) 2184 : cluster [DBG] pgmap v1513: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:27:29.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:27:28 smithi157 bash[24585]: audit 2024-09-16T06:27:27.935088+0000 mgr.a (mgr.14373) 2185 : audit [DBG] from='client.59415 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:27:31.090 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:27:30 smithi047 bash[22744]: cluster 2024-09-16T06:27:29.760936+0000 mgr.a (mgr.14373) 2186 : cluster [DBG] pgmap v1514: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:27:31.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:27:30 smithi157 bash[24585]: cluster 2024-09-16T06:27:29.760936+0000 mgr.a (mgr.14373) 2186 : cluster [DBG] pgmap v1514: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:27:31.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:27:30 smithi086 bash[24289]: cluster 2024-09-16T06:27:29.760936+0000 mgr.a (mgr.14373) 2186 : cluster [DBG] pgmap v1514: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:27:33.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:27:32 smithi047 bash[22744]: cluster 2024-09-16T06:27:31.763159+0000 mgr.a (mgr.14373) 2187 : cluster [DBG] pgmap v1515: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:27:33.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:27:32 smithi157 bash[24585]: cluster 2024-09-16T06:27:31.763159+0000 mgr.a (mgr.14373) 2187 : cluster [DBG] pgmap v1515: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:27:33.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:27:32 smithi086 bash[24289]: cluster 2024-09-16T06:27:31.763159+0000 mgr.a (mgr.14373) 2187 : cluster [DBG] pgmap v1515: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:27:33.379 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:27:33.379 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:27:33.380 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:27:34.136 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:27:34.136 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:27:34.136 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:27:34.136 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:27:34.136 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:27:35.090 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:27:34 smithi047 bash[22744]: audit 2024-09-16T06:27:33.714809+0000 mgr.a (mgr.14373) 2188 : audit [DBG] from='client.59493 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:27:35.090 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:27:34 smithi047 bash[22744]: cluster 2024-09-16T06:27:33.764150+0000 mgr.a (mgr.14373) 2189 : cluster [DBG] pgmap v1516: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:27:35.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:27:34 smithi157 bash[24585]: audit 2024-09-16T06:27:33.714809+0000 mgr.a (mgr.14373) 2188 : audit [DBG] from='client.59493 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:27:35.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:27:34 smithi157 bash[24585]: cluster 2024-09-16T06:27:33.764150+0000 mgr.a (mgr.14373) 2189 : cluster [DBG] pgmap v1516: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:27:35.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:27:34 smithi086 bash[24289]: audit 2024-09-16T06:27:33.714809+0000 mgr.a (mgr.14373) 2188 : audit [DBG] from='client.59493 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:27:35.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:27:34 smithi086 bash[24289]: cluster 2024-09-16T06:27:33.764150+0000 mgr.a (mgr.14373) 2189 : cluster [DBG] pgmap v1516: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:27:37.090 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:27:36 smithi047 bash[22744]: cluster 2024-09-16T06:27:35.765188+0000 mgr.a (mgr.14373) 2190 : cluster [DBG] pgmap v1517: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:27:37.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:27:36 smithi157 bash[24585]: cluster 2024-09-16T06:27:35.765188+0000 mgr.a (mgr.14373) 2190 : cluster [DBG] pgmap v1517: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:27:37.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:27:36 smithi086 bash[24289]: cluster 2024-09-16T06:27:35.765188+0000 mgr.a (mgr.14373) 2190 : cluster [DBG] pgmap v1517: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:27:39.090 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:27:38 smithi047 bash[22744]: cluster 2024-09-16T06:27:37.767637+0000 mgr.a (mgr.14373) 2191 : cluster [DBG] pgmap v1518: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:27:39.137 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:27:39.138 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:27:39.138 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:27:39.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:27:38 smithi157 bash[24585]: cluster 2024-09-16T06:27:37.767637+0000 mgr.a (mgr.14373) 2191 : cluster [DBG] pgmap v1518: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:27:39.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:27:38 smithi086 bash[24289]: cluster 2024-09-16T06:27:37.767637+0000 mgr.a (mgr.14373) 2191 : cluster [DBG] pgmap v1518: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:27:39.885 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:27:39.886 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:27:39.886 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:27:39.886 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:27:39.886 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:27:41.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:27:40 smithi157 bash[24585]: audit 2024-09-16T06:27:39.466751+0000 mgr.a (mgr.14373) 2192 : audit [DBG] from='client.59568 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:27:41.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:27:40 smithi157 bash[24585]: cluster 2024-09-16T06:27:39.768141+0000 mgr.a (mgr.14373) 2193 : cluster [DBG] pgmap v1519: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:27:41.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:27:40 smithi086 bash[24289]: audit 2024-09-16T06:27:39.466751+0000 mgr.a (mgr.14373) 2192 : audit [DBG] from='client.59568 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:27:41.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:27:40 smithi086 bash[24289]: cluster 2024-09-16T06:27:39.768141+0000 mgr.a (mgr.14373) 2193 : cluster [DBG] pgmap v1519: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:27:41.340 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:27:40 smithi047 bash[22744]: audit 2024-09-16T06:27:39.466751+0000 mgr.a (mgr.14373) 2192 : audit [DBG] from='client.59568 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:27:41.340 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:27:40 smithi047 bash[22744]: cluster 2024-09-16T06:27:39.768141+0000 mgr.a (mgr.14373) 2193 : cluster [DBG] pgmap v1519: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:27:43.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:27:42 smithi157 bash[24585]: cluster 2024-09-16T06:27:41.770388+0000 mgr.a (mgr.14373) 2194 : cluster [DBG] pgmap v1520: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:27:43.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:27:42 smithi086 bash[24289]: cluster 2024-09-16T06:27:41.770388+0000 mgr.a (mgr.14373) 2194 : cluster [DBG] pgmap v1520: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:27:43.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:27:42 smithi047 bash[22744]: cluster 2024-09-16T06:27:41.770388+0000 mgr.a (mgr.14373) 2194 : cluster [DBG] pgmap v1520: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:27:44.889 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:27:44.889 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:27:44.889 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:27:45.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:27:44 smithi157 bash[24585]: cluster 2024-09-16T06:27:43.771146+0000 mgr.a (mgr.14373) 2195 : cluster [DBG] pgmap v1521: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:27:45.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:27:44 smithi086 bash[24289]: cluster 2024-09-16T06:27:43.771146+0000 mgr.a (mgr.14373) 2195 : cluster [DBG] pgmap v1521: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:27:45.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:27:44 smithi047 bash[22744]: cluster 2024-09-16T06:27:43.771146+0000 mgr.a (mgr.14373) 2195 : cluster [DBG] pgmap v1521: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:27:45.658 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:27:45.658 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:27:45.658 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:27:45.658 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:27:45.658 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:27:47.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:27:46 smithi157 bash[24585]: audit 2024-09-16T06:27:45.226254+0000 mgr.a (mgr.14373) 2196 : audit [DBG] from='client.59646 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:27:47.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:27:46 smithi157 bash[24585]: cluster 2024-09-16T06:27:45.772730+0000 mgr.a (mgr.14373) 2197 : cluster [DBG] pgmap v1522: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:27:47.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:27:46 smithi086 bash[24289]: audit 2024-09-16T06:27:45.226254+0000 mgr.a (mgr.14373) 2196 : audit [DBG] from='client.59646 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:27:47.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:27:46 smithi086 bash[24289]: cluster 2024-09-16T06:27:45.772730+0000 mgr.a (mgr.14373) 2197 : cluster [DBG] pgmap v1522: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:27:47.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:27:46 smithi047 bash[22744]: audit 2024-09-16T06:27:45.226254+0000 mgr.a (mgr.14373) 2196 : audit [DBG] from='client.59646 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:27:47.340 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:27:46 smithi047 bash[22744]: cluster 2024-09-16T06:27:45.772730+0000 mgr.a (mgr.14373) 2197 : cluster [DBG] pgmap v1522: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:27:49.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:27:48 smithi157 bash[24585]: cluster 2024-09-16T06:27:47.775057+0000 mgr.a (mgr.14373) 2198 : cluster [DBG] pgmap v1523: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:27:49.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:27:48 smithi086 bash[24289]: cluster 2024-09-16T06:27:47.775057+0000 mgr.a (mgr.14373) 2198 : cluster [DBG] pgmap v1523: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:27:49.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:27:48 smithi047 bash[22744]: cluster 2024-09-16T06:27:47.775057+0000 mgr.a (mgr.14373) 2198 : cluster [DBG] pgmap v1523: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:27:50.659 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:27:50.660 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:27:50.660 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:27:51.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:27:50 smithi157 bash[24585]: cluster 2024-09-16T06:27:49.775835+0000 mgr.a (mgr.14373) 2199 : cluster [DBG] pgmap v1524: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:27:51.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:27:50 smithi086 bash[24289]: cluster 2024-09-16T06:27:49.775835+0000 mgr.a (mgr.14373) 2199 : cluster [DBG] pgmap v1524: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:27:51.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:27:50 smithi047 bash[22744]: cluster 2024-09-16T06:27:49.775835+0000 mgr.a (mgr.14373) 2199 : cluster [DBG] pgmap v1524: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:27:51.440 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:27:51.441 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:27:51.441 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:27:51.441 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:27:51.441 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:27:53.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:27:52 smithi157 bash[24585]: audit 2024-09-16T06:27:51.000798+0000 mgr.a (mgr.14373) 2200 : audit [DBG] from='client.59721 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:27:53.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:27:52 smithi157 bash[24585]: cluster 2024-09-16T06:27:51.778608+0000 mgr.a (mgr.14373) 2201 : cluster [DBG] pgmap v1525: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-16T06:27:53.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:27:52 smithi086 bash[24289]: audit 2024-09-16T06:27:51.000798+0000 mgr.a (mgr.14373) 2200 : audit [DBG] from='client.59721 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:27:53.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:27:52 smithi086 bash[24289]: cluster 2024-09-16T06:27:51.778608+0000 mgr.a (mgr.14373) 2201 : cluster [DBG] pgmap v1525: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-16T06:27:53.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:27:52 smithi047 bash[22744]: audit 2024-09-16T06:27:51.000798+0000 mgr.a (mgr.14373) 2200 : audit [DBG] from='client.59721 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:27:53.340 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:27:52 smithi047 bash[22744]: cluster 2024-09-16T06:27:51.778608+0000 mgr.a (mgr.14373) 2201 : cluster [DBG] pgmap v1525: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-16T06:27:55.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:27:54 smithi157 bash[24585]: cluster 2024-09-16T06:27:53.779368+0000 mgr.a (mgr.14373) 2202 : cluster [DBG] pgmap v1526: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T06:27:55.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:27:54 smithi086 bash[24289]: cluster 2024-09-16T06:27:53.779368+0000 mgr.a (mgr.14373) 2202 : cluster [DBG] pgmap v1526: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T06:27:55.340 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:27:54 smithi047 bash[22744]: cluster 2024-09-16T06:27:53.779368+0000 mgr.a (mgr.14373) 2202 : cluster [DBG] pgmap v1526: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T06:27:56.442 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:27:56.442 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:27:56.443 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:27:57.184 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:27:57.184 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:27:57.184 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:27:57.184 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:27:57.184 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:27:57.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:27:56 smithi157 bash[24585]: cluster 2024-09-16T06:27:55.780155+0000 mgr.a (mgr.14373) 2203 : cluster [DBG] pgmap v1527: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T06:27:57.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:27:56 smithi086 bash[24289]: cluster 2024-09-16T06:27:55.780155+0000 mgr.a (mgr.14373) 2203 : cluster [DBG] pgmap v1527: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T06:27:57.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:27:56 smithi047 bash[22744]: cluster 2024-09-16T06:27:55.780155+0000 mgr.a (mgr.14373) 2203 : cluster [DBG] pgmap v1527: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T06:27:58.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:27:57 smithi157 bash[24585]: audit 2024-09-16T06:27:56.771775+0000 mgr.a (mgr.14373) 2204 : audit [DBG] from='client.59796 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:27:58.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:27:57 smithi086 bash[24289]: audit 2024-09-16T06:27:56.771775+0000 mgr.a (mgr.14373) 2204 : audit [DBG] from='client.59796 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:27:58.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:27:57 smithi047 bash[22744]: audit 2024-09-16T06:27:56.771775+0000 mgr.a (mgr.14373) 2204 : audit [DBG] from='client.59796 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:27:59.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:27:58 smithi157 bash[24585]: cluster 2024-09-16T06:27:57.783026+0000 mgr.a (mgr.14373) 2205 : cluster [DBG] pgmap v1528: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:27:59.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:27:58 smithi086 bash[24289]: cluster 2024-09-16T06:27:57.783026+0000 mgr.a (mgr.14373) 2205 : cluster [DBG] pgmap v1528: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:27:59.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:27:58 smithi047 bash[22744]: cluster 2024-09-16T06:27:57.783026+0000 mgr.a (mgr.14373) 2205 : cluster [DBG] pgmap v1528: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:28:01.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:28:00 smithi157 bash[24585]: cluster 2024-09-16T06:27:59.783832+0000 mgr.a (mgr.14373) 2206 : cluster [DBG] pgmap v1529: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:28:01.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:28:00 smithi086 bash[24289]: cluster 2024-09-16T06:27:59.783832+0000 mgr.a (mgr.14373) 2206 : cluster [DBG] pgmap v1529: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:28:01.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:28:00 smithi047 bash[22744]: cluster 2024-09-16T06:27:59.783832+0000 mgr.a (mgr.14373) 2206 : cluster [DBG] pgmap v1529: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:28:02.185 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:28:02.186 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:28:02.186 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:28:02.954 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:28:02.954 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:28:02.955 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:28:02.955 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:28:02.955 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:28:03.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:28:02 smithi157 bash[24585]: cluster 2024-09-16T06:28:01.785785+0000 mgr.a (mgr.14373) 2207 : cluster [DBG] pgmap v1530: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:28:03.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:28:02 smithi086 bash[24289]: cluster 2024-09-16T06:28:01.785785+0000 mgr.a (mgr.14373) 2207 : cluster [DBG] pgmap v1530: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:28:03.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:28:02 smithi047 bash[22744]: cluster 2024-09-16T06:28:01.785785+0000 mgr.a (mgr.14373) 2207 : cluster [DBG] pgmap v1530: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:28:04.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:28:03 smithi157 bash[24585]: audit 2024-09-16T06:28:02.522946+0000 mgr.a (mgr.14373) 2208 : audit [DBG] from='client.59874 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:28:04.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:28:03 smithi086 bash[24289]: audit 2024-09-16T06:28:02.522946+0000 mgr.a (mgr.14373) 2208 : audit [DBG] from='client.59874 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:28:04.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:28:03 smithi047 bash[22744]: audit 2024-09-16T06:28:02.522946+0000 mgr.a (mgr.14373) 2208 : audit [DBG] from='client.59874 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:28:05.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:28:04 smithi157 bash[24585]: cluster 2024-09-16T06:28:03.786790+0000 mgr.a (mgr.14373) 2209 : cluster [DBG] pgmap v1531: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-16T06:28:05.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:28:04 smithi086 bash[24289]: cluster 2024-09-16T06:28:03.786790+0000 mgr.a (mgr.14373) 2209 : cluster [DBG] pgmap v1531: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-16T06:28:05.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:28:04 smithi047 bash[22744]: cluster 2024-09-16T06:28:03.786790+0000 mgr.a (mgr.14373) 2209 : cluster [DBG] pgmap v1531: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-16T06:28:07.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:28:06 smithi157 bash[24585]: cluster 2024-09-16T06:28:05.787576+0000 mgr.a (mgr.14373) 2210 : cluster [DBG] pgmap v1532: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-16T06:28:07.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:28:06 smithi086 bash[24289]: cluster 2024-09-16T06:28:05.787576+0000 mgr.a (mgr.14373) 2210 : cluster [DBG] pgmap v1532: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-16T06:28:07.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:28:06 smithi047 bash[22744]: cluster 2024-09-16T06:28:05.787576+0000 mgr.a (mgr.14373) 2210 : cluster [DBG] pgmap v1532: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-16T06:28:07.956 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:28:07.956 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:28:07.956 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:28:08.716 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:28:08.717 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:28:08.717 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:28:08.717 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:28:08.717 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:28:09.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:28:08 smithi157 bash[24585]: cluster 2024-09-16T06:28:07.789798+0000 mgr.a (mgr.14373) 2211 : cluster [DBG] pgmap v1533: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 33 KiB/s rd, 0 B/s wr, 53 op/s 2024-09-16T06:28:09.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:28:08 smithi086 bash[24289]: cluster 2024-09-16T06:28:07.789798+0000 mgr.a (mgr.14373) 2211 : cluster [DBG] pgmap v1533: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 33 KiB/s rd, 0 B/s wr, 53 op/s 2024-09-16T06:28:09.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:28:08 smithi047 bash[22744]: cluster 2024-09-16T06:28:07.789798+0000 mgr.a (mgr.14373) 2211 : cluster [DBG] pgmap v1533: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 33 KiB/s rd, 0 B/s wr, 53 op/s 2024-09-16T06:28:10.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:28:09 smithi157 bash[24585]: audit 2024-09-16T06:28:08.287671+0000 mgr.a (mgr.14373) 2212 : audit [DBG] from='client.59952 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:28:10.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:28:09 smithi086 bash[24289]: audit 2024-09-16T06:28:08.287671+0000 mgr.a (mgr.14373) 2212 : audit [DBG] from='client.59952 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:28:10.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:28:09 smithi047 bash[22744]: audit 2024-09-16T06:28:08.287671+0000 mgr.a (mgr.14373) 2212 : audit [DBG] from='client.59952 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:28:11.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:28:10 smithi157 bash[24585]: cluster 2024-09-16T06:28:09.790796+0000 mgr.a (mgr.14373) 2213 : cluster [DBG] pgmap v1534: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 33 KiB/s rd, 0 B/s wr, 53 op/s 2024-09-16T06:28:11.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:28:10 smithi086 bash[24289]: cluster 2024-09-16T06:28:09.790796+0000 mgr.a (mgr.14373) 2213 : cluster [DBG] pgmap v1534: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 33 KiB/s rd, 0 B/s wr, 53 op/s 2024-09-16T06:28:11.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:28:10 smithi047 bash[22744]: cluster 2024-09-16T06:28:09.790796+0000 mgr.a (mgr.14373) 2213 : cluster [DBG] pgmap v1534: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 33 KiB/s rd, 0 B/s wr, 53 op/s 2024-09-16T06:28:13.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:28:12 smithi157 bash[24585]: cluster 2024-09-16T06:28:11.793087+0000 mgr.a (mgr.14373) 2214 : cluster [DBG] pgmap v1535: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 70 KiB/s rd, 0 B/s wr, 114 op/s 2024-09-16T06:28:13.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:28:12 smithi086 bash[24289]: cluster 2024-09-16T06:28:11.793087+0000 mgr.a (mgr.14373) 2214 : cluster [DBG] pgmap v1535: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 70 KiB/s rd, 0 B/s wr, 114 op/s 2024-09-16T06:28:13.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:28:12 smithi047 bash[22744]: cluster 2024-09-16T06:28:11.793087+0000 mgr.a (mgr.14373) 2214 : cluster [DBG] pgmap v1535: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 70 KiB/s rd, 0 B/s wr, 114 op/s 2024-09-16T06:28:13.718 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:28:13.719 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:28:13.719 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:28:14.467 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:28:14.467 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:28:14.467 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:28:14.467 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:28:14.467 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:28:15.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:28:14 smithi157 bash[24585]: cluster 2024-09-16T06:28:13.794063+0000 mgr.a (mgr.14373) 2215 : cluster [DBG] pgmap v1536: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 69 KiB/s rd, 0 B/s wr, 114 op/s 2024-09-16T06:28:15.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:28:14 smithi086 bash[24289]: cluster 2024-09-16T06:28:13.794063+0000 mgr.a (mgr.14373) 2215 : cluster [DBG] pgmap v1536: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 69 KiB/s rd, 0 B/s wr, 114 op/s 2024-09-16T06:28:15.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:28:14 smithi047 bash[22744]: cluster 2024-09-16T06:28:13.794063+0000 mgr.a (mgr.14373) 2215 : cluster [DBG] pgmap v1536: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 69 KiB/s rd, 0 B/s wr, 114 op/s 2024-09-16T06:28:16.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:28:15 smithi157 bash[24585]: audit 2024-09-16T06:28:14.056390+0000 mgr.a (mgr.14373) 2216 : audit [DBG] from='client.60030 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:28:16.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:28:15 smithi086 bash[24289]: audit 2024-09-16T06:28:14.056390+0000 mgr.a (mgr.14373) 2216 : audit [DBG] from='client.60030 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:28:16.340 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:28:15 smithi047 bash[22744]: audit 2024-09-16T06:28:14.056390+0000 mgr.a (mgr.14373) 2216 : audit [DBG] from='client.60030 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:28:17.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:28:16 smithi157 bash[24585]: cluster 2024-09-16T06:28:15.795102+0000 mgr.a (mgr.14373) 2217 : cluster [DBG] pgmap v1537: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 69 KiB/s rd, 0 B/s wr, 114 op/s 2024-09-16T06:28:17.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:28:16 smithi086 bash[24289]: cluster 2024-09-16T06:28:15.795102+0000 mgr.a (mgr.14373) 2217 : cluster [DBG] pgmap v1537: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 69 KiB/s rd, 0 B/s wr, 114 op/s 2024-09-16T06:28:17.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:28:16 smithi047 bash[22744]: cluster 2024-09-16T06:28:15.795102+0000 mgr.a (mgr.14373) 2217 : cluster [DBG] pgmap v1537: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 69 KiB/s rd, 0 B/s wr, 114 op/s 2024-09-16T06:28:19.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:28:18 smithi157 bash[24585]: cluster 2024-09-16T06:28:17.797332+0000 mgr.a (mgr.14373) 2218 : cluster [DBG] pgmap v1538: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 70 KiB/s rd, 0 B/s wr, 114 op/s 2024-09-16T06:28:19.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:28:18 smithi086 bash[24289]: cluster 2024-09-16T06:28:17.797332+0000 mgr.a (mgr.14373) 2218 : cluster [DBG] pgmap v1538: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 70 KiB/s rd, 0 B/s wr, 114 op/s 2024-09-16T06:28:19.340 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:28:18 smithi047 bash[22744]: cluster 2024-09-16T06:28:17.797332+0000 mgr.a (mgr.14373) 2218 : cluster [DBG] pgmap v1538: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 70 KiB/s rd, 0 B/s wr, 114 op/s 2024-09-16T06:28:19.468 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:28:19.469 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:28:19.469 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:28:20.230 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:28:20.231 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:28:20.231 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:28:20.231 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:28:20.231 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:28:21.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:28:20 smithi157 bash[24585]: cluster 2024-09-16T06:28:19.798076+0000 mgr.a (mgr.14373) 2219 : cluster [DBG] pgmap v1539: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 38 KiB/s rd, 0 B/s wr, 62 op/s 2024-09-16T06:28:21.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:28:20 smithi157 bash[24585]: audit 2024-09-16T06:28:19.804254+0000 mgr.a (mgr.14373) 2220 : audit [DBG] from='client.60105 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:28:21.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:28:20 smithi086 bash[24289]: cluster 2024-09-16T06:28:19.798076+0000 mgr.a (mgr.14373) 2219 : cluster [DBG] pgmap v1539: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 38 KiB/s rd, 0 B/s wr, 62 op/s 2024-09-16T06:28:21.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:28:20 smithi086 bash[24289]: audit 2024-09-16T06:28:19.804254+0000 mgr.a (mgr.14373) 2220 : audit [DBG] from='client.60105 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:28:21.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:28:20 smithi047 bash[22744]: cluster 2024-09-16T06:28:19.798076+0000 mgr.a (mgr.14373) 2219 : cluster [DBG] pgmap v1539: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 38 KiB/s rd, 0 B/s wr, 62 op/s 2024-09-16T06:28:21.340 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:28:20 smithi047 bash[22744]: audit 2024-09-16T06:28:19.804254+0000 mgr.a (mgr.14373) 2220 : audit [DBG] from='client.60105 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:28:23.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:28:22 smithi157 bash[24585]: cluster 2024-09-16T06:28:21.800421+0000 mgr.a (mgr.14373) 2221 : cluster [DBG] pgmap v1540: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 39 KiB/s rd, 0 B/s wr, 63 op/s 2024-09-16T06:28:23.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:28:22 smithi086 bash[24289]: cluster 2024-09-16T06:28:21.800421+0000 mgr.a (mgr.14373) 2221 : cluster [DBG] pgmap v1540: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 39 KiB/s rd, 0 B/s wr, 63 op/s 2024-09-16T06:28:23.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:28:22 smithi047 bash[22744]: cluster 2024-09-16T06:28:21.800421+0000 mgr.a (mgr.14373) 2221 : cluster [DBG] pgmap v1540: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 39 KiB/s rd, 0 B/s wr, 63 op/s 2024-09-16T06:28:24.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:28:23 smithi157 bash[24585]: audit 2024-09-16T06:28:23.382449+0000 mon.b (mon.2) 246 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T06:28:24.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:28:23 smithi086 bash[24289]: audit 2024-09-16T06:28:23.382449+0000 mon.b (mon.2) 246 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T06:28:24.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:28:23 smithi047 bash[22744]: audit 2024-09-16T06:28:23.382449+0000 mon.b (mon.2) 246 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T06:28:25.232 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:28:25.236 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:28:25.236 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:28:25.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:28:24 smithi157 bash[24585]: cluster 2024-09-16T06:28:23.801156+0000 mgr.a (mgr.14373) 2222 : cluster [DBG] pgmap v1541: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:28:25.305 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:28:24 smithi157 bash[24585]: audit 2024-09-16T06:28:24.246688+0000 mon.b (mon.2) 247 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T06:28:25.305 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:28:24 smithi157 bash[24585]: audit 2024-09-16T06:28:24.248555+0000 mon.b (mon.2) 248 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T06:28:25.305 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:28:24 smithi157 bash[24585]: audit 2024-09-16T06:28:24.260201+0000 mon.a (mon.0) 698 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:28:25.305 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:28:24 smithi157 bash[24585]: audit 2024-09-16T06:28:24.265582+0000 mon.b (mon.2) 249 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:28:25.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:28:24 smithi086 bash[24289]: cluster 2024-09-16T06:28:23.801156+0000 mgr.a (mgr.14373) 2222 : cluster [DBG] pgmap v1541: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:28:25.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:28:24 smithi086 bash[24289]: audit 2024-09-16T06:28:24.246688+0000 mon.b (mon.2) 247 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T06:28:25.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:28:24 smithi086 bash[24289]: audit 2024-09-16T06:28:24.248555+0000 mon.b (mon.2) 248 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T06:28:25.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:28:24 smithi086 bash[24289]: audit 2024-09-16T06:28:24.260201+0000 mon.a (mon.0) 698 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:28:25.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:28:24 smithi086 bash[24289]: audit 2024-09-16T06:28:24.265582+0000 mon.b (mon.2) 249 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:28:25.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:28:24 smithi047 bash[22744]: cluster 2024-09-16T06:28:23.801156+0000 mgr.a (mgr.14373) 2222 : cluster [DBG] pgmap v1541: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:28:25.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:28:24 smithi047 bash[22744]: audit 2024-09-16T06:28:24.246688+0000 mon.b (mon.2) 247 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T06:28:25.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:28:24 smithi047 bash[22744]: audit 2024-09-16T06:28:24.248555+0000 mon.b (mon.2) 248 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T06:28:25.340 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:28:24 smithi047 bash[22744]: audit 2024-09-16T06:28:24.260201+0000 mon.a (mon.0) 698 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:28:25.340 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:28:24 smithi047 bash[22744]: audit 2024-09-16T06:28:24.265582+0000 mon.b (mon.2) 249 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:28:25.340 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 06:28:25 smithi047 bash[22994]: debug 2024-09-16T06:28:25.000+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T06:28:25.340 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 06:28:25 smithi047 bash[22994]: debug 2024-09-16T06:28:25.000+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T06:28:25.975 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:28:25.975 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:28:25.975 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:28:25.975 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:28:25.975 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:28:26.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:28:25 smithi157 bash[24585]: audit 2024-09-16T06:28:24.269426+0000 mgr.a (mgr.14373) 2223 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:28:26.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:28:25 smithi086 bash[24289]: audit 2024-09-16T06:28:24.269426+0000 mgr.a (mgr.14373) 2223 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:28:26.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:28:25 smithi047 bash[22744]: audit 2024-09-16T06:28:24.269426+0000 mgr.a (mgr.14373) 2223 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:28:27.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:28:26 smithi157 bash[24585]: audit 2024-09-16T06:28:25.003512+0000 mgr.a (mgr.14373) 2224 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T06:28:27.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:28:26 smithi157 bash[24585]: cephadm 2024-09-16T06:28:25.005871+0000 mgr.a (mgr.14373) 2225 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T06:28:27.305 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:28:26 smithi157 bash[24585]: audit 2024-09-16T06:28:25.566603+0000 mgr.a (mgr.14373) 2226 : audit [DBG] from='client.60285 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:28:27.305 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:28:26 smithi157 bash[24585]: cluster 2024-09-16T06:28:25.801722+0000 mgr.a (mgr.14373) 2227 : cluster [DBG] pgmap v1542: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:28:27.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:28:26 smithi086 bash[24289]: audit 2024-09-16T06:28:25.003512+0000 mgr.a (mgr.14373) 2224 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T06:28:27.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:28:26 smithi086 bash[24289]: cephadm 2024-09-16T06:28:25.005871+0000 mgr.a (mgr.14373) 2225 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T06:28:27.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:28:26 smithi086 bash[24289]: audit 2024-09-16T06:28:25.566603+0000 mgr.a (mgr.14373) 2226 : audit [DBG] from='client.60285 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:28:27.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:28:26 smithi086 bash[24289]: cluster 2024-09-16T06:28:25.801722+0000 mgr.a (mgr.14373) 2227 : cluster [DBG] pgmap v1542: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:28:27.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:28:26 smithi047 bash[22744]: audit 2024-09-16T06:28:25.003512+0000 mgr.a (mgr.14373) 2224 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T06:28:27.340 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:28:26 smithi047 bash[22744]: cephadm 2024-09-16T06:28:25.005871+0000 mgr.a (mgr.14373) 2225 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T06:28:27.340 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:28:26 smithi047 bash[22744]: audit 2024-09-16T06:28:25.566603+0000 mgr.a (mgr.14373) 2226 : audit [DBG] from='client.60285 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:28:27.340 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:28:26 smithi047 bash[22744]: cluster 2024-09-16T06:28:25.801722+0000 mgr.a (mgr.14373) 2227 : cluster [DBG] pgmap v1542: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:28:29.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:28:28 smithi157 bash[24585]: cluster 2024-09-16T06:28:27.804030+0000 mgr.a (mgr.14373) 2228 : cluster [DBG] pgmap v1543: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:28:29.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:28:28 smithi086 bash[24289]: cluster 2024-09-16T06:28:27.804030+0000 mgr.a (mgr.14373) 2228 : cluster [DBG] pgmap v1543: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:28:29.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:28:28 smithi047 bash[22744]: cluster 2024-09-16T06:28:27.804030+0000 mgr.a (mgr.14373) 2228 : cluster [DBG] pgmap v1543: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:28:30.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:28:30 smithi157 bash[24585]: cluster 2024-09-16T06:28:29.804817+0000 mgr.a (mgr.14373) 2229 : cluster [DBG] pgmap v1544: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:28:30.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:28:30 smithi086 bash[24289]: cluster 2024-09-16T06:28:29.804817+0000 mgr.a (mgr.14373) 2229 : cluster [DBG] pgmap v1544: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:28:30.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:28:30 smithi047 bash[22744]: cluster 2024-09-16T06:28:29.804817+0000 mgr.a (mgr.14373) 2229 : cluster [DBG] pgmap v1544: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:28:30.976 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:28:30.977 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:28:30.977 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:28:31.730 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:28:31.730 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:28:31.730 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:28:31.730 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:28:31.730 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:28:33.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:28:32 smithi157 bash[24585]: audit 2024-09-16T06:28:31.311122+0000 mgr.a (mgr.14373) 2230 : audit [DBG] from='client.60363 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:28:33.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:28:32 smithi157 bash[24585]: cluster 2024-09-16T06:28:31.807726+0000 mgr.a (mgr.14373) 2231 : cluster [DBG] pgmap v1545: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:28:33.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:28:32 smithi086 bash[24289]: audit 2024-09-16T06:28:31.311122+0000 mgr.a (mgr.14373) 2230 : audit [DBG] from='client.60363 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:28:33.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:28:32 smithi086 bash[24289]: cluster 2024-09-16T06:28:31.807726+0000 mgr.a (mgr.14373) 2231 : cluster [DBG] pgmap v1545: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:28:33.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:28:32 smithi047 bash[22744]: audit 2024-09-16T06:28:31.311122+0000 mgr.a (mgr.14373) 2230 : audit [DBG] from='client.60363 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:28:33.340 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:28:32 smithi047 bash[22744]: cluster 2024-09-16T06:28:31.807726+0000 mgr.a (mgr.14373) 2231 : cluster [DBG] pgmap v1545: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:28:35.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:28:34 smithi157 bash[24585]: cluster 2024-09-16T06:28:33.808564+0000 mgr.a (mgr.14373) 2232 : cluster [DBG] pgmap v1546: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T06:28:35.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:28:34 smithi086 bash[24289]: cluster 2024-09-16T06:28:33.808564+0000 mgr.a (mgr.14373) 2232 : cluster [DBG] pgmap v1546: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T06:28:35.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:28:34 smithi047 bash[22744]: cluster 2024-09-16T06:28:33.808564+0000 mgr.a (mgr.14373) 2232 : cluster [DBG] pgmap v1546: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T06:28:36.731 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:28:36.732 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:28:36.732 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:28:37.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:28:36 smithi157 bash[24585]: cluster 2024-09-16T06:28:35.809321+0000 mgr.a (mgr.14373) 2233 : cluster [DBG] pgmap v1547: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T06:28:37.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:28:36 smithi086 bash[24289]: cluster 2024-09-16T06:28:35.809321+0000 mgr.a (mgr.14373) 2233 : cluster [DBG] pgmap v1547: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T06:28:37.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:28:36 smithi047 bash[22744]: cluster 2024-09-16T06:28:35.809321+0000 mgr.a (mgr.14373) 2233 : cluster [DBG] pgmap v1547: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T06:28:37.497 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:28:37.497 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:28:37.497 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:28:37.498 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:28:37.498 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:28:39.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:28:38 smithi157 bash[24585]: audit 2024-09-16T06:28:37.072039+0000 mgr.a (mgr.14373) 2234 : audit [DBG] from='client.60441 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:28:39.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:28:38 smithi157 bash[24585]: cluster 2024-09-16T06:28:37.812107+0000 mgr.a (mgr.14373) 2235 : cluster [DBG] pgmap v1548: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:28:39.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:28:38 smithi086 bash[24289]: audit 2024-09-16T06:28:37.072039+0000 mgr.a (mgr.14373) 2234 : audit [DBG] from='client.60441 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:28:39.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:28:38 smithi086 bash[24289]: cluster 2024-09-16T06:28:37.812107+0000 mgr.a (mgr.14373) 2235 : cluster [DBG] pgmap v1548: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:28:39.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:28:38 smithi047 bash[22744]: audit 2024-09-16T06:28:37.072039+0000 mgr.a (mgr.14373) 2234 : audit [DBG] from='client.60441 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:28:39.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:28:38 smithi047 bash[22744]: cluster 2024-09-16T06:28:37.812107+0000 mgr.a (mgr.14373) 2235 : cluster [DBG] pgmap v1548: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:28:41.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:28:40 smithi157 bash[24585]: cluster 2024-09-16T06:28:39.812925+0000 mgr.a (mgr.14373) 2236 : cluster [DBG] pgmap v1549: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:28:41.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:28:40 smithi086 bash[24289]: cluster 2024-09-16T06:28:39.812925+0000 mgr.a (mgr.14373) 2236 : cluster [DBG] pgmap v1549: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:28:41.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:28:40 smithi047 bash[22744]: cluster 2024-09-16T06:28:39.812925+0000 mgr.a (mgr.14373) 2236 : cluster [DBG] pgmap v1549: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:28:42.498 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:28:42.499 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:28:42.499 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:28:43.255 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:28:43.255 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:28:43.255 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:28:43.255 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:28:43.255 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:28:43.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:28:42 smithi157 bash[24585]: cluster 2024-09-16T06:28:41.814937+0000 mgr.a (mgr.14373) 2237 : cluster [DBG] pgmap v1550: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:28:43.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:28:42 smithi086 bash[24289]: cluster 2024-09-16T06:28:41.814937+0000 mgr.a (mgr.14373) 2237 : cluster [DBG] pgmap v1550: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:28:43.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:28:42 smithi047 bash[22744]: cluster 2024-09-16T06:28:41.814937+0000 mgr.a (mgr.14373) 2237 : cluster [DBG] pgmap v1550: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:28:44.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:28:43 smithi157 bash[24585]: audit 2024-09-16T06:28:42.831438+0000 mgr.a (mgr.14373) 2238 : audit [DBG] from='client.60519 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:28:44.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:28:43 smithi086 bash[24289]: audit 2024-09-16T06:28:42.831438+0000 mgr.a (mgr.14373) 2238 : audit [DBG] from='client.60519 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:28:44.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:28:43 smithi047 bash[22744]: audit 2024-09-16T06:28:42.831438+0000 mgr.a (mgr.14373) 2238 : audit [DBG] from='client.60519 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:28:45.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:28:44 smithi157 bash[24585]: cluster 2024-09-16T06:28:43.815905+0000 mgr.a (mgr.14373) 2239 : cluster [DBG] pgmap v1551: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:28:45.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:28:44 smithi086 bash[24289]: cluster 2024-09-16T06:28:43.815905+0000 mgr.a (mgr.14373) 2239 : cluster [DBG] pgmap v1551: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:28:45.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:28:44 smithi047 bash[22744]: cluster 2024-09-16T06:28:43.815905+0000 mgr.a (mgr.14373) 2239 : cluster [DBG] pgmap v1551: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:28:47.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:28:46 smithi157 bash[24585]: cluster 2024-09-16T06:28:45.816697+0000 mgr.a (mgr.14373) 2240 : cluster [DBG] pgmap v1552: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:28:47.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:28:46 smithi086 bash[24289]: cluster 2024-09-16T06:28:45.816697+0000 mgr.a (mgr.14373) 2240 : cluster [DBG] pgmap v1552: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:28:47.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:28:46 smithi047 bash[22744]: cluster 2024-09-16T06:28:45.816697+0000 mgr.a (mgr.14373) 2240 : cluster [DBG] pgmap v1552: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:28:48.256 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:28:48.257 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:28:48.257 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:28:49.019 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:28:49.020 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:28:49.020 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:28:49.020 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:28:49.020 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:28:49.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:28:48 smithi157 bash[24585]: cluster 2024-09-16T06:28:47.818986+0000 mgr.a (mgr.14373) 2241 : cluster [DBG] pgmap v1553: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:28:49.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:28:48 smithi086 bash[24289]: cluster 2024-09-16T06:28:47.818986+0000 mgr.a (mgr.14373) 2241 : cluster [DBG] pgmap v1553: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:28:49.340 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:28:48 smithi047 bash[22744]: cluster 2024-09-16T06:28:47.818986+0000 mgr.a (mgr.14373) 2241 : cluster [DBG] pgmap v1553: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:28:50.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:28:49 smithi157 bash[24585]: audit 2024-09-16T06:28:48.590154+0000 mgr.a (mgr.14373) 2242 : audit [DBG] from='client.60591 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:28:50.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:28:49 smithi086 bash[24289]: audit 2024-09-16T06:28:48.590154+0000 mgr.a (mgr.14373) 2242 : audit [DBG] from='client.60591 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:28:50.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:28:49 smithi047 bash[22744]: audit 2024-09-16T06:28:48.590154+0000 mgr.a (mgr.14373) 2242 : audit [DBG] from='client.60591 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:28:51.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:28:50 smithi157 bash[24585]: cluster 2024-09-16T06:28:49.819889+0000 mgr.a (mgr.14373) 2243 : cluster [DBG] pgmap v1554: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:28:51.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:28:50 smithi086 bash[24289]: cluster 2024-09-16T06:28:49.819889+0000 mgr.a (mgr.14373) 2243 : cluster [DBG] pgmap v1554: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:28:51.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:28:50 smithi047 bash[22744]: cluster 2024-09-16T06:28:49.819889+0000 mgr.a (mgr.14373) 2243 : cluster [DBG] pgmap v1554: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:28:53.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:28:52 smithi157 bash[24585]: cluster 2024-09-16T06:28:51.822027+0000 mgr.a (mgr.14373) 2244 : cluster [DBG] pgmap v1555: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:28:53.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:28:52 smithi086 bash[24289]: cluster 2024-09-16T06:28:51.822027+0000 mgr.a (mgr.14373) 2244 : cluster [DBG] pgmap v1555: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:28:53.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:28:52 smithi047 bash[22744]: cluster 2024-09-16T06:28:51.822027+0000 mgr.a (mgr.14373) 2244 : cluster [DBG] pgmap v1555: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:28:54.021 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:28:54.022 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:28:54.022 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:28:54.768 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:28:54.768 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:28:54.768 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:28:54.768 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:28:54.768 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:28:55.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:28:54 smithi157 bash[24585]: cluster 2024-09-16T06:28:53.822827+0000 mgr.a (mgr.14373) 2245 : cluster [DBG] pgmap v1556: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:28:55.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:28:54 smithi086 bash[24289]: cluster 2024-09-16T06:28:53.822827+0000 mgr.a (mgr.14373) 2245 : cluster [DBG] pgmap v1556: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:28:55.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:28:54 smithi047 bash[22744]: cluster 2024-09-16T06:28:53.822827+0000 mgr.a (mgr.14373) 2245 : cluster [DBG] pgmap v1556: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:28:56.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:28:55 smithi157 bash[24585]: audit 2024-09-16T06:28:54.353106+0000 mgr.a (mgr.14373) 2246 : audit [DBG] from='client.60669 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:28:56.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:28:55 smithi086 bash[24289]: audit 2024-09-16T06:28:54.353106+0000 mgr.a (mgr.14373) 2246 : audit [DBG] from='client.60669 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:28:56.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:28:55 smithi047 bash[22744]: audit 2024-09-16T06:28:54.353106+0000 mgr.a (mgr.14373) 2246 : audit [DBG] from='client.60669 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:28:57.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:28:56 smithi157 bash[24585]: cluster 2024-09-16T06:28:55.823717+0000 mgr.a (mgr.14373) 2247 : cluster [DBG] pgmap v1557: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:28:57.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:28:56 smithi086 bash[24289]: cluster 2024-09-16T06:28:55.823717+0000 mgr.a (mgr.14373) 2247 : cluster [DBG] pgmap v1557: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:28:57.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:28:56 smithi047 bash[22744]: cluster 2024-09-16T06:28:55.823717+0000 mgr.a (mgr.14373) 2247 : cluster [DBG] pgmap v1557: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:28:59.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:28:58 smithi157 bash[24585]: cluster 2024-09-16T06:28:57.825949+0000 mgr.a (mgr.14373) 2248 : cluster [DBG] pgmap v1558: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:28:59.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:28:58 smithi086 bash[24289]: cluster 2024-09-16T06:28:57.825949+0000 mgr.a (mgr.14373) 2248 : cluster [DBG] pgmap v1558: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:28:59.340 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:28:58 smithi047 bash[22744]: cluster 2024-09-16T06:28:57.825949+0000 mgr.a (mgr.14373) 2248 : cluster [DBG] pgmap v1558: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:28:59.769 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:28:59.770 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:28:59.770 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:29:00.523 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:29:00.524 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:29:00.524 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:29:00.524 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:29:00.524 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:29:01.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:29:00 smithi157 bash[24585]: cluster 2024-09-16T06:28:59.826819+0000 mgr.a (mgr.14373) 2249 : cluster [DBG] pgmap v1559: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:29:01.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:29:00 smithi086 bash[24289]: cluster 2024-09-16T06:28:59.826819+0000 mgr.a (mgr.14373) 2249 : cluster [DBG] pgmap v1559: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:29:01.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:29:00 smithi047 bash[22744]: cluster 2024-09-16T06:28:59.826819+0000 mgr.a (mgr.14373) 2249 : cluster [DBG] pgmap v1559: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:29:02.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:29:01 smithi157 bash[24585]: audit 2024-09-16T06:29:00.105381+0000 mgr.a (mgr.14373) 2250 : audit [DBG] from='client.60747 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:29:02.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:29:01 smithi086 bash[24289]: audit 2024-09-16T06:29:00.105381+0000 mgr.a (mgr.14373) 2250 : audit [DBG] from='client.60747 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:29:02.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:29:01 smithi047 bash[22744]: audit 2024-09-16T06:29:00.105381+0000 mgr.a (mgr.14373) 2250 : audit [DBG] from='client.60747 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:29:03.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:29:02 smithi157 bash[24585]: cluster 2024-09-16T06:29:01.829072+0000 mgr.a (mgr.14373) 2251 : cluster [DBG] pgmap v1560: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:29:03.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:29:02 smithi086 bash[24289]: cluster 2024-09-16T06:29:01.829072+0000 mgr.a (mgr.14373) 2251 : cluster [DBG] pgmap v1560: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:29:03.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:29:02 smithi047 bash[22744]: cluster 2024-09-16T06:29:01.829072+0000 mgr.a (mgr.14373) 2251 : cluster [DBG] pgmap v1560: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:29:05.305 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:29:04 smithi157 bash[24585]: cluster 2024-09-16T06:29:03.829822+0000 mgr.a (mgr.14373) 2252 : cluster [DBG] pgmap v1561: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:29:05.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:29:04 smithi086 bash[24289]: cluster 2024-09-16T06:29:03.829822+0000 mgr.a (mgr.14373) 2252 : cluster [DBG] pgmap v1561: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:29:05.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:29:04 smithi047 bash[22744]: cluster 2024-09-16T06:29:03.829822+0000 mgr.a (mgr.14373) 2252 : cluster [DBG] pgmap v1561: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:29:05.525 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:29:05.526 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:29:05.526 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:29:06.293 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:29:06.293 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:29:06.293 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:29:06.293 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:29:06.293 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:29:07.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:29:06 smithi157 bash[24585]: cluster 2024-09-16T06:29:05.830565+0000 mgr.a (mgr.14373) 2253 : cluster [DBG] pgmap v1562: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:29:07.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:29:06 smithi157 bash[24585]: audit 2024-09-16T06:29:05.866844+0000 mgr.a (mgr.14373) 2254 : audit [DBG] from='client.60825 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:29:07.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:29:06 smithi086 bash[24289]: cluster 2024-09-16T06:29:05.830565+0000 mgr.a (mgr.14373) 2253 : cluster [DBG] pgmap v1562: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:29:07.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:29:06 smithi086 bash[24289]: audit 2024-09-16T06:29:05.866844+0000 mgr.a (mgr.14373) 2254 : audit [DBG] from='client.60825 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:29:07.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:29:06 smithi047 bash[22744]: cluster 2024-09-16T06:29:05.830565+0000 mgr.a (mgr.14373) 2253 : cluster [DBG] pgmap v1562: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:29:07.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:29:06 smithi047 bash[22744]: audit 2024-09-16T06:29:05.866844+0000 mgr.a (mgr.14373) 2254 : audit [DBG] from='client.60825 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:29:09.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:29:08 smithi157 bash[24585]: cluster 2024-09-16T06:29:07.832903+0000 mgr.a (mgr.14373) 2255 : cluster [DBG] pgmap v1563: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:29:09.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:29:08 smithi086 bash[24289]: cluster 2024-09-16T06:29:07.832903+0000 mgr.a (mgr.14373) 2255 : cluster [DBG] pgmap v1563: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:29:09.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:29:08 smithi047 bash[22744]: cluster 2024-09-16T06:29:07.832903+0000 mgr.a (mgr.14373) 2255 : cluster [DBG] pgmap v1563: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:29:11.294 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:29:11.295 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:29:11.295 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:29:11.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:29:10 smithi157 bash[24585]: cluster 2024-09-16T06:29:09.833649+0000 mgr.a (mgr.14373) 2256 : cluster [DBG] pgmap v1564: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:29:11.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:29:10 smithi086 bash[24289]: cluster 2024-09-16T06:29:09.833649+0000 mgr.a (mgr.14373) 2256 : cluster [DBG] pgmap v1564: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:29:11.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:29:10 smithi047 bash[22744]: cluster 2024-09-16T06:29:09.833649+0000 mgr.a (mgr.14373) 2256 : cluster [DBG] pgmap v1564: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:29:12.050 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:29:12.051 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:29:12.051 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:29:12.051 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:29:12.051 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:29:13.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:29:12 smithi157 bash[24585]: audit 2024-09-16T06:29:11.630424+0000 mgr.a (mgr.14373) 2257 : audit [DBG] from='client.60903 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:29:13.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:29:12 smithi157 bash[24585]: cluster 2024-09-16T06:29:11.835039+0000 mgr.a (mgr.14373) 2258 : cluster [DBG] pgmap v1565: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:29:13.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:29:12 smithi086 bash[24289]: audit 2024-09-16T06:29:11.630424+0000 mgr.a (mgr.14373) 2257 : audit [DBG] from='client.60903 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:29:13.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:29:12 smithi086 bash[24289]: cluster 2024-09-16T06:29:11.835039+0000 mgr.a (mgr.14373) 2258 : cluster [DBG] pgmap v1565: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:29:13.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:29:12 smithi047 bash[22744]: audit 2024-09-16T06:29:11.630424+0000 mgr.a (mgr.14373) 2257 : audit [DBG] from='client.60903 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:29:13.340 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:29:12 smithi047 bash[22744]: cluster 2024-09-16T06:29:11.835039+0000 mgr.a (mgr.14373) 2258 : cluster [DBG] pgmap v1565: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:29:15.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:29:14 smithi157 bash[24585]: cluster 2024-09-16T06:29:13.835833+0000 mgr.a (mgr.14373) 2259 : cluster [DBG] pgmap v1566: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T06:29:15.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:29:14 smithi086 bash[24289]: cluster 2024-09-16T06:29:13.835833+0000 mgr.a (mgr.14373) 2259 : cluster [DBG] pgmap v1566: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T06:29:15.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:29:14 smithi047 bash[22744]: cluster 2024-09-16T06:29:13.835833+0000 mgr.a (mgr.14373) 2259 : cluster [DBG] pgmap v1566: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T06:29:17.052 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:29:17.052 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:29:17.053 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:29:17.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:29:16 smithi157 bash[24585]: cluster 2024-09-16T06:29:15.836595+0000 mgr.a (mgr.14373) 2260 : cluster [DBG] pgmap v1567: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T06:29:17.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:29:16 smithi086 bash[24289]: cluster 2024-09-16T06:29:15.836595+0000 mgr.a (mgr.14373) 2260 : cluster [DBG] pgmap v1567: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T06:29:17.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:29:16 smithi047 bash[22744]: cluster 2024-09-16T06:29:15.836595+0000 mgr.a (mgr.14373) 2260 : cluster [DBG] pgmap v1567: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T06:29:17.802 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:29:17.802 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:29:17.803 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:29:17.803 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:29:17.803 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:29:19.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:29:18 smithi157 bash[24585]: audit 2024-09-16T06:29:17.386221+0000 mgr.a (mgr.14373) 2261 : audit [DBG] from='client.60975 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:29:19.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:29:18 smithi157 bash[24585]: cluster 2024-09-16T06:29:17.837871+0000 mgr.a (mgr.14373) 2262 : cluster [DBG] pgmap v1568: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:29:19.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:29:18 smithi086 bash[24289]: audit 2024-09-16T06:29:17.386221+0000 mgr.a (mgr.14373) 2261 : audit [DBG] from='client.60975 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:29:19.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:29:18 smithi086 bash[24289]: cluster 2024-09-16T06:29:17.837871+0000 mgr.a (mgr.14373) 2262 : cluster [DBG] pgmap v1568: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:29:19.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:29:18 smithi047 bash[22744]: audit 2024-09-16T06:29:17.386221+0000 mgr.a (mgr.14373) 2261 : audit [DBG] from='client.60975 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:29:19.340 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:29:18 smithi047 bash[22744]: cluster 2024-09-16T06:29:17.837871+0000 mgr.a (mgr.14373) 2262 : cluster [DBG] pgmap v1568: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:29:21.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:29:20 smithi157 bash[24585]: cluster 2024-09-16T06:29:19.838616+0000 mgr.a (mgr.14373) 2263 : cluster [DBG] pgmap v1569: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T06:29:21.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:29:20 smithi086 bash[24289]: cluster 2024-09-16T06:29:19.838616+0000 mgr.a (mgr.14373) 2263 : cluster [DBG] pgmap v1569: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T06:29:21.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:29:20 smithi047 bash[22744]: cluster 2024-09-16T06:29:19.838616+0000 mgr.a (mgr.14373) 2263 : cluster [DBG] pgmap v1569: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T06:29:22.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:29:22 smithi157 bash[24585]: cluster 2024-09-16T06:29:21.840545+0000 mgr.a (mgr.14373) 2264 : cluster [DBG] pgmap v1570: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:29:22.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:29:22 smithi086 bash[24289]: cluster 2024-09-16T06:29:21.840545+0000 mgr.a (mgr.14373) 2264 : cluster [DBG] pgmap v1570: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:29:22.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:29:22 smithi047 bash[22744]: cluster 2024-09-16T06:29:21.840545+0000 mgr.a (mgr.14373) 2264 : cluster [DBG] pgmap v1570: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:29:22.804 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:29:22.805 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:29:22.805 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:29:23.575 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:29:23.576 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:29:23.576 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:29:23.576 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:29:23.576 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:29:25.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:29:24 smithi157 bash[24585]: audit 2024-09-16T06:29:23.140529+0000 mgr.a (mgr.14373) 2265 : audit [DBG] from='client.61050 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:29:25.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:29:24 smithi157 bash[24585]: cluster 2024-09-16T06:29:23.841527+0000 mgr.a (mgr.14373) 2266 : cluster [DBG] pgmap v1571: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:29:25.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:29:24 smithi086 bash[24289]: audit 2024-09-16T06:29:23.140529+0000 mgr.a (mgr.14373) 2265 : audit [DBG] from='client.61050 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:29:25.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:29:24 smithi086 bash[24289]: cluster 2024-09-16T06:29:23.841527+0000 mgr.a (mgr.14373) 2266 : cluster [DBG] pgmap v1571: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:29:25.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:29:24 smithi047 bash[22744]: audit 2024-09-16T06:29:23.140529+0000 mgr.a (mgr.14373) 2265 : audit [DBG] from='client.61050 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:29:25.340 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:29:24 smithi047 bash[22744]: cluster 2024-09-16T06:29:23.841527+0000 mgr.a (mgr.14373) 2266 : cluster [DBG] pgmap v1571: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:29:26.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:29:25 smithi157 bash[24585]: audit 2024-09-16T06:29:25.061510+0000 mon.b (mon.2) 250 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T06:29:26.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:29:25 smithi086 bash[24289]: audit 2024-09-16T06:29:25.061510+0000 mon.b (mon.2) 250 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T06:29:26.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:29:25 smithi047 bash[22744]: audit 2024-09-16T06:29:25.061510+0000 mon.b (mon.2) 250 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T06:29:27.090 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 06:29:26 smithi047 bash[22994]: debug 2024-09-16T06:29:26.659+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T06:29:27.090 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 06:29:26 smithi047 bash[22994]: debug 2024-09-16T06:29:26.663+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T06:29:27.090 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:29:26 smithi047 bash[22744]: cluster 2024-09-16T06:29:25.842295+0000 mgr.a (mgr.14373) 2267 : cluster [DBG] pgmap v1572: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:29:27.090 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:29:26 smithi047 bash[22744]: audit 2024-09-16T06:29:25.920036+0000 mon.b (mon.2) 251 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T06:29:27.090 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:29:26 smithi047 bash[22744]: audit 2024-09-16T06:29:25.921985+0000 mon.b (mon.2) 252 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T06:29:27.090 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:29:26 smithi047 bash[22744]: audit 2024-09-16T06:29:25.933288+0000 mon.a (mon.0) 699 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:29:27.090 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:29:26 smithi047 bash[22744]: audit 2024-09-16T06:29:25.938090+0000 mon.b (mon.2) 253 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:29:27.090 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:29:26 smithi047 bash[22744]: audit 2024-09-16T06:29:25.942073+0000 mgr.a (mgr.14373) 2268 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:29:27.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:29:26 smithi157 bash[24585]: cluster 2024-09-16T06:29:25.842295+0000 mgr.a (mgr.14373) 2267 : cluster [DBG] pgmap v1572: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:29:27.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:29:26 smithi157 bash[24585]: audit 2024-09-16T06:29:25.920036+0000 mon.b (mon.2) 251 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T06:29:27.305 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:29:26 smithi157 bash[24585]: audit 2024-09-16T06:29:25.921985+0000 mon.b (mon.2) 252 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T06:29:27.305 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:29:26 smithi157 bash[24585]: audit 2024-09-16T06:29:25.933288+0000 mon.a (mon.0) 699 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:29:27.305 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:29:26 smithi157 bash[24585]: audit 2024-09-16T06:29:25.938090+0000 mon.b (mon.2) 253 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:29:27.305 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:29:26 smithi157 bash[24585]: audit 2024-09-16T06:29:25.942073+0000 mgr.a (mgr.14373) 2268 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:29:27.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:29:26 smithi086 bash[24289]: cluster 2024-09-16T06:29:25.842295+0000 mgr.a (mgr.14373) 2267 : cluster [DBG] pgmap v1572: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:29:27.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:29:26 smithi086 bash[24289]: audit 2024-09-16T06:29:25.920036+0000 mon.b (mon.2) 251 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T06:29:27.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:29:26 smithi086 bash[24289]: audit 2024-09-16T06:29:25.921985+0000 mon.b (mon.2) 252 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T06:29:27.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:29:26 smithi086 bash[24289]: audit 2024-09-16T06:29:25.933288+0000 mon.a (mon.0) 699 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:29:27.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:29:26 smithi086 bash[24289]: audit 2024-09-16T06:29:25.938090+0000 mon.b (mon.2) 253 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:29:27.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:29:26 smithi086 bash[24289]: audit 2024-09-16T06:29:25.942073+0000 mgr.a (mgr.14373) 2268 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:29:28.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:29:27 smithi157 bash[24585]: audit 2024-09-16T06:29:26.665930+0000 mgr.a (mgr.14373) 2269 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T06:29:28.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:29:27 smithi157 bash[24585]: cephadm 2024-09-16T06:29:26.667702+0000 mgr.a (mgr.14373) 2270 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T06:29:28.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:29:27 smithi086 bash[24289]: audit 2024-09-16T06:29:26.665930+0000 mgr.a (mgr.14373) 2269 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T06:29:28.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:29:27 smithi086 bash[24289]: cephadm 2024-09-16T06:29:26.667702+0000 mgr.a (mgr.14373) 2270 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T06:29:28.341 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:29:27 smithi047 bash[22744]: audit 2024-09-16T06:29:26.665930+0000 mgr.a (mgr.14373) 2269 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T06:29:28.341 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:29:27 smithi047 bash[22744]: cephadm 2024-09-16T06:29:26.667702+0000 mgr.a (mgr.14373) 2270 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T06:29:28.577 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:29:28.578 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:29:28.578 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:29:29.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:29:28 smithi157 bash[24585]: cluster 2024-09-16T06:29:27.844968+0000 mgr.a (mgr.14373) 2271 : cluster [DBG] pgmap v1573: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 4.6 KiB/s rd, 255 B/s wr, 4 op/s 2024-09-16T06:29:29.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:29:28 smithi086 bash[24289]: cluster 2024-09-16T06:29:27.844968+0000 mgr.a (mgr.14373) 2271 : cluster [DBG] pgmap v1573: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 4.6 KiB/s rd, 255 B/s wr, 4 op/s 2024-09-16T06:29:29.319 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:29:29.319 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:29:29.320 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:29:29.320 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:29:29.320 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:29:29.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:29:28 smithi047 bash[22744]: cluster 2024-09-16T06:29:27.844968+0000 mgr.a (mgr.14373) 2271 : cluster [DBG] pgmap v1573: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 4.6 KiB/s rd, 255 B/s wr, 4 op/s 2024-09-16T06:29:30.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:29:29 smithi157 bash[24585]: audit 2024-09-16T06:29:28.912129+0000 mgr.a (mgr.14373) 2272 : audit [DBG] from='client.61227 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:29:30.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:29:29 smithi086 bash[24289]: audit 2024-09-16T06:29:28.912129+0000 mgr.a (mgr.14373) 2272 : audit [DBG] from='client.61227 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:29:30.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:29:29 smithi047 bash[22744]: audit 2024-09-16T06:29:28.912129+0000 mgr.a (mgr.14373) 2272 : audit [DBG] from='client.61227 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:29:31.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:29:30 smithi157 bash[24585]: cluster 2024-09-16T06:29:29.845843+0000 mgr.a (mgr.14373) 2273 : cluster [DBG] pgmap v1574: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 3.7 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-16T06:29:31.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:29:30 smithi086 bash[24289]: cluster 2024-09-16T06:29:29.845843+0000 mgr.a (mgr.14373) 2273 : cluster [DBG] pgmap v1574: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 3.7 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-16T06:29:31.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:29:30 smithi047 bash[22744]: cluster 2024-09-16T06:29:29.845843+0000 mgr.a (mgr.14373) 2273 : cluster [DBG] pgmap v1574: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 3.7 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-16T06:29:33.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:29:32 smithi157 bash[24585]: cluster 2024-09-16T06:29:31.848072+0000 mgr.a (mgr.14373) 2274 : cluster [DBG] pgmap v1575: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:29:33.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:29:32 smithi086 bash[24289]: cluster 2024-09-16T06:29:31.848072+0000 mgr.a (mgr.14373) 2274 : cluster [DBG] pgmap v1575: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:29:33.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:29:32 smithi047 bash[22744]: cluster 2024-09-16T06:29:31.848072+0000 mgr.a (mgr.14373) 2274 : cluster [DBG] pgmap v1575: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:29:34.321 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:29:34.321 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:29:34.321 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:29:35.065 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:29:35.065 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:29:35.066 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:29:35.066 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:29:35.066 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:29:35.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:29:34 smithi157 bash[24585]: cluster 2024-09-16T06:29:33.848863+0000 mgr.a (mgr.14373) 2275 : cluster [DBG] pgmap v1576: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:29:35.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:29:34 smithi086 bash[24289]: cluster 2024-09-16T06:29:33.848863+0000 mgr.a (mgr.14373) 2275 : cluster [DBG] pgmap v1576: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:29:35.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:29:34 smithi047 bash[22744]: cluster 2024-09-16T06:29:33.848863+0000 mgr.a (mgr.14373) 2275 : cluster [DBG] pgmap v1576: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:29:36.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:29:35 smithi157 bash[24585]: audit 2024-09-16T06:29:34.655038+0000 mgr.a (mgr.14373) 2276 : audit [DBG] from='client.61305 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:29:36.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:29:35 smithi086 bash[24289]: audit 2024-09-16T06:29:34.655038+0000 mgr.a (mgr.14373) 2276 : audit [DBG] from='client.61305 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:29:36.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:29:35 smithi047 bash[22744]: audit 2024-09-16T06:29:34.655038+0000 mgr.a (mgr.14373) 2276 : audit [DBG] from='client.61305 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:29:37.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:29:36 smithi157 bash[24585]: cluster 2024-09-16T06:29:35.849855+0000 mgr.a (mgr.14373) 2277 : cluster [DBG] pgmap v1577: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:29:37.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:29:36 smithi086 bash[24289]: cluster 2024-09-16T06:29:35.849855+0000 mgr.a (mgr.14373) 2277 : cluster [DBG] pgmap v1577: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:29:37.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:29:36 smithi047 bash[22744]: cluster 2024-09-16T06:29:35.849855+0000 mgr.a (mgr.14373) 2277 : cluster [DBG] pgmap v1577: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:29:39.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:29:38 smithi157 bash[24585]: cluster 2024-09-16T06:29:37.852187+0000 mgr.a (mgr.14373) 2278 : cluster [DBG] pgmap v1578: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:29:39.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:29:38 smithi086 bash[24289]: cluster 2024-09-16T06:29:37.852187+0000 mgr.a (mgr.14373) 2278 : cluster [DBG] pgmap v1578: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:29:39.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:29:38 smithi047 bash[22744]: cluster 2024-09-16T06:29:37.852187+0000 mgr.a (mgr.14373) 2278 : cluster [DBG] pgmap v1578: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:29:40.067 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:29:40.068 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:29:40.068 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:29:40.818 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:29:40.819 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:29:40.819 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:29:40.819 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:29:40.819 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:29:41.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:29:40 smithi157 bash[24585]: cluster 2024-09-16T06:29:39.852951+0000 mgr.a (mgr.14373) 2279 : cluster [DBG] pgmap v1579: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 5.2 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-16T06:29:41.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:29:40 smithi086 bash[24289]: cluster 2024-09-16T06:29:39.852951+0000 mgr.a (mgr.14373) 2279 : cluster [DBG] pgmap v1579: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 5.2 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-16T06:29:41.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:29:40 smithi047 bash[22744]: cluster 2024-09-16T06:29:39.852951+0000 mgr.a (mgr.14373) 2279 : cluster [DBG] pgmap v1579: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 5.2 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-16T06:29:42.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:29:41 smithi157 bash[24585]: audit 2024-09-16T06:29:40.400171+0000 mgr.a (mgr.14373) 2280 : audit [DBG] from='client.61380 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:29:42.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:29:41 smithi086 bash[24289]: audit 2024-09-16T06:29:40.400171+0000 mgr.a (mgr.14373) 2280 : audit [DBG] from='client.61380 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:29:42.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:29:41 smithi047 bash[22744]: audit 2024-09-16T06:29:40.400171+0000 mgr.a (mgr.14373) 2280 : audit [DBG] from='client.61380 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:29:43.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:29:42 smithi157 bash[24585]: cluster 2024-09-16T06:29:41.855237+0000 mgr.a (mgr.14373) 2281 : cluster [DBG] pgmap v1580: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-16T06:29:43.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:29:42 smithi086 bash[24289]: cluster 2024-09-16T06:29:41.855237+0000 mgr.a (mgr.14373) 2281 : cluster [DBG] pgmap v1580: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-16T06:29:43.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:29:42 smithi047 bash[22744]: cluster 2024-09-16T06:29:41.855237+0000 mgr.a (mgr.14373) 2281 : cluster [DBG] pgmap v1580: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-16T06:29:45.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:29:44 smithi157 bash[24585]: cluster 2024-09-16T06:29:43.856185+0000 mgr.a (mgr.14373) 2282 : cluster [DBG] pgmap v1581: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:29:45.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:29:44 smithi086 bash[24289]: cluster 2024-09-16T06:29:43.856185+0000 mgr.a (mgr.14373) 2282 : cluster [DBG] pgmap v1581: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:29:45.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:29:44 smithi047 bash[22744]: cluster 2024-09-16T06:29:43.856185+0000 mgr.a (mgr.14373) 2282 : cluster [DBG] pgmap v1581: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:29:45.820 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:29:45.820 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:29:45.821 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:29:46.603 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:29:46.604 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:29:46.604 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:29:46.604 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:29:46.604 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:29:47.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:29:46 smithi157 bash[24585]: cluster 2024-09-16T06:29:45.856859+0000 mgr.a (mgr.14373) 2283 : cluster [DBG] pgmap v1582: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:29:47.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:29:46 smithi086 bash[24289]: cluster 2024-09-16T06:29:45.856859+0000 mgr.a (mgr.14373) 2283 : cluster [DBG] pgmap v1582: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:29:47.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:29:46 smithi047 bash[22744]: cluster 2024-09-16T06:29:45.856859+0000 mgr.a (mgr.14373) 2283 : cluster [DBG] pgmap v1582: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:29:48.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:29:47 smithi157 bash[24585]: audit 2024-09-16T06:29:46.162676+0000 mgr.a (mgr.14373) 2284 : audit [DBG] from='client.61458 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:29:48.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:29:47 smithi086 bash[24289]: audit 2024-09-16T06:29:46.162676+0000 mgr.a (mgr.14373) 2284 : audit [DBG] from='client.61458 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:29:48.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:29:47 smithi047 bash[22744]: audit 2024-09-16T06:29:46.162676+0000 mgr.a (mgr.14373) 2284 : audit [DBG] from='client.61458 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:29:49.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:29:48 smithi157 bash[24585]: cluster 2024-09-16T06:29:47.859540+0000 mgr.a (mgr.14373) 2285 : cluster [DBG] pgmap v1583: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-16T06:29:49.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:29:48 smithi086 bash[24289]: cluster 2024-09-16T06:29:47.859540+0000 mgr.a (mgr.14373) 2285 : cluster [DBG] pgmap v1583: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-16T06:29:49.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:29:48 smithi047 bash[22744]: cluster 2024-09-16T06:29:47.859540+0000 mgr.a (mgr.14373) 2285 : cluster [DBG] pgmap v1583: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-16T06:29:50.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:29:50 smithi157 bash[24585]: cluster 2024-09-16T06:29:49.860274+0000 mgr.a (mgr.14373) 2286 : cluster [DBG] pgmap v1584: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T06:29:50.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:29:50 smithi086 bash[24289]: cluster 2024-09-16T06:29:49.860274+0000 mgr.a (mgr.14373) 2286 : cluster [DBG] pgmap v1584: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T06:29:50.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:29:50 smithi047 bash[22744]: cluster 2024-09-16T06:29:49.860274+0000 mgr.a (mgr.14373) 2286 : cluster [DBG] pgmap v1584: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T06:29:51.605 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:29:51.606 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:29:51.606 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:29:52.364 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:29:52.364 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:29:52.364 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:29:52.364 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:29:52.364 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:29:53.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:29:52 smithi157 bash[24585]: cluster 2024-09-16T06:29:51.862246+0000 mgr.a (mgr.14373) 2287 : cluster [DBG] pgmap v1585: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:29:53.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:29:52 smithi157 bash[24585]: audit 2024-09-16T06:29:51.942602+0000 mgr.a (mgr.14373) 2288 : audit [DBG] from='client.61536 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:29:53.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:29:52 smithi086 bash[24289]: cluster 2024-09-16T06:29:51.862246+0000 mgr.a (mgr.14373) 2287 : cluster [DBG] pgmap v1585: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:29:53.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:29:52 smithi086 bash[24289]: audit 2024-09-16T06:29:51.942602+0000 mgr.a (mgr.14373) 2288 : audit [DBG] from='client.61536 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:29:53.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:29:52 smithi047 bash[22744]: cluster 2024-09-16T06:29:51.862246+0000 mgr.a (mgr.14373) 2287 : cluster [DBG] pgmap v1585: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:29:53.340 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:29:52 smithi047 bash[22744]: audit 2024-09-16T06:29:51.942602+0000 mgr.a (mgr.14373) 2288 : audit [DBG] from='client.61536 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:29:55.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:29:54 smithi157 bash[24585]: cluster 2024-09-16T06:29:53.863153+0000 mgr.a (mgr.14373) 2289 : cluster [DBG] pgmap v1586: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:29:55.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:29:54 smithi086 bash[24289]: cluster 2024-09-16T06:29:53.863153+0000 mgr.a (mgr.14373) 2289 : cluster [DBG] pgmap v1586: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:29:55.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:29:54 smithi047 bash[22744]: cluster 2024-09-16T06:29:53.863153+0000 mgr.a (mgr.14373) 2289 : cluster [DBG] pgmap v1586: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:29:57.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:29:56 smithi157 bash[24585]: cluster 2024-09-16T06:29:55.863962+0000 mgr.a (mgr.14373) 2290 : cluster [DBG] pgmap v1587: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T06:29:57.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:29:56 smithi086 bash[24289]: cluster 2024-09-16T06:29:55.863962+0000 mgr.a (mgr.14373) 2290 : cluster [DBG] pgmap v1587: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T06:29:57.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:29:56 smithi047 bash[22744]: cluster 2024-09-16T06:29:55.863962+0000 mgr.a (mgr.14373) 2290 : cluster [DBG] pgmap v1587: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T06:29:57.365 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:29:57.366 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:29:57.366 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:29:58.101 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:29:58.101 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:29:58.102 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:29:58.102 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:29:58.102 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:29:59.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:29:58 smithi157 bash[24585]: audit 2024-09-16T06:29:57.699064+0000 mgr.a (mgr.14373) 2291 : audit [DBG] from='client.61614 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:29:59.305 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:29:58 smithi157 bash[24585]: cluster 2024-09-16T06:29:57.865248+0000 mgr.a (mgr.14373) 2292 : cluster [DBG] pgmap v1588: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:29:59.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:29:58 smithi086 bash[24289]: audit 2024-09-16T06:29:57.699064+0000 mgr.a (mgr.14373) 2291 : audit [DBG] from='client.61614 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:29:59.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:29:58 smithi086 bash[24289]: cluster 2024-09-16T06:29:57.865248+0000 mgr.a (mgr.14373) 2292 : cluster [DBG] pgmap v1588: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:29:59.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:29:58 smithi047 bash[22744]: audit 2024-09-16T06:29:57.699064+0000 mgr.a (mgr.14373) 2291 : audit [DBG] from='client.61614 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:29:59.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:29:58 smithi047 bash[22744]: cluster 2024-09-16T06:29:57.865248+0000 mgr.a (mgr.14373) 2292 : cluster [DBG] pgmap v1588: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:30:01.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:30:00 smithi157 bash[24585]: cluster 2024-09-16T06:29:59.866115+0000 mgr.a (mgr.14373) 2293 : cluster [DBG] pgmap v1589: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-16T06:30:01.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:30:00 smithi157 bash[24585]: cluster 2024-09-16T06:30:00.000114+0000 mon.a (mon.0) 700 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-16T06:30:01.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:30:00 smithi086 bash[24289]: cluster 2024-09-16T06:29:59.866115+0000 mgr.a (mgr.14373) 2293 : cluster [DBG] pgmap v1589: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-16T06:30:01.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:30:00 smithi086 bash[24289]: cluster 2024-09-16T06:30:00.000114+0000 mon.a (mon.0) 700 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-16T06:30:01.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:30:00 smithi047 bash[22744]: cluster 2024-09-16T06:29:59.866115+0000 mgr.a (mgr.14373) 2293 : cluster [DBG] pgmap v1589: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-16T06:30:01.340 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:30:00 smithi047 bash[22744]: cluster 2024-09-16T06:30:00.000114+0000 mon.a (mon.0) 700 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-16T06:30:03.103 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:30:03.103 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:30:03.104 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:30:03.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:30:02 smithi157 bash[24585]: cluster 2024-09-16T06:30:01.868304+0000 mgr.a (mgr.14373) 2294 : cluster [DBG] pgmap v1590: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-16T06:30:03.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:30:02 smithi086 bash[24289]: cluster 2024-09-16T06:30:01.868304+0000 mgr.a (mgr.14373) 2294 : cluster [DBG] pgmap v1590: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-16T06:30:03.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:30:02 smithi047 bash[22744]: cluster 2024-09-16T06:30:01.868304+0000 mgr.a (mgr.14373) 2294 : cluster [DBG] pgmap v1590: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-16T06:30:03.879 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:30:03.879 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:30:03.880 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:30:03.880 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:30:03.880 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:30:05.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:30:04 smithi157 bash[24585]: audit 2024-09-16T06:30:03.440587+0000 mgr.a (mgr.14373) 2295 : audit [DBG] from='client.61692 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:30:05.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:30:04 smithi157 bash[24585]: cluster 2024-09-16T06:30:03.868799+0000 mgr.a (mgr.14373) 2296 : cluster [DBG] pgmap v1591: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:30:05.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:30:04 smithi086 bash[24289]: audit 2024-09-16T06:30:03.440587+0000 mgr.a (mgr.14373) 2295 : audit [DBG] from='client.61692 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:30:05.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:30:04 smithi086 bash[24289]: cluster 2024-09-16T06:30:03.868799+0000 mgr.a (mgr.14373) 2296 : cluster [DBG] pgmap v1591: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:30:05.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:30:04 smithi047 bash[22744]: audit 2024-09-16T06:30:03.440587+0000 mgr.a (mgr.14373) 2295 : audit [DBG] from='client.61692 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:30:05.340 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:30:04 smithi047 bash[22744]: cluster 2024-09-16T06:30:03.868799+0000 mgr.a (mgr.14373) 2296 : cluster [DBG] pgmap v1591: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:30:07.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:30:06 smithi157 bash[24585]: cluster 2024-09-16T06:30:05.869542+0000 mgr.a (mgr.14373) 2297 : cluster [DBG] pgmap v1592: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:30:07.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:30:06 smithi086 bash[24289]: cluster 2024-09-16T06:30:05.869542+0000 mgr.a (mgr.14373) 2297 : cluster [DBG] pgmap v1592: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:30:07.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:30:06 smithi047 bash[22744]: cluster 2024-09-16T06:30:05.869542+0000 mgr.a (mgr.14373) 2297 : cluster [DBG] pgmap v1592: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:30:08.881 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:30:08.882 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:30:08.882 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:30:09.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:30:08 smithi157 bash[24585]: cluster 2024-09-16T06:30:07.871804+0000 mgr.a (mgr.14373) 2298 : cluster [DBG] pgmap v1593: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:30:09.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:30:08 smithi086 bash[24289]: cluster 2024-09-16T06:30:07.871804+0000 mgr.a (mgr.14373) 2298 : cluster [DBG] pgmap v1593: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:30:09.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:30:08 smithi047 bash[22744]: cluster 2024-09-16T06:30:07.871804+0000 mgr.a (mgr.14373) 2298 : cluster [DBG] pgmap v1593: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:30:09.656 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:30:09.656 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:30:09.656 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:30:09.656 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:30:09.656 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:30:11.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:30:10 smithi157 bash[24585]: audit 2024-09-16T06:30:09.215434+0000 mgr.a (mgr.14373) 2299 : audit [DBG] from='client.61764 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:30:11.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:30:10 smithi157 bash[24585]: cluster 2024-09-16T06:30:09.872726+0000 mgr.a (mgr.14373) 2300 : cluster [DBG] pgmap v1594: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:30:11.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:30:10 smithi086 bash[24289]: audit 2024-09-16T06:30:09.215434+0000 mgr.a (mgr.14373) 2299 : audit [DBG] from='client.61764 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:30:11.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:30:10 smithi086 bash[24289]: cluster 2024-09-16T06:30:09.872726+0000 mgr.a (mgr.14373) 2300 : cluster [DBG] pgmap v1594: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:30:11.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:30:10 smithi047 bash[22744]: audit 2024-09-16T06:30:09.215434+0000 mgr.a (mgr.14373) 2299 : audit [DBG] from='client.61764 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:30:11.340 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:30:10 smithi047 bash[22744]: cluster 2024-09-16T06:30:09.872726+0000 mgr.a (mgr.14373) 2300 : cluster [DBG] pgmap v1594: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:30:13.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:30:12 smithi157 bash[24585]: cluster 2024-09-16T06:30:11.874866+0000 mgr.a (mgr.14373) 2301 : cluster [DBG] pgmap v1595: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:30:13.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:30:12 smithi086 bash[24289]: cluster 2024-09-16T06:30:11.874866+0000 mgr.a (mgr.14373) 2301 : cluster [DBG] pgmap v1595: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:30:13.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:30:12 smithi047 bash[22744]: cluster 2024-09-16T06:30:11.874866+0000 mgr.a (mgr.14373) 2301 : cluster [DBG] pgmap v1595: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:30:14.657 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:30:14.658 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:30:14.658 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:30:15.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:30:14 smithi157 bash[24585]: cluster 2024-09-16T06:30:13.875608+0000 mgr.a (mgr.14373) 2302 : cluster [DBG] pgmap v1596: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:30:15.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:30:14 smithi086 bash[24289]: cluster 2024-09-16T06:30:13.875608+0000 mgr.a (mgr.14373) 2302 : cluster [DBG] pgmap v1596: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:30:15.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:30:14 smithi047 bash[22744]: cluster 2024-09-16T06:30:13.875608+0000 mgr.a (mgr.14373) 2302 : cluster [DBG] pgmap v1596: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:30:15.424 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:30:15.424 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:30:15.424 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:30:15.424 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:30:15.424 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:30:16.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:30:15 smithi157 bash[24585]: audit 2024-09-16T06:30:14.994722+0000 mgr.a (mgr.14373) 2303 : audit [DBG] from='client.61842 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:30:16.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:30:15 smithi086 bash[24289]: audit 2024-09-16T06:30:14.994722+0000 mgr.a (mgr.14373) 2303 : audit [DBG] from='client.61842 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:30:16.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:30:15 smithi047 bash[22744]: audit 2024-09-16T06:30:14.994722+0000 mgr.a (mgr.14373) 2303 : audit [DBG] from='client.61842 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:30:17.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:30:16 smithi157 bash[24585]: cluster 2024-09-16T06:30:15.876486+0000 mgr.a (mgr.14373) 2304 : cluster [DBG] pgmap v1597: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:30:17.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:30:16 smithi086 bash[24289]: cluster 2024-09-16T06:30:15.876486+0000 mgr.a (mgr.14373) 2304 : cluster [DBG] pgmap v1597: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:30:17.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:30:16 smithi047 bash[22744]: cluster 2024-09-16T06:30:15.876486+0000 mgr.a (mgr.14373) 2304 : cluster [DBG] pgmap v1597: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:30:19.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:30:18 smithi157 bash[24585]: cluster 2024-09-16T06:30:17.878735+0000 mgr.a (mgr.14373) 2305 : cluster [DBG] pgmap v1598: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:30:19.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:30:18 smithi086 bash[24289]: cluster 2024-09-16T06:30:17.878735+0000 mgr.a (mgr.14373) 2305 : cluster [DBG] pgmap v1598: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:30:19.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:30:18 smithi047 bash[22744]: cluster 2024-09-16T06:30:17.878735+0000 mgr.a (mgr.14373) 2305 : cluster [DBG] pgmap v1598: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:30:20.425 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:30:20.426 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:30:20.426 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:30:21.214 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:30:21.214 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:30:21.215 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:30:21.215 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:30:21.215 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:30:21.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:30:20 smithi157 bash[24585]: cluster 2024-09-16T06:30:19.879485+0000 mgr.a (mgr.14373) 2306 : cluster [DBG] pgmap v1599: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:30:21.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:30:20 smithi086 bash[24289]: cluster 2024-09-16T06:30:19.879485+0000 mgr.a (mgr.14373) 2306 : cluster [DBG] pgmap v1599: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:30:21.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:30:20 smithi047 bash[22744]: cluster 2024-09-16T06:30:19.879485+0000 mgr.a (mgr.14373) 2306 : cluster [DBG] pgmap v1599: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:30:22.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:30:21 smithi157 bash[24585]: audit 2024-09-16T06:30:20.762974+0000 mgr.a (mgr.14373) 2307 : audit [DBG] from='client.61920 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:30:22.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:30:21 smithi086 bash[24289]: audit 2024-09-16T06:30:20.762974+0000 mgr.a (mgr.14373) 2307 : audit [DBG] from='client.61920 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:30:22.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:30:21 smithi047 bash[22744]: audit 2024-09-16T06:30:20.762974+0000 mgr.a (mgr.14373) 2307 : audit [DBG] from='client.61920 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:30:23.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:30:22 smithi157 bash[24585]: cluster 2024-09-16T06:30:21.881796+0000 mgr.a (mgr.14373) 2308 : cluster [DBG] pgmap v1600: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:30:23.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:30:22 smithi086 bash[24289]: cluster 2024-09-16T06:30:21.881796+0000 mgr.a (mgr.14373) 2308 : cluster [DBG] pgmap v1600: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:30:23.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:30:22 smithi047 bash[22744]: cluster 2024-09-16T06:30:21.881796+0000 mgr.a (mgr.14373) 2308 : cluster [DBG] pgmap v1600: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:30:25.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:30:25 smithi157 bash[24585]: cluster 2024-09-16T06:30:23.882709+0000 mgr.a (mgr.14373) 2309 : cluster [DBG] pgmap v1601: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:30:25.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:30:24 smithi086 bash[24289]: cluster 2024-09-16T06:30:23.882709+0000 mgr.a (mgr.14373) 2309 : cluster [DBG] pgmap v1601: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:30:25.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:30:25 smithi047 bash[22744]: cluster 2024-09-16T06:30:23.882709+0000 mgr.a (mgr.14373) 2309 : cluster [DBG] pgmap v1601: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:30:26.216 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:30:26.216 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:30:26.217 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:30:26.972 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:30:26.972 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:30:26.972 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:30:26.972 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:30:26.973 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:30:27.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:30:27 smithi157 bash[24585]: cluster 2024-09-16T06:30:25.883697+0000 mgr.a (mgr.14373) 2310 : cluster [DBG] pgmap v1602: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:30:27.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:30:27 smithi157 bash[24585]: audit 2024-09-16T06:30:26.720116+0000 mon.b (mon.2) 254 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T06:30:27.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:30:27 smithi086 bash[24289]: cluster 2024-09-16T06:30:25.883697+0000 mgr.a (mgr.14373) 2310 : cluster [DBG] pgmap v1602: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:30:27.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:30:27 smithi086 bash[24289]: audit 2024-09-16T06:30:26.720116+0000 mon.b (mon.2) 254 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T06:30:27.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:30:27 smithi047 bash[22744]: cluster 2024-09-16T06:30:25.883697+0000 mgr.a (mgr.14373) 2310 : cluster [DBG] pgmap v1602: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:30:27.340 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:30:27 smithi047 bash[22744]: audit 2024-09-16T06:30:26.720116+0000 mon.b (mon.2) 254 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T06:30:28.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:30:28 smithi157 bash[24585]: audit 2024-09-16T06:30:26.545616+0000 mgr.a (mgr.14373) 2311 : audit [DBG] from='client.61995 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:30:28.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:30:28 smithi086 bash[24289]: audit 2024-09-16T06:30:26.545616+0000 mgr.a (mgr.14373) 2311 : audit [DBG] from='client.61995 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:30:28.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:30:28 smithi047 bash[22744]: audit 2024-09-16T06:30:26.545616+0000 mgr.a (mgr.14373) 2311 : audit [DBG] from='client.61995 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:30:29.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:30:29 smithi157 bash[24585]: cluster 2024-09-16T06:30:27.886558+0000 mgr.a (mgr.14373) 2312 : cluster [DBG] pgmap v1603: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:30:29.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:30:29 smithi086 bash[24289]: cluster 2024-09-16T06:30:27.886558+0000 mgr.a (mgr.14373) 2312 : cluster [DBG] pgmap v1603: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:30:29.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:30:29 smithi047 bash[22744]: cluster 2024-09-16T06:30:27.886558+0000 mgr.a (mgr.14373) 2312 : cluster [DBG] pgmap v1603: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:30:30.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:30:30 smithi157 bash[24585]: cluster 2024-09-16T06:30:29.887304+0000 mgr.a (mgr.14373) 2313 : cluster [DBG] pgmap v1604: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:30:30.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:30:30 smithi086 bash[24289]: cluster 2024-09-16T06:30:29.887304+0000 mgr.a (mgr.14373) 2313 : cluster [DBG] pgmap v1604: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:30:30.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:30:30 smithi047 bash[22744]: cluster 2024-09-16T06:30:29.887304+0000 mgr.a (mgr.14373) 2313 : cluster [DBG] pgmap v1604: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:30:31.973 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:30:31.974 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:30:31.974 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:30:32.730 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:30:32.730 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:30:32.730 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:30:32.730 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:30:32.730 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:30:33.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:30:32 smithi157 bash[24585]: cluster 2024-09-16T06:30:31.888722+0000 mgr.a (mgr.14373) 2314 : cluster [DBG] pgmap v1605: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:30:33.305 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:30:32 smithi157 bash[24585]: audit 2024-09-16T06:30:32.027697+0000 mon.a (mon.0) 701 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:30:33.305 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:30:32 smithi157 bash[24585]: audit 2024-09-16T06:30:32.038039+0000 mon.a (mon.0) 702 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:30:33.305 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:30:32 smithi157 bash[24585]: audit 2024-09-16T06:30:32.058056+0000 mon.a (mon.0) 703 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:30:33.305 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:30:33 smithi157 bash[24585]: audit 2024-09-16T06:30:32.065647+0000 mon.a (mon.0) 704 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:30:33.305 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:30:33 smithi157 bash[24585]: audit 2024-09-16T06:30:32.072582+0000 mon.a (mon.0) 705 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:30:33.305 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:30:33 smithi157 bash[24585]: audit 2024-09-16T06:30:32.077193+0000 mon.a (mon.0) 706 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:30:33.305 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:30:33 smithi157 bash[24585]: audit 2024-09-16T06:30:32.789858+0000 mon.b (mon.2) 255 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T06:30:33.305 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:30:33 smithi157 bash[24585]: audit 2024-09-16T06:30:32.791632+0000 mon.b (mon.2) 256 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T06:30:33.305 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:30:33 smithi157 bash[24585]: audit 2024-09-16T06:30:32.800014+0000 mon.a (mon.0) 707 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:30:33.305 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:30:33 smithi157 bash[24585]: audit 2024-09-16T06:30:32.803459+0000 mon.b (mon.2) 257 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:30:33.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:30:32 smithi086 bash[24289]: cluster 2024-09-16T06:30:31.888722+0000 mgr.a (mgr.14373) 2314 : cluster [DBG] pgmap v1605: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:30:33.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:30:32 smithi086 bash[24289]: audit 2024-09-16T06:30:32.027697+0000 mon.a (mon.0) 701 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:30:33.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:30:32 smithi086 bash[24289]: audit 2024-09-16T06:30:32.038039+0000 mon.a (mon.0) 702 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:30:33.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:30:32 smithi086 bash[24289]: audit 2024-09-16T06:30:32.058056+0000 mon.a (mon.0) 703 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:30:33.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:30:32 smithi086 bash[24289]: audit 2024-09-16T06:30:32.065647+0000 mon.a (mon.0) 704 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:30:33.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:30:32 smithi086 bash[24289]: audit 2024-09-16T06:30:32.072582+0000 mon.a (mon.0) 705 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:30:33.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:30:32 smithi086 bash[24289]: audit 2024-09-16T06:30:32.077193+0000 mon.a (mon.0) 706 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:30:33.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:30:32 smithi086 bash[24289]: audit 2024-09-16T06:30:32.789858+0000 mon.b (mon.2) 255 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T06:30:33.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:30:32 smithi086 bash[24289]: audit 2024-09-16T06:30:32.791632+0000 mon.b (mon.2) 256 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T06:30:33.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:30:32 smithi086 bash[24289]: audit 2024-09-16T06:30:32.800014+0000 mon.a (mon.0) 707 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:30:33.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:30:32 smithi086 bash[24289]: audit 2024-09-16T06:30:32.803459+0000 mon.b (mon.2) 257 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:30:33.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:30:32 smithi047 bash[22744]: cluster 2024-09-16T06:30:31.888722+0000 mgr.a (mgr.14373) 2314 : cluster [DBG] pgmap v1605: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:30:33.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:30:32 smithi047 bash[22744]: audit 2024-09-16T06:30:32.027697+0000 mon.a (mon.0) 701 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:30:33.340 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:30:32 smithi047 bash[22744]: audit 2024-09-16T06:30:32.038039+0000 mon.a (mon.0) 702 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:30:33.340 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:30:32 smithi047 bash[22744]: audit 2024-09-16T06:30:32.058056+0000 mon.a (mon.0) 703 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:30:33.340 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:30:32 smithi047 bash[22744]: audit 2024-09-16T06:30:32.065647+0000 mon.a (mon.0) 704 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:30:33.340 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:30:32 smithi047 bash[22744]: audit 2024-09-16T06:30:32.072582+0000 mon.a (mon.0) 705 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:30:33.340 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:30:32 smithi047 bash[22744]: audit 2024-09-16T06:30:32.077193+0000 mon.a (mon.0) 706 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:30:33.340 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:30:32 smithi047 bash[22744]: audit 2024-09-16T06:30:32.789858+0000 mon.b (mon.2) 255 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T06:30:33.340 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:30:32 smithi047 bash[22744]: audit 2024-09-16T06:30:32.791632+0000 mon.b (mon.2) 256 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T06:30:33.340 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:30:32 smithi047 bash[22744]: audit 2024-09-16T06:30:32.800014+0000 mon.a (mon.0) 707 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:30:33.340 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:30:32 smithi047 bash[22744]: audit 2024-09-16T06:30:32.803459+0000 mon.b (mon.2) 257 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:30:33.839 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 06:30:33 smithi047 bash[22994]: debug 2024-09-16T06:30:33.518+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T06:30:33.840 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 06:30:33 smithi047 bash[22994]: debug 2024-09-16T06:30:33.522+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T06:30:34.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:30:33 smithi157 bash[24585]: audit 2024-09-16T06:30:32.308345+0000 mgr.a (mgr.14373) 2315 : audit [DBG] from='client.62073 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:30:34.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:30:33 smithi157 bash[24585]: audit 2024-09-16T06:30:32.807882+0000 mgr.a (mgr.14373) 2316 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:30:34.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:30:33 smithi086 bash[24289]: audit 2024-09-16T06:30:32.308345+0000 mgr.a (mgr.14373) 2315 : audit [DBG] from='client.62073 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:30:34.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:30:33 smithi086 bash[24289]: audit 2024-09-16T06:30:32.807882+0000 mgr.a (mgr.14373) 2316 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:30:34.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:30:33 smithi047 bash[22744]: audit 2024-09-16T06:30:32.308345+0000 mgr.a (mgr.14373) 2315 : audit [DBG] from='client.62073 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:30:34.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:30:33 smithi047 bash[22744]: audit 2024-09-16T06:30:32.807882+0000 mgr.a (mgr.14373) 2316 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:30:35.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:30:34 smithi157 bash[24585]: audit 2024-09-16T06:30:33.521136+0000 mgr.a (mgr.14373) 2317 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T06:30:35.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:30:34 smithi157 bash[24585]: cephadm 2024-09-16T06:30:33.523030+0000 mgr.a (mgr.14373) 2318 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T06:30:35.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:30:34 smithi157 bash[24585]: cluster 2024-09-16T06:30:33.889603+0000 mgr.a (mgr.14373) 2319 : cluster [DBG] pgmap v1606: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:30:35.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:30:34 smithi086 bash[24289]: audit 2024-09-16T06:30:33.521136+0000 mgr.a (mgr.14373) 2317 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T06:30:35.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:30:34 smithi086 bash[24289]: cephadm 2024-09-16T06:30:33.523030+0000 mgr.a (mgr.14373) 2318 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T06:30:35.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:30:34 smithi086 bash[24289]: cluster 2024-09-16T06:30:33.889603+0000 mgr.a (mgr.14373) 2319 : cluster [DBG] pgmap v1606: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:30:35.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:30:34 smithi047 bash[22744]: audit 2024-09-16T06:30:33.521136+0000 mgr.a (mgr.14373) 2317 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T06:30:35.340 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:30:34 smithi047 bash[22744]: cephadm 2024-09-16T06:30:33.523030+0000 mgr.a (mgr.14373) 2318 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T06:30:35.340 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:30:34 smithi047 bash[22744]: cluster 2024-09-16T06:30:33.889603+0000 mgr.a (mgr.14373) 2319 : cluster [DBG] pgmap v1606: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:30:37.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:30:36 smithi157 bash[24585]: cluster 2024-09-16T06:30:35.890407+0000 mgr.a (mgr.14373) 2320 : cluster [DBG] pgmap v1607: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T06:30:37.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:30:36 smithi086 bash[24289]: cluster 2024-09-16T06:30:35.890407+0000 mgr.a (mgr.14373) 2320 : cluster [DBG] pgmap v1607: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T06:30:37.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:30:36 smithi047 bash[22744]: cluster 2024-09-16T06:30:35.890407+0000 mgr.a (mgr.14373) 2320 : cluster [DBG] pgmap v1607: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T06:30:37.731 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:30:37.732 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:30:37.733 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:30:38.477 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:30:38.478 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:30:38.478 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:30:38.478 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:30:38.478 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:30:39.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:30:38 smithi157 bash[24585]: cluster 2024-09-16T06:30:37.891952+0000 mgr.a (mgr.14373) 2321 : cluster [DBG] pgmap v1608: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:30:39.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:30:38 smithi086 bash[24289]: cluster 2024-09-16T06:30:37.891952+0000 mgr.a (mgr.14373) 2321 : cluster [DBG] pgmap v1608: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:30:39.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:30:38 smithi047 bash[22744]: cluster 2024-09-16T06:30:37.891952+0000 mgr.a (mgr.14373) 2321 : cluster [DBG] pgmap v1608: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:30:40.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:30:39 smithi157 bash[24585]: audit 2024-09-16T06:30:38.061608+0000 mgr.a (mgr.14373) 2322 : audit [DBG] from='client.62259 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:30:40.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:30:39 smithi086 bash[24289]: audit 2024-09-16T06:30:38.061608+0000 mgr.a (mgr.14373) 2322 : audit [DBG] from='client.62259 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:30:40.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:30:39 smithi047 bash[22744]: audit 2024-09-16T06:30:38.061608+0000 mgr.a (mgr.14373) 2322 : audit [DBG] from='client.62259 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:30:41.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:30:40 smithi157 bash[24585]: cluster 2024-09-16T06:30:39.892924+0000 mgr.a (mgr.14373) 2323 : cluster [DBG] pgmap v1609: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:30:41.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:30:40 smithi086 bash[24289]: cluster 2024-09-16T06:30:39.892924+0000 mgr.a (mgr.14373) 2323 : cluster [DBG] pgmap v1609: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:30:41.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:30:40 smithi047 bash[22744]: cluster 2024-09-16T06:30:39.892924+0000 mgr.a (mgr.14373) 2323 : cluster [DBG] pgmap v1609: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:30:43.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:30:42 smithi157 bash[24585]: cluster 2024-09-16T06:30:41.895040+0000 mgr.a (mgr.14373) 2324 : cluster [DBG] pgmap v1610: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:30:43.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:30:42 smithi086 bash[24289]: cluster 2024-09-16T06:30:41.895040+0000 mgr.a (mgr.14373) 2324 : cluster [DBG] pgmap v1610: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:30:43.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:30:42 smithi047 bash[22744]: cluster 2024-09-16T06:30:41.895040+0000 mgr.a (mgr.14373) 2324 : cluster [DBG] pgmap v1610: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:30:43.479 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:30:43.480 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:30:43.480 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:30:44.232 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:30:44.233 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:30:44.233 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:30:44.233 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:30:44.233 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:30:45.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:30:44 smithi157 bash[24585]: audit 2024-09-16T06:30:43.807493+0000 mgr.a (mgr.14373) 2325 : audit [DBG] from='client.62337 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:30:45.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:30:44 smithi157 bash[24585]: cluster 2024-09-16T06:30:43.895630+0000 mgr.a (mgr.14373) 2326 : cluster [DBG] pgmap v1611: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:30:45.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:30:44 smithi086 bash[24289]: audit 2024-09-16T06:30:43.807493+0000 mgr.a (mgr.14373) 2325 : audit [DBG] from='client.62337 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:30:45.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:30:44 smithi086 bash[24289]: cluster 2024-09-16T06:30:43.895630+0000 mgr.a (mgr.14373) 2326 : cluster [DBG] pgmap v1611: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:30:45.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:30:44 smithi047 bash[22744]: audit 2024-09-16T06:30:43.807493+0000 mgr.a (mgr.14373) 2325 : audit [DBG] from='client.62337 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:30:45.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:30:44 smithi047 bash[22744]: cluster 2024-09-16T06:30:43.895630+0000 mgr.a (mgr.14373) 2326 : cluster [DBG] pgmap v1611: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:30:47.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:30:46 smithi157 bash[24585]: cluster 2024-09-16T06:30:45.896598+0000 mgr.a (mgr.14373) 2327 : cluster [DBG] pgmap v1612: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:30:47.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:30:46 smithi086 bash[24289]: cluster 2024-09-16T06:30:45.896598+0000 mgr.a (mgr.14373) 2327 : cluster [DBG] pgmap v1612: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:30:47.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:30:46 smithi047 bash[22744]: cluster 2024-09-16T06:30:45.896598+0000 mgr.a (mgr.14373) 2327 : cluster [DBG] pgmap v1612: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:30:49.234 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:30:49.235 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:30:49.235 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:30:49.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:30:48 smithi157 bash[24585]: cluster 2024-09-16T06:30:47.898862+0000 mgr.a (mgr.14373) 2328 : cluster [DBG] pgmap v1613: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:30:49.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:30:48 smithi086 bash[24289]: cluster 2024-09-16T06:30:47.898862+0000 mgr.a (mgr.14373) 2328 : cluster [DBG] pgmap v1613: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:30:49.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:30:48 smithi047 bash[22744]: cluster 2024-09-16T06:30:47.898862+0000 mgr.a (mgr.14373) 2328 : cluster [DBG] pgmap v1613: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:30:49.985 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:30:49.985 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:30:49.986 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:30:49.986 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:30:49.986 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:30:51.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:30:50 smithi157 bash[24585]: audit 2024-09-16T06:30:49.566913+0000 mgr.a (mgr.14373) 2329 : audit [DBG] from='client.62412 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:30:51.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:30:50 smithi157 bash[24585]: cluster 2024-09-16T06:30:49.899415+0000 mgr.a (mgr.14373) 2330 : cluster [DBG] pgmap v1614: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:30:51.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:30:50 smithi086 bash[24289]: audit 2024-09-16T06:30:49.566913+0000 mgr.a (mgr.14373) 2329 : audit [DBG] from='client.62412 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:30:51.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:30:50 smithi086 bash[24289]: cluster 2024-09-16T06:30:49.899415+0000 mgr.a (mgr.14373) 2330 : cluster [DBG] pgmap v1614: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:30:51.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:30:50 smithi047 bash[22744]: audit 2024-09-16T06:30:49.566913+0000 mgr.a (mgr.14373) 2329 : audit [DBG] from='client.62412 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:30:51.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:30:50 smithi047 bash[22744]: cluster 2024-09-16T06:30:49.899415+0000 mgr.a (mgr.14373) 2330 : cluster [DBG] pgmap v1614: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:30:53.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:30:53 smithi157 bash[24585]: cluster 2024-09-16T06:30:51.901517+0000 mgr.a (mgr.14373) 2331 : cluster [DBG] pgmap v1615: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:30:53.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:30:52 smithi086 bash[24289]: cluster 2024-09-16T06:30:51.901517+0000 mgr.a (mgr.14373) 2331 : cluster [DBG] pgmap v1615: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:30:53.340 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:30:52 smithi047 bash[22744]: cluster 2024-09-16T06:30:51.901517+0000 mgr.a (mgr.14373) 2331 : cluster [DBG] pgmap v1615: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:30:54.987 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:30:54.988 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:30:54.988 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:30:55.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:30:55 smithi157 bash[24585]: cluster 2024-09-16T06:30:53.902273+0000 mgr.a (mgr.14373) 2332 : cluster [DBG] pgmap v1616: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:30:55.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:30:55 smithi086 bash[24289]: cluster 2024-09-16T06:30:53.902273+0000 mgr.a (mgr.14373) 2332 : cluster [DBG] pgmap v1616: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:30:55.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:30:55 smithi047 bash[22744]: cluster 2024-09-16T06:30:53.902273+0000 mgr.a (mgr.14373) 2332 : cluster [DBG] pgmap v1616: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:30:55.736 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:30:55.736 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:30:55.736 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:30:55.736 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:30:55.736 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:30:57.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:30:57 smithi157 bash[24585]: audit 2024-09-16T06:30:55.320730+0000 mgr.a (mgr.14373) 2333 : audit [DBG] from='client.62490 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:30:57.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:30:57 smithi157 bash[24585]: cluster 2024-09-16T06:30:55.903238+0000 mgr.a (mgr.14373) 2334 : cluster [DBG] pgmap v1617: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:30:57.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:30:57 smithi086 bash[24289]: audit 2024-09-16T06:30:55.320730+0000 mgr.a (mgr.14373) 2333 : audit [DBG] from='client.62490 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:30:57.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:30:57 smithi086 bash[24289]: cluster 2024-09-16T06:30:55.903238+0000 mgr.a (mgr.14373) 2334 : cluster [DBG] pgmap v1617: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:30:57.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:30:57 smithi047 bash[22744]: audit 2024-09-16T06:30:55.320730+0000 mgr.a (mgr.14373) 2333 : audit [DBG] from='client.62490 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:30:57.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:30:57 smithi047 bash[22744]: cluster 2024-09-16T06:30:55.903238+0000 mgr.a (mgr.14373) 2334 : cluster [DBG] pgmap v1617: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:30:59.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:30:59 smithi157 bash[24585]: cluster 2024-09-16T06:30:57.905506+0000 mgr.a (mgr.14373) 2335 : cluster [DBG] pgmap v1618: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:30:59.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:30:59 smithi086 bash[24289]: cluster 2024-09-16T06:30:57.905506+0000 mgr.a (mgr.14373) 2335 : cluster [DBG] pgmap v1618: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:30:59.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:30:59 smithi047 bash[22744]: cluster 2024-09-16T06:30:57.905506+0000 mgr.a (mgr.14373) 2335 : cluster [DBG] pgmap v1618: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:31:00.737 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:31:00.738 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:31:00.738 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:31:01.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:31:01 smithi157 bash[24585]: cluster 2024-09-16T06:30:59.906256+0000 mgr.a (mgr.14373) 2336 : cluster [DBG] pgmap v1619: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:31:01.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:31:01 smithi086 bash[24289]: cluster 2024-09-16T06:30:59.906256+0000 mgr.a (mgr.14373) 2336 : cluster [DBG] pgmap v1619: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:31:01.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:31:01 smithi047 bash[22744]: cluster 2024-09-16T06:30:59.906256+0000 mgr.a (mgr.14373) 2336 : cluster [DBG] pgmap v1619: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:31:01.513 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:31:01.513 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:31:01.513 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:31:01.513 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:31:01.513 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:31:03.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:31:03 smithi157 bash[24585]: audit 2024-09-16T06:31:01.073333+0000 mgr.a (mgr.14373) 2337 : audit [DBG] from='client.62568 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:31:03.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:31:03 smithi157 bash[24585]: cluster 2024-09-16T06:31:01.909691+0000 mgr.a (mgr.14373) 2338 : cluster [DBG] pgmap v1620: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-16T06:31:03.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:31:03 smithi086 bash[24289]: audit 2024-09-16T06:31:01.073333+0000 mgr.a (mgr.14373) 2337 : audit [DBG] from='client.62568 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:31:03.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:31:03 smithi086 bash[24289]: cluster 2024-09-16T06:31:01.909691+0000 mgr.a (mgr.14373) 2338 : cluster [DBG] pgmap v1620: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-16T06:31:03.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:31:03 smithi047 bash[22744]: audit 2024-09-16T06:31:01.073333+0000 mgr.a (mgr.14373) 2337 : audit [DBG] from='client.62568 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:31:03.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:31:03 smithi047 bash[22744]: cluster 2024-09-16T06:31:01.909691+0000 mgr.a (mgr.14373) 2338 : cluster [DBG] pgmap v1620: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-16T06:31:05.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:31:05 smithi157 bash[24585]: cluster 2024-09-16T06:31:03.910514+0000 mgr.a (mgr.14373) 2339 : cluster [DBG] pgmap v1621: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T06:31:05.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:31:05 smithi086 bash[24289]: cluster 2024-09-16T06:31:03.910514+0000 mgr.a (mgr.14373) 2339 : cluster [DBG] pgmap v1621: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T06:31:05.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:31:05 smithi047 bash[22744]: cluster 2024-09-16T06:31:03.910514+0000 mgr.a (mgr.14373) 2339 : cluster [DBG] pgmap v1621: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T06:31:06.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:31:06 smithi047 bash[22744]: cluster 2024-09-16T06:31:05.911264+0000 mgr.a (mgr.14373) 2340 : cluster [DBG] pgmap v1622: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T06:31:06.515 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:31:06.516 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:31:06.516 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:31:06.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:31:06 smithi157 bash[24585]: cluster 2024-09-16T06:31:05.911264+0000 mgr.a (mgr.14373) 2340 : cluster [DBG] pgmap v1622: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T06:31:06.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:31:06 smithi086 bash[24289]: cluster 2024-09-16T06:31:05.911264+0000 mgr.a (mgr.14373) 2340 : cluster [DBG] pgmap v1622: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T06:31:07.265 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:31:07.265 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:31:07.265 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:31:07.266 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:31:07.266 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:31:07.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:31:07 smithi047 bash[22744]: audit 2024-09-16T06:31:06.847027+0000 mgr.a (mgr.14373) 2341 : audit [DBG] from='client.62643 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:31:07.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:31:07 smithi157 bash[24585]: audit 2024-09-16T06:31:06.847027+0000 mgr.a (mgr.14373) 2341 : audit [DBG] from='client.62643 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:31:07.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:31:07 smithi086 bash[24289]: audit 2024-09-16T06:31:06.847027+0000 mgr.a (mgr.14373) 2341 : audit [DBG] from='client.62643 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:31:08.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:31:08 smithi047 bash[22744]: cluster 2024-09-16T06:31:07.914520+0000 mgr.a (mgr.14373) 2342 : cluster [DBG] pgmap v1623: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:31:08.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:31:08 smithi157 bash[24585]: cluster 2024-09-16T06:31:07.914520+0000 mgr.a (mgr.14373) 2342 : cluster [DBG] pgmap v1623: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:31:08.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:31:08 smithi086 bash[24289]: cluster 2024-09-16T06:31:07.914520+0000 mgr.a (mgr.14373) 2342 : cluster [DBG] pgmap v1623: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:31:11.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:31:10 smithi157 bash[24585]: cluster 2024-09-16T06:31:09.915272+0000 mgr.a (mgr.14373) 2343 : cluster [DBG] pgmap v1624: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:31:11.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:31:10 smithi086 bash[24289]: cluster 2024-09-16T06:31:09.915272+0000 mgr.a (mgr.14373) 2343 : cluster [DBG] pgmap v1624: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:31:11.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:31:10 smithi047 bash[22744]: cluster 2024-09-16T06:31:09.915272+0000 mgr.a (mgr.14373) 2343 : cluster [DBG] pgmap v1624: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:31:12.266 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:31:12.267 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:31:12.267 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:31:13.013 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:31:13.013 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:31:13.013 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:31:13.013 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:31:13.014 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:31:13.305 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:31:12 smithi157 bash[24585]: cluster 2024-09-16T06:31:11.917277+0000 mgr.a (mgr.14373) 2344 : cluster [DBG] pgmap v1625: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:31:13.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:31:12 smithi086 bash[24289]: cluster 2024-09-16T06:31:11.917277+0000 mgr.a (mgr.14373) 2344 : cluster [DBG] pgmap v1625: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:31:13.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:31:12 smithi047 bash[22744]: cluster 2024-09-16T06:31:11.917277+0000 mgr.a (mgr.14373) 2344 : cluster [DBG] pgmap v1625: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:31:14.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:31:13 smithi157 bash[24585]: audit 2024-09-16T06:31:12.596584+0000 mgr.a (mgr.14373) 2345 : audit [DBG] from='client.62721 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:31:14.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:31:13 smithi086 bash[24289]: audit 2024-09-16T06:31:12.596584+0000 mgr.a (mgr.14373) 2345 : audit [DBG] from='client.62721 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:31:14.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:31:13 smithi047 bash[22744]: audit 2024-09-16T06:31:12.596584+0000 mgr.a (mgr.14373) 2345 : audit [DBG] from='client.62721 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:31:15.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:31:14 smithi157 bash[24585]: cluster 2024-09-16T06:31:13.918243+0000 mgr.a (mgr.14373) 2346 : cluster [DBG] pgmap v1626: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-16T06:31:15.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:31:14 smithi086 bash[24289]: cluster 2024-09-16T06:31:13.918243+0000 mgr.a (mgr.14373) 2346 : cluster [DBG] pgmap v1626: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-16T06:31:15.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:31:14 smithi047 bash[22744]: cluster 2024-09-16T06:31:13.918243+0000 mgr.a (mgr.14373) 2346 : cluster [DBG] pgmap v1626: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-16T06:31:17.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:31:16 smithi157 bash[24585]: cluster 2024-09-16T06:31:15.919012+0000 mgr.a (mgr.14373) 2347 : cluster [DBG] pgmap v1627: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-16T06:31:17.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:31:16 smithi086 bash[24289]: cluster 2024-09-16T06:31:15.919012+0000 mgr.a (mgr.14373) 2347 : cluster [DBG] pgmap v1627: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-16T06:31:17.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:31:16 smithi047 bash[22744]: cluster 2024-09-16T06:31:15.919012+0000 mgr.a (mgr.14373) 2347 : cluster [DBG] pgmap v1627: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-16T06:31:18.013 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:31:18.014 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:31:18.014 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:31:18.795 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:31:18.795 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:31:18.795 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:31:18.796 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:31:18.796 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:31:19.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:31:18 smithi157 bash[24585]: cluster 2024-09-16T06:31:17.921232+0000 mgr.a (mgr.14373) 2348 : cluster [DBG] pgmap v1628: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-16T06:31:19.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:31:18 smithi086 bash[24289]: cluster 2024-09-16T06:31:17.921232+0000 mgr.a (mgr.14373) 2348 : cluster [DBG] pgmap v1628: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-16T06:31:19.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:31:18 smithi047 bash[22744]: cluster 2024-09-16T06:31:17.921232+0000 mgr.a (mgr.14373) 2348 : cluster [DBG] pgmap v1628: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-16T06:31:20.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:31:20 smithi157 bash[24585]: audit 2024-09-16T06:31:18.351388+0000 mgr.a (mgr.14373) 2349 : audit [DBG] from='client.62796 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:31:20.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:31:20 smithi086 bash[24289]: audit 2024-09-16T06:31:18.351388+0000 mgr.a (mgr.14373) 2349 : audit [DBG] from='client.62796 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:31:20.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:31:20 smithi047 bash[22744]: audit 2024-09-16T06:31:18.351388+0000 mgr.a (mgr.14373) 2349 : audit [DBG] from='client.62796 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:31:21.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:31:21 smithi157 bash[24585]: cluster 2024-09-16T06:31:19.922174+0000 mgr.a (mgr.14373) 2350 : cluster [DBG] pgmap v1629: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:31:21.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:31:21 smithi086 bash[24289]: cluster 2024-09-16T06:31:19.922174+0000 mgr.a (mgr.14373) 2350 : cluster [DBG] pgmap v1629: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:31:21.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:31:21 smithi047 bash[22744]: cluster 2024-09-16T06:31:19.922174+0000 mgr.a (mgr.14373) 2350 : cluster [DBG] pgmap v1629: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:31:23.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:31:23 smithi157 bash[24585]: cluster 2024-09-16T06:31:21.924455+0000 mgr.a (mgr.14373) 2351 : cluster [DBG] pgmap v1630: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:31:23.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:31:23 smithi086 bash[24289]: cluster 2024-09-16T06:31:21.924455+0000 mgr.a (mgr.14373) 2351 : cluster [DBG] pgmap v1630: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:31:23.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:31:23 smithi047 bash[22744]: cluster 2024-09-16T06:31:21.924455+0000 mgr.a (mgr.14373) 2351 : cluster [DBG] pgmap v1630: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:31:23.796 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:31:23.797 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:31:23.797 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:31:24.553 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:31:24.553 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:31:24.553 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:31:24.553 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:31:24.553 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:31:25.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:31:25 smithi157 bash[24585]: cluster 2024-09-16T06:31:23.924940+0000 mgr.a (mgr.14373) 2352 : cluster [DBG] pgmap v1631: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:31:25.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:31:25 smithi086 bash[24289]: cluster 2024-09-16T06:31:23.924940+0000 mgr.a (mgr.14373) 2352 : cluster [DBG] pgmap v1631: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:31:25.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:31:25 smithi047 bash[22744]: cluster 2024-09-16T06:31:23.924940+0000 mgr.a (mgr.14373) 2352 : cluster [DBG] pgmap v1631: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:31:26.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:31:26 smithi157 bash[24585]: audit 2024-09-16T06:31:24.133459+0000 mgr.a (mgr.14373) 2353 : audit [DBG] from='client.62865 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:31:26.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:31:26 smithi086 bash[24289]: audit 2024-09-16T06:31:24.133459+0000 mgr.a (mgr.14373) 2353 : audit [DBG] from='client.62865 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:31:26.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:31:26 smithi047 bash[22744]: audit 2024-09-16T06:31:24.133459+0000 mgr.a (mgr.14373) 2353 : audit [DBG] from='client.62865 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:31:27.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:31:27 smithi157 bash[24585]: cluster 2024-09-16T06:31:25.925819+0000 mgr.a (mgr.14373) 2354 : cluster [DBG] pgmap v1632: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:31:27.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:31:27 smithi086 bash[24289]: cluster 2024-09-16T06:31:25.925819+0000 mgr.a (mgr.14373) 2354 : cluster [DBG] pgmap v1632: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:31:27.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:31:27 smithi047 bash[22744]: cluster 2024-09-16T06:31:25.925819+0000 mgr.a (mgr.14373) 2354 : cluster [DBG] pgmap v1632: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:31:29.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:31:29 smithi157 bash[24585]: cluster 2024-09-16T06:31:27.928119+0000 mgr.a (mgr.14373) 2355 : cluster [DBG] pgmap v1633: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:31:29.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:31:29 smithi086 bash[24289]: cluster 2024-09-16T06:31:27.928119+0000 mgr.a (mgr.14373) 2355 : cluster [DBG] pgmap v1633: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:31:29.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:31:29 smithi047 bash[22744]: cluster 2024-09-16T06:31:27.928119+0000 mgr.a (mgr.14373) 2355 : cluster [DBG] pgmap v1633: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:31:29.554 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:31:29.555 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:31:29.555 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:31:30.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:31:30 smithi157 bash[24585]: audit 2024-09-16T06:31:29.900670+0000 mgr.a (mgr.14373) 2356 : audit [DBG] from='client.62943 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:31:30.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:31:30 smithi157 bash[24585]: cluster 2024-09-16T06:31:29.928946+0000 mgr.a (mgr.14373) 2357 : cluster [DBG] pgmap v1634: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:31:30.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:31:30 smithi086 bash[24289]: audit 2024-09-16T06:31:29.900670+0000 mgr.a (mgr.14373) 2356 : audit [DBG] from='client.62943 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:31:30.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:31:30 smithi086 bash[24289]: cluster 2024-09-16T06:31:29.928946+0000 mgr.a (mgr.14373) 2357 : cluster [DBG] pgmap v1634: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:31:30.331 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:31:30.331 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:31:30.331 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:31:30.331 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:31:30.331 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:31:30.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:31:30 smithi047 bash[22744]: audit 2024-09-16T06:31:29.900670+0000 mgr.a (mgr.14373) 2356 : audit [DBG] from='client.62943 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:31:30.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:31:30 smithi047 bash[22744]: cluster 2024-09-16T06:31:29.928946+0000 mgr.a (mgr.14373) 2357 : cluster [DBG] pgmap v1634: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:31:33.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:31:32 smithi157 bash[24585]: cluster 2024-09-16T06:31:31.931296+0000 mgr.a (mgr.14373) 2358 : cluster [DBG] pgmap v1635: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:31:33.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:31:32 smithi086 bash[24289]: cluster 2024-09-16T06:31:31.931296+0000 mgr.a (mgr.14373) 2358 : cluster [DBG] pgmap v1635: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:31:33.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:31:32 smithi047 bash[22744]: cluster 2024-09-16T06:31:31.931296+0000 mgr.a (mgr.14373) 2358 : cluster [DBG] pgmap v1635: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:31:34.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:31:33 smithi157 bash[24585]: audit 2024-09-16T06:31:33.574258+0000 mon.b (mon.2) 258 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T06:31:34.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:31:33 smithi086 bash[24289]: audit 2024-09-16T06:31:33.574258+0000 mon.b (mon.2) 258 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T06:31:34.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:31:33 smithi047 bash[22744]: audit 2024-09-16T06:31:33.574258+0000 mon.b (mon.2) 258 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T06:31:35.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:31:34 smithi157 bash[24585]: cluster 2024-09-16T06:31:33.932037+0000 mgr.a (mgr.14373) 2359 : cluster [DBG] pgmap v1636: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:31:35.305 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:31:34 smithi157 bash[24585]: audit 2024-09-16T06:31:34.399477+0000 mon.b (mon.2) 259 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T06:31:35.305 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:31:34 smithi157 bash[24585]: audit 2024-09-16T06:31:34.401730+0000 mon.b (mon.2) 260 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T06:31:35.305 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:31:34 smithi157 bash[24585]: audit 2024-09-16T06:31:34.416059+0000 mon.a (mon.0) 708 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:31:35.305 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:31:34 smithi157 bash[24585]: audit 2024-09-16T06:31:34.420060+0000 mon.b (mon.2) 261 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:31:35.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:31:34 smithi086 bash[24289]: cluster 2024-09-16T06:31:33.932037+0000 mgr.a (mgr.14373) 2359 : cluster [DBG] pgmap v1636: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:31:35.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:31:34 smithi086 bash[24289]: audit 2024-09-16T06:31:34.399477+0000 mon.b (mon.2) 259 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T06:31:35.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:31:34 smithi086 bash[24289]: audit 2024-09-16T06:31:34.401730+0000 mon.b (mon.2) 260 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T06:31:35.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:31:34 smithi086 bash[24289]: audit 2024-09-16T06:31:34.416059+0000 mon.a (mon.0) 708 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:31:35.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:31:34 smithi086 bash[24289]: audit 2024-09-16T06:31:34.420060+0000 mon.b (mon.2) 261 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:31:35.333 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:31:35.334 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:31:35.334 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:31:35.339 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 06:31:35 smithi047 bash[22994]: debug 2024-09-16T06:31:35.148+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T06:31:35.339 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 06:31:35 smithi047 bash[22994]: debug 2024-09-16T06:31:35.152+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T06:31:35.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:31:34 smithi047 bash[22744]: cluster 2024-09-16T06:31:33.932037+0000 mgr.a (mgr.14373) 2359 : cluster [DBG] pgmap v1636: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:31:35.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:31:34 smithi047 bash[22744]: audit 2024-09-16T06:31:34.399477+0000 mon.b (mon.2) 259 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T06:31:35.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:31:34 smithi047 bash[22744]: audit 2024-09-16T06:31:34.401730+0000 mon.b (mon.2) 260 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T06:31:35.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:31:34 smithi047 bash[22744]: audit 2024-09-16T06:31:34.416059+0000 mon.a (mon.0) 708 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:31:35.340 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:31:34 smithi047 bash[22744]: audit 2024-09-16T06:31:34.420060+0000 mon.b (mon.2) 261 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:31:36.087 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:31:36.087 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:31:36.087 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:31:36.087 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:31:36.088 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:31:36.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:31:36 smithi157 bash[24585]: audit 2024-09-16T06:31:34.423078+0000 mgr.a (mgr.14373) 2360 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:31:36.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:31:36 smithi086 bash[24289]: audit 2024-09-16T06:31:34.423078+0000 mgr.a (mgr.14373) 2360 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:31:36.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:31:36 smithi047 bash[22744]: audit 2024-09-16T06:31:34.423078+0000 mgr.a (mgr.14373) 2360 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:31:37.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:31:37 smithi157 bash[24585]: audit 2024-09-16T06:31:35.154086+0000 mgr.a (mgr.14373) 2361 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T06:31:37.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:31:37 smithi157 bash[24585]: cephadm 2024-09-16T06:31:35.156081+0000 mgr.a (mgr.14373) 2362 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T06:31:37.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:31:37 smithi157 bash[24585]: audit 2024-09-16T06:31:35.664542+0000 mgr.a (mgr.14373) 2363 : audit [DBG] from='client.63126 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:31:37.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:31:37 smithi157 bash[24585]: cluster 2024-09-16T06:31:35.932650+0000 mgr.a (mgr.14373) 2364 : cluster [DBG] pgmap v1637: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:31:37.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:31:37 smithi086 bash[24289]: audit 2024-09-16T06:31:35.154086+0000 mgr.a (mgr.14373) 2361 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T06:31:37.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:31:37 smithi086 bash[24289]: cephadm 2024-09-16T06:31:35.156081+0000 mgr.a (mgr.14373) 2362 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T06:31:37.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:31:37 smithi086 bash[24289]: audit 2024-09-16T06:31:35.664542+0000 mgr.a (mgr.14373) 2363 : audit [DBG] from='client.63126 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:31:37.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:31:37 smithi086 bash[24289]: cluster 2024-09-16T06:31:35.932650+0000 mgr.a (mgr.14373) 2364 : cluster [DBG] pgmap v1637: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:31:37.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:31:37 smithi047 bash[22744]: audit 2024-09-16T06:31:35.154086+0000 mgr.a (mgr.14373) 2361 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T06:31:37.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:31:37 smithi047 bash[22744]: cephadm 2024-09-16T06:31:35.156081+0000 mgr.a (mgr.14373) 2362 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T06:31:37.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:31:37 smithi047 bash[22744]: audit 2024-09-16T06:31:35.664542+0000 mgr.a (mgr.14373) 2363 : audit [DBG] from='client.63126 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:31:37.340 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:31:37 smithi047 bash[22744]: cluster 2024-09-16T06:31:35.932650+0000 mgr.a (mgr.14373) 2364 : cluster [DBG] pgmap v1637: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:31:39.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:31:39 smithi157 bash[24585]: cluster 2024-09-16T06:31:37.934998+0000 mgr.a (mgr.14373) 2365 : cluster [DBG] pgmap v1638: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:31:39.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:31:39 smithi086 bash[24289]: cluster 2024-09-16T06:31:37.934998+0000 mgr.a (mgr.14373) 2365 : cluster [DBG] pgmap v1638: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:31:39.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:31:39 smithi047 bash[22744]: cluster 2024-09-16T06:31:37.934998+0000 mgr.a (mgr.14373) 2365 : cluster [DBG] pgmap v1638: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:31:41.089 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:31:41.090 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:31:41.090 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:31:41.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:31:41 smithi157 bash[24585]: cluster 2024-09-16T06:31:39.935768+0000 mgr.a (mgr.14373) 2366 : cluster [DBG] pgmap v1639: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:31:41.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:31:41 smithi086 bash[24289]: cluster 2024-09-16T06:31:39.935768+0000 mgr.a (mgr.14373) 2366 : cluster [DBG] pgmap v1639: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:31:41.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:31:41 smithi047 bash[22744]: cluster 2024-09-16T06:31:39.935768+0000 mgr.a (mgr.14373) 2366 : cluster [DBG] pgmap v1639: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:31:41.845 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:31:41.845 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:31:41.846 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:31:41.846 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:31:41.846 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:31:43.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:31:43 smithi157 bash[24585]: audit 2024-09-16T06:31:41.425983+0000 mgr.a (mgr.14373) 2367 : audit [DBG] from='client.63201 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:31:43.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:31:43 smithi157 bash[24585]: cluster 2024-09-16T06:31:41.937003+0000 mgr.a (mgr.14373) 2368 : cluster [DBG] pgmap v1640: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:31:43.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:31:43 smithi086 bash[24289]: audit 2024-09-16T06:31:41.425983+0000 mgr.a (mgr.14373) 2367 : audit [DBG] from='client.63201 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:31:43.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:31:43 smithi086 bash[24289]: cluster 2024-09-16T06:31:41.937003+0000 mgr.a (mgr.14373) 2368 : cluster [DBG] pgmap v1640: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:31:43.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:31:43 smithi047 bash[22744]: audit 2024-09-16T06:31:41.425983+0000 mgr.a (mgr.14373) 2367 : audit [DBG] from='client.63201 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:31:43.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:31:43 smithi047 bash[22744]: cluster 2024-09-16T06:31:41.937003+0000 mgr.a (mgr.14373) 2368 : cluster [DBG] pgmap v1640: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:31:45.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:31:45 smithi157 bash[24585]: cluster 2024-09-16T06:31:43.937719+0000 mgr.a (mgr.14373) 2369 : cluster [DBG] pgmap v1641: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T06:31:45.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:31:45 smithi086 bash[24289]: cluster 2024-09-16T06:31:43.937719+0000 mgr.a (mgr.14373) 2369 : cluster [DBG] pgmap v1641: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T06:31:45.340 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:31:45 smithi047 bash[22744]: cluster 2024-09-16T06:31:43.937719+0000 mgr.a (mgr.14373) 2369 : cluster [DBG] pgmap v1641: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T06:31:46.847 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:31:46.848 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:31:46.848 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:31:47.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:31:47 smithi157 bash[24585]: cluster 2024-09-16T06:31:45.938515+0000 mgr.a (mgr.14373) 2370 : cluster [DBG] pgmap v1642: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T06:31:47.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:31:47 smithi086 bash[24289]: cluster 2024-09-16T06:31:45.938515+0000 mgr.a (mgr.14373) 2370 : cluster [DBG] pgmap v1642: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T06:31:47.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:31:47 smithi047 bash[22744]: cluster 2024-09-16T06:31:45.938515+0000 mgr.a (mgr.14373) 2370 : cluster [DBG] pgmap v1642: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T06:31:47.617 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:31:47.617 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:31:47.617 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:31:47.617 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:31:47.618 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:31:49.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:31:49 smithi086 bash[24289]: audit 2024-09-16T06:31:47.184874+0000 mgr.a (mgr.14373) 2371 : audit [DBG] from='client.63279 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:31:49.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:31:49 smithi086 bash[24289]: cluster 2024-09-16T06:31:47.941229+0000 mgr.a (mgr.14373) 2372 : cluster [DBG] pgmap v1643: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:31:49.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:31:49 smithi047 bash[22744]: audit 2024-09-16T06:31:47.184874+0000 mgr.a (mgr.14373) 2371 : audit [DBG] from='client.63279 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:31:49.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:31:49 smithi047 bash[22744]: cluster 2024-09-16T06:31:47.941229+0000 mgr.a (mgr.14373) 2372 : cluster [DBG] pgmap v1643: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:31:49.510 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:31:49 smithi157 bash[24585]: audit 2024-09-16T06:31:47.184874+0000 mgr.a (mgr.14373) 2371 : audit [DBG] from='client.63279 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:31:49.510 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:31:49 smithi157 bash[24585]: cluster 2024-09-16T06:31:47.941229+0000 mgr.a (mgr.14373) 2372 : cluster [DBG] pgmap v1643: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:31:50.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:31:50 smithi157 bash[24585]: cluster 2024-09-16T06:31:49.942009+0000 mgr.a (mgr.14373) 2373 : cluster [DBG] pgmap v1644: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:31:50.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:31:50 smithi086 bash[24289]: cluster 2024-09-16T06:31:49.942009+0000 mgr.a (mgr.14373) 2373 : cluster [DBG] pgmap v1644: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:31:50.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:31:50 smithi047 bash[22744]: cluster 2024-09-16T06:31:49.942009+0000 mgr.a (mgr.14373) 2373 : cluster [DBG] pgmap v1644: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:31:52.619 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:31:52.620 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:31:52.620 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:31:53.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:31:53 smithi157 bash[24585]: cluster 2024-09-16T06:31:51.943998+0000 mgr.a (mgr.14373) 2374 : cluster [DBG] pgmap v1645: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:31:53.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:31:53 smithi086 bash[24289]: cluster 2024-09-16T06:31:51.943998+0000 mgr.a (mgr.14373) 2374 : cluster [DBG] pgmap v1645: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:31:53.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:31:53 smithi047 bash[22744]: cluster 2024-09-16T06:31:51.943998+0000 mgr.a (mgr.14373) 2374 : cluster [DBG] pgmap v1645: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:31:53.387 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:31:53.388 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:31:53.388 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:31:53.388 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:31:53.388 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:31:54.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:31:54 smithi157 bash[24585]: audit 2024-09-16T06:31:52.956851+0000 mgr.a (mgr.14373) 2375 : audit [DBG] from='client.63354 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:31:54.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:31:54 smithi086 bash[24289]: audit 2024-09-16T06:31:52.956851+0000 mgr.a (mgr.14373) 2375 : audit [DBG] from='client.63354 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:31:54.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:31:54 smithi047 bash[22744]: audit 2024-09-16T06:31:52.956851+0000 mgr.a (mgr.14373) 2375 : audit [DBG] from='client.63354 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:31:55.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:31:55 smithi157 bash[24585]: cluster 2024-09-16T06:31:53.944933+0000 mgr.a (mgr.14373) 2376 : cluster [DBG] pgmap v1646: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:31:55.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:31:55 smithi086 bash[24289]: cluster 2024-09-16T06:31:53.944933+0000 mgr.a (mgr.14373) 2376 : cluster [DBG] pgmap v1646: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:31:55.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:31:55 smithi047 bash[22744]: cluster 2024-09-16T06:31:53.944933+0000 mgr.a (mgr.14373) 2376 : cluster [DBG] pgmap v1646: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:31:57.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:31:57 smithi157 bash[24585]: cluster 2024-09-16T06:31:55.945826+0000 mgr.a (mgr.14373) 2377 : cluster [DBG] pgmap v1647: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:31:57.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:31:57 smithi086 bash[24289]: cluster 2024-09-16T06:31:55.945826+0000 mgr.a (mgr.14373) 2377 : cluster [DBG] pgmap v1647: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:31:57.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:31:57 smithi047 bash[22744]: cluster 2024-09-16T06:31:55.945826+0000 mgr.a (mgr.14373) 2377 : cluster [DBG] pgmap v1647: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:31:58.389 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:31:58.390 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:31:58.390 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:31:59.168 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:31:59.169 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:31:59.169 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:31:59.169 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:31:59.169 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:31:59.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:31:59 smithi157 bash[24585]: cluster 2024-09-16T06:31:57.948233+0000 mgr.a (mgr.14373) 2378 : cluster [DBG] pgmap v1648: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:31:59.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:31:59 smithi086 bash[24289]: cluster 2024-09-16T06:31:57.948233+0000 mgr.a (mgr.14373) 2378 : cluster [DBG] pgmap v1648: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:31:59.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:31:59 smithi047 bash[22744]: cluster 2024-09-16T06:31:57.948233+0000 mgr.a (mgr.14373) 2378 : cluster [DBG] pgmap v1648: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:32:00.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:32:00 smithi157 bash[24585]: audit 2024-09-16T06:31:58.732628+0000 mgr.a (mgr.14373) 2379 : audit [DBG] from='client.63429 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:32:00.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:32:00 smithi086 bash[24289]: audit 2024-09-16T06:31:58.732628+0000 mgr.a (mgr.14373) 2379 : audit [DBG] from='client.63429 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:32:00.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:32:00 smithi047 bash[22744]: audit 2024-09-16T06:31:58.732628+0000 mgr.a (mgr.14373) 2379 : audit [DBG] from='client.63429 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:32:01.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:32:01 smithi157 bash[24585]: cluster 2024-09-16T06:31:59.949253+0000 mgr.a (mgr.14373) 2380 : cluster [DBG] pgmap v1649: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:32:01.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:32:01 smithi086 bash[24289]: cluster 2024-09-16T06:31:59.949253+0000 mgr.a (mgr.14373) 2380 : cluster [DBG] pgmap v1649: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:32:01.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:32:01 smithi047 bash[22744]: cluster 2024-09-16T06:31:59.949253+0000 mgr.a (mgr.14373) 2380 : cluster [DBG] pgmap v1649: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:32:02.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:32:02 smithi047 bash[22744]: cluster 2024-09-16T06:32:01.951481+0000 mgr.a (mgr.14373) 2381 : cluster [DBG] pgmap v1650: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:32:02.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:32:02 smithi157 bash[24585]: cluster 2024-09-16T06:32:01.951481+0000 mgr.a (mgr.14373) 2381 : cluster [DBG] pgmap v1650: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:32:02.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:32:02 smithi086 bash[24289]: cluster 2024-09-16T06:32:01.951481+0000 mgr.a (mgr.14373) 2381 : cluster [DBG] pgmap v1650: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:32:04.167 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:32:04.168 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:32:04.168 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:32:04.911 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:32:04.911 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:32:04.911 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:32:04.911 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:32:04.911 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:32:05.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:32:05 smithi157 bash[24585]: cluster 2024-09-16T06:32:03.952242+0000 mgr.a (mgr.14373) 2382 : cluster [DBG] pgmap v1651: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:32:05.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:32:05 smithi086 bash[24289]: cluster 2024-09-16T06:32:03.952242+0000 mgr.a (mgr.14373) 2382 : cluster [DBG] pgmap v1651: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:32:05.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:32:05 smithi047 bash[22744]: cluster 2024-09-16T06:32:03.952242+0000 mgr.a (mgr.14373) 2382 : cluster [DBG] pgmap v1651: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:32:06.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:32:06 smithi157 bash[24585]: audit 2024-09-16T06:32:04.502464+0000 mgr.a (mgr.14373) 2383 : audit [DBG] from='client.63507 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:32:06.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:32:06 smithi086 bash[24289]: audit 2024-09-16T06:32:04.502464+0000 mgr.a (mgr.14373) 2383 : audit [DBG] from='client.63507 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:32:06.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:32:06 smithi047 bash[22744]: audit 2024-09-16T06:32:04.502464+0000 mgr.a (mgr.14373) 2383 : audit [DBG] from='client.63507 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:32:07.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:32:07 smithi157 bash[24585]: cluster 2024-09-16T06:32:05.953137+0000 mgr.a (mgr.14373) 2384 : cluster [DBG] pgmap v1652: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:32:07.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:32:07 smithi086 bash[24289]: cluster 2024-09-16T06:32:05.953137+0000 mgr.a (mgr.14373) 2384 : cluster [DBG] pgmap v1652: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:32:07.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:32:07 smithi047 bash[22744]: cluster 2024-09-16T06:32:05.953137+0000 mgr.a (mgr.14373) 2384 : cluster [DBG] pgmap v1652: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:32:09.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:32:09 smithi157 bash[24585]: cluster 2024-09-16T06:32:07.955435+0000 mgr.a (mgr.14373) 2385 : cluster [DBG] pgmap v1653: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:32:09.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:32:09 smithi086 bash[24289]: cluster 2024-09-16T06:32:07.955435+0000 mgr.a (mgr.14373) 2385 : cluster [DBG] pgmap v1653: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:32:09.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:32:09 smithi047 bash[22744]: cluster 2024-09-16T06:32:07.955435+0000 mgr.a (mgr.14373) 2385 : cluster [DBG] pgmap v1653: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:32:09.912 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:32:09.918 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:32:09.919 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:32:10.654 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:32:10.654 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:32:10.654 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:32:10.655 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:32:10.655 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:32:11.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:32:11 smithi157 bash[24585]: cluster 2024-09-16T06:32:09.956039+0000 mgr.a (mgr.14373) 2386 : cluster [DBG] pgmap v1654: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:32:11.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:32:11 smithi086 bash[24289]: cluster 2024-09-16T06:32:09.956039+0000 mgr.a (mgr.14373) 2386 : cluster [DBG] pgmap v1654: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:32:11.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:32:11 smithi047 bash[22744]: cluster 2024-09-16T06:32:09.956039+0000 mgr.a (mgr.14373) 2386 : cluster [DBG] pgmap v1654: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:32:12.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:32:12 smithi157 bash[24585]: audit 2024-09-16T06:32:10.245254+0000 mgr.a (mgr.14373) 2387 : audit [DBG] from='client.63585 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:32:12.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:32:12 smithi086 bash[24289]: audit 2024-09-16T06:32:10.245254+0000 mgr.a (mgr.14373) 2387 : audit [DBG] from='client.63585 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:32:12.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:32:12 smithi047 bash[22744]: audit 2024-09-16T06:32:10.245254+0000 mgr.a (mgr.14373) 2387 : audit [DBG] from='client.63585 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:32:13.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:32:13 smithi157 bash[24585]: cluster 2024-09-16T06:32:11.958309+0000 mgr.a (mgr.14373) 2388 : cluster [DBG] pgmap v1655: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:32:13.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:32:13 smithi086 bash[24289]: cluster 2024-09-16T06:32:11.958309+0000 mgr.a (mgr.14373) 2388 : cluster [DBG] pgmap v1655: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:32:13.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:32:13 smithi047 bash[22744]: cluster 2024-09-16T06:32:11.958309+0000 mgr.a (mgr.14373) 2388 : cluster [DBG] pgmap v1655: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:32:14.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:32:14 smithi157 bash[24585]: cluster 2024-09-16T06:32:13.959087+0000 mgr.a (mgr.14373) 2389 : cluster [DBG] pgmap v1656: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:32:14.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:32:14 smithi086 bash[24289]: cluster 2024-09-16T06:32:13.959087+0000 mgr.a (mgr.14373) 2389 : cluster [DBG] pgmap v1656: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:32:14.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:32:14 smithi047 bash[22744]: cluster 2024-09-16T06:32:13.959087+0000 mgr.a (mgr.14373) 2389 : cluster [DBG] pgmap v1656: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:32:15.656 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:32:15.656 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:32:15.657 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:32:16.433 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:32:16.434 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:32:16.434 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:32:16.434 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:32:16.434 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:32:17.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:32:17 smithi157 bash[24585]: cluster 2024-09-16T06:32:15.959845+0000 mgr.a (mgr.14373) 2390 : cluster [DBG] pgmap v1657: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:32:17.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:32:17 smithi157 bash[24585]: audit 2024-09-16T06:32:15.994160+0000 mgr.a (mgr.14373) 2391 : audit [DBG] from='client.63660 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:32:17.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:32:17 smithi086 bash[24289]: cluster 2024-09-16T06:32:15.959845+0000 mgr.a (mgr.14373) 2390 : cluster [DBG] pgmap v1657: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:32:17.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:32:17 smithi086 bash[24289]: audit 2024-09-16T06:32:15.994160+0000 mgr.a (mgr.14373) 2391 : audit [DBG] from='client.63660 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:32:17.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:32:17 smithi047 bash[22744]: cluster 2024-09-16T06:32:15.959845+0000 mgr.a (mgr.14373) 2390 : cluster [DBG] pgmap v1657: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:32:17.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:32:17 smithi047 bash[22744]: audit 2024-09-16T06:32:15.994160+0000 mgr.a (mgr.14373) 2391 : audit [DBG] from='client.63660 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:32:19.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:32:19 smithi157 bash[24585]: cluster 2024-09-16T06:32:17.962157+0000 mgr.a (mgr.14373) 2392 : cluster [DBG] pgmap v1658: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:32:19.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:32:19 smithi086 bash[24289]: cluster 2024-09-16T06:32:17.962157+0000 mgr.a (mgr.14373) 2392 : cluster [DBG] pgmap v1658: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:32:19.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:32:19 smithi047 bash[22744]: cluster 2024-09-16T06:32:17.962157+0000 mgr.a (mgr.14373) 2392 : cluster [DBG] pgmap v1658: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:32:21.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:32:21 smithi157 bash[24585]: cluster 2024-09-16T06:32:19.962958+0000 mgr.a (mgr.14373) 2393 : cluster [DBG] pgmap v1659: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:32:21.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:32:21 smithi086 bash[24289]: cluster 2024-09-16T06:32:19.962958+0000 mgr.a (mgr.14373) 2393 : cluster [DBG] pgmap v1659: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:32:21.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:32:21 smithi047 bash[22744]: cluster 2024-09-16T06:32:19.962958+0000 mgr.a (mgr.14373) 2393 : cluster [DBG] pgmap v1659: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:32:21.435 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:32:21.435 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:32:21.435 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:32:22.192 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:32:22.193 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:32:22.193 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:32:22.193 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:32:22.193 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:32:23.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:32:23 smithi157 bash[24585]: audit 2024-09-16T06:32:21.767568+0000 mgr.a (mgr.14373) 2394 : audit [DBG] from='client.63738 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:32:23.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:32:23 smithi157 bash[24585]: cluster 2024-09-16T06:32:21.964490+0000 mgr.a (mgr.14373) 2395 : cluster [DBG] pgmap v1660: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:32:23.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:32:23 smithi086 bash[24289]: audit 2024-09-16T06:32:21.767568+0000 mgr.a (mgr.14373) 2394 : audit [DBG] from='client.63738 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:32:23.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:32:23 smithi086 bash[24289]: cluster 2024-09-16T06:32:21.964490+0000 mgr.a (mgr.14373) 2395 : cluster [DBG] pgmap v1660: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:32:23.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:32:23 smithi047 bash[22744]: audit 2024-09-16T06:32:21.767568+0000 mgr.a (mgr.14373) 2394 : audit [DBG] from='client.63738 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:32:23.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:32:23 smithi047 bash[22744]: cluster 2024-09-16T06:32:21.964490+0000 mgr.a (mgr.14373) 2395 : cluster [DBG] pgmap v1660: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:32:25.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:32:25 smithi157 bash[24585]: cluster 2024-09-16T06:32:23.965349+0000 mgr.a (mgr.14373) 2396 : cluster [DBG] pgmap v1661: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T06:32:25.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:32:25 smithi086 bash[24289]: cluster 2024-09-16T06:32:23.965349+0000 mgr.a (mgr.14373) 2396 : cluster [DBG] pgmap v1661: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T06:32:25.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:32:25 smithi047 bash[22744]: cluster 2024-09-16T06:32:23.965349+0000 mgr.a (mgr.14373) 2396 : cluster [DBG] pgmap v1661: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T06:32:27.194 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:32:27.194 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:32:27.194 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:32:27.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:32:27 smithi157 bash[24585]: cluster 2024-09-16T06:32:25.966123+0000 mgr.a (mgr.14373) 2397 : cluster [DBG] pgmap v1662: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T06:32:27.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:32:27 smithi086 bash[24289]: cluster 2024-09-16T06:32:25.966123+0000 mgr.a (mgr.14373) 2397 : cluster [DBG] pgmap v1662: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T06:32:27.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:32:27 smithi047 bash[22744]: cluster 2024-09-16T06:32:25.966123+0000 mgr.a (mgr.14373) 2397 : cluster [DBG] pgmap v1662: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T06:32:27.930 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:32:27.931 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:32:27.931 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:32:27.931 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:32:27.931 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:32:29.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:32:29 smithi157 bash[24585]: audit 2024-09-16T06:32:27.524771+0000 mgr.a (mgr.14373) 2398 : audit [DBG] from='client.63816 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:32:29.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:32:29 smithi157 bash[24585]: cluster 2024-09-16T06:32:27.968969+0000 mgr.a (mgr.14373) 2399 : cluster [DBG] pgmap v1663: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:32:29.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:32:29 smithi086 bash[24289]: audit 2024-09-16T06:32:27.524771+0000 mgr.a (mgr.14373) 2398 : audit [DBG] from='client.63816 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:32:29.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:32:29 smithi086 bash[24289]: cluster 2024-09-16T06:32:27.968969+0000 mgr.a (mgr.14373) 2399 : cluster [DBG] pgmap v1663: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:32:29.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:32:29 smithi047 bash[22744]: audit 2024-09-16T06:32:27.524771+0000 mgr.a (mgr.14373) 2398 : audit [DBG] from='client.63816 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:32:29.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:32:29 smithi047 bash[22744]: cluster 2024-09-16T06:32:27.968969+0000 mgr.a (mgr.14373) 2399 : cluster [DBG] pgmap v1663: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:32:30.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:32:30 smithi157 bash[24585]: cluster 2024-09-16T06:32:29.969813+0000 mgr.a (mgr.14373) 2400 : cluster [DBG] pgmap v1664: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:32:30.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:32:30 smithi086 bash[24289]: cluster 2024-09-16T06:32:29.969813+0000 mgr.a (mgr.14373) 2400 : cluster [DBG] pgmap v1664: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:32:30.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:32:30 smithi047 bash[22744]: cluster 2024-09-16T06:32:29.969813+0000 mgr.a (mgr.14373) 2400 : cluster [DBG] pgmap v1664: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:32:32.932 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:32:32.933 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:32:32.933 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:32:33.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:32:33 smithi157 bash[24585]: cluster 2024-09-16T06:32:31.971955+0000 mgr.a (mgr.14373) 2401 : cluster [DBG] pgmap v1665: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:32:33.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:32:33 smithi086 bash[24289]: cluster 2024-09-16T06:32:31.971955+0000 mgr.a (mgr.14373) 2401 : cluster [DBG] pgmap v1665: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:32:33.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:32:33 smithi047 bash[22744]: cluster 2024-09-16T06:32:31.971955+0000 mgr.a (mgr.14373) 2401 : cluster [DBG] pgmap v1665: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:32:33.669 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:32:33.669 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:32:33.669 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:32:33.670 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:32:33.670 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:32:35.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:32:35 smithi157 bash[24585]: audit 2024-09-16T06:32:33.264275+0000 mgr.a (mgr.14373) 2402 : audit [DBG] from='client.63894 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:32:35.305 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:32:35 smithi157 bash[24585]: cluster 2024-09-16T06:32:33.972936+0000 mgr.a (mgr.14373) 2403 : cluster [DBG] pgmap v1666: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:32:35.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:32:35 smithi086 bash[24289]: audit 2024-09-16T06:32:33.264275+0000 mgr.a (mgr.14373) 2402 : audit [DBG] from='client.63894 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:32:35.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:32:35 smithi086 bash[24289]: cluster 2024-09-16T06:32:33.972936+0000 mgr.a (mgr.14373) 2403 : cluster [DBG] pgmap v1666: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:32:35.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:32:35 smithi047 bash[22744]: audit 2024-09-16T06:32:33.264275+0000 mgr.a (mgr.14373) 2402 : audit [DBG] from='client.63894 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:32:35.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:32:35 smithi047 bash[22744]: cluster 2024-09-16T06:32:33.972936+0000 mgr.a (mgr.14373) 2403 : cluster [DBG] pgmap v1666: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:32:36.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:32:36 smithi157 bash[24585]: audit 2024-09-16T06:32:35.220006+0000 mon.b (mon.2) 262 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T06:32:36.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:32:36 smithi086 bash[24289]: audit 2024-09-16T06:32:35.220006+0000 mon.b (mon.2) 262 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T06:32:36.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:32:36 smithi047 bash[22744]: audit 2024-09-16T06:32:35.220006+0000 mon.b (mon.2) 262 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T06:32:37.089 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 06:32:36 smithi047 bash[22994]: debug 2024-09-16T06:32:36.823+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T06:32:37.089 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 06:32:36 smithi047 bash[22994]: debug 2024-09-16T06:32:36.823+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T06:32:37.090 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:32:37 smithi047 bash[22744]: cluster 2024-09-16T06:32:35.973695+0000 mgr.a (mgr.14373) 2404 : cluster [DBG] pgmap v1667: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:32:37.090 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:32:37 smithi047 bash[22744]: audit 2024-09-16T06:32:36.063864+0000 mon.b (mon.2) 263 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T06:32:37.090 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:32:37 smithi047 bash[22744]: audit 2024-09-16T06:32:36.066169+0000 mon.b (mon.2) 264 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T06:32:37.090 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:32:37 smithi047 bash[22744]: audit 2024-09-16T06:32:36.079531+0000 mon.a (mon.0) 709 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:32:37.090 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:32:37 smithi047 bash[22744]: audit 2024-09-16T06:32:36.080887+0000 mon.b (mon.2) 265 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:32:37.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:32:37 smithi157 bash[24585]: cluster 2024-09-16T06:32:35.973695+0000 mgr.a (mgr.14373) 2404 : cluster [DBG] pgmap v1667: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:32:37.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:32:37 smithi157 bash[24585]: audit 2024-09-16T06:32:36.063864+0000 mon.b (mon.2) 263 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T06:32:37.305 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:32:37 smithi157 bash[24585]: audit 2024-09-16T06:32:36.066169+0000 mon.b (mon.2) 264 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T06:32:37.305 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:32:37 smithi157 bash[24585]: audit 2024-09-16T06:32:36.079531+0000 mon.a (mon.0) 709 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:32:37.305 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:32:37 smithi157 bash[24585]: audit 2024-09-16T06:32:36.080887+0000 mon.b (mon.2) 265 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:32:37.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:32:37 smithi086 bash[24289]: cluster 2024-09-16T06:32:35.973695+0000 mgr.a (mgr.14373) 2404 : cluster [DBG] pgmap v1667: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:32:37.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:32:37 smithi086 bash[24289]: audit 2024-09-16T06:32:36.063864+0000 mon.b (mon.2) 263 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T06:32:37.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:32:37 smithi086 bash[24289]: audit 2024-09-16T06:32:36.066169+0000 mon.b (mon.2) 264 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T06:32:37.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:32:37 smithi086 bash[24289]: audit 2024-09-16T06:32:36.079531+0000 mon.a (mon.0) 709 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:32:37.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:32:37 smithi086 bash[24289]: audit 2024-09-16T06:32:36.080887+0000 mon.b (mon.2) 265 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:32:38.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:32:38 smithi157 bash[24585]: audit 2024-09-16T06:32:36.084262+0000 mgr.a (mgr.14373) 2405 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:32:38.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:32:38 smithi157 bash[24585]: audit 2024-09-16T06:32:36.828435+0000 mgr.a (mgr.14373) 2406 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T06:32:38.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:32:38 smithi157 bash[24585]: cephadm 2024-09-16T06:32:36.830289+0000 mgr.a (mgr.14373) 2407 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T06:32:38.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:32:38 smithi157 bash[24585]: cluster 2024-09-16T06:32:37.976421+0000 mgr.a (mgr.14373) 2408 : cluster [DBG] pgmap v1668: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 4.3 KiB/s rd, 255 B/s wr, 4 op/s 2024-09-16T06:32:38.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:32:38 smithi086 bash[24289]: audit 2024-09-16T06:32:36.084262+0000 mgr.a (mgr.14373) 2405 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:32:38.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:32:38 smithi086 bash[24289]: audit 2024-09-16T06:32:36.828435+0000 mgr.a (mgr.14373) 2406 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T06:32:38.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:32:38 smithi086 bash[24289]: cephadm 2024-09-16T06:32:36.830289+0000 mgr.a (mgr.14373) 2407 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T06:32:38.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:32:38 smithi086 bash[24289]: cluster 2024-09-16T06:32:37.976421+0000 mgr.a (mgr.14373) 2408 : cluster [DBG] pgmap v1668: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 4.3 KiB/s rd, 255 B/s wr, 4 op/s 2024-09-16T06:32:38.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:32:38 smithi047 bash[22744]: audit 2024-09-16T06:32:36.084262+0000 mgr.a (mgr.14373) 2405 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:32:38.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:32:38 smithi047 bash[22744]: audit 2024-09-16T06:32:36.828435+0000 mgr.a (mgr.14373) 2406 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T06:32:38.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:32:38 smithi047 bash[22744]: cephadm 2024-09-16T06:32:36.830289+0000 mgr.a (mgr.14373) 2407 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T06:32:38.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:32:38 smithi047 bash[22744]: cluster 2024-09-16T06:32:37.976421+0000 mgr.a (mgr.14373) 2408 : cluster [DBG] pgmap v1668: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 4.3 KiB/s rd, 255 B/s wr, 4 op/s 2024-09-16T06:32:38.670 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:32:38.671 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:32:38.671 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:32:39.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:32:39 smithi157 bash[24585]: audit 2024-09-16T06:32:39.003866+0000 mgr.a (mgr.14373) 2409 : audit [DBG] from='client.64077 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:32:39.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:32:39 smithi086 bash[24289]: audit 2024-09-16T06:32:39.003866+0000 mgr.a (mgr.14373) 2409 : audit [DBG] from='client.64077 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:32:39.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:32:39 smithi047 bash[22744]: audit 2024-09-16T06:32:39.003866+0000 mgr.a (mgr.14373) 2409 : audit [DBG] from='client.64077 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:32:39.430 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:32:39.431 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:32:39.431 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:32:39.431 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:32:39.431 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:32:40.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:32:40 smithi086 bash[24289]: cluster 2024-09-16T06:32:39.977406+0000 mgr.a (mgr.14373) 2410 : cluster [DBG] pgmap v1669: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 3.4 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-16T06:32:40.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:32:40 smithi047 bash[22744]: cluster 2024-09-16T06:32:39.977406+0000 mgr.a (mgr.14373) 2410 : cluster [DBG] pgmap v1669: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 3.4 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-16T06:32:40.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:32:40 smithi157 bash[24585]: cluster 2024-09-16T06:32:39.977406+0000 mgr.a (mgr.14373) 2410 : cluster [DBG] pgmap v1669: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 3.4 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-16T06:32:43.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:32:42 smithi157 bash[24585]: cluster 2024-09-16T06:32:41.980523+0000 mgr.a (mgr.14373) 2411 : cluster [DBG] pgmap v1670: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:32:43.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:32:42 smithi086 bash[24289]: cluster 2024-09-16T06:32:41.980523+0000 mgr.a (mgr.14373) 2411 : cluster [DBG] pgmap v1670: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:32:43.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:32:42 smithi047 bash[22744]: cluster 2024-09-16T06:32:41.980523+0000 mgr.a (mgr.14373) 2411 : cluster [DBG] pgmap v1670: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:32:44.432 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:32:44.433 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:32:44.433 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:32:45.173 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:32:45.173 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:32:45.173 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:32:45.174 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:32:45.174 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:32:45.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:32:45 smithi157 bash[24585]: cluster 2024-09-16T06:32:43.981327+0000 mgr.a (mgr.14373) 2412 : cluster [DBG] pgmap v1671: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:32:45.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:32:45 smithi086 bash[24289]: cluster 2024-09-16T06:32:43.981327+0000 mgr.a (mgr.14373) 2412 : cluster [DBG] pgmap v1671: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:32:45.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:32:45 smithi047 bash[22744]: cluster 2024-09-16T06:32:43.981327+0000 mgr.a (mgr.14373) 2412 : cluster [DBG] pgmap v1671: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:32:46.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:32:46 smithi157 bash[24585]: audit 2024-09-16T06:32:44.766323+0000 mgr.a (mgr.14373) 2413 : audit [DBG] from='client.64155 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:32:46.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:32:46 smithi086 bash[24289]: audit 2024-09-16T06:32:44.766323+0000 mgr.a (mgr.14373) 2413 : audit [DBG] from='client.64155 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:32:46.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:32:46 smithi047 bash[22744]: audit 2024-09-16T06:32:44.766323+0000 mgr.a (mgr.14373) 2413 : audit [DBG] from='client.64155 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:32:47.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:32:47 smithi157 bash[24585]: cluster 2024-09-16T06:32:45.982387+0000 mgr.a (mgr.14373) 2414 : cluster [DBG] pgmap v1672: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:32:47.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:32:47 smithi086 bash[24289]: cluster 2024-09-16T06:32:45.982387+0000 mgr.a (mgr.14373) 2414 : cluster [DBG] pgmap v1672: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:32:47.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:32:47 smithi047 bash[22744]: cluster 2024-09-16T06:32:45.982387+0000 mgr.a (mgr.14373) 2414 : cluster [DBG] pgmap v1672: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:32:49.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:32:49 smithi157 bash[24585]: cluster 2024-09-16T06:32:47.984730+0000 mgr.a (mgr.14373) 2415 : cluster [DBG] pgmap v1673: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:32:49.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:32:49 smithi086 bash[24289]: cluster 2024-09-16T06:32:47.984730+0000 mgr.a (mgr.14373) 2415 : cluster [DBG] pgmap v1673: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:32:49.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:32:49 smithi047 bash[22744]: cluster 2024-09-16T06:32:47.984730+0000 mgr.a (mgr.14373) 2415 : cluster [DBG] pgmap v1673: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:32:50.174 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:32:50.175 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:32:50.176 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:32:50.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:32:50 smithi157 bash[24585]: cluster 2024-09-16T06:32:49.985514+0000 mgr.a (mgr.14373) 2416 : cluster [DBG] pgmap v1674: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 5.4 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-16T06:32:50.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:32:50 smithi086 bash[24289]: cluster 2024-09-16T06:32:49.985514+0000 mgr.a (mgr.14373) 2416 : cluster [DBG] pgmap v1674: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 5.4 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-16T06:32:50.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:32:50 smithi047 bash[22744]: cluster 2024-09-16T06:32:49.985514+0000 mgr.a (mgr.14373) 2416 : cluster [DBG] pgmap v1674: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 5.4 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-16T06:32:50.936 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:32:50.936 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:32:50.936 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:32:50.936 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:32:50.936 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:32:51.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:32:51 smithi086 bash[24289]: audit 2024-09-16T06:32:50.509670+0000 mgr.a (mgr.14373) 2417 : audit [DBG] from='client.64233 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:32:51.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:32:51 smithi047 bash[22744]: audit 2024-09-16T06:32:50.509670+0000 mgr.a (mgr.14373) 2417 : audit [DBG] from='client.64233 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:32:51.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:32:51 smithi157 bash[24585]: audit 2024-09-16T06:32:50.509670+0000 mgr.a (mgr.14373) 2417 : audit [DBG] from='client.64233 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:32:52.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:32:52 smithi086 bash[24289]: cluster 2024-09-16T06:32:51.987810+0000 mgr.a (mgr.14373) 2418 : cluster [DBG] pgmap v1675: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-16T06:32:52.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:32:52 smithi047 bash[22744]: cluster 2024-09-16T06:32:51.987810+0000 mgr.a (mgr.14373) 2418 : cluster [DBG] pgmap v1675: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-16T06:32:52.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:32:52 smithi157 bash[24585]: cluster 2024-09-16T06:32:51.987810+0000 mgr.a (mgr.14373) 2418 : cluster [DBG] pgmap v1675: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-16T06:32:55.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:32:55 smithi157 bash[24585]: cluster 2024-09-16T06:32:53.988553+0000 mgr.a (mgr.14373) 2419 : cluster [DBG] pgmap v1676: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:32:55.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:32:55 smithi086 bash[24289]: cluster 2024-09-16T06:32:53.988553+0000 mgr.a (mgr.14373) 2419 : cluster [DBG] pgmap v1676: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:32:55.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:32:55 smithi047 bash[22744]: cluster 2024-09-16T06:32:53.988553+0000 mgr.a (mgr.14373) 2419 : cluster [DBG] pgmap v1676: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:32:55.937 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:32:55.938 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:32:55.938 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:32:56.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:32:56 smithi157 bash[24585]: cluster 2024-09-16T06:32:55.989310+0000 mgr.a (mgr.14373) 2420 : cluster [DBG] pgmap v1677: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:32:56.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:32:56 smithi086 bash[24289]: cluster 2024-09-16T06:32:55.989310+0000 mgr.a (mgr.14373) 2420 : cluster [DBG] pgmap v1677: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:32:56.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:32:56 smithi047 bash[22744]: cluster 2024-09-16T06:32:55.989310+0000 mgr.a (mgr.14373) 2420 : cluster [DBG] pgmap v1677: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:32:56.702 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:32:56.702 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:32:56.702 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:32:56.702 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:32:56.702 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:32:57.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:32:57 smithi157 bash[24585]: audit 2024-09-16T06:32:56.270545+0000 mgr.a (mgr.14373) 2421 : audit [DBG] from='client.64311 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:32:57.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:32:57 smithi086 bash[24289]: audit 2024-09-16T06:32:56.270545+0000 mgr.a (mgr.14373) 2421 : audit [DBG] from='client.64311 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:32:57.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:32:57 smithi047 bash[22744]: audit 2024-09-16T06:32:56.270545+0000 mgr.a (mgr.14373) 2421 : audit [DBG] from='client.64311 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:32:58.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:32:58 smithi157 bash[24585]: cluster 2024-09-16T06:32:57.991967+0000 mgr.a (mgr.14373) 2422 : cluster [DBG] pgmap v1678: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:32:58.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:32:58 smithi086 bash[24289]: cluster 2024-09-16T06:32:57.991967+0000 mgr.a (mgr.14373) 2422 : cluster [DBG] pgmap v1678: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:32:58.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:32:58 smithi047 bash[22744]: cluster 2024-09-16T06:32:57.991967+0000 mgr.a (mgr.14373) 2422 : cluster [DBG] pgmap v1678: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:33:00.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:33:00 smithi157 bash[24585]: cluster 2024-09-16T06:32:59.992740+0000 mgr.a (mgr.14373) 2423 : cluster [DBG] pgmap v1679: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:33:00.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:33:00 smithi086 bash[24289]: cluster 2024-09-16T06:32:59.992740+0000 mgr.a (mgr.14373) 2423 : cluster [DBG] pgmap v1679: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:33:00.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:33:00 smithi047 bash[22744]: cluster 2024-09-16T06:32:59.992740+0000 mgr.a (mgr.14373) 2423 : cluster [DBG] pgmap v1679: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:33:01.703 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:33:01.704 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:33:01.705 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:33:02.442 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:33:02.443 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:33:02.443 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:33:02.443 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:33:02.443 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:33:03.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:33:03 smithi157 bash[24585]: cluster 2024-09-16T06:33:01.994695+0000 mgr.a (mgr.14373) 2424 : cluster [DBG] pgmap v1680: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-16T06:33:03.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:33:03 smithi157 bash[24585]: audit 2024-09-16T06:33:02.037831+0000 mgr.a (mgr.14373) 2425 : audit [DBG] from='client.64386 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:33:03.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:33:03 smithi086 bash[24289]: cluster 2024-09-16T06:33:01.994695+0000 mgr.a (mgr.14373) 2424 : cluster [DBG] pgmap v1680: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-16T06:33:03.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:33:03 smithi086 bash[24289]: audit 2024-09-16T06:33:02.037831+0000 mgr.a (mgr.14373) 2425 : audit [DBG] from='client.64386 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:33:03.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:33:03 smithi047 bash[22744]: cluster 2024-09-16T06:33:01.994695+0000 mgr.a (mgr.14373) 2424 : cluster [DBG] pgmap v1680: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-16T06:33:03.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:33:03 smithi047 bash[22744]: audit 2024-09-16T06:33:02.037831+0000 mgr.a (mgr.14373) 2425 : audit [DBG] from='client.64386 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:33:04.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:33:04 smithi086 bash[24289]: cluster 2024-09-16T06:33:03.995708+0000 mgr.a (mgr.14373) 2426 : cluster [DBG] pgmap v1681: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T06:33:04.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:33:04 smithi047 bash[22744]: cluster 2024-09-16T06:33:03.995708+0000 mgr.a (mgr.14373) 2426 : cluster [DBG] pgmap v1681: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T06:33:04.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:33:04 smithi157 bash[24585]: cluster 2024-09-16T06:33:03.995708+0000 mgr.a (mgr.14373) 2426 : cluster [DBG] pgmap v1681: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T06:33:06.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:33:06 smithi157 bash[24585]: cluster 2024-09-16T06:33:05.996540+0000 mgr.a (mgr.14373) 2427 : cluster [DBG] pgmap v1682: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T06:33:06.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:33:06 smithi086 bash[24289]: cluster 2024-09-16T06:33:05.996540+0000 mgr.a (mgr.14373) 2427 : cluster [DBG] pgmap v1682: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T06:33:06.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:33:06 smithi047 bash[22744]: cluster 2024-09-16T06:33:05.996540+0000 mgr.a (mgr.14373) 2427 : cluster [DBG] pgmap v1682: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T06:33:07.444 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:33:07.445 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:33:07.445 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:33:08.187 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:33:08.187 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:33:08.188 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:33:08.188 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:33:08.188 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:33:08.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:33:08 smithi157 bash[24585]: audit 2024-09-16T06:33:07.779151+0000 mgr.a (mgr.14373) 2428 : audit [DBG] from='client.64464 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:33:08.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:33:08 smithi157 bash[24585]: cluster 2024-09-16T06:33:07.998384+0000 mgr.a (mgr.14373) 2429 : cluster [DBG] pgmap v1683: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-16T06:33:08.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:33:08 smithi086 bash[24289]: audit 2024-09-16T06:33:07.779151+0000 mgr.a (mgr.14373) 2428 : audit [DBG] from='client.64464 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:33:08.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:33:08 smithi086 bash[24289]: cluster 2024-09-16T06:33:07.998384+0000 mgr.a (mgr.14373) 2429 : cluster [DBG] pgmap v1683: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-16T06:33:08.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:33:08 smithi047 bash[22744]: audit 2024-09-16T06:33:07.779151+0000 mgr.a (mgr.14373) 2428 : audit [DBG] from='client.64464 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:33:08.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:33:08 smithi047 bash[22744]: cluster 2024-09-16T06:33:07.998384+0000 mgr.a (mgr.14373) 2429 : cluster [DBG] pgmap v1683: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-16T06:33:10.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:33:10 smithi157 bash[24585]: cluster 2024-09-16T06:33:09.999243+0000 mgr.a (mgr.14373) 2430 : cluster [DBG] pgmap v1684: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-16T06:33:10.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:33:10 smithi086 bash[24289]: cluster 2024-09-16T06:33:09.999243+0000 mgr.a (mgr.14373) 2430 : cluster [DBG] pgmap v1684: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-16T06:33:10.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:33:10 smithi047 bash[22744]: cluster 2024-09-16T06:33:09.999243+0000 mgr.a (mgr.14373) 2430 : cluster [DBG] pgmap v1684: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-16T06:33:12.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:33:12 smithi157 bash[24585]: cluster 2024-09-16T06:33:12.001436+0000 mgr.a (mgr.14373) 2431 : cluster [DBG] pgmap v1685: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 3.2 KiB/s rd, 2 op/s 2024-09-16T06:33:12.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:33:12 smithi086 bash[24289]: cluster 2024-09-16T06:33:12.001436+0000 mgr.a (mgr.14373) 2431 : cluster [DBG] pgmap v1685: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 3.2 KiB/s rd, 2 op/s 2024-09-16T06:33:12.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:33:12 smithi047 bash[22744]: cluster 2024-09-16T06:33:12.001436+0000 mgr.a (mgr.14373) 2431 : cluster [DBG] pgmap v1685: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 3.2 KiB/s rd, 2 op/s 2024-09-16T06:33:13.188 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:33:13.189 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:33:13.189 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:33:13.957 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:33:13.957 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:33:13.957 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:33:13.957 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:33:13.957 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:33:14.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:33:14 smithi157 bash[24585]: audit 2024-09-16T06:33:13.525880+0000 mgr.a (mgr.14373) 2432 : audit [DBG] from='client.64539 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:33:14.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:33:14 smithi157 bash[24585]: cluster 2024-09-16T06:33:14.002100+0000 mgr.a (mgr.14373) 2433 : cluster [DBG] pgmap v1686: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:33:14.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:33:14 smithi086 bash[24289]: audit 2024-09-16T06:33:13.525880+0000 mgr.a (mgr.14373) 2432 : audit [DBG] from='client.64539 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:33:14.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:33:14 smithi086 bash[24289]: cluster 2024-09-16T06:33:14.002100+0000 mgr.a (mgr.14373) 2433 : cluster [DBG] pgmap v1686: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:33:14.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:33:14 smithi047 bash[22744]: audit 2024-09-16T06:33:13.525880+0000 mgr.a (mgr.14373) 2432 : audit [DBG] from='client.64539 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:33:14.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:33:14 smithi047 bash[22744]: cluster 2024-09-16T06:33:14.002100+0000 mgr.a (mgr.14373) 2433 : cluster [DBG] pgmap v1686: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:33:16.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:33:16 smithi157 bash[24585]: cluster 2024-09-16T06:33:16.002859+0000 mgr.a (mgr.14373) 2434 : cluster [DBG] pgmap v1687: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:33:16.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:33:16 smithi086 bash[24289]: cluster 2024-09-16T06:33:16.002859+0000 mgr.a (mgr.14373) 2434 : cluster [DBG] pgmap v1687: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:33:16.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:33:16 smithi047 bash[22744]: cluster 2024-09-16T06:33:16.002859+0000 mgr.a (mgr.14373) 2434 : cluster [DBG] pgmap v1687: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:33:18.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:33:18 smithi157 bash[24585]: cluster 2024-09-16T06:33:18.005085+0000 mgr.a (mgr.14373) 2435 : cluster [DBG] pgmap v1688: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:33:18.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:33:18 smithi086 bash[24289]: cluster 2024-09-16T06:33:18.005085+0000 mgr.a (mgr.14373) 2435 : cluster [DBG] pgmap v1688: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:33:18.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:33:18 smithi047 bash[22744]: cluster 2024-09-16T06:33:18.005085+0000 mgr.a (mgr.14373) 2435 : cluster [DBG] pgmap v1688: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:33:18.958 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:33:18.959 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:33:18.959 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:33:19.705 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:33:19.706 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:33:19.706 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:33:19.706 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:33:19.706 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:33:20.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:33:20 smithi157 bash[24585]: audit 2024-09-16T06:33:19.290922+0000 mgr.a (mgr.14373) 2436 : audit [DBG] from='client.64614 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:33:20.555 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:33:20 smithi157 bash[24585]: cluster 2024-09-16T06:33:20.006087+0000 mgr.a (mgr.14373) 2437 : cluster [DBG] pgmap v1689: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:33:20.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:33:20 smithi086 bash[24289]: audit 2024-09-16T06:33:19.290922+0000 mgr.a (mgr.14373) 2436 : audit [DBG] from='client.64614 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:33:20.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:33:20 smithi086 bash[24289]: cluster 2024-09-16T06:33:20.006087+0000 mgr.a (mgr.14373) 2437 : cluster [DBG] pgmap v1689: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:33:20.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:33:20 smithi047 bash[22744]: audit 2024-09-16T06:33:19.290922+0000 mgr.a (mgr.14373) 2436 : audit [DBG] from='client.64614 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:33:20.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:33:20 smithi047 bash[22744]: cluster 2024-09-16T06:33:20.006087+0000 mgr.a (mgr.14373) 2437 : cluster [DBG] pgmap v1689: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:33:22.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:33:22 smithi157 bash[24585]: cluster 2024-09-16T06:33:22.008457+0000 mgr.a (mgr.14373) 2438 : cluster [DBG] pgmap v1690: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:33:22.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:33:22 smithi086 bash[24289]: cluster 2024-09-16T06:33:22.008457+0000 mgr.a (mgr.14373) 2438 : cluster [DBG] pgmap v1690: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:33:22.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:33:22 smithi047 bash[22744]: cluster 2024-09-16T06:33:22.008457+0000 mgr.a (mgr.14373) 2438 : cluster [DBG] pgmap v1690: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:33:24.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:33:24 smithi157 bash[24585]: cluster 2024-09-16T06:33:24.009388+0000 mgr.a (mgr.14373) 2439 : cluster [DBG] pgmap v1691: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:33:24.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:33:24 smithi086 bash[24289]: cluster 2024-09-16T06:33:24.009388+0000 mgr.a (mgr.14373) 2439 : cluster [DBG] pgmap v1691: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:33:24.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:33:24 smithi047 bash[22744]: cluster 2024-09-16T06:33:24.009388+0000 mgr.a (mgr.14373) 2439 : cluster [DBG] pgmap v1691: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:33:24.707 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:33:24.708 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:33:24.708 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:33:25.477 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:33:25.477 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:33:25.477 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:33:25.477 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:33:25.477 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:33:25.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:33:25 smithi157 bash[24585]: audit 2024-09-16T06:33:25.046328+0000 mgr.a (mgr.14373) 2440 : audit [DBG] from='client.64692 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:33:25.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:33:25 smithi086 bash[24289]: audit 2024-09-16T06:33:25.046328+0000 mgr.a (mgr.14373) 2440 : audit [DBG] from='client.64692 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:33:25.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:33:25 smithi047 bash[22744]: audit 2024-09-16T06:33:25.046328+0000 mgr.a (mgr.14373) 2440 : audit [DBG] from='client.64692 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:33:26.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:33:26 smithi157 bash[24585]: cluster 2024-09-16T06:33:26.010317+0000 mgr.a (mgr.14373) 2441 : cluster [DBG] pgmap v1692: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:33:26.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:33:26 smithi086 bash[24289]: cluster 2024-09-16T06:33:26.010317+0000 mgr.a (mgr.14373) 2441 : cluster [DBG] pgmap v1692: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:33:26.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:33:26 smithi047 bash[22744]: cluster 2024-09-16T06:33:26.010317+0000 mgr.a (mgr.14373) 2441 : cluster [DBG] pgmap v1692: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:33:28.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:33:28 smithi157 bash[24585]: cluster 2024-09-16T06:33:28.012543+0000 mgr.a (mgr.14373) 2442 : cluster [DBG] pgmap v1693: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:33:28.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:33:28 smithi086 bash[24289]: cluster 2024-09-16T06:33:28.012543+0000 mgr.a (mgr.14373) 2442 : cluster [DBG] pgmap v1693: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:33:28.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:33:28 smithi047 bash[22744]: cluster 2024-09-16T06:33:28.012543+0000 mgr.a (mgr.14373) 2442 : cluster [DBG] pgmap v1693: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:33:30.478 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:33:30.479 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:33:30.479 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:33:30.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:33:30 smithi157 bash[24585]: cluster 2024-09-16T06:33:30.013290+0000 mgr.a (mgr.14373) 2443 : cluster [DBG] pgmap v1694: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:33:30.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:33:30 smithi086 bash[24289]: cluster 2024-09-16T06:33:30.013290+0000 mgr.a (mgr.14373) 2443 : cluster [DBG] pgmap v1694: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:33:30.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:33:30 smithi047 bash[22744]: cluster 2024-09-16T06:33:30.013290+0000 mgr.a (mgr.14373) 2443 : cluster [DBG] pgmap v1694: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:33:31.254 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:33:31.254 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:33:31.255 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:33:31.255 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:33:31.255 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:33:31.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:33:31 smithi157 bash[24585]: audit 2024-09-16T06:33:30.818513+0000 mgr.a (mgr.14373) 2444 : audit [DBG] from='client.64770 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:33:31.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:33:31 smithi086 bash[24289]: audit 2024-09-16T06:33:30.818513+0000 mgr.a (mgr.14373) 2444 : audit [DBG] from='client.64770 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:33:31.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:33:31 smithi047 bash[22744]: audit 2024-09-16T06:33:30.818513+0000 mgr.a (mgr.14373) 2444 : audit [DBG] from='client.64770 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:33:32.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:33:32 smithi157 bash[24585]: cluster 2024-09-16T06:33:32.015612+0000 mgr.a (mgr.14373) 2445 : cluster [DBG] pgmap v1695: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:33:32.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:33:32 smithi086 bash[24289]: cluster 2024-09-16T06:33:32.015612+0000 mgr.a (mgr.14373) 2445 : cluster [DBG] pgmap v1695: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:33:32.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:33:32 smithi047 bash[22744]: cluster 2024-09-16T06:33:32.015612+0000 mgr.a (mgr.14373) 2445 : cluster [DBG] pgmap v1695: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:33:34.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:33:34 smithi157 bash[24585]: cluster 2024-09-16T06:33:34.016365+0000 mgr.a (mgr.14373) 2446 : cluster [DBG] pgmap v1696: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:33:34.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:33:34 smithi086 bash[24289]: cluster 2024-09-16T06:33:34.016365+0000 mgr.a (mgr.14373) 2446 : cluster [DBG] pgmap v1696: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:33:34.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:33:34 smithi047 bash[22744]: cluster 2024-09-16T06:33:34.016365+0000 mgr.a (mgr.14373) 2446 : cluster [DBG] pgmap v1696: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:33:36.256 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:33:36.257 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:33:36.257 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:33:36.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:33:36 smithi157 bash[24585]: cluster 2024-09-16T06:33:36.017112+0000 mgr.a (mgr.14373) 2447 : cluster [DBG] pgmap v1697: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:33:36.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:33:36 smithi086 bash[24289]: cluster 2024-09-16T06:33:36.017112+0000 mgr.a (mgr.14373) 2447 : cluster [DBG] pgmap v1697: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:33:36.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:33:36 smithi047 bash[22744]: cluster 2024-09-16T06:33:36.017112+0000 mgr.a (mgr.14373) 2447 : cluster [DBG] pgmap v1697: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:33:37.009 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:33:37.010 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:33:37.010 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:33:37.010 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:33:37.010 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:33:37.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:33:37 smithi157 bash[24585]: audit 2024-09-16T06:33:36.590932+0000 mgr.a (mgr.14373) 2448 : audit [DBG] from='client.64845 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:33:37.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:33:37 smithi157 bash[24585]: audit 2024-09-16T06:33:36.882008+0000 mon.b (mon.2) 266 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T06:33:37.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:33:37 smithi086 bash[24289]: audit 2024-09-16T06:33:36.590932+0000 mgr.a (mgr.14373) 2448 : audit [DBG] from='client.64845 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:33:37.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:33:37 smithi086 bash[24289]: audit 2024-09-16T06:33:36.882008+0000 mon.b (mon.2) 266 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T06:33:37.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:33:37 smithi047 bash[22744]: audit 2024-09-16T06:33:36.590932+0000 mgr.a (mgr.14373) 2448 : audit [DBG] from='client.64845 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:33:37.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:33:37 smithi047 bash[22744]: audit 2024-09-16T06:33:36.882008+0000 mon.b (mon.2) 266 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T06:33:38.438 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:33:38 smithi047 bash[22744]: audit 2024-09-16T06:33:37.667311+0000 mon.b (mon.2) 267 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T06:33:38.438 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:33:38 smithi047 bash[22744]: audit 2024-09-16T06:33:37.669667+0000 mon.b (mon.2) 268 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T06:33:38.438 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:33:38 smithi047 bash[22744]: audit 2024-09-16T06:33:37.683524+0000 mon.a (mon.0) 710 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:33:38.438 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:33:38 smithi047 bash[22744]: audit 2024-09-16T06:33:37.687019+0000 mon.b (mon.2) 269 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:33:38.438 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:33:38 smithi047 bash[22744]: audit 2024-09-16T06:33:37.691825+0000 mgr.a (mgr.14373) 2449 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:33:38.438 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:33:38 smithi047 bash[22744]: cluster 2024-09-16T06:33:38.024927+0000 mgr.a (mgr.14373) 2450 : cluster [DBG] pgmap v1698: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:33:38.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:33:38 smithi157 bash[24585]: audit 2024-09-16T06:33:37.667311+0000 mon.b (mon.2) 267 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T06:33:38.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:33:38 smithi157 bash[24585]: audit 2024-09-16T06:33:37.669667+0000 mon.b (mon.2) 268 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T06:33:38.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:33:38 smithi157 bash[24585]: audit 2024-09-16T06:33:37.683524+0000 mon.a (mon.0) 710 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:33:38.555 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:33:38 smithi157 bash[24585]: audit 2024-09-16T06:33:37.687019+0000 mon.b (mon.2) 269 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:33:38.555 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:33:38 smithi157 bash[24585]: audit 2024-09-16T06:33:37.691825+0000 mgr.a (mgr.14373) 2449 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:33:38.555 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:33:38 smithi157 bash[24585]: cluster 2024-09-16T06:33:38.024927+0000 mgr.a (mgr.14373) 2450 : cluster [DBG] pgmap v1698: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:33:38.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:33:38 smithi086 bash[24289]: audit 2024-09-16T06:33:37.667311+0000 mon.b (mon.2) 267 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T06:33:38.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:33:38 smithi086 bash[24289]: audit 2024-09-16T06:33:37.669667+0000 mon.b (mon.2) 268 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T06:33:38.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:33:38 smithi086 bash[24289]: audit 2024-09-16T06:33:37.683524+0000 mon.a (mon.0) 710 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:33:38.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:33:38 smithi086 bash[24289]: audit 2024-09-16T06:33:37.687019+0000 mon.b (mon.2) 269 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:33:38.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:33:38 smithi086 bash[24289]: audit 2024-09-16T06:33:37.691825+0000 mgr.a (mgr.14373) 2449 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:33:38.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:33:38 smithi086 bash[24289]: cluster 2024-09-16T06:33:38.024927+0000 mgr.a (mgr.14373) 2450 : cluster [DBG] pgmap v1698: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:33:38.839 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 06:33:38 smithi047 bash[22994]: debug 2024-09-16T06:33:38.438+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T06:33:38.839 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 06:33:38 smithi047 bash[22994]: debug 2024-09-16T06:33:38.438+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T06:33:40.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:33:39 smithi157 bash[24585]: audit 2024-09-16T06:33:38.439935+0000 mgr.a (mgr.14373) 2451 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T06:33:40.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:33:39 smithi157 bash[24585]: cephadm 2024-09-16T06:33:38.442187+0000 mgr.a (mgr.14373) 2452 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T06:33:40.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:33:39 smithi086 bash[24289]: audit 2024-09-16T06:33:38.439935+0000 mgr.a (mgr.14373) 2451 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T06:33:40.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:33:39 smithi086 bash[24289]: cephadm 2024-09-16T06:33:38.442187+0000 mgr.a (mgr.14373) 2452 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T06:33:40.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:33:39 smithi047 bash[22744]: audit 2024-09-16T06:33:38.439935+0000 mgr.a (mgr.14373) 2451 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T06:33:40.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:33:39 smithi047 bash[22744]: cephadm 2024-09-16T06:33:38.442187+0000 mgr.a (mgr.14373) 2452 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T06:33:41.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:33:40 smithi157 bash[24585]: cluster 2024-09-16T06:33:40.025819+0000 mgr.a (mgr.14373) 2453 : cluster [DBG] pgmap v1699: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:33:41.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:33:40 smithi086 bash[24289]: cluster 2024-09-16T06:33:40.025819+0000 mgr.a (mgr.14373) 2453 : cluster [DBG] pgmap v1699: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:33:41.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:33:40 smithi047 bash[22744]: cluster 2024-09-16T06:33:40.025819+0000 mgr.a (mgr.14373) 2453 : cluster [DBG] pgmap v1699: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:33:42.011 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:33:42.012 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:33:42.012 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:33:42.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:33:42 smithi157 bash[24585]: cluster 2024-09-16T06:33:42.027648+0000 mgr.a (mgr.14373) 2454 : cluster [DBG] pgmap v1700: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:33:42.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:33:42 smithi086 bash[24289]: cluster 2024-09-16T06:33:42.027648+0000 mgr.a (mgr.14373) 2454 : cluster [DBG] pgmap v1700: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:33:42.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:33:42 smithi047 bash[22744]: cluster 2024-09-16T06:33:42.027648+0000 mgr.a (mgr.14373) 2454 : cluster [DBG] pgmap v1700: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:33:42.799 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:33:42.799 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:33:42.799 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:33:42.799 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:33:42.799 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:33:43.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:33:43 smithi157 bash[24585]: audit 2024-09-16T06:33:42.352863+0000 mgr.a (mgr.14373) 2455 : audit [DBG] from='client.65025 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:33:43.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:33:43 smithi086 bash[24289]: audit 2024-09-16T06:33:42.352863+0000 mgr.a (mgr.14373) 2455 : audit [DBG] from='client.65025 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:33:43.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:33:43 smithi047 bash[22744]: audit 2024-09-16T06:33:42.352863+0000 mgr.a (mgr.14373) 2455 : audit [DBG] from='client.65025 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:33:44.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:33:44 smithi157 bash[24585]: cluster 2024-09-16T06:33:44.028536+0000 mgr.a (mgr.14373) 2456 : cluster [DBG] pgmap v1701: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T06:33:44.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:33:44 smithi086 bash[24289]: cluster 2024-09-16T06:33:44.028536+0000 mgr.a (mgr.14373) 2456 : cluster [DBG] pgmap v1701: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T06:33:44.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:33:44 smithi047 bash[22744]: cluster 2024-09-16T06:33:44.028536+0000 mgr.a (mgr.14373) 2456 : cluster [DBG] pgmap v1701: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T06:33:46.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:33:46 smithi157 bash[24585]: cluster 2024-09-16T06:33:46.029291+0000 mgr.a (mgr.14373) 2457 : cluster [DBG] pgmap v1702: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T06:33:46.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:33:46 smithi086 bash[24289]: cluster 2024-09-16T06:33:46.029291+0000 mgr.a (mgr.14373) 2457 : cluster [DBG] pgmap v1702: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T06:33:46.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:33:46 smithi047 bash[22744]: cluster 2024-09-16T06:33:46.029291+0000 mgr.a (mgr.14373) 2457 : cluster [DBG] pgmap v1702: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T06:33:47.800 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:33:47.801 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:33:47.801 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:33:48.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:33:48 smithi157 bash[24585]: cluster 2024-09-16T06:33:48.031433+0000 mgr.a (mgr.14373) 2458 : cluster [DBG] pgmap v1703: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:33:48.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:33:48 smithi086 bash[24289]: cluster 2024-09-16T06:33:48.031433+0000 mgr.a (mgr.14373) 2458 : cluster [DBG] pgmap v1703: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:33:48.570 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:33:48.570 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:33:48.570 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:33:48.570 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:33:48.570 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:33:48.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:33:48 smithi047 bash[22744]: cluster 2024-09-16T06:33:48.031433+0000 mgr.a (mgr.14373) 2458 : cluster [DBG] pgmap v1703: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:33:49.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:33:49 smithi157 bash[24585]: audit 2024-09-16T06:33:48.139785+0000 mgr.a (mgr.14373) 2459 : audit [DBG] from='client.65103 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:33:49.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:33:49 smithi086 bash[24289]: audit 2024-09-16T06:33:48.139785+0000 mgr.a (mgr.14373) 2459 : audit [DBG] from='client.65103 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:33:49.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:33:49 smithi047 bash[22744]: audit 2024-09-16T06:33:48.139785+0000 mgr.a (mgr.14373) 2459 : audit [DBG] from='client.65103 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:33:50.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:33:50 smithi157 bash[24585]: cluster 2024-09-16T06:33:50.032321+0000 mgr.a (mgr.14373) 2460 : cluster [DBG] pgmap v1704: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:33:50.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:33:50 smithi086 bash[24289]: cluster 2024-09-16T06:33:50.032321+0000 mgr.a (mgr.14373) 2460 : cluster [DBG] pgmap v1704: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:33:50.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:33:50 smithi047 bash[22744]: cluster 2024-09-16T06:33:50.032321+0000 mgr.a (mgr.14373) 2460 : cluster [DBG] pgmap v1704: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:33:52.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:33:52 smithi157 bash[24585]: cluster 2024-09-16T06:33:52.034567+0000 mgr.a (mgr.14373) 2461 : cluster [DBG] pgmap v1705: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:33:52.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:33:52 smithi086 bash[24289]: cluster 2024-09-16T06:33:52.034567+0000 mgr.a (mgr.14373) 2461 : cluster [DBG] pgmap v1705: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:33:52.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:33:52 smithi047 bash[22744]: cluster 2024-09-16T06:33:52.034567+0000 mgr.a (mgr.14373) 2461 : cluster [DBG] pgmap v1705: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:33:53.571 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:33:53.572 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:33:53.572 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:33:54.329 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:33:54.329 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:33:54.329 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:33:54.330 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:33:54.330 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:33:54.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:33:54 smithi157 bash[24585]: audit 2024-09-16T06:33:53.906231+0000 mgr.a (mgr.14373) 2462 : audit [DBG] from='client.65178 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:33:54.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:33:54 smithi157 bash[24585]: cluster 2024-09-16T06:33:54.035058+0000 mgr.a (mgr.14373) 2463 : cluster [DBG] pgmap v1706: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:33:54.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:33:54 smithi086 bash[24289]: audit 2024-09-16T06:33:53.906231+0000 mgr.a (mgr.14373) 2462 : audit [DBG] from='client.65178 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:33:54.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:33:54 smithi086 bash[24289]: cluster 2024-09-16T06:33:54.035058+0000 mgr.a (mgr.14373) 2463 : cluster [DBG] pgmap v1706: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:33:54.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:33:54 smithi047 bash[22744]: audit 2024-09-16T06:33:53.906231+0000 mgr.a (mgr.14373) 2462 : audit [DBG] from='client.65178 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:33:54.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:33:54 smithi047 bash[22744]: cluster 2024-09-16T06:33:54.035058+0000 mgr.a (mgr.14373) 2463 : cluster [DBG] pgmap v1706: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:33:56.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:33:56 smithi157 bash[24585]: cluster 2024-09-16T06:33:56.035879+0000 mgr.a (mgr.14373) 2464 : cluster [DBG] pgmap v1707: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:33:56.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:33:56 smithi086 bash[24289]: cluster 2024-09-16T06:33:56.035879+0000 mgr.a (mgr.14373) 2464 : cluster [DBG] pgmap v1707: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:33:56.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:33:56 smithi047 bash[22744]: cluster 2024-09-16T06:33:56.035879+0000 mgr.a (mgr.14373) 2464 : cluster [DBG] pgmap v1707: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:33:58.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:33:58 smithi157 bash[24585]: cluster 2024-09-16T06:33:58.038365+0000 mgr.a (mgr.14373) 2465 : cluster [DBG] pgmap v1708: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:33:58.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:33:58 smithi086 bash[24289]: cluster 2024-09-16T06:33:58.038365+0000 mgr.a (mgr.14373) 2465 : cluster [DBG] pgmap v1708: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:33:58.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:33:58 smithi047 bash[22744]: cluster 2024-09-16T06:33:58.038365+0000 mgr.a (mgr.14373) 2465 : cluster [DBG] pgmap v1708: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:33:59.331 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:33:59.332 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:33:59.332 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:34:00.095 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:34:00.095 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:34:00.095 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:34:00.095 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:34:00.095 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:34:00.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:34:00 smithi157 bash[24585]: audit 2024-09-16T06:33:59.663590+0000 mgr.a (mgr.14373) 2466 : audit [DBG] from='client.65256 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:34:00.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:34:00 smithi157 bash[24585]: cluster 2024-09-16T06:34:00.038824+0000 mgr.a (mgr.14373) 2467 : cluster [DBG] pgmap v1709: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:34:00.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:34:00 smithi086 bash[24289]: audit 2024-09-16T06:33:59.663590+0000 mgr.a (mgr.14373) 2466 : audit [DBG] from='client.65256 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:34:00.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:34:00 smithi086 bash[24289]: cluster 2024-09-16T06:34:00.038824+0000 mgr.a (mgr.14373) 2467 : cluster [DBG] pgmap v1709: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:34:00.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:34:00 smithi047 bash[22744]: audit 2024-09-16T06:33:59.663590+0000 mgr.a (mgr.14373) 2466 : audit [DBG] from='client.65256 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:34:00.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:34:00 smithi047 bash[22744]: cluster 2024-09-16T06:34:00.038824+0000 mgr.a (mgr.14373) 2467 : cluster [DBG] pgmap v1709: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:34:02.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:34:02 smithi157 bash[24585]: cluster 2024-09-16T06:34:02.040950+0000 mgr.a (mgr.14373) 2468 : cluster [DBG] pgmap v1710: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:34:02.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:34:02 smithi086 bash[24289]: cluster 2024-09-16T06:34:02.040950+0000 mgr.a (mgr.14373) 2468 : cluster [DBG] pgmap v1710: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:34:02.590 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:34:02 smithi047 bash[22744]: cluster 2024-09-16T06:34:02.040950+0000 mgr.a (mgr.14373) 2468 : cluster [DBG] pgmap v1710: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:34:04.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:34:04 smithi157 bash[24585]: cluster 2024-09-16T06:34:04.041722+0000 mgr.a (mgr.14373) 2469 : cluster [DBG] pgmap v1711: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:34:04.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:34:04 smithi086 bash[24289]: cluster 2024-09-16T06:34:04.041722+0000 mgr.a (mgr.14373) 2469 : cluster [DBG] pgmap v1711: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:34:04.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:34:04 smithi047 bash[22744]: cluster 2024-09-16T06:34:04.041722+0000 mgr.a (mgr.14373) 2469 : cluster [DBG] pgmap v1711: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:34:05.096 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:34:05.097 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:34:05.097 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:34:05.870 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:34:05.870 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:34:05.870 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:34:05.870 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:34:05.871 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:34:06.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:34:06 smithi157 bash[24585]: audit 2024-09-16T06:34:05.432656+0000 mgr.a (mgr.14373) 2470 : audit [DBG] from='client.65334 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:34:06.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:34:06 smithi157 bash[24585]: cluster 2024-09-16T06:34:06.042686+0000 mgr.a (mgr.14373) 2471 : cluster [DBG] pgmap v1712: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:34:06.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:34:06 smithi086 bash[24289]: audit 2024-09-16T06:34:05.432656+0000 mgr.a (mgr.14373) 2470 : audit [DBG] from='client.65334 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:34:06.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:34:06 smithi086 bash[24289]: cluster 2024-09-16T06:34:06.042686+0000 mgr.a (mgr.14373) 2471 : cluster [DBG] pgmap v1712: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:34:06.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:34:06 smithi047 bash[22744]: audit 2024-09-16T06:34:05.432656+0000 mgr.a (mgr.14373) 2470 : audit [DBG] from='client.65334 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:34:06.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:34:06 smithi047 bash[22744]: cluster 2024-09-16T06:34:06.042686+0000 mgr.a (mgr.14373) 2471 : cluster [DBG] pgmap v1712: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:34:08.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:34:08 smithi157 bash[24585]: cluster 2024-09-16T06:34:08.044952+0000 mgr.a (mgr.14373) 2472 : cluster [DBG] pgmap v1713: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:34:08.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:34:08 smithi086 bash[24289]: cluster 2024-09-16T06:34:08.044952+0000 mgr.a (mgr.14373) 2472 : cluster [DBG] pgmap v1713: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:34:08.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:34:08 smithi047 bash[22744]: cluster 2024-09-16T06:34:08.044952+0000 mgr.a (mgr.14373) 2472 : cluster [DBG] pgmap v1713: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:34:10.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:34:10 smithi157 bash[24585]: cluster 2024-09-16T06:34:10.045707+0000 mgr.a (mgr.14373) 2473 : cluster [DBG] pgmap v1714: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:34:10.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:34:10 smithi086 bash[24289]: cluster 2024-09-16T06:34:10.045707+0000 mgr.a (mgr.14373) 2473 : cluster [DBG] pgmap v1714: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:34:10.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:34:10 smithi047 bash[22744]: cluster 2024-09-16T06:34:10.045707+0000 mgr.a (mgr.14373) 2473 : cluster [DBG] pgmap v1714: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:34:10.872 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:34:10.873 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:34:10.873 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:34:11.611 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:34:11.612 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:34:11.612 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:34:11.612 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:34:11.612 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:34:12.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:34:12 smithi157 bash[24585]: audit 2024-09-16T06:34:11.204213+0000 mgr.a (mgr.14373) 2474 : audit [DBG] from='client.65409 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:34:12.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:34:12 smithi157 bash[24585]: cluster 2024-09-16T06:34:12.048514+0000 mgr.a (mgr.14373) 2475 : cluster [DBG] pgmap v1715: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-16T06:34:12.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:34:12 smithi086 bash[24289]: audit 2024-09-16T06:34:11.204213+0000 mgr.a (mgr.14373) 2474 : audit [DBG] from='client.65409 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:34:12.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:34:12 smithi086 bash[24289]: cluster 2024-09-16T06:34:12.048514+0000 mgr.a (mgr.14373) 2475 : cluster [DBG] pgmap v1715: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-16T06:34:12.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:34:12 smithi047 bash[22744]: audit 2024-09-16T06:34:11.204213+0000 mgr.a (mgr.14373) 2474 : audit [DBG] from='client.65409 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:34:12.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:34:12 smithi047 bash[22744]: cluster 2024-09-16T06:34:12.048514+0000 mgr.a (mgr.14373) 2475 : cluster [DBG] pgmap v1715: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-16T06:34:14.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:34:14 smithi157 bash[24585]: cluster 2024-09-16T06:34:14.049295+0000 mgr.a (mgr.14373) 2476 : cluster [DBG] pgmap v1716: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T06:34:14.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:34:14 smithi086 bash[24289]: cluster 2024-09-16T06:34:14.049295+0000 mgr.a (mgr.14373) 2476 : cluster [DBG] pgmap v1716: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T06:34:14.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:34:14 smithi047 bash[22744]: cluster 2024-09-16T06:34:14.049295+0000 mgr.a (mgr.14373) 2476 : cluster [DBG] pgmap v1716: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T06:34:16.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:34:16 smithi157 bash[24585]: cluster 2024-09-16T06:34:16.050043+0000 mgr.a (mgr.14373) 2477 : cluster [DBG] pgmap v1717: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T06:34:16.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:34:16 smithi086 bash[24289]: cluster 2024-09-16T06:34:16.050043+0000 mgr.a (mgr.14373) 2477 : cluster [DBG] pgmap v1717: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T06:34:16.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:34:16 smithi047 bash[22744]: cluster 2024-09-16T06:34:16.050043+0000 mgr.a (mgr.14373) 2477 : cluster [DBG] pgmap v1717: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T06:34:16.613 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:34:16.614 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:34:16.614 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:34:17.361 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:34:17.362 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:34:17.362 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:34:17.362 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:34:17.362 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:34:17.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:34:17 smithi157 bash[24585]: audit 2024-09-16T06:34:16.944776+0000 mgr.a (mgr.14373) 2478 : audit [DBG] from='client.65484 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:34:17.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:34:17 smithi086 bash[24289]: audit 2024-09-16T06:34:16.944776+0000 mgr.a (mgr.14373) 2478 : audit [DBG] from='client.65484 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:34:17.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:34:17 smithi047 bash[22744]: audit 2024-09-16T06:34:16.944776+0000 mgr.a (mgr.14373) 2478 : audit [DBG] from='client.65484 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:34:18.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:34:18 smithi157 bash[24585]: cluster 2024-09-16T06:34:18.052838+0000 mgr.a (mgr.14373) 2479 : cluster [DBG] pgmap v1718: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:34:18.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:34:18 smithi086 bash[24289]: cluster 2024-09-16T06:34:18.052838+0000 mgr.a (mgr.14373) 2479 : cluster [DBG] pgmap v1718: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:34:18.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:34:18 smithi047 bash[22744]: cluster 2024-09-16T06:34:18.052838+0000 mgr.a (mgr.14373) 2479 : cluster [DBG] pgmap v1718: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:34:20.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:34:20 smithi157 bash[24585]: cluster 2024-09-16T06:34:20.053651+0000 mgr.a (mgr.14373) 2480 : cluster [DBG] pgmap v1719: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:34:20.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:34:20 smithi086 bash[24289]: cluster 2024-09-16T06:34:20.053651+0000 mgr.a (mgr.14373) 2480 : cluster [DBG] pgmap v1719: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:34:20.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:34:20 smithi047 bash[22744]: cluster 2024-09-16T06:34:20.053651+0000 mgr.a (mgr.14373) 2480 : cluster [DBG] pgmap v1719: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:34:22.362 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:34:22.363 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:34:22.363 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:34:22.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:34:22 smithi157 bash[24585]: cluster 2024-09-16T06:34:22.055673+0000 mgr.a (mgr.14373) 2481 : cluster [DBG] pgmap v1720: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:34:22.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:34:22 smithi086 bash[24289]: cluster 2024-09-16T06:34:22.055673+0000 mgr.a (mgr.14373) 2481 : cluster [DBG] pgmap v1720: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:34:22.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:34:22 smithi047 bash[22744]: cluster 2024-09-16T06:34:22.055673+0000 mgr.a (mgr.14373) 2481 : cluster [DBG] pgmap v1720: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:34:23.130 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:34:23.130 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:34:23.131 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:34:23.131 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:34:23.131 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:34:23.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:34:23 smithi157 bash[24585]: audit 2024-09-16T06:34:22.697540+0000 mgr.a (mgr.14373) 2482 : audit [DBG] from='client.65559 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:34:23.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:34:23 smithi086 bash[24289]: audit 2024-09-16T06:34:22.697540+0000 mgr.a (mgr.14373) 2482 : audit [DBG] from='client.65559 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:34:23.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:34:23 smithi047 bash[22744]: audit 2024-09-16T06:34:22.697540+0000 mgr.a (mgr.14373) 2482 : audit [DBG] from='client.65559 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:34:24.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:34:24 smithi157 bash[24585]: cluster 2024-09-16T06:34:24.056628+0000 mgr.a (mgr.14373) 2483 : cluster [DBG] pgmap v1721: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-16T06:34:24.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:34:24 smithi086 bash[24289]: cluster 2024-09-16T06:34:24.056628+0000 mgr.a (mgr.14373) 2483 : cluster [DBG] pgmap v1721: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-16T06:34:24.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:34:24 smithi047 bash[22744]: cluster 2024-09-16T06:34:24.056628+0000 mgr.a (mgr.14373) 2483 : cluster [DBG] pgmap v1721: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-16T06:34:26.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:34:26 smithi157 bash[24585]: cluster 2024-09-16T06:34:26.057401+0000 mgr.a (mgr.14373) 2484 : cluster [DBG] pgmap v1722: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-16T06:34:26.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:34:26 smithi086 bash[24289]: cluster 2024-09-16T06:34:26.057401+0000 mgr.a (mgr.14373) 2484 : cluster [DBG] pgmap v1722: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-16T06:34:26.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:34:26 smithi047 bash[22744]: cluster 2024-09-16T06:34:26.057401+0000 mgr.a (mgr.14373) 2484 : cluster [DBG] pgmap v1722: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-16T06:34:28.132 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:34:28.132 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:34:28.133 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:34:28.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:34:28 smithi157 bash[24585]: cluster 2024-09-16T06:34:28.059615+0000 mgr.a (mgr.14373) 2485 : cluster [DBG] pgmap v1723: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-16T06:34:28.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:34:28 smithi086 bash[24289]: cluster 2024-09-16T06:34:28.059615+0000 mgr.a (mgr.14373) 2485 : cluster [DBG] pgmap v1723: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-16T06:34:28.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:34:28 smithi047 bash[22744]: cluster 2024-09-16T06:34:28.059615+0000 mgr.a (mgr.14373) 2485 : cluster [DBG] pgmap v1723: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-16T06:34:28.890 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:34:28.890 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:34:28.890 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:34:28.891 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:34:28.891 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:34:29.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:34:29 smithi157 bash[24585]: audit 2024-09-16T06:34:28.471380+0000 mgr.a (mgr.14373) 2486 : audit [DBG] from='client.65637 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:34:29.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:34:29 smithi086 bash[24289]: audit 2024-09-16T06:34:28.471380+0000 mgr.a (mgr.14373) 2486 : audit [DBG] from='client.65637 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:34:29.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:34:29 smithi047 bash[22744]: audit 2024-09-16T06:34:28.471380+0000 mgr.a (mgr.14373) 2486 : audit [DBG] from='client.65637 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:34:30.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:34:30 smithi157 bash[24585]: cluster 2024-09-16T06:34:30.060543+0000 mgr.a (mgr.14373) 2487 : cluster [DBG] pgmap v1724: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:34:30.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:34:30 smithi086 bash[24289]: cluster 2024-09-16T06:34:30.060543+0000 mgr.a (mgr.14373) 2487 : cluster [DBG] pgmap v1724: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:34:30.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:34:30 smithi047 bash[22744]: cluster 2024-09-16T06:34:30.060543+0000 mgr.a (mgr.14373) 2487 : cluster [DBG] pgmap v1724: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:34:32.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:34:32 smithi157 bash[24585]: cluster 2024-09-16T06:34:32.062777+0000 mgr.a (mgr.14373) 2488 : cluster [DBG] pgmap v1725: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:34:32.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:34:32 smithi086 bash[24289]: cluster 2024-09-16T06:34:32.062777+0000 mgr.a (mgr.14373) 2488 : cluster [DBG] pgmap v1725: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:34:32.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:34:32 smithi047 bash[22744]: cluster 2024-09-16T06:34:32.062777+0000 mgr.a (mgr.14373) 2488 : cluster [DBG] pgmap v1725: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:34:33.892 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:34:33.892 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:34:33.893 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:34:34.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:34:34 smithi157 bash[24585]: cluster 2024-09-16T06:34:34.063297+0000 mgr.a (mgr.14373) 2489 : cluster [DBG] pgmap v1726: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:34:34.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:34:34 smithi086 bash[24289]: cluster 2024-09-16T06:34:34.063297+0000 mgr.a (mgr.14373) 2489 : cluster [DBG] pgmap v1726: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:34:34.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:34:34 smithi047 bash[22744]: cluster 2024-09-16T06:34:34.063297+0000 mgr.a (mgr.14373) 2489 : cluster [DBG] pgmap v1726: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:34:34.671 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:34:34.671 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:34:34.671 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:34:34.671 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:34:34.672 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:34:35.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:34:35 smithi157 bash[24585]: audit 2024-09-16T06:34:34.235531+0000 mgr.a (mgr.14373) 2490 : audit [DBG] from='client.65715 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:34:35.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:34:35 smithi086 bash[24289]: audit 2024-09-16T06:34:34.235531+0000 mgr.a (mgr.14373) 2490 : audit [DBG] from='client.65715 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:34:35.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:34:35 smithi047 bash[22744]: audit 2024-09-16T06:34:34.235531+0000 mgr.a (mgr.14373) 2490 : audit [DBG] from='client.65715 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:34:36.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:34:36 smithi157 bash[24585]: cluster 2024-09-16T06:34:36.064235+0000 mgr.a (mgr.14373) 2491 : cluster [DBG] pgmap v1727: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:34:36.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:34:36 smithi086 bash[24289]: cluster 2024-09-16T06:34:36.064235+0000 mgr.a (mgr.14373) 2491 : cluster [DBG] pgmap v1727: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:34:36.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:34:36 smithi047 bash[22744]: cluster 2024-09-16T06:34:36.064235+0000 mgr.a (mgr.14373) 2491 : cluster [DBG] pgmap v1727: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:34:38.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:34:38 smithi157 bash[24585]: cluster 2024-09-16T06:34:38.066522+0000 mgr.a (mgr.14373) 2492 : cluster [DBG] pgmap v1728: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:34:38.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:34:38 smithi086 bash[24289]: cluster 2024-09-16T06:34:38.066522+0000 mgr.a (mgr.14373) 2492 : cluster [DBG] pgmap v1728: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:34:38.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:34:38 smithi047 bash[22744]: cluster 2024-09-16T06:34:38.066522+0000 mgr.a (mgr.14373) 2492 : cluster [DBG] pgmap v1728: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:34:39.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:34:39 smithi157 bash[24585]: audit 2024-09-16T06:34:38.500583+0000 mon.b (mon.2) 270 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T06:34:39.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:34:39 smithi086 bash[24289]: audit 2024-09-16T06:34:38.500583+0000 mon.b (mon.2) 270 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T06:34:39.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:34:39 smithi047 bash[22744]: audit 2024-09-16T06:34:38.500583+0000 mon.b (mon.2) 270 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T06:34:39.672 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:34:39.673 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:34:39.674 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:34:40.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:34:40 smithi157 bash[24585]: audit 2024-09-16T06:34:39.139812+0000 mon.a (mon.0) 711 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:34:40.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:34:40 smithi157 bash[24585]: audit 2024-09-16T06:34:39.148370+0000 mon.a (mon.0) 712 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:34:40.555 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:34:40 smithi157 bash[24585]: audit 2024-09-16T06:34:39.937591+0000 mon.b (mon.2) 271 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T06:34:40.555 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:34:40 smithi157 bash[24585]: audit 2024-09-16T06:34:39.939358+0000 mon.b (mon.2) 272 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T06:34:40.555 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:34:40 smithi157 bash[24585]: audit 2024-09-16T06:34:39.947619+0000 mon.a (mon.0) 713 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:34:40.555 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:34:40 smithi157 bash[24585]: audit 2024-09-16T06:34:39.950976+0000 mon.b (mon.2) 273 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:34:40.555 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:34:40 smithi157 bash[24585]: audit 2024-09-16T06:34:39.954903+0000 mgr.a (mgr.14373) 2493 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:34:40.555 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:34:40 smithi157 bash[24585]: audit 2024-09-16T06:34:40.006338+0000 mgr.a (mgr.14373) 2494 : audit [DBG] from='client.65793 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:34:40.555 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:34:40 smithi157 bash[24585]: cluster 2024-09-16T06:34:40.067216+0000 mgr.a (mgr.14373) 2495 : cluster [DBG] pgmap v1729: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:34:40.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:34:40 smithi086 bash[24289]: audit 2024-09-16T06:34:39.139812+0000 mon.a (mon.0) 711 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:34:40.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:34:40 smithi086 bash[24289]: audit 2024-09-16T06:34:39.148370+0000 mon.a (mon.0) 712 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:34:40.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:34:40 smithi086 bash[24289]: audit 2024-09-16T06:34:39.937591+0000 mon.b (mon.2) 271 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T06:34:40.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:34:40 smithi086 bash[24289]: audit 2024-09-16T06:34:39.939358+0000 mon.b (mon.2) 272 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T06:34:40.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:34:40 smithi086 bash[24289]: audit 2024-09-16T06:34:39.947619+0000 mon.a (mon.0) 713 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:34:40.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:34:40 smithi086 bash[24289]: audit 2024-09-16T06:34:39.950976+0000 mon.b (mon.2) 273 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:34:40.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:34:40 smithi086 bash[24289]: audit 2024-09-16T06:34:39.954903+0000 mgr.a (mgr.14373) 2493 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:34:40.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:34:40 smithi086 bash[24289]: audit 2024-09-16T06:34:40.006338+0000 mgr.a (mgr.14373) 2494 : audit [DBG] from='client.65793 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:34:40.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:34:40 smithi086 bash[24289]: cluster 2024-09-16T06:34:40.067216+0000 mgr.a (mgr.14373) 2495 : cluster [DBG] pgmap v1729: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:34:40.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:34:40 smithi047 bash[22744]: audit 2024-09-16T06:34:39.139812+0000 mon.a (mon.0) 711 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:34:40.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:34:40 smithi047 bash[22744]: audit 2024-09-16T06:34:39.148370+0000 mon.a (mon.0) 712 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:34:40.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:34:40 smithi047 bash[22744]: audit 2024-09-16T06:34:39.937591+0000 mon.b (mon.2) 271 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T06:34:40.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:34:40 smithi047 bash[22744]: audit 2024-09-16T06:34:39.939358+0000 mon.b (mon.2) 272 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T06:34:40.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:34:40 smithi047 bash[22744]: audit 2024-09-16T06:34:39.947619+0000 mon.a (mon.0) 713 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:34:40.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:34:40 smithi047 bash[22744]: audit 2024-09-16T06:34:39.950976+0000 mon.b (mon.2) 273 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:34:40.590 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:34:40 smithi047 bash[22744]: audit 2024-09-16T06:34:39.954903+0000 mgr.a (mgr.14373) 2493 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:34:40.590 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:34:40 smithi047 bash[22744]: audit 2024-09-16T06:34:40.006338+0000 mgr.a (mgr.14373) 2494 : audit [DBG] from='client.65793 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:34:40.590 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:34:40 smithi047 bash[22744]: cluster 2024-09-16T06:34:40.067216+0000 mgr.a (mgr.14373) 2495 : cluster [DBG] pgmap v1729: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:34:41.051 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:34:41.051 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:34:41.051 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:34:41.051 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:34:41.051 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:34:41.089 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 06:34:40 smithi047 bash[22994]: debug 2024-09-16T06:34:40.652+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T06:34:41.089 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 06:34:40 smithi047 bash[22994]: debug 2024-09-16T06:34:40.664+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T06:34:42.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:34:41 smithi157 bash[24585]: audit 2024-09-16T06:34:40.658308+0000 mgr.a (mgr.14373) 2496 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T06:34:42.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:34:41 smithi157 bash[24585]: cephadm 2024-09-16T06:34:40.669370+0000 mgr.a (mgr.14373) 2497 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T06:34:42.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:34:41 smithi086 bash[24289]: audit 2024-09-16T06:34:40.658308+0000 mgr.a (mgr.14373) 2496 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T06:34:42.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:34:41 smithi086 bash[24289]: cephadm 2024-09-16T06:34:40.669370+0000 mgr.a (mgr.14373) 2497 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T06:34:42.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:34:41 smithi047 bash[22744]: audit 2024-09-16T06:34:40.658308+0000 mgr.a (mgr.14373) 2496 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T06:34:42.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:34:41 smithi047 bash[22744]: cephadm 2024-09-16T06:34:40.669370+0000 mgr.a (mgr.14373) 2497 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T06:34:43.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:34:42 smithi157 bash[24585]: cluster 2024-09-16T06:34:42.069604+0000 mgr.a (mgr.14373) 2498 : cluster [DBG] pgmap v1730: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:34:43.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:34:42 smithi086 bash[24289]: cluster 2024-09-16T06:34:42.069604+0000 mgr.a (mgr.14373) 2498 : cluster [DBG] pgmap v1730: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:34:43.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:34:42 smithi047 bash[22744]: cluster 2024-09-16T06:34:42.069604+0000 mgr.a (mgr.14373) 2498 : cluster [DBG] pgmap v1730: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:34:44.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:34:44 smithi157 bash[24585]: cluster 2024-09-16T06:34:44.070364+0000 mgr.a (mgr.14373) 2499 : cluster [DBG] pgmap v1731: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:34:44.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:34:44 smithi086 bash[24289]: cluster 2024-09-16T06:34:44.070364+0000 mgr.a (mgr.14373) 2499 : cluster [DBG] pgmap v1731: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:34:44.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:34:44 smithi047 bash[22744]: cluster 2024-09-16T06:34:44.070364+0000 mgr.a (mgr.14373) 2499 : cluster [DBG] pgmap v1731: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:34:46.052 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:34:46.053 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:34:46.053 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:34:46.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:34:46 smithi157 bash[24585]: cluster 2024-09-16T06:34:46.070876+0000 mgr.a (mgr.14373) 2500 : cluster [DBG] pgmap v1732: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:34:46.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:34:46 smithi086 bash[24289]: cluster 2024-09-16T06:34:46.070876+0000 mgr.a (mgr.14373) 2500 : cluster [DBG] pgmap v1732: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:34:46.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:34:46 smithi047 bash[22744]: cluster 2024-09-16T06:34:46.070876+0000 mgr.a (mgr.14373) 2500 : cluster [DBG] pgmap v1732: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:34:46.807 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:34:46.807 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:34:46.807 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:34:46.807 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:34:46.807 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:34:47.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:34:47 smithi157 bash[24585]: audit 2024-09-16T06:34:46.386029+0000 mgr.a (mgr.14373) 2501 : audit [DBG] from='client.65979 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:34:47.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:34:47 smithi086 bash[24289]: audit 2024-09-16T06:34:46.386029+0000 mgr.a (mgr.14373) 2501 : audit [DBG] from='client.65979 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:34:47.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:34:47 smithi047 bash[22744]: audit 2024-09-16T06:34:46.386029+0000 mgr.a (mgr.14373) 2501 : audit [DBG] from='client.65979 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:34:49.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:34:49 smithi157 bash[24585]: cluster 2024-09-16T06:34:48.073623+0000 mgr.a (mgr.14373) 2502 : cluster [DBG] pgmap v1733: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:34:49.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:34:49 smithi086 bash[24289]: cluster 2024-09-16T06:34:48.073623+0000 mgr.a (mgr.14373) 2502 : cluster [DBG] pgmap v1733: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:34:49.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:34:49 smithi047 bash[22744]: cluster 2024-09-16T06:34:48.073623+0000 mgr.a (mgr.14373) 2502 : cluster [DBG] pgmap v1733: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:34:51.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:34:51 smithi157 bash[24585]: cluster 2024-09-16T06:34:50.074440+0000 mgr.a (mgr.14373) 2503 : cluster [DBG] pgmap v1734: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T06:34:51.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:34:51 smithi086 bash[24289]: cluster 2024-09-16T06:34:50.074440+0000 mgr.a (mgr.14373) 2503 : cluster [DBG] pgmap v1734: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T06:34:51.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:34:51 smithi047 bash[22744]: cluster 2024-09-16T06:34:50.074440+0000 mgr.a (mgr.14373) 2503 : cluster [DBG] pgmap v1734: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T06:34:51.808 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:34:51.809 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:34:51.809 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:34:52.553 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:34:52.553 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:34:52.553 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:34:52.554 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:34:52.554 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:34:54.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:34:54 smithi157 bash[24585]: cluster 2024-09-16T06:34:52.076339+0000 mgr.a (mgr.14373) 2504 : cluster [DBG] pgmap v1735: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:34:54.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:34:54 smithi157 bash[24585]: audit 2024-09-16T06:34:52.142074+0000 mgr.a (mgr.14373) 2505 : audit [DBG] from='client.66057 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:34:54.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:34:54 smithi086 bash[24289]: cluster 2024-09-16T06:34:52.076339+0000 mgr.a (mgr.14373) 2504 : cluster [DBG] pgmap v1735: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:34:54.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:34:54 smithi086 bash[24289]: audit 2024-09-16T06:34:52.142074+0000 mgr.a (mgr.14373) 2505 : audit [DBG] from='client.66057 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:34:54.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:34:54 smithi047 bash[22744]: cluster 2024-09-16T06:34:52.076339+0000 mgr.a (mgr.14373) 2504 : cluster [DBG] pgmap v1735: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:34:54.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:34:54 smithi047 bash[22744]: audit 2024-09-16T06:34:52.142074+0000 mgr.a (mgr.14373) 2505 : audit [DBG] from='client.66057 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:34:56.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:34:56 smithi157 bash[24585]: cluster 2024-09-16T06:34:54.077225+0000 mgr.a (mgr.14373) 2506 : cluster [DBG] pgmap v1736: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:34:56.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:34:56 smithi086 bash[24289]: cluster 2024-09-16T06:34:54.077225+0000 mgr.a (mgr.14373) 2506 : cluster [DBG] pgmap v1736: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:34:56.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:34:56 smithi047 bash[22744]: cluster 2024-09-16T06:34:54.077225+0000 mgr.a (mgr.14373) 2506 : cluster [DBG] pgmap v1736: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:34:57.555 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:34:57.556 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:34:57.556 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:34:58.290 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:34:58.291 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:34:58.291 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:34:58.291 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:34:58.291 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:34:58.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:34:58 smithi157 bash[24585]: cluster 2024-09-16T06:34:56.078016+0000 mgr.a (mgr.14373) 2507 : cluster [DBG] pgmap v1737: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T06:34:58.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:34:58 smithi086 bash[24289]: cluster 2024-09-16T06:34:56.078016+0000 mgr.a (mgr.14373) 2507 : cluster [DBG] pgmap v1737: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T06:34:58.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:34:58 smithi047 bash[22744]: cluster 2024-09-16T06:34:56.078016+0000 mgr.a (mgr.14373) 2507 : cluster [DBG] pgmap v1737: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T06:34:59.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:34:59 smithi157 bash[24585]: audit 2024-09-16T06:34:57.887454+0000 mgr.a (mgr.14373) 2508 : audit [DBG] from='client.66135 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:34:59.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:34:59 smithi086 bash[24289]: audit 2024-09-16T06:34:57.887454+0000 mgr.a (mgr.14373) 2508 : audit [DBG] from='client.66135 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:34:59.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:34:59 smithi047 bash[22744]: audit 2024-09-16T06:34:57.887454+0000 mgr.a (mgr.14373) 2508 : audit [DBG] from='client.66135 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:35:00.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:35:00 smithi157 bash[24585]: cluster 2024-09-16T06:34:58.079206+0000 mgr.a (mgr.14373) 2509 : cluster [DBG] pgmap v1738: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:35:00.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:35:00 smithi086 bash[24289]: cluster 2024-09-16T06:34:58.079206+0000 mgr.a (mgr.14373) 2509 : cluster [DBG] pgmap v1738: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:35:00.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:35:00 smithi047 bash[22744]: cluster 2024-09-16T06:34:58.079206+0000 mgr.a (mgr.14373) 2509 : cluster [DBG] pgmap v1738: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:35:02.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:35:02 smithi157 bash[24585]: cluster 2024-09-16T06:35:00.080031+0000 mgr.a (mgr.14373) 2510 : cluster [DBG] pgmap v1739: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:35:02.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:35:02 smithi086 bash[24289]: cluster 2024-09-16T06:35:00.080031+0000 mgr.a (mgr.14373) 2510 : cluster [DBG] pgmap v1739: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:35:02.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:35:02 smithi047 bash[22744]: cluster 2024-09-16T06:35:00.080031+0000 mgr.a (mgr.14373) 2510 : cluster [DBG] pgmap v1739: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:35:03.292 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:35:03.293 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:35:03.293 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:35:04.038 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:35:04.038 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:35:04.039 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:35:04.039 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:35:04.039 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:35:04.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:35:04 smithi157 bash[24585]: cluster 2024-09-16T06:35:02.082251+0000 mgr.a (mgr.14373) 2511 : cluster [DBG] pgmap v1740: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:35:04.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:35:04 smithi086 bash[24289]: cluster 2024-09-16T06:35:02.082251+0000 mgr.a (mgr.14373) 2511 : cluster [DBG] pgmap v1740: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:35:04.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:35:04 smithi047 bash[22744]: cluster 2024-09-16T06:35:02.082251+0000 mgr.a (mgr.14373) 2511 : cluster [DBG] pgmap v1740: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:35:05.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:35:05 smithi157 bash[24585]: audit 2024-09-16T06:35:03.626858+0000 mgr.a (mgr.14373) 2512 : audit [DBG] from='client.66213 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:35:05.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:35:05 smithi086 bash[24289]: audit 2024-09-16T06:35:03.626858+0000 mgr.a (mgr.14373) 2512 : audit [DBG] from='client.66213 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:35:05.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:35:05 smithi047 bash[22744]: audit 2024-09-16T06:35:03.626858+0000 mgr.a (mgr.14373) 2512 : audit [DBG] from='client.66213 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:35:06.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:35:06 smithi157 bash[24585]: cluster 2024-09-16T06:35:04.082885+0000 mgr.a (mgr.14373) 2513 : cluster [DBG] pgmap v1741: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:35:06.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:35:06 smithi086 bash[24289]: cluster 2024-09-16T06:35:04.082885+0000 mgr.a (mgr.14373) 2513 : cluster [DBG] pgmap v1741: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:35:06.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:35:06 smithi047 bash[22744]: cluster 2024-09-16T06:35:04.082885+0000 mgr.a (mgr.14373) 2513 : cluster [DBG] pgmap v1741: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:35:08.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:35:08 smithi157 bash[24585]: cluster 2024-09-16T06:35:06.083599+0000 mgr.a (mgr.14373) 2514 : cluster [DBG] pgmap v1742: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:35:08.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:35:08 smithi086 bash[24289]: cluster 2024-09-16T06:35:06.083599+0000 mgr.a (mgr.14373) 2514 : cluster [DBG] pgmap v1742: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:35:08.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:35:08 smithi047 bash[22744]: cluster 2024-09-16T06:35:06.083599+0000 mgr.a (mgr.14373) 2514 : cluster [DBG] pgmap v1742: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:35:09.040 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:35:09.040 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:35:09.041 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:35:09.794 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:35:09.794 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:35:09.794 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:35:09.795 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:35:09.795 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:35:10.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:35:10 smithi157 bash[24585]: cluster 2024-09-16T06:35:08.085818+0000 mgr.a (mgr.14373) 2515 : cluster [DBG] pgmap v1743: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:35:10.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:35:10 smithi086 bash[24289]: cluster 2024-09-16T06:35:08.085818+0000 mgr.a (mgr.14373) 2515 : cluster [DBG] pgmap v1743: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:35:10.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:35:10 smithi047 bash[22744]: cluster 2024-09-16T06:35:08.085818+0000 mgr.a (mgr.14373) 2515 : cluster [DBG] pgmap v1743: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:35:11.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:35:11 smithi086 bash[24289]: audit 2024-09-16T06:35:09.376267+0000 mgr.a (mgr.14373) 2516 : audit [DBG] from='client.66291 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:35:11.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:35:11 smithi047 bash[22744]: audit 2024-09-16T06:35:09.376267+0000 mgr.a (mgr.14373) 2516 : audit [DBG] from='client.66291 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:35:11.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:35:11 smithi157 bash[24585]: audit 2024-09-16T06:35:09.376267+0000 mgr.a (mgr.14373) 2516 : audit [DBG] from='client.66291 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:35:12.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:35:12 smithi086 bash[24289]: cluster 2024-09-16T06:35:10.086914+0000 mgr.a (mgr.14373) 2517 : cluster [DBG] pgmap v1744: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:35:12.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:35:12 smithi047 bash[22744]: cluster 2024-09-16T06:35:10.086914+0000 mgr.a (mgr.14373) 2517 : cluster [DBG] pgmap v1744: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:35:12.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:35:12 smithi157 bash[24585]: cluster 2024-09-16T06:35:10.086914+0000 mgr.a (mgr.14373) 2517 : cluster [DBG] pgmap v1744: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:35:14.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:35:14 smithi086 bash[24289]: cluster 2024-09-16T06:35:12.089265+0000 mgr.a (mgr.14373) 2518 : cluster [DBG] pgmap v1745: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:35:14.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:35:14 smithi047 bash[22744]: cluster 2024-09-16T06:35:12.089265+0000 mgr.a (mgr.14373) 2518 : cluster [DBG] pgmap v1745: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:35:14.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:35:14 smithi157 bash[24585]: cluster 2024-09-16T06:35:12.089265+0000 mgr.a (mgr.14373) 2518 : cluster [DBG] pgmap v1745: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:35:14.796 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:35:14.796 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:35:14.797 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:35:15.577 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:35:15.577 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:35:15.577 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:35:15.577 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:35:15.577 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:35:16.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:35:16 smithi047 bash[22744]: cluster 2024-09-16T06:35:14.090205+0000 mgr.a (mgr.14373) 2519 : cluster [DBG] pgmap v1746: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:35:16.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:35:16 smithi157 bash[24585]: cluster 2024-09-16T06:35:14.090205+0000 mgr.a (mgr.14373) 2519 : cluster [DBG] pgmap v1746: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:35:16.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:35:16 smithi086 bash[24289]: cluster 2024-09-16T06:35:14.090205+0000 mgr.a (mgr.14373) 2519 : cluster [DBG] pgmap v1746: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:35:17.340 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:35:17 smithi047 bash[22744]: audit 2024-09-16T06:35:15.131107+0000 mgr.a (mgr.14373) 2520 : audit [DBG] from='client.66369 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:35:17.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:35:17 smithi157 bash[24585]: audit 2024-09-16T06:35:15.131107+0000 mgr.a (mgr.14373) 2520 : audit [DBG] from='client.66369 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:35:17.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:35:17 smithi086 bash[24289]: audit 2024-09-16T06:35:15.131107+0000 mgr.a (mgr.14373) 2520 : audit [DBG] from='client.66369 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:35:18.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:35:18 smithi047 bash[22744]: cluster 2024-09-16T06:35:16.091182+0000 mgr.a (mgr.14373) 2521 : cluster [DBG] pgmap v1747: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:35:18.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:35:18 smithi157 bash[24585]: cluster 2024-09-16T06:35:16.091182+0000 mgr.a (mgr.14373) 2521 : cluster [DBG] pgmap v1747: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:35:18.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:35:18 smithi086 bash[24289]: cluster 2024-09-16T06:35:16.091182+0000 mgr.a (mgr.14373) 2521 : cluster [DBG] pgmap v1747: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:35:19.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:35:19 smithi157 bash[24585]: cluster 2024-09-16T06:35:18.093434+0000 mgr.a (mgr.14373) 2522 : cluster [DBG] pgmap v1748: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:35:19.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:35:19 smithi086 bash[24289]: cluster 2024-09-16T06:35:18.093434+0000 mgr.a (mgr.14373) 2522 : cluster [DBG] pgmap v1748: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:35:19.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:35:19 smithi047 bash[22744]: cluster 2024-09-16T06:35:18.093434+0000 mgr.a (mgr.14373) 2522 : cluster [DBG] pgmap v1748: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:35:20.578 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:35:20.579 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:35:20.579 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:35:21.357 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:35:21.357 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:35:21.358 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:35:21.358 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:35:21.358 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:35:21.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:35:21 smithi157 bash[24585]: cluster 2024-09-16T06:35:20.094203+0000 mgr.a (mgr.14373) 2523 : cluster [DBG] pgmap v1749: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:35:21.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:35:21 smithi157 bash[24585]: audit 2024-09-16T06:35:20.914842+0000 mgr.a (mgr.14373) 2524 : audit [DBG] from='client.66444 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:35:21.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:35:21 smithi086 bash[24289]: cluster 2024-09-16T06:35:20.094203+0000 mgr.a (mgr.14373) 2523 : cluster [DBG] pgmap v1749: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:35:21.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:35:21 smithi086 bash[24289]: audit 2024-09-16T06:35:20.914842+0000 mgr.a (mgr.14373) 2524 : audit [DBG] from='client.66444 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:35:21.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:35:21 smithi047 bash[22744]: cluster 2024-09-16T06:35:20.094203+0000 mgr.a (mgr.14373) 2523 : cluster [DBG] pgmap v1749: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:35:21.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:35:21 smithi047 bash[22744]: audit 2024-09-16T06:35:20.914842+0000 mgr.a (mgr.14373) 2524 : audit [DBG] from='client.66444 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:35:23.555 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:35:23 smithi157 bash[24585]: cluster 2024-09-16T06:35:22.096596+0000 mgr.a (mgr.14373) 2525 : cluster [DBG] pgmap v1750: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:35:23.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:35:23 smithi086 bash[24289]: cluster 2024-09-16T06:35:22.096596+0000 mgr.a (mgr.14373) 2525 : cluster [DBG] pgmap v1750: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:35:23.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:35:23 smithi047 bash[22744]: cluster 2024-09-16T06:35:22.096596+0000 mgr.a (mgr.14373) 2525 : cluster [DBG] pgmap v1750: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:35:25.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:35:25 smithi157 bash[24585]: cluster 2024-09-16T06:35:24.097368+0000 mgr.a (mgr.14373) 2526 : cluster [DBG] pgmap v1751: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:35:25.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:35:25 smithi086 bash[24289]: cluster 2024-09-16T06:35:24.097368+0000 mgr.a (mgr.14373) 2526 : cluster [DBG] pgmap v1751: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:35:25.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:35:25 smithi047 bash[22744]: cluster 2024-09-16T06:35:24.097368+0000 mgr.a (mgr.14373) 2526 : cluster [DBG] pgmap v1751: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:35:26.358 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:35:26.359 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:35:26.359 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:35:27.116 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:35:27.116 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:35:27.116 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:35:27.116 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:35:27.116 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:35:27.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:35:27 smithi157 bash[24585]: cluster 2024-09-16T06:35:26.098165+0000 mgr.a (mgr.14373) 2527 : cluster [DBG] pgmap v1752: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:35:27.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:35:27 smithi157 bash[24585]: audit 2024-09-16T06:35:26.697705+0000 mgr.a (mgr.14373) 2528 : audit [DBG] from='client.66519 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:35:27.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:35:27 smithi086 bash[24289]: cluster 2024-09-16T06:35:26.098165+0000 mgr.a (mgr.14373) 2527 : cluster [DBG] pgmap v1752: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:35:27.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:35:27 smithi086 bash[24289]: audit 2024-09-16T06:35:26.697705+0000 mgr.a (mgr.14373) 2528 : audit [DBG] from='client.66519 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:35:27.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:35:27 smithi047 bash[22744]: cluster 2024-09-16T06:35:26.098165+0000 mgr.a (mgr.14373) 2527 : cluster [DBG] pgmap v1752: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:35:27.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:35:27 smithi047 bash[22744]: audit 2024-09-16T06:35:26.697705+0000 mgr.a (mgr.14373) 2528 : audit [DBG] from='client.66519 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:35:29.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:35:29 smithi157 bash[24585]: cluster 2024-09-16T06:35:28.100922+0000 mgr.a (mgr.14373) 2529 : cluster [DBG] pgmap v1753: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:35:29.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:35:29 smithi086 bash[24289]: cluster 2024-09-16T06:35:28.100922+0000 mgr.a (mgr.14373) 2529 : cluster [DBG] pgmap v1753: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:35:29.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:35:29 smithi047 bash[22744]: cluster 2024-09-16T06:35:28.100922+0000 mgr.a (mgr.14373) 2529 : cluster [DBG] pgmap v1753: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:35:31.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:35:31 smithi157 bash[24585]: cluster 2024-09-16T06:35:30.101717+0000 mgr.a (mgr.14373) 2530 : cluster [DBG] pgmap v1754: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:35:31.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:35:31 smithi086 bash[24289]: cluster 2024-09-16T06:35:30.101717+0000 mgr.a (mgr.14373) 2530 : cluster [DBG] pgmap v1754: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:35:31.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:35:31 smithi047 bash[22744]: cluster 2024-09-16T06:35:30.101717+0000 mgr.a (mgr.14373) 2530 : cluster [DBG] pgmap v1754: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:35:32.117 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:35:32.118 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:35:32.118 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:35:32.885 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:35:32.885 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:35:32.885 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:35:32.885 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:35:32.885 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:35:33.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:35:33 smithi157 bash[24585]: cluster 2024-09-16T06:35:32.103701+0000 mgr.a (mgr.14373) 2531 : cluster [DBG] pgmap v1755: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:35:33.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:35:33 smithi157 bash[24585]: audit 2024-09-16T06:35:32.454404+0000 mgr.a (mgr.14373) 2532 : audit [DBG] from='client.66597 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:35:33.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:35:33 smithi086 bash[24289]: cluster 2024-09-16T06:35:32.103701+0000 mgr.a (mgr.14373) 2531 : cluster [DBG] pgmap v1755: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:35:33.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:35:33 smithi086 bash[24289]: audit 2024-09-16T06:35:32.454404+0000 mgr.a (mgr.14373) 2532 : audit [DBG] from='client.66597 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:35:33.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:35:33 smithi047 bash[22744]: cluster 2024-09-16T06:35:32.103701+0000 mgr.a (mgr.14373) 2531 : cluster [DBG] pgmap v1755: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:35:33.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:35:33 smithi047 bash[22744]: audit 2024-09-16T06:35:32.454404+0000 mgr.a (mgr.14373) 2532 : audit [DBG] from='client.66597 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:35:35.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:35:35 smithi157 bash[24585]: cluster 2024-09-16T06:35:34.104591+0000 mgr.a (mgr.14373) 2533 : cluster [DBG] pgmap v1756: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:35:35.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:35:35 smithi086 bash[24289]: cluster 2024-09-16T06:35:34.104591+0000 mgr.a (mgr.14373) 2533 : cluster [DBG] pgmap v1756: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:35:35.590 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:35:35 smithi047 bash[22744]: cluster 2024-09-16T06:35:34.104591+0000 mgr.a (mgr.14373) 2533 : cluster [DBG] pgmap v1756: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:35:37.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:35:37 smithi157 bash[24585]: cluster 2024-09-16T06:35:36.105391+0000 mgr.a (mgr.14373) 2534 : cluster [DBG] pgmap v1757: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T06:35:37.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:35:37 smithi086 bash[24289]: cluster 2024-09-16T06:35:36.105391+0000 mgr.a (mgr.14373) 2534 : cluster [DBG] pgmap v1757: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T06:35:37.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:35:37 smithi047 bash[22744]: cluster 2024-09-16T06:35:36.105391+0000 mgr.a (mgr.14373) 2534 : cluster [DBG] pgmap v1757: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T06:35:37.886 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:35:37.887 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:35:37.887 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:35:38.668 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:35:38.668 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:35:38.668 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:35:38.668 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:35:38.669 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:35:39.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:35:39 smithi157 bash[24585]: cluster 2024-09-16T06:35:38.107499+0000 mgr.a (mgr.14373) 2535 : cluster [DBG] pgmap v1758: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:35:39.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:35:39 smithi157 bash[24585]: audit 2024-09-16T06:35:38.224000+0000 mgr.a (mgr.14373) 2536 : audit [DBG] from='client.66672 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:35:39.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:35:39 smithi086 bash[24289]: cluster 2024-09-16T06:35:38.107499+0000 mgr.a (mgr.14373) 2535 : cluster [DBG] pgmap v1758: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:35:39.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:35:39 smithi086 bash[24289]: audit 2024-09-16T06:35:38.224000+0000 mgr.a (mgr.14373) 2536 : audit [DBG] from='client.66672 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:35:39.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:35:39 smithi047 bash[22744]: cluster 2024-09-16T06:35:38.107499+0000 mgr.a (mgr.14373) 2535 : cluster [DBG] pgmap v1758: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:35:39.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:35:39 smithi047 bash[22744]: audit 2024-09-16T06:35:38.224000+0000 mgr.a (mgr.14373) 2536 : audit [DBG] from='client.66672 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:35:41.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:35:41 smithi157 bash[24585]: cluster 2024-09-16T06:35:40.108401+0000 mgr.a (mgr.14373) 2537 : cluster [DBG] pgmap v1759: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:35:41.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:35:41 smithi157 bash[24585]: audit 2024-09-16T06:35:40.734069+0000 mon.b (mon.2) 274 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T06:35:41.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:35:41 smithi086 bash[24289]: cluster 2024-09-16T06:35:40.108401+0000 mgr.a (mgr.14373) 2537 : cluster [DBG] pgmap v1759: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:35:41.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:35:41 smithi086 bash[24289]: audit 2024-09-16T06:35:40.734069+0000 mon.b (mon.2) 274 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T06:35:41.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:35:41 smithi047 bash[22744]: cluster 2024-09-16T06:35:40.108401+0000 mgr.a (mgr.14373) 2537 : cluster [DBG] pgmap v1759: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:35:41.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:35:41 smithi047 bash[22744]: audit 2024-09-16T06:35:40.734069+0000 mon.b (mon.2) 274 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T06:35:42.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:35:42 smithi157 bash[24585]: audit 2024-09-16T06:35:41.351406+0000 mon.a (mon.0) 714 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:35:42.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:35:42 smithi157 bash[24585]: audit 2024-09-16T06:35:41.356099+0000 mon.a (mon.0) 715 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:35:42.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:35:42 smithi157 bash[24585]: audit 2024-09-16T06:35:41.361655+0000 mon.a (mon.0) 716 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:35:42.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:35:42 smithi157 bash[24585]: audit 2024-09-16T06:35:41.366895+0000 mon.a (mon.0) 717 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:35:42.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:35:42 smithi086 bash[24289]: audit 2024-09-16T06:35:41.351406+0000 mon.a (mon.0) 714 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:35:42.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:35:42 smithi086 bash[24289]: audit 2024-09-16T06:35:41.356099+0000 mon.a (mon.0) 715 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:35:42.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:35:42 smithi086 bash[24289]: audit 2024-09-16T06:35:41.361655+0000 mon.a (mon.0) 716 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:35:42.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:35:42 smithi086 bash[24289]: audit 2024-09-16T06:35:41.366895+0000 mon.a (mon.0) 717 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:35:42.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:35:42 smithi047 bash[22744]: audit 2024-09-16T06:35:41.351406+0000 mon.a (mon.0) 714 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:35:42.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:35:42 smithi047 bash[22744]: audit 2024-09-16T06:35:41.356099+0000 mon.a (mon.0) 715 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:35:42.840 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:35:42 smithi047 bash[22744]: audit 2024-09-16T06:35:41.361655+0000 mon.a (mon.0) 716 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:35:42.840 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:35:42 smithi047 bash[22744]: audit 2024-09-16T06:35:41.366895+0000 mon.a (mon.0) 717 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:35:43.669 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:35:43.670 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:35:43.670 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:35:43.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:35:43 smithi157 bash[24585]: cluster 2024-09-16T06:35:42.110585+0000 mgr.a (mgr.14373) 2538 : cluster [DBG] pgmap v1760: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:35:43.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:35:43 smithi086 bash[24289]: cluster 2024-09-16T06:35:42.110585+0000 mgr.a (mgr.14373) 2538 : cluster [DBG] pgmap v1760: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:35:43.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:35:43 smithi047 bash[22744]: cluster 2024-09-16T06:35:42.110585+0000 mgr.a (mgr.14373) 2538 : cluster [DBG] pgmap v1760: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:35:44.449 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:35:44.450 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:35:44.450 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:35:44.450 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:35:44.450 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:35:44.760 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:35:44 smithi047 bash[22744]: audit 2024-09-16T06:35:44.005190+0000 mgr.a (mgr.14373) 2539 : audit [DBG] from='client.66744 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:35:44.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:35:44 smithi157 bash[24585]: audit 2024-09-16T06:35:44.005190+0000 mgr.a (mgr.14373) 2539 : audit [DBG] from='client.66744 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:35:44.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:35:44 smithi086 bash[24289]: audit 2024-09-16T06:35:44.005190+0000 mgr.a (mgr.14373) 2539 : audit [DBG] from='client.66744 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:35:45.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:35:45 smithi157 bash[24585]: cluster 2024-09-16T06:35:44.111079+0000 mgr.a (mgr.14373) 2540 : cluster [DBG] pgmap v1761: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:35:45.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:35:45 smithi086 bash[24289]: cluster 2024-09-16T06:35:44.111079+0000 mgr.a (mgr.14373) 2540 : cluster [DBG] pgmap v1761: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:35:45.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:35:45 smithi047 bash[22744]: cluster 2024-09-16T06:35:44.111079+0000 mgr.a (mgr.14373) 2540 : cluster [DBG] pgmap v1761: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:35:47.675 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:35:47 smithi047 bash[22744]: cluster 2024-09-16T06:35:46.112086+0000 mgr.a (mgr.14373) 2541 : cluster [DBG] pgmap v1762: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:35:47.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:35:47 smithi157 bash[24585]: cluster 2024-09-16T06:35:46.112086+0000 mgr.a (mgr.14373) 2541 : cluster [DBG] pgmap v1762: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:35:47.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:35:47 smithi086 bash[24289]: cluster 2024-09-16T06:35:46.112086+0000 mgr.a (mgr.14373) 2541 : cluster [DBG] pgmap v1762: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:35:49.453 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:35:49.453 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:35:49.453 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:35:49.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:35:49 smithi157 bash[24585]: cluster 2024-09-16T06:35:48.114384+0000 mgr.a (mgr.14373) 2542 : cluster [DBG] pgmap v1763: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:35:49.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:35:49 smithi086 bash[24289]: cluster 2024-09-16T06:35:48.114384+0000 mgr.a (mgr.14373) 2542 : cluster [DBG] pgmap v1763: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:35:49.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:35:49 smithi047 bash[22744]: cluster 2024-09-16T06:35:48.114384+0000 mgr.a (mgr.14373) 2542 : cluster [DBG] pgmap v1763: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:35:50.229 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:35:50.229 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:35:50.229 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:35:50.229 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:35:50.230 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:35:50.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:35:50 smithi157 bash[24585]: audit 2024-09-16T06:35:49.787213+0000 mgr.a (mgr.14373) 2543 : audit [DBG] from='client.66819 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:35:50.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:35:50 smithi086 bash[24289]: audit 2024-09-16T06:35:49.787213+0000 mgr.a (mgr.14373) 2543 : audit [DBG] from='client.66819 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:35:50.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:35:50 smithi047 bash[22744]: audit 2024-09-16T06:35:49.787213+0000 mgr.a (mgr.14373) 2543 : audit [DBG] from='client.66819 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:35:51.839 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 06:35:51 smithi047 bash[22994]: debug 2024-09-16T06:35:51.459+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T06:35:51.839 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 06:35:51 smithi047 bash[22994]: debug 2024-09-16T06:35:51.463+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T06:35:51.840 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:35:51 smithi047 bash[22744]: cluster 2024-09-16T06:35:50.114876+0000 mgr.a (mgr.14373) 2544 : cluster [DBG] pgmap v1764: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:35:51.840 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:35:51 smithi047 bash[22744]: audit 2024-09-16T06:35:50.691245+0000 mon.a (mon.0) 718 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:35:51.840 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:35:51 smithi047 bash[22744]: audit 2024-09-16T06:35:50.698707+0000 mon.a (mon.0) 719 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:35:51.840 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:35:51 smithi047 bash[22744]: audit 2024-09-16T06:35:50.700926+0000 mon.b (mon.2) 275 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T06:35:51.840 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:35:51 smithi047 bash[22744]: audit 2024-09-16T06:35:50.702882+0000 mon.b (mon.2) 276 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T06:35:51.840 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:35:51 smithi047 bash[22744]: audit 2024-09-16T06:35:50.716525+0000 mon.a (mon.0) 720 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:35:51.840 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:35:51 smithi047 bash[22744]: audit 2024-09-16T06:35:50.721098+0000 mon.b (mon.2) 277 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:35:51.840 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:35:51 smithi047 bash[22744]: audit 2024-09-16T06:35:50.725707+0000 mgr.a (mgr.14373) 2545 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:35:52.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:35:51 smithi157 bash[24585]: cluster 2024-09-16T06:35:50.114876+0000 mgr.a (mgr.14373) 2544 : cluster [DBG] pgmap v1764: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:35:52.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:35:51 smithi157 bash[24585]: audit 2024-09-16T06:35:50.691245+0000 mon.a (mon.0) 718 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:35:52.055 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:35:51 smithi157 bash[24585]: audit 2024-09-16T06:35:50.698707+0000 mon.a (mon.0) 719 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:35:52.055 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:35:51 smithi157 bash[24585]: audit 2024-09-16T06:35:50.700926+0000 mon.b (mon.2) 275 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T06:35:52.055 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:35:51 smithi157 bash[24585]: audit 2024-09-16T06:35:50.702882+0000 mon.b (mon.2) 276 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T06:35:52.055 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:35:51 smithi157 bash[24585]: audit 2024-09-16T06:35:50.716525+0000 mon.a (mon.0) 720 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:35:52.055 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:35:51 smithi157 bash[24585]: audit 2024-09-16T06:35:50.721098+0000 mon.b (mon.2) 277 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:35:52.055 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:35:51 smithi157 bash[24585]: audit 2024-09-16T06:35:50.725707+0000 mgr.a (mgr.14373) 2545 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:35:52.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:35:51 smithi086 bash[24289]: cluster 2024-09-16T06:35:50.114876+0000 mgr.a (mgr.14373) 2544 : cluster [DBG] pgmap v1764: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:35:52.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:35:51 smithi086 bash[24289]: audit 2024-09-16T06:35:50.691245+0000 mon.a (mon.0) 718 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:35:52.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:35:51 smithi086 bash[24289]: audit 2024-09-16T06:35:50.698707+0000 mon.a (mon.0) 719 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:35:52.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:35:51 smithi086 bash[24289]: audit 2024-09-16T06:35:50.700926+0000 mon.b (mon.2) 275 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T06:35:52.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:35:51 smithi086 bash[24289]: audit 2024-09-16T06:35:50.702882+0000 mon.b (mon.2) 276 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T06:35:52.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:35:51 smithi086 bash[24289]: audit 2024-09-16T06:35:50.716525+0000 mon.a (mon.0) 720 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:35:52.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:35:51 smithi086 bash[24289]: audit 2024-09-16T06:35:50.721098+0000 mon.b (mon.2) 277 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:35:52.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:35:51 smithi086 bash[24289]: audit 2024-09-16T06:35:50.725707+0000 mgr.a (mgr.14373) 2545 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:35:53.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:35:52 smithi157 bash[24585]: audit 2024-09-16T06:35:51.465480+0000 mgr.a (mgr.14373) 2546 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T06:35:53.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:35:52 smithi157 bash[24585]: cephadm 2024-09-16T06:35:51.468024+0000 mgr.a (mgr.14373) 2547 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T06:35:53.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:35:52 smithi086 bash[24289]: audit 2024-09-16T06:35:51.465480+0000 mgr.a (mgr.14373) 2546 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T06:35:53.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:35:52 smithi086 bash[24289]: cephadm 2024-09-16T06:35:51.468024+0000 mgr.a (mgr.14373) 2547 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T06:35:53.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:35:52 smithi047 bash[22744]: audit 2024-09-16T06:35:51.465480+0000 mgr.a (mgr.14373) 2546 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T06:35:53.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:35:52 smithi047 bash[22744]: cephadm 2024-09-16T06:35:51.468024+0000 mgr.a (mgr.14373) 2547 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T06:35:54.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:35:53 smithi157 bash[24585]: cluster 2024-09-16T06:35:52.117242+0000 mgr.a (mgr.14373) 2548 : cluster [DBG] pgmap v1765: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:35:54.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:35:53 smithi086 bash[24289]: cluster 2024-09-16T06:35:52.117242+0000 mgr.a (mgr.14373) 2548 : cluster [DBG] pgmap v1765: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:35:54.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:35:53 smithi047 bash[22744]: cluster 2024-09-16T06:35:52.117242+0000 mgr.a (mgr.14373) 2548 : cluster [DBG] pgmap v1765: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:35:55.232 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:35:55.233 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:35:55.233 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:35:56.009 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:35:56.009 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:35:56.010 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:35:56.010 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:35:56.010 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:35:56.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:35:55 smithi157 bash[24585]: cluster 2024-09-16T06:35:54.118035+0000 mgr.a (mgr.14373) 2549 : cluster [DBG] pgmap v1766: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:35:56.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:35:55 smithi086 bash[24289]: cluster 2024-09-16T06:35:54.118035+0000 mgr.a (mgr.14373) 2549 : cluster [DBG] pgmap v1766: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:35:56.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:35:55 smithi047 bash[22744]: cluster 2024-09-16T06:35:54.118035+0000 mgr.a (mgr.14373) 2549 : cluster [DBG] pgmap v1766: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:35:57.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:35:56 smithi157 bash[24585]: audit 2024-09-16T06:35:55.569032+0000 mgr.a (mgr.14373) 2550 : audit [DBG] from='client.67005 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:35:57.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:35:56 smithi086 bash[24289]: audit 2024-09-16T06:35:55.569032+0000 mgr.a (mgr.14373) 2550 : audit [DBG] from='client.67005 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:35:57.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:35:56 smithi047 bash[22744]: audit 2024-09-16T06:35:55.569032+0000 mgr.a (mgr.14373) 2550 : audit [DBG] from='client.67005 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:35:58.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:35:57 smithi157 bash[24585]: cluster 2024-09-16T06:35:56.119191+0000 mgr.a (mgr.14373) 2551 : cluster [DBG] pgmap v1767: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:35:58.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:35:57 smithi086 bash[24289]: cluster 2024-09-16T06:35:56.119191+0000 mgr.a (mgr.14373) 2551 : cluster [DBG] pgmap v1767: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:35:58.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:35:57 smithi047 bash[22744]: cluster 2024-09-16T06:35:56.119191+0000 mgr.a (mgr.14373) 2551 : cluster [DBG] pgmap v1767: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:36:00.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:35:59 smithi157 bash[24585]: cluster 2024-09-16T06:35:58.121577+0000 mgr.a (mgr.14373) 2552 : cluster [DBG] pgmap v1768: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:36:00.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:35:59 smithi086 bash[24289]: cluster 2024-09-16T06:35:58.121577+0000 mgr.a (mgr.14373) 2552 : cluster [DBG] pgmap v1768: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:36:00.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:35:59 smithi047 bash[22744]: cluster 2024-09-16T06:35:58.121577+0000 mgr.a (mgr.14373) 2552 : cluster [DBG] pgmap v1768: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:36:01.011 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:36:01.011 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:36:01.012 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:36:01.783 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:36:01.784 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:36:01.784 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:36:01.784 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:36:01.784 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:36:02.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:36:01 smithi157 bash[24585]: cluster 2024-09-16T06:36:00.122488+0000 mgr.a (mgr.14373) 2553 : cluster [DBG] pgmap v1769: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:36:02.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:36:01 smithi086 bash[24289]: cluster 2024-09-16T06:36:00.122488+0000 mgr.a (mgr.14373) 2553 : cluster [DBG] pgmap v1769: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:36:02.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:36:01 smithi047 bash[22744]: cluster 2024-09-16T06:36:00.122488+0000 mgr.a (mgr.14373) 2553 : cluster [DBG] pgmap v1769: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:36:03.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:36:02 smithi157 bash[24585]: audit 2024-09-16T06:36:01.348174+0000 mgr.a (mgr.14373) 2554 : audit [DBG] from='client.67083 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:36:03.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:36:02 smithi086 bash[24289]: audit 2024-09-16T06:36:01.348174+0000 mgr.a (mgr.14373) 2554 : audit [DBG] from='client.67083 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:36:03.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:36:02 smithi047 bash[22744]: audit 2024-09-16T06:36:01.348174+0000 mgr.a (mgr.14373) 2554 : audit [DBG] from='client.67083 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:36:04.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:36:03 smithi157 bash[24585]: cluster 2024-09-16T06:36:02.125270+0000 mgr.a (mgr.14373) 2555 : cluster [DBG] pgmap v1770: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:36:04.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:36:03 smithi086 bash[24289]: cluster 2024-09-16T06:36:02.125270+0000 mgr.a (mgr.14373) 2555 : cluster [DBG] pgmap v1770: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:36:04.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:36:03 smithi047 bash[22744]: cluster 2024-09-16T06:36:02.125270+0000 mgr.a (mgr.14373) 2555 : cluster [DBG] pgmap v1770: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:36:06.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:36:05 smithi157 bash[24585]: cluster 2024-09-16T06:36:04.126061+0000 mgr.a (mgr.14373) 2556 : cluster [DBG] pgmap v1771: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:36:06.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:36:05 smithi086 bash[24289]: cluster 2024-09-16T06:36:04.126061+0000 mgr.a (mgr.14373) 2556 : cluster [DBG] pgmap v1771: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:36:06.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:36:05 smithi047 bash[22744]: cluster 2024-09-16T06:36:04.126061+0000 mgr.a (mgr.14373) 2556 : cluster [DBG] pgmap v1771: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:36:06.785 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:36:06.786 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:36:06.786 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:36:07.555 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:36:07.555 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:36:07.556 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:36:07.556 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:36:07.556 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:36:08.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:36:07 smithi157 bash[24585]: cluster 2024-09-16T06:36:06.126913+0000 mgr.a (mgr.14373) 2557 : cluster [DBG] pgmap v1772: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:36:08.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:36:07 smithi086 bash[24289]: cluster 2024-09-16T06:36:06.126913+0000 mgr.a (mgr.14373) 2557 : cluster [DBG] pgmap v1772: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:36:08.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:36:07 smithi047 bash[22744]: cluster 2024-09-16T06:36:06.126913+0000 mgr.a (mgr.14373) 2557 : cluster [DBG] pgmap v1772: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:36:09.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:36:08 smithi157 bash[24585]: audit 2024-09-16T06:36:07.120338+0000 mgr.a (mgr.14373) 2558 : audit [DBG] from='client.67161 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:36:09.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:36:08 smithi086 bash[24289]: audit 2024-09-16T06:36:07.120338+0000 mgr.a (mgr.14373) 2558 : audit [DBG] from='client.67161 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:36:09.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:36:08 smithi047 bash[22744]: audit 2024-09-16T06:36:07.120338+0000 mgr.a (mgr.14373) 2558 : audit [DBG] from='client.67161 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:36:10.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:36:09 smithi157 bash[24585]: cluster 2024-09-16T06:36:08.129613+0000 mgr.a (mgr.14373) 2559 : cluster [DBG] pgmap v1773: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:36:10.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:36:09 smithi086 bash[24289]: cluster 2024-09-16T06:36:08.129613+0000 mgr.a (mgr.14373) 2559 : cluster [DBG] pgmap v1773: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:36:10.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:36:09 smithi047 bash[22744]: cluster 2024-09-16T06:36:08.129613+0000 mgr.a (mgr.14373) 2559 : cluster [DBG] pgmap v1773: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:36:12.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:36:11 smithi157 bash[24585]: cluster 2024-09-16T06:36:10.130429+0000 mgr.a (mgr.14373) 2560 : cluster [DBG] pgmap v1774: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:36:12.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:36:11 smithi086 bash[24289]: cluster 2024-09-16T06:36:10.130429+0000 mgr.a (mgr.14373) 2560 : cluster [DBG] pgmap v1774: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:36:12.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:36:11 smithi047 bash[22744]: cluster 2024-09-16T06:36:10.130429+0000 mgr.a (mgr.14373) 2560 : cluster [DBG] pgmap v1774: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:36:12.557 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:36:12.557 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:36:12.557 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:36:13.327 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:36:13.328 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:36:13.328 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:36:13.328 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:36:13.328 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:36:14.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:36:13 smithi157 bash[24585]: cluster 2024-09-16T06:36:12.132435+0000 mgr.a (mgr.14373) 2561 : cluster [DBG] pgmap v1775: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:36:14.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:36:13 smithi157 bash[24585]: audit 2024-09-16T06:36:12.897985+0000 mgr.a (mgr.14373) 2562 : audit [DBG] from='client.67236 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:36:14.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:36:13 smithi086 bash[24289]: cluster 2024-09-16T06:36:12.132435+0000 mgr.a (mgr.14373) 2561 : cluster [DBG] pgmap v1775: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:36:14.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:36:13 smithi086 bash[24289]: audit 2024-09-16T06:36:12.897985+0000 mgr.a (mgr.14373) 2562 : audit [DBG] from='client.67236 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:36:14.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:36:13 smithi047 bash[22744]: cluster 2024-09-16T06:36:12.132435+0000 mgr.a (mgr.14373) 2561 : cluster [DBG] pgmap v1775: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:36:14.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:36:13 smithi047 bash[22744]: audit 2024-09-16T06:36:12.897985+0000 mgr.a (mgr.14373) 2562 : audit [DBG] from='client.67236 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:36:16.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:36:15 smithi157 bash[24585]: cluster 2024-09-16T06:36:14.133352+0000 mgr.a (mgr.14373) 2563 : cluster [DBG] pgmap v1776: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:36:16.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:36:15 smithi086 bash[24289]: cluster 2024-09-16T06:36:14.133352+0000 mgr.a (mgr.14373) 2563 : cluster [DBG] pgmap v1776: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:36:16.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:36:15 smithi047 bash[22744]: cluster 2024-09-16T06:36:14.133352+0000 mgr.a (mgr.14373) 2563 : cluster [DBG] pgmap v1776: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:36:18.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:36:17 smithi157 bash[24585]: cluster 2024-09-16T06:36:16.134135+0000 mgr.a (mgr.14373) 2564 : cluster [DBG] pgmap v1777: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:36:18.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:36:17 smithi086 bash[24289]: cluster 2024-09-16T06:36:16.134135+0000 mgr.a (mgr.14373) 2564 : cluster [DBG] pgmap v1777: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:36:18.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:36:17 smithi047 bash[22744]: cluster 2024-09-16T06:36:16.134135+0000 mgr.a (mgr.14373) 2564 : cluster [DBG] pgmap v1777: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:36:18.329 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:36:18.329 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:36:18.330 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:36:19.109 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:36:19.109 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:36:19.109 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:36:19.109 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:36:19.109 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:36:20.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:36:19 smithi157 bash[24585]: cluster 2024-09-16T06:36:18.136258+0000 mgr.a (mgr.14373) 2565 : cluster [DBG] pgmap v1778: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:36:20.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:36:19 smithi157 bash[24585]: audit 2024-09-16T06:36:18.666614+0000 mgr.a (mgr.14373) 2566 : audit [DBG] from='client.67314 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:36:20.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:36:19 smithi086 bash[24289]: cluster 2024-09-16T06:36:18.136258+0000 mgr.a (mgr.14373) 2565 : cluster [DBG] pgmap v1778: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:36:20.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:36:19 smithi086 bash[24289]: audit 2024-09-16T06:36:18.666614+0000 mgr.a (mgr.14373) 2566 : audit [DBG] from='client.67314 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:36:20.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:36:19 smithi047 bash[22744]: cluster 2024-09-16T06:36:18.136258+0000 mgr.a (mgr.14373) 2565 : cluster [DBG] pgmap v1778: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:36:20.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:36:19 smithi047 bash[22744]: audit 2024-09-16T06:36:18.666614+0000 mgr.a (mgr.14373) 2566 : audit [DBG] from='client.67314 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:36:22.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:36:21 smithi157 bash[24585]: cluster 2024-09-16T06:36:20.137152+0000 mgr.a (mgr.14373) 2567 : cluster [DBG] pgmap v1779: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:36:22.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:36:21 smithi086 bash[24289]: cluster 2024-09-16T06:36:20.137152+0000 mgr.a (mgr.14373) 2567 : cluster [DBG] pgmap v1779: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:36:22.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:36:21 smithi047 bash[22744]: cluster 2024-09-16T06:36:20.137152+0000 mgr.a (mgr.14373) 2567 : cluster [DBG] pgmap v1779: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:36:24.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:36:23 smithi157 bash[24585]: cluster 2024-09-16T06:36:22.139402+0000 mgr.a (mgr.14373) 2568 : cluster [DBG] pgmap v1780: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:36:24.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:36:23 smithi086 bash[24289]: cluster 2024-09-16T06:36:22.139402+0000 mgr.a (mgr.14373) 2568 : cluster [DBG] pgmap v1780: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:36:24.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:36:23 smithi047 bash[22744]: cluster 2024-09-16T06:36:22.139402+0000 mgr.a (mgr.14373) 2568 : cluster [DBG] pgmap v1780: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:36:24.110 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:36:24.111 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:36:24.111 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:36:24.849 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:36:24.850 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:36:24.850 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:36:24.850 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:36:24.850 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:36:26.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:36:25 smithi157 bash[24585]: cluster 2024-09-16T06:36:24.140073+0000 mgr.a (mgr.14373) 2569 : cluster [DBG] pgmap v1781: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:36:26.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:36:25 smithi157 bash[24585]: audit 2024-09-16T06:36:24.439116+0000 mgr.a (mgr.14373) 2570 : audit [DBG] from='client.67389 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:36:26.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:36:25 smithi086 bash[24289]: cluster 2024-09-16T06:36:24.140073+0000 mgr.a (mgr.14373) 2569 : cluster [DBG] pgmap v1781: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:36:26.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:36:25 smithi086 bash[24289]: audit 2024-09-16T06:36:24.439116+0000 mgr.a (mgr.14373) 2570 : audit [DBG] from='client.67389 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:36:26.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:36:25 smithi047 bash[22744]: cluster 2024-09-16T06:36:24.140073+0000 mgr.a (mgr.14373) 2569 : cluster [DBG] pgmap v1781: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:36:26.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:36:25 smithi047 bash[22744]: audit 2024-09-16T06:36:24.439116+0000 mgr.a (mgr.14373) 2570 : audit [DBG] from='client.67389 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:36:28.055 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:36:27 smithi157 bash[24585]: cluster 2024-09-16T06:36:26.140950+0000 mgr.a (mgr.14373) 2571 : cluster [DBG] pgmap v1782: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:36:28.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:36:27 smithi086 bash[24289]: cluster 2024-09-16T06:36:26.140950+0000 mgr.a (mgr.14373) 2571 : cluster [DBG] pgmap v1782: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:36:28.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:36:27 smithi047 bash[22744]: cluster 2024-09-16T06:36:26.140950+0000 mgr.a (mgr.14373) 2571 : cluster [DBG] pgmap v1782: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:36:29.851 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:36:29.851 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:36:29.852 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:36:30.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:36:29 smithi157 bash[24585]: cluster 2024-09-16T06:36:28.143222+0000 mgr.a (mgr.14373) 2572 : cluster [DBG] pgmap v1783: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:36:30.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:36:29 smithi086 bash[24289]: cluster 2024-09-16T06:36:28.143222+0000 mgr.a (mgr.14373) 2572 : cluster [DBG] pgmap v1783: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:36:30.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:36:29 smithi047 bash[22744]: cluster 2024-09-16T06:36:28.143222+0000 mgr.a (mgr.14373) 2572 : cluster [DBG] pgmap v1783: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:36:30.594 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:36:30.594 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:36:30.594 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:36:30.594 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:36:30.594 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:36:32.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:36:31 smithi157 bash[24585]: cluster 2024-09-16T06:36:30.143947+0000 mgr.a (mgr.14373) 2573 : cluster [DBG] pgmap v1784: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:36:32.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:36:31 smithi157 bash[24585]: audit 2024-09-16T06:36:30.184661+0000 mgr.a (mgr.14373) 2574 : audit [DBG] from='client.67467 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:36:32.073 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:36:31 smithi086 bash[24289]: cluster 2024-09-16T06:36:30.143947+0000 mgr.a (mgr.14373) 2573 : cluster [DBG] pgmap v1784: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:36:32.073 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:36:31 smithi086 bash[24289]: audit 2024-09-16T06:36:30.184661+0000 mgr.a (mgr.14373) 2574 : audit [DBG] from='client.67467 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:36:32.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:36:31 smithi047 bash[22744]: cluster 2024-09-16T06:36:30.143947+0000 mgr.a (mgr.14373) 2573 : cluster [DBG] pgmap v1784: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:36:32.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:36:31 smithi047 bash[22744]: audit 2024-09-16T06:36:30.184661+0000 mgr.a (mgr.14373) 2574 : audit [DBG] from='client.67467 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:36:34.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:36:33 smithi157 bash[24585]: cluster 2024-09-16T06:36:32.146291+0000 mgr.a (mgr.14373) 2575 : cluster [DBG] pgmap v1785: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:36:34.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:36:33 smithi086 bash[24289]: cluster 2024-09-16T06:36:32.146291+0000 mgr.a (mgr.14373) 2575 : cluster [DBG] pgmap v1785: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:36:34.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:36:33 smithi047 bash[22744]: cluster 2024-09-16T06:36:32.146291+0000 mgr.a (mgr.14373) 2575 : cluster [DBG] pgmap v1785: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:36:35.595 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:36:35.596 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:36:35.596 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:36:36.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:36:35 smithi086 bash[24289]: cluster 2024-09-16T06:36:34.147075+0000 mgr.a (mgr.14373) 2576 : cluster [DBG] pgmap v1786: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:36:36.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:36:35 smithi047 bash[22744]: cluster 2024-09-16T06:36:34.147075+0000 mgr.a (mgr.14373) 2576 : cluster [DBG] pgmap v1786: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:36:36.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:36:35 smithi157 bash[24585]: cluster 2024-09-16T06:36:34.147075+0000 mgr.a (mgr.14373) 2576 : cluster [DBG] pgmap v1786: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:36:36.368 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:36:36.368 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:36:36.368 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:36:36.368 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:36:36.369 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:36:37.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:36:36 smithi086 bash[24289]: audit 2024-09-16T06:36:35.931827+0000 mgr.a (mgr.14373) 2577 : audit [DBG] from='client.67542 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:36:37.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:36:36 smithi047 bash[22744]: audit 2024-09-16T06:36:35.931827+0000 mgr.a (mgr.14373) 2577 : audit [DBG] from='client.67542 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:36:37.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:36:36 smithi157 bash[24585]: audit 2024-09-16T06:36:35.931827+0000 mgr.a (mgr.14373) 2577 : audit [DBG] from='client.67542 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:36:38.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:36:37 smithi086 bash[24289]: cluster 2024-09-16T06:36:36.147571+0000 mgr.a (mgr.14373) 2578 : cluster [DBG] pgmap v1787: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:36:38.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:36:37 smithi047 bash[22744]: cluster 2024-09-16T06:36:36.147571+0000 mgr.a (mgr.14373) 2578 : cluster [DBG] pgmap v1787: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:36:38.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:36:37 smithi157 bash[24585]: cluster 2024-09-16T06:36:36.147571+0000 mgr.a (mgr.14373) 2578 : cluster [DBG] pgmap v1787: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:36:40.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:36:39 smithi047 bash[22744]: cluster 2024-09-16T06:36:38.149836+0000 mgr.a (mgr.14373) 2579 : cluster [DBG] pgmap v1788: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:36:40.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:36:39 smithi157 bash[24585]: cluster 2024-09-16T06:36:38.149836+0000 mgr.a (mgr.14373) 2579 : cluster [DBG] pgmap v1788: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:36:40.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:36:39 smithi086 bash[24289]: cluster 2024-09-16T06:36:38.149836+0000 mgr.a (mgr.14373) 2579 : cluster [DBG] pgmap v1788: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:36:41.369 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:36:41.370 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:36:41.371 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:36:42.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:36:41 smithi047 bash[22744]: cluster 2024-09-16T06:36:40.150632+0000 mgr.a (mgr.14373) 2580 : cluster [DBG] pgmap v1789: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:36:42.114 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:36:42.114 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:36:42.114 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:36:42.114 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:36:42.114 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:36:42.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:36:41 smithi157 bash[24585]: cluster 2024-09-16T06:36:40.150632+0000 mgr.a (mgr.14373) 2580 : cluster [DBG] pgmap v1789: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:36:42.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:36:41 smithi086 bash[24289]: cluster 2024-09-16T06:36:40.150632+0000 mgr.a (mgr.14373) 2580 : cluster [DBG] pgmap v1789: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:36:43.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:36:42 smithi157 bash[24585]: audit 2024-09-16T06:36:41.698642+0000 mgr.a (mgr.14373) 2581 : audit [DBG] from='client.67617 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:36:43.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:36:42 smithi086 bash[24289]: audit 2024-09-16T06:36:41.698642+0000 mgr.a (mgr.14373) 2581 : audit [DBG] from='client.67617 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:36:43.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:36:42 smithi047 bash[22744]: audit 2024-09-16T06:36:41.698642+0000 mgr.a (mgr.14373) 2581 : audit [DBG] from='client.67617 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:36:44.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:36:43 smithi157 bash[24585]: cluster 2024-09-16T06:36:42.151958+0000 mgr.a (mgr.14373) 2582 : cluster [DBG] pgmap v1790: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:36:44.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:36:43 smithi086 bash[24289]: cluster 2024-09-16T06:36:42.151958+0000 mgr.a (mgr.14373) 2582 : cluster [DBG] pgmap v1790: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:36:44.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:36:43 smithi047 bash[22744]: cluster 2024-09-16T06:36:42.151958+0000 mgr.a (mgr.14373) 2582 : cluster [DBG] pgmap v1790: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:36:46.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:36:45 smithi157 bash[24585]: cluster 2024-09-16T06:36:44.152693+0000 mgr.a (mgr.14373) 2583 : cluster [DBG] pgmap v1791: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T06:36:46.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:36:45 smithi086 bash[24289]: cluster 2024-09-16T06:36:44.152693+0000 mgr.a (mgr.14373) 2583 : cluster [DBG] pgmap v1791: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T06:36:46.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:36:45 smithi047 bash[22744]: cluster 2024-09-16T06:36:44.152693+0000 mgr.a (mgr.14373) 2583 : cluster [DBG] pgmap v1791: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T06:36:47.115 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:36:47.116 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:36:47.116 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:36:47.905 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:36:47.905 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:36:47.906 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:36:47.906 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:36:47.906 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:36:48.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:36:47 smithi157 bash[24585]: cluster 2024-09-16T06:36:46.153451+0000 mgr.a (mgr.14373) 2584 : cluster [DBG] pgmap v1792: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T06:36:48.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:36:47 smithi086 bash[24289]: cluster 2024-09-16T06:36:46.153451+0000 mgr.a (mgr.14373) 2584 : cluster [DBG] pgmap v1792: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T06:36:48.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:36:47 smithi047 bash[22744]: cluster 2024-09-16T06:36:46.153451+0000 mgr.a (mgr.14373) 2584 : cluster [DBG] pgmap v1792: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T06:36:49.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:36:48 smithi157 bash[24585]: audit 2024-09-16T06:36:47.455152+0000 mgr.a (mgr.14373) 2585 : audit [DBG] from='client.67695 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:36:49.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:36:48 smithi086 bash[24289]: audit 2024-09-16T06:36:47.455152+0000 mgr.a (mgr.14373) 2585 : audit [DBG] from='client.67695 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:36:49.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:36:48 smithi047 bash[22744]: audit 2024-09-16T06:36:47.455152+0000 mgr.a (mgr.14373) 2585 : audit [DBG] from='client.67695 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:36:50.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:36:49 smithi157 bash[24585]: cluster 2024-09-16T06:36:48.156305+0000 mgr.a (mgr.14373) 2586 : cluster [DBG] pgmap v1793: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:36:50.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:36:49 smithi086 bash[24289]: cluster 2024-09-16T06:36:48.156305+0000 mgr.a (mgr.14373) 2586 : cluster [DBG] pgmap v1793: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:36:50.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:36:49 smithi047 bash[22744]: cluster 2024-09-16T06:36:48.156305+0000 mgr.a (mgr.14373) 2586 : cluster [DBG] pgmap v1793: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:36:52.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:36:51 smithi157 bash[24585]: cluster 2024-09-16T06:36:50.157085+0000 mgr.a (mgr.14373) 2587 : cluster [DBG] pgmap v1794: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:36:52.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:36:51 smithi157 bash[24585]: audit 2024-09-16T06:36:51.534163+0000 mon.b (mon.2) 278 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T06:36:52.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:36:51 smithi086 bash[24289]: cluster 2024-09-16T06:36:50.157085+0000 mgr.a (mgr.14373) 2587 : cluster [DBG] pgmap v1794: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:36:52.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:36:51 smithi086 bash[24289]: audit 2024-09-16T06:36:51.534163+0000 mon.b (mon.2) 278 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T06:36:52.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:36:51 smithi047 bash[22744]: cluster 2024-09-16T06:36:50.157085+0000 mgr.a (mgr.14373) 2587 : cluster [DBG] pgmap v1794: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:36:52.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:36:51 smithi047 bash[22744]: audit 2024-09-16T06:36:51.534163+0000 mon.b (mon.2) 278 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T06:36:52.907 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:36:52.907 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:36:52.908 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:36:53.671 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:36:53.671 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:36:53.672 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:36:53.672 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:36:53.672 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:36:54.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:36:54 smithi157 bash[24585]: cluster 2024-09-16T06:36:52.158168+0000 mgr.a (mgr.14373) 2588 : cluster [DBG] pgmap v1795: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:36:54.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:36:54 smithi086 bash[24289]: cluster 2024-09-16T06:36:52.158168+0000 mgr.a (mgr.14373) 2588 : cluster [DBG] pgmap v1795: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:36:54.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:36:54 smithi047 bash[22744]: cluster 2024-09-16T06:36:52.158168+0000 mgr.a (mgr.14373) 2588 : cluster [DBG] pgmap v1795: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:36:55.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:36:55 smithi157 bash[24585]: audit 2024-09-16T06:36:53.246911+0000 mgr.a (mgr.14373) 2589 : audit [DBG] from='client.67767 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:36:55.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:36:55 smithi086 bash[24289]: audit 2024-09-16T06:36:53.246911+0000 mgr.a (mgr.14373) 2589 : audit [DBG] from='client.67767 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:36:55.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:36:55 smithi047 bash[22744]: audit 2024-09-16T06:36:53.246911+0000 mgr.a (mgr.14373) 2589 : audit [DBG] from='client.67767 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:36:56.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:36:56 smithi157 bash[24585]: cluster 2024-09-16T06:36:54.159054+0000 mgr.a (mgr.14373) 2590 : cluster [DBG] pgmap v1796: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:36:56.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:36:56 smithi086 bash[24289]: cluster 2024-09-16T06:36:54.159054+0000 mgr.a (mgr.14373) 2590 : cluster [DBG] pgmap v1796: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:36:56.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:36:56 smithi047 bash[22744]: cluster 2024-09-16T06:36:54.159054+0000 mgr.a (mgr.14373) 2590 : cluster [DBG] pgmap v1796: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:36:58.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:36:58 smithi157 bash[24585]: cluster 2024-09-16T06:36:56.159858+0000 mgr.a (mgr.14373) 2591 : cluster [DBG] pgmap v1797: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:36:58.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:36:58 smithi086 bash[24289]: cluster 2024-09-16T06:36:56.159858+0000 mgr.a (mgr.14373) 2591 : cluster [DBG] pgmap v1797: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:36:58.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:36:58 smithi047 bash[22744]: cluster 2024-09-16T06:36:56.159858+0000 mgr.a (mgr.14373) 2591 : cluster [DBG] pgmap v1797: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:36:58.672 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:36:58.673 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:36:58.673 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:36:59.451 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:36:59.451 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:36:59.451 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:36:59.452 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:36:59.452 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:37:00.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:37:00 smithi157 bash[24585]: cluster 2024-09-16T06:36:58.162149+0000 mgr.a (mgr.14373) 2592 : cluster [DBG] pgmap v1798: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:37:00.305 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:37:00 smithi157 bash[24585]: audit 2024-09-16T06:36:59.011426+0000 mgr.a (mgr.14373) 2593 : audit [DBG] from='client.67845 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:37:00.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:37:00 smithi086 bash[24289]: cluster 2024-09-16T06:36:58.162149+0000 mgr.a (mgr.14373) 2592 : cluster [DBG] pgmap v1798: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:37:00.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:37:00 smithi086 bash[24289]: audit 2024-09-16T06:36:59.011426+0000 mgr.a (mgr.14373) 2593 : audit [DBG] from='client.67845 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:37:00.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:37:00 smithi047 bash[22744]: cluster 2024-09-16T06:36:58.162149+0000 mgr.a (mgr.14373) 2592 : cluster [DBG] pgmap v1798: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:37:00.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:37:00 smithi047 bash[22744]: audit 2024-09-16T06:36:59.011426+0000 mgr.a (mgr.14373) 2593 : audit [DBG] from='client.67845 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:37:02.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:37:02 smithi157 bash[24585]: cluster 2024-09-16T06:37:00.163037+0000 mgr.a (mgr.14373) 2594 : cluster [DBG] pgmap v1799: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:37:02.305 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:37:02 smithi157 bash[24585]: audit 2024-09-16T06:37:01.856632+0000 mon.a (mon.0) 721 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:37:02.305 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:37:02 smithi157 bash[24585]: audit 2024-09-16T06:37:01.867204+0000 mon.a (mon.0) 722 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:37:02.305 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:37:02 smithi157 bash[24585]: audit 2024-09-16T06:37:01.868711+0000 mon.b (mon.2) 279 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T06:37:02.305 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:37:02 smithi157 bash[24585]: audit 2024-09-16T06:37:01.870788+0000 mon.b (mon.2) 280 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T06:37:02.305 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:37:02 smithi157 bash[24585]: audit 2024-09-16T06:37:01.884190+0000 mon.a (mon.0) 723 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:37:02.305 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:37:02 smithi157 bash[24585]: audit 2024-09-16T06:37:01.889398+0000 mon.b (mon.2) 281 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:37:02.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:37:02 smithi086 bash[24289]: cluster 2024-09-16T06:37:00.163037+0000 mgr.a (mgr.14373) 2594 : cluster [DBG] pgmap v1799: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:37:02.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:37:02 smithi086 bash[24289]: audit 2024-09-16T06:37:01.856632+0000 mon.a (mon.0) 721 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:37:02.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:37:02 smithi086 bash[24289]: audit 2024-09-16T06:37:01.867204+0000 mon.a (mon.0) 722 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:37:02.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:37:02 smithi086 bash[24289]: audit 2024-09-16T06:37:01.868711+0000 mon.b (mon.2) 279 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T06:37:02.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:37:02 smithi086 bash[24289]: audit 2024-09-16T06:37:01.870788+0000 mon.b (mon.2) 280 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T06:37:02.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:37:02 smithi086 bash[24289]: audit 2024-09-16T06:37:01.884190+0000 mon.a (mon.0) 723 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:37:02.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:37:02 smithi086 bash[24289]: audit 2024-09-16T06:37:01.889398+0000 mon.b (mon.2) 281 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:37:02.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:37:02 smithi047 bash[22744]: cluster 2024-09-16T06:37:00.163037+0000 mgr.a (mgr.14373) 2594 : cluster [DBG] pgmap v1799: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:37:02.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:37:02 smithi047 bash[22744]: audit 2024-09-16T06:37:01.856632+0000 mon.a (mon.0) 721 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:37:02.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:37:02 smithi047 bash[22744]: audit 2024-09-16T06:37:01.867204+0000 mon.a (mon.0) 722 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:37:02.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:37:02 smithi047 bash[22744]: audit 2024-09-16T06:37:01.868711+0000 mon.b (mon.2) 279 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T06:37:02.340 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:37:02 smithi047 bash[22744]: audit 2024-09-16T06:37:01.870788+0000 mon.b (mon.2) 280 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T06:37:02.340 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:37:02 smithi047 bash[22744]: audit 2024-09-16T06:37:01.884190+0000 mon.a (mon.0) 723 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:37:02.340 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:37:02 smithi047 bash[22744]: audit 2024-09-16T06:37:01.889398+0000 mon.b (mon.2) 281 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:37:03.062 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 06:37:02 smithi047 bash[22994]: debug 2024-09-16T06:37:02.633+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T06:37:03.062 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 06:37:02 smithi047 bash[22994]: debug 2024-09-16T06:37:02.637+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T06:37:03.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:37:03 smithi086 bash[24289]: audit 2024-09-16T06:37:01.893688+0000 mgr.a (mgr.14373) 2595 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:37:03.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:37:03 smithi047 bash[22744]: audit 2024-09-16T06:37:01.893688+0000 mgr.a (mgr.14373) 2595 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:37:03.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:37:03 smithi157 bash[24585]: audit 2024-09-16T06:37:01.893688+0000 mgr.a (mgr.14373) 2595 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:37:04.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:37:04 smithi086 bash[24289]: cluster 2024-09-16T06:37:02.164395+0000 mgr.a (mgr.14373) 2596 : cluster [DBG] pgmap v1800: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:37:04.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:37:04 smithi086 bash[24289]: audit 2024-09-16T06:37:02.638204+0000 mgr.a (mgr.14373) 2597 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T06:37:04.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:37:04 smithi086 bash[24289]: cephadm 2024-09-16T06:37:02.640038+0000 mgr.a (mgr.14373) 2598 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T06:37:04.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:37:04 smithi047 bash[22744]: cluster 2024-09-16T06:37:02.164395+0000 mgr.a (mgr.14373) 2596 : cluster [DBG] pgmap v1800: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:37:04.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:37:04 smithi047 bash[22744]: audit 2024-09-16T06:37:02.638204+0000 mgr.a (mgr.14373) 2597 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T06:37:04.340 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:37:04 smithi047 bash[22744]: cephadm 2024-09-16T06:37:02.640038+0000 mgr.a (mgr.14373) 2598 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T06:37:04.453 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:37:04.453 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:37:04.454 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:37:04.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:37:04 smithi157 bash[24585]: cluster 2024-09-16T06:37:02.164395+0000 mgr.a (mgr.14373) 2596 : cluster [DBG] pgmap v1800: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:37:04.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:37:04 smithi157 bash[24585]: audit 2024-09-16T06:37:02.638204+0000 mgr.a (mgr.14373) 2597 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T06:37:04.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:37:04 smithi157 bash[24585]: cephadm 2024-09-16T06:37:02.640038+0000 mgr.a (mgr.14373) 2598 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T06:37:05.200 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:37:05.201 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:37:05.201 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:37:05.201 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:37:05.201 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:37:06.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:37:06 smithi086 bash[24289]: cluster 2024-09-16T06:37:04.165240+0000 mgr.a (mgr.14373) 2599 : cluster [DBG] pgmap v1801: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:37:06.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:37:06 smithi086 bash[24289]: audit 2024-09-16T06:37:04.784947+0000 mgr.a (mgr.14373) 2600 : audit [DBG] from='client.68028 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:37:06.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:37:06 smithi047 bash[22744]: cluster 2024-09-16T06:37:04.165240+0000 mgr.a (mgr.14373) 2599 : cluster [DBG] pgmap v1801: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:37:06.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:37:06 smithi047 bash[22744]: audit 2024-09-16T06:37:04.784947+0000 mgr.a (mgr.14373) 2600 : audit [DBG] from='client.68028 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:37:06.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:37:06 smithi157 bash[24585]: cluster 2024-09-16T06:37:04.165240+0000 mgr.a (mgr.14373) 2599 : cluster [DBG] pgmap v1801: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:37:06.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:37:06 smithi157 bash[24585]: audit 2024-09-16T06:37:04.784947+0000 mgr.a (mgr.14373) 2600 : audit [DBG] from='client.68028 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:37:08.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:37:08 smithi047 bash[22744]: cluster 2024-09-16T06:37:06.166122+0000 mgr.a (mgr.14373) 2601 : cluster [DBG] pgmap v1802: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:37:08.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:37:08 smithi157 bash[24585]: cluster 2024-09-16T06:37:06.166122+0000 mgr.a (mgr.14373) 2601 : cluster [DBG] pgmap v1802: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:37:08.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:37:08 smithi086 bash[24289]: cluster 2024-09-16T06:37:06.166122+0000 mgr.a (mgr.14373) 2601 : cluster [DBG] pgmap v1802: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:37:10.202 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:37:10.203 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:37:10.203 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:37:10.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:37:10 smithi047 bash[22744]: cluster 2024-09-16T06:37:08.168487+0000 mgr.a (mgr.14373) 2602 : cluster [DBG] pgmap v1803: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:37:10.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:37:10 smithi157 bash[24585]: cluster 2024-09-16T06:37:08.168487+0000 mgr.a (mgr.14373) 2602 : cluster [DBG] pgmap v1803: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:37:10.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:37:10 smithi086 bash[24289]: cluster 2024-09-16T06:37:08.168487+0000 mgr.a (mgr.14373) 2602 : cluster [DBG] pgmap v1803: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:37:10.953 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:37:10.953 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:37:10.953 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:37:10.953 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:37:10.953 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:37:12.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:37:12 smithi047 bash[22744]: cluster 2024-09-16T06:37:10.169246+0000 mgr.a (mgr.14373) 2603 : cluster [DBG] pgmap v1804: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:37:12.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:37:12 smithi047 bash[22744]: audit 2024-09-16T06:37:10.535712+0000 mgr.a (mgr.14373) 2604 : audit [DBG] from='client.68100 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:37:12.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:37:12 smithi157 bash[24585]: cluster 2024-09-16T06:37:10.169246+0000 mgr.a (mgr.14373) 2603 : cluster [DBG] pgmap v1804: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:37:12.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:37:12 smithi157 bash[24585]: audit 2024-09-16T06:37:10.535712+0000 mgr.a (mgr.14373) 2604 : audit [DBG] from='client.68100 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:37:12.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:37:12 smithi086 bash[24289]: cluster 2024-09-16T06:37:10.169246+0000 mgr.a (mgr.14373) 2603 : cluster [DBG] pgmap v1804: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:37:12.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:37:12 smithi086 bash[24289]: audit 2024-09-16T06:37:10.535712+0000 mgr.a (mgr.14373) 2604 : audit [DBG] from='client.68100 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:37:14.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:37:14 smithi047 bash[22744]: cluster 2024-09-16T06:37:12.171725+0000 mgr.a (mgr.14373) 2605 : cluster [DBG] pgmap v1805: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:37:14.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:37:14 smithi157 bash[24585]: cluster 2024-09-16T06:37:12.171725+0000 mgr.a (mgr.14373) 2605 : cluster [DBG] pgmap v1805: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:37:14.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:37:14 smithi086 bash[24289]: cluster 2024-09-16T06:37:12.171725+0000 mgr.a (mgr.14373) 2605 : cluster [DBG] pgmap v1805: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:37:15.954 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:37:15.955 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:37:15.955 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:37:16.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:37:16 smithi047 bash[22744]: cluster 2024-09-16T06:37:14.172520+0000 mgr.a (mgr.14373) 2606 : cluster [DBG] pgmap v1806: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:37:16.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:37:16 smithi157 bash[24585]: cluster 2024-09-16T06:37:14.172520+0000 mgr.a (mgr.14373) 2606 : cluster [DBG] pgmap v1806: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:37:16.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:37:16 smithi086 bash[24289]: cluster 2024-09-16T06:37:14.172520+0000 mgr.a (mgr.14373) 2606 : cluster [DBG] pgmap v1806: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:37:16.724 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:37:16.724 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:37:16.724 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:37:16.724 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:37:16.724 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:37:18.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:37:18 smithi157 bash[24585]: cluster 2024-09-16T06:37:16.173384+0000 mgr.a (mgr.14373) 2607 : cluster [DBG] pgmap v1807: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:37:18.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:37:18 smithi157 bash[24585]: audit 2024-09-16T06:37:16.292838+0000 mgr.a (mgr.14373) 2608 : audit [DBG] from='client.68175 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:37:18.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:37:18 smithi086 bash[24289]: cluster 2024-09-16T06:37:16.173384+0000 mgr.a (mgr.14373) 2607 : cluster [DBG] pgmap v1807: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:37:18.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:37:18 smithi086 bash[24289]: audit 2024-09-16T06:37:16.292838+0000 mgr.a (mgr.14373) 2608 : audit [DBG] from='client.68175 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:37:18.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:37:18 smithi047 bash[22744]: cluster 2024-09-16T06:37:16.173384+0000 mgr.a (mgr.14373) 2607 : cluster [DBG] pgmap v1807: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:37:18.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:37:18 smithi047 bash[22744]: audit 2024-09-16T06:37:16.292838+0000 mgr.a (mgr.14373) 2608 : audit [DBG] from='client.68175 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:37:20.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:37:20 smithi157 bash[24585]: cluster 2024-09-16T06:37:18.176251+0000 mgr.a (mgr.14373) 2609 : cluster [DBG] pgmap v1808: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:37:20.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:37:20 smithi086 bash[24289]: cluster 2024-09-16T06:37:18.176251+0000 mgr.a (mgr.14373) 2609 : cluster [DBG] pgmap v1808: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:37:20.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:37:20 smithi047 bash[22744]: cluster 2024-09-16T06:37:18.176251+0000 mgr.a (mgr.14373) 2609 : cluster [DBG] pgmap v1808: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:37:21.725 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:37:21.726 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:37:21.726 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:37:22.466 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:37:22.466 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:37:22.466 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:37:22.466 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:37:22.466 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:37:22.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:37:22 smithi157 bash[24585]: cluster 2024-09-16T06:37:20.177065+0000 mgr.a (mgr.14373) 2610 : cluster [DBG] pgmap v1809: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T06:37:22.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:37:22 smithi086 bash[24289]: cluster 2024-09-16T06:37:20.177065+0000 mgr.a (mgr.14373) 2610 : cluster [DBG] pgmap v1809: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T06:37:22.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:37:22 smithi047 bash[22744]: cluster 2024-09-16T06:37:20.177065+0000 mgr.a (mgr.14373) 2610 : cluster [DBG] pgmap v1809: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T06:37:23.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:37:23 smithi157 bash[24585]: audit 2024-09-16T06:37:22.061090+0000 mgr.a (mgr.14373) 2611 : audit [DBG] from='client.68253 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:37:23.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:37:23 smithi157 bash[24585]: cluster 2024-09-16T06:37:22.185369+0000 mgr.a (mgr.14373) 2612 : cluster [DBG] pgmap v1810: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:37:23.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:37:23 smithi086 bash[24289]: audit 2024-09-16T06:37:22.061090+0000 mgr.a (mgr.14373) 2611 : audit [DBG] from='client.68253 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:37:23.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:37:23 smithi086 bash[24289]: cluster 2024-09-16T06:37:22.185369+0000 mgr.a (mgr.14373) 2612 : cluster [DBG] pgmap v1810: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:37:23.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:37:23 smithi047 bash[22744]: audit 2024-09-16T06:37:22.061090+0000 mgr.a (mgr.14373) 2611 : audit [DBG] from='client.68253 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:37:23.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:37:23 smithi047 bash[22744]: cluster 2024-09-16T06:37:22.185369+0000 mgr.a (mgr.14373) 2612 : cluster [DBG] pgmap v1810: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:37:25.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:37:25 smithi157 bash[24585]: cluster 2024-09-16T06:37:24.186256+0000 mgr.a (mgr.14373) 2613 : cluster [DBG] pgmap v1811: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:37:25.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:37:25 smithi086 bash[24289]: cluster 2024-09-16T06:37:24.186256+0000 mgr.a (mgr.14373) 2613 : cluster [DBG] pgmap v1811: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:37:25.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:37:25 smithi047 bash[22744]: cluster 2024-09-16T06:37:24.186256+0000 mgr.a (mgr.14373) 2613 : cluster [DBG] pgmap v1811: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:37:27.467 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:37:27.468 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:37:27.468 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:37:27.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:37:27 smithi157 bash[24585]: cluster 2024-09-16T06:37:26.187024+0000 mgr.a (mgr.14373) 2614 : cluster [DBG] pgmap v1812: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:37:27.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:37:27 smithi086 bash[24289]: cluster 2024-09-16T06:37:26.187024+0000 mgr.a (mgr.14373) 2614 : cluster [DBG] pgmap v1812: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:37:27.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:37:27 smithi047 bash[22744]: cluster 2024-09-16T06:37:26.187024+0000 mgr.a (mgr.14373) 2614 : cluster [DBG] pgmap v1812: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:37:28.248 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:37:28.248 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:37:28.248 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:37:28.248 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:37:28.249 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:37:28.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:37:28 smithi157 bash[24585]: audit 2024-09-16T06:37:27.806784+0000 mgr.a (mgr.14373) 2615 : audit [DBG] from='client.68325 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:37:28.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:37:28 smithi086 bash[24289]: audit 2024-09-16T06:37:27.806784+0000 mgr.a (mgr.14373) 2615 : audit [DBG] from='client.68325 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:37:28.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:37:28 smithi047 bash[22744]: audit 2024-09-16T06:37:27.806784+0000 mgr.a (mgr.14373) 2615 : audit [DBG] from='client.68325 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:37:29.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:37:29 smithi157 bash[24585]: cluster 2024-09-16T06:37:28.188385+0000 mgr.a (mgr.14373) 2616 : cluster [DBG] pgmap v1813: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:37:29.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:37:29 smithi086 bash[24289]: cluster 2024-09-16T06:37:28.188385+0000 mgr.a (mgr.14373) 2616 : cluster [DBG] pgmap v1813: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:37:29.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:37:29 smithi047 bash[22744]: cluster 2024-09-16T06:37:28.188385+0000 mgr.a (mgr.14373) 2616 : cluster [DBG] pgmap v1813: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:37:31.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:37:31 smithi157 bash[24585]: cluster 2024-09-16T06:37:30.189110+0000 mgr.a (mgr.14373) 2617 : cluster [DBG] pgmap v1814: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-16T06:37:31.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:37:31 smithi086 bash[24289]: cluster 2024-09-16T06:37:30.189110+0000 mgr.a (mgr.14373) 2617 : cluster [DBG] pgmap v1814: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-16T06:37:31.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:37:31 smithi047 bash[22744]: cluster 2024-09-16T06:37:30.189110+0000 mgr.a (mgr.14373) 2617 : cluster [DBG] pgmap v1814: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-16T06:37:33.250 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:37:33.250 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:37:33.250 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:37:33.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:37:33 smithi157 bash[24585]: cluster 2024-09-16T06:37:32.191112+0000 mgr.a (mgr.14373) 2618 : cluster [DBG] pgmap v1815: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-16T06:37:33.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:37:33 smithi086 bash[24289]: cluster 2024-09-16T06:37:32.191112+0000 mgr.a (mgr.14373) 2618 : cluster [DBG] pgmap v1815: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-16T06:37:33.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:37:33 smithi047 bash[22744]: cluster 2024-09-16T06:37:32.191112+0000 mgr.a (mgr.14373) 2618 : cluster [DBG] pgmap v1815: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-16T06:37:33.993 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:37:33.994 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:37:33.994 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:37:33.994 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:37:33.994 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:37:34.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:37:34 smithi157 bash[24585]: audit 2024-09-16T06:37:33.584097+0000 mgr.a (mgr.14373) 2619 : audit [DBG] from='client.68400 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:37:34.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:37:34 smithi086 bash[24289]: audit 2024-09-16T06:37:33.584097+0000 mgr.a (mgr.14373) 2619 : audit [DBG] from='client.68400 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:37:34.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:37:34 smithi047 bash[22744]: audit 2024-09-16T06:37:33.584097+0000 mgr.a (mgr.14373) 2619 : audit [DBG] from='client.68400 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:37:35.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:37:35 smithi157 bash[24585]: cluster 2024-09-16T06:37:34.191961+0000 mgr.a (mgr.14373) 2620 : cluster [DBG] pgmap v1816: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:37:35.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:37:35 smithi086 bash[24289]: cluster 2024-09-16T06:37:34.191961+0000 mgr.a (mgr.14373) 2620 : cluster [DBG] pgmap v1816: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:37:35.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:37:35 smithi047 bash[22744]: cluster 2024-09-16T06:37:34.191961+0000 mgr.a (mgr.14373) 2620 : cluster [DBG] pgmap v1816: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:37:37.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:37:37 smithi157 bash[24585]: cluster 2024-09-16T06:37:36.192670+0000 mgr.a (mgr.14373) 2621 : cluster [DBG] pgmap v1817: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:37:37.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:37:37 smithi086 bash[24289]: cluster 2024-09-16T06:37:36.192670+0000 mgr.a (mgr.14373) 2621 : cluster [DBG] pgmap v1817: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:37:37.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:37:37 smithi047 bash[22744]: cluster 2024-09-16T06:37:36.192670+0000 mgr.a (mgr.14373) 2621 : cluster [DBG] pgmap v1817: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:37:38.995 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:37:38.996 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:37:38.996 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:37:39.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:37:39 smithi157 bash[24585]: cluster 2024-09-16T06:37:38.194883+0000 mgr.a (mgr.14373) 2622 : cluster [DBG] pgmap v1818: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:37:39.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:37:39 smithi086 bash[24289]: cluster 2024-09-16T06:37:38.194883+0000 mgr.a (mgr.14373) 2622 : cluster [DBG] pgmap v1818: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:37:39.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:37:39 smithi047 bash[22744]: cluster 2024-09-16T06:37:38.194883+0000 mgr.a (mgr.14373) 2622 : cluster [DBG] pgmap v1818: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:37:39.737 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:37:39.738 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:37:39.738 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:37:39.738 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:37:39.738 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:37:40.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:37:40 smithi157 bash[24585]: audit 2024-09-16T06:37:39.327970+0000 mgr.a (mgr.14373) 2623 : audit [DBG] from='client.68478 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:37:40.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:37:40 smithi086 bash[24289]: audit 2024-09-16T06:37:39.327970+0000 mgr.a (mgr.14373) 2623 : audit [DBG] from='client.68478 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:37:40.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:37:40 smithi047 bash[22744]: audit 2024-09-16T06:37:39.327970+0000 mgr.a (mgr.14373) 2623 : audit [DBG] from='client.68478 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:37:41.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:37:41 smithi157 bash[24585]: cluster 2024-09-16T06:37:40.195831+0000 mgr.a (mgr.14373) 2624 : cluster [DBG] pgmap v1819: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:37:41.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:37:41 smithi086 bash[24289]: cluster 2024-09-16T06:37:40.195831+0000 mgr.a (mgr.14373) 2624 : cluster [DBG] pgmap v1819: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:37:41.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:37:41 smithi047 bash[22744]: cluster 2024-09-16T06:37:40.195831+0000 mgr.a (mgr.14373) 2624 : cluster [DBG] pgmap v1819: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:37:43.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:37:43 smithi157 bash[24585]: cluster 2024-09-16T06:37:42.198075+0000 mgr.a (mgr.14373) 2625 : cluster [DBG] pgmap v1820: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:37:43.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:37:43 smithi086 bash[24289]: cluster 2024-09-16T06:37:42.198075+0000 mgr.a (mgr.14373) 2625 : cluster [DBG] pgmap v1820: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:37:43.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:37:43 smithi047 bash[22744]: cluster 2024-09-16T06:37:42.198075+0000 mgr.a (mgr.14373) 2625 : cluster [DBG] pgmap v1820: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:37:44.739 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:37:44.740 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:37:44.740 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:37:45.516 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:37:45.517 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:37:45.517 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:37:45.517 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:37:45.517 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:37:45.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:37:45 smithi157 bash[24585]: cluster 2024-09-16T06:37:44.198864+0000 mgr.a (mgr.14373) 2626 : cluster [DBG] pgmap v1821: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:37:45.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:37:45 smithi157 bash[24585]: audit 2024-09-16T06:37:45.076644+0000 mgr.a (mgr.14373) 2627 : audit [DBG] from='client.68550 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:37:45.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:37:45 smithi086 bash[24289]: cluster 2024-09-16T06:37:44.198864+0000 mgr.a (mgr.14373) 2626 : cluster [DBG] pgmap v1821: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:37:45.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:37:45 smithi086 bash[24289]: audit 2024-09-16T06:37:45.076644+0000 mgr.a (mgr.14373) 2627 : audit [DBG] from='client.68550 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:37:45.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:37:45 smithi047 bash[22744]: cluster 2024-09-16T06:37:44.198864+0000 mgr.a (mgr.14373) 2626 : cluster [DBG] pgmap v1821: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:37:45.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:37:45 smithi047 bash[22744]: audit 2024-09-16T06:37:45.076644+0000 mgr.a (mgr.14373) 2627 : audit [DBG] from='client.68550 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:37:47.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:37:47 smithi086 bash[24289]: cluster 2024-09-16T06:37:46.199825+0000 mgr.a (mgr.14373) 2628 : cluster [DBG] pgmap v1822: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:37:47.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:37:47 smithi047 bash[22744]: cluster 2024-09-16T06:37:46.199825+0000 mgr.a (mgr.14373) 2628 : cluster [DBG] pgmap v1822: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:37:47.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:37:47 smithi157 bash[24585]: cluster 2024-09-16T06:37:46.199825+0000 mgr.a (mgr.14373) 2628 : cluster [DBG] pgmap v1822: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:37:49.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:37:49 smithi086 bash[24289]: cluster 2024-09-16T06:37:48.202041+0000 mgr.a (mgr.14373) 2629 : cluster [DBG] pgmap v1823: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:37:49.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:37:49 smithi047 bash[22744]: cluster 2024-09-16T06:37:48.202041+0000 mgr.a (mgr.14373) 2629 : cluster [DBG] pgmap v1823: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:37:49.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:37:49 smithi157 bash[24585]: cluster 2024-09-16T06:37:48.202041+0000 mgr.a (mgr.14373) 2629 : cluster [DBG] pgmap v1823: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:37:50.518 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:37:50.519 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:37:50.519 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:37:51.292 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:37:51.292 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:37:51.292 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:37:51.292 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:37:51.293 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:37:51.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:37:51 smithi086 bash[24289]: cluster 2024-09-16T06:37:50.202844+0000 mgr.a (mgr.14373) 2630 : cluster [DBG] pgmap v1824: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:37:51.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:37:51 smithi086 bash[24289]: audit 2024-09-16T06:37:50.857069+0000 mgr.a (mgr.14373) 2631 : audit [DBG] from='client.68625 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:37:51.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:37:51 smithi047 bash[22744]: cluster 2024-09-16T06:37:50.202844+0000 mgr.a (mgr.14373) 2630 : cluster [DBG] pgmap v1824: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:37:51.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:37:51 smithi047 bash[22744]: audit 2024-09-16T06:37:50.857069+0000 mgr.a (mgr.14373) 2631 : audit [DBG] from='client.68625 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:37:51.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:37:51 smithi157 bash[24585]: cluster 2024-09-16T06:37:50.202844+0000 mgr.a (mgr.14373) 2630 : cluster [DBG] pgmap v1824: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:37:51.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:37:51 smithi157 bash[24585]: audit 2024-09-16T06:37:50.857069+0000 mgr.a (mgr.14373) 2631 : audit [DBG] from='client.68625 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:37:53.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:37:53 smithi047 bash[22744]: cluster 2024-09-16T06:37:52.205261+0000 mgr.a (mgr.14373) 2632 : cluster [DBG] pgmap v1825: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:37:53.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:37:53 smithi157 bash[24585]: cluster 2024-09-16T06:37:52.205261+0000 mgr.a (mgr.14373) 2632 : cluster [DBG] pgmap v1825: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:37:53.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:37:53 smithi086 bash[24289]: cluster 2024-09-16T06:37:52.205261+0000 mgr.a (mgr.14373) 2632 : cluster [DBG] pgmap v1825: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:37:55.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:37:55 smithi047 bash[22744]: cluster 2024-09-16T06:37:54.206055+0000 mgr.a (mgr.14373) 2633 : cluster [DBG] pgmap v1826: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:37:55.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:37:55 smithi157 bash[24585]: cluster 2024-09-16T06:37:54.206055+0000 mgr.a (mgr.14373) 2633 : cluster [DBG] pgmap v1826: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:37:55.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:37:55 smithi086 bash[24289]: cluster 2024-09-16T06:37:54.206055+0000 mgr.a (mgr.14373) 2633 : cluster [DBG] pgmap v1826: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:37:56.293 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:37:56.294 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:37:56.294 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:37:57.063 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:37:57.063 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:37:57.063 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:37:57.063 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:37:57.063 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:37:57.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:37:57 smithi047 bash[22744]: cluster 2024-09-16T06:37:56.206839+0000 mgr.a (mgr.14373) 2634 : cluster [DBG] pgmap v1827: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:37:57.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:37:57 smithi047 bash[22744]: audit 2024-09-16T06:37:56.637551+0000 mgr.a (mgr.14373) 2635 : audit [DBG] from='client.68700 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:37:57.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:37:57 smithi157 bash[24585]: cluster 2024-09-16T06:37:56.206839+0000 mgr.a (mgr.14373) 2634 : cluster [DBG] pgmap v1827: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:37:57.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:37:57 smithi157 bash[24585]: audit 2024-09-16T06:37:56.637551+0000 mgr.a (mgr.14373) 2635 : audit [DBG] from='client.68700 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:37:57.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:37:57 smithi086 bash[24289]: cluster 2024-09-16T06:37:56.206839+0000 mgr.a (mgr.14373) 2634 : cluster [DBG] pgmap v1827: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:37:57.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:37:57 smithi086 bash[24289]: audit 2024-09-16T06:37:56.637551+0000 mgr.a (mgr.14373) 2635 : audit [DBG] from='client.68700 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:37:59.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:37:59 smithi047 bash[22744]: cluster 2024-09-16T06:37:58.209643+0000 mgr.a (mgr.14373) 2636 : cluster [DBG] pgmap v1828: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:37:59.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:37:59 smithi157 bash[24585]: cluster 2024-09-16T06:37:58.209643+0000 mgr.a (mgr.14373) 2636 : cluster [DBG] pgmap v1828: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:37:59.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:37:59 smithi086 bash[24289]: cluster 2024-09-16T06:37:58.209643+0000 mgr.a (mgr.14373) 2636 : cluster [DBG] pgmap v1828: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:38:01.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:38:01 smithi047 bash[22744]: cluster 2024-09-16T06:38:00.210448+0000 mgr.a (mgr.14373) 2637 : cluster [DBG] pgmap v1829: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:38:01.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:38:01 smithi157 bash[24585]: cluster 2024-09-16T06:38:00.210448+0000 mgr.a (mgr.14373) 2637 : cluster [DBG] pgmap v1829: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:38:01.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:38:01 smithi086 bash[24289]: cluster 2024-09-16T06:38:00.210448+0000 mgr.a (mgr.14373) 2637 : cluster [DBG] pgmap v1829: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:38:02.064 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:38:02.065 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:38:02.065 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:38:02.854 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:38:02.854 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:38:02.854 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:38:02.854 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:38:02.855 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:38:03.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:38:03 smithi157 bash[24585]: cluster 2024-09-16T06:38:02.211861+0000 mgr.a (mgr.14373) 2638 : cluster [DBG] pgmap v1830: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:38:03.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:38:03 smithi157 bash[24585]: audit 2024-09-16T06:38:02.400499+0000 mgr.a (mgr.14373) 2639 : audit [DBG] from='client.68778 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:38:03.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:38:03 smithi157 bash[24585]: audit 2024-09-16T06:38:02.688175+0000 mon.b (mon.2) 282 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T06:38:03.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:38:03 smithi086 bash[24289]: cluster 2024-09-16T06:38:02.211861+0000 mgr.a (mgr.14373) 2638 : cluster [DBG] pgmap v1830: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:38:03.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:38:03 smithi086 bash[24289]: audit 2024-09-16T06:38:02.400499+0000 mgr.a (mgr.14373) 2639 : audit [DBG] from='client.68778 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:38:03.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:38:03 smithi086 bash[24289]: audit 2024-09-16T06:38:02.688175+0000 mon.b (mon.2) 282 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T06:38:03.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:38:03 smithi047 bash[22744]: cluster 2024-09-16T06:38:02.211861+0000 mgr.a (mgr.14373) 2638 : cluster [DBG] pgmap v1830: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:38:03.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:38:03 smithi047 bash[22744]: audit 2024-09-16T06:38:02.400499+0000 mgr.a (mgr.14373) 2639 : audit [DBG] from='client.68778 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:38:03.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:38:03 smithi047 bash[22744]: audit 2024-09-16T06:38:02.688175+0000 mon.b (mon.2) 282 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T06:38:05.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:38:05 smithi157 bash[24585]: cluster 2024-09-16T06:38:04.212784+0000 mgr.a (mgr.14373) 2640 : cluster [DBG] pgmap v1831: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:38:05.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:38:05 smithi086 bash[24289]: cluster 2024-09-16T06:38:04.212784+0000 mgr.a (mgr.14373) 2640 : cluster [DBG] pgmap v1831: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:38:05.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:38:05 smithi047 bash[22744]: cluster 2024-09-16T06:38:04.212784+0000 mgr.a (mgr.14373) 2640 : cluster [DBG] pgmap v1831: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:38:07.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:38:07 smithi157 bash[24585]: cluster 2024-09-16T06:38:06.213576+0000 mgr.a (mgr.14373) 2641 : cluster [DBG] pgmap v1832: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T06:38:07.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:38:07 smithi086 bash[24289]: cluster 2024-09-16T06:38:06.213576+0000 mgr.a (mgr.14373) 2641 : cluster [DBG] pgmap v1832: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T06:38:07.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:38:07 smithi047 bash[22744]: cluster 2024-09-16T06:38:06.213576+0000 mgr.a (mgr.14373) 2641 : cluster [DBG] pgmap v1832: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T06:38:07.855 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:38:07.856 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:38:07.856 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:38:08.640 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:38:08.641 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:38:08.641 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:38:08.641 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:38:08.641 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:38:09.672 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:38:09 smithi157 bash[24585]: audit 2024-09-16T06:38:08.198291+0000 mgr.a (mgr.14373) 2642 : audit [DBG] from='client.68853 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:38:09.672 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:38:09 smithi157 bash[24585]: cluster 2024-09-16T06:38:08.217073+0000 mgr.a (mgr.14373) 2643 : cluster [DBG] pgmap v1833: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 22 KiB/s rd, 0 B/s wr, 35 op/s 2024-09-16T06:38:09.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:38:09 smithi086 bash[24289]: audit 2024-09-16T06:38:08.198291+0000 mgr.a (mgr.14373) 2642 : audit [DBG] from='client.68853 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:38:09.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:38:09 smithi086 bash[24289]: cluster 2024-09-16T06:38:08.217073+0000 mgr.a (mgr.14373) 2643 : cluster [DBG] pgmap v1833: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 22 KiB/s rd, 0 B/s wr, 35 op/s 2024-09-16T06:38:09.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:38:09 smithi047 bash[22744]: audit 2024-09-16T06:38:08.198291+0000 mgr.a (mgr.14373) 2642 : audit [DBG] from='client.68853 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:38:09.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:38:09 smithi047 bash[22744]: cluster 2024-09-16T06:38:08.217073+0000 mgr.a (mgr.14373) 2643 : cluster [DBG] pgmap v1833: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 22 KiB/s rd, 0 B/s wr, 35 op/s 2024-09-16T06:38:11.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:38:11 smithi157 bash[24585]: cluster 2024-09-16T06:38:10.218108+0000 mgr.a (mgr.14373) 2644 : cluster [DBG] pgmap v1834: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 22 KiB/s rd, 0 B/s wr, 35 op/s 2024-09-16T06:38:11.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:38:11 smithi086 bash[24289]: cluster 2024-09-16T06:38:10.218108+0000 mgr.a (mgr.14373) 2644 : cluster [DBG] pgmap v1834: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 22 KiB/s rd, 0 B/s wr, 35 op/s 2024-09-16T06:38:11.840 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:38:11 smithi047 bash[22744]: cluster 2024-09-16T06:38:10.218108+0000 mgr.a (mgr.14373) 2644 : cluster [DBG] pgmap v1834: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 22 KiB/s rd, 0 B/s wr, 35 op/s 2024-09-16T06:38:13.642 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:38:13.643 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:38:13.643 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:38:13.839 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 06:38:13 smithi047 bash[22994]: debug 2024-09-16T06:38:13.584+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T06:38:13.839 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 06:38:13 smithi047 bash[22994]: debug 2024-09-16T06:38:13.584+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T06:38:13.840 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:38:13 smithi047 bash[22744]: cluster 2024-09-16T06:38:12.220382+0000 mgr.a (mgr.14373) 2645 : cluster [DBG] pgmap v1835: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 86 KiB/s rd, 0 B/s wr, 141 op/s 2024-09-16T06:38:13.840 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:38:13 smithi047 bash[22744]: audit 2024-09-16T06:38:12.799977+0000 mon.a (mon.0) 724 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:38:13.840 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:38:13 smithi047 bash[22744]: audit 2024-09-16T06:38:12.811142+0000 mon.a (mon.0) 725 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:38:13.840 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:38:13 smithi047 bash[22744]: audit 2024-09-16T06:38:12.813939+0000 mon.b (mon.2) 283 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T06:38:13.840 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:38:13 smithi047 bash[22744]: audit 2024-09-16T06:38:12.816617+0000 mon.b (mon.2) 284 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T06:38:13.840 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:38:13 smithi047 bash[22744]: audit 2024-09-16T06:38:12.830394+0000 mon.a (mon.0) 726 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:38:13.840 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:38:13 smithi047 bash[22744]: audit 2024-09-16T06:38:12.834849+0000 mon.b (mon.2) 285 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:38:13.840 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:38:13 smithi047 bash[22744]: audit 2024-09-16T06:38:12.839146+0000 mgr.a (mgr.14373) 2646 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:38:14.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:38:13 smithi157 bash[24585]: cluster 2024-09-16T06:38:12.220382+0000 mgr.a (mgr.14373) 2645 : cluster [DBG] pgmap v1835: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 86 KiB/s rd, 0 B/s wr, 141 op/s 2024-09-16T06:38:14.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:38:13 smithi157 bash[24585]: audit 2024-09-16T06:38:12.799977+0000 mon.a (mon.0) 724 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:38:14.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:38:13 smithi157 bash[24585]: audit 2024-09-16T06:38:12.811142+0000 mon.a (mon.0) 725 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:38:14.055 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:38:13 smithi157 bash[24585]: audit 2024-09-16T06:38:12.813939+0000 mon.b (mon.2) 283 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T06:38:14.055 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:38:13 smithi157 bash[24585]: audit 2024-09-16T06:38:12.816617+0000 mon.b (mon.2) 284 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T06:38:14.055 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:38:13 smithi157 bash[24585]: audit 2024-09-16T06:38:12.830394+0000 mon.a (mon.0) 726 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:38:14.055 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:38:13 smithi157 bash[24585]: audit 2024-09-16T06:38:12.834849+0000 mon.b (mon.2) 285 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:38:14.055 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:38:13 smithi157 bash[24585]: audit 2024-09-16T06:38:12.839146+0000 mgr.a (mgr.14373) 2646 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:38:14.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:38:13 smithi086 bash[24289]: cluster 2024-09-16T06:38:12.220382+0000 mgr.a (mgr.14373) 2645 : cluster [DBG] pgmap v1835: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 86 KiB/s rd, 0 B/s wr, 141 op/s 2024-09-16T06:38:14.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:38:13 smithi086 bash[24289]: audit 2024-09-16T06:38:12.799977+0000 mon.a (mon.0) 724 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:38:14.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:38:13 smithi086 bash[24289]: audit 2024-09-16T06:38:12.811142+0000 mon.a (mon.0) 725 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:38:14.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:38:13 smithi086 bash[24289]: audit 2024-09-16T06:38:12.813939+0000 mon.b (mon.2) 283 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T06:38:14.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:38:13 smithi086 bash[24289]: audit 2024-09-16T06:38:12.816617+0000 mon.b (mon.2) 284 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T06:38:14.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:38:13 smithi086 bash[24289]: audit 2024-09-16T06:38:12.830394+0000 mon.a (mon.0) 726 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:38:14.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:38:13 smithi086 bash[24289]: audit 2024-09-16T06:38:12.834849+0000 mon.b (mon.2) 285 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:38:14.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:38:13 smithi086 bash[24289]: audit 2024-09-16T06:38:12.839146+0000 mgr.a (mgr.14373) 2646 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:38:14.384 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:38:14.384 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:38:14.384 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:38:14.384 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:38:14.384 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:38:15.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:38:14 smithi086 bash[24289]: audit 2024-09-16T06:38:13.587862+0000 mgr.a (mgr.14373) 2647 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T06:38:15.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:38:14 smithi086 bash[24289]: cephadm 2024-09-16T06:38:13.590174+0000 mgr.a (mgr.14373) 2648 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T06:38:15.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:38:14 smithi086 bash[24289]: audit 2024-09-16T06:38:13.965607+0000 mgr.a (mgr.14373) 2649 : audit [DBG] from='client.69030 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:38:15.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:38:14 smithi047 bash[22744]: audit 2024-09-16T06:38:13.587862+0000 mgr.a (mgr.14373) 2647 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T06:38:15.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:38:14 smithi047 bash[22744]: cephadm 2024-09-16T06:38:13.590174+0000 mgr.a (mgr.14373) 2648 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T06:38:15.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:38:14 smithi047 bash[22744]: audit 2024-09-16T06:38:13.965607+0000 mgr.a (mgr.14373) 2649 : audit [DBG] from='client.69030 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:38:15.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:38:14 smithi157 bash[24585]: audit 2024-09-16T06:38:13.587862+0000 mgr.a (mgr.14373) 2647 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T06:38:15.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:38:14 smithi157 bash[24585]: cephadm 2024-09-16T06:38:13.590174+0000 mgr.a (mgr.14373) 2648 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T06:38:15.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:38:14 smithi157 bash[24585]: audit 2024-09-16T06:38:13.965607+0000 mgr.a (mgr.14373) 2649 : audit [DBG] from='client.69030 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:38:16.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:38:15 smithi086 bash[24289]: cluster 2024-09-16T06:38:14.220940+0000 mgr.a (mgr.14373) 2650 : cluster [DBG] pgmap v1836: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 86 KiB/s rd, 0 B/s wr, 141 op/s 2024-09-16T06:38:16.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:38:15 smithi047 bash[22744]: cluster 2024-09-16T06:38:14.220940+0000 mgr.a (mgr.14373) 2650 : cluster [DBG] pgmap v1836: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 86 KiB/s rd, 0 B/s wr, 141 op/s 2024-09-16T06:38:16.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:38:15 smithi157 bash[24585]: cluster 2024-09-16T06:38:14.220940+0000 mgr.a (mgr.14373) 2650 : cluster [DBG] pgmap v1836: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 86 KiB/s rd, 0 B/s wr, 141 op/s 2024-09-16T06:38:18.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:38:18 smithi157 bash[24585]: cluster 2024-09-16T06:38:16.221823+0000 mgr.a (mgr.14373) 2651 : cluster [DBG] pgmap v1837: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 86 KiB/s rd, 0 B/s wr, 141 op/s 2024-09-16T06:38:18.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:38:18 smithi086 bash[24289]: cluster 2024-09-16T06:38:16.221823+0000 mgr.a (mgr.14373) 2651 : cluster [DBG] pgmap v1837: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 86 KiB/s rd, 0 B/s wr, 141 op/s 2024-09-16T06:38:18.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:38:18 smithi047 bash[22744]: cluster 2024-09-16T06:38:16.221823+0000 mgr.a (mgr.14373) 2651 : cluster [DBG] pgmap v1837: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 86 KiB/s rd, 0 B/s wr, 141 op/s 2024-09-16T06:38:19.385 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:38:19.386 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:38:19.386 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:38:20.165 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:38:20.165 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:38:20.166 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:38:20.166 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:38:20.166 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:38:20.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:38:20 smithi157 bash[24585]: cluster 2024-09-16T06:38:18.224046+0000 mgr.a (mgr.14373) 2652 : cluster [DBG] pgmap v1838: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 92 KiB/s rd, 426 B/s wr, 147 op/s 2024-09-16T06:38:20.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:38:20 smithi086 bash[24289]: cluster 2024-09-16T06:38:18.224046+0000 mgr.a (mgr.14373) 2652 : cluster [DBG] pgmap v1838: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 92 KiB/s rd, 426 B/s wr, 147 op/s 2024-09-16T06:38:20.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:38:20 smithi047 bash[22744]: cluster 2024-09-16T06:38:18.224046+0000 mgr.a (mgr.14373) 2652 : cluster [DBG] pgmap v1838: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 92 KiB/s rd, 426 B/s wr, 147 op/s 2024-09-16T06:38:21.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:38:21 smithi086 bash[24289]: audit 2024-09-16T06:38:19.721237+0000 mgr.a (mgr.14373) 2653 : audit [DBG] from='client.69108 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:38:21.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:38:21 smithi047 bash[22744]: audit 2024-09-16T06:38:19.721237+0000 mgr.a (mgr.14373) 2653 : audit [DBG] from='client.69108 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:38:21.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:38:21 smithi157 bash[24585]: audit 2024-09-16T06:38:19.721237+0000 mgr.a (mgr.14373) 2653 : audit [DBG] from='client.69108 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:38:22.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:38:22 smithi086 bash[24289]: cluster 2024-09-16T06:38:20.224726+0000 mgr.a (mgr.14373) 2654 : cluster [DBG] pgmap v1839: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 70 KiB/s rd, 426 B/s wr, 112 op/s 2024-09-16T06:38:22.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:38:22 smithi047 bash[22744]: cluster 2024-09-16T06:38:20.224726+0000 mgr.a (mgr.14373) 2654 : cluster [DBG] pgmap v1839: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 70 KiB/s rd, 426 B/s wr, 112 op/s 2024-09-16T06:38:22.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:38:22 smithi157 bash[24585]: cluster 2024-09-16T06:38:20.224726+0000 mgr.a (mgr.14373) 2654 : cluster [DBG] pgmap v1839: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 70 KiB/s rd, 426 B/s wr, 112 op/s 2024-09-16T06:38:24.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:38:24 smithi086 bash[24289]: cluster 2024-09-16T06:38:22.226984+0000 mgr.a (mgr.14373) 2655 : cluster [DBG] pgmap v1840: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 71 KiB/s rd, 426 B/s wr, 113 op/s 2024-09-16T06:38:24.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:38:24 smithi047 bash[22744]: cluster 2024-09-16T06:38:22.226984+0000 mgr.a (mgr.14373) 2655 : cluster [DBG] pgmap v1840: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 71 KiB/s rd, 426 B/s wr, 113 op/s 2024-09-16T06:38:24.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:38:24 smithi157 bash[24585]: cluster 2024-09-16T06:38:22.226984+0000 mgr.a (mgr.14373) 2655 : cluster [DBG] pgmap v1840: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 71 KiB/s rd, 426 B/s wr, 113 op/s 2024-09-16T06:38:25.166 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:38:25.167 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:38:25.167 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:38:25.914 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:38:25.914 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:38:25.914 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:38:25.914 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:38:25.914 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:38:26.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:38:26 smithi047 bash[22744]: cluster 2024-09-16T06:38:24.227760+0000 mgr.a (mgr.14373) 2656 : cluster [DBG] pgmap v1841: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:38:26.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:38:26 smithi157 bash[24585]: cluster 2024-09-16T06:38:24.227760+0000 mgr.a (mgr.14373) 2656 : cluster [DBG] pgmap v1841: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:38:26.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:38:26 smithi086 bash[24289]: cluster 2024-09-16T06:38:24.227760+0000 mgr.a (mgr.14373) 2656 : cluster [DBG] pgmap v1841: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:38:27.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:38:27 smithi047 bash[22744]: audit 2024-09-16T06:38:25.498751+0000 mgr.a (mgr.14373) 2657 : audit [DBG] from='client.69180 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:38:27.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:38:27 smithi157 bash[24585]: audit 2024-09-16T06:38:25.498751+0000 mgr.a (mgr.14373) 2657 : audit [DBG] from='client.69180 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:38:27.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:38:27 smithi086 bash[24289]: audit 2024-09-16T06:38:25.498751+0000 mgr.a (mgr.14373) 2657 : audit [DBG] from='client.69180 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:38:28.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:38:28 smithi047 bash[22744]: cluster 2024-09-16T06:38:26.228721+0000 mgr.a (mgr.14373) 2658 : cluster [DBG] pgmap v1842: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:38:28.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:38:28 smithi157 bash[24585]: cluster 2024-09-16T06:38:26.228721+0000 mgr.a (mgr.14373) 2658 : cluster [DBG] pgmap v1842: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:38:28.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:38:28 smithi086 bash[24289]: cluster 2024-09-16T06:38:26.228721+0000 mgr.a (mgr.14373) 2658 : cluster [DBG] pgmap v1842: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:38:30.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:38:30 smithi047 bash[22744]: cluster 2024-09-16T06:38:28.230966+0000 mgr.a (mgr.14373) 2659 : cluster [DBG] pgmap v1843: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:38:30.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:38:30 smithi157 bash[24585]: cluster 2024-09-16T06:38:28.230966+0000 mgr.a (mgr.14373) 2659 : cluster [DBG] pgmap v1843: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:38:30.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:38:30 smithi086 bash[24289]: cluster 2024-09-16T06:38:28.230966+0000 mgr.a (mgr.14373) 2659 : cluster [DBG] pgmap v1843: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:38:30.915 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:38:30.916 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:38:30.916 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:38:31.666 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:38:31.666 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:38:31.666 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:38:31.667 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:38:31.667 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:38:32.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:38:32 smithi047 bash[22744]: cluster 2024-09-16T06:38:30.231751+0000 mgr.a (mgr.14373) 2660 : cluster [DBG] pgmap v1844: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:38:32.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:38:32 smithi157 bash[24585]: cluster 2024-09-16T06:38:30.231751+0000 mgr.a (mgr.14373) 2660 : cluster [DBG] pgmap v1844: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:38:32.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:38:32 smithi086 bash[24289]: cluster 2024-09-16T06:38:30.231751+0000 mgr.a (mgr.14373) 2660 : cluster [DBG] pgmap v1844: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:38:33.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:38:33 smithi157 bash[24585]: audit 2024-09-16T06:38:31.255096+0000 mgr.a (mgr.14373) 2661 : audit [DBG] from='client.69258 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:38:33.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:38:33 smithi086 bash[24289]: audit 2024-09-16T06:38:31.255096+0000 mgr.a (mgr.14373) 2661 : audit [DBG] from='client.69258 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:38:33.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:38:33 smithi047 bash[22744]: audit 2024-09-16T06:38:31.255096+0000 mgr.a (mgr.14373) 2661 : audit [DBG] from='client.69258 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:38:34.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:38:34 smithi157 bash[24585]: cluster 2024-09-16T06:38:32.234540+0000 mgr.a (mgr.14373) 2662 : cluster [DBG] pgmap v1845: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-16T06:38:34.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:38:34 smithi086 bash[24289]: cluster 2024-09-16T06:38:32.234540+0000 mgr.a (mgr.14373) 2662 : cluster [DBG] pgmap v1845: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-16T06:38:34.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:38:34 smithi047 bash[22744]: cluster 2024-09-16T06:38:32.234540+0000 mgr.a (mgr.14373) 2662 : cluster [DBG] pgmap v1845: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-16T06:38:36.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:38:36 smithi157 bash[24585]: cluster 2024-09-16T06:38:34.235283+0000 mgr.a (mgr.14373) 2663 : cluster [DBG] pgmap v1846: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-16T06:38:36.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:38:36 smithi086 bash[24289]: cluster 2024-09-16T06:38:34.235283+0000 mgr.a (mgr.14373) 2663 : cluster [DBG] pgmap v1846: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-16T06:38:36.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:38:36 smithi047 bash[22744]: cluster 2024-09-16T06:38:34.235283+0000 mgr.a (mgr.14373) 2663 : cluster [DBG] pgmap v1846: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-16T06:38:36.667 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:38:36.669 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:38:36.669 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:38:37.436 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:38:37.437 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:38:37.437 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:38:37.437 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:38:37.437 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:38:38.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:38:38 smithi157 bash[24585]: cluster 2024-09-16T06:38:36.236054+0000 mgr.a (mgr.14373) 2664 : cluster [DBG] pgmap v1847: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-16T06:38:38.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:38:38 smithi157 bash[24585]: audit 2024-09-16T06:38:37.000884+0000 mgr.a (mgr.14373) 2665 : audit [DBG] from='client.69336 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:38:38.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:38:38 smithi086 bash[24289]: cluster 2024-09-16T06:38:36.236054+0000 mgr.a (mgr.14373) 2664 : cluster [DBG] pgmap v1847: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-16T06:38:38.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:38:38 smithi086 bash[24289]: audit 2024-09-16T06:38:37.000884+0000 mgr.a (mgr.14373) 2665 : audit [DBG] from='client.69336 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:38:38.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:38:38 smithi047 bash[22744]: cluster 2024-09-16T06:38:36.236054+0000 mgr.a (mgr.14373) 2664 : cluster [DBG] pgmap v1847: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-16T06:38:38.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:38:38 smithi047 bash[22744]: audit 2024-09-16T06:38:37.000884+0000 mgr.a (mgr.14373) 2665 : audit [DBG] from='client.69336 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:38:40.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:38:40 smithi157 bash[24585]: cluster 2024-09-16T06:38:38.238942+0000 mgr.a (mgr.14373) 2666 : cluster [DBG] pgmap v1848: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:38:40.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:38:40 smithi086 bash[24289]: cluster 2024-09-16T06:38:38.238942+0000 mgr.a (mgr.14373) 2666 : cluster [DBG] pgmap v1848: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:38:40.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:38:40 smithi047 bash[22744]: cluster 2024-09-16T06:38:38.238942+0000 mgr.a (mgr.14373) 2666 : cluster [DBG] pgmap v1848: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:38:42.438 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:38:42.438 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:38:42.439 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:38:42.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:38:42 smithi157 bash[24585]: cluster 2024-09-16T06:38:40.239896+0000 mgr.a (mgr.14373) 2667 : cluster [DBG] pgmap v1849: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:38:42.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:38:42 smithi086 bash[24289]: cluster 2024-09-16T06:38:40.239896+0000 mgr.a (mgr.14373) 2667 : cluster [DBG] pgmap v1849: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:38:42.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:38:42 smithi047 bash[22744]: cluster 2024-09-16T06:38:40.239896+0000 mgr.a (mgr.14373) 2667 : cluster [DBG] pgmap v1849: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:38:43.187 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:38:43.187 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:38:43.187 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:38:43.188 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:38:43.188 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:38:43.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:38:43 smithi157 bash[24585]: cluster 2024-09-16T06:38:42.242242+0000 mgr.a (mgr.14373) 2668 : cluster [DBG] pgmap v1850: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:38:43.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:38:43 smithi157 bash[24585]: audit 2024-09-16T06:38:42.773096+0000 mgr.a (mgr.14373) 2669 : audit [DBG] from='client.69408 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:38:43.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:38:43 smithi086 bash[24289]: cluster 2024-09-16T06:38:42.242242+0000 mgr.a (mgr.14373) 2668 : cluster [DBG] pgmap v1850: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:38:43.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:38:43 smithi086 bash[24289]: audit 2024-09-16T06:38:42.773096+0000 mgr.a (mgr.14373) 2669 : audit [DBG] from='client.69408 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:38:43.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:38:43 smithi047 bash[22744]: cluster 2024-09-16T06:38:42.242242+0000 mgr.a (mgr.14373) 2668 : cluster [DBG] pgmap v1850: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:38:43.590 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:38:43 smithi047 bash[22744]: audit 2024-09-16T06:38:42.773096+0000 mgr.a (mgr.14373) 2669 : audit [DBG] from='client.69408 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:38:45.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:38:45 smithi157 bash[24585]: cluster 2024-09-16T06:38:44.243249+0000 mgr.a (mgr.14373) 2670 : cluster [DBG] pgmap v1851: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-16T06:38:45.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:38:45 smithi086 bash[24289]: cluster 2024-09-16T06:38:44.243249+0000 mgr.a (mgr.14373) 2670 : cluster [DBG] pgmap v1851: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-16T06:38:45.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:38:45 smithi047 bash[22744]: cluster 2024-09-16T06:38:44.243249+0000 mgr.a (mgr.14373) 2670 : cluster [DBG] pgmap v1851: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-16T06:38:47.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:38:47 smithi157 bash[24585]: cluster 2024-09-16T06:38:46.244052+0000 mgr.a (mgr.14373) 2671 : cluster [DBG] pgmap v1852: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-16T06:38:47.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:38:47 smithi086 bash[24289]: cluster 2024-09-16T06:38:46.244052+0000 mgr.a (mgr.14373) 2671 : cluster [DBG] pgmap v1852: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-16T06:38:47.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:38:47 smithi047 bash[22744]: cluster 2024-09-16T06:38:46.244052+0000 mgr.a (mgr.14373) 2671 : cluster [DBG] pgmap v1852: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-16T06:38:48.189 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:38:48.189 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:38:48.190 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:38:48.964 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:38:48.964 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:38:48.965 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:38:48.965 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:38:48.965 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:38:49.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:38:49 smithi086 bash[24289]: cluster 2024-09-16T06:38:48.246272+0000 mgr.a (mgr.14373) 2672 : cluster [DBG] pgmap v1853: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-09-16T06:38:49.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:38:49 smithi086 bash[24289]: audit 2024-09-16T06:38:48.527132+0000 mgr.a (mgr.14373) 2673 : audit [DBG] from='client.69480 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:38:49.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:38:49 smithi047 bash[22744]: cluster 2024-09-16T06:38:48.246272+0000 mgr.a (mgr.14373) 2672 : cluster [DBG] pgmap v1853: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-09-16T06:38:49.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:38:49 smithi047 bash[22744]: audit 2024-09-16T06:38:48.527132+0000 mgr.a (mgr.14373) 2673 : audit [DBG] from='client.69480 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:38:49.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:38:49 smithi157 bash[24585]: cluster 2024-09-16T06:38:48.246272+0000 mgr.a (mgr.14373) 2672 : cluster [DBG] pgmap v1853: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-09-16T06:38:49.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:38:49 smithi157 bash[24585]: audit 2024-09-16T06:38:48.527132+0000 mgr.a (mgr.14373) 2673 : audit [DBG] from='client.69480 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:38:51.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:38:51 smithi086 bash[24289]: cluster 2024-09-16T06:38:50.247191+0000 mgr.a (mgr.14373) 2674 : cluster [DBG] pgmap v1854: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:38:51.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:38:51 smithi047 bash[22744]: cluster 2024-09-16T06:38:50.247191+0000 mgr.a (mgr.14373) 2674 : cluster [DBG] pgmap v1854: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:38:51.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:38:51 smithi157 bash[24585]: cluster 2024-09-16T06:38:50.247191+0000 mgr.a (mgr.14373) 2674 : cluster [DBG] pgmap v1854: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:38:53.965 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:38:53.966 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:38:53.966 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:38:54.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:38:54 smithi086 bash[24289]: cluster 2024-09-16T06:38:52.249442+0000 mgr.a (mgr.14373) 2675 : cluster [DBG] pgmap v1855: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:38:54.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:38:54 smithi047 bash[22744]: cluster 2024-09-16T06:38:52.249442+0000 mgr.a (mgr.14373) 2675 : cluster [DBG] pgmap v1855: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:38:54.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:38:54 smithi157 bash[24585]: cluster 2024-09-16T06:38:52.249442+0000 mgr.a (mgr.14373) 2675 : cluster [DBG] pgmap v1855: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:38:54.741 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:38:54.742 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:38:54.742 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:38:54.742 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:38:54.742 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:38:56.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:38:56 smithi086 bash[24289]: cluster 2024-09-16T06:38:54.250373+0000 mgr.a (mgr.14373) 2676 : cluster [DBG] pgmap v1856: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:38:56.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:38:56 smithi086 bash[24289]: audit 2024-09-16T06:38:54.307838+0000 mgr.a (mgr.14373) 2677 : audit [DBG] from='client.69558 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:38:56.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:38:56 smithi047 bash[22744]: cluster 2024-09-16T06:38:54.250373+0000 mgr.a (mgr.14373) 2676 : cluster [DBG] pgmap v1856: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:38:56.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:38:56 smithi047 bash[22744]: audit 2024-09-16T06:38:54.307838+0000 mgr.a (mgr.14373) 2677 : audit [DBG] from='client.69558 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:38:56.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:38:56 smithi157 bash[24585]: cluster 2024-09-16T06:38:54.250373+0000 mgr.a (mgr.14373) 2676 : cluster [DBG] pgmap v1856: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:38:56.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:38:56 smithi157 bash[24585]: audit 2024-09-16T06:38:54.307838+0000 mgr.a (mgr.14373) 2677 : audit [DBG] from='client.69558 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:38:58.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:38:58 smithi086 bash[24289]: cluster 2024-09-16T06:38:56.251319+0000 mgr.a (mgr.14373) 2678 : cluster [DBG] pgmap v1857: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:38:58.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:38:58 smithi047 bash[22744]: cluster 2024-09-16T06:38:56.251319+0000 mgr.a (mgr.14373) 2678 : cluster [DBG] pgmap v1857: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:38:58.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:38:58 smithi157 bash[24585]: cluster 2024-09-16T06:38:56.251319+0000 mgr.a (mgr.14373) 2678 : cluster [DBG] pgmap v1857: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:38:59.743 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:38:59.743 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:38:59.744 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:39:00.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:39:00 smithi047 bash[22744]: cluster 2024-09-16T06:38:58.253559+0000 mgr.a (mgr.14373) 2679 : cluster [DBG] pgmap v1858: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:39:00.508 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:39:00.509 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:39:00.509 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:39:00.509 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:39:00.509 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:39:00.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:39:00 smithi157 bash[24585]: cluster 2024-09-16T06:38:58.253559+0000 mgr.a (mgr.14373) 2679 : cluster [DBG] pgmap v1858: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:39:00.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:39:00 smithi086 bash[24289]: cluster 2024-09-16T06:38:58.253559+0000 mgr.a (mgr.14373) 2679 : cluster [DBG] pgmap v1858: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:39:01.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:39:01 smithi047 bash[22744]: audit 2024-09-16T06:39:00.083762+0000 mgr.a (mgr.14373) 2680 : audit [DBG] from='client.69636 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:39:01.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:39:01 smithi157 bash[24585]: audit 2024-09-16T06:39:00.083762+0000 mgr.a (mgr.14373) 2680 : audit [DBG] from='client.69636 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:39:01.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:39:01 smithi086 bash[24289]: audit 2024-09-16T06:39:00.083762+0000 mgr.a (mgr.14373) 2680 : audit [DBG] from='client.69636 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:39:02.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:39:02 smithi047 bash[22744]: cluster 2024-09-16T06:39:00.254126+0000 mgr.a (mgr.14373) 2681 : cluster [DBG] pgmap v1859: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:39:02.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:39:02 smithi157 bash[24585]: cluster 2024-09-16T06:39:00.254126+0000 mgr.a (mgr.14373) 2681 : cluster [DBG] pgmap v1859: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:39:02.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:39:02 smithi086 bash[24289]: cluster 2024-09-16T06:39:00.254126+0000 mgr.a (mgr.14373) 2681 : cluster [DBG] pgmap v1859: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:39:04.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:39:04 smithi047 bash[22744]: cluster 2024-09-16T06:39:02.256467+0000 mgr.a (mgr.14373) 2682 : cluster [DBG] pgmap v1860: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:39:04.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:39:04 smithi157 bash[24585]: cluster 2024-09-16T06:39:02.256467+0000 mgr.a (mgr.14373) 2682 : cluster [DBG] pgmap v1860: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:39:04.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:39:04 smithi086 bash[24289]: cluster 2024-09-16T06:39:02.256467+0000 mgr.a (mgr.14373) 2682 : cluster [DBG] pgmap v1860: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:39:05.510 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:39:05.511 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:39:05.511 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:39:06.260 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:39:06.260 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:39:06.260 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:39:06.261 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:39:06.261 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:39:06.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:39:06 smithi157 bash[24585]: cluster 2024-09-16T06:39:04.257243+0000 mgr.a (mgr.14373) 2683 : cluster [DBG] pgmap v1861: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:39:06.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:39:06 smithi086 bash[24289]: cluster 2024-09-16T06:39:04.257243+0000 mgr.a (mgr.14373) 2683 : cluster [DBG] pgmap v1861: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:39:06.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:39:06 smithi047 bash[22744]: cluster 2024-09-16T06:39:04.257243+0000 mgr.a (mgr.14373) 2683 : cluster [DBG] pgmap v1861: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:39:07.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:39:07 smithi157 bash[24585]: audit 2024-09-16T06:39:05.843522+0000 mgr.a (mgr.14373) 2684 : audit [DBG] from='client.69714 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:39:07.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:39:07 smithi086 bash[24289]: audit 2024-09-16T06:39:05.843522+0000 mgr.a (mgr.14373) 2684 : audit [DBG] from='client.69714 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:39:07.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:39:07 smithi047 bash[22744]: audit 2024-09-16T06:39:05.843522+0000 mgr.a (mgr.14373) 2684 : audit [DBG] from='client.69714 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:39:08.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:39:08 smithi157 bash[24585]: cluster 2024-09-16T06:39:06.257751+0000 mgr.a (mgr.14373) 2685 : cluster [DBG] pgmap v1862: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:39:08.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:39:08 smithi086 bash[24289]: cluster 2024-09-16T06:39:06.257751+0000 mgr.a (mgr.14373) 2685 : cluster [DBG] pgmap v1862: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:39:08.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:39:08 smithi047 bash[22744]: cluster 2024-09-16T06:39:06.257751+0000 mgr.a (mgr.14373) 2685 : cluster [DBG] pgmap v1862: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:39:10.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:39:10 smithi157 bash[24585]: cluster 2024-09-16T06:39:08.259936+0000 mgr.a (mgr.14373) 2686 : cluster [DBG] pgmap v1863: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:39:10.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:39:10 smithi086 bash[24289]: cluster 2024-09-16T06:39:08.259936+0000 mgr.a (mgr.14373) 2686 : cluster [DBG] pgmap v1863: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:39:10.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:39:10 smithi047 bash[22744]: cluster 2024-09-16T06:39:08.259936+0000 mgr.a (mgr.14373) 2686 : cluster [DBG] pgmap v1863: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:39:11.261 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:39:11.262 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:39:11.262 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:39:12.040 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:39:12.041 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:39:12.041 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:39:12.041 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:39:12.041 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:39:12.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:39:12 smithi157 bash[24585]: cluster 2024-09-16T06:39:10.260677+0000 mgr.a (mgr.14373) 2687 : cluster [DBG] pgmap v1864: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:39:12.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:39:12 smithi086 bash[24289]: cluster 2024-09-16T06:39:10.260677+0000 mgr.a (mgr.14373) 2687 : cluster [DBG] pgmap v1864: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:39:12.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:39:12 smithi047 bash[22744]: cluster 2024-09-16T06:39:10.260677+0000 mgr.a (mgr.14373) 2687 : cluster [DBG] pgmap v1864: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:39:13.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:39:13 smithi157 bash[24585]: audit 2024-09-16T06:39:11.601736+0000 mgr.a (mgr.14373) 2688 : audit [DBG] from='client.69792 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:39:13.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:39:13 smithi086 bash[24289]: audit 2024-09-16T06:39:11.601736+0000 mgr.a (mgr.14373) 2688 : audit [DBG] from='client.69792 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:39:13.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:39:13 smithi047 bash[22744]: audit 2024-09-16T06:39:11.601736+0000 mgr.a (mgr.14373) 2688 : audit [DBG] from='client.69792 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:39:14.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:39:14 smithi157 bash[24585]: cluster 2024-09-16T06:39:12.263385+0000 mgr.a (mgr.14373) 2689 : cluster [DBG] pgmap v1865: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:39:14.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:39:14 smithi157 bash[24585]: audit 2024-09-16T06:39:13.662757+0000 mon.b (mon.2) 286 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T06:39:14.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:39:14 smithi086 bash[24289]: cluster 2024-09-16T06:39:12.263385+0000 mgr.a (mgr.14373) 2689 : cluster [DBG] pgmap v1865: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:39:14.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:39:14 smithi086 bash[24289]: audit 2024-09-16T06:39:13.662757+0000 mon.b (mon.2) 286 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T06:39:14.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:39:14 smithi047 bash[22744]: cluster 2024-09-16T06:39:12.263385+0000 mgr.a (mgr.14373) 2689 : cluster [DBG] pgmap v1865: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:39:14.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:39:14 smithi047 bash[22744]: audit 2024-09-16T06:39:13.662757+0000 mon.b (mon.2) 286 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T06:39:16.089 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 06:39:15 smithi047 bash[22994]: debug 2024-09-16T06:39:15.778+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T06:39:16.089 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 06:39:15 smithi047 bash[22994]: debug 2024-09-16T06:39:15.778+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T06:39:16.090 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:39:16 smithi047 bash[22744]: cluster 2024-09-16T06:39:14.264141+0000 mgr.a (mgr.14373) 2690 : cluster [DBG] pgmap v1866: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:39:16.090 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:39:16 smithi047 bash[22744]: audit 2024-09-16T06:39:15.012754+0000 mon.a (mon.0) 727 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:39:16.090 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:39:16 smithi047 bash[22744]: audit 2024-09-16T06:39:15.019308+0000 mon.a (mon.0) 728 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:39:16.090 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:39:16 smithi047 bash[22744]: audit 2024-09-16T06:39:15.026631+0000 mon.a (mon.0) 729 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:39:16.090 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:39:16 smithi047 bash[22744]: audit 2024-09-16T06:39:15.033322+0000 mon.a (mon.0) 730 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:39:16.090 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:39:16 smithi047 bash[22744]: audit 2024-09-16T06:39:15.049072+0000 mon.a (mon.0) 731 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:39:16.090 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:39:16 smithi047 bash[22744]: audit 2024-09-16T06:39:15.057113+0000 mon.a (mon.0) 732 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:39:16.091 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:39:16 smithi047 bash[22744]: audit 2024-09-16T06:39:15.057550+0000 mon.b (mon.2) 287 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T06:39:16.091 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:39:16 smithi047 bash[22744]: audit 2024-09-16T06:39:15.058773+0000 mon.b (mon.2) 288 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T06:39:16.091 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:39:16 smithi047 bash[22744]: audit 2024-09-16T06:39:15.068698+0000 mon.a (mon.0) 733 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:39:16.091 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:39:16 smithi047 bash[22744]: audit 2024-09-16T06:39:15.070663+0000 mon.b (mon.2) 289 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:39:16.091 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:39:16 smithi047 bash[22744]: audit 2024-09-16T06:39:15.073782+0000 mgr.a (mgr.14373) 2691 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:39:16.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:39:16 smithi157 bash[24585]: cluster 2024-09-16T06:39:14.264141+0000 mgr.a (mgr.14373) 2690 : cluster [DBG] pgmap v1866: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:39:16.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:39:16 smithi157 bash[24585]: audit 2024-09-16T06:39:15.012754+0000 mon.a (mon.0) 727 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:39:16.305 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:39:16 smithi157 bash[24585]: audit 2024-09-16T06:39:15.019308+0000 mon.a (mon.0) 728 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:39:16.305 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:39:16 smithi157 bash[24585]: audit 2024-09-16T06:39:15.026631+0000 mon.a (mon.0) 729 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:39:16.305 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:39:16 smithi157 bash[24585]: audit 2024-09-16T06:39:15.033322+0000 mon.a (mon.0) 730 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:39:16.305 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:39:16 smithi157 bash[24585]: audit 2024-09-16T06:39:15.049072+0000 mon.a (mon.0) 731 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:39:16.305 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:39:16 smithi157 bash[24585]: audit 2024-09-16T06:39:15.057113+0000 mon.a (mon.0) 732 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:39:16.305 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:39:16 smithi157 bash[24585]: audit 2024-09-16T06:39:15.057550+0000 mon.b (mon.2) 287 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T06:39:16.305 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:39:16 smithi157 bash[24585]: audit 2024-09-16T06:39:15.058773+0000 mon.b (mon.2) 288 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T06:39:16.305 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:39:16 smithi157 bash[24585]: audit 2024-09-16T06:39:15.068698+0000 mon.a (mon.0) 733 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:39:16.305 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:39:16 smithi157 bash[24585]: audit 2024-09-16T06:39:15.070663+0000 mon.b (mon.2) 289 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:39:16.305 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:39:16 smithi157 bash[24585]: audit 2024-09-16T06:39:15.073782+0000 mgr.a (mgr.14373) 2691 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:39:16.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:39:16 smithi086 bash[24289]: cluster 2024-09-16T06:39:14.264141+0000 mgr.a (mgr.14373) 2690 : cluster [DBG] pgmap v1866: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:39:16.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:39:16 smithi086 bash[24289]: audit 2024-09-16T06:39:15.012754+0000 mon.a (mon.0) 727 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:39:16.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:39:16 smithi086 bash[24289]: audit 2024-09-16T06:39:15.019308+0000 mon.a (mon.0) 728 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:39:16.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:39:16 smithi086 bash[24289]: audit 2024-09-16T06:39:15.026631+0000 mon.a (mon.0) 729 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:39:16.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:39:16 smithi086 bash[24289]: audit 2024-09-16T06:39:15.033322+0000 mon.a (mon.0) 730 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:39:16.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:39:16 smithi086 bash[24289]: audit 2024-09-16T06:39:15.049072+0000 mon.a (mon.0) 731 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:39:16.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:39:16 smithi086 bash[24289]: audit 2024-09-16T06:39:15.057113+0000 mon.a (mon.0) 732 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:39:16.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:39:16 smithi086 bash[24289]: audit 2024-09-16T06:39:15.057550+0000 mon.b (mon.2) 287 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T06:39:16.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:39:16 smithi086 bash[24289]: audit 2024-09-16T06:39:15.058773+0000 mon.b (mon.2) 288 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T06:39:16.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:39:16 smithi086 bash[24289]: audit 2024-09-16T06:39:15.068698+0000 mon.a (mon.0) 733 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:39:16.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:39:16 smithi086 bash[24289]: audit 2024-09-16T06:39:15.070663+0000 mon.b (mon.2) 289 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:39:16.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:39:16 smithi086 bash[24289]: audit 2024-09-16T06:39:15.073782+0000 mgr.a (mgr.14373) 2691 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:39:17.042 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:39:17.042 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:39:17.043 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:39:17.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:39:17 smithi157 bash[24585]: audit 2024-09-16T06:39:15.784015+0000 mgr.a (mgr.14373) 2692 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T06:39:17.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:39:17 smithi157 bash[24585]: cephadm 2024-09-16T06:39:15.786136+0000 mgr.a (mgr.14373) 2693 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T06:39:17.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:39:17 smithi086 bash[24289]: audit 2024-09-16T06:39:15.784015+0000 mgr.a (mgr.14373) 2692 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T06:39:17.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:39:17 smithi086 bash[24289]: cephadm 2024-09-16T06:39:15.786136+0000 mgr.a (mgr.14373) 2693 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T06:39:17.340 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:39:17 smithi047 bash[22744]: audit 2024-09-16T06:39:15.784015+0000 mgr.a (mgr.14373) 2692 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T06:39:17.340 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:39:17 smithi047 bash[22744]: cephadm 2024-09-16T06:39:15.786136+0000 mgr.a (mgr.14373) 2693 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T06:39:17.800 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:39:17.801 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:39:17.801 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:39:17.801 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:39:17.801 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:39:18.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:39:18 smithi086 bash[24289]: cluster 2024-09-16T06:39:16.265070+0000 mgr.a (mgr.14373) 2694 : cluster [DBG] pgmap v1867: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T06:39:18.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:39:18 smithi047 bash[22744]: cluster 2024-09-16T06:39:16.265070+0000 mgr.a (mgr.14373) 2694 : cluster [DBG] pgmap v1867: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T06:39:18.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:39:18 smithi157 bash[24585]: cluster 2024-09-16T06:39:16.265070+0000 mgr.a (mgr.14373) 2694 : cluster [DBG] pgmap v1867: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T06:39:19.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:39:19 smithi047 bash[22744]: audit 2024-09-16T06:39:17.378913+0000 mgr.a (mgr.14373) 2695 : audit [DBG] from='client.69975 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:39:19.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:39:19 smithi157 bash[24585]: audit 2024-09-16T06:39:17.378913+0000 mgr.a (mgr.14373) 2695 : audit [DBG] from='client.69975 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:39:19.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:39:19 smithi086 bash[24289]: audit 2024-09-16T06:39:17.378913+0000 mgr.a (mgr.14373) 2695 : audit [DBG] from='client.69975 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:39:20.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:39:20 smithi047 bash[22744]: cluster 2024-09-16T06:39:18.267873+0000 mgr.a (mgr.14373) 2696 : cluster [DBG] pgmap v1868: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:39:20.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:39:20 smithi157 bash[24585]: cluster 2024-09-16T06:39:18.267873+0000 mgr.a (mgr.14373) 2696 : cluster [DBG] pgmap v1868: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:39:20.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:39:20 smithi086 bash[24289]: cluster 2024-09-16T06:39:18.267873+0000 mgr.a (mgr.14373) 2696 : cluster [DBG] pgmap v1868: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:39:22.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:39:22 smithi047 bash[22744]: cluster 2024-09-16T06:39:20.268647+0000 mgr.a (mgr.14373) 2697 : cluster [DBG] pgmap v1869: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T06:39:22.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:39:22 smithi157 bash[24585]: cluster 2024-09-16T06:39:20.268647+0000 mgr.a (mgr.14373) 2697 : cluster [DBG] pgmap v1869: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T06:39:22.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:39:22 smithi086 bash[24289]: cluster 2024-09-16T06:39:20.268647+0000 mgr.a (mgr.14373) 2697 : cluster [DBG] pgmap v1869: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T06:39:22.802 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:39:22.803 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:39:22.803 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:39:23.570 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:39:23.570 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:39:23.570 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:39:23.570 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:39:23.570 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:39:24.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:39:24 smithi047 bash[22744]: cluster 2024-09-16T06:39:22.270701+0000 mgr.a (mgr.14373) 2698 : cluster [DBG] pgmap v1870: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:39:24.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:39:24 smithi157 bash[24585]: cluster 2024-09-16T06:39:22.270701+0000 mgr.a (mgr.14373) 2698 : cluster [DBG] pgmap v1870: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:39:24.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:39:24 smithi086 bash[24289]: cluster 2024-09-16T06:39:22.270701+0000 mgr.a (mgr.14373) 2698 : cluster [DBG] pgmap v1870: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:39:25.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:39:25 smithi157 bash[24585]: audit 2024-09-16T06:39:23.141596+0000 mgr.a (mgr.14373) 2699 : audit [DBG] from='client.70050 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:39:25.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:39:25 smithi086 bash[24289]: audit 2024-09-16T06:39:23.141596+0000 mgr.a (mgr.14373) 2699 : audit [DBG] from='client.70050 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:39:25.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:39:25 smithi047 bash[22744]: audit 2024-09-16T06:39:23.141596+0000 mgr.a (mgr.14373) 2699 : audit [DBG] from='client.70050 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:39:26.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:39:26 smithi157 bash[24585]: cluster 2024-09-16T06:39:24.271663+0000 mgr.a (mgr.14373) 2700 : cluster [DBG] pgmap v1871: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:39:26.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:39:26 smithi086 bash[24289]: cluster 2024-09-16T06:39:24.271663+0000 mgr.a (mgr.14373) 2700 : cluster [DBG] pgmap v1871: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:39:26.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:39:26 smithi047 bash[22744]: cluster 2024-09-16T06:39:24.271663+0000 mgr.a (mgr.14373) 2700 : cluster [DBG] pgmap v1871: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:39:28.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:39:28 smithi157 bash[24585]: cluster 2024-09-16T06:39:26.272462+0000 mgr.a (mgr.14373) 2701 : cluster [DBG] pgmap v1872: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:39:28.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:39:28 smithi086 bash[24289]: cluster 2024-09-16T06:39:26.272462+0000 mgr.a (mgr.14373) 2701 : cluster [DBG] pgmap v1872: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:39:28.571 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:39:28.572 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:39:28.572 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:39:28.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:39:28 smithi047 bash[22744]: cluster 2024-09-16T06:39:26.272462+0000 mgr.a (mgr.14373) 2701 : cluster [DBG] pgmap v1872: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:39:29.340 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:39:29.341 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:39:29.341 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:39:29.341 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:39:29.341 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:39:30.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:39:30 smithi157 bash[24585]: cluster 2024-09-16T06:39:28.274786+0000 mgr.a (mgr.14373) 2702 : cluster [DBG] pgmap v1873: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:39:30.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:39:30 smithi157 bash[24585]: audit 2024-09-16T06:39:28.906062+0000 mgr.a (mgr.14373) 2703 : audit [DBG] from='client.70128 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:39:30.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:39:30 smithi086 bash[24289]: cluster 2024-09-16T06:39:28.274786+0000 mgr.a (mgr.14373) 2702 : cluster [DBG] pgmap v1873: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:39:30.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:39:30 smithi086 bash[24289]: audit 2024-09-16T06:39:28.906062+0000 mgr.a (mgr.14373) 2703 : audit [DBG] from='client.70128 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:39:30.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:39:30 smithi047 bash[22744]: cluster 2024-09-16T06:39:28.274786+0000 mgr.a (mgr.14373) 2702 : cluster [DBG] pgmap v1873: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:39:30.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:39:30 smithi047 bash[22744]: audit 2024-09-16T06:39:28.906062+0000 mgr.a (mgr.14373) 2703 : audit [DBG] from='client.70128 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:39:32.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:39:32 smithi157 bash[24585]: cluster 2024-09-16T06:39:30.275716+0000 mgr.a (mgr.14373) 2704 : cluster [DBG] pgmap v1874: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:39:32.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:39:32 smithi086 bash[24289]: cluster 2024-09-16T06:39:30.275716+0000 mgr.a (mgr.14373) 2704 : cluster [DBG] pgmap v1874: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:39:32.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:39:32 smithi047 bash[22744]: cluster 2024-09-16T06:39:30.275716+0000 mgr.a (mgr.14373) 2704 : cluster [DBG] pgmap v1874: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:39:34.342 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:39:34.343 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:39:34.343 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:39:34.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:39:34 smithi157 bash[24585]: cluster 2024-09-16T06:39:32.278096+0000 mgr.a (mgr.14373) 2705 : cluster [DBG] pgmap v1875: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:39:34.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:39:34 smithi086 bash[24289]: cluster 2024-09-16T06:39:32.278096+0000 mgr.a (mgr.14373) 2705 : cluster [DBG] pgmap v1875: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:39:34.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:39:34 smithi047 bash[22744]: cluster 2024-09-16T06:39:32.278096+0000 mgr.a (mgr.14373) 2705 : cluster [DBG] pgmap v1875: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:39:35.115 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:39:35.116 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:39:35.116 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:39:35.116 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:39:35.116 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:39:36.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:39:36 smithi157 bash[24585]: cluster 2024-09-16T06:39:34.278912+0000 mgr.a (mgr.14373) 2706 : cluster [DBG] pgmap v1876: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:39:36.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:39:36 smithi157 bash[24585]: audit 2024-09-16T06:39:34.678797+0000 mgr.a (mgr.14373) 2707 : audit [DBG] from='client.70206 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:39:36.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:39:36 smithi086 bash[24289]: cluster 2024-09-16T06:39:34.278912+0000 mgr.a (mgr.14373) 2706 : cluster [DBG] pgmap v1876: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:39:36.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:39:36 smithi086 bash[24289]: audit 2024-09-16T06:39:34.678797+0000 mgr.a (mgr.14373) 2707 : audit [DBG] from='client.70206 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:39:36.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:39:36 smithi047 bash[22744]: cluster 2024-09-16T06:39:34.278912+0000 mgr.a (mgr.14373) 2706 : cluster [DBG] pgmap v1876: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:39:36.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:39:36 smithi047 bash[22744]: audit 2024-09-16T06:39:34.678797+0000 mgr.a (mgr.14373) 2707 : audit [DBG] from='client.70206 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:39:38.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:39:38 smithi157 bash[24585]: cluster 2024-09-16T06:39:36.279914+0000 mgr.a (mgr.14373) 2708 : cluster [DBG] pgmap v1877: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:39:38.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:39:38 smithi086 bash[24289]: cluster 2024-09-16T06:39:36.279914+0000 mgr.a (mgr.14373) 2708 : cluster [DBG] pgmap v1877: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:39:38.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:39:38 smithi047 bash[22744]: cluster 2024-09-16T06:39:36.279914+0000 mgr.a (mgr.14373) 2708 : cluster [DBG] pgmap v1877: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:39:40.117 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:39:40.118 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:39:40.118 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:39:40.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:39:40 smithi157 bash[24585]: cluster 2024-09-16T06:39:38.282225+0000 mgr.a (mgr.14373) 2709 : cluster [DBG] pgmap v1878: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:39:40.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:39:40 smithi086 bash[24289]: cluster 2024-09-16T06:39:38.282225+0000 mgr.a (mgr.14373) 2709 : cluster [DBG] pgmap v1878: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:39:40.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:39:40 smithi047 bash[22744]: cluster 2024-09-16T06:39:38.282225+0000 mgr.a (mgr.14373) 2709 : cluster [DBG] pgmap v1878: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:39:40.901 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:39:40.901 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:39:40.901 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:39:40.901 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:39:40.901 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:39:42.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:39:42 smithi157 bash[24585]: cluster 2024-09-16T06:39:40.282768+0000 mgr.a (mgr.14373) 2710 : cluster [DBG] pgmap v1879: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:39:42.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:39:42 smithi157 bash[24585]: audit 2024-09-16T06:39:40.454551+0000 mgr.a (mgr.14373) 2711 : audit [DBG] from='client.70284 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:39:42.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:39:42 smithi086 bash[24289]: cluster 2024-09-16T06:39:40.282768+0000 mgr.a (mgr.14373) 2710 : cluster [DBG] pgmap v1879: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:39:42.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:39:42 smithi086 bash[24289]: audit 2024-09-16T06:39:40.454551+0000 mgr.a (mgr.14373) 2711 : audit [DBG] from='client.70284 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:39:42.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:39:42 smithi047 bash[22744]: cluster 2024-09-16T06:39:40.282768+0000 mgr.a (mgr.14373) 2710 : cluster [DBG] pgmap v1879: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:39:42.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:39:42 smithi047 bash[22744]: audit 2024-09-16T06:39:40.454551+0000 mgr.a (mgr.14373) 2711 : audit [DBG] from='client.70284 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:39:43.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:39:43 smithi157 bash[24585]: cluster 2024-09-16T06:39:42.285067+0000 mgr.a (mgr.14373) 2712 : cluster [DBG] pgmap v1880: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:39:43.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:39:43 smithi086 bash[24289]: cluster 2024-09-16T06:39:42.285067+0000 mgr.a (mgr.14373) 2712 : cluster [DBG] pgmap v1880: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:39:43.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:39:43 smithi047 bash[22744]: cluster 2024-09-16T06:39:42.285067+0000 mgr.a (mgr.14373) 2712 : cluster [DBG] pgmap v1880: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:39:45.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:39:45 smithi157 bash[24585]: cluster 2024-09-16T06:39:44.285838+0000 mgr.a (mgr.14373) 2713 : cluster [DBG] pgmap v1881: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:39:45.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:39:45 smithi086 bash[24289]: cluster 2024-09-16T06:39:44.285838+0000 mgr.a (mgr.14373) 2713 : cluster [DBG] pgmap v1881: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:39:45.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:39:45 smithi047 bash[22744]: cluster 2024-09-16T06:39:44.285838+0000 mgr.a (mgr.14373) 2713 : cluster [DBG] pgmap v1881: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:39:45.902 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:39:45.903 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:39:45.903 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:39:46.642 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:39:46.642 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:39:46.642 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:39:46.642 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:39:46.642 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:39:47.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:39:47 smithi157 bash[24585]: audit 2024-09-16T06:39:46.236426+0000 mgr.a (mgr.14373) 2714 : audit [DBG] from='client.70362 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:39:47.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:39:47 smithi157 bash[24585]: cluster 2024-09-16T06:39:46.286983+0000 mgr.a (mgr.14373) 2715 : cluster [DBG] pgmap v1882: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:39:47.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:39:47 smithi086 bash[24289]: audit 2024-09-16T06:39:46.236426+0000 mgr.a (mgr.14373) 2714 : audit [DBG] from='client.70362 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:39:47.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:39:47 smithi086 bash[24289]: cluster 2024-09-16T06:39:46.286983+0000 mgr.a (mgr.14373) 2715 : cluster [DBG] pgmap v1882: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:39:47.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:39:47 smithi047 bash[22744]: audit 2024-09-16T06:39:46.236426+0000 mgr.a (mgr.14373) 2714 : audit [DBG] from='client.70362 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:39:47.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:39:47 smithi047 bash[22744]: cluster 2024-09-16T06:39:46.286983+0000 mgr.a (mgr.14373) 2715 : cluster [DBG] pgmap v1882: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:39:49.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:39:49 smithi157 bash[24585]: cluster 2024-09-16T06:39:48.289441+0000 mgr.a (mgr.14373) 2716 : cluster [DBG] pgmap v1883: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-16T06:39:49.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:39:49 smithi086 bash[24289]: cluster 2024-09-16T06:39:48.289441+0000 mgr.a (mgr.14373) 2716 : cluster [DBG] pgmap v1883: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-16T06:39:49.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:39:49 smithi047 bash[22744]: cluster 2024-09-16T06:39:48.289441+0000 mgr.a (mgr.14373) 2716 : cluster [DBG] pgmap v1883: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-16T06:39:51.643 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:39:51.644 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:39:51.644 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:39:51.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:39:51 smithi157 bash[24585]: cluster 2024-09-16T06:39:50.290196+0000 mgr.a (mgr.14373) 2717 : cluster [DBG] pgmap v1884: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T06:39:51.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:39:51 smithi086 bash[24289]: cluster 2024-09-16T06:39:50.290196+0000 mgr.a (mgr.14373) 2717 : cluster [DBG] pgmap v1884: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T06:39:51.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:39:51 smithi047 bash[22744]: cluster 2024-09-16T06:39:50.290196+0000 mgr.a (mgr.14373) 2717 : cluster [DBG] pgmap v1884: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T06:39:52.422 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:39:52.422 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:39:52.422 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:39:52.422 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:39:52.423 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:39:52.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:39:52 smithi157 bash[24585]: audit 2024-09-16T06:39:51.986327+0000 mgr.a (mgr.14373) 2718 : audit [DBG] from='client.70437 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:39:52.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:39:52 smithi086 bash[24289]: audit 2024-09-16T06:39:51.986327+0000 mgr.a (mgr.14373) 2718 : audit [DBG] from='client.70437 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:39:52.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:39:52 smithi047 bash[22744]: audit 2024-09-16T06:39:51.986327+0000 mgr.a (mgr.14373) 2718 : audit [DBG] from='client.70437 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:39:53.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:39:53 smithi157 bash[24585]: cluster 2024-09-16T06:39:52.291423+0000 mgr.a (mgr.14373) 2719 : cluster [DBG] pgmap v1885: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:39:53.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:39:53 smithi086 bash[24289]: cluster 2024-09-16T06:39:52.291423+0000 mgr.a (mgr.14373) 2719 : cluster [DBG] pgmap v1885: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:39:53.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:39:53 smithi047 bash[22744]: cluster 2024-09-16T06:39:52.291423+0000 mgr.a (mgr.14373) 2719 : cluster [DBG] pgmap v1885: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:39:55.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:39:55 smithi157 bash[24585]: cluster 2024-09-16T06:39:54.292300+0000 mgr.a (mgr.14373) 2720 : cluster [DBG] pgmap v1886: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:39:55.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:39:55 smithi086 bash[24289]: cluster 2024-09-16T06:39:54.292300+0000 mgr.a (mgr.14373) 2720 : cluster [DBG] pgmap v1886: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:39:55.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:39:55 smithi047 bash[22744]: cluster 2024-09-16T06:39:54.292300+0000 mgr.a (mgr.14373) 2720 : cluster [DBG] pgmap v1886: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:39:57.423 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:39:57.424 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:39:57.424 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:39:57.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:39:57 smithi157 bash[24585]: cluster 2024-09-16T06:39:56.293089+0000 mgr.a (mgr.14373) 2721 : cluster [DBG] pgmap v1887: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T06:39:57.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:39:57 smithi086 bash[24289]: cluster 2024-09-16T06:39:56.293089+0000 mgr.a (mgr.14373) 2721 : cluster [DBG] pgmap v1887: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T06:39:57.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:39:57 smithi047 bash[22744]: cluster 2024-09-16T06:39:56.293089+0000 mgr.a (mgr.14373) 2721 : cluster [DBG] pgmap v1887: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T06:39:58.201 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:39:58.202 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:39:58.202 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:39:58.202 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:39:58.202 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:39:58.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:39:58 smithi157 bash[24585]: audit 2024-09-16T06:39:57.762792+0000 mgr.a (mgr.14373) 2722 : audit [DBG] from='client.70515 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:39:58.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:39:58 smithi086 bash[24289]: audit 2024-09-16T06:39:57.762792+0000 mgr.a (mgr.14373) 2722 : audit [DBG] from='client.70515 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:39:58.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:39:58 smithi047 bash[22744]: audit 2024-09-16T06:39:57.762792+0000 mgr.a (mgr.14373) 2722 : audit [DBG] from='client.70515 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:39:59.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:39:59 smithi157 bash[24585]: cluster 2024-09-16T06:39:58.295847+0000 mgr.a (mgr.14373) 2723 : cluster [DBG] pgmap v1888: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:39:59.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:39:59 smithi086 bash[24289]: cluster 2024-09-16T06:39:58.295847+0000 mgr.a (mgr.14373) 2723 : cluster [DBG] pgmap v1888: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:39:59.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:39:59 smithi047 bash[22744]: cluster 2024-09-16T06:39:58.295847+0000 mgr.a (mgr.14373) 2723 : cluster [DBG] pgmap v1888: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:40:00.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:40:00 smithi157 bash[24585]: cluster 2024-09-16T06:40:00.000148+0000 mon.a (mon.0) 734 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-16T06:40:00.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:40:00 smithi086 bash[24289]: cluster 2024-09-16T06:40:00.000148+0000 mon.a (mon.0) 734 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-16T06:40:00.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:40:00 smithi047 bash[22744]: cluster 2024-09-16T06:40:00.000148+0000 mon.a (mon.0) 734 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-16T06:40:01.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:40:01 smithi157 bash[24585]: cluster 2024-09-16T06:40:00.296653+0000 mgr.a (mgr.14373) 2724 : cluster [DBG] pgmap v1889: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-16T06:40:01.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:40:01 smithi086 bash[24289]: cluster 2024-09-16T06:40:00.296653+0000 mgr.a (mgr.14373) 2724 : cluster [DBG] pgmap v1889: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-16T06:40:01.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:40:01 smithi047 bash[22744]: cluster 2024-09-16T06:40:00.296653+0000 mgr.a (mgr.14373) 2724 : cluster [DBG] pgmap v1889: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-16T06:40:03.203 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:40:03.204 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:40:03.204 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:40:03.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:40:03 smithi157 bash[24585]: cluster 2024-09-16T06:40:02.298697+0000 mgr.a (mgr.14373) 2725 : cluster [DBG] pgmap v1890: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-16T06:40:03.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:40:03 smithi086 bash[24289]: cluster 2024-09-16T06:40:02.298697+0000 mgr.a (mgr.14373) 2725 : cluster [DBG] pgmap v1890: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-16T06:40:03.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:40:03 smithi047 bash[22744]: cluster 2024-09-16T06:40:02.298697+0000 mgr.a (mgr.14373) 2725 : cluster [DBG] pgmap v1890: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-16T06:40:03.971 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:40:03.971 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:40:03.971 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:40:03.971 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:40:03.971 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:40:04.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:40:04 smithi157 bash[24585]: audit 2024-09-16T06:40:03.540637+0000 mgr.a (mgr.14373) 2726 : audit [DBG] from='client.70590 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:40:04.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:40:04 smithi086 bash[24289]: audit 2024-09-16T06:40:03.540637+0000 mgr.a (mgr.14373) 2726 : audit [DBG] from='client.70590 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:40:04.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:40:04 smithi047 bash[22744]: audit 2024-09-16T06:40:03.540637+0000 mgr.a (mgr.14373) 2726 : audit [DBG] from='client.70590 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:40:05.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:40:05 smithi157 bash[24585]: cluster 2024-09-16T06:40:04.299630+0000 mgr.a (mgr.14373) 2727 : cluster [DBG] pgmap v1891: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:40:05.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:40:05 smithi086 bash[24289]: cluster 2024-09-16T06:40:04.299630+0000 mgr.a (mgr.14373) 2727 : cluster [DBG] pgmap v1891: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:40:05.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:40:05 smithi047 bash[22744]: cluster 2024-09-16T06:40:04.299630+0000 mgr.a (mgr.14373) 2727 : cluster [DBG] pgmap v1891: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:40:07.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:40:07 smithi157 bash[24585]: cluster 2024-09-16T06:40:06.300436+0000 mgr.a (mgr.14373) 2728 : cluster [DBG] pgmap v1892: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:40:07.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:40:07 smithi086 bash[24289]: cluster 2024-09-16T06:40:06.300436+0000 mgr.a (mgr.14373) 2728 : cluster [DBG] pgmap v1892: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:40:07.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:40:07 smithi047 bash[22744]: cluster 2024-09-16T06:40:06.300436+0000 mgr.a (mgr.14373) 2728 : cluster [DBG] pgmap v1892: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:40:08.973 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:40:09.146 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:40:09.147 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:40:09.726 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:40:09.727 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:40:09.727 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:40:09.727 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:40:09.727 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:40:09.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:40:09 smithi157 bash[24585]: cluster 2024-09-16T06:40:08.302675+0000 mgr.a (mgr.14373) 2729 : cluster [DBG] pgmap v1893: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:40:09.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:40:09 smithi086 bash[24289]: cluster 2024-09-16T06:40:08.302675+0000 mgr.a (mgr.14373) 2729 : cluster [DBG] pgmap v1893: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:40:09.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:40:09 smithi047 bash[22744]: cluster 2024-09-16T06:40:08.302675+0000 mgr.a (mgr.14373) 2729 : cluster [DBG] pgmap v1893: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:40:10.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:40:10 smithi157 bash[24585]: audit 2024-09-16T06:40:09.305340+0000 mgr.a (mgr.14373) 2730 : audit [DBG] from='client.70668 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:40:10.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:40:10 smithi086 bash[24289]: audit 2024-09-16T06:40:09.305340+0000 mgr.a (mgr.14373) 2730 : audit [DBG] from='client.70668 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:40:10.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:40:10 smithi047 bash[22744]: audit 2024-09-16T06:40:09.305340+0000 mgr.a (mgr.14373) 2730 : audit [DBG] from='client.70668 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:40:11.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:40:11 smithi157 bash[24585]: cluster 2024-09-16T06:40:10.303596+0000 mgr.a (mgr.14373) 2731 : cluster [DBG] pgmap v1894: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:40:11.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:40:11 smithi086 bash[24289]: cluster 2024-09-16T06:40:10.303596+0000 mgr.a (mgr.14373) 2731 : cluster [DBG] pgmap v1894: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:40:11.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:40:11 smithi047 bash[22744]: cluster 2024-09-16T06:40:10.303596+0000 mgr.a (mgr.14373) 2731 : cluster [DBG] pgmap v1894: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:40:13.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:40:13 smithi157 bash[24585]: cluster 2024-09-16T06:40:12.305849+0000 mgr.a (mgr.14373) 2732 : cluster [DBG] pgmap v1895: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:40:13.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:40:13 smithi086 bash[24289]: cluster 2024-09-16T06:40:12.305849+0000 mgr.a (mgr.14373) 2732 : cluster [DBG] pgmap v1895: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:40:13.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:40:13 smithi047 bash[22744]: cluster 2024-09-16T06:40:12.305849+0000 mgr.a (mgr.14373) 2732 : cluster [DBG] pgmap v1895: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:40:14.728 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:40:14.728 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:40:14.729 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:40:15.475 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:40:15.476 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:40:15.476 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:40:15.476 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:40:15.476 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:40:15.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:40:15 smithi157 bash[24585]: cluster 2024-09-16T06:40:14.306638+0000 mgr.a (mgr.14373) 2733 : cluster [DBG] pgmap v1896: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:40:15.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:40:15 smithi157 bash[24585]: audit 2024-09-16T06:40:15.055856+0000 mgr.a (mgr.14373) 2734 : audit [DBG] from='client.70746 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:40:15.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:40:15 smithi086 bash[24289]: cluster 2024-09-16T06:40:14.306638+0000 mgr.a (mgr.14373) 2733 : cluster [DBG] pgmap v1896: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:40:15.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:40:15 smithi086 bash[24289]: audit 2024-09-16T06:40:15.055856+0000 mgr.a (mgr.14373) 2734 : audit [DBG] from='client.70746 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:40:15.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:40:15 smithi047 bash[22744]: cluster 2024-09-16T06:40:14.306638+0000 mgr.a (mgr.14373) 2733 : cluster [DBG] pgmap v1896: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:40:15.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:40:15 smithi047 bash[22744]: audit 2024-09-16T06:40:15.055856+0000 mgr.a (mgr.14373) 2734 : audit [DBG] from='client.70746 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:40:16.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:40:16 smithi157 bash[24585]: audit 2024-09-16T06:40:15.841081+0000 mon.b (mon.2) 290 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T06:40:16.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:40:16 smithi086 bash[24289]: audit 2024-09-16T06:40:15.841081+0000 mon.b (mon.2) 290 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T06:40:16.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:40:16 smithi047 bash[22744]: audit 2024-09-16T06:40:15.841081+0000 mon.b (mon.2) 290 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T06:40:17.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:40:17 smithi157 bash[24585]: cluster 2024-09-16T06:40:16.307232+0000 mgr.a (mgr.14373) 2735 : cluster [DBG] pgmap v1897: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:40:17.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:40:17 smithi157 bash[24585]: audit 2024-09-16T06:40:16.684503+0000 mon.b (mon.2) 291 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T06:40:17.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:40:17 smithi157 bash[24585]: audit 2024-09-16T06:40:16.686821+0000 mon.b (mon.2) 292 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T06:40:17.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:40:17 smithi157 bash[24585]: audit 2024-09-16T06:40:16.698139+0000 mon.a (mon.0) 735 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:40:17.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:40:17 smithi157 bash[24585]: audit 2024-09-16T06:40:16.705218+0000 mon.b (mon.2) 293 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:40:17.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:40:17 smithi157 bash[24585]: audit 2024-09-16T06:40:16.709479+0000 mgr.a (mgr.14373) 2736 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:40:17.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:40:17 smithi086 bash[24289]: cluster 2024-09-16T06:40:16.307232+0000 mgr.a (mgr.14373) 2735 : cluster [DBG] pgmap v1897: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:40:17.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:40:17 smithi086 bash[24289]: audit 2024-09-16T06:40:16.684503+0000 mon.b (mon.2) 291 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T06:40:17.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:40:17 smithi086 bash[24289]: audit 2024-09-16T06:40:16.686821+0000 mon.b (mon.2) 292 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T06:40:17.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:40:17 smithi086 bash[24289]: audit 2024-09-16T06:40:16.698139+0000 mon.a (mon.0) 735 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:40:17.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:40:17 smithi086 bash[24289]: audit 2024-09-16T06:40:16.705218+0000 mon.b (mon.2) 293 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:40:17.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:40:17 smithi086 bash[24289]: audit 2024-09-16T06:40:16.709479+0000 mgr.a (mgr.14373) 2736 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:40:17.839 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 06:40:17 smithi047 bash[22994]: debug 2024-09-16T06:40:17.425+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T06:40:17.839 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 06:40:17 smithi047 bash[22994]: debug 2024-09-16T06:40:17.429+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T06:40:17.840 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:40:17 smithi047 bash[22744]: cluster 2024-09-16T06:40:16.307232+0000 mgr.a (mgr.14373) 2735 : cluster [DBG] pgmap v1897: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:40:17.840 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:40:17 smithi047 bash[22744]: audit 2024-09-16T06:40:16.684503+0000 mon.b (mon.2) 291 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T06:40:17.840 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:40:17 smithi047 bash[22744]: audit 2024-09-16T06:40:16.686821+0000 mon.b (mon.2) 292 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T06:40:17.840 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:40:17 smithi047 bash[22744]: audit 2024-09-16T06:40:16.698139+0000 mon.a (mon.0) 735 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:40:17.840 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:40:17 smithi047 bash[22744]: audit 2024-09-16T06:40:16.705218+0000 mon.b (mon.2) 293 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:40:17.840 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:40:17 smithi047 bash[22744]: audit 2024-09-16T06:40:16.709479+0000 mgr.a (mgr.14373) 2736 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:40:18.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:40:18 smithi157 bash[24585]: audit 2024-09-16T06:40:17.430301+0000 mgr.a (mgr.14373) 2737 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T06:40:18.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:40:18 smithi157 bash[24585]: cephadm 2024-09-16T06:40:17.432253+0000 mgr.a (mgr.14373) 2738 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T06:40:18.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:40:18 smithi086 bash[24289]: audit 2024-09-16T06:40:17.430301+0000 mgr.a (mgr.14373) 2737 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T06:40:18.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:40:18 smithi086 bash[24289]: cephadm 2024-09-16T06:40:17.432253+0000 mgr.a (mgr.14373) 2738 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T06:40:18.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:40:18 smithi047 bash[22744]: audit 2024-09-16T06:40:17.430301+0000 mgr.a (mgr.14373) 2737 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T06:40:18.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:40:18 smithi047 bash[22744]: cephadm 2024-09-16T06:40:17.432253+0000 mgr.a (mgr.14373) 2738 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T06:40:19.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:40:19 smithi157 bash[24585]: cluster 2024-09-16T06:40:18.309903+0000 mgr.a (mgr.14373) 2739 : cluster [DBG] pgmap v1898: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:40:19.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:40:19 smithi086 bash[24289]: cluster 2024-09-16T06:40:18.309903+0000 mgr.a (mgr.14373) 2739 : cluster [DBG] pgmap v1898: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:40:19.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:40:19 smithi047 bash[22744]: cluster 2024-09-16T06:40:18.309903+0000 mgr.a (mgr.14373) 2739 : cluster [DBG] pgmap v1898: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:40:20.477 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:40:20.477 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:40:20.478 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:40:21.250 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:40:21.250 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:40:21.250 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:40:21.250 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:40:21.250 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:40:21.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:40:21 smithi157 bash[24585]: cluster 2024-09-16T06:40:20.310700+0000 mgr.a (mgr.14373) 2740 : cluster [DBG] pgmap v1899: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:40:21.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:40:21 smithi157 bash[24585]: audit 2024-09-16T06:40:20.812588+0000 mgr.a (mgr.14373) 2741 : audit [DBG] from='client.70929 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:40:21.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:40:21 smithi086 bash[24289]: cluster 2024-09-16T06:40:20.310700+0000 mgr.a (mgr.14373) 2740 : cluster [DBG] pgmap v1899: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:40:21.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:40:21 smithi086 bash[24289]: audit 2024-09-16T06:40:20.812588+0000 mgr.a (mgr.14373) 2741 : audit [DBG] from='client.70929 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:40:21.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:40:21 smithi047 bash[22744]: cluster 2024-09-16T06:40:20.310700+0000 mgr.a (mgr.14373) 2740 : cluster [DBG] pgmap v1899: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:40:21.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:40:21 smithi047 bash[22744]: audit 2024-09-16T06:40:20.812588+0000 mgr.a (mgr.14373) 2741 : audit [DBG] from='client.70929 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:40:23.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:40:23 smithi157 bash[24585]: cluster 2024-09-16T06:40:22.313042+0000 mgr.a (mgr.14373) 2742 : cluster [DBG] pgmap v1900: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:40:23.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:40:23 smithi086 bash[24289]: cluster 2024-09-16T06:40:22.313042+0000 mgr.a (mgr.14373) 2742 : cluster [DBG] pgmap v1900: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:40:23.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:40:23 smithi047 bash[22744]: cluster 2024-09-16T06:40:22.313042+0000 mgr.a (mgr.14373) 2742 : cluster [DBG] pgmap v1900: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:40:25.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:40:25 smithi157 bash[24585]: cluster 2024-09-16T06:40:24.313852+0000 mgr.a (mgr.14373) 2743 : cluster [DBG] pgmap v1901: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:40:25.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:40:25 smithi086 bash[24289]: cluster 2024-09-16T06:40:24.313852+0000 mgr.a (mgr.14373) 2743 : cluster [DBG] pgmap v1901: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:40:25.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:40:25 smithi047 bash[22744]: cluster 2024-09-16T06:40:24.313852+0000 mgr.a (mgr.14373) 2743 : cluster [DBG] pgmap v1901: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:40:26.251 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:40:26.252 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:40:26.252 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:40:27.012 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:40:27.012 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:40:27.012 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:40:27.013 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:40:27.013 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:40:27.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:40:27 smithi157 bash[24585]: cluster 2024-09-16T06:40:26.314632+0000 mgr.a (mgr.14373) 2744 : cluster [DBG] pgmap v1902: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:40:27.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:40:27 smithi157 bash[24585]: audit 2024-09-16T06:40:26.586414+0000 mgr.a (mgr.14373) 2745 : audit [DBG] from='client.71004 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:40:27.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:40:27 smithi086 bash[24289]: cluster 2024-09-16T06:40:26.314632+0000 mgr.a (mgr.14373) 2744 : cluster [DBG] pgmap v1902: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:40:27.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:40:27 smithi086 bash[24289]: audit 2024-09-16T06:40:26.586414+0000 mgr.a (mgr.14373) 2745 : audit [DBG] from='client.71004 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:40:27.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:40:27 smithi047 bash[22744]: cluster 2024-09-16T06:40:26.314632+0000 mgr.a (mgr.14373) 2744 : cluster [DBG] pgmap v1902: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:40:27.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:40:27 smithi047 bash[22744]: audit 2024-09-16T06:40:26.586414+0000 mgr.a (mgr.14373) 2745 : audit [DBG] from='client.71004 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:40:29.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:40:29 smithi157 bash[24585]: cluster 2024-09-16T06:40:28.317334+0000 mgr.a (mgr.14373) 2746 : cluster [DBG] pgmap v1903: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:40:29.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:40:29 smithi086 bash[24289]: cluster 2024-09-16T06:40:28.317334+0000 mgr.a (mgr.14373) 2746 : cluster [DBG] pgmap v1903: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:40:29.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:40:29 smithi047 bash[22744]: cluster 2024-09-16T06:40:28.317334+0000 mgr.a (mgr.14373) 2746 : cluster [DBG] pgmap v1903: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:40:31.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:40:31 smithi157 bash[24585]: cluster 2024-09-16T06:40:30.318120+0000 mgr.a (mgr.14373) 2747 : cluster [DBG] pgmap v1904: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T06:40:31.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:40:31 smithi086 bash[24289]: cluster 2024-09-16T06:40:30.318120+0000 mgr.a (mgr.14373) 2747 : cluster [DBG] pgmap v1904: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T06:40:31.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:40:31 smithi047 bash[22744]: cluster 2024-09-16T06:40:30.318120+0000 mgr.a (mgr.14373) 2747 : cluster [DBG] pgmap v1904: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T06:40:32.012 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:40:32.013 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:40:32.013 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:40:32.771 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:40:32.771 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:40:32.771 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:40:32.772 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:40:32.772 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:40:33.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:40:33 smithi157 bash[24585]: cluster 2024-09-16T06:40:32.319305+0000 mgr.a (mgr.14373) 2748 : cluster [DBG] pgmap v1905: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:40:33.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:40:33 smithi157 bash[24585]: audit 2024-09-16T06:40:32.343632+0000 mgr.a (mgr.14373) 2749 : audit [DBG] from='client.71082 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:40:33.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:40:33 smithi086 bash[24289]: cluster 2024-09-16T06:40:32.319305+0000 mgr.a (mgr.14373) 2748 : cluster [DBG] pgmap v1905: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:40:33.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:40:33 smithi086 bash[24289]: audit 2024-09-16T06:40:32.343632+0000 mgr.a (mgr.14373) 2749 : audit [DBG] from='client.71082 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:40:33.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:40:33 smithi047 bash[22744]: cluster 2024-09-16T06:40:32.319305+0000 mgr.a (mgr.14373) 2748 : cluster [DBG] pgmap v1905: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:40:33.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:40:33 smithi047 bash[22744]: audit 2024-09-16T06:40:32.343632+0000 mgr.a (mgr.14373) 2749 : audit [DBG] from='client.71082 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:40:35.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:40:35 smithi157 bash[24585]: cluster 2024-09-16T06:40:34.320310+0000 mgr.a (mgr.14373) 2750 : cluster [DBG] pgmap v1906: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:40:35.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:40:35 smithi086 bash[24289]: cluster 2024-09-16T06:40:34.320310+0000 mgr.a (mgr.14373) 2750 : cluster [DBG] pgmap v1906: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:40:35.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:40:35 smithi047 bash[22744]: cluster 2024-09-16T06:40:34.320310+0000 mgr.a (mgr.14373) 2750 : cluster [DBG] pgmap v1906: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:40:37.773 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:40:37.774 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:40:37.774 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:40:37.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:40:37 smithi157 bash[24585]: cluster 2024-09-16T06:40:36.321248+0000 mgr.a (mgr.14373) 2751 : cluster [DBG] pgmap v1907: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T06:40:37.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:40:37 smithi086 bash[24289]: cluster 2024-09-16T06:40:36.321248+0000 mgr.a (mgr.14373) 2751 : cluster [DBG] pgmap v1907: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T06:40:37.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:40:37 smithi047 bash[22744]: cluster 2024-09-16T06:40:36.321248+0000 mgr.a (mgr.14373) 2751 : cluster [DBG] pgmap v1907: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T06:40:38.518 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:40:38.518 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:40:38.518 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:40:38.518 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:40:38.519 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:40:38.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:40:38 smithi157 bash[24585]: audit 2024-09-16T06:40:38.107295+0000 mgr.a (mgr.14373) 2752 : audit [DBG] from='client.71160 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:40:38.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:40:38 smithi086 bash[24289]: audit 2024-09-16T06:40:38.107295+0000 mgr.a (mgr.14373) 2752 : audit [DBG] from='client.71160 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:40:38.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:40:38 smithi047 bash[22744]: audit 2024-09-16T06:40:38.107295+0000 mgr.a (mgr.14373) 2752 : audit [DBG] from='client.71160 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:40:39.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:40:39 smithi157 bash[24585]: cluster 2024-09-16T06:40:38.330982+0000 mgr.a (mgr.14373) 2753 : cluster [DBG] pgmap v1908: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:40:39.890 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:40:39 smithi047 bash[22744]: cluster 2024-09-16T06:40:38.330982+0000 mgr.a (mgr.14373) 2753 : cluster [DBG] pgmap v1908: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:40:39.890 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:40:39 smithi086 bash[24289]: cluster 2024-09-16T06:40:38.330982+0000 mgr.a (mgr.14373) 2753 : cluster [DBG] pgmap v1908: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:40:41.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:40:41 smithi157 bash[24585]: cluster 2024-09-16T06:40:40.331898+0000 mgr.a (mgr.14373) 2754 : cluster [DBG] pgmap v1909: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:40:41.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:40:41 smithi086 bash[24289]: cluster 2024-09-16T06:40:40.331898+0000 mgr.a (mgr.14373) 2754 : cluster [DBG] pgmap v1909: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:40:41.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:40:41 smithi047 bash[22744]: cluster 2024-09-16T06:40:40.331898+0000 mgr.a (mgr.14373) 2754 : cluster [DBG] pgmap v1909: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:40:43.519 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:40:43.520 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:40:43.521 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:40:43.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:40:43 smithi157 bash[24585]: cluster 2024-09-16T06:40:42.334106+0000 mgr.a (mgr.14373) 2755 : cluster [DBG] pgmap v1910: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:40:43.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:40:43 smithi086 bash[24289]: cluster 2024-09-16T06:40:42.334106+0000 mgr.a (mgr.14373) 2755 : cluster [DBG] pgmap v1910: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:40:43.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:40:43 smithi047 bash[22744]: cluster 2024-09-16T06:40:42.334106+0000 mgr.a (mgr.14373) 2755 : cluster [DBG] pgmap v1910: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:40:44.283 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:40:44.283 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:40:44.283 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:40:44.283 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:40:44.283 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:40:44.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:40:44 smithi157 bash[24585]: audit 2024-09-16T06:40:43.857312+0000 mgr.a (mgr.14373) 2756 : audit [DBG] from='client.71235 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:40:44.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:40:44 smithi086 bash[24289]: audit 2024-09-16T06:40:43.857312+0000 mgr.a (mgr.14373) 2756 : audit [DBG] from='client.71235 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:40:44.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:40:44 smithi047 bash[22744]: audit 2024-09-16T06:40:43.857312+0000 mgr.a (mgr.14373) 2756 : audit [DBG] from='client.71235 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:40:45.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:40:45 smithi157 bash[24585]: cluster 2024-09-16T06:40:44.334901+0000 mgr.a (mgr.14373) 2757 : cluster [DBG] pgmap v1911: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:40:45.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:40:45 smithi086 bash[24289]: cluster 2024-09-16T06:40:44.334901+0000 mgr.a (mgr.14373) 2757 : cluster [DBG] pgmap v1911: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:40:45.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:40:45 smithi047 bash[22744]: cluster 2024-09-16T06:40:44.334901+0000 mgr.a (mgr.14373) 2757 : cluster [DBG] pgmap v1911: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:40:47.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:40:47 smithi157 bash[24585]: cluster 2024-09-16T06:40:46.335618+0000 mgr.a (mgr.14373) 2758 : cluster [DBG] pgmap v1912: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:40:47.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:40:47 smithi086 bash[24289]: cluster 2024-09-16T06:40:46.335618+0000 mgr.a (mgr.14373) 2758 : cluster [DBG] pgmap v1912: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:40:47.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:40:47 smithi047 bash[22744]: cluster 2024-09-16T06:40:46.335618+0000 mgr.a (mgr.14373) 2758 : cluster [DBG] pgmap v1912: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:40:49.284 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:40:49.285 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:40:49.285 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:40:49.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:40:49 smithi157 bash[24585]: cluster 2024-09-16T06:40:48.337813+0000 mgr.a (mgr.14373) 2759 : cluster [DBG] pgmap v1913: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:40:49.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:40:49 smithi086 bash[24289]: cluster 2024-09-16T06:40:48.337813+0000 mgr.a (mgr.14373) 2759 : cluster [DBG] pgmap v1913: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:40:49.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:40:49 smithi047 bash[22744]: cluster 2024-09-16T06:40:48.337813+0000 mgr.a (mgr.14373) 2759 : cluster [DBG] pgmap v1913: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:40:50.059 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:40:50.059 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:40:50.059 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:40:50.060 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:40:50.060 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:40:50.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:40:50 smithi157 bash[24585]: audit 2024-09-16T06:40:49.620418+0000 mgr.a (mgr.14373) 2760 : audit [DBG] from='client.71310 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:40:50.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:40:50 smithi086 bash[24289]: audit 2024-09-16T06:40:49.620418+0000 mgr.a (mgr.14373) 2760 : audit [DBG] from='client.71310 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:40:50.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:40:50 smithi047 bash[22744]: audit 2024-09-16T06:40:49.620418+0000 mgr.a (mgr.14373) 2760 : audit [DBG] from='client.71310 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:40:51.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:40:51 smithi157 bash[24585]: cluster 2024-09-16T06:40:50.338710+0000 mgr.a (mgr.14373) 2761 : cluster [DBG] pgmap v1914: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:40:51.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:40:51 smithi086 bash[24289]: cluster 2024-09-16T06:40:50.338710+0000 mgr.a (mgr.14373) 2761 : cluster [DBG] pgmap v1914: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:40:51.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:40:51 smithi047 bash[22744]: cluster 2024-09-16T06:40:50.338710+0000 mgr.a (mgr.14373) 2761 : cluster [DBG] pgmap v1914: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:40:53.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:40:53 smithi157 bash[24585]: cluster 2024-09-16T06:40:52.340930+0000 mgr.a (mgr.14373) 2762 : cluster [DBG] pgmap v1915: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:40:53.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:40:53 smithi086 bash[24289]: cluster 2024-09-16T06:40:52.340930+0000 mgr.a (mgr.14373) 2762 : cluster [DBG] pgmap v1915: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:40:53.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:40:53 smithi047 bash[22744]: cluster 2024-09-16T06:40:52.340930+0000 mgr.a (mgr.14373) 2762 : cluster [DBG] pgmap v1915: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:40:55.061 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:40:55.062 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:40:55.062 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:40:55.803 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:40:55.803 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:40:55.803 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:40:55.803 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:40:55.803 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:40:55.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:40:55 smithi157 bash[24585]: cluster 2024-09-16T06:40:54.341697+0000 mgr.a (mgr.14373) 2763 : cluster [DBG] pgmap v1916: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:40:55.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:40:55 smithi086 bash[24289]: cluster 2024-09-16T06:40:54.341697+0000 mgr.a (mgr.14373) 2763 : cluster [DBG] pgmap v1916: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:40:55.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:40:55 smithi047 bash[22744]: cluster 2024-09-16T06:40:54.341697+0000 mgr.a (mgr.14373) 2763 : cluster [DBG] pgmap v1916: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:40:56.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:40:56 smithi086 bash[24289]: audit 2024-09-16T06:40:55.393838+0000 mgr.a (mgr.14373) 2764 : audit [DBG] from='client.71385 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:40:56.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:40:56 smithi047 bash[22744]: audit 2024-09-16T06:40:55.393838+0000 mgr.a (mgr.14373) 2764 : audit [DBG] from='client.71385 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:40:57.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:40:56 smithi157 bash[24585]: audit 2024-09-16T06:40:55.393838+0000 mgr.a (mgr.14373) 2764 : audit [DBG] from='client.71385 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:40:57.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:40:57 smithi047 bash[22744]: cluster 2024-09-16T06:40:56.342612+0000 mgr.a (mgr.14373) 2765 : cluster [DBG] pgmap v1917: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:40:58.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:40:57 smithi157 bash[24585]: cluster 2024-09-16T06:40:56.342612+0000 mgr.a (mgr.14373) 2765 : cluster [DBG] pgmap v1917: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:40:58.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:40:57 smithi086 bash[24289]: cluster 2024-09-16T06:40:56.342612+0000 mgr.a (mgr.14373) 2765 : cluster [DBG] pgmap v1917: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:40:59.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:40:59 smithi086 bash[24289]: cluster 2024-09-16T06:40:58.344822+0000 mgr.a (mgr.14373) 2766 : cluster [DBG] pgmap v1918: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:40:59.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:40:59 smithi047 bash[22744]: cluster 2024-09-16T06:40:58.344822+0000 mgr.a (mgr.14373) 2766 : cluster [DBG] pgmap v1918: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:41:00.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:40:59 smithi157 bash[24585]: cluster 2024-09-16T06:40:58.344822+0000 mgr.a (mgr.14373) 2766 : cluster [DBG] pgmap v1918: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:41:00.805 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:41:00.805 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:41:00.805 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:41:01.588 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:41:01.588 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:41:01.588 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:41:01.588 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:41:01.588 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:41:01.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:41:01 smithi047 bash[22744]: cluster 2024-09-16T06:41:00.345588+0000 mgr.a (mgr.14373) 2767 : cluster [DBG] pgmap v1919: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:41:02.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:41:01 smithi157 bash[24585]: cluster 2024-09-16T06:41:00.345588+0000 mgr.a (mgr.14373) 2767 : cluster [DBG] pgmap v1919: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:41:02.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:41:01 smithi086 bash[24289]: cluster 2024-09-16T06:41:00.345588+0000 mgr.a (mgr.14373) 2767 : cluster [DBG] pgmap v1919: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:41:02.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:41:02 smithi047 bash[22744]: audit 2024-09-16T06:41:01.143130+0000 mgr.a (mgr.14373) 2768 : audit [DBG] from='client.71457 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:41:03.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:41:02 smithi157 bash[24585]: audit 2024-09-16T06:41:01.143130+0000 mgr.a (mgr.14373) 2768 : audit [DBG] from='client.71457 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:41:03.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:41:02 smithi086 bash[24289]: audit 2024-09-16T06:41:01.143130+0000 mgr.a (mgr.14373) 2768 : audit [DBG] from='client.71457 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:41:03.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:41:03 smithi047 bash[22744]: cluster 2024-09-16T06:41:02.347995+0000 mgr.a (mgr.14373) 2769 : cluster [DBG] pgmap v1920: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-16T06:41:04.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:41:03 smithi157 bash[24585]: cluster 2024-09-16T06:41:02.347995+0000 mgr.a (mgr.14373) 2769 : cluster [DBG] pgmap v1920: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-16T06:41:04.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:41:03 smithi086 bash[24289]: cluster 2024-09-16T06:41:02.347995+0000 mgr.a (mgr.14373) 2769 : cluster [DBG] pgmap v1920: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-16T06:41:05.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:41:05 smithi047 bash[22744]: cluster 2024-09-16T06:41:04.348788+0000 mgr.a (mgr.14373) 2770 : cluster [DBG] pgmap v1921: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-16T06:41:06.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:41:05 smithi157 bash[24585]: cluster 2024-09-16T06:41:04.348788+0000 mgr.a (mgr.14373) 2770 : cluster [DBG] pgmap v1921: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-16T06:41:06.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:41:05 smithi086 bash[24289]: cluster 2024-09-16T06:41:04.348788+0000 mgr.a (mgr.14373) 2770 : cluster [DBG] pgmap v1921: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-16T06:41:06.589 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:41:06.590 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:41:06.591 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:41:07.353 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:41:07.353 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:41:07.353 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:41:07.353 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:41:07.353 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:41:07.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:41:07 smithi047 bash[22744]: cluster 2024-09-16T06:41:06.349567+0000 mgr.a (mgr.14373) 2771 : cluster [DBG] pgmap v1922: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-16T06:41:07.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:41:07 smithi047 bash[22744]: audit 2024-09-16T06:41:06.923557+0000 mgr.a (mgr.14373) 2772 : audit [DBG] from='client.71532 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:41:08.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:41:07 smithi157 bash[24585]: cluster 2024-09-16T06:41:06.349567+0000 mgr.a (mgr.14373) 2771 : cluster [DBG] pgmap v1922: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-16T06:41:08.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:41:07 smithi157 bash[24585]: audit 2024-09-16T06:41:06.923557+0000 mgr.a (mgr.14373) 2772 : audit [DBG] from='client.71532 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:41:08.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:41:07 smithi086 bash[24289]: cluster 2024-09-16T06:41:06.349567+0000 mgr.a (mgr.14373) 2771 : cluster [DBG] pgmap v1922: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-16T06:41:08.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:41:07 smithi086 bash[24289]: audit 2024-09-16T06:41:06.923557+0000 mgr.a (mgr.14373) 2772 : audit [DBG] from='client.71532 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:41:10.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:41:09 smithi157 bash[24585]: cluster 2024-09-16T06:41:08.352274+0000 mgr.a (mgr.14373) 2773 : cluster [DBG] pgmap v1923: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:41:10.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:41:09 smithi086 bash[24289]: cluster 2024-09-16T06:41:08.352274+0000 mgr.a (mgr.14373) 2773 : cluster [DBG] pgmap v1923: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:41:10.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:41:09 smithi047 bash[22744]: cluster 2024-09-16T06:41:08.352274+0000 mgr.a (mgr.14373) 2773 : cluster [DBG] pgmap v1923: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:41:12.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:41:11 smithi157 bash[24585]: cluster 2024-09-16T06:41:10.353178+0000 mgr.a (mgr.14373) 2774 : cluster [DBG] pgmap v1924: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:41:12.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:41:11 smithi086 bash[24289]: cluster 2024-09-16T06:41:10.353178+0000 mgr.a (mgr.14373) 2774 : cluster [DBG] pgmap v1924: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:41:12.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:41:11 smithi047 bash[22744]: cluster 2024-09-16T06:41:10.353178+0000 mgr.a (mgr.14373) 2774 : cluster [DBG] pgmap v1924: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:41:12.354 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:41:12.355 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:41:12.355 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:41:13.113 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:41:13.114 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:41:13.114 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:41:13.114 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:41:13.114 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:41:14.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:41:13 smithi157 bash[24585]: cluster 2024-09-16T06:41:12.355353+0000 mgr.a (mgr.14373) 2775 : cluster [DBG] pgmap v1925: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:41:14.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:41:13 smithi157 bash[24585]: audit 2024-09-16T06:41:12.688275+0000 mgr.a (mgr.14373) 2776 : audit [DBG] from='client.71607 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:41:14.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:41:13 smithi086 bash[24289]: cluster 2024-09-16T06:41:12.355353+0000 mgr.a (mgr.14373) 2775 : cluster [DBG] pgmap v1925: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:41:14.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:41:13 smithi086 bash[24289]: audit 2024-09-16T06:41:12.688275+0000 mgr.a (mgr.14373) 2776 : audit [DBG] from='client.71607 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:41:14.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:41:13 smithi047 bash[22744]: cluster 2024-09-16T06:41:12.355353+0000 mgr.a (mgr.14373) 2775 : cluster [DBG] pgmap v1925: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:41:14.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:41:13 smithi047 bash[22744]: audit 2024-09-16T06:41:12.688275+0000 mgr.a (mgr.14373) 2776 : audit [DBG] from='client.71607 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:41:16.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:41:15 smithi157 bash[24585]: cluster 2024-09-16T06:41:14.356268+0000 mgr.a (mgr.14373) 2777 : cluster [DBG] pgmap v1926: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T06:41:16.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:41:15 smithi086 bash[24289]: cluster 2024-09-16T06:41:14.356268+0000 mgr.a (mgr.14373) 2777 : cluster [DBG] pgmap v1926: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T06:41:16.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:41:15 smithi047 bash[22744]: cluster 2024-09-16T06:41:14.356268+0000 mgr.a (mgr.14373) 2777 : cluster [DBG] pgmap v1926: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T06:41:18.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:41:17 smithi157 bash[24585]: cluster 2024-09-16T06:41:16.357033+0000 mgr.a (mgr.14373) 2778 : cluster [DBG] pgmap v1927: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T06:41:18.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:41:17 smithi157 bash[24585]: audit 2024-09-16T06:41:17.489293+0000 mon.b (mon.2) 294 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T06:41:18.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:41:17 smithi086 bash[24289]: cluster 2024-09-16T06:41:16.357033+0000 mgr.a (mgr.14373) 2778 : cluster [DBG] pgmap v1927: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T06:41:18.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:41:17 smithi086 bash[24289]: audit 2024-09-16T06:41:17.489293+0000 mon.b (mon.2) 294 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T06:41:18.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:41:17 smithi047 bash[22744]: cluster 2024-09-16T06:41:16.357033+0000 mgr.a (mgr.14373) 2778 : cluster [DBG] pgmap v1927: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T06:41:18.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:41:17 smithi047 bash[22744]: audit 2024-09-16T06:41:17.489293+0000 mon.b (mon.2) 294 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T06:41:18.115 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:41:18.115 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:41:18.115 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:41:18.848 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:41:18.848 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:41:18.848 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:41:18.848 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:41:18.849 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:41:20.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:41:19 smithi157 bash[24585]: cluster 2024-09-16T06:41:18.359148+0000 mgr.a (mgr.14373) 2779 : cluster [DBG] pgmap v1928: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-16T06:41:20.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:41:19 smithi157 bash[24585]: audit 2024-09-16T06:41:18.429184+0000 mgr.a (mgr.14373) 2780 : audit [DBG] from='client.71682 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:41:20.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:41:19 smithi086 bash[24289]: cluster 2024-09-16T06:41:18.359148+0000 mgr.a (mgr.14373) 2779 : cluster [DBG] pgmap v1928: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-16T06:41:20.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:41:19 smithi086 bash[24289]: audit 2024-09-16T06:41:18.429184+0000 mgr.a (mgr.14373) 2780 : audit [DBG] from='client.71682 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:41:20.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:41:19 smithi047 bash[22744]: cluster 2024-09-16T06:41:18.359148+0000 mgr.a (mgr.14373) 2779 : cluster [DBG] pgmap v1928: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-16T06:41:20.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:41:19 smithi047 bash[22744]: audit 2024-09-16T06:41:18.429184+0000 mgr.a (mgr.14373) 2780 : audit [DBG] from='client.71682 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:41:22.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:41:21 smithi157 bash[24585]: cluster 2024-09-16T06:41:20.360099+0000 mgr.a (mgr.14373) 2781 : cluster [DBG] pgmap v1929: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:41:22.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:41:21 smithi086 bash[24289]: cluster 2024-09-16T06:41:20.360099+0000 mgr.a (mgr.14373) 2781 : cluster [DBG] pgmap v1929: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:41:22.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:41:21 smithi047 bash[22744]: cluster 2024-09-16T06:41:20.360099+0000 mgr.a (mgr.14373) 2781 : cluster [DBG] pgmap v1929: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:41:23.849 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:41:23.850 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:41:23.850 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:41:24.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:41:23 smithi047 bash[22744]: cluster 2024-09-16T06:41:22.362391+0000 mgr.a (mgr.14373) 2782 : cluster [DBG] pgmap v1930: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:41:24.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:41:23 smithi047 bash[22744]: audit 2024-09-16T06:41:22.834702+0000 mon.a (mon.0) 736 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:41:24.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:41:23 smithi047 bash[22744]: audit 2024-09-16T06:41:22.846630+0000 mon.a (mon.0) 737 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:41:24.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:41:23 smithi047 bash[22744]: audit 2024-09-16T06:41:22.872619+0000 mon.a (mon.0) 738 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:41:24.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:41:23 smithi047 bash[22744]: audit 2024-09-16T06:41:22.879995+0000 mon.a (mon.0) 739 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:41:24.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:41:23 smithi047 bash[22744]: audit 2024-09-16T06:41:22.885376+0000 mon.a (mon.0) 740 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:41:24.090 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:41:23 smithi047 bash[22744]: audit 2024-09-16T06:41:22.892326+0000 mon.a (mon.0) 741 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:41:24.090 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:41:23 smithi047 bash[22744]: audit 2024-09-16T06:41:23.620412+0000 mon.b (mon.2) 295 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T06:41:24.090 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:41:23 smithi047 bash[22744]: audit 2024-09-16T06:41:23.622734+0000 mon.b (mon.2) 296 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T06:41:24.090 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:41:23 smithi047 bash[22744]: audit 2024-09-16T06:41:23.636216+0000 mon.a (mon.0) 742 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:41:24.090 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:41:23 smithi047 bash[22744]: audit 2024-09-16T06:41:23.640613+0000 mon.b (mon.2) 297 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:41:24.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:41:23 smithi157 bash[24585]: cluster 2024-09-16T06:41:22.362391+0000 mgr.a (mgr.14373) 2782 : cluster [DBG] pgmap v1930: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:41:24.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:41:23 smithi157 bash[24585]: audit 2024-09-16T06:41:22.834702+0000 mon.a (mon.0) 736 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:41:24.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:41:23 smithi157 bash[24585]: audit 2024-09-16T06:41:22.846630+0000 mon.a (mon.0) 737 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:41:24.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:41:23 smithi157 bash[24585]: audit 2024-09-16T06:41:22.872619+0000 mon.a (mon.0) 738 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:41:24.305 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:41:23 smithi157 bash[24585]: audit 2024-09-16T06:41:22.879995+0000 mon.a (mon.0) 739 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:41:24.305 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:41:23 smithi157 bash[24585]: audit 2024-09-16T06:41:22.885376+0000 mon.a (mon.0) 740 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:41:24.305 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:41:23 smithi157 bash[24585]: audit 2024-09-16T06:41:22.892326+0000 mon.a (mon.0) 741 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:41:24.305 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:41:23 smithi157 bash[24585]: audit 2024-09-16T06:41:23.620412+0000 mon.b (mon.2) 295 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T06:41:24.305 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:41:23 smithi157 bash[24585]: audit 2024-09-16T06:41:23.622734+0000 mon.b (mon.2) 296 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T06:41:24.305 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:41:23 smithi157 bash[24585]: audit 2024-09-16T06:41:23.636216+0000 mon.a (mon.0) 742 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:41:24.305 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:41:23 smithi157 bash[24585]: audit 2024-09-16T06:41:23.640613+0000 mon.b (mon.2) 297 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:41:24.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:41:23 smithi086 bash[24289]: cluster 2024-09-16T06:41:22.362391+0000 mgr.a (mgr.14373) 2782 : cluster [DBG] pgmap v1930: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:41:24.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:41:23 smithi086 bash[24289]: audit 2024-09-16T06:41:22.834702+0000 mon.a (mon.0) 736 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:41:24.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:41:23 smithi086 bash[24289]: audit 2024-09-16T06:41:22.846630+0000 mon.a (mon.0) 737 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:41:24.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:41:23 smithi086 bash[24289]: audit 2024-09-16T06:41:22.872619+0000 mon.a (mon.0) 738 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:41:24.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:41:23 smithi086 bash[24289]: audit 2024-09-16T06:41:22.879995+0000 mon.a (mon.0) 739 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:41:24.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:41:23 smithi086 bash[24289]: audit 2024-09-16T06:41:22.885376+0000 mon.a (mon.0) 740 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:41:24.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:41:23 smithi086 bash[24289]: audit 2024-09-16T06:41:22.892326+0000 mon.a (mon.0) 741 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:41:24.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:41:23 smithi086 bash[24289]: audit 2024-09-16T06:41:23.620412+0000 mon.b (mon.2) 295 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T06:41:24.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:41:23 smithi086 bash[24289]: audit 2024-09-16T06:41:23.622734+0000 mon.b (mon.2) 296 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T06:41:24.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:41:23 smithi086 bash[24289]: audit 2024-09-16T06:41:23.636216+0000 mon.a (mon.0) 742 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:41:24.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:41:23 smithi086 bash[24289]: audit 2024-09-16T06:41:23.640613+0000 mon.b (mon.2) 297 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:41:24.809 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:41:24.809 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:41:24.809 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:41:24.809 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:41:24.809 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:41:24.839 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 06:41:24 smithi047 bash[22994]: debug 2024-09-16T06:41:24.400+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T06:41:24.839 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 06:41:24 smithi047 bash[22994]: debug 2024-09-16T06:41:24.416+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T06:41:25.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:41:24 smithi157 bash[24585]: audit 2024-09-16T06:41:23.645107+0000 mgr.a (mgr.14373) 2783 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:41:25.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:41:24 smithi086 bash[24289]: audit 2024-09-16T06:41:23.645107+0000 mgr.a (mgr.14373) 2783 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:41:25.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:41:24 smithi047 bash[22744]: audit 2024-09-16T06:41:23.645107+0000 mgr.a (mgr.14373) 2783 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:41:26.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:41:25 smithi157 bash[24585]: audit 2024-09-16T06:41:24.195852+0000 mgr.a (mgr.14373) 2784 : audit [DBG] from='client.71799 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:41:26.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:41:25 smithi157 bash[24585]: cluster 2024-09-16T06:41:24.362988+0000 mgr.a (mgr.14373) 2785 : cluster [DBG] pgmap v1931: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:41:26.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:41:25 smithi157 bash[24585]: audit 2024-09-16T06:41:24.405971+0000 mgr.a (mgr.14373) 2786 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T06:41:26.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:41:25 smithi157 bash[24585]: cephadm 2024-09-16T06:41:24.419899+0000 mgr.a (mgr.14373) 2787 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T06:41:26.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:41:25 smithi086 bash[24289]: audit 2024-09-16T06:41:24.195852+0000 mgr.a (mgr.14373) 2784 : audit [DBG] from='client.71799 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:41:26.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:41:25 smithi086 bash[24289]: cluster 2024-09-16T06:41:24.362988+0000 mgr.a (mgr.14373) 2785 : cluster [DBG] pgmap v1931: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:41:26.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:41:25 smithi086 bash[24289]: audit 2024-09-16T06:41:24.405971+0000 mgr.a (mgr.14373) 2786 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T06:41:26.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:41:25 smithi086 bash[24289]: cephadm 2024-09-16T06:41:24.419899+0000 mgr.a (mgr.14373) 2787 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T06:41:26.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:41:25 smithi047 bash[22744]: audit 2024-09-16T06:41:24.195852+0000 mgr.a (mgr.14373) 2784 : audit [DBG] from='client.71799 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:41:26.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:41:25 smithi047 bash[22744]: cluster 2024-09-16T06:41:24.362988+0000 mgr.a (mgr.14373) 2785 : cluster [DBG] pgmap v1931: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:41:26.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:41:25 smithi047 bash[22744]: audit 2024-09-16T06:41:24.405971+0000 mgr.a (mgr.14373) 2786 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T06:41:26.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:41:25 smithi047 bash[22744]: cephadm 2024-09-16T06:41:24.419899+0000 mgr.a (mgr.14373) 2787 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T06:41:28.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:41:27 smithi157 bash[24585]: cluster 2024-09-16T06:41:26.363862+0000 mgr.a (mgr.14373) 2788 : cluster [DBG] pgmap v1932: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:41:28.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:41:27 smithi086 bash[24289]: cluster 2024-09-16T06:41:26.363862+0000 mgr.a (mgr.14373) 2788 : cluster [DBG] pgmap v1932: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:41:28.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:41:27 smithi047 bash[22744]: cluster 2024-09-16T06:41:26.363862+0000 mgr.a (mgr.14373) 2788 : cluster [DBG] pgmap v1932: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:41:29.810 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:41:29.811 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:41:29.811 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:41:30.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:41:29 smithi157 bash[24585]: cluster 2024-09-16T06:41:28.366234+0000 mgr.a (mgr.14373) 2789 : cluster [DBG] pgmap v1933: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:41:30.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:41:29 smithi086 bash[24289]: cluster 2024-09-16T06:41:28.366234+0000 mgr.a (mgr.14373) 2789 : cluster [DBG] pgmap v1933: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:41:30.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:41:29 smithi047 bash[22744]: cluster 2024-09-16T06:41:28.366234+0000 mgr.a (mgr.14373) 2789 : cluster [DBG] pgmap v1933: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:41:30.588 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:41:30.588 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:41:30.588 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:41:30.588 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:41:30.589 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:41:31.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:41:30 smithi157 bash[24585]: audit 2024-09-16T06:41:30.145833+0000 mgr.a (mgr.14373) 2790 : audit [DBG] from='client.71943 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:41:31.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:41:30 smithi086 bash[24289]: audit 2024-09-16T06:41:30.145833+0000 mgr.a (mgr.14373) 2790 : audit [DBG] from='client.71943 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:41:31.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:41:30 smithi047 bash[22744]: audit 2024-09-16T06:41:30.145833+0000 mgr.a (mgr.14373) 2790 : audit [DBG] from='client.71943 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:41:32.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:41:31 smithi157 bash[24585]: cluster 2024-09-16T06:41:30.366814+0000 mgr.a (mgr.14373) 2791 : cluster [DBG] pgmap v1934: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:41:32.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:41:31 smithi086 bash[24289]: cluster 2024-09-16T06:41:30.366814+0000 mgr.a (mgr.14373) 2791 : cluster [DBG] pgmap v1934: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:41:32.340 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:41:31 smithi047 bash[22744]: cluster 2024-09-16T06:41:30.366814+0000 mgr.a (mgr.14373) 2791 : cluster [DBG] pgmap v1934: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:41:34.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:41:33 smithi157 bash[24585]: cluster 2024-09-16T06:41:32.369262+0000 mgr.a (mgr.14373) 2792 : cluster [DBG] pgmap v1935: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:41:34.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:41:33 smithi086 bash[24289]: cluster 2024-09-16T06:41:32.369262+0000 mgr.a (mgr.14373) 2792 : cluster [DBG] pgmap v1935: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:41:34.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:41:33 smithi047 bash[22744]: cluster 2024-09-16T06:41:32.369262+0000 mgr.a (mgr.14373) 2792 : cluster [DBG] pgmap v1935: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:41:35.590 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:41:35.590 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:41:35.590 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:41:36.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:41:35 smithi157 bash[24585]: cluster 2024-09-16T06:41:34.370229+0000 mgr.a (mgr.14373) 2793 : cluster [DBG] pgmap v1936: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:41:36.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:41:35 smithi086 bash[24289]: cluster 2024-09-16T06:41:34.370229+0000 mgr.a (mgr.14373) 2793 : cluster [DBG] pgmap v1936: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:41:36.327 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:41:36.327 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:41:36.327 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:41:36.328 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:41:36.328 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:41:36.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:41:35 smithi047 bash[22744]: cluster 2024-09-16T06:41:34.370229+0000 mgr.a (mgr.14373) 2793 : cluster [DBG] pgmap v1936: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:41:37.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:41:36 smithi157 bash[24585]: audit 2024-09-16T06:41:35.923846+0000 mgr.a (mgr.14373) 2794 : audit [DBG] from='client.72015 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:41:37.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:41:36 smithi086 bash[24289]: audit 2024-09-16T06:41:35.923846+0000 mgr.a (mgr.14373) 2794 : audit [DBG] from='client.72015 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:41:37.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:41:36 smithi047 bash[22744]: audit 2024-09-16T06:41:35.923846+0000 mgr.a (mgr.14373) 2794 : audit [DBG] from='client.72015 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:41:38.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:41:37 smithi157 bash[24585]: cluster 2024-09-16T06:41:36.371277+0000 mgr.a (mgr.14373) 2795 : cluster [DBG] pgmap v1937: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.1 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:41:38.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:41:37 smithi086 bash[24289]: cluster 2024-09-16T06:41:36.371277+0000 mgr.a (mgr.14373) 2795 : cluster [DBG] pgmap v1937: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.1 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:41:38.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:41:37 smithi047 bash[22744]: cluster 2024-09-16T06:41:36.371277+0000 mgr.a (mgr.14373) 2795 : cluster [DBG] pgmap v1937: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.1 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:41:40.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:41:39 smithi157 bash[24585]: cluster 2024-09-16T06:41:38.372898+0000 mgr.a (mgr.14373) 2796 : cluster [DBG] pgmap v1938: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:41:40.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:41:39 smithi086 bash[24289]: cluster 2024-09-16T06:41:38.372898+0000 mgr.a (mgr.14373) 2796 : cluster [DBG] pgmap v1938: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:41:40.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:41:39 smithi047 bash[22744]: cluster 2024-09-16T06:41:38.372898+0000 mgr.a (mgr.14373) 2796 : cluster [DBG] pgmap v1938: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:41:41.329 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:41:41.425 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:41:41.426 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:41:42.078 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:41:42.078 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:41:42.078 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:41:42.078 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:41:42.079 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:41:42.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:41:41 smithi157 bash[24585]: cluster 2024-09-16T06:41:40.373639+0000 mgr.a (mgr.14373) 2797 : cluster [DBG] pgmap v1939: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:41:42.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:41:41 smithi086 bash[24289]: cluster 2024-09-16T06:41:40.373639+0000 mgr.a (mgr.14373) 2797 : cluster [DBG] pgmap v1939: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:41:42.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:41:41 smithi047 bash[22744]: cluster 2024-09-16T06:41:40.373639+0000 mgr.a (mgr.14373) 2797 : cluster [DBG] pgmap v1939: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:41:43.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:41:42 smithi157 bash[24585]: audit 2024-09-16T06:41:41.662804+0000 mgr.a (mgr.14373) 2798 : audit [DBG] from='client.72093 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:41:43.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:41:42 smithi086 bash[24289]: audit 2024-09-16T06:41:41.662804+0000 mgr.a (mgr.14373) 2798 : audit [DBG] from='client.72093 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:41:43.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:41:42 smithi047 bash[22744]: audit 2024-09-16T06:41:41.662804+0000 mgr.a (mgr.14373) 2798 : audit [DBG] from='client.72093 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:41:44.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:41:43 smithi157 bash[24585]: cluster 2024-09-16T06:41:42.376391+0000 mgr.a (mgr.14373) 2799 : cluster [DBG] pgmap v1940: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:41:44.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:41:43 smithi086 bash[24289]: cluster 2024-09-16T06:41:42.376391+0000 mgr.a (mgr.14373) 2799 : cluster [DBG] pgmap v1940: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:41:44.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:41:43 smithi047 bash[22744]: cluster 2024-09-16T06:41:42.376391+0000 mgr.a (mgr.14373) 2799 : cluster [DBG] pgmap v1940: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:41:46.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:41:45 smithi157 bash[24585]: cluster 2024-09-16T06:41:44.377184+0000 mgr.a (mgr.14373) 2800 : cluster [DBG] pgmap v1941: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:41:46.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:41:45 smithi086 bash[24289]: cluster 2024-09-16T06:41:44.377184+0000 mgr.a (mgr.14373) 2800 : cluster [DBG] pgmap v1941: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:41:46.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:41:45 smithi047 bash[22744]: cluster 2024-09-16T06:41:44.377184+0000 mgr.a (mgr.14373) 2800 : cluster [DBG] pgmap v1941: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:41:47.080 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:41:47.080 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:41:47.080 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:41:47.863 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:41:47.863 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:41:47.863 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:41:47.863 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:41:47.864 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:41:48.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:41:47 smithi157 bash[24585]: cluster 2024-09-16T06:41:46.378406+0000 mgr.a (mgr.14373) 2801 : cluster [DBG] pgmap v1942: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-16T06:41:48.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:41:47 smithi086 bash[24289]: cluster 2024-09-16T06:41:46.378406+0000 mgr.a (mgr.14373) 2801 : cluster [DBG] pgmap v1942: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-16T06:41:48.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:41:47 smithi047 bash[22744]: cluster 2024-09-16T06:41:46.378406+0000 mgr.a (mgr.14373) 2801 : cluster [DBG] pgmap v1942: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-16T06:41:49.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:41:48 smithi157 bash[24585]: audit 2024-09-16T06:41:47.420076+0000 mgr.a (mgr.14373) 2802 : audit [DBG] from='client.72171 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:41:49.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:41:48 smithi086 bash[24289]: audit 2024-09-16T06:41:47.420076+0000 mgr.a (mgr.14373) 2802 : audit [DBG] from='client.72171 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:41:49.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:41:48 smithi047 bash[22744]: audit 2024-09-16T06:41:47.420076+0000 mgr.a (mgr.14373) 2802 : audit [DBG] from='client.72171 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:41:50.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:41:49 smithi157 bash[24585]: cluster 2024-09-16T06:41:48.380697+0000 mgr.a (mgr.14373) 2803 : cluster [DBG] pgmap v1943: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-16T06:41:50.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:41:49 smithi086 bash[24289]: cluster 2024-09-16T06:41:48.380697+0000 mgr.a (mgr.14373) 2803 : cluster [DBG] pgmap v1943: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-16T06:41:50.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:41:49 smithi047 bash[22744]: cluster 2024-09-16T06:41:48.380697+0000 mgr.a (mgr.14373) 2803 : cluster [DBG] pgmap v1943: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-16T06:41:52.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:41:51 smithi157 bash[24585]: cluster 2024-09-16T06:41:50.381486+0000 mgr.a (mgr.14373) 2804 : cluster [DBG] pgmap v1944: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:41:52.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:41:51 smithi086 bash[24289]: cluster 2024-09-16T06:41:50.381486+0000 mgr.a (mgr.14373) 2804 : cluster [DBG] pgmap v1944: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:41:52.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:41:51 smithi047 bash[22744]: cluster 2024-09-16T06:41:50.381486+0000 mgr.a (mgr.14373) 2804 : cluster [DBG] pgmap v1944: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:41:52.865 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:41:52.865 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:41:52.866 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:41:53.638 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:41:53.639 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:41:53.639 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:41:53.639 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:41:53.639 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:41:54.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:41:53 smithi157 bash[24585]: cluster 2024-09-16T06:41:52.383588+0000 mgr.a (mgr.14373) 2805 : cluster [DBG] pgmap v1945: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:41:54.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:41:53 smithi086 bash[24289]: cluster 2024-09-16T06:41:52.383588+0000 mgr.a (mgr.14373) 2805 : cluster [DBG] pgmap v1945: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:41:54.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:41:53 smithi047 bash[22744]: cluster 2024-09-16T06:41:52.383588+0000 mgr.a (mgr.14373) 2805 : cluster [DBG] pgmap v1945: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:41:55.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:41:54 smithi157 bash[24585]: audit 2024-09-16T06:41:53.198518+0000 mgr.a (mgr.14373) 2806 : audit [DBG] from='client.72249 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:41:55.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:41:54 smithi086 bash[24289]: audit 2024-09-16T06:41:53.198518+0000 mgr.a (mgr.14373) 2806 : audit [DBG] from='client.72249 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:41:55.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:41:54 smithi047 bash[22744]: audit 2024-09-16T06:41:53.198518+0000 mgr.a (mgr.14373) 2806 : audit [DBG] from='client.72249 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:41:56.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:41:55 smithi157 bash[24585]: cluster 2024-09-16T06:41:54.384545+0000 mgr.a (mgr.14373) 2807 : cluster [DBG] pgmap v1946: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:41:56.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:41:55 smithi086 bash[24289]: cluster 2024-09-16T06:41:54.384545+0000 mgr.a (mgr.14373) 2807 : cluster [DBG] pgmap v1946: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:41:56.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:41:55 smithi047 bash[22744]: cluster 2024-09-16T06:41:54.384545+0000 mgr.a (mgr.14373) 2807 : cluster [DBG] pgmap v1946: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:41:58.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:41:57 smithi157 bash[24585]: cluster 2024-09-16T06:41:56.385941+0000 mgr.a (mgr.14373) 2808 : cluster [DBG] pgmap v1947: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-16T06:41:58.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:41:57 smithi086 bash[24289]: cluster 2024-09-16T06:41:56.385941+0000 mgr.a (mgr.14373) 2808 : cluster [DBG] pgmap v1947: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-16T06:41:58.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:41:57 smithi047 bash[22744]: cluster 2024-09-16T06:41:56.385941+0000 mgr.a (mgr.14373) 2808 : cluster [DBG] pgmap v1947: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-16T06:41:58.640 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:41:58.641 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:41:58.641 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:41:59.422 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:41:59.423 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:41:59.423 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:41:59.423 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:41:59.423 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:42:00.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:41:59 smithi157 bash[24585]: cluster 2024-09-16T06:41:58.387751+0000 mgr.a (mgr.14373) 2809 : cluster [DBG] pgmap v1948: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:42:00.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:41:59 smithi157 bash[24585]: audit 2024-09-16T06:41:58.984984+0000 mgr.a (mgr.14373) 2810 : audit [DBG] from='client.72327 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:42:00.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:41:59 smithi086 bash[24289]: cluster 2024-09-16T06:41:58.387751+0000 mgr.a (mgr.14373) 2809 : cluster [DBG] pgmap v1948: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:42:00.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:41:59 smithi086 bash[24289]: audit 2024-09-16T06:41:58.984984+0000 mgr.a (mgr.14373) 2810 : audit [DBG] from='client.72327 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:42:00.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:41:59 smithi047 bash[22744]: cluster 2024-09-16T06:41:58.387751+0000 mgr.a (mgr.14373) 2809 : cluster [DBG] pgmap v1948: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:42:00.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:41:59 smithi047 bash[22744]: audit 2024-09-16T06:41:58.984984+0000 mgr.a (mgr.14373) 2810 : audit [DBG] from='client.72327 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:42:02.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:42:01 smithi157 bash[24585]: cluster 2024-09-16T06:42:00.388735+0000 mgr.a (mgr.14373) 2811 : cluster [DBG] pgmap v1949: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:42:02.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:42:01 smithi086 bash[24289]: cluster 2024-09-16T06:42:00.388735+0000 mgr.a (mgr.14373) 2811 : cluster [DBG] pgmap v1949: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:42:02.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:42:01 smithi047 bash[22744]: cluster 2024-09-16T06:42:00.388735+0000 mgr.a (mgr.14373) 2811 : cluster [DBG] pgmap v1949: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:42:04.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:42:03 smithi157 bash[24585]: cluster 2024-09-16T06:42:02.391027+0000 mgr.a (mgr.14373) 2812 : cluster [DBG] pgmap v1950: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:42:04.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:42:03 smithi086 bash[24289]: cluster 2024-09-16T06:42:02.391027+0000 mgr.a (mgr.14373) 2812 : cluster [DBG] pgmap v1950: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:42:04.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:42:03 smithi047 bash[22744]: cluster 2024-09-16T06:42:02.391027+0000 mgr.a (mgr.14373) 2812 : cluster [DBG] pgmap v1950: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:42:04.424 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:42:04.425 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:42:04.425 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:42:05.174 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:42:05.174 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:42:05.174 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:42:05.174 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:42:05.175 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:42:06.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:42:05 smithi157 bash[24585]: cluster 2024-09-16T06:42:04.391812+0000 mgr.a (mgr.14373) 2813 : cluster [DBG] pgmap v1951: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:42:06.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:42:05 smithi157 bash[24585]: audit 2024-09-16T06:42:04.757876+0000 mgr.a (mgr.14373) 2814 : audit [DBG] from='client.72396 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:42:06.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:42:05 smithi086 bash[24289]: cluster 2024-09-16T06:42:04.391812+0000 mgr.a (mgr.14373) 2813 : cluster [DBG] pgmap v1951: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:42:06.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:42:05 smithi086 bash[24289]: audit 2024-09-16T06:42:04.757876+0000 mgr.a (mgr.14373) 2814 : audit [DBG] from='client.72396 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:42:06.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:42:05 smithi047 bash[22744]: cluster 2024-09-16T06:42:04.391812+0000 mgr.a (mgr.14373) 2813 : cluster [DBG] pgmap v1951: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:42:06.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:42:05 smithi047 bash[22744]: audit 2024-09-16T06:42:04.757876+0000 mgr.a (mgr.14373) 2814 : audit [DBG] from='client.72396 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:42:08.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:42:07 smithi157 bash[24585]: cluster 2024-09-16T06:42:06.393752+0000 mgr.a (mgr.14373) 2815 : cluster [DBG] pgmap v1952: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-16T06:42:08.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:42:07 smithi086 bash[24289]: cluster 2024-09-16T06:42:06.393752+0000 mgr.a (mgr.14373) 2815 : cluster [DBG] pgmap v1952: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-16T06:42:08.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:42:07 smithi047 bash[22744]: cluster 2024-09-16T06:42:06.393752+0000 mgr.a (mgr.14373) 2815 : cluster [DBG] pgmap v1952: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-16T06:42:10.176 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:42:10.177 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:42:10.177 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:42:10.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:42:09 smithi157 bash[24585]: cluster 2024-09-16T06:42:08.395035+0000 mgr.a (mgr.14373) 2816 : cluster [DBG] pgmap v1953: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:42:10.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:42:09 smithi086 bash[24289]: cluster 2024-09-16T06:42:08.395035+0000 mgr.a (mgr.14373) 2816 : cluster [DBG] pgmap v1953: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:42:10.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:42:09 smithi047 bash[22744]: cluster 2024-09-16T06:42:08.395035+0000 mgr.a (mgr.14373) 2816 : cluster [DBG] pgmap v1953: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:42:10.967 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:42:10.967 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:42:10.967 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:42:10.967 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:42:10.968 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:42:12.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:42:11 smithi157 bash[24585]: cluster 2024-09-16T06:42:10.395766+0000 mgr.a (mgr.14373) 2817 : cluster [DBG] pgmap v1954: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:42:12.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:42:11 smithi157 bash[24585]: audit 2024-09-16T06:42:10.517043+0000 mgr.a (mgr.14373) 2818 : audit [DBG] from='client.72474 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:42:12.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:42:11 smithi086 bash[24289]: cluster 2024-09-16T06:42:10.395766+0000 mgr.a (mgr.14373) 2817 : cluster [DBG] pgmap v1954: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:42:12.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:42:11 smithi086 bash[24289]: audit 2024-09-16T06:42:10.517043+0000 mgr.a (mgr.14373) 2818 : audit [DBG] from='client.72474 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:42:12.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:42:11 smithi047 bash[22744]: cluster 2024-09-16T06:42:10.395766+0000 mgr.a (mgr.14373) 2817 : cluster [DBG] pgmap v1954: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:42:12.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:42:11 smithi047 bash[22744]: audit 2024-09-16T06:42:10.517043+0000 mgr.a (mgr.14373) 2818 : audit [DBG] from='client.72474 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:42:14.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:42:13 smithi157 bash[24585]: cluster 2024-09-16T06:42:12.398146+0000 mgr.a (mgr.14373) 2819 : cluster [DBG] pgmap v1955: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:42:14.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:42:13 smithi086 bash[24289]: cluster 2024-09-16T06:42:12.398146+0000 mgr.a (mgr.14373) 2819 : cluster [DBG] pgmap v1955: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:42:14.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:42:13 smithi047 bash[22744]: cluster 2024-09-16T06:42:12.398146+0000 mgr.a (mgr.14373) 2819 : cluster [DBG] pgmap v1955: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:42:15.969 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:42:15.969 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:42:15.970 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:42:16.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:42:15 smithi157 bash[24585]: cluster 2024-09-16T06:42:14.398926+0000 mgr.a (mgr.14373) 2820 : cluster [DBG] pgmap v1956: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:42:16.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:42:15 smithi086 bash[24289]: cluster 2024-09-16T06:42:14.398926+0000 mgr.a (mgr.14373) 2820 : cluster [DBG] pgmap v1956: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:42:16.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:42:15 smithi047 bash[22744]: cluster 2024-09-16T06:42:14.398926+0000 mgr.a (mgr.14373) 2820 : cluster [DBG] pgmap v1956: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:42:16.732 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:42:16.733 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:42:16.733 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:42:16.733 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:42:16.733 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:42:18.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:42:17 smithi157 bash[24585]: audit 2024-09-16T06:42:16.308581+0000 mgr.a (mgr.14373) 2821 : audit [DBG] from='client.72552 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:42:18.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:42:17 smithi157 bash[24585]: cluster 2024-09-16T06:42:16.399906+0000 mgr.a (mgr.14373) 2822 : cluster [DBG] pgmap v1957: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:42:18.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:42:17 smithi086 bash[24289]: audit 2024-09-16T06:42:16.308581+0000 mgr.a (mgr.14373) 2821 : audit [DBG] from='client.72552 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:42:18.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:42:17 smithi086 bash[24289]: cluster 2024-09-16T06:42:16.399906+0000 mgr.a (mgr.14373) 2822 : cluster [DBG] pgmap v1957: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:42:18.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:42:17 smithi047 bash[22744]: audit 2024-09-16T06:42:16.308581+0000 mgr.a (mgr.14373) 2821 : audit [DBG] from='client.72552 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:42:18.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:42:17 smithi047 bash[22744]: cluster 2024-09-16T06:42:16.399906+0000 mgr.a (mgr.14373) 2822 : cluster [DBG] pgmap v1957: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:42:20.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:42:19 smithi157 bash[24585]: cluster 2024-09-16T06:42:18.401529+0000 mgr.a (mgr.14373) 2823 : cluster [DBG] pgmap v1958: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-16T06:42:20.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:42:19 smithi086 bash[24289]: cluster 2024-09-16T06:42:18.401529+0000 mgr.a (mgr.14373) 2823 : cluster [DBG] pgmap v1958: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-16T06:42:20.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:42:19 smithi047 bash[22744]: cluster 2024-09-16T06:42:18.401529+0000 mgr.a (mgr.14373) 2823 : cluster [DBG] pgmap v1958: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-16T06:42:21.734 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:42:21.735 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:42:21.735 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:42:22.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:42:21 smithi157 bash[24585]: cluster 2024-09-16T06:42:20.402362+0000 mgr.a (mgr.14373) 2824 : cluster [DBG] pgmap v1959: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-16T06:42:22.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:42:21 smithi086 bash[24289]: cluster 2024-09-16T06:42:20.402362+0000 mgr.a (mgr.14373) 2824 : cluster [DBG] pgmap v1959: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-16T06:42:22.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:42:21 smithi047 bash[22744]: cluster 2024-09-16T06:42:20.402362+0000 mgr.a (mgr.14373) 2824 : cluster [DBG] pgmap v1959: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-16T06:42:22.535 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:42:22.535 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:42:22.535 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:42:22.535 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:42:22.535 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:42:23.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:42:23 smithi157 bash[24585]: audit 2024-09-16T06:42:22.096039+0000 mgr.a (mgr.14373) 2825 : audit [DBG] from='client.72630 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:42:23.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:42:23 smithi086 bash[24289]: audit 2024-09-16T06:42:22.096039+0000 mgr.a (mgr.14373) 2825 : audit [DBG] from='client.72630 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:42:23.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:42:23 smithi047 bash[22744]: audit 2024-09-16T06:42:22.096039+0000 mgr.a (mgr.14373) 2825 : audit [DBG] from='client.72630 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:42:24.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:42:24 smithi157 bash[24585]: cluster 2024-09-16T06:42:22.403865+0000 mgr.a (mgr.14373) 2826 : cluster [DBG] pgmap v1960: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:42:24.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:42:24 smithi086 bash[24289]: cluster 2024-09-16T06:42:22.403865+0000 mgr.a (mgr.14373) 2826 : cluster [DBG] pgmap v1960: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:42:24.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:42:24 smithi047 bash[22744]: cluster 2024-09-16T06:42:22.403865+0000 mgr.a (mgr.14373) 2826 : cluster [DBG] pgmap v1960: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:42:25.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:42:25 smithi157 bash[24585]: audit 2024-09-16T06:42:24.470716+0000 mon.b (mon.2) 298 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T06:42:25.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:42:25 smithi086 bash[24289]: audit 2024-09-16T06:42:24.470716+0000 mon.b (mon.2) 298 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T06:42:25.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:42:25 smithi047 bash[22744]: audit 2024-09-16T06:42:24.470716+0000 mon.b (mon.2) 298 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T06:42:26.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:42:26 smithi157 bash[24585]: cluster 2024-09-16T06:42:24.404762+0000 mgr.a (mgr.14373) 2827 : cluster [DBG] pgmap v1961: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T06:42:26.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:42:26 smithi157 bash[24585]: audit 2024-09-16T06:42:25.303867+0000 mon.b (mon.2) 299 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T06:42:26.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:42:26 smithi157 bash[24585]: audit 2024-09-16T06:42:25.305901+0000 mon.b (mon.2) 300 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T06:42:26.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:42:26 smithi157 bash[24585]: audit 2024-09-16T06:42:25.318945+0000 mon.a (mon.0) 743 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:42:26.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:42:26 smithi157 bash[24585]: audit 2024-09-16T06:42:25.322477+0000 mon.b (mon.2) 301 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:42:26.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:42:26 smithi086 bash[24289]: cluster 2024-09-16T06:42:24.404762+0000 mgr.a (mgr.14373) 2827 : cluster [DBG] pgmap v1961: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T06:42:26.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:42:26 smithi086 bash[24289]: audit 2024-09-16T06:42:25.303867+0000 mon.b (mon.2) 299 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T06:42:26.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:42:26 smithi086 bash[24289]: audit 2024-09-16T06:42:25.305901+0000 mon.b (mon.2) 300 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T06:42:26.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:42:26 smithi086 bash[24289]: audit 2024-09-16T06:42:25.318945+0000 mon.a (mon.0) 743 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:42:26.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:42:26 smithi086 bash[24289]: audit 2024-09-16T06:42:25.322477+0000 mon.b (mon.2) 301 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:42:26.339 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 06:42:26 smithi047 bash[22994]: debug 2024-09-16T06:42:26.059+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T06:42:26.339 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 06:42:26 smithi047 bash[22994]: debug 2024-09-16T06:42:26.063+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T06:42:26.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:42:26 smithi047 bash[22744]: cluster 2024-09-16T06:42:24.404762+0000 mgr.a (mgr.14373) 2827 : cluster [DBG] pgmap v1961: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T06:42:26.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:42:26 smithi047 bash[22744]: audit 2024-09-16T06:42:25.303867+0000 mon.b (mon.2) 299 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T06:42:26.340 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:42:26 smithi047 bash[22744]: audit 2024-09-16T06:42:25.305901+0000 mon.b (mon.2) 300 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T06:42:26.340 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:42:26 smithi047 bash[22744]: audit 2024-09-16T06:42:25.318945+0000 mon.a (mon.0) 743 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:42:26.340 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:42:26 smithi047 bash[22744]: audit 2024-09-16T06:42:25.322477+0000 mon.b (mon.2) 301 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:42:27.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:42:27 smithi157 bash[24585]: audit 2024-09-16T06:42:25.325805+0000 mgr.a (mgr.14373) 2828 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:42:27.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:42:27 smithi157 bash[24585]: audit 2024-09-16T06:42:26.064484+0000 mgr.a (mgr.14373) 2829 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T06:42:27.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:42:27 smithi157 bash[24585]: cephadm 2024-09-16T06:42:26.066391+0000 mgr.a (mgr.14373) 2830 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T06:42:27.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:42:27 smithi086 bash[24289]: audit 2024-09-16T06:42:25.325805+0000 mgr.a (mgr.14373) 2828 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:42:27.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:42:27 smithi086 bash[24289]: audit 2024-09-16T06:42:26.064484+0000 mgr.a (mgr.14373) 2829 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T06:42:27.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:42:27 smithi086 bash[24289]: cephadm 2024-09-16T06:42:26.066391+0000 mgr.a (mgr.14373) 2830 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T06:42:27.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:42:27 smithi047 bash[22744]: audit 2024-09-16T06:42:25.325805+0000 mgr.a (mgr.14373) 2828 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:42:27.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:42:27 smithi047 bash[22744]: audit 2024-09-16T06:42:26.064484+0000 mgr.a (mgr.14373) 2829 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T06:42:27.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:42:27 smithi047 bash[22744]: cephadm 2024-09-16T06:42:26.066391+0000 mgr.a (mgr.14373) 2830 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T06:42:27.536 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:42:27.537 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:42:27.537 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:42:28.261 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:42:28.261 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:42:28.261 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:42:28.261 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:42:28.261 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:42:28.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:42:28 smithi157 bash[24585]: cluster 2024-09-16T06:42:26.406822+0000 mgr.a (mgr.14373) 2831 : cluster [DBG] pgmap v1962: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 3.7 KiB/s rd, 85 B/s wr, 3 op/s 2024-09-16T06:42:28.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:42:28 smithi086 bash[24289]: cluster 2024-09-16T06:42:26.406822+0000 mgr.a (mgr.14373) 2831 : cluster [DBG] pgmap v1962: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 3.7 KiB/s rd, 85 B/s wr, 3 op/s 2024-09-16T06:42:28.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:42:28 smithi047 bash[22744]: cluster 2024-09-16T06:42:26.406822+0000 mgr.a (mgr.14373) 2831 : cluster [DBG] pgmap v1962: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 3.7 KiB/s rd, 85 B/s wr, 3 op/s 2024-09-16T06:42:29.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:42:29 smithi157 bash[24585]: audit 2024-09-16T06:42:27.858842+0000 mgr.a (mgr.14373) 2832 : audit [DBG] from='client.72816 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:42:29.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:42:29 smithi086 bash[24289]: audit 2024-09-16T06:42:27.858842+0000 mgr.a (mgr.14373) 2832 : audit [DBG] from='client.72816 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:42:29.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:42:29 smithi047 bash[22744]: audit 2024-09-16T06:42:27.858842+0000 mgr.a (mgr.14373) 2832 : audit [DBG] from='client.72816 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:42:30.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:42:30 smithi157 bash[24585]: cluster 2024-09-16T06:42:28.408603+0000 mgr.a (mgr.14373) 2833 : cluster [DBG] pgmap v1963: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:42:30.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:42:30 smithi086 bash[24289]: cluster 2024-09-16T06:42:28.408603+0000 mgr.a (mgr.14373) 2833 : cluster [DBG] pgmap v1963: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:42:30.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:42:30 smithi047 bash[22744]: cluster 2024-09-16T06:42:28.408603+0000 mgr.a (mgr.14373) 2833 : cluster [DBG] pgmap v1963: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:42:32.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:42:32 smithi157 bash[24585]: cluster 2024-09-16T06:42:30.409408+0000 mgr.a (mgr.14373) 2834 : cluster [DBG] pgmap v1964: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.8 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T06:42:32.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:42:32 smithi086 bash[24289]: cluster 2024-09-16T06:42:30.409408+0000 mgr.a (mgr.14373) 2834 : cluster [DBG] pgmap v1964: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.8 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T06:42:32.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:42:32 smithi047 bash[22744]: cluster 2024-09-16T06:42:30.409408+0000 mgr.a (mgr.14373) 2834 : cluster [DBG] pgmap v1964: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.8 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T06:42:33.262 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:42:33.263 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:42:33.263 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:42:34.031 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:42:34.031 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:42:34.031 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:42:34.031 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:42:34.031 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:42:34.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:42:34 smithi157 bash[24585]: cluster 2024-09-16T06:42:32.411493+0000 mgr.a (mgr.14373) 2835 : cluster [DBG] pgmap v1965: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:42:34.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:42:34 smithi086 bash[24289]: cluster 2024-09-16T06:42:32.411493+0000 mgr.a (mgr.14373) 2835 : cluster [DBG] pgmap v1965: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:42:34.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:42:34 smithi047 bash[22744]: cluster 2024-09-16T06:42:32.411493+0000 mgr.a (mgr.14373) 2835 : cluster [DBG] pgmap v1965: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:42:35.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:42:35 smithi086 bash[24289]: audit 2024-09-16T06:42:33.602686+0000 mgr.a (mgr.14373) 2836 : audit [DBG] from='client.72894 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:42:35.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:42:35 smithi047 bash[22744]: audit 2024-09-16T06:42:33.602686+0000 mgr.a (mgr.14373) 2836 : audit [DBG] from='client.72894 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:42:35.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:42:35 smithi157 bash[24585]: audit 2024-09-16T06:42:33.602686+0000 mgr.a (mgr.14373) 2836 : audit [DBG] from='client.72894 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:42:36.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:42:36 smithi086 bash[24289]: cluster 2024-09-16T06:42:34.412408+0000 mgr.a (mgr.14373) 2837 : cluster [DBG] pgmap v1966: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:42:36.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:42:36 smithi047 bash[22744]: cluster 2024-09-16T06:42:34.412408+0000 mgr.a (mgr.14373) 2837 : cluster [DBG] pgmap v1966: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:42:36.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:42:36 smithi157 bash[24585]: cluster 2024-09-16T06:42:34.412408+0000 mgr.a (mgr.14373) 2837 : cluster [DBG] pgmap v1966: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:42:38.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:42:38 smithi086 bash[24289]: cluster 2024-09-16T06:42:36.414164+0000 mgr.a (mgr.14373) 2838 : cluster [DBG] pgmap v1967: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.3 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:42:38.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:42:38 smithi047 bash[22744]: cluster 2024-09-16T06:42:36.414164+0000 mgr.a (mgr.14373) 2838 : cluster [DBG] pgmap v1967: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.3 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:42:38.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:42:38 smithi157 bash[24585]: cluster 2024-09-16T06:42:36.414164+0000 mgr.a (mgr.14373) 2838 : cluster [DBG] pgmap v1967: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.3 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:42:39.032 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:42:39.033 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:42:39.033 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:42:39.810 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:42:39.810 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:42:39.810 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:42:39.810 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:42:39.810 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:42:40.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:42:40 smithi086 bash[24289]: cluster 2024-09-16T06:42:38.415406+0000 mgr.a (mgr.14373) 2839 : cluster [DBG] pgmap v1968: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 5.2 KiB/s rd, 341 B/s wr, 4 op/s 2024-09-16T06:42:40.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:42:40 smithi047 bash[22744]: cluster 2024-09-16T06:42:38.415406+0000 mgr.a (mgr.14373) 2839 : cluster [DBG] pgmap v1968: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 5.2 KiB/s rd, 341 B/s wr, 4 op/s 2024-09-16T06:42:40.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:42:40 smithi157 bash[24585]: cluster 2024-09-16T06:42:38.415406+0000 mgr.a (mgr.14373) 2839 : cluster [DBG] pgmap v1968: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 5.2 KiB/s rd, 341 B/s wr, 4 op/s 2024-09-16T06:42:41.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:42:41 smithi047 bash[22744]: audit 2024-09-16T06:42:39.371888+0000 mgr.a (mgr.14373) 2840 : audit [DBG] from='client.72966 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:42:41.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:42:41 smithi157 bash[24585]: audit 2024-09-16T06:42:39.371888+0000 mgr.a (mgr.14373) 2840 : audit [DBG] from='client.72966 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:42:41.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:42:41 smithi086 bash[24289]: audit 2024-09-16T06:42:39.371888+0000 mgr.a (mgr.14373) 2840 : audit [DBG] from='client.72966 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:42:42.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:42:42 smithi047 bash[22744]: cluster 2024-09-16T06:42:40.416378+0000 mgr.a (mgr.14373) 2841 : cluster [DBG] pgmap v1969: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:42:42.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:42:42 smithi157 bash[24585]: cluster 2024-09-16T06:42:40.416378+0000 mgr.a (mgr.14373) 2841 : cluster [DBG] pgmap v1969: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:42:42.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:42:42 smithi086 bash[24289]: cluster 2024-09-16T06:42:40.416378+0000 mgr.a (mgr.14373) 2841 : cluster [DBG] pgmap v1969: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:42:44.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:42:44 smithi047 bash[22744]: cluster 2024-09-16T06:42:42.418632+0000 mgr.a (mgr.14373) 2842 : cluster [DBG] pgmap v1970: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:42:44.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:42:44 smithi157 bash[24585]: cluster 2024-09-16T06:42:42.418632+0000 mgr.a (mgr.14373) 2842 : cluster [DBG] pgmap v1970: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:42:44.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:42:44 smithi086 bash[24289]: cluster 2024-09-16T06:42:42.418632+0000 mgr.a (mgr.14373) 2842 : cluster [DBG] pgmap v1970: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:42:44.812 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:42:44.812 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:42:44.812 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:42:45.587 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:42:45.588 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:42:45.588 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:42:45.588 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:42:45.588 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:42:46.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:42:46 smithi047 bash[22744]: cluster 2024-09-16T06:42:44.419400+0000 mgr.a (mgr.14373) 2843 : cluster [DBG] pgmap v1971: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:42:46.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:42:46 smithi047 bash[22744]: audit 2024-09-16T06:42:45.146998+0000 mgr.a (mgr.14373) 2844 : audit [DBG] from='client.73044 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:42:46.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:42:46 smithi157 bash[24585]: cluster 2024-09-16T06:42:44.419400+0000 mgr.a (mgr.14373) 2843 : cluster [DBG] pgmap v1971: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:42:46.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:42:46 smithi157 bash[24585]: audit 2024-09-16T06:42:45.146998+0000 mgr.a (mgr.14373) 2844 : audit [DBG] from='client.73044 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:42:46.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:42:46 smithi086 bash[24289]: cluster 2024-09-16T06:42:44.419400+0000 mgr.a (mgr.14373) 2843 : cluster [DBG] pgmap v1971: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:42:46.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:42:46 smithi086 bash[24289]: audit 2024-09-16T06:42:45.146998+0000 mgr.a (mgr.14373) 2844 : audit [DBG] from='client.73044 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:42:48.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:42:48 smithi047 bash[22744]: cluster 2024-09-16T06:42:46.421356+0000 mgr.a (mgr.14373) 2845 : cluster [DBG] pgmap v1972: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-16T06:42:48.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:42:48 smithi157 bash[24585]: cluster 2024-09-16T06:42:46.421356+0000 mgr.a (mgr.14373) 2845 : cluster [DBG] pgmap v1972: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-16T06:42:48.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:42:48 smithi086 bash[24289]: cluster 2024-09-16T06:42:46.421356+0000 mgr.a (mgr.14373) 2845 : cluster [DBG] pgmap v1972: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-16T06:42:50.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:42:50 smithi157 bash[24585]: cluster 2024-09-16T06:42:48.422631+0000 mgr.a (mgr.14373) 2846 : cluster [DBG] pgmap v1973: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.4 KiB/s rd, 2 op/s 2024-09-16T06:42:50.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:42:50 smithi086 bash[24289]: cluster 2024-09-16T06:42:48.422631+0000 mgr.a (mgr.14373) 2846 : cluster [DBG] pgmap v1973: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.4 KiB/s rd, 2 op/s 2024-09-16T06:42:50.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:42:50 smithi047 bash[22744]: cluster 2024-09-16T06:42:48.422631+0000 mgr.a (mgr.14373) 2846 : cluster [DBG] pgmap v1973: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.4 KiB/s rd, 2 op/s 2024-09-16T06:42:50.589 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:42:50.590 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:42:50.590 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:42:51.336 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:42:51.337 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:42:51.337 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:42:51.337 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:42:51.337 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:42:52.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:42:52 smithi157 bash[24585]: cluster 2024-09-16T06:42:50.423398+0000 mgr.a (mgr.14373) 2847 : cluster [DBG] pgmap v1974: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:42:52.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:42:52 smithi157 bash[24585]: audit 2024-09-16T06:42:50.922246+0000 mgr.a (mgr.14373) 2848 : audit [DBG] from='client.73119 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:42:52.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:42:52 smithi086 bash[24289]: cluster 2024-09-16T06:42:50.423398+0000 mgr.a (mgr.14373) 2847 : cluster [DBG] pgmap v1974: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:42:52.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:42:52 smithi086 bash[24289]: audit 2024-09-16T06:42:50.922246+0000 mgr.a (mgr.14373) 2848 : audit [DBG] from='client.73119 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:42:52.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:42:52 smithi047 bash[22744]: cluster 2024-09-16T06:42:50.423398+0000 mgr.a (mgr.14373) 2847 : cluster [DBG] pgmap v1974: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:42:52.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:42:52 smithi047 bash[22744]: audit 2024-09-16T06:42:50.922246+0000 mgr.a (mgr.14373) 2848 : audit [DBG] from='client.73119 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:42:54.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:42:54 smithi157 bash[24585]: cluster 2024-09-16T06:42:52.425756+0000 mgr.a (mgr.14373) 2849 : cluster [DBG] pgmap v1975: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:42:54.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:42:54 smithi086 bash[24289]: cluster 2024-09-16T06:42:52.425756+0000 mgr.a (mgr.14373) 2849 : cluster [DBG] pgmap v1975: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:42:54.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:42:54 smithi047 bash[22744]: cluster 2024-09-16T06:42:52.425756+0000 mgr.a (mgr.14373) 2849 : cluster [DBG] pgmap v1975: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:42:56.338 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:42:56.339 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:42:56.339 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:42:56.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:42:56 smithi157 bash[24585]: cluster 2024-09-16T06:42:54.426563+0000 mgr.a (mgr.14373) 2850 : cluster [DBG] pgmap v1976: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:42:56.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:42:56 smithi086 bash[24289]: cluster 2024-09-16T06:42:54.426563+0000 mgr.a (mgr.14373) 2850 : cluster [DBG] pgmap v1976: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:42:56.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:42:56 smithi047 bash[22744]: cluster 2024-09-16T06:42:54.426563+0000 mgr.a (mgr.14373) 2850 : cluster [DBG] pgmap v1976: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:42:57.082 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:42:57.083 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:42:57.083 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:42:57.083 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:42:57.084 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:42:58.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:42:58 smithi157 bash[24585]: cluster 2024-09-16T06:42:56.428132+0000 mgr.a (mgr.14373) 2851 : cluster [DBG] pgmap v1977: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:42:58.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:42:58 smithi157 bash[24585]: audit 2024-09-16T06:42:56.668761+0000 mgr.a (mgr.14373) 2852 : audit [DBG] from='client.73194 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:42:58.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:42:58 smithi086 bash[24289]: cluster 2024-09-16T06:42:56.428132+0000 mgr.a (mgr.14373) 2851 : cluster [DBG] pgmap v1977: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:42:58.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:42:58 smithi086 bash[24289]: audit 2024-09-16T06:42:56.668761+0000 mgr.a (mgr.14373) 2852 : audit [DBG] from='client.73194 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:42:58.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:42:58 smithi047 bash[22744]: cluster 2024-09-16T06:42:56.428132+0000 mgr.a (mgr.14373) 2851 : cluster [DBG] pgmap v1977: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:42:58.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:42:58 smithi047 bash[22744]: audit 2024-09-16T06:42:56.668761+0000 mgr.a (mgr.14373) 2852 : audit [DBG] from='client.73194 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:43:00.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:43:00 smithi157 bash[24585]: cluster 2024-09-16T06:42:58.429806+0000 mgr.a (mgr.14373) 2853 : cluster [DBG] pgmap v1978: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-09-16T06:43:00.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:43:00 smithi086 bash[24289]: cluster 2024-09-16T06:42:58.429806+0000 mgr.a (mgr.14373) 2853 : cluster [DBG] pgmap v1978: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-09-16T06:43:00.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:43:00 smithi047 bash[22744]: cluster 2024-09-16T06:42:58.429806+0000 mgr.a (mgr.14373) 2853 : cluster [DBG] pgmap v1978: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-09-16T06:43:02.084 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:43:02.084 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:43:02.085 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:43:02.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:43:02 smithi157 bash[24585]: cluster 2024-09-16T06:43:00.430615+0000 mgr.a (mgr.14373) 2854 : cluster [DBG] pgmap v1979: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T06:43:02.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:43:02 smithi086 bash[24289]: cluster 2024-09-16T06:43:00.430615+0000 mgr.a (mgr.14373) 2854 : cluster [DBG] pgmap v1979: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T06:43:02.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:43:02 smithi047 bash[22744]: cluster 2024-09-16T06:43:00.430615+0000 mgr.a (mgr.14373) 2854 : cluster [DBG] pgmap v1979: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T06:43:02.864 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:43:02.864 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:43:02.864 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:43:02.864 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:43:02.864 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:43:04.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:43:04 smithi157 bash[24585]: audit 2024-09-16T06:43:02.425465+0000 mgr.a (mgr.14373) 2855 : audit [DBG] from='client.73272 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:43:04.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:43:04 smithi157 bash[24585]: cluster 2024-09-16T06:43:02.439652+0000 mgr.a (mgr.14373) 2856 : cluster [DBG] pgmap v1980: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:43:04.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:43:04 smithi086 bash[24289]: audit 2024-09-16T06:43:02.425465+0000 mgr.a (mgr.14373) 2855 : audit [DBG] from='client.73272 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:43:04.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:43:04 smithi086 bash[24289]: cluster 2024-09-16T06:43:02.439652+0000 mgr.a (mgr.14373) 2856 : cluster [DBG] pgmap v1980: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:43:04.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:43:04 smithi047 bash[22744]: audit 2024-09-16T06:43:02.425465+0000 mgr.a (mgr.14373) 2855 : audit [DBG] from='client.73272 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:43:04.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:43:04 smithi047 bash[22744]: cluster 2024-09-16T06:43:02.439652+0000 mgr.a (mgr.14373) 2856 : cluster [DBG] pgmap v1980: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:43:06.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:43:06 smithi157 bash[24585]: cluster 2024-09-16T06:43:04.440565+0000 mgr.a (mgr.14373) 2857 : cluster [DBG] pgmap v1981: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:43:06.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:43:06 smithi086 bash[24289]: cluster 2024-09-16T06:43:04.440565+0000 mgr.a (mgr.14373) 2857 : cluster [DBG] pgmap v1981: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:43:06.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:43:06 smithi047 bash[22744]: cluster 2024-09-16T06:43:04.440565+0000 mgr.a (mgr.14373) 2857 : cluster [DBG] pgmap v1981: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:43:07.865 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:43:07.866 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:43:07.866 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:43:08.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:43:08 smithi157 bash[24585]: cluster 2024-09-16T06:43:06.442329+0000 mgr.a (mgr.14373) 2858 : cluster [DBG] pgmap v1982: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T06:43:08.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:43:08 smithi086 bash[24289]: cluster 2024-09-16T06:43:06.442329+0000 mgr.a (mgr.14373) 2858 : cluster [DBG] pgmap v1982: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T06:43:08.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:43:08 smithi047 bash[22744]: cluster 2024-09-16T06:43:06.442329+0000 mgr.a (mgr.14373) 2858 : cluster [DBG] pgmap v1982: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T06:43:08.613 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:43:08.613 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:43:08.613 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:43:08.613 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:43:08.613 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:43:10.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:43:10 smithi157 bash[24585]: audit 2024-09-16T06:43:08.199219+0000 mgr.a (mgr.14373) 2859 : audit [DBG] from='client.73347 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:43:10.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:43:10 smithi157 bash[24585]: cluster 2024-09-16T06:43:08.443221+0000 mgr.a (mgr.14373) 2860 : cluster [DBG] pgmap v1983: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:43:10.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:43:10 smithi086 bash[24289]: audit 2024-09-16T06:43:08.199219+0000 mgr.a (mgr.14373) 2859 : audit [DBG] from='client.73347 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:43:10.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:43:10 smithi086 bash[24289]: cluster 2024-09-16T06:43:08.443221+0000 mgr.a (mgr.14373) 2860 : cluster [DBG] pgmap v1983: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:43:10.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:43:10 smithi047 bash[22744]: audit 2024-09-16T06:43:08.199219+0000 mgr.a (mgr.14373) 2859 : audit [DBG] from='client.73347 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:43:10.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:43:10 smithi047 bash[22744]: cluster 2024-09-16T06:43:08.443221+0000 mgr.a (mgr.14373) 2860 : cluster [DBG] pgmap v1983: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:43:12.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:43:12 smithi157 bash[24585]: cluster 2024-09-16T06:43:10.444084+0000 mgr.a (mgr.14373) 2861 : cluster [DBG] pgmap v1984: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:43:12.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:43:12 smithi086 bash[24289]: cluster 2024-09-16T06:43:10.444084+0000 mgr.a (mgr.14373) 2861 : cluster [DBG] pgmap v1984: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:43:12.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:43:12 smithi047 bash[22744]: cluster 2024-09-16T06:43:10.444084+0000 mgr.a (mgr.14373) 2861 : cluster [DBG] pgmap v1984: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:43:13.625 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:43:13.626 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:43:13.626 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:43:14.359 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:43:14.359 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:43:14.359 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:43:14.359 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:43:14.359 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:43:14.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:43:14 smithi157 bash[24585]: cluster 2024-09-16T06:43:12.446333+0000 mgr.a (mgr.14373) 2862 : cluster [DBG] pgmap v1985: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:43:14.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:43:14 smithi086 bash[24289]: cluster 2024-09-16T06:43:12.446333+0000 mgr.a (mgr.14373) 2862 : cluster [DBG] pgmap v1985: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:43:14.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:43:14 smithi047 bash[22744]: cluster 2024-09-16T06:43:12.446333+0000 mgr.a (mgr.14373) 2862 : cluster [DBG] pgmap v1985: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:43:15.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:43:15 smithi157 bash[24585]: audit 2024-09-16T06:43:13.955746+0000 mgr.a (mgr.14373) 2863 : audit [DBG] from='client.73425 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:43:15.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:43:15 smithi086 bash[24289]: audit 2024-09-16T06:43:13.955746+0000 mgr.a (mgr.14373) 2863 : audit [DBG] from='client.73425 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:43:15.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:43:15 smithi047 bash[22744]: audit 2024-09-16T06:43:13.955746+0000 mgr.a (mgr.14373) 2863 : audit [DBG] from='client.73425 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:43:16.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:43:16 smithi157 bash[24585]: cluster 2024-09-16T06:43:14.447314+0000 mgr.a (mgr.14373) 2864 : cluster [DBG] pgmap v1986: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:43:16.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:43:16 smithi086 bash[24289]: cluster 2024-09-16T06:43:14.447314+0000 mgr.a (mgr.14373) 2864 : cluster [DBG] pgmap v1986: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:43:16.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:43:16 smithi047 bash[22744]: cluster 2024-09-16T06:43:14.447314+0000 mgr.a (mgr.14373) 2864 : cluster [DBG] pgmap v1986: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:43:18.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:43:18 smithi157 bash[24585]: cluster 2024-09-16T06:43:16.449086+0000 mgr.a (mgr.14373) 2865 : cluster [DBG] pgmap v1987: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-16T06:43:18.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:43:18 smithi086 bash[24289]: cluster 2024-09-16T06:43:16.449086+0000 mgr.a (mgr.14373) 2865 : cluster [DBG] pgmap v1987: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-16T06:43:18.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:43:18 smithi047 bash[22744]: cluster 2024-09-16T06:43:16.449086+0000 mgr.a (mgr.14373) 2865 : cluster [DBG] pgmap v1987: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-16T06:43:19.361 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:43:19.361 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:43:19.361 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:43:20.142 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:43:20.142 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:43:20.143 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:43:20.143 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:43:20.143 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:43:20.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:43:20 smithi157 bash[24585]: cluster 2024-09-16T06:43:18.450299+0000 mgr.a (mgr.14373) 2866 : cluster [DBG] pgmap v1988: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.4 KiB/s rd, 2 op/s 2024-09-16T06:43:20.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:43:20 smithi086 bash[24289]: cluster 2024-09-16T06:43:18.450299+0000 mgr.a (mgr.14373) 2866 : cluster [DBG] pgmap v1988: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.4 KiB/s rd, 2 op/s 2024-09-16T06:43:20.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:43:20 smithi047 bash[22744]: cluster 2024-09-16T06:43:18.450299+0000 mgr.a (mgr.14373) 2866 : cluster [DBG] pgmap v1988: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.4 KiB/s rd, 2 op/s 2024-09-16T06:43:21.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:43:21 smithi157 bash[24585]: audit 2024-09-16T06:43:19.699858+0000 mgr.a (mgr.14373) 2867 : audit [DBG] from='client.73500 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:43:21.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:43:21 smithi086 bash[24289]: audit 2024-09-16T06:43:19.699858+0000 mgr.a (mgr.14373) 2867 : audit [DBG] from='client.73500 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:43:21.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:43:21 smithi047 bash[22744]: audit 2024-09-16T06:43:19.699858+0000 mgr.a (mgr.14373) 2867 : audit [DBG] from='client.73500 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:43:22.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:43:22 smithi157 bash[24585]: cluster 2024-09-16T06:43:20.451284+0000 mgr.a (mgr.14373) 2868 : cluster [DBG] pgmap v1989: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:43:22.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:43:22 smithi086 bash[24289]: cluster 2024-09-16T06:43:20.451284+0000 mgr.a (mgr.14373) 2868 : cluster [DBG] pgmap v1989: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:43:22.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:43:22 smithi047 bash[22744]: cluster 2024-09-16T06:43:20.451284+0000 mgr.a (mgr.14373) 2868 : cluster [DBG] pgmap v1989: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:43:23.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:43:23 smithi157 bash[24585]: cluster 2024-09-16T06:43:22.453551+0000 mgr.a (mgr.14373) 2869 : cluster [DBG] pgmap v1990: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:43:23.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:43:23 smithi086 bash[24289]: cluster 2024-09-16T06:43:22.453551+0000 mgr.a (mgr.14373) 2869 : cluster [DBG] pgmap v1990: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:43:23.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:43:23 smithi047 bash[22744]: cluster 2024-09-16T06:43:22.453551+0000 mgr.a (mgr.14373) 2869 : cluster [DBG] pgmap v1990: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:43:25.144 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:43:25.144 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:43:25.144 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:43:25.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:43:25 smithi157 bash[24585]: cluster 2024-09-16T06:43:24.454302+0000 mgr.a (mgr.14373) 2870 : cluster [DBG] pgmap v1991: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:43:25.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:43:25 smithi086 bash[24289]: cluster 2024-09-16T06:43:24.454302+0000 mgr.a (mgr.14373) 2870 : cluster [DBG] pgmap v1991: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:43:25.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:43:25 smithi047 bash[22744]: cluster 2024-09-16T06:43:24.454302+0000 mgr.a (mgr.14373) 2870 : cluster [DBG] pgmap v1991: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:43:25.921 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:43:25.921 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:43:25.921 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:43:25.921 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:43:25.921 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:43:26.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:43:26 smithi157 bash[24585]: audit 2024-09-16T06:43:25.485915+0000 mgr.a (mgr.14373) 2871 : audit [DBG] from='client.73572 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:43:26.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:43:26 smithi157 bash[24585]: audit 2024-09-16T06:43:26.118831+0000 mon.b (mon.2) 302 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T06:43:26.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:43:26 smithi086 bash[24289]: audit 2024-09-16T06:43:25.485915+0000 mgr.a (mgr.14373) 2871 : audit [DBG] from='client.73572 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:43:26.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:43:26 smithi086 bash[24289]: audit 2024-09-16T06:43:26.118831+0000 mon.b (mon.2) 302 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T06:43:26.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:43:26 smithi047 bash[22744]: audit 2024-09-16T06:43:25.485915+0000 mgr.a (mgr.14373) 2871 : audit [DBG] from='client.73572 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:43:26.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:43:26 smithi047 bash[22744]: audit 2024-09-16T06:43:26.118831+0000 mon.b (mon.2) 302 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T06:43:27.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:43:27 smithi157 bash[24585]: cluster 2024-09-16T06:43:26.456231+0000 mgr.a (mgr.14373) 2872 : cluster [DBG] pgmap v1992: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-16T06:43:27.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:43:27 smithi157 bash[24585]: audit 2024-09-16T06:43:26.951832+0000 mon.b (mon.2) 303 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T06:43:27.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:43:27 smithi157 bash[24585]: audit 2024-09-16T06:43:26.953984+0000 mon.b (mon.2) 304 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T06:43:27.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:43:27 smithi157 bash[24585]: audit 2024-09-16T06:43:26.965300+0000 mon.a (mon.0) 744 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:43:27.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:43:27 smithi157 bash[24585]: audit 2024-09-16T06:43:26.970893+0000 mon.b (mon.2) 305 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:43:27.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:43:27 smithi157 bash[24585]: audit 2024-09-16T06:43:26.974486+0000 mgr.a (mgr.14373) 2873 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:43:27.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:43:27 smithi086 bash[24289]: cluster 2024-09-16T06:43:26.456231+0000 mgr.a (mgr.14373) 2872 : cluster [DBG] pgmap v1992: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-16T06:43:27.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:43:27 smithi086 bash[24289]: audit 2024-09-16T06:43:26.951832+0000 mon.b (mon.2) 303 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T06:43:27.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:43:27 smithi086 bash[24289]: audit 2024-09-16T06:43:26.953984+0000 mon.b (mon.2) 304 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T06:43:27.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:43:27 smithi086 bash[24289]: audit 2024-09-16T06:43:26.965300+0000 mon.a (mon.0) 744 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:43:27.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:43:27 smithi086 bash[24289]: audit 2024-09-16T06:43:26.970893+0000 mon.b (mon.2) 305 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:43:27.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:43:27 smithi086 bash[24289]: audit 2024-09-16T06:43:26.974486+0000 mgr.a (mgr.14373) 2873 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:43:27.839 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 06:43:27 smithi047 bash[22994]: debug 2024-09-16T06:43:27.693+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T06:43:27.839 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 06:43:27 smithi047 bash[22994]: debug 2024-09-16T06:43:27.693+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T06:43:27.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:43:27 smithi047 bash[22744]: cluster 2024-09-16T06:43:26.456231+0000 mgr.a (mgr.14373) 2872 : cluster [DBG] pgmap v1992: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-16T06:43:27.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:43:27 smithi047 bash[22744]: audit 2024-09-16T06:43:26.951832+0000 mon.b (mon.2) 303 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T06:43:27.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:43:27 smithi047 bash[22744]: audit 2024-09-16T06:43:26.953984+0000 mon.b (mon.2) 304 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T06:43:27.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:43:27 smithi047 bash[22744]: audit 2024-09-16T06:43:26.965300+0000 mon.a (mon.0) 744 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:43:27.840 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:43:27 smithi047 bash[22744]: audit 2024-09-16T06:43:26.970893+0000 mon.b (mon.2) 305 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:43:27.840 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:43:27 smithi047 bash[22744]: audit 2024-09-16T06:43:26.974486+0000 mgr.a (mgr.14373) 2873 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:43:28.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:43:28 smithi157 bash[24585]: audit 2024-09-16T06:43:27.695351+0000 mgr.a (mgr.14373) 2874 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T06:43:28.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:43:28 smithi157 bash[24585]: cephadm 2024-09-16T06:43:27.696938+0000 mgr.a (mgr.14373) 2875 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T06:43:28.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:43:28 smithi086 bash[24289]: audit 2024-09-16T06:43:27.695351+0000 mgr.a (mgr.14373) 2874 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T06:43:28.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:43:28 smithi086 bash[24289]: cephadm 2024-09-16T06:43:27.696938+0000 mgr.a (mgr.14373) 2875 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T06:43:28.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:43:28 smithi047 bash[22744]: audit 2024-09-16T06:43:27.695351+0000 mgr.a (mgr.14373) 2874 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T06:43:28.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:43:28 smithi047 bash[22744]: cephadm 2024-09-16T06:43:27.696938+0000 mgr.a (mgr.14373) 2875 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T06:43:29.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:43:29 smithi157 bash[24585]: cluster 2024-09-16T06:43:28.457877+0000 mgr.a (mgr.14373) 2876 : cluster [DBG] pgmap v1993: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.4 KiB/s rd, 2 op/s 2024-09-16T06:43:29.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:43:29 smithi086 bash[24289]: cluster 2024-09-16T06:43:28.457877+0000 mgr.a (mgr.14373) 2876 : cluster [DBG] pgmap v1993: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.4 KiB/s rd, 2 op/s 2024-09-16T06:43:29.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:43:29 smithi047 bash[22744]: cluster 2024-09-16T06:43:28.457877+0000 mgr.a (mgr.14373) 2876 : cluster [DBG] pgmap v1993: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.4 KiB/s rd, 2 op/s 2024-09-16T06:43:30.923 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:43:30.923 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:43:30.924 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:43:31.691 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:43:31.691 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:43:31.691 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:43:31.691 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:43:31.691 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:43:31.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:43:31 smithi157 bash[24585]: cluster 2024-09-16T06:43:30.458666+0000 mgr.a (mgr.14373) 2877 : cluster [DBG] pgmap v1994: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:43:31.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:43:31 smithi086 bash[24289]: cluster 2024-09-16T06:43:30.458666+0000 mgr.a (mgr.14373) 2877 : cluster [DBG] pgmap v1994: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:43:31.841 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:43:31 smithi047 bash[22744]: cluster 2024-09-16T06:43:30.458666+0000 mgr.a (mgr.14373) 2877 : cluster [DBG] pgmap v1994: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:43:32.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:43:32 smithi157 bash[24585]: audit 2024-09-16T06:43:31.260585+0000 mgr.a (mgr.14373) 2878 : audit [DBG] from='client.73758 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:43:32.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:43:32 smithi086 bash[24289]: audit 2024-09-16T06:43:31.260585+0000 mgr.a (mgr.14373) 2878 : audit [DBG] from='client.73758 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:43:32.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:43:32 smithi047 bash[22744]: audit 2024-09-16T06:43:31.260585+0000 mgr.a (mgr.14373) 2878 : audit [DBG] from='client.73758 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:43:33.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:43:33 smithi157 bash[24585]: cluster 2024-09-16T06:43:32.461052+0000 mgr.a (mgr.14373) 2879 : cluster [DBG] pgmap v1995: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:43:33.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:43:33 smithi086 bash[24289]: cluster 2024-09-16T06:43:32.461052+0000 mgr.a (mgr.14373) 2879 : cluster [DBG] pgmap v1995: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:43:33.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:43:33 smithi047 bash[22744]: cluster 2024-09-16T06:43:32.461052+0000 mgr.a (mgr.14373) 2879 : cluster [DBG] pgmap v1995: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:43:35.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:43:35 smithi157 bash[24585]: cluster 2024-09-16T06:43:34.461805+0000 mgr.a (mgr.14373) 2880 : cluster [DBG] pgmap v1996: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T06:43:35.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:43:35 smithi086 bash[24289]: cluster 2024-09-16T06:43:34.461805+0000 mgr.a (mgr.14373) 2880 : cluster [DBG] pgmap v1996: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T06:43:35.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:43:35 smithi047 bash[22744]: cluster 2024-09-16T06:43:34.461805+0000 mgr.a (mgr.14373) 2880 : cluster [DBG] pgmap v1996: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T06:43:36.692 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:43:36.693 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:43:36.693 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:43:37.425 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:43:37.425 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:43:37.425 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:43:37.425 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:43:37.425 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:43:37.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:43:37 smithi157 bash[24585]: cluster 2024-09-16T06:43:36.463409+0000 mgr.a (mgr.14373) 2881 : cluster [DBG] pgmap v1997: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T06:43:37.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:43:37 smithi157 bash[24585]: audit 2024-09-16T06:43:37.024898+0000 mgr.a (mgr.14373) 2882 : audit [DBG] from='client.73833 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:43:37.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:43:37 smithi086 bash[24289]: cluster 2024-09-16T06:43:36.463409+0000 mgr.a (mgr.14373) 2881 : cluster [DBG] pgmap v1997: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T06:43:37.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:43:37 smithi086 bash[24289]: audit 2024-09-16T06:43:37.024898+0000 mgr.a (mgr.14373) 2882 : audit [DBG] from='client.73833 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:43:37.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:43:37 smithi047 bash[22744]: cluster 2024-09-16T06:43:36.463409+0000 mgr.a (mgr.14373) 2881 : cluster [DBG] pgmap v1997: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T06:43:37.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:43:37 smithi047 bash[22744]: audit 2024-09-16T06:43:37.024898+0000 mgr.a (mgr.14373) 2882 : audit [DBG] from='client.73833 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:43:39.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:43:39 smithi086 bash[24289]: cluster 2024-09-16T06:43:38.465069+0000 mgr.a (mgr.14373) 2883 : cluster [DBG] pgmap v1998: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T06:43:39.840 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:43:39 smithi047 bash[22744]: cluster 2024-09-16T06:43:38.465069+0000 mgr.a (mgr.14373) 2883 : cluster [DBG] pgmap v1998: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T06:43:40.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:43:39 smithi157 bash[24585]: cluster 2024-09-16T06:43:38.465069+0000 mgr.a (mgr.14373) 2883 : cluster [DBG] pgmap v1998: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T06:43:41.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:43:41 smithi086 bash[24289]: cluster 2024-09-16T06:43:40.465860+0000 mgr.a (mgr.14373) 2884 : cluster [DBG] pgmap v1999: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T06:43:41.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:43:41 smithi047 bash[22744]: cluster 2024-09-16T06:43:40.465860+0000 mgr.a (mgr.14373) 2884 : cluster [DBG] pgmap v1999: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T06:43:42.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:43:41 smithi157 bash[24585]: cluster 2024-09-16T06:43:40.465860+0000 mgr.a (mgr.14373) 2884 : cluster [DBG] pgmap v1999: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T06:43:42.426 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:43:42.427 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:43:42.427 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:43:43.176 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:43:43.177 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:43:43.177 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:43:43.177 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:43:43.177 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:43:43.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:43:43 smithi086 bash[24289]: cluster 2024-09-16T06:43:42.467296+0000 mgr.a (mgr.14373) 2885 : cluster [DBG] pgmap v2000: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:43:43.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:43:43 smithi086 bash[24289]: audit 2024-09-16T06:43:42.770091+0000 mgr.a (mgr.14373) 2886 : audit [DBG] from='client.73908 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:43:43.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:43:43 smithi047 bash[22744]: cluster 2024-09-16T06:43:42.467296+0000 mgr.a (mgr.14373) 2885 : cluster [DBG] pgmap v2000: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:43:43.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:43:43 smithi047 bash[22744]: audit 2024-09-16T06:43:42.770091+0000 mgr.a (mgr.14373) 2886 : audit [DBG] from='client.73908 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:43:44.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:43:43 smithi157 bash[24585]: cluster 2024-09-16T06:43:42.467296+0000 mgr.a (mgr.14373) 2885 : cluster [DBG] pgmap v2000: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:43:44.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:43:43 smithi157 bash[24585]: audit 2024-09-16T06:43:42.770091+0000 mgr.a (mgr.14373) 2886 : audit [DBG] from='client.73908 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:43:45.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:43:45 smithi047 bash[22744]: cluster 2024-09-16T06:43:44.468165+0000 mgr.a (mgr.14373) 2887 : cluster [DBG] pgmap v2001: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-16T06:43:46.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:43:45 smithi157 bash[24585]: cluster 2024-09-16T06:43:44.468165+0000 mgr.a (mgr.14373) 2887 : cluster [DBG] pgmap v2001: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-16T06:43:46.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:43:45 smithi086 bash[24289]: cluster 2024-09-16T06:43:44.468165+0000 mgr.a (mgr.14373) 2887 : cluster [DBG] pgmap v2001: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-16T06:43:47.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:43:47 smithi047 bash[22744]: cluster 2024-09-16T06:43:46.469924+0000 mgr.a (mgr.14373) 2888 : cluster [DBG] pgmap v2002: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-16T06:43:48.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:43:47 smithi157 bash[24585]: cluster 2024-09-16T06:43:46.469924+0000 mgr.a (mgr.14373) 2888 : cluster [DBG] pgmap v2002: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-16T06:43:48.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:43:47 smithi086 bash[24289]: cluster 2024-09-16T06:43:46.469924+0000 mgr.a (mgr.14373) 2888 : cluster [DBG] pgmap v2002: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-16T06:43:48.178 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:43:48.179 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:43:48.179 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:43:48.940 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:43:48.940 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:43:48.940 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:43:48.940 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:43:48.940 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:43:49.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:43:49 smithi047 bash[22744]: cluster 2024-09-16T06:43:48.471221+0000 mgr.a (mgr.14373) 2889 : cluster [DBG] pgmap v2003: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-16T06:43:49.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:43:49 smithi047 bash[22744]: audit 2024-09-16T06:43:48.510171+0000 mgr.a (mgr.14373) 2890 : audit [DBG] from='client.73983 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:43:50.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:43:49 smithi157 bash[24585]: cluster 2024-09-16T06:43:48.471221+0000 mgr.a (mgr.14373) 2889 : cluster [DBG] pgmap v2003: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-16T06:43:50.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:43:49 smithi157 bash[24585]: audit 2024-09-16T06:43:48.510171+0000 mgr.a (mgr.14373) 2890 : audit [DBG] from='client.73983 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:43:50.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:43:49 smithi086 bash[24289]: cluster 2024-09-16T06:43:48.471221+0000 mgr.a (mgr.14373) 2889 : cluster [DBG] pgmap v2003: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-16T06:43:50.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:43:49 smithi086 bash[24289]: audit 2024-09-16T06:43:48.510171+0000 mgr.a (mgr.14373) 2890 : audit [DBG] from='client.73983 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:43:52.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:43:51 smithi157 bash[24585]: cluster 2024-09-16T06:43:50.472147+0000 mgr.a (mgr.14373) 2891 : cluster [DBG] pgmap v2004: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:43:52.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:43:51 smithi086 bash[24289]: cluster 2024-09-16T06:43:50.472147+0000 mgr.a (mgr.14373) 2891 : cluster [DBG] pgmap v2004: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:43:52.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:43:51 smithi047 bash[22744]: cluster 2024-09-16T06:43:50.472147+0000 mgr.a (mgr.14373) 2891 : cluster [DBG] pgmap v2004: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:43:53.941 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:43:53.942 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:43:53.942 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:43:54.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:43:53 smithi157 bash[24585]: cluster 2024-09-16T06:43:52.474401+0000 mgr.a (mgr.14373) 2892 : cluster [DBG] pgmap v2005: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:43:54.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:43:53 smithi086 bash[24289]: cluster 2024-09-16T06:43:52.474401+0000 mgr.a (mgr.14373) 2892 : cluster [DBG] pgmap v2005: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:43:54.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:43:53 smithi047 bash[22744]: cluster 2024-09-16T06:43:52.474401+0000 mgr.a (mgr.14373) 2892 : cluster [DBG] pgmap v2005: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:43:54.726 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:43:54.727 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:43:54.727 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:43:54.727 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:43:54.727 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:43:56.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:43:55 smithi157 bash[24585]: audit 2024-09-16T06:43:54.281303+0000 mgr.a (mgr.14373) 2893 : audit [DBG] from='client.74058 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:43:56.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:43:55 smithi157 bash[24585]: cluster 2024-09-16T06:43:54.475122+0000 mgr.a (mgr.14373) 2894 : cluster [DBG] pgmap v2006: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:43:56.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:43:55 smithi086 bash[24289]: audit 2024-09-16T06:43:54.281303+0000 mgr.a (mgr.14373) 2893 : audit [DBG] from='client.74058 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:43:56.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:43:55 smithi086 bash[24289]: cluster 2024-09-16T06:43:54.475122+0000 mgr.a (mgr.14373) 2894 : cluster [DBG] pgmap v2006: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:43:56.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:43:55 smithi047 bash[22744]: audit 2024-09-16T06:43:54.281303+0000 mgr.a (mgr.14373) 2893 : audit [DBG] from='client.74058 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:43:56.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:43:55 smithi047 bash[22744]: cluster 2024-09-16T06:43:54.475122+0000 mgr.a (mgr.14373) 2894 : cluster [DBG] pgmap v2006: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:43:58.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:43:57 smithi157 bash[24585]: cluster 2024-09-16T06:43:56.476990+0000 mgr.a (mgr.14373) 2895 : cluster [DBG] pgmap v2007: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-16T06:43:58.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:43:57 smithi086 bash[24289]: cluster 2024-09-16T06:43:56.476990+0000 mgr.a (mgr.14373) 2895 : cluster [DBG] pgmap v2007: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-16T06:43:58.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:43:57 smithi047 bash[22744]: cluster 2024-09-16T06:43:56.476990+0000 mgr.a (mgr.14373) 2895 : cluster [DBG] pgmap v2007: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-16T06:43:59.728 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:43:59.729 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:43:59.729 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:44:00.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:43:59 smithi157 bash[24585]: cluster 2024-09-16T06:43:58.478219+0000 mgr.a (mgr.14373) 2896 : cluster [DBG] pgmap v2008: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.4 KiB/s rd, 2 op/s 2024-09-16T06:44:00.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:43:59 smithi086 bash[24289]: cluster 2024-09-16T06:43:58.478219+0000 mgr.a (mgr.14373) 2896 : cluster [DBG] pgmap v2008: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.4 KiB/s rd, 2 op/s 2024-09-16T06:44:00.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:43:59 smithi047 bash[22744]: cluster 2024-09-16T06:43:58.478219+0000 mgr.a (mgr.14373) 2896 : cluster [DBG] pgmap v2008: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.4 KiB/s rd, 2 op/s 2024-09-16T06:44:00.489 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:44:00.490 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:44:00.490 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:44:00.490 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:44:00.490 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:44:01.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:44:00 smithi157 bash[24585]: audit 2024-09-16T06:44:00.066765+0000 mgr.a (mgr.14373) 2897 : audit [DBG] from='client.74133 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:44:01.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:44:00 smithi086 bash[24289]: audit 2024-09-16T06:44:00.066765+0000 mgr.a (mgr.14373) 2897 : audit [DBG] from='client.74133 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:44:01.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:44:00 smithi047 bash[22744]: audit 2024-09-16T06:44:00.066765+0000 mgr.a (mgr.14373) 2897 : audit [DBG] from='client.74133 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:44:02.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:44:01 smithi157 bash[24585]: cluster 2024-09-16T06:44:00.478726+0000 mgr.a (mgr.14373) 2898 : cluster [DBG] pgmap v2009: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:44:02.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:44:01 smithi086 bash[24289]: cluster 2024-09-16T06:44:00.478726+0000 mgr.a (mgr.14373) 2898 : cluster [DBG] pgmap v2009: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:44:02.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:44:01 smithi047 bash[22744]: cluster 2024-09-16T06:44:00.478726+0000 mgr.a (mgr.14373) 2898 : cluster [DBG] pgmap v2009: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:44:04.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:44:03 smithi157 bash[24585]: cluster 2024-09-16T06:44:02.480892+0000 mgr.a (mgr.14373) 2899 : cluster [DBG] pgmap v2010: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:44:04.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:44:03 smithi086 bash[24289]: cluster 2024-09-16T06:44:02.480892+0000 mgr.a (mgr.14373) 2899 : cluster [DBG] pgmap v2010: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:44:04.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:44:03 smithi047 bash[22744]: cluster 2024-09-16T06:44:02.480892+0000 mgr.a (mgr.14373) 2899 : cluster [DBG] pgmap v2010: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:44:05.491 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:44:05.492 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:44:05.492 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:44:06.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:44:05 smithi157 bash[24585]: cluster 2024-09-16T06:44:04.481644+0000 mgr.a (mgr.14373) 2900 : cluster [DBG] pgmap v2011: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:44:06.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:44:05 smithi086 bash[24289]: cluster 2024-09-16T06:44:04.481644+0000 mgr.a (mgr.14373) 2900 : cluster [DBG] pgmap v2011: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:44:06.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:44:05 smithi047 bash[22744]: cluster 2024-09-16T06:44:04.481644+0000 mgr.a (mgr.14373) 2900 : cluster [DBG] pgmap v2011: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:44:06.267 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:44:06.267 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:44:06.267 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:44:06.267 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:44:06.267 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:44:07.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:44:06 smithi157 bash[24585]: audit 2024-09-16T06:44:05.830740+0000 mgr.a (mgr.14373) 2901 : audit [DBG] from='client.74211 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:44:07.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:44:06 smithi086 bash[24289]: audit 2024-09-16T06:44:05.830740+0000 mgr.a (mgr.14373) 2901 : audit [DBG] from='client.74211 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:44:07.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:44:06 smithi047 bash[22744]: audit 2024-09-16T06:44:05.830740+0000 mgr.a (mgr.14373) 2901 : audit [DBG] from='client.74211 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:44:08.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:44:07 smithi157 bash[24585]: cluster 2024-09-16T06:44:06.483550+0000 mgr.a (mgr.14373) 2902 : cluster [DBG] pgmap v2012: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-16T06:44:08.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:44:07 smithi086 bash[24289]: cluster 2024-09-16T06:44:06.483550+0000 mgr.a (mgr.14373) 2902 : cluster [DBG] pgmap v2012: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-16T06:44:08.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:44:07 smithi047 bash[22744]: cluster 2024-09-16T06:44:06.483550+0000 mgr.a (mgr.14373) 2902 : cluster [DBG] pgmap v2012: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-16T06:44:10.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:44:09 smithi157 bash[24585]: cluster 2024-09-16T06:44:08.484782+0000 mgr.a (mgr.14373) 2903 : cluster [DBG] pgmap v2013: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.4 KiB/s rd, 2 op/s 2024-09-16T06:44:10.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:44:09 smithi086 bash[24289]: cluster 2024-09-16T06:44:08.484782+0000 mgr.a (mgr.14373) 2903 : cluster [DBG] pgmap v2013: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.4 KiB/s rd, 2 op/s 2024-09-16T06:44:10.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:44:09 smithi047 bash[22744]: cluster 2024-09-16T06:44:08.484782+0000 mgr.a (mgr.14373) 2903 : cluster [DBG] pgmap v2013: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.4 KiB/s rd, 2 op/s 2024-09-16T06:44:11.269 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:44:11.269 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:44:11.269 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:44:12.018 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:44:12.018 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:44:12.018 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:44:12.018 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:44:12.018 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:44:12.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:44:11 smithi157 bash[24585]: cluster 2024-09-16T06:44:10.485549+0000 mgr.a (mgr.14373) 2904 : cluster [DBG] pgmap v2014: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:44:12.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:44:11 smithi086 bash[24289]: cluster 2024-09-16T06:44:10.485549+0000 mgr.a (mgr.14373) 2904 : cluster [DBG] pgmap v2014: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:44:12.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:44:11 smithi047 bash[22744]: cluster 2024-09-16T06:44:10.485549+0000 mgr.a (mgr.14373) 2904 : cluster [DBG] pgmap v2014: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:44:13.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:44:12 smithi157 bash[24585]: audit 2024-09-16T06:44:11.607495+0000 mgr.a (mgr.14373) 2905 : audit [DBG] from='client.74286 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:44:13.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:44:12 smithi086 bash[24289]: audit 2024-09-16T06:44:11.607495+0000 mgr.a (mgr.14373) 2905 : audit [DBG] from='client.74286 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:44:13.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:44:12 smithi047 bash[22744]: audit 2024-09-16T06:44:11.607495+0000 mgr.a (mgr.14373) 2905 : audit [DBG] from='client.74286 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:44:14.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:44:13 smithi157 bash[24585]: cluster 2024-09-16T06:44:12.488228+0000 mgr.a (mgr.14373) 2906 : cluster [DBG] pgmap v2015: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:44:14.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:44:13 smithi086 bash[24289]: cluster 2024-09-16T06:44:12.488228+0000 mgr.a (mgr.14373) 2906 : cluster [DBG] pgmap v2015: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:44:14.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:44:13 smithi047 bash[22744]: cluster 2024-09-16T06:44:12.488228+0000 mgr.a (mgr.14373) 2906 : cluster [DBG] pgmap v2015: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:44:16.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:44:15 smithi157 bash[24585]: cluster 2024-09-16T06:44:14.489114+0000 mgr.a (mgr.14373) 2907 : cluster [DBG] pgmap v2016: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:44:16.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:44:15 smithi086 bash[24289]: cluster 2024-09-16T06:44:14.489114+0000 mgr.a (mgr.14373) 2907 : cluster [DBG] pgmap v2016: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:44:16.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:44:15 smithi047 bash[22744]: cluster 2024-09-16T06:44:14.489114+0000 mgr.a (mgr.14373) 2907 : cluster [DBG] pgmap v2016: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:44:17.019 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:44:17.020 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:44:17.020 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:44:17.794 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:44:17.794 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:44:17.794 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:44:17.794 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:44:17.794 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:44:18.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:44:17 smithi157 bash[24585]: cluster 2024-09-16T06:44:16.490875+0000 mgr.a (mgr.14373) 2908 : cluster [DBG] pgmap v2017: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T06:44:18.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:44:17 smithi086 bash[24289]: cluster 2024-09-16T06:44:16.490875+0000 mgr.a (mgr.14373) 2908 : cluster [DBG] pgmap v2017: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T06:44:18.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:44:17 smithi047 bash[22744]: cluster 2024-09-16T06:44:16.490875+0000 mgr.a (mgr.14373) 2908 : cluster [DBG] pgmap v2017: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T06:44:19.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:44:18 smithi157 bash[24585]: audit 2024-09-16T06:44:17.357822+0000 mgr.a (mgr.14373) 2909 : audit [DBG] from='client.74358 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:44:19.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:44:18 smithi086 bash[24289]: audit 2024-09-16T06:44:17.357822+0000 mgr.a (mgr.14373) 2909 : audit [DBG] from='client.74358 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:44:19.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:44:18 smithi047 bash[22744]: audit 2024-09-16T06:44:17.357822+0000 mgr.a (mgr.14373) 2909 : audit [DBG] from='client.74358 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:44:20.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:44:19 smithi157 bash[24585]: cluster 2024-09-16T06:44:18.492533+0000 mgr.a (mgr.14373) 2910 : cluster [DBG] pgmap v2018: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-09-16T06:44:20.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:44:19 smithi086 bash[24289]: cluster 2024-09-16T06:44:18.492533+0000 mgr.a (mgr.14373) 2910 : cluster [DBG] pgmap v2018: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-09-16T06:44:20.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:44:19 smithi047 bash[22744]: cluster 2024-09-16T06:44:18.492533+0000 mgr.a (mgr.14373) 2910 : cluster [DBG] pgmap v2018: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-09-16T06:44:22.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:44:21 smithi157 bash[24585]: cluster 2024-09-16T06:44:20.493298+0000 mgr.a (mgr.14373) 2911 : cluster [DBG] pgmap v2019: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:44:22.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:44:21 smithi086 bash[24289]: cluster 2024-09-16T06:44:20.493298+0000 mgr.a (mgr.14373) 2911 : cluster [DBG] pgmap v2019: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:44:22.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:44:21 smithi047 bash[22744]: cluster 2024-09-16T06:44:20.493298+0000 mgr.a (mgr.14373) 2911 : cluster [DBG] pgmap v2019: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:44:22.795 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:44:22.796 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:44:22.796 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:44:23.565 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:44:23.565 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:44:23.566 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:44:23.566 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:44:23.566 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:44:24.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:44:23 smithi157 bash[24585]: cluster 2024-09-16T06:44:22.495383+0000 mgr.a (mgr.14373) 2912 : cluster [DBG] pgmap v2020: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:44:24.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:44:23 smithi157 bash[24585]: audit 2024-09-16T06:44:23.134118+0000 mgr.a (mgr.14373) 2913 : audit [DBG] from='client.74430 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:44:24.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:44:23 smithi086 bash[24289]: cluster 2024-09-16T06:44:22.495383+0000 mgr.a (mgr.14373) 2912 : cluster [DBG] pgmap v2020: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:44:24.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:44:23 smithi086 bash[24289]: audit 2024-09-16T06:44:23.134118+0000 mgr.a (mgr.14373) 2913 : audit [DBG] from='client.74430 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:44:24.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:44:23 smithi047 bash[22744]: cluster 2024-09-16T06:44:22.495383+0000 mgr.a (mgr.14373) 2912 : cluster [DBG] pgmap v2020: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:44:24.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:44:23 smithi047 bash[22744]: audit 2024-09-16T06:44:23.134118+0000 mgr.a (mgr.14373) 2913 : audit [DBG] from='client.74430 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:44:26.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:44:25 smithi157 bash[24585]: cluster 2024-09-16T06:44:24.496412+0000 mgr.a (mgr.14373) 2914 : cluster [DBG] pgmap v2021: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:44:26.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:44:25 smithi086 bash[24289]: cluster 2024-09-16T06:44:24.496412+0000 mgr.a (mgr.14373) 2914 : cluster [DBG] pgmap v2021: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:44:26.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:44:25 smithi047 bash[22744]: cluster 2024-09-16T06:44:24.496412+0000 mgr.a (mgr.14373) 2914 : cluster [DBG] pgmap v2021: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:44:28.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:44:27 smithi157 bash[24585]: cluster 2024-09-16T06:44:26.498339+0000 mgr.a (mgr.14373) 2915 : cluster [DBG] pgmap v2022: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-16T06:44:28.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:44:27 smithi086 bash[24289]: cluster 2024-09-16T06:44:26.498339+0000 mgr.a (mgr.14373) 2915 : cluster [DBG] pgmap v2022: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-16T06:44:28.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:44:27 smithi047 bash[22744]: cluster 2024-09-16T06:44:26.498339+0000 mgr.a (mgr.14373) 2915 : cluster [DBG] pgmap v2022: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-16T06:44:28.566 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:44:28.567 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:44:28.567 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:44:29.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:44:28 smithi157 bash[24585]: audit 2024-09-16T06:44:27.744328+0000 mon.b (mon.2) 306 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T06:44:29.055 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:44:28 smithi157 bash[24585]: audit 2024-09-16T06:44:28.590629+0000 mon.b (mon.2) 307 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T06:44:29.055 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:44:28 smithi157 bash[24585]: audit 2024-09-16T06:44:28.592340+0000 mon.b (mon.2) 308 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T06:44:29.055 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:44:28 smithi157 bash[24585]: audit 2024-09-16T06:44:28.602827+0000 mon.a (mon.0) 745 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:44:29.055 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:44:28 smithi157 bash[24585]: audit 2024-09-16T06:44:28.605012+0000 mon.b (mon.2) 309 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:44:29.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:44:28 smithi086 bash[24289]: audit 2024-09-16T06:44:27.744328+0000 mon.b (mon.2) 306 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T06:44:29.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:44:28 smithi086 bash[24289]: audit 2024-09-16T06:44:28.590629+0000 mon.b (mon.2) 307 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T06:44:29.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:44:28 smithi086 bash[24289]: audit 2024-09-16T06:44:28.592340+0000 mon.b (mon.2) 308 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T06:44:29.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:44:28 smithi086 bash[24289]: audit 2024-09-16T06:44:28.602827+0000 mon.a (mon.0) 745 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:44:29.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:44:28 smithi086 bash[24289]: audit 2024-09-16T06:44:28.605012+0000 mon.b (mon.2) 309 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:44:29.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:44:28 smithi047 bash[22744]: audit 2024-09-16T06:44:27.744328+0000 mon.b (mon.2) 306 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T06:44:29.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:44:28 smithi047 bash[22744]: audit 2024-09-16T06:44:28.590629+0000 mon.b (mon.2) 307 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T06:44:29.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:44:28 smithi047 bash[22744]: audit 2024-09-16T06:44:28.592340+0000 mon.b (mon.2) 308 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T06:44:29.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:44:28 smithi047 bash[22744]: audit 2024-09-16T06:44:28.602827+0000 mon.a (mon.0) 745 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:44:29.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:44:28 smithi047 bash[22744]: audit 2024-09-16T06:44:28.605012+0000 mon.b (mon.2) 309 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:44:29.588 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 06:44:29 smithi047 bash[22994]: debug 2024-09-16T06:44:29.328+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T06:44:29.589 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 06:44:29 smithi047 bash[22994]: debug 2024-09-16T06:44:29.340+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T06:44:29.733 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:44:29.734 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:44:29.734 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:44:29.734 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:44:29.734 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:44:30.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:44:29 smithi157 bash[24585]: cluster 2024-09-16T06:44:28.499561+0000 mgr.a (mgr.14373) 2916 : cluster [DBG] pgmap v2023: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.4 KiB/s rd, 2 op/s 2024-09-16T06:44:30.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:44:29 smithi157 bash[24585]: audit 2024-09-16T06:44:28.608386+0000 mgr.a (mgr.14373) 2917 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:44:30.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:44:29 smithi157 bash[24585]: audit 2024-09-16T06:44:28.913003+0000 mgr.a (mgr.14373) 2918 : audit [DBG] from='client.74508 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:44:30.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:44:29 smithi086 bash[24289]: cluster 2024-09-16T06:44:28.499561+0000 mgr.a (mgr.14373) 2916 : cluster [DBG] pgmap v2023: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.4 KiB/s rd, 2 op/s 2024-09-16T06:44:30.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:44:29 smithi086 bash[24289]: audit 2024-09-16T06:44:28.608386+0000 mgr.a (mgr.14373) 2917 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:44:30.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:44:29 smithi086 bash[24289]: audit 2024-09-16T06:44:28.913003+0000 mgr.a (mgr.14373) 2918 : audit [DBG] from='client.74508 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:44:30.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:44:29 smithi047 bash[22744]: cluster 2024-09-16T06:44:28.499561+0000 mgr.a (mgr.14373) 2916 : cluster [DBG] pgmap v2023: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.4 KiB/s rd, 2 op/s 2024-09-16T06:44:30.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:44:29 smithi047 bash[22744]: audit 2024-09-16T06:44:28.608386+0000 mgr.a (mgr.14373) 2917 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:44:30.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:44:29 smithi047 bash[22744]: audit 2024-09-16T06:44:28.913003+0000 mgr.a (mgr.14373) 2918 : audit [DBG] from='client.74508 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:44:31.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:44:30 smithi157 bash[24585]: audit 2024-09-16T06:44:29.332405+0000 mgr.a (mgr.14373) 2919 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T06:44:31.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:44:30 smithi157 bash[24585]: cephadm 2024-09-16T06:44:29.345975+0000 mgr.a (mgr.14373) 2920 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T06:44:31.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:44:30 smithi086 bash[24289]: audit 2024-09-16T06:44:29.332405+0000 mgr.a (mgr.14373) 2919 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T06:44:31.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:44:30 smithi086 bash[24289]: cephadm 2024-09-16T06:44:29.345975+0000 mgr.a (mgr.14373) 2920 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T06:44:31.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:44:30 smithi047 bash[22744]: audit 2024-09-16T06:44:29.332405+0000 mgr.a (mgr.14373) 2919 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T06:44:31.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:44:30 smithi047 bash[22744]: cephadm 2024-09-16T06:44:29.345975+0000 mgr.a (mgr.14373) 2920 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T06:44:32.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:44:31 smithi157 bash[24585]: cluster 2024-09-16T06:44:30.500452+0000 mgr.a (mgr.14373) 2921 : cluster [DBG] pgmap v2024: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:44:32.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:44:31 smithi086 bash[24289]: cluster 2024-09-16T06:44:30.500452+0000 mgr.a (mgr.14373) 2921 : cluster [DBG] pgmap v2024: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:44:32.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:44:31 smithi047 bash[22744]: cluster 2024-09-16T06:44:30.500452+0000 mgr.a (mgr.14373) 2921 : cluster [DBG] pgmap v2024: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:44:34.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:44:33 smithi157 bash[24585]: cluster 2024-09-16T06:44:32.502675+0000 mgr.a (mgr.14373) 2922 : cluster [DBG] pgmap v2025: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:44:34.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:44:33 smithi086 bash[24289]: cluster 2024-09-16T06:44:32.502675+0000 mgr.a (mgr.14373) 2922 : cluster [DBG] pgmap v2025: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:44:34.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:44:33 smithi047 bash[22744]: cluster 2024-09-16T06:44:32.502675+0000 mgr.a (mgr.14373) 2922 : cluster [DBG] pgmap v2025: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:44:34.735 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:44:34.736 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:44:34.736 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:44:35.522 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:44:35.523 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:44:35.523 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:44:35.523 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:44:35.523 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:44:36.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:44:35 smithi157 bash[24585]: cluster 2024-09-16T06:44:34.503424+0000 mgr.a (mgr.14373) 2923 : cluster [DBG] pgmap v2026: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:44:36.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:44:35 smithi157 bash[24585]: audit 2024-09-16T06:44:35.074042+0000 mgr.a (mgr.14373) 2924 : audit [DBG] from='client.74685 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:44:36.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:44:35 smithi086 bash[24289]: cluster 2024-09-16T06:44:34.503424+0000 mgr.a (mgr.14373) 2923 : cluster [DBG] pgmap v2026: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:44:36.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:44:35 smithi086 bash[24289]: audit 2024-09-16T06:44:35.074042+0000 mgr.a (mgr.14373) 2924 : audit [DBG] from='client.74685 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:44:36.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:44:35 smithi047 bash[22744]: cluster 2024-09-16T06:44:34.503424+0000 mgr.a (mgr.14373) 2923 : cluster [DBG] pgmap v2026: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:44:36.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:44:35 smithi047 bash[22744]: audit 2024-09-16T06:44:35.074042+0000 mgr.a (mgr.14373) 2924 : audit [DBG] from='client.74685 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:44:38.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:44:37 smithi157 bash[24585]: cluster 2024-09-16T06:44:36.505280+0000 mgr.a (mgr.14373) 2925 : cluster [DBG] pgmap v2027: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.3 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:44:38.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:44:37 smithi086 bash[24289]: cluster 2024-09-16T06:44:36.505280+0000 mgr.a (mgr.14373) 2925 : cluster [DBG] pgmap v2027: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.3 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:44:38.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:44:37 smithi047 bash[22744]: cluster 2024-09-16T06:44:36.505280+0000 mgr.a (mgr.14373) 2925 : cluster [DBG] pgmap v2027: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.3 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:44:40.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:44:39 smithi157 bash[24585]: cluster 2024-09-16T06:44:38.506532+0000 mgr.a (mgr.14373) 2926 : cluster [DBG] pgmap v2028: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.6 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:44:40.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:44:39 smithi086 bash[24289]: cluster 2024-09-16T06:44:38.506532+0000 mgr.a (mgr.14373) 2926 : cluster [DBG] pgmap v2028: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.6 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:44:40.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:44:39 smithi047 bash[22744]: cluster 2024-09-16T06:44:38.506532+0000 mgr.a (mgr.14373) 2926 : cluster [DBG] pgmap v2028: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.6 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:44:40.524 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:44:40.525 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:44:40.525 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:44:41.300 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:44:41.300 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:44:41.300 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:44:41.300 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:44:41.300 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:44:42.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:44:41 smithi157 bash[24585]: cluster 2024-09-16T06:44:40.507299+0000 mgr.a (mgr.14373) 2927 : cluster [DBG] pgmap v2029: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:44:42.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:44:41 smithi157 bash[24585]: audit 2024-09-16T06:44:40.863184+0000 mgr.a (mgr.14373) 2928 : audit [DBG] from='client.74763 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:44:42.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:44:41 smithi086 bash[24289]: cluster 2024-09-16T06:44:40.507299+0000 mgr.a (mgr.14373) 2927 : cluster [DBG] pgmap v2029: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:44:42.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:44:41 smithi086 bash[24289]: audit 2024-09-16T06:44:40.863184+0000 mgr.a (mgr.14373) 2928 : audit [DBG] from='client.74763 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:44:42.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:44:41 smithi047 bash[22744]: cluster 2024-09-16T06:44:40.507299+0000 mgr.a (mgr.14373) 2927 : cluster [DBG] pgmap v2029: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:44:42.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:44:41 smithi047 bash[22744]: audit 2024-09-16T06:44:40.863184+0000 mgr.a (mgr.14373) 2928 : audit [DBG] from='client.74763 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:44:44.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:44:43 smithi157 bash[24585]: cluster 2024-09-16T06:44:42.509618+0000 mgr.a (mgr.14373) 2929 : cluster [DBG] pgmap v2030: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:44:44.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:44:43 smithi086 bash[24289]: cluster 2024-09-16T06:44:42.509618+0000 mgr.a (mgr.14373) 2929 : cluster [DBG] pgmap v2030: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:44:44.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:44:43 smithi047 bash[22744]: cluster 2024-09-16T06:44:42.509618+0000 mgr.a (mgr.14373) 2929 : cluster [DBG] pgmap v2030: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:44:46.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:44:45 smithi157 bash[24585]: cluster 2024-09-16T06:44:44.510448+0000 mgr.a (mgr.14373) 2930 : cluster [DBG] pgmap v2031: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:44:46.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:44:45 smithi086 bash[24289]: cluster 2024-09-16T06:44:44.510448+0000 mgr.a (mgr.14373) 2930 : cluster [DBG] pgmap v2031: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:44:46.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:44:45 smithi047 bash[22744]: cluster 2024-09-16T06:44:44.510448+0000 mgr.a (mgr.14373) 2930 : cluster [DBG] pgmap v2031: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:44:46.301 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:44:46.302 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:44:46.302 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:44:47.068 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:44:47.068 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:44:47.068 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:44:47.068 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:44:47.068 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:44:48.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:44:47 smithi157 bash[24585]: cluster 2024-09-16T06:44:46.512075+0000 mgr.a (mgr.14373) 2931 : cluster [DBG] pgmap v2032: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:44:48.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:44:47 smithi157 bash[24585]: audit 2024-09-16T06:44:46.642474+0000 mgr.a (mgr.14373) 2932 : audit [DBG] from='client.74841 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:44:48.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:44:47 smithi086 bash[24289]: cluster 2024-09-16T06:44:46.512075+0000 mgr.a (mgr.14373) 2931 : cluster [DBG] pgmap v2032: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:44:48.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:44:47 smithi086 bash[24289]: audit 2024-09-16T06:44:46.642474+0000 mgr.a (mgr.14373) 2932 : audit [DBG] from='client.74841 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:44:48.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:44:47 smithi047 bash[22744]: cluster 2024-09-16T06:44:46.512075+0000 mgr.a (mgr.14373) 2931 : cluster [DBG] pgmap v2032: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:44:48.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:44:47 smithi047 bash[22744]: audit 2024-09-16T06:44:46.642474+0000 mgr.a (mgr.14373) 2932 : audit [DBG] from='client.74841 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:44:50.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:44:49 smithi157 bash[24585]: cluster 2024-09-16T06:44:48.513753+0000 mgr.a (mgr.14373) 2933 : cluster [DBG] pgmap v2033: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-09-16T06:44:50.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:44:49 smithi086 bash[24289]: cluster 2024-09-16T06:44:48.513753+0000 mgr.a (mgr.14373) 2933 : cluster [DBG] pgmap v2033: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-09-16T06:44:50.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:44:49 smithi047 bash[22744]: cluster 2024-09-16T06:44:48.513753+0000 mgr.a (mgr.14373) 2933 : cluster [DBG] pgmap v2033: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-09-16T06:44:52.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:44:51 smithi157 bash[24585]: cluster 2024-09-16T06:44:50.514636+0000 mgr.a (mgr.14373) 2934 : cluster [DBG] pgmap v2034: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T06:44:52.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:44:51 smithi086 bash[24289]: cluster 2024-09-16T06:44:50.514636+0000 mgr.a (mgr.14373) 2934 : cluster [DBG] pgmap v2034: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T06:44:52.069 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:44:52.070 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:44:52.070 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:44:52.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:44:51 smithi047 bash[22744]: cluster 2024-09-16T06:44:50.514636+0000 mgr.a (mgr.14373) 2934 : cluster [DBG] pgmap v2034: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T06:44:52.827 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:44:52.827 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:44:52.827 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:44:52.827 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:44:52.827 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:44:54.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:44:53 smithi157 bash[24585]: audit 2024-09-16T06:44:52.402576+0000 mgr.a (mgr.14373) 2935 : audit [DBG] from='client.74919 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:44:54.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:44:53 smithi157 bash[24585]: cluster 2024-09-16T06:44:52.516044+0000 mgr.a (mgr.14373) 2936 : cluster [DBG] pgmap v2035: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:44:54.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:44:53 smithi086 bash[24289]: audit 2024-09-16T06:44:52.402576+0000 mgr.a (mgr.14373) 2935 : audit [DBG] from='client.74919 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:44:54.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:44:53 smithi086 bash[24289]: cluster 2024-09-16T06:44:52.516044+0000 mgr.a (mgr.14373) 2936 : cluster [DBG] pgmap v2035: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:44:54.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:44:53 smithi047 bash[22744]: audit 2024-09-16T06:44:52.402576+0000 mgr.a (mgr.14373) 2935 : audit [DBG] from='client.74919 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:44:54.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:44:53 smithi047 bash[22744]: cluster 2024-09-16T06:44:52.516044+0000 mgr.a (mgr.14373) 2936 : cluster [DBG] pgmap v2035: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:44:56.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:44:55 smithi157 bash[24585]: cluster 2024-09-16T06:44:54.516971+0000 mgr.a (mgr.14373) 2937 : cluster [DBG] pgmap v2036: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:44:56.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:44:55 smithi086 bash[24289]: cluster 2024-09-16T06:44:54.516971+0000 mgr.a (mgr.14373) 2937 : cluster [DBG] pgmap v2036: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:44:56.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:44:55 smithi047 bash[22744]: cluster 2024-09-16T06:44:54.516971+0000 mgr.a (mgr.14373) 2937 : cluster [DBG] pgmap v2036: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:44:57.828 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:44:57.829 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:44:57.829 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:44:58.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:44:57 smithi157 bash[24585]: cluster 2024-09-16T06:44:56.518763+0000 mgr.a (mgr.14373) 2938 : cluster [DBG] pgmap v2037: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T06:44:58.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:44:57 smithi086 bash[24289]: cluster 2024-09-16T06:44:56.518763+0000 mgr.a (mgr.14373) 2938 : cluster [DBG] pgmap v2037: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T06:44:58.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:44:57 smithi047 bash[22744]: cluster 2024-09-16T06:44:56.518763+0000 mgr.a (mgr.14373) 2938 : cluster [DBG] pgmap v2037: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T06:44:58.578 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:44:58.579 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:44:58.579 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:44:58.579 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:44:58.579 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:44:59.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:44:58 smithi157 bash[24585]: audit 2024-09-16T06:44:58.162197+0000 mgr.a (mgr.14373) 2939 : audit [DBG] from='client.74997 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:44:59.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:44:58 smithi086 bash[24289]: audit 2024-09-16T06:44:58.162197+0000 mgr.a (mgr.14373) 2939 : audit [DBG] from='client.74997 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:44:59.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:44:58 smithi047 bash[22744]: audit 2024-09-16T06:44:58.162197+0000 mgr.a (mgr.14373) 2939 : audit [DBG] from='client.74997 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:45:00.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:44:59 smithi157 bash[24585]: cluster 2024-09-16T06:44:58.519674+0000 mgr.a (mgr.14373) 2940 : cluster [DBG] pgmap v2038: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:45:00.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:44:59 smithi086 bash[24289]: cluster 2024-09-16T06:44:58.519674+0000 mgr.a (mgr.14373) 2940 : cluster [DBG] pgmap v2038: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:45:00.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:44:59 smithi047 bash[22744]: cluster 2024-09-16T06:44:58.519674+0000 mgr.a (mgr.14373) 2940 : cluster [DBG] pgmap v2038: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:45:02.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:45:01 smithi157 bash[24585]: cluster 2024-09-16T06:45:00.520416+0000 mgr.a (mgr.14373) 2941 : cluster [DBG] pgmap v2039: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:45:02.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:45:01 smithi086 bash[24289]: cluster 2024-09-16T06:45:00.520416+0000 mgr.a (mgr.14373) 2941 : cluster [DBG] pgmap v2039: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:45:02.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:45:01 smithi047 bash[22744]: cluster 2024-09-16T06:45:00.520416+0000 mgr.a (mgr.14373) 2941 : cluster [DBG] pgmap v2039: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:45:03.580 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:45:03.581 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:45:03.581 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:45:04.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:45:03 smithi157 bash[24585]: cluster 2024-09-16T06:45:02.522552+0000 mgr.a (mgr.14373) 2942 : cluster [DBG] pgmap v2040: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:45:04.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:45:03 smithi086 bash[24289]: cluster 2024-09-16T06:45:02.522552+0000 mgr.a (mgr.14373) 2942 : cluster [DBG] pgmap v2040: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:45:04.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:45:03 smithi047 bash[22744]: cluster 2024-09-16T06:45:02.522552+0000 mgr.a (mgr.14373) 2942 : cluster [DBG] pgmap v2040: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:45:04.362 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:45:04.362 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:45:04.363 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:45:04.363 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:45:04.363 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:45:05.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:45:04 smithi157 bash[24585]: audit 2024-09-16T06:45:03.921617+0000 mgr.a (mgr.14373) 2943 : audit [DBG] from='client.75075 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:45:05.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:45:04 smithi086 bash[24289]: audit 2024-09-16T06:45:03.921617+0000 mgr.a (mgr.14373) 2943 : audit [DBG] from='client.75075 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:45:05.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:45:04 smithi047 bash[22744]: audit 2024-09-16T06:45:03.921617+0000 mgr.a (mgr.14373) 2943 : audit [DBG] from='client.75075 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:45:06.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:45:05 smithi157 bash[24585]: cluster 2024-09-16T06:45:04.523626+0000 mgr.a (mgr.14373) 2944 : cluster [DBG] pgmap v2041: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:45:06.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:45:05 smithi086 bash[24289]: cluster 2024-09-16T06:45:04.523626+0000 mgr.a (mgr.14373) 2944 : cluster [DBG] pgmap v2041: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:45:06.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:45:05 smithi047 bash[22744]: cluster 2024-09-16T06:45:04.523626+0000 mgr.a (mgr.14373) 2944 : cluster [DBG] pgmap v2041: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:45:08.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:45:07 smithi157 bash[24585]: cluster 2024-09-16T06:45:06.525479+0000 mgr.a (mgr.14373) 2945 : cluster [DBG] pgmap v2042: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-16T06:45:08.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:45:07 smithi086 bash[24289]: cluster 2024-09-16T06:45:06.525479+0000 mgr.a (mgr.14373) 2945 : cluster [DBG] pgmap v2042: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-16T06:45:08.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:45:07 smithi047 bash[22744]: cluster 2024-09-16T06:45:06.525479+0000 mgr.a (mgr.14373) 2945 : cluster [DBG] pgmap v2042: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-16T06:45:09.364 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:45:09.365 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:45:09.365 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:45:10.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:45:09 smithi157 bash[24585]: cluster 2024-09-16T06:45:08.526722+0000 mgr.a (mgr.14373) 2946 : cluster [DBG] pgmap v2043: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.4 KiB/s rd, 2 op/s 2024-09-16T06:45:10.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:45:09 smithi086 bash[24289]: cluster 2024-09-16T06:45:08.526722+0000 mgr.a (mgr.14373) 2946 : cluster [DBG] pgmap v2043: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.4 KiB/s rd, 2 op/s 2024-09-16T06:45:10.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:45:09 smithi047 bash[22744]: cluster 2024-09-16T06:45:08.526722+0000 mgr.a (mgr.14373) 2946 : cluster [DBG] pgmap v2043: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.4 KiB/s rd, 2 op/s 2024-09-16T06:45:10.143 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:45:10.143 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:45:10.143 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:45:10.143 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:45:10.143 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:45:11.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:45:10 smithi086 bash[24289]: audit 2024-09-16T06:45:09.702014+0000 mgr.a (mgr.14373) 2947 : audit [DBG] from='client.75153 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:45:11.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:45:10 smithi047 bash[22744]: audit 2024-09-16T06:45:09.702014+0000 mgr.a (mgr.14373) 2947 : audit [DBG] from='client.75153 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:45:11.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:45:10 smithi157 bash[24585]: audit 2024-09-16T06:45:09.702014+0000 mgr.a (mgr.14373) 2947 : audit [DBG] from='client.75153 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:45:12.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:45:11 smithi086 bash[24289]: cluster 2024-09-16T06:45:10.527691+0000 mgr.a (mgr.14373) 2948 : cluster [DBG] pgmap v2044: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:45:12.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:45:11 smithi047 bash[22744]: cluster 2024-09-16T06:45:10.527691+0000 mgr.a (mgr.14373) 2948 : cluster [DBG] pgmap v2044: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:45:12.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:45:11 smithi157 bash[24585]: cluster 2024-09-16T06:45:10.527691+0000 mgr.a (mgr.14373) 2948 : cluster [DBG] pgmap v2044: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:45:14.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:45:13 smithi086 bash[24289]: cluster 2024-09-16T06:45:12.529930+0000 mgr.a (mgr.14373) 2949 : cluster [DBG] pgmap v2045: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:45:14.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:45:13 smithi047 bash[22744]: cluster 2024-09-16T06:45:12.529930+0000 mgr.a (mgr.14373) 2949 : cluster [DBG] pgmap v2045: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:45:14.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:45:13 smithi157 bash[24585]: cluster 2024-09-16T06:45:12.529930+0000 mgr.a (mgr.14373) 2949 : cluster [DBG] pgmap v2045: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:45:15.144 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:45:15.145 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:45:15.145 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:45:15.918 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:45:15.918 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:45:15.919 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:45:15.919 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:45:15.919 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:45:16.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:45:15 smithi047 bash[22744]: cluster 2024-09-16T06:45:14.530724+0000 mgr.a (mgr.14373) 2950 : cluster [DBG] pgmap v2046: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:45:16.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:45:15 smithi157 bash[24585]: cluster 2024-09-16T06:45:14.530724+0000 mgr.a (mgr.14373) 2950 : cluster [DBG] pgmap v2046: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:45:16.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:45:15 smithi086 bash[24289]: cluster 2024-09-16T06:45:14.530724+0000 mgr.a (mgr.14373) 2950 : cluster [DBG] pgmap v2046: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:45:17.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:45:16 smithi047 bash[22744]: audit 2024-09-16T06:45:15.483280+0000 mgr.a (mgr.14373) 2951 : audit [DBG] from='client.75225 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:45:17.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:45:16 smithi157 bash[24585]: audit 2024-09-16T06:45:15.483280+0000 mgr.a (mgr.14373) 2951 : audit [DBG] from='client.75225 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:45:17.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:45:16 smithi086 bash[24289]: audit 2024-09-16T06:45:15.483280+0000 mgr.a (mgr.14373) 2951 : audit [DBG] from='client.75225 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:45:18.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:45:17 smithi047 bash[22744]: cluster 2024-09-16T06:45:16.532680+0000 mgr.a (mgr.14373) 2952 : cluster [DBG] pgmap v2047: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-16T06:45:18.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:45:17 smithi157 bash[24585]: cluster 2024-09-16T06:45:16.532680+0000 mgr.a (mgr.14373) 2952 : cluster [DBG] pgmap v2047: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-16T06:45:18.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:45:17 smithi086 bash[24289]: cluster 2024-09-16T06:45:16.532680+0000 mgr.a (mgr.14373) 2952 : cluster [DBG] pgmap v2047: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-16T06:45:20.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:45:19 smithi047 bash[22744]: cluster 2024-09-16T06:45:18.533937+0000 mgr.a (mgr.14373) 2953 : cluster [DBG] pgmap v2048: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.4 KiB/s rd, 2 op/s 2024-09-16T06:45:20.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:45:19 smithi157 bash[24585]: cluster 2024-09-16T06:45:18.533937+0000 mgr.a (mgr.14373) 2953 : cluster [DBG] pgmap v2048: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.4 KiB/s rd, 2 op/s 2024-09-16T06:45:20.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:45:19 smithi086 bash[24289]: cluster 2024-09-16T06:45:18.533937+0000 mgr.a (mgr.14373) 2953 : cluster [DBG] pgmap v2048: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.4 KiB/s rd, 2 op/s 2024-09-16T06:45:20.920 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:45:20.920 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:45:20.921 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:45:21.697 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:45:21.698 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:45:21.698 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:45:21.698 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:45:21.698 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:45:22.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:45:21 smithi157 bash[24585]: cluster 2024-09-16T06:45:20.534720+0000 mgr.a (mgr.14373) 2954 : cluster [DBG] pgmap v2049: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:45:22.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:45:21 smithi086 bash[24289]: cluster 2024-09-16T06:45:20.534720+0000 mgr.a (mgr.14373) 2954 : cluster [DBG] pgmap v2049: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:45:22.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:45:21 smithi047 bash[22744]: cluster 2024-09-16T06:45:20.534720+0000 mgr.a (mgr.14373) 2954 : cluster [DBG] pgmap v2049: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:45:23.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:45:22 smithi157 bash[24585]: audit 2024-09-16T06:45:21.261117+0000 mgr.a (mgr.14373) 2955 : audit [DBG] from='client.75303 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:45:23.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:45:22 smithi086 bash[24289]: audit 2024-09-16T06:45:21.261117+0000 mgr.a (mgr.14373) 2955 : audit [DBG] from='client.75303 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:45:23.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:45:22 smithi047 bash[22744]: audit 2024-09-16T06:45:21.261117+0000 mgr.a (mgr.14373) 2955 : audit [DBG] from='client.75303 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:45:24.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:45:23 smithi157 bash[24585]: cluster 2024-09-16T06:45:22.537172+0000 mgr.a (mgr.14373) 2956 : cluster [DBG] pgmap v2050: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-16T06:45:24.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:45:23 smithi086 bash[24289]: cluster 2024-09-16T06:45:22.537172+0000 mgr.a (mgr.14373) 2956 : cluster [DBG] pgmap v2050: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-16T06:45:24.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:45:23 smithi047 bash[22744]: cluster 2024-09-16T06:45:22.537172+0000 mgr.a (mgr.14373) 2956 : cluster [DBG] pgmap v2050: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-16T06:45:26.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:45:25 smithi157 bash[24585]: cluster 2024-09-16T06:45:24.537958+0000 mgr.a (mgr.14373) 2957 : cluster [DBG] pgmap v2051: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T06:45:26.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:45:25 smithi086 bash[24289]: cluster 2024-09-16T06:45:24.537958+0000 mgr.a (mgr.14373) 2957 : cluster [DBG] pgmap v2051: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T06:45:26.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:45:25 smithi047 bash[22744]: cluster 2024-09-16T06:45:24.537958+0000 mgr.a (mgr.14373) 2957 : cluster [DBG] pgmap v2051: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T06:45:26.699 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:45:26.700 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:45:26.700 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:45:27.453 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:45:27.454 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:45:27.454 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:45:27.454 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:45:27.454 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:45:28.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:45:27 smithi157 bash[24585]: cluster 2024-09-16T06:45:26.539534+0000 mgr.a (mgr.14373) 2958 : cluster [DBG] pgmap v2052: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-09-16T06:45:28.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:45:27 smithi157 bash[24585]: audit 2024-09-16T06:45:27.037275+0000 mgr.a (mgr.14373) 2959 : audit [DBG] from='client.75378 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:45:28.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:45:27 smithi086 bash[24289]: cluster 2024-09-16T06:45:26.539534+0000 mgr.a (mgr.14373) 2958 : cluster [DBG] pgmap v2052: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-09-16T06:45:28.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:45:27 smithi086 bash[24289]: audit 2024-09-16T06:45:27.037275+0000 mgr.a (mgr.14373) 2959 : audit [DBG] from='client.75378 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:45:28.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:45:27 smithi047 bash[22744]: cluster 2024-09-16T06:45:26.539534+0000 mgr.a (mgr.14373) 2958 : cluster [DBG] pgmap v2052: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-09-16T06:45:28.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:45:27 smithi047 bash[22744]: audit 2024-09-16T06:45:27.037275+0000 mgr.a (mgr.14373) 2959 : audit [DBG] from='client.75378 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:45:30.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:45:29 smithi157 bash[24585]: cluster 2024-09-16T06:45:28.541330+0000 mgr.a (mgr.14373) 2960 : cluster [DBG] pgmap v2053: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-09-16T06:45:30.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:45:29 smithi157 bash[24585]: audit 2024-09-16T06:45:29.398872+0000 mon.b (mon.2) 310 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T06:45:30.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:45:29 smithi086 bash[24289]: cluster 2024-09-16T06:45:28.541330+0000 mgr.a (mgr.14373) 2960 : cluster [DBG] pgmap v2053: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-09-16T06:45:30.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:45:29 smithi086 bash[24289]: audit 2024-09-16T06:45:29.398872+0000 mon.b (mon.2) 310 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T06:45:30.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:45:29 smithi047 bash[22744]: cluster 2024-09-16T06:45:28.541330+0000 mgr.a (mgr.14373) 2960 : cluster [DBG] pgmap v2053: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-09-16T06:45:30.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:45:29 smithi047 bash[22744]: audit 2024-09-16T06:45:29.398872+0000 mon.b (mon.2) 310 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T06:45:31.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:45:31 smithi157 bash[24585]: audit 2024-09-16T06:45:30.035088+0000 mon.a (mon.0) 746 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:45:31.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:45:31 smithi157 bash[24585]: audit 2024-09-16T06:45:30.042810+0000 mon.a (mon.0) 747 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:45:31.305 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:45:31 smithi157 bash[24585]: audit 2024-09-16T06:45:30.838732+0000 mon.b (mon.2) 311 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T06:45:31.305 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:45:31 smithi157 bash[24585]: audit 2024-09-16T06:45:30.840903+0000 mon.b (mon.2) 312 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T06:45:31.305 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:45:31 smithi157 bash[24585]: audit 2024-09-16T06:45:30.855063+0000 mon.a (mon.0) 748 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:45:31.305 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:45:31 smithi157 bash[24585]: audit 2024-09-16T06:45:30.859066+0000 mon.b (mon.2) 313 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:45:31.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:45:31 smithi086 bash[24289]: audit 2024-09-16T06:45:30.035088+0000 mon.a (mon.0) 746 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:45:31.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:45:31 smithi086 bash[24289]: audit 2024-09-16T06:45:30.042810+0000 mon.a (mon.0) 747 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:45:31.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:45:31 smithi086 bash[24289]: audit 2024-09-16T06:45:30.838732+0000 mon.b (mon.2) 311 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T06:45:31.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:45:31 smithi086 bash[24289]: audit 2024-09-16T06:45:30.840903+0000 mon.b (mon.2) 312 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T06:45:31.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:45:31 smithi086 bash[24289]: audit 2024-09-16T06:45:30.855063+0000 mon.a (mon.0) 748 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:45:31.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:45:31 smithi086 bash[24289]: audit 2024-09-16T06:45:30.859066+0000 mon.b (mon.2) 313 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:45:31.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:45:31 smithi047 bash[22744]: audit 2024-09-16T06:45:30.035088+0000 mon.a (mon.0) 746 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:45:31.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:45:31 smithi047 bash[22744]: audit 2024-09-16T06:45:30.042810+0000 mon.a (mon.0) 747 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:45:31.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:45:31 smithi047 bash[22744]: audit 2024-09-16T06:45:30.838732+0000 mon.b (mon.2) 311 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T06:45:31.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:45:31 smithi047 bash[22744]: audit 2024-09-16T06:45:30.840903+0000 mon.b (mon.2) 312 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T06:45:31.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:45:31 smithi047 bash[22744]: audit 2024-09-16T06:45:30.855063+0000 mon.a (mon.0) 748 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:45:31.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:45:31 smithi047 bash[22744]: audit 2024-09-16T06:45:30.859066+0000 mon.b (mon.2) 313 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:45:32.045 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 06:45:31 smithi047 bash[22994]: debug 2024-09-16T06:45:31.587+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T06:45:32.046 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 06:45:31 smithi047 bash[22994]: debug 2024-09-16T06:45:31.591+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T06:45:32.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:45:32 smithi157 bash[24585]: cluster 2024-09-16T06:45:30.542088+0000 mgr.a (mgr.14373) 2961 : cluster [DBG] pgmap v2054: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:45:32.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:45:32 smithi157 bash[24585]: audit 2024-09-16T06:45:30.863764+0000 mgr.a (mgr.14373) 2962 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:45:32.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:45:32 smithi086 bash[24289]: cluster 2024-09-16T06:45:30.542088+0000 mgr.a (mgr.14373) 2961 : cluster [DBG] pgmap v2054: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:45:32.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:45:32 smithi086 bash[24289]: audit 2024-09-16T06:45:30.863764+0000 mgr.a (mgr.14373) 2962 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:45:32.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:45:32 smithi047 bash[22744]: cluster 2024-09-16T06:45:30.542088+0000 mgr.a (mgr.14373) 2961 : cluster [DBG] pgmap v2054: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:45:32.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:45:32 smithi047 bash[22744]: audit 2024-09-16T06:45:30.863764+0000 mgr.a (mgr.14373) 2962 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:45:32.455 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:45:32.455 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:45:32.456 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:45:33.228 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:45:33.228 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:45:33.229 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:45:33.229 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:45:33.229 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:45:33.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:45:33 smithi157 bash[24585]: audit 2024-09-16T06:45:31.592997+0000 mgr.a (mgr.14373) 2963 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T06:45:33.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:45:33 smithi157 bash[24585]: cephadm 2024-09-16T06:45:31.594870+0000 mgr.a (mgr.14373) 2964 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T06:45:33.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:45:33 smithi086 bash[24289]: audit 2024-09-16T06:45:31.592997+0000 mgr.a (mgr.14373) 2963 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T06:45:33.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:45:33 smithi086 bash[24289]: cephadm 2024-09-16T06:45:31.594870+0000 mgr.a (mgr.14373) 2964 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T06:45:33.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:45:33 smithi047 bash[22744]: audit 2024-09-16T06:45:31.592997+0000 mgr.a (mgr.14373) 2963 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T06:45:33.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:45:33 smithi047 bash[22744]: cephadm 2024-09-16T06:45:31.594870+0000 mgr.a (mgr.14373) 2964 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T06:45:34.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:45:34 smithi086 bash[24289]: cluster 2024-09-16T06:45:32.543219+0000 mgr.a (mgr.14373) 2965 : cluster [DBG] pgmap v2055: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 5.6 KiB/s rd, 426 B/s wr, 5 op/s 2024-09-16T06:45:34.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:45:34 smithi086 bash[24289]: audit 2024-09-16T06:45:32.795158+0000 mgr.a (mgr.14373) 2966 : audit [DBG] from='client.75561 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:45:34.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:45:34 smithi047 bash[22744]: cluster 2024-09-16T06:45:32.543219+0000 mgr.a (mgr.14373) 2965 : cluster [DBG] pgmap v2055: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 5.6 KiB/s rd, 426 B/s wr, 5 op/s 2024-09-16T06:45:34.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:45:34 smithi047 bash[22744]: audit 2024-09-16T06:45:32.795158+0000 mgr.a (mgr.14373) 2966 : audit [DBG] from='client.75561 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:45:34.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:45:34 smithi157 bash[24585]: cluster 2024-09-16T06:45:32.543219+0000 mgr.a (mgr.14373) 2965 : cluster [DBG] pgmap v2055: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 5.6 KiB/s rd, 426 B/s wr, 5 op/s 2024-09-16T06:45:34.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:45:34 smithi157 bash[24585]: audit 2024-09-16T06:45:32.795158+0000 mgr.a (mgr.14373) 2966 : audit [DBG] from='client.75561 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:45:36.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:45:36 smithi086 bash[24289]: cluster 2024-09-16T06:45:34.544140+0000 mgr.a (mgr.14373) 2967 : cluster [DBG] pgmap v2056: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 5.3 KiB/s rd, 426 B/s wr, 5 op/s 2024-09-16T06:45:36.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:45:36 smithi047 bash[22744]: cluster 2024-09-16T06:45:34.544140+0000 mgr.a (mgr.14373) 2967 : cluster [DBG] pgmap v2056: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 5.3 KiB/s rd, 426 B/s wr, 5 op/s 2024-09-16T06:45:36.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:45:36 smithi157 bash[24585]: cluster 2024-09-16T06:45:34.544140+0000 mgr.a (mgr.14373) 2967 : cluster [DBG] pgmap v2056: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 5.3 KiB/s rd, 426 B/s wr, 5 op/s 2024-09-16T06:45:38.230 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:45:38.231 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:45:38.231 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:45:38.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:45:38 smithi086 bash[24289]: cluster 2024-09-16T06:45:36.545896+0000 mgr.a (mgr.14373) 2968 : cluster [DBG] pgmap v2057: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.1 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:45:38.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:45:38 smithi047 bash[22744]: cluster 2024-09-16T06:45:36.545896+0000 mgr.a (mgr.14373) 2968 : cluster [DBG] pgmap v2057: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.1 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:45:38.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:45:38 smithi157 bash[24585]: cluster 2024-09-16T06:45:36.545896+0000 mgr.a (mgr.14373) 2968 : cluster [DBG] pgmap v2057: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.1 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:45:38.997 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:45:38.998 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:45:38.998 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:45:38.998 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:45:38.998 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:45:40.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:45:40 smithi047 bash[22744]: cluster 2024-09-16T06:45:38.547141+0000 mgr.a (mgr.14373) 2969 : cluster [DBG] pgmap v2058: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.3 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:45:40.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:45:40 smithi047 bash[22744]: audit 2024-09-16T06:45:38.570504+0000 mgr.a (mgr.14373) 2970 : audit [DBG] from='client.75639 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:45:40.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:45:40 smithi157 bash[24585]: cluster 2024-09-16T06:45:38.547141+0000 mgr.a (mgr.14373) 2969 : cluster [DBG] pgmap v2058: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.3 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:45:40.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:45:40 smithi157 bash[24585]: audit 2024-09-16T06:45:38.570504+0000 mgr.a (mgr.14373) 2970 : audit [DBG] from='client.75639 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:45:40.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:45:40 smithi086 bash[24289]: cluster 2024-09-16T06:45:38.547141+0000 mgr.a (mgr.14373) 2969 : cluster [DBG] pgmap v2058: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.3 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:45:40.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:45:40 smithi086 bash[24289]: audit 2024-09-16T06:45:38.570504+0000 mgr.a (mgr.14373) 2970 : audit [DBG] from='client.75639 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:45:42.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:45:42 smithi047 bash[22744]: cluster 2024-09-16T06:45:40.548028+0000 mgr.a (mgr.14373) 2971 : cluster [DBG] pgmap v2059: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:45:42.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:45:42 smithi157 bash[24585]: cluster 2024-09-16T06:45:40.548028+0000 mgr.a (mgr.14373) 2971 : cluster [DBG] pgmap v2059: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:45:42.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:45:42 smithi086 bash[24289]: cluster 2024-09-16T06:45:40.548028+0000 mgr.a (mgr.14373) 2971 : cluster [DBG] pgmap v2059: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:45:43.999 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:45:44.000 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:45:44.000 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:45:44.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:45:44 smithi047 bash[22744]: cluster 2024-09-16T06:45:42.550277+0000 mgr.a (mgr.14373) 2972 : cluster [DBG] pgmap v2060: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:45:44.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:45:44 smithi157 bash[24585]: cluster 2024-09-16T06:45:42.550277+0000 mgr.a (mgr.14373) 2972 : cluster [DBG] pgmap v2060: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:45:44.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:45:44 smithi086 bash[24289]: cluster 2024-09-16T06:45:42.550277+0000 mgr.a (mgr.14373) 2972 : cluster [DBG] pgmap v2060: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:45:44.774 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:45:44.774 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:45:44.774 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:45:44.774 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:45:44.774 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:45:46.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:45:46 smithi047 bash[22744]: audit 2024-09-16T06:45:44.336702+0000 mgr.a (mgr.14373) 2973 : audit [DBG] from='client.75717 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:45:46.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:45:46 smithi047 bash[22744]: cluster 2024-09-16T06:45:44.550783+0000 mgr.a (mgr.14373) 2974 : cluster [DBG] pgmap v2061: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 3.2 KiB/s rd, 3 op/s 2024-09-16T06:45:46.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:45:46 smithi157 bash[24585]: audit 2024-09-16T06:45:44.336702+0000 mgr.a (mgr.14373) 2973 : audit [DBG] from='client.75717 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:45:46.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:45:46 smithi157 bash[24585]: cluster 2024-09-16T06:45:44.550783+0000 mgr.a (mgr.14373) 2974 : cluster [DBG] pgmap v2061: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 3.2 KiB/s rd, 3 op/s 2024-09-16T06:45:46.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:45:46 smithi086 bash[24289]: audit 2024-09-16T06:45:44.336702+0000 mgr.a (mgr.14373) 2973 : audit [DBG] from='client.75717 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:45:46.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:45:46 smithi086 bash[24289]: cluster 2024-09-16T06:45:44.550783+0000 mgr.a (mgr.14373) 2974 : cluster [DBG] pgmap v2061: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 3.2 KiB/s rd, 3 op/s 2024-09-16T06:45:48.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:45:48 smithi047 bash[22744]: cluster 2024-09-16T06:45:46.552592+0000 mgr.a (mgr.14373) 2975 : cluster [DBG] pgmap v2062: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 3.6 KiB/s rd, 3 op/s 2024-09-16T06:45:48.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:45:48 smithi157 bash[24585]: cluster 2024-09-16T06:45:46.552592+0000 mgr.a (mgr.14373) 2975 : cluster [DBG] pgmap v2062: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 3.6 KiB/s rd, 3 op/s 2024-09-16T06:45:48.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:45:48 smithi086 bash[24289]: cluster 2024-09-16T06:45:46.552592+0000 mgr.a (mgr.14373) 2975 : cluster [DBG] pgmap v2062: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 3.6 KiB/s rd, 3 op/s 2024-09-16T06:45:49.775 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:45:49.776 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:45:49.776 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:45:50.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:45:50 smithi157 bash[24585]: cluster 2024-09-16T06:45:48.553843+0000 mgr.a (mgr.14373) 2976 : cluster [DBG] pgmap v2063: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.4 KiB/s rd, 2 op/s 2024-09-16T06:45:50.558 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:45:50.558 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:45:50.558 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:45:50.559 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:45:50.559 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:45:50.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:45:50 smithi086 bash[24289]: cluster 2024-09-16T06:45:48.553843+0000 mgr.a (mgr.14373) 2976 : cluster [DBG] pgmap v2063: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.4 KiB/s rd, 2 op/s 2024-09-16T06:45:50.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:45:50 smithi047 bash[22744]: cluster 2024-09-16T06:45:48.553843+0000 mgr.a (mgr.14373) 2976 : cluster [DBG] pgmap v2063: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.4 KiB/s rd, 2 op/s 2024-09-16T06:45:51.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:45:51 smithi157 bash[24585]: audit 2024-09-16T06:45:50.115156+0000 mgr.a (mgr.14373) 2977 : audit [DBG] from='client.75795 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:45:51.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:45:51 smithi086 bash[24289]: audit 2024-09-16T06:45:50.115156+0000 mgr.a (mgr.14373) 2977 : audit [DBG] from='client.75795 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:45:51.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:45:51 smithi047 bash[22744]: audit 2024-09-16T06:45:50.115156+0000 mgr.a (mgr.14373) 2977 : audit [DBG] from='client.75795 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:45:52.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:45:52 smithi157 bash[24585]: cluster 2024-09-16T06:45:50.554421+0000 mgr.a (mgr.14373) 2978 : cluster [DBG] pgmap v2064: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:45:52.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:45:52 smithi086 bash[24289]: cluster 2024-09-16T06:45:50.554421+0000 mgr.a (mgr.14373) 2978 : cluster [DBG] pgmap v2064: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:45:52.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:45:52 smithi047 bash[22744]: cluster 2024-09-16T06:45:50.554421+0000 mgr.a (mgr.14373) 2978 : cluster [DBG] pgmap v2064: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:45:54.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:45:54 smithi157 bash[24585]: cluster 2024-09-16T06:45:52.556669+0000 mgr.a (mgr.14373) 2979 : cluster [DBG] pgmap v2065: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:45:54.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:45:54 smithi086 bash[24289]: cluster 2024-09-16T06:45:52.556669+0000 mgr.a (mgr.14373) 2979 : cluster [DBG] pgmap v2065: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:45:54.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:45:54 smithi047 bash[22744]: cluster 2024-09-16T06:45:52.556669+0000 mgr.a (mgr.14373) 2979 : cluster [DBG] pgmap v2065: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:45:55.560 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:45:55.561 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:45:55.561 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:45:56.317 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:45:56.318 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:45:56.318 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:45:56.318 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:45:56.318 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:45:56.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:45:56 smithi157 bash[24585]: cluster 2024-09-16T06:45:54.557436+0000 mgr.a (mgr.14373) 2980 : cluster [DBG] pgmap v2066: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:45:56.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:45:56 smithi086 bash[24289]: cluster 2024-09-16T06:45:54.557436+0000 mgr.a (mgr.14373) 2980 : cluster [DBG] pgmap v2066: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:45:56.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:45:56 smithi047 bash[22744]: cluster 2024-09-16T06:45:54.557436+0000 mgr.a (mgr.14373) 2980 : cluster [DBG] pgmap v2066: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:45:57.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:45:57 smithi157 bash[24585]: audit 2024-09-16T06:45:55.895917+0000 mgr.a (mgr.14373) 2981 : audit [DBG] from='client.75873 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:45:57.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:45:57 smithi086 bash[24289]: audit 2024-09-16T06:45:55.895917+0000 mgr.a (mgr.14373) 2981 : audit [DBG] from='client.75873 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:45:57.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:45:57 smithi047 bash[22744]: audit 2024-09-16T06:45:55.895917+0000 mgr.a (mgr.14373) 2981 : audit [DBG] from='client.75873 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:45:58.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:45:58 smithi157 bash[24585]: cluster 2024-09-16T06:45:56.559379+0000 mgr.a (mgr.14373) 2982 : cluster [DBG] pgmap v2067: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-16T06:45:58.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:45:58 smithi086 bash[24289]: cluster 2024-09-16T06:45:56.559379+0000 mgr.a (mgr.14373) 2982 : cluster [DBG] pgmap v2067: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-16T06:45:58.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:45:58 smithi047 bash[22744]: cluster 2024-09-16T06:45:56.559379+0000 mgr.a (mgr.14373) 2982 : cluster [DBG] pgmap v2067: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-16T06:46:00.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:46:00 smithi157 bash[24585]: cluster 2024-09-16T06:45:58.560755+0000 mgr.a (mgr.14373) 2983 : cluster [DBG] pgmap v2068: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.4 KiB/s rd, 2 op/s 2024-09-16T06:46:00.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:46:00 smithi086 bash[24289]: cluster 2024-09-16T06:45:58.560755+0000 mgr.a (mgr.14373) 2983 : cluster [DBG] pgmap v2068: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.4 KiB/s rd, 2 op/s 2024-09-16T06:46:00.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:46:00 smithi047 bash[22744]: cluster 2024-09-16T06:45:58.560755+0000 mgr.a (mgr.14373) 2983 : cluster [DBG] pgmap v2068: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.4 KiB/s rd, 2 op/s 2024-09-16T06:46:01.319 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:46:01.320 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:46:01.320 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:46:02.096 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:46:02.096 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:46:02.096 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:46:02.096 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:46:02.097 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:46:02.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:46:02 smithi157 bash[24585]: cluster 2024-09-16T06:46:00.561712+0000 mgr.a (mgr.14373) 2984 : cluster [DBG] pgmap v2069: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:46:02.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:46:02 smithi086 bash[24289]: cluster 2024-09-16T06:46:00.561712+0000 mgr.a (mgr.14373) 2984 : cluster [DBG] pgmap v2069: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:46:02.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:46:02 smithi047 bash[22744]: cluster 2024-09-16T06:46:00.561712+0000 mgr.a (mgr.14373) 2984 : cluster [DBG] pgmap v2069: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:46:03.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:46:03 smithi157 bash[24585]: audit 2024-09-16T06:46:01.655598+0000 mgr.a (mgr.14373) 2985 : audit [DBG] from='client.75951 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:46:03.637 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:46:03 smithi047 bash[22744]: audit 2024-09-16T06:46:01.655598+0000 mgr.a (mgr.14373) 2985 : audit [DBG] from='client.75951 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:46:03.638 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:46:03 smithi086 bash[24289]: audit 2024-09-16T06:46:01.655598+0000 mgr.a (mgr.14373) 2985 : audit [DBG] from='client.75951 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:46:04.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:46:04 smithi157 bash[24585]: cluster 2024-09-16T06:46:02.564586+0000 mgr.a (mgr.14373) 2986 : cluster [DBG] pgmap v2070: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:46:04.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:46:04 smithi086 bash[24289]: cluster 2024-09-16T06:46:02.564586+0000 mgr.a (mgr.14373) 2986 : cluster [DBG] pgmap v2070: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:46:04.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:46:04 smithi047 bash[22744]: cluster 2024-09-16T06:46:02.564586+0000 mgr.a (mgr.14373) 2986 : cluster [DBG] pgmap v2070: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:46:06.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:46:06 smithi157 bash[24585]: cluster 2024-09-16T06:46:04.565359+0000 mgr.a (mgr.14373) 2987 : cluster [DBG] pgmap v2071: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:46:06.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:46:06 smithi086 bash[24289]: cluster 2024-09-16T06:46:04.565359+0000 mgr.a (mgr.14373) 2987 : cluster [DBG] pgmap v2071: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:46:06.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:46:06 smithi047 bash[22744]: cluster 2024-09-16T06:46:04.565359+0000 mgr.a (mgr.14373) 2987 : cluster [DBG] pgmap v2071: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:46:07.098 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:46:07.098 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:46:07.098 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:46:07.868 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:46:07.868 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:46:07.868 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:46:07.868 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:46:07.869 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:46:08.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:46:08 smithi157 bash[24585]: cluster 2024-09-16T06:46:06.566956+0000 mgr.a (mgr.14373) 2988 : cluster [DBG] pgmap v2072: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T06:46:08.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:46:08 smithi086 bash[24289]: cluster 2024-09-16T06:46:06.566956+0000 mgr.a (mgr.14373) 2988 : cluster [DBG] pgmap v2072: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T06:46:08.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:46:08 smithi047 bash[22744]: cluster 2024-09-16T06:46:06.566956+0000 mgr.a (mgr.14373) 2988 : cluster [DBG] pgmap v2072: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T06:46:09.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:46:09 smithi157 bash[24585]: audit 2024-09-16T06:46:07.433948+0000 mgr.a (mgr.14373) 2989 : audit [DBG] from='client.76023 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:46:09.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:46:09 smithi086 bash[24289]: audit 2024-09-16T06:46:07.433948+0000 mgr.a (mgr.14373) 2989 : audit [DBG] from='client.76023 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:46:09.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:46:09 smithi047 bash[22744]: audit 2024-09-16T06:46:07.433948+0000 mgr.a (mgr.14373) 2989 : audit [DBG] from='client.76023 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:46:10.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:46:10 smithi157 bash[24585]: cluster 2024-09-16T06:46:08.568744+0000 mgr.a (mgr.14373) 2990 : cluster [DBG] pgmap v2073: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-09-16T06:46:10.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:46:10 smithi086 bash[24289]: cluster 2024-09-16T06:46:08.568744+0000 mgr.a (mgr.14373) 2990 : cluster [DBG] pgmap v2073: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-09-16T06:46:10.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:46:10 smithi047 bash[22744]: cluster 2024-09-16T06:46:08.568744+0000 mgr.a (mgr.14373) 2990 : cluster [DBG] pgmap v2073: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-09-16T06:46:12.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:46:12 smithi157 bash[24585]: cluster 2024-09-16T06:46:10.569556+0000 mgr.a (mgr.14373) 2991 : cluster [DBG] pgmap v2074: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:46:12.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:46:12 smithi086 bash[24289]: cluster 2024-09-16T06:46:10.569556+0000 mgr.a (mgr.14373) 2991 : cluster [DBG] pgmap v2074: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:46:12.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:46:12 smithi047 bash[22744]: cluster 2024-09-16T06:46:10.569556+0000 mgr.a (mgr.14373) 2991 : cluster [DBG] pgmap v2074: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:46:12.870 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:46:12.870 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:46:12.871 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:46:13.621 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:46:13.621 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:46:13.621 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:46:13.621 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:46:13.621 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:46:14.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:46:14 smithi157 bash[24585]: cluster 2024-09-16T06:46:12.571656+0000 mgr.a (mgr.14373) 2992 : cluster [DBG] pgmap v2075: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:46:14.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:46:14 smithi157 bash[24585]: audit 2024-09-16T06:46:13.207676+0000 mgr.a (mgr.14373) 2993 : audit [DBG] from='client.76101 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:46:14.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:46:14 smithi086 bash[24289]: cluster 2024-09-16T06:46:12.571656+0000 mgr.a (mgr.14373) 2992 : cluster [DBG] pgmap v2075: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:46:14.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:46:14 smithi086 bash[24289]: audit 2024-09-16T06:46:13.207676+0000 mgr.a (mgr.14373) 2993 : audit [DBG] from='client.76101 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:46:14.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:46:14 smithi047 bash[22744]: cluster 2024-09-16T06:46:12.571656+0000 mgr.a (mgr.14373) 2992 : cluster [DBG] pgmap v2075: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:46:14.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:46:14 smithi047 bash[22744]: audit 2024-09-16T06:46:13.207676+0000 mgr.a (mgr.14373) 2993 : audit [DBG] from='client.76101 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:46:16.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:46:16 smithi157 bash[24585]: cluster 2024-09-16T06:46:14.572630+0000 mgr.a (mgr.14373) 2994 : cluster [DBG] pgmap v2076: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:46:16.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:46:16 smithi086 bash[24289]: cluster 2024-09-16T06:46:14.572630+0000 mgr.a (mgr.14373) 2994 : cluster [DBG] pgmap v2076: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:46:16.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:46:16 smithi047 bash[22744]: cluster 2024-09-16T06:46:14.572630+0000 mgr.a (mgr.14373) 2994 : cluster [DBG] pgmap v2076: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:46:18.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:46:18 smithi157 bash[24585]: cluster 2024-09-16T06:46:16.574386+0000 mgr.a (mgr.14373) 2995 : cluster [DBG] pgmap v2077: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-16T06:46:18.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:46:18 smithi086 bash[24289]: cluster 2024-09-16T06:46:16.574386+0000 mgr.a (mgr.14373) 2995 : cluster [DBG] pgmap v2077: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-16T06:46:18.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:46:18 smithi047 bash[22744]: cluster 2024-09-16T06:46:16.574386+0000 mgr.a (mgr.14373) 2995 : cluster [DBG] pgmap v2077: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-16T06:46:18.622 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:46:18.623 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:46:18.623 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:46:19.401 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:46:19.401 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:46:19.401 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:46:19.401 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:46:19.401 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:46:20.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:46:20 smithi157 bash[24585]: cluster 2024-09-16T06:46:18.575558+0000 mgr.a (mgr.14373) 2996 : cluster [DBG] pgmap v2078: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.4 KiB/s rd, 2 op/s 2024-09-16T06:46:20.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:46:20 smithi157 bash[24585]: audit 2024-09-16T06:46:18.961485+0000 mgr.a (mgr.14373) 2997 : audit [DBG] from='client.76179 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:46:20.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:46:20 smithi086 bash[24289]: cluster 2024-09-16T06:46:18.575558+0000 mgr.a (mgr.14373) 2996 : cluster [DBG] pgmap v2078: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.4 KiB/s rd, 2 op/s 2024-09-16T06:46:20.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:46:20 smithi086 bash[24289]: audit 2024-09-16T06:46:18.961485+0000 mgr.a (mgr.14373) 2997 : audit [DBG] from='client.76179 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:46:20.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:46:20 smithi047 bash[22744]: cluster 2024-09-16T06:46:18.575558+0000 mgr.a (mgr.14373) 2996 : cluster [DBG] pgmap v2078: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.4 KiB/s rd, 2 op/s 2024-09-16T06:46:20.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:46:20 smithi047 bash[22744]: audit 2024-09-16T06:46:18.961485+0000 mgr.a (mgr.14373) 2997 : audit [DBG] from='client.76179 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:46:22.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:46:22 smithi157 bash[24585]: cluster 2024-09-16T06:46:20.576459+0000 mgr.a (mgr.14373) 2998 : cluster [DBG] pgmap v2079: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:46:22.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:46:22 smithi086 bash[24289]: cluster 2024-09-16T06:46:20.576459+0000 mgr.a (mgr.14373) 2998 : cluster [DBG] pgmap v2079: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:46:22.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:46:22 smithi047 bash[22744]: cluster 2024-09-16T06:46:20.576459+0000 mgr.a (mgr.14373) 2998 : cluster [DBG] pgmap v2079: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:46:24.402 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:46:24.403 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:46:24.403 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:46:24.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:46:24 smithi157 bash[24585]: cluster 2024-09-16T06:46:22.578777+0000 mgr.a (mgr.14373) 2999 : cluster [DBG] pgmap v2080: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:46:24.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:46:24 smithi086 bash[24289]: cluster 2024-09-16T06:46:22.578777+0000 mgr.a (mgr.14373) 2999 : cluster [DBG] pgmap v2080: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:46:24.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:46:24 smithi047 bash[22744]: cluster 2024-09-16T06:46:22.578777+0000 mgr.a (mgr.14373) 2999 : cluster [DBG] pgmap v2080: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:46:25.169 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:46:25.169 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:46:25.170 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:46:25.170 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:46:25.170 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:46:26.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:46:26 smithi157 bash[24585]: cluster 2024-09-16T06:46:24.579547+0000 mgr.a (mgr.14373) 3000 : cluster [DBG] pgmap v2081: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:46:26.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:46:26 smithi157 bash[24585]: audit 2024-09-16T06:46:24.742817+0000 mgr.a (mgr.14373) 3001 : audit [DBG] from='client.76257 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:46:26.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:46:26 smithi086 bash[24289]: cluster 2024-09-16T06:46:24.579547+0000 mgr.a (mgr.14373) 3000 : cluster [DBG] pgmap v2081: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:46:26.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:46:26 smithi086 bash[24289]: audit 2024-09-16T06:46:24.742817+0000 mgr.a (mgr.14373) 3001 : audit [DBG] from='client.76257 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:46:26.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:46:26 smithi047 bash[22744]: cluster 2024-09-16T06:46:24.579547+0000 mgr.a (mgr.14373) 3000 : cluster [DBG] pgmap v2081: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:46:26.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:46:26 smithi047 bash[22744]: audit 2024-09-16T06:46:24.742817+0000 mgr.a (mgr.14373) 3001 : audit [DBG] from='client.76257 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:46:28.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:46:28 smithi157 bash[24585]: cluster 2024-09-16T06:46:26.581390+0000 mgr.a (mgr.14373) 3002 : cluster [DBG] pgmap v2082: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-16T06:46:28.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:46:28 smithi086 bash[24289]: cluster 2024-09-16T06:46:26.581390+0000 mgr.a (mgr.14373) 3002 : cluster [DBG] pgmap v2082: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-16T06:46:28.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:46:28 smithi047 bash[22744]: cluster 2024-09-16T06:46:26.581390+0000 mgr.a (mgr.14373) 3002 : cluster [DBG] pgmap v2082: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-16T06:46:30.171 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:46:30.171 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:46:30.171 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:46:30.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:46:30 smithi157 bash[24585]: cluster 2024-09-16T06:46:28.582658+0000 mgr.a (mgr.14373) 3003 : cluster [DBG] pgmap v2083: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.4 KiB/s rd, 2 op/s 2024-09-16T06:46:30.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:46:30 smithi086 bash[24289]: cluster 2024-09-16T06:46:28.582658+0000 mgr.a (mgr.14373) 3003 : cluster [DBG] pgmap v2083: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.4 KiB/s rd, 2 op/s 2024-09-16T06:46:30.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:46:30 smithi047 bash[22744]: cluster 2024-09-16T06:46:28.582658+0000 mgr.a (mgr.14373) 3003 : cluster [DBG] pgmap v2083: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.4 KiB/s rd, 2 op/s 2024-09-16T06:46:30.907 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:46:30.908 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:46:30.908 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:46:30.908 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:46:30.908 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:46:32.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:46:32 smithi157 bash[24585]: audit 2024-09-16T06:46:30.499482+0000 mgr.a (mgr.14373) 3004 : audit [DBG] from='client.76332 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:46:32.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:46:32 smithi157 bash[24585]: cluster 2024-09-16T06:46:30.583205+0000 mgr.a (mgr.14373) 3005 : cluster [DBG] pgmap v2084: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:46:32.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:46:32 smithi157 bash[24585]: audit 2024-09-16T06:46:31.643002+0000 mon.b (mon.2) 314 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T06:46:32.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:46:32 smithi086 bash[24289]: audit 2024-09-16T06:46:30.499482+0000 mgr.a (mgr.14373) 3004 : audit [DBG] from='client.76332 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:46:32.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:46:32 smithi086 bash[24289]: cluster 2024-09-16T06:46:30.583205+0000 mgr.a (mgr.14373) 3005 : cluster [DBG] pgmap v2084: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:46:32.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:46:32 smithi086 bash[24289]: audit 2024-09-16T06:46:31.643002+0000 mon.b (mon.2) 314 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T06:46:32.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:46:32 smithi047 bash[22744]: audit 2024-09-16T06:46:30.499482+0000 mgr.a (mgr.14373) 3004 : audit [DBG] from='client.76332 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:46:32.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:46:32 smithi047 bash[22744]: cluster 2024-09-16T06:46:30.583205+0000 mgr.a (mgr.14373) 3005 : cluster [DBG] pgmap v2084: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:46:32.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:46:32 smithi047 bash[22744]: audit 2024-09-16T06:46:31.643002+0000 mon.b (mon.2) 314 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T06:46:33.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:46:33 smithi157 bash[24585]: audit 2024-09-16T06:46:32.265302+0000 mon.a (mon.0) 749 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:46:33.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:46:33 smithi157 bash[24585]: audit 2024-09-16T06:46:32.271859+0000 mon.a (mon.0) 750 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:46:33.555 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:46:33 smithi157 bash[24585]: audit 2024-09-16T06:46:32.282185+0000 mon.a (mon.0) 751 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:46:33.555 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:46:33 smithi157 bash[24585]: audit 2024-09-16T06:46:32.290281+0000 mon.a (mon.0) 752 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:46:33.555 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:46:33 smithi157 bash[24585]: cluster 2024-09-16T06:46:32.585403+0000 mgr.a (mgr.14373) 3006 : cluster [DBG] pgmap v2085: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:46:33.555 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:46:33 smithi157 bash[24585]: audit 2024-09-16T06:46:32.934334+0000 mon.b (mon.2) 315 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T06:46:33.555 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:46:33 smithi157 bash[24585]: audit 2024-09-16T06:46:32.936402+0000 mon.b (mon.2) 316 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T06:46:33.555 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:46:33 smithi157 bash[24585]: audit 2024-09-16T06:46:32.949973+0000 mon.a (mon.0) 753 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:46:33.555 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:46:33 smithi157 bash[24585]: audit 2024-09-16T06:46:32.952905+0000 mon.b (mon.2) 317 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:46:33.555 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:46:33 smithi157 bash[24585]: audit 2024-09-16T06:46:32.956490+0000 mgr.a (mgr.14373) 3007 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:46:33.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:46:33 smithi086 bash[24289]: audit 2024-09-16T06:46:32.265302+0000 mon.a (mon.0) 749 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:46:33.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:46:33 smithi086 bash[24289]: audit 2024-09-16T06:46:32.271859+0000 mon.a (mon.0) 750 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:46:33.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:46:33 smithi086 bash[24289]: audit 2024-09-16T06:46:32.282185+0000 mon.a (mon.0) 751 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:46:33.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:46:33 smithi086 bash[24289]: audit 2024-09-16T06:46:32.290281+0000 mon.a (mon.0) 752 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:46:33.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:46:33 smithi086 bash[24289]: cluster 2024-09-16T06:46:32.585403+0000 mgr.a (mgr.14373) 3006 : cluster [DBG] pgmap v2085: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:46:33.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:46:33 smithi086 bash[24289]: audit 2024-09-16T06:46:32.934334+0000 mon.b (mon.2) 315 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T06:46:33.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:46:33 smithi086 bash[24289]: audit 2024-09-16T06:46:32.936402+0000 mon.b (mon.2) 316 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T06:46:33.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:46:33 smithi086 bash[24289]: audit 2024-09-16T06:46:32.949973+0000 mon.a (mon.0) 753 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:46:33.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:46:33 smithi086 bash[24289]: audit 2024-09-16T06:46:32.952905+0000 mon.b (mon.2) 317 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:46:33.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:46:33 smithi086 bash[24289]: audit 2024-09-16T06:46:32.956490+0000 mgr.a (mgr.14373) 3007 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:46:33.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:46:33 smithi047 bash[22744]: audit 2024-09-16T06:46:32.265302+0000 mon.a (mon.0) 749 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:46:33.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:46:33 smithi047 bash[22744]: audit 2024-09-16T06:46:32.271859+0000 mon.a (mon.0) 750 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:46:33.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:46:33 smithi047 bash[22744]: audit 2024-09-16T06:46:32.282185+0000 mon.a (mon.0) 751 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:46:33.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:46:33 smithi047 bash[22744]: audit 2024-09-16T06:46:32.290281+0000 mon.a (mon.0) 752 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:46:33.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:46:33 smithi047 bash[22744]: cluster 2024-09-16T06:46:32.585403+0000 mgr.a (mgr.14373) 3006 : cluster [DBG] pgmap v2085: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:46:33.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:46:33 smithi047 bash[22744]: audit 2024-09-16T06:46:32.934334+0000 mon.b (mon.2) 315 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T06:46:33.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:46:33 smithi047 bash[22744]: audit 2024-09-16T06:46:32.936402+0000 mon.b (mon.2) 316 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T06:46:33.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:46:33 smithi047 bash[22744]: audit 2024-09-16T06:46:32.949973+0000 mon.a (mon.0) 753 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:46:33.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:46:33 smithi047 bash[22744]: audit 2024-09-16T06:46:32.952905+0000 mon.b (mon.2) 317 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:46:33.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:46:33 smithi047 bash[22744]: audit 2024-09-16T06:46:32.956490+0000 mgr.a (mgr.14373) 3007 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:46:34.089 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 06:46:33 smithi047 bash[22994]: debug 2024-09-16T06:46:33.666+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T06:46:34.190 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 06:46:33 smithi047 bash[22994]: debug 2024-09-16T06:46:33.666+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T06:46:34.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:46:34 smithi157 bash[24585]: audit 2024-09-16T06:46:33.667501+0000 mgr.a (mgr.14373) 3008 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T06:46:34.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:46:34 smithi157 bash[24585]: cephadm 2024-09-16T06:46:33.669463+0000 mgr.a (mgr.14373) 3009 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T06:46:34.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:46:34 smithi086 bash[24289]: audit 2024-09-16T06:46:33.667501+0000 mgr.a (mgr.14373) 3008 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T06:46:34.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:46:34 smithi086 bash[24289]: cephadm 2024-09-16T06:46:33.669463+0000 mgr.a (mgr.14373) 3009 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T06:46:34.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:46:34 smithi047 bash[22744]: audit 2024-09-16T06:46:33.667501+0000 mgr.a (mgr.14373) 3008 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T06:46:34.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:46:34 smithi047 bash[22744]: cephadm 2024-09-16T06:46:33.669463+0000 mgr.a (mgr.14373) 3009 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T06:46:35.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:46:35 smithi157 bash[24585]: cluster 2024-09-16T06:46:34.586290+0000 mgr.a (mgr.14373) 3010 : cluster [DBG] pgmap v2086: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:46:35.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:46:35 smithi086 bash[24289]: cluster 2024-09-16T06:46:34.586290+0000 mgr.a (mgr.14373) 3010 : cluster [DBG] pgmap v2086: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:46:35.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:46:35 smithi047 bash[22744]: cluster 2024-09-16T06:46:34.586290+0000 mgr.a (mgr.14373) 3010 : cluster [DBG] pgmap v2086: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:46:35.909 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:46:35.910 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:46:35.910 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:46:36.697 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:46:36.698 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:46:36.698 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:46:36.698 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:46:36.698 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:46:38.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:46:37 smithi157 bash[24585]: audit 2024-09-16T06:46:36.251954+0000 mgr.a (mgr.14373) 3011 : audit [DBG] from='client.76515 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:46:38.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:46:37 smithi157 bash[24585]: cluster 2024-09-16T06:46:36.594106+0000 mgr.a (mgr.14373) 3012 : cluster [DBG] pgmap v2087: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 4.2 KiB/s rd, 85 B/s wr, 4 op/s 2024-09-16T06:46:38.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:46:37 smithi086 bash[24289]: audit 2024-09-16T06:46:36.251954+0000 mgr.a (mgr.14373) 3011 : audit [DBG] from='client.76515 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:46:38.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:46:37 smithi086 bash[24289]: cluster 2024-09-16T06:46:36.594106+0000 mgr.a (mgr.14373) 3012 : cluster [DBG] pgmap v2087: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 4.2 KiB/s rd, 85 B/s wr, 4 op/s 2024-09-16T06:46:38.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:46:37 smithi047 bash[22744]: audit 2024-09-16T06:46:36.251954+0000 mgr.a (mgr.14373) 3011 : audit [DBG] from='client.76515 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:46:38.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:46:37 smithi047 bash[22744]: cluster 2024-09-16T06:46:36.594106+0000 mgr.a (mgr.14373) 3012 : cluster [DBG] pgmap v2087: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 4.2 KiB/s rd, 85 B/s wr, 4 op/s 2024-09-16T06:46:40.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:46:39 smithi157 bash[24585]: cluster 2024-09-16T06:46:38.595377+0000 mgr.a (mgr.14373) 3013 : cluster [DBG] pgmap v2088: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 6.9 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T06:46:40.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:46:39 smithi086 bash[24289]: cluster 2024-09-16T06:46:38.595377+0000 mgr.a (mgr.14373) 3013 : cluster [DBG] pgmap v2088: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 6.9 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T06:46:40.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:46:39 smithi047 bash[22744]: cluster 2024-09-16T06:46:38.595377+0000 mgr.a (mgr.14373) 3013 : cluster [DBG] pgmap v2088: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 6.9 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T06:46:41.699 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:46:41.700 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:46:41.700 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:46:42.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:46:41 smithi157 bash[24585]: cluster 2024-09-16T06:46:40.596136+0000 mgr.a (mgr.14373) 3014 : cluster [DBG] pgmap v2089: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T06:46:42.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:46:41 smithi086 bash[24289]: cluster 2024-09-16T06:46:40.596136+0000 mgr.a (mgr.14373) 3014 : cluster [DBG] pgmap v2089: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T06:46:42.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:46:41 smithi047 bash[22744]: cluster 2024-09-16T06:46:40.596136+0000 mgr.a (mgr.14373) 3014 : cluster [DBG] pgmap v2089: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T06:46:42.484 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:46:42.484 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:46:42.484 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:46:42.484 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:46:42.484 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:46:43.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:46:42 smithi157 bash[24585]: audit 2024-09-16T06:46:42.041773+0000 mgr.a (mgr.14373) 3015 : audit [DBG] from='client.76587 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:46:43.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:46:42 smithi086 bash[24289]: audit 2024-09-16T06:46:42.041773+0000 mgr.a (mgr.14373) 3015 : audit [DBG] from='client.76587 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:46:43.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:46:42 smithi047 bash[22744]: audit 2024-09-16T06:46:42.041773+0000 mgr.a (mgr.14373) 3015 : audit [DBG] from='client.76587 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:46:44.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:46:43 smithi157 bash[24585]: cluster 2024-09-16T06:46:42.598854+0000 mgr.a (mgr.14373) 3016 : cluster [DBG] pgmap v2090: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:46:44.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:46:43 smithi086 bash[24289]: cluster 2024-09-16T06:46:42.598854+0000 mgr.a (mgr.14373) 3016 : cluster [DBG] pgmap v2090: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:46:44.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:46:43 smithi047 bash[22744]: cluster 2024-09-16T06:46:42.598854+0000 mgr.a (mgr.14373) 3016 : cluster [DBG] pgmap v2090: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:46:46.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:46:45 smithi157 bash[24585]: cluster 2024-09-16T06:46:44.599759+0000 mgr.a (mgr.14373) 3017 : cluster [DBG] pgmap v2091: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T06:46:46.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:46:45 smithi086 bash[24289]: cluster 2024-09-16T06:46:44.599759+0000 mgr.a (mgr.14373) 3017 : cluster [DBG] pgmap v2091: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T06:46:46.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:46:45 smithi047 bash[22744]: cluster 2024-09-16T06:46:44.599759+0000 mgr.a (mgr.14373) 3017 : cluster [DBG] pgmap v2091: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T06:46:47.485 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:46:47.486 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:46:47.486 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:46:48.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:46:47 smithi157 bash[24585]: cluster 2024-09-16T06:46:46.601462+0000 mgr.a (mgr.14373) 3018 : cluster [DBG] pgmap v2092: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 6.4 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T06:46:48.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:46:47 smithi086 bash[24289]: cluster 2024-09-16T06:46:46.601462+0000 mgr.a (mgr.14373) 3018 : cluster [DBG] pgmap v2092: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 6.4 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T06:46:48.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:46:47 smithi047 bash[22744]: cluster 2024-09-16T06:46:46.601462+0000 mgr.a (mgr.14373) 3018 : cluster [DBG] pgmap v2092: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 6.4 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T06:46:48.268 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:46:48.268 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:46:48.268 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:46:48.268 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:46:48.268 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:46:49.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:46:48 smithi157 bash[24585]: audit 2024-09-16T06:46:47.827028+0000 mgr.a (mgr.14373) 3019 : audit [DBG] from='client.76665 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:46:49.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:46:48 smithi086 bash[24289]: audit 2024-09-16T06:46:47.827028+0000 mgr.a (mgr.14373) 3019 : audit [DBG] from='client.76665 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:46:49.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:46:48 smithi047 bash[22744]: audit 2024-09-16T06:46:47.827028+0000 mgr.a (mgr.14373) 3019 : audit [DBG] from='client.76665 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:46:50.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:46:49 smithi157 bash[24585]: cluster 2024-09-16T06:46:48.603363+0000 mgr.a (mgr.14373) 3020 : cluster [DBG] pgmap v2093: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 4.6 KiB/s rd, 341 B/s wr, 4 op/s 2024-09-16T06:46:50.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:46:49 smithi086 bash[24289]: cluster 2024-09-16T06:46:48.603363+0000 mgr.a (mgr.14373) 3020 : cluster [DBG] pgmap v2093: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 4.6 KiB/s rd, 341 B/s wr, 4 op/s 2024-09-16T06:46:50.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:46:49 smithi047 bash[22744]: cluster 2024-09-16T06:46:48.603363+0000 mgr.a (mgr.14373) 3020 : cluster [DBG] pgmap v2093: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 4.6 KiB/s rd, 341 B/s wr, 4 op/s 2024-09-16T06:46:52.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:46:51 smithi157 bash[24585]: cluster 2024-09-16T06:46:50.604173+0000 mgr.a (mgr.14373) 3021 : cluster [DBG] pgmap v2094: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-16T06:46:52.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:46:51 smithi086 bash[24289]: cluster 2024-09-16T06:46:50.604173+0000 mgr.a (mgr.14373) 3021 : cluster [DBG] pgmap v2094: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-16T06:46:52.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:46:51 smithi047 bash[22744]: cluster 2024-09-16T06:46:50.604173+0000 mgr.a (mgr.14373) 3021 : cluster [DBG] pgmap v2094: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-16T06:46:53.269 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:46:53.270 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:46:53.270 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:46:54.017 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:46:54.017 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:46:54.017 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:46:54.017 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:46:54.017 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:46:54.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:46:54 smithi157 bash[24585]: cluster 2024-09-16T06:46:52.606242+0000 mgr.a (mgr.14373) 3022 : cluster [DBG] pgmap v2095: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-16T06:46:54.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:46:54 smithi086 bash[24289]: cluster 2024-09-16T06:46:52.606242+0000 mgr.a (mgr.14373) 3022 : cluster [DBG] pgmap v2095: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-16T06:46:54.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:46:54 smithi047 bash[22744]: cluster 2024-09-16T06:46:52.606242+0000 mgr.a (mgr.14373) 3022 : cluster [DBG] pgmap v2095: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-16T06:46:55.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:46:55 smithi157 bash[24585]: audit 2024-09-16T06:46:53.603050+0000 mgr.a (mgr.14373) 3023 : audit [DBG] from='client.76743 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:46:55.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:46:55 smithi086 bash[24289]: audit 2024-09-16T06:46:53.603050+0000 mgr.a (mgr.14373) 3023 : audit [DBG] from='client.76743 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:46:55.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:46:55 smithi047 bash[22744]: audit 2024-09-16T06:46:53.603050+0000 mgr.a (mgr.14373) 3023 : audit [DBG] from='client.76743 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:46:56.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:46:56 smithi157 bash[24585]: cluster 2024-09-16T06:46:54.607168+0000 mgr.a (mgr.14373) 3024 : cluster [DBG] pgmap v2096: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:46:56.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:46:56 smithi086 bash[24289]: cluster 2024-09-16T06:46:54.607168+0000 mgr.a (mgr.14373) 3024 : cluster [DBG] pgmap v2096: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:46:56.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:46:56 smithi047 bash[22744]: cluster 2024-09-16T06:46:54.607168+0000 mgr.a (mgr.14373) 3024 : cluster [DBG] pgmap v2096: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:46:58.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:46:58 smithi157 bash[24585]: cluster 2024-09-16T06:46:56.608921+0000 mgr.a (mgr.14373) 3025 : cluster [DBG] pgmap v2097: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-16T06:46:58.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:46:58 smithi086 bash[24289]: cluster 2024-09-16T06:46:56.608921+0000 mgr.a (mgr.14373) 3025 : cluster [DBG] pgmap v2097: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-16T06:46:58.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:46:58 smithi047 bash[22744]: cluster 2024-09-16T06:46:56.608921+0000 mgr.a (mgr.14373) 3025 : cluster [DBG] pgmap v2097: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-16T06:46:59.018 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:46:59.019 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:46:59.019 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:46:59.781 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:46:59.781 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:46:59.781 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:46:59.781 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:46:59.781 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:47:00.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:47:00 smithi157 bash[24585]: cluster 2024-09-16T06:46:58.610153+0000 mgr.a (mgr.14373) 3026 : cluster [DBG] pgmap v2098: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.4 KiB/s rd, 2 op/s 2024-09-16T06:47:00.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:47:00 smithi086 bash[24289]: cluster 2024-09-16T06:46:58.610153+0000 mgr.a (mgr.14373) 3026 : cluster [DBG] pgmap v2098: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.4 KiB/s rd, 2 op/s 2024-09-16T06:47:00.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:47:00 smithi047 bash[22744]: cluster 2024-09-16T06:46:58.610153+0000 mgr.a (mgr.14373) 3026 : cluster [DBG] pgmap v2098: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.4 KiB/s rd, 2 op/s 2024-09-16T06:47:01.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:47:01 smithi157 bash[24585]: audit 2024-09-16T06:46:59.356656+0000 mgr.a (mgr.14373) 3027 : audit [DBG] from='client.76821 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:47:01.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:47:01 smithi086 bash[24289]: audit 2024-09-16T06:46:59.356656+0000 mgr.a (mgr.14373) 3027 : audit [DBG] from='client.76821 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:47:01.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:47:01 smithi047 bash[22744]: audit 2024-09-16T06:46:59.356656+0000 mgr.a (mgr.14373) 3027 : audit [DBG] from='client.76821 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:47:02.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:47:02 smithi157 bash[24585]: cluster 2024-09-16T06:47:00.611064+0000 mgr.a (mgr.14373) 3028 : cluster [DBG] pgmap v2099: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:47:02.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:47:02 smithi086 bash[24289]: cluster 2024-09-16T06:47:00.611064+0000 mgr.a (mgr.14373) 3028 : cluster [DBG] pgmap v2099: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:47:02.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:47:02 smithi047 bash[22744]: cluster 2024-09-16T06:47:00.611064+0000 mgr.a (mgr.14373) 3028 : cluster [DBG] pgmap v2099: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:47:04.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:47:04 smithi157 bash[24585]: cluster 2024-09-16T06:47:02.613290+0000 mgr.a (mgr.14373) 3029 : cluster [DBG] pgmap v2100: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:47:04.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:47:04 smithi086 bash[24289]: cluster 2024-09-16T06:47:02.613290+0000 mgr.a (mgr.14373) 3029 : cluster [DBG] pgmap v2100: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:47:04.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:47:04 smithi047 bash[22744]: cluster 2024-09-16T06:47:02.613290+0000 mgr.a (mgr.14373) 3029 : cluster [DBG] pgmap v2100: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:47:04.783 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:47:04.819 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:47:04.820 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:47:05.533 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:47:05.533 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:47:05.533 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:47:05.533 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:47:05.533 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:47:06.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:47:06 smithi157 bash[24585]: cluster 2024-09-16T06:47:04.614045+0000 mgr.a (mgr.14373) 3030 : cluster [DBG] pgmap v2101: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:47:06.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:47:06 smithi157 bash[24585]: audit 2024-09-16T06:47:05.115369+0000 mgr.a (mgr.14373) 3031 : audit [DBG] from='client.76896 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:47:06.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:47:06 smithi086 bash[24289]: cluster 2024-09-16T06:47:04.614045+0000 mgr.a (mgr.14373) 3030 : cluster [DBG] pgmap v2101: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:47:06.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:47:06 smithi086 bash[24289]: audit 2024-09-16T06:47:05.115369+0000 mgr.a (mgr.14373) 3031 : audit [DBG] from='client.76896 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:47:06.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:47:06 smithi047 bash[22744]: cluster 2024-09-16T06:47:04.614045+0000 mgr.a (mgr.14373) 3030 : cluster [DBG] pgmap v2101: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:47:06.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:47:06 smithi047 bash[22744]: audit 2024-09-16T06:47:05.115369+0000 mgr.a (mgr.14373) 3031 : audit [DBG] from='client.76896 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:47:08.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:47:08 smithi157 bash[24585]: cluster 2024-09-16T06:47:06.615899+0000 mgr.a (mgr.14373) 3032 : cluster [DBG] pgmap v2102: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-16T06:47:08.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:47:08 smithi086 bash[24289]: cluster 2024-09-16T06:47:06.615899+0000 mgr.a (mgr.14373) 3032 : cluster [DBG] pgmap v2102: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-16T06:47:08.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:47:08 smithi047 bash[22744]: cluster 2024-09-16T06:47:06.615899+0000 mgr.a (mgr.14373) 3032 : cluster [DBG] pgmap v2102: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-16T06:47:10.534 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:47:10.535 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:47:10.535 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:47:10.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:47:10 smithi157 bash[24585]: cluster 2024-09-16T06:47:08.617132+0000 mgr.a (mgr.14373) 3033 : cluster [DBG] pgmap v2103: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.4 KiB/s rd, 2 op/s 2024-09-16T06:47:10.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:47:10 smithi086 bash[24289]: cluster 2024-09-16T06:47:08.617132+0000 mgr.a (mgr.14373) 3033 : cluster [DBG] pgmap v2103: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.4 KiB/s rd, 2 op/s 2024-09-16T06:47:10.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:47:10 smithi047 bash[22744]: cluster 2024-09-16T06:47:08.617132+0000 mgr.a (mgr.14373) 3033 : cluster [DBG] pgmap v2103: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.4 KiB/s rd, 2 op/s 2024-09-16T06:47:11.297 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:47:11.298 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:47:11.298 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:47:11.298 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:47:11.298 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:47:12.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:47:12 smithi157 bash[24585]: cluster 2024-09-16T06:47:10.617886+0000 mgr.a (mgr.14373) 3034 : cluster [DBG] pgmap v2104: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:47:12.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:47:12 smithi157 bash[24585]: audit 2024-09-16T06:47:10.871313+0000 mgr.a (mgr.14373) 3035 : audit [DBG] from='client.76971 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:47:12.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:47:12 smithi086 bash[24289]: cluster 2024-09-16T06:47:10.617886+0000 mgr.a (mgr.14373) 3034 : cluster [DBG] pgmap v2104: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:47:12.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:47:12 smithi086 bash[24289]: audit 2024-09-16T06:47:10.871313+0000 mgr.a (mgr.14373) 3035 : audit [DBG] from='client.76971 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:47:12.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:47:12 smithi047 bash[22744]: cluster 2024-09-16T06:47:10.617886+0000 mgr.a (mgr.14373) 3034 : cluster [DBG] pgmap v2104: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:47:12.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:47:12 smithi047 bash[22744]: audit 2024-09-16T06:47:10.871313+0000 mgr.a (mgr.14373) 3035 : audit [DBG] from='client.76971 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:47:14.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:47:14 smithi157 bash[24585]: cluster 2024-09-16T06:47:12.620389+0000 mgr.a (mgr.14373) 3036 : cluster [DBG] pgmap v2105: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:47:14.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:47:14 smithi086 bash[24289]: cluster 2024-09-16T06:47:12.620389+0000 mgr.a (mgr.14373) 3036 : cluster [DBG] pgmap v2105: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:47:14.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:47:14 smithi047 bash[22744]: cluster 2024-09-16T06:47:12.620389+0000 mgr.a (mgr.14373) 3036 : cluster [DBG] pgmap v2105: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:47:16.299 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:47:16.300 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:47:16.300 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:47:16.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:47:16 smithi157 bash[24585]: cluster 2024-09-16T06:47:14.621181+0000 mgr.a (mgr.14373) 3037 : cluster [DBG] pgmap v2106: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:47:16.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:47:16 smithi086 bash[24289]: cluster 2024-09-16T06:47:14.621181+0000 mgr.a (mgr.14373) 3037 : cluster [DBG] pgmap v2106: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:47:16.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:47:16 smithi047 bash[22744]: cluster 2024-09-16T06:47:14.621181+0000 mgr.a (mgr.14373) 3037 : cluster [DBG] pgmap v2106: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:47:17.071 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:47:17.072 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:47:17.072 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:47:17.072 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:47:17.072 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:47:18.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:47:18 smithi157 bash[24585]: cluster 2024-09-16T06:47:16.622826+0000 mgr.a (mgr.14373) 3038 : cluster [DBG] pgmap v2107: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:47:18.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:47:18 smithi157 bash[24585]: audit 2024-09-16T06:47:16.641214+0000 mgr.a (mgr.14373) 3039 : audit [DBG] from='client.77049 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:47:18.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:47:18 smithi086 bash[24289]: cluster 2024-09-16T06:47:16.622826+0000 mgr.a (mgr.14373) 3038 : cluster [DBG] pgmap v2107: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:47:18.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:47:18 smithi086 bash[24289]: audit 2024-09-16T06:47:16.641214+0000 mgr.a (mgr.14373) 3039 : audit [DBG] from='client.77049 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:47:18.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:47:18 smithi047 bash[22744]: cluster 2024-09-16T06:47:16.622826+0000 mgr.a (mgr.14373) 3038 : cluster [DBG] pgmap v2107: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:47:18.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:47:18 smithi047 bash[22744]: audit 2024-09-16T06:47:16.641214+0000 mgr.a (mgr.14373) 3039 : audit [DBG] from='client.77049 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:47:19.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:47:19 smithi157 bash[24585]: cluster 2024-09-16T06:47:18.624551+0000 mgr.a (mgr.14373) 3040 : cluster [DBG] pgmap v2108: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-09-16T06:47:19.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:47:19 smithi086 bash[24289]: cluster 2024-09-16T06:47:18.624551+0000 mgr.a (mgr.14373) 3040 : cluster [DBG] pgmap v2108: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-09-16T06:47:19.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:47:19 smithi047 bash[22744]: cluster 2024-09-16T06:47:18.624551+0000 mgr.a (mgr.14373) 3040 : cluster [DBG] pgmap v2108: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-09-16T06:47:22.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:47:21 smithi157 bash[24585]: cluster 2024-09-16T06:47:20.625379+0000 mgr.a (mgr.14373) 3041 : cluster [DBG] pgmap v2109: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:47:22.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:47:21 smithi086 bash[24289]: cluster 2024-09-16T06:47:20.625379+0000 mgr.a (mgr.14373) 3041 : cluster [DBG] pgmap v2109: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:47:22.073 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:47:22.073 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:47:22.074 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:47:22.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:47:21 smithi047 bash[22744]: cluster 2024-09-16T06:47:20.625379+0000 mgr.a (mgr.14373) 3041 : cluster [DBG] pgmap v2109: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:47:22.834 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:47:22.834 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:47:22.834 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:47:22.834 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:47:22.834 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:47:24.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:47:23 smithi157 bash[24585]: audit 2024-09-16T06:47:22.410185+0000 mgr.a (mgr.14373) 3042 : audit [DBG] from='client.77127 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:47:24.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:47:23 smithi157 bash[24585]: cluster 2024-09-16T06:47:22.626748+0000 mgr.a (mgr.14373) 3043 : cluster [DBG] pgmap v2110: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:47:24.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:47:23 smithi086 bash[24289]: audit 2024-09-16T06:47:22.410185+0000 mgr.a (mgr.14373) 3042 : audit [DBG] from='client.77127 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:47:24.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:47:23 smithi086 bash[24289]: cluster 2024-09-16T06:47:22.626748+0000 mgr.a (mgr.14373) 3043 : cluster [DBG] pgmap v2110: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:47:24.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:47:23 smithi047 bash[22744]: audit 2024-09-16T06:47:22.410185+0000 mgr.a (mgr.14373) 3042 : audit [DBG] from='client.77127 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:47:24.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:47:23 smithi047 bash[22744]: cluster 2024-09-16T06:47:22.626748+0000 mgr.a (mgr.14373) 3043 : cluster [DBG] pgmap v2110: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:47:26.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:47:25 smithi157 bash[24585]: cluster 2024-09-16T06:47:24.627582+0000 mgr.a (mgr.14373) 3044 : cluster [DBG] pgmap v2111: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:47:26.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:47:25 smithi086 bash[24289]: cluster 2024-09-16T06:47:24.627582+0000 mgr.a (mgr.14373) 3044 : cluster [DBG] pgmap v2111: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:47:26.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:47:25 smithi047 bash[22744]: cluster 2024-09-16T06:47:24.627582+0000 mgr.a (mgr.14373) 3044 : cluster [DBG] pgmap v2111: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:47:27.835 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:47:27.836 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:47:27.836 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:47:28.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:47:27 smithi157 bash[24585]: cluster 2024-09-16T06:47:26.629454+0000 mgr.a (mgr.14373) 3045 : cluster [DBG] pgmap v2112: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T06:47:28.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:47:27 smithi086 bash[24289]: cluster 2024-09-16T06:47:26.629454+0000 mgr.a (mgr.14373) 3045 : cluster [DBG] pgmap v2112: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T06:47:28.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:47:27 smithi047 bash[22744]: cluster 2024-09-16T06:47:26.629454+0000 mgr.a (mgr.14373) 3045 : cluster [DBG] pgmap v2112: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T06:47:28.623 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:47:28.623 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:47:28.623 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:47:28.623 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:47:28.623 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:47:29.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:47:28 smithi157 bash[24585]: audit 2024-09-16T06:47:28.181938+0000 mgr.a (mgr.14373) 3046 : audit [DBG] from='client.77205 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:47:29.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:47:28 smithi086 bash[24289]: audit 2024-09-16T06:47:28.181938+0000 mgr.a (mgr.14373) 3046 : audit [DBG] from='client.77205 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:47:29.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:47:28 smithi047 bash[22744]: audit 2024-09-16T06:47:28.181938+0000 mgr.a (mgr.14373) 3046 : audit [DBG] from='client.77205 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:47:30.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:47:29 smithi157 bash[24585]: cluster 2024-09-16T06:47:28.630487+0000 mgr.a (mgr.14373) 3047 : cluster [DBG] pgmap v2113: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:47:30.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:47:29 smithi086 bash[24289]: cluster 2024-09-16T06:47:28.630487+0000 mgr.a (mgr.14373) 3047 : cluster [DBG] pgmap v2113: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:47:30.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:47:29 smithi047 bash[22744]: cluster 2024-09-16T06:47:28.630487+0000 mgr.a (mgr.14373) 3047 : cluster [DBG] pgmap v2113: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:47:32.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:47:31 smithi157 bash[24585]: cluster 2024-09-16T06:47:30.631259+0000 mgr.a (mgr.14373) 3048 : cluster [DBG] pgmap v2114: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:47:32.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:47:31 smithi086 bash[24289]: cluster 2024-09-16T06:47:30.631259+0000 mgr.a (mgr.14373) 3048 : cluster [DBG] pgmap v2114: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:47:32.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:47:31 smithi047 bash[22744]: cluster 2024-09-16T06:47:30.631259+0000 mgr.a (mgr.14373) 3048 : cluster [DBG] pgmap v2114: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:47:33.624 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:47:33.625 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:47:33.625 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:47:34.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:47:33 smithi157 bash[24585]: cluster 2024-09-16T06:47:32.633319+0000 mgr.a (mgr.14373) 3049 : cluster [DBG] pgmap v2115: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:47:34.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:47:33 smithi086 bash[24289]: cluster 2024-09-16T06:47:32.633319+0000 mgr.a (mgr.14373) 3049 : cluster [DBG] pgmap v2115: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:47:34.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:47:33 smithi047 bash[22744]: cluster 2024-09-16T06:47:32.633319+0000 mgr.a (mgr.14373) 3049 : cluster [DBG] pgmap v2115: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:47:34.382 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:47:34.383 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:47:34.383 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:47:34.383 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:47:34.383 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:47:35.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:47:34 smithi157 bash[24585]: audit 2024-09-16T06:47:33.723067+0000 mon.b (mon.2) 318 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T06:47:35.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:47:34 smithi157 bash[24585]: audit 2024-09-16T06:47:33.964200+0000 mgr.a (mgr.14373) 3050 : audit [DBG] from='client.77280 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:47:35.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:47:34 smithi157 bash[24585]: audit 2024-09-16T06:47:34.498280+0000 mon.b (mon.2) 319 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T06:47:35.055 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:47:34 smithi157 bash[24585]: audit 2024-09-16T06:47:34.500530+0000 mon.b (mon.2) 320 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T06:47:35.055 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:47:34 smithi157 bash[24585]: audit 2024-09-16T06:47:34.514191+0000 mon.a (mon.0) 754 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:47:35.055 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:47:34 smithi157 bash[24585]: audit 2024-09-16T06:47:34.517245+0000 mon.b (mon.2) 321 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:47:35.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:47:34 smithi086 bash[24289]: audit 2024-09-16T06:47:33.723067+0000 mon.b (mon.2) 318 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T06:47:35.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:47:34 smithi086 bash[24289]: audit 2024-09-16T06:47:33.964200+0000 mgr.a (mgr.14373) 3050 : audit [DBG] from='client.77280 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:47:35.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:47:34 smithi086 bash[24289]: audit 2024-09-16T06:47:34.498280+0000 mon.b (mon.2) 319 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T06:47:35.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:47:34 smithi086 bash[24289]: audit 2024-09-16T06:47:34.500530+0000 mon.b (mon.2) 320 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T06:47:35.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:47:34 smithi086 bash[24289]: audit 2024-09-16T06:47:34.514191+0000 mon.a (mon.0) 754 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:47:35.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:47:34 smithi086 bash[24289]: audit 2024-09-16T06:47:34.517245+0000 mon.b (mon.2) 321 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:47:35.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:47:34 smithi047 bash[22744]: audit 2024-09-16T06:47:33.723067+0000 mon.b (mon.2) 318 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T06:47:35.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:47:34 smithi047 bash[22744]: audit 2024-09-16T06:47:33.964200+0000 mgr.a (mgr.14373) 3050 : audit [DBG] from='client.77280 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:47:35.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:47:34 smithi047 bash[22744]: audit 2024-09-16T06:47:34.498280+0000 mon.b (mon.2) 319 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T06:47:35.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:47:34 smithi047 bash[22744]: audit 2024-09-16T06:47:34.500530+0000 mon.b (mon.2) 320 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T06:47:35.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:47:34 smithi047 bash[22744]: audit 2024-09-16T06:47:34.514191+0000 mon.a (mon.0) 754 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:47:35.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:47:34 smithi047 bash[22744]: audit 2024-09-16T06:47:34.517245+0000 mon.b (mon.2) 321 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:47:35.588 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 06:47:35 smithi047 bash[22994]: debug 2024-09-16T06:47:35.220+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T06:47:35.589 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 06:47:35 smithi047 bash[22994]: debug 2024-09-16T06:47:35.224+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T06:47:36.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:47:35 smithi157 bash[24585]: audit 2024-09-16T06:47:34.522142+0000 mgr.a (mgr.14373) 3051 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:47:36.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:47:35 smithi157 bash[24585]: cluster 2024-09-16T06:47:34.637735+0000 mgr.a (mgr.14373) 3052 : cluster [DBG] pgmap v2116: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:47:36.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:47:35 smithi157 bash[24585]: audit 2024-09-16T06:47:35.225105+0000 mgr.a (mgr.14373) 3053 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T06:47:36.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:47:35 smithi157 bash[24585]: cephadm 2024-09-16T06:47:35.227120+0000 mgr.a (mgr.14373) 3054 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T06:47:36.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:47:35 smithi086 bash[24289]: audit 2024-09-16T06:47:34.522142+0000 mgr.a (mgr.14373) 3051 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:47:36.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:47:35 smithi086 bash[24289]: cluster 2024-09-16T06:47:34.637735+0000 mgr.a (mgr.14373) 3052 : cluster [DBG] pgmap v2116: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:47:36.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:47:35 smithi086 bash[24289]: audit 2024-09-16T06:47:35.225105+0000 mgr.a (mgr.14373) 3053 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T06:47:36.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:47:35 smithi086 bash[24289]: cephadm 2024-09-16T06:47:35.227120+0000 mgr.a (mgr.14373) 3054 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T06:47:36.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:47:35 smithi047 bash[22744]: audit 2024-09-16T06:47:34.522142+0000 mgr.a (mgr.14373) 3051 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:47:36.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:47:35 smithi047 bash[22744]: cluster 2024-09-16T06:47:34.637735+0000 mgr.a (mgr.14373) 3052 : cluster [DBG] pgmap v2116: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:47:36.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:47:35 smithi047 bash[22744]: audit 2024-09-16T06:47:35.225105+0000 mgr.a (mgr.14373) 3053 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T06:47:36.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:47:35 smithi047 bash[22744]: cephadm 2024-09-16T06:47:35.227120+0000 mgr.a (mgr.14373) 3054 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T06:47:38.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:47:38 smithi157 bash[24585]: cluster 2024-09-16T06:47:36.639604+0000 mgr.a (mgr.14373) 3055 : cluster [DBG] pgmap v2117: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 4.6 KiB/s rd, 85 B/s wr, 4 op/s 2024-09-16T06:47:38.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:47:38 smithi086 bash[24289]: cluster 2024-09-16T06:47:36.639604+0000 mgr.a (mgr.14373) 3055 : cluster [DBG] pgmap v2117: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 4.6 KiB/s rd, 85 B/s wr, 4 op/s 2024-09-16T06:47:38.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:47:38 smithi047 bash[22744]: cluster 2024-09-16T06:47:36.639604+0000 mgr.a (mgr.14373) 3055 : cluster [DBG] pgmap v2117: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 4.6 KiB/s rd, 85 B/s wr, 4 op/s 2024-09-16T06:47:39.384 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:47:39.385 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:47:39.385 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:47:40.156 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:47:40.156 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:47:40.156 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:47:40.156 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:47:40.156 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:47:40.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:47:40 smithi157 bash[24585]: cluster 2024-09-16T06:47:38.640808+0000 mgr.a (mgr.14373) 3056 : cluster [DBG] pgmap v2118: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.6 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:47:40.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:47:40 smithi086 bash[24289]: cluster 2024-09-16T06:47:38.640808+0000 mgr.a (mgr.14373) 3056 : cluster [DBG] pgmap v2118: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.6 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:47:40.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:47:40 smithi047 bash[22744]: cluster 2024-09-16T06:47:38.640808+0000 mgr.a (mgr.14373) 3056 : cluster [DBG] pgmap v2118: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.6 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:47:41.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:47:41 smithi157 bash[24585]: audit 2024-09-16T06:47:39.723552+0000 mgr.a (mgr.14373) 3057 : audit [DBG] from='client.77463 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:47:41.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:47:41 smithi086 bash[24289]: audit 2024-09-16T06:47:39.723552+0000 mgr.a (mgr.14373) 3057 : audit [DBG] from='client.77463 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:47:41.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:47:41 smithi047 bash[22744]: audit 2024-09-16T06:47:39.723552+0000 mgr.a (mgr.14373) 3057 : audit [DBG] from='client.77463 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:47:42.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:47:42 smithi157 bash[24585]: cluster 2024-09-16T06:47:40.641676+0000 mgr.a (mgr.14373) 3058 : cluster [DBG] pgmap v2119: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:47:42.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:47:42 smithi086 bash[24289]: cluster 2024-09-16T06:47:40.641676+0000 mgr.a (mgr.14373) 3058 : cluster [DBG] pgmap v2119: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:47:42.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:47:42 smithi047 bash[22744]: cluster 2024-09-16T06:47:40.641676+0000 mgr.a (mgr.14373) 3058 : cluster [DBG] pgmap v2119: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:47:44.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:47:44 smithi157 bash[24585]: cluster 2024-09-16T06:47:42.643894+0000 mgr.a (mgr.14373) 3059 : cluster [DBG] pgmap v2120: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:47:44.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:47:44 smithi086 bash[24289]: cluster 2024-09-16T06:47:42.643894+0000 mgr.a (mgr.14373) 3059 : cluster [DBG] pgmap v2120: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:47:44.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:47:44 smithi047 bash[22744]: cluster 2024-09-16T06:47:42.643894+0000 mgr.a (mgr.14373) 3059 : cluster [DBG] pgmap v2120: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:47:45.157 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:47:45.158 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:47:45.158 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:47:45.939 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:47:45.939 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:47:45.939 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:47:45.940 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:47:45.940 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:47:46.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:47:46 smithi157 bash[24585]: cluster 2024-09-16T06:47:44.644650+0000 mgr.a (mgr.14373) 3060 : cluster [DBG] pgmap v2121: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:47:46.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:47:46 smithi086 bash[24289]: cluster 2024-09-16T06:47:44.644650+0000 mgr.a (mgr.14373) 3060 : cluster [DBG] pgmap v2121: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:47:46.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:47:46 smithi047 bash[22744]: cluster 2024-09-16T06:47:44.644650+0000 mgr.a (mgr.14373) 3060 : cluster [DBG] pgmap v2121: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:47:47.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:47:47 smithi157 bash[24585]: audit 2024-09-16T06:47:45.493328+0000 mgr.a (mgr.14373) 3061 : audit [DBG] from='client.77538 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:47:47.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:47:47 smithi086 bash[24289]: audit 2024-09-16T06:47:45.493328+0000 mgr.a (mgr.14373) 3061 : audit [DBG] from='client.77538 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:47:47.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:47:47 smithi047 bash[22744]: audit 2024-09-16T06:47:45.493328+0000 mgr.a (mgr.14373) 3061 : audit [DBG] from='client.77538 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:47:48.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:47:48 smithi157 bash[24585]: cluster 2024-09-16T06:47:46.646511+0000 mgr.a (mgr.14373) 3062 : cluster [DBG] pgmap v2122: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.3 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:47:48.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:47:48 smithi086 bash[24289]: cluster 2024-09-16T06:47:46.646511+0000 mgr.a (mgr.14373) 3062 : cluster [DBG] pgmap v2122: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.3 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:47:48.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:47:48 smithi047 bash[22744]: cluster 2024-09-16T06:47:46.646511+0000 mgr.a (mgr.14373) 3062 : cluster [DBG] pgmap v2122: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.3 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:47:50.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:47:50 smithi157 bash[24585]: cluster 2024-09-16T06:47:48.647746+0000 mgr.a (mgr.14373) 3063 : cluster [DBG] pgmap v2123: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 5.2 KiB/s rd, 341 B/s wr, 4 op/s 2024-09-16T06:47:50.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:47:50 smithi086 bash[24289]: cluster 2024-09-16T06:47:48.647746+0000 mgr.a (mgr.14373) 3063 : cluster [DBG] pgmap v2123: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 5.2 KiB/s rd, 341 B/s wr, 4 op/s 2024-09-16T06:47:50.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:47:50 smithi047 bash[22744]: cluster 2024-09-16T06:47:48.647746+0000 mgr.a (mgr.14373) 3063 : cluster [DBG] pgmap v2123: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 5.2 KiB/s rd, 341 B/s wr, 4 op/s 2024-09-16T06:47:50.941 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:47:50.996 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:47:50.996 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:47:51.699 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:47:51.700 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:47:51.700 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:47:51.700 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:47:51.700 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:47:52.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:47:52 smithi157 bash[24585]: cluster 2024-09-16T06:47:50.648494+0000 mgr.a (mgr.14373) 3064 : cluster [DBG] pgmap v2124: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:47:52.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:47:52 smithi086 bash[24289]: cluster 2024-09-16T06:47:50.648494+0000 mgr.a (mgr.14373) 3064 : cluster [DBG] pgmap v2124: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:47:52.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:47:52 smithi047 bash[22744]: cluster 2024-09-16T06:47:50.648494+0000 mgr.a (mgr.14373) 3064 : cluster [DBG] pgmap v2124: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:47:53.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:47:53 smithi157 bash[24585]: audit 2024-09-16T06:47:51.274825+0000 mgr.a (mgr.14373) 3065 : audit [DBG] from='client.77613 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:47:53.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:47:53 smithi086 bash[24289]: audit 2024-09-16T06:47:51.274825+0000 mgr.a (mgr.14373) 3065 : audit [DBG] from='client.77613 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:47:53.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:47:53 smithi047 bash[22744]: audit 2024-09-16T06:47:51.274825+0000 mgr.a (mgr.14373) 3065 : audit [DBG] from='client.77613 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:47:54.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:47:54 smithi157 bash[24585]: cluster 2024-09-16T06:47:52.650908+0000 mgr.a (mgr.14373) 3066 : cluster [DBG] pgmap v2125: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.4 KiB/s rd, 2 op/s 2024-09-16T06:47:54.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:47:54 smithi086 bash[24289]: cluster 2024-09-16T06:47:52.650908+0000 mgr.a (mgr.14373) 3066 : cluster [DBG] pgmap v2125: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.4 KiB/s rd, 2 op/s 2024-09-16T06:47:54.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:47:54 smithi047 bash[22744]: cluster 2024-09-16T06:47:52.650908+0000 mgr.a (mgr.14373) 3066 : cluster [DBG] pgmap v2125: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.4 KiB/s rd, 2 op/s 2024-09-16T06:47:56.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:47:56 smithi157 bash[24585]: cluster 2024-09-16T06:47:54.651725+0000 mgr.a (mgr.14373) 3067 : cluster [DBG] pgmap v2126: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-09-16T06:47:56.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:47:56 smithi086 bash[24289]: cluster 2024-09-16T06:47:54.651725+0000 mgr.a (mgr.14373) 3067 : cluster [DBG] pgmap v2126: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-09-16T06:47:56.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:47:56 smithi047 bash[22744]: cluster 2024-09-16T06:47:54.651725+0000 mgr.a (mgr.14373) 3067 : cluster [DBG] pgmap v2126: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-09-16T06:47:56.701 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:47:56.702 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:47:56.702 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:47:57.458 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:47:57.458 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:47:57.458 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:47:57.458 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:47:57.458 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:47:58.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:47:58 smithi157 bash[24585]: cluster 2024-09-16T06:47:56.653279+0000 mgr.a (mgr.14373) 3068 : cluster [DBG] pgmap v2127: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:47:58.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:47:58 smithi157 bash[24585]: audit 2024-09-16T06:47:57.037225+0000 mgr.a (mgr.14373) 3069 : audit [DBG] from='client.77691 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:47:58.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:47:58 smithi086 bash[24289]: cluster 2024-09-16T06:47:56.653279+0000 mgr.a (mgr.14373) 3068 : cluster [DBG] pgmap v2127: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:47:58.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:47:58 smithi086 bash[24289]: audit 2024-09-16T06:47:57.037225+0000 mgr.a (mgr.14373) 3069 : audit [DBG] from='client.77691 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:47:58.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:47:58 smithi047 bash[22744]: cluster 2024-09-16T06:47:56.653279+0000 mgr.a (mgr.14373) 3068 : cluster [DBG] pgmap v2127: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:47:58.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:47:58 smithi047 bash[22744]: audit 2024-09-16T06:47:57.037225+0000 mgr.a (mgr.14373) 3069 : audit [DBG] from='client.77691 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:47:59.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:47:59 smithi157 bash[24585]: cluster 2024-09-16T06:47:58.654930+0000 mgr.a (mgr.14373) 3070 : cluster [DBG] pgmap v2128: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-09-16T06:47:59.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:47:59 smithi086 bash[24289]: cluster 2024-09-16T06:47:58.654930+0000 mgr.a (mgr.14373) 3070 : cluster [DBG] pgmap v2128: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-09-16T06:47:59.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:47:59 smithi047 bash[22744]: cluster 2024-09-16T06:47:58.654930+0000 mgr.a (mgr.14373) 3070 : cluster [DBG] pgmap v2128: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-09-16T06:48:02.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:48:01 smithi157 bash[24585]: cluster 2024-09-16T06:48:00.655693+0000 mgr.a (mgr.14373) 3071 : cluster [DBG] pgmap v2129: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T06:48:02.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:48:01 smithi086 bash[24289]: cluster 2024-09-16T06:48:00.655693+0000 mgr.a (mgr.14373) 3071 : cluster [DBG] pgmap v2129: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T06:48:02.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:48:01 smithi047 bash[22744]: cluster 2024-09-16T06:48:00.655693+0000 mgr.a (mgr.14373) 3071 : cluster [DBG] pgmap v2129: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T06:48:02.459 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:48:02.460 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:48:02.460 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:48:03.247 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:48:03.248 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:48:03.248 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:48:03.248 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:48:03.248 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:48:04.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:48:03 smithi157 bash[24585]: cluster 2024-09-16T06:48:02.657432+0000 mgr.a (mgr.14373) 3072 : cluster [DBG] pgmap v2130: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:48:04.055 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:48:03 smithi157 bash[24585]: audit 2024-09-16T06:48:02.801144+0000 mgr.a (mgr.14373) 3073 : audit [DBG] from='client.77766 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:48:04.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:48:03 smithi086 bash[24289]: cluster 2024-09-16T06:48:02.657432+0000 mgr.a (mgr.14373) 3072 : cluster [DBG] pgmap v2130: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:48:04.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:48:03 smithi086 bash[24289]: audit 2024-09-16T06:48:02.801144+0000 mgr.a (mgr.14373) 3073 : audit [DBG] from='client.77766 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:48:04.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:48:03 smithi047 bash[22744]: cluster 2024-09-16T06:48:02.657432+0000 mgr.a (mgr.14373) 3072 : cluster [DBG] pgmap v2130: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:48:04.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:48:03 smithi047 bash[22744]: audit 2024-09-16T06:48:02.801144+0000 mgr.a (mgr.14373) 3073 : audit [DBG] from='client.77766 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:48:06.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:48:05 smithi157 bash[24585]: cluster 2024-09-16T06:48:04.658316+0000 mgr.a (mgr.14373) 3074 : cluster [DBG] pgmap v2131: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T06:48:06.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:48:05 smithi086 bash[24289]: cluster 2024-09-16T06:48:04.658316+0000 mgr.a (mgr.14373) 3074 : cluster [DBG] pgmap v2131: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T06:48:06.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:48:05 smithi047 bash[22744]: cluster 2024-09-16T06:48:04.658316+0000 mgr.a (mgr.14373) 3074 : cluster [DBG] pgmap v2131: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T06:48:08.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:48:07 smithi157 bash[24585]: cluster 2024-09-16T06:48:06.660095+0000 mgr.a (mgr.14373) 3075 : cluster [DBG] pgmap v2132: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 5.3 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-16T06:48:08.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:48:07 smithi086 bash[24289]: cluster 2024-09-16T06:48:06.660095+0000 mgr.a (mgr.14373) 3075 : cluster [DBG] pgmap v2132: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 5.3 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-16T06:48:08.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:48:07 smithi047 bash[22744]: cluster 2024-09-16T06:48:06.660095+0000 mgr.a (mgr.14373) 3075 : cluster [DBG] pgmap v2132: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 5.3 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-16T06:48:08.249 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:48:08.250 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:48:08.250 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:48:09.061 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:48:09.061 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:48:09.061 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:48:09.061 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:48:09.061 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:48:10.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:48:09 smithi157 bash[24585]: audit 2024-09-16T06:48:08.618362+0000 mgr.a (mgr.14373) 3076 : audit [DBG] from='client.77841 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:48:10.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:48:09 smithi157 bash[24585]: cluster 2024-09-16T06:48:08.661757+0000 mgr.a (mgr.14373) 3077 : cluster [DBG] pgmap v2133: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-16T06:48:10.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:48:09 smithi086 bash[24289]: audit 2024-09-16T06:48:08.618362+0000 mgr.a (mgr.14373) 3076 : audit [DBG] from='client.77841 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:48:10.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:48:09 smithi086 bash[24289]: cluster 2024-09-16T06:48:08.661757+0000 mgr.a (mgr.14373) 3077 : cluster [DBG] pgmap v2133: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-16T06:48:10.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:48:09 smithi047 bash[22744]: audit 2024-09-16T06:48:08.618362+0000 mgr.a (mgr.14373) 3076 : audit [DBG] from='client.77841 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:48:10.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:48:09 smithi047 bash[22744]: cluster 2024-09-16T06:48:08.661757+0000 mgr.a (mgr.14373) 3077 : cluster [DBG] pgmap v2133: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-16T06:48:12.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:48:11 smithi157 bash[24585]: cluster 2024-09-16T06:48:10.662708+0000 mgr.a (mgr.14373) 3078 : cluster [DBG] pgmap v2134: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-16T06:48:12.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:48:11 smithi086 bash[24289]: cluster 2024-09-16T06:48:10.662708+0000 mgr.a (mgr.14373) 3078 : cluster [DBG] pgmap v2134: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-16T06:48:12.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:48:11 smithi047 bash[22744]: cluster 2024-09-16T06:48:10.662708+0000 mgr.a (mgr.14373) 3078 : cluster [DBG] pgmap v2134: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-16T06:48:14.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:48:13 smithi157 bash[24585]: cluster 2024-09-16T06:48:12.664929+0000 mgr.a (mgr.14373) 3079 : cluster [DBG] pgmap v2135: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 71 KiB/s rd, 0 B/s wr, 115 op/s 2024-09-16T06:48:14.062 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:48:14.063 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:48:14.063 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:48:14.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:48:13 smithi086 bash[24289]: cluster 2024-09-16T06:48:12.664929+0000 mgr.a (mgr.14373) 3079 : cluster [DBG] pgmap v2135: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 71 KiB/s rd, 0 B/s wr, 115 op/s 2024-09-16T06:48:14.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:48:13 smithi047 bash[22744]: cluster 2024-09-16T06:48:12.664929+0000 mgr.a (mgr.14373) 3079 : cluster [DBG] pgmap v2135: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 71 KiB/s rd, 0 B/s wr, 115 op/s 2024-09-16T06:48:14.841 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:48:14.841 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:48:14.841 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:48:14.841 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:48:14.841 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:48:16.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:48:15 smithi157 bash[24585]: audit 2024-09-16T06:48:14.403237+0000 mgr.a (mgr.14373) 3080 : audit [DBG] from='client.77916 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:48:16.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:48:15 smithi157 bash[24585]: cluster 2024-09-16T06:48:14.665490+0000 mgr.a (mgr.14373) 3081 : cluster [DBG] pgmap v2136: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 70 KiB/s rd, 0 B/s wr, 114 op/s 2024-09-16T06:48:16.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:48:15 smithi086 bash[24289]: audit 2024-09-16T06:48:14.403237+0000 mgr.a (mgr.14373) 3080 : audit [DBG] from='client.77916 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:48:16.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:48:15 smithi086 bash[24289]: cluster 2024-09-16T06:48:14.665490+0000 mgr.a (mgr.14373) 3081 : cluster [DBG] pgmap v2136: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 70 KiB/s rd, 0 B/s wr, 114 op/s 2024-09-16T06:48:16.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:48:15 smithi047 bash[22744]: audit 2024-09-16T06:48:14.403237+0000 mgr.a (mgr.14373) 3080 : audit [DBG] from='client.77916 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:48:16.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:48:15 smithi047 bash[22744]: cluster 2024-09-16T06:48:14.665490+0000 mgr.a (mgr.14373) 3081 : cluster [DBG] pgmap v2136: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 70 KiB/s rd, 0 B/s wr, 114 op/s 2024-09-16T06:48:18.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:48:17 smithi157 bash[24585]: cluster 2024-09-16T06:48:16.667380+0000 mgr.a (mgr.14373) 3082 : cluster [DBG] pgmap v2137: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 70 KiB/s rd, 0 B/s wr, 115 op/s 2024-09-16T06:48:18.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:48:17 smithi086 bash[24289]: cluster 2024-09-16T06:48:16.667380+0000 mgr.a (mgr.14373) 3082 : cluster [DBG] pgmap v2137: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 70 KiB/s rd, 0 B/s wr, 115 op/s 2024-09-16T06:48:18.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:48:17 smithi047 bash[22744]: cluster 2024-09-16T06:48:16.667380+0000 mgr.a (mgr.14373) 3082 : cluster [DBG] pgmap v2137: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 70 KiB/s rd, 0 B/s wr, 115 op/s 2024-09-16T06:48:19.842 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:48:19.843 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:48:19.844 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:48:20.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:48:19 smithi157 bash[24585]: cluster 2024-09-16T06:48:18.668718+0000 mgr.a (mgr.14373) 3083 : cluster [DBG] pgmap v2138: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 67 KiB/s rd, 0 B/s wr, 109 op/s 2024-09-16T06:48:20.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:48:19 smithi086 bash[24289]: cluster 2024-09-16T06:48:18.668718+0000 mgr.a (mgr.14373) 3083 : cluster [DBG] pgmap v2138: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 67 KiB/s rd, 0 B/s wr, 109 op/s 2024-09-16T06:48:20.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:48:19 smithi047 bash[22744]: cluster 2024-09-16T06:48:18.668718+0000 mgr.a (mgr.14373) 3083 : cluster [DBG] pgmap v2138: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 67 KiB/s rd, 0 B/s wr, 109 op/s 2024-09-16T06:48:20.585 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:48:20.586 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:48:20.586 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:48:20.586 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:48:20.586 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:48:21.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:48:20 smithi157 bash[24585]: audit 2024-09-16T06:48:20.175524+0000 mgr.a (mgr.14373) 3084 : audit [DBG] from='client.77991 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:48:21.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:48:20 smithi086 bash[24289]: audit 2024-09-16T06:48:20.175524+0000 mgr.a (mgr.14373) 3084 : audit [DBG] from='client.77991 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:48:21.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:48:20 smithi047 bash[22744]: audit 2024-09-16T06:48:20.175524+0000 mgr.a (mgr.14373) 3084 : audit [DBG] from='client.77991 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:48:22.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:48:21 smithi157 bash[24585]: cluster 2024-09-16T06:48:20.669268+0000 mgr.a (mgr.14373) 3085 : cluster [DBG] pgmap v2139: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 65 KiB/s rd, 0 B/s wr, 107 op/s 2024-09-16T06:48:22.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:48:21 smithi086 bash[24289]: cluster 2024-09-16T06:48:20.669268+0000 mgr.a (mgr.14373) 3085 : cluster [DBG] pgmap v2139: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 65 KiB/s rd, 0 B/s wr, 107 op/s 2024-09-16T06:48:22.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:48:21 smithi047 bash[22744]: cluster 2024-09-16T06:48:20.669268+0000 mgr.a (mgr.14373) 3085 : cluster [DBG] pgmap v2139: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 65 KiB/s rd, 0 B/s wr, 107 op/s 2024-09-16T06:48:24.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:48:23 smithi157 bash[24585]: cluster 2024-09-16T06:48:22.671495+0000 mgr.a (mgr.14373) 3086 : cluster [DBG] pgmap v2140: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 66 KiB/s rd, 0 B/s wr, 108 op/s 2024-09-16T06:48:24.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:48:23 smithi086 bash[24289]: cluster 2024-09-16T06:48:22.671495+0000 mgr.a (mgr.14373) 3086 : cluster [DBG] pgmap v2140: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 66 KiB/s rd, 0 B/s wr, 108 op/s 2024-09-16T06:48:24.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:48:23 smithi047 bash[22744]: cluster 2024-09-16T06:48:22.671495+0000 mgr.a (mgr.14373) 3086 : cluster [DBG] pgmap v2140: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 66 KiB/s rd, 0 B/s wr, 108 op/s 2024-09-16T06:48:25.587 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:48:25.588 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:48:25.588 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:48:26.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:48:25 smithi157 bash[24585]: cluster 2024-09-16T06:48:24.672228+0000 mgr.a (mgr.14373) 3087 : cluster [DBG] pgmap v2141: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:48:26.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:48:25 smithi086 bash[24289]: cluster 2024-09-16T06:48:24.672228+0000 mgr.a (mgr.14373) 3087 : cluster [DBG] pgmap v2141: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:48:26.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:48:25 smithi047 bash[22744]: cluster 2024-09-16T06:48:24.672228+0000 mgr.a (mgr.14373) 3087 : cluster [DBG] pgmap v2141: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:48:26.358 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:48:26.358 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:48:26.358 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:48:26.358 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:48:26.358 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:48:27.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:48:26 smithi157 bash[24585]: audit 2024-09-16T06:48:25.929359+0000 mgr.a (mgr.14373) 3088 : audit [DBG] from='client.78066 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:48:27.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:48:26 smithi086 bash[24289]: audit 2024-09-16T06:48:25.929359+0000 mgr.a (mgr.14373) 3088 : audit [DBG] from='client.78066 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:48:27.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:48:26 smithi047 bash[22744]: audit 2024-09-16T06:48:25.929359+0000 mgr.a (mgr.14373) 3088 : audit [DBG] from='client.78066 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:48:28.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:48:27 smithi157 bash[24585]: cluster 2024-09-16T06:48:26.674126+0000 mgr.a (mgr.14373) 3089 : cluster [DBG] pgmap v2142: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-16T06:48:28.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:48:27 smithi086 bash[24289]: cluster 2024-09-16T06:48:26.674126+0000 mgr.a (mgr.14373) 3089 : cluster [DBG] pgmap v2142: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-16T06:48:28.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:48:27 smithi047 bash[22744]: cluster 2024-09-16T06:48:26.674126+0000 mgr.a (mgr.14373) 3089 : cluster [DBG] pgmap v2142: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-16T06:48:30.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:48:29 smithi157 bash[24585]: cluster 2024-09-16T06:48:28.675524+0000 mgr.a (mgr.14373) 3090 : cluster [DBG] pgmap v2143: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.4 KiB/s rd, 2 op/s 2024-09-16T06:48:30.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:48:29 smithi086 bash[24289]: cluster 2024-09-16T06:48:28.675524+0000 mgr.a (mgr.14373) 3090 : cluster [DBG] pgmap v2143: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.4 KiB/s rd, 2 op/s 2024-09-16T06:48:30.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:48:29 smithi047 bash[22744]: cluster 2024-09-16T06:48:28.675524+0000 mgr.a (mgr.14373) 3090 : cluster [DBG] pgmap v2143: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.4 KiB/s rd, 2 op/s 2024-09-16T06:48:31.359 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:48:31.360 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:48:31.360 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:48:32.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:48:31 smithi157 bash[24585]: cluster 2024-09-16T06:48:30.676484+0000 mgr.a (mgr.14373) 3091 : cluster [DBG] pgmap v2144: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:48:32.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:48:31 smithi086 bash[24289]: cluster 2024-09-16T06:48:30.676484+0000 mgr.a (mgr.14373) 3091 : cluster [DBG] pgmap v2144: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:48:32.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:48:31 smithi047 bash[22744]: cluster 2024-09-16T06:48:30.676484+0000 mgr.a (mgr.14373) 3091 : cluster [DBG] pgmap v2144: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:48:32.133 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:48:32.133 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:48:32.133 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:48:32.133 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:48:32.133 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:48:33.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:48:32 smithi157 bash[24585]: audit 2024-09-16T06:48:31.698044+0000 mgr.a (mgr.14373) 3092 : audit [DBG] from='client.78144 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:48:33.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:48:32 smithi086 bash[24289]: audit 2024-09-16T06:48:31.698044+0000 mgr.a (mgr.14373) 3092 : audit [DBG] from='client.78144 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:48:33.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:48:32 smithi047 bash[22744]: audit 2024-09-16T06:48:31.698044+0000 mgr.a (mgr.14373) 3092 : audit [DBG] from='client.78144 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:48:34.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:48:33 smithi157 bash[24585]: cluster 2024-09-16T06:48:32.679331+0000 mgr.a (mgr.14373) 3093 : cluster [DBG] pgmap v2145: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:48:34.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:48:33 smithi086 bash[24289]: cluster 2024-09-16T06:48:32.679331+0000 mgr.a (mgr.14373) 3093 : cluster [DBG] pgmap v2145: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:48:34.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:48:33 smithi047 bash[22744]: cluster 2024-09-16T06:48:32.679331+0000 mgr.a (mgr.14373) 3093 : cluster [DBG] pgmap v2145: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:48:36.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:48:35 smithi157 bash[24585]: cluster 2024-09-16T06:48:34.680142+0000 mgr.a (mgr.14373) 3094 : cluster [DBG] pgmap v2146: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:48:36.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:48:35 smithi157 bash[24585]: audit 2024-09-16T06:48:35.276830+0000 mon.b (mon.2) 322 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T06:48:36.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:48:35 smithi086 bash[24289]: cluster 2024-09-16T06:48:34.680142+0000 mgr.a (mgr.14373) 3094 : cluster [DBG] pgmap v2146: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:48:36.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:48:35 smithi086 bash[24289]: audit 2024-09-16T06:48:35.276830+0000 mon.b (mon.2) 322 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T06:48:36.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:48:35 smithi047 bash[22744]: cluster 2024-09-16T06:48:34.680142+0000 mgr.a (mgr.14373) 3094 : cluster [DBG] pgmap v2146: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:48:36.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:48:35 smithi047 bash[22744]: audit 2024-09-16T06:48:35.276830+0000 mon.b (mon.2) 322 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T06:48:37.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:48:36 smithi157 bash[24585]: audit 2024-09-16T06:48:36.112915+0000 mon.b (mon.2) 323 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T06:48:37.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:48:36 smithi157 bash[24585]: audit 2024-09-16T06:48:36.114930+0000 mon.b (mon.2) 324 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T06:48:37.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:48:36 smithi157 bash[24585]: audit 2024-09-16T06:48:36.128564+0000 mon.a (mon.0) 755 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:48:37.055 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:48:36 smithi157 bash[24585]: audit 2024-09-16T06:48:36.132129+0000 mon.b (mon.2) 325 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:48:37.055 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:48:36 smithi157 bash[24585]: audit 2024-09-16T06:48:36.136697+0000 mgr.a (mgr.14373) 3095 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:48:37.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:48:36 smithi086 bash[24289]: audit 2024-09-16T06:48:36.112915+0000 mon.b (mon.2) 323 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T06:48:37.072 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:48:36 smithi086 bash[24289]: audit 2024-09-16T06:48:36.114930+0000 mon.b (mon.2) 324 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T06:48:37.072 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:48:36 smithi086 bash[24289]: audit 2024-09-16T06:48:36.128564+0000 mon.a (mon.0) 755 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:48:37.072 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:48:36 smithi086 bash[24289]: audit 2024-09-16T06:48:36.132129+0000 mon.b (mon.2) 325 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:48:37.072 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:48:36 smithi086 bash[24289]: audit 2024-09-16T06:48:36.136697+0000 mgr.a (mgr.14373) 3095 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:48:37.088 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 06:48:36 smithi047 bash[22994]: debug 2024-09-16T06:48:36.839+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T06:48:37.089 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 06:48:36 smithi047 bash[22994]: debug 2024-09-16T06:48:36.839+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T06:48:37.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:48:36 smithi047 bash[22744]: audit 2024-09-16T06:48:36.112915+0000 mon.b (mon.2) 323 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T06:48:37.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:48:36 smithi047 bash[22744]: audit 2024-09-16T06:48:36.114930+0000 mon.b (mon.2) 324 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T06:48:37.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:48:36 smithi047 bash[22744]: audit 2024-09-16T06:48:36.128564+0000 mon.a (mon.0) 755 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:48:37.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:48:36 smithi047 bash[22744]: audit 2024-09-16T06:48:36.132129+0000 mon.b (mon.2) 325 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:48:37.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:48:36 smithi047 bash[22744]: audit 2024-09-16T06:48:36.136697+0000 mgr.a (mgr.14373) 3095 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:48:37.134 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:48:37.135 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:48:37.135 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:48:37.878 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:48:37.878 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:48:37.878 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:48:37.879 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:48:37.879 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:48:38.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:48:38 smithi157 bash[24585]: cluster 2024-09-16T06:48:36.681209+0000 mgr.a (mgr.14373) 3096 : cluster [DBG] pgmap v2147: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 85 B/s wr, 2 op/s 2024-09-16T06:48:38.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:48:38 smithi157 bash[24585]: audit 2024-09-16T06:48:36.842365+0000 mgr.a (mgr.14373) 3097 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T06:48:38.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:48:38 smithi157 bash[24585]: cephadm 2024-09-16T06:48:36.843990+0000 mgr.a (mgr.14373) 3098 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T06:48:38.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:48:38 smithi086 bash[24289]: cluster 2024-09-16T06:48:36.681209+0000 mgr.a (mgr.14373) 3096 : cluster [DBG] pgmap v2147: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 85 B/s wr, 2 op/s 2024-09-16T06:48:38.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:48:38 smithi086 bash[24289]: audit 2024-09-16T06:48:36.842365+0000 mgr.a (mgr.14373) 3097 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T06:48:38.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:48:38 smithi086 bash[24289]: cephadm 2024-09-16T06:48:36.843990+0000 mgr.a (mgr.14373) 3098 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T06:48:38.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:48:38 smithi047 bash[22744]: cluster 2024-09-16T06:48:36.681209+0000 mgr.a (mgr.14373) 3096 : cluster [DBG] pgmap v2147: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 85 B/s wr, 2 op/s 2024-09-16T06:48:38.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:48:38 smithi047 bash[22744]: audit 2024-09-16T06:48:36.842365+0000 mgr.a (mgr.14373) 3097 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T06:48:38.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:48:38 smithi047 bash[22744]: cephadm 2024-09-16T06:48:36.843990+0000 mgr.a (mgr.14373) 3098 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T06:48:39.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:48:39 smithi157 bash[24585]: audit 2024-09-16T06:48:37.458189+0000 mgr.a (mgr.14373) 3099 : audit [DBG] from='client.78324 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:48:39.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:48:39 smithi086 bash[24289]: audit 2024-09-16T06:48:37.458189+0000 mgr.a (mgr.14373) 3099 : audit [DBG] from='client.78324 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:48:39.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:48:39 smithi047 bash[22744]: audit 2024-09-16T06:48:37.458189+0000 mgr.a (mgr.14373) 3099 : audit [DBG] from='client.78324 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:48:40.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:48:40 smithi157 bash[24585]: cluster 2024-09-16T06:48:38.683045+0000 mgr.a (mgr.14373) 3100 : cluster [DBG] pgmap v2148: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 3.2 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-16T06:48:40.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:48:40 smithi086 bash[24289]: cluster 2024-09-16T06:48:38.683045+0000 mgr.a (mgr.14373) 3100 : cluster [DBG] pgmap v2148: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 3.2 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-16T06:48:40.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:48:40 smithi047 bash[22744]: cluster 2024-09-16T06:48:38.683045+0000 mgr.a (mgr.14373) 3100 : cluster [DBG] pgmap v2148: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 3.2 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-16T06:48:42.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:48:42 smithi157 bash[24585]: cluster 2024-09-16T06:48:40.683977+0000 mgr.a (mgr.14373) 3101 : cluster [DBG] pgmap v2149: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-16T06:48:42.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:48:42 smithi086 bash[24289]: cluster 2024-09-16T06:48:40.683977+0000 mgr.a (mgr.14373) 3101 : cluster [DBG] pgmap v2149: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-16T06:48:42.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:48:42 smithi047 bash[22744]: cluster 2024-09-16T06:48:40.683977+0000 mgr.a (mgr.14373) 3101 : cluster [DBG] pgmap v2149: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-16T06:48:42.880 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:48:42.881 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:48:42.881 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:48:43.652 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:48:43.652 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:48:43.652 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:48:43.653 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:48:43.653 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:48:44.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:48:44 smithi157 bash[24585]: cluster 2024-09-16T06:48:42.686078+0000 mgr.a (mgr.14373) 3102 : cluster [DBG] pgmap v2150: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:48:44.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:48:44 smithi157 bash[24585]: audit 2024-09-16T06:48:43.223659+0000 mgr.a (mgr.14373) 3103 : audit [DBG] from='client.78399 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:48:44.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:48:44 smithi086 bash[24289]: cluster 2024-09-16T06:48:42.686078+0000 mgr.a (mgr.14373) 3102 : cluster [DBG] pgmap v2150: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:48:44.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:48:44 smithi086 bash[24289]: audit 2024-09-16T06:48:43.223659+0000 mgr.a (mgr.14373) 3103 : audit [DBG] from='client.78399 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:48:44.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:48:44 smithi047 bash[22744]: cluster 2024-09-16T06:48:42.686078+0000 mgr.a (mgr.14373) 3102 : cluster [DBG] pgmap v2150: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:48:44.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:48:44 smithi047 bash[22744]: audit 2024-09-16T06:48:43.223659+0000 mgr.a (mgr.14373) 3103 : audit [DBG] from='client.78399 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:48:46.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:48:46 smithi157 bash[24585]: cluster 2024-09-16T06:48:44.687081+0000 mgr.a (mgr.14373) 3104 : cluster [DBG] pgmap v2151: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:48:46.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:48:46 smithi086 bash[24289]: cluster 2024-09-16T06:48:44.687081+0000 mgr.a (mgr.14373) 3104 : cluster [DBG] pgmap v2151: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:48:46.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:48:46 smithi047 bash[22744]: cluster 2024-09-16T06:48:44.687081+0000 mgr.a (mgr.14373) 3104 : cluster [DBG] pgmap v2151: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:48:48.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:48:48 smithi157 bash[24585]: cluster 2024-09-16T06:48:46.688885+0000 mgr.a (mgr.14373) 3105 : cluster [DBG] pgmap v2152: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.3 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:48:48.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:48:48 smithi086 bash[24289]: cluster 2024-09-16T06:48:46.688885+0000 mgr.a (mgr.14373) 3105 : cluster [DBG] pgmap v2152: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.3 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:48:48.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:48:48 smithi047 bash[22744]: cluster 2024-09-16T06:48:46.688885+0000 mgr.a (mgr.14373) 3105 : cluster [DBG] pgmap v2152: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.3 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:48:48.653 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:48:48.654 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:48:48.654 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:48:49.422 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:48:49.423 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:48:49.423 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:48:49.423 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:48:49.423 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:48:50.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:48:50 smithi157 bash[24585]: cluster 2024-09-16T06:48:48.690065+0000 mgr.a (mgr.14373) 3106 : cluster [DBG] pgmap v2153: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 6.9 KiB/s rd, 341 B/s wr, 6 op/s 2024-09-16T06:48:50.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:48:50 smithi157 bash[24585]: audit 2024-09-16T06:48:48.990164+0000 mgr.a (mgr.14373) 3107 : audit [DBG] from='client.78471 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:48:50.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:48:50 smithi086 bash[24289]: cluster 2024-09-16T06:48:48.690065+0000 mgr.a (mgr.14373) 3106 : cluster [DBG] pgmap v2153: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 6.9 KiB/s rd, 341 B/s wr, 6 op/s 2024-09-16T06:48:50.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:48:50 smithi086 bash[24289]: audit 2024-09-16T06:48:48.990164+0000 mgr.a (mgr.14373) 3107 : audit [DBG] from='client.78471 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:48:50.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:48:50 smithi047 bash[22744]: cluster 2024-09-16T06:48:48.690065+0000 mgr.a (mgr.14373) 3106 : cluster [DBG] pgmap v2153: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 6.9 KiB/s rd, 341 B/s wr, 6 op/s 2024-09-16T06:48:50.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:48:50 smithi047 bash[22744]: audit 2024-09-16T06:48:48.990164+0000 mgr.a (mgr.14373) 3107 : audit [DBG] from='client.78471 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:48:52.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:48:52 smithi157 bash[24585]: cluster 2024-09-16T06:48:50.691046+0000 mgr.a (mgr.14373) 3108 : cluster [DBG] pgmap v2154: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 5.2 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-16T06:48:52.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:48:52 smithi086 bash[24289]: cluster 2024-09-16T06:48:50.691046+0000 mgr.a (mgr.14373) 3108 : cluster [DBG] pgmap v2154: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 5.2 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-16T06:48:52.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:48:52 smithi047 bash[22744]: cluster 2024-09-16T06:48:50.691046+0000 mgr.a (mgr.14373) 3108 : cluster [DBG] pgmap v2154: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 5.2 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-16T06:48:54.424 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:48:54.425 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:48:54.425 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:48:54.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:48:54 smithi157 bash[24585]: cluster 2024-09-16T06:48:52.693315+0000 mgr.a (mgr.14373) 3109 : cluster [DBG] pgmap v2155: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 6.2 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-16T06:48:54.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:48:54 smithi086 bash[24289]: cluster 2024-09-16T06:48:52.693315+0000 mgr.a (mgr.14373) 3109 : cluster [DBG] pgmap v2155: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 6.2 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-16T06:48:54.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:48:54 smithi047 bash[22744]: cluster 2024-09-16T06:48:52.693315+0000 mgr.a (mgr.14373) 3109 : cluster [DBG] pgmap v2155: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 6.2 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-16T06:48:55.202 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:48:55.202 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:48:55.202 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:48:55.202 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:48:55.203 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:48:56.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:48:56 smithi157 bash[24585]: cluster 2024-09-16T06:48:54.694211+0000 mgr.a (mgr.14373) 3110 : cluster [DBG] pgmap v2156: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:48:56.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:48:56 smithi157 bash[24585]: audit 2024-09-16T06:48:54.756801+0000 mgr.a (mgr.14373) 3111 : audit [DBG] from='client.78549 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:48:56.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:48:56 smithi086 bash[24289]: cluster 2024-09-16T06:48:54.694211+0000 mgr.a (mgr.14373) 3110 : cluster [DBG] pgmap v2156: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:48:56.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:48:56 smithi086 bash[24289]: audit 2024-09-16T06:48:54.756801+0000 mgr.a (mgr.14373) 3111 : audit [DBG] from='client.78549 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:48:56.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:48:56 smithi047 bash[22744]: cluster 2024-09-16T06:48:54.694211+0000 mgr.a (mgr.14373) 3110 : cluster [DBG] pgmap v2156: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:48:56.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:48:56 smithi047 bash[22744]: audit 2024-09-16T06:48:54.756801+0000 mgr.a (mgr.14373) 3111 : audit [DBG] from='client.78549 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:48:58.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:48:58 smithi157 bash[24585]: cluster 2024-09-16T06:48:56.696421+0000 mgr.a (mgr.14373) 3112 : cluster [DBG] pgmap v2157: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:48:58.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:48:58 smithi086 bash[24289]: cluster 2024-09-16T06:48:56.696421+0000 mgr.a (mgr.14373) 3112 : cluster [DBG] pgmap v2157: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:48:58.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:48:58 smithi047 bash[22744]: cluster 2024-09-16T06:48:56.696421+0000 mgr.a (mgr.14373) 3112 : cluster [DBG] pgmap v2157: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:49:00.203 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:49:00.204 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:49:00.204 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:49:00.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:49:00 smithi157 bash[24585]: cluster 2024-09-16T06:48:58.697174+0000 mgr.a (mgr.14373) 3113 : cluster [DBG] pgmap v2158: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.4 KiB/s rd, 2 op/s 2024-09-16T06:49:00.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:49:00 smithi086 bash[24289]: cluster 2024-09-16T06:48:58.697174+0000 mgr.a (mgr.14373) 3113 : cluster [DBG] pgmap v2158: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.4 KiB/s rd, 2 op/s 2024-09-16T06:49:00.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:49:00 smithi047 bash[22744]: cluster 2024-09-16T06:48:58.697174+0000 mgr.a (mgr.14373) 3113 : cluster [DBG] pgmap v2158: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.4 KiB/s rd, 2 op/s 2024-09-16T06:49:00.955 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:49:00.956 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:49:00.956 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:49:00.956 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:49:00.956 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:49:02.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:49:02 smithi157 bash[24585]: audit 2024-09-16T06:49:00.537370+0000 mgr.a (mgr.14373) 3114 : audit [DBG] from='client.78627 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:49:02.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:49:02 smithi157 bash[24585]: cluster 2024-09-16T06:49:00.697729+0000 mgr.a (mgr.14373) 3115 : cluster [DBG] pgmap v2159: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:49:02.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:49:02 smithi086 bash[24289]: audit 2024-09-16T06:49:00.537370+0000 mgr.a (mgr.14373) 3114 : audit [DBG] from='client.78627 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:49:02.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:49:02 smithi086 bash[24289]: cluster 2024-09-16T06:49:00.697729+0000 mgr.a (mgr.14373) 3115 : cluster [DBG] pgmap v2159: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:49:02.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:49:02 smithi047 bash[22744]: audit 2024-09-16T06:49:00.537370+0000 mgr.a (mgr.14373) 3114 : audit [DBG] from='client.78627 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:49:02.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:49:02 smithi047 bash[22744]: cluster 2024-09-16T06:49:00.697729+0000 mgr.a (mgr.14373) 3115 : cluster [DBG] pgmap v2159: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:49:04.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:49:04 smithi157 bash[24585]: cluster 2024-09-16T06:49:02.700063+0000 mgr.a (mgr.14373) 3116 : cluster [DBG] pgmap v2160: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:49:04.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:49:04 smithi086 bash[24289]: cluster 2024-09-16T06:49:02.700063+0000 mgr.a (mgr.14373) 3116 : cluster [DBG] pgmap v2160: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:49:04.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:49:04 smithi047 bash[22744]: cluster 2024-09-16T06:49:02.700063+0000 mgr.a (mgr.14373) 3116 : cluster [DBG] pgmap v2160: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:49:05.957 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:49:05.957 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:49:05.958 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:49:06.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:49:06 smithi157 bash[24585]: cluster 2024-09-16T06:49:04.700840+0000 mgr.a (mgr.14373) 3117 : cluster [DBG] pgmap v2161: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:49:06.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:49:06 smithi086 bash[24289]: cluster 2024-09-16T06:49:04.700840+0000 mgr.a (mgr.14373) 3117 : cluster [DBG] pgmap v2161: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:49:06.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:49:06 smithi047 bash[22744]: cluster 2024-09-16T06:49:04.700840+0000 mgr.a (mgr.14373) 3117 : cluster [DBG] pgmap v2161: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:49:06.701 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:49:06.702 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:49:06.702 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:49:06.702 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:49:06.702 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:49:08.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:49:08 smithi157 bash[24585]: audit 2024-09-16T06:49:06.294490+0000 mgr.a (mgr.14373) 3118 : audit [DBG] from='client.78705 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:49:08.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:49:08 smithi157 bash[24585]: cluster 2024-09-16T06:49:06.701919+0000 mgr.a (mgr.14373) 3119 : cluster [DBG] pgmap v2162: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.4 KiB/s rd, 2 op/s 2024-09-16T06:49:08.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:49:08 smithi086 bash[24289]: audit 2024-09-16T06:49:06.294490+0000 mgr.a (mgr.14373) 3118 : audit [DBG] from='client.78705 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:49:08.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:49:08 smithi086 bash[24289]: cluster 2024-09-16T06:49:06.701919+0000 mgr.a (mgr.14373) 3119 : cluster [DBG] pgmap v2162: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.4 KiB/s rd, 2 op/s 2024-09-16T06:49:08.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:49:08 smithi047 bash[22744]: audit 2024-09-16T06:49:06.294490+0000 mgr.a (mgr.14373) 3118 : audit [DBG] from='client.78705 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:49:08.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:49:08 smithi047 bash[22744]: cluster 2024-09-16T06:49:06.701919+0000 mgr.a (mgr.14373) 3119 : cluster [DBG] pgmap v2162: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.4 KiB/s rd, 2 op/s 2024-09-16T06:49:10.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:49:10 smithi157 bash[24585]: cluster 2024-09-16T06:49:08.702670+0000 mgr.a (mgr.14373) 3120 : cluster [DBG] pgmap v2163: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-09-16T06:49:10.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:49:10 smithi086 bash[24289]: cluster 2024-09-16T06:49:08.702670+0000 mgr.a (mgr.14373) 3120 : cluster [DBG] pgmap v2163: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-09-16T06:49:10.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:49:10 smithi047 bash[22744]: cluster 2024-09-16T06:49:08.702670+0000 mgr.a (mgr.14373) 3120 : cluster [DBG] pgmap v2163: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-09-16T06:49:11.703 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:49:11.704 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:49:11.704 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:49:12.471 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:49:12.471 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:49:12.471 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:49:12.471 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:49:12.471 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:49:12.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:49:12 smithi157 bash[24585]: cluster 2024-09-16T06:49:10.703432+0000 mgr.a (mgr.14373) 3121 : cluster [DBG] pgmap v2164: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-09-16T06:49:12.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:49:12 smithi086 bash[24289]: cluster 2024-09-16T06:49:10.703432+0000 mgr.a (mgr.14373) 3121 : cluster [DBG] pgmap v2164: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-09-16T06:49:12.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:49:12 smithi047 bash[22744]: cluster 2024-09-16T06:49:10.703432+0000 mgr.a (mgr.14373) 3121 : cluster [DBG] pgmap v2164: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-09-16T06:49:13.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:49:13 smithi157 bash[24585]: audit 2024-09-16T06:49:12.047155+0000 mgr.a (mgr.14373) 3122 : audit [DBG] from='client.78780 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:49:13.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:49:13 smithi086 bash[24289]: audit 2024-09-16T06:49:12.047155+0000 mgr.a (mgr.14373) 3122 : audit [DBG] from='client.78780 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:49:13.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:49:13 smithi047 bash[22744]: audit 2024-09-16T06:49:12.047155+0000 mgr.a (mgr.14373) 3122 : audit [DBG] from='client.78780 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:49:14.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:49:14 smithi157 bash[24585]: cluster 2024-09-16T06:49:12.706176+0000 mgr.a (mgr.14373) 3123 : cluster [DBG] pgmap v2165: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:49:14.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:49:14 smithi086 bash[24289]: cluster 2024-09-16T06:49:12.706176+0000 mgr.a (mgr.14373) 3123 : cluster [DBG] pgmap v2165: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:49:14.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:49:14 smithi047 bash[22744]: cluster 2024-09-16T06:49:12.706176+0000 mgr.a (mgr.14373) 3123 : cluster [DBG] pgmap v2165: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:49:16.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:49:16 smithi157 bash[24585]: cluster 2024-09-16T06:49:14.706956+0000 mgr.a (mgr.14373) 3124 : cluster [DBG] pgmap v2166: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T06:49:16.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:49:16 smithi086 bash[24289]: cluster 2024-09-16T06:49:14.706956+0000 mgr.a (mgr.14373) 3124 : cluster [DBG] pgmap v2166: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T06:49:16.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:49:16 smithi047 bash[22744]: cluster 2024-09-16T06:49:14.706956+0000 mgr.a (mgr.14373) 3124 : cluster [DBG] pgmap v2166: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T06:49:17.472 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:49:17.473 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:49:17.473 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:49:18.240 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:49:18.240 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:49:18.241 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:49:18.241 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:49:18.241 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:49:18.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:49:18 smithi157 bash[24585]: cluster 2024-09-16T06:49:16.708864+0000 mgr.a (mgr.14373) 3125 : cluster [DBG] pgmap v2167: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:49:18.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:49:18 smithi086 bash[24289]: cluster 2024-09-16T06:49:16.708864+0000 mgr.a (mgr.14373) 3125 : cluster [DBG] pgmap v2167: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:49:18.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:49:18 smithi047 bash[22744]: cluster 2024-09-16T06:49:16.708864+0000 mgr.a (mgr.14373) 3125 : cluster [DBG] pgmap v2167: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:49:19.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:49:19 smithi157 bash[24585]: audit 2024-09-16T06:49:17.812115+0000 mgr.a (mgr.14373) 3126 : audit [DBG] from='client.78858 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:49:19.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:49:19 smithi086 bash[24289]: audit 2024-09-16T06:49:17.812115+0000 mgr.a (mgr.14373) 3126 : audit [DBG] from='client.78858 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:49:19.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:49:19 smithi047 bash[22744]: audit 2024-09-16T06:49:17.812115+0000 mgr.a (mgr.14373) 3126 : audit [DBG] from='client.78858 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:49:20.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:49:20 smithi157 bash[24585]: cluster 2024-09-16T06:49:18.709815+0000 mgr.a (mgr.14373) 3127 : cluster [DBG] pgmap v2168: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T06:49:20.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:49:20 smithi086 bash[24289]: cluster 2024-09-16T06:49:18.709815+0000 mgr.a (mgr.14373) 3127 : cluster [DBG] pgmap v2168: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T06:49:20.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:49:20 smithi047 bash[22744]: cluster 2024-09-16T06:49:18.709815+0000 mgr.a (mgr.14373) 3127 : cluster [DBG] pgmap v2168: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T06:49:22.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:49:22 smithi157 bash[24585]: cluster 2024-09-16T06:49:20.710669+0000 mgr.a (mgr.14373) 3128 : cluster [DBG] pgmap v2169: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T06:49:22.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:49:22 smithi086 bash[24289]: cluster 2024-09-16T06:49:20.710669+0000 mgr.a (mgr.14373) 3128 : cluster [DBG] pgmap v2169: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T06:49:22.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:49:22 smithi047 bash[22744]: cluster 2024-09-16T06:49:20.710669+0000 mgr.a (mgr.14373) 3128 : cluster [DBG] pgmap v2169: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T06:49:23.242 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:49:23.243 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:49:23.243 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:49:24.019 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:49:24.019 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:49:24.019 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:49:24.019 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:49:24.019 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:49:24.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:49:24 smithi157 bash[24585]: cluster 2024-09-16T06:49:22.712880+0000 mgr.a (mgr.14373) 3129 : cluster [DBG] pgmap v2170: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-16T06:49:24.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:49:24 smithi086 bash[24289]: cluster 2024-09-16T06:49:22.712880+0000 mgr.a (mgr.14373) 3129 : cluster [DBG] pgmap v2170: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-16T06:49:24.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:49:24 smithi047 bash[22744]: cluster 2024-09-16T06:49:22.712880+0000 mgr.a (mgr.14373) 3129 : cluster [DBG] pgmap v2170: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-16T06:49:25.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:49:25 smithi157 bash[24585]: audit 2024-09-16T06:49:23.577178+0000 mgr.a (mgr.14373) 3130 : audit [DBG] from='client.78930 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:49:25.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:49:25 smithi086 bash[24289]: audit 2024-09-16T06:49:23.577178+0000 mgr.a (mgr.14373) 3130 : audit [DBG] from='client.78930 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:49:25.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:49:25 smithi047 bash[22744]: audit 2024-09-16T06:49:23.577178+0000 mgr.a (mgr.14373) 3130 : audit [DBG] from='client.78930 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:49:26.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:49:26 smithi157 bash[24585]: cluster 2024-09-16T06:49:24.713823+0000 mgr.a (mgr.14373) 3131 : cluster [DBG] pgmap v2171: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:49:26.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:49:26 smithi086 bash[24289]: cluster 2024-09-16T06:49:24.713823+0000 mgr.a (mgr.14373) 3131 : cluster [DBG] pgmap v2171: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:49:26.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:49:26 smithi047 bash[22744]: cluster 2024-09-16T06:49:24.713823+0000 mgr.a (mgr.14373) 3131 : cluster [DBG] pgmap v2171: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:49:28.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:49:28 smithi157 bash[24585]: cluster 2024-09-16T06:49:26.715980+0000 mgr.a (mgr.14373) 3132 : cluster [DBG] pgmap v2172: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:49:28.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:49:28 smithi086 bash[24289]: cluster 2024-09-16T06:49:26.715980+0000 mgr.a (mgr.14373) 3132 : cluster [DBG] pgmap v2172: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:49:28.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:49:28 smithi047 bash[22744]: cluster 2024-09-16T06:49:26.715980+0000 mgr.a (mgr.14373) 3132 : cluster [DBG] pgmap v2172: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:49:29.020 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:49:29.021 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:49:29.021 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:49:29.789 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:49:29.789 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:49:29.789 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:49:29.790 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:49:29.790 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:49:30.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:49:30 smithi157 bash[24585]: cluster 2024-09-16T06:49:28.716751+0000 mgr.a (mgr.14373) 3133 : cluster [DBG] pgmap v2173: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:49:30.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:49:30 smithi086 bash[24289]: cluster 2024-09-16T06:49:28.716751+0000 mgr.a (mgr.14373) 3133 : cluster [DBG] pgmap v2173: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:49:30.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:49:30 smithi047 bash[22744]: cluster 2024-09-16T06:49:28.716751+0000 mgr.a (mgr.14373) 3133 : cluster [DBG] pgmap v2173: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:49:31.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:49:31 smithi157 bash[24585]: audit 2024-09-16T06:49:29.357469+0000 mgr.a (mgr.14373) 3134 : audit [DBG] from='client.79002 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:49:31.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:49:31 smithi086 bash[24289]: audit 2024-09-16T06:49:29.357469+0000 mgr.a (mgr.14373) 3134 : audit [DBG] from='client.79002 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:49:31.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:49:31 smithi047 bash[22744]: audit 2024-09-16T06:49:29.357469+0000 mgr.a (mgr.14373) 3134 : audit [DBG] from='client.79002 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:49:32.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:49:32 smithi086 bash[24289]: cluster 2024-09-16T06:49:30.717706+0000 mgr.a (mgr.14373) 3135 : cluster [DBG] pgmap v2174: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:49:32.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:49:32 smithi157 bash[24585]: cluster 2024-09-16T06:49:30.717706+0000 mgr.a (mgr.14373) 3135 : cluster [DBG] pgmap v2174: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:49:32.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:49:32 smithi047 bash[22744]: cluster 2024-09-16T06:49:30.717706+0000 mgr.a (mgr.14373) 3135 : cluster [DBG] pgmap v2174: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:49:33.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:49:33 smithi157 bash[24585]: cluster 2024-09-16T06:49:32.719990+0000 mgr.a (mgr.14373) 3136 : cluster [DBG] pgmap v2175: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:49:33.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:49:33 smithi086 bash[24289]: cluster 2024-09-16T06:49:32.719990+0000 mgr.a (mgr.14373) 3136 : cluster [DBG] pgmap v2175: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:49:33.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:49:33 smithi047 bash[22744]: cluster 2024-09-16T06:49:32.719990+0000 mgr.a (mgr.14373) 3136 : cluster [DBG] pgmap v2175: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:49:34.791 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:49:34.791 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:49:34.791 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:49:35.565 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:49:35.565 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:49:35.565 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:49:35.565 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:49:35.565 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:49:36.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:49:35 smithi157 bash[24585]: cluster 2024-09-16T06:49:34.720760+0000 mgr.a (mgr.14373) 3137 : cluster [DBG] pgmap v2176: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:49:36.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:49:35 smithi157 bash[24585]: audit 2024-09-16T06:49:35.127664+0000 mgr.a (mgr.14373) 3138 : audit [DBG] from='client.79077 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:49:36.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:49:35 smithi086 bash[24289]: cluster 2024-09-16T06:49:34.720760+0000 mgr.a (mgr.14373) 3137 : cluster [DBG] pgmap v2176: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:49:36.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:49:35 smithi086 bash[24289]: audit 2024-09-16T06:49:35.127664+0000 mgr.a (mgr.14373) 3138 : audit [DBG] from='client.79077 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:49:36.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:49:35 smithi047 bash[22744]: cluster 2024-09-16T06:49:34.720760+0000 mgr.a (mgr.14373) 3137 : cluster [DBG] pgmap v2176: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:49:36.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:49:35 smithi047 bash[22744]: audit 2024-09-16T06:49:35.127664+0000 mgr.a (mgr.14373) 3138 : audit [DBG] from='client.79077 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:49:38.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:49:37 smithi157 bash[24585]: cluster 2024-09-16T06:49:36.723134+0000 mgr.a (mgr.14373) 3139 : cluster [DBG] pgmap v2177: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:49:38.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:49:37 smithi157 bash[24585]: audit 2024-09-16T06:49:36.892500+0000 mon.b (mon.2) 326 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T06:49:38.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:49:37 smithi157 bash[24585]: audit 2024-09-16T06:49:37.734472+0000 mon.b (mon.2) 327 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T06:49:38.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:49:37 smithi157 bash[24585]: audit 2024-09-16T06:49:37.736467+0000 mon.b (mon.2) 328 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T06:49:38.055 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:49:37 smithi157 bash[24585]: audit 2024-09-16T06:49:37.749731+0000 mon.a (mon.0) 756 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:49:38.055 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:49:37 smithi157 bash[24585]: audit 2024-09-16T06:49:37.753221+0000 mon.b (mon.2) 329 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:49:38.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:49:37 smithi086 bash[24289]: cluster 2024-09-16T06:49:36.723134+0000 mgr.a (mgr.14373) 3139 : cluster [DBG] pgmap v2177: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:49:38.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:49:37 smithi086 bash[24289]: audit 2024-09-16T06:49:36.892500+0000 mon.b (mon.2) 326 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T06:49:38.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:49:37 smithi086 bash[24289]: audit 2024-09-16T06:49:37.734472+0000 mon.b (mon.2) 327 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T06:49:38.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:49:37 smithi086 bash[24289]: audit 2024-09-16T06:49:37.736467+0000 mon.b (mon.2) 328 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T06:49:38.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:49:37 smithi086 bash[24289]: audit 2024-09-16T06:49:37.749731+0000 mon.a (mon.0) 756 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:49:38.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:49:37 smithi086 bash[24289]: audit 2024-09-16T06:49:37.753221+0000 mon.b (mon.2) 329 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:49:38.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:49:37 smithi047 bash[22744]: cluster 2024-09-16T06:49:36.723134+0000 mgr.a (mgr.14373) 3139 : cluster [DBG] pgmap v2177: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:49:38.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:49:37 smithi047 bash[22744]: audit 2024-09-16T06:49:36.892500+0000 mon.b (mon.2) 326 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T06:49:38.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:49:37 smithi047 bash[22744]: audit 2024-09-16T06:49:37.734472+0000 mon.b (mon.2) 327 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T06:49:38.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:49:37 smithi047 bash[22744]: audit 2024-09-16T06:49:37.736467+0000 mon.b (mon.2) 328 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T06:49:38.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:49:37 smithi047 bash[22744]: audit 2024-09-16T06:49:37.749731+0000 mon.a (mon.0) 756 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:49:38.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:49:37 smithi047 bash[22744]: audit 2024-09-16T06:49:37.753221+0000 mon.b (mon.2) 329 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:49:38.782 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 06:49:38 smithi047 bash[22994]: debug 2024-09-16T06:49:38.470+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T06:49:38.782 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 06:49:38 smithi047 bash[22994]: debug 2024-09-16T06:49:38.474+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T06:49:39.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:49:38 smithi157 bash[24585]: audit 2024-09-16T06:49:37.757676+0000 mgr.a (mgr.14373) 3140 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:49:39.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:49:38 smithi086 bash[24289]: audit 2024-09-16T06:49:37.757676+0000 mgr.a (mgr.14373) 3140 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:49:39.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:49:38 smithi047 bash[22744]: audit 2024-09-16T06:49:37.757676+0000 mgr.a (mgr.14373) 3140 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:49:40.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:49:39 smithi157 bash[24585]: audit 2024-09-16T06:49:38.473473+0000 mgr.a (mgr.14373) 3141 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T06:49:40.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:49:39 smithi157 bash[24585]: cephadm 2024-09-16T06:49:38.475288+0000 mgr.a (mgr.14373) 3142 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T06:49:40.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:49:39 smithi157 bash[24585]: cluster 2024-09-16T06:49:38.724053+0000 mgr.a (mgr.14373) 3143 : cluster [DBG] pgmap v2178: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:49:40.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:49:39 smithi086 bash[24289]: audit 2024-09-16T06:49:38.473473+0000 mgr.a (mgr.14373) 3141 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T06:49:40.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:49:39 smithi086 bash[24289]: cephadm 2024-09-16T06:49:38.475288+0000 mgr.a (mgr.14373) 3142 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T06:49:40.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:49:39 smithi086 bash[24289]: cluster 2024-09-16T06:49:38.724053+0000 mgr.a (mgr.14373) 3143 : cluster [DBG] pgmap v2178: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:49:40.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:49:39 smithi047 bash[22744]: audit 2024-09-16T06:49:38.473473+0000 mgr.a (mgr.14373) 3141 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T06:49:40.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:49:39 smithi047 bash[22744]: cephadm 2024-09-16T06:49:38.475288+0000 mgr.a (mgr.14373) 3142 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T06:49:40.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:49:39 smithi047 bash[22744]: cluster 2024-09-16T06:49:38.724053+0000 mgr.a (mgr.14373) 3143 : cluster [DBG] pgmap v2178: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:49:40.566 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:49:40.567 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:49:40.567 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:49:41.313 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:49:41.313 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:49:41.313 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:49:41.313 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:49:41.314 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:49:42.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:49:41 smithi157 bash[24585]: cluster 2024-09-16T06:49:40.724577+0000 mgr.a (mgr.14373) 3144 : cluster [DBG] pgmap v2179: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:49:42.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:49:41 smithi157 bash[24585]: audit 2024-09-16T06:49:40.895231+0000 mgr.a (mgr.14373) 3145 : audit [DBG] from='client.79257 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:49:42.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:49:41 smithi086 bash[24289]: cluster 2024-09-16T06:49:40.724577+0000 mgr.a (mgr.14373) 3144 : cluster [DBG] pgmap v2179: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:49:42.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:49:41 smithi086 bash[24289]: audit 2024-09-16T06:49:40.895231+0000 mgr.a (mgr.14373) 3145 : audit [DBG] from='client.79257 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:49:42.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:49:41 smithi047 bash[22744]: cluster 2024-09-16T06:49:40.724577+0000 mgr.a (mgr.14373) 3144 : cluster [DBG] pgmap v2179: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:49:42.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:49:41 smithi047 bash[22744]: audit 2024-09-16T06:49:40.895231+0000 mgr.a (mgr.14373) 3145 : audit [DBG] from='client.79257 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:49:44.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:49:43 smithi157 bash[24585]: cluster 2024-09-16T06:49:42.726867+0000 mgr.a (mgr.14373) 3146 : cluster [DBG] pgmap v2180: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:49:44.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:49:43 smithi086 bash[24289]: cluster 2024-09-16T06:49:42.726867+0000 mgr.a (mgr.14373) 3146 : cluster [DBG] pgmap v2180: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:49:44.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:49:43 smithi047 bash[22744]: cluster 2024-09-16T06:49:42.726867+0000 mgr.a (mgr.14373) 3146 : cluster [DBG] pgmap v2180: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:49:46.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:49:45 smithi086 bash[24289]: cluster 2024-09-16T06:49:44.727661+0000 mgr.a (mgr.14373) 3147 : cluster [DBG] pgmap v2181: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:49:46.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:49:45 smithi047 bash[22744]: cluster 2024-09-16T06:49:44.727661+0000 mgr.a (mgr.14373) 3147 : cluster [DBG] pgmap v2181: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:49:46.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:49:45 smithi157 bash[24585]: cluster 2024-09-16T06:49:44.727661+0000 mgr.a (mgr.14373) 3147 : cluster [DBG] pgmap v2181: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:49:46.315 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:49:46.315 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:49:46.315 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:49:47.058 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:49:47.058 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:49:47.058 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:49:47.058 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:49:47.058 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:49:48.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:49:47 smithi086 bash[24289]: audit 2024-09-16T06:49:46.649981+0000 mgr.a (mgr.14373) 3148 : audit [DBG] from='client.79335 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:49:48.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:49:47 smithi086 bash[24289]: cluster 2024-09-16T06:49:46.728860+0000 mgr.a (mgr.14373) 3149 : cluster [DBG] pgmap v2182: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:49:48.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:49:47 smithi047 bash[22744]: audit 2024-09-16T06:49:46.649981+0000 mgr.a (mgr.14373) 3148 : audit [DBG] from='client.79335 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:49:48.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:49:47 smithi047 bash[22744]: cluster 2024-09-16T06:49:46.728860+0000 mgr.a (mgr.14373) 3149 : cluster [DBG] pgmap v2182: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:49:48.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:49:47 smithi157 bash[24585]: audit 2024-09-16T06:49:46.649981+0000 mgr.a (mgr.14373) 3148 : audit [DBG] from='client.79335 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:49:48.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:49:47 smithi157 bash[24585]: cluster 2024-09-16T06:49:46.728860+0000 mgr.a (mgr.14373) 3149 : cluster [DBG] pgmap v2182: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:49:50.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:49:49 smithi086 bash[24289]: cluster 2024-09-16T06:49:48.729748+0000 mgr.a (mgr.14373) 3150 : cluster [DBG] pgmap v2183: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T06:49:50.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:49:49 smithi047 bash[22744]: cluster 2024-09-16T06:49:48.729748+0000 mgr.a (mgr.14373) 3150 : cluster [DBG] pgmap v2183: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T06:49:50.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:49:49 smithi157 bash[24585]: cluster 2024-09-16T06:49:48.729748+0000 mgr.a (mgr.14373) 3150 : cluster [DBG] pgmap v2183: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T06:49:52.059 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:49:52.060 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:49:52.060 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:49:52.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:49:51 smithi086 bash[24289]: cluster 2024-09-16T06:49:50.730543+0000 mgr.a (mgr.14373) 3151 : cluster [DBG] pgmap v2184: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T06:49:52.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:49:51 smithi047 bash[22744]: cluster 2024-09-16T06:49:50.730543+0000 mgr.a (mgr.14373) 3151 : cluster [DBG] pgmap v2184: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T06:49:52.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:49:51 smithi157 bash[24585]: cluster 2024-09-16T06:49:50.730543+0000 mgr.a (mgr.14373) 3151 : cluster [DBG] pgmap v2184: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T06:49:52.805 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:49:52.805 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:49:52.805 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:49:52.805 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:49:52.805 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:49:54.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:49:53 smithi047 bash[22744]: audit 2024-09-16T06:49:52.393056+0000 mgr.a (mgr.14373) 3152 : audit [DBG] from='client.79410 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:49:54.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:49:53 smithi047 bash[22744]: cluster 2024-09-16T06:49:52.731795+0000 mgr.a (mgr.14373) 3153 : cluster [DBG] pgmap v2185: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:49:54.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:49:53 smithi157 bash[24585]: audit 2024-09-16T06:49:52.393056+0000 mgr.a (mgr.14373) 3152 : audit [DBG] from='client.79410 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:49:54.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:49:53 smithi157 bash[24585]: cluster 2024-09-16T06:49:52.731795+0000 mgr.a (mgr.14373) 3153 : cluster [DBG] pgmap v2185: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:49:54.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:49:53 smithi086 bash[24289]: audit 2024-09-16T06:49:52.393056+0000 mgr.a (mgr.14373) 3152 : audit [DBG] from='client.79410 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:49:54.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:49:53 smithi086 bash[24289]: cluster 2024-09-16T06:49:52.731795+0000 mgr.a (mgr.14373) 3153 : cluster [DBG] pgmap v2185: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:49:56.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:49:55 smithi047 bash[22744]: cluster 2024-09-16T06:49:54.732653+0000 mgr.a (mgr.14373) 3154 : cluster [DBG] pgmap v2186: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T06:49:56.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:49:55 smithi157 bash[24585]: cluster 2024-09-16T06:49:54.732653+0000 mgr.a (mgr.14373) 3154 : cluster [DBG] pgmap v2186: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T06:49:56.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:49:55 smithi086 bash[24289]: cluster 2024-09-16T06:49:54.732653+0000 mgr.a (mgr.14373) 3154 : cluster [DBG] pgmap v2186: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T06:49:57.806 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:49:57.807 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:49:57.807 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:49:58.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:49:57 smithi047 bash[22744]: cluster 2024-09-16T06:49:56.734789+0000 mgr.a (mgr.14373) 3155 : cluster [DBG] pgmap v2187: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:49:58.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:49:57 smithi157 bash[24585]: cluster 2024-09-16T06:49:56.734789+0000 mgr.a (mgr.14373) 3155 : cluster [DBG] pgmap v2187: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:49:58.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:49:57 smithi086 bash[24289]: cluster 2024-09-16T06:49:56.734789+0000 mgr.a (mgr.14373) 3155 : cluster [DBG] pgmap v2187: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:49:58.560 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:49:58.561 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:49:58.561 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:49:58.561 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:49:58.561 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:49:59.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:49:58 smithi047 bash[22744]: audit 2024-09-16T06:49:58.141977+0000 mgr.a (mgr.14373) 3156 : audit [DBG] from='client.79488 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:49:59.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:49:58 smithi157 bash[24585]: audit 2024-09-16T06:49:58.141977+0000 mgr.a (mgr.14373) 3156 : audit [DBG] from='client.79488 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:49:59.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:49:58 smithi086 bash[24289]: audit 2024-09-16T06:49:58.141977+0000 mgr.a (mgr.14373) 3156 : audit [DBG] from='client.79488 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:50:00.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:49:59 smithi157 bash[24585]: cluster 2024-09-16T06:49:58.735397+0000 mgr.a (mgr.14373) 3157 : cluster [DBG] pgmap v2188: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:50:00.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:49:59 smithi086 bash[24289]: cluster 2024-09-16T06:49:58.735397+0000 mgr.a (mgr.14373) 3157 : cluster [DBG] pgmap v2188: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:50:00.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:49:59 smithi047 bash[22744]: cluster 2024-09-16T06:49:58.735397+0000 mgr.a (mgr.14373) 3157 : cluster [DBG] pgmap v2188: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:50:01.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:50:00 smithi157 bash[24585]: cluster 2024-09-16T06:50:00.000156+0000 mon.a (mon.0) 757 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-16T06:50:01.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:50:00 smithi086 bash[24289]: cluster 2024-09-16T06:50:00.000156+0000 mon.a (mon.0) 757 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-16T06:50:01.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:50:00 smithi047 bash[22744]: cluster 2024-09-16T06:50:00.000156+0000 mon.a (mon.0) 757 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-16T06:50:02.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:50:01 smithi157 bash[24585]: cluster 2024-09-16T06:50:00.736151+0000 mgr.a (mgr.14373) 3158 : cluster [DBG] pgmap v2189: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:50:02.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:50:01 smithi086 bash[24289]: cluster 2024-09-16T06:50:00.736151+0000 mgr.a (mgr.14373) 3158 : cluster [DBG] pgmap v2189: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:50:02.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:50:01 smithi047 bash[22744]: cluster 2024-09-16T06:50:00.736151+0000 mgr.a (mgr.14373) 3158 : cluster [DBG] pgmap v2189: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:50:03.562 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:50:03.563 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:50:03.563 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:50:04.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:50:03 smithi157 bash[24585]: cluster 2024-09-16T06:50:02.738426+0000 mgr.a (mgr.14373) 3159 : cluster [DBG] pgmap v2190: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:50:04.315 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:50:04.315 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:50:04.315 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:50:04.315 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:50:04.316 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:50:04.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:50:03 smithi086 bash[24289]: cluster 2024-09-16T06:50:02.738426+0000 mgr.a (mgr.14373) 3159 : cluster [DBG] pgmap v2190: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:50:04.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:50:03 smithi047 bash[22744]: cluster 2024-09-16T06:50:02.738426+0000 mgr.a (mgr.14373) 3159 : cluster [DBG] pgmap v2190: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:50:05.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:50:04 smithi157 bash[24585]: audit 2024-09-16T06:50:03.893384+0000 mgr.a (mgr.14373) 3160 : audit [DBG] from='client.79563 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:50:05.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:50:04 smithi086 bash[24289]: audit 2024-09-16T06:50:03.893384+0000 mgr.a (mgr.14373) 3160 : audit [DBG] from='client.79563 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:50:05.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:50:04 smithi047 bash[22744]: audit 2024-09-16T06:50:03.893384+0000 mgr.a (mgr.14373) 3160 : audit [DBG] from='client.79563 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:50:06.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:50:05 smithi157 bash[24585]: cluster 2024-09-16T06:50:04.739378+0000 mgr.a (mgr.14373) 3161 : cluster [DBG] pgmap v2191: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:50:06.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:50:05 smithi086 bash[24289]: cluster 2024-09-16T06:50:04.739378+0000 mgr.a (mgr.14373) 3161 : cluster [DBG] pgmap v2191: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:50:06.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:50:05 smithi047 bash[22744]: cluster 2024-09-16T06:50:04.739378+0000 mgr.a (mgr.14373) 3161 : cluster [DBG] pgmap v2191: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:50:08.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:50:07 smithi157 bash[24585]: cluster 2024-09-16T06:50:06.741474+0000 mgr.a (mgr.14373) 3162 : cluster [DBG] pgmap v2192: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:50:08.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:50:07 smithi086 bash[24289]: cluster 2024-09-16T06:50:06.741474+0000 mgr.a (mgr.14373) 3162 : cluster [DBG] pgmap v2192: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:50:08.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:50:07 smithi047 bash[22744]: cluster 2024-09-16T06:50:06.741474+0000 mgr.a (mgr.14373) 3162 : cluster [DBG] pgmap v2192: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:50:09.317 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:50:09.318 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:50:09.318 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:50:10.086 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:50:10.086 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:50:10.086 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:50:10.086 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:50:10.086 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:50:10.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:50:09 smithi157 bash[24585]: cluster 2024-09-16T06:50:08.742245+0000 mgr.a (mgr.14373) 3163 : cluster [DBG] pgmap v2193: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:50:10.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:50:09 smithi086 bash[24289]: cluster 2024-09-16T06:50:08.742245+0000 mgr.a (mgr.14373) 3163 : cluster [DBG] pgmap v2193: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:50:10.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:50:09 smithi047 bash[22744]: cluster 2024-09-16T06:50:08.742245+0000 mgr.a (mgr.14373) 3163 : cluster [DBG] pgmap v2193: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:50:11.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:50:10 smithi157 bash[24585]: audit 2024-09-16T06:50:09.654563+0000 mgr.a (mgr.14373) 3164 : audit [DBG] from='client.79641 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:50:11.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:50:10 smithi086 bash[24289]: audit 2024-09-16T06:50:09.654563+0000 mgr.a (mgr.14373) 3164 : audit [DBG] from='client.79641 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:50:11.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:50:10 smithi047 bash[22744]: audit 2024-09-16T06:50:09.654563+0000 mgr.a (mgr.14373) 3164 : audit [DBG] from='client.79641 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:50:12.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:50:11 smithi157 bash[24585]: cluster 2024-09-16T06:50:10.743207+0000 mgr.a (mgr.14373) 3165 : cluster [DBG] pgmap v2194: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:50:12.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:50:11 smithi086 bash[24289]: cluster 2024-09-16T06:50:10.743207+0000 mgr.a (mgr.14373) 3165 : cluster [DBG] pgmap v2194: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:50:12.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:50:11 smithi047 bash[22744]: cluster 2024-09-16T06:50:10.743207+0000 mgr.a (mgr.14373) 3165 : cluster [DBG] pgmap v2194: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:50:14.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:50:13 smithi157 bash[24585]: cluster 2024-09-16T06:50:12.745451+0000 mgr.a (mgr.14373) 3166 : cluster [DBG] pgmap v2195: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:50:14.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:50:13 smithi086 bash[24289]: cluster 2024-09-16T06:50:12.745451+0000 mgr.a (mgr.14373) 3166 : cluster [DBG] pgmap v2195: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:50:14.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:50:13 smithi047 bash[22744]: cluster 2024-09-16T06:50:12.745451+0000 mgr.a (mgr.14373) 3166 : cluster [DBG] pgmap v2195: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:50:15.088 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:50:15.088 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:50:15.089 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:50:15.831 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:50:15.831 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:50:15.831 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:50:15.831 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:50:15.831 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:50:16.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:50:15 smithi157 bash[24585]: cluster 2024-09-16T06:50:14.746221+0000 mgr.a (mgr.14373) 3167 : cluster [DBG] pgmap v2196: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:50:16.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:50:15 smithi086 bash[24289]: cluster 2024-09-16T06:50:14.746221+0000 mgr.a (mgr.14373) 3167 : cluster [DBG] pgmap v2196: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:50:16.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:50:15 smithi047 bash[22744]: cluster 2024-09-16T06:50:14.746221+0000 mgr.a (mgr.14373) 3167 : cluster [DBG] pgmap v2196: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:50:17.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:50:16 smithi157 bash[24585]: audit 2024-09-16T06:50:15.429502+0000 mgr.a (mgr.14373) 3168 : audit [DBG] from='client.79719 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:50:17.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:50:16 smithi086 bash[24289]: audit 2024-09-16T06:50:15.429502+0000 mgr.a (mgr.14373) 3168 : audit [DBG] from='client.79719 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:50:17.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:50:16 smithi047 bash[22744]: audit 2024-09-16T06:50:15.429502+0000 mgr.a (mgr.14373) 3168 : audit [DBG] from='client.79719 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:50:18.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:50:17 smithi157 bash[24585]: cluster 2024-09-16T06:50:16.748450+0000 mgr.a (mgr.14373) 3169 : cluster [DBG] pgmap v2197: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:50:18.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:50:17 smithi086 bash[24289]: cluster 2024-09-16T06:50:16.748450+0000 mgr.a (mgr.14373) 3169 : cluster [DBG] pgmap v2197: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:50:18.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:50:17 smithi047 bash[22744]: cluster 2024-09-16T06:50:16.748450+0000 mgr.a (mgr.14373) 3169 : cluster [DBG] pgmap v2197: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:50:20.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:50:19 smithi157 bash[24585]: cluster 2024-09-16T06:50:18.749221+0000 mgr.a (mgr.14373) 3170 : cluster [DBG] pgmap v2198: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:50:20.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:50:19 smithi086 bash[24289]: cluster 2024-09-16T06:50:18.749221+0000 mgr.a (mgr.14373) 3170 : cluster [DBG] pgmap v2198: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:50:20.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:50:19 smithi047 bash[22744]: cluster 2024-09-16T06:50:18.749221+0000 mgr.a (mgr.14373) 3170 : cluster [DBG] pgmap v2198: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:50:20.832 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:50:20.833 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:50:20.833 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:50:21.594 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:50:21.594 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:50:21.594 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:50:21.594 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:50:21.594 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:50:22.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:50:21 smithi157 bash[24585]: cluster 2024-09-16T06:50:20.749997+0000 mgr.a (mgr.14373) 3171 : cluster [DBG] pgmap v2199: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:50:22.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:50:21 smithi157 bash[24585]: audit 2024-09-16T06:50:21.167822+0000 mgr.a (mgr.14373) 3172 : audit [DBG] from='client.79797 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:50:22.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:50:21 smithi086 bash[24289]: cluster 2024-09-16T06:50:20.749997+0000 mgr.a (mgr.14373) 3171 : cluster [DBG] pgmap v2199: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:50:22.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:50:21 smithi086 bash[24289]: audit 2024-09-16T06:50:21.167822+0000 mgr.a (mgr.14373) 3172 : audit [DBG] from='client.79797 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:50:22.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:50:21 smithi047 bash[22744]: cluster 2024-09-16T06:50:20.749997+0000 mgr.a (mgr.14373) 3171 : cluster [DBG] pgmap v2199: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:50:22.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:50:21 smithi047 bash[22744]: audit 2024-09-16T06:50:21.167822+0000 mgr.a (mgr.14373) 3172 : audit [DBG] from='client.79797 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:50:24.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:50:23 smithi157 bash[24585]: cluster 2024-09-16T06:50:22.752371+0000 mgr.a (mgr.14373) 3173 : cluster [DBG] pgmap v2200: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:50:24.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:50:23 smithi086 bash[24289]: cluster 2024-09-16T06:50:22.752371+0000 mgr.a (mgr.14373) 3173 : cluster [DBG] pgmap v2200: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:50:24.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:50:23 smithi047 bash[22744]: cluster 2024-09-16T06:50:22.752371+0000 mgr.a (mgr.14373) 3173 : cluster [DBG] pgmap v2200: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:50:26.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:50:25 smithi157 bash[24585]: cluster 2024-09-16T06:50:24.753144+0000 mgr.a (mgr.14373) 3174 : cluster [DBG] pgmap v2201: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-16T06:50:26.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:50:25 smithi086 bash[24289]: cluster 2024-09-16T06:50:24.753144+0000 mgr.a (mgr.14373) 3174 : cluster [DBG] pgmap v2201: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-16T06:50:26.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:50:25 smithi047 bash[22744]: cluster 2024-09-16T06:50:24.753144+0000 mgr.a (mgr.14373) 3174 : cluster [DBG] pgmap v2201: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-16T06:50:26.595 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:50:26.596 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:50:26.596 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:50:27.347 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:50:27.347 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:50:27.347 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:50:27.347 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:50:27.347 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:50:28.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:50:27 smithi157 bash[24585]: cluster 2024-09-16T06:50:26.754389+0000 mgr.a (mgr.14373) 3175 : cluster [DBG] pgmap v2202: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:50:28.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:50:27 smithi157 bash[24585]: audit 2024-09-16T06:50:26.933514+0000 mgr.a (mgr.14373) 3176 : audit [DBG] from='client.79875 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:50:28.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:50:27 smithi086 bash[24289]: cluster 2024-09-16T06:50:26.754389+0000 mgr.a (mgr.14373) 3175 : cluster [DBG] pgmap v2202: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:50:28.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:50:27 smithi086 bash[24289]: audit 2024-09-16T06:50:26.933514+0000 mgr.a (mgr.14373) 3176 : audit [DBG] from='client.79875 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:50:28.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:50:27 smithi047 bash[22744]: cluster 2024-09-16T06:50:26.754389+0000 mgr.a (mgr.14373) 3175 : cluster [DBG] pgmap v2202: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:50:28.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:50:27 smithi047 bash[22744]: audit 2024-09-16T06:50:26.933514+0000 mgr.a (mgr.14373) 3176 : audit [DBG] from='client.79875 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:50:30.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:50:29 smithi157 bash[24585]: cluster 2024-09-16T06:50:28.755235+0000 mgr.a (mgr.14373) 3177 : cluster [DBG] pgmap v2203: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T06:50:30.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:50:29 smithi086 bash[24289]: cluster 2024-09-16T06:50:28.755235+0000 mgr.a (mgr.14373) 3177 : cluster [DBG] pgmap v2203: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T06:50:30.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:50:29 smithi047 bash[22744]: cluster 2024-09-16T06:50:28.755235+0000 mgr.a (mgr.14373) 3177 : cluster [DBG] pgmap v2203: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T06:50:32.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:50:31 smithi157 bash[24585]: cluster 2024-09-16T06:50:30.756032+0000 mgr.a (mgr.14373) 3178 : cluster [DBG] pgmap v2204: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T06:50:32.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:50:31 smithi086 bash[24289]: cluster 2024-09-16T06:50:30.756032+0000 mgr.a (mgr.14373) 3178 : cluster [DBG] pgmap v2204: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T06:50:32.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:50:31 smithi047 bash[22744]: cluster 2024-09-16T06:50:30.756032+0000 mgr.a (mgr.14373) 3178 : cluster [DBG] pgmap v2204: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T06:50:32.348 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:50:32.349 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:50:32.349 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:50:33.108 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:50:33.108 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:50:33.108 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:50:33.108 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:50:33.108 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:50:34.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:50:33 smithi157 bash[24585]: audit 2024-09-16T06:50:32.683541+0000 mgr.a (mgr.14373) 3179 : audit [DBG] from='client.79953 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:50:34.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:50:33 smithi157 bash[24585]: cluster 2024-09-16T06:50:32.757341+0000 mgr.a (mgr.14373) 3180 : cluster [DBG] pgmap v2205: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:50:34.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:50:33 smithi086 bash[24289]: audit 2024-09-16T06:50:32.683541+0000 mgr.a (mgr.14373) 3179 : audit [DBG] from='client.79953 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:50:34.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:50:33 smithi086 bash[24289]: cluster 2024-09-16T06:50:32.757341+0000 mgr.a (mgr.14373) 3180 : cluster [DBG] pgmap v2205: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:50:34.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:50:33 smithi047 bash[22744]: audit 2024-09-16T06:50:32.683541+0000 mgr.a (mgr.14373) 3179 : audit [DBG] from='client.79953 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:50:34.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:50:33 smithi047 bash[22744]: cluster 2024-09-16T06:50:32.757341+0000 mgr.a (mgr.14373) 3180 : cluster [DBG] pgmap v2205: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:50:36.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:50:35 smithi157 bash[24585]: cluster 2024-09-16T06:50:34.758210+0000 mgr.a (mgr.14373) 3181 : cluster [DBG] pgmap v2206: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-16T06:50:36.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:50:35 smithi086 bash[24289]: cluster 2024-09-16T06:50:34.758210+0000 mgr.a (mgr.14373) 3181 : cluster [DBG] pgmap v2206: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-16T06:50:36.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:50:35 smithi047 bash[22744]: cluster 2024-09-16T06:50:34.758210+0000 mgr.a (mgr.14373) 3181 : cluster [DBG] pgmap v2206: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-16T06:50:38.110 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:50:38.110 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:50:38.111 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:50:38.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:50:37 smithi157 bash[24585]: cluster 2024-09-16T06:50:36.760329+0000 mgr.a (mgr.14373) 3182 : cluster [DBG] pgmap v2207: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-16T06:50:38.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:50:37 smithi086 bash[24289]: cluster 2024-09-16T06:50:36.760329+0000 mgr.a (mgr.14373) 3182 : cluster [DBG] pgmap v2207: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-16T06:50:38.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:50:37 smithi047 bash[22744]: cluster 2024-09-16T06:50:36.760329+0000 mgr.a (mgr.14373) 3182 : cluster [DBG] pgmap v2207: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-16T06:50:38.854 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:50:38.855 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:50:38.855 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:50:38.855 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:50:38.855 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:50:39.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:50:38 smithi157 bash[24585]: audit 2024-09-16T06:50:38.523568+0000 mon.b (mon.2) 330 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T06:50:39.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:50:38 smithi086 bash[24289]: audit 2024-09-16T06:50:38.523568+0000 mon.b (mon.2) 330 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T06:50:39.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:50:38 smithi047 bash[22744]: audit 2024-09-16T06:50:38.523568+0000 mon.b (mon.2) 330 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T06:50:40.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:50:39 smithi157 bash[24585]: audit 2024-09-16T06:50:38.437274+0000 mgr.a (mgr.14373) 3183 : audit [DBG] from='client.80031 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:50:40.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:50:39 smithi157 bash[24585]: cluster 2024-09-16T06:50:38.761354+0000 mgr.a (mgr.14373) 3184 : cluster [DBG] pgmap v2208: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:50:40.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:50:39 smithi157 bash[24585]: audit 2024-09-16T06:50:39.314676+0000 mon.b (mon.2) 331 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T06:50:40.305 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:50:39 smithi157 bash[24585]: audit 2024-09-16T06:50:39.316886+0000 mon.b (mon.2) 332 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T06:50:40.305 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:50:39 smithi157 bash[24585]: audit 2024-09-16T06:50:39.330669+0000 mon.a (mon.0) 758 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:50:40.305 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:50:39 smithi157 bash[24585]: audit 2024-09-16T06:50:39.332368+0000 mon.b (mon.2) 333 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:50:40.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:50:39 smithi086 bash[24289]: audit 2024-09-16T06:50:38.437274+0000 mgr.a (mgr.14373) 3183 : audit [DBG] from='client.80031 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:50:40.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:50:39 smithi086 bash[24289]: cluster 2024-09-16T06:50:38.761354+0000 mgr.a (mgr.14373) 3184 : cluster [DBG] pgmap v2208: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:50:40.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:50:39 smithi086 bash[24289]: audit 2024-09-16T06:50:39.314676+0000 mon.b (mon.2) 331 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T06:50:40.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:50:39 smithi086 bash[24289]: audit 2024-09-16T06:50:39.316886+0000 mon.b (mon.2) 332 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T06:50:40.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:50:39 smithi086 bash[24289]: audit 2024-09-16T06:50:39.330669+0000 mon.a (mon.0) 758 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:50:40.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:50:39 smithi086 bash[24289]: audit 2024-09-16T06:50:39.332368+0000 mon.b (mon.2) 333 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:50:40.339 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 06:50:40 smithi047 bash[22994]: debug 2024-09-16T06:50:40.040+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T06:50:40.339 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 06:50:40 smithi047 bash[22994]: debug 2024-09-16T06:50:40.040+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T06:50:40.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:50:39 smithi047 bash[22744]: audit 2024-09-16T06:50:38.437274+0000 mgr.a (mgr.14373) 3183 : audit [DBG] from='client.80031 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:50:40.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:50:39 smithi047 bash[22744]: cluster 2024-09-16T06:50:38.761354+0000 mgr.a (mgr.14373) 3184 : cluster [DBG] pgmap v2208: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:50:40.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:50:39 smithi047 bash[22744]: audit 2024-09-16T06:50:39.314676+0000 mon.b (mon.2) 331 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T06:50:40.340 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:50:39 smithi047 bash[22744]: audit 2024-09-16T06:50:39.316886+0000 mon.b (mon.2) 332 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T06:50:40.340 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:50:39 smithi047 bash[22744]: audit 2024-09-16T06:50:39.330669+0000 mon.a (mon.0) 758 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:50:40.340 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:50:39 smithi047 bash[22744]: audit 2024-09-16T06:50:39.332368+0000 mon.b (mon.2) 333 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:50:41.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:50:40 smithi157 bash[24585]: audit 2024-09-16T06:50:39.337225+0000 mgr.a (mgr.14373) 3185 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:50:41.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:50:40 smithi157 bash[24585]: audit 2024-09-16T06:50:40.044171+0000 mgr.a (mgr.14373) 3186 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T06:50:41.305 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:50:40 smithi157 bash[24585]: cephadm 2024-09-16T06:50:40.046290+0000 mgr.a (mgr.14373) 3187 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T06:50:41.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:50:40 smithi086 bash[24289]: audit 2024-09-16T06:50:39.337225+0000 mgr.a (mgr.14373) 3185 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:50:41.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:50:40 smithi086 bash[24289]: audit 2024-09-16T06:50:40.044171+0000 mgr.a (mgr.14373) 3186 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T06:50:41.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:50:40 smithi086 bash[24289]: cephadm 2024-09-16T06:50:40.046290+0000 mgr.a (mgr.14373) 3187 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T06:50:41.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:50:40 smithi047 bash[22744]: audit 2024-09-16T06:50:39.337225+0000 mgr.a (mgr.14373) 3185 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:50:41.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:50:40 smithi047 bash[22744]: audit 2024-09-16T06:50:40.044171+0000 mgr.a (mgr.14373) 3186 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T06:50:41.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:50:40 smithi047 bash[22744]: cephadm 2024-09-16T06:50:40.046290+0000 mgr.a (mgr.14373) 3187 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T06:50:42.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:50:41 smithi157 bash[24585]: cluster 2024-09-16T06:50:40.762240+0000 mgr.a (mgr.14373) 3188 : cluster [DBG] pgmap v2209: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:50:42.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:50:41 smithi086 bash[24289]: cluster 2024-09-16T06:50:40.762240+0000 mgr.a (mgr.14373) 3188 : cluster [DBG] pgmap v2209: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:50:42.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:50:41 smithi047 bash[22744]: cluster 2024-09-16T06:50:40.762240+0000 mgr.a (mgr.14373) 3188 : cluster [DBG] pgmap v2209: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:50:43.856 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:50:43.857 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:50:43.857 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:50:44.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:50:43 smithi157 bash[24585]: cluster 2024-09-16T06:50:42.764424+0000 mgr.a (mgr.14373) 3189 : cluster [DBG] pgmap v2210: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:50:44.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:50:43 smithi086 bash[24289]: cluster 2024-09-16T06:50:42.764424+0000 mgr.a (mgr.14373) 3189 : cluster [DBG] pgmap v2210: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:50:44.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:50:43 smithi047 bash[22744]: cluster 2024-09-16T06:50:42.764424+0000 mgr.a (mgr.14373) 3189 : cluster [DBG] pgmap v2210: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:50:44.610 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:50:44.610 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:50:44.610 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:50:44.611 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:50:44.611 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:50:45.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:50:44 smithi157 bash[24585]: audit 2024-09-16T06:50:44.187069+0000 mgr.a (mgr.14373) 3190 : audit [DBG] from='client.80214 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:50:45.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:50:44 smithi086 bash[24289]: audit 2024-09-16T06:50:44.187069+0000 mgr.a (mgr.14373) 3190 : audit [DBG] from='client.80214 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:50:45.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:50:44 smithi047 bash[22744]: audit 2024-09-16T06:50:44.187069+0000 mgr.a (mgr.14373) 3190 : audit [DBG] from='client.80214 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:50:46.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:50:45 smithi157 bash[24585]: cluster 2024-09-16T06:50:44.765461+0000 mgr.a (mgr.14373) 3191 : cluster [DBG] pgmap v2211: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:50:46.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:50:45 smithi086 bash[24289]: cluster 2024-09-16T06:50:44.765461+0000 mgr.a (mgr.14373) 3191 : cluster [DBG] pgmap v2211: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:50:46.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:50:45 smithi047 bash[22744]: cluster 2024-09-16T06:50:44.765461+0000 mgr.a (mgr.14373) 3191 : cluster [DBG] pgmap v2211: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:50:48.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:50:47 smithi157 bash[24585]: cluster 2024-09-16T06:50:46.767730+0000 mgr.a (mgr.14373) 3192 : cluster [DBG] pgmap v2212: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:50:48.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:50:47 smithi086 bash[24289]: cluster 2024-09-16T06:50:46.767730+0000 mgr.a (mgr.14373) 3192 : cluster [DBG] pgmap v2212: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:50:48.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:50:47 smithi047 bash[22744]: cluster 2024-09-16T06:50:46.767730+0000 mgr.a (mgr.14373) 3192 : cluster [DBG] pgmap v2212: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:50:49.612 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:50:49.613 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:50:49.613 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:50:50.305 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:50:49 smithi157 bash[24585]: cluster 2024-09-16T06:50:48.768465+0000 mgr.a (mgr.14373) 3193 : cluster [DBG] pgmap v2213: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:50:50.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:50:49 smithi086 bash[24289]: cluster 2024-09-16T06:50:48.768465+0000 mgr.a (mgr.14373) 3193 : cluster [DBG] pgmap v2213: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:50:50.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:50:49 smithi047 bash[22744]: cluster 2024-09-16T06:50:48.768465+0000 mgr.a (mgr.14373) 3193 : cluster [DBG] pgmap v2213: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:50:50.377 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:50:50.378 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:50:50.378 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:50:50.378 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:50:50.378 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:50:51.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:50:50 smithi157 bash[24585]: audit 2024-09-16T06:50:49.950410+0000 mgr.a (mgr.14373) 3194 : audit [DBG] from='client.80286 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:50:51.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:50:50 smithi086 bash[24289]: audit 2024-09-16T06:50:49.950410+0000 mgr.a (mgr.14373) 3194 : audit [DBG] from='client.80286 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:50:51.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:50:50 smithi047 bash[22744]: audit 2024-09-16T06:50:49.950410+0000 mgr.a (mgr.14373) 3194 : audit [DBG] from='client.80286 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:50:52.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:50:52 smithi157 bash[24585]: cluster 2024-09-16T06:50:50.769435+0000 mgr.a (mgr.14373) 3195 : cluster [DBG] pgmap v2214: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:50:52.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:50:52 smithi086 bash[24289]: cluster 2024-09-16T06:50:50.769435+0000 mgr.a (mgr.14373) 3195 : cluster [DBG] pgmap v2214: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:50:52.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:50:52 smithi047 bash[22744]: cluster 2024-09-16T06:50:50.769435+0000 mgr.a (mgr.14373) 3195 : cluster [DBG] pgmap v2214: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:50:54.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:50:54 smithi157 bash[24585]: cluster 2024-09-16T06:50:52.771767+0000 mgr.a (mgr.14373) 3196 : cluster [DBG] pgmap v2215: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:50:54.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:50:54 smithi086 bash[24289]: cluster 2024-09-16T06:50:52.771767+0000 mgr.a (mgr.14373) 3196 : cluster [DBG] pgmap v2215: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:50:54.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:50:54 smithi047 bash[22744]: cluster 2024-09-16T06:50:52.771767+0000 mgr.a (mgr.14373) 3196 : cluster [DBG] pgmap v2215: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:50:55.379 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:50:55.380 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:50:55.380 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:50:56.159 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:50:56.159 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:50:56.159 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:50:56.159 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:50:56.160 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:50:56.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:50:56 smithi157 bash[24585]: cluster 2024-09-16T06:50:54.772539+0000 mgr.a (mgr.14373) 3197 : cluster [DBG] pgmap v2216: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:50:56.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:50:56 smithi086 bash[24289]: cluster 2024-09-16T06:50:54.772539+0000 mgr.a (mgr.14373) 3197 : cluster [DBG] pgmap v2216: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:50:56.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:50:56 smithi047 bash[22744]: cluster 2024-09-16T06:50:54.772539+0000 mgr.a (mgr.14373) 3197 : cluster [DBG] pgmap v2216: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:50:57.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:50:57 smithi157 bash[24585]: audit 2024-09-16T06:50:55.719456+0000 mgr.a (mgr.14373) 3198 : audit [DBG] from='client.80364 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:50:57.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:50:57 smithi086 bash[24289]: audit 2024-09-16T06:50:55.719456+0000 mgr.a (mgr.14373) 3198 : audit [DBG] from='client.80364 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:50:57.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:50:57 smithi047 bash[22744]: audit 2024-09-16T06:50:55.719456+0000 mgr.a (mgr.14373) 3198 : audit [DBG] from='client.80364 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:50:58.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:50:58 smithi157 bash[24585]: cluster 2024-09-16T06:50:56.774816+0000 mgr.a (mgr.14373) 3199 : cluster [DBG] pgmap v2217: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:50:58.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:50:58 smithi086 bash[24289]: cluster 2024-09-16T06:50:56.774816+0000 mgr.a (mgr.14373) 3199 : cluster [DBG] pgmap v2217: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:50:58.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:50:58 smithi047 bash[22744]: cluster 2024-09-16T06:50:56.774816+0000 mgr.a (mgr.14373) 3199 : cluster [DBG] pgmap v2217: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:51:00.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:51:00 smithi157 bash[24585]: cluster 2024-09-16T06:50:58.775579+0000 mgr.a (mgr.14373) 3200 : cluster [DBG] pgmap v2218: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:51:00.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:51:00 smithi086 bash[24289]: cluster 2024-09-16T06:50:58.775579+0000 mgr.a (mgr.14373) 3200 : cluster [DBG] pgmap v2218: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:51:00.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:51:00 smithi047 bash[22744]: cluster 2024-09-16T06:50:58.775579+0000 mgr.a (mgr.14373) 3200 : cluster [DBG] pgmap v2218: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:51:01.161 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:51:01.161 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:51:01.162 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:51:01.926 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:51:01.926 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:51:01.927 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:51:01.927 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:51:01.927 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:51:02.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:51:02 smithi157 bash[24585]: cluster 2024-09-16T06:51:00.776344+0000 mgr.a (mgr.14373) 3201 : cluster [DBG] pgmap v2219: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:51:02.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:51:02 smithi086 bash[24289]: cluster 2024-09-16T06:51:00.776344+0000 mgr.a (mgr.14373) 3201 : cluster [DBG] pgmap v2219: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:51:02.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:51:02 smithi047 bash[22744]: cluster 2024-09-16T06:51:00.776344+0000 mgr.a (mgr.14373) 3201 : cluster [DBG] pgmap v2219: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:51:03.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:51:03 smithi157 bash[24585]: audit 2024-09-16T06:51:01.501586+0000 mgr.a (mgr.14373) 3202 : audit [DBG] from='client.80439 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:51:03.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:51:03 smithi086 bash[24289]: audit 2024-09-16T06:51:01.501586+0000 mgr.a (mgr.14373) 3202 : audit [DBG] from='client.80439 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:51:03.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:51:03 smithi047 bash[22744]: audit 2024-09-16T06:51:01.501586+0000 mgr.a (mgr.14373) 3202 : audit [DBG] from='client.80439 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:51:04.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:51:04 smithi157 bash[24585]: cluster 2024-09-16T06:51:02.779060+0000 mgr.a (mgr.14373) 3203 : cluster [DBG] pgmap v2220: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-16T06:51:04.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:51:04 smithi086 bash[24289]: cluster 2024-09-16T06:51:02.779060+0000 mgr.a (mgr.14373) 3203 : cluster [DBG] pgmap v2220: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-16T06:51:04.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:51:04 smithi047 bash[22744]: cluster 2024-09-16T06:51:02.779060+0000 mgr.a (mgr.14373) 3203 : cluster [DBG] pgmap v2220: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-16T06:51:06.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:51:06 smithi157 bash[24585]: cluster 2024-09-16T06:51:04.779879+0000 mgr.a (mgr.14373) 3204 : cluster [DBG] pgmap v2221: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-16T06:51:06.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:51:06 smithi086 bash[24289]: cluster 2024-09-16T06:51:04.779879+0000 mgr.a (mgr.14373) 3204 : cluster [DBG] pgmap v2221: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-16T06:51:06.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:51:06 smithi047 bash[22744]: cluster 2024-09-16T06:51:04.779879+0000 mgr.a (mgr.14373) 3204 : cluster [DBG] pgmap v2221: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-16T06:51:06.928 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:51:06.929 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:51:06.929 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:51:07.706 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:51:07.707 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:51:07.707 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:51:07.707 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:51:07.707 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:51:08.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:51:08 smithi157 bash[24585]: cluster 2024-09-16T06:51:06.781763+0000 mgr.a (mgr.14373) 3205 : cluster [DBG] pgmap v2222: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:51:08.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:51:08 smithi157 bash[24585]: audit 2024-09-16T06:51:07.267415+0000 mgr.a (mgr.14373) 3206 : audit [DBG] from='client.80517 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:51:08.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:51:08 smithi086 bash[24289]: cluster 2024-09-16T06:51:06.781763+0000 mgr.a (mgr.14373) 3205 : cluster [DBG] pgmap v2222: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:51:08.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:51:08 smithi086 bash[24289]: audit 2024-09-16T06:51:07.267415+0000 mgr.a (mgr.14373) 3206 : audit [DBG] from='client.80517 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:51:08.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:51:08 smithi047 bash[22744]: cluster 2024-09-16T06:51:06.781763+0000 mgr.a (mgr.14373) 3205 : cluster [DBG] pgmap v2222: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:51:08.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:51:08 smithi047 bash[22744]: audit 2024-09-16T06:51:07.267415+0000 mgr.a (mgr.14373) 3206 : audit [DBG] from='client.80517 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:51:09.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:51:09 smithi157 bash[24585]: cluster 2024-09-16T06:51:08.782699+0000 mgr.a (mgr.14373) 3207 : cluster [DBG] pgmap v2223: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:51:09.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:51:09 smithi086 bash[24289]: cluster 2024-09-16T06:51:08.782699+0000 mgr.a (mgr.14373) 3207 : cluster [DBG] pgmap v2223: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:51:09.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:51:09 smithi047 bash[22744]: cluster 2024-09-16T06:51:08.782699+0000 mgr.a (mgr.14373) 3207 : cluster [DBG] pgmap v2223: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:51:12.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:51:11 smithi047 bash[22744]: cluster 2024-09-16T06:51:10.783492+0000 mgr.a (mgr.14373) 3208 : cluster [DBG] pgmap v2224: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T06:51:12.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:51:11 smithi157 bash[24585]: cluster 2024-09-16T06:51:10.783492+0000 mgr.a (mgr.14373) 3208 : cluster [DBG] pgmap v2224: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T06:51:12.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:51:11 smithi086 bash[24289]: cluster 2024-09-16T06:51:10.783492+0000 mgr.a (mgr.14373) 3208 : cluster [DBG] pgmap v2224: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T06:51:12.708 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:51:12.709 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:51:12.709 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:51:13.478 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:51:13.479 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:51:13.479 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:51:13.479 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:51:13.479 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:51:14.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:51:13 smithi157 bash[24585]: cluster 2024-09-16T06:51:12.785781+0000 mgr.a (mgr.14373) 3209 : cluster [DBG] pgmap v2225: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:51:14.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:51:13 smithi157 bash[24585]: audit 2024-09-16T06:51:13.044092+0000 mgr.a (mgr.14373) 3210 : audit [DBG] from='client.80589 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:51:14.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:51:13 smithi086 bash[24289]: cluster 2024-09-16T06:51:12.785781+0000 mgr.a (mgr.14373) 3209 : cluster [DBG] pgmap v2225: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:51:14.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:51:13 smithi086 bash[24289]: audit 2024-09-16T06:51:13.044092+0000 mgr.a (mgr.14373) 3210 : audit [DBG] from='client.80589 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:51:14.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:51:13 smithi047 bash[22744]: cluster 2024-09-16T06:51:12.785781+0000 mgr.a (mgr.14373) 3209 : cluster [DBG] pgmap v2225: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:51:14.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:51:13 smithi047 bash[22744]: audit 2024-09-16T06:51:13.044092+0000 mgr.a (mgr.14373) 3210 : audit [DBG] from='client.80589 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:51:16.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:51:15 smithi157 bash[24585]: cluster 2024-09-16T06:51:14.786723+0000 mgr.a (mgr.14373) 3211 : cluster [DBG] pgmap v2226: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-16T06:51:16.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:51:15 smithi086 bash[24289]: cluster 2024-09-16T06:51:14.786723+0000 mgr.a (mgr.14373) 3211 : cluster [DBG] pgmap v2226: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-16T06:51:16.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:51:15 smithi047 bash[22744]: cluster 2024-09-16T06:51:14.786723+0000 mgr.a (mgr.14373) 3211 : cluster [DBG] pgmap v2226: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-16T06:51:18.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:51:17 smithi157 bash[24585]: cluster 2024-09-16T06:51:16.788846+0000 mgr.a (mgr.14373) 3212 : cluster [DBG] pgmap v2227: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-09-16T06:51:18.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:51:17 smithi086 bash[24289]: cluster 2024-09-16T06:51:16.788846+0000 mgr.a (mgr.14373) 3212 : cluster [DBG] pgmap v2227: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-09-16T06:51:18.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:51:17 smithi047 bash[22744]: cluster 2024-09-16T06:51:16.788846+0000 mgr.a (mgr.14373) 3212 : cluster [DBG] pgmap v2227: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-09-16T06:51:18.480 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:51:18.481 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:51:18.481 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:51:19.254 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:51:19.255 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:51:19.255 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:51:19.255 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:51:19.255 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:51:20.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:51:19 smithi157 bash[24585]: cluster 2024-09-16T06:51:18.789576+0000 mgr.a (mgr.14373) 3213 : cluster [DBG] pgmap v2228: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:51:20.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:51:19 smithi157 bash[24585]: audit 2024-09-16T06:51:18.822445+0000 mgr.a (mgr.14373) 3214 : audit [DBG] from='client.80667 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:51:20.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:51:19 smithi086 bash[24289]: cluster 2024-09-16T06:51:18.789576+0000 mgr.a (mgr.14373) 3213 : cluster [DBG] pgmap v2228: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:51:20.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:51:19 smithi086 bash[24289]: audit 2024-09-16T06:51:18.822445+0000 mgr.a (mgr.14373) 3214 : audit [DBG] from='client.80667 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:51:20.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:51:19 smithi047 bash[22744]: cluster 2024-09-16T06:51:18.789576+0000 mgr.a (mgr.14373) 3213 : cluster [DBG] pgmap v2228: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:51:20.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:51:19 smithi047 bash[22744]: audit 2024-09-16T06:51:18.822445+0000 mgr.a (mgr.14373) 3214 : audit [DBG] from='client.80667 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:51:22.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:51:21 smithi157 bash[24585]: cluster 2024-09-16T06:51:20.790510+0000 mgr.a (mgr.14373) 3215 : cluster [DBG] pgmap v2229: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:51:22.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:51:21 smithi086 bash[24289]: cluster 2024-09-16T06:51:20.790510+0000 mgr.a (mgr.14373) 3215 : cluster [DBG] pgmap v2229: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:51:22.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:51:21 smithi047 bash[22744]: cluster 2024-09-16T06:51:20.790510+0000 mgr.a (mgr.14373) 3215 : cluster [DBG] pgmap v2229: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:51:24.256 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:51:24.257 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:51:24.257 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:51:24.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:51:23 smithi157 bash[24585]: cluster 2024-09-16T06:51:22.792700+0000 mgr.a (mgr.14373) 3216 : cluster [DBG] pgmap v2230: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:51:24.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:51:23 smithi086 bash[24289]: cluster 2024-09-16T06:51:22.792700+0000 mgr.a (mgr.14373) 3216 : cluster [DBG] pgmap v2230: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:51:24.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:51:23 smithi047 bash[22744]: cluster 2024-09-16T06:51:22.792700+0000 mgr.a (mgr.14373) 3216 : cluster [DBG] pgmap v2230: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:51:25.022 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:51:25.022 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:51:25.022 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:51:25.022 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:51:25.023 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:51:26.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:51:25 smithi157 bash[24585]: audit 2024-09-16T06:51:24.591014+0000 mgr.a (mgr.14373) 3217 : audit [DBG] from='client.80742 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:51:26.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:51:25 smithi157 bash[24585]: cluster 2024-09-16T06:51:24.793300+0000 mgr.a (mgr.14373) 3218 : cluster [DBG] pgmap v2231: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:51:26.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:51:25 smithi086 bash[24289]: audit 2024-09-16T06:51:24.591014+0000 mgr.a (mgr.14373) 3217 : audit [DBG] from='client.80742 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:51:26.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:51:25 smithi086 bash[24289]: cluster 2024-09-16T06:51:24.793300+0000 mgr.a (mgr.14373) 3218 : cluster [DBG] pgmap v2231: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:51:26.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:51:25 smithi047 bash[22744]: audit 2024-09-16T06:51:24.591014+0000 mgr.a (mgr.14373) 3217 : audit [DBG] from='client.80742 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:51:26.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:51:25 smithi047 bash[22744]: cluster 2024-09-16T06:51:24.793300+0000 mgr.a (mgr.14373) 3218 : cluster [DBG] pgmap v2231: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:51:28.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:51:27 smithi157 bash[24585]: cluster 2024-09-16T06:51:26.795509+0000 mgr.a (mgr.14373) 3219 : cluster [DBG] pgmap v2232: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:51:28.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:51:27 smithi086 bash[24289]: cluster 2024-09-16T06:51:26.795509+0000 mgr.a (mgr.14373) 3219 : cluster [DBG] pgmap v2232: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:51:28.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:51:27 smithi047 bash[22744]: cluster 2024-09-16T06:51:26.795509+0000 mgr.a (mgr.14373) 3219 : cluster [DBG] pgmap v2232: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:51:30.023 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:51:30.025 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:51:30.025 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:51:30.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:51:29 smithi157 bash[24585]: cluster 2024-09-16T06:51:28.796394+0000 mgr.a (mgr.14373) 3220 : cluster [DBG] pgmap v2233: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:51:30.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:51:29 smithi086 bash[24289]: cluster 2024-09-16T06:51:28.796394+0000 mgr.a (mgr.14373) 3220 : cluster [DBG] pgmap v2233: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:51:30.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:51:29 smithi047 bash[22744]: cluster 2024-09-16T06:51:28.796394+0000 mgr.a (mgr.14373) 3220 : cluster [DBG] pgmap v2233: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:51:30.777 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:51:30.777 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:51:30.778 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:51:30.778 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:51:30.778 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:51:32.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:51:31 smithi157 bash[24585]: audit 2024-09-16T06:51:30.358832+0000 mgr.a (mgr.14373) 3221 : audit [DBG] from='client.80820 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:51:32.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:51:31 smithi157 bash[24585]: cluster 2024-09-16T06:51:30.797106+0000 mgr.a (mgr.14373) 3222 : cluster [DBG] pgmap v2234: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:51:32.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:51:31 smithi086 bash[24289]: audit 2024-09-16T06:51:30.358832+0000 mgr.a (mgr.14373) 3221 : audit [DBG] from='client.80820 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:51:32.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:51:31 smithi086 bash[24289]: cluster 2024-09-16T06:51:30.797106+0000 mgr.a (mgr.14373) 3222 : cluster [DBG] pgmap v2234: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:51:32.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:51:31 smithi047 bash[22744]: audit 2024-09-16T06:51:30.358832+0000 mgr.a (mgr.14373) 3221 : audit [DBG] from='client.80820 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:51:32.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:51:31 smithi047 bash[22744]: cluster 2024-09-16T06:51:30.797106+0000 mgr.a (mgr.14373) 3222 : cluster [DBG] pgmap v2234: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:51:34.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:51:33 smithi157 bash[24585]: cluster 2024-09-16T06:51:32.799330+0000 mgr.a (mgr.14373) 3223 : cluster [DBG] pgmap v2235: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:51:34.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:51:33 smithi086 bash[24289]: cluster 2024-09-16T06:51:32.799330+0000 mgr.a (mgr.14373) 3223 : cluster [DBG] pgmap v2235: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:51:34.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:51:33 smithi047 bash[22744]: cluster 2024-09-16T06:51:32.799330+0000 mgr.a (mgr.14373) 3223 : cluster [DBG] pgmap v2235: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:51:35.779 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:51:35.779 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:51:35.780 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:51:36.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:51:35 smithi157 bash[24585]: cluster 2024-09-16T06:51:34.800085+0000 mgr.a (mgr.14373) 3224 : cluster [DBG] pgmap v2236: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:51:36.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:51:35 smithi086 bash[24289]: cluster 2024-09-16T06:51:34.800085+0000 mgr.a (mgr.14373) 3224 : cluster [DBG] pgmap v2236: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:51:36.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:51:35 smithi047 bash[22744]: cluster 2024-09-16T06:51:34.800085+0000 mgr.a (mgr.14373) 3224 : cluster [DBG] pgmap v2236: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:51:36.565 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:51:36.565 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:51:36.565 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:51:36.565 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:51:36.566 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:51:37.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:51:36 smithi157 bash[24585]: audit 2024-09-16T06:51:36.120667+0000 mgr.a (mgr.14373) 3225 : audit [DBG] from='client.80898 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:51:37.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:51:36 smithi086 bash[24289]: audit 2024-09-16T06:51:36.120667+0000 mgr.a (mgr.14373) 3225 : audit [DBG] from='client.80898 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:51:37.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:51:36 smithi047 bash[22744]: audit 2024-09-16T06:51:36.120667+0000 mgr.a (mgr.14373) 3225 : audit [DBG] from='client.80898 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:51:38.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:51:37 smithi157 bash[24585]: cluster 2024-09-16T06:51:36.802420+0000 mgr.a (mgr.14373) 3226 : cluster [DBG] pgmap v2237: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:51:38.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:51:37 smithi086 bash[24289]: cluster 2024-09-16T06:51:36.802420+0000 mgr.a (mgr.14373) 3226 : cluster [DBG] pgmap v2237: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:51:38.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:51:37 smithi047 bash[22744]: cluster 2024-09-16T06:51:36.802420+0000 mgr.a (mgr.14373) 3226 : cluster [DBG] pgmap v2237: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:51:40.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:51:39 smithi157 bash[24585]: cluster 2024-09-16T06:51:38.803171+0000 mgr.a (mgr.14373) 3227 : cluster [DBG] pgmap v2238: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-16T06:51:40.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:51:39 smithi086 bash[24289]: cluster 2024-09-16T06:51:38.803171+0000 mgr.a (mgr.14373) 3227 : cluster [DBG] pgmap v2238: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-16T06:51:40.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:51:39 smithi047 bash[22744]: cluster 2024-09-16T06:51:38.803171+0000 mgr.a (mgr.14373) 3227 : cluster [DBG] pgmap v2238: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-16T06:51:41.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:51:40 smithi157 bash[24585]: audit 2024-09-16T06:51:40.093674+0000 mon.b (mon.2) 334 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T06:51:41.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:51:40 smithi086 bash[24289]: audit 2024-09-16T06:51:40.093674+0000 mon.b (mon.2) 334 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T06:51:41.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:51:40 smithi047 bash[22744]: audit 2024-09-16T06:51:40.093674+0000 mon.b (mon.2) 334 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T06:51:41.566 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:51:41.567 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:51:41.567 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:51:42.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:51:41 smithi157 bash[24585]: cluster 2024-09-16T06:51:40.803880+0000 mgr.a (mgr.14373) 3228 : cluster [DBG] pgmap v2239: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-16T06:51:42.304 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:51:42.304 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:51:42.305 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:51:42.305 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:51:42.305 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:51:42.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:51:41 smithi086 bash[24289]: cluster 2024-09-16T06:51:40.803880+0000 mgr.a (mgr.14373) 3228 : cluster [DBG] pgmap v2239: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-16T06:51:42.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:51:41 smithi047 bash[22744]: cluster 2024-09-16T06:51:40.803880+0000 mgr.a (mgr.14373) 3228 : cluster [DBG] pgmap v2239: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-16T06:51:43.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:51:42 smithi157 bash[24585]: audit 2024-09-16T06:51:41.898038+0000 mgr.a (mgr.14373) 3229 : audit [DBG] from='client.80973 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:51:43.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:51:42 smithi086 bash[24289]: audit 2024-09-16T06:51:41.898038+0000 mgr.a (mgr.14373) 3229 : audit [DBG] from='client.80973 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:51:43.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:51:42 smithi047 bash[22744]: audit 2024-09-16T06:51:41.898038+0000 mgr.a (mgr.14373) 3229 : audit [DBG] from='client.80973 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:51:44.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:51:43 smithi157 bash[24585]: cluster 2024-09-16T06:51:42.806546+0000 mgr.a (mgr.14373) 3230 : cluster [DBG] pgmap v2240: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:51:44.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:51:43 smithi086 bash[24289]: cluster 2024-09-16T06:51:42.806546+0000 mgr.a (mgr.14373) 3230 : cluster [DBG] pgmap v2240: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:51:44.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:51:43 smithi047 bash[22744]: cluster 2024-09-16T06:51:42.806546+0000 mgr.a (mgr.14373) 3230 : cluster [DBG] pgmap v2240: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:51:46.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:51:45 smithi157 bash[24585]: cluster 2024-09-16T06:51:44.807350+0000 mgr.a (mgr.14373) 3231 : cluster [DBG] pgmap v2241: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:51:46.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:51:45 smithi157 bash[24585]: audit 2024-09-16T06:51:45.452126+0000 mon.a (mon.0) 759 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:51:46.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:51:45 smithi157 bash[24585]: audit 2024-09-16T06:51:45.456193+0000 mon.a (mon.0) 760 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:51:46.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:51:45 smithi157 bash[24585]: audit 2024-09-16T06:51:45.464568+0000 mon.a (mon.0) 761 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:51:46.305 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:51:45 smithi157 bash[24585]: audit 2024-09-16T06:51:45.468110+0000 mon.a (mon.0) 762 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:51:46.305 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:51:45 smithi157 bash[24585]: audit 2024-09-16T06:51:45.478832+0000 mon.a (mon.0) 763 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:51:46.305 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:51:45 smithi157 bash[24585]: audit 2024-09-16T06:51:45.487557+0000 mon.a (mon.0) 764 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:51:46.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:51:45 smithi086 bash[24289]: cluster 2024-09-16T06:51:44.807350+0000 mgr.a (mgr.14373) 3231 : cluster [DBG] pgmap v2241: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:51:46.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:51:45 smithi086 bash[24289]: audit 2024-09-16T06:51:45.452126+0000 mon.a (mon.0) 759 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:51:46.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:51:45 smithi086 bash[24289]: audit 2024-09-16T06:51:45.456193+0000 mon.a (mon.0) 760 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:51:46.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:51:45 smithi086 bash[24289]: audit 2024-09-16T06:51:45.464568+0000 mon.a (mon.0) 761 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:51:46.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:51:45 smithi086 bash[24289]: audit 2024-09-16T06:51:45.468110+0000 mon.a (mon.0) 762 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:51:46.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:51:45 smithi086 bash[24289]: audit 2024-09-16T06:51:45.478832+0000 mon.a (mon.0) 763 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:51:46.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:51:45 smithi086 bash[24289]: audit 2024-09-16T06:51:45.487557+0000 mon.a (mon.0) 764 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:51:46.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:51:45 smithi047 bash[22744]: cluster 2024-09-16T06:51:44.807350+0000 mgr.a (mgr.14373) 3231 : cluster [DBG] pgmap v2241: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:51:46.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:51:45 smithi047 bash[22744]: audit 2024-09-16T06:51:45.452126+0000 mon.a (mon.0) 759 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:51:46.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:51:45 smithi047 bash[22744]: audit 2024-09-16T06:51:45.456193+0000 mon.a (mon.0) 760 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:51:46.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:51:45 smithi047 bash[22744]: audit 2024-09-16T06:51:45.464568+0000 mon.a (mon.0) 761 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:51:46.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:51:45 smithi047 bash[22744]: audit 2024-09-16T06:51:45.468110+0000 mon.a (mon.0) 762 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:51:46.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:51:45 smithi047 bash[22744]: audit 2024-09-16T06:51:45.478832+0000 mon.a (mon.0) 763 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:51:46.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:51:45 smithi047 bash[22744]: audit 2024-09-16T06:51:45.487557+0000 mon.a (mon.0) 764 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:51:47.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:51:46 smithi157 bash[24585]: audit 2024-09-16T06:51:46.203111+0000 mon.b (mon.2) 335 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T06:51:47.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:51:46 smithi157 bash[24585]: audit 2024-09-16T06:51:46.204997+0000 mon.b (mon.2) 336 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T06:51:47.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:51:46 smithi157 bash[24585]: audit 2024-09-16T06:51:46.217429+0000 mon.a (mon.0) 765 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:51:47.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:51:46 smithi157 bash[24585]: audit 2024-09-16T06:51:46.220706+0000 mon.b (mon.2) 337 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:51:47.305 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:51:46 smithi157 bash[24585]: audit 2024-09-16T06:51:46.225430+0000 mgr.a (mgr.14373) 3232 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:51:47.305 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:51:47.306 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:51:47.306 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:51:47.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:51:46 smithi086 bash[24289]: audit 2024-09-16T06:51:46.203111+0000 mon.b (mon.2) 335 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T06:51:47.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:51:46 smithi086 bash[24289]: audit 2024-09-16T06:51:46.204997+0000 mon.b (mon.2) 336 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T06:51:47.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:51:46 smithi086 bash[24289]: audit 2024-09-16T06:51:46.217429+0000 mon.a (mon.0) 765 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:51:47.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:51:46 smithi086 bash[24289]: audit 2024-09-16T06:51:46.220706+0000 mon.b (mon.2) 337 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:51:47.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:51:46 smithi086 bash[24289]: audit 2024-09-16T06:51:46.225430+0000 mgr.a (mgr.14373) 3232 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:51:47.338 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 06:51:46 smithi047 bash[22994]: debug 2024-09-16T06:51:46.959+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T06:51:47.338 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 06:51:46 smithi047 bash[22994]: debug 2024-09-16T06:51:46.963+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T06:51:47.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:51:46 smithi047 bash[22744]: audit 2024-09-16T06:51:46.203111+0000 mon.b (mon.2) 335 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T06:51:47.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:51:46 smithi047 bash[22744]: audit 2024-09-16T06:51:46.204997+0000 mon.b (mon.2) 336 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T06:51:47.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:51:46 smithi047 bash[22744]: audit 2024-09-16T06:51:46.217429+0000 mon.a (mon.0) 765 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:51:47.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:51:46 smithi047 bash[22744]: audit 2024-09-16T06:51:46.220706+0000 mon.b (mon.2) 337 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:51:47.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:51:46 smithi047 bash[22744]: audit 2024-09-16T06:51:46.225430+0000 mgr.a (mgr.14373) 3232 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:51:48.081 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:51:48.081 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:51:48.081 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:51:48.081 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:51:48.081 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:51:48.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:51:48 smithi157 bash[24585]: cluster 2024-09-16T06:51:46.808707+0000 mgr.a (mgr.14373) 3233 : cluster [DBG] pgmap v2242: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 3.2 KiB/s rd, 170 B/s wr, 3 op/s 2024-09-16T06:51:48.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:51:48 smithi157 bash[24585]: audit 2024-09-16T06:51:46.965658+0000 mgr.a (mgr.14373) 3234 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T06:51:48.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:51:48 smithi157 bash[24585]: cephadm 2024-09-16T06:51:46.967318+0000 mgr.a (mgr.14373) 3235 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T06:51:48.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:51:48 smithi086 bash[24289]: cluster 2024-09-16T06:51:46.808707+0000 mgr.a (mgr.14373) 3233 : cluster [DBG] pgmap v2242: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 3.2 KiB/s rd, 170 B/s wr, 3 op/s 2024-09-16T06:51:48.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:51:48 smithi086 bash[24289]: audit 2024-09-16T06:51:46.965658+0000 mgr.a (mgr.14373) 3234 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T06:51:48.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:51:48 smithi086 bash[24289]: cephadm 2024-09-16T06:51:46.967318+0000 mgr.a (mgr.14373) 3235 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T06:51:48.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:51:48 smithi047 bash[22744]: cluster 2024-09-16T06:51:46.808707+0000 mgr.a (mgr.14373) 3233 : cluster [DBG] pgmap v2242: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 3.2 KiB/s rd, 170 B/s wr, 3 op/s 2024-09-16T06:51:48.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:51:48 smithi047 bash[22744]: audit 2024-09-16T06:51:46.965658+0000 mgr.a (mgr.14373) 3234 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T06:51:48.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:51:48 smithi047 bash[22744]: cephadm 2024-09-16T06:51:46.967318+0000 mgr.a (mgr.14373) 3235 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T06:51:49.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:51:49 smithi157 bash[24585]: audit 2024-09-16T06:51:47.645804+0000 mgr.a (mgr.14373) 3236 : audit [DBG] from='client.81159 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:51:49.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:51:49 smithi086 bash[24289]: audit 2024-09-16T06:51:47.645804+0000 mgr.a (mgr.14373) 3236 : audit [DBG] from='client.81159 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:51:49.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:51:49 smithi047 bash[22744]: audit 2024-09-16T06:51:47.645804+0000 mgr.a (mgr.14373) 3236 : audit [DBG] from='client.81159 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:51:50.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:51:50 smithi157 bash[24585]: cluster 2024-09-16T06:51:48.809592+0000 mgr.a (mgr.14373) 3237 : cluster [DBG] pgmap v2243: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-09-16T06:51:50.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:51:50 smithi086 bash[24289]: cluster 2024-09-16T06:51:48.809592+0000 mgr.a (mgr.14373) 3237 : cluster [DBG] pgmap v2243: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-09-16T06:51:50.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:51:50 smithi047 bash[22744]: cluster 2024-09-16T06:51:48.809592+0000 mgr.a (mgr.14373) 3237 : cluster [DBG] pgmap v2243: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-09-16T06:51:52.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:51:52 smithi157 bash[24585]: cluster 2024-09-16T06:51:50.810380+0000 mgr.a (mgr.14373) 3238 : cluster [DBG] pgmap v2244: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-09-16T06:51:52.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:51:52 smithi086 bash[24289]: cluster 2024-09-16T06:51:50.810380+0000 mgr.a (mgr.14373) 3238 : cluster [DBG] pgmap v2244: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-09-16T06:51:52.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:51:52 smithi047 bash[22744]: cluster 2024-09-16T06:51:50.810380+0000 mgr.a (mgr.14373) 3238 : cluster [DBG] pgmap v2244: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-09-16T06:51:53.082 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:51:53.083 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:51:53.083 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:51:53.836 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:51:53.837 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:51:53.837 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:51:53.837 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:51:53.837 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:51:54.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:51:54 smithi157 bash[24585]: cluster 2024-09-16T06:51:52.812485+0000 mgr.a (mgr.14373) 3239 : cluster [DBG] pgmap v2245: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.1 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:51:54.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:51:54 smithi086 bash[24289]: cluster 2024-09-16T06:51:52.812485+0000 mgr.a (mgr.14373) 3239 : cluster [DBG] pgmap v2245: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.1 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:51:54.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:51:54 smithi047 bash[22744]: cluster 2024-09-16T06:51:52.812485+0000 mgr.a (mgr.14373) 3239 : cluster [DBG] pgmap v2245: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.1 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:51:55.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:51:55 smithi157 bash[24585]: audit 2024-09-16T06:51:53.414334+0000 mgr.a (mgr.14373) 3240 : audit [DBG] from='client.81237 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:51:55.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:51:55 smithi086 bash[24289]: audit 2024-09-16T06:51:53.414334+0000 mgr.a (mgr.14373) 3240 : audit [DBG] from='client.81237 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:51:55.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:51:55 smithi047 bash[22744]: audit 2024-09-16T06:51:53.414334+0000 mgr.a (mgr.14373) 3240 : audit [DBG] from='client.81237 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:51:56.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:51:56 smithi157 bash[24585]: cluster 2024-09-16T06:51:54.813375+0000 mgr.a (mgr.14373) 3241 : cluster [DBG] pgmap v2246: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:51:56.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:51:56 smithi086 bash[24289]: cluster 2024-09-16T06:51:54.813375+0000 mgr.a (mgr.14373) 3241 : cluster [DBG] pgmap v2246: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:51:56.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:51:56 smithi047 bash[22744]: cluster 2024-09-16T06:51:54.813375+0000 mgr.a (mgr.14373) 3241 : cluster [DBG] pgmap v2246: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:51:58.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:51:58 smithi157 bash[24585]: cluster 2024-09-16T06:51:56.815545+0000 mgr.a (mgr.14373) 3242 : cluster [DBG] pgmap v2247: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:51:58.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:51:58 smithi086 bash[24289]: cluster 2024-09-16T06:51:56.815545+0000 mgr.a (mgr.14373) 3242 : cluster [DBG] pgmap v2247: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:51:58.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:51:58 smithi047 bash[22744]: cluster 2024-09-16T06:51:56.815545+0000 mgr.a (mgr.14373) 3242 : cluster [DBG] pgmap v2247: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:51:58.838 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:51:58.840 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:51:58.840 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:51:59.608 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:51:59.609 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:51:59.609 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:51:59.609 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:51:59.609 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:52:00.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:52:00 smithi157 bash[24585]: cluster 2024-09-16T06:51:58.816277+0000 mgr.a (mgr.14373) 3243 : cluster [DBG] pgmap v2248: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 5.7 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-16T06:52:00.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:52:00 smithi157 bash[24585]: audit 2024-09-16T06:51:59.176582+0000 mgr.a (mgr.14373) 3244 : audit [DBG] from='client.81315 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:52:00.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:52:00 smithi086 bash[24289]: cluster 2024-09-16T06:51:58.816277+0000 mgr.a (mgr.14373) 3243 : cluster [DBG] pgmap v2248: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 5.7 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-16T06:52:00.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:52:00 smithi086 bash[24289]: audit 2024-09-16T06:51:59.176582+0000 mgr.a (mgr.14373) 3244 : audit [DBG] from='client.81315 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:52:00.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:52:00 smithi047 bash[22744]: cluster 2024-09-16T06:51:58.816277+0000 mgr.a (mgr.14373) 3243 : cluster [DBG] pgmap v2248: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 5.7 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-16T06:52:00.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:52:00 smithi047 bash[22744]: audit 2024-09-16T06:51:59.176582+0000 mgr.a (mgr.14373) 3244 : audit [DBG] from='client.81315 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:52:02.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:52:02 smithi157 bash[24585]: cluster 2024-09-16T06:52:00.817162+0000 mgr.a (mgr.14373) 3245 : cluster [DBG] pgmap v2249: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 5.7 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-16T06:52:02.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:52:02 smithi086 bash[24289]: cluster 2024-09-16T06:52:00.817162+0000 mgr.a (mgr.14373) 3245 : cluster [DBG] pgmap v2249: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 5.7 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-16T06:52:02.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:52:02 smithi047 bash[22744]: cluster 2024-09-16T06:52:00.817162+0000 mgr.a (mgr.14373) 3245 : cluster [DBG] pgmap v2249: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 5.7 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-16T06:52:04.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:52:04 smithi157 bash[24585]: cluster 2024-09-16T06:52:02.819721+0000 mgr.a (mgr.14373) 3246 : cluster [DBG] pgmap v2250: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-16T06:52:04.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:52:04 smithi086 bash[24289]: cluster 2024-09-16T06:52:02.819721+0000 mgr.a (mgr.14373) 3246 : cluster [DBG] pgmap v2250: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-16T06:52:04.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:52:04 smithi047 bash[22744]: cluster 2024-09-16T06:52:02.819721+0000 mgr.a (mgr.14373) 3246 : cluster [DBG] pgmap v2250: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-16T06:52:04.610 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:52:04.611 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:52:04.611 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:52:05.383 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:52:05.383 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:52:05.384 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:52:05.384 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:52:05.384 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:52:06.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:52:06 smithi157 bash[24585]: cluster 2024-09-16T06:52:04.820498+0000 mgr.a (mgr.14373) 3247 : cluster [DBG] pgmap v2251: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:52:06.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:52:06 smithi157 bash[24585]: audit 2024-09-16T06:52:04.948390+0000 mgr.a (mgr.14373) 3248 : audit [DBG] from='client.81390 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:52:06.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:52:06 smithi086 bash[24289]: cluster 2024-09-16T06:52:04.820498+0000 mgr.a (mgr.14373) 3247 : cluster [DBG] pgmap v2251: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:52:06.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:52:06 smithi086 bash[24289]: audit 2024-09-16T06:52:04.948390+0000 mgr.a (mgr.14373) 3248 : audit [DBG] from='client.81390 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:52:06.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:52:06 smithi047 bash[22744]: cluster 2024-09-16T06:52:04.820498+0000 mgr.a (mgr.14373) 3247 : cluster [DBG] pgmap v2251: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:52:06.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:52:06 smithi047 bash[22744]: audit 2024-09-16T06:52:04.948390+0000 mgr.a (mgr.14373) 3248 : audit [DBG] from='client.81390 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:52:08.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:52:08 smithi157 bash[24585]: cluster 2024-09-16T06:52:06.822940+0000 mgr.a (mgr.14373) 3249 : cluster [DBG] pgmap v2252: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:52:08.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:52:08 smithi086 bash[24289]: cluster 2024-09-16T06:52:06.822940+0000 mgr.a (mgr.14373) 3249 : cluster [DBG] pgmap v2252: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:52:08.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:52:08 smithi047 bash[22744]: cluster 2024-09-16T06:52:06.822940+0000 mgr.a (mgr.14373) 3249 : cluster [DBG] pgmap v2252: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:52:10.385 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:52:10.386 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:52:10.386 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:52:10.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:52:10 smithi157 bash[24585]: cluster 2024-09-16T06:52:08.823735+0000 mgr.a (mgr.14373) 3250 : cluster [DBG] pgmap v2253: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:52:10.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:52:10 smithi086 bash[24289]: cluster 2024-09-16T06:52:08.823735+0000 mgr.a (mgr.14373) 3250 : cluster [DBG] pgmap v2253: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:52:10.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:52:10 smithi047 bash[22744]: cluster 2024-09-16T06:52:08.823735+0000 mgr.a (mgr.14373) 3250 : cluster [DBG] pgmap v2253: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:52:11.163 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:52:11.163 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:52:11.163 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:52:11.163 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:52:11.163 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:52:12.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:52:12 smithi157 bash[24585]: audit 2024-09-16T06:52:10.722725+0000 mgr.a (mgr.14373) 3251 : audit [DBG] from='client.81468 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:52:12.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:52:12 smithi157 bash[24585]: cluster 2024-09-16T06:52:10.824249+0000 mgr.a (mgr.14373) 3252 : cluster [DBG] pgmap v2254: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:52:12.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:52:12 smithi086 bash[24289]: audit 2024-09-16T06:52:10.722725+0000 mgr.a (mgr.14373) 3251 : audit [DBG] from='client.81468 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:52:12.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:52:12 smithi086 bash[24289]: cluster 2024-09-16T06:52:10.824249+0000 mgr.a (mgr.14373) 3252 : cluster [DBG] pgmap v2254: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:52:12.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:52:12 smithi047 bash[22744]: audit 2024-09-16T06:52:10.722725+0000 mgr.a (mgr.14373) 3251 : audit [DBG] from='client.81468 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:52:12.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:52:12 smithi047 bash[22744]: cluster 2024-09-16T06:52:10.824249+0000 mgr.a (mgr.14373) 3252 : cluster [DBG] pgmap v2254: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:52:14.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:52:14 smithi157 bash[24585]: cluster 2024-09-16T06:52:12.826656+0000 mgr.a (mgr.14373) 3253 : cluster [DBG] pgmap v2255: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:52:14.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:52:14 smithi086 bash[24289]: cluster 2024-09-16T06:52:12.826656+0000 mgr.a (mgr.14373) 3253 : cluster [DBG] pgmap v2255: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:52:14.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:52:14 smithi047 bash[22744]: cluster 2024-09-16T06:52:12.826656+0000 mgr.a (mgr.14373) 3253 : cluster [DBG] pgmap v2255: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:52:16.164 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:52:16.165 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:52:16.165 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:52:16.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:52:16 smithi157 bash[24585]: cluster 2024-09-16T06:52:14.827449+0000 mgr.a (mgr.14373) 3254 : cluster [DBG] pgmap v2256: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:52:16.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:52:16 smithi086 bash[24289]: cluster 2024-09-16T06:52:14.827449+0000 mgr.a (mgr.14373) 3254 : cluster [DBG] pgmap v2256: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:52:16.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:52:16 smithi047 bash[22744]: cluster 2024-09-16T06:52:14.827449+0000 mgr.a (mgr.14373) 3254 : cluster [DBG] pgmap v2256: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:52:16.918 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:52:16.918 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:52:16.918 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:52:16.919 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:52:16.919 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:52:18.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:52:18 smithi157 bash[24585]: audit 2024-09-16T06:52:16.496172+0000 mgr.a (mgr.14373) 3255 : audit [DBG] from='client.81546 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:52:18.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:52:18 smithi157 bash[24585]: cluster 2024-09-16T06:52:16.828762+0000 mgr.a (mgr.14373) 3256 : cluster [DBG] pgmap v2257: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-16T06:52:18.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:52:18 smithi086 bash[24289]: audit 2024-09-16T06:52:16.496172+0000 mgr.a (mgr.14373) 3255 : audit [DBG] from='client.81546 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:52:18.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:52:18 smithi086 bash[24289]: cluster 2024-09-16T06:52:16.828762+0000 mgr.a (mgr.14373) 3256 : cluster [DBG] pgmap v2257: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-16T06:52:18.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:52:18 smithi047 bash[22744]: audit 2024-09-16T06:52:16.496172+0000 mgr.a (mgr.14373) 3255 : audit [DBG] from='client.81546 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:52:18.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:52:18 smithi047 bash[22744]: cluster 2024-09-16T06:52:16.828762+0000 mgr.a (mgr.14373) 3256 : cluster [DBG] pgmap v2257: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-16T06:52:20.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:52:20 smithi157 bash[24585]: cluster 2024-09-16T06:52:18.829525+0000 mgr.a (mgr.14373) 3257 : cluster [DBG] pgmap v2258: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-16T06:52:20.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:52:20 smithi086 bash[24289]: cluster 2024-09-16T06:52:18.829525+0000 mgr.a (mgr.14373) 3257 : cluster [DBG] pgmap v2258: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-16T06:52:20.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:52:20 smithi047 bash[22744]: cluster 2024-09-16T06:52:18.829525+0000 mgr.a (mgr.14373) 3257 : cluster [DBG] pgmap v2258: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-16T06:52:21.919 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:52:21.920 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:52:21.920 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:52:22.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:52:22 smithi157 bash[24585]: cluster 2024-09-16T06:52:20.830282+0000 mgr.a (mgr.14373) 3258 : cluster [DBG] pgmap v2259: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-16T06:52:22.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:52:22 smithi086 bash[24289]: cluster 2024-09-16T06:52:20.830282+0000 mgr.a (mgr.14373) 3258 : cluster [DBG] pgmap v2259: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-16T06:52:22.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:52:22 smithi047 bash[22744]: cluster 2024-09-16T06:52:20.830282+0000 mgr.a (mgr.14373) 3258 : cluster [DBG] pgmap v2259: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-16T06:52:22.672 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:52:22.673 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:52:22.673 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:52:22.673 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:52:22.673 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:52:23.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:52:23 smithi086 bash[24289]: audit 2024-09-16T06:52:22.256901+0000 mgr.a (mgr.14373) 3259 : audit [DBG] from='client.81624 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:52:23.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:52:23 smithi047 bash[22744]: audit 2024-09-16T06:52:22.256901+0000 mgr.a (mgr.14373) 3259 : audit [DBG] from='client.81624 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:52:23.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:52:23 smithi157 bash[24585]: audit 2024-09-16T06:52:22.256901+0000 mgr.a (mgr.14373) 3259 : audit [DBG] from='client.81624 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:52:24.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:52:24 smithi086 bash[24289]: cluster 2024-09-16T06:52:22.833052+0000 mgr.a (mgr.14373) 3260 : cluster [DBG] pgmap v2260: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:52:24.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:52:24 smithi047 bash[22744]: cluster 2024-09-16T06:52:22.833052+0000 mgr.a (mgr.14373) 3260 : cluster [DBG] pgmap v2260: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:52:24.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:52:24 smithi157 bash[24585]: cluster 2024-09-16T06:52:22.833052+0000 mgr.a (mgr.14373) 3260 : cluster [DBG] pgmap v2260: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:52:25.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:52:25 smithi047 bash[22744]: cluster 2024-09-16T06:52:24.833843+0000 mgr.a (mgr.14373) 3261 : cluster [DBG] pgmap v2261: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:52:25.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:52:25 smithi157 bash[24585]: cluster 2024-09-16T06:52:24.833843+0000 mgr.a (mgr.14373) 3261 : cluster [DBG] pgmap v2261: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:52:25.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:52:25 smithi086 bash[24289]: cluster 2024-09-16T06:52:24.833843+0000 mgr.a (mgr.14373) 3261 : cluster [DBG] pgmap v2261: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:52:27.674 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:52:27.675 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:52:27.675 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:52:28.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:52:27 smithi157 bash[24585]: cluster 2024-09-16T06:52:26.835797+0000 mgr.a (mgr.14373) 3262 : cluster [DBG] pgmap v2262: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:52:28.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:52:27 smithi086 bash[24289]: cluster 2024-09-16T06:52:26.835797+0000 mgr.a (mgr.14373) 3262 : cluster [DBG] pgmap v2262: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:52:28.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:52:27 smithi047 bash[22744]: cluster 2024-09-16T06:52:26.835797+0000 mgr.a (mgr.14373) 3262 : cluster [DBG] pgmap v2262: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:52:28.430 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:52:28.430 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:52:28.430 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:52:28.430 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:52:28.430 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:52:29.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:52:28 smithi157 bash[24585]: audit 2024-09-16T06:52:28.009406+0000 mgr.a (mgr.14373) 3263 : audit [DBG] from='client.81696 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:52:29.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:52:28 smithi086 bash[24289]: audit 2024-09-16T06:52:28.009406+0000 mgr.a (mgr.14373) 3263 : audit [DBG] from='client.81696 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:52:29.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:52:28 smithi047 bash[22744]: audit 2024-09-16T06:52:28.009406+0000 mgr.a (mgr.14373) 3263 : audit [DBG] from='client.81696 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:52:30.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:52:29 smithi157 bash[24585]: cluster 2024-09-16T06:52:28.836902+0000 mgr.a (mgr.14373) 3264 : cluster [DBG] pgmap v2263: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-16T06:52:30.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:52:29 smithi086 bash[24289]: cluster 2024-09-16T06:52:28.836902+0000 mgr.a (mgr.14373) 3264 : cluster [DBG] pgmap v2263: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-16T06:52:30.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:52:29 smithi047 bash[22744]: cluster 2024-09-16T06:52:28.836902+0000 mgr.a (mgr.14373) 3264 : cluster [DBG] pgmap v2263: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-16T06:52:32.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:52:31 smithi157 bash[24585]: cluster 2024-09-16T06:52:30.837772+0000 mgr.a (mgr.14373) 3265 : cluster [DBG] pgmap v2264: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-16T06:52:32.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:52:31 smithi086 bash[24289]: cluster 2024-09-16T06:52:30.837772+0000 mgr.a (mgr.14373) 3265 : cluster [DBG] pgmap v2264: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-16T06:52:32.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:52:31 smithi047 bash[22744]: cluster 2024-09-16T06:52:30.837772+0000 mgr.a (mgr.14373) 3265 : cluster [DBG] pgmap v2264: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-16T06:52:33.432 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:52:33.432 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:52:33.432 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:52:34.212 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:52:34.213 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:52:34.213 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:52:34.213 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:52:34.213 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:52:34.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:52:33 smithi157 bash[24585]: cluster 2024-09-16T06:52:32.840018+0000 mgr.a (mgr.14373) 3266 : cluster [DBG] pgmap v2265: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-09-16T06:52:34.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:52:33 smithi086 bash[24289]: cluster 2024-09-16T06:52:32.840018+0000 mgr.a (mgr.14373) 3266 : cluster [DBG] pgmap v2265: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-09-16T06:52:34.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:52:33 smithi047 bash[22744]: cluster 2024-09-16T06:52:32.840018+0000 mgr.a (mgr.14373) 3266 : cluster [DBG] pgmap v2265: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-09-16T06:52:35.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:52:34 smithi157 bash[24585]: audit 2024-09-16T06:52:33.769952+0000 mgr.a (mgr.14373) 3267 : audit [DBG] from='client.81771 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:52:35.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:52:34 smithi086 bash[24289]: audit 2024-09-16T06:52:33.769952+0000 mgr.a (mgr.14373) 3267 : audit [DBG] from='client.81771 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:52:35.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:52:34 smithi047 bash[22744]: audit 2024-09-16T06:52:33.769952+0000 mgr.a (mgr.14373) 3267 : audit [DBG] from='client.81771 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:52:36.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:52:35 smithi157 bash[24585]: cluster 2024-09-16T06:52:34.840998+0000 mgr.a (mgr.14373) 3268 : cluster [DBG] pgmap v2266: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:52:36.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:52:35 smithi086 bash[24289]: cluster 2024-09-16T06:52:34.840998+0000 mgr.a (mgr.14373) 3268 : cluster [DBG] pgmap v2266: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:52:36.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:52:35 smithi047 bash[22744]: cluster 2024-09-16T06:52:34.840998+0000 mgr.a (mgr.14373) 3268 : cluster [DBG] pgmap v2266: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:52:38.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:52:37 smithi157 bash[24585]: cluster 2024-09-16T06:52:36.843224+0000 mgr.a (mgr.14373) 3269 : cluster [DBG] pgmap v2267: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:52:38.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:52:37 smithi086 bash[24289]: cluster 2024-09-16T06:52:36.843224+0000 mgr.a (mgr.14373) 3269 : cluster [DBG] pgmap v2267: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:52:38.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:52:37 smithi047 bash[22744]: cluster 2024-09-16T06:52:36.843224+0000 mgr.a (mgr.14373) 3269 : cluster [DBG] pgmap v2267: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:52:39.214 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:52:39.214 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:52:39.214 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:52:39.991 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:52:39.991 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:52:39.991 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:52:39.992 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:52:39.992 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:52:40.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:52:39 smithi157 bash[24585]: cluster 2024-09-16T06:52:38.843989+0000 mgr.a (mgr.14373) 3270 : cluster [DBG] pgmap v2268: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:52:40.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:52:39 smithi086 bash[24289]: cluster 2024-09-16T06:52:38.843989+0000 mgr.a (mgr.14373) 3270 : cluster [DBG] pgmap v2268: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:52:40.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:52:39 smithi047 bash[22744]: cluster 2024-09-16T06:52:38.843989+0000 mgr.a (mgr.14373) 3270 : cluster [DBG] pgmap v2268: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:52:41.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:52:40 smithi157 bash[24585]: audit 2024-09-16T06:52:39.550042+0000 mgr.a (mgr.14373) 3271 : audit [DBG] from='client.81849 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:52:41.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:52:40 smithi086 bash[24289]: audit 2024-09-16T06:52:39.550042+0000 mgr.a (mgr.14373) 3271 : audit [DBG] from='client.81849 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:52:41.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:52:40 smithi047 bash[22744]: audit 2024-09-16T06:52:39.550042+0000 mgr.a (mgr.14373) 3271 : audit [DBG] from='client.81849 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:52:42.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:52:41 smithi157 bash[24585]: cluster 2024-09-16T06:52:40.844870+0000 mgr.a (mgr.14373) 3272 : cluster [DBG] pgmap v2269: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:52:42.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:52:41 smithi086 bash[24289]: cluster 2024-09-16T06:52:40.844870+0000 mgr.a (mgr.14373) 3272 : cluster [DBG] pgmap v2269: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:52:42.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:52:41 smithi047 bash[22744]: cluster 2024-09-16T06:52:40.844870+0000 mgr.a (mgr.14373) 3272 : cluster [DBG] pgmap v2269: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:52:44.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:52:43 smithi157 bash[24585]: cluster 2024-09-16T06:52:42.847088+0000 mgr.a (mgr.14373) 3273 : cluster [DBG] pgmap v2270: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:52:44.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:52:43 smithi086 bash[24289]: cluster 2024-09-16T06:52:42.847088+0000 mgr.a (mgr.14373) 3273 : cluster [DBG] pgmap v2270: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:52:44.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:52:43 smithi047 bash[22744]: cluster 2024-09-16T06:52:42.847088+0000 mgr.a (mgr.14373) 3273 : cluster [DBG] pgmap v2270: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:52:44.993 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:52:44.993 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:52:44.993 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:52:45.754 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:52:45.754 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:52:45.754 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:52:45.754 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:52:45.755 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:52:46.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:52:45 smithi157 bash[24585]: cluster 2024-09-16T06:52:44.847850+0000 mgr.a (mgr.14373) 3274 : cluster [DBG] pgmap v2271: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:52:46.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:52:45 smithi086 bash[24289]: cluster 2024-09-16T06:52:44.847850+0000 mgr.a (mgr.14373) 3274 : cluster [DBG] pgmap v2271: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:52:46.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:52:45 smithi047 bash[22744]: cluster 2024-09-16T06:52:44.847850+0000 mgr.a (mgr.14373) 3274 : cluster [DBG] pgmap v2271: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:52:47.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:52:46 smithi157 bash[24585]: audit 2024-09-16T06:52:45.331273+0000 mgr.a (mgr.14373) 3275 : audit [DBG] from='client.81921 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:52:47.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:52:46 smithi086 bash[24289]: audit 2024-09-16T06:52:45.331273+0000 mgr.a (mgr.14373) 3275 : audit [DBG] from='client.81921 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:52:47.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:52:46 smithi047 bash[22744]: audit 2024-09-16T06:52:45.331273+0000 mgr.a (mgr.14373) 3275 : audit [DBG] from='client.81921 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:52:48.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:52:47 smithi157 bash[24585]: cluster 2024-09-16T06:52:46.850174+0000 mgr.a (mgr.14373) 3276 : cluster [DBG] pgmap v2272: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:52:48.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:52:47 smithi157 bash[24585]: audit 2024-09-16T06:52:47.020456+0000 mon.b (mon.2) 338 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T06:52:48.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:52:47 smithi157 bash[24585]: audit 2024-09-16T06:52:47.840473+0000 mon.b (mon.2) 339 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T06:52:48.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:52:47 smithi157 bash[24585]: audit 2024-09-16T06:52:47.842716+0000 mon.b (mon.2) 340 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T06:52:48.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:52:47 smithi157 bash[24585]: audit 2024-09-16T06:52:47.856498+0000 mon.a (mon.0) 766 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:52:48.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:52:47 smithi157 bash[24585]: audit 2024-09-16T06:52:47.859718+0000 mon.b (mon.2) 341 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:52:48.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:52:47 smithi086 bash[24289]: cluster 2024-09-16T06:52:46.850174+0000 mgr.a (mgr.14373) 3276 : cluster [DBG] pgmap v2272: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:52:48.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:52:47 smithi086 bash[24289]: audit 2024-09-16T06:52:47.020456+0000 mon.b (mon.2) 338 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T06:52:48.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:52:47 smithi086 bash[24289]: audit 2024-09-16T06:52:47.840473+0000 mon.b (mon.2) 339 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T06:52:48.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:52:47 smithi086 bash[24289]: audit 2024-09-16T06:52:47.842716+0000 mon.b (mon.2) 340 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T06:52:48.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:52:47 smithi086 bash[24289]: audit 2024-09-16T06:52:47.856498+0000 mon.a (mon.0) 766 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:52:48.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:52:47 smithi086 bash[24289]: audit 2024-09-16T06:52:47.859718+0000 mon.b (mon.2) 341 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:52:48.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:52:47 smithi047 bash[22744]: cluster 2024-09-16T06:52:46.850174+0000 mgr.a (mgr.14373) 3276 : cluster [DBG] pgmap v2272: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:52:48.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:52:47 smithi047 bash[22744]: audit 2024-09-16T06:52:47.020456+0000 mon.b (mon.2) 338 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T06:52:48.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:52:47 smithi047 bash[22744]: audit 2024-09-16T06:52:47.840473+0000 mon.b (mon.2) 339 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T06:52:48.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:52:47 smithi047 bash[22744]: audit 2024-09-16T06:52:47.842716+0000 mon.b (mon.2) 340 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T06:52:48.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:52:47 smithi047 bash[22744]: audit 2024-09-16T06:52:47.856498+0000 mon.a (mon.0) 766 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:52:48.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:52:47 smithi047 bash[22744]: audit 2024-09-16T06:52:47.859718+0000 mon.b (mon.2) 341 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:52:48.838 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 06:52:48 smithi047 bash[22994]: debug 2024-09-16T06:52:48.586+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T06:52:48.839 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 06:52:48 smithi047 bash[22994]: debug 2024-09-16T06:52:48.586+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T06:52:49.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:52:48 smithi157 bash[24585]: audit 2024-09-16T06:52:47.864189+0000 mgr.a (mgr.14373) 3277 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:52:49.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:52:48 smithi086 bash[24289]: audit 2024-09-16T06:52:47.864189+0000 mgr.a (mgr.14373) 3277 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:52:49.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:52:48 smithi047 bash[22744]: audit 2024-09-16T06:52:47.864189+0000 mgr.a (mgr.14373) 3277 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:52:50.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:52:49 smithi157 bash[24585]: audit 2024-09-16T06:52:48.587106+0000 mgr.a (mgr.14373) 3278 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T06:52:50.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:52:49 smithi157 bash[24585]: cephadm 2024-09-16T06:52:48.589219+0000 mgr.a (mgr.14373) 3279 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T06:52:50.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:52:49 smithi157 bash[24585]: cluster 2024-09-16T06:52:48.851146+0000 mgr.a (mgr.14373) 3280 : cluster [DBG] pgmap v2273: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:52:50.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:52:49 smithi086 bash[24289]: audit 2024-09-16T06:52:48.587106+0000 mgr.a (mgr.14373) 3278 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T06:52:50.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:52:49 smithi086 bash[24289]: cephadm 2024-09-16T06:52:48.589219+0000 mgr.a (mgr.14373) 3279 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T06:52:50.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:52:49 smithi086 bash[24289]: cluster 2024-09-16T06:52:48.851146+0000 mgr.a (mgr.14373) 3280 : cluster [DBG] pgmap v2273: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:52:50.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:52:49 smithi047 bash[22744]: audit 2024-09-16T06:52:48.587106+0000 mgr.a (mgr.14373) 3278 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T06:52:50.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:52:49 smithi047 bash[22744]: cephadm 2024-09-16T06:52:48.589219+0000 mgr.a (mgr.14373) 3279 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T06:52:50.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:52:49 smithi047 bash[22744]: cluster 2024-09-16T06:52:48.851146+0000 mgr.a (mgr.14373) 3280 : cluster [DBG] pgmap v2273: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:52:50.755 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:52:50.756 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:52:50.756 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:52:51.535 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:52:51.535 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:52:51.535 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:52:51.535 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:52:51.535 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:52:52.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:52:51 smithi157 bash[24585]: cluster 2024-09-16T06:52:50.851677+0000 mgr.a (mgr.14373) 3281 : cluster [DBG] pgmap v2274: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:52:52.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:52:51 smithi157 bash[24585]: audit 2024-09-16T06:52:51.096672+0000 mgr.a (mgr.14373) 3282 : audit [DBG] from='client.82107 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:52:52.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:52:51 smithi086 bash[24289]: cluster 2024-09-16T06:52:50.851677+0000 mgr.a (mgr.14373) 3281 : cluster [DBG] pgmap v2274: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:52:52.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:52:51 smithi086 bash[24289]: audit 2024-09-16T06:52:51.096672+0000 mgr.a (mgr.14373) 3282 : audit [DBG] from='client.82107 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:52:52.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:52:51 smithi047 bash[22744]: cluster 2024-09-16T06:52:50.851677+0000 mgr.a (mgr.14373) 3281 : cluster [DBG] pgmap v2274: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:52:52.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:52:51 smithi047 bash[22744]: audit 2024-09-16T06:52:51.096672+0000 mgr.a (mgr.14373) 3282 : audit [DBG] from='client.82107 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:52:54.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:52:53 smithi157 bash[24585]: cluster 2024-09-16T06:52:52.854448+0000 mgr.a (mgr.14373) 3283 : cluster [DBG] pgmap v2275: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:52:54.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:52:53 smithi086 bash[24289]: cluster 2024-09-16T06:52:52.854448+0000 mgr.a (mgr.14373) 3283 : cluster [DBG] pgmap v2275: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:52:54.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:52:53 smithi047 bash[22744]: cluster 2024-09-16T06:52:52.854448+0000 mgr.a (mgr.14373) 3283 : cluster [DBG] pgmap v2275: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:52:56.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:52:55 smithi157 bash[24585]: cluster 2024-09-16T06:52:54.855246+0000 mgr.a (mgr.14373) 3284 : cluster [DBG] pgmap v2276: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T06:52:56.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:52:55 smithi086 bash[24289]: cluster 2024-09-16T06:52:54.855246+0000 mgr.a (mgr.14373) 3284 : cluster [DBG] pgmap v2276: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T06:52:56.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:52:55 smithi047 bash[22744]: cluster 2024-09-16T06:52:54.855246+0000 mgr.a (mgr.14373) 3284 : cluster [DBG] pgmap v2276: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T06:52:56.536 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:52:56.537 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:52:56.537 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:52:57.306 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:52:57.306 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:52:57.306 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:52:57.306 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:52:57.306 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:52:58.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:52:57 smithi157 bash[24585]: cluster 2024-09-16T06:52:56.857167+0000 mgr.a (mgr.14373) 3285 : cluster [DBG] pgmap v2277: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:52:58.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:52:57 smithi157 bash[24585]: audit 2024-09-16T06:52:56.875295+0000 mgr.a (mgr.14373) 3286 : audit [DBG] from='client.82185 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:52:58.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:52:57 smithi086 bash[24289]: cluster 2024-09-16T06:52:56.857167+0000 mgr.a (mgr.14373) 3285 : cluster [DBG] pgmap v2277: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:52:58.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:52:57 smithi086 bash[24289]: audit 2024-09-16T06:52:56.875295+0000 mgr.a (mgr.14373) 3286 : audit [DBG] from='client.82185 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:52:58.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:52:57 smithi047 bash[22744]: cluster 2024-09-16T06:52:56.857167+0000 mgr.a (mgr.14373) 3285 : cluster [DBG] pgmap v2277: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:52:58.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:52:57 smithi047 bash[22744]: audit 2024-09-16T06:52:56.875295+0000 mgr.a (mgr.14373) 3286 : audit [DBG] from='client.82185 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:53:00.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:52:59 smithi157 bash[24585]: cluster 2024-09-16T06:52:58.858186+0000 mgr.a (mgr.14373) 3287 : cluster [DBG] pgmap v2278: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T06:53:00.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:52:59 smithi086 bash[24289]: cluster 2024-09-16T06:52:58.858186+0000 mgr.a (mgr.14373) 3287 : cluster [DBG] pgmap v2278: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T06:53:00.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:52:59 smithi047 bash[22744]: cluster 2024-09-16T06:52:58.858186+0000 mgr.a (mgr.14373) 3287 : cluster [DBG] pgmap v2278: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T06:53:02.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:53:01 smithi157 bash[24585]: cluster 2024-09-16T06:53:00.859005+0000 mgr.a (mgr.14373) 3288 : cluster [DBG] pgmap v2279: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T06:53:02.307 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:53:02.308 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:53:02.309 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:53:02.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:53:01 smithi086 bash[24289]: cluster 2024-09-16T06:53:00.859005+0000 mgr.a (mgr.14373) 3288 : cluster [DBG] pgmap v2279: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T06:53:02.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:53:01 smithi047 bash[22744]: cluster 2024-09-16T06:53:00.859005+0000 mgr.a (mgr.14373) 3288 : cluster [DBG] pgmap v2279: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T06:53:03.072 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:53:03.073 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:53:03.073 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:53:03.073 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:53:03.073 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:53:04.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:53:03 smithi157 bash[24585]: audit 2024-09-16T06:53:02.646571+0000 mgr.a (mgr.14373) 3289 : audit [DBG] from='client.82263 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:53:04.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:53:03 smithi157 bash[24585]: cluster 2024-09-16T06:53:02.860499+0000 mgr.a (mgr.14373) 3290 : cluster [DBG] pgmap v2280: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:53:04.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:53:03 smithi086 bash[24289]: audit 2024-09-16T06:53:02.646571+0000 mgr.a (mgr.14373) 3289 : audit [DBG] from='client.82263 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:53:04.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:53:03 smithi086 bash[24289]: cluster 2024-09-16T06:53:02.860499+0000 mgr.a (mgr.14373) 3290 : cluster [DBG] pgmap v2280: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:53:04.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:53:04 smithi047 bash[22744]: audit 2024-09-16T06:53:02.646571+0000 mgr.a (mgr.14373) 3289 : audit [DBG] from='client.82263 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:53:04.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:53:04 smithi047 bash[22744]: cluster 2024-09-16T06:53:02.860499+0000 mgr.a (mgr.14373) 3290 : cluster [DBG] pgmap v2280: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:53:06.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:53:06 smithi157 bash[24585]: cluster 2024-09-16T06:53:04.861377+0000 mgr.a (mgr.14373) 3291 : cluster [DBG] pgmap v2281: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-16T06:53:06.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:53:06 smithi086 bash[24289]: cluster 2024-09-16T06:53:04.861377+0000 mgr.a (mgr.14373) 3291 : cluster [DBG] pgmap v2281: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-16T06:53:06.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:53:06 smithi047 bash[22744]: cluster 2024-09-16T06:53:04.861377+0000 mgr.a (mgr.14373) 3291 : cluster [DBG] pgmap v2281: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-16T06:53:08.074 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:53:08.074 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:53:08.075 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:53:08.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:53:08 smithi157 bash[24585]: cluster 2024-09-16T06:53:06.863532+0000 mgr.a (mgr.14373) 3292 : cluster [DBG] pgmap v2282: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-16T06:53:08.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:53:08 smithi086 bash[24289]: cluster 2024-09-16T06:53:06.863532+0000 mgr.a (mgr.14373) 3292 : cluster [DBG] pgmap v2282: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-16T06:53:08.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:53:08 smithi047 bash[22744]: cluster 2024-09-16T06:53:06.863532+0000 mgr.a (mgr.14373) 3292 : cluster [DBG] pgmap v2282: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-16T06:53:08.814 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:53:08.814 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:53:08.814 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:53:08.814 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:53:08.814 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:53:10.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:53:10 smithi157 bash[24585]: audit 2024-09-16T06:53:08.408653+0000 mgr.a (mgr.14373) 3293 : audit [DBG] from='client.82338 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:53:10.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:53:10 smithi157 bash[24585]: cluster 2024-09-16T06:53:08.864195+0000 mgr.a (mgr.14373) 3294 : cluster [DBG] pgmap v2283: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:53:10.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:53:10 smithi086 bash[24289]: audit 2024-09-16T06:53:08.408653+0000 mgr.a (mgr.14373) 3293 : audit [DBG] from='client.82338 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:53:10.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:53:10 smithi086 bash[24289]: cluster 2024-09-16T06:53:08.864195+0000 mgr.a (mgr.14373) 3294 : cluster [DBG] pgmap v2283: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:53:10.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:53:10 smithi047 bash[22744]: audit 2024-09-16T06:53:08.408653+0000 mgr.a (mgr.14373) 3293 : audit [DBG] from='client.82338 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:53:10.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:53:10 smithi047 bash[22744]: cluster 2024-09-16T06:53:08.864195+0000 mgr.a (mgr.14373) 3294 : cluster [DBG] pgmap v2283: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:53:12.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:53:12 smithi157 bash[24585]: cluster 2024-09-16T06:53:10.864953+0000 mgr.a (mgr.14373) 3295 : cluster [DBG] pgmap v2284: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:53:12.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:53:12 smithi086 bash[24289]: cluster 2024-09-16T06:53:10.864953+0000 mgr.a (mgr.14373) 3295 : cluster [DBG] pgmap v2284: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:53:12.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:53:12 smithi047 bash[22744]: cluster 2024-09-16T06:53:10.864953+0000 mgr.a (mgr.14373) 3295 : cluster [DBG] pgmap v2284: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:53:13.815 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:53:13.816 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:53:13.816 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:53:14.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:53:14 smithi157 bash[24585]: cluster 2024-09-16T06:53:12.867362+0000 mgr.a (mgr.14373) 3296 : cluster [DBG] pgmap v2285: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:53:14.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:53:14 smithi086 bash[24289]: cluster 2024-09-16T06:53:12.867362+0000 mgr.a (mgr.14373) 3296 : cluster [DBG] pgmap v2285: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:53:14.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:53:14 smithi047 bash[22744]: cluster 2024-09-16T06:53:12.867362+0000 mgr.a (mgr.14373) 3296 : cluster [DBG] pgmap v2285: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:53:14.568 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:53:14.568 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:53:14.568 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:53:14.568 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:53:14.568 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:53:15.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:53:15 smithi157 bash[24585]: audit 2024-09-16T06:53:14.154279+0000 mgr.a (mgr.14373) 3297 : audit [DBG] from='client.82416 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:53:15.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:53:15 smithi086 bash[24289]: audit 2024-09-16T06:53:14.154279+0000 mgr.a (mgr.14373) 3297 : audit [DBG] from='client.82416 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:53:15.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:53:15 smithi047 bash[22744]: audit 2024-09-16T06:53:14.154279+0000 mgr.a (mgr.14373) 3297 : audit [DBG] from='client.82416 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:53:16.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:53:16 smithi157 bash[24585]: cluster 2024-09-16T06:53:14.868387+0000 mgr.a (mgr.14373) 3298 : cluster [DBG] pgmap v2286: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:53:16.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:53:16 smithi086 bash[24289]: cluster 2024-09-16T06:53:14.868387+0000 mgr.a (mgr.14373) 3298 : cluster [DBG] pgmap v2286: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:53:16.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:53:16 smithi047 bash[22744]: cluster 2024-09-16T06:53:14.868387+0000 mgr.a (mgr.14373) 3298 : cluster [DBG] pgmap v2286: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:53:18.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:53:18 smithi157 bash[24585]: cluster 2024-09-16T06:53:16.870580+0000 mgr.a (mgr.14373) 3299 : cluster [DBG] pgmap v2287: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:53:18.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:53:18 smithi086 bash[24289]: cluster 2024-09-16T06:53:16.870580+0000 mgr.a (mgr.14373) 3299 : cluster [DBG] pgmap v2287: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:53:18.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:53:18 smithi047 bash[22744]: cluster 2024-09-16T06:53:16.870580+0000 mgr.a (mgr.14373) 3299 : cluster [DBG] pgmap v2287: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:53:19.569 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:53:19.570 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:53:19.570 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:53:20.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:53:20 smithi157 bash[24585]: cluster 2024-09-16T06:53:18.871370+0000 mgr.a (mgr.14373) 3300 : cluster [DBG] pgmap v2288: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:53:20.318 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:53:20.318 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:53:20.318 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:53:20.318 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:53:20.318 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:53:20.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:53:20 smithi086 bash[24289]: cluster 2024-09-16T06:53:18.871370+0000 mgr.a (mgr.14373) 3300 : cluster [DBG] pgmap v2288: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:53:20.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:53:20 smithi047 bash[22744]: cluster 2024-09-16T06:53:18.871370+0000 mgr.a (mgr.14373) 3300 : cluster [DBG] pgmap v2288: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:53:21.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:53:21 smithi157 bash[24585]: audit 2024-09-16T06:53:19.905367+0000 mgr.a (mgr.14373) 3301 : audit [DBG] from='client.82494 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:53:21.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:53:21 smithi086 bash[24289]: audit 2024-09-16T06:53:19.905367+0000 mgr.a (mgr.14373) 3301 : audit [DBG] from='client.82494 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:53:21.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:53:21 smithi047 bash[22744]: audit 2024-09-16T06:53:19.905367+0000 mgr.a (mgr.14373) 3301 : audit [DBG] from='client.82494 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:53:22.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:53:22 smithi157 bash[24585]: cluster 2024-09-16T06:53:20.872352+0000 mgr.a (mgr.14373) 3302 : cluster [DBG] pgmap v2289: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:53:22.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:53:22 smithi086 bash[24289]: cluster 2024-09-16T06:53:20.872352+0000 mgr.a (mgr.14373) 3302 : cluster [DBG] pgmap v2289: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:53:22.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:53:22 smithi047 bash[22744]: cluster 2024-09-16T06:53:20.872352+0000 mgr.a (mgr.14373) 3302 : cluster [DBG] pgmap v2289: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:53:24.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:53:24 smithi157 bash[24585]: cluster 2024-09-16T06:53:22.874652+0000 mgr.a (mgr.14373) 3303 : cluster [DBG] pgmap v2290: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:53:24.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:53:24 smithi086 bash[24289]: cluster 2024-09-16T06:53:22.874652+0000 mgr.a (mgr.14373) 3303 : cluster [DBG] pgmap v2290: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:53:24.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:53:24 smithi047 bash[22744]: cluster 2024-09-16T06:53:22.874652+0000 mgr.a (mgr.14373) 3303 : cluster [DBG] pgmap v2290: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:53:25.319 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:53:25.320 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:53:25.321 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:53:26.095 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:53:26.095 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:53:26.095 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:53:26.095 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:53:26.095 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:53:26.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:53:26 smithi157 bash[24585]: cluster 2024-09-16T06:53:24.875434+0000 mgr.a (mgr.14373) 3304 : cluster [DBG] pgmap v2291: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:53:26.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:53:26 smithi086 bash[24289]: cluster 2024-09-16T06:53:24.875434+0000 mgr.a (mgr.14373) 3304 : cluster [DBG] pgmap v2291: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:53:26.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:53:26 smithi047 bash[22744]: cluster 2024-09-16T06:53:24.875434+0000 mgr.a (mgr.14373) 3304 : cluster [DBG] pgmap v2291: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:53:27.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:53:27 smithi157 bash[24585]: audit 2024-09-16T06:53:25.658984+0000 mgr.a (mgr.14373) 3305 : audit [DBG] from='client.82572 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:53:27.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:53:27 smithi086 bash[24289]: audit 2024-09-16T06:53:25.658984+0000 mgr.a (mgr.14373) 3305 : audit [DBG] from='client.82572 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:53:27.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:53:27 smithi047 bash[22744]: audit 2024-09-16T06:53:25.658984+0000 mgr.a (mgr.14373) 3305 : audit [DBG] from='client.82572 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:53:28.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:53:28 smithi157 bash[24585]: cluster 2024-09-16T06:53:26.877781+0000 mgr.a (mgr.14373) 3306 : cluster [DBG] pgmap v2292: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:53:28.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:53:28 smithi086 bash[24289]: cluster 2024-09-16T06:53:26.877781+0000 mgr.a (mgr.14373) 3306 : cluster [DBG] pgmap v2292: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:53:28.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:53:28 smithi047 bash[22744]: cluster 2024-09-16T06:53:26.877781+0000 mgr.a (mgr.14373) 3306 : cluster [DBG] pgmap v2292: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:53:30.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:53:30 smithi157 bash[24585]: cluster 2024-09-16T06:53:28.878565+0000 mgr.a (mgr.14373) 3307 : cluster [DBG] pgmap v2293: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:53:30.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:53:30 smithi086 bash[24289]: cluster 2024-09-16T06:53:28.878565+0000 mgr.a (mgr.14373) 3307 : cluster [DBG] pgmap v2293: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:53:30.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:53:30 smithi047 bash[22744]: cluster 2024-09-16T06:53:28.878565+0000 mgr.a (mgr.14373) 3307 : cluster [DBG] pgmap v2293: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:53:31.096 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:53:31.097 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:53:31.097 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:53:31.869 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:53:31.869 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:53:31.870 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:53:31.870 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:53:31.870 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:53:32.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:53:32 smithi157 bash[24585]: cluster 2024-09-16T06:53:30.879310+0000 mgr.a (mgr.14373) 3308 : cluster [DBG] pgmap v2294: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:53:32.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:53:32 smithi086 bash[24289]: cluster 2024-09-16T06:53:30.879310+0000 mgr.a (mgr.14373) 3308 : cluster [DBG] pgmap v2294: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:53:32.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:53:32 smithi047 bash[22744]: cluster 2024-09-16T06:53:30.879310+0000 mgr.a (mgr.14373) 3308 : cluster [DBG] pgmap v2294: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:53:33.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:53:33 smithi086 bash[24289]: audit 2024-09-16T06:53:31.439668+0000 mgr.a (mgr.14373) 3309 : audit [DBG] from='client.82644 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:53:33.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:53:33 smithi047 bash[22744]: audit 2024-09-16T06:53:31.439668+0000 mgr.a (mgr.14373) 3309 : audit [DBG] from='client.82644 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:53:33.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:53:33 smithi157 bash[24585]: audit 2024-09-16T06:53:31.439668+0000 mgr.a (mgr.14373) 3309 : audit [DBG] from='client.82644 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:53:34.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:53:34 smithi086 bash[24289]: cluster 2024-09-16T06:53:32.882126+0000 mgr.a (mgr.14373) 3310 : cluster [DBG] pgmap v2295: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:53:34.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:53:34 smithi047 bash[22744]: cluster 2024-09-16T06:53:32.882126+0000 mgr.a (mgr.14373) 3310 : cluster [DBG] pgmap v2295: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:53:34.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:53:34 smithi157 bash[24585]: cluster 2024-09-16T06:53:32.882126+0000 mgr.a (mgr.14373) 3310 : cluster [DBG] pgmap v2295: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:53:36.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:53:36 smithi086 bash[24289]: cluster 2024-09-16T06:53:34.882947+0000 mgr.a (mgr.14373) 3311 : cluster [DBG] pgmap v2296: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:53:36.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:53:36 smithi047 bash[22744]: cluster 2024-09-16T06:53:34.882947+0000 mgr.a (mgr.14373) 3311 : cluster [DBG] pgmap v2296: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:53:36.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:53:36 smithi157 bash[24585]: cluster 2024-09-16T06:53:34.882947+0000 mgr.a (mgr.14373) 3311 : cluster [DBG] pgmap v2296: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:53:36.871 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:53:36.872 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:53:36.872 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:53:37.625 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:53:37.625 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:53:37.625 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:53:37.625 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:53:37.626 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:53:38.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:53:38 smithi086 bash[24289]: cluster 2024-09-16T06:53:36.884183+0000 mgr.a (mgr.14373) 3312 : cluster [DBG] pgmap v2297: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:53:38.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:53:38 smithi086 bash[24289]: audit 2024-09-16T06:53:37.206757+0000 mgr.a (mgr.14373) 3313 : audit [DBG] from='client.82722 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:53:38.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:53:38 smithi047 bash[22744]: cluster 2024-09-16T06:53:36.884183+0000 mgr.a (mgr.14373) 3312 : cluster [DBG] pgmap v2297: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:53:38.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:53:38 smithi047 bash[22744]: audit 2024-09-16T06:53:37.206757+0000 mgr.a (mgr.14373) 3313 : audit [DBG] from='client.82722 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:53:38.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:53:38 smithi157 bash[24585]: cluster 2024-09-16T06:53:36.884183+0000 mgr.a (mgr.14373) 3312 : cluster [DBG] pgmap v2297: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:53:38.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:53:38 smithi157 bash[24585]: audit 2024-09-16T06:53:37.206757+0000 mgr.a (mgr.14373) 3313 : audit [DBG] from='client.82722 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:53:40.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:53:40 smithi047 bash[22744]: cluster 2024-09-16T06:53:38.885087+0000 mgr.a (mgr.14373) 3314 : cluster [DBG] pgmap v2298: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:53:40.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:53:40 smithi157 bash[24585]: cluster 2024-09-16T06:53:38.885087+0000 mgr.a (mgr.14373) 3314 : cluster [DBG] pgmap v2298: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:53:40.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:53:40 smithi086 bash[24289]: cluster 2024-09-16T06:53:38.885087+0000 mgr.a (mgr.14373) 3314 : cluster [DBG] pgmap v2298: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:53:42.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:53:42 smithi047 bash[22744]: cluster 2024-09-16T06:53:40.885842+0000 mgr.a (mgr.14373) 3315 : cluster [DBG] pgmap v2299: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T06:53:42.626 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:53:42.627 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:53:42.628 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:53:42.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:53:42 smithi157 bash[24585]: cluster 2024-09-16T06:53:40.885842+0000 mgr.a (mgr.14373) 3315 : cluster [DBG] pgmap v2299: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T06:53:42.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:53:42 smithi086 bash[24289]: cluster 2024-09-16T06:53:40.885842+0000 mgr.a (mgr.14373) 3315 : cluster [DBG] pgmap v2299: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T06:53:43.375 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:53:43.375 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:53:43.375 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:53:43.375 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:53:43.375 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:53:43.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:53:43 smithi047 bash[22744]: cluster 2024-09-16T06:53:42.888048+0000 mgr.a (mgr.14373) 3316 : cluster [DBG] pgmap v2300: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:53:43.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:53:43 smithi047 bash[22744]: audit 2024-09-16T06:53:42.955035+0000 mgr.a (mgr.14373) 3317 : audit [DBG] from='client.82800 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:53:43.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:53:43 smithi157 bash[24585]: cluster 2024-09-16T06:53:42.888048+0000 mgr.a (mgr.14373) 3316 : cluster [DBG] pgmap v2300: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:53:43.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:53:43 smithi157 bash[24585]: audit 2024-09-16T06:53:42.955035+0000 mgr.a (mgr.14373) 3317 : audit [DBG] from='client.82800 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:53:43.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:53:43 smithi086 bash[24289]: cluster 2024-09-16T06:53:42.888048+0000 mgr.a (mgr.14373) 3316 : cluster [DBG] pgmap v2300: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:53:43.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:53:43 smithi086 bash[24289]: audit 2024-09-16T06:53:42.955035+0000 mgr.a (mgr.14373) 3317 : audit [DBG] from='client.82800 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:53:46.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:53:45 smithi157 bash[24585]: cluster 2024-09-16T06:53:44.889060+0000 mgr.a (mgr.14373) 3318 : cluster [DBG] pgmap v2301: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:53:46.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:53:45 smithi086 bash[24289]: cluster 2024-09-16T06:53:44.889060+0000 mgr.a (mgr.14373) 3318 : cluster [DBG] pgmap v2301: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:53:46.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:53:45 smithi047 bash[22744]: cluster 2024-09-16T06:53:44.889060+0000 mgr.a (mgr.14373) 3318 : cluster [DBG] pgmap v2301: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:53:48.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:53:47 smithi157 bash[24585]: cluster 2024-09-16T06:53:46.891275+0000 mgr.a (mgr.14373) 3319 : cluster [DBG] pgmap v2302: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:53:48.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:53:47 smithi086 bash[24289]: cluster 2024-09-16T06:53:46.891275+0000 mgr.a (mgr.14373) 3319 : cluster [DBG] pgmap v2302: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:53:48.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:53:47 smithi047 bash[22744]: cluster 2024-09-16T06:53:46.891275+0000 mgr.a (mgr.14373) 3319 : cluster [DBG] pgmap v2302: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:53:48.376 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:53:48.377 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:53:48.378 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:53:49.168 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:53:49.168 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:53:49.168 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:53:49.168 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:53:49.168 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:53:49.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:53:48 smithi157 bash[24585]: audit 2024-09-16T06:53:48.643403+0000 mon.b (mon.2) 342 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T06:53:49.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:53:48 smithi086 bash[24289]: audit 2024-09-16T06:53:48.643403+0000 mon.b (mon.2) 342 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T06:53:49.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:53:48 smithi047 bash[22744]: audit 2024-09-16T06:53:48.643403+0000 mon.b (mon.2) 342 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T06:53:50.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:53:49 smithi157 bash[24585]: audit 2024-09-16T06:53:48.739440+0000 mgr.a (mgr.14373) 3320 : audit [DBG] from='client.82878 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:53:50.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:53:49 smithi157 bash[24585]: cluster 2024-09-16T06:53:48.891840+0000 mgr.a (mgr.14373) 3321 : cluster [DBG] pgmap v2303: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:53:50.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:53:49 smithi157 bash[24585]: audit 2024-09-16T06:53:49.424310+0000 mon.b (mon.2) 343 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T06:53:50.305 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:53:49 smithi157 bash[24585]: audit 2024-09-16T06:53:49.426818+0000 mon.b (mon.2) 344 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T06:53:50.305 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:53:49 smithi157 bash[24585]: audit 2024-09-16T06:53:49.437516+0000 mon.a (mon.0) 767 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:53:50.305 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:53:49 smithi157 bash[24585]: audit 2024-09-16T06:53:49.440905+0000 mon.b (mon.2) 345 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:53:50.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:53:49 smithi086 bash[24289]: audit 2024-09-16T06:53:48.739440+0000 mgr.a (mgr.14373) 3320 : audit [DBG] from='client.82878 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:53:50.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:53:49 smithi086 bash[24289]: cluster 2024-09-16T06:53:48.891840+0000 mgr.a (mgr.14373) 3321 : cluster [DBG] pgmap v2303: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:53:50.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:53:49 smithi086 bash[24289]: audit 2024-09-16T06:53:49.424310+0000 mon.b (mon.2) 343 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T06:53:50.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:53:49 smithi086 bash[24289]: audit 2024-09-16T06:53:49.426818+0000 mon.b (mon.2) 344 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T06:53:50.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:53:49 smithi086 bash[24289]: audit 2024-09-16T06:53:49.437516+0000 mon.a (mon.0) 767 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:53:50.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:53:49 smithi086 bash[24289]: audit 2024-09-16T06:53:49.440905+0000 mon.b (mon.2) 345 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:53:50.338 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 06:53:50 smithi047 bash[22994]: debug 2024-09-16T06:53:50.148+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T06:53:50.338 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 06:53:50 smithi047 bash[22994]: debug 2024-09-16T06:53:50.148+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T06:53:50.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:53:49 smithi047 bash[22744]: audit 2024-09-16T06:53:48.739440+0000 mgr.a (mgr.14373) 3320 : audit [DBG] from='client.82878 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:53:50.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:53:49 smithi047 bash[22744]: cluster 2024-09-16T06:53:48.891840+0000 mgr.a (mgr.14373) 3321 : cluster [DBG] pgmap v2303: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:53:50.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:53:49 smithi047 bash[22744]: audit 2024-09-16T06:53:49.424310+0000 mon.b (mon.2) 343 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T06:53:50.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:53:49 smithi047 bash[22744]: audit 2024-09-16T06:53:49.426818+0000 mon.b (mon.2) 344 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T06:53:50.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:53:49 smithi047 bash[22744]: audit 2024-09-16T06:53:49.437516+0000 mon.a (mon.0) 767 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:53:50.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:53:49 smithi047 bash[22744]: audit 2024-09-16T06:53:49.440905+0000 mon.b (mon.2) 345 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:53:51.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:53:50 smithi157 bash[24585]: audit 2024-09-16T06:53:49.445816+0000 mgr.a (mgr.14373) 3322 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:53:51.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:53:50 smithi157 bash[24585]: audit 2024-09-16T06:53:50.151279+0000 mgr.a (mgr.14373) 3323 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T06:53:51.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:53:50 smithi157 bash[24585]: cephadm 2024-09-16T06:53:50.153095+0000 mgr.a (mgr.14373) 3324 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T06:53:51.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:53:50 smithi086 bash[24289]: audit 2024-09-16T06:53:49.445816+0000 mgr.a (mgr.14373) 3322 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:53:51.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:53:50 smithi086 bash[24289]: audit 2024-09-16T06:53:50.151279+0000 mgr.a (mgr.14373) 3323 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T06:53:51.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:53:50 smithi086 bash[24289]: cephadm 2024-09-16T06:53:50.153095+0000 mgr.a (mgr.14373) 3324 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T06:53:51.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:53:50 smithi047 bash[22744]: audit 2024-09-16T06:53:49.445816+0000 mgr.a (mgr.14373) 3322 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:53:51.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:53:50 smithi047 bash[22744]: audit 2024-09-16T06:53:50.151279+0000 mgr.a (mgr.14373) 3323 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T06:53:51.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:53:50 smithi047 bash[22744]: cephadm 2024-09-16T06:53:50.153095+0000 mgr.a (mgr.14373) 3324 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T06:53:52.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:53:51 smithi157 bash[24585]: cluster 2024-09-16T06:53:50.892737+0000 mgr.a (mgr.14373) 3325 : cluster [DBG] pgmap v2304: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:53:52.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:53:51 smithi086 bash[24289]: cluster 2024-09-16T06:53:50.892737+0000 mgr.a (mgr.14373) 3325 : cluster [DBG] pgmap v2304: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:53:52.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:53:51 smithi047 bash[22744]: cluster 2024-09-16T06:53:50.892737+0000 mgr.a (mgr.14373) 3325 : cluster [DBG] pgmap v2304: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:53:54.169 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:53:54.170 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:53:54.170 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:53:54.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:53:53 smithi157 bash[24585]: cluster 2024-09-16T06:53:52.895013+0000 mgr.a (mgr.14373) 3326 : cluster [DBG] pgmap v2305: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:53:54.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:53:53 smithi086 bash[24289]: cluster 2024-09-16T06:53:52.895013+0000 mgr.a (mgr.14373) 3326 : cluster [DBG] pgmap v2305: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:53:54.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:53:53 smithi047 bash[22744]: cluster 2024-09-16T06:53:52.895013+0000 mgr.a (mgr.14373) 3326 : cluster [DBG] pgmap v2305: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:53:54.939 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:53:54.939 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:53:54.939 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:53:54.939 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:53:54.939 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:53:56.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:53:55 smithi157 bash[24585]: audit 2024-09-16T06:53:54.504812+0000 mgr.a (mgr.14373) 3327 : audit [DBG] from='client.83058 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:53:56.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:53:55 smithi157 bash[24585]: cluster 2024-09-16T06:53:54.895656+0000 mgr.a (mgr.14373) 3328 : cluster [DBG] pgmap v2306: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:53:56.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:53:55 smithi086 bash[24289]: audit 2024-09-16T06:53:54.504812+0000 mgr.a (mgr.14373) 3327 : audit [DBG] from='client.83058 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:53:56.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:53:55 smithi086 bash[24289]: cluster 2024-09-16T06:53:54.895656+0000 mgr.a (mgr.14373) 3328 : cluster [DBG] pgmap v2306: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:53:56.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:53:55 smithi047 bash[22744]: audit 2024-09-16T06:53:54.504812+0000 mgr.a (mgr.14373) 3327 : audit [DBG] from='client.83058 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:53:56.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:53:55 smithi047 bash[22744]: cluster 2024-09-16T06:53:54.895656+0000 mgr.a (mgr.14373) 3328 : cluster [DBG] pgmap v2306: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:53:58.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:53:57 smithi157 bash[24585]: cluster 2024-09-16T06:53:56.897791+0000 mgr.a (mgr.14373) 3329 : cluster [DBG] pgmap v2307: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:53:58.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:53:57 smithi086 bash[24289]: cluster 2024-09-16T06:53:56.897791+0000 mgr.a (mgr.14373) 3329 : cluster [DBG] pgmap v2307: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:53:58.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:53:57 smithi047 bash[22744]: cluster 2024-09-16T06:53:56.897791+0000 mgr.a (mgr.14373) 3329 : cluster [DBG] pgmap v2307: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:53:59.941 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:53:59.941 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:53:59.941 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:54:00.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:53:59 smithi157 bash[24585]: cluster 2024-09-16T06:53:58.898697+0000 mgr.a (mgr.14373) 3330 : cluster [DBG] pgmap v2308: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:54:00.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:53:59 smithi086 bash[24289]: cluster 2024-09-16T06:53:58.898697+0000 mgr.a (mgr.14373) 3330 : cluster [DBG] pgmap v2308: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:54:00.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:53:59 smithi047 bash[22744]: cluster 2024-09-16T06:53:58.898697+0000 mgr.a (mgr.14373) 3330 : cluster [DBG] pgmap v2308: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:54:00.710 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:54:00.711 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:54:00.711 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:54:00.711 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:54:00.711 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:54:01.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:54:00 smithi157 bash[24585]: audit 2024-09-16T06:54:00.278446+0000 mgr.a (mgr.14373) 3331 : audit [DBG] from='client.83133 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:54:01.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:54:00 smithi086 bash[24289]: audit 2024-09-16T06:54:00.278446+0000 mgr.a (mgr.14373) 3331 : audit [DBG] from='client.83133 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:54:01.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:54:00 smithi047 bash[22744]: audit 2024-09-16T06:54:00.278446+0000 mgr.a (mgr.14373) 3331 : audit [DBG] from='client.83133 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:54:02.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:54:01 smithi157 bash[24585]: cluster 2024-09-16T06:54:00.899714+0000 mgr.a (mgr.14373) 3332 : cluster [DBG] pgmap v2309: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:54:02.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:54:01 smithi086 bash[24289]: cluster 2024-09-16T06:54:00.899714+0000 mgr.a (mgr.14373) 3332 : cluster [DBG] pgmap v2309: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:54:02.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:54:01 smithi047 bash[22744]: cluster 2024-09-16T06:54:00.899714+0000 mgr.a (mgr.14373) 3332 : cluster [DBG] pgmap v2309: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:54:04.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:54:04 smithi157 bash[24585]: cluster 2024-09-16T06:54:02.901979+0000 mgr.a (mgr.14373) 3333 : cluster [DBG] pgmap v2310: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:54:04.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:54:03 smithi086 bash[24289]: cluster 2024-09-16T06:54:02.901979+0000 mgr.a (mgr.14373) 3333 : cluster [DBG] pgmap v2310: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:54:04.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:54:04 smithi047 bash[22744]: cluster 2024-09-16T06:54:02.901979+0000 mgr.a (mgr.14373) 3333 : cluster [DBG] pgmap v2310: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:54:05.712 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:54:05.713 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:54:05.713 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:54:06.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:54:06 smithi157 bash[24585]: cluster 2024-09-16T06:54:04.902762+0000 mgr.a (mgr.14373) 3334 : cluster [DBG] pgmap v2311: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:54:06.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:54:06 smithi086 bash[24289]: cluster 2024-09-16T06:54:04.902762+0000 mgr.a (mgr.14373) 3334 : cluster [DBG] pgmap v2311: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:54:06.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:54:06 smithi047 bash[22744]: cluster 2024-09-16T06:54:04.902762+0000 mgr.a (mgr.14373) 3334 : cluster [DBG] pgmap v2311: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:54:06.499 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:54:06.500 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:54:06.500 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:54:06.500 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:54:06.500 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:54:07.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:54:07 smithi157 bash[24585]: audit 2024-09-16T06:54:06.057433+0000 mgr.a (mgr.14373) 3335 : audit [DBG] from='client.83211 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:54:07.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:54:07 smithi086 bash[24289]: audit 2024-09-16T06:54:06.057433+0000 mgr.a (mgr.14373) 3335 : audit [DBG] from='client.83211 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:54:07.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:54:07 smithi047 bash[22744]: audit 2024-09-16T06:54:06.057433+0000 mgr.a (mgr.14373) 3335 : audit [DBG] from='client.83211 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:54:08.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:54:08 smithi157 bash[24585]: cluster 2024-09-16T06:54:06.905522+0000 mgr.a (mgr.14373) 3336 : cluster [DBG] pgmap v2312: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-16T06:54:08.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:54:08 smithi086 bash[24289]: cluster 2024-09-16T06:54:06.905522+0000 mgr.a (mgr.14373) 3336 : cluster [DBG] pgmap v2312: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-16T06:54:08.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:54:08 smithi047 bash[22744]: cluster 2024-09-16T06:54:06.905522+0000 mgr.a (mgr.14373) 3336 : cluster [DBG] pgmap v2312: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-16T06:54:10.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:54:10 smithi157 bash[24585]: cluster 2024-09-16T06:54:08.906293+0000 mgr.a (mgr.14373) 3337 : cluster [DBG] pgmap v2313: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T06:54:10.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:54:10 smithi086 bash[24289]: cluster 2024-09-16T06:54:08.906293+0000 mgr.a (mgr.14373) 3337 : cluster [DBG] pgmap v2313: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T06:54:10.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:54:10 smithi047 bash[22744]: cluster 2024-09-16T06:54:08.906293+0000 mgr.a (mgr.14373) 3337 : cluster [DBG] pgmap v2313: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T06:54:11.501 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:54:11.502 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:54:11.502 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:54:12.281 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:54:12.281 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:54:12.281 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:54:12.281 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:54:12.281 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:54:12.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:54:12 smithi157 bash[24585]: cluster 2024-09-16T06:54:10.907053+0000 mgr.a (mgr.14373) 3338 : cluster [DBG] pgmap v2314: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T06:54:12.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:54:12 smithi086 bash[24289]: cluster 2024-09-16T06:54:10.907053+0000 mgr.a (mgr.14373) 3338 : cluster [DBG] pgmap v2314: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T06:54:12.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:54:12 smithi047 bash[22744]: cluster 2024-09-16T06:54:10.907053+0000 mgr.a (mgr.14373) 3338 : cluster [DBG] pgmap v2314: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T06:54:13.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:54:13 smithi157 bash[24585]: audit 2024-09-16T06:54:11.834910+0000 mgr.a (mgr.14373) 3339 : audit [DBG] from='client.83289 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:54:13.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:54:13 smithi086 bash[24289]: audit 2024-09-16T06:54:11.834910+0000 mgr.a (mgr.14373) 3339 : audit [DBG] from='client.83289 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:54:13.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:54:13 smithi047 bash[22744]: audit 2024-09-16T06:54:11.834910+0000 mgr.a (mgr.14373) 3339 : audit [DBG] from='client.83289 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:54:14.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:54:14 smithi157 bash[24585]: cluster 2024-09-16T06:54:12.909810+0000 mgr.a (mgr.14373) 3340 : cluster [DBG] pgmap v2315: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:54:14.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:54:14 smithi086 bash[24289]: cluster 2024-09-16T06:54:12.909810+0000 mgr.a (mgr.14373) 3340 : cluster [DBG] pgmap v2315: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:54:14.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:54:14 smithi047 bash[22744]: cluster 2024-09-16T06:54:12.909810+0000 mgr.a (mgr.14373) 3340 : cluster [DBG] pgmap v2315: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:54:16.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:54:16 smithi157 bash[24585]: cluster 2024-09-16T06:54:14.910606+0000 mgr.a (mgr.14373) 3341 : cluster [DBG] pgmap v2316: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:54:16.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:54:16 smithi086 bash[24289]: cluster 2024-09-16T06:54:14.910606+0000 mgr.a (mgr.14373) 3341 : cluster [DBG] pgmap v2316: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:54:16.340 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:54:16 smithi047 bash[22744]: cluster 2024-09-16T06:54:14.910606+0000 mgr.a (mgr.14373) 3341 : cluster [DBG] pgmap v2316: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:54:17.282 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:54:17.283 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:54:17.283 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:54:18.065 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:54:18.065 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:54:18.065 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:54:18.066 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:54:18.066 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:54:18.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:54:18 smithi157 bash[24585]: cluster 2024-09-16T06:54:16.912609+0000 mgr.a (mgr.14373) 3342 : cluster [DBG] pgmap v2317: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:54:18.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:54:18 smithi086 bash[24289]: cluster 2024-09-16T06:54:16.912609+0000 mgr.a (mgr.14373) 3342 : cluster [DBG] pgmap v2317: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:54:18.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:54:18 smithi047 bash[22744]: cluster 2024-09-16T06:54:16.912609+0000 mgr.a (mgr.14373) 3342 : cluster [DBG] pgmap v2317: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:54:19.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:54:19 smithi157 bash[24585]: audit 2024-09-16T06:54:17.625291+0000 mgr.a (mgr.14373) 3343 : audit [DBG] from='client.83364 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:54:19.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:54:19 smithi086 bash[24289]: audit 2024-09-16T06:54:17.625291+0000 mgr.a (mgr.14373) 3343 : audit [DBG] from='client.83364 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:54:19.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:54:19 smithi047 bash[22744]: audit 2024-09-16T06:54:17.625291+0000 mgr.a (mgr.14373) 3343 : audit [DBG] from='client.83364 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:54:20.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:54:20 smithi157 bash[24585]: cluster 2024-09-16T06:54:18.913502+0000 mgr.a (mgr.14373) 3344 : cluster [DBG] pgmap v2318: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-16T06:54:20.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:54:20 smithi086 bash[24289]: cluster 2024-09-16T06:54:18.913502+0000 mgr.a (mgr.14373) 3344 : cluster [DBG] pgmap v2318: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-16T06:54:20.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:54:20 smithi047 bash[22744]: cluster 2024-09-16T06:54:18.913502+0000 mgr.a (mgr.14373) 3344 : cluster [DBG] pgmap v2318: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-16T06:54:22.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:54:22 smithi086 bash[24289]: cluster 2024-09-16T06:54:20.914282+0000 mgr.a (mgr.14373) 3345 : cluster [DBG] pgmap v2319: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-16T06:54:22.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:54:22 smithi047 bash[22744]: cluster 2024-09-16T06:54:20.914282+0000 mgr.a (mgr.14373) 3345 : cluster [DBG] pgmap v2319: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-16T06:54:22.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:54:22 smithi157 bash[24585]: cluster 2024-09-16T06:54:20.914282+0000 mgr.a (mgr.14373) 3345 : cluster [DBG] pgmap v2319: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-16T06:54:23.066 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:54:23.067 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:54:23.067 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:54:23.833 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:54:23.833 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:54:23.834 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:54:23.834 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:54:23.834 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:54:24.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:54:24 smithi086 bash[24289]: cluster 2024-09-16T06:54:22.916523+0000 mgr.a (mgr.14373) 3346 : cluster [DBG] pgmap v2320: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-16T06:54:24.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:54:24 smithi047 bash[22744]: cluster 2024-09-16T06:54:22.916523+0000 mgr.a (mgr.14373) 3346 : cluster [DBG] pgmap v2320: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-16T06:54:24.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:54:24 smithi157 bash[24585]: cluster 2024-09-16T06:54:22.916523+0000 mgr.a (mgr.14373) 3346 : cluster [DBG] pgmap v2320: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-16T06:54:25.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:54:25 smithi047 bash[22744]: audit 2024-09-16T06:54:23.408302+0000 mgr.a (mgr.14373) 3347 : audit [DBG] from='client.83442 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:54:25.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:54:25 smithi157 bash[24585]: audit 2024-09-16T06:54:23.408302+0000 mgr.a (mgr.14373) 3347 : audit [DBG] from='client.83442 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:54:25.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:54:25 smithi086 bash[24289]: audit 2024-09-16T06:54:23.408302+0000 mgr.a (mgr.14373) 3347 : audit [DBG] from='client.83442 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:54:26.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:54:26 smithi047 bash[22744]: cluster 2024-09-16T06:54:24.917406+0000 mgr.a (mgr.14373) 3348 : cluster [DBG] pgmap v2321: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:54:26.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:54:26 smithi157 bash[24585]: cluster 2024-09-16T06:54:24.917406+0000 mgr.a (mgr.14373) 3348 : cluster [DBG] pgmap v2321: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:54:26.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:54:26 smithi086 bash[24289]: cluster 2024-09-16T06:54:24.917406+0000 mgr.a (mgr.14373) 3348 : cluster [DBG] pgmap v2321: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:54:28.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:54:28 smithi047 bash[22744]: cluster 2024-09-16T06:54:26.919579+0000 mgr.a (mgr.14373) 3349 : cluster [DBG] pgmap v2322: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:54:28.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:54:28 smithi157 bash[24585]: cluster 2024-09-16T06:54:26.919579+0000 mgr.a (mgr.14373) 3349 : cluster [DBG] pgmap v2322: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:54:28.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:54:28 smithi086 bash[24289]: cluster 2024-09-16T06:54:26.919579+0000 mgr.a (mgr.14373) 3349 : cluster [DBG] pgmap v2322: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:54:28.835 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:54:28.836 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:54:28.836 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:54:29.610 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:54:29.610 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:54:29.610 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:54:29.610 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:54:29.610 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:54:30.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:54:30 smithi047 bash[22744]: cluster 2024-09-16T06:54:28.920318+0000 mgr.a (mgr.14373) 3350 : cluster [DBG] pgmap v2323: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:54:30.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:54:30 smithi047 bash[22744]: audit 2024-09-16T06:54:29.174041+0000 mgr.a (mgr.14373) 3351 : audit [DBG] from='client.83520 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:54:30.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:54:30 smithi157 bash[24585]: cluster 2024-09-16T06:54:28.920318+0000 mgr.a (mgr.14373) 3350 : cluster [DBG] pgmap v2323: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:54:30.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:54:30 smithi157 bash[24585]: audit 2024-09-16T06:54:29.174041+0000 mgr.a (mgr.14373) 3351 : audit [DBG] from='client.83520 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:54:30.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:54:30 smithi086 bash[24289]: cluster 2024-09-16T06:54:28.920318+0000 mgr.a (mgr.14373) 3350 : cluster [DBG] pgmap v2323: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:54:30.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:54:30 smithi086 bash[24289]: audit 2024-09-16T06:54:29.174041+0000 mgr.a (mgr.14373) 3351 : audit [DBG] from='client.83520 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:54:32.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:54:32 smithi047 bash[22744]: cluster 2024-09-16T06:54:30.921222+0000 mgr.a (mgr.14373) 3352 : cluster [DBG] pgmap v2324: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:54:32.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:54:32 smithi157 bash[24585]: cluster 2024-09-16T06:54:30.921222+0000 mgr.a (mgr.14373) 3352 : cluster [DBG] pgmap v2324: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:54:32.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:54:32 smithi086 bash[24289]: cluster 2024-09-16T06:54:30.921222+0000 mgr.a (mgr.14373) 3352 : cluster [DBG] pgmap v2324: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:54:34.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:54:34 smithi047 bash[22744]: cluster 2024-09-16T06:54:32.923450+0000 mgr.a (mgr.14373) 3353 : cluster [DBG] pgmap v2325: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:54:34.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:54:34 smithi157 bash[24585]: cluster 2024-09-16T06:54:32.923450+0000 mgr.a (mgr.14373) 3353 : cluster [DBG] pgmap v2325: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:54:34.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:54:34 smithi086 bash[24289]: cluster 2024-09-16T06:54:32.923450+0000 mgr.a (mgr.14373) 3353 : cluster [DBG] pgmap v2325: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:54:34.611 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:54:34.612 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:54:34.612 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:54:35.372 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:54:35.372 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:54:35.372 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:54:35.373 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:54:35.373 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:54:36.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:54:36 smithi157 bash[24585]: cluster 2024-09-16T06:54:34.924179+0000 mgr.a (mgr.14373) 3354 : cluster [DBG] pgmap v2326: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:54:36.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:54:36 smithi157 bash[24585]: audit 2024-09-16T06:54:34.946956+0000 mgr.a (mgr.14373) 3355 : audit [DBG] from='client.83595 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:54:36.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:54:36 smithi086 bash[24289]: cluster 2024-09-16T06:54:34.924179+0000 mgr.a (mgr.14373) 3354 : cluster [DBG] pgmap v2326: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:54:36.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:54:36 smithi086 bash[24289]: audit 2024-09-16T06:54:34.946956+0000 mgr.a (mgr.14373) 3355 : audit [DBG] from='client.83595 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:54:36.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:54:36 smithi047 bash[22744]: cluster 2024-09-16T06:54:34.924179+0000 mgr.a (mgr.14373) 3354 : cluster [DBG] pgmap v2326: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:54:36.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:54:36 smithi047 bash[22744]: audit 2024-09-16T06:54:34.946956+0000 mgr.a (mgr.14373) 3355 : audit [DBG] from='client.83595 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:54:38.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:54:38 smithi157 bash[24585]: cluster 2024-09-16T06:54:36.926489+0000 mgr.a (mgr.14373) 3356 : cluster [DBG] pgmap v2327: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:54:38.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:54:38 smithi086 bash[24289]: cluster 2024-09-16T06:54:36.926489+0000 mgr.a (mgr.14373) 3356 : cluster [DBG] pgmap v2327: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:54:38.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:54:38 smithi047 bash[22744]: cluster 2024-09-16T06:54:36.926489+0000 mgr.a (mgr.14373) 3356 : cluster [DBG] pgmap v2327: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:54:40.374 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:54:40.375 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:54:40.375 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:54:40.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:54:40 smithi157 bash[24585]: cluster 2024-09-16T06:54:38.927201+0000 mgr.a (mgr.14373) 3357 : cluster [DBG] pgmap v2328: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:54:40.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:54:40 smithi086 bash[24289]: cluster 2024-09-16T06:54:38.927201+0000 mgr.a (mgr.14373) 3357 : cluster [DBG] pgmap v2328: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:54:40.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:54:40 smithi047 bash[22744]: cluster 2024-09-16T06:54:38.927201+0000 mgr.a (mgr.14373) 3357 : cluster [DBG] pgmap v2328: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:54:41.121 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:54:41.122 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:54:41.122 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:54:41.122 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:54:41.122 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:54:42.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:54:42 smithi157 bash[24585]: audit 2024-09-16T06:54:40.704541+0000 mgr.a (mgr.14373) 3358 : audit [DBG] from='client.83673 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:54:42.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:54:42 smithi157 bash[24585]: cluster 2024-09-16T06:54:40.928057+0000 mgr.a (mgr.14373) 3359 : cluster [DBG] pgmap v2329: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:54:42.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:54:42 smithi086 bash[24289]: audit 2024-09-16T06:54:40.704541+0000 mgr.a (mgr.14373) 3358 : audit [DBG] from='client.83673 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:54:42.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:54:42 smithi086 bash[24289]: cluster 2024-09-16T06:54:40.928057+0000 mgr.a (mgr.14373) 3359 : cluster [DBG] pgmap v2329: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:54:42.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:54:42 smithi047 bash[22744]: audit 2024-09-16T06:54:40.704541+0000 mgr.a (mgr.14373) 3358 : audit [DBG] from='client.83673 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:54:42.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:54:42 smithi047 bash[22744]: cluster 2024-09-16T06:54:40.928057+0000 mgr.a (mgr.14373) 3359 : cluster [DBG] pgmap v2329: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:54:44.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:54:44 smithi157 bash[24585]: cluster 2024-09-16T06:54:42.930381+0000 mgr.a (mgr.14373) 3360 : cluster [DBG] pgmap v2330: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:54:44.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:54:44 smithi086 bash[24289]: cluster 2024-09-16T06:54:42.930381+0000 mgr.a (mgr.14373) 3360 : cluster [DBG] pgmap v2330: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:54:44.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:54:44 smithi047 bash[22744]: cluster 2024-09-16T06:54:42.930381+0000 mgr.a (mgr.14373) 3360 : cluster [DBG] pgmap v2330: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:54:46.123 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:54:46.123 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:54:46.124 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:54:46.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:54:46 smithi157 bash[24585]: cluster 2024-09-16T06:54:44.931106+0000 mgr.a (mgr.14373) 3361 : cluster [DBG] pgmap v2331: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:54:46.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:54:46 smithi086 bash[24289]: cluster 2024-09-16T06:54:44.931106+0000 mgr.a (mgr.14373) 3361 : cluster [DBG] pgmap v2331: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:54:46.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:54:46 smithi047 bash[22744]: cluster 2024-09-16T06:54:44.931106+0000 mgr.a (mgr.14373) 3361 : cluster [DBG] pgmap v2331: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:54:46.903 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:54:46.904 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:54:46.904 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:54:46.904 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:54:46.904 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:54:48.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:54:48 smithi157 bash[24585]: audit 2024-09-16T06:54:46.462767+0000 mgr.a (mgr.14373) 3362 : audit [DBG] from='client.83751 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:54:48.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:54:48 smithi157 bash[24585]: cluster 2024-09-16T06:54:46.932527+0000 mgr.a (mgr.14373) 3363 : cluster [DBG] pgmap v2332: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:54:48.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:54:48 smithi086 bash[24289]: audit 2024-09-16T06:54:46.462767+0000 mgr.a (mgr.14373) 3362 : audit [DBG] from='client.83751 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:54:48.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:54:48 smithi086 bash[24289]: cluster 2024-09-16T06:54:46.932527+0000 mgr.a (mgr.14373) 3363 : cluster [DBG] pgmap v2332: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:54:48.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:54:48 smithi047 bash[22744]: audit 2024-09-16T06:54:46.462767+0000 mgr.a (mgr.14373) 3362 : audit [DBG] from='client.83751 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:54:48.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:54:48 smithi047 bash[22744]: cluster 2024-09-16T06:54:46.932527+0000 mgr.a (mgr.14373) 3363 : cluster [DBG] pgmap v2332: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:54:50.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:54:50 smithi157 bash[24585]: cluster 2024-09-16T06:54:48.933241+0000 mgr.a (mgr.14373) 3364 : cluster [DBG] pgmap v2333: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T06:54:50.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:54:50 smithi086 bash[24289]: cluster 2024-09-16T06:54:48.933241+0000 mgr.a (mgr.14373) 3364 : cluster [DBG] pgmap v2333: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T06:54:50.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:54:50 smithi047 bash[22744]: cluster 2024-09-16T06:54:48.933241+0000 mgr.a (mgr.14373) 3364 : cluster [DBG] pgmap v2333: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T06:54:51.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:54:51 smithi157 bash[24585]: audit 2024-09-16T06:54:50.201437+0000 mon.b (mon.2) 346 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T06:54:51.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:54:51 smithi157 bash[24585]: audit 2024-09-16T06:54:51.040031+0000 mon.b (mon.2) 347 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T06:54:51.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:54:51 smithi157 bash[24585]: audit 2024-09-16T06:54:51.041631+0000 mon.b (mon.2) 348 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T06:54:51.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:54:51 smithi157 bash[24585]: audit 2024-09-16T06:54:51.054164+0000 mon.a (mon.0) 768 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:54:51.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:54:51 smithi157 bash[24585]: audit 2024-09-16T06:54:51.057745+0000 mon.b (mon.2) 349 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:54:51.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:54:51 smithi086 bash[24289]: audit 2024-09-16T06:54:50.201437+0000 mon.b (mon.2) 346 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T06:54:51.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:54:51 smithi086 bash[24289]: audit 2024-09-16T06:54:51.040031+0000 mon.b (mon.2) 347 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T06:54:51.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:54:51 smithi086 bash[24289]: audit 2024-09-16T06:54:51.041631+0000 mon.b (mon.2) 348 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T06:54:51.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:54:51 smithi086 bash[24289]: audit 2024-09-16T06:54:51.054164+0000 mon.a (mon.0) 768 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:54:51.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:54:51 smithi086 bash[24289]: audit 2024-09-16T06:54:51.057745+0000 mon.b (mon.2) 349 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:54:51.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:54:51 smithi047 bash[22744]: audit 2024-09-16T06:54:50.201437+0000 mon.b (mon.2) 346 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T06:54:51.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:54:51 smithi047 bash[22744]: audit 2024-09-16T06:54:51.040031+0000 mon.b (mon.2) 347 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T06:54:51.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:54:51 smithi047 bash[22744]: audit 2024-09-16T06:54:51.041631+0000 mon.b (mon.2) 348 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T06:54:51.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:54:51 smithi047 bash[22744]: audit 2024-09-16T06:54:51.054164+0000 mon.a (mon.0) 768 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:54:51.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:54:51 smithi047 bash[22744]: audit 2024-09-16T06:54:51.057745+0000 mon.b (mon.2) 349 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:54:51.905 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:54:51.905 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:54:51.906 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:54:52.089 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 06:54:51 smithi047 bash[22994]: debug 2024-09-16T06:54:51.791+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T06:54:52.089 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 06:54:51 smithi047 bash[22994]: debug 2024-09-16T06:54:51.795+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T06:54:52.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:54:52 smithi157 bash[24585]: cluster 2024-09-16T06:54:50.933955+0000 mgr.a (mgr.14373) 3365 : cluster [DBG] pgmap v2334: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T06:54:52.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:54:52 smithi157 bash[24585]: audit 2024-09-16T06:54:51.062317+0000 mgr.a (mgr.14373) 3366 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:54:52.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:54:52 smithi086 bash[24289]: cluster 2024-09-16T06:54:50.933955+0000 mgr.a (mgr.14373) 3365 : cluster [DBG] pgmap v2334: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T06:54:52.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:54:52 smithi086 bash[24289]: audit 2024-09-16T06:54:51.062317+0000 mgr.a (mgr.14373) 3366 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:54:52.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:54:52 smithi047 bash[22744]: cluster 2024-09-16T06:54:50.933955+0000 mgr.a (mgr.14373) 3365 : cluster [DBG] pgmap v2334: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T06:54:52.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:54:52 smithi047 bash[22744]: audit 2024-09-16T06:54:51.062317+0000 mgr.a (mgr.14373) 3366 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:54:52.664 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:54:52.665 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:54:52.665 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:54:52.665 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:54:52.665 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:54:53.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:54:53 smithi157 bash[24585]: audit 2024-09-16T06:54:51.796937+0000 mgr.a (mgr.14373) 3367 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T06:54:53.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:54:53 smithi157 bash[24585]: cephadm 2024-09-16T06:54:51.798896+0000 mgr.a (mgr.14373) 3368 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T06:54:53.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:54:53 smithi157 bash[24585]: audit 2024-09-16T06:54:52.238314+0000 mgr.a (mgr.14373) 3369 : audit [DBG] from='client.83931 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:54:53.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:54:53 smithi086 bash[24289]: audit 2024-09-16T06:54:51.796937+0000 mgr.a (mgr.14373) 3367 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T06:54:53.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:54:53 smithi086 bash[24289]: cephadm 2024-09-16T06:54:51.798896+0000 mgr.a (mgr.14373) 3368 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T06:54:53.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:54:53 smithi086 bash[24289]: audit 2024-09-16T06:54:52.238314+0000 mgr.a (mgr.14373) 3369 : audit [DBG] from='client.83931 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:54:53.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:54:53 smithi047 bash[22744]: audit 2024-09-16T06:54:51.796937+0000 mgr.a (mgr.14373) 3367 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T06:54:53.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:54:53 smithi047 bash[22744]: cephadm 2024-09-16T06:54:51.798896+0000 mgr.a (mgr.14373) 3368 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T06:54:53.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:54:53 smithi047 bash[22744]: audit 2024-09-16T06:54:52.238314+0000 mgr.a (mgr.14373) 3369 : audit [DBG] from='client.83931 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:54:54.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:54:54 smithi157 bash[24585]: cluster 2024-09-16T06:54:52.936717+0000 mgr.a (mgr.14373) 3370 : cluster [DBG] pgmap v2335: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-16T06:54:54.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:54:54 smithi086 bash[24289]: cluster 2024-09-16T06:54:52.936717+0000 mgr.a (mgr.14373) 3370 : cluster [DBG] pgmap v2335: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-16T06:54:54.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:54:54 smithi047 bash[22744]: cluster 2024-09-16T06:54:52.936717+0000 mgr.a (mgr.14373) 3370 : cluster [DBG] pgmap v2335: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-16T06:54:56.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:54:56 smithi086 bash[24289]: cluster 2024-09-16T06:54:54.937528+0000 mgr.a (mgr.14373) 3371 : cluster [DBG] pgmap v2336: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-16T06:54:56.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:54:56 smithi047 bash[22744]: cluster 2024-09-16T06:54:54.937528+0000 mgr.a (mgr.14373) 3371 : cluster [DBG] pgmap v2336: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-16T06:54:56.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:54:56 smithi157 bash[24585]: cluster 2024-09-16T06:54:54.937528+0000 mgr.a (mgr.14373) 3371 : cluster [DBG] pgmap v2336: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-16T06:54:57.666 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:54:57.667 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:54:57.667 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:54:58.413 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:54:58.413 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:54:58.413 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:54:58.414 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:54:58.414 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:54:58.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:54:58 smithi086 bash[24289]: cluster 2024-09-16T06:54:56.939550+0000 mgr.a (mgr.14373) 3372 : cluster [DBG] pgmap v2337: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:54:58.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:54:58 smithi047 bash[22744]: cluster 2024-09-16T06:54:56.939550+0000 mgr.a (mgr.14373) 3372 : cluster [DBG] pgmap v2337: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:54:58.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:54:58 smithi157 bash[24585]: cluster 2024-09-16T06:54:56.939550+0000 mgr.a (mgr.14373) 3372 : cluster [DBG] pgmap v2337: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:54:59.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:54:59 smithi086 bash[24289]: audit 2024-09-16T06:54:58.002260+0000 mgr.a (mgr.14373) 3373 : audit [DBG] from='client.84009 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:54:59.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:54:59 smithi047 bash[22744]: audit 2024-09-16T06:54:58.002260+0000 mgr.a (mgr.14373) 3373 : audit [DBG] from='client.84009 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:54:59.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:54:59 smithi157 bash[24585]: audit 2024-09-16T06:54:58.002260+0000 mgr.a (mgr.14373) 3373 : audit [DBG] from='client.84009 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:55:00.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:55:00 smithi047 bash[22744]: cluster 2024-09-16T06:54:58.940430+0000 mgr.a (mgr.14373) 3374 : cluster [DBG] pgmap v2338: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:55:00.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:55:00 smithi157 bash[24585]: cluster 2024-09-16T06:54:58.940430+0000 mgr.a (mgr.14373) 3374 : cluster [DBG] pgmap v2338: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:55:00.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:55:00 smithi086 bash[24289]: cluster 2024-09-16T06:54:58.940430+0000 mgr.a (mgr.14373) 3374 : cluster [DBG] pgmap v2338: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:55:02.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:55:02 smithi047 bash[22744]: cluster 2024-09-16T06:55:00.941225+0000 mgr.a (mgr.14373) 3375 : cluster [DBG] pgmap v2339: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:55:02.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:55:02 smithi157 bash[24585]: cluster 2024-09-16T06:55:00.941225+0000 mgr.a (mgr.14373) 3375 : cluster [DBG] pgmap v2339: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:55:02.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:55:02 smithi086 bash[24289]: cluster 2024-09-16T06:55:00.941225+0000 mgr.a (mgr.14373) 3375 : cluster [DBG] pgmap v2339: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:55:03.415 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:55:03.415 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:55:03.416 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:55:04.194 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:55:04.195 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:55:04.195 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:55:04.195 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:55:04.195 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:55:04.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:55:04 smithi047 bash[22744]: cluster 2024-09-16T06:55:02.943455+0000 mgr.a (mgr.14373) 3376 : cluster [DBG] pgmap v2340: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:55:04.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:55:04 smithi157 bash[24585]: cluster 2024-09-16T06:55:02.943455+0000 mgr.a (mgr.14373) 3376 : cluster [DBG] pgmap v2340: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:55:04.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:55:04 smithi086 bash[24289]: cluster 2024-09-16T06:55:02.943455+0000 mgr.a (mgr.14373) 3376 : cluster [DBG] pgmap v2340: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:55:05.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:55:05 smithi047 bash[22744]: audit 2024-09-16T06:55:03.755000+0000 mgr.a (mgr.14373) 3377 : audit [DBG] from='client.84087 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:55:05.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:55:05 smithi157 bash[24585]: audit 2024-09-16T06:55:03.755000+0000 mgr.a (mgr.14373) 3377 : audit [DBG] from='client.84087 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:55:05.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:55:05 smithi086 bash[24289]: audit 2024-09-16T06:55:03.755000+0000 mgr.a (mgr.14373) 3377 : audit [DBG] from='client.84087 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:55:06.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:55:06 smithi157 bash[24585]: cluster 2024-09-16T06:55:04.944344+0000 mgr.a (mgr.14373) 3378 : cluster [DBG] pgmap v2341: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T06:55:06.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:55:06 smithi086 bash[24289]: cluster 2024-09-16T06:55:04.944344+0000 mgr.a (mgr.14373) 3378 : cluster [DBG] pgmap v2341: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T06:55:06.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:55:06 smithi047 bash[22744]: cluster 2024-09-16T06:55:04.944344+0000 mgr.a (mgr.14373) 3378 : cluster [DBG] pgmap v2341: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T06:55:07.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:55:07 smithi157 bash[24585]: cluster 2024-09-16T06:55:06.946533+0000 mgr.a (mgr.14373) 3379 : cluster [DBG] pgmap v2342: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:55:07.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:55:07 smithi086 bash[24289]: cluster 2024-09-16T06:55:06.946533+0000 mgr.a (mgr.14373) 3379 : cluster [DBG] pgmap v2342: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:55:07.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:55:07 smithi047 bash[22744]: cluster 2024-09-16T06:55:06.946533+0000 mgr.a (mgr.14373) 3379 : cluster [DBG] pgmap v2342: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:55:09.197 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:55:09.197 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:55:09.197 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:55:09.969 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:55:09.969 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:55:09.969 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:55:09.970 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:55:09.970 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:55:10.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:55:10 smithi157 bash[24585]: cluster 2024-09-16T06:55:08.947265+0000 mgr.a (mgr.14373) 3380 : cluster [DBG] pgmap v2343: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:55:10.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:55:10 smithi086 bash[24289]: cluster 2024-09-16T06:55:08.947265+0000 mgr.a (mgr.14373) 3380 : cluster [DBG] pgmap v2343: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:55:10.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:55:10 smithi047 bash[22744]: cluster 2024-09-16T06:55:08.947265+0000 mgr.a (mgr.14373) 3380 : cluster [DBG] pgmap v2343: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:55:11.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:55:11 smithi157 bash[24585]: audit 2024-09-16T06:55:09.538053+0000 mgr.a (mgr.14373) 3381 : audit [DBG] from='client.84165 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:55:11.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:55:11 smithi086 bash[24289]: audit 2024-09-16T06:55:09.538053+0000 mgr.a (mgr.14373) 3381 : audit [DBG] from='client.84165 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:55:11.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:55:11 smithi047 bash[22744]: audit 2024-09-16T06:55:09.538053+0000 mgr.a (mgr.14373) 3381 : audit [DBG] from='client.84165 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:55:12.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:55:12 smithi157 bash[24585]: cluster 2024-09-16T06:55:10.948131+0000 mgr.a (mgr.14373) 3382 : cluster [DBG] pgmap v2344: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:55:12.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:55:12 smithi086 bash[24289]: cluster 2024-09-16T06:55:10.948131+0000 mgr.a (mgr.14373) 3382 : cluster [DBG] pgmap v2344: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:55:12.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:55:12 smithi047 bash[22744]: cluster 2024-09-16T06:55:10.948131+0000 mgr.a (mgr.14373) 3382 : cluster [DBG] pgmap v2344: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:55:14.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:55:14 smithi157 bash[24585]: cluster 2024-09-16T06:55:12.950312+0000 mgr.a (mgr.14373) 3383 : cluster [DBG] pgmap v2345: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:55:14.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:55:14 smithi086 bash[24289]: cluster 2024-09-16T06:55:12.950312+0000 mgr.a (mgr.14373) 3383 : cluster [DBG] pgmap v2345: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:55:14.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:55:14 smithi047 bash[22744]: cluster 2024-09-16T06:55:12.950312+0000 mgr.a (mgr.14373) 3383 : cluster [DBG] pgmap v2345: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:55:14.971 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:55:14.971 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:55:14.972 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:55:15.722 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:55:15.722 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:55:15.723 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:55:15.723 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:55:15.723 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:55:16.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:55:16 smithi157 bash[24585]: cluster 2024-09-16T06:55:14.951096+0000 mgr.a (mgr.14373) 3384 : cluster [DBG] pgmap v2346: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:55:16.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:55:16 smithi157 bash[24585]: audit 2024-09-16T06:55:15.306386+0000 mgr.a (mgr.14373) 3385 : audit [DBG] from='client.84243 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:55:16.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:55:16 smithi086 bash[24289]: cluster 2024-09-16T06:55:14.951096+0000 mgr.a (mgr.14373) 3384 : cluster [DBG] pgmap v2346: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:55:16.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:55:16 smithi086 bash[24289]: audit 2024-09-16T06:55:15.306386+0000 mgr.a (mgr.14373) 3385 : audit [DBG] from='client.84243 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:55:16.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:55:16 smithi047 bash[22744]: cluster 2024-09-16T06:55:14.951096+0000 mgr.a (mgr.14373) 3384 : cluster [DBG] pgmap v2346: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:55:16.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:55:16 smithi047 bash[22744]: audit 2024-09-16T06:55:15.306386+0000 mgr.a (mgr.14373) 3385 : audit [DBG] from='client.84243 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:55:18.305 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:55:18 smithi157 bash[24585]: cluster 2024-09-16T06:55:16.953380+0000 mgr.a (mgr.14373) 3386 : cluster [DBG] pgmap v2347: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:55:18.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:55:18 smithi086 bash[24289]: cluster 2024-09-16T06:55:16.953380+0000 mgr.a (mgr.14373) 3386 : cluster [DBG] pgmap v2347: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:55:18.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:55:18 smithi047 bash[22744]: cluster 2024-09-16T06:55:16.953380+0000 mgr.a (mgr.14373) 3386 : cluster [DBG] pgmap v2347: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:55:20.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:55:20 smithi157 bash[24585]: cluster 2024-09-16T06:55:18.954143+0000 mgr.a (mgr.14373) 3387 : cluster [DBG] pgmap v2348: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:55:20.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:55:20 smithi086 bash[24289]: cluster 2024-09-16T06:55:18.954143+0000 mgr.a (mgr.14373) 3387 : cluster [DBG] pgmap v2348: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:55:20.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:55:20 smithi047 bash[22744]: cluster 2024-09-16T06:55:18.954143+0000 mgr.a (mgr.14373) 3387 : cluster [DBG] pgmap v2348: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:55:20.723 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:55:20.724 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:55:20.724 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:55:21.460 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:55:21.460 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:55:21.460 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:55:21.460 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:55:21.460 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:55:22.305 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:55:22 smithi157 bash[24585]: cluster 2024-09-16T06:55:20.954639+0000 mgr.a (mgr.14373) 3388 : cluster [DBG] pgmap v2349: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:55:22.305 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:55:22 smithi157 bash[24585]: audit 2024-09-16T06:55:21.056854+0000 mgr.a (mgr.14373) 3389 : audit [DBG] from='client.84321 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:55:22.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:55:22 smithi086 bash[24289]: cluster 2024-09-16T06:55:20.954639+0000 mgr.a (mgr.14373) 3388 : cluster [DBG] pgmap v2349: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:55:22.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:55:22 smithi086 bash[24289]: audit 2024-09-16T06:55:21.056854+0000 mgr.a (mgr.14373) 3389 : audit [DBG] from='client.84321 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:55:22.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:55:22 smithi047 bash[22744]: cluster 2024-09-16T06:55:20.954639+0000 mgr.a (mgr.14373) 3388 : cluster [DBG] pgmap v2349: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:55:22.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:55:22 smithi047 bash[22744]: audit 2024-09-16T06:55:21.056854+0000 mgr.a (mgr.14373) 3389 : audit [DBG] from='client.84321 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:55:24.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:55:24 smithi157 bash[24585]: cluster 2024-09-16T06:55:22.956882+0000 mgr.a (mgr.14373) 3390 : cluster [DBG] pgmap v2350: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-16T06:55:24.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:55:24 smithi086 bash[24289]: cluster 2024-09-16T06:55:22.956882+0000 mgr.a (mgr.14373) 3390 : cluster [DBG] pgmap v2350: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-16T06:55:24.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:55:24 smithi047 bash[22744]: cluster 2024-09-16T06:55:22.956882+0000 mgr.a (mgr.14373) 3390 : cluster [DBG] pgmap v2350: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-16T06:55:26.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:55:26 smithi157 bash[24585]: cluster 2024-09-16T06:55:24.957609+0000 mgr.a (mgr.14373) 3391 : cluster [DBG] pgmap v2351: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T06:55:26.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:55:26 smithi086 bash[24289]: cluster 2024-09-16T06:55:24.957609+0000 mgr.a (mgr.14373) 3391 : cluster [DBG] pgmap v2351: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T06:55:26.365 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:55:26 smithi047 bash[22744]: cluster 2024-09-16T06:55:24.957609+0000 mgr.a (mgr.14373) 3391 : cluster [DBG] pgmap v2351: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T06:55:26.461 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:55:26.462 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:55:26.462 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:55:27.210 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:55:27.211 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:55:27.211 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:55:27.211 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:55:27.211 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:55:28.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:55:28 smithi157 bash[24585]: audit 2024-09-16T06:55:26.793516+0000 mgr.a (mgr.14373) 3392 : audit [DBG] from='client.84396 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:55:28.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:55:28 smithi157 bash[24585]: cluster 2024-09-16T06:55:26.958963+0000 mgr.a (mgr.14373) 3393 : cluster [DBG] pgmap v2352: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:55:28.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:55:28 smithi047 bash[22744]: audit 2024-09-16T06:55:26.793516+0000 mgr.a (mgr.14373) 3392 : audit [DBG] from='client.84396 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:55:28.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:55:28 smithi047 bash[22744]: cluster 2024-09-16T06:55:26.958963+0000 mgr.a (mgr.14373) 3393 : cluster [DBG] pgmap v2352: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:55:28.390 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:55:28 smithi086 bash[24289]: audit 2024-09-16T06:55:26.793516+0000 mgr.a (mgr.14373) 3392 : audit [DBG] from='client.84396 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:55:28.390 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:55:28 smithi086 bash[24289]: cluster 2024-09-16T06:55:26.958963+0000 mgr.a (mgr.14373) 3393 : cluster [DBG] pgmap v2352: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:55:30.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:55:30 smithi157 bash[24585]: cluster 2024-09-16T06:55:28.959838+0000 mgr.a (mgr.14373) 3394 : cluster [DBG] pgmap v2353: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T06:55:30.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:55:30 smithi086 bash[24289]: cluster 2024-09-16T06:55:28.959838+0000 mgr.a (mgr.14373) 3394 : cluster [DBG] pgmap v2353: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T06:55:30.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:55:30 smithi047 bash[22744]: cluster 2024-09-16T06:55:28.959838+0000 mgr.a (mgr.14373) 3394 : cluster [DBG] pgmap v2353: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T06:55:32.212 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:55:32.212 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:55:32.213 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:55:32.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:55:32 smithi157 bash[24585]: cluster 2024-09-16T06:55:30.960608+0000 mgr.a (mgr.14373) 3395 : cluster [DBG] pgmap v2354: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T06:55:32.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:55:32 smithi086 bash[24289]: cluster 2024-09-16T06:55:30.960608+0000 mgr.a (mgr.14373) 3395 : cluster [DBG] pgmap v2354: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T06:55:32.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:55:32 smithi047 bash[22744]: cluster 2024-09-16T06:55:30.960608+0000 mgr.a (mgr.14373) 3395 : cluster [DBG] pgmap v2354: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T06:55:32.958 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:55:32.958 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:55:32.959 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:55:32.959 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:55:32.959 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:55:34.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:55:34 smithi086 bash[24289]: audit 2024-09-16T06:55:32.538377+0000 mgr.a (mgr.14373) 3396 : audit [DBG] from='client.84471 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:55:34.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:55:34 smithi086 bash[24289]: cluster 2024-09-16T06:55:32.961909+0000 mgr.a (mgr.14373) 3397 : cluster [DBG] pgmap v2355: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:55:34.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:55:34 smithi047 bash[22744]: audit 2024-09-16T06:55:32.538377+0000 mgr.a (mgr.14373) 3396 : audit [DBG] from='client.84471 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:55:34.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:55:34 smithi047 bash[22744]: cluster 2024-09-16T06:55:32.961909+0000 mgr.a (mgr.14373) 3397 : cluster [DBG] pgmap v2355: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:55:34.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:55:34 smithi157 bash[24585]: audit 2024-09-16T06:55:32.538377+0000 mgr.a (mgr.14373) 3396 : audit [DBG] from='client.84471 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:55:34.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:55:34 smithi157 bash[24585]: cluster 2024-09-16T06:55:32.961909+0000 mgr.a (mgr.14373) 3397 : cluster [DBG] pgmap v2355: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:55:36.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:55:36 smithi086 bash[24289]: cluster 2024-09-16T06:55:34.962670+0000 mgr.a (mgr.14373) 3398 : cluster [DBG] pgmap v2356: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-16T06:55:36.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:55:36 smithi047 bash[22744]: cluster 2024-09-16T06:55:34.962670+0000 mgr.a (mgr.14373) 3398 : cluster [DBG] pgmap v2356: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-16T06:55:36.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:55:36 smithi157 bash[24585]: cluster 2024-09-16T06:55:34.962670+0000 mgr.a (mgr.14373) 3398 : cluster [DBG] pgmap v2356: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-16T06:55:37.960 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:55:37.960 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:55:37.961 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:55:38.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:55:38 smithi086 bash[24289]: cluster 2024-09-16T06:55:36.964600+0000 mgr.a (mgr.14373) 3399 : cluster [DBG] pgmap v2357: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-16T06:55:38.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:55:38 smithi047 bash[22744]: cluster 2024-09-16T06:55:36.964600+0000 mgr.a (mgr.14373) 3399 : cluster [DBG] pgmap v2357: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-16T06:55:38.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:55:38 smithi157 bash[24585]: cluster 2024-09-16T06:55:36.964600+0000 mgr.a (mgr.14373) 3399 : cluster [DBG] pgmap v2357: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-16T06:55:38.711 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:55:38.711 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:55:38.711 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:55:38.711 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:55:38.712 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:55:39.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:55:39 smithi047 bash[22744]: audit 2024-09-16T06:55:38.297825+0000 mgr.a (mgr.14373) 3400 : audit [DBG] from='client.84549 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:55:39.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:55:39 smithi157 bash[24585]: audit 2024-09-16T06:55:38.297825+0000 mgr.a (mgr.14373) 3400 : audit [DBG] from='client.84549 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:55:39.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:55:39 smithi086 bash[24289]: audit 2024-09-16T06:55:38.297825+0000 mgr.a (mgr.14373) 3400 : audit [DBG] from='client.84549 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:55:40.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:55:40 smithi047 bash[22744]: cluster 2024-09-16T06:55:38.965498+0000 mgr.a (mgr.14373) 3401 : cluster [DBG] pgmap v2358: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:55:40.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:55:40 smithi157 bash[24585]: cluster 2024-09-16T06:55:38.965498+0000 mgr.a (mgr.14373) 3401 : cluster [DBG] pgmap v2358: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:55:40.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:55:40 smithi086 bash[24289]: cluster 2024-09-16T06:55:38.965498+0000 mgr.a (mgr.14373) 3401 : cluster [DBG] pgmap v2358: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:55:42.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:55:42 smithi047 bash[22744]: cluster 2024-09-16T06:55:40.966281+0000 mgr.a (mgr.14373) 3402 : cluster [DBG] pgmap v2359: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:55:42.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:55:42 smithi157 bash[24585]: cluster 2024-09-16T06:55:40.966281+0000 mgr.a (mgr.14373) 3402 : cluster [DBG] pgmap v2359: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:55:42.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:55:42 smithi086 bash[24289]: cluster 2024-09-16T06:55:40.966281+0000 mgr.a (mgr.14373) 3402 : cluster [DBG] pgmap v2359: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:55:43.713 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:55:43.713 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:55:43.713 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:55:44.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:55:44 smithi047 bash[22744]: cluster 2024-09-16T06:55:42.968411+0000 mgr.a (mgr.14373) 3403 : cluster [DBG] pgmap v2360: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:55:44.470 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:55:44.470 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:55:44.470 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:55:44.470 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:55:44.470 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:55:44.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:55:44 smithi157 bash[24585]: cluster 2024-09-16T06:55:42.968411+0000 mgr.a (mgr.14373) 3403 : cluster [DBG] pgmap v2360: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:55:44.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:55:44 smithi086 bash[24289]: cluster 2024-09-16T06:55:42.968411+0000 mgr.a (mgr.14373) 3403 : cluster [DBG] pgmap v2360: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:55:45.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:55:45 smithi047 bash[22744]: audit 2024-09-16T06:55:44.052389+0000 mgr.a (mgr.14373) 3404 : audit [DBG] from='client.84627 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:55:45.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:55:45 smithi157 bash[24585]: audit 2024-09-16T06:55:44.052389+0000 mgr.a (mgr.14373) 3404 : audit [DBG] from='client.84627 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:55:45.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:55:45 smithi086 bash[24289]: audit 2024-09-16T06:55:44.052389+0000 mgr.a (mgr.14373) 3404 : audit [DBG] from='client.84627 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:55:46.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:55:46 smithi157 bash[24585]: cluster 2024-09-16T06:55:44.969385+0000 mgr.a (mgr.14373) 3405 : cluster [DBG] pgmap v2361: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:55:46.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:55:46 smithi086 bash[24289]: cluster 2024-09-16T06:55:44.969385+0000 mgr.a (mgr.14373) 3405 : cluster [DBG] pgmap v2361: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:55:46.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:55:46 smithi047 bash[22744]: cluster 2024-09-16T06:55:44.969385+0000 mgr.a (mgr.14373) 3405 : cluster [DBG] pgmap v2361: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:55:48.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:55:48 smithi157 bash[24585]: cluster 2024-09-16T06:55:46.971608+0000 mgr.a (mgr.14373) 3406 : cluster [DBG] pgmap v2362: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:55:48.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:55:48 smithi086 bash[24289]: cluster 2024-09-16T06:55:46.971608+0000 mgr.a (mgr.14373) 3406 : cluster [DBG] pgmap v2362: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:55:48.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:55:48 smithi047 bash[22744]: cluster 2024-09-16T06:55:46.971608+0000 mgr.a (mgr.14373) 3406 : cluster [DBG] pgmap v2362: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:55:49.471 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:55:49.472 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:55:49.472 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:55:50.220 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:55:50.220 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:55:50.220 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:55:50.220 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:55:50.220 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:55:50.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:55:50 smithi157 bash[24585]: cluster 2024-09-16T06:55:48.972358+0000 mgr.a (mgr.14373) 3407 : cluster [DBG] pgmap v2363: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:55:50.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:55:50 smithi086 bash[24289]: cluster 2024-09-16T06:55:48.972358+0000 mgr.a (mgr.14373) 3407 : cluster [DBG] pgmap v2363: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:55:50.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:55:50 smithi047 bash[22744]: cluster 2024-09-16T06:55:48.972358+0000 mgr.a (mgr.14373) 3407 : cluster [DBG] pgmap v2363: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:55:51.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:55:51 smithi157 bash[24585]: audit 2024-09-16T06:55:49.810759+0000 mgr.a (mgr.14373) 3408 : audit [DBG] from='client.84705 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:55:51.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:55:51 smithi086 bash[24289]: audit 2024-09-16T06:55:49.810759+0000 mgr.a (mgr.14373) 3408 : audit [DBG] from='client.84705 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:55:51.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:55:51 smithi047 bash[22744]: audit 2024-09-16T06:55:49.810759+0000 mgr.a (mgr.14373) 3408 : audit [DBG] from='client.84705 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:55:52.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:55:52 smithi157 bash[24585]: cluster 2024-09-16T06:55:50.973323+0000 mgr.a (mgr.14373) 3409 : cluster [DBG] pgmap v2364: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:55:52.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:55:52 smithi157 bash[24585]: audit 2024-09-16T06:55:51.850342+0000 mon.b (mon.2) 350 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T06:55:52.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:55:52 smithi086 bash[24289]: cluster 2024-09-16T06:55:50.973323+0000 mgr.a (mgr.14373) 3409 : cluster [DBG] pgmap v2364: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:55:52.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:55:52 smithi086 bash[24289]: audit 2024-09-16T06:55:51.850342+0000 mon.b (mon.2) 350 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T06:55:52.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:55:52 smithi047 bash[22744]: cluster 2024-09-16T06:55:50.973323+0000 mgr.a (mgr.14373) 3409 : cluster [DBG] pgmap v2364: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:55:52.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:55:52 smithi047 bash[22744]: audit 2024-09-16T06:55:51.850342+0000 mon.b (mon.2) 350 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T06:55:53.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:55:53 smithi157 bash[24585]: audit 2024-09-16T06:55:52.489545+0000 mon.a (mon.0) 769 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:55:53.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:55:53 smithi157 bash[24585]: audit 2024-09-16T06:55:52.500997+0000 mon.a (mon.0) 770 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:55:53.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:55:53 smithi157 bash[24585]: cluster 2024-09-16T06:55:52.975644+0000 mgr.a (mgr.14373) 3410 : cluster [DBG] pgmap v2365: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:55:53.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:55:53 smithi157 bash[24585]: audit 2024-09-16T06:55:53.274401+0000 mon.b (mon.2) 351 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T06:55:53.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:55:53 smithi157 bash[24585]: audit 2024-09-16T06:55:53.276711+0000 mon.b (mon.2) 352 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T06:55:53.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:55:53 smithi157 bash[24585]: audit 2024-09-16T06:55:53.289255+0000 mon.a (mon.0) 771 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:55:53.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:55:53 smithi157 bash[24585]: audit 2024-09-16T06:55:53.293146+0000 mon.b (mon.2) 353 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:55:53.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:55:53 smithi157 bash[24585]: audit 2024-09-16T06:55:53.297532+0000 mgr.a (mgr.14373) 3411 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:55:53.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:55:53 smithi086 bash[24289]: audit 2024-09-16T06:55:52.489545+0000 mon.a (mon.0) 769 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:55:53.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:55:53 smithi086 bash[24289]: audit 2024-09-16T06:55:52.500997+0000 mon.a (mon.0) 770 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:55:53.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:55:53 smithi086 bash[24289]: cluster 2024-09-16T06:55:52.975644+0000 mgr.a (mgr.14373) 3410 : cluster [DBG] pgmap v2365: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:55:53.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:55:53 smithi086 bash[24289]: audit 2024-09-16T06:55:53.274401+0000 mon.b (mon.2) 351 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T06:55:53.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:55:53 smithi086 bash[24289]: audit 2024-09-16T06:55:53.276711+0000 mon.b (mon.2) 352 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T06:55:53.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:55:53 smithi086 bash[24289]: audit 2024-09-16T06:55:53.289255+0000 mon.a (mon.0) 771 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:55:53.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:55:53 smithi086 bash[24289]: audit 2024-09-16T06:55:53.293146+0000 mon.b (mon.2) 353 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:55:53.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:55:53 smithi086 bash[24289]: audit 2024-09-16T06:55:53.297532+0000 mgr.a (mgr.14373) 3411 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:55:53.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:55:53 smithi047 bash[22744]: audit 2024-09-16T06:55:52.489545+0000 mon.a (mon.0) 769 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:55:53.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:55:53 smithi047 bash[22744]: audit 2024-09-16T06:55:52.500997+0000 mon.a (mon.0) 770 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:55:53.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:55:53 smithi047 bash[22744]: cluster 2024-09-16T06:55:52.975644+0000 mgr.a (mgr.14373) 3410 : cluster [DBG] pgmap v2365: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:55:53.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:55:53 smithi047 bash[22744]: audit 2024-09-16T06:55:53.274401+0000 mon.b (mon.2) 351 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T06:55:53.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:55:53 smithi047 bash[22744]: audit 2024-09-16T06:55:53.276711+0000 mon.b (mon.2) 352 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T06:55:53.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:55:53 smithi047 bash[22744]: audit 2024-09-16T06:55:53.289255+0000 mon.a (mon.0) 771 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:55:53.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:55:53 smithi047 bash[22744]: audit 2024-09-16T06:55:53.293146+0000 mon.b (mon.2) 353 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:55:53.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:55:53 smithi047 bash[22744]: audit 2024-09-16T06:55:53.297532+0000 mgr.a (mgr.14373) 3411 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:55:54.338 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 06:55:54 smithi047 bash[22994]: debug 2024-09-16T06:55:54.018+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T06:55:54.339 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 06:55:54 smithi047 bash[22994]: debug 2024-09-16T06:55:54.018+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T06:55:54.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:55:54 smithi157 bash[24585]: audit 2024-09-16T06:55:54.018984+0000 mgr.a (mgr.14373) 3412 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T06:55:54.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:55:54 smithi157 bash[24585]: cephadm 2024-09-16T06:55:54.021129+0000 mgr.a (mgr.14373) 3413 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T06:55:54.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:55:54 smithi086 bash[24289]: audit 2024-09-16T06:55:54.018984+0000 mgr.a (mgr.14373) 3412 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T06:55:54.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:55:54 smithi086 bash[24289]: cephadm 2024-09-16T06:55:54.021129+0000 mgr.a (mgr.14373) 3413 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T06:55:54.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:55:54 smithi047 bash[22744]: audit 2024-09-16T06:55:54.018984+0000 mgr.a (mgr.14373) 3412 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T06:55:54.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:55:54 smithi047 bash[22744]: cephadm 2024-09-16T06:55:54.021129+0000 mgr.a (mgr.14373) 3413 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T06:55:55.221 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:55:55.222 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:55:55.222 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:55:55.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:55:55 smithi157 bash[24585]: cluster 2024-09-16T06:55:54.976637+0000 mgr.a (mgr.14373) 3414 : cluster [DBG] pgmap v2366: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:55:55.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:55:55 smithi086 bash[24289]: cluster 2024-09-16T06:55:54.976637+0000 mgr.a (mgr.14373) 3414 : cluster [DBG] pgmap v2366: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:55:55.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:55:55 smithi047 bash[22744]: cluster 2024-09-16T06:55:54.976637+0000 mgr.a (mgr.14373) 3414 : cluster [DBG] pgmap v2366: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:55:55.994 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:55:55.994 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:55:55.994 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:55:55.995 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:55:55.995 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:55:56.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:55:56 smithi157 bash[24585]: audit 2024-09-16T06:55:55.557481+0000 mgr.a (mgr.14373) 3415 : audit [DBG] from='client.84891 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:55:56.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:55:56 smithi086 bash[24289]: audit 2024-09-16T06:55:55.557481+0000 mgr.a (mgr.14373) 3415 : audit [DBG] from='client.84891 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:55:56.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:55:56 smithi047 bash[22744]: audit 2024-09-16T06:55:55.557481+0000 mgr.a (mgr.14373) 3415 : audit [DBG] from='client.84891 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:55:57.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:55:57 smithi157 bash[24585]: cluster 2024-09-16T06:55:56.979105+0000 mgr.a (mgr.14373) 3416 : cluster [DBG] pgmap v2367: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:55:57.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:55:57 smithi086 bash[24289]: cluster 2024-09-16T06:55:56.979105+0000 mgr.a (mgr.14373) 3416 : cluster [DBG] pgmap v2367: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:55:57.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:55:57 smithi047 bash[22744]: cluster 2024-09-16T06:55:56.979105+0000 mgr.a (mgr.14373) 3416 : cluster [DBG] pgmap v2367: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:56:00.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:56:00 smithi157 bash[24585]: cluster 2024-09-16T06:55:58.979912+0000 mgr.a (mgr.14373) 3417 : cluster [DBG] pgmap v2368: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:56:00.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:56:00 smithi086 bash[24289]: cluster 2024-09-16T06:55:58.979912+0000 mgr.a (mgr.14373) 3417 : cluster [DBG] pgmap v2368: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:56:00.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:56:00 smithi047 bash[22744]: cluster 2024-09-16T06:55:58.979912+0000 mgr.a (mgr.14373) 3417 : cluster [DBG] pgmap v2368: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:56:00.996 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:56:00.996 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:56:00.997 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:56:01.754 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:56:01.755 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:56:01.755 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:56:01.755 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:56:01.755 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:56:02.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:56:02 smithi157 bash[24585]: cluster 2024-09-16T06:56:00.980684+0000 mgr.a (mgr.14373) 3418 : cluster [DBG] pgmap v2369: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:56:02.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:56:02 smithi157 bash[24585]: audit 2024-09-16T06:56:01.335984+0000 mgr.a (mgr.14373) 3419 : audit [DBG] from='client.84966 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:56:02.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:56:02 smithi086 bash[24289]: cluster 2024-09-16T06:56:00.980684+0000 mgr.a (mgr.14373) 3418 : cluster [DBG] pgmap v2369: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:56:02.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:56:02 smithi086 bash[24289]: audit 2024-09-16T06:56:01.335984+0000 mgr.a (mgr.14373) 3419 : audit [DBG] from='client.84966 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:56:02.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:56:02 smithi047 bash[22744]: cluster 2024-09-16T06:56:00.980684+0000 mgr.a (mgr.14373) 3418 : cluster [DBG] pgmap v2369: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:56:02.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:56:02 smithi047 bash[22744]: audit 2024-09-16T06:56:01.335984+0000 mgr.a (mgr.14373) 3419 : audit [DBG] from='client.84966 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:56:04.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:56:04 smithi086 bash[24289]: cluster 2024-09-16T06:56:02.983450+0000 mgr.a (mgr.14373) 3420 : cluster [DBG] pgmap v2370: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:56:04.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:56:04 smithi047 bash[22744]: cluster 2024-09-16T06:56:02.983450+0000 mgr.a (mgr.14373) 3420 : cluster [DBG] pgmap v2370: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:56:04.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:56:04 smithi157 bash[24585]: cluster 2024-09-16T06:56:02.983450+0000 mgr.a (mgr.14373) 3420 : cluster [DBG] pgmap v2370: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:56:06.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:56:06 smithi086 bash[24289]: cluster 2024-09-16T06:56:04.984219+0000 mgr.a (mgr.14373) 3421 : cluster [DBG] pgmap v2371: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T06:56:06.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:56:06 smithi047 bash[22744]: cluster 2024-09-16T06:56:04.984219+0000 mgr.a (mgr.14373) 3421 : cluster [DBG] pgmap v2371: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T06:56:06.756 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:56:06.757 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:56:06.757 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:56:06.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:56:06 smithi157 bash[24585]: cluster 2024-09-16T06:56:04.984219+0000 mgr.a (mgr.14373) 3421 : cluster [DBG] pgmap v2371: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T06:56:07.534 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:56:07.542 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:56:07.542 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:56:07.542 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:56:07.542 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:56:08.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:56:08 smithi047 bash[22744]: cluster 2024-09-16T06:56:06.986153+0000 mgr.a (mgr.14373) 3422 : cluster [DBG] pgmap v2372: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:56:08.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:56:08 smithi047 bash[22744]: audit 2024-09-16T06:56:07.092708+0000 mgr.a (mgr.14373) 3423 : audit [DBG] from='client.85044 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:56:08.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:56:08 smithi157 bash[24585]: cluster 2024-09-16T06:56:06.986153+0000 mgr.a (mgr.14373) 3422 : cluster [DBG] pgmap v2372: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:56:08.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:56:08 smithi157 bash[24585]: audit 2024-09-16T06:56:07.092708+0000 mgr.a (mgr.14373) 3423 : audit [DBG] from='client.85044 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:56:08.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:56:08 smithi086 bash[24289]: cluster 2024-09-16T06:56:06.986153+0000 mgr.a (mgr.14373) 3422 : cluster [DBG] pgmap v2372: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:56:08.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:56:08 smithi086 bash[24289]: audit 2024-09-16T06:56:07.092708+0000 mgr.a (mgr.14373) 3423 : audit [DBG] from='client.85044 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:56:10.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:56:10 smithi047 bash[22744]: cluster 2024-09-16T06:56:08.987100+0000 mgr.a (mgr.14373) 3424 : cluster [DBG] pgmap v2373: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:56:10.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:56:10 smithi157 bash[24585]: cluster 2024-09-16T06:56:08.987100+0000 mgr.a (mgr.14373) 3424 : cluster [DBG] pgmap v2373: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:56:10.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:56:10 smithi086 bash[24289]: cluster 2024-09-16T06:56:08.987100+0000 mgr.a (mgr.14373) 3424 : cluster [DBG] pgmap v2373: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:56:12.535 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:56:12.536 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:56:12.536 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:56:12.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:56:12 smithi047 bash[22744]: cluster 2024-09-16T06:56:10.987890+0000 mgr.a (mgr.14373) 3425 : cluster [DBG] pgmap v2374: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T06:56:12.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:56:12 smithi157 bash[24585]: cluster 2024-09-16T06:56:10.987890+0000 mgr.a (mgr.14373) 3425 : cluster [DBG] pgmap v2374: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T06:56:12.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:56:12 smithi086 bash[24289]: cluster 2024-09-16T06:56:10.987890+0000 mgr.a (mgr.14373) 3425 : cluster [DBG] pgmap v2374: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T06:56:13.277 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:56:13.277 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:56:13.277 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:56:13.277 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:56:13.277 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:56:14.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:56:14 smithi047 bash[22744]: audit 2024-09-16T06:56:12.869028+0000 mgr.a (mgr.14373) 3426 : audit [DBG] from='client.85116 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:56:14.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:56:14 smithi047 bash[22744]: cluster 2024-09-16T06:56:12.989081+0000 mgr.a (mgr.14373) 3427 : cluster [DBG] pgmap v2375: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:56:14.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:56:14 smithi157 bash[24585]: audit 2024-09-16T06:56:12.869028+0000 mgr.a (mgr.14373) 3426 : audit [DBG] from='client.85116 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:56:14.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:56:14 smithi157 bash[24585]: cluster 2024-09-16T06:56:12.989081+0000 mgr.a (mgr.14373) 3427 : cluster [DBG] pgmap v2375: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:56:14.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:56:14 smithi086 bash[24289]: audit 2024-09-16T06:56:12.869028+0000 mgr.a (mgr.14373) 3426 : audit [DBG] from='client.85116 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:56:14.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:56:14 smithi086 bash[24289]: cluster 2024-09-16T06:56:12.989081+0000 mgr.a (mgr.14373) 3427 : cluster [DBG] pgmap v2375: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:56:16.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:56:16 smithi047 bash[22744]: cluster 2024-09-16T06:56:14.989953+0000 mgr.a (mgr.14373) 3428 : cluster [DBG] pgmap v2376: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:56:16.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:56:16 smithi157 bash[24585]: cluster 2024-09-16T06:56:14.989953+0000 mgr.a (mgr.14373) 3428 : cluster [DBG] pgmap v2376: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:56:16.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:56:16 smithi086 bash[24289]: cluster 2024-09-16T06:56:14.989953+0000 mgr.a (mgr.14373) 3428 : cluster [DBG] pgmap v2376: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:56:18.278 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:56:18.279 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:56:18.279 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:56:18.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:56:18 smithi157 bash[24585]: cluster 2024-09-16T06:56:16.992190+0000 mgr.a (mgr.14373) 3429 : cluster [DBG] pgmap v2377: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:56:18.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:56:18 smithi086 bash[24289]: cluster 2024-09-16T06:56:16.992190+0000 mgr.a (mgr.14373) 3429 : cluster [DBG] pgmap v2377: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:56:18.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:56:18 smithi047 bash[22744]: cluster 2024-09-16T06:56:16.992190+0000 mgr.a (mgr.14373) 3429 : cluster [DBG] pgmap v2377: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:56:19.049 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:56:19.049 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:56:19.049 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:56:19.049 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:56:19.049 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:56:20.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:56:20 smithi157 bash[24585]: audit 2024-09-16T06:56:18.612087+0000 mgr.a (mgr.14373) 3430 : audit [DBG] from='client.85194 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:56:20.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:56:20 smithi157 bash[24585]: cluster 2024-09-16T06:56:18.992707+0000 mgr.a (mgr.14373) 3431 : cluster [DBG] pgmap v2378: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:56:20.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:56:20 smithi086 bash[24289]: audit 2024-09-16T06:56:18.612087+0000 mgr.a (mgr.14373) 3430 : audit [DBG] from='client.85194 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:56:20.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:56:20 smithi086 bash[24289]: cluster 2024-09-16T06:56:18.992707+0000 mgr.a (mgr.14373) 3431 : cluster [DBG] pgmap v2378: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:56:20.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:56:20 smithi047 bash[22744]: audit 2024-09-16T06:56:18.612087+0000 mgr.a (mgr.14373) 3430 : audit [DBG] from='client.85194 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:56:20.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:56:20 smithi047 bash[22744]: cluster 2024-09-16T06:56:18.992707+0000 mgr.a (mgr.14373) 3431 : cluster [DBG] pgmap v2378: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:56:22.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:56:22 smithi157 bash[24585]: cluster 2024-09-16T06:56:20.993435+0000 mgr.a (mgr.14373) 3432 : cluster [DBG] pgmap v2379: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:56:22.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:56:22 smithi086 bash[24289]: cluster 2024-09-16T06:56:20.993435+0000 mgr.a (mgr.14373) 3432 : cluster [DBG] pgmap v2379: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:56:22.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:56:22 smithi047 bash[22744]: cluster 2024-09-16T06:56:20.993435+0000 mgr.a (mgr.14373) 3432 : cluster [DBG] pgmap v2379: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:56:24.050 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:56:24.051 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:56:24.051 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:56:24.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:56:24 smithi157 bash[24585]: cluster 2024-09-16T06:56:22.995672+0000 mgr.a (mgr.14373) 3433 : cluster [DBG] pgmap v2380: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:56:24.815 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:56:24.816 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:56:24.816 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:56:24.816 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:56:24.816 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:56:24.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:56:24 smithi086 bash[24289]: cluster 2024-09-16T06:56:22.995672+0000 mgr.a (mgr.14373) 3433 : cluster [DBG] pgmap v2380: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:56:24.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:56:24 smithi047 bash[22744]: cluster 2024-09-16T06:56:22.995672+0000 mgr.a (mgr.14373) 3433 : cluster [DBG] pgmap v2380: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:56:26.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:56:26 smithi157 bash[24585]: audit 2024-09-16T06:56:24.389791+0000 mgr.a (mgr.14373) 3434 : audit [DBG] from='client.85272 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:56:26.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:56:26 smithi157 bash[24585]: cluster 2024-09-16T06:56:24.996240+0000 mgr.a (mgr.14373) 3435 : cluster [DBG] pgmap v2381: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:56:26.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:56:26 smithi086 bash[24289]: audit 2024-09-16T06:56:24.389791+0000 mgr.a (mgr.14373) 3434 : audit [DBG] from='client.85272 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:56:26.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:56:26 smithi086 bash[24289]: cluster 2024-09-16T06:56:24.996240+0000 mgr.a (mgr.14373) 3435 : cluster [DBG] pgmap v2381: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:56:26.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:56:26 smithi047 bash[22744]: audit 2024-09-16T06:56:24.389791+0000 mgr.a (mgr.14373) 3434 : audit [DBG] from='client.85272 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:56:26.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:56:26 smithi047 bash[22744]: cluster 2024-09-16T06:56:24.996240+0000 mgr.a (mgr.14373) 3435 : cluster [DBG] pgmap v2381: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:56:27.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:56:27 smithi157 bash[24585]: cluster 2024-09-16T06:56:26.998392+0000 mgr.a (mgr.14373) 3436 : cluster [DBG] pgmap v2382: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:56:27.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:56:27 smithi086 bash[24289]: cluster 2024-09-16T06:56:26.998392+0000 mgr.a (mgr.14373) 3436 : cluster [DBG] pgmap v2382: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:56:27.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:56:27 smithi047 bash[22744]: cluster 2024-09-16T06:56:26.998392+0000 mgr.a (mgr.14373) 3436 : cluster [DBG] pgmap v2382: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:56:29.817 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:56:29.818 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:56:29.818 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:56:30.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:56:30 smithi086 bash[24289]: cluster 2024-09-16T06:56:28.999092+0000 mgr.a (mgr.14373) 3437 : cluster [DBG] pgmap v2383: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:56:30.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:56:30 smithi047 bash[22744]: cluster 2024-09-16T06:56:28.999092+0000 mgr.a (mgr.14373) 3437 : cluster [DBG] pgmap v2383: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:56:30.553 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:56:30.554 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:56:30.554 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:56:30.554 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:56:30.554 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:56:30.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:56:30 smithi157 bash[24585]: cluster 2024-09-16T06:56:28.999092+0000 mgr.a (mgr.14373) 3437 : cluster [DBG] pgmap v2383: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:56:31.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:56:31 smithi086 bash[24289]: audit 2024-09-16T06:56:30.151218+0000 mgr.a (mgr.14373) 3438 : audit [DBG] from='client.85347 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:56:31.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:56:31 smithi047 bash[22744]: audit 2024-09-16T06:56:30.151218+0000 mgr.a (mgr.14373) 3438 : audit [DBG] from='client.85347 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:56:31.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:56:31 smithi157 bash[24585]: audit 2024-09-16T06:56:30.151218+0000 mgr.a (mgr.14373) 3438 : audit [DBG] from='client.85347 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:56:32.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:56:32 smithi086 bash[24289]: cluster 2024-09-16T06:56:31.000208+0000 mgr.a (mgr.14373) 3439 : cluster [DBG] pgmap v2384: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:56:32.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:56:32 smithi047 bash[22744]: cluster 2024-09-16T06:56:31.000208+0000 mgr.a (mgr.14373) 3439 : cluster [DBG] pgmap v2384: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:56:32.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:56:32 smithi157 bash[24585]: cluster 2024-09-16T06:56:31.000208+0000 mgr.a (mgr.14373) 3439 : cluster [DBG] pgmap v2384: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:56:34.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:56:34 smithi047 bash[22744]: cluster 2024-09-16T06:56:33.002618+0000 mgr.a (mgr.14373) 3440 : cluster [DBG] pgmap v2385: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:56:34.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:56:34 smithi157 bash[24585]: cluster 2024-09-16T06:56:33.002618+0000 mgr.a (mgr.14373) 3440 : cluster [DBG] pgmap v2385: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:56:34.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:56:34 smithi086 bash[24289]: cluster 2024-09-16T06:56:33.002618+0000 mgr.a (mgr.14373) 3440 : cluster [DBG] pgmap v2385: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:56:35.555 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:56:35.556 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:56:35.556 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:56:36.338 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:56:36.338 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:56:36.338 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:56:36.338 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:56:36.338 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:56:36.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:56:36 smithi047 bash[22744]: cluster 2024-09-16T06:56:35.003427+0000 mgr.a (mgr.14373) 3441 : cluster [DBG] pgmap v2386: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:56:36.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:56:36 smithi157 bash[24585]: cluster 2024-09-16T06:56:35.003427+0000 mgr.a (mgr.14373) 3441 : cluster [DBG] pgmap v2386: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:56:36.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:56:36 smithi086 bash[24289]: cluster 2024-09-16T06:56:35.003427+0000 mgr.a (mgr.14373) 3441 : cluster [DBG] pgmap v2386: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:56:37.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:56:37 smithi047 bash[22744]: audit 2024-09-16T06:56:35.895304+0000 mgr.a (mgr.14373) 3442 : audit [DBG] from='client.85425 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:56:37.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:56:37 smithi157 bash[24585]: audit 2024-09-16T06:56:35.895304+0000 mgr.a (mgr.14373) 3442 : audit [DBG] from='client.85425 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:56:37.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:56:37 smithi086 bash[24289]: audit 2024-09-16T06:56:35.895304+0000 mgr.a (mgr.14373) 3442 : audit [DBG] from='client.85425 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:56:38.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:56:38 smithi047 bash[22744]: cluster 2024-09-16T06:56:37.005771+0000 mgr.a (mgr.14373) 3443 : cluster [DBG] pgmap v2387: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:56:38.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:56:38 smithi157 bash[24585]: cluster 2024-09-16T06:56:37.005771+0000 mgr.a (mgr.14373) 3443 : cluster [DBG] pgmap v2387: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:56:38.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:56:38 smithi086 bash[24289]: cluster 2024-09-16T06:56:37.005771+0000 mgr.a (mgr.14373) 3443 : cluster [DBG] pgmap v2387: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:56:40.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:56:40 smithi047 bash[22744]: cluster 2024-09-16T06:56:39.006567+0000 mgr.a (mgr.14373) 3444 : cluster [DBG] pgmap v2388: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:56:40.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:56:40 smithi157 bash[24585]: cluster 2024-09-16T06:56:39.006567+0000 mgr.a (mgr.14373) 3444 : cluster [DBG] pgmap v2388: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:56:40.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:56:40 smithi086 bash[24289]: cluster 2024-09-16T06:56:39.006567+0000 mgr.a (mgr.14373) 3444 : cluster [DBG] pgmap v2388: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:56:41.339 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:56:41.340 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:56:41.340 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:56:42.093 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:56:42.093 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:56:42.093 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:56:42.093 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:56:42.094 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:56:42.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:56:42 smithi157 bash[24585]: cluster 2024-09-16T06:56:41.007350+0000 mgr.a (mgr.14373) 3445 : cluster [DBG] pgmap v2389: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:56:42.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:56:42 smithi086 bash[24289]: cluster 2024-09-16T06:56:41.007350+0000 mgr.a (mgr.14373) 3445 : cluster [DBG] pgmap v2389: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:56:42.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:56:42 smithi047 bash[22744]: cluster 2024-09-16T06:56:41.007350+0000 mgr.a (mgr.14373) 3445 : cluster [DBG] pgmap v2389: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:56:43.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:56:43 smithi157 bash[24585]: audit 2024-09-16T06:56:41.677425+0000 mgr.a (mgr.14373) 3446 : audit [DBG] from='client.85497 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:56:43.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:56:43 smithi086 bash[24289]: audit 2024-09-16T06:56:41.677425+0000 mgr.a (mgr.14373) 3446 : audit [DBG] from='client.85497 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:56:43.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:56:43 smithi047 bash[22744]: audit 2024-09-16T06:56:41.677425+0000 mgr.a (mgr.14373) 3446 : audit [DBG] from='client.85497 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:56:44.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:56:44 smithi157 bash[24585]: cluster 2024-09-16T06:56:43.010061+0000 mgr.a (mgr.14373) 3447 : cluster [DBG] pgmap v2390: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:56:44.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:56:44 smithi086 bash[24289]: cluster 2024-09-16T06:56:43.010061+0000 mgr.a (mgr.14373) 3447 : cluster [DBG] pgmap v2390: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:56:44.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:56:44 smithi047 bash[22744]: cluster 2024-09-16T06:56:43.010061+0000 mgr.a (mgr.14373) 3447 : cluster [DBG] pgmap v2390: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:56:46.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:56:46 smithi157 bash[24585]: cluster 2024-09-16T06:56:45.010868+0000 mgr.a (mgr.14373) 3448 : cluster [DBG] pgmap v2391: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:56:46.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:56:46 smithi086 bash[24289]: cluster 2024-09-16T06:56:45.010868+0000 mgr.a (mgr.14373) 3448 : cluster [DBG] pgmap v2391: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:56:46.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:56:46 smithi047 bash[22744]: cluster 2024-09-16T06:56:45.010868+0000 mgr.a (mgr.14373) 3448 : cluster [DBG] pgmap v2391: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:56:47.095 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:56:47.096 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:56:47.096 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:56:47.850 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:56:47.850 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:56:47.850 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:56:47.850 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:56:47.850 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:56:48.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:56:48 smithi157 bash[24585]: cluster 2024-09-16T06:56:47.012862+0000 mgr.a (mgr.14373) 3449 : cluster [DBG] pgmap v2392: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:56:48.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:56:48 smithi086 bash[24289]: cluster 2024-09-16T06:56:47.012862+0000 mgr.a (mgr.14373) 3449 : cluster [DBG] pgmap v2392: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:56:48.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:56:48 smithi047 bash[22744]: cluster 2024-09-16T06:56:47.012862+0000 mgr.a (mgr.14373) 3449 : cluster [DBG] pgmap v2392: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:56:49.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:56:49 smithi157 bash[24585]: audit 2024-09-16T06:56:47.427096+0000 mgr.a (mgr.14373) 3450 : audit [DBG] from='client.85572 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:56:49.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:56:49 smithi086 bash[24289]: audit 2024-09-16T06:56:47.427096+0000 mgr.a (mgr.14373) 3450 : audit [DBG] from='client.85572 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:56:49.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:56:49 smithi047 bash[22744]: audit 2024-09-16T06:56:47.427096+0000 mgr.a (mgr.14373) 3450 : audit [DBG] from='client.85572 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:56:50.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:56:50 smithi157 bash[24585]: cluster 2024-09-16T06:56:49.013878+0000 mgr.a (mgr.14373) 3451 : cluster [DBG] pgmap v2393: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:56:50.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:56:50 smithi086 bash[24289]: cluster 2024-09-16T06:56:49.013878+0000 mgr.a (mgr.14373) 3451 : cluster [DBG] pgmap v2393: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:56:50.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:56:50 smithi047 bash[22744]: cluster 2024-09-16T06:56:49.013878+0000 mgr.a (mgr.14373) 3451 : cluster [DBG] pgmap v2393: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:56:52.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:56:52 smithi157 bash[24585]: cluster 2024-09-16T06:56:51.014685+0000 mgr.a (mgr.14373) 3452 : cluster [DBG] pgmap v2394: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T06:56:52.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:56:52 smithi086 bash[24289]: cluster 2024-09-16T06:56:51.014685+0000 mgr.a (mgr.14373) 3452 : cluster [DBG] pgmap v2394: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T06:56:52.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:56:52 smithi047 bash[22744]: cluster 2024-09-16T06:56:51.014685+0000 mgr.a (mgr.14373) 3452 : cluster [DBG] pgmap v2394: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T06:56:52.851 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:56:52.852 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:56:52.852 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:56:53.642 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:56:53.642 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:56:53.643 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:56:53.643 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:56:53.643 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:56:54.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:56:54 smithi157 bash[24585]: cluster 2024-09-16T06:56:53.016600+0000 mgr.a (mgr.14373) 3453 : cluster [DBG] pgmap v2395: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:56:54.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:56:54 smithi157 bash[24585]: audit 2024-09-16T06:56:53.194297+0000 mgr.a (mgr.14373) 3454 : audit [DBG] from='client.85647 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:56:54.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:56:54 smithi157 bash[24585]: audit 2024-09-16T06:56:54.073755+0000 mon.b (mon.2) 354 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T06:56:54.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:56:54 smithi086 bash[24289]: cluster 2024-09-16T06:56:53.016600+0000 mgr.a (mgr.14373) 3453 : cluster [DBG] pgmap v2395: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:56:54.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:56:54 smithi086 bash[24289]: audit 2024-09-16T06:56:53.194297+0000 mgr.a (mgr.14373) 3454 : audit [DBG] from='client.85647 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:56:54.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:56:54 smithi086 bash[24289]: audit 2024-09-16T06:56:54.073755+0000 mon.b (mon.2) 354 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T06:56:54.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:56:54 smithi047 bash[22744]: cluster 2024-09-16T06:56:53.016600+0000 mgr.a (mgr.14373) 3453 : cluster [DBG] pgmap v2395: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:56:54.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:56:54 smithi047 bash[22744]: audit 2024-09-16T06:56:53.194297+0000 mgr.a (mgr.14373) 3454 : audit [DBG] from='client.85647 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:56:54.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:56:54 smithi047 bash[22744]: audit 2024-09-16T06:56:54.073755+0000 mon.b (mon.2) 354 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T06:56:56.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:56:55 smithi157 bash[24585]: audit 2024-09-16T06:56:54.678150+0000 mon.a (mon.0) 772 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:56:56.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:56:55 smithi157 bash[24585]: audit 2024-09-16T06:56:54.685113+0000 mon.a (mon.0) 773 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:56:56.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:56:55 smithi157 bash[24585]: audit 2024-09-16T06:56:54.690508+0000 mon.a (mon.0) 774 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:56:56.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:56:55 smithi157 bash[24585]: audit 2024-09-16T06:56:54.695889+0000 mon.a (mon.0) 775 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:56:56.055 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:56:55 smithi157 bash[24585]: cluster 2024-09-16T06:56:55.017454+0000 mgr.a (mgr.14373) 3455 : cluster [DBG] pgmap v2396: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:56:56.055 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:56:55 smithi157 bash[24585]: audit 2024-09-16T06:56:55.353987+0000 mon.b (mon.2) 355 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T06:56:56.055 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:56:55 smithi157 bash[24585]: audit 2024-09-16T06:56:55.356200+0000 mon.b (mon.2) 356 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T06:56:56.055 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:56:55 smithi157 bash[24585]: audit 2024-09-16T06:56:55.366947+0000 mon.a (mon.0) 776 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:56:56.055 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:56:55 smithi157 bash[24585]: audit 2024-09-16T06:56:55.370296+0000 mon.b (mon.2) 357 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:56:56.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:56:55 smithi086 bash[24289]: audit 2024-09-16T06:56:54.678150+0000 mon.a (mon.0) 772 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:56:56.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:56:55 smithi086 bash[24289]: audit 2024-09-16T06:56:54.685113+0000 mon.a (mon.0) 773 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:56:56.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:56:55 smithi086 bash[24289]: audit 2024-09-16T06:56:54.690508+0000 mon.a (mon.0) 774 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:56:56.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:56:55 smithi086 bash[24289]: audit 2024-09-16T06:56:54.695889+0000 mon.a (mon.0) 775 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:56:56.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:56:55 smithi086 bash[24289]: cluster 2024-09-16T06:56:55.017454+0000 mgr.a (mgr.14373) 3455 : cluster [DBG] pgmap v2396: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:56:56.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:56:55 smithi086 bash[24289]: audit 2024-09-16T06:56:55.353987+0000 mon.b (mon.2) 355 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T06:56:56.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:56:55 smithi086 bash[24289]: audit 2024-09-16T06:56:55.356200+0000 mon.b (mon.2) 356 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T06:56:56.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:56:55 smithi086 bash[24289]: audit 2024-09-16T06:56:55.366947+0000 mon.a (mon.0) 776 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:56:56.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:56:55 smithi086 bash[24289]: audit 2024-09-16T06:56:55.370296+0000 mon.b (mon.2) 357 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:56:56.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:56:55 smithi047 bash[22744]: audit 2024-09-16T06:56:54.678150+0000 mon.a (mon.0) 772 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:56:56.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:56:55 smithi047 bash[22744]: audit 2024-09-16T06:56:54.685113+0000 mon.a (mon.0) 773 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:56:56.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:56:55 smithi047 bash[22744]: audit 2024-09-16T06:56:54.690508+0000 mon.a (mon.0) 774 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:56:56.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:56:55 smithi047 bash[22744]: audit 2024-09-16T06:56:54.695889+0000 mon.a (mon.0) 775 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:56:56.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:56:55 smithi047 bash[22744]: cluster 2024-09-16T06:56:55.017454+0000 mgr.a (mgr.14373) 3455 : cluster [DBG] pgmap v2396: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:56:56.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:56:55 smithi047 bash[22744]: audit 2024-09-16T06:56:55.353987+0000 mon.b (mon.2) 355 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T06:56:56.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:56:55 smithi047 bash[22744]: audit 2024-09-16T06:56:55.356200+0000 mon.b (mon.2) 356 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T06:56:56.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:56:55 smithi047 bash[22744]: audit 2024-09-16T06:56:55.366947+0000 mon.a (mon.0) 776 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:56:56.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:56:55 smithi047 bash[22744]: audit 2024-09-16T06:56:55.370296+0000 mon.b (mon.2) 357 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:56:56.588 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 06:56:56 smithi047 bash[22994]: debug 2024-09-16T06:56:56.100+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T06:56:56.589 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 06:56:56 smithi047 bash[22994]: debug 2024-09-16T06:56:56.100+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T06:56:57.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:56:56 smithi157 bash[24585]: audit 2024-09-16T06:56:55.374871+0000 mgr.a (mgr.14373) 3456 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:56:57.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:56:56 smithi157 bash[24585]: audit 2024-09-16T06:56:56.103674+0000 mgr.a (mgr.14373) 3457 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T06:56:57.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:56:56 smithi157 bash[24585]: cephadm 2024-09-16T06:56:56.105761+0000 mgr.a (mgr.14373) 3458 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T06:56:57.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:56:56 smithi086 bash[24289]: audit 2024-09-16T06:56:55.374871+0000 mgr.a (mgr.14373) 3456 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:56:57.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:56:56 smithi086 bash[24289]: audit 2024-09-16T06:56:56.103674+0000 mgr.a (mgr.14373) 3457 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T06:56:57.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:56:56 smithi086 bash[24289]: cephadm 2024-09-16T06:56:56.105761+0000 mgr.a (mgr.14373) 3458 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T06:56:57.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:56:56 smithi047 bash[22744]: audit 2024-09-16T06:56:55.374871+0000 mgr.a (mgr.14373) 3456 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:56:57.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:56:56 smithi047 bash[22744]: audit 2024-09-16T06:56:56.103674+0000 mgr.a (mgr.14373) 3457 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T06:56:57.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:56:56 smithi047 bash[22744]: cephadm 2024-09-16T06:56:56.105761+0000 mgr.a (mgr.14373) 3458 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T06:56:58.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:56:57 smithi157 bash[24585]: cluster 2024-09-16T06:56:57.019909+0000 mgr.a (mgr.14373) 3459 : cluster [DBG] pgmap v2397: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:56:58.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:56:57 smithi086 bash[24289]: cluster 2024-09-16T06:56:57.019909+0000 mgr.a (mgr.14373) 3459 : cluster [DBG] pgmap v2397: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:56:58.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:56:57 smithi047 bash[22744]: cluster 2024-09-16T06:56:57.019909+0000 mgr.a (mgr.14373) 3459 : cluster [DBG] pgmap v2397: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:56:58.644 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:56:58.644 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:56:58.645 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:56:59.381 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:56:59.381 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:56:59.382 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:56:59.382 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:56:59.382 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:57:00.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:57:00 smithi047 bash[22744]: audit 2024-09-16T06:56:58.978250+0000 mgr.a (mgr.14373) 3460 : audit [DBG] from='client.85833 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:57:00.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:57:00 smithi047 bash[22744]: cluster 2024-09-16T06:56:59.020898+0000 mgr.a (mgr.14373) 3461 : cluster [DBG] pgmap v2398: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:57:00.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:57:00 smithi157 bash[24585]: audit 2024-09-16T06:56:58.978250+0000 mgr.a (mgr.14373) 3460 : audit [DBG] from='client.85833 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:57:00.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:57:00 smithi157 bash[24585]: cluster 2024-09-16T06:56:59.020898+0000 mgr.a (mgr.14373) 3461 : cluster [DBG] pgmap v2398: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:57:00.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:57:00 smithi086 bash[24289]: audit 2024-09-16T06:56:58.978250+0000 mgr.a (mgr.14373) 3460 : audit [DBG] from='client.85833 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:57:00.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:57:00 smithi086 bash[24289]: cluster 2024-09-16T06:56:59.020898+0000 mgr.a (mgr.14373) 3461 : cluster [DBG] pgmap v2398: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:57:02.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:57:02 smithi047 bash[22744]: cluster 2024-09-16T06:57:01.021835+0000 mgr.a (mgr.14373) 3462 : cluster [DBG] pgmap v2399: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:57:02.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:57:02 smithi157 bash[24585]: cluster 2024-09-16T06:57:01.021835+0000 mgr.a (mgr.14373) 3462 : cluster [DBG] pgmap v2399: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:57:02.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:57:02 smithi086 bash[24289]: cluster 2024-09-16T06:57:01.021835+0000 mgr.a (mgr.14373) 3462 : cluster [DBG] pgmap v2399: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:57:04.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:57:04 smithi047 bash[22744]: cluster 2024-09-16T06:57:03.024141+0000 mgr.a (mgr.14373) 3463 : cluster [DBG] pgmap v2400: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:57:04.382 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:57:04.383 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:57:04.383 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:57:04.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:57:04 smithi157 bash[24585]: cluster 2024-09-16T06:57:03.024141+0000 mgr.a (mgr.14373) 3463 : cluster [DBG] pgmap v2400: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:57:04.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:57:04 smithi086 bash[24289]: cluster 2024-09-16T06:57:03.024141+0000 mgr.a (mgr.14373) 3463 : cluster [DBG] pgmap v2400: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:57:05.137 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:57:05.137 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:57:05.137 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:57:05.137 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:57:05.137 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:57:06.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:57:06 smithi047 bash[22744]: audit 2024-09-16T06:57:04.713995+0000 mgr.a (mgr.14373) 3464 : audit [DBG] from='client.85908 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:57:06.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:57:06 smithi047 bash[22744]: cluster 2024-09-16T06:57:05.024761+0000 mgr.a (mgr.14373) 3465 : cluster [DBG] pgmap v2401: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:57:06.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:57:06 smithi157 bash[24585]: audit 2024-09-16T06:57:04.713995+0000 mgr.a (mgr.14373) 3464 : audit [DBG] from='client.85908 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:57:06.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:57:06 smithi157 bash[24585]: cluster 2024-09-16T06:57:05.024761+0000 mgr.a (mgr.14373) 3465 : cluster [DBG] pgmap v2401: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:57:06.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:57:06 smithi086 bash[24289]: audit 2024-09-16T06:57:04.713995+0000 mgr.a (mgr.14373) 3464 : audit [DBG] from='client.85908 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:57:06.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:57:06 smithi086 bash[24289]: cluster 2024-09-16T06:57:05.024761+0000 mgr.a (mgr.14373) 3465 : cluster [DBG] pgmap v2401: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:57:08.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:57:08 smithi157 bash[24585]: cluster 2024-09-16T06:57:07.027050+0000 mgr.a (mgr.14373) 3466 : cluster [DBG] pgmap v2402: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:57:08.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:57:08 smithi086 bash[24289]: cluster 2024-09-16T06:57:07.027050+0000 mgr.a (mgr.14373) 3466 : cluster [DBG] pgmap v2402: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:57:08.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:57:08 smithi047 bash[22744]: cluster 2024-09-16T06:57:07.027050+0000 mgr.a (mgr.14373) 3466 : cluster [DBG] pgmap v2402: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:57:10.138 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:57:10.139 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:57:10.139 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:57:10.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:57:10 smithi157 bash[24585]: cluster 2024-09-16T06:57:09.027817+0000 mgr.a (mgr.14373) 3467 : cluster [DBG] pgmap v2403: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:57:10.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:57:10 smithi086 bash[24289]: cluster 2024-09-16T06:57:09.027817+0000 mgr.a (mgr.14373) 3467 : cluster [DBG] pgmap v2403: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:57:10.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:57:10 smithi047 bash[22744]: cluster 2024-09-16T06:57:09.027817+0000 mgr.a (mgr.14373) 3467 : cluster [DBG] pgmap v2403: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:57:10.878 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:57:10.878 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:57:10.878 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:57:10.878 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:57:10.878 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:57:12.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:57:12 smithi157 bash[24585]: audit 2024-09-16T06:57:10.471696+0000 mgr.a (mgr.14373) 3468 : audit [DBG] from='client.85983 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:57:12.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:57:12 smithi157 bash[24585]: cluster 2024-09-16T06:57:11.028780+0000 mgr.a (mgr.14373) 3469 : cluster [DBG] pgmap v2404: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:57:12.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:57:12 smithi086 bash[24289]: audit 2024-09-16T06:57:10.471696+0000 mgr.a (mgr.14373) 3468 : audit [DBG] from='client.85983 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:57:12.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:57:12 smithi086 bash[24289]: cluster 2024-09-16T06:57:11.028780+0000 mgr.a (mgr.14373) 3469 : cluster [DBG] pgmap v2404: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:57:12.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:57:12 smithi047 bash[22744]: audit 2024-09-16T06:57:10.471696+0000 mgr.a (mgr.14373) 3468 : audit [DBG] from='client.85983 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:57:12.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:57:12 smithi047 bash[22744]: cluster 2024-09-16T06:57:11.028780+0000 mgr.a (mgr.14373) 3469 : cluster [DBG] pgmap v2404: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:57:14.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:57:14 smithi157 bash[24585]: cluster 2024-09-16T06:57:13.031047+0000 mgr.a (mgr.14373) 3470 : cluster [DBG] pgmap v2405: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:57:14.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:57:14 smithi086 bash[24289]: cluster 2024-09-16T06:57:13.031047+0000 mgr.a (mgr.14373) 3470 : cluster [DBG] pgmap v2405: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:57:14.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:57:14 smithi047 bash[22744]: cluster 2024-09-16T06:57:13.031047+0000 mgr.a (mgr.14373) 3470 : cluster [DBG] pgmap v2405: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:57:15.879 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:57:15.880 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:57:15.880 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:57:16.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:57:16 smithi157 bash[24585]: cluster 2024-09-16T06:57:15.031810+0000 mgr.a (mgr.14373) 3471 : cluster [DBG] pgmap v2406: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:57:16.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:57:16 smithi086 bash[24289]: cluster 2024-09-16T06:57:15.031810+0000 mgr.a (mgr.14373) 3471 : cluster [DBG] pgmap v2406: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:57:16.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:57:16 smithi047 bash[22744]: cluster 2024-09-16T06:57:15.031810+0000 mgr.a (mgr.14373) 3471 : cluster [DBG] pgmap v2406: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:57:16.643 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:57:16.643 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:57:16.644 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:57:16.644 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:57:16.644 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:57:17.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:57:17 smithi157 bash[24585]: audit 2024-09-16T06:57:16.216943+0000 mgr.a (mgr.14373) 3472 : audit [DBG] from='client.86061 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:57:17.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:57:17 smithi086 bash[24289]: audit 2024-09-16T06:57:16.216943+0000 mgr.a (mgr.14373) 3472 : audit [DBG] from='client.86061 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:57:17.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:57:17 smithi047 bash[22744]: audit 2024-09-16T06:57:16.216943+0000 mgr.a (mgr.14373) 3472 : audit [DBG] from='client.86061 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:57:18.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:57:18 smithi157 bash[24585]: cluster 2024-09-16T06:57:17.034750+0000 mgr.a (mgr.14373) 3473 : cluster [DBG] pgmap v2407: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:57:18.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:57:18 smithi086 bash[24289]: cluster 2024-09-16T06:57:17.034750+0000 mgr.a (mgr.14373) 3473 : cluster [DBG] pgmap v2407: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:57:18.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:57:18 smithi047 bash[22744]: cluster 2024-09-16T06:57:17.034750+0000 mgr.a (mgr.14373) 3473 : cluster [DBG] pgmap v2407: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:57:20.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:57:20 smithi157 bash[24585]: cluster 2024-09-16T06:57:19.035572+0000 mgr.a (mgr.14373) 3474 : cluster [DBG] pgmap v2408: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:57:20.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:57:20 smithi086 bash[24289]: cluster 2024-09-16T06:57:19.035572+0000 mgr.a (mgr.14373) 3474 : cluster [DBG] pgmap v2408: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:57:20.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:57:20 smithi047 bash[22744]: cluster 2024-09-16T06:57:19.035572+0000 mgr.a (mgr.14373) 3474 : cluster [DBG] pgmap v2408: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:57:21.645 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:57:21.645 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:57:21.645 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:57:22.390 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:57:22.390 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:57:22.391 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:57:22.391 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:57:22.391 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:57:22.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:57:22 smithi157 bash[24585]: cluster 2024-09-16T06:57:21.036319+0000 mgr.a (mgr.14373) 3475 : cluster [DBG] pgmap v2409: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T06:57:22.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:57:22 smithi086 bash[24289]: cluster 2024-09-16T06:57:21.036319+0000 mgr.a (mgr.14373) 3475 : cluster [DBG] pgmap v2409: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T06:57:22.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:57:22 smithi047 bash[22744]: cluster 2024-09-16T06:57:21.036319+0000 mgr.a (mgr.14373) 3475 : cluster [DBG] pgmap v2409: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T06:57:23.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:57:23 smithi157 bash[24585]: audit 2024-09-16T06:57:21.980442+0000 mgr.a (mgr.14373) 3476 : audit [DBG] from='client.86139 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:57:23.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:57:23 smithi086 bash[24289]: audit 2024-09-16T06:57:21.980442+0000 mgr.a (mgr.14373) 3476 : audit [DBG] from='client.86139 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:57:23.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:57:23 smithi047 bash[22744]: audit 2024-09-16T06:57:21.980442+0000 mgr.a (mgr.14373) 3476 : audit [DBG] from='client.86139 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:57:24.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:57:24 smithi157 bash[24585]: cluster 2024-09-16T06:57:23.039158+0000 mgr.a (mgr.14373) 3477 : cluster [DBG] pgmap v2410: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:57:24.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:57:24 smithi086 bash[24289]: cluster 2024-09-16T06:57:23.039158+0000 mgr.a (mgr.14373) 3477 : cluster [DBG] pgmap v2410: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:57:24.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:57:24 smithi047 bash[22744]: cluster 2024-09-16T06:57:23.039158+0000 mgr.a (mgr.14373) 3477 : cluster [DBG] pgmap v2410: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:57:26.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:57:26 smithi157 bash[24585]: cluster 2024-09-16T06:57:25.039941+0000 mgr.a (mgr.14373) 3478 : cluster [DBG] pgmap v2411: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:57:26.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:57:26 smithi086 bash[24289]: cluster 2024-09-16T06:57:25.039941+0000 mgr.a (mgr.14373) 3478 : cluster [DBG] pgmap v2411: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:57:26.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:57:26 smithi047 bash[22744]: cluster 2024-09-16T06:57:25.039941+0000 mgr.a (mgr.14373) 3478 : cluster [DBG] pgmap v2411: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:57:27.392 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:57:27.393 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:57:27.393 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:57:28.150 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:57:28.150 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:57:28.150 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:57:28.150 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:57:28.150 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:57:28.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:57:28 smithi157 bash[24585]: cluster 2024-09-16T06:57:27.041911+0000 mgr.a (mgr.14373) 3479 : cluster [DBG] pgmap v2412: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:57:28.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:57:28 smithi086 bash[24289]: cluster 2024-09-16T06:57:27.041911+0000 mgr.a (mgr.14373) 3479 : cluster [DBG] pgmap v2412: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:57:28.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:57:28 smithi047 bash[22744]: cluster 2024-09-16T06:57:27.041911+0000 mgr.a (mgr.14373) 3479 : cluster [DBG] pgmap v2412: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:57:29.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:57:29 smithi157 bash[24585]: audit 2024-09-16T06:57:27.731521+0000 mgr.a (mgr.14373) 3480 : audit [DBG] from='client.86208 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:57:29.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:57:29 smithi086 bash[24289]: audit 2024-09-16T06:57:27.731521+0000 mgr.a (mgr.14373) 3480 : audit [DBG] from='client.86208 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:57:29.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:57:29 smithi047 bash[22744]: audit 2024-09-16T06:57:27.731521+0000 mgr.a (mgr.14373) 3480 : audit [DBG] from='client.86208 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:57:30.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:57:30 smithi157 bash[24585]: cluster 2024-09-16T06:57:29.042875+0000 mgr.a (mgr.14373) 3481 : cluster [DBG] pgmap v2413: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:57:30.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:57:30 smithi086 bash[24289]: cluster 2024-09-16T06:57:29.042875+0000 mgr.a (mgr.14373) 3481 : cluster [DBG] pgmap v2413: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:57:30.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:57:30 smithi047 bash[22744]: cluster 2024-09-16T06:57:29.042875+0000 mgr.a (mgr.14373) 3481 : cluster [DBG] pgmap v2413: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:57:32.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:57:32 smithi157 bash[24585]: cluster 2024-09-16T06:57:31.043640+0000 mgr.a (mgr.14373) 3482 : cluster [DBG] pgmap v2414: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:57:32.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:57:32 smithi086 bash[24289]: cluster 2024-09-16T06:57:31.043640+0000 mgr.a (mgr.14373) 3482 : cluster [DBG] pgmap v2414: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:57:32.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:57:32 smithi047 bash[22744]: cluster 2024-09-16T06:57:31.043640+0000 mgr.a (mgr.14373) 3482 : cluster [DBG] pgmap v2414: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:57:33.151 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:57:33.152 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:57:33.152 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:57:33.939 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:57:33.939 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:57:33.939 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:57:33.939 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:57:33.939 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:57:34.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:57:34 smithi157 bash[24585]: cluster 2024-09-16T06:57:33.045865+0000 mgr.a (mgr.14373) 3483 : cluster [DBG] pgmap v2415: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:57:34.601 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:57:34 smithi047 bash[22744]: cluster 2024-09-16T06:57:33.045865+0000 mgr.a (mgr.14373) 3483 : cluster [DBG] pgmap v2415: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:57:34.601 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:57:34 smithi086 bash[24289]: cluster 2024-09-16T06:57:33.045865+0000 mgr.a (mgr.14373) 3483 : cluster [DBG] pgmap v2415: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:57:35.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:57:35 smithi157 bash[24585]: audit 2024-09-16T06:57:33.496139+0000 mgr.a (mgr.14373) 3484 : audit [DBG] from='client.86286 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:57:35.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:57:35 smithi086 bash[24289]: audit 2024-09-16T06:57:33.496139+0000 mgr.a (mgr.14373) 3484 : audit [DBG] from='client.86286 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:57:35.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:57:35 smithi047 bash[22744]: audit 2024-09-16T06:57:33.496139+0000 mgr.a (mgr.14373) 3484 : audit [DBG] from='client.86286 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:57:36.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:57:36 smithi157 bash[24585]: cluster 2024-09-16T06:57:35.046780+0000 mgr.a (mgr.14373) 3485 : cluster [DBG] pgmap v2416: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:57:36.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:57:36 smithi086 bash[24289]: cluster 2024-09-16T06:57:35.046780+0000 mgr.a (mgr.14373) 3485 : cluster [DBG] pgmap v2416: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:57:36.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:57:36 smithi047 bash[22744]: cluster 2024-09-16T06:57:35.046780+0000 mgr.a (mgr.14373) 3485 : cluster [DBG] pgmap v2416: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:57:38.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:57:38 smithi157 bash[24585]: cluster 2024-09-16T06:57:37.048972+0000 mgr.a (mgr.14373) 3486 : cluster [DBG] pgmap v2417: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:57:38.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:57:38 smithi086 bash[24289]: cluster 2024-09-16T06:57:37.048972+0000 mgr.a (mgr.14373) 3486 : cluster [DBG] pgmap v2417: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:57:38.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:57:38 smithi047 bash[22744]: cluster 2024-09-16T06:57:37.048972+0000 mgr.a (mgr.14373) 3486 : cluster [DBG] pgmap v2417: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:57:38.941 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:57:38.941 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:57:38.941 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:57:39.701 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:57:39.701 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:57:39.701 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:57:39.701 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:57:39.702 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:57:40.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:57:40 smithi157 bash[24585]: cluster 2024-09-16T06:57:39.049414+0000 mgr.a (mgr.14373) 3487 : cluster [DBG] pgmap v2418: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:57:40.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:57:40 smithi157 bash[24585]: audit 2024-09-16T06:57:39.279066+0000 mgr.a (mgr.14373) 3488 : audit [DBG] from='client.86364 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:57:40.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:57:40 smithi086 bash[24289]: cluster 2024-09-16T06:57:39.049414+0000 mgr.a (mgr.14373) 3487 : cluster [DBG] pgmap v2418: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:57:40.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:57:40 smithi086 bash[24289]: audit 2024-09-16T06:57:39.279066+0000 mgr.a (mgr.14373) 3488 : audit [DBG] from='client.86364 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:57:40.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:57:40 smithi047 bash[22744]: cluster 2024-09-16T06:57:39.049414+0000 mgr.a (mgr.14373) 3487 : cluster [DBG] pgmap v2418: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:57:40.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:57:40 smithi047 bash[22744]: audit 2024-09-16T06:57:39.279066+0000 mgr.a (mgr.14373) 3488 : audit [DBG] from='client.86364 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:57:42.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:57:42 smithi157 bash[24585]: cluster 2024-09-16T06:57:41.050202+0000 mgr.a (mgr.14373) 3489 : cluster [DBG] pgmap v2419: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:57:42.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:57:42 smithi086 bash[24289]: cluster 2024-09-16T06:57:41.050202+0000 mgr.a (mgr.14373) 3489 : cluster [DBG] pgmap v2419: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:57:42.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:57:42 smithi047 bash[22744]: cluster 2024-09-16T06:57:41.050202+0000 mgr.a (mgr.14373) 3489 : cluster [DBG] pgmap v2419: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:57:44.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:57:44 smithi157 bash[24585]: cluster 2024-09-16T06:57:43.052363+0000 mgr.a (mgr.14373) 3490 : cluster [DBG] pgmap v2420: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:57:44.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:57:44 smithi086 bash[24289]: cluster 2024-09-16T06:57:43.052363+0000 mgr.a (mgr.14373) 3490 : cluster [DBG] pgmap v2420: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:57:44.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:57:44 smithi047 bash[22744]: cluster 2024-09-16T06:57:43.052363+0000 mgr.a (mgr.14373) 3490 : cluster [DBG] pgmap v2420: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:57:44.703 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:57:44.703 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:57:44.703 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:57:45.453 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:57:45.454 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:57:45.454 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:57:45.454 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:57:45.454 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:57:46.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:57:46 smithi157 bash[24585]: audit 2024-09-16T06:57:45.037057+0000 mgr.a (mgr.14373) 3491 : audit [DBG] from='client.86436 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:57:46.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:57:46 smithi157 bash[24585]: cluster 2024-09-16T06:57:45.053542+0000 mgr.a (mgr.14373) 3492 : cluster [DBG] pgmap v2421: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:57:46.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:57:46 smithi086 bash[24289]: audit 2024-09-16T06:57:45.037057+0000 mgr.a (mgr.14373) 3491 : audit [DBG] from='client.86436 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:57:46.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:57:46 smithi086 bash[24289]: cluster 2024-09-16T06:57:45.053542+0000 mgr.a (mgr.14373) 3492 : cluster [DBG] pgmap v2421: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:57:46.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:57:46 smithi047 bash[22744]: audit 2024-09-16T06:57:45.037057+0000 mgr.a (mgr.14373) 3491 : audit [DBG] from='client.86436 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:57:46.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:57:46 smithi047 bash[22744]: cluster 2024-09-16T06:57:45.053542+0000 mgr.a (mgr.14373) 3492 : cluster [DBG] pgmap v2421: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:57:48.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:57:48 smithi157 bash[24585]: cluster 2024-09-16T06:57:47.055939+0000 mgr.a (mgr.14373) 3493 : cluster [DBG] pgmap v2422: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:57:48.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:57:48 smithi086 bash[24289]: cluster 2024-09-16T06:57:47.055939+0000 mgr.a (mgr.14373) 3493 : cluster [DBG] pgmap v2422: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:57:48.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:57:48 smithi047 bash[22744]: cluster 2024-09-16T06:57:47.055939+0000 mgr.a (mgr.14373) 3493 : cluster [DBG] pgmap v2422: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:57:50.455 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:57:50.456 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:57:50.456 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:57:50.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:57:50 smithi157 bash[24585]: cluster 2024-09-16T06:57:49.056675+0000 mgr.a (mgr.14373) 3494 : cluster [DBG] pgmap v2423: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:57:50.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:57:50 smithi086 bash[24289]: cluster 2024-09-16T06:57:49.056675+0000 mgr.a (mgr.14373) 3494 : cluster [DBG] pgmap v2423: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:57:50.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:57:50 smithi047 bash[22744]: cluster 2024-09-16T06:57:49.056675+0000 mgr.a (mgr.14373) 3494 : cluster [DBG] pgmap v2423: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:57:51.239 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:57:51.239 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:57:51.239 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:57:51.239 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:57:51.239 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:57:52.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:57:52 smithi157 bash[24585]: audit 2024-09-16T06:57:50.791209+0000 mgr.a (mgr.14373) 3495 : audit [DBG] from='client.86514 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:57:52.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:57:52 smithi157 bash[24585]: cluster 2024-09-16T06:57:51.057239+0000 mgr.a (mgr.14373) 3496 : cluster [DBG] pgmap v2424: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:57:52.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:57:52 smithi086 bash[24289]: audit 2024-09-16T06:57:50.791209+0000 mgr.a (mgr.14373) 3495 : audit [DBG] from='client.86514 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:57:52.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:57:52 smithi086 bash[24289]: cluster 2024-09-16T06:57:51.057239+0000 mgr.a (mgr.14373) 3496 : cluster [DBG] pgmap v2424: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:57:52.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:57:52 smithi047 bash[22744]: audit 2024-09-16T06:57:50.791209+0000 mgr.a (mgr.14373) 3495 : audit [DBG] from='client.86514 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:57:52.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:57:52 smithi047 bash[22744]: cluster 2024-09-16T06:57:51.057239+0000 mgr.a (mgr.14373) 3496 : cluster [DBG] pgmap v2424: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:57:54.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:57:54 smithi157 bash[24585]: cluster 2024-09-16T06:57:53.059572+0000 mgr.a (mgr.14373) 3497 : cluster [DBG] pgmap v2425: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:57:54.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:57:54 smithi086 bash[24289]: cluster 2024-09-16T06:57:53.059572+0000 mgr.a (mgr.14373) 3497 : cluster [DBG] pgmap v2425: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:57:54.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:57:54 smithi047 bash[22744]: cluster 2024-09-16T06:57:53.059572+0000 mgr.a (mgr.14373) 3497 : cluster [DBG] pgmap v2425: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:57:56.240 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:57:56.240 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:57:56.240 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:57:56.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:57:56 smithi157 bash[24585]: cluster 2024-09-16T06:57:55.060350+0000 mgr.a (mgr.14373) 3498 : cluster [DBG] pgmap v2426: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:57:56.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:57:56 smithi157 bash[24585]: audit 2024-09-16T06:57:56.165060+0000 mon.b (mon.2) 358 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T06:57:56.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:57:56 smithi086 bash[24289]: cluster 2024-09-16T06:57:55.060350+0000 mgr.a (mgr.14373) 3498 : cluster [DBG] pgmap v2426: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:57:56.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:57:56 smithi086 bash[24289]: audit 2024-09-16T06:57:56.165060+0000 mon.b (mon.2) 358 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T06:57:56.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:57:56 smithi047 bash[22744]: cluster 2024-09-16T06:57:55.060350+0000 mgr.a (mgr.14373) 3498 : cluster [DBG] pgmap v2426: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:57:56.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:57:56 smithi047 bash[22744]: audit 2024-09-16T06:57:56.165060+0000 mon.b (mon.2) 358 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T06:57:57.032 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:57:57.033 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:57:57.033 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:57:57.033 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:57:57.033 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:57:57.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:57:57 smithi157 bash[24585]: audit 2024-09-16T06:57:57.033964+0000 mon.b (mon.2) 359 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T06:57:57.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:57:57 smithi157 bash[24585]: audit 2024-09-16T06:57:57.035648+0000 mon.b (mon.2) 360 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T06:57:57.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:57:57 smithi157 bash[24585]: audit 2024-09-16T06:57:57.043789+0000 mon.a (mon.0) 777 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:57:57.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:57:57 smithi157 bash[24585]: audit 2024-09-16T06:57:57.046918+0000 mon.b (mon.2) 361 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:57:57.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:57:57 smithi086 bash[24289]: audit 2024-09-16T06:57:57.033964+0000 mon.b (mon.2) 359 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T06:57:57.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:57:57 smithi086 bash[24289]: audit 2024-09-16T06:57:57.035648+0000 mon.b (mon.2) 360 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T06:57:57.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:57:57 smithi086 bash[24289]: audit 2024-09-16T06:57:57.043789+0000 mon.a (mon.0) 777 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:57:57.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:57:57 smithi086 bash[24289]: audit 2024-09-16T06:57:57.046918+0000 mon.b (mon.2) 361 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:57:57.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:57:57 smithi047 bash[22744]: audit 2024-09-16T06:57:57.033964+0000 mon.b (mon.2) 359 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T06:57:57.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:57:57 smithi047 bash[22744]: audit 2024-09-16T06:57:57.035648+0000 mon.b (mon.2) 360 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T06:57:57.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:57:57 smithi047 bash[22744]: audit 2024-09-16T06:57:57.043789+0000 mon.a (mon.0) 777 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:57:57.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:57:57 smithi047 bash[22744]: audit 2024-09-16T06:57:57.046918+0000 mon.b (mon.2) 361 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:57:58.088 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 06:57:57 smithi047 bash[22994]: debug 2024-09-16T06:57:57.727+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T06:57:58.089 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 06:57:57 smithi047 bash[22994]: debug 2024-09-16T06:57:57.731+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T06:57:58.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:57:58 smithi157 bash[24585]: audit 2024-09-16T06:57:56.577252+0000 mgr.a (mgr.14373) 3499 : audit [DBG] from='client.86586 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:57:58.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:57:58 smithi157 bash[24585]: audit 2024-09-16T06:57:57.050208+0000 mgr.a (mgr.14373) 3500 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:57:58.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:57:58 smithi157 bash[24585]: cluster 2024-09-16T06:57:57.062145+0000 mgr.a (mgr.14373) 3501 : cluster [DBG] pgmap v2427: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:57:58.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:57:58 smithi086 bash[24289]: audit 2024-09-16T06:57:56.577252+0000 mgr.a (mgr.14373) 3499 : audit [DBG] from='client.86586 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:57:58.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:57:58 smithi086 bash[24289]: audit 2024-09-16T06:57:57.050208+0000 mgr.a (mgr.14373) 3500 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:57:58.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:57:58 smithi086 bash[24289]: cluster 2024-09-16T06:57:57.062145+0000 mgr.a (mgr.14373) 3501 : cluster [DBG] pgmap v2427: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:57:58.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:57:58 smithi047 bash[22744]: audit 2024-09-16T06:57:56.577252+0000 mgr.a (mgr.14373) 3499 : audit [DBG] from='client.86586 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:57:58.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:57:58 smithi047 bash[22744]: audit 2024-09-16T06:57:57.050208+0000 mgr.a (mgr.14373) 3500 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:57:58.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:57:58 smithi047 bash[22744]: cluster 2024-09-16T06:57:57.062145+0000 mgr.a (mgr.14373) 3501 : cluster [DBG] pgmap v2427: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:57:59.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:57:59 smithi157 bash[24585]: audit 2024-09-16T06:57:57.733157+0000 mgr.a (mgr.14373) 3502 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T06:57:59.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:57:59 smithi157 bash[24585]: cephadm 2024-09-16T06:57:57.735271+0000 mgr.a (mgr.14373) 3503 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T06:57:59.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:57:59 smithi086 bash[24289]: audit 2024-09-16T06:57:57.733157+0000 mgr.a (mgr.14373) 3502 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T06:57:59.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:57:59 smithi086 bash[24289]: cephadm 2024-09-16T06:57:57.735271+0000 mgr.a (mgr.14373) 3503 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T06:57:59.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:57:59 smithi047 bash[22744]: audit 2024-09-16T06:57:57.733157+0000 mgr.a (mgr.14373) 3502 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T06:57:59.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:57:59 smithi047 bash[22744]: cephadm 2024-09-16T06:57:57.735271+0000 mgr.a (mgr.14373) 3503 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T06:58:00.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:58:00 smithi157 bash[24585]: cluster 2024-09-16T06:57:59.063106+0000 mgr.a (mgr.14373) 3504 : cluster [DBG] pgmap v2428: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T06:58:00.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:58:00 smithi086 bash[24289]: cluster 2024-09-16T06:57:59.063106+0000 mgr.a (mgr.14373) 3504 : cluster [DBG] pgmap v2428: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T06:58:00.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:58:00 smithi047 bash[22744]: cluster 2024-09-16T06:57:59.063106+0000 mgr.a (mgr.14373) 3504 : cluster [DBG] pgmap v2428: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T06:58:02.034 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:58:02.035 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:58:02.035 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:58:02.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:58:02 smithi157 bash[24585]: cluster 2024-09-16T06:58:01.063931+0000 mgr.a (mgr.14373) 3505 : cluster [DBG] pgmap v2429: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T06:58:02.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:58:02 smithi086 bash[24289]: cluster 2024-09-16T06:58:01.063931+0000 mgr.a (mgr.14373) 3505 : cluster [DBG] pgmap v2429: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T06:58:02.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:58:02 smithi047 bash[22744]: cluster 2024-09-16T06:58:01.063931+0000 mgr.a (mgr.14373) 3505 : cluster [DBG] pgmap v2429: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T06:58:02.795 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:58:02.795 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:58:02.795 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:58:02.795 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:58:02.795 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:58:03.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:58:03 smithi157 bash[24585]: audit 2024-09-16T06:58:02.369920+0000 mgr.a (mgr.14373) 3506 : audit [DBG] from='client.86769 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:58:03.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:58:03 smithi086 bash[24289]: audit 2024-09-16T06:58:02.369920+0000 mgr.a (mgr.14373) 3506 : audit [DBG] from='client.86769 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:58:03.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:58:03 smithi047 bash[22744]: audit 2024-09-16T06:58:02.369920+0000 mgr.a (mgr.14373) 3506 : audit [DBG] from='client.86769 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:58:04.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:58:04 smithi157 bash[24585]: cluster 2024-09-16T06:58:03.066654+0000 mgr.a (mgr.14373) 3507 : cluster [DBG] pgmap v2430: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:58:04.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:58:04 smithi086 bash[24289]: cluster 2024-09-16T06:58:03.066654+0000 mgr.a (mgr.14373) 3507 : cluster [DBG] pgmap v2430: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:58:04.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:58:04 smithi047 bash[22744]: cluster 2024-09-16T06:58:03.066654+0000 mgr.a (mgr.14373) 3507 : cluster [DBG] pgmap v2430: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:58:06.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:58:06 smithi157 bash[24585]: cluster 2024-09-16T06:58:05.067450+0000 mgr.a (mgr.14373) 3508 : cluster [DBG] pgmap v2431: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T06:58:06.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:58:06 smithi086 bash[24289]: cluster 2024-09-16T06:58:05.067450+0000 mgr.a (mgr.14373) 3508 : cluster [DBG] pgmap v2431: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T06:58:06.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:58:06 smithi047 bash[22744]: cluster 2024-09-16T06:58:05.067450+0000 mgr.a (mgr.14373) 3508 : cluster [DBG] pgmap v2431: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T06:58:07.796 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:58:07.797 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:58:07.797 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:58:08.538 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:58:08.538 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:58:08.538 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:58:08.538 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:58:08.538 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:58:08.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:58:08 smithi157 bash[24585]: cluster 2024-09-16T06:58:07.069392+0000 mgr.a (mgr.14373) 3509 : cluster [DBG] pgmap v2432: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 11 KiB/s rd, 426 B/s wr, 14 op/s 2024-09-16T06:58:08.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:58:08 smithi086 bash[24289]: cluster 2024-09-16T06:58:07.069392+0000 mgr.a (mgr.14373) 3509 : cluster [DBG] pgmap v2432: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 11 KiB/s rd, 426 B/s wr, 14 op/s 2024-09-16T06:58:08.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:58:08 smithi047 bash[22744]: cluster 2024-09-16T06:58:07.069392+0000 mgr.a (mgr.14373) 3509 : cluster [DBG] pgmap v2432: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 11 KiB/s rd, 426 B/s wr, 14 op/s 2024-09-16T06:58:09.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:58:09 smithi157 bash[24585]: audit 2024-09-16T06:58:08.127853+0000 mgr.a (mgr.14373) 3510 : audit [DBG] from='client.86841 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:58:09.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:58:09 smithi086 bash[24289]: audit 2024-09-16T06:58:08.127853+0000 mgr.a (mgr.14373) 3510 : audit [DBG] from='client.86841 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:58:09.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:58:09 smithi047 bash[22744]: audit 2024-09-16T06:58:08.127853+0000 mgr.a (mgr.14373) 3510 : audit [DBG] from='client.86841 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:58:10.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:58:10 smithi157 bash[24585]: cluster 2024-09-16T06:58:09.070394+0000 mgr.a (mgr.14373) 3511 : cluster [DBG] pgmap v2433: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 11 KiB/s rd, 426 B/s wr, 14 op/s 2024-09-16T06:58:10.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:58:10 smithi086 bash[24289]: cluster 2024-09-16T06:58:09.070394+0000 mgr.a (mgr.14373) 3511 : cluster [DBG] pgmap v2433: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 11 KiB/s rd, 426 B/s wr, 14 op/s 2024-09-16T06:58:10.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:58:10 smithi047 bash[22744]: cluster 2024-09-16T06:58:09.070394+0000 mgr.a (mgr.14373) 3511 : cluster [DBG] pgmap v2433: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 11 KiB/s rd, 426 B/s wr, 14 op/s 2024-09-16T06:58:12.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:58:12 smithi157 bash[24585]: cluster 2024-09-16T06:58:11.071206+0000 mgr.a (mgr.14373) 3512 : cluster [DBG] pgmap v2434: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 11 KiB/s rd, 426 B/s wr, 14 op/s 2024-09-16T06:58:12.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:58:12 smithi086 bash[24289]: cluster 2024-09-16T06:58:11.071206+0000 mgr.a (mgr.14373) 3512 : cluster [DBG] pgmap v2434: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 11 KiB/s rd, 426 B/s wr, 14 op/s 2024-09-16T06:58:12.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:58:12 smithi047 bash[22744]: cluster 2024-09-16T06:58:11.071206+0000 mgr.a (mgr.14373) 3512 : cluster [DBG] pgmap v2434: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 11 KiB/s rd, 426 B/s wr, 14 op/s 2024-09-16T06:58:13.539 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:58:13.540 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:58:13.540 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:58:14.333 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:58:14.333 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:58:14.333 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:58:14.333 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:58:14.333 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:58:14.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:58:14 smithi157 bash[24585]: cluster 2024-09-16T06:58:13.073406+0000 mgr.a (mgr.14373) 3513 : cluster [DBG] pgmap v2435: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 76 KiB/s rd, 426 B/s wr, 120 op/s 2024-09-16T06:58:14.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:58:14 smithi086 bash[24289]: cluster 2024-09-16T06:58:13.073406+0000 mgr.a (mgr.14373) 3513 : cluster [DBG] pgmap v2435: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 76 KiB/s rd, 426 B/s wr, 120 op/s 2024-09-16T06:58:14.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:58:14 smithi047 bash[22744]: cluster 2024-09-16T06:58:13.073406+0000 mgr.a (mgr.14373) 3513 : cluster [DBG] pgmap v2435: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 76 KiB/s rd, 426 B/s wr, 120 op/s 2024-09-16T06:58:15.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:58:15 smithi157 bash[24585]: audit 2024-09-16T06:58:13.883395+0000 mgr.a (mgr.14373) 3514 : audit [DBG] from='client.86919 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:58:15.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:58:15 smithi086 bash[24289]: audit 2024-09-16T06:58:13.883395+0000 mgr.a (mgr.14373) 3514 : audit [DBG] from='client.86919 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:58:15.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:58:15 smithi047 bash[22744]: audit 2024-09-16T06:58:13.883395+0000 mgr.a (mgr.14373) 3514 : audit [DBG] from='client.86919 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:58:16.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:58:16 smithi157 bash[24585]: cluster 2024-09-16T06:58:15.074308+0000 mgr.a (mgr.14373) 3515 : cluster [DBG] pgmap v2436: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 70 KiB/s rd, 0 B/s wr, 114 op/s 2024-09-16T06:58:16.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:58:16 smithi086 bash[24289]: cluster 2024-09-16T06:58:15.074308+0000 mgr.a (mgr.14373) 3515 : cluster [DBG] pgmap v2436: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 70 KiB/s rd, 0 B/s wr, 114 op/s 2024-09-16T06:58:16.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:58:16 smithi047 bash[22744]: cluster 2024-09-16T06:58:15.074308+0000 mgr.a (mgr.14373) 3515 : cluster [DBG] pgmap v2436: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 70 KiB/s rd, 0 B/s wr, 114 op/s 2024-09-16T06:58:18.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:58:18 smithi157 bash[24585]: cluster 2024-09-16T06:58:17.076438+0000 mgr.a (mgr.14373) 3516 : cluster [DBG] pgmap v2437: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 70 KiB/s rd, 0 B/s wr, 115 op/s 2024-09-16T06:58:18.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:58:18 smithi086 bash[24289]: cluster 2024-09-16T06:58:17.076438+0000 mgr.a (mgr.14373) 3516 : cluster [DBG] pgmap v2437: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 70 KiB/s rd, 0 B/s wr, 115 op/s 2024-09-16T06:58:18.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:58:18 smithi047 bash[22744]: cluster 2024-09-16T06:58:17.076438+0000 mgr.a (mgr.14373) 3516 : cluster [DBG] pgmap v2437: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 70 KiB/s rd, 0 B/s wr, 115 op/s 2024-09-16T06:58:19.334 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:58:19.335 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:58:19.336 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:58:20.126 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:58:20.126 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:58:20.126 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:58:20.126 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:58:20.126 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:58:20.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:58:20 smithi086 bash[24289]: cluster 2024-09-16T06:58:19.077229+0000 mgr.a (mgr.14373) 3517 : cluster [DBG] pgmap v2438: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 65 KiB/s rd, 0 B/s wr, 107 op/s 2024-09-16T06:58:20.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:58:20 smithi047 bash[22744]: cluster 2024-09-16T06:58:19.077229+0000 mgr.a (mgr.14373) 3517 : cluster [DBG] pgmap v2438: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 65 KiB/s rd, 0 B/s wr, 107 op/s 2024-09-16T06:58:20.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:58:20 smithi157 bash[24585]: cluster 2024-09-16T06:58:19.077229+0000 mgr.a (mgr.14373) 3517 : cluster [DBG] pgmap v2438: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 65 KiB/s rd, 0 B/s wr, 107 op/s 2024-09-16T06:58:21.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:58:21 smithi086 bash[24289]: audit 2024-09-16T06:58:19.677479+0000 mgr.a (mgr.14373) 3518 : audit [DBG] from='client.86997 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:58:21.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:58:21 smithi047 bash[22744]: audit 2024-09-16T06:58:19.677479+0000 mgr.a (mgr.14373) 3518 : audit [DBG] from='client.86997 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:58:21.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:58:21 smithi157 bash[24585]: audit 2024-09-16T06:58:19.677479+0000 mgr.a (mgr.14373) 3518 : audit [DBG] from='client.86997 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:58:22.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:58:22 smithi086 bash[24289]: cluster 2024-09-16T06:58:21.078134+0000 mgr.a (mgr.14373) 3519 : cluster [DBG] pgmap v2439: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 65 KiB/s rd, 0 B/s wr, 107 op/s 2024-09-16T06:58:22.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:58:22 smithi047 bash[22744]: cluster 2024-09-16T06:58:21.078134+0000 mgr.a (mgr.14373) 3519 : cluster [DBG] pgmap v2439: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 65 KiB/s rd, 0 B/s wr, 107 op/s 2024-09-16T06:58:22.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:58:22 smithi157 bash[24585]: cluster 2024-09-16T06:58:21.078134+0000 mgr.a (mgr.14373) 3519 : cluster [DBG] pgmap v2439: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 65 KiB/s rd, 0 B/s wr, 107 op/s 2024-09-16T06:58:24.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:58:24 smithi047 bash[22744]: cluster 2024-09-16T06:58:23.080381+0000 mgr.a (mgr.14373) 3520 : cluster [DBG] pgmap v2440: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 66 KiB/s rd, 0 B/s wr, 108 op/s 2024-09-16T06:58:24.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:58:24 smithi157 bash[24585]: cluster 2024-09-16T06:58:23.080381+0000 mgr.a (mgr.14373) 3520 : cluster [DBG] pgmap v2440: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 66 KiB/s rd, 0 B/s wr, 108 op/s 2024-09-16T06:58:24.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:58:24 smithi086 bash[24289]: cluster 2024-09-16T06:58:23.080381+0000 mgr.a (mgr.14373) 3520 : cluster [DBG] pgmap v2440: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 66 KiB/s rd, 0 B/s wr, 108 op/s 2024-09-16T06:58:25.127 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:58:25.128 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:58:25.128 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:58:25.903 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:58:25.903 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:58:25.903 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:58:25.903 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:58:25.903 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:58:26.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:58:26 smithi047 bash[22744]: cluster 2024-09-16T06:58:25.081139+0000 mgr.a (mgr.14373) 3521 : cluster [DBG] pgmap v2441: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:58:26.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:58:26 smithi157 bash[24585]: cluster 2024-09-16T06:58:25.081139+0000 mgr.a (mgr.14373) 3521 : cluster [DBG] pgmap v2441: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:58:26.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:58:26 smithi086 bash[24289]: cluster 2024-09-16T06:58:25.081139+0000 mgr.a (mgr.14373) 3521 : cluster [DBG] pgmap v2441: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:58:27.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:58:27 smithi047 bash[22744]: audit 2024-09-16T06:58:25.466001+0000 mgr.a (mgr.14373) 3522 : audit [DBG] from='client.87072 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:58:27.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:58:27 smithi157 bash[24585]: audit 2024-09-16T06:58:25.466001+0000 mgr.a (mgr.14373) 3522 : audit [DBG] from='client.87072 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:58:27.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:58:27 smithi086 bash[24289]: audit 2024-09-16T06:58:25.466001+0000 mgr.a (mgr.14373) 3522 : audit [DBG] from='client.87072 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:58:28.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:58:28 smithi047 bash[22744]: cluster 2024-09-16T06:58:27.083407+0000 mgr.a (mgr.14373) 3523 : cluster [DBG] pgmap v2442: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:58:28.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:58:28 smithi157 bash[24585]: cluster 2024-09-16T06:58:27.083407+0000 mgr.a (mgr.14373) 3523 : cluster [DBG] pgmap v2442: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:58:28.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:58:28 smithi086 bash[24289]: cluster 2024-09-16T06:58:27.083407+0000 mgr.a (mgr.14373) 3523 : cluster [DBG] pgmap v2442: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:58:30.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:58:30 smithi157 bash[24585]: cluster 2024-09-16T06:58:29.084198+0000 mgr.a (mgr.14373) 3524 : cluster [DBG] pgmap v2443: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:58:30.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:58:30 smithi086 bash[24289]: cluster 2024-09-16T06:58:29.084198+0000 mgr.a (mgr.14373) 3524 : cluster [DBG] pgmap v2443: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:58:30.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:58:30 smithi047 bash[22744]: cluster 2024-09-16T06:58:29.084198+0000 mgr.a (mgr.14373) 3524 : cluster [DBG] pgmap v2443: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:58:30.904 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:58:30.933 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:58:30.933 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:58:31.678 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:58:31.679 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:58:31.679 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:58:31.679 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:58:31.679 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:58:32.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:58:32 smithi157 bash[24585]: cluster 2024-09-16T06:58:31.084968+0000 mgr.a (mgr.14373) 3525 : cluster [DBG] pgmap v2444: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:58:32.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:58:32 smithi157 bash[24585]: audit 2024-09-16T06:58:31.247557+0000 mgr.a (mgr.14373) 3526 : audit [DBG] from='client.87150 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:58:32.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:58:32 smithi086 bash[24289]: cluster 2024-09-16T06:58:31.084968+0000 mgr.a (mgr.14373) 3525 : cluster [DBG] pgmap v2444: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:58:32.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:58:32 smithi086 bash[24289]: audit 2024-09-16T06:58:31.247557+0000 mgr.a (mgr.14373) 3526 : audit [DBG] from='client.87150 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:58:32.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:58:32 smithi047 bash[22744]: cluster 2024-09-16T06:58:31.084968+0000 mgr.a (mgr.14373) 3525 : cluster [DBG] pgmap v2444: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:58:32.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:58:32 smithi047 bash[22744]: audit 2024-09-16T06:58:31.247557+0000 mgr.a (mgr.14373) 3526 : audit [DBG] from='client.87150 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:58:34.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:58:34 smithi157 bash[24585]: cluster 2024-09-16T06:58:33.087626+0000 mgr.a (mgr.14373) 3527 : cluster [DBG] pgmap v2445: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:58:34.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:58:34 smithi086 bash[24289]: cluster 2024-09-16T06:58:33.087626+0000 mgr.a (mgr.14373) 3527 : cluster [DBG] pgmap v2445: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:58:34.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:58:34 smithi047 bash[22744]: cluster 2024-09-16T06:58:33.087626+0000 mgr.a (mgr.14373) 3527 : cluster [DBG] pgmap v2445: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:58:36.680 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:58:36.681 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:58:36.681 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:58:36.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:58:36 smithi157 bash[24585]: cluster 2024-09-16T06:58:35.088387+0000 mgr.a (mgr.14373) 3528 : cluster [DBG] pgmap v2446: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:58:36.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:58:36 smithi086 bash[24289]: cluster 2024-09-16T06:58:35.088387+0000 mgr.a (mgr.14373) 3528 : cluster [DBG] pgmap v2446: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:58:36.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:58:36 smithi047 bash[22744]: cluster 2024-09-16T06:58:35.088387+0000 mgr.a (mgr.14373) 3528 : cluster [DBG] pgmap v2446: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:58:37.437 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:58:37.438 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:58:37.438 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:58:37.438 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:58:37.438 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:58:38.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:58:38 smithi157 bash[24585]: audit 2024-09-16T06:58:37.015377+0000 mgr.a (mgr.14373) 3529 : audit [DBG] from='client.87228 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:58:38.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:58:38 smithi157 bash[24585]: cluster 2024-09-16T06:58:37.089685+0000 mgr.a (mgr.14373) 3530 : cluster [DBG] pgmap v2447: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:58:38.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:58:38 smithi086 bash[24289]: audit 2024-09-16T06:58:37.015377+0000 mgr.a (mgr.14373) 3529 : audit [DBG] from='client.87228 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:58:38.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:58:38 smithi086 bash[24289]: cluster 2024-09-16T06:58:37.089685+0000 mgr.a (mgr.14373) 3530 : cluster [DBG] pgmap v2447: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:58:38.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:58:38 smithi047 bash[22744]: audit 2024-09-16T06:58:37.015377+0000 mgr.a (mgr.14373) 3529 : audit [DBG] from='client.87228 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:58:38.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:58:38 smithi047 bash[22744]: cluster 2024-09-16T06:58:37.089685+0000 mgr.a (mgr.14373) 3530 : cluster [DBG] pgmap v2447: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:58:40.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:58:40 smithi157 bash[24585]: cluster 2024-09-16T06:58:39.090564+0000 mgr.a (mgr.14373) 3531 : cluster [DBG] pgmap v2448: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T06:58:40.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:58:40 smithi086 bash[24289]: cluster 2024-09-16T06:58:39.090564+0000 mgr.a (mgr.14373) 3531 : cluster [DBG] pgmap v2448: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T06:58:40.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:58:40 smithi047 bash[22744]: cluster 2024-09-16T06:58:39.090564+0000 mgr.a (mgr.14373) 3531 : cluster [DBG] pgmap v2448: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T06:58:42.439 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:58:42.440 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:58:42.440 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:58:42.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:58:42 smithi157 bash[24585]: cluster 2024-09-16T06:58:41.091313+0000 mgr.a (mgr.14373) 3532 : cluster [DBG] pgmap v2449: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T06:58:42.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:58:42 smithi086 bash[24289]: cluster 2024-09-16T06:58:41.091313+0000 mgr.a (mgr.14373) 3532 : cluster [DBG] pgmap v2449: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T06:58:42.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:58:42 smithi047 bash[22744]: cluster 2024-09-16T06:58:41.091313+0000 mgr.a (mgr.14373) 3532 : cluster [DBG] pgmap v2449: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T06:58:43.210 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:58:43.210 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:58:43.210 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:58:43.210 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:58:43.210 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:58:44.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:58:44 smithi157 bash[24585]: audit 2024-09-16T06:58:42.778242+0000 mgr.a (mgr.14373) 3533 : audit [DBG] from='client.87306 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:58:44.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:58:44 smithi157 bash[24585]: cluster 2024-09-16T06:58:43.092511+0000 mgr.a (mgr.14373) 3534 : cluster [DBG] pgmap v2450: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:58:44.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:58:44 smithi086 bash[24289]: audit 2024-09-16T06:58:42.778242+0000 mgr.a (mgr.14373) 3533 : audit [DBG] from='client.87306 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:58:44.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:58:44 smithi086 bash[24289]: cluster 2024-09-16T06:58:43.092511+0000 mgr.a (mgr.14373) 3534 : cluster [DBG] pgmap v2450: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:58:44.840 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:58:44 smithi047 bash[22744]: audit 2024-09-16T06:58:42.778242+0000 mgr.a (mgr.14373) 3533 : audit [DBG] from='client.87306 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:58:44.840 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:58:44 smithi047 bash[22744]: cluster 2024-09-16T06:58:43.092511+0000 mgr.a (mgr.14373) 3534 : cluster [DBG] pgmap v2450: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:58:46.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:58:46 smithi157 bash[24585]: cluster 2024-09-16T06:58:45.093354+0000 mgr.a (mgr.14373) 3535 : cluster [DBG] pgmap v2451: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:58:46.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:58:46 smithi086 bash[24289]: cluster 2024-09-16T06:58:45.093354+0000 mgr.a (mgr.14373) 3535 : cluster [DBG] pgmap v2451: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:58:46.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:58:46 smithi047 bash[22744]: cluster 2024-09-16T06:58:45.093354+0000 mgr.a (mgr.14373) 3535 : cluster [DBG] pgmap v2451: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:58:48.211 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:58:48.212 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:58:48.212 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:58:48.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:58:48 smithi157 bash[24585]: cluster 2024-09-16T06:58:47.095537+0000 mgr.a (mgr.14373) 3536 : cluster [DBG] pgmap v2452: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:58:48.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:58:48 smithi086 bash[24289]: cluster 2024-09-16T06:58:47.095537+0000 mgr.a (mgr.14373) 3536 : cluster [DBG] pgmap v2452: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:58:48.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:58:48 smithi047 bash[22744]: cluster 2024-09-16T06:58:47.095537+0000 mgr.a (mgr.14373) 3536 : cluster [DBG] pgmap v2452: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:58:48.962 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:58:48.962 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:58:48.962 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:58:48.962 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:58:48.963 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:58:50.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:58:50 smithi157 bash[24585]: audit 2024-09-16T06:58:48.548169+0000 mgr.a (mgr.14373) 3537 : audit [DBG] from='client.87384 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:58:50.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:58:50 smithi157 bash[24585]: cluster 2024-09-16T06:58:49.096430+0000 mgr.a (mgr.14373) 3538 : cluster [DBG] pgmap v2453: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:58:50.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:58:50 smithi086 bash[24289]: audit 2024-09-16T06:58:48.548169+0000 mgr.a (mgr.14373) 3537 : audit [DBG] from='client.87384 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:58:50.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:58:50 smithi086 bash[24289]: cluster 2024-09-16T06:58:49.096430+0000 mgr.a (mgr.14373) 3538 : cluster [DBG] pgmap v2453: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:58:50.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:58:50 smithi047 bash[22744]: audit 2024-09-16T06:58:48.548169+0000 mgr.a (mgr.14373) 3537 : audit [DBG] from='client.87384 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:58:50.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:58:50 smithi047 bash[22744]: cluster 2024-09-16T06:58:49.096430+0000 mgr.a (mgr.14373) 3538 : cluster [DBG] pgmap v2453: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:58:52.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:58:52 smithi157 bash[24585]: cluster 2024-09-16T06:58:51.097205+0000 mgr.a (mgr.14373) 3539 : cluster [DBG] pgmap v2454: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:58:52.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:58:52 smithi086 bash[24289]: cluster 2024-09-16T06:58:51.097205+0000 mgr.a (mgr.14373) 3539 : cluster [DBG] pgmap v2454: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:58:52.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:58:52 smithi047 bash[22744]: cluster 2024-09-16T06:58:51.097205+0000 mgr.a (mgr.14373) 3539 : cluster [DBG] pgmap v2454: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:58:53.963 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:58:53.964 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:58:53.964 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:58:54.727 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:58:54.727 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:58:54.727 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:58:54.727 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:58:54.727 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:58:54.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:58:54 smithi157 bash[24585]: cluster 2024-09-16T06:58:53.099397+0000 mgr.a (mgr.14373) 3540 : cluster [DBG] pgmap v2455: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:58:54.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:58:54 smithi086 bash[24289]: cluster 2024-09-16T06:58:53.099397+0000 mgr.a (mgr.14373) 3540 : cluster [DBG] pgmap v2455: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:58:54.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:58:54 smithi047 bash[22744]: cluster 2024-09-16T06:58:53.099397+0000 mgr.a (mgr.14373) 3540 : cluster [DBG] pgmap v2455: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:58:55.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:58:55 smithi157 bash[24585]: audit 2024-09-16T06:58:54.301917+0000 mgr.a (mgr.14373) 3541 : audit [DBG] from='client.87462 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:58:55.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:58:55 smithi086 bash[24289]: audit 2024-09-16T06:58:54.301917+0000 mgr.a (mgr.14373) 3541 : audit [DBG] from='client.87462 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:58:55.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:58:55 smithi047 bash[22744]: audit 2024-09-16T06:58:54.301917+0000 mgr.a (mgr.14373) 3541 : audit [DBG] from='client.87462 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:58:56.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:58:56 smithi157 bash[24585]: cluster 2024-09-16T06:58:55.100258+0000 mgr.a (mgr.14373) 3542 : cluster [DBG] pgmap v2456: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:58:56.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:58:56 smithi086 bash[24289]: cluster 2024-09-16T06:58:55.100258+0000 mgr.a (mgr.14373) 3542 : cluster [DBG] pgmap v2456: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:58:56.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:58:56 smithi047 bash[22744]: cluster 2024-09-16T06:58:55.100258+0000 mgr.a (mgr.14373) 3542 : cluster [DBG] pgmap v2456: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:58:58.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:58:58 smithi157 bash[24585]: cluster 2024-09-16T06:58:57.102404+0000 mgr.a (mgr.14373) 3543 : cluster [DBG] pgmap v2457: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:58:58.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:58:58 smithi157 bash[24585]: audit 2024-09-16T06:58:57.788412+0000 mon.b (mon.2) 362 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T06:58:58.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:58:58 smithi086 bash[24289]: cluster 2024-09-16T06:58:57.102404+0000 mgr.a (mgr.14373) 3543 : cluster [DBG] pgmap v2457: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:58:58.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:58:58 smithi086 bash[24289]: audit 2024-09-16T06:58:57.788412+0000 mon.b (mon.2) 362 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T06:58:58.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:58:58 smithi047 bash[22744]: cluster 2024-09-16T06:58:57.102404+0000 mgr.a (mgr.14373) 3543 : cluster [DBG] pgmap v2457: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:58:58.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:58:58 smithi047 bash[22744]: audit 2024-09-16T06:58:57.788412+0000 mon.b (mon.2) 362 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T06:58:59.729 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:58:59.729 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:58:59.729 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:58:59.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:58:59 smithi157 bash[24585]: audit 2024-09-16T06:58:58.609732+0000 mon.b (mon.2) 363 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T06:58:59.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:58:59 smithi157 bash[24585]: audit 2024-09-16T06:58:58.611614+0000 mon.b (mon.2) 364 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T06:58:59.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:58:59 smithi157 bash[24585]: audit 2024-09-16T06:58:58.624603+0000 mon.a (mon.0) 778 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:58:59.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:58:59 smithi157 bash[24585]: audit 2024-09-16T06:58:58.626427+0000 mon.b (mon.2) 365 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:58:59.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:58:59 smithi086 bash[24289]: audit 2024-09-16T06:58:58.609732+0000 mon.b (mon.2) 363 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T06:58:59.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:58:59 smithi086 bash[24289]: audit 2024-09-16T06:58:58.611614+0000 mon.b (mon.2) 364 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T06:58:59.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:58:59 smithi086 bash[24289]: audit 2024-09-16T06:58:58.624603+0000 mon.a (mon.0) 778 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:58:59.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:58:59 smithi086 bash[24289]: audit 2024-09-16T06:58:58.626427+0000 mon.b (mon.2) 365 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:58:59.838 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 06:58:59 smithi047 bash[22994]: debug 2024-09-16T06:58:59.354+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T06:58:59.838 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 06:58:59 smithi047 bash[22994]: debug 2024-09-16T06:58:59.354+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T06:58:59.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:58:59 smithi047 bash[22744]: audit 2024-09-16T06:58:58.609732+0000 mon.b (mon.2) 363 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T06:58:59.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:58:59 smithi047 bash[22744]: audit 2024-09-16T06:58:58.611614+0000 mon.b (mon.2) 364 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T06:58:59.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:58:59 smithi047 bash[22744]: audit 2024-09-16T06:58:58.624603+0000 mon.a (mon.0) 778 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T06:58:59.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:58:59 smithi047 bash[22744]: audit 2024-09-16T06:58:58.626427+0000 mon.b (mon.2) 365 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:59:00.469 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:59:00.469 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:59:00.469 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:59:00.469 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:59:00.470 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:59:00.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:59:00 smithi157 bash[24585]: audit 2024-09-16T06:58:58.630904+0000 mgr.a (mgr.14373) 3544 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:59:00.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:59:00 smithi157 bash[24585]: cluster 2024-09-16T06:58:59.102929+0000 mgr.a (mgr.14373) 3545 : cluster [DBG] pgmap v2458: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:59:00.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:59:00 smithi157 bash[24585]: audit 2024-09-16T06:58:59.356252+0000 mgr.a (mgr.14373) 3546 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T06:59:00.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:59:00 smithi157 bash[24585]: cephadm 2024-09-16T06:58:59.358248+0000 mgr.a (mgr.14373) 3547 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T06:59:00.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:59:00 smithi157 bash[24585]: audit 2024-09-16T06:59:00.066550+0000 mgr.a (mgr.14373) 3548 : audit [DBG] from='client.87648 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:59:00.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:59:00 smithi086 bash[24289]: audit 2024-09-16T06:58:58.630904+0000 mgr.a (mgr.14373) 3544 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:59:00.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:59:00 smithi086 bash[24289]: cluster 2024-09-16T06:58:59.102929+0000 mgr.a (mgr.14373) 3545 : cluster [DBG] pgmap v2458: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:59:00.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:59:00 smithi086 bash[24289]: audit 2024-09-16T06:58:59.356252+0000 mgr.a (mgr.14373) 3546 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T06:59:00.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:59:00 smithi086 bash[24289]: cephadm 2024-09-16T06:58:59.358248+0000 mgr.a (mgr.14373) 3547 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T06:59:00.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:59:00 smithi086 bash[24289]: audit 2024-09-16T06:59:00.066550+0000 mgr.a (mgr.14373) 3548 : audit [DBG] from='client.87648 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:59:00.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:59:00 smithi047 bash[22744]: audit 2024-09-16T06:58:58.630904+0000 mgr.a (mgr.14373) 3544 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T06:59:00.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:59:00 smithi047 bash[22744]: cluster 2024-09-16T06:58:59.102929+0000 mgr.a (mgr.14373) 3545 : cluster [DBG] pgmap v2458: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:59:00.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:59:00 smithi047 bash[22744]: audit 2024-09-16T06:58:59.356252+0000 mgr.a (mgr.14373) 3546 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T06:59:00.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:59:00 smithi047 bash[22744]: cephadm 2024-09-16T06:58:59.358248+0000 mgr.a (mgr.14373) 3547 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T06:59:00.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:59:00 smithi047 bash[22744]: audit 2024-09-16T06:59:00.066550+0000 mgr.a (mgr.14373) 3548 : audit [DBG] from='client.87648 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:59:01.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:59:01 smithi157 bash[24585]: cluster 2024-09-16T06:59:01.103789+0000 mgr.a (mgr.14373) 3549 : cluster [DBG] pgmap v2459: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:59:01.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:59:01 smithi086 bash[24289]: cluster 2024-09-16T06:59:01.103789+0000 mgr.a (mgr.14373) 3549 : cluster [DBG] pgmap v2459: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:59:01.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:59:01 smithi047 bash[22744]: cluster 2024-09-16T06:59:01.103789+0000 mgr.a (mgr.14373) 3549 : cluster [DBG] pgmap v2459: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:59:04.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:59:04 smithi157 bash[24585]: cluster 2024-09-16T06:59:03.105997+0000 mgr.a (mgr.14373) 3550 : cluster [DBG] pgmap v2460: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:59:04.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:59:04 smithi086 bash[24289]: cluster 2024-09-16T06:59:03.105997+0000 mgr.a (mgr.14373) 3550 : cluster [DBG] pgmap v2460: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:59:04.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:59:04 smithi047 bash[22744]: cluster 2024-09-16T06:59:03.105997+0000 mgr.a (mgr.14373) 3550 : cluster [DBG] pgmap v2460: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:59:05.471 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:59:05.471 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:59:05.472 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:59:06.234 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:59:06.234 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:59:06.234 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:59:06.234 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:59:06.234 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:59:06.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:59:06 smithi157 bash[24585]: cluster 2024-09-16T06:59:05.106794+0000 mgr.a (mgr.14373) 3551 : cluster [DBG] pgmap v2461: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:59:06.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:59:06 smithi086 bash[24289]: cluster 2024-09-16T06:59:05.106794+0000 mgr.a (mgr.14373) 3551 : cluster [DBG] pgmap v2461: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:59:06.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:59:06 smithi047 bash[22744]: cluster 2024-09-16T06:59:05.106794+0000 mgr.a (mgr.14373) 3551 : cluster [DBG] pgmap v2461: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:59:07.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:59:07 smithi157 bash[24585]: audit 2024-09-16T06:59:05.804480+0000 mgr.a (mgr.14373) 3552 : audit [DBG] from='client.87717 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:59:07.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:59:07 smithi086 bash[24289]: audit 2024-09-16T06:59:05.804480+0000 mgr.a (mgr.14373) 3552 : audit [DBG] from='client.87717 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:59:07.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:59:07 smithi047 bash[22744]: audit 2024-09-16T06:59:05.804480+0000 mgr.a (mgr.14373) 3552 : audit [DBG] from='client.87717 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:59:08.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:59:08 smithi157 bash[24585]: cluster 2024-09-16T06:59:07.109032+0000 mgr.a (mgr.14373) 3553 : cluster [DBG] pgmap v2462: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:59:08.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:59:08 smithi086 bash[24289]: cluster 2024-09-16T06:59:07.109032+0000 mgr.a (mgr.14373) 3553 : cluster [DBG] pgmap v2462: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:59:08.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:59:08 smithi047 bash[22744]: cluster 2024-09-16T06:59:07.109032+0000 mgr.a (mgr.14373) 3553 : cluster [DBG] pgmap v2462: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:59:10.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:59:10 smithi157 bash[24585]: cluster 2024-09-16T06:59:09.109818+0000 mgr.a (mgr.14373) 3554 : cluster [DBG] pgmap v2463: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:59:10.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:59:10 smithi086 bash[24289]: cluster 2024-09-16T06:59:09.109818+0000 mgr.a (mgr.14373) 3554 : cluster [DBG] pgmap v2463: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:59:10.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:59:10 smithi047 bash[22744]: cluster 2024-09-16T06:59:09.109818+0000 mgr.a (mgr.14373) 3554 : cluster [DBG] pgmap v2463: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:59:11.235 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:59:11.236 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:59:11.236 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:59:11.982 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:59:11.983 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:59:11.983 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:59:11.983 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:59:11.983 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:59:12.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:59:12 smithi157 bash[24585]: cluster 2024-09-16T06:59:11.110604+0000 mgr.a (mgr.14373) 3555 : cluster [DBG] pgmap v2464: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:59:12.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:59:12 smithi086 bash[24289]: cluster 2024-09-16T06:59:11.110604+0000 mgr.a (mgr.14373) 3555 : cluster [DBG] pgmap v2464: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:59:12.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:59:12 smithi047 bash[22744]: cluster 2024-09-16T06:59:11.110604+0000 mgr.a (mgr.14373) 3555 : cluster [DBG] pgmap v2464: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:59:13.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:59:13 smithi157 bash[24585]: audit 2024-09-16T06:59:11.570872+0000 mgr.a (mgr.14373) 3556 : audit [DBG] from='client.87789 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:59:13.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:59:13 smithi086 bash[24289]: audit 2024-09-16T06:59:11.570872+0000 mgr.a (mgr.14373) 3556 : audit [DBG] from='client.87789 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:59:13.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:59:13 smithi047 bash[22744]: audit 2024-09-16T06:59:11.570872+0000 mgr.a (mgr.14373) 3556 : audit [DBG] from='client.87789 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:59:14.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:59:14 smithi157 bash[24585]: cluster 2024-09-16T06:59:13.113282+0000 mgr.a (mgr.14373) 3557 : cluster [DBG] pgmap v2465: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:59:14.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:59:14 smithi086 bash[24289]: cluster 2024-09-16T06:59:13.113282+0000 mgr.a (mgr.14373) 3557 : cluster [DBG] pgmap v2465: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:59:14.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:59:14 smithi047 bash[22744]: cluster 2024-09-16T06:59:13.113282+0000 mgr.a (mgr.14373) 3557 : cluster [DBG] pgmap v2465: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T06:59:16.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:59:16 smithi157 bash[24585]: cluster 2024-09-16T06:59:15.114036+0000 mgr.a (mgr.14373) 3558 : cluster [DBG] pgmap v2466: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:59:16.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:59:16 smithi086 bash[24289]: cluster 2024-09-16T06:59:15.114036+0000 mgr.a (mgr.14373) 3558 : cluster [DBG] pgmap v2466: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:59:16.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:59:16 smithi047 bash[22744]: cluster 2024-09-16T06:59:15.114036+0000 mgr.a (mgr.14373) 3558 : cluster [DBG] pgmap v2466: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:59:16.984 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:59:16.988 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:59:16.988 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:59:17.716 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:59:17.717 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:59:17.717 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:59:17.717 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:59:17.717 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:59:18.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:59:18 smithi157 bash[24585]: cluster 2024-09-16T06:59:17.115047+0000 mgr.a (mgr.14373) 3559 : cluster [DBG] pgmap v2467: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:59:18.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:59:18 smithi157 bash[24585]: audit 2024-09-16T06:59:17.319008+0000 mgr.a (mgr.14373) 3560 : audit [DBG] from='client.87867 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:59:18.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:59:18 smithi086 bash[24289]: cluster 2024-09-16T06:59:17.115047+0000 mgr.a (mgr.14373) 3559 : cluster [DBG] pgmap v2467: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:59:18.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:59:18 smithi086 bash[24289]: audit 2024-09-16T06:59:17.319008+0000 mgr.a (mgr.14373) 3560 : audit [DBG] from='client.87867 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:59:18.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:59:18 smithi047 bash[22744]: cluster 2024-09-16T06:59:17.115047+0000 mgr.a (mgr.14373) 3559 : cluster [DBG] pgmap v2467: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:59:18.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:59:18 smithi047 bash[22744]: audit 2024-09-16T06:59:17.319008+0000 mgr.a (mgr.14373) 3560 : audit [DBG] from='client.87867 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:59:20.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:59:20 smithi157 bash[24585]: cluster 2024-09-16T06:59:19.115957+0000 mgr.a (mgr.14373) 3561 : cluster [DBG] pgmap v2468: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T06:59:20.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:59:20 smithi086 bash[24289]: cluster 2024-09-16T06:59:19.115957+0000 mgr.a (mgr.14373) 3561 : cluster [DBG] pgmap v2468: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T06:59:20.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:59:20 smithi047 bash[22744]: cluster 2024-09-16T06:59:19.115957+0000 mgr.a (mgr.14373) 3561 : cluster [DBG] pgmap v2468: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T06:59:22.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:59:22 smithi157 bash[24585]: cluster 2024-09-16T06:59:21.116735+0000 mgr.a (mgr.14373) 3562 : cluster [DBG] pgmap v2469: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T06:59:22.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:59:22 smithi086 bash[24289]: cluster 2024-09-16T06:59:21.116735+0000 mgr.a (mgr.14373) 3562 : cluster [DBG] pgmap v2469: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T06:59:22.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:59:22 smithi047 bash[22744]: cluster 2024-09-16T06:59:21.116735+0000 mgr.a (mgr.14373) 3562 : cluster [DBG] pgmap v2469: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T06:59:22.720 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:59:22.721 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:59:22.721 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:59:23.489 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:59:23.489 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:59:23.489 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:59:23.489 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:59:23.489 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:59:24.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:59:24 smithi157 bash[24585]: audit 2024-09-16T06:59:23.054468+0000 mgr.a (mgr.14373) 3563 : audit [DBG] from='client.87942 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:59:24.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:59:24 smithi157 bash[24585]: cluster 2024-09-16T06:59:23.119676+0000 mgr.a (mgr.14373) 3564 : cluster [DBG] pgmap v2470: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:59:24.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:59:24 smithi086 bash[24289]: audit 2024-09-16T06:59:23.054468+0000 mgr.a (mgr.14373) 3563 : audit [DBG] from='client.87942 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:59:24.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:59:24 smithi086 bash[24289]: cluster 2024-09-16T06:59:23.119676+0000 mgr.a (mgr.14373) 3564 : cluster [DBG] pgmap v2470: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:59:24.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:59:24 smithi047 bash[22744]: audit 2024-09-16T06:59:23.054468+0000 mgr.a (mgr.14373) 3563 : audit [DBG] from='client.87942 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:59:24.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:59:24 smithi047 bash[22744]: cluster 2024-09-16T06:59:23.119676+0000 mgr.a (mgr.14373) 3564 : cluster [DBG] pgmap v2470: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:59:26.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:59:26 smithi157 bash[24585]: cluster 2024-09-16T06:59:25.120658+0000 mgr.a (mgr.14373) 3565 : cluster [DBG] pgmap v2471: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:59:26.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:59:26 smithi086 bash[24289]: cluster 2024-09-16T06:59:25.120658+0000 mgr.a (mgr.14373) 3565 : cluster [DBG] pgmap v2471: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:59:26.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:59:26 smithi047 bash[22744]: cluster 2024-09-16T06:59:25.120658+0000 mgr.a (mgr.14373) 3565 : cluster [DBG] pgmap v2471: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:59:28.490 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:59:28.491 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:59:28.491 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:59:28.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:59:28 smithi157 bash[24585]: cluster 2024-09-16T06:59:27.122800+0000 mgr.a (mgr.14373) 3566 : cluster [DBG] pgmap v2472: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:59:28.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:59:28 smithi086 bash[24289]: cluster 2024-09-16T06:59:27.122800+0000 mgr.a (mgr.14373) 3566 : cluster [DBG] pgmap v2472: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:59:28.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:59:28 smithi047 bash[22744]: cluster 2024-09-16T06:59:27.122800+0000 mgr.a (mgr.14373) 3566 : cluster [DBG] pgmap v2472: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:59:29.249 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:59:29.249 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:59:29.250 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:59:29.250 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:59:29.250 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:59:30.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:59:30 smithi157 bash[24585]: audit 2024-09-16T06:59:28.828083+0000 mgr.a (mgr.14373) 3567 : audit [DBG] from='client.88014 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:59:30.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:59:30 smithi157 bash[24585]: cluster 2024-09-16T06:59:29.123388+0000 mgr.a (mgr.14373) 3568 : cluster [DBG] pgmap v2473: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:59:30.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:59:30 smithi086 bash[24289]: audit 2024-09-16T06:59:28.828083+0000 mgr.a (mgr.14373) 3567 : audit [DBG] from='client.88014 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:59:30.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:59:30 smithi086 bash[24289]: cluster 2024-09-16T06:59:29.123388+0000 mgr.a (mgr.14373) 3568 : cluster [DBG] pgmap v2473: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:59:30.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:59:30 smithi047 bash[22744]: audit 2024-09-16T06:59:28.828083+0000 mgr.a (mgr.14373) 3567 : audit [DBG] from='client.88014 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:59:30.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:59:30 smithi047 bash[22744]: cluster 2024-09-16T06:59:29.123388+0000 mgr.a (mgr.14373) 3568 : cluster [DBG] pgmap v2473: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:59:32.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:59:32 smithi157 bash[24585]: cluster 2024-09-16T06:59:31.124262+0000 mgr.a (mgr.14373) 3569 : cluster [DBG] pgmap v2474: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:59:32.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:59:32 smithi086 bash[24289]: cluster 2024-09-16T06:59:31.124262+0000 mgr.a (mgr.14373) 3569 : cluster [DBG] pgmap v2474: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:59:32.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:59:32 smithi047 bash[22744]: cluster 2024-09-16T06:59:31.124262+0000 mgr.a (mgr.14373) 3569 : cluster [DBG] pgmap v2474: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:59:34.251 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:59:34.252 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:59:34.252 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:59:34.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:59:34 smithi157 bash[24585]: cluster 2024-09-16T06:59:33.126453+0000 mgr.a (mgr.14373) 3570 : cluster [DBG] pgmap v2475: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:59:34.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:59:34 smithi086 bash[24289]: cluster 2024-09-16T06:59:33.126453+0000 mgr.a (mgr.14373) 3570 : cluster [DBG] pgmap v2475: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:59:34.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:59:34 smithi047 bash[22744]: cluster 2024-09-16T06:59:33.126453+0000 mgr.a (mgr.14373) 3570 : cluster [DBG] pgmap v2475: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:59:35.018 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:59:35.018 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:59:35.018 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:59:35.018 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:59:35.018 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:59:36.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:59:36 smithi157 bash[24585]: audit 2024-09-16T06:59:34.586213+0000 mgr.a (mgr.14373) 3571 : audit [DBG] from='client.88089 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:59:36.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:59:36 smithi157 bash[24585]: cluster 2024-09-16T06:59:35.126939+0000 mgr.a (mgr.14373) 3572 : cluster [DBG] pgmap v2476: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:59:36.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:59:36 smithi086 bash[24289]: audit 2024-09-16T06:59:34.586213+0000 mgr.a (mgr.14373) 3571 : audit [DBG] from='client.88089 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:59:36.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:59:36 smithi086 bash[24289]: cluster 2024-09-16T06:59:35.126939+0000 mgr.a (mgr.14373) 3572 : cluster [DBG] pgmap v2476: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:59:36.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:59:36 smithi047 bash[22744]: audit 2024-09-16T06:59:34.586213+0000 mgr.a (mgr.14373) 3571 : audit [DBG] from='client.88089 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:59:36.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:59:36 smithi047 bash[22744]: cluster 2024-09-16T06:59:35.126939+0000 mgr.a (mgr.14373) 3572 : cluster [DBG] pgmap v2476: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:59:38.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:59:38 smithi157 bash[24585]: cluster 2024-09-16T06:59:37.129027+0000 mgr.a (mgr.14373) 3573 : cluster [DBG] pgmap v2477: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:59:38.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:59:38 smithi086 bash[24289]: cluster 2024-09-16T06:59:37.129027+0000 mgr.a (mgr.14373) 3573 : cluster [DBG] pgmap v2477: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:59:38.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:59:38 smithi047 bash[22744]: cluster 2024-09-16T06:59:37.129027+0000 mgr.a (mgr.14373) 3573 : cluster [DBG] pgmap v2477: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:59:40.019 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:59:40.020 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:59:40.020 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:59:40.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:59:40 smithi157 bash[24585]: cluster 2024-09-16T06:59:39.129772+0000 mgr.a (mgr.14373) 3574 : cluster [DBG] pgmap v2478: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:59:40.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:59:40 smithi086 bash[24289]: cluster 2024-09-16T06:59:39.129772+0000 mgr.a (mgr.14373) 3574 : cluster [DBG] pgmap v2478: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:59:40.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:59:40 smithi047 bash[22744]: cluster 2024-09-16T06:59:39.129772+0000 mgr.a (mgr.14373) 3574 : cluster [DBG] pgmap v2478: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:59:40.803 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:59:40.804 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:59:40.804 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:59:40.804 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:59:40.804 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:59:41.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:59:41 smithi157 bash[24585]: audit 2024-09-16T06:59:40.363972+0000 mgr.a (mgr.14373) 3575 : audit [DBG] from='client.88164 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:59:41.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:59:41 smithi086 bash[24289]: audit 2024-09-16T06:59:40.363972+0000 mgr.a (mgr.14373) 3575 : audit [DBG] from='client.88164 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:59:41.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:59:41 smithi047 bash[22744]: audit 2024-09-16T06:59:40.363972+0000 mgr.a (mgr.14373) 3575 : audit [DBG] from='client.88164 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:59:42.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:59:42 smithi157 bash[24585]: cluster 2024-09-16T06:59:41.130685+0000 mgr.a (mgr.14373) 3576 : cluster [DBG] pgmap v2479: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:59:42.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:59:42 smithi086 bash[24289]: cluster 2024-09-16T06:59:41.130685+0000 mgr.a (mgr.14373) 3576 : cluster [DBG] pgmap v2479: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:59:42.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:59:42 smithi047 bash[22744]: cluster 2024-09-16T06:59:41.130685+0000 mgr.a (mgr.14373) 3576 : cluster [DBG] pgmap v2479: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:59:44.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:59:44 smithi157 bash[24585]: cluster 2024-09-16T06:59:43.132847+0000 mgr.a (mgr.14373) 3577 : cluster [DBG] pgmap v2480: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:59:44.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:59:44 smithi086 bash[24289]: cluster 2024-09-16T06:59:43.132847+0000 mgr.a (mgr.14373) 3577 : cluster [DBG] pgmap v2480: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:59:44.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:59:44 smithi047 bash[22744]: cluster 2024-09-16T06:59:43.132847+0000 mgr.a (mgr.14373) 3577 : cluster [DBG] pgmap v2480: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T06:59:45.805 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:59:45.806 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:59:45.806 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:59:46.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:59:46 smithi157 bash[24585]: cluster 2024-09-16T06:59:45.133589+0000 mgr.a (mgr.14373) 3578 : cluster [DBG] pgmap v2481: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:59:46.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:59:46 smithi086 bash[24289]: cluster 2024-09-16T06:59:45.133589+0000 mgr.a (mgr.14373) 3578 : cluster [DBG] pgmap v2481: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:59:46.569 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:59:46.569 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:59:46.569 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:59:46.569 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:59:46.569 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:59:46.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:59:46 smithi047 bash[22744]: cluster 2024-09-16T06:59:45.133589+0000 mgr.a (mgr.14373) 3578 : cluster [DBG] pgmap v2481: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:59:47.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:59:47 smithi157 bash[24585]: audit 2024-09-16T06:59:46.143077+0000 mgr.a (mgr.14373) 3579 : audit [DBG] from='client.88239 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:59:47.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:59:47 smithi086 bash[24289]: audit 2024-09-16T06:59:46.143077+0000 mgr.a (mgr.14373) 3579 : audit [DBG] from='client.88239 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:59:47.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:59:47 smithi047 bash[22744]: audit 2024-09-16T06:59:46.143077+0000 mgr.a (mgr.14373) 3579 : audit [DBG] from='client.88239 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:59:48.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:59:48 smithi157 bash[24585]: cluster 2024-09-16T06:59:47.136435+0000 mgr.a (mgr.14373) 3580 : cluster [DBG] pgmap v2482: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-16T06:59:48.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:59:48 smithi086 bash[24289]: cluster 2024-09-16T06:59:47.136435+0000 mgr.a (mgr.14373) 3580 : cluster [DBG] pgmap v2482: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-16T06:59:48.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:59:48 smithi047 bash[22744]: cluster 2024-09-16T06:59:47.136435+0000 mgr.a (mgr.14373) 3580 : cluster [DBG] pgmap v2482: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-16T06:59:50.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:59:50 smithi157 bash[24585]: cluster 2024-09-16T06:59:49.137213+0000 mgr.a (mgr.14373) 3581 : cluster [DBG] pgmap v2483: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T06:59:50.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:59:50 smithi086 bash[24289]: cluster 2024-09-16T06:59:49.137213+0000 mgr.a (mgr.14373) 3581 : cluster [DBG] pgmap v2483: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T06:59:50.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:59:50 smithi047 bash[22744]: cluster 2024-09-16T06:59:49.137213+0000 mgr.a (mgr.14373) 3581 : cluster [DBG] pgmap v2483: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T06:59:51.570 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:59:51.571 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:59:51.571 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:59:52.333 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:59:52.334 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:59:52.334 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:59:52.334 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:59:52.334 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:59:52.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:59:52 smithi157 bash[24585]: cluster 2024-09-16T06:59:51.137981+0000 mgr.a (mgr.14373) 3582 : cluster [DBG] pgmap v2484: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T06:59:52.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:59:52 smithi086 bash[24289]: cluster 2024-09-16T06:59:51.137981+0000 mgr.a (mgr.14373) 3582 : cluster [DBG] pgmap v2484: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T06:59:52.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:59:52 smithi047 bash[22744]: cluster 2024-09-16T06:59:51.137981+0000 mgr.a (mgr.14373) 3582 : cluster [DBG] pgmap v2484: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T06:59:53.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:59:53 smithi157 bash[24585]: audit 2024-09-16T06:59:51.911373+0000 mgr.a (mgr.14373) 3583 : audit [DBG] from='client.88317 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:59:53.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:59:53 smithi086 bash[24289]: audit 2024-09-16T06:59:51.911373+0000 mgr.a (mgr.14373) 3583 : audit [DBG] from='client.88317 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:59:53.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:59:53 smithi047 bash[22744]: audit 2024-09-16T06:59:51.911373+0000 mgr.a (mgr.14373) 3583 : audit [DBG] from='client.88317 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:59:54.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:59:54 smithi157 bash[24585]: cluster 2024-09-16T06:59:53.140799+0000 mgr.a (mgr.14373) 3584 : cluster [DBG] pgmap v2485: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:59:54.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:59:54 smithi086 bash[24289]: cluster 2024-09-16T06:59:53.140799+0000 mgr.a (mgr.14373) 3584 : cluster [DBG] pgmap v2485: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:59:54.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:59:54 smithi047 bash[22744]: cluster 2024-09-16T06:59:53.140799+0000 mgr.a (mgr.14373) 3584 : cluster [DBG] pgmap v2485: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:59:56.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:59:56 smithi157 bash[24585]: cluster 2024-09-16T06:59:55.141748+0000 mgr.a (mgr.14373) 3585 : cluster [DBG] pgmap v2486: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:59:56.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:59:56 smithi086 bash[24289]: cluster 2024-09-16T06:59:55.141748+0000 mgr.a (mgr.14373) 3585 : cluster [DBG] pgmap v2486: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:59:56.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:59:56 smithi047 bash[22744]: cluster 2024-09-16T06:59:55.141748+0000 mgr.a (mgr.14373) 3585 : cluster [DBG] pgmap v2486: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T06:59:57.335 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T06:59:57.335 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T06:59:57.336 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T06:59:58.111 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T06:59:58.112 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T06:59:58.112 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T06:59:58.112 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T06:59:58.112 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T06:59:58.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:59:58 smithi086 bash[24289]: cluster 2024-09-16T06:59:57.143864+0000 mgr.a (mgr.14373) 3586 : cluster [DBG] pgmap v2487: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:59:58.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:59:58 smithi047 bash[22744]: cluster 2024-09-16T06:59:57.143864+0000 mgr.a (mgr.14373) 3586 : cluster [DBG] pgmap v2487: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:59:58.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:59:58 smithi157 bash[24585]: cluster 2024-09-16T06:59:57.143864+0000 mgr.a (mgr.14373) 3586 : cluster [DBG] pgmap v2487: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T06:59:59.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 06:59:59 smithi086 bash[24289]: audit 2024-09-16T06:59:57.671240+0000 mgr.a (mgr.14373) 3587 : audit [DBG] from='client.88392 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:59:59.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 06:59:59 smithi047 bash[22744]: audit 2024-09-16T06:59:57.671240+0000 mgr.a (mgr.14373) 3587 : audit [DBG] from='client.88392 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T06:59:59.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 06:59:59 smithi157 bash[24585]: audit 2024-09-16T06:59:57.671240+0000 mgr.a (mgr.14373) 3587 : audit [DBG] from='client.88392 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:00:00.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:00:00 smithi086 bash[24289]: cluster 2024-09-16T06:59:59.144843+0000 mgr.a (mgr.14373) 3588 : cluster [DBG] pgmap v2488: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-16T07:00:00.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:00:00 smithi086 bash[24289]: audit 2024-09-16T06:59:59.411866+0000 mon.b (mon.2) 366 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T07:00:00.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:00:00 smithi086 bash[24289]: cluster 2024-09-16T07:00:00.000121+0000 mon.a (mon.0) 779 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-16T07:00:00.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:00:00 smithi086 bash[24289]: audit 2024-09-16T07:00:00.255277+0000 mon.b (mon.2) 367 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T07:00:00.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:00:00 smithi086 bash[24289]: audit 2024-09-16T07:00:00.257193+0000 mon.b (mon.2) 368 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T07:00:00.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:00:00 smithi086 bash[24289]: audit 2024-09-16T07:00:00.269413+0000 mon.a (mon.0) 780 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:00:00.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:00:00 smithi086 bash[24289]: audit 2024-09-16T07:00:00.270584+0000 mon.b (mon.2) 369 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:00:00.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:00:00 smithi047 bash[22744]: cluster 2024-09-16T06:59:59.144843+0000 mgr.a (mgr.14373) 3588 : cluster [DBG] pgmap v2488: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-16T07:00:00.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:00:00 smithi047 bash[22744]: audit 2024-09-16T06:59:59.411866+0000 mon.b (mon.2) 366 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T07:00:00.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:00:00 smithi047 bash[22744]: cluster 2024-09-16T07:00:00.000121+0000 mon.a (mon.0) 779 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-16T07:00:00.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:00:00 smithi047 bash[22744]: audit 2024-09-16T07:00:00.255277+0000 mon.b (mon.2) 367 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T07:00:00.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:00:00 smithi047 bash[22744]: audit 2024-09-16T07:00:00.257193+0000 mon.b (mon.2) 368 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T07:00:00.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:00:00 smithi047 bash[22744]: audit 2024-09-16T07:00:00.269413+0000 mon.a (mon.0) 780 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:00:00.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:00:00 smithi047 bash[22744]: audit 2024-09-16T07:00:00.270584+0000 mon.b (mon.2) 369 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:00:00.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:00:00 smithi157 bash[24585]: cluster 2024-09-16T06:59:59.144843+0000 mgr.a (mgr.14373) 3588 : cluster [DBG] pgmap v2488: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-16T07:00:00.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:00:00 smithi157 bash[24585]: audit 2024-09-16T06:59:59.411866+0000 mon.b (mon.2) 366 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T07:00:00.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:00:00 smithi157 bash[24585]: cluster 2024-09-16T07:00:00.000121+0000 mon.a (mon.0) 779 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-16T07:00:00.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:00:00 smithi157 bash[24585]: audit 2024-09-16T07:00:00.255277+0000 mon.b (mon.2) 367 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T07:00:00.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:00:00 smithi157 bash[24585]: audit 2024-09-16T07:00:00.257193+0000 mon.b (mon.2) 368 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T07:00:00.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:00:00 smithi157 bash[24585]: audit 2024-09-16T07:00:00.269413+0000 mon.a (mon.0) 780 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:00:00.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:00:00 smithi157 bash[24585]: audit 2024-09-16T07:00:00.270584+0000 mon.b (mon.2) 369 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:00:01.319 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 07:00:01 smithi047 bash[22994]: debug 2024-09-16T07:00:01.000+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T07:00:01.319 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 07:00:01 smithi047 bash[22994]: debug 2024-09-16T07:00:01.000+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T07:00:01.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:00:01 smithi047 bash[22744]: audit 2024-09-16T07:00:00.275267+0000 mgr.a (mgr.14373) 3589 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:00:01.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:00:01 smithi157 bash[24585]: audit 2024-09-16T07:00:00.275267+0000 mgr.a (mgr.14373) 3589 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:00:01.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:00:01 smithi086 bash[24289]: audit 2024-09-16T07:00:00.275267+0000 mgr.a (mgr.14373) 3589 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:00:02.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:00:02 smithi047 bash[22744]: audit 2024-09-16T07:00:01.003004+0000 mgr.a (mgr.14373) 3590 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T07:00:02.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:00:02 smithi047 bash[22744]: cephadm 2024-09-16T07:00:01.005213+0000 mgr.a (mgr.14373) 3591 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T07:00:02.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:00:02 smithi047 bash[22744]: cluster 2024-09-16T07:00:01.145814+0000 mgr.a (mgr.14373) 3592 : cluster [DBG] pgmap v2489: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-16T07:00:02.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:00:02 smithi157 bash[24585]: audit 2024-09-16T07:00:01.003004+0000 mgr.a (mgr.14373) 3590 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T07:00:02.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:00:02 smithi157 bash[24585]: cephadm 2024-09-16T07:00:01.005213+0000 mgr.a (mgr.14373) 3591 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T07:00:02.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:00:02 smithi157 bash[24585]: cluster 2024-09-16T07:00:01.145814+0000 mgr.a (mgr.14373) 3592 : cluster [DBG] pgmap v2489: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-16T07:00:02.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:00:02 smithi086 bash[24289]: audit 2024-09-16T07:00:01.003004+0000 mgr.a (mgr.14373) 3590 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T07:00:02.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:00:02 smithi086 bash[24289]: cephadm 2024-09-16T07:00:01.005213+0000 mgr.a (mgr.14373) 3591 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T07:00:02.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:00:02 smithi086 bash[24289]: cluster 2024-09-16T07:00:01.145814+0000 mgr.a (mgr.14373) 3592 : cluster [DBG] pgmap v2489: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-16T07:00:03.113 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:00:03.114 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:00:03.114 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:00:03.901 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:00:03.901 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:00:03.902 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:00:03.902 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:00:03.902 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:00:04.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:00:04 smithi047 bash[22744]: cluster 2024-09-16T07:00:03.147698+0000 mgr.a (mgr.14373) 3593 : cluster [DBG] pgmap v2490: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:00:04.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:00:04 smithi157 bash[24585]: cluster 2024-09-16T07:00:03.147698+0000 mgr.a (mgr.14373) 3593 : cluster [DBG] pgmap v2490: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:00:04.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:00:04 smithi086 bash[24289]: cluster 2024-09-16T07:00:03.147698+0000 mgr.a (mgr.14373) 3593 : cluster [DBG] pgmap v2490: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:00:05.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:00:05 smithi157 bash[24585]: audit 2024-09-16T07:00:03.452816+0000 mgr.a (mgr.14373) 3594 : audit [DBG] from='client.88575 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:00:05.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:00:05 smithi086 bash[24289]: audit 2024-09-16T07:00:03.452816+0000 mgr.a (mgr.14373) 3594 : audit [DBG] from='client.88575 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:00:05.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:00:05 smithi047 bash[22744]: audit 2024-09-16T07:00:03.452816+0000 mgr.a (mgr.14373) 3594 : audit [DBG] from='client.88575 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:00:06.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:00:06 smithi157 bash[24585]: cluster 2024-09-16T07:00:05.148651+0000 mgr.a (mgr.14373) 3595 : cluster [DBG] pgmap v2491: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:00:06.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:00:06 smithi086 bash[24289]: cluster 2024-09-16T07:00:05.148651+0000 mgr.a (mgr.14373) 3595 : cluster [DBG] pgmap v2491: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:00:06.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:00:06 smithi047 bash[22744]: cluster 2024-09-16T07:00:05.148651+0000 mgr.a (mgr.14373) 3595 : cluster [DBG] pgmap v2491: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:00:08.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:00:08 smithi157 bash[24585]: cluster 2024-09-16T07:00:07.150817+0000 mgr.a (mgr.14373) 3596 : cluster [DBG] pgmap v2492: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:00:08.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:00:08 smithi086 bash[24289]: cluster 2024-09-16T07:00:07.150817+0000 mgr.a (mgr.14373) 3596 : cluster [DBG] pgmap v2492: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:00:08.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:00:08 smithi047 bash[22744]: cluster 2024-09-16T07:00:07.150817+0000 mgr.a (mgr.14373) 3596 : cluster [DBG] pgmap v2492: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:00:08.903 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:00:08.903 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:00:08.903 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:00:09.648 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:00:09.648 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:00:09.648 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:00:09.648 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:00:09.648 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:00:10.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:00:10 smithi157 bash[24585]: cluster 2024-09-16T07:00:09.151330+0000 mgr.a (mgr.14373) 3597 : cluster [DBG] pgmap v2493: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:00:10.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:00:10 smithi157 bash[24585]: audit 2024-09-16T07:00:09.235161+0000 mgr.a (mgr.14373) 3598 : audit [DBG] from='client.88650 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:00:10.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:00:10 smithi086 bash[24289]: cluster 2024-09-16T07:00:09.151330+0000 mgr.a (mgr.14373) 3597 : cluster [DBG] pgmap v2493: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:00:10.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:00:10 smithi086 bash[24289]: audit 2024-09-16T07:00:09.235161+0000 mgr.a (mgr.14373) 3598 : audit [DBG] from='client.88650 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:00:10.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:00:10 smithi047 bash[22744]: cluster 2024-09-16T07:00:09.151330+0000 mgr.a (mgr.14373) 3597 : cluster [DBG] pgmap v2493: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:00:10.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:00:10 smithi047 bash[22744]: audit 2024-09-16T07:00:09.235161+0000 mgr.a (mgr.14373) 3598 : audit [DBG] from='client.88650 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:00:12.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:00:12 smithi157 bash[24585]: cluster 2024-09-16T07:00:11.152203+0000 mgr.a (mgr.14373) 3599 : cluster [DBG] pgmap v2494: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:00:12.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:00:12 smithi086 bash[24289]: cluster 2024-09-16T07:00:11.152203+0000 mgr.a (mgr.14373) 3599 : cluster [DBG] pgmap v2494: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:00:12.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:00:12 smithi047 bash[22744]: cluster 2024-09-16T07:00:11.152203+0000 mgr.a (mgr.14373) 3599 : cluster [DBG] pgmap v2494: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:00:14.649 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:00:14.650 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:00:14.650 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:00:14.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:00:14 smithi157 bash[24585]: cluster 2024-09-16T07:00:13.154449+0000 mgr.a (mgr.14373) 3600 : cluster [DBG] pgmap v2495: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:00:14.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:00:14 smithi086 bash[24289]: cluster 2024-09-16T07:00:13.154449+0000 mgr.a (mgr.14373) 3600 : cluster [DBG] pgmap v2495: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:00:14.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:00:14 smithi047 bash[22744]: cluster 2024-09-16T07:00:13.154449+0000 mgr.a (mgr.14373) 3600 : cluster [DBG] pgmap v2495: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:00:15.401 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:00:15.401 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:00:15.402 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:00:15.402 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:00:15.402 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:00:16.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:00:16 smithi157 bash[24585]: audit 2024-09-16T07:00:14.982581+0000 mgr.a (mgr.14373) 3601 : audit [DBG] from='client.88725 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:00:16.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:00:16 smithi157 bash[24585]: cluster 2024-09-16T07:00:15.154961+0000 mgr.a (mgr.14373) 3602 : cluster [DBG] pgmap v2496: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:00:16.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:00:16 smithi086 bash[24289]: audit 2024-09-16T07:00:14.982581+0000 mgr.a (mgr.14373) 3601 : audit [DBG] from='client.88725 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:00:16.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:00:16 smithi086 bash[24289]: cluster 2024-09-16T07:00:15.154961+0000 mgr.a (mgr.14373) 3602 : cluster [DBG] pgmap v2496: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:00:16.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:00:16 smithi047 bash[22744]: audit 2024-09-16T07:00:14.982581+0000 mgr.a (mgr.14373) 3601 : audit [DBG] from='client.88725 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:00:16.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:00:16 smithi047 bash[22744]: cluster 2024-09-16T07:00:15.154961+0000 mgr.a (mgr.14373) 3602 : cluster [DBG] pgmap v2496: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:00:18.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:00:18 smithi157 bash[24585]: cluster 2024-09-16T07:00:17.157139+0000 mgr.a (mgr.14373) 3603 : cluster [DBG] pgmap v2497: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:00:18.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:00:18 smithi086 bash[24289]: cluster 2024-09-16T07:00:17.157139+0000 mgr.a (mgr.14373) 3603 : cluster [DBG] pgmap v2497: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:00:18.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:00:18 smithi047 bash[22744]: cluster 2024-09-16T07:00:17.157139+0000 mgr.a (mgr.14373) 3603 : cluster [DBG] pgmap v2497: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:00:20.403 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:00:20.403 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:00:20.403 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:00:20.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:00:20 smithi157 bash[24585]: cluster 2024-09-16T07:00:19.157905+0000 mgr.a (mgr.14373) 3604 : cluster [DBG] pgmap v2498: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:00:20.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:00:20 smithi086 bash[24289]: cluster 2024-09-16T07:00:19.157905+0000 mgr.a (mgr.14373) 3604 : cluster [DBG] pgmap v2498: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:00:20.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:00:20 smithi047 bash[22744]: cluster 2024-09-16T07:00:19.157905+0000 mgr.a (mgr.14373) 3604 : cluster [DBG] pgmap v2498: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:00:21.179 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:00:21.180 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:00:21.180 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:00:21.180 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:00:21.180 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:00:22.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:00:22 smithi157 bash[24585]: audit 2024-09-16T07:00:20.744849+0000 mgr.a (mgr.14373) 3605 : audit [DBG] from='client.88800 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:00:22.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:00:22 smithi157 bash[24585]: cluster 2024-09-16T07:00:21.158407+0000 mgr.a (mgr.14373) 3606 : cluster [DBG] pgmap v2499: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:00:22.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:00:22 smithi086 bash[24289]: audit 2024-09-16T07:00:20.744849+0000 mgr.a (mgr.14373) 3605 : audit [DBG] from='client.88800 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:00:22.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:00:22 smithi086 bash[24289]: cluster 2024-09-16T07:00:21.158407+0000 mgr.a (mgr.14373) 3606 : cluster [DBG] pgmap v2499: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:00:22.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:00:22 smithi047 bash[22744]: audit 2024-09-16T07:00:20.744849+0000 mgr.a (mgr.14373) 3605 : audit [DBG] from='client.88800 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:00:22.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:00:22 smithi047 bash[22744]: cluster 2024-09-16T07:00:21.158407+0000 mgr.a (mgr.14373) 3606 : cluster [DBG] pgmap v2499: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:00:24.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:00:24 smithi157 bash[24585]: cluster 2024-09-16T07:00:23.160714+0000 mgr.a (mgr.14373) 3607 : cluster [DBG] pgmap v2500: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:00:24.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:00:24 smithi086 bash[24289]: cluster 2024-09-16T07:00:23.160714+0000 mgr.a (mgr.14373) 3607 : cluster [DBG] pgmap v2500: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:00:24.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:00:24 smithi047 bash[22744]: cluster 2024-09-16T07:00:23.160714+0000 mgr.a (mgr.14373) 3607 : cluster [DBG] pgmap v2500: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:00:26.181 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:00:26.182 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:00:26.182 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:00:26.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:00:26 smithi157 bash[24585]: cluster 2024-09-16T07:00:25.161494+0000 mgr.a (mgr.14373) 3608 : cluster [DBG] pgmap v2501: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:00:26.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:00:26 smithi086 bash[24289]: cluster 2024-09-16T07:00:25.161494+0000 mgr.a (mgr.14373) 3608 : cluster [DBG] pgmap v2501: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:00:26.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:00:26 smithi047 bash[22744]: cluster 2024-09-16T07:00:25.161494+0000 mgr.a (mgr.14373) 3608 : cluster [DBG] pgmap v2501: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:00:26.946 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:00:26.946 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:00:26.946 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:00:26.946 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:00:26.946 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:00:28.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:00:28 smithi157 bash[24585]: audit 2024-09-16T07:00:26.520739+0000 mgr.a (mgr.14373) 3609 : audit [DBG] from='client.88878 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:00:28.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:00:28 smithi157 bash[24585]: cluster 2024-09-16T07:00:27.164270+0000 mgr.a (mgr.14373) 3610 : cluster [DBG] pgmap v2502: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:00:28.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:00:28 smithi086 bash[24289]: audit 2024-09-16T07:00:26.520739+0000 mgr.a (mgr.14373) 3609 : audit [DBG] from='client.88878 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:00:28.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:00:28 smithi086 bash[24289]: cluster 2024-09-16T07:00:27.164270+0000 mgr.a (mgr.14373) 3610 : cluster [DBG] pgmap v2502: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:00:28.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:00:28 smithi047 bash[22744]: audit 2024-09-16T07:00:26.520739+0000 mgr.a (mgr.14373) 3609 : audit [DBG] from='client.88878 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:00:28.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:00:28 smithi047 bash[22744]: cluster 2024-09-16T07:00:27.164270+0000 mgr.a (mgr.14373) 3610 : cluster [DBG] pgmap v2502: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:00:30.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:00:30 smithi157 bash[24585]: cluster 2024-09-16T07:00:29.165075+0000 mgr.a (mgr.14373) 3611 : cluster [DBG] pgmap v2503: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:00:30.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:00:30 smithi086 bash[24289]: cluster 2024-09-16T07:00:29.165075+0000 mgr.a (mgr.14373) 3611 : cluster [DBG] pgmap v2503: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:00:30.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:00:30 smithi047 bash[22744]: cluster 2024-09-16T07:00:29.165075+0000 mgr.a (mgr.14373) 3611 : cluster [DBG] pgmap v2503: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:00:31.947 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:00:31.948 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:00:31.948 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:00:32.726 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:00:32.726 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:00:32.727 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:00:32.727 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:00:32.727 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:00:32.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:00:32 smithi157 bash[24585]: cluster 2024-09-16T07:00:31.165841+0000 mgr.a (mgr.14373) 3612 : cluster [DBG] pgmap v2504: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T07:00:32.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:00:32 smithi086 bash[24289]: cluster 2024-09-16T07:00:31.165841+0000 mgr.a (mgr.14373) 3612 : cluster [DBG] pgmap v2504: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T07:00:32.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:00:32 smithi047 bash[22744]: cluster 2024-09-16T07:00:31.165841+0000 mgr.a (mgr.14373) 3612 : cluster [DBG] pgmap v2504: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T07:00:33.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:00:33 smithi157 bash[24585]: audit 2024-09-16T07:00:32.290999+0000 mgr.a (mgr.14373) 3613 : audit [DBG] from='client.88953 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:00:33.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:00:33 smithi086 bash[24289]: audit 2024-09-16T07:00:32.290999+0000 mgr.a (mgr.14373) 3613 : audit [DBG] from='client.88953 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:00:33.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:00:33 smithi047 bash[22744]: audit 2024-09-16T07:00:32.290999+0000 mgr.a (mgr.14373) 3613 : audit [DBG] from='client.88953 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:00:34.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:00:34 smithi157 bash[24585]: cluster 2024-09-16T07:00:33.168830+0000 mgr.a (mgr.14373) 3614 : cluster [DBG] pgmap v2505: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:00:34.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:00:34 smithi086 bash[24289]: cluster 2024-09-16T07:00:33.168830+0000 mgr.a (mgr.14373) 3614 : cluster [DBG] pgmap v2505: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:00:34.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:00:34 smithi047 bash[22744]: cluster 2024-09-16T07:00:33.168830+0000 mgr.a (mgr.14373) 3614 : cluster [DBG] pgmap v2505: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:00:35.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:00:35 smithi157 bash[24585]: cluster 2024-09-16T07:00:35.169623+0000 mgr.a (mgr.14373) 3615 : cluster [DBG] pgmap v2506: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:00:35.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:00:35 smithi086 bash[24289]: cluster 2024-09-16T07:00:35.169623+0000 mgr.a (mgr.14373) 3615 : cluster [DBG] pgmap v2506: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:00:35.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:00:35 smithi047 bash[22744]: cluster 2024-09-16T07:00:35.169623+0000 mgr.a (mgr.14373) 3615 : cluster [DBG] pgmap v2506: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:00:37.728 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:00:37.728 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:00:37.728 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:00:38.502 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:00:38.502 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:00:38.502 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:00:38.502 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:00:38.502 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:00:38.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:00:38 smithi157 bash[24585]: cluster 2024-09-16T07:00:37.171563+0000 mgr.a (mgr.14373) 3616 : cluster [DBG] pgmap v2507: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:00:38.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:00:38 smithi086 bash[24289]: cluster 2024-09-16T07:00:37.171563+0000 mgr.a (mgr.14373) 3616 : cluster [DBG] pgmap v2507: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:00:38.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:00:38 smithi047 bash[22744]: cluster 2024-09-16T07:00:37.171563+0000 mgr.a (mgr.14373) 3616 : cluster [DBG] pgmap v2507: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:00:39.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:00:39 smithi157 bash[24585]: audit 2024-09-16T07:00:38.072646+0000 mgr.a (mgr.14373) 3617 : audit [DBG] from='client.89025 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:00:39.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:00:39 smithi086 bash[24289]: audit 2024-09-16T07:00:38.072646+0000 mgr.a (mgr.14373) 3617 : audit [DBG] from='client.89025 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:00:39.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:00:39 smithi047 bash[22744]: audit 2024-09-16T07:00:38.072646+0000 mgr.a (mgr.14373) 3617 : audit [DBG] from='client.89025 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:00:40.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:00:40 smithi157 bash[24585]: cluster 2024-09-16T07:00:39.172535+0000 mgr.a (mgr.14373) 3618 : cluster [DBG] pgmap v2508: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:00:40.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:00:40 smithi086 bash[24289]: cluster 2024-09-16T07:00:39.172535+0000 mgr.a (mgr.14373) 3618 : cluster [DBG] pgmap v2508: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:00:40.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:00:40 smithi047 bash[22744]: cluster 2024-09-16T07:00:39.172535+0000 mgr.a (mgr.14373) 3618 : cluster [DBG] pgmap v2508: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:00:42.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:00:42 smithi157 bash[24585]: cluster 2024-09-16T07:00:41.173298+0000 mgr.a (mgr.14373) 3619 : cluster [DBG] pgmap v2509: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:00:42.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:00:42 smithi086 bash[24289]: cluster 2024-09-16T07:00:41.173298+0000 mgr.a (mgr.14373) 3619 : cluster [DBG] pgmap v2509: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:00:42.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:00:42 smithi047 bash[22744]: cluster 2024-09-16T07:00:41.173298+0000 mgr.a (mgr.14373) 3619 : cluster [DBG] pgmap v2509: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:00:43.503 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:00:43.504 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:00:43.504 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:00:44.267 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:00:44.267 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:00:44.267 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:00:44.267 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:00:44.267 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:00:44.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:00:44 smithi157 bash[24585]: cluster 2024-09-16T07:00:43.175492+0000 mgr.a (mgr.14373) 3620 : cluster [DBG] pgmap v2510: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:00:44.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:00:44 smithi086 bash[24289]: cluster 2024-09-16T07:00:43.175492+0000 mgr.a (mgr.14373) 3620 : cluster [DBG] pgmap v2510: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:00:44.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:00:44 smithi047 bash[22744]: cluster 2024-09-16T07:00:43.175492+0000 mgr.a (mgr.14373) 3620 : cluster [DBG] pgmap v2510: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:00:45.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:00:45 smithi157 bash[24585]: audit 2024-09-16T07:00:43.838418+0000 mgr.a (mgr.14373) 3621 : audit [DBG] from='client.89097 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:00:45.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:00:45 smithi086 bash[24289]: audit 2024-09-16T07:00:43.838418+0000 mgr.a (mgr.14373) 3621 : audit [DBG] from='client.89097 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:00:45.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:00:45 smithi047 bash[22744]: audit 2024-09-16T07:00:43.838418+0000 mgr.a (mgr.14373) 3621 : audit [DBG] from='client.89097 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:00:46.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:00:46 smithi157 bash[24585]: cluster 2024-09-16T07:00:45.176438+0000 mgr.a (mgr.14373) 3622 : cluster [DBG] pgmap v2511: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:00:46.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:00:46 smithi086 bash[24289]: cluster 2024-09-16T07:00:45.176438+0000 mgr.a (mgr.14373) 3622 : cluster [DBG] pgmap v2511: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:00:46.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:00:46 smithi047 bash[22744]: cluster 2024-09-16T07:00:45.176438+0000 mgr.a (mgr.14373) 3622 : cluster [DBG] pgmap v2511: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:00:48.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:00:48 smithi157 bash[24585]: cluster 2024-09-16T07:00:47.178658+0000 mgr.a (mgr.14373) 3623 : cluster [DBG] pgmap v2512: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:00:48.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:00:48 smithi086 bash[24289]: cluster 2024-09-16T07:00:47.178658+0000 mgr.a (mgr.14373) 3623 : cluster [DBG] pgmap v2512: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:00:48.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:00:48 smithi047 bash[22744]: cluster 2024-09-16T07:00:47.178658+0000 mgr.a (mgr.14373) 3623 : cluster [DBG] pgmap v2512: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:00:49.268 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:00:49.269 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:00:49.269 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:00:50.024 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:00:50.024 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:00:50.025 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:00:50.025 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:00:50.025 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:00:50.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:00:50 smithi157 bash[24585]: cluster 2024-09-16T07:00:49.179400+0000 mgr.a (mgr.14373) 3624 : cluster [DBG] pgmap v2513: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:00:50.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:00:50 smithi086 bash[24289]: cluster 2024-09-16T07:00:49.179400+0000 mgr.a (mgr.14373) 3624 : cluster [DBG] pgmap v2513: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:00:50.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:00:50 smithi047 bash[22744]: cluster 2024-09-16T07:00:49.179400+0000 mgr.a (mgr.14373) 3624 : cluster [DBG] pgmap v2513: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:00:51.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:00:51 smithi157 bash[24585]: audit 2024-09-16T07:00:49.603378+0000 mgr.a (mgr.14373) 3625 : audit [DBG] from='client.89166 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:00:51.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:00:51 smithi086 bash[24289]: audit 2024-09-16T07:00:49.603378+0000 mgr.a (mgr.14373) 3625 : audit [DBG] from='client.89166 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:00:51.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:00:51 smithi047 bash[22744]: audit 2024-09-16T07:00:49.603378+0000 mgr.a (mgr.14373) 3625 : audit [DBG] from='client.89166 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:00:52.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:00:52 smithi157 bash[24585]: cluster 2024-09-16T07:00:51.180440+0000 mgr.a (mgr.14373) 3626 : cluster [DBG] pgmap v2514: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:00:52.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:00:52 smithi086 bash[24289]: cluster 2024-09-16T07:00:51.180440+0000 mgr.a (mgr.14373) 3626 : cluster [DBG] pgmap v2514: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:00:52.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:00:52 smithi047 bash[22744]: cluster 2024-09-16T07:00:51.180440+0000 mgr.a (mgr.14373) 3626 : cluster [DBG] pgmap v2514: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:00:54.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:00:54 smithi157 bash[24585]: cluster 2024-09-16T07:00:53.182889+0000 mgr.a (mgr.14373) 3627 : cluster [DBG] pgmap v2515: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:00:54.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:00:54 smithi086 bash[24289]: cluster 2024-09-16T07:00:53.182889+0000 mgr.a (mgr.14373) 3627 : cluster [DBG] pgmap v2515: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:00:54.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:00:54 smithi047 bash[22744]: cluster 2024-09-16T07:00:53.182889+0000 mgr.a (mgr.14373) 3627 : cluster [DBG] pgmap v2515: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:00:55.025 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:00:55.026 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:00:55.027 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:00:55.788 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:00:55.788 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:00:55.788 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:00:55.788 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:00:55.789 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:00:56.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:00:56 smithi157 bash[24585]: cluster 2024-09-16T07:00:55.183664+0000 mgr.a (mgr.14373) 3628 : cluster [DBG] pgmap v2516: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:00:56.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:00:56 smithi157 bash[24585]: audit 2024-09-16T07:00:55.361897+0000 mgr.a (mgr.14373) 3629 : audit [DBG] from='client.89241 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:00:56.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:00:56 smithi086 bash[24289]: cluster 2024-09-16T07:00:55.183664+0000 mgr.a (mgr.14373) 3628 : cluster [DBG] pgmap v2516: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:00:56.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:00:56 smithi086 bash[24289]: audit 2024-09-16T07:00:55.361897+0000 mgr.a (mgr.14373) 3629 : audit [DBG] from='client.89241 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:00:56.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:00:56 smithi047 bash[22744]: cluster 2024-09-16T07:00:55.183664+0000 mgr.a (mgr.14373) 3628 : cluster [DBG] pgmap v2516: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:00:56.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:00:56 smithi047 bash[22744]: audit 2024-09-16T07:00:55.361897+0000 mgr.a (mgr.14373) 3629 : audit [DBG] from='client.89241 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:00:58.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:00:58 smithi157 bash[24585]: cluster 2024-09-16T07:00:57.185948+0000 mgr.a (mgr.14373) 3630 : cluster [DBG] pgmap v2517: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:00:58.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:00:58 smithi086 bash[24289]: cluster 2024-09-16T07:00:57.185948+0000 mgr.a (mgr.14373) 3630 : cluster [DBG] pgmap v2517: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:00:58.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:00:58 smithi047 bash[22744]: cluster 2024-09-16T07:00:57.185948+0000 mgr.a (mgr.14373) 3630 : cluster [DBG] pgmap v2517: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:01:00.790 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:01:00.790 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:01:00.791 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:01:00.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:01:00 smithi157 bash[24585]: cluster 2024-09-16T07:00:59.186777+0000 mgr.a (mgr.14373) 3631 : cluster [DBG] pgmap v2518: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:01:00.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:01:00 smithi086 bash[24289]: cluster 2024-09-16T07:00:59.186777+0000 mgr.a (mgr.14373) 3631 : cluster [DBG] pgmap v2518: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:01:00.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:01:00 smithi047 bash[22744]: cluster 2024-09-16T07:00:59.186777+0000 mgr.a (mgr.14373) 3631 : cluster [DBG] pgmap v2518: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:01:01.585 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:01:01.585 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:01:01.585 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:01:01.585 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:01:01.585 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:01:01.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:01:01 smithi157 bash[24585]: audit 2024-09-16T07:01:01.058176+0000 mon.b (mon.2) 370 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T07:01:01.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:01:01 smithi086 bash[24289]: audit 2024-09-16T07:01:01.058176+0000 mon.b (mon.2) 370 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T07:01:01.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:01:01 smithi047 bash[22744]: audit 2024-09-16T07:01:01.058176+0000 mon.b (mon.2) 370 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T07:01:02.675 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:01:02 smithi047 bash[22744]: audit 2024-09-16T07:01:01.129846+0000 mgr.a (mgr.14373) 3632 : audit [DBG] from='client.89319 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:01:02.675 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:01:02 smithi047 bash[22744]: cluster 2024-09-16T07:01:01.187496+0000 mgr.a (mgr.14373) 3633 : cluster [DBG] pgmap v2519: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:01:02.675 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:01:02 smithi047 bash[22744]: audit 2024-09-16T07:01:01.940292+0000 mon.b (mon.2) 371 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T07:01:02.675 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:01:02 smithi047 bash[22744]: audit 2024-09-16T07:01:01.942643+0000 mon.b (mon.2) 372 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T07:01:02.675 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:01:02 smithi047 bash[22744]: audit 2024-09-16T07:01:01.956687+0000 mon.a (mon.0) 781 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:01:02.675 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:01:02 smithi047 bash[22744]: audit 2024-09-16T07:01:01.960516+0000 mon.b (mon.2) 373 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:01:02.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:01:02 smithi157 bash[24585]: audit 2024-09-16T07:01:01.129846+0000 mgr.a (mgr.14373) 3632 : audit [DBG] from='client.89319 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:01:02.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:01:02 smithi157 bash[24585]: cluster 2024-09-16T07:01:01.187496+0000 mgr.a (mgr.14373) 3633 : cluster [DBG] pgmap v2519: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:01:02.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:01:02 smithi157 bash[24585]: audit 2024-09-16T07:01:01.940292+0000 mon.b (mon.2) 371 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T07:01:02.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:01:02 smithi157 bash[24585]: audit 2024-09-16T07:01:01.942643+0000 mon.b (mon.2) 372 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T07:01:02.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:01:02 smithi157 bash[24585]: audit 2024-09-16T07:01:01.956687+0000 mon.a (mon.0) 781 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:01:02.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:01:02 smithi157 bash[24585]: audit 2024-09-16T07:01:01.960516+0000 mon.b (mon.2) 373 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:01:02.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:01:02 smithi086 bash[24289]: audit 2024-09-16T07:01:01.129846+0000 mgr.a (mgr.14373) 3632 : audit [DBG] from='client.89319 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:01:02.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:01:02 smithi086 bash[24289]: cluster 2024-09-16T07:01:01.187496+0000 mgr.a (mgr.14373) 3633 : cluster [DBG] pgmap v2519: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:01:02.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:01:02 smithi086 bash[24289]: audit 2024-09-16T07:01:01.940292+0000 mon.b (mon.2) 371 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T07:01:02.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:01:02 smithi086 bash[24289]: audit 2024-09-16T07:01:01.942643+0000 mon.b (mon.2) 372 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T07:01:02.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:01:02 smithi086 bash[24289]: audit 2024-09-16T07:01:01.956687+0000 mon.a (mon.0) 781 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:01:02.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:01:02 smithi086 bash[24289]: audit 2024-09-16T07:01:01.960516+0000 mon.b (mon.2) 373 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:01:03.088 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 07:01:02 smithi047 bash[22994]: debug 2024-09-16T07:01:02.671+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T07:01:03.088 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 07:01:02 smithi047 bash[22994]: debug 2024-09-16T07:01:02.675+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T07:01:03.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:01:03 smithi157 bash[24585]: audit 2024-09-16T07:01:01.965611+0000 mgr.a (mgr.14373) 3634 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:01:03.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:01:03 smithi086 bash[24289]: audit 2024-09-16T07:01:01.965611+0000 mgr.a (mgr.14373) 3634 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:01:03.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:01:03 smithi047 bash[22744]: audit 2024-09-16T07:01:01.965611+0000 mgr.a (mgr.14373) 3634 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:01:04.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:01:04 smithi157 bash[24585]: audit 2024-09-16T07:01:02.678096+0000 mgr.a (mgr.14373) 3635 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T07:01:04.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:01:04 smithi157 bash[24585]: cephadm 2024-09-16T07:01:02.680141+0000 mgr.a (mgr.14373) 3636 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T07:01:04.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:01:04 smithi157 bash[24585]: cluster 2024-09-16T07:01:03.190368+0000 mgr.a (mgr.14373) 3637 : cluster [DBG] pgmap v2520: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-16T07:01:04.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:01:04 smithi086 bash[24289]: audit 2024-09-16T07:01:02.678096+0000 mgr.a (mgr.14373) 3635 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T07:01:04.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:01:04 smithi086 bash[24289]: cephadm 2024-09-16T07:01:02.680141+0000 mgr.a (mgr.14373) 3636 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T07:01:04.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:01:04 smithi086 bash[24289]: cluster 2024-09-16T07:01:03.190368+0000 mgr.a (mgr.14373) 3637 : cluster [DBG] pgmap v2520: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-16T07:01:04.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:01:04 smithi047 bash[22744]: audit 2024-09-16T07:01:02.678096+0000 mgr.a (mgr.14373) 3635 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T07:01:04.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:01:04 smithi047 bash[22744]: cephadm 2024-09-16T07:01:02.680141+0000 mgr.a (mgr.14373) 3636 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T07:01:04.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:01:04 smithi047 bash[22744]: cluster 2024-09-16T07:01:03.190368+0000 mgr.a (mgr.14373) 3637 : cluster [DBG] pgmap v2520: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-16T07:01:05.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:01:05 smithi157 bash[24585]: cluster 2024-09-16T07:01:05.191311+0000 mgr.a (mgr.14373) 3638 : cluster [DBG] pgmap v2521: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T07:01:05.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:01:05 smithi086 bash[24289]: cluster 2024-09-16T07:01:05.191311+0000 mgr.a (mgr.14373) 3638 : cluster [DBG] pgmap v2521: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T07:01:05.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:01:05 smithi047 bash[22744]: cluster 2024-09-16T07:01:05.191311+0000 mgr.a (mgr.14373) 3638 : cluster [DBG] pgmap v2521: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T07:01:06.586 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:01:06.587 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:01:06.587 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:01:07.355 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:01:07.355 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:01:07.355 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:01:07.355 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:01:07.355 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:01:08.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:01:08 smithi157 bash[24585]: audit 2024-09-16T07:01:06.920861+0000 mgr.a (mgr.14373) 3639 : audit [DBG] from='client.89505 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:01:08.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:01:08 smithi157 bash[24585]: cluster 2024-09-16T07:01:07.192705+0000 mgr.a (mgr.14373) 3640 : cluster [DBG] pgmap v2522: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:01:08.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:01:08 smithi086 bash[24289]: audit 2024-09-16T07:01:06.920861+0000 mgr.a (mgr.14373) 3639 : audit [DBG] from='client.89505 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:01:08.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:01:08 smithi086 bash[24289]: cluster 2024-09-16T07:01:07.192705+0000 mgr.a (mgr.14373) 3640 : cluster [DBG] pgmap v2522: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:01:08.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:01:08 smithi047 bash[22744]: audit 2024-09-16T07:01:06.920861+0000 mgr.a (mgr.14373) 3639 : audit [DBG] from='client.89505 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:01:08.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:01:08 smithi047 bash[22744]: cluster 2024-09-16T07:01:07.192705+0000 mgr.a (mgr.14373) 3640 : cluster [DBG] pgmap v2522: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:01:10.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:01:10 smithi157 bash[24585]: cluster 2024-09-16T07:01:09.193585+0000 mgr.a (mgr.14373) 3641 : cluster [DBG] pgmap v2523: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T07:01:10.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:01:10 smithi086 bash[24289]: cluster 2024-09-16T07:01:09.193585+0000 mgr.a (mgr.14373) 3641 : cluster [DBG] pgmap v2523: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T07:01:10.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:01:10 smithi047 bash[22744]: cluster 2024-09-16T07:01:09.193585+0000 mgr.a (mgr.14373) 3641 : cluster [DBG] pgmap v2523: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T07:01:12.357 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:01:12.357 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:01:12.357 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:01:12.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:01:12 smithi157 bash[24585]: cluster 2024-09-16T07:01:11.194372+0000 mgr.a (mgr.14373) 3642 : cluster [DBG] pgmap v2524: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T07:01:12.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:01:12 smithi086 bash[24289]: cluster 2024-09-16T07:01:11.194372+0000 mgr.a (mgr.14373) 3642 : cluster [DBG] pgmap v2524: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T07:01:12.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:01:12 smithi047 bash[22744]: cluster 2024-09-16T07:01:11.194372+0000 mgr.a (mgr.14373) 3642 : cluster [DBG] pgmap v2524: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T07:01:13.126 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:01:13.127 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:01:13.127 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:01:13.127 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:01:13.127 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:01:14.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:01:14 smithi157 bash[24585]: audit 2024-09-16T07:01:12.697665+0000 mgr.a (mgr.14373) 3643 : audit [DBG] from='client.89583 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:01:14.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:01:14 smithi157 bash[24585]: cluster 2024-09-16T07:01:13.197045+0000 mgr.a (mgr.14373) 3644 : cluster [DBG] pgmap v2525: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:01:14.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:01:14 smithi086 bash[24289]: audit 2024-09-16T07:01:12.697665+0000 mgr.a (mgr.14373) 3643 : audit [DBG] from='client.89583 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:01:14.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:01:14 smithi086 bash[24289]: cluster 2024-09-16T07:01:13.197045+0000 mgr.a (mgr.14373) 3644 : cluster [DBG] pgmap v2525: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:01:14.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:01:14 smithi047 bash[22744]: audit 2024-09-16T07:01:12.697665+0000 mgr.a (mgr.14373) 3643 : audit [DBG] from='client.89583 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:01:14.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:01:14 smithi047 bash[22744]: cluster 2024-09-16T07:01:13.197045+0000 mgr.a (mgr.14373) 3644 : cluster [DBG] pgmap v2525: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:01:16.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:01:16 smithi157 bash[24585]: cluster 2024-09-16T07:01:15.197957+0000 mgr.a (mgr.14373) 3645 : cluster [DBG] pgmap v2526: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T07:01:16.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:01:16 smithi086 bash[24289]: cluster 2024-09-16T07:01:15.197957+0000 mgr.a (mgr.14373) 3645 : cluster [DBG] pgmap v2526: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T07:01:16.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:01:16 smithi047 bash[22744]: cluster 2024-09-16T07:01:15.197957+0000 mgr.a (mgr.14373) 3645 : cluster [DBG] pgmap v2526: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T07:01:18.128 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:01:18.129 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:01:18.129 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:01:18.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:01:18 smithi157 bash[24585]: cluster 2024-09-16T07:01:17.200096+0000 mgr.a (mgr.14373) 3646 : cluster [DBG] pgmap v2527: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:01:18.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:01:18 smithi086 bash[24289]: cluster 2024-09-16T07:01:17.200096+0000 mgr.a (mgr.14373) 3646 : cluster [DBG] pgmap v2527: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:01:18.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:01:18 smithi047 bash[22744]: cluster 2024-09-16T07:01:17.200096+0000 mgr.a (mgr.14373) 3646 : cluster [DBG] pgmap v2527: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:01:18.890 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:01:18.891 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:01:18.891 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:01:18.891 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:01:18.891 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:01:20.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:01:20 smithi157 bash[24585]: audit 2024-09-16T07:01:18.462792+0000 mgr.a (mgr.14373) 3647 : audit [DBG] from='client.89661 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:01:20.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:01:20 smithi157 bash[24585]: cluster 2024-09-16T07:01:19.201095+0000 mgr.a (mgr.14373) 3648 : cluster [DBG] pgmap v2528: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:01:20.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:01:20 smithi086 bash[24289]: audit 2024-09-16T07:01:18.462792+0000 mgr.a (mgr.14373) 3647 : audit [DBG] from='client.89661 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:01:20.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:01:20 smithi086 bash[24289]: cluster 2024-09-16T07:01:19.201095+0000 mgr.a (mgr.14373) 3648 : cluster [DBG] pgmap v2528: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:01:20.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:01:20 smithi047 bash[22744]: audit 2024-09-16T07:01:18.462792+0000 mgr.a (mgr.14373) 3647 : audit [DBG] from='client.89661 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:01:20.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:01:20 smithi047 bash[22744]: cluster 2024-09-16T07:01:19.201095+0000 mgr.a (mgr.14373) 3648 : cluster [DBG] pgmap v2528: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:01:22.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:01:22 smithi157 bash[24585]: cluster 2024-09-16T07:01:21.201866+0000 mgr.a (mgr.14373) 3649 : cluster [DBG] pgmap v2529: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:01:22.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:01:22 smithi086 bash[24289]: cluster 2024-09-16T07:01:21.201866+0000 mgr.a (mgr.14373) 3649 : cluster [DBG] pgmap v2529: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:01:22.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:01:22 smithi047 bash[22744]: cluster 2024-09-16T07:01:21.201866+0000 mgr.a (mgr.14373) 3649 : cluster [DBG] pgmap v2529: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:01:23.892 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:01:23.893 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:01:23.893 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:01:24.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:01:24 smithi157 bash[24585]: cluster 2024-09-16T07:01:23.204141+0000 mgr.a (mgr.14373) 3650 : cluster [DBG] pgmap v2530: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:01:24.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:01:24 smithi086 bash[24289]: cluster 2024-09-16T07:01:23.204141+0000 mgr.a (mgr.14373) 3650 : cluster [DBG] pgmap v2530: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:01:24.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:01:24 smithi047 bash[22744]: cluster 2024-09-16T07:01:23.204141+0000 mgr.a (mgr.14373) 3650 : cluster [DBG] pgmap v2530: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:01:24.677 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:01:24.677 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:01:24.678 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:01:24.678 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:01:24.678 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:01:25.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:01:25 smithi157 bash[24585]: audit 2024-09-16T07:01:24.230406+0000 mgr.a (mgr.14373) 3651 : audit [DBG] from='client.89736 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:01:25.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:01:25 smithi086 bash[24289]: audit 2024-09-16T07:01:24.230406+0000 mgr.a (mgr.14373) 3651 : audit [DBG] from='client.89736 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:01:25.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:01:25 smithi047 bash[22744]: audit 2024-09-16T07:01:24.230406+0000 mgr.a (mgr.14373) 3651 : audit [DBG] from='client.89736 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:01:26.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:01:26 smithi157 bash[24585]: cluster 2024-09-16T07:01:25.205119+0000 mgr.a (mgr.14373) 3652 : cluster [DBG] pgmap v2531: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:01:26.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:01:26 smithi086 bash[24289]: cluster 2024-09-16T07:01:25.205119+0000 mgr.a (mgr.14373) 3652 : cluster [DBG] pgmap v2531: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:01:26.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:01:26 smithi047 bash[22744]: cluster 2024-09-16T07:01:25.205119+0000 mgr.a (mgr.14373) 3652 : cluster [DBG] pgmap v2531: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:01:28.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:01:28 smithi157 bash[24585]: cluster 2024-09-16T07:01:27.207290+0000 mgr.a (mgr.14373) 3653 : cluster [DBG] pgmap v2532: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:01:28.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:01:28 smithi086 bash[24289]: cluster 2024-09-16T07:01:27.207290+0000 mgr.a (mgr.14373) 3653 : cluster [DBG] pgmap v2532: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:01:28.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:01:28 smithi047 bash[22744]: cluster 2024-09-16T07:01:27.207290+0000 mgr.a (mgr.14373) 3653 : cluster [DBG] pgmap v2532: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:01:29.679 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:01:29.679 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:01:29.679 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:01:30.463 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:01:30.463 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:01:30.463 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:01:30.463 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:01:30.463 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:01:30.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:01:30 smithi157 bash[24585]: cluster 2024-09-16T07:01:29.208041+0000 mgr.a (mgr.14373) 3654 : cluster [DBG] pgmap v2533: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:01:30.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:01:30 smithi086 bash[24289]: cluster 2024-09-16T07:01:29.208041+0000 mgr.a (mgr.14373) 3654 : cluster [DBG] pgmap v2533: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:01:30.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:01:30 smithi047 bash[22744]: cluster 2024-09-16T07:01:29.208041+0000 mgr.a (mgr.14373) 3654 : cluster [DBG] pgmap v2533: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:01:31.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:01:31 smithi157 bash[24585]: audit 2024-09-16T07:01:30.022880+0000 mgr.a (mgr.14373) 3655 : audit [DBG] from='client.89811 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:01:31.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:01:31 smithi086 bash[24289]: audit 2024-09-16T07:01:30.022880+0000 mgr.a (mgr.14373) 3655 : audit [DBG] from='client.89811 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:01:31.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:01:31 smithi047 bash[22744]: audit 2024-09-16T07:01:30.022880+0000 mgr.a (mgr.14373) 3655 : audit [DBG] from='client.89811 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:01:32.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:01:32 smithi086 bash[24289]: cluster 2024-09-16T07:01:31.208915+0000 mgr.a (mgr.14373) 3656 : cluster [DBG] pgmap v2534: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:01:32.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:01:32 smithi047 bash[22744]: cluster 2024-09-16T07:01:31.208915+0000 mgr.a (mgr.14373) 3656 : cluster [DBG] pgmap v2534: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:01:32.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:01:32 smithi157 bash[24585]: cluster 2024-09-16T07:01:31.208915+0000 mgr.a (mgr.14373) 3656 : cluster [DBG] pgmap v2534: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:01:34.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:01:34 smithi086 bash[24289]: cluster 2024-09-16T07:01:33.211184+0000 mgr.a (mgr.14373) 3657 : cluster [DBG] pgmap v2535: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:01:34.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:01:34 smithi047 bash[22744]: cluster 2024-09-16T07:01:33.211184+0000 mgr.a (mgr.14373) 3657 : cluster [DBG] pgmap v2535: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:01:34.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:01:34 smithi157 bash[24585]: cluster 2024-09-16T07:01:33.211184+0000 mgr.a (mgr.14373) 3657 : cluster [DBG] pgmap v2535: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:01:35.465 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:01:35.465 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:01:35.465 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:01:36.214 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:01:36.214 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:01:36.214 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:01:36.214 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:01:36.214 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:01:36.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:01:36 smithi047 bash[22744]: cluster 2024-09-16T07:01:35.212066+0000 mgr.a (mgr.14373) 3658 : cluster [DBG] pgmap v2536: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:01:36.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:01:36 smithi157 bash[24585]: cluster 2024-09-16T07:01:35.212066+0000 mgr.a (mgr.14373) 3658 : cluster [DBG] pgmap v2536: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:01:36.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:01:36 smithi086 bash[24289]: cluster 2024-09-16T07:01:35.212066+0000 mgr.a (mgr.14373) 3658 : cluster [DBG] pgmap v2536: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:01:37.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:01:37 smithi047 bash[22744]: audit 2024-09-16T07:01:35.803779+0000 mgr.a (mgr.14373) 3659 : audit [DBG] from='client.89883 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:01:37.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:01:37 smithi157 bash[24585]: audit 2024-09-16T07:01:35.803779+0000 mgr.a (mgr.14373) 3659 : audit [DBG] from='client.89883 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:01:37.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:01:37 smithi086 bash[24289]: audit 2024-09-16T07:01:35.803779+0000 mgr.a (mgr.14373) 3659 : audit [DBG] from='client.89883 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:01:38.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:01:38 smithi047 bash[22744]: cluster 2024-09-16T07:01:37.214385+0000 mgr.a (mgr.14373) 3660 : cluster [DBG] pgmap v2537: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:01:38.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:01:38 smithi157 bash[24585]: cluster 2024-09-16T07:01:37.214385+0000 mgr.a (mgr.14373) 3660 : cluster [DBG] pgmap v2537: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:01:38.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:01:38 smithi086 bash[24289]: cluster 2024-09-16T07:01:37.214385+0000 mgr.a (mgr.14373) 3660 : cluster [DBG] pgmap v2537: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:01:40.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:01:40 smithi047 bash[22744]: cluster 2024-09-16T07:01:39.215126+0000 mgr.a (mgr.14373) 3661 : cluster [DBG] pgmap v2538: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:01:40.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:01:40 smithi157 bash[24585]: cluster 2024-09-16T07:01:39.215126+0000 mgr.a (mgr.14373) 3661 : cluster [DBG] pgmap v2538: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:01:40.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:01:40 smithi086 bash[24289]: cluster 2024-09-16T07:01:39.215126+0000 mgr.a (mgr.14373) 3661 : cluster [DBG] pgmap v2538: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:01:41.215 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:01:41.216 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:01:41.216 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:01:41.959 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:01:41.959 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:01:41.960 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:01:41.960 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:01:41.960 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:01:42.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:01:42 smithi047 bash[22744]: cluster 2024-09-16T07:01:41.215895+0000 mgr.a (mgr.14373) 3662 : cluster [DBG] pgmap v2539: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:01:42.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:01:42 smithi157 bash[24585]: cluster 2024-09-16T07:01:41.215895+0000 mgr.a (mgr.14373) 3662 : cluster [DBG] pgmap v2539: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:01:42.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:01:42 smithi086 bash[24289]: cluster 2024-09-16T07:01:41.215895+0000 mgr.a (mgr.14373) 3662 : cluster [DBG] pgmap v2539: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:01:43.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:01:43 smithi157 bash[24585]: audit 2024-09-16T07:01:41.552172+0000 mgr.a (mgr.14373) 3663 : audit [DBG] from='client.89961 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:01:43.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:01:43 smithi086 bash[24289]: audit 2024-09-16T07:01:41.552172+0000 mgr.a (mgr.14373) 3663 : audit [DBG] from='client.89961 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:01:43.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:01:43 smithi047 bash[22744]: audit 2024-09-16T07:01:41.552172+0000 mgr.a (mgr.14373) 3663 : audit [DBG] from='client.89961 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:01:44.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:01:44 smithi157 bash[24585]: cluster 2024-09-16T07:01:43.218549+0000 mgr.a (mgr.14373) 3664 : cluster [DBG] pgmap v2540: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:01:44.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:01:44 smithi086 bash[24289]: cluster 2024-09-16T07:01:43.218549+0000 mgr.a (mgr.14373) 3664 : cluster [DBG] pgmap v2540: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:01:44.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:01:44 smithi047 bash[22744]: cluster 2024-09-16T07:01:43.218549+0000 mgr.a (mgr.14373) 3664 : cluster [DBG] pgmap v2540: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:01:46.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:01:46 smithi157 bash[24585]: cluster 2024-09-16T07:01:45.219318+0000 mgr.a (mgr.14373) 3665 : cluster [DBG] pgmap v2541: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:01:46.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:01:46 smithi086 bash[24289]: cluster 2024-09-16T07:01:45.219318+0000 mgr.a (mgr.14373) 3665 : cluster [DBG] pgmap v2541: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:01:46.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:01:46 smithi047 bash[22744]: cluster 2024-09-16T07:01:45.219318+0000 mgr.a (mgr.14373) 3665 : cluster [DBG] pgmap v2541: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:01:46.961 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:01:46.961 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:01:46.961 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:01:47.713 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:01:47.713 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:01:47.713 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:01:47.714 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:01:47.714 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:01:48.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:01:48 smithi157 bash[24585]: cluster 2024-09-16T07:01:47.221360+0000 mgr.a (mgr.14373) 3666 : cluster [DBG] pgmap v2542: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:01:48.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:01:48 smithi157 bash[24585]: audit 2024-09-16T07:01:47.296228+0000 mgr.a (mgr.14373) 3667 : audit [DBG] from='client.90033 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:01:48.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:01:48 smithi086 bash[24289]: cluster 2024-09-16T07:01:47.221360+0000 mgr.a (mgr.14373) 3666 : cluster [DBG] pgmap v2542: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:01:48.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:01:48 smithi086 bash[24289]: audit 2024-09-16T07:01:47.296228+0000 mgr.a (mgr.14373) 3667 : audit [DBG] from='client.90033 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:01:48.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:01:48 smithi047 bash[22744]: cluster 2024-09-16T07:01:47.221360+0000 mgr.a (mgr.14373) 3666 : cluster [DBG] pgmap v2542: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:01:48.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:01:48 smithi047 bash[22744]: audit 2024-09-16T07:01:47.296228+0000 mgr.a (mgr.14373) 3667 : audit [DBG] from='client.90033 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:01:50.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:01:50 smithi157 bash[24585]: cluster 2024-09-16T07:01:49.222270+0000 mgr.a (mgr.14373) 3668 : cluster [DBG] pgmap v2543: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:01:50.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:01:50 smithi086 bash[24289]: cluster 2024-09-16T07:01:49.222270+0000 mgr.a (mgr.14373) 3668 : cluster [DBG] pgmap v2543: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:01:50.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:01:50 smithi047 bash[22744]: cluster 2024-09-16T07:01:49.222270+0000 mgr.a (mgr.14373) 3668 : cluster [DBG] pgmap v2543: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:01:52.715 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:01:52.716 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:01:52.716 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:01:52.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:01:52 smithi157 bash[24585]: cluster 2024-09-16T07:01:51.223083+0000 mgr.a (mgr.14373) 3669 : cluster [DBG] pgmap v2544: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T07:01:52.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:01:52 smithi086 bash[24289]: cluster 2024-09-16T07:01:51.223083+0000 mgr.a (mgr.14373) 3669 : cluster [DBG] pgmap v2544: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T07:01:52.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:01:52 smithi047 bash[22744]: cluster 2024-09-16T07:01:51.223083+0000 mgr.a (mgr.14373) 3669 : cluster [DBG] pgmap v2544: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T07:01:53.475 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:01:53.475 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:01:53.475 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:01:53.475 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:01:53.476 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:01:54.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:01:54 smithi157 bash[24585]: audit 2024-09-16T07:01:53.053958+0000 mgr.a (mgr.14373) 3670 : audit [DBG] from='client.90111 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:01:54.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:01:54 smithi157 bash[24585]: cluster 2024-09-16T07:01:53.224402+0000 mgr.a (mgr.14373) 3671 : cluster [DBG] pgmap v2545: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:01:54.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:01:54 smithi086 bash[24289]: audit 2024-09-16T07:01:53.053958+0000 mgr.a (mgr.14373) 3670 : audit [DBG] from='client.90111 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:01:54.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:01:54 smithi086 bash[24289]: cluster 2024-09-16T07:01:53.224402+0000 mgr.a (mgr.14373) 3671 : cluster [DBG] pgmap v2545: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:01:54.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:01:54 smithi047 bash[22744]: audit 2024-09-16T07:01:53.053958+0000 mgr.a (mgr.14373) 3670 : audit [DBG] from='client.90111 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:01:54.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:01:54 smithi047 bash[22744]: cluster 2024-09-16T07:01:53.224402+0000 mgr.a (mgr.14373) 3671 : cluster [DBG] pgmap v2545: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:01:56.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:01:56 smithi157 bash[24585]: cluster 2024-09-16T07:01:55.225246+0000 mgr.a (mgr.14373) 3672 : cluster [DBG] pgmap v2546: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:01:56.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:01:56 smithi086 bash[24289]: cluster 2024-09-16T07:01:55.225246+0000 mgr.a (mgr.14373) 3672 : cluster [DBG] pgmap v2546: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:01:56.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:01:56 smithi047 bash[22744]: cluster 2024-09-16T07:01:55.225246+0000 mgr.a (mgr.14373) 3672 : cluster [DBG] pgmap v2546: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:01:58.477 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:01:58.478 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:01:58.478 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:01:58.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:01:58 smithi157 bash[24585]: cluster 2024-09-16T07:01:57.227404+0000 mgr.a (mgr.14373) 3673 : cluster [DBG] pgmap v2547: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:01:58.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:01:58 smithi086 bash[24289]: cluster 2024-09-16T07:01:57.227404+0000 mgr.a (mgr.14373) 3673 : cluster [DBG] pgmap v2547: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:01:58.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:01:58 smithi047 bash[22744]: cluster 2024-09-16T07:01:57.227404+0000 mgr.a (mgr.14373) 3673 : cluster [DBG] pgmap v2547: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:01:59.221 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:01:59.222 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:01:59.222 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:01:59.222 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:01:59.222 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:02:00.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:02:00 smithi157 bash[24585]: audit 2024-09-16T07:01:58.811014+0000 mgr.a (mgr.14373) 3674 : audit [DBG] from='client.90183 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:02:00.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:02:00 smithi157 bash[24585]: cluster 2024-09-16T07:01:59.228028+0000 mgr.a (mgr.14373) 3675 : cluster [DBG] pgmap v2548: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:02:00.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:02:00 smithi086 bash[24289]: audit 2024-09-16T07:01:58.811014+0000 mgr.a (mgr.14373) 3674 : audit [DBG] from='client.90183 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:02:00.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:02:00 smithi086 bash[24289]: cluster 2024-09-16T07:01:59.228028+0000 mgr.a (mgr.14373) 3675 : cluster [DBG] pgmap v2548: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:02:00.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:02:00 smithi047 bash[22744]: audit 2024-09-16T07:01:58.811014+0000 mgr.a (mgr.14373) 3674 : audit [DBG] from='client.90183 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:02:00.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:02:00 smithi047 bash[22744]: cluster 2024-09-16T07:01:59.228028+0000 mgr.a (mgr.14373) 3675 : cluster [DBG] pgmap v2548: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:02:02.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:02:02 smithi157 bash[24585]: cluster 2024-09-16T07:02:01.228764+0000 mgr.a (mgr.14373) 3676 : cluster [DBG] pgmap v2549: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:02:02.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:02:02 smithi086 bash[24289]: cluster 2024-09-16T07:02:01.228764+0000 mgr.a (mgr.14373) 3676 : cluster [DBG] pgmap v2549: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:02:02.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:02:02 smithi047 bash[22744]: cluster 2024-09-16T07:02:01.228764+0000 mgr.a (mgr.14373) 3676 : cluster [DBG] pgmap v2549: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:02:03.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:02:03 smithi157 bash[24585]: audit 2024-09-16T07:02:02.727440+0000 mon.b (mon.2) 374 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T07:02:03.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:02:03 smithi086 bash[24289]: audit 2024-09-16T07:02:02.727440+0000 mon.b (mon.2) 374 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T07:02:03.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:02:03 smithi047 bash[22744]: audit 2024-09-16T07:02:02.727440+0000 mon.b (mon.2) 374 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T07:02:04.223 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:02:04.224 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:02:04.224 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:02:04.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:02:04 smithi157 bash[24585]: cluster 2024-09-16T07:02:03.230936+0000 mgr.a (mgr.14373) 3677 : cluster [DBG] pgmap v2550: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:02:04.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:02:04 smithi086 bash[24289]: cluster 2024-09-16T07:02:03.230936+0000 mgr.a (mgr.14373) 3677 : cluster [DBG] pgmap v2550: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:02:04.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:02:04 smithi047 bash[22744]: cluster 2024-09-16T07:02:03.230936+0000 mgr.a (mgr.14373) 3677 : cluster [DBG] pgmap v2550: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:02:04.968 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:02:04.969 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:02:04.969 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:02:04.969 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:02:04.969 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:02:06.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:02:06 smithi157 bash[24585]: audit 2024-09-16T07:02:04.554287+0000 mgr.a (mgr.14373) 3678 : audit [DBG] from='client.90261 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:02:06.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:02:06 smithi157 bash[24585]: cluster 2024-09-16T07:02:05.231894+0000 mgr.a (mgr.14373) 3679 : cluster [DBG] pgmap v2551: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:02:06.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:02:06 smithi086 bash[24289]: audit 2024-09-16T07:02:04.554287+0000 mgr.a (mgr.14373) 3678 : audit [DBG] from='client.90261 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:02:06.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:02:06 smithi086 bash[24289]: cluster 2024-09-16T07:02:05.231894+0000 mgr.a (mgr.14373) 3679 : cluster [DBG] pgmap v2551: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:02:06.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:02:06 smithi047 bash[22744]: audit 2024-09-16T07:02:04.554287+0000 mgr.a (mgr.14373) 3678 : audit [DBG] from='client.90261 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:02:06.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:02:06 smithi047 bash[22744]: cluster 2024-09-16T07:02:05.231894+0000 mgr.a (mgr.14373) 3679 : cluster [DBG] pgmap v2551: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:02:08.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:02:08 smithi157 bash[24585]: cluster 2024-09-16T07:02:07.234044+0000 mgr.a (mgr.14373) 3680 : cluster [DBG] pgmap v2552: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:02:08.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:02:08 smithi157 bash[24585]: audit 2024-09-16T07:02:08.076443+0000 mon.a (mon.0) 782 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:02:08.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:02:08 smithi157 bash[24585]: audit 2024-09-16T07:02:08.082329+0000 mon.a (mon.0) 783 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:02:08.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:02:08 smithi157 bash[24585]: audit 2024-09-16T07:02:08.099352+0000 mon.a (mon.0) 784 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:02:08.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:02:08 smithi157 bash[24585]: audit 2024-09-16T07:02:08.106639+0000 mon.a (mon.0) 785 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:02:08.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:02:08 smithi157 bash[24585]: audit 2024-09-16T07:02:08.113432+0000 mon.a (mon.0) 786 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:02:08.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:02:08 smithi157 bash[24585]: audit 2024-09-16T07:02:08.119765+0000 mon.a (mon.0) 787 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:02:08.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:02:08 smithi086 bash[24289]: cluster 2024-09-16T07:02:07.234044+0000 mgr.a (mgr.14373) 3680 : cluster [DBG] pgmap v2552: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:02:08.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:02:08 smithi086 bash[24289]: audit 2024-09-16T07:02:08.076443+0000 mon.a (mon.0) 782 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:02:08.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:02:08 smithi086 bash[24289]: audit 2024-09-16T07:02:08.082329+0000 mon.a (mon.0) 783 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:02:08.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:02:08 smithi086 bash[24289]: audit 2024-09-16T07:02:08.099352+0000 mon.a (mon.0) 784 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:02:08.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:02:08 smithi086 bash[24289]: audit 2024-09-16T07:02:08.106639+0000 mon.a (mon.0) 785 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:02:08.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:02:08 smithi086 bash[24289]: audit 2024-09-16T07:02:08.113432+0000 mon.a (mon.0) 786 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:02:08.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:02:08 smithi086 bash[24289]: audit 2024-09-16T07:02:08.119765+0000 mon.a (mon.0) 787 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:02:08.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:02:08 smithi047 bash[22744]: cluster 2024-09-16T07:02:07.234044+0000 mgr.a (mgr.14373) 3680 : cluster [DBG] pgmap v2552: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:02:08.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:02:08 smithi047 bash[22744]: audit 2024-09-16T07:02:08.076443+0000 mon.a (mon.0) 782 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:02:08.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:02:08 smithi047 bash[22744]: audit 2024-09-16T07:02:08.082329+0000 mon.a (mon.0) 783 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:02:08.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:02:08 smithi047 bash[22744]: audit 2024-09-16T07:02:08.099352+0000 mon.a (mon.0) 784 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:02:08.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:02:08 smithi047 bash[22744]: audit 2024-09-16T07:02:08.106639+0000 mon.a (mon.0) 785 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:02:08.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:02:08 smithi047 bash[22744]: audit 2024-09-16T07:02:08.113432+0000 mon.a (mon.0) 786 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:02:08.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:02:08 smithi047 bash[22744]: audit 2024-09-16T07:02:08.119765+0000 mon.a (mon.0) 787 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:02:09.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:02:09 smithi157 bash[24585]: audit 2024-09-16T07:02:08.830572+0000 mon.b (mon.2) 375 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T07:02:09.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:02:09 smithi157 bash[24585]: audit 2024-09-16T07:02:08.832909+0000 mon.b (mon.2) 376 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T07:02:09.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:02:09 smithi157 bash[24585]: audit 2024-09-16T07:02:08.844386+0000 mon.a (mon.0) 788 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:02:09.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:02:09 smithi157 bash[24585]: audit 2024-09-16T07:02:08.849337+0000 mon.b (mon.2) 377 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:02:09.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:02:09 smithi086 bash[24289]: audit 2024-09-16T07:02:08.830572+0000 mon.b (mon.2) 375 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T07:02:09.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:02:09 smithi086 bash[24289]: audit 2024-09-16T07:02:08.832909+0000 mon.b (mon.2) 376 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T07:02:09.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:02:09 smithi086 bash[24289]: audit 2024-09-16T07:02:08.844386+0000 mon.a (mon.0) 788 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:02:09.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:02:09 smithi086 bash[24289]: audit 2024-09-16T07:02:08.849337+0000 mon.b (mon.2) 377 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:02:09.838 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 07:02:09 smithi047 bash[22994]: debug 2024-09-16T07:02:09.590+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T07:02:09.838 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 07:02:09 smithi047 bash[22994]: debug 2024-09-16T07:02:09.590+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T07:02:09.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:02:09 smithi047 bash[22744]: audit 2024-09-16T07:02:08.830572+0000 mon.b (mon.2) 375 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T07:02:09.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:02:09 smithi047 bash[22744]: audit 2024-09-16T07:02:08.832909+0000 mon.b (mon.2) 376 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T07:02:09.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:02:09 smithi047 bash[22744]: audit 2024-09-16T07:02:08.844386+0000 mon.a (mon.0) 788 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:02:09.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:02:09 smithi047 bash[22744]: audit 2024-09-16T07:02:08.849337+0000 mon.b (mon.2) 377 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:02:09.970 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:02:09.971 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:02:09.971 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:02:10.729 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:02:10.729 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:02:10.730 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:02:10.730 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:02:10.730 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:02:10.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:02:10 smithi157 bash[24585]: audit 2024-09-16T07:02:08.853993+0000 mgr.a (mgr.14373) 3681 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:02:10.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:02:10 smithi157 bash[24585]: cluster 2024-09-16T07:02:09.234616+0000 mgr.a (mgr.14373) 3682 : cluster [DBG] pgmap v2553: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:02:10.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:02:10 smithi086 bash[24289]: audit 2024-09-16T07:02:08.853993+0000 mgr.a (mgr.14373) 3681 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:02:10.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:02:10 smithi086 bash[24289]: cluster 2024-09-16T07:02:09.234616+0000 mgr.a (mgr.14373) 3682 : cluster [DBG] pgmap v2553: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:02:10.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:02:10 smithi047 bash[22744]: audit 2024-09-16T07:02:08.853993+0000 mgr.a (mgr.14373) 3681 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:02:10.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:02:10 smithi047 bash[22744]: cluster 2024-09-16T07:02:09.234616+0000 mgr.a (mgr.14373) 3682 : cluster [DBG] pgmap v2553: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:02:11.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:02:11 smithi157 bash[24585]: audit 2024-09-16T07:02:09.592023+0000 mgr.a (mgr.14373) 3683 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T07:02:11.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:02:11 smithi157 bash[24585]: cephadm 2024-09-16T07:02:09.593925+0000 mgr.a (mgr.14373) 3684 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T07:02:11.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:02:11 smithi157 bash[24585]: audit 2024-09-16T07:02:10.302686+0000 mgr.a (mgr.14373) 3685 : audit [DBG] from='client.90447 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:02:11.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:02:11 smithi086 bash[24289]: audit 2024-09-16T07:02:09.592023+0000 mgr.a (mgr.14373) 3683 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T07:02:11.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:02:11 smithi086 bash[24289]: cephadm 2024-09-16T07:02:09.593925+0000 mgr.a (mgr.14373) 3684 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T07:02:11.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:02:11 smithi086 bash[24289]: audit 2024-09-16T07:02:10.302686+0000 mgr.a (mgr.14373) 3685 : audit [DBG] from='client.90447 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:02:11.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:02:11 smithi047 bash[22744]: audit 2024-09-16T07:02:09.592023+0000 mgr.a (mgr.14373) 3683 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T07:02:11.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:02:11 smithi047 bash[22744]: cephadm 2024-09-16T07:02:09.593925+0000 mgr.a (mgr.14373) 3684 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T07:02:11.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:02:11 smithi047 bash[22744]: audit 2024-09-16T07:02:10.302686+0000 mgr.a (mgr.14373) 3685 : audit [DBG] from='client.90447 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:02:12.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:02:12 smithi157 bash[24585]: cluster 2024-09-16T07:02:11.235451+0000 mgr.a (mgr.14373) 3686 : cluster [DBG] pgmap v2554: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:02:12.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:02:12 smithi086 bash[24289]: cluster 2024-09-16T07:02:11.235451+0000 mgr.a (mgr.14373) 3686 : cluster [DBG] pgmap v2554: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:02:12.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:02:12 smithi047 bash[22744]: cluster 2024-09-16T07:02:11.235451+0000 mgr.a (mgr.14373) 3686 : cluster [DBG] pgmap v2554: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:02:14.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:02:14 smithi157 bash[24585]: cluster 2024-09-16T07:02:13.237657+0000 mgr.a (mgr.14373) 3687 : cluster [DBG] pgmap v2555: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:02:14.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:02:14 smithi086 bash[24289]: cluster 2024-09-16T07:02:13.237657+0000 mgr.a (mgr.14373) 3687 : cluster [DBG] pgmap v2555: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:02:14.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:02:14 smithi047 bash[22744]: cluster 2024-09-16T07:02:13.237657+0000 mgr.a (mgr.14373) 3687 : cluster [DBG] pgmap v2555: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:02:15.731 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:02:15.731 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:02:15.731 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:02:16.531 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:02:16.531 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:02:16.531 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:02:16.531 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:02:16.532 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:02:16.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:02:16 smithi157 bash[24585]: cluster 2024-09-16T07:02:15.238476+0000 mgr.a (mgr.14373) 3688 : cluster [DBG] pgmap v2556: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:02:16.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:02:16 smithi086 bash[24289]: cluster 2024-09-16T07:02:15.238476+0000 mgr.a (mgr.14373) 3688 : cluster [DBG] pgmap v2556: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:02:16.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:02:16 smithi047 bash[22744]: cluster 2024-09-16T07:02:15.238476+0000 mgr.a (mgr.14373) 3688 : cluster [DBG] pgmap v2556: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:02:17.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:02:17 smithi157 bash[24585]: audit 2024-09-16T07:02:16.071299+0000 mgr.a (mgr.14373) 3689 : audit [DBG] from='client.90525 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:02:17.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:02:17 smithi086 bash[24289]: audit 2024-09-16T07:02:16.071299+0000 mgr.a (mgr.14373) 3689 : audit [DBG] from='client.90525 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:02:17.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:02:17 smithi047 bash[22744]: audit 2024-09-16T07:02:16.071299+0000 mgr.a (mgr.14373) 3689 : audit [DBG] from='client.90525 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:02:18.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:02:18 smithi157 bash[24585]: cluster 2024-09-16T07:02:17.240829+0000 mgr.a (mgr.14373) 3690 : cluster [DBG] pgmap v2557: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:02:18.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:02:18 smithi086 bash[24289]: cluster 2024-09-16T07:02:17.240829+0000 mgr.a (mgr.14373) 3690 : cluster [DBG] pgmap v2557: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:02:18.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:02:18 smithi047 bash[22744]: cluster 2024-09-16T07:02:17.240829+0000 mgr.a (mgr.14373) 3690 : cluster [DBG] pgmap v2557: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:02:19.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:02:19 smithi157 bash[24585]: cluster 2024-09-16T07:02:19.241598+0000 mgr.a (mgr.14373) 3691 : cluster [DBG] pgmap v2558: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T07:02:19.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:02:19 smithi086 bash[24289]: cluster 2024-09-16T07:02:19.241598+0000 mgr.a (mgr.14373) 3691 : cluster [DBG] pgmap v2558: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T07:02:19.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:02:19 smithi047 bash[22744]: cluster 2024-09-16T07:02:19.241598+0000 mgr.a (mgr.14373) 3691 : cluster [DBG] pgmap v2558: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T07:02:21.533 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:02:21.534 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:02:21.534 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:02:22.282 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:02:22.282 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:02:22.283 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:02:22.283 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:02:22.283 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:02:22.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:02:22 smithi157 bash[24585]: cluster 2024-09-16T07:02:21.242391+0000 mgr.a (mgr.14373) 3692 : cluster [DBG] pgmap v2559: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T07:02:22.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:02:22 smithi086 bash[24289]: cluster 2024-09-16T07:02:21.242391+0000 mgr.a (mgr.14373) 3692 : cluster [DBG] pgmap v2559: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T07:02:22.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:02:22 smithi047 bash[22744]: cluster 2024-09-16T07:02:21.242391+0000 mgr.a (mgr.14373) 3692 : cluster [DBG] pgmap v2559: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T07:02:23.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:02:23 smithi086 bash[24289]: audit 2024-09-16T07:02:21.867249+0000 mgr.a (mgr.14373) 3693 : audit [DBG] from='client.90600 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:02:23.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:02:23 smithi047 bash[22744]: audit 2024-09-16T07:02:21.867249+0000 mgr.a (mgr.14373) 3693 : audit [DBG] from='client.90600 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:02:23.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:02:23 smithi157 bash[24585]: audit 2024-09-16T07:02:21.867249+0000 mgr.a (mgr.14373) 3693 : audit [DBG] from='client.90600 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:02:24.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:02:24 smithi086 bash[24289]: cluster 2024-09-16T07:02:23.244950+0000 mgr.a (mgr.14373) 3694 : cluster [DBG] pgmap v2560: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:02:24.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:02:24 smithi047 bash[22744]: cluster 2024-09-16T07:02:23.244950+0000 mgr.a (mgr.14373) 3694 : cluster [DBG] pgmap v2560: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:02:24.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:02:24 smithi157 bash[24585]: cluster 2024-09-16T07:02:23.244950+0000 mgr.a (mgr.14373) 3694 : cluster [DBG] pgmap v2560: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:02:26.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:02:26 smithi086 bash[24289]: cluster 2024-09-16T07:02:25.245706+0000 mgr.a (mgr.14373) 3695 : cluster [DBG] pgmap v2561: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:02:26.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:02:26 smithi047 bash[22744]: cluster 2024-09-16T07:02:25.245706+0000 mgr.a (mgr.14373) 3695 : cluster [DBG] pgmap v2561: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:02:26.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:02:26 smithi157 bash[24585]: cluster 2024-09-16T07:02:25.245706+0000 mgr.a (mgr.14373) 3695 : cluster [DBG] pgmap v2561: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:02:27.284 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:02:27.284 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:02:27.285 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:02:28.050 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:02:28.051 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:02:28.051 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:02:28.051 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:02:28.051 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:02:28.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:02:28 smithi086 bash[24289]: cluster 2024-09-16T07:02:27.247819+0000 mgr.a (mgr.14373) 3696 : cluster [DBG] pgmap v2562: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:02:28.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:02:28 smithi047 bash[22744]: cluster 2024-09-16T07:02:27.247819+0000 mgr.a (mgr.14373) 3696 : cluster [DBG] pgmap v2562: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:02:28.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:02:28 smithi157 bash[24585]: cluster 2024-09-16T07:02:27.247819+0000 mgr.a (mgr.14373) 3696 : cluster [DBG] pgmap v2562: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:02:29.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:02:29 smithi047 bash[22744]: audit 2024-09-16T07:02:27.620458+0000 mgr.a (mgr.14373) 3697 : audit [DBG] from='client.90675 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:02:29.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:02:29 smithi157 bash[24585]: audit 2024-09-16T07:02:27.620458+0000 mgr.a (mgr.14373) 3697 : audit [DBG] from='client.90675 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:02:29.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:02:29 smithi086 bash[24289]: audit 2024-09-16T07:02:27.620458+0000 mgr.a (mgr.14373) 3697 : audit [DBG] from='client.90675 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:02:30.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:02:30 smithi047 bash[22744]: cluster 2024-09-16T07:02:29.248737+0000 mgr.a (mgr.14373) 3698 : cluster [DBG] pgmap v2563: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-16T07:02:30.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:02:30 smithi157 bash[24585]: cluster 2024-09-16T07:02:29.248737+0000 mgr.a (mgr.14373) 3698 : cluster [DBG] pgmap v2563: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-16T07:02:30.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:02:30 smithi086 bash[24289]: cluster 2024-09-16T07:02:29.248737+0000 mgr.a (mgr.14373) 3698 : cluster [DBG] pgmap v2563: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-16T07:02:32.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:02:32 smithi047 bash[22744]: cluster 2024-09-16T07:02:31.249533+0000 mgr.a (mgr.14373) 3699 : cluster [DBG] pgmap v2564: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-16T07:02:32.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:02:32 smithi157 bash[24585]: cluster 2024-09-16T07:02:31.249533+0000 mgr.a (mgr.14373) 3699 : cluster [DBG] pgmap v2564: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-16T07:02:32.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:02:32 smithi086 bash[24289]: cluster 2024-09-16T07:02:31.249533+0000 mgr.a (mgr.14373) 3699 : cluster [DBG] pgmap v2564: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-16T07:02:33.052 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:02:33.053 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:02:33.053 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:02:33.800 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:02:33.800 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:02:33.800 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:02:33.800 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:02:33.800 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:02:34.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:02:34 smithi047 bash[22744]: cluster 2024-09-16T07:02:33.250893+0000 mgr.a (mgr.14373) 3700 : cluster [DBG] pgmap v2565: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-16T07:02:34.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:02:34 smithi047 bash[22744]: audit 2024-09-16T07:02:33.386729+0000 mgr.a (mgr.14373) 3701 : audit [DBG] from='client.90750 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:02:34.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:02:34 smithi157 bash[24585]: cluster 2024-09-16T07:02:33.250893+0000 mgr.a (mgr.14373) 3700 : cluster [DBG] pgmap v2565: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-16T07:02:34.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:02:34 smithi157 bash[24585]: audit 2024-09-16T07:02:33.386729+0000 mgr.a (mgr.14373) 3701 : audit [DBG] from='client.90750 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:02:34.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:02:34 smithi086 bash[24289]: cluster 2024-09-16T07:02:33.250893+0000 mgr.a (mgr.14373) 3700 : cluster [DBG] pgmap v2565: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-16T07:02:34.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:02:34 smithi086 bash[24289]: audit 2024-09-16T07:02:33.386729+0000 mgr.a (mgr.14373) 3701 : audit [DBG] from='client.90750 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:02:36.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:02:36 smithi157 bash[24585]: cluster 2024-09-16T07:02:35.251754+0000 mgr.a (mgr.14373) 3702 : cluster [DBG] pgmap v2566: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:02:36.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:02:36 smithi086 bash[24289]: cluster 2024-09-16T07:02:35.251754+0000 mgr.a (mgr.14373) 3702 : cluster [DBG] pgmap v2566: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:02:36.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:02:36 smithi047 bash[22744]: cluster 2024-09-16T07:02:35.251754+0000 mgr.a (mgr.14373) 3702 : cluster [DBG] pgmap v2566: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:02:38.801 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:02:38.802 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:02:38.802 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:02:38.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:02:38 smithi157 bash[24585]: cluster 2024-09-16T07:02:37.253904+0000 mgr.a (mgr.14373) 3703 : cluster [DBG] pgmap v2567: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:02:38.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:02:38 smithi086 bash[24289]: cluster 2024-09-16T07:02:37.253904+0000 mgr.a (mgr.14373) 3703 : cluster [DBG] pgmap v2567: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:02:38.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:02:38 smithi047 bash[22744]: cluster 2024-09-16T07:02:37.253904+0000 mgr.a (mgr.14373) 3703 : cluster [DBG] pgmap v2567: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:02:39.560 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:02:39.561 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:02:39.561 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:02:39.561 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:02:39.561 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:02:40.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:02:40 smithi157 bash[24585]: audit 2024-09-16T07:02:39.137258+0000 mgr.a (mgr.14373) 3704 : audit [DBG] from='client.90828 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:02:40.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:02:40 smithi157 bash[24585]: cluster 2024-09-16T07:02:39.254581+0000 mgr.a (mgr.14373) 3705 : cluster [DBG] pgmap v2568: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:02:40.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:02:40 smithi086 bash[24289]: audit 2024-09-16T07:02:39.137258+0000 mgr.a (mgr.14373) 3704 : audit [DBG] from='client.90828 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:02:40.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:02:40 smithi086 bash[24289]: cluster 2024-09-16T07:02:39.254581+0000 mgr.a (mgr.14373) 3705 : cluster [DBG] pgmap v2568: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:02:40.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:02:40 smithi047 bash[22744]: audit 2024-09-16T07:02:39.137258+0000 mgr.a (mgr.14373) 3704 : audit [DBG] from='client.90828 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:02:40.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:02:40 smithi047 bash[22744]: cluster 2024-09-16T07:02:39.254581+0000 mgr.a (mgr.14373) 3705 : cluster [DBG] pgmap v2568: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:02:42.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:02:42 smithi157 bash[24585]: cluster 2024-09-16T07:02:41.255341+0000 mgr.a (mgr.14373) 3706 : cluster [DBG] pgmap v2569: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:02:42.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:02:42 smithi086 bash[24289]: cluster 2024-09-16T07:02:41.255341+0000 mgr.a (mgr.14373) 3706 : cluster [DBG] pgmap v2569: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:02:42.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:02:42 smithi047 bash[22744]: cluster 2024-09-16T07:02:41.255341+0000 mgr.a (mgr.14373) 3706 : cluster [DBG] pgmap v2569: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:02:44.562 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:02:44.562 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:02:44.563 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:02:44.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:02:44 smithi157 bash[24585]: cluster 2024-09-16T07:02:43.257561+0000 mgr.a (mgr.14373) 3707 : cluster [DBG] pgmap v2570: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:02:44.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:02:44 smithi086 bash[24289]: cluster 2024-09-16T07:02:43.257561+0000 mgr.a (mgr.14373) 3707 : cluster [DBG] pgmap v2570: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:02:44.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:02:44 smithi047 bash[22744]: cluster 2024-09-16T07:02:43.257561+0000 mgr.a (mgr.14373) 3707 : cluster [DBG] pgmap v2570: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:02:45.305 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:02:45.306 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:02:45.306 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:02:45.306 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:02:45.306 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:02:46.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:02:46 smithi157 bash[24585]: audit 2024-09-16T07:02:44.896145+0000 mgr.a (mgr.14373) 3708 : audit [DBG] from='client.90906 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:02:46.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:02:46 smithi157 bash[24585]: cluster 2024-09-16T07:02:45.258196+0000 mgr.a (mgr.14373) 3709 : cluster [DBG] pgmap v2571: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:02:46.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:02:46 smithi086 bash[24289]: audit 2024-09-16T07:02:44.896145+0000 mgr.a (mgr.14373) 3708 : audit [DBG] from='client.90906 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:02:46.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:02:46 smithi086 bash[24289]: cluster 2024-09-16T07:02:45.258196+0000 mgr.a (mgr.14373) 3709 : cluster [DBG] pgmap v2571: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:02:46.840 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:02:46 smithi047 bash[22744]: audit 2024-09-16T07:02:44.896145+0000 mgr.a (mgr.14373) 3708 : audit [DBG] from='client.90906 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:02:46.840 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:02:46 smithi047 bash[22744]: cluster 2024-09-16T07:02:45.258196+0000 mgr.a (mgr.14373) 3709 : cluster [DBG] pgmap v2571: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:02:48.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:02:48 smithi157 bash[24585]: cluster 2024-09-16T07:02:47.260333+0000 mgr.a (mgr.14373) 3710 : cluster [DBG] pgmap v2572: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:02:48.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:02:48 smithi086 bash[24289]: cluster 2024-09-16T07:02:47.260333+0000 mgr.a (mgr.14373) 3710 : cluster [DBG] pgmap v2572: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:02:48.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:02:48 smithi047 bash[22744]: cluster 2024-09-16T07:02:47.260333+0000 mgr.a (mgr.14373) 3710 : cluster [DBG] pgmap v2572: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:02:50.307 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:02:50.308 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:02:50.308 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:02:50.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:02:50 smithi157 bash[24585]: cluster 2024-09-16T07:02:49.261109+0000 mgr.a (mgr.14373) 3711 : cluster [DBG] pgmap v2573: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:02:50.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:02:50 smithi086 bash[24289]: cluster 2024-09-16T07:02:49.261109+0000 mgr.a (mgr.14373) 3711 : cluster [DBG] pgmap v2573: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:02:50.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:02:50 smithi047 bash[22744]: cluster 2024-09-16T07:02:49.261109+0000 mgr.a (mgr.14373) 3711 : cluster [DBG] pgmap v2573: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:02:51.091 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:02:51.091 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:02:51.091 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:02:51.091 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:02:51.091 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:02:52.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:02:52 smithi157 bash[24585]: audit 2024-09-16T07:02:50.644592+0000 mgr.a (mgr.14373) 3712 : audit [DBG] from='client.90984 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:02:52.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:02:52 smithi157 bash[24585]: cluster 2024-09-16T07:02:51.262058+0000 mgr.a (mgr.14373) 3713 : cluster [DBG] pgmap v2574: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:02:52.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:02:52 smithi086 bash[24289]: audit 2024-09-16T07:02:50.644592+0000 mgr.a (mgr.14373) 3712 : audit [DBG] from='client.90984 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:02:52.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:02:52 smithi086 bash[24289]: cluster 2024-09-16T07:02:51.262058+0000 mgr.a (mgr.14373) 3713 : cluster [DBG] pgmap v2574: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:02:52.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:02:52 smithi047 bash[22744]: audit 2024-09-16T07:02:50.644592+0000 mgr.a (mgr.14373) 3712 : audit [DBG] from='client.90984 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:02:52.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:02:52 smithi047 bash[22744]: cluster 2024-09-16T07:02:51.262058+0000 mgr.a (mgr.14373) 3713 : cluster [DBG] pgmap v2574: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:02:54.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:02:54 smithi157 bash[24585]: cluster 2024-09-16T07:02:53.264339+0000 mgr.a (mgr.14373) 3714 : cluster [DBG] pgmap v2575: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:02:54.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:02:54 smithi086 bash[24289]: cluster 2024-09-16T07:02:53.264339+0000 mgr.a (mgr.14373) 3714 : cluster [DBG] pgmap v2575: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:02:54.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:02:54 smithi047 bash[22744]: cluster 2024-09-16T07:02:53.264339+0000 mgr.a (mgr.14373) 3714 : cluster [DBG] pgmap v2575: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:02:56.092 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:02:56.093 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:02:56.093 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:02:56.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:02:56 smithi157 bash[24585]: cluster 2024-09-16T07:02:55.265108+0000 mgr.a (mgr.14373) 3715 : cluster [DBG] pgmap v2576: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:02:56.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:02:56 smithi086 bash[24289]: cluster 2024-09-16T07:02:55.265108+0000 mgr.a (mgr.14373) 3715 : cluster [DBG] pgmap v2576: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:02:56.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:02:56 smithi047 bash[22744]: cluster 2024-09-16T07:02:55.265108+0000 mgr.a (mgr.14373) 3715 : cluster [DBG] pgmap v2576: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:02:56.840 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:02:56.841 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:02:56.841 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:02:56.841 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:02:56.841 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:02:57.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:02:57 smithi157 bash[24585]: audit 2024-09-16T07:02:56.431754+0000 mgr.a (mgr.14373) 3716 : audit [DBG] from='client.91056 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:02:57.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:02:57 smithi086 bash[24289]: audit 2024-09-16T07:02:56.431754+0000 mgr.a (mgr.14373) 3716 : audit [DBG] from='client.91056 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:02:57.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:02:57 smithi047 bash[22744]: audit 2024-09-16T07:02:56.431754+0000 mgr.a (mgr.14373) 3716 : audit [DBG] from='client.91056 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:02:58.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:02:58 smithi157 bash[24585]: cluster 2024-09-16T07:02:57.267875+0000 mgr.a (mgr.14373) 3717 : cluster [DBG] pgmap v2577: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:02:58.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:02:58 smithi086 bash[24289]: cluster 2024-09-16T07:02:57.267875+0000 mgr.a (mgr.14373) 3717 : cluster [DBG] pgmap v2577: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:02:58.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:02:58 smithi047 bash[22744]: cluster 2024-09-16T07:02:57.267875+0000 mgr.a (mgr.14373) 3717 : cluster [DBG] pgmap v2577: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:03:00.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:03:00 smithi157 bash[24585]: cluster 2024-09-16T07:02:59.268665+0000 mgr.a (mgr.14373) 3718 : cluster [DBG] pgmap v2578: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:03:00.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:03:00 smithi086 bash[24289]: cluster 2024-09-16T07:02:59.268665+0000 mgr.a (mgr.14373) 3718 : cluster [DBG] pgmap v2578: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:03:00.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:03:00 smithi047 bash[22744]: cluster 2024-09-16T07:02:59.268665+0000 mgr.a (mgr.14373) 3718 : cluster [DBG] pgmap v2578: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:03:01.842 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:03:01.843 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:03:01.843 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:03:02.600 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:03:02.600 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:03:02.600 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:03:02.600 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:03:02.601 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:03:02.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:03:02 smithi157 bash[24585]: cluster 2024-09-16T07:03:01.269422+0000 mgr.a (mgr.14373) 3719 : cluster [DBG] pgmap v2579: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T07:03:02.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:03:02 smithi086 bash[24289]: cluster 2024-09-16T07:03:01.269422+0000 mgr.a (mgr.14373) 3719 : cluster [DBG] pgmap v2579: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T07:03:02.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:03:02 smithi047 bash[22744]: cluster 2024-09-16T07:03:01.269422+0000 mgr.a (mgr.14373) 3719 : cluster [DBG] pgmap v2579: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T07:03:03.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:03:03 smithi157 bash[24585]: audit 2024-09-16T07:03:02.178104+0000 mgr.a (mgr.14373) 3720 : audit [DBG] from='client.91134 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:03:03.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:03:03 smithi086 bash[24289]: audit 2024-09-16T07:03:02.178104+0000 mgr.a (mgr.14373) 3720 : audit [DBG] from='client.91134 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:03:03.840 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:03:03 smithi047 bash[22744]: audit 2024-09-16T07:03:02.178104+0000 mgr.a (mgr.14373) 3720 : audit [DBG] from='client.91134 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:03:04.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:03:04 smithi157 bash[24585]: cluster 2024-09-16T07:03:03.272274+0000 mgr.a (mgr.14373) 3721 : cluster [DBG] pgmap v2580: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:03:04.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:03:04 smithi086 bash[24289]: cluster 2024-09-16T07:03:03.272274+0000 mgr.a (mgr.14373) 3721 : cluster [DBG] pgmap v2580: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:03:04.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:03:04 smithi047 bash[22744]: cluster 2024-09-16T07:03:03.272274+0000 mgr.a (mgr.14373) 3721 : cluster [DBG] pgmap v2580: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:03:06.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:03:06 smithi157 bash[24585]: cluster 2024-09-16T07:03:05.273058+0000 mgr.a (mgr.14373) 3722 : cluster [DBG] pgmap v2581: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:03:06.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:03:06 smithi086 bash[24289]: cluster 2024-09-16T07:03:05.273058+0000 mgr.a (mgr.14373) 3722 : cluster [DBG] pgmap v2581: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:03:06.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:03:06 smithi047 bash[22744]: cluster 2024-09-16T07:03:05.273058+0000 mgr.a (mgr.14373) 3722 : cluster [DBG] pgmap v2581: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:03:07.601 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:03:07.602 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:03:07.603 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:03:08.347 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:03:08.347 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:03:08.347 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:03:08.348 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:03:08.348 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:03:08.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:03:08 smithi157 bash[24585]: cluster 2024-09-16T07:03:07.275022+0000 mgr.a (mgr.14373) 3723 : cluster [DBG] pgmap v2582: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:03:08.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:03:08 smithi086 bash[24289]: cluster 2024-09-16T07:03:07.275022+0000 mgr.a (mgr.14373) 3723 : cluster [DBG] pgmap v2582: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:03:08.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:03:08 smithi047 bash[22744]: cluster 2024-09-16T07:03:07.275022+0000 mgr.a (mgr.14373) 3723 : cluster [DBG] pgmap v2582: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:03:09.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:03:09 smithi157 bash[24585]: audit 2024-09-16T07:03:07.935085+0000 mgr.a (mgr.14373) 3724 : audit [DBG] from='client.91212 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:03:09.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:03:09 smithi086 bash[24289]: audit 2024-09-16T07:03:07.935085+0000 mgr.a (mgr.14373) 3724 : audit [DBG] from='client.91212 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:03:09.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:03:09 smithi047 bash[22744]: audit 2024-09-16T07:03:07.935085+0000 mgr.a (mgr.14373) 3724 : audit [DBG] from='client.91212 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:03:10.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:03:10 smithi157 bash[24585]: cluster 2024-09-16T07:03:09.276118+0000 mgr.a (mgr.14373) 3725 : cluster [DBG] pgmap v2583: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:03:10.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:03:10 smithi157 bash[24585]: audit 2024-09-16T07:03:09.646089+0000 mon.b (mon.2) 378 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T07:03:10.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:03:10 smithi086 bash[24289]: cluster 2024-09-16T07:03:09.276118+0000 mgr.a (mgr.14373) 3725 : cluster [DBG] pgmap v2583: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:03:10.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:03:10 smithi086 bash[24289]: audit 2024-09-16T07:03:09.646089+0000 mon.b (mon.2) 378 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T07:03:10.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:03:10 smithi047 bash[22744]: cluster 2024-09-16T07:03:09.276118+0000 mgr.a (mgr.14373) 3725 : cluster [DBG] pgmap v2583: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:03:10.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:03:10 smithi047 bash[22744]: audit 2024-09-16T07:03:09.646089+0000 mon.b (mon.2) 378 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T07:03:11.464 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 07:03:11 smithi047 bash[22994]: debug 2024-09-16T07:03:11.212+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T07:03:11.465 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 07:03:11 smithi047 bash[22994]: debug 2024-09-16T07:03:11.216+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T07:03:11.465 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:03:11 smithi047 bash[22744]: audit 2024-09-16T07:03:10.471362+0000 mon.b (mon.2) 379 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T07:03:11.465 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:03:11 smithi047 bash[22744]: audit 2024-09-16T07:03:10.473283+0000 mon.b (mon.2) 380 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T07:03:11.465 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:03:11 smithi047 bash[22744]: audit 2024-09-16T07:03:10.486257+0000 mon.a (mon.0) 789 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:03:11.466 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:03:11 smithi047 bash[22744]: audit 2024-09-16T07:03:10.489774+0000 mon.b (mon.2) 381 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:03:11.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:03:11 smithi157 bash[24585]: audit 2024-09-16T07:03:10.471362+0000 mon.b (mon.2) 379 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T07:03:11.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:03:11 smithi157 bash[24585]: audit 2024-09-16T07:03:10.473283+0000 mon.b (mon.2) 380 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T07:03:11.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:03:11 smithi157 bash[24585]: audit 2024-09-16T07:03:10.486257+0000 mon.a (mon.0) 789 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:03:11.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:03:11 smithi157 bash[24585]: audit 2024-09-16T07:03:10.489774+0000 mon.b (mon.2) 381 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:03:11.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:03:11 smithi157 bash[24585]: audit 2024-09-16T07:03:10.494636+0000 mgr.a (mgr.14373) 3726 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:03:11.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:03:11 smithi157 bash[24585]: audit 2024-09-16T07:03:11.217081+0000 mgr.a (mgr.14373) 3727 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T07:03:11.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:03:11 smithi157 bash[24585]: cephadm 2024-09-16T07:03:11.219048+0000 mgr.a (mgr.14373) 3728 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T07:03:11.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:03:11 smithi157 bash[24585]: cluster 2024-09-16T07:03:11.276680+0000 mgr.a (mgr.14373) 3729 : cluster [DBG] pgmap v2584: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:03:11.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:03:11 smithi086 bash[24289]: audit 2024-09-16T07:03:10.471362+0000 mon.b (mon.2) 379 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T07:03:11.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:03:11 smithi086 bash[24289]: audit 2024-09-16T07:03:10.473283+0000 mon.b (mon.2) 380 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T07:03:11.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:03:11 smithi086 bash[24289]: audit 2024-09-16T07:03:10.486257+0000 mon.a (mon.0) 789 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:03:11.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:03:11 smithi086 bash[24289]: audit 2024-09-16T07:03:10.489774+0000 mon.b (mon.2) 381 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:03:11.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:03:11 smithi086 bash[24289]: audit 2024-09-16T07:03:10.494636+0000 mgr.a (mgr.14373) 3726 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:03:11.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:03:11 smithi086 bash[24289]: audit 2024-09-16T07:03:11.217081+0000 mgr.a (mgr.14373) 3727 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T07:03:11.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:03:11 smithi086 bash[24289]: cephadm 2024-09-16T07:03:11.219048+0000 mgr.a (mgr.14373) 3728 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T07:03:11.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:03:11 smithi086 bash[24289]: cluster 2024-09-16T07:03:11.276680+0000 mgr.a (mgr.14373) 3729 : cluster [DBG] pgmap v2584: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:03:11.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:03:11 smithi047 bash[22744]: audit 2024-09-16T07:03:10.494636+0000 mgr.a (mgr.14373) 3726 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:03:11.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:03:11 smithi047 bash[22744]: audit 2024-09-16T07:03:11.217081+0000 mgr.a (mgr.14373) 3727 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T07:03:11.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:03:11 smithi047 bash[22744]: cephadm 2024-09-16T07:03:11.219048+0000 mgr.a (mgr.14373) 3728 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T07:03:11.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:03:11 smithi047 bash[22744]: cluster 2024-09-16T07:03:11.276680+0000 mgr.a (mgr.14373) 3729 : cluster [DBG] pgmap v2584: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:03:13.349 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:03:13.349 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:03:13.350 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:03:14.113 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:03:14.113 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:03:14.113 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:03:14.113 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:03:14.113 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:03:14.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:03:14 smithi047 bash[22744]: cluster 2024-09-16T07:03:13.278933+0000 mgr.a (mgr.14373) 3730 : cluster [DBG] pgmap v2585: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:03:14.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:03:14 smithi157 bash[24585]: cluster 2024-09-16T07:03:13.278933+0000 mgr.a (mgr.14373) 3730 : cluster [DBG] pgmap v2585: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:03:14.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:03:14 smithi086 bash[24289]: cluster 2024-09-16T07:03:13.278933+0000 mgr.a (mgr.14373) 3730 : cluster [DBG] pgmap v2585: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:03:15.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:03:15 smithi047 bash[22744]: audit 2024-09-16T07:03:13.682593+0000 mgr.a (mgr.14373) 3731 : audit [DBG] from='client.91386 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:03:15.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:03:15 smithi157 bash[24585]: audit 2024-09-16T07:03:13.682593+0000 mgr.a (mgr.14373) 3731 : audit [DBG] from='client.91386 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:03:15.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:03:15 smithi086 bash[24289]: audit 2024-09-16T07:03:13.682593+0000 mgr.a (mgr.14373) 3731 : audit [DBG] from='client.91386 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:03:16.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:03:16 smithi157 bash[24585]: cluster 2024-09-16T07:03:15.279920+0000 mgr.a (mgr.14373) 3732 : cluster [DBG] pgmap v2586: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:03:16.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:03:16 smithi086 bash[24289]: cluster 2024-09-16T07:03:15.279920+0000 mgr.a (mgr.14373) 3732 : cluster [DBG] pgmap v2586: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:03:16.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:03:16 smithi047 bash[22744]: cluster 2024-09-16T07:03:15.279920+0000 mgr.a (mgr.14373) 3732 : cluster [DBG] pgmap v2586: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:03:18.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:03:18 smithi157 bash[24585]: cluster 2024-09-16T07:03:17.282083+0000 mgr.a (mgr.14373) 3733 : cluster [DBG] pgmap v2587: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:03:18.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:03:18 smithi086 bash[24289]: cluster 2024-09-16T07:03:17.282083+0000 mgr.a (mgr.14373) 3733 : cluster [DBG] pgmap v2587: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:03:18.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:03:18 smithi047 bash[22744]: cluster 2024-09-16T07:03:17.282083+0000 mgr.a (mgr.14373) 3733 : cluster [DBG] pgmap v2587: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:03:19.114 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:03:19.115 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:03:19.115 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:03:19.894 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:03:19.895 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:03:19.895 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:03:19.895 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:03:19.895 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:03:20.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:03:20 smithi157 bash[24585]: cluster 2024-09-16T07:03:19.282638+0000 mgr.a (mgr.14373) 3734 : cluster [DBG] pgmap v2588: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:03:20.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:03:20 smithi157 bash[24585]: audit 2024-09-16T07:03:19.451381+0000 mgr.a (mgr.14373) 3735 : audit [DBG] from='client.91461 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:03:20.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:03:20 smithi086 bash[24289]: cluster 2024-09-16T07:03:19.282638+0000 mgr.a (mgr.14373) 3734 : cluster [DBG] pgmap v2588: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:03:20.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:03:20 smithi086 bash[24289]: audit 2024-09-16T07:03:19.451381+0000 mgr.a (mgr.14373) 3735 : audit [DBG] from='client.91461 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:03:20.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:03:20 smithi047 bash[22744]: cluster 2024-09-16T07:03:19.282638+0000 mgr.a (mgr.14373) 3734 : cluster [DBG] pgmap v2588: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:03:20.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:03:20 smithi047 bash[22744]: audit 2024-09-16T07:03:19.451381+0000 mgr.a (mgr.14373) 3735 : audit [DBG] from='client.91461 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:03:22.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:03:22 smithi157 bash[24585]: cluster 2024-09-16T07:03:21.283563+0000 mgr.a (mgr.14373) 3736 : cluster [DBG] pgmap v2589: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:03:22.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:03:22 smithi086 bash[24289]: cluster 2024-09-16T07:03:21.283563+0000 mgr.a (mgr.14373) 3736 : cluster [DBG] pgmap v2589: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:03:22.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:03:22 smithi047 bash[22744]: cluster 2024-09-16T07:03:21.283563+0000 mgr.a (mgr.14373) 3736 : cluster [DBG] pgmap v2589: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:03:24.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:03:24 smithi157 bash[24585]: cluster 2024-09-16T07:03:23.285835+0000 mgr.a (mgr.14373) 3737 : cluster [DBG] pgmap v2590: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:03:24.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:03:24 smithi086 bash[24289]: cluster 2024-09-16T07:03:23.285835+0000 mgr.a (mgr.14373) 3737 : cluster [DBG] pgmap v2590: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:03:24.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:03:24 smithi047 bash[22744]: cluster 2024-09-16T07:03:23.285835+0000 mgr.a (mgr.14373) 3737 : cluster [DBG] pgmap v2590: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:03:24.896 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:03:24.897 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:03:24.897 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:03:25.668 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:03:25.669 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:03:25.669 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:03:25.669 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:03:25.669 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:03:26.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:03:26 smithi157 bash[24585]: audit 2024-09-16T07:03:25.234732+0000 mgr.a (mgr.14373) 3738 : audit [DBG] from='client.91536 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:03:26.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:03:26 smithi157 bash[24585]: cluster 2024-09-16T07:03:25.286779+0000 mgr.a (mgr.14373) 3739 : cluster [DBG] pgmap v2591: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:03:26.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:03:26 smithi086 bash[24289]: audit 2024-09-16T07:03:25.234732+0000 mgr.a (mgr.14373) 3738 : audit [DBG] from='client.91536 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:03:26.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:03:26 smithi086 bash[24289]: cluster 2024-09-16T07:03:25.286779+0000 mgr.a (mgr.14373) 3739 : cluster [DBG] pgmap v2591: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:03:26.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:03:26 smithi047 bash[22744]: audit 2024-09-16T07:03:25.234732+0000 mgr.a (mgr.14373) 3738 : audit [DBG] from='client.91536 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:03:26.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:03:26 smithi047 bash[22744]: cluster 2024-09-16T07:03:25.286779+0000 mgr.a (mgr.14373) 3739 : cluster [DBG] pgmap v2591: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:03:28.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:03:28 smithi157 bash[24585]: cluster 2024-09-16T07:03:27.289057+0000 mgr.a (mgr.14373) 3740 : cluster [DBG] pgmap v2592: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:03:28.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:03:28 smithi086 bash[24289]: cluster 2024-09-16T07:03:27.289057+0000 mgr.a (mgr.14373) 3740 : cluster [DBG] pgmap v2592: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:03:28.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:03:28 smithi047 bash[22744]: cluster 2024-09-16T07:03:27.289057+0000 mgr.a (mgr.14373) 3740 : cluster [DBG] pgmap v2592: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:03:30.670 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:03:30.671 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:03:30.671 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:03:30.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:03:30 smithi157 bash[24585]: cluster 2024-09-16T07:03:29.289850+0000 mgr.a (mgr.14373) 3741 : cluster [DBG] pgmap v2593: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:03:30.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:03:30 smithi086 bash[24289]: cluster 2024-09-16T07:03:29.289850+0000 mgr.a (mgr.14373) 3741 : cluster [DBG] pgmap v2593: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:03:30.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:03:30 smithi047 bash[22744]: cluster 2024-09-16T07:03:29.289850+0000 mgr.a (mgr.14373) 3741 : cluster [DBG] pgmap v2593: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:03:31.434 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:03:31.434 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:03:31.434 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:03:31.434 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:03:31.434 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:03:32.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:03:32 smithi157 bash[24585]: audit 2024-09-16T07:03:31.007359+0000 mgr.a (mgr.14373) 3742 : audit [DBG] from='client.91611 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:03:32.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:03:32 smithi157 bash[24585]: cluster 2024-09-16T07:03:31.290386+0000 mgr.a (mgr.14373) 3743 : cluster [DBG] pgmap v2594: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:03:32.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:03:32 smithi086 bash[24289]: audit 2024-09-16T07:03:31.007359+0000 mgr.a (mgr.14373) 3742 : audit [DBG] from='client.91611 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:03:32.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:03:32 smithi086 bash[24289]: cluster 2024-09-16T07:03:31.290386+0000 mgr.a (mgr.14373) 3743 : cluster [DBG] pgmap v2594: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:03:32.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:03:32 smithi047 bash[22744]: audit 2024-09-16T07:03:31.007359+0000 mgr.a (mgr.14373) 3742 : audit [DBG] from='client.91611 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:03:32.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:03:32 smithi047 bash[22744]: cluster 2024-09-16T07:03:31.290386+0000 mgr.a (mgr.14373) 3743 : cluster [DBG] pgmap v2594: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:03:34.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:03:34 smithi157 bash[24585]: cluster 2024-09-16T07:03:33.292637+0000 mgr.a (mgr.14373) 3744 : cluster [DBG] pgmap v2595: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:03:34.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:03:34 smithi086 bash[24289]: cluster 2024-09-16T07:03:33.292637+0000 mgr.a (mgr.14373) 3744 : cluster [DBG] pgmap v2595: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:03:34.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:03:34 smithi047 bash[22744]: cluster 2024-09-16T07:03:33.292637+0000 mgr.a (mgr.14373) 3744 : cluster [DBG] pgmap v2595: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:03:36.435 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:03:36.436 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:03:36.436 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:03:36.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:03:36 smithi157 bash[24585]: cluster 2024-09-16T07:03:35.293432+0000 mgr.a (mgr.14373) 3745 : cluster [DBG] pgmap v2596: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:03:36.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:03:36 smithi086 bash[24289]: cluster 2024-09-16T07:03:35.293432+0000 mgr.a (mgr.14373) 3745 : cluster [DBG] pgmap v2596: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:03:36.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:03:36 smithi047 bash[22744]: cluster 2024-09-16T07:03:35.293432+0000 mgr.a (mgr.14373) 3745 : cluster [DBG] pgmap v2596: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:03:37.210 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:03:37.211 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:03:37.211 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:03:37.211 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:03:37.211 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:03:38.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:03:38 smithi157 bash[24585]: audit 2024-09-16T07:03:36.774157+0000 mgr.a (mgr.14373) 3746 : audit [DBG] from='client.91689 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:03:38.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:03:38 smithi157 bash[24585]: cluster 2024-09-16T07:03:37.296160+0000 mgr.a (mgr.14373) 3747 : cluster [DBG] pgmap v2597: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:03:38.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:03:38 smithi086 bash[24289]: audit 2024-09-16T07:03:36.774157+0000 mgr.a (mgr.14373) 3746 : audit [DBG] from='client.91689 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:03:38.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:03:38 smithi086 bash[24289]: cluster 2024-09-16T07:03:37.296160+0000 mgr.a (mgr.14373) 3747 : cluster [DBG] pgmap v2597: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:03:38.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:03:38 smithi047 bash[22744]: audit 2024-09-16T07:03:36.774157+0000 mgr.a (mgr.14373) 3746 : audit [DBG] from='client.91689 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:03:38.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:03:38 smithi047 bash[22744]: cluster 2024-09-16T07:03:37.296160+0000 mgr.a (mgr.14373) 3747 : cluster [DBG] pgmap v2597: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:03:40.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:03:40 smithi157 bash[24585]: cluster 2024-09-16T07:03:39.296968+0000 mgr.a (mgr.14373) 3748 : cluster [DBG] pgmap v2598: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:03:40.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:03:40 smithi086 bash[24289]: cluster 2024-09-16T07:03:39.296968+0000 mgr.a (mgr.14373) 3748 : cluster [DBG] pgmap v2598: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:03:40.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:03:40 smithi047 bash[22744]: cluster 2024-09-16T07:03:39.296968+0000 mgr.a (mgr.14373) 3748 : cluster [DBG] pgmap v2598: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:03:42.212 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:03:42.213 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:03:42.213 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:03:42.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:03:42 smithi157 bash[24585]: cluster 2024-09-16T07:03:41.297721+0000 mgr.a (mgr.14373) 3749 : cluster [DBG] pgmap v2599: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T07:03:42.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:03:42 smithi086 bash[24289]: cluster 2024-09-16T07:03:41.297721+0000 mgr.a (mgr.14373) 3749 : cluster [DBG] pgmap v2599: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T07:03:42.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:03:42 smithi047 bash[22744]: cluster 2024-09-16T07:03:41.297721+0000 mgr.a (mgr.14373) 3749 : cluster [DBG] pgmap v2599: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T07:03:42.964 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:03:42.964 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:03:42.965 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:03:42.965 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:03:42.965 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:03:44.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:03:44 smithi157 bash[24585]: audit 2024-09-16T07:03:42.546619+0000 mgr.a (mgr.14373) 3750 : audit [DBG] from='client.91764 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:03:44.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:03:44 smithi157 bash[24585]: cluster 2024-09-16T07:03:43.300436+0000 mgr.a (mgr.14373) 3751 : cluster [DBG] pgmap v2600: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:03:44.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:03:44 smithi086 bash[24289]: audit 2024-09-16T07:03:42.546619+0000 mgr.a (mgr.14373) 3750 : audit [DBG] from='client.91764 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:03:44.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:03:44 smithi086 bash[24289]: cluster 2024-09-16T07:03:43.300436+0000 mgr.a (mgr.14373) 3751 : cluster [DBG] pgmap v2600: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:03:44.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:03:44 smithi047 bash[22744]: audit 2024-09-16T07:03:42.546619+0000 mgr.a (mgr.14373) 3750 : audit [DBG] from='client.91764 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:03:44.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:03:44 smithi047 bash[22744]: cluster 2024-09-16T07:03:43.300436+0000 mgr.a (mgr.14373) 3751 : cluster [DBG] pgmap v2600: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:03:46.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:03:46 smithi157 bash[24585]: cluster 2024-09-16T07:03:45.301231+0000 mgr.a (mgr.14373) 3752 : cluster [DBG] pgmap v2601: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:03:46.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:03:46 smithi086 bash[24289]: cluster 2024-09-16T07:03:45.301231+0000 mgr.a (mgr.14373) 3752 : cluster [DBG] pgmap v2601: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:03:46.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:03:46 smithi047 bash[22744]: cluster 2024-09-16T07:03:45.301231+0000 mgr.a (mgr.14373) 3752 : cluster [DBG] pgmap v2601: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:03:47.965 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:03:47.966 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:03:47.966 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:03:48.712 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:03:48.713 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:03:48.713 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:03:48.713 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:03:48.713 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:03:48.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:03:48 smithi157 bash[24585]: cluster 2024-09-16T07:03:47.303193+0000 mgr.a (mgr.14373) 3753 : cluster [DBG] pgmap v2602: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:03:48.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:03:48 smithi086 bash[24289]: cluster 2024-09-16T07:03:47.303193+0000 mgr.a (mgr.14373) 3753 : cluster [DBG] pgmap v2602: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:03:48.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:03:48 smithi047 bash[22744]: cluster 2024-09-16T07:03:47.303193+0000 mgr.a (mgr.14373) 3753 : cluster [DBG] pgmap v2602: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:03:49.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:03:49 smithi157 bash[24585]: audit 2024-09-16T07:03:48.298825+0000 mgr.a (mgr.14373) 3754 : audit [DBG] from='client.91839 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:03:49.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:03:49 smithi086 bash[24289]: audit 2024-09-16T07:03:48.298825+0000 mgr.a (mgr.14373) 3754 : audit [DBG] from='client.91839 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:03:49.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:03:49 smithi047 bash[22744]: audit 2024-09-16T07:03:48.298825+0000 mgr.a (mgr.14373) 3754 : audit [DBG] from='client.91839 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:03:50.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:03:50 smithi157 bash[24585]: cluster 2024-09-16T07:03:49.304159+0000 mgr.a (mgr.14373) 3755 : cluster [DBG] pgmap v2603: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:03:50.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:03:50 smithi086 bash[24289]: cluster 2024-09-16T07:03:49.304159+0000 mgr.a (mgr.14373) 3755 : cluster [DBG] pgmap v2603: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:03:50.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:03:50 smithi047 bash[22744]: cluster 2024-09-16T07:03:49.304159+0000 mgr.a (mgr.14373) 3755 : cluster [DBG] pgmap v2603: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:03:52.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:03:52 smithi157 bash[24585]: cluster 2024-09-16T07:03:51.304973+0000 mgr.a (mgr.14373) 3756 : cluster [DBG] pgmap v2604: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:03:52.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:03:52 smithi086 bash[24289]: cluster 2024-09-16T07:03:51.304973+0000 mgr.a (mgr.14373) 3756 : cluster [DBG] pgmap v2604: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:03:52.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:03:52 smithi047 bash[22744]: cluster 2024-09-16T07:03:51.304973+0000 mgr.a (mgr.14373) 3756 : cluster [DBG] pgmap v2604: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:03:53.714 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:03:53.715 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:03:53.715 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:03:54.499 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:03:54.500 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:03:54.500 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:03:54.500 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:03:54.500 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:03:54.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:03:54 smithi157 bash[24585]: cluster 2024-09-16T07:03:53.307325+0000 mgr.a (mgr.14373) 3757 : cluster [DBG] pgmap v2605: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:03:54.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:03:54 smithi086 bash[24289]: cluster 2024-09-16T07:03:53.307325+0000 mgr.a (mgr.14373) 3757 : cluster [DBG] pgmap v2605: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:03:54.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:03:54 smithi047 bash[22744]: cluster 2024-09-16T07:03:53.307325+0000 mgr.a (mgr.14373) 3757 : cluster [DBG] pgmap v2605: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:03:55.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:03:55 smithi157 bash[24585]: audit 2024-09-16T07:03:54.055176+0000 mgr.a (mgr.14373) 3758 : audit [DBG] from='client.91914 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:03:55.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:03:55 smithi086 bash[24289]: audit 2024-09-16T07:03:54.055176+0000 mgr.a (mgr.14373) 3758 : audit [DBG] from='client.91914 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:03:55.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:03:55 smithi047 bash[22744]: audit 2024-09-16T07:03:54.055176+0000 mgr.a (mgr.14373) 3758 : audit [DBG] from='client.91914 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:03:56.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:03:56 smithi157 bash[24585]: cluster 2024-09-16T07:03:55.308293+0000 mgr.a (mgr.14373) 3759 : cluster [DBG] pgmap v2606: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:03:56.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:03:56 smithi086 bash[24289]: cluster 2024-09-16T07:03:55.308293+0000 mgr.a (mgr.14373) 3759 : cluster [DBG] pgmap v2606: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:03:56.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:03:56 smithi047 bash[22744]: cluster 2024-09-16T07:03:55.308293+0000 mgr.a (mgr.14373) 3759 : cluster [DBG] pgmap v2606: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:03:58.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:03:58 smithi157 bash[24585]: cluster 2024-09-16T07:03:57.310616+0000 mgr.a (mgr.14373) 3760 : cluster [DBG] pgmap v2607: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:03:58.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:03:58 smithi086 bash[24289]: cluster 2024-09-16T07:03:57.310616+0000 mgr.a (mgr.14373) 3760 : cluster [DBG] pgmap v2607: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:03:58.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:03:58 smithi047 bash[22744]: cluster 2024-09-16T07:03:57.310616+0000 mgr.a (mgr.14373) 3760 : cluster [DBG] pgmap v2607: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:03:59.501 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:03:59.501 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:03:59.502 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:04:00.278 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:04:00.279 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:04:00.279 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:04:00.279 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:04:00.279 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:04:00.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:04:00 smithi157 bash[24585]: cluster 2024-09-16T07:03:59.311437+0000 mgr.a (mgr.14373) 3761 : cluster [DBG] pgmap v2608: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:04:00.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:04:00 smithi086 bash[24289]: cluster 2024-09-16T07:03:59.311437+0000 mgr.a (mgr.14373) 3761 : cluster [DBG] pgmap v2608: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:04:00.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:04:00 smithi047 bash[22744]: cluster 2024-09-16T07:03:59.311437+0000 mgr.a (mgr.14373) 3761 : cluster [DBG] pgmap v2608: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:04:01.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:04:01 smithi157 bash[24585]: audit 2024-09-16T07:03:59.844627+0000 mgr.a (mgr.14373) 3762 : audit [DBG] from='client.91989 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:04:01.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:04:01 smithi086 bash[24289]: audit 2024-09-16T07:03:59.844627+0000 mgr.a (mgr.14373) 3762 : audit [DBG] from='client.91989 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:04:01.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:04:01 smithi047 bash[22744]: audit 2024-09-16T07:03:59.844627+0000 mgr.a (mgr.14373) 3762 : audit [DBG] from='client.91989 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:04:02.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:04:02 smithi157 bash[24585]: cluster 2024-09-16T07:04:01.312400+0000 mgr.a (mgr.14373) 3763 : cluster [DBG] pgmap v2609: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:04:02.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:04:02 smithi086 bash[24289]: cluster 2024-09-16T07:04:01.312400+0000 mgr.a (mgr.14373) 3763 : cluster [DBG] pgmap v2609: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:04:02.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:04:02 smithi047 bash[22744]: cluster 2024-09-16T07:04:01.312400+0000 mgr.a (mgr.14373) 3763 : cluster [DBG] pgmap v2609: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:04:04.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:04:04 smithi157 bash[24585]: cluster 2024-09-16T07:04:03.314658+0000 mgr.a (mgr.14373) 3764 : cluster [DBG] pgmap v2610: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:04:04.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:04:04 smithi086 bash[24289]: cluster 2024-09-16T07:04:03.314658+0000 mgr.a (mgr.14373) 3764 : cluster [DBG] pgmap v2610: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:04:04.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:04:04 smithi047 bash[22744]: cluster 2024-09-16T07:04:03.314658+0000 mgr.a (mgr.14373) 3764 : cluster [DBG] pgmap v2610: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:04:05.280 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:04:05.281 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:04:05.281 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:04:06.028 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:04:06.028 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:04:06.029 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:04:06.029 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:04:06.029 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:04:06.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:04:06 smithi157 bash[24585]: cluster 2024-09-16T07:04:05.315405+0000 mgr.a (mgr.14373) 3765 : cluster [DBG] pgmap v2611: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:04:06.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:04:06 smithi086 bash[24289]: cluster 2024-09-16T07:04:05.315405+0000 mgr.a (mgr.14373) 3765 : cluster [DBG] pgmap v2611: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:04:06.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:04:06 smithi047 bash[22744]: cluster 2024-09-16T07:04:05.315405+0000 mgr.a (mgr.14373) 3765 : cluster [DBG] pgmap v2611: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:04:07.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:04:07 smithi157 bash[24585]: audit 2024-09-16T07:04:05.617150+0000 mgr.a (mgr.14373) 3766 : audit [DBG] from='client.92067 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:04:07.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:04:07 smithi086 bash[24289]: audit 2024-09-16T07:04:05.617150+0000 mgr.a (mgr.14373) 3766 : audit [DBG] from='client.92067 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:04:07.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:04:07 smithi047 bash[22744]: audit 2024-09-16T07:04:05.617150+0000 mgr.a (mgr.14373) 3766 : audit [DBG] from='client.92067 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:04:08.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:04:08 smithi157 bash[24585]: cluster 2024-09-16T07:04:07.317667+0000 mgr.a (mgr.14373) 3767 : cluster [DBG] pgmap v2612: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:04:08.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:04:08 smithi086 bash[24289]: cluster 2024-09-16T07:04:07.317667+0000 mgr.a (mgr.14373) 3767 : cluster [DBG] pgmap v2612: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:04:08.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:04:08 smithi047 bash[22744]: cluster 2024-09-16T07:04:07.317667+0000 mgr.a (mgr.14373) 3767 : cluster [DBG] pgmap v2612: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:04:09.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:04:09 smithi157 bash[24585]: cluster 2024-09-16T07:04:09.318474+0000 mgr.a (mgr.14373) 3768 : cluster [DBG] pgmap v2613: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:04:09.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:04:09 smithi086 bash[24289]: cluster 2024-09-16T07:04:09.318474+0000 mgr.a (mgr.14373) 3768 : cluster [DBG] pgmap v2613: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:04:09.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:04:09 smithi047 bash[22744]: cluster 2024-09-16T07:04:09.318474+0000 mgr.a (mgr.14373) 3768 : cluster [DBG] pgmap v2613: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:04:11.030 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:04:11.030 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:04:11.031 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:04:11.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:04:11 smithi047 bash[22744]: audit 2024-09-16T07:04:11.275212+0000 mon.b (mon.2) 382 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T07:04:11.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:04:11 smithi157 bash[24585]: audit 2024-09-16T07:04:11.275212+0000 mon.b (mon.2) 382 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T07:04:11.810 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:04:11.810 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:04:11.810 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:04:11.811 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:04:11.811 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:04:11.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:04:11 smithi086 bash[24289]: audit 2024-09-16T07:04:11.275212+0000 mon.b (mon.2) 382 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T07:04:12.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:04:12 smithi157 bash[24585]: cluster 2024-09-16T07:04:11.319184+0000 mgr.a (mgr.14373) 3769 : cluster [DBG] pgmap v2614: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:04:12.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:04:12 smithi157 bash[24585]: audit 2024-09-16T07:04:11.372541+0000 mgr.a (mgr.14373) 3770 : audit [DBG] from='client.92145 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:04:12.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:04:12 smithi157 bash[24585]: audit 2024-09-16T07:04:12.096543+0000 mon.b (mon.2) 383 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T07:04:12.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:04:12 smithi157 bash[24585]: audit 2024-09-16T07:04:12.098948+0000 mon.b (mon.2) 384 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T07:04:12.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:04:12 smithi157 bash[24585]: audit 2024-09-16T07:04:12.110938+0000 mon.a (mon.0) 790 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:04:12.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:04:12 smithi157 bash[24585]: audit 2024-09-16T07:04:12.123207+0000 mon.b (mon.2) 385 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:04:12.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:04:12 smithi086 bash[24289]: cluster 2024-09-16T07:04:11.319184+0000 mgr.a (mgr.14373) 3769 : cluster [DBG] pgmap v2614: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:04:12.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:04:12 smithi086 bash[24289]: audit 2024-09-16T07:04:11.372541+0000 mgr.a (mgr.14373) 3770 : audit [DBG] from='client.92145 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:04:12.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:04:12 smithi086 bash[24289]: audit 2024-09-16T07:04:12.096543+0000 mon.b (mon.2) 383 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T07:04:12.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:04:12 smithi086 bash[24289]: audit 2024-09-16T07:04:12.098948+0000 mon.b (mon.2) 384 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T07:04:12.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:04:12 smithi086 bash[24289]: audit 2024-09-16T07:04:12.110938+0000 mon.a (mon.0) 790 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:04:12.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:04:12 smithi086 bash[24289]: audit 2024-09-16T07:04:12.123207+0000 mon.b (mon.2) 385 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:04:12.830 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:04:12 smithi047 bash[22744]: cluster 2024-09-16T07:04:11.319184+0000 mgr.a (mgr.14373) 3769 : cluster [DBG] pgmap v2614: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:04:12.831 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:04:12 smithi047 bash[22744]: audit 2024-09-16T07:04:11.372541+0000 mgr.a (mgr.14373) 3770 : audit [DBG] from='client.92145 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:04:12.831 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:04:12 smithi047 bash[22744]: audit 2024-09-16T07:04:12.096543+0000 mon.b (mon.2) 383 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T07:04:12.831 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:04:12 smithi047 bash[22744]: audit 2024-09-16T07:04:12.098948+0000 mon.b (mon.2) 384 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T07:04:12.831 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:04:12 smithi047 bash[22744]: audit 2024-09-16T07:04:12.110938+0000 mon.a (mon.0) 790 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:04:12.831 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:04:12 smithi047 bash[22744]: audit 2024-09-16T07:04:12.123207+0000 mon.b (mon.2) 385 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:04:13.088 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 07:04:12 smithi047 bash[22994]: debug 2024-09-16T07:04:12.827+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T07:04:13.088 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 07:04:12 smithi047 bash[22994]: debug 2024-09-16T07:04:12.831+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T07:04:13.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:04:13 smithi157 bash[24585]: audit 2024-09-16T07:04:12.126688+0000 mgr.a (mgr.14373) 3771 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:04:13.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:04:13 smithi086 bash[24289]: audit 2024-09-16T07:04:12.126688+0000 mgr.a (mgr.14373) 3771 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:04:13.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:04:13 smithi047 bash[22744]: audit 2024-09-16T07:04:12.126688+0000 mgr.a (mgr.14373) 3771 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:04:14.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:04:14 smithi157 bash[24585]: audit 2024-09-16T07:04:12.833891+0000 mgr.a (mgr.14373) 3772 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T07:04:14.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:04:14 smithi157 bash[24585]: cephadm 2024-09-16T07:04:12.836149+0000 mgr.a (mgr.14373) 3773 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T07:04:14.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:04:14 smithi157 bash[24585]: cluster 2024-09-16T07:04:13.321912+0000 mgr.a (mgr.14373) 3774 : cluster [DBG] pgmap v2615: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:04:14.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:04:14 smithi086 bash[24289]: audit 2024-09-16T07:04:12.833891+0000 mgr.a (mgr.14373) 3772 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T07:04:14.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:04:14 smithi086 bash[24289]: cephadm 2024-09-16T07:04:12.836149+0000 mgr.a (mgr.14373) 3773 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T07:04:14.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:04:14 smithi086 bash[24289]: cluster 2024-09-16T07:04:13.321912+0000 mgr.a (mgr.14373) 3774 : cluster [DBG] pgmap v2615: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:04:14.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:04:14 smithi047 bash[22744]: audit 2024-09-16T07:04:12.833891+0000 mgr.a (mgr.14373) 3772 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T07:04:14.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:04:14 smithi047 bash[22744]: cephadm 2024-09-16T07:04:12.836149+0000 mgr.a (mgr.14373) 3773 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T07:04:14.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:04:14 smithi047 bash[22744]: cluster 2024-09-16T07:04:13.321912+0000 mgr.a (mgr.14373) 3774 : cluster [DBG] pgmap v2615: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:04:16.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:04:16 smithi157 bash[24585]: cluster 2024-09-16T07:04:15.322693+0000 mgr.a (mgr.14373) 3775 : cluster [DBG] pgmap v2616: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:04:16.812 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:04:16.812 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:04:16.812 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:04:16.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:04:16 smithi086 bash[24289]: cluster 2024-09-16T07:04:15.322693+0000 mgr.a (mgr.14373) 3775 : cluster [DBG] pgmap v2616: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:04:16.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:04:16 smithi047 bash[22744]: cluster 2024-09-16T07:04:15.322693+0000 mgr.a (mgr.14373) 3775 : cluster [DBG] pgmap v2616: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:04:17.591 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:04:17.591 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:04:17.591 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:04:17.591 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:04:17.591 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:04:18.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:04:18 smithi157 bash[24585]: audit 2024-09-16T07:04:17.150403+0000 mgr.a (mgr.14373) 3776 : audit [DBG] from='client.92325 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:04:18.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:04:18 smithi157 bash[24585]: cluster 2024-09-16T07:04:17.325572+0000 mgr.a (mgr.14373) 3777 : cluster [DBG] pgmap v2617: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:04:18.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:04:18 smithi086 bash[24289]: audit 2024-09-16T07:04:17.150403+0000 mgr.a (mgr.14373) 3776 : audit [DBG] from='client.92325 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:04:18.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:04:18 smithi086 bash[24289]: cluster 2024-09-16T07:04:17.325572+0000 mgr.a (mgr.14373) 3777 : cluster [DBG] pgmap v2617: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:04:18.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:04:18 smithi047 bash[22744]: audit 2024-09-16T07:04:17.150403+0000 mgr.a (mgr.14373) 3776 : audit [DBG] from='client.92325 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:04:18.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:04:18 smithi047 bash[22744]: cluster 2024-09-16T07:04:17.325572+0000 mgr.a (mgr.14373) 3777 : cluster [DBG] pgmap v2617: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:04:20.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:04:20 smithi157 bash[24585]: cluster 2024-09-16T07:04:19.326561+0000 mgr.a (mgr.14373) 3778 : cluster [DBG] pgmap v2618: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T07:04:20.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:04:20 smithi086 bash[24289]: cluster 2024-09-16T07:04:19.326561+0000 mgr.a (mgr.14373) 3778 : cluster [DBG] pgmap v2618: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T07:04:20.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:04:20 smithi047 bash[22744]: cluster 2024-09-16T07:04:19.326561+0000 mgr.a (mgr.14373) 3778 : cluster [DBG] pgmap v2618: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T07:04:22.592 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:04:22.593 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:04:22.593 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:04:22.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:04:22 smithi157 bash[24585]: cluster 2024-09-16T07:04:21.327391+0000 mgr.a (mgr.14373) 3779 : cluster [DBG] pgmap v2619: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T07:04:22.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:04:22 smithi086 bash[24289]: cluster 2024-09-16T07:04:21.327391+0000 mgr.a (mgr.14373) 3779 : cluster [DBG] pgmap v2619: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T07:04:22.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:04:22 smithi047 bash[22744]: cluster 2024-09-16T07:04:21.327391+0000 mgr.a (mgr.14373) 3779 : cluster [DBG] pgmap v2619: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T07:04:23.342 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:04:23.342 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:04:23.342 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:04:23.342 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:04:23.342 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:04:24.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:04:24 smithi157 bash[24585]: audit 2024-09-16T07:04:22.926287+0000 mgr.a (mgr.14373) 3780 : audit [DBG] from='client.92400 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:04:24.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:04:24 smithi157 bash[24585]: cluster 2024-09-16T07:04:23.328606+0000 mgr.a (mgr.14373) 3781 : cluster [DBG] pgmap v2620: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:04:24.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:04:24 smithi086 bash[24289]: audit 2024-09-16T07:04:22.926287+0000 mgr.a (mgr.14373) 3780 : audit [DBG] from='client.92400 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:04:24.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:04:24 smithi086 bash[24289]: cluster 2024-09-16T07:04:23.328606+0000 mgr.a (mgr.14373) 3781 : cluster [DBG] pgmap v2620: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:04:24.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:04:24 smithi047 bash[22744]: audit 2024-09-16T07:04:22.926287+0000 mgr.a (mgr.14373) 3780 : audit [DBG] from='client.92400 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:04:24.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:04:24 smithi047 bash[22744]: cluster 2024-09-16T07:04:23.328606+0000 mgr.a (mgr.14373) 3781 : cluster [DBG] pgmap v2620: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:04:26.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:04:26 smithi157 bash[24585]: cluster 2024-09-16T07:04:25.329393+0000 mgr.a (mgr.14373) 3782 : cluster [DBG] pgmap v2621: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:04:26.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:04:26 smithi086 bash[24289]: cluster 2024-09-16T07:04:25.329393+0000 mgr.a (mgr.14373) 3782 : cluster [DBG] pgmap v2621: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:04:26.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:04:26 smithi047 bash[22744]: cluster 2024-09-16T07:04:25.329393+0000 mgr.a (mgr.14373) 3782 : cluster [DBG] pgmap v2621: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:04:28.343 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:04:28.344 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:04:28.344 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:04:28.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:04:28 smithi157 bash[24585]: cluster 2024-09-16T07:04:27.331353+0000 mgr.a (mgr.14373) 3783 : cluster [DBG] pgmap v2622: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:04:28.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:04:28 smithi086 bash[24289]: cluster 2024-09-16T07:04:27.331353+0000 mgr.a (mgr.14373) 3783 : cluster [DBG] pgmap v2622: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:04:28.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:04:28 smithi047 bash[22744]: cluster 2024-09-16T07:04:27.331353+0000 mgr.a (mgr.14373) 3783 : cluster [DBG] pgmap v2622: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:04:29.089 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:04:29.089 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:04:29.090 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:04:29.090 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:04:29.090 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:04:30.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:04:30 smithi157 bash[24585]: audit 2024-09-16T07:04:28.679493+0000 mgr.a (mgr.14373) 3784 : audit [DBG] from='client.92478 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:04:30.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:04:30 smithi157 bash[24585]: cluster 2024-09-16T07:04:29.332264+0000 mgr.a (mgr.14373) 3785 : cluster [DBG] pgmap v2623: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:04:30.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:04:30 smithi086 bash[24289]: audit 2024-09-16T07:04:28.679493+0000 mgr.a (mgr.14373) 3784 : audit [DBG] from='client.92478 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:04:30.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:04:30 smithi086 bash[24289]: cluster 2024-09-16T07:04:29.332264+0000 mgr.a (mgr.14373) 3785 : cluster [DBG] pgmap v2623: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:04:30.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:04:30 smithi047 bash[22744]: audit 2024-09-16T07:04:28.679493+0000 mgr.a (mgr.14373) 3784 : audit [DBG] from='client.92478 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:04:30.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:04:30 smithi047 bash[22744]: cluster 2024-09-16T07:04:29.332264+0000 mgr.a (mgr.14373) 3785 : cluster [DBG] pgmap v2623: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:04:32.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:04:32 smithi157 bash[24585]: cluster 2024-09-16T07:04:31.333042+0000 mgr.a (mgr.14373) 3786 : cluster [DBG] pgmap v2624: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:04:32.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:04:32 smithi086 bash[24289]: cluster 2024-09-16T07:04:31.333042+0000 mgr.a (mgr.14373) 3786 : cluster [DBG] pgmap v2624: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:04:32.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:04:32 smithi047 bash[22744]: cluster 2024-09-16T07:04:31.333042+0000 mgr.a (mgr.14373) 3786 : cluster [DBG] pgmap v2624: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:04:34.091 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:04:34.091 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:04:34.091 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:04:34.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:04:34 smithi157 bash[24585]: cluster 2024-09-16T07:04:33.335324+0000 mgr.a (mgr.14373) 3787 : cluster [DBG] pgmap v2625: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:04:34.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:04:34 smithi086 bash[24289]: cluster 2024-09-16T07:04:33.335324+0000 mgr.a (mgr.14373) 3787 : cluster [DBG] pgmap v2625: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:04:34.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:04:34 smithi047 bash[22744]: cluster 2024-09-16T07:04:33.335324+0000 mgr.a (mgr.14373) 3787 : cluster [DBG] pgmap v2625: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:04:34.873 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:04:34.874 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:04:34.874 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:04:34.874 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:04:34.874 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:04:35.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:04:35 smithi157 bash[24585]: audit 2024-09-16T07:04:34.434613+0000 mgr.a (mgr.14373) 3788 : audit [DBG] from='client.92556 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:04:35.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:04:35 smithi086 bash[24289]: audit 2024-09-16T07:04:34.434613+0000 mgr.a (mgr.14373) 3788 : audit [DBG] from='client.92556 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:04:35.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:04:35 smithi047 bash[22744]: audit 2024-09-16T07:04:34.434613+0000 mgr.a (mgr.14373) 3788 : audit [DBG] from='client.92556 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:04:36.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:04:36 smithi157 bash[24585]: cluster 2024-09-16T07:04:35.336282+0000 mgr.a (mgr.14373) 3789 : cluster [DBG] pgmap v2626: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:04:36.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:04:36 smithi086 bash[24289]: cluster 2024-09-16T07:04:35.336282+0000 mgr.a (mgr.14373) 3789 : cluster [DBG] pgmap v2626: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:04:36.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:04:36 smithi047 bash[22744]: cluster 2024-09-16T07:04:35.336282+0000 mgr.a (mgr.14373) 3789 : cluster [DBG] pgmap v2626: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:04:38.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:04:38 smithi157 bash[24585]: cluster 2024-09-16T07:04:37.338472+0000 mgr.a (mgr.14373) 3790 : cluster [DBG] pgmap v2627: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:04:38.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:04:38 smithi086 bash[24289]: cluster 2024-09-16T07:04:37.338472+0000 mgr.a (mgr.14373) 3790 : cluster [DBG] pgmap v2627: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:04:38.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:04:38 smithi047 bash[22744]: cluster 2024-09-16T07:04:37.338472+0000 mgr.a (mgr.14373) 3790 : cluster [DBG] pgmap v2627: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:04:39.875 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:04:39.876 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:04:39.877 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:04:40.648 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:04:40.648 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:04:40.648 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:04:40.648 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:04:40.648 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:04:40.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:04:40 smithi157 bash[24585]: cluster 2024-09-16T07:04:39.339254+0000 mgr.a (mgr.14373) 3791 : cluster [DBG] pgmap v2628: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:04:40.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:04:40 smithi086 bash[24289]: cluster 2024-09-16T07:04:39.339254+0000 mgr.a (mgr.14373) 3791 : cluster [DBG] pgmap v2628: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:04:40.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:04:40 smithi047 bash[22744]: cluster 2024-09-16T07:04:39.339254+0000 mgr.a (mgr.14373) 3791 : cluster [DBG] pgmap v2628: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:04:41.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:04:41 smithi157 bash[24585]: audit 2024-09-16T07:04:40.212438+0000 mgr.a (mgr.14373) 3792 : audit [DBG] from='client.92634 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:04:41.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:04:41 smithi086 bash[24289]: audit 2024-09-16T07:04:40.212438+0000 mgr.a (mgr.14373) 3792 : audit [DBG] from='client.92634 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:04:41.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:04:41 smithi047 bash[22744]: audit 2024-09-16T07:04:40.212438+0000 mgr.a (mgr.14373) 3792 : audit [DBG] from='client.92634 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:04:42.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:04:42 smithi157 bash[24585]: cluster 2024-09-16T07:04:41.340171+0000 mgr.a (mgr.14373) 3793 : cluster [DBG] pgmap v2629: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:04:42.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:04:42 smithi086 bash[24289]: cluster 2024-09-16T07:04:41.340171+0000 mgr.a (mgr.14373) 3793 : cluster [DBG] pgmap v2629: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:04:42.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:04:42 smithi047 bash[22744]: cluster 2024-09-16T07:04:41.340171+0000 mgr.a (mgr.14373) 3793 : cluster [DBG] pgmap v2629: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:04:43.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:04:43 smithi157 bash[24585]: cluster 2024-09-16T07:04:43.342507+0000 mgr.a (mgr.14373) 3794 : cluster [DBG] pgmap v2630: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:04:43.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:04:43 smithi086 bash[24289]: cluster 2024-09-16T07:04:43.342507+0000 mgr.a (mgr.14373) 3794 : cluster [DBG] pgmap v2630: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:04:43.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:04:43 smithi047 bash[22744]: cluster 2024-09-16T07:04:43.342507+0000 mgr.a (mgr.14373) 3794 : cluster [DBG] pgmap v2630: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:04:45.649 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:04:45.650 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:04:45.650 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:04:46.421 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:04:46.422 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:04:46.422 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:04:46.422 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:04:46.422 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:04:46.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:04:46 smithi157 bash[24585]: cluster 2024-09-16T07:04:45.343393+0000 mgr.a (mgr.14373) 3795 : cluster [DBG] pgmap v2631: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:04:46.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:04:46 smithi086 bash[24289]: cluster 2024-09-16T07:04:45.343393+0000 mgr.a (mgr.14373) 3795 : cluster [DBG] pgmap v2631: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:04:46.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:04:46 smithi047 bash[22744]: cluster 2024-09-16T07:04:45.343393+0000 mgr.a (mgr.14373) 3795 : cluster [DBG] pgmap v2631: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:04:47.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:04:47 smithi157 bash[24585]: audit 2024-09-16T07:04:45.987254+0000 mgr.a (mgr.14373) 3796 : audit [DBG] from='client.92712 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:04:47.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:04:47 smithi086 bash[24289]: audit 2024-09-16T07:04:45.987254+0000 mgr.a (mgr.14373) 3796 : audit [DBG] from='client.92712 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:04:47.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:04:47 smithi047 bash[22744]: audit 2024-09-16T07:04:45.987254+0000 mgr.a (mgr.14373) 3796 : audit [DBG] from='client.92712 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:04:48.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:04:48 smithi157 bash[24585]: cluster 2024-09-16T07:04:47.345657+0000 mgr.a (mgr.14373) 3797 : cluster [DBG] pgmap v2632: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:04:48.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:04:48 smithi086 bash[24289]: cluster 2024-09-16T07:04:47.345657+0000 mgr.a (mgr.14373) 3797 : cluster [DBG] pgmap v2632: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:04:48.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:04:48 smithi047 bash[22744]: cluster 2024-09-16T07:04:47.345657+0000 mgr.a (mgr.14373) 3797 : cluster [DBG] pgmap v2632: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:04:50.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:04:50 smithi157 bash[24585]: cluster 2024-09-16T07:04:49.346424+0000 mgr.a (mgr.14373) 3798 : cluster [DBG] pgmap v2633: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:04:50.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:04:50 smithi086 bash[24289]: cluster 2024-09-16T07:04:49.346424+0000 mgr.a (mgr.14373) 3798 : cluster [DBG] pgmap v2633: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:04:50.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:04:50 smithi047 bash[22744]: cluster 2024-09-16T07:04:49.346424+0000 mgr.a (mgr.14373) 3798 : cluster [DBG] pgmap v2633: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:04:51.423 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:04:51.424 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:04:51.424 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:04:52.201 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:04:52.202 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:04:52.202 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:04:52.202 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:04:52.202 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:04:52.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:04:52 smithi157 bash[24585]: cluster 2024-09-16T07:04:51.347187+0000 mgr.a (mgr.14373) 3799 : cluster [DBG] pgmap v2634: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:04:52.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:04:52 smithi086 bash[24289]: cluster 2024-09-16T07:04:51.347187+0000 mgr.a (mgr.14373) 3799 : cluster [DBG] pgmap v2634: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:04:52.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:04:52 smithi047 bash[22744]: cluster 2024-09-16T07:04:51.347187+0000 mgr.a (mgr.14373) 3799 : cluster [DBG] pgmap v2634: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:04:53.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:04:53 smithi157 bash[24585]: audit 2024-09-16T07:04:51.763761+0000 mgr.a (mgr.14373) 3800 : audit [DBG] from='client.92787 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:04:53.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:04:53 smithi086 bash[24289]: audit 2024-09-16T07:04:51.763761+0000 mgr.a (mgr.14373) 3800 : audit [DBG] from='client.92787 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:04:53.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:04:53 smithi047 bash[22744]: audit 2024-09-16T07:04:51.763761+0000 mgr.a (mgr.14373) 3800 : audit [DBG] from='client.92787 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:04:54.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:04:54 smithi157 bash[24585]: cluster 2024-09-16T07:04:53.349887+0000 mgr.a (mgr.14373) 3801 : cluster [DBG] pgmap v2635: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:04:54.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:04:54 smithi086 bash[24289]: cluster 2024-09-16T07:04:53.349887+0000 mgr.a (mgr.14373) 3801 : cluster [DBG] pgmap v2635: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:04:54.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:04:54 smithi047 bash[22744]: cluster 2024-09-16T07:04:53.349887+0000 mgr.a (mgr.14373) 3801 : cluster [DBG] pgmap v2635: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:04:56.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:04:56 smithi157 bash[24585]: cluster 2024-09-16T07:04:55.350677+0000 mgr.a (mgr.14373) 3802 : cluster [DBG] pgmap v2636: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:04:56.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:04:56 smithi086 bash[24289]: cluster 2024-09-16T07:04:55.350677+0000 mgr.a (mgr.14373) 3802 : cluster [DBG] pgmap v2636: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:04:56.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:04:56 smithi047 bash[22744]: cluster 2024-09-16T07:04:55.350677+0000 mgr.a (mgr.14373) 3802 : cluster [DBG] pgmap v2636: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:04:57.203 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:04:57.204 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:04:57.204 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:04:57.954 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:04:57.954 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:04:57.954 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:04:57.954 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:04:57.954 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:04:58.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:04:58 smithi157 bash[24585]: cluster 2024-09-16T07:04:57.352318+0000 mgr.a (mgr.14373) 3803 : cluster [DBG] pgmap v2637: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:04:58.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:04:58 smithi086 bash[24289]: cluster 2024-09-16T07:04:57.352318+0000 mgr.a (mgr.14373) 3803 : cluster [DBG] pgmap v2637: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:04:58.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:04:58 smithi047 bash[22744]: cluster 2024-09-16T07:04:57.352318+0000 mgr.a (mgr.14373) 3803 : cluster [DBG] pgmap v2637: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:04:59.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:04:59 smithi157 bash[24585]: audit 2024-09-16T07:04:57.540910+0000 mgr.a (mgr.14373) 3804 : audit [DBG] from='client.92865 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:04:59.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:04:59 smithi086 bash[24289]: audit 2024-09-16T07:04:57.540910+0000 mgr.a (mgr.14373) 3804 : audit [DBG] from='client.92865 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:04:59.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:04:59 smithi047 bash[22744]: audit 2024-09-16T07:04:57.540910+0000 mgr.a (mgr.14373) 3804 : audit [DBG] from='client.92865 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:05:00.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:05:00 smithi157 bash[24585]: cluster 2024-09-16T07:04:59.353253+0000 mgr.a (mgr.14373) 3805 : cluster [DBG] pgmap v2638: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:05:00.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:05:00 smithi086 bash[24289]: cluster 2024-09-16T07:04:59.353253+0000 mgr.a (mgr.14373) 3805 : cluster [DBG] pgmap v2638: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:05:00.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:05:00 smithi047 bash[22744]: cluster 2024-09-16T07:04:59.353253+0000 mgr.a (mgr.14373) 3805 : cluster [DBG] pgmap v2638: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:05:02.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:05:02 smithi157 bash[24585]: cluster 2024-09-16T07:05:01.353869+0000 mgr.a (mgr.14373) 3806 : cluster [DBG] pgmap v2639: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T07:05:02.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:05:02 smithi086 bash[24289]: cluster 2024-09-16T07:05:01.353869+0000 mgr.a (mgr.14373) 3806 : cluster [DBG] pgmap v2639: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T07:05:02.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:05:02 smithi047 bash[22744]: cluster 2024-09-16T07:05:01.353869+0000 mgr.a (mgr.14373) 3806 : cluster [DBG] pgmap v2639: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T07:05:02.956 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:05:02.956 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:05:02.957 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:05:03.709 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:05:03.709 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:05:03.709 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:05:03.709 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:05:03.709 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:05:04.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:05:04 smithi157 bash[24585]: audit 2024-09-16T07:05:03.292135+0000 mgr.a (mgr.14373) 3807 : audit [DBG] from='client.92937 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:05:04.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:05:04 smithi157 bash[24585]: cluster 2024-09-16T07:05:03.355199+0000 mgr.a (mgr.14373) 3808 : cluster [DBG] pgmap v2640: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:05:04.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:05:04 smithi086 bash[24289]: audit 2024-09-16T07:05:03.292135+0000 mgr.a (mgr.14373) 3807 : audit [DBG] from='client.92937 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:05:04.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:05:04 smithi086 bash[24289]: cluster 2024-09-16T07:05:03.355199+0000 mgr.a (mgr.14373) 3808 : cluster [DBG] pgmap v2640: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:05:04.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:05:04 smithi047 bash[22744]: audit 2024-09-16T07:05:03.292135+0000 mgr.a (mgr.14373) 3807 : audit [DBG] from='client.92937 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:05:04.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:05:04 smithi047 bash[22744]: cluster 2024-09-16T07:05:03.355199+0000 mgr.a (mgr.14373) 3808 : cluster [DBG] pgmap v2640: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:05:06.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:05:06 smithi157 bash[24585]: cluster 2024-09-16T07:05:05.356087+0000 mgr.a (mgr.14373) 3809 : cluster [DBG] pgmap v2641: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:05:06.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:05:06 smithi086 bash[24289]: cluster 2024-09-16T07:05:05.356087+0000 mgr.a (mgr.14373) 3809 : cluster [DBG] pgmap v2641: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:05:06.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:05:06 smithi047 bash[22744]: cluster 2024-09-16T07:05:05.356087+0000 mgr.a (mgr.14373) 3809 : cluster [DBG] pgmap v2641: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:05:08.710 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:05:08.711 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:05:08.711 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:05:08.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:05:08 smithi157 bash[24585]: cluster 2024-09-16T07:05:07.358276+0000 mgr.a (mgr.14373) 3810 : cluster [DBG] pgmap v2642: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:05:08.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:05:08 smithi086 bash[24289]: cluster 2024-09-16T07:05:07.358276+0000 mgr.a (mgr.14373) 3810 : cluster [DBG] pgmap v2642: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:05:08.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:05:08 smithi047 bash[22744]: cluster 2024-09-16T07:05:07.358276+0000 mgr.a (mgr.14373) 3810 : cluster [DBG] pgmap v2642: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:05:09.467 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:05:09.468 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:05:09.468 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:05:09.468 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:05:09.468 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:05:10.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:05:10 smithi157 bash[24585]: audit 2024-09-16T07:05:09.047260+0000 mgr.a (mgr.14373) 3811 : audit [DBG] from='client.93012 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:05:10.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:05:10 smithi157 bash[24585]: cluster 2024-09-16T07:05:09.358816+0000 mgr.a (mgr.14373) 3812 : cluster [DBG] pgmap v2643: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:05:10.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:05:10 smithi086 bash[24289]: audit 2024-09-16T07:05:09.047260+0000 mgr.a (mgr.14373) 3811 : audit [DBG] from='client.93012 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:05:10.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:05:10 smithi086 bash[24289]: cluster 2024-09-16T07:05:09.358816+0000 mgr.a (mgr.14373) 3812 : cluster [DBG] pgmap v2643: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:05:10.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:05:10 smithi047 bash[22744]: audit 2024-09-16T07:05:09.047260+0000 mgr.a (mgr.14373) 3811 : audit [DBG] from='client.93012 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:05:10.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:05:10 smithi047 bash[22744]: cluster 2024-09-16T07:05:09.358816+0000 mgr.a (mgr.14373) 3812 : cluster [DBG] pgmap v2643: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:05:12.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:05:12 smithi157 bash[24585]: cluster 2024-09-16T07:05:11.359660+0000 mgr.a (mgr.14373) 3813 : cluster [DBG] pgmap v2644: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:05:12.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:05:12 smithi086 bash[24289]: cluster 2024-09-16T07:05:11.359660+0000 mgr.a (mgr.14373) 3813 : cluster [DBG] pgmap v2644: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:05:12.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:05:12 smithi047 bash[22744]: cluster 2024-09-16T07:05:11.359660+0000 mgr.a (mgr.14373) 3813 : cluster [DBG] pgmap v2644: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:05:13.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:05:13 smithi157 bash[24585]: audit 2024-09-16T07:05:12.885966+0000 mon.b (mon.2) 386 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T07:05:13.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:05:13 smithi086 bash[24289]: audit 2024-09-16T07:05:12.885966+0000 mon.b (mon.2) 386 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T07:05:13.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:05:13 smithi047 bash[22744]: audit 2024-09-16T07:05:12.885966+0000 mon.b (mon.2) 386 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T07:05:14.469 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:05:14.469 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:05:14.469 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:05:14.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:05:14 smithi157 bash[24585]: cluster 2024-09-16T07:05:13.361974+0000 mgr.a (mgr.14373) 3814 : cluster [DBG] pgmap v2645: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:05:14.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:05:14 smithi157 bash[24585]: audit 2024-09-16T07:05:13.728965+0000 mon.b (mon.2) 387 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T07:05:14.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:05:14 smithi157 bash[24585]: audit 2024-09-16T07:05:13.731435+0000 mon.b (mon.2) 388 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T07:05:14.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:05:14 smithi157 bash[24585]: audit 2024-09-16T07:05:13.744709+0000 mon.a (mon.0) 791 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:05:14.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:05:14 smithi157 bash[24585]: audit 2024-09-16T07:05:13.748469+0000 mon.b (mon.2) 389 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:05:14.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:05:14 smithi086 bash[24289]: cluster 2024-09-16T07:05:13.361974+0000 mgr.a (mgr.14373) 3814 : cluster [DBG] pgmap v2645: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:05:14.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:05:14 smithi086 bash[24289]: audit 2024-09-16T07:05:13.728965+0000 mon.b (mon.2) 387 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T07:05:14.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:05:14 smithi086 bash[24289]: audit 2024-09-16T07:05:13.731435+0000 mon.b (mon.2) 388 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T07:05:14.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:05:14 smithi086 bash[24289]: audit 2024-09-16T07:05:13.744709+0000 mon.a (mon.0) 791 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:05:14.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:05:14 smithi086 bash[24289]: audit 2024-09-16T07:05:13.748469+0000 mon.b (mon.2) 389 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:05:14.838 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 07:05:14 smithi047 bash[22994]: debug 2024-09-16T07:05:14.474+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T07:05:14.838 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 07:05:14 smithi047 bash[22994]: debug 2024-09-16T07:05:14.478+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T07:05:14.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:05:14 smithi047 bash[22744]: cluster 2024-09-16T07:05:13.361974+0000 mgr.a (mgr.14373) 3814 : cluster [DBG] pgmap v2645: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:05:14.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:05:14 smithi047 bash[22744]: audit 2024-09-16T07:05:13.728965+0000 mon.b (mon.2) 387 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T07:05:14.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:05:14 smithi047 bash[22744]: audit 2024-09-16T07:05:13.731435+0000 mon.b (mon.2) 388 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T07:05:14.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:05:14 smithi047 bash[22744]: audit 2024-09-16T07:05:13.744709+0000 mon.a (mon.0) 791 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:05:14.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:05:14 smithi047 bash[22744]: audit 2024-09-16T07:05:13.748469+0000 mon.b (mon.2) 389 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:05:15.198 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:05:15.198 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:05:15.198 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:05:15.199 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:05:15.199 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:05:15.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:05:15 smithi157 bash[24585]: audit 2024-09-16T07:05:13.752984+0000 mgr.a (mgr.14373) 3815 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:05:15.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:05:15 smithi157 bash[24585]: audit 2024-09-16T07:05:14.477317+0000 mgr.a (mgr.14373) 3816 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T07:05:15.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:05:15 smithi157 bash[24585]: cephadm 2024-09-16T07:05:14.479372+0000 mgr.a (mgr.14373) 3817 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T07:05:15.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:05:15 smithi086 bash[24289]: audit 2024-09-16T07:05:13.752984+0000 mgr.a (mgr.14373) 3815 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:05:15.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:05:15 smithi086 bash[24289]: audit 2024-09-16T07:05:14.477317+0000 mgr.a (mgr.14373) 3816 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T07:05:15.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:05:15 smithi086 bash[24289]: cephadm 2024-09-16T07:05:14.479372+0000 mgr.a (mgr.14373) 3817 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T07:05:15.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:05:15 smithi047 bash[22744]: audit 2024-09-16T07:05:13.752984+0000 mgr.a (mgr.14373) 3815 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:05:15.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:05:15 smithi047 bash[22744]: audit 2024-09-16T07:05:14.477317+0000 mgr.a (mgr.14373) 3816 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T07:05:15.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:05:15 smithi047 bash[22744]: cephadm 2024-09-16T07:05:14.479372+0000 mgr.a (mgr.14373) 3817 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T07:05:16.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:05:16 smithi157 bash[24585]: audit 2024-09-16T07:05:14.784968+0000 mgr.a (mgr.14373) 3818 : audit [DBG] from='client.93198 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:05:16.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:05:16 smithi157 bash[24585]: cluster 2024-09-16T07:05:15.362895+0000 mgr.a (mgr.14373) 3819 : cluster [DBG] pgmap v2646: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:05:16.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:05:16 smithi086 bash[24289]: audit 2024-09-16T07:05:14.784968+0000 mgr.a (mgr.14373) 3818 : audit [DBG] from='client.93198 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:05:16.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:05:16 smithi086 bash[24289]: cluster 2024-09-16T07:05:15.362895+0000 mgr.a (mgr.14373) 3819 : cluster [DBG] pgmap v2646: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:05:16.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:05:16 smithi047 bash[22744]: audit 2024-09-16T07:05:14.784968+0000 mgr.a (mgr.14373) 3818 : audit [DBG] from='client.93198 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:05:16.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:05:16 smithi047 bash[22744]: cluster 2024-09-16T07:05:15.362895+0000 mgr.a (mgr.14373) 3819 : cluster [DBG] pgmap v2646: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:05:17.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:05:17 smithi157 bash[24585]: cluster 2024-09-16T07:05:17.365037+0000 mgr.a (mgr.14373) 3820 : cluster [DBG] pgmap v2647: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:05:17.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:05:17 smithi086 bash[24289]: cluster 2024-09-16T07:05:17.365037+0000 mgr.a (mgr.14373) 3820 : cluster [DBG] pgmap v2647: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:05:17.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:05:17 smithi047 bash[22744]: cluster 2024-09-16T07:05:17.365037+0000 mgr.a (mgr.14373) 3820 : cluster [DBG] pgmap v2647: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:05:20.200 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:05:20.201 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:05:20.201 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:05:20.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:05:20 smithi157 bash[24585]: cluster 2024-09-16T07:05:19.365781+0000 mgr.a (mgr.14373) 3821 : cluster [DBG] pgmap v2648: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:05:20.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:05:20 smithi086 bash[24289]: cluster 2024-09-16T07:05:19.365781+0000 mgr.a (mgr.14373) 3821 : cluster [DBG] pgmap v2648: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:05:20.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:05:20 smithi047 bash[22744]: cluster 2024-09-16T07:05:19.365781+0000 mgr.a (mgr.14373) 3821 : cluster [DBG] pgmap v2648: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:05:20.973 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:05:20.973 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:05:20.973 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:05:20.973 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:05:20.974 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:05:22.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:05:22 smithi157 bash[24585]: audit 2024-09-16T07:05:20.542024+0000 mgr.a (mgr.14373) 3822 : audit [DBG] from='client.93276 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:05:22.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:05:22 smithi157 bash[24585]: cluster 2024-09-16T07:05:21.366753+0000 mgr.a (mgr.14373) 3823 : cluster [DBG] pgmap v2649: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:05:22.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:05:22 smithi086 bash[24289]: audit 2024-09-16T07:05:20.542024+0000 mgr.a (mgr.14373) 3822 : audit [DBG] from='client.93276 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:05:22.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:05:22 smithi086 bash[24289]: cluster 2024-09-16T07:05:21.366753+0000 mgr.a (mgr.14373) 3823 : cluster [DBG] pgmap v2649: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:05:22.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:05:22 smithi047 bash[22744]: audit 2024-09-16T07:05:20.542024+0000 mgr.a (mgr.14373) 3822 : audit [DBG] from='client.93276 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:05:22.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:05:22 smithi047 bash[22744]: cluster 2024-09-16T07:05:21.366753+0000 mgr.a (mgr.14373) 3823 : cluster [DBG] pgmap v2649: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:05:24.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:05:24 smithi157 bash[24585]: cluster 2024-09-16T07:05:23.368966+0000 mgr.a (mgr.14373) 3824 : cluster [DBG] pgmap v2650: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:05:24.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:05:24 smithi086 bash[24289]: cluster 2024-09-16T07:05:23.368966+0000 mgr.a (mgr.14373) 3824 : cluster [DBG] pgmap v2650: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:05:24.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:05:24 smithi047 bash[22744]: cluster 2024-09-16T07:05:23.368966+0000 mgr.a (mgr.14373) 3824 : cluster [DBG] pgmap v2650: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:05:25.975 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:05:25.975 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:05:25.976 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:05:26.763 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:05:26.763 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:05:26.763 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:05:26.763 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:05:26.763 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:05:26.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:05:26 smithi157 bash[24585]: cluster 2024-09-16T07:05:25.369695+0000 mgr.a (mgr.14373) 3825 : cluster [DBG] pgmap v2651: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:05:26.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:05:26 smithi086 bash[24289]: cluster 2024-09-16T07:05:25.369695+0000 mgr.a (mgr.14373) 3825 : cluster [DBG] pgmap v2651: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:05:26.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:05:26 smithi047 bash[22744]: cluster 2024-09-16T07:05:25.369695+0000 mgr.a (mgr.14373) 3825 : cluster [DBG] pgmap v2651: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:05:27.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:05:27 smithi157 bash[24585]: audit 2024-09-16T07:05:26.316013+0000 mgr.a (mgr.14373) 3826 : audit [DBG] from='client.93348 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:05:27.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:05:27 smithi086 bash[24289]: audit 2024-09-16T07:05:26.316013+0000 mgr.a (mgr.14373) 3826 : audit [DBG] from='client.93348 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:05:27.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:05:27 smithi047 bash[22744]: audit 2024-09-16T07:05:26.316013+0000 mgr.a (mgr.14373) 3826 : audit [DBG] from='client.93348 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:05:28.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:05:28 smithi157 bash[24585]: cluster 2024-09-16T07:05:27.372405+0000 mgr.a (mgr.14373) 3827 : cluster [DBG] pgmap v2652: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:05:28.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:05:28 smithi086 bash[24289]: cluster 2024-09-16T07:05:27.372405+0000 mgr.a (mgr.14373) 3827 : cluster [DBG] pgmap v2652: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:05:28.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:05:28 smithi047 bash[22744]: cluster 2024-09-16T07:05:27.372405+0000 mgr.a (mgr.14373) 3827 : cluster [DBG] pgmap v2652: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:05:30.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:05:30 smithi157 bash[24585]: cluster 2024-09-16T07:05:29.373184+0000 mgr.a (mgr.14373) 3828 : cluster [DBG] pgmap v2653: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:05:30.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:05:30 smithi086 bash[24289]: cluster 2024-09-16T07:05:29.373184+0000 mgr.a (mgr.14373) 3828 : cluster [DBG] pgmap v2653: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:05:30.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:05:30 smithi047 bash[22744]: cluster 2024-09-16T07:05:29.373184+0000 mgr.a (mgr.14373) 3828 : cluster [DBG] pgmap v2653: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:05:31.765 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:05:31.765 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:05:31.765 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:05:32.532 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:05:32.532 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:05:32.532 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:05:32.532 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:05:32.532 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:05:32.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:05:32 smithi157 bash[24585]: cluster 2024-09-16T07:05:31.373921+0000 mgr.a (mgr.14373) 3829 : cluster [DBG] pgmap v2654: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T07:05:32.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:05:32 smithi086 bash[24289]: cluster 2024-09-16T07:05:31.373921+0000 mgr.a (mgr.14373) 3829 : cluster [DBG] pgmap v2654: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T07:05:32.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:05:32 smithi047 bash[22744]: cluster 2024-09-16T07:05:31.373921+0000 mgr.a (mgr.14373) 3829 : cluster [DBG] pgmap v2654: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T07:05:33.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:05:33 smithi157 bash[24585]: audit 2024-09-16T07:05:32.102093+0000 mgr.a (mgr.14373) 3830 : audit [DBG] from='client.93426 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:05:33.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:05:33 smithi086 bash[24289]: audit 2024-09-16T07:05:32.102093+0000 mgr.a (mgr.14373) 3830 : audit [DBG] from='client.93426 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:05:33.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:05:33 smithi047 bash[22744]: audit 2024-09-16T07:05:32.102093+0000 mgr.a (mgr.14373) 3830 : audit [DBG] from='client.93426 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:05:34.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:05:34 smithi157 bash[24585]: cluster 2024-09-16T07:05:33.376622+0000 mgr.a (mgr.14373) 3831 : cluster [DBG] pgmap v2655: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:05:34.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:05:34 smithi086 bash[24289]: cluster 2024-09-16T07:05:33.376622+0000 mgr.a (mgr.14373) 3831 : cluster [DBG] pgmap v2655: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:05:34.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:05:34 smithi047 bash[22744]: cluster 2024-09-16T07:05:33.376622+0000 mgr.a (mgr.14373) 3831 : cluster [DBG] pgmap v2655: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:05:36.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:05:36 smithi157 bash[24585]: cluster 2024-09-16T07:05:35.377379+0000 mgr.a (mgr.14373) 3832 : cluster [DBG] pgmap v2656: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:05:36.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:05:36 smithi086 bash[24289]: cluster 2024-09-16T07:05:35.377379+0000 mgr.a (mgr.14373) 3832 : cluster [DBG] pgmap v2656: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:05:36.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:05:36 smithi047 bash[22744]: cluster 2024-09-16T07:05:35.377379+0000 mgr.a (mgr.14373) 3832 : cluster [DBG] pgmap v2656: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:05:37.533 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:05:37.534 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:05:37.534 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:05:38.297 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:05:38.297 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:05:38.297 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:05:38.297 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:05:38.297 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:05:38.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:05:38 smithi157 bash[24585]: cluster 2024-09-16T07:05:37.379481+0000 mgr.a (mgr.14373) 3833 : cluster [DBG] pgmap v2657: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:05:38.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:05:38 smithi086 bash[24289]: cluster 2024-09-16T07:05:37.379481+0000 mgr.a (mgr.14373) 3833 : cluster [DBG] pgmap v2657: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:05:38.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:05:38 smithi047 bash[22744]: cluster 2024-09-16T07:05:37.379481+0000 mgr.a (mgr.14373) 3833 : cluster [DBG] pgmap v2657: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:05:39.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:05:39 smithi157 bash[24585]: audit 2024-09-16T07:05:37.872255+0000 mgr.a (mgr.14373) 3834 : audit [DBG] from='client.93504 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:05:39.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:05:39 smithi086 bash[24289]: audit 2024-09-16T07:05:37.872255+0000 mgr.a (mgr.14373) 3834 : audit [DBG] from='client.93504 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:05:39.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:05:39 smithi047 bash[22744]: audit 2024-09-16T07:05:37.872255+0000 mgr.a (mgr.14373) 3834 : audit [DBG] from='client.93504 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:05:40.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:05:40 smithi157 bash[24585]: cluster 2024-09-16T07:05:39.380413+0000 mgr.a (mgr.14373) 3835 : cluster [DBG] pgmap v2658: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:05:40.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:05:40 smithi086 bash[24289]: cluster 2024-09-16T07:05:39.380413+0000 mgr.a (mgr.14373) 3835 : cluster [DBG] pgmap v2658: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:05:40.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:05:40 smithi047 bash[22744]: cluster 2024-09-16T07:05:39.380413+0000 mgr.a (mgr.14373) 3835 : cluster [DBG] pgmap v2658: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:05:42.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:05:42 smithi157 bash[24585]: cluster 2024-09-16T07:05:41.381155+0000 mgr.a (mgr.14373) 3836 : cluster [DBG] pgmap v2659: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:05:42.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:05:42 smithi086 bash[24289]: cluster 2024-09-16T07:05:41.381155+0000 mgr.a (mgr.14373) 3836 : cluster [DBG] pgmap v2659: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:05:42.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:05:42 smithi047 bash[22744]: cluster 2024-09-16T07:05:41.381155+0000 mgr.a (mgr.14373) 3836 : cluster [DBG] pgmap v2659: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:05:43.298 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:05:43.299 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:05:43.299 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:05:44.076 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:05:44.077 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:05:44.077 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:05:44.077 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:05:44.077 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:05:44.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:05:44 smithi157 bash[24585]: cluster 2024-09-16T07:05:43.383450+0000 mgr.a (mgr.14373) 3837 : cluster [DBG] pgmap v2660: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:05:44.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:05:44 smithi086 bash[24289]: cluster 2024-09-16T07:05:43.383450+0000 mgr.a (mgr.14373) 3837 : cluster [DBG] pgmap v2660: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:05:44.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:05:44 smithi047 bash[22744]: cluster 2024-09-16T07:05:43.383450+0000 mgr.a (mgr.14373) 3837 : cluster [DBG] pgmap v2660: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:05:45.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:05:45 smithi157 bash[24585]: audit 2024-09-16T07:05:43.643760+0000 mgr.a (mgr.14373) 3838 : audit [DBG] from='client.93582 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:05:45.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:05:45 smithi086 bash[24289]: audit 2024-09-16T07:05:43.643760+0000 mgr.a (mgr.14373) 3838 : audit [DBG] from='client.93582 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:05:45.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:05:45 smithi047 bash[22744]: audit 2024-09-16T07:05:43.643760+0000 mgr.a (mgr.14373) 3838 : audit [DBG] from='client.93582 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:05:46.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:05:46 smithi157 bash[24585]: cluster 2024-09-16T07:05:45.384401+0000 mgr.a (mgr.14373) 3839 : cluster [DBG] pgmap v2661: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:05:46.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:05:46 smithi086 bash[24289]: cluster 2024-09-16T07:05:45.384401+0000 mgr.a (mgr.14373) 3839 : cluster [DBG] pgmap v2661: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:05:46.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:05:46 smithi047 bash[22744]: cluster 2024-09-16T07:05:45.384401+0000 mgr.a (mgr.14373) 3839 : cluster [DBG] pgmap v2661: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:05:47.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:05:47 smithi157 bash[24585]: cluster 2024-09-16T07:05:47.386647+0000 mgr.a (mgr.14373) 3840 : cluster [DBG] pgmap v2662: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:05:47.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:05:47 smithi086 bash[24289]: cluster 2024-09-16T07:05:47.386647+0000 mgr.a (mgr.14373) 3840 : cluster [DBG] pgmap v2662: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:05:47.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:05:47 smithi047 bash[22744]: cluster 2024-09-16T07:05:47.386647+0000 mgr.a (mgr.14373) 3840 : cluster [DBG] pgmap v2662: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:05:49.078 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:05:49.078 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:05:49.079 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:05:49.839 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:05:49.840 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:05:49.840 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:05:49.840 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:05:49.840 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:05:50.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:05:50 smithi157 bash[24585]: cluster 2024-09-16T07:05:49.387284+0000 mgr.a (mgr.14373) 3841 : cluster [DBG] pgmap v2663: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:05:50.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:05:50 smithi157 bash[24585]: audit 2024-09-16T07:05:49.414904+0000 mgr.a (mgr.14373) 3842 : audit [DBG] from='client.93651 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:05:50.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:05:50 smithi086 bash[24289]: cluster 2024-09-16T07:05:49.387284+0000 mgr.a (mgr.14373) 3841 : cluster [DBG] pgmap v2663: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:05:50.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:05:50 smithi086 bash[24289]: audit 2024-09-16T07:05:49.414904+0000 mgr.a (mgr.14373) 3842 : audit [DBG] from='client.93651 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:05:50.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:05:50 smithi047 bash[22744]: cluster 2024-09-16T07:05:49.387284+0000 mgr.a (mgr.14373) 3841 : cluster [DBG] pgmap v2663: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:05:50.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:05:50 smithi047 bash[22744]: audit 2024-09-16T07:05:49.414904+0000 mgr.a (mgr.14373) 3842 : audit [DBG] from='client.93651 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:05:52.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:05:52 smithi157 bash[24585]: cluster 2024-09-16T07:05:51.388123+0000 mgr.a (mgr.14373) 3843 : cluster [DBG] pgmap v2664: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:05:52.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:05:52 smithi086 bash[24289]: cluster 2024-09-16T07:05:51.388123+0000 mgr.a (mgr.14373) 3843 : cluster [DBG] pgmap v2664: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:05:52.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:05:52 smithi047 bash[22744]: cluster 2024-09-16T07:05:51.388123+0000 mgr.a (mgr.14373) 3843 : cluster [DBG] pgmap v2664: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:05:54.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:05:54 smithi157 bash[24585]: cluster 2024-09-16T07:05:53.390393+0000 mgr.a (mgr.14373) 3844 : cluster [DBG] pgmap v2665: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:05:54.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:05:54 smithi086 bash[24289]: cluster 2024-09-16T07:05:53.390393+0000 mgr.a (mgr.14373) 3844 : cluster [DBG] pgmap v2665: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:05:54.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:05:54 smithi047 bash[22744]: cluster 2024-09-16T07:05:53.390393+0000 mgr.a (mgr.14373) 3844 : cluster [DBG] pgmap v2665: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:05:54.841 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:05:54.841 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:05:54.842 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:05:55.589 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:05:55.589 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:05:55.589 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:05:55.589 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:05:55.589 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:05:56.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:05:56 smithi157 bash[24585]: audit 2024-09-16T07:05:55.173434+0000 mgr.a (mgr.14373) 3845 : audit [DBG] from='client.93729 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:05:56.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:05:56 smithi157 bash[24585]: cluster 2024-09-16T07:05:55.397922+0000 mgr.a (mgr.14373) 3846 : cluster [DBG] pgmap v2666: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:05:56.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:05:56 smithi086 bash[24289]: audit 2024-09-16T07:05:55.173434+0000 mgr.a (mgr.14373) 3845 : audit [DBG] from='client.93729 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:05:56.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:05:56 smithi086 bash[24289]: cluster 2024-09-16T07:05:55.397922+0000 mgr.a (mgr.14373) 3846 : cluster [DBG] pgmap v2666: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:05:56.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:05:56 smithi047 bash[22744]: audit 2024-09-16T07:05:55.173434+0000 mgr.a (mgr.14373) 3845 : audit [DBG] from='client.93729 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:05:56.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:05:56 smithi047 bash[22744]: cluster 2024-09-16T07:05:55.397922+0000 mgr.a (mgr.14373) 3846 : cluster [DBG] pgmap v2666: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:05:58.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:05:58 smithi157 bash[24585]: cluster 2024-09-16T07:05:57.400218+0000 mgr.a (mgr.14373) 3847 : cluster [DBG] pgmap v2667: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:05:58.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:05:58 smithi086 bash[24289]: cluster 2024-09-16T07:05:57.400218+0000 mgr.a (mgr.14373) 3847 : cluster [DBG] pgmap v2667: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:05:58.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:05:58 smithi047 bash[22744]: cluster 2024-09-16T07:05:57.400218+0000 mgr.a (mgr.14373) 3847 : cluster [DBG] pgmap v2667: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:06:00.590 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:06:00.591 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:06:00.592 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:06:00.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:06:00 smithi157 bash[24585]: cluster 2024-09-16T07:05:59.400998+0000 mgr.a (mgr.14373) 3848 : cluster [DBG] pgmap v2668: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:06:00.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:06:00 smithi086 bash[24289]: cluster 2024-09-16T07:05:59.400998+0000 mgr.a (mgr.14373) 3848 : cluster [DBG] pgmap v2668: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:06:00.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:06:00 smithi047 bash[22744]: cluster 2024-09-16T07:05:59.400998+0000 mgr.a (mgr.14373) 3848 : cluster [DBG] pgmap v2668: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:06:01.369 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:06:01.370 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:06:01.370 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:06:01.370 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:06:01.370 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:06:02.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:06:02 smithi157 bash[24585]: audit 2024-09-16T07:06:00.927379+0000 mgr.a (mgr.14373) 3849 : audit [DBG] from='client.93807 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:06:02.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:06:02 smithi157 bash[24585]: cluster 2024-09-16T07:06:01.401975+0000 mgr.a (mgr.14373) 3850 : cluster [DBG] pgmap v2669: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:06:02.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:06:02 smithi086 bash[24289]: audit 2024-09-16T07:06:00.927379+0000 mgr.a (mgr.14373) 3849 : audit [DBG] from='client.93807 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:06:02.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:06:02 smithi086 bash[24289]: cluster 2024-09-16T07:06:01.401975+0000 mgr.a (mgr.14373) 3850 : cluster [DBG] pgmap v2669: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:06:02.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:06:02 smithi047 bash[22744]: audit 2024-09-16T07:06:00.927379+0000 mgr.a (mgr.14373) 3849 : audit [DBG] from='client.93807 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:06:02.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:06:02 smithi047 bash[22744]: cluster 2024-09-16T07:06:01.401975+0000 mgr.a (mgr.14373) 3850 : cluster [DBG] pgmap v2669: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:06:04.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:06:04 smithi157 bash[24585]: cluster 2024-09-16T07:06:03.404339+0000 mgr.a (mgr.14373) 3851 : cluster [DBG] pgmap v2670: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:06:04.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:06:04 smithi086 bash[24289]: cluster 2024-09-16T07:06:03.404339+0000 mgr.a (mgr.14373) 3851 : cluster [DBG] pgmap v2670: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:06:04.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:06:04 smithi047 bash[22744]: cluster 2024-09-16T07:06:03.404339+0000 mgr.a (mgr.14373) 3851 : cluster [DBG] pgmap v2670: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:06:06.370 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:06:06.372 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:06:06.372 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:06:06.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:06:06 smithi157 bash[24585]: cluster 2024-09-16T07:06:05.405273+0000 mgr.a (mgr.14373) 3852 : cluster [DBG] pgmap v2671: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:06:06.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:06:06 smithi086 bash[24289]: cluster 2024-09-16T07:06:05.405273+0000 mgr.a (mgr.14373) 3852 : cluster [DBG] pgmap v2671: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:06:06.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:06:06 smithi047 bash[22744]: cluster 2024-09-16T07:06:05.405273+0000 mgr.a (mgr.14373) 3852 : cluster [DBG] pgmap v2671: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:06:07.142 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:06:07.142 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:06:07.143 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:06:07.143 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:06:07.143 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:06:08.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:06:08 smithi157 bash[24585]: audit 2024-09-16T07:06:06.714712+0000 mgr.a (mgr.14373) 3853 : audit [DBG] from='client.93882 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:06:08.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:06:08 smithi157 bash[24585]: cluster 2024-09-16T07:06:07.408062+0000 mgr.a (mgr.14373) 3854 : cluster [DBG] pgmap v2672: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:06:08.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:06:08 smithi086 bash[24289]: audit 2024-09-16T07:06:06.714712+0000 mgr.a (mgr.14373) 3853 : audit [DBG] from='client.93882 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:06:08.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:06:08 smithi086 bash[24289]: cluster 2024-09-16T07:06:07.408062+0000 mgr.a (mgr.14373) 3854 : cluster [DBG] pgmap v2672: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:06:08.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:06:08 smithi047 bash[22744]: audit 2024-09-16T07:06:06.714712+0000 mgr.a (mgr.14373) 3853 : audit [DBG] from='client.93882 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:06:08.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:06:08 smithi047 bash[22744]: cluster 2024-09-16T07:06:07.408062+0000 mgr.a (mgr.14373) 3854 : cluster [DBG] pgmap v2672: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:06:10.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:06:10 smithi157 bash[24585]: cluster 2024-09-16T07:06:09.408980+0000 mgr.a (mgr.14373) 3855 : cluster [DBG] pgmap v2673: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:06:10.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:06:10 smithi086 bash[24289]: cluster 2024-09-16T07:06:09.408980+0000 mgr.a (mgr.14373) 3855 : cluster [DBG] pgmap v2673: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:06:10.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:06:10 smithi047 bash[22744]: cluster 2024-09-16T07:06:09.408980+0000 mgr.a (mgr.14373) 3855 : cluster [DBG] pgmap v2673: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:06:12.144 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:06:12.145 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:06:12.145 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:06:12.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:06:12 smithi157 bash[24585]: cluster 2024-09-16T07:06:11.409907+0000 mgr.a (mgr.14373) 3856 : cluster [DBG] pgmap v2674: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:06:12.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:06:12 smithi086 bash[24289]: cluster 2024-09-16T07:06:11.409907+0000 mgr.a (mgr.14373) 3856 : cluster [DBG] pgmap v2674: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:06:12.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:06:12 smithi047 bash[22744]: cluster 2024-09-16T07:06:11.409907+0000 mgr.a (mgr.14373) 3856 : cluster [DBG] pgmap v2674: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:06:12.916 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:06:12.917 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:06:12.917 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:06:12.917 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:06:12.917 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:06:13.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:06:13 smithi157 bash[24585]: audit 2024-09-16T07:06:12.483655+0000 mgr.a (mgr.14373) 3857 : audit [DBG] from='client.93960 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:06:13.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:06:13 smithi086 bash[24289]: audit 2024-09-16T07:06:12.483655+0000 mgr.a (mgr.14373) 3857 : audit [DBG] from='client.93960 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:06:13.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:06:13 smithi047 bash[22744]: audit 2024-09-16T07:06:12.483655+0000 mgr.a (mgr.14373) 3857 : audit [DBG] from='client.93960 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:06:14.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:06:14 smithi157 bash[24585]: cluster 2024-09-16T07:06:13.412808+0000 mgr.a (mgr.14373) 3858 : cluster [DBG] pgmap v2675: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:06:14.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:06:14 smithi086 bash[24289]: cluster 2024-09-16T07:06:13.412808+0000 mgr.a (mgr.14373) 3858 : cluster [DBG] pgmap v2675: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:06:14.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:06:14 smithi047 bash[22744]: cluster 2024-09-16T07:06:13.412808+0000 mgr.a (mgr.14373) 3858 : cluster [DBG] pgmap v2675: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:06:15.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:06:15 smithi157 bash[24585]: audit 2024-09-16T07:06:14.531144+0000 mon.b (mon.2) 390 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T07:06:15.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:06:15 smithi157 bash[24585]: audit 2024-09-16T07:06:15.160880+0000 mon.a (mon.0) 792 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:06:15.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:06:15 smithi157 bash[24585]: audit 2024-09-16T07:06:15.171859+0000 mon.a (mon.0) 793 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:06:15.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:06:15 smithi086 bash[24289]: audit 2024-09-16T07:06:14.531144+0000 mon.b (mon.2) 390 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T07:06:15.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:06:15 smithi086 bash[24289]: audit 2024-09-16T07:06:15.160880+0000 mon.a (mon.0) 792 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:06:15.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:06:15 smithi086 bash[24289]: audit 2024-09-16T07:06:15.171859+0000 mon.a (mon.0) 793 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:06:15.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:06:15 smithi047 bash[22744]: audit 2024-09-16T07:06:14.531144+0000 mon.b (mon.2) 390 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T07:06:15.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:06:15 smithi047 bash[22744]: audit 2024-09-16T07:06:15.160880+0000 mon.a (mon.0) 792 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:06:15.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:06:15 smithi047 bash[22744]: audit 2024-09-16T07:06:15.171859+0000 mon.a (mon.0) 793 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:06:16.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:06:16 smithi157 bash[24585]: cluster 2024-09-16T07:06:15.413688+0000 mgr.a (mgr.14373) 3859 : cluster [DBG] pgmap v2676: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:06:16.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:06:16 smithi086 bash[24289]: cluster 2024-09-16T07:06:15.413688+0000 mgr.a (mgr.14373) 3859 : cluster [DBG] pgmap v2676: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:06:16.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:06:16 smithi047 bash[22744]: cluster 2024-09-16T07:06:15.413688+0000 mgr.a (mgr.14373) 3859 : cluster [DBG] pgmap v2676: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:06:17.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:06:17 smithi086 bash[24289]: cluster 2024-09-16T07:06:17.415876+0000 mgr.a (mgr.14373) 3860 : cluster [DBG] pgmap v2677: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:06:17.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:06:17 smithi047 bash[22744]: cluster 2024-09-16T07:06:17.415876+0000 mgr.a (mgr.14373) 3860 : cluster [DBG] pgmap v2677: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:06:17.918 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:06:17.919 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:06:17.919 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:06:18.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:06:17 smithi157 bash[24585]: cluster 2024-09-16T07:06:17.415876+0000 mgr.a (mgr.14373) 3860 : cluster [DBG] pgmap v2677: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:06:18.649 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:06:18.650 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:06:18.650 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:06:18.650 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:06:18.650 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:06:18.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:06:18 smithi086 bash[24289]: audit 2024-09-16T07:06:18.241918+0000 mgr.a (mgr.14373) 3861 : audit [DBG] from='client.94038 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:06:18.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:06:18 smithi047 bash[22744]: audit 2024-09-16T07:06:18.241918+0000 mgr.a (mgr.14373) 3861 : audit [DBG] from='client.94038 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:06:19.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:06:18 smithi157 bash[24585]: audit 2024-09-16T07:06:18.241918+0000 mgr.a (mgr.14373) 3861 : audit [DBG] from='client.94038 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:06:19.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:06:19 smithi086 bash[24289]: cluster 2024-09-16T07:06:19.416822+0000 mgr.a (mgr.14373) 3862 : cluster [DBG] pgmap v2678: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:06:19.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:06:19 smithi047 bash[22744]: cluster 2024-09-16T07:06:19.416822+0000 mgr.a (mgr.14373) 3862 : cluster [DBG] pgmap v2678: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:06:20.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:06:19 smithi157 bash[24585]: cluster 2024-09-16T07:06:19.416822+0000 mgr.a (mgr.14373) 3862 : cluster [DBG] pgmap v2678: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:06:22.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:06:22 smithi047 bash[22744]: cluster 2024-09-16T07:06:21.417387+0000 mgr.a (mgr.14373) 3863 : cluster [DBG] pgmap v2679: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:06:22.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:06:22 smithi157 bash[24585]: cluster 2024-09-16T07:06:21.417387+0000 mgr.a (mgr.14373) 3863 : cluster [DBG] pgmap v2679: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:06:22.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:06:22 smithi086 bash[24289]: cluster 2024-09-16T07:06:21.417387+0000 mgr.a (mgr.14373) 3863 : cluster [DBG] pgmap v2679: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:06:23.651 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:06:23.652 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:06:23.652 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:06:24.394 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:06:24.394 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:06:24.394 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:06:24.394 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:06:24.394 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:06:24.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:06:24 smithi157 bash[24585]: cluster 2024-09-16T07:06:23.419606+0000 mgr.a (mgr.14373) 3864 : cluster [DBG] pgmap v2680: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:06:24.817 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:06:24 smithi047 bash[22744]: cluster 2024-09-16T07:06:23.419606+0000 mgr.a (mgr.14373) 3864 : cluster [DBG] pgmap v2680: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:06:24.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:06:24 smithi086 bash[24289]: cluster 2024-09-16T07:06:23.419606+0000 mgr.a (mgr.14373) 3864 : cluster [DBG] pgmap v2680: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:06:25.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:06:25 smithi157 bash[24585]: audit 2024-09-16T07:06:23.985382+0000 mgr.a (mgr.14373) 3865 : audit [DBG] from='client.94110 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:06:25.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:06:25 smithi157 bash[24585]: audit 2024-09-16T07:06:25.305733+0000 mon.a (mon.0) 794 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:06:25.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:06:25 smithi157 bash[24585]: audit 2024-09-16T07:06:25.316412+0000 mon.a (mon.0) 795 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:06:25.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:06:25 smithi157 bash[24585]: audit 2024-09-16T07:06:25.320066+0000 mon.b (mon.2) 391 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T07:06:25.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:06:25 smithi157 bash[24585]: audit 2024-09-16T07:06:25.322543+0000 mon.b (mon.2) 392 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T07:06:25.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:06:25 smithi157 bash[24585]: audit 2024-09-16T07:06:25.335649+0000 mon.a (mon.0) 796 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:06:25.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:06:25 smithi157 bash[24585]: audit 2024-09-16T07:06:25.341391+0000 mon.b (mon.2) 393 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:06:25.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:06:25 smithi086 bash[24289]: audit 2024-09-16T07:06:23.985382+0000 mgr.a (mgr.14373) 3865 : audit [DBG] from='client.94110 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:06:25.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:06:25 smithi086 bash[24289]: audit 2024-09-16T07:06:25.305733+0000 mon.a (mon.0) 794 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:06:25.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:06:25 smithi086 bash[24289]: audit 2024-09-16T07:06:25.316412+0000 mon.a (mon.0) 795 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:06:25.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:06:25 smithi086 bash[24289]: audit 2024-09-16T07:06:25.320066+0000 mon.b (mon.2) 391 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T07:06:25.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:06:25 smithi086 bash[24289]: audit 2024-09-16T07:06:25.322543+0000 mon.b (mon.2) 392 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T07:06:25.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:06:25 smithi086 bash[24289]: audit 2024-09-16T07:06:25.335649+0000 mon.a (mon.0) 796 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:06:25.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:06:25 smithi086 bash[24289]: audit 2024-09-16T07:06:25.341391+0000 mon.b (mon.2) 393 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:06:25.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:06:25 smithi047 bash[22744]: audit 2024-09-16T07:06:23.985382+0000 mgr.a (mgr.14373) 3865 : audit [DBG] from='client.94110 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:06:25.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:06:25 smithi047 bash[22744]: audit 2024-09-16T07:06:25.305733+0000 mon.a (mon.0) 794 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:06:25.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:06:25 smithi047 bash[22744]: audit 2024-09-16T07:06:25.316412+0000 mon.a (mon.0) 795 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:06:25.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:06:25 smithi047 bash[22744]: audit 2024-09-16T07:06:25.320066+0000 mon.b (mon.2) 391 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T07:06:25.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:06:25 smithi047 bash[22744]: audit 2024-09-16T07:06:25.322543+0000 mon.b (mon.2) 392 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T07:06:25.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:06:25 smithi047 bash[22744]: audit 2024-09-16T07:06:25.335649+0000 mon.a (mon.0) 796 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:06:25.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:06:25 smithi047 bash[22744]: audit 2024-09-16T07:06:25.341391+0000 mon.b (mon.2) 393 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:06:26.338 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 07:06:26 smithi047 bash[22994]: debug 2024-09-16T07:06:26.068+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T07:06:26.338 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 07:06:26 smithi047 bash[22994]: debug 2024-09-16T07:06:26.068+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T07:06:26.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:06:26 smithi157 bash[24585]: audit 2024-09-16T07:06:25.346226+0000 mgr.a (mgr.14373) 3866 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:06:26.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:06:26 smithi157 bash[24585]: cluster 2024-09-16T07:06:25.420157+0000 mgr.a (mgr.14373) 3867 : cluster [DBG] pgmap v2681: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:06:26.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:06:26 smithi086 bash[24289]: audit 2024-09-16T07:06:25.346226+0000 mgr.a (mgr.14373) 3866 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:06:26.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:06:26 smithi086 bash[24289]: cluster 2024-09-16T07:06:25.420157+0000 mgr.a (mgr.14373) 3867 : cluster [DBG] pgmap v2681: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:06:26.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:06:26 smithi047 bash[22744]: audit 2024-09-16T07:06:25.346226+0000 mgr.a (mgr.14373) 3866 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:06:26.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:06:26 smithi047 bash[22744]: cluster 2024-09-16T07:06:25.420157+0000 mgr.a (mgr.14373) 3867 : cluster [DBG] pgmap v2681: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:06:27.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:06:27 smithi157 bash[24585]: audit 2024-09-16T07:06:26.071576+0000 mgr.a (mgr.14373) 3868 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T07:06:27.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:06:27 smithi157 bash[24585]: cephadm 2024-09-16T07:06:26.073742+0000 mgr.a (mgr.14373) 3869 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T07:06:27.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:06:27 smithi086 bash[24289]: audit 2024-09-16T07:06:26.071576+0000 mgr.a (mgr.14373) 3868 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T07:06:27.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:06:27 smithi086 bash[24289]: cephadm 2024-09-16T07:06:26.073742+0000 mgr.a (mgr.14373) 3869 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T07:06:27.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:06:27 smithi047 bash[22744]: audit 2024-09-16T07:06:26.071576+0000 mgr.a (mgr.14373) 3868 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T07:06:27.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:06:27 smithi047 bash[22744]: cephadm 2024-09-16T07:06:26.073742+0000 mgr.a (mgr.14373) 3869 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T07:06:28.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:06:28 smithi157 bash[24585]: cluster 2024-09-16T07:06:27.422476+0000 mgr.a (mgr.14373) 3870 : cluster [DBG] pgmap v2682: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:06:28.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:06:28 smithi086 bash[24289]: cluster 2024-09-16T07:06:27.422476+0000 mgr.a (mgr.14373) 3870 : cluster [DBG] pgmap v2682: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:06:28.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:06:28 smithi047 bash[22744]: cluster 2024-09-16T07:06:27.422476+0000 mgr.a (mgr.14373) 3870 : cluster [DBG] pgmap v2682: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:06:29.395 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:06:29.396 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:06:29.396 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:06:30.155 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:06:30.155 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:06:30.155 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:06:30.155 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:06:30.155 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:06:30.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:06:30 smithi157 bash[24585]: cluster 2024-09-16T07:06:29.423026+0000 mgr.a (mgr.14373) 3871 : cluster [DBG] pgmap v2683: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:06:30.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:06:30 smithi086 bash[24289]: cluster 2024-09-16T07:06:29.423026+0000 mgr.a (mgr.14373) 3871 : cluster [DBG] pgmap v2683: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:06:30.841 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:06:30 smithi047 bash[22744]: cluster 2024-09-16T07:06:29.423026+0000 mgr.a (mgr.14373) 3871 : cluster [DBG] pgmap v2683: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:06:31.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:06:31 smithi157 bash[24585]: audit 2024-09-16T07:06:29.734120+0000 mgr.a (mgr.14373) 3872 : audit [DBG] from='client.94293 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:06:31.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:06:31 smithi086 bash[24289]: audit 2024-09-16T07:06:29.734120+0000 mgr.a (mgr.14373) 3872 : audit [DBG] from='client.94293 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:06:31.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:06:31 smithi047 bash[22744]: audit 2024-09-16T07:06:29.734120+0000 mgr.a (mgr.14373) 3872 : audit [DBG] from='client.94293 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:06:32.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:06:32 smithi157 bash[24585]: cluster 2024-09-16T07:06:31.423955+0000 mgr.a (mgr.14373) 3873 : cluster [DBG] pgmap v2684: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:06:32.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:06:32 smithi086 bash[24289]: cluster 2024-09-16T07:06:31.423955+0000 mgr.a (mgr.14373) 3873 : cluster [DBG] pgmap v2684: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:06:32.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:06:32 smithi047 bash[22744]: cluster 2024-09-16T07:06:31.423955+0000 mgr.a (mgr.14373) 3873 : cluster [DBG] pgmap v2684: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:06:34.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:06:34 smithi157 bash[24585]: cluster 2024-09-16T07:06:33.426199+0000 mgr.a (mgr.14373) 3874 : cluster [DBG] pgmap v2685: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:06:34.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:06:34 smithi086 bash[24289]: cluster 2024-09-16T07:06:33.426199+0000 mgr.a (mgr.14373) 3874 : cluster [DBG] pgmap v2685: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:06:34.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:06:34 smithi047 bash[22744]: cluster 2024-09-16T07:06:33.426199+0000 mgr.a (mgr.14373) 3874 : cluster [DBG] pgmap v2685: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:06:35.156 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:06:35.157 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:06:35.157 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:06:35.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:06:35 smithi157 bash[24585]: cluster 2024-09-16T07:06:35.427024+0000 mgr.a (mgr.14373) 3875 : cluster [DBG] pgmap v2686: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:06:35.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:06:35 smithi157 bash[24585]: audit 2024-09-16T07:06:35.489489+0000 mgr.a (mgr.14373) 3876 : audit [DBG] from='client.94371 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:06:35.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:06:35 smithi086 bash[24289]: cluster 2024-09-16T07:06:35.427024+0000 mgr.a (mgr.14373) 3875 : cluster [DBG] pgmap v2686: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:06:35.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:06:35 smithi086 bash[24289]: audit 2024-09-16T07:06:35.489489+0000 mgr.a (mgr.14373) 3876 : audit [DBG] from='client.94371 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:06:35.844 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:06:35 smithi047 bash[22744]: cluster 2024-09-16T07:06:35.427024+0000 mgr.a (mgr.14373) 3875 : cluster [DBG] pgmap v2686: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:06:35.844 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:06:35 smithi047 bash[22744]: audit 2024-09-16T07:06:35.489489+0000 mgr.a (mgr.14373) 3876 : audit [DBG] from='client.94371 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:06:35.902 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:06:35.902 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:06:35.902 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:06:35.902 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:06:35.903 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:06:38.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:06:38 smithi157 bash[24585]: cluster 2024-09-16T07:06:37.429381+0000 mgr.a (mgr.14373) 3877 : cluster [DBG] pgmap v2687: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:06:38.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:06:38 smithi086 bash[24289]: cluster 2024-09-16T07:06:37.429381+0000 mgr.a (mgr.14373) 3877 : cluster [DBG] pgmap v2687: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:06:38.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:06:38 smithi047 bash[22744]: cluster 2024-09-16T07:06:37.429381+0000 mgr.a (mgr.14373) 3877 : cluster [DBG] pgmap v2687: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:06:40.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:06:40 smithi157 bash[24585]: cluster 2024-09-16T07:06:39.430275+0000 mgr.a (mgr.14373) 3878 : cluster [DBG] pgmap v2688: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:06:40.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:06:40 smithi086 bash[24289]: cluster 2024-09-16T07:06:39.430275+0000 mgr.a (mgr.14373) 3878 : cluster [DBG] pgmap v2688: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:06:40.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:06:40 smithi047 bash[22744]: cluster 2024-09-16T07:06:39.430275+0000 mgr.a (mgr.14373) 3878 : cluster [DBG] pgmap v2688: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:06:40.903 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:06:40.904 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:06:40.905 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:06:41.683 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:06:41.683 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:06:41.684 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:06:41.684 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:06:41.684 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:06:42.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:06:42 smithi157 bash[24585]: audit 2024-09-16T07:06:41.241154+0000 mgr.a (mgr.14373) 3879 : audit [DBG] from='client.94446 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:06:42.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:06:42 smithi157 bash[24585]: cluster 2024-09-16T07:06:41.430846+0000 mgr.a (mgr.14373) 3880 : cluster [DBG] pgmap v2689: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:06:42.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:06:42 smithi086 bash[24289]: audit 2024-09-16T07:06:41.241154+0000 mgr.a (mgr.14373) 3879 : audit [DBG] from='client.94446 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:06:42.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:06:42 smithi086 bash[24289]: cluster 2024-09-16T07:06:41.430846+0000 mgr.a (mgr.14373) 3880 : cluster [DBG] pgmap v2689: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:06:42.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:06:42 smithi047 bash[22744]: audit 2024-09-16T07:06:41.241154+0000 mgr.a (mgr.14373) 3879 : audit [DBG] from='client.94446 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:06:42.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:06:42 smithi047 bash[22744]: cluster 2024-09-16T07:06:41.430846+0000 mgr.a (mgr.14373) 3880 : cluster [DBG] pgmap v2689: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:06:44.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:06:44 smithi157 bash[24585]: cluster 2024-09-16T07:06:43.433527+0000 mgr.a (mgr.14373) 3881 : cluster [DBG] pgmap v2690: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-16T07:06:44.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:06:44 smithi086 bash[24289]: cluster 2024-09-16T07:06:43.433527+0000 mgr.a (mgr.14373) 3881 : cluster [DBG] pgmap v2690: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-16T07:06:44.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:06:44 smithi047 bash[22744]: cluster 2024-09-16T07:06:43.433527+0000 mgr.a (mgr.14373) 3881 : cluster [DBG] pgmap v2690: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-16T07:06:46.685 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:06:46.686 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:06:46.686 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:06:46.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:06:46 smithi157 bash[24585]: cluster 2024-09-16T07:06:45.434502+0000 mgr.a (mgr.14373) 3882 : cluster [DBG] pgmap v2691: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T07:06:46.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:06:46 smithi086 bash[24289]: cluster 2024-09-16T07:06:45.434502+0000 mgr.a (mgr.14373) 3882 : cluster [DBG] pgmap v2691: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T07:06:46.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:06:46 smithi047 bash[22744]: cluster 2024-09-16T07:06:45.434502+0000 mgr.a (mgr.14373) 3882 : cluster [DBG] pgmap v2691: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T07:06:47.425 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:06:47.425 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:06:47.425 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:06:47.425 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:06:47.425 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:06:48.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:06:48 smithi157 bash[24585]: audit 2024-09-16T07:06:47.018710+0000 mgr.a (mgr.14373) 3883 : audit [DBG] from='client.94524 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:06:48.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:06:48 smithi157 bash[24585]: cluster 2024-09-16T07:06:47.435988+0000 mgr.a (mgr.14373) 3884 : cluster [DBG] pgmap v2692: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:06:48.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:06:48 smithi086 bash[24289]: audit 2024-09-16T07:06:47.018710+0000 mgr.a (mgr.14373) 3883 : audit [DBG] from='client.94524 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:06:48.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:06:48 smithi086 bash[24289]: cluster 2024-09-16T07:06:47.435988+0000 mgr.a (mgr.14373) 3884 : cluster [DBG] pgmap v2692: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:06:48.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:06:48 smithi047 bash[22744]: audit 2024-09-16T07:06:47.018710+0000 mgr.a (mgr.14373) 3883 : audit [DBG] from='client.94524 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:06:48.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:06:48 smithi047 bash[22744]: cluster 2024-09-16T07:06:47.435988+0000 mgr.a (mgr.14373) 3884 : cluster [DBG] pgmap v2692: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:06:50.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:06:50 smithi157 bash[24585]: cluster 2024-09-16T07:06:49.436896+0000 mgr.a (mgr.14373) 3885 : cluster [DBG] pgmap v2693: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:06:50.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:06:50 smithi086 bash[24289]: cluster 2024-09-16T07:06:49.436896+0000 mgr.a (mgr.14373) 3885 : cluster [DBG] pgmap v2693: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:06:50.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:06:50 smithi047 bash[22744]: cluster 2024-09-16T07:06:49.436896+0000 mgr.a (mgr.14373) 3885 : cluster [DBG] pgmap v2693: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:06:51.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:06:51 smithi086 bash[24289]: cluster 2024-09-16T07:06:51.437671+0000 mgr.a (mgr.14373) 3886 : cluster [DBG] pgmap v2694: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T07:06:51.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:06:51 smithi047 bash[22744]: cluster 2024-09-16T07:06:51.437671+0000 mgr.a (mgr.14373) 3886 : cluster [DBG] pgmap v2694: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T07:06:52.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:06:51 smithi157 bash[24585]: cluster 2024-09-16T07:06:51.437671+0000 mgr.a (mgr.14373) 3886 : cluster [DBG] pgmap v2694: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T07:06:52.426 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:06:52.427 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:06:52.427 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:06:53.166 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:06:53.166 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:06:53.166 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:06:53.166 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:06:53.167 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:06:54.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:06:54 smithi157 bash[24585]: audit 2024-09-16T07:06:52.758085+0000 mgr.a (mgr.14373) 3887 : audit [DBG] from='client.94596 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:06:54.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:06:54 smithi157 bash[24585]: cluster 2024-09-16T07:06:53.440530+0000 mgr.a (mgr.14373) 3888 : cluster [DBG] pgmap v2695: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:06:54.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:06:54 smithi086 bash[24289]: audit 2024-09-16T07:06:52.758085+0000 mgr.a (mgr.14373) 3887 : audit [DBG] from='client.94596 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:06:54.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:06:54 smithi086 bash[24289]: cluster 2024-09-16T07:06:53.440530+0000 mgr.a (mgr.14373) 3888 : cluster [DBG] pgmap v2695: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:06:54.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:06:54 smithi047 bash[22744]: audit 2024-09-16T07:06:52.758085+0000 mgr.a (mgr.14373) 3887 : audit [DBG] from='client.94596 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:06:54.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:06:54 smithi047 bash[22744]: cluster 2024-09-16T07:06:53.440530+0000 mgr.a (mgr.14373) 3888 : cluster [DBG] pgmap v2695: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:06:56.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:06:56 smithi157 bash[24585]: cluster 2024-09-16T07:06:55.441484+0000 mgr.a (mgr.14373) 3889 : cluster [DBG] pgmap v2696: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-16T07:06:56.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:06:56 smithi086 bash[24289]: cluster 2024-09-16T07:06:55.441484+0000 mgr.a (mgr.14373) 3889 : cluster [DBG] pgmap v2696: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-16T07:06:56.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:06:56 smithi047 bash[22744]: cluster 2024-09-16T07:06:55.441484+0000 mgr.a (mgr.14373) 3889 : cluster [DBG] pgmap v2696: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-16T07:06:58.168 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:06:58.168 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:06:58.168 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:06:58.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:06:58 smithi157 bash[24585]: cluster 2024-09-16T07:06:57.443626+0000 mgr.a (mgr.14373) 3890 : cluster [DBG] pgmap v2697: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-16T07:06:58.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:06:58 smithi086 bash[24289]: cluster 2024-09-16T07:06:57.443626+0000 mgr.a (mgr.14373) 3890 : cluster [DBG] pgmap v2697: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-16T07:06:58.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:06:58 smithi047 bash[22744]: cluster 2024-09-16T07:06:57.443626+0000 mgr.a (mgr.14373) 3890 : cluster [DBG] pgmap v2697: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-16T07:06:58.931 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:06:58.932 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:06:58.932 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:06:58.932 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:06:58.932 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:06:59.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:06:59 smithi157 bash[24585]: audit 2024-09-16T07:06:58.505606+0000 mgr.a (mgr.14373) 3891 : audit [DBG] from='client.94674 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:06:59.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:06:59 smithi086 bash[24289]: audit 2024-09-16T07:06:58.505606+0000 mgr.a (mgr.14373) 3891 : audit [DBG] from='client.94674 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:06:59.841 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:06:59 smithi047 bash[22744]: audit 2024-09-16T07:06:58.505606+0000 mgr.a (mgr.14373) 3891 : audit [DBG] from='client.94674 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:07:00.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:07:00 smithi157 bash[24585]: cluster 2024-09-16T07:06:59.444632+0000 mgr.a (mgr.14373) 3892 : cluster [DBG] pgmap v2698: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:07:00.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:07:00 smithi086 bash[24289]: cluster 2024-09-16T07:06:59.444632+0000 mgr.a (mgr.14373) 3892 : cluster [DBG] pgmap v2698: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:07:00.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:07:00 smithi047 bash[22744]: cluster 2024-09-16T07:06:59.444632+0000 mgr.a (mgr.14373) 3892 : cluster [DBG] pgmap v2698: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:07:02.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:07:02 smithi157 bash[24585]: cluster 2024-09-16T07:07:01.445418+0000 mgr.a (mgr.14373) 3893 : cluster [DBG] pgmap v2699: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:07:02.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:07:02 smithi086 bash[24289]: cluster 2024-09-16T07:07:01.445418+0000 mgr.a (mgr.14373) 3893 : cluster [DBG] pgmap v2699: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:07:02.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:07:02 smithi047 bash[22744]: cluster 2024-09-16T07:07:01.445418+0000 mgr.a (mgr.14373) 3893 : cluster [DBG] pgmap v2699: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:07:03.933 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:07:03.934 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:07:03.934 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:07:04.707 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:07:04.707 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:07:04.707 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:07:04.707 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:07:04.707 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:07:04.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:07:04 smithi157 bash[24585]: cluster 2024-09-16T07:07:03.447678+0000 mgr.a (mgr.14373) 3894 : cluster [DBG] pgmap v2700: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:07:04.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:07:04 smithi086 bash[24289]: cluster 2024-09-16T07:07:03.447678+0000 mgr.a (mgr.14373) 3894 : cluster [DBG] pgmap v2700: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:07:04.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:07:04 smithi047 bash[22744]: cluster 2024-09-16T07:07:03.447678+0000 mgr.a (mgr.14373) 3894 : cluster [DBG] pgmap v2700: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:07:05.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:07:05 smithi157 bash[24585]: audit 2024-09-16T07:07:04.270643+0000 mgr.a (mgr.14373) 3895 : audit [DBG] from='client.94752 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:07:05.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:07:05 smithi086 bash[24289]: audit 2024-09-16T07:07:04.270643+0000 mgr.a (mgr.14373) 3895 : audit [DBG] from='client.94752 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:07:05.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:07:05 smithi047 bash[22744]: audit 2024-09-16T07:07:04.270643+0000 mgr.a (mgr.14373) 3895 : audit [DBG] from='client.94752 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:07:06.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:07:06 smithi157 bash[24585]: cluster 2024-09-16T07:07:05.448715+0000 mgr.a (mgr.14373) 3896 : cluster [DBG] pgmap v2701: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:07:06.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:07:06 smithi086 bash[24289]: cluster 2024-09-16T07:07:05.448715+0000 mgr.a (mgr.14373) 3896 : cluster [DBG] pgmap v2701: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:07:06.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:07:06 smithi047 bash[22744]: cluster 2024-09-16T07:07:05.448715+0000 mgr.a (mgr.14373) 3896 : cluster [DBG] pgmap v2701: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:07:08.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:07:08 smithi157 bash[24585]: cluster 2024-09-16T07:07:07.450931+0000 mgr.a (mgr.14373) 3897 : cluster [DBG] pgmap v2702: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:07:08.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:07:08 smithi086 bash[24289]: cluster 2024-09-16T07:07:07.450931+0000 mgr.a (mgr.14373) 3897 : cluster [DBG] pgmap v2702: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:07:08.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:07:08 smithi047 bash[22744]: cluster 2024-09-16T07:07:07.450931+0000 mgr.a (mgr.14373) 3897 : cluster [DBG] pgmap v2702: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:07:09.708 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:07:09.709 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:07:09.709 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:07:10.493 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:07:10.494 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:07:10.494 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:07:10.494 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:07:10.494 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:07:10.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:07:10 smithi157 bash[24585]: cluster 2024-09-16T07:07:09.451701+0000 mgr.a (mgr.14373) 3898 : cluster [DBG] pgmap v2703: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:07:10.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:07:10 smithi086 bash[24289]: cluster 2024-09-16T07:07:09.451701+0000 mgr.a (mgr.14373) 3898 : cluster [DBG] pgmap v2703: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:07:10.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:07:10 smithi047 bash[22744]: cluster 2024-09-16T07:07:09.451701+0000 mgr.a (mgr.14373) 3898 : cluster [DBG] pgmap v2703: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:07:11.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:07:11 smithi157 bash[24585]: audit 2024-09-16T07:07:10.050152+0000 mgr.a (mgr.14373) 3899 : audit [DBG] from='client.94830 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:07:11.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:07:11 smithi086 bash[24289]: audit 2024-09-16T07:07:10.050152+0000 mgr.a (mgr.14373) 3899 : audit [DBG] from='client.94830 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:07:11.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:07:11 smithi047 bash[22744]: audit 2024-09-16T07:07:10.050152+0000 mgr.a (mgr.14373) 3899 : audit [DBG] from='client.94830 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:07:12.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:07:12 smithi157 bash[24585]: cluster 2024-09-16T07:07:11.452689+0000 mgr.a (mgr.14373) 3900 : cluster [DBG] pgmap v2704: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:07:12.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:07:12 smithi086 bash[24289]: cluster 2024-09-16T07:07:11.452689+0000 mgr.a (mgr.14373) 3900 : cluster [DBG] pgmap v2704: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:07:12.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:07:12 smithi047 bash[22744]: cluster 2024-09-16T07:07:11.452689+0000 mgr.a (mgr.14373) 3900 : cluster [DBG] pgmap v2704: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:07:13.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:07:13 smithi157 bash[24585]: cluster 2024-09-16T07:07:13.454990+0000 mgr.a (mgr.14373) 3901 : cluster [DBG] pgmap v2705: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:07:13.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:07:13 smithi086 bash[24289]: cluster 2024-09-16T07:07:13.454990+0000 mgr.a (mgr.14373) 3901 : cluster [DBG] pgmap v2705: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:07:13.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:07:13 smithi047 bash[22744]: cluster 2024-09-16T07:07:13.454990+0000 mgr.a (mgr.14373) 3901 : cluster [DBG] pgmap v2705: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:07:15.497 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:07:15.497 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:07:15.497 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:07:16.265 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:07:16.265 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:07:16.265 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:07:16.265 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:07:16.266 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:07:16.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:07:16 smithi157 bash[24585]: cluster 2024-09-16T07:07:15.455772+0000 mgr.a (mgr.14373) 3902 : cluster [DBG] pgmap v2706: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:07:16.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:07:16 smithi086 bash[24289]: cluster 2024-09-16T07:07:15.455772+0000 mgr.a (mgr.14373) 3902 : cluster [DBG] pgmap v2706: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:07:16.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:07:16 smithi047 bash[22744]: cluster 2024-09-16T07:07:15.455772+0000 mgr.a (mgr.14373) 3902 : cluster [DBG] pgmap v2706: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:07:17.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:07:17 smithi157 bash[24585]: audit 2024-09-16T07:07:15.832744+0000 mgr.a (mgr.14373) 3903 : audit [DBG] from='client.94908 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:07:17.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:07:17 smithi086 bash[24289]: audit 2024-09-16T07:07:15.832744+0000 mgr.a (mgr.14373) 3903 : audit [DBG] from='client.94908 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:07:17.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:07:17 smithi047 bash[22744]: audit 2024-09-16T07:07:15.832744+0000 mgr.a (mgr.14373) 3903 : audit [DBG] from='client.94908 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:07:18.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:07:18 smithi157 bash[24585]: cluster 2024-09-16T07:07:17.458110+0000 mgr.a (mgr.14373) 3904 : cluster [DBG] pgmap v2707: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:07:18.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:07:18 smithi086 bash[24289]: cluster 2024-09-16T07:07:17.458110+0000 mgr.a (mgr.14373) 3904 : cluster [DBG] pgmap v2707: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:07:18.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:07:18 smithi047 bash[22744]: cluster 2024-09-16T07:07:17.458110+0000 mgr.a (mgr.14373) 3904 : cluster [DBG] pgmap v2707: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:07:20.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:07:20 smithi157 bash[24585]: cluster 2024-09-16T07:07:19.458916+0000 mgr.a (mgr.14373) 3905 : cluster [DBG] pgmap v2708: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:07:20.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:07:20 smithi086 bash[24289]: cluster 2024-09-16T07:07:19.458916+0000 mgr.a (mgr.14373) 3905 : cluster [DBG] pgmap v2708: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:07:20.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:07:20 smithi047 bash[22744]: cluster 2024-09-16T07:07:19.458916+0000 mgr.a (mgr.14373) 3905 : cluster [DBG] pgmap v2708: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:07:21.266 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:07:21.267 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:07:21.267 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:07:22.051 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:07:22.051 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:07:22.051 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:07:22.051 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:07:22.052 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:07:22.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:07:22 smithi157 bash[24585]: cluster 2024-09-16T07:07:21.459614+0000 mgr.a (mgr.14373) 3906 : cluster [DBG] pgmap v2709: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:07:22.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:07:22 smithi086 bash[24289]: cluster 2024-09-16T07:07:21.459614+0000 mgr.a (mgr.14373) 3906 : cluster [DBG] pgmap v2709: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:07:22.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:07:22 smithi047 bash[22744]: cluster 2024-09-16T07:07:21.459614+0000 mgr.a (mgr.14373) 3906 : cluster [DBG] pgmap v2709: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:07:23.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:07:23 smithi157 bash[24585]: audit 2024-09-16T07:07:21.607349+0000 mgr.a (mgr.14373) 3907 : audit [DBG] from='client.94986 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:07:23.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:07:23 smithi157 bash[24585]: cluster 2024-09-16T07:07:23.462421+0000 mgr.a (mgr.14373) 3908 : cluster [DBG] pgmap v2710: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:07:23.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:07:23 smithi086 bash[24289]: audit 2024-09-16T07:07:21.607349+0000 mgr.a (mgr.14373) 3907 : audit [DBG] from='client.94986 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:07:23.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:07:23 smithi086 bash[24289]: cluster 2024-09-16T07:07:23.462421+0000 mgr.a (mgr.14373) 3908 : cluster [DBG] pgmap v2710: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:07:23.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:07:23 smithi047 bash[22744]: audit 2024-09-16T07:07:21.607349+0000 mgr.a (mgr.14373) 3907 : audit [DBG] from='client.94986 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:07:23.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:07:23 smithi047 bash[22744]: cluster 2024-09-16T07:07:23.462421+0000 mgr.a (mgr.14373) 3908 : cluster [DBG] pgmap v2710: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:07:26.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:07:26 smithi157 bash[24585]: cluster 2024-09-16T07:07:25.463383+0000 mgr.a (mgr.14373) 3909 : cluster [DBG] pgmap v2711: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:07:26.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:07:26 smithi157 bash[24585]: audit 2024-09-16T07:07:26.133606+0000 mon.b (mon.2) 394 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T07:07:26.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:07:26 smithi086 bash[24289]: cluster 2024-09-16T07:07:25.463383+0000 mgr.a (mgr.14373) 3909 : cluster [DBG] pgmap v2711: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:07:26.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:07:26 smithi086 bash[24289]: audit 2024-09-16T07:07:26.133606+0000 mon.b (mon.2) 394 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T07:07:26.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:07:26 smithi047 bash[22744]: cluster 2024-09-16T07:07:25.463383+0000 mgr.a (mgr.14373) 3909 : cluster [DBG] pgmap v2711: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:07:26.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:07:26 smithi047 bash[22744]: audit 2024-09-16T07:07:26.133606+0000 mon.b (mon.2) 394 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T07:07:27.052 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:07:27.053 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:07:27.053 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:07:27.820 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:07:27.820 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:07:27.821 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:07:27.821 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:07:27.821 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:07:28.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:07:27 smithi157 bash[24585]: audit 2024-09-16T07:07:26.754677+0000 mon.a (mon.0) 797 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:07:28.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:07:27 smithi157 bash[24585]: audit 2024-09-16T07:07:26.762952+0000 mon.a (mon.0) 798 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:07:28.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:07:27 smithi157 bash[24585]: audit 2024-09-16T07:07:26.769313+0000 mon.a (mon.0) 799 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:07:28.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:07:27 smithi157 bash[24585]: audit 2024-09-16T07:07:26.778490+0000 mon.a (mon.0) 800 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:07:28.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:07:27 smithi157 bash[24585]: audit 2024-09-16T07:07:27.381636+0000 mgr.a (mgr.14373) 3910 : audit [DBG] from='client.95064 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:07:28.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:07:27 smithi157 bash[24585]: cluster 2024-09-16T07:07:27.464722+0000 mgr.a (mgr.14373) 3911 : cluster [DBG] pgmap v2712: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:07:28.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:07:27 smithi086 bash[24289]: audit 2024-09-16T07:07:26.754677+0000 mon.a (mon.0) 797 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:07:28.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:07:27 smithi086 bash[24289]: audit 2024-09-16T07:07:26.762952+0000 mon.a (mon.0) 798 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:07:28.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:07:27 smithi086 bash[24289]: audit 2024-09-16T07:07:26.769313+0000 mon.a (mon.0) 799 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:07:28.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:07:27 smithi086 bash[24289]: audit 2024-09-16T07:07:26.778490+0000 mon.a (mon.0) 800 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:07:28.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:07:27 smithi086 bash[24289]: audit 2024-09-16T07:07:27.381636+0000 mgr.a (mgr.14373) 3910 : audit [DBG] from='client.95064 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:07:28.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:07:27 smithi086 bash[24289]: cluster 2024-09-16T07:07:27.464722+0000 mgr.a (mgr.14373) 3911 : cluster [DBG] pgmap v2712: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:07:28.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:07:27 smithi047 bash[22744]: audit 2024-09-16T07:07:26.754677+0000 mon.a (mon.0) 797 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:07:28.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:07:27 smithi047 bash[22744]: audit 2024-09-16T07:07:26.762952+0000 mon.a (mon.0) 798 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:07:28.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:07:27 smithi047 bash[22744]: audit 2024-09-16T07:07:26.769313+0000 mon.a (mon.0) 799 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:07:28.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:07:27 smithi047 bash[22744]: audit 2024-09-16T07:07:26.778490+0000 mon.a (mon.0) 800 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:07:28.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:07:27 smithi047 bash[22744]: audit 2024-09-16T07:07:27.381636+0000 mgr.a (mgr.14373) 3910 : audit [DBG] from='client.95064 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:07:28.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:07:27 smithi047 bash[22744]: cluster 2024-09-16T07:07:27.464722+0000 mgr.a (mgr.14373) 3911 : cluster [DBG] pgmap v2712: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:07:30.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:07:30 smithi157 bash[24585]: cluster 2024-09-16T07:07:29.465599+0000 mgr.a (mgr.14373) 3912 : cluster [DBG] pgmap v2713: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:07:30.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:07:30 smithi086 bash[24289]: cluster 2024-09-16T07:07:29.465599+0000 mgr.a (mgr.14373) 3912 : cluster [DBG] pgmap v2713: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:07:30.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:07:30 smithi047 bash[22744]: cluster 2024-09-16T07:07:29.465599+0000 mgr.a (mgr.14373) 3912 : cluster [DBG] pgmap v2713: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:07:32.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:07:32 smithi157 bash[24585]: cluster 2024-09-16T07:07:31.466552+0000 mgr.a (mgr.14373) 3913 : cluster [DBG] pgmap v2714: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T07:07:32.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:07:32 smithi086 bash[24289]: cluster 2024-09-16T07:07:31.466552+0000 mgr.a (mgr.14373) 3913 : cluster [DBG] pgmap v2714: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T07:07:32.822 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:07:32.823 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:07:32.823 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:07:32.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:07:32 smithi047 bash[22744]: cluster 2024-09-16T07:07:31.466552+0000 mgr.a (mgr.14373) 3913 : cluster [DBG] pgmap v2714: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T07:07:33.580 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:07:33.580 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:07:33.580 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:07:33.580 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:07:33.580 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:07:34.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:07:34 smithi157 bash[24585]: audit 2024-09-16T07:07:33.154234+0000 mgr.a (mgr.14373) 3914 : audit [DBG] from='client.95142 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:07:34.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:07:34 smithi157 bash[24585]: cluster 2024-09-16T07:07:33.468012+0000 mgr.a (mgr.14373) 3915 : cluster [DBG] pgmap v2715: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:07:34.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:07:34 smithi086 bash[24289]: audit 2024-09-16T07:07:33.154234+0000 mgr.a (mgr.14373) 3914 : audit [DBG] from='client.95142 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:07:34.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:07:34 smithi086 bash[24289]: cluster 2024-09-16T07:07:33.468012+0000 mgr.a (mgr.14373) 3915 : cluster [DBG] pgmap v2715: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:07:34.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:07:34 smithi047 bash[22744]: audit 2024-09-16T07:07:33.154234+0000 mgr.a (mgr.14373) 3914 : audit [DBG] from='client.95142 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:07:34.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:07:34 smithi047 bash[22744]: cluster 2024-09-16T07:07:33.468012+0000 mgr.a (mgr.14373) 3915 : cluster [DBG] pgmap v2715: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:07:36.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:07:36 smithi157 bash[24585]: cluster 2024-09-16T07:07:35.468852+0000 mgr.a (mgr.14373) 3916 : cluster [DBG] pgmap v2716: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:07:36.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:07:36 smithi086 bash[24289]: cluster 2024-09-16T07:07:35.468852+0000 mgr.a (mgr.14373) 3916 : cluster [DBG] pgmap v2716: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:07:36.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:07:36 smithi047 bash[22744]: cluster 2024-09-16T07:07:35.468852+0000 mgr.a (mgr.14373) 3916 : cluster [DBG] pgmap v2716: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:07:38.089 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 07:07:37 smithi047 bash[22994]: debug 2024-09-16T07:07:37.834+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T07:07:38.089 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 07:07:37 smithi047 bash[22994]: debug 2024-09-16T07:07:37.834+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T07:07:38.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:07:38 smithi047 bash[22744]: audit 2024-09-16T07:07:37.027114+0000 mon.a (mon.0) 801 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:07:38.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:07:38 smithi047 bash[22744]: audit 2024-09-16T07:07:37.038323+0000 mon.a (mon.0) 802 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:07:38.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:07:38 smithi047 bash[22744]: audit 2024-09-16T07:07:37.039761+0000 mon.b (mon.2) 395 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T07:07:38.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:07:38 smithi047 bash[22744]: audit 2024-09-16T07:07:37.042031+0000 mon.b (mon.2) 396 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T07:07:38.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:07:38 smithi047 bash[22744]: audit 2024-09-16T07:07:37.055342+0000 mon.a (mon.0) 803 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:07:38.090 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:07:38 smithi047 bash[22744]: audit 2024-09-16T07:07:37.059237+0000 mon.b (mon.2) 397 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:07:38.090 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:07:38 smithi047 bash[22744]: audit 2024-09-16T07:07:37.063591+0000 mgr.a (mgr.14373) 3917 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:07:38.090 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:07:38 smithi047 bash[22744]: cluster 2024-09-16T07:07:37.470302+0000 mgr.a (mgr.14373) 3918 : cluster [DBG] pgmap v2717: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:07:38.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:07:38 smithi157 bash[24585]: audit 2024-09-16T07:07:37.027114+0000 mon.a (mon.0) 801 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:07:38.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:07:38 smithi157 bash[24585]: audit 2024-09-16T07:07:37.038323+0000 mon.a (mon.0) 802 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:07:38.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:07:38 smithi157 bash[24585]: audit 2024-09-16T07:07:37.039761+0000 mon.b (mon.2) 395 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T07:07:38.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:07:38 smithi157 bash[24585]: audit 2024-09-16T07:07:37.042031+0000 mon.b (mon.2) 396 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T07:07:38.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:07:38 smithi157 bash[24585]: audit 2024-09-16T07:07:37.055342+0000 mon.a (mon.0) 803 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:07:38.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:07:38 smithi157 bash[24585]: audit 2024-09-16T07:07:37.059237+0000 mon.b (mon.2) 397 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:07:38.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:07:38 smithi157 bash[24585]: audit 2024-09-16T07:07:37.063591+0000 mgr.a (mgr.14373) 3917 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:07:38.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:07:38 smithi157 bash[24585]: cluster 2024-09-16T07:07:37.470302+0000 mgr.a (mgr.14373) 3918 : cluster [DBG] pgmap v2717: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:07:38.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:07:38 smithi086 bash[24289]: audit 2024-09-16T07:07:37.027114+0000 mon.a (mon.0) 801 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:07:38.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:07:38 smithi086 bash[24289]: audit 2024-09-16T07:07:37.038323+0000 mon.a (mon.0) 802 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:07:38.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:07:38 smithi086 bash[24289]: audit 2024-09-16T07:07:37.039761+0000 mon.b (mon.2) 395 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T07:07:38.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:07:38 smithi086 bash[24289]: audit 2024-09-16T07:07:37.042031+0000 mon.b (mon.2) 396 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T07:07:38.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:07:38 smithi086 bash[24289]: audit 2024-09-16T07:07:37.055342+0000 mon.a (mon.0) 803 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:07:38.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:07:38 smithi086 bash[24289]: audit 2024-09-16T07:07:37.059237+0000 mon.b (mon.2) 397 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:07:38.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:07:38 smithi086 bash[24289]: audit 2024-09-16T07:07:37.063591+0000 mgr.a (mgr.14373) 3917 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:07:38.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:07:38 smithi086 bash[24289]: cluster 2024-09-16T07:07:37.470302+0000 mgr.a (mgr.14373) 3918 : cluster [DBG] pgmap v2717: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:07:38.581 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:07:38.582 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:07:38.582 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:07:39.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:07:39 smithi086 bash[24289]: audit 2024-09-16T07:07:37.838766+0000 mgr.a (mgr.14373) 3919 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T07:07:39.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:07:39 smithi086 bash[24289]: cephadm 2024-09-16T07:07:37.841343+0000 mgr.a (mgr.14373) 3920 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T07:07:39.328 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:07:39.328 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:07:39.328 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:07:39.328 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:07:39.328 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:07:39.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:07:39 smithi047 bash[22744]: audit 2024-09-16T07:07:37.838766+0000 mgr.a (mgr.14373) 3919 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T07:07:39.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:07:39 smithi047 bash[22744]: cephadm 2024-09-16T07:07:37.841343+0000 mgr.a (mgr.14373) 3920 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T07:07:39.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:07:39 smithi157 bash[24585]: audit 2024-09-16T07:07:37.838766+0000 mgr.a (mgr.14373) 3919 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T07:07:39.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:07:39 smithi157 bash[24585]: cephadm 2024-09-16T07:07:37.841343+0000 mgr.a (mgr.14373) 3920 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T07:07:40.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:07:40 smithi086 bash[24289]: audit 2024-09-16T07:07:38.915673+0000 mgr.a (mgr.14373) 3921 : audit [DBG] from='client.95322 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:07:40.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:07:40 smithi086 bash[24289]: cluster 2024-09-16T07:07:39.471217+0000 mgr.a (mgr.14373) 3922 : cluster [DBG] pgmap v2718: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:07:40.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:07:40 smithi047 bash[22744]: audit 2024-09-16T07:07:38.915673+0000 mgr.a (mgr.14373) 3921 : audit [DBG] from='client.95322 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:07:40.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:07:40 smithi047 bash[22744]: cluster 2024-09-16T07:07:39.471217+0000 mgr.a (mgr.14373) 3922 : cluster [DBG] pgmap v2718: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:07:40.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:07:40 smithi157 bash[24585]: audit 2024-09-16T07:07:38.915673+0000 mgr.a (mgr.14373) 3921 : audit [DBG] from='client.95322 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:07:40.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:07:40 smithi157 bash[24585]: cluster 2024-09-16T07:07:39.471217+0000 mgr.a (mgr.14373) 3922 : cluster [DBG] pgmap v2718: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:07:42.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:07:42 smithi157 bash[24585]: cluster 2024-09-16T07:07:41.473354+0000 mgr.a (mgr.14373) 3923 : cluster [DBG] pgmap v2719: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:07:42.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:07:42 smithi086 bash[24289]: cluster 2024-09-16T07:07:41.473354+0000 mgr.a (mgr.14373) 3923 : cluster [DBG] pgmap v2719: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:07:42.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:07:42 smithi047 bash[22744]: cluster 2024-09-16T07:07:41.473354+0000 mgr.a (mgr.14373) 3923 : cluster [DBG] pgmap v2719: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:07:44.329 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:07:44.330 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:07:44.331 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:07:44.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:07:44 smithi157 bash[24585]: cluster 2024-09-16T07:07:43.474116+0000 mgr.a (mgr.14373) 3924 : cluster [DBG] pgmap v2720: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:07:44.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:07:44 smithi086 bash[24289]: cluster 2024-09-16T07:07:43.474116+0000 mgr.a (mgr.14373) 3924 : cluster [DBG] pgmap v2720: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:07:44.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:07:44 smithi047 bash[22744]: cluster 2024-09-16T07:07:43.474116+0000 mgr.a (mgr.14373) 3924 : cluster [DBG] pgmap v2720: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:07:45.085 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:07:45.085 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:07:45.085 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:07:45.086 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:07:45.086 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:07:45.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:07:45 smithi157 bash[24585]: audit 2024-09-16T07:07:44.668068+0000 mgr.a (mgr.14373) 3925 : audit [DBG] from='client.95400 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:07:45.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:07:45 smithi157 bash[24585]: cluster 2024-09-16T07:07:45.475213+0000 mgr.a (mgr.14373) 3926 : cluster [DBG] pgmap v2721: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:07:45.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:07:45 smithi086 bash[24289]: audit 2024-09-16T07:07:44.668068+0000 mgr.a (mgr.14373) 3925 : audit [DBG] from='client.95400 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:07:45.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:07:45 smithi086 bash[24289]: cluster 2024-09-16T07:07:45.475213+0000 mgr.a (mgr.14373) 3926 : cluster [DBG] pgmap v2721: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:07:45.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:07:45 smithi047 bash[22744]: audit 2024-09-16T07:07:44.668068+0000 mgr.a (mgr.14373) 3925 : audit [DBG] from='client.95400 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:07:45.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:07:45 smithi047 bash[22744]: cluster 2024-09-16T07:07:45.475213+0000 mgr.a (mgr.14373) 3926 : cluster [DBG] pgmap v2721: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:07:48.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:07:48 smithi157 bash[24585]: cluster 2024-09-16T07:07:47.477536+0000 mgr.a (mgr.14373) 3927 : cluster [DBG] pgmap v2722: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:07:48.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:07:48 smithi086 bash[24289]: cluster 2024-09-16T07:07:47.477536+0000 mgr.a (mgr.14373) 3927 : cluster [DBG] pgmap v2722: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:07:48.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:07:48 smithi047 bash[22744]: cluster 2024-09-16T07:07:47.477536+0000 mgr.a (mgr.14373) 3927 : cluster [DBG] pgmap v2722: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:07:49.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:07:49 smithi047 bash[22744]: cluster 2024-09-16T07:07:49.478498+0000 mgr.a (mgr.14373) 3928 : cluster [DBG] pgmap v2723: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:07:50.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:07:49 smithi157 bash[24585]: cluster 2024-09-16T07:07:49.478498+0000 mgr.a (mgr.14373) 3928 : cluster [DBG] pgmap v2723: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:07:50.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:07:49 smithi086 bash[24289]: cluster 2024-09-16T07:07:49.478498+0000 mgr.a (mgr.14373) 3928 : cluster [DBG] pgmap v2723: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:07:50.087 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:07:50.087 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:07:50.088 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:07:50.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:07:50 smithi047 bash[22744]: audit 2024-09-16T07:07:50.430003+0000 mgr.a (mgr.14373) 3929 : audit [DBG] from='client.95478 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:07:50.855 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:07:50.855 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:07:50.855 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:07:50.855 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:07:50.855 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:07:51.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:07:50 smithi157 bash[24585]: audit 2024-09-16T07:07:50.430003+0000 mgr.a (mgr.14373) 3929 : audit [DBG] from='client.95478 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:07:51.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:07:50 smithi086 bash[24289]: audit 2024-09-16T07:07:50.430003+0000 mgr.a (mgr.14373) 3929 : audit [DBG] from='client.95478 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:07:52.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:07:51 smithi157 bash[24585]: cluster 2024-09-16T07:07:51.480846+0000 mgr.a (mgr.14373) 3930 : cluster [DBG] pgmap v2724: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:07:52.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:07:51 smithi086 bash[24289]: cluster 2024-09-16T07:07:51.480846+0000 mgr.a (mgr.14373) 3930 : cluster [DBG] pgmap v2724: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:07:52.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:07:51 smithi047 bash[22744]: cluster 2024-09-16T07:07:51.480846+0000 mgr.a (mgr.14373) 3930 : cluster [DBG] pgmap v2724: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:07:54.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:07:54 smithi157 bash[24585]: cluster 2024-09-16T07:07:53.481640+0000 mgr.a (mgr.14373) 3931 : cluster [DBG] pgmap v2725: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:07:54.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:07:54 smithi086 bash[24289]: cluster 2024-09-16T07:07:53.481640+0000 mgr.a (mgr.14373) 3931 : cluster [DBG] pgmap v2725: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:07:54.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:07:54 smithi047 bash[22744]: cluster 2024-09-16T07:07:53.481640+0000 mgr.a (mgr.14373) 3931 : cluster [DBG] pgmap v2725: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:07:55.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:07:55 smithi157 bash[24585]: cluster 2024-09-16T07:07:55.482446+0000 mgr.a (mgr.14373) 3932 : cluster [DBG] pgmap v2726: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:07:55.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:07:55 smithi086 bash[24289]: cluster 2024-09-16T07:07:55.482446+0000 mgr.a (mgr.14373) 3932 : cluster [DBG] pgmap v2726: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:07:55.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:07:55 smithi047 bash[22744]: cluster 2024-09-16T07:07:55.482446+0000 mgr.a (mgr.14373) 3932 : cluster [DBG] pgmap v2726: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:07:55.856 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:07:55.857 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:07:55.857 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:07:56.642 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:07:56.642 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:07:56.642 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:07:56.642 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:07:56.643 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:07:56.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:07:56 smithi157 bash[24585]: audit 2024-09-16T07:07:56.195278+0000 mgr.a (mgr.14373) 3933 : audit [DBG] from='client.95550 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:07:56.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:07:56 smithi086 bash[24289]: audit 2024-09-16T07:07:56.195278+0000 mgr.a (mgr.14373) 3933 : audit [DBG] from='client.95550 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:07:56.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:07:56 smithi047 bash[22744]: audit 2024-09-16T07:07:56.195278+0000 mgr.a (mgr.14373) 3933 : audit [DBG] from='client.95550 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:07:57.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:07:57 smithi086 bash[24289]: cluster 2024-09-16T07:07:57.485211+0000 mgr.a (mgr.14373) 3934 : cluster [DBG] pgmap v2727: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:07:57.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:07:57 smithi047 bash[22744]: cluster 2024-09-16T07:07:57.485211+0000 mgr.a (mgr.14373) 3934 : cluster [DBG] pgmap v2727: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:07:58.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:07:57 smithi157 bash[24585]: cluster 2024-09-16T07:07:57.485211+0000 mgr.a (mgr.14373) 3934 : cluster [DBG] pgmap v2727: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:08:00.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:08:00 smithi157 bash[24585]: cluster 2024-09-16T07:07:59.485990+0000 mgr.a (mgr.14373) 3935 : cluster [DBG] pgmap v2728: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:08:00.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:08:00 smithi086 bash[24289]: cluster 2024-09-16T07:07:59.485990+0000 mgr.a (mgr.14373) 3935 : cluster [DBG] pgmap v2728: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:08:00.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:08:00 smithi047 bash[22744]: cluster 2024-09-16T07:07:59.485990+0000 mgr.a (mgr.14373) 3935 : cluster [DBG] pgmap v2728: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:08:01.644 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:08:01.644 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:08:01.644 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:08:01.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:08:01 smithi157 bash[24585]: cluster 2024-09-16T07:08:01.487948+0000 mgr.a (mgr.14373) 3936 : cluster [DBG] pgmap v2729: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:08:01.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:08:01 smithi086 bash[24289]: cluster 2024-09-16T07:08:01.487948+0000 mgr.a (mgr.14373) 3936 : cluster [DBG] pgmap v2729: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:08:01.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:08:01 smithi047 bash[22744]: cluster 2024-09-16T07:08:01.487948+0000 mgr.a (mgr.14373) 3936 : cluster [DBG] pgmap v2729: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:08:02.390 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:08:02.390 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:08:02.390 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:08:02.390 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:08:02.390 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:08:02.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:08:02 smithi157 bash[24585]: audit 2024-09-16T07:08:01.976539+0000 mgr.a (mgr.14373) 3937 : audit [DBG] from='client.95628 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:08:02.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:08:02 smithi086 bash[24289]: audit 2024-09-16T07:08:01.976539+0000 mgr.a (mgr.14373) 3937 : audit [DBG] from='client.95628 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:08:02.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:08:02 smithi047 bash[22744]: audit 2024-09-16T07:08:01.976539+0000 mgr.a (mgr.14373) 3937 : audit [DBG] from='client.95628 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:08:03.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:08:03 smithi086 bash[24289]: cluster 2024-09-16T07:08:03.488974+0000 mgr.a (mgr.14373) 3938 : cluster [DBG] pgmap v2730: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:08:03.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:08:03 smithi047 bash[22744]: cluster 2024-09-16T07:08:03.488974+0000 mgr.a (mgr.14373) 3938 : cluster [DBG] pgmap v2730: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:08:04.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:08:03 smithi157 bash[24585]: cluster 2024-09-16T07:08:03.488974+0000 mgr.a (mgr.14373) 3938 : cluster [DBG] pgmap v2730: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:08:06.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:08:05 smithi157 bash[24585]: cluster 2024-09-16T07:08:05.489908+0000 mgr.a (mgr.14373) 3939 : cluster [DBG] pgmap v2731: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T07:08:06.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:08:05 smithi047 bash[22744]: cluster 2024-09-16T07:08:05.489908+0000 mgr.a (mgr.14373) 3939 : cluster [DBG] pgmap v2731: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T07:08:06.089 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:08:05 smithi086 bash[24289]: cluster 2024-09-16T07:08:05.489908+0000 mgr.a (mgr.14373) 3939 : cluster [DBG] pgmap v2731: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T07:08:07.392 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:08:07.392 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:08:07.392 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:08:08.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:08:07 smithi157 bash[24585]: cluster 2024-09-16T07:08:07.491072+0000 mgr.a (mgr.14373) 3940 : cluster [DBG] pgmap v2732: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-16T07:08:08.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:08:07 smithi086 bash[24289]: cluster 2024-09-16T07:08:07.491072+0000 mgr.a (mgr.14373) 3940 : cluster [DBG] pgmap v2732: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-16T07:08:08.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:08:07 smithi047 bash[22744]: cluster 2024-09-16T07:08:07.491072+0000 mgr.a (mgr.14373) 3940 : cluster [DBG] pgmap v2732: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-16T07:08:08.132 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:08:08.132 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:08:08.132 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:08:08.133 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:08:08.133 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:08:09.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:08:08 smithi157 bash[24585]: audit 2024-09-16T07:08:07.722223+0000 mgr.a (mgr.14373) 3941 : audit [DBG] from='client.95706 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:08:09.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:08:08 smithi086 bash[24289]: audit 2024-09-16T07:08:07.722223+0000 mgr.a (mgr.14373) 3941 : audit [DBG] from='client.95706 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:08:09.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:08:08 smithi047 bash[22744]: audit 2024-09-16T07:08:07.722223+0000 mgr.a (mgr.14373) 3941 : audit [DBG] from='client.95706 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:08:10.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:08:09 smithi157 bash[24585]: cluster 2024-09-16T07:08:09.492030+0000 mgr.a (mgr.14373) 3942 : cluster [DBG] pgmap v2733: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-16T07:08:10.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:08:09 smithi086 bash[24289]: cluster 2024-09-16T07:08:09.492030+0000 mgr.a (mgr.14373) 3942 : cluster [DBG] pgmap v2733: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-16T07:08:10.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:08:09 smithi047 bash[22744]: cluster 2024-09-16T07:08:09.492030+0000 mgr.a (mgr.14373) 3942 : cluster [DBG] pgmap v2733: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-16T07:08:12.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:08:11 smithi157 bash[24585]: cluster 2024-09-16T07:08:11.494162+0000 mgr.a (mgr.14373) 3943 : cluster [DBG] pgmap v2734: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 70 KiB/s rd, 0 B/s wr, 115 op/s 2024-09-16T07:08:12.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:08:11 smithi086 bash[24289]: cluster 2024-09-16T07:08:11.494162+0000 mgr.a (mgr.14373) 3943 : cluster [DBG] pgmap v2734: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 70 KiB/s rd, 0 B/s wr, 115 op/s 2024-09-16T07:08:12.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:08:11 smithi047 bash[22744]: cluster 2024-09-16T07:08:11.494162+0000 mgr.a (mgr.14373) 3943 : cluster [DBG] pgmap v2734: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 70 KiB/s rd, 0 B/s wr, 115 op/s 2024-09-16T07:08:13.134 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:08:13.134 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:08:13.135 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:08:13.908 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:08:13.908 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:08:13.908 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:08:13.908 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:08:13.908 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:08:14.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:08:13 smithi157 bash[24585]: audit 2024-09-16T07:08:13.472142+0000 mgr.a (mgr.14373) 3944 : audit [DBG] from='client.95784 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:08:14.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:08:13 smithi157 bash[24585]: cluster 2024-09-16T07:08:13.495177+0000 mgr.a (mgr.14373) 3945 : cluster [DBG] pgmap v2735: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 70 KiB/s rd, 0 B/s wr, 114 op/s 2024-09-16T07:08:14.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:08:13 smithi086 bash[24289]: audit 2024-09-16T07:08:13.472142+0000 mgr.a (mgr.14373) 3944 : audit [DBG] from='client.95784 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:08:14.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:08:13 smithi086 bash[24289]: cluster 2024-09-16T07:08:13.495177+0000 mgr.a (mgr.14373) 3945 : cluster [DBG] pgmap v2735: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 70 KiB/s rd, 0 B/s wr, 114 op/s 2024-09-16T07:08:14.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:08:13 smithi047 bash[22744]: audit 2024-09-16T07:08:13.472142+0000 mgr.a (mgr.14373) 3944 : audit [DBG] from='client.95784 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:08:14.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:08:13 smithi047 bash[22744]: cluster 2024-09-16T07:08:13.495177+0000 mgr.a (mgr.14373) 3945 : cluster [DBG] pgmap v2735: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 70 KiB/s rd, 0 B/s wr, 114 op/s 2024-09-16T07:08:16.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:08:15 smithi157 bash[24585]: cluster 2024-09-16T07:08:15.496087+0000 mgr.a (mgr.14373) 3946 : cluster [DBG] pgmap v2736: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 70 KiB/s rd, 0 B/s wr, 114 op/s 2024-09-16T07:08:16.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:08:15 smithi086 bash[24289]: cluster 2024-09-16T07:08:15.496087+0000 mgr.a (mgr.14373) 3946 : cluster [DBG] pgmap v2736: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 70 KiB/s rd, 0 B/s wr, 114 op/s 2024-09-16T07:08:16.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:08:15 smithi047 bash[22744]: cluster 2024-09-16T07:08:15.496087+0000 mgr.a (mgr.14373) 3946 : cluster [DBG] pgmap v2736: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 70 KiB/s rd, 0 B/s wr, 114 op/s 2024-09-16T07:08:18.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:08:17 smithi157 bash[24585]: cluster 2024-09-16T07:08:17.498268+0000 mgr.a (mgr.14373) 3947 : cluster [DBG] pgmap v2737: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 70 KiB/s rd, 0 B/s wr, 115 op/s 2024-09-16T07:08:18.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:08:17 smithi086 bash[24289]: cluster 2024-09-16T07:08:17.498268+0000 mgr.a (mgr.14373) 3947 : cluster [DBG] pgmap v2737: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 70 KiB/s rd, 0 B/s wr, 115 op/s 2024-09-16T07:08:18.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:08:17 smithi047 bash[22744]: cluster 2024-09-16T07:08:17.498268+0000 mgr.a (mgr.14373) 3947 : cluster [DBG] pgmap v2737: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 70 KiB/s rd, 0 B/s wr, 115 op/s 2024-09-16T07:08:18.909 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:08:18.910 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:08:18.910 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:08:19.657 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:08:19.657 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:08:19.657 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:08:19.658 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:08:19.658 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:08:20.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:08:19 smithi157 bash[24585]: audit 2024-09-16T07:08:19.238070+0000 mgr.a (mgr.14373) 3948 : audit [DBG] from='client.95862 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:08:20.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:08:19 smithi157 bash[24585]: cluster 2024-09-16T07:08:19.498893+0000 mgr.a (mgr.14373) 3949 : cluster [DBG] pgmap v2738: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 65 KiB/s rd, 0 B/s wr, 107 op/s 2024-09-16T07:08:20.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:08:19 smithi086 bash[24289]: audit 2024-09-16T07:08:19.238070+0000 mgr.a (mgr.14373) 3948 : audit [DBG] from='client.95862 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:08:20.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:08:19 smithi086 bash[24289]: cluster 2024-09-16T07:08:19.498893+0000 mgr.a (mgr.14373) 3949 : cluster [DBG] pgmap v2738: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 65 KiB/s rd, 0 B/s wr, 107 op/s 2024-09-16T07:08:20.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:08:19 smithi047 bash[22744]: audit 2024-09-16T07:08:19.238070+0000 mgr.a (mgr.14373) 3948 : audit [DBG] from='client.95862 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:08:20.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:08:19 smithi047 bash[22744]: cluster 2024-09-16T07:08:19.498893+0000 mgr.a (mgr.14373) 3949 : cluster [DBG] pgmap v2738: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 65 KiB/s rd, 0 B/s wr, 107 op/s 2024-09-16T07:08:22.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:08:21 smithi157 bash[24585]: cluster 2024-09-16T07:08:21.501075+0000 mgr.a (mgr.14373) 3950 : cluster [DBG] pgmap v2739: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 66 KiB/s rd, 0 B/s wr, 108 op/s 2024-09-16T07:08:22.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:08:21 smithi086 bash[24289]: cluster 2024-09-16T07:08:21.501075+0000 mgr.a (mgr.14373) 3950 : cluster [DBG] pgmap v2739: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 66 KiB/s rd, 0 B/s wr, 108 op/s 2024-09-16T07:08:22.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:08:21 smithi047 bash[22744]: cluster 2024-09-16T07:08:21.501075+0000 mgr.a (mgr.14373) 3950 : cluster [DBG] pgmap v2739: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 66 KiB/s rd, 0 B/s wr, 108 op/s 2024-09-16T07:08:24.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:08:23 smithi157 bash[24585]: cluster 2024-09-16T07:08:23.501849+0000 mgr.a (mgr.14373) 3951 : cluster [DBG] pgmap v2740: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:08:24.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:08:23 smithi086 bash[24289]: cluster 2024-09-16T07:08:23.501849+0000 mgr.a (mgr.14373) 3951 : cluster [DBG] pgmap v2740: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:08:24.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:08:23 smithi047 bash[22744]: cluster 2024-09-16T07:08:23.501849+0000 mgr.a (mgr.14373) 3951 : cluster [DBG] pgmap v2740: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:08:24.659 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:08:24.659 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:08:24.659 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:08:25.440 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:08:25.441 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:08:25.441 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:08:25.441 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:08:25.442 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:08:26.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:08:25 smithi157 bash[24585]: audit 2024-09-16T07:08:24.999079+0000 mgr.a (mgr.14373) 3952 : audit [DBG] from='client.95937 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:08:26.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:08:25 smithi157 bash[24585]: cluster 2024-09-16T07:08:25.502453+0000 mgr.a (mgr.14373) 3953 : cluster [DBG] pgmap v2741: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:08:26.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:08:25 smithi086 bash[24289]: audit 2024-09-16T07:08:24.999079+0000 mgr.a (mgr.14373) 3952 : audit [DBG] from='client.95937 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:08:26.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:08:25 smithi086 bash[24289]: cluster 2024-09-16T07:08:25.502453+0000 mgr.a (mgr.14373) 3953 : cluster [DBG] pgmap v2741: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:08:26.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:08:25 smithi047 bash[22744]: audit 2024-09-16T07:08:24.999079+0000 mgr.a (mgr.14373) 3952 : audit [DBG] from='client.95937 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:08:26.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:08:25 smithi047 bash[22744]: cluster 2024-09-16T07:08:25.502453+0000 mgr.a (mgr.14373) 3953 : cluster [DBG] pgmap v2741: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:08:28.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:08:27 smithi157 bash[24585]: cluster 2024-09-16T07:08:27.504592+0000 mgr.a (mgr.14373) 3954 : cluster [DBG] pgmap v2742: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:08:28.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:08:27 smithi086 bash[24289]: cluster 2024-09-16T07:08:27.504592+0000 mgr.a (mgr.14373) 3954 : cluster [DBG] pgmap v2742: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:08:28.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:08:27 smithi047 bash[22744]: cluster 2024-09-16T07:08:27.504592+0000 mgr.a (mgr.14373) 3954 : cluster [DBG] pgmap v2742: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:08:30.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:08:29 smithi157 bash[24585]: cluster 2024-09-16T07:08:29.505347+0000 mgr.a (mgr.14373) 3955 : cluster [DBG] pgmap v2743: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:08:30.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:08:29 smithi086 bash[24289]: cluster 2024-09-16T07:08:29.505347+0000 mgr.a (mgr.14373) 3955 : cluster [DBG] pgmap v2743: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:08:30.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:08:29 smithi047 bash[22744]: cluster 2024-09-16T07:08:29.505347+0000 mgr.a (mgr.14373) 3955 : cluster [DBG] pgmap v2743: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:08:30.442 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:08:30.443 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:08:30.443 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:08:31.204 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:08:31.205 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:08:31.205 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:08:31.205 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:08:31.205 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:08:32.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:08:31 smithi157 bash[24585]: audit 2024-09-16T07:08:30.774158+0000 mgr.a (mgr.14373) 3956 : audit [DBG] from='client.96015 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:08:32.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:08:31 smithi157 bash[24585]: cluster 2024-09-16T07:08:31.507677+0000 mgr.a (mgr.14373) 3957 : cluster [DBG] pgmap v2744: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:08:32.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:08:31 smithi086 bash[24289]: audit 2024-09-16T07:08:30.774158+0000 mgr.a (mgr.14373) 3956 : audit [DBG] from='client.96015 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:08:32.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:08:31 smithi086 bash[24289]: cluster 2024-09-16T07:08:31.507677+0000 mgr.a (mgr.14373) 3957 : cluster [DBG] pgmap v2744: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:08:32.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:08:31 smithi047 bash[22744]: audit 2024-09-16T07:08:30.774158+0000 mgr.a (mgr.14373) 3956 : audit [DBG] from='client.96015 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:08:32.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:08:31 smithi047 bash[22744]: cluster 2024-09-16T07:08:31.507677+0000 mgr.a (mgr.14373) 3957 : cluster [DBG] pgmap v2744: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:08:34.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:08:33 smithi157 bash[24585]: cluster 2024-09-16T07:08:33.508446+0000 mgr.a (mgr.14373) 3958 : cluster [DBG] pgmap v2745: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:08:34.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:08:33 smithi086 bash[24289]: cluster 2024-09-16T07:08:33.508446+0000 mgr.a (mgr.14373) 3958 : cluster [DBG] pgmap v2745: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:08:34.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:08:33 smithi047 bash[22744]: cluster 2024-09-16T07:08:33.508446+0000 mgr.a (mgr.14373) 3958 : cluster [DBG] pgmap v2745: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:08:36.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:08:35 smithi157 bash[24585]: cluster 2024-09-16T07:08:35.509207+0000 mgr.a (mgr.14373) 3959 : cluster [DBG] pgmap v2746: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:08:36.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:08:35 smithi086 bash[24289]: cluster 2024-09-16T07:08:35.509207+0000 mgr.a (mgr.14373) 3959 : cluster [DBG] pgmap v2746: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:08:36.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:08:35 smithi047 bash[22744]: cluster 2024-09-16T07:08:35.509207+0000 mgr.a (mgr.14373) 3959 : cluster [DBG] pgmap v2746: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:08:36.206 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:08:36.207 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:08:36.207 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:08:36.961 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:08:36.961 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:08:36.961 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:08:36.961 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:08:36.961 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:08:37.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:08:36 smithi157 bash[24585]: audit 2024-09-16T07:08:36.540969+0000 mgr.a (mgr.14373) 3960 : audit [DBG] from='client.96090 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:08:37.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:08:36 smithi086 bash[24289]: audit 2024-09-16T07:08:36.540969+0000 mgr.a (mgr.14373) 3960 : audit [DBG] from='client.96090 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:08:37.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:08:36 smithi047 bash[22744]: audit 2024-09-16T07:08:36.540969+0000 mgr.a (mgr.14373) 3960 : audit [DBG] from='client.96090 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:08:38.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:08:37 smithi157 bash[24585]: cluster 2024-09-16T07:08:37.511925+0000 mgr.a (mgr.14373) 3961 : cluster [DBG] pgmap v2747: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:08:38.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:08:37 smithi086 bash[24289]: cluster 2024-09-16T07:08:37.511925+0000 mgr.a (mgr.14373) 3961 : cluster [DBG] pgmap v2747: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:08:38.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:08:37 smithi047 bash[22744]: cluster 2024-09-16T07:08:37.511925+0000 mgr.a (mgr.14373) 3961 : cluster [DBG] pgmap v2747: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:08:39.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:08:38 smithi157 bash[24585]: audit 2024-09-16T07:08:37.915199+0000 mon.b (mon.2) 398 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T07:08:39.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:08:38 smithi086 bash[24289]: audit 2024-09-16T07:08:37.915199+0000 mon.b (mon.2) 398 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T07:08:39.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:08:38 smithi047 bash[22744]: audit 2024-09-16T07:08:37.915199+0000 mon.b (mon.2) 398 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T07:08:40.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:08:39 smithi157 bash[24585]: cluster 2024-09-16T07:08:39.512721+0000 mgr.a (mgr.14373) 3962 : cluster [DBG] pgmap v2748: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:08:40.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:08:39 smithi086 bash[24289]: cluster 2024-09-16T07:08:39.512721+0000 mgr.a (mgr.14373) 3962 : cluster [DBG] pgmap v2748: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:08:40.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:08:39 smithi047 bash[22744]: cluster 2024-09-16T07:08:39.512721+0000 mgr.a (mgr.14373) 3962 : cluster [DBG] pgmap v2748: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:08:41.962 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:08:41.963 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:08:41.963 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:08:42.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:08:41 smithi157 bash[24585]: cluster 2024-09-16T07:08:41.514767+0000 mgr.a (mgr.14373) 3963 : cluster [DBG] pgmap v2749: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:08:42.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:08:41 smithi086 bash[24289]: cluster 2024-09-16T07:08:41.514767+0000 mgr.a (mgr.14373) 3963 : cluster [DBG] pgmap v2749: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:08:42.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:08:41 smithi047 bash[22744]: cluster 2024-09-16T07:08:41.514767+0000 mgr.a (mgr.14373) 3963 : cluster [DBG] pgmap v2749: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:08:42.739 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:08:42.739 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:08:42.739 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:08:42.739 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:08:42.739 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:08:43.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:08:42 smithi157 bash[24585]: audit 2024-09-16T07:08:42.302563+0000 mgr.a (mgr.14373) 3964 : audit [DBG] from='client.96168 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:08:43.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:08:42 smithi086 bash[24289]: audit 2024-09-16T07:08:42.302563+0000 mgr.a (mgr.14373) 3964 : audit [DBG] from='client.96168 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:08:43.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:08:42 smithi047 bash[22744]: audit 2024-09-16T07:08:42.302563+0000 mgr.a (mgr.14373) 3964 : audit [DBG] from='client.96168 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:08:43.900 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:08:43 smithi157 bash[24585]: cluster 2024-09-16T07:08:43.515630+0000 mgr.a (mgr.14373) 3965 : cluster [DBG] pgmap v2750: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:08:44.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:08:43 smithi086 bash[24289]: cluster 2024-09-16T07:08:43.515630+0000 mgr.a (mgr.14373) 3965 : cluster [DBG] pgmap v2750: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:08:44.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:08:43 smithi047 bash[22744]: cluster 2024-09-16T07:08:43.515630+0000 mgr.a (mgr.14373) 3965 : cluster [DBG] pgmap v2750: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:08:46.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:08:45 smithi157 bash[24585]: cluster 2024-09-16T07:08:45.516418+0000 mgr.a (mgr.14373) 3966 : cluster [DBG] pgmap v2751: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T07:08:46.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:08:45 smithi086 bash[24289]: cluster 2024-09-16T07:08:45.516418+0000 mgr.a (mgr.14373) 3966 : cluster [DBG] pgmap v2751: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T07:08:46.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:08:45 smithi047 bash[22744]: cluster 2024-09-16T07:08:45.516418+0000 mgr.a (mgr.14373) 3966 : cluster [DBG] pgmap v2751: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T07:08:47.740 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:08:47.741 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:08:47.741 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:08:47.867 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:08:47 smithi157 bash[24585]: cluster 2024-09-16T07:08:47.518557+0000 mgr.a (mgr.14373) 3967 : cluster [DBG] pgmap v2752: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:08:48.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:08:47 smithi086 bash[24289]: cluster 2024-09-16T07:08:47.518557+0000 mgr.a (mgr.14373) 3967 : cluster [DBG] pgmap v2752: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:08:48.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:08:47 smithi047 bash[22744]: cluster 2024-09-16T07:08:47.518557+0000 mgr.a (mgr.14373) 3967 : cluster [DBG] pgmap v2752: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:08:48.524 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:08:48.524 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:08:48.524 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:08:48.525 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:08:48.525 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:08:49.589 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 07:08:49 smithi047 bash[22994]: debug 2024-09-16T07:08:49.209+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T07:08:49.589 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 07:08:49 smithi047 bash[22994]: debug 2024-09-16T07:08:49.213+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T07:08:49.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:08:49 smithi047 bash[22744]: audit 2024-09-16T07:08:48.078065+0000 mgr.a (mgr.14373) 3968 : audit [DBG] from='client.96246 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:08:49.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:08:49 smithi047 bash[22744]: audit 2024-09-16T07:08:48.350485+0000 mon.a (mon.0) 804 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:08:49.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:08:49 smithi047 bash[22744]: audit 2024-09-16T07:08:48.359448+0000 mon.a (mon.0) 805 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:08:49.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:08:49 smithi047 bash[22744]: audit 2024-09-16T07:08:48.361688+0000 mon.b (mon.2) 399 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T07:08:49.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:08:49 smithi047 bash[22744]: audit 2024-09-16T07:08:48.363099+0000 mon.b (mon.2) 400 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T07:08:49.590 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:08:49 smithi047 bash[22744]: audit 2024-09-16T07:08:48.371549+0000 mon.a (mon.0) 806 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:08:49.590 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:08:49 smithi047 bash[22744]: audit 2024-09-16T07:08:48.374422+0000 mon.b (mon.2) 401 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:08:49.590 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:08:49 smithi047 bash[22744]: audit 2024-09-16T07:08:48.377644+0000 mgr.a (mgr.14373) 3969 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:08:49.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:08:49 smithi157 bash[24585]: audit 2024-09-16T07:08:48.078065+0000 mgr.a (mgr.14373) 3968 : audit [DBG] from='client.96246 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:08:49.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:08:49 smithi157 bash[24585]: audit 2024-09-16T07:08:48.350485+0000 mon.a (mon.0) 804 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:08:49.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:08:49 smithi157 bash[24585]: audit 2024-09-16T07:08:48.359448+0000 mon.a (mon.0) 805 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:08:49.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:08:49 smithi157 bash[24585]: audit 2024-09-16T07:08:48.361688+0000 mon.b (mon.2) 399 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T07:08:49.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:08:49 smithi157 bash[24585]: audit 2024-09-16T07:08:48.363099+0000 mon.b (mon.2) 400 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T07:08:49.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:08:49 smithi157 bash[24585]: audit 2024-09-16T07:08:48.371549+0000 mon.a (mon.0) 806 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:08:49.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:08:49 smithi157 bash[24585]: audit 2024-09-16T07:08:48.374422+0000 mon.b (mon.2) 401 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:08:49.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:08:49 smithi157 bash[24585]: audit 2024-09-16T07:08:48.377644+0000 mgr.a (mgr.14373) 3969 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:08:49.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:08:49 smithi086 bash[24289]: audit 2024-09-16T07:08:48.078065+0000 mgr.a (mgr.14373) 3968 : audit [DBG] from='client.96246 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:08:49.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:08:49 smithi086 bash[24289]: audit 2024-09-16T07:08:48.350485+0000 mon.a (mon.0) 804 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:08:49.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:08:49 smithi086 bash[24289]: audit 2024-09-16T07:08:48.359448+0000 mon.a (mon.0) 805 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:08:49.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:08:49 smithi086 bash[24289]: audit 2024-09-16T07:08:48.361688+0000 mon.b (mon.2) 399 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T07:08:49.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:08:49 smithi086 bash[24289]: audit 2024-09-16T07:08:48.363099+0000 mon.b (mon.2) 400 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T07:08:49.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:08:49 smithi086 bash[24289]: audit 2024-09-16T07:08:48.371549+0000 mon.a (mon.0) 806 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:08:49.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:08:49 smithi086 bash[24289]: audit 2024-09-16T07:08:48.374422+0000 mon.b (mon.2) 401 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:08:49.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:08:49 smithi086 bash[24289]: audit 2024-09-16T07:08:48.377644+0000 mgr.a (mgr.14373) 3969 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:08:50.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:08:50 smithi157 bash[24585]: audit 2024-09-16T07:08:49.213218+0000 mgr.a (mgr.14373) 3970 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T07:08:50.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:08:50 smithi157 bash[24585]: cephadm 2024-09-16T07:08:49.215447+0000 mgr.a (mgr.14373) 3971 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T07:08:50.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:08:50 smithi157 bash[24585]: cluster 2024-09-16T07:08:49.519531+0000 mgr.a (mgr.14373) 3972 : cluster [DBG] pgmap v2753: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:08:50.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:08:50 smithi086 bash[24289]: audit 2024-09-16T07:08:49.213218+0000 mgr.a (mgr.14373) 3970 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T07:08:50.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:08:50 smithi086 bash[24289]: cephadm 2024-09-16T07:08:49.215447+0000 mgr.a (mgr.14373) 3971 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T07:08:50.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:08:50 smithi086 bash[24289]: cluster 2024-09-16T07:08:49.519531+0000 mgr.a (mgr.14373) 3972 : cluster [DBG] pgmap v2753: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:08:50.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:08:50 smithi047 bash[22744]: audit 2024-09-16T07:08:49.213218+0000 mgr.a (mgr.14373) 3970 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T07:08:50.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:08:50 smithi047 bash[22744]: cephadm 2024-09-16T07:08:49.215447+0000 mgr.a (mgr.14373) 3971 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T07:08:50.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:08:50 smithi047 bash[22744]: cluster 2024-09-16T07:08:49.519531+0000 mgr.a (mgr.14373) 3972 : cluster [DBG] pgmap v2753: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:08:52.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:08:51 smithi157 bash[24585]: cluster 2024-09-16T07:08:51.521670+0000 mgr.a (mgr.14373) 3973 : cluster [DBG] pgmap v2754: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:08:52.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:08:51 smithi086 bash[24289]: cluster 2024-09-16T07:08:51.521670+0000 mgr.a (mgr.14373) 3973 : cluster [DBG] pgmap v2754: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:08:52.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:08:51 smithi047 bash[22744]: cluster 2024-09-16T07:08:51.521670+0000 mgr.a (mgr.14373) 3973 : cluster [DBG] pgmap v2754: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:08:53.526 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:08:53.527 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:08:53.527 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:08:54.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:08:53 smithi157 bash[24585]: cluster 2024-09-16T07:08:53.522462+0000 mgr.a (mgr.14373) 3974 : cluster [DBG] pgmap v2755: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:08:54.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:08:53 smithi086 bash[24289]: cluster 2024-09-16T07:08:53.522462+0000 mgr.a (mgr.14373) 3974 : cluster [DBG] pgmap v2755: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:08:54.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:08:53 smithi047 bash[22744]: cluster 2024-09-16T07:08:53.522462+0000 mgr.a (mgr.14373) 3974 : cluster [DBG] pgmap v2755: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:08:54.293 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:08:54.293 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:08:54.293 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:08:54.293 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:08:54.293 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:08:55.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:08:54 smithi157 bash[24585]: audit 2024-09-16T07:08:53.864511+0000 mgr.a (mgr.14373) 3975 : audit [DBG] from='client.96426 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:08:55.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:08:54 smithi086 bash[24289]: audit 2024-09-16T07:08:53.864511+0000 mgr.a (mgr.14373) 3975 : audit [DBG] from='client.96426 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:08:55.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:08:54 smithi047 bash[22744]: audit 2024-09-16T07:08:53.864511+0000 mgr.a (mgr.14373) 3975 : audit [DBG] from='client.96426 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:08:56.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:08:55 smithi157 bash[24585]: cluster 2024-09-16T07:08:55.523384+0000 mgr.a (mgr.14373) 3976 : cluster [DBG] pgmap v2756: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:08:56.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:08:55 smithi086 bash[24289]: cluster 2024-09-16T07:08:55.523384+0000 mgr.a (mgr.14373) 3976 : cluster [DBG] pgmap v2756: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:08:56.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:08:55 smithi047 bash[22744]: cluster 2024-09-16T07:08:55.523384+0000 mgr.a (mgr.14373) 3976 : cluster [DBG] pgmap v2756: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:08:58.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:08:57 smithi157 bash[24585]: cluster 2024-09-16T07:08:57.525553+0000 mgr.a (mgr.14373) 3977 : cluster [DBG] pgmap v2757: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:08:58.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:08:57 smithi086 bash[24289]: cluster 2024-09-16T07:08:57.525553+0000 mgr.a (mgr.14373) 3977 : cluster [DBG] pgmap v2757: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:08:58.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:08:57 smithi047 bash[22744]: cluster 2024-09-16T07:08:57.525553+0000 mgr.a (mgr.14373) 3977 : cluster [DBG] pgmap v2757: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:08:59.294 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:08:59.295 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:08:59.296 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:09:00.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:08:59 smithi157 bash[24585]: cluster 2024-09-16T07:08:59.526318+0000 mgr.a (mgr.14373) 3978 : cluster [DBG] pgmap v2758: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:09:00.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:08:59 smithi086 bash[24289]: cluster 2024-09-16T07:08:59.526318+0000 mgr.a (mgr.14373) 3978 : cluster [DBG] pgmap v2758: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:09:00.086 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:09:00.086 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:09:00.086 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:09:00.086 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:09:00.086 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:09:00.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:08:59 smithi047 bash[22744]: cluster 2024-09-16T07:08:59.526318+0000 mgr.a (mgr.14373) 3978 : cluster [DBG] pgmap v2758: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:09:01.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:09:00 smithi157 bash[24585]: audit 2024-09-16T07:08:59.631849+0000 mgr.a (mgr.14373) 3979 : audit [DBG] from='client.96504 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:09:01.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:09:00 smithi086 bash[24289]: audit 2024-09-16T07:08:59.631849+0000 mgr.a (mgr.14373) 3979 : audit [DBG] from='client.96504 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:09:01.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:09:00 smithi047 bash[22744]: audit 2024-09-16T07:08:59.631849+0000 mgr.a (mgr.14373) 3979 : audit [DBG] from='client.96504 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:09:02.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:09:01 smithi157 bash[24585]: cluster 2024-09-16T07:09:01.528627+0000 mgr.a (mgr.14373) 3980 : cluster [DBG] pgmap v2759: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:09:02.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:09:01 smithi086 bash[24289]: cluster 2024-09-16T07:09:01.528627+0000 mgr.a (mgr.14373) 3980 : cluster [DBG] pgmap v2759: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:09:02.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:09:01 smithi047 bash[22744]: cluster 2024-09-16T07:09:01.528627+0000 mgr.a (mgr.14373) 3980 : cluster [DBG] pgmap v2759: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:09:04.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:09:03 smithi157 bash[24585]: cluster 2024-09-16T07:09:03.529397+0000 mgr.a (mgr.14373) 3981 : cluster [DBG] pgmap v2760: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:09:04.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:09:03 smithi086 bash[24289]: cluster 2024-09-16T07:09:03.529397+0000 mgr.a (mgr.14373) 3981 : cluster [DBG] pgmap v2760: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:09:04.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:09:03 smithi047 bash[22744]: cluster 2024-09-16T07:09:03.529397+0000 mgr.a (mgr.14373) 3981 : cluster [DBG] pgmap v2760: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:09:05.087 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:09:05.088 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:09:05.088 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:09:05.825 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:09:05.826 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:09:05.826 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:09:05.826 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:09:05.826 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:09:06.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:09:05 smithi157 bash[24585]: audit 2024-09-16T07:09:05.422187+0000 mgr.a (mgr.14373) 3982 : audit [DBG] from='client.96579 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:09:06.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:09:05 smithi157 bash[24585]: cluster 2024-09-16T07:09:05.529901+0000 mgr.a (mgr.14373) 3983 : cluster [DBG] pgmap v2761: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:09:06.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:09:05 smithi086 bash[24289]: audit 2024-09-16T07:09:05.422187+0000 mgr.a (mgr.14373) 3982 : audit [DBG] from='client.96579 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:09:06.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:09:05 smithi086 bash[24289]: cluster 2024-09-16T07:09:05.529901+0000 mgr.a (mgr.14373) 3983 : cluster [DBG] pgmap v2761: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:09:06.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:09:05 smithi047 bash[22744]: audit 2024-09-16T07:09:05.422187+0000 mgr.a (mgr.14373) 3982 : audit [DBG] from='client.96579 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:09:06.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:09:05 smithi047 bash[22744]: cluster 2024-09-16T07:09:05.529901+0000 mgr.a (mgr.14373) 3983 : cluster [DBG] pgmap v2761: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:09:08.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:09:07 smithi157 bash[24585]: cluster 2024-09-16T07:09:07.532128+0000 mgr.a (mgr.14373) 3984 : cluster [DBG] pgmap v2762: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:09:08.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:09:07 smithi086 bash[24289]: cluster 2024-09-16T07:09:07.532128+0000 mgr.a (mgr.14373) 3984 : cluster [DBG] pgmap v2762: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:09:08.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:09:07 smithi047 bash[22744]: cluster 2024-09-16T07:09:07.532128+0000 mgr.a (mgr.14373) 3984 : cluster [DBG] pgmap v2762: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:09:10.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:09:09 smithi157 bash[24585]: cluster 2024-09-16T07:09:09.532889+0000 mgr.a (mgr.14373) 3985 : cluster [DBG] pgmap v2763: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:09:10.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:09:09 smithi086 bash[24289]: cluster 2024-09-16T07:09:09.532889+0000 mgr.a (mgr.14373) 3985 : cluster [DBG] pgmap v2763: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:09:10.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:09:09 smithi047 bash[22744]: cluster 2024-09-16T07:09:09.532889+0000 mgr.a (mgr.14373) 3985 : cluster [DBG] pgmap v2763: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:09:10.827 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:09:10.828 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:09:10.828 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:09:11.582 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:09:11.582 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:09:11.582 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:09:11.582 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:09:11.582 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:09:12.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:09:11 smithi157 bash[24585]: audit 2024-09-16T07:09:11.160913+0000 mgr.a (mgr.14373) 3986 : audit [DBG] from='client.96654 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:09:12.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:09:11 smithi157 bash[24585]: cluster 2024-09-16T07:09:11.534216+0000 mgr.a (mgr.14373) 3987 : cluster [DBG] pgmap v2764: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:09:12.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:09:11 smithi086 bash[24289]: audit 2024-09-16T07:09:11.160913+0000 mgr.a (mgr.14373) 3986 : audit [DBG] from='client.96654 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:09:12.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:09:11 smithi086 bash[24289]: cluster 2024-09-16T07:09:11.534216+0000 mgr.a (mgr.14373) 3987 : cluster [DBG] pgmap v2764: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:09:12.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:09:11 smithi047 bash[22744]: audit 2024-09-16T07:09:11.160913+0000 mgr.a (mgr.14373) 3986 : audit [DBG] from='client.96654 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:09:12.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:09:11 smithi047 bash[22744]: cluster 2024-09-16T07:09:11.534216+0000 mgr.a (mgr.14373) 3987 : cluster [DBG] pgmap v2764: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:09:14.055 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:09:13 smithi157 bash[24585]: cluster 2024-09-16T07:09:13.534963+0000 mgr.a (mgr.14373) 3988 : cluster [DBG] pgmap v2765: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T07:09:14.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:09:13 smithi086 bash[24289]: cluster 2024-09-16T07:09:13.534963+0000 mgr.a (mgr.14373) 3988 : cluster [DBG] pgmap v2765: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T07:09:14.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:09:13 smithi047 bash[22744]: cluster 2024-09-16T07:09:13.534963+0000 mgr.a (mgr.14373) 3988 : cluster [DBG] pgmap v2765: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T07:09:16.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:09:15 smithi157 bash[24585]: cluster 2024-09-16T07:09:15.535739+0000 mgr.a (mgr.14373) 3989 : cluster [DBG] pgmap v2766: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T07:09:16.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:09:15 smithi086 bash[24289]: cluster 2024-09-16T07:09:15.535739+0000 mgr.a (mgr.14373) 3989 : cluster [DBG] pgmap v2766: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T07:09:16.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:09:15 smithi047 bash[22744]: cluster 2024-09-16T07:09:15.535739+0000 mgr.a (mgr.14373) 3989 : cluster [DBG] pgmap v2766: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T07:09:16.583 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:09:16.584 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:09:16.584 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:09:17.368 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:09:17.369 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:09:17.369 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:09:17.369 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:09:17.369 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:09:18.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:09:17 smithi157 bash[24585]: audit 2024-09-16T07:09:16.923225+0000 mgr.a (mgr.14373) 3990 : audit [DBG] from='client.96729 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:09:18.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:09:17 smithi157 bash[24585]: cluster 2024-09-16T07:09:17.538606+0000 mgr.a (mgr.14373) 3991 : cluster [DBG] pgmap v2767: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:09:18.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:09:17 smithi086 bash[24289]: audit 2024-09-16T07:09:16.923225+0000 mgr.a (mgr.14373) 3990 : audit [DBG] from='client.96729 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:09:18.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:09:17 smithi086 bash[24289]: cluster 2024-09-16T07:09:17.538606+0000 mgr.a (mgr.14373) 3991 : cluster [DBG] pgmap v2767: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:09:18.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:09:17 smithi047 bash[22744]: audit 2024-09-16T07:09:16.923225+0000 mgr.a (mgr.14373) 3990 : audit [DBG] from='client.96729 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:09:18.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:09:17 smithi047 bash[22744]: cluster 2024-09-16T07:09:17.538606+0000 mgr.a (mgr.14373) 3991 : cluster [DBG] pgmap v2767: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:09:20.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:09:19 smithi157 bash[24585]: cluster 2024-09-16T07:09:19.539411+0000 mgr.a (mgr.14373) 3992 : cluster [DBG] pgmap v2768: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:09:20.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:09:19 smithi086 bash[24289]: cluster 2024-09-16T07:09:19.539411+0000 mgr.a (mgr.14373) 3992 : cluster [DBG] pgmap v2768: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:09:20.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:09:19 smithi047 bash[22744]: cluster 2024-09-16T07:09:19.539411+0000 mgr.a (mgr.14373) 3992 : cluster [DBG] pgmap v2768: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:09:22.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:09:21 smithi157 bash[24585]: cluster 2024-09-16T07:09:21.541342+0000 mgr.a (mgr.14373) 3993 : cluster [DBG] pgmap v2769: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:09:22.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:09:21 smithi086 bash[24289]: cluster 2024-09-16T07:09:21.541342+0000 mgr.a (mgr.14373) 3993 : cluster [DBG] pgmap v2769: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:09:22.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:09:21 smithi047 bash[22744]: cluster 2024-09-16T07:09:21.541342+0000 mgr.a (mgr.14373) 3993 : cluster [DBG] pgmap v2769: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:09:22.370 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:09:22.370 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:09:22.371 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:09:23.113 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:09:23.113 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:09:23.113 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:09:23.113 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:09:23.113 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:09:24.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:09:23 smithi157 bash[24585]: audit 2024-09-16T07:09:22.700449+0000 mgr.a (mgr.14373) 3994 : audit [DBG] from='client.96807 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:09:24.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:09:23 smithi157 bash[24585]: cluster 2024-09-16T07:09:23.542224+0000 mgr.a (mgr.14373) 3995 : cluster [DBG] pgmap v2770: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:09:24.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:09:23 smithi086 bash[24289]: audit 2024-09-16T07:09:22.700449+0000 mgr.a (mgr.14373) 3994 : audit [DBG] from='client.96807 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:09:24.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:09:23 smithi086 bash[24289]: cluster 2024-09-16T07:09:23.542224+0000 mgr.a (mgr.14373) 3995 : cluster [DBG] pgmap v2770: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:09:24.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:09:23 smithi047 bash[22744]: audit 2024-09-16T07:09:22.700449+0000 mgr.a (mgr.14373) 3994 : audit [DBG] from='client.96807 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:09:24.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:09:23 smithi047 bash[22744]: cluster 2024-09-16T07:09:23.542224+0000 mgr.a (mgr.14373) 3995 : cluster [DBG] pgmap v2770: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:09:26.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:09:25 smithi157 bash[24585]: cluster 2024-09-16T07:09:25.542988+0000 mgr.a (mgr.14373) 3996 : cluster [DBG] pgmap v2771: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:09:26.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:09:25 smithi086 bash[24289]: cluster 2024-09-16T07:09:25.542988+0000 mgr.a (mgr.14373) 3996 : cluster [DBG] pgmap v2771: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:09:26.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:09:25 smithi047 bash[22744]: cluster 2024-09-16T07:09:25.542988+0000 mgr.a (mgr.14373) 3996 : cluster [DBG] pgmap v2771: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:09:28.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:09:27 smithi157 bash[24585]: cluster 2024-09-16T07:09:27.545123+0000 mgr.a (mgr.14373) 3997 : cluster [DBG] pgmap v2772: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:09:28.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:09:27 smithi086 bash[24289]: cluster 2024-09-16T07:09:27.545123+0000 mgr.a (mgr.14373) 3997 : cluster [DBG] pgmap v2772: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:09:28.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:09:27 smithi047 bash[22744]: cluster 2024-09-16T07:09:27.545123+0000 mgr.a (mgr.14373) 3997 : cluster [DBG] pgmap v2772: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:09:28.114 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:09:28.115 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:09:28.115 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:09:28.873 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:09:28.874 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:09:28.874 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:09:28.874 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:09:28.874 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:09:29.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:09:28 smithi157 bash[24585]: audit 2024-09-16T07:09:28.450401+0000 mgr.a (mgr.14373) 3998 : audit [DBG] from='client.96882 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:09:29.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:09:28 smithi086 bash[24289]: audit 2024-09-16T07:09:28.450401+0000 mgr.a (mgr.14373) 3998 : audit [DBG] from='client.96882 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:09:29.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:09:28 smithi047 bash[22744]: audit 2024-09-16T07:09:28.450401+0000 mgr.a (mgr.14373) 3998 : audit [DBG] from='client.96882 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:09:30.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:09:29 smithi157 bash[24585]: cluster 2024-09-16T07:09:29.546027+0000 mgr.a (mgr.14373) 3999 : cluster [DBG] pgmap v2773: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:09:30.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:09:29 smithi086 bash[24289]: cluster 2024-09-16T07:09:29.546027+0000 mgr.a (mgr.14373) 3999 : cluster [DBG] pgmap v2773: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:09:30.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:09:29 smithi047 bash[22744]: cluster 2024-09-16T07:09:29.546027+0000 mgr.a (mgr.14373) 3999 : cluster [DBG] pgmap v2773: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:09:32.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:09:31 smithi157 bash[24585]: cluster 2024-09-16T07:09:31.548175+0000 mgr.a (mgr.14373) 4000 : cluster [DBG] pgmap v2774: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:09:32.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:09:31 smithi086 bash[24289]: cluster 2024-09-16T07:09:31.548175+0000 mgr.a (mgr.14373) 4000 : cluster [DBG] pgmap v2774: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:09:32.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:09:31 smithi047 bash[22744]: cluster 2024-09-16T07:09:31.548175+0000 mgr.a (mgr.14373) 4000 : cluster [DBG] pgmap v2774: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:09:33.875 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:09:33.875 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:09:33.876 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:09:34.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:09:33 smithi157 bash[24585]: cluster 2024-09-16T07:09:33.548932+0000 mgr.a (mgr.14373) 4001 : cluster [DBG] pgmap v2775: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:09:34.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:09:33 smithi086 bash[24289]: cluster 2024-09-16T07:09:33.548932+0000 mgr.a (mgr.14373) 4001 : cluster [DBG] pgmap v2775: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:09:34.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:09:33 smithi047 bash[22744]: cluster 2024-09-16T07:09:33.548932+0000 mgr.a (mgr.14373) 4001 : cluster [DBG] pgmap v2775: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:09:34.620 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:09:34.620 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:09:34.620 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:09:34.620 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:09:34.620 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:09:35.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:09:34 smithi157 bash[24585]: audit 2024-09-16T07:09:34.209701+0000 mgr.a (mgr.14373) 4002 : audit [DBG] from='client.96960 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:09:35.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:09:34 smithi086 bash[24289]: audit 2024-09-16T07:09:34.209701+0000 mgr.a (mgr.14373) 4002 : audit [DBG] from='client.96960 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:09:35.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:09:34 smithi047 bash[22744]: audit 2024-09-16T07:09:34.209701+0000 mgr.a (mgr.14373) 4002 : audit [DBG] from='client.96960 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:09:36.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:09:35 smithi157 bash[24585]: cluster 2024-09-16T07:09:35.549811+0000 mgr.a (mgr.14373) 4003 : cluster [DBG] pgmap v2776: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:09:36.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:09:35 smithi086 bash[24289]: cluster 2024-09-16T07:09:35.549811+0000 mgr.a (mgr.14373) 4003 : cluster [DBG] pgmap v2776: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:09:36.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:09:35 smithi047 bash[22744]: cluster 2024-09-16T07:09:35.549811+0000 mgr.a (mgr.14373) 4003 : cluster [DBG] pgmap v2776: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:09:38.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:09:37 smithi157 bash[24585]: cluster 2024-09-16T07:09:37.551991+0000 mgr.a (mgr.14373) 4004 : cluster [DBG] pgmap v2777: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:09:38.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:09:37 smithi086 bash[24289]: cluster 2024-09-16T07:09:37.551991+0000 mgr.a (mgr.14373) 4004 : cluster [DBG] pgmap v2777: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:09:38.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:09:37 smithi047 bash[22744]: cluster 2024-09-16T07:09:37.551991+0000 mgr.a (mgr.14373) 4004 : cluster [DBG] pgmap v2777: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:09:39.621 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:09:39.622 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:09:39.623 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:09:40.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:09:39 smithi157 bash[24585]: cluster 2024-09-16T07:09:39.552727+0000 mgr.a (mgr.14373) 4005 : cluster [DBG] pgmap v2778: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:09:40.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:09:39 smithi086 bash[24289]: cluster 2024-09-16T07:09:39.552727+0000 mgr.a (mgr.14373) 4005 : cluster [DBG] pgmap v2778: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:09:40.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:09:39 smithi047 bash[22744]: cluster 2024-09-16T07:09:39.552727+0000 mgr.a (mgr.14373) 4005 : cluster [DBG] pgmap v2778: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:09:40.402 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:09:40.402 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:09:40.402 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:09:40.403 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:09:40.403 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:09:41.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:09:40 smithi157 bash[24585]: audit 2024-09-16T07:09:39.959418+0000 mgr.a (mgr.14373) 4006 : audit [DBG] from='client.97038 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:09:41.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:09:40 smithi086 bash[24289]: audit 2024-09-16T07:09:39.959418+0000 mgr.a (mgr.14373) 4006 : audit [DBG] from='client.97038 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:09:41.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:09:40 smithi047 bash[22744]: audit 2024-09-16T07:09:39.959418+0000 mgr.a (mgr.14373) 4006 : audit [DBG] from='client.97038 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:09:42.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:09:41 smithi157 bash[24585]: cluster 2024-09-16T07:09:41.554953+0000 mgr.a (mgr.14373) 4007 : cluster [DBG] pgmap v2779: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:09:42.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:09:41 smithi086 bash[24289]: cluster 2024-09-16T07:09:41.554953+0000 mgr.a (mgr.14373) 4007 : cluster [DBG] pgmap v2779: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:09:42.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:09:41 smithi047 bash[22744]: cluster 2024-09-16T07:09:41.554953+0000 mgr.a (mgr.14373) 4007 : cluster [DBG] pgmap v2779: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:09:44.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:09:43 smithi157 bash[24585]: cluster 2024-09-16T07:09:43.555689+0000 mgr.a (mgr.14373) 4008 : cluster [DBG] pgmap v2780: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:09:44.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:09:43 smithi086 bash[24289]: cluster 2024-09-16T07:09:43.555689+0000 mgr.a (mgr.14373) 4008 : cluster [DBG] pgmap v2780: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:09:44.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:09:43 smithi047 bash[22744]: cluster 2024-09-16T07:09:43.555689+0000 mgr.a (mgr.14373) 4008 : cluster [DBG] pgmap v2780: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:09:45.404 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:09:45.404 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:09:45.404 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:09:46.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:09:45 smithi157 bash[24585]: cluster 2024-09-16T07:09:45.556139+0000 mgr.a (mgr.14373) 4009 : cluster [DBG] pgmap v2781: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:09:46.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:09:45 smithi086 bash[24289]: cluster 2024-09-16T07:09:45.556139+0000 mgr.a (mgr.14373) 4009 : cluster [DBG] pgmap v2781: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:09:46.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:09:45 smithi047 bash[22744]: cluster 2024-09-16T07:09:45.556139+0000 mgr.a (mgr.14373) 4009 : cluster [DBG] pgmap v2781: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:09:46.193 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:09:46.193 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:09:46.193 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:09:46.193 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:09:46.193 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:09:47.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:09:46 smithi157 bash[24585]: audit 2024-09-16T07:09:45.747527+0000 mgr.a (mgr.14373) 4010 : audit [DBG] from='client.97116 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:09:47.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:09:46 smithi086 bash[24289]: audit 2024-09-16T07:09:45.747527+0000 mgr.a (mgr.14373) 4010 : audit [DBG] from='client.97116 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:09:47.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:09:46 smithi047 bash[22744]: audit 2024-09-16T07:09:45.747527+0000 mgr.a (mgr.14373) 4010 : audit [DBG] from='client.97116 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:09:48.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:09:47 smithi157 bash[24585]: cluster 2024-09-16T07:09:47.558464+0000 mgr.a (mgr.14373) 4011 : cluster [DBG] pgmap v2782: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:09:48.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:09:47 smithi086 bash[24289]: cluster 2024-09-16T07:09:47.558464+0000 mgr.a (mgr.14373) 4011 : cluster [DBG] pgmap v2782: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:09:48.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:09:47 smithi047 bash[22744]: cluster 2024-09-16T07:09:47.558464+0000 mgr.a (mgr.14373) 4011 : cluster [DBG] pgmap v2782: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:09:49.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:09:49 smithi157 bash[24585]: audit 2024-09-16T07:09:49.287581+0000 mon.b (mon.2) 402 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T07:09:49.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:09:49 smithi086 bash[24289]: audit 2024-09-16T07:09:49.287581+0000 mon.b (mon.2) 402 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T07:09:49.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:09:49 smithi047 bash[22744]: audit 2024-09-16T07:09:49.287581+0000 mon.b (mon.2) 402 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T07:09:50.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:09:50 smithi157 bash[24585]: cluster 2024-09-16T07:09:49.559217+0000 mgr.a (mgr.14373) 4012 : cluster [DBG] pgmap v2783: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:09:50.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:09:50 smithi086 bash[24289]: cluster 2024-09-16T07:09:49.559217+0000 mgr.a (mgr.14373) 4012 : cluster [DBG] pgmap v2783: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:09:50.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:09:50 smithi047 bash[22744]: cluster 2024-09-16T07:09:49.559217+0000 mgr.a (mgr.14373) 4012 : cluster [DBG] pgmap v2783: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:09:51.194 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:09:51.195 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:09:51.195 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:09:51.838 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 07:09:51 smithi047 bash[22994]: debug 2024-09-16T07:09:51.391+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T07:09:51.838 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 07:09:51 smithi047 bash[22994]: debug 2024-09-16T07:09:51.395+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T07:09:51.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:09:51 smithi047 bash[22744]: audit 2024-09-16T07:09:50.623917+0000 mon.a (mon.0) 807 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:09:51.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:09:51 smithi047 bash[22744]: audit 2024-09-16T07:09:50.631846+0000 mon.a (mon.0) 808 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:09:51.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:09:51 smithi047 bash[22744]: audit 2024-09-16T07:09:50.645133+0000 mon.a (mon.0) 809 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:09:51.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:09:51 smithi047 bash[22744]: audit 2024-09-16T07:09:50.651169+0000 mon.a (mon.0) 810 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:09:51.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:09:51 smithi047 bash[22744]: audit 2024-09-16T07:09:50.663272+0000 mon.a (mon.0) 811 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:09:51.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:09:51 smithi047 bash[22744]: audit 2024-09-16T07:09:50.669809+0000 mon.b (mon.2) 403 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T07:09:51.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:09:51 smithi047 bash[22744]: audit 2024-09-16T07:09:50.669946+0000 mon.a (mon.0) 812 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:09:51.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:09:51 smithi047 bash[22744]: audit 2024-09-16T07:09:50.671130+0000 mon.b (mon.2) 404 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T07:09:51.840 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:09:51 smithi047 bash[22744]: audit 2024-09-16T07:09:50.680690+0000 mon.a (mon.0) 813 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:09:51.840 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:09:51 smithi047 bash[22744]: audit 2024-09-16T07:09:50.682241+0000 mon.b (mon.2) 405 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:09:51.840 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:09:51 smithi047 bash[22744]: audit 2024-09-16T07:09:50.686338+0000 mgr.a (mgr.14373) 4013 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:09:51.840 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:09:51 smithi047 bash[22744]: audit 2024-09-16T07:09:51.396713+0000 mgr.a (mgr.14373) 4014 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T07:09:51.840 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:09:51 smithi047 bash[22744]: cephadm 2024-09-16T07:09:51.398628+0000 mgr.a (mgr.14373) 4015 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T07:09:51.840 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:09:51 smithi047 bash[22744]: audit 2024-09-16T07:09:51.533133+0000 mgr.a (mgr.14373) 4016 : audit [DBG] from='client.97299 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:09:51.840 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:09:51 smithi047 bash[22744]: cluster 2024-09-16T07:09:51.561488+0000 mgr.a (mgr.14373) 4017 : cluster [DBG] pgmap v2784: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T07:09:51.944 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:09:51.945 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:09:51.945 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:09:51.945 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:09:51.945 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:09:52.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:09:51 smithi157 bash[24585]: audit 2024-09-16T07:09:50.623917+0000 mon.a (mon.0) 807 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:09:52.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:09:51 smithi157 bash[24585]: audit 2024-09-16T07:09:50.631846+0000 mon.a (mon.0) 808 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:09:52.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:09:51 smithi157 bash[24585]: audit 2024-09-16T07:09:50.645133+0000 mon.a (mon.0) 809 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:09:52.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:09:51 smithi157 bash[24585]: audit 2024-09-16T07:09:50.651169+0000 mon.a (mon.0) 810 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:09:52.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:09:51 smithi157 bash[24585]: audit 2024-09-16T07:09:50.663272+0000 mon.a (mon.0) 811 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:09:52.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:09:51 smithi157 bash[24585]: audit 2024-09-16T07:09:50.669809+0000 mon.b (mon.2) 403 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T07:09:52.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:09:51 smithi157 bash[24585]: audit 2024-09-16T07:09:50.669946+0000 mon.a (mon.0) 812 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:09:52.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:09:51 smithi157 bash[24585]: audit 2024-09-16T07:09:50.671130+0000 mon.b (mon.2) 404 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T07:09:52.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:09:51 smithi157 bash[24585]: audit 2024-09-16T07:09:50.680690+0000 mon.a (mon.0) 813 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:09:52.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:09:51 smithi157 bash[24585]: audit 2024-09-16T07:09:50.682241+0000 mon.b (mon.2) 405 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:09:52.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:09:51 smithi157 bash[24585]: audit 2024-09-16T07:09:50.686338+0000 mgr.a (mgr.14373) 4013 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:09:52.055 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:09:51 smithi157 bash[24585]: audit 2024-09-16T07:09:51.396713+0000 mgr.a (mgr.14373) 4014 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T07:09:52.055 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:09:51 smithi157 bash[24585]: cephadm 2024-09-16T07:09:51.398628+0000 mgr.a (mgr.14373) 4015 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T07:09:52.055 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:09:51 smithi157 bash[24585]: audit 2024-09-16T07:09:51.533133+0000 mgr.a (mgr.14373) 4016 : audit [DBG] from='client.97299 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:09:52.055 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:09:51 smithi157 bash[24585]: cluster 2024-09-16T07:09:51.561488+0000 mgr.a (mgr.14373) 4017 : cluster [DBG] pgmap v2784: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T07:09:52.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:09:51 smithi086 bash[24289]: audit 2024-09-16T07:09:50.623917+0000 mon.a (mon.0) 807 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:09:52.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:09:51 smithi086 bash[24289]: audit 2024-09-16T07:09:50.631846+0000 mon.a (mon.0) 808 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:09:52.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:09:51 smithi086 bash[24289]: audit 2024-09-16T07:09:50.645133+0000 mon.a (mon.0) 809 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:09:52.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:09:51 smithi086 bash[24289]: audit 2024-09-16T07:09:50.651169+0000 mon.a (mon.0) 810 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:09:52.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:09:51 smithi086 bash[24289]: audit 2024-09-16T07:09:50.663272+0000 mon.a (mon.0) 811 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:09:52.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:09:51 smithi086 bash[24289]: audit 2024-09-16T07:09:50.669809+0000 mon.b (mon.2) 403 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T07:09:52.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:09:51 smithi086 bash[24289]: audit 2024-09-16T07:09:50.669946+0000 mon.a (mon.0) 812 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:09:52.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:09:51 smithi086 bash[24289]: audit 2024-09-16T07:09:50.671130+0000 mon.b (mon.2) 404 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T07:09:52.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:09:51 smithi086 bash[24289]: audit 2024-09-16T07:09:50.680690+0000 mon.a (mon.0) 813 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:09:52.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:09:51 smithi086 bash[24289]: audit 2024-09-16T07:09:50.682241+0000 mon.b (mon.2) 405 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:09:52.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:09:51 smithi086 bash[24289]: audit 2024-09-16T07:09:50.686338+0000 mgr.a (mgr.14373) 4013 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:09:52.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:09:51 smithi086 bash[24289]: audit 2024-09-16T07:09:51.396713+0000 mgr.a (mgr.14373) 4014 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T07:09:52.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:09:51 smithi086 bash[24289]: cephadm 2024-09-16T07:09:51.398628+0000 mgr.a (mgr.14373) 4015 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T07:09:52.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:09:51 smithi086 bash[24289]: audit 2024-09-16T07:09:51.533133+0000 mgr.a (mgr.14373) 4016 : audit [DBG] from='client.97299 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:09:52.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:09:51 smithi086 bash[24289]: cluster 2024-09-16T07:09:51.561488+0000 mgr.a (mgr.14373) 4017 : cluster [DBG] pgmap v2784: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T07:09:54.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:09:53 smithi157 bash[24585]: cluster 2024-09-16T07:09:53.562367+0000 mgr.a (mgr.14373) 4018 : cluster [DBG] pgmap v2785: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 5.7 KiB/s rd, 426 B/s wr, 5 op/s 2024-09-16T07:09:54.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:09:53 smithi086 bash[24289]: cluster 2024-09-16T07:09:53.562367+0000 mgr.a (mgr.14373) 4018 : cluster [DBG] pgmap v2785: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 5.7 KiB/s rd, 426 B/s wr, 5 op/s 2024-09-16T07:09:54.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:09:53 smithi047 bash[22744]: cluster 2024-09-16T07:09:53.562367+0000 mgr.a (mgr.14373) 4018 : cluster [DBG] pgmap v2785: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 5.7 KiB/s rd, 426 B/s wr, 5 op/s 2024-09-16T07:09:56.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:09:55 smithi157 bash[24585]: cluster 2024-09-16T07:09:55.563146+0000 mgr.a (mgr.14373) 4019 : cluster [DBG] pgmap v2786: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 5.7 KiB/s rd, 426 B/s wr, 5 op/s 2024-09-16T07:09:56.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:09:55 smithi086 bash[24289]: cluster 2024-09-16T07:09:55.563146+0000 mgr.a (mgr.14373) 4019 : cluster [DBG] pgmap v2786: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 5.7 KiB/s rd, 426 B/s wr, 5 op/s 2024-09-16T07:09:56.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:09:55 smithi047 bash[22744]: cluster 2024-09-16T07:09:55.563146+0000 mgr.a (mgr.14373) 4019 : cluster [DBG] pgmap v2786: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 5.7 KiB/s rd, 426 B/s wr, 5 op/s 2024-09-16T07:09:56.946 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:09:56.947 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:09:56.947 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:09:57.714 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:09:57.715 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:09:57.715 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:09:57.715 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:09:57.715 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:09:58.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:09:57 smithi157 bash[24585]: audit 2024-09-16T07:09:57.284085+0000 mgr.a (mgr.14373) 4020 : audit [DBG] from='client.97374 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:09:58.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:09:57 smithi157 bash[24585]: cluster 2024-09-16T07:09:57.564556+0000 mgr.a (mgr.14373) 4021 : cluster [DBG] pgmap v2787: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:09:58.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:09:57 smithi086 bash[24289]: audit 2024-09-16T07:09:57.284085+0000 mgr.a (mgr.14373) 4020 : audit [DBG] from='client.97374 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:09:58.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:09:57 smithi086 bash[24289]: cluster 2024-09-16T07:09:57.564556+0000 mgr.a (mgr.14373) 4021 : cluster [DBG] pgmap v2787: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:09:58.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:09:57 smithi047 bash[22744]: audit 2024-09-16T07:09:57.284085+0000 mgr.a (mgr.14373) 4020 : audit [DBG] from='client.97374 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:09:58.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:09:57 smithi047 bash[22744]: cluster 2024-09-16T07:09:57.564556+0000 mgr.a (mgr.14373) 4021 : cluster [DBG] pgmap v2787: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:10:00.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:09:59 smithi157 bash[24585]: cluster 2024-09-16T07:09:59.565509+0000 mgr.a (mgr.14373) 4022 : cluster [DBG] pgmap v2788: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T07:10:00.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:09:59 smithi086 bash[24289]: cluster 2024-09-16T07:09:59.565509+0000 mgr.a (mgr.14373) 4022 : cluster [DBG] pgmap v2788: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T07:10:00.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:09:59 smithi047 bash[22744]: cluster 2024-09-16T07:09:59.565509+0000 mgr.a (mgr.14373) 4022 : cluster [DBG] pgmap v2788: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T07:10:01.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:10:00 smithi157 bash[24585]: cluster 2024-09-16T07:10:00.000154+0000 mon.a (mon.0) 814 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-16T07:10:01.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:10:00 smithi086 bash[24289]: cluster 2024-09-16T07:10:00.000154+0000 mon.a (mon.0) 814 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-16T07:10:01.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:10:00 smithi047 bash[22744]: cluster 2024-09-16T07:10:00.000154+0000 mon.a (mon.0) 814 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-16T07:10:02.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:10:01 smithi157 bash[24585]: cluster 2024-09-16T07:10:01.567691+0000 mgr.a (mgr.14373) 4023 : cluster [DBG] pgmap v2789: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:10:02.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:10:01 smithi086 bash[24289]: cluster 2024-09-16T07:10:01.567691+0000 mgr.a (mgr.14373) 4023 : cluster [DBG] pgmap v2789: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:10:02.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:10:01 smithi047 bash[22744]: cluster 2024-09-16T07:10:01.567691+0000 mgr.a (mgr.14373) 4023 : cluster [DBG] pgmap v2789: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:10:02.716 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:10:02.716 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:10:02.717 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:10:03.480 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:10:03.480 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:10:03.480 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:10:03.480 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:10:03.480 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:10:04.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:10:03 smithi157 bash[24585]: audit 2024-09-16T07:10:03.052228+0000 mgr.a (mgr.14373) 4024 : audit [DBG] from='client.97452 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:10:04.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:10:03 smithi157 bash[24585]: cluster 2024-09-16T07:10:03.568524+0000 mgr.a (mgr.14373) 4025 : cluster [DBG] pgmap v2790: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-16T07:10:04.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:10:03 smithi086 bash[24289]: audit 2024-09-16T07:10:03.052228+0000 mgr.a (mgr.14373) 4024 : audit [DBG] from='client.97452 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:10:04.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:10:03 smithi086 bash[24289]: cluster 2024-09-16T07:10:03.568524+0000 mgr.a (mgr.14373) 4025 : cluster [DBG] pgmap v2790: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-16T07:10:04.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:10:03 smithi047 bash[22744]: audit 2024-09-16T07:10:03.052228+0000 mgr.a (mgr.14373) 4024 : audit [DBG] from='client.97452 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:10:04.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:10:03 smithi047 bash[22744]: cluster 2024-09-16T07:10:03.568524+0000 mgr.a (mgr.14373) 4025 : cluster [DBG] pgmap v2790: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-16T07:10:06.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:10:05 smithi157 bash[24585]: cluster 2024-09-16T07:10:05.569303+0000 mgr.a (mgr.14373) 4026 : cluster [DBG] pgmap v2791: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-16T07:10:06.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:10:05 smithi086 bash[24289]: cluster 2024-09-16T07:10:05.569303+0000 mgr.a (mgr.14373) 4026 : cluster [DBG] pgmap v2791: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-16T07:10:06.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:10:05 smithi047 bash[22744]: cluster 2024-09-16T07:10:05.569303+0000 mgr.a (mgr.14373) 4026 : cluster [DBG] pgmap v2791: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-16T07:10:08.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:10:07 smithi157 bash[24585]: cluster 2024-09-16T07:10:07.571450+0000 mgr.a (mgr.14373) 4027 : cluster [DBG] pgmap v2792: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 3.1 KiB/s rd, 2 op/s 2024-09-16T07:10:08.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:10:07 smithi086 bash[24289]: cluster 2024-09-16T07:10:07.571450+0000 mgr.a (mgr.14373) 4027 : cluster [DBG] pgmap v2792: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 3.1 KiB/s rd, 2 op/s 2024-09-16T07:10:08.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:10:07 smithi047 bash[22744]: cluster 2024-09-16T07:10:07.571450+0000 mgr.a (mgr.14373) 4027 : cluster [DBG] pgmap v2792: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 3.1 KiB/s rd, 2 op/s 2024-09-16T07:10:08.481 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:10:08.482 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:10:08.482 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:10:09.238 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:10:09.238 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:10:09.238 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:10:09.238 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:10:09.238 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:10:10.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:10:09 smithi157 bash[24585]: audit 2024-09-16T07:10:08.814100+0000 mgr.a (mgr.14373) 4028 : audit [DBG] from='client.97530 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:10:10.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:10:09 smithi157 bash[24585]: cluster 2024-09-16T07:10:09.572419+0000 mgr.a (mgr.14373) 4029 : cluster [DBG] pgmap v2793: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:10:10.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:10:09 smithi086 bash[24289]: audit 2024-09-16T07:10:08.814100+0000 mgr.a (mgr.14373) 4028 : audit [DBG] from='client.97530 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:10:10.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:10:09 smithi086 bash[24289]: cluster 2024-09-16T07:10:09.572419+0000 mgr.a (mgr.14373) 4029 : cluster [DBG] pgmap v2793: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:10:10.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:10:09 smithi047 bash[22744]: audit 2024-09-16T07:10:08.814100+0000 mgr.a (mgr.14373) 4028 : audit [DBG] from='client.97530 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:10:10.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:10:09 smithi047 bash[22744]: cluster 2024-09-16T07:10:09.572419+0000 mgr.a (mgr.14373) 4029 : cluster [DBG] pgmap v2793: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:10:13.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:10:12 smithi157 bash[24585]: cluster 2024-09-16T07:10:11.574614+0000 mgr.a (mgr.14373) 4030 : cluster [DBG] pgmap v2794: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:10:13.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:10:12 smithi086 bash[24289]: cluster 2024-09-16T07:10:11.574614+0000 mgr.a (mgr.14373) 4030 : cluster [DBG] pgmap v2794: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:10:13.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:10:12 smithi047 bash[22744]: cluster 2024-09-16T07:10:11.574614+0000 mgr.a (mgr.14373) 4030 : cluster [DBG] pgmap v2794: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:10:14.239 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:10:14.240 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:10:14.240 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:10:15.031 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:10:15.031 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:10:15.032 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:10:15.032 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:10:15.032 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:10:15.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:10:14 smithi157 bash[24585]: cluster 2024-09-16T07:10:13.575403+0000 mgr.a (mgr.14373) 4031 : cluster [DBG] pgmap v2795: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:10:15.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:10:14 smithi086 bash[24289]: cluster 2024-09-16T07:10:13.575403+0000 mgr.a (mgr.14373) 4031 : cluster [DBG] pgmap v2795: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:10:15.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:10:14 smithi047 bash[22744]: cluster 2024-09-16T07:10:13.575403+0000 mgr.a (mgr.14373) 4031 : cluster [DBG] pgmap v2795: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:10:16.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:10:15 smithi157 bash[24585]: audit 2024-09-16T07:10:14.579556+0000 mgr.a (mgr.14373) 4032 : audit [DBG] from='client.97605 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:10:16.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:10:15 smithi086 bash[24289]: audit 2024-09-16T07:10:14.579556+0000 mgr.a (mgr.14373) 4032 : audit [DBG] from='client.97605 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:10:16.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:10:15 smithi047 bash[22744]: audit 2024-09-16T07:10:14.579556+0000 mgr.a (mgr.14373) 4032 : audit [DBG] from='client.97605 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:10:17.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:10:16 smithi157 bash[24585]: cluster 2024-09-16T07:10:15.576351+0000 mgr.a (mgr.14373) 4033 : cluster [DBG] pgmap v2796: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:10:17.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:10:16 smithi086 bash[24289]: cluster 2024-09-16T07:10:15.576351+0000 mgr.a (mgr.14373) 4033 : cluster [DBG] pgmap v2796: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:10:17.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:10:16 smithi047 bash[22744]: cluster 2024-09-16T07:10:15.576351+0000 mgr.a (mgr.14373) 4033 : cluster [DBG] pgmap v2796: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:10:19.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:10:18 smithi157 bash[24585]: cluster 2024-09-16T07:10:17.578605+0000 mgr.a (mgr.14373) 4034 : cluster [DBG] pgmap v2797: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:10:19.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:10:18 smithi086 bash[24289]: cluster 2024-09-16T07:10:17.578605+0000 mgr.a (mgr.14373) 4034 : cluster [DBG] pgmap v2797: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:10:19.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:10:18 smithi047 bash[22744]: cluster 2024-09-16T07:10:17.578605+0000 mgr.a (mgr.14373) 4034 : cluster [DBG] pgmap v2797: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:10:20.033 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:10:20.033 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:10:20.033 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:10:20.789 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:10:20.789 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:10:20.789 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:10:20.789 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:10:20.789 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:10:21.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:10:20 smithi157 bash[24585]: cluster 2024-09-16T07:10:19.579362+0000 mgr.a (mgr.14373) 4035 : cluster [DBG] pgmap v2798: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:10:21.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:10:20 smithi157 bash[24585]: audit 2024-09-16T07:10:20.366123+0000 mgr.a (mgr.14373) 4036 : audit [DBG] from='client.97683 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:10:21.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:10:20 smithi086 bash[24289]: cluster 2024-09-16T07:10:19.579362+0000 mgr.a (mgr.14373) 4035 : cluster [DBG] pgmap v2798: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:10:21.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:10:20 smithi086 bash[24289]: audit 2024-09-16T07:10:20.366123+0000 mgr.a (mgr.14373) 4036 : audit [DBG] from='client.97683 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:10:21.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:10:20 smithi047 bash[22744]: cluster 2024-09-16T07:10:19.579362+0000 mgr.a (mgr.14373) 4035 : cluster [DBG] pgmap v2798: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:10:21.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:10:20 smithi047 bash[22744]: audit 2024-09-16T07:10:20.366123+0000 mgr.a (mgr.14373) 4036 : audit [DBG] from='client.97683 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:10:23.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:10:22 smithi157 bash[24585]: cluster 2024-09-16T07:10:21.581731+0000 mgr.a (mgr.14373) 4037 : cluster [DBG] pgmap v2799: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:10:23.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:10:22 smithi086 bash[24289]: cluster 2024-09-16T07:10:21.581731+0000 mgr.a (mgr.14373) 4037 : cluster [DBG] pgmap v2799: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:10:23.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:10:22 smithi047 bash[22744]: cluster 2024-09-16T07:10:21.581731+0000 mgr.a (mgr.14373) 4037 : cluster [DBG] pgmap v2799: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:10:25.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:10:24 smithi157 bash[24585]: cluster 2024-09-16T07:10:23.582649+0000 mgr.a (mgr.14373) 4038 : cluster [DBG] pgmap v2800: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:10:25.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:10:24 smithi086 bash[24289]: cluster 2024-09-16T07:10:23.582649+0000 mgr.a (mgr.14373) 4038 : cluster [DBG] pgmap v2800: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:10:25.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:10:24 smithi047 bash[22744]: cluster 2024-09-16T07:10:23.582649+0000 mgr.a (mgr.14373) 4038 : cluster [DBG] pgmap v2800: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:10:25.790 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:10:25.791 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:10:25.791 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:10:26.572 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:10:26.573 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:10:26.573 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:10:26.573 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:10:26.573 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:10:27.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:10:26 smithi157 bash[24585]: cluster 2024-09-16T07:10:25.583405+0000 mgr.a (mgr.14373) 4039 : cluster [DBG] pgmap v2801: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:10:27.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:10:26 smithi157 bash[24585]: audit 2024-09-16T07:10:26.129364+0000 mgr.a (mgr.14373) 4040 : audit [DBG] from='client.97758 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:10:27.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:10:26 smithi086 bash[24289]: cluster 2024-09-16T07:10:25.583405+0000 mgr.a (mgr.14373) 4039 : cluster [DBG] pgmap v2801: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:10:27.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:10:26 smithi086 bash[24289]: audit 2024-09-16T07:10:26.129364+0000 mgr.a (mgr.14373) 4040 : audit [DBG] from='client.97758 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:10:27.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:10:26 smithi047 bash[22744]: cluster 2024-09-16T07:10:25.583405+0000 mgr.a (mgr.14373) 4039 : cluster [DBG] pgmap v2801: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:10:27.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:10:26 smithi047 bash[22744]: audit 2024-09-16T07:10:26.129364+0000 mgr.a (mgr.14373) 4040 : audit [DBG] from='client.97758 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:10:29.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:10:28 smithi157 bash[24585]: cluster 2024-09-16T07:10:27.586157+0000 mgr.a (mgr.14373) 4041 : cluster [DBG] pgmap v2802: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-16T07:10:29.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:10:28 smithi086 bash[24289]: cluster 2024-09-16T07:10:27.586157+0000 mgr.a (mgr.14373) 4041 : cluster [DBG] pgmap v2802: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-16T07:10:29.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:10:28 smithi047 bash[22744]: cluster 2024-09-16T07:10:27.586157+0000 mgr.a (mgr.14373) 4041 : cluster [DBG] pgmap v2802: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-16T07:10:31.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:10:30 smithi157 bash[24585]: cluster 2024-09-16T07:10:29.586947+0000 mgr.a (mgr.14373) 4042 : cluster [DBG] pgmap v2803: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T07:10:31.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:10:30 smithi086 bash[24289]: cluster 2024-09-16T07:10:29.586947+0000 mgr.a (mgr.14373) 4042 : cluster [DBG] pgmap v2803: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T07:10:31.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:10:30 smithi047 bash[22744]: cluster 2024-09-16T07:10:29.586947+0000 mgr.a (mgr.14373) 4042 : cluster [DBG] pgmap v2803: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T07:10:31.574 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:10:31.575 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:10:31.575 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:10:32.359 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:10:32.359 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:10:32.359 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:10:32.359 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:10:32.359 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:10:33.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:10:32 smithi157 bash[24585]: cluster 2024-09-16T07:10:31.588993+0000 mgr.a (mgr.14373) 4043 : cluster [DBG] pgmap v2804: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:10:33.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:10:32 smithi157 bash[24585]: audit 2024-09-16T07:10:31.914401+0000 mgr.a (mgr.14373) 4044 : audit [DBG] from='client.97836 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:10:33.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:10:32 smithi086 bash[24289]: cluster 2024-09-16T07:10:31.588993+0000 mgr.a (mgr.14373) 4043 : cluster [DBG] pgmap v2804: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:10:33.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:10:32 smithi086 bash[24289]: audit 2024-09-16T07:10:31.914401+0000 mgr.a (mgr.14373) 4044 : audit [DBG] from='client.97836 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:10:33.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:10:32 smithi047 bash[22744]: cluster 2024-09-16T07:10:31.588993+0000 mgr.a (mgr.14373) 4043 : cluster [DBG] pgmap v2804: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:10:33.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:10:32 smithi047 bash[22744]: audit 2024-09-16T07:10:31.914401+0000 mgr.a (mgr.14373) 4044 : audit [DBG] from='client.97836 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:10:35.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:10:34 smithi157 bash[24585]: cluster 2024-09-16T07:10:33.590123+0000 mgr.a (mgr.14373) 4045 : cluster [DBG] pgmap v2805: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:10:35.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:10:34 smithi086 bash[24289]: cluster 2024-09-16T07:10:33.590123+0000 mgr.a (mgr.14373) 4045 : cluster [DBG] pgmap v2805: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:10:35.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:10:34 smithi047 bash[22744]: cluster 2024-09-16T07:10:33.590123+0000 mgr.a (mgr.14373) 4045 : cluster [DBG] pgmap v2805: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:10:37.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:10:36 smithi157 bash[24585]: cluster 2024-09-16T07:10:35.590962+0000 mgr.a (mgr.14373) 4046 : cluster [DBG] pgmap v2806: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T07:10:37.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:10:36 smithi086 bash[24289]: cluster 2024-09-16T07:10:35.590962+0000 mgr.a (mgr.14373) 4046 : cluster [DBG] pgmap v2806: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T07:10:37.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:10:36 smithi047 bash[22744]: cluster 2024-09-16T07:10:35.590962+0000 mgr.a (mgr.14373) 4046 : cluster [DBG] pgmap v2806: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T07:10:37.360 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:10:37.361 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:10:37.361 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:10:38.136 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:10:38.136 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:10:38.136 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:10:38.136 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:10:38.136 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:10:39.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:10:38 smithi157 bash[24585]: cluster 2024-09-16T07:10:37.592296+0000 mgr.a (mgr.14373) 4047 : cluster [DBG] pgmap v2807: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:10:39.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:10:38 smithi157 bash[24585]: audit 2024-09-16T07:10:37.696886+0000 mgr.a (mgr.14373) 4048 : audit [DBG] from='client.97914 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:10:39.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:10:38 smithi086 bash[24289]: cluster 2024-09-16T07:10:37.592296+0000 mgr.a (mgr.14373) 4047 : cluster [DBG] pgmap v2807: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:10:39.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:10:38 smithi086 bash[24289]: audit 2024-09-16T07:10:37.696886+0000 mgr.a (mgr.14373) 4048 : audit [DBG] from='client.97914 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:10:39.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:10:38 smithi047 bash[22744]: cluster 2024-09-16T07:10:37.592296+0000 mgr.a (mgr.14373) 4047 : cluster [DBG] pgmap v2807: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:10:39.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:10:38 smithi047 bash[22744]: audit 2024-09-16T07:10:37.696886+0000 mgr.a (mgr.14373) 4048 : audit [DBG] from='client.97914 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:10:41.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:10:40 smithi157 bash[24585]: cluster 2024-09-16T07:10:39.593241+0000 mgr.a (mgr.14373) 4049 : cluster [DBG] pgmap v2808: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-16T07:10:41.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:10:40 smithi086 bash[24289]: cluster 2024-09-16T07:10:39.593241+0000 mgr.a (mgr.14373) 4049 : cluster [DBG] pgmap v2808: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-16T07:10:41.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:10:40 smithi047 bash[22744]: cluster 2024-09-16T07:10:39.593241+0000 mgr.a (mgr.14373) 4049 : cluster [DBG] pgmap v2808: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-16T07:10:43.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:10:42 smithi157 bash[24585]: cluster 2024-09-16T07:10:41.595401+0000 mgr.a (mgr.14373) 4050 : cluster [DBG] pgmap v2809: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-16T07:10:43.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:10:42 smithi086 bash[24289]: cluster 2024-09-16T07:10:41.595401+0000 mgr.a (mgr.14373) 4050 : cluster [DBG] pgmap v2809: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-16T07:10:43.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:10:42 smithi047 bash[22744]: cluster 2024-09-16T07:10:41.595401+0000 mgr.a (mgr.14373) 4050 : cluster [DBG] pgmap v2809: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-16T07:10:43.137 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:10:43.138 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:10:43.138 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:10:43.914 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:10:43.914 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:10:43.915 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:10:43.915 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:10:43.915 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:10:44.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:10:43 smithi157 bash[24585]: audit 2024-09-16T07:10:43.481467+0000 mgr.a (mgr.14373) 4051 : audit [DBG] from='client.97992 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:10:44.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:10:43 smithi086 bash[24289]: audit 2024-09-16T07:10:43.481467+0000 mgr.a (mgr.14373) 4051 : audit [DBG] from='client.97992 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:10:44.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:10:43 smithi047 bash[22744]: audit 2024-09-16T07:10:43.481467+0000 mgr.a (mgr.14373) 4051 : audit [DBG] from='client.97992 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:10:45.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:10:44 smithi157 bash[24585]: cluster 2024-09-16T07:10:43.595904+0000 mgr.a (mgr.14373) 4052 : cluster [DBG] pgmap v2810: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:10:45.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:10:44 smithi086 bash[24289]: cluster 2024-09-16T07:10:43.595904+0000 mgr.a (mgr.14373) 4052 : cluster [DBG] pgmap v2810: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:10:45.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:10:44 smithi047 bash[22744]: cluster 2024-09-16T07:10:43.595904+0000 mgr.a (mgr.14373) 4052 : cluster [DBG] pgmap v2810: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:10:47.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:10:46 smithi157 bash[24585]: cluster 2024-09-16T07:10:45.596769+0000 mgr.a (mgr.14373) 4053 : cluster [DBG] pgmap v2811: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:10:47.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:10:46 smithi086 bash[24289]: cluster 2024-09-16T07:10:45.596769+0000 mgr.a (mgr.14373) 4053 : cluster [DBG] pgmap v2811: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:10:47.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:10:46 smithi047 bash[22744]: cluster 2024-09-16T07:10:45.596769+0000 mgr.a (mgr.14373) 4053 : cluster [DBG] pgmap v2811: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:10:48.916 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:10:48.917 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:10:48.917 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:10:49.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:10:48 smithi157 bash[24585]: cluster 2024-09-16T07:10:47.599017+0000 mgr.a (mgr.14373) 4054 : cluster [DBG] pgmap v2812: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:10:49.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:10:48 smithi086 bash[24289]: cluster 2024-09-16T07:10:47.599017+0000 mgr.a (mgr.14373) 4054 : cluster [DBG] pgmap v2812: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:10:49.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:10:48 smithi047 bash[22744]: cluster 2024-09-16T07:10:47.599017+0000 mgr.a (mgr.14373) 4054 : cluster [DBG] pgmap v2812: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:10:49.686 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:10:49.686 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:10:49.686 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:10:49.686 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:10:49.686 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:10:50.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:10:49 smithi157 bash[24585]: audit 2024-09-16T07:10:49.248963+0000 mgr.a (mgr.14373) 4055 : audit [DBG] from='client.98067 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:10:50.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:10:49 smithi086 bash[24289]: audit 2024-09-16T07:10:49.248963+0000 mgr.a (mgr.14373) 4055 : audit [DBG] from='client.98067 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:10:50.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:10:49 smithi047 bash[22744]: audit 2024-09-16T07:10:49.248963+0000 mgr.a (mgr.14373) 4055 : audit [DBG] from='client.98067 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:10:51.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:10:50 smithi157 bash[24585]: cluster 2024-09-16T07:10:49.599631+0000 mgr.a (mgr.14373) 4056 : cluster [DBG] pgmap v2813: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:10:51.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:10:50 smithi086 bash[24289]: cluster 2024-09-16T07:10:49.599631+0000 mgr.a (mgr.14373) 4056 : cluster [DBG] pgmap v2813: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:10:51.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:10:50 smithi047 bash[22744]: cluster 2024-09-16T07:10:49.599631+0000 mgr.a (mgr.14373) 4056 : cluster [DBG] pgmap v2813: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:10:52.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:10:51 smithi157 bash[24585]: audit 2024-09-16T07:10:51.456124+0000 mon.b (mon.2) 406 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T07:10:52.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:10:51 smithi086 bash[24289]: audit 2024-09-16T07:10:51.456124+0000 mon.b (mon.2) 406 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T07:10:52.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:10:51 smithi047 bash[22744]: audit 2024-09-16T07:10:51.456124+0000 mon.b (mon.2) 406 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T07:10:53.052 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:10:52 smithi047 bash[22744]: cluster 2024-09-16T07:10:51.601916+0000 mgr.a (mgr.14373) 4057 : cluster [DBG] pgmap v2814: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:10:53.052 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:10:52 smithi047 bash[22744]: audit 2024-09-16T07:10:52.305315+0000 mon.b (mon.2) 407 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T07:10:53.052 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:10:52 smithi047 bash[22744]: audit 2024-09-16T07:10:52.307455+0000 mon.b (mon.2) 408 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T07:10:53.052 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:10:52 smithi047 bash[22744]: audit 2024-09-16T07:10:52.320417+0000 mon.a (mon.0) 815 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:10:53.053 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:10:52 smithi047 bash[22744]: audit 2024-09-16T07:10:52.324208+0000 mon.b (mon.2) 409 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:10:53.053 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:10:52 smithi047 bash[22744]: audit 2024-09-16T07:10:52.328788+0000 mgr.a (mgr.14373) 4058 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:10:53.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:10:52 smithi157 bash[24585]: cluster 2024-09-16T07:10:51.601916+0000 mgr.a (mgr.14373) 4057 : cluster [DBG] pgmap v2814: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:10:53.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:10:52 smithi157 bash[24585]: audit 2024-09-16T07:10:52.305315+0000 mon.b (mon.2) 407 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T07:10:53.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:10:52 smithi157 bash[24585]: audit 2024-09-16T07:10:52.307455+0000 mon.b (mon.2) 408 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T07:10:53.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:10:52 smithi157 bash[24585]: audit 2024-09-16T07:10:52.320417+0000 mon.a (mon.0) 815 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:10:53.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:10:52 smithi157 bash[24585]: audit 2024-09-16T07:10:52.324208+0000 mon.b (mon.2) 409 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:10:53.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:10:52 smithi157 bash[24585]: audit 2024-09-16T07:10:52.328788+0000 mgr.a (mgr.14373) 4058 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:10:53.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:10:52 smithi086 bash[24289]: cluster 2024-09-16T07:10:51.601916+0000 mgr.a (mgr.14373) 4057 : cluster [DBG] pgmap v2814: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:10:53.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:10:52 smithi086 bash[24289]: audit 2024-09-16T07:10:52.305315+0000 mon.b (mon.2) 407 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T07:10:53.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:10:52 smithi086 bash[24289]: audit 2024-09-16T07:10:52.307455+0000 mon.b (mon.2) 408 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T07:10:53.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:10:52 smithi086 bash[24289]: audit 2024-09-16T07:10:52.320417+0000 mon.a (mon.0) 815 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:10:53.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:10:52 smithi086 bash[24289]: audit 2024-09-16T07:10:52.324208+0000 mon.b (mon.2) 409 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:10:53.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:10:52 smithi086 bash[24289]: audit 2024-09-16T07:10:52.328788+0000 mgr.a (mgr.14373) 4058 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:10:53.338 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 07:10:53 smithi047 bash[22994]: debug 2024-09-16T07:10:53.050+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T07:10:53.339 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 07:10:53 smithi047 bash[22994]: debug 2024-09-16T07:10:53.050+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T07:10:54.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:10:53 smithi157 bash[24585]: audit 2024-09-16T07:10:53.054757+0000 mgr.a (mgr.14373) 4059 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T07:10:54.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:10:53 smithi157 bash[24585]: cephadm 2024-09-16T07:10:53.057184+0000 mgr.a (mgr.14373) 4060 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T07:10:54.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:10:53 smithi086 bash[24289]: audit 2024-09-16T07:10:53.054757+0000 mgr.a (mgr.14373) 4059 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T07:10:54.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:10:53 smithi086 bash[24289]: cephadm 2024-09-16T07:10:53.057184+0000 mgr.a (mgr.14373) 4060 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T07:10:54.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:10:53 smithi047 bash[22744]: audit 2024-09-16T07:10:53.054757+0000 mgr.a (mgr.14373) 4059 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T07:10:54.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:10:53 smithi047 bash[22744]: cephadm 2024-09-16T07:10:53.057184+0000 mgr.a (mgr.14373) 4060 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T07:10:54.687 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:10:54.688 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:10:54.689 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:10:55.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:10:54 smithi157 bash[24585]: cluster 2024-09-16T07:10:53.602945+0000 mgr.a (mgr.14373) 4061 : cluster [DBG] pgmap v2815: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:10:55.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:10:54 smithi086 bash[24289]: cluster 2024-09-16T07:10:53.602945+0000 mgr.a (mgr.14373) 4061 : cluster [DBG] pgmap v2815: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:10:55.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:10:54 smithi047 bash[22744]: cluster 2024-09-16T07:10:53.602945+0000 mgr.a (mgr.14373) 4061 : cluster [DBG] pgmap v2815: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:10:55.448 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:10:55.449 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:10:55.449 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:10:55.449 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:10:55.449 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:10:56.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:10:55 smithi157 bash[24585]: audit 2024-09-16T07:10:55.027614+0000 mgr.a (mgr.14373) 4062 : audit [DBG] from='client.98253 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:10:56.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:10:55 smithi086 bash[24289]: audit 2024-09-16T07:10:55.027614+0000 mgr.a (mgr.14373) 4062 : audit [DBG] from='client.98253 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:10:56.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:10:55 smithi047 bash[22744]: audit 2024-09-16T07:10:55.027614+0000 mgr.a (mgr.14373) 4062 : audit [DBG] from='client.98253 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:10:57.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:10:56 smithi157 bash[24585]: cluster 2024-09-16T07:10:55.603531+0000 mgr.a (mgr.14373) 4063 : cluster [DBG] pgmap v2816: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:10:57.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:10:56 smithi086 bash[24289]: cluster 2024-09-16T07:10:55.603531+0000 mgr.a (mgr.14373) 4063 : cluster [DBG] pgmap v2816: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:10:57.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:10:56 smithi047 bash[22744]: cluster 2024-09-16T07:10:55.603531+0000 mgr.a (mgr.14373) 4063 : cluster [DBG] pgmap v2816: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:10:59.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:10:58 smithi157 bash[24585]: cluster 2024-09-16T07:10:57.605827+0000 mgr.a (mgr.14373) 4064 : cluster [DBG] pgmap v2817: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:10:59.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:10:58 smithi086 bash[24289]: cluster 2024-09-16T07:10:57.605827+0000 mgr.a (mgr.14373) 4064 : cluster [DBG] pgmap v2817: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:10:59.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:10:58 smithi047 bash[22744]: cluster 2024-09-16T07:10:57.605827+0000 mgr.a (mgr.14373) 4064 : cluster [DBG] pgmap v2817: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:11:00.450 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:11:00.451 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:11:00.451 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:11:01.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:11:00 smithi157 bash[24585]: cluster 2024-09-16T07:10:59.606797+0000 mgr.a (mgr.14373) 4065 : cluster [DBG] pgmap v2818: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:11:01.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:11:00 smithi086 bash[24289]: cluster 2024-09-16T07:10:59.606797+0000 mgr.a (mgr.14373) 4065 : cluster [DBG] pgmap v2818: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:11:01.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:11:00 smithi047 bash[22744]: cluster 2024-09-16T07:10:59.606797+0000 mgr.a (mgr.14373) 4065 : cluster [DBG] pgmap v2818: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:11:01.193 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:11:01.193 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:11:01.193 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:11:01.193 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:11:01.193 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:11:02.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:11:01 smithi157 bash[24585]: audit 2024-09-16T07:11:00.786623+0000 mgr.a (mgr.14373) 4066 : audit [DBG] from='client.98331 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:11:02.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:11:01 smithi086 bash[24289]: audit 2024-09-16T07:11:00.786623+0000 mgr.a (mgr.14373) 4066 : audit [DBG] from='client.98331 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:11:02.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:11:01 smithi047 bash[22744]: audit 2024-09-16T07:11:00.786623+0000 mgr.a (mgr.14373) 4066 : audit [DBG] from='client.98331 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:11:03.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:11:02 smithi157 bash[24585]: cluster 2024-09-16T07:11:01.609240+0000 mgr.a (mgr.14373) 4067 : cluster [DBG] pgmap v2819: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:11:03.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:11:02 smithi086 bash[24289]: cluster 2024-09-16T07:11:01.609240+0000 mgr.a (mgr.14373) 4067 : cluster [DBG] pgmap v2819: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:11:03.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:11:02 smithi047 bash[22744]: cluster 2024-09-16T07:11:01.609240+0000 mgr.a (mgr.14373) 4067 : cluster [DBG] pgmap v2819: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:11:05.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:11:04 smithi157 bash[24585]: cluster 2024-09-16T07:11:03.610187+0000 mgr.a (mgr.14373) 4068 : cluster [DBG] pgmap v2820: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:11:05.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:11:04 smithi086 bash[24289]: cluster 2024-09-16T07:11:03.610187+0000 mgr.a (mgr.14373) 4068 : cluster [DBG] pgmap v2820: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:11:05.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:11:04 smithi047 bash[22744]: cluster 2024-09-16T07:11:03.610187+0000 mgr.a (mgr.14373) 4068 : cluster [DBG] pgmap v2820: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:11:06.194 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:11:06.195 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:11:06.195 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:11:06.933 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:11:06.933 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:11:06.934 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:11:06.934 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:11:06.934 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:11:07.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:11:06 smithi157 bash[24585]: cluster 2024-09-16T07:11:05.611094+0000 mgr.a (mgr.14373) 4069 : cluster [DBG] pgmap v2821: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:11:07.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:11:06 smithi157 bash[24585]: audit 2024-09-16T07:11:06.527492+0000 mgr.a (mgr.14373) 4070 : audit [DBG] from='client.98406 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:11:07.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:11:06 smithi086 bash[24289]: cluster 2024-09-16T07:11:05.611094+0000 mgr.a (mgr.14373) 4069 : cluster [DBG] pgmap v2821: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:11:07.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:11:06 smithi086 bash[24289]: audit 2024-09-16T07:11:06.527492+0000 mgr.a (mgr.14373) 4070 : audit [DBG] from='client.98406 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:11:07.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:11:06 smithi047 bash[22744]: cluster 2024-09-16T07:11:05.611094+0000 mgr.a (mgr.14373) 4069 : cluster [DBG] pgmap v2821: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:11:07.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:11:06 smithi047 bash[22744]: audit 2024-09-16T07:11:06.527492+0000 mgr.a (mgr.14373) 4070 : audit [DBG] from='client.98406 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:11:09.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:11:08 smithi157 bash[24585]: cluster 2024-09-16T07:11:07.614020+0000 mgr.a (mgr.14373) 4071 : cluster [DBG] pgmap v2822: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:11:09.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:11:08 smithi086 bash[24289]: cluster 2024-09-16T07:11:07.614020+0000 mgr.a (mgr.14373) 4071 : cluster [DBG] pgmap v2822: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:11:09.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:11:08 smithi047 bash[22744]: cluster 2024-09-16T07:11:07.614020+0000 mgr.a (mgr.14373) 4071 : cluster [DBG] pgmap v2822: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:11:11.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:11:10 smithi157 bash[24585]: cluster 2024-09-16T07:11:09.615005+0000 mgr.a (mgr.14373) 4072 : cluster [DBG] pgmap v2823: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:11:11.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:11:10 smithi086 bash[24289]: cluster 2024-09-16T07:11:09.615005+0000 mgr.a (mgr.14373) 4072 : cluster [DBG] pgmap v2823: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:11:11.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:11:10 smithi047 bash[22744]: cluster 2024-09-16T07:11:09.615005+0000 mgr.a (mgr.14373) 4072 : cluster [DBG] pgmap v2823: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:11:11.934 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:11:11.935 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:11:11.935 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:11:12.708 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:11:12.708 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:11:12.708 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:11:12.708 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:11:12.708 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:11:13.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:11:12 smithi157 bash[24585]: cluster 2024-09-16T07:11:11.617129+0000 mgr.a (mgr.14373) 4073 : cluster [DBG] pgmap v2824: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:11:13.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:11:12 smithi157 bash[24585]: audit 2024-09-16T07:11:12.272476+0000 mgr.a (mgr.14373) 4074 : audit [DBG] from='client.98484 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:11:13.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:11:12 smithi086 bash[24289]: cluster 2024-09-16T07:11:11.617129+0000 mgr.a (mgr.14373) 4073 : cluster [DBG] pgmap v2824: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:11:13.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:11:12 smithi086 bash[24289]: audit 2024-09-16T07:11:12.272476+0000 mgr.a (mgr.14373) 4074 : audit [DBG] from='client.98484 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:11:13.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:11:12 smithi047 bash[22744]: cluster 2024-09-16T07:11:11.617129+0000 mgr.a (mgr.14373) 4073 : cluster [DBG] pgmap v2824: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:11:13.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:11:12 smithi047 bash[22744]: audit 2024-09-16T07:11:12.272476+0000 mgr.a (mgr.14373) 4074 : audit [DBG] from='client.98484 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:11:15.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:11:14 smithi086 bash[24289]: cluster 2024-09-16T07:11:13.618294+0000 mgr.a (mgr.14373) 4075 : cluster [DBG] pgmap v2825: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:11:15.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:11:14 smithi047 bash[22744]: cluster 2024-09-16T07:11:13.618294+0000 mgr.a (mgr.14373) 4075 : cluster [DBG] pgmap v2825: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:11:15.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:11:14 smithi157 bash[24585]: cluster 2024-09-16T07:11:13.618294+0000 mgr.a (mgr.14373) 4075 : cluster [DBG] pgmap v2825: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:11:17.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:11:16 smithi086 bash[24289]: cluster 2024-09-16T07:11:15.619250+0000 mgr.a (mgr.14373) 4076 : cluster [DBG] pgmap v2826: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:11:17.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:11:16 smithi047 bash[22744]: cluster 2024-09-16T07:11:15.619250+0000 mgr.a (mgr.14373) 4076 : cluster [DBG] pgmap v2826: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:11:17.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:11:16 smithi157 bash[24585]: cluster 2024-09-16T07:11:15.619250+0000 mgr.a (mgr.14373) 4076 : cluster [DBG] pgmap v2826: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:11:17.709 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:11:17.710 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:11:17.710 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:11:18.490 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:11:18.490 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:11:18.490 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:11:18.490 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:11:18.490 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:11:19.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:11:18 smithi086 bash[24289]: cluster 2024-09-16T07:11:17.621592+0000 mgr.a (mgr.14373) 4077 : cluster [DBG] pgmap v2827: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:11:19.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:11:18 smithi086 bash[24289]: audit 2024-09-16T07:11:18.054530+0000 mgr.a (mgr.14373) 4078 : audit [DBG] from='client.98559 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:11:19.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:11:18 smithi047 bash[22744]: cluster 2024-09-16T07:11:17.621592+0000 mgr.a (mgr.14373) 4077 : cluster [DBG] pgmap v2827: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:11:19.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:11:18 smithi047 bash[22744]: audit 2024-09-16T07:11:18.054530+0000 mgr.a (mgr.14373) 4078 : audit [DBG] from='client.98559 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:11:19.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:11:18 smithi157 bash[24585]: cluster 2024-09-16T07:11:17.621592+0000 mgr.a (mgr.14373) 4077 : cluster [DBG] pgmap v2827: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:11:19.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:11:18 smithi157 bash[24585]: audit 2024-09-16T07:11:18.054530+0000 mgr.a (mgr.14373) 4078 : audit [DBG] from='client.98559 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:11:21.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:11:20 smithi086 bash[24289]: cluster 2024-09-16T07:11:19.622559+0000 mgr.a (mgr.14373) 4079 : cluster [DBG] pgmap v2828: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:11:21.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:11:20 smithi047 bash[22744]: cluster 2024-09-16T07:11:19.622559+0000 mgr.a (mgr.14373) 4079 : cluster [DBG] pgmap v2828: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:11:21.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:11:20 smithi157 bash[24585]: cluster 2024-09-16T07:11:19.622559+0000 mgr.a (mgr.14373) 4079 : cluster [DBG] pgmap v2828: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:11:23.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:11:22 smithi047 bash[22744]: cluster 2024-09-16T07:11:21.624713+0000 mgr.a (mgr.14373) 4080 : cluster [DBG] pgmap v2829: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:11:23.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:11:22 smithi157 bash[24585]: cluster 2024-09-16T07:11:21.624713+0000 mgr.a (mgr.14373) 4080 : cluster [DBG] pgmap v2829: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:11:23.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:11:22 smithi086 bash[24289]: cluster 2024-09-16T07:11:21.624713+0000 mgr.a (mgr.14373) 4080 : cluster [DBG] pgmap v2829: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:11:23.491 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:11:23.492 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:11:23.492 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:11:24.250 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:11:24.251 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:11:24.251 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:11:24.251 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:11:24.251 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:11:25.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:11:24 smithi047 bash[22744]: cluster 2024-09-16T07:11:23.625153+0000 mgr.a (mgr.14373) 4081 : cluster [DBG] pgmap v2830: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:11:25.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:11:24 smithi047 bash[22744]: audit 2024-09-16T07:11:23.831519+0000 mgr.a (mgr.14373) 4082 : audit [DBG] from='client.98631 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:11:25.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:11:24 smithi157 bash[24585]: cluster 2024-09-16T07:11:23.625153+0000 mgr.a (mgr.14373) 4081 : cluster [DBG] pgmap v2830: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:11:25.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:11:24 smithi157 bash[24585]: audit 2024-09-16T07:11:23.831519+0000 mgr.a (mgr.14373) 4082 : audit [DBG] from='client.98631 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:11:25.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:11:24 smithi086 bash[24289]: cluster 2024-09-16T07:11:23.625153+0000 mgr.a (mgr.14373) 4081 : cluster [DBG] pgmap v2830: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:11:25.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:11:24 smithi086 bash[24289]: audit 2024-09-16T07:11:23.831519+0000 mgr.a (mgr.14373) 4082 : audit [DBG] from='client.98631 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:11:27.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:11:26 smithi047 bash[22744]: cluster 2024-09-16T07:11:25.625983+0000 mgr.a (mgr.14373) 4083 : cluster [DBG] pgmap v2831: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:11:27.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:11:26 smithi157 bash[24585]: cluster 2024-09-16T07:11:25.625983+0000 mgr.a (mgr.14373) 4083 : cluster [DBG] pgmap v2831: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:11:27.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:11:26 smithi086 bash[24289]: cluster 2024-09-16T07:11:25.625983+0000 mgr.a (mgr.14373) 4083 : cluster [DBG] pgmap v2831: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:11:29.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:11:28 smithi047 bash[22744]: cluster 2024-09-16T07:11:27.628241+0000 mgr.a (mgr.14373) 4084 : cluster [DBG] pgmap v2832: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:11:29.252 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:11:29.253 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:11:29.253 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:11:29.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:11:28 smithi157 bash[24585]: cluster 2024-09-16T07:11:27.628241+0000 mgr.a (mgr.14373) 4084 : cluster [DBG] pgmap v2832: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:11:29.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:11:28 smithi086 bash[24289]: cluster 2024-09-16T07:11:27.628241+0000 mgr.a (mgr.14373) 4084 : cluster [DBG] pgmap v2832: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:11:30.029 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:11:30.030 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:11:30.030 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:11:30.030 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:11:30.030 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:11:31.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:11:30 smithi047 bash[22744]: audit 2024-09-16T07:11:29.588984+0000 mgr.a (mgr.14373) 4085 : audit [DBG] from='client.98709 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:11:31.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:11:30 smithi047 bash[22744]: cluster 2024-09-16T07:11:29.629214+0000 mgr.a (mgr.14373) 4086 : cluster [DBG] pgmap v2833: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:11:31.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:11:30 smithi157 bash[24585]: audit 2024-09-16T07:11:29.588984+0000 mgr.a (mgr.14373) 4085 : audit [DBG] from='client.98709 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:11:31.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:11:30 smithi157 bash[24585]: cluster 2024-09-16T07:11:29.629214+0000 mgr.a (mgr.14373) 4086 : cluster [DBG] pgmap v2833: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:11:31.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:11:30 smithi086 bash[24289]: audit 2024-09-16T07:11:29.588984+0000 mgr.a (mgr.14373) 4085 : audit [DBG] from='client.98709 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:11:31.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:11:30 smithi086 bash[24289]: cluster 2024-09-16T07:11:29.629214+0000 mgr.a (mgr.14373) 4086 : cluster [DBG] pgmap v2833: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:11:33.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:11:32 smithi157 bash[24585]: cluster 2024-09-16T07:11:31.631509+0000 mgr.a (mgr.14373) 4087 : cluster [DBG] pgmap v2834: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:11:33.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:11:32 smithi086 bash[24289]: cluster 2024-09-16T07:11:31.631509+0000 mgr.a (mgr.14373) 4087 : cluster [DBG] pgmap v2834: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:11:33.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:11:32 smithi047 bash[22744]: cluster 2024-09-16T07:11:31.631509+0000 mgr.a (mgr.14373) 4087 : cluster [DBG] pgmap v2834: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:11:35.031 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:11:35.032 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:11:35.032 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:11:35.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:11:34 smithi157 bash[24585]: cluster 2024-09-16T07:11:33.632312+0000 mgr.a (mgr.14373) 4088 : cluster [DBG] pgmap v2835: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:11:35.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:11:34 smithi086 bash[24289]: cluster 2024-09-16T07:11:33.632312+0000 mgr.a (mgr.14373) 4088 : cluster [DBG] pgmap v2835: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:11:35.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:11:34 smithi047 bash[22744]: cluster 2024-09-16T07:11:33.632312+0000 mgr.a (mgr.14373) 4088 : cluster [DBG] pgmap v2835: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:11:35.777 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:11:35.777 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:11:35.778 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:11:35.778 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:11:35.778 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:11:36.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:11:35 smithi157 bash[24585]: audit 2024-09-16T07:11:35.363893+0000 mgr.a (mgr.14373) 4089 : audit [DBG] from='client.98784 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:11:36.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:11:35 smithi086 bash[24289]: audit 2024-09-16T07:11:35.363893+0000 mgr.a (mgr.14373) 4089 : audit [DBG] from='client.98784 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:11:36.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:11:35 smithi047 bash[22744]: audit 2024-09-16T07:11:35.363893+0000 mgr.a (mgr.14373) 4089 : audit [DBG] from='client.98784 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:11:37.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:11:36 smithi157 bash[24585]: cluster 2024-09-16T07:11:35.632813+0000 mgr.a (mgr.14373) 4090 : cluster [DBG] pgmap v2836: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:11:37.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:11:36 smithi086 bash[24289]: cluster 2024-09-16T07:11:35.632813+0000 mgr.a (mgr.14373) 4090 : cluster [DBG] pgmap v2836: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:11:37.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:11:36 smithi047 bash[22744]: cluster 2024-09-16T07:11:35.632813+0000 mgr.a (mgr.14373) 4090 : cluster [DBG] pgmap v2836: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:11:39.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:11:38 smithi157 bash[24585]: cluster 2024-09-16T07:11:37.635128+0000 mgr.a (mgr.14373) 4091 : cluster [DBG] pgmap v2837: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:11:39.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:11:38 smithi086 bash[24289]: cluster 2024-09-16T07:11:37.635128+0000 mgr.a (mgr.14373) 4091 : cluster [DBG] pgmap v2837: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:11:39.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:11:38 smithi047 bash[22744]: cluster 2024-09-16T07:11:37.635128+0000 mgr.a (mgr.14373) 4091 : cluster [DBG] pgmap v2837: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:11:40.779 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:11:40.779 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:11:40.779 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:11:41.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:11:40 smithi157 bash[24585]: cluster 2024-09-16T07:11:39.635885+0000 mgr.a (mgr.14373) 4092 : cluster [DBG] pgmap v2838: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:11:41.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:11:40 smithi086 bash[24289]: cluster 2024-09-16T07:11:39.635885+0000 mgr.a (mgr.14373) 4092 : cluster [DBG] pgmap v2838: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:11:41.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:11:40 smithi047 bash[22744]: cluster 2024-09-16T07:11:39.635885+0000 mgr.a (mgr.14373) 4092 : cluster [DBG] pgmap v2838: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:11:41.544 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:11:41.545 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:11:41.545 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:11:41.545 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:11:41.545 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:11:42.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:11:41 smithi157 bash[24585]: audit 2024-09-16T07:11:41.118034+0000 mgr.a (mgr.14373) 4093 : audit [DBG] from='client.98859 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:11:42.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:11:41 smithi086 bash[24289]: audit 2024-09-16T07:11:41.118034+0000 mgr.a (mgr.14373) 4093 : audit [DBG] from='client.98859 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:11:42.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:11:41 smithi047 bash[22744]: audit 2024-09-16T07:11:41.118034+0000 mgr.a (mgr.14373) 4093 : audit [DBG] from='client.98859 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:11:43.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:11:42 smithi157 bash[24585]: cluster 2024-09-16T07:11:41.638552+0000 mgr.a (mgr.14373) 4094 : cluster [DBG] pgmap v2839: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-16T07:11:43.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:11:42 smithi086 bash[24289]: cluster 2024-09-16T07:11:41.638552+0000 mgr.a (mgr.14373) 4094 : cluster [DBG] pgmap v2839: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-16T07:11:43.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:11:42 smithi047 bash[22744]: cluster 2024-09-16T07:11:41.638552+0000 mgr.a (mgr.14373) 4094 : cluster [DBG] pgmap v2839: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-16T07:11:45.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:11:44 smithi157 bash[24585]: cluster 2024-09-16T07:11:43.639277+0000 mgr.a (mgr.14373) 4095 : cluster [DBG] pgmap v2840: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T07:11:45.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:11:44 smithi086 bash[24289]: cluster 2024-09-16T07:11:43.639277+0000 mgr.a (mgr.14373) 4095 : cluster [DBG] pgmap v2840: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T07:11:45.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:11:44 smithi047 bash[22744]: cluster 2024-09-16T07:11:43.639277+0000 mgr.a (mgr.14373) 4095 : cluster [DBG] pgmap v2840: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T07:11:46.546 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:11:46.547 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:11:46.547 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:11:47.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:11:46 smithi157 bash[24585]: cluster 2024-09-16T07:11:45.640022+0000 mgr.a (mgr.14373) 4096 : cluster [DBG] pgmap v2841: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T07:11:47.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:11:46 smithi086 bash[24289]: cluster 2024-09-16T07:11:45.640022+0000 mgr.a (mgr.14373) 4096 : cluster [DBG] pgmap v2841: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T07:11:47.318 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:11:47.318 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:11:47.318 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:11:47.318 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:11:47.319 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:11:47.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:11:46 smithi047 bash[22744]: cluster 2024-09-16T07:11:45.640022+0000 mgr.a (mgr.14373) 4096 : cluster [DBG] pgmap v2841: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T07:11:48.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:11:47 smithi157 bash[24585]: audit 2024-09-16T07:11:46.883691+0000 mgr.a (mgr.14373) 4097 : audit [DBG] from='client.98934 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:11:48.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:11:47 smithi086 bash[24289]: audit 2024-09-16T07:11:46.883691+0000 mgr.a (mgr.14373) 4097 : audit [DBG] from='client.98934 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:11:48.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:11:47 smithi047 bash[22744]: audit 2024-09-16T07:11:46.883691+0000 mgr.a (mgr.14373) 4097 : audit [DBG] from='client.98934 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:11:49.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:11:48 smithi157 bash[24585]: cluster 2024-09-16T07:11:47.642926+0000 mgr.a (mgr.14373) 4098 : cluster [DBG] pgmap v2842: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:11:49.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:11:48 smithi086 bash[24289]: cluster 2024-09-16T07:11:47.642926+0000 mgr.a (mgr.14373) 4098 : cluster [DBG] pgmap v2842: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:11:49.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:11:48 smithi047 bash[22744]: cluster 2024-09-16T07:11:47.642926+0000 mgr.a (mgr.14373) 4098 : cluster [DBG] pgmap v2842: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:11:51.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:11:50 smithi157 bash[24585]: cluster 2024-09-16T07:11:49.643859+0000 mgr.a (mgr.14373) 4099 : cluster [DBG] pgmap v2843: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:11:51.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:11:50 smithi086 bash[24289]: cluster 2024-09-16T07:11:49.643859+0000 mgr.a (mgr.14373) 4099 : cluster [DBG] pgmap v2843: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:11:51.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:11:50 smithi047 bash[22744]: cluster 2024-09-16T07:11:49.643859+0000 mgr.a (mgr.14373) 4099 : cluster [DBG] pgmap v2843: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:11:52.320 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:11:52.321 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:11:52.321 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:11:53.099 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:11:53.099 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:11:53.099 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:11:53.099 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:11:53.099 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:11:53.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:11:52 smithi157 bash[24585]: cluster 2024-09-16T07:11:51.645949+0000 mgr.a (mgr.14373) 4100 : cluster [DBG] pgmap v2844: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:11:53.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:11:52 smithi086 bash[24289]: cluster 2024-09-16T07:11:51.645949+0000 mgr.a (mgr.14373) 4100 : cluster [DBG] pgmap v2844: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:11:53.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:11:52 smithi047 bash[22744]: cluster 2024-09-16T07:11:51.645949+0000 mgr.a (mgr.14373) 4100 : cluster [DBG] pgmap v2844: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:11:54.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:11:53 smithi157 bash[24585]: audit 2024-09-16T07:11:52.658208+0000 mgr.a (mgr.14373) 4101 : audit [DBG] from='client.99009 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:11:54.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:11:53 smithi157 bash[24585]: audit 2024-09-16T07:11:53.107487+0000 mon.b (mon.2) 410 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T07:11:54.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:11:53 smithi157 bash[24585]: audit 2024-09-16T07:11:53.889819+0000 mon.b (mon.2) 411 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T07:11:54.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:11:53 smithi157 bash[24585]: audit 2024-09-16T07:11:53.891969+0000 mon.b (mon.2) 412 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T07:11:54.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:11:53 smithi086 bash[24289]: audit 2024-09-16T07:11:52.658208+0000 mgr.a (mgr.14373) 4101 : audit [DBG] from='client.99009 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:11:54.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:11:53 smithi086 bash[24289]: audit 2024-09-16T07:11:53.107487+0000 mon.b (mon.2) 410 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T07:11:54.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:11:53 smithi086 bash[24289]: audit 2024-09-16T07:11:53.889819+0000 mon.b (mon.2) 411 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T07:11:54.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:11:53 smithi086 bash[24289]: audit 2024-09-16T07:11:53.891969+0000 mon.b (mon.2) 412 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T07:11:54.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:11:53 smithi047 bash[22744]: audit 2024-09-16T07:11:52.658208+0000 mgr.a (mgr.14373) 4101 : audit [DBG] from='client.99009 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:11:54.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:11:53 smithi047 bash[22744]: audit 2024-09-16T07:11:53.107487+0000 mon.b (mon.2) 410 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T07:11:54.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:11:53 smithi047 bash[22744]: audit 2024-09-16T07:11:53.889819+0000 mon.b (mon.2) 411 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T07:11:54.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:11:53 smithi047 bash[22744]: audit 2024-09-16T07:11:53.891969+0000 mon.b (mon.2) 412 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T07:11:54.910 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 07:11:54 smithi047 bash[22994]: debug 2024-09-16T07:11:54.625+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T07:11:54.910 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 07:11:54 smithi047 bash[22994]: debug 2024-09-16T07:11:54.629+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T07:11:55.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:11:54 smithi157 bash[24585]: cluster 2024-09-16T07:11:53.646918+0000 mgr.a (mgr.14373) 4102 : cluster [DBG] pgmap v2845: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-16T07:11:55.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:11:54 smithi157 bash[24585]: audit 2024-09-16T07:11:53.903094+0000 mon.a (mon.0) 816 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:11:55.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:11:54 smithi157 bash[24585]: audit 2024-09-16T07:11:53.907325+0000 mon.b (mon.2) 413 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:11:55.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:11:54 smithi157 bash[24585]: audit 2024-09-16T07:11:53.912898+0000 mgr.a (mgr.14373) 4103 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:11:55.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:11:54 smithi086 bash[24289]: cluster 2024-09-16T07:11:53.646918+0000 mgr.a (mgr.14373) 4102 : cluster [DBG] pgmap v2845: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-16T07:11:55.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:11:54 smithi086 bash[24289]: audit 2024-09-16T07:11:53.903094+0000 mon.a (mon.0) 816 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:11:55.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:11:54 smithi086 bash[24289]: audit 2024-09-16T07:11:53.907325+0000 mon.b (mon.2) 413 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:11:55.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:11:54 smithi086 bash[24289]: audit 2024-09-16T07:11:53.912898+0000 mgr.a (mgr.14373) 4103 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:11:55.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:11:54 smithi047 bash[22744]: cluster 2024-09-16T07:11:53.646918+0000 mgr.a (mgr.14373) 4102 : cluster [DBG] pgmap v2845: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-16T07:11:55.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:11:54 smithi047 bash[22744]: audit 2024-09-16T07:11:53.903094+0000 mon.a (mon.0) 816 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:11:55.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:11:54 smithi047 bash[22744]: audit 2024-09-16T07:11:53.907325+0000 mon.b (mon.2) 413 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:11:55.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:11:54 smithi047 bash[22744]: audit 2024-09-16T07:11:53.912898+0000 mgr.a (mgr.14373) 4103 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:11:56.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:11:55 smithi157 bash[24585]: audit 2024-09-16T07:11:54.628057+0000 mgr.a (mgr.14373) 4104 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T07:11:56.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:11:55 smithi157 bash[24585]: cephadm 2024-09-16T07:11:54.630666+0000 mgr.a (mgr.14373) 4105 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T07:11:56.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:11:55 smithi086 bash[24289]: audit 2024-09-16T07:11:54.628057+0000 mgr.a (mgr.14373) 4104 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T07:11:56.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:11:55 smithi086 bash[24289]: cephadm 2024-09-16T07:11:54.630666+0000 mgr.a (mgr.14373) 4105 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T07:11:56.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:11:55 smithi047 bash[22744]: audit 2024-09-16T07:11:54.628057+0000 mgr.a (mgr.14373) 4104 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T07:11:56.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:11:55 smithi047 bash[22744]: cephadm 2024-09-16T07:11:54.630666+0000 mgr.a (mgr.14373) 4105 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T07:11:57.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:11:56 smithi157 bash[24585]: cluster 2024-09-16T07:11:55.647826+0000 mgr.a (mgr.14373) 4106 : cluster [DBG] pgmap v2846: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-16T07:11:57.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:11:56 smithi086 bash[24289]: cluster 2024-09-16T07:11:55.647826+0000 mgr.a (mgr.14373) 4106 : cluster [DBG] pgmap v2846: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-16T07:11:57.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:11:56 smithi047 bash[22744]: cluster 2024-09-16T07:11:55.647826+0000 mgr.a (mgr.14373) 4106 : cluster [DBG] pgmap v2846: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-16T07:11:58.100 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:11:58.101 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:11:58.101 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:11:58.876 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:11:58.877 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:11:58.877 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:11:58.877 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:11:58.877 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:11:59.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:11:59 smithi157 bash[24585]: cluster 2024-09-16T07:11:57.650074+0000 mgr.a (mgr.14373) 4107 : cluster [DBG] pgmap v2847: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:11:59.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:11:59 smithi157 bash[24585]: audit 2024-09-16T07:11:58.441374+0000 mgr.a (mgr.14373) 4108 : audit [DBG] from='client.99195 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:11:59.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:11:59 smithi086 bash[24289]: cluster 2024-09-16T07:11:57.650074+0000 mgr.a (mgr.14373) 4107 : cluster [DBG] pgmap v2847: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:11:59.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:11:59 smithi086 bash[24289]: audit 2024-09-16T07:11:58.441374+0000 mgr.a (mgr.14373) 4108 : audit [DBG] from='client.99195 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:11:59.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:11:59 smithi047 bash[22744]: cluster 2024-09-16T07:11:57.650074+0000 mgr.a (mgr.14373) 4107 : cluster [DBG] pgmap v2847: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:11:59.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:11:59 smithi047 bash[22744]: audit 2024-09-16T07:11:58.441374+0000 mgr.a (mgr.14373) 4108 : audit [DBG] from='client.99195 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:12:01.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:12:01 smithi157 bash[24585]: cluster 2024-09-16T07:11:59.651011+0000 mgr.a (mgr.14373) 4109 : cluster [DBG] pgmap v2848: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:12:01.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:12:01 smithi086 bash[24289]: cluster 2024-09-16T07:11:59.651011+0000 mgr.a (mgr.14373) 4109 : cluster [DBG] pgmap v2848: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:12:01.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:12:01 smithi047 bash[22744]: cluster 2024-09-16T07:11:59.651011+0000 mgr.a (mgr.14373) 4109 : cluster [DBG] pgmap v2848: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:12:03.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:12:03 smithi086 bash[24289]: cluster 2024-09-16T07:12:01.653194+0000 mgr.a (mgr.14373) 4110 : cluster [DBG] pgmap v2849: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:12:03.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:12:03 smithi047 bash[22744]: cluster 2024-09-16T07:12:01.653194+0000 mgr.a (mgr.14373) 4110 : cluster [DBG] pgmap v2849: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:12:03.878 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:12:03.879 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:12:03.879 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:12:04.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:12:03 smithi157 bash[24585]: cluster 2024-09-16T07:12:01.653194+0000 mgr.a (mgr.14373) 4110 : cluster [DBG] pgmap v2849: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:12:04.664 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:12:04.664 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:12:04.664 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:12:04.664 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:12:04.664 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:12:05.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:12:05 smithi086 bash[24289]: cluster 2024-09-16T07:12:03.654082+0000 mgr.a (mgr.14373) 4111 : cluster [DBG] pgmap v2850: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:12:05.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:12:05 smithi086 bash[24289]: audit 2024-09-16T07:12:04.221058+0000 mgr.a (mgr.14373) 4112 : audit [DBG] from='client.99273 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:12:05.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:12:05 smithi047 bash[22744]: cluster 2024-09-16T07:12:03.654082+0000 mgr.a (mgr.14373) 4111 : cluster [DBG] pgmap v2850: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:12:05.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:12:05 smithi047 bash[22744]: audit 2024-09-16T07:12:04.221058+0000 mgr.a (mgr.14373) 4112 : audit [DBG] from='client.99273 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:12:06.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:12:05 smithi157 bash[24585]: cluster 2024-09-16T07:12:03.654082+0000 mgr.a (mgr.14373) 4111 : cluster [DBG] pgmap v2850: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:12:06.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:12:05 smithi157 bash[24585]: audit 2024-09-16T07:12:04.221058+0000 mgr.a (mgr.14373) 4112 : audit [DBG] from='client.99273 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:12:07.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:12:07 smithi086 bash[24289]: cluster 2024-09-16T07:12:05.654999+0000 mgr.a (mgr.14373) 4113 : cluster [DBG] pgmap v2851: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:12:07.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:12:07 smithi047 bash[22744]: cluster 2024-09-16T07:12:05.654999+0000 mgr.a (mgr.14373) 4113 : cluster [DBG] pgmap v2851: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:12:08.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:12:07 smithi157 bash[24585]: cluster 2024-09-16T07:12:05.654999+0000 mgr.a (mgr.14373) 4113 : cluster [DBG] pgmap v2851: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:12:09.665 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:12:09.666 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:12:09.666 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:12:09.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:12:09 smithi086 bash[24289]: cluster 2024-09-16T07:12:07.657293+0000 mgr.a (mgr.14373) 4114 : cluster [DBG] pgmap v2852: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:12:09.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:12:09 smithi047 bash[22744]: cluster 2024-09-16T07:12:07.657293+0000 mgr.a (mgr.14373) 4114 : cluster [DBG] pgmap v2852: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:12:10.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:12:09 smithi157 bash[24585]: cluster 2024-09-16T07:12:07.657293+0000 mgr.a (mgr.14373) 4114 : cluster [DBG] pgmap v2852: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:12:10.401 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:12:10.401 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:12:10.401 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:12:10.401 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:12:10.401 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:12:11.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:12:11 smithi047 bash[22744]: cluster 2024-09-16T07:12:09.658117+0000 mgr.a (mgr.14373) 4115 : cluster [DBG] pgmap v2853: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:12:11.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:12:11 smithi047 bash[22744]: audit 2024-09-16T07:12:09.995439+0000 mgr.a (mgr.14373) 4116 : audit [DBG] from='client.99351 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:12:12.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:12:11 smithi157 bash[24585]: cluster 2024-09-16T07:12:09.658117+0000 mgr.a (mgr.14373) 4115 : cluster [DBG] pgmap v2853: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:12:12.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:12:11 smithi157 bash[24585]: audit 2024-09-16T07:12:09.995439+0000 mgr.a (mgr.14373) 4116 : audit [DBG] from='client.99351 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:12:12.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:12:11 smithi086 bash[24289]: cluster 2024-09-16T07:12:09.658117+0000 mgr.a (mgr.14373) 4115 : cluster [DBG] pgmap v2853: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:12:12.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:12:11 smithi086 bash[24289]: audit 2024-09-16T07:12:09.995439+0000 mgr.a (mgr.14373) 4116 : audit [DBG] from='client.99351 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:12:13.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:12:13 smithi047 bash[22744]: cluster 2024-09-16T07:12:11.660412+0000 mgr.a (mgr.14373) 4117 : cluster [DBG] pgmap v2854: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:12:14.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:12:13 smithi157 bash[24585]: cluster 2024-09-16T07:12:11.660412+0000 mgr.a (mgr.14373) 4117 : cluster [DBG] pgmap v2854: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:12:14.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:12:13 smithi086 bash[24289]: cluster 2024-09-16T07:12:11.660412+0000 mgr.a (mgr.14373) 4117 : cluster [DBG] pgmap v2854: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:12:15.402 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:12:15.403 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:12:15.403 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:12:15.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:12:15 smithi047 bash[22744]: cluster 2024-09-16T07:12:13.661175+0000 mgr.a (mgr.14373) 4118 : cluster [DBG] pgmap v2855: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:12:16.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:12:15 smithi157 bash[24585]: cluster 2024-09-16T07:12:13.661175+0000 mgr.a (mgr.14373) 4118 : cluster [DBG] pgmap v2855: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:12:16.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:12:15 smithi086 bash[24289]: cluster 2024-09-16T07:12:13.661175+0000 mgr.a (mgr.14373) 4118 : cluster [DBG] pgmap v2855: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:12:16.148 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:12:16.148 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:12:16.148 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:12:16.148 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:12:16.148 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:12:17.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:12:17 smithi047 bash[22744]: cluster 2024-09-16T07:12:15.661979+0000 mgr.a (mgr.14373) 4119 : cluster [DBG] pgmap v2856: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:12:17.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:12:17 smithi047 bash[22744]: audit 2024-09-16T07:12:15.737463+0000 mgr.a (mgr.14373) 4120 : audit [DBG] from='client.99426 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:12:18.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:12:17 smithi157 bash[24585]: cluster 2024-09-16T07:12:15.661979+0000 mgr.a (mgr.14373) 4119 : cluster [DBG] pgmap v2856: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:12:18.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:12:17 smithi157 bash[24585]: audit 2024-09-16T07:12:15.737463+0000 mgr.a (mgr.14373) 4120 : audit [DBG] from='client.99426 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:12:18.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:12:17 smithi086 bash[24289]: cluster 2024-09-16T07:12:15.661979+0000 mgr.a (mgr.14373) 4119 : cluster [DBG] pgmap v2856: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:12:18.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:12:17 smithi086 bash[24289]: audit 2024-09-16T07:12:15.737463+0000 mgr.a (mgr.14373) 4120 : audit [DBG] from='client.99426 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:12:19.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:12:19 smithi047 bash[22744]: cluster 2024-09-16T07:12:17.664331+0000 mgr.a (mgr.14373) 4121 : cluster [DBG] pgmap v2857: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:12:20.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:12:19 smithi157 bash[24585]: cluster 2024-09-16T07:12:17.664331+0000 mgr.a (mgr.14373) 4121 : cluster [DBG] pgmap v2857: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:12:20.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:12:19 smithi086 bash[24289]: cluster 2024-09-16T07:12:17.664331+0000 mgr.a (mgr.14373) 4121 : cluster [DBG] pgmap v2857: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:12:21.149 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:12:21.150 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:12:21.150 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:12:21.920 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:12:21.920 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:12:21.920 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:12:21.920 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:12:21.920 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:12:22.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:12:21 smithi157 bash[24585]: cluster 2024-09-16T07:12:19.665272+0000 mgr.a (mgr.14373) 4122 : cluster [DBG] pgmap v2858: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:12:22.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:12:21 smithi086 bash[24289]: cluster 2024-09-16T07:12:19.665272+0000 mgr.a (mgr.14373) 4122 : cluster [DBG] pgmap v2858: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:12:22.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:12:21 smithi047 bash[22744]: cluster 2024-09-16T07:12:19.665272+0000 mgr.a (mgr.14373) 4122 : cluster [DBG] pgmap v2858: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:12:23.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:12:22 smithi157 bash[24585]: audit 2024-09-16T07:12:21.485660+0000 mgr.a (mgr.14373) 4123 : audit [DBG] from='client.99504 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:12:23.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:12:22 smithi086 bash[24289]: audit 2024-09-16T07:12:21.485660+0000 mgr.a (mgr.14373) 4123 : audit [DBG] from='client.99504 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:12:23.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:12:22 smithi047 bash[22744]: audit 2024-09-16T07:12:21.485660+0000 mgr.a (mgr.14373) 4123 : audit [DBG] from='client.99504 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:12:24.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:12:23 smithi157 bash[24585]: cluster 2024-09-16T07:12:21.667085+0000 mgr.a (mgr.14373) 4124 : cluster [DBG] pgmap v2859: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:12:24.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:12:23 smithi086 bash[24289]: cluster 2024-09-16T07:12:21.667085+0000 mgr.a (mgr.14373) 4124 : cluster [DBG] pgmap v2859: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:12:24.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:12:23 smithi047 bash[22744]: cluster 2024-09-16T07:12:21.667085+0000 mgr.a (mgr.14373) 4124 : cluster [DBG] pgmap v2859: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:12:25.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:12:24 smithi157 bash[24585]: cluster 2024-09-16T07:12:23.667950+0000 mgr.a (mgr.14373) 4125 : cluster [DBG] pgmap v2860: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:12:25.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:12:24 smithi086 bash[24289]: cluster 2024-09-16T07:12:23.667950+0000 mgr.a (mgr.14373) 4125 : cluster [DBG] pgmap v2860: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:12:25.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:12:24 smithi047 bash[22744]: cluster 2024-09-16T07:12:23.667950+0000 mgr.a (mgr.14373) 4125 : cluster [DBG] pgmap v2860: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:12:26.921 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:12:26.922 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:12:26.922 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:12:27.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:12:26 smithi157 bash[24585]: cluster 2024-09-16T07:12:25.668752+0000 mgr.a (mgr.14373) 4126 : cluster [DBG] pgmap v2861: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T07:12:27.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:12:26 smithi086 bash[24289]: cluster 2024-09-16T07:12:25.668752+0000 mgr.a (mgr.14373) 4126 : cluster [DBG] pgmap v2861: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T07:12:27.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:12:26 smithi047 bash[22744]: cluster 2024-09-16T07:12:25.668752+0000 mgr.a (mgr.14373) 4126 : cluster [DBG] pgmap v2861: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T07:12:27.694 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:12:27.695 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:12:27.695 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:12:27.695 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:12:27.695 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:12:28.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:12:27 smithi157 bash[24585]: audit 2024-09-16T07:12:27.262594+0000 mgr.a (mgr.14373) 4127 : audit [DBG] from='client.99582 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:12:28.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:12:27 smithi086 bash[24289]: audit 2024-09-16T07:12:27.262594+0000 mgr.a (mgr.14373) 4127 : audit [DBG] from='client.99582 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:12:28.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:12:27 smithi047 bash[22744]: audit 2024-09-16T07:12:27.262594+0000 mgr.a (mgr.14373) 4127 : audit [DBG] from='client.99582 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:12:29.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:12:28 smithi157 bash[24585]: cluster 2024-09-16T07:12:27.669959+0000 mgr.a (mgr.14373) 4128 : cluster [DBG] pgmap v2862: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:12:29.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:12:28 smithi086 bash[24289]: cluster 2024-09-16T07:12:27.669959+0000 mgr.a (mgr.14373) 4128 : cluster [DBG] pgmap v2862: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:12:29.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:12:28 smithi047 bash[22744]: cluster 2024-09-16T07:12:27.669959+0000 mgr.a (mgr.14373) 4128 : cluster [DBG] pgmap v2862: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:12:31.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:12:30 smithi157 bash[24585]: cluster 2024-09-16T07:12:29.670708+0000 mgr.a (mgr.14373) 4129 : cluster [DBG] pgmap v2863: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T07:12:31.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:12:30 smithi086 bash[24289]: cluster 2024-09-16T07:12:29.670708+0000 mgr.a (mgr.14373) 4129 : cluster [DBG] pgmap v2863: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T07:12:31.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:12:30 smithi047 bash[22744]: cluster 2024-09-16T07:12:29.670708+0000 mgr.a (mgr.14373) 4129 : cluster [DBG] pgmap v2863: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T07:12:32.696 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:12:32.697 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:12:32.697 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:12:33.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:12:32 smithi157 bash[24585]: cluster 2024-09-16T07:12:31.672650+0000 mgr.a (mgr.14373) 4130 : cluster [DBG] pgmap v2864: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:12:33.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:12:32 smithi086 bash[24289]: cluster 2024-09-16T07:12:31.672650+0000 mgr.a (mgr.14373) 4130 : cluster [DBG] pgmap v2864: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:12:33.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:12:32 smithi047 bash[22744]: cluster 2024-09-16T07:12:31.672650+0000 mgr.a (mgr.14373) 4130 : cluster [DBG] pgmap v2864: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:12:33.435 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:12:33.435 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:12:33.436 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:12:33.436 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:12:33.436 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:12:34.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:12:33 smithi157 bash[24585]: audit 2024-09-16T07:12:33.030830+0000 mgr.a (mgr.14373) 4131 : audit [DBG] from='client.99651 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:12:34.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:12:33 smithi086 bash[24289]: audit 2024-09-16T07:12:33.030830+0000 mgr.a (mgr.14373) 4131 : audit [DBG] from='client.99651 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:12:34.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:12:33 smithi047 bash[22744]: audit 2024-09-16T07:12:33.030830+0000 mgr.a (mgr.14373) 4131 : audit [DBG] from='client.99651 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:12:35.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:12:34 smithi157 bash[24585]: cluster 2024-09-16T07:12:33.673642+0000 mgr.a (mgr.14373) 4132 : cluster [DBG] pgmap v2865: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:12:35.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:12:34 smithi086 bash[24289]: cluster 2024-09-16T07:12:33.673642+0000 mgr.a (mgr.14373) 4132 : cluster [DBG] pgmap v2865: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:12:35.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:12:34 smithi047 bash[22744]: cluster 2024-09-16T07:12:33.673642+0000 mgr.a (mgr.14373) 4132 : cluster [DBG] pgmap v2865: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:12:37.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:12:36 smithi157 bash[24585]: cluster 2024-09-16T07:12:35.674426+0000 mgr.a (mgr.14373) 4133 : cluster [DBG] pgmap v2866: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:12:37.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:12:36 smithi086 bash[24289]: cluster 2024-09-16T07:12:35.674426+0000 mgr.a (mgr.14373) 4133 : cluster [DBG] pgmap v2866: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:12:37.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:12:36 smithi047 bash[22744]: cluster 2024-09-16T07:12:35.674426+0000 mgr.a (mgr.14373) 4133 : cluster [DBG] pgmap v2866: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:12:38.437 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:12:38.437 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:12:38.438 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:12:39.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:12:38 smithi157 bash[24585]: cluster 2024-09-16T07:12:37.676646+0000 mgr.a (mgr.14373) 4134 : cluster [DBG] pgmap v2867: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:12:39.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:12:38 smithi086 bash[24289]: cluster 2024-09-16T07:12:37.676646+0000 mgr.a (mgr.14373) 4134 : cluster [DBG] pgmap v2867: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:12:39.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:12:38 smithi047 bash[22744]: cluster 2024-09-16T07:12:37.676646+0000 mgr.a (mgr.14373) 4134 : cluster [DBG] pgmap v2867: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:12:39.199 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:12:39.199 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:12:39.199 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:12:39.200 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:12:39.200 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:12:40.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:12:39 smithi157 bash[24585]: audit 2024-09-16T07:12:38.772404+0000 mgr.a (mgr.14373) 4135 : audit [DBG] from='client.99726 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:12:40.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:12:39 smithi086 bash[24289]: audit 2024-09-16T07:12:38.772404+0000 mgr.a (mgr.14373) 4135 : audit [DBG] from='client.99726 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:12:40.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:12:39 smithi047 bash[22744]: audit 2024-09-16T07:12:38.772404+0000 mgr.a (mgr.14373) 4135 : audit [DBG] from='client.99726 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:12:41.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:12:40 smithi157 bash[24585]: cluster 2024-09-16T07:12:39.677504+0000 mgr.a (mgr.14373) 4136 : cluster [DBG] pgmap v2868: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:12:41.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:12:40 smithi086 bash[24289]: cluster 2024-09-16T07:12:39.677504+0000 mgr.a (mgr.14373) 4136 : cluster [DBG] pgmap v2868: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:12:41.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:12:40 smithi047 bash[22744]: cluster 2024-09-16T07:12:39.677504+0000 mgr.a (mgr.14373) 4136 : cluster [DBG] pgmap v2868: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:12:43.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:12:43 smithi086 bash[24289]: cluster 2024-09-16T07:12:41.679633+0000 mgr.a (mgr.14373) 4137 : cluster [DBG] pgmap v2869: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:12:43.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:12:43 smithi047 bash[22744]: cluster 2024-09-16T07:12:41.679633+0000 mgr.a (mgr.14373) 4137 : cluster [DBG] pgmap v2869: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:12:44.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:12:43 smithi157 bash[24585]: cluster 2024-09-16T07:12:41.679633+0000 mgr.a (mgr.14373) 4137 : cluster [DBG] pgmap v2869: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:12:44.201 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:12:44.202 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:12:44.202 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:12:44.977 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:12:44.977 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:12:44.977 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:12:44.977 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:12:44.977 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:12:45.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:12:45 smithi086 bash[24289]: cluster 2024-09-16T07:12:43.680380+0000 mgr.a (mgr.14373) 4138 : cluster [DBG] pgmap v2870: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:12:45.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:12:45 smithi086 bash[24289]: audit 2024-09-16T07:12:44.541424+0000 mgr.a (mgr.14373) 4139 : audit [DBG] from='client.99801 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:12:45.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:12:45 smithi047 bash[22744]: cluster 2024-09-16T07:12:43.680380+0000 mgr.a (mgr.14373) 4138 : cluster [DBG] pgmap v2870: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:12:45.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:12:45 smithi047 bash[22744]: audit 2024-09-16T07:12:44.541424+0000 mgr.a (mgr.14373) 4139 : audit [DBG] from='client.99801 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:12:46.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:12:45 smithi157 bash[24585]: cluster 2024-09-16T07:12:43.680380+0000 mgr.a (mgr.14373) 4138 : cluster [DBG] pgmap v2870: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:12:46.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:12:45 smithi157 bash[24585]: audit 2024-09-16T07:12:44.541424+0000 mgr.a (mgr.14373) 4139 : audit [DBG] from='client.99801 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:12:47.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:12:47 smithi086 bash[24289]: cluster 2024-09-16T07:12:45.681291+0000 mgr.a (mgr.14373) 4140 : cluster [DBG] pgmap v2871: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:12:47.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:12:47 smithi047 bash[22744]: cluster 2024-09-16T07:12:45.681291+0000 mgr.a (mgr.14373) 4140 : cluster [DBG] pgmap v2871: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:12:48.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:12:47 smithi157 bash[24585]: cluster 2024-09-16T07:12:45.681291+0000 mgr.a (mgr.14373) 4140 : cluster [DBG] pgmap v2871: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:12:49.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:12:49 smithi047 bash[22744]: cluster 2024-09-16T07:12:47.683532+0000 mgr.a (mgr.14373) 4141 : cluster [DBG] pgmap v2872: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:12:49.978 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:12:49.979 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:12:49.979 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:12:50.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:12:49 smithi157 bash[24585]: cluster 2024-09-16T07:12:47.683532+0000 mgr.a (mgr.14373) 4141 : cluster [DBG] pgmap v2872: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:12:50.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:12:49 smithi086 bash[24289]: cluster 2024-09-16T07:12:47.683532+0000 mgr.a (mgr.14373) 4141 : cluster [DBG] pgmap v2872: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:12:50.760 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:12:50.761 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:12:50.761 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:12:50.761 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:12:50.761 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:12:51.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:12:51 smithi047 bash[22744]: cluster 2024-09-16T07:12:49.684310+0000 mgr.a (mgr.14373) 4142 : cluster [DBG] pgmap v2873: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:12:51.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:12:51 smithi047 bash[22744]: audit 2024-09-16T07:12:50.319263+0000 mgr.a (mgr.14373) 4143 : audit [DBG] from='client.99879 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:12:52.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:12:51 smithi157 bash[24585]: cluster 2024-09-16T07:12:49.684310+0000 mgr.a (mgr.14373) 4142 : cluster [DBG] pgmap v2873: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:12:52.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:12:51 smithi157 bash[24585]: audit 2024-09-16T07:12:50.319263+0000 mgr.a (mgr.14373) 4143 : audit [DBG] from='client.99879 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:12:52.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:12:51 smithi086 bash[24289]: cluster 2024-09-16T07:12:49.684310+0000 mgr.a (mgr.14373) 4142 : cluster [DBG] pgmap v2873: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:12:52.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:12:51 smithi086 bash[24289]: audit 2024-09-16T07:12:50.319263+0000 mgr.a (mgr.14373) 4143 : audit [DBG] from='client.99879 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:12:53.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:12:53 smithi047 bash[22744]: cluster 2024-09-16T07:12:51.686661+0000 mgr.a (mgr.14373) 4144 : cluster [DBG] pgmap v2874: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:12:54.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:12:53 smithi157 bash[24585]: cluster 2024-09-16T07:12:51.686661+0000 mgr.a (mgr.14373) 4144 : cluster [DBG] pgmap v2874: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:12:54.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:12:53 smithi086 bash[24289]: cluster 2024-09-16T07:12:51.686661+0000 mgr.a (mgr.14373) 4144 : cluster [DBG] pgmap v2874: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:12:55.762 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:12:55.762 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:12:55.763 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:12:55.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:12:55 smithi047 bash[22744]: cluster 2024-09-16T07:12:53.687388+0000 mgr.a (mgr.14373) 4145 : cluster [DBG] pgmap v2875: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:12:55.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:12:55 smithi047 bash[22744]: audit 2024-09-16T07:12:54.683100+0000 mon.b (mon.2) 414 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T07:12:56.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:12:55 smithi157 bash[24585]: cluster 2024-09-16T07:12:53.687388+0000 mgr.a (mgr.14373) 4145 : cluster [DBG] pgmap v2875: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:12:56.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:12:55 smithi157 bash[24585]: audit 2024-09-16T07:12:54.683100+0000 mon.b (mon.2) 414 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T07:12:56.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:12:55 smithi086 bash[24289]: cluster 2024-09-16T07:12:53.687388+0000 mgr.a (mgr.14373) 4145 : cluster [DBG] pgmap v2875: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:12:56.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:12:55 smithi086 bash[24289]: audit 2024-09-16T07:12:54.683100+0000 mon.b (mon.2) 414 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T07:12:56.513 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:12:56.513 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:12:56.514 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:12:56.514 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:12:56.514 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:12:57.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:12:57 smithi047 bash[22744]: cluster 2024-09-16T07:12:55.688145+0000 mgr.a (mgr.14373) 4146 : cluster [DBG] pgmap v2876: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:12:57.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:12:57 smithi047 bash[22744]: audit 2024-09-16T07:12:56.094190+0000 mgr.a (mgr.14373) 4147 : audit [DBG] from='client.99954 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:12:58.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:12:57 smithi157 bash[24585]: cluster 2024-09-16T07:12:55.688145+0000 mgr.a (mgr.14373) 4146 : cluster [DBG] pgmap v2876: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:12:58.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:12:57 smithi157 bash[24585]: audit 2024-09-16T07:12:56.094190+0000 mgr.a (mgr.14373) 4147 : audit [DBG] from='client.99954 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:12:58.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:12:57 smithi086 bash[24289]: cluster 2024-09-16T07:12:55.688145+0000 mgr.a (mgr.14373) 4146 : cluster [DBG] pgmap v2876: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:12:58.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:12:57 smithi086 bash[24289]: audit 2024-09-16T07:12:56.094190+0000 mgr.a (mgr.14373) 4147 : audit [DBG] from='client.99954 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:13:00.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:12:59 smithi157 bash[24585]: cluster 2024-09-16T07:12:57.690592+0000 mgr.a (mgr.14373) 4148 : cluster [DBG] pgmap v2877: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-16T07:13:00.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:12:59 smithi086 bash[24289]: cluster 2024-09-16T07:12:57.690592+0000 mgr.a (mgr.14373) 4148 : cluster [DBG] pgmap v2877: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-16T07:13:00.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:12:59 smithi047 bash[22744]: cluster 2024-09-16T07:12:57.690592+0000 mgr.a (mgr.14373) 4148 : cluster [DBG] pgmap v2877: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-16T07:13:01.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:13:01 smithi157 bash[24585]: cluster 2024-09-16T07:12:59.691374+0000 mgr.a (mgr.14373) 4149 : cluster [DBG] pgmap v2878: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T07:13:01.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:13:01 smithi157 bash[24585]: audit 2024-09-16T07:13:00.044484+0000 mon.a (mon.0) 817 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:13:01.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:13:01 smithi157 bash[24585]: audit 2024-09-16T07:13:00.050121+0000 mon.a (mon.0) 818 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:13:01.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:13:01 smithi157 bash[24585]: audit 2024-09-16T07:13:00.053110+0000 mon.a (mon.0) 819 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:13:01.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:13:01 smithi157 bash[24585]: audit 2024-09-16T07:13:00.059451+0000 mon.a (mon.0) 820 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:13:01.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:13:01 smithi157 bash[24585]: audit 2024-09-16T07:13:00.064165+0000 mon.a (mon.0) 821 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:13:01.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:13:01 smithi157 bash[24585]: audit 2024-09-16T07:13:00.070106+0000 mon.a (mon.0) 822 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:13:01.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:13:01 smithi157 bash[24585]: audit 2024-09-16T07:13:00.811016+0000 mon.b (mon.2) 415 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T07:13:01.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:13:01 smithi157 bash[24585]: audit 2024-09-16T07:13:00.813323+0000 mon.b (mon.2) 416 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T07:13:01.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:13:01 smithi157 bash[24585]: audit 2024-09-16T07:13:00.824663+0000 mon.a (mon.0) 823 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:13:01.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:13:01 smithi157 bash[24585]: audit 2024-09-16T07:13:00.830335+0000 mon.b (mon.2) 417 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:13:01.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:13:01 smithi086 bash[24289]: cluster 2024-09-16T07:12:59.691374+0000 mgr.a (mgr.14373) 4149 : cluster [DBG] pgmap v2878: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T07:13:01.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:13:01 smithi086 bash[24289]: audit 2024-09-16T07:13:00.044484+0000 mon.a (mon.0) 817 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:13:01.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:13:01 smithi086 bash[24289]: audit 2024-09-16T07:13:00.050121+0000 mon.a (mon.0) 818 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:13:01.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:13:01 smithi086 bash[24289]: audit 2024-09-16T07:13:00.053110+0000 mon.a (mon.0) 819 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:13:01.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:13:01 smithi086 bash[24289]: audit 2024-09-16T07:13:00.059451+0000 mon.a (mon.0) 820 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:13:01.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:13:01 smithi086 bash[24289]: audit 2024-09-16T07:13:00.064165+0000 mon.a (mon.0) 821 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:13:01.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:13:01 smithi086 bash[24289]: audit 2024-09-16T07:13:00.070106+0000 mon.a (mon.0) 822 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:13:01.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:13:01 smithi086 bash[24289]: audit 2024-09-16T07:13:00.811016+0000 mon.b (mon.2) 415 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T07:13:01.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:13:01 smithi086 bash[24289]: audit 2024-09-16T07:13:00.813323+0000 mon.b (mon.2) 416 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T07:13:01.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:13:01 smithi086 bash[24289]: audit 2024-09-16T07:13:00.824663+0000 mon.a (mon.0) 823 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:13:01.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:13:01 smithi086 bash[24289]: audit 2024-09-16T07:13:00.830335+0000 mon.b (mon.2) 417 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:13:01.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:13:01 smithi047 bash[22744]: cluster 2024-09-16T07:12:59.691374+0000 mgr.a (mgr.14373) 4149 : cluster [DBG] pgmap v2878: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T07:13:01.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:13:01 smithi047 bash[22744]: audit 2024-09-16T07:13:00.044484+0000 mon.a (mon.0) 817 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:13:01.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:13:01 smithi047 bash[22744]: audit 2024-09-16T07:13:00.050121+0000 mon.a (mon.0) 818 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:13:01.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:13:01 smithi047 bash[22744]: audit 2024-09-16T07:13:00.053110+0000 mon.a (mon.0) 819 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:13:01.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:13:01 smithi047 bash[22744]: audit 2024-09-16T07:13:00.059451+0000 mon.a (mon.0) 820 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:13:01.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:13:01 smithi047 bash[22744]: audit 2024-09-16T07:13:00.064165+0000 mon.a (mon.0) 821 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:13:01.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:13:01 smithi047 bash[22744]: audit 2024-09-16T07:13:00.070106+0000 mon.a (mon.0) 822 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:13:01.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:13:01 smithi047 bash[22744]: audit 2024-09-16T07:13:00.811016+0000 mon.b (mon.2) 415 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T07:13:01.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:13:01 smithi047 bash[22744]: audit 2024-09-16T07:13:00.813323+0000 mon.b (mon.2) 416 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T07:13:01.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:13:01 smithi047 bash[22744]: audit 2024-09-16T07:13:00.824663+0000 mon.a (mon.0) 823 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:13:01.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:13:01 smithi047 bash[22744]: audit 2024-09-16T07:13:00.830335+0000 mon.b (mon.2) 417 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:13:01.514 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:13:01.515 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:13:01.515 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:13:01.838 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 07:13:01 smithi047 bash[22994]: debug 2024-09-16T07:13:01.559+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T07:13:01.839 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 07:13:01 smithi047 bash[22994]: debug 2024-09-16T07:13:01.563+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T07:13:02.241 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:13:02.242 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:13:02.242 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:13:02.242 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:13:02.242 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:13:02.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:13:02 smithi157 bash[24585]: audit 2024-09-16T07:13:00.834414+0000 mgr.a (mgr.14373) 4150 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:13:02.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:13:02 smithi157 bash[24585]: audit 2024-09-16T07:13:01.565907+0000 mgr.a (mgr.14373) 4151 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T07:13:02.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:13:02 smithi157 bash[24585]: cephadm 2024-09-16T07:13:01.567962+0000 mgr.a (mgr.14373) 4152 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T07:13:02.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:13:02 smithi086 bash[24289]: audit 2024-09-16T07:13:00.834414+0000 mgr.a (mgr.14373) 4150 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:13:02.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:13:02 smithi086 bash[24289]: audit 2024-09-16T07:13:01.565907+0000 mgr.a (mgr.14373) 4151 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T07:13:02.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:13:02 smithi086 bash[24289]: cephadm 2024-09-16T07:13:01.567962+0000 mgr.a (mgr.14373) 4152 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T07:13:02.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:13:02 smithi047 bash[22744]: audit 2024-09-16T07:13:00.834414+0000 mgr.a (mgr.14373) 4150 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:13:02.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:13:02 smithi047 bash[22744]: audit 2024-09-16T07:13:01.565907+0000 mgr.a (mgr.14373) 4151 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T07:13:02.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:13:02 smithi047 bash[22744]: cephadm 2024-09-16T07:13:01.567962+0000 mgr.a (mgr.14373) 4152 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T07:13:03.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:13:03 smithi157 bash[24585]: cluster 2024-09-16T07:13:01.693650+0000 mgr.a (mgr.14373) 4153 : cluster [DBG] pgmap v2879: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 3.9 KiB/s rd, 255 B/s wr, 4 op/s 2024-09-16T07:13:03.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:13:03 smithi157 bash[24585]: audit 2024-09-16T07:13:01.832904+0000 mgr.a (mgr.14373) 4154 : audit [DBG] from='client.100140 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:13:03.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:13:03 smithi086 bash[24289]: cluster 2024-09-16T07:13:01.693650+0000 mgr.a (mgr.14373) 4153 : cluster [DBG] pgmap v2879: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 3.9 KiB/s rd, 255 B/s wr, 4 op/s 2024-09-16T07:13:03.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:13:03 smithi086 bash[24289]: audit 2024-09-16T07:13:01.832904+0000 mgr.a (mgr.14373) 4154 : audit [DBG] from='client.100140 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:13:03.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:13:03 smithi047 bash[22744]: cluster 2024-09-16T07:13:01.693650+0000 mgr.a (mgr.14373) 4153 : cluster [DBG] pgmap v2879: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 3.9 KiB/s rd, 255 B/s wr, 4 op/s 2024-09-16T07:13:03.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:13:03 smithi047 bash[22744]: audit 2024-09-16T07:13:01.832904+0000 mgr.a (mgr.14373) 4154 : audit [DBG] from='client.100140 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:13:05.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:13:05 smithi086 bash[24289]: cluster 2024-09-16T07:13:03.694569+0000 mgr.a (mgr.14373) 4155 : cluster [DBG] pgmap v2880: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 3.0 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-16T07:13:05.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:13:05 smithi047 bash[22744]: cluster 2024-09-16T07:13:03.694569+0000 mgr.a (mgr.14373) 4155 : cluster [DBG] pgmap v2880: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 3.0 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-16T07:13:05.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:13:05 smithi157 bash[24585]: cluster 2024-09-16T07:13:03.694569+0000 mgr.a (mgr.14373) 4155 : cluster [DBG] pgmap v2880: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 3.0 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-16T07:13:07.243 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:13:07.243 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:13:07.243 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:13:07.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:13:07 smithi086 bash[24289]: cluster 2024-09-16T07:13:05.695380+0000 mgr.a (mgr.14373) 4156 : cluster [DBG] pgmap v2881: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 3.0 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-16T07:13:07.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:13:07 smithi047 bash[22744]: cluster 2024-09-16T07:13:05.695380+0000 mgr.a (mgr.14373) 4156 : cluster [DBG] pgmap v2881: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 3.0 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-16T07:13:07.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:13:07 smithi157 bash[24585]: cluster 2024-09-16T07:13:05.695380+0000 mgr.a (mgr.14373) 4156 : cluster [DBG] pgmap v2881: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 3.0 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-16T07:13:08.008 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:13:08.008 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:13:08.008 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:13:08.008 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:13:08.008 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:13:08.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:13:08 smithi047 bash[22744]: audit 2024-09-16T07:13:07.581430+0000 mgr.a (mgr.14373) 4157 : audit [DBG] from='client.100215 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:13:08.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:13:08 smithi157 bash[24585]: audit 2024-09-16T07:13:07.581430+0000 mgr.a (mgr.14373) 4157 : audit [DBG] from='client.100215 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:13:08.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:13:08 smithi086 bash[24289]: audit 2024-09-16T07:13:07.581430+0000 mgr.a (mgr.14373) 4157 : audit [DBG] from='client.100215 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:13:09.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:13:09 smithi047 bash[22744]: cluster 2024-09-16T07:13:07.696680+0000 mgr.a (mgr.14373) 4158 : cluster [DBG] pgmap v2882: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:13:09.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:13:09 smithi157 bash[24585]: cluster 2024-09-16T07:13:07.696680+0000 mgr.a (mgr.14373) 4158 : cluster [DBG] pgmap v2882: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:13:09.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:13:09 smithi086 bash[24289]: cluster 2024-09-16T07:13:07.696680+0000 mgr.a (mgr.14373) 4158 : cluster [DBG] pgmap v2882: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:13:11.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:13:11 smithi047 bash[22744]: cluster 2024-09-16T07:13:09.697537+0000 mgr.a (mgr.14373) 4159 : cluster [DBG] pgmap v2883: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T07:13:11.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:13:11 smithi157 bash[24585]: cluster 2024-09-16T07:13:09.697537+0000 mgr.a (mgr.14373) 4159 : cluster [DBG] pgmap v2883: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T07:13:11.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:13:11 smithi086 bash[24289]: cluster 2024-09-16T07:13:09.697537+0000 mgr.a (mgr.14373) 4159 : cluster [DBG] pgmap v2883: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T07:13:13.009 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:13:13.010 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:13:13.010 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:13:13.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:13:13 smithi047 bash[22744]: cluster 2024-09-16T07:13:11.699681+0000 mgr.a (mgr.14373) 4160 : cluster [DBG] pgmap v2884: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.4 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:13:13.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:13:13 smithi157 bash[24585]: cluster 2024-09-16T07:13:11.699681+0000 mgr.a (mgr.14373) 4160 : cluster [DBG] pgmap v2884: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.4 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:13:13.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:13:13 smithi086 bash[24289]: cluster 2024-09-16T07:13:11.699681+0000 mgr.a (mgr.14373) 4160 : cluster [DBG] pgmap v2884: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.4 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:13:13.778 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:13:13.778 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:13:13.778 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:13:13.778 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:13:13.779 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:13:14.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:13:14 smithi047 bash[22744]: audit 2024-09-16T07:13:13.343924+0000 mgr.a (mgr.14373) 4161 : audit [DBG] from='client.100293 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:13:14.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:13:14 smithi157 bash[24585]: audit 2024-09-16T07:13:13.343924+0000 mgr.a (mgr.14373) 4161 : audit [DBG] from='client.100293 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:13:14.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:13:14 smithi086 bash[24289]: audit 2024-09-16T07:13:13.343924+0000 mgr.a (mgr.14373) 4161 : audit [DBG] from='client.100293 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:13:15.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:13:15 smithi157 bash[24585]: cluster 2024-09-16T07:13:13.700276+0000 mgr.a (mgr.14373) 4162 : cluster [DBG] pgmap v2885: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 4.9 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-16T07:13:15.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:13:15 smithi086 bash[24289]: cluster 2024-09-16T07:13:13.700276+0000 mgr.a (mgr.14373) 4162 : cluster [DBG] pgmap v2885: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 4.9 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-16T07:13:15.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:13:15 smithi047 bash[22744]: cluster 2024-09-16T07:13:13.700276+0000 mgr.a (mgr.14373) 4162 : cluster [DBG] pgmap v2885: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 4.9 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-16T07:13:17.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:13:17 smithi157 bash[24585]: cluster 2024-09-16T07:13:15.701018+0000 mgr.a (mgr.14373) 4163 : cluster [DBG] pgmap v2886: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 4.9 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-16T07:13:17.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:13:17 smithi086 bash[24289]: cluster 2024-09-16T07:13:15.701018+0000 mgr.a (mgr.14373) 4163 : cluster [DBG] pgmap v2886: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 4.9 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-16T07:13:17.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:13:17 smithi047 bash[22744]: cluster 2024-09-16T07:13:15.701018+0000 mgr.a (mgr.14373) 4163 : cluster [DBG] pgmap v2886: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 4.9 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-16T07:13:18.779 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:13:18.780 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:13:18.781 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:13:19.533 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:13:19.533 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:13:19.534 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:13:19.534 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:13:19.534 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:13:19.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:13:19 smithi157 bash[24585]: cluster 2024-09-16T07:13:17.703222+0000 mgr.a (mgr.14373) 4164 : cluster [DBG] pgmap v2887: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-16T07:13:19.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:13:19 smithi086 bash[24289]: cluster 2024-09-16T07:13:17.703222+0000 mgr.a (mgr.14373) 4164 : cluster [DBG] pgmap v2887: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-16T07:13:19.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:13:19 smithi047 bash[22744]: cluster 2024-09-16T07:13:17.703222+0000 mgr.a (mgr.14373) 4164 : cluster [DBG] pgmap v2887: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-16T07:13:20.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:13:20 smithi157 bash[24585]: audit 2024-09-16T07:13:19.116175+0000 mgr.a (mgr.14373) 4165 : audit [DBG] from='client.100365 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:13:20.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:13:20 smithi086 bash[24289]: audit 2024-09-16T07:13:19.116175+0000 mgr.a (mgr.14373) 4165 : audit [DBG] from='client.100365 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:13:20.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:13:20 smithi047 bash[22744]: audit 2024-09-16T07:13:19.116175+0000 mgr.a (mgr.14373) 4165 : audit [DBG] from='client.100365 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:13:21.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:13:21 smithi157 bash[24585]: cluster 2024-09-16T07:13:19.704066+0000 mgr.a (mgr.14373) 4166 : cluster [DBG] pgmap v2888: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:13:21.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:13:21 smithi086 bash[24289]: cluster 2024-09-16T07:13:19.704066+0000 mgr.a (mgr.14373) 4166 : cluster [DBG] pgmap v2888: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:13:21.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:13:21 smithi047 bash[22744]: cluster 2024-09-16T07:13:19.704066+0000 mgr.a (mgr.14373) 4166 : cluster [DBG] pgmap v2888: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:13:23.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:13:23 smithi157 bash[24585]: cluster 2024-09-16T07:13:21.706204+0000 mgr.a (mgr.14373) 4167 : cluster [DBG] pgmap v2889: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:13:23.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:13:23 smithi086 bash[24289]: cluster 2024-09-16T07:13:21.706204+0000 mgr.a (mgr.14373) 4167 : cluster [DBG] pgmap v2889: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:13:23.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:13:23 smithi047 bash[22744]: cluster 2024-09-16T07:13:21.706204+0000 mgr.a (mgr.14373) 4167 : cluster [DBG] pgmap v2889: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:13:24.535 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:13:24.535 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:13:24.535 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:13:25.312 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:13:25.312 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:13:25.312 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:13:25.312 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:13:25.312 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:13:25.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:13:25 smithi157 bash[24585]: cluster 2024-09-16T07:13:23.706959+0000 mgr.a (mgr.14373) 4168 : cluster [DBG] pgmap v2890: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:13:25.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:13:25 smithi086 bash[24289]: cluster 2024-09-16T07:13:23.706959+0000 mgr.a (mgr.14373) 4168 : cluster [DBG] pgmap v2890: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:13:25.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:13:25 smithi047 bash[22744]: cluster 2024-09-16T07:13:23.706959+0000 mgr.a (mgr.14373) 4168 : cluster [DBG] pgmap v2890: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:13:26.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:13:26 smithi157 bash[24585]: audit 2024-09-16T07:13:24.875071+0000 mgr.a (mgr.14373) 4169 : audit [DBG] from='client.100440 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:13:26.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:13:26 smithi086 bash[24289]: audit 2024-09-16T07:13:24.875071+0000 mgr.a (mgr.14373) 4169 : audit [DBG] from='client.100440 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:13:26.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:13:26 smithi047 bash[22744]: audit 2024-09-16T07:13:24.875071+0000 mgr.a (mgr.14373) 4169 : audit [DBG] from='client.100440 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:13:27.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:13:27 smithi157 bash[24585]: cluster 2024-09-16T07:13:25.707842+0000 mgr.a (mgr.14373) 4170 : cluster [DBG] pgmap v2891: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:13:27.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:13:27 smithi086 bash[24289]: cluster 2024-09-16T07:13:25.707842+0000 mgr.a (mgr.14373) 4170 : cluster [DBG] pgmap v2891: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:13:27.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:13:27 smithi047 bash[22744]: cluster 2024-09-16T07:13:25.707842+0000 mgr.a (mgr.14373) 4170 : cluster [DBG] pgmap v2891: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:13:29.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:13:29 smithi157 bash[24585]: cluster 2024-09-16T07:13:27.710095+0000 mgr.a (mgr.14373) 4171 : cluster [DBG] pgmap v2892: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:13:29.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:13:29 smithi086 bash[24289]: cluster 2024-09-16T07:13:27.710095+0000 mgr.a (mgr.14373) 4171 : cluster [DBG] pgmap v2892: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:13:29.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:13:29 smithi047 bash[22744]: cluster 2024-09-16T07:13:27.710095+0000 mgr.a (mgr.14373) 4171 : cluster [DBG] pgmap v2892: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:13:30.314 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:13:30.314 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:13:30.314 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:13:31.084 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:13:31.084 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:13:31.084 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:13:31.084 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:13:31.084 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:13:31.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:13:31 smithi157 bash[24585]: cluster 2024-09-16T07:13:29.710862+0000 mgr.a (mgr.14373) 4172 : cluster [DBG] pgmap v2893: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:13:31.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:13:31 smithi086 bash[24289]: cluster 2024-09-16T07:13:29.710862+0000 mgr.a (mgr.14373) 4172 : cluster [DBG] pgmap v2893: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:13:31.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:13:31 smithi047 bash[22744]: cluster 2024-09-16T07:13:29.710862+0000 mgr.a (mgr.14373) 4172 : cluster [DBG] pgmap v2893: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:13:32.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:13:32 smithi157 bash[24585]: audit 2024-09-16T07:13:30.653308+0000 mgr.a (mgr.14373) 4173 : audit [DBG] from='client.100518 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:13:32.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:13:32 smithi086 bash[24289]: audit 2024-09-16T07:13:30.653308+0000 mgr.a (mgr.14373) 4173 : audit [DBG] from='client.100518 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:13:32.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:13:32 smithi047 bash[22744]: audit 2024-09-16T07:13:30.653308+0000 mgr.a (mgr.14373) 4173 : audit [DBG] from='client.100518 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:13:33.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:13:33 smithi157 bash[24585]: cluster 2024-09-16T07:13:31.713133+0000 mgr.a (mgr.14373) 4174 : cluster [DBG] pgmap v2894: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:13:33.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:13:33 smithi086 bash[24289]: cluster 2024-09-16T07:13:31.713133+0000 mgr.a (mgr.14373) 4174 : cluster [DBG] pgmap v2894: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:13:33.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:13:33 smithi047 bash[22744]: cluster 2024-09-16T07:13:31.713133+0000 mgr.a (mgr.14373) 4174 : cluster [DBG] pgmap v2894: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:13:35.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:13:35 smithi157 bash[24585]: cluster 2024-09-16T07:13:33.713922+0000 mgr.a (mgr.14373) 4175 : cluster [DBG] pgmap v2895: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:13:35.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:13:35 smithi086 bash[24289]: cluster 2024-09-16T07:13:33.713922+0000 mgr.a (mgr.14373) 4175 : cluster [DBG] pgmap v2895: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:13:35.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:13:35 smithi047 bash[22744]: cluster 2024-09-16T07:13:33.713922+0000 mgr.a (mgr.14373) 4175 : cluster [DBG] pgmap v2895: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:13:36.085 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:13:36.086 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:13:36.086 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:13:36.839 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:13:36.839 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:13:36.839 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:13:36.839 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:13:36.839 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:13:37.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:13:37 smithi157 bash[24585]: cluster 2024-09-16T07:13:35.714696+0000 mgr.a (mgr.14373) 4176 : cluster [DBG] pgmap v2896: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:13:37.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:13:37 smithi157 bash[24585]: audit 2024-09-16T07:13:36.425126+0000 mgr.a (mgr.14373) 4177 : audit [DBG] from='client.100593 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:13:37.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:13:37 smithi086 bash[24289]: cluster 2024-09-16T07:13:35.714696+0000 mgr.a (mgr.14373) 4176 : cluster [DBG] pgmap v2896: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:13:37.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:13:37 smithi086 bash[24289]: audit 2024-09-16T07:13:36.425126+0000 mgr.a (mgr.14373) 4177 : audit [DBG] from='client.100593 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:13:37.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:13:37 smithi047 bash[22744]: cluster 2024-09-16T07:13:35.714696+0000 mgr.a (mgr.14373) 4176 : cluster [DBG] pgmap v2896: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:13:37.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:13:37 smithi047 bash[22744]: audit 2024-09-16T07:13:36.425126+0000 mgr.a (mgr.14373) 4177 : audit [DBG] from='client.100593 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:13:39.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:13:39 smithi157 bash[24585]: cluster 2024-09-16T07:13:37.717428+0000 mgr.a (mgr.14373) 4178 : cluster [DBG] pgmap v2897: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:13:39.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:13:39 smithi086 bash[24289]: cluster 2024-09-16T07:13:37.717428+0000 mgr.a (mgr.14373) 4178 : cluster [DBG] pgmap v2897: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:13:39.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:13:39 smithi047 bash[22744]: cluster 2024-09-16T07:13:37.717428+0000 mgr.a (mgr.14373) 4178 : cluster [DBG] pgmap v2897: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:13:41.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:13:41 smithi157 bash[24585]: cluster 2024-09-16T07:13:39.718224+0000 mgr.a (mgr.14373) 4179 : cluster [DBG] pgmap v2898: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:13:41.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:13:41 smithi086 bash[24289]: cluster 2024-09-16T07:13:39.718224+0000 mgr.a (mgr.14373) 4179 : cluster [DBG] pgmap v2898: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:13:41.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:13:41 smithi047 bash[22744]: cluster 2024-09-16T07:13:39.718224+0000 mgr.a (mgr.14373) 4179 : cluster [DBG] pgmap v2898: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:13:41.840 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:13:41.841 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:13:41.841 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:13:42.604 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:13:42.604 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:13:42.604 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:13:42.604 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:13:42.604 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:13:43.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:13:43 smithi157 bash[24585]: cluster 2024-09-16T07:13:41.720170+0000 mgr.a (mgr.14373) 4180 : cluster [DBG] pgmap v2899: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:13:43.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:13:43 smithi157 bash[24585]: audit 2024-09-16T07:13:42.177429+0000 mgr.a (mgr.14373) 4181 : audit [DBG] from='client.100671 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:13:43.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:13:43 smithi086 bash[24289]: cluster 2024-09-16T07:13:41.720170+0000 mgr.a (mgr.14373) 4180 : cluster [DBG] pgmap v2899: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:13:43.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:13:43 smithi086 bash[24289]: audit 2024-09-16T07:13:42.177429+0000 mgr.a (mgr.14373) 4181 : audit [DBG] from='client.100671 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:13:43.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:13:43 smithi047 bash[22744]: cluster 2024-09-16T07:13:41.720170+0000 mgr.a (mgr.14373) 4180 : cluster [DBG] pgmap v2899: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:13:43.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:13:43 smithi047 bash[22744]: audit 2024-09-16T07:13:42.177429+0000 mgr.a (mgr.14373) 4181 : audit [DBG] from='client.100671 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:13:45.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:13:45 smithi157 bash[24585]: cluster 2024-09-16T07:13:43.721091+0000 mgr.a (mgr.14373) 4182 : cluster [DBG] pgmap v2900: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:13:45.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:13:45 smithi086 bash[24289]: cluster 2024-09-16T07:13:43.721091+0000 mgr.a (mgr.14373) 4182 : cluster [DBG] pgmap v2900: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:13:45.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:13:45 smithi047 bash[22744]: cluster 2024-09-16T07:13:43.721091+0000 mgr.a (mgr.14373) 4182 : cluster [DBG] pgmap v2900: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:13:47.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:13:47 smithi157 bash[24585]: cluster 2024-09-16T07:13:45.721885+0000 mgr.a (mgr.14373) 4183 : cluster [DBG] pgmap v2901: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T07:13:47.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:13:47 smithi086 bash[24289]: cluster 2024-09-16T07:13:45.721885+0000 mgr.a (mgr.14373) 4183 : cluster [DBG] pgmap v2901: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T07:13:47.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:13:47 smithi047 bash[22744]: cluster 2024-09-16T07:13:45.721885+0000 mgr.a (mgr.14373) 4183 : cluster [DBG] pgmap v2901: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T07:13:47.605 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:13:47.606 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:13:47.606 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:13:48.382 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:13:48.382 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:13:48.382 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:13:48.382 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:13:48.383 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:13:49.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:13:49 smithi157 bash[24585]: cluster 2024-09-16T07:13:47.723087+0000 mgr.a (mgr.14373) 4184 : cluster [DBG] pgmap v2902: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:13:49.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:13:49 smithi157 bash[24585]: audit 2024-09-16T07:13:47.944120+0000 mgr.a (mgr.14373) 4185 : audit [DBG] from='client.100746 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:13:49.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:13:49 smithi086 bash[24289]: cluster 2024-09-16T07:13:47.723087+0000 mgr.a (mgr.14373) 4184 : cluster [DBG] pgmap v2902: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:13:49.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:13:49 smithi086 bash[24289]: audit 2024-09-16T07:13:47.944120+0000 mgr.a (mgr.14373) 4185 : audit [DBG] from='client.100746 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:13:49.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:13:49 smithi047 bash[22744]: cluster 2024-09-16T07:13:47.723087+0000 mgr.a (mgr.14373) 4184 : cluster [DBG] pgmap v2902: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:13:49.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:13:49 smithi047 bash[22744]: audit 2024-09-16T07:13:47.944120+0000 mgr.a (mgr.14373) 4185 : audit [DBG] from='client.100746 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:13:51.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:13:51 smithi157 bash[24585]: cluster 2024-09-16T07:13:49.724000+0000 mgr.a (mgr.14373) 4186 : cluster [DBG] pgmap v2903: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:13:51.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:13:51 smithi086 bash[24289]: cluster 2024-09-16T07:13:49.724000+0000 mgr.a (mgr.14373) 4186 : cluster [DBG] pgmap v2903: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:13:51.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:13:51 smithi047 bash[22744]: cluster 2024-09-16T07:13:49.724000+0000 mgr.a (mgr.14373) 4186 : cluster [DBG] pgmap v2903: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:13:53.383 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:13:53.384 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:13:53.384 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:13:53.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:13:53 smithi157 bash[24585]: cluster 2024-09-16T07:13:51.726129+0000 mgr.a (mgr.14373) 4187 : cluster [DBG] pgmap v2904: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:13:53.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:13:53 smithi086 bash[24289]: cluster 2024-09-16T07:13:51.726129+0000 mgr.a (mgr.14373) 4187 : cluster [DBG] pgmap v2904: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:13:53.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:13:53 smithi047 bash[22744]: cluster 2024-09-16T07:13:51.726129+0000 mgr.a (mgr.14373) 4187 : cluster [DBG] pgmap v2904: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:13:54.160 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:13:54.160 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:13:54.161 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:13:54.161 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:13:54.161 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:13:55.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:13:55 smithi157 bash[24585]: audit 2024-09-16T07:13:53.719889+0000 mgr.a (mgr.14373) 4188 : audit [DBG] from='client.100821 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:13:55.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:13:55 smithi157 bash[24585]: cluster 2024-09-16T07:13:53.738797+0000 mgr.a (mgr.14373) 4189 : cluster [DBG] pgmap v2905: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:13:55.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:13:55 smithi086 bash[24289]: audit 2024-09-16T07:13:53.719889+0000 mgr.a (mgr.14373) 4188 : audit [DBG] from='client.100821 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:13:55.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:13:55 smithi086 bash[24289]: cluster 2024-09-16T07:13:53.738797+0000 mgr.a (mgr.14373) 4189 : cluster [DBG] pgmap v2905: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:13:55.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:13:55 smithi047 bash[22744]: audit 2024-09-16T07:13:53.719889+0000 mgr.a (mgr.14373) 4188 : audit [DBG] from='client.100821 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:13:55.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:13:55 smithi047 bash[22744]: cluster 2024-09-16T07:13:53.738797+0000 mgr.a (mgr.14373) 4189 : cluster [DBG] pgmap v2905: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:13:57.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:13:57 smithi157 bash[24585]: cluster 2024-09-16T07:13:55.739834+0000 mgr.a (mgr.14373) 4190 : cluster [DBG] pgmap v2906: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:13:57.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:13:57 smithi086 bash[24289]: cluster 2024-09-16T07:13:55.739834+0000 mgr.a (mgr.14373) 4190 : cluster [DBG] pgmap v2906: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:13:57.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:13:57 smithi047 bash[22744]: cluster 2024-09-16T07:13:55.739834+0000 mgr.a (mgr.14373) 4190 : cluster [DBG] pgmap v2906: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:13:59.162 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:13:59.162 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:13:59.162 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:13:59.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:13:59 smithi157 bash[24585]: cluster 2024-09-16T07:13:57.742026+0000 mgr.a (mgr.14373) 4191 : cluster [DBG] pgmap v2907: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:13:59.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:13:59 smithi086 bash[24289]: cluster 2024-09-16T07:13:57.742026+0000 mgr.a (mgr.14373) 4191 : cluster [DBG] pgmap v2907: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:13:59.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:13:59 smithi047 bash[22744]: cluster 2024-09-16T07:13:57.742026+0000 mgr.a (mgr.14373) 4191 : cluster [DBG] pgmap v2907: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:13:59.905 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:13:59.905 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:13:59.906 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:13:59.906 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:13:59.906 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:14:00.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:14:00 smithi157 bash[24585]: audit 2024-09-16T07:13:59.495281+0000 mgr.a (mgr.14373) 4192 : audit [DBG] from='client.100896 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:14:00.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:14:00 smithi086 bash[24289]: audit 2024-09-16T07:13:59.495281+0000 mgr.a (mgr.14373) 4192 : audit [DBG] from='client.100896 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:14:00.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:14:00 smithi047 bash[22744]: audit 2024-09-16T07:13:59.495281+0000 mgr.a (mgr.14373) 4192 : audit [DBG] from='client.100896 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:14:01.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:14:01 smithi157 bash[24585]: cluster 2024-09-16T07:13:59.742572+0000 mgr.a (mgr.14373) 4193 : cluster [DBG] pgmap v2908: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:14:01.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:14:01 smithi086 bash[24289]: cluster 2024-09-16T07:13:59.742572+0000 mgr.a (mgr.14373) 4193 : cluster [DBG] pgmap v2908: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:14:01.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:14:01 smithi047 bash[22744]: cluster 2024-09-16T07:13:59.742572+0000 mgr.a (mgr.14373) 4193 : cluster [DBG] pgmap v2908: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:14:02.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:14:02 smithi157 bash[24585]: audit 2024-09-16T07:14:01.617247+0000 mon.b (mon.2) 418 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T07:14:02.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:14:02 smithi086 bash[24289]: audit 2024-09-16T07:14:01.617247+0000 mon.b (mon.2) 418 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T07:14:02.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:14:02 smithi047 bash[22744]: audit 2024-09-16T07:14:01.617247+0000 mon.b (mon.2) 418 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T07:14:03.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:14:03 smithi157 bash[24585]: cluster 2024-09-16T07:14:01.744766+0000 mgr.a (mgr.14373) 4194 : cluster [DBG] pgmap v2909: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:14:03.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:14:03 smithi157 bash[24585]: audit 2024-09-16T07:14:02.453553+0000 mon.b (mon.2) 419 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T07:14:03.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:14:03 smithi157 bash[24585]: audit 2024-09-16T07:14:02.455812+0000 mon.b (mon.2) 420 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T07:14:03.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:14:03 smithi157 bash[24585]: audit 2024-09-16T07:14:02.468724+0000 mon.a (mon.0) 824 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:14:03.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:14:03 smithi157 bash[24585]: audit 2024-09-16T07:14:02.472550+0000 mon.b (mon.2) 421 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:14:03.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:14:03 smithi157 bash[24585]: audit 2024-09-16T07:14:02.476656+0000 mgr.a (mgr.14373) 4195 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:14:03.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:14:03 smithi086 bash[24289]: cluster 2024-09-16T07:14:01.744766+0000 mgr.a (mgr.14373) 4194 : cluster [DBG] pgmap v2909: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:14:03.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:14:03 smithi086 bash[24289]: audit 2024-09-16T07:14:02.453553+0000 mon.b (mon.2) 419 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T07:14:03.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:14:03 smithi086 bash[24289]: audit 2024-09-16T07:14:02.455812+0000 mon.b (mon.2) 420 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T07:14:03.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:14:03 smithi086 bash[24289]: audit 2024-09-16T07:14:02.468724+0000 mon.a (mon.0) 824 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:14:03.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:14:03 smithi086 bash[24289]: audit 2024-09-16T07:14:02.472550+0000 mon.b (mon.2) 421 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:14:03.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:14:03 smithi086 bash[24289]: audit 2024-09-16T07:14:02.476656+0000 mgr.a (mgr.14373) 4195 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:14:03.588 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 07:14:03 smithi047 bash[22994]: debug 2024-09-16T07:14:03.210+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T07:14:03.588 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 07:14:03 smithi047 bash[22994]: debug 2024-09-16T07:14:03.210+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T07:14:03.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:14:03 smithi047 bash[22744]: cluster 2024-09-16T07:14:01.744766+0000 mgr.a (mgr.14373) 4194 : cluster [DBG] pgmap v2909: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:14:03.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:14:03 smithi047 bash[22744]: audit 2024-09-16T07:14:02.453553+0000 mon.b (mon.2) 419 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T07:14:03.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:14:03 smithi047 bash[22744]: audit 2024-09-16T07:14:02.455812+0000 mon.b (mon.2) 420 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T07:14:03.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:14:03 smithi047 bash[22744]: audit 2024-09-16T07:14:02.468724+0000 mon.a (mon.0) 824 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:14:03.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:14:03 smithi047 bash[22744]: audit 2024-09-16T07:14:02.472550+0000 mon.b (mon.2) 421 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:14:03.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:14:03 smithi047 bash[22744]: audit 2024-09-16T07:14:02.476656+0000 mgr.a (mgr.14373) 4195 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:14:04.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:14:04 smithi157 bash[24585]: audit 2024-09-16T07:14:03.215958+0000 mgr.a (mgr.14373) 4196 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T07:14:04.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:14:04 smithi157 bash[24585]: cephadm 2024-09-16T07:14:03.217966+0000 mgr.a (mgr.14373) 4197 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T07:14:04.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:14:04 smithi086 bash[24289]: audit 2024-09-16T07:14:03.215958+0000 mgr.a (mgr.14373) 4196 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T07:14:04.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:14:04 smithi086 bash[24289]: cephadm 2024-09-16T07:14:03.217966+0000 mgr.a (mgr.14373) 4197 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T07:14:04.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:14:04 smithi047 bash[22744]: audit 2024-09-16T07:14:03.215958+0000 mgr.a (mgr.14373) 4196 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T07:14:04.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:14:04 smithi047 bash[22744]: cephadm 2024-09-16T07:14:03.217966+0000 mgr.a (mgr.14373) 4197 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T07:14:04.907 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:14:04.907 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:14:04.908 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:14:05.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:14:05 smithi157 bash[24585]: cluster 2024-09-16T07:14:03.745750+0000 mgr.a (mgr.14373) 4198 : cluster [DBG] pgmap v2910: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:14:05.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:14:05 smithi086 bash[24289]: cluster 2024-09-16T07:14:03.745750+0000 mgr.a (mgr.14373) 4198 : cluster [DBG] pgmap v2910: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:14:05.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:14:05 smithi047 bash[22744]: cluster 2024-09-16T07:14:03.745750+0000 mgr.a (mgr.14373) 4198 : cluster [DBG] pgmap v2910: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:14:05.684 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:14:05.685 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:14:05.685 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:14:05.685 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:14:05.685 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:14:06.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:14:06 smithi157 bash[24585]: audit 2024-09-16T07:14:05.247140+0000 mgr.a (mgr.14373) 4199 : audit [DBG] from='client.101079 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:14:06.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:14:06 smithi086 bash[24289]: audit 2024-09-16T07:14:05.247140+0000 mgr.a (mgr.14373) 4199 : audit [DBG] from='client.101079 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:14:06.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:14:06 smithi047 bash[22744]: audit 2024-09-16T07:14:05.247140+0000 mgr.a (mgr.14373) 4199 : audit [DBG] from='client.101079 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:14:07.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:14:07 smithi157 bash[24585]: cluster 2024-09-16T07:14:05.746826+0000 mgr.a (mgr.14373) 4200 : cluster [DBG] pgmap v2911: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:14:07.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:14:07 smithi086 bash[24289]: cluster 2024-09-16T07:14:05.746826+0000 mgr.a (mgr.14373) 4200 : cluster [DBG] pgmap v2911: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:14:07.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:14:07 smithi047 bash[22744]: cluster 2024-09-16T07:14:05.746826+0000 mgr.a (mgr.14373) 4200 : cluster [DBG] pgmap v2911: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:14:09.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:14:09 smithi157 bash[24585]: cluster 2024-09-16T07:14:07.749022+0000 mgr.a (mgr.14373) 4201 : cluster [DBG] pgmap v2912: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:14:09.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:14:09 smithi086 bash[24289]: cluster 2024-09-16T07:14:07.749022+0000 mgr.a (mgr.14373) 4201 : cluster [DBG] pgmap v2912: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:14:09.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:14:09 smithi047 bash[22744]: cluster 2024-09-16T07:14:07.749022+0000 mgr.a (mgr.14373) 4201 : cluster [DBG] pgmap v2912: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:14:10.686 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:14:10.687 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:14:10.687 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:14:11.441 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:14:11.442 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:14:11.442 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:14:11.442 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:14:11.442 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:14:11.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:14:11 smithi157 bash[24585]: cluster 2024-09-16T07:14:09.749778+0000 mgr.a (mgr.14373) 4202 : cluster [DBG] pgmap v2913: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:14:11.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:14:11 smithi086 bash[24289]: cluster 2024-09-16T07:14:09.749778+0000 mgr.a (mgr.14373) 4202 : cluster [DBG] pgmap v2913: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:14:11.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:14:11 smithi047 bash[22744]: cluster 2024-09-16T07:14:09.749778+0000 mgr.a (mgr.14373) 4202 : cluster [DBG] pgmap v2913: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:14:12.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:14:12 smithi157 bash[24585]: audit 2024-09-16T07:14:11.018846+0000 mgr.a (mgr.14373) 4203 : audit [DBG] from='client.101157 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:14:12.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:14:12 smithi086 bash[24289]: audit 2024-09-16T07:14:11.018846+0000 mgr.a (mgr.14373) 4203 : audit [DBG] from='client.101157 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:14:12.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:14:12 smithi047 bash[22744]: audit 2024-09-16T07:14:11.018846+0000 mgr.a (mgr.14373) 4203 : audit [DBG] from='client.101157 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:14:13.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:14:13 smithi157 bash[24585]: cluster 2024-09-16T07:14:11.752156+0000 mgr.a (mgr.14373) 4204 : cluster [DBG] pgmap v2914: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:14:13.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:14:13 smithi086 bash[24289]: cluster 2024-09-16T07:14:11.752156+0000 mgr.a (mgr.14373) 4204 : cluster [DBG] pgmap v2914: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:14:13.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:14:13 smithi047 bash[22744]: cluster 2024-09-16T07:14:11.752156+0000 mgr.a (mgr.14373) 4204 : cluster [DBG] pgmap v2914: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:14:15.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:14:15 smithi157 bash[24585]: cluster 2024-09-16T07:14:13.752967+0000 mgr.a (mgr.14373) 4205 : cluster [DBG] pgmap v2915: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:14:15.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:14:15 smithi086 bash[24289]: cluster 2024-09-16T07:14:13.752967+0000 mgr.a (mgr.14373) 4205 : cluster [DBG] pgmap v2915: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:14:15.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:14:15 smithi047 bash[22744]: cluster 2024-09-16T07:14:13.752967+0000 mgr.a (mgr.14373) 4205 : cluster [DBG] pgmap v2915: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:14:16.443 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:14:16.444 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:14:16.444 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:14:17.214 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:14:17.214 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:14:17.214 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:14:17.214 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:14:17.214 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:14:17.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:14:17 smithi157 bash[24585]: cluster 2024-09-16T07:14:15.753737+0000 mgr.a (mgr.14373) 4206 : cluster [DBG] pgmap v2916: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:14:17.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:14:17 smithi086 bash[24289]: cluster 2024-09-16T07:14:15.753737+0000 mgr.a (mgr.14373) 4206 : cluster [DBG] pgmap v2916: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:14:17.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:14:17 smithi047 bash[22744]: cluster 2024-09-16T07:14:15.753737+0000 mgr.a (mgr.14373) 4206 : cluster [DBG] pgmap v2916: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:14:18.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:14:18 smithi157 bash[24585]: audit 2024-09-16T07:14:16.780270+0000 mgr.a (mgr.14373) 4207 : audit [DBG] from='client.101229 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:14:18.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:14:18 smithi086 bash[24289]: audit 2024-09-16T07:14:16.780270+0000 mgr.a (mgr.14373) 4207 : audit [DBG] from='client.101229 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:14:18.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:14:18 smithi047 bash[22744]: audit 2024-09-16T07:14:16.780270+0000 mgr.a (mgr.14373) 4207 : audit [DBG] from='client.101229 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:14:19.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:14:19 smithi157 bash[24585]: cluster 2024-09-16T07:14:17.756568+0000 mgr.a (mgr.14373) 4208 : cluster [DBG] pgmap v2917: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:14:19.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:14:19 smithi086 bash[24289]: cluster 2024-09-16T07:14:17.756568+0000 mgr.a (mgr.14373) 4208 : cluster [DBG] pgmap v2917: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:14:19.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:14:19 smithi047 bash[22744]: cluster 2024-09-16T07:14:17.756568+0000 mgr.a (mgr.14373) 4208 : cluster [DBG] pgmap v2917: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:14:21.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:14:21 smithi157 bash[24585]: cluster 2024-09-16T07:14:19.757354+0000 mgr.a (mgr.14373) 4209 : cluster [DBG] pgmap v2918: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:14:21.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:14:21 smithi086 bash[24289]: cluster 2024-09-16T07:14:19.757354+0000 mgr.a (mgr.14373) 4209 : cluster [DBG] pgmap v2918: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:14:21.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:14:21 smithi047 bash[22744]: cluster 2024-09-16T07:14:19.757354+0000 mgr.a (mgr.14373) 4209 : cluster [DBG] pgmap v2918: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:14:22.215 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:14:22.216 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:14:22.216 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:14:22.962 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:14:22.962 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:14:22.963 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:14:22.963 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:14:22.963 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:14:23.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:14:23 smithi157 bash[24585]: cluster 2024-09-16T07:14:21.759246+0000 mgr.a (mgr.14373) 4210 : cluster [DBG] pgmap v2919: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:14:23.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:14:23 smithi157 bash[24585]: audit 2024-09-16T07:14:22.548518+0000 mgr.a (mgr.14373) 4211 : audit [DBG] from='client.101307 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:14:23.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:14:23 smithi086 bash[24289]: cluster 2024-09-16T07:14:21.759246+0000 mgr.a (mgr.14373) 4210 : cluster [DBG] pgmap v2919: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:14:23.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:14:23 smithi086 bash[24289]: audit 2024-09-16T07:14:22.548518+0000 mgr.a (mgr.14373) 4211 : audit [DBG] from='client.101307 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:14:23.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:14:23 smithi047 bash[22744]: cluster 2024-09-16T07:14:21.759246+0000 mgr.a (mgr.14373) 4210 : cluster [DBG] pgmap v2919: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:14:23.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:14:23 smithi047 bash[22744]: audit 2024-09-16T07:14:22.548518+0000 mgr.a (mgr.14373) 4211 : audit [DBG] from='client.101307 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:14:25.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:14:25 smithi157 bash[24585]: cluster 2024-09-16T07:14:23.760219+0000 mgr.a (mgr.14373) 4212 : cluster [DBG] pgmap v2920: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:14:25.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:14:25 smithi086 bash[24289]: cluster 2024-09-16T07:14:23.760219+0000 mgr.a (mgr.14373) 4212 : cluster [DBG] pgmap v2920: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:14:25.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:14:25 smithi047 bash[22744]: cluster 2024-09-16T07:14:23.760219+0000 mgr.a (mgr.14373) 4212 : cluster [DBG] pgmap v2920: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:14:27.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:14:27 smithi157 bash[24585]: cluster 2024-09-16T07:14:25.761004+0000 mgr.a (mgr.14373) 4213 : cluster [DBG] pgmap v2921: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T07:14:27.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:14:27 smithi086 bash[24289]: cluster 2024-09-16T07:14:25.761004+0000 mgr.a (mgr.14373) 4213 : cluster [DBG] pgmap v2921: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T07:14:27.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:14:27 smithi047 bash[22744]: cluster 2024-09-16T07:14:25.761004+0000 mgr.a (mgr.14373) 4213 : cluster [DBG] pgmap v2921: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T07:14:27.964 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:14:27.965 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:14:27.965 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:14:28.706 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:14:28.706 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:14:28.706 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:14:28.706 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:14:28.706 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:14:29.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:14:29 smithi086 bash[24289]: cluster 2024-09-16T07:14:27.763252+0000 mgr.a (mgr.14373) 4214 : cluster [DBG] pgmap v2922: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:14:29.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:14:29 smithi086 bash[24289]: audit 2024-09-16T07:14:28.300158+0000 mgr.a (mgr.14373) 4215 : audit [DBG] from='client.101385 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:14:29.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:14:29 smithi047 bash[22744]: cluster 2024-09-16T07:14:27.763252+0000 mgr.a (mgr.14373) 4214 : cluster [DBG] pgmap v2922: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:14:29.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:14:29 smithi047 bash[22744]: audit 2024-09-16T07:14:28.300158+0000 mgr.a (mgr.14373) 4215 : audit [DBG] from='client.101385 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:14:29.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:14:29 smithi157 bash[24585]: cluster 2024-09-16T07:14:27.763252+0000 mgr.a (mgr.14373) 4214 : cluster [DBG] pgmap v2922: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:14:29.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:14:29 smithi157 bash[24585]: audit 2024-09-16T07:14:28.300158+0000 mgr.a (mgr.14373) 4215 : audit [DBG] from='client.101385 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:14:31.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:14:31 smithi086 bash[24289]: cluster 2024-09-16T07:14:29.764194+0000 mgr.a (mgr.14373) 4216 : cluster [DBG] pgmap v2923: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:14:31.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:14:31 smithi047 bash[22744]: cluster 2024-09-16T07:14:29.764194+0000 mgr.a (mgr.14373) 4216 : cluster [DBG] pgmap v2923: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:14:31.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:14:31 smithi157 bash[24585]: cluster 2024-09-16T07:14:29.764194+0000 mgr.a (mgr.14373) 4216 : cluster [DBG] pgmap v2923: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:14:33.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:14:33 smithi086 bash[24289]: cluster 2024-09-16T07:14:31.766369+0000 mgr.a (mgr.14373) 4217 : cluster [DBG] pgmap v2924: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:14:33.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:14:33 smithi047 bash[22744]: cluster 2024-09-16T07:14:31.766369+0000 mgr.a (mgr.14373) 4217 : cluster [DBG] pgmap v2924: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:14:33.707 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:14:33.708 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:14:33.708 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:14:33.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:14:33 smithi157 bash[24585]: cluster 2024-09-16T07:14:31.766369+0000 mgr.a (mgr.14373) 4217 : cluster [DBG] pgmap v2924: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:14:34.482 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:14:34.482 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:14:34.482 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:14:34.482 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:14:34.482 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:14:35.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:14:35 smithi047 bash[22744]: cluster 2024-09-16T07:14:33.767162+0000 mgr.a (mgr.14373) 4218 : cluster [DBG] pgmap v2925: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:14:35.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:14:35 smithi047 bash[22744]: audit 2024-09-16T07:14:34.046990+0000 mgr.a (mgr.14373) 4219 : audit [DBG] from='client.101457 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:14:35.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:14:35 smithi157 bash[24585]: cluster 2024-09-16T07:14:33.767162+0000 mgr.a (mgr.14373) 4218 : cluster [DBG] pgmap v2925: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:14:35.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:14:35 smithi157 bash[24585]: audit 2024-09-16T07:14:34.046990+0000 mgr.a (mgr.14373) 4219 : audit [DBG] from='client.101457 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:14:35.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:14:35 smithi086 bash[24289]: cluster 2024-09-16T07:14:33.767162+0000 mgr.a (mgr.14373) 4218 : cluster [DBG] pgmap v2925: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:14:35.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:14:35 smithi086 bash[24289]: audit 2024-09-16T07:14:34.046990+0000 mgr.a (mgr.14373) 4219 : audit [DBG] from='client.101457 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:14:37.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:14:37 smithi047 bash[22744]: cluster 2024-09-16T07:14:35.768142+0000 mgr.a (mgr.14373) 4220 : cluster [DBG] pgmap v2926: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:14:37.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:14:37 smithi157 bash[24585]: cluster 2024-09-16T07:14:35.768142+0000 mgr.a (mgr.14373) 4220 : cluster [DBG] pgmap v2926: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:14:37.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:14:37 smithi086 bash[24289]: cluster 2024-09-16T07:14:35.768142+0000 mgr.a (mgr.14373) 4220 : cluster [DBG] pgmap v2926: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:14:39.484 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:14:39.484 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:14:39.484 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:14:39.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:14:39 smithi047 bash[22744]: cluster 2024-09-16T07:14:37.770432+0000 mgr.a (mgr.14373) 4221 : cluster [DBG] pgmap v2927: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:14:39.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:14:39 smithi157 bash[24585]: cluster 2024-09-16T07:14:37.770432+0000 mgr.a (mgr.14373) 4221 : cluster [DBG] pgmap v2927: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:14:39.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:14:39 smithi086 bash[24289]: cluster 2024-09-16T07:14:37.770432+0000 mgr.a (mgr.14373) 4221 : cluster [DBG] pgmap v2927: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:14:40.228 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:14:40.229 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:14:40.229 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:14:40.229 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:14:40.229 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:14:41.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:14:41 smithi047 bash[22744]: cluster 2024-09-16T07:14:39.771162+0000 mgr.a (mgr.14373) 4222 : cluster [DBG] pgmap v2928: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:14:41.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:14:41 smithi047 bash[22744]: audit 2024-09-16T07:14:39.815542+0000 mgr.a (mgr.14373) 4223 : audit [DBG] from='client.101535 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:14:41.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:14:41 smithi157 bash[24585]: cluster 2024-09-16T07:14:39.771162+0000 mgr.a (mgr.14373) 4222 : cluster [DBG] pgmap v2928: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:14:41.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:14:41 smithi157 bash[24585]: audit 2024-09-16T07:14:39.815542+0000 mgr.a (mgr.14373) 4223 : audit [DBG] from='client.101535 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:14:41.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:14:41 smithi086 bash[24289]: cluster 2024-09-16T07:14:39.771162+0000 mgr.a (mgr.14373) 4222 : cluster [DBG] pgmap v2928: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:14:41.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:14:41 smithi086 bash[24289]: audit 2024-09-16T07:14:39.815542+0000 mgr.a (mgr.14373) 4223 : audit [DBG] from='client.101535 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:14:43.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:14:43 smithi047 bash[22744]: cluster 2024-09-16T07:14:41.773337+0000 mgr.a (mgr.14373) 4224 : cluster [DBG] pgmap v2929: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:14:43.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:14:43 smithi157 bash[24585]: cluster 2024-09-16T07:14:41.773337+0000 mgr.a (mgr.14373) 4224 : cluster [DBG] pgmap v2929: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:14:43.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:14:43 smithi086 bash[24289]: cluster 2024-09-16T07:14:41.773337+0000 mgr.a (mgr.14373) 4224 : cluster [DBG] pgmap v2929: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:14:45.230 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:14:45.230 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:14:45.231 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:14:45.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:14:45 smithi157 bash[24585]: cluster 2024-09-16T07:14:43.774102+0000 mgr.a (mgr.14373) 4225 : cluster [DBG] pgmap v2930: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:14:45.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:14:45 smithi086 bash[24289]: cluster 2024-09-16T07:14:43.774102+0000 mgr.a (mgr.14373) 4225 : cluster [DBG] pgmap v2930: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:14:45.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:14:45 smithi047 bash[22744]: cluster 2024-09-16T07:14:43.774102+0000 mgr.a (mgr.14373) 4225 : cluster [DBG] pgmap v2930: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:14:45.990 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:14:45.991 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:14:45.991 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:14:45.991 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:14:45.991 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:14:46.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:14:46 smithi157 bash[24585]: audit 2024-09-16T07:14:45.564416+0000 mgr.a (mgr.14373) 4226 : audit [DBG] from='client.101613 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:14:46.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:14:46 smithi086 bash[24289]: audit 2024-09-16T07:14:45.564416+0000 mgr.a (mgr.14373) 4226 : audit [DBG] from='client.101613 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:14:46.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:14:46 smithi047 bash[22744]: audit 2024-09-16T07:14:45.564416+0000 mgr.a (mgr.14373) 4226 : audit [DBG] from='client.101613 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:14:47.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:14:47 smithi157 bash[24585]: cluster 2024-09-16T07:14:45.774666+0000 mgr.a (mgr.14373) 4227 : cluster [DBG] pgmap v2931: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:14:47.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:14:47 smithi086 bash[24289]: cluster 2024-09-16T07:14:45.774666+0000 mgr.a (mgr.14373) 4227 : cluster [DBG] pgmap v2931: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:14:47.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:14:47 smithi047 bash[22744]: cluster 2024-09-16T07:14:45.774666+0000 mgr.a (mgr.14373) 4227 : cluster [DBG] pgmap v2931: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:14:49.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:14:49 smithi157 bash[24585]: cluster 2024-09-16T07:14:47.777001+0000 mgr.a (mgr.14373) 4228 : cluster [DBG] pgmap v2932: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:14:49.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:14:49 smithi086 bash[24289]: cluster 2024-09-16T07:14:47.777001+0000 mgr.a (mgr.14373) 4228 : cluster [DBG] pgmap v2932: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:14:49.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:14:49 smithi047 bash[22744]: cluster 2024-09-16T07:14:47.777001+0000 mgr.a (mgr.14373) 4228 : cluster [DBG] pgmap v2932: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:14:50.992 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:14:50.993 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:14:50.993 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:14:51.759 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:14:51.759 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:14:51.759 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:14:51.760 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:14:51.760 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:14:51.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:14:51 smithi157 bash[24585]: cluster 2024-09-16T07:14:49.777755+0000 mgr.a (mgr.14373) 4229 : cluster [DBG] pgmap v2933: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:14:51.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:14:51 smithi086 bash[24289]: cluster 2024-09-16T07:14:49.777755+0000 mgr.a (mgr.14373) 4229 : cluster [DBG] pgmap v2933: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:14:51.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:14:51 smithi047 bash[22744]: cluster 2024-09-16T07:14:49.777755+0000 mgr.a (mgr.14373) 4229 : cluster [DBG] pgmap v2933: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:14:52.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:14:52 smithi157 bash[24585]: audit 2024-09-16T07:14:51.325030+0000 mgr.a (mgr.14373) 4230 : audit [DBG] from='client.101691 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:14:52.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:14:52 smithi086 bash[24289]: audit 2024-09-16T07:14:51.325030+0000 mgr.a (mgr.14373) 4230 : audit [DBG] from='client.101691 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:14:52.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:14:52 smithi047 bash[22744]: audit 2024-09-16T07:14:51.325030+0000 mgr.a (mgr.14373) 4230 : audit [DBG] from='client.101691 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:14:54.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:14:53 smithi157 bash[24585]: cluster 2024-09-16T07:14:51.779126+0000 mgr.a (mgr.14373) 4231 : cluster [DBG] pgmap v2934: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:14:54.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:14:53 smithi086 bash[24289]: cluster 2024-09-16T07:14:51.779126+0000 mgr.a (mgr.14373) 4231 : cluster [DBG] pgmap v2934: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:14:54.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:14:53 smithi047 bash[22744]: cluster 2024-09-16T07:14:51.779126+0000 mgr.a (mgr.14373) 4231 : cluster [DBG] pgmap v2934: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:14:56.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:14:55 smithi157 bash[24585]: cluster 2024-09-16T07:14:53.779860+0000 mgr.a (mgr.14373) 4232 : cluster [DBG] pgmap v2935: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T07:14:56.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:14:55 smithi086 bash[24289]: cluster 2024-09-16T07:14:53.779860+0000 mgr.a (mgr.14373) 4232 : cluster [DBG] pgmap v2935: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T07:14:56.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:14:55 smithi047 bash[22744]: cluster 2024-09-16T07:14:53.779860+0000 mgr.a (mgr.14373) 4232 : cluster [DBG] pgmap v2935: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T07:14:56.761 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:14:56.761 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:14:56.762 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:14:57.542 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:14:57.542 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:14:57.542 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:14:57.542 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:14:57.542 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:14:58.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:14:57 smithi157 bash[24585]: cluster 2024-09-16T07:14:55.780631+0000 mgr.a (mgr.14373) 4233 : cluster [DBG] pgmap v2936: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T07:14:58.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:14:57 smithi086 bash[24289]: cluster 2024-09-16T07:14:55.780631+0000 mgr.a (mgr.14373) 4233 : cluster [DBG] pgmap v2936: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T07:14:58.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:14:57 smithi047 bash[22744]: cluster 2024-09-16T07:14:55.780631+0000 mgr.a (mgr.14373) 4233 : cluster [DBG] pgmap v2936: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T07:14:59.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:14:58 smithi157 bash[24585]: audit 2024-09-16T07:14:57.099730+0000 mgr.a (mgr.14373) 4234 : audit [DBG] from='client.101766 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:14:59.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:14:58 smithi086 bash[24289]: audit 2024-09-16T07:14:57.099730+0000 mgr.a (mgr.14373) 4234 : audit [DBG] from='client.101766 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:14:59.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:14:58 smithi047 bash[22744]: audit 2024-09-16T07:14:57.099730+0000 mgr.a (mgr.14373) 4234 : audit [DBG] from='client.101766 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:15:00.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:14:59 smithi157 bash[24585]: cluster 2024-09-16T07:14:57.783378+0000 mgr.a (mgr.14373) 4235 : cluster [DBG] pgmap v2937: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:15:00.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:14:59 smithi086 bash[24289]: cluster 2024-09-16T07:14:57.783378+0000 mgr.a (mgr.14373) 4235 : cluster [DBG] pgmap v2937: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:15:00.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:14:59 smithi047 bash[22744]: cluster 2024-09-16T07:14:57.783378+0000 mgr.a (mgr.14373) 4235 : cluster [DBG] pgmap v2937: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:15:02.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:15:01 smithi157 bash[24585]: cluster 2024-09-16T07:14:59.784157+0000 mgr.a (mgr.14373) 4236 : cluster [DBG] pgmap v2938: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:15:02.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:15:01 smithi086 bash[24289]: cluster 2024-09-16T07:14:59.784157+0000 mgr.a (mgr.14373) 4236 : cluster [DBG] pgmap v2938: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:15:02.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:15:01 smithi047 bash[22744]: cluster 2024-09-16T07:14:59.784157+0000 mgr.a (mgr.14373) 4236 : cluster [DBG] pgmap v2938: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:15:02.543 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:15:02.544 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:15:02.544 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:15:03.319 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:15:03.319 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:15:03.319 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:15:03.319 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:15:03.319 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:15:04.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:15:03 smithi157 bash[24585]: cluster 2024-09-16T07:15:01.786129+0000 mgr.a (mgr.14373) 4237 : cluster [DBG] pgmap v2939: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:15:04.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:15:03 smithi157 bash[24585]: audit 2024-09-16T07:15:03.281668+0000 mon.b (mon.2) 422 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T07:15:04.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:15:03 smithi086 bash[24289]: cluster 2024-09-16T07:15:01.786129+0000 mgr.a (mgr.14373) 4237 : cluster [DBG] pgmap v2939: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:15:04.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:15:03 smithi086 bash[24289]: audit 2024-09-16T07:15:03.281668+0000 mon.b (mon.2) 422 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T07:15:04.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:15:03 smithi047 bash[22744]: cluster 2024-09-16T07:15:01.786129+0000 mgr.a (mgr.14373) 4237 : cluster [DBG] pgmap v2939: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:15:04.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:15:03 smithi047 bash[22744]: audit 2024-09-16T07:15:03.281668+0000 mon.b (mon.2) 422 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T07:15:05.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:15:04 smithi157 bash[24585]: audit 2024-09-16T07:15:02.886895+0000 mgr.a (mgr.14373) 4238 : audit [DBG] from='client.101844 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:15:05.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:15:04 smithi157 bash[24585]: audit 2024-09-16T07:15:04.051260+0000 mon.b (mon.2) 423 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T07:15:05.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:15:04 smithi157 bash[24585]: audit 2024-09-16T07:15:04.053339+0000 mon.b (mon.2) 424 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T07:15:05.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:15:04 smithi157 bash[24585]: audit 2024-09-16T07:15:04.066226+0000 mon.a (mon.0) 825 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:15:05.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:15:04 smithi157 bash[24585]: audit 2024-09-16T07:15:04.069978+0000 mon.b (mon.2) 425 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:15:05.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:15:04 smithi086 bash[24289]: audit 2024-09-16T07:15:02.886895+0000 mgr.a (mgr.14373) 4238 : audit [DBG] from='client.101844 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:15:05.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:15:04 smithi086 bash[24289]: audit 2024-09-16T07:15:04.051260+0000 mon.b (mon.2) 423 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T07:15:05.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:15:04 smithi086 bash[24289]: audit 2024-09-16T07:15:04.053339+0000 mon.b (mon.2) 424 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T07:15:05.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:15:04 smithi086 bash[24289]: audit 2024-09-16T07:15:04.066226+0000 mon.a (mon.0) 825 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:15:05.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:15:04 smithi086 bash[24289]: audit 2024-09-16T07:15:04.069978+0000 mon.b (mon.2) 425 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:15:05.088 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 07:15:04 smithi047 bash[22994]: debug 2024-09-16T07:15:04.801+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T07:15:05.088 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 07:15:04 smithi047 bash[22994]: debug 2024-09-16T07:15:04.801+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T07:15:05.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:15:04 smithi047 bash[22744]: audit 2024-09-16T07:15:02.886895+0000 mgr.a (mgr.14373) 4238 : audit [DBG] from='client.101844 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:15:05.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:15:04 smithi047 bash[22744]: audit 2024-09-16T07:15:04.051260+0000 mon.b (mon.2) 423 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T07:15:05.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:15:04 smithi047 bash[22744]: audit 2024-09-16T07:15:04.053339+0000 mon.b (mon.2) 424 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T07:15:05.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:15:04 smithi047 bash[22744]: audit 2024-09-16T07:15:04.066226+0000 mon.a (mon.0) 825 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:15:05.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:15:04 smithi047 bash[22744]: audit 2024-09-16T07:15:04.069978+0000 mon.b (mon.2) 425 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:15:06.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:15:05 smithi157 bash[24585]: cluster 2024-09-16T07:15:03.786892+0000 mgr.a (mgr.14373) 4239 : cluster [DBG] pgmap v2940: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:15:06.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:15:05 smithi157 bash[24585]: audit 2024-09-16T07:15:04.074488+0000 mgr.a (mgr.14373) 4240 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:15:06.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:15:05 smithi086 bash[24289]: cluster 2024-09-16T07:15:03.786892+0000 mgr.a (mgr.14373) 4239 : cluster [DBG] pgmap v2940: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:15:06.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:15:05 smithi086 bash[24289]: audit 2024-09-16T07:15:04.074488+0000 mgr.a (mgr.14373) 4240 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:15:06.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:15:05 smithi047 bash[22744]: cluster 2024-09-16T07:15:03.786892+0000 mgr.a (mgr.14373) 4239 : cluster [DBG] pgmap v2940: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:15:06.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:15:05 smithi047 bash[22744]: audit 2024-09-16T07:15:04.074488+0000 mgr.a (mgr.14373) 4240 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:15:07.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:15:06 smithi157 bash[24585]: audit 2024-09-16T07:15:04.803825+0000 mgr.a (mgr.14373) 4241 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T07:15:07.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:15:06 smithi157 bash[24585]: cephadm 2024-09-16T07:15:04.805941+0000 mgr.a (mgr.14373) 4242 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T07:15:07.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:15:06 smithi086 bash[24289]: audit 2024-09-16T07:15:04.803825+0000 mgr.a (mgr.14373) 4241 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T07:15:07.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:15:06 smithi086 bash[24289]: cephadm 2024-09-16T07:15:04.805941+0000 mgr.a (mgr.14373) 4242 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T07:15:07.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:15:06 smithi047 bash[22744]: audit 2024-09-16T07:15:04.803825+0000 mgr.a (mgr.14373) 4241 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T07:15:07.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:15:06 smithi047 bash[22744]: cephadm 2024-09-16T07:15:04.805941+0000 mgr.a (mgr.14373) 4242 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T07:15:08.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:15:07 smithi157 bash[24585]: cluster 2024-09-16T07:15:05.787755+0000 mgr.a (mgr.14373) 4243 : cluster [DBG] pgmap v2941: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:15:08.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:15:07 smithi086 bash[24289]: cluster 2024-09-16T07:15:05.787755+0000 mgr.a (mgr.14373) 4243 : cluster [DBG] pgmap v2941: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:15:08.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:15:07 smithi047 bash[22744]: cluster 2024-09-16T07:15:05.787755+0000 mgr.a (mgr.14373) 4243 : cluster [DBG] pgmap v2941: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:15:08.320 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:15:08.321 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:15:08.321 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:15:09.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:15:08 smithi157 bash[24585]: cluster 2024-09-16T07:15:07.789974+0000 mgr.a (mgr.14373) 4244 : cluster [DBG] pgmap v2942: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:15:09.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:15:08 smithi086 bash[24289]: cluster 2024-09-16T07:15:07.789974+0000 mgr.a (mgr.14373) 4244 : cluster [DBG] pgmap v2942: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:15:09.076 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:15:09.076 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:15:09.077 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:15:09.077 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:15:09.077 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:15:09.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:15:08 smithi047 bash[22744]: cluster 2024-09-16T07:15:07.789974+0000 mgr.a (mgr.14373) 4244 : cluster [DBG] pgmap v2942: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:15:10.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:15:09 smithi157 bash[24585]: audit 2024-09-16T07:15:08.660700+0000 mgr.a (mgr.14373) 4245 : audit [DBG] from='client.102027 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:15:10.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:15:09 smithi086 bash[24289]: audit 2024-09-16T07:15:08.660700+0000 mgr.a (mgr.14373) 4245 : audit [DBG] from='client.102027 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:15:10.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:15:09 smithi047 bash[22744]: audit 2024-09-16T07:15:08.660700+0000 mgr.a (mgr.14373) 4245 : audit [DBG] from='client.102027 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:15:11.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:15:10 smithi157 bash[24585]: cluster 2024-09-16T07:15:09.790963+0000 mgr.a (mgr.14373) 4246 : cluster [DBG] pgmap v2943: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:15:11.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:15:10 smithi086 bash[24289]: cluster 2024-09-16T07:15:09.790963+0000 mgr.a (mgr.14373) 4246 : cluster [DBG] pgmap v2943: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:15:11.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:15:10 smithi047 bash[22744]: cluster 2024-09-16T07:15:09.790963+0000 mgr.a (mgr.14373) 4246 : cluster [DBG] pgmap v2943: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:15:13.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:15:12 smithi157 bash[24585]: cluster 2024-09-16T07:15:11.793136+0000 mgr.a (mgr.14373) 4247 : cluster [DBG] pgmap v2944: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:15:13.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:15:12 smithi086 bash[24289]: cluster 2024-09-16T07:15:11.793136+0000 mgr.a (mgr.14373) 4247 : cluster [DBG] pgmap v2944: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:15:13.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:15:12 smithi047 bash[22744]: cluster 2024-09-16T07:15:11.793136+0000 mgr.a (mgr.14373) 4247 : cluster [DBG] pgmap v2944: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:15:14.078 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:15:14.079 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:15:14.079 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:15:14.854 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:15:14.854 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:15:14.854 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:15:14.854 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:15:14.854 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:15:15.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:15:14 smithi157 bash[24585]: cluster 2024-09-16T07:15:13.793909+0000 mgr.a (mgr.14373) 4248 : cluster [DBG] pgmap v2945: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:15:15.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:15:14 smithi157 bash[24585]: audit 2024-09-16T07:15:14.415686+0000 mgr.a (mgr.14373) 4249 : audit [DBG] from='client.102105 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:15:15.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:15:14 smithi086 bash[24289]: cluster 2024-09-16T07:15:13.793909+0000 mgr.a (mgr.14373) 4248 : cluster [DBG] pgmap v2945: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:15:15.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:15:14 smithi086 bash[24289]: audit 2024-09-16T07:15:14.415686+0000 mgr.a (mgr.14373) 4249 : audit [DBG] from='client.102105 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:15:15.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:15:14 smithi047 bash[22744]: cluster 2024-09-16T07:15:13.793909+0000 mgr.a (mgr.14373) 4248 : cluster [DBG] pgmap v2945: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:15:15.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:15:14 smithi047 bash[22744]: audit 2024-09-16T07:15:14.415686+0000 mgr.a (mgr.14373) 4249 : audit [DBG] from='client.102105 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:15:17.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:15:16 smithi157 bash[24585]: cluster 2024-09-16T07:15:15.794844+0000 mgr.a (mgr.14373) 4250 : cluster [DBG] pgmap v2946: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:15:17.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:15:16 smithi086 bash[24289]: cluster 2024-09-16T07:15:15.794844+0000 mgr.a (mgr.14373) 4250 : cluster [DBG] pgmap v2946: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:15:17.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:15:16 smithi047 bash[22744]: cluster 2024-09-16T07:15:15.794844+0000 mgr.a (mgr.14373) 4250 : cluster [DBG] pgmap v2946: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:15:19.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:15:18 smithi157 bash[24585]: cluster 2024-09-16T07:15:17.797107+0000 mgr.a (mgr.14373) 4251 : cluster [DBG] pgmap v2947: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:15:19.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:15:18 smithi086 bash[24289]: cluster 2024-09-16T07:15:17.797107+0000 mgr.a (mgr.14373) 4251 : cluster [DBG] pgmap v2947: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:15:19.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:15:18 smithi047 bash[22744]: cluster 2024-09-16T07:15:17.797107+0000 mgr.a (mgr.14373) 4251 : cluster [DBG] pgmap v2947: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:15:19.855 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:15:19.856 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:15:19.856 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:15:20.607 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:15:20.608 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:15:20.608 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:15:20.608 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:15:20.608 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:15:21.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:15:20 smithi157 bash[24585]: cluster 2024-09-16T07:15:19.797892+0000 mgr.a (mgr.14373) 4252 : cluster [DBG] pgmap v2948: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:15:21.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:15:20 smithi157 bash[24585]: audit 2024-09-16T07:15:20.191414+0000 mgr.a (mgr.14373) 4253 : audit [DBG] from='client.102183 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:15:21.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:15:20 smithi086 bash[24289]: cluster 2024-09-16T07:15:19.797892+0000 mgr.a (mgr.14373) 4252 : cluster [DBG] pgmap v2948: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:15:21.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:15:20 smithi086 bash[24289]: audit 2024-09-16T07:15:20.191414+0000 mgr.a (mgr.14373) 4253 : audit [DBG] from='client.102183 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:15:21.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:15:20 smithi047 bash[22744]: cluster 2024-09-16T07:15:19.797892+0000 mgr.a (mgr.14373) 4252 : cluster [DBG] pgmap v2948: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:15:21.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:15:20 smithi047 bash[22744]: audit 2024-09-16T07:15:20.191414+0000 mgr.a (mgr.14373) 4253 : audit [DBG] from='client.102183 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:15:23.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:15:22 smithi157 bash[24585]: cluster 2024-09-16T07:15:21.800129+0000 mgr.a (mgr.14373) 4254 : cluster [DBG] pgmap v2949: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:15:23.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:15:22 smithi086 bash[24289]: cluster 2024-09-16T07:15:21.800129+0000 mgr.a (mgr.14373) 4254 : cluster [DBG] pgmap v2949: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:15:23.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:15:22 smithi047 bash[22744]: cluster 2024-09-16T07:15:21.800129+0000 mgr.a (mgr.14373) 4254 : cluster [DBG] pgmap v2949: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:15:25.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:15:24 smithi157 bash[24585]: cluster 2024-09-16T07:15:23.800900+0000 mgr.a (mgr.14373) 4255 : cluster [DBG] pgmap v2950: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:15:25.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:15:24 smithi086 bash[24289]: cluster 2024-09-16T07:15:23.800900+0000 mgr.a (mgr.14373) 4255 : cluster [DBG] pgmap v2950: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:15:25.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:15:24 smithi047 bash[22744]: cluster 2024-09-16T07:15:23.800900+0000 mgr.a (mgr.14373) 4255 : cluster [DBG] pgmap v2950: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:15:25.609 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:15:25.610 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:15:25.610 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:15:26.362 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:15:26.362 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:15:26.362 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:15:26.362 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:15:26.362 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:15:27.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:15:26 smithi157 bash[24585]: cluster 2024-09-16T07:15:25.801663+0000 mgr.a (mgr.14373) 4256 : cluster [DBG] pgmap v2951: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:15:27.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:15:26 smithi157 bash[24585]: audit 2024-09-16T07:15:25.943359+0000 mgr.a (mgr.14373) 4257 : audit [DBG] from='client.102258 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:15:27.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:15:26 smithi086 bash[24289]: cluster 2024-09-16T07:15:25.801663+0000 mgr.a (mgr.14373) 4256 : cluster [DBG] pgmap v2951: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:15:27.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:15:26 smithi086 bash[24289]: audit 2024-09-16T07:15:25.943359+0000 mgr.a (mgr.14373) 4257 : audit [DBG] from='client.102258 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:15:27.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:15:26 smithi047 bash[22744]: cluster 2024-09-16T07:15:25.801663+0000 mgr.a (mgr.14373) 4256 : cluster [DBG] pgmap v2951: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:15:27.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:15:26 smithi047 bash[22744]: audit 2024-09-16T07:15:25.943359+0000 mgr.a (mgr.14373) 4257 : audit [DBG] from='client.102258 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:15:29.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:15:28 smithi157 bash[24585]: cluster 2024-09-16T07:15:27.804051+0000 mgr.a (mgr.14373) 4258 : cluster [DBG] pgmap v2952: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:15:29.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:15:28 smithi086 bash[24289]: cluster 2024-09-16T07:15:27.804051+0000 mgr.a (mgr.14373) 4258 : cluster [DBG] pgmap v2952: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:15:29.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:15:28 smithi047 bash[22744]: cluster 2024-09-16T07:15:27.804051+0000 mgr.a (mgr.14373) 4258 : cluster [DBG] pgmap v2952: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:15:31.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:15:30 smithi157 bash[24585]: cluster 2024-09-16T07:15:29.804811+0000 mgr.a (mgr.14373) 4259 : cluster [DBG] pgmap v2953: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:15:31.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:15:30 smithi086 bash[24289]: cluster 2024-09-16T07:15:29.804811+0000 mgr.a (mgr.14373) 4259 : cluster [DBG] pgmap v2953: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:15:31.341 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:15:30 smithi047 bash[22744]: cluster 2024-09-16T07:15:29.804811+0000 mgr.a (mgr.14373) 4259 : cluster [DBG] pgmap v2953: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:15:31.363 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:15:31.364 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:15:31.365 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:15:32.116 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:15:32.117 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:15:32.117 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:15:32.117 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:15:32.117 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:15:33.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:15:32 smithi157 bash[24585]: audit 2024-09-16T07:15:31.698559+0000 mgr.a (mgr.14373) 4260 : audit [DBG] from='client.102336 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:15:33.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:15:32 smithi157 bash[24585]: cluster 2024-09-16T07:15:31.806096+0000 mgr.a (mgr.14373) 4261 : cluster [DBG] pgmap v2954: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:15:33.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:15:32 smithi086 bash[24289]: audit 2024-09-16T07:15:31.698559+0000 mgr.a (mgr.14373) 4260 : audit [DBG] from='client.102336 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:15:33.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:15:32 smithi086 bash[24289]: cluster 2024-09-16T07:15:31.806096+0000 mgr.a (mgr.14373) 4261 : cluster [DBG] pgmap v2954: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:15:33.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:15:32 smithi047 bash[22744]: audit 2024-09-16T07:15:31.698559+0000 mgr.a (mgr.14373) 4260 : audit [DBG] from='client.102336 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:15:33.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:15:32 smithi047 bash[22744]: cluster 2024-09-16T07:15:31.806096+0000 mgr.a (mgr.14373) 4261 : cluster [DBG] pgmap v2954: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:15:35.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:15:34 smithi157 bash[24585]: cluster 2024-09-16T07:15:33.807099+0000 mgr.a (mgr.14373) 4262 : cluster [DBG] pgmap v2955: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T07:15:35.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:15:34 smithi086 bash[24289]: cluster 2024-09-16T07:15:33.807099+0000 mgr.a (mgr.14373) 4262 : cluster [DBG] pgmap v2955: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T07:15:35.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:15:34 smithi047 bash[22744]: cluster 2024-09-16T07:15:33.807099+0000 mgr.a (mgr.14373) 4262 : cluster [DBG] pgmap v2955: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T07:15:37.118 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:15:37.119 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:15:37.120 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:15:37.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:15:36 smithi157 bash[24585]: cluster 2024-09-16T07:15:35.807891+0000 mgr.a (mgr.14373) 4263 : cluster [DBG] pgmap v2956: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T07:15:37.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:15:36 smithi086 bash[24289]: cluster 2024-09-16T07:15:35.807891+0000 mgr.a (mgr.14373) 4263 : cluster [DBG] pgmap v2956: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T07:15:37.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:15:36 smithi047 bash[22744]: cluster 2024-09-16T07:15:35.807891+0000 mgr.a (mgr.14373) 4263 : cluster [DBG] pgmap v2956: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T07:15:37.860 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:15:37.861 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:15:37.861 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:15:37.861 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:15:37.861 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:15:38.305 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:15:37 smithi157 bash[24585]: audit 2024-09-16T07:15:37.452190+0000 mgr.a (mgr.14373) 4264 : audit [DBG] from='client.102408 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:15:38.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:15:37 smithi086 bash[24289]: audit 2024-09-16T07:15:37.452190+0000 mgr.a (mgr.14373) 4264 : audit [DBG] from='client.102408 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:15:38.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:15:37 smithi047 bash[22744]: audit 2024-09-16T07:15:37.452190+0000 mgr.a (mgr.14373) 4264 : audit [DBG] from='client.102408 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:15:39.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:15:38 smithi157 bash[24585]: cluster 2024-09-16T07:15:37.809237+0000 mgr.a (mgr.14373) 4265 : cluster [DBG] pgmap v2957: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:15:39.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:15:38 smithi086 bash[24289]: cluster 2024-09-16T07:15:37.809237+0000 mgr.a (mgr.14373) 4265 : cluster [DBG] pgmap v2957: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:15:39.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:15:38 smithi047 bash[22744]: cluster 2024-09-16T07:15:37.809237+0000 mgr.a (mgr.14373) 4265 : cluster [DBG] pgmap v2957: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:15:41.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:15:40 smithi157 bash[24585]: cluster 2024-09-16T07:15:39.809960+0000 mgr.a (mgr.14373) 4266 : cluster [DBG] pgmap v2958: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T07:15:41.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:15:40 smithi086 bash[24289]: cluster 2024-09-16T07:15:39.809960+0000 mgr.a (mgr.14373) 4266 : cluster [DBG] pgmap v2958: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T07:15:41.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:15:40 smithi047 bash[22744]: cluster 2024-09-16T07:15:39.809960+0000 mgr.a (mgr.14373) 4266 : cluster [DBG] pgmap v2958: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T07:15:42.862 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:15:42.863 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:15:42.863 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:15:43.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:15:42 smithi157 bash[24585]: cluster 2024-09-16T07:15:41.811909+0000 mgr.a (mgr.14373) 4267 : cluster [DBG] pgmap v2959: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:15:43.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:15:42 smithi086 bash[24289]: cluster 2024-09-16T07:15:41.811909+0000 mgr.a (mgr.14373) 4267 : cluster [DBG] pgmap v2959: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:15:43.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:15:42 smithi047 bash[22744]: cluster 2024-09-16T07:15:41.811909+0000 mgr.a (mgr.14373) 4267 : cluster [DBG] pgmap v2959: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:15:43.642 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:15:43.643 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:15:43.643 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:15:43.643 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:15:43.643 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:15:44.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:15:43 smithi157 bash[24585]: audit 2024-09-16T07:15:43.202137+0000 mgr.a (mgr.14373) 4268 : audit [DBG] from='client.102486 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:15:44.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:15:43 smithi086 bash[24289]: audit 2024-09-16T07:15:43.202137+0000 mgr.a (mgr.14373) 4268 : audit [DBG] from='client.102486 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:15:44.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:15:43 smithi047 bash[22744]: audit 2024-09-16T07:15:43.202137+0000 mgr.a (mgr.14373) 4268 : audit [DBG] from='client.102486 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:15:45.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:15:44 smithi157 bash[24585]: cluster 2024-09-16T07:15:43.812808+0000 mgr.a (mgr.14373) 4269 : cluster [DBG] pgmap v2960: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:15:45.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:15:44 smithi086 bash[24289]: cluster 2024-09-16T07:15:43.812808+0000 mgr.a (mgr.14373) 4269 : cluster [DBG] pgmap v2960: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:15:45.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:15:44 smithi047 bash[22744]: cluster 2024-09-16T07:15:43.812808+0000 mgr.a (mgr.14373) 4269 : cluster [DBG] pgmap v2960: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:15:47.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:15:46 smithi157 bash[24585]: cluster 2024-09-16T07:15:45.813581+0000 mgr.a (mgr.14373) 4270 : cluster [DBG] pgmap v2961: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:15:47.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:15:46 smithi086 bash[24289]: cluster 2024-09-16T07:15:45.813581+0000 mgr.a (mgr.14373) 4270 : cluster [DBG] pgmap v2961: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:15:47.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:15:46 smithi047 bash[22744]: cluster 2024-09-16T07:15:45.813581+0000 mgr.a (mgr.14373) 4270 : cluster [DBG] pgmap v2961: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:15:48.644 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:15:48.645 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:15:48.645 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:15:49.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:15:48 smithi157 bash[24585]: cluster 2024-09-16T07:15:47.815786+0000 mgr.a (mgr.14373) 4271 : cluster [DBG] pgmap v2962: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:15:49.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:15:48 smithi086 bash[24289]: cluster 2024-09-16T07:15:47.815786+0000 mgr.a (mgr.14373) 4271 : cluster [DBG] pgmap v2962: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:15:49.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:15:48 smithi047 bash[22744]: cluster 2024-09-16T07:15:47.815786+0000 mgr.a (mgr.14373) 4271 : cluster [DBG] pgmap v2962: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:15:49.397 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:15:49.398 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:15:49.398 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:15:49.398 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:15:49.398 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:15:50.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:15:49 smithi157 bash[24585]: audit 2024-09-16T07:15:48.983364+0000 mgr.a (mgr.14373) 4272 : audit [DBG] from='client.102558 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:15:50.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:15:49 smithi086 bash[24289]: audit 2024-09-16T07:15:48.983364+0000 mgr.a (mgr.14373) 4272 : audit [DBG] from='client.102558 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:15:50.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:15:49 smithi047 bash[22744]: audit 2024-09-16T07:15:48.983364+0000 mgr.a (mgr.14373) 4272 : audit [DBG] from='client.102558 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:15:51.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:15:50 smithi157 bash[24585]: cluster 2024-09-16T07:15:49.816713+0000 mgr.a (mgr.14373) 4273 : cluster [DBG] pgmap v2963: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:15:51.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:15:50 smithi086 bash[24289]: cluster 2024-09-16T07:15:49.816713+0000 mgr.a (mgr.14373) 4273 : cluster [DBG] pgmap v2963: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:15:51.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:15:50 smithi047 bash[22744]: cluster 2024-09-16T07:15:49.816713+0000 mgr.a (mgr.14373) 4273 : cluster [DBG] pgmap v2963: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:15:53.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:15:52 smithi157 bash[24585]: cluster 2024-09-16T07:15:51.818903+0000 mgr.a (mgr.14373) 4274 : cluster [DBG] pgmap v2964: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:15:53.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:15:52 smithi086 bash[24289]: cluster 2024-09-16T07:15:51.818903+0000 mgr.a (mgr.14373) 4274 : cluster [DBG] pgmap v2964: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:15:53.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:15:52 smithi047 bash[22744]: cluster 2024-09-16T07:15:51.818903+0000 mgr.a (mgr.14373) 4274 : cluster [DBG] pgmap v2964: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:15:54.399 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:15:54.400 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:15:54.400 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:15:55.178 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:15:55.178 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:15:55.178 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:15:55.178 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:15:55.179 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:15:55.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:15:54 smithi157 bash[24585]: cluster 2024-09-16T07:15:53.819643+0000 mgr.a (mgr.14373) 4275 : cluster [DBG] pgmap v2965: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:15:55.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:15:54 smithi086 bash[24289]: cluster 2024-09-16T07:15:53.819643+0000 mgr.a (mgr.14373) 4275 : cluster [DBG] pgmap v2965: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:15:55.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:15:54 smithi047 bash[22744]: cluster 2024-09-16T07:15:53.819643+0000 mgr.a (mgr.14373) 4275 : cluster [DBG] pgmap v2965: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:15:56.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:15:55 smithi157 bash[24585]: audit 2024-09-16T07:15:54.737970+0000 mgr.a (mgr.14373) 4276 : audit [DBG] from='client.102636 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:15:56.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:15:55 smithi086 bash[24289]: audit 2024-09-16T07:15:54.737970+0000 mgr.a (mgr.14373) 4276 : audit [DBG] from='client.102636 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:15:56.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:15:55 smithi047 bash[22744]: audit 2024-09-16T07:15:54.737970+0000 mgr.a (mgr.14373) 4276 : audit [DBG] from='client.102636 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:15:57.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:15:56 smithi157 bash[24585]: cluster 2024-09-16T07:15:55.820558+0000 mgr.a (mgr.14373) 4277 : cluster [DBG] pgmap v2966: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:15:57.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:15:56 smithi086 bash[24289]: cluster 2024-09-16T07:15:55.820558+0000 mgr.a (mgr.14373) 4277 : cluster [DBG] pgmap v2966: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:15:57.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:15:56 smithi047 bash[22744]: cluster 2024-09-16T07:15:55.820558+0000 mgr.a (mgr.14373) 4277 : cluster [DBG] pgmap v2966: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:15:59.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:15:58 smithi157 bash[24585]: cluster 2024-09-16T07:15:57.822846+0000 mgr.a (mgr.14373) 4278 : cluster [DBG] pgmap v2967: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:15:59.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:15:58 smithi086 bash[24289]: cluster 2024-09-16T07:15:57.822846+0000 mgr.a (mgr.14373) 4278 : cluster [DBG] pgmap v2967: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:15:59.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:15:58 smithi047 bash[22744]: cluster 2024-09-16T07:15:57.822846+0000 mgr.a (mgr.14373) 4278 : cluster [DBG] pgmap v2967: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:16:00.179 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:16:00.180 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:16:00.180 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:16:00.915 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:16:00.915 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:16:00.915 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:16:00.915 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:16:00.915 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:16:01.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:16:00 smithi157 bash[24585]: cluster 2024-09-16T07:15:59.823631+0000 mgr.a (mgr.14373) 4279 : cluster [DBG] pgmap v2968: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:16:01.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:16:00 smithi157 bash[24585]: audit 2024-09-16T07:16:00.508414+0000 mgr.a (mgr.14373) 4280 : audit [DBG] from='client.102714 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:16:01.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:16:00 smithi086 bash[24289]: cluster 2024-09-16T07:15:59.823631+0000 mgr.a (mgr.14373) 4279 : cluster [DBG] pgmap v2968: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:16:01.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:16:00 smithi086 bash[24289]: audit 2024-09-16T07:16:00.508414+0000 mgr.a (mgr.14373) 4280 : audit [DBG] from='client.102714 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:16:01.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:16:00 smithi047 bash[22744]: cluster 2024-09-16T07:15:59.823631+0000 mgr.a (mgr.14373) 4279 : cluster [DBG] pgmap v2968: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:16:01.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:16:00 smithi047 bash[22744]: audit 2024-09-16T07:16:00.508414+0000 mgr.a (mgr.14373) 4280 : audit [DBG] from='client.102714 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:16:03.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:16:02 smithi157 bash[24585]: cluster 2024-09-16T07:16:01.825812+0000 mgr.a (mgr.14373) 4281 : cluster [DBG] pgmap v2969: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:16:03.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:16:02 smithi086 bash[24289]: cluster 2024-09-16T07:16:01.825812+0000 mgr.a (mgr.14373) 4281 : cluster [DBG] pgmap v2969: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:16:03.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:16:02 smithi047 bash[22744]: cluster 2024-09-16T07:16:01.825812+0000 mgr.a (mgr.14373) 4281 : cluster [DBG] pgmap v2969: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:16:05.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:16:04 smithi157 bash[24585]: cluster 2024-09-16T07:16:03.826571+0000 mgr.a (mgr.14373) 4282 : cluster [DBG] pgmap v2970: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:16:05.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:16:04 smithi157 bash[24585]: audit 2024-09-16T07:16:04.858057+0000 mon.b (mon.2) 426 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T07:16:05.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:16:04 smithi086 bash[24289]: cluster 2024-09-16T07:16:03.826571+0000 mgr.a (mgr.14373) 4282 : cluster [DBG] pgmap v2970: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:16:05.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:16:04 smithi086 bash[24289]: audit 2024-09-16T07:16:04.858057+0000 mon.b (mon.2) 426 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T07:16:05.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:16:04 smithi047 bash[22744]: cluster 2024-09-16T07:16:03.826571+0000 mgr.a (mgr.14373) 4282 : cluster [DBG] pgmap v2970: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:16:05.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:16:04 smithi047 bash[22744]: audit 2024-09-16T07:16:04.858057+0000 mon.b (mon.2) 426 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T07:16:05.916 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:16:05.917 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:16:05.917 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:16:06.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:16:05 smithi157 bash[24585]: audit 2024-09-16T07:16:05.689263+0000 mon.b (mon.2) 427 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T07:16:06.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:16:05 smithi157 bash[24585]: audit 2024-09-16T07:16:05.691174+0000 mon.b (mon.2) 428 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T07:16:06.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:16:05 smithi157 bash[24585]: audit 2024-09-16T07:16:05.703715+0000 mon.a (mon.0) 826 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:16:06.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:16:05 smithi157 bash[24585]: audit 2024-09-16T07:16:05.706187+0000 mon.b (mon.2) 429 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:16:06.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:16:05 smithi086 bash[24289]: audit 2024-09-16T07:16:05.689263+0000 mon.b (mon.2) 427 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T07:16:06.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:16:05 smithi086 bash[24289]: audit 2024-09-16T07:16:05.691174+0000 mon.b (mon.2) 428 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T07:16:06.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:16:05 smithi086 bash[24289]: audit 2024-09-16T07:16:05.703715+0000 mon.a (mon.0) 826 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:16:06.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:16:05 smithi086 bash[24289]: audit 2024-09-16T07:16:05.706187+0000 mon.b (mon.2) 429 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:16:06.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:16:05 smithi047 bash[22744]: audit 2024-09-16T07:16:05.689263+0000 mon.b (mon.2) 427 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T07:16:06.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:16:05 smithi047 bash[22744]: audit 2024-09-16T07:16:05.691174+0000 mon.b (mon.2) 428 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T07:16:06.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:16:05 smithi047 bash[22744]: audit 2024-09-16T07:16:05.703715+0000 mon.a (mon.0) 826 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:16:06.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:16:05 smithi047 bash[22744]: audit 2024-09-16T07:16:05.706187+0000 mon.b (mon.2) 429 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:16:06.838 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 07:16:06 smithi047 bash[22994]: debug 2024-09-16T07:16:06.443+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T07:16:06.838 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 07:16:06 smithi047 bash[22994]: debug 2024-09-16T07:16:06.455+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T07:16:06.844 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:16:06.844 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:16:06.844 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:16:06.844 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:16:06.844 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:16:07.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:16:06 smithi157 bash[24585]: audit 2024-09-16T07:16:05.710446+0000 mgr.a (mgr.14373) 4283 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:16:07.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:16:06 smithi157 bash[24585]: cluster 2024-09-16T07:16:05.827063+0000 mgr.a (mgr.14373) 4284 : cluster [DBG] pgmap v2971: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:16:07.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:16:06 smithi157 bash[24585]: audit 2024-09-16T07:16:06.253674+0000 mgr.a (mgr.14373) 4285 : audit [DBG] from='client.102828 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:16:07.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:16:06 smithi157 bash[24585]: audit 2024-09-16T07:16:06.450171+0000 mgr.a (mgr.14373) 4286 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T07:16:07.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:16:06 smithi157 bash[24585]: cephadm 2024-09-16T07:16:06.461669+0000 mgr.a (mgr.14373) 4287 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T07:16:07.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:16:06 smithi086 bash[24289]: audit 2024-09-16T07:16:05.710446+0000 mgr.a (mgr.14373) 4283 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:16:07.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:16:06 smithi086 bash[24289]: cluster 2024-09-16T07:16:05.827063+0000 mgr.a (mgr.14373) 4284 : cluster [DBG] pgmap v2971: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:16:07.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:16:06 smithi086 bash[24289]: audit 2024-09-16T07:16:06.253674+0000 mgr.a (mgr.14373) 4285 : audit [DBG] from='client.102828 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:16:07.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:16:06 smithi086 bash[24289]: audit 2024-09-16T07:16:06.450171+0000 mgr.a (mgr.14373) 4286 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T07:16:07.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:16:06 smithi086 bash[24289]: cephadm 2024-09-16T07:16:06.461669+0000 mgr.a (mgr.14373) 4287 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T07:16:07.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:16:06 smithi047 bash[22744]: audit 2024-09-16T07:16:05.710446+0000 mgr.a (mgr.14373) 4283 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:16:07.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:16:06 smithi047 bash[22744]: cluster 2024-09-16T07:16:05.827063+0000 mgr.a (mgr.14373) 4284 : cluster [DBG] pgmap v2971: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:16:07.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:16:06 smithi047 bash[22744]: audit 2024-09-16T07:16:06.253674+0000 mgr.a (mgr.14373) 4285 : audit [DBG] from='client.102828 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:16:07.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:16:06 smithi047 bash[22744]: audit 2024-09-16T07:16:06.450171+0000 mgr.a (mgr.14373) 4286 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T07:16:07.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:16:06 smithi047 bash[22744]: cephadm 2024-09-16T07:16:06.461669+0000 mgr.a (mgr.14373) 4287 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T07:16:09.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:16:09 smithi157 bash[24585]: cluster 2024-09-16T07:16:07.829701+0000 mgr.a (mgr.14373) 4288 : cluster [DBG] pgmap v2972: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:16:09.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:16:09 smithi086 bash[24289]: cluster 2024-09-16T07:16:07.829701+0000 mgr.a (mgr.14373) 4288 : cluster [DBG] pgmap v2972: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:16:09.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:16:09 smithi047 bash[22744]: cluster 2024-09-16T07:16:07.829701+0000 mgr.a (mgr.14373) 4288 : cluster [DBG] pgmap v2972: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:16:11.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:16:11 smithi157 bash[24585]: cluster 2024-09-16T07:16:09.830501+0000 mgr.a (mgr.14373) 4289 : cluster [DBG] pgmap v2973: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T07:16:11.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:16:11 smithi086 bash[24289]: cluster 2024-09-16T07:16:09.830501+0000 mgr.a (mgr.14373) 4289 : cluster [DBG] pgmap v2973: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T07:16:11.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:16:11 smithi047 bash[22744]: cluster 2024-09-16T07:16:09.830501+0000 mgr.a (mgr.14373) 4289 : cluster [DBG] pgmap v2973: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T07:16:11.845 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:16:11.846 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:16:11.846 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:16:12.597 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:16:12.597 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:16:12.597 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:16:12.598 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:16:12.598 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:16:13.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:16:13 smithi157 bash[24585]: cluster 2024-09-16T07:16:11.832415+0000 mgr.a (mgr.14373) 4290 : cluster [DBG] pgmap v2974: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:16:13.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:16:13 smithi157 bash[24585]: audit 2024-09-16T07:16:12.186417+0000 mgr.a (mgr.14373) 4291 : audit [DBG] from='client.102966 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:16:13.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:16:13 smithi086 bash[24289]: cluster 2024-09-16T07:16:11.832415+0000 mgr.a (mgr.14373) 4290 : cluster [DBG] pgmap v2974: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:16:13.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:16:13 smithi086 bash[24289]: audit 2024-09-16T07:16:12.186417+0000 mgr.a (mgr.14373) 4291 : audit [DBG] from='client.102966 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:16:13.340 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:16:13 smithi047 bash[22744]: cluster 2024-09-16T07:16:11.832415+0000 mgr.a (mgr.14373) 4290 : cluster [DBG] pgmap v2974: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:16:13.340 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:16:13 smithi047 bash[22744]: audit 2024-09-16T07:16:12.186417+0000 mgr.a (mgr.14373) 4291 : audit [DBG] from='client.102966 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:16:15.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:16:15 smithi157 bash[24585]: cluster 2024-09-16T07:16:13.833304+0000 mgr.a (mgr.14373) 4292 : cluster [DBG] pgmap v2975: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T07:16:15.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:16:15 smithi086 bash[24289]: cluster 2024-09-16T07:16:13.833304+0000 mgr.a (mgr.14373) 4292 : cluster [DBG] pgmap v2975: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T07:16:15.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:16:15 smithi047 bash[22744]: cluster 2024-09-16T07:16:13.833304+0000 mgr.a (mgr.14373) 4292 : cluster [DBG] pgmap v2975: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T07:16:17.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:16:17 smithi157 bash[24585]: cluster 2024-09-16T07:16:15.834069+0000 mgr.a (mgr.14373) 4293 : cluster [DBG] pgmap v2976: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T07:16:17.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:16:17 smithi086 bash[24289]: cluster 2024-09-16T07:16:15.834069+0000 mgr.a (mgr.14373) 4293 : cluster [DBG] pgmap v2976: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T07:16:17.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:16:17 smithi047 bash[22744]: cluster 2024-09-16T07:16:15.834069+0000 mgr.a (mgr.14373) 4293 : cluster [DBG] pgmap v2976: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T07:16:17.599 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:16:17.599 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:16:17.600 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:16:18.346 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:16:18.346 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:16:18.346 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:16:18.346 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:16:18.346 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:16:19.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:16:19 smithi157 bash[24585]: cluster 2024-09-16T07:16:17.836248+0000 mgr.a (mgr.14373) 4294 : cluster [DBG] pgmap v2977: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:16:19.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:16:19 smithi157 bash[24585]: audit 2024-09-16T07:16:17.933868+0000 mgr.a (mgr.14373) 4295 : audit [DBG] from='client.103041 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:16:19.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:16:19 smithi086 bash[24289]: cluster 2024-09-16T07:16:17.836248+0000 mgr.a (mgr.14373) 4294 : cluster [DBG] pgmap v2977: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:16:19.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:16:19 smithi086 bash[24289]: audit 2024-09-16T07:16:17.933868+0000 mgr.a (mgr.14373) 4295 : audit [DBG] from='client.103041 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:16:19.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:16:19 smithi047 bash[22744]: cluster 2024-09-16T07:16:17.836248+0000 mgr.a (mgr.14373) 4294 : cluster [DBG] pgmap v2977: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:16:19.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:16:19 smithi047 bash[22744]: audit 2024-09-16T07:16:17.933868+0000 mgr.a (mgr.14373) 4295 : audit [DBG] from='client.103041 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:16:21.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:16:21 smithi157 bash[24585]: cluster 2024-09-16T07:16:19.837139+0000 mgr.a (mgr.14373) 4296 : cluster [DBG] pgmap v2978: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:16:21.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:16:21 smithi086 bash[24289]: cluster 2024-09-16T07:16:19.837139+0000 mgr.a (mgr.14373) 4296 : cluster [DBG] pgmap v2978: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:16:21.340 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:16:21 smithi047 bash[22744]: cluster 2024-09-16T07:16:19.837139+0000 mgr.a (mgr.14373) 4296 : cluster [DBG] pgmap v2978: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:16:23.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:16:23 smithi157 bash[24585]: cluster 2024-09-16T07:16:21.839268+0000 mgr.a (mgr.14373) 4297 : cluster [DBG] pgmap v2979: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:16:23.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:16:23 smithi086 bash[24289]: cluster 2024-09-16T07:16:21.839268+0000 mgr.a (mgr.14373) 4297 : cluster [DBG] pgmap v2979: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:16:23.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:16:23 smithi047 bash[22744]: cluster 2024-09-16T07:16:21.839268+0000 mgr.a (mgr.14373) 4297 : cluster [DBG] pgmap v2979: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:16:23.347 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:16:23.348 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:16:23.349 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:16:24.122 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:16:24.122 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:16:24.122 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:16:24.122 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:16:24.122 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:16:25.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:16:25 smithi157 bash[24585]: audit 2024-09-16T07:16:23.688863+0000 mgr.a (mgr.14373) 4298 : audit [DBG] from='client.103116 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:16:25.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:16:25 smithi157 bash[24585]: cluster 2024-09-16T07:16:23.839812+0000 mgr.a (mgr.14373) 4299 : cluster [DBG] pgmap v2980: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:16:25.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:16:25 smithi086 bash[24289]: audit 2024-09-16T07:16:23.688863+0000 mgr.a (mgr.14373) 4298 : audit [DBG] from='client.103116 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:16:25.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:16:25 smithi086 bash[24289]: cluster 2024-09-16T07:16:23.839812+0000 mgr.a (mgr.14373) 4299 : cluster [DBG] pgmap v2980: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:16:25.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:16:25 smithi047 bash[22744]: audit 2024-09-16T07:16:23.688863+0000 mgr.a (mgr.14373) 4298 : audit [DBG] from='client.103116 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:16:25.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:16:25 smithi047 bash[22744]: cluster 2024-09-16T07:16:23.839812+0000 mgr.a (mgr.14373) 4299 : cluster [DBG] pgmap v2980: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:16:27.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:16:27 smithi157 bash[24585]: cluster 2024-09-16T07:16:25.840696+0000 mgr.a (mgr.14373) 4300 : cluster [DBG] pgmap v2981: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:16:27.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:16:27 smithi086 bash[24289]: cluster 2024-09-16T07:16:25.840696+0000 mgr.a (mgr.14373) 4300 : cluster [DBG] pgmap v2981: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:16:27.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:16:27 smithi047 bash[22744]: cluster 2024-09-16T07:16:25.840696+0000 mgr.a (mgr.14373) 4300 : cluster [DBG] pgmap v2981: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:16:29.124 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:16:29.125 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:16:29.125 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:16:29.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:16:29 smithi157 bash[24585]: cluster 2024-09-16T07:16:27.842948+0000 mgr.a (mgr.14373) 4301 : cluster [DBG] pgmap v2982: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:16:29.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:16:29 smithi086 bash[24289]: cluster 2024-09-16T07:16:27.842948+0000 mgr.a (mgr.14373) 4301 : cluster [DBG] pgmap v2982: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:16:29.340 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:16:29 smithi047 bash[22744]: cluster 2024-09-16T07:16:27.842948+0000 mgr.a (mgr.14373) 4301 : cluster [DBG] pgmap v2982: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:16:29.857 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:16:29.858 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:16:29.858 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:16:29.858 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:16:29.858 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:16:30.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:16:30 smithi157 bash[24585]: audit 2024-09-16T07:16:29.454496+0000 mgr.a (mgr.14373) 4302 : audit [DBG] from='client.103191 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:16:30.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:16:30 smithi086 bash[24289]: audit 2024-09-16T07:16:29.454496+0000 mgr.a (mgr.14373) 4302 : audit [DBG] from='client.103191 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:16:30.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:16:30 smithi047 bash[22744]: audit 2024-09-16T07:16:29.454496+0000 mgr.a (mgr.14373) 4302 : audit [DBG] from='client.103191 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:16:31.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:16:31 smithi086 bash[24289]: cluster 2024-09-16T07:16:29.843423+0000 mgr.a (mgr.14373) 4303 : cluster [DBG] pgmap v2983: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:16:31.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:16:31 smithi047 bash[22744]: cluster 2024-09-16T07:16:29.843423+0000 mgr.a (mgr.14373) 4303 : cluster [DBG] pgmap v2983: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:16:31.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:16:31 smithi157 bash[24585]: cluster 2024-09-16T07:16:29.843423+0000 mgr.a (mgr.14373) 4303 : cluster [DBG] pgmap v2983: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:16:33.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:16:33 smithi086 bash[24289]: cluster 2024-09-16T07:16:31.845555+0000 mgr.a (mgr.14373) 4304 : cluster [DBG] pgmap v2984: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:16:33.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:16:33 smithi047 bash[22744]: cluster 2024-09-16T07:16:31.845555+0000 mgr.a (mgr.14373) 4304 : cluster [DBG] pgmap v2984: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:16:33.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:16:33 smithi157 bash[24585]: cluster 2024-09-16T07:16:31.845555+0000 mgr.a (mgr.14373) 4304 : cluster [DBG] pgmap v2984: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:16:34.859 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:16:34.860 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:16:34.860 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:16:35.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:16:35 smithi086 bash[24289]: cluster 2024-09-16T07:16:33.846323+0000 mgr.a (mgr.14373) 4305 : cluster [DBG] pgmap v2985: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:16:35.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:16:35 smithi047 bash[22744]: cluster 2024-09-16T07:16:33.846323+0000 mgr.a (mgr.14373) 4305 : cluster [DBG] pgmap v2985: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:16:35.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:16:35 smithi157 bash[24585]: cluster 2024-09-16T07:16:33.846323+0000 mgr.a (mgr.14373) 4305 : cluster [DBG] pgmap v2985: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:16:35.609 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:16:35.609 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:16:35.609 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:16:35.609 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:16:35.609 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:16:36.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:16:36 smithi086 bash[24289]: audit 2024-09-16T07:16:35.187004+0000 mgr.a (mgr.14373) 4306 : audit [DBG] from='client.103263 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:16:36.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:16:36 smithi047 bash[22744]: audit 2024-09-16T07:16:35.187004+0000 mgr.a (mgr.14373) 4306 : audit [DBG] from='client.103263 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:16:36.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:16:36 smithi157 bash[24585]: audit 2024-09-16T07:16:35.187004+0000 mgr.a (mgr.14373) 4306 : audit [DBG] from='client.103263 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:16:37.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:16:37 smithi047 bash[22744]: cluster 2024-09-16T07:16:35.847204+0000 mgr.a (mgr.14373) 4307 : cluster [DBG] pgmap v2986: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:16:37.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:16:37 smithi157 bash[24585]: cluster 2024-09-16T07:16:35.847204+0000 mgr.a (mgr.14373) 4307 : cluster [DBG] pgmap v2986: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:16:37.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:16:37 smithi086 bash[24289]: cluster 2024-09-16T07:16:35.847204+0000 mgr.a (mgr.14373) 4307 : cluster [DBG] pgmap v2986: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:16:39.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:16:39 smithi047 bash[22744]: cluster 2024-09-16T07:16:37.849558+0000 mgr.a (mgr.14373) 4308 : cluster [DBG] pgmap v2987: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:16:39.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:16:39 smithi157 bash[24585]: cluster 2024-09-16T07:16:37.849558+0000 mgr.a (mgr.14373) 4308 : cluster [DBG] pgmap v2987: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:16:39.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:16:39 smithi086 bash[24289]: cluster 2024-09-16T07:16:37.849558+0000 mgr.a (mgr.14373) 4308 : cluster [DBG] pgmap v2987: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:16:40.611 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:16:40.611 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:16:40.611 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:16:41.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:16:41 smithi047 bash[22744]: cluster 2024-09-16T07:16:39.850505+0000 mgr.a (mgr.14373) 4309 : cluster [DBG] pgmap v2988: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:16:41.356 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:16:41.357 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:16:41.357 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:16:41.357 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:16:41.357 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:16:41.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:16:41 smithi157 bash[24585]: cluster 2024-09-16T07:16:39.850505+0000 mgr.a (mgr.14373) 4309 : cluster [DBG] pgmap v2988: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:16:41.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:16:41 smithi086 bash[24289]: cluster 2024-09-16T07:16:39.850505+0000 mgr.a (mgr.14373) 4309 : cluster [DBG] pgmap v2988: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:16:42.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:16:42 smithi157 bash[24585]: audit 2024-09-16T07:16:40.944954+0000 mgr.a (mgr.14373) 4310 : audit [DBG] from='client.103341 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:16:42.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:16:42 smithi086 bash[24289]: audit 2024-09-16T07:16:40.944954+0000 mgr.a (mgr.14373) 4310 : audit [DBG] from='client.103341 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:16:42.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:16:42 smithi047 bash[22744]: audit 2024-09-16T07:16:40.944954+0000 mgr.a (mgr.14373) 4310 : audit [DBG] from='client.103341 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:16:43.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:16:43 smithi157 bash[24585]: cluster 2024-09-16T07:16:41.852781+0000 mgr.a (mgr.14373) 4311 : cluster [DBG] pgmap v2989: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:16:43.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:16:43 smithi086 bash[24289]: cluster 2024-09-16T07:16:41.852781+0000 mgr.a (mgr.14373) 4311 : cluster [DBG] pgmap v2989: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:16:43.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:16:43 smithi047 bash[22744]: cluster 2024-09-16T07:16:41.852781+0000 mgr.a (mgr.14373) 4311 : cluster [DBG] pgmap v2989: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:16:45.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:16:45 smithi157 bash[24585]: cluster 2024-09-16T07:16:43.853506+0000 mgr.a (mgr.14373) 4312 : cluster [DBG] pgmap v2990: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:16:45.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:16:45 smithi086 bash[24289]: cluster 2024-09-16T07:16:43.853506+0000 mgr.a (mgr.14373) 4312 : cluster [DBG] pgmap v2990: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:16:45.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:16:45 smithi047 bash[22744]: cluster 2024-09-16T07:16:43.853506+0000 mgr.a (mgr.14373) 4312 : cluster [DBG] pgmap v2990: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:16:46.358 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:16:46.359 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:16:46.359 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:16:47.092 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:16:47.093 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:16:47.093 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:16:47.093 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:16:47.093 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:16:47.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:16:47 smithi157 bash[24585]: cluster 2024-09-16T07:16:45.854244+0000 mgr.a (mgr.14373) 4313 : cluster [DBG] pgmap v2991: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:16:47.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:16:47 smithi086 bash[24289]: cluster 2024-09-16T07:16:45.854244+0000 mgr.a (mgr.14373) 4313 : cluster [DBG] pgmap v2991: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:16:47.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:16:47 smithi047 bash[22744]: cluster 2024-09-16T07:16:45.854244+0000 mgr.a (mgr.14373) 4313 : cluster [DBG] pgmap v2991: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:16:48.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:16:48 smithi157 bash[24585]: audit 2024-09-16T07:16:46.690038+0000 mgr.a (mgr.14373) 4314 : audit [DBG] from='client.103413 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:16:48.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:16:48 smithi086 bash[24289]: audit 2024-09-16T07:16:46.690038+0000 mgr.a (mgr.14373) 4314 : audit [DBG] from='client.103413 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:16:48.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:16:48 smithi047 bash[22744]: audit 2024-09-16T07:16:46.690038+0000 mgr.a (mgr.14373) 4314 : audit [DBG] from='client.103413 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:16:49.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:16:49 smithi157 bash[24585]: cluster 2024-09-16T07:16:47.857022+0000 mgr.a (mgr.14373) 4315 : cluster [DBG] pgmap v2992: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:16:49.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:16:49 smithi086 bash[24289]: cluster 2024-09-16T07:16:47.857022+0000 mgr.a (mgr.14373) 4315 : cluster [DBG] pgmap v2992: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:16:49.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:16:49 smithi047 bash[22744]: cluster 2024-09-16T07:16:47.857022+0000 mgr.a (mgr.14373) 4315 : cluster [DBG] pgmap v2992: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:16:51.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:16:51 smithi157 bash[24585]: cluster 2024-09-16T07:16:49.857989+0000 mgr.a (mgr.14373) 4316 : cluster [DBG] pgmap v2993: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:16:51.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:16:51 smithi086 bash[24289]: cluster 2024-09-16T07:16:49.857989+0000 mgr.a (mgr.14373) 4316 : cluster [DBG] pgmap v2993: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:16:51.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:16:51 smithi047 bash[22744]: cluster 2024-09-16T07:16:49.857989+0000 mgr.a (mgr.14373) 4316 : cluster [DBG] pgmap v2993: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:16:52.094 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:16:52.095 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:16:52.095 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:16:52.846 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:16:52.846 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:16:52.846 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:16:52.846 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:16:52.846 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:16:53.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:16:53 smithi157 bash[24585]: cluster 2024-09-16T07:16:51.860066+0000 mgr.a (mgr.14373) 4317 : cluster [DBG] pgmap v2994: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:16:53.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:16:53 smithi157 bash[24585]: audit 2024-09-16T07:16:52.429246+0000 mgr.a (mgr.14373) 4318 : audit [DBG] from='client.103491 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:16:53.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:16:53 smithi086 bash[24289]: cluster 2024-09-16T07:16:51.860066+0000 mgr.a (mgr.14373) 4317 : cluster [DBG] pgmap v2994: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:16:53.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:16:53 smithi086 bash[24289]: audit 2024-09-16T07:16:52.429246+0000 mgr.a (mgr.14373) 4318 : audit [DBG] from='client.103491 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:16:53.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:16:53 smithi047 bash[22744]: cluster 2024-09-16T07:16:51.860066+0000 mgr.a (mgr.14373) 4317 : cluster [DBG] pgmap v2994: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:16:53.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:16:53 smithi047 bash[22744]: audit 2024-09-16T07:16:52.429246+0000 mgr.a (mgr.14373) 4318 : audit [DBG] from='client.103491 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:16:55.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:16:55 smithi157 bash[24585]: cluster 2024-09-16T07:16:53.861223+0000 mgr.a (mgr.14373) 4319 : cluster [DBG] pgmap v2995: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:16:55.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:16:55 smithi086 bash[24289]: cluster 2024-09-16T07:16:53.861223+0000 mgr.a (mgr.14373) 4319 : cluster [DBG] pgmap v2995: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:16:55.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:16:55 smithi047 bash[22744]: cluster 2024-09-16T07:16:53.861223+0000 mgr.a (mgr.14373) 4319 : cluster [DBG] pgmap v2995: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:16:57.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:16:57 smithi157 bash[24585]: cluster 2024-09-16T07:16:55.862091+0000 mgr.a (mgr.14373) 4320 : cluster [DBG] pgmap v2996: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T07:16:57.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:16:57 smithi086 bash[24289]: cluster 2024-09-16T07:16:55.862091+0000 mgr.a (mgr.14373) 4320 : cluster [DBG] pgmap v2996: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T07:16:57.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:16:57 smithi047 bash[22744]: cluster 2024-09-16T07:16:55.862091+0000 mgr.a (mgr.14373) 4320 : cluster [DBG] pgmap v2996: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T07:16:57.848 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:16:57.848 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:16:57.849 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:16:58.594 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:16:58.595 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:16:58.595 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:16:58.595 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:16:58.595 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:16:59.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:16:59 smithi157 bash[24585]: cluster 2024-09-16T07:16:57.863508+0000 mgr.a (mgr.14373) 4321 : cluster [DBG] pgmap v2997: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:16:59.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:16:59 smithi157 bash[24585]: audit 2024-09-16T07:16:58.179697+0000 mgr.a (mgr.14373) 4322 : audit [DBG] from='client.103566 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:16:59.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:16:59 smithi086 bash[24289]: cluster 2024-09-16T07:16:57.863508+0000 mgr.a (mgr.14373) 4321 : cluster [DBG] pgmap v2997: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:16:59.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:16:59 smithi086 bash[24289]: audit 2024-09-16T07:16:58.179697+0000 mgr.a (mgr.14373) 4322 : audit [DBG] from='client.103566 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:16:59.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:16:59 smithi047 bash[22744]: cluster 2024-09-16T07:16:57.863508+0000 mgr.a (mgr.14373) 4321 : cluster [DBG] pgmap v2997: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:16:59.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:16:59 smithi047 bash[22744]: audit 2024-09-16T07:16:58.179697+0000 mgr.a (mgr.14373) 4322 : audit [DBG] from='client.103566 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:17:01.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:17:01 smithi157 bash[24585]: cluster 2024-09-16T07:16:59.864385+0000 mgr.a (mgr.14373) 4323 : cluster [DBG] pgmap v2998: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:17:01.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:17:01 smithi086 bash[24289]: cluster 2024-09-16T07:16:59.864385+0000 mgr.a (mgr.14373) 4323 : cluster [DBG] pgmap v2998: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:17:01.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:17:01 smithi047 bash[22744]: cluster 2024-09-16T07:16:59.864385+0000 mgr.a (mgr.14373) 4323 : cluster [DBG] pgmap v2998: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:17:03.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:17:03 smithi157 bash[24585]: cluster 2024-09-16T07:17:01.866542+0000 mgr.a (mgr.14373) 4324 : cluster [DBG] pgmap v2999: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:17:03.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:17:03 smithi086 bash[24289]: cluster 2024-09-16T07:17:01.866542+0000 mgr.a (mgr.14373) 4324 : cluster [DBG] pgmap v2999: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:17:03.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:17:03 smithi047 bash[22744]: cluster 2024-09-16T07:17:01.866542+0000 mgr.a (mgr.14373) 4324 : cluster [DBG] pgmap v2999: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:17:03.596 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:17:03.597 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:17:03.597 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:17:04.371 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:17:04.371 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:17:04.371 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:17:04.371 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:17:04.371 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:17:05.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:17:05 smithi157 bash[24585]: cluster 2024-09-16T07:17:03.867225+0000 mgr.a (mgr.14373) 4325 : cluster [DBG] pgmap v3000: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:17:05.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:17:05 smithi157 bash[24585]: audit 2024-09-16T07:17:03.935148+0000 mgr.a (mgr.14373) 4326 : audit [DBG] from='client.103644 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:17:05.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:17:05 smithi086 bash[24289]: cluster 2024-09-16T07:17:03.867225+0000 mgr.a (mgr.14373) 4325 : cluster [DBG] pgmap v3000: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:17:05.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:17:05 smithi086 bash[24289]: audit 2024-09-16T07:17:03.935148+0000 mgr.a (mgr.14373) 4326 : audit [DBG] from='client.103644 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:17:05.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:17:05 smithi047 bash[22744]: cluster 2024-09-16T07:17:03.867225+0000 mgr.a (mgr.14373) 4325 : cluster [DBG] pgmap v3000: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:17:05.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:17:05 smithi047 bash[22744]: audit 2024-09-16T07:17:03.935148+0000 mgr.a (mgr.14373) 4326 : audit [DBG] from='client.103644 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:17:07.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:17:07 smithi157 bash[24585]: cluster 2024-09-16T07:17:05.868073+0000 mgr.a (mgr.14373) 4327 : cluster [DBG] pgmap v3001: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:17:07.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:17:07 smithi157 bash[24585]: audit 2024-09-16T07:17:06.515582+0000 mon.b (mon.2) 430 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T07:17:07.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:17:07 smithi157 bash[24585]: audit 2024-09-16T07:17:07.141590+0000 mon.a (mon.0) 827 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:17:07.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:17:07 smithi157 bash[24585]: audit 2024-09-16T07:17:07.146545+0000 mon.a (mon.0) 828 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:17:07.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:17:07 smithi086 bash[24289]: cluster 2024-09-16T07:17:05.868073+0000 mgr.a (mgr.14373) 4327 : cluster [DBG] pgmap v3001: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:17:07.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:17:07 smithi086 bash[24289]: audit 2024-09-16T07:17:06.515582+0000 mon.b (mon.2) 430 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T07:17:07.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:17:07 smithi086 bash[24289]: audit 2024-09-16T07:17:07.141590+0000 mon.a (mon.0) 827 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:17:07.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:17:07 smithi086 bash[24289]: audit 2024-09-16T07:17:07.146545+0000 mon.a (mon.0) 828 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:17:07.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:17:07 smithi047 bash[22744]: cluster 2024-09-16T07:17:05.868073+0000 mgr.a (mgr.14373) 4327 : cluster [DBG] pgmap v3001: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:17:07.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:17:07 smithi047 bash[22744]: audit 2024-09-16T07:17:06.515582+0000 mon.b (mon.2) 430 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T07:17:07.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:17:07 smithi047 bash[22744]: audit 2024-09-16T07:17:07.141590+0000 mon.a (mon.0) 827 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:17:07.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:17:07 smithi047 bash[22744]: audit 2024-09-16T07:17:07.146545+0000 mon.a (mon.0) 828 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:17:08.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:17:08 smithi157 bash[24585]: audit 2024-09-16T07:17:07.944236+0000 mon.b (mon.2) 431 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T07:17:08.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:17:08 smithi157 bash[24585]: audit 2024-09-16T07:17:07.946265+0000 mon.b (mon.2) 432 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T07:17:08.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:17:08 smithi157 bash[24585]: audit 2024-09-16T07:17:07.958605+0000 mon.a (mon.0) 829 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:17:08.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:17:08 smithi157 bash[24585]: audit 2024-09-16T07:17:07.960642+0000 mon.b (mon.2) 433 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:17:08.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:17:08 smithi086 bash[24289]: audit 2024-09-16T07:17:07.944236+0000 mon.b (mon.2) 431 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T07:17:08.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:17:08 smithi086 bash[24289]: audit 2024-09-16T07:17:07.946265+0000 mon.b (mon.2) 432 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T07:17:08.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:17:08 smithi086 bash[24289]: audit 2024-09-16T07:17:07.958605+0000 mon.a (mon.0) 829 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:17:08.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:17:08 smithi086 bash[24289]: audit 2024-09-16T07:17:07.960642+0000 mon.b (mon.2) 433 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:17:08.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:17:08 smithi047 bash[22744]: audit 2024-09-16T07:17:07.944236+0000 mon.b (mon.2) 431 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T07:17:08.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:17:08 smithi047 bash[22744]: audit 2024-09-16T07:17:07.946265+0000 mon.b (mon.2) 432 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T07:17:08.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:17:08 smithi047 bash[22744]: audit 2024-09-16T07:17:07.958605+0000 mon.a (mon.0) 829 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:17:08.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:17:08 smithi047 bash[22744]: audit 2024-09-16T07:17:07.960642+0000 mon.b (mon.2) 433 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:17:09.088 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 07:17:08 smithi047 bash[22994]: debug 2024-09-16T07:17:08.690+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T07:17:09.088 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 07:17:08 smithi047 bash[22994]: debug 2024-09-16T07:17:08.690+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T07:17:09.372 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:17:09.373 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:17:09.373 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:17:09.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:17:09 smithi157 bash[24585]: cluster 2024-09-16T07:17:07.869566+0000 mgr.a (mgr.14373) 4328 : cluster [DBG] pgmap v3002: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:17:09.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:17:09 smithi157 bash[24585]: audit 2024-09-16T07:17:07.964727+0000 mgr.a (mgr.14373) 4329 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:17:09.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:17:09 smithi086 bash[24289]: cluster 2024-09-16T07:17:07.869566+0000 mgr.a (mgr.14373) 4328 : cluster [DBG] pgmap v3002: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:17:09.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:17:09 smithi086 bash[24289]: audit 2024-09-16T07:17:07.964727+0000 mgr.a (mgr.14373) 4329 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:17:09.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:17:09 smithi047 bash[22744]: cluster 2024-09-16T07:17:07.869566+0000 mgr.a (mgr.14373) 4328 : cluster [DBG] pgmap v3002: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:17:09.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:17:09 smithi047 bash[22744]: audit 2024-09-16T07:17:07.964727+0000 mgr.a (mgr.14373) 4329 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:17:10.124 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:17:10.125 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:17:10.125 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:17:10.125 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:17:10.125 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:17:10.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:17:10 smithi157 bash[24585]: audit 2024-09-16T07:17:08.694795+0000 mgr.a (mgr.14373) 4330 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T07:17:10.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:17:10 smithi157 bash[24585]: cephadm 2024-09-16T07:17:08.696990+0000 mgr.a (mgr.14373) 4331 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T07:17:10.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:17:10 smithi086 bash[24289]: audit 2024-09-16T07:17:08.694795+0000 mgr.a (mgr.14373) 4330 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T07:17:10.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:17:10 smithi086 bash[24289]: cephadm 2024-09-16T07:17:08.696990+0000 mgr.a (mgr.14373) 4331 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T07:17:10.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:17:10 smithi047 bash[22744]: audit 2024-09-16T07:17:08.694795+0000 mgr.a (mgr.14373) 4330 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T07:17:10.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:17:10 smithi047 bash[22744]: cephadm 2024-09-16T07:17:08.696990+0000 mgr.a (mgr.14373) 4331 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T07:17:11.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:17:11 smithi157 bash[24585]: audit 2024-09-16T07:17:09.704250+0000 mgr.a (mgr.14373) 4332 : audit [DBG] from='client.103830 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:17:11.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:17:11 smithi157 bash[24585]: cluster 2024-09-16T07:17:09.870195+0000 mgr.a (mgr.14373) 4333 : cluster [DBG] pgmap v3003: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:17:11.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:17:11 smithi086 bash[24289]: audit 2024-09-16T07:17:09.704250+0000 mgr.a (mgr.14373) 4332 : audit [DBG] from='client.103830 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:17:11.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:17:11 smithi086 bash[24289]: cluster 2024-09-16T07:17:09.870195+0000 mgr.a (mgr.14373) 4333 : cluster [DBG] pgmap v3003: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:17:11.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:17:11 smithi047 bash[22744]: audit 2024-09-16T07:17:09.704250+0000 mgr.a (mgr.14373) 4332 : audit [DBG] from='client.103830 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:17:11.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:17:11 smithi047 bash[22744]: cluster 2024-09-16T07:17:09.870195+0000 mgr.a (mgr.14373) 4333 : cluster [DBG] pgmap v3003: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:17:13.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:17:13 smithi157 bash[24585]: cluster 2024-09-16T07:17:11.872541+0000 mgr.a (mgr.14373) 4334 : cluster [DBG] pgmap v3004: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:17:13.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:17:13 smithi086 bash[24289]: cluster 2024-09-16T07:17:11.872541+0000 mgr.a (mgr.14373) 4334 : cluster [DBG] pgmap v3004: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:17:13.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:17:13 smithi047 bash[22744]: cluster 2024-09-16T07:17:11.872541+0000 mgr.a (mgr.14373) 4334 : cluster [DBG] pgmap v3004: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:17:15.127 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:17:15.127 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:17:15.127 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:17:15.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:17:15 smithi157 bash[24585]: cluster 2024-09-16T07:17:13.873314+0000 mgr.a (mgr.14373) 4335 : cluster [DBG] pgmap v3005: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:17:15.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:17:15 smithi086 bash[24289]: cluster 2024-09-16T07:17:13.873314+0000 mgr.a (mgr.14373) 4335 : cluster [DBG] pgmap v3005: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:17:15.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:17:15 smithi047 bash[22744]: cluster 2024-09-16T07:17:13.873314+0000 mgr.a (mgr.14373) 4335 : cluster [DBG] pgmap v3005: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:17:15.909 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:17:15.909 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:17:15.909 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:17:15.910 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:17:15.910 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:17:16.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:17:16 smithi157 bash[24585]: audit 2024-09-16T07:17:15.468099+0000 mgr.a (mgr.14373) 4336 : audit [DBG] from='client.103905 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:17:16.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:17:16 smithi086 bash[24289]: audit 2024-09-16T07:17:15.468099+0000 mgr.a (mgr.14373) 4336 : audit [DBG] from='client.103905 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:17:16.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:17:16 smithi047 bash[22744]: audit 2024-09-16T07:17:15.468099+0000 mgr.a (mgr.14373) 4336 : audit [DBG] from='client.103905 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:17:17.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:17:17 smithi157 bash[24585]: cluster 2024-09-16T07:17:15.873856+0000 mgr.a (mgr.14373) 4337 : cluster [DBG] pgmap v3006: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:17:17.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:17:17 smithi086 bash[24289]: cluster 2024-09-16T07:17:15.873856+0000 mgr.a (mgr.14373) 4337 : cluster [DBG] pgmap v3006: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:17:17.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:17:17 smithi047 bash[22744]: cluster 2024-09-16T07:17:15.873856+0000 mgr.a (mgr.14373) 4337 : cluster [DBG] pgmap v3006: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:17:19.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:17:19 smithi157 bash[24585]: cluster 2024-09-16T07:17:17.876041+0000 mgr.a (mgr.14373) 4338 : cluster [DBG] pgmap v3007: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:17:19.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:17:19 smithi086 bash[24289]: cluster 2024-09-16T07:17:17.876041+0000 mgr.a (mgr.14373) 4338 : cluster [DBG] pgmap v3007: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:17:19.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:17:19 smithi047 bash[22744]: cluster 2024-09-16T07:17:17.876041+0000 mgr.a (mgr.14373) 4338 : cluster [DBG] pgmap v3007: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:17:20.911 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:17:20.912 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:17:20.912 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:17:21.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:17:21 smithi157 bash[24585]: cluster 2024-09-16T07:17:19.876865+0000 mgr.a (mgr.14373) 4339 : cluster [DBG] pgmap v3008: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:17:21.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:17:21 smithi086 bash[24289]: cluster 2024-09-16T07:17:19.876865+0000 mgr.a (mgr.14373) 4339 : cluster [DBG] pgmap v3008: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:17:21.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:17:21 smithi047 bash[22744]: cluster 2024-09-16T07:17:19.876865+0000 mgr.a (mgr.14373) 4339 : cluster [DBG] pgmap v3008: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:17:21.691 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:17:21.691 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:17:21.691 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:17:21.691 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:17:21.691 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:17:22.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:17:22 smithi157 bash[24585]: audit 2024-09-16T07:17:21.252618+0000 mgr.a (mgr.14373) 4340 : audit [DBG] from='client.103983 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:17:22.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:17:22 smithi086 bash[24289]: audit 2024-09-16T07:17:21.252618+0000 mgr.a (mgr.14373) 4340 : audit [DBG] from='client.103983 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:17:22.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:17:22 smithi047 bash[22744]: audit 2024-09-16T07:17:21.252618+0000 mgr.a (mgr.14373) 4340 : audit [DBG] from='client.103983 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:17:23.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:17:23 smithi157 bash[24585]: cluster 2024-09-16T07:17:21.879602+0000 mgr.a (mgr.14373) 4341 : cluster [DBG] pgmap v3009: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:17:23.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:17:23 smithi086 bash[24289]: cluster 2024-09-16T07:17:21.879602+0000 mgr.a (mgr.14373) 4341 : cluster [DBG] pgmap v3009: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:17:23.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:17:23 smithi047 bash[22744]: cluster 2024-09-16T07:17:21.879602+0000 mgr.a (mgr.14373) 4341 : cluster [DBG] pgmap v3009: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:17:25.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:17:25 smithi157 bash[24585]: cluster 2024-09-16T07:17:23.880363+0000 mgr.a (mgr.14373) 4342 : cluster [DBG] pgmap v3010: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:17:25.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:17:25 smithi086 bash[24289]: cluster 2024-09-16T07:17:23.880363+0000 mgr.a (mgr.14373) 4342 : cluster [DBG] pgmap v3010: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:17:25.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:17:25 smithi047 bash[22744]: cluster 2024-09-16T07:17:23.880363+0000 mgr.a (mgr.14373) 4342 : cluster [DBG] pgmap v3010: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:17:26.693 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:17:26.693 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:17:26.693 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:17:27.458 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:17:27.458 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:17:27.458 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:17:27.458 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:17:27.458 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:17:27.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:17:27 smithi157 bash[24585]: cluster 2024-09-16T07:17:25.881118+0000 mgr.a (mgr.14373) 4343 : cluster [DBG] pgmap v3011: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T07:17:27.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:17:27 smithi086 bash[24289]: cluster 2024-09-16T07:17:25.881118+0000 mgr.a (mgr.14373) 4343 : cluster [DBG] pgmap v3011: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T07:17:27.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:17:27 smithi047 bash[22744]: cluster 2024-09-16T07:17:25.881118+0000 mgr.a (mgr.14373) 4343 : cluster [DBG] pgmap v3011: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T07:17:28.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:17:28 smithi157 bash[24585]: audit 2024-09-16T07:17:27.027087+0000 mgr.a (mgr.14373) 4344 : audit [DBG] from='client.104061 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:17:28.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:17:28 smithi086 bash[24289]: audit 2024-09-16T07:17:27.027087+0000 mgr.a (mgr.14373) 4344 : audit [DBG] from='client.104061 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:17:28.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:17:28 smithi047 bash[22744]: audit 2024-09-16T07:17:27.027087+0000 mgr.a (mgr.14373) 4344 : audit [DBG] from='client.104061 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:17:29.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:17:29 smithi157 bash[24585]: cluster 2024-09-16T07:17:27.883918+0000 mgr.a (mgr.14373) 4345 : cluster [DBG] pgmap v3012: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:17:29.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:17:29 smithi086 bash[24289]: cluster 2024-09-16T07:17:27.883918+0000 mgr.a (mgr.14373) 4345 : cluster [DBG] pgmap v3012: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:17:29.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:17:29 smithi047 bash[22744]: cluster 2024-09-16T07:17:27.883918+0000 mgr.a (mgr.14373) 4345 : cluster [DBG] pgmap v3012: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:17:31.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:17:31 smithi157 bash[24585]: cluster 2024-09-16T07:17:29.884823+0000 mgr.a (mgr.14373) 4346 : cluster [DBG] pgmap v3013: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:17:31.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:17:31 smithi086 bash[24289]: cluster 2024-09-16T07:17:29.884823+0000 mgr.a (mgr.14373) 4346 : cluster [DBG] pgmap v3013: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:17:31.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:17:31 smithi047 bash[22744]: cluster 2024-09-16T07:17:29.884823+0000 mgr.a (mgr.14373) 4346 : cluster [DBG] pgmap v3013: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:17:32.459 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:17:32.460 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:17:32.460 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:17:33.205 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:17:33.205 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:17:33.205 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:17:33.205 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:17:33.205 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:17:33.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:17:33 smithi157 bash[24585]: cluster 2024-09-16T07:17:31.886845+0000 mgr.a (mgr.14373) 4347 : cluster [DBG] pgmap v3014: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:17:33.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:17:33 smithi086 bash[24289]: cluster 2024-09-16T07:17:31.886845+0000 mgr.a (mgr.14373) 4347 : cluster [DBG] pgmap v3014: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:17:33.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:17:33 smithi047 bash[22744]: cluster 2024-09-16T07:17:31.886845+0000 mgr.a (mgr.14373) 4347 : cluster [DBG] pgmap v3014: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:17:34.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:17:34 smithi157 bash[24585]: audit 2024-09-16T07:17:32.793533+0000 mgr.a (mgr.14373) 4348 : audit [DBG] from='client.104139 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:17:34.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:17:34 smithi086 bash[24289]: audit 2024-09-16T07:17:32.793533+0000 mgr.a (mgr.14373) 4348 : audit [DBG] from='client.104139 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:17:34.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:17:34 smithi047 bash[22744]: audit 2024-09-16T07:17:32.793533+0000 mgr.a (mgr.14373) 4348 : audit [DBG] from='client.104139 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:17:35.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:17:35 smithi157 bash[24585]: cluster 2024-09-16T07:17:33.887970+0000 mgr.a (mgr.14373) 4349 : cluster [DBG] pgmap v3015: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:17:35.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:17:35 smithi086 bash[24289]: cluster 2024-09-16T07:17:33.887970+0000 mgr.a (mgr.14373) 4349 : cluster [DBG] pgmap v3015: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:17:35.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:17:35 smithi047 bash[22744]: cluster 2024-09-16T07:17:33.887970+0000 mgr.a (mgr.14373) 4349 : cluster [DBG] pgmap v3015: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:17:37.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:17:37 smithi157 bash[24585]: cluster 2024-09-16T07:17:35.888782+0000 mgr.a (mgr.14373) 4350 : cluster [DBG] pgmap v3016: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:17:37.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:17:37 smithi086 bash[24289]: cluster 2024-09-16T07:17:35.888782+0000 mgr.a (mgr.14373) 4350 : cluster [DBG] pgmap v3016: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:17:37.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:17:37 smithi047 bash[22744]: cluster 2024-09-16T07:17:35.888782+0000 mgr.a (mgr.14373) 4350 : cluster [DBG] pgmap v3016: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:17:38.206 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:17:38.207 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:17:38.207 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:17:38.989 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:17:38.989 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:17:38.989 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:17:38.989 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:17:38.989 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:17:39.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:17:39 smithi157 bash[24585]: cluster 2024-09-16T07:17:37.891156+0000 mgr.a (mgr.14373) 4351 : cluster [DBG] pgmap v3017: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:17:39.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:17:39 smithi157 bash[24585]: audit 2024-09-16T07:17:38.543455+0000 mgr.a (mgr.14373) 4352 : audit [DBG] from='client.104217 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:17:39.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:17:39 smithi086 bash[24289]: cluster 2024-09-16T07:17:37.891156+0000 mgr.a (mgr.14373) 4351 : cluster [DBG] pgmap v3017: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:17:39.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:17:39 smithi086 bash[24289]: audit 2024-09-16T07:17:38.543455+0000 mgr.a (mgr.14373) 4352 : audit [DBG] from='client.104217 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:17:39.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:17:39 smithi047 bash[22744]: cluster 2024-09-16T07:17:37.891156+0000 mgr.a (mgr.14373) 4351 : cluster [DBG] pgmap v3017: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:17:39.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:17:39 smithi047 bash[22744]: audit 2024-09-16T07:17:38.543455+0000 mgr.a (mgr.14373) 4352 : audit [DBG] from='client.104217 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:17:41.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:17:41 smithi157 bash[24585]: cluster 2024-09-16T07:17:39.892149+0000 mgr.a (mgr.14373) 4353 : cluster [DBG] pgmap v3018: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:17:41.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:17:41 smithi086 bash[24289]: cluster 2024-09-16T07:17:39.892149+0000 mgr.a (mgr.14373) 4353 : cluster [DBG] pgmap v3018: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:17:41.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:17:41 smithi047 bash[22744]: cluster 2024-09-16T07:17:39.892149+0000 mgr.a (mgr.14373) 4353 : cluster [DBG] pgmap v3018: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:17:43.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:17:43 smithi157 bash[24585]: cluster 2024-09-16T07:17:41.894275+0000 mgr.a (mgr.14373) 4354 : cluster [DBG] pgmap v3019: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:17:43.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:17:43 smithi086 bash[24289]: cluster 2024-09-16T07:17:41.894275+0000 mgr.a (mgr.14373) 4354 : cluster [DBG] pgmap v3019: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:17:43.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:17:43 smithi047 bash[22744]: cluster 2024-09-16T07:17:41.894275+0000 mgr.a (mgr.14373) 4354 : cluster [DBG] pgmap v3019: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:17:43.990 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:17:43.991 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:17:43.991 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:17:44.767 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:17:44.767 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:17:44.767 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:17:44.767 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:17:44.768 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:17:45.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:17:45 smithi157 bash[24585]: cluster 2024-09-16T07:17:43.895088+0000 mgr.a (mgr.14373) 4355 : cluster [DBG] pgmap v3020: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:17:45.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:17:45 smithi157 bash[24585]: audit 2024-09-16T07:17:44.330159+0000 mgr.a (mgr.14373) 4356 : audit [DBG] from='client.104292 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:17:45.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:17:45 smithi086 bash[24289]: cluster 2024-09-16T07:17:43.895088+0000 mgr.a (mgr.14373) 4355 : cluster [DBG] pgmap v3020: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:17:45.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:17:45 smithi086 bash[24289]: audit 2024-09-16T07:17:44.330159+0000 mgr.a (mgr.14373) 4356 : audit [DBG] from='client.104292 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:17:45.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:17:45 smithi047 bash[22744]: cluster 2024-09-16T07:17:43.895088+0000 mgr.a (mgr.14373) 4355 : cluster [DBG] pgmap v3020: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:17:45.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:17:45 smithi047 bash[22744]: audit 2024-09-16T07:17:44.330159+0000 mgr.a (mgr.14373) 4356 : audit [DBG] from='client.104292 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:17:47.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:17:47 smithi157 bash[24585]: cluster 2024-09-16T07:17:45.896081+0000 mgr.a (mgr.14373) 4357 : cluster [DBG] pgmap v3021: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:17:47.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:17:47 smithi086 bash[24289]: cluster 2024-09-16T07:17:45.896081+0000 mgr.a (mgr.14373) 4357 : cluster [DBG] pgmap v3021: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:17:47.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:17:47 smithi047 bash[22744]: cluster 2024-09-16T07:17:45.896081+0000 mgr.a (mgr.14373) 4357 : cluster [DBG] pgmap v3021: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:17:49.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:17:49 smithi157 bash[24585]: cluster 2024-09-16T07:17:47.898316+0000 mgr.a (mgr.14373) 4358 : cluster [DBG] pgmap v3022: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:17:49.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:17:49 smithi086 bash[24289]: cluster 2024-09-16T07:17:47.898316+0000 mgr.a (mgr.14373) 4358 : cluster [DBG] pgmap v3022: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:17:49.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:17:49 smithi047 bash[22744]: cluster 2024-09-16T07:17:47.898316+0000 mgr.a (mgr.14373) 4358 : cluster [DBG] pgmap v3022: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:17:49.769 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:17:49.770 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:17:49.770 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:17:50.516 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:17:50.516 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:17:50.516 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:17:50.517 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:17:50.517 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:17:51.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:17:51 smithi157 bash[24585]: cluster 2024-09-16T07:17:49.898764+0000 mgr.a (mgr.14373) 4359 : cluster [DBG] pgmap v3023: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:17:51.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:17:51 smithi157 bash[24585]: audit 2024-09-16T07:17:50.106392+0000 mgr.a (mgr.14373) 4360 : audit [DBG] from='client.104370 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:17:51.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:17:51 smithi086 bash[24289]: cluster 2024-09-16T07:17:49.898764+0000 mgr.a (mgr.14373) 4359 : cluster [DBG] pgmap v3023: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:17:51.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:17:51 smithi086 bash[24289]: audit 2024-09-16T07:17:50.106392+0000 mgr.a (mgr.14373) 4360 : audit [DBG] from='client.104370 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:17:51.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:17:51 smithi047 bash[22744]: cluster 2024-09-16T07:17:49.898764+0000 mgr.a (mgr.14373) 4359 : cluster [DBG] pgmap v3023: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:17:51.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:17:51 smithi047 bash[22744]: audit 2024-09-16T07:17:50.106392+0000 mgr.a (mgr.14373) 4360 : audit [DBG] from='client.104370 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:17:53.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:17:53 smithi157 bash[24585]: cluster 2024-09-16T07:17:51.901189+0000 mgr.a (mgr.14373) 4361 : cluster [DBG] pgmap v3024: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:17:53.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:17:53 smithi086 bash[24289]: cluster 2024-09-16T07:17:51.901189+0000 mgr.a (mgr.14373) 4361 : cluster [DBG] pgmap v3024: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:17:53.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:17:53 smithi047 bash[22744]: cluster 2024-09-16T07:17:51.901189+0000 mgr.a (mgr.14373) 4361 : cluster [DBG] pgmap v3024: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:17:55.518 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:17:55.518 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:17:55.518 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:17:55.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:17:55 smithi157 bash[24585]: cluster 2024-09-16T07:17:53.902165+0000 mgr.a (mgr.14373) 4362 : cluster [DBG] pgmap v3025: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:17:55.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:17:55 smithi086 bash[24289]: cluster 2024-09-16T07:17:53.902165+0000 mgr.a (mgr.14373) 4362 : cluster [DBG] pgmap v3025: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:17:55.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:17:55 smithi047 bash[22744]: cluster 2024-09-16T07:17:53.902165+0000 mgr.a (mgr.14373) 4362 : cluster [DBG] pgmap v3025: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:17:56.289 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:17:56.289 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:17:56.289 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:17:56.289 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:17:56.289 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:17:57.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:17:57 smithi157 bash[24585]: audit 2024-09-16T07:17:55.856642+0000 mgr.a (mgr.14373) 4363 : audit [DBG] from='client.104448 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:17:57.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:17:57 smithi157 bash[24585]: cluster 2024-09-16T07:17:55.902969+0000 mgr.a (mgr.14373) 4364 : cluster [DBG] pgmap v3026: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:17:57.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:17:57 smithi086 bash[24289]: audit 2024-09-16T07:17:55.856642+0000 mgr.a (mgr.14373) 4363 : audit [DBG] from='client.104448 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:17:57.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:17:57 smithi086 bash[24289]: cluster 2024-09-16T07:17:55.902969+0000 mgr.a (mgr.14373) 4364 : cluster [DBG] pgmap v3026: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:17:57.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:17:57 smithi047 bash[22744]: audit 2024-09-16T07:17:55.856642+0000 mgr.a (mgr.14373) 4363 : audit [DBG] from='client.104448 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:17:57.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:17:57 smithi047 bash[22744]: cluster 2024-09-16T07:17:55.902969+0000 mgr.a (mgr.14373) 4364 : cluster [DBG] pgmap v3026: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:17:59.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:17:59 smithi157 bash[24585]: cluster 2024-09-16T07:17:57.905307+0000 mgr.a (mgr.14373) 4365 : cluster [DBG] pgmap v3027: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:17:59.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:17:59 smithi086 bash[24289]: cluster 2024-09-16T07:17:57.905307+0000 mgr.a (mgr.14373) 4365 : cluster [DBG] pgmap v3027: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:17:59.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:17:59 smithi047 bash[22744]: cluster 2024-09-16T07:17:57.905307+0000 mgr.a (mgr.14373) 4365 : cluster [DBG] pgmap v3027: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:18:01.290 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:18:01.291 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:18:01.291 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:18:01.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:18:01 smithi157 bash[24585]: cluster 2024-09-16T07:17:59.906095+0000 mgr.a (mgr.14373) 4366 : cluster [DBG] pgmap v3028: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:18:01.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:18:01 smithi086 bash[24289]: cluster 2024-09-16T07:17:59.906095+0000 mgr.a (mgr.14373) 4366 : cluster [DBG] pgmap v3028: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:18:01.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:18:01 smithi047 bash[22744]: cluster 2024-09-16T07:17:59.906095+0000 mgr.a (mgr.14373) 4366 : cluster [DBG] pgmap v3028: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:18:02.078 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:18:02.079 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:18:02.079 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:18:02.079 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:18:02.079 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:18:02.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:18:02 smithi086 bash[24289]: audit 2024-09-16T07:18:01.635302+0000 mgr.a (mgr.14373) 4367 : audit [DBG] from='client.104520 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:18:02.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:18:02 smithi047 bash[22744]: audit 2024-09-16T07:18:01.635302+0000 mgr.a (mgr.14373) 4367 : audit [DBG] from='client.104520 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:18:02.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:18:02 smithi157 bash[24585]: audit 2024-09-16T07:18:01.635302+0000 mgr.a (mgr.14373) 4367 : audit [DBG] from='client.104520 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:18:03.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:18:03 smithi086 bash[24289]: cluster 2024-09-16T07:18:01.907484+0000 mgr.a (mgr.14373) 4368 : cluster [DBG] pgmap v3029: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:18:03.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:18:03 smithi047 bash[22744]: cluster 2024-09-16T07:18:01.907484+0000 mgr.a (mgr.14373) 4368 : cluster [DBG] pgmap v3029: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:18:03.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:18:03 smithi157 bash[24585]: cluster 2024-09-16T07:18:01.907484+0000 mgr.a (mgr.14373) 4368 : cluster [DBG] pgmap v3029: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:18:05.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:18:05 smithi086 bash[24289]: cluster 2024-09-16T07:18:03.908409+0000 mgr.a (mgr.14373) 4369 : cluster [DBG] pgmap v3030: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:18:05.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:18:05 smithi047 bash[22744]: cluster 2024-09-16T07:18:03.908409+0000 mgr.a (mgr.14373) 4369 : cluster [DBG] pgmap v3030: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:18:05.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:18:05 smithi157 bash[24585]: cluster 2024-09-16T07:18:03.908409+0000 mgr.a (mgr.14373) 4369 : cluster [DBG] pgmap v3030: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:18:07.082 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:18:07.082 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:18:07.082 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:18:07.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:18:07 smithi086 bash[24289]: cluster 2024-09-16T07:18:05.909189+0000 mgr.a (mgr.14373) 4370 : cluster [DBG] pgmap v3031: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T07:18:07.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:18:07 smithi047 bash[22744]: cluster 2024-09-16T07:18:05.909189+0000 mgr.a (mgr.14373) 4370 : cluster [DBG] pgmap v3031: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T07:18:07.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:18:07 smithi157 bash[24585]: cluster 2024-09-16T07:18:05.909189+0000 mgr.a (mgr.14373) 4370 : cluster [DBG] pgmap v3031: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T07:18:07.857 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:18:07.858 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:18:07.858 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:18:07.858 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:18:07.858 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:18:08.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:18:08 smithi047 bash[22744]: audit 2024-09-16T07:18:07.419005+0000 mgr.a (mgr.14373) 4371 : audit [DBG] from='client.104598 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:18:08.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:18:08 smithi157 bash[24585]: audit 2024-09-16T07:18:07.419005+0000 mgr.a (mgr.14373) 4371 : audit [DBG] from='client.104598 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:18:08.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:18:08 smithi086 bash[24289]: audit 2024-09-16T07:18:07.419005+0000 mgr.a (mgr.14373) 4371 : audit [DBG] from='client.104598 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:18:09.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:18:09 smithi047 bash[22744]: cluster 2024-09-16T07:18:07.910524+0000 mgr.a (mgr.14373) 4372 : cluster [DBG] pgmap v3032: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 8.1 KiB/s rd, 0 B/s wr, 12 op/s 2024-09-16T07:18:09.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:18:09 smithi047 bash[22744]: audit 2024-09-16T07:18:08.747893+0000 mon.b (mon.2) 434 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T07:18:09.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:18:09 smithi157 bash[24585]: cluster 2024-09-16T07:18:07.910524+0000 mgr.a (mgr.14373) 4372 : cluster [DBG] pgmap v3032: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 8.1 KiB/s rd, 0 B/s wr, 12 op/s 2024-09-16T07:18:09.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:18:09 smithi157 bash[24585]: audit 2024-09-16T07:18:08.747893+0000 mon.b (mon.2) 434 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T07:18:09.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:18:09 smithi086 bash[24289]: cluster 2024-09-16T07:18:07.910524+0000 mgr.a (mgr.14373) 4372 : cluster [DBG] pgmap v3032: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 8.1 KiB/s rd, 0 B/s wr, 12 op/s 2024-09-16T07:18:09.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:18:09 smithi086 bash[24289]: audit 2024-09-16T07:18:08.747893+0000 mon.b (mon.2) 434 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T07:18:10.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:18:10 smithi157 bash[24585]: audit 2024-09-16T07:18:09.367734+0000 mon.a (mon.0) 830 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:18:10.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:18:10 smithi157 bash[24585]: audit 2024-09-16T07:18:09.370980+0000 mon.a (mon.0) 831 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:18:10.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:18:10 smithi157 bash[24585]: audit 2024-09-16T07:18:09.376002+0000 mon.a (mon.0) 832 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:18:10.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:18:10 smithi157 bash[24585]: audit 2024-09-16T07:18:09.380481+0000 mon.a (mon.0) 833 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:18:10.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:18:10 smithi157 bash[24585]: audit 2024-09-16T07:18:10.056873+0000 mon.b (mon.2) 435 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T07:18:10.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:18:10 smithi157 bash[24585]: audit 2024-09-16T07:18:10.058617+0000 mon.b (mon.2) 436 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T07:18:10.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:18:10 smithi157 bash[24585]: audit 2024-09-16T07:18:10.071654+0000 mon.a (mon.0) 834 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:18:10.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:18:10 smithi157 bash[24585]: audit 2024-09-16T07:18:10.076242+0000 mon.b (mon.2) 437 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:18:10.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:18:10 smithi086 bash[24289]: audit 2024-09-16T07:18:09.367734+0000 mon.a (mon.0) 830 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:18:10.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:18:10 smithi086 bash[24289]: audit 2024-09-16T07:18:09.370980+0000 mon.a (mon.0) 831 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:18:10.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:18:10 smithi086 bash[24289]: audit 2024-09-16T07:18:09.376002+0000 mon.a (mon.0) 832 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:18:10.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:18:10 smithi086 bash[24289]: audit 2024-09-16T07:18:09.380481+0000 mon.a (mon.0) 833 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:18:10.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:18:10 smithi086 bash[24289]: audit 2024-09-16T07:18:10.056873+0000 mon.b (mon.2) 435 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T07:18:10.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:18:10 smithi086 bash[24289]: audit 2024-09-16T07:18:10.058617+0000 mon.b (mon.2) 436 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T07:18:10.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:18:10 smithi086 bash[24289]: audit 2024-09-16T07:18:10.071654+0000 mon.a (mon.0) 834 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:18:10.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:18:10 smithi086 bash[24289]: audit 2024-09-16T07:18:10.076242+0000 mon.b (mon.2) 437 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:18:10.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:18:10 smithi047 bash[22744]: audit 2024-09-16T07:18:09.367734+0000 mon.a (mon.0) 830 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:18:10.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:18:10 smithi047 bash[22744]: audit 2024-09-16T07:18:09.370980+0000 mon.a (mon.0) 831 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:18:10.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:18:10 smithi047 bash[22744]: audit 2024-09-16T07:18:09.376002+0000 mon.a (mon.0) 832 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:18:10.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:18:10 smithi047 bash[22744]: audit 2024-09-16T07:18:09.380481+0000 mon.a (mon.0) 833 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:18:10.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:18:10 smithi047 bash[22744]: audit 2024-09-16T07:18:10.056873+0000 mon.b (mon.2) 435 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T07:18:10.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:18:10 smithi047 bash[22744]: audit 2024-09-16T07:18:10.058617+0000 mon.b (mon.2) 436 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T07:18:10.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:18:10 smithi047 bash[22744]: audit 2024-09-16T07:18:10.071654+0000 mon.a (mon.0) 834 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:18:10.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:18:10 smithi047 bash[22744]: audit 2024-09-16T07:18:10.076242+0000 mon.b (mon.2) 437 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:18:11.338 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 07:18:10 smithi047 bash[22994]: debug 2024-09-16T07:18:10.893+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T07:18:11.338 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 07:18:10 smithi047 bash[22994]: debug 2024-09-16T07:18:10.893+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T07:18:11.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:18:11 smithi157 bash[24585]: cluster 2024-09-16T07:18:09.911252+0000 mgr.a (mgr.14373) 4373 : cluster [DBG] pgmap v3033: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 0 B/s wr, 11 op/s 2024-09-16T07:18:11.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:18:11 smithi157 bash[24585]: audit 2024-09-16T07:18:10.080716+0000 mgr.a (mgr.14373) 4374 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:18:11.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:18:11 smithi086 bash[24289]: cluster 2024-09-16T07:18:09.911252+0000 mgr.a (mgr.14373) 4373 : cluster [DBG] pgmap v3033: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 0 B/s wr, 11 op/s 2024-09-16T07:18:11.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:18:11 smithi086 bash[24289]: audit 2024-09-16T07:18:10.080716+0000 mgr.a (mgr.14373) 4374 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:18:11.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:18:11 smithi047 bash[22744]: cluster 2024-09-16T07:18:09.911252+0000 mgr.a (mgr.14373) 4373 : cluster [DBG] pgmap v3033: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 0 B/s wr, 11 op/s 2024-09-16T07:18:11.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:18:11 smithi047 bash[22744]: audit 2024-09-16T07:18:10.080716+0000 mgr.a (mgr.14373) 4374 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:18:12.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:18:12 smithi157 bash[24585]: audit 2024-09-16T07:18:10.896138+0000 mgr.a (mgr.14373) 4375 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T07:18:12.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:18:12 smithi157 bash[24585]: cephadm 2024-09-16T07:18:10.898027+0000 mgr.a (mgr.14373) 4376 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T07:18:12.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:18:12 smithi086 bash[24289]: audit 2024-09-16T07:18:10.896138+0000 mgr.a (mgr.14373) 4375 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T07:18:12.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:18:12 smithi086 bash[24289]: cephadm 2024-09-16T07:18:10.898027+0000 mgr.a (mgr.14373) 4376 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T07:18:12.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:18:12 smithi047 bash[22744]: audit 2024-09-16T07:18:10.896138+0000 mgr.a (mgr.14373) 4375 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T07:18:12.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:18:12 smithi047 bash[22744]: cephadm 2024-09-16T07:18:10.898027+0000 mgr.a (mgr.14373) 4376 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T07:18:12.859 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:18:12.860 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:18:12.860 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:18:13.632 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:18:13.632 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:18:13.632 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:18:13.632 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:18:13.632 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:18:13.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:18:13 smithi157 bash[24585]: cluster 2024-09-16T07:18:11.913678+0000 mgr.a (mgr.14373) 4377 : cluster [DBG] pgmap v3034: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 77 KiB/s rd, 426 B/s wr, 123 op/s 2024-09-16T07:18:13.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:18:13 smithi086 bash[24289]: cluster 2024-09-16T07:18:11.913678+0000 mgr.a (mgr.14373) 4377 : cluster [DBG] pgmap v3034: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 77 KiB/s rd, 426 B/s wr, 123 op/s 2024-09-16T07:18:13.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:18:13 smithi047 bash[22744]: cluster 2024-09-16T07:18:11.913678+0000 mgr.a (mgr.14373) 4377 : cluster [DBG] pgmap v3034: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 77 KiB/s rd, 426 B/s wr, 123 op/s 2024-09-16T07:18:14.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:18:14 smithi157 bash[24585]: audit 2024-09-16T07:18:13.197371+0000 mgr.a (mgr.14373) 4378 : audit [DBG] from='client.104784 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:18:14.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:18:14 smithi086 bash[24289]: audit 2024-09-16T07:18:13.197371+0000 mgr.a (mgr.14373) 4378 : audit [DBG] from='client.104784 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:18:14.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:18:14 smithi047 bash[22744]: audit 2024-09-16T07:18:13.197371+0000 mgr.a (mgr.14373) 4378 : audit [DBG] from='client.104784 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:18:15.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:18:15 smithi157 bash[24585]: cluster 2024-09-16T07:18:13.914695+0000 mgr.a (mgr.14373) 4379 : cluster [DBG] pgmap v3035: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 77 KiB/s rd, 426 B/s wr, 123 op/s 2024-09-16T07:18:15.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:18:15 smithi086 bash[24289]: cluster 2024-09-16T07:18:13.914695+0000 mgr.a (mgr.14373) 4379 : cluster [DBG] pgmap v3035: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 77 KiB/s rd, 426 B/s wr, 123 op/s 2024-09-16T07:18:15.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:18:15 smithi047 bash[22744]: cluster 2024-09-16T07:18:13.914695+0000 mgr.a (mgr.14373) 4379 : cluster [DBG] pgmap v3035: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 77 KiB/s rd, 426 B/s wr, 123 op/s 2024-09-16T07:18:17.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:18:17 smithi157 bash[24585]: cluster 2024-09-16T07:18:15.915511+0000 mgr.a (mgr.14373) 4380 : cluster [DBG] pgmap v3036: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 77 KiB/s rd, 426 B/s wr, 123 op/s 2024-09-16T07:18:17.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:18:17 smithi086 bash[24289]: cluster 2024-09-16T07:18:15.915511+0000 mgr.a (mgr.14373) 4380 : cluster [DBG] pgmap v3036: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 77 KiB/s rd, 426 B/s wr, 123 op/s 2024-09-16T07:18:17.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:18:17 smithi047 bash[22744]: cluster 2024-09-16T07:18:15.915511+0000 mgr.a (mgr.14373) 4380 : cluster [DBG] pgmap v3036: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 77 KiB/s rd, 426 B/s wr, 123 op/s 2024-09-16T07:18:18.633 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:18:18.634 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:18:18.634 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:18:19.403 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:18:19.403 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:18:19.403 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:18:19.403 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:18:19.403 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:18:19.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:18:19 smithi157 bash[24585]: cluster 2024-09-16T07:18:17.917749+0000 mgr.a (mgr.14373) 4381 : cluster [DBG] pgmap v3037: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 78 KiB/s rd, 426 B/s wr, 124 op/s 2024-09-16T07:18:19.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:18:19 smithi086 bash[24289]: cluster 2024-09-16T07:18:17.917749+0000 mgr.a (mgr.14373) 4381 : cluster [DBG] pgmap v3037: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 78 KiB/s rd, 426 B/s wr, 124 op/s 2024-09-16T07:18:19.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:18:19 smithi047 bash[22744]: cluster 2024-09-16T07:18:17.917749+0000 mgr.a (mgr.14373) 4381 : cluster [DBG] pgmap v3037: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 78 KiB/s rd, 426 B/s wr, 124 op/s 2024-09-16T07:18:20.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:18:20 smithi157 bash[24585]: audit 2024-09-16T07:18:18.973421+0000 mgr.a (mgr.14373) 4382 : audit [DBG] from='client.104859 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:18:20.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:18:20 smithi086 bash[24289]: audit 2024-09-16T07:18:18.973421+0000 mgr.a (mgr.14373) 4382 : audit [DBG] from='client.104859 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:18:20.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:18:20 smithi047 bash[22744]: audit 2024-09-16T07:18:18.973421+0000 mgr.a (mgr.14373) 4382 : audit [DBG] from='client.104859 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:18:21.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:18:21 smithi157 bash[24585]: cluster 2024-09-16T07:18:19.918891+0000 mgr.a (mgr.14373) 4383 : cluster [DBG] pgmap v3038: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 70 KiB/s rd, 426 B/s wr, 112 op/s 2024-09-16T07:18:21.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:18:21 smithi086 bash[24289]: cluster 2024-09-16T07:18:19.918891+0000 mgr.a (mgr.14373) 4383 : cluster [DBG] pgmap v3038: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 70 KiB/s rd, 426 B/s wr, 112 op/s 2024-09-16T07:18:21.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:18:21 smithi047 bash[22744]: cluster 2024-09-16T07:18:19.918891+0000 mgr.a (mgr.14373) 4383 : cluster [DBG] pgmap v3038: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 70 KiB/s rd, 426 B/s wr, 112 op/s 2024-09-16T07:18:23.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:18:23 smithi157 bash[24585]: cluster 2024-09-16T07:18:21.921217+0000 mgr.a (mgr.14373) 4384 : cluster [DBG] pgmap v3039: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 71 KiB/s rd, 426 B/s wr, 113 op/s 2024-09-16T07:18:23.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:18:23 smithi086 bash[24289]: cluster 2024-09-16T07:18:21.921217+0000 mgr.a (mgr.14373) 4384 : cluster [DBG] pgmap v3039: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 71 KiB/s rd, 426 B/s wr, 113 op/s 2024-09-16T07:18:23.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:18:23 smithi047 bash[22744]: cluster 2024-09-16T07:18:21.921217+0000 mgr.a (mgr.14373) 4384 : cluster [DBG] pgmap v3039: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 71 KiB/s rd, 426 B/s wr, 113 op/s 2024-09-16T07:18:24.404 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:18:24.405 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:18:24.405 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:18:25.182 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:18:25.183 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:18:25.183 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:18:25.183 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:18:25.183 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:18:25.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:18:25 smithi157 bash[24585]: cluster 2024-09-16T07:18:23.922171+0000 mgr.a (mgr.14373) 4385 : cluster [DBG] pgmap v3040: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:18:25.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:18:25 smithi086 bash[24289]: cluster 2024-09-16T07:18:23.922171+0000 mgr.a (mgr.14373) 4385 : cluster [DBG] pgmap v3040: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:18:25.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:18:25 smithi047 bash[22744]: cluster 2024-09-16T07:18:23.922171+0000 mgr.a (mgr.14373) 4385 : cluster [DBG] pgmap v3040: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:18:26.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:18:26 smithi157 bash[24585]: audit 2024-09-16T07:18:24.744651+0000 mgr.a (mgr.14373) 4386 : audit [DBG] from='client.104937 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:18:26.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:18:26 smithi086 bash[24289]: audit 2024-09-16T07:18:24.744651+0000 mgr.a (mgr.14373) 4386 : audit [DBG] from='client.104937 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:18:26.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:18:26 smithi047 bash[22744]: audit 2024-09-16T07:18:24.744651+0000 mgr.a (mgr.14373) 4386 : audit [DBG] from='client.104937 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:18:27.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:18:27 smithi157 bash[24585]: cluster 2024-09-16T07:18:25.923173+0000 mgr.a (mgr.14373) 4387 : cluster [DBG] pgmap v3041: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:18:27.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:18:27 smithi086 bash[24289]: cluster 2024-09-16T07:18:25.923173+0000 mgr.a (mgr.14373) 4387 : cluster [DBG] pgmap v3041: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:18:27.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:18:27 smithi047 bash[22744]: cluster 2024-09-16T07:18:25.923173+0000 mgr.a (mgr.14373) 4387 : cluster [DBG] pgmap v3041: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:18:29.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:18:29 smithi157 bash[24585]: cluster 2024-09-16T07:18:27.925422+0000 mgr.a (mgr.14373) 4388 : cluster [DBG] pgmap v3042: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:18:29.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:18:29 smithi086 bash[24289]: cluster 2024-09-16T07:18:27.925422+0000 mgr.a (mgr.14373) 4388 : cluster [DBG] pgmap v3042: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:18:29.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:18:29 smithi047 bash[22744]: cluster 2024-09-16T07:18:27.925422+0000 mgr.a (mgr.14373) 4388 : cluster [DBG] pgmap v3042: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:18:30.184 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:18:30.185 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:18:30.185 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:18:30.914 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:18:30.914 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:18:30.914 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:18:30.914 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:18:30.914 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:18:31.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:18:31 smithi157 bash[24585]: cluster 2024-09-16T07:18:29.926200+0000 mgr.a (mgr.14373) 4389 : cluster [DBG] pgmap v3043: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:18:31.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:18:31 smithi157 bash[24585]: audit 2024-09-16T07:18:30.516722+0000 mgr.a (mgr.14373) 4390 : audit [DBG] from='client.105012 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:18:31.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:18:31 smithi086 bash[24289]: cluster 2024-09-16T07:18:29.926200+0000 mgr.a (mgr.14373) 4389 : cluster [DBG] pgmap v3043: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:18:31.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:18:31 smithi086 bash[24289]: audit 2024-09-16T07:18:30.516722+0000 mgr.a (mgr.14373) 4390 : audit [DBG] from='client.105012 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:18:31.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:18:31 smithi047 bash[22744]: cluster 2024-09-16T07:18:29.926200+0000 mgr.a (mgr.14373) 4389 : cluster [DBG] pgmap v3043: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:18:31.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:18:31 smithi047 bash[22744]: audit 2024-09-16T07:18:30.516722+0000 mgr.a (mgr.14373) 4390 : audit [DBG] from='client.105012 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:18:33.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:18:33 smithi157 bash[24585]: cluster 2024-09-16T07:18:31.928548+0000 mgr.a (mgr.14373) 4391 : cluster [DBG] pgmap v3044: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:18:33.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:18:33 smithi086 bash[24289]: cluster 2024-09-16T07:18:31.928548+0000 mgr.a (mgr.14373) 4391 : cluster [DBG] pgmap v3044: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:18:33.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:18:33 smithi047 bash[22744]: cluster 2024-09-16T07:18:31.928548+0000 mgr.a (mgr.14373) 4391 : cluster [DBG] pgmap v3044: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:18:35.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:18:35 smithi157 bash[24585]: cluster 2024-09-16T07:18:33.929313+0000 mgr.a (mgr.14373) 4392 : cluster [DBG] pgmap v3045: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:18:35.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:18:35 smithi086 bash[24289]: cluster 2024-09-16T07:18:33.929313+0000 mgr.a (mgr.14373) 4392 : cluster [DBG] pgmap v3045: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:18:35.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:18:35 smithi047 bash[22744]: cluster 2024-09-16T07:18:33.929313+0000 mgr.a (mgr.14373) 4392 : cluster [DBG] pgmap v3045: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:18:35.915 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:18:35.916 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:18:35.916 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:18:36.676 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:18:36.677 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:18:36.677 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:18:36.677 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:18:36.677 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:18:37.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:18:37 smithi157 bash[24585]: cluster 2024-09-16T07:18:35.930017+0000 mgr.a (mgr.14373) 4393 : cluster [DBG] pgmap v3046: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:18:37.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:18:37 smithi157 bash[24585]: audit 2024-09-16T07:18:36.251798+0000 mgr.a (mgr.14373) 4394 : audit [DBG] from='client.105087 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:18:37.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:18:37 smithi086 bash[24289]: cluster 2024-09-16T07:18:35.930017+0000 mgr.a (mgr.14373) 4393 : cluster [DBG] pgmap v3046: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:18:37.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:18:37 smithi086 bash[24289]: audit 2024-09-16T07:18:36.251798+0000 mgr.a (mgr.14373) 4394 : audit [DBG] from='client.105087 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:18:37.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:18:37 smithi047 bash[22744]: cluster 2024-09-16T07:18:35.930017+0000 mgr.a (mgr.14373) 4393 : cluster [DBG] pgmap v3046: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:18:37.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:18:37 smithi047 bash[22744]: audit 2024-09-16T07:18:36.251798+0000 mgr.a (mgr.14373) 4394 : audit [DBG] from='client.105087 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:18:39.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:18:39 smithi157 bash[24585]: cluster 2024-09-16T07:18:37.932737+0000 mgr.a (mgr.14373) 4395 : cluster [DBG] pgmap v3047: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-16T07:18:39.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:18:39 smithi086 bash[24289]: cluster 2024-09-16T07:18:37.932737+0000 mgr.a (mgr.14373) 4395 : cluster [DBG] pgmap v3047: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-16T07:18:39.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:18:39 smithi047 bash[22744]: cluster 2024-09-16T07:18:37.932737+0000 mgr.a (mgr.14373) 4395 : cluster [DBG] pgmap v3047: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-16T07:18:41.678 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:18:41.679 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:18:41.679 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:18:41.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:18:41 smithi157 bash[24585]: cluster 2024-09-16T07:18:39.933561+0000 mgr.a (mgr.14373) 4396 : cluster [DBG] pgmap v3048: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T07:18:41.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:18:41 smithi086 bash[24289]: cluster 2024-09-16T07:18:39.933561+0000 mgr.a (mgr.14373) 4396 : cluster [DBG] pgmap v3048: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T07:18:41.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:18:41 smithi047 bash[22744]: cluster 2024-09-16T07:18:39.933561+0000 mgr.a (mgr.14373) 4396 : cluster [DBG] pgmap v3048: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T07:18:42.438 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:18:42.439 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:18:42.439 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:18:42.439 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:18:42.439 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:18:43.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:18:43 smithi157 bash[24585]: cluster 2024-09-16T07:18:41.935509+0000 mgr.a (mgr.14373) 4397 : cluster [DBG] pgmap v3049: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:18:43.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:18:43 smithi157 bash[24585]: audit 2024-09-16T07:18:42.013144+0000 mgr.a (mgr.14373) 4398 : audit [DBG] from='client.105165 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:18:43.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:18:43 smithi086 bash[24289]: cluster 2024-09-16T07:18:41.935509+0000 mgr.a (mgr.14373) 4397 : cluster [DBG] pgmap v3049: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:18:43.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:18:43 smithi086 bash[24289]: audit 2024-09-16T07:18:42.013144+0000 mgr.a (mgr.14373) 4398 : audit [DBG] from='client.105165 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:18:43.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:18:43 smithi047 bash[22744]: cluster 2024-09-16T07:18:41.935509+0000 mgr.a (mgr.14373) 4397 : cluster [DBG] pgmap v3049: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:18:43.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:18:43 smithi047 bash[22744]: audit 2024-09-16T07:18:42.013144+0000 mgr.a (mgr.14373) 4398 : audit [DBG] from='client.105165 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:18:45.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:18:45 smithi157 bash[24585]: cluster 2024-09-16T07:18:43.936380+0000 mgr.a (mgr.14373) 4399 : cluster [DBG] pgmap v3050: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:18:45.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:18:45 smithi086 bash[24289]: cluster 2024-09-16T07:18:43.936380+0000 mgr.a (mgr.14373) 4399 : cluster [DBG] pgmap v3050: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:18:45.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:18:45 smithi047 bash[22744]: cluster 2024-09-16T07:18:43.936380+0000 mgr.a (mgr.14373) 4399 : cluster [DBG] pgmap v3050: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:18:47.440 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:18:47.441 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:18:47.441 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:18:47.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:18:47 smithi157 bash[24585]: cluster 2024-09-16T07:18:45.937173+0000 mgr.a (mgr.14373) 4400 : cluster [DBG] pgmap v3051: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T07:18:47.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:18:47 smithi086 bash[24289]: cluster 2024-09-16T07:18:45.937173+0000 mgr.a (mgr.14373) 4400 : cluster [DBG] pgmap v3051: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T07:18:47.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:18:47 smithi047 bash[22744]: cluster 2024-09-16T07:18:45.937173+0000 mgr.a (mgr.14373) 4400 : cluster [DBG] pgmap v3051: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T07:18:48.208 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:18:48.208 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:18:48.208 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:18:48.208 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:18:48.209 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:18:49.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:18:49 smithi157 bash[24585]: audit 2024-09-16T07:18:47.777166+0000 mgr.a (mgr.14373) 4401 : audit [DBG] from='client.105243 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:18:49.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:18:49 smithi157 bash[24585]: cluster 2024-09-16T07:18:47.938691+0000 mgr.a (mgr.14373) 4402 : cluster [DBG] pgmap v3052: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:18:49.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:18:49 smithi086 bash[24289]: audit 2024-09-16T07:18:47.777166+0000 mgr.a (mgr.14373) 4401 : audit [DBG] from='client.105243 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:18:49.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:18:49 smithi086 bash[24289]: cluster 2024-09-16T07:18:47.938691+0000 mgr.a (mgr.14373) 4402 : cluster [DBG] pgmap v3052: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:18:49.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:18:49 smithi047 bash[22744]: audit 2024-09-16T07:18:47.777166+0000 mgr.a (mgr.14373) 4401 : audit [DBG] from='client.105243 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:18:49.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:18:49 smithi047 bash[22744]: cluster 2024-09-16T07:18:47.938691+0000 mgr.a (mgr.14373) 4402 : cluster [DBG] pgmap v3052: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:18:51.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:18:51 smithi157 bash[24585]: cluster 2024-09-16T07:18:49.939677+0000 mgr.a (mgr.14373) 4403 : cluster [DBG] pgmap v3053: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-16T07:18:51.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:18:51 smithi086 bash[24289]: cluster 2024-09-16T07:18:49.939677+0000 mgr.a (mgr.14373) 4403 : cluster [DBG] pgmap v3053: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-16T07:18:51.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:18:51 smithi047 bash[22744]: cluster 2024-09-16T07:18:49.939677+0000 mgr.a (mgr.14373) 4403 : cluster [DBG] pgmap v3053: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-16T07:18:53.210 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:18:53.210 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:18:53.211 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:18:53.974 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:18:53.974 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:18:53.975 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:18:53.975 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:18:53.975 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:18:54.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:18:53 smithi157 bash[24585]: cluster 2024-09-16T07:18:51.942026+0000 mgr.a (mgr.14373) 4404 : cluster [DBG] pgmap v3054: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-16T07:18:54.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:18:53 smithi086 bash[24289]: cluster 2024-09-16T07:18:51.942026+0000 mgr.a (mgr.14373) 4404 : cluster [DBG] pgmap v3054: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-16T07:18:54.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:18:53 smithi047 bash[22744]: cluster 2024-09-16T07:18:51.942026+0000 mgr.a (mgr.14373) 4404 : cluster [DBG] pgmap v3054: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-16T07:18:55.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:18:54 smithi157 bash[24585]: audit 2024-09-16T07:18:53.545202+0000 mgr.a (mgr.14373) 4405 : audit [DBG] from='client.105321 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:18:55.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:18:54 smithi086 bash[24289]: audit 2024-09-16T07:18:53.545202+0000 mgr.a (mgr.14373) 4405 : audit [DBG] from='client.105321 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:18:55.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:18:54 smithi047 bash[22744]: audit 2024-09-16T07:18:53.545202+0000 mgr.a (mgr.14373) 4405 : audit [DBG] from='client.105321 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:18:56.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:18:55 smithi157 bash[24585]: cluster 2024-09-16T07:18:53.942633+0000 mgr.a (mgr.14373) 4406 : cluster [DBG] pgmap v3055: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:18:56.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:18:55 smithi086 bash[24289]: cluster 2024-09-16T07:18:53.942633+0000 mgr.a (mgr.14373) 4406 : cluster [DBG] pgmap v3055: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:18:56.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:18:55 smithi047 bash[22744]: cluster 2024-09-16T07:18:53.942633+0000 mgr.a (mgr.14373) 4406 : cluster [DBG] pgmap v3055: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:18:58.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:18:57 smithi157 bash[24585]: cluster 2024-09-16T07:18:55.943402+0000 mgr.a (mgr.14373) 4407 : cluster [DBG] pgmap v3056: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:18:58.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:18:57 smithi086 bash[24289]: cluster 2024-09-16T07:18:55.943402+0000 mgr.a (mgr.14373) 4407 : cluster [DBG] pgmap v3056: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:18:58.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:18:57 smithi047 bash[22744]: cluster 2024-09-16T07:18:55.943402+0000 mgr.a (mgr.14373) 4407 : cluster [DBG] pgmap v3056: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:18:58.975 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:18:58.976 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:18:58.977 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:18:59.721 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:18:59.722 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:18:59.722 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:18:59.722 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:18:59.722 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:19:00.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:18:59 smithi157 bash[24585]: cluster 2024-09-16T07:18:57.945729+0000 mgr.a (mgr.14373) 4408 : cluster [DBG] pgmap v3057: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:19:00.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:18:59 smithi086 bash[24289]: cluster 2024-09-16T07:18:57.945729+0000 mgr.a (mgr.14373) 4408 : cluster [DBG] pgmap v3057: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:19:00.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:18:59 smithi047 bash[22744]: cluster 2024-09-16T07:18:57.945729+0000 mgr.a (mgr.14373) 4408 : cluster [DBG] pgmap v3057: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:19:01.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:19:00 smithi157 bash[24585]: audit 2024-09-16T07:18:59.310731+0000 mgr.a (mgr.14373) 4409 : audit [DBG] from='client.105396 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:19:01.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:19:00 smithi086 bash[24289]: audit 2024-09-16T07:18:59.310731+0000 mgr.a (mgr.14373) 4409 : audit [DBG] from='client.105396 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:19:01.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:19:00 smithi047 bash[22744]: audit 2024-09-16T07:18:59.310731+0000 mgr.a (mgr.14373) 4409 : audit [DBG] from='client.105396 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:19:02.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:19:01 smithi157 bash[24585]: cluster 2024-09-16T07:18:59.946735+0000 mgr.a (mgr.14373) 4410 : cluster [DBG] pgmap v3058: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:19:02.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:19:01 smithi086 bash[24289]: cluster 2024-09-16T07:18:59.946735+0000 mgr.a (mgr.14373) 4410 : cluster [DBG] pgmap v3058: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:19:02.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:19:01 smithi047 bash[22744]: cluster 2024-09-16T07:18:59.946735+0000 mgr.a (mgr.14373) 4410 : cluster [DBG] pgmap v3058: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:19:04.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:19:03 smithi157 bash[24585]: cluster 2024-09-16T07:19:01.948949+0000 mgr.a (mgr.14373) 4411 : cluster [DBG] pgmap v3059: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:19:04.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:19:03 smithi086 bash[24289]: cluster 2024-09-16T07:19:01.948949+0000 mgr.a (mgr.14373) 4411 : cluster [DBG] pgmap v3059: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:19:04.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:19:03 smithi047 bash[22744]: cluster 2024-09-16T07:19:01.948949+0000 mgr.a (mgr.14373) 4411 : cluster [DBG] pgmap v3059: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:19:04.723 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:19:04.724 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:19:04.724 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:19:05.464 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:19:05.464 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:19:05.464 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:19:05.465 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:19:05.465 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:19:06.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:19:05 smithi157 bash[24585]: cluster 2024-09-16T07:19:03.949730+0000 mgr.a (mgr.14373) 4412 : cluster [DBG] pgmap v3060: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:19:06.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:19:05 smithi086 bash[24289]: cluster 2024-09-16T07:19:03.949730+0000 mgr.a (mgr.14373) 4412 : cluster [DBG] pgmap v3060: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:19:06.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:19:05 smithi047 bash[22744]: cluster 2024-09-16T07:19:03.949730+0000 mgr.a (mgr.14373) 4412 : cluster [DBG] pgmap v3060: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:19:07.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:19:06 smithi157 bash[24585]: audit 2024-09-16T07:19:05.056409+0000 mgr.a (mgr.14373) 4413 : audit [DBG] from='client.105474 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:19:07.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:19:06 smithi086 bash[24289]: audit 2024-09-16T07:19:05.056409+0000 mgr.a (mgr.14373) 4413 : audit [DBG] from='client.105474 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:19:07.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:19:06 smithi047 bash[22744]: audit 2024-09-16T07:19:05.056409+0000 mgr.a (mgr.14373) 4413 : audit [DBG] from='client.105474 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:19:08.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:19:07 smithi157 bash[24585]: cluster 2024-09-16T07:19:05.950698+0000 mgr.a (mgr.14373) 4414 : cluster [DBG] pgmap v3061: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:19:08.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:19:07 smithi086 bash[24289]: cluster 2024-09-16T07:19:05.950698+0000 mgr.a (mgr.14373) 4414 : cluster [DBG] pgmap v3061: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:19:08.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:19:07 smithi047 bash[22744]: cluster 2024-09-16T07:19:05.950698+0000 mgr.a (mgr.14373) 4414 : cluster [DBG] pgmap v3061: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:19:10.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:19:09 smithi157 bash[24585]: cluster 2024-09-16T07:19:07.952915+0000 mgr.a (mgr.14373) 4415 : cluster [DBG] pgmap v3062: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:19:10.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:19:09 smithi086 bash[24289]: cluster 2024-09-16T07:19:07.952915+0000 mgr.a (mgr.14373) 4415 : cluster [DBG] pgmap v3062: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:19:10.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:19:09 smithi047 bash[22744]: cluster 2024-09-16T07:19:07.952915+0000 mgr.a (mgr.14373) 4415 : cluster [DBG] pgmap v3062: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:19:10.465 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:19:10.466 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:19:10.466 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:19:11.214 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:19:11.214 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:19:11.214 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:19:11.214 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:19:11.215 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:19:12.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:19:11 smithi157 bash[24585]: cluster 2024-09-16T07:19:09.953693+0000 mgr.a (mgr.14373) 4416 : cluster [DBG] pgmap v3063: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:19:12.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:19:11 smithi157 bash[24585]: audit 2024-09-16T07:19:10.945304+0000 mon.b (mon.2) 438 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T07:19:12.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:19:11 smithi086 bash[24289]: cluster 2024-09-16T07:19:09.953693+0000 mgr.a (mgr.14373) 4416 : cluster [DBG] pgmap v3063: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:19:12.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:19:11 smithi086 bash[24289]: audit 2024-09-16T07:19:10.945304+0000 mon.b (mon.2) 438 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T07:19:12.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:19:11 smithi047 bash[22744]: cluster 2024-09-16T07:19:09.953693+0000 mgr.a (mgr.14373) 4416 : cluster [DBG] pgmap v3063: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:19:12.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:19:11 smithi047 bash[22744]: audit 2024-09-16T07:19:10.945304+0000 mon.b (mon.2) 438 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T07:19:12.838 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 07:19:12 smithi047 bash[22994]: debug 2024-09-16T07:19:12.452+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T07:19:12.838 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 07:19:12 smithi047 bash[22994]: debug 2024-09-16T07:19:12.456+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T07:19:12.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:19:12 smithi047 bash[22744]: audit 2024-09-16T07:19:10.795431+0000 mgr.a (mgr.14373) 4417 : audit [DBG] from='client.105552 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:19:12.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:19:12 smithi047 bash[22744]: audit 2024-09-16T07:19:11.730667+0000 mon.b (mon.2) 439 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T07:19:12.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:19:12 smithi047 bash[22744]: audit 2024-09-16T07:19:11.732914+0000 mon.b (mon.2) 440 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T07:19:12.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:19:12 smithi047 bash[22744]: audit 2024-09-16T07:19:11.746275+0000 mon.a (mon.0) 835 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:19:12.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:19:12 smithi047 bash[22744]: audit 2024-09-16T07:19:11.749819+0000 mon.b (mon.2) 441 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:19:12.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:19:12 smithi047 bash[22744]: audit 2024-09-16T07:19:11.754320+0000 mgr.a (mgr.14373) 4418 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:19:12.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:19:12 smithi047 bash[22744]: cluster 2024-09-16T07:19:11.959546+0000 mgr.a (mgr.14373) 4419 : cluster [DBG] pgmap v3064: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:19:12.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:19:12 smithi047 bash[22744]: audit 2024-09-16T07:19:12.456553+0000 mgr.a (mgr.14373) 4420 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T07:19:12.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:19:12 smithi047 bash[22744]: cephadm 2024-09-16T07:19:12.458428+0000 mgr.a (mgr.14373) 4421 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T07:19:13.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:19:12 smithi157 bash[24585]: audit 2024-09-16T07:19:10.795431+0000 mgr.a (mgr.14373) 4417 : audit [DBG] from='client.105552 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:19:13.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:19:12 smithi157 bash[24585]: audit 2024-09-16T07:19:11.730667+0000 mon.b (mon.2) 439 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T07:19:13.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:19:12 smithi157 bash[24585]: audit 2024-09-16T07:19:11.732914+0000 mon.b (mon.2) 440 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T07:19:13.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:19:12 smithi157 bash[24585]: audit 2024-09-16T07:19:11.746275+0000 mon.a (mon.0) 835 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:19:13.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:19:12 smithi157 bash[24585]: audit 2024-09-16T07:19:11.749819+0000 mon.b (mon.2) 441 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:19:13.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:19:12 smithi157 bash[24585]: audit 2024-09-16T07:19:11.754320+0000 mgr.a (mgr.14373) 4418 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:19:13.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:19:12 smithi157 bash[24585]: cluster 2024-09-16T07:19:11.959546+0000 mgr.a (mgr.14373) 4419 : cluster [DBG] pgmap v3064: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:19:13.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:19:12 smithi157 bash[24585]: audit 2024-09-16T07:19:12.456553+0000 mgr.a (mgr.14373) 4420 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T07:19:13.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:19:12 smithi157 bash[24585]: cephadm 2024-09-16T07:19:12.458428+0000 mgr.a (mgr.14373) 4421 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T07:19:13.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:19:12 smithi086 bash[24289]: audit 2024-09-16T07:19:10.795431+0000 mgr.a (mgr.14373) 4417 : audit [DBG] from='client.105552 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:19:13.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:19:12 smithi086 bash[24289]: audit 2024-09-16T07:19:11.730667+0000 mon.b (mon.2) 439 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T07:19:13.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:19:12 smithi086 bash[24289]: audit 2024-09-16T07:19:11.732914+0000 mon.b (mon.2) 440 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T07:19:13.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:19:12 smithi086 bash[24289]: audit 2024-09-16T07:19:11.746275+0000 mon.a (mon.0) 835 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:19:13.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:19:12 smithi086 bash[24289]: audit 2024-09-16T07:19:11.749819+0000 mon.b (mon.2) 441 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:19:13.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:19:12 smithi086 bash[24289]: audit 2024-09-16T07:19:11.754320+0000 mgr.a (mgr.14373) 4418 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:19:13.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:19:12 smithi086 bash[24289]: cluster 2024-09-16T07:19:11.959546+0000 mgr.a (mgr.14373) 4419 : cluster [DBG] pgmap v3064: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:19:13.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:19:12 smithi086 bash[24289]: audit 2024-09-16T07:19:12.456553+0000 mgr.a (mgr.14373) 4420 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T07:19:13.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:19:12 smithi086 bash[24289]: cephadm 2024-09-16T07:19:12.458428+0000 mgr.a (mgr.14373) 4421 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T07:19:15.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:19:15 smithi157 bash[24585]: cluster 2024-09-16T07:19:13.960396+0000 mgr.a (mgr.14373) 4422 : cluster [DBG] pgmap v3065: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:19:15.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:19:15 smithi086 bash[24289]: cluster 2024-09-16T07:19:13.960396+0000 mgr.a (mgr.14373) 4422 : cluster [DBG] pgmap v3065: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:19:15.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:19:15 smithi047 bash[22744]: cluster 2024-09-16T07:19:13.960396+0000 mgr.a (mgr.14373) 4422 : cluster [DBG] pgmap v3065: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:19:16.215 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:19:16.216 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:19:16.216 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:19:16.984 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:19:16.985 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:19:16.985 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:19:16.985 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:19:16.985 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:19:17.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:19:17 smithi157 bash[24585]: cluster 2024-09-16T07:19:15.961165+0000 mgr.a (mgr.14373) 4423 : cluster [DBG] pgmap v3066: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:19:17.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:19:17 smithi157 bash[24585]: audit 2024-09-16T07:19:16.556421+0000 mgr.a (mgr.14373) 4424 : audit [DBG] from='client.105735 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:19:17.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:19:17 smithi086 bash[24289]: cluster 2024-09-16T07:19:15.961165+0000 mgr.a (mgr.14373) 4423 : cluster [DBG] pgmap v3066: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:19:17.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:19:17 smithi086 bash[24289]: audit 2024-09-16T07:19:16.556421+0000 mgr.a (mgr.14373) 4424 : audit [DBG] from='client.105735 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:19:17.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:19:17 smithi047 bash[22744]: cluster 2024-09-16T07:19:15.961165+0000 mgr.a (mgr.14373) 4423 : cluster [DBG] pgmap v3066: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:19:17.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:19:17 smithi047 bash[22744]: audit 2024-09-16T07:19:16.556421+0000 mgr.a (mgr.14373) 4424 : audit [DBG] from='client.105735 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:19:19.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:19:19 smithi157 bash[24585]: cluster 2024-09-16T07:19:17.963936+0000 mgr.a (mgr.14373) 4425 : cluster [DBG] pgmap v3067: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:19:19.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:19:19 smithi086 bash[24289]: cluster 2024-09-16T07:19:17.963936+0000 mgr.a (mgr.14373) 4425 : cluster [DBG] pgmap v3067: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:19:19.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:19:19 smithi047 bash[22744]: cluster 2024-09-16T07:19:17.963936+0000 mgr.a (mgr.14373) 4425 : cluster [DBG] pgmap v3067: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:19:21.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:19:21 smithi157 bash[24585]: cluster 2024-09-16T07:19:19.964740+0000 mgr.a (mgr.14373) 4426 : cluster [DBG] pgmap v3068: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T07:19:21.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:19:21 smithi086 bash[24289]: cluster 2024-09-16T07:19:19.964740+0000 mgr.a (mgr.14373) 4426 : cluster [DBG] pgmap v3068: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T07:19:21.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:19:21 smithi047 bash[22744]: cluster 2024-09-16T07:19:19.964740+0000 mgr.a (mgr.14373) 4426 : cluster [DBG] pgmap v3068: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T07:19:21.985 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:19:21.986 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:19:21.986 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:19:22.744 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:19:22.744 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:19:22.744 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:19:22.745 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:19:22.745 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:19:23.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:19:23 smithi157 bash[24585]: cluster 2024-09-16T07:19:21.966678+0000 mgr.a (mgr.14373) 4427 : cluster [DBG] pgmap v3069: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:19:23.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:19:23 smithi157 bash[24585]: audit 2024-09-16T07:19:22.323568+0000 mgr.a (mgr.14373) 4428 : audit [DBG] from='client.105813 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:19:23.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:19:23 smithi086 bash[24289]: cluster 2024-09-16T07:19:21.966678+0000 mgr.a (mgr.14373) 4427 : cluster [DBG] pgmap v3069: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:19:23.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:19:23 smithi086 bash[24289]: audit 2024-09-16T07:19:22.323568+0000 mgr.a (mgr.14373) 4428 : audit [DBG] from='client.105813 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:19:23.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:19:23 smithi047 bash[22744]: cluster 2024-09-16T07:19:21.966678+0000 mgr.a (mgr.14373) 4427 : cluster [DBG] pgmap v3069: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:19:23.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:19:23 smithi047 bash[22744]: audit 2024-09-16T07:19:22.323568+0000 mgr.a (mgr.14373) 4428 : audit [DBG] from='client.105813 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:19:25.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:19:25 smithi157 bash[24585]: cluster 2024-09-16T07:19:23.967728+0000 mgr.a (mgr.14373) 4429 : cluster [DBG] pgmap v3070: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T07:19:25.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:19:25 smithi086 bash[24289]: cluster 2024-09-16T07:19:23.967728+0000 mgr.a (mgr.14373) 4429 : cluster [DBG] pgmap v3070: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T07:19:25.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:19:25 smithi047 bash[22744]: cluster 2024-09-16T07:19:23.967728+0000 mgr.a (mgr.14373) 4429 : cluster [DBG] pgmap v3070: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T07:19:27.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:19:27 smithi157 bash[24585]: cluster 2024-09-16T07:19:25.968695+0000 mgr.a (mgr.14373) 4430 : cluster [DBG] pgmap v3071: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T07:19:27.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:19:27 smithi086 bash[24289]: cluster 2024-09-16T07:19:25.968695+0000 mgr.a (mgr.14373) 4430 : cluster [DBG] pgmap v3071: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T07:19:27.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:19:27 smithi047 bash[22744]: cluster 2024-09-16T07:19:25.968695+0000 mgr.a (mgr.14373) 4430 : cluster [DBG] pgmap v3071: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T07:19:27.746 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:19:27.746 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:19:27.746 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:19:28.518 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:19:28.519 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:19:28.519 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:19:28.519 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:19:28.519 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:19:29.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:19:29 smithi157 bash[24585]: cluster 2024-09-16T07:19:27.970887+0000 mgr.a (mgr.14373) 4431 : cluster [DBG] pgmap v3072: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:19:29.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:19:29 smithi157 bash[24585]: audit 2024-09-16T07:19:28.088929+0000 mgr.a (mgr.14373) 4432 : audit [DBG] from='client.105891 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:19:29.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:19:29 smithi086 bash[24289]: cluster 2024-09-16T07:19:27.970887+0000 mgr.a (mgr.14373) 4431 : cluster [DBG] pgmap v3072: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:19:29.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:19:29 smithi086 bash[24289]: audit 2024-09-16T07:19:28.088929+0000 mgr.a (mgr.14373) 4432 : audit [DBG] from='client.105891 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:19:29.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:19:29 smithi047 bash[22744]: cluster 2024-09-16T07:19:27.970887+0000 mgr.a (mgr.14373) 4431 : cluster [DBG] pgmap v3072: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:19:29.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:19:29 smithi047 bash[22744]: audit 2024-09-16T07:19:28.088929+0000 mgr.a (mgr.14373) 4432 : audit [DBG] from='client.105891 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:19:31.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:19:31 smithi157 bash[24585]: cluster 2024-09-16T07:19:29.971785+0000 mgr.a (mgr.14373) 4433 : cluster [DBG] pgmap v3073: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:19:31.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:19:31 smithi086 bash[24289]: cluster 2024-09-16T07:19:29.971785+0000 mgr.a (mgr.14373) 4433 : cluster [DBG] pgmap v3073: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:19:31.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:19:31 smithi047 bash[22744]: cluster 2024-09-16T07:19:29.971785+0000 mgr.a (mgr.14373) 4433 : cluster [DBG] pgmap v3073: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:19:33.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:19:33 smithi086 bash[24289]: cluster 2024-09-16T07:19:31.973893+0000 mgr.a (mgr.14373) 4434 : cluster [DBG] pgmap v3074: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:19:33.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:19:33 smithi047 bash[22744]: cluster 2024-09-16T07:19:31.973893+0000 mgr.a (mgr.14373) 4434 : cluster [DBG] pgmap v3074: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:19:33.520 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:19:33.521 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:19:33.521 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:19:33.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:19:33 smithi157 bash[24585]: cluster 2024-09-16T07:19:31.973893+0000 mgr.a (mgr.14373) 4434 : cluster [DBG] pgmap v3074: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:19:34.256 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:19:34.256 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:19:34.256 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:19:34.257 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:19:34.257 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:19:35.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:19:35 smithi086 bash[24289]: audit 2024-09-16T07:19:33.849913+0000 mgr.a (mgr.14373) 4435 : audit [DBG] from='client.105969 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:19:35.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:19:35 smithi086 bash[24289]: cluster 2024-09-16T07:19:33.977098+0000 mgr.a (mgr.14373) 4436 : cluster [DBG] pgmap v3075: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:19:35.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:19:35 smithi047 bash[22744]: audit 2024-09-16T07:19:33.849913+0000 mgr.a (mgr.14373) 4435 : audit [DBG] from='client.105969 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:19:35.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:19:35 smithi047 bash[22744]: cluster 2024-09-16T07:19:33.977098+0000 mgr.a (mgr.14373) 4436 : cluster [DBG] pgmap v3075: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:19:35.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:19:35 smithi157 bash[24585]: audit 2024-09-16T07:19:33.849913+0000 mgr.a (mgr.14373) 4435 : audit [DBG] from='client.105969 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:19:35.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:19:35 smithi157 bash[24585]: cluster 2024-09-16T07:19:33.977098+0000 mgr.a (mgr.14373) 4436 : cluster [DBG] pgmap v3075: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:19:37.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:19:37 smithi086 bash[24289]: cluster 2024-09-16T07:19:35.978067+0000 mgr.a (mgr.14373) 4437 : cluster [DBG] pgmap v3076: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:19:37.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:19:37 smithi047 bash[22744]: cluster 2024-09-16T07:19:35.978067+0000 mgr.a (mgr.14373) 4437 : cluster [DBG] pgmap v3076: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:19:37.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:19:37 smithi157 bash[24585]: cluster 2024-09-16T07:19:35.978067+0000 mgr.a (mgr.14373) 4437 : cluster [DBG] pgmap v3076: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:19:39.257 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:19:39.258 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:19:39.258 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:19:39.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:19:39 smithi086 bash[24289]: cluster 2024-09-16T07:19:37.980308+0000 mgr.a (mgr.14373) 4438 : cluster [DBG] pgmap v3077: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:19:39.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:19:39 smithi047 bash[22744]: cluster 2024-09-16T07:19:37.980308+0000 mgr.a (mgr.14373) 4438 : cluster [DBG] pgmap v3077: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:19:39.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:19:39 smithi157 bash[24585]: cluster 2024-09-16T07:19:37.980308+0000 mgr.a (mgr.14373) 4438 : cluster [DBG] pgmap v3077: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:19:39.989 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:19:39.990 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:19:39.990 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:19:39.990 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:19:39.990 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:19:40.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:19:40 smithi047 bash[22744]: audit 2024-09-16T07:19:39.593221+0000 mgr.a (mgr.14373) 4439 : audit [DBG] from='client.106041 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:19:40.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:19:40 smithi157 bash[24585]: audit 2024-09-16T07:19:39.593221+0000 mgr.a (mgr.14373) 4439 : audit [DBG] from='client.106041 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:19:40.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:19:40 smithi086 bash[24289]: audit 2024-09-16T07:19:39.593221+0000 mgr.a (mgr.14373) 4439 : audit [DBG] from='client.106041 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:19:41.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:19:41 smithi047 bash[22744]: cluster 2024-09-16T07:19:39.980795+0000 mgr.a (mgr.14373) 4440 : cluster [DBG] pgmap v3078: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:19:41.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:19:41 smithi157 bash[24585]: cluster 2024-09-16T07:19:39.980795+0000 mgr.a (mgr.14373) 4440 : cluster [DBG] pgmap v3078: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:19:41.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:19:41 smithi086 bash[24289]: cluster 2024-09-16T07:19:39.980795+0000 mgr.a (mgr.14373) 4440 : cluster [DBG] pgmap v3078: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:19:43.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:19:43 smithi047 bash[22744]: cluster 2024-09-16T07:19:41.982890+0000 mgr.a (mgr.14373) 4441 : cluster [DBG] pgmap v3079: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:19:43.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:19:43 smithi157 bash[24585]: cluster 2024-09-16T07:19:41.982890+0000 mgr.a (mgr.14373) 4441 : cluster [DBG] pgmap v3079: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:19:43.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:19:43 smithi086 bash[24289]: cluster 2024-09-16T07:19:41.982890+0000 mgr.a (mgr.14373) 4441 : cluster [DBG] pgmap v3079: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:19:44.991 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:19:44.991 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:19:44.992 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:19:45.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:19:45 smithi047 bash[22744]: cluster 2024-09-16T07:19:43.983631+0000 mgr.a (mgr.14373) 4442 : cluster [DBG] pgmap v3080: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:19:45.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:19:45 smithi157 bash[24585]: cluster 2024-09-16T07:19:43.983631+0000 mgr.a (mgr.14373) 4442 : cluster [DBG] pgmap v3080: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:19:45.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:19:45 smithi086 bash[24289]: cluster 2024-09-16T07:19:43.983631+0000 mgr.a (mgr.14373) 4442 : cluster [DBG] pgmap v3080: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:19:45.745 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:19:45.745 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:19:45.745 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:19:45.745 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:19:45.746 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:19:46.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:19:46 smithi047 bash[22744]: audit 2024-09-16T07:19:45.326949+0000 mgr.a (mgr.14373) 4443 : audit [DBG] from='client.106119 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:19:46.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:19:46 smithi157 bash[24585]: audit 2024-09-16T07:19:45.326949+0000 mgr.a (mgr.14373) 4443 : audit [DBG] from='client.106119 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:19:46.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:19:46 smithi086 bash[24289]: audit 2024-09-16T07:19:45.326949+0000 mgr.a (mgr.14373) 4443 : audit [DBG] from='client.106119 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:19:47.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:19:47 smithi157 bash[24585]: cluster 2024-09-16T07:19:45.984587+0000 mgr.a (mgr.14373) 4444 : cluster [DBG] pgmap v3081: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:19:47.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:19:47 smithi086 bash[24289]: cluster 2024-09-16T07:19:45.984587+0000 mgr.a (mgr.14373) 4444 : cluster [DBG] pgmap v3081: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:19:47.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:19:47 smithi047 bash[22744]: cluster 2024-09-16T07:19:45.984587+0000 mgr.a (mgr.14373) 4444 : cluster [DBG] pgmap v3081: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:19:49.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:19:49 smithi157 bash[24585]: cluster 2024-09-16T07:19:47.986817+0000 mgr.a (mgr.14373) 4445 : cluster [DBG] pgmap v3082: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:19:49.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:19:49 smithi086 bash[24289]: cluster 2024-09-16T07:19:47.986817+0000 mgr.a (mgr.14373) 4445 : cluster [DBG] pgmap v3082: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:19:49.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:19:49 smithi047 bash[22744]: cluster 2024-09-16T07:19:47.986817+0000 mgr.a (mgr.14373) 4445 : cluster [DBG] pgmap v3082: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:19:50.747 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:19:50.747 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:19:50.747 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:19:51.518 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:19:51.518 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:19:51.519 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:19:51.519 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:19:51.519 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:19:51.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:19:51 smithi157 bash[24585]: cluster 2024-09-16T07:19:49.987597+0000 mgr.a (mgr.14373) 4446 : cluster [DBG] pgmap v3083: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:19:51.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:19:51 smithi086 bash[24289]: cluster 2024-09-16T07:19:49.987597+0000 mgr.a (mgr.14373) 4446 : cluster [DBG] pgmap v3083: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:19:51.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:19:51 smithi047 bash[22744]: cluster 2024-09-16T07:19:49.987597+0000 mgr.a (mgr.14373) 4446 : cluster [DBG] pgmap v3083: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:19:52.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:19:52 smithi157 bash[24585]: audit 2024-09-16T07:19:51.084269+0000 mgr.a (mgr.14373) 4447 : audit [DBG] from='client.106194 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:19:52.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:19:52 smithi086 bash[24289]: audit 2024-09-16T07:19:51.084269+0000 mgr.a (mgr.14373) 4447 : audit [DBG] from='client.106194 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:19:52.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:19:52 smithi047 bash[22744]: audit 2024-09-16T07:19:51.084269+0000 mgr.a (mgr.14373) 4447 : audit [DBG] from='client.106194 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:19:53.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:19:53 smithi157 bash[24585]: cluster 2024-09-16T07:19:51.989956+0000 mgr.a (mgr.14373) 4448 : cluster [DBG] pgmap v3084: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:19:53.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:19:53 smithi086 bash[24289]: cluster 2024-09-16T07:19:51.989956+0000 mgr.a (mgr.14373) 4448 : cluster [DBG] pgmap v3084: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:19:53.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:19:53 smithi047 bash[22744]: cluster 2024-09-16T07:19:51.989956+0000 mgr.a (mgr.14373) 4448 : cluster [DBG] pgmap v3084: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:19:55.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:19:55 smithi157 bash[24585]: cluster 2024-09-16T07:19:53.990787+0000 mgr.a (mgr.14373) 4449 : cluster [DBG] pgmap v3085: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:19:55.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:19:55 smithi086 bash[24289]: cluster 2024-09-16T07:19:53.990787+0000 mgr.a (mgr.14373) 4449 : cluster [DBG] pgmap v3085: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:19:55.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:19:55 smithi047 bash[22744]: cluster 2024-09-16T07:19:53.990787+0000 mgr.a (mgr.14373) 4449 : cluster [DBG] pgmap v3085: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:19:56.520 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:19:56.521 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:19:56.521 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:19:57.257 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:19:57.258 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:19:57.258 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:19:57.258 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:19:57.258 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:19:57.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:19:57 smithi157 bash[24585]: cluster 2024-09-16T07:19:55.991572+0000 mgr.a (mgr.14373) 4450 : cluster [DBG] pgmap v3086: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:19:57.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:19:57 smithi086 bash[24289]: cluster 2024-09-16T07:19:55.991572+0000 mgr.a (mgr.14373) 4450 : cluster [DBG] pgmap v3086: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:19:57.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:19:57 smithi047 bash[22744]: cluster 2024-09-16T07:19:55.991572+0000 mgr.a (mgr.14373) 4450 : cluster [DBG] pgmap v3086: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:19:58.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:19:58 smithi157 bash[24585]: audit 2024-09-16T07:19:56.854880+0000 mgr.a (mgr.14373) 4451 : audit [DBG] from='client.106269 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:19:58.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:19:58 smithi086 bash[24289]: audit 2024-09-16T07:19:56.854880+0000 mgr.a (mgr.14373) 4451 : audit [DBG] from='client.106269 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:19:58.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:19:58 smithi047 bash[22744]: audit 2024-09-16T07:19:56.854880+0000 mgr.a (mgr.14373) 4451 : audit [DBG] from='client.106269 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:19:59.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:19:59 smithi157 bash[24585]: cluster 2024-09-16T07:19:57.994247+0000 mgr.a (mgr.14373) 4452 : cluster [DBG] pgmap v3087: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:19:59.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:19:59 smithi086 bash[24289]: cluster 2024-09-16T07:19:57.994247+0000 mgr.a (mgr.14373) 4452 : cluster [DBG] pgmap v3087: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:19:59.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:19:59 smithi047 bash[22744]: cluster 2024-09-16T07:19:57.994247+0000 mgr.a (mgr.14373) 4452 : cluster [DBG] pgmap v3087: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:20:00.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:20:00 smithi157 bash[24585]: cluster 2024-09-16T07:20:00.000148+0000 mon.a (mon.0) 836 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-16T07:20:00.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:20:00 smithi086 bash[24289]: cluster 2024-09-16T07:20:00.000148+0000 mon.a (mon.0) 836 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-16T07:20:00.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:20:00 smithi047 bash[22744]: cluster 2024-09-16T07:20:00.000148+0000 mon.a (mon.0) 836 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-16T07:20:01.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:20:01 smithi157 bash[24585]: cluster 2024-09-16T07:19:59.995047+0000 mgr.a (mgr.14373) 4453 : cluster [DBG] pgmap v3088: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:20:01.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:20:01 smithi086 bash[24289]: cluster 2024-09-16T07:19:59.995047+0000 mgr.a (mgr.14373) 4453 : cluster [DBG] pgmap v3088: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:20:01.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:20:01 smithi047 bash[22744]: cluster 2024-09-16T07:19:59.995047+0000 mgr.a (mgr.14373) 4453 : cluster [DBG] pgmap v3088: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:20:02.259 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:20:02.259 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:20:02.260 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:20:03.037 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:20:03.037 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:20:03.037 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:20:03.037 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:20:03.038 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:20:03.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:20:03 smithi157 bash[24585]: cluster 2024-09-16T07:20:01.998079+0000 mgr.a (mgr.14373) 4454 : cluster [DBG] pgmap v3089: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:20:03.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:20:03 smithi157 bash[24585]: audit 2024-09-16T07:20:02.594639+0000 mgr.a (mgr.14373) 4455 : audit [DBG] from='client.106347 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:20:03.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:20:03 smithi086 bash[24289]: cluster 2024-09-16T07:20:01.998079+0000 mgr.a (mgr.14373) 4454 : cluster [DBG] pgmap v3089: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:20:03.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:20:03 smithi086 bash[24289]: audit 2024-09-16T07:20:02.594639+0000 mgr.a (mgr.14373) 4455 : audit [DBG] from='client.106347 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:20:03.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:20:03 smithi047 bash[22744]: cluster 2024-09-16T07:20:01.998079+0000 mgr.a (mgr.14373) 4454 : cluster [DBG] pgmap v3089: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:20:03.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:20:03 smithi047 bash[22744]: audit 2024-09-16T07:20:02.594639+0000 mgr.a (mgr.14373) 4455 : audit [DBG] from='client.106347 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:20:05.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:20:05 smithi157 bash[24585]: cluster 2024-09-16T07:20:03.999096+0000 mgr.a (mgr.14373) 4456 : cluster [DBG] pgmap v3090: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:20:05.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:20:05 smithi086 bash[24289]: cluster 2024-09-16T07:20:03.999096+0000 mgr.a (mgr.14373) 4456 : cluster [DBG] pgmap v3090: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:20:05.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:20:05 smithi047 bash[22744]: cluster 2024-09-16T07:20:03.999096+0000 mgr.a (mgr.14373) 4456 : cluster [DBG] pgmap v3090: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:20:07.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:20:07 smithi157 bash[24585]: cluster 2024-09-16T07:20:06.000052+0000 mgr.a (mgr.14373) 4457 : cluster [DBG] pgmap v3091: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:20:07.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:20:07 smithi086 bash[24289]: cluster 2024-09-16T07:20:06.000052+0000 mgr.a (mgr.14373) 4457 : cluster [DBG] pgmap v3091: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:20:07.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:20:07 smithi047 bash[22744]: cluster 2024-09-16T07:20:06.000052+0000 mgr.a (mgr.14373) 4457 : cluster [DBG] pgmap v3091: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:20:08.039 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:20:08.039 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:20:08.040 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:20:08.793 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:20:08.793 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:20:08.794 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:20:08.794 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:20:08.794 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:20:09.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:20:09 smithi157 bash[24585]: cluster 2024-09-16T07:20:08.002288+0000 mgr.a (mgr.14373) 4458 : cluster [DBG] pgmap v3092: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:20:09.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:20:09 smithi157 bash[24585]: audit 2024-09-16T07:20:08.378404+0000 mgr.a (mgr.14373) 4459 : audit [DBG] from='client.106425 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:20:09.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:20:09 smithi086 bash[24289]: cluster 2024-09-16T07:20:08.002288+0000 mgr.a (mgr.14373) 4458 : cluster [DBG] pgmap v3092: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:20:09.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:20:09 smithi086 bash[24289]: audit 2024-09-16T07:20:08.378404+0000 mgr.a (mgr.14373) 4459 : audit [DBG] from='client.106425 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:20:09.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:20:09 smithi047 bash[22744]: cluster 2024-09-16T07:20:08.002288+0000 mgr.a (mgr.14373) 4458 : cluster [DBG] pgmap v3092: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:20:09.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:20:09 smithi047 bash[22744]: audit 2024-09-16T07:20:08.378404+0000 mgr.a (mgr.14373) 4459 : audit [DBG] from='client.106425 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:20:11.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:20:11 smithi157 bash[24585]: cluster 2024-09-16T07:20:10.003167+0000 mgr.a (mgr.14373) 4460 : cluster [DBG] pgmap v3093: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:20:11.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:20:11 smithi086 bash[24289]: cluster 2024-09-16T07:20:10.003167+0000 mgr.a (mgr.14373) 4460 : cluster [DBG] pgmap v3093: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:20:11.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:20:11 smithi047 bash[22744]: cluster 2024-09-16T07:20:10.003167+0000 mgr.a (mgr.14373) 4460 : cluster [DBG] pgmap v3093: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:20:13.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:20:13 smithi157 bash[24585]: cluster 2024-09-16T07:20:12.005313+0000 mgr.a (mgr.14373) 4461 : cluster [DBG] pgmap v3094: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:20:13.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:20:13 smithi157 bash[24585]: audit 2024-09-16T07:20:12.515904+0000 mon.b (mon.2) 442 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T07:20:13.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:20:13 smithi086 bash[24289]: cluster 2024-09-16T07:20:12.005313+0000 mgr.a (mgr.14373) 4461 : cluster [DBG] pgmap v3094: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:20:13.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:20:13 smithi086 bash[24289]: audit 2024-09-16T07:20:12.515904+0000 mon.b (mon.2) 442 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T07:20:13.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:20:13 smithi047 bash[22744]: cluster 2024-09-16T07:20:12.005313+0000 mgr.a (mgr.14373) 4461 : cluster [DBG] pgmap v3094: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:20:13.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:20:13 smithi047 bash[22744]: audit 2024-09-16T07:20:12.515904+0000 mon.b (mon.2) 442 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T07:20:13.794 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:20:13.794 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:20:13.794 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:20:14.338 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 07:20:14 smithi047 bash[22994]: debug 2024-09-16T07:20:14.058+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T07:20:14.338 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 07:20:14 smithi047 bash[22994]: debug 2024-09-16T07:20:14.062+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T07:20:14.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:20:14 smithi047 bash[22744]: audit 2024-09-16T07:20:13.340756+0000 mon.b (mon.2) 443 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T07:20:14.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:20:14 smithi047 bash[22744]: audit 2024-09-16T07:20:13.342785+0000 mon.b (mon.2) 444 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T07:20:14.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:20:14 smithi047 bash[22744]: audit 2024-09-16T07:20:13.355914+0000 mon.a (mon.0) 837 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:20:14.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:20:14 smithi047 bash[22744]: audit 2024-09-16T07:20:13.359254+0000 mon.b (mon.2) 445 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:20:14.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:20:14 smithi047 bash[22744]: audit 2024-09-16T07:20:13.362545+0000 mgr.a (mgr.14373) 4462 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:20:14.542 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:20:14.543 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:20:14.543 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:20:14.543 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:20:14.543 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:20:14.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:20:14 smithi157 bash[24585]: audit 2024-09-16T07:20:13.340756+0000 mon.b (mon.2) 443 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T07:20:14.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:20:14 smithi157 bash[24585]: audit 2024-09-16T07:20:13.342785+0000 mon.b (mon.2) 444 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T07:20:14.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:20:14 smithi157 bash[24585]: audit 2024-09-16T07:20:13.355914+0000 mon.a (mon.0) 837 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:20:14.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:20:14 smithi157 bash[24585]: audit 2024-09-16T07:20:13.359254+0000 mon.b (mon.2) 445 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:20:14.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:20:14 smithi157 bash[24585]: audit 2024-09-16T07:20:13.362545+0000 mgr.a (mgr.14373) 4462 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:20:14.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:20:14 smithi086 bash[24289]: audit 2024-09-16T07:20:13.340756+0000 mon.b (mon.2) 443 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T07:20:14.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:20:14 smithi086 bash[24289]: audit 2024-09-16T07:20:13.342785+0000 mon.b (mon.2) 444 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T07:20:14.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:20:14 smithi086 bash[24289]: audit 2024-09-16T07:20:13.355914+0000 mon.a (mon.0) 837 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:20:14.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:20:14 smithi086 bash[24289]: audit 2024-09-16T07:20:13.359254+0000 mon.b (mon.2) 445 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:20:14.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:20:14 smithi086 bash[24289]: audit 2024-09-16T07:20:13.362545+0000 mgr.a (mgr.14373) 4462 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:20:15.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:20:15 smithi157 bash[24585]: cluster 2024-09-16T07:20:14.005875+0000 mgr.a (mgr.14373) 4463 : cluster [DBG] pgmap v3095: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:20:15.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:20:15 smithi157 bash[24585]: audit 2024-09-16T07:20:14.065196+0000 mgr.a (mgr.14373) 4464 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T07:20:15.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:20:15 smithi157 bash[24585]: cephadm 2024-09-16T07:20:14.067362+0000 mgr.a (mgr.14373) 4465 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T07:20:15.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:20:15 smithi157 bash[24585]: audit 2024-09-16T07:20:14.134906+0000 mgr.a (mgr.14373) 4466 : audit [DBG] from='client.106593 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:20:15.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:20:15 smithi086 bash[24289]: cluster 2024-09-16T07:20:14.005875+0000 mgr.a (mgr.14373) 4463 : cluster [DBG] pgmap v3095: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:20:15.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:20:15 smithi086 bash[24289]: audit 2024-09-16T07:20:14.065196+0000 mgr.a (mgr.14373) 4464 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T07:20:15.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:20:15 smithi086 bash[24289]: cephadm 2024-09-16T07:20:14.067362+0000 mgr.a (mgr.14373) 4465 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T07:20:15.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:20:15 smithi086 bash[24289]: audit 2024-09-16T07:20:14.134906+0000 mgr.a (mgr.14373) 4466 : audit [DBG] from='client.106593 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:20:15.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:20:15 smithi047 bash[22744]: cluster 2024-09-16T07:20:14.005875+0000 mgr.a (mgr.14373) 4463 : cluster [DBG] pgmap v3095: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:20:15.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:20:15 smithi047 bash[22744]: audit 2024-09-16T07:20:14.065196+0000 mgr.a (mgr.14373) 4464 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T07:20:15.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:20:15 smithi047 bash[22744]: cephadm 2024-09-16T07:20:14.067362+0000 mgr.a (mgr.14373) 4465 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T07:20:15.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:20:15 smithi047 bash[22744]: audit 2024-09-16T07:20:14.134906+0000 mgr.a (mgr.14373) 4466 : audit [DBG] from='client.106593 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:20:17.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:20:17 smithi157 bash[24585]: cluster 2024-09-16T07:20:16.006898+0000 mgr.a (mgr.14373) 4467 : cluster [DBG] pgmap v3096: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:20:17.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:20:17 smithi086 bash[24289]: cluster 2024-09-16T07:20:16.006898+0000 mgr.a (mgr.14373) 4467 : cluster [DBG] pgmap v3096: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:20:17.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:20:17 smithi047 bash[22744]: cluster 2024-09-16T07:20:16.006898+0000 mgr.a (mgr.14373) 4467 : cluster [DBG] pgmap v3096: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:20:19.544 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:20:19.545 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:20:19.545 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:20:19.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:20:19 smithi157 bash[24585]: cluster 2024-09-16T07:20:18.009260+0000 mgr.a (mgr.14373) 4468 : cluster [DBG] pgmap v3097: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:20:19.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:20:19 smithi086 bash[24289]: cluster 2024-09-16T07:20:18.009260+0000 mgr.a (mgr.14373) 4468 : cluster [DBG] pgmap v3097: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:20:19.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:20:19 smithi047 bash[22744]: cluster 2024-09-16T07:20:18.009260+0000 mgr.a (mgr.14373) 4468 : cluster [DBG] pgmap v3097: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:20:20.318 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:20:20.318 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:20:20.318 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:20:20.318 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:20:20.318 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:20:21.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:20:21 smithi157 bash[24585]: audit 2024-09-16T07:20:19.883330+0000 mgr.a (mgr.14373) 4469 : audit [DBG] from='client.106686 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:20:21.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:20:21 smithi157 bash[24585]: cluster 2024-09-16T07:20:20.009947+0000 mgr.a (mgr.14373) 4470 : cluster [DBG] pgmap v3098: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:20:21.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:20:21 smithi086 bash[24289]: audit 2024-09-16T07:20:19.883330+0000 mgr.a (mgr.14373) 4469 : audit [DBG] from='client.106686 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:20:21.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:20:21 smithi086 bash[24289]: cluster 2024-09-16T07:20:20.009947+0000 mgr.a (mgr.14373) 4470 : cluster [DBG] pgmap v3098: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:20:21.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:20:21 smithi047 bash[22744]: audit 2024-09-16T07:20:19.883330+0000 mgr.a (mgr.14373) 4469 : audit [DBG] from='client.106686 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:20:21.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:20:21 smithi047 bash[22744]: cluster 2024-09-16T07:20:20.009947+0000 mgr.a (mgr.14373) 4470 : cluster [DBG] pgmap v3098: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:20:23.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:20:23 smithi157 bash[24585]: cluster 2024-09-16T07:20:22.012195+0000 mgr.a (mgr.14373) 4471 : cluster [DBG] pgmap v3099: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:20:23.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:20:23 smithi086 bash[24289]: cluster 2024-09-16T07:20:22.012195+0000 mgr.a (mgr.14373) 4471 : cluster [DBG] pgmap v3099: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:20:23.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:20:23 smithi047 bash[22744]: cluster 2024-09-16T07:20:22.012195+0000 mgr.a (mgr.14373) 4471 : cluster [DBG] pgmap v3099: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:20:25.319 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:20:25.320 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:20:25.320 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:20:25.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:20:25 smithi157 bash[24585]: cluster 2024-09-16T07:20:24.013135+0000 mgr.a (mgr.14373) 4472 : cluster [DBG] pgmap v3100: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:20:25.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:20:25 smithi086 bash[24289]: cluster 2024-09-16T07:20:24.013135+0000 mgr.a (mgr.14373) 4472 : cluster [DBG] pgmap v3100: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:20:25.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:20:25 smithi047 bash[22744]: cluster 2024-09-16T07:20:24.013135+0000 mgr.a (mgr.14373) 4472 : cluster [DBG] pgmap v3100: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:20:26.063 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:20:26.063 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:20:26.063 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:20:26.063 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:20:26.063 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:20:26.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:20:26 smithi157 bash[24585]: audit 2024-09-16T07:20:25.652450+0000 mgr.a (mgr.14373) 4473 : audit [DBG] from='client.106761 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:20:26.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:20:26 smithi086 bash[24289]: audit 2024-09-16T07:20:25.652450+0000 mgr.a (mgr.14373) 4473 : audit [DBG] from='client.106761 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:20:26.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:20:26 smithi047 bash[22744]: audit 2024-09-16T07:20:25.652450+0000 mgr.a (mgr.14373) 4473 : audit [DBG] from='client.106761 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:20:27.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:20:27 smithi157 bash[24585]: cluster 2024-09-16T07:20:26.013750+0000 mgr.a (mgr.14373) 4474 : cluster [DBG] pgmap v3101: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:20:27.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:20:27 smithi086 bash[24289]: cluster 2024-09-16T07:20:26.013750+0000 mgr.a (mgr.14373) 4474 : cluster [DBG] pgmap v3101: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:20:27.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:20:27 smithi047 bash[22744]: cluster 2024-09-16T07:20:26.013750+0000 mgr.a (mgr.14373) 4474 : cluster [DBG] pgmap v3101: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:20:29.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:20:29 smithi157 bash[24585]: cluster 2024-09-16T07:20:28.015981+0000 mgr.a (mgr.14373) 4475 : cluster [DBG] pgmap v3102: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:20:29.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:20:29 smithi086 bash[24289]: cluster 2024-09-16T07:20:28.015981+0000 mgr.a (mgr.14373) 4475 : cluster [DBG] pgmap v3102: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:20:29.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:20:29 smithi047 bash[22744]: cluster 2024-09-16T07:20:28.015981+0000 mgr.a (mgr.14373) 4475 : cluster [DBG] pgmap v3102: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:20:31.065 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:20:31.065 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:20:31.066 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:20:31.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:20:31 smithi157 bash[24585]: cluster 2024-09-16T07:20:30.016722+0000 mgr.a (mgr.14373) 4476 : cluster [DBG] pgmap v3103: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:20:31.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:20:31 smithi086 bash[24289]: cluster 2024-09-16T07:20:30.016722+0000 mgr.a (mgr.14373) 4476 : cluster [DBG] pgmap v3103: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:20:31.829 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:20:31.829 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:20:31.829 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:20:31.829 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:20:31.830 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:20:31.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:20:31 smithi047 bash[22744]: cluster 2024-09-16T07:20:30.016722+0000 mgr.a (mgr.14373) 4476 : cluster [DBG] pgmap v3103: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:20:32.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:20:32 smithi157 bash[24585]: audit 2024-09-16T07:20:31.404459+0000 mgr.a (mgr.14373) 4477 : audit [DBG] from='client.106839 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:20:32.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:20:32 smithi086 bash[24289]: audit 2024-09-16T07:20:31.404459+0000 mgr.a (mgr.14373) 4477 : audit [DBG] from='client.106839 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:20:32.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:20:32 smithi047 bash[22744]: audit 2024-09-16T07:20:31.404459+0000 mgr.a (mgr.14373) 4477 : audit [DBG] from='client.106839 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:20:33.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:20:33 smithi157 bash[24585]: cluster 2024-09-16T07:20:32.019357+0000 mgr.a (mgr.14373) 4478 : cluster [DBG] pgmap v3104: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:20:33.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:20:33 smithi086 bash[24289]: cluster 2024-09-16T07:20:32.019357+0000 mgr.a (mgr.14373) 4478 : cluster [DBG] pgmap v3104: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:20:33.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:20:33 smithi047 bash[22744]: cluster 2024-09-16T07:20:32.019357+0000 mgr.a (mgr.14373) 4478 : cluster [DBG] pgmap v3104: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:20:35.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:20:35 smithi157 bash[24585]: cluster 2024-09-16T07:20:34.020140+0000 mgr.a (mgr.14373) 4479 : cluster [DBG] pgmap v3105: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:20:35.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:20:35 smithi086 bash[24289]: cluster 2024-09-16T07:20:34.020140+0000 mgr.a (mgr.14373) 4479 : cluster [DBG] pgmap v3105: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:20:35.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:20:35 smithi047 bash[22744]: cluster 2024-09-16T07:20:34.020140+0000 mgr.a (mgr.14373) 4479 : cluster [DBG] pgmap v3105: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:20:36.831 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:20:36.832 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:20:36.832 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:20:37.573 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:20:37.573 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:20:37.573 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:20:37.573 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:20:37.573 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:20:37.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:20:37 smithi157 bash[24585]: cluster 2024-09-16T07:20:36.020853+0000 mgr.a (mgr.14373) 4480 : cluster [DBG] pgmap v3106: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T07:20:37.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:20:37 smithi086 bash[24289]: cluster 2024-09-16T07:20:36.020853+0000 mgr.a (mgr.14373) 4480 : cluster [DBG] pgmap v3106: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T07:20:37.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:20:37 smithi047 bash[22744]: cluster 2024-09-16T07:20:36.020853+0000 mgr.a (mgr.14373) 4480 : cluster [DBG] pgmap v3106: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T07:20:38.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:20:38 smithi157 bash[24585]: audit 2024-09-16T07:20:37.166773+0000 mgr.a (mgr.14373) 4481 : audit [DBG] from='client.106917 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:20:38.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:20:38 smithi086 bash[24289]: audit 2024-09-16T07:20:37.166773+0000 mgr.a (mgr.14373) 4481 : audit [DBG] from='client.106917 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:20:38.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:20:38 smithi047 bash[22744]: audit 2024-09-16T07:20:37.166773+0000 mgr.a (mgr.14373) 4481 : audit [DBG] from='client.106917 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:20:39.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:20:39 smithi157 bash[24585]: cluster 2024-09-16T07:20:38.023564+0000 mgr.a (mgr.14373) 4482 : cluster [DBG] pgmap v3107: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:20:39.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:20:39 smithi086 bash[24289]: cluster 2024-09-16T07:20:38.023564+0000 mgr.a (mgr.14373) 4482 : cluster [DBG] pgmap v3107: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:20:39.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:20:39 smithi047 bash[22744]: cluster 2024-09-16T07:20:38.023564+0000 mgr.a (mgr.14373) 4482 : cluster [DBG] pgmap v3107: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:20:41.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:20:41 smithi157 bash[24585]: cluster 2024-09-16T07:20:40.024345+0000 mgr.a (mgr.14373) 4483 : cluster [DBG] pgmap v3108: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:20:41.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:20:41 smithi086 bash[24289]: cluster 2024-09-16T07:20:40.024345+0000 mgr.a (mgr.14373) 4483 : cluster [DBG] pgmap v3108: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:20:41.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:20:41 smithi047 bash[22744]: cluster 2024-09-16T07:20:40.024345+0000 mgr.a (mgr.14373) 4483 : cluster [DBG] pgmap v3108: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:20:42.574 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:20:42.575 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:20:42.575 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:20:43.356 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:20:43.356 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:20:43.356 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:20:43.356 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:20:43.356 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:20:43.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:20:43 smithi157 bash[24585]: cluster 2024-09-16T07:20:42.026314+0000 mgr.a (mgr.14373) 4484 : cluster [DBG] pgmap v3109: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:20:43.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:20:43 smithi086 bash[24289]: cluster 2024-09-16T07:20:42.026314+0000 mgr.a (mgr.14373) 4484 : cluster [DBG] pgmap v3109: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:20:43.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:20:43 smithi047 bash[22744]: cluster 2024-09-16T07:20:42.026314+0000 mgr.a (mgr.14373) 4484 : cluster [DBG] pgmap v3109: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:20:44.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:20:44 smithi157 bash[24585]: audit 2024-09-16T07:20:42.909564+0000 mgr.a (mgr.14373) 4485 : audit [DBG] from='client.106989 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:20:44.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:20:44 smithi086 bash[24289]: audit 2024-09-16T07:20:42.909564+0000 mgr.a (mgr.14373) 4485 : audit [DBG] from='client.106989 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:20:44.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:20:44 smithi047 bash[22744]: audit 2024-09-16T07:20:42.909564+0000 mgr.a (mgr.14373) 4485 : audit [DBG] from='client.106989 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:20:45.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:20:45 smithi157 bash[24585]: cluster 2024-09-16T07:20:44.027318+0000 mgr.a (mgr.14373) 4486 : cluster [DBG] pgmap v3110: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:20:45.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:20:45 smithi086 bash[24289]: cluster 2024-09-16T07:20:44.027318+0000 mgr.a (mgr.14373) 4486 : cluster [DBG] pgmap v3110: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:20:45.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:20:45 smithi047 bash[22744]: cluster 2024-09-16T07:20:44.027318+0000 mgr.a (mgr.14373) 4486 : cluster [DBG] pgmap v3110: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:20:47.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:20:47 smithi157 bash[24585]: cluster 2024-09-16T07:20:46.028299+0000 mgr.a (mgr.14373) 4487 : cluster [DBG] pgmap v3111: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:20:47.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:20:47 smithi086 bash[24289]: cluster 2024-09-16T07:20:46.028299+0000 mgr.a (mgr.14373) 4487 : cluster [DBG] pgmap v3111: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:20:47.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:20:47 smithi047 bash[22744]: cluster 2024-09-16T07:20:46.028299+0000 mgr.a (mgr.14373) 4487 : cluster [DBG] pgmap v3111: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:20:48.357 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:20:48.358 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:20:48.358 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:20:49.134 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:20:49.134 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:20:49.135 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:20:49.135 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:20:49.135 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:20:49.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:20:49 smithi157 bash[24585]: cluster 2024-09-16T07:20:48.030699+0000 mgr.a (mgr.14373) 4488 : cluster [DBG] pgmap v3112: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:20:49.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:20:49 smithi157 bash[24585]: audit 2024-09-16T07:20:48.694072+0000 mgr.a (mgr.14373) 4489 : audit [DBG] from='client.107067 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:20:49.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:20:49 smithi086 bash[24289]: cluster 2024-09-16T07:20:48.030699+0000 mgr.a (mgr.14373) 4488 : cluster [DBG] pgmap v3112: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:20:49.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:20:49 smithi086 bash[24289]: audit 2024-09-16T07:20:48.694072+0000 mgr.a (mgr.14373) 4489 : audit [DBG] from='client.107067 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:20:49.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:20:49 smithi047 bash[22744]: cluster 2024-09-16T07:20:48.030699+0000 mgr.a (mgr.14373) 4488 : cluster [DBG] pgmap v3112: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:20:49.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:20:49 smithi047 bash[22744]: audit 2024-09-16T07:20:48.694072+0000 mgr.a (mgr.14373) 4489 : audit [DBG] from='client.107067 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:20:51.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:20:51 smithi157 bash[24585]: cluster 2024-09-16T07:20:50.031841+0000 mgr.a (mgr.14373) 4490 : cluster [DBG] pgmap v3113: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:20:51.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:20:51 smithi086 bash[24289]: cluster 2024-09-16T07:20:50.031841+0000 mgr.a (mgr.14373) 4490 : cluster [DBG] pgmap v3113: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:20:51.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:20:51 smithi047 bash[22744]: cluster 2024-09-16T07:20:50.031841+0000 mgr.a (mgr.14373) 4490 : cluster [DBG] pgmap v3113: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:20:54.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:20:53 smithi157 bash[24585]: cluster 2024-09-16T07:20:52.034170+0000 mgr.a (mgr.14373) 4491 : cluster [DBG] pgmap v3114: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:20:54.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:20:53 smithi086 bash[24289]: cluster 2024-09-16T07:20:52.034170+0000 mgr.a (mgr.14373) 4491 : cluster [DBG] pgmap v3114: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:20:54.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:20:53 smithi047 bash[22744]: cluster 2024-09-16T07:20:52.034170+0000 mgr.a (mgr.14373) 4491 : cluster [DBG] pgmap v3114: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:20:54.136 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:20:54.136 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:20:54.136 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:20:54.916 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:20:54.917 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:20:54.917 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:20:54.917 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:20:54.917 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:20:56.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:20:55 smithi157 bash[24585]: cluster 2024-09-16T07:20:54.035094+0000 mgr.a (mgr.14373) 4492 : cluster [DBG] pgmap v3115: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:20:56.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:20:55 smithi157 bash[24585]: audit 2024-09-16T07:20:54.471414+0000 mgr.a (mgr.14373) 4493 : audit [DBG] from='client.107145 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:20:56.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:20:55 smithi086 bash[24289]: cluster 2024-09-16T07:20:54.035094+0000 mgr.a (mgr.14373) 4492 : cluster [DBG] pgmap v3115: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:20:56.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:20:55 smithi086 bash[24289]: audit 2024-09-16T07:20:54.471414+0000 mgr.a (mgr.14373) 4493 : audit [DBG] from='client.107145 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:20:56.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:20:55 smithi047 bash[22744]: cluster 2024-09-16T07:20:54.035094+0000 mgr.a (mgr.14373) 4492 : cluster [DBG] pgmap v3115: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:20:56.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:20:55 smithi047 bash[22744]: audit 2024-09-16T07:20:54.471414+0000 mgr.a (mgr.14373) 4493 : audit [DBG] from='client.107145 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:20:58.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:20:57 smithi157 bash[24585]: cluster 2024-09-16T07:20:56.036067+0000 mgr.a (mgr.14373) 4494 : cluster [DBG] pgmap v3116: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:20:58.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:20:57 smithi086 bash[24289]: cluster 2024-09-16T07:20:56.036067+0000 mgr.a (mgr.14373) 4494 : cluster [DBG] pgmap v3116: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:20:58.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:20:57 smithi047 bash[22744]: cluster 2024-09-16T07:20:56.036067+0000 mgr.a (mgr.14373) 4494 : cluster [DBG] pgmap v3116: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:20:59.918 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:20:59.918 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:20:59.919 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:21:00.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:20:59 smithi157 bash[24585]: cluster 2024-09-16T07:20:58.038438+0000 mgr.a (mgr.14373) 4495 : cluster [DBG] pgmap v3117: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:21:00.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:20:59 smithi086 bash[24289]: cluster 2024-09-16T07:20:58.038438+0000 mgr.a (mgr.14373) 4495 : cluster [DBG] pgmap v3117: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:21:00.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:20:59 smithi047 bash[22744]: cluster 2024-09-16T07:20:58.038438+0000 mgr.a (mgr.14373) 4495 : cluster [DBG] pgmap v3117: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:21:00.700 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:21:00.701 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:21:00.701 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:21:00.701 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:21:00.701 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:21:02.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:21:01 smithi157 bash[24585]: cluster 2024-09-16T07:21:00.038947+0000 mgr.a (mgr.14373) 4496 : cluster [DBG] pgmap v3118: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:21:02.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:21:01 smithi157 bash[24585]: audit 2024-09-16T07:21:00.264547+0000 mgr.a (mgr.14373) 4497 : audit [DBG] from='client.107223 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:21:02.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:21:01 smithi086 bash[24289]: cluster 2024-09-16T07:21:00.038947+0000 mgr.a (mgr.14373) 4496 : cluster [DBG] pgmap v3118: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:21:02.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:21:01 smithi086 bash[24289]: audit 2024-09-16T07:21:00.264547+0000 mgr.a (mgr.14373) 4497 : audit [DBG] from='client.107223 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:21:02.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:21:01 smithi047 bash[22744]: cluster 2024-09-16T07:21:00.038947+0000 mgr.a (mgr.14373) 4496 : cluster [DBG] pgmap v3118: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:21:02.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:21:01 smithi047 bash[22744]: audit 2024-09-16T07:21:00.264547+0000 mgr.a (mgr.14373) 4497 : audit [DBG] from='client.107223 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:21:04.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:21:03 smithi157 bash[24585]: cluster 2024-09-16T07:21:02.041338+0000 mgr.a (mgr.14373) 4498 : cluster [DBG] pgmap v3119: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:21:04.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:21:03 smithi086 bash[24289]: cluster 2024-09-16T07:21:02.041338+0000 mgr.a (mgr.14373) 4498 : cluster [DBG] pgmap v3119: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:21:04.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:21:03 smithi047 bash[22744]: cluster 2024-09-16T07:21:02.041338+0000 mgr.a (mgr.14373) 4498 : cluster [DBG] pgmap v3119: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:21:05.702 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:21:05.703 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:21:05.703 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:21:06.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:21:05 smithi157 bash[24585]: cluster 2024-09-16T07:21:04.042136+0000 mgr.a (mgr.14373) 4499 : cluster [DBG] pgmap v3120: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:21:06.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:21:05 smithi086 bash[24289]: cluster 2024-09-16T07:21:04.042136+0000 mgr.a (mgr.14373) 4499 : cluster [DBG] pgmap v3120: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:21:06.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:21:05 smithi047 bash[22744]: cluster 2024-09-16T07:21:04.042136+0000 mgr.a (mgr.14373) 4499 : cluster [DBG] pgmap v3120: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:21:06.470 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:21:06.470 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:21:06.470 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:21:06.470 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:21:06.470 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:21:08.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:21:07 smithi157 bash[24585]: audit 2024-09-16T07:21:06.041296+0000 mgr.a (mgr.14373) 4500 : audit [DBG] from='client.107298 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:21:08.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:21:07 smithi157 bash[24585]: cluster 2024-09-16T07:21:06.056368+0000 mgr.a (mgr.14373) 4501 : cluster [DBG] pgmap v3121: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:21:08.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:21:07 smithi086 bash[24289]: audit 2024-09-16T07:21:06.041296+0000 mgr.a (mgr.14373) 4500 : audit [DBG] from='client.107298 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:21:08.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:21:07 smithi086 bash[24289]: cluster 2024-09-16T07:21:06.056368+0000 mgr.a (mgr.14373) 4501 : cluster [DBG] pgmap v3121: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:21:08.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:21:07 smithi047 bash[22744]: audit 2024-09-16T07:21:06.041296+0000 mgr.a (mgr.14373) 4500 : audit [DBG] from='client.107298 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:21:08.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:21:07 smithi047 bash[22744]: cluster 2024-09-16T07:21:06.056368+0000 mgr.a (mgr.14373) 4501 : cluster [DBG] pgmap v3121: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:21:10.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:21:09 smithi157 bash[24585]: cluster 2024-09-16T07:21:08.058919+0000 mgr.a (mgr.14373) 4502 : cluster [DBG] pgmap v3122: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:21:10.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:21:09 smithi086 bash[24289]: cluster 2024-09-16T07:21:08.058919+0000 mgr.a (mgr.14373) 4502 : cluster [DBG] pgmap v3122: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:21:10.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:21:09 smithi047 bash[22744]: cluster 2024-09-16T07:21:08.058919+0000 mgr.a (mgr.14373) 4502 : cluster [DBG] pgmap v3122: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:21:11.471 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:21:11.472 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:21:11.472 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:21:12.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:21:11 smithi157 bash[24585]: cluster 2024-09-16T07:21:10.059691+0000 mgr.a (mgr.14373) 4503 : cluster [DBG] pgmap v3123: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:21:12.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:21:11 smithi086 bash[24289]: cluster 2024-09-16T07:21:10.059691+0000 mgr.a (mgr.14373) 4503 : cluster [DBG] pgmap v3123: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:21:12.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:21:11 smithi047 bash[22744]: cluster 2024-09-16T07:21:10.059691+0000 mgr.a (mgr.14373) 4503 : cluster [DBG] pgmap v3123: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:21:12.244 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:21:12.245 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:21:12.245 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:21:12.245 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:21:12.245 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:21:14.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:21:13 smithi157 bash[24585]: audit 2024-09-16T07:21:11.813624+0000 mgr.a (mgr.14373) 4504 : audit [DBG] from='client.107376 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:21:14.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:21:13 smithi157 bash[24585]: cluster 2024-09-16T07:21:12.061054+0000 mgr.a (mgr.14373) 4505 : cluster [DBG] pgmap v3124: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:21:14.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:21:13 smithi086 bash[24289]: audit 2024-09-16T07:21:11.813624+0000 mgr.a (mgr.14373) 4504 : audit [DBG] from='client.107376 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:21:14.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:21:13 smithi086 bash[24289]: cluster 2024-09-16T07:21:12.061054+0000 mgr.a (mgr.14373) 4505 : cluster [DBG] pgmap v3124: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:21:14.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:21:13 smithi047 bash[22744]: audit 2024-09-16T07:21:11.813624+0000 mgr.a (mgr.14373) 4504 : audit [DBG] from='client.107376 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:21:14.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:21:13 smithi047 bash[22744]: cluster 2024-09-16T07:21:12.061054+0000 mgr.a (mgr.14373) 4505 : cluster [DBG] pgmap v3124: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:21:15.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:21:14 smithi157 bash[24585]: audit 2024-09-16T07:21:14.113675+0000 mon.b (mon.2) 446 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T07:21:15.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:21:14 smithi086 bash[24289]: audit 2024-09-16T07:21:14.113675+0000 mon.b (mon.2) 446 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T07:21:15.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:21:14 smithi047 bash[22744]: audit 2024-09-16T07:21:14.113675+0000 mon.b (mon.2) 446 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T07:21:16.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:21:15 smithi157 bash[24585]: cluster 2024-09-16T07:21:14.061936+0000 mgr.a (mgr.14373) 4506 : cluster [DBG] pgmap v3125: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 936 B/s rd, 0 op/s 2024-09-16T07:21:16.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:21:15 smithi157 bash[24585]: audit 2024-09-16T07:21:14.955422+0000 mon.b (mon.2) 447 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T07:21:16.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:21:15 smithi157 bash[24585]: audit 2024-09-16T07:21:14.957560+0000 mon.b (mon.2) 448 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T07:21:16.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:21:15 smithi157 bash[24585]: audit 2024-09-16T07:21:14.970811+0000 mon.a (mon.0) 838 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:21:16.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:21:15 smithi157 bash[24585]: audit 2024-09-16T07:21:14.972855+0000 mon.b (mon.2) 449 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:21:16.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:21:15 smithi157 bash[24585]: audit 2024-09-16T07:21:14.977334+0000 mgr.a (mgr.14373) 4507 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:21:16.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:21:15 smithi157 bash[24585]: audit 2024-09-16T07:21:15.709430+0000 mgr.a (mgr.14373) 4508 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T07:21:16.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:21:15 smithi157 bash[24585]: cephadm 2024-09-16T07:21:15.711738+0000 mgr.a (mgr.14373) 4509 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T07:21:16.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:21:15 smithi086 bash[24289]: cluster 2024-09-16T07:21:14.061936+0000 mgr.a (mgr.14373) 4506 : cluster [DBG] pgmap v3125: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 936 B/s rd, 0 op/s 2024-09-16T07:21:16.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:21:15 smithi086 bash[24289]: audit 2024-09-16T07:21:14.955422+0000 mon.b (mon.2) 447 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T07:21:16.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:21:15 smithi086 bash[24289]: audit 2024-09-16T07:21:14.957560+0000 mon.b (mon.2) 448 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T07:21:16.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:21:15 smithi086 bash[24289]: audit 2024-09-16T07:21:14.970811+0000 mon.a (mon.0) 838 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:21:16.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:21:15 smithi086 bash[24289]: audit 2024-09-16T07:21:14.972855+0000 mon.b (mon.2) 449 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:21:16.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:21:15 smithi086 bash[24289]: audit 2024-09-16T07:21:14.977334+0000 mgr.a (mgr.14373) 4507 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:21:16.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:21:15 smithi086 bash[24289]: audit 2024-09-16T07:21:15.709430+0000 mgr.a (mgr.14373) 4508 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T07:21:16.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:21:15 smithi086 bash[24289]: cephadm 2024-09-16T07:21:15.711738+0000 mgr.a (mgr.14373) 4509 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T07:21:16.088 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 07:21:15 smithi047 bash[22994]: debug 2024-09-16T07:21:15.705+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T07:21:16.088 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 07:21:15 smithi047 bash[22994]: debug 2024-09-16T07:21:15.709+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T07:21:16.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:21:15 smithi047 bash[22744]: cluster 2024-09-16T07:21:14.061936+0000 mgr.a (mgr.14373) 4506 : cluster [DBG] pgmap v3125: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 936 B/s rd, 0 op/s 2024-09-16T07:21:16.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:21:15 smithi047 bash[22744]: audit 2024-09-16T07:21:14.955422+0000 mon.b (mon.2) 447 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T07:21:16.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:21:15 smithi047 bash[22744]: audit 2024-09-16T07:21:14.957560+0000 mon.b (mon.2) 448 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T07:21:16.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:21:15 smithi047 bash[22744]: audit 2024-09-16T07:21:14.970811+0000 mon.a (mon.0) 838 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:21:16.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:21:15 smithi047 bash[22744]: audit 2024-09-16T07:21:14.972855+0000 mon.b (mon.2) 449 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:21:16.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:21:15 smithi047 bash[22744]: audit 2024-09-16T07:21:14.977334+0000 mgr.a (mgr.14373) 4507 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:21:16.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:21:15 smithi047 bash[22744]: audit 2024-09-16T07:21:15.709430+0000 mgr.a (mgr.14373) 4508 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T07:21:16.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:21:15 smithi047 bash[22744]: cephadm 2024-09-16T07:21:15.711738+0000 mgr.a (mgr.14373) 4509 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T07:21:17.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:21:16 smithi157 bash[24585]: cluster 2024-09-16T07:21:16.062911+0000 mgr.a (mgr.14373) 4510 : cluster [DBG] pgmap v3126: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:21:17.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:21:16 smithi086 bash[24289]: cluster 2024-09-16T07:21:16.062911+0000 mgr.a (mgr.14373) 4510 : cluster [DBG] pgmap v3126: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:21:17.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:21:16 smithi047 bash[22744]: cluster 2024-09-16T07:21:16.062911+0000 mgr.a (mgr.14373) 4510 : cluster [DBG] pgmap v3126: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:21:17.246 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:21:17.246 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:21:17.247 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:21:17.997 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:21:17.997 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:21:17.997 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:21:17.997 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:21:17.997 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:21:18.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:21:17 smithi157 bash[24585]: audit 2024-09-16T07:21:17.578736+0000 mgr.a (mgr.14373) 4511 : audit [DBG] from='client.107559 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:21:18.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:21:17 smithi086 bash[24289]: audit 2024-09-16T07:21:17.578736+0000 mgr.a (mgr.14373) 4511 : audit [DBG] from='client.107559 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:21:18.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:21:17 smithi047 bash[22744]: audit 2024-09-16T07:21:17.578736+0000 mgr.a (mgr.14373) 4511 : audit [DBG] from='client.107559 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:21:19.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:21:18 smithi157 bash[24585]: cluster 2024-09-16T07:21:18.065681+0000 mgr.a (mgr.14373) 4512 : cluster [DBG] pgmap v3127: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:21:19.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:21:18 smithi086 bash[24289]: cluster 2024-09-16T07:21:18.065681+0000 mgr.a (mgr.14373) 4512 : cluster [DBG] pgmap v3127: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:21:19.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:21:18 smithi047 bash[22744]: cluster 2024-09-16T07:21:18.065681+0000 mgr.a (mgr.14373) 4512 : cluster [DBG] pgmap v3127: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:21:21.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:21:21 smithi157 bash[24585]: cluster 2024-09-16T07:21:20.066523+0000 mgr.a (mgr.14373) 4513 : cluster [DBG] pgmap v3128: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T07:21:21.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:21:21 smithi086 bash[24289]: cluster 2024-09-16T07:21:20.066523+0000 mgr.a (mgr.14373) 4513 : cluster [DBG] pgmap v3128: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T07:21:21.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:21:21 smithi047 bash[22744]: cluster 2024-09-16T07:21:20.066523+0000 mgr.a (mgr.14373) 4513 : cluster [DBG] pgmap v3128: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T07:21:22.999 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:21:22.999 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:21:23.000 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:21:23.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:21:23 smithi157 bash[24585]: cluster 2024-09-16T07:21:22.068467+0000 mgr.a (mgr.14373) 4514 : cluster [DBG] pgmap v3129: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:21:23.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:21:23 smithi086 bash[24289]: cluster 2024-09-16T07:21:22.068467+0000 mgr.a (mgr.14373) 4514 : cluster [DBG] pgmap v3129: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:21:23.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:21:23 smithi047 bash[22744]: cluster 2024-09-16T07:21:22.068467+0000 mgr.a (mgr.14373) 4514 : cluster [DBG] pgmap v3129: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:21:23.782 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:21:23.782 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:21:23.783 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:21:23.783 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:21:23.783 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:21:24.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:21:24 smithi157 bash[24585]: audit 2024-09-16T07:21:23.343500+0000 mgr.a (mgr.14373) 4515 : audit [DBG] from='client.107637 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:21:24.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:21:24 smithi086 bash[24289]: audit 2024-09-16T07:21:23.343500+0000 mgr.a (mgr.14373) 4515 : audit [DBG] from='client.107637 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:21:24.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:21:24 smithi047 bash[22744]: audit 2024-09-16T07:21:23.343500+0000 mgr.a (mgr.14373) 4515 : audit [DBG] from='client.107637 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:21:25.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:21:25 smithi157 bash[24585]: cluster 2024-09-16T07:21:24.069443+0000 mgr.a (mgr.14373) 4516 : cluster [DBG] pgmap v3130: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:21:25.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:21:25 smithi086 bash[24289]: cluster 2024-09-16T07:21:24.069443+0000 mgr.a (mgr.14373) 4516 : cluster [DBG] pgmap v3130: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:21:25.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:21:25 smithi047 bash[22744]: cluster 2024-09-16T07:21:24.069443+0000 mgr.a (mgr.14373) 4516 : cluster [DBG] pgmap v3130: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:21:27.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:21:27 smithi157 bash[24585]: cluster 2024-09-16T07:21:26.070397+0000 mgr.a (mgr.14373) 4517 : cluster [DBG] pgmap v3131: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:21:27.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:21:27 smithi086 bash[24289]: cluster 2024-09-16T07:21:26.070397+0000 mgr.a (mgr.14373) 4517 : cluster [DBG] pgmap v3131: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:21:27.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:21:27 smithi047 bash[22744]: cluster 2024-09-16T07:21:26.070397+0000 mgr.a (mgr.14373) 4517 : cluster [DBG] pgmap v3131: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:21:28.784 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:21:28.785 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:21:28.785 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:21:29.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:21:29 smithi157 bash[24585]: cluster 2024-09-16T07:21:28.072636+0000 mgr.a (mgr.14373) 4518 : cluster [DBG] pgmap v3132: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:21:29.554 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:21:29.554 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:21:29.555 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:21:29.555 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:21:29.555 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:21:29.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:21:29 smithi086 bash[24289]: cluster 2024-09-16T07:21:28.072636+0000 mgr.a (mgr.14373) 4518 : cluster [DBG] pgmap v3132: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:21:29.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:21:29 smithi047 bash[22744]: cluster 2024-09-16T07:21:28.072636+0000 mgr.a (mgr.14373) 4518 : cluster [DBG] pgmap v3132: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:21:30.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:21:30 smithi157 bash[24585]: audit 2024-09-16T07:21:29.120773+0000 mgr.a (mgr.14373) 4519 : audit [DBG] from='client.107715 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:21:30.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:21:30 smithi086 bash[24289]: audit 2024-09-16T07:21:29.120773+0000 mgr.a (mgr.14373) 4519 : audit [DBG] from='client.107715 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:21:30.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:21:30 smithi047 bash[22744]: audit 2024-09-16T07:21:29.120773+0000 mgr.a (mgr.14373) 4519 : audit [DBG] from='client.107715 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:21:31.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:21:31 smithi157 bash[24585]: cluster 2024-09-16T07:21:30.073651+0000 mgr.a (mgr.14373) 4520 : cluster [DBG] pgmap v3133: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:21:31.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:21:31 smithi086 bash[24289]: cluster 2024-09-16T07:21:30.073651+0000 mgr.a (mgr.14373) 4520 : cluster [DBG] pgmap v3133: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:21:31.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:21:31 smithi047 bash[22744]: cluster 2024-09-16T07:21:30.073651+0000 mgr.a (mgr.14373) 4520 : cluster [DBG] pgmap v3133: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:21:33.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:21:33 smithi157 bash[24585]: cluster 2024-09-16T07:21:32.075849+0000 mgr.a (mgr.14373) 4521 : cluster [DBG] pgmap v3134: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:21:33.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:21:33 smithi086 bash[24289]: cluster 2024-09-16T07:21:32.075849+0000 mgr.a (mgr.14373) 4521 : cluster [DBG] pgmap v3134: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:21:33.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:21:33 smithi047 bash[22744]: cluster 2024-09-16T07:21:32.075849+0000 mgr.a (mgr.14373) 4521 : cluster [DBG] pgmap v3134: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:21:34.556 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:21:34.557 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:21:34.557 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:21:35.303 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:21:35.303 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:21:35.303 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:21:35.303 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:21:35.304 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:21:35.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:21:35 smithi157 bash[24585]: cluster 2024-09-16T07:21:34.076584+0000 mgr.a (mgr.14373) 4522 : cluster [DBG] pgmap v3135: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:21:35.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:21:35 smithi086 bash[24289]: cluster 2024-09-16T07:21:34.076584+0000 mgr.a (mgr.14373) 4522 : cluster [DBG] pgmap v3135: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:21:35.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:21:35 smithi047 bash[22744]: cluster 2024-09-16T07:21:34.076584+0000 mgr.a (mgr.14373) 4522 : cluster [DBG] pgmap v3135: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:21:36.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:21:36 smithi157 bash[24585]: audit 2024-09-16T07:21:34.888163+0000 mgr.a (mgr.14373) 4523 : audit [DBG] from='client.107790 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:21:36.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:21:36 smithi086 bash[24289]: audit 2024-09-16T07:21:34.888163+0000 mgr.a (mgr.14373) 4523 : audit [DBG] from='client.107790 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:21:36.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:21:36 smithi047 bash[22744]: audit 2024-09-16T07:21:34.888163+0000 mgr.a (mgr.14373) 4523 : audit [DBG] from='client.107790 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:21:37.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:21:37 smithi157 bash[24585]: cluster 2024-09-16T07:21:36.077539+0000 mgr.a (mgr.14373) 4524 : cluster [DBG] pgmap v3136: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:21:37.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:21:37 smithi086 bash[24289]: cluster 2024-09-16T07:21:36.077539+0000 mgr.a (mgr.14373) 4524 : cluster [DBG] pgmap v3136: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:21:37.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:21:37 smithi047 bash[22744]: cluster 2024-09-16T07:21:36.077539+0000 mgr.a (mgr.14373) 4524 : cluster [DBG] pgmap v3136: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:21:39.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:21:39 smithi157 bash[24585]: cluster 2024-09-16T07:21:38.079738+0000 mgr.a (mgr.14373) 4525 : cluster [DBG] pgmap v3137: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:21:39.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:21:39 smithi086 bash[24289]: cluster 2024-09-16T07:21:38.079738+0000 mgr.a (mgr.14373) 4525 : cluster [DBG] pgmap v3137: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:21:39.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:21:39 smithi047 bash[22744]: cluster 2024-09-16T07:21:38.079738+0000 mgr.a (mgr.14373) 4525 : cluster [DBG] pgmap v3137: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:21:40.304 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:21:40.305 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:21:40.305 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:21:41.074 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:21:41.074 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:21:41.074 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:21:41.074 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:21:41.075 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:21:41.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:21:41 smithi157 bash[24585]: cluster 2024-09-16T07:21:40.080525+0000 mgr.a (mgr.14373) 4526 : cluster [DBG] pgmap v3138: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:21:41.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:21:41 smithi157 bash[24585]: audit 2024-09-16T07:21:40.645399+0000 mgr.a (mgr.14373) 4527 : audit [DBG] from='client.107868 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:21:41.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:21:41 smithi086 bash[24289]: cluster 2024-09-16T07:21:40.080525+0000 mgr.a (mgr.14373) 4526 : cluster [DBG] pgmap v3138: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:21:41.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:21:41 smithi086 bash[24289]: audit 2024-09-16T07:21:40.645399+0000 mgr.a (mgr.14373) 4527 : audit [DBG] from='client.107868 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:21:41.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:21:41 smithi047 bash[22744]: cluster 2024-09-16T07:21:40.080525+0000 mgr.a (mgr.14373) 4526 : cluster [DBG] pgmap v3138: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:21:41.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:21:41 smithi047 bash[22744]: audit 2024-09-16T07:21:40.645399+0000 mgr.a (mgr.14373) 4527 : audit [DBG] from='client.107868 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:21:43.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:21:43 smithi157 bash[24585]: cluster 2024-09-16T07:21:42.082897+0000 mgr.a (mgr.14373) 4528 : cluster [DBG] pgmap v3139: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:21:43.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:21:43 smithi086 bash[24289]: cluster 2024-09-16T07:21:42.082897+0000 mgr.a (mgr.14373) 4528 : cluster [DBG] pgmap v3139: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:21:43.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:21:43 smithi047 bash[22744]: cluster 2024-09-16T07:21:42.082897+0000 mgr.a (mgr.14373) 4528 : cluster [DBG] pgmap v3139: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:21:45.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:21:45 smithi157 bash[24585]: cluster 2024-09-16T07:21:44.083680+0000 mgr.a (mgr.14373) 4529 : cluster [DBG] pgmap v3140: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:21:45.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:21:45 smithi086 bash[24289]: cluster 2024-09-16T07:21:44.083680+0000 mgr.a (mgr.14373) 4529 : cluster [DBG] pgmap v3140: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:21:45.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:21:45 smithi047 bash[22744]: cluster 2024-09-16T07:21:44.083680+0000 mgr.a (mgr.14373) 4529 : cluster [DBG] pgmap v3140: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:21:46.076 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:21:46.077 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:21:46.077 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:21:46.852 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:21:46.852 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:21:46.852 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:21:46.852 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:21:46.852 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:21:47.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:21:47 smithi157 bash[24585]: cluster 2024-09-16T07:21:46.084243+0000 mgr.a (mgr.14373) 4530 : cluster [DBG] pgmap v3141: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:21:47.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:21:47 smithi157 bash[24585]: audit 2024-09-16T07:21:46.412904+0000 mgr.a (mgr.14373) 4531 : audit [DBG] from='client.107943 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:21:47.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:21:47 smithi086 bash[24289]: cluster 2024-09-16T07:21:46.084243+0000 mgr.a (mgr.14373) 4530 : cluster [DBG] pgmap v3141: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:21:47.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:21:47 smithi086 bash[24289]: audit 2024-09-16T07:21:46.412904+0000 mgr.a (mgr.14373) 4531 : audit [DBG] from='client.107943 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:21:47.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:21:47 smithi047 bash[22744]: cluster 2024-09-16T07:21:46.084243+0000 mgr.a (mgr.14373) 4530 : cluster [DBG] pgmap v3141: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:21:47.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:21:47 smithi047 bash[22744]: audit 2024-09-16T07:21:46.412904+0000 mgr.a (mgr.14373) 4531 : audit [DBG] from='client.107943 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:21:49.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:21:49 smithi157 bash[24585]: cluster 2024-09-16T07:21:48.087057+0000 mgr.a (mgr.14373) 4532 : cluster [DBG] pgmap v3142: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:21:49.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:21:49 smithi086 bash[24289]: cluster 2024-09-16T07:21:48.087057+0000 mgr.a (mgr.14373) 4532 : cluster [DBG] pgmap v3142: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:21:49.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:21:49 smithi047 bash[22744]: cluster 2024-09-16T07:21:48.087057+0000 mgr.a (mgr.14373) 4532 : cluster [DBG] pgmap v3142: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:21:51.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:21:51 smithi157 bash[24585]: cluster 2024-09-16T07:21:50.087890+0000 mgr.a (mgr.14373) 4533 : cluster [DBG] pgmap v3143: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:21:51.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:21:51 smithi086 bash[24289]: cluster 2024-09-16T07:21:50.087890+0000 mgr.a (mgr.14373) 4533 : cluster [DBG] pgmap v3143: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:21:51.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:21:51 smithi047 bash[22744]: cluster 2024-09-16T07:21:50.087890+0000 mgr.a (mgr.14373) 4533 : cluster [DBG] pgmap v3143: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:21:51.853 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:21:51.854 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:21:51.854 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:21:52.609 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:21:52.609 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:21:52.609 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:21:52.609 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:21:52.610 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:21:53.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:21:53 smithi157 bash[24585]: cluster 2024-09-16T07:21:52.089173+0000 mgr.a (mgr.14373) 4534 : cluster [DBG] pgmap v3144: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:21:53.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:21:53 smithi157 bash[24585]: audit 2024-09-16T07:21:52.189937+0000 mgr.a (mgr.14373) 4535 : audit [DBG] from='client.108021 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:21:53.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:21:53 smithi086 bash[24289]: cluster 2024-09-16T07:21:52.089173+0000 mgr.a (mgr.14373) 4534 : cluster [DBG] pgmap v3144: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:21:53.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:21:53 smithi086 bash[24289]: audit 2024-09-16T07:21:52.189937+0000 mgr.a (mgr.14373) 4535 : audit [DBG] from='client.108021 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:21:53.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:21:53 smithi047 bash[22744]: cluster 2024-09-16T07:21:52.089173+0000 mgr.a (mgr.14373) 4534 : cluster [DBG] pgmap v3144: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:21:53.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:21:53 smithi047 bash[22744]: audit 2024-09-16T07:21:52.189937+0000 mgr.a (mgr.14373) 4535 : audit [DBG] from='client.108021 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:21:55.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:21:55 smithi157 bash[24585]: cluster 2024-09-16T07:21:54.090056+0000 mgr.a (mgr.14373) 4536 : cluster [DBG] pgmap v3145: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:21:55.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:21:55 smithi086 bash[24289]: cluster 2024-09-16T07:21:54.090056+0000 mgr.a (mgr.14373) 4536 : cluster [DBG] pgmap v3145: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:21:55.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:21:55 smithi047 bash[22744]: cluster 2024-09-16T07:21:54.090056+0000 mgr.a (mgr.14373) 4536 : cluster [DBG] pgmap v3145: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:21:57.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:21:57 smithi157 bash[24585]: cluster 2024-09-16T07:21:56.090864+0000 mgr.a (mgr.14373) 4537 : cluster [DBG] pgmap v3146: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T07:21:57.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:21:57 smithi086 bash[24289]: cluster 2024-09-16T07:21:56.090864+0000 mgr.a (mgr.14373) 4537 : cluster [DBG] pgmap v3146: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T07:21:57.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:21:57 smithi047 bash[22744]: cluster 2024-09-16T07:21:56.090864+0000 mgr.a (mgr.14373) 4537 : cluster [DBG] pgmap v3146: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T07:21:57.611 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:21:57.611 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:21:57.611 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:21:58.403 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:21:58.403 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:21:58.403 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:21:58.403 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:21:58.403 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:21:59.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:21:59 smithi157 bash[24585]: audit 2024-09-16T07:21:57.957905+0000 mgr.a (mgr.14373) 4538 : audit [DBG] from='client.108096 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:21:59.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:21:59 smithi157 bash[24585]: cluster 2024-09-16T07:21:58.101414+0000 mgr.a (mgr.14373) 4539 : cluster [DBG] pgmap v3147: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:21:59.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:21:59 smithi086 bash[24289]: audit 2024-09-16T07:21:57.957905+0000 mgr.a (mgr.14373) 4538 : audit [DBG] from='client.108096 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:21:59.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:21:59 smithi086 bash[24289]: cluster 2024-09-16T07:21:58.101414+0000 mgr.a (mgr.14373) 4539 : cluster [DBG] pgmap v3147: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:21:59.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:21:59 smithi047 bash[22744]: audit 2024-09-16T07:21:57.957905+0000 mgr.a (mgr.14373) 4538 : audit [DBG] from='client.108096 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:21:59.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:21:59 smithi047 bash[22744]: cluster 2024-09-16T07:21:58.101414+0000 mgr.a (mgr.14373) 4539 : cluster [DBG] pgmap v3147: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:22:01.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:22:01 smithi157 bash[24585]: cluster 2024-09-16T07:22:00.102299+0000 mgr.a (mgr.14373) 4540 : cluster [DBG] pgmap v3148: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:22:01.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:22:01 smithi086 bash[24289]: cluster 2024-09-16T07:22:00.102299+0000 mgr.a (mgr.14373) 4540 : cluster [DBG] pgmap v3148: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:22:01.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:22:01 smithi047 bash[22744]: cluster 2024-09-16T07:22:00.102299+0000 mgr.a (mgr.14373) 4540 : cluster [DBG] pgmap v3148: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:22:03.405 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:22:03.405 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:22:03.406 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:22:03.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:22:03 smithi157 bash[24585]: cluster 2024-09-16T07:22:02.104553+0000 mgr.a (mgr.14373) 4541 : cluster [DBG] pgmap v3149: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:22:03.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:22:03 smithi086 bash[24289]: cluster 2024-09-16T07:22:02.104553+0000 mgr.a (mgr.14373) 4541 : cluster [DBG] pgmap v3149: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:22:03.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:22:03 smithi047 bash[22744]: cluster 2024-09-16T07:22:02.104553+0000 mgr.a (mgr.14373) 4541 : cluster [DBG] pgmap v3149: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:22:04.174 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:22:04.174 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:22:04.174 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:22:04.174 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:22:04.175 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:22:05.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:22:05 smithi157 bash[24585]: audit 2024-09-16T07:22:03.740908+0000 mgr.a (mgr.14373) 4542 : audit [DBG] from='client.108174 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:22:05.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:22:05 smithi157 bash[24585]: cluster 2024-09-16T07:22:04.105123+0000 mgr.a (mgr.14373) 4543 : cluster [DBG] pgmap v3150: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:22:05.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:22:05 smithi086 bash[24289]: audit 2024-09-16T07:22:03.740908+0000 mgr.a (mgr.14373) 4542 : audit [DBG] from='client.108174 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:22:05.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:22:05 smithi086 bash[24289]: cluster 2024-09-16T07:22:04.105123+0000 mgr.a (mgr.14373) 4543 : cluster [DBG] pgmap v3150: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:22:05.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:22:05 smithi047 bash[22744]: audit 2024-09-16T07:22:03.740908+0000 mgr.a (mgr.14373) 4542 : audit [DBG] from='client.108174 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:22:05.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:22:05 smithi047 bash[22744]: cluster 2024-09-16T07:22:04.105123+0000 mgr.a (mgr.14373) 4543 : cluster [DBG] pgmap v3150: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:22:07.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:22:07 smithi157 bash[24585]: cluster 2024-09-16T07:22:06.105878+0000 mgr.a (mgr.14373) 4544 : cluster [DBG] pgmap v3151: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:22:07.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:22:07 smithi086 bash[24289]: cluster 2024-09-16T07:22:06.105878+0000 mgr.a (mgr.14373) 4544 : cluster [DBG] pgmap v3151: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:22:07.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:22:07 smithi047 bash[22744]: cluster 2024-09-16T07:22:06.105878+0000 mgr.a (mgr.14373) 4544 : cluster [DBG] pgmap v3151: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:22:09.176 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:22:09.176 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:22:09.176 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:22:09.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:22:09 smithi157 bash[24585]: cluster 2024-09-16T07:22:08.108122+0000 mgr.a (mgr.14373) 4545 : cluster [DBG] pgmap v3152: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:22:09.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:22:09 smithi086 bash[24289]: cluster 2024-09-16T07:22:08.108122+0000 mgr.a (mgr.14373) 4545 : cluster [DBG] pgmap v3152: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:22:09.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:22:09 smithi047 bash[22744]: cluster 2024-09-16T07:22:08.108122+0000 mgr.a (mgr.14373) 4545 : cluster [DBG] pgmap v3152: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:22:09.914 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:22:09.914 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:22:09.914 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:22:09.914 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:22:09.915 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:22:10.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:22:10 smithi157 bash[24585]: audit 2024-09-16T07:22:09.506087+0000 mgr.a (mgr.14373) 4546 : audit [DBG] from='client.108252 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:22:10.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:22:10 smithi086 bash[24289]: audit 2024-09-16T07:22:09.506087+0000 mgr.a (mgr.14373) 4546 : audit [DBG] from='client.108252 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:22:10.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:22:10 smithi047 bash[22744]: audit 2024-09-16T07:22:09.506087+0000 mgr.a (mgr.14373) 4546 : audit [DBG] from='client.108252 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:22:11.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:22:11 smithi157 bash[24585]: cluster 2024-09-16T07:22:10.109095+0000 mgr.a (mgr.14373) 4547 : cluster [DBG] pgmap v3153: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:22:11.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:22:11 smithi086 bash[24289]: cluster 2024-09-16T07:22:10.109095+0000 mgr.a (mgr.14373) 4547 : cluster [DBG] pgmap v3153: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:22:11.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:22:11 smithi047 bash[22744]: cluster 2024-09-16T07:22:10.109095+0000 mgr.a (mgr.14373) 4547 : cluster [DBG] pgmap v3153: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:22:13.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:22:13 smithi157 bash[24585]: cluster 2024-09-16T07:22:12.111437+0000 mgr.a (mgr.14373) 4548 : cluster [DBG] pgmap v3154: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:22:13.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:22:13 smithi086 bash[24289]: cluster 2024-09-16T07:22:12.111437+0000 mgr.a (mgr.14373) 4548 : cluster [DBG] pgmap v3154: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:22:13.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:22:13 smithi047 bash[22744]: cluster 2024-09-16T07:22:12.111437+0000 mgr.a (mgr.14373) 4548 : cluster [DBG] pgmap v3154: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:22:14.916 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:22:14.917 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:22:14.917 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:22:15.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:22:15 smithi157 bash[24585]: cluster 2024-09-16T07:22:14.112361+0000 mgr.a (mgr.14373) 4549 : cluster [DBG] pgmap v3155: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:22:15.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:22:15 smithi086 bash[24289]: cluster 2024-09-16T07:22:14.112361+0000 mgr.a (mgr.14373) 4549 : cluster [DBG] pgmap v3155: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:22:15.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:22:15 smithi047 bash[22744]: cluster 2024-09-16T07:22:14.112361+0000 mgr.a (mgr.14373) 4549 : cluster [DBG] pgmap v3155: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:22:15.673 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:22:15.673 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:22:15.673 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:22:15.674 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:22:15.674 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:22:16.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:22:16 smithi157 bash[24585]: audit 2024-09-16T07:22:15.247895+0000 mgr.a (mgr.14373) 4550 : audit [DBG] from='client.108330 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:22:16.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:22:16 smithi157 bash[24585]: audit 2024-09-16T07:22:15.765723+0000 mon.b (mon.2) 450 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T07:22:16.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:22:16 smithi086 bash[24289]: audit 2024-09-16T07:22:15.247895+0000 mgr.a (mgr.14373) 4550 : audit [DBG] from='client.108330 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:22:16.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:22:16 smithi086 bash[24289]: audit 2024-09-16T07:22:15.765723+0000 mon.b (mon.2) 450 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T07:22:16.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:22:16 smithi047 bash[22744]: audit 2024-09-16T07:22:15.247895+0000 mgr.a (mgr.14373) 4550 : audit [DBG] from='client.108330 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:22:16.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:22:16 smithi047 bash[22744]: audit 2024-09-16T07:22:15.765723+0000 mon.b (mon.2) 450 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T07:22:17.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:22:17 smithi157 bash[24585]: cluster 2024-09-16T07:22:16.113433+0000 mgr.a (mgr.14373) 4551 : cluster [DBG] pgmap v3156: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:22:17.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:22:17 smithi157 bash[24585]: audit 2024-09-16T07:22:16.577049+0000 mon.b (mon.2) 451 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T07:22:17.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:22:17 smithi157 bash[24585]: audit 2024-09-16T07:22:16.578898+0000 mon.b (mon.2) 452 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T07:22:17.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:22:17 smithi157 bash[24585]: audit 2024-09-16T07:22:16.591134+0000 mon.a (mon.0) 839 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:22:17.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:22:17 smithi157 bash[24585]: audit 2024-09-16T07:22:16.593353+0000 mon.b (mon.2) 453 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:22:17.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:22:17 smithi157 bash[24585]: audit 2024-09-16T07:22:16.597744+0000 mgr.a (mgr.14373) 4552 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:22:17.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:22:17 smithi086 bash[24289]: cluster 2024-09-16T07:22:16.113433+0000 mgr.a (mgr.14373) 4551 : cluster [DBG] pgmap v3156: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:22:17.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:22:17 smithi086 bash[24289]: audit 2024-09-16T07:22:16.577049+0000 mon.b (mon.2) 451 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T07:22:17.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:22:17 smithi086 bash[24289]: audit 2024-09-16T07:22:16.578898+0000 mon.b (mon.2) 452 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T07:22:17.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:22:17 smithi086 bash[24289]: audit 2024-09-16T07:22:16.591134+0000 mon.a (mon.0) 839 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:22:17.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:22:17 smithi086 bash[24289]: audit 2024-09-16T07:22:16.593353+0000 mon.b (mon.2) 453 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:22:17.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:22:17 smithi086 bash[24289]: audit 2024-09-16T07:22:16.597744+0000 mgr.a (mgr.14373) 4552 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:22:17.588 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 07:22:17 smithi047 bash[22994]: debug 2024-09-16T07:22:17.323+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T07:22:17.588 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 07:22:17 smithi047 bash[22994]: debug 2024-09-16T07:22:17.323+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T07:22:17.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:22:17 smithi047 bash[22744]: cluster 2024-09-16T07:22:16.113433+0000 mgr.a (mgr.14373) 4551 : cluster [DBG] pgmap v3156: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:22:17.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:22:17 smithi047 bash[22744]: audit 2024-09-16T07:22:16.577049+0000 mon.b (mon.2) 451 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T07:22:17.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:22:17 smithi047 bash[22744]: audit 2024-09-16T07:22:16.578898+0000 mon.b (mon.2) 452 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T07:22:17.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:22:17 smithi047 bash[22744]: audit 2024-09-16T07:22:16.591134+0000 mon.a (mon.0) 839 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:22:17.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:22:17 smithi047 bash[22744]: audit 2024-09-16T07:22:16.593353+0000 mon.b (mon.2) 453 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:22:17.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:22:17 smithi047 bash[22744]: audit 2024-09-16T07:22:16.597744+0000 mgr.a (mgr.14373) 4552 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:22:18.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:22:18 smithi157 bash[24585]: audit 2024-09-16T07:22:17.327033+0000 mgr.a (mgr.14373) 4553 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T07:22:18.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:22:18 smithi157 bash[24585]: cephadm 2024-09-16T07:22:17.328912+0000 mgr.a (mgr.14373) 4554 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T07:22:18.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:22:18 smithi086 bash[24289]: audit 2024-09-16T07:22:17.327033+0000 mgr.a (mgr.14373) 4553 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T07:22:18.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:22:18 smithi086 bash[24289]: cephadm 2024-09-16T07:22:17.328912+0000 mgr.a (mgr.14373) 4554 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T07:22:18.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:22:18 smithi047 bash[22744]: audit 2024-09-16T07:22:17.327033+0000 mgr.a (mgr.14373) 4553 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T07:22:18.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:22:18 smithi047 bash[22744]: cephadm 2024-09-16T07:22:17.328912+0000 mgr.a (mgr.14373) 4554 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T07:22:19.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:22:19 smithi157 bash[24585]: cluster 2024-09-16T07:22:18.116258+0000 mgr.a (mgr.14373) 4555 : cluster [DBG] pgmap v3157: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:22:19.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:22:19 smithi086 bash[24289]: cluster 2024-09-16T07:22:18.116258+0000 mgr.a (mgr.14373) 4555 : cluster [DBG] pgmap v3157: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:22:19.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:22:19 smithi047 bash[22744]: cluster 2024-09-16T07:22:18.116258+0000 mgr.a (mgr.14373) 4555 : cluster [DBG] pgmap v3157: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:22:20.675 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:22:20.676 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:22:20.676 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:22:21.437 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:22:21.438 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:22:21.438 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:22:21.438 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:22:21.438 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:22:21.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:22:21 smithi157 bash[24585]: cluster 2024-09-16T07:22:20.117042+0000 mgr.a (mgr.14373) 4556 : cluster [DBG] pgmap v3158: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:22:21.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:22:21 smithi086 bash[24289]: cluster 2024-09-16T07:22:20.117042+0000 mgr.a (mgr.14373) 4556 : cluster [DBG] pgmap v3158: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:22:21.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:22:21 smithi047 bash[22744]: cluster 2024-09-16T07:22:20.117042+0000 mgr.a (mgr.14373) 4556 : cluster [DBG] pgmap v3158: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:22:22.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:22:22 smithi157 bash[24585]: audit 2024-09-16T07:22:21.015812+0000 mgr.a (mgr.14373) 4557 : audit [DBG] from='client.108504 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:22:22.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:22:22 smithi086 bash[24289]: audit 2024-09-16T07:22:21.015812+0000 mgr.a (mgr.14373) 4557 : audit [DBG] from='client.108504 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:22:22.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:22:22 smithi047 bash[22744]: audit 2024-09-16T07:22:21.015812+0000 mgr.a (mgr.14373) 4557 : audit [DBG] from='client.108504 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:22:23.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:22:23 smithi157 bash[24585]: cluster 2024-09-16T07:22:22.119427+0000 mgr.a (mgr.14373) 4558 : cluster [DBG] pgmap v3159: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:22:23.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:22:23 smithi086 bash[24289]: cluster 2024-09-16T07:22:22.119427+0000 mgr.a (mgr.14373) 4558 : cluster [DBG] pgmap v3159: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:22:23.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:22:23 smithi047 bash[22744]: cluster 2024-09-16T07:22:22.119427+0000 mgr.a (mgr.14373) 4558 : cluster [DBG] pgmap v3159: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:22:25.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:22:25 smithi157 bash[24585]: cluster 2024-09-16T07:22:24.120225+0000 mgr.a (mgr.14373) 4559 : cluster [DBG] pgmap v3160: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:22:25.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:22:25 smithi086 bash[24289]: cluster 2024-09-16T07:22:24.120225+0000 mgr.a (mgr.14373) 4559 : cluster [DBG] pgmap v3160: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:22:25.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:22:25 smithi047 bash[22744]: cluster 2024-09-16T07:22:24.120225+0000 mgr.a (mgr.14373) 4559 : cluster [DBG] pgmap v3160: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:22:26.439 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:22:26.440 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:22:26.440 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:22:27.200 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:22:27.200 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:22:27.200 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:22:27.200 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:22:27.200 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:22:27.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:22:27 smithi086 bash[24289]: cluster 2024-09-16T07:22:26.120996+0000 mgr.a (mgr.14373) 4560 : cluster [DBG] pgmap v3161: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:22:27.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:22:27 smithi047 bash[22744]: cluster 2024-09-16T07:22:26.120996+0000 mgr.a (mgr.14373) 4560 : cluster [DBG] pgmap v3161: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:22:27.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:22:27 smithi157 bash[24585]: cluster 2024-09-16T07:22:26.120996+0000 mgr.a (mgr.14373) 4560 : cluster [DBG] pgmap v3161: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:22:28.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:22:28 smithi086 bash[24289]: audit 2024-09-16T07:22:26.775644+0000 mgr.a (mgr.14373) 4561 : audit [DBG] from='client.108576 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:22:28.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:22:28 smithi047 bash[22744]: audit 2024-09-16T07:22:26.775644+0000 mgr.a (mgr.14373) 4561 : audit [DBG] from='client.108576 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:22:28.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:22:28 smithi157 bash[24585]: audit 2024-09-16T07:22:26.775644+0000 mgr.a (mgr.14373) 4561 : audit [DBG] from='client.108576 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:22:29.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:22:29 smithi086 bash[24289]: cluster 2024-09-16T07:22:28.123786+0000 mgr.a (mgr.14373) 4562 : cluster [DBG] pgmap v3162: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:22:29.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:22:29 smithi047 bash[22744]: cluster 2024-09-16T07:22:28.123786+0000 mgr.a (mgr.14373) 4562 : cluster [DBG] pgmap v3162: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:22:29.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:22:29 smithi157 bash[24585]: cluster 2024-09-16T07:22:28.123786+0000 mgr.a (mgr.14373) 4562 : cluster [DBG] pgmap v3162: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:22:31.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:22:31 smithi047 bash[22744]: cluster 2024-09-16T07:22:30.124622+0000 mgr.a (mgr.14373) 4563 : cluster [DBG] pgmap v3163: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T07:22:31.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:22:31 smithi157 bash[24585]: cluster 2024-09-16T07:22:30.124622+0000 mgr.a (mgr.14373) 4563 : cluster [DBG] pgmap v3163: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T07:22:31.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:22:31 smithi086 bash[24289]: cluster 2024-09-16T07:22:30.124622+0000 mgr.a (mgr.14373) 4563 : cluster [DBG] pgmap v3163: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T07:22:32.199 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:22:32.200 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:22:32.200 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:22:32.949 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:22:32.949 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:22:32.949 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:22:32.950 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:22:32.950 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:22:33.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:22:33 smithi047 bash[22744]: cluster 2024-09-16T07:22:32.126661+0000 mgr.a (mgr.14373) 4564 : cluster [DBG] pgmap v3164: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:22:33.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:22:33 smithi047 bash[22744]: audit 2024-09-16T07:22:32.534977+0000 mgr.a (mgr.14373) 4565 : audit [DBG] from='client.108654 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:22:33.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:22:33 smithi157 bash[24585]: cluster 2024-09-16T07:22:32.126661+0000 mgr.a (mgr.14373) 4564 : cluster [DBG] pgmap v3164: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:22:33.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:22:33 smithi157 bash[24585]: audit 2024-09-16T07:22:32.534977+0000 mgr.a (mgr.14373) 4565 : audit [DBG] from='client.108654 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:22:33.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:22:33 smithi086 bash[24289]: cluster 2024-09-16T07:22:32.126661+0000 mgr.a (mgr.14373) 4564 : cluster [DBG] pgmap v3164: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:22:33.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:22:33 smithi086 bash[24289]: audit 2024-09-16T07:22:32.534977+0000 mgr.a (mgr.14373) 4565 : audit [DBG] from='client.108654 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:22:35.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:22:35 smithi047 bash[22744]: cluster 2024-09-16T07:22:34.127756+0000 mgr.a (mgr.14373) 4566 : cluster [DBG] pgmap v3165: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:22:35.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:22:35 smithi157 bash[24585]: cluster 2024-09-16T07:22:34.127756+0000 mgr.a (mgr.14373) 4566 : cluster [DBG] pgmap v3165: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:22:35.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:22:35 smithi086 bash[24289]: cluster 2024-09-16T07:22:34.127756+0000 mgr.a (mgr.14373) 4566 : cluster [DBG] pgmap v3165: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:22:37.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:22:37 smithi047 bash[22744]: cluster 2024-09-16T07:22:36.128700+0000 mgr.a (mgr.14373) 4567 : cluster [DBG] pgmap v3166: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T07:22:37.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:22:37 smithi157 bash[24585]: cluster 2024-09-16T07:22:36.128700+0000 mgr.a (mgr.14373) 4567 : cluster [DBG] pgmap v3166: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T07:22:37.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:22:37 smithi086 bash[24289]: cluster 2024-09-16T07:22:36.128700+0000 mgr.a (mgr.14373) 4567 : cluster [DBG] pgmap v3166: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T07:22:37.951 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:22:37.951 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:22:37.951 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:22:38.717 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:22:38.717 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:22:38.717 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:22:38.717 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:22:38.718 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:22:39.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:22:39 smithi047 bash[22744]: cluster 2024-09-16T07:22:38.130907+0000 mgr.a (mgr.14373) 4568 : cluster [DBG] pgmap v3167: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:22:39.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:22:39 smithi047 bash[22744]: audit 2024-09-16T07:22:38.289871+0000 mgr.a (mgr.14373) 4569 : audit [DBG] from='client.108732 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:22:39.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:22:39 smithi157 bash[24585]: cluster 2024-09-16T07:22:38.130907+0000 mgr.a (mgr.14373) 4568 : cluster [DBG] pgmap v3167: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:22:39.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:22:39 smithi157 bash[24585]: audit 2024-09-16T07:22:38.289871+0000 mgr.a (mgr.14373) 4569 : audit [DBG] from='client.108732 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:22:39.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:22:39 smithi086 bash[24289]: cluster 2024-09-16T07:22:38.130907+0000 mgr.a (mgr.14373) 4568 : cluster [DBG] pgmap v3167: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:22:39.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:22:39 smithi086 bash[24289]: audit 2024-09-16T07:22:38.289871+0000 mgr.a (mgr.14373) 4569 : audit [DBG] from='client.108732 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:22:41.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:22:41 smithi157 bash[24585]: cluster 2024-09-16T07:22:40.131850+0000 mgr.a (mgr.14373) 4570 : cluster [DBG] pgmap v3168: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:22:41.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:22:41 smithi086 bash[24289]: cluster 2024-09-16T07:22:40.131850+0000 mgr.a (mgr.14373) 4570 : cluster [DBG] pgmap v3168: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:22:41.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:22:41 smithi047 bash[22744]: cluster 2024-09-16T07:22:40.131850+0000 mgr.a (mgr.14373) 4570 : cluster [DBG] pgmap v3168: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:22:43.719 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:22:43.719 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:22:43.720 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:22:43.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:22:43 smithi157 bash[24585]: cluster 2024-09-16T07:22:42.134065+0000 mgr.a (mgr.14373) 4571 : cluster [DBG] pgmap v3169: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:22:43.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:22:43 smithi086 bash[24289]: cluster 2024-09-16T07:22:42.134065+0000 mgr.a (mgr.14373) 4571 : cluster [DBG] pgmap v3169: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:22:43.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:22:43 smithi047 bash[22744]: cluster 2024-09-16T07:22:42.134065+0000 mgr.a (mgr.14373) 4571 : cluster [DBG] pgmap v3169: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:22:44.481 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:22:44.481 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:22:44.481 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:22:44.481 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:22:44.482 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:22:45.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:22:45 smithi157 bash[24585]: audit 2024-09-16T07:22:44.064312+0000 mgr.a (mgr.14373) 4572 : audit [DBG] from='client.108810 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:22:45.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:22:45 smithi157 bash[24585]: cluster 2024-09-16T07:22:44.134623+0000 mgr.a (mgr.14373) 4573 : cluster [DBG] pgmap v3170: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:22:45.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:22:45 smithi086 bash[24289]: audit 2024-09-16T07:22:44.064312+0000 mgr.a (mgr.14373) 4572 : audit [DBG] from='client.108810 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:22:45.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:22:45 smithi086 bash[24289]: cluster 2024-09-16T07:22:44.134623+0000 mgr.a (mgr.14373) 4573 : cluster [DBG] pgmap v3170: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:22:45.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:22:45 smithi047 bash[22744]: audit 2024-09-16T07:22:44.064312+0000 mgr.a (mgr.14373) 4572 : audit [DBG] from='client.108810 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:22:45.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:22:45 smithi047 bash[22744]: cluster 2024-09-16T07:22:44.134623+0000 mgr.a (mgr.14373) 4573 : cluster [DBG] pgmap v3170: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:22:47.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:22:47 smithi157 bash[24585]: cluster 2024-09-16T07:22:46.135491+0000 mgr.a (mgr.14373) 4574 : cluster [DBG] pgmap v3171: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:22:47.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:22:47 smithi086 bash[24289]: cluster 2024-09-16T07:22:46.135491+0000 mgr.a (mgr.14373) 4574 : cluster [DBG] pgmap v3171: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:22:47.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:22:47 smithi047 bash[22744]: cluster 2024-09-16T07:22:46.135491+0000 mgr.a (mgr.14373) 4574 : cluster [DBG] pgmap v3171: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:22:49.483 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:22:49.483 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:22:49.483 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:22:49.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:22:49 smithi157 bash[24585]: cluster 2024-09-16T07:22:48.137708+0000 mgr.a (mgr.14373) 4575 : cluster [DBG] pgmap v3172: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:22:49.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:22:49 smithi086 bash[24289]: cluster 2024-09-16T07:22:48.137708+0000 mgr.a (mgr.14373) 4575 : cluster [DBG] pgmap v3172: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:22:49.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:22:49 smithi047 bash[22744]: cluster 2024-09-16T07:22:48.137708+0000 mgr.a (mgr.14373) 4575 : cluster [DBG] pgmap v3172: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:22:50.232 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:22:50.232 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:22:50.232 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:22:50.233 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:22:50.233 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:22:51.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:22:51 smithi157 bash[24585]: audit 2024-09-16T07:22:49.815630+0000 mgr.a (mgr.14373) 4576 : audit [DBG] from='client.108885 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:22:51.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:22:51 smithi157 bash[24585]: cluster 2024-09-16T07:22:50.140106+0000 mgr.a (mgr.14373) 4577 : cluster [DBG] pgmap v3173: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:22:51.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:22:51 smithi086 bash[24289]: audit 2024-09-16T07:22:49.815630+0000 mgr.a (mgr.14373) 4576 : audit [DBG] from='client.108885 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:22:51.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:22:51 smithi086 bash[24289]: cluster 2024-09-16T07:22:50.140106+0000 mgr.a (mgr.14373) 4577 : cluster [DBG] pgmap v3173: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:22:51.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:22:51 smithi047 bash[22744]: audit 2024-09-16T07:22:49.815630+0000 mgr.a (mgr.14373) 4576 : audit [DBG] from='client.108885 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:22:51.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:22:51 smithi047 bash[22744]: cluster 2024-09-16T07:22:50.140106+0000 mgr.a (mgr.14373) 4577 : cluster [DBG] pgmap v3173: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:22:54.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:22:53 smithi157 bash[24585]: cluster 2024-09-16T07:22:52.142431+0000 mgr.a (mgr.14373) 4578 : cluster [DBG] pgmap v3174: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:22:54.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:22:53 smithi086 bash[24289]: cluster 2024-09-16T07:22:52.142431+0000 mgr.a (mgr.14373) 4578 : cluster [DBG] pgmap v3174: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:22:54.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:22:53 smithi047 bash[22744]: cluster 2024-09-16T07:22:52.142431+0000 mgr.a (mgr.14373) 4578 : cluster [DBG] pgmap v3174: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:22:55.234 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:22:55.235 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:22:55.235 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:22:56.004 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:22:56.005 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:22:56.005 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:22:56.005 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:22:56.005 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:22:56.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:22:55 smithi157 bash[24585]: cluster 2024-09-16T07:22:54.143206+0000 mgr.a (mgr.14373) 4579 : cluster [DBG] pgmap v3175: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:22:56.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:22:55 smithi086 bash[24289]: cluster 2024-09-16T07:22:54.143206+0000 mgr.a (mgr.14373) 4579 : cluster [DBG] pgmap v3175: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:22:56.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:22:55 smithi047 bash[22744]: cluster 2024-09-16T07:22:54.143206+0000 mgr.a (mgr.14373) 4579 : cluster [DBG] pgmap v3175: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:22:57.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:22:56 smithi157 bash[24585]: audit 2024-09-16T07:22:55.574241+0000 mgr.a (mgr.14373) 4580 : audit [DBG] from='client.108957 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:22:57.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:22:56 smithi086 bash[24289]: audit 2024-09-16T07:22:55.574241+0000 mgr.a (mgr.14373) 4580 : audit [DBG] from='client.108957 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:22:57.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:22:56 smithi047 bash[22744]: audit 2024-09-16T07:22:55.574241+0000 mgr.a (mgr.14373) 4580 : audit [DBG] from='client.108957 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:22:58.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:22:57 smithi157 bash[24585]: cluster 2024-09-16T07:22:56.143830+0000 mgr.a (mgr.14373) 4581 : cluster [DBG] pgmap v3176: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:22:58.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:22:57 smithi086 bash[24289]: cluster 2024-09-16T07:22:56.143830+0000 mgr.a (mgr.14373) 4581 : cluster [DBG] pgmap v3176: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:22:58.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:22:57 smithi047 bash[22744]: cluster 2024-09-16T07:22:56.143830+0000 mgr.a (mgr.14373) 4581 : cluster [DBG] pgmap v3176: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:23:00.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:22:59 smithi157 bash[24585]: cluster 2024-09-16T07:22:58.146057+0000 mgr.a (mgr.14373) 4582 : cluster [DBG] pgmap v3177: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:23:00.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:22:59 smithi086 bash[24289]: cluster 2024-09-16T07:22:58.146057+0000 mgr.a (mgr.14373) 4582 : cluster [DBG] pgmap v3177: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:23:00.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:22:59 smithi047 bash[22744]: cluster 2024-09-16T07:22:58.146057+0000 mgr.a (mgr.14373) 4582 : cluster [DBG] pgmap v3177: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:23:01.006 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:23:01.006 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:23:01.007 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:23:01.782 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:23:01.783 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:23:01.783 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:23:01.783 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:23:01.783 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:23:02.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:23:01 smithi157 bash[24585]: cluster 2024-09-16T07:23:00.147006+0000 mgr.a (mgr.14373) 4583 : cluster [DBG] pgmap v3178: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:23:02.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:23:01 smithi086 bash[24289]: cluster 2024-09-16T07:23:00.147006+0000 mgr.a (mgr.14373) 4583 : cluster [DBG] pgmap v3178: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:23:02.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:23:01 smithi047 bash[22744]: cluster 2024-09-16T07:23:00.147006+0000 mgr.a (mgr.14373) 4583 : cluster [DBG] pgmap v3178: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:23:03.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:23:02 smithi157 bash[24585]: audit 2024-09-16T07:23:01.344528+0000 mgr.a (mgr.14373) 4584 : audit [DBG] from='client.109029 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:23:03.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:23:02 smithi086 bash[24289]: audit 2024-09-16T07:23:01.344528+0000 mgr.a (mgr.14373) 4584 : audit [DBG] from='client.109029 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:23:03.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:23:02 smithi047 bash[22744]: audit 2024-09-16T07:23:01.344528+0000 mgr.a (mgr.14373) 4584 : audit [DBG] from='client.109029 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:23:04.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:23:03 smithi157 bash[24585]: cluster 2024-09-16T07:23:02.150015+0000 mgr.a (mgr.14373) 4585 : cluster [DBG] pgmap v3179: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:23:04.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:23:03 smithi086 bash[24289]: cluster 2024-09-16T07:23:02.150015+0000 mgr.a (mgr.14373) 4585 : cluster [DBG] pgmap v3179: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:23:04.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:23:03 smithi047 bash[22744]: cluster 2024-09-16T07:23:02.150015+0000 mgr.a (mgr.14373) 4585 : cluster [DBG] pgmap v3179: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:23:06.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:23:05 smithi157 bash[24585]: cluster 2024-09-16T07:23:04.150900+0000 mgr.a (mgr.14373) 4586 : cluster [DBG] pgmap v3180: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:23:06.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:23:05 smithi086 bash[24289]: cluster 2024-09-16T07:23:04.150900+0000 mgr.a (mgr.14373) 4586 : cluster [DBG] pgmap v3180: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:23:06.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:23:05 smithi047 bash[22744]: cluster 2024-09-16T07:23:04.150900+0000 mgr.a (mgr.14373) 4586 : cluster [DBG] pgmap v3180: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:23:06.784 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:23:06.785 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:23:06.785 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:23:07.571 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:23:07.571 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:23:07.571 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:23:07.571 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:23:07.571 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:23:08.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:23:07 smithi157 bash[24585]: cluster 2024-09-16T07:23:06.151680+0000 mgr.a (mgr.14373) 4587 : cluster [DBG] pgmap v3181: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T07:23:08.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:23:07 smithi086 bash[24289]: cluster 2024-09-16T07:23:06.151680+0000 mgr.a (mgr.14373) 4587 : cluster [DBG] pgmap v3181: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T07:23:08.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:23:07 smithi047 bash[22744]: cluster 2024-09-16T07:23:06.151680+0000 mgr.a (mgr.14373) 4587 : cluster [DBG] pgmap v3181: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T07:23:09.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:23:08 smithi157 bash[24585]: audit 2024-09-16T07:23:07.124811+0000 mgr.a (mgr.14373) 4588 : audit [DBG] from='client.109107 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:23:09.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:23:08 smithi157 bash[24585]: cluster 2024-09-16T07:23:08.154464+0000 mgr.a (mgr.14373) 4589 : cluster [DBG] pgmap v3182: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:23:09.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:23:08 smithi086 bash[24289]: audit 2024-09-16T07:23:07.124811+0000 mgr.a (mgr.14373) 4588 : audit [DBG] from='client.109107 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:23:09.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:23:08 smithi086 bash[24289]: cluster 2024-09-16T07:23:08.154464+0000 mgr.a (mgr.14373) 4589 : cluster [DBG] pgmap v3182: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:23:09.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:23:08 smithi047 bash[22744]: audit 2024-09-16T07:23:07.124811+0000 mgr.a (mgr.14373) 4588 : audit [DBG] from='client.109107 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:23:09.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:23:08 smithi047 bash[22744]: cluster 2024-09-16T07:23:08.154464+0000 mgr.a (mgr.14373) 4589 : cluster [DBG] pgmap v3182: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:23:11.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:23:11 smithi157 bash[24585]: cluster 2024-09-16T07:23:10.155279+0000 mgr.a (mgr.14373) 4590 : cluster [DBG] pgmap v3183: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:23:11.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:23:11 smithi086 bash[24289]: cluster 2024-09-16T07:23:10.155279+0000 mgr.a (mgr.14373) 4590 : cluster [DBG] pgmap v3183: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:23:11.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:23:11 smithi047 bash[22744]: cluster 2024-09-16T07:23:10.155279+0000 mgr.a (mgr.14373) 4590 : cluster [DBG] pgmap v3183: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:23:12.572 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:23:12.573 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:23:12.573 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:23:13.323 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:23:13.323 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:23:13.323 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:23:13.323 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:23:13.323 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:23:13.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:23:13 smithi157 bash[24585]: cluster 2024-09-16T07:23:12.157351+0000 mgr.a (mgr.14373) 4591 : cluster [DBG] pgmap v3184: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:23:13.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:23:13 smithi086 bash[24289]: cluster 2024-09-16T07:23:12.157351+0000 mgr.a (mgr.14373) 4591 : cluster [DBG] pgmap v3184: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:23:13.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:23:13 smithi047 bash[22744]: cluster 2024-09-16T07:23:12.157351+0000 mgr.a (mgr.14373) 4591 : cluster [DBG] pgmap v3184: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:23:14.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:23:14 smithi157 bash[24585]: audit 2024-09-16T07:23:12.904737+0000 mgr.a (mgr.14373) 4592 : audit [DBG] from='client.109182 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:23:14.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:23:14 smithi086 bash[24289]: audit 2024-09-16T07:23:12.904737+0000 mgr.a (mgr.14373) 4592 : audit [DBG] from='client.109182 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:23:14.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:23:14 smithi047 bash[22744]: audit 2024-09-16T07:23:12.904737+0000 mgr.a (mgr.14373) 4592 : audit [DBG] from='client.109182 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:23:15.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:23:15 smithi157 bash[24585]: cluster 2024-09-16T07:23:14.158471+0000 mgr.a (mgr.14373) 4593 : cluster [DBG] pgmap v3185: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:23:15.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:23:15 smithi086 bash[24289]: cluster 2024-09-16T07:23:14.158471+0000 mgr.a (mgr.14373) 4593 : cluster [DBG] pgmap v3185: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:23:15.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:23:15 smithi047 bash[22744]: cluster 2024-09-16T07:23:14.158471+0000 mgr.a (mgr.14373) 4593 : cluster [DBG] pgmap v3185: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:23:17.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:23:17 smithi157 bash[24585]: cluster 2024-09-16T07:23:16.159310+0000 mgr.a (mgr.14373) 4594 : cluster [DBG] pgmap v3186: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:23:17.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:23:17 smithi086 bash[24289]: cluster 2024-09-16T07:23:16.159310+0000 mgr.a (mgr.14373) 4594 : cluster [DBG] pgmap v3186: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:23:17.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:23:17 smithi047 bash[22744]: cluster 2024-09-16T07:23:16.159310+0000 mgr.a (mgr.14373) 4594 : cluster [DBG] pgmap v3186: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:23:18.324 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:23:18.325 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:23:18.325 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:23:18.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:23:18 smithi157 bash[24585]: audit 2024-09-16T07:23:17.379830+0000 mon.b (mon.2) 454 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T07:23:18.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:23:18 smithi086 bash[24289]: audit 2024-09-16T07:23:17.379830+0000 mon.b (mon.2) 454 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T07:23:18.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:23:18 smithi047 bash[22744]: audit 2024-09-16T07:23:17.379830+0000 mon.b (mon.2) 454 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T07:23:19.079 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:23:19.079 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:23:19.079 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:23:19.079 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:23:19.079 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:23:19.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:23:19 smithi157 bash[24585]: cluster 2024-09-16T07:23:18.161473+0000 mgr.a (mgr.14373) 4595 : cluster [DBG] pgmap v3187: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:23:19.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:23:19 smithi157 bash[24585]: audit 2024-09-16T07:23:18.660186+0000 mgr.a (mgr.14373) 4596 : audit [DBG] from='client.109254 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:23:19.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:23:19 smithi086 bash[24289]: cluster 2024-09-16T07:23:18.161473+0000 mgr.a (mgr.14373) 4595 : cluster [DBG] pgmap v3187: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:23:19.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:23:19 smithi086 bash[24289]: audit 2024-09-16T07:23:18.660186+0000 mgr.a (mgr.14373) 4596 : audit [DBG] from='client.109254 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:23:19.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:23:19 smithi047 bash[22744]: cluster 2024-09-16T07:23:18.161473+0000 mgr.a (mgr.14373) 4595 : cluster [DBG] pgmap v3187: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:23:19.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:23:19 smithi047 bash[22744]: audit 2024-09-16T07:23:18.660186+0000 mgr.a (mgr.14373) 4596 : audit [DBG] from='client.109254 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:23:21.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:23:21 smithi157 bash[24585]: cluster 2024-09-16T07:23:20.162574+0000 mgr.a (mgr.14373) 4597 : cluster [DBG] pgmap v3188: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:23:21.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:23:21 smithi086 bash[24289]: cluster 2024-09-16T07:23:20.162574+0000 mgr.a (mgr.14373) 4597 : cluster [DBG] pgmap v3188: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:23:21.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:23:21 smithi047 bash[22744]: cluster 2024-09-16T07:23:20.162574+0000 mgr.a (mgr.14373) 4597 : cluster [DBG] pgmap v3188: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:23:24.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:23:23 smithi157 bash[24585]: cluster 2024-09-16T07:23:22.164981+0000 mgr.a (mgr.14373) 4598 : cluster [DBG] pgmap v3189: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:23:24.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:23:23 smithi157 bash[24585]: audit 2024-09-16T07:23:22.732038+0000 mon.a (mon.0) 840 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:23:24.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:23:23 smithi157 bash[24585]: audit 2024-09-16T07:23:22.742995+0000 mon.a (mon.0) 841 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:23:24.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:23:23 smithi157 bash[24585]: audit 2024-09-16T07:23:22.746356+0000 mon.a (mon.0) 842 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:23:24.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:23:23 smithi157 bash[24585]: audit 2024-09-16T07:23:22.752651+0000 mon.a (mon.0) 843 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:23:24.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:23:23 smithi157 bash[24585]: audit 2024-09-16T07:23:22.774654+0000 mon.a (mon.0) 844 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:23:24.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:23:23 smithi157 bash[24585]: audit 2024-09-16T07:23:22.783248+0000 mon.a (mon.0) 845 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:23:24.055 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:23:23 smithi157 bash[24585]: audit 2024-09-16T07:23:23.506811+0000 mon.b (mon.2) 455 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T07:23:24.055 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:23:23 smithi157 bash[24585]: audit 2024-09-16T07:23:23.508837+0000 mon.b (mon.2) 456 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T07:23:24.055 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:23:23 smithi157 bash[24585]: audit 2024-09-16T07:23:23.521938+0000 mon.a (mon.0) 846 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:23:24.055 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:23:23 smithi157 bash[24585]: audit 2024-09-16T07:23:23.525404+0000 mon.b (mon.2) 457 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:23:24.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:23:23 smithi086 bash[24289]: cluster 2024-09-16T07:23:22.164981+0000 mgr.a (mgr.14373) 4598 : cluster [DBG] pgmap v3189: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:23:24.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:23:23 smithi086 bash[24289]: audit 2024-09-16T07:23:22.732038+0000 mon.a (mon.0) 840 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:23:24.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:23:23 smithi086 bash[24289]: audit 2024-09-16T07:23:22.742995+0000 mon.a (mon.0) 841 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:23:24.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:23:23 smithi086 bash[24289]: audit 2024-09-16T07:23:22.746356+0000 mon.a (mon.0) 842 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:23:24.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:23:23 smithi086 bash[24289]: audit 2024-09-16T07:23:22.752651+0000 mon.a (mon.0) 843 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:23:24.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:23:23 smithi086 bash[24289]: audit 2024-09-16T07:23:22.774654+0000 mon.a (mon.0) 844 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:23:24.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:23:23 smithi086 bash[24289]: audit 2024-09-16T07:23:22.783248+0000 mon.a (mon.0) 845 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:23:24.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:23:23 smithi086 bash[24289]: audit 2024-09-16T07:23:23.506811+0000 mon.b (mon.2) 455 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T07:23:24.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:23:23 smithi086 bash[24289]: audit 2024-09-16T07:23:23.508837+0000 mon.b (mon.2) 456 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T07:23:24.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:23:23 smithi086 bash[24289]: audit 2024-09-16T07:23:23.521938+0000 mon.a (mon.0) 846 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:23:24.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:23:23 smithi086 bash[24289]: audit 2024-09-16T07:23:23.525404+0000 mon.b (mon.2) 457 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:23:24.080 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:23:24.080 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:23:24.080 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:23:24.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:23:23 smithi047 bash[22744]: cluster 2024-09-16T07:23:22.164981+0000 mgr.a (mgr.14373) 4598 : cluster [DBG] pgmap v3189: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:23:24.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:23:23 smithi047 bash[22744]: audit 2024-09-16T07:23:22.732038+0000 mon.a (mon.0) 840 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:23:24.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:23:23 smithi047 bash[22744]: audit 2024-09-16T07:23:22.742995+0000 mon.a (mon.0) 841 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:23:24.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:23:23 smithi047 bash[22744]: audit 2024-09-16T07:23:22.746356+0000 mon.a (mon.0) 842 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:23:24.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:23:23 smithi047 bash[22744]: audit 2024-09-16T07:23:22.752651+0000 mon.a (mon.0) 843 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:23:24.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:23:23 smithi047 bash[22744]: audit 2024-09-16T07:23:22.774654+0000 mon.a (mon.0) 844 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:23:24.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:23:23 smithi047 bash[22744]: audit 2024-09-16T07:23:22.783248+0000 mon.a (mon.0) 845 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:23:24.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:23:23 smithi047 bash[22744]: audit 2024-09-16T07:23:23.506811+0000 mon.b (mon.2) 455 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T07:23:24.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:23:23 smithi047 bash[22744]: audit 2024-09-16T07:23:23.508837+0000 mon.b (mon.2) 456 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T07:23:24.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:23:23 smithi047 bash[22744]: audit 2024-09-16T07:23:23.521938+0000 mon.a (mon.0) 846 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:23:24.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:23:23 smithi047 bash[22744]: audit 2024-09-16T07:23:23.525404+0000 mon.b (mon.2) 457 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:23:24.588 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 07:23:24 smithi047 bash[22994]: debug 2024-09-16T07:23:24.246+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T07:23:24.588 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 07:23:24 smithi047 bash[22994]: debug 2024-09-16T07:23:24.250+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T07:23:24.813 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:23:24.813 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:23:24.813 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:23:24.814 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:23:24.814 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:23:25.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:23:24 smithi157 bash[24585]: audit 2024-09-16T07:23:23.528764+0000 mgr.a (mgr.14373) 4599 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:23:25.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:23:24 smithi086 bash[24289]: audit 2024-09-16T07:23:23.528764+0000 mgr.a (mgr.14373) 4599 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:23:25.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:23:24 smithi047 bash[22744]: audit 2024-09-16T07:23:23.528764+0000 mgr.a (mgr.14373) 4599 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:23:26.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:23:25 smithi157 bash[24585]: cluster 2024-09-16T07:23:24.165706+0000 mgr.a (mgr.14373) 4600 : cluster [DBG] pgmap v3190: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:23:26.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:23:25 smithi157 bash[24585]: audit 2024-09-16T07:23:24.252452+0000 mgr.a (mgr.14373) 4601 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T07:23:26.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:23:25 smithi157 bash[24585]: cephadm 2024-09-16T07:23:24.254350+0000 mgr.a (mgr.14373) 4602 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T07:23:26.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:23:25 smithi157 bash[24585]: audit 2024-09-16T07:23:24.406738+0000 mgr.a (mgr.14373) 4603 : audit [DBG] from='client.109440 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:23:26.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:23:25 smithi086 bash[24289]: cluster 2024-09-16T07:23:24.165706+0000 mgr.a (mgr.14373) 4600 : cluster [DBG] pgmap v3190: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:23:26.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:23:25 smithi086 bash[24289]: audit 2024-09-16T07:23:24.252452+0000 mgr.a (mgr.14373) 4601 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T07:23:26.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:23:25 smithi086 bash[24289]: cephadm 2024-09-16T07:23:24.254350+0000 mgr.a (mgr.14373) 4602 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T07:23:26.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:23:25 smithi086 bash[24289]: audit 2024-09-16T07:23:24.406738+0000 mgr.a (mgr.14373) 4603 : audit [DBG] from='client.109440 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:23:26.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:23:25 smithi047 bash[22744]: cluster 2024-09-16T07:23:24.165706+0000 mgr.a (mgr.14373) 4600 : cluster [DBG] pgmap v3190: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:23:26.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:23:25 smithi047 bash[22744]: audit 2024-09-16T07:23:24.252452+0000 mgr.a (mgr.14373) 4601 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T07:23:26.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:23:25 smithi047 bash[22744]: cephadm 2024-09-16T07:23:24.254350+0000 mgr.a (mgr.14373) 4602 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T07:23:26.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:23:25 smithi047 bash[22744]: audit 2024-09-16T07:23:24.406738+0000 mgr.a (mgr.14373) 4603 : audit [DBG] from='client.109440 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:23:28.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:23:27 smithi157 bash[24585]: cluster 2024-09-16T07:23:26.166626+0000 mgr.a (mgr.14373) 4604 : cluster [DBG] pgmap v3191: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:23:28.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:23:27 smithi086 bash[24289]: cluster 2024-09-16T07:23:26.166626+0000 mgr.a (mgr.14373) 4604 : cluster [DBG] pgmap v3191: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:23:28.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:23:27 smithi047 bash[22744]: cluster 2024-09-16T07:23:26.166626+0000 mgr.a (mgr.14373) 4604 : cluster [DBG] pgmap v3191: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:23:29.815 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:23:29.816 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:23:29.816 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:23:30.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:23:29 smithi157 bash[24585]: cluster 2024-09-16T07:23:28.168925+0000 mgr.a (mgr.14373) 4605 : cluster [DBG] pgmap v3192: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:23:30.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:23:29 smithi086 bash[24289]: cluster 2024-09-16T07:23:28.168925+0000 mgr.a (mgr.14373) 4605 : cluster [DBG] pgmap v3192: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:23:30.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:23:29 smithi047 bash[22744]: cluster 2024-09-16T07:23:28.168925+0000 mgr.a (mgr.14373) 4605 : cluster [DBG] pgmap v3192: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:23:30.566 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:23:30.567 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:23:30.567 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:23:30.567 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:23:30.567 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:23:32.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:23:31 smithi157 bash[24585]: audit 2024-09-16T07:23:30.154634+0000 mgr.a (mgr.14373) 4606 : audit [DBG] from='client.109518 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:23:32.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:23:31 smithi157 bash[24585]: cluster 2024-09-16T07:23:30.170374+0000 mgr.a (mgr.14373) 4607 : cluster [DBG] pgmap v3193: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:23:32.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:23:31 smithi086 bash[24289]: audit 2024-09-16T07:23:30.154634+0000 mgr.a (mgr.14373) 4606 : audit [DBG] from='client.109518 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:23:32.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:23:31 smithi086 bash[24289]: cluster 2024-09-16T07:23:30.170374+0000 mgr.a (mgr.14373) 4607 : cluster [DBG] pgmap v3193: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:23:32.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:23:31 smithi047 bash[22744]: audit 2024-09-16T07:23:30.154634+0000 mgr.a (mgr.14373) 4606 : audit [DBG] from='client.109518 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:23:32.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:23:31 smithi047 bash[22744]: cluster 2024-09-16T07:23:30.170374+0000 mgr.a (mgr.14373) 4607 : cluster [DBG] pgmap v3193: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:23:33.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:23:32 smithi086 bash[24289]: cluster 2024-09-16T07:23:32.172820+0000 mgr.a (mgr.14373) 4608 : cluster [DBG] pgmap v3194: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:23:33.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:23:32 smithi047 bash[22744]: cluster 2024-09-16T07:23:32.172820+0000 mgr.a (mgr.14373) 4608 : cluster [DBG] pgmap v3194: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:23:33.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:23:32 smithi157 bash[24585]: cluster 2024-09-16T07:23:32.172820+0000 mgr.a (mgr.14373) 4608 : cluster [DBG] pgmap v3194: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:23:35.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:23:35 smithi157 bash[24585]: cluster 2024-09-16T07:23:34.173611+0000 mgr.a (mgr.14373) 4609 : cluster [DBG] pgmap v3195: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:23:35.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:23:35 smithi086 bash[24289]: cluster 2024-09-16T07:23:34.173611+0000 mgr.a (mgr.14373) 4609 : cluster [DBG] pgmap v3195: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:23:35.568 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:23:35.568 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:23:35.569 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:23:35.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:23:35 smithi047 bash[22744]: cluster 2024-09-16T07:23:34.173611+0000 mgr.a (mgr.14373) 4609 : cluster [DBG] pgmap v3195: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:23:36.313 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:23:36.314 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:23:36.314 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:23:36.314 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:23:36.314 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:23:37.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:23:37 smithi157 bash[24585]: audit 2024-09-16T07:23:35.907748+0000 mgr.a (mgr.14373) 4610 : audit [DBG] from='client.109596 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:23:37.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:23:37 smithi157 bash[24585]: cluster 2024-09-16T07:23:36.174199+0000 mgr.a (mgr.14373) 4611 : cluster [DBG] pgmap v3196: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:23:37.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:23:37 smithi086 bash[24289]: audit 2024-09-16T07:23:35.907748+0000 mgr.a (mgr.14373) 4610 : audit [DBG] from='client.109596 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:23:37.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:23:37 smithi086 bash[24289]: cluster 2024-09-16T07:23:36.174199+0000 mgr.a (mgr.14373) 4611 : cluster [DBG] pgmap v3196: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:23:37.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:23:37 smithi047 bash[22744]: audit 2024-09-16T07:23:35.907748+0000 mgr.a (mgr.14373) 4610 : audit [DBG] from='client.109596 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:23:37.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:23:37 smithi047 bash[22744]: cluster 2024-09-16T07:23:36.174199+0000 mgr.a (mgr.14373) 4611 : cluster [DBG] pgmap v3196: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:23:39.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:23:39 smithi157 bash[24585]: cluster 2024-09-16T07:23:38.176509+0000 mgr.a (mgr.14373) 4612 : cluster [DBG] pgmap v3197: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:23:39.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:23:39 smithi086 bash[24289]: cluster 2024-09-16T07:23:38.176509+0000 mgr.a (mgr.14373) 4612 : cluster [DBG] pgmap v3197: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:23:39.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:23:39 smithi047 bash[22744]: cluster 2024-09-16T07:23:38.176509+0000 mgr.a (mgr.14373) 4612 : cluster [DBG] pgmap v3197: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:23:41.315 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:23:41.316 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:23:41.316 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:23:41.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:23:41 smithi157 bash[24585]: cluster 2024-09-16T07:23:40.177280+0000 mgr.a (mgr.14373) 4613 : cluster [DBG] pgmap v3198: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:23:41.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:23:41 smithi086 bash[24289]: cluster 2024-09-16T07:23:40.177280+0000 mgr.a (mgr.14373) 4613 : cluster [DBG] pgmap v3198: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:23:41.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:23:41 smithi047 bash[22744]: cluster 2024-09-16T07:23:40.177280+0000 mgr.a (mgr.14373) 4613 : cluster [DBG] pgmap v3198: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:23:42.061 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:23:42.062 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:23:42.062 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:23:42.062 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:23:42.062 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:23:42.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:23:42 smithi157 bash[24585]: audit 2024-09-16T07:23:41.650319+0000 mgr.a (mgr.14373) 4614 : audit [DBG] from='client.109674 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:23:42.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:23:42 smithi086 bash[24289]: audit 2024-09-16T07:23:41.650319+0000 mgr.a (mgr.14373) 4614 : audit [DBG] from='client.109674 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:23:42.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:23:42 smithi047 bash[22744]: audit 2024-09-16T07:23:41.650319+0000 mgr.a (mgr.14373) 4614 : audit [DBG] from='client.109674 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:23:43.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:23:43 smithi157 bash[24585]: cluster 2024-09-16T07:23:42.180178+0000 mgr.a (mgr.14373) 4615 : cluster [DBG] pgmap v3199: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:23:43.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:23:43 smithi086 bash[24289]: cluster 2024-09-16T07:23:42.180178+0000 mgr.a (mgr.14373) 4615 : cluster [DBG] pgmap v3199: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:23:43.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:23:43 smithi047 bash[22744]: cluster 2024-09-16T07:23:42.180178+0000 mgr.a (mgr.14373) 4615 : cluster [DBG] pgmap v3199: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:23:45.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:23:45 smithi157 bash[24585]: cluster 2024-09-16T07:23:44.180912+0000 mgr.a (mgr.14373) 4616 : cluster [DBG] pgmap v3200: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:23:45.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:23:45 smithi086 bash[24289]: cluster 2024-09-16T07:23:44.180912+0000 mgr.a (mgr.14373) 4616 : cluster [DBG] pgmap v3200: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:23:45.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:23:45 smithi047 bash[22744]: cluster 2024-09-16T07:23:44.180912+0000 mgr.a (mgr.14373) 4616 : cluster [DBG] pgmap v3200: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:23:47.065 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:23:47.065 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:23:47.065 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:23:47.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:23:47 smithi157 bash[24585]: cluster 2024-09-16T07:23:46.181676+0000 mgr.a (mgr.14373) 4617 : cluster [DBG] pgmap v3201: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T07:23:47.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:23:47 smithi086 bash[24289]: cluster 2024-09-16T07:23:46.181676+0000 mgr.a (mgr.14373) 4617 : cluster [DBG] pgmap v3201: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T07:23:47.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:23:47 smithi047 bash[22744]: cluster 2024-09-16T07:23:46.181676+0000 mgr.a (mgr.14373) 4617 : cluster [DBG] pgmap v3201: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T07:23:47.845 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:23:47.845 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:23:47.845 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:23:47.845 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:23:47.845 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:23:48.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:23:48 smithi157 bash[24585]: audit 2024-09-16T07:23:47.405954+0000 mgr.a (mgr.14373) 4618 : audit [DBG] from='client.109752 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:23:48.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:23:48 smithi086 bash[24289]: audit 2024-09-16T07:23:47.405954+0000 mgr.a (mgr.14373) 4618 : audit [DBG] from='client.109752 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:23:48.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:23:48 smithi047 bash[22744]: audit 2024-09-16T07:23:47.405954+0000 mgr.a (mgr.14373) 4618 : audit [DBG] from='client.109752 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:23:49.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:23:49 smithi157 bash[24585]: cluster 2024-09-16T07:23:48.184313+0000 mgr.a (mgr.14373) 4619 : cluster [DBG] pgmap v3202: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:23:49.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:23:49 smithi086 bash[24289]: cluster 2024-09-16T07:23:48.184313+0000 mgr.a (mgr.14373) 4619 : cluster [DBG] pgmap v3202: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:23:49.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:23:49 smithi047 bash[22744]: cluster 2024-09-16T07:23:48.184313+0000 mgr.a (mgr.14373) 4619 : cluster [DBG] pgmap v3202: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:23:51.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:23:51 smithi157 bash[24585]: cluster 2024-09-16T07:23:50.185077+0000 mgr.a (mgr.14373) 4620 : cluster [DBG] pgmap v3203: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:23:51.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:23:51 smithi086 bash[24289]: cluster 2024-09-16T07:23:50.185077+0000 mgr.a (mgr.14373) 4620 : cluster [DBG] pgmap v3203: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:23:51.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:23:51 smithi047 bash[22744]: cluster 2024-09-16T07:23:50.185077+0000 mgr.a (mgr.14373) 4620 : cluster [DBG] pgmap v3203: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:23:52.846 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:23:52.847 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:23:52.847 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:23:53.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:23:53 smithi157 bash[24585]: cluster 2024-09-16T07:23:52.187115+0000 mgr.a (mgr.14373) 4621 : cluster [DBG] pgmap v3204: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:23:53.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:23:53 smithi086 bash[24289]: cluster 2024-09-16T07:23:52.187115+0000 mgr.a (mgr.14373) 4621 : cluster [DBG] pgmap v3204: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:23:53.584 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:23:53.584 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:23:53.584 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:23:53.584 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:23:53.584 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:23:53.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:23:53 smithi047 bash[22744]: cluster 2024-09-16T07:23:52.187115+0000 mgr.a (mgr.14373) 4621 : cluster [DBG] pgmap v3204: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:23:54.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:23:54 smithi157 bash[24585]: audit 2024-09-16T07:23:53.180064+0000 mgr.a (mgr.14373) 4622 : audit [DBG] from='client.109827 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:23:54.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:23:54 smithi086 bash[24289]: audit 2024-09-16T07:23:53.180064+0000 mgr.a (mgr.14373) 4622 : audit [DBG] from='client.109827 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:23:54.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:23:54 smithi047 bash[22744]: audit 2024-09-16T07:23:53.180064+0000 mgr.a (mgr.14373) 4622 : audit [DBG] from='client.109827 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:23:55.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:23:55 smithi157 bash[24585]: cluster 2024-09-16T07:23:54.188029+0000 mgr.a (mgr.14373) 4623 : cluster [DBG] pgmap v3205: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:23:55.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:23:55 smithi086 bash[24289]: cluster 2024-09-16T07:23:54.188029+0000 mgr.a (mgr.14373) 4623 : cluster [DBG] pgmap v3205: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:23:55.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:23:55 smithi047 bash[22744]: cluster 2024-09-16T07:23:54.188029+0000 mgr.a (mgr.14373) 4623 : cluster [DBG] pgmap v3205: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:23:57.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:23:57 smithi157 bash[24585]: cluster 2024-09-16T07:23:56.188795+0000 mgr.a (mgr.14373) 4624 : cluster [DBG] pgmap v3206: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:23:57.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:23:57 smithi086 bash[24289]: cluster 2024-09-16T07:23:56.188795+0000 mgr.a (mgr.14373) 4624 : cluster [DBG] pgmap v3206: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:23:57.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:23:57 smithi047 bash[22744]: cluster 2024-09-16T07:23:56.188795+0000 mgr.a (mgr.14373) 4624 : cluster [DBG] pgmap v3206: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:23:58.586 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:23:58.586 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:23:58.586 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:23:59.344 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:23:59.344 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:23:59.345 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:23:59.345 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:23:59.345 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:23:59.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:23:59 smithi157 bash[24585]: cluster 2024-09-16T07:23:58.191012+0000 mgr.a (mgr.14373) 4625 : cluster [DBG] pgmap v3207: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:23:59.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:23:59 smithi086 bash[24289]: cluster 2024-09-16T07:23:58.191012+0000 mgr.a (mgr.14373) 4625 : cluster [DBG] pgmap v3207: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:23:59.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:23:59 smithi047 bash[22744]: cluster 2024-09-16T07:23:58.191012+0000 mgr.a (mgr.14373) 4625 : cluster [DBG] pgmap v3207: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:24:00.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:24:00 smithi086 bash[24289]: audit 2024-09-16T07:23:58.920893+0000 mgr.a (mgr.14373) 4626 : audit [DBG] from='client.109905 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:24:00.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:24:00 smithi047 bash[22744]: audit 2024-09-16T07:23:58.920893+0000 mgr.a (mgr.14373) 4626 : audit [DBG] from='client.109905 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:24:00.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:24:00 smithi157 bash[24585]: audit 2024-09-16T07:23:58.920893+0000 mgr.a (mgr.14373) 4626 : audit [DBG] from='client.109905 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:24:01.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:24:01 smithi086 bash[24289]: cluster 2024-09-16T07:24:00.192034+0000 mgr.a (mgr.14373) 4627 : cluster [DBG] pgmap v3208: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:24:01.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:24:01 smithi047 bash[22744]: cluster 2024-09-16T07:24:00.192034+0000 mgr.a (mgr.14373) 4627 : cluster [DBG] pgmap v3208: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:24:01.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:24:01 smithi157 bash[24585]: cluster 2024-09-16T07:24:00.192034+0000 mgr.a (mgr.14373) 4627 : cluster [DBG] pgmap v3208: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:24:03.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:24:03 smithi086 bash[24289]: cluster 2024-09-16T07:24:02.194455+0000 mgr.a (mgr.14373) 4628 : cluster [DBG] pgmap v3209: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:24:03.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:24:03 smithi047 bash[22744]: cluster 2024-09-16T07:24:02.194455+0000 mgr.a (mgr.14373) 4628 : cluster [DBG] pgmap v3209: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:24:03.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:24:03 smithi157 bash[24585]: cluster 2024-09-16T07:24:02.194455+0000 mgr.a (mgr.14373) 4628 : cluster [DBG] pgmap v3209: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:24:04.346 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:24:04.347 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:24:04.347 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:24:05.090 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:24:05.091 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:24:05.091 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:24:05.091 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:24:05.091 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:24:05.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:24:05 smithi086 bash[24289]: cluster 2024-09-16T07:24:04.195239+0000 mgr.a (mgr.14373) 4629 : cluster [DBG] pgmap v3210: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:24:05.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:24:05 smithi086 bash[24289]: audit 2024-09-16T07:24:04.684224+0000 mgr.a (mgr.14373) 4630 : audit [DBG] from='client.109983 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:24:05.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:24:05 smithi047 bash[22744]: cluster 2024-09-16T07:24:04.195239+0000 mgr.a (mgr.14373) 4629 : cluster [DBG] pgmap v3210: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:24:05.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:24:05 smithi047 bash[22744]: audit 2024-09-16T07:24:04.684224+0000 mgr.a (mgr.14373) 4630 : audit [DBG] from='client.109983 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:24:05.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:24:05 smithi157 bash[24585]: cluster 2024-09-16T07:24:04.195239+0000 mgr.a (mgr.14373) 4629 : cluster [DBG] pgmap v3210: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:24:05.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:24:05 smithi157 bash[24585]: audit 2024-09-16T07:24:04.684224+0000 mgr.a (mgr.14373) 4630 : audit [DBG] from='client.109983 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:24:07.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:24:07 smithi047 bash[22744]: cluster 2024-09-16T07:24:06.196146+0000 mgr.a (mgr.14373) 4631 : cluster [DBG] pgmap v3211: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:24:07.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:24:07 smithi157 bash[24585]: cluster 2024-09-16T07:24:06.196146+0000 mgr.a (mgr.14373) 4631 : cluster [DBG] pgmap v3211: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:24:07.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:24:07 smithi086 bash[24289]: cluster 2024-09-16T07:24:06.196146+0000 mgr.a (mgr.14373) 4631 : cluster [DBG] pgmap v3211: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:24:09.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:24:09 smithi047 bash[22744]: cluster 2024-09-16T07:24:08.198384+0000 mgr.a (mgr.14373) 4632 : cluster [DBG] pgmap v3212: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:24:09.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:24:09 smithi157 bash[24585]: cluster 2024-09-16T07:24:08.198384+0000 mgr.a (mgr.14373) 4632 : cluster [DBG] pgmap v3212: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:24:09.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:24:09 smithi086 bash[24289]: cluster 2024-09-16T07:24:08.198384+0000 mgr.a (mgr.14373) 4632 : cluster [DBG] pgmap v3212: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:24:10.092 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:24:10.093 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:24:10.093 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:24:10.836 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:24:10.836 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:24:10.836 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:24:10.836 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:24:10.836 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:24:11.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:24:11 smithi047 bash[22744]: cluster 2024-09-16T07:24:10.198813+0000 mgr.a (mgr.14373) 4633 : cluster [DBG] pgmap v3213: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:24:11.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:24:11 smithi047 bash[22744]: audit 2024-09-16T07:24:10.427673+0000 mgr.a (mgr.14373) 4634 : audit [DBG] from='client.110061 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:24:11.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:24:11 smithi157 bash[24585]: cluster 2024-09-16T07:24:10.198813+0000 mgr.a (mgr.14373) 4633 : cluster [DBG] pgmap v3213: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:24:11.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:24:11 smithi157 bash[24585]: audit 2024-09-16T07:24:10.427673+0000 mgr.a (mgr.14373) 4634 : audit [DBG] from='client.110061 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:24:11.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:24:11 smithi086 bash[24289]: cluster 2024-09-16T07:24:10.198813+0000 mgr.a (mgr.14373) 4633 : cluster [DBG] pgmap v3213: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:24:11.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:24:11 smithi086 bash[24289]: audit 2024-09-16T07:24:10.427673+0000 mgr.a (mgr.14373) 4634 : audit [DBG] from='client.110061 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:24:13.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:24:13 smithi047 bash[22744]: cluster 2024-09-16T07:24:12.201087+0000 mgr.a (mgr.14373) 4635 : cluster [DBG] pgmap v3214: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:24:13.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:24:13 smithi157 bash[24585]: cluster 2024-09-16T07:24:12.201087+0000 mgr.a (mgr.14373) 4635 : cluster [DBG] pgmap v3214: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:24:13.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:24:13 smithi086 bash[24289]: cluster 2024-09-16T07:24:12.201087+0000 mgr.a (mgr.14373) 4635 : cluster [DBG] pgmap v3214: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:24:15.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:24:15 smithi047 bash[22744]: cluster 2024-09-16T07:24:14.201842+0000 mgr.a (mgr.14373) 4636 : cluster [DBG] pgmap v3215: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:24:15.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:24:15 smithi157 bash[24585]: cluster 2024-09-16T07:24:14.201842+0000 mgr.a (mgr.14373) 4636 : cluster [DBG] pgmap v3215: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:24:15.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:24:15 smithi086 bash[24289]: cluster 2024-09-16T07:24:14.201842+0000 mgr.a (mgr.14373) 4636 : cluster [DBG] pgmap v3215: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:24:15.837 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:24:15.838 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:24:15.838 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:24:16.580 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:24:16.581 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:24:16.581 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:24:16.581 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:24:16.581 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:24:17.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:24:17 smithi157 bash[24585]: audit 2024-09-16T07:24:16.175739+0000 mgr.a (mgr.14373) 4637 : audit [DBG] from='client.110139 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:24:17.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:24:17 smithi157 bash[24585]: cluster 2024-09-16T07:24:16.202828+0000 mgr.a (mgr.14373) 4638 : cluster [DBG] pgmap v3216: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:24:17.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:24:17 smithi086 bash[24289]: audit 2024-09-16T07:24:16.175739+0000 mgr.a (mgr.14373) 4637 : audit [DBG] from='client.110139 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:24:17.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:24:17 smithi086 bash[24289]: cluster 2024-09-16T07:24:16.202828+0000 mgr.a (mgr.14373) 4638 : cluster [DBG] pgmap v3216: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:24:17.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:24:17 smithi047 bash[22744]: audit 2024-09-16T07:24:16.175739+0000 mgr.a (mgr.14373) 4637 : audit [DBG] from='client.110139 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:24:17.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:24:17 smithi047 bash[22744]: cluster 2024-09-16T07:24:16.202828+0000 mgr.a (mgr.14373) 4638 : cluster [DBG] pgmap v3216: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:24:19.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:24:19 smithi157 bash[24585]: cluster 2024-09-16T07:24:18.205524+0000 mgr.a (mgr.14373) 4639 : cluster [DBG] pgmap v3217: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:24:19.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:24:19 smithi086 bash[24289]: cluster 2024-09-16T07:24:18.205524+0000 mgr.a (mgr.14373) 4639 : cluster [DBG] pgmap v3217: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:24:19.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:24:19 smithi047 bash[22744]: cluster 2024-09-16T07:24:18.205524+0000 mgr.a (mgr.14373) 4639 : cluster [DBG] pgmap v3217: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:24:21.582 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:24:21.583 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:24:21.583 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:24:21.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:24:21 smithi157 bash[24585]: cluster 2024-09-16T07:24:20.206260+0000 mgr.a (mgr.14373) 4640 : cluster [DBG] pgmap v3218: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:24:21.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:24:21 smithi086 bash[24289]: cluster 2024-09-16T07:24:20.206260+0000 mgr.a (mgr.14373) 4640 : cluster [DBG] pgmap v3218: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:24:21.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:24:21 smithi047 bash[22744]: cluster 2024-09-16T07:24:20.206260+0000 mgr.a (mgr.14373) 4640 : cluster [DBG] pgmap v3218: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:24:22.348 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:24:22.348 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:24:22.349 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:24:22.349 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:24:22.349 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:24:23.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:24:23 smithi157 bash[24585]: audit 2024-09-16T07:24:21.922274+0000 mgr.a (mgr.14373) 4641 : audit [DBG] from='client.110217 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:24:23.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:24:23 smithi157 bash[24585]: cluster 2024-09-16T07:24:22.207483+0000 mgr.a (mgr.14373) 4642 : cluster [DBG] pgmap v3219: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:24:23.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:24:23 smithi086 bash[24289]: audit 2024-09-16T07:24:21.922274+0000 mgr.a (mgr.14373) 4641 : audit [DBG] from='client.110217 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:24:23.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:24:23 smithi086 bash[24289]: cluster 2024-09-16T07:24:22.207483+0000 mgr.a (mgr.14373) 4642 : cluster [DBG] pgmap v3219: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:24:23.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:24:23 smithi047 bash[22744]: audit 2024-09-16T07:24:21.922274+0000 mgr.a (mgr.14373) 4641 : audit [DBG] from='client.110217 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:24:23.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:24:23 smithi047 bash[22744]: cluster 2024-09-16T07:24:22.207483+0000 mgr.a (mgr.14373) 4642 : cluster [DBG] pgmap v3219: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:24:24.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:24:24 smithi157 bash[24585]: audit 2024-09-16T07:24:24.301619+0000 mon.b (mon.2) 458 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T07:24:24.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:24:24 smithi086 bash[24289]: audit 2024-09-16T07:24:24.301619+0000 mon.b (mon.2) 458 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T07:24:24.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:24:24 smithi047 bash[22744]: audit 2024-09-16T07:24:24.301619+0000 mon.b (mon.2) 458 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T07:24:25.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:24:25 smithi157 bash[24585]: cluster 2024-09-16T07:24:24.208326+0000 mgr.a (mgr.14373) 4643 : cluster [DBG] pgmap v3220: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:24:25.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:24:25 smithi157 bash[24585]: audit 2024-09-16T07:24:25.146163+0000 mon.b (mon.2) 459 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T07:24:25.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:24:25 smithi157 bash[24585]: audit 2024-09-16T07:24:25.148068+0000 mon.b (mon.2) 460 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T07:24:25.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:24:25 smithi157 bash[24585]: audit 2024-09-16T07:24:25.158774+0000 mon.a (mon.0) 847 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:24:25.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:24:25 smithi157 bash[24585]: audit 2024-09-16T07:24:25.164796+0000 mon.b (mon.2) 461 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:24:25.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:24:25 smithi086 bash[24289]: cluster 2024-09-16T07:24:24.208326+0000 mgr.a (mgr.14373) 4643 : cluster [DBG] pgmap v3220: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:24:25.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:24:25 smithi086 bash[24289]: audit 2024-09-16T07:24:25.146163+0000 mon.b (mon.2) 459 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T07:24:25.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:24:25 smithi086 bash[24289]: audit 2024-09-16T07:24:25.148068+0000 mon.b (mon.2) 460 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T07:24:25.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:24:25 smithi086 bash[24289]: audit 2024-09-16T07:24:25.158774+0000 mon.a (mon.0) 847 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:24:25.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:24:25 smithi086 bash[24289]: audit 2024-09-16T07:24:25.164796+0000 mon.b (mon.2) 461 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:24:25.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:24:25 smithi047 bash[22744]: cluster 2024-09-16T07:24:24.208326+0000 mgr.a (mgr.14373) 4643 : cluster [DBG] pgmap v3220: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:24:25.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:24:25 smithi047 bash[22744]: audit 2024-09-16T07:24:25.146163+0000 mon.b (mon.2) 459 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T07:24:25.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:24:25 smithi047 bash[22744]: audit 2024-09-16T07:24:25.148068+0000 mon.b (mon.2) 460 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T07:24:25.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:24:25 smithi047 bash[22744]: audit 2024-09-16T07:24:25.158774+0000 mon.a (mon.0) 847 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:24:25.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:24:25 smithi047 bash[22744]: audit 2024-09-16T07:24:25.164796+0000 mon.b (mon.2) 461 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:24:26.338 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 07:24:25 smithi047 bash[22994]: debug 2024-09-16T07:24:25.885+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T07:24:26.338 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 07:24:25 smithi047 bash[22994]: debug 2024-09-16T07:24:25.885+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T07:24:26.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:24:26 smithi157 bash[24585]: audit 2024-09-16T07:24:25.169014+0000 mgr.a (mgr.14373) 4644 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:24:26.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:24:26 smithi086 bash[24289]: audit 2024-09-16T07:24:25.169014+0000 mgr.a (mgr.14373) 4644 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:24:26.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:24:26 smithi047 bash[22744]: audit 2024-09-16T07:24:25.169014+0000 mgr.a (mgr.14373) 4644 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:24:27.350 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:24:27.350 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:24:27.350 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:24:27.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:24:27 smithi157 bash[24585]: audit 2024-09-16T07:24:25.888364+0000 mgr.a (mgr.14373) 4645 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T07:24:27.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:24:27 smithi157 bash[24585]: cephadm 2024-09-16T07:24:25.890237+0000 mgr.a (mgr.14373) 4646 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T07:24:27.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:24:27 smithi157 bash[24585]: cluster 2024-09-16T07:24:26.209316+0000 mgr.a (mgr.14373) 4647 : cluster [DBG] pgmap v3221: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T07:24:27.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:24:27 smithi086 bash[24289]: audit 2024-09-16T07:24:25.888364+0000 mgr.a (mgr.14373) 4645 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T07:24:27.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:24:27 smithi086 bash[24289]: cephadm 2024-09-16T07:24:25.890237+0000 mgr.a (mgr.14373) 4646 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T07:24:27.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:24:27 smithi086 bash[24289]: cluster 2024-09-16T07:24:26.209316+0000 mgr.a (mgr.14373) 4647 : cluster [DBG] pgmap v3221: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T07:24:27.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:24:27 smithi047 bash[22744]: audit 2024-09-16T07:24:25.888364+0000 mgr.a (mgr.14373) 4645 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T07:24:27.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:24:27 smithi047 bash[22744]: cephadm 2024-09-16T07:24:25.890237+0000 mgr.a (mgr.14373) 4646 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T07:24:27.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:24:27 smithi047 bash[22744]: cluster 2024-09-16T07:24:26.209316+0000 mgr.a (mgr.14373) 4647 : cluster [DBG] pgmap v3221: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T07:24:28.110 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:24:28.111 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:24:28.111 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:24:28.111 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:24:28.111 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:24:28.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:24:28 smithi157 bash[24585]: audit 2024-09-16T07:24:27.686653+0000 mgr.a (mgr.14373) 4648 : audit [DBG] from='client.110400 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:24:28.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:24:28 smithi086 bash[24289]: audit 2024-09-16T07:24:27.686653+0000 mgr.a (mgr.14373) 4648 : audit [DBG] from='client.110400 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:24:28.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:24:28 smithi047 bash[22744]: audit 2024-09-16T07:24:27.686653+0000 mgr.a (mgr.14373) 4648 : audit [DBG] from='client.110400 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:24:29.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:24:29 smithi157 bash[24585]: cluster 2024-09-16T07:24:28.212189+0000 mgr.a (mgr.14373) 4649 : cluster [DBG] pgmap v3222: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:24:29.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:24:29 smithi086 bash[24289]: cluster 2024-09-16T07:24:28.212189+0000 mgr.a (mgr.14373) 4649 : cluster [DBG] pgmap v3222: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:24:29.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:24:29 smithi047 bash[22744]: cluster 2024-09-16T07:24:28.212189+0000 mgr.a (mgr.14373) 4649 : cluster [DBG] pgmap v3222: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:24:31.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:24:31 smithi157 bash[24585]: cluster 2024-09-16T07:24:30.213051+0000 mgr.a (mgr.14373) 4650 : cluster [DBG] pgmap v3223: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:24:31.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:24:31 smithi086 bash[24289]: cluster 2024-09-16T07:24:30.213051+0000 mgr.a (mgr.14373) 4650 : cluster [DBG] pgmap v3223: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:24:31.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:24:31 smithi047 bash[22744]: cluster 2024-09-16T07:24:30.213051+0000 mgr.a (mgr.14373) 4650 : cluster [DBG] pgmap v3223: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:24:33.112 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:24:33.113 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:24:33.113 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:24:33.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:24:33 smithi157 bash[24585]: cluster 2024-09-16T07:24:32.215122+0000 mgr.a (mgr.14373) 4651 : cluster [DBG] pgmap v3224: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:24:33.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:24:33 smithi086 bash[24289]: cluster 2024-09-16T07:24:32.215122+0000 mgr.a (mgr.14373) 4651 : cluster [DBG] pgmap v3224: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:24:33.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:24:33 smithi047 bash[22744]: cluster 2024-09-16T07:24:32.215122+0000 mgr.a (mgr.14373) 4651 : cluster [DBG] pgmap v3224: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:24:33.895 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:24:33.895 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:24:33.896 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:24:33.896 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:24:33.896 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:24:34.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:24:34 smithi157 bash[24585]: audit 2024-09-16T07:24:33.451585+0000 mgr.a (mgr.14373) 4652 : audit [DBG] from='client.110478 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:24:34.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:24:34 smithi086 bash[24289]: audit 2024-09-16T07:24:33.451585+0000 mgr.a (mgr.14373) 4652 : audit [DBG] from='client.110478 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:24:34.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:24:34 smithi047 bash[22744]: audit 2024-09-16T07:24:33.451585+0000 mgr.a (mgr.14373) 4652 : audit [DBG] from='client.110478 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:24:35.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:24:35 smithi157 bash[24585]: cluster 2024-09-16T07:24:34.216082+0000 mgr.a (mgr.14373) 4653 : cluster [DBG] pgmap v3225: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:24:35.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:24:35 smithi086 bash[24289]: cluster 2024-09-16T07:24:34.216082+0000 mgr.a (mgr.14373) 4653 : cluster [DBG] pgmap v3225: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:24:35.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:24:35 smithi047 bash[22744]: cluster 2024-09-16T07:24:34.216082+0000 mgr.a (mgr.14373) 4653 : cluster [DBG] pgmap v3225: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:24:37.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:24:37 smithi157 bash[24585]: cluster 2024-09-16T07:24:36.216891+0000 mgr.a (mgr.14373) 4654 : cluster [DBG] pgmap v3226: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:24:37.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:24:37 smithi086 bash[24289]: cluster 2024-09-16T07:24:36.216891+0000 mgr.a (mgr.14373) 4654 : cluster [DBG] pgmap v3226: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:24:37.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:24:37 smithi047 bash[22744]: cluster 2024-09-16T07:24:36.216891+0000 mgr.a (mgr.14373) 4654 : cluster [DBG] pgmap v3226: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:24:38.896 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:24:38.897 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:24:38.897 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:24:39.647 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:24:39.648 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:24:39.648 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:24:39.648 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:24:39.648 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:24:39.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:24:39 smithi157 bash[24585]: cluster 2024-09-16T07:24:38.219151+0000 mgr.a (mgr.14373) 4655 : cluster [DBG] pgmap v3227: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:24:39.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:24:39 smithi086 bash[24289]: cluster 2024-09-16T07:24:38.219151+0000 mgr.a (mgr.14373) 4655 : cluster [DBG] pgmap v3227: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:24:39.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:24:39 smithi047 bash[22744]: cluster 2024-09-16T07:24:38.219151+0000 mgr.a (mgr.14373) 4655 : cluster [DBG] pgmap v3227: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:24:40.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:24:40 smithi157 bash[24585]: audit 2024-09-16T07:24:39.231403+0000 mgr.a (mgr.14373) 4656 : audit [DBG] from='client.110553 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:24:40.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:24:40 smithi086 bash[24289]: audit 2024-09-16T07:24:39.231403+0000 mgr.a (mgr.14373) 4656 : audit [DBG] from='client.110553 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:24:40.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:24:40 smithi047 bash[22744]: audit 2024-09-16T07:24:39.231403+0000 mgr.a (mgr.14373) 4656 : audit [DBG] from='client.110553 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:24:41.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:24:41 smithi157 bash[24585]: cluster 2024-09-16T07:24:40.220126+0000 mgr.a (mgr.14373) 4657 : cluster [DBG] pgmap v3228: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:24:41.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:24:41 smithi086 bash[24289]: cluster 2024-09-16T07:24:40.220126+0000 mgr.a (mgr.14373) 4657 : cluster [DBG] pgmap v3228: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:24:41.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:24:41 smithi047 bash[22744]: cluster 2024-09-16T07:24:40.220126+0000 mgr.a (mgr.14373) 4657 : cluster [DBG] pgmap v3228: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:24:43.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:24:43 smithi157 bash[24585]: cluster 2024-09-16T07:24:42.222451+0000 mgr.a (mgr.14373) 4658 : cluster [DBG] pgmap v3229: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:24:43.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:24:43 smithi086 bash[24289]: cluster 2024-09-16T07:24:42.222451+0000 mgr.a (mgr.14373) 4658 : cluster [DBG] pgmap v3229: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:24:43.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:24:43 smithi047 bash[22744]: cluster 2024-09-16T07:24:42.222451+0000 mgr.a (mgr.14373) 4658 : cluster [DBG] pgmap v3229: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:24:44.649 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:24:44.650 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:24:44.650 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:24:45.432 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:24:45.432 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:24:45.432 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:24:45.432 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:24:45.432 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:24:45.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:24:45 smithi157 bash[24585]: cluster 2024-09-16T07:24:44.223187+0000 mgr.a (mgr.14373) 4659 : cluster [DBG] pgmap v3230: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:24:45.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:24:45 smithi086 bash[24289]: cluster 2024-09-16T07:24:44.223187+0000 mgr.a (mgr.14373) 4659 : cluster [DBG] pgmap v3230: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:24:45.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:24:45 smithi047 bash[22744]: cluster 2024-09-16T07:24:44.223187+0000 mgr.a (mgr.14373) 4659 : cluster [DBG] pgmap v3230: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:24:46.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:24:46 smithi157 bash[24585]: audit 2024-09-16T07:24:44.991347+0000 mgr.a (mgr.14373) 4660 : audit [DBG] from='client.110631 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:24:46.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:24:46 smithi086 bash[24289]: audit 2024-09-16T07:24:44.991347+0000 mgr.a (mgr.14373) 4660 : audit [DBG] from='client.110631 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:24:46.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:24:46 smithi047 bash[22744]: audit 2024-09-16T07:24:44.991347+0000 mgr.a (mgr.14373) 4660 : audit [DBG] from='client.110631 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:24:47.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:24:47 smithi157 bash[24585]: cluster 2024-09-16T07:24:46.224106+0000 mgr.a (mgr.14373) 4661 : cluster [DBG] pgmap v3231: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:24:47.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:24:47 smithi086 bash[24289]: cluster 2024-09-16T07:24:46.224106+0000 mgr.a (mgr.14373) 4661 : cluster [DBG] pgmap v3231: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:24:47.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:24:47 smithi047 bash[22744]: cluster 2024-09-16T07:24:46.224106+0000 mgr.a (mgr.14373) 4661 : cluster [DBG] pgmap v3231: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:24:49.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:24:49 smithi157 bash[24585]: cluster 2024-09-16T07:24:48.226406+0000 mgr.a (mgr.14373) 4662 : cluster [DBG] pgmap v3232: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:24:49.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:24:49 smithi086 bash[24289]: cluster 2024-09-16T07:24:48.226406+0000 mgr.a (mgr.14373) 4662 : cluster [DBG] pgmap v3232: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:24:49.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:24:49 smithi047 bash[22744]: cluster 2024-09-16T07:24:48.226406+0000 mgr.a (mgr.14373) 4662 : cluster [DBG] pgmap v3232: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:24:50.433 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:24:50.434 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:24:50.434 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:24:51.206 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:24:51.206 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:24:51.206 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:24:51.206 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:24:51.206 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:24:51.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:24:51 smithi157 bash[24585]: cluster 2024-09-16T07:24:50.227165+0000 mgr.a (mgr.14373) 4663 : cluster [DBG] pgmap v3233: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:24:51.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:24:51 smithi086 bash[24289]: cluster 2024-09-16T07:24:50.227165+0000 mgr.a (mgr.14373) 4663 : cluster [DBG] pgmap v3233: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:24:51.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:24:51 smithi047 bash[22744]: cluster 2024-09-16T07:24:50.227165+0000 mgr.a (mgr.14373) 4663 : cluster [DBG] pgmap v3233: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:24:52.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:24:52 smithi157 bash[24585]: audit 2024-09-16T07:24:50.773507+0000 mgr.a (mgr.14373) 4664 : audit [DBG] from='client.110706 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:24:52.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:24:52 smithi086 bash[24289]: audit 2024-09-16T07:24:50.773507+0000 mgr.a (mgr.14373) 4664 : audit [DBG] from='client.110706 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:24:52.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:24:52 smithi047 bash[22744]: audit 2024-09-16T07:24:50.773507+0000 mgr.a (mgr.14373) 4664 : audit [DBG] from='client.110706 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:24:53.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:24:53 smithi157 bash[24585]: cluster 2024-09-16T07:24:52.229609+0000 mgr.a (mgr.14373) 4665 : cluster [DBG] pgmap v3234: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:24:53.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:24:53 smithi086 bash[24289]: cluster 2024-09-16T07:24:52.229609+0000 mgr.a (mgr.14373) 4665 : cluster [DBG] pgmap v3234: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:24:53.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:24:53 smithi047 bash[22744]: cluster 2024-09-16T07:24:52.229609+0000 mgr.a (mgr.14373) 4665 : cluster [DBG] pgmap v3234: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:24:55.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:24:55 smithi157 bash[24585]: cluster 2024-09-16T07:24:54.230401+0000 mgr.a (mgr.14373) 4666 : cluster [DBG] pgmap v3235: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:24:55.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:24:55 smithi086 bash[24289]: cluster 2024-09-16T07:24:54.230401+0000 mgr.a (mgr.14373) 4666 : cluster [DBG] pgmap v3235: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:24:55.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:24:55 smithi047 bash[22744]: cluster 2024-09-16T07:24:54.230401+0000 mgr.a (mgr.14373) 4666 : cluster [DBG] pgmap v3235: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:24:56.207 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:24:56.208 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:24:56.208 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:24:56.952 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:24:56.952 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:24:56.952 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:24:56.953 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:24:56.953 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:24:57.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:24:57 smithi157 bash[24585]: cluster 2024-09-16T07:24:56.230938+0000 mgr.a (mgr.14373) 4667 : cluster [DBG] pgmap v3236: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:24:57.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:24:57 smithi157 bash[24585]: audit 2024-09-16T07:24:56.541904+0000 mgr.a (mgr.14373) 4668 : audit [DBG] from='client.110781 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:24:57.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:24:57 smithi086 bash[24289]: cluster 2024-09-16T07:24:56.230938+0000 mgr.a (mgr.14373) 4667 : cluster [DBG] pgmap v3236: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:24:57.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:24:57 smithi086 bash[24289]: audit 2024-09-16T07:24:56.541904+0000 mgr.a (mgr.14373) 4668 : audit [DBG] from='client.110781 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:24:57.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:24:57 smithi047 bash[22744]: cluster 2024-09-16T07:24:56.230938+0000 mgr.a (mgr.14373) 4667 : cluster [DBG] pgmap v3236: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:24:57.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:24:57 smithi047 bash[22744]: audit 2024-09-16T07:24:56.541904+0000 mgr.a (mgr.14373) 4668 : audit [DBG] from='client.110781 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:24:59.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:24:59 smithi157 bash[24585]: cluster 2024-09-16T07:24:58.233722+0000 mgr.a (mgr.14373) 4669 : cluster [DBG] pgmap v3237: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:24:59.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:24:59 smithi086 bash[24289]: cluster 2024-09-16T07:24:58.233722+0000 mgr.a (mgr.14373) 4669 : cluster [DBG] pgmap v3237: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:24:59.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:24:59 smithi047 bash[22744]: cluster 2024-09-16T07:24:58.233722+0000 mgr.a (mgr.14373) 4669 : cluster [DBG] pgmap v3237: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:25:01.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:25:01 smithi157 bash[24585]: cluster 2024-09-16T07:25:00.234531+0000 mgr.a (mgr.14373) 4670 : cluster [DBG] pgmap v3238: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:25:01.807 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:25:01 smithi086 bash[24289]: cluster 2024-09-16T07:25:00.234531+0000 mgr.a (mgr.14373) 4670 : cluster [DBG] pgmap v3238: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:25:01.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:25:01 smithi047 bash[22744]: cluster 2024-09-16T07:25:00.234531+0000 mgr.a (mgr.14373) 4670 : cluster [DBG] pgmap v3238: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:25:01.952 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:25:01.952 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:25:01.952 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:25:02.728 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:25:02.728 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:25:02.728 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:25:02.729 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:25:02.729 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:25:03.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:25:03 smithi157 bash[24585]: cluster 2024-09-16T07:25:02.236496+0000 mgr.a (mgr.14373) 4671 : cluster [DBG] pgmap v3239: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:25:03.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:25:03 smithi157 bash[24585]: audit 2024-09-16T07:25:02.295656+0000 mgr.a (mgr.14373) 4672 : audit [DBG] from='client.110859 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:25:03.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:25:03 smithi086 bash[24289]: cluster 2024-09-16T07:25:02.236496+0000 mgr.a (mgr.14373) 4671 : cluster [DBG] pgmap v3239: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:25:03.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:25:03 smithi086 bash[24289]: audit 2024-09-16T07:25:02.295656+0000 mgr.a (mgr.14373) 4672 : audit [DBG] from='client.110859 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:25:03.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:25:03 smithi047 bash[22744]: cluster 2024-09-16T07:25:02.236496+0000 mgr.a (mgr.14373) 4671 : cluster [DBG] pgmap v3239: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:25:03.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:25:03 smithi047 bash[22744]: audit 2024-09-16T07:25:02.295656+0000 mgr.a (mgr.14373) 4672 : audit [DBG] from='client.110859 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:25:05.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:25:05 smithi157 bash[24585]: cluster 2024-09-16T07:25:04.237447+0000 mgr.a (mgr.14373) 4673 : cluster [DBG] pgmap v3240: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:25:05.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:25:05 smithi086 bash[24289]: cluster 2024-09-16T07:25:04.237447+0000 mgr.a (mgr.14373) 4673 : cluster [DBG] pgmap v3240: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:25:05.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:25:05 smithi047 bash[22744]: cluster 2024-09-16T07:25:04.237447+0000 mgr.a (mgr.14373) 4673 : cluster [DBG] pgmap v3240: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:25:07.730 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:25:07.730 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:25:07.730 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:25:07.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:25:07 smithi157 bash[24585]: cluster 2024-09-16T07:25:06.238273+0000 mgr.a (mgr.14373) 4674 : cluster [DBG] pgmap v3241: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T07:25:07.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:25:07 smithi086 bash[24289]: cluster 2024-09-16T07:25:06.238273+0000 mgr.a (mgr.14373) 4674 : cluster [DBG] pgmap v3241: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T07:25:07.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:25:07 smithi047 bash[22744]: cluster 2024-09-16T07:25:06.238273+0000 mgr.a (mgr.14373) 4674 : cluster [DBG] pgmap v3241: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T07:25:08.490 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:25:08.490 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:25:08.490 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:25:08.490 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:25:08.490 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:25:09.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:25:09 smithi157 bash[24585]: audit 2024-09-16T07:25:08.065195+0000 mgr.a (mgr.14373) 4675 : audit [DBG] from='client.110937 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:25:09.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:25:09 smithi157 bash[24585]: cluster 2024-09-16T07:25:08.240120+0000 mgr.a (mgr.14373) 4676 : cluster [DBG] pgmap v3242: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:25:09.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:25:09 smithi086 bash[24289]: audit 2024-09-16T07:25:08.065195+0000 mgr.a (mgr.14373) 4675 : audit [DBG] from='client.110937 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:25:09.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:25:09 smithi086 bash[24289]: cluster 2024-09-16T07:25:08.240120+0000 mgr.a (mgr.14373) 4676 : cluster [DBG] pgmap v3242: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:25:09.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:25:09 smithi047 bash[22744]: audit 2024-09-16T07:25:08.065195+0000 mgr.a (mgr.14373) 4675 : audit [DBG] from='client.110937 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:25:09.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:25:09 smithi047 bash[22744]: cluster 2024-09-16T07:25:08.240120+0000 mgr.a (mgr.14373) 4676 : cluster [DBG] pgmap v3242: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:25:11.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:25:11 smithi157 bash[24585]: cluster 2024-09-16T07:25:10.241030+0000 mgr.a (mgr.14373) 4677 : cluster [DBG] pgmap v3243: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:25:11.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:25:11 smithi086 bash[24289]: cluster 2024-09-16T07:25:10.241030+0000 mgr.a (mgr.14373) 4677 : cluster [DBG] pgmap v3243: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:25:11.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:25:11 smithi047 bash[22744]: cluster 2024-09-16T07:25:10.241030+0000 mgr.a (mgr.14373) 4677 : cluster [DBG] pgmap v3243: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:25:13.491 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:25:13.492 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:25:13.492 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:25:13.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:25:13 smithi157 bash[24585]: cluster 2024-09-16T07:25:12.243333+0000 mgr.a (mgr.14373) 4678 : cluster [DBG] pgmap v3244: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:25:13.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:25:13 smithi086 bash[24289]: cluster 2024-09-16T07:25:12.243333+0000 mgr.a (mgr.14373) 4678 : cluster [DBG] pgmap v3244: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:25:13.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:25:13 smithi047 bash[22744]: cluster 2024-09-16T07:25:12.243333+0000 mgr.a (mgr.14373) 4678 : cluster [DBG] pgmap v3244: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:25:14.237 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:25:14.237 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:25:14.238 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:25:14.238 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:25:14.238 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:25:15.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:25:15 smithi157 bash[24585]: audit 2024-09-16T07:25:13.826296+0000 mgr.a (mgr.14373) 4679 : audit [DBG] from='client.111012 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:25:15.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:25:15 smithi157 bash[24585]: cluster 2024-09-16T07:25:14.244116+0000 mgr.a (mgr.14373) 4680 : cluster [DBG] pgmap v3245: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:25:15.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:25:15 smithi086 bash[24289]: audit 2024-09-16T07:25:13.826296+0000 mgr.a (mgr.14373) 4679 : audit [DBG] from='client.111012 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:25:15.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:25:15 smithi086 bash[24289]: cluster 2024-09-16T07:25:14.244116+0000 mgr.a (mgr.14373) 4680 : cluster [DBG] pgmap v3245: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:25:15.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:25:15 smithi047 bash[22744]: audit 2024-09-16T07:25:13.826296+0000 mgr.a (mgr.14373) 4679 : audit [DBG] from='client.111012 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:25:15.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:25:15 smithi047 bash[22744]: cluster 2024-09-16T07:25:14.244116+0000 mgr.a (mgr.14373) 4680 : cluster [DBG] pgmap v3245: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:25:17.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:25:17 smithi157 bash[24585]: cluster 2024-09-16T07:25:16.244879+0000 mgr.a (mgr.14373) 4681 : cluster [DBG] pgmap v3246: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:25:17.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:25:17 smithi086 bash[24289]: cluster 2024-09-16T07:25:16.244879+0000 mgr.a (mgr.14373) 4681 : cluster [DBG] pgmap v3246: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:25:17.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:25:17 smithi047 bash[22744]: cluster 2024-09-16T07:25:16.244879+0000 mgr.a (mgr.14373) 4681 : cluster [DBG] pgmap v3246: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:25:19.239 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:25:19.239 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:25:19.240 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:25:19.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:25:19 smithi157 bash[24585]: cluster 2024-09-16T07:25:18.247243+0000 mgr.a (mgr.14373) 4682 : cluster [DBG] pgmap v3247: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:25:19.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:25:19 smithi086 bash[24289]: cluster 2024-09-16T07:25:18.247243+0000 mgr.a (mgr.14373) 4682 : cluster [DBG] pgmap v3247: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:25:19.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:25:19 smithi047 bash[22744]: cluster 2024-09-16T07:25:18.247243+0000 mgr.a (mgr.14373) 4682 : cluster [DBG] pgmap v3247: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:25:20.014 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:25:20.015 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:25:20.015 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:25:20.015 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:25:20.015 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:25:20.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:25:20 smithi157 bash[24585]: audit 2024-09-16T07:25:19.579397+0000 mgr.a (mgr.14373) 4683 : audit [DBG] from='client.111090 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:25:20.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:25:20 smithi086 bash[24289]: audit 2024-09-16T07:25:19.579397+0000 mgr.a (mgr.14373) 4683 : audit [DBG] from='client.111090 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:25:20.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:25:20 smithi047 bash[22744]: audit 2024-09-16T07:25:19.579397+0000 mgr.a (mgr.14373) 4683 : audit [DBG] from='client.111090 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:25:21.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:25:21 smithi157 bash[24585]: cluster 2024-09-16T07:25:20.247806+0000 mgr.a (mgr.14373) 4684 : cluster [DBG] pgmap v3248: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:25:21.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:25:21 smithi086 bash[24289]: cluster 2024-09-16T07:25:20.247806+0000 mgr.a (mgr.14373) 4684 : cluster [DBG] pgmap v3248: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:25:21.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:25:21 smithi047 bash[22744]: cluster 2024-09-16T07:25:20.247806+0000 mgr.a (mgr.14373) 4684 : cluster [DBG] pgmap v3248: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:25:23.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:25:23 smithi157 bash[24585]: cluster 2024-09-16T07:25:22.250003+0000 mgr.a (mgr.14373) 4685 : cluster [DBG] pgmap v3249: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:25:23.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:25:23 smithi086 bash[24289]: cluster 2024-09-16T07:25:22.250003+0000 mgr.a (mgr.14373) 4685 : cluster [DBG] pgmap v3249: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:25:23.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:25:23 smithi047 bash[22744]: cluster 2024-09-16T07:25:22.250003+0000 mgr.a (mgr.14373) 4685 : cluster [DBG] pgmap v3249: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:25:25.016 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:25:25.017 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:25:25.017 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:25:25.788 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:25:25.789 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:25:25.789 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:25:25.789 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:25:25.789 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:25:25.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:25:25 smithi157 bash[24585]: cluster 2024-09-16T07:25:24.250795+0000 mgr.a (mgr.14373) 4686 : cluster [DBG] pgmap v3250: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:25:25.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:25:25 smithi086 bash[24289]: cluster 2024-09-16T07:25:24.250795+0000 mgr.a (mgr.14373) 4686 : cluster [DBG] pgmap v3250: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:25:25.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:25:25 smithi047 bash[22744]: cluster 2024-09-16T07:25:24.250795+0000 mgr.a (mgr.14373) 4686 : cluster [DBG] pgmap v3250: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:25:26.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:25:26 smithi157 bash[24585]: audit 2024-09-16T07:25:25.353692+0000 mgr.a (mgr.14373) 4687 : audit [DBG] from='client.111168 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:25:26.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:25:26 smithi157 bash[24585]: audit 2024-09-16T07:25:25.939791+0000 mon.b (mon.2) 462 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T07:25:26.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:25:26 smithi086 bash[24289]: audit 2024-09-16T07:25:25.353692+0000 mgr.a (mgr.14373) 4687 : audit [DBG] from='client.111168 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:25:26.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:25:26 smithi086 bash[24289]: audit 2024-09-16T07:25:25.939791+0000 mon.b (mon.2) 462 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T07:25:26.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:25:26 smithi047 bash[22744]: audit 2024-09-16T07:25:25.353692+0000 mgr.a (mgr.14373) 4687 : audit [DBG] from='client.111168 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:25:26.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:25:26 smithi047 bash[22744]: audit 2024-09-16T07:25:25.939791+0000 mon.b (mon.2) 462 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T07:25:27.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:25:27 smithi157 bash[24585]: cluster 2024-09-16T07:25:26.251700+0000 mgr.a (mgr.14373) 4688 : cluster [DBG] pgmap v3251: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:25:27.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:25:27 smithi157 bash[24585]: audit 2024-09-16T07:25:26.780494+0000 mon.b (mon.2) 463 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T07:25:27.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:25:27 smithi157 bash[24585]: audit 2024-09-16T07:25:26.782725+0000 mon.b (mon.2) 464 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T07:25:27.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:25:27 smithi157 bash[24585]: audit 2024-09-16T07:25:26.795962+0000 mon.a (mon.0) 848 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:25:27.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:25:27 smithi157 bash[24585]: audit 2024-09-16T07:25:26.799888+0000 mon.b (mon.2) 465 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:25:27.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:25:27 smithi086 bash[24289]: cluster 2024-09-16T07:25:26.251700+0000 mgr.a (mgr.14373) 4688 : cluster [DBG] pgmap v3251: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:25:27.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:25:27 smithi086 bash[24289]: audit 2024-09-16T07:25:26.780494+0000 mon.b (mon.2) 463 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T07:25:27.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:25:27 smithi086 bash[24289]: audit 2024-09-16T07:25:26.782725+0000 mon.b (mon.2) 464 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T07:25:27.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:25:27 smithi086 bash[24289]: audit 2024-09-16T07:25:26.795962+0000 mon.a (mon.0) 848 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:25:27.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:25:27 smithi086 bash[24289]: audit 2024-09-16T07:25:26.799888+0000 mon.b (mon.2) 465 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:25:27.838 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 07:25:27 smithi047 bash[22994]: debug 2024-09-16T07:25:27.511+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T07:25:27.839 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 07:25:27 smithi047 bash[22994]: debug 2024-09-16T07:25:27.515+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T07:25:27.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:25:27 smithi047 bash[22744]: cluster 2024-09-16T07:25:26.251700+0000 mgr.a (mgr.14373) 4688 : cluster [DBG] pgmap v3251: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:25:27.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:25:27 smithi047 bash[22744]: audit 2024-09-16T07:25:26.780494+0000 mon.b (mon.2) 463 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T07:25:27.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:25:27 smithi047 bash[22744]: audit 2024-09-16T07:25:26.782725+0000 mon.b (mon.2) 464 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T07:25:27.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:25:27 smithi047 bash[22744]: audit 2024-09-16T07:25:26.795962+0000 mon.a (mon.0) 848 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:25:27.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:25:27 smithi047 bash[22744]: audit 2024-09-16T07:25:26.799888+0000 mon.b (mon.2) 465 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:25:28.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:25:28 smithi157 bash[24585]: audit 2024-09-16T07:25:26.804084+0000 mgr.a (mgr.14373) 4689 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:25:28.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:25:28 smithi157 bash[24585]: audit 2024-09-16T07:25:27.517683+0000 mgr.a (mgr.14373) 4690 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T07:25:28.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:25:28 smithi157 bash[24585]: cephadm 2024-09-16T07:25:27.519610+0000 mgr.a (mgr.14373) 4691 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T07:25:28.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:25:28 smithi086 bash[24289]: audit 2024-09-16T07:25:26.804084+0000 mgr.a (mgr.14373) 4689 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:25:28.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:25:28 smithi086 bash[24289]: audit 2024-09-16T07:25:27.517683+0000 mgr.a (mgr.14373) 4690 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T07:25:28.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:25:28 smithi086 bash[24289]: cephadm 2024-09-16T07:25:27.519610+0000 mgr.a (mgr.14373) 4691 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T07:25:28.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:25:28 smithi047 bash[22744]: audit 2024-09-16T07:25:26.804084+0000 mgr.a (mgr.14373) 4689 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:25:28.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:25:28 smithi047 bash[22744]: audit 2024-09-16T07:25:27.517683+0000 mgr.a (mgr.14373) 4690 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T07:25:28.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:25:28 smithi047 bash[22744]: cephadm 2024-09-16T07:25:27.519610+0000 mgr.a (mgr.14373) 4691 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T07:25:29.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:25:29 smithi157 bash[24585]: cluster 2024-09-16T07:25:28.254499+0000 mgr.a (mgr.14373) 4692 : cluster [DBG] pgmap v3252: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:25:29.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:25:29 smithi086 bash[24289]: cluster 2024-09-16T07:25:28.254499+0000 mgr.a (mgr.14373) 4692 : cluster [DBG] pgmap v3252: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:25:29.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:25:29 smithi047 bash[22744]: cluster 2024-09-16T07:25:28.254499+0000 mgr.a (mgr.14373) 4692 : cluster [DBG] pgmap v3252: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:25:30.790 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:25:30.791 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:25:30.791 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:25:31.566 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:25:31.567 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:25:31.567 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:25:31.567 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:25:31.567 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:25:31.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:25:31 smithi086 bash[24289]: cluster 2024-09-16T07:25:30.255395+0000 mgr.a (mgr.14373) 4693 : cluster [DBG] pgmap v3253: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:25:31.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:25:31 smithi047 bash[22744]: cluster 2024-09-16T07:25:30.255395+0000 mgr.a (mgr.14373) 4693 : cluster [DBG] pgmap v3253: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:25:32.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:25:31 smithi157 bash[24585]: cluster 2024-09-16T07:25:30.255395+0000 mgr.a (mgr.14373) 4693 : cluster [DBG] pgmap v3253: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:25:32.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:25:32 smithi086 bash[24289]: audit 2024-09-16T07:25:31.128231+0000 mgr.a (mgr.14373) 4694 : audit [DBG] from='client.111348 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:25:32.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:25:32 smithi047 bash[22744]: audit 2024-09-16T07:25:31.128231+0000 mgr.a (mgr.14373) 4694 : audit [DBG] from='client.111348 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:25:33.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:25:32 smithi157 bash[24585]: audit 2024-09-16T07:25:31.128231+0000 mgr.a (mgr.14373) 4694 : audit [DBG] from='client.111348 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:25:33.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:25:33 smithi086 bash[24289]: cluster 2024-09-16T07:25:32.258241+0000 mgr.a (mgr.14373) 4695 : cluster [DBG] pgmap v3254: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:25:33.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:25:33 smithi047 bash[22744]: cluster 2024-09-16T07:25:32.258241+0000 mgr.a (mgr.14373) 4695 : cluster [DBG] pgmap v3254: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:25:34.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:25:33 smithi157 bash[24585]: cluster 2024-09-16T07:25:32.258241+0000 mgr.a (mgr.14373) 4695 : cluster [DBG] pgmap v3254: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:25:35.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:25:35 smithi047 bash[22744]: cluster 2024-09-16T07:25:34.258990+0000 mgr.a (mgr.14373) 4696 : cluster [DBG] pgmap v3255: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T07:25:36.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:25:35 smithi157 bash[24585]: cluster 2024-09-16T07:25:34.258990+0000 mgr.a (mgr.14373) 4696 : cluster [DBG] pgmap v3255: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T07:25:36.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:25:35 smithi086 bash[24289]: cluster 2024-09-16T07:25:34.258990+0000 mgr.a (mgr.14373) 4696 : cluster [DBG] pgmap v3255: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T07:25:36.568 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:25:36.570 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:25:36.570 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:25:37.315 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:25:37.315 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:25:37.315 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:25:37.315 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:25:37.315 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:25:37.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:25:37 smithi047 bash[22744]: cluster 2024-09-16T07:25:36.259741+0000 mgr.a (mgr.14373) 4697 : cluster [DBG] pgmap v3256: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T07:25:38.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:25:37 smithi157 bash[24585]: cluster 2024-09-16T07:25:36.259741+0000 mgr.a (mgr.14373) 4697 : cluster [DBG] pgmap v3256: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T07:25:38.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:25:37 smithi086 bash[24289]: cluster 2024-09-16T07:25:36.259741+0000 mgr.a (mgr.14373) 4697 : cluster [DBG] pgmap v3256: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T07:25:38.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:25:38 smithi047 bash[22744]: audit 2024-09-16T07:25:36.902553+0000 mgr.a (mgr.14373) 4698 : audit [DBG] from='client.111423 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:25:39.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:25:38 smithi157 bash[24585]: audit 2024-09-16T07:25:36.902553+0000 mgr.a (mgr.14373) 4698 : audit [DBG] from='client.111423 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:25:39.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:25:38 smithi086 bash[24289]: audit 2024-09-16T07:25:36.902553+0000 mgr.a (mgr.14373) 4698 : audit [DBG] from='client.111423 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:25:39.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:25:39 smithi047 bash[22744]: cluster 2024-09-16T07:25:38.262517+0000 mgr.a (mgr.14373) 4699 : cluster [DBG] pgmap v3257: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:25:40.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:25:39 smithi157 bash[24585]: cluster 2024-09-16T07:25:38.262517+0000 mgr.a (mgr.14373) 4699 : cluster [DBG] pgmap v3257: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:25:40.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:25:39 smithi086 bash[24289]: cluster 2024-09-16T07:25:38.262517+0000 mgr.a (mgr.14373) 4699 : cluster [DBG] pgmap v3257: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:25:42.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:25:41 smithi157 bash[24585]: cluster 2024-09-16T07:25:40.263294+0000 mgr.a (mgr.14373) 4700 : cluster [DBG] pgmap v3258: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T07:25:42.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:25:41 smithi086 bash[24289]: cluster 2024-09-16T07:25:40.263294+0000 mgr.a (mgr.14373) 4700 : cluster [DBG] pgmap v3258: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T07:25:42.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:25:41 smithi047 bash[22744]: cluster 2024-09-16T07:25:40.263294+0000 mgr.a (mgr.14373) 4700 : cluster [DBG] pgmap v3258: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T07:25:42.316 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:25:42.317 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:25:42.317 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:25:43.108 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:25:43.109 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:25:43.109 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:25:43.109 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:25:43.109 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:25:44.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:25:43 smithi157 bash[24585]: cluster 2024-09-16T07:25:42.265329+0000 mgr.a (mgr.14373) 4701 : cluster [DBG] pgmap v3259: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:25:44.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:25:43 smithi157 bash[24585]: audit 2024-09-16T07:25:42.657278+0000 mgr.a (mgr.14373) 4702 : audit [DBG] from='client.111501 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:25:44.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:25:43 smithi086 bash[24289]: cluster 2024-09-16T07:25:42.265329+0000 mgr.a (mgr.14373) 4701 : cluster [DBG] pgmap v3259: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:25:44.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:25:43 smithi086 bash[24289]: audit 2024-09-16T07:25:42.657278+0000 mgr.a (mgr.14373) 4702 : audit [DBG] from='client.111501 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:25:44.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:25:43 smithi047 bash[22744]: cluster 2024-09-16T07:25:42.265329+0000 mgr.a (mgr.14373) 4701 : cluster [DBG] pgmap v3259: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:25:44.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:25:43 smithi047 bash[22744]: audit 2024-09-16T07:25:42.657278+0000 mgr.a (mgr.14373) 4702 : audit [DBG] from='client.111501 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:25:46.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:25:45 smithi157 bash[24585]: cluster 2024-09-16T07:25:44.266380+0000 mgr.a (mgr.14373) 4703 : cluster [DBG] pgmap v3260: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-16T07:25:46.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:25:45 smithi086 bash[24289]: cluster 2024-09-16T07:25:44.266380+0000 mgr.a (mgr.14373) 4703 : cluster [DBG] pgmap v3260: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-16T07:25:46.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:25:45 smithi047 bash[22744]: cluster 2024-09-16T07:25:44.266380+0000 mgr.a (mgr.14373) 4703 : cluster [DBG] pgmap v3260: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-16T07:25:48.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:25:47 smithi157 bash[24585]: cluster 2024-09-16T07:25:46.267298+0000 mgr.a (mgr.14373) 4704 : cluster [DBG] pgmap v3261: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-16T07:25:48.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:25:47 smithi086 bash[24289]: cluster 2024-09-16T07:25:46.267298+0000 mgr.a (mgr.14373) 4704 : cluster [DBG] pgmap v3261: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-16T07:25:48.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:25:47 smithi047 bash[22744]: cluster 2024-09-16T07:25:46.267298+0000 mgr.a (mgr.14373) 4704 : cluster [DBG] pgmap v3261: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-16T07:25:48.109 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:25:48.111 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:25:48.111 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:25:48.850 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:25:48.850 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:25:48.850 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:25:48.850 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:25:48.850 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:25:50.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:25:49 smithi157 bash[24585]: cluster 2024-09-16T07:25:48.269265+0000 mgr.a (mgr.14373) 4705 : cluster [DBG] pgmap v3262: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-16T07:25:50.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:25:49 smithi157 bash[24585]: audit 2024-09-16T07:25:48.438245+0000 mgr.a (mgr.14373) 4706 : audit [DBG] from='client.111576 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:25:50.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:25:49 smithi086 bash[24289]: cluster 2024-09-16T07:25:48.269265+0000 mgr.a (mgr.14373) 4705 : cluster [DBG] pgmap v3262: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-16T07:25:50.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:25:49 smithi086 bash[24289]: audit 2024-09-16T07:25:48.438245+0000 mgr.a (mgr.14373) 4706 : audit [DBG] from='client.111576 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:25:50.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:25:49 smithi047 bash[22744]: cluster 2024-09-16T07:25:48.269265+0000 mgr.a (mgr.14373) 4705 : cluster [DBG] pgmap v3262: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-16T07:25:50.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:25:49 smithi047 bash[22744]: audit 2024-09-16T07:25:48.438245+0000 mgr.a (mgr.14373) 4706 : audit [DBG] from='client.111576 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:25:52.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:25:51 smithi157 bash[24585]: cluster 2024-09-16T07:25:50.270231+0000 mgr.a (mgr.14373) 4707 : cluster [DBG] pgmap v3263: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:25:52.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:25:51 smithi086 bash[24289]: cluster 2024-09-16T07:25:50.270231+0000 mgr.a (mgr.14373) 4707 : cluster [DBG] pgmap v3263: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:25:52.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:25:51 smithi047 bash[22744]: cluster 2024-09-16T07:25:50.270231+0000 mgr.a (mgr.14373) 4707 : cluster [DBG] pgmap v3263: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:25:53.851 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:25:53.852 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:25:53.852 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:25:54.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:25:53 smithi157 bash[24585]: cluster 2024-09-16T07:25:52.272524+0000 mgr.a (mgr.14373) 4708 : cluster [DBG] pgmap v3264: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:25:54.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:25:53 smithi086 bash[24289]: cluster 2024-09-16T07:25:52.272524+0000 mgr.a (mgr.14373) 4708 : cluster [DBG] pgmap v3264: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:25:54.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:25:53 smithi047 bash[22744]: cluster 2024-09-16T07:25:52.272524+0000 mgr.a (mgr.14373) 4708 : cluster [DBG] pgmap v3264: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:25:54.631 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:25:54.631 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:25:54.631 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:25:54.631 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:25:54.632 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:25:56.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:25:55 smithi157 bash[24585]: audit 2024-09-16T07:25:54.195593+0000 mgr.a (mgr.14373) 4709 : audit [DBG] from='client.111654 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:25:56.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:25:55 smithi157 bash[24585]: cluster 2024-09-16T07:25:54.273175+0000 mgr.a (mgr.14373) 4710 : cluster [DBG] pgmap v3265: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:25:56.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:25:55 smithi086 bash[24289]: audit 2024-09-16T07:25:54.195593+0000 mgr.a (mgr.14373) 4709 : audit [DBG] from='client.111654 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:25:56.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:25:55 smithi086 bash[24289]: cluster 2024-09-16T07:25:54.273175+0000 mgr.a (mgr.14373) 4710 : cluster [DBG] pgmap v3265: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:25:56.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:25:55 smithi047 bash[22744]: audit 2024-09-16T07:25:54.195593+0000 mgr.a (mgr.14373) 4709 : audit [DBG] from='client.111654 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:25:56.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:25:55 smithi047 bash[22744]: cluster 2024-09-16T07:25:54.273175+0000 mgr.a (mgr.14373) 4710 : cluster [DBG] pgmap v3265: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:25:58.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:25:57 smithi157 bash[24585]: cluster 2024-09-16T07:25:56.274077+0000 mgr.a (mgr.14373) 4711 : cluster [DBG] pgmap v3266: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:25:58.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:25:57 smithi086 bash[24289]: cluster 2024-09-16T07:25:56.274077+0000 mgr.a (mgr.14373) 4711 : cluster [DBG] pgmap v3266: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:25:58.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:25:57 smithi047 bash[22744]: cluster 2024-09-16T07:25:56.274077+0000 mgr.a (mgr.14373) 4711 : cluster [DBG] pgmap v3266: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:25:59.633 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:25:59.634 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:25:59.634 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:26:00.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:25:59 smithi157 bash[24585]: cluster 2024-09-16T07:25:58.276284+0000 mgr.a (mgr.14373) 4712 : cluster [DBG] pgmap v3267: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:26:00.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:25:59 smithi086 bash[24289]: cluster 2024-09-16T07:25:58.276284+0000 mgr.a (mgr.14373) 4712 : cluster [DBG] pgmap v3267: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:26:00.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:25:59 smithi047 bash[22744]: cluster 2024-09-16T07:25:58.276284+0000 mgr.a (mgr.14373) 4712 : cluster [DBG] pgmap v3267: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:26:00.415 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:26:00.416 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:26:00.416 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:26:00.416 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:26:00.416 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:26:02.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:26:01 smithi157 bash[24585]: audit 2024-09-16T07:25:59.977486+0000 mgr.a (mgr.14373) 4713 : audit [DBG] from='client.111729 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:26:02.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:26:01 smithi157 bash[24585]: cluster 2024-09-16T07:26:00.276923+0000 mgr.a (mgr.14373) 4714 : cluster [DBG] pgmap v3268: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:26:02.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:26:01 smithi086 bash[24289]: audit 2024-09-16T07:25:59.977486+0000 mgr.a (mgr.14373) 4713 : audit [DBG] from='client.111729 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:26:02.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:26:01 smithi086 bash[24289]: cluster 2024-09-16T07:26:00.276923+0000 mgr.a (mgr.14373) 4714 : cluster [DBG] pgmap v3268: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:26:02.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:26:01 smithi047 bash[22744]: audit 2024-09-16T07:25:59.977486+0000 mgr.a (mgr.14373) 4713 : audit [DBG] from='client.111729 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:26:02.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:26:01 smithi047 bash[22744]: cluster 2024-09-16T07:26:00.276923+0000 mgr.a (mgr.14373) 4714 : cluster [DBG] pgmap v3268: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:26:04.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:26:03 smithi157 bash[24585]: cluster 2024-09-16T07:26:02.279241+0000 mgr.a (mgr.14373) 4715 : cluster [DBG] pgmap v3269: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:26:04.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:26:03 smithi086 bash[24289]: cluster 2024-09-16T07:26:02.279241+0000 mgr.a (mgr.14373) 4715 : cluster [DBG] pgmap v3269: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:26:04.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:26:03 smithi047 bash[22744]: cluster 2024-09-16T07:26:02.279241+0000 mgr.a (mgr.14373) 4715 : cluster [DBG] pgmap v3269: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:26:05.417 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:26:05.418 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:26:05.418 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:26:06.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:26:05 smithi157 bash[24585]: cluster 2024-09-16T07:26:04.280018+0000 mgr.a (mgr.14373) 4716 : cluster [DBG] pgmap v3270: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:26:06.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:26:05 smithi086 bash[24289]: cluster 2024-09-16T07:26:04.280018+0000 mgr.a (mgr.14373) 4716 : cluster [DBG] pgmap v3270: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:26:06.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:26:05 smithi047 bash[22744]: cluster 2024-09-16T07:26:04.280018+0000 mgr.a (mgr.14373) 4716 : cluster [DBG] pgmap v3270: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:26:06.173 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:26:06.173 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:26:06.173 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:26:06.173 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:26:06.173 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:26:07.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:26:06 smithi157 bash[24585]: audit 2024-09-16T07:26:05.754887+0000 mgr.a (mgr.14373) 4717 : audit [DBG] from='client.111804 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:26:07.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:26:06 smithi086 bash[24289]: audit 2024-09-16T07:26:05.754887+0000 mgr.a (mgr.14373) 4717 : audit [DBG] from='client.111804 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:26:07.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:26:06 smithi047 bash[22744]: audit 2024-09-16T07:26:05.754887+0000 mgr.a (mgr.14373) 4717 : audit [DBG] from='client.111804 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:26:08.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:26:07 smithi157 bash[24585]: cluster 2024-09-16T07:26:06.280986+0000 mgr.a (mgr.14373) 4718 : cluster [DBG] pgmap v3271: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:26:08.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:26:07 smithi086 bash[24289]: cluster 2024-09-16T07:26:06.280986+0000 mgr.a (mgr.14373) 4718 : cluster [DBG] pgmap v3271: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:26:08.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:26:07 smithi047 bash[22744]: cluster 2024-09-16T07:26:06.280986+0000 mgr.a (mgr.14373) 4718 : cluster [DBG] pgmap v3271: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:26:10.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:26:09 smithi157 bash[24585]: cluster 2024-09-16T07:26:08.283413+0000 mgr.a (mgr.14373) 4719 : cluster [DBG] pgmap v3272: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:26:10.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:26:09 smithi086 bash[24289]: cluster 2024-09-16T07:26:08.283413+0000 mgr.a (mgr.14373) 4719 : cluster [DBG] pgmap v3272: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:26:10.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:26:09 smithi047 bash[22744]: cluster 2024-09-16T07:26:08.283413+0000 mgr.a (mgr.14373) 4719 : cluster [DBG] pgmap v3272: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:26:11.174 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:26:11.175 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:26:11.175 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:26:11.913 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:26:11.914 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:26:11.914 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:26:11.914 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:26:11.914 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:26:12.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:26:11 smithi157 bash[24585]: cluster 2024-09-16T07:26:10.284366+0000 mgr.a (mgr.14373) 4720 : cluster [DBG] pgmap v3273: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:26:12.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:26:11 smithi086 bash[24289]: cluster 2024-09-16T07:26:10.284366+0000 mgr.a (mgr.14373) 4720 : cluster [DBG] pgmap v3273: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:26:12.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:26:11 smithi047 bash[22744]: cluster 2024-09-16T07:26:10.284366+0000 mgr.a (mgr.14373) 4720 : cluster [DBG] pgmap v3273: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:26:13.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:26:12 smithi157 bash[24585]: audit 2024-09-16T07:26:11.509486+0000 mgr.a (mgr.14373) 4721 : audit [DBG] from='client.111879 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:26:13.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:26:12 smithi086 bash[24289]: audit 2024-09-16T07:26:11.509486+0000 mgr.a (mgr.14373) 4721 : audit [DBG] from='client.111879 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:26:13.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:26:12 smithi047 bash[22744]: audit 2024-09-16T07:26:11.509486+0000 mgr.a (mgr.14373) 4721 : audit [DBG] from='client.111879 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:26:14.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:26:13 smithi157 bash[24585]: cluster 2024-09-16T07:26:12.287171+0000 mgr.a (mgr.14373) 4722 : cluster [DBG] pgmap v3274: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:26:14.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:26:13 smithi086 bash[24289]: cluster 2024-09-16T07:26:12.287171+0000 mgr.a (mgr.14373) 4722 : cluster [DBG] pgmap v3274: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:26:14.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:26:13 smithi047 bash[22744]: cluster 2024-09-16T07:26:12.287171+0000 mgr.a (mgr.14373) 4722 : cluster [DBG] pgmap v3274: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:26:16.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:26:15 smithi157 bash[24585]: cluster 2024-09-16T07:26:14.287968+0000 mgr.a (mgr.14373) 4723 : cluster [DBG] pgmap v3275: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:26:16.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:26:15 smithi086 bash[24289]: cluster 2024-09-16T07:26:14.287968+0000 mgr.a (mgr.14373) 4723 : cluster [DBG] pgmap v3275: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:26:16.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:26:15 smithi047 bash[22744]: cluster 2024-09-16T07:26:14.287968+0000 mgr.a (mgr.14373) 4723 : cluster [DBG] pgmap v3275: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:26:16.915 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:26:16.916 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:26:16.916 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:26:17.671 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:26:17.671 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:26:17.671 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:26:17.671 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:26:17.671 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:26:18.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:26:17 smithi157 bash[24585]: cluster 2024-09-16T07:26:16.288739+0000 mgr.a (mgr.14373) 4724 : cluster [DBG] pgmap v3276: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:26:18.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:26:17 smithi086 bash[24289]: cluster 2024-09-16T07:26:16.288739+0000 mgr.a (mgr.14373) 4724 : cluster [DBG] pgmap v3276: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:26:18.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:26:17 smithi047 bash[22744]: cluster 2024-09-16T07:26:16.288739+0000 mgr.a (mgr.14373) 4724 : cluster [DBG] pgmap v3276: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:26:19.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:26:18 smithi157 bash[24585]: audit 2024-09-16T07:26:17.248835+0000 mgr.a (mgr.14373) 4725 : audit [DBG] from='client.111957 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:26:19.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:26:18 smithi086 bash[24289]: audit 2024-09-16T07:26:17.248835+0000 mgr.a (mgr.14373) 4725 : audit [DBG] from='client.111957 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:26:19.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:26:18 smithi047 bash[22744]: audit 2024-09-16T07:26:17.248835+0000 mgr.a (mgr.14373) 4725 : audit [DBG] from='client.111957 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:26:20.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:26:19 smithi157 bash[24585]: cluster 2024-09-16T07:26:18.291540+0000 mgr.a (mgr.14373) 4726 : cluster [DBG] pgmap v3277: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:26:20.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:26:19 smithi086 bash[24289]: cluster 2024-09-16T07:26:18.291540+0000 mgr.a (mgr.14373) 4726 : cluster [DBG] pgmap v3277: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:26:20.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:26:19 smithi047 bash[22744]: cluster 2024-09-16T07:26:18.291540+0000 mgr.a (mgr.14373) 4726 : cluster [DBG] pgmap v3277: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:26:22.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:26:21 smithi157 bash[24585]: cluster 2024-09-16T07:26:20.292336+0000 mgr.a (mgr.14373) 4727 : cluster [DBG] pgmap v3278: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:26:22.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:26:21 smithi086 bash[24289]: cluster 2024-09-16T07:26:20.292336+0000 mgr.a (mgr.14373) 4727 : cluster [DBG] pgmap v3278: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:26:22.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:26:21 smithi047 bash[22744]: cluster 2024-09-16T07:26:20.292336+0000 mgr.a (mgr.14373) 4727 : cluster [DBG] pgmap v3278: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:26:22.672 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:26:22.673 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:26:22.673 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:26:23.438 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:26:23.438 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:26:23.438 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:26:23.438 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:26:23.438 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:26:24.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:26:23 smithi157 bash[24585]: cluster 2024-09-16T07:26:22.294418+0000 mgr.a (mgr.14373) 4728 : cluster [DBG] pgmap v3279: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:26:24.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:26:23 smithi086 bash[24289]: cluster 2024-09-16T07:26:22.294418+0000 mgr.a (mgr.14373) 4728 : cluster [DBG] pgmap v3279: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:26:24.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:26:23 smithi047 bash[22744]: cluster 2024-09-16T07:26:22.294418+0000 mgr.a (mgr.14373) 4728 : cluster [DBG] pgmap v3279: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:26:25.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:26:24 smithi157 bash[24585]: audit 2024-09-16T07:26:23.010378+0000 mgr.a (mgr.14373) 4729 : audit [DBG] from='client.112032 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:26:25.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:26:24 smithi086 bash[24289]: audit 2024-09-16T07:26:23.010378+0000 mgr.a (mgr.14373) 4729 : audit [DBG] from='client.112032 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:26:25.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:26:24 smithi047 bash[22744]: audit 2024-09-16T07:26:23.010378+0000 mgr.a (mgr.14373) 4729 : audit [DBG] from='client.112032 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:26:26.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:26:25 smithi157 bash[24585]: cluster 2024-09-16T07:26:24.295332+0000 mgr.a (mgr.14373) 4730 : cluster [DBG] pgmap v3280: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:26:26.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:26:25 smithi086 bash[24289]: cluster 2024-09-16T07:26:24.295332+0000 mgr.a (mgr.14373) 4730 : cluster [DBG] pgmap v3280: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:26:26.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:26:25 smithi047 bash[22744]: cluster 2024-09-16T07:26:24.295332+0000 mgr.a (mgr.14373) 4730 : cluster [DBG] pgmap v3280: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:26:28.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:26:27 smithi157 bash[24585]: cluster 2024-09-16T07:26:26.296151+0000 mgr.a (mgr.14373) 4731 : cluster [DBG] pgmap v3281: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:26:28.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:26:27 smithi157 bash[24585]: audit 2024-09-16T07:26:27.570789+0000 mon.b (mon.2) 466 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T07:26:28.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:26:27 smithi086 bash[24289]: cluster 2024-09-16T07:26:26.296151+0000 mgr.a (mgr.14373) 4731 : cluster [DBG] pgmap v3281: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:26:28.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:26:27 smithi086 bash[24289]: audit 2024-09-16T07:26:27.570789+0000 mon.b (mon.2) 466 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T07:26:28.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:26:27 smithi047 bash[22744]: cluster 2024-09-16T07:26:26.296151+0000 mgr.a (mgr.14373) 4731 : cluster [DBG] pgmap v3281: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:26:28.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:26:27 smithi047 bash[22744]: audit 2024-09-16T07:26:27.570789+0000 mon.b (mon.2) 466 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T07:26:28.439 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:26:28.440 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:26:28.440 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:26:29.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:26:28 smithi157 bash[24585]: audit 2024-09-16T07:26:28.411407+0000 mon.b (mon.2) 467 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T07:26:29.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:26:28 smithi157 bash[24585]: audit 2024-09-16T07:26:28.413639+0000 mon.b (mon.2) 468 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T07:26:29.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:26:28 smithi157 bash[24585]: audit 2024-09-16T07:26:28.426429+0000 mon.a (mon.0) 849 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:26:29.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:26:28 smithi157 bash[24585]: audit 2024-09-16T07:26:28.431021+0000 mon.b (mon.2) 469 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:26:29.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:26:28 smithi086 bash[24289]: audit 2024-09-16T07:26:28.411407+0000 mon.b (mon.2) 467 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T07:26:29.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:26:28 smithi086 bash[24289]: audit 2024-09-16T07:26:28.413639+0000 mon.b (mon.2) 468 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T07:26:29.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:26:28 smithi086 bash[24289]: audit 2024-09-16T07:26:28.426429+0000 mon.a (mon.0) 849 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:26:29.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:26:28 smithi086 bash[24289]: audit 2024-09-16T07:26:28.431021+0000 mon.b (mon.2) 469 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:26:29.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:26:28 smithi047 bash[22744]: audit 2024-09-16T07:26:28.411407+0000 mon.b (mon.2) 467 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T07:26:29.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:26:28 smithi047 bash[22744]: audit 2024-09-16T07:26:28.413639+0000 mon.b (mon.2) 468 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T07:26:29.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:26:28 smithi047 bash[22744]: audit 2024-09-16T07:26:28.426429+0000 mon.a (mon.0) 849 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:26:29.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:26:28 smithi047 bash[22744]: audit 2024-09-16T07:26:28.431021+0000 mon.b (mon.2) 469 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:26:29.538 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:26:29.539 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:26:29.539 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:26:29.539 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:26:29.539 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:26:29.588 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 07:26:29 smithi047 bash[22994]: debug 2024-09-16T07:26:29.150+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T07:26:29.588 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 07:26:29 smithi047 bash[22994]: debug 2024-09-16T07:26:29.162+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T07:26:30.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:26:29 smithi157 bash[24585]: cluster 2024-09-16T07:26:28.297981+0000 mgr.a (mgr.14373) 4732 : cluster [DBG] pgmap v3282: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:26:30.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:26:29 smithi157 bash[24585]: audit 2024-09-16T07:26:28.434938+0000 mgr.a (mgr.14373) 4733 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:26:30.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:26:29 smithi086 bash[24289]: cluster 2024-09-16T07:26:28.297981+0000 mgr.a (mgr.14373) 4732 : cluster [DBG] pgmap v3282: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:26:30.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:26:29 smithi086 bash[24289]: audit 2024-09-16T07:26:28.434938+0000 mgr.a (mgr.14373) 4733 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:26:30.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:26:29 smithi047 bash[22744]: cluster 2024-09-16T07:26:28.297981+0000 mgr.a (mgr.14373) 4732 : cluster [DBG] pgmap v3282: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:26:30.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:26:29 smithi047 bash[22744]: audit 2024-09-16T07:26:28.434938+0000 mgr.a (mgr.14373) 4733 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:26:31.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:26:30 smithi157 bash[24585]: audit 2024-09-16T07:26:28.805476+0000 mgr.a (mgr.14373) 4734 : audit [DBG] from='client.112122 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:26:31.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:26:30 smithi157 bash[24585]: audit 2024-09-16T07:26:29.152404+0000 mgr.a (mgr.14373) 4735 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T07:26:31.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:26:30 smithi157 bash[24585]: cephadm 2024-09-16T07:26:29.163007+0000 mgr.a (mgr.14373) 4736 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T07:26:31.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:26:30 smithi086 bash[24289]: audit 2024-09-16T07:26:28.805476+0000 mgr.a (mgr.14373) 4734 : audit [DBG] from='client.112122 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:26:31.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:26:30 smithi086 bash[24289]: audit 2024-09-16T07:26:29.152404+0000 mgr.a (mgr.14373) 4735 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T07:26:31.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:26:30 smithi086 bash[24289]: cephadm 2024-09-16T07:26:29.163007+0000 mgr.a (mgr.14373) 4736 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T07:26:31.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:26:30 smithi047 bash[22744]: audit 2024-09-16T07:26:28.805476+0000 mgr.a (mgr.14373) 4734 : audit [DBG] from='client.112122 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:26:31.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:26:30 smithi047 bash[22744]: audit 2024-09-16T07:26:29.152404+0000 mgr.a (mgr.14373) 4735 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T07:26:31.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:26:30 smithi047 bash[22744]: cephadm 2024-09-16T07:26:29.163007+0000 mgr.a (mgr.14373) 4736 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T07:26:32.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:26:31 smithi157 bash[24585]: cluster 2024-09-16T07:26:30.298920+0000 mgr.a (mgr.14373) 4737 : cluster [DBG] pgmap v3283: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:26:32.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:26:31 smithi086 bash[24289]: cluster 2024-09-16T07:26:30.298920+0000 mgr.a (mgr.14373) 4737 : cluster [DBG] pgmap v3283: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:26:32.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:26:31 smithi047 bash[22744]: cluster 2024-09-16T07:26:30.298920+0000 mgr.a (mgr.14373) 4737 : cluster [DBG] pgmap v3283: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:26:34.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:26:33 smithi157 bash[24585]: cluster 2024-09-16T07:26:32.301152+0000 mgr.a (mgr.14373) 4738 : cluster [DBG] pgmap v3284: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:26:34.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:26:33 smithi086 bash[24289]: cluster 2024-09-16T07:26:32.301152+0000 mgr.a (mgr.14373) 4738 : cluster [DBG] pgmap v3284: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:26:34.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:26:33 smithi047 bash[22744]: cluster 2024-09-16T07:26:32.301152+0000 mgr.a (mgr.14373) 4738 : cluster [DBG] pgmap v3284: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:26:34.540 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:26:34.541 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:26:34.541 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:26:35.312 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:26:35.312 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:26:35.312 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:26:35.313 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:26:35.313 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:26:36.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:26:35 smithi157 bash[24585]: cluster 2024-09-16T07:26:34.301914+0000 mgr.a (mgr.14373) 4739 : cluster [DBG] pgmap v3285: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:26:36.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:26:35 smithi086 bash[24289]: cluster 2024-09-16T07:26:34.301914+0000 mgr.a (mgr.14373) 4739 : cluster [DBG] pgmap v3285: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:26:36.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:26:35 smithi047 bash[22744]: cluster 2024-09-16T07:26:34.301914+0000 mgr.a (mgr.14373) 4739 : cluster [DBG] pgmap v3285: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:26:37.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:26:36 smithi157 bash[24585]: audit 2024-09-16T07:26:34.885708+0000 mgr.a (mgr.14373) 4740 : audit [DBG] from='client.112287 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:26:37.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:26:36 smithi086 bash[24289]: audit 2024-09-16T07:26:34.885708+0000 mgr.a (mgr.14373) 4740 : audit [DBG] from='client.112287 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:26:37.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:26:36 smithi047 bash[22744]: audit 2024-09-16T07:26:34.885708+0000 mgr.a (mgr.14373) 4740 : audit [DBG] from='client.112287 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:26:38.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:26:37 smithi157 bash[24585]: cluster 2024-09-16T07:26:36.302828+0000 mgr.a (mgr.14373) 4741 : cluster [DBG] pgmap v3286: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:26:38.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:26:37 smithi086 bash[24289]: cluster 2024-09-16T07:26:36.302828+0000 mgr.a (mgr.14373) 4741 : cluster [DBG] pgmap v3286: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:26:38.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:26:37 smithi047 bash[22744]: cluster 2024-09-16T07:26:36.302828+0000 mgr.a (mgr.14373) 4741 : cluster [DBG] pgmap v3286: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:26:40.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:26:39 smithi157 bash[24585]: cluster 2024-09-16T07:26:38.305078+0000 mgr.a (mgr.14373) 4742 : cluster [DBG] pgmap v3287: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:26:40.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:26:39 smithi086 bash[24289]: cluster 2024-09-16T07:26:38.305078+0000 mgr.a (mgr.14373) 4742 : cluster [DBG] pgmap v3287: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:26:40.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:26:39 smithi047 bash[22744]: cluster 2024-09-16T07:26:38.305078+0000 mgr.a (mgr.14373) 4742 : cluster [DBG] pgmap v3287: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:26:40.314 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:26:40.314 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:26:40.314 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:26:41.083 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:26:41.084 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:26:41.084 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:26:41.084 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:26:41.084 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:26:42.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:26:41 smithi157 bash[24585]: cluster 2024-09-16T07:26:40.305863+0000 mgr.a (mgr.14373) 4743 : cluster [DBG] pgmap v3288: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:26:42.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:26:41 smithi157 bash[24585]: audit 2024-09-16T07:26:40.650840+0000 mgr.a (mgr.14373) 4744 : audit [DBG] from='client.112362 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:26:42.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:26:41 smithi086 bash[24289]: cluster 2024-09-16T07:26:40.305863+0000 mgr.a (mgr.14373) 4743 : cluster [DBG] pgmap v3288: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:26:42.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:26:41 smithi086 bash[24289]: audit 2024-09-16T07:26:40.650840+0000 mgr.a (mgr.14373) 4744 : audit [DBG] from='client.112362 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:26:42.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:26:41 smithi047 bash[22744]: cluster 2024-09-16T07:26:40.305863+0000 mgr.a (mgr.14373) 4743 : cluster [DBG] pgmap v3288: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:26:42.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:26:41 smithi047 bash[22744]: audit 2024-09-16T07:26:40.650840+0000 mgr.a (mgr.14373) 4744 : audit [DBG] from='client.112362 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:26:44.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:26:43 smithi157 bash[24585]: cluster 2024-09-16T07:26:42.308229+0000 mgr.a (mgr.14373) 4745 : cluster [DBG] pgmap v3289: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:26:44.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:26:43 smithi086 bash[24289]: cluster 2024-09-16T07:26:42.308229+0000 mgr.a (mgr.14373) 4745 : cluster [DBG] pgmap v3289: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:26:44.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:26:43 smithi047 bash[22744]: cluster 2024-09-16T07:26:42.308229+0000 mgr.a (mgr.14373) 4745 : cluster [DBG] pgmap v3289: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:26:46.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:26:45 smithi157 bash[24585]: cluster 2024-09-16T07:26:44.308976+0000 mgr.a (mgr.14373) 4746 : cluster [DBG] pgmap v3290: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:26:46.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:26:45 smithi086 bash[24289]: cluster 2024-09-16T07:26:44.308976+0000 mgr.a (mgr.14373) 4746 : cluster [DBG] pgmap v3290: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:26:46.085 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:26:46.086 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:26:46.086 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:26:46.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:26:45 smithi047 bash[22744]: cluster 2024-09-16T07:26:44.308976+0000 mgr.a (mgr.14373) 4746 : cluster [DBG] pgmap v3290: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:26:46.859 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:26:46.860 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:26:46.860 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:26:46.860 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:26:46.860 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:26:48.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:26:47 smithi157 bash[24585]: cluster 2024-09-16T07:26:46.309704+0000 mgr.a (mgr.14373) 4747 : cluster [DBG] pgmap v3291: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:26:48.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:26:47 smithi157 bash[24585]: audit 2024-09-16T07:26:46.423652+0000 mgr.a (mgr.14373) 4748 : audit [DBG] from='client.112440 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:26:48.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:26:47 smithi086 bash[24289]: cluster 2024-09-16T07:26:46.309704+0000 mgr.a (mgr.14373) 4747 : cluster [DBG] pgmap v3291: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:26:48.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:26:47 smithi086 bash[24289]: audit 2024-09-16T07:26:46.423652+0000 mgr.a (mgr.14373) 4748 : audit [DBG] from='client.112440 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:26:48.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:26:47 smithi047 bash[22744]: cluster 2024-09-16T07:26:46.309704+0000 mgr.a (mgr.14373) 4747 : cluster [DBG] pgmap v3291: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:26:48.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:26:47 smithi047 bash[22744]: audit 2024-09-16T07:26:46.423652+0000 mgr.a (mgr.14373) 4748 : audit [DBG] from='client.112440 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:26:50.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:26:49 smithi157 bash[24585]: cluster 2024-09-16T07:26:48.312412+0000 mgr.a (mgr.14373) 4749 : cluster [DBG] pgmap v3292: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:26:50.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:26:49 smithi086 bash[24289]: cluster 2024-09-16T07:26:48.312412+0000 mgr.a (mgr.14373) 4749 : cluster [DBG] pgmap v3292: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:26:50.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:26:49 smithi047 bash[22744]: cluster 2024-09-16T07:26:48.312412+0000 mgr.a (mgr.14373) 4749 : cluster [DBG] pgmap v3292: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:26:51.861 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:26:51.861 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:26:51.862 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:26:52.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:26:51 smithi157 bash[24585]: cluster 2024-09-16T07:26:50.313202+0000 mgr.a (mgr.14373) 4750 : cluster [DBG] pgmap v3293: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:26:52.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:26:51 smithi086 bash[24289]: cluster 2024-09-16T07:26:50.313202+0000 mgr.a (mgr.14373) 4750 : cluster [DBG] pgmap v3293: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:26:52.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:26:51 smithi047 bash[22744]: cluster 2024-09-16T07:26:50.313202+0000 mgr.a (mgr.14373) 4750 : cluster [DBG] pgmap v3293: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:26:52.614 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:26:52.614 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:26:52.614 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:26:52.614 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:26:52.615 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:26:54.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:26:53 smithi157 bash[24585]: audit 2024-09-16T07:26:52.195007+0000 mgr.a (mgr.14373) 4751 : audit [DBG] from='client.112515 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:26:54.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:26:53 smithi157 bash[24585]: cluster 2024-09-16T07:26:52.314693+0000 mgr.a (mgr.14373) 4752 : cluster [DBG] pgmap v3294: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:26:54.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:26:53 smithi086 bash[24289]: audit 2024-09-16T07:26:52.195007+0000 mgr.a (mgr.14373) 4751 : audit [DBG] from='client.112515 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:26:54.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:26:53 smithi086 bash[24289]: cluster 2024-09-16T07:26:52.314693+0000 mgr.a (mgr.14373) 4752 : cluster [DBG] pgmap v3294: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:26:54.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:26:53 smithi047 bash[22744]: audit 2024-09-16T07:26:52.195007+0000 mgr.a (mgr.14373) 4751 : audit [DBG] from='client.112515 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:26:54.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:26:53 smithi047 bash[22744]: cluster 2024-09-16T07:26:52.314693+0000 mgr.a (mgr.14373) 4752 : cluster [DBG] pgmap v3294: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:26:56.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:26:55 smithi157 bash[24585]: cluster 2024-09-16T07:26:54.315596+0000 mgr.a (mgr.14373) 4753 : cluster [DBG] pgmap v3295: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:26:56.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:26:55 smithi086 bash[24289]: cluster 2024-09-16T07:26:54.315596+0000 mgr.a (mgr.14373) 4753 : cluster [DBG] pgmap v3295: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:26:56.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:26:55 smithi047 bash[22744]: cluster 2024-09-16T07:26:54.315596+0000 mgr.a (mgr.14373) 4753 : cluster [DBG] pgmap v3295: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:26:57.616 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:26:57.616 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:26:57.616 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:26:58.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:26:57 smithi157 bash[24585]: cluster 2024-09-16T07:26:56.316397+0000 mgr.a (mgr.14373) 4754 : cluster [DBG] pgmap v3296: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T07:26:58.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:26:57 smithi086 bash[24289]: cluster 2024-09-16T07:26:56.316397+0000 mgr.a (mgr.14373) 4754 : cluster [DBG] pgmap v3296: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T07:26:58.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:26:57 smithi047 bash[22744]: cluster 2024-09-16T07:26:56.316397+0000 mgr.a (mgr.14373) 4754 : cluster [DBG] pgmap v3296: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T07:26:58.386 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:26:58.387 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:26:58.387 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:26:58.387 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:26:58.387 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:26:59.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:26:58 smithi157 bash[24585]: audit 2024-09-16T07:26:57.955871+0000 mgr.a (mgr.14373) 4755 : audit [DBG] from='client.112590 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:26:59.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:26:58 smithi157 bash[24585]: cluster 2024-09-16T07:26:58.318965+0000 mgr.a (mgr.14373) 4756 : cluster [DBG] pgmap v3297: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:26:59.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:26:58 smithi086 bash[24289]: audit 2024-09-16T07:26:57.955871+0000 mgr.a (mgr.14373) 4755 : audit [DBG] from='client.112590 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:26:59.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:26:58 smithi086 bash[24289]: cluster 2024-09-16T07:26:58.318965+0000 mgr.a (mgr.14373) 4756 : cluster [DBG] pgmap v3297: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:26:59.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:26:58 smithi047 bash[22744]: audit 2024-09-16T07:26:57.955871+0000 mgr.a (mgr.14373) 4755 : audit [DBG] from='client.112590 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:26:59.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:26:58 smithi047 bash[22744]: cluster 2024-09-16T07:26:58.318965+0000 mgr.a (mgr.14373) 4756 : cluster [DBG] pgmap v3297: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:27:01.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:27:01 smithi157 bash[24585]: cluster 2024-09-16T07:27:00.319718+0000 mgr.a (mgr.14373) 4757 : cluster [DBG] pgmap v3298: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:27:01.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:27:01 smithi086 bash[24289]: cluster 2024-09-16T07:27:00.319718+0000 mgr.a (mgr.14373) 4757 : cluster [DBG] pgmap v3298: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:27:01.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:27:01 smithi047 bash[22744]: cluster 2024-09-16T07:27:00.319718+0000 mgr.a (mgr.14373) 4757 : cluster [DBG] pgmap v3298: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:27:03.388 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:27:03.388 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:27:03.388 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:27:03.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:27:03 smithi157 bash[24585]: cluster 2024-09-16T07:27:02.321743+0000 mgr.a (mgr.14373) 4758 : cluster [DBG] pgmap v3299: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:27:03.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:27:03 smithi086 bash[24289]: cluster 2024-09-16T07:27:02.321743+0000 mgr.a (mgr.14373) 4758 : cluster [DBG] pgmap v3299: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:27:03.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:27:03 smithi047 bash[22744]: cluster 2024-09-16T07:27:02.321743+0000 mgr.a (mgr.14373) 4758 : cluster [DBG] pgmap v3299: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:27:04.145 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:27:04.145 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:27:04.145 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:27:04.145 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:27:04.145 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:27:04.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:27:04 smithi157 bash[24585]: audit 2024-09-16T07:27:03.725567+0000 mgr.a (mgr.14373) 4759 : audit [DBG] from='client.112668 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:27:04.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:27:04 smithi086 bash[24289]: audit 2024-09-16T07:27:03.725567+0000 mgr.a (mgr.14373) 4759 : audit [DBG] from='client.112668 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:27:04.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:27:04 smithi047 bash[22744]: audit 2024-09-16T07:27:03.725567+0000 mgr.a (mgr.14373) 4759 : audit [DBG] from='client.112668 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:27:05.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:27:05 smithi157 bash[24585]: cluster 2024-09-16T07:27:04.322669+0000 mgr.a (mgr.14373) 4760 : cluster [DBG] pgmap v3300: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:27:05.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:27:05 smithi086 bash[24289]: cluster 2024-09-16T07:27:04.322669+0000 mgr.a (mgr.14373) 4760 : cluster [DBG] pgmap v3300: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:27:05.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:27:05 smithi047 bash[22744]: cluster 2024-09-16T07:27:04.322669+0000 mgr.a (mgr.14373) 4760 : cluster [DBG] pgmap v3300: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:27:07.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:27:07 smithi157 bash[24585]: cluster 2024-09-16T07:27:06.323432+0000 mgr.a (mgr.14373) 4761 : cluster [DBG] pgmap v3301: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:27:07.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:27:07 smithi086 bash[24289]: cluster 2024-09-16T07:27:06.323432+0000 mgr.a (mgr.14373) 4761 : cluster [DBG] pgmap v3301: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:27:07.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:27:07 smithi047 bash[22744]: cluster 2024-09-16T07:27:06.323432+0000 mgr.a (mgr.14373) 4761 : cluster [DBG] pgmap v3301: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:27:09.147 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:27:09.147 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:27:09.148 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:27:09.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:27:09 smithi157 bash[24585]: cluster 2024-09-16T07:27:08.325613+0000 mgr.a (mgr.14373) 4762 : cluster [DBG] pgmap v3302: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:27:09.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:27:09 smithi086 bash[24289]: cluster 2024-09-16T07:27:08.325613+0000 mgr.a (mgr.14373) 4762 : cluster [DBG] pgmap v3302: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:27:09.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:27:09 smithi047 bash[22744]: cluster 2024-09-16T07:27:08.325613+0000 mgr.a (mgr.14373) 4762 : cluster [DBG] pgmap v3302: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:27:09.919 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:27:09.919 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:27:09.919 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:27:09.920 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:27:09.920 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:27:10.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:27:10 smithi157 bash[24585]: audit 2024-09-16T07:27:09.484506+0000 mgr.a (mgr.14373) 4763 : audit [DBG] from='client.112746 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:27:10.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:27:10 smithi086 bash[24289]: audit 2024-09-16T07:27:09.484506+0000 mgr.a (mgr.14373) 4763 : audit [DBG] from='client.112746 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:27:10.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:27:10 smithi047 bash[22744]: audit 2024-09-16T07:27:09.484506+0000 mgr.a (mgr.14373) 4763 : audit [DBG] from='client.112746 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:27:11.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:27:11 smithi157 bash[24585]: cluster 2024-09-16T07:27:10.326530+0000 mgr.a (mgr.14373) 4764 : cluster [DBG] pgmap v3303: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:27:11.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:27:11 smithi086 bash[24289]: cluster 2024-09-16T07:27:10.326530+0000 mgr.a (mgr.14373) 4764 : cluster [DBG] pgmap v3303: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:27:11.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:27:11 smithi047 bash[22744]: cluster 2024-09-16T07:27:10.326530+0000 mgr.a (mgr.14373) 4764 : cluster [DBG] pgmap v3303: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:27:13.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:27:13 smithi157 bash[24585]: cluster 2024-09-16T07:27:12.328799+0000 mgr.a (mgr.14373) 4765 : cluster [DBG] pgmap v3304: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:27:13.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:27:13 smithi086 bash[24289]: cluster 2024-09-16T07:27:12.328799+0000 mgr.a (mgr.14373) 4765 : cluster [DBG] pgmap v3304: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:27:13.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:27:13 smithi047 bash[22744]: cluster 2024-09-16T07:27:12.328799+0000 mgr.a (mgr.14373) 4765 : cluster [DBG] pgmap v3304: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:27:14.921 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:27:14.922 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:27:14.922 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:27:15.702 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:27:15.702 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:27:15.702 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:27:15.702 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:27:15.702 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:27:15.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:27:15 smithi157 bash[24585]: cluster 2024-09-16T07:27:14.329605+0000 mgr.a (mgr.14373) 4766 : cluster [DBG] pgmap v3305: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:27:15.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:27:15 smithi086 bash[24289]: cluster 2024-09-16T07:27:14.329605+0000 mgr.a (mgr.14373) 4766 : cluster [DBG] pgmap v3305: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:27:15.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:27:15 smithi047 bash[22744]: cluster 2024-09-16T07:27:14.329605+0000 mgr.a (mgr.14373) 4766 : cluster [DBG] pgmap v3305: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:27:16.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:27:16 smithi157 bash[24585]: audit 2024-09-16T07:27:15.256196+0000 mgr.a (mgr.14373) 4767 : audit [DBG] from='client.112824 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:27:16.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:27:16 smithi086 bash[24289]: audit 2024-09-16T07:27:15.256196+0000 mgr.a (mgr.14373) 4767 : audit [DBG] from='client.112824 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:27:16.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:27:16 smithi047 bash[22744]: audit 2024-09-16T07:27:15.256196+0000 mgr.a (mgr.14373) 4767 : audit [DBG] from='client.112824 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:27:17.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:27:17 smithi157 bash[24585]: cluster 2024-09-16T07:27:16.330550+0000 mgr.a (mgr.14373) 4768 : cluster [DBG] pgmap v3306: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:27:17.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:27:17 smithi086 bash[24289]: cluster 2024-09-16T07:27:16.330550+0000 mgr.a (mgr.14373) 4768 : cluster [DBG] pgmap v3306: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:27:17.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:27:17 smithi047 bash[22744]: cluster 2024-09-16T07:27:16.330550+0000 mgr.a (mgr.14373) 4768 : cluster [DBG] pgmap v3306: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:27:19.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:27:19 smithi157 bash[24585]: cluster 2024-09-16T07:27:18.332769+0000 mgr.a (mgr.14373) 4769 : cluster [DBG] pgmap v3307: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:27:19.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:27:19 smithi086 bash[24289]: cluster 2024-09-16T07:27:18.332769+0000 mgr.a (mgr.14373) 4769 : cluster [DBG] pgmap v3307: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:27:19.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:27:19 smithi047 bash[22744]: cluster 2024-09-16T07:27:18.332769+0000 mgr.a (mgr.14373) 4769 : cluster [DBG] pgmap v3307: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:27:20.703 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:27:20.704 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:27:20.704 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:27:21.450 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:27:21.450 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:27:21.451 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:27:21.451 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:27:21.451 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:27:21.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:27:21 smithi157 bash[24585]: cluster 2024-09-16T07:27:20.333532+0000 mgr.a (mgr.14373) 4770 : cluster [DBG] pgmap v3308: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:27:21.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:27:21 smithi086 bash[24289]: cluster 2024-09-16T07:27:20.333532+0000 mgr.a (mgr.14373) 4770 : cluster [DBG] pgmap v3308: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:27:21.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:27:21 smithi047 bash[22744]: cluster 2024-09-16T07:27:20.333532+0000 mgr.a (mgr.14373) 4770 : cluster [DBG] pgmap v3308: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:27:22.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:27:22 smithi157 bash[24585]: audit 2024-09-16T07:27:21.035603+0000 mgr.a (mgr.14373) 4771 : audit [DBG] from='client.112902 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:27:22.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:27:22 smithi086 bash[24289]: audit 2024-09-16T07:27:21.035603+0000 mgr.a (mgr.14373) 4771 : audit [DBG] from='client.112902 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:27:22.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:27:22 smithi047 bash[22744]: audit 2024-09-16T07:27:21.035603+0000 mgr.a (mgr.14373) 4771 : audit [DBG] from='client.112902 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:27:23.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:27:23 smithi157 bash[24585]: cluster 2024-09-16T07:27:22.336000+0000 mgr.a (mgr.14373) 4772 : cluster [DBG] pgmap v3309: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-16T07:27:23.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:27:23 smithi086 bash[24289]: cluster 2024-09-16T07:27:22.336000+0000 mgr.a (mgr.14373) 4772 : cluster [DBG] pgmap v3309: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-16T07:27:23.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:27:23 smithi047 bash[22744]: cluster 2024-09-16T07:27:22.336000+0000 mgr.a (mgr.14373) 4772 : cluster [DBG] pgmap v3309: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-16T07:27:25.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:27:25 smithi157 bash[24585]: cluster 2024-09-16T07:27:24.336779+0000 mgr.a (mgr.14373) 4773 : cluster [DBG] pgmap v3310: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T07:27:25.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:27:25 smithi086 bash[24289]: cluster 2024-09-16T07:27:24.336779+0000 mgr.a (mgr.14373) 4773 : cluster [DBG] pgmap v3310: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T07:27:25.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:27:25 smithi047 bash[22744]: cluster 2024-09-16T07:27:24.336779+0000 mgr.a (mgr.14373) 4773 : cluster [DBG] pgmap v3310: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T07:27:26.451 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:27:26.452 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:27:26.453 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:27:27.219 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:27:27.219 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:27:27.219 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:27:27.219 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:27:27.220 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:27:27.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:27:27 smithi157 bash[24585]: cluster 2024-09-16T07:27:26.337536+0000 mgr.a (mgr.14373) 4774 : cluster [DBG] pgmap v3311: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T07:27:27.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:27:27 smithi157 bash[24585]: audit 2024-09-16T07:27:26.789190+0000 mgr.a (mgr.14373) 4775 : audit [DBG] from='client.112980 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:27:27.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:27:27 smithi086 bash[24289]: cluster 2024-09-16T07:27:26.337536+0000 mgr.a (mgr.14373) 4774 : cluster [DBG] pgmap v3311: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T07:27:27.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:27:27 smithi086 bash[24289]: audit 2024-09-16T07:27:26.789190+0000 mgr.a (mgr.14373) 4775 : audit [DBG] from='client.112980 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:27:27.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:27:27 smithi047 bash[22744]: cluster 2024-09-16T07:27:26.337536+0000 mgr.a (mgr.14373) 4774 : cluster [DBG] pgmap v3311: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T07:27:27.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:27:27 smithi047 bash[22744]: audit 2024-09-16T07:27:26.789190+0000 mgr.a (mgr.14373) 4775 : audit [DBG] from='client.112980 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:27:29.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:27:29 smithi157 bash[24585]: cluster 2024-09-16T07:27:28.340225+0000 mgr.a (mgr.14373) 4776 : cluster [DBG] pgmap v3312: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:27:29.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:27:29 smithi157 bash[24585]: audit 2024-09-16T07:27:29.213977+0000 mon.b (mon.2) 470 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T07:27:29.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:27:29 smithi086 bash[24289]: cluster 2024-09-16T07:27:28.340225+0000 mgr.a (mgr.14373) 4776 : cluster [DBG] pgmap v3312: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:27:29.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:27:29 smithi086 bash[24289]: audit 2024-09-16T07:27:29.213977+0000 mon.b (mon.2) 470 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T07:27:29.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:27:29 smithi047 bash[22744]: cluster 2024-09-16T07:27:28.340225+0000 mgr.a (mgr.14373) 4776 : cluster [DBG] pgmap v3312: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:27:29.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:27:29 smithi047 bash[22744]: audit 2024-09-16T07:27:29.213977+0000 mon.b (mon.2) 470 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T07:27:31.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:27:30 smithi157 bash[24585]: audit 2024-09-16T07:27:29.841994+0000 mon.a (mon.0) 850 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:27:31.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:27:30 smithi157 bash[24585]: audit 2024-09-16T07:27:29.847214+0000 mon.a (mon.0) 851 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:27:31.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:27:30 smithi157 bash[24585]: cluster 2024-09-16T07:27:30.340952+0000 mgr.a (mgr.14373) 4777 : cluster [DBG] pgmap v3313: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:27:31.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:27:30 smithi157 bash[24585]: audit 2024-09-16T07:27:30.579404+0000 mon.b (mon.2) 471 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T07:27:31.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:27:30 smithi157 bash[24585]: audit 2024-09-16T07:27:30.581571+0000 mon.b (mon.2) 472 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T07:27:31.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:27:30 smithi157 bash[24585]: audit 2024-09-16T07:27:30.593541+0000 mon.a (mon.0) 852 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:27:31.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:27:30 smithi157 bash[24585]: audit 2024-09-16T07:27:30.596125+0000 mon.b (mon.2) 473 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:27:31.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:27:30 smithi157 bash[24585]: audit 2024-09-16T07:27:30.600019+0000 mgr.a (mgr.14373) 4778 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:27:31.308 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:27:30 smithi047 bash[22744]: audit 2024-09-16T07:27:29.841994+0000 mon.a (mon.0) 850 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:27:31.309 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:27:30 smithi047 bash[22744]: audit 2024-09-16T07:27:29.847214+0000 mon.a (mon.0) 851 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:27:31.309 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:27:30 smithi047 bash[22744]: cluster 2024-09-16T07:27:30.340952+0000 mgr.a (mgr.14373) 4777 : cluster [DBG] pgmap v3313: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:27:31.309 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:27:30 smithi047 bash[22744]: audit 2024-09-16T07:27:30.579404+0000 mon.b (mon.2) 471 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T07:27:31.309 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:27:30 smithi047 bash[22744]: audit 2024-09-16T07:27:30.581571+0000 mon.b (mon.2) 472 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T07:27:31.309 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:27:30 smithi047 bash[22744]: audit 2024-09-16T07:27:30.593541+0000 mon.a (mon.0) 852 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:27:31.309 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:27:30 smithi047 bash[22744]: audit 2024-09-16T07:27:30.596125+0000 mon.b (mon.2) 473 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:27:31.309 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:27:30 smithi047 bash[22744]: audit 2024-09-16T07:27:30.600019+0000 mgr.a (mgr.14373) 4778 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:27:31.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:27:30 smithi086 bash[24289]: audit 2024-09-16T07:27:29.841994+0000 mon.a (mon.0) 850 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:27:31.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:27:30 smithi086 bash[24289]: audit 2024-09-16T07:27:29.847214+0000 mon.a (mon.0) 851 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:27:31.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:27:30 smithi086 bash[24289]: cluster 2024-09-16T07:27:30.340952+0000 mgr.a (mgr.14373) 4777 : cluster [DBG] pgmap v3313: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:27:31.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:27:30 smithi086 bash[24289]: audit 2024-09-16T07:27:30.579404+0000 mon.b (mon.2) 471 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T07:27:31.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:27:30 smithi086 bash[24289]: audit 2024-09-16T07:27:30.581571+0000 mon.b (mon.2) 472 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T07:27:31.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:27:30 smithi086 bash[24289]: audit 2024-09-16T07:27:30.593541+0000 mon.a (mon.0) 852 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:27:31.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:27:30 smithi086 bash[24289]: audit 2024-09-16T07:27:30.596125+0000 mon.b (mon.2) 473 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:27:31.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:27:30 smithi086 bash[24289]: audit 2024-09-16T07:27:30.600019+0000 mgr.a (mgr.14373) 4778 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:27:31.589 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 07:27:31 smithi047 bash[22994]: debug 2024-09-16T07:27:31.308+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T07:27:31.589 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 07:27:31 smithi047 bash[22994]: debug 2024-09-16T07:27:31.308+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T07:27:32.221 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:27:32.221 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:27:32.222 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:27:32.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:27:31 smithi157 bash[24585]: audit 2024-09-16T07:27:31.311384+0000 mgr.a (mgr.14373) 4779 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T07:27:32.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:27:31 smithi157 bash[24585]: cephadm 2024-09-16T07:27:31.313799+0000 mgr.a (mgr.14373) 4780 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T07:27:32.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:27:31 smithi086 bash[24289]: audit 2024-09-16T07:27:31.311384+0000 mgr.a (mgr.14373) 4779 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T07:27:32.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:27:31 smithi086 bash[24289]: cephadm 2024-09-16T07:27:31.313799+0000 mgr.a (mgr.14373) 4780 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T07:27:32.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:27:31 smithi047 bash[22744]: audit 2024-09-16T07:27:31.311384+0000 mgr.a (mgr.14373) 4779 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T07:27:32.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:27:31 smithi047 bash[22744]: cephadm 2024-09-16T07:27:31.313799+0000 mgr.a (mgr.14373) 4780 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T07:27:32.967 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:27:32.967 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:27:32.967 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:27:32.968 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:27:32.968 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:27:33.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:27:32 smithi157 bash[24585]: cluster 2024-09-16T07:27:32.342095+0000 mgr.a (mgr.14373) 4781 : cluster [DBG] pgmap v3314: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:27:33.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:27:32 smithi157 bash[24585]: audit 2024-09-16T07:27:32.551933+0000 mgr.a (mgr.14373) 4782 : audit [DBG] from='client.113166 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:27:33.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:27:32 smithi086 bash[24289]: cluster 2024-09-16T07:27:32.342095+0000 mgr.a (mgr.14373) 4781 : cluster [DBG] pgmap v3314: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:27:33.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:27:32 smithi086 bash[24289]: audit 2024-09-16T07:27:32.551933+0000 mgr.a (mgr.14373) 4782 : audit [DBG] from='client.113166 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:27:33.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:27:32 smithi047 bash[22744]: cluster 2024-09-16T07:27:32.342095+0000 mgr.a (mgr.14373) 4781 : cluster [DBG] pgmap v3314: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:27:33.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:27:32 smithi047 bash[22744]: audit 2024-09-16T07:27:32.551933+0000 mgr.a (mgr.14373) 4782 : audit [DBG] from='client.113166 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:27:35.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:27:35 smithi157 bash[24585]: cluster 2024-09-16T07:27:34.343004+0000 mgr.a (mgr.14373) 4783 : cluster [DBG] pgmap v3315: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T07:27:35.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:27:35 smithi086 bash[24289]: cluster 2024-09-16T07:27:34.343004+0000 mgr.a (mgr.14373) 4783 : cluster [DBG] pgmap v3315: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T07:27:35.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:27:35 smithi047 bash[22744]: cluster 2024-09-16T07:27:34.343004+0000 mgr.a (mgr.14373) 4783 : cluster [DBG] pgmap v3315: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T07:27:37.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:27:37 smithi157 bash[24585]: cluster 2024-09-16T07:27:36.343778+0000 mgr.a (mgr.14373) 4784 : cluster [DBG] pgmap v3316: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T07:27:37.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:27:37 smithi086 bash[24289]: cluster 2024-09-16T07:27:36.343778+0000 mgr.a (mgr.14373) 4784 : cluster [DBG] pgmap v3316: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T07:27:37.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:27:37 smithi047 bash[22744]: cluster 2024-09-16T07:27:36.343778+0000 mgr.a (mgr.14373) 4784 : cluster [DBG] pgmap v3316: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T07:27:37.969 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:27:37.970 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:27:37.970 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:27:38.718 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:27:38.719 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:27:38.719 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:27:38.719 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:27:38.719 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:27:39.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:27:39 smithi157 bash[24585]: audit 2024-09-16T07:27:38.303590+0000 mgr.a (mgr.14373) 4785 : audit [DBG] from='client.113244 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:27:39.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:27:39 smithi157 bash[24585]: cluster 2024-09-16T07:27:38.346730+0000 mgr.a (mgr.14373) 4786 : cluster [DBG] pgmap v3317: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.4 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:27:39.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:27:39 smithi086 bash[24289]: audit 2024-09-16T07:27:38.303590+0000 mgr.a (mgr.14373) 4785 : audit [DBG] from='client.113244 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:27:39.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:27:39 smithi086 bash[24289]: cluster 2024-09-16T07:27:38.346730+0000 mgr.a (mgr.14373) 4786 : cluster [DBG] pgmap v3317: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.4 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:27:39.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:27:39 smithi047 bash[22744]: audit 2024-09-16T07:27:38.303590+0000 mgr.a (mgr.14373) 4785 : audit [DBG] from='client.113244 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:27:39.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:27:39 smithi047 bash[22744]: cluster 2024-09-16T07:27:38.346730+0000 mgr.a (mgr.14373) 4786 : cluster [DBG] pgmap v3317: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.4 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:27:41.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:27:41 smithi157 bash[24585]: cluster 2024-09-16T07:27:40.347700+0000 mgr.a (mgr.14373) 4787 : cluster [DBG] pgmap v3318: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:27:41.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:27:41 smithi086 bash[24289]: cluster 2024-09-16T07:27:40.347700+0000 mgr.a (mgr.14373) 4787 : cluster [DBG] pgmap v3318: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:27:41.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:27:41 smithi047 bash[22744]: cluster 2024-09-16T07:27:40.347700+0000 mgr.a (mgr.14373) 4787 : cluster [DBG] pgmap v3318: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:27:43.720 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:27:43.721 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:27:43.721 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:27:43.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:27:43 smithi157 bash[24585]: cluster 2024-09-16T07:27:42.349890+0000 mgr.a (mgr.14373) 4788 : cluster [DBG] pgmap v3319: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:27:43.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:27:43 smithi086 bash[24289]: cluster 2024-09-16T07:27:42.349890+0000 mgr.a (mgr.14373) 4788 : cluster [DBG] pgmap v3319: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:27:43.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:27:43 smithi047 bash[22744]: cluster 2024-09-16T07:27:42.349890+0000 mgr.a (mgr.14373) 4788 : cluster [DBG] pgmap v3319: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:27:44.477 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:27:44.477 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:27:44.477 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:27:44.477 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:27:44.477 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:27:45.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:27:45 smithi157 bash[24585]: audit 2024-09-16T07:27:44.054123+0000 mgr.a (mgr.14373) 4789 : audit [DBG] from='client.113322 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:27:45.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:27:45 smithi157 bash[24585]: cluster 2024-09-16T07:27:44.350533+0000 mgr.a (mgr.14373) 4790 : cluster [DBG] pgmap v3320: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:27:45.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:27:45 smithi086 bash[24289]: audit 2024-09-16T07:27:44.054123+0000 mgr.a (mgr.14373) 4789 : audit [DBG] from='client.113322 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:27:45.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:27:45 smithi086 bash[24289]: cluster 2024-09-16T07:27:44.350533+0000 mgr.a (mgr.14373) 4790 : cluster [DBG] pgmap v3320: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:27:45.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:27:45 smithi047 bash[22744]: audit 2024-09-16T07:27:44.054123+0000 mgr.a (mgr.14373) 4789 : audit [DBG] from='client.113322 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:27:45.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:27:45 smithi047 bash[22744]: cluster 2024-09-16T07:27:44.350533+0000 mgr.a (mgr.14373) 4790 : cluster [DBG] pgmap v3320: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:27:47.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:27:47 smithi157 bash[24585]: cluster 2024-09-16T07:27:46.351355+0000 mgr.a (mgr.14373) 4791 : cluster [DBG] pgmap v3321: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:27:47.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:27:47 smithi086 bash[24289]: cluster 2024-09-16T07:27:46.351355+0000 mgr.a (mgr.14373) 4791 : cluster [DBG] pgmap v3321: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:27:47.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:27:47 smithi047 bash[22744]: cluster 2024-09-16T07:27:46.351355+0000 mgr.a (mgr.14373) 4791 : cluster [DBG] pgmap v3321: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:27:49.478 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:27:49.479 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:27:49.479 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:27:50.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:27:49 smithi157 bash[24585]: cluster 2024-09-16T07:27:48.353540+0000 mgr.a (mgr.14373) 4792 : cluster [DBG] pgmap v3322: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:27:50.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:27:49 smithi086 bash[24289]: cluster 2024-09-16T07:27:48.353540+0000 mgr.a (mgr.14373) 4792 : cluster [DBG] pgmap v3322: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:27:50.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:27:49 smithi047 bash[22744]: cluster 2024-09-16T07:27:48.353540+0000 mgr.a (mgr.14373) 4792 : cluster [DBG] pgmap v3322: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:27:50.219 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:27:50.219 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:27:50.219 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:27:50.219 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:27:50.220 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:27:52.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:27:51 smithi157 bash[24585]: audit 2024-09-16T07:27:49.812997+0000 mgr.a (mgr.14373) 4793 : audit [DBG] from='client.113397 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:27:52.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:27:51 smithi157 bash[24585]: cluster 2024-09-16T07:27:50.354406+0000 mgr.a (mgr.14373) 4794 : cluster [DBG] pgmap v3323: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:27:52.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:27:51 smithi086 bash[24289]: audit 2024-09-16T07:27:49.812997+0000 mgr.a (mgr.14373) 4793 : audit [DBG] from='client.113397 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:27:52.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:27:51 smithi086 bash[24289]: cluster 2024-09-16T07:27:50.354406+0000 mgr.a (mgr.14373) 4794 : cluster [DBG] pgmap v3323: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:27:52.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:27:51 smithi047 bash[22744]: audit 2024-09-16T07:27:49.812997+0000 mgr.a (mgr.14373) 4793 : audit [DBG] from='client.113397 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:27:52.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:27:51 smithi047 bash[22744]: cluster 2024-09-16T07:27:50.354406+0000 mgr.a (mgr.14373) 4794 : cluster [DBG] pgmap v3323: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:27:54.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:27:53 smithi157 bash[24585]: cluster 2024-09-16T07:27:52.356591+0000 mgr.a (mgr.14373) 4795 : cluster [DBG] pgmap v3324: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:27:54.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:27:53 smithi086 bash[24289]: cluster 2024-09-16T07:27:52.356591+0000 mgr.a (mgr.14373) 4795 : cluster [DBG] pgmap v3324: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:27:54.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:27:53 smithi047 bash[22744]: cluster 2024-09-16T07:27:52.356591+0000 mgr.a (mgr.14373) 4795 : cluster [DBG] pgmap v3324: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:27:55.221 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:27:55.222 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:27:55.222 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:27:56.002 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:27:56.003 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:27:56.003 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:27:56.003 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:27:56.003 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:27:56.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:27:55 smithi157 bash[24585]: cluster 2024-09-16T07:27:54.357356+0000 mgr.a (mgr.14373) 4796 : cluster [DBG] pgmap v3325: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:27:56.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:27:55 smithi086 bash[24289]: cluster 2024-09-16T07:27:54.357356+0000 mgr.a (mgr.14373) 4796 : cluster [DBG] pgmap v3325: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:27:56.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:27:55 smithi047 bash[22744]: cluster 2024-09-16T07:27:54.357356+0000 mgr.a (mgr.14373) 4796 : cluster [DBG] pgmap v3325: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:27:57.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:27:56 smithi157 bash[24585]: audit 2024-09-16T07:27:55.564073+0000 mgr.a (mgr.14373) 4797 : audit [DBG] from='client.113469 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:27:57.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:27:56 smithi086 bash[24289]: audit 2024-09-16T07:27:55.564073+0000 mgr.a (mgr.14373) 4797 : audit [DBG] from='client.113469 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:27:57.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:27:56 smithi047 bash[22744]: audit 2024-09-16T07:27:55.564073+0000 mgr.a (mgr.14373) 4797 : audit [DBG] from='client.113469 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:27:58.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:27:57 smithi157 bash[24585]: cluster 2024-09-16T07:27:56.358211+0000 mgr.a (mgr.14373) 4798 : cluster [DBG] pgmap v3326: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:27:58.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:27:57 smithi086 bash[24289]: cluster 2024-09-16T07:27:56.358211+0000 mgr.a (mgr.14373) 4798 : cluster [DBG] pgmap v3326: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:27:58.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:27:57 smithi047 bash[22744]: cluster 2024-09-16T07:27:56.358211+0000 mgr.a (mgr.14373) 4798 : cluster [DBG] pgmap v3326: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:28:00.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:27:59 smithi086 bash[24289]: cluster 2024-09-16T07:27:58.360420+0000 mgr.a (mgr.14373) 4799 : cluster [DBG] pgmap v3327: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:28:00.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:27:59 smithi047 bash[22744]: cluster 2024-09-16T07:27:58.360420+0000 mgr.a (mgr.14373) 4799 : cluster [DBG] pgmap v3327: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:28:00.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:27:59 smithi157 bash[24585]: cluster 2024-09-16T07:27:58.360420+0000 mgr.a (mgr.14373) 4799 : cluster [DBG] pgmap v3327: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:28:01.004 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:28:01.004 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:28:01.005 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:28:01.746 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:28:01.746 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:28:01.746 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:28:01.746 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:28:01.746 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:28:02.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:28:01 smithi086 bash[24289]: cluster 2024-09-16T07:28:00.361333+0000 mgr.a (mgr.14373) 4800 : cluster [DBG] pgmap v3328: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:28:02.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:28:01 smithi047 bash[22744]: cluster 2024-09-16T07:28:00.361333+0000 mgr.a (mgr.14373) 4800 : cluster [DBG] pgmap v3328: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:28:02.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:28:01 smithi157 bash[24585]: cluster 2024-09-16T07:28:00.361333+0000 mgr.a (mgr.14373) 4800 : cluster [DBG] pgmap v3328: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:28:03.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:28:02 smithi086 bash[24289]: audit 2024-09-16T07:28:01.333656+0000 mgr.a (mgr.14373) 4801 : audit [DBG] from='client.113547 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:28:03.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:28:02 smithi047 bash[22744]: audit 2024-09-16T07:28:01.333656+0000 mgr.a (mgr.14373) 4801 : audit [DBG] from='client.113547 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:28:03.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:28:02 smithi157 bash[24585]: audit 2024-09-16T07:28:01.333656+0000 mgr.a (mgr.14373) 4801 : audit [DBG] from='client.113547 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:28:04.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:28:03 smithi047 bash[22744]: cluster 2024-09-16T07:28:02.364082+0000 mgr.a (mgr.14373) 4802 : cluster [DBG] pgmap v3329: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:28:04.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:28:03 smithi157 bash[24585]: cluster 2024-09-16T07:28:02.364082+0000 mgr.a (mgr.14373) 4802 : cluster [DBG] pgmap v3329: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:28:04.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:28:03 smithi086 bash[24289]: cluster 2024-09-16T07:28:02.364082+0000 mgr.a (mgr.14373) 4802 : cluster [DBG] pgmap v3329: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:28:05.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:28:04 smithi047 bash[22744]: cluster 2024-09-16T07:28:04.364885+0000 mgr.a (mgr.14373) 4803 : cluster [DBG] pgmap v3330: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:28:05.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:28:04 smithi157 bash[24585]: cluster 2024-09-16T07:28:04.364885+0000 mgr.a (mgr.14373) 4803 : cluster [DBG] pgmap v3330: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:28:05.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:28:04 smithi086 bash[24289]: cluster 2024-09-16T07:28:04.364885+0000 mgr.a (mgr.14373) 4803 : cluster [DBG] pgmap v3330: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:28:06.747 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:28:06.748 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:28:06.748 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:28:07.529 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:28:07.530 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:28:07.530 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:28:07.530 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:28:07.530 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:28:07.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:28:07 smithi157 bash[24585]: cluster 2024-09-16T07:28:06.365682+0000 mgr.a (mgr.14373) 4804 : cluster [DBG] pgmap v3331: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T07:28:07.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:28:07 smithi086 bash[24289]: cluster 2024-09-16T07:28:06.365682+0000 mgr.a (mgr.14373) 4804 : cluster [DBG] pgmap v3331: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T07:28:07.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:28:07 smithi047 bash[22744]: cluster 2024-09-16T07:28:06.365682+0000 mgr.a (mgr.14373) 4804 : cluster [DBG] pgmap v3331: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T07:28:08.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:28:08 smithi157 bash[24585]: audit 2024-09-16T07:28:07.086567+0000 mgr.a (mgr.14373) 4805 : audit [DBG] from='client.113625 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:28:08.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:28:08 smithi086 bash[24289]: audit 2024-09-16T07:28:07.086567+0000 mgr.a (mgr.14373) 4805 : audit [DBG] from='client.113625 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:28:08.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:28:08 smithi047 bash[22744]: audit 2024-09-16T07:28:07.086567+0000 mgr.a (mgr.14373) 4805 : audit [DBG] from='client.113625 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:28:09.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:28:09 smithi157 bash[24585]: cluster 2024-09-16T07:28:08.368619+0000 mgr.a (mgr.14373) 4806 : cluster [DBG] pgmap v3332: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-16T07:28:09.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:28:09 smithi086 bash[24289]: cluster 2024-09-16T07:28:08.368619+0000 mgr.a (mgr.14373) 4806 : cluster [DBG] pgmap v3332: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-16T07:28:09.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:28:09 smithi047 bash[22744]: cluster 2024-09-16T07:28:08.368619+0000 mgr.a (mgr.14373) 4806 : cluster [DBG] pgmap v3332: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-16T07:28:11.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:28:11 smithi157 bash[24585]: cluster 2024-09-16T07:28:10.369477+0000 mgr.a (mgr.14373) 4807 : cluster [DBG] pgmap v3333: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 5.2 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-16T07:28:11.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:28:11 smithi086 bash[24289]: cluster 2024-09-16T07:28:10.369477+0000 mgr.a (mgr.14373) 4807 : cluster [DBG] pgmap v3333: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 5.2 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-16T07:28:11.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:28:11 smithi047 bash[22744]: cluster 2024-09-16T07:28:10.369477+0000 mgr.a (mgr.14373) 4807 : cluster [DBG] pgmap v3333: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 5.2 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-16T07:28:12.531 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:28:12.532 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:28:12.532 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:28:13.308 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:28:13.309 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:28:13.309 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:28:13.309 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:28:13.309 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:28:13.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:28:13 smithi157 bash[24585]: cluster 2024-09-16T07:28:12.371569+0000 mgr.a (mgr.14373) 4808 : cluster [DBG] pgmap v3334: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 55 KiB/s rd, 0 B/s wr, 91 op/s 2024-09-16T07:28:13.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:28:13 smithi086 bash[24289]: cluster 2024-09-16T07:28:12.371569+0000 mgr.a (mgr.14373) 4808 : cluster [DBG] pgmap v3334: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 55 KiB/s rd, 0 B/s wr, 91 op/s 2024-09-16T07:28:13.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:28:13 smithi047 bash[22744]: cluster 2024-09-16T07:28:12.371569+0000 mgr.a (mgr.14373) 4808 : cluster [DBG] pgmap v3334: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 55 KiB/s rd, 0 B/s wr, 91 op/s 2024-09-16T07:28:14.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:28:14 smithi157 bash[24585]: audit 2024-09-16T07:28:12.866503+0000 mgr.a (mgr.14373) 4809 : audit [DBG] from='client.113703 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:28:14.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:28:14 smithi086 bash[24289]: audit 2024-09-16T07:28:12.866503+0000 mgr.a (mgr.14373) 4809 : audit [DBG] from='client.113703 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:28:14.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:28:14 smithi047 bash[22744]: audit 2024-09-16T07:28:12.866503+0000 mgr.a (mgr.14373) 4809 : audit [DBG] from='client.113703 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:28:15.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:28:15 smithi157 bash[24585]: cluster 2024-09-16T07:28:14.372573+0000 mgr.a (mgr.14373) 4810 : cluster [DBG] pgmap v3335: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 55 KiB/s rd, 0 B/s wr, 91 op/s 2024-09-16T07:28:15.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:28:15 smithi086 bash[24289]: cluster 2024-09-16T07:28:14.372573+0000 mgr.a (mgr.14373) 4810 : cluster [DBG] pgmap v3335: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 55 KiB/s rd, 0 B/s wr, 91 op/s 2024-09-16T07:28:15.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:28:15 smithi047 bash[22744]: cluster 2024-09-16T07:28:14.372573+0000 mgr.a (mgr.14373) 4810 : cluster [DBG] pgmap v3335: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 55 KiB/s rd, 0 B/s wr, 91 op/s 2024-09-16T07:28:17.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:28:17 smithi157 bash[24585]: cluster 2024-09-16T07:28:16.373340+0000 mgr.a (mgr.14373) 4811 : cluster [DBG] pgmap v3336: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 55 KiB/s rd, 0 B/s wr, 91 op/s 2024-09-16T07:28:17.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:28:17 smithi086 bash[24289]: cluster 2024-09-16T07:28:16.373340+0000 mgr.a (mgr.14373) 4811 : cluster [DBG] pgmap v3336: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 55 KiB/s rd, 0 B/s wr, 91 op/s 2024-09-16T07:28:17.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:28:17 smithi047 bash[22744]: cluster 2024-09-16T07:28:16.373340+0000 mgr.a (mgr.14373) 4811 : cluster [DBG] pgmap v3336: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 55 KiB/s rd, 0 B/s wr, 91 op/s 2024-09-16T07:28:18.310 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:28:18.311 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:28:18.311 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:28:19.099 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:28:19.099 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:28:19.099 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:28:19.100 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:28:19.100 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:28:19.459 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:28:19 smithi047 bash[22744]: cluster 2024-09-16T07:28:18.374767+0000 mgr.a (mgr.14373) 4812 : cluster [DBG] pgmap v3337: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 70 KiB/s rd, 0 B/s wr, 115 op/s 2024-09-16T07:28:19.459 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:28:19 smithi047 bash[22744]: audit 2024-09-16T07:28:18.654278+0000 mgr.a (mgr.14373) 4813 : audit [DBG] from='client.113781 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:28:19.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:28:19 smithi157 bash[24585]: cluster 2024-09-16T07:28:18.374767+0000 mgr.a (mgr.14373) 4812 : cluster [DBG] pgmap v3337: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 70 KiB/s rd, 0 B/s wr, 115 op/s 2024-09-16T07:28:19.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:28:19 smithi157 bash[24585]: audit 2024-09-16T07:28:18.654278+0000 mgr.a (mgr.14373) 4813 : audit [DBG] from='client.113781 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:28:19.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:28:19 smithi086 bash[24289]: cluster 2024-09-16T07:28:18.374767+0000 mgr.a (mgr.14373) 4812 : cluster [DBG] pgmap v3337: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 70 KiB/s rd, 0 B/s wr, 115 op/s 2024-09-16T07:28:19.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:28:19 smithi086 bash[24289]: audit 2024-09-16T07:28:18.654278+0000 mgr.a (mgr.14373) 4813 : audit [DBG] from='client.113781 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:28:21.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:28:21 smithi157 bash[24585]: cluster 2024-09-16T07:28:20.375685+0000 mgr.a (mgr.14373) 4814 : cluster [DBG] pgmap v3338: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 65 KiB/s rd, 0 B/s wr, 107 op/s 2024-09-16T07:28:21.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:28:21 smithi086 bash[24289]: cluster 2024-09-16T07:28:20.375685+0000 mgr.a (mgr.14373) 4814 : cluster [DBG] pgmap v3338: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 65 KiB/s rd, 0 B/s wr, 107 op/s 2024-09-16T07:28:21.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:28:21 smithi047 bash[22744]: cluster 2024-09-16T07:28:20.375685+0000 mgr.a (mgr.14373) 4814 : cluster [DBG] pgmap v3338: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 65 KiB/s rd, 0 B/s wr, 107 op/s 2024-09-16T07:28:23.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:28:23 smithi157 bash[24585]: cluster 2024-09-16T07:28:22.377935+0000 mgr.a (mgr.14373) 4815 : cluster [DBG] pgmap v3339: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 66 KiB/s rd, 0 B/s wr, 108 op/s 2024-09-16T07:28:23.887 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:28:23 smithi047 bash[22744]: cluster 2024-09-16T07:28:22.377935+0000 mgr.a (mgr.14373) 4815 : cluster [DBG] pgmap v3339: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 66 KiB/s rd, 0 B/s wr, 108 op/s 2024-09-16T07:28:23.887 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:28:23 smithi086 bash[24289]: cluster 2024-09-16T07:28:22.377935+0000 mgr.a (mgr.14373) 4815 : cluster [DBG] pgmap v3339: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 66 KiB/s rd, 0 B/s wr, 108 op/s 2024-09-16T07:28:24.101 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:28:24.102 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:28:24.102 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:28:24.840 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:28:24.840 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:28:24.840 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:28:24.840 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:28:24.840 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:28:25.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:28:25 smithi157 bash[24585]: cluster 2024-09-16T07:28:24.378820+0000 mgr.a (mgr.14373) 4816 : cluster [DBG] pgmap v3340: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 16 KiB/s rd, 0 B/s wr, 25 op/s 2024-09-16T07:28:25.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:28:25 smithi157 bash[24585]: audit 2024-09-16T07:28:24.433773+0000 mgr.a (mgr.14373) 4817 : audit [DBG] from='client.113853 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:28:25.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:28:25 smithi086 bash[24289]: cluster 2024-09-16T07:28:24.378820+0000 mgr.a (mgr.14373) 4816 : cluster [DBG] pgmap v3340: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 16 KiB/s rd, 0 B/s wr, 25 op/s 2024-09-16T07:28:25.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:28:25 smithi086 bash[24289]: audit 2024-09-16T07:28:24.433773+0000 mgr.a (mgr.14373) 4817 : audit [DBG] from='client.113853 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:28:25.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:28:25 smithi047 bash[22744]: cluster 2024-09-16T07:28:24.378820+0000 mgr.a (mgr.14373) 4816 : cluster [DBG] pgmap v3340: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 16 KiB/s rd, 0 B/s wr, 25 op/s 2024-09-16T07:28:25.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:28:25 smithi047 bash[22744]: audit 2024-09-16T07:28:24.433773+0000 mgr.a (mgr.14373) 4817 : audit [DBG] from='client.113853 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:28:27.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:28:27 smithi157 bash[24585]: cluster 2024-09-16T07:28:26.379789+0000 mgr.a (mgr.14373) 4818 : cluster [DBG] pgmap v3341: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 16 KiB/s rd, 0 B/s wr, 25 op/s 2024-09-16T07:28:27.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:28:27 smithi086 bash[24289]: cluster 2024-09-16T07:28:26.379789+0000 mgr.a (mgr.14373) 4818 : cluster [DBG] pgmap v3341: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 16 KiB/s rd, 0 B/s wr, 25 op/s 2024-09-16T07:28:27.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:28:27 smithi047 bash[22744]: cluster 2024-09-16T07:28:26.379789+0000 mgr.a (mgr.14373) 4818 : cluster [DBG] pgmap v3341: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 16 KiB/s rd, 0 B/s wr, 25 op/s 2024-09-16T07:28:29.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:28:29 smithi157 bash[24585]: cluster 2024-09-16T07:28:28.382034+0000 mgr.a (mgr.14373) 4819 : cluster [DBG] pgmap v3342: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 17 KiB/s rd, 0 B/s wr, 26 op/s 2024-09-16T07:28:29.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:28:29 smithi086 bash[24289]: cluster 2024-09-16T07:28:28.382034+0000 mgr.a (mgr.14373) 4819 : cluster [DBG] pgmap v3342: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 17 KiB/s rd, 0 B/s wr, 26 op/s 2024-09-16T07:28:29.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:28:29 smithi047 bash[22744]: cluster 2024-09-16T07:28:28.382034+0000 mgr.a (mgr.14373) 4819 : cluster [DBG] pgmap v3342: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 17 KiB/s rd, 0 B/s wr, 26 op/s 2024-09-16T07:28:29.841 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:28:29.842 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:28:29.842 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:28:30.625 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:28:30.626 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:28:30.626 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:28:30.626 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:28:30.626 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:28:31.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:28:31 smithi157 bash[24585]: audit 2024-09-16T07:28:30.178995+0000 mgr.a (mgr.14373) 4820 : audit [DBG] from='client.113931 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:28:31.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:28:31 smithi157 bash[24585]: cluster 2024-09-16T07:28:30.382578+0000 mgr.a (mgr.14373) 4821 : cluster [DBG] pgmap v3343: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-16T07:28:31.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:28:31 smithi157 bash[24585]: audit 2024-09-16T07:28:31.364015+0000 mon.b (mon.2) 474 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T07:28:31.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:28:31 smithi086 bash[24289]: audit 2024-09-16T07:28:30.178995+0000 mgr.a (mgr.14373) 4820 : audit [DBG] from='client.113931 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:28:31.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:28:31 smithi086 bash[24289]: cluster 2024-09-16T07:28:30.382578+0000 mgr.a (mgr.14373) 4821 : cluster [DBG] pgmap v3343: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-16T07:28:31.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:28:31 smithi086 bash[24289]: audit 2024-09-16T07:28:31.364015+0000 mon.b (mon.2) 474 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T07:28:31.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:28:31 smithi047 bash[22744]: audit 2024-09-16T07:28:30.178995+0000 mgr.a (mgr.14373) 4820 : audit [DBG] from='client.113931 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:28:31.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:28:31 smithi047 bash[22744]: cluster 2024-09-16T07:28:30.382578+0000 mgr.a (mgr.14373) 4821 : cluster [DBG] pgmap v3343: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-16T07:28:31.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:28:31 smithi047 bash[22744]: audit 2024-09-16T07:28:31.364015+0000 mon.b (mon.2) 474 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T07:28:33.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:28:32 smithi157 bash[24585]: audit 2024-09-16T07:28:31.983089+0000 mon.a (mon.0) 853 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:28:33.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:28:32 smithi157 bash[24585]: audit 2024-09-16T07:28:31.990221+0000 mon.a (mon.0) 854 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:28:33.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:28:32 smithi157 bash[24585]: audit 2024-09-16T07:28:31.995611+0000 mon.a (mon.0) 855 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:28:33.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:28:32 smithi157 bash[24585]: audit 2024-09-16T07:28:32.001456+0000 mon.a (mon.0) 856 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:28:33.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:28:32 smithi157 bash[24585]: cluster 2024-09-16T07:28:32.384881+0000 mgr.a (mgr.14373) 4822 : cluster [DBG] pgmap v3344: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 3.2 KiB/s rd, 2 op/s 2024-09-16T07:28:33.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:28:32 smithi157 bash[24585]: audit 2024-09-16T07:28:32.644012+0000 mon.b (mon.2) 475 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T07:28:33.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:28:32 smithi157 bash[24585]: audit 2024-09-16T07:28:32.646063+0000 mon.b (mon.2) 476 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T07:28:33.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:28:32 smithi157 bash[24585]: audit 2024-09-16T07:28:32.659298+0000 mon.a (mon.0) 857 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:28:33.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:28:32 smithi157 bash[24585]: audit 2024-09-16T07:28:32.663946+0000 mon.b (mon.2) 477 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:28:33.305 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:28:32 smithi157 bash[24585]: audit 2024-09-16T07:28:32.667744+0000 mgr.a (mgr.14373) 4823 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:28:33.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:28:32 smithi086 bash[24289]: audit 2024-09-16T07:28:31.983089+0000 mon.a (mon.0) 853 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:28:33.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:28:32 smithi086 bash[24289]: audit 2024-09-16T07:28:31.990221+0000 mon.a (mon.0) 854 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:28:33.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:28:32 smithi086 bash[24289]: audit 2024-09-16T07:28:31.995611+0000 mon.a (mon.0) 855 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:28:33.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:28:32 smithi086 bash[24289]: audit 2024-09-16T07:28:32.001456+0000 mon.a (mon.0) 856 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:28:33.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:28:32 smithi086 bash[24289]: cluster 2024-09-16T07:28:32.384881+0000 mgr.a (mgr.14373) 4822 : cluster [DBG] pgmap v3344: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 3.2 KiB/s rd, 2 op/s 2024-09-16T07:28:33.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:28:32 smithi086 bash[24289]: audit 2024-09-16T07:28:32.644012+0000 mon.b (mon.2) 475 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T07:28:33.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:28:32 smithi086 bash[24289]: audit 2024-09-16T07:28:32.646063+0000 mon.b (mon.2) 476 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T07:28:33.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:28:32 smithi086 bash[24289]: audit 2024-09-16T07:28:32.659298+0000 mon.a (mon.0) 857 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:28:33.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:28:32 smithi086 bash[24289]: audit 2024-09-16T07:28:32.663946+0000 mon.b (mon.2) 477 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:28:33.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:28:32 smithi086 bash[24289]: audit 2024-09-16T07:28:32.667744+0000 mgr.a (mgr.14373) 4823 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:28:33.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:28:32 smithi047 bash[22744]: audit 2024-09-16T07:28:31.983089+0000 mon.a (mon.0) 853 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:28:33.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:28:32 smithi047 bash[22744]: audit 2024-09-16T07:28:31.990221+0000 mon.a (mon.0) 854 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:28:33.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:28:32 smithi047 bash[22744]: audit 2024-09-16T07:28:31.995611+0000 mon.a (mon.0) 855 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:28:33.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:28:32 smithi047 bash[22744]: audit 2024-09-16T07:28:32.001456+0000 mon.a (mon.0) 856 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:28:33.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:28:32 smithi047 bash[22744]: cluster 2024-09-16T07:28:32.384881+0000 mgr.a (mgr.14373) 4822 : cluster [DBG] pgmap v3344: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 3.2 KiB/s rd, 2 op/s 2024-09-16T07:28:33.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:28:32 smithi047 bash[22744]: audit 2024-09-16T07:28:32.644012+0000 mon.b (mon.2) 475 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T07:28:33.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:28:32 smithi047 bash[22744]: audit 2024-09-16T07:28:32.646063+0000 mon.b (mon.2) 476 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T07:28:33.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:28:32 smithi047 bash[22744]: audit 2024-09-16T07:28:32.659298+0000 mon.a (mon.0) 857 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:28:33.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:28:32 smithi047 bash[22744]: audit 2024-09-16T07:28:32.663946+0000 mon.b (mon.2) 477 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:28:33.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:28:32 smithi047 bash[22744]: audit 2024-09-16T07:28:32.667744+0000 mgr.a (mgr.14373) 4823 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:28:33.839 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 07:28:33 smithi047 bash[22994]: debug 2024-09-16T07:28:33.415+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T07:28:33.839 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 07:28:33 smithi047 bash[22994]: debug 2024-09-16T07:28:33.419+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T07:28:34.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:28:34 smithi157 bash[24585]: audit 2024-09-16T07:28:33.420065+0000 mgr.a (mgr.14373) 4824 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T07:28:34.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:28:34 smithi157 bash[24585]: cephadm 2024-09-16T07:28:33.422439+0000 mgr.a (mgr.14373) 4825 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T07:28:34.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:28:34 smithi086 bash[24289]: audit 2024-09-16T07:28:33.420065+0000 mgr.a (mgr.14373) 4824 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T07:28:34.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:28:34 smithi086 bash[24289]: cephadm 2024-09-16T07:28:33.422439+0000 mgr.a (mgr.14373) 4825 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T07:28:34.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:28:34 smithi047 bash[22744]: audit 2024-09-16T07:28:33.420065+0000 mgr.a (mgr.14373) 4824 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T07:28:34.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:28:34 smithi047 bash[22744]: cephadm 2024-09-16T07:28:33.422439+0000 mgr.a (mgr.14373) 4825 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T07:28:35.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:28:35 smithi157 bash[24585]: cluster 2024-09-16T07:28:34.385997+0000 mgr.a (mgr.14373) 4826 : cluster [DBG] pgmap v3345: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-16T07:28:35.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:28:35 smithi086 bash[24289]: cluster 2024-09-16T07:28:34.385997+0000 mgr.a (mgr.14373) 4826 : cluster [DBG] pgmap v3345: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-16T07:28:35.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:28:35 smithi047 bash[22744]: cluster 2024-09-16T07:28:34.385997+0000 mgr.a (mgr.14373) 4826 : cluster [DBG] pgmap v3345: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-16T07:28:35.627 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:28:35.628 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:28:35.628 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:28:36.378 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:28:36.379 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:28:36.379 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:28:36.379 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:28:36.379 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:28:37.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:28:37 smithi157 bash[24585]: audit 2024-09-16T07:28:35.966207+0000 mgr.a (mgr.14373) 4827 : audit [DBG] from='client.114114 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:28:37.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:28:37 smithi157 bash[24585]: cluster 2024-09-16T07:28:36.386745+0000 mgr.a (mgr.14373) 4828 : cluster [DBG] pgmap v3346: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-16T07:28:37.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:28:37 smithi086 bash[24289]: audit 2024-09-16T07:28:35.966207+0000 mgr.a (mgr.14373) 4827 : audit [DBG] from='client.114114 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:28:37.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:28:37 smithi086 bash[24289]: cluster 2024-09-16T07:28:36.386745+0000 mgr.a (mgr.14373) 4828 : cluster [DBG] pgmap v3346: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-16T07:28:37.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:28:37 smithi047 bash[22744]: audit 2024-09-16T07:28:35.966207+0000 mgr.a (mgr.14373) 4827 : audit [DBG] from='client.114114 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:28:37.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:28:37 smithi047 bash[22744]: cluster 2024-09-16T07:28:36.386745+0000 mgr.a (mgr.14373) 4828 : cluster [DBG] pgmap v3346: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-16T07:28:39.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:28:39 smithi157 bash[24585]: cluster 2024-09-16T07:28:38.388924+0000 mgr.a (mgr.14373) 4829 : cluster [DBG] pgmap v3347: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 8.4 KiB/s rd, 426 B/s wr, 8 op/s 2024-09-16T07:28:39.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:28:39 smithi086 bash[24289]: cluster 2024-09-16T07:28:38.388924+0000 mgr.a (mgr.14373) 4829 : cluster [DBG] pgmap v3347: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 8.4 KiB/s rd, 426 B/s wr, 8 op/s 2024-09-16T07:28:39.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:28:39 smithi047 bash[22744]: cluster 2024-09-16T07:28:38.388924+0000 mgr.a (mgr.14373) 4829 : cluster [DBG] pgmap v3347: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 8.4 KiB/s rd, 426 B/s wr, 8 op/s 2024-09-16T07:28:41.380 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:28:41.381 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:28:41.381 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:28:41.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:28:41 smithi157 bash[24585]: cluster 2024-09-16T07:28:40.389712+0000 mgr.a (mgr.14373) 4830 : cluster [DBG] pgmap v3348: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:28:41.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:28:41 smithi086 bash[24289]: cluster 2024-09-16T07:28:40.389712+0000 mgr.a (mgr.14373) 4830 : cluster [DBG] pgmap v3348: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:28:41.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:28:41 smithi047 bash[22744]: cluster 2024-09-16T07:28:40.389712+0000 mgr.a (mgr.14373) 4830 : cluster [DBG] pgmap v3348: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:28:42.136 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:28:42.136 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:28:42.136 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:28:42.136 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:28:42.136 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:28:42.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:28:42 smithi157 bash[24585]: audit 2024-09-16T07:28:41.716255+0000 mgr.a (mgr.14373) 4831 : audit [DBG] from='client.114189 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:28:42.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:28:42 smithi086 bash[24289]: audit 2024-09-16T07:28:41.716255+0000 mgr.a (mgr.14373) 4831 : audit [DBG] from='client.114189 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:28:42.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:28:42 smithi047 bash[22744]: audit 2024-09-16T07:28:41.716255+0000 mgr.a (mgr.14373) 4831 : audit [DBG] from='client.114189 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:28:43.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:28:43 smithi157 bash[24585]: cluster 2024-09-16T07:28:42.392451+0000 mgr.a (mgr.14373) 4832 : cluster [DBG] pgmap v3349: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:28:43.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:28:43 smithi086 bash[24289]: cluster 2024-09-16T07:28:42.392451+0000 mgr.a (mgr.14373) 4832 : cluster [DBG] pgmap v3349: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:28:43.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:28:43 smithi047 bash[22744]: cluster 2024-09-16T07:28:42.392451+0000 mgr.a (mgr.14373) 4832 : cluster [DBG] pgmap v3349: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:28:45.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:28:45 smithi157 bash[24585]: cluster 2024-09-16T07:28:44.393208+0000 mgr.a (mgr.14373) 4833 : cluster [DBG] pgmap v3350: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T07:28:45.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:28:45 smithi086 bash[24289]: cluster 2024-09-16T07:28:44.393208+0000 mgr.a (mgr.14373) 4833 : cluster [DBG] pgmap v3350: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T07:28:45.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:28:45 smithi047 bash[22744]: cluster 2024-09-16T07:28:44.393208+0000 mgr.a (mgr.14373) 4833 : cluster [DBG] pgmap v3350: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T07:28:47.138 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:28:47.138 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:28:47.138 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:28:47.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:28:47 smithi157 bash[24585]: cluster 2024-09-16T07:28:46.393984+0000 mgr.a (mgr.14373) 4834 : cluster [DBG] pgmap v3351: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T07:28:47.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:28:47 smithi086 bash[24289]: cluster 2024-09-16T07:28:46.393984+0000 mgr.a (mgr.14373) 4834 : cluster [DBG] pgmap v3351: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T07:28:47.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:28:47 smithi047 bash[22744]: cluster 2024-09-16T07:28:46.393984+0000 mgr.a (mgr.14373) 4834 : cluster [DBG] pgmap v3351: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T07:28:47.887 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:28:47.888 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:28:47.888 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:28:47.888 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:28:47.888 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:28:48.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:28:48 smithi157 bash[24585]: audit 2024-09-16T07:28:47.470998+0000 mgr.a (mgr.14373) 4835 : audit [DBG] from='client.114267 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:28:48.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:28:48 smithi086 bash[24289]: audit 2024-09-16T07:28:47.470998+0000 mgr.a (mgr.14373) 4835 : audit [DBG] from='client.114267 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:28:48.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:28:48 smithi047 bash[22744]: audit 2024-09-16T07:28:47.470998+0000 mgr.a (mgr.14373) 4835 : audit [DBG] from='client.114267 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:28:49.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:28:49 smithi157 bash[24585]: cluster 2024-09-16T07:28:48.396871+0000 mgr.a (mgr.14373) 4836 : cluster [DBG] pgmap v3352: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:28:49.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:28:49 smithi086 bash[24289]: cluster 2024-09-16T07:28:48.396871+0000 mgr.a (mgr.14373) 4836 : cluster [DBG] pgmap v3352: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:28:49.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:28:49 smithi047 bash[22744]: cluster 2024-09-16T07:28:48.396871+0000 mgr.a (mgr.14373) 4836 : cluster [DBG] pgmap v3352: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:28:51.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:28:51 smithi157 bash[24585]: cluster 2024-09-16T07:28:50.397811+0000 mgr.a (mgr.14373) 4837 : cluster [DBG] pgmap v3353: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:28:51.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:28:51 smithi086 bash[24289]: cluster 2024-09-16T07:28:50.397811+0000 mgr.a (mgr.14373) 4837 : cluster [DBG] pgmap v3353: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:28:51.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:28:51 smithi047 bash[22744]: cluster 2024-09-16T07:28:50.397811+0000 mgr.a (mgr.14373) 4837 : cluster [DBG] pgmap v3353: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:28:52.889 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:28:52.890 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:28:52.890 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:28:53.663 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:28:53.664 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:28:53.664 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:28:53.664 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:28:53.664 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:28:53.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:28:53 smithi157 bash[24585]: cluster 2024-09-16T07:28:52.400070+0000 mgr.a (mgr.14373) 4838 : cluster [DBG] pgmap v3354: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:28:53.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:28:53 smithi086 bash[24289]: cluster 2024-09-16T07:28:52.400070+0000 mgr.a (mgr.14373) 4838 : cluster [DBG] pgmap v3354: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:28:53.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:28:53 smithi047 bash[22744]: cluster 2024-09-16T07:28:52.400070+0000 mgr.a (mgr.14373) 4838 : cluster [DBG] pgmap v3354: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:28:54.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:28:54 smithi157 bash[24585]: audit 2024-09-16T07:28:53.224099+0000 mgr.a (mgr.14373) 4839 : audit [DBG] from='client.114345 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:28:54.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:28:54 smithi086 bash[24289]: audit 2024-09-16T07:28:53.224099+0000 mgr.a (mgr.14373) 4839 : audit [DBG] from='client.114345 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:28:54.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:28:54 smithi047 bash[22744]: audit 2024-09-16T07:28:53.224099+0000 mgr.a (mgr.14373) 4839 : audit [DBG] from='client.114345 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:28:55.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:28:55 smithi157 bash[24585]: cluster 2024-09-16T07:28:54.401108+0000 mgr.a (mgr.14373) 4840 : cluster [DBG] pgmap v3355: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:28:55.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:28:55 smithi086 bash[24289]: cluster 2024-09-16T07:28:54.401108+0000 mgr.a (mgr.14373) 4840 : cluster [DBG] pgmap v3355: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:28:55.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:28:55 smithi047 bash[22744]: cluster 2024-09-16T07:28:54.401108+0000 mgr.a (mgr.14373) 4840 : cluster [DBG] pgmap v3355: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:28:57.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:28:57 smithi157 bash[24585]: cluster 2024-09-16T07:28:56.401891+0000 mgr.a (mgr.14373) 4841 : cluster [DBG] pgmap v3356: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:28:57.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:28:57 smithi086 bash[24289]: cluster 2024-09-16T07:28:56.401891+0000 mgr.a (mgr.14373) 4841 : cluster [DBG] pgmap v3356: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:28:57.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:28:57 smithi047 bash[22744]: cluster 2024-09-16T07:28:56.401891+0000 mgr.a (mgr.14373) 4841 : cluster [DBG] pgmap v3356: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:28:58.665 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:28:58.666 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:28:58.666 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:28:59.420 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:28:59.420 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:28:59.420 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:28:59.420 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:28:59.420 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:28:59.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:28:59 smithi157 bash[24585]: cluster 2024-09-16T07:28:58.404104+0000 mgr.a (mgr.14373) 4842 : cluster [DBG] pgmap v3357: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:28:59.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:28:59 smithi086 bash[24289]: cluster 2024-09-16T07:28:58.404104+0000 mgr.a (mgr.14373) 4842 : cluster [DBG] pgmap v3357: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:28:59.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:28:59 smithi047 bash[22744]: cluster 2024-09-16T07:28:58.404104+0000 mgr.a (mgr.14373) 4842 : cluster [DBG] pgmap v3357: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:29:00.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:29:00 smithi157 bash[24585]: audit 2024-09-16T07:28:59.000317+0000 mgr.a (mgr.14373) 4843 : audit [DBG] from='client.114417 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:29:00.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:29:00 smithi086 bash[24289]: audit 2024-09-16T07:28:59.000317+0000 mgr.a (mgr.14373) 4843 : audit [DBG] from='client.114417 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:29:00.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:29:00 smithi047 bash[22744]: audit 2024-09-16T07:28:59.000317+0000 mgr.a (mgr.14373) 4843 : audit [DBG] from='client.114417 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:29:01.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:29:01 smithi157 bash[24585]: cluster 2024-09-16T07:29:00.405097+0000 mgr.a (mgr.14373) 4844 : cluster [DBG] pgmap v3358: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:29:01.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:29:01 smithi086 bash[24289]: cluster 2024-09-16T07:29:00.405097+0000 mgr.a (mgr.14373) 4844 : cluster [DBG] pgmap v3358: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:29:01.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:29:01 smithi047 bash[22744]: cluster 2024-09-16T07:29:00.405097+0000 mgr.a (mgr.14373) 4844 : cluster [DBG] pgmap v3358: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:29:03.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:29:03 smithi157 bash[24585]: cluster 2024-09-16T07:29:02.407400+0000 mgr.a (mgr.14373) 4845 : cluster [DBG] pgmap v3359: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:29:03.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:29:03 smithi086 bash[24289]: cluster 2024-09-16T07:29:02.407400+0000 mgr.a (mgr.14373) 4845 : cluster [DBG] pgmap v3359: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:29:03.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:29:03 smithi047 bash[22744]: cluster 2024-09-16T07:29:02.407400+0000 mgr.a (mgr.14373) 4845 : cluster [DBG] pgmap v3359: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:29:04.422 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:29:04.422 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:29:04.423 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:29:05.188 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:29:05.189 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:29:05.189 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:29:05.189 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:29:05.189 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:29:05.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:29:05 smithi157 bash[24585]: cluster 2024-09-16T07:29:04.408165+0000 mgr.a (mgr.14373) 4846 : cluster [DBG] pgmap v3360: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:29:05.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:29:05 smithi157 bash[24585]: audit 2024-09-16T07:29:04.760607+0000 mgr.a (mgr.14373) 4847 : audit [DBG] from='client.114492 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:29:05.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:29:05 smithi086 bash[24289]: cluster 2024-09-16T07:29:04.408165+0000 mgr.a (mgr.14373) 4846 : cluster [DBG] pgmap v3360: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:29:05.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:29:05 smithi086 bash[24289]: audit 2024-09-16T07:29:04.760607+0000 mgr.a (mgr.14373) 4847 : audit [DBG] from='client.114492 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:29:05.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:29:05 smithi047 bash[22744]: cluster 2024-09-16T07:29:04.408165+0000 mgr.a (mgr.14373) 4846 : cluster [DBG] pgmap v3360: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:29:05.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:29:05 smithi047 bash[22744]: audit 2024-09-16T07:29:04.760607+0000 mgr.a (mgr.14373) 4847 : audit [DBG] from='client.114492 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:29:07.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:29:07 smithi157 bash[24585]: cluster 2024-09-16T07:29:06.409145+0000 mgr.a (mgr.14373) 4848 : cluster [DBG] pgmap v3361: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:29:07.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:29:07 smithi086 bash[24289]: cluster 2024-09-16T07:29:06.409145+0000 mgr.a (mgr.14373) 4848 : cluster [DBG] pgmap v3361: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:29:07.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:29:07 smithi047 bash[22744]: cluster 2024-09-16T07:29:06.409145+0000 mgr.a (mgr.14373) 4848 : cluster [DBG] pgmap v3361: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:29:09.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:29:09 smithi157 bash[24585]: cluster 2024-09-16T07:29:08.411418+0000 mgr.a (mgr.14373) 4849 : cluster [DBG] pgmap v3362: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:29:09.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:29:09 smithi086 bash[24289]: cluster 2024-09-16T07:29:08.411418+0000 mgr.a (mgr.14373) 4849 : cluster [DBG] pgmap v3362: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:29:09.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:29:09 smithi047 bash[22744]: cluster 2024-09-16T07:29:08.411418+0000 mgr.a (mgr.14373) 4849 : cluster [DBG] pgmap v3362: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:29:10.190 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:29:10.191 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:29:10.191 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:29:10.967 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:29:10.967 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:29:10.967 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:29:10.967 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:29:10.968 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:29:11.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:29:11 smithi157 bash[24585]: cluster 2024-09-16T07:29:10.412181+0000 mgr.a (mgr.14373) 4850 : cluster [DBG] pgmap v3363: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:29:11.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:29:11 smithi157 bash[24585]: audit 2024-09-16T07:29:10.525487+0000 mgr.a (mgr.14373) 4851 : audit [DBG] from='client.114570 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:29:11.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:29:11 smithi086 bash[24289]: cluster 2024-09-16T07:29:10.412181+0000 mgr.a (mgr.14373) 4850 : cluster [DBG] pgmap v3363: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:29:11.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:29:11 smithi086 bash[24289]: audit 2024-09-16T07:29:10.525487+0000 mgr.a (mgr.14373) 4851 : audit [DBG] from='client.114570 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:29:11.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:29:11 smithi047 bash[22744]: cluster 2024-09-16T07:29:10.412181+0000 mgr.a (mgr.14373) 4850 : cluster [DBG] pgmap v3363: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:29:11.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:29:11 smithi047 bash[22744]: audit 2024-09-16T07:29:10.525487+0000 mgr.a (mgr.14373) 4851 : audit [DBG] from='client.114570 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:29:13.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:29:13 smithi157 bash[24585]: cluster 2024-09-16T07:29:12.414555+0000 mgr.a (mgr.14373) 4852 : cluster [DBG] pgmap v3364: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:29:13.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:29:13 smithi086 bash[24289]: cluster 2024-09-16T07:29:12.414555+0000 mgr.a (mgr.14373) 4852 : cluster [DBG] pgmap v3364: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:29:13.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:29:13 smithi047 bash[22744]: cluster 2024-09-16T07:29:12.414555+0000 mgr.a (mgr.14373) 4852 : cluster [DBG] pgmap v3364: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:29:15.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:29:15 smithi086 bash[24289]: cluster 2024-09-16T07:29:14.415326+0000 mgr.a (mgr.14373) 4853 : cluster [DBG] pgmap v3365: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:29:15.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:29:15 smithi047 bash[22744]: cluster 2024-09-16T07:29:14.415326+0000 mgr.a (mgr.14373) 4853 : cluster [DBG] pgmap v3365: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:29:15.969 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:29:15.969 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:29:15.970 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:29:16.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:29:15 smithi157 bash[24585]: cluster 2024-09-16T07:29:14.415326+0000 mgr.a (mgr.14373) 4853 : cluster [DBG] pgmap v3365: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:29:16.721 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:29:16.721 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:29:16.721 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:29:16.722 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:29:16.722 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:29:17.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:29:17 smithi086 bash[24289]: audit 2024-09-16T07:29:16.304867+0000 mgr.a (mgr.14373) 4854 : audit [DBG] from='client.114648 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:29:17.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:29:17 smithi086 bash[24289]: cluster 2024-09-16T07:29:16.415985+0000 mgr.a (mgr.14373) 4855 : cluster [DBG] pgmap v3366: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:29:17.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:29:17 smithi047 bash[22744]: audit 2024-09-16T07:29:16.304867+0000 mgr.a (mgr.14373) 4854 : audit [DBG] from='client.114648 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:29:17.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:29:17 smithi047 bash[22744]: cluster 2024-09-16T07:29:16.415985+0000 mgr.a (mgr.14373) 4855 : cluster [DBG] pgmap v3366: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:29:18.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:29:17 smithi157 bash[24585]: audit 2024-09-16T07:29:16.304867+0000 mgr.a (mgr.14373) 4854 : audit [DBG] from='client.114648 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:29:18.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:29:17 smithi157 bash[24585]: cluster 2024-09-16T07:29:16.415985+0000 mgr.a (mgr.14373) 4855 : cluster [DBG] pgmap v3366: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:29:19.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:29:19 smithi086 bash[24289]: cluster 2024-09-16T07:29:18.418655+0000 mgr.a (mgr.14373) 4856 : cluster [DBG] pgmap v3367: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:29:19.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:29:19 smithi047 bash[22744]: cluster 2024-09-16T07:29:18.418655+0000 mgr.a (mgr.14373) 4856 : cluster [DBG] pgmap v3367: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:29:20.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:29:19 smithi157 bash[24585]: cluster 2024-09-16T07:29:18.418655+0000 mgr.a (mgr.14373) 4856 : cluster [DBG] pgmap v3367: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:29:21.723 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:29:21.723 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:29:21.723 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:29:21.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:29:21 smithi047 bash[22744]: cluster 2024-09-16T07:29:20.419466+0000 mgr.a (mgr.14373) 4857 : cluster [DBG] pgmap v3368: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:29:22.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:29:21 smithi157 bash[24585]: cluster 2024-09-16T07:29:20.419466+0000 mgr.a (mgr.14373) 4857 : cluster [DBG] pgmap v3368: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:29:22.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:29:21 smithi086 bash[24289]: cluster 2024-09-16T07:29:20.419466+0000 mgr.a (mgr.14373) 4857 : cluster [DBG] pgmap v3368: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:29:22.461 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:29:22.461 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:29:22.461 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:29:22.461 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:29:22.461 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:29:23.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:29:23 smithi047 bash[22744]: audit 2024-09-16T07:29:22.054750+0000 mgr.a (mgr.14373) 4858 : audit [DBG] from='client.114726 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:29:23.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:29:23 smithi047 bash[22744]: cluster 2024-09-16T07:29:22.420876+0000 mgr.a (mgr.14373) 4859 : cluster [DBG] pgmap v3369: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:29:24.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:29:23 smithi157 bash[24585]: audit 2024-09-16T07:29:22.054750+0000 mgr.a (mgr.14373) 4858 : audit [DBG] from='client.114726 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:29:24.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:29:23 smithi157 bash[24585]: cluster 2024-09-16T07:29:22.420876+0000 mgr.a (mgr.14373) 4859 : cluster [DBG] pgmap v3369: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:29:24.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:29:23 smithi086 bash[24289]: audit 2024-09-16T07:29:22.054750+0000 mgr.a (mgr.14373) 4858 : audit [DBG] from='client.114726 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:29:24.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:29:23 smithi086 bash[24289]: cluster 2024-09-16T07:29:22.420876+0000 mgr.a (mgr.14373) 4859 : cluster [DBG] pgmap v3369: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:29:25.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:29:25 smithi047 bash[22744]: cluster 2024-09-16T07:29:24.421621+0000 mgr.a (mgr.14373) 4860 : cluster [DBG] pgmap v3370: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:29:26.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:29:25 smithi157 bash[24585]: cluster 2024-09-16T07:29:24.421621+0000 mgr.a (mgr.14373) 4860 : cluster [DBG] pgmap v3370: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:29:26.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:29:25 smithi086 bash[24289]: cluster 2024-09-16T07:29:24.421621+0000 mgr.a (mgr.14373) 4860 : cluster [DBG] pgmap v3370: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:29:27.462 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:29:27.463 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:29:27.463 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:29:27.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:29:27 smithi047 bash[22744]: cluster 2024-09-16T07:29:26.422592+0000 mgr.a (mgr.14373) 4861 : cluster [DBG] pgmap v3371: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T07:29:28.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:29:27 smithi157 bash[24585]: cluster 2024-09-16T07:29:26.422592+0000 mgr.a (mgr.14373) 4861 : cluster [DBG] pgmap v3371: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T07:29:28.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:29:27 smithi086 bash[24289]: cluster 2024-09-16T07:29:26.422592+0000 mgr.a (mgr.14373) 4861 : cluster [DBG] pgmap v3371: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T07:29:28.231 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:29:28.231 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:29:28.231 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:29:28.231 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:29:28.231 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:29:29.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:29:28 smithi086 bash[24289]: audit 2024-09-16T07:29:27.802879+0000 mgr.a (mgr.14373) 4862 : audit [DBG] from='client.114804 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:29:29.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:29:28 smithi047 bash[22744]: audit 2024-09-16T07:29:27.802879+0000 mgr.a (mgr.14373) 4862 : audit [DBG] from='client.114804 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:29:29.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:29:28 smithi157 bash[24585]: audit 2024-09-16T07:29:27.802879+0000 mgr.a (mgr.14373) 4862 : audit [DBG] from='client.114804 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:29:30.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:29:29 smithi086 bash[24289]: cluster 2024-09-16T07:29:28.425525+0000 mgr.a (mgr.14373) 4863 : cluster [DBG] pgmap v3372: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:29:30.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:29:29 smithi047 bash[22744]: cluster 2024-09-16T07:29:28.425525+0000 mgr.a (mgr.14373) 4863 : cluster [DBG] pgmap v3372: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:29:30.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:29:29 smithi157 bash[24585]: cluster 2024-09-16T07:29:28.425525+0000 mgr.a (mgr.14373) 4863 : cluster [DBG] pgmap v3372: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:29:32.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:29:31 smithi086 bash[24289]: cluster 2024-09-16T07:29:30.426388+0000 mgr.a (mgr.14373) 4864 : cluster [DBG] pgmap v3373: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:29:32.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:29:31 smithi047 bash[22744]: cluster 2024-09-16T07:29:30.426388+0000 mgr.a (mgr.14373) 4864 : cluster [DBG] pgmap v3373: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:29:32.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:29:31 smithi157 bash[24585]: cluster 2024-09-16T07:29:30.426388+0000 mgr.a (mgr.14373) 4864 : cluster [DBG] pgmap v3373: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:29:33.232 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:29:33.233 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:29:33.233 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:29:33.986 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:29:33.986 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:29:33.986 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:29:33.986 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:29:33.986 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:29:34.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:29:33 smithi047 bash[22744]: cluster 2024-09-16T07:29:32.428384+0000 mgr.a (mgr.14373) 4865 : cluster [DBG] pgmap v3374: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:29:34.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:29:33 smithi047 bash[22744]: audit 2024-09-16T07:29:33.476161+0000 mon.b (mon.2) 478 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T07:29:34.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:29:33 smithi157 bash[24585]: cluster 2024-09-16T07:29:32.428384+0000 mgr.a (mgr.14373) 4865 : cluster [DBG] pgmap v3374: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:29:34.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:29:33 smithi157 bash[24585]: audit 2024-09-16T07:29:33.476161+0000 mon.b (mon.2) 478 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T07:29:34.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:29:33 smithi086 bash[24289]: cluster 2024-09-16T07:29:32.428384+0000 mgr.a (mgr.14373) 4865 : cluster [DBG] pgmap v3374: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:29:34.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:29:33 smithi086 bash[24289]: audit 2024-09-16T07:29:33.476161+0000 mon.b (mon.2) 478 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T07:29:35.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:29:34 smithi047 bash[22744]: audit 2024-09-16T07:29:33.567130+0000 mgr.a (mgr.14373) 4866 : audit [DBG] from='client.114882 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:29:35.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:29:34 smithi047 bash[22744]: audit 2024-09-16T07:29:34.352854+0000 mon.b (mon.2) 479 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T07:29:35.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:29:34 smithi047 bash[22744]: audit 2024-09-16T07:29:34.354774+0000 mon.b (mon.2) 480 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T07:29:35.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:29:34 smithi047 bash[22744]: audit 2024-09-16T07:29:34.366081+0000 mon.a (mon.0) 858 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:29:35.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:29:34 smithi047 bash[22744]: audit 2024-09-16T07:29:34.368508+0000 mon.b (mon.2) 481 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:29:35.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:29:34 smithi157 bash[24585]: audit 2024-09-16T07:29:33.567130+0000 mgr.a (mgr.14373) 4866 : audit [DBG] from='client.114882 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:29:35.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:29:34 smithi157 bash[24585]: audit 2024-09-16T07:29:34.352854+0000 mon.b (mon.2) 479 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T07:29:35.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:29:34 smithi157 bash[24585]: audit 2024-09-16T07:29:34.354774+0000 mon.b (mon.2) 480 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T07:29:35.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:29:34 smithi157 bash[24585]: audit 2024-09-16T07:29:34.366081+0000 mon.a (mon.0) 858 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:29:35.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:29:34 smithi157 bash[24585]: audit 2024-09-16T07:29:34.368508+0000 mon.b (mon.2) 481 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:29:35.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:29:34 smithi086 bash[24289]: audit 2024-09-16T07:29:33.567130+0000 mgr.a (mgr.14373) 4866 : audit [DBG] from='client.114882 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:29:35.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:29:34 smithi086 bash[24289]: audit 2024-09-16T07:29:34.352854+0000 mon.b (mon.2) 479 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T07:29:35.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:29:34 smithi086 bash[24289]: audit 2024-09-16T07:29:34.354774+0000 mon.b (mon.2) 480 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T07:29:35.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:29:34 smithi086 bash[24289]: audit 2024-09-16T07:29:34.366081+0000 mon.a (mon.0) 858 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:29:35.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:29:34 smithi086 bash[24289]: audit 2024-09-16T07:29:34.368508+0000 mon.b (mon.2) 481 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:29:35.589 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 07:29:35 smithi047 bash[22994]: debug 2024-09-16T07:29:35.093+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T07:29:35.589 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 07:29:35 smithi047 bash[22994]: debug 2024-09-16T07:29:35.097+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T07:29:36.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:29:35 smithi047 bash[22744]: audit 2024-09-16T07:29:34.371618+0000 mgr.a (mgr.14373) 4867 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:29:36.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:29:35 smithi047 bash[22744]: cluster 2024-09-16T07:29:34.429434+0000 mgr.a (mgr.14373) 4868 : cluster [DBG] pgmap v3375: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:29:36.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:29:35 smithi157 bash[24585]: audit 2024-09-16T07:29:34.371618+0000 mgr.a (mgr.14373) 4867 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:29:36.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:29:35 smithi157 bash[24585]: cluster 2024-09-16T07:29:34.429434+0000 mgr.a (mgr.14373) 4868 : cluster [DBG] pgmap v3375: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:29:36.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:29:35 smithi086 bash[24289]: audit 2024-09-16T07:29:34.371618+0000 mgr.a (mgr.14373) 4867 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:29:36.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:29:35 smithi086 bash[24289]: cluster 2024-09-16T07:29:34.429434+0000 mgr.a (mgr.14373) 4868 : cluster [DBG] pgmap v3375: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:29:37.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:29:36 smithi047 bash[22744]: audit 2024-09-16T07:29:35.096818+0000 mgr.a (mgr.14373) 4869 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T07:29:37.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:29:36 smithi047 bash[22744]: cephadm 2024-09-16T07:29:35.098558+0000 mgr.a (mgr.14373) 4870 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T07:29:37.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:29:36 smithi157 bash[24585]: audit 2024-09-16T07:29:35.096818+0000 mgr.a (mgr.14373) 4869 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T07:29:37.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:29:36 smithi157 bash[24585]: cephadm 2024-09-16T07:29:35.098558+0000 mgr.a (mgr.14373) 4870 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T07:29:37.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:29:36 smithi086 bash[24289]: audit 2024-09-16T07:29:35.096818+0000 mgr.a (mgr.14373) 4869 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T07:29:37.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:29:36 smithi086 bash[24289]: cephadm 2024-09-16T07:29:35.098558+0000 mgr.a (mgr.14373) 4870 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T07:29:38.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:29:37 smithi047 bash[22744]: cluster 2024-09-16T07:29:36.430944+0000 mgr.a (mgr.14373) 4871 : cluster [DBG] pgmap v3376: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 3.3 KiB/s rd, 85 B/s wr, 3 op/s 2024-09-16T07:29:38.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:29:37 smithi157 bash[24585]: cluster 2024-09-16T07:29:36.430944+0000 mgr.a (mgr.14373) 4871 : cluster [DBG] pgmap v3376: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 3.3 KiB/s rd, 85 B/s wr, 3 op/s 2024-09-16T07:29:38.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:29:37 smithi086 bash[24289]: cluster 2024-09-16T07:29:36.430944+0000 mgr.a (mgr.14373) 4871 : cluster [DBG] pgmap v3376: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 3.3 KiB/s rd, 85 B/s wr, 3 op/s 2024-09-16T07:29:38.987 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:29:38.988 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:29:38.988 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:29:39.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:29:38 smithi157 bash[24585]: cluster 2024-09-16T07:29:38.432614+0000 mgr.a (mgr.14373) 4872 : cluster [DBG] pgmap v3377: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:29:39.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:29:38 smithi086 bash[24289]: cluster 2024-09-16T07:29:38.432614+0000 mgr.a (mgr.14373) 4872 : cluster [DBG] pgmap v3377: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:29:39.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:29:38 smithi047 bash[22744]: cluster 2024-09-16T07:29:38.432614+0000 mgr.a (mgr.14373) 4872 : cluster [DBG] pgmap v3377: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:29:39.730 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:29:39.730 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:29:39.730 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:29:39.730 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:29:39.730 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:29:40.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:29:39 smithi157 bash[24585]: audit 2024-09-16T07:29:39.326184+0000 mgr.a (mgr.14373) 4873 : audit [DBG] from='client.115056 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:29:40.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:29:39 smithi086 bash[24289]: audit 2024-09-16T07:29:39.326184+0000 mgr.a (mgr.14373) 4873 : audit [DBG] from='client.115056 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:29:40.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:29:39 smithi047 bash[22744]: audit 2024-09-16T07:29:39.326184+0000 mgr.a (mgr.14373) 4873 : audit [DBG] from='client.115056 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:29:41.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:29:40 smithi157 bash[24585]: cluster 2024-09-16T07:29:40.433599+0000 mgr.a (mgr.14373) 4874 : cluster [DBG] pgmap v3378: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:29:41.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:29:40 smithi086 bash[24289]: cluster 2024-09-16T07:29:40.433599+0000 mgr.a (mgr.14373) 4874 : cluster [DBG] pgmap v3378: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:29:41.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:29:40 smithi047 bash[22744]: cluster 2024-09-16T07:29:40.433599+0000 mgr.a (mgr.14373) 4874 : cluster [DBG] pgmap v3378: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:29:43.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:29:43 smithi157 bash[24585]: cluster 2024-09-16T07:29:42.435853+0000 mgr.a (mgr.14373) 4875 : cluster [DBG] pgmap v3379: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:29:43.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:29:43 smithi086 bash[24289]: cluster 2024-09-16T07:29:42.435853+0000 mgr.a (mgr.14373) 4875 : cluster [DBG] pgmap v3379: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:29:43.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:29:43 smithi047 bash[22744]: cluster 2024-09-16T07:29:42.435853+0000 mgr.a (mgr.14373) 4875 : cluster [DBG] pgmap v3379: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:29:44.731 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:29:44.732 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:29:44.732 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:29:45.504 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:29:45.504 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:29:45.504 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:29:45.504 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:29:45.504 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:29:45.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:29:45 smithi157 bash[24585]: cluster 2024-09-16T07:29:44.436639+0000 mgr.a (mgr.14373) 4876 : cluster [DBG] pgmap v3380: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:29:45.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:29:45 smithi086 bash[24289]: cluster 2024-09-16T07:29:44.436639+0000 mgr.a (mgr.14373) 4876 : cluster [DBG] pgmap v3380: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:29:45.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:29:45 smithi047 bash[22744]: cluster 2024-09-16T07:29:44.436639+0000 mgr.a (mgr.14373) 4876 : cluster [DBG] pgmap v3380: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:29:46.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:29:46 smithi157 bash[24585]: audit 2024-09-16T07:29:45.068726+0000 mgr.a (mgr.14373) 4877 : audit [DBG] from='client.115131 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:29:46.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:29:46 smithi086 bash[24289]: audit 2024-09-16T07:29:45.068726+0000 mgr.a (mgr.14373) 4877 : audit [DBG] from='client.115131 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:29:46.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:29:46 smithi047 bash[22744]: audit 2024-09-16T07:29:45.068726+0000 mgr.a (mgr.14373) 4877 : audit [DBG] from='client.115131 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:29:47.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:29:47 smithi157 bash[24585]: cluster 2024-09-16T07:29:46.439149+0000 mgr.a (mgr.14373) 4878 : cluster [DBG] pgmap v3381: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:29:47.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:29:47 smithi086 bash[24289]: cluster 2024-09-16T07:29:46.439149+0000 mgr.a (mgr.14373) 4878 : cluster [DBG] pgmap v3381: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:29:47.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:29:47 smithi047 bash[22744]: cluster 2024-09-16T07:29:46.439149+0000 mgr.a (mgr.14373) 4878 : cluster [DBG] pgmap v3381: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:29:49.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:29:49 smithi157 bash[24585]: cluster 2024-09-16T07:29:48.440083+0000 mgr.a (mgr.14373) 4879 : cluster [DBG] pgmap v3382: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.4 KiB/s rd, 341 B/s wr, 6 op/s 2024-09-16T07:29:49.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:29:49 smithi086 bash[24289]: cluster 2024-09-16T07:29:48.440083+0000 mgr.a (mgr.14373) 4879 : cluster [DBG] pgmap v3382: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.4 KiB/s rd, 341 B/s wr, 6 op/s 2024-09-16T07:29:49.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:29:49 smithi047 bash[22744]: cluster 2024-09-16T07:29:48.440083+0000 mgr.a (mgr.14373) 4879 : cluster [DBG] pgmap v3382: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.4 KiB/s rd, 341 B/s wr, 6 op/s 2024-09-16T07:29:50.505 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:29:50.506 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:29:50.507 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:29:51.279 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:29:51.279 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:29:51.279 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:29:51.279 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:29:51.280 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:29:51.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:29:51 smithi157 bash[24585]: cluster 2024-09-16T07:29:50.441009+0000 mgr.a (mgr.14373) 4880 : cluster [DBG] pgmap v3383: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:29:51.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:29:51 smithi086 bash[24289]: cluster 2024-09-16T07:29:50.441009+0000 mgr.a (mgr.14373) 4880 : cluster [DBG] pgmap v3383: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:29:51.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:29:51 smithi047 bash[22744]: cluster 2024-09-16T07:29:50.441009+0000 mgr.a (mgr.14373) 4880 : cluster [DBG] pgmap v3383: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:29:52.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:29:52 smithi157 bash[24585]: audit 2024-09-16T07:29:50.844915+0000 mgr.a (mgr.14373) 4881 : audit [DBG] from='client.115209 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:29:52.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:29:52 smithi086 bash[24289]: audit 2024-09-16T07:29:50.844915+0000 mgr.a (mgr.14373) 4881 : audit [DBG] from='client.115209 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:29:52.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:29:52 smithi047 bash[22744]: audit 2024-09-16T07:29:50.844915+0000 mgr.a (mgr.14373) 4881 : audit [DBG] from='client.115209 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:29:53.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:29:53 smithi157 bash[24585]: cluster 2024-09-16T07:29:52.443521+0000 mgr.a (mgr.14373) 4882 : cluster [DBG] pgmap v3384: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:29:53.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:29:53 smithi086 bash[24289]: cluster 2024-09-16T07:29:52.443521+0000 mgr.a (mgr.14373) 4882 : cluster [DBG] pgmap v3384: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:29:53.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:29:53 smithi047 bash[22744]: cluster 2024-09-16T07:29:52.443521+0000 mgr.a (mgr.14373) 4882 : cluster [DBG] pgmap v3384: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:29:55.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:29:55 smithi157 bash[24585]: cluster 2024-09-16T07:29:54.444482+0000 mgr.a (mgr.14373) 4883 : cluster [DBG] pgmap v3385: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:29:55.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:29:55 smithi086 bash[24289]: cluster 2024-09-16T07:29:54.444482+0000 mgr.a (mgr.14373) 4883 : cluster [DBG] pgmap v3385: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:29:55.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:29:55 smithi047 bash[22744]: cluster 2024-09-16T07:29:54.444482+0000 mgr.a (mgr.14373) 4883 : cluster [DBG] pgmap v3385: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:29:56.280 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:29:56.281 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:29:56.281 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:29:57.039 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:29:57.039 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:29:57.040 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:29:57.040 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:29:57.040 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:29:57.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:29:57 smithi157 bash[24585]: cluster 2024-09-16T07:29:56.446395+0000 mgr.a (mgr.14373) 4884 : cluster [DBG] pgmap v3386: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:29:57.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:29:57 smithi157 bash[24585]: audit 2024-09-16T07:29:56.619903+0000 mgr.a (mgr.14373) 4885 : audit [DBG] from='client.115281 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:29:57.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:29:57 smithi086 bash[24289]: cluster 2024-09-16T07:29:56.446395+0000 mgr.a (mgr.14373) 4884 : cluster [DBG] pgmap v3386: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:29:57.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:29:57 smithi086 bash[24289]: audit 2024-09-16T07:29:56.619903+0000 mgr.a (mgr.14373) 4885 : audit [DBG] from='client.115281 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:29:57.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:29:57 smithi047 bash[22744]: cluster 2024-09-16T07:29:56.446395+0000 mgr.a (mgr.14373) 4884 : cluster [DBG] pgmap v3386: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:29:57.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:29:57 smithi047 bash[22744]: audit 2024-09-16T07:29:56.619903+0000 mgr.a (mgr.14373) 4885 : audit [DBG] from='client.115281 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:29:59.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:29:59 smithi157 bash[24585]: cluster 2024-09-16T07:29:58.447302+0000 mgr.a (mgr.14373) 4886 : cluster [DBG] pgmap v3387: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:29:59.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:29:59 smithi086 bash[24289]: cluster 2024-09-16T07:29:58.447302+0000 mgr.a (mgr.14373) 4886 : cluster [DBG] pgmap v3387: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:29:59.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:29:59 smithi047 bash[22744]: cluster 2024-09-16T07:29:58.447302+0000 mgr.a (mgr.14373) 4886 : cluster [DBG] pgmap v3387: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:30:00.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:30:00 smithi157 bash[24585]: cluster 2024-09-16T07:30:00.000156+0000 mon.a (mon.0) 859 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-16T07:30:00.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:30:00 smithi086 bash[24289]: cluster 2024-09-16T07:30:00.000156+0000 mon.a (mon.0) 859 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-16T07:30:00.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:30:00 smithi047 bash[22744]: cluster 2024-09-16T07:30:00.000156+0000 mon.a (mon.0) 859 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-16T07:30:01.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:30:01 smithi157 bash[24585]: cluster 2024-09-16T07:30:00.448097+0000 mgr.a (mgr.14373) 4887 : cluster [DBG] pgmap v3388: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T07:30:01.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:30:01 smithi086 bash[24289]: cluster 2024-09-16T07:30:00.448097+0000 mgr.a (mgr.14373) 4887 : cluster [DBG] pgmap v3388: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T07:30:01.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:30:01 smithi047 bash[22744]: cluster 2024-09-16T07:30:00.448097+0000 mgr.a (mgr.14373) 4887 : cluster [DBG] pgmap v3388: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T07:30:02.041 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:30:02.042 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:30:02.042 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:30:02.819 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:30:02.819 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:30:02.819 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:30:02.819 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:30:02.820 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:30:03.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:30:03 smithi157 bash[24585]: audit 2024-09-16T07:30:02.367804+0000 mgr.a (mgr.14373) 4888 : audit [DBG] from='client.115356 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:30:03.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:30:03 smithi157 bash[24585]: cluster 2024-09-16T07:30:02.450144+0000 mgr.a (mgr.14373) 4889 : cluster [DBG] pgmap v3389: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:30:03.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:30:03 smithi086 bash[24289]: audit 2024-09-16T07:30:02.367804+0000 mgr.a (mgr.14373) 4888 : audit [DBG] from='client.115356 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:30:03.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:30:03 smithi086 bash[24289]: cluster 2024-09-16T07:30:02.450144+0000 mgr.a (mgr.14373) 4889 : cluster [DBG] pgmap v3389: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:30:03.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:30:03 smithi047 bash[22744]: audit 2024-09-16T07:30:02.367804+0000 mgr.a (mgr.14373) 4888 : audit [DBG] from='client.115356 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:30:03.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:30:03 smithi047 bash[22744]: cluster 2024-09-16T07:30:02.450144+0000 mgr.a (mgr.14373) 4889 : cluster [DBG] pgmap v3389: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:30:05.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:30:05 smithi086 bash[24289]: cluster 2024-09-16T07:30:04.451061+0000 mgr.a (mgr.14373) 4890 : cluster [DBG] pgmap v3390: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:30:05.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:30:05 smithi047 bash[22744]: cluster 2024-09-16T07:30:04.451061+0000 mgr.a (mgr.14373) 4890 : cluster [DBG] pgmap v3390: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:30:06.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:30:05 smithi157 bash[24585]: cluster 2024-09-16T07:30:04.451061+0000 mgr.a (mgr.14373) 4890 : cluster [DBG] pgmap v3390: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:30:07.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:30:07 smithi086 bash[24289]: cluster 2024-09-16T07:30:06.453194+0000 mgr.a (mgr.14373) 4891 : cluster [DBG] pgmap v3391: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:30:07.820 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:30:07.821 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:30:07.822 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:30:07.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:30:07 smithi047 bash[22744]: cluster 2024-09-16T07:30:06.453194+0000 mgr.a (mgr.14373) 4891 : cluster [DBG] pgmap v3391: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:30:08.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:30:07 smithi157 bash[24585]: cluster 2024-09-16T07:30:06.453194+0000 mgr.a (mgr.14373) 4891 : cluster [DBG] pgmap v3391: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:30:08.557 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:30:08.557 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:30:08.557 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:30:08.557 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:30:08.557 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:30:09.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:30:09 smithi086 bash[24289]: audit 2024-09-16T07:30:08.146459+0000 mgr.a (mgr.14373) 4892 : audit [DBG] from='client.115431 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:30:09.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:30:09 smithi086 bash[24289]: cluster 2024-09-16T07:30:08.461759+0000 mgr.a (mgr.14373) 4893 : cluster [DBG] pgmap v3392: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:30:09.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:30:09 smithi047 bash[22744]: audit 2024-09-16T07:30:08.146459+0000 mgr.a (mgr.14373) 4892 : audit [DBG] from='client.115431 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:30:09.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:30:09 smithi047 bash[22744]: cluster 2024-09-16T07:30:08.461759+0000 mgr.a (mgr.14373) 4893 : cluster [DBG] pgmap v3392: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:30:10.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:30:09 smithi157 bash[24585]: audit 2024-09-16T07:30:08.146459+0000 mgr.a (mgr.14373) 4892 : audit [DBG] from='client.115431 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:30:10.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:30:09 smithi157 bash[24585]: cluster 2024-09-16T07:30:08.461759+0000 mgr.a (mgr.14373) 4893 : cluster [DBG] pgmap v3392: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:30:11.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:30:11 smithi047 bash[22744]: cluster 2024-09-16T07:30:10.462814+0000 mgr.a (mgr.14373) 4894 : cluster [DBG] pgmap v3393: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:30:12.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:30:11 smithi157 bash[24585]: cluster 2024-09-16T07:30:10.462814+0000 mgr.a (mgr.14373) 4894 : cluster [DBG] pgmap v3393: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:30:12.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:30:11 smithi086 bash[24289]: cluster 2024-09-16T07:30:10.462814+0000 mgr.a (mgr.14373) 4894 : cluster [DBG] pgmap v3393: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:30:13.558 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:30:13.559 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:30:13.559 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:30:13.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:30:13 smithi047 bash[22744]: cluster 2024-09-16T07:30:12.465030+0000 mgr.a (mgr.14373) 4895 : cluster [DBG] pgmap v3394: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:30:14.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:30:13 smithi157 bash[24585]: cluster 2024-09-16T07:30:12.465030+0000 mgr.a (mgr.14373) 4895 : cluster [DBG] pgmap v3394: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:30:14.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:30:13 smithi086 bash[24289]: cluster 2024-09-16T07:30:12.465030+0000 mgr.a (mgr.14373) 4895 : cluster [DBG] pgmap v3394: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:30:14.325 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:30:14.325 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:30:14.325 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:30:14.325 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:30:14.326 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:30:15.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:30:15 smithi047 bash[22744]: audit 2024-09-16T07:30:13.898679+0000 mgr.a (mgr.14373) 4896 : audit [DBG] from='client.115509 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:30:15.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:30:15 smithi047 bash[22744]: cluster 2024-09-16T07:30:14.465993+0000 mgr.a (mgr.14373) 4897 : cluster [DBG] pgmap v3395: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:30:16.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:30:15 smithi157 bash[24585]: audit 2024-09-16T07:30:13.898679+0000 mgr.a (mgr.14373) 4896 : audit [DBG] from='client.115509 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:30:16.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:30:15 smithi157 bash[24585]: cluster 2024-09-16T07:30:14.465993+0000 mgr.a (mgr.14373) 4897 : cluster [DBG] pgmap v3395: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:30:16.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:30:15 smithi086 bash[24289]: audit 2024-09-16T07:30:13.898679+0000 mgr.a (mgr.14373) 4896 : audit [DBG] from='client.115509 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:30:16.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:30:15 smithi086 bash[24289]: cluster 2024-09-16T07:30:14.465993+0000 mgr.a (mgr.14373) 4897 : cluster [DBG] pgmap v3395: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:30:17.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:30:17 smithi047 bash[22744]: cluster 2024-09-16T07:30:16.468112+0000 mgr.a (mgr.14373) 4898 : cluster [DBG] pgmap v3396: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:30:18.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:30:17 smithi157 bash[24585]: cluster 2024-09-16T07:30:16.468112+0000 mgr.a (mgr.14373) 4898 : cluster [DBG] pgmap v3396: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:30:18.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:30:17 smithi086 bash[24289]: cluster 2024-09-16T07:30:16.468112+0000 mgr.a (mgr.14373) 4898 : cluster [DBG] pgmap v3396: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:30:19.327 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:30:19.328 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:30:19.328 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:30:19.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:30:19 smithi047 bash[22744]: cluster 2024-09-16T07:30:18.469045+0000 mgr.a (mgr.14373) 4899 : cluster [DBG] pgmap v3397: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:30:20.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:30:19 smithi157 bash[24585]: cluster 2024-09-16T07:30:18.469045+0000 mgr.a (mgr.14373) 4899 : cluster [DBG] pgmap v3397: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:30:20.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:30:19 smithi086 bash[24289]: cluster 2024-09-16T07:30:18.469045+0000 mgr.a (mgr.14373) 4899 : cluster [DBG] pgmap v3397: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:30:20.077 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:30:20.077 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:30:20.077 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:30:20.077 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:30:20.077 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:30:21.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:30:20 smithi157 bash[24585]: audit 2024-09-16T07:30:19.664429+0000 mgr.a (mgr.14373) 4900 : audit [DBG] from='client.115584 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:30:21.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:30:20 smithi086 bash[24289]: audit 2024-09-16T07:30:19.664429+0000 mgr.a (mgr.14373) 4900 : audit [DBG] from='client.115584 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:30:21.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:30:20 smithi047 bash[22744]: audit 2024-09-16T07:30:19.664429+0000 mgr.a (mgr.14373) 4900 : audit [DBG] from='client.115584 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:30:22.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:30:21 smithi157 bash[24585]: cluster 2024-09-16T07:30:20.470005+0000 mgr.a (mgr.14373) 4901 : cluster [DBG] pgmap v3398: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:30:22.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:30:21 smithi086 bash[24289]: cluster 2024-09-16T07:30:20.470005+0000 mgr.a (mgr.14373) 4901 : cluster [DBG] pgmap v3398: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:30:22.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:30:21 smithi047 bash[22744]: cluster 2024-09-16T07:30:20.470005+0000 mgr.a (mgr.14373) 4901 : cluster [DBG] pgmap v3398: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:30:24.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:30:23 smithi157 bash[24585]: cluster 2024-09-16T07:30:22.472234+0000 mgr.a (mgr.14373) 4902 : cluster [DBG] pgmap v3399: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:30:24.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:30:23 smithi086 bash[24289]: cluster 2024-09-16T07:30:22.472234+0000 mgr.a (mgr.14373) 4902 : cluster [DBG] pgmap v3399: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:30:24.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:30:23 smithi047 bash[22744]: cluster 2024-09-16T07:30:22.472234+0000 mgr.a (mgr.14373) 4902 : cluster [DBG] pgmap v3399: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:30:25.079 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:30:25.079 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:30:25.079 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:30:25.869 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:30:25.869 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:30:25.869 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:30:25.869 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:30:25.869 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:30:26.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:30:25 smithi157 bash[24585]: cluster 2024-09-16T07:30:24.472996+0000 mgr.a (mgr.14373) 4903 : cluster [DBG] pgmap v3400: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:30:26.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:30:25 smithi086 bash[24289]: cluster 2024-09-16T07:30:24.472996+0000 mgr.a (mgr.14373) 4903 : cluster [DBG] pgmap v3400: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:30:26.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:30:25 smithi047 bash[22744]: cluster 2024-09-16T07:30:24.472996+0000 mgr.a (mgr.14373) 4903 : cluster [DBG] pgmap v3400: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:30:27.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:30:26 smithi157 bash[24585]: audit 2024-09-16T07:30:25.421094+0000 mgr.a (mgr.14373) 4904 : audit [DBG] from='client.115662 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:30:27.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:30:26 smithi086 bash[24289]: audit 2024-09-16T07:30:25.421094+0000 mgr.a (mgr.14373) 4904 : audit [DBG] from='client.115662 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:30:27.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:30:26 smithi047 bash[22744]: audit 2024-09-16T07:30:25.421094+0000 mgr.a (mgr.14373) 4904 : audit [DBG] from='client.115662 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:30:28.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:30:27 smithi157 bash[24585]: cluster 2024-09-16T07:30:26.475308+0000 mgr.a (mgr.14373) 4905 : cluster [DBG] pgmap v3401: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:30:28.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:30:27 smithi086 bash[24289]: cluster 2024-09-16T07:30:26.475308+0000 mgr.a (mgr.14373) 4905 : cluster [DBG] pgmap v3401: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:30:28.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:30:27 smithi047 bash[22744]: cluster 2024-09-16T07:30:26.475308+0000 mgr.a (mgr.14373) 4905 : cluster [DBG] pgmap v3401: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:30:30.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:30:29 smithi157 bash[24585]: cluster 2024-09-16T07:30:28.476103+0000 mgr.a (mgr.14373) 4906 : cluster [DBG] pgmap v3402: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:30:30.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:30:29 smithi086 bash[24289]: cluster 2024-09-16T07:30:28.476103+0000 mgr.a (mgr.14373) 4906 : cluster [DBG] pgmap v3402: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:30:30.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:30:29 smithi047 bash[22744]: cluster 2024-09-16T07:30:28.476103+0000 mgr.a (mgr.14373) 4906 : cluster [DBG] pgmap v3402: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:30:30.870 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:30:30.871 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:30:30.871 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:30:31.650 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:30:31.650 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:30:31.650 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:30:31.650 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:30:31.651 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:30:32.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:30:31 smithi157 bash[24585]: cluster 2024-09-16T07:30:30.476877+0000 mgr.a (mgr.14373) 4907 : cluster [DBG] pgmap v3403: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:30:32.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:30:31 smithi086 bash[24289]: cluster 2024-09-16T07:30:30.476877+0000 mgr.a (mgr.14373) 4907 : cluster [DBG] pgmap v3403: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:30:32.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:30:31 smithi047 bash[22744]: cluster 2024-09-16T07:30:30.476877+0000 mgr.a (mgr.14373) 4907 : cluster [DBG] pgmap v3403: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:30:33.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:30:32 smithi157 bash[24585]: audit 2024-09-16T07:30:31.212453+0000 mgr.a (mgr.14373) 4908 : audit [DBG] from='client.115737 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:30:33.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:30:32 smithi086 bash[24289]: audit 2024-09-16T07:30:31.212453+0000 mgr.a (mgr.14373) 4908 : audit [DBG] from='client.115737 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:30:33.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:30:32 smithi047 bash[22744]: audit 2024-09-16T07:30:31.212453+0000 mgr.a (mgr.14373) 4908 : audit [DBG] from='client.115737 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:30:34.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:30:33 smithi157 bash[24585]: cluster 2024-09-16T07:30:32.479573+0000 mgr.a (mgr.14373) 4909 : cluster [DBG] pgmap v3404: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-16T07:30:34.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:30:33 smithi086 bash[24289]: cluster 2024-09-16T07:30:32.479573+0000 mgr.a (mgr.14373) 4909 : cluster [DBG] pgmap v3404: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-16T07:30:34.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:30:33 smithi047 bash[22744]: cluster 2024-09-16T07:30:32.479573+0000 mgr.a (mgr.14373) 4909 : cluster [DBG] pgmap v3404: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-16T07:30:36.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:30:35 smithi157 bash[24585]: cluster 2024-09-16T07:30:34.480368+0000 mgr.a (mgr.14373) 4910 : cluster [DBG] pgmap v3405: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T07:30:36.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:30:35 smithi157 bash[24585]: audit 2024-09-16T07:30:35.150127+0000 mon.b (mon.2) 482 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T07:30:36.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:30:35 smithi086 bash[24289]: cluster 2024-09-16T07:30:34.480368+0000 mgr.a (mgr.14373) 4910 : cluster [DBG] pgmap v3405: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T07:30:36.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:30:35 smithi086 bash[24289]: audit 2024-09-16T07:30:35.150127+0000 mon.b (mon.2) 482 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T07:30:36.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:30:35 smithi047 bash[22744]: cluster 2024-09-16T07:30:34.480368+0000 mgr.a (mgr.14373) 4910 : cluster [DBG] pgmap v3405: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T07:30:36.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:30:35 smithi047 bash[22744]: audit 2024-09-16T07:30:35.150127+0000 mon.b (mon.2) 482 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T07:30:36.652 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:30:36.652 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:30:36.652 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:30:37.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:30:36 smithi157 bash[24585]: audit 2024-09-16T07:30:35.992251+0000 mon.b (mon.2) 483 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T07:30:37.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:30:36 smithi157 bash[24585]: audit 2024-09-16T07:30:35.994191+0000 mon.b (mon.2) 484 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T07:30:37.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:30:36 smithi157 bash[24585]: audit 2024-09-16T07:30:36.003973+0000 mon.a (mon.0) 860 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:30:37.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:30:36 smithi157 bash[24585]: audit 2024-09-16T07:30:36.014814+0000 mon.b (mon.2) 485 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:30:37.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:30:36 smithi086 bash[24289]: audit 2024-09-16T07:30:35.992251+0000 mon.b (mon.2) 483 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T07:30:37.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:30:36 smithi086 bash[24289]: audit 2024-09-16T07:30:35.994191+0000 mon.b (mon.2) 484 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T07:30:37.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:30:36 smithi086 bash[24289]: audit 2024-09-16T07:30:36.003973+0000 mon.a (mon.0) 860 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:30:37.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:30:36 smithi086 bash[24289]: audit 2024-09-16T07:30:36.014814+0000 mon.b (mon.2) 485 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:30:37.088 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 07:30:36 smithi047 bash[22994]: debug 2024-09-16T07:30:36.724+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T07:30:37.092 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 07:30:36 smithi047 bash[22994]: debug 2024-09-16T07:30:36.724+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T07:30:37.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:30:36 smithi047 bash[22744]: audit 2024-09-16T07:30:35.992251+0000 mon.b (mon.2) 483 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T07:30:37.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:30:36 smithi047 bash[22744]: audit 2024-09-16T07:30:35.994191+0000 mon.b (mon.2) 484 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T07:30:37.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:30:36 smithi047 bash[22744]: audit 2024-09-16T07:30:36.003973+0000 mon.a (mon.0) 860 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:30:37.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:30:36 smithi047 bash[22744]: audit 2024-09-16T07:30:36.014814+0000 mon.b (mon.2) 485 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:30:37.400 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:30:37.400 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:30:37.400 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:30:37.401 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:30:37.401 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:30:38.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:30:37 smithi157 bash[24585]: audit 2024-09-16T07:30:36.017234+0000 mgr.a (mgr.14373) 4911 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:30:38.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:30:37 smithi157 bash[24585]: cluster 2024-09-16T07:30:36.481466+0000 mgr.a (mgr.14373) 4912 : cluster [DBG] pgmap v3406: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 3.7 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-16T07:30:38.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:30:37 smithi157 bash[24585]: audit 2024-09-16T07:30:36.728133+0000 mgr.a (mgr.14373) 4913 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T07:30:38.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:30:37 smithi157 bash[24585]: cephadm 2024-09-16T07:30:36.729813+0000 mgr.a (mgr.14373) 4914 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T07:30:38.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:30:37 smithi086 bash[24289]: audit 2024-09-16T07:30:36.017234+0000 mgr.a (mgr.14373) 4911 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:30:38.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:30:37 smithi086 bash[24289]: cluster 2024-09-16T07:30:36.481466+0000 mgr.a (mgr.14373) 4912 : cluster [DBG] pgmap v3406: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 3.7 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-16T07:30:38.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:30:37 smithi086 bash[24289]: audit 2024-09-16T07:30:36.728133+0000 mgr.a (mgr.14373) 4913 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T07:30:38.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:30:37 smithi086 bash[24289]: cephadm 2024-09-16T07:30:36.729813+0000 mgr.a (mgr.14373) 4914 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T07:30:38.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:30:37 smithi047 bash[22744]: audit 2024-09-16T07:30:36.017234+0000 mgr.a (mgr.14373) 4911 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:30:38.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:30:37 smithi047 bash[22744]: cluster 2024-09-16T07:30:36.481466+0000 mgr.a (mgr.14373) 4912 : cluster [DBG] pgmap v3406: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 3.7 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-16T07:30:38.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:30:37 smithi047 bash[22744]: audit 2024-09-16T07:30:36.728133+0000 mgr.a (mgr.14373) 4913 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T07:30:38.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:30:37 smithi047 bash[22744]: cephadm 2024-09-16T07:30:36.729813+0000 mgr.a (mgr.14373) 4914 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T07:30:39.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:30:38 smithi157 bash[24585]: audit 2024-09-16T07:30:36.984656+0000 mgr.a (mgr.14373) 4915 : audit [DBG] from='client.115920 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:30:39.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:30:38 smithi086 bash[24289]: audit 2024-09-16T07:30:36.984656+0000 mgr.a (mgr.14373) 4915 : audit [DBG] from='client.115920 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:30:39.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:30:38 smithi047 bash[22744]: audit 2024-09-16T07:30:36.984656+0000 mgr.a (mgr.14373) 4915 : audit [DBG] from='client.115920 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:30:40.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:30:39 smithi157 bash[24585]: cluster 2024-09-16T07:30:38.482425+0000 mgr.a (mgr.14373) 4916 : cluster [DBG] pgmap v3407: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-16T07:30:40.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:30:39 smithi086 bash[24289]: cluster 2024-09-16T07:30:38.482425+0000 mgr.a (mgr.14373) 4916 : cluster [DBG] pgmap v3407: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-16T07:30:40.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:30:39 smithi047 bash[22744]: cluster 2024-09-16T07:30:38.482425+0000 mgr.a (mgr.14373) 4916 : cluster [DBG] pgmap v3407: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-16T07:30:42.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:30:41 smithi157 bash[24585]: cluster 2024-09-16T07:30:40.483245+0000 mgr.a (mgr.14373) 4917 : cluster [DBG] pgmap v3408: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-16T07:30:42.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:30:41 smithi086 bash[24289]: cluster 2024-09-16T07:30:40.483245+0000 mgr.a (mgr.14373) 4917 : cluster [DBG] pgmap v3408: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-16T07:30:42.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:30:41 smithi047 bash[22744]: cluster 2024-09-16T07:30:40.483245+0000 mgr.a (mgr.14373) 4917 : cluster [DBG] pgmap v3408: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-16T07:30:42.401 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:30:42.402 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:30:42.402 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:30:43.146 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:30:43.147 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:30:43.147 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:30:43.147 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:30:43.147 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:30:44.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:30:43 smithi157 bash[24585]: cluster 2024-09-16T07:30:42.485123+0000 mgr.a (mgr.14373) 4918 : cluster [DBG] pgmap v3409: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:30:44.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:30:43 smithi157 bash[24585]: audit 2024-09-16T07:30:42.742214+0000 mgr.a (mgr.14373) 4919 : audit [DBG] from='client.115995 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:30:44.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:30:43 smithi086 bash[24289]: cluster 2024-09-16T07:30:42.485123+0000 mgr.a (mgr.14373) 4918 : cluster [DBG] pgmap v3409: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:30:44.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:30:43 smithi086 bash[24289]: audit 2024-09-16T07:30:42.742214+0000 mgr.a (mgr.14373) 4919 : audit [DBG] from='client.115995 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:30:44.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:30:43 smithi047 bash[22744]: cluster 2024-09-16T07:30:42.485123+0000 mgr.a (mgr.14373) 4918 : cluster [DBG] pgmap v3409: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:30:44.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:30:43 smithi047 bash[22744]: audit 2024-09-16T07:30:42.742214+0000 mgr.a (mgr.14373) 4919 : audit [DBG] from='client.115995 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:30:46.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:30:45 smithi157 bash[24585]: cluster 2024-09-16T07:30:44.486031+0000 mgr.a (mgr.14373) 4920 : cluster [DBG] pgmap v3410: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T07:30:46.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:30:45 smithi086 bash[24289]: cluster 2024-09-16T07:30:44.486031+0000 mgr.a (mgr.14373) 4920 : cluster [DBG] pgmap v3410: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T07:30:46.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:30:45 smithi047 bash[22744]: cluster 2024-09-16T07:30:44.486031+0000 mgr.a (mgr.14373) 4920 : cluster [DBG] pgmap v3410: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T07:30:48.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:30:47 smithi157 bash[24585]: cluster 2024-09-16T07:30:46.488198+0000 mgr.a (mgr.14373) 4921 : cluster [DBG] pgmap v3411: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:30:48.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:30:47 smithi086 bash[24289]: cluster 2024-09-16T07:30:46.488198+0000 mgr.a (mgr.14373) 4921 : cluster [DBG] pgmap v3411: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:30:48.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:30:47 smithi047 bash[22744]: cluster 2024-09-16T07:30:46.488198+0000 mgr.a (mgr.14373) 4921 : cluster [DBG] pgmap v3411: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:30:48.148 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:30:48.149 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:30:48.149 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:30:48.925 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:30:48.926 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:30:48.926 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:30:48.926 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:30:48.926 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:30:50.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:30:49 smithi157 bash[24585]: audit 2024-09-16T07:30:48.487253+0000 mgr.a (mgr.14373) 4922 : audit [DBG] from='client.116070 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:30:50.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:30:49 smithi157 bash[24585]: cluster 2024-09-16T07:30:48.497822+0000 mgr.a (mgr.14373) 4923 : cluster [DBG] pgmap v3412: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 5.2 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-16T07:30:50.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:30:49 smithi086 bash[24289]: audit 2024-09-16T07:30:48.487253+0000 mgr.a (mgr.14373) 4922 : audit [DBG] from='client.116070 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:30:50.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:30:49 smithi086 bash[24289]: cluster 2024-09-16T07:30:48.497822+0000 mgr.a (mgr.14373) 4923 : cluster [DBG] pgmap v3412: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 5.2 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-16T07:30:50.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:30:49 smithi047 bash[22744]: audit 2024-09-16T07:30:48.487253+0000 mgr.a (mgr.14373) 4922 : audit [DBG] from='client.116070 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:30:50.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:30:49 smithi047 bash[22744]: cluster 2024-09-16T07:30:48.497822+0000 mgr.a (mgr.14373) 4923 : cluster [DBG] pgmap v3412: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 5.2 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-16T07:30:52.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:30:51 smithi157 bash[24585]: cluster 2024-09-16T07:30:50.498783+0000 mgr.a (mgr.14373) 4924 : cluster [DBG] pgmap v3413: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 5.2 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-16T07:30:52.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:30:51 smithi086 bash[24289]: cluster 2024-09-16T07:30:50.498783+0000 mgr.a (mgr.14373) 4924 : cluster [DBG] pgmap v3413: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 5.2 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-16T07:30:52.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:30:51 smithi047 bash[22744]: cluster 2024-09-16T07:30:50.498783+0000 mgr.a (mgr.14373) 4924 : cluster [DBG] pgmap v3413: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 5.2 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-16T07:30:53.927 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:30:53.928 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:30:53.928 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:30:54.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:30:53 smithi047 bash[22744]: cluster 2024-09-16T07:30:52.501036+0000 mgr.a (mgr.14373) 4925 : cluster [DBG] pgmap v3414: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-16T07:30:54.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:30:53 smithi157 bash[24585]: cluster 2024-09-16T07:30:52.501036+0000 mgr.a (mgr.14373) 4925 : cluster [DBG] pgmap v3414: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-16T07:30:54.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:30:53 smithi086 bash[24289]: cluster 2024-09-16T07:30:52.501036+0000 mgr.a (mgr.14373) 4925 : cluster [DBG] pgmap v3414: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-16T07:30:54.716 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:30:54.717 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:30:54.717 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:30:54.717 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:30:54.717 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:30:56.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:30:55 smithi047 bash[22744]: audit 2024-09-16T07:30:54.270553+0000 mgr.a (mgr.14373) 4926 : audit [DBG] from='client.116142 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:30:56.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:30:55 smithi047 bash[22744]: cluster 2024-09-16T07:30:54.501562+0000 mgr.a (mgr.14373) 4927 : cluster [DBG] pgmap v3415: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:30:56.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:30:55 smithi157 bash[24585]: audit 2024-09-16T07:30:54.270553+0000 mgr.a (mgr.14373) 4926 : audit [DBG] from='client.116142 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:30:56.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:30:55 smithi157 bash[24585]: cluster 2024-09-16T07:30:54.501562+0000 mgr.a (mgr.14373) 4927 : cluster [DBG] pgmap v3415: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:30:56.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:30:55 smithi086 bash[24289]: audit 2024-09-16T07:30:54.270553+0000 mgr.a (mgr.14373) 4926 : audit [DBG] from='client.116142 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:30:56.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:30:55 smithi086 bash[24289]: cluster 2024-09-16T07:30:54.501562+0000 mgr.a (mgr.14373) 4927 : cluster [DBG] pgmap v3415: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:30:58.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:30:57 smithi047 bash[22744]: cluster 2024-09-16T07:30:56.503778+0000 mgr.a (mgr.14373) 4928 : cluster [DBG] pgmap v3416: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:30:58.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:30:57 smithi157 bash[24585]: cluster 2024-09-16T07:30:56.503778+0000 mgr.a (mgr.14373) 4928 : cluster [DBG] pgmap v3416: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:30:58.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:30:57 smithi086 bash[24289]: cluster 2024-09-16T07:30:56.503778+0000 mgr.a (mgr.14373) 4928 : cluster [DBG] pgmap v3416: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:30:59.718 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:30:59.718 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:30:59.719 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:31:00.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:30:59 smithi047 bash[22744]: cluster 2024-09-16T07:30:58.504695+0000 mgr.a (mgr.14373) 4929 : cluster [DBG] pgmap v3417: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:31:00.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:30:59 smithi157 bash[24585]: cluster 2024-09-16T07:30:58.504695+0000 mgr.a (mgr.14373) 4929 : cluster [DBG] pgmap v3417: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:31:00.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:30:59 smithi086 bash[24289]: cluster 2024-09-16T07:30:58.504695+0000 mgr.a (mgr.14373) 4929 : cluster [DBG] pgmap v3417: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:31:00.490 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:31:00.490 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:31:00.490 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:31:00.490 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:31:00.490 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:31:02.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:31:01 smithi047 bash[22744]: audit 2024-09-16T07:31:00.055473+0000 mgr.a (mgr.14373) 4930 : audit [DBG] from='client.116220 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:31:02.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:31:01 smithi047 bash[22744]: cluster 2024-09-16T07:31:00.505359+0000 mgr.a (mgr.14373) 4931 : cluster [DBG] pgmap v3418: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:31:02.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:31:01 smithi157 bash[24585]: audit 2024-09-16T07:31:00.055473+0000 mgr.a (mgr.14373) 4930 : audit [DBG] from='client.116220 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:31:02.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:31:01 smithi157 bash[24585]: cluster 2024-09-16T07:31:00.505359+0000 mgr.a (mgr.14373) 4931 : cluster [DBG] pgmap v3418: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:31:02.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:31:01 smithi086 bash[24289]: audit 2024-09-16T07:31:00.055473+0000 mgr.a (mgr.14373) 4930 : audit [DBG] from='client.116220 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:31:02.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:31:01 smithi086 bash[24289]: cluster 2024-09-16T07:31:00.505359+0000 mgr.a (mgr.14373) 4931 : cluster [DBG] pgmap v3418: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:31:04.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:31:03 smithi047 bash[22744]: cluster 2024-09-16T07:31:02.507525+0000 mgr.a (mgr.14373) 4932 : cluster [DBG] pgmap v3419: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:31:04.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:31:03 smithi157 bash[24585]: cluster 2024-09-16T07:31:02.507525+0000 mgr.a (mgr.14373) 4932 : cluster [DBG] pgmap v3419: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:31:04.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:31:03 smithi086 bash[24289]: cluster 2024-09-16T07:31:02.507525+0000 mgr.a (mgr.14373) 4932 : cluster [DBG] pgmap v3419: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:31:05.491 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:31:05.492 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:31:05.492 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:31:06.268 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:31:06.268 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:31:06.268 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:31:06.268 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:31:06.268 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:31:06.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:31:05 smithi157 bash[24585]: cluster 2024-09-16T07:31:04.508291+0000 mgr.a (mgr.14373) 4933 : cluster [DBG] pgmap v3420: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:31:06.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:31:05 smithi086 bash[24289]: cluster 2024-09-16T07:31:04.508291+0000 mgr.a (mgr.14373) 4933 : cluster [DBG] pgmap v3420: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:31:06.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:31:05 smithi047 bash[22744]: cluster 2024-09-16T07:31:04.508291+0000 mgr.a (mgr.14373) 4933 : cluster [DBG] pgmap v3420: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:31:07.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:31:06 smithi157 bash[24585]: audit 2024-09-16T07:31:05.828242+0000 mgr.a (mgr.14373) 4934 : audit [DBG] from='client.116295 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:31:07.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:31:06 smithi086 bash[24289]: audit 2024-09-16T07:31:05.828242+0000 mgr.a (mgr.14373) 4934 : audit [DBG] from='client.116295 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:31:07.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:31:06 smithi047 bash[22744]: audit 2024-09-16T07:31:05.828242+0000 mgr.a (mgr.14373) 4934 : audit [DBG] from='client.116295 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:31:08.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:31:07 smithi157 bash[24585]: cluster 2024-09-16T07:31:06.510592+0000 mgr.a (mgr.14373) 4935 : cluster [DBG] pgmap v3421: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:31:08.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:31:07 smithi086 bash[24289]: cluster 2024-09-16T07:31:06.510592+0000 mgr.a (mgr.14373) 4935 : cluster [DBG] pgmap v3421: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:31:08.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:31:07 smithi047 bash[22744]: cluster 2024-09-16T07:31:06.510592+0000 mgr.a (mgr.14373) 4935 : cluster [DBG] pgmap v3421: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:31:09.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:31:08 smithi157 bash[24585]: cluster 2024-09-16T07:31:08.511361+0000 mgr.a (mgr.14373) 4936 : cluster [DBG] pgmap v3422: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:31:09.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:31:08 smithi086 bash[24289]: cluster 2024-09-16T07:31:08.511361+0000 mgr.a (mgr.14373) 4936 : cluster [DBG] pgmap v3422: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:31:09.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:31:08 smithi047 bash[22744]: cluster 2024-09-16T07:31:08.511361+0000 mgr.a (mgr.14373) 4936 : cluster [DBG] pgmap v3422: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:31:11.269 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:31:11.270 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:31:11.270 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:31:11.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:31:11 smithi086 bash[24289]: cluster 2024-09-16T07:31:10.512118+0000 mgr.a (mgr.14373) 4937 : cluster [DBG] pgmap v3423: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:31:11.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:31:11 smithi047 bash[22744]: cluster 2024-09-16T07:31:10.512118+0000 mgr.a (mgr.14373) 4937 : cluster [DBG] pgmap v3423: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:31:12.009 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:31:12.010 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:31:12.010 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:31:12.010 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:31:12.010 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:31:12.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:31:11 smithi157 bash[24585]: cluster 2024-09-16T07:31:10.512118+0000 mgr.a (mgr.14373) 4937 : cluster [DBG] pgmap v3423: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:31:12.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:31:12 smithi047 bash[22744]: audit 2024-09-16T07:31:11.603034+0000 mgr.a (mgr.14373) 4938 : audit [DBG] from='client.116370 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:31:13.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:31:12 smithi157 bash[24585]: audit 2024-09-16T07:31:11.603034+0000 mgr.a (mgr.14373) 4938 : audit [DBG] from='client.116370 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:31:13.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:31:12 smithi086 bash[24289]: audit 2024-09-16T07:31:11.603034+0000 mgr.a (mgr.14373) 4938 : audit [DBG] from='client.116370 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:31:13.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:31:13 smithi047 bash[22744]: cluster 2024-09-16T07:31:12.514775+0000 mgr.a (mgr.14373) 4939 : cluster [DBG] pgmap v3424: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:31:14.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:31:13 smithi157 bash[24585]: cluster 2024-09-16T07:31:12.514775+0000 mgr.a (mgr.14373) 4939 : cluster [DBG] pgmap v3424: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:31:14.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:31:13 smithi086 bash[24289]: cluster 2024-09-16T07:31:12.514775+0000 mgr.a (mgr.14373) 4939 : cluster [DBG] pgmap v3424: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:31:15.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:31:15 smithi047 bash[22744]: cluster 2024-09-16T07:31:14.515561+0000 mgr.a (mgr.14373) 4940 : cluster [DBG] pgmap v3425: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:31:16.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:31:15 smithi157 bash[24585]: cluster 2024-09-16T07:31:14.515561+0000 mgr.a (mgr.14373) 4940 : cluster [DBG] pgmap v3425: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:31:16.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:31:15 smithi086 bash[24289]: cluster 2024-09-16T07:31:14.515561+0000 mgr.a (mgr.14373) 4940 : cluster [DBG] pgmap v3425: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:31:17.011 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:31:17.012 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:31:17.012 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:31:17.787 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:31:17.788 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:31:17.788 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:31:17.788 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:31:17.788 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:31:17.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:31:17 smithi047 bash[22744]: cluster 2024-09-16T07:31:16.517458+0000 mgr.a (mgr.14373) 4941 : cluster [DBG] pgmap v3426: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:31:18.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:31:17 smithi157 bash[24585]: cluster 2024-09-16T07:31:16.517458+0000 mgr.a (mgr.14373) 4941 : cluster [DBG] pgmap v3426: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:31:18.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:31:17 smithi086 bash[24289]: cluster 2024-09-16T07:31:16.517458+0000 mgr.a (mgr.14373) 4941 : cluster [DBG] pgmap v3426: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:31:18.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:31:18 smithi047 bash[22744]: audit 2024-09-16T07:31:17.353338+0000 mgr.a (mgr.14373) 4942 : audit [DBG] from='client.116448 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:31:19.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:31:18 smithi157 bash[24585]: audit 2024-09-16T07:31:17.353338+0000 mgr.a (mgr.14373) 4942 : audit [DBG] from='client.116448 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:31:19.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:31:18 smithi086 bash[24289]: audit 2024-09-16T07:31:17.353338+0000 mgr.a (mgr.14373) 4942 : audit [DBG] from='client.116448 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:31:20.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:31:19 smithi157 bash[24585]: cluster 2024-09-16T07:31:18.518402+0000 mgr.a (mgr.14373) 4943 : cluster [DBG] pgmap v3427: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:31:20.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:31:19 smithi086 bash[24289]: cluster 2024-09-16T07:31:18.518402+0000 mgr.a (mgr.14373) 4943 : cluster [DBG] pgmap v3427: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:31:20.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:31:19 smithi047 bash[22744]: cluster 2024-09-16T07:31:18.518402+0000 mgr.a (mgr.14373) 4943 : cluster [DBG] pgmap v3427: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:31:22.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:31:21 smithi157 bash[24585]: cluster 2024-09-16T07:31:20.519173+0000 mgr.a (mgr.14373) 4944 : cluster [DBG] pgmap v3428: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T07:31:22.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:31:21 smithi086 bash[24289]: cluster 2024-09-16T07:31:20.519173+0000 mgr.a (mgr.14373) 4944 : cluster [DBG] pgmap v3428: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T07:31:22.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:31:21 smithi047 bash[22744]: cluster 2024-09-16T07:31:20.519173+0000 mgr.a (mgr.14373) 4944 : cluster [DBG] pgmap v3428: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T07:31:22.789 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:31:22.790 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:31:22.790 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:31:23.565 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:31:23.565 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:31:23.565 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:31:23.565 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:31:23.566 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:31:24.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:31:23 smithi157 bash[24585]: cluster 2024-09-16T07:31:22.521369+0000 mgr.a (mgr.14373) 4945 : cluster [DBG] pgmap v3429: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:31:24.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:31:23 smithi086 bash[24289]: cluster 2024-09-16T07:31:22.521369+0000 mgr.a (mgr.14373) 4945 : cluster [DBG] pgmap v3429: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:31:24.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:31:23 smithi047 bash[22744]: cluster 2024-09-16T07:31:22.521369+0000 mgr.a (mgr.14373) 4945 : cluster [DBG] pgmap v3429: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:31:25.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:31:24 smithi157 bash[24585]: audit 2024-09-16T07:31:23.124332+0000 mgr.a (mgr.14373) 4946 : audit [DBG] from='client.116523 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:31:25.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:31:24 smithi086 bash[24289]: audit 2024-09-16T07:31:23.124332+0000 mgr.a (mgr.14373) 4946 : audit [DBG] from='client.116523 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:31:25.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:31:24 smithi047 bash[22744]: audit 2024-09-16T07:31:23.124332+0000 mgr.a (mgr.14373) 4946 : audit [DBG] from='client.116523 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:31:26.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:31:25 smithi157 bash[24585]: cluster 2024-09-16T07:31:24.522270+0000 mgr.a (mgr.14373) 4947 : cluster [DBG] pgmap v3430: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:31:26.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:31:25 smithi086 bash[24289]: cluster 2024-09-16T07:31:24.522270+0000 mgr.a (mgr.14373) 4947 : cluster [DBG] pgmap v3430: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:31:26.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:31:25 smithi047 bash[22744]: cluster 2024-09-16T07:31:24.522270+0000 mgr.a (mgr.14373) 4947 : cluster [DBG] pgmap v3430: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:31:28.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:31:27 smithi157 bash[24585]: cluster 2024-09-16T07:31:26.524449+0000 mgr.a (mgr.14373) 4948 : cluster [DBG] pgmap v3431: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:31:28.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:31:27 smithi086 bash[24289]: cluster 2024-09-16T07:31:26.524449+0000 mgr.a (mgr.14373) 4948 : cluster [DBG] pgmap v3431: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:31:28.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:31:27 smithi047 bash[22744]: cluster 2024-09-16T07:31:26.524449+0000 mgr.a (mgr.14373) 4948 : cluster [DBG] pgmap v3431: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:31:28.566 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:31:28.566 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:31:28.566 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:31:29.314 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:31:29.315 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:31:29.315 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:31:29.315 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:31:29.315 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:31:30.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:31:29 smithi157 bash[24585]: cluster 2024-09-16T07:31:28.525207+0000 mgr.a (mgr.14373) 4949 : cluster [DBG] pgmap v3432: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:31:30.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:31:29 smithi086 bash[24289]: cluster 2024-09-16T07:31:28.525207+0000 mgr.a (mgr.14373) 4949 : cluster [DBG] pgmap v3432: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:31:30.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:31:29 smithi047 bash[22744]: cluster 2024-09-16T07:31:28.525207+0000 mgr.a (mgr.14373) 4949 : cluster [DBG] pgmap v3432: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:31:31.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:31:30 smithi157 bash[24585]: audit 2024-09-16T07:31:28.898551+0000 mgr.a (mgr.14373) 4950 : audit [DBG] from='client.116601 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:31:31.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:31:30 smithi086 bash[24289]: audit 2024-09-16T07:31:28.898551+0000 mgr.a (mgr.14373) 4950 : audit [DBG] from='client.116601 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:31:31.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:31:30 smithi047 bash[22744]: audit 2024-09-16T07:31:28.898551+0000 mgr.a (mgr.14373) 4950 : audit [DBG] from='client.116601 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:31:32.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:31:31 smithi157 bash[24585]: cluster 2024-09-16T07:31:30.526127+0000 mgr.a (mgr.14373) 4951 : cluster [DBG] pgmap v3433: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:31:32.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:31:31 smithi086 bash[24289]: cluster 2024-09-16T07:31:30.526127+0000 mgr.a (mgr.14373) 4951 : cluster [DBG] pgmap v3433: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:31:32.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:31:31 smithi047 bash[22744]: cluster 2024-09-16T07:31:30.526127+0000 mgr.a (mgr.14373) 4951 : cluster [DBG] pgmap v3433: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:31:34.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:31:33 smithi157 bash[24585]: cluster 2024-09-16T07:31:32.528359+0000 mgr.a (mgr.14373) 4952 : cluster [DBG] pgmap v3434: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:31:34.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:31:33 smithi086 bash[24289]: cluster 2024-09-16T07:31:32.528359+0000 mgr.a (mgr.14373) 4952 : cluster [DBG] pgmap v3434: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:31:34.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:31:33 smithi047 bash[22744]: cluster 2024-09-16T07:31:32.528359+0000 mgr.a (mgr.14373) 4952 : cluster [DBG] pgmap v3434: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:31:34.316 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:31:34.317 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:31:34.317 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:31:35.079 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:31:35.079 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:31:35.079 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:31:35.079 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:31:35.079 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:31:36.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:31:35 smithi157 bash[24585]: cluster 2024-09-16T07:31:34.529085+0000 mgr.a (mgr.14373) 4953 : cluster [DBG] pgmap v3435: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:31:36.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:31:35 smithi157 bash[24585]: audit 2024-09-16T07:31:34.655582+0000 mgr.a (mgr.14373) 4954 : audit [DBG] from='client.116679 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:31:36.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:31:35 smithi086 bash[24289]: cluster 2024-09-16T07:31:34.529085+0000 mgr.a (mgr.14373) 4953 : cluster [DBG] pgmap v3435: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:31:36.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:31:35 smithi086 bash[24289]: audit 2024-09-16T07:31:34.655582+0000 mgr.a (mgr.14373) 4954 : audit [DBG] from='client.116679 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:31:36.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:31:35 smithi047 bash[22744]: cluster 2024-09-16T07:31:34.529085+0000 mgr.a (mgr.14373) 4953 : cluster [DBG] pgmap v3435: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:31:36.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:31:35 smithi047 bash[22744]: audit 2024-09-16T07:31:34.655582+0000 mgr.a (mgr.14373) 4954 : audit [DBG] from='client.116679 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:31:38.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:31:37 smithi157 bash[24585]: cluster 2024-09-16T07:31:36.531635+0000 mgr.a (mgr.14373) 4955 : cluster [DBG] pgmap v3436: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:31:38.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:31:37 smithi157 bash[24585]: audit 2024-09-16T07:31:36.786347+0000 mon.b (mon.2) 486 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T07:31:38.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:31:37 smithi157 bash[24585]: audit 2024-09-16T07:31:37.629102+0000 mon.b (mon.2) 487 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T07:31:38.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:31:37 smithi157 bash[24585]: audit 2024-09-16T07:31:37.631244+0000 mon.b (mon.2) 488 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T07:31:38.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:31:37 smithi157 bash[24585]: audit 2024-09-16T07:31:37.643712+0000 mon.a (mon.0) 861 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:31:38.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:31:37 smithi086 bash[24289]: cluster 2024-09-16T07:31:36.531635+0000 mgr.a (mgr.14373) 4955 : cluster [DBG] pgmap v3436: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:31:38.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:31:37 smithi086 bash[24289]: audit 2024-09-16T07:31:36.786347+0000 mon.b (mon.2) 486 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T07:31:38.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:31:37 smithi086 bash[24289]: audit 2024-09-16T07:31:37.629102+0000 mon.b (mon.2) 487 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T07:31:38.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:31:37 smithi086 bash[24289]: audit 2024-09-16T07:31:37.631244+0000 mon.b (mon.2) 488 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T07:31:38.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:31:37 smithi086 bash[24289]: audit 2024-09-16T07:31:37.643712+0000 mon.a (mon.0) 861 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:31:38.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:31:37 smithi047 bash[22744]: cluster 2024-09-16T07:31:36.531635+0000 mgr.a (mgr.14373) 4955 : cluster [DBG] pgmap v3436: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:31:38.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:31:37 smithi047 bash[22744]: audit 2024-09-16T07:31:36.786347+0000 mon.b (mon.2) 486 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T07:31:38.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:31:37 smithi047 bash[22744]: audit 2024-09-16T07:31:37.629102+0000 mon.b (mon.2) 487 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T07:31:38.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:31:37 smithi047 bash[22744]: audit 2024-09-16T07:31:37.631244+0000 mon.b (mon.2) 488 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T07:31:38.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:31:37 smithi047 bash[22744]: audit 2024-09-16T07:31:37.643712+0000 mon.a (mon.0) 861 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:31:38.657 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 07:31:38 smithi047 bash[22994]: debug 2024-09-16T07:31:38.371+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T07:31:38.657 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 07:31:38 smithi047 bash[22994]: debug 2024-09-16T07:31:38.371+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T07:31:39.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:31:38 smithi157 bash[24585]: audit 2024-09-16T07:31:37.648679+0000 mon.b (mon.2) 489 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:31:39.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:31:38 smithi157 bash[24585]: audit 2024-09-16T07:31:37.652515+0000 mgr.a (mgr.14373) 4956 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:31:39.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:31:38 smithi086 bash[24289]: audit 2024-09-16T07:31:37.648679+0000 mon.b (mon.2) 489 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:31:39.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:31:38 smithi086 bash[24289]: audit 2024-09-16T07:31:37.652515+0000 mgr.a (mgr.14373) 4956 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:31:39.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:31:38 smithi047 bash[22744]: audit 2024-09-16T07:31:37.648679+0000 mon.b (mon.2) 489 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:31:39.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:31:38 smithi047 bash[22744]: audit 2024-09-16T07:31:37.652515+0000 mgr.a (mgr.14373) 4956 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:31:40.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:31:39 smithi157 bash[24585]: audit 2024-09-16T07:31:38.376168+0000 mgr.a (mgr.14373) 4957 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T07:31:40.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:31:39 smithi157 bash[24585]: cephadm 2024-09-16T07:31:38.377979+0000 mgr.a (mgr.14373) 4958 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T07:31:40.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:31:39 smithi157 bash[24585]: cluster 2024-09-16T07:31:38.532553+0000 mgr.a (mgr.14373) 4959 : cluster [DBG] pgmap v3437: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:31:40.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:31:39 smithi086 bash[24289]: audit 2024-09-16T07:31:38.376168+0000 mgr.a (mgr.14373) 4957 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T07:31:40.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:31:39 smithi086 bash[24289]: cephadm 2024-09-16T07:31:38.377979+0000 mgr.a (mgr.14373) 4958 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T07:31:40.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:31:39 smithi086 bash[24289]: cluster 2024-09-16T07:31:38.532553+0000 mgr.a (mgr.14373) 4959 : cluster [DBG] pgmap v3437: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:31:40.080 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:31:40.081 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:31:40.081 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:31:40.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:31:39 smithi047 bash[22744]: audit 2024-09-16T07:31:38.376168+0000 mgr.a (mgr.14373) 4957 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T07:31:40.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:31:39 smithi047 bash[22744]: cephadm 2024-09-16T07:31:38.377979+0000 mgr.a (mgr.14373) 4958 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T07:31:40.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:31:39 smithi047 bash[22744]: cluster 2024-09-16T07:31:38.532553+0000 mgr.a (mgr.14373) 4959 : cluster [DBG] pgmap v3437: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:31:40.867 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:31:40.868 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:31:40.868 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:31:40.868 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:31:40.868 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:31:42.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:31:41 smithi157 bash[24585]: audit 2024-09-16T07:31:40.425010+0000 mgr.a (mgr.14373) 4960 : audit [DBG] from='client.116856 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:31:42.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:31:41 smithi157 bash[24585]: cluster 2024-09-16T07:31:40.533075+0000 mgr.a (mgr.14373) 4961 : cluster [DBG] pgmap v3438: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:31:42.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:31:41 smithi086 bash[24289]: audit 2024-09-16T07:31:40.425010+0000 mgr.a (mgr.14373) 4960 : audit [DBG] from='client.116856 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:31:42.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:31:41 smithi086 bash[24289]: cluster 2024-09-16T07:31:40.533075+0000 mgr.a (mgr.14373) 4961 : cluster [DBG] pgmap v3438: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:31:42.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:31:41 smithi047 bash[22744]: audit 2024-09-16T07:31:40.425010+0000 mgr.a (mgr.14373) 4960 : audit [DBG] from='client.116856 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:31:42.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:31:41 smithi047 bash[22744]: cluster 2024-09-16T07:31:40.533075+0000 mgr.a (mgr.14373) 4961 : cluster [DBG] pgmap v3438: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:31:44.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:31:43 smithi157 bash[24585]: cluster 2024-09-16T07:31:42.535412+0000 mgr.a (mgr.14373) 4962 : cluster [DBG] pgmap v3439: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:31:44.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:31:43 smithi086 bash[24289]: cluster 2024-09-16T07:31:42.535412+0000 mgr.a (mgr.14373) 4962 : cluster [DBG] pgmap v3439: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:31:44.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:31:43 smithi047 bash[22744]: cluster 2024-09-16T07:31:42.535412+0000 mgr.a (mgr.14373) 4962 : cluster [DBG] pgmap v3439: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:31:45.869 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:31:45.870 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:31:45.870 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:31:46.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:31:45 smithi157 bash[24585]: cluster 2024-09-16T07:31:44.536175+0000 mgr.a (mgr.14373) 4963 : cluster [DBG] pgmap v3440: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:31:46.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:31:45 smithi086 bash[24289]: cluster 2024-09-16T07:31:44.536175+0000 mgr.a (mgr.14373) 4963 : cluster [DBG] pgmap v3440: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:31:46.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:31:45 smithi047 bash[22744]: cluster 2024-09-16T07:31:44.536175+0000 mgr.a (mgr.14373) 4963 : cluster [DBG] pgmap v3440: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:31:46.620 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:31:46.620 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:31:46.620 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:31:46.620 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:31:46.621 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:31:48.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:31:47 smithi157 bash[24585]: audit 2024-09-16T07:31:46.206834+0000 mgr.a (mgr.14373) 4964 : audit [DBG] from='client.116931 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:31:48.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:31:47 smithi157 bash[24585]: cluster 2024-09-16T07:31:46.537412+0000 mgr.a (mgr.14373) 4965 : cluster [DBG] pgmap v3441: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:31:48.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:31:47 smithi086 bash[24289]: audit 2024-09-16T07:31:46.206834+0000 mgr.a (mgr.14373) 4964 : audit [DBG] from='client.116931 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:31:48.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:31:47 smithi086 bash[24289]: cluster 2024-09-16T07:31:46.537412+0000 mgr.a (mgr.14373) 4965 : cluster [DBG] pgmap v3441: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:31:48.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:31:47 smithi047 bash[22744]: audit 2024-09-16T07:31:46.206834+0000 mgr.a (mgr.14373) 4964 : audit [DBG] from='client.116931 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:31:48.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:31:47 smithi047 bash[22744]: cluster 2024-09-16T07:31:46.537412+0000 mgr.a (mgr.14373) 4965 : cluster [DBG] pgmap v3441: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:31:50.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:31:49 smithi157 bash[24585]: cluster 2024-09-16T07:31:48.538154+0000 mgr.a (mgr.14373) 4966 : cluster [DBG] pgmap v3442: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T07:31:50.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:31:49 smithi086 bash[24289]: cluster 2024-09-16T07:31:48.538154+0000 mgr.a (mgr.14373) 4966 : cluster [DBG] pgmap v3442: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T07:31:50.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:31:49 smithi047 bash[22744]: cluster 2024-09-16T07:31:48.538154+0000 mgr.a (mgr.14373) 4966 : cluster [DBG] pgmap v3442: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T07:31:51.621 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:31:51.624 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:31:51.624 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:31:52.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:31:51 smithi157 bash[24585]: cluster 2024-09-16T07:31:50.538931+0000 mgr.a (mgr.14373) 4967 : cluster [DBG] pgmap v3443: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T07:31:52.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:31:51 smithi086 bash[24289]: cluster 2024-09-16T07:31:50.538931+0000 mgr.a (mgr.14373) 4967 : cluster [DBG] pgmap v3443: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T07:31:52.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:31:51 smithi047 bash[22744]: cluster 2024-09-16T07:31:50.538931+0000 mgr.a (mgr.14373) 4967 : cluster [DBG] pgmap v3443: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T07:31:52.400 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:31:52.401 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:31:52.401 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:31:52.401 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:31:52.401 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:31:54.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:31:53 smithi047 bash[22744]: audit 2024-09-16T07:31:51.963707+0000 mgr.a (mgr.14373) 4968 : audit [DBG] from='client.117009 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:31:54.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:31:53 smithi047 bash[22744]: cluster 2024-09-16T07:31:52.541623+0000 mgr.a (mgr.14373) 4969 : cluster [DBG] pgmap v3444: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:31:54.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:31:53 smithi157 bash[24585]: audit 2024-09-16T07:31:51.963707+0000 mgr.a (mgr.14373) 4968 : audit [DBG] from='client.117009 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:31:54.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:31:53 smithi157 bash[24585]: cluster 2024-09-16T07:31:52.541623+0000 mgr.a (mgr.14373) 4969 : cluster [DBG] pgmap v3444: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:31:54.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:31:53 smithi086 bash[24289]: audit 2024-09-16T07:31:51.963707+0000 mgr.a (mgr.14373) 4968 : audit [DBG] from='client.117009 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:31:54.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:31:53 smithi086 bash[24289]: cluster 2024-09-16T07:31:52.541623+0000 mgr.a (mgr.14373) 4969 : cluster [DBG] pgmap v3444: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:31:56.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:31:55 smithi047 bash[22744]: cluster 2024-09-16T07:31:54.542418+0000 mgr.a (mgr.14373) 4970 : cluster [DBG] pgmap v3445: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T07:31:56.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:31:55 smithi157 bash[24585]: cluster 2024-09-16T07:31:54.542418+0000 mgr.a (mgr.14373) 4970 : cluster [DBG] pgmap v3445: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T07:31:56.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:31:55 smithi086 bash[24289]: cluster 2024-09-16T07:31:54.542418+0000 mgr.a (mgr.14373) 4970 : cluster [DBG] pgmap v3445: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T07:31:57.402 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:31:57.403 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:31:57.403 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:31:58.187 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:31:58.188 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:31:58.188 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:31:58.188 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:31:58.188 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:31:58.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:31:57 smithi157 bash[24585]: cluster 2024-09-16T07:31:56.544331+0000 mgr.a (mgr.14373) 4971 : cluster [DBG] pgmap v3446: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:31:58.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:31:57 smithi086 bash[24289]: cluster 2024-09-16T07:31:56.544331+0000 mgr.a (mgr.14373) 4971 : cluster [DBG] pgmap v3446: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:31:58.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:31:57 smithi047 bash[22744]: cluster 2024-09-16T07:31:56.544331+0000 mgr.a (mgr.14373) 4971 : cluster [DBG] pgmap v3446: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:31:59.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:31:58 smithi157 bash[24585]: audit 2024-09-16T07:31:57.746175+0000 mgr.a (mgr.14373) 4972 : audit [DBG] from='client.117087 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:31:59.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:31:58 smithi086 bash[24289]: audit 2024-09-16T07:31:57.746175+0000 mgr.a (mgr.14373) 4972 : audit [DBG] from='client.117087 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:31:59.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:31:58 smithi047 bash[22744]: audit 2024-09-16T07:31:57.746175+0000 mgr.a (mgr.14373) 4972 : audit [DBG] from='client.117087 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:32:00.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:31:59 smithi157 bash[24585]: cluster 2024-09-16T07:31:58.545343+0000 mgr.a (mgr.14373) 4973 : cluster [DBG] pgmap v3447: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-16T07:32:00.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:31:59 smithi086 bash[24289]: cluster 2024-09-16T07:31:58.545343+0000 mgr.a (mgr.14373) 4973 : cluster [DBG] pgmap v3447: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-16T07:32:00.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:31:59 smithi047 bash[22744]: cluster 2024-09-16T07:31:58.545343+0000 mgr.a (mgr.14373) 4973 : cluster [DBG] pgmap v3447: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-16T07:32:02.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:32:01 smithi157 bash[24585]: cluster 2024-09-16T07:32:00.546157+0000 mgr.a (mgr.14373) 4974 : cluster [DBG] pgmap v3448: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-16T07:32:02.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:32:01 smithi086 bash[24289]: cluster 2024-09-16T07:32:00.546157+0000 mgr.a (mgr.14373) 4974 : cluster [DBG] pgmap v3448: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-16T07:32:02.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:32:01 smithi047 bash[22744]: cluster 2024-09-16T07:32:00.546157+0000 mgr.a (mgr.14373) 4974 : cluster [DBG] pgmap v3448: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-16T07:32:03.189 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:32:03.190 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:32:03.190 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:32:03.921 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:32:03.921 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:32:03.921 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:32:03.921 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:32:03.921 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:32:04.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:32:03 smithi157 bash[24585]: cluster 2024-09-16T07:32:02.548430+0000 mgr.a (mgr.14373) 4975 : cluster [DBG] pgmap v3449: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-16T07:32:04.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:32:03 smithi086 bash[24289]: cluster 2024-09-16T07:32:02.548430+0000 mgr.a (mgr.14373) 4975 : cluster [DBG] pgmap v3449: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-16T07:32:04.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:32:03 smithi047 bash[22744]: cluster 2024-09-16T07:32:02.548430+0000 mgr.a (mgr.14373) 4975 : cluster [DBG] pgmap v3449: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-16T07:32:05.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:32:04 smithi157 bash[24585]: audit 2024-09-16T07:32:03.518281+0000 mgr.a (mgr.14373) 4976 : audit [DBG] from='client.117165 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:32:05.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:32:04 smithi086 bash[24289]: audit 2024-09-16T07:32:03.518281+0000 mgr.a (mgr.14373) 4976 : audit [DBG] from='client.117165 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:32:05.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:32:04 smithi047 bash[22744]: audit 2024-09-16T07:32:03.518281+0000 mgr.a (mgr.14373) 4976 : audit [DBG] from='client.117165 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:32:06.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:32:05 smithi157 bash[24585]: cluster 2024-09-16T07:32:04.549456+0000 mgr.a (mgr.14373) 4977 : cluster [DBG] pgmap v3450: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:32:06.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:32:05 smithi086 bash[24289]: cluster 2024-09-16T07:32:04.549456+0000 mgr.a (mgr.14373) 4977 : cluster [DBG] pgmap v3450: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:32:06.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:32:05 smithi047 bash[22744]: cluster 2024-09-16T07:32:04.549456+0000 mgr.a (mgr.14373) 4977 : cluster [DBG] pgmap v3450: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:32:07.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:32:06 smithi157 bash[24585]: cluster 2024-09-16T07:32:06.551601+0000 mgr.a (mgr.14373) 4978 : cluster [DBG] pgmap v3451: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:32:07.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:32:06 smithi086 bash[24289]: cluster 2024-09-16T07:32:06.551601+0000 mgr.a (mgr.14373) 4978 : cluster [DBG] pgmap v3451: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:32:07.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:32:06 smithi047 bash[22744]: cluster 2024-09-16T07:32:06.551601+0000 mgr.a (mgr.14373) 4978 : cluster [DBG] pgmap v3451: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:32:08.925 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:32:08.925 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:32:08.925 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:32:09.683 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:32:09.683 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:32:09.684 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:32:09.684 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:32:09.684 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:32:10.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:32:09 smithi157 bash[24585]: cluster 2024-09-16T07:32:08.552382+0000 mgr.a (mgr.14373) 4979 : cluster [DBG] pgmap v3452: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:32:10.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:32:09 smithi086 bash[24289]: cluster 2024-09-16T07:32:08.552382+0000 mgr.a (mgr.14373) 4979 : cluster [DBG] pgmap v3452: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:32:10.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:32:09 smithi047 bash[22744]: cluster 2024-09-16T07:32:08.552382+0000 mgr.a (mgr.14373) 4979 : cluster [DBG] pgmap v3452: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:32:11.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:32:10 smithi157 bash[24585]: audit 2024-09-16T07:32:09.258421+0000 mgr.a (mgr.14373) 4980 : audit [DBG] from='client.117240 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:32:11.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:32:10 smithi086 bash[24289]: audit 2024-09-16T07:32:09.258421+0000 mgr.a (mgr.14373) 4980 : audit [DBG] from='client.117240 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:32:11.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:32:10 smithi047 bash[22744]: audit 2024-09-16T07:32:09.258421+0000 mgr.a (mgr.14373) 4980 : audit [DBG] from='client.117240 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:32:12.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:32:11 smithi157 bash[24585]: cluster 2024-09-16T07:32:10.553351+0000 mgr.a (mgr.14373) 4981 : cluster [DBG] pgmap v3453: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:32:12.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:32:11 smithi086 bash[24289]: cluster 2024-09-16T07:32:10.553351+0000 mgr.a (mgr.14373) 4981 : cluster [DBG] pgmap v3453: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:32:12.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:32:11 smithi047 bash[22744]: cluster 2024-09-16T07:32:10.553351+0000 mgr.a (mgr.14373) 4981 : cluster [DBG] pgmap v3453: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:32:14.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:32:13 smithi157 bash[24585]: cluster 2024-09-16T07:32:12.555609+0000 mgr.a (mgr.14373) 4982 : cluster [DBG] pgmap v3454: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:32:14.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:32:13 smithi086 bash[24289]: cluster 2024-09-16T07:32:12.555609+0000 mgr.a (mgr.14373) 4982 : cluster [DBG] pgmap v3454: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:32:14.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:32:13 smithi047 bash[22744]: cluster 2024-09-16T07:32:12.555609+0000 mgr.a (mgr.14373) 4982 : cluster [DBG] pgmap v3454: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:32:14.685 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:32:14.686 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:32:14.686 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:32:15.421 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:32:15.422 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:32:15.422 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:32:15.422 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:32:15.422 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:32:16.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:32:15 smithi157 bash[24585]: cluster 2024-09-16T07:32:14.556382+0000 mgr.a (mgr.14373) 4983 : cluster [DBG] pgmap v3455: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:32:16.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:32:15 smithi086 bash[24289]: cluster 2024-09-16T07:32:14.556382+0000 mgr.a (mgr.14373) 4983 : cluster [DBG] pgmap v3455: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:32:16.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:32:15 smithi047 bash[22744]: cluster 2024-09-16T07:32:14.556382+0000 mgr.a (mgr.14373) 4983 : cluster [DBG] pgmap v3455: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:32:17.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:32:16 smithi157 bash[24585]: audit 2024-09-16T07:32:15.021178+0000 mgr.a (mgr.14373) 4984 : audit [DBG] from='client.117318 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:32:17.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:32:16 smithi086 bash[24289]: audit 2024-09-16T07:32:15.021178+0000 mgr.a (mgr.14373) 4984 : audit [DBG] from='client.117318 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:32:17.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:32:16 smithi047 bash[22744]: audit 2024-09-16T07:32:15.021178+0000 mgr.a (mgr.14373) 4984 : audit [DBG] from='client.117318 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:32:18.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:32:17 smithi157 bash[24585]: cluster 2024-09-16T07:32:16.558723+0000 mgr.a (mgr.14373) 4985 : cluster [DBG] pgmap v3456: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:32:18.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:32:17 smithi086 bash[24289]: cluster 2024-09-16T07:32:16.558723+0000 mgr.a (mgr.14373) 4985 : cluster [DBG] pgmap v3456: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:32:18.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:32:17 smithi047 bash[22744]: cluster 2024-09-16T07:32:16.558723+0000 mgr.a (mgr.14373) 4985 : cluster [DBG] pgmap v3456: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:32:20.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:32:19 smithi157 bash[24585]: cluster 2024-09-16T07:32:18.559517+0000 mgr.a (mgr.14373) 4986 : cluster [DBG] pgmap v3457: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:32:20.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:32:19 smithi086 bash[24289]: cluster 2024-09-16T07:32:18.559517+0000 mgr.a (mgr.14373) 4986 : cluster [DBG] pgmap v3457: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:32:20.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:32:19 smithi047 bash[22744]: cluster 2024-09-16T07:32:18.559517+0000 mgr.a (mgr.14373) 4986 : cluster [DBG] pgmap v3457: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:32:20.423 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:32:20.424 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:32:20.424 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:32:21.170 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:32:21.170 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:32:21.171 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:32:21.171 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:32:21.171 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:32:22.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:32:21 smithi157 bash[24585]: cluster 2024-09-16T07:32:20.559966+0000 mgr.a (mgr.14373) 4987 : cluster [DBG] pgmap v3458: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:32:22.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:32:21 smithi157 bash[24585]: audit 2024-09-16T07:32:20.760382+0000 mgr.a (mgr.14373) 4988 : audit [DBG] from='client.117393 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:32:22.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:32:21 smithi086 bash[24289]: cluster 2024-09-16T07:32:20.559966+0000 mgr.a (mgr.14373) 4987 : cluster [DBG] pgmap v3458: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:32:22.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:32:21 smithi086 bash[24289]: audit 2024-09-16T07:32:20.760382+0000 mgr.a (mgr.14373) 4988 : audit [DBG] from='client.117393 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:32:22.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:32:21 smithi047 bash[22744]: cluster 2024-09-16T07:32:20.559966+0000 mgr.a (mgr.14373) 4987 : cluster [DBG] pgmap v3458: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:32:22.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:32:21 smithi047 bash[22744]: audit 2024-09-16T07:32:20.760382+0000 mgr.a (mgr.14373) 4988 : audit [DBG] from='client.117393 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:32:24.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:32:23 smithi157 bash[24585]: cluster 2024-09-16T07:32:22.562316+0000 mgr.a (mgr.14373) 4989 : cluster [DBG] pgmap v3459: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:32:24.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:32:23 smithi086 bash[24289]: cluster 2024-09-16T07:32:22.562316+0000 mgr.a (mgr.14373) 4989 : cluster [DBG] pgmap v3459: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:32:24.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:32:23 smithi047 bash[22744]: cluster 2024-09-16T07:32:22.562316+0000 mgr.a (mgr.14373) 4989 : cluster [DBG] pgmap v3459: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:32:26.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:32:25 smithi157 bash[24585]: cluster 2024-09-16T07:32:24.563142+0000 mgr.a (mgr.14373) 4990 : cluster [DBG] pgmap v3460: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:32:26.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:32:25 smithi086 bash[24289]: cluster 2024-09-16T07:32:24.563142+0000 mgr.a (mgr.14373) 4990 : cluster [DBG] pgmap v3460: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:32:26.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:32:25 smithi047 bash[22744]: cluster 2024-09-16T07:32:24.563142+0000 mgr.a (mgr.14373) 4990 : cluster [DBG] pgmap v3460: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:32:26.172 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:32:26.172 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:32:26.173 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:32:26.972 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:32:26.973 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:32:26.973 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:32:26.973 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:32:26.973 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:32:28.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:32:27 smithi157 bash[24585]: audit 2024-09-16T07:32:26.520235+0000 mgr.a (mgr.14373) 4991 : audit [DBG] from='client.117471 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:32:28.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:32:27 smithi157 bash[24585]: cluster 2024-09-16T07:32:26.566178+0000 mgr.a (mgr.14373) 4992 : cluster [DBG] pgmap v3461: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:32:28.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:32:27 smithi086 bash[24289]: audit 2024-09-16T07:32:26.520235+0000 mgr.a (mgr.14373) 4991 : audit [DBG] from='client.117471 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:32:28.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:32:27 smithi086 bash[24289]: cluster 2024-09-16T07:32:26.566178+0000 mgr.a (mgr.14373) 4992 : cluster [DBG] pgmap v3461: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:32:28.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:32:27 smithi047 bash[22744]: audit 2024-09-16T07:32:26.520235+0000 mgr.a (mgr.14373) 4991 : audit [DBG] from='client.117471 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:32:28.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:32:27 smithi047 bash[22744]: cluster 2024-09-16T07:32:26.566178+0000 mgr.a (mgr.14373) 4992 : cluster [DBG] pgmap v3461: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:32:30.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:32:29 smithi157 bash[24585]: cluster 2024-09-16T07:32:28.567146+0000 mgr.a (mgr.14373) 4993 : cluster [DBG] pgmap v3462: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:32:30.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:32:29 smithi086 bash[24289]: cluster 2024-09-16T07:32:28.567146+0000 mgr.a (mgr.14373) 4993 : cluster [DBG] pgmap v3462: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:32:30.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:32:29 smithi047 bash[22744]: cluster 2024-09-16T07:32:28.567146+0000 mgr.a (mgr.14373) 4993 : cluster [DBG] pgmap v3462: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:32:31.974 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:32:31.975 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:32:31.975 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:32:32.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:32:31 smithi157 bash[24585]: cluster 2024-09-16T07:32:30.567965+0000 mgr.a (mgr.14373) 4994 : cluster [DBG] pgmap v3463: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T07:32:32.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:32:31 smithi086 bash[24289]: cluster 2024-09-16T07:32:30.567965+0000 mgr.a (mgr.14373) 4994 : cluster [DBG] pgmap v3463: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T07:32:32.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:32:31 smithi047 bash[22744]: cluster 2024-09-16T07:32:30.567965+0000 mgr.a (mgr.14373) 4994 : cluster [DBG] pgmap v3463: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T07:32:32.733 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:32:32.734 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:32:32.734 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:32:32.734 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:32:32.734 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:32:34.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:32:33 smithi157 bash[24585]: audit 2024-09-16T07:32:32.306741+0000 mgr.a (mgr.14373) 4995 : audit [DBG] from='client.117546 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:32:34.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:32:33 smithi157 bash[24585]: cluster 2024-09-16T07:32:32.569309+0000 mgr.a (mgr.14373) 4996 : cluster [DBG] pgmap v3464: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:32:34.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:32:33 smithi086 bash[24289]: audit 2024-09-16T07:32:32.306741+0000 mgr.a (mgr.14373) 4995 : audit [DBG] from='client.117546 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:32:34.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:32:33 smithi086 bash[24289]: cluster 2024-09-16T07:32:32.569309+0000 mgr.a (mgr.14373) 4996 : cluster [DBG] pgmap v3464: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:32:34.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:32:33 smithi047 bash[22744]: audit 2024-09-16T07:32:32.306741+0000 mgr.a (mgr.14373) 4995 : audit [DBG] from='client.117546 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:32:34.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:32:33 smithi047 bash[22744]: cluster 2024-09-16T07:32:32.569309+0000 mgr.a (mgr.14373) 4996 : cluster [DBG] pgmap v3464: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:32:36.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:32:35 smithi157 bash[24585]: cluster 2024-09-16T07:32:34.570151+0000 mgr.a (mgr.14373) 4997 : cluster [DBG] pgmap v3465: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:32:36.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:32:35 smithi086 bash[24289]: cluster 2024-09-16T07:32:34.570151+0000 mgr.a (mgr.14373) 4997 : cluster [DBG] pgmap v3465: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:32:36.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:32:35 smithi047 bash[22744]: cluster 2024-09-16T07:32:34.570151+0000 mgr.a (mgr.14373) 4997 : cluster [DBG] pgmap v3465: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:32:37.735 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:32:37.736 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:32:37.736 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:32:38.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:32:37 smithi157 bash[24585]: cluster 2024-09-16T07:32:36.572313+0000 mgr.a (mgr.14373) 4998 : cluster [DBG] pgmap v3466: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:32:38.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:32:37 smithi086 bash[24289]: cluster 2024-09-16T07:32:36.572313+0000 mgr.a (mgr.14373) 4998 : cluster [DBG] pgmap v3466: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:32:38.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:32:37 smithi047 bash[22744]: cluster 2024-09-16T07:32:36.572313+0000 mgr.a (mgr.14373) 4998 : cluster [DBG] pgmap v3466: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:32:38.528 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:32:38.528 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:32:38.528 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:32:38.528 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:32:38.528 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:32:39.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:32:38 smithi157 bash[24585]: audit 2024-09-16T07:32:38.431964+0000 mon.b (mon.2) 490 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T07:32:39.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:32:38 smithi086 bash[24289]: audit 2024-09-16T07:32:38.431964+0000 mon.b (mon.2) 490 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T07:32:39.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:32:38 smithi047 bash[22744]: audit 2024-09-16T07:32:38.431964+0000 mon.b (mon.2) 490 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T07:32:39.968 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:32:39 smithi047 bash[22744]: audit 2024-09-16T07:32:38.075269+0000 mgr.a (mgr.14373) 4999 : audit [DBG] from='client.117621 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:32:39.968 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:32:39 smithi047 bash[22744]: cluster 2024-09-16T07:32:38.573404+0000 mgr.a (mgr.14373) 5000 : cluster [DBG] pgmap v3467: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:32:39.968 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:32:39 smithi047 bash[22744]: audit 2024-09-16T07:32:39.216980+0000 mon.b (mon.2) 491 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T07:32:39.968 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:32:39 smithi047 bash[22744]: audit 2024-09-16T07:32:39.218871+0000 mon.b (mon.2) 492 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T07:32:39.968 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:32:39 smithi047 bash[22744]: audit 2024-09-16T07:32:39.230749+0000 mon.a (mon.0) 862 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:32:39.968 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:32:39 smithi047 bash[22744]: audit 2024-09-16T07:32:39.235147+0000 mon.b (mon.2) 493 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:32:40.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:32:39 smithi157 bash[24585]: audit 2024-09-16T07:32:38.075269+0000 mgr.a (mgr.14373) 4999 : audit [DBG] from='client.117621 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:32:40.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:32:39 smithi157 bash[24585]: cluster 2024-09-16T07:32:38.573404+0000 mgr.a (mgr.14373) 5000 : cluster [DBG] pgmap v3467: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:32:40.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:32:39 smithi157 bash[24585]: audit 2024-09-16T07:32:39.216980+0000 mon.b (mon.2) 491 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T07:32:40.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:32:39 smithi157 bash[24585]: audit 2024-09-16T07:32:39.218871+0000 mon.b (mon.2) 492 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T07:32:40.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:32:39 smithi157 bash[24585]: audit 2024-09-16T07:32:39.230749+0000 mon.a (mon.0) 862 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:32:40.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:32:39 smithi157 bash[24585]: audit 2024-09-16T07:32:39.235147+0000 mon.b (mon.2) 493 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:32:40.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:32:39 smithi086 bash[24289]: audit 2024-09-16T07:32:38.075269+0000 mgr.a (mgr.14373) 4999 : audit [DBG] from='client.117621 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:32:40.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:32:39 smithi086 bash[24289]: cluster 2024-09-16T07:32:38.573404+0000 mgr.a (mgr.14373) 5000 : cluster [DBG] pgmap v3467: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:32:40.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:32:39 smithi086 bash[24289]: audit 2024-09-16T07:32:39.216980+0000 mon.b (mon.2) 491 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T07:32:40.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:32:39 smithi086 bash[24289]: audit 2024-09-16T07:32:39.218871+0000 mon.b (mon.2) 492 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T07:32:40.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:32:39 smithi086 bash[24289]: audit 2024-09-16T07:32:39.230749+0000 mon.a (mon.0) 862 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:32:40.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:32:39 smithi086 bash[24289]: audit 2024-09-16T07:32:39.235147+0000 mon.b (mon.2) 493 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:32:40.339 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 07:32:39 smithi047 bash[22994]: debug 2024-09-16T07:32:39.969+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T07:32:40.339 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 07:32:39 smithi047 bash[22994]: debug 2024-09-16T07:32:39.969+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T07:32:41.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:32:40 smithi157 bash[24585]: audit 2024-09-16T07:32:39.238909+0000 mgr.a (mgr.14373) 5001 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:32:41.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:32:40 smithi086 bash[24289]: audit 2024-09-16T07:32:39.238909+0000 mgr.a (mgr.14373) 5001 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:32:41.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:32:40 smithi047 bash[22744]: audit 2024-09-16T07:32:39.238909+0000 mgr.a (mgr.14373) 5001 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:32:42.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:32:41 smithi157 bash[24585]: audit 2024-09-16T07:32:39.970410+0000 mgr.a (mgr.14373) 5002 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T07:32:42.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:32:41 smithi157 bash[24585]: cephadm 2024-09-16T07:32:39.972358+0000 mgr.a (mgr.14373) 5003 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T07:32:42.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:32:41 smithi157 bash[24585]: cluster 2024-09-16T07:32:40.574458+0000 mgr.a (mgr.14373) 5004 : cluster [DBG] pgmap v3468: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:32:42.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:32:41 smithi086 bash[24289]: audit 2024-09-16T07:32:39.970410+0000 mgr.a (mgr.14373) 5002 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T07:32:42.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:32:41 smithi086 bash[24289]: cephadm 2024-09-16T07:32:39.972358+0000 mgr.a (mgr.14373) 5003 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T07:32:42.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:32:41 smithi086 bash[24289]: cluster 2024-09-16T07:32:40.574458+0000 mgr.a (mgr.14373) 5004 : cluster [DBG] pgmap v3468: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:32:42.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:32:41 smithi047 bash[22744]: audit 2024-09-16T07:32:39.970410+0000 mgr.a (mgr.14373) 5002 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T07:32:42.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:32:41 smithi047 bash[22744]: cephadm 2024-09-16T07:32:39.972358+0000 mgr.a (mgr.14373) 5003 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T07:32:42.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:32:41 smithi047 bash[22744]: cluster 2024-09-16T07:32:40.574458+0000 mgr.a (mgr.14373) 5004 : cluster [DBG] pgmap v3468: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:32:43.529 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:32:43.530 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:32:43.530 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:32:44.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:32:43 smithi157 bash[24585]: cluster 2024-09-16T07:32:42.576718+0000 mgr.a (mgr.14373) 5005 : cluster [DBG] pgmap v3469: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:32:44.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:32:43 smithi086 bash[24289]: cluster 2024-09-16T07:32:42.576718+0000 mgr.a (mgr.14373) 5005 : cluster [DBG] pgmap v3469: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:32:44.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:32:43 smithi047 bash[22744]: cluster 2024-09-16T07:32:42.576718+0000 mgr.a (mgr.14373) 5005 : cluster [DBG] pgmap v3469: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:32:44.271 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:32:44.272 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:32:44.272 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:32:44.272 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:32:44.272 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:32:45.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:32:44 smithi157 bash[24585]: audit 2024-09-16T07:32:43.865527+0000 mgr.a (mgr.14373) 5006 : audit [DBG] from='client.117804 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:32:45.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:32:44 smithi086 bash[24289]: audit 2024-09-16T07:32:43.865527+0000 mgr.a (mgr.14373) 5006 : audit [DBG] from='client.117804 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:32:45.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:32:44 smithi047 bash[22744]: audit 2024-09-16T07:32:43.865527+0000 mgr.a (mgr.14373) 5006 : audit [DBG] from='client.117804 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:32:46.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:32:45 smithi157 bash[24585]: cluster 2024-09-16T07:32:44.577718+0000 mgr.a (mgr.14373) 5007 : cluster [DBG] pgmap v3470: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:32:46.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:32:45 smithi086 bash[24289]: cluster 2024-09-16T07:32:44.577718+0000 mgr.a (mgr.14373) 5007 : cluster [DBG] pgmap v3470: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:32:46.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:32:45 smithi047 bash[22744]: cluster 2024-09-16T07:32:44.577718+0000 mgr.a (mgr.14373) 5007 : cluster [DBG] pgmap v3470: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:32:48.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:32:47 smithi157 bash[24585]: cluster 2024-09-16T07:32:46.579904+0000 mgr.a (mgr.14373) 5008 : cluster [DBG] pgmap v3471: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:32:48.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:32:47 smithi086 bash[24289]: cluster 2024-09-16T07:32:46.579904+0000 mgr.a (mgr.14373) 5008 : cluster [DBG] pgmap v3471: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:32:48.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:32:47 smithi047 bash[22744]: cluster 2024-09-16T07:32:46.579904+0000 mgr.a (mgr.14373) 5008 : cluster [DBG] pgmap v3471: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:32:49.273 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:32:49.274 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:32:49.274 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:32:50.049 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:32:50.049 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:32:50.049 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:32:50.049 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:32:50.049 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:32:50.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:32:49 smithi157 bash[24585]: cluster 2024-09-16T07:32:48.580680+0000 mgr.a (mgr.14373) 5009 : cluster [DBG] pgmap v3472: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:32:50.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:32:49 smithi086 bash[24289]: cluster 2024-09-16T07:32:48.580680+0000 mgr.a (mgr.14373) 5009 : cluster [DBG] pgmap v3472: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:32:50.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:32:49 smithi047 bash[22744]: cluster 2024-09-16T07:32:48.580680+0000 mgr.a (mgr.14373) 5009 : cluster [DBG] pgmap v3472: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:32:51.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:32:50 smithi157 bash[24585]: audit 2024-09-16T07:32:49.608294+0000 mgr.a (mgr.14373) 5010 : audit [DBG] from='client.117879 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:32:51.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:32:50 smithi086 bash[24289]: audit 2024-09-16T07:32:49.608294+0000 mgr.a (mgr.14373) 5010 : audit [DBG] from='client.117879 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:32:51.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:32:50 smithi047 bash[22744]: audit 2024-09-16T07:32:49.608294+0000 mgr.a (mgr.14373) 5010 : audit [DBG] from='client.117879 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:32:52.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:32:51 smithi157 bash[24585]: cluster 2024-09-16T07:32:50.581789+0000 mgr.a (mgr.14373) 5011 : cluster [DBG] pgmap v3473: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:32:52.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:32:51 smithi086 bash[24289]: cluster 2024-09-16T07:32:50.581789+0000 mgr.a (mgr.14373) 5011 : cluster [DBG] pgmap v3473: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:32:52.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:32:51 smithi047 bash[22744]: cluster 2024-09-16T07:32:50.581789+0000 mgr.a (mgr.14373) 5011 : cluster [DBG] pgmap v3473: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:32:54.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:32:53 smithi157 bash[24585]: cluster 2024-09-16T07:32:52.584088+0000 mgr.a (mgr.14373) 5012 : cluster [DBG] pgmap v3474: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:32:54.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:32:53 smithi086 bash[24289]: cluster 2024-09-16T07:32:52.584088+0000 mgr.a (mgr.14373) 5012 : cluster [DBG] pgmap v3474: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:32:54.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:32:53 smithi047 bash[22744]: cluster 2024-09-16T07:32:52.584088+0000 mgr.a (mgr.14373) 5012 : cluster [DBG] pgmap v3474: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:32:55.050 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:32:55.051 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:32:55.051 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:32:55.844 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:32:55.844 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:32:55.844 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:32:55.844 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:32:55.844 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:32:56.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:32:55 smithi157 bash[24585]: cluster 2024-09-16T07:32:54.584855+0000 mgr.a (mgr.14373) 5013 : cluster [DBG] pgmap v3475: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:32:56.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:32:55 smithi086 bash[24289]: cluster 2024-09-16T07:32:54.584855+0000 mgr.a (mgr.14373) 5013 : cluster [DBG] pgmap v3475: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:32:56.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:32:55 smithi047 bash[22744]: cluster 2024-09-16T07:32:54.584855+0000 mgr.a (mgr.14373) 5013 : cluster [DBG] pgmap v3475: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:32:57.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:32:56 smithi157 bash[24585]: audit 2024-09-16T07:32:55.386044+0000 mgr.a (mgr.14373) 5014 : audit [DBG] from='client.117957 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:32:57.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:32:56 smithi086 bash[24289]: audit 2024-09-16T07:32:55.386044+0000 mgr.a (mgr.14373) 5014 : audit [DBG] from='client.117957 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:32:57.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:32:56 smithi047 bash[22744]: audit 2024-09-16T07:32:55.386044+0000 mgr.a (mgr.14373) 5014 : audit [DBG] from='client.117957 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:32:58.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:32:57 smithi157 bash[24585]: cluster 2024-09-16T07:32:56.587178+0000 mgr.a (mgr.14373) 5015 : cluster [DBG] pgmap v3476: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:32:58.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:32:57 smithi086 bash[24289]: cluster 2024-09-16T07:32:56.587178+0000 mgr.a (mgr.14373) 5015 : cluster [DBG] pgmap v3476: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:32:58.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:32:57 smithi047 bash[22744]: cluster 2024-09-16T07:32:56.587178+0000 mgr.a (mgr.14373) 5015 : cluster [DBG] pgmap v3476: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:33:00.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:32:59 smithi157 bash[24585]: cluster 2024-09-16T07:32:58.587982+0000 mgr.a (mgr.14373) 5016 : cluster [DBG] pgmap v3477: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:33:00.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:32:59 smithi086 bash[24289]: cluster 2024-09-16T07:32:58.587982+0000 mgr.a (mgr.14373) 5016 : cluster [DBG] pgmap v3477: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:33:00.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:32:59 smithi047 bash[22744]: cluster 2024-09-16T07:32:58.587982+0000 mgr.a (mgr.14373) 5016 : cluster [DBG] pgmap v3477: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:33:00.845 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:33:00.846 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:33:00.846 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:33:01.599 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:33:01.599 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:33:01.599 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:33:01.599 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:33:01.599 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:33:02.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:33:01 smithi157 bash[24585]: cluster 2024-09-16T07:33:00.588755+0000 mgr.a (mgr.14373) 5017 : cluster [DBG] pgmap v3478: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:33:02.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:33:01 smithi086 bash[24289]: cluster 2024-09-16T07:33:00.588755+0000 mgr.a (mgr.14373) 5017 : cluster [DBG] pgmap v3478: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:33:02.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:33:01 smithi047 bash[22744]: cluster 2024-09-16T07:33:00.588755+0000 mgr.a (mgr.14373) 5017 : cluster [DBG] pgmap v3478: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:33:03.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:33:02 smithi157 bash[24585]: audit 2024-09-16T07:33:01.176197+0000 mgr.a (mgr.14373) 5018 : audit [DBG] from='client.118032 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:33:03.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:33:02 smithi086 bash[24289]: audit 2024-09-16T07:33:01.176197+0000 mgr.a (mgr.14373) 5018 : audit [DBG] from='client.118032 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:33:03.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:33:02 smithi047 bash[22744]: audit 2024-09-16T07:33:01.176197+0000 mgr.a (mgr.14373) 5018 : audit [DBG] from='client.118032 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:33:04.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:33:03 smithi157 bash[24585]: cluster 2024-09-16T07:33:02.591557+0000 mgr.a (mgr.14373) 5019 : cluster [DBG] pgmap v3479: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-16T07:33:04.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:33:03 smithi086 bash[24289]: cluster 2024-09-16T07:33:02.591557+0000 mgr.a (mgr.14373) 5019 : cluster [DBG] pgmap v3479: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-16T07:33:04.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:33:03 smithi047 bash[22744]: cluster 2024-09-16T07:33:02.591557+0000 mgr.a (mgr.14373) 5019 : cluster [DBG] pgmap v3479: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-16T07:33:06.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:33:05 smithi157 bash[24585]: cluster 2024-09-16T07:33:04.592342+0000 mgr.a (mgr.14373) 5020 : cluster [DBG] pgmap v3480: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T07:33:06.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:33:05 smithi086 bash[24289]: cluster 2024-09-16T07:33:04.592342+0000 mgr.a (mgr.14373) 5020 : cluster [DBG] pgmap v3480: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T07:33:06.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:33:05 smithi047 bash[22744]: cluster 2024-09-16T07:33:04.592342+0000 mgr.a (mgr.14373) 5020 : cluster [DBG] pgmap v3480: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T07:33:06.600 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:33:06.601 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:33:06.601 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:33:07.352 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:33:07.353 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:33:07.353 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:33:07.353 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:33:07.353 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:33:08.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:33:07 smithi157 bash[24585]: cluster 2024-09-16T07:33:06.594248+0000 mgr.a (mgr.14373) 5021 : cluster [DBG] pgmap v3481: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:33:08.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:33:07 smithi086 bash[24289]: cluster 2024-09-16T07:33:06.594248+0000 mgr.a (mgr.14373) 5021 : cluster [DBG] pgmap v3481: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:33:08.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:33:07 smithi047 bash[22744]: cluster 2024-09-16T07:33:06.594248+0000 mgr.a (mgr.14373) 5021 : cluster [DBG] pgmap v3481: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:33:09.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:33:08 smithi157 bash[24585]: audit 2024-09-16T07:33:06.936532+0000 mgr.a (mgr.14373) 5022 : audit [DBG] from='client.118107 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:33:09.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:33:08 smithi086 bash[24289]: audit 2024-09-16T07:33:06.936532+0000 mgr.a (mgr.14373) 5022 : audit [DBG] from='client.118107 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:33:09.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:33:08 smithi047 bash[22744]: audit 2024-09-16T07:33:06.936532+0000 mgr.a (mgr.14373) 5022 : audit [DBG] from='client.118107 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:33:10.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:33:09 smithi157 bash[24585]: cluster 2024-09-16T07:33:08.595150+0000 mgr.a (mgr.14373) 5023 : cluster [DBG] pgmap v3482: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:33:10.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:33:09 smithi086 bash[24289]: cluster 2024-09-16T07:33:08.595150+0000 mgr.a (mgr.14373) 5023 : cluster [DBG] pgmap v3482: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:33:10.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:33:09 smithi047 bash[22744]: cluster 2024-09-16T07:33:08.595150+0000 mgr.a (mgr.14373) 5023 : cluster [DBG] pgmap v3482: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:33:12.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:33:11 smithi157 bash[24585]: cluster 2024-09-16T07:33:10.595925+0000 mgr.a (mgr.14373) 5024 : cluster [DBG] pgmap v3483: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T07:33:12.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:33:11 smithi086 bash[24289]: cluster 2024-09-16T07:33:10.595925+0000 mgr.a (mgr.14373) 5024 : cluster [DBG] pgmap v3483: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T07:33:12.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:33:11 smithi047 bash[22744]: cluster 2024-09-16T07:33:10.595925+0000 mgr.a (mgr.14373) 5024 : cluster [DBG] pgmap v3483: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T07:33:12.354 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:33:12.354 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:33:12.355 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:33:13.139 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:33:13.139 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:33:13.139 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:33:13.139 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:33:13.139 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:33:14.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:33:13 smithi157 bash[24585]: cluster 2024-09-16T07:33:12.598072+0000 mgr.a (mgr.14373) 5025 : cluster [DBG] pgmap v3484: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:33:14.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:33:13 smithi157 bash[24585]: audit 2024-09-16T07:33:12.690722+0000 mgr.a (mgr.14373) 5026 : audit [DBG] from='client.118185 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:33:14.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:33:13 smithi086 bash[24289]: cluster 2024-09-16T07:33:12.598072+0000 mgr.a (mgr.14373) 5025 : cluster [DBG] pgmap v3484: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:33:14.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:33:13 smithi086 bash[24289]: audit 2024-09-16T07:33:12.690722+0000 mgr.a (mgr.14373) 5026 : audit [DBG] from='client.118185 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:33:14.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:33:13 smithi047 bash[22744]: cluster 2024-09-16T07:33:12.598072+0000 mgr.a (mgr.14373) 5025 : cluster [DBG] pgmap v3484: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:33:14.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:33:13 smithi047 bash[22744]: audit 2024-09-16T07:33:12.690722+0000 mgr.a (mgr.14373) 5026 : audit [DBG] from='client.118185 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:33:16.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:33:15 smithi086 bash[24289]: cluster 2024-09-16T07:33:14.599006+0000 mgr.a (mgr.14373) 5027 : cluster [DBG] pgmap v3485: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-16T07:33:16.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:33:15 smithi047 bash[22744]: cluster 2024-09-16T07:33:14.599006+0000 mgr.a (mgr.14373) 5027 : cluster [DBG] pgmap v3485: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-16T07:33:16.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:33:15 smithi157 bash[24585]: cluster 2024-09-16T07:33:14.599006+0000 mgr.a (mgr.14373) 5027 : cluster [DBG] pgmap v3485: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-16T07:33:18.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:33:17 smithi086 bash[24289]: cluster 2024-09-16T07:33:16.601139+0000 mgr.a (mgr.14373) 5028 : cluster [DBG] pgmap v3486: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-16T07:33:18.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:33:17 smithi047 bash[22744]: cluster 2024-09-16T07:33:16.601139+0000 mgr.a (mgr.14373) 5028 : cluster [DBG] pgmap v3486: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-16T07:33:18.140 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:33:18.141 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:33:18.141 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:33:18.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:33:17 smithi157 bash[24585]: cluster 2024-09-16T07:33:16.601139+0000 mgr.a (mgr.14373) 5028 : cluster [DBG] pgmap v3486: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-16T07:33:18.923 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:33:18.924 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:33:18.924 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:33:18.924 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:33:18.924 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:33:20.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:33:19 smithi086 bash[24289]: audit 2024-09-16T07:33:18.479364+0000 mgr.a (mgr.14373) 5029 : audit [DBG] from='client.118260 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:33:20.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:33:19 smithi086 bash[24289]: cluster 2024-09-16T07:33:18.601758+0000 mgr.a (mgr.14373) 5030 : cluster [DBG] pgmap v3487: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:33:20.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:33:19 smithi047 bash[22744]: audit 2024-09-16T07:33:18.479364+0000 mgr.a (mgr.14373) 5029 : audit [DBG] from='client.118260 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:33:20.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:33:19 smithi047 bash[22744]: cluster 2024-09-16T07:33:18.601758+0000 mgr.a (mgr.14373) 5030 : cluster [DBG] pgmap v3487: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:33:20.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:33:19 smithi157 bash[24585]: audit 2024-09-16T07:33:18.479364+0000 mgr.a (mgr.14373) 5029 : audit [DBG] from='client.118260 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:33:20.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:33:19 smithi157 bash[24585]: cluster 2024-09-16T07:33:18.601758+0000 mgr.a (mgr.14373) 5030 : cluster [DBG] pgmap v3487: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:33:22.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:33:21 smithi086 bash[24289]: cluster 2024-09-16T07:33:20.602685+0000 mgr.a (mgr.14373) 5031 : cluster [DBG] pgmap v3488: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:33:22.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:33:21 smithi047 bash[22744]: cluster 2024-09-16T07:33:20.602685+0000 mgr.a (mgr.14373) 5031 : cluster [DBG] pgmap v3488: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:33:22.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:33:21 smithi157 bash[24585]: cluster 2024-09-16T07:33:20.602685+0000 mgr.a (mgr.14373) 5031 : cluster [DBG] pgmap v3488: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:33:23.925 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:33:23.926 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:33:23.926 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:33:24.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:33:23 smithi047 bash[22744]: cluster 2024-09-16T07:33:22.605043+0000 mgr.a (mgr.14373) 5032 : cluster [DBG] pgmap v3489: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:33:24.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:33:23 smithi157 bash[24585]: cluster 2024-09-16T07:33:22.605043+0000 mgr.a (mgr.14373) 5032 : cluster [DBG] pgmap v3489: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:33:24.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:33:23 smithi086 bash[24289]: cluster 2024-09-16T07:33:22.605043+0000 mgr.a (mgr.14373) 5032 : cluster [DBG] pgmap v3489: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:33:24.700 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:33:24.700 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:33:24.700 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:33:24.700 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:33:24.701 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:33:26.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:33:25 smithi047 bash[22744]: audit 2024-09-16T07:33:24.265735+0000 mgr.a (mgr.14373) 5033 : audit [DBG] from='client.118335 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:33:26.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:33:25 smithi047 bash[22744]: cluster 2024-09-16T07:33:24.605824+0000 mgr.a (mgr.14373) 5034 : cluster [DBG] pgmap v3490: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:33:26.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:33:25 smithi157 bash[24585]: audit 2024-09-16T07:33:24.265735+0000 mgr.a (mgr.14373) 5033 : audit [DBG] from='client.118335 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:33:26.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:33:25 smithi157 bash[24585]: cluster 2024-09-16T07:33:24.605824+0000 mgr.a (mgr.14373) 5034 : cluster [DBG] pgmap v3490: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:33:26.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:33:25 smithi086 bash[24289]: audit 2024-09-16T07:33:24.265735+0000 mgr.a (mgr.14373) 5033 : audit [DBG] from='client.118335 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:33:26.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:33:25 smithi086 bash[24289]: cluster 2024-09-16T07:33:24.605824+0000 mgr.a (mgr.14373) 5034 : cluster [DBG] pgmap v3490: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:33:28.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:33:27 smithi047 bash[22744]: cluster 2024-09-16T07:33:26.607994+0000 mgr.a (mgr.14373) 5035 : cluster [DBG] pgmap v3491: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:33:28.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:33:27 smithi157 bash[24585]: cluster 2024-09-16T07:33:26.607994+0000 mgr.a (mgr.14373) 5035 : cluster [DBG] pgmap v3491: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:33:28.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:33:27 smithi086 bash[24289]: cluster 2024-09-16T07:33:26.607994+0000 mgr.a (mgr.14373) 5035 : cluster [DBG] pgmap v3491: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:33:29.702 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:33:29.703 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:33:29.703 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:33:30.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:33:29 smithi047 bash[22744]: cluster 2024-09-16T07:33:28.608765+0000 mgr.a (mgr.14373) 5036 : cluster [DBG] pgmap v3492: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:33:30.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:33:29 smithi157 bash[24585]: cluster 2024-09-16T07:33:28.608765+0000 mgr.a (mgr.14373) 5036 : cluster [DBG] pgmap v3492: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:33:30.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:33:29 smithi086 bash[24289]: cluster 2024-09-16T07:33:28.608765+0000 mgr.a (mgr.14373) 5036 : cluster [DBG] pgmap v3492: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:33:30.495 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:33:30.496 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:33:30.496 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:33:30.496 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:33:30.496 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:33:32.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:33:31 smithi047 bash[22744]: audit 2024-09-16T07:33:30.052512+0000 mgr.a (mgr.14373) 5037 : audit [DBG] from='client.118413 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:33:32.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:33:31 smithi047 bash[22744]: cluster 2024-09-16T07:33:30.609719+0000 mgr.a (mgr.14373) 5038 : cluster [DBG] pgmap v3493: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:33:32.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:33:31 smithi157 bash[24585]: audit 2024-09-16T07:33:30.052512+0000 mgr.a (mgr.14373) 5037 : audit [DBG] from='client.118413 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:33:32.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:33:31 smithi157 bash[24585]: cluster 2024-09-16T07:33:30.609719+0000 mgr.a (mgr.14373) 5038 : cluster [DBG] pgmap v3493: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:33:32.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:33:31 smithi086 bash[24289]: audit 2024-09-16T07:33:30.052512+0000 mgr.a (mgr.14373) 5037 : audit [DBG] from='client.118413 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:33:32.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:33:31 smithi086 bash[24289]: cluster 2024-09-16T07:33:30.609719+0000 mgr.a (mgr.14373) 5038 : cluster [DBG] pgmap v3493: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:33:34.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:33:33 smithi157 bash[24585]: cluster 2024-09-16T07:33:32.611976+0000 mgr.a (mgr.14373) 5039 : cluster [DBG] pgmap v3494: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:33:34.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:33:33 smithi086 bash[24289]: cluster 2024-09-16T07:33:32.611976+0000 mgr.a (mgr.14373) 5039 : cluster [DBG] pgmap v3494: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:33:34.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:33:33 smithi047 bash[22744]: cluster 2024-09-16T07:33:32.611976+0000 mgr.a (mgr.14373) 5039 : cluster [DBG] pgmap v3494: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:33:35.497 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:33:35.497 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:33:35.498 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:33:36.241 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:33:36.241 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:33:36.241 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:33:36.242 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:33:36.242 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:33:36.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:33:35 smithi157 bash[24585]: cluster 2024-09-16T07:33:34.612742+0000 mgr.a (mgr.14373) 5040 : cluster [DBG] pgmap v3495: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:33:36.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:33:35 smithi086 bash[24289]: cluster 2024-09-16T07:33:34.612742+0000 mgr.a (mgr.14373) 5040 : cluster [DBG] pgmap v3495: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:33:36.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:33:35 smithi047 bash[22744]: cluster 2024-09-16T07:33:34.612742+0000 mgr.a (mgr.14373) 5040 : cluster [DBG] pgmap v3495: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:33:37.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:33:36 smithi157 bash[24585]: audit 2024-09-16T07:33:35.830090+0000 mgr.a (mgr.14373) 5041 : audit [DBG] from='client.118485 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:33:37.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:33:36 smithi086 bash[24289]: audit 2024-09-16T07:33:35.830090+0000 mgr.a (mgr.14373) 5041 : audit [DBG] from='client.118485 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:33:37.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:33:36 smithi047 bash[22744]: audit 2024-09-16T07:33:35.830090+0000 mgr.a (mgr.14373) 5041 : audit [DBG] from='client.118485 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:33:38.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:33:37 smithi157 bash[24585]: cluster 2024-09-16T07:33:36.615025+0000 mgr.a (mgr.14373) 5042 : cluster [DBG] pgmap v3496: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:33:38.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:33:37 smithi086 bash[24289]: cluster 2024-09-16T07:33:36.615025+0000 mgr.a (mgr.14373) 5042 : cluster [DBG] pgmap v3496: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:33:38.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:33:37 smithi047 bash[22744]: cluster 2024-09-16T07:33:36.615025+0000 mgr.a (mgr.14373) 5042 : cluster [DBG] pgmap v3496: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:33:40.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:33:39 smithi157 bash[24585]: cluster 2024-09-16T07:33:38.615833+0000 mgr.a (mgr.14373) 5043 : cluster [DBG] pgmap v3497: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:33:40.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:33:39 smithi086 bash[24289]: cluster 2024-09-16T07:33:38.615833+0000 mgr.a (mgr.14373) 5043 : cluster [DBG] pgmap v3497: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:33:40.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:33:39 smithi047 bash[22744]: cluster 2024-09-16T07:33:38.615833+0000 mgr.a (mgr.14373) 5043 : cluster [DBG] pgmap v3497: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:33:41.243 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:33:41.244 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:33:41.244 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:33:41.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:33:40 smithi157 bash[24585]: audit 2024-09-16T07:33:40.026658+0000 mon.b (mon.2) 494 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T07:33:41.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:33:40 smithi086 bash[24289]: audit 2024-09-16T07:33:40.026658+0000 mon.b (mon.2) 494 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T07:33:41.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:33:40 smithi047 bash[22744]: audit 2024-09-16T07:33:40.026658+0000 mon.b (mon.2) 494 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T07:33:42.009 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:33:42.009 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:33:42.009 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:33:42.009 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:33:42.009 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:33:42.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:33:41 smithi157 bash[24585]: cluster 2024-09-16T07:33:40.616414+0000 mgr.a (mgr.14373) 5044 : cluster [DBG] pgmap v3498: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:33:42.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:33:41 smithi086 bash[24289]: cluster 2024-09-16T07:33:40.616414+0000 mgr.a (mgr.14373) 5044 : cluster [DBG] pgmap v3498: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:33:42.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:33:41 smithi047 bash[22744]: cluster 2024-09-16T07:33:40.616414+0000 mgr.a (mgr.14373) 5044 : cluster [DBG] pgmap v3498: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:33:43.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:33:42 smithi157 bash[24585]: audit 2024-09-16T07:33:41.585271+0000 mgr.a (mgr.14373) 5045 : audit [DBG] from='client.118560 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:33:43.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:33:42 smithi086 bash[24289]: audit 2024-09-16T07:33:41.585271+0000 mgr.a (mgr.14373) 5045 : audit [DBG] from='client.118560 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:33:43.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:33:42 smithi047 bash[22744]: audit 2024-09-16T07:33:41.585271+0000 mgr.a (mgr.14373) 5045 : audit [DBG] from='client.118560 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:33:44.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:33:43 smithi157 bash[24585]: cluster 2024-09-16T07:33:42.618971+0000 mgr.a (mgr.14373) 5046 : cluster [DBG] pgmap v3499: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:33:44.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:33:43 smithi086 bash[24289]: cluster 2024-09-16T07:33:42.618971+0000 mgr.a (mgr.14373) 5046 : cluster [DBG] pgmap v3499: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:33:44.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:33:43 smithi047 bash[22744]: cluster 2024-09-16T07:33:42.618971+0000 mgr.a (mgr.14373) 5046 : cluster [DBG] pgmap v3499: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:33:46.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:33:45 smithi157 bash[24585]: cluster 2024-09-16T07:33:44.619773+0000 mgr.a (mgr.14373) 5047 : cluster [DBG] pgmap v3500: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:33:46.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:33:45 smithi157 bash[24585]: audit 2024-09-16T07:33:45.380136+0000 mon.a (mon.0) 863 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:33:46.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:33:45 smithi157 bash[24585]: audit 2024-09-16T07:33:45.385302+0000 mon.a (mon.0) 864 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:33:46.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:33:45 smithi157 bash[24585]: audit 2024-09-16T07:33:45.391189+0000 mon.a (mon.0) 865 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:33:46.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:33:45 smithi157 bash[24585]: audit 2024-09-16T07:33:45.396276+0000 mon.a (mon.0) 866 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:33:46.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:33:45 smithi157 bash[24585]: audit 2024-09-16T07:33:45.421814+0000 mon.a (mon.0) 867 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:33:46.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:33:45 smithi157 bash[24585]: audit 2024-09-16T07:33:45.427316+0000 mon.a (mon.0) 868 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:33:46.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:33:45 smithi086 bash[24289]: cluster 2024-09-16T07:33:44.619773+0000 mgr.a (mgr.14373) 5047 : cluster [DBG] pgmap v3500: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:33:46.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:33:45 smithi086 bash[24289]: audit 2024-09-16T07:33:45.380136+0000 mon.a (mon.0) 863 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:33:46.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:33:45 smithi086 bash[24289]: audit 2024-09-16T07:33:45.385302+0000 mon.a (mon.0) 864 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:33:46.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:33:45 smithi086 bash[24289]: audit 2024-09-16T07:33:45.391189+0000 mon.a (mon.0) 865 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:33:46.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:33:45 smithi086 bash[24289]: audit 2024-09-16T07:33:45.396276+0000 mon.a (mon.0) 866 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:33:46.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:33:45 smithi086 bash[24289]: audit 2024-09-16T07:33:45.421814+0000 mon.a (mon.0) 867 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:33:46.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:33:45 smithi086 bash[24289]: audit 2024-09-16T07:33:45.427316+0000 mon.a (mon.0) 868 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:33:46.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:33:45 smithi047 bash[22744]: cluster 2024-09-16T07:33:44.619773+0000 mgr.a (mgr.14373) 5047 : cluster [DBG] pgmap v3500: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:33:46.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:33:45 smithi047 bash[22744]: audit 2024-09-16T07:33:45.380136+0000 mon.a (mon.0) 863 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:33:46.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:33:45 smithi047 bash[22744]: audit 2024-09-16T07:33:45.385302+0000 mon.a (mon.0) 864 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:33:46.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:33:45 smithi047 bash[22744]: audit 2024-09-16T07:33:45.391189+0000 mon.a (mon.0) 865 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:33:46.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:33:45 smithi047 bash[22744]: audit 2024-09-16T07:33:45.396276+0000 mon.a (mon.0) 866 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:33:46.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:33:45 smithi047 bash[22744]: audit 2024-09-16T07:33:45.421814+0000 mon.a (mon.0) 867 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:33:46.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:33:45 smithi047 bash[22744]: audit 2024-09-16T07:33:45.427316+0000 mon.a (mon.0) 868 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:33:47.010 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:33:47.011 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:33:47.011 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:33:47.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:33:46 smithi157 bash[24585]: audit 2024-09-16T07:33:46.163552+0000 mon.b (mon.2) 495 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T07:33:47.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:33:46 smithi157 bash[24585]: audit 2024-09-16T07:33:46.165666+0000 mon.b (mon.2) 496 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T07:33:47.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:33:46 smithi157 bash[24585]: audit 2024-09-16T07:33:46.177416+0000 mon.a (mon.0) 869 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:33:47.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:33:46 smithi157 bash[24585]: audit 2024-09-16T07:33:46.182523+0000 mon.b (mon.2) 497 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:33:47.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:33:46 smithi157 bash[24585]: audit 2024-09-16T07:33:46.186092+0000 mgr.a (mgr.14373) 5048 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:33:47.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:33:46 smithi157 bash[24585]: cluster 2024-09-16T07:33:46.621137+0000 mgr.a (mgr.14373) 5049 : cluster [DBG] pgmap v3501: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 3.1 KiB/s rd, 170 B/s wr, 2 op/s 2024-09-16T07:33:47.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:33:46 smithi086 bash[24289]: audit 2024-09-16T07:33:46.163552+0000 mon.b (mon.2) 495 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T07:33:47.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:33:46 smithi086 bash[24289]: audit 2024-09-16T07:33:46.165666+0000 mon.b (mon.2) 496 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T07:33:47.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:33:46 smithi086 bash[24289]: audit 2024-09-16T07:33:46.177416+0000 mon.a (mon.0) 869 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:33:47.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:33:46 smithi086 bash[24289]: audit 2024-09-16T07:33:46.182523+0000 mon.b (mon.2) 497 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:33:47.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:33:46 smithi086 bash[24289]: audit 2024-09-16T07:33:46.186092+0000 mgr.a (mgr.14373) 5048 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:33:47.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:33:46 smithi086 bash[24289]: cluster 2024-09-16T07:33:46.621137+0000 mgr.a (mgr.14373) 5049 : cluster [DBG] pgmap v3501: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 3.1 KiB/s rd, 170 B/s wr, 2 op/s 2024-09-16T07:33:47.339 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 07:33:46 smithi047 bash[22994]: debug 2024-09-16T07:33:46.900+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T07:33:47.339 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 07:33:46 smithi047 bash[22994]: debug 2024-09-16T07:33:46.900+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T07:33:47.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:33:46 smithi047 bash[22744]: audit 2024-09-16T07:33:46.163552+0000 mon.b (mon.2) 495 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T07:33:47.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:33:46 smithi047 bash[22744]: audit 2024-09-16T07:33:46.165666+0000 mon.b (mon.2) 496 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T07:33:47.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:33:46 smithi047 bash[22744]: audit 2024-09-16T07:33:46.177416+0000 mon.a (mon.0) 869 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:33:47.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:33:46 smithi047 bash[22744]: audit 2024-09-16T07:33:46.182523+0000 mon.b (mon.2) 497 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:33:47.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:33:46 smithi047 bash[22744]: audit 2024-09-16T07:33:46.186092+0000 mgr.a (mgr.14373) 5048 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:33:47.340 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:33:46 smithi047 bash[22744]: cluster 2024-09-16T07:33:46.621137+0000 mgr.a (mgr.14373) 5049 : cluster [DBG] pgmap v3501: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 3.1 KiB/s rd, 170 B/s wr, 2 op/s 2024-09-16T07:33:47.750 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:33:47.751 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:33:47.751 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:33:47.751 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:33:47.751 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:33:48.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:33:48 smithi157 bash[24585]: audit 2024-09-16T07:33:46.902768+0000 mgr.a (mgr.14373) 5050 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T07:33:48.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:33:48 smithi157 bash[24585]: cephadm 2024-09-16T07:33:46.904263+0000 mgr.a (mgr.14373) 5051 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T07:33:48.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:33:48 smithi157 bash[24585]: audit 2024-09-16T07:33:47.340391+0000 mgr.a (mgr.14373) 5052 : audit [DBG] from='client.118740 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:33:48.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:33:48 smithi086 bash[24289]: audit 2024-09-16T07:33:46.902768+0000 mgr.a (mgr.14373) 5050 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T07:33:48.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:33:48 smithi086 bash[24289]: cephadm 2024-09-16T07:33:46.904263+0000 mgr.a (mgr.14373) 5051 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T07:33:48.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:33:48 smithi086 bash[24289]: audit 2024-09-16T07:33:47.340391+0000 mgr.a (mgr.14373) 5052 : audit [DBG] from='client.118740 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:33:48.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:33:48 smithi047 bash[22744]: audit 2024-09-16T07:33:46.902768+0000 mgr.a (mgr.14373) 5050 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T07:33:48.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:33:48 smithi047 bash[22744]: cephadm 2024-09-16T07:33:46.904263+0000 mgr.a (mgr.14373) 5051 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T07:33:48.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:33:48 smithi047 bash[22744]: audit 2024-09-16T07:33:47.340391+0000 mgr.a (mgr.14373) 5052 : audit [DBG] from='client.118740 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:33:49.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:33:49 smithi157 bash[24585]: cluster 2024-09-16T07:33:48.621970+0000 mgr.a (mgr.14373) 5053 : cluster [DBG] pgmap v3502: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 170 B/s wr, 2 op/s 2024-09-16T07:33:49.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:33:49 smithi086 bash[24289]: cluster 2024-09-16T07:33:48.621970+0000 mgr.a (mgr.14373) 5053 : cluster [DBG] pgmap v3502: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 170 B/s wr, 2 op/s 2024-09-16T07:33:49.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:33:49 smithi047 bash[22744]: cluster 2024-09-16T07:33:48.621970+0000 mgr.a (mgr.14373) 5053 : cluster [DBG] pgmap v3502: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 170 B/s wr, 2 op/s 2024-09-16T07:33:52.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:33:51 smithi157 bash[24585]: cluster 2024-09-16T07:33:50.622761+0000 mgr.a (mgr.14373) 5054 : cluster [DBG] pgmap v3503: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 170 B/s wr, 2 op/s 2024-09-16T07:33:52.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:33:51 smithi086 bash[24289]: cluster 2024-09-16T07:33:50.622761+0000 mgr.a (mgr.14373) 5054 : cluster [DBG] pgmap v3503: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 170 B/s wr, 2 op/s 2024-09-16T07:33:52.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:33:51 smithi047 bash[22744]: cluster 2024-09-16T07:33:50.622761+0000 mgr.a (mgr.14373) 5054 : cluster [DBG] pgmap v3503: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 170 B/s wr, 2 op/s 2024-09-16T07:33:52.752 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:33:52.753 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:33:52.753 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:33:53.526 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:33:53.527 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:33:53.527 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:33:53.527 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:33:53.527 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:33:54.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:33:53 smithi157 bash[24585]: cluster 2024-09-16T07:33:52.624985+0000 mgr.a (mgr.14373) 5055 : cluster [DBG] pgmap v3504: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:33:54.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:33:53 smithi086 bash[24289]: cluster 2024-09-16T07:33:52.624985+0000 mgr.a (mgr.14373) 5055 : cluster [DBG] pgmap v3504: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:33:54.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:33:53 smithi047 bash[22744]: cluster 2024-09-16T07:33:52.624985+0000 mgr.a (mgr.14373) 5055 : cluster [DBG] pgmap v3504: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:33:55.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:33:54 smithi157 bash[24585]: audit 2024-09-16T07:33:53.096129+0000 mgr.a (mgr.14373) 5056 : audit [DBG] from='client.118818 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:33:55.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:33:54 smithi086 bash[24289]: audit 2024-09-16T07:33:53.096129+0000 mgr.a (mgr.14373) 5056 : audit [DBG] from='client.118818 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:33:55.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:33:54 smithi047 bash[22744]: audit 2024-09-16T07:33:53.096129+0000 mgr.a (mgr.14373) 5056 : audit [DBG] from='client.118818 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:33:56.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:33:55 smithi157 bash[24585]: cluster 2024-09-16T07:33:54.625895+0000 mgr.a (mgr.14373) 5057 : cluster [DBG] pgmap v3505: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:33:56.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:33:55 smithi086 bash[24289]: cluster 2024-09-16T07:33:54.625895+0000 mgr.a (mgr.14373) 5057 : cluster [DBG] pgmap v3505: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:33:56.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:33:55 smithi047 bash[22744]: cluster 2024-09-16T07:33:54.625895+0000 mgr.a (mgr.14373) 5057 : cluster [DBG] pgmap v3505: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:33:58.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:33:57 smithi157 bash[24585]: cluster 2024-09-16T07:33:56.628029+0000 mgr.a (mgr.14373) 5058 : cluster [DBG] pgmap v3506: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:33:58.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:33:57 smithi086 bash[24289]: cluster 2024-09-16T07:33:56.628029+0000 mgr.a (mgr.14373) 5058 : cluster [DBG] pgmap v3506: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:33:58.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:33:57 smithi047 bash[22744]: cluster 2024-09-16T07:33:56.628029+0000 mgr.a (mgr.14373) 5058 : cluster [DBG] pgmap v3506: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:33:58.528 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:33:58.529 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:33:58.529 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:33:59.279 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:33:59.279 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:33:59.279 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:33:59.279 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:33:59.279 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:34:00.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:33:59 smithi157 bash[24585]: cluster 2024-09-16T07:33:58.628522+0000 mgr.a (mgr.14373) 5059 : cluster [DBG] pgmap v3507: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 5.7 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-16T07:34:00.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:33:59 smithi157 bash[24585]: audit 2024-09-16T07:33:58.865276+0000 mgr.a (mgr.14373) 5060 : audit [DBG] from='client.118896 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:34:00.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:33:59 smithi086 bash[24289]: cluster 2024-09-16T07:33:58.628522+0000 mgr.a (mgr.14373) 5059 : cluster [DBG] pgmap v3507: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 5.7 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-16T07:34:00.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:33:59 smithi086 bash[24289]: audit 2024-09-16T07:33:58.865276+0000 mgr.a (mgr.14373) 5060 : audit [DBG] from='client.118896 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:34:00.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:33:59 smithi047 bash[22744]: cluster 2024-09-16T07:33:58.628522+0000 mgr.a (mgr.14373) 5059 : cluster [DBG] pgmap v3507: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 5.7 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-16T07:34:00.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:33:59 smithi047 bash[22744]: audit 2024-09-16T07:33:58.865276+0000 mgr.a (mgr.14373) 5060 : audit [DBG] from='client.118896 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:34:02.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:34:01 smithi157 bash[24585]: cluster 2024-09-16T07:34:00.629393+0000 mgr.a (mgr.14373) 5061 : cluster [DBG] pgmap v3508: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 5.7 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-16T07:34:02.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:34:01 smithi086 bash[24289]: cluster 2024-09-16T07:34:00.629393+0000 mgr.a (mgr.14373) 5061 : cluster [DBG] pgmap v3508: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 5.7 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-16T07:34:02.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:34:01 smithi047 bash[22744]: cluster 2024-09-16T07:34:00.629393+0000 mgr.a (mgr.14373) 5061 : cluster [DBG] pgmap v3508: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 5.7 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-16T07:34:04.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:34:03 smithi157 bash[24585]: cluster 2024-09-16T07:34:02.631661+0000 mgr.a (mgr.14373) 5062 : cluster [DBG] pgmap v3509: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-16T07:34:04.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:34:03 smithi086 bash[24289]: cluster 2024-09-16T07:34:02.631661+0000 mgr.a (mgr.14373) 5062 : cluster [DBG] pgmap v3509: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-16T07:34:04.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:34:03 smithi047 bash[22744]: cluster 2024-09-16T07:34:02.631661+0000 mgr.a (mgr.14373) 5062 : cluster [DBG] pgmap v3509: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-16T07:34:04.280 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:34:04.281 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:34:04.281 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:34:05.067 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:34:05.068 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:34:05.068 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:34:05.068 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:34:05.068 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:34:06.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:34:05 smithi157 bash[24585]: audit 2024-09-16T07:34:04.623009+0000 mgr.a (mgr.14373) 5063 : audit [DBG] from='client.118971 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:34:06.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:34:05 smithi157 bash[24585]: cluster 2024-09-16T07:34:04.641607+0000 mgr.a (mgr.14373) 5064 : cluster [DBG] pgmap v3510: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:34:06.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:34:05 smithi086 bash[24289]: audit 2024-09-16T07:34:04.623009+0000 mgr.a (mgr.14373) 5063 : audit [DBG] from='client.118971 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:34:06.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:34:05 smithi086 bash[24289]: cluster 2024-09-16T07:34:04.641607+0000 mgr.a (mgr.14373) 5064 : cluster [DBG] pgmap v3510: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:34:06.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:34:05 smithi047 bash[22744]: audit 2024-09-16T07:34:04.623009+0000 mgr.a (mgr.14373) 5063 : audit [DBG] from='client.118971 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:34:06.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:34:05 smithi047 bash[22744]: cluster 2024-09-16T07:34:04.641607+0000 mgr.a (mgr.14373) 5064 : cluster [DBG] pgmap v3510: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:34:08.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:34:07 smithi157 bash[24585]: cluster 2024-09-16T07:34:06.644241+0000 mgr.a (mgr.14373) 5065 : cluster [DBG] pgmap v3511: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:34:08.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:34:07 smithi086 bash[24289]: cluster 2024-09-16T07:34:06.644241+0000 mgr.a (mgr.14373) 5065 : cluster [DBG] pgmap v3511: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:34:08.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:34:07 smithi047 bash[22744]: cluster 2024-09-16T07:34:06.644241+0000 mgr.a (mgr.14373) 5065 : cluster [DBG] pgmap v3511: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:34:10.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:34:09 smithi157 bash[24585]: cluster 2024-09-16T07:34:08.645164+0000 mgr.a (mgr.14373) 5066 : cluster [DBG] pgmap v3512: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:34:10.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:34:09 smithi086 bash[24289]: cluster 2024-09-16T07:34:08.645164+0000 mgr.a (mgr.14373) 5066 : cluster [DBG] pgmap v3512: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:34:10.069 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:34:10.070 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:34:10.070 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:34:10.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:34:09 smithi047 bash[22744]: cluster 2024-09-16T07:34:08.645164+0000 mgr.a (mgr.14373) 5066 : cluster [DBG] pgmap v3512: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:34:10.857 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:34:10.858 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:34:10.858 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:34:10.858 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:34:10.858 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:34:12.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:34:11 smithi157 bash[24585]: audit 2024-09-16T07:34:10.410588+0000 mgr.a (mgr.14373) 5067 : audit [DBG] from='client.119046 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:34:12.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:34:11 smithi157 bash[24585]: cluster 2024-09-16T07:34:10.652513+0000 mgr.a (mgr.14373) 5068 : cluster [DBG] pgmap v3513: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:34:12.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:34:11 smithi086 bash[24289]: audit 2024-09-16T07:34:10.410588+0000 mgr.a (mgr.14373) 5067 : audit [DBG] from='client.119046 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:34:12.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:34:11 smithi086 bash[24289]: cluster 2024-09-16T07:34:10.652513+0000 mgr.a (mgr.14373) 5068 : cluster [DBG] pgmap v3513: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:34:12.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:34:11 smithi047 bash[22744]: audit 2024-09-16T07:34:10.410588+0000 mgr.a (mgr.14373) 5067 : audit [DBG] from='client.119046 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:34:12.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:34:11 smithi047 bash[22744]: cluster 2024-09-16T07:34:10.652513+0000 mgr.a (mgr.14373) 5068 : cluster [DBG] pgmap v3513: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:34:14.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:34:13 smithi157 bash[24585]: cluster 2024-09-16T07:34:12.654890+0000 mgr.a (mgr.14373) 5069 : cluster [DBG] pgmap v3514: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:34:14.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:34:13 smithi086 bash[24289]: cluster 2024-09-16T07:34:12.654890+0000 mgr.a (mgr.14373) 5069 : cluster [DBG] pgmap v3514: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:34:14.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:34:13 smithi047 bash[22744]: cluster 2024-09-16T07:34:12.654890+0000 mgr.a (mgr.14373) 5069 : cluster [DBG] pgmap v3514: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:34:15.859 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:34:15.860 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:34:15.860 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:34:16.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:34:15 smithi157 bash[24585]: cluster 2024-09-16T07:34:14.655631+0000 mgr.a (mgr.14373) 5070 : cluster [DBG] pgmap v3515: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:34:16.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:34:15 smithi086 bash[24289]: cluster 2024-09-16T07:34:14.655631+0000 mgr.a (mgr.14373) 5070 : cluster [DBG] pgmap v3515: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:34:16.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:34:15 smithi047 bash[22744]: cluster 2024-09-16T07:34:14.655631+0000 mgr.a (mgr.14373) 5070 : cluster [DBG] pgmap v3515: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:34:16.649 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:34:16.649 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:34:16.649 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:34:16.649 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:34:16.649 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:34:18.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:34:17 smithi157 bash[24585]: audit 2024-09-16T07:34:16.201813+0000 mgr.a (mgr.14373) 5071 : audit [DBG] from='client.119121 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:34:18.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:34:17 smithi157 bash[24585]: cluster 2024-09-16T07:34:16.657099+0000 mgr.a (mgr.14373) 5072 : cluster [DBG] pgmap v3516: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-16T07:34:18.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:34:17 smithi086 bash[24289]: audit 2024-09-16T07:34:16.201813+0000 mgr.a (mgr.14373) 5071 : audit [DBG] from='client.119121 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:34:18.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:34:17 smithi086 bash[24289]: cluster 2024-09-16T07:34:16.657099+0000 mgr.a (mgr.14373) 5072 : cluster [DBG] pgmap v3516: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-16T07:34:18.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:34:17 smithi047 bash[22744]: audit 2024-09-16T07:34:16.201813+0000 mgr.a (mgr.14373) 5071 : audit [DBG] from='client.119121 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:34:18.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:34:17 smithi047 bash[22744]: cluster 2024-09-16T07:34:16.657099+0000 mgr.a (mgr.14373) 5072 : cluster [DBG] pgmap v3516: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-16T07:34:20.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:34:19 smithi157 bash[24585]: cluster 2024-09-16T07:34:18.657836+0000 mgr.a (mgr.14373) 5073 : cluster [DBG] pgmap v3517: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T07:34:20.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:34:19 smithi086 bash[24289]: cluster 2024-09-16T07:34:18.657836+0000 mgr.a (mgr.14373) 5073 : cluster [DBG] pgmap v3517: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T07:34:20.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:34:19 smithi047 bash[22744]: cluster 2024-09-16T07:34:18.657836+0000 mgr.a (mgr.14373) 5073 : cluster [DBG] pgmap v3517: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T07:34:21.650 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:34:21.651 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:34:21.651 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:34:22.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:34:21 smithi157 bash[24585]: cluster 2024-09-16T07:34:20.658616+0000 mgr.a (mgr.14373) 5074 : cluster [DBG] pgmap v3518: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T07:34:22.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:34:21 smithi086 bash[24289]: cluster 2024-09-16T07:34:20.658616+0000 mgr.a (mgr.14373) 5074 : cluster [DBG] pgmap v3518: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T07:34:22.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:34:21 smithi047 bash[22744]: cluster 2024-09-16T07:34:20.658616+0000 mgr.a (mgr.14373) 5074 : cluster [DBG] pgmap v3518: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T07:34:22.407 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:34:22.407 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:34:22.407 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:34:22.407 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:34:22.408 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:34:24.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:34:23 smithi157 bash[24585]: audit 2024-09-16T07:34:21.986384+0000 mgr.a (mgr.14373) 5075 : audit [DBG] from='client.119196 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:34:24.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:34:23 smithi157 bash[24585]: cluster 2024-09-16T07:34:22.661379+0000 mgr.a (mgr.14373) 5076 : cluster [DBG] pgmap v3519: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:34:24.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:34:23 smithi086 bash[24289]: audit 2024-09-16T07:34:21.986384+0000 mgr.a (mgr.14373) 5075 : audit [DBG] from='client.119196 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:34:24.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:34:23 smithi086 bash[24289]: cluster 2024-09-16T07:34:22.661379+0000 mgr.a (mgr.14373) 5076 : cluster [DBG] pgmap v3519: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:34:24.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:34:23 smithi047 bash[22744]: audit 2024-09-16T07:34:21.986384+0000 mgr.a (mgr.14373) 5075 : audit [DBG] from='client.119196 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:34:24.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:34:23 smithi047 bash[22744]: cluster 2024-09-16T07:34:22.661379+0000 mgr.a (mgr.14373) 5076 : cluster [DBG] pgmap v3519: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:34:26.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:34:25 smithi157 bash[24585]: cluster 2024-09-16T07:34:24.662192+0000 mgr.a (mgr.14373) 5077 : cluster [DBG] pgmap v3520: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:34:26.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:34:25 smithi086 bash[24289]: cluster 2024-09-16T07:34:24.662192+0000 mgr.a (mgr.14373) 5077 : cluster [DBG] pgmap v3520: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:34:26.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:34:25 smithi047 bash[22744]: cluster 2024-09-16T07:34:24.662192+0000 mgr.a (mgr.14373) 5077 : cluster [DBG] pgmap v3520: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:34:27.409 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:34:27.410 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:34:27.410 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:34:28.148 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:34:28.149 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:34:28.149 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:34:28.149 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:34:28.149 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:34:28.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:34:27 smithi157 bash[24585]: cluster 2024-09-16T07:34:26.664084+0000 mgr.a (mgr.14373) 5078 : cluster [DBG] pgmap v3521: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:34:28.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:34:27 smithi086 bash[24289]: cluster 2024-09-16T07:34:26.664084+0000 mgr.a (mgr.14373) 5078 : cluster [DBG] pgmap v3521: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:34:28.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:34:27 smithi047 bash[22744]: cluster 2024-09-16T07:34:26.664084+0000 mgr.a (mgr.14373) 5078 : cluster [DBG] pgmap v3521: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:34:29.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:34:28 smithi157 bash[24585]: audit 2024-09-16T07:34:27.739370+0000 mgr.a (mgr.14373) 5079 : audit [DBG] from='client.119274 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:34:29.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:34:28 smithi086 bash[24289]: audit 2024-09-16T07:34:27.739370+0000 mgr.a (mgr.14373) 5079 : audit [DBG] from='client.119274 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:34:29.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:34:28 smithi047 bash[22744]: audit 2024-09-16T07:34:27.739370+0000 mgr.a (mgr.14373) 5079 : audit [DBG] from='client.119274 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:34:30.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:34:29 smithi157 bash[24585]: cluster 2024-09-16T07:34:28.664999+0000 mgr.a (mgr.14373) 5080 : cluster [DBG] pgmap v3522: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-16T07:34:30.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:34:29 smithi086 bash[24289]: cluster 2024-09-16T07:34:28.664999+0000 mgr.a (mgr.14373) 5080 : cluster [DBG] pgmap v3522: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-16T07:34:30.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:34:29 smithi047 bash[22744]: cluster 2024-09-16T07:34:28.664999+0000 mgr.a (mgr.14373) 5080 : cluster [DBG] pgmap v3522: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-16T07:34:31.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:34:30 smithi157 bash[24585]: cluster 2024-09-16T07:34:30.665789+0000 mgr.a (mgr.14373) 5081 : cluster [DBG] pgmap v3523: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-16T07:34:31.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:34:30 smithi086 bash[24289]: cluster 2024-09-16T07:34:30.665789+0000 mgr.a (mgr.14373) 5081 : cluster [DBG] pgmap v3523: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-16T07:34:31.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:34:30 smithi047 bash[22744]: cluster 2024-09-16T07:34:30.665789+0000 mgr.a (mgr.14373) 5081 : cluster [DBG] pgmap v3523: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-16T07:34:33.150 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:34:33.151 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:34:33.151 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:34:33.905 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:34:33.905 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:34:33.905 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:34:33.906 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:34:33.906 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:34:34.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:34:33 smithi157 bash[24585]: cluster 2024-09-16T07:34:32.667939+0000 mgr.a (mgr.14373) 5082 : cluster [DBG] pgmap v3524: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-16T07:34:34.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:34:33 smithi086 bash[24289]: cluster 2024-09-16T07:34:32.667939+0000 mgr.a (mgr.14373) 5082 : cluster [DBG] pgmap v3524: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-16T07:34:34.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:34:33 smithi047 bash[22744]: cluster 2024-09-16T07:34:32.667939+0000 mgr.a (mgr.14373) 5082 : cluster [DBG] pgmap v3524: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-16T07:34:35.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:34:34 smithi157 bash[24585]: audit 2024-09-16T07:34:33.483394+0000 mgr.a (mgr.14373) 5083 : audit [DBG] from='client.119352 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:34:35.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:34:34 smithi086 bash[24289]: audit 2024-09-16T07:34:33.483394+0000 mgr.a (mgr.14373) 5083 : audit [DBG] from='client.119352 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:34:35.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:34:34 smithi047 bash[22744]: audit 2024-09-16T07:34:33.483394+0000 mgr.a (mgr.14373) 5083 : audit [DBG] from='client.119352 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:34:36.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:34:35 smithi157 bash[24585]: cluster 2024-09-16T07:34:34.668827+0000 mgr.a (mgr.14373) 5084 : cluster [DBG] pgmap v3525: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:34:36.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:34:35 smithi086 bash[24289]: cluster 2024-09-16T07:34:34.668827+0000 mgr.a (mgr.14373) 5084 : cluster [DBG] pgmap v3525: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:34:36.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:34:35 smithi047 bash[22744]: cluster 2024-09-16T07:34:34.668827+0000 mgr.a (mgr.14373) 5084 : cluster [DBG] pgmap v3525: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:34:38.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:34:37 smithi157 bash[24585]: cluster 2024-09-16T07:34:36.670967+0000 mgr.a (mgr.14373) 5085 : cluster [DBG] pgmap v3526: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:34:38.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:34:37 smithi086 bash[24289]: cluster 2024-09-16T07:34:36.670967+0000 mgr.a (mgr.14373) 5085 : cluster [DBG] pgmap v3526: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:34:38.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:34:37 smithi047 bash[22744]: cluster 2024-09-16T07:34:36.670967+0000 mgr.a (mgr.14373) 5085 : cluster [DBG] pgmap v3526: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:34:38.906 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:34:38.907 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:34:38.907 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:34:39.670 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:34:39.670 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:34:39.670 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:34:39.671 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:34:39.671 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:34:40.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:34:39 smithi157 bash[24585]: cluster 2024-09-16T07:34:38.671721+0000 mgr.a (mgr.14373) 5086 : cluster [DBG] pgmap v3527: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:34:40.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:34:39 smithi086 bash[24289]: cluster 2024-09-16T07:34:38.671721+0000 mgr.a (mgr.14373) 5086 : cluster [DBG] pgmap v3527: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:34:40.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:34:39 smithi047 bash[22744]: cluster 2024-09-16T07:34:38.671721+0000 mgr.a (mgr.14373) 5086 : cluster [DBG] pgmap v3527: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:34:41.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:34:40 smithi157 bash[24585]: audit 2024-09-16T07:34:39.244704+0000 mgr.a (mgr.14373) 5087 : audit [DBG] from='client.119424 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:34:41.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:34:40 smithi086 bash[24289]: audit 2024-09-16T07:34:39.244704+0000 mgr.a (mgr.14373) 5087 : audit [DBG] from='client.119424 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:34:41.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:34:40 smithi047 bash[22744]: audit 2024-09-16T07:34:39.244704+0000 mgr.a (mgr.14373) 5087 : audit [DBG] from='client.119424 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:34:42.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:34:41 smithi157 bash[24585]: cluster 2024-09-16T07:34:40.672613+0000 mgr.a (mgr.14373) 5088 : cluster [DBG] pgmap v3528: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:34:42.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:34:41 smithi086 bash[24289]: cluster 2024-09-16T07:34:40.672613+0000 mgr.a (mgr.14373) 5088 : cluster [DBG] pgmap v3528: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:34:42.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:34:41 smithi047 bash[22744]: cluster 2024-09-16T07:34:40.672613+0000 mgr.a (mgr.14373) 5088 : cluster [DBG] pgmap v3528: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:34:44.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:34:43 smithi157 bash[24585]: cluster 2024-09-16T07:34:42.674837+0000 mgr.a (mgr.14373) 5089 : cluster [DBG] pgmap v3529: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:34:44.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:34:43 smithi086 bash[24289]: cluster 2024-09-16T07:34:42.674837+0000 mgr.a (mgr.14373) 5089 : cluster [DBG] pgmap v3529: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:34:44.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:34:43 smithi047 bash[22744]: cluster 2024-09-16T07:34:42.674837+0000 mgr.a (mgr.14373) 5089 : cluster [DBG] pgmap v3529: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:34:44.672 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:34:44.673 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:34:44.673 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:34:45.443 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:34:45.443 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:34:45.443 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:34:45.443 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:34:45.443 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:34:46.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:34:45 smithi157 bash[24585]: cluster 2024-09-16T07:34:44.675652+0000 mgr.a (mgr.14373) 5090 : cluster [DBG] pgmap v3530: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:34:46.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:34:45 smithi086 bash[24289]: cluster 2024-09-16T07:34:44.675652+0000 mgr.a (mgr.14373) 5090 : cluster [DBG] pgmap v3530: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:34:46.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:34:45 smithi047 bash[22744]: cluster 2024-09-16T07:34:44.675652+0000 mgr.a (mgr.14373) 5090 : cluster [DBG] pgmap v3530: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:34:47.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:34:46 smithi157 bash[24585]: audit 2024-09-16T07:34:45.011178+0000 mgr.a (mgr.14373) 5091 : audit [DBG] from='client.119496 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:34:47.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:34:46 smithi086 bash[24289]: audit 2024-09-16T07:34:45.011178+0000 mgr.a (mgr.14373) 5091 : audit [DBG] from='client.119496 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:34:47.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:34:46 smithi047 bash[22744]: audit 2024-09-16T07:34:45.011178+0000 mgr.a (mgr.14373) 5091 : audit [DBG] from='client.119496 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:34:48.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:34:47 smithi157 bash[24585]: cluster 2024-09-16T07:34:46.677900+0000 mgr.a (mgr.14373) 5092 : cluster [DBG] pgmap v3531: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:34:48.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:34:47 smithi157 bash[24585]: audit 2024-09-16T07:34:46.952881+0000 mon.b (mon.2) 498 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T07:34:48.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:34:47 smithi157 bash[24585]: audit 2024-09-16T07:34:47.779495+0000 mon.b (mon.2) 499 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T07:34:48.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:34:47 smithi157 bash[24585]: audit 2024-09-16T07:34:47.781461+0000 mon.b (mon.2) 500 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T07:34:48.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:34:47 smithi157 bash[24585]: audit 2024-09-16T07:34:47.793914+0000 mon.a (mon.0) 870 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:34:48.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:34:47 smithi157 bash[24585]: audit 2024-09-16T07:34:47.798054+0000 mon.b (mon.2) 501 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:34:48.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:34:47 smithi157 bash[24585]: audit 2024-09-16T07:34:47.801601+0000 mgr.a (mgr.14373) 5093 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:34:48.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:34:47 smithi086 bash[24289]: cluster 2024-09-16T07:34:46.677900+0000 mgr.a (mgr.14373) 5092 : cluster [DBG] pgmap v3531: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:34:48.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:34:47 smithi086 bash[24289]: audit 2024-09-16T07:34:46.952881+0000 mon.b (mon.2) 498 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T07:34:48.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:34:47 smithi086 bash[24289]: audit 2024-09-16T07:34:47.779495+0000 mon.b (mon.2) 499 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T07:34:48.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:34:47 smithi086 bash[24289]: audit 2024-09-16T07:34:47.781461+0000 mon.b (mon.2) 500 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T07:34:48.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:34:47 smithi086 bash[24289]: audit 2024-09-16T07:34:47.793914+0000 mon.a (mon.0) 870 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:34:48.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:34:47 smithi086 bash[24289]: audit 2024-09-16T07:34:47.798054+0000 mon.b (mon.2) 501 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:34:48.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:34:47 smithi086 bash[24289]: audit 2024-09-16T07:34:47.801601+0000 mgr.a (mgr.14373) 5093 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:34:48.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:34:47 smithi047 bash[22744]: cluster 2024-09-16T07:34:46.677900+0000 mgr.a (mgr.14373) 5092 : cluster [DBG] pgmap v3531: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:34:48.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:34:47 smithi047 bash[22744]: audit 2024-09-16T07:34:46.952881+0000 mon.b (mon.2) 498 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T07:34:48.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:34:47 smithi047 bash[22744]: audit 2024-09-16T07:34:47.779495+0000 mon.b (mon.2) 499 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T07:34:48.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:34:47 smithi047 bash[22744]: audit 2024-09-16T07:34:47.781461+0000 mon.b (mon.2) 500 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T07:34:48.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:34:47 smithi047 bash[22744]: audit 2024-09-16T07:34:47.793914+0000 mon.a (mon.0) 870 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:34:48.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:34:47 smithi047 bash[22744]: audit 2024-09-16T07:34:47.798054+0000 mon.b (mon.2) 501 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:34:48.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:34:47 smithi047 bash[22744]: audit 2024-09-16T07:34:47.801601+0000 mgr.a (mgr.14373) 5093 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:34:48.839 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 07:34:48 smithi047 bash[22994]: debug 2024-09-16T07:34:48.519+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T07:34:48.839 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 07:34:48 smithi047 bash[22994]: debug 2024-09-16T07:34:48.519+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T07:34:49.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:34:48 smithi157 bash[24585]: audit 2024-09-16T07:34:48.522780+0000 mgr.a (mgr.14373) 5094 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T07:34:49.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:34:48 smithi157 bash[24585]: cephadm 2024-09-16T07:34:48.524635+0000 mgr.a (mgr.14373) 5095 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T07:34:49.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:34:48 smithi157 bash[24585]: cluster 2024-09-16T07:34:48.678786+0000 mgr.a (mgr.14373) 5096 : cluster [DBG] pgmap v3532: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:34:49.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:34:48 smithi086 bash[24289]: audit 2024-09-16T07:34:48.522780+0000 mgr.a (mgr.14373) 5094 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T07:34:49.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:34:48 smithi086 bash[24289]: cephadm 2024-09-16T07:34:48.524635+0000 mgr.a (mgr.14373) 5095 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T07:34:49.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:34:48 smithi086 bash[24289]: cluster 2024-09-16T07:34:48.678786+0000 mgr.a (mgr.14373) 5096 : cluster [DBG] pgmap v3532: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:34:49.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:34:48 smithi047 bash[22744]: audit 2024-09-16T07:34:48.522780+0000 mgr.a (mgr.14373) 5094 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T07:34:49.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:34:48 smithi047 bash[22744]: cephadm 2024-09-16T07:34:48.524635+0000 mgr.a (mgr.14373) 5095 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T07:34:49.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:34:48 smithi047 bash[22744]: cluster 2024-09-16T07:34:48.678786+0000 mgr.a (mgr.14373) 5096 : cluster [DBG] pgmap v3532: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:34:50.444 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:34:50.445 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:34:50.445 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:34:51.225 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:34:51.225 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:34:51.225 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:34:51.225 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:34:51.225 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:34:52.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:34:51 smithi157 bash[24585]: cluster 2024-09-16T07:34:50.679315+0000 mgr.a (mgr.14373) 5097 : cluster [DBG] pgmap v3533: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:34:52.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:34:51 smithi157 bash[24585]: audit 2024-09-16T07:34:50.783832+0000 mgr.a (mgr.14373) 5098 : audit [DBG] from='client.119682 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:34:52.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:34:51 smithi086 bash[24289]: cluster 2024-09-16T07:34:50.679315+0000 mgr.a (mgr.14373) 5097 : cluster [DBG] pgmap v3533: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:34:52.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:34:51 smithi086 bash[24289]: audit 2024-09-16T07:34:50.783832+0000 mgr.a (mgr.14373) 5098 : audit [DBG] from='client.119682 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:34:52.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:34:51 smithi047 bash[22744]: cluster 2024-09-16T07:34:50.679315+0000 mgr.a (mgr.14373) 5097 : cluster [DBG] pgmap v3533: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:34:52.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:34:51 smithi047 bash[22744]: audit 2024-09-16T07:34:50.783832+0000 mgr.a (mgr.14373) 5098 : audit [DBG] from='client.119682 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:34:54.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:34:53 smithi157 bash[24585]: cluster 2024-09-16T07:34:52.681624+0000 mgr.a (mgr.14373) 5099 : cluster [DBG] pgmap v3534: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:34:54.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:34:53 smithi086 bash[24289]: cluster 2024-09-16T07:34:52.681624+0000 mgr.a (mgr.14373) 5099 : cluster [DBG] pgmap v3534: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:34:54.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:34:53 smithi047 bash[22744]: cluster 2024-09-16T07:34:52.681624+0000 mgr.a (mgr.14373) 5099 : cluster [DBG] pgmap v3534: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:34:56.226 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:34:56.227 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:34:56.227 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:34:56.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:34:55 smithi157 bash[24585]: cluster 2024-09-16T07:34:54.682434+0000 mgr.a (mgr.14373) 5100 : cluster [DBG] pgmap v3535: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:34:56.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:34:55 smithi086 bash[24289]: cluster 2024-09-16T07:34:54.682434+0000 mgr.a (mgr.14373) 5100 : cluster [DBG] pgmap v3535: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:34:56.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:34:55 smithi047 bash[22744]: cluster 2024-09-16T07:34:54.682434+0000 mgr.a (mgr.14373) 5100 : cluster [DBG] pgmap v3535: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:34:57.011 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:34:57.011 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:34:57.011 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:34:57.011 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:34:57.011 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:34:58.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:34:57 smithi157 bash[24585]: audit 2024-09-16T07:34:56.567191+0000 mgr.a (mgr.14373) 5101 : audit [DBG] from='client.119757 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:34:58.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:34:57 smithi157 bash[24585]: cluster 2024-09-16T07:34:56.683722+0000 mgr.a (mgr.14373) 5102 : cluster [DBG] pgmap v3536: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:34:58.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:34:57 smithi086 bash[24289]: audit 2024-09-16T07:34:56.567191+0000 mgr.a (mgr.14373) 5101 : audit [DBG] from='client.119757 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:34:58.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:34:57 smithi086 bash[24289]: cluster 2024-09-16T07:34:56.683722+0000 mgr.a (mgr.14373) 5102 : cluster [DBG] pgmap v3536: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:34:58.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:34:57 smithi047 bash[22744]: audit 2024-09-16T07:34:56.567191+0000 mgr.a (mgr.14373) 5101 : audit [DBG] from='client.119757 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:34:58.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:34:57 smithi047 bash[22744]: cluster 2024-09-16T07:34:56.683722+0000 mgr.a (mgr.14373) 5102 : cluster [DBG] pgmap v3536: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:35:00.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:34:59 smithi157 bash[24585]: cluster 2024-09-16T07:34:58.684644+0000 mgr.a (mgr.14373) 5103 : cluster [DBG] pgmap v3537: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T07:35:00.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:34:59 smithi086 bash[24289]: cluster 2024-09-16T07:34:58.684644+0000 mgr.a (mgr.14373) 5103 : cluster [DBG] pgmap v3537: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T07:35:00.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:34:59 smithi047 bash[22744]: cluster 2024-09-16T07:34:58.684644+0000 mgr.a (mgr.14373) 5103 : cluster [DBG] pgmap v3537: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T07:35:02.013 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:35:02.013 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:35:02.014 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:35:02.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:35:01 smithi157 bash[24585]: cluster 2024-09-16T07:35:00.685428+0000 mgr.a (mgr.14373) 5104 : cluster [DBG] pgmap v3538: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T07:35:02.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:35:01 smithi086 bash[24289]: cluster 2024-09-16T07:35:00.685428+0000 mgr.a (mgr.14373) 5104 : cluster [DBG] pgmap v3538: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T07:35:02.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:35:01 smithi047 bash[22744]: cluster 2024-09-16T07:35:00.685428+0000 mgr.a (mgr.14373) 5104 : cluster [DBG] pgmap v3538: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T07:35:02.779 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:35:02.779 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:35:02.779 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:35:02.779 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:35:02.779 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:35:04.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:35:03 smithi157 bash[24585]: audit 2024-09-16T07:35:02.351238+0000 mgr.a (mgr.14373) 5105 : audit [DBG] from='client.119835 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:35:04.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:35:03 smithi157 bash[24585]: cluster 2024-09-16T07:35:02.687240+0000 mgr.a (mgr.14373) 5106 : cluster [DBG] pgmap v3539: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:35:04.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:35:03 smithi086 bash[24289]: audit 2024-09-16T07:35:02.351238+0000 mgr.a (mgr.14373) 5105 : audit [DBG] from='client.119835 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:35:04.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:35:03 smithi086 bash[24289]: cluster 2024-09-16T07:35:02.687240+0000 mgr.a (mgr.14373) 5106 : cluster [DBG] pgmap v3539: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:35:04.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:35:03 smithi047 bash[22744]: audit 2024-09-16T07:35:02.351238+0000 mgr.a (mgr.14373) 5105 : audit [DBG] from='client.119835 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:35:04.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:35:03 smithi047 bash[22744]: cluster 2024-09-16T07:35:02.687240+0000 mgr.a (mgr.14373) 5106 : cluster [DBG] pgmap v3539: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:35:06.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:35:05 smithi157 bash[24585]: cluster 2024-09-16T07:35:04.687978+0000 mgr.a (mgr.14373) 5107 : cluster [DBG] pgmap v3540: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T07:35:06.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:35:05 smithi086 bash[24289]: cluster 2024-09-16T07:35:04.687978+0000 mgr.a (mgr.14373) 5107 : cluster [DBG] pgmap v3540: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T07:35:06.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:35:05 smithi047 bash[22744]: cluster 2024-09-16T07:35:04.687978+0000 mgr.a (mgr.14373) 5107 : cluster [DBG] pgmap v3540: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T07:35:07.781 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:35:07.781 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:35:07.782 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:35:08.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:35:07 smithi157 bash[24585]: cluster 2024-09-16T07:35:06.689920+0000 mgr.a (mgr.14373) 5108 : cluster [DBG] pgmap v3541: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:35:08.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:35:07 smithi086 bash[24289]: cluster 2024-09-16T07:35:06.689920+0000 mgr.a (mgr.14373) 5108 : cluster [DBG] pgmap v3541: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:35:08.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:35:07 smithi047 bash[22744]: cluster 2024-09-16T07:35:06.689920+0000 mgr.a (mgr.14373) 5108 : cluster [DBG] pgmap v3541: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:35:08.526 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:35:08.526 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:35:08.526 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:35:08.526 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:35:08.526 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:35:09.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:35:08 smithi157 bash[24585]: audit 2024-09-16T07:35:08.114339+0000 mgr.a (mgr.14373) 5109 : audit [DBG] from='client.119913 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:35:09.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:35:08 smithi157 bash[24585]: cluster 2024-09-16T07:35:08.690770+0000 mgr.a (mgr.14373) 5110 : cluster [DBG] pgmap v3542: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:35:09.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:35:08 smithi086 bash[24289]: audit 2024-09-16T07:35:08.114339+0000 mgr.a (mgr.14373) 5109 : audit [DBG] from='client.119913 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:35:09.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:35:08 smithi086 bash[24289]: cluster 2024-09-16T07:35:08.690770+0000 mgr.a (mgr.14373) 5110 : cluster [DBG] pgmap v3542: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:35:09.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:35:08 smithi047 bash[22744]: audit 2024-09-16T07:35:08.114339+0000 mgr.a (mgr.14373) 5109 : audit [DBG] from='client.119913 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:35:09.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:35:08 smithi047 bash[22744]: cluster 2024-09-16T07:35:08.690770+0000 mgr.a (mgr.14373) 5110 : cluster [DBG] pgmap v3542: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:35:12.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:35:11 smithi157 bash[24585]: cluster 2024-09-16T07:35:10.691524+0000 mgr.a (mgr.14373) 5111 : cluster [DBG] pgmap v3543: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:35:12.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:35:11 smithi086 bash[24289]: cluster 2024-09-16T07:35:10.691524+0000 mgr.a (mgr.14373) 5111 : cluster [DBG] pgmap v3543: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:35:12.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:35:11 smithi047 bash[22744]: cluster 2024-09-16T07:35:10.691524+0000 mgr.a (mgr.14373) 5111 : cluster [DBG] pgmap v3543: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:35:13.527 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:35:13.528 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:35:13.528 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:35:14.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:35:13 smithi157 bash[24585]: cluster 2024-09-16T07:35:12.693724+0000 mgr.a (mgr.14373) 5112 : cluster [DBG] pgmap v3544: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:35:14.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:35:13 smithi086 bash[24289]: cluster 2024-09-16T07:35:12.693724+0000 mgr.a (mgr.14373) 5112 : cluster [DBG] pgmap v3544: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:35:14.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:35:13 smithi047 bash[22744]: cluster 2024-09-16T07:35:12.693724+0000 mgr.a (mgr.14373) 5112 : cluster [DBG] pgmap v3544: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:35:14.272 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:35:14.273 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:35:14.273 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:35:14.273 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:35:14.273 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:35:15.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:35:14 smithi157 bash[24585]: audit 2024-09-16T07:35:13.866330+0000 mgr.a (mgr.14373) 5113 : audit [DBG] from='client.119991 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:35:15.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:35:14 smithi086 bash[24289]: audit 2024-09-16T07:35:13.866330+0000 mgr.a (mgr.14373) 5113 : audit [DBG] from='client.119991 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:35:15.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:35:14 smithi047 bash[22744]: audit 2024-09-16T07:35:13.866330+0000 mgr.a (mgr.14373) 5113 : audit [DBG] from='client.119991 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:35:16.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:35:15 smithi157 bash[24585]: cluster 2024-09-16T07:35:14.694604+0000 mgr.a (mgr.14373) 5114 : cluster [DBG] pgmap v3545: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:35:16.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:35:15 smithi086 bash[24289]: cluster 2024-09-16T07:35:14.694604+0000 mgr.a (mgr.14373) 5114 : cluster [DBG] pgmap v3545: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:35:16.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:35:15 smithi047 bash[22744]: cluster 2024-09-16T07:35:14.694604+0000 mgr.a (mgr.14373) 5114 : cluster [DBG] pgmap v3545: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:35:18.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:35:17 smithi157 bash[24585]: cluster 2024-09-16T07:35:16.696701+0000 mgr.a (mgr.14373) 5115 : cluster [DBG] pgmap v3546: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:35:18.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:35:17 smithi086 bash[24289]: cluster 2024-09-16T07:35:16.696701+0000 mgr.a (mgr.14373) 5115 : cluster [DBG] pgmap v3546: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:35:18.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:35:17 smithi047 bash[22744]: cluster 2024-09-16T07:35:16.696701+0000 mgr.a (mgr.14373) 5115 : cluster [DBG] pgmap v3546: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:35:19.274 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:35:19.275 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:35:19.275 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:35:20.046 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:35:20.046 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:35:20.046 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:35:20.046 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:35:20.046 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:35:20.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:35:19 smithi157 bash[24585]: cluster 2024-09-16T07:35:18.697451+0000 mgr.a (mgr.14373) 5116 : cluster [DBG] pgmap v3547: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:35:20.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:35:19 smithi086 bash[24289]: cluster 2024-09-16T07:35:18.697451+0000 mgr.a (mgr.14373) 5116 : cluster [DBG] pgmap v3547: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:35:20.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:35:19 smithi047 bash[22744]: cluster 2024-09-16T07:35:18.697451+0000 mgr.a (mgr.14373) 5116 : cluster [DBG] pgmap v3547: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:35:21.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:35:20 smithi157 bash[24585]: audit 2024-09-16T07:35:19.609954+0000 mgr.a (mgr.14373) 5117 : audit [DBG] from='client.120063 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:35:21.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:35:20 smithi086 bash[24289]: audit 2024-09-16T07:35:19.609954+0000 mgr.a (mgr.14373) 5117 : audit [DBG] from='client.120063 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:35:21.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:35:20 smithi047 bash[22744]: audit 2024-09-16T07:35:19.609954+0000 mgr.a (mgr.14373) 5117 : audit [DBG] from='client.120063 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:35:22.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:35:21 smithi157 bash[24585]: cluster 2024-09-16T07:35:20.698388+0000 mgr.a (mgr.14373) 5118 : cluster [DBG] pgmap v3548: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:35:22.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:35:21 smithi086 bash[24289]: cluster 2024-09-16T07:35:20.698388+0000 mgr.a (mgr.14373) 5118 : cluster [DBG] pgmap v3548: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:35:22.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:35:21 smithi047 bash[22744]: cluster 2024-09-16T07:35:20.698388+0000 mgr.a (mgr.14373) 5118 : cluster [DBG] pgmap v3548: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:35:24.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:35:23 smithi157 bash[24585]: cluster 2024-09-16T07:35:22.700579+0000 mgr.a (mgr.14373) 5119 : cluster [DBG] pgmap v3549: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:35:24.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:35:23 smithi086 bash[24289]: cluster 2024-09-16T07:35:22.700579+0000 mgr.a (mgr.14373) 5119 : cluster [DBG] pgmap v3549: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:35:24.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:35:23 smithi047 bash[22744]: cluster 2024-09-16T07:35:22.700579+0000 mgr.a (mgr.14373) 5119 : cluster [DBG] pgmap v3549: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:35:25.047 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:35:25.048 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:35:25.048 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:35:25.820 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:35:25.820 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:35:25.820 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:35:25.820 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:35:25.820 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:35:26.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:35:25 smithi157 bash[24585]: cluster 2024-09-16T07:35:24.701400+0000 mgr.a (mgr.14373) 5120 : cluster [DBG] pgmap v3550: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:35:26.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:35:25 smithi086 bash[24289]: cluster 2024-09-16T07:35:24.701400+0000 mgr.a (mgr.14373) 5120 : cluster [DBG] pgmap v3550: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:35:26.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:35:25 smithi047 bash[22744]: cluster 2024-09-16T07:35:24.701400+0000 mgr.a (mgr.14373) 5120 : cluster [DBG] pgmap v3550: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:35:27.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:35:26 smithi157 bash[24585]: audit 2024-09-16T07:35:25.383066+0000 mgr.a (mgr.14373) 5121 : audit [DBG] from='client.120138 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:35:27.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:35:26 smithi086 bash[24289]: audit 2024-09-16T07:35:25.383066+0000 mgr.a (mgr.14373) 5121 : audit [DBG] from='client.120138 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:35:27.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:35:26 smithi047 bash[22744]: audit 2024-09-16T07:35:25.383066+0000 mgr.a (mgr.14373) 5121 : audit [DBG] from='client.120138 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:35:28.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:35:27 smithi157 bash[24585]: cluster 2024-09-16T07:35:26.703721+0000 mgr.a (mgr.14373) 5122 : cluster [DBG] pgmap v3551: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:35:28.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:35:27 smithi086 bash[24289]: cluster 2024-09-16T07:35:26.703721+0000 mgr.a (mgr.14373) 5122 : cluster [DBG] pgmap v3551: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:35:28.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:35:27 smithi047 bash[22744]: cluster 2024-09-16T07:35:26.703721+0000 mgr.a (mgr.14373) 5122 : cluster [DBG] pgmap v3551: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:35:30.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:35:29 smithi086 bash[24289]: cluster 2024-09-16T07:35:28.704509+0000 mgr.a (mgr.14373) 5123 : cluster [DBG] pgmap v3552: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:35:30.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:35:29 smithi047 bash[22744]: cluster 2024-09-16T07:35:28.704509+0000 mgr.a (mgr.14373) 5123 : cluster [DBG] pgmap v3552: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:35:30.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:35:29 smithi157 bash[24585]: cluster 2024-09-16T07:35:28.704509+0000 mgr.a (mgr.14373) 5123 : cluster [DBG] pgmap v3552: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:35:30.821 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:35:30.822 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:35:30.822 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:35:31.571 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:35:31.571 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:35:31.571 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:35:31.571 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:35:31.571 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:35:32.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:35:31 smithi086 bash[24289]: cluster 2024-09-16T07:35:30.705308+0000 mgr.a (mgr.14373) 5124 : cluster [DBG] pgmap v3553: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:35:32.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:35:31 smithi047 bash[22744]: cluster 2024-09-16T07:35:30.705308+0000 mgr.a (mgr.14373) 5124 : cluster [DBG] pgmap v3553: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:35:32.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:35:31 smithi157 bash[24585]: cluster 2024-09-16T07:35:30.705308+0000 mgr.a (mgr.14373) 5124 : cluster [DBG] pgmap v3553: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:35:33.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:35:32 smithi086 bash[24289]: audit 2024-09-16T07:35:31.155471+0000 mgr.a (mgr.14373) 5125 : audit [DBG] from='client.120216 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:35:33.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:35:32 smithi047 bash[22744]: audit 2024-09-16T07:35:31.155471+0000 mgr.a (mgr.14373) 5125 : audit [DBG] from='client.120216 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:35:33.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:35:32 smithi157 bash[24585]: audit 2024-09-16T07:35:31.155471+0000 mgr.a (mgr.14373) 5125 : audit [DBG] from='client.120216 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:35:34.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:35:33 smithi047 bash[22744]: cluster 2024-09-16T07:35:32.707780+0000 mgr.a (mgr.14373) 5126 : cluster [DBG] pgmap v3554: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-16T07:35:34.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:35:33 smithi157 bash[24585]: cluster 2024-09-16T07:35:32.707780+0000 mgr.a (mgr.14373) 5126 : cluster [DBG] pgmap v3554: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-16T07:35:34.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:35:33 smithi086 bash[24289]: cluster 2024-09-16T07:35:32.707780+0000 mgr.a (mgr.14373) 5126 : cluster [DBG] pgmap v3554: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-16T07:35:36.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:35:35 smithi047 bash[22744]: cluster 2024-09-16T07:35:34.708563+0000 mgr.a (mgr.14373) 5127 : cluster [DBG] pgmap v3555: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T07:35:36.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:35:35 smithi157 bash[24585]: cluster 2024-09-16T07:35:34.708563+0000 mgr.a (mgr.14373) 5127 : cluster [DBG] pgmap v3555: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T07:35:36.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:35:35 smithi086 bash[24289]: cluster 2024-09-16T07:35:34.708563+0000 mgr.a (mgr.14373) 5127 : cluster [DBG] pgmap v3555: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T07:35:36.572 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:35:36.573 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:35:36.573 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:35:37.319 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:35:37.320 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:35:37.320 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:35:37.320 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:35:37.320 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:35:38.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:35:37 smithi047 bash[22744]: cluster 2024-09-16T07:35:36.710126+0000 mgr.a (mgr.14373) 5128 : cluster [DBG] pgmap v3556: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:35:38.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:35:37 smithi047 bash[22744]: audit 2024-09-16T07:35:36.908082+0000 mgr.a (mgr.14373) 5129 : audit [DBG] from='client.120291 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:35:38.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:35:37 smithi157 bash[24585]: cluster 2024-09-16T07:35:36.710126+0000 mgr.a (mgr.14373) 5128 : cluster [DBG] pgmap v3556: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:35:38.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:35:37 smithi157 bash[24585]: audit 2024-09-16T07:35:36.908082+0000 mgr.a (mgr.14373) 5129 : audit [DBG] from='client.120291 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:35:38.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:35:37 smithi086 bash[24289]: cluster 2024-09-16T07:35:36.710126+0000 mgr.a (mgr.14373) 5128 : cluster [DBG] pgmap v3556: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:35:38.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:35:37 smithi086 bash[24289]: audit 2024-09-16T07:35:36.908082+0000 mgr.a (mgr.14373) 5129 : audit [DBG] from='client.120291 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:35:40.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:35:39 smithi047 bash[22744]: cluster 2024-09-16T07:35:38.711114+0000 mgr.a (mgr.14373) 5130 : cluster [DBG] pgmap v3557: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:35:40.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:35:39 smithi157 bash[24585]: cluster 2024-09-16T07:35:38.711114+0000 mgr.a (mgr.14373) 5130 : cluster [DBG] pgmap v3557: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:35:40.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:35:39 smithi086 bash[24289]: cluster 2024-09-16T07:35:38.711114+0000 mgr.a (mgr.14373) 5130 : cluster [DBG] pgmap v3557: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:35:42.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:35:41 smithi047 bash[22744]: cluster 2024-09-16T07:35:40.712030+0000 mgr.a (mgr.14373) 5131 : cluster [DBG] pgmap v3558: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T07:35:42.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:35:41 smithi157 bash[24585]: cluster 2024-09-16T07:35:40.712030+0000 mgr.a (mgr.14373) 5131 : cluster [DBG] pgmap v3558: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T07:35:42.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:35:41 smithi086 bash[24289]: cluster 2024-09-16T07:35:40.712030+0000 mgr.a (mgr.14373) 5131 : cluster [DBG] pgmap v3558: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T07:35:42.321 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:35:42.321 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:35:42.322 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:35:43.106 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:35:43.107 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:35:43.107 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:35:43.107 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:35:43.107 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:35:44.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:35:43 smithi047 bash[22744]: audit 2024-09-16T07:35:42.660874+0000 mgr.a (mgr.14373) 5132 : audit [DBG] from='client.120363 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:35:44.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:35:43 smithi047 bash[22744]: cluster 2024-09-16T07:35:42.714665+0000 mgr.a (mgr.14373) 5133 : cluster [DBG] pgmap v3559: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:35:44.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:35:43 smithi157 bash[24585]: audit 2024-09-16T07:35:42.660874+0000 mgr.a (mgr.14373) 5132 : audit [DBG] from='client.120363 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:35:44.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:35:43 smithi157 bash[24585]: cluster 2024-09-16T07:35:42.714665+0000 mgr.a (mgr.14373) 5133 : cluster [DBG] pgmap v3559: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:35:44.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:35:43 smithi086 bash[24289]: audit 2024-09-16T07:35:42.660874+0000 mgr.a (mgr.14373) 5132 : audit [DBG] from='client.120363 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:35:44.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:35:43 smithi086 bash[24289]: cluster 2024-09-16T07:35:42.714665+0000 mgr.a (mgr.14373) 5133 : cluster [DBG] pgmap v3559: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:35:46.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:35:45 smithi157 bash[24585]: cluster 2024-09-16T07:35:44.715686+0000 mgr.a (mgr.14373) 5134 : cluster [DBG] pgmap v3560: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-16T07:35:46.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:35:45 smithi086 bash[24289]: cluster 2024-09-16T07:35:44.715686+0000 mgr.a (mgr.14373) 5134 : cluster [DBG] pgmap v3560: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-16T07:35:46.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:35:45 smithi047 bash[22744]: cluster 2024-09-16T07:35:44.715686+0000 mgr.a (mgr.14373) 5134 : cluster [DBG] pgmap v3560: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-16T07:35:48.108 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:35:48.109 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:35:48.109 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:35:48.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:35:47 smithi157 bash[24585]: cluster 2024-09-16T07:35:46.717863+0000 mgr.a (mgr.14373) 5135 : cluster [DBG] pgmap v3561: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-16T07:35:48.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:35:47 smithi086 bash[24289]: cluster 2024-09-16T07:35:46.717863+0000 mgr.a (mgr.14373) 5135 : cluster [DBG] pgmap v3561: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-16T07:35:48.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:35:47 smithi047 bash[22744]: cluster 2024-09-16T07:35:46.717863+0000 mgr.a (mgr.14373) 5135 : cluster [DBG] pgmap v3561: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-16T07:35:48.883 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:35:48.883 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:35:48.883 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:35:48.883 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:35:48.883 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:35:49.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:35:48 smithi157 bash[24585]: audit 2024-09-16T07:35:48.575531+0000 mon.b (mon.2) 502 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T07:35:49.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:35:48 smithi086 bash[24289]: audit 2024-09-16T07:35:48.575531+0000 mon.b (mon.2) 502 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T07:35:49.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:35:48 smithi047 bash[22744]: audit 2024-09-16T07:35:48.575531+0000 mon.b (mon.2) 502 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T07:35:50.124 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:35:49 smithi047 bash[22744]: audit 2024-09-16T07:35:48.433345+0000 mgr.a (mgr.14373) 5136 : audit [DBG] from='client.120438 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:35:50.124 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:35:49 smithi047 bash[22744]: cluster 2024-09-16T07:35:48.718465+0000 mgr.a (mgr.14373) 5137 : cluster [DBG] pgmap v3562: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:35:50.125 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:35:49 smithi047 bash[22744]: audit 2024-09-16T07:35:49.372416+0000 mon.b (mon.2) 503 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T07:35:50.125 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:35:49 smithi047 bash[22744]: audit 2024-09-16T07:35:49.374675+0000 mon.b (mon.2) 504 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T07:35:50.125 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:35:49 smithi047 bash[22744]: audit 2024-09-16T07:35:49.387404+0000 mon.a (mon.0) 871 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:35:50.125 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:35:49 smithi047 bash[22744]: audit 2024-09-16T07:35:49.391844+0000 mon.b (mon.2) 505 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:35:50.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:35:49 smithi157 bash[24585]: audit 2024-09-16T07:35:48.433345+0000 mgr.a (mgr.14373) 5136 : audit [DBG] from='client.120438 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:35:50.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:35:49 smithi157 bash[24585]: cluster 2024-09-16T07:35:48.718465+0000 mgr.a (mgr.14373) 5137 : cluster [DBG] pgmap v3562: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:35:50.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:35:49 smithi157 bash[24585]: audit 2024-09-16T07:35:49.372416+0000 mon.b (mon.2) 503 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T07:35:50.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:35:49 smithi157 bash[24585]: audit 2024-09-16T07:35:49.374675+0000 mon.b (mon.2) 504 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T07:35:50.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:35:49 smithi157 bash[24585]: audit 2024-09-16T07:35:49.387404+0000 mon.a (mon.0) 871 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:35:50.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:35:49 smithi157 bash[24585]: audit 2024-09-16T07:35:49.391844+0000 mon.b (mon.2) 505 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:35:50.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:35:49 smithi086 bash[24289]: audit 2024-09-16T07:35:48.433345+0000 mgr.a (mgr.14373) 5136 : audit [DBG] from='client.120438 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:35:50.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:35:49 smithi086 bash[24289]: cluster 2024-09-16T07:35:48.718465+0000 mgr.a (mgr.14373) 5137 : cluster [DBG] pgmap v3562: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:35:50.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:35:49 smithi086 bash[24289]: audit 2024-09-16T07:35:49.372416+0000 mon.b (mon.2) 503 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T07:35:50.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:35:49 smithi086 bash[24289]: audit 2024-09-16T07:35:49.374675+0000 mon.b (mon.2) 504 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T07:35:50.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:35:49 smithi086 bash[24289]: audit 2024-09-16T07:35:49.387404+0000 mon.a (mon.0) 871 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:35:50.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:35:49 smithi086 bash[24289]: audit 2024-09-16T07:35:49.391844+0000 mon.b (mon.2) 505 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:35:50.589 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 07:35:50 smithi047 bash[22994]: debug 2024-09-16T07:35:50.125+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T07:35:50.589 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 07:35:50 smithi047 bash[22994]: debug 2024-09-16T07:35:50.125+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T07:35:51.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:35:50 smithi157 bash[24585]: audit 2024-09-16T07:35:49.395615+0000 mgr.a (mgr.14373) 5138 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:35:51.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:35:50 smithi086 bash[24289]: audit 2024-09-16T07:35:49.395615+0000 mgr.a (mgr.14373) 5138 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:35:51.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:35:50 smithi047 bash[22744]: audit 2024-09-16T07:35:49.395615+0000 mgr.a (mgr.14373) 5138 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:35:52.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:35:51 smithi157 bash[24585]: audit 2024-09-16T07:35:50.126910+0000 mgr.a (mgr.14373) 5139 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T07:35:52.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:35:51 smithi157 bash[24585]: cephadm 2024-09-16T07:35:50.128733+0000 mgr.a (mgr.14373) 5140 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T07:35:52.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:35:51 smithi157 bash[24585]: cluster 2024-09-16T07:35:50.719383+0000 mgr.a (mgr.14373) 5141 : cluster [DBG] pgmap v3563: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:35:52.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:35:51 smithi086 bash[24289]: audit 2024-09-16T07:35:50.126910+0000 mgr.a (mgr.14373) 5139 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T07:35:52.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:35:51 smithi086 bash[24289]: cephadm 2024-09-16T07:35:50.128733+0000 mgr.a (mgr.14373) 5140 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T07:35:52.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:35:51 smithi086 bash[24289]: cluster 2024-09-16T07:35:50.719383+0000 mgr.a (mgr.14373) 5141 : cluster [DBG] pgmap v3563: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:35:52.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:35:51 smithi047 bash[22744]: audit 2024-09-16T07:35:50.126910+0000 mgr.a (mgr.14373) 5139 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T07:35:52.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:35:51 smithi047 bash[22744]: cephadm 2024-09-16T07:35:50.128733+0000 mgr.a (mgr.14373) 5140 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T07:35:52.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:35:51 smithi047 bash[22744]: cluster 2024-09-16T07:35:50.719383+0000 mgr.a (mgr.14373) 5141 : cluster [DBG] pgmap v3563: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:35:53.884 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:35:53.885 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:35:53.885 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:35:54.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:35:53 smithi157 bash[24585]: cluster 2024-09-16T07:35:52.721629+0000 mgr.a (mgr.14373) 5142 : cluster [DBG] pgmap v3564: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:35:54.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:35:53 smithi086 bash[24289]: cluster 2024-09-16T07:35:52.721629+0000 mgr.a (mgr.14373) 5142 : cluster [DBG] pgmap v3564: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:35:54.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:35:53 smithi047 bash[22744]: cluster 2024-09-16T07:35:52.721629+0000 mgr.a (mgr.14373) 5142 : cluster [DBG] pgmap v3564: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:35:54.649 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:35:54.649 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:35:54.650 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:35:54.650 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:35:54.650 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:35:56.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:35:55 smithi157 bash[24585]: audit 2024-09-16T07:35:54.222972+0000 mgr.a (mgr.14373) 5143 : audit [DBG] from='client.120618 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:35:56.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:35:55 smithi157 bash[24585]: cluster 2024-09-16T07:35:54.722672+0000 mgr.a (mgr.14373) 5144 : cluster [DBG] pgmap v3565: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:35:56.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:35:55 smithi086 bash[24289]: audit 2024-09-16T07:35:54.222972+0000 mgr.a (mgr.14373) 5143 : audit [DBG] from='client.120618 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:35:56.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:35:55 smithi086 bash[24289]: cluster 2024-09-16T07:35:54.722672+0000 mgr.a (mgr.14373) 5144 : cluster [DBG] pgmap v3565: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:35:56.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:35:55 smithi047 bash[22744]: audit 2024-09-16T07:35:54.222972+0000 mgr.a (mgr.14373) 5143 : audit [DBG] from='client.120618 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:35:56.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:35:55 smithi047 bash[22744]: cluster 2024-09-16T07:35:54.722672+0000 mgr.a (mgr.14373) 5144 : cluster [DBG] pgmap v3565: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:35:58.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:35:57 smithi157 bash[24585]: cluster 2024-09-16T07:35:56.724761+0000 mgr.a (mgr.14373) 5145 : cluster [DBG] pgmap v3566: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:35:58.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:35:57 smithi086 bash[24289]: cluster 2024-09-16T07:35:56.724761+0000 mgr.a (mgr.14373) 5145 : cluster [DBG] pgmap v3566: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:35:58.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:35:57 smithi047 bash[22744]: cluster 2024-09-16T07:35:56.724761+0000 mgr.a (mgr.14373) 5145 : cluster [DBG] pgmap v3566: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:35:59.652 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:35:59.653 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:35:59.653 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:36:00.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:35:59 smithi157 bash[24585]: cluster 2024-09-16T07:35:58.725545+0000 mgr.a (mgr.14373) 5146 : cluster [DBG] pgmap v3567: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:36:00.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:35:59 smithi086 bash[24289]: cluster 2024-09-16T07:35:58.725545+0000 mgr.a (mgr.14373) 5146 : cluster [DBG] pgmap v3567: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:36:00.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:35:59 smithi047 bash[22744]: cluster 2024-09-16T07:35:58.725545+0000 mgr.a (mgr.14373) 5146 : cluster [DBG] pgmap v3567: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:36:00.423 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:36:00.423 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:36:00.423 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:36:00.423 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:36:00.423 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:36:02.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:36:01 smithi157 bash[24585]: audit 2024-09-16T07:35:59.996206+0000 mgr.a (mgr.14373) 5147 : audit [DBG] from='client.120693 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:36:02.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:36:01 smithi157 bash[24585]: cluster 2024-09-16T07:36:00.726666+0000 mgr.a (mgr.14373) 5148 : cluster [DBG] pgmap v3568: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:36:02.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:36:01 smithi086 bash[24289]: audit 2024-09-16T07:35:59.996206+0000 mgr.a (mgr.14373) 5147 : audit [DBG] from='client.120693 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:36:02.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:36:01 smithi086 bash[24289]: cluster 2024-09-16T07:36:00.726666+0000 mgr.a (mgr.14373) 5148 : cluster [DBG] pgmap v3568: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:36:02.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:36:01 smithi047 bash[22744]: audit 2024-09-16T07:35:59.996206+0000 mgr.a (mgr.14373) 5147 : audit [DBG] from='client.120693 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:36:02.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:36:01 smithi047 bash[22744]: cluster 2024-09-16T07:36:00.726666+0000 mgr.a (mgr.14373) 5148 : cluster [DBG] pgmap v3568: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:36:04.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:36:03 smithi157 bash[24585]: cluster 2024-09-16T07:36:02.728959+0000 mgr.a (mgr.14373) 5149 : cluster [DBG] pgmap v3569: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:36:04.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:36:03 smithi086 bash[24289]: cluster 2024-09-16T07:36:02.728959+0000 mgr.a (mgr.14373) 5149 : cluster [DBG] pgmap v3569: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:36:04.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:36:03 smithi047 bash[22744]: cluster 2024-09-16T07:36:02.728959+0000 mgr.a (mgr.14373) 5149 : cluster [DBG] pgmap v3569: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:36:05.425 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:36:05.425 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:36:05.425 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:36:06.208 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:36:06.209 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:36:06.209 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:36:06.209 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:36:06.209 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:36:06.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:36:05 smithi157 bash[24585]: cluster 2024-09-16T07:36:04.729732+0000 mgr.a (mgr.14373) 5150 : cluster [DBG] pgmap v3570: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:36:06.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:36:05 smithi086 bash[24289]: cluster 2024-09-16T07:36:04.729732+0000 mgr.a (mgr.14373) 5150 : cluster [DBG] pgmap v3570: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:36:06.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:36:05 smithi047 bash[22744]: cluster 2024-09-16T07:36:04.729732+0000 mgr.a (mgr.14373) 5150 : cluster [DBG] pgmap v3570: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:36:07.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:36:06 smithi157 bash[24585]: audit 2024-09-16T07:36:05.764782+0000 mgr.a (mgr.14373) 5151 : audit [DBG] from='client.120771 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:36:07.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:36:06 smithi086 bash[24289]: audit 2024-09-16T07:36:05.764782+0000 mgr.a (mgr.14373) 5151 : audit [DBG] from='client.120771 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:36:07.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:36:06 smithi047 bash[22744]: audit 2024-09-16T07:36:05.764782+0000 mgr.a (mgr.14373) 5151 : audit [DBG] from='client.120771 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:36:08.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:36:07 smithi157 bash[24585]: cluster 2024-09-16T07:36:06.732105+0000 mgr.a (mgr.14373) 5152 : cluster [DBG] pgmap v3571: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:36:08.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:36:07 smithi086 bash[24289]: cluster 2024-09-16T07:36:06.732105+0000 mgr.a (mgr.14373) 5152 : cluster [DBG] pgmap v3571: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:36:08.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:36:07 smithi047 bash[22744]: cluster 2024-09-16T07:36:06.732105+0000 mgr.a (mgr.14373) 5152 : cluster [DBG] pgmap v3571: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:36:10.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:36:09 smithi157 bash[24585]: cluster 2024-09-16T07:36:08.732878+0000 mgr.a (mgr.14373) 5153 : cluster [DBG] pgmap v3572: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:36:10.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:36:09 smithi086 bash[24289]: cluster 2024-09-16T07:36:08.732878+0000 mgr.a (mgr.14373) 5153 : cluster [DBG] pgmap v3572: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:36:10.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:36:09 smithi047 bash[22744]: cluster 2024-09-16T07:36:08.732878+0000 mgr.a (mgr.14373) 5153 : cluster [DBG] pgmap v3572: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:36:11.210 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:36:11.211 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:36:11.211 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:36:11.988 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:36:11.989 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:36:11.989 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:36:11.989 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:36:11.989 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:36:12.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:36:11 smithi157 bash[24585]: cluster 2024-09-16T07:36:10.733664+0000 mgr.a (mgr.14373) 5154 : cluster [DBG] pgmap v3573: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:36:12.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:36:11 smithi086 bash[24289]: cluster 2024-09-16T07:36:10.733664+0000 mgr.a (mgr.14373) 5154 : cluster [DBG] pgmap v3573: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:36:12.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:36:11 smithi047 bash[22744]: cluster 2024-09-16T07:36:10.733664+0000 mgr.a (mgr.14373) 5154 : cluster [DBG] pgmap v3573: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:36:13.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:36:12 smithi157 bash[24585]: audit 2024-09-16T07:36:11.551697+0000 mgr.a (mgr.14373) 5155 : audit [DBG] from='client.120849 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:36:13.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:36:12 smithi086 bash[24289]: audit 2024-09-16T07:36:11.551697+0000 mgr.a (mgr.14373) 5155 : audit [DBG] from='client.120849 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:36:13.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:36:12 smithi047 bash[22744]: audit 2024-09-16T07:36:11.551697+0000 mgr.a (mgr.14373) 5155 : audit [DBG] from='client.120849 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:36:14.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:36:13 smithi157 bash[24585]: cluster 2024-09-16T07:36:12.736505+0000 mgr.a (mgr.14373) 5156 : cluster [DBG] pgmap v3574: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:36:14.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:36:13 smithi086 bash[24289]: cluster 2024-09-16T07:36:12.736505+0000 mgr.a (mgr.14373) 5156 : cluster [DBG] pgmap v3574: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:36:14.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:36:13 smithi047 bash[22744]: cluster 2024-09-16T07:36:12.736505+0000 mgr.a (mgr.14373) 5156 : cluster [DBG] pgmap v3574: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:36:15.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:36:14 smithi157 bash[24585]: cluster 2024-09-16T07:36:14.737302+0000 mgr.a (mgr.14373) 5157 : cluster [DBG] pgmap v3575: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:36:15.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:36:14 smithi086 bash[24289]: cluster 2024-09-16T07:36:14.737302+0000 mgr.a (mgr.14373) 5157 : cluster [DBG] pgmap v3575: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:36:15.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:36:14 smithi047 bash[22744]: cluster 2024-09-16T07:36:14.737302+0000 mgr.a (mgr.14373) 5157 : cluster [DBG] pgmap v3575: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:36:16.990 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:36:16.991 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:36:16.991 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:36:17.762 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:36:17.762 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:36:17.763 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:36:17.763 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:36:17.763 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:36:18.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:36:17 smithi157 bash[24585]: cluster 2024-09-16T07:36:16.739271+0000 mgr.a (mgr.14373) 5158 : cluster [DBG] pgmap v3576: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:36:18.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:36:17 smithi086 bash[24289]: cluster 2024-09-16T07:36:16.739271+0000 mgr.a (mgr.14373) 5158 : cluster [DBG] pgmap v3576: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:36:18.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:36:17 smithi047 bash[22744]: cluster 2024-09-16T07:36:16.739271+0000 mgr.a (mgr.14373) 5158 : cluster [DBG] pgmap v3576: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:36:19.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:36:18 smithi157 bash[24585]: audit 2024-09-16T07:36:17.328980+0000 mgr.a (mgr.14373) 5159 : audit [DBG] from='client.120927 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:36:19.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:36:18 smithi086 bash[24289]: audit 2024-09-16T07:36:17.328980+0000 mgr.a (mgr.14373) 5159 : audit [DBG] from='client.120927 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:36:19.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:36:18 smithi047 bash[22744]: audit 2024-09-16T07:36:17.328980+0000 mgr.a (mgr.14373) 5159 : audit [DBG] from='client.120927 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:36:20.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:36:19 smithi086 bash[24289]: cluster 2024-09-16T07:36:18.740241+0000 mgr.a (mgr.14373) 5160 : cluster [DBG] pgmap v3577: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:36:20.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:36:19 smithi047 bash[22744]: cluster 2024-09-16T07:36:18.740241+0000 mgr.a (mgr.14373) 5160 : cluster [DBG] pgmap v3577: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:36:20.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:36:19 smithi157 bash[24585]: cluster 2024-09-16T07:36:18.740241+0000 mgr.a (mgr.14373) 5160 : cluster [DBG] pgmap v3577: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:36:22.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:36:21 smithi086 bash[24289]: cluster 2024-09-16T07:36:20.741041+0000 mgr.a (mgr.14373) 5161 : cluster [DBG] pgmap v3578: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T07:36:22.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:36:21 smithi047 bash[22744]: cluster 2024-09-16T07:36:20.741041+0000 mgr.a (mgr.14373) 5161 : cluster [DBG] pgmap v3578: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T07:36:22.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:36:21 smithi157 bash[24585]: cluster 2024-09-16T07:36:20.741041+0000 mgr.a (mgr.14373) 5161 : cluster [DBG] pgmap v3578: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T07:36:22.764 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:36:22.764 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:36:22.764 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:36:23.560 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:36:23.560 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:36:23.560 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:36:23.560 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:36:23.560 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:36:24.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:36:23 smithi086 bash[24289]: cluster 2024-09-16T07:36:22.743268+0000 mgr.a (mgr.14373) 5162 : cluster [DBG] pgmap v3579: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:36:24.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:36:23 smithi047 bash[22744]: cluster 2024-09-16T07:36:22.743268+0000 mgr.a (mgr.14373) 5162 : cluster [DBG] pgmap v3579: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:36:24.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:36:23 smithi157 bash[24585]: cluster 2024-09-16T07:36:22.743268+0000 mgr.a (mgr.14373) 5162 : cluster [DBG] pgmap v3579: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:36:25.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:36:24 smithi047 bash[22744]: audit 2024-09-16T07:36:23.111537+0000 mgr.a (mgr.14373) 5163 : audit [DBG] from='client.57199 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:36:25.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:36:24 smithi157 bash[24585]: audit 2024-09-16T07:36:23.111537+0000 mgr.a (mgr.14373) 5163 : audit [DBG] from='client.57199 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:36:25.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:36:24 smithi086 bash[24289]: audit 2024-09-16T07:36:23.111537+0000 mgr.a (mgr.14373) 5163 : audit [DBG] from='client.57199 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:36:26.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:36:25 smithi047 bash[22744]: cluster 2024-09-16T07:36:24.744227+0000 mgr.a (mgr.14373) 5164 : cluster [DBG] pgmap v3580: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:36:26.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:36:25 smithi157 bash[24585]: cluster 2024-09-16T07:36:24.744227+0000 mgr.a (mgr.14373) 5164 : cluster [DBG] pgmap v3580: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:36:26.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:36:25 smithi086 bash[24289]: cluster 2024-09-16T07:36:24.744227+0000 mgr.a (mgr.14373) 5164 : cluster [DBG] pgmap v3580: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:36:28.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:36:27 smithi047 bash[22744]: cluster 2024-09-16T07:36:26.746373+0000 mgr.a (mgr.14373) 5165 : cluster [DBG] pgmap v3581: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:36:28.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:36:27 smithi157 bash[24585]: cluster 2024-09-16T07:36:26.746373+0000 mgr.a (mgr.14373) 5165 : cluster [DBG] pgmap v3581: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:36:28.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:36:27 smithi086 bash[24289]: cluster 2024-09-16T07:36:26.746373+0000 mgr.a (mgr.14373) 5165 : cluster [DBG] pgmap v3581: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:36:28.561 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:36:28.562 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:36:28.562 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:36:29.326 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:36:29.327 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:36:29.327 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:36:29.327 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:36:29.327 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:36:30.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:36:29 smithi047 bash[22744]: cluster 2024-09-16T07:36:28.747135+0000 mgr.a (mgr.14373) 5166 : cluster [DBG] pgmap v3582: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:36:30.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:36:29 smithi047 bash[22744]: audit 2024-09-16T07:36:28.898193+0000 mgr.a (mgr.14373) 5167 : audit [DBG] from='client.121083 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:36:30.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:36:29 smithi157 bash[24585]: cluster 2024-09-16T07:36:28.747135+0000 mgr.a (mgr.14373) 5166 : cluster [DBG] pgmap v3582: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:36:30.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:36:29 smithi157 bash[24585]: audit 2024-09-16T07:36:28.898193+0000 mgr.a (mgr.14373) 5167 : audit [DBG] from='client.121083 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:36:30.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:36:29 smithi086 bash[24289]: cluster 2024-09-16T07:36:28.747135+0000 mgr.a (mgr.14373) 5166 : cluster [DBG] pgmap v3582: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:36:30.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:36:29 smithi086 bash[24289]: audit 2024-09-16T07:36:28.898193+0000 mgr.a (mgr.14373) 5167 : audit [DBG] from='client.121083 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:36:32.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:36:31 smithi047 bash[22744]: cluster 2024-09-16T07:36:30.748199+0000 mgr.a (mgr.14373) 5168 : cluster [DBG] pgmap v3583: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:36:32.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:36:31 smithi157 bash[24585]: cluster 2024-09-16T07:36:30.748199+0000 mgr.a (mgr.14373) 5168 : cluster [DBG] pgmap v3583: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:36:32.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:36:31 smithi086 bash[24289]: cluster 2024-09-16T07:36:30.748199+0000 mgr.a (mgr.14373) 5168 : cluster [DBG] pgmap v3583: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:36:34.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:36:33 smithi157 bash[24585]: cluster 2024-09-16T07:36:32.750606+0000 mgr.a (mgr.14373) 5169 : cluster [DBG] pgmap v3584: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:36:34.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:36:33 smithi086 bash[24289]: cluster 2024-09-16T07:36:32.750606+0000 mgr.a (mgr.14373) 5169 : cluster [DBG] pgmap v3584: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:36:34.328 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:36:34.329 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:36:34.329 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:36:34.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:36:33 smithi047 bash[22744]: cluster 2024-09-16T07:36:32.750606+0000 mgr.a (mgr.14373) 5169 : cluster [DBG] pgmap v3584: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:36:35.078 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:36:35.078 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:36:35.078 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:36:35.078 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:36:35.078 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:36:36.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:36:35 smithi157 bash[24585]: audit 2024-09-16T07:36:34.659980+0000 mgr.a (mgr.14373) 5170 : audit [DBG] from='client.121161 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:36:36.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:36:35 smithi157 bash[24585]: cluster 2024-09-16T07:36:34.751185+0000 mgr.a (mgr.14373) 5171 : cluster [DBG] pgmap v3585: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:36:36.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:36:35 smithi086 bash[24289]: audit 2024-09-16T07:36:34.659980+0000 mgr.a (mgr.14373) 5170 : audit [DBG] from='client.121161 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:36:36.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:36:35 smithi086 bash[24289]: cluster 2024-09-16T07:36:34.751185+0000 mgr.a (mgr.14373) 5171 : cluster [DBG] pgmap v3585: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:36:36.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:36:35 smithi047 bash[22744]: audit 2024-09-16T07:36:34.659980+0000 mgr.a (mgr.14373) 5170 : audit [DBG] from='client.121161 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:36:36.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:36:35 smithi047 bash[22744]: cluster 2024-09-16T07:36:34.751185+0000 mgr.a (mgr.14373) 5171 : cluster [DBG] pgmap v3585: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:36:38.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:36:37 smithi157 bash[24585]: cluster 2024-09-16T07:36:36.753385+0000 mgr.a (mgr.14373) 5172 : cluster [DBG] pgmap v3586: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:36:38.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:36:37 smithi086 bash[24289]: cluster 2024-09-16T07:36:36.753385+0000 mgr.a (mgr.14373) 5172 : cluster [DBG] pgmap v3586: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:36:38.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:36:37 smithi047 bash[22744]: cluster 2024-09-16T07:36:36.753385+0000 mgr.a (mgr.14373) 5172 : cluster [DBG] pgmap v3586: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:36:40.080 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:36:40.080 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:36:40.081 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:36:40.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:36:39 smithi157 bash[24585]: cluster 2024-09-16T07:36:38.754167+0000 mgr.a (mgr.14373) 5173 : cluster [DBG] pgmap v3587: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:36:40.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:36:39 smithi086 bash[24289]: cluster 2024-09-16T07:36:38.754167+0000 mgr.a (mgr.14373) 5173 : cluster [DBG] pgmap v3587: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:36:40.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:36:39 smithi047 bash[22744]: cluster 2024-09-16T07:36:38.754167+0000 mgr.a (mgr.14373) 5173 : cluster [DBG] pgmap v3587: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:36:40.857 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:36:40.857 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:36:40.857 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:36:40.857 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:36:40.857 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:36:42.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:36:41 smithi157 bash[24585]: audit 2024-09-16T07:36:40.415117+0000 mgr.a (mgr.14373) 5174 : audit [DBG] from='client.121236 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:36:42.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:36:41 smithi157 bash[24585]: cluster 2024-09-16T07:36:40.757286+0000 mgr.a (mgr.14373) 5175 : cluster [DBG] pgmap v3588: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:36:42.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:36:41 smithi086 bash[24289]: audit 2024-09-16T07:36:40.415117+0000 mgr.a (mgr.14373) 5174 : audit [DBG] from='client.121236 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:36:42.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:36:41 smithi086 bash[24289]: cluster 2024-09-16T07:36:40.757286+0000 mgr.a (mgr.14373) 5175 : cluster [DBG] pgmap v3588: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:36:42.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:36:41 smithi047 bash[22744]: audit 2024-09-16T07:36:40.415117+0000 mgr.a (mgr.14373) 5174 : audit [DBG] from='client.121236 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:36:42.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:36:41 smithi047 bash[22744]: cluster 2024-09-16T07:36:40.757286+0000 mgr.a (mgr.14373) 5175 : cluster [DBG] pgmap v3588: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:36:44.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:36:43 smithi157 bash[24585]: cluster 2024-09-16T07:36:42.759645+0000 mgr.a (mgr.14373) 5176 : cluster [DBG] pgmap v3589: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:36:44.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:36:43 smithi086 bash[24289]: cluster 2024-09-16T07:36:42.759645+0000 mgr.a (mgr.14373) 5176 : cluster [DBG] pgmap v3589: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:36:44.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:36:43 smithi047 bash[22744]: cluster 2024-09-16T07:36:42.759645+0000 mgr.a (mgr.14373) 5176 : cluster [DBG] pgmap v3589: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:36:45.858 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:36:45.859 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:36:45.859 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:36:46.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:36:45 smithi157 bash[24585]: cluster 2024-09-16T07:36:44.760556+0000 mgr.a (mgr.14373) 5177 : cluster [DBG] pgmap v3590: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:36:46.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:36:45 smithi086 bash[24289]: cluster 2024-09-16T07:36:44.760556+0000 mgr.a (mgr.14373) 5177 : cluster [DBG] pgmap v3590: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:36:46.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:36:45 smithi047 bash[22744]: cluster 2024-09-16T07:36:44.760556+0000 mgr.a (mgr.14373) 5177 : cluster [DBG] pgmap v3590: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:36:46.600 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:36:46.600 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:36:46.600 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:36:46.600 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:36:46.600 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:36:48.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:36:47 smithi157 bash[24585]: audit 2024-09-16T07:36:46.194483+0000 mgr.a (mgr.14373) 5178 : audit [DBG] from='client.121314 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:36:48.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:36:47 smithi157 bash[24585]: cluster 2024-09-16T07:36:46.763130+0000 mgr.a (mgr.14373) 5179 : cluster [DBG] pgmap v3591: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-16T07:36:48.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:36:47 smithi086 bash[24289]: audit 2024-09-16T07:36:46.194483+0000 mgr.a (mgr.14373) 5178 : audit [DBG] from='client.121314 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:36:48.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:36:47 smithi086 bash[24289]: cluster 2024-09-16T07:36:46.763130+0000 mgr.a (mgr.14373) 5179 : cluster [DBG] pgmap v3591: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-16T07:36:48.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:36:47 smithi047 bash[22744]: audit 2024-09-16T07:36:46.194483+0000 mgr.a (mgr.14373) 5178 : audit [DBG] from='client.121314 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:36:48.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:36:47 smithi047 bash[22744]: cluster 2024-09-16T07:36:46.763130+0000 mgr.a (mgr.14373) 5179 : cluster [DBG] pgmap v3591: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-16T07:36:50.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:36:49 smithi157 bash[24585]: cluster 2024-09-16T07:36:48.763947+0000 mgr.a (mgr.14373) 5180 : cluster [DBG] pgmap v3592: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T07:36:50.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:36:49 smithi086 bash[24289]: cluster 2024-09-16T07:36:48.763947+0000 mgr.a (mgr.14373) 5180 : cluster [DBG] pgmap v3592: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T07:36:50.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:36:49 smithi047 bash[22744]: cluster 2024-09-16T07:36:48.763947+0000 mgr.a (mgr.14373) 5180 : cluster [DBG] pgmap v3592: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T07:36:51.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:36:50 smithi157 bash[24585]: audit 2024-09-16T07:36:50.178733+0000 mon.b (mon.2) 506 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T07:36:51.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:36:50 smithi086 bash[24289]: audit 2024-09-16T07:36:50.178733+0000 mon.b (mon.2) 506 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T07:36:51.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:36:50 smithi047 bash[22744]: audit 2024-09-16T07:36:50.178733+0000 mon.b (mon.2) 506 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T07:36:51.601 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:36:51.601 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:36:51.601 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:36:52.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:36:51 smithi157 bash[24585]: cluster 2024-09-16T07:36:50.764480+0000 mgr.a (mgr.14373) 5181 : cluster [DBG] pgmap v3593: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T07:36:52.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:36:51 smithi086 bash[24289]: cluster 2024-09-16T07:36:50.764480+0000 mgr.a (mgr.14373) 5181 : cluster [DBG] pgmap v3593: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T07:36:52.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:36:51 smithi047 bash[22744]: cluster 2024-09-16T07:36:50.764480+0000 mgr.a (mgr.14373) 5181 : cluster [DBG] pgmap v3593: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T07:36:52.353 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:36:52.353 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:36:52.353 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:36:52.353 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:36:52.353 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:36:54.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:36:53 smithi157 bash[24585]: audit 2024-09-16T07:36:51.940488+0000 mgr.a (mgr.14373) 5182 : audit [DBG] from='client.121392 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:36:54.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:36:53 smithi157 bash[24585]: cluster 2024-09-16T07:36:52.767419+0000 mgr.a (mgr.14373) 5183 : cluster [DBG] pgmap v3594: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:36:54.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:36:53 smithi086 bash[24289]: audit 2024-09-16T07:36:51.940488+0000 mgr.a (mgr.14373) 5182 : audit [DBG] from='client.121392 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:36:54.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:36:53 smithi086 bash[24289]: cluster 2024-09-16T07:36:52.767419+0000 mgr.a (mgr.14373) 5183 : cluster [DBG] pgmap v3594: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:36:54.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:36:53 smithi047 bash[22744]: audit 2024-09-16T07:36:51.940488+0000 mgr.a (mgr.14373) 5182 : audit [DBG] from='client.121392 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:36:54.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:36:53 smithi047 bash[22744]: cluster 2024-09-16T07:36:52.767419+0000 mgr.a (mgr.14373) 5183 : cluster [DBG] pgmap v3594: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:36:56.147 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:36:55 smithi047 bash[22744]: cluster 2024-09-16T07:36:54.768399+0000 mgr.a (mgr.14373) 5184 : cluster [DBG] pgmap v3595: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:36:56.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:36:55 smithi157 bash[24585]: cluster 2024-09-16T07:36:54.768399+0000 mgr.a (mgr.14373) 5184 : cluster [DBG] pgmap v3595: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:36:56.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:36:55 smithi086 bash[24289]: cluster 2024-09-16T07:36:54.768399+0000 mgr.a (mgr.14373) 5184 : cluster [DBG] pgmap v3595: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:36:57.355 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:36:57.355 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:36:57.356 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:36:58.123 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:36:58.123 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:36:58.124 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:36:58.124 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:36:58.124 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:36:58.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:36:57 smithi157 bash[24585]: cluster 2024-09-16T07:36:56.770417+0000 mgr.a (mgr.14373) 5185 : cluster [DBG] pgmap v3596: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:36:58.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:36:57 smithi086 bash[24289]: cluster 2024-09-16T07:36:56.770417+0000 mgr.a (mgr.14373) 5185 : cluster [DBG] pgmap v3596: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:36:58.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:36:57 smithi047 bash[22744]: cluster 2024-09-16T07:36:56.770417+0000 mgr.a (mgr.14373) 5185 : cluster [DBG] pgmap v3596: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:36:59.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:36:58 smithi157 bash[24585]: audit 2024-09-16T07:36:57.687799+0000 mgr.a (mgr.14373) 5186 : audit [DBG] from='client.121470 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:36:59.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:36:58 smithi086 bash[24289]: audit 2024-09-16T07:36:57.687799+0000 mgr.a (mgr.14373) 5186 : audit [DBG] from='client.121470 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:36:59.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:36:58 smithi047 bash[22744]: audit 2024-09-16T07:36:57.687799+0000 mgr.a (mgr.14373) 5186 : audit [DBG] from='client.121470 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:37:00.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:36:59 smithi157 bash[24585]: cluster 2024-09-16T07:36:58.771418+0000 mgr.a (mgr.14373) 5187 : cluster [DBG] pgmap v3597: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-16T07:37:00.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:36:59 smithi086 bash[24289]: cluster 2024-09-16T07:36:58.771418+0000 mgr.a (mgr.14373) 5187 : cluster [DBG] pgmap v3597: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-16T07:37:00.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:36:59 smithi047 bash[22744]: cluster 2024-09-16T07:36:58.771418+0000 mgr.a (mgr.14373) 5187 : cluster [DBG] pgmap v3597: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-16T07:37:01.589 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 07:37:01 smithi047 bash[22994]: debug 2024-09-16T07:37:01.332+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T07:37:01.589 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 07:37:01 smithi047 bash[22994]: debug 2024-09-16T07:37:01.336+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T07:37:01.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:37:01 smithi047 bash[22744]: audit 2024-09-16T07:37:00.551223+0000 mon.a (mon.0) 872 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:37:01.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:37:01 smithi047 bash[22744]: audit 2024-09-16T07:37:00.561207+0000 mon.a (mon.0) 873 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:37:01.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:37:01 smithi047 bash[22744]: audit 2024-09-16T07:37:00.563084+0000 mon.b (mon.2) 507 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T07:37:01.590 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:37:01 smithi047 bash[22744]: audit 2024-09-16T07:37:00.565528+0000 mon.b (mon.2) 508 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T07:37:01.590 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:37:01 smithi047 bash[22744]: audit 2024-09-16T07:37:00.578593+0000 mon.a (mon.0) 874 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:37:01.590 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:37:01 smithi047 bash[22744]: audit 2024-09-16T07:37:00.581827+0000 mon.b (mon.2) 509 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:37:01.590 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:37:01 smithi047 bash[22744]: audit 2024-09-16T07:37:00.585551+0000 mgr.a (mgr.14373) 5188 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:37:01.590 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:37:01 smithi047 bash[22744]: cluster 2024-09-16T07:37:00.771994+0000 mgr.a (mgr.14373) 5189 : cluster [DBG] pgmap v3598: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-16T07:37:01.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:37:01 smithi157 bash[24585]: audit 2024-09-16T07:37:00.551223+0000 mon.a (mon.0) 872 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:37:01.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:37:01 smithi157 bash[24585]: audit 2024-09-16T07:37:00.561207+0000 mon.a (mon.0) 873 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:37:01.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:37:01 smithi157 bash[24585]: audit 2024-09-16T07:37:00.563084+0000 mon.b (mon.2) 507 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T07:37:01.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:37:01 smithi157 bash[24585]: audit 2024-09-16T07:37:00.565528+0000 mon.b (mon.2) 508 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T07:37:01.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:37:01 smithi157 bash[24585]: audit 2024-09-16T07:37:00.578593+0000 mon.a (mon.0) 874 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:37:01.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:37:01 smithi157 bash[24585]: audit 2024-09-16T07:37:00.581827+0000 mon.b (mon.2) 509 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:37:01.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:37:01 smithi157 bash[24585]: audit 2024-09-16T07:37:00.585551+0000 mgr.a (mgr.14373) 5188 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:37:01.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:37:01 smithi157 bash[24585]: cluster 2024-09-16T07:37:00.771994+0000 mgr.a (mgr.14373) 5189 : cluster [DBG] pgmap v3598: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-16T07:37:01.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:37:01 smithi086 bash[24289]: audit 2024-09-16T07:37:00.551223+0000 mon.a (mon.0) 872 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:37:01.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:37:01 smithi086 bash[24289]: audit 2024-09-16T07:37:00.561207+0000 mon.a (mon.0) 873 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:37:01.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:37:01 smithi086 bash[24289]: audit 2024-09-16T07:37:00.563084+0000 mon.b (mon.2) 507 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T07:37:01.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:37:01 smithi086 bash[24289]: audit 2024-09-16T07:37:00.565528+0000 mon.b (mon.2) 508 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T07:37:01.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:37:01 smithi086 bash[24289]: audit 2024-09-16T07:37:00.578593+0000 mon.a (mon.0) 874 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:37:01.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:37:01 smithi086 bash[24289]: audit 2024-09-16T07:37:00.581827+0000 mon.b (mon.2) 509 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:37:01.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:37:01 smithi086 bash[24289]: audit 2024-09-16T07:37:00.585551+0000 mgr.a (mgr.14373) 5188 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:37:01.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:37:01 smithi086 bash[24289]: cluster 2024-09-16T07:37:00.771994+0000 mgr.a (mgr.14373) 5189 : cluster [DBG] pgmap v3598: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-16T07:37:02.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:37:02 smithi047 bash[22744]: audit 2024-09-16T07:37:01.336447+0000 mgr.a (mgr.14373) 5190 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T07:37:02.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:37:02 smithi047 bash[22744]: cephadm 2024-09-16T07:37:01.338890+0000 mgr.a (mgr.14373) 5191 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T07:37:03.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:37:02 smithi157 bash[24585]: audit 2024-09-16T07:37:01.336447+0000 mgr.a (mgr.14373) 5190 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T07:37:03.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:37:02 smithi157 bash[24585]: cephadm 2024-09-16T07:37:01.338890+0000 mgr.a (mgr.14373) 5191 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T07:37:03.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:37:02 smithi086 bash[24289]: audit 2024-09-16T07:37:01.336447+0000 mgr.a (mgr.14373) 5190 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T07:37:03.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:37:02 smithi086 bash[24289]: cephadm 2024-09-16T07:37:01.338890+0000 mgr.a (mgr.14373) 5191 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T07:37:03.125 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:37:03.125 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:37:03.126 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:37:03.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:37:03 smithi047 bash[22744]: cluster 2024-09-16T07:37:02.774283+0000 mgr.a (mgr.14373) 5192 : cluster [DBG] pgmap v3599: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.4 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:37:03.904 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:37:03.904 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:37:03.904 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:37:03.904 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:37:03.904 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:37:04.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:37:03 smithi157 bash[24585]: cluster 2024-09-16T07:37:02.774283+0000 mgr.a (mgr.14373) 5192 : cluster [DBG] pgmap v3599: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.4 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:37:04.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:37:03 smithi086 bash[24289]: cluster 2024-09-16T07:37:02.774283+0000 mgr.a (mgr.14373) 5192 : cluster [DBG] pgmap v3599: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.4 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:37:04.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:37:04 smithi047 bash[22744]: audit 2024-09-16T07:37:03.462204+0000 mgr.a (mgr.14373) 5193 : audit [DBG] from='client.121656 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:37:05.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:37:04 smithi157 bash[24585]: audit 2024-09-16T07:37:03.462204+0000 mgr.a (mgr.14373) 5193 : audit [DBG] from='client.121656 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:37:05.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:37:04 smithi086 bash[24289]: audit 2024-09-16T07:37:03.462204+0000 mgr.a (mgr.14373) 5193 : audit [DBG] from='client.121656 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:37:06.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:37:05 smithi157 bash[24585]: cluster 2024-09-16T07:37:04.775313+0000 mgr.a (mgr.14373) 5194 : cluster [DBG] pgmap v3600: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:37:06.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:37:05 smithi086 bash[24289]: cluster 2024-09-16T07:37:04.775313+0000 mgr.a (mgr.14373) 5194 : cluster [DBG] pgmap v3600: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:37:06.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:37:05 smithi047 bash[22744]: cluster 2024-09-16T07:37:04.775313+0000 mgr.a (mgr.14373) 5194 : cluster [DBG] pgmap v3600: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:37:08.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:37:07 smithi047 bash[22744]: cluster 2024-09-16T07:37:06.777462+0000 mgr.a (mgr.14373) 5195 : cluster [DBG] pgmap v3601: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:37:08.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:37:07 smithi157 bash[24585]: cluster 2024-09-16T07:37:06.777462+0000 mgr.a (mgr.14373) 5195 : cluster [DBG] pgmap v3601: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:37:08.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:37:07 smithi086 bash[24289]: cluster 2024-09-16T07:37:06.777462+0000 mgr.a (mgr.14373) 5195 : cluster [DBG] pgmap v3601: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:37:08.905 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:37:08.906 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:37:08.906 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:37:09.686 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:37:09.686 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:37:09.687 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:37:09.687 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:37:09.687 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:37:10.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:37:09 smithi047 bash[22744]: cluster 2024-09-16T07:37:08.778262+0000 mgr.a (mgr.14373) 5196 : cluster [DBG] pgmap v3602: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:37:10.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:37:09 smithi157 bash[24585]: cluster 2024-09-16T07:37:08.778262+0000 mgr.a (mgr.14373) 5196 : cluster [DBG] pgmap v3602: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:37:10.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:37:09 smithi086 bash[24289]: cluster 2024-09-16T07:37:08.778262+0000 mgr.a (mgr.14373) 5196 : cluster [DBG] pgmap v3602: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:37:11.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:37:10 smithi157 bash[24585]: audit 2024-09-16T07:37:09.244837+0000 mgr.a (mgr.14373) 5197 : audit [DBG] from='client.121725 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:37:11.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:37:10 smithi086 bash[24289]: audit 2024-09-16T07:37:09.244837+0000 mgr.a (mgr.14373) 5197 : audit [DBG] from='client.121725 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:37:11.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:37:10 smithi047 bash[22744]: audit 2024-09-16T07:37:09.244837+0000 mgr.a (mgr.14373) 5197 : audit [DBG] from='client.121725 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:37:12.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:37:11 smithi157 bash[24585]: cluster 2024-09-16T07:37:10.779213+0000 mgr.a (mgr.14373) 5198 : cluster [DBG] pgmap v3603: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:37:12.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:37:11 smithi086 bash[24289]: cluster 2024-09-16T07:37:10.779213+0000 mgr.a (mgr.14373) 5198 : cluster [DBG] pgmap v3603: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:37:12.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:37:11 smithi047 bash[22744]: cluster 2024-09-16T07:37:10.779213+0000 mgr.a (mgr.14373) 5198 : cluster [DBG] pgmap v3603: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:37:14.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:37:13 smithi157 bash[24585]: cluster 2024-09-16T07:37:12.781443+0000 mgr.a (mgr.14373) 5199 : cluster [DBG] pgmap v3604: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:37:14.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:37:13 smithi086 bash[24289]: cluster 2024-09-16T07:37:12.781443+0000 mgr.a (mgr.14373) 5199 : cluster [DBG] pgmap v3604: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:37:14.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:37:13 smithi047 bash[22744]: cluster 2024-09-16T07:37:12.781443+0000 mgr.a (mgr.14373) 5199 : cluster [DBG] pgmap v3604: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:37:14.688 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:37:14.688 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:37:14.689 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:37:15.470 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:37:15.471 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:37:15.471 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:37:15.471 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:37:15.471 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:37:16.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:37:15 smithi157 bash[24585]: cluster 2024-09-16T07:37:14.781930+0000 mgr.a (mgr.14373) 5200 : cluster [DBG] pgmap v3605: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:37:16.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:37:15 smithi086 bash[24289]: cluster 2024-09-16T07:37:14.781930+0000 mgr.a (mgr.14373) 5200 : cluster [DBG] pgmap v3605: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:37:16.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:37:15 smithi047 bash[22744]: cluster 2024-09-16T07:37:14.781930+0000 mgr.a (mgr.14373) 5200 : cluster [DBG] pgmap v3605: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:37:17.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:37:16 smithi157 bash[24585]: audit 2024-09-16T07:37:15.026488+0000 mgr.a (mgr.14373) 5201 : audit [DBG] from='client.121800 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:37:17.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:37:16 smithi086 bash[24289]: audit 2024-09-16T07:37:15.026488+0000 mgr.a (mgr.14373) 5201 : audit [DBG] from='client.121800 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:37:17.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:37:16 smithi047 bash[22744]: audit 2024-09-16T07:37:15.026488+0000 mgr.a (mgr.14373) 5201 : audit [DBG] from='client.121800 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:37:18.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:37:17 smithi157 bash[24585]: cluster 2024-09-16T07:37:16.784379+0000 mgr.a (mgr.14373) 5202 : cluster [DBG] pgmap v3606: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:37:18.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:37:17 smithi086 bash[24289]: cluster 2024-09-16T07:37:16.784379+0000 mgr.a (mgr.14373) 5202 : cluster [DBG] pgmap v3606: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:37:18.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:37:17 smithi047 bash[22744]: cluster 2024-09-16T07:37:16.784379+0000 mgr.a (mgr.14373) 5202 : cluster [DBG] pgmap v3606: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:37:20.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:37:19 smithi157 bash[24585]: cluster 2024-09-16T07:37:18.785285+0000 mgr.a (mgr.14373) 5203 : cluster [DBG] pgmap v3607: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:37:20.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:37:19 smithi086 bash[24289]: cluster 2024-09-16T07:37:18.785285+0000 mgr.a (mgr.14373) 5203 : cluster [DBG] pgmap v3607: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:37:20.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:37:19 smithi047 bash[22744]: cluster 2024-09-16T07:37:18.785285+0000 mgr.a (mgr.14373) 5203 : cluster [DBG] pgmap v3607: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:37:20.472 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:37:20.473 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:37:20.473 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:37:21.236 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:37:21.237 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:37:21.237 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:37:21.237 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:37:21.237 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:37:22.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:37:21 smithi157 bash[24585]: cluster 2024-09-16T07:37:20.785983+0000 mgr.a (mgr.14373) 5204 : cluster [DBG] pgmap v3608: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:37:22.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:37:21 smithi157 bash[24585]: audit 2024-09-16T07:37:20.809844+0000 mgr.a (mgr.14373) 5205 : audit [DBG] from='client.121878 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:37:22.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:37:21 smithi086 bash[24289]: cluster 2024-09-16T07:37:20.785983+0000 mgr.a (mgr.14373) 5204 : cluster [DBG] pgmap v3608: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:37:22.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:37:21 smithi086 bash[24289]: audit 2024-09-16T07:37:20.809844+0000 mgr.a (mgr.14373) 5205 : audit [DBG] from='client.121878 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:37:22.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:37:21 smithi047 bash[22744]: cluster 2024-09-16T07:37:20.785983+0000 mgr.a (mgr.14373) 5204 : cluster [DBG] pgmap v3608: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:37:22.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:37:21 smithi047 bash[22744]: audit 2024-09-16T07:37:20.809844+0000 mgr.a (mgr.14373) 5205 : audit [DBG] from='client.121878 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:37:24.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:37:23 smithi157 bash[24585]: cluster 2024-09-16T07:37:22.788510+0000 mgr.a (mgr.14373) 5206 : cluster [DBG] pgmap v3609: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:37:24.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:37:23 smithi086 bash[24289]: cluster 2024-09-16T07:37:22.788510+0000 mgr.a (mgr.14373) 5206 : cluster [DBG] pgmap v3609: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:37:24.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:37:23 smithi047 bash[22744]: cluster 2024-09-16T07:37:22.788510+0000 mgr.a (mgr.14373) 5206 : cluster [DBG] pgmap v3609: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:37:26.238 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:37:26.239 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:37:26.239 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:37:26.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:37:25 smithi157 bash[24585]: cluster 2024-09-16T07:37:24.789436+0000 mgr.a (mgr.14373) 5207 : cluster [DBG] pgmap v3610: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:37:26.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:37:25 smithi086 bash[24289]: cluster 2024-09-16T07:37:24.789436+0000 mgr.a (mgr.14373) 5207 : cluster [DBG] pgmap v3610: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:37:26.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:37:25 smithi047 bash[22744]: cluster 2024-09-16T07:37:24.789436+0000 mgr.a (mgr.14373) 5207 : cluster [DBG] pgmap v3610: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:37:27.004 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:37:27.004 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:37:27.004 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:37:27.004 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:37:27.004 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:37:28.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:37:27 smithi157 bash[24585]: audit 2024-09-16T07:37:26.577606+0000 mgr.a (mgr.14373) 5208 : audit [DBG] from='client.121950 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:37:28.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:37:27 smithi157 bash[24585]: cluster 2024-09-16T07:37:26.790699+0000 mgr.a (mgr.14373) 5209 : cluster [DBG] pgmap v3611: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:37:28.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:37:27 smithi086 bash[24289]: audit 2024-09-16T07:37:26.577606+0000 mgr.a (mgr.14373) 5208 : audit [DBG] from='client.121950 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:37:28.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:37:27 smithi086 bash[24289]: cluster 2024-09-16T07:37:26.790699+0000 mgr.a (mgr.14373) 5209 : cluster [DBG] pgmap v3611: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:37:28.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:37:27 smithi047 bash[22744]: audit 2024-09-16T07:37:26.577606+0000 mgr.a (mgr.14373) 5208 : audit [DBG] from='client.121950 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:37:28.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:37:27 smithi047 bash[22744]: cluster 2024-09-16T07:37:26.790699+0000 mgr.a (mgr.14373) 5209 : cluster [DBG] pgmap v3611: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:37:30.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:37:29 smithi157 bash[24585]: cluster 2024-09-16T07:37:28.791539+0000 mgr.a (mgr.14373) 5210 : cluster [DBG] pgmap v3612: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:37:30.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:37:29 smithi086 bash[24289]: cluster 2024-09-16T07:37:28.791539+0000 mgr.a (mgr.14373) 5210 : cluster [DBG] pgmap v3612: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:37:30.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:37:29 smithi047 bash[22744]: cluster 2024-09-16T07:37:28.791539+0000 mgr.a (mgr.14373) 5210 : cluster [DBG] pgmap v3612: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:37:32.005 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:37:32.006 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:37:32.006 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:37:32.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:37:31 smithi157 bash[24585]: cluster 2024-09-16T07:37:30.792301+0000 mgr.a (mgr.14373) 5211 : cluster [DBG] pgmap v3613: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T07:37:32.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:37:31 smithi086 bash[24289]: cluster 2024-09-16T07:37:30.792301+0000 mgr.a (mgr.14373) 5211 : cluster [DBG] pgmap v3613: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T07:37:32.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:37:31 smithi047 bash[22744]: cluster 2024-09-16T07:37:30.792301+0000 mgr.a (mgr.14373) 5211 : cluster [DBG] pgmap v3613: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T07:37:32.770 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:37:32.771 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:37:32.771 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:37:32.771 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:37:32.771 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:37:34.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:37:33 smithi157 bash[24585]: audit 2024-09-16T07:37:32.346372+0000 mgr.a (mgr.14373) 5212 : audit [DBG] from='client.122028 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:37:34.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:37:33 smithi157 bash[24585]: cluster 2024-09-16T07:37:32.793677+0000 mgr.a (mgr.14373) 5213 : cluster [DBG] pgmap v3614: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:37:34.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:37:33 smithi086 bash[24289]: audit 2024-09-16T07:37:32.346372+0000 mgr.a (mgr.14373) 5212 : audit [DBG] from='client.122028 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:37:34.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:37:33 smithi086 bash[24289]: cluster 2024-09-16T07:37:32.793677+0000 mgr.a (mgr.14373) 5213 : cluster [DBG] pgmap v3614: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:37:34.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:37:33 smithi047 bash[22744]: audit 2024-09-16T07:37:32.346372+0000 mgr.a (mgr.14373) 5212 : audit [DBG] from='client.122028 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:37:34.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:37:33 smithi047 bash[22744]: cluster 2024-09-16T07:37:32.793677+0000 mgr.a (mgr.14373) 5213 : cluster [DBG] pgmap v3614: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:37:36.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:37:35 smithi157 bash[24585]: cluster 2024-09-16T07:37:34.794432+0000 mgr.a (mgr.14373) 5214 : cluster [DBG] pgmap v3615: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T07:37:36.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:37:35 smithi086 bash[24289]: cluster 2024-09-16T07:37:34.794432+0000 mgr.a (mgr.14373) 5214 : cluster [DBG] pgmap v3615: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T07:37:36.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:37:35 smithi047 bash[22744]: cluster 2024-09-16T07:37:34.794432+0000 mgr.a (mgr.14373) 5214 : cluster [DBG] pgmap v3615: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T07:37:37.772 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:37:37.773 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:37:37.773 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:37:38.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:37:37 smithi157 bash[24585]: cluster 2024-09-16T07:37:36.796334+0000 mgr.a (mgr.14373) 5215 : cluster [DBG] pgmap v3616: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:37:38.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:37:37 smithi086 bash[24289]: cluster 2024-09-16T07:37:36.796334+0000 mgr.a (mgr.14373) 5215 : cluster [DBG] pgmap v3616: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:37:38.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:37:37 smithi047 bash[22744]: cluster 2024-09-16T07:37:36.796334+0000 mgr.a (mgr.14373) 5215 : cluster [DBG] pgmap v3616: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:37:38.560 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:37:38.561 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:37:38.561 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:37:38.561 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:37:38.561 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:37:40.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:37:39 smithi157 bash[24585]: audit 2024-09-16T07:37:38.112509+0000 mgr.a (mgr.14373) 5216 : audit [DBG] from='client.122103 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:37:40.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:37:39 smithi157 bash[24585]: cluster 2024-09-16T07:37:38.797301+0000 mgr.a (mgr.14373) 5217 : cluster [DBG] pgmap v3617: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:37:40.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:37:39 smithi086 bash[24289]: audit 2024-09-16T07:37:38.112509+0000 mgr.a (mgr.14373) 5216 : audit [DBG] from='client.122103 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:37:40.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:37:39 smithi086 bash[24289]: cluster 2024-09-16T07:37:38.797301+0000 mgr.a (mgr.14373) 5217 : cluster [DBG] pgmap v3617: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:37:40.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:37:39 smithi047 bash[22744]: audit 2024-09-16T07:37:38.112509+0000 mgr.a (mgr.14373) 5216 : audit [DBG] from='client.122103 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:37:40.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:37:39 smithi047 bash[22744]: cluster 2024-09-16T07:37:38.797301+0000 mgr.a (mgr.14373) 5217 : cluster [DBG] pgmap v3617: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:37:42.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:37:41 smithi157 bash[24585]: cluster 2024-09-16T07:37:40.798088+0000 mgr.a (mgr.14373) 5218 : cluster [DBG] pgmap v3618: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:37:42.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:37:41 smithi086 bash[24289]: cluster 2024-09-16T07:37:40.798088+0000 mgr.a (mgr.14373) 5218 : cluster [DBG] pgmap v3618: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:37:42.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:37:41 smithi047 bash[22744]: cluster 2024-09-16T07:37:40.798088+0000 mgr.a (mgr.14373) 5218 : cluster [DBG] pgmap v3618: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:37:43.562 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:37:43.563 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:37:43.563 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:37:44.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:37:43 smithi157 bash[24585]: cluster 2024-09-16T07:37:42.800256+0000 mgr.a (mgr.14373) 5219 : cluster [DBG] pgmap v3619: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:37:44.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:37:43 smithi086 bash[24289]: cluster 2024-09-16T07:37:42.800256+0000 mgr.a (mgr.14373) 5219 : cluster [DBG] pgmap v3619: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:37:44.333 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:37:44.334 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:37:44.334 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:37:44.334 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:37:44.334 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:37:44.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:37:43 smithi047 bash[22744]: cluster 2024-09-16T07:37:42.800256+0000 mgr.a (mgr.14373) 5219 : cluster [DBG] pgmap v3619: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:37:45.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:37:44 smithi157 bash[24585]: audit 2024-09-16T07:37:43.903305+0000 mgr.a (mgr.14373) 5220 : audit [DBG] from='client.122178 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:37:45.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:37:44 smithi086 bash[24289]: audit 2024-09-16T07:37:43.903305+0000 mgr.a (mgr.14373) 5220 : audit [DBG] from='client.122178 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:37:45.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:37:44 smithi047 bash[22744]: audit 2024-09-16T07:37:43.903305+0000 mgr.a (mgr.14373) 5220 : audit [DBG] from='client.122178 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:37:46.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:37:45 smithi157 bash[24585]: cluster 2024-09-16T07:37:44.801358+0000 mgr.a (mgr.14373) 5221 : cluster [DBG] pgmap v3620: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:37:46.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:37:45 smithi086 bash[24289]: cluster 2024-09-16T07:37:44.801358+0000 mgr.a (mgr.14373) 5221 : cluster [DBG] pgmap v3620: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:37:46.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:37:45 smithi047 bash[22744]: cluster 2024-09-16T07:37:44.801358+0000 mgr.a (mgr.14373) 5221 : cluster [DBG] pgmap v3620: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:37:48.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:37:47 smithi157 bash[24585]: cluster 2024-09-16T07:37:46.803564+0000 mgr.a (mgr.14373) 5222 : cluster [DBG] pgmap v3621: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:37:48.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:37:47 smithi086 bash[24289]: cluster 2024-09-16T07:37:46.803564+0000 mgr.a (mgr.14373) 5222 : cluster [DBG] pgmap v3621: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:37:48.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:37:47 smithi047 bash[22744]: cluster 2024-09-16T07:37:46.803564+0000 mgr.a (mgr.14373) 5222 : cluster [DBG] pgmap v3621: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:37:49.335 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:37:49.336 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:37:49.336 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:37:50.121 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:37:50.121 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:37:50.121 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:37:50.121 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:37:50.121 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:37:50.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:37:49 smithi157 bash[24585]: cluster 2024-09-16T07:37:48.804464+0000 mgr.a (mgr.14373) 5223 : cluster [DBG] pgmap v3622: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:37:50.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:37:49 smithi086 bash[24289]: cluster 2024-09-16T07:37:48.804464+0000 mgr.a (mgr.14373) 5223 : cluster [DBG] pgmap v3622: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:37:50.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:37:49 smithi047 bash[22744]: cluster 2024-09-16T07:37:48.804464+0000 mgr.a (mgr.14373) 5223 : cluster [DBG] pgmap v3622: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:37:51.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:37:50 smithi157 bash[24585]: audit 2024-09-16T07:37:49.677913+0000 mgr.a (mgr.14373) 5224 : audit [DBG] from='client.122256 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:37:51.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:37:50 smithi086 bash[24289]: audit 2024-09-16T07:37:49.677913+0000 mgr.a (mgr.14373) 5224 : audit [DBG] from='client.122256 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:37:51.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:37:50 smithi047 bash[22744]: audit 2024-09-16T07:37:49.677913+0000 mgr.a (mgr.14373) 5224 : audit [DBG] from='client.122256 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:37:52.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:37:51 smithi157 bash[24585]: cluster 2024-09-16T07:37:50.805417+0000 mgr.a (mgr.14373) 5225 : cluster [DBG] pgmap v3623: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:37:52.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:37:51 smithi086 bash[24289]: cluster 2024-09-16T07:37:50.805417+0000 mgr.a (mgr.14373) 5225 : cluster [DBG] pgmap v3623: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:37:52.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:37:51 smithi047 bash[22744]: cluster 2024-09-16T07:37:50.805417+0000 mgr.a (mgr.14373) 5225 : cluster [DBG] pgmap v3623: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:37:53.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:37:52 smithi157 bash[24585]: cluster 2024-09-16T07:37:52.807669+0000 mgr.a (mgr.14373) 5226 : cluster [DBG] pgmap v3624: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:37:53.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:37:52 smithi086 bash[24289]: cluster 2024-09-16T07:37:52.807669+0000 mgr.a (mgr.14373) 5226 : cluster [DBG] pgmap v3624: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:37:53.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:37:52 smithi047 bash[22744]: cluster 2024-09-16T07:37:52.807669+0000 mgr.a (mgr.14373) 5226 : cluster [DBG] pgmap v3624: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:37:55.123 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:37:55.123 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:37:55.123 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:37:55.894 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:37:55.894 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:37:55.894 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:37:55.894 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:37:55.894 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:37:56.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:37:55 smithi157 bash[24585]: cluster 2024-09-16T07:37:54.808432+0000 mgr.a (mgr.14373) 5227 : cluster [DBG] pgmap v3625: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:37:56.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:37:55 smithi086 bash[24289]: cluster 2024-09-16T07:37:54.808432+0000 mgr.a (mgr.14373) 5227 : cluster [DBG] pgmap v3625: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:37:56.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:37:55 smithi047 bash[22744]: cluster 2024-09-16T07:37:54.808432+0000 mgr.a (mgr.14373) 5227 : cluster [DBG] pgmap v3625: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:37:57.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:37:56 smithi157 bash[24585]: audit 2024-09-16T07:37:55.460991+0000 mgr.a (mgr.14373) 5228 : audit [DBG] from='client.122334 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:37:57.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:37:56 smithi086 bash[24289]: audit 2024-09-16T07:37:55.460991+0000 mgr.a (mgr.14373) 5228 : audit [DBG] from='client.122334 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:37:57.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:37:56 smithi047 bash[22744]: audit 2024-09-16T07:37:55.460991+0000 mgr.a (mgr.14373) 5228 : audit [DBG] from='client.122334 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:37:58.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:37:57 smithi157 bash[24585]: cluster 2024-09-16T07:37:56.810721+0000 mgr.a (mgr.14373) 5229 : cluster [DBG] pgmap v3626: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:37:58.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:37:57 smithi086 bash[24289]: cluster 2024-09-16T07:37:56.810721+0000 mgr.a (mgr.14373) 5229 : cluster [DBG] pgmap v3626: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:37:58.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:37:57 smithi047 bash[22744]: cluster 2024-09-16T07:37:56.810721+0000 mgr.a (mgr.14373) 5229 : cluster [DBG] pgmap v3626: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:38:00.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:37:59 smithi157 bash[24585]: cluster 2024-09-16T07:37:58.811465+0000 mgr.a (mgr.14373) 5230 : cluster [DBG] pgmap v3627: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:38:00.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:37:59 smithi086 bash[24289]: cluster 2024-09-16T07:37:58.811465+0000 mgr.a (mgr.14373) 5230 : cluster [DBG] pgmap v3627: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:38:00.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:37:59 smithi047 bash[22744]: cluster 2024-09-16T07:37:58.811465+0000 mgr.a (mgr.14373) 5230 : cluster [DBG] pgmap v3627: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:38:00.895 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:38:00.896 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:38:00.896 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:38:01.656 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:38:01.656 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:38:01.656 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:38:01.656 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:38:01.657 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:38:02.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:38:01 smithi157 bash[24585]: cluster 2024-09-16T07:38:00.812212+0000 mgr.a (mgr.14373) 5231 : cluster [DBG] pgmap v3628: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:38:02.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:38:01 smithi157 bash[24585]: audit 2024-09-16T07:38:01.401251+0000 mon.b (mon.2) 510 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T07:38:02.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:38:01 smithi086 bash[24289]: cluster 2024-09-16T07:38:00.812212+0000 mgr.a (mgr.14373) 5231 : cluster [DBG] pgmap v3628: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:38:02.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:38:01 smithi086 bash[24289]: audit 2024-09-16T07:38:01.401251+0000 mon.b (mon.2) 510 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T07:38:02.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:38:01 smithi047 bash[22744]: cluster 2024-09-16T07:38:00.812212+0000 mgr.a (mgr.14373) 5231 : cluster [DBG] pgmap v3628: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:38:02.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:38:01 smithi047 bash[22744]: audit 2024-09-16T07:38:01.401251+0000 mon.b (mon.2) 510 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T07:38:03.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:38:02 smithi157 bash[24585]: audit 2024-09-16T07:38:01.229526+0000 mgr.a (mgr.14373) 5232 : audit [DBG] from='client.122409 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:38:03.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:38:02 smithi157 bash[24585]: audit 2024-09-16T07:38:01.961285+0000 mon.a (mon.0) 875 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:38:03.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:38:02 smithi157 bash[24585]: audit 2024-09-16T07:38:01.968940+0000 mon.a (mon.0) 876 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:38:03.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:38:02 smithi086 bash[24289]: audit 2024-09-16T07:38:01.229526+0000 mgr.a (mgr.14373) 5232 : audit [DBG] from='client.122409 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:38:03.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:38:02 smithi086 bash[24289]: audit 2024-09-16T07:38:01.961285+0000 mon.a (mon.0) 875 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:38:03.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:38:02 smithi086 bash[24289]: audit 2024-09-16T07:38:01.968940+0000 mon.a (mon.0) 876 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:38:03.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:38:02 smithi047 bash[22744]: audit 2024-09-16T07:38:01.229526+0000 mgr.a (mgr.14373) 5232 : audit [DBG] from='client.122409 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:38:03.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:38:02 smithi047 bash[22744]: audit 2024-09-16T07:38:01.961285+0000 mon.a (mon.0) 875 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:38:03.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:38:02 smithi047 bash[22744]: audit 2024-09-16T07:38:01.968940+0000 mon.a (mon.0) 876 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:38:04.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:38:03 smithi157 bash[24585]: cluster 2024-09-16T07:38:02.814839+0000 mgr.a (mgr.14373) 5233 : cluster [DBG] pgmap v3629: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:38:04.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:38:03 smithi086 bash[24289]: cluster 2024-09-16T07:38:02.814839+0000 mgr.a (mgr.14373) 5233 : cluster [DBG] pgmap v3629: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:38:04.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:38:03 smithi047 bash[22744]: cluster 2024-09-16T07:38:02.814839+0000 mgr.a (mgr.14373) 5233 : cluster [DBG] pgmap v3629: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:38:06.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:38:05 smithi157 bash[24585]: cluster 2024-09-16T07:38:04.815734+0000 mgr.a (mgr.14373) 5234 : cluster [DBG] pgmap v3630: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:38:06.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:38:05 smithi086 bash[24289]: cluster 2024-09-16T07:38:04.815734+0000 mgr.a (mgr.14373) 5234 : cluster [DBG] pgmap v3630: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:38:06.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:38:05 smithi047 bash[22744]: cluster 2024-09-16T07:38:04.815734+0000 mgr.a (mgr.14373) 5234 : cluster [DBG] pgmap v3630: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:38:06.657 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:38:06.658 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:38:06.658 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:38:07.442 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:38:07.443 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:38:07.443 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:38:07.443 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:38:07.443 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:38:08.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:38:07 smithi157 bash[24585]: cluster 2024-09-16T07:38:06.817827+0000 mgr.a (mgr.14373) 5235 : cluster [DBG] pgmap v3631: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 22 KiB/s rd, 0 B/s wr, 34 op/s 2024-09-16T07:38:08.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:38:07 smithi086 bash[24289]: cluster 2024-09-16T07:38:06.817827+0000 mgr.a (mgr.14373) 5235 : cluster [DBG] pgmap v3631: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 22 KiB/s rd, 0 B/s wr, 34 op/s 2024-09-16T07:38:08.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:38:07 smithi047 bash[22744]: cluster 2024-09-16T07:38:06.817827+0000 mgr.a (mgr.14373) 5235 : cluster [DBG] pgmap v3631: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 22 KiB/s rd, 0 B/s wr, 34 op/s 2024-09-16T07:38:09.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:38:08 smithi157 bash[24585]: audit 2024-09-16T07:38:06.999729+0000 mgr.a (mgr.14373) 5236 : audit [DBG] from='client.122484 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:38:09.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:38:08 smithi086 bash[24289]: audit 2024-09-16T07:38:06.999729+0000 mgr.a (mgr.14373) 5236 : audit [DBG] from='client.122484 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:38:09.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:38:08 smithi047 bash[22744]: audit 2024-09-16T07:38:06.999729+0000 mgr.a (mgr.14373) 5236 : audit [DBG] from='client.122484 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:38:10.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:38:09 smithi157 bash[24585]: cluster 2024-09-16T07:38:08.818791+0000 mgr.a (mgr.14373) 5237 : cluster [DBG] pgmap v3632: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 21 KiB/s rd, 0 B/s wr, 34 op/s 2024-09-16T07:38:10.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:38:09 smithi086 bash[24289]: cluster 2024-09-16T07:38:08.818791+0000 mgr.a (mgr.14373) 5237 : cluster [DBG] pgmap v3632: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 21 KiB/s rd, 0 B/s wr, 34 op/s 2024-09-16T07:38:10.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:38:09 smithi047 bash[22744]: cluster 2024-09-16T07:38:08.818791+0000 mgr.a (mgr.14373) 5237 : cluster [DBG] pgmap v3632: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 21 KiB/s rd, 0 B/s wr, 34 op/s 2024-09-16T07:38:12.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:38:11 smithi157 bash[24585]: cluster 2024-09-16T07:38:10.819686+0000 mgr.a (mgr.14373) 5238 : cluster [DBG] pgmap v3633: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 21 KiB/s rd, 0 B/s wr, 34 op/s 2024-09-16T07:38:12.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:38:11 smithi086 bash[24289]: cluster 2024-09-16T07:38:10.819686+0000 mgr.a (mgr.14373) 5238 : cluster [DBG] pgmap v3633: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 21 KiB/s rd, 0 B/s wr, 34 op/s 2024-09-16T07:38:12.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:38:11 smithi047 bash[22744]: cluster 2024-09-16T07:38:10.819686+0000 mgr.a (mgr.14373) 5238 : cluster [DBG] pgmap v3633: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 21 KiB/s rd, 0 B/s wr, 34 op/s 2024-09-16T07:38:12.444 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:38:12.444 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:38:12.444 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:38:13.338 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 07:38:13 smithi047 bash[22994]: debug 2024-09-16T07:38:13.022+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T07:38:13.338 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 07:38:13 smithi047 bash[22994]: debug 2024-09-16T07:38:13.042+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T07:38:13.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:38:13 smithi047 bash[22744]: audit 2024-09-16T07:38:12.164392+0000 mon.a (mon.0) 877 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:38:13.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:38:13 smithi047 bash[22744]: audit 2024-09-16T07:38:12.177211+0000 mon.a (mon.0) 878 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:38:13.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:38:13 smithi047 bash[22744]: audit 2024-09-16T07:38:12.179305+0000 mon.b (mon.2) 511 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T07:38:13.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:38:13 smithi047 bash[22744]: audit 2024-09-16T07:38:12.181828+0000 mon.b (mon.2) 512 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T07:38:13.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:38:13 smithi047 bash[22744]: audit 2024-09-16T07:38:12.196019+0000 mon.a (mon.0) 879 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:38:13.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:38:13 smithi047 bash[22744]: audit 2024-09-16T07:38:12.201354+0000 mon.b (mon.2) 513 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:38:13.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:38:13 smithi047 bash[22744]: audit 2024-09-16T07:38:12.205193+0000 mgr.a (mgr.14373) 5239 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:38:13.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:38:13 smithi047 bash[22744]: audit 2024-09-16T07:38:12.800143+0000 mgr.a (mgr.14373) 5240 : audit [DBG] from='client.122601 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:38:13.340 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:38:13 smithi047 bash[22744]: cluster 2024-09-16T07:38:12.820995+0000 mgr.a (mgr.14373) 5241 : cluster [DBG] pgmap v3634: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 22 KiB/s rd, 0 B/s wr, 34 op/s 2024-09-16T07:38:13.469 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:38:13.470 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:38:13.470 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:38:13.470 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:38:13.470 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:38:13.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:38:13 smithi157 bash[24585]: audit 2024-09-16T07:38:12.164392+0000 mon.a (mon.0) 877 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:38:13.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:38:13 smithi157 bash[24585]: audit 2024-09-16T07:38:12.177211+0000 mon.a (mon.0) 878 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:38:13.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:38:13 smithi157 bash[24585]: audit 2024-09-16T07:38:12.179305+0000 mon.b (mon.2) 511 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T07:38:13.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:38:13 smithi157 bash[24585]: audit 2024-09-16T07:38:12.181828+0000 mon.b (mon.2) 512 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T07:38:13.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:38:13 smithi157 bash[24585]: audit 2024-09-16T07:38:12.196019+0000 mon.a (mon.0) 879 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:38:13.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:38:13 smithi157 bash[24585]: audit 2024-09-16T07:38:12.201354+0000 mon.b (mon.2) 513 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:38:13.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:38:13 smithi157 bash[24585]: audit 2024-09-16T07:38:12.205193+0000 mgr.a (mgr.14373) 5239 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:38:13.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:38:13 smithi157 bash[24585]: audit 2024-09-16T07:38:12.800143+0000 mgr.a (mgr.14373) 5240 : audit [DBG] from='client.122601 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:38:13.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:38:13 smithi157 bash[24585]: cluster 2024-09-16T07:38:12.820995+0000 mgr.a (mgr.14373) 5241 : cluster [DBG] pgmap v3634: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 22 KiB/s rd, 0 B/s wr, 34 op/s 2024-09-16T07:38:13.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:38:13 smithi086 bash[24289]: audit 2024-09-16T07:38:12.164392+0000 mon.a (mon.0) 877 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:38:13.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:38:13 smithi086 bash[24289]: audit 2024-09-16T07:38:12.177211+0000 mon.a (mon.0) 878 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:38:13.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:38:13 smithi086 bash[24289]: audit 2024-09-16T07:38:12.179305+0000 mon.b (mon.2) 511 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T07:38:13.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:38:13 smithi086 bash[24289]: audit 2024-09-16T07:38:12.181828+0000 mon.b (mon.2) 512 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T07:38:13.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:38:13 smithi086 bash[24289]: audit 2024-09-16T07:38:12.196019+0000 mon.a (mon.0) 879 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:38:13.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:38:13 smithi086 bash[24289]: audit 2024-09-16T07:38:12.201354+0000 mon.b (mon.2) 513 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:38:13.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:38:13 smithi086 bash[24289]: audit 2024-09-16T07:38:12.205193+0000 mgr.a (mgr.14373) 5239 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:38:13.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:38:13 smithi086 bash[24289]: audit 2024-09-16T07:38:12.800143+0000 mgr.a (mgr.14373) 5240 : audit [DBG] from='client.122601 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:38:13.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:38:13 smithi086 bash[24289]: cluster 2024-09-16T07:38:12.820995+0000 mgr.a (mgr.14373) 5241 : cluster [DBG] pgmap v3634: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 22 KiB/s rd, 0 B/s wr, 34 op/s 2024-09-16T07:38:14.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:38:14 smithi157 bash[24585]: audit 2024-09-16T07:38:13.030334+0000 mgr.a (mgr.14373) 5242 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T07:38:14.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:38:14 smithi157 bash[24585]: cephadm 2024-09-16T07:38:13.046592+0000 mgr.a (mgr.14373) 5243 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T07:38:14.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:38:14 smithi086 bash[24289]: audit 2024-09-16T07:38:13.030334+0000 mgr.a (mgr.14373) 5242 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T07:38:14.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:38:14 smithi086 bash[24289]: cephadm 2024-09-16T07:38:13.046592+0000 mgr.a (mgr.14373) 5243 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T07:38:14.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:38:14 smithi047 bash[22744]: audit 2024-09-16T07:38:13.030334+0000 mgr.a (mgr.14373) 5242 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T07:38:14.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:38:14 smithi047 bash[22744]: cephadm 2024-09-16T07:38:13.046592+0000 mgr.a (mgr.14373) 5243 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T07:38:15.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:38:15 smithi157 bash[24585]: cluster 2024-09-16T07:38:14.821864+0000 mgr.a (mgr.14373) 5244 : cluster [DBG] pgmap v3635: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 22 KiB/s rd, 0 B/s wr, 34 op/s 2024-09-16T07:38:15.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:38:15 smithi086 bash[24289]: cluster 2024-09-16T07:38:14.821864+0000 mgr.a (mgr.14373) 5244 : cluster [DBG] pgmap v3635: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 22 KiB/s rd, 0 B/s wr, 34 op/s 2024-09-16T07:38:15.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:38:15 smithi047 bash[22744]: cluster 2024-09-16T07:38:14.821864+0000 mgr.a (mgr.14373) 5244 : cluster [DBG] pgmap v3635: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 22 KiB/s rd, 0 B/s wr, 34 op/s 2024-09-16T07:38:18.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:38:17 smithi157 bash[24585]: cluster 2024-09-16T07:38:16.824068+0000 mgr.a (mgr.14373) 5245 : cluster [DBG] pgmap v3636: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 91 KiB/s rd, 426 B/s wr, 146 op/s 2024-09-16T07:38:18.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:38:17 smithi086 bash[24289]: cluster 2024-09-16T07:38:16.824068+0000 mgr.a (mgr.14373) 5245 : cluster [DBG] pgmap v3636: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 91 KiB/s rd, 426 B/s wr, 146 op/s 2024-09-16T07:38:18.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:38:17 smithi047 bash[22744]: cluster 2024-09-16T07:38:16.824068+0000 mgr.a (mgr.14373) 5245 : cluster [DBG] pgmap v3636: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 91 KiB/s rd, 426 B/s wr, 146 op/s 2024-09-16T07:38:18.471 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:38:18.472 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:38:18.472 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:38:19.248 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:38:19.249 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:38:19.249 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:38:19.249 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:38:19.249 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:38:20.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:38:19 smithi157 bash[24585]: audit 2024-09-16T07:38:18.807642+0000 mgr.a (mgr.14373) 5246 : audit [DBG] from='client.122739 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:38:20.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:38:19 smithi157 bash[24585]: cluster 2024-09-16T07:38:18.826164+0000 mgr.a (mgr.14373) 5247 : cluster [DBG] pgmap v3637: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 70 KiB/s rd, 426 B/s wr, 112 op/s 2024-09-16T07:38:20.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:38:19 smithi086 bash[24289]: audit 2024-09-16T07:38:18.807642+0000 mgr.a (mgr.14373) 5246 : audit [DBG] from='client.122739 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:38:20.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:38:19 smithi086 bash[24289]: cluster 2024-09-16T07:38:18.826164+0000 mgr.a (mgr.14373) 5247 : cluster [DBG] pgmap v3637: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 70 KiB/s rd, 426 B/s wr, 112 op/s 2024-09-16T07:38:20.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:38:19 smithi047 bash[22744]: audit 2024-09-16T07:38:18.807642+0000 mgr.a (mgr.14373) 5246 : audit [DBG] from='client.122739 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:38:20.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:38:19 smithi047 bash[22744]: cluster 2024-09-16T07:38:18.826164+0000 mgr.a (mgr.14373) 5247 : cluster [DBG] pgmap v3637: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 70 KiB/s rd, 426 B/s wr, 112 op/s 2024-09-16T07:38:22.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:38:21 smithi157 bash[24585]: cluster 2024-09-16T07:38:20.827177+0000 mgr.a (mgr.14373) 5248 : cluster [DBG] pgmap v3638: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 70 KiB/s rd, 426 B/s wr, 112 op/s 2024-09-16T07:38:22.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:38:21 smithi086 bash[24289]: cluster 2024-09-16T07:38:20.827177+0000 mgr.a (mgr.14373) 5248 : cluster [DBG] pgmap v3638: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 70 KiB/s rd, 426 B/s wr, 112 op/s 2024-09-16T07:38:22.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:38:21 smithi047 bash[22744]: cluster 2024-09-16T07:38:20.827177+0000 mgr.a (mgr.14373) 5248 : cluster [DBG] pgmap v3638: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 70 KiB/s rd, 426 B/s wr, 112 op/s 2024-09-16T07:38:24.250 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:38:24.250 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:38:24.251 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:38:24.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:38:23 smithi157 bash[24585]: cluster 2024-09-16T07:38:22.829398+0000 mgr.a (mgr.14373) 5249 : cluster [DBG] pgmap v3639: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 71 KiB/s rd, 426 B/s wr, 113 op/s 2024-09-16T07:38:24.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:38:23 smithi086 bash[24289]: cluster 2024-09-16T07:38:22.829398+0000 mgr.a (mgr.14373) 5249 : cluster [DBG] pgmap v3639: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 71 KiB/s rd, 426 B/s wr, 113 op/s 2024-09-16T07:38:24.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:38:23 smithi047 bash[22744]: cluster 2024-09-16T07:38:22.829398+0000 mgr.a (mgr.14373) 5249 : cluster [DBG] pgmap v3639: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 71 KiB/s rd, 426 B/s wr, 113 op/s 2024-09-16T07:38:25.027 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:38:25.027 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:38:25.027 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:38:25.027 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:38:25.027 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:38:26.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:38:25 smithi157 bash[24585]: audit 2024-09-16T07:38:24.590660+0000 mgr.a (mgr.14373) 5250 : audit [DBG] from='client.122814 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:38:26.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:38:25 smithi157 bash[24585]: cluster 2024-09-16T07:38:24.829952+0000 mgr.a (mgr.14373) 5251 : cluster [DBG] pgmap v3640: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 70 KiB/s rd, 426 B/s wr, 112 op/s 2024-09-16T07:38:26.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:38:25 smithi086 bash[24289]: audit 2024-09-16T07:38:24.590660+0000 mgr.a (mgr.14373) 5250 : audit [DBG] from='client.122814 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:38:26.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:38:25 smithi086 bash[24289]: cluster 2024-09-16T07:38:24.829952+0000 mgr.a (mgr.14373) 5251 : cluster [DBG] pgmap v3640: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 70 KiB/s rd, 426 B/s wr, 112 op/s 2024-09-16T07:38:26.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:38:25 smithi047 bash[22744]: audit 2024-09-16T07:38:24.590660+0000 mgr.a (mgr.14373) 5250 : audit [DBG] from='client.122814 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:38:26.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:38:25 smithi047 bash[22744]: cluster 2024-09-16T07:38:24.829952+0000 mgr.a (mgr.14373) 5251 : cluster [DBG] pgmap v3640: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 70 KiB/s rd, 426 B/s wr, 112 op/s 2024-09-16T07:38:28.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:38:27 smithi157 bash[24585]: cluster 2024-09-16T07:38:26.832199+0000 mgr.a (mgr.14373) 5252 : cluster [DBG] pgmap v3641: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 71 KiB/s rd, 426 B/s wr, 113 op/s 2024-09-16T07:38:28.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:38:27 smithi086 bash[24289]: cluster 2024-09-16T07:38:26.832199+0000 mgr.a (mgr.14373) 5252 : cluster [DBG] pgmap v3641: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 71 KiB/s rd, 426 B/s wr, 113 op/s 2024-09-16T07:38:28.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:38:27 smithi047 bash[22744]: cluster 2024-09-16T07:38:26.832199+0000 mgr.a (mgr.14373) 5252 : cluster [DBG] pgmap v3641: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 71 KiB/s rd, 426 B/s wr, 113 op/s 2024-09-16T07:38:30.029 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:38:30.029 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:38:30.029 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:38:30.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:38:29 smithi157 bash[24585]: cluster 2024-09-16T07:38:28.833150+0000 mgr.a (mgr.14373) 5253 : cluster [DBG] pgmap v3642: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:38:30.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:38:29 smithi086 bash[24289]: cluster 2024-09-16T07:38:28.833150+0000 mgr.a (mgr.14373) 5253 : cluster [DBG] pgmap v3642: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:38:30.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:38:29 smithi047 bash[22744]: cluster 2024-09-16T07:38:28.833150+0000 mgr.a (mgr.14373) 5253 : cluster [DBG] pgmap v3642: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:38:30.815 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:38:30.815 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:38:30.816 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:38:30.816 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:38:30.816 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:38:32.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:38:31 smithi157 bash[24585]: audit 2024-09-16T07:38:30.371225+0000 mgr.a (mgr.14373) 5254 : audit [DBG] from='client.122892 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:38:32.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:38:31 smithi157 bash[24585]: cluster 2024-09-16T07:38:30.833874+0000 mgr.a (mgr.14373) 5255 : cluster [DBG] pgmap v3643: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:38:32.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:38:31 smithi086 bash[24289]: audit 2024-09-16T07:38:30.371225+0000 mgr.a (mgr.14373) 5254 : audit [DBG] from='client.122892 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:38:32.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:38:31 smithi086 bash[24289]: cluster 2024-09-16T07:38:30.833874+0000 mgr.a (mgr.14373) 5255 : cluster [DBG] pgmap v3643: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:38:32.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:38:31 smithi047 bash[22744]: audit 2024-09-16T07:38:30.371225+0000 mgr.a (mgr.14373) 5254 : audit [DBG] from='client.122892 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:38:32.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:38:31 smithi047 bash[22744]: cluster 2024-09-16T07:38:30.833874+0000 mgr.a (mgr.14373) 5255 : cluster [DBG] pgmap v3643: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:38:34.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:38:33 smithi157 bash[24585]: cluster 2024-09-16T07:38:32.836093+0000 mgr.a (mgr.14373) 5256 : cluster [DBG] pgmap v3644: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:38:34.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:38:33 smithi086 bash[24289]: cluster 2024-09-16T07:38:32.836093+0000 mgr.a (mgr.14373) 5256 : cluster [DBG] pgmap v3644: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:38:34.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:38:33 smithi047 bash[22744]: cluster 2024-09-16T07:38:32.836093+0000 mgr.a (mgr.14373) 5256 : cluster [DBG] pgmap v3644: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:38:35.817 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:38:35.817 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:38:35.818 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:38:36.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:38:35 smithi157 bash[24585]: cluster 2024-09-16T07:38:34.836857+0000 mgr.a (mgr.14373) 5257 : cluster [DBG] pgmap v3645: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:38:36.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:38:35 smithi086 bash[24289]: cluster 2024-09-16T07:38:34.836857+0000 mgr.a (mgr.14373) 5257 : cluster [DBG] pgmap v3645: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:38:36.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:38:35 smithi047 bash[22744]: cluster 2024-09-16T07:38:34.836857+0000 mgr.a (mgr.14373) 5257 : cluster [DBG] pgmap v3645: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:38:36.568 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:38:36.568 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:38:36.568 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:38:36.568 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:38:36.568 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:38:38.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:38:37 smithi157 bash[24585]: audit 2024-09-16T07:38:36.155080+0000 mgr.a (mgr.14373) 5258 : audit [DBG] from='client.122967 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:38:38.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:38:37 smithi157 bash[24585]: cluster 2024-09-16T07:38:36.839504+0000 mgr.a (mgr.14373) 5259 : cluster [DBG] pgmap v3646: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:38:38.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:38:37 smithi086 bash[24289]: audit 2024-09-16T07:38:36.155080+0000 mgr.a (mgr.14373) 5258 : audit [DBG] from='client.122967 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:38:38.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:38:37 smithi086 bash[24289]: cluster 2024-09-16T07:38:36.839504+0000 mgr.a (mgr.14373) 5259 : cluster [DBG] pgmap v3646: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:38:38.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:38:37 smithi047 bash[22744]: audit 2024-09-16T07:38:36.155080+0000 mgr.a (mgr.14373) 5258 : audit [DBG] from='client.122967 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:38:38.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:38:37 smithi047 bash[22744]: cluster 2024-09-16T07:38:36.839504+0000 mgr.a (mgr.14373) 5259 : cluster [DBG] pgmap v3646: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:38:40.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:38:39 smithi157 bash[24585]: cluster 2024-09-16T07:38:38.840276+0000 mgr.a (mgr.14373) 5260 : cluster [DBG] pgmap v3647: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:38:40.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:38:39 smithi086 bash[24289]: cluster 2024-09-16T07:38:38.840276+0000 mgr.a (mgr.14373) 5260 : cluster [DBG] pgmap v3647: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:38:40.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:38:39 smithi047 bash[22744]: cluster 2024-09-16T07:38:38.840276+0000 mgr.a (mgr.14373) 5260 : cluster [DBG] pgmap v3647: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:38:41.569 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:38:41.570 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:38:41.570 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:38:42.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:38:41 smithi157 bash[24585]: cluster 2024-09-16T07:38:40.841049+0000 mgr.a (mgr.14373) 5261 : cluster [DBG] pgmap v3648: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T07:38:42.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:38:41 smithi086 bash[24289]: cluster 2024-09-16T07:38:40.841049+0000 mgr.a (mgr.14373) 5261 : cluster [DBG] pgmap v3648: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T07:38:42.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:38:41 smithi047 bash[22744]: cluster 2024-09-16T07:38:40.841049+0000 mgr.a (mgr.14373) 5261 : cluster [DBG] pgmap v3648: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T07:38:42.347 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:38:42.347 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:38:42.347 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:38:42.347 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:38:42.347 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:38:43.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:38:42 smithi157 bash[24585]: audit 2024-09-16T07:38:41.910866+0000 mgr.a (mgr.14373) 5262 : audit [DBG] from='client.123045 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:38:43.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:38:42 smithi086 bash[24289]: audit 2024-09-16T07:38:41.910866+0000 mgr.a (mgr.14373) 5262 : audit [DBG] from='client.123045 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:38:43.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:38:42 smithi047 bash[22744]: audit 2024-09-16T07:38:41.910866+0000 mgr.a (mgr.14373) 5262 : audit [DBG] from='client.123045 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:38:44.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:38:43 smithi157 bash[24585]: cluster 2024-09-16T07:38:42.843873+0000 mgr.a (mgr.14373) 5263 : cluster [DBG] pgmap v3649: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:38:44.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:38:43 smithi086 bash[24289]: cluster 2024-09-16T07:38:42.843873+0000 mgr.a (mgr.14373) 5263 : cluster [DBG] pgmap v3649: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:38:44.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:38:43 smithi047 bash[22744]: cluster 2024-09-16T07:38:42.843873+0000 mgr.a (mgr.14373) 5263 : cluster [DBG] pgmap v3649: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:38:46.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:38:45 smithi157 bash[24585]: cluster 2024-09-16T07:38:44.844615+0000 mgr.a (mgr.14373) 5264 : cluster [DBG] pgmap v3650: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:38:46.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:38:45 smithi086 bash[24289]: cluster 2024-09-16T07:38:44.844615+0000 mgr.a (mgr.14373) 5264 : cluster [DBG] pgmap v3650: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:38:46.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:38:45 smithi047 bash[22744]: cluster 2024-09-16T07:38:44.844615+0000 mgr.a (mgr.14373) 5264 : cluster [DBG] pgmap v3650: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:38:47.349 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:38:47.349 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:38:47.349 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:38:48.103 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:38:48.104 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:38:48.104 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:38:48.104 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:38:48.104 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:38:48.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:38:47 smithi157 bash[24585]: cluster 2024-09-16T07:38:46.846553+0000 mgr.a (mgr.14373) 5265 : cluster [DBG] pgmap v3651: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:38:48.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:38:47 smithi086 bash[24289]: cluster 2024-09-16T07:38:46.846553+0000 mgr.a (mgr.14373) 5265 : cluster [DBG] pgmap v3651: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:38:48.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:38:47 smithi047 bash[22744]: cluster 2024-09-16T07:38:46.846553+0000 mgr.a (mgr.14373) 5265 : cluster [DBG] pgmap v3651: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:38:49.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:38:48 smithi157 bash[24585]: audit 2024-09-16T07:38:47.685697+0000 mgr.a (mgr.14373) 5266 : audit [DBG] from='client.123120 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:38:49.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:38:48 smithi086 bash[24289]: audit 2024-09-16T07:38:47.685697+0000 mgr.a (mgr.14373) 5266 : audit [DBG] from='client.123120 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:38:49.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:38:48 smithi047 bash[22744]: audit 2024-09-16T07:38:47.685697+0000 mgr.a (mgr.14373) 5266 : audit [DBG] from='client.123120 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:38:50.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:38:49 smithi157 bash[24585]: cluster 2024-09-16T07:38:48.847380+0000 mgr.a (mgr.14373) 5267 : cluster [DBG] pgmap v3652: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:38:50.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:38:49 smithi086 bash[24289]: cluster 2024-09-16T07:38:48.847380+0000 mgr.a (mgr.14373) 5267 : cluster [DBG] pgmap v3652: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:38:50.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:38:49 smithi047 bash[22744]: cluster 2024-09-16T07:38:48.847380+0000 mgr.a (mgr.14373) 5267 : cluster [DBG] pgmap v3652: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:38:52.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:38:51 smithi157 bash[24585]: cluster 2024-09-16T07:38:50.848162+0000 mgr.a (mgr.14373) 5268 : cluster [DBG] pgmap v3653: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:38:52.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:38:51 smithi086 bash[24289]: cluster 2024-09-16T07:38:50.848162+0000 mgr.a (mgr.14373) 5268 : cluster [DBG] pgmap v3653: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:38:52.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:38:51 smithi047 bash[22744]: cluster 2024-09-16T07:38:50.848162+0000 mgr.a (mgr.14373) 5268 : cluster [DBG] pgmap v3653: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:38:53.105 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:38:53.106 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:38:53.106 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:38:53.886 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:38:53.887 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:38:53.887 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:38:53.887 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:38:53.887 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:38:54.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:38:53 smithi157 bash[24585]: cluster 2024-09-16T07:38:52.850523+0000 mgr.a (mgr.14373) 5269 : cluster [DBG] pgmap v3654: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:38:54.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:38:53 smithi086 bash[24289]: cluster 2024-09-16T07:38:52.850523+0000 mgr.a (mgr.14373) 5269 : cluster [DBG] pgmap v3654: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:38:54.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:38:53 smithi047 bash[22744]: cluster 2024-09-16T07:38:52.850523+0000 mgr.a (mgr.14373) 5269 : cluster [DBG] pgmap v3654: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:38:55.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:38:54 smithi157 bash[24585]: audit 2024-09-16T07:38:53.443188+0000 mgr.a (mgr.14373) 5270 : audit [DBG] from='client.123195 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:38:55.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:38:54 smithi086 bash[24289]: audit 2024-09-16T07:38:53.443188+0000 mgr.a (mgr.14373) 5270 : audit [DBG] from='client.123195 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:38:55.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:38:54 smithi047 bash[22744]: audit 2024-09-16T07:38:53.443188+0000 mgr.a (mgr.14373) 5270 : audit [DBG] from='client.123195 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:38:56.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:38:55 smithi157 bash[24585]: cluster 2024-09-16T07:38:54.851477+0000 mgr.a (mgr.14373) 5271 : cluster [DBG] pgmap v3655: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:38:56.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:38:55 smithi086 bash[24289]: cluster 2024-09-16T07:38:54.851477+0000 mgr.a (mgr.14373) 5271 : cluster [DBG] pgmap v3655: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:38:56.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:38:55 smithi047 bash[22744]: cluster 2024-09-16T07:38:54.851477+0000 mgr.a (mgr.14373) 5271 : cluster [DBG] pgmap v3655: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:38:58.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:38:57 smithi157 bash[24585]: cluster 2024-09-16T07:38:56.853716+0000 mgr.a (mgr.14373) 5272 : cluster [DBG] pgmap v3656: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:38:58.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:38:57 smithi086 bash[24289]: cluster 2024-09-16T07:38:56.853716+0000 mgr.a (mgr.14373) 5272 : cluster [DBG] pgmap v3656: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:38:58.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:38:57 smithi047 bash[22744]: cluster 2024-09-16T07:38:56.853716+0000 mgr.a (mgr.14373) 5272 : cluster [DBG] pgmap v3656: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:38:58.888 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:38:58.889 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:38:58.889 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:38:59.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:38:59 smithi157 bash[24585]: cluster 2024-09-16T07:38:58.854533+0000 mgr.a (mgr.14373) 5273 : cluster [DBG] pgmap v3657: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:38:59.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:38:59 smithi086 bash[24289]: cluster 2024-09-16T07:38:58.854533+0000 mgr.a (mgr.14373) 5273 : cluster [DBG] pgmap v3657: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:38:59.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:38:59 smithi047 bash[22744]: cluster 2024-09-16T07:38:58.854533+0000 mgr.a (mgr.14373) 5273 : cluster [DBG] pgmap v3657: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:38:59.637 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:38:59.637 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:38:59.637 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:38:59.637 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:38:59.637 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:39:00.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:39:00 smithi157 bash[24585]: audit 2024-09-16T07:38:59.221756+0000 mgr.a (mgr.14373) 5274 : audit [DBG] from='client.123273 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:39:00.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:39:00 smithi086 bash[24289]: audit 2024-09-16T07:38:59.221756+0000 mgr.a (mgr.14373) 5274 : audit [DBG] from='client.123273 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:39:00.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:39:00 smithi047 bash[22744]: audit 2024-09-16T07:38:59.221756+0000 mgr.a (mgr.14373) 5274 : audit [DBG] from='client.123273 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:39:01.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:39:01 smithi157 bash[24585]: cluster 2024-09-16T07:39:00.855513+0000 mgr.a (mgr.14373) 5275 : cluster [DBG] pgmap v3658: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:39:01.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:39:01 smithi086 bash[24289]: cluster 2024-09-16T07:39:00.855513+0000 mgr.a (mgr.14373) 5275 : cluster [DBG] pgmap v3658: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:39:01.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:39:01 smithi047 bash[22744]: cluster 2024-09-16T07:39:00.855513+0000 mgr.a (mgr.14373) 5275 : cluster [DBG] pgmap v3658: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:39:04.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:39:03 smithi157 bash[24585]: cluster 2024-09-16T07:39:02.857764+0000 mgr.a (mgr.14373) 5276 : cluster [DBG] pgmap v3659: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:39:04.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:39:03 smithi086 bash[24289]: cluster 2024-09-16T07:39:02.857764+0000 mgr.a (mgr.14373) 5276 : cluster [DBG] pgmap v3659: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:39:04.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:39:03 smithi047 bash[22744]: cluster 2024-09-16T07:39:02.857764+0000 mgr.a (mgr.14373) 5276 : cluster [DBG] pgmap v3659: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:39:04.638 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:39:04.639 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:39:04.639 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:39:05.380 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:39:05.381 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:39:05.381 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:39:05.381 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:39:05.381 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:39:06.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:39:05 smithi157 bash[24585]: cluster 2024-09-16T07:39:04.858503+0000 mgr.a (mgr.14373) 5277 : cluster [DBG] pgmap v3660: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:39:06.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:39:05 smithi086 bash[24289]: cluster 2024-09-16T07:39:04.858503+0000 mgr.a (mgr.14373) 5277 : cluster [DBG] pgmap v3660: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:39:06.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:39:05 smithi047 bash[22744]: cluster 2024-09-16T07:39:04.858503+0000 mgr.a (mgr.14373) 5277 : cluster [DBG] pgmap v3660: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:39:07.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:39:06 smithi157 bash[24585]: audit 2024-09-16T07:39:04.971451+0000 mgr.a (mgr.14373) 5278 : audit [DBG] from='client.123351 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:39:07.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:39:06 smithi086 bash[24289]: audit 2024-09-16T07:39:04.971451+0000 mgr.a (mgr.14373) 5278 : audit [DBG] from='client.123351 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:39:07.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:39:06 smithi047 bash[22744]: audit 2024-09-16T07:39:04.971451+0000 mgr.a (mgr.14373) 5278 : audit [DBG] from='client.123351 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:39:08.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:39:07 smithi157 bash[24585]: cluster 2024-09-16T07:39:06.860716+0000 mgr.a (mgr.14373) 5279 : cluster [DBG] pgmap v3661: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:39:08.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:39:07 smithi086 bash[24289]: cluster 2024-09-16T07:39:06.860716+0000 mgr.a (mgr.14373) 5279 : cluster [DBG] pgmap v3661: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:39:08.340 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:39:07 smithi047 bash[22744]: cluster 2024-09-16T07:39:06.860716+0000 mgr.a (mgr.14373) 5279 : cluster [DBG] pgmap v3661: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:39:10.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:39:09 smithi157 bash[24585]: cluster 2024-09-16T07:39:08.861474+0000 mgr.a (mgr.14373) 5280 : cluster [DBG] pgmap v3662: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:39:10.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:39:09 smithi086 bash[24289]: cluster 2024-09-16T07:39:08.861474+0000 mgr.a (mgr.14373) 5280 : cluster [DBG] pgmap v3662: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:39:10.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:39:09 smithi047 bash[22744]: cluster 2024-09-16T07:39:08.861474+0000 mgr.a (mgr.14373) 5280 : cluster [DBG] pgmap v3662: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:39:10.382 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:39:10.383 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:39:10.383 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:39:11.155 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:39:11.155 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:39:11.155 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:39:11.155 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:39:11.155 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:39:12.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:39:11 smithi157 bash[24585]: audit 2024-09-16T07:39:10.716627+0000 mgr.a (mgr.14373) 5281 : audit [DBG] from='client.123429 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:39:12.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:39:11 smithi157 bash[24585]: cluster 2024-09-16T07:39:10.862291+0000 mgr.a (mgr.14373) 5282 : cluster [DBG] pgmap v3663: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:39:12.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:39:11 smithi086 bash[24289]: audit 2024-09-16T07:39:10.716627+0000 mgr.a (mgr.14373) 5281 : audit [DBG] from='client.123429 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:39:12.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:39:11 smithi086 bash[24289]: cluster 2024-09-16T07:39:10.862291+0000 mgr.a (mgr.14373) 5282 : cluster [DBG] pgmap v3663: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:39:12.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:39:11 smithi047 bash[22744]: audit 2024-09-16T07:39:10.716627+0000 mgr.a (mgr.14373) 5281 : audit [DBG] from='client.123429 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:39:12.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:39:11 smithi047 bash[22744]: cluster 2024-09-16T07:39:10.862291+0000 mgr.a (mgr.14373) 5282 : cluster [DBG] pgmap v3663: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:39:14.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:39:13 smithi157 bash[24585]: cluster 2024-09-16T07:39:12.864673+0000 mgr.a (mgr.14373) 5283 : cluster [DBG] pgmap v3664: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:39:14.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:39:13 smithi157 bash[24585]: audit 2024-09-16T07:39:13.121666+0000 mon.b (mon.2) 514 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T07:39:14.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:39:13 smithi157 bash[24585]: audit 2024-09-16T07:39:13.739085+0000 mon.a (mon.0) 880 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:39:14.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:39:13 smithi157 bash[24585]: audit 2024-09-16T07:39:13.747094+0000 mon.a (mon.0) 881 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:39:14.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:39:13 smithi157 bash[24585]: audit 2024-09-16T07:39:13.757546+0000 mon.a (mon.0) 882 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:39:14.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:39:13 smithi157 bash[24585]: audit 2024-09-16T07:39:13.764813+0000 mon.a (mon.0) 883 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:39:14.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:39:13 smithi086 bash[24289]: cluster 2024-09-16T07:39:12.864673+0000 mgr.a (mgr.14373) 5283 : cluster [DBG] pgmap v3664: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:39:14.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:39:13 smithi086 bash[24289]: audit 2024-09-16T07:39:13.121666+0000 mon.b (mon.2) 514 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T07:39:14.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:39:13 smithi086 bash[24289]: audit 2024-09-16T07:39:13.739085+0000 mon.a (mon.0) 880 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:39:14.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:39:13 smithi086 bash[24289]: audit 2024-09-16T07:39:13.747094+0000 mon.a (mon.0) 881 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:39:14.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:39:13 smithi086 bash[24289]: audit 2024-09-16T07:39:13.757546+0000 mon.a (mon.0) 882 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:39:14.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:39:13 smithi086 bash[24289]: audit 2024-09-16T07:39:13.764813+0000 mon.a (mon.0) 883 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:39:14.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:39:13 smithi047 bash[22744]: cluster 2024-09-16T07:39:12.864673+0000 mgr.a (mgr.14373) 5283 : cluster [DBG] pgmap v3664: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:39:14.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:39:13 smithi047 bash[22744]: audit 2024-09-16T07:39:13.121666+0000 mon.b (mon.2) 514 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T07:39:14.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:39:13 smithi047 bash[22744]: audit 2024-09-16T07:39:13.739085+0000 mon.a (mon.0) 880 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:39:14.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:39:13 smithi047 bash[22744]: audit 2024-09-16T07:39:13.747094+0000 mon.a (mon.0) 881 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:39:14.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:39:13 smithi047 bash[22744]: audit 2024-09-16T07:39:13.757546+0000 mon.a (mon.0) 882 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:39:14.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:39:13 smithi047 bash[22744]: audit 2024-09-16T07:39:13.764813+0000 mon.a (mon.0) 883 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:39:16.156 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:39:16.156 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:39:16.157 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:39:16.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:39:15 smithi157 bash[24585]: cluster 2024-09-16T07:39:14.865564+0000 mgr.a (mgr.14373) 5284 : cluster [DBG] pgmap v3665: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:39:16.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:39:15 smithi086 bash[24289]: cluster 2024-09-16T07:39:14.865564+0000 mgr.a (mgr.14373) 5284 : cluster [DBG] pgmap v3665: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:39:16.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:39:15 smithi047 bash[22744]: cluster 2024-09-16T07:39:14.865564+0000 mgr.a (mgr.14373) 5284 : cluster [DBG] pgmap v3665: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:39:16.901 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:39:16.902 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:39:16.902 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:39:16.902 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:39:16.902 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:39:18.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:39:17 smithi157 bash[24585]: audit 2024-09-16T07:39:16.490469+0000 mgr.a (mgr.14373) 5285 : audit [DBG] from='client.123507 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:39:18.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:39:17 smithi157 bash[24585]: cluster 2024-09-16T07:39:16.867079+0000 mgr.a (mgr.14373) 5286 : cluster [DBG] pgmap v3666: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:39:18.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:39:17 smithi086 bash[24289]: audit 2024-09-16T07:39:16.490469+0000 mgr.a (mgr.14373) 5285 : audit [DBG] from='client.123507 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:39:18.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:39:17 smithi086 bash[24289]: cluster 2024-09-16T07:39:16.867079+0000 mgr.a (mgr.14373) 5286 : cluster [DBG] pgmap v3666: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:39:18.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:39:17 smithi047 bash[22744]: audit 2024-09-16T07:39:16.490469+0000 mgr.a (mgr.14373) 5285 : audit [DBG] from='client.123507 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:39:18.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:39:17 smithi047 bash[22744]: cluster 2024-09-16T07:39:16.867079+0000 mgr.a (mgr.14373) 5286 : cluster [DBG] pgmap v3666: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:39:20.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:39:19 smithi157 bash[24585]: cluster 2024-09-16T07:39:18.867831+0000 mgr.a (mgr.14373) 5287 : cluster [DBG] pgmap v3667: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:39:20.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:39:19 smithi086 bash[24289]: cluster 2024-09-16T07:39:18.867831+0000 mgr.a (mgr.14373) 5287 : cluster [DBG] pgmap v3667: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:39:20.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:39:19 smithi047 bash[22744]: cluster 2024-09-16T07:39:18.867831+0000 mgr.a (mgr.14373) 5287 : cluster [DBG] pgmap v3667: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:39:21.903 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:39:21.904 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:39:21.904 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:39:22.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:39:21 smithi157 bash[24585]: cluster 2024-09-16T07:39:20.868621+0000 mgr.a (mgr.14373) 5288 : cluster [DBG] pgmap v3668: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T07:39:22.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:39:21 smithi086 bash[24289]: cluster 2024-09-16T07:39:20.868621+0000 mgr.a (mgr.14373) 5288 : cluster [DBG] pgmap v3668: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T07:39:22.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:39:21 smithi047 bash[22744]: cluster 2024-09-16T07:39:20.868621+0000 mgr.a (mgr.14373) 5288 : cluster [DBG] pgmap v3668: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T07:39:22.678 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:39:22.678 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:39:22.678 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:39:22.678 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:39:22.678 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:39:24.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:39:23 smithi157 bash[24585]: audit 2024-09-16T07:39:22.242717+0000 mgr.a (mgr.14373) 5289 : audit [DBG] from='client.123585 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:39:24.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:39:23 smithi157 bash[24585]: cluster 2024-09-16T07:39:22.871262+0000 mgr.a (mgr.14373) 5290 : cluster [DBG] pgmap v3669: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:39:24.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:39:23 smithi157 bash[24585]: audit 2024-09-16T07:39:23.844811+0000 mon.a (mon.0) 884 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:39:24.305 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:39:23 smithi157 bash[24585]: audit 2024-09-16T07:39:23.855407+0000 mon.a (mon.0) 885 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:39:24.305 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:39:23 smithi157 bash[24585]: audit 2024-09-16T07:39:23.857569+0000 mon.b (mon.2) 515 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T07:39:24.305 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:39:23 smithi157 bash[24585]: audit 2024-09-16T07:39:23.859965+0000 mon.b (mon.2) 516 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T07:39:24.305 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:39:23 smithi157 bash[24585]: audit 2024-09-16T07:39:23.873147+0000 mon.a (mon.0) 886 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:39:24.305 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:39:23 smithi157 bash[24585]: audit 2024-09-16T07:39:23.877498+0000 mon.b (mon.2) 517 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:39:24.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:39:23 smithi086 bash[24289]: audit 2024-09-16T07:39:22.242717+0000 mgr.a (mgr.14373) 5289 : audit [DBG] from='client.123585 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:39:24.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:39:23 smithi086 bash[24289]: cluster 2024-09-16T07:39:22.871262+0000 mgr.a (mgr.14373) 5290 : cluster [DBG] pgmap v3669: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:39:24.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:39:23 smithi086 bash[24289]: audit 2024-09-16T07:39:23.844811+0000 mon.a (mon.0) 884 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:39:24.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:39:23 smithi086 bash[24289]: audit 2024-09-16T07:39:23.855407+0000 mon.a (mon.0) 885 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:39:24.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:39:23 smithi086 bash[24289]: audit 2024-09-16T07:39:23.857569+0000 mon.b (mon.2) 515 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T07:39:24.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:39:23 smithi086 bash[24289]: audit 2024-09-16T07:39:23.859965+0000 mon.b (mon.2) 516 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T07:39:24.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:39:23 smithi086 bash[24289]: audit 2024-09-16T07:39:23.873147+0000 mon.a (mon.0) 886 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:39:24.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:39:23 smithi086 bash[24289]: audit 2024-09-16T07:39:23.877498+0000 mon.b (mon.2) 517 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:39:24.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:39:23 smithi047 bash[22744]: audit 2024-09-16T07:39:22.242717+0000 mgr.a (mgr.14373) 5289 : audit [DBG] from='client.123585 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:39:24.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:39:23 smithi047 bash[22744]: cluster 2024-09-16T07:39:22.871262+0000 mgr.a (mgr.14373) 5290 : cluster [DBG] pgmap v3669: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:39:24.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:39:23 smithi047 bash[22744]: audit 2024-09-16T07:39:23.844811+0000 mon.a (mon.0) 884 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:39:24.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:39:23 smithi047 bash[22744]: audit 2024-09-16T07:39:23.855407+0000 mon.a (mon.0) 885 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:39:24.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:39:23 smithi047 bash[22744]: audit 2024-09-16T07:39:23.857569+0000 mon.b (mon.2) 515 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T07:39:24.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:39:23 smithi047 bash[22744]: audit 2024-09-16T07:39:23.859965+0000 mon.b (mon.2) 516 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T07:39:24.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:39:23 smithi047 bash[22744]: audit 2024-09-16T07:39:23.873147+0000 mon.a (mon.0) 886 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:39:24.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:39:23 smithi047 bash[22744]: audit 2024-09-16T07:39:23.877498+0000 mon.b (mon.2) 517 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:39:24.962 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 07:39:24 smithi047 bash[22994]: debug 2024-09-16T07:39:24.629+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T07:39:24.962 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 07:39:24 smithi047 bash[22994]: debug 2024-09-16T07:39:24.633+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T07:39:25.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:39:24 smithi157 bash[24585]: audit 2024-09-16T07:39:23.881286+0000 mgr.a (mgr.14373) 5291 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:39:25.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:39:24 smithi086 bash[24289]: audit 2024-09-16T07:39:23.881286+0000 mgr.a (mgr.14373) 5291 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:39:25.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:39:24 smithi047 bash[22744]: audit 2024-09-16T07:39:23.881286+0000 mgr.a (mgr.14373) 5291 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:39:26.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:39:25 smithi157 bash[24585]: audit 2024-09-16T07:39:24.633477+0000 mgr.a (mgr.14373) 5292 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T07:39:26.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:39:25 smithi157 bash[24585]: cephadm 2024-09-16T07:39:24.636093+0000 mgr.a (mgr.14373) 5293 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T07:39:26.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:39:25 smithi157 bash[24585]: cluster 2024-09-16T07:39:24.872192+0000 mgr.a (mgr.14373) 5294 : cluster [DBG] pgmap v3670: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:39:26.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:39:25 smithi086 bash[24289]: audit 2024-09-16T07:39:24.633477+0000 mgr.a (mgr.14373) 5292 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T07:39:26.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:39:25 smithi086 bash[24289]: cephadm 2024-09-16T07:39:24.636093+0000 mgr.a (mgr.14373) 5293 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T07:39:26.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:39:25 smithi086 bash[24289]: cluster 2024-09-16T07:39:24.872192+0000 mgr.a (mgr.14373) 5294 : cluster [DBG] pgmap v3670: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:39:26.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:39:25 smithi047 bash[22744]: audit 2024-09-16T07:39:24.633477+0000 mgr.a (mgr.14373) 5292 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T07:39:26.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:39:25 smithi047 bash[22744]: cephadm 2024-09-16T07:39:24.636093+0000 mgr.a (mgr.14373) 5293 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T07:39:26.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:39:25 smithi047 bash[22744]: cluster 2024-09-16T07:39:24.872192+0000 mgr.a (mgr.14373) 5294 : cluster [DBG] pgmap v3670: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:39:27.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:39:26 smithi157 bash[24585]: cluster 2024-09-16T07:39:26.874338+0000 mgr.a (mgr.14373) 5295 : cluster [DBG] pgmap v3671: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:39:27.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:39:26 smithi086 bash[24289]: cluster 2024-09-16T07:39:26.874338+0000 mgr.a (mgr.14373) 5295 : cluster [DBG] pgmap v3671: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:39:27.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:39:26 smithi047 bash[22744]: cluster 2024-09-16T07:39:26.874338+0000 mgr.a (mgr.14373) 5295 : cluster [DBG] pgmap v3671: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:39:27.679 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:39:27.680 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:39:27.680 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:39:28.446 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:39:28.446 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:39:28.446 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:39:28.446 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:39:28.446 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:39:30.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:39:29 smithi157 bash[24585]: audit 2024-09-16T07:39:28.023112+0000 mgr.a (mgr.14373) 5296 : audit [DBG] from='client.123768 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:39:30.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:39:29 smithi157 bash[24585]: cluster 2024-09-16T07:39:28.875271+0000 mgr.a (mgr.14373) 5297 : cluster [DBG] pgmap v3672: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:39:30.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:39:29 smithi086 bash[24289]: audit 2024-09-16T07:39:28.023112+0000 mgr.a (mgr.14373) 5296 : audit [DBG] from='client.123768 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:39:30.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:39:29 smithi086 bash[24289]: cluster 2024-09-16T07:39:28.875271+0000 mgr.a (mgr.14373) 5297 : cluster [DBG] pgmap v3672: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:39:30.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:39:29 smithi047 bash[22744]: audit 2024-09-16T07:39:28.023112+0000 mgr.a (mgr.14373) 5296 : audit [DBG] from='client.123768 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:39:30.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:39:29 smithi047 bash[22744]: cluster 2024-09-16T07:39:28.875271+0000 mgr.a (mgr.14373) 5297 : cluster [DBG] pgmap v3672: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:39:32.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:39:31 smithi157 bash[24585]: cluster 2024-09-16T07:39:30.876093+0000 mgr.a (mgr.14373) 5298 : cluster [DBG] pgmap v3673: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:39:32.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:39:31 smithi086 bash[24289]: cluster 2024-09-16T07:39:30.876093+0000 mgr.a (mgr.14373) 5298 : cluster [DBG] pgmap v3673: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:39:32.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:39:31 smithi047 bash[22744]: cluster 2024-09-16T07:39:30.876093+0000 mgr.a (mgr.14373) 5298 : cluster [DBG] pgmap v3673: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:39:33.447 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:39:33.448 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:39:33.448 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:39:34.209 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:39:34.209 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:39:34.210 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:39:34.210 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:39:34.210 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:39:34.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:39:33 smithi157 bash[24585]: cluster 2024-09-16T07:39:32.878318+0000 mgr.a (mgr.14373) 5299 : cluster [DBG] pgmap v3674: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:39:34.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:39:33 smithi086 bash[24289]: cluster 2024-09-16T07:39:32.878318+0000 mgr.a (mgr.14373) 5299 : cluster [DBG] pgmap v3674: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:39:34.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:39:33 smithi047 bash[22744]: cluster 2024-09-16T07:39:32.878318+0000 mgr.a (mgr.14373) 5299 : cluster [DBG] pgmap v3674: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:39:35.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:39:34 smithi157 bash[24585]: audit 2024-09-16T07:39:33.783672+0000 mgr.a (mgr.14373) 5300 : audit [DBG] from='client.123846 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:39:35.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:39:34 smithi086 bash[24289]: audit 2024-09-16T07:39:33.783672+0000 mgr.a (mgr.14373) 5300 : audit [DBG] from='client.123846 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:39:35.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:39:34 smithi047 bash[22744]: audit 2024-09-16T07:39:33.783672+0000 mgr.a (mgr.14373) 5300 : audit [DBG] from='client.123846 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:39:36.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:39:35 smithi157 bash[24585]: cluster 2024-09-16T07:39:34.879251+0000 mgr.a (mgr.14373) 5301 : cluster [DBG] pgmap v3675: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:39:36.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:39:35 smithi086 bash[24289]: cluster 2024-09-16T07:39:34.879251+0000 mgr.a (mgr.14373) 5301 : cluster [DBG] pgmap v3675: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:39:36.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:39:35 smithi047 bash[22744]: cluster 2024-09-16T07:39:34.879251+0000 mgr.a (mgr.14373) 5301 : cluster [DBG] pgmap v3675: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:39:38.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:39:37 smithi157 bash[24585]: cluster 2024-09-16T07:39:36.881444+0000 mgr.a (mgr.14373) 5302 : cluster [DBG] pgmap v3676: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:39:38.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:39:37 smithi086 bash[24289]: cluster 2024-09-16T07:39:36.881444+0000 mgr.a (mgr.14373) 5302 : cluster [DBG] pgmap v3676: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:39:38.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:39:37 smithi047 bash[22744]: cluster 2024-09-16T07:39:36.881444+0000 mgr.a (mgr.14373) 5302 : cluster [DBG] pgmap v3676: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:39:39.211 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:39:39.212 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:39:39.212 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:39:39.960 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:39:39.960 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:39:39.961 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:39:39.961 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:39:39.961 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:39:40.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:39:39 smithi157 bash[24585]: cluster 2024-09-16T07:39:38.882221+0000 mgr.a (mgr.14373) 5303 : cluster [DBG] pgmap v3677: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:39:40.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:39:39 smithi086 bash[24289]: cluster 2024-09-16T07:39:38.882221+0000 mgr.a (mgr.14373) 5303 : cluster [DBG] pgmap v3677: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:39:40.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:39:39 smithi047 bash[22744]: cluster 2024-09-16T07:39:38.882221+0000 mgr.a (mgr.14373) 5303 : cluster [DBG] pgmap v3677: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:39:41.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:39:40 smithi157 bash[24585]: audit 2024-09-16T07:39:39.547585+0000 mgr.a (mgr.14373) 5304 : audit [DBG] from='client.123921 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:39:41.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:39:40 smithi086 bash[24289]: audit 2024-09-16T07:39:39.547585+0000 mgr.a (mgr.14373) 5304 : audit [DBG] from='client.123921 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:39:41.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:39:40 smithi047 bash[22744]: audit 2024-09-16T07:39:39.547585+0000 mgr.a (mgr.14373) 5304 : audit [DBG] from='client.123921 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:39:42.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:39:41 smithi157 bash[24585]: cluster 2024-09-16T07:39:40.883157+0000 mgr.a (mgr.14373) 5305 : cluster [DBG] pgmap v3678: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:39:42.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:39:41 smithi086 bash[24289]: cluster 2024-09-16T07:39:40.883157+0000 mgr.a (mgr.14373) 5305 : cluster [DBG] pgmap v3678: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:39:42.340 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:39:41 smithi047 bash[22744]: cluster 2024-09-16T07:39:40.883157+0000 mgr.a (mgr.14373) 5305 : cluster [DBG] pgmap v3678: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:39:43.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:39:42 smithi157 bash[24585]: cluster 2024-09-16T07:39:42.885497+0000 mgr.a (mgr.14373) 5306 : cluster [DBG] pgmap v3679: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:39:43.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:39:42 smithi086 bash[24289]: cluster 2024-09-16T07:39:42.885497+0000 mgr.a (mgr.14373) 5306 : cluster [DBG] pgmap v3679: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:39:43.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:39:42 smithi047 bash[22744]: cluster 2024-09-16T07:39:42.885497+0000 mgr.a (mgr.14373) 5306 : cluster [DBG] pgmap v3679: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:39:44.962 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:39:44.962 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:39:44.963 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:39:45.709 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:39:45.709 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:39:45.710 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:39:45.710 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:39:45.710 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:39:46.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:39:45 smithi157 bash[24585]: cluster 2024-09-16T07:39:44.886445+0000 mgr.a (mgr.14373) 5307 : cluster [DBG] pgmap v3680: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:39:46.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:39:45 smithi086 bash[24289]: cluster 2024-09-16T07:39:44.886445+0000 mgr.a (mgr.14373) 5307 : cluster [DBG] pgmap v3680: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:39:46.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:39:45 smithi047 bash[22744]: cluster 2024-09-16T07:39:44.886445+0000 mgr.a (mgr.14373) 5307 : cluster [DBG] pgmap v3680: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:39:47.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:39:46 smithi157 bash[24585]: audit 2024-09-16T07:39:45.292279+0000 mgr.a (mgr.14373) 5308 : audit [DBG] from='client.123993 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:39:47.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:39:46 smithi086 bash[24289]: audit 2024-09-16T07:39:45.292279+0000 mgr.a (mgr.14373) 5308 : audit [DBG] from='client.123993 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:39:47.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:39:46 smithi047 bash[22744]: audit 2024-09-16T07:39:45.292279+0000 mgr.a (mgr.14373) 5308 : audit [DBG] from='client.123993 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:39:48.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:39:47 smithi157 bash[24585]: cluster 2024-09-16T07:39:46.888754+0000 mgr.a (mgr.14373) 5309 : cluster [DBG] pgmap v3681: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:39:48.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:39:47 smithi086 bash[24289]: cluster 2024-09-16T07:39:46.888754+0000 mgr.a (mgr.14373) 5309 : cluster [DBG] pgmap v3681: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:39:48.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:39:47 smithi047 bash[22744]: cluster 2024-09-16T07:39:46.888754+0000 mgr.a (mgr.14373) 5309 : cluster [DBG] pgmap v3681: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:39:50.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:39:49 smithi157 bash[24585]: cluster 2024-09-16T07:39:48.889532+0000 mgr.a (mgr.14373) 5310 : cluster [DBG] pgmap v3682: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:39:50.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:39:49 smithi086 bash[24289]: cluster 2024-09-16T07:39:48.889532+0000 mgr.a (mgr.14373) 5310 : cluster [DBG] pgmap v3682: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:39:50.340 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:39:49 smithi047 bash[22744]: cluster 2024-09-16T07:39:48.889532+0000 mgr.a (mgr.14373) 5310 : cluster [DBG] pgmap v3682: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:39:50.711 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:39:50.712 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:39:50.712 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:39:51.464 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:39:51.464 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:39:51.464 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:39:51.464 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:39:51.464 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:39:52.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:39:51 smithi157 bash[24585]: cluster 2024-09-16T07:39:50.890250+0000 mgr.a (mgr.14373) 5311 : cluster [DBG] pgmap v3683: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:39:52.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:39:51 smithi086 bash[24289]: cluster 2024-09-16T07:39:50.890250+0000 mgr.a (mgr.14373) 5311 : cluster [DBG] pgmap v3683: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:39:52.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:39:51 smithi047 bash[22744]: cluster 2024-09-16T07:39:50.890250+0000 mgr.a (mgr.14373) 5311 : cluster [DBG] pgmap v3683: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:39:53.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:39:52 smithi157 bash[24585]: audit 2024-09-16T07:39:51.045536+0000 mgr.a (mgr.14373) 5312 : audit [DBG] from='client.124068 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:39:53.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:39:52 smithi086 bash[24289]: audit 2024-09-16T07:39:51.045536+0000 mgr.a (mgr.14373) 5312 : audit [DBG] from='client.124068 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:39:53.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:39:52 smithi047 bash[22744]: audit 2024-09-16T07:39:51.045536+0000 mgr.a (mgr.14373) 5312 : audit [DBG] from='client.124068 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:39:54.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:39:53 smithi157 bash[24585]: cluster 2024-09-16T07:39:52.892617+0000 mgr.a (mgr.14373) 5313 : cluster [DBG] pgmap v3684: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-16T07:39:54.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:39:53 smithi086 bash[24289]: cluster 2024-09-16T07:39:52.892617+0000 mgr.a (mgr.14373) 5313 : cluster [DBG] pgmap v3684: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-16T07:39:54.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:39:53 smithi047 bash[22744]: cluster 2024-09-16T07:39:52.892617+0000 mgr.a (mgr.14373) 5313 : cluster [DBG] pgmap v3684: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-16T07:39:55.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:39:54 smithi157 bash[24585]: cluster 2024-09-16T07:39:54.893398+0000 mgr.a (mgr.14373) 5314 : cluster [DBG] pgmap v3685: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T07:39:55.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:39:54 smithi086 bash[24289]: cluster 2024-09-16T07:39:54.893398+0000 mgr.a (mgr.14373) 5314 : cluster [DBG] pgmap v3685: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T07:39:55.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:39:54 smithi047 bash[22744]: cluster 2024-09-16T07:39:54.893398+0000 mgr.a (mgr.14373) 5314 : cluster [DBG] pgmap v3685: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T07:39:56.469 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:39:56.469 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:39:56.469 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:39:57.248 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:39:57.248 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:39:57.249 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:39:57.249 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:39:57.249 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:39:58.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:39:57 smithi157 bash[24585]: audit 2024-09-16T07:39:56.803124+0000 mgr.a (mgr.14373) 5315 : audit [DBG] from='client.124146 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:39:58.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:39:57 smithi157 bash[24585]: cluster 2024-09-16T07:39:56.894635+0000 mgr.a (mgr.14373) 5316 : cluster [DBG] pgmap v3686: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:39:58.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:39:57 smithi086 bash[24289]: audit 2024-09-16T07:39:56.803124+0000 mgr.a (mgr.14373) 5315 : audit [DBG] from='client.124146 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:39:58.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:39:57 smithi086 bash[24289]: cluster 2024-09-16T07:39:56.894635+0000 mgr.a (mgr.14373) 5316 : cluster [DBG] pgmap v3686: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:39:58.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:39:57 smithi047 bash[22744]: audit 2024-09-16T07:39:56.803124+0000 mgr.a (mgr.14373) 5315 : audit [DBG] from='client.124146 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:39:58.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:39:57 smithi047 bash[22744]: cluster 2024-09-16T07:39:56.894635+0000 mgr.a (mgr.14373) 5316 : cluster [DBG] pgmap v3686: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:40:00.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:39:59 smithi157 bash[24585]: cluster 2024-09-16T07:39:58.895501+0000 mgr.a (mgr.14373) 5317 : cluster [DBG] pgmap v3687: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T07:40:00.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:39:59 smithi086 bash[24289]: cluster 2024-09-16T07:39:58.895501+0000 mgr.a (mgr.14373) 5317 : cluster [DBG] pgmap v3687: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T07:40:00.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:39:59 smithi047 bash[22744]: cluster 2024-09-16T07:39:58.895501+0000 mgr.a (mgr.14373) 5317 : cluster [DBG] pgmap v3687: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T07:40:01.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:40:00 smithi157 bash[24585]: cluster 2024-09-16T07:40:00.000165+0000 mon.a (mon.0) 887 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-16T07:40:01.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:40:00 smithi086 bash[24289]: cluster 2024-09-16T07:40:00.000165+0000 mon.a (mon.0) 887 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-16T07:40:01.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:40:00 smithi047 bash[22744]: cluster 2024-09-16T07:40:00.000165+0000 mon.a (mon.0) 887 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-16T07:40:02.249 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:40:02.250 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:40:02.250 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:40:02.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:40:01 smithi157 bash[24585]: cluster 2024-09-16T07:40:00.896293+0000 mgr.a (mgr.14373) 5318 : cluster [DBG] pgmap v3688: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T07:40:02.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:40:01 smithi086 bash[24289]: cluster 2024-09-16T07:40:00.896293+0000 mgr.a (mgr.14373) 5318 : cluster [DBG] pgmap v3688: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T07:40:02.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:40:01 smithi047 bash[22744]: cluster 2024-09-16T07:40:00.896293+0000 mgr.a (mgr.14373) 5318 : cluster [DBG] pgmap v3688: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T07:40:03.010 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:40:03.011 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:40:03.011 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:40:03.011 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:40:03.011 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:40:04.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:40:03 smithi157 bash[24585]: audit 2024-09-16T07:40:02.581928+0000 mgr.a (mgr.14373) 5319 : audit [DBG] from='client.124221 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:40:04.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:40:03 smithi157 bash[24585]: cluster 2024-09-16T07:40:02.897560+0000 mgr.a (mgr.14373) 5320 : cluster [DBG] pgmap v3689: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:40:04.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:40:03 smithi086 bash[24289]: audit 2024-09-16T07:40:02.581928+0000 mgr.a (mgr.14373) 5319 : audit [DBG] from='client.124221 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:40:04.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:40:03 smithi086 bash[24289]: cluster 2024-09-16T07:40:02.897560+0000 mgr.a (mgr.14373) 5320 : cluster [DBG] pgmap v3689: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:40:04.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:40:03 smithi047 bash[22744]: audit 2024-09-16T07:40:02.581928+0000 mgr.a (mgr.14373) 5319 : audit [DBG] from='client.124221 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:40:04.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:40:03 smithi047 bash[22744]: cluster 2024-09-16T07:40:02.897560+0000 mgr.a (mgr.14373) 5320 : cluster [DBG] pgmap v3689: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:40:06.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:40:05 smithi157 bash[24585]: cluster 2024-09-16T07:40:04.898436+0000 mgr.a (mgr.14373) 5321 : cluster [DBG] pgmap v3690: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-16T07:40:06.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:40:05 smithi086 bash[24289]: cluster 2024-09-16T07:40:04.898436+0000 mgr.a (mgr.14373) 5321 : cluster [DBG] pgmap v3690: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-16T07:40:06.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:40:05 smithi047 bash[22744]: cluster 2024-09-16T07:40:04.898436+0000 mgr.a (mgr.14373) 5321 : cluster [DBG] pgmap v3690: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-16T07:40:07.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:40:06 smithi157 bash[24585]: cluster 2024-09-16T07:40:06.900522+0000 mgr.a (mgr.14373) 5322 : cluster [DBG] pgmap v3691: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-16T07:40:07.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:40:06 smithi086 bash[24289]: cluster 2024-09-16T07:40:06.900522+0000 mgr.a (mgr.14373) 5322 : cluster [DBG] pgmap v3691: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-16T07:40:07.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:40:06 smithi047 bash[22744]: cluster 2024-09-16T07:40:06.900522+0000 mgr.a (mgr.14373) 5322 : cluster [DBG] pgmap v3691: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-16T07:40:08.012 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:40:08.013 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:40:08.013 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:40:08.800 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:40:08.801 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:40:08.801 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:40:08.801 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:40:08.801 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:40:10.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:40:09 smithi157 bash[24585]: audit 2024-09-16T07:40:08.358060+0000 mgr.a (mgr.14373) 5323 : audit [DBG] from='client.124296 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:40:10.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:40:09 smithi157 bash[24585]: cluster 2024-09-16T07:40:08.901464+0000 mgr.a (mgr.14373) 5324 : cluster [DBG] pgmap v3692: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:40:10.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:40:09 smithi086 bash[24289]: audit 2024-09-16T07:40:08.358060+0000 mgr.a (mgr.14373) 5323 : audit [DBG] from='client.124296 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:40:10.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:40:09 smithi086 bash[24289]: cluster 2024-09-16T07:40:08.901464+0000 mgr.a (mgr.14373) 5324 : cluster [DBG] pgmap v3692: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:40:10.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:40:09 smithi047 bash[22744]: audit 2024-09-16T07:40:08.358060+0000 mgr.a (mgr.14373) 5323 : audit [DBG] from='client.124296 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:40:10.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:40:09 smithi047 bash[22744]: cluster 2024-09-16T07:40:08.901464+0000 mgr.a (mgr.14373) 5324 : cluster [DBG] pgmap v3692: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:40:12.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:40:11 smithi157 bash[24585]: cluster 2024-09-16T07:40:10.902250+0000 mgr.a (mgr.14373) 5325 : cluster [DBG] pgmap v3693: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:40:12.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:40:11 smithi086 bash[24289]: cluster 2024-09-16T07:40:10.902250+0000 mgr.a (mgr.14373) 5325 : cluster [DBG] pgmap v3693: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:40:12.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:40:11 smithi047 bash[22744]: cluster 2024-09-16T07:40:10.902250+0000 mgr.a (mgr.14373) 5325 : cluster [DBG] pgmap v3693: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:40:13.802 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:40:13.803 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:40:13.803 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:40:14.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:40:13 smithi157 bash[24585]: cluster 2024-09-16T07:40:12.904516+0000 mgr.a (mgr.14373) 5326 : cluster [DBG] pgmap v3694: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:40:14.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:40:13 smithi086 bash[24289]: cluster 2024-09-16T07:40:12.904516+0000 mgr.a (mgr.14373) 5326 : cluster [DBG] pgmap v3694: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:40:14.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:40:13 smithi047 bash[22744]: cluster 2024-09-16T07:40:12.904516+0000 mgr.a (mgr.14373) 5326 : cluster [DBG] pgmap v3694: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:40:14.548 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:40:14.548 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:40:14.548 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:40:14.548 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:40:14.549 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:40:16.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:40:15 smithi157 bash[24585]: audit 2024-09-16T07:40:14.141968+0000 mgr.a (mgr.14373) 5327 : audit [DBG] from='client.124371 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:40:16.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:40:15 smithi157 bash[24585]: cluster 2024-09-16T07:40:14.905475+0000 mgr.a (mgr.14373) 5328 : cluster [DBG] pgmap v3695: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:40:16.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:40:15 smithi086 bash[24289]: audit 2024-09-16T07:40:14.141968+0000 mgr.a (mgr.14373) 5327 : audit [DBG] from='client.124371 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:40:16.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:40:15 smithi086 bash[24289]: cluster 2024-09-16T07:40:14.905475+0000 mgr.a (mgr.14373) 5328 : cluster [DBG] pgmap v3695: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:40:16.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:40:15 smithi047 bash[22744]: audit 2024-09-16T07:40:14.141968+0000 mgr.a (mgr.14373) 5327 : audit [DBG] from='client.124371 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:40:16.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:40:15 smithi047 bash[22744]: cluster 2024-09-16T07:40:14.905475+0000 mgr.a (mgr.14373) 5328 : cluster [DBG] pgmap v3695: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:40:18.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:40:17 smithi157 bash[24585]: cluster 2024-09-16T07:40:16.907648+0000 mgr.a (mgr.14373) 5329 : cluster [DBG] pgmap v3696: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:40:18.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:40:17 smithi086 bash[24289]: cluster 2024-09-16T07:40:16.907648+0000 mgr.a (mgr.14373) 5329 : cluster [DBG] pgmap v3696: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:40:18.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:40:17 smithi047 bash[22744]: cluster 2024-09-16T07:40:16.907648+0000 mgr.a (mgr.14373) 5329 : cluster [DBG] pgmap v3696: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:40:19.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:40:18 smithi157 bash[24585]: cluster 2024-09-16T07:40:18.908394+0000 mgr.a (mgr.14373) 5330 : cluster [DBG] pgmap v3697: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:40:19.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:40:18 smithi086 bash[24289]: cluster 2024-09-16T07:40:18.908394+0000 mgr.a (mgr.14373) 5330 : cluster [DBG] pgmap v3697: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:40:19.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:40:18 smithi047 bash[22744]: cluster 2024-09-16T07:40:18.908394+0000 mgr.a (mgr.14373) 5330 : cluster [DBG] pgmap v3697: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:40:19.549 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:40:19.550 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:40:19.550 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:40:20.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:40:19 smithi157 bash[24585]: audit 2024-09-16T07:40:19.886575+0000 mgr.a (mgr.14373) 5331 : audit [DBG] from='client.124449 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:40:20.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:40:19 smithi086 bash[24289]: audit 2024-09-16T07:40:19.886575+0000 mgr.a (mgr.14373) 5331 : audit [DBG] from='client.124449 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:40:20.324 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:40:20.324 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:40:20.324 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:40:20.324 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:40:20.324 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:40:20.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:40:19 smithi047 bash[22744]: audit 2024-09-16T07:40:19.886575+0000 mgr.a (mgr.14373) 5331 : audit [DBG] from='client.124449 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:40:21.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:40:20 smithi157 bash[24585]: cluster 2024-09-16T07:40:20.909357+0000 mgr.a (mgr.14373) 5332 : cluster [DBG] pgmap v3698: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:40:21.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:40:20 smithi086 bash[24289]: cluster 2024-09-16T07:40:20.909357+0000 mgr.a (mgr.14373) 5332 : cluster [DBG] pgmap v3698: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:40:21.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:40:20 smithi047 bash[22744]: cluster 2024-09-16T07:40:20.909357+0000 mgr.a (mgr.14373) 5332 : cluster [DBG] pgmap v3698: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:40:24.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:40:23 smithi157 bash[24585]: cluster 2024-09-16T07:40:22.911632+0000 mgr.a (mgr.14373) 5333 : cluster [DBG] pgmap v3699: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:40:24.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:40:23 smithi086 bash[24289]: cluster 2024-09-16T07:40:22.911632+0000 mgr.a (mgr.14373) 5333 : cluster [DBG] pgmap v3699: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:40:24.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:40:23 smithi047 bash[22744]: cluster 2024-09-16T07:40:22.911632+0000 mgr.a (mgr.14373) 5333 : cluster [DBG] pgmap v3699: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:40:25.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:40:24 smithi157 bash[24585]: audit 2024-09-16T07:40:24.688981+0000 mon.b (mon.2) 518 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T07:40:25.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:40:24 smithi086 bash[24289]: audit 2024-09-16T07:40:24.688981+0000 mon.b (mon.2) 518 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T07:40:25.325 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:40:25.326 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:40:25.326 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:40:25.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:40:24 smithi047 bash[22744]: audit 2024-09-16T07:40:24.688981+0000 mon.b (mon.2) 518 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T07:40:26.089 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:40:26.089 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:40:26.089 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:40:26.089 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:40:26.090 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:40:26.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:40:25 smithi157 bash[24585]: cluster 2024-09-16T07:40:24.912375+0000 mgr.a (mgr.14373) 5334 : cluster [DBG] pgmap v3700: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:40:26.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:40:25 smithi157 bash[24585]: audit 2024-09-16T07:40:25.650409+0000 mgr.a (mgr.14373) 5335 : audit [DBG] from='client.124524 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:40:26.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:40:25 smithi086 bash[24289]: cluster 2024-09-16T07:40:24.912375+0000 mgr.a (mgr.14373) 5334 : cluster [DBG] pgmap v3700: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:40:26.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:40:25 smithi086 bash[24289]: audit 2024-09-16T07:40:25.650409+0000 mgr.a (mgr.14373) 5335 : audit [DBG] from='client.124524 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:40:26.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:40:25 smithi047 bash[22744]: cluster 2024-09-16T07:40:24.912375+0000 mgr.a (mgr.14373) 5334 : cluster [DBG] pgmap v3700: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:40:26.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:40:25 smithi047 bash[22744]: audit 2024-09-16T07:40:25.650409+0000 mgr.a (mgr.14373) 5335 : audit [DBG] from='client.124524 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:40:27.089 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 07:40:26 smithi047 bash[22994]: debug 2024-09-16T07:40:26.824+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T07:40:27.089 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 07:40:26 smithi047 bash[22994]: debug 2024-09-16T07:40:26.824+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T07:40:27.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:40:27 smithi047 bash[22744]: audit 2024-09-16T07:40:26.027045+0000 mon.a (mon.0) 888 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:40:27.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:40:27 smithi047 bash[22744]: audit 2024-09-16T07:40:26.030448+0000 mon.a (mon.0) 889 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:40:27.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:40:27 smithi047 bash[22744]: audit 2024-09-16T07:40:26.035007+0000 mon.a (mon.0) 890 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:40:27.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:40:27 smithi047 bash[22744]: audit 2024-09-16T07:40:26.038294+0000 mon.a (mon.0) 891 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:40:27.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:40:27 smithi047 bash[22744]: audit 2024-09-16T07:40:26.120735+0000 mon.a (mon.0) 892 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:40:27.090 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:40:27 smithi047 bash[22744]: audit 2024-09-16T07:40:26.128082+0000 mon.a (mon.0) 893 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:40:27.090 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:40:27 smithi047 bash[22744]: audit 2024-09-16T07:40:26.130784+0000 mon.b (mon.2) 519 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T07:40:27.090 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:40:27 smithi047 bash[22744]: audit 2024-09-16T07:40:26.132093+0000 mon.b (mon.2) 520 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T07:40:27.090 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:40:27 smithi047 bash[22744]: audit 2024-09-16T07:40:26.138557+0000 mon.a (mon.0) 894 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:40:27.090 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:40:27 smithi047 bash[22744]: audit 2024-09-16T07:40:26.141911+0000 mon.b (mon.2) 521 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:40:27.090 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:40:27 smithi047 bash[22744]: audit 2024-09-16T07:40:26.144355+0000 mgr.a (mgr.14373) 5336 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:40:27.090 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:40:27 smithi047 bash[22744]: audit 2024-09-16T07:40:26.827002+0000 mgr.a (mgr.14373) 5337 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T07:40:27.090 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:40:27 smithi047 bash[22744]: cephadm 2024-09-16T07:40:26.828993+0000 mgr.a (mgr.14373) 5338 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T07:40:27.090 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:40:27 smithi047 bash[22744]: cluster 2024-09-16T07:40:26.915046+0000 mgr.a (mgr.14373) 5339 : cluster [DBG] pgmap v3701: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 3.4 KiB/s rd, 3 op/s 2024-09-16T07:40:27.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:40:27 smithi157 bash[24585]: audit 2024-09-16T07:40:26.027045+0000 mon.a (mon.0) 888 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:40:27.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:40:27 smithi157 bash[24585]: audit 2024-09-16T07:40:26.030448+0000 mon.a (mon.0) 889 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:40:27.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:40:27 smithi157 bash[24585]: audit 2024-09-16T07:40:26.035007+0000 mon.a (mon.0) 890 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:40:27.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:40:27 smithi157 bash[24585]: audit 2024-09-16T07:40:26.038294+0000 mon.a (mon.0) 891 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:40:27.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:40:27 smithi157 bash[24585]: audit 2024-09-16T07:40:26.120735+0000 mon.a (mon.0) 892 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:40:27.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:40:27 smithi157 bash[24585]: audit 2024-09-16T07:40:26.128082+0000 mon.a (mon.0) 893 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:40:27.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:40:27 smithi157 bash[24585]: audit 2024-09-16T07:40:26.130784+0000 mon.b (mon.2) 519 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T07:40:27.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:40:27 smithi157 bash[24585]: audit 2024-09-16T07:40:26.132093+0000 mon.b (mon.2) 520 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T07:40:27.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:40:27 smithi157 bash[24585]: audit 2024-09-16T07:40:26.138557+0000 mon.a (mon.0) 894 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:40:27.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:40:27 smithi157 bash[24585]: audit 2024-09-16T07:40:26.141911+0000 mon.b (mon.2) 521 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:40:27.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:40:27 smithi157 bash[24585]: audit 2024-09-16T07:40:26.144355+0000 mgr.a (mgr.14373) 5336 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:40:27.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:40:27 smithi157 bash[24585]: audit 2024-09-16T07:40:26.827002+0000 mgr.a (mgr.14373) 5337 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T07:40:27.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:40:27 smithi157 bash[24585]: cephadm 2024-09-16T07:40:26.828993+0000 mgr.a (mgr.14373) 5338 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T07:40:27.305 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:40:27 smithi157 bash[24585]: cluster 2024-09-16T07:40:26.915046+0000 mgr.a (mgr.14373) 5339 : cluster [DBG] pgmap v3701: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 3.4 KiB/s rd, 3 op/s 2024-09-16T07:40:27.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:40:27 smithi086 bash[24289]: audit 2024-09-16T07:40:26.027045+0000 mon.a (mon.0) 888 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:40:27.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:40:27 smithi086 bash[24289]: audit 2024-09-16T07:40:26.030448+0000 mon.a (mon.0) 889 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:40:27.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:40:27 smithi086 bash[24289]: audit 2024-09-16T07:40:26.035007+0000 mon.a (mon.0) 890 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:40:27.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:40:27 smithi086 bash[24289]: audit 2024-09-16T07:40:26.038294+0000 mon.a (mon.0) 891 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:40:27.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:40:27 smithi086 bash[24289]: audit 2024-09-16T07:40:26.120735+0000 mon.a (mon.0) 892 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:40:27.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:40:27 smithi086 bash[24289]: audit 2024-09-16T07:40:26.128082+0000 mon.a (mon.0) 893 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:40:27.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:40:27 smithi086 bash[24289]: audit 2024-09-16T07:40:26.130784+0000 mon.b (mon.2) 519 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T07:40:27.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:40:27 smithi086 bash[24289]: audit 2024-09-16T07:40:26.132093+0000 mon.b (mon.2) 520 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T07:40:27.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:40:27 smithi086 bash[24289]: audit 2024-09-16T07:40:26.138557+0000 mon.a (mon.0) 894 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:40:27.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:40:27 smithi086 bash[24289]: audit 2024-09-16T07:40:26.141911+0000 mon.b (mon.2) 521 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:40:27.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:40:27 smithi086 bash[24289]: audit 2024-09-16T07:40:26.144355+0000 mgr.a (mgr.14373) 5336 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:40:27.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:40:27 smithi086 bash[24289]: audit 2024-09-16T07:40:26.827002+0000 mgr.a (mgr.14373) 5337 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T07:40:27.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:40:27 smithi086 bash[24289]: cephadm 2024-09-16T07:40:26.828993+0000 mgr.a (mgr.14373) 5338 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T07:40:27.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:40:27 smithi086 bash[24289]: cluster 2024-09-16T07:40:26.915046+0000 mgr.a (mgr.14373) 5339 : cluster [DBG] pgmap v3701: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 3.4 KiB/s rd, 3 op/s 2024-09-16T07:40:30.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:40:29 smithi157 bash[24585]: cluster 2024-09-16T07:40:28.915792+0000 mgr.a (mgr.14373) 5340 : cluster [DBG] pgmap v3702: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-16T07:40:30.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:40:29 smithi086 bash[24289]: cluster 2024-09-16T07:40:28.915792+0000 mgr.a (mgr.14373) 5340 : cluster [DBG] pgmap v3702: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-16T07:40:30.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:40:29 smithi047 bash[22744]: cluster 2024-09-16T07:40:28.915792+0000 mgr.a (mgr.14373) 5340 : cluster [DBG] pgmap v3702: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-16T07:40:31.090 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:40:31.091 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:40:31.091 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:40:31.874 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:40:31.875 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:40:31.875 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:40:31.875 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:40:31.875 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:40:32.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:40:31 smithi157 bash[24585]: cluster 2024-09-16T07:40:30.916547+0000 mgr.a (mgr.14373) 5341 : cluster [DBG] pgmap v3703: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-16T07:40:32.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:40:31 smithi086 bash[24289]: cluster 2024-09-16T07:40:30.916547+0000 mgr.a (mgr.14373) 5341 : cluster [DBG] pgmap v3703: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-16T07:40:32.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:40:31 smithi047 bash[22744]: cluster 2024-09-16T07:40:30.916547+0000 mgr.a (mgr.14373) 5341 : cluster [DBG] pgmap v3703: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-16T07:40:33.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:40:32 smithi157 bash[24585]: audit 2024-09-16T07:40:31.429557+0000 mgr.a (mgr.14373) 5342 : audit [DBG] from='client.124707 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:40:33.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:40:32 smithi157 bash[24585]: cluster 2024-09-16T07:40:32.919266+0000 mgr.a (mgr.14373) 5343 : cluster [DBG] pgmap v3704: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:40:33.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:40:32 smithi086 bash[24289]: audit 2024-09-16T07:40:31.429557+0000 mgr.a (mgr.14373) 5342 : audit [DBG] from='client.124707 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:40:33.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:40:32 smithi086 bash[24289]: cluster 2024-09-16T07:40:32.919266+0000 mgr.a (mgr.14373) 5343 : cluster [DBG] pgmap v3704: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:40:33.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:40:32 smithi047 bash[22744]: audit 2024-09-16T07:40:31.429557+0000 mgr.a (mgr.14373) 5342 : audit [DBG] from='client.124707 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:40:33.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:40:32 smithi047 bash[22744]: cluster 2024-09-16T07:40:32.919266+0000 mgr.a (mgr.14373) 5343 : cluster [DBG] pgmap v3704: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:40:36.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:40:35 smithi157 bash[24585]: cluster 2024-09-16T07:40:34.920063+0000 mgr.a (mgr.14373) 5344 : cluster [DBG] pgmap v3705: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T07:40:36.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:40:35 smithi086 bash[24289]: cluster 2024-09-16T07:40:34.920063+0000 mgr.a (mgr.14373) 5344 : cluster [DBG] pgmap v3705: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T07:40:36.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:40:35 smithi047 bash[22744]: cluster 2024-09-16T07:40:34.920063+0000 mgr.a (mgr.14373) 5344 : cluster [DBG] pgmap v3705: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T07:40:36.876 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:40:36.877 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:40:36.877 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:40:37.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:40:37 smithi157 bash[24585]: cluster 2024-09-16T07:40:36.922092+0000 mgr.a (mgr.14373) 5345 : cluster [DBG] pgmap v3706: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:40:37.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:40:37 smithi086 bash[24289]: cluster 2024-09-16T07:40:36.922092+0000 mgr.a (mgr.14373) 5345 : cluster [DBG] pgmap v3706: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:40:37.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:40:37 smithi047 bash[22744]: cluster 2024-09-16T07:40:36.922092+0000 mgr.a (mgr.14373) 5345 : cluster [DBG] pgmap v3706: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:40:37.670 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:40:37.671 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:40:37.671 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:40:37.671 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:40:37.671 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:40:38.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:40:38 smithi157 bash[24585]: audit 2024-09-16T07:40:37.227657+0000 mgr.a (mgr.14373) 5346 : audit [DBG] from='client.124785 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:40:38.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:40:38 smithi086 bash[24289]: audit 2024-09-16T07:40:37.227657+0000 mgr.a (mgr.14373) 5346 : audit [DBG] from='client.124785 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:40:38.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:40:38 smithi047 bash[22744]: audit 2024-09-16T07:40:37.227657+0000 mgr.a (mgr.14373) 5346 : audit [DBG] from='client.124785 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:40:39.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:40:39 smithi157 bash[24585]: cluster 2024-09-16T07:40:38.923032+0000 mgr.a (mgr.14373) 5347 : cluster [DBG] pgmap v3707: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 5.4 KiB/s rd, 426 B/s wr, 5 op/s 2024-09-16T07:40:39.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:40:39 smithi086 bash[24289]: cluster 2024-09-16T07:40:38.923032+0000 mgr.a (mgr.14373) 5347 : cluster [DBG] pgmap v3707: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 5.4 KiB/s rd, 426 B/s wr, 5 op/s 2024-09-16T07:40:39.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:40:39 smithi047 bash[22744]: cluster 2024-09-16T07:40:38.923032+0000 mgr.a (mgr.14373) 5347 : cluster [DBG] pgmap v3707: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 5.4 KiB/s rd, 426 B/s wr, 5 op/s 2024-09-16T07:40:42.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:40:41 smithi157 bash[24585]: cluster 2024-09-16T07:40:40.923791+0000 mgr.a (mgr.14373) 5348 : cluster [DBG] pgmap v3708: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 5.4 KiB/s rd, 426 B/s wr, 5 op/s 2024-09-16T07:40:42.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:40:41 smithi086 bash[24289]: cluster 2024-09-16T07:40:40.923791+0000 mgr.a (mgr.14373) 5348 : cluster [DBG] pgmap v3708: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 5.4 KiB/s rd, 426 B/s wr, 5 op/s 2024-09-16T07:40:42.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:40:41 smithi047 bash[22744]: cluster 2024-09-16T07:40:40.923791+0000 mgr.a (mgr.14373) 5348 : cluster [DBG] pgmap v3708: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 5.4 KiB/s rd, 426 B/s wr, 5 op/s 2024-09-16T07:40:42.672 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:40:42.672 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:40:42.673 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:40:43.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:40:42 smithi157 bash[24585]: cluster 2024-09-16T07:40:42.925912+0000 mgr.a (mgr.14373) 5349 : cluster [DBG] pgmap v3709: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T07:40:43.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:40:42 smithi086 bash[24289]: cluster 2024-09-16T07:40:42.925912+0000 mgr.a (mgr.14373) 5349 : cluster [DBG] pgmap v3709: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T07:40:43.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:40:42 smithi047 bash[22744]: cluster 2024-09-16T07:40:42.925912+0000 mgr.a (mgr.14373) 5349 : cluster [DBG] pgmap v3709: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T07:40:43.430 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:40:43.431 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:40:43.431 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:40:43.431 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:40:43.431 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:40:44.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:40:43 smithi157 bash[24585]: audit 2024-09-16T07:40:43.008567+0000 mgr.a (mgr.14373) 5350 : audit [DBG] from='client.124860 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:40:44.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:40:43 smithi086 bash[24289]: audit 2024-09-16T07:40:43.008567+0000 mgr.a (mgr.14373) 5350 : audit [DBG] from='client.124860 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:40:44.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:40:43 smithi047 bash[22744]: audit 2024-09-16T07:40:43.008567+0000 mgr.a (mgr.14373) 5350 : audit [DBG] from='client.124860 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:40:45.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:40:44 smithi157 bash[24585]: cluster 2024-09-16T07:40:44.926802+0000 mgr.a (mgr.14373) 5351 : cluster [DBG] pgmap v3710: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:40:45.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:40:45 smithi086 bash[24289]: cluster 2024-09-16T07:40:44.926802+0000 mgr.a (mgr.14373) 5351 : cluster [DBG] pgmap v3710: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:40:45.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:40:44 smithi047 bash[22744]: cluster 2024-09-16T07:40:44.926802+0000 mgr.a (mgr.14373) 5351 : cluster [DBG] pgmap v3710: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:40:47.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:40:47 smithi157 bash[24585]: cluster 2024-09-16T07:40:46.928905+0000 mgr.a (mgr.14373) 5352 : cluster [DBG] pgmap v3711: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:40:47.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:40:47 smithi086 bash[24289]: cluster 2024-09-16T07:40:46.928905+0000 mgr.a (mgr.14373) 5352 : cluster [DBG] pgmap v3711: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:40:47.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:40:47 smithi047 bash[22744]: cluster 2024-09-16T07:40:46.928905+0000 mgr.a (mgr.14373) 5352 : cluster [DBG] pgmap v3711: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:40:48.432 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:40:48.433 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:40:48.433 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:40:49.173 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:40:49.174 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:40:49.174 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:40:49.174 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:40:49.174 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:40:50.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:40:49 smithi157 bash[24585]: audit 2024-09-16T07:40:48.765857+0000 mgr.a (mgr.14373) 5353 : audit [DBG] from='client.124938 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:40:50.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:40:49 smithi157 bash[24585]: cluster 2024-09-16T07:40:48.929549+0000 mgr.a (mgr.14373) 5354 : cluster [DBG] pgmap v3712: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:40:50.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:40:49 smithi086 bash[24289]: audit 2024-09-16T07:40:48.765857+0000 mgr.a (mgr.14373) 5353 : audit [DBG] from='client.124938 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:40:50.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:40:49 smithi086 bash[24289]: cluster 2024-09-16T07:40:48.929549+0000 mgr.a (mgr.14373) 5354 : cluster [DBG] pgmap v3712: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:40:50.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:40:49 smithi047 bash[22744]: audit 2024-09-16T07:40:48.765857+0000 mgr.a (mgr.14373) 5353 : audit [DBG] from='client.124938 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:40:50.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:40:49 smithi047 bash[22744]: cluster 2024-09-16T07:40:48.929549+0000 mgr.a (mgr.14373) 5354 : cluster [DBG] pgmap v3712: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:40:51.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:40:51 smithi157 bash[24585]: cluster 2024-09-16T07:40:50.930471+0000 mgr.a (mgr.14373) 5355 : cluster [DBG] pgmap v3713: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:40:51.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:40:51 smithi086 bash[24289]: cluster 2024-09-16T07:40:50.930471+0000 mgr.a (mgr.14373) 5355 : cluster [DBG] pgmap v3713: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:40:51.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:40:51 smithi047 bash[22744]: cluster 2024-09-16T07:40:50.930471+0000 mgr.a (mgr.14373) 5355 : cluster [DBG] pgmap v3713: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:40:53.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:40:53 smithi157 bash[24585]: cluster 2024-09-16T07:40:52.932677+0000 mgr.a (mgr.14373) 5356 : cluster [DBG] pgmap v3714: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:40:53.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:40:53 smithi086 bash[24289]: cluster 2024-09-16T07:40:52.932677+0000 mgr.a (mgr.14373) 5356 : cluster [DBG] pgmap v3714: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:40:53.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:40:53 smithi047 bash[22744]: cluster 2024-09-16T07:40:52.932677+0000 mgr.a (mgr.14373) 5356 : cluster [DBG] pgmap v3714: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:40:54.175 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:40:54.176 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:40:54.177 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:40:54.953 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:40:54.954 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:40:54.954 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:40:54.954 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:40:54.954 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:40:56.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:40:55 smithi157 bash[24585]: audit 2024-09-16T07:40:54.517108+0000 mgr.a (mgr.14373) 5357 : audit [DBG] from='client.125016 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:40:56.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:40:55 smithi157 bash[24585]: cluster 2024-09-16T07:40:54.933260+0000 mgr.a (mgr.14373) 5358 : cluster [DBG] pgmap v3715: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:40:56.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:40:55 smithi086 bash[24289]: audit 2024-09-16T07:40:54.517108+0000 mgr.a (mgr.14373) 5357 : audit [DBG] from='client.125016 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:40:56.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:40:55 smithi086 bash[24289]: cluster 2024-09-16T07:40:54.933260+0000 mgr.a (mgr.14373) 5358 : cluster [DBG] pgmap v3715: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:40:56.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:40:55 smithi047 bash[22744]: audit 2024-09-16T07:40:54.517108+0000 mgr.a (mgr.14373) 5357 : audit [DBG] from='client.125016 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:40:56.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:40:55 smithi047 bash[22744]: cluster 2024-09-16T07:40:54.933260+0000 mgr.a (mgr.14373) 5358 : cluster [DBG] pgmap v3715: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:40:57.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:40:56 smithi157 bash[24585]: cluster 2024-09-16T07:40:56.935393+0000 mgr.a (mgr.14373) 5359 : cluster [DBG] pgmap v3716: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:40:57.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:40:56 smithi086 bash[24289]: cluster 2024-09-16T07:40:56.935393+0000 mgr.a (mgr.14373) 5359 : cluster [DBG] pgmap v3716: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:40:57.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:40:56 smithi047 bash[22744]: cluster 2024-09-16T07:40:56.935393+0000 mgr.a (mgr.14373) 5359 : cluster [DBG] pgmap v3716: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:40:59.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:40:59 smithi157 bash[24585]: cluster 2024-09-16T07:40:58.936283+0000 mgr.a (mgr.14373) 5360 : cluster [DBG] pgmap v3717: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:40:59.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:40:59 smithi086 bash[24289]: cluster 2024-09-16T07:40:58.936283+0000 mgr.a (mgr.14373) 5360 : cluster [DBG] pgmap v3717: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:40:59.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:40:59 smithi047 bash[22744]: cluster 2024-09-16T07:40:58.936283+0000 mgr.a (mgr.14373) 5360 : cluster [DBG] pgmap v3717: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:40:59.955 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:40:59.956 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:40:59.956 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:41:00.708 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:41:00.709 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:41:00.709 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:41:00.709 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:41:00.709 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:41:01.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:41:01 smithi157 bash[24585]: audit 2024-09-16T07:41:00.295935+0000 mgr.a (mgr.14373) 5361 : audit [DBG] from='client.125091 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:41:01.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:41:01 smithi157 bash[24585]: cluster 2024-09-16T07:41:00.937266+0000 mgr.a (mgr.14373) 5362 : cluster [DBG] pgmap v3718: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:41:01.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:41:01 smithi086 bash[24289]: audit 2024-09-16T07:41:00.295935+0000 mgr.a (mgr.14373) 5361 : audit [DBG] from='client.125091 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:41:01.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:41:01 smithi086 bash[24289]: cluster 2024-09-16T07:41:00.937266+0000 mgr.a (mgr.14373) 5362 : cluster [DBG] pgmap v3718: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:41:01.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:41:01 smithi047 bash[22744]: audit 2024-09-16T07:41:00.295935+0000 mgr.a (mgr.14373) 5361 : audit [DBG] from='client.125091 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:41:01.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:41:01 smithi047 bash[22744]: cluster 2024-09-16T07:41:00.937266+0000 mgr.a (mgr.14373) 5362 : cluster [DBG] pgmap v3718: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:41:03.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:41:03 smithi157 bash[24585]: cluster 2024-09-16T07:41:02.939532+0000 mgr.a (mgr.14373) 5363 : cluster [DBG] pgmap v3719: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:41:03.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:41:03 smithi086 bash[24289]: cluster 2024-09-16T07:41:02.939532+0000 mgr.a (mgr.14373) 5363 : cluster [DBG] pgmap v3719: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:41:03.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:41:03 smithi047 bash[22744]: cluster 2024-09-16T07:41:02.939532+0000 mgr.a (mgr.14373) 5363 : cluster [DBG] pgmap v3719: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:41:05.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:41:05 smithi157 bash[24585]: cluster 2024-09-16T07:41:04.940291+0000 mgr.a (mgr.14373) 5364 : cluster [DBG] pgmap v3720: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:41:05.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:41:05 smithi086 bash[24289]: cluster 2024-09-16T07:41:04.940291+0000 mgr.a (mgr.14373) 5364 : cluster [DBG] pgmap v3720: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:41:05.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:41:05 smithi047 bash[22744]: cluster 2024-09-16T07:41:04.940291+0000 mgr.a (mgr.14373) 5364 : cluster [DBG] pgmap v3720: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:41:05.710 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:41:05.711 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:41:05.711 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:41:06.478 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:41:06.479 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:41:06.479 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:41:06.479 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:41:06.479 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:41:07.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:41:07 smithi157 bash[24585]: audit 2024-09-16T07:41:06.047049+0000 mgr.a (mgr.14373) 5365 : audit [DBG] from='client.125166 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:41:07.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:41:07 smithi157 bash[24585]: cluster 2024-09-16T07:41:06.942700+0000 mgr.a (mgr.14373) 5366 : cluster [DBG] pgmap v3721: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-16T07:41:07.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:41:07 smithi086 bash[24289]: audit 2024-09-16T07:41:06.047049+0000 mgr.a (mgr.14373) 5365 : audit [DBG] from='client.125166 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:41:07.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:41:07 smithi086 bash[24289]: cluster 2024-09-16T07:41:06.942700+0000 mgr.a (mgr.14373) 5366 : cluster [DBG] pgmap v3721: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-16T07:41:07.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:41:07 smithi047 bash[22744]: audit 2024-09-16T07:41:06.047049+0000 mgr.a (mgr.14373) 5365 : audit [DBG] from='client.125166 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:41:07.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:41:07 smithi047 bash[22744]: cluster 2024-09-16T07:41:06.942700+0000 mgr.a (mgr.14373) 5366 : cluster [DBG] pgmap v3721: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-16T07:41:09.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:41:09 smithi157 bash[24585]: cluster 2024-09-16T07:41:08.943448+0000 mgr.a (mgr.14373) 5367 : cluster [DBG] pgmap v3722: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T07:41:09.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:41:09 smithi086 bash[24289]: cluster 2024-09-16T07:41:08.943448+0000 mgr.a (mgr.14373) 5367 : cluster [DBG] pgmap v3722: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T07:41:09.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:41:09 smithi047 bash[22744]: cluster 2024-09-16T07:41:08.943448+0000 mgr.a (mgr.14373) 5367 : cluster [DBG] pgmap v3722: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T07:41:11.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:41:11 smithi157 bash[24585]: cluster 2024-09-16T07:41:10.944176+0000 mgr.a (mgr.14373) 5368 : cluster [DBG] pgmap v3723: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T07:41:11.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:41:11 smithi086 bash[24289]: cluster 2024-09-16T07:41:10.944176+0000 mgr.a (mgr.14373) 5368 : cluster [DBG] pgmap v3723: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T07:41:11.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:41:11 smithi047 bash[22744]: cluster 2024-09-16T07:41:10.944176+0000 mgr.a (mgr.14373) 5368 : cluster [DBG] pgmap v3723: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T07:41:11.480 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:41:11.481 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:41:11.481 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:41:12.244 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:41:12.245 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:41:12.245 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:41:12.245 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:41:12.245 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:41:12.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:41:12 smithi157 bash[24585]: audit 2024-09-16T07:41:11.816901+0000 mgr.a (mgr.14373) 5369 : audit [DBG] from='client.125244 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:41:12.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:41:12 smithi086 bash[24289]: audit 2024-09-16T07:41:11.816901+0000 mgr.a (mgr.14373) 5369 : audit [DBG] from='client.125244 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:41:12.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:41:12 smithi047 bash[22744]: audit 2024-09-16T07:41:11.816901+0000 mgr.a (mgr.14373) 5369 : audit [DBG] from='client.125244 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:41:13.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:41:13 smithi157 bash[24585]: cluster 2024-09-16T07:41:12.946854+0000 mgr.a (mgr.14373) 5370 : cluster [DBG] pgmap v3724: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:41:13.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:41:13 smithi086 bash[24289]: cluster 2024-09-16T07:41:12.946854+0000 mgr.a (mgr.14373) 5370 : cluster [DBG] pgmap v3724: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:41:13.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:41:13 smithi047 bash[22744]: cluster 2024-09-16T07:41:12.946854+0000 mgr.a (mgr.14373) 5370 : cluster [DBG] pgmap v3724: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:41:15.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:41:15 smithi157 bash[24585]: cluster 2024-09-16T07:41:14.947640+0000 mgr.a (mgr.14373) 5371 : cluster [DBG] pgmap v3725: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:41:15.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:41:15 smithi086 bash[24289]: cluster 2024-09-16T07:41:14.947640+0000 mgr.a (mgr.14373) 5371 : cluster [DBG] pgmap v3725: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:41:15.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:41:15 smithi047 bash[22744]: cluster 2024-09-16T07:41:14.947640+0000 mgr.a (mgr.14373) 5371 : cluster [DBG] pgmap v3725: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:41:17.246 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:41:17.247 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:41:17.247 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:41:17.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:41:17 smithi157 bash[24585]: cluster 2024-09-16T07:41:16.949573+0000 mgr.a (mgr.14373) 5372 : cluster [DBG] pgmap v3726: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:41:17.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:41:17 smithi086 bash[24289]: cluster 2024-09-16T07:41:16.949573+0000 mgr.a (mgr.14373) 5372 : cluster [DBG] pgmap v3726: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:41:17.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:41:17 smithi047 bash[22744]: cluster 2024-09-16T07:41:16.949573+0000 mgr.a (mgr.14373) 5372 : cluster [DBG] pgmap v3726: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:41:18.031 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:41:18.031 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:41:18.031 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:41:18.031 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:41:18.031 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:41:18.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:41:18 smithi157 bash[24585]: audit 2024-09-16T07:41:17.589657+0000 mgr.a (mgr.14373) 5373 : audit [DBG] from='client.125322 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:41:18.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:41:18 smithi086 bash[24289]: audit 2024-09-16T07:41:17.589657+0000 mgr.a (mgr.14373) 5373 : audit [DBG] from='client.125322 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:41:18.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:41:18 smithi047 bash[22744]: audit 2024-09-16T07:41:17.589657+0000 mgr.a (mgr.14373) 5373 : audit [DBG] from='client.125322 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:41:19.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:41:19 smithi157 bash[24585]: cluster 2024-09-16T07:41:18.950463+0000 mgr.a (mgr.14373) 5374 : cluster [DBG] pgmap v3727: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-16T07:41:19.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:41:19 smithi086 bash[24289]: cluster 2024-09-16T07:41:18.950463+0000 mgr.a (mgr.14373) 5374 : cluster [DBG] pgmap v3727: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-16T07:41:19.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:41:19 smithi047 bash[22744]: cluster 2024-09-16T07:41:18.950463+0000 mgr.a (mgr.14373) 5374 : cluster [DBG] pgmap v3727: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-16T07:41:21.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:41:21 smithi157 bash[24585]: cluster 2024-09-16T07:41:20.951244+0000 mgr.a (mgr.14373) 5375 : cluster [DBG] pgmap v3728: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-16T07:41:21.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:41:21 smithi086 bash[24289]: cluster 2024-09-16T07:41:20.951244+0000 mgr.a (mgr.14373) 5375 : cluster [DBG] pgmap v3728: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-16T07:41:21.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:41:21 smithi047 bash[22744]: cluster 2024-09-16T07:41:20.951244+0000 mgr.a (mgr.14373) 5375 : cluster [DBG] pgmap v3728: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-16T07:41:23.032 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:41:23.033 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:41:23.033 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:41:23.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:41:23 smithi157 bash[24585]: cluster 2024-09-16T07:41:22.953446+0000 mgr.a (mgr.14373) 5376 : cluster [DBG] pgmap v3729: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-16T07:41:23.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:41:23 smithi086 bash[24289]: cluster 2024-09-16T07:41:22.953446+0000 mgr.a (mgr.14373) 5376 : cluster [DBG] pgmap v3729: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-16T07:41:23.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:41:23 smithi047 bash[22744]: cluster 2024-09-16T07:41:22.953446+0000 mgr.a (mgr.14373) 5376 : cluster [DBG] pgmap v3729: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-16T07:41:23.772 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:41:23.773 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:41:23.773 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:41:23.773 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:41:23.773 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:41:24.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:41:24 smithi157 bash[24585]: audit 2024-09-16T07:41:23.363132+0000 mgr.a (mgr.14373) 5377 : audit [DBG] from='client.125397 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:41:24.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:41:24 smithi086 bash[24289]: audit 2024-09-16T07:41:23.363132+0000 mgr.a (mgr.14373) 5377 : audit [DBG] from='client.125397 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:41:24.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:41:24 smithi047 bash[22744]: audit 2024-09-16T07:41:23.363132+0000 mgr.a (mgr.14373) 5377 : audit [DBG] from='client.125397 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:41:25.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:41:25 smithi157 bash[24585]: cluster 2024-09-16T07:41:24.954329+0000 mgr.a (mgr.14373) 5378 : cluster [DBG] pgmap v3730: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:41:25.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:41:25 smithi086 bash[24289]: cluster 2024-09-16T07:41:24.954329+0000 mgr.a (mgr.14373) 5378 : cluster [DBG] pgmap v3730: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:41:25.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:41:25 smithi047 bash[22744]: cluster 2024-09-16T07:41:24.954329+0000 mgr.a (mgr.14373) 5378 : cluster [DBG] pgmap v3730: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:41:27.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:41:26 smithi157 bash[24585]: audit 2024-09-16T07:41:26.879907+0000 mon.b (mon.2) 522 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T07:41:27.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:41:26 smithi086 bash[24289]: audit 2024-09-16T07:41:26.879907+0000 mon.b (mon.2) 522 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T07:41:27.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:41:26 smithi047 bash[22744]: audit 2024-09-16T07:41:26.879907+0000 mon.b (mon.2) 522 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T07:41:28.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:41:27 smithi157 bash[24585]: cluster 2024-09-16T07:41:26.956655+0000 mgr.a (mgr.14373) 5379 : cluster [DBG] pgmap v3731: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:41:28.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:41:27 smithi157 bash[24585]: audit 2024-09-16T07:41:27.709123+0000 mon.b (mon.2) 523 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T07:41:28.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:41:27 smithi157 bash[24585]: audit 2024-09-16T07:41:27.710951+0000 mon.b (mon.2) 524 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T07:41:28.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:41:27 smithi157 bash[24585]: audit 2024-09-16T07:41:27.724167+0000 mon.a (mon.0) 895 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:41:28.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:41:27 smithi157 bash[24585]: audit 2024-09-16T07:41:27.726669+0000 mon.b (mon.2) 525 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:41:28.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:41:27 smithi086 bash[24289]: cluster 2024-09-16T07:41:26.956655+0000 mgr.a (mgr.14373) 5379 : cluster [DBG] pgmap v3731: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:41:28.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:41:27 smithi086 bash[24289]: audit 2024-09-16T07:41:27.709123+0000 mon.b (mon.2) 523 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T07:41:28.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:41:27 smithi086 bash[24289]: audit 2024-09-16T07:41:27.710951+0000 mon.b (mon.2) 524 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T07:41:28.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:41:27 smithi086 bash[24289]: audit 2024-09-16T07:41:27.724167+0000 mon.a (mon.0) 895 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:41:28.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:41:27 smithi086 bash[24289]: audit 2024-09-16T07:41:27.726669+0000 mon.b (mon.2) 525 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:41:28.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:41:27 smithi047 bash[22744]: cluster 2024-09-16T07:41:26.956655+0000 mgr.a (mgr.14373) 5379 : cluster [DBG] pgmap v3731: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:41:28.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:41:27 smithi047 bash[22744]: audit 2024-09-16T07:41:27.709123+0000 mon.b (mon.2) 523 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T07:41:28.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:41:27 smithi047 bash[22744]: audit 2024-09-16T07:41:27.710951+0000 mon.b (mon.2) 524 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T07:41:28.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:41:27 smithi047 bash[22744]: audit 2024-09-16T07:41:27.724167+0000 mon.a (mon.0) 895 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:41:28.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:41:27 smithi047 bash[22744]: audit 2024-09-16T07:41:27.726669+0000 mon.b (mon.2) 525 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:41:28.773 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:41:28.774 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:41:28.774 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:41:28.838 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 07:41:28 smithi047 bash[22994]: debug 2024-09-16T07:41:28.458+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T07:41:28.838 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 07:41:28 smithi047 bash[22994]: debug 2024-09-16T07:41:28.462+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T07:41:29.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:41:28 smithi157 bash[24585]: audit 2024-09-16T07:41:27.729695+0000 mgr.a (mgr.14373) 5380 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:41:29.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:41:28 smithi086 bash[24289]: audit 2024-09-16T07:41:27.729695+0000 mgr.a (mgr.14373) 5380 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:41:29.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:41:28 smithi047 bash[22744]: audit 2024-09-16T07:41:27.729695+0000 mgr.a (mgr.14373) 5380 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:41:29.513 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:41:29.513 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:41:29.513 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:41:29.513 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:41:29.514 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:41:30.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:41:29 smithi157 bash[24585]: audit 2024-09-16T07:41:28.465304+0000 mgr.a (mgr.14373) 5381 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T07:41:30.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:41:29 smithi157 bash[24585]: cephadm 2024-09-16T07:41:28.467142+0000 mgr.a (mgr.14373) 5382 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T07:41:30.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:41:29 smithi157 bash[24585]: cluster 2024-09-16T07:41:28.957499+0000 mgr.a (mgr.14373) 5383 : cluster [DBG] pgmap v3732: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:41:30.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:41:29 smithi086 bash[24289]: audit 2024-09-16T07:41:28.465304+0000 mgr.a (mgr.14373) 5381 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T07:41:30.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:41:29 smithi086 bash[24289]: cephadm 2024-09-16T07:41:28.467142+0000 mgr.a (mgr.14373) 5382 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T07:41:30.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:41:29 smithi086 bash[24289]: cluster 2024-09-16T07:41:28.957499+0000 mgr.a (mgr.14373) 5383 : cluster [DBG] pgmap v3732: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:41:30.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:41:29 smithi047 bash[22744]: audit 2024-09-16T07:41:28.465304+0000 mgr.a (mgr.14373) 5381 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T07:41:30.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:41:29 smithi047 bash[22744]: cephadm 2024-09-16T07:41:28.467142+0000 mgr.a (mgr.14373) 5382 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T07:41:30.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:41:29 smithi047 bash[22744]: cluster 2024-09-16T07:41:28.957499+0000 mgr.a (mgr.14373) 5383 : cluster [DBG] pgmap v3732: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:41:31.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:41:30 smithi157 bash[24585]: audit 2024-09-16T07:41:29.103687+0000 mgr.a (mgr.14373) 5384 : audit [DBG] from='client.125583 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:41:31.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:41:30 smithi086 bash[24289]: audit 2024-09-16T07:41:29.103687+0000 mgr.a (mgr.14373) 5384 : audit [DBG] from='client.125583 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:41:31.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:41:30 smithi047 bash[22744]: audit 2024-09-16T07:41:29.103687+0000 mgr.a (mgr.14373) 5384 : audit [DBG] from='client.125583 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:41:32.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:41:31 smithi157 bash[24585]: cluster 2024-09-16T07:41:30.958450+0000 mgr.a (mgr.14373) 5385 : cluster [DBG] pgmap v3733: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:41:32.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:41:31 smithi086 bash[24289]: cluster 2024-09-16T07:41:30.958450+0000 mgr.a (mgr.14373) 5385 : cluster [DBG] pgmap v3733: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:41:32.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:41:31 smithi047 bash[22744]: cluster 2024-09-16T07:41:30.958450+0000 mgr.a (mgr.14373) 5385 : cluster [DBG] pgmap v3733: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:41:34.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:41:33 smithi157 bash[24585]: cluster 2024-09-16T07:41:32.960702+0000 mgr.a (mgr.14373) 5386 : cluster [DBG] pgmap v3734: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:41:34.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:41:33 smithi086 bash[24289]: cluster 2024-09-16T07:41:32.960702+0000 mgr.a (mgr.14373) 5386 : cluster [DBG] pgmap v3734: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:41:34.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:41:33 smithi047 bash[22744]: cluster 2024-09-16T07:41:32.960702+0000 mgr.a (mgr.14373) 5386 : cluster [DBG] pgmap v3734: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:41:34.515 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:41:34.515 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:41:34.515 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:41:35.289 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:41:35.292 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:41:35.292 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:41:35.292 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:41:35.292 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:41:36.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:41:35 smithi157 bash[24585]: audit 2024-09-16T07:41:34.851088+0000 mgr.a (mgr.14373) 5387 : audit [DBG] from='client.125661 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:41:36.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:41:35 smithi157 bash[24585]: cluster 2024-09-16T07:41:34.961230+0000 mgr.a (mgr.14373) 5388 : cluster [DBG] pgmap v3735: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:41:36.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:41:35 smithi086 bash[24289]: audit 2024-09-16T07:41:34.851088+0000 mgr.a (mgr.14373) 5387 : audit [DBG] from='client.125661 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:41:36.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:41:35 smithi086 bash[24289]: cluster 2024-09-16T07:41:34.961230+0000 mgr.a (mgr.14373) 5388 : cluster [DBG] pgmap v3735: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:41:36.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:41:35 smithi047 bash[22744]: audit 2024-09-16T07:41:34.851088+0000 mgr.a (mgr.14373) 5387 : audit [DBG] from='client.125661 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:41:36.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:41:35 smithi047 bash[22744]: cluster 2024-09-16T07:41:34.961230+0000 mgr.a (mgr.14373) 5388 : cluster [DBG] pgmap v3735: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:41:38.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:41:37 smithi157 bash[24585]: cluster 2024-09-16T07:41:36.963569+0000 mgr.a (mgr.14373) 5389 : cluster [DBG] pgmap v3736: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:41:38.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:41:37 smithi086 bash[24289]: cluster 2024-09-16T07:41:36.963569+0000 mgr.a (mgr.14373) 5389 : cluster [DBG] pgmap v3736: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:41:38.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:41:37 smithi047 bash[22744]: cluster 2024-09-16T07:41:36.963569+0000 mgr.a (mgr.14373) 5389 : cluster [DBG] pgmap v3736: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:41:40.290 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:41:40.291 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:41:40.291 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:41:40.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:41:39 smithi157 bash[24585]: cluster 2024-09-16T07:41:38.964490+0000 mgr.a (mgr.14373) 5390 : cluster [DBG] pgmap v3737: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:41:40.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:41:39 smithi086 bash[24289]: cluster 2024-09-16T07:41:38.964490+0000 mgr.a (mgr.14373) 5390 : cluster [DBG] pgmap v3737: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:41:40.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:41:39 smithi047 bash[22744]: cluster 2024-09-16T07:41:38.964490+0000 mgr.a (mgr.14373) 5390 : cluster [DBG] pgmap v3737: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:41:41.036 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:41:41.037 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:41:41.037 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:41:41.037 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:41:41.037 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:41:41.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:41:41 smithi157 bash[24585]: audit 2024-09-16T07:41:40.621564+0000 mgr.a (mgr.14373) 5391 : audit [DBG] from='client.125736 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:41:41.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:41:41 smithi157 bash[24585]: cluster 2024-09-16T07:41:40.965175+0000 mgr.a (mgr.14373) 5392 : cluster [DBG] pgmap v3738: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:41:41.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:41:41 smithi086 bash[24289]: audit 2024-09-16T07:41:40.621564+0000 mgr.a (mgr.14373) 5391 : audit [DBG] from='client.125736 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:41:41.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:41:41 smithi086 bash[24289]: cluster 2024-09-16T07:41:40.965175+0000 mgr.a (mgr.14373) 5392 : cluster [DBG] pgmap v3738: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:41:41.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:41:41 smithi047 bash[22744]: audit 2024-09-16T07:41:40.621564+0000 mgr.a (mgr.14373) 5391 : audit [DBG] from='client.125736 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:41:41.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:41:41 smithi047 bash[22744]: cluster 2024-09-16T07:41:40.965175+0000 mgr.a (mgr.14373) 5392 : cluster [DBG] pgmap v3738: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:41:43.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:41:43 smithi157 bash[24585]: cluster 2024-09-16T07:41:42.967379+0000 mgr.a (mgr.14373) 5393 : cluster [DBG] pgmap v3739: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:41:43.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:41:43 smithi086 bash[24289]: cluster 2024-09-16T07:41:42.967379+0000 mgr.a (mgr.14373) 5393 : cluster [DBG] pgmap v3739: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:41:43.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:41:43 smithi047 bash[22744]: cluster 2024-09-16T07:41:42.967379+0000 mgr.a (mgr.14373) 5393 : cluster [DBG] pgmap v3739: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:41:45.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:41:45 smithi157 bash[24585]: cluster 2024-09-16T07:41:44.968147+0000 mgr.a (mgr.14373) 5394 : cluster [DBG] pgmap v3740: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:41:45.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:41:45 smithi086 bash[24289]: cluster 2024-09-16T07:41:44.968147+0000 mgr.a (mgr.14373) 5394 : cluster [DBG] pgmap v3740: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:41:45.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:41:45 smithi047 bash[22744]: cluster 2024-09-16T07:41:44.968147+0000 mgr.a (mgr.14373) 5394 : cluster [DBG] pgmap v3740: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:41:46.038 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:41:46.038 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:41:46.039 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:41:46.813 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:41:46.814 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:41:46.814 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:41:46.814 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:41:46.814 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:41:47.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:41:47 smithi157 bash[24585]: audit 2024-09-16T07:41:46.375653+0000 mgr.a (mgr.14373) 5395 : audit [DBG] from='client.125814 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:41:47.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:41:47 smithi157 bash[24585]: cluster 2024-09-16T07:41:46.971022+0000 mgr.a (mgr.14373) 5396 : cluster [DBG] pgmap v3741: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:41:47.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:41:47 smithi086 bash[24289]: audit 2024-09-16T07:41:46.375653+0000 mgr.a (mgr.14373) 5395 : audit [DBG] from='client.125814 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:41:47.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:41:47 smithi086 bash[24289]: cluster 2024-09-16T07:41:46.971022+0000 mgr.a (mgr.14373) 5396 : cluster [DBG] pgmap v3741: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:41:47.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:41:47 smithi047 bash[22744]: audit 2024-09-16T07:41:46.375653+0000 mgr.a (mgr.14373) 5395 : audit [DBG] from='client.125814 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:41:47.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:41:47 smithi047 bash[22744]: cluster 2024-09-16T07:41:46.971022+0000 mgr.a (mgr.14373) 5396 : cluster [DBG] pgmap v3741: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:41:49.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:41:49 smithi157 bash[24585]: cluster 2024-09-16T07:41:48.971962+0000 mgr.a (mgr.14373) 5397 : cluster [DBG] pgmap v3742: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:41:49.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:41:49 smithi086 bash[24289]: cluster 2024-09-16T07:41:48.971962+0000 mgr.a (mgr.14373) 5397 : cluster [DBG] pgmap v3742: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:41:49.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:41:49 smithi047 bash[22744]: cluster 2024-09-16T07:41:48.971962+0000 mgr.a (mgr.14373) 5397 : cluster [DBG] pgmap v3742: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:41:51.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:41:51 smithi157 bash[24585]: cluster 2024-09-16T07:41:50.972884+0000 mgr.a (mgr.14373) 5398 : cluster [DBG] pgmap v3743: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T07:41:51.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:41:51 smithi086 bash[24289]: cluster 2024-09-16T07:41:50.972884+0000 mgr.a (mgr.14373) 5398 : cluster [DBG] pgmap v3743: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T07:41:51.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:41:51 smithi047 bash[22744]: cluster 2024-09-16T07:41:50.972884+0000 mgr.a (mgr.14373) 5398 : cluster [DBG] pgmap v3743: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T07:41:51.815 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:41:51.815 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:41:51.816 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:41:52.585 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:41:52.585 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:41:52.585 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:41:52.585 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:41:52.586 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:41:53.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:41:53 smithi157 bash[24585]: audit 2024-09-16T07:41:52.154583+0000 mgr.a (mgr.14373) 5399 : audit [DBG] from='client.125892 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:41:53.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:41:53 smithi157 bash[24585]: cluster 2024-09-16T07:41:52.975564+0000 mgr.a (mgr.14373) 5400 : cluster [DBG] pgmap v3744: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:41:53.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:41:53 smithi086 bash[24289]: audit 2024-09-16T07:41:52.154583+0000 mgr.a (mgr.14373) 5399 : audit [DBG] from='client.125892 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:41:53.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:41:53 smithi086 bash[24289]: cluster 2024-09-16T07:41:52.975564+0000 mgr.a (mgr.14373) 5400 : cluster [DBG] pgmap v3744: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:41:53.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:41:53 smithi047 bash[22744]: audit 2024-09-16T07:41:52.154583+0000 mgr.a (mgr.14373) 5399 : audit [DBG] from='client.125892 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:41:53.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:41:53 smithi047 bash[22744]: cluster 2024-09-16T07:41:52.975564+0000 mgr.a (mgr.14373) 5400 : cluster [DBG] pgmap v3744: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:41:55.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:41:55 smithi157 bash[24585]: cluster 2024-09-16T07:41:54.976323+0000 mgr.a (mgr.14373) 5401 : cluster [DBG] pgmap v3745: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:41:55.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:41:55 smithi086 bash[24289]: cluster 2024-09-16T07:41:54.976323+0000 mgr.a (mgr.14373) 5401 : cluster [DBG] pgmap v3745: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:41:55.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:41:55 smithi047 bash[22744]: cluster 2024-09-16T07:41:54.976323+0000 mgr.a (mgr.14373) 5401 : cluster [DBG] pgmap v3745: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:41:57.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:41:57 smithi157 bash[24585]: cluster 2024-09-16T07:41:56.978277+0000 mgr.a (mgr.14373) 5402 : cluster [DBG] pgmap v3746: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:41:57.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:41:57 smithi086 bash[24289]: cluster 2024-09-16T07:41:56.978277+0000 mgr.a (mgr.14373) 5402 : cluster [DBG] pgmap v3746: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:41:57.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:41:57 smithi047 bash[22744]: cluster 2024-09-16T07:41:56.978277+0000 mgr.a (mgr.14373) 5402 : cluster [DBG] pgmap v3746: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:41:57.587 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:41:57.588 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:41:57.588 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:41:58.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:41:58 smithi157 bash[24585]: audit 2024-09-16T07:41:57.928297+0000 mgr.a (mgr.14373) 5403 : audit [DBG] from='client.125970 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:41:58.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:41:58 smithi086 bash[24289]: audit 2024-09-16T07:41:57.928297+0000 mgr.a (mgr.14373) 5403 : audit [DBG] from='client.125970 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:41:58.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:41:58 smithi047 bash[22744]: audit 2024-09-16T07:41:57.928297+0000 mgr.a (mgr.14373) 5403 : audit [DBG] from='client.125970 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:41:58.375 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:41:58.376 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:41:58.376 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:41:58.376 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:41:58.376 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:41:59.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:41:59 smithi086 bash[24289]: cluster 2024-09-16T07:41:58.979184+0000 mgr.a (mgr.14373) 5404 : cluster [DBG] pgmap v3747: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:41:59.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:41:59 smithi047 bash[22744]: cluster 2024-09-16T07:41:58.979184+0000 mgr.a (mgr.14373) 5404 : cluster [DBG] pgmap v3747: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:41:59.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:41:59 smithi157 bash[24585]: cluster 2024-09-16T07:41:58.979184+0000 mgr.a (mgr.14373) 5404 : cluster [DBG] pgmap v3747: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:42:01.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:42:01 smithi157 bash[24585]: cluster 2024-09-16T07:42:00.979952+0000 mgr.a (mgr.14373) 5405 : cluster [DBG] pgmap v3748: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:42:01.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:42:01 smithi086 bash[24289]: cluster 2024-09-16T07:42:00.979952+0000 mgr.a (mgr.14373) 5405 : cluster [DBG] pgmap v3748: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:42:01.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:42:01 smithi047 bash[22744]: cluster 2024-09-16T07:42:00.979952+0000 mgr.a (mgr.14373) 5405 : cluster [DBG] pgmap v3748: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:42:03.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:42:03 smithi157 bash[24585]: cluster 2024-09-16T07:42:02.982140+0000 mgr.a (mgr.14373) 5406 : cluster [DBG] pgmap v3749: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:42:03.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:42:03 smithi086 bash[24289]: cluster 2024-09-16T07:42:02.982140+0000 mgr.a (mgr.14373) 5406 : cluster [DBG] pgmap v3749: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:42:03.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:42:03 smithi047 bash[22744]: cluster 2024-09-16T07:42:02.982140+0000 mgr.a (mgr.14373) 5406 : cluster [DBG] pgmap v3749: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:42:03.377 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:42:03.378 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:42:03.378 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:42:04.129 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:42:04.130 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:42:04.130 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:42:04.130 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:42:04.130 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:42:04.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:42:04 smithi157 bash[24585]: audit 2024-09-16T07:42:03.709669+0000 mgr.a (mgr.14373) 5407 : audit [DBG] from='client.126045 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:42:04.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:42:04 smithi086 bash[24289]: audit 2024-09-16T07:42:03.709669+0000 mgr.a (mgr.14373) 5407 : audit [DBG] from='client.126045 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:42:04.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:42:04 smithi047 bash[22744]: audit 2024-09-16T07:42:03.709669+0000 mgr.a (mgr.14373) 5407 : audit [DBG] from='client.126045 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:42:05.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:42:05 smithi086 bash[24289]: cluster 2024-09-16T07:42:04.983177+0000 mgr.a (mgr.14373) 5408 : cluster [DBG] pgmap v3750: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:42:05.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:42:05 smithi047 bash[22744]: cluster 2024-09-16T07:42:04.983177+0000 mgr.a (mgr.14373) 5408 : cluster [DBG] pgmap v3750: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:42:05.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:42:05 smithi157 bash[24585]: cluster 2024-09-16T07:42:04.983177+0000 mgr.a (mgr.14373) 5408 : cluster [DBG] pgmap v3750: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:42:07.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:42:07 smithi157 bash[24585]: cluster 2024-09-16T07:42:06.985476+0000 mgr.a (mgr.14373) 5409 : cluster [DBG] pgmap v3751: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:42:07.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:42:07 smithi086 bash[24289]: cluster 2024-09-16T07:42:06.985476+0000 mgr.a (mgr.14373) 5409 : cluster [DBG] pgmap v3751: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:42:07.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:42:07 smithi047 bash[22744]: cluster 2024-09-16T07:42:06.985476+0000 mgr.a (mgr.14373) 5409 : cluster [DBG] pgmap v3751: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:42:09.131 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:42:09.132 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:42:09.133 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:42:09.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:42:09 smithi157 bash[24585]: cluster 2024-09-16T07:42:08.986420+0000 mgr.a (mgr.14373) 5410 : cluster [DBG] pgmap v3752: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:42:09.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:42:09 smithi086 bash[24289]: cluster 2024-09-16T07:42:08.986420+0000 mgr.a (mgr.14373) 5410 : cluster [DBG] pgmap v3752: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:42:09.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:42:09 smithi047 bash[22744]: cluster 2024-09-16T07:42:08.986420+0000 mgr.a (mgr.14373) 5410 : cluster [DBG] pgmap v3752: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:42:09.906 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:42:09.906 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:42:09.906 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:42:09.906 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:42:09.906 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:42:10.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:42:10 smithi157 bash[24585]: audit 2024-09-16T07:42:09.472555+0000 mgr.a (mgr.14373) 5411 : audit [DBG] from='client.126120 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:42:10.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:42:10 smithi086 bash[24289]: audit 2024-09-16T07:42:09.472555+0000 mgr.a (mgr.14373) 5411 : audit [DBG] from='client.126120 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:42:10.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:42:10 smithi047 bash[22744]: audit 2024-09-16T07:42:09.472555+0000 mgr.a (mgr.14373) 5411 : audit [DBG] from='client.126120 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:42:11.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:42:11 smithi086 bash[24289]: cluster 2024-09-16T07:42:10.987442+0000 mgr.a (mgr.14373) 5412 : cluster [DBG] pgmap v3753: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:42:11.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:42:11 smithi047 bash[22744]: cluster 2024-09-16T07:42:10.987442+0000 mgr.a (mgr.14373) 5412 : cluster [DBG] pgmap v3753: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:42:11.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:42:11 smithi157 bash[24585]: cluster 2024-09-16T07:42:10.987442+0000 mgr.a (mgr.14373) 5412 : cluster [DBG] pgmap v3753: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:42:13.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:42:13 smithi157 bash[24585]: cluster 2024-09-16T07:42:12.989808+0000 mgr.a (mgr.14373) 5413 : cluster [DBG] pgmap v3754: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:42:13.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:42:13 smithi086 bash[24289]: cluster 2024-09-16T07:42:12.989808+0000 mgr.a (mgr.14373) 5413 : cluster [DBG] pgmap v3754: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:42:13.341 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:42:13 smithi047 bash[22744]: cluster 2024-09-16T07:42:12.989808+0000 mgr.a (mgr.14373) 5413 : cluster [DBG] pgmap v3754: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:42:14.907 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:42:14.908 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:42:14.908 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:42:15.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:42:15 smithi157 bash[24585]: cluster 2024-09-16T07:42:14.990736+0000 mgr.a (mgr.14373) 5414 : cluster [DBG] pgmap v3755: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:42:15.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:42:15 smithi086 bash[24289]: cluster 2024-09-16T07:42:14.990736+0000 mgr.a (mgr.14373) 5414 : cluster [DBG] pgmap v3755: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:42:15.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:42:15 smithi047 bash[22744]: cluster 2024-09-16T07:42:14.990736+0000 mgr.a (mgr.14373) 5414 : cluster [DBG] pgmap v3755: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:42:15.683 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:42:15.684 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:42:15.684 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:42:15.684 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:42:15.684 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:42:16.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:42:16 smithi086 bash[24289]: audit 2024-09-16T07:42:15.246708+0000 mgr.a (mgr.14373) 5415 : audit [DBG] from='client.126192 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:42:16.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:42:16 smithi047 bash[22744]: audit 2024-09-16T07:42:15.246708+0000 mgr.a (mgr.14373) 5415 : audit [DBG] from='client.126192 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:42:16.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:42:16 smithi157 bash[24585]: audit 2024-09-16T07:42:15.246708+0000 mgr.a (mgr.14373) 5415 : audit [DBG] from='client.126192 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:42:17.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:42:17 smithi086 bash[24289]: cluster 2024-09-16T07:42:16.993009+0000 mgr.a (mgr.14373) 5416 : cluster [DBG] pgmap v3756: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:42:17.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:42:17 smithi047 bash[22744]: cluster 2024-09-16T07:42:16.993009+0000 mgr.a (mgr.14373) 5416 : cluster [DBG] pgmap v3756: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:42:17.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:42:17 smithi157 bash[24585]: cluster 2024-09-16T07:42:16.993009+0000 mgr.a (mgr.14373) 5416 : cluster [DBG] pgmap v3756: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:42:19.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:42:19 smithi157 bash[24585]: cluster 2024-09-16T07:42:18.993765+0000 mgr.a (mgr.14373) 5417 : cluster [DBG] pgmap v3757: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:42:19.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:42:19 smithi086 bash[24289]: cluster 2024-09-16T07:42:18.993765+0000 mgr.a (mgr.14373) 5417 : cluster [DBG] pgmap v3757: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:42:19.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:42:19 smithi047 bash[22744]: cluster 2024-09-16T07:42:18.993765+0000 mgr.a (mgr.14373) 5417 : cluster [DBG] pgmap v3757: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:42:20.685 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:42:20.686 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:42:20.686 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:42:21.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:42:21 smithi086 bash[24289]: cluster 2024-09-16T07:42:20.994480+0000 mgr.a (mgr.14373) 5418 : cluster [DBG] pgmap v3758: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:42:21.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:42:21 smithi047 bash[22744]: cluster 2024-09-16T07:42:20.994480+0000 mgr.a (mgr.14373) 5418 : cluster [DBG] pgmap v3758: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:42:21.454 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:42:21.454 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:42:21.454 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:42:21.454 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:42:21.455 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:42:21.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:42:21 smithi157 bash[24585]: cluster 2024-09-16T07:42:20.994480+0000 mgr.a (mgr.14373) 5418 : cluster [DBG] pgmap v3758: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:42:22.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:42:22 smithi086 bash[24289]: audit 2024-09-16T07:42:21.019001+0000 mgr.a (mgr.14373) 5419 : audit [DBG] from='client.126264 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:42:22.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:42:22 smithi047 bash[22744]: audit 2024-09-16T07:42:21.019001+0000 mgr.a (mgr.14373) 5419 : audit [DBG] from='client.126264 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:42:22.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:42:22 smithi157 bash[24585]: audit 2024-09-16T07:42:21.019001+0000 mgr.a (mgr.14373) 5419 : audit [DBG] from='client.126264 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:42:23.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:42:23 smithi086 bash[24289]: cluster 2024-09-16T07:42:22.996767+0000 mgr.a (mgr.14373) 5420 : cluster [DBG] pgmap v3759: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-16T07:42:23.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:42:23 smithi047 bash[22744]: cluster 2024-09-16T07:42:22.996767+0000 mgr.a (mgr.14373) 5420 : cluster [DBG] pgmap v3759: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-16T07:42:23.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:42:23 smithi157 bash[24585]: cluster 2024-09-16T07:42:22.996767+0000 mgr.a (mgr.14373) 5420 : cluster [DBG] pgmap v3759: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-16T07:42:25.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:42:25 smithi086 bash[24289]: cluster 2024-09-16T07:42:24.997574+0000 mgr.a (mgr.14373) 5421 : cluster [DBG] pgmap v3760: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T07:42:25.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:42:25 smithi047 bash[22744]: cluster 2024-09-16T07:42:24.997574+0000 mgr.a (mgr.14373) 5421 : cluster [DBG] pgmap v3760: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T07:42:25.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:42:25 smithi157 bash[24585]: cluster 2024-09-16T07:42:24.997574+0000 mgr.a (mgr.14373) 5421 : cluster [DBG] pgmap v3760: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T07:42:26.456 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:42:26.457 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:42:26.460 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:42:27.201 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:42:27.201 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:42:27.201 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:42:27.201 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:42:27.201 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:42:27.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:42:27 smithi086 bash[24289]: audit 2024-09-16T07:42:26.791983+0000 mgr.a (mgr.14373) 5422 : audit [DBG] from='client.126339 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:42:27.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:42:27 smithi086 bash[24289]: cluster 2024-09-16T07:42:26.999075+0000 mgr.a (mgr.14373) 5423 : cluster [DBG] pgmap v3761: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:42:27.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:42:27 smithi047 bash[22744]: audit 2024-09-16T07:42:26.791983+0000 mgr.a (mgr.14373) 5422 : audit [DBG] from='client.126339 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:42:27.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:42:27 smithi047 bash[22744]: cluster 2024-09-16T07:42:26.999075+0000 mgr.a (mgr.14373) 5423 : cluster [DBG] pgmap v3761: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:42:27.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:42:27 smithi157 bash[24585]: audit 2024-09-16T07:42:26.791983+0000 mgr.a (mgr.14373) 5422 : audit [DBG] from='client.126339 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:42:27.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:42:27 smithi157 bash[24585]: cluster 2024-09-16T07:42:26.999075+0000 mgr.a (mgr.14373) 5423 : cluster [DBG] pgmap v3761: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:42:28.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:42:28 smithi047 bash[22744]: audit 2024-09-16T07:42:28.521854+0000 mon.b (mon.2) 526 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T07:42:29.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:42:28 smithi157 bash[24585]: audit 2024-09-16T07:42:28.521854+0000 mon.b (mon.2) 526 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T07:42:29.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:42:28 smithi086 bash[24289]: audit 2024-09-16T07:42:28.521854+0000 mon.b (mon.2) 526 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T07:42:29.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:42:29 smithi047 bash[22744]: cluster 2024-09-16T07:42:28.999866+0000 mgr.a (mgr.14373) 5424 : cluster [DBG] pgmap v3762: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T07:42:29.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:42:29 smithi047 bash[22744]: audit 2024-09-16T07:42:29.350962+0000 mon.b (mon.2) 527 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T07:42:29.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:42:29 smithi047 bash[22744]: audit 2024-09-16T07:42:29.353067+0000 mon.b (mon.2) 528 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T07:42:29.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:42:29 smithi047 bash[22744]: audit 2024-09-16T07:42:29.365820+0000 mon.a (mon.0) 896 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:42:29.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:42:29 smithi047 bash[22744]: audit 2024-09-16T07:42:29.369817+0000 mon.b (mon.2) 529 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:42:30.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:42:29 smithi157 bash[24585]: cluster 2024-09-16T07:42:28.999866+0000 mgr.a (mgr.14373) 5424 : cluster [DBG] pgmap v3762: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T07:42:30.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:42:29 smithi157 bash[24585]: audit 2024-09-16T07:42:29.350962+0000 mon.b (mon.2) 527 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T07:42:30.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:42:29 smithi157 bash[24585]: audit 2024-09-16T07:42:29.353067+0000 mon.b (mon.2) 528 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T07:42:30.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:42:29 smithi157 bash[24585]: audit 2024-09-16T07:42:29.365820+0000 mon.a (mon.0) 896 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:42:30.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:42:29 smithi157 bash[24585]: audit 2024-09-16T07:42:29.369817+0000 mon.b (mon.2) 529 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:42:30.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:42:29 smithi086 bash[24289]: cluster 2024-09-16T07:42:28.999866+0000 mgr.a (mgr.14373) 5424 : cluster [DBG] pgmap v3762: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T07:42:30.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:42:29 smithi086 bash[24289]: audit 2024-09-16T07:42:29.350962+0000 mon.b (mon.2) 527 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T07:42:30.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:42:29 smithi086 bash[24289]: audit 2024-09-16T07:42:29.353067+0000 mon.b (mon.2) 528 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T07:42:30.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:42:29 smithi086 bash[24289]: audit 2024-09-16T07:42:29.365820+0000 mon.a (mon.0) 896 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:42:30.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:42:29 smithi086 bash[24289]: audit 2024-09-16T07:42:29.369817+0000 mon.b (mon.2) 529 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:42:30.584 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 07:42:30 smithi047 bash[22994]: debug 2024-09-16T07:42:30.113+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T07:42:30.585 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 07:42:30 smithi047 bash[22994]: debug 2024-09-16T07:42:30.117+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T07:42:30.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:42:30 smithi047 bash[22744]: audit 2024-09-16T07:42:29.373771+0000 mgr.a (mgr.14373) 5425 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:42:31.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:42:30 smithi157 bash[24585]: audit 2024-09-16T07:42:29.373771+0000 mgr.a (mgr.14373) 5425 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:42:31.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:42:30 smithi086 bash[24289]: audit 2024-09-16T07:42:29.373771+0000 mgr.a (mgr.14373) 5425 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:42:32.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:42:31 smithi157 bash[24585]: audit 2024-09-16T07:42:30.116355+0000 mgr.a (mgr.14373) 5426 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T07:42:32.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:42:31 smithi157 bash[24585]: cephadm 2024-09-16T07:42:30.118407+0000 mgr.a (mgr.14373) 5427 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T07:42:32.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:42:31 smithi157 bash[24585]: cluster 2024-09-16T07:42:31.000814+0000 mgr.a (mgr.14373) 5428 : cluster [DBG] pgmap v3763: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T07:42:32.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:42:31 smithi086 bash[24289]: audit 2024-09-16T07:42:30.116355+0000 mgr.a (mgr.14373) 5426 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T07:42:32.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:42:31 smithi086 bash[24289]: cephadm 2024-09-16T07:42:30.118407+0000 mgr.a (mgr.14373) 5427 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T07:42:32.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:42:31 smithi086 bash[24289]: cluster 2024-09-16T07:42:31.000814+0000 mgr.a (mgr.14373) 5428 : cluster [DBG] pgmap v3763: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T07:42:32.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:42:31 smithi047 bash[22744]: audit 2024-09-16T07:42:30.116355+0000 mgr.a (mgr.14373) 5426 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T07:42:32.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:42:31 smithi047 bash[22744]: cephadm 2024-09-16T07:42:30.118407+0000 mgr.a (mgr.14373) 5427 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T07:42:32.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:42:31 smithi047 bash[22744]: cluster 2024-09-16T07:42:31.000814+0000 mgr.a (mgr.14373) 5428 : cluster [DBG] pgmap v3763: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T07:42:32.202 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:42:32.203 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:42:32.203 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:42:32.949 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:42:32.949 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:42:32.949 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:42:32.949 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:42:32.950 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:42:33.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:42:33 smithi086 bash[24289]: audit 2024-09-16T07:42:32.536543+0000 mgr.a (mgr.14373) 5429 : audit [DBG] from='client.126519 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:42:33.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:42:33 smithi086 bash[24289]: cluster 2024-09-16T07:42:33.002996+0000 mgr.a (mgr.14373) 5430 : cluster [DBG] pgmap v3764: 225 pgs: 225 active+clean; 589 KiB data, 125 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:42:33.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:42:33 smithi047 bash[22744]: audit 2024-09-16T07:42:32.536543+0000 mgr.a (mgr.14373) 5429 : audit [DBG] from='client.126519 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:42:33.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:42:33 smithi047 bash[22744]: cluster 2024-09-16T07:42:33.002996+0000 mgr.a (mgr.14373) 5430 : cluster [DBG] pgmap v3764: 225 pgs: 225 active+clean; 589 KiB data, 125 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:42:33.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:42:33 smithi157 bash[24585]: audit 2024-09-16T07:42:32.536543+0000 mgr.a (mgr.14373) 5429 : audit [DBG] from='client.126519 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:42:33.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:42:33 smithi157 bash[24585]: cluster 2024-09-16T07:42:33.002996+0000 mgr.a (mgr.14373) 5430 : cluster [DBG] pgmap v3764: 225 pgs: 225 active+clean; 589 KiB data, 125 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:42:35.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:42:35 smithi086 bash[24289]: cluster 2024-09-16T07:42:35.003723+0000 mgr.a (mgr.14373) 5431 : cluster [DBG] pgmap v3765: 225 pgs: 225 active+clean; 589 KiB data, 125 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T07:42:35.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:42:35 smithi047 bash[22744]: cluster 2024-09-16T07:42:35.003723+0000 mgr.a (mgr.14373) 5431 : cluster [DBG] pgmap v3765: 225 pgs: 225 active+clean; 589 KiB data, 125 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T07:42:35.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:42:35 smithi157 bash[24585]: cluster 2024-09-16T07:42:35.003723+0000 mgr.a (mgr.14373) 5431 : cluster [DBG] pgmap v3765: 225 pgs: 225 active+clean; 589 KiB data, 125 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T07:42:37.950 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:42:37.951 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:42:37.951 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:42:38.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:42:38 smithi086 bash[24289]: cluster 2024-09-16T07:42:37.005685+0000 mgr.a (mgr.14373) 5432 : cluster [DBG] pgmap v3766: 225 pgs: 225 active+clean; 589 KiB data, 125 MiB used, 268 GiB / 268 GiB avail; 7.4 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:42:38.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:42:38 smithi047 bash[22744]: cluster 2024-09-16T07:42:37.005685+0000 mgr.a (mgr.14373) 5432 : cluster [DBG] pgmap v3766: 225 pgs: 225 active+clean; 589 KiB data, 125 MiB used, 268 GiB / 268 GiB avail; 7.4 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:42:38.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:42:38 smithi157 bash[24585]: cluster 2024-09-16T07:42:37.005685+0000 mgr.a (mgr.14373) 5432 : cluster [DBG] pgmap v3766: 225 pgs: 225 active+clean; 589 KiB data, 125 MiB used, 268 GiB / 268 GiB avail; 7.4 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:42:38.698 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:42:38.698 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:42:38.698 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:42:38.698 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:42:38.698 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:42:39.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:42:39 smithi047 bash[22744]: audit 2024-09-16T07:42:38.285436+0000 mgr.a (mgr.14373) 5433 : audit [DBG] from='client.126597 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:42:39.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:42:39 smithi157 bash[24585]: audit 2024-09-16T07:42:38.285436+0000 mgr.a (mgr.14373) 5433 : audit [DBG] from='client.126597 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:42:39.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:42:39 smithi086 bash[24289]: audit 2024-09-16T07:42:38.285436+0000 mgr.a (mgr.14373) 5433 : audit [DBG] from='client.126597 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:42:40.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:42:40 smithi047 bash[22744]: cluster 2024-09-16T07:42:39.006661+0000 mgr.a (mgr.14373) 5434 : cluster [DBG] pgmap v3767: 225 pgs: 225 active+clean; 589 KiB data, 125 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:42:40.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:42:40 smithi157 bash[24585]: cluster 2024-09-16T07:42:39.006661+0000 mgr.a (mgr.14373) 5434 : cluster [DBG] pgmap v3767: 225 pgs: 225 active+clean; 589 KiB data, 125 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:42:40.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:42:40 smithi086 bash[24289]: cluster 2024-09-16T07:42:39.006661+0000 mgr.a (mgr.14373) 5434 : cluster [DBG] pgmap v3767: 225 pgs: 225 active+clean; 589 KiB data, 125 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:42:42.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:42:42 smithi047 bash[22744]: cluster 2024-09-16T07:42:41.007486+0000 mgr.a (mgr.14373) 5435 : cluster [DBG] pgmap v3768: 225 pgs: 225 active+clean; 589 KiB data, 125 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:42:42.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:42:42 smithi157 bash[24585]: cluster 2024-09-16T07:42:41.007486+0000 mgr.a (mgr.14373) 5435 : cluster [DBG] pgmap v3768: 225 pgs: 225 active+clean; 589 KiB data, 125 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:42:42.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:42:42 smithi086 bash[24289]: cluster 2024-09-16T07:42:41.007486+0000 mgr.a (mgr.14373) 5435 : cluster [DBG] pgmap v3768: 225 pgs: 225 active+clean; 589 KiB data, 125 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:42:43.699 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:42:43.700 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:42:43.700 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:42:44.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:42:44 smithi047 bash[22744]: cluster 2024-09-16T07:42:43.009676+0000 mgr.a (mgr.14373) 5436 : cluster [DBG] pgmap v3769: 225 pgs: 225 active+clean; 589 KiB data, 125 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:42:44.486 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:42:44.486 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:42:44.486 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:42:44.486 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:42:44.486 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:42:44.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:42:44 smithi157 bash[24585]: cluster 2024-09-16T07:42:43.009676+0000 mgr.a (mgr.14373) 5436 : cluster [DBG] pgmap v3769: 225 pgs: 225 active+clean; 589 KiB data, 125 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:42:44.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:42:44 smithi086 bash[24289]: cluster 2024-09-16T07:42:43.009676+0000 mgr.a (mgr.14373) 5436 : cluster [DBG] pgmap v3769: 225 pgs: 225 active+clean; 589 KiB data, 125 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:42:45.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:42:45 smithi047 bash[22744]: audit 2024-09-16T07:42:44.044725+0000 mgr.a (mgr.14373) 5437 : audit [DBG] from='client.126675 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:42:45.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:42:45 smithi157 bash[24585]: audit 2024-09-16T07:42:44.044725+0000 mgr.a (mgr.14373) 5437 : audit [DBG] from='client.126675 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:42:45.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:42:45 smithi086 bash[24289]: audit 2024-09-16T07:42:44.044725+0000 mgr.a (mgr.14373) 5437 : audit [DBG] from='client.126675 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:42:46.559 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:42:46 smithi157 bash[24585]: cluster 2024-09-16T07:42:45.010696+0000 mgr.a (mgr.14373) 5438 : cluster [DBG] pgmap v3770: 225 pgs: 225 active+clean; 589 KiB data, 125 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:42:46.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:42:46 smithi086 bash[24289]: cluster 2024-09-16T07:42:45.010696+0000 mgr.a (mgr.14373) 5438 : cluster [DBG] pgmap v3770: 225 pgs: 225 active+clean; 589 KiB data, 125 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:42:46.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:42:46 smithi047 bash[22744]: cluster 2024-09-16T07:42:45.010696+0000 mgr.a (mgr.14373) 5438 : cluster [DBG] pgmap v3770: 225 pgs: 225 active+clean; 589 KiB data, 125 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:42:48.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:42:48 smithi157 bash[24585]: cluster 2024-09-16T07:42:47.012846+0000 mgr.a (mgr.14373) 5439 : cluster [DBG] pgmap v3771: 225 pgs: 225 active+clean; 589 KiB data, 125 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:42:48.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:42:48 smithi086 bash[24289]: cluster 2024-09-16T07:42:47.012846+0000 mgr.a (mgr.14373) 5439 : cluster [DBG] pgmap v3771: 225 pgs: 225 active+clean; 589 KiB data, 125 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:42:48.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:42:48 smithi047 bash[22744]: cluster 2024-09-16T07:42:47.012846+0000 mgr.a (mgr.14373) 5439 : cluster [DBG] pgmap v3771: 225 pgs: 225 active+clean; 589 KiB data, 125 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:42:49.487 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:42:49.488 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:42:49.489 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:42:50.270 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:42:50.270 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:42:50.270 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:42:50.270 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:42:50.270 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:42:50.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:42:50 smithi157 bash[24585]: cluster 2024-09-16T07:42:49.013596+0000 mgr.a (mgr.14373) 5440 : cluster [DBG] pgmap v3772: 225 pgs: 225 active+clean; 589 KiB data, 125 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:42:50.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:42:50 smithi157 bash[24585]: audit 2024-09-16T07:42:49.826486+0000 mgr.a (mgr.14373) 5441 : audit [DBG] from='client.126753 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:42:50.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:42:50 smithi086 bash[24289]: cluster 2024-09-16T07:42:49.013596+0000 mgr.a (mgr.14373) 5440 : cluster [DBG] pgmap v3772: 225 pgs: 225 active+clean; 589 KiB data, 125 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:42:50.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:42:50 smithi086 bash[24289]: audit 2024-09-16T07:42:49.826486+0000 mgr.a (mgr.14373) 5441 : audit [DBG] from='client.126753 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:42:50.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:42:50 smithi047 bash[22744]: cluster 2024-09-16T07:42:49.013596+0000 mgr.a (mgr.14373) 5440 : cluster [DBG] pgmap v3772: 225 pgs: 225 active+clean; 589 KiB data, 125 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:42:50.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:42:50 smithi047 bash[22744]: audit 2024-09-16T07:42:49.826486+0000 mgr.a (mgr.14373) 5441 : audit [DBG] from='client.126753 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:42:52.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:42:52 smithi157 bash[24585]: cluster 2024-09-16T07:42:51.014596+0000 mgr.a (mgr.14373) 5442 : cluster [DBG] pgmap v3773: 225 pgs: 225 active+clean; 589 KiB data, 125 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:42:52.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:42:52 smithi086 bash[24289]: cluster 2024-09-16T07:42:51.014596+0000 mgr.a (mgr.14373) 5442 : cluster [DBG] pgmap v3773: 225 pgs: 225 active+clean; 589 KiB data, 125 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:42:52.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:42:52 smithi047 bash[22744]: cluster 2024-09-16T07:42:51.014596+0000 mgr.a (mgr.14373) 5442 : cluster [DBG] pgmap v3773: 225 pgs: 225 active+clean; 589 KiB data, 125 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:42:55.271 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:42:55.272 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:42:55.272 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:42:55.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:42:55 smithi157 bash[24585]: cluster 2024-09-16T07:42:53.016875+0000 mgr.a (mgr.14373) 5443 : cluster [DBG] pgmap v3774: 225 pgs: 225 active+clean; 589 KiB data, 125 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:42:55.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:42:55 smithi086 bash[24289]: cluster 2024-09-16T07:42:53.016875+0000 mgr.a (mgr.14373) 5443 : cluster [DBG] pgmap v3774: 225 pgs: 225 active+clean; 589 KiB data, 125 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:42:55.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:42:55 smithi047 bash[22744]: cluster 2024-09-16T07:42:53.016875+0000 mgr.a (mgr.14373) 5443 : cluster [DBG] pgmap v3774: 225 pgs: 225 active+clean; 589 KiB data, 125 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:42:56.047 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:42:56.047 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:42:56.047 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:42:56.047 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:42:56.047 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:42:57.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:42:57 smithi157 bash[24585]: cluster 2024-09-16T07:42:55.017630+0000 mgr.a (mgr.14373) 5444 : cluster [DBG] pgmap v3775: 225 pgs: 225 active+clean; 589 KiB data, 125 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:42:57.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:42:57 smithi157 bash[24585]: audit 2024-09-16T07:42:55.609340+0000 mgr.a (mgr.14373) 5445 : audit [DBG] from='client.126831 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:42:57.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:42:57 smithi086 bash[24289]: cluster 2024-09-16T07:42:55.017630+0000 mgr.a (mgr.14373) 5444 : cluster [DBG] pgmap v3775: 225 pgs: 225 active+clean; 589 KiB data, 125 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:42:57.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:42:57 smithi086 bash[24289]: audit 2024-09-16T07:42:55.609340+0000 mgr.a (mgr.14373) 5445 : audit [DBG] from='client.126831 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:42:57.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:42:57 smithi047 bash[22744]: cluster 2024-09-16T07:42:55.017630+0000 mgr.a (mgr.14373) 5444 : cluster [DBG] pgmap v3775: 225 pgs: 225 active+clean; 589 KiB data, 125 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:42:57.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:42:57 smithi047 bash[22744]: audit 2024-09-16T07:42:55.609340+0000 mgr.a (mgr.14373) 5445 : audit [DBG] from='client.126831 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:42:59.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:42:59 smithi157 bash[24585]: cluster 2024-09-16T07:42:57.020023+0000 mgr.a (mgr.14373) 5446 : cluster [DBG] pgmap v3776: 225 pgs: 225 active+clean; 589 KiB data, 125 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:42:59.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:42:59 smithi086 bash[24289]: cluster 2024-09-16T07:42:57.020023+0000 mgr.a (mgr.14373) 5446 : cluster [DBG] pgmap v3776: 225 pgs: 225 active+clean; 589 KiB data, 125 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:42:59.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:42:59 smithi047 bash[22744]: cluster 2024-09-16T07:42:57.020023+0000 mgr.a (mgr.14373) 5446 : cluster [DBG] pgmap v3776: 225 pgs: 225 active+clean; 589 KiB data, 125 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:43:00.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:43:00 smithi157 bash[24585]: cluster 2024-09-16T07:42:59.020821+0000 mgr.a (mgr.14373) 5447 : cluster [DBG] pgmap v3777: 225 pgs: 225 active+clean; 589 KiB data, 125 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:43:00.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:43:00 smithi086 bash[24289]: cluster 2024-09-16T07:42:59.020821+0000 mgr.a (mgr.14373) 5447 : cluster [DBG] pgmap v3777: 225 pgs: 225 active+clean; 589 KiB data, 125 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:43:00.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:43:00 smithi047 bash[22744]: cluster 2024-09-16T07:42:59.020821+0000 mgr.a (mgr.14373) 5447 : cluster [DBG] pgmap v3777: 225 pgs: 225 active+clean; 589 KiB data, 125 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:43:01.048 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:43:01.049 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:43:01.049 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:43:01.808 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:43:01.809 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:43:01.809 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:43:01.809 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:43:01.809 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:43:02.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:43:02 smithi047 bash[22744]: cluster 2024-09-16T07:43:01.021584+0000 mgr.a (mgr.14373) 5448 : cluster [DBG] pgmap v3778: 225 pgs: 225 active+clean; 589 KiB data, 125 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:43:02.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:43:02 smithi047 bash[22744]: audit 2024-09-16T07:43:01.386053+0000 mgr.a (mgr.14373) 5449 : audit [DBG] from='client.126909 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:43:02.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:43:02 smithi157 bash[24585]: cluster 2024-09-16T07:43:01.021584+0000 mgr.a (mgr.14373) 5448 : cluster [DBG] pgmap v3778: 225 pgs: 225 active+clean; 589 KiB data, 125 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:43:02.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:43:02 smithi157 bash[24585]: audit 2024-09-16T07:43:01.386053+0000 mgr.a (mgr.14373) 5449 : audit [DBG] from='client.126909 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:43:02.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:43:02 smithi086 bash[24289]: cluster 2024-09-16T07:43:01.021584+0000 mgr.a (mgr.14373) 5448 : cluster [DBG] pgmap v3778: 225 pgs: 225 active+clean; 589 KiB data, 125 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:43:02.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:43:02 smithi086 bash[24289]: audit 2024-09-16T07:43:01.386053+0000 mgr.a (mgr.14373) 5449 : audit [DBG] from='client.126909 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:43:04.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:43:04 smithi047 bash[22744]: cluster 2024-09-16T07:43:03.024378+0000 mgr.a (mgr.14373) 5450 : cluster [DBG] pgmap v3779: 225 pgs: 225 active+clean; 589 KiB data, 125 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:43:04.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:43:04 smithi157 bash[24585]: cluster 2024-09-16T07:43:03.024378+0000 mgr.a (mgr.14373) 5450 : cluster [DBG] pgmap v3779: 225 pgs: 225 active+clean; 589 KiB data, 125 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:43:04.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:43:04 smithi086 bash[24289]: cluster 2024-09-16T07:43:03.024378+0000 mgr.a (mgr.14373) 5450 : cluster [DBG] pgmap v3779: 225 pgs: 225 active+clean; 589 KiB data, 125 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:43:06.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:43:06 smithi047 bash[22744]: cluster 2024-09-16T07:43:05.025141+0000 mgr.a (mgr.14373) 5451 : cluster [DBG] pgmap v3780: 225 pgs: 225 active+clean; 589 KiB data, 125 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:43:06.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:43:06 smithi157 bash[24585]: cluster 2024-09-16T07:43:05.025141+0000 mgr.a (mgr.14373) 5451 : cluster [DBG] pgmap v3780: 225 pgs: 225 active+clean; 589 KiB data, 125 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:43:06.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:43:06 smithi086 bash[24289]: cluster 2024-09-16T07:43:05.025141+0000 mgr.a (mgr.14373) 5451 : cluster [DBG] pgmap v3780: 225 pgs: 225 active+clean; 589 KiB data, 125 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:43:06.810 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:43:06.811 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:43:06.811 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:43:07.579 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:43:07.579 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:43:07.579 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:43:07.579 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:43:07.579 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:43:08.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:43:08 smithi047 bash[22744]: cluster 2024-09-16T07:43:07.027135+0000 mgr.a (mgr.14373) 5452 : cluster [DBG] pgmap v3781: 225 pgs: 225 active+clean; 589 KiB data, 125 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:43:08.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:43:08 smithi047 bash[22744]: audit 2024-09-16T07:43:07.148393+0000 mgr.a (mgr.14373) 5453 : audit [DBG] from='client.126984 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:43:08.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:43:08 smithi157 bash[24585]: cluster 2024-09-16T07:43:07.027135+0000 mgr.a (mgr.14373) 5452 : cluster [DBG] pgmap v3781: 225 pgs: 225 active+clean; 589 KiB data, 125 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:43:08.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:43:08 smithi157 bash[24585]: audit 2024-09-16T07:43:07.148393+0000 mgr.a (mgr.14373) 5453 : audit [DBG] from='client.126984 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:43:08.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:43:08 smithi086 bash[24289]: cluster 2024-09-16T07:43:07.027135+0000 mgr.a (mgr.14373) 5452 : cluster [DBG] pgmap v3781: 225 pgs: 225 active+clean; 589 KiB data, 125 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:43:08.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:43:08 smithi086 bash[24289]: audit 2024-09-16T07:43:07.148393+0000 mgr.a (mgr.14373) 5453 : audit [DBG] from='client.126984 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:43:10.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:43:10 smithi157 bash[24585]: cluster 2024-09-16T07:43:09.028131+0000 mgr.a (mgr.14373) 5454 : cluster [DBG] pgmap v3782: 225 pgs: 225 active+clean; 589 KiB data, 125 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:43:10.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:43:10 smithi086 bash[24289]: cluster 2024-09-16T07:43:09.028131+0000 mgr.a (mgr.14373) 5454 : cluster [DBG] pgmap v3782: 225 pgs: 225 active+clean; 589 KiB data, 125 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:43:10.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:43:10 smithi047 bash[22744]: cluster 2024-09-16T07:43:09.028131+0000 mgr.a (mgr.14373) 5454 : cluster [DBG] pgmap v3782: 225 pgs: 225 active+clean; 589 KiB data, 125 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:43:12.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:43:12 smithi157 bash[24585]: cluster 2024-09-16T07:43:11.028911+0000 mgr.a (mgr.14373) 5455 : cluster [DBG] pgmap v3783: 225 pgs: 225 active+clean; 589 KiB data, 125 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T07:43:12.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:43:12 smithi086 bash[24289]: cluster 2024-09-16T07:43:11.028911+0000 mgr.a (mgr.14373) 5455 : cluster [DBG] pgmap v3783: 225 pgs: 225 active+clean; 589 KiB data, 125 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T07:43:12.580 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:43:12.581 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:43:12.581 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:43:12.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:43:12 smithi047 bash[22744]: cluster 2024-09-16T07:43:11.028911+0000 mgr.a (mgr.14373) 5455 : cluster [DBG] pgmap v3783: 225 pgs: 225 active+clean; 589 KiB data, 125 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T07:43:13.342 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:43:13.342 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:43:13.342 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:43:13.343 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:43:13.343 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:43:13.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:43:13 smithi157 bash[24585]: audit 2024-09-16T07:43:12.916600+0000 mgr.a (mgr.14373) 5456 : audit [DBG] from='client.127056 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:43:13.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:43:13 smithi086 bash[24289]: audit 2024-09-16T07:43:12.916600+0000 mgr.a (mgr.14373) 5456 : audit [DBG] from='client.127056 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:43:13.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:43:13 smithi047 bash[22744]: audit 2024-09-16T07:43:12.916600+0000 mgr.a (mgr.14373) 5456 : audit [DBG] from='client.127056 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:43:14.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:43:14 smithi157 bash[24585]: cluster 2024-09-16T07:43:13.030234+0000 mgr.a (mgr.14373) 5457 : cluster [DBG] pgmap v3784: 225 pgs: 225 active+clean; 589 KiB data, 125 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:43:14.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:43:14 smithi086 bash[24289]: cluster 2024-09-16T07:43:13.030234+0000 mgr.a (mgr.14373) 5457 : cluster [DBG] pgmap v3784: 225 pgs: 225 active+clean; 589 KiB data, 125 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:43:14.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:43:14 smithi047 bash[22744]: cluster 2024-09-16T07:43:13.030234+0000 mgr.a (mgr.14373) 5457 : cluster [DBG] pgmap v3784: 225 pgs: 225 active+clean; 589 KiB data, 125 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:43:16.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:43:16 smithi157 bash[24585]: cluster 2024-09-16T07:43:15.031240+0000 mgr.a (mgr.14373) 5458 : cluster [DBG] pgmap v3785: 225 pgs: 225 active+clean; 589 KiB data, 125 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:43:16.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:43:16 smithi086 bash[24289]: cluster 2024-09-16T07:43:15.031240+0000 mgr.a (mgr.14373) 5458 : cluster [DBG] pgmap v3785: 225 pgs: 225 active+clean; 589 KiB data, 125 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:43:16.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:43:16 smithi047 bash[22744]: cluster 2024-09-16T07:43:15.031240+0000 mgr.a (mgr.14373) 5458 : cluster [DBG] pgmap v3785: 225 pgs: 225 active+clean; 589 KiB data, 125 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:43:18.344 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:43:18.345 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:43:18.345 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:43:18.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:43:18 smithi157 bash[24585]: cluster 2024-09-16T07:43:17.033442+0000 mgr.a (mgr.14373) 5459 : cluster [DBG] pgmap v3786: 225 pgs: 225 active+clean; 589 KiB data, 125 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:43:18.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:43:18 smithi086 bash[24289]: cluster 2024-09-16T07:43:17.033442+0000 mgr.a (mgr.14373) 5459 : cluster [DBG] pgmap v3786: 225 pgs: 225 active+clean; 589 KiB data, 125 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:43:18.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:43:18 smithi047 bash[22744]: cluster 2024-09-16T07:43:17.033442+0000 mgr.a (mgr.14373) 5459 : cluster [DBG] pgmap v3786: 225 pgs: 225 active+clean; 589 KiB data, 125 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:43:19.128 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:43:19.128 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:43:19.128 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:43:19.128 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:43:19.128 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:43:19.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:43:19 smithi157 bash[24585]: audit 2024-09-16T07:43:18.683071+0000 mgr.a (mgr.14373) 5460 : audit [DBG] from='client.127134 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:43:19.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:43:19 smithi086 bash[24289]: audit 2024-09-16T07:43:18.683071+0000 mgr.a (mgr.14373) 5460 : audit [DBG] from='client.127134 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:43:19.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:43:19 smithi047 bash[22744]: audit 2024-09-16T07:43:18.683071+0000 mgr.a (mgr.14373) 5460 : audit [DBG] from='client.127134 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:43:20.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:43:20 smithi157 bash[24585]: cluster 2024-09-16T07:43:19.034120+0000 mgr.a (mgr.14373) 5461 : cluster [DBG] pgmap v3787: 225 pgs: 225 active+clean; 589 KiB data, 125 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:43:20.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:43:20 smithi086 bash[24289]: cluster 2024-09-16T07:43:19.034120+0000 mgr.a (mgr.14373) 5461 : cluster [DBG] pgmap v3787: 225 pgs: 225 active+clean; 589 KiB data, 125 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:43:20.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:43:20 smithi047 bash[22744]: cluster 2024-09-16T07:43:19.034120+0000 mgr.a (mgr.14373) 5461 : cluster [DBG] pgmap v3787: 225 pgs: 225 active+clean; 589 KiB data, 125 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:43:22.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:43:22 smithi157 bash[24585]: cluster 2024-09-16T07:43:21.034908+0000 mgr.a (mgr.14373) 5462 : cluster [DBG] pgmap v3788: 225 pgs: 225 active+clean; 589 KiB data, 125 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:43:22.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:43:22 smithi086 bash[24289]: cluster 2024-09-16T07:43:21.034908+0000 mgr.a (mgr.14373) 5462 : cluster [DBG] pgmap v3788: 225 pgs: 225 active+clean; 589 KiB data, 125 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:43:22.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:43:22 smithi047 bash[22744]: cluster 2024-09-16T07:43:21.034908+0000 mgr.a (mgr.14373) 5462 : cluster [DBG] pgmap v3788: 225 pgs: 225 active+clean; 589 KiB data, 125 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:43:24.129 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:43:24.130 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:43:24.131 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:43:24.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:43:24 smithi157 bash[24585]: cluster 2024-09-16T07:43:23.037122+0000 mgr.a (mgr.14373) 5463 : cluster [DBG] pgmap v3789: 225 pgs: 225 active+clean; 589 KiB data, 125 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:43:24.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:43:24 smithi086 bash[24289]: cluster 2024-09-16T07:43:23.037122+0000 mgr.a (mgr.14373) 5463 : cluster [DBG] pgmap v3789: 225 pgs: 225 active+clean; 589 KiB data, 125 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:43:24.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:43:24 smithi047 bash[22744]: cluster 2024-09-16T07:43:23.037122+0000 mgr.a (mgr.14373) 5463 : cluster [DBG] pgmap v3789: 225 pgs: 225 active+clean; 589 KiB data, 125 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:43:24.904 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:43:24.905 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:43:24.905 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:43:24.905 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:43:24.905 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:43:25.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:43:25 smithi157 bash[24585]: audit 2024-09-16T07:43:24.467459+0000 mgr.a (mgr.14373) 5464 : audit [DBG] from='client.127206 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:43:25.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:43:25 smithi086 bash[24289]: audit 2024-09-16T07:43:24.467459+0000 mgr.a (mgr.14373) 5464 : audit [DBG] from='client.127206 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:43:25.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:43:25 smithi047 bash[22744]: audit 2024-09-16T07:43:24.467459+0000 mgr.a (mgr.14373) 5464 : audit [DBG] from='client.127206 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:43:26.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:43:26 smithi157 bash[24585]: cluster 2024-09-16T07:43:25.038078+0000 mgr.a (mgr.14373) 5465 : cluster [DBG] pgmap v3790: 225 pgs: 225 active+clean; 589 KiB data, 125 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:43:26.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:43:26 smithi086 bash[24289]: cluster 2024-09-16T07:43:25.038078+0000 mgr.a (mgr.14373) 5465 : cluster [DBG] pgmap v3790: 225 pgs: 225 active+clean; 589 KiB data, 125 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:43:26.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:43:26 smithi047 bash[22744]: cluster 2024-09-16T07:43:25.038078+0000 mgr.a (mgr.14373) 5465 : cluster [DBG] pgmap v3790: 225 pgs: 225 active+clean; 589 KiB data, 125 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:43:28.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:43:28 smithi157 bash[24585]: cluster 2024-09-16T07:43:27.040265+0000 mgr.a (mgr.14373) 5466 : cluster [DBG] pgmap v3791: 225 pgs: 225 active+clean; 589 KiB data, 125 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:43:28.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:43:28 smithi086 bash[24289]: cluster 2024-09-16T07:43:27.040265+0000 mgr.a (mgr.14373) 5466 : cluster [DBG] pgmap v3791: 225 pgs: 225 active+clean; 589 KiB data, 125 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:43:28.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:43:28 smithi047 bash[22744]: cluster 2024-09-16T07:43:27.040265+0000 mgr.a (mgr.14373) 5466 : cluster [DBG] pgmap v3791: 225 pgs: 225 active+clean; 589 KiB data, 125 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:43:29.906 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:43:29.907 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:43:29.907 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:43:30.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:43:30 smithi157 bash[24585]: cluster 2024-09-16T07:43:29.041023+0000 mgr.a (mgr.14373) 5467 : cluster [DBG] pgmap v3792: 225 pgs: 225 active+clean; 589 KiB data, 125 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:43:30.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:43:30 smithi086 bash[24289]: cluster 2024-09-16T07:43:29.041023+0000 mgr.a (mgr.14373) 5467 : cluster [DBG] pgmap v3792: 225 pgs: 225 active+clean; 589 KiB data, 125 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:43:30.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:43:30 smithi047 bash[22744]: cluster 2024-09-16T07:43:29.041023+0000 mgr.a (mgr.14373) 5467 : cluster [DBG] pgmap v3792: 225 pgs: 225 active+clean; 589 KiB data, 125 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:43:30.675 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:43:30.676 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:43:30.676 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:43:30.676 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:43:30.676 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:43:31.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:43:31 smithi157 bash[24585]: audit 2024-09-16T07:43:30.171202+0000 mon.b (mon.2) 530 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T07:43:31.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:43:31 smithi157 bash[24585]: audit 2024-09-16T07:43:30.245234+0000 mgr.a (mgr.14373) 5468 : audit [DBG] from='client.127284 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:43:31.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:43:31 smithi157 bash[24585]: audit 2024-09-16T07:43:31.043807+0000 mon.b (mon.2) 531 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T07:43:31.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:43:31 smithi157 bash[24585]: audit 2024-09-16T07:43:31.046074+0000 mon.b (mon.2) 532 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T07:43:31.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:43:31 smithi157 bash[24585]: audit 2024-09-16T07:43:31.057339+0000 mon.a (mon.0) 897 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:43:31.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:43:31 smithi157 bash[24585]: audit 2024-09-16T07:43:31.061455+0000 mon.b (mon.2) 533 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:43:31.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:43:31 smithi086 bash[24289]: audit 2024-09-16T07:43:30.171202+0000 mon.b (mon.2) 530 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T07:43:31.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:43:31 smithi086 bash[24289]: audit 2024-09-16T07:43:30.245234+0000 mgr.a (mgr.14373) 5468 : audit [DBG] from='client.127284 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:43:31.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:43:31 smithi086 bash[24289]: audit 2024-09-16T07:43:31.043807+0000 mon.b (mon.2) 531 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T07:43:31.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:43:31 smithi086 bash[24289]: audit 2024-09-16T07:43:31.046074+0000 mon.b (mon.2) 532 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T07:43:31.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:43:31 smithi086 bash[24289]: audit 2024-09-16T07:43:31.057339+0000 mon.a (mon.0) 897 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:43:31.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:43:31 smithi086 bash[24289]: audit 2024-09-16T07:43:31.061455+0000 mon.b (mon.2) 533 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:43:31.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:43:31 smithi047 bash[22744]: audit 2024-09-16T07:43:30.171202+0000 mon.b (mon.2) 530 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T07:43:31.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:43:31 smithi047 bash[22744]: audit 2024-09-16T07:43:30.245234+0000 mgr.a (mgr.14373) 5468 : audit [DBG] from='client.127284 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:43:31.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:43:31 smithi047 bash[22744]: audit 2024-09-16T07:43:31.043807+0000 mon.b (mon.2) 531 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T07:43:31.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:43:31 smithi047 bash[22744]: audit 2024-09-16T07:43:31.046074+0000 mon.b (mon.2) 532 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T07:43:31.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:43:31 smithi047 bash[22744]: audit 2024-09-16T07:43:31.057339+0000 mon.a (mon.0) 897 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:43:31.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:43:31 smithi047 bash[22744]: audit 2024-09-16T07:43:31.061455+0000 mon.b (mon.2) 533 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:43:32.088 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 07:43:31 smithi047 bash[22994]: debug 2024-09-16T07:43:31.816+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T07:43:32.088 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 07:43:31 smithi047 bash[22994]: debug 2024-09-16T07:43:31.816+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T07:43:32.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:43:32 smithi157 bash[24585]: cluster 2024-09-16T07:43:31.041642+0000 mgr.a (mgr.14373) 5469 : cluster [DBG] pgmap v3793: 225 pgs: 225 active+clean; 589 KiB data, 125 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:43:32.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:43:32 smithi157 bash[24585]: audit 2024-09-16T07:43:31.065801+0000 mgr.a (mgr.14373) 5470 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:43:32.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:43:32 smithi157 bash[24585]: audit 2024-09-16T07:43:31.818909+0000 mgr.a (mgr.14373) 5471 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T07:43:32.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:43:32 smithi157 bash[24585]: cephadm 2024-09-16T07:43:31.821557+0000 mgr.a (mgr.14373) 5472 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T07:43:32.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:43:32 smithi086 bash[24289]: cluster 2024-09-16T07:43:31.041642+0000 mgr.a (mgr.14373) 5469 : cluster [DBG] pgmap v3793: 225 pgs: 225 active+clean; 589 KiB data, 125 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:43:32.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:43:32 smithi086 bash[24289]: audit 2024-09-16T07:43:31.065801+0000 mgr.a (mgr.14373) 5470 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:43:32.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:43:32 smithi086 bash[24289]: audit 2024-09-16T07:43:31.818909+0000 mgr.a (mgr.14373) 5471 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T07:43:32.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:43:32 smithi086 bash[24289]: cephadm 2024-09-16T07:43:31.821557+0000 mgr.a (mgr.14373) 5472 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T07:43:32.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:43:32 smithi047 bash[22744]: cluster 2024-09-16T07:43:31.041642+0000 mgr.a (mgr.14373) 5469 : cluster [DBG] pgmap v3793: 225 pgs: 225 active+clean; 589 KiB data, 125 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:43:32.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:43:32 smithi047 bash[22744]: audit 2024-09-16T07:43:31.065801+0000 mgr.a (mgr.14373) 5470 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:43:32.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:43:32 smithi047 bash[22744]: audit 2024-09-16T07:43:31.818909+0000 mgr.a (mgr.14373) 5471 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T07:43:32.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:43:32 smithi047 bash[22744]: cephadm 2024-09-16T07:43:31.821557+0000 mgr.a (mgr.14373) 5472 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T07:43:34.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:43:34 smithi157 bash[24585]: cluster 2024-09-16T07:43:33.044337+0000 mgr.a (mgr.14373) 5473 : cluster [DBG] pgmap v3794: 225 pgs: 225 active+clean; 589 KiB data, 125 MiB used, 268 GiB / 268 GiB avail; 4.3 KiB/s rd, 255 B/s wr, 4 op/s 2024-09-16T07:43:34.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:43:34 smithi086 bash[24289]: cluster 2024-09-16T07:43:33.044337+0000 mgr.a (mgr.14373) 5473 : cluster [DBG] pgmap v3794: 225 pgs: 225 active+clean; 589 KiB data, 125 MiB used, 268 GiB / 268 GiB avail; 4.3 KiB/s rd, 255 B/s wr, 4 op/s 2024-09-16T07:43:34.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:43:34 smithi047 bash[22744]: cluster 2024-09-16T07:43:33.044337+0000 mgr.a (mgr.14373) 5473 : cluster [DBG] pgmap v3794: 225 pgs: 225 active+clean; 589 KiB data, 125 MiB used, 268 GiB / 268 GiB avail; 4.3 KiB/s rd, 255 B/s wr, 4 op/s 2024-09-16T07:43:35.677 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:43:35.678 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:43:35.678 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:43:36.430 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:43:36.430 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:43:36.430 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:43:36.430 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:43:36.430 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:43:36.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:43:36 smithi157 bash[24585]: cluster 2024-09-16T07:43:35.045117+0000 mgr.a (mgr.14373) 5474 : cluster [DBG] pgmap v3795: 225 pgs: 225 active+clean; 589 KiB data, 125 MiB used, 268 GiB / 268 GiB avail; 3.4 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-16T07:43:36.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:43:36 smithi157 bash[24585]: audit 2024-09-16T07:43:36.011404+0000 mgr.a (mgr.14373) 5475 : audit [DBG] from='client.127467 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:43:36.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:43:36 smithi086 bash[24289]: cluster 2024-09-16T07:43:35.045117+0000 mgr.a (mgr.14373) 5474 : cluster [DBG] pgmap v3795: 225 pgs: 225 active+clean; 589 KiB data, 125 MiB used, 268 GiB / 268 GiB avail; 3.4 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-16T07:43:36.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:43:36 smithi086 bash[24289]: audit 2024-09-16T07:43:36.011404+0000 mgr.a (mgr.14373) 5475 : audit [DBG] from='client.127467 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:43:36.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:43:36 smithi047 bash[22744]: cluster 2024-09-16T07:43:35.045117+0000 mgr.a (mgr.14373) 5474 : cluster [DBG] pgmap v3795: 225 pgs: 225 active+clean; 589 KiB data, 125 MiB used, 268 GiB / 268 GiB avail; 3.4 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-16T07:43:36.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:43:36 smithi047 bash[22744]: audit 2024-09-16T07:43:36.011404+0000 mgr.a (mgr.14373) 5475 : audit [DBG] from='client.127467 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:43:38.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:43:38 smithi157 bash[24585]: cluster 2024-09-16T07:43:37.047562+0000 mgr.a (mgr.14373) 5476 : cluster [DBG] pgmap v3796: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:43:38.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:43:38 smithi086 bash[24289]: cluster 2024-09-16T07:43:37.047562+0000 mgr.a (mgr.14373) 5476 : cluster [DBG] pgmap v3796: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:43:38.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:43:38 smithi047 bash[22744]: cluster 2024-09-16T07:43:37.047562+0000 mgr.a (mgr.14373) 5476 : cluster [DBG] pgmap v3796: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:43:40.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:43:40 smithi157 bash[24585]: cluster 2024-09-16T07:43:39.048354+0000 mgr.a (mgr.14373) 5477 : cluster [DBG] pgmap v3797: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:43:40.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:43:40 smithi086 bash[24289]: cluster 2024-09-16T07:43:39.048354+0000 mgr.a (mgr.14373) 5477 : cluster [DBG] pgmap v3797: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:43:40.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:43:40 smithi047 bash[22744]: cluster 2024-09-16T07:43:39.048354+0000 mgr.a (mgr.14373) 5477 : cluster [DBG] pgmap v3797: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:43:41.431 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:43:41.432 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:43:41.432 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:43:42.177 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:43:42.178 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:43:42.178 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:43:42.178 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:43:42.178 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:43:42.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:43:42 smithi157 bash[24585]: cluster 2024-09-16T07:43:41.049166+0000 mgr.a (mgr.14373) 5478 : cluster [DBG] pgmap v3798: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:43:42.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:43:42 smithi157 bash[24585]: audit 2024-09-16T07:43:41.764679+0000 mgr.a (mgr.14373) 5479 : audit [DBG] from='client.127545 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:43:42.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:43:42 smithi086 bash[24289]: cluster 2024-09-16T07:43:41.049166+0000 mgr.a (mgr.14373) 5478 : cluster [DBG] pgmap v3798: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:43:42.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:43:42 smithi086 bash[24289]: audit 2024-09-16T07:43:41.764679+0000 mgr.a (mgr.14373) 5479 : audit [DBG] from='client.127545 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:43:42.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:43:42 smithi047 bash[22744]: cluster 2024-09-16T07:43:41.049166+0000 mgr.a (mgr.14373) 5478 : cluster [DBG] pgmap v3798: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:43:42.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:43:42 smithi047 bash[22744]: audit 2024-09-16T07:43:41.764679+0000 mgr.a (mgr.14373) 5479 : audit [DBG] from='client.127545 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:43:44.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:43:44 smithi157 bash[24585]: cluster 2024-09-16T07:43:43.051963+0000 mgr.a (mgr.14373) 5480 : cluster [DBG] pgmap v3799: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:43:44.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:43:44 smithi086 bash[24289]: cluster 2024-09-16T07:43:43.051963+0000 mgr.a (mgr.14373) 5480 : cluster [DBG] pgmap v3799: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:43:44.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:43:44 smithi047 bash[22744]: cluster 2024-09-16T07:43:43.051963+0000 mgr.a (mgr.14373) 5480 : cluster [DBG] pgmap v3799: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:43:46.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:43:46 smithi157 bash[24585]: cluster 2024-09-16T07:43:45.052730+0000 mgr.a (mgr.14373) 5481 : cluster [DBG] pgmap v3800: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 4.5 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-16T07:43:46.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:43:46 smithi086 bash[24289]: cluster 2024-09-16T07:43:45.052730+0000 mgr.a (mgr.14373) 5481 : cluster [DBG] pgmap v3800: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 4.5 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-16T07:43:46.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:43:46 smithi047 bash[22744]: cluster 2024-09-16T07:43:45.052730+0000 mgr.a (mgr.14373) 5481 : cluster [DBG] pgmap v3800: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 4.5 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-16T07:43:47.179 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:43:47.180 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:43:47.180 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:43:47.964 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:43:47.965 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:43:47.965 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:43:47.965 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:43:47.965 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:43:48.569 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:43:48 smithi157 bash[24585]: cluster 2024-09-16T07:43:47.054701+0000 mgr.a (mgr.14373) 5482 : cluster [DBG] pgmap v3801: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 5.4 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-16T07:43:48.569 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:43:48 smithi157 bash[24585]: audit 2024-09-16T07:43:47.518690+0000 mgr.a (mgr.14373) 5483 : audit [DBG] from='client.127620 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:43:48.573 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:43:48 smithi086 bash[24289]: cluster 2024-09-16T07:43:47.054701+0000 mgr.a (mgr.14373) 5482 : cluster [DBG] pgmap v3801: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 5.4 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-16T07:43:48.573 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:43:48 smithi086 bash[24289]: audit 2024-09-16T07:43:47.518690+0000 mgr.a (mgr.14373) 5483 : audit [DBG] from='client.127620 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:43:48.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:43:48 smithi047 bash[22744]: cluster 2024-09-16T07:43:47.054701+0000 mgr.a (mgr.14373) 5482 : cluster [DBG] pgmap v3801: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 5.4 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-16T07:43:48.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:43:48 smithi047 bash[22744]: audit 2024-09-16T07:43:47.518690+0000 mgr.a (mgr.14373) 5483 : audit [DBG] from='client.127620 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:43:50.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:43:50 smithi157 bash[24585]: cluster 2024-09-16T07:43:49.055655+0000 mgr.a (mgr.14373) 5484 : cluster [DBG] pgmap v3802: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:43:50.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:43:50 smithi086 bash[24289]: cluster 2024-09-16T07:43:49.055655+0000 mgr.a (mgr.14373) 5484 : cluster [DBG] pgmap v3802: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:43:50.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:43:50 smithi047 bash[22744]: cluster 2024-09-16T07:43:49.055655+0000 mgr.a (mgr.14373) 5484 : cluster [DBG] pgmap v3802: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:43:52.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:43:52 smithi157 bash[24585]: cluster 2024-09-16T07:43:51.056472+0000 mgr.a (mgr.14373) 5485 : cluster [DBG] pgmap v3803: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T07:43:52.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:43:52 smithi086 bash[24289]: cluster 2024-09-16T07:43:51.056472+0000 mgr.a (mgr.14373) 5485 : cluster [DBG] pgmap v3803: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T07:43:52.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:43:52 smithi047 bash[22744]: cluster 2024-09-16T07:43:51.056472+0000 mgr.a (mgr.14373) 5485 : cluster [DBG] pgmap v3803: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T07:43:52.966 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:43:52.967 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:43:52.967 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:43:53.747 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:43:53.747 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:43:53.747 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:43:53.748 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:43:53.748 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:43:54.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:43:54 smithi157 bash[24585]: cluster 2024-09-16T07:43:53.058687+0000 mgr.a (mgr.14373) 5486 : cluster [DBG] pgmap v3804: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:43:54.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:43:54 smithi157 bash[24585]: audit 2024-09-16T07:43:53.302740+0000 mgr.a (mgr.14373) 5487 : audit [DBG] from='client.127695 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:43:54.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:43:54 smithi086 bash[24289]: cluster 2024-09-16T07:43:53.058687+0000 mgr.a (mgr.14373) 5486 : cluster [DBG] pgmap v3804: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:43:54.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:43:54 smithi086 bash[24289]: audit 2024-09-16T07:43:53.302740+0000 mgr.a (mgr.14373) 5487 : audit [DBG] from='client.127695 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:43:54.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:43:54 smithi047 bash[22744]: cluster 2024-09-16T07:43:53.058687+0000 mgr.a (mgr.14373) 5486 : cluster [DBG] pgmap v3804: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:43:54.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:43:54 smithi047 bash[22744]: audit 2024-09-16T07:43:53.302740+0000 mgr.a (mgr.14373) 5487 : audit [DBG] from='client.127695 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:43:56.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:43:56 smithi157 bash[24585]: cluster 2024-09-16T07:43:55.059648+0000 mgr.a (mgr.14373) 5488 : cluster [DBG] pgmap v3805: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:43:56.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:43:56 smithi086 bash[24289]: cluster 2024-09-16T07:43:55.059648+0000 mgr.a (mgr.14373) 5488 : cluster [DBG] pgmap v3805: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:43:56.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:43:56 smithi047 bash[22744]: cluster 2024-09-16T07:43:55.059648+0000 mgr.a (mgr.14373) 5488 : cluster [DBG] pgmap v3805: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:43:58.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:43:58 smithi157 bash[24585]: cluster 2024-09-16T07:43:57.061786+0000 mgr.a (mgr.14373) 5489 : cluster [DBG] pgmap v3806: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:43:58.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:43:58 smithi086 bash[24289]: cluster 2024-09-16T07:43:57.061786+0000 mgr.a (mgr.14373) 5489 : cluster [DBG] pgmap v3806: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:43:58.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:43:58 smithi047 bash[22744]: cluster 2024-09-16T07:43:57.061786+0000 mgr.a (mgr.14373) 5489 : cluster [DBG] pgmap v3806: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:43:58.748 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:43:58.749 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:43:58.749 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:43:59.520 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:43:59.521 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:43:59.521 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:43:59.521 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:43:59.521 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:44:00.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:44:00 smithi157 bash[24585]: cluster 2024-09-16T07:43:59.062530+0000 mgr.a (mgr.14373) 5490 : cluster [DBG] pgmap v3807: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:44:00.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:44:00 smithi157 bash[24585]: audit 2024-09-16T07:43:59.091571+0000 mgr.a (mgr.14373) 5491 : audit [DBG] from='client.127773 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:44:00.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:44:00 smithi086 bash[24289]: cluster 2024-09-16T07:43:59.062530+0000 mgr.a (mgr.14373) 5490 : cluster [DBG] pgmap v3807: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:44:00.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:44:00 smithi086 bash[24289]: audit 2024-09-16T07:43:59.091571+0000 mgr.a (mgr.14373) 5491 : audit [DBG] from='client.127773 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:44:00.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:44:00 smithi047 bash[22744]: cluster 2024-09-16T07:43:59.062530+0000 mgr.a (mgr.14373) 5490 : cluster [DBG] pgmap v3807: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:44:00.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:44:00 smithi047 bash[22744]: audit 2024-09-16T07:43:59.091571+0000 mgr.a (mgr.14373) 5491 : audit [DBG] from='client.127773 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:44:02.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:44:02 smithi157 bash[24585]: cluster 2024-09-16T07:44:01.063435+0000 mgr.a (mgr.14373) 5492 : cluster [DBG] pgmap v3808: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:44:02.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:44:02 smithi086 bash[24289]: cluster 2024-09-16T07:44:01.063435+0000 mgr.a (mgr.14373) 5492 : cluster [DBG] pgmap v3808: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:44:02.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:44:02 smithi047 bash[22744]: cluster 2024-09-16T07:44:01.063435+0000 mgr.a (mgr.14373) 5492 : cluster [DBG] pgmap v3808: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:44:04.522 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:44:04.522 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:44:04.522 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:44:04.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:44:04 smithi157 bash[24585]: cluster 2024-09-16T07:44:03.065656+0000 mgr.a (mgr.14373) 5493 : cluster [DBG] pgmap v3809: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:44:04.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:44:04 smithi086 bash[24289]: cluster 2024-09-16T07:44:03.065656+0000 mgr.a (mgr.14373) 5493 : cluster [DBG] pgmap v3809: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:44:04.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:44:04 smithi047 bash[22744]: cluster 2024-09-16T07:44:03.065656+0000 mgr.a (mgr.14373) 5493 : cluster [DBG] pgmap v3809: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:44:05.289 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:44:05.290 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:44:05.290 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:44:05.290 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:44:05.290 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:44:05.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:44:05 smithi157 bash[24585]: audit 2024-09-16T07:44:04.858878+0000 mgr.a (mgr.14373) 5494 : audit [DBG] from='client.127851 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:44:05.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:44:05 smithi086 bash[24289]: audit 2024-09-16T07:44:04.858878+0000 mgr.a (mgr.14373) 5494 : audit [DBG] from='client.127851 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:44:05.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:44:05 smithi047 bash[22744]: audit 2024-09-16T07:44:04.858878+0000 mgr.a (mgr.14373) 5494 : audit [DBG] from='client.127851 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:44:06.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:44:06 smithi157 bash[24585]: cluster 2024-09-16T07:44:05.066224+0000 mgr.a (mgr.14373) 5495 : cluster [DBG] pgmap v3810: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:44:06.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:44:06 smithi086 bash[24289]: cluster 2024-09-16T07:44:05.066224+0000 mgr.a (mgr.14373) 5495 : cluster [DBG] pgmap v3810: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:44:06.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:44:06 smithi047 bash[22744]: cluster 2024-09-16T07:44:05.066224+0000 mgr.a (mgr.14373) 5495 : cluster [DBG] pgmap v3810: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:44:08.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:44:08 smithi157 bash[24585]: cluster 2024-09-16T07:44:07.068445+0000 mgr.a (mgr.14373) 5496 : cluster [DBG] pgmap v3811: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:44:08.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:44:08 smithi086 bash[24289]: cluster 2024-09-16T07:44:07.068445+0000 mgr.a (mgr.14373) 5496 : cluster [DBG] pgmap v3811: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:44:08.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:44:08 smithi047 bash[22744]: cluster 2024-09-16T07:44:07.068445+0000 mgr.a (mgr.14373) 5496 : cluster [DBG] pgmap v3811: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:44:10.291 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:44:10.292 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:44:10.292 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:44:10.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:44:10 smithi157 bash[24585]: cluster 2024-09-16T07:44:09.069202+0000 mgr.a (mgr.14373) 5497 : cluster [DBG] pgmap v3812: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:44:10.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:44:10 smithi086 bash[24289]: cluster 2024-09-16T07:44:09.069202+0000 mgr.a (mgr.14373) 5497 : cluster [DBG] pgmap v3812: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:44:10.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:44:10 smithi047 bash[22744]: cluster 2024-09-16T07:44:09.069202+0000 mgr.a (mgr.14373) 5497 : cluster [DBG] pgmap v3812: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:44:11.056 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:44:11.056 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:44:11.056 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:44:11.056 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:44:11.056 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:44:11.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:44:11 smithi157 bash[24585]: audit 2024-09-16T07:44:10.629503+0000 mgr.a (mgr.14373) 5498 : audit [DBG] from='client.127929 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:44:11.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:44:11 smithi086 bash[24289]: audit 2024-09-16T07:44:10.629503+0000 mgr.a (mgr.14373) 5498 : audit [DBG] from='client.127929 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:44:11.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:44:11 smithi047 bash[22744]: audit 2024-09-16T07:44:10.629503+0000 mgr.a (mgr.14373) 5498 : audit [DBG] from='client.127929 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:44:12.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:44:12 smithi157 bash[24585]: cluster 2024-09-16T07:44:11.069749+0000 mgr.a (mgr.14373) 5499 : cluster [DBG] pgmap v3813: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:44:12.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:44:12 smithi086 bash[24289]: cluster 2024-09-16T07:44:11.069749+0000 mgr.a (mgr.14373) 5499 : cluster [DBG] pgmap v3813: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:44:12.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:44:12 smithi047 bash[22744]: cluster 2024-09-16T07:44:11.069749+0000 mgr.a (mgr.14373) 5499 : cluster [DBG] pgmap v3813: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:44:14.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:44:14 smithi157 bash[24585]: cluster 2024-09-16T07:44:13.071983+0000 mgr.a (mgr.14373) 5500 : cluster [DBG] pgmap v3814: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:44:14.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:44:14 smithi086 bash[24289]: cluster 2024-09-16T07:44:13.071983+0000 mgr.a (mgr.14373) 5500 : cluster [DBG] pgmap v3814: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:44:14.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:44:14 smithi047 bash[22744]: cluster 2024-09-16T07:44:13.071983+0000 mgr.a (mgr.14373) 5500 : cluster [DBG] pgmap v3814: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:44:16.057 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:44:16.058 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:44:16.058 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:44:16.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:44:16 smithi157 bash[24585]: cluster 2024-09-16T07:44:15.072734+0000 mgr.a (mgr.14373) 5501 : cluster [DBG] pgmap v3815: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:44:16.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:44:16 smithi086 bash[24289]: cluster 2024-09-16T07:44:15.072734+0000 mgr.a (mgr.14373) 5501 : cluster [DBG] pgmap v3815: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:44:16.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:44:16 smithi047 bash[22744]: cluster 2024-09-16T07:44:15.072734+0000 mgr.a (mgr.14373) 5501 : cluster [DBG] pgmap v3815: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:44:16.799 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:44:16.800 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:44:16.800 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:44:16.800 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:44:16.800 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:44:17.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:44:17 smithi157 bash[24585]: audit 2024-09-16T07:44:16.394201+0000 mgr.a (mgr.14373) 5502 : audit [DBG] from='client.128004 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:44:17.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:44:17 smithi086 bash[24289]: audit 2024-09-16T07:44:16.394201+0000 mgr.a (mgr.14373) 5502 : audit [DBG] from='client.128004 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:44:17.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:44:17 smithi047 bash[22744]: audit 2024-09-16T07:44:16.394201+0000 mgr.a (mgr.14373) 5502 : audit [DBG] from='client.128004 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:44:18.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:44:18 smithi157 bash[24585]: cluster 2024-09-16T07:44:17.075406+0000 mgr.a (mgr.14373) 5503 : cluster [DBG] pgmap v3816: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:44:18.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:44:18 smithi086 bash[24289]: cluster 2024-09-16T07:44:17.075406+0000 mgr.a (mgr.14373) 5503 : cluster [DBG] pgmap v3816: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:44:18.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:44:18 smithi047 bash[22744]: cluster 2024-09-16T07:44:17.075406+0000 mgr.a (mgr.14373) 5503 : cluster [DBG] pgmap v3816: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:44:20.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:44:20 smithi157 bash[24585]: cluster 2024-09-16T07:44:19.076173+0000 mgr.a (mgr.14373) 5504 : cluster [DBG] pgmap v3817: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:44:20.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:44:20 smithi086 bash[24289]: cluster 2024-09-16T07:44:19.076173+0000 mgr.a (mgr.14373) 5504 : cluster [DBG] pgmap v3817: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:44:20.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:44:20 smithi047 bash[22744]: cluster 2024-09-16T07:44:19.076173+0000 mgr.a (mgr.14373) 5504 : cluster [DBG] pgmap v3817: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:44:21.801 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:44:21.802 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:44:21.802 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:44:22.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:44:22 smithi157 bash[24585]: cluster 2024-09-16T07:44:21.076947+0000 mgr.a (mgr.14373) 5505 : cluster [DBG] pgmap v3818: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T07:44:22.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:44:22 smithi086 bash[24289]: cluster 2024-09-16T07:44:21.076947+0000 mgr.a (mgr.14373) 5505 : cluster [DBG] pgmap v3818: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T07:44:22.585 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:44:22.585 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:44:22.585 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:44:22.585 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:44:22.585 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:44:22.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:44:22 smithi047 bash[22744]: cluster 2024-09-16T07:44:21.076947+0000 mgr.a (mgr.14373) 5505 : cluster [DBG] pgmap v3818: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T07:44:23.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:44:23 smithi157 bash[24585]: audit 2024-09-16T07:44:22.141775+0000 mgr.a (mgr.14373) 5506 : audit [DBG] from='client.128079 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:44:23.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:44:23 smithi086 bash[24289]: audit 2024-09-16T07:44:22.141775+0000 mgr.a (mgr.14373) 5506 : audit [DBG] from='client.128079 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:44:23.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:44:23 smithi047 bash[22744]: audit 2024-09-16T07:44:22.141775+0000 mgr.a (mgr.14373) 5506 : audit [DBG] from='client.128079 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:44:24.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:44:24 smithi157 bash[24585]: cluster 2024-09-16T07:44:23.079796+0000 mgr.a (mgr.14373) 5507 : cluster [DBG] pgmap v3819: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:44:24.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:44:24 smithi086 bash[24289]: cluster 2024-09-16T07:44:23.079796+0000 mgr.a (mgr.14373) 5507 : cluster [DBG] pgmap v3819: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:44:24.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:44:24 smithi047 bash[22744]: cluster 2024-09-16T07:44:23.079796+0000 mgr.a (mgr.14373) 5507 : cluster [DBG] pgmap v3819: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:44:26.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:44:26 smithi157 bash[24585]: cluster 2024-09-16T07:44:25.080578+0000 mgr.a (mgr.14373) 5508 : cluster [DBG] pgmap v3820: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:44:26.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:44:26 smithi086 bash[24289]: cluster 2024-09-16T07:44:25.080578+0000 mgr.a (mgr.14373) 5508 : cluster [DBG] pgmap v3820: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:44:26.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:44:26 smithi047 bash[22744]: cluster 2024-09-16T07:44:25.080578+0000 mgr.a (mgr.14373) 5508 : cluster [DBG] pgmap v3820: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:44:27.587 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:44:27.587 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:44:27.587 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:44:28.350 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:44:28.350 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:44:28.350 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:44:28.350 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:44:28.350 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:44:28.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:44:28 smithi086 bash[24289]: cluster 2024-09-16T07:44:27.082579+0000 mgr.a (mgr.14373) 5509 : cluster [DBG] pgmap v3821: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:44:28.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:44:28 smithi086 bash[24289]: audit 2024-09-16T07:44:27.922246+0000 mgr.a (mgr.14373) 5510 : audit [DBG] from='client.128157 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:44:28.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:44:28 smithi047 bash[22744]: cluster 2024-09-16T07:44:27.082579+0000 mgr.a (mgr.14373) 5509 : cluster [DBG] pgmap v3821: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:44:28.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:44:28 smithi047 bash[22744]: audit 2024-09-16T07:44:27.922246+0000 mgr.a (mgr.14373) 5510 : audit [DBG] from='client.128157 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:44:28.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:44:28 smithi157 bash[24585]: cluster 2024-09-16T07:44:27.082579+0000 mgr.a (mgr.14373) 5509 : cluster [DBG] pgmap v3821: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:44:28.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:44:28 smithi157 bash[24585]: audit 2024-09-16T07:44:27.922246+0000 mgr.a (mgr.14373) 5510 : audit [DBG] from='client.128157 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:44:30.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:44:30 smithi086 bash[24289]: cluster 2024-09-16T07:44:29.083540+0000 mgr.a (mgr.14373) 5511 : cluster [DBG] pgmap v3822: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:44:30.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:44:30 smithi047 bash[22744]: cluster 2024-09-16T07:44:29.083540+0000 mgr.a (mgr.14373) 5511 : cluster [DBG] pgmap v3822: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:44:30.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:44:30 smithi157 bash[24585]: cluster 2024-09-16T07:44:29.083540+0000 mgr.a (mgr.14373) 5511 : cluster [DBG] pgmap v3822: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:44:32.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:44:32 smithi086 bash[24289]: cluster 2024-09-16T07:44:31.084353+0000 mgr.a (mgr.14373) 5512 : cluster [DBG] pgmap v3823: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:44:32.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:44:32 smithi086 bash[24289]: audit 2024-09-16T07:44:31.882184+0000 mon.b (mon.2) 534 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T07:44:32.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:44:32 smithi047 bash[22744]: cluster 2024-09-16T07:44:31.084353+0000 mgr.a (mgr.14373) 5512 : cluster [DBG] pgmap v3823: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:44:32.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:44:32 smithi047 bash[22744]: audit 2024-09-16T07:44:31.882184+0000 mon.b (mon.2) 534 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T07:44:32.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:44:32 smithi157 bash[24585]: cluster 2024-09-16T07:44:31.084353+0000 mgr.a (mgr.14373) 5512 : cluster [DBG] pgmap v3823: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:44:32.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:44:32 smithi157 bash[24585]: audit 2024-09-16T07:44:31.882184+0000 mon.b (mon.2) 534 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T07:44:33.352 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:44:33.352 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:44:33.353 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:44:34.102 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:44:34.102 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:44:34.102 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:44:34.102 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:44:34.102 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:44:34.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:44:34 smithi047 bash[22744]: cluster 2024-09-16T07:44:33.086594+0000 mgr.a (mgr.14373) 5513 : cluster [DBG] pgmap v3824: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:44:34.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:44:34 smithi047 bash[22744]: audit 2024-09-16T07:44:33.679952+0000 mgr.a (mgr.14373) 5514 : audit [DBG] from='client.128235 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:44:34.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:44:34 smithi157 bash[24585]: cluster 2024-09-16T07:44:33.086594+0000 mgr.a (mgr.14373) 5513 : cluster [DBG] pgmap v3824: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:44:34.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:44:34 smithi157 bash[24585]: audit 2024-09-16T07:44:33.679952+0000 mgr.a (mgr.14373) 5514 : audit [DBG] from='client.128235 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:44:34.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:44:34 smithi086 bash[24289]: cluster 2024-09-16T07:44:33.086594+0000 mgr.a (mgr.14373) 5513 : cluster [DBG] pgmap v3824: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:44:34.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:44:34 smithi086 bash[24289]: audit 2024-09-16T07:44:33.679952+0000 mgr.a (mgr.14373) 5514 : audit [DBG] from='client.128235 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:44:36.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:44:36 smithi047 bash[22744]: cluster 2024-09-16T07:44:35.087537+0000 mgr.a (mgr.14373) 5515 : cluster [DBG] pgmap v3825: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:44:36.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:44:36 smithi157 bash[24585]: cluster 2024-09-16T07:44:35.087537+0000 mgr.a (mgr.14373) 5515 : cluster [DBG] pgmap v3825: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:44:36.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:44:36 smithi086 bash[24289]: cluster 2024-09-16T07:44:35.087537+0000 mgr.a (mgr.14373) 5515 : cluster [DBG] pgmap v3825: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:44:38.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:44:38 smithi157 bash[24585]: cluster 2024-09-16T07:44:37.088614+0000 mgr.a (mgr.14373) 5516 : cluster [DBG] pgmap v3826: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:44:38.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:44:38 smithi157 bash[24585]: audit 2024-09-16T07:44:37.222420+0000 mon.a (mon.0) 898 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:44:38.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:44:38 smithi157 bash[24585]: audit 2024-09-16T07:44:37.227940+0000 mon.a (mon.0) 899 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:44:38.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:44:38 smithi157 bash[24585]: audit 2024-09-16T07:44:37.230454+0000 mon.a (mon.0) 900 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:44:38.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:44:38 smithi157 bash[24585]: audit 2024-09-16T07:44:37.232931+0000 mon.a (mon.0) 901 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:44:38.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:44:38 smithi157 bash[24585]: audit 2024-09-16T07:44:37.236794+0000 mon.a (mon.0) 902 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:44:38.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:44:38 smithi157 bash[24585]: audit 2024-09-16T07:44:37.240844+0000 mon.a (mon.0) 903 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:44:38.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:44:38 smithi157 bash[24585]: audit 2024-09-16T07:44:37.959912+0000 mon.b (mon.2) 535 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T07:44:38.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:44:38 smithi157 bash[24585]: audit 2024-09-16T07:44:37.961792+0000 mon.b (mon.2) 536 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T07:44:38.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:44:38 smithi157 bash[24585]: audit 2024-09-16T07:44:37.974208+0000 mon.a (mon.0) 904 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:44:38.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:44:38 smithi157 bash[24585]: audit 2024-09-16T07:44:37.977767+0000 mon.b (mon.2) 537 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:44:38.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:44:38 smithi157 bash[24585]: audit 2024-09-16T07:44:37.980632+0000 mgr.a (mgr.14373) 5517 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:44:38.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:44:38 smithi086 bash[24289]: cluster 2024-09-16T07:44:37.088614+0000 mgr.a (mgr.14373) 5516 : cluster [DBG] pgmap v3826: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:44:38.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:44:38 smithi086 bash[24289]: audit 2024-09-16T07:44:37.222420+0000 mon.a (mon.0) 898 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:44:38.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:44:38 smithi086 bash[24289]: audit 2024-09-16T07:44:37.227940+0000 mon.a (mon.0) 899 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:44:38.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:44:38 smithi086 bash[24289]: audit 2024-09-16T07:44:37.230454+0000 mon.a (mon.0) 900 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:44:38.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:44:38 smithi086 bash[24289]: audit 2024-09-16T07:44:37.232931+0000 mon.a (mon.0) 901 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:44:38.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:44:38 smithi086 bash[24289]: audit 2024-09-16T07:44:37.236794+0000 mon.a (mon.0) 902 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:44:38.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:44:38 smithi086 bash[24289]: audit 2024-09-16T07:44:37.240844+0000 mon.a (mon.0) 903 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:44:38.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:44:38 smithi086 bash[24289]: audit 2024-09-16T07:44:37.959912+0000 mon.b (mon.2) 535 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T07:44:38.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:44:38 smithi086 bash[24289]: audit 2024-09-16T07:44:37.961792+0000 mon.b (mon.2) 536 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T07:44:38.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:44:38 smithi086 bash[24289]: audit 2024-09-16T07:44:37.974208+0000 mon.a (mon.0) 904 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:44:38.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:44:38 smithi086 bash[24289]: audit 2024-09-16T07:44:37.977767+0000 mon.b (mon.2) 537 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:44:38.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:44:38 smithi086 bash[24289]: audit 2024-09-16T07:44:37.980632+0000 mgr.a (mgr.14373) 5517 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:44:38.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:44:38 smithi047 bash[22744]: cluster 2024-09-16T07:44:37.088614+0000 mgr.a (mgr.14373) 5516 : cluster [DBG] pgmap v3826: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:44:38.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:44:38 smithi047 bash[22744]: audit 2024-09-16T07:44:37.222420+0000 mon.a (mon.0) 898 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:44:38.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:44:38 smithi047 bash[22744]: audit 2024-09-16T07:44:37.227940+0000 mon.a (mon.0) 899 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:44:38.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:44:38 smithi047 bash[22744]: audit 2024-09-16T07:44:37.230454+0000 mon.a (mon.0) 900 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:44:38.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:44:38 smithi047 bash[22744]: audit 2024-09-16T07:44:37.232931+0000 mon.a (mon.0) 901 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:44:38.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:44:38 smithi047 bash[22744]: audit 2024-09-16T07:44:37.236794+0000 mon.a (mon.0) 902 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:44:38.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:44:38 smithi047 bash[22744]: audit 2024-09-16T07:44:37.240844+0000 mon.a (mon.0) 903 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:44:38.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:44:38 smithi047 bash[22744]: audit 2024-09-16T07:44:37.959912+0000 mon.b (mon.2) 535 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T07:44:38.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:44:38 smithi047 bash[22744]: audit 2024-09-16T07:44:37.961792+0000 mon.b (mon.2) 536 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T07:44:38.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:44:38 smithi047 bash[22744]: audit 2024-09-16T07:44:37.974208+0000 mon.a (mon.0) 904 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:44:38.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:44:38 smithi047 bash[22744]: audit 2024-09-16T07:44:37.977767+0000 mon.b (mon.2) 537 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:44:38.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:44:38 smithi047 bash[22744]: audit 2024-09-16T07:44:37.980632+0000 mgr.a (mgr.14373) 5517 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:44:39.088 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 07:44:38 smithi047 bash[22994]: debug 2024-09-16T07:44:38.698+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T07:44:39.088 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 07:44:38 smithi047 bash[22994]: debug 2024-09-16T07:44:38.702+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T07:44:39.103 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:44:39.104 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:44:39.104 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:44:39.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:44:39 smithi157 bash[24585]: audit 2024-09-16T07:44:38.705651+0000 mgr.a (mgr.14373) 5518 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T07:44:39.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:44:39 smithi157 bash[24585]: cephadm 2024-09-16T07:44:38.708007+0000 mgr.a (mgr.14373) 5519 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T07:44:39.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:44:39 smithi086 bash[24289]: audit 2024-09-16T07:44:38.705651+0000 mgr.a (mgr.14373) 5518 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T07:44:39.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:44:39 smithi086 bash[24289]: cephadm 2024-09-16T07:44:38.708007+0000 mgr.a (mgr.14373) 5519 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T07:44:39.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:44:39 smithi047 bash[22744]: audit 2024-09-16T07:44:38.705651+0000 mgr.a (mgr.14373) 5518 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T07:44:39.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:44:39 smithi047 bash[22744]: cephadm 2024-09-16T07:44:38.708007+0000 mgr.a (mgr.14373) 5519 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T07:44:39.838 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:44:39.838 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:44:39.838 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:44:39.838 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:44:39.838 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:44:40.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:44:40 smithi157 bash[24585]: cluster 2024-09-16T07:44:39.089468+0000 mgr.a (mgr.14373) 5520 : cluster [DBG] pgmap v3827: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:44:40.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:44:40 smithi157 bash[24585]: audit 2024-09-16T07:44:39.430310+0000 mgr.a (mgr.14373) 5521 : audit [DBG] from='client.128415 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:44:40.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:44:40 smithi086 bash[24289]: cluster 2024-09-16T07:44:39.089468+0000 mgr.a (mgr.14373) 5520 : cluster [DBG] pgmap v3827: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:44:40.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:44:40 smithi086 bash[24289]: audit 2024-09-16T07:44:39.430310+0000 mgr.a (mgr.14373) 5521 : audit [DBG] from='client.128415 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:44:40.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:44:40 smithi047 bash[22744]: cluster 2024-09-16T07:44:39.089468+0000 mgr.a (mgr.14373) 5520 : cluster [DBG] pgmap v3827: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:44:40.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:44:40 smithi047 bash[22744]: audit 2024-09-16T07:44:39.430310+0000 mgr.a (mgr.14373) 5521 : audit [DBG] from='client.128415 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:44:42.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:44:42 smithi157 bash[24585]: cluster 2024-09-16T07:44:41.090312+0000 mgr.a (mgr.14373) 5522 : cluster [DBG] pgmap v3828: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:44:42.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:44:42 smithi086 bash[24289]: cluster 2024-09-16T07:44:41.090312+0000 mgr.a (mgr.14373) 5522 : cluster [DBG] pgmap v3828: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:44:42.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:44:42 smithi047 bash[22744]: cluster 2024-09-16T07:44:41.090312+0000 mgr.a (mgr.14373) 5522 : cluster [DBG] pgmap v3828: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:44:44.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:44:44 smithi157 bash[24585]: cluster 2024-09-16T07:44:43.092554+0000 mgr.a (mgr.14373) 5523 : cluster [DBG] pgmap v3829: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:44:44.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:44:44 smithi086 bash[24289]: cluster 2024-09-16T07:44:43.092554+0000 mgr.a (mgr.14373) 5523 : cluster [DBG] pgmap v3829: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:44:44.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:44:44 smithi047 bash[22744]: cluster 2024-09-16T07:44:43.092554+0000 mgr.a (mgr.14373) 5523 : cluster [DBG] pgmap v3829: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:44:44.839 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:44:44.840 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:44:44.840 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:44:45.597 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:44:45.597 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:44:45.597 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:44:45.597 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:44:45.597 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:44:46.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:44:46 smithi157 bash[24585]: cluster 2024-09-16T07:44:45.093314+0000 mgr.a (mgr.14373) 5524 : cluster [DBG] pgmap v3830: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:44:46.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:44:46 smithi157 bash[24585]: audit 2024-09-16T07:44:45.175351+0000 mgr.a (mgr.14373) 5525 : audit [DBG] from='client.128490 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:44:46.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:44:46 smithi086 bash[24289]: cluster 2024-09-16T07:44:45.093314+0000 mgr.a (mgr.14373) 5524 : cluster [DBG] pgmap v3830: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:44:46.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:44:46 smithi086 bash[24289]: audit 2024-09-16T07:44:45.175351+0000 mgr.a (mgr.14373) 5525 : audit [DBG] from='client.128490 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:44:46.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:44:46 smithi047 bash[22744]: cluster 2024-09-16T07:44:45.093314+0000 mgr.a (mgr.14373) 5524 : cluster [DBG] pgmap v3830: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:44:46.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:44:46 smithi047 bash[22744]: audit 2024-09-16T07:44:45.175351+0000 mgr.a (mgr.14373) 5525 : audit [DBG] from='client.128490 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:44:48.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:44:48 smithi157 bash[24585]: cluster 2024-09-16T07:44:47.095681+0000 mgr.a (mgr.14373) 5526 : cluster [DBG] pgmap v3831: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:44:48.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:44:48 smithi086 bash[24289]: cluster 2024-09-16T07:44:47.095681+0000 mgr.a (mgr.14373) 5526 : cluster [DBG] pgmap v3831: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:44:48.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:44:48 smithi047 bash[22744]: cluster 2024-09-16T07:44:47.095681+0000 mgr.a (mgr.14373) 5526 : cluster [DBG] pgmap v3831: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:44:50.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:44:50 smithi157 bash[24585]: cluster 2024-09-16T07:44:49.096431+0000 mgr.a (mgr.14373) 5527 : cluster [DBG] pgmap v3832: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:44:50.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:44:50 smithi086 bash[24289]: cluster 2024-09-16T07:44:49.096431+0000 mgr.a (mgr.14373) 5527 : cluster [DBG] pgmap v3832: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:44:50.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:44:50 smithi047 bash[22744]: cluster 2024-09-16T07:44:49.096431+0000 mgr.a (mgr.14373) 5527 : cluster [DBG] pgmap v3832: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:44:50.598 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:44:50.599 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:44:50.599 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:44:51.385 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:44:51.385 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:44:51.385 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:44:51.385 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:44:51.385 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:44:51.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:44:51 smithi157 bash[24585]: audit 2024-09-16T07:44:50.936554+0000 mgr.a (mgr.14373) 5528 : audit [DBG] from='client.128565 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:44:51.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:44:51 smithi086 bash[24289]: audit 2024-09-16T07:44:50.936554+0000 mgr.a (mgr.14373) 5528 : audit [DBG] from='client.128565 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:44:51.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:44:51 smithi047 bash[22744]: audit 2024-09-16T07:44:50.936554+0000 mgr.a (mgr.14373) 5528 : audit [DBG] from='client.128565 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:44:52.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:44:52 smithi157 bash[24585]: cluster 2024-09-16T07:44:51.096992+0000 mgr.a (mgr.14373) 5529 : cluster [DBG] pgmap v3833: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:44:52.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:44:52 smithi086 bash[24289]: cluster 2024-09-16T07:44:51.096992+0000 mgr.a (mgr.14373) 5529 : cluster [DBG] pgmap v3833: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:44:52.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:44:52 smithi047 bash[22744]: cluster 2024-09-16T07:44:51.096992+0000 mgr.a (mgr.14373) 5529 : cluster [DBG] pgmap v3833: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:44:54.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:44:54 smithi157 bash[24585]: cluster 2024-09-16T07:44:53.099307+0000 mgr.a (mgr.14373) 5530 : cluster [DBG] pgmap v3834: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:44:54.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:44:54 smithi086 bash[24289]: cluster 2024-09-16T07:44:53.099307+0000 mgr.a (mgr.14373) 5530 : cluster [DBG] pgmap v3834: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:44:54.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:44:54 smithi047 bash[22744]: cluster 2024-09-16T07:44:53.099307+0000 mgr.a (mgr.14373) 5530 : cluster [DBG] pgmap v3834: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:44:56.387 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:44:56.387 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:44:56.387 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:44:56.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:44:56 smithi157 bash[24585]: cluster 2024-09-16T07:44:55.100024+0000 mgr.a (mgr.14373) 5531 : cluster [DBG] pgmap v3835: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:44:56.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:44:56 smithi086 bash[24289]: cluster 2024-09-16T07:44:55.100024+0000 mgr.a (mgr.14373) 5531 : cluster [DBG] pgmap v3835: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:44:56.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:44:56 smithi047 bash[22744]: cluster 2024-09-16T07:44:55.100024+0000 mgr.a (mgr.14373) 5531 : cluster [DBG] pgmap v3835: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:44:57.171 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:44:57.171 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:44:57.171 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:44:57.171 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:44:57.172 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:44:57.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:44:57 smithi157 bash[24585]: audit 2024-09-16T07:44:56.724050+0000 mgr.a (mgr.14373) 5532 : audit [DBG] from='client.128643 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:44:57.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:44:57 smithi086 bash[24289]: audit 2024-09-16T07:44:56.724050+0000 mgr.a (mgr.14373) 5532 : audit [DBG] from='client.128643 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:44:57.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:44:57 smithi047 bash[22744]: audit 2024-09-16T07:44:56.724050+0000 mgr.a (mgr.14373) 5532 : audit [DBG] from='client.128643 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:44:58.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:44:58 smithi157 bash[24585]: cluster 2024-09-16T07:44:57.101374+0000 mgr.a (mgr.14373) 5533 : cluster [DBG] pgmap v3836: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:44:58.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:44:58 smithi086 bash[24289]: cluster 2024-09-16T07:44:57.101374+0000 mgr.a (mgr.14373) 5533 : cluster [DBG] pgmap v3836: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:44:58.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:44:58 smithi047 bash[22744]: cluster 2024-09-16T07:44:57.101374+0000 mgr.a (mgr.14373) 5533 : cluster [DBG] pgmap v3836: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:45:00.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:45:00 smithi157 bash[24585]: cluster 2024-09-16T07:44:59.102097+0000 mgr.a (mgr.14373) 5534 : cluster [DBG] pgmap v3837: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T07:45:00.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:45:00 smithi086 bash[24289]: cluster 2024-09-16T07:44:59.102097+0000 mgr.a (mgr.14373) 5534 : cluster [DBG] pgmap v3837: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T07:45:00.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:45:00 smithi047 bash[22744]: cluster 2024-09-16T07:44:59.102097+0000 mgr.a (mgr.14373) 5534 : cluster [DBG] pgmap v3837: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T07:45:02.173 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:45:02.173 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:45:02.174 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:45:02.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:45:02 smithi157 bash[24585]: cluster 2024-09-16T07:45:01.102887+0000 mgr.a (mgr.14373) 5535 : cluster [DBG] pgmap v3838: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T07:45:02.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:45:02 smithi086 bash[24289]: cluster 2024-09-16T07:45:01.102887+0000 mgr.a (mgr.14373) 5535 : cluster [DBG] pgmap v3838: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T07:45:02.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:45:02 smithi047 bash[22744]: cluster 2024-09-16T07:45:01.102887+0000 mgr.a (mgr.14373) 5535 : cluster [DBG] pgmap v3838: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T07:45:02.934 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:45:02.935 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:45:02.935 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:45:02.935 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:45:02.935 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:45:03.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:45:03 smithi157 bash[24585]: audit 2024-09-16T07:45:02.508739+0000 mgr.a (mgr.14373) 5536 : audit [DBG] from='client.128718 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:45:03.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:45:03 smithi086 bash[24289]: audit 2024-09-16T07:45:02.508739+0000 mgr.a (mgr.14373) 5536 : audit [DBG] from='client.128718 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:45:03.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:45:03 smithi047 bash[22744]: audit 2024-09-16T07:45:02.508739+0000 mgr.a (mgr.14373) 5536 : audit [DBG] from='client.128718 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:45:04.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:45:04 smithi086 bash[24289]: cluster 2024-09-16T07:45:03.105655+0000 mgr.a (mgr.14373) 5537 : cluster [DBG] pgmap v3839: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:45:04.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:45:04 smithi047 bash[22744]: cluster 2024-09-16T07:45:03.105655+0000 mgr.a (mgr.14373) 5537 : cluster [DBG] pgmap v3839: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:45:04.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:45:04 smithi157 bash[24585]: cluster 2024-09-16T07:45:03.105655+0000 mgr.a (mgr.14373) 5537 : cluster [DBG] pgmap v3839: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:45:06.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:45:06 smithi086 bash[24289]: cluster 2024-09-16T07:45:05.106455+0000 mgr.a (mgr.14373) 5538 : cluster [DBG] pgmap v3840: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:45:06.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:45:06 smithi047 bash[22744]: cluster 2024-09-16T07:45:05.106455+0000 mgr.a (mgr.14373) 5538 : cluster [DBG] pgmap v3840: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:45:06.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:45:06 smithi157 bash[24585]: cluster 2024-09-16T07:45:05.106455+0000 mgr.a (mgr.14373) 5538 : cluster [DBG] pgmap v3840: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:45:07.936 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:45:07.937 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:45:07.937 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:45:08.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:45:08 smithi086 bash[24289]: cluster 2024-09-16T07:45:07.108417+0000 mgr.a (mgr.14373) 5539 : cluster [DBG] pgmap v3841: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:45:08.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:45:08 smithi047 bash[22744]: cluster 2024-09-16T07:45:07.108417+0000 mgr.a (mgr.14373) 5539 : cluster [DBG] pgmap v3841: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:45:08.688 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:45:08.688 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:45:08.688 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:45:08.688 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:45:08.689 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:45:08.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:45:08 smithi157 bash[24585]: cluster 2024-09-16T07:45:07.108417+0000 mgr.a (mgr.14373) 5539 : cluster [DBG] pgmap v3841: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:45:09.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:45:09 smithi047 bash[22744]: audit 2024-09-16T07:45:08.268076+0000 mgr.a (mgr.14373) 5540 : audit [DBG] from='client.128793 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:45:09.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:45:09 smithi157 bash[24585]: audit 2024-09-16T07:45:08.268076+0000 mgr.a (mgr.14373) 5540 : audit [DBG] from='client.128793 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:45:09.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:45:09 smithi086 bash[24289]: audit 2024-09-16T07:45:08.268076+0000 mgr.a (mgr.14373) 5540 : audit [DBG] from='client.128793 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:45:10.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:45:10 smithi047 bash[22744]: cluster 2024-09-16T07:45:09.109287+0000 mgr.a (mgr.14373) 5541 : cluster [DBG] pgmap v3842: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:45:10.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:45:10 smithi157 bash[24585]: cluster 2024-09-16T07:45:09.109287+0000 mgr.a (mgr.14373) 5541 : cluster [DBG] pgmap v3842: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:45:10.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:45:10 smithi086 bash[24289]: cluster 2024-09-16T07:45:09.109287+0000 mgr.a (mgr.14373) 5541 : cluster [DBG] pgmap v3842: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:45:12.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:45:12 smithi047 bash[22744]: cluster 2024-09-16T07:45:11.110054+0000 mgr.a (mgr.14373) 5542 : cluster [DBG] pgmap v3843: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:45:12.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:45:12 smithi157 bash[24585]: cluster 2024-09-16T07:45:11.110054+0000 mgr.a (mgr.14373) 5542 : cluster [DBG] pgmap v3843: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:45:12.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:45:12 smithi086 bash[24289]: cluster 2024-09-16T07:45:11.110054+0000 mgr.a (mgr.14373) 5542 : cluster [DBG] pgmap v3843: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:45:13.687 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:45:13.687 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:45:13.688 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:45:14.436 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:45:14.437 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:45:14.437 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:45:14.437 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:45:14.437 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:45:14.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:45:14 smithi047 bash[22744]: cluster 2024-09-16T07:45:13.112267+0000 mgr.a (mgr.14373) 5543 : cluster [DBG] pgmap v3844: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:45:14.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:45:14 smithi047 bash[22744]: audit 2024-09-16T07:45:14.021744+0000 mgr.a (mgr.14373) 5544 : audit [DBG] from='client.128871 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:45:14.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:45:14 smithi157 bash[24585]: cluster 2024-09-16T07:45:13.112267+0000 mgr.a (mgr.14373) 5543 : cluster [DBG] pgmap v3844: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:45:14.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:45:14 smithi157 bash[24585]: audit 2024-09-16T07:45:14.021744+0000 mgr.a (mgr.14373) 5544 : audit [DBG] from='client.128871 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:45:14.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:45:14 smithi086 bash[24289]: cluster 2024-09-16T07:45:13.112267+0000 mgr.a (mgr.14373) 5543 : cluster [DBG] pgmap v3844: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:45:14.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:45:14 smithi086 bash[24289]: audit 2024-09-16T07:45:14.021744+0000 mgr.a (mgr.14373) 5544 : audit [DBG] from='client.128871 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:45:16.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:45:16 smithi047 bash[22744]: cluster 2024-09-16T07:45:15.113171+0000 mgr.a (mgr.14373) 5545 : cluster [DBG] pgmap v3845: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:45:16.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:45:16 smithi157 bash[24585]: cluster 2024-09-16T07:45:15.113171+0000 mgr.a (mgr.14373) 5545 : cluster [DBG] pgmap v3845: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:45:16.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:45:16 smithi086 bash[24289]: cluster 2024-09-16T07:45:15.113171+0000 mgr.a (mgr.14373) 5545 : cluster [DBG] pgmap v3845: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:45:18.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:45:18 smithi157 bash[24585]: cluster 2024-09-16T07:45:17.115354+0000 mgr.a (mgr.14373) 5546 : cluster [DBG] pgmap v3846: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:45:18.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:45:18 smithi086 bash[24289]: cluster 2024-09-16T07:45:17.115354+0000 mgr.a (mgr.14373) 5546 : cluster [DBG] pgmap v3846: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:45:18.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:45:18 smithi047 bash[22744]: cluster 2024-09-16T07:45:17.115354+0000 mgr.a (mgr.14373) 5546 : cluster [DBG] pgmap v3846: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:45:19.438 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:45:19.438 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:45:19.438 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:45:20.213 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:45:20.214 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:45:20.214 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:45:20.214 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:45:20.214 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:45:20.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:45:20 smithi157 bash[24585]: cluster 2024-09-16T07:45:19.116120+0000 mgr.a (mgr.14373) 5547 : cluster [DBG] pgmap v3847: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:45:20.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:45:20 smithi157 bash[24585]: audit 2024-09-16T07:45:19.775644+0000 mgr.a (mgr.14373) 5548 : audit [DBG] from='client.128949 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:45:20.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:45:20 smithi086 bash[24289]: cluster 2024-09-16T07:45:19.116120+0000 mgr.a (mgr.14373) 5547 : cluster [DBG] pgmap v3847: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:45:20.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:45:20 smithi086 bash[24289]: audit 2024-09-16T07:45:19.775644+0000 mgr.a (mgr.14373) 5548 : audit [DBG] from='client.128949 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:45:20.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:45:20 smithi047 bash[22744]: cluster 2024-09-16T07:45:19.116120+0000 mgr.a (mgr.14373) 5547 : cluster [DBG] pgmap v3847: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:45:20.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:45:20 smithi047 bash[22744]: audit 2024-09-16T07:45:19.775644+0000 mgr.a (mgr.14373) 5548 : audit [DBG] from='client.128949 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:45:22.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:45:22 smithi157 bash[24585]: cluster 2024-09-16T07:45:21.117033+0000 mgr.a (mgr.14373) 5549 : cluster [DBG] pgmap v3848: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:45:22.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:45:22 smithi086 bash[24289]: cluster 2024-09-16T07:45:21.117033+0000 mgr.a (mgr.14373) 5549 : cluster [DBG] pgmap v3848: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:45:22.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:45:22 smithi047 bash[22744]: cluster 2024-09-16T07:45:21.117033+0000 mgr.a (mgr.14373) 5549 : cluster [DBG] pgmap v3848: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:45:24.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:45:24 smithi157 bash[24585]: cluster 2024-09-16T07:45:23.119284+0000 mgr.a (mgr.14373) 5550 : cluster [DBG] pgmap v3849: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:45:24.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:45:24 smithi086 bash[24289]: cluster 2024-09-16T07:45:23.119284+0000 mgr.a (mgr.14373) 5550 : cluster [DBG] pgmap v3849: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:45:24.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:45:24 smithi047 bash[22744]: cluster 2024-09-16T07:45:23.119284+0000 mgr.a (mgr.14373) 5550 : cluster [DBG] pgmap v3849: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:45:25.215 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:45:25.216 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:45:25.216 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:45:25.943 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:45:25.944 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:45:25.944 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:45:25.944 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:45:25.944 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:45:26.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:45:26 smithi157 bash[24585]: cluster 2024-09-16T07:45:25.120010+0000 mgr.a (mgr.14373) 5551 : cluster [DBG] pgmap v3850: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:45:26.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:45:26 smithi157 bash[24585]: audit 2024-09-16T07:45:25.544841+0000 mgr.a (mgr.14373) 5552 : audit [DBG] from='client.129024 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:45:26.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:45:26 smithi086 bash[24289]: cluster 2024-09-16T07:45:25.120010+0000 mgr.a (mgr.14373) 5551 : cluster [DBG] pgmap v3850: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:45:26.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:45:26 smithi086 bash[24289]: audit 2024-09-16T07:45:25.544841+0000 mgr.a (mgr.14373) 5552 : audit [DBG] from='client.129024 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:45:26.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:45:26 smithi047 bash[22744]: cluster 2024-09-16T07:45:25.120010+0000 mgr.a (mgr.14373) 5551 : cluster [DBG] pgmap v3850: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:45:26.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:45:26 smithi047 bash[22744]: audit 2024-09-16T07:45:25.544841+0000 mgr.a (mgr.14373) 5552 : audit [DBG] from='client.129024 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:45:28.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:45:28 smithi157 bash[24585]: cluster 2024-09-16T07:45:27.122243+0000 mgr.a (mgr.14373) 5553 : cluster [DBG] pgmap v3851: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:45:28.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:45:28 smithi086 bash[24289]: cluster 2024-09-16T07:45:27.122243+0000 mgr.a (mgr.14373) 5553 : cluster [DBG] pgmap v3851: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:45:28.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:45:28 smithi047 bash[22744]: cluster 2024-09-16T07:45:27.122243+0000 mgr.a (mgr.14373) 5553 : cluster [DBG] pgmap v3851: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:45:30.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:45:30 smithi157 bash[24585]: cluster 2024-09-16T07:45:29.122987+0000 mgr.a (mgr.14373) 5554 : cluster [DBG] pgmap v3852: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:45:30.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:45:30 smithi086 bash[24289]: cluster 2024-09-16T07:45:29.122987+0000 mgr.a (mgr.14373) 5554 : cluster [DBG] pgmap v3852: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:45:30.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:45:30 smithi047 bash[22744]: cluster 2024-09-16T07:45:29.122987+0000 mgr.a (mgr.14373) 5554 : cluster [DBG] pgmap v3852: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:45:30.945 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:45:30.946 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:45:30.946 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:45:31.728 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:45:31.729 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:45:31.729 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:45:31.729 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:45:31.729 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:45:32.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:45:32 smithi157 bash[24585]: cluster 2024-09-16T07:45:31.123706+0000 mgr.a (mgr.14373) 5555 : cluster [DBG] pgmap v3853: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:45:32.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:45:32 smithi157 bash[24585]: audit 2024-09-16T07:45:31.289638+0000 mgr.a (mgr.14373) 5556 : audit [DBG] from='client.129099 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:45:32.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:45:32 smithi086 bash[24289]: cluster 2024-09-16T07:45:31.123706+0000 mgr.a (mgr.14373) 5555 : cluster [DBG] pgmap v3853: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:45:32.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:45:32 smithi086 bash[24289]: audit 2024-09-16T07:45:31.289638+0000 mgr.a (mgr.14373) 5556 : audit [DBG] from='client.129099 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:45:32.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:45:32 smithi047 bash[22744]: cluster 2024-09-16T07:45:31.123706+0000 mgr.a (mgr.14373) 5555 : cluster [DBG] pgmap v3853: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:45:32.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:45:32 smithi047 bash[22744]: audit 2024-09-16T07:45:31.289638+0000 mgr.a (mgr.14373) 5556 : audit [DBG] from='client.129099 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:45:35.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:45:35 smithi157 bash[24585]: cluster 2024-09-16T07:45:33.126428+0000 mgr.a (mgr.14373) 5557 : cluster [DBG] pgmap v3854: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:45:35.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:45:35 smithi086 bash[24289]: cluster 2024-09-16T07:45:33.126428+0000 mgr.a (mgr.14373) 5557 : cluster [DBG] pgmap v3854: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:45:35.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:45:35 smithi047 bash[22744]: cluster 2024-09-16T07:45:33.126428+0000 mgr.a (mgr.14373) 5557 : cluster [DBG] pgmap v3854: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:45:36.730 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:45:36.731 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:45:36.731 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:45:37.311 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:45:37 smithi157 bash[24585]: cluster 2024-09-16T07:45:35.127310+0000 mgr.a (mgr.14373) 5558 : cluster [DBG] pgmap v3855: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:45:37.329 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:45:37 smithi086 bash[24289]: cluster 2024-09-16T07:45:35.127310+0000 mgr.a (mgr.14373) 5558 : cluster [DBG] pgmap v3855: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:45:37.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:45:37 smithi047 bash[22744]: cluster 2024-09-16T07:45:35.127310+0000 mgr.a (mgr.14373) 5558 : cluster [DBG] pgmap v3855: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:45:37.492 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:45:37.492 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:45:37.492 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:45:37.492 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:45:37.493 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:45:39.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:45:39 smithi157 bash[24585]: audit 2024-09-16T07:45:37.069028+0000 mgr.a (mgr.14373) 5559 : audit [DBG] from='client.129177 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:45:39.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:45:39 smithi157 bash[24585]: cluster 2024-09-16T07:45:37.128823+0000 mgr.a (mgr.14373) 5560 : cluster [DBG] pgmap v3856: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:45:39.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:45:39 smithi157 bash[24585]: audit 2024-09-16T07:45:38.759555+0000 mon.b (mon.2) 538 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T07:45:39.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:45:39 smithi086 bash[24289]: audit 2024-09-16T07:45:37.069028+0000 mgr.a (mgr.14373) 5559 : audit [DBG] from='client.129177 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:45:39.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:45:39 smithi086 bash[24289]: cluster 2024-09-16T07:45:37.128823+0000 mgr.a (mgr.14373) 5560 : cluster [DBG] pgmap v3856: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:45:39.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:45:39 smithi086 bash[24289]: audit 2024-09-16T07:45:38.759555+0000 mon.b (mon.2) 538 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T07:45:39.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:45:39 smithi047 bash[22744]: audit 2024-09-16T07:45:37.069028+0000 mgr.a (mgr.14373) 5559 : audit [DBG] from='client.129177 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:45:39.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:45:39 smithi047 bash[22744]: cluster 2024-09-16T07:45:37.128823+0000 mgr.a (mgr.14373) 5560 : cluster [DBG] pgmap v3856: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:45:39.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:45:39 smithi047 bash[22744]: audit 2024-09-16T07:45:38.759555+0000 mon.b (mon.2) 538 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T07:45:40.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:45:40 smithi157 bash[24585]: audit 2024-09-16T07:45:39.592403+0000 mon.b (mon.2) 539 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T07:45:40.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:45:40 smithi157 bash[24585]: audit 2024-09-16T07:45:39.594263+0000 mon.b (mon.2) 540 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T07:45:40.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:45:40 smithi157 bash[24585]: audit 2024-09-16T07:45:39.606837+0000 mon.a (mon.0) 905 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:45:40.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:45:40 smithi157 bash[24585]: audit 2024-09-16T07:45:39.608893+0000 mon.b (mon.2) 541 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:45:40.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:45:40 smithi086 bash[24289]: audit 2024-09-16T07:45:39.592403+0000 mon.b (mon.2) 539 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T07:45:40.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:45:40 smithi086 bash[24289]: audit 2024-09-16T07:45:39.594263+0000 mon.b (mon.2) 540 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T07:45:40.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:45:40 smithi086 bash[24289]: audit 2024-09-16T07:45:39.606837+0000 mon.a (mon.0) 905 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:45:40.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:45:40 smithi086 bash[24289]: audit 2024-09-16T07:45:39.608893+0000 mon.b (mon.2) 541 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:45:40.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:45:40 smithi047 bash[22744]: audit 2024-09-16T07:45:39.592403+0000 mon.b (mon.2) 539 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T07:45:40.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:45:40 smithi047 bash[22744]: audit 2024-09-16T07:45:39.594263+0000 mon.b (mon.2) 540 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T07:45:40.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:45:40 smithi047 bash[22744]: audit 2024-09-16T07:45:39.606837+0000 mon.a (mon.0) 905 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:45:40.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:45:40 smithi047 bash[22744]: audit 2024-09-16T07:45:39.608893+0000 mon.b (mon.2) 541 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:45:40.838 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 07:45:40 smithi047 bash[22994]: debug 2024-09-16T07:45:40.349+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T07:45:40.838 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 07:45:40 smithi047 bash[22994]: debug 2024-09-16T07:45:40.349+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T07:45:41.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:45:41 smithi086 bash[24289]: cluster 2024-09-16T07:45:39.129623+0000 mgr.a (mgr.14373) 5561 : cluster [DBG] pgmap v3857: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:45:41.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:45:41 smithi086 bash[24289]: audit 2024-09-16T07:45:39.613071+0000 mgr.a (mgr.14373) 5562 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:45:41.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:45:41 smithi047 bash[22744]: cluster 2024-09-16T07:45:39.129623+0000 mgr.a (mgr.14373) 5561 : cluster [DBG] pgmap v3857: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:45:41.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:45:41 smithi047 bash[22744]: audit 2024-09-16T07:45:39.613071+0000 mgr.a (mgr.14373) 5562 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:45:41.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:45:41 smithi157 bash[24585]: cluster 2024-09-16T07:45:39.129623+0000 mgr.a (mgr.14373) 5561 : cluster [DBG] pgmap v3857: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:45:41.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:45:41 smithi157 bash[24585]: audit 2024-09-16T07:45:39.613071+0000 mgr.a (mgr.14373) 5562 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:45:42.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:45:42 smithi086 bash[24289]: audit 2024-09-16T07:45:40.350826+0000 mgr.a (mgr.14373) 5563 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T07:45:42.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:45:42 smithi086 bash[24289]: cephadm 2024-09-16T07:45:40.353276+0000 mgr.a (mgr.14373) 5564 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T07:45:42.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:45:42 smithi086 bash[24289]: cluster 2024-09-16T07:45:41.130500+0000 mgr.a (mgr.14373) 5565 : cluster [DBG] pgmap v3858: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T07:45:42.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:45:42 smithi047 bash[22744]: audit 2024-09-16T07:45:40.350826+0000 mgr.a (mgr.14373) 5563 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T07:45:42.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:45:42 smithi047 bash[22744]: cephadm 2024-09-16T07:45:40.353276+0000 mgr.a (mgr.14373) 5564 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T07:45:42.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:45:42 smithi047 bash[22744]: cluster 2024-09-16T07:45:41.130500+0000 mgr.a (mgr.14373) 5565 : cluster [DBG] pgmap v3858: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T07:45:42.497 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:45:42.497 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:45:42.497 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:45:42.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:45:42 smithi157 bash[24585]: audit 2024-09-16T07:45:40.350826+0000 mgr.a (mgr.14373) 5563 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T07:45:42.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:45:42 smithi157 bash[24585]: cephadm 2024-09-16T07:45:40.353276+0000 mgr.a (mgr.14373) 5564 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T07:45:42.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:45:42 smithi157 bash[24585]: cluster 2024-09-16T07:45:41.130500+0000 mgr.a (mgr.14373) 5565 : cluster [DBG] pgmap v3858: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T07:45:43.270 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:45:43.271 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:45:43.271 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:45:43.271 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:45:43.271 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:45:43.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:45:43 smithi086 bash[24289]: audit 2024-09-16T07:45:42.830964+0000 mgr.a (mgr.14373) 5566 : audit [DBG] from='client.129360 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:45:43.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:45:43 smithi047 bash[22744]: audit 2024-09-16T07:45:42.830964+0000 mgr.a (mgr.14373) 5566 : audit [DBG] from='client.129360 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:45:43.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:45:43 smithi157 bash[24585]: audit 2024-09-16T07:45:42.830964+0000 mgr.a (mgr.14373) 5566 : audit [DBG] from='client.129360 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:45:44.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:45:44 smithi047 bash[22744]: cluster 2024-09-16T07:45:43.132081+0000 mgr.a (mgr.14373) 5567 : cluster [DBG] pgmap v3859: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:45:44.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:45:44 smithi157 bash[24585]: cluster 2024-09-16T07:45:43.132081+0000 mgr.a (mgr.14373) 5567 : cluster [DBG] pgmap v3859: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:45:44.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:45:44 smithi086 bash[24289]: cluster 2024-09-16T07:45:43.132081+0000 mgr.a (mgr.14373) 5567 : cluster [DBG] pgmap v3859: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:45:46.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:45:46 smithi157 bash[24585]: cluster 2024-09-16T07:45:45.132947+0000 mgr.a (mgr.14373) 5568 : cluster [DBG] pgmap v3860: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:45:46.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:45:46 smithi086 bash[24289]: cluster 2024-09-16T07:45:45.132947+0000 mgr.a (mgr.14373) 5568 : cluster [DBG] pgmap v3860: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:45:46.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:45:46 smithi047 bash[22744]: cluster 2024-09-16T07:45:45.132947+0000 mgr.a (mgr.14373) 5568 : cluster [DBG] pgmap v3860: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:45:48.272 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:45:48.273 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:45:48.273 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:45:48.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:45:48 smithi157 bash[24585]: cluster 2024-09-16T07:45:47.135126+0000 mgr.a (mgr.14373) 5569 : cluster [DBG] pgmap v3861: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:45:48.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:45:48 smithi086 bash[24289]: cluster 2024-09-16T07:45:47.135126+0000 mgr.a (mgr.14373) 5569 : cluster [DBG] pgmap v3861: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:45:48.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:45:48 smithi047 bash[22744]: cluster 2024-09-16T07:45:47.135126+0000 mgr.a (mgr.14373) 5569 : cluster [DBG] pgmap v3861: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:45:49.046 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:45:49.046 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:45:49.046 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:45:49.046 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:45:49.047 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:45:49.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:45:49 smithi157 bash[24585]: audit 2024-09-16T07:45:48.610976+0000 mgr.a (mgr.14373) 5570 : audit [DBG] from='client.129438 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:45:49.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:45:49 smithi086 bash[24289]: audit 2024-09-16T07:45:48.610976+0000 mgr.a (mgr.14373) 5570 : audit [DBG] from='client.129438 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:45:49.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:45:49 smithi047 bash[22744]: audit 2024-09-16T07:45:48.610976+0000 mgr.a (mgr.14373) 5570 : audit [DBG] from='client.129438 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:45:50.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:45:50 smithi157 bash[24585]: cluster 2024-09-16T07:45:49.135960+0000 mgr.a (mgr.14373) 5571 : cluster [DBG] pgmap v3862: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:45:50.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:45:50 smithi086 bash[24289]: cluster 2024-09-16T07:45:49.135960+0000 mgr.a (mgr.14373) 5571 : cluster [DBG] pgmap v3862: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:45:50.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:45:50 smithi047 bash[22744]: cluster 2024-09-16T07:45:49.135960+0000 mgr.a (mgr.14373) 5571 : cluster [DBG] pgmap v3862: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:45:52.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:45:52 smithi157 bash[24585]: cluster 2024-09-16T07:45:51.136718+0000 mgr.a (mgr.14373) 5572 : cluster [DBG] pgmap v3863: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:45:52.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:45:52 smithi086 bash[24289]: cluster 2024-09-16T07:45:51.136718+0000 mgr.a (mgr.14373) 5572 : cluster [DBG] pgmap v3863: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:45:52.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:45:52 smithi047 bash[22744]: cluster 2024-09-16T07:45:51.136718+0000 mgr.a (mgr.14373) 5572 : cluster [DBG] pgmap v3863: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:45:54.047 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:45:54.048 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:45:54.048 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:45:54.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:45:54 smithi157 bash[24585]: cluster 2024-09-16T07:45:53.138949+0000 mgr.a (mgr.14373) 5573 : cluster [DBG] pgmap v3864: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:45:54.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:45:54 smithi086 bash[24289]: cluster 2024-09-16T07:45:53.138949+0000 mgr.a (mgr.14373) 5573 : cluster [DBG] pgmap v3864: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:45:54.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:45:54 smithi047 bash[22744]: cluster 2024-09-16T07:45:53.138949+0000 mgr.a (mgr.14373) 5573 : cluster [DBG] pgmap v3864: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:45:54.788 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:45:54.788 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:45:54.789 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:45:54.789 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:45:54.789 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:45:55.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:45:55 smithi157 bash[24585]: audit 2024-09-16T07:45:54.380811+0000 mgr.a (mgr.14373) 5574 : audit [DBG] from='client.129513 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:45:55.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:45:55 smithi086 bash[24289]: audit 2024-09-16T07:45:54.380811+0000 mgr.a (mgr.14373) 5574 : audit [DBG] from='client.129513 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:45:55.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:45:55 smithi047 bash[22744]: audit 2024-09-16T07:45:54.380811+0000 mgr.a (mgr.14373) 5574 : audit [DBG] from='client.129513 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:45:56.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:45:56 smithi157 bash[24585]: cluster 2024-09-16T07:45:55.139817+0000 mgr.a (mgr.14373) 5575 : cluster [DBG] pgmap v3865: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:45:56.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:45:56 smithi086 bash[24289]: cluster 2024-09-16T07:45:55.139817+0000 mgr.a (mgr.14373) 5575 : cluster [DBG] pgmap v3865: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:45:56.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:45:56 smithi047 bash[22744]: cluster 2024-09-16T07:45:55.139817+0000 mgr.a (mgr.14373) 5575 : cluster [DBG] pgmap v3865: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:45:58.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:45:58 smithi157 bash[24585]: cluster 2024-09-16T07:45:57.142044+0000 mgr.a (mgr.14373) 5576 : cluster [DBG] pgmap v3866: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:45:58.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:45:58 smithi086 bash[24289]: cluster 2024-09-16T07:45:57.142044+0000 mgr.a (mgr.14373) 5576 : cluster [DBG] pgmap v3866: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:45:58.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:45:58 smithi047 bash[22744]: cluster 2024-09-16T07:45:57.142044+0000 mgr.a (mgr.14373) 5576 : cluster [DBG] pgmap v3866: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:45:59.790 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:45:59.790 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:45:59.790 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:46:00.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:46:00 smithi157 bash[24585]: cluster 2024-09-16T07:45:59.142801+0000 mgr.a (mgr.14373) 5577 : cluster [DBG] pgmap v3867: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:46:00.559 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:46:00.559 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:46:00.559 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:46:00.559 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:46:00.559 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:46:00.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:46:00 smithi086 bash[24289]: cluster 2024-09-16T07:45:59.142801+0000 mgr.a (mgr.14373) 5577 : cluster [DBG] pgmap v3867: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:46:00.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:46:00 smithi047 bash[22744]: cluster 2024-09-16T07:45:59.142801+0000 mgr.a (mgr.14373) 5577 : cluster [DBG] pgmap v3867: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:46:01.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:46:01 smithi157 bash[24585]: audit 2024-09-16T07:46:00.128545+0000 mgr.a (mgr.14373) 5578 : audit [DBG] from='client.129591 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:46:01.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:46:01 smithi086 bash[24289]: audit 2024-09-16T07:46:00.128545+0000 mgr.a (mgr.14373) 5578 : audit [DBG] from='client.129591 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:46:01.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:46:01 smithi047 bash[22744]: audit 2024-09-16T07:46:00.128545+0000 mgr.a (mgr.14373) 5578 : audit [DBG] from='client.129591 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:46:02.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:46:02 smithi157 bash[24585]: cluster 2024-09-16T07:46:01.143719+0000 mgr.a (mgr.14373) 5579 : cluster [DBG] pgmap v3868: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:46:02.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:46:02 smithi086 bash[24289]: cluster 2024-09-16T07:46:01.143719+0000 mgr.a (mgr.14373) 5579 : cluster [DBG] pgmap v3868: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:46:02.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:46:02 smithi047 bash[22744]: cluster 2024-09-16T07:46:01.143719+0000 mgr.a (mgr.14373) 5579 : cluster [DBG] pgmap v3868: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:46:04.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:46:04 smithi157 bash[24585]: cluster 2024-09-16T07:46:03.145946+0000 mgr.a (mgr.14373) 5580 : cluster [DBG] pgmap v3869: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:46:04.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:46:04 smithi086 bash[24289]: cluster 2024-09-16T07:46:03.145946+0000 mgr.a (mgr.14373) 5580 : cluster [DBG] pgmap v3869: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:46:04.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:46:04 smithi047 bash[22744]: cluster 2024-09-16T07:46:03.145946+0000 mgr.a (mgr.14373) 5580 : cluster [DBG] pgmap v3869: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:46:05.561 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:46:05.561 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:46:05.562 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:46:06.328 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:46:06.328 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:46:06.328 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:46:06.329 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:46:06.329 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:46:06.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:46:06 smithi157 bash[24585]: cluster 2024-09-16T07:46:05.146736+0000 mgr.a (mgr.14373) 5581 : cluster [DBG] pgmap v3870: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:46:06.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:46:06 smithi157 bash[24585]: audit 2024-09-16T07:46:05.899524+0000 mgr.a (mgr.14373) 5582 : audit [DBG] from='client.129666 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:46:06.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:46:06 smithi086 bash[24289]: cluster 2024-09-16T07:46:05.146736+0000 mgr.a (mgr.14373) 5581 : cluster [DBG] pgmap v3870: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:46:06.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:46:06 smithi086 bash[24289]: audit 2024-09-16T07:46:05.899524+0000 mgr.a (mgr.14373) 5582 : audit [DBG] from='client.129666 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:46:06.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:46:06 smithi047 bash[22744]: cluster 2024-09-16T07:46:05.146736+0000 mgr.a (mgr.14373) 5581 : cluster [DBG] pgmap v3870: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:46:06.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:46:06 smithi047 bash[22744]: audit 2024-09-16T07:46:05.899524+0000 mgr.a (mgr.14373) 5582 : audit [DBG] from='client.129666 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:46:09.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:46:09 smithi157 bash[24585]: cluster 2024-09-16T07:46:07.149049+0000 mgr.a (mgr.14373) 5583 : cluster [DBG] pgmap v3871: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:46:09.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:46:09 smithi086 bash[24289]: cluster 2024-09-16T07:46:07.149049+0000 mgr.a (mgr.14373) 5583 : cluster [DBG] pgmap v3871: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:46:09.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:46:09 smithi047 bash[22744]: cluster 2024-09-16T07:46:07.149049+0000 mgr.a (mgr.14373) 5583 : cluster [DBG] pgmap v3871: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:46:11.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:46:11 smithi157 bash[24585]: cluster 2024-09-16T07:46:09.149832+0000 mgr.a (mgr.14373) 5584 : cluster [DBG] pgmap v3872: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:46:11.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:46:11 smithi086 bash[24289]: cluster 2024-09-16T07:46:09.149832+0000 mgr.a (mgr.14373) 5584 : cluster [DBG] pgmap v3872: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:46:11.329 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:46:11.330 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:46:11.330 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:46:11.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:46:11 smithi047 bash[22744]: cluster 2024-09-16T07:46:09.149832+0000 mgr.a (mgr.14373) 5584 : cluster [DBG] pgmap v3872: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:46:12.100 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:46:12.100 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:46:12.101 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:46:12.101 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:46:12.101 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:46:13.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:46:13 smithi086 bash[24289]: cluster 2024-09-16T07:46:11.150620+0000 mgr.a (mgr.14373) 5585 : cluster [DBG] pgmap v3873: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:46:13.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:46:13 smithi086 bash[24289]: audit 2024-09-16T07:46:11.666062+0000 mgr.a (mgr.14373) 5586 : audit [DBG] from='client.129741 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:46:13.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:46:13 smithi047 bash[22744]: cluster 2024-09-16T07:46:11.150620+0000 mgr.a (mgr.14373) 5585 : cluster [DBG] pgmap v3873: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:46:13.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:46:13 smithi047 bash[22744]: audit 2024-09-16T07:46:11.666062+0000 mgr.a (mgr.14373) 5586 : audit [DBG] from='client.129741 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:46:13.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:46:13 smithi157 bash[24585]: cluster 2024-09-16T07:46:11.150620+0000 mgr.a (mgr.14373) 5585 : cluster [DBG] pgmap v3873: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:46:13.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:46:13 smithi157 bash[24585]: audit 2024-09-16T07:46:11.666062+0000 mgr.a (mgr.14373) 5586 : audit [DBG] from='client.129741 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:46:15.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:46:15 smithi086 bash[24289]: cluster 2024-09-16T07:46:13.153394+0000 mgr.a (mgr.14373) 5587 : cluster [DBG] pgmap v3874: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:46:15.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:46:15 smithi047 bash[22744]: cluster 2024-09-16T07:46:13.153394+0000 mgr.a (mgr.14373) 5587 : cluster [DBG] pgmap v3874: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:46:15.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:46:15 smithi157 bash[24585]: cluster 2024-09-16T07:46:13.153394+0000 mgr.a (mgr.14373) 5587 : cluster [DBG] pgmap v3874: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:46:16.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:46:16 smithi157 bash[24585]: cluster 2024-09-16T07:46:15.154178+0000 mgr.a (mgr.14373) 5588 : cluster [DBG] pgmap v3875: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:46:16.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:46:16 smithi086 bash[24289]: cluster 2024-09-16T07:46:15.154178+0000 mgr.a (mgr.14373) 5588 : cluster [DBG] pgmap v3875: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:46:16.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:46:16 smithi047 bash[22744]: cluster 2024-09-16T07:46:15.154178+0000 mgr.a (mgr.14373) 5588 : cluster [DBG] pgmap v3875: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:46:17.102 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:46:17.103 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:46:17.103 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:46:17.879 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:46:17.879 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:46:17.879 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:46:17.879 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:46:17.879 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:46:18.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:46:18 smithi157 bash[24585]: cluster 2024-09-16T07:46:17.155471+0000 mgr.a (mgr.14373) 5589 : cluster [DBG] pgmap v3876: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:46:18.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:46:18 smithi157 bash[24585]: audit 2024-09-16T07:46:17.438756+0000 mgr.a (mgr.14373) 5590 : audit [DBG] from='client.129816 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:46:18.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:46:18 smithi086 bash[24289]: cluster 2024-09-16T07:46:17.155471+0000 mgr.a (mgr.14373) 5589 : cluster [DBG] pgmap v3876: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:46:18.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:46:18 smithi086 bash[24289]: audit 2024-09-16T07:46:17.438756+0000 mgr.a (mgr.14373) 5590 : audit [DBG] from='client.129816 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:46:18.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:46:18 smithi047 bash[22744]: cluster 2024-09-16T07:46:17.155471+0000 mgr.a (mgr.14373) 5589 : cluster [DBG] pgmap v3876: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:46:18.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:46:18 smithi047 bash[22744]: audit 2024-09-16T07:46:17.438756+0000 mgr.a (mgr.14373) 5590 : audit [DBG] from='client.129816 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:46:20.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:46:20 smithi157 bash[24585]: cluster 2024-09-16T07:46:19.156432+0000 mgr.a (mgr.14373) 5591 : cluster [DBG] pgmap v3877: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:46:20.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:46:20 smithi086 bash[24289]: cluster 2024-09-16T07:46:19.156432+0000 mgr.a (mgr.14373) 5591 : cluster [DBG] pgmap v3877: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:46:20.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:46:20 smithi047 bash[22744]: cluster 2024-09-16T07:46:19.156432+0000 mgr.a (mgr.14373) 5591 : cluster [DBG] pgmap v3877: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:46:22.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:46:22 smithi157 bash[24585]: cluster 2024-09-16T07:46:21.157212+0000 mgr.a (mgr.14373) 5592 : cluster [DBG] pgmap v3878: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T07:46:22.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:46:22 smithi086 bash[24289]: cluster 2024-09-16T07:46:21.157212+0000 mgr.a (mgr.14373) 5592 : cluster [DBG] pgmap v3878: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T07:46:22.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:46:22 smithi047 bash[22744]: cluster 2024-09-16T07:46:21.157212+0000 mgr.a (mgr.14373) 5592 : cluster [DBG] pgmap v3878: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T07:46:22.881 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:46:22.881 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:46:22.881 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:46:23.645 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:46:23.645 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:46:23.645 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:46:23.645 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:46:23.645 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:46:24.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:46:24 smithi157 bash[24585]: cluster 2024-09-16T07:46:23.159373+0000 mgr.a (mgr.14373) 5593 : cluster [DBG] pgmap v3879: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:46:24.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:46:24 smithi157 bash[24585]: audit 2024-09-16T07:46:23.219791+0000 mgr.a (mgr.14373) 5594 : audit [DBG] from='client.129888 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:46:24.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:46:24 smithi086 bash[24289]: cluster 2024-09-16T07:46:23.159373+0000 mgr.a (mgr.14373) 5593 : cluster [DBG] pgmap v3879: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:46:24.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:46:24 smithi086 bash[24289]: audit 2024-09-16T07:46:23.219791+0000 mgr.a (mgr.14373) 5594 : audit [DBG] from='client.129888 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:46:24.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:46:24 smithi047 bash[22744]: cluster 2024-09-16T07:46:23.159373+0000 mgr.a (mgr.14373) 5593 : cluster [DBG] pgmap v3879: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:46:24.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:46:24 smithi047 bash[22744]: audit 2024-09-16T07:46:23.219791+0000 mgr.a (mgr.14373) 5594 : audit [DBG] from='client.129888 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:46:26.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:46:26 smithi157 bash[24585]: cluster 2024-09-16T07:46:25.160350+0000 mgr.a (mgr.14373) 5595 : cluster [DBG] pgmap v3880: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:46:26.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:46:26 smithi086 bash[24289]: cluster 2024-09-16T07:46:25.160350+0000 mgr.a (mgr.14373) 5595 : cluster [DBG] pgmap v3880: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:46:26.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:46:26 smithi047 bash[22744]: cluster 2024-09-16T07:46:25.160350+0000 mgr.a (mgr.14373) 5595 : cluster [DBG] pgmap v3880: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:46:28.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:46:28 smithi157 bash[24585]: cluster 2024-09-16T07:46:27.162551+0000 mgr.a (mgr.14373) 5596 : cluster [DBG] pgmap v3881: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:46:28.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:46:28 smithi086 bash[24289]: cluster 2024-09-16T07:46:27.162551+0000 mgr.a (mgr.14373) 5596 : cluster [DBG] pgmap v3881: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:46:28.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:46:28 smithi047 bash[22744]: cluster 2024-09-16T07:46:27.162551+0000 mgr.a (mgr.14373) 5596 : cluster [DBG] pgmap v3881: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:46:28.647 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:46:29.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:46:29 smithi157 bash[24585]: audit 2024-09-16T07:46:28.993925+0000 mgr.a (mgr.14373) 5597 : audit [DBG] from='client.129966 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:46:29.555 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:46:29.555 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:46:29.555 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:46:29.555 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:46:29.556 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:46:29.556 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:46:29.556 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:46:29.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:46:29 smithi086 bash[24289]: audit 2024-09-16T07:46:28.993925+0000 mgr.a (mgr.14373) 5597 : audit [DBG] from='client.129966 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:46:29.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:46:29 smithi047 bash[22744]: audit 2024-09-16T07:46:28.993925+0000 mgr.a (mgr.14373) 5597 : audit [DBG] from='client.129966 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:46:30.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:46:30 smithi157 bash[24585]: cluster 2024-09-16T07:46:29.163146+0000 mgr.a (mgr.14373) 5598 : cluster [DBG] pgmap v3882: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:46:30.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:46:30 smithi086 bash[24289]: cluster 2024-09-16T07:46:29.163146+0000 mgr.a (mgr.14373) 5598 : cluster [DBG] pgmap v3882: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:46:30.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:46:30 smithi047 bash[22744]: cluster 2024-09-16T07:46:29.163146+0000 mgr.a (mgr.14373) 5598 : cluster [DBG] pgmap v3882: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:46:32.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:46:32 smithi157 bash[24585]: cluster 2024-09-16T07:46:31.164030+0000 mgr.a (mgr.14373) 5599 : cluster [DBG] pgmap v3883: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:46:32.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:46:32 smithi086 bash[24289]: cluster 2024-09-16T07:46:31.164030+0000 mgr.a (mgr.14373) 5599 : cluster [DBG] pgmap v3883: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:46:32.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:46:32 smithi047 bash[22744]: cluster 2024-09-16T07:46:31.164030+0000 mgr.a (mgr.14373) 5599 : cluster [DBG] pgmap v3883: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:46:34.427 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:46:34.428 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:46:34.428 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:46:34.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:46:34 smithi157 bash[24585]: cluster 2024-09-16T07:46:33.166295+0000 mgr.a (mgr.14373) 5600 : cluster [DBG] pgmap v3884: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:46:34.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:46:34 smithi086 bash[24289]: cluster 2024-09-16T07:46:33.166295+0000 mgr.a (mgr.14373) 5600 : cluster [DBG] pgmap v3884: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:46:34.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:46:34 smithi047 bash[22744]: cluster 2024-09-16T07:46:33.166295+0000 mgr.a (mgr.14373) 5600 : cluster [DBG] pgmap v3884: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:46:35.206 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:46:35.206 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:46:35.207 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:46:35.207 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:46:35.207 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:46:35.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:46:35 smithi157 bash[24585]: audit 2024-09-16T07:46:34.763493+0000 mgr.a (mgr.14373) 5601 : audit [DBG] from='client.130041 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:46:35.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:46:35 smithi086 bash[24289]: audit 2024-09-16T07:46:34.763493+0000 mgr.a (mgr.14373) 5601 : audit [DBG] from='client.130041 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:46:35.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:46:35 smithi047 bash[22744]: audit 2024-09-16T07:46:34.763493+0000 mgr.a (mgr.14373) 5601 : audit [DBG] from='client.130041 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:46:36.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:46:36 smithi157 bash[24585]: cluster 2024-09-16T07:46:35.166956+0000 mgr.a (mgr.14373) 5602 : cluster [DBG] pgmap v3885: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:46:36.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:46:36 smithi086 bash[24289]: cluster 2024-09-16T07:46:35.166956+0000 mgr.a (mgr.14373) 5602 : cluster [DBG] pgmap v3885: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:46:36.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:46:36 smithi047 bash[22744]: cluster 2024-09-16T07:46:35.166956+0000 mgr.a (mgr.14373) 5602 : cluster [DBG] pgmap v3885: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:46:38.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:46:38 smithi157 bash[24585]: cluster 2024-09-16T07:46:37.169127+0000 mgr.a (mgr.14373) 5603 : cluster [DBG] pgmap v3886: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:46:38.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:46:38 smithi086 bash[24289]: cluster 2024-09-16T07:46:37.169127+0000 mgr.a (mgr.14373) 5603 : cluster [DBG] pgmap v3886: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:46:38.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:46:38 smithi047 bash[22744]: cluster 2024-09-16T07:46:37.169127+0000 mgr.a (mgr.14373) 5603 : cluster [DBG] pgmap v3886: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:46:40.208 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:46:40.209 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:46:40.209 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:46:40.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:46:40 smithi157 bash[24585]: cluster 2024-09-16T07:46:39.169896+0000 mgr.a (mgr.14373) 5604 : cluster [DBG] pgmap v3887: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:46:40.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:46:40 smithi086 bash[24289]: cluster 2024-09-16T07:46:39.169896+0000 mgr.a (mgr.14373) 5604 : cluster [DBG] pgmap v3887: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:46:40.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:46:40 smithi047 bash[22744]: cluster 2024-09-16T07:46:39.169896+0000 mgr.a (mgr.14373) 5604 : cluster [DBG] pgmap v3887: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:46:40.978 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:46:40.978 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:46:40.978 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:46:40.978 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:46:40.978 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:46:41.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:46:41 smithi157 bash[24585]: audit 2024-09-16T07:46:40.402351+0000 mon.b (mon.2) 542 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T07:46:41.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:46:41 smithi157 bash[24585]: audit 2024-09-16T07:46:40.548025+0000 mgr.a (mgr.14373) 5605 : audit [DBG] from='client.130119 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:46:41.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:46:41 smithi157 bash[24585]: audit 2024-09-16T07:46:41.241958+0000 mon.b (mon.2) 543 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T07:46:41.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:46:41 smithi157 bash[24585]: audit 2024-09-16T07:46:41.244453+0000 mon.b (mon.2) 544 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T07:46:41.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:46:41 smithi157 bash[24585]: audit 2024-09-16T07:46:41.257090+0000 mon.a (mon.0) 906 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:46:41.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:46:41 smithi157 bash[24585]: audit 2024-09-16T07:46:41.260926+0000 mon.b (mon.2) 545 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:46:41.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:46:41 smithi086 bash[24289]: audit 2024-09-16T07:46:40.402351+0000 mon.b (mon.2) 542 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T07:46:41.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:46:41 smithi086 bash[24289]: audit 2024-09-16T07:46:40.548025+0000 mgr.a (mgr.14373) 5605 : audit [DBG] from='client.130119 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:46:41.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:46:41 smithi086 bash[24289]: audit 2024-09-16T07:46:41.241958+0000 mon.b (mon.2) 543 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T07:46:41.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:46:41 smithi086 bash[24289]: audit 2024-09-16T07:46:41.244453+0000 mon.b (mon.2) 544 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T07:46:41.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:46:41 smithi086 bash[24289]: audit 2024-09-16T07:46:41.257090+0000 mon.a (mon.0) 906 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:46:41.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:46:41 smithi086 bash[24289]: audit 2024-09-16T07:46:41.260926+0000 mon.b (mon.2) 545 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:46:41.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:46:41 smithi047 bash[22744]: audit 2024-09-16T07:46:40.402351+0000 mon.b (mon.2) 542 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T07:46:41.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:46:41 smithi047 bash[22744]: audit 2024-09-16T07:46:40.548025+0000 mgr.a (mgr.14373) 5605 : audit [DBG] from='client.130119 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:46:41.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:46:41 smithi047 bash[22744]: audit 2024-09-16T07:46:41.241958+0000 mon.b (mon.2) 543 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T07:46:41.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:46:41 smithi047 bash[22744]: audit 2024-09-16T07:46:41.244453+0000 mon.b (mon.2) 544 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T07:46:41.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:46:41 smithi047 bash[22744]: audit 2024-09-16T07:46:41.257090+0000 mon.a (mon.0) 906 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:46:41.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:46:41 smithi047 bash[22744]: audit 2024-09-16T07:46:41.260926+0000 mon.b (mon.2) 545 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:46:42.279 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 07:46:41 smithi047 bash[22994]: debug 2024-09-16T07:46:41.968+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T07:46:42.279 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 07:46:41 smithi047 bash[22994]: debug 2024-09-16T07:46:41.972+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T07:46:42.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:46:42 smithi157 bash[24585]: cluster 2024-09-16T07:46:41.170763+0000 mgr.a (mgr.14373) 5606 : cluster [DBG] pgmap v3888: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:46:42.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:46:42 smithi157 bash[24585]: audit 2024-09-16T07:46:41.265256+0000 mgr.a (mgr.14373) 5607 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:46:42.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:46:42 smithi157 bash[24585]: audit 2024-09-16T07:46:41.973024+0000 mgr.a (mgr.14373) 5608 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T07:46:42.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:46:42 smithi157 bash[24585]: cephadm 2024-09-16T07:46:41.974991+0000 mgr.a (mgr.14373) 5609 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T07:46:42.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:46:42 smithi086 bash[24289]: cluster 2024-09-16T07:46:41.170763+0000 mgr.a (mgr.14373) 5606 : cluster [DBG] pgmap v3888: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:46:42.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:46:42 smithi086 bash[24289]: audit 2024-09-16T07:46:41.265256+0000 mgr.a (mgr.14373) 5607 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:46:42.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:46:42 smithi086 bash[24289]: audit 2024-09-16T07:46:41.973024+0000 mgr.a (mgr.14373) 5608 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T07:46:42.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:46:42 smithi086 bash[24289]: cephadm 2024-09-16T07:46:41.974991+0000 mgr.a (mgr.14373) 5609 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T07:46:42.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:46:42 smithi047 bash[22744]: cluster 2024-09-16T07:46:41.170763+0000 mgr.a (mgr.14373) 5606 : cluster [DBG] pgmap v3888: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:46:42.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:46:42 smithi047 bash[22744]: audit 2024-09-16T07:46:41.265256+0000 mgr.a (mgr.14373) 5607 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:46:42.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:46:42 smithi047 bash[22744]: audit 2024-09-16T07:46:41.973024+0000 mgr.a (mgr.14373) 5608 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T07:46:42.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:46:42 smithi047 bash[22744]: cephadm 2024-09-16T07:46:41.974991+0000 mgr.a (mgr.14373) 5609 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T07:46:44.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:46:44 smithi157 bash[24585]: cluster 2024-09-16T07:46:43.173508+0000 mgr.a (mgr.14373) 5610 : cluster [DBG] pgmap v3889: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 3.4 KiB/s rd, 3 op/s 2024-09-16T07:46:44.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:46:44 smithi086 bash[24289]: cluster 2024-09-16T07:46:43.173508+0000 mgr.a (mgr.14373) 5610 : cluster [DBG] pgmap v3889: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 3.4 KiB/s rd, 3 op/s 2024-09-16T07:46:44.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:46:44 smithi047 bash[22744]: cluster 2024-09-16T07:46:43.173508+0000 mgr.a (mgr.14373) 5610 : cluster [DBG] pgmap v3889: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 3.4 KiB/s rd, 3 op/s 2024-09-16T07:46:45.980 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:46:45.980 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:46:45.980 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:46:46.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:46:46 smithi157 bash[24585]: cluster 2024-09-16T07:46:45.174265+0000 mgr.a (mgr.14373) 5611 : cluster [DBG] pgmap v3890: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-16T07:46:46.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:46:46 smithi086 bash[24289]: cluster 2024-09-16T07:46:45.174265+0000 mgr.a (mgr.14373) 5611 : cluster [DBG] pgmap v3890: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-16T07:46:46.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:46:46 smithi047 bash[22744]: cluster 2024-09-16T07:46:45.174265+0000 mgr.a (mgr.14373) 5611 : cluster [DBG] pgmap v3890: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-16T07:46:46.728 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:46:46.728 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:46:46.729 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:46:46.729 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:46:46.729 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:46:47.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:46:47 smithi157 bash[24585]: audit 2024-09-16T07:46:46.315563+0000 mgr.a (mgr.14373) 5612 : audit [DBG] from='client.130299 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:46:47.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:46:47 smithi086 bash[24289]: audit 2024-09-16T07:46:46.315563+0000 mgr.a (mgr.14373) 5612 : audit [DBG] from='client.130299 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:46:47.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:46:47 smithi047 bash[22744]: audit 2024-09-16T07:46:46.315563+0000 mgr.a (mgr.14373) 5612 : audit [DBG] from='client.130299 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:46:48.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:46:48 smithi157 bash[24585]: cluster 2024-09-16T07:46:47.177047+0000 mgr.a (mgr.14373) 5613 : cluster [DBG] pgmap v3891: 225 pgs: 225 active+clean; 589 KiB data, 126 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:46:48.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:46:48 smithi086 bash[24289]: cluster 2024-09-16T07:46:47.177047+0000 mgr.a (mgr.14373) 5613 : cluster [DBG] pgmap v3891: 225 pgs: 225 active+clean; 589 KiB data, 126 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:46:48.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:46:48 smithi047 bash[22744]: cluster 2024-09-16T07:46:47.177047+0000 mgr.a (mgr.14373) 5613 : cluster [DBG] pgmap v3891: 225 pgs: 225 active+clean; 589 KiB data, 126 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:46:50.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:46:50 smithi157 bash[24585]: cluster 2024-09-16T07:46:49.177829+0000 mgr.a (mgr.14373) 5614 : cluster [DBG] pgmap v3892: 225 pgs: 225 active+clean; 589 KiB data, 126 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T07:46:50.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:46:50 smithi086 bash[24289]: cluster 2024-09-16T07:46:49.177829+0000 mgr.a (mgr.14373) 5614 : cluster [DBG] pgmap v3892: 225 pgs: 225 active+clean; 589 KiB data, 126 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T07:46:50.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:46:50 smithi047 bash[22744]: cluster 2024-09-16T07:46:49.177829+0000 mgr.a (mgr.14373) 5614 : cluster [DBG] pgmap v3892: 225 pgs: 225 active+clean; 589 KiB data, 126 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T07:46:51.730 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:46:51.730 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:46:51.731 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:46:52.474 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:46:52.474 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:46:52.474 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:46:52.474 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:46:52.475 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:46:52.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:46:52 smithi086 bash[24289]: cluster 2024-09-16T07:46:51.178625+0000 mgr.a (mgr.14373) 5615 : cluster [DBG] pgmap v3893: 225 pgs: 225 active+clean; 589 KiB data, 126 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T07:46:52.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:46:52 smithi086 bash[24289]: audit 2024-09-16T07:46:52.065041+0000 mgr.a (mgr.14373) 5616 : audit [DBG] from='client.130371 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:46:52.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:46:52 smithi047 bash[22744]: cluster 2024-09-16T07:46:51.178625+0000 mgr.a (mgr.14373) 5615 : cluster [DBG] pgmap v3893: 225 pgs: 225 active+clean; 589 KiB data, 126 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T07:46:52.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:46:52 smithi047 bash[22744]: audit 2024-09-16T07:46:52.065041+0000 mgr.a (mgr.14373) 5616 : audit [DBG] from='client.130371 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:46:52.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:46:52 smithi157 bash[24585]: cluster 2024-09-16T07:46:51.178625+0000 mgr.a (mgr.14373) 5615 : cluster [DBG] pgmap v3893: 225 pgs: 225 active+clean; 589 KiB data, 126 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T07:46:52.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:46:52 smithi157 bash[24585]: audit 2024-09-16T07:46:52.065041+0000 mgr.a (mgr.14373) 5616 : audit [DBG] from='client.130371 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:46:55.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:46:55 smithi086 bash[24289]: cluster 2024-09-16T07:46:53.181458+0000 mgr.a (mgr.14373) 5617 : cluster [DBG] pgmap v3894: 225 pgs: 225 active+clean; 589 KiB data, 126 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:46:55.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:46:55 smithi047 bash[22744]: cluster 2024-09-16T07:46:53.181458+0000 mgr.a (mgr.14373) 5617 : cluster [DBG] pgmap v3894: 225 pgs: 225 active+clean; 589 KiB data, 126 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:46:55.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:46:55 smithi157 bash[24585]: cluster 2024-09-16T07:46:53.181458+0000 mgr.a (mgr.14373) 5617 : cluster [DBG] pgmap v3894: 225 pgs: 225 active+clean; 589 KiB data, 126 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:46:57.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:46:57 smithi086 bash[24289]: cluster 2024-09-16T07:46:55.182250+0000 mgr.a (mgr.14373) 5618 : cluster [DBG] pgmap v3895: 225 pgs: 225 active+clean; 589 KiB data, 126 MiB used, 268 GiB / 268 GiB avail; 5.4 KiB/s rd, 426 B/s wr, 5 op/s 2024-09-16T07:46:57.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:46:57 smithi047 bash[22744]: cluster 2024-09-16T07:46:55.182250+0000 mgr.a (mgr.14373) 5618 : cluster [DBG] pgmap v3895: 225 pgs: 225 active+clean; 589 KiB data, 126 MiB used, 268 GiB / 268 GiB avail; 5.4 KiB/s rd, 426 B/s wr, 5 op/s 2024-09-16T07:46:57.476 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:46:57.477 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:46:57.477 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:46:57.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:46:57 smithi157 bash[24585]: cluster 2024-09-16T07:46:55.182250+0000 mgr.a (mgr.14373) 5618 : cluster [DBG] pgmap v3895: 225 pgs: 225 active+clean; 589 KiB data, 126 MiB used, 268 GiB / 268 GiB avail; 5.4 KiB/s rd, 426 B/s wr, 5 op/s 2024-09-16T07:46:58.250 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:46:58.250 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:46:58.250 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:46:58.250 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:46:58.250 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:46:59.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:46:59 smithi086 bash[24289]: cluster 2024-09-16T07:46:57.184257+0000 mgr.a (mgr.14373) 5619 : cluster [DBG] pgmap v3896: 225 pgs: 225 active+clean; 589 KiB data, 126 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T07:46:59.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:46:59 smithi086 bash[24289]: audit 2024-09-16T07:46:57.813551+0000 mgr.a (mgr.14373) 5620 : audit [DBG] from='client.130446 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:46:59.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:46:59 smithi047 bash[22744]: cluster 2024-09-16T07:46:57.184257+0000 mgr.a (mgr.14373) 5619 : cluster [DBG] pgmap v3896: 225 pgs: 225 active+clean; 589 KiB data, 126 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T07:46:59.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:46:59 smithi047 bash[22744]: audit 2024-09-16T07:46:57.813551+0000 mgr.a (mgr.14373) 5620 : audit [DBG] from='client.130446 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:46:59.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:46:59 smithi157 bash[24585]: cluster 2024-09-16T07:46:57.184257+0000 mgr.a (mgr.14373) 5619 : cluster [DBG] pgmap v3896: 225 pgs: 225 active+clean; 589 KiB data, 126 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T07:46:59.582 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:46:59 smithi157 bash[24585]: audit 2024-09-16T07:46:57.813551+0000 mgr.a (mgr.14373) 5620 : audit [DBG] from='client.130446 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:47:01.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:47:01 smithi047 bash[22744]: cluster 2024-09-16T07:46:59.185415+0000 mgr.a (mgr.14373) 5621 : cluster [DBG] pgmap v3897: 225 pgs: 225 active+clean; 589 KiB data, 126 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:47:01.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:47:01 smithi157 bash[24585]: cluster 2024-09-16T07:46:59.185415+0000 mgr.a (mgr.14373) 5621 : cluster [DBG] pgmap v3897: 225 pgs: 225 active+clean; 589 KiB data, 126 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:47:01.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:47:01 smithi086 bash[24289]: cluster 2024-09-16T07:46:59.185415+0000 mgr.a (mgr.14373) 5621 : cluster [DBG] pgmap v3897: 225 pgs: 225 active+clean; 589 KiB data, 126 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:47:03.251 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:47:03.252 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:47:03.252 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:47:03.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:47:03 smithi047 bash[22744]: cluster 2024-09-16T07:47:01.186392+0000 mgr.a (mgr.14373) 5622 : cluster [DBG] pgmap v3898: 225 pgs: 225 active+clean; 589 KiB data, 126 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:47:03.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:47:03 smithi157 bash[24585]: cluster 2024-09-16T07:47:01.186392+0000 mgr.a (mgr.14373) 5622 : cluster [DBG] pgmap v3898: 225 pgs: 225 active+clean; 589 KiB data, 126 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:47:03.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:47:03 smithi086 bash[24289]: cluster 2024-09-16T07:47:01.186392+0000 mgr.a (mgr.14373) 5622 : cluster [DBG] pgmap v3898: 225 pgs: 225 active+clean; 589 KiB data, 126 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:47:04.024 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:47:04.024 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:47:04.024 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:47:04.024 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:47:04.024 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:47:05.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:47:05 smithi047 bash[22744]: cluster 2024-09-16T07:47:03.188776+0000 mgr.a (mgr.14373) 5623 : cluster [DBG] pgmap v3899: 225 pgs: 225 active+clean; 589 KiB data, 126 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:47:05.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:47:05 smithi047 bash[22744]: audit 2024-09-16T07:47:03.590525+0000 mgr.a (mgr.14373) 5624 : audit [DBG] from='client.130524 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:47:05.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:47:05 smithi157 bash[24585]: cluster 2024-09-16T07:47:03.188776+0000 mgr.a (mgr.14373) 5623 : cluster [DBG] pgmap v3899: 225 pgs: 225 active+clean; 589 KiB data, 126 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:47:05.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:47:05 smithi157 bash[24585]: audit 2024-09-16T07:47:03.590525+0000 mgr.a (mgr.14373) 5624 : audit [DBG] from='client.130524 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:47:05.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:47:05 smithi086 bash[24289]: cluster 2024-09-16T07:47:03.188776+0000 mgr.a (mgr.14373) 5623 : cluster [DBG] pgmap v3899: 225 pgs: 225 active+clean; 589 KiB data, 126 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:47:05.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:47:05 smithi086 bash[24289]: audit 2024-09-16T07:47:03.590525+0000 mgr.a (mgr.14373) 5624 : audit [DBG] from='client.130524 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:47:06.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:47:06 smithi047 bash[22744]: cluster 2024-09-16T07:47:05.189786+0000 mgr.a (mgr.14373) 5625 : cluster [DBG] pgmap v3900: 225 pgs: 225 active+clean; 589 KiB data, 126 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:47:06.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:47:06 smithi157 bash[24585]: cluster 2024-09-16T07:47:05.189786+0000 mgr.a (mgr.14373) 5625 : cluster [DBG] pgmap v3900: 225 pgs: 225 active+clean; 589 KiB data, 126 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:47:06.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:47:06 smithi086 bash[24289]: cluster 2024-09-16T07:47:05.189786+0000 mgr.a (mgr.14373) 5625 : cluster [DBG] pgmap v3900: 225 pgs: 225 active+clean; 589 KiB data, 126 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:47:08.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:47:08 smithi157 bash[24585]: cluster 2024-09-16T07:47:07.191984+0000 mgr.a (mgr.14373) 5626 : cluster [DBG] pgmap v3901: 225 pgs: 225 active+clean; 589 KiB data, 126 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:47:08.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:47:08 smithi086 bash[24289]: cluster 2024-09-16T07:47:07.191984+0000 mgr.a (mgr.14373) 5626 : cluster [DBG] pgmap v3901: 225 pgs: 225 active+clean; 589 KiB data, 126 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:47:08.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:47:08 smithi047 bash[22744]: cluster 2024-09-16T07:47:07.191984+0000 mgr.a (mgr.14373) 5626 : cluster [DBG] pgmap v3901: 225 pgs: 225 active+clean; 589 KiB data, 126 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:47:09.025 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:47:09.026 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:47:09.026 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:47:09.793 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:47:09.793 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:47:09.793 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:47:09.794 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:47:09.794 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:47:10.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:47:10 smithi157 bash[24585]: cluster 2024-09-16T07:47:09.192458+0000 mgr.a (mgr.14373) 5627 : cluster [DBG] pgmap v3902: 225 pgs: 225 active+clean; 589 KiB data, 126 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:47:10.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:47:10 smithi157 bash[24585]: audit 2024-09-16T07:47:09.363317+0000 mgr.a (mgr.14373) 5628 : audit [DBG] from='client.130599 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:47:10.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:47:10 smithi086 bash[24289]: cluster 2024-09-16T07:47:09.192458+0000 mgr.a (mgr.14373) 5627 : cluster [DBG] pgmap v3902: 225 pgs: 225 active+clean; 589 KiB data, 126 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:47:10.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:47:10 smithi086 bash[24289]: audit 2024-09-16T07:47:09.363317+0000 mgr.a (mgr.14373) 5628 : audit [DBG] from='client.130599 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:47:10.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:47:10 smithi047 bash[22744]: cluster 2024-09-16T07:47:09.192458+0000 mgr.a (mgr.14373) 5627 : cluster [DBG] pgmap v3902: 225 pgs: 225 active+clean; 589 KiB data, 126 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:47:10.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:47:10 smithi047 bash[22744]: audit 2024-09-16T07:47:09.363317+0000 mgr.a (mgr.14373) 5628 : audit [DBG] from='client.130599 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:47:12.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:47:12 smithi157 bash[24585]: cluster 2024-09-16T07:47:11.193337+0000 mgr.a (mgr.14373) 5629 : cluster [DBG] pgmap v3903: 225 pgs: 225 active+clean; 589 KiB data, 126 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:47:12.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:47:12 smithi086 bash[24289]: cluster 2024-09-16T07:47:11.193337+0000 mgr.a (mgr.14373) 5629 : cluster [DBG] pgmap v3903: 225 pgs: 225 active+clean; 589 KiB data, 126 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:47:12.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:47:12 smithi047 bash[22744]: cluster 2024-09-16T07:47:11.193337+0000 mgr.a (mgr.14373) 5629 : cluster [DBG] pgmap v3903: 225 pgs: 225 active+clean; 589 KiB data, 126 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:47:14.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:47:14 smithi157 bash[24585]: cluster 2024-09-16T07:47:13.195630+0000 mgr.a (mgr.14373) 5630 : cluster [DBG] pgmap v3904: 225 pgs: 225 active+clean; 589 KiB data, 126 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:47:14.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:47:14 smithi086 bash[24289]: cluster 2024-09-16T07:47:13.195630+0000 mgr.a (mgr.14373) 5630 : cluster [DBG] pgmap v3904: 225 pgs: 225 active+clean; 589 KiB data, 126 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:47:14.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:47:14 smithi047 bash[22744]: cluster 2024-09-16T07:47:13.195630+0000 mgr.a (mgr.14373) 5630 : cluster [DBG] pgmap v3904: 225 pgs: 225 active+clean; 589 KiB data, 126 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:47:14.795 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:47:14.796 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:47:14.796 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:47:15.567 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:47:15.568 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:47:15.568 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:47:15.568 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:47:15.568 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:47:16.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:47:16 smithi157 bash[24585]: audit 2024-09-16T07:47:15.133107+0000 mgr.a (mgr.14373) 5631 : audit [DBG] from='client.130677 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:47:16.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:47:16 smithi157 bash[24585]: cluster 2024-09-16T07:47:15.196413+0000 mgr.a (mgr.14373) 5632 : cluster [DBG] pgmap v3905: 225 pgs: 225 active+clean; 589 KiB data, 126 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:47:16.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:47:16 smithi086 bash[24289]: audit 2024-09-16T07:47:15.133107+0000 mgr.a (mgr.14373) 5631 : audit [DBG] from='client.130677 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:47:16.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:47:16 smithi086 bash[24289]: cluster 2024-09-16T07:47:15.196413+0000 mgr.a (mgr.14373) 5632 : cluster [DBG] pgmap v3905: 225 pgs: 225 active+clean; 589 KiB data, 126 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:47:16.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:47:16 smithi047 bash[22744]: audit 2024-09-16T07:47:15.133107+0000 mgr.a (mgr.14373) 5631 : audit [DBG] from='client.130677 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:47:16.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:47:16 smithi047 bash[22744]: cluster 2024-09-16T07:47:15.196413+0000 mgr.a (mgr.14373) 5632 : cluster [DBG] pgmap v3905: 225 pgs: 225 active+clean; 589 KiB data, 126 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:47:18.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:47:18 smithi157 bash[24585]: cluster 2024-09-16T07:47:17.198723+0000 mgr.a (mgr.14373) 5633 : cluster [DBG] pgmap v3906: 225 pgs: 225 active+clean; 589 KiB data, 126 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:47:18.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:47:18 smithi086 bash[24289]: cluster 2024-09-16T07:47:17.198723+0000 mgr.a (mgr.14373) 5633 : cluster [DBG] pgmap v3906: 225 pgs: 225 active+clean; 589 KiB data, 126 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:47:18.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:47:18 smithi047 bash[22744]: cluster 2024-09-16T07:47:17.198723+0000 mgr.a (mgr.14373) 5633 : cluster [DBG] pgmap v3906: 225 pgs: 225 active+clean; 589 KiB data, 126 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:47:20.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:47:20 smithi157 bash[24585]: cluster 2024-09-16T07:47:19.199478+0000 mgr.a (mgr.14373) 5634 : cluster [DBG] pgmap v3907: 225 pgs: 225 active+clean; 589 KiB data, 126 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:47:20.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:47:20 smithi086 bash[24289]: cluster 2024-09-16T07:47:19.199478+0000 mgr.a (mgr.14373) 5634 : cluster [DBG] pgmap v3907: 225 pgs: 225 active+clean; 589 KiB data, 126 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:47:20.569 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:47:20.570 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:47:20.570 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:47:20.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:47:20 smithi047 bash[22744]: cluster 2024-09-16T07:47:19.199478+0000 mgr.a (mgr.14373) 5634 : cluster [DBG] pgmap v3907: 225 pgs: 225 active+clean; 589 KiB data, 126 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:47:21.331 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:47:21.331 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:47:21.331 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:47:21.332 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:47:21.332 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:47:21.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:47:21 smithi157 bash[24585]: audit 2024-09-16T07:47:20.907424+0000 mgr.a (mgr.14373) 5635 : audit [DBG] from='client.130755 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:47:21.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:47:21 smithi086 bash[24289]: audit 2024-09-16T07:47:20.907424+0000 mgr.a (mgr.14373) 5635 : audit [DBG] from='client.130755 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:47:21.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:47:21 smithi047 bash[22744]: audit 2024-09-16T07:47:20.907424+0000 mgr.a (mgr.14373) 5635 : audit [DBG] from='client.130755 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:47:22.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:47:22 smithi157 bash[24585]: cluster 2024-09-16T07:47:21.200090+0000 mgr.a (mgr.14373) 5636 : cluster [DBG] pgmap v3908: 225 pgs: 225 active+clean; 589 KiB data, 126 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:47:22.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:47:22 smithi086 bash[24289]: cluster 2024-09-16T07:47:21.200090+0000 mgr.a (mgr.14373) 5636 : cluster [DBG] pgmap v3908: 225 pgs: 225 active+clean; 589 KiB data, 126 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:47:22.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:47:22 smithi047 bash[22744]: cluster 2024-09-16T07:47:21.200090+0000 mgr.a (mgr.14373) 5636 : cluster [DBG] pgmap v3908: 225 pgs: 225 active+clean; 589 KiB data, 126 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:47:24.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:47:24 smithi157 bash[24585]: cluster 2024-09-16T07:47:23.202443+0000 mgr.a (mgr.14373) 5637 : cluster [DBG] pgmap v3909: 225 pgs: 225 active+clean; 589 KiB data, 126 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:47:24.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:47:24 smithi086 bash[24289]: cluster 2024-09-16T07:47:23.202443+0000 mgr.a (mgr.14373) 5637 : cluster [DBG] pgmap v3909: 225 pgs: 225 active+clean; 589 KiB data, 126 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:47:24.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:47:24 smithi047 bash[22744]: cluster 2024-09-16T07:47:23.202443+0000 mgr.a (mgr.14373) 5637 : cluster [DBG] pgmap v3909: 225 pgs: 225 active+clean; 589 KiB data, 126 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:47:26.333 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:47:26.333 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:47:26.334 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:47:26.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:47:26 smithi157 bash[24585]: cluster 2024-09-16T07:47:25.203221+0000 mgr.a (mgr.14373) 5638 : cluster [DBG] pgmap v3910: 225 pgs: 225 active+clean; 589 KiB data, 126 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:47:26.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:47:26 smithi086 bash[24289]: cluster 2024-09-16T07:47:25.203221+0000 mgr.a (mgr.14373) 5638 : cluster [DBG] pgmap v3910: 225 pgs: 225 active+clean; 589 KiB data, 126 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:47:26.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:47:26 smithi047 bash[22744]: cluster 2024-09-16T07:47:25.203221+0000 mgr.a (mgr.14373) 5638 : cluster [DBG] pgmap v3910: 225 pgs: 225 active+clean; 589 KiB data, 126 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:47:27.109 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:47:27.109 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:47:27.109 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:47:27.109 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:47:27.109 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:47:27.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:47:27 smithi157 bash[24585]: audit 2024-09-16T07:47:26.677771+0000 mgr.a (mgr.14373) 5639 : audit [DBG] from='client.130830 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:47:27.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:47:27 smithi086 bash[24289]: audit 2024-09-16T07:47:26.677771+0000 mgr.a (mgr.14373) 5639 : audit [DBG] from='client.130830 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:47:27.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:47:27 smithi047 bash[22744]: audit 2024-09-16T07:47:26.677771+0000 mgr.a (mgr.14373) 5639 : audit [DBG] from='client.130830 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:47:28.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:47:28 smithi157 bash[24585]: cluster 2024-09-16T07:47:27.205944+0000 mgr.a (mgr.14373) 5640 : cluster [DBG] pgmap v3911: 225 pgs: 225 active+clean; 589 KiB data, 126 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:47:28.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:47:28 smithi086 bash[24289]: cluster 2024-09-16T07:47:27.205944+0000 mgr.a (mgr.14373) 5640 : cluster [DBG] pgmap v3911: 225 pgs: 225 active+clean; 589 KiB data, 126 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:47:28.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:47:28 smithi047 bash[22744]: cluster 2024-09-16T07:47:27.205944+0000 mgr.a (mgr.14373) 5640 : cluster [DBG] pgmap v3911: 225 pgs: 225 active+clean; 589 KiB data, 126 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:47:30.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:47:30 smithi086 bash[24289]: cluster 2024-09-16T07:47:29.206746+0000 mgr.a (mgr.14373) 5641 : cluster [DBG] pgmap v3912: 225 pgs: 225 active+clean; 589 KiB data, 126 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:47:30.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:47:30 smithi047 bash[22744]: cluster 2024-09-16T07:47:29.206746+0000 mgr.a (mgr.14373) 5641 : cluster [DBG] pgmap v3912: 225 pgs: 225 active+clean; 589 KiB data, 126 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:47:30.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:47:30 smithi157 bash[24585]: cluster 2024-09-16T07:47:29.206746+0000 mgr.a (mgr.14373) 5641 : cluster [DBG] pgmap v3912: 225 pgs: 225 active+clean; 589 KiB data, 126 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:47:32.110 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:47:32.111 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:47:32.111 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:47:32.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:47:32 smithi086 bash[24289]: cluster 2024-09-16T07:47:31.207525+0000 mgr.a (mgr.14373) 5642 : cluster [DBG] pgmap v3913: 225 pgs: 225 active+clean; 589 KiB data, 126 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T07:47:32.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:47:32 smithi047 bash[22744]: cluster 2024-09-16T07:47:31.207525+0000 mgr.a (mgr.14373) 5642 : cluster [DBG] pgmap v3913: 225 pgs: 225 active+clean; 589 KiB data, 126 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T07:47:32.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:47:32 smithi157 bash[24585]: cluster 2024-09-16T07:47:31.207525+0000 mgr.a (mgr.14373) 5642 : cluster [DBG] pgmap v3913: 225 pgs: 225 active+clean; 589 KiB data, 126 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T07:47:32.892 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:47:32.892 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:47:32.892 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:47:32.893 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:47:32.893 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:47:33.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:47:33 smithi047 bash[22744]: audit 2024-09-16T07:47:32.448063+0000 mgr.a (mgr.14373) 5643 : audit [DBG] from='client.130902 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:47:33.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:47:33 smithi157 bash[24585]: audit 2024-09-16T07:47:32.448063+0000 mgr.a (mgr.14373) 5643 : audit [DBG] from='client.130902 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:47:33.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:47:33 smithi086 bash[24289]: audit 2024-09-16T07:47:32.448063+0000 mgr.a (mgr.14373) 5643 : audit [DBG] from='client.130902 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:47:34.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:47:34 smithi047 bash[22744]: cluster 2024-09-16T07:47:33.210310+0000 mgr.a (mgr.14373) 5644 : cluster [DBG] pgmap v3914: 225 pgs: 225 active+clean; 589 KiB data, 126 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:47:34.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:47:34 smithi157 bash[24585]: cluster 2024-09-16T07:47:33.210310+0000 mgr.a (mgr.14373) 5644 : cluster [DBG] pgmap v3914: 225 pgs: 225 active+clean; 589 KiB data, 126 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:47:34.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:47:34 smithi086 bash[24289]: cluster 2024-09-16T07:47:33.210310+0000 mgr.a (mgr.14373) 5644 : cluster [DBG] pgmap v3914: 225 pgs: 225 active+clean; 589 KiB data, 126 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:47:36.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:47:36 smithi047 bash[22744]: cluster 2024-09-16T07:47:35.211130+0000 mgr.a (mgr.14373) 5645 : cluster [DBG] pgmap v3915: 225 pgs: 225 active+clean; 589 KiB data, 126 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:47:36.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:47:36 smithi157 bash[24585]: cluster 2024-09-16T07:47:35.211130+0000 mgr.a (mgr.14373) 5645 : cluster [DBG] pgmap v3915: 225 pgs: 225 active+clean; 589 KiB data, 126 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:47:36.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:47:36 smithi086 bash[24289]: cluster 2024-09-16T07:47:35.211130+0000 mgr.a (mgr.14373) 5645 : cluster [DBG] pgmap v3915: 225 pgs: 225 active+clean; 589 KiB data, 126 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:47:37.894 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:47:37.894 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:47:37.895 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:47:38.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:47:38 smithi047 bash[22744]: cluster 2024-09-16T07:47:37.213081+0000 mgr.a (mgr.14373) 5646 : cluster [DBG] pgmap v3916: 225 pgs: 225 active+clean; 589 KiB data, 126 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:47:38.673 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:47:38.673 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:47:38.673 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:47:38.673 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:47:38.673 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:47:38.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:47:38 smithi157 bash[24585]: cluster 2024-09-16T07:47:37.213081+0000 mgr.a (mgr.14373) 5646 : cluster [DBG] pgmap v3916: 225 pgs: 225 active+clean; 589 KiB data, 126 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:47:38.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:47:38 smithi086 bash[24289]: cluster 2024-09-16T07:47:37.213081+0000 mgr.a (mgr.14373) 5646 : cluster [DBG] pgmap v3916: 225 pgs: 225 active+clean; 589 KiB data, 126 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:47:39.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:47:39 smithi047 bash[22744]: audit 2024-09-16T07:47:38.235968+0000 mgr.a (mgr.14373) 5647 : audit [DBG] from='client.130980 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:47:39.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:47:39 smithi157 bash[24585]: audit 2024-09-16T07:47:38.235968+0000 mgr.a (mgr.14373) 5647 : audit [DBG] from='client.130980 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:47:39.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:47:39 smithi086 bash[24289]: audit 2024-09-16T07:47:38.235968+0000 mgr.a (mgr.14373) 5647 : audit [DBG] from='client.130980 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:47:40.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:47:40 smithi157 bash[24585]: cluster 2024-09-16T07:47:39.214087+0000 mgr.a (mgr.14373) 5648 : cluster [DBG] pgmap v3917: 225 pgs: 225 active+clean; 589 KiB data, 126 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:47:40.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:47:40 smithi086 bash[24289]: cluster 2024-09-16T07:47:39.214087+0000 mgr.a (mgr.14373) 5648 : cluster [DBG] pgmap v3917: 225 pgs: 225 active+clean; 589 KiB data, 126 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:47:40.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:47:40 smithi047 bash[22744]: cluster 2024-09-16T07:47:39.214087+0000 mgr.a (mgr.14373) 5648 : cluster [DBG] pgmap v3917: 225 pgs: 225 active+clean; 589 KiB data, 126 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:47:42.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:47:42 smithi157 bash[24585]: cluster 2024-09-16T07:47:41.214858+0000 mgr.a (mgr.14373) 5649 : cluster [DBG] pgmap v3918: 225 pgs: 225 active+clean; 589 KiB data, 126 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:47:42.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:47:42 smithi157 bash[24585]: audit 2024-09-16T07:47:42.024694+0000 mon.b (mon.2) 546 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T07:47:42.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:47:42 smithi086 bash[24289]: cluster 2024-09-16T07:47:41.214858+0000 mgr.a (mgr.14373) 5649 : cluster [DBG] pgmap v3918: 225 pgs: 225 active+clean; 589 KiB data, 126 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:47:42.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:47:42 smithi086 bash[24289]: audit 2024-09-16T07:47:42.024694+0000 mon.b (mon.2) 546 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T07:47:42.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:47:42 smithi047 bash[22744]: cluster 2024-09-16T07:47:41.214858+0000 mgr.a (mgr.14373) 5649 : cluster [DBG] pgmap v3918: 225 pgs: 225 active+clean; 589 KiB data, 126 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:47:42.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:47:42 smithi047 bash[22744]: audit 2024-09-16T07:47:42.024694+0000 mon.b (mon.2) 546 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T07:47:43.636 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:47:43 smithi047 bash[22744]: audit 2024-09-16T07:47:42.872029+0000 mon.b (mon.2) 547 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T07:47:43.636 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:47:43 smithi047 bash[22744]: audit 2024-09-16T07:47:42.873827+0000 mon.b (mon.2) 548 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T07:47:43.636 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:47:43 smithi047 bash[22744]: audit 2024-09-16T07:47:42.885803+0000 mon.a (mon.0) 907 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:47:43.636 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:47:43 smithi047 bash[22744]: audit 2024-09-16T07:47:42.887566+0000 mon.b (mon.2) 549 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:47:43.636 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:47:43 smithi047 bash[22744]: audit 2024-09-16T07:47:42.890800+0000 mgr.a (mgr.14373) 5650 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:47:43.674 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:47:43.674 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:47:43.675 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:47:43.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:47:43 smithi157 bash[24585]: audit 2024-09-16T07:47:42.872029+0000 mon.b (mon.2) 547 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T07:47:43.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:47:43 smithi157 bash[24585]: audit 2024-09-16T07:47:42.873827+0000 mon.b (mon.2) 548 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T07:47:43.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:47:43 smithi157 bash[24585]: audit 2024-09-16T07:47:42.885803+0000 mon.a (mon.0) 907 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:47:43.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:47:43 smithi157 bash[24585]: audit 2024-09-16T07:47:42.887566+0000 mon.b (mon.2) 549 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:47:43.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:47:43 smithi157 bash[24585]: audit 2024-09-16T07:47:42.890800+0000 mgr.a (mgr.14373) 5650 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:47:43.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:47:43 smithi086 bash[24289]: audit 2024-09-16T07:47:42.872029+0000 mon.b (mon.2) 547 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T07:47:43.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:47:43 smithi086 bash[24289]: audit 2024-09-16T07:47:42.873827+0000 mon.b (mon.2) 548 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T07:47:43.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:47:43 smithi086 bash[24289]: audit 2024-09-16T07:47:42.885803+0000 mon.a (mon.0) 907 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:47:43.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:47:43 smithi086 bash[24289]: audit 2024-09-16T07:47:42.887566+0000 mon.b (mon.2) 549 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:47:43.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:47:43 smithi086 bash[24289]: audit 2024-09-16T07:47:42.890800+0000 mgr.a (mgr.14373) 5650 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:47:44.088 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 07:47:43 smithi047 bash[22994]: debug 2024-09-16T07:47:43.634+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T07:47:44.088 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 07:47:43 smithi047 bash[22994]: debug 2024-09-16T07:47:43.634+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T07:47:44.413 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:47:44.413 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:47:44.413 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:47:44.413 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:47:44.414 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:47:45.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:47:44 smithi157 bash[24585]: cluster 2024-09-16T07:47:43.216159+0000 mgr.a (mgr.14373) 5651 : cluster [DBG] pgmap v3919: 225 pgs: 225 active+clean; 589 KiB data, 126 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:47:45.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:47:44 smithi157 bash[24585]: audit 2024-09-16T07:47:43.638502+0000 mgr.a (mgr.14373) 5652 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T07:47:45.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:47:44 smithi157 bash[24585]: cephadm 2024-09-16T07:47:43.640934+0000 mgr.a (mgr.14373) 5653 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T07:47:45.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:47:44 smithi157 bash[24585]: audit 2024-09-16T07:47:44.002168+0000 mgr.a (mgr.14373) 5654 : audit [DBG] from='client.131166 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:47:45.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:47:44 smithi086 bash[24289]: cluster 2024-09-16T07:47:43.216159+0000 mgr.a (mgr.14373) 5651 : cluster [DBG] pgmap v3919: 225 pgs: 225 active+clean; 589 KiB data, 126 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:47:45.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:47:44 smithi086 bash[24289]: audit 2024-09-16T07:47:43.638502+0000 mgr.a (mgr.14373) 5652 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T07:47:45.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:47:44 smithi086 bash[24289]: cephadm 2024-09-16T07:47:43.640934+0000 mgr.a (mgr.14373) 5653 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T07:47:45.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:47:44 smithi086 bash[24289]: audit 2024-09-16T07:47:44.002168+0000 mgr.a (mgr.14373) 5654 : audit [DBG] from='client.131166 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:47:45.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:47:44 smithi047 bash[22744]: cluster 2024-09-16T07:47:43.216159+0000 mgr.a (mgr.14373) 5651 : cluster [DBG] pgmap v3919: 225 pgs: 225 active+clean; 589 KiB data, 126 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:47:45.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:47:44 smithi047 bash[22744]: audit 2024-09-16T07:47:43.638502+0000 mgr.a (mgr.14373) 5652 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T07:47:45.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:47:44 smithi047 bash[22744]: cephadm 2024-09-16T07:47:43.640934+0000 mgr.a (mgr.14373) 5653 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T07:47:45.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:47:44 smithi047 bash[22744]: audit 2024-09-16T07:47:44.002168+0000 mgr.a (mgr.14373) 5654 : audit [DBG] from='client.131166 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:47:47.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:47:46 smithi157 bash[24585]: cluster 2024-09-16T07:47:45.217088+0000 mgr.a (mgr.14373) 5655 : cluster [DBG] pgmap v3920: 225 pgs: 225 active+clean; 589 KiB data, 126 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:47:47.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:47:46 smithi086 bash[24289]: cluster 2024-09-16T07:47:45.217088+0000 mgr.a (mgr.14373) 5655 : cluster [DBG] pgmap v3920: 225 pgs: 225 active+clean; 589 KiB data, 126 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:47:47.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:47:46 smithi047 bash[22744]: cluster 2024-09-16T07:47:45.217088+0000 mgr.a (mgr.14373) 5655 : cluster [DBG] pgmap v3920: 225 pgs: 225 active+clean; 589 KiB data, 126 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:47:49.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:47:48 smithi157 bash[24585]: cluster 2024-09-16T07:47:47.219304+0000 mgr.a (mgr.14373) 5656 : cluster [DBG] pgmap v3921: 225 pgs: 225 active+clean; 589 KiB data, 126 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:47:49.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:47:48 smithi086 bash[24289]: cluster 2024-09-16T07:47:47.219304+0000 mgr.a (mgr.14373) 5656 : cluster [DBG] pgmap v3921: 225 pgs: 225 active+clean; 589 KiB data, 126 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:47:49.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:47:48 smithi047 bash[22744]: cluster 2024-09-16T07:47:47.219304+0000 mgr.a (mgr.14373) 5656 : cluster [DBG] pgmap v3921: 225 pgs: 225 active+clean; 589 KiB data, 126 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:47:49.415 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:47:49.415 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:47:49.416 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:47:50.205 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:47:50.206 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:47:50.206 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:47:50.206 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:47:50.206 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:47:51.317 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:47:50 smithi157 bash[24585]: cluster 2024-09-16T07:47:49.220071+0000 mgr.a (mgr.14373) 5657 : cluster [DBG] pgmap v3922: 225 pgs: 225 active+clean; 589 KiB data, 126 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:47:51.317 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:47:50 smithi157 bash[24585]: audit 2024-09-16T07:47:49.754256+0000 mgr.a (mgr.14373) 5658 : audit [DBG] from='client.131244 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:47:51.327 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:47:50 smithi086 bash[24289]: cluster 2024-09-16T07:47:49.220071+0000 mgr.a (mgr.14373) 5657 : cluster [DBG] pgmap v3922: 225 pgs: 225 active+clean; 589 KiB data, 126 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:47:51.328 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:47:50 smithi086 bash[24289]: audit 2024-09-16T07:47:49.754256+0000 mgr.a (mgr.14373) 5658 : audit [DBG] from='client.131244 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:47:51.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:47:50 smithi047 bash[22744]: cluster 2024-09-16T07:47:49.220071+0000 mgr.a (mgr.14373) 5657 : cluster [DBG] pgmap v3922: 225 pgs: 225 active+clean; 589 KiB data, 126 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:47:51.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:47:50 smithi047 bash[22744]: audit 2024-09-16T07:47:49.754256+0000 mgr.a (mgr.14373) 5658 : audit [DBG] from='client.131244 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:47:53.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:47:52 smithi157 bash[24585]: cluster 2024-09-16T07:47:51.220992+0000 mgr.a (mgr.14373) 5659 : cluster [DBG] pgmap v3923: 225 pgs: 225 active+clean; 589 KiB data, 126 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:47:53.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:47:52 smithi086 bash[24289]: cluster 2024-09-16T07:47:51.220992+0000 mgr.a (mgr.14373) 5659 : cluster [DBG] pgmap v3923: 225 pgs: 225 active+clean; 589 KiB data, 126 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:47:53.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:47:52 smithi047 bash[22744]: cluster 2024-09-16T07:47:51.220992+0000 mgr.a (mgr.14373) 5659 : cluster [DBG] pgmap v3923: 225 pgs: 225 active+clean; 589 KiB data, 126 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:47:55.207 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:47:55.208 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:47:55.208 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:47:55.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:47:54 smithi157 bash[24585]: cluster 2024-09-16T07:47:53.223284+0000 mgr.a (mgr.14373) 5660 : cluster [DBG] pgmap v3924: 225 pgs: 225 active+clean; 589 KiB data, 126 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:47:55.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:47:54 smithi086 bash[24289]: cluster 2024-09-16T07:47:53.223284+0000 mgr.a (mgr.14373) 5660 : cluster [DBG] pgmap v3924: 225 pgs: 225 active+clean; 589 KiB data, 126 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:47:55.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:47:54 smithi047 bash[22744]: cluster 2024-09-16T07:47:53.223284+0000 mgr.a (mgr.14373) 5660 : cluster [DBG] pgmap v3924: 225 pgs: 225 active+clean; 589 KiB data, 126 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:47:55.952 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:47:55.953 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:47:55.953 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:47:55.953 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:47:55.953 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:47:57.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:47:56 smithi157 bash[24585]: cluster 2024-09-16T07:47:55.224064+0000 mgr.a (mgr.14373) 5661 : cluster [DBG] pgmap v3925: 225 pgs: 225 active+clean; 589 KiB data, 126 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:47:57.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:47:56 smithi157 bash[24585]: audit 2024-09-16T07:47:55.541481+0000 mgr.a (mgr.14373) 5662 : audit [DBG] from='client.131319 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:47:57.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:47:56 smithi086 bash[24289]: cluster 2024-09-16T07:47:55.224064+0000 mgr.a (mgr.14373) 5661 : cluster [DBG] pgmap v3925: 225 pgs: 225 active+clean; 589 KiB data, 126 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:47:57.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:47:56 smithi086 bash[24289]: audit 2024-09-16T07:47:55.541481+0000 mgr.a (mgr.14373) 5662 : audit [DBG] from='client.131319 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:47:57.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:47:56 smithi047 bash[22744]: cluster 2024-09-16T07:47:55.224064+0000 mgr.a (mgr.14373) 5661 : cluster [DBG] pgmap v3925: 225 pgs: 225 active+clean; 589 KiB data, 126 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:47:57.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:47:56 smithi047 bash[22744]: audit 2024-09-16T07:47:55.541481+0000 mgr.a (mgr.14373) 5662 : audit [DBG] from='client.131319 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:47:59.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:47:58 smithi157 bash[24585]: cluster 2024-09-16T07:47:57.226400+0000 mgr.a (mgr.14373) 5663 : cluster [DBG] pgmap v3926: 225 pgs: 225 active+clean; 589 KiB data, 126 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:47:59.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:47:58 smithi086 bash[24289]: cluster 2024-09-16T07:47:57.226400+0000 mgr.a (mgr.14373) 5663 : cluster [DBG] pgmap v3926: 225 pgs: 225 active+clean; 589 KiB data, 126 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:47:59.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:47:58 smithi047 bash[22744]: cluster 2024-09-16T07:47:57.226400+0000 mgr.a (mgr.14373) 5663 : cluster [DBG] pgmap v3926: 225 pgs: 225 active+clean; 589 KiB data, 126 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:48:00.954 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:48:00.955 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:48:00.955 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:48:01.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:48:00 smithi157 bash[24585]: cluster 2024-09-16T07:47:59.227174+0000 mgr.a (mgr.14373) 5664 : cluster [DBG] pgmap v3927: 225 pgs: 225 active+clean; 589 KiB data, 126 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:48:01.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:48:00 smithi086 bash[24289]: cluster 2024-09-16T07:47:59.227174+0000 mgr.a (mgr.14373) 5664 : cluster [DBG] pgmap v3927: 225 pgs: 225 active+clean; 589 KiB data, 126 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:48:01.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:48:00 smithi047 bash[22744]: cluster 2024-09-16T07:47:59.227174+0000 mgr.a (mgr.14373) 5664 : cluster [DBG] pgmap v3927: 225 pgs: 225 active+clean; 589 KiB data, 126 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:48:01.702 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:48:01.702 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:48:01.703 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:48:01.703 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:48:01.703 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:48:03.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:48:02 smithi157 bash[24585]: cluster 2024-09-16T07:48:01.227900+0000 mgr.a (mgr.14373) 5665 : cluster [DBG] pgmap v3928: 225 pgs: 225 active+clean; 589 KiB data, 126 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:48:03.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:48:02 smithi157 bash[24585]: audit 2024-09-16T07:48:01.291327+0000 mgr.a (mgr.14373) 5666 : audit [DBG] from='client.131394 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:48:03.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:48:02 smithi086 bash[24289]: cluster 2024-09-16T07:48:01.227900+0000 mgr.a (mgr.14373) 5665 : cluster [DBG] pgmap v3928: 225 pgs: 225 active+clean; 589 KiB data, 126 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:48:03.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:48:02 smithi086 bash[24289]: audit 2024-09-16T07:48:01.291327+0000 mgr.a (mgr.14373) 5666 : audit [DBG] from='client.131394 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:48:03.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:48:02 smithi047 bash[22744]: cluster 2024-09-16T07:48:01.227900+0000 mgr.a (mgr.14373) 5665 : cluster [DBG] pgmap v3928: 225 pgs: 225 active+clean; 589 KiB data, 126 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:48:03.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:48:02 smithi047 bash[22744]: audit 2024-09-16T07:48:01.291327+0000 mgr.a (mgr.14373) 5666 : audit [DBG] from='client.131394 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:48:05.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:48:04 smithi157 bash[24585]: cluster 2024-09-16T07:48:03.230606+0000 mgr.a (mgr.14373) 5667 : cluster [DBG] pgmap v3929: 225 pgs: 225 active+clean; 589 KiB data, 126 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:48:05.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:48:04 smithi086 bash[24289]: cluster 2024-09-16T07:48:03.230606+0000 mgr.a (mgr.14373) 5667 : cluster [DBG] pgmap v3929: 225 pgs: 225 active+clean; 589 KiB data, 126 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:48:05.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:48:04 smithi047 bash[22744]: cluster 2024-09-16T07:48:03.230606+0000 mgr.a (mgr.14373) 5667 : cluster [DBG] pgmap v3929: 225 pgs: 225 active+clean; 589 KiB data, 126 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:48:06.704 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:48:06.704 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:48:06.705 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:48:07.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:48:06 smithi157 bash[24585]: cluster 2024-09-16T07:48:05.231435+0000 mgr.a (mgr.14373) 5668 : cluster [DBG] pgmap v3930: 225 pgs: 225 active+clean; 589 KiB data, 126 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:48:07.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:48:06 smithi086 bash[24289]: cluster 2024-09-16T07:48:05.231435+0000 mgr.a (mgr.14373) 5668 : cluster [DBG] pgmap v3930: 225 pgs: 225 active+clean; 589 KiB data, 126 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:48:07.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:48:06 smithi047 bash[22744]: cluster 2024-09-16T07:48:05.231435+0000 mgr.a (mgr.14373) 5668 : cluster [DBG] pgmap v3930: 225 pgs: 225 active+clean; 589 KiB data, 126 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:48:07.450 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:48:07.450 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:48:07.450 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:48:07.450 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:48:07.450 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:48:08.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:48:07 smithi157 bash[24585]: audit 2024-09-16T07:48:07.040556+0000 mgr.a (mgr.14373) 5669 : audit [DBG] from='client.131472 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:48:08.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:48:07 smithi086 bash[24289]: audit 2024-09-16T07:48:07.040556+0000 mgr.a (mgr.14373) 5669 : audit [DBG] from='client.131472 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:48:08.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:48:07 smithi047 bash[22744]: audit 2024-09-16T07:48:07.040556+0000 mgr.a (mgr.14373) 5669 : audit [DBG] from='client.131472 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:48:09.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:48:08 smithi157 bash[24585]: cluster 2024-09-16T07:48:07.232858+0000 mgr.a (mgr.14373) 5670 : cluster [DBG] pgmap v3931: 225 pgs: 225 active+clean; 589 KiB data, 126 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-16T07:48:09.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:48:08 smithi086 bash[24289]: cluster 2024-09-16T07:48:07.232858+0000 mgr.a (mgr.14373) 5670 : cluster [DBG] pgmap v3931: 225 pgs: 225 active+clean; 589 KiB data, 126 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-16T07:48:09.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:48:08 smithi047 bash[22744]: cluster 2024-09-16T07:48:07.232858+0000 mgr.a (mgr.14373) 5670 : cluster [DBG] pgmap v3931: 225 pgs: 225 active+clean; 589 KiB data, 126 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-16T07:48:11.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:48:10 smithi157 bash[24585]: cluster 2024-09-16T07:48:09.233707+0000 mgr.a (mgr.14373) 5671 : cluster [DBG] pgmap v3932: 225 pgs: 225 active+clean; 589 KiB data, 126 MiB used, 268 GiB / 268 GiB avail; 4.9 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-16T07:48:11.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:48:10 smithi086 bash[24289]: cluster 2024-09-16T07:48:09.233707+0000 mgr.a (mgr.14373) 5671 : cluster [DBG] pgmap v3932: 225 pgs: 225 active+clean; 589 KiB data, 126 MiB used, 268 GiB / 268 GiB avail; 4.9 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-16T07:48:11.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:48:10 smithi047 bash[22744]: cluster 2024-09-16T07:48:09.233707+0000 mgr.a (mgr.14373) 5671 : cluster [DBG] pgmap v3932: 225 pgs: 225 active+clean; 589 KiB data, 126 MiB used, 268 GiB / 268 GiB avail; 4.9 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-16T07:48:12.452 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:48:12.453 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:48:12.453 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:48:13.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:48:12 smithi157 bash[24585]: cluster 2024-09-16T07:48:11.234527+0000 mgr.a (mgr.14373) 5672 : cluster [DBG] pgmap v3933: 225 pgs: 225 active+clean; 589 KiB data, 126 MiB used, 268 GiB / 268 GiB avail; 4.9 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-16T07:48:13.311 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:48:13.312 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:48:13.312 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:48:13.312 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:48:13.312 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:48:13.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:48:12 smithi086 bash[24289]: cluster 2024-09-16T07:48:11.234527+0000 mgr.a (mgr.14373) 5672 : cluster [DBG] pgmap v3933: 225 pgs: 225 active+clean; 589 KiB data, 126 MiB used, 268 GiB / 268 GiB avail; 4.9 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-16T07:48:13.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:48:12 smithi047 bash[22744]: cluster 2024-09-16T07:48:11.234527+0000 mgr.a (mgr.14373) 5672 : cluster [DBG] pgmap v3933: 225 pgs: 225 active+clean; 589 KiB data, 126 MiB used, 268 GiB / 268 GiB avail; 4.9 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-16T07:48:14.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:48:13 smithi157 bash[24585]: audit 2024-09-16T07:48:12.840749+0000 mgr.a (mgr.14373) 5673 : audit [DBG] from='client.131550 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:48:14.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:48:13 smithi086 bash[24289]: audit 2024-09-16T07:48:12.840749+0000 mgr.a (mgr.14373) 5673 : audit [DBG] from='client.131550 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:48:14.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:48:13 smithi047 bash[22744]: audit 2024-09-16T07:48:12.840749+0000 mgr.a (mgr.14373) 5673 : audit [DBG] from='client.131550 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:48:15.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:48:14 smithi157 bash[24585]: cluster 2024-09-16T07:48:13.235834+0000 mgr.a (mgr.14373) 5674 : cluster [DBG] pgmap v3934: 225 pgs: 225 active+clean; 589 KiB data, 126 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-16T07:48:15.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:48:14 smithi086 bash[24289]: cluster 2024-09-16T07:48:13.235834+0000 mgr.a (mgr.14373) 5674 : cluster [DBG] pgmap v3934: 225 pgs: 225 active+clean; 589 KiB data, 126 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-16T07:48:15.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:48:14 smithi047 bash[22744]: cluster 2024-09-16T07:48:13.235834+0000 mgr.a (mgr.14373) 5674 : cluster [DBG] pgmap v3934: 225 pgs: 225 active+clean; 589 KiB data, 126 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-16T07:48:17.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:48:16 smithi157 bash[24585]: cluster 2024-09-16T07:48:15.236582+0000 mgr.a (mgr.14373) 5675 : cluster [DBG] pgmap v3935: 225 pgs: 225 active+clean; 589 KiB data, 126 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-16T07:48:17.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:48:16 smithi086 bash[24289]: cluster 2024-09-16T07:48:15.236582+0000 mgr.a (mgr.14373) 5675 : cluster [DBG] pgmap v3935: 225 pgs: 225 active+clean; 589 KiB data, 126 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-16T07:48:17.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:48:16 smithi047 bash[22744]: cluster 2024-09-16T07:48:15.236582+0000 mgr.a (mgr.14373) 5675 : cluster [DBG] pgmap v3935: 225 pgs: 225 active+clean; 589 KiB data, 126 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-16T07:48:18.313 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:48:18.314 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:48:18.314 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:48:19.093 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:48:19.093 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:48:19.093 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:48:19.093 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:48:19.094 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:48:19.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:48:18 smithi157 bash[24585]: cluster 2024-09-16T07:48:17.238617+0000 mgr.a (mgr.14373) 5676 : cluster [DBG] pgmap v3936: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 70 KiB/s rd, 0 B/s wr, 114 op/s 2024-09-16T07:48:19.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:48:18 smithi086 bash[24289]: cluster 2024-09-16T07:48:17.238617+0000 mgr.a (mgr.14373) 5676 : cluster [DBG] pgmap v3936: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 70 KiB/s rd, 0 B/s wr, 114 op/s 2024-09-16T07:48:19.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:48:18 smithi047 bash[22744]: cluster 2024-09-16T07:48:17.238617+0000 mgr.a (mgr.14373) 5676 : cluster [DBG] pgmap v3936: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 70 KiB/s rd, 0 B/s wr, 114 op/s 2024-09-16T07:48:20.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:48:19 smithi157 bash[24585]: audit 2024-09-16T07:48:18.652429+0000 mgr.a (mgr.14373) 5677 : audit [DBG] from='client.131628 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:48:20.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:48:19 smithi086 bash[24289]: audit 2024-09-16T07:48:18.652429+0000 mgr.a (mgr.14373) 5677 : audit [DBG] from='client.131628 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:48:20.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:48:19 smithi047 bash[22744]: audit 2024-09-16T07:48:18.652429+0000 mgr.a (mgr.14373) 5677 : audit [DBG] from='client.131628 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:48:21.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:48:20 smithi157 bash[24585]: cluster 2024-09-16T07:48:19.239570+0000 mgr.a (mgr.14373) 5678 : cluster [DBG] pgmap v3937: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 65 KiB/s rd, 0 B/s wr, 107 op/s 2024-09-16T07:48:21.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:48:20 smithi086 bash[24289]: cluster 2024-09-16T07:48:19.239570+0000 mgr.a (mgr.14373) 5678 : cluster [DBG] pgmap v3937: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 65 KiB/s rd, 0 B/s wr, 107 op/s 2024-09-16T07:48:21.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:48:20 smithi047 bash[22744]: cluster 2024-09-16T07:48:19.239570+0000 mgr.a (mgr.14373) 5678 : cluster [DBG] pgmap v3937: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 65 KiB/s rd, 0 B/s wr, 107 op/s 2024-09-16T07:48:23.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:48:22 smithi157 bash[24585]: cluster 2024-09-16T07:48:21.240358+0000 mgr.a (mgr.14373) 5679 : cluster [DBG] pgmap v3938: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 65 KiB/s rd, 0 B/s wr, 107 op/s 2024-09-16T07:48:23.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:48:22 smithi086 bash[24289]: cluster 2024-09-16T07:48:21.240358+0000 mgr.a (mgr.14373) 5679 : cluster [DBG] pgmap v3938: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 65 KiB/s rd, 0 B/s wr, 107 op/s 2024-09-16T07:48:23.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:48:22 smithi047 bash[22744]: cluster 2024-09-16T07:48:21.240358+0000 mgr.a (mgr.14373) 5679 : cluster [DBG] pgmap v3938: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 65 KiB/s rd, 0 B/s wr, 107 op/s 2024-09-16T07:48:24.094 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:48:24.095 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:48:24.095 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:48:24.853 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:48:24.853 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:48:24.853 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:48:24.854 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:48:24.854 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:48:25.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:48:24 smithi157 bash[24585]: cluster 2024-09-16T07:48:23.242652+0000 mgr.a (mgr.14373) 5680 : cluster [DBG] pgmap v3939: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 66 KiB/s rd, 0 B/s wr, 108 op/s 2024-09-16T07:48:25.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:48:24 smithi086 bash[24289]: cluster 2024-09-16T07:48:23.242652+0000 mgr.a (mgr.14373) 5680 : cluster [DBG] pgmap v3939: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 66 KiB/s rd, 0 B/s wr, 108 op/s 2024-09-16T07:48:25.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:48:24 smithi047 bash[22744]: cluster 2024-09-16T07:48:23.242652+0000 mgr.a (mgr.14373) 5680 : cluster [DBG] pgmap v3939: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 66 KiB/s rd, 0 B/s wr, 108 op/s 2024-09-16T07:48:26.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:48:25 smithi157 bash[24585]: audit 2024-09-16T07:48:24.430091+0000 mgr.a (mgr.14373) 5681 : audit [DBG] from='client.131703 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:48:26.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:48:25 smithi086 bash[24289]: audit 2024-09-16T07:48:24.430091+0000 mgr.a (mgr.14373) 5681 : audit [DBG] from='client.131703 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:48:26.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:48:25 smithi047 bash[22744]: audit 2024-09-16T07:48:24.430091+0000 mgr.a (mgr.14373) 5681 : audit [DBG] from='client.131703 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:48:27.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:48:27 smithi157 bash[24585]: cluster 2024-09-16T07:48:25.243598+0000 mgr.a (mgr.14373) 5682 : cluster [DBG] pgmap v3940: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 65 KiB/s rd, 0 B/s wr, 107 op/s 2024-09-16T07:48:27.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:48:26 smithi086 bash[24289]: cluster 2024-09-16T07:48:25.243598+0000 mgr.a (mgr.14373) 5682 : cluster [DBG] pgmap v3940: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 65 KiB/s rd, 0 B/s wr, 107 op/s 2024-09-16T07:48:27.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:48:27 smithi047 bash[22744]: cluster 2024-09-16T07:48:25.243598+0000 mgr.a (mgr.14373) 5682 : cluster [DBG] pgmap v3940: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 65 KiB/s rd, 0 B/s wr, 107 op/s 2024-09-16T07:48:29.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:48:29 smithi157 bash[24585]: cluster 2024-09-16T07:48:27.245815+0000 mgr.a (mgr.14373) 5683 : cluster [DBG] pgmap v3941: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 66 KiB/s rd, 0 B/s wr, 108 op/s 2024-09-16T07:48:29.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:48:29 smithi086 bash[24289]: cluster 2024-09-16T07:48:27.245815+0000 mgr.a (mgr.14373) 5683 : cluster [DBG] pgmap v3941: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 66 KiB/s rd, 0 B/s wr, 108 op/s 2024-09-16T07:48:29.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:48:29 smithi047 bash[22744]: cluster 2024-09-16T07:48:27.245815+0000 mgr.a (mgr.14373) 5683 : cluster [DBG] pgmap v3941: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 66 KiB/s rd, 0 B/s wr, 108 op/s 2024-09-16T07:48:29.855 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:48:29.855 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:48:29.855 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:48:30.617 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:48:30.618 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:48:30.618 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:48:30.618 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:48:30.618 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:48:31.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:48:31 smithi157 bash[24585]: cluster 2024-09-16T07:48:29.246579+0000 mgr.a (mgr.14373) 5684 : cluster [DBG] pgmap v3942: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:48:31.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:48:31 smithi086 bash[24289]: cluster 2024-09-16T07:48:29.246579+0000 mgr.a (mgr.14373) 5684 : cluster [DBG] pgmap v3942: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:48:31.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:48:31 smithi047 bash[22744]: cluster 2024-09-16T07:48:29.246579+0000 mgr.a (mgr.14373) 5684 : cluster [DBG] pgmap v3942: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:48:32.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:48:32 smithi157 bash[24585]: audit 2024-09-16T07:48:30.196551+0000 mgr.a (mgr.14373) 5685 : audit [DBG] from='client.131775 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:48:32.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:48:32 smithi086 bash[24289]: audit 2024-09-16T07:48:30.196551+0000 mgr.a (mgr.14373) 5685 : audit [DBG] from='client.131775 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:48:32.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:48:32 smithi047 bash[22744]: audit 2024-09-16T07:48:30.196551+0000 mgr.a (mgr.14373) 5685 : audit [DBG] from='client.131775 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:48:33.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:48:33 smithi157 bash[24585]: cluster 2024-09-16T07:48:31.247478+0000 mgr.a (mgr.14373) 5686 : cluster [DBG] pgmap v3943: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:48:33.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:48:33 smithi086 bash[24289]: cluster 2024-09-16T07:48:31.247478+0000 mgr.a (mgr.14373) 5686 : cluster [DBG] pgmap v3943: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:48:33.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:48:33 smithi047 bash[22744]: cluster 2024-09-16T07:48:31.247478+0000 mgr.a (mgr.14373) 5686 : cluster [DBG] pgmap v3943: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:48:35.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:48:35 smithi047 bash[22744]: cluster 2024-09-16T07:48:33.249792+0000 mgr.a (mgr.14373) 5687 : cluster [DBG] pgmap v3944: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:48:35.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:48:35 smithi157 bash[24585]: cluster 2024-09-16T07:48:33.249792+0000 mgr.a (mgr.14373) 5687 : cluster [DBG] pgmap v3944: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:48:35.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:48:35 smithi086 bash[24289]: cluster 2024-09-16T07:48:33.249792+0000 mgr.a (mgr.14373) 5687 : cluster [DBG] pgmap v3944: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:48:35.619 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:48:35.619 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:48:35.620 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:48:36.398 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:48:36.398 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:48:36.398 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:48:36.398 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:48:36.398 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:48:37.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:48:37 smithi047 bash[22744]: cluster 2024-09-16T07:48:35.250611+0000 mgr.a (mgr.14373) 5688 : cluster [DBG] pgmap v3945: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:48:37.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:48:37 smithi047 bash[22744]: audit 2024-09-16T07:48:35.960973+0000 mgr.a (mgr.14373) 5689 : audit [DBG] from='client.131853 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:48:37.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:48:37 smithi157 bash[24585]: cluster 2024-09-16T07:48:35.250611+0000 mgr.a (mgr.14373) 5688 : cluster [DBG] pgmap v3945: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:48:37.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:48:37 smithi157 bash[24585]: audit 2024-09-16T07:48:35.960973+0000 mgr.a (mgr.14373) 5689 : audit [DBG] from='client.131853 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:48:37.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:48:37 smithi086 bash[24289]: cluster 2024-09-16T07:48:35.250611+0000 mgr.a (mgr.14373) 5688 : cluster [DBG] pgmap v3945: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:48:37.614 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:48:37 smithi086 bash[24289]: audit 2024-09-16T07:48:35.960973+0000 mgr.a (mgr.14373) 5689 : audit [DBG] from='client.131853 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:48:39.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:48:39 smithi157 bash[24585]: cluster 2024-09-16T07:48:37.253010+0000 mgr.a (mgr.14373) 5690 : cluster [DBG] pgmap v3946: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:48:39.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:48:39 smithi086 bash[24289]: cluster 2024-09-16T07:48:37.253010+0000 mgr.a (mgr.14373) 5690 : cluster [DBG] pgmap v3946: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:48:39.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:48:39 smithi047 bash[22744]: cluster 2024-09-16T07:48:37.253010+0000 mgr.a (mgr.14373) 5690 : cluster [DBG] pgmap v3946: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:48:40.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:48:40 smithi157 bash[24585]: cluster 2024-09-16T07:48:39.253787+0000 mgr.a (mgr.14373) 5691 : cluster [DBG] pgmap v3947: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:48:40.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:48:40 smithi086 bash[24289]: cluster 2024-09-16T07:48:39.253787+0000 mgr.a (mgr.14373) 5691 : cluster [DBG] pgmap v3947: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:48:40.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:48:40 smithi047 bash[22744]: cluster 2024-09-16T07:48:39.253787+0000 mgr.a (mgr.14373) 5691 : cluster [DBG] pgmap v3947: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:48:41.399 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:48:41.400 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:48:41.400 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:48:42.140 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:48:42.140 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:48:42.140 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:48:42.140 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:48:42.140 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:48:42.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:48:42 smithi086 bash[24289]: cluster 2024-09-16T07:48:41.254581+0000 mgr.a (mgr.14373) 5692 : cluster [DBG] pgmap v3948: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:48:42.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:48:42 smithi086 bash[24289]: audit 2024-09-16T07:48:41.734453+0000 mgr.a (mgr.14373) 5693 : audit [DBG] from='client.131928 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:48:42.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:48:42 smithi047 bash[22744]: cluster 2024-09-16T07:48:41.254581+0000 mgr.a (mgr.14373) 5692 : cluster [DBG] pgmap v3948: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:48:42.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:48:42 smithi047 bash[22744]: audit 2024-09-16T07:48:41.734453+0000 mgr.a (mgr.14373) 5693 : audit [DBG] from='client.131928 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:48:42.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:48:42 smithi157 bash[24585]: cluster 2024-09-16T07:48:41.254581+0000 mgr.a (mgr.14373) 5692 : cluster [DBG] pgmap v3948: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:48:42.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:48:42 smithi157 bash[24585]: audit 2024-09-16T07:48:41.734453+0000 mgr.a (mgr.14373) 5693 : audit [DBG] from='client.131928 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:48:44.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:48:44 smithi086 bash[24289]: cluster 2024-09-16T07:48:43.257332+0000 mgr.a (mgr.14373) 5694 : cluster [DBG] pgmap v3949: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:48:44.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:48:44 smithi086 bash[24289]: audit 2024-09-16T07:48:43.691583+0000 mon.b (mon.2) 550 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T07:48:44.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:48:44 smithi047 bash[22744]: cluster 2024-09-16T07:48:43.257332+0000 mgr.a (mgr.14373) 5694 : cluster [DBG] pgmap v3949: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:48:44.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:48:44 smithi047 bash[22744]: audit 2024-09-16T07:48:43.691583+0000 mon.b (mon.2) 550 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T07:48:44.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:48:44 smithi157 bash[24585]: cluster 2024-09-16T07:48:43.257332+0000 mgr.a (mgr.14373) 5694 : cluster [DBG] pgmap v3949: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:48:44.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:48:44 smithi157 bash[24585]: audit 2024-09-16T07:48:43.691583+0000 mon.b (mon.2) 550 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T07:48:45.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:48:45 smithi047 bash[22744]: audit 2024-09-16T07:48:44.327584+0000 mon.a (mon.0) 908 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:48:45.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:48:45 smithi047 bash[22744]: audit 2024-09-16T07:48:44.333352+0000 mon.a (mon.0) 909 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:48:45.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:48:45 smithi047 bash[22744]: audit 2024-09-16T07:48:45.076132+0000 mon.b (mon.2) 551 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T07:48:45.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:48:45 smithi047 bash[22744]: audit 2024-09-16T07:48:45.078173+0000 mon.b (mon.2) 552 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T07:48:45.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:48:45 smithi047 bash[22744]: audit 2024-09-16T07:48:45.089436+0000 mon.a (mon.0) 910 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:48:45.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:48:45 smithi047 bash[22744]: audit 2024-09-16T07:48:45.091430+0000 mon.b (mon.2) 553 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:48:45.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:48:45 smithi047 bash[22744]: audit 2024-09-16T07:48:45.094625+0000 mgr.a (mgr.14373) 5695 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:48:45.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:48:45 smithi157 bash[24585]: audit 2024-09-16T07:48:44.327584+0000 mon.a (mon.0) 908 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:48:45.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:48:45 smithi157 bash[24585]: audit 2024-09-16T07:48:44.333352+0000 mon.a (mon.0) 909 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:48:45.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:48:45 smithi157 bash[24585]: audit 2024-09-16T07:48:45.076132+0000 mon.b (mon.2) 551 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T07:48:45.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:48:45 smithi157 bash[24585]: audit 2024-09-16T07:48:45.078173+0000 mon.b (mon.2) 552 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T07:48:45.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:48:45 smithi157 bash[24585]: audit 2024-09-16T07:48:45.089436+0000 mon.a (mon.0) 910 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:48:45.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:48:45 smithi157 bash[24585]: audit 2024-09-16T07:48:45.091430+0000 mon.b (mon.2) 553 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:48:45.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:48:45 smithi157 bash[24585]: audit 2024-09-16T07:48:45.094625+0000 mgr.a (mgr.14373) 5695 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:48:45.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:48:45 smithi086 bash[24289]: audit 2024-09-16T07:48:44.327584+0000 mon.a (mon.0) 908 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:48:45.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:48:45 smithi086 bash[24289]: audit 2024-09-16T07:48:44.333352+0000 mon.a (mon.0) 909 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:48:45.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:48:45 smithi086 bash[24289]: audit 2024-09-16T07:48:45.076132+0000 mon.b (mon.2) 551 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T07:48:45.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:48:45 smithi086 bash[24289]: audit 2024-09-16T07:48:45.078173+0000 mon.b (mon.2) 552 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T07:48:45.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:48:45 smithi086 bash[24289]: audit 2024-09-16T07:48:45.089436+0000 mon.a (mon.0) 910 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:48:45.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:48:45 smithi086 bash[24289]: audit 2024-09-16T07:48:45.091430+0000 mon.b (mon.2) 553 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:48:45.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:48:45 smithi086 bash[24289]: audit 2024-09-16T07:48:45.094625+0000 mgr.a (mgr.14373) 5695 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:48:46.088 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 07:48:45 smithi047 bash[22994]: debug 2024-09-16T07:48:45.809+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T07:48:46.088 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 07:48:45 smithi047 bash[22994]: debug 2024-09-16T07:48:45.809+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T07:48:47.144 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:48:47.144 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:48:47.144 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:48:47.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:48:47 smithi047 bash[22744]: cluster 2024-09-16T07:48:45.257967+0000 mgr.a (mgr.14373) 5696 : cluster [DBG] pgmap v3950: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:48:47.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:48:47 smithi047 bash[22744]: audit 2024-09-16T07:48:45.811088+0000 mgr.a (mgr.14373) 5697 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T07:48:47.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:48:47 smithi047 bash[22744]: cephadm 2024-09-16T07:48:45.813451+0000 mgr.a (mgr.14373) 5698 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T07:48:47.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:48:47 smithi157 bash[24585]: cluster 2024-09-16T07:48:45.257967+0000 mgr.a (mgr.14373) 5696 : cluster [DBG] pgmap v3950: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:48:47.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:48:47 smithi157 bash[24585]: audit 2024-09-16T07:48:45.811088+0000 mgr.a (mgr.14373) 5697 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T07:48:47.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:48:47 smithi157 bash[24585]: cephadm 2024-09-16T07:48:45.813451+0000 mgr.a (mgr.14373) 5698 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T07:48:47.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:48:47 smithi086 bash[24289]: cluster 2024-09-16T07:48:45.257967+0000 mgr.a (mgr.14373) 5696 : cluster [DBG] pgmap v3950: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:48:47.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:48:47 smithi086 bash[24289]: audit 2024-09-16T07:48:45.811088+0000 mgr.a (mgr.14373) 5697 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T07:48:47.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:48:47 smithi086 bash[24289]: cephadm 2024-09-16T07:48:45.813451+0000 mgr.a (mgr.14373) 5698 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T07:48:47.885 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:48:47.949 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:48:47.950 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:48:47.950 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:48:47.950 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:48:49.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:48:49 smithi157 bash[24585]: cluster 2024-09-16T07:48:47.259038+0000 mgr.a (mgr.14373) 5699 : cluster [DBG] pgmap v3951: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:48:49.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:48:49 smithi157 bash[24585]: audit 2024-09-16T07:48:47.476155+0000 mgr.a (mgr.14373) 5700 : audit [DBG] from='client.132105 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:48:49.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:48:49 smithi086 bash[24289]: cluster 2024-09-16T07:48:47.259038+0000 mgr.a (mgr.14373) 5699 : cluster [DBG] pgmap v3951: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:48:49.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:48:49 smithi086 bash[24289]: audit 2024-09-16T07:48:47.476155+0000 mgr.a (mgr.14373) 5700 : audit [DBG] from='client.132105 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:48:49.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:48:49 smithi047 bash[22744]: cluster 2024-09-16T07:48:47.259038+0000 mgr.a (mgr.14373) 5699 : cluster [DBG] pgmap v3951: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:48:49.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:48:49 smithi047 bash[22744]: audit 2024-09-16T07:48:47.476155+0000 mgr.a (mgr.14373) 5700 : audit [DBG] from='client.132105 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:48:51.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:48:51 smithi157 bash[24585]: cluster 2024-09-16T07:48:49.259921+0000 mgr.a (mgr.14373) 5701 : cluster [DBG] pgmap v3952: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T07:48:51.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:48:51 smithi086 bash[24289]: cluster 2024-09-16T07:48:49.259921+0000 mgr.a (mgr.14373) 5701 : cluster [DBG] pgmap v3952: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T07:48:51.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:48:51 smithi047 bash[22744]: cluster 2024-09-16T07:48:49.259921+0000 mgr.a (mgr.14373) 5701 : cluster [DBG] pgmap v3952: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T07:48:52.889 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:48:52.889 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:48:52.889 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:48:53.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:48:53 smithi157 bash[24585]: cluster 2024-09-16T07:48:51.260708+0000 mgr.a (mgr.14373) 5702 : cluster [DBG] pgmap v3953: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T07:48:53.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:48:53 smithi086 bash[24289]: cluster 2024-09-16T07:48:51.260708+0000 mgr.a (mgr.14373) 5702 : cluster [DBG] pgmap v3953: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T07:48:53.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:48:53 smithi047 bash[22744]: cluster 2024-09-16T07:48:51.260708+0000 mgr.a (mgr.14373) 5702 : cluster [DBG] pgmap v3953: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T07:48:53.640 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:48:53.640 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:48:53.640 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:48:53.640 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:48:53.640 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:48:55.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:48:55 smithi157 bash[24585]: audit 2024-09-16T07:48:53.220740+0000 mgr.a (mgr.14373) 5703 : audit [DBG] from='client.132183 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:48:55.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:48:55 smithi157 bash[24585]: cluster 2024-09-16T07:48:53.263681+0000 mgr.a (mgr.14373) 5704 : cluster [DBG] pgmap v3954: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:48:55.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:48:55 smithi086 bash[24289]: audit 2024-09-16T07:48:53.220740+0000 mgr.a (mgr.14373) 5703 : audit [DBG] from='client.132183 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:48:55.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:48:55 smithi086 bash[24289]: cluster 2024-09-16T07:48:53.263681+0000 mgr.a (mgr.14373) 5704 : cluster [DBG] pgmap v3954: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:48:55.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:48:55 smithi047 bash[22744]: audit 2024-09-16T07:48:53.220740+0000 mgr.a (mgr.14373) 5703 : audit [DBG] from='client.132183 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:48:55.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:48:55 smithi047 bash[22744]: cluster 2024-09-16T07:48:53.263681+0000 mgr.a (mgr.14373) 5704 : cluster [DBG] pgmap v3954: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:48:57.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:48:57 smithi157 bash[24585]: cluster 2024-09-16T07:48:55.264624+0000 mgr.a (mgr.14373) 5705 : cluster [DBG] pgmap v3955: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:48:57.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:48:57 smithi086 bash[24289]: cluster 2024-09-16T07:48:55.264624+0000 mgr.a (mgr.14373) 5705 : cluster [DBG] pgmap v3955: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:48:57.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:48:57 smithi047 bash[22744]: cluster 2024-09-16T07:48:55.264624+0000 mgr.a (mgr.14373) 5705 : cluster [DBG] pgmap v3955: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:48:58.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:48:58 smithi157 bash[24585]: cluster 2024-09-16T07:48:57.266886+0000 mgr.a (mgr.14373) 5706 : cluster [DBG] pgmap v3956: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:48:58.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:48:58 smithi086 bash[24289]: cluster 2024-09-16T07:48:57.266886+0000 mgr.a (mgr.14373) 5706 : cluster [DBG] pgmap v3956: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:48:58.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:48:58 smithi047 bash[22744]: cluster 2024-09-16T07:48:57.266886+0000 mgr.a (mgr.14373) 5706 : cluster [DBG] pgmap v3956: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:48:58.641 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:48:58.642 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:48:58.642 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:48:59.381 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:48:59.381 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:48:59.382 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:48:59.382 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:48:59.382 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:48:59.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:48:59 smithi157 bash[24585]: audit 2024-09-16T07:48:58.974461+0000 mgr.a (mgr.14373) 5707 : audit [DBG] from='client.132261 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:48:59.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:48:59 smithi086 bash[24289]: audit 2024-09-16T07:48:58.974461+0000 mgr.a (mgr.14373) 5707 : audit [DBG] from='client.132261 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:48:59.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:48:59 smithi047 bash[22744]: audit 2024-09-16T07:48:58.974461+0000 mgr.a (mgr.14373) 5707 : audit [DBG] from='client.132261 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:49:00.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:49:00 smithi157 bash[24585]: cluster 2024-09-16T07:48:59.267471+0000 mgr.a (mgr.14373) 5708 : cluster [DBG] pgmap v3957: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:49:00.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:49:00 smithi086 bash[24289]: cluster 2024-09-16T07:48:59.267471+0000 mgr.a (mgr.14373) 5708 : cluster [DBG] pgmap v3957: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:49:00.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:49:00 smithi047 bash[22744]: cluster 2024-09-16T07:48:59.267471+0000 mgr.a (mgr.14373) 5708 : cluster [DBG] pgmap v3957: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:49:02.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:49:02 smithi047 bash[22744]: cluster 2024-09-16T07:49:01.268350+0000 mgr.a (mgr.14373) 5709 : cluster [DBG] pgmap v3958: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:49:02.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:49:02 smithi157 bash[24585]: cluster 2024-09-16T07:49:01.268350+0000 mgr.a (mgr.14373) 5709 : cluster [DBG] pgmap v3958: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:49:02.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:49:02 smithi086 bash[24289]: cluster 2024-09-16T07:49:01.268350+0000 mgr.a (mgr.14373) 5709 : cluster [DBG] pgmap v3958: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:49:04.383 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:49:04.383 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:49:04.384 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:49:04.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:49:04 smithi047 bash[22744]: cluster 2024-09-16T07:49:03.270602+0000 mgr.a (mgr.14373) 5710 : cluster [DBG] pgmap v3959: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:49:04.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:49:04 smithi157 bash[24585]: cluster 2024-09-16T07:49:03.270602+0000 mgr.a (mgr.14373) 5710 : cluster [DBG] pgmap v3959: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:49:04.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:49:04 smithi086 bash[24289]: cluster 2024-09-16T07:49:03.270602+0000 mgr.a (mgr.14373) 5710 : cluster [DBG] pgmap v3959: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:49:05.134 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:49:05.134 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:49:05.134 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:49:05.134 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:49:05.134 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:49:05.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:49:05 smithi047 bash[22744]: audit 2024-09-16T07:49:04.718436+0000 mgr.a (mgr.14373) 5711 : audit [DBG] from='client.132339 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:49:05.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:49:05 smithi157 bash[24585]: audit 2024-09-16T07:49:04.718436+0000 mgr.a (mgr.14373) 5711 : audit [DBG] from='client.132339 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:49:05.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:49:05 smithi086 bash[24289]: audit 2024-09-16T07:49:04.718436+0000 mgr.a (mgr.14373) 5711 : audit [DBG] from='client.132339 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:49:06.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:49:06 smithi047 bash[22744]: cluster 2024-09-16T07:49:05.271546+0000 mgr.a (mgr.14373) 5712 : cluster [DBG] pgmap v3960: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:49:06.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:49:06 smithi157 bash[24585]: cluster 2024-09-16T07:49:05.271546+0000 mgr.a (mgr.14373) 5712 : cluster [DBG] pgmap v3960: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:49:06.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:49:06 smithi086 bash[24289]: cluster 2024-09-16T07:49:05.271546+0000 mgr.a (mgr.14373) 5712 : cluster [DBG] pgmap v3960: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:49:08.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:49:08 smithi157 bash[24585]: cluster 2024-09-16T07:49:07.273749+0000 mgr.a (mgr.14373) 5713 : cluster [DBG] pgmap v3961: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:49:08.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:49:08 smithi086 bash[24289]: cluster 2024-09-16T07:49:07.273749+0000 mgr.a (mgr.14373) 5713 : cluster [DBG] pgmap v3961: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:49:08.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:49:08 smithi047 bash[22744]: cluster 2024-09-16T07:49:07.273749+0000 mgr.a (mgr.14373) 5713 : cluster [DBG] pgmap v3961: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:49:10.135 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:49:10.136 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:49:10.137 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:49:10.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:49:10 smithi157 bash[24585]: cluster 2024-09-16T07:49:09.274512+0000 mgr.a (mgr.14373) 5714 : cluster [DBG] pgmap v3962: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:49:10.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:49:10 smithi086 bash[24289]: cluster 2024-09-16T07:49:09.274512+0000 mgr.a (mgr.14373) 5714 : cluster [DBG] pgmap v3962: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:49:10.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:49:10 smithi047 bash[22744]: cluster 2024-09-16T07:49:09.274512+0000 mgr.a (mgr.14373) 5714 : cluster [DBG] pgmap v3962: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:49:10.891 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:49:10.892 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:49:10.892 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:49:10.892 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:49:10.892 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:49:11.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:49:11 smithi157 bash[24585]: audit 2024-09-16T07:49:10.475142+0000 mgr.a (mgr.14373) 5715 : audit [DBG] from='client.132417 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:49:11.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:49:11 smithi086 bash[24289]: audit 2024-09-16T07:49:10.475142+0000 mgr.a (mgr.14373) 5715 : audit [DBG] from='client.132417 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:49:11.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:49:11 smithi047 bash[22744]: audit 2024-09-16T07:49:10.475142+0000 mgr.a (mgr.14373) 5715 : audit [DBG] from='client.132417 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:49:12.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:49:12 smithi157 bash[24585]: cluster 2024-09-16T07:49:11.275487+0000 mgr.a (mgr.14373) 5716 : cluster [DBG] pgmap v3963: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:49:12.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:49:12 smithi086 bash[24289]: cluster 2024-09-16T07:49:11.275487+0000 mgr.a (mgr.14373) 5716 : cluster [DBG] pgmap v3963: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:49:12.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:49:12 smithi047 bash[22744]: cluster 2024-09-16T07:49:11.275487+0000 mgr.a (mgr.14373) 5716 : cluster [DBG] pgmap v3963: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:49:14.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:49:14 smithi157 bash[24585]: cluster 2024-09-16T07:49:13.277869+0000 mgr.a (mgr.14373) 5717 : cluster [DBG] pgmap v3964: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:49:14.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:49:14 smithi086 bash[24289]: cluster 2024-09-16T07:49:13.277869+0000 mgr.a (mgr.14373) 5717 : cluster [DBG] pgmap v3964: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:49:14.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:49:14 smithi047 bash[22744]: cluster 2024-09-16T07:49:13.277869+0000 mgr.a (mgr.14373) 5717 : cluster [DBG] pgmap v3964: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:49:15.893 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:49:15.894 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:49:15.894 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:49:16.687 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:49:16.688 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:49:16.688 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:49:16.688 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:49:16.688 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:49:16.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:49:16 smithi157 bash[24585]: cluster 2024-09-16T07:49:15.278836+0000 mgr.a (mgr.14373) 5718 : cluster [DBG] pgmap v3965: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:49:16.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:49:16 smithi086 bash[24289]: cluster 2024-09-16T07:49:15.278836+0000 mgr.a (mgr.14373) 5718 : cluster [DBG] pgmap v3965: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:49:16.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:49:16 smithi047 bash[22744]: cluster 2024-09-16T07:49:15.278836+0000 mgr.a (mgr.14373) 5718 : cluster [DBG] pgmap v3965: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:49:17.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:49:17 smithi157 bash[24585]: audit 2024-09-16T07:49:16.243306+0000 mgr.a (mgr.14373) 5719 : audit [DBG] from='client.132495 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:49:17.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:49:17 smithi086 bash[24289]: audit 2024-09-16T07:49:16.243306+0000 mgr.a (mgr.14373) 5719 : audit [DBG] from='client.132495 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:49:17.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:49:17 smithi047 bash[22744]: audit 2024-09-16T07:49:16.243306+0000 mgr.a (mgr.14373) 5719 : audit [DBG] from='client.132495 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:49:18.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:49:18 smithi157 bash[24585]: cluster 2024-09-16T07:49:17.281499+0000 mgr.a (mgr.14373) 5720 : cluster [DBG] pgmap v3966: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-16T07:49:18.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:49:18 smithi086 bash[24289]: cluster 2024-09-16T07:49:17.281499+0000 mgr.a (mgr.14373) 5720 : cluster [DBG] pgmap v3966: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-16T07:49:18.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:49:18 smithi047 bash[22744]: cluster 2024-09-16T07:49:17.281499+0000 mgr.a (mgr.14373) 5720 : cluster [DBG] pgmap v3966: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-16T07:49:20.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:49:20 smithi157 bash[24585]: cluster 2024-09-16T07:49:19.282313+0000 mgr.a (mgr.14373) 5721 : cluster [DBG] pgmap v3967: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T07:49:20.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:49:20 smithi086 bash[24289]: cluster 2024-09-16T07:49:19.282313+0000 mgr.a (mgr.14373) 5721 : cluster [DBG] pgmap v3967: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T07:49:20.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:49:20 smithi047 bash[22744]: cluster 2024-09-16T07:49:19.282313+0000 mgr.a (mgr.14373) 5721 : cluster [DBG] pgmap v3967: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T07:49:21.689 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:49:21.690 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:49:21.690 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:49:22.432 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:49:22.432 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:49:22.433 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:49:22.433 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:49:22.433 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:49:22.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:49:22 smithi157 bash[24585]: cluster 2024-09-16T07:49:21.283120+0000 mgr.a (mgr.14373) 5722 : cluster [DBG] pgmap v3968: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T07:49:22.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:49:22 smithi157 bash[24585]: audit 2024-09-16T07:49:22.023418+0000 mgr.a (mgr.14373) 5723 : audit [DBG] from='client.132573 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:49:22.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:49:22 smithi086 bash[24289]: cluster 2024-09-16T07:49:21.283120+0000 mgr.a (mgr.14373) 5722 : cluster [DBG] pgmap v3968: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T07:49:22.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:49:22 smithi086 bash[24289]: audit 2024-09-16T07:49:22.023418+0000 mgr.a (mgr.14373) 5723 : audit [DBG] from='client.132573 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:49:22.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:49:22 smithi047 bash[22744]: cluster 2024-09-16T07:49:21.283120+0000 mgr.a (mgr.14373) 5722 : cluster [DBG] pgmap v3968: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T07:49:22.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:49:22 smithi047 bash[22744]: audit 2024-09-16T07:49:22.023418+0000 mgr.a (mgr.14373) 5723 : audit [DBG] from='client.132573 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:49:24.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:49:24 smithi157 bash[24585]: cluster 2024-09-16T07:49:23.285846+0000 mgr.a (mgr.14373) 5724 : cluster [DBG] pgmap v3969: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:49:24.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:49:24 smithi086 bash[24289]: cluster 2024-09-16T07:49:23.285846+0000 mgr.a (mgr.14373) 5724 : cluster [DBG] pgmap v3969: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:49:24.841 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:49:24 smithi047 bash[22744]: cluster 2024-09-16T07:49:23.285846+0000 mgr.a (mgr.14373) 5724 : cluster [DBG] pgmap v3969: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:49:26.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:49:26 smithi157 bash[24585]: cluster 2024-09-16T07:49:25.286648+0000 mgr.a (mgr.14373) 5725 : cluster [DBG] pgmap v3970: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:49:26.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:49:26 smithi086 bash[24289]: cluster 2024-09-16T07:49:25.286648+0000 mgr.a (mgr.14373) 5725 : cluster [DBG] pgmap v3970: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:49:26.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:49:26 smithi047 bash[22744]: cluster 2024-09-16T07:49:25.286648+0000 mgr.a (mgr.14373) 5725 : cluster [DBG] pgmap v3970: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:49:27.434 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:49:27.434 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:49:27.435 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:49:28.176 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:49:28.177 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:49:28.177 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:49:28.177 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:49:28.177 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:49:28.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:49:28 smithi157 bash[24585]: cluster 2024-09-16T07:49:27.288585+0000 mgr.a (mgr.14373) 5726 : cluster [DBG] pgmap v3971: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:49:28.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:49:28 smithi157 bash[24585]: audit 2024-09-16T07:49:27.766032+0000 mgr.a (mgr.14373) 5727 : audit [DBG] from='client.132651 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:49:28.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:49:28 smithi086 bash[24289]: cluster 2024-09-16T07:49:27.288585+0000 mgr.a (mgr.14373) 5726 : cluster [DBG] pgmap v3971: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:49:28.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:49:28 smithi086 bash[24289]: audit 2024-09-16T07:49:27.766032+0000 mgr.a (mgr.14373) 5727 : audit [DBG] from='client.132651 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:49:28.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:49:28 smithi047 bash[22744]: cluster 2024-09-16T07:49:27.288585+0000 mgr.a (mgr.14373) 5726 : cluster [DBG] pgmap v3971: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:49:28.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:49:28 smithi047 bash[22744]: audit 2024-09-16T07:49:27.766032+0000 mgr.a (mgr.14373) 5727 : audit [DBG] from='client.132651 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:49:30.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:49:30 smithi157 bash[24585]: cluster 2024-09-16T07:49:29.289470+0000 mgr.a (mgr.14373) 5728 : cluster [DBG] pgmap v3972: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-16T07:49:30.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:49:30 smithi086 bash[24289]: cluster 2024-09-16T07:49:29.289470+0000 mgr.a (mgr.14373) 5728 : cluster [DBG] pgmap v3972: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-16T07:49:30.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:49:30 smithi047 bash[22744]: cluster 2024-09-16T07:49:29.289470+0000 mgr.a (mgr.14373) 5728 : cluster [DBG] pgmap v3972: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-16T07:49:32.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:49:32 smithi157 bash[24585]: cluster 2024-09-16T07:49:31.290255+0000 mgr.a (mgr.14373) 5729 : cluster [DBG] pgmap v3973: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-16T07:49:32.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:49:32 smithi086 bash[24289]: cluster 2024-09-16T07:49:31.290255+0000 mgr.a (mgr.14373) 5729 : cluster [DBG] pgmap v3973: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-16T07:49:32.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:49:32 smithi047 bash[22744]: cluster 2024-09-16T07:49:31.290255+0000 mgr.a (mgr.14373) 5729 : cluster [DBG] pgmap v3973: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-16T07:49:33.178 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:49:33.179 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:49:33.179 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:49:33.938 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:49:33.938 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:49:33.938 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:49:33.938 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:49:33.938 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:49:34.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:49:34 smithi157 bash[24585]: cluster 2024-09-16T07:49:33.291259+0000 mgr.a (mgr.14373) 5730 : cluster [DBG] pgmap v3974: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-16T07:49:34.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:49:34 smithi157 bash[24585]: audit 2024-09-16T07:49:33.510573+0000 mgr.a (mgr.14373) 5731 : audit [DBG] from='client.132726 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:49:34.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:49:34 smithi086 bash[24289]: cluster 2024-09-16T07:49:33.291259+0000 mgr.a (mgr.14373) 5730 : cluster [DBG] pgmap v3974: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-16T07:49:34.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:49:34 smithi086 bash[24289]: audit 2024-09-16T07:49:33.510573+0000 mgr.a (mgr.14373) 5731 : audit [DBG] from='client.132726 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:49:34.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:49:34 smithi047 bash[22744]: cluster 2024-09-16T07:49:33.291259+0000 mgr.a (mgr.14373) 5730 : cluster [DBG] pgmap v3974: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-16T07:49:34.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:49:34 smithi047 bash[22744]: audit 2024-09-16T07:49:33.510573+0000 mgr.a (mgr.14373) 5731 : audit [DBG] from='client.132726 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:49:36.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:49:36 smithi157 bash[24585]: cluster 2024-09-16T07:49:35.292106+0000 mgr.a (mgr.14373) 5732 : cluster [DBG] pgmap v3975: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:49:36.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:49:36 smithi086 bash[24289]: cluster 2024-09-16T07:49:35.292106+0000 mgr.a (mgr.14373) 5732 : cluster [DBG] pgmap v3975: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:49:36.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:49:36 smithi047 bash[22744]: cluster 2024-09-16T07:49:35.292106+0000 mgr.a (mgr.14373) 5732 : cluster [DBG] pgmap v3975: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:49:38.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:49:38 smithi157 bash[24585]: cluster 2024-09-16T07:49:37.294270+0000 mgr.a (mgr.14373) 5733 : cluster [DBG] pgmap v3976: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:49:38.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:49:38 smithi086 bash[24289]: cluster 2024-09-16T07:49:37.294270+0000 mgr.a (mgr.14373) 5733 : cluster [DBG] pgmap v3976: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:49:38.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:49:38 smithi047 bash[22744]: cluster 2024-09-16T07:49:37.294270+0000 mgr.a (mgr.14373) 5733 : cluster [DBG] pgmap v3976: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:49:38.939 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:49:38.940 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:49:38.940 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:49:39.710 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:49:39.710 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:49:39.710 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:49:39.710 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:49:39.710 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:49:40.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:49:40 smithi157 bash[24585]: audit 2024-09-16T07:49:39.283430+0000 mgr.a (mgr.14373) 5734 : audit [DBG] from='client.132801 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:49:40.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:49:40 smithi157 bash[24585]: cluster 2024-09-16T07:49:39.300582+0000 mgr.a (mgr.14373) 5735 : cluster [DBG] pgmap v3977: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:49:40.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:49:40 smithi086 bash[24289]: audit 2024-09-16T07:49:39.283430+0000 mgr.a (mgr.14373) 5734 : audit [DBG] from='client.132801 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:49:40.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:49:40 smithi086 bash[24289]: cluster 2024-09-16T07:49:39.300582+0000 mgr.a (mgr.14373) 5735 : cluster [DBG] pgmap v3977: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:49:40.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:49:40 smithi047 bash[22744]: audit 2024-09-16T07:49:39.283430+0000 mgr.a (mgr.14373) 5734 : audit [DBG] from='client.132801 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:49:40.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:49:40 smithi047 bash[22744]: cluster 2024-09-16T07:49:39.300582+0000 mgr.a (mgr.14373) 5735 : cluster [DBG] pgmap v3977: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:49:42.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:49:42 smithi157 bash[24585]: cluster 2024-09-16T07:49:41.301528+0000 mgr.a (mgr.14373) 5736 : cluster [DBG] pgmap v3978: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:49:42.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:49:42 smithi086 bash[24289]: cluster 2024-09-16T07:49:41.301528+0000 mgr.a (mgr.14373) 5736 : cluster [DBG] pgmap v3978: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:49:42.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:49:42 smithi047 bash[22744]: cluster 2024-09-16T07:49:41.301528+0000 mgr.a (mgr.14373) 5736 : cluster [DBG] pgmap v3978: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:49:44.711 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:49:44.712 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:49:44.712 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:49:44.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:49:44 smithi157 bash[24585]: cluster 2024-09-16T07:49:43.303782+0000 mgr.a (mgr.14373) 5737 : cluster [DBG] pgmap v3979: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:49:44.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:49:44 smithi086 bash[24289]: cluster 2024-09-16T07:49:43.303782+0000 mgr.a (mgr.14373) 5737 : cluster [DBG] pgmap v3979: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:49:44.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:49:44 smithi047 bash[22744]: cluster 2024-09-16T07:49:43.303782+0000 mgr.a (mgr.14373) 5737 : cluster [DBG] pgmap v3979: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:49:45.492 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:49:45.493 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:49:45.493 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:49:45.493 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:49:45.493 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:49:45.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:49:45 smithi157 bash[24585]: audit 2024-09-16T07:49:45.055661+0000 mgr.a (mgr.14373) 5738 : audit [DBG] from='client.132876 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:49:45.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:49:45 smithi086 bash[24289]: audit 2024-09-16T07:49:45.055661+0000 mgr.a (mgr.14373) 5738 : audit [DBG] from='client.132876 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:49:45.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:49:45 smithi047 bash[22744]: audit 2024-09-16T07:49:45.055661+0000 mgr.a (mgr.14373) 5738 : audit [DBG] from='client.132876 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:49:46.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:49:46 smithi157 bash[24585]: cluster 2024-09-16T07:49:45.304455+0000 mgr.a (mgr.14373) 5739 : cluster [DBG] pgmap v3980: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:49:46.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:49:46 smithi157 bash[24585]: audit 2024-09-16T07:49:45.865904+0000 mon.b (mon.2) 554 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T07:49:46.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:49:46 smithi086 bash[24289]: cluster 2024-09-16T07:49:45.304455+0000 mgr.a (mgr.14373) 5739 : cluster [DBG] pgmap v3980: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:49:46.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:49:46 smithi086 bash[24289]: audit 2024-09-16T07:49:45.865904+0000 mon.b (mon.2) 554 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T07:49:46.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:49:46 smithi047 bash[22744]: cluster 2024-09-16T07:49:45.304455+0000 mgr.a (mgr.14373) 5739 : cluster [DBG] pgmap v3980: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:49:46.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:49:46 smithi047 bash[22744]: audit 2024-09-16T07:49:45.865904+0000 mon.b (mon.2) 554 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T07:49:47.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:49:47 smithi157 bash[24585]: audit 2024-09-16T07:49:46.484833+0000 mon.a (mon.0) 911 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:49:47.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:49:47 smithi157 bash[24585]: audit 2024-09-16T07:49:46.488244+0000 mon.a (mon.0) 912 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:49:47.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:49:47 smithi157 bash[24585]: audit 2024-09-16T07:49:46.492654+0000 mon.a (mon.0) 913 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:49:47.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:49:47 smithi157 bash[24585]: audit 2024-09-16T07:49:46.496047+0000 mon.a (mon.0) 914 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:49:47.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:49:47 smithi157 bash[24585]: audit 2024-09-16T07:49:47.155171+0000 mon.b (mon.2) 555 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T07:49:47.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:49:47 smithi157 bash[24585]: audit 2024-09-16T07:49:47.157162+0000 mon.b (mon.2) 556 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T07:49:47.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:49:47 smithi157 bash[24585]: audit 2024-09-16T07:49:47.170220+0000 mon.a (mon.0) 915 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:49:47.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:49:47 smithi157 bash[24585]: audit 2024-09-16T07:49:47.173792+0000 mon.b (mon.2) 557 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:49:47.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:49:47 smithi086 bash[24289]: audit 2024-09-16T07:49:46.484833+0000 mon.a (mon.0) 911 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:49:47.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:49:47 smithi086 bash[24289]: audit 2024-09-16T07:49:46.488244+0000 mon.a (mon.0) 912 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:49:47.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:49:47 smithi086 bash[24289]: audit 2024-09-16T07:49:46.492654+0000 mon.a (mon.0) 913 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:49:47.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:49:47 smithi086 bash[24289]: audit 2024-09-16T07:49:46.496047+0000 mon.a (mon.0) 914 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:49:47.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:49:47 smithi086 bash[24289]: audit 2024-09-16T07:49:47.155171+0000 mon.b (mon.2) 555 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T07:49:47.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:49:47 smithi086 bash[24289]: audit 2024-09-16T07:49:47.157162+0000 mon.b (mon.2) 556 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T07:49:47.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:49:47 smithi086 bash[24289]: audit 2024-09-16T07:49:47.170220+0000 mon.a (mon.0) 915 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:49:47.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:49:47 smithi086 bash[24289]: audit 2024-09-16T07:49:47.173792+0000 mon.b (mon.2) 557 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:49:47.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:49:47 smithi047 bash[22744]: audit 2024-09-16T07:49:46.484833+0000 mon.a (mon.0) 911 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:49:47.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:49:47 smithi047 bash[22744]: audit 2024-09-16T07:49:46.488244+0000 mon.a (mon.0) 912 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:49:47.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:49:47 smithi047 bash[22744]: audit 2024-09-16T07:49:46.492654+0000 mon.a (mon.0) 913 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:49:47.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:49:47 smithi047 bash[22744]: audit 2024-09-16T07:49:46.496047+0000 mon.a (mon.0) 914 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:49:47.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:49:47 smithi047 bash[22744]: audit 2024-09-16T07:49:47.155171+0000 mon.b (mon.2) 555 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T07:49:47.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:49:47 smithi047 bash[22744]: audit 2024-09-16T07:49:47.157162+0000 mon.b (mon.2) 556 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T07:49:47.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:49:47 smithi047 bash[22744]: audit 2024-09-16T07:49:47.170220+0000 mon.a (mon.0) 915 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:49:47.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:49:47 smithi047 bash[22744]: audit 2024-09-16T07:49:47.173792+0000 mon.b (mon.2) 557 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:49:48.338 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 07:49:47 smithi047 bash[22994]: debug 2024-09-16T07:49:47.924+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T07:49:48.338 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 07:49:47 smithi047 bash[22994]: debug 2024-09-16T07:49:47.928+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T07:49:48.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:49:48 smithi157 bash[24585]: audit 2024-09-16T07:49:47.178208+0000 mgr.a (mgr.14373) 5740 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:49:48.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:49:48 smithi157 bash[24585]: cluster 2024-09-16T07:49:47.307433+0000 mgr.a (mgr.14373) 5741 : cluster [DBG] pgmap v3981: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:49:48.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:49:48 smithi157 bash[24585]: audit 2024-09-16T07:49:47.929970+0000 mgr.a (mgr.14373) 5742 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T07:49:48.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:49:48 smithi157 bash[24585]: cephadm 2024-09-16T07:49:47.932370+0000 mgr.a (mgr.14373) 5743 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T07:49:48.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:49:48 smithi086 bash[24289]: audit 2024-09-16T07:49:47.178208+0000 mgr.a (mgr.14373) 5740 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:49:48.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:49:48 smithi086 bash[24289]: cluster 2024-09-16T07:49:47.307433+0000 mgr.a (mgr.14373) 5741 : cluster [DBG] pgmap v3981: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:49:48.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:49:48 smithi086 bash[24289]: audit 2024-09-16T07:49:47.929970+0000 mgr.a (mgr.14373) 5742 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T07:49:48.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:49:48 smithi086 bash[24289]: cephadm 2024-09-16T07:49:47.932370+0000 mgr.a (mgr.14373) 5743 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T07:49:48.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:49:48 smithi047 bash[22744]: audit 2024-09-16T07:49:47.178208+0000 mgr.a (mgr.14373) 5740 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:49:48.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:49:48 smithi047 bash[22744]: cluster 2024-09-16T07:49:47.307433+0000 mgr.a (mgr.14373) 5741 : cluster [DBG] pgmap v3981: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:49:48.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:49:48 smithi047 bash[22744]: audit 2024-09-16T07:49:47.929970+0000 mgr.a (mgr.14373) 5742 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T07:49:48.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:49:48 smithi047 bash[22744]: cephadm 2024-09-16T07:49:47.932370+0000 mgr.a (mgr.14373) 5743 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T07:49:50.494 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:49:50.495 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:49:50.495 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:49:50.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:49:50 smithi157 bash[24585]: cluster 2024-09-16T07:49:49.308390+0000 mgr.a (mgr.14373) 5744 : cluster [DBG] pgmap v3982: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:49:50.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:49:50 smithi086 bash[24289]: cluster 2024-09-16T07:49:49.308390+0000 mgr.a (mgr.14373) 5744 : cluster [DBG] pgmap v3982: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:49:50.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:49:50 smithi047 bash[22744]: cluster 2024-09-16T07:49:49.308390+0000 mgr.a (mgr.14373) 5744 : cluster [DBG] pgmap v3982: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:49:51.278 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:49:51.278 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:49:51.278 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:49:51.279 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:49:51.279 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:49:51.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:49:51 smithi157 bash[24585]: audit 2024-09-16T07:49:50.839549+0000 mgr.a (mgr.14373) 5745 : audit [DBG] from='client.133056 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:49:51.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:49:51 smithi086 bash[24289]: audit 2024-09-16T07:49:50.839549+0000 mgr.a (mgr.14373) 5745 : audit [DBG] from='client.133056 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:49:51.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:49:51 smithi047 bash[22744]: audit 2024-09-16T07:49:50.839549+0000 mgr.a (mgr.14373) 5745 : audit [DBG] from='client.133056 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:49:52.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:49:52 smithi157 bash[24585]: cluster 2024-09-16T07:49:51.309070+0000 mgr.a (mgr.14373) 5746 : cluster [DBG] pgmap v3983: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:49:52.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:49:52 smithi086 bash[24289]: cluster 2024-09-16T07:49:51.309070+0000 mgr.a (mgr.14373) 5746 : cluster [DBG] pgmap v3983: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:49:52.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:49:52 smithi047 bash[22744]: cluster 2024-09-16T07:49:51.309070+0000 mgr.a (mgr.14373) 5746 : cluster [DBG] pgmap v3983: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:49:54.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:49:54 smithi157 bash[24585]: cluster 2024-09-16T07:49:53.311274+0000 mgr.a (mgr.14373) 5747 : cluster [DBG] pgmap v3984: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:49:54.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:49:54 smithi086 bash[24289]: cluster 2024-09-16T07:49:53.311274+0000 mgr.a (mgr.14373) 5747 : cluster [DBG] pgmap v3984: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:49:54.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:49:54 smithi047 bash[22744]: cluster 2024-09-16T07:49:53.311274+0000 mgr.a (mgr.14373) 5747 : cluster [DBG] pgmap v3984: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:49:56.279 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:49:56.280 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:49:56.281 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:49:56.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:49:56 smithi157 bash[24585]: cluster 2024-09-16T07:49:55.312062+0000 mgr.a (mgr.14373) 5748 : cluster [DBG] pgmap v3985: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:49:56.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:49:56 smithi086 bash[24289]: cluster 2024-09-16T07:49:55.312062+0000 mgr.a (mgr.14373) 5748 : cluster [DBG] pgmap v3985: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:49:56.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:49:56 smithi047 bash[22744]: cluster 2024-09-16T07:49:55.312062+0000 mgr.a (mgr.14373) 5748 : cluster [DBG] pgmap v3985: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:49:57.034 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:49:57.034 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:49:57.034 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:49:57.034 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:49:57.034 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:49:57.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:49:57 smithi157 bash[24585]: audit 2024-09-16T07:49:56.618180+0000 mgr.a (mgr.14373) 5749 : audit [DBG] from='client.133131 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:49:57.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:49:57 smithi086 bash[24289]: audit 2024-09-16T07:49:56.618180+0000 mgr.a (mgr.14373) 5749 : audit [DBG] from='client.133131 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:49:57.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:49:57 smithi047 bash[22744]: audit 2024-09-16T07:49:56.618180+0000 mgr.a (mgr.14373) 5749 : audit [DBG] from='client.133131 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:49:58.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:49:58 smithi157 bash[24585]: cluster 2024-09-16T07:49:57.314799+0000 mgr.a (mgr.14373) 5750 : cluster [DBG] pgmap v3986: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:49:58.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:49:58 smithi086 bash[24289]: cluster 2024-09-16T07:49:57.314799+0000 mgr.a (mgr.14373) 5750 : cluster [DBG] pgmap v3986: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:49:58.840 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:49:58 smithi047 bash[22744]: cluster 2024-09-16T07:49:57.314799+0000 mgr.a (mgr.14373) 5750 : cluster [DBG] pgmap v3986: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:50:00.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:50:00 smithi157 bash[24585]: cluster 2024-09-16T07:49:59.315575+0000 mgr.a (mgr.14373) 5751 : cluster [DBG] pgmap v3987: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T07:50:00.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:50:00 smithi157 bash[24585]: cluster 2024-09-16T07:50:00.000123+0000 mon.a (mon.0) 916 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-16T07:50:00.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:50:00 smithi086 bash[24289]: cluster 2024-09-16T07:49:59.315575+0000 mgr.a (mgr.14373) 5751 : cluster [DBG] pgmap v3987: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T07:50:00.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:50:00 smithi086 bash[24289]: cluster 2024-09-16T07:50:00.000123+0000 mon.a (mon.0) 916 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-16T07:50:00.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:50:00 smithi047 bash[22744]: cluster 2024-09-16T07:49:59.315575+0000 mgr.a (mgr.14373) 5751 : cluster [DBG] pgmap v3987: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T07:50:00.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:50:00 smithi047 bash[22744]: cluster 2024-09-16T07:50:00.000123+0000 mon.a (mon.0) 916 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-16T07:50:02.036 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:50:02.036 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:50:02.036 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:50:02.778 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:50:02.779 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:50:02.779 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:50:02.779 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:50:02.779 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:50:02.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:50:02 smithi157 bash[24585]: cluster 2024-09-16T07:50:01.316333+0000 mgr.a (mgr.14373) 5752 : cluster [DBG] pgmap v3988: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T07:50:02.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:50:02 smithi086 bash[24289]: cluster 2024-09-16T07:50:01.316333+0000 mgr.a (mgr.14373) 5752 : cluster [DBG] pgmap v3988: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T07:50:02.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:50:02 smithi047 bash[22744]: cluster 2024-09-16T07:50:01.316333+0000 mgr.a (mgr.14373) 5752 : cluster [DBG] pgmap v3988: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T07:50:03.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:50:03 smithi157 bash[24585]: audit 2024-09-16T07:50:02.374471+0000 mgr.a (mgr.14373) 5753 : audit [DBG] from='client.133206 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:50:03.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:50:03 smithi086 bash[24289]: audit 2024-09-16T07:50:02.374471+0000 mgr.a (mgr.14373) 5753 : audit [DBG] from='client.133206 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:50:03.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:50:03 smithi047 bash[22744]: audit 2024-09-16T07:50:02.374471+0000 mgr.a (mgr.14373) 5753 : audit [DBG] from='client.133206 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:50:04.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:50:04 smithi157 bash[24585]: cluster 2024-09-16T07:50:03.319164+0000 mgr.a (mgr.14373) 5754 : cluster [DBG] pgmap v3989: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:50:04.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:50:04 smithi086 bash[24289]: cluster 2024-09-16T07:50:03.319164+0000 mgr.a (mgr.14373) 5754 : cluster [DBG] pgmap v3989: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:50:04.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:50:04 smithi047 bash[22744]: cluster 2024-09-16T07:50:03.319164+0000 mgr.a (mgr.14373) 5754 : cluster [DBG] pgmap v3989: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:50:06.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:50:06 smithi157 bash[24585]: cluster 2024-09-16T07:50:05.319933+0000 mgr.a (mgr.14373) 5755 : cluster [DBG] pgmap v3990: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:50:06.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:50:06 smithi086 bash[24289]: cluster 2024-09-16T07:50:05.319933+0000 mgr.a (mgr.14373) 5755 : cluster [DBG] pgmap v3990: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:50:06.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:50:06 smithi047 bash[22744]: cluster 2024-09-16T07:50:05.319933+0000 mgr.a (mgr.14373) 5755 : cluster [DBG] pgmap v3990: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:50:07.780 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:50:07.782 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:50:07.782 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:50:08.559 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:50:08.559 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:50:08.559 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:50:08.559 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:50:08.559 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:50:08.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:50:08 smithi157 bash[24585]: cluster 2024-09-16T07:50:07.321945+0000 mgr.a (mgr.14373) 5756 : cluster [DBG] pgmap v3991: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:50:08.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:50:08 smithi157 bash[24585]: audit 2024-09-16T07:50:08.121613+0000 mgr.a (mgr.14373) 5757 : audit [DBG] from='client.133281 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:50:08.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:50:08 smithi086 bash[24289]: cluster 2024-09-16T07:50:07.321945+0000 mgr.a (mgr.14373) 5756 : cluster [DBG] pgmap v3991: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:50:08.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:50:08 smithi086 bash[24289]: audit 2024-09-16T07:50:08.121613+0000 mgr.a (mgr.14373) 5757 : audit [DBG] from='client.133281 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:50:08.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:50:08 smithi047 bash[22744]: cluster 2024-09-16T07:50:07.321945+0000 mgr.a (mgr.14373) 5756 : cluster [DBG] pgmap v3991: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:50:08.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:50:08 smithi047 bash[22744]: audit 2024-09-16T07:50:08.121613+0000 mgr.a (mgr.14373) 5757 : audit [DBG] from='client.133281 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:50:10.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:50:10 smithi157 bash[24585]: cluster 2024-09-16T07:50:09.323063+0000 mgr.a (mgr.14373) 5758 : cluster [DBG] pgmap v3992: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:50:10.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:50:10 smithi086 bash[24289]: cluster 2024-09-16T07:50:09.323063+0000 mgr.a (mgr.14373) 5758 : cluster [DBG] pgmap v3992: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:50:10.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:50:10 smithi047 bash[22744]: cluster 2024-09-16T07:50:09.323063+0000 mgr.a (mgr.14373) 5758 : cluster [DBG] pgmap v3992: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:50:12.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:50:12 smithi086 bash[24289]: cluster 2024-09-16T07:50:11.324040+0000 mgr.a (mgr.14373) 5759 : cluster [DBG] pgmap v3993: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:50:12.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:50:12 smithi047 bash[22744]: cluster 2024-09-16T07:50:11.324040+0000 mgr.a (mgr.14373) 5759 : cluster [DBG] pgmap v3993: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:50:13.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:50:12 smithi157 bash[24585]: cluster 2024-09-16T07:50:11.324040+0000 mgr.a (mgr.14373) 5759 : cluster [DBG] pgmap v3993: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:50:13.561 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:50:13.561 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:50:13.561 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:50:14.306 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:50:14.306 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:50:14.307 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:50:14.307 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:50:14.307 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:50:14.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:50:14 smithi086 bash[24289]: cluster 2024-09-16T07:50:13.326306+0000 mgr.a (mgr.14373) 5760 : cluster [DBG] pgmap v3994: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:50:14.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:50:14 smithi086 bash[24289]: audit 2024-09-16T07:50:13.896062+0000 mgr.a (mgr.14373) 5761 : audit [DBG] from='client.133356 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:50:14.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:50:14 smithi047 bash[22744]: cluster 2024-09-16T07:50:13.326306+0000 mgr.a (mgr.14373) 5760 : cluster [DBG] pgmap v3994: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:50:14.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:50:14 smithi047 bash[22744]: audit 2024-09-16T07:50:13.896062+0000 mgr.a (mgr.14373) 5761 : audit [DBG] from='client.133356 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:50:15.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:50:14 smithi157 bash[24585]: cluster 2024-09-16T07:50:13.326306+0000 mgr.a (mgr.14373) 5760 : cluster [DBG] pgmap v3994: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:50:15.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:50:14 smithi157 bash[24585]: audit 2024-09-16T07:50:13.896062+0000 mgr.a (mgr.14373) 5761 : audit [DBG] from='client.133356 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:50:16.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:50:16 smithi086 bash[24289]: cluster 2024-09-16T07:50:15.327241+0000 mgr.a (mgr.14373) 5762 : cluster [DBG] pgmap v3995: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:50:16.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:50:16 smithi047 bash[22744]: cluster 2024-09-16T07:50:15.327241+0000 mgr.a (mgr.14373) 5762 : cluster [DBG] pgmap v3995: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:50:17.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:50:16 smithi157 bash[24585]: cluster 2024-09-16T07:50:15.327241+0000 mgr.a (mgr.14373) 5762 : cluster [DBG] pgmap v3995: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:50:18.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:50:18 smithi086 bash[24289]: cluster 2024-09-16T07:50:17.329596+0000 mgr.a (mgr.14373) 5763 : cluster [DBG] pgmap v3996: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:50:18.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:50:18 smithi047 bash[22744]: cluster 2024-09-16T07:50:17.329596+0000 mgr.a (mgr.14373) 5763 : cluster [DBG] pgmap v3996: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:50:19.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:50:18 smithi157 bash[24585]: cluster 2024-09-16T07:50:17.329596+0000 mgr.a (mgr.14373) 5763 : cluster [DBG] pgmap v3996: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:50:19.308 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:50:19.309 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:50:19.309 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:50:20.050 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:50:20.050 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:50:20.050 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:50:20.050 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:50:20.050 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:50:20.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:50:20 smithi047 bash[22744]: cluster 2024-09-16T07:50:19.330421+0000 mgr.a (mgr.14373) 5764 : cluster [DBG] pgmap v3997: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:50:20.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:50:20 smithi047 bash[22744]: audit 2024-09-16T07:50:19.641846+0000 mgr.a (mgr.14373) 5765 : audit [DBG] from='client.133431 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:50:21.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:50:20 smithi157 bash[24585]: cluster 2024-09-16T07:50:19.330421+0000 mgr.a (mgr.14373) 5764 : cluster [DBG] pgmap v3997: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:50:21.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:50:20 smithi157 bash[24585]: audit 2024-09-16T07:50:19.641846+0000 mgr.a (mgr.14373) 5765 : audit [DBG] from='client.133431 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:50:21.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:50:20 smithi086 bash[24289]: cluster 2024-09-16T07:50:19.330421+0000 mgr.a (mgr.14373) 5764 : cluster [DBG] pgmap v3997: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:50:21.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:50:20 smithi086 bash[24289]: audit 2024-09-16T07:50:19.641846+0000 mgr.a (mgr.14373) 5765 : audit [DBG] from='client.133431 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:50:22.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:50:22 smithi047 bash[22744]: cluster 2024-09-16T07:50:21.331360+0000 mgr.a (mgr.14373) 5766 : cluster [DBG] pgmap v3998: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:50:23.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:50:22 smithi157 bash[24585]: cluster 2024-09-16T07:50:21.331360+0000 mgr.a (mgr.14373) 5766 : cluster [DBG] pgmap v3998: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:50:23.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:50:22 smithi086 bash[24289]: cluster 2024-09-16T07:50:21.331360+0000 mgr.a (mgr.14373) 5766 : cluster [DBG] pgmap v3998: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:50:24.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:50:24 smithi047 bash[22744]: cluster 2024-09-16T07:50:23.333649+0000 mgr.a (mgr.14373) 5767 : cluster [DBG] pgmap v3999: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:50:25.051 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:50:25.052 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:50:25.052 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:50:25.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:50:24 smithi157 bash[24585]: cluster 2024-09-16T07:50:23.333649+0000 mgr.a (mgr.14373) 5767 : cluster [DBG] pgmap v3999: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:50:25.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:50:24 smithi086 bash[24289]: cluster 2024-09-16T07:50:23.333649+0000 mgr.a (mgr.14373) 5767 : cluster [DBG] pgmap v3999: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:50:25.814 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:50:25.814 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:50:25.814 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:50:25.814 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:50:25.814 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:50:26.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:50:26 smithi047 bash[22744]: cluster 2024-09-16T07:50:25.334084+0000 mgr.a (mgr.14373) 5768 : cluster [DBG] pgmap v4000: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:50:26.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:50:26 smithi047 bash[22744]: audit 2024-09-16T07:50:25.388262+0000 mgr.a (mgr.14373) 5769 : audit [DBG] from='client.133509 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:50:27.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:50:26 smithi157 bash[24585]: cluster 2024-09-16T07:50:25.334084+0000 mgr.a (mgr.14373) 5768 : cluster [DBG] pgmap v4000: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:50:27.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:50:26 smithi157 bash[24585]: audit 2024-09-16T07:50:25.388262+0000 mgr.a (mgr.14373) 5769 : audit [DBG] from='client.133509 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:50:27.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:50:26 smithi086 bash[24289]: cluster 2024-09-16T07:50:25.334084+0000 mgr.a (mgr.14373) 5768 : cluster [DBG] pgmap v4000: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:50:27.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:50:26 smithi086 bash[24289]: audit 2024-09-16T07:50:25.388262+0000 mgr.a (mgr.14373) 5769 : audit [DBG] from='client.133509 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:50:28.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:50:28 smithi047 bash[22744]: cluster 2024-09-16T07:50:27.336396+0000 mgr.a (mgr.14373) 5770 : cluster [DBG] pgmap v4001: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:50:29.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:50:28 smithi157 bash[24585]: cluster 2024-09-16T07:50:27.336396+0000 mgr.a (mgr.14373) 5770 : cluster [DBG] pgmap v4001: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:50:29.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:50:28 smithi086 bash[24289]: cluster 2024-09-16T07:50:27.336396+0000 mgr.a (mgr.14373) 5770 : cluster [DBG] pgmap v4001: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:50:30.815 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:50:30.816 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:50:30.816 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:50:31.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:50:30 smithi157 bash[24585]: cluster 2024-09-16T07:50:29.337159+0000 mgr.a (mgr.14373) 5771 : cluster [DBG] pgmap v4002: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:50:31.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:50:30 smithi086 bash[24289]: cluster 2024-09-16T07:50:29.337159+0000 mgr.a (mgr.14373) 5771 : cluster [DBG] pgmap v4002: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:50:31.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:50:30 smithi047 bash[22744]: cluster 2024-09-16T07:50:29.337159+0000 mgr.a (mgr.14373) 5771 : cluster [DBG] pgmap v4002: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:50:31.595 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:50:31.596 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:50:31.596 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:50:31.596 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:50:31.596 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:50:33.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:50:32 smithi157 bash[24585]: audit 2024-09-16T07:50:31.154183+0000 mgr.a (mgr.14373) 5772 : audit [DBG] from='client.133587 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:50:33.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:50:32 smithi157 bash[24585]: cluster 2024-09-16T07:50:31.337676+0000 mgr.a (mgr.14373) 5773 : cluster [DBG] pgmap v4003: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:50:33.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:50:32 smithi086 bash[24289]: audit 2024-09-16T07:50:31.154183+0000 mgr.a (mgr.14373) 5772 : audit [DBG] from='client.133587 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:50:33.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:50:32 smithi086 bash[24289]: cluster 2024-09-16T07:50:31.337676+0000 mgr.a (mgr.14373) 5773 : cluster [DBG] pgmap v4003: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:50:33.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:50:32 smithi047 bash[22744]: audit 2024-09-16T07:50:31.154183+0000 mgr.a (mgr.14373) 5772 : audit [DBG] from='client.133587 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:50:33.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:50:32 smithi047 bash[22744]: cluster 2024-09-16T07:50:31.337676+0000 mgr.a (mgr.14373) 5773 : cluster [DBG] pgmap v4003: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:50:35.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:50:34 smithi157 bash[24585]: cluster 2024-09-16T07:50:33.340034+0000 mgr.a (mgr.14373) 5774 : cluster [DBG] pgmap v4004: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-16T07:50:35.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:50:34 smithi086 bash[24289]: cluster 2024-09-16T07:50:33.340034+0000 mgr.a (mgr.14373) 5774 : cluster [DBG] pgmap v4004: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-16T07:50:35.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:50:34 smithi047 bash[22744]: cluster 2024-09-16T07:50:33.340034+0000 mgr.a (mgr.14373) 5774 : cluster [DBG] pgmap v4004: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-16T07:50:36.597 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:50:36.597 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:50:36.598 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:50:37.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:50:36 smithi157 bash[24585]: cluster 2024-09-16T07:50:35.340790+0000 mgr.a (mgr.14373) 5775 : cluster [DBG] pgmap v4005: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T07:50:37.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:50:36 smithi086 bash[24289]: cluster 2024-09-16T07:50:35.340790+0000 mgr.a (mgr.14373) 5775 : cluster [DBG] pgmap v4005: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T07:50:37.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:50:36 smithi047 bash[22744]: cluster 2024-09-16T07:50:35.340790+0000 mgr.a (mgr.14373) 5775 : cluster [DBG] pgmap v4005: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T07:50:37.358 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:50:37.359 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:50:37.359 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:50:37.359 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:50:37.359 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:50:38.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:50:37 smithi157 bash[24585]: audit 2024-09-16T07:50:36.937256+0000 mgr.a (mgr.14373) 5776 : audit [DBG] from='client.133665 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:50:38.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:50:37 smithi086 bash[24289]: audit 2024-09-16T07:50:36.937256+0000 mgr.a (mgr.14373) 5776 : audit [DBG] from='client.133665 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:50:38.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:50:37 smithi047 bash[22744]: audit 2024-09-16T07:50:36.937256+0000 mgr.a (mgr.14373) 5776 : audit [DBG] from='client.133665 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:50:39.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:50:38 smithi157 bash[24585]: cluster 2024-09-16T07:50:37.342268+0000 mgr.a (mgr.14373) 5777 : cluster [DBG] pgmap v4006: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:50:39.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:50:38 smithi086 bash[24289]: cluster 2024-09-16T07:50:37.342268+0000 mgr.a (mgr.14373) 5777 : cluster [DBG] pgmap v4006: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:50:39.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:50:38 smithi047 bash[22744]: cluster 2024-09-16T07:50:37.342268+0000 mgr.a (mgr.14373) 5777 : cluster [DBG] pgmap v4006: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:50:41.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:50:40 smithi157 bash[24585]: cluster 2024-09-16T07:50:39.343014+0000 mgr.a (mgr.14373) 5778 : cluster [DBG] pgmap v4007: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T07:50:41.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:50:40 smithi086 bash[24289]: cluster 2024-09-16T07:50:39.343014+0000 mgr.a (mgr.14373) 5778 : cluster [DBG] pgmap v4007: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T07:50:41.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:50:40 smithi047 bash[22744]: cluster 2024-09-16T07:50:39.343014+0000 mgr.a (mgr.14373) 5778 : cluster [DBG] pgmap v4007: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T07:50:42.360 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:50:42.361 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:50:42.361 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:50:43.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:50:42 smithi157 bash[24585]: cluster 2024-09-16T07:50:41.343747+0000 mgr.a (mgr.14373) 5779 : cluster [DBG] pgmap v4008: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T07:50:43.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:50:42 smithi086 bash[24289]: cluster 2024-09-16T07:50:41.343747+0000 mgr.a (mgr.14373) 5779 : cluster [DBG] pgmap v4008: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T07:50:43.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:50:42 smithi047 bash[22744]: cluster 2024-09-16T07:50:41.343747+0000 mgr.a (mgr.14373) 5779 : cluster [DBG] pgmap v4008: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T07:50:43.112 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:50:43.112 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:50:43.112 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:50:43.112 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:50:43.112 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:50:44.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:50:43 smithi157 bash[24585]: audit 2024-09-16T07:50:42.697085+0000 mgr.a (mgr.14373) 5780 : audit [DBG] from='client.133740 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:50:44.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:50:43 smithi086 bash[24289]: audit 2024-09-16T07:50:42.697085+0000 mgr.a (mgr.14373) 5780 : audit [DBG] from='client.133740 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:50:44.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:50:43 smithi047 bash[22744]: audit 2024-09-16T07:50:42.697085+0000 mgr.a (mgr.14373) 5780 : audit [DBG] from='client.133740 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:50:45.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:50:44 smithi157 bash[24585]: cluster 2024-09-16T07:50:43.346470+0000 mgr.a (mgr.14373) 5781 : cluster [DBG] pgmap v4009: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:50:45.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:50:44 smithi086 bash[24289]: cluster 2024-09-16T07:50:43.346470+0000 mgr.a (mgr.14373) 5781 : cluster [DBG] pgmap v4009: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:50:45.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:50:44 smithi047 bash[22744]: cluster 2024-09-16T07:50:43.346470+0000 mgr.a (mgr.14373) 5781 : cluster [DBG] pgmap v4009: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:50:47.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:50:46 smithi157 bash[24585]: cluster 2024-09-16T07:50:45.347242+0000 mgr.a (mgr.14373) 5782 : cluster [DBG] pgmap v4010: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-16T07:50:47.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:50:46 smithi086 bash[24289]: cluster 2024-09-16T07:50:45.347242+0000 mgr.a (mgr.14373) 5782 : cluster [DBG] pgmap v4010: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-16T07:50:47.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:50:46 smithi047 bash[22744]: cluster 2024-09-16T07:50:45.347242+0000 mgr.a (mgr.14373) 5782 : cluster [DBG] pgmap v4010: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-16T07:50:48.113 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:50:48.114 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:50:48.114 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:50:48.887 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:50:48.888 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:50:48.888 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:50:48.888 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:50:48.888 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:50:49.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:50:48 smithi157 bash[24585]: cluster 2024-09-16T07:50:47.349264+0000 mgr.a (mgr.14373) 5783 : cluster [DBG] pgmap v4011: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-16T07:50:49.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:50:48 smithi157 bash[24585]: audit 2024-09-16T07:50:47.983206+0000 mon.b (mon.2) 558 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T07:50:49.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:50:48 smithi086 bash[24289]: cluster 2024-09-16T07:50:47.349264+0000 mgr.a (mgr.14373) 5783 : cluster [DBG] pgmap v4011: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-16T07:50:49.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:50:48 smithi086 bash[24289]: audit 2024-09-16T07:50:47.983206+0000 mon.b (mon.2) 558 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T07:50:49.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:50:48 smithi047 bash[22744]: cluster 2024-09-16T07:50:47.349264+0000 mgr.a (mgr.14373) 5783 : cluster [DBG] pgmap v4011: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-16T07:50:49.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:50:48 smithi047 bash[22744]: audit 2024-09-16T07:50:47.983206+0000 mon.b (mon.2) 558 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T07:50:49.838 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 07:50:49 smithi047 bash[22994]: debug 2024-09-16T07:50:49.571+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T07:50:49.838 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 07:50:49 smithi047 bash[22994]: debug 2024-09-16T07:50:49.575+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T07:50:49.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:50:49 smithi047 bash[22744]: audit 2024-09-16T07:50:48.445327+0000 mgr.a (mgr.14373) 5784 : audit [DBG] from='client.133815 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:50:49.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:50:49 smithi047 bash[22744]: audit 2024-09-16T07:50:48.859429+0000 mon.b (mon.2) 559 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T07:50:49.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:50:49 smithi047 bash[22744]: audit 2024-09-16T07:50:48.860970+0000 mon.b (mon.2) 560 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T07:50:49.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:50:49 smithi047 bash[22744]: audit 2024-09-16T07:50:48.869792+0000 mon.a (mon.0) 917 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:50:49.840 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:50:49 smithi047 bash[22744]: audit 2024-09-16T07:50:48.874621+0000 mon.b (mon.2) 561 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:50:49.840 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:50:49 smithi047 bash[22744]: audit 2024-09-16T07:50:48.877730+0000 mgr.a (mgr.14373) 5785 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:50:50.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:50:49 smithi157 bash[24585]: audit 2024-09-16T07:50:48.445327+0000 mgr.a (mgr.14373) 5784 : audit [DBG] from='client.133815 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:50:50.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:50:49 smithi157 bash[24585]: audit 2024-09-16T07:50:48.859429+0000 mon.b (mon.2) 559 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T07:50:50.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:50:49 smithi157 bash[24585]: audit 2024-09-16T07:50:48.860970+0000 mon.b (mon.2) 560 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T07:50:50.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:50:49 smithi157 bash[24585]: audit 2024-09-16T07:50:48.869792+0000 mon.a (mon.0) 917 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:50:50.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:50:49 smithi157 bash[24585]: audit 2024-09-16T07:50:48.874621+0000 mon.b (mon.2) 561 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:50:50.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:50:49 smithi157 bash[24585]: audit 2024-09-16T07:50:48.877730+0000 mgr.a (mgr.14373) 5785 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:50:50.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:50:49 smithi086 bash[24289]: audit 2024-09-16T07:50:48.445327+0000 mgr.a (mgr.14373) 5784 : audit [DBG] from='client.133815 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:50:50.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:50:49 smithi086 bash[24289]: audit 2024-09-16T07:50:48.859429+0000 mon.b (mon.2) 559 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T07:50:50.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:50:49 smithi086 bash[24289]: audit 2024-09-16T07:50:48.860970+0000 mon.b (mon.2) 560 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T07:50:50.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:50:49 smithi086 bash[24289]: audit 2024-09-16T07:50:48.869792+0000 mon.a (mon.0) 917 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:50:50.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:50:49 smithi086 bash[24289]: audit 2024-09-16T07:50:48.874621+0000 mon.b (mon.2) 561 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:50:50.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:50:49 smithi086 bash[24289]: audit 2024-09-16T07:50:48.877730+0000 mgr.a (mgr.14373) 5785 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:50:51.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:50:50 smithi157 bash[24585]: cluster 2024-09-16T07:50:49.349809+0000 mgr.a (mgr.14373) 5786 : cluster [DBG] pgmap v4012: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:50:51.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:50:50 smithi157 bash[24585]: audit 2024-09-16T07:50:49.576973+0000 mgr.a (mgr.14373) 5787 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T07:50:51.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:50:50 smithi157 bash[24585]: cephadm 2024-09-16T07:50:49.578964+0000 mgr.a (mgr.14373) 5788 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T07:50:51.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:50:50 smithi086 bash[24289]: cluster 2024-09-16T07:50:49.349809+0000 mgr.a (mgr.14373) 5786 : cluster [DBG] pgmap v4012: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:50:51.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:50:50 smithi086 bash[24289]: audit 2024-09-16T07:50:49.576973+0000 mgr.a (mgr.14373) 5787 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T07:50:51.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:50:50 smithi086 bash[24289]: cephadm 2024-09-16T07:50:49.578964+0000 mgr.a (mgr.14373) 5788 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T07:50:51.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:50:50 smithi047 bash[22744]: cluster 2024-09-16T07:50:49.349809+0000 mgr.a (mgr.14373) 5786 : cluster [DBG] pgmap v4012: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:50:51.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:50:50 smithi047 bash[22744]: audit 2024-09-16T07:50:49.576973+0000 mgr.a (mgr.14373) 5787 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T07:50:51.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:50:50 smithi047 bash[22744]: cephadm 2024-09-16T07:50:49.578964+0000 mgr.a (mgr.14373) 5788 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T07:50:53.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:50:52 smithi157 bash[24585]: cluster 2024-09-16T07:50:51.350747+0000 mgr.a (mgr.14373) 5789 : cluster [DBG] pgmap v4013: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:50:53.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:50:52 smithi086 bash[24289]: cluster 2024-09-16T07:50:51.350747+0000 mgr.a (mgr.14373) 5789 : cluster [DBG] pgmap v4013: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:50:53.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:50:52 smithi047 bash[22744]: cluster 2024-09-16T07:50:51.350747+0000 mgr.a (mgr.14373) 5789 : cluster [DBG] pgmap v4013: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:50:53.889 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:50:53.890 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:50:53.890 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:50:54.640 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:50:54.641 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:50:54.641 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:50:54.641 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:50:54.641 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:50:55.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:50:55 smithi157 bash[24585]: cluster 2024-09-16T07:50:53.352945+0000 mgr.a (mgr.14373) 5790 : cluster [DBG] pgmap v4014: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:50:55.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:50:55 smithi086 bash[24289]: cluster 2024-09-16T07:50:53.352945+0000 mgr.a (mgr.14373) 5790 : cluster [DBG] pgmap v4014: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:50:55.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:50:55 smithi047 bash[22744]: cluster 2024-09-16T07:50:53.352945+0000 mgr.a (mgr.14373) 5790 : cluster [DBG] pgmap v4014: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:50:56.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:50:56 smithi157 bash[24585]: audit 2024-09-16T07:50:54.222247+0000 mgr.a (mgr.14373) 5791 : audit [DBG] from='client.134001 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:50:56.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:50:56 smithi086 bash[24289]: audit 2024-09-16T07:50:54.222247+0000 mgr.a (mgr.14373) 5791 : audit [DBG] from='client.134001 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:50:56.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:50:56 smithi047 bash[22744]: audit 2024-09-16T07:50:54.222247+0000 mgr.a (mgr.14373) 5791 : audit [DBG] from='client.134001 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:50:57.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:50:57 smithi157 bash[24585]: cluster 2024-09-16T07:50:55.353940+0000 mgr.a (mgr.14373) 5792 : cluster [DBG] pgmap v4015: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:50:57.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:50:57 smithi086 bash[24289]: cluster 2024-09-16T07:50:55.353940+0000 mgr.a (mgr.14373) 5792 : cluster [DBG] pgmap v4015: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:50:57.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:50:57 smithi047 bash[22744]: cluster 2024-09-16T07:50:55.353940+0000 mgr.a (mgr.14373) 5792 : cluster [DBG] pgmap v4015: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:50:59.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:50:59 smithi157 bash[24585]: cluster 2024-09-16T07:50:57.356216+0000 mgr.a (mgr.14373) 5793 : cluster [DBG] pgmap v4016: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:50:59.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:50:59 smithi086 bash[24289]: cluster 2024-09-16T07:50:57.356216+0000 mgr.a (mgr.14373) 5793 : cluster [DBG] pgmap v4016: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:50:59.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:50:59 smithi047 bash[22744]: cluster 2024-09-16T07:50:57.356216+0000 mgr.a (mgr.14373) 5793 : cluster [DBG] pgmap v4016: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:50:59.642 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:50:59.643 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:50:59.643 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:51:00.396 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:51:00.397 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:51:00.397 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:51:00.400 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:51:00.400 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:51:01.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:51:01 smithi157 bash[24585]: cluster 2024-09-16T07:50:59.356975+0000 mgr.a (mgr.14373) 5794 : cluster [DBG] pgmap v4017: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:51:01.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:51:01 smithi157 bash[24585]: audit 2024-09-16T07:50:59.988018+0000 mgr.a (mgr.14373) 5795 : audit [DBG] from='client.134079 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:51:01.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:51:01 smithi086 bash[24289]: cluster 2024-09-16T07:50:59.356975+0000 mgr.a (mgr.14373) 5794 : cluster [DBG] pgmap v4017: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:51:01.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:51:01 smithi086 bash[24289]: audit 2024-09-16T07:50:59.988018+0000 mgr.a (mgr.14373) 5795 : audit [DBG] from='client.134079 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:51:01.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:51:01 smithi047 bash[22744]: cluster 2024-09-16T07:50:59.356975+0000 mgr.a (mgr.14373) 5794 : cluster [DBG] pgmap v4017: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:51:01.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:51:01 smithi047 bash[22744]: audit 2024-09-16T07:50:59.988018+0000 mgr.a (mgr.14373) 5795 : audit [DBG] from='client.134079 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:51:02.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:51:02 smithi157 bash[24585]: cluster 2024-09-16T07:51:01.357929+0000 mgr.a (mgr.14373) 5796 : cluster [DBG] pgmap v4018: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:51:02.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:51:02 smithi086 bash[24289]: cluster 2024-09-16T07:51:01.357929+0000 mgr.a (mgr.14373) 5796 : cluster [DBG] pgmap v4018: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:51:02.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:51:02 smithi047 bash[22744]: cluster 2024-09-16T07:51:01.357929+0000 mgr.a (mgr.14373) 5796 : cluster [DBG] pgmap v4018: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:51:04.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:51:04 smithi157 bash[24585]: cluster 2024-09-16T07:51:03.360171+0000 mgr.a (mgr.14373) 5797 : cluster [DBG] pgmap v4019: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:51:04.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:51:04 smithi086 bash[24289]: cluster 2024-09-16T07:51:03.360171+0000 mgr.a (mgr.14373) 5797 : cluster [DBG] pgmap v4019: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:51:04.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:51:04 smithi047 bash[22744]: cluster 2024-09-16T07:51:03.360171+0000 mgr.a (mgr.14373) 5797 : cluster [DBG] pgmap v4019: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:51:05.398 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:51:05.398 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:51:05.398 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:51:06.187 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:51:06.188 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:51:06.188 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:51:06.188 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:51:06.188 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:51:06.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:51:06 smithi157 bash[24585]: cluster 2024-09-16T07:51:05.360956+0000 mgr.a (mgr.14373) 5798 : cluster [DBG] pgmap v4020: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:51:06.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:51:06 smithi157 bash[24585]: audit 2024-09-16T07:51:05.739997+0000 mgr.a (mgr.14373) 5799 : audit [DBG] from='client.134157 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:51:06.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:51:06 smithi086 bash[24289]: cluster 2024-09-16T07:51:05.360956+0000 mgr.a (mgr.14373) 5798 : cluster [DBG] pgmap v4020: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:51:06.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:51:06 smithi086 bash[24289]: audit 2024-09-16T07:51:05.739997+0000 mgr.a (mgr.14373) 5799 : audit [DBG] from='client.134157 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:51:06.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:51:06 smithi047 bash[22744]: cluster 2024-09-16T07:51:05.360956+0000 mgr.a (mgr.14373) 5798 : cluster [DBG] pgmap v4020: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:51:06.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:51:06 smithi047 bash[22744]: audit 2024-09-16T07:51:05.739997+0000 mgr.a (mgr.14373) 5799 : audit [DBG] from='client.134157 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:51:08.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:51:08 smithi157 bash[24585]: cluster 2024-09-16T07:51:07.363302+0000 mgr.a (mgr.14373) 5800 : cluster [DBG] pgmap v4021: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:51:08.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:51:08 smithi086 bash[24289]: cluster 2024-09-16T07:51:07.363302+0000 mgr.a (mgr.14373) 5800 : cluster [DBG] pgmap v4021: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:51:08.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:51:08 smithi047 bash[22744]: cluster 2024-09-16T07:51:07.363302+0000 mgr.a (mgr.14373) 5800 : cluster [DBG] pgmap v4021: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:51:10.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:51:10 smithi157 bash[24585]: cluster 2024-09-16T07:51:09.364079+0000 mgr.a (mgr.14373) 5801 : cluster [DBG] pgmap v4022: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:51:10.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:51:10 smithi086 bash[24289]: cluster 2024-09-16T07:51:09.364079+0000 mgr.a (mgr.14373) 5801 : cluster [DBG] pgmap v4022: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:51:10.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:51:10 smithi047 bash[22744]: cluster 2024-09-16T07:51:09.364079+0000 mgr.a (mgr.14373) 5801 : cluster [DBG] pgmap v4022: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:51:11.189 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:51:11.190 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:51:11.190 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:51:11.965 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:51:11.966 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:51:11.966 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:51:11.966 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:51:11.966 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:51:12.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:51:12 smithi157 bash[24585]: cluster 2024-09-16T07:51:11.364532+0000 mgr.a (mgr.14373) 5802 : cluster [DBG] pgmap v4023: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:51:12.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:51:12 smithi157 bash[24585]: audit 2024-09-16T07:51:11.526808+0000 mgr.a (mgr.14373) 5803 : audit [DBG] from='client.134232 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:51:12.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:51:12 smithi086 bash[24289]: cluster 2024-09-16T07:51:11.364532+0000 mgr.a (mgr.14373) 5802 : cluster [DBG] pgmap v4023: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:51:12.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:51:12 smithi086 bash[24289]: audit 2024-09-16T07:51:11.526808+0000 mgr.a (mgr.14373) 5803 : audit [DBG] from='client.134232 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:51:12.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:51:12 smithi047 bash[22744]: cluster 2024-09-16T07:51:11.364532+0000 mgr.a (mgr.14373) 5802 : cluster [DBG] pgmap v4023: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:51:12.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:51:12 smithi047 bash[22744]: audit 2024-09-16T07:51:11.526808+0000 mgr.a (mgr.14373) 5803 : audit [DBG] from='client.134232 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:51:14.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:51:14 smithi157 bash[24585]: cluster 2024-09-16T07:51:13.367194+0000 mgr.a (mgr.14373) 5804 : cluster [DBG] pgmap v4024: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:51:14.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:51:14 smithi086 bash[24289]: cluster 2024-09-16T07:51:13.367194+0000 mgr.a (mgr.14373) 5804 : cluster [DBG] pgmap v4024: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:51:14.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:51:14 smithi047 bash[22744]: cluster 2024-09-16T07:51:13.367194+0000 mgr.a (mgr.14373) 5804 : cluster [DBG] pgmap v4024: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:51:16.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:51:16 smithi157 bash[24585]: cluster 2024-09-16T07:51:15.367960+0000 mgr.a (mgr.14373) 5805 : cluster [DBG] pgmap v4025: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:51:16.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:51:16 smithi086 bash[24289]: cluster 2024-09-16T07:51:15.367960+0000 mgr.a (mgr.14373) 5805 : cluster [DBG] pgmap v4025: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:51:16.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:51:16 smithi047 bash[22744]: cluster 2024-09-16T07:51:15.367960+0000 mgr.a (mgr.14373) 5805 : cluster [DBG] pgmap v4025: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:51:16.967 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:51:16.968 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:51:16.968 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:51:17.716 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:51:17.717 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:51:17.717 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:51:17.717 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:51:17.717 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:51:18.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:51:18 smithi157 bash[24585]: audit 2024-09-16T07:51:17.303818+0000 mgr.a (mgr.14373) 5806 : audit [DBG] from='client.134307 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:51:18.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:51:18 smithi157 bash[24585]: cluster 2024-09-16T07:51:17.369248+0000 mgr.a (mgr.14373) 5807 : cluster [DBG] pgmap v4026: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:51:18.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:51:18 smithi086 bash[24289]: audit 2024-09-16T07:51:17.303818+0000 mgr.a (mgr.14373) 5806 : audit [DBG] from='client.134307 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:51:18.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:51:18 smithi086 bash[24289]: cluster 2024-09-16T07:51:17.369248+0000 mgr.a (mgr.14373) 5807 : cluster [DBG] pgmap v4026: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:51:18.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:51:18 smithi047 bash[22744]: audit 2024-09-16T07:51:17.303818+0000 mgr.a (mgr.14373) 5806 : audit [DBG] from='client.134307 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:51:18.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:51:18 smithi047 bash[22744]: cluster 2024-09-16T07:51:17.369248+0000 mgr.a (mgr.14373) 5807 : cluster [DBG] pgmap v4026: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:51:20.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:51:20 smithi157 bash[24585]: cluster 2024-09-16T07:51:19.370123+0000 mgr.a (mgr.14373) 5808 : cluster [DBG] pgmap v4027: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T07:51:20.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:51:20 smithi086 bash[24289]: cluster 2024-09-16T07:51:19.370123+0000 mgr.a (mgr.14373) 5808 : cluster [DBG] pgmap v4027: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T07:51:20.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:51:20 smithi047 bash[22744]: cluster 2024-09-16T07:51:19.370123+0000 mgr.a (mgr.14373) 5808 : cluster [DBG] pgmap v4027: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T07:51:22.718 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:51:22.719 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:51:22.719 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:51:22.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:51:22 smithi157 bash[24585]: cluster 2024-09-16T07:51:21.370900+0000 mgr.a (mgr.14373) 5809 : cluster [DBG] pgmap v4028: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T07:51:22.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:51:22 smithi086 bash[24289]: cluster 2024-09-16T07:51:21.370900+0000 mgr.a (mgr.14373) 5809 : cluster [DBG] pgmap v4028: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T07:51:22.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:51:22 smithi047 bash[22744]: cluster 2024-09-16T07:51:21.370900+0000 mgr.a (mgr.14373) 5809 : cluster [DBG] pgmap v4028: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T07:51:23.449 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:51:23.450 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:51:23.450 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:51:23.450 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:51:23.450 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:51:23.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:51:23 smithi157 bash[24585]: audit 2024-09-16T07:51:23.045168+0000 mgr.a (mgr.14373) 5810 : audit [DBG] from='client.134385 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:51:23.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:51:23 smithi086 bash[24289]: audit 2024-09-16T07:51:23.045168+0000 mgr.a (mgr.14373) 5810 : audit [DBG] from='client.134385 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:51:23.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:51:23 smithi047 bash[22744]: audit 2024-09-16T07:51:23.045168+0000 mgr.a (mgr.14373) 5810 : audit [DBG] from='client.134385 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:51:24.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:51:24 smithi157 bash[24585]: cluster 2024-09-16T07:51:23.372502+0000 mgr.a (mgr.14373) 5811 : cluster [DBG] pgmap v4029: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:51:24.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:51:24 smithi086 bash[24289]: cluster 2024-09-16T07:51:23.372502+0000 mgr.a (mgr.14373) 5811 : cluster [DBG] pgmap v4029: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:51:24.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:51:24 smithi047 bash[22744]: cluster 2024-09-16T07:51:23.372502+0000 mgr.a (mgr.14373) 5811 : cluster [DBG] pgmap v4029: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:51:26.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:51:26 smithi157 bash[24585]: cluster 2024-09-16T07:51:25.373250+0000 mgr.a (mgr.14373) 5812 : cluster [DBG] pgmap v4030: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:51:26.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:51:26 smithi086 bash[24289]: cluster 2024-09-16T07:51:25.373250+0000 mgr.a (mgr.14373) 5812 : cluster [DBG] pgmap v4030: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:51:26.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:51:26 smithi047 bash[22744]: cluster 2024-09-16T07:51:25.373250+0000 mgr.a (mgr.14373) 5812 : cluster [DBG] pgmap v4030: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:51:28.451 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:51:28.452 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:51:28.452 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:51:28.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:51:28 smithi157 bash[24585]: cluster 2024-09-16T07:51:27.375287+0000 mgr.a (mgr.14373) 5813 : cluster [DBG] pgmap v4031: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:51:28.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:51:28 smithi086 bash[24289]: cluster 2024-09-16T07:51:27.375287+0000 mgr.a (mgr.14373) 5813 : cluster [DBG] pgmap v4031: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:51:28.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:51:28 smithi047 bash[22744]: cluster 2024-09-16T07:51:27.375287+0000 mgr.a (mgr.14373) 5813 : cluster [DBG] pgmap v4031: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:51:29.224 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:51:29.224 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:51:29.224 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:51:29.224 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:51:29.224 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:51:29.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:51:29 smithi157 bash[24585]: audit 2024-09-16T07:51:28.790625+0000 mgr.a (mgr.14373) 5814 : audit [DBG] from='client.134463 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:51:29.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:51:29 smithi086 bash[24289]: audit 2024-09-16T07:51:28.790625+0000 mgr.a (mgr.14373) 5814 : audit [DBG] from='client.134463 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:51:29.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:51:29 smithi047 bash[22744]: audit 2024-09-16T07:51:28.790625+0000 mgr.a (mgr.14373) 5814 : audit [DBG] from='client.134463 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:51:30.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:51:30 smithi157 bash[24585]: cluster 2024-09-16T07:51:29.376219+0000 mgr.a (mgr.14373) 5815 : cluster [DBG] pgmap v4032: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:51:30.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:51:30 smithi086 bash[24289]: cluster 2024-09-16T07:51:29.376219+0000 mgr.a (mgr.14373) 5815 : cluster [DBG] pgmap v4032: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:51:30.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:51:30 smithi047 bash[22744]: cluster 2024-09-16T07:51:29.376219+0000 mgr.a (mgr.14373) 5815 : cluster [DBG] pgmap v4032: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:51:32.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:51:32 smithi157 bash[24585]: cluster 2024-09-16T07:51:31.377000+0000 mgr.a (mgr.14373) 5816 : cluster [DBG] pgmap v4033: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:51:32.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:51:32 smithi086 bash[24289]: cluster 2024-09-16T07:51:31.377000+0000 mgr.a (mgr.14373) 5816 : cluster [DBG] pgmap v4033: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:51:32.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:51:32 smithi047 bash[22744]: cluster 2024-09-16T07:51:31.377000+0000 mgr.a (mgr.14373) 5816 : cluster [DBG] pgmap v4033: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:51:34.226 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:51:34.226 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:51:34.226 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:51:34.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:51:34 smithi157 bash[24585]: cluster 2024-09-16T07:51:33.379231+0000 mgr.a (mgr.14373) 5817 : cluster [DBG] pgmap v4034: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:51:34.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:51:34 smithi086 bash[24289]: cluster 2024-09-16T07:51:33.379231+0000 mgr.a (mgr.14373) 5817 : cluster [DBG] pgmap v4034: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:51:34.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:51:34 smithi047 bash[22744]: cluster 2024-09-16T07:51:33.379231+0000 mgr.a (mgr.14373) 5817 : cluster [DBG] pgmap v4034: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:51:34.990 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:51:34.990 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:51:34.991 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:51:34.991 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:51:34.991 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:51:35.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:51:35 smithi157 bash[24585]: audit 2024-09-16T07:51:34.559812+0000 mgr.a (mgr.14373) 5818 : audit [DBG] from='client.134541 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:51:35.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:51:35 smithi086 bash[24289]: audit 2024-09-16T07:51:34.559812+0000 mgr.a (mgr.14373) 5818 : audit [DBG] from='client.134541 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:51:35.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:51:35 smithi047 bash[22744]: audit 2024-09-16T07:51:34.559812+0000 mgr.a (mgr.14373) 5818 : audit [DBG] from='client.134541 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:51:36.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:51:36 smithi157 bash[24585]: cluster 2024-09-16T07:51:35.380157+0000 mgr.a (mgr.14373) 5819 : cluster [DBG] pgmap v4035: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:51:36.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:51:36 smithi086 bash[24289]: cluster 2024-09-16T07:51:35.380157+0000 mgr.a (mgr.14373) 5819 : cluster [DBG] pgmap v4035: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:51:36.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:51:36 smithi047 bash[22744]: cluster 2024-09-16T07:51:35.380157+0000 mgr.a (mgr.14373) 5819 : cluster [DBG] pgmap v4035: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:51:38.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:51:38 smithi157 bash[24585]: cluster 2024-09-16T07:51:37.382416+0000 mgr.a (mgr.14373) 5820 : cluster [DBG] pgmap v4036: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:51:38.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:51:38 smithi086 bash[24289]: cluster 2024-09-16T07:51:37.382416+0000 mgr.a (mgr.14373) 5820 : cluster [DBG] pgmap v4036: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:51:38.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:51:38 smithi047 bash[22744]: cluster 2024-09-16T07:51:37.382416+0000 mgr.a (mgr.14373) 5820 : cluster [DBG] pgmap v4036: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:51:39.992 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:51:39.992 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:51:39.993 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:51:40.772 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:51:40.773 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:51:40.773 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:51:40.773 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:51:40.773 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:51:40.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:51:40 smithi157 bash[24585]: cluster 2024-09-16T07:51:39.383153+0000 mgr.a (mgr.14373) 5821 : cluster [DBG] pgmap v4037: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:51:40.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:51:40 smithi086 bash[24289]: cluster 2024-09-16T07:51:39.383153+0000 mgr.a (mgr.14373) 5821 : cluster [DBG] pgmap v4037: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:51:40.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:51:40 smithi047 bash[22744]: cluster 2024-09-16T07:51:39.383153+0000 mgr.a (mgr.14373) 5821 : cluster [DBG] pgmap v4037: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:51:41.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:51:41 smithi157 bash[24585]: audit 2024-09-16T07:51:40.331938+0000 mgr.a (mgr.14373) 5822 : audit [DBG] from='client.134619 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:51:41.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:51:41 smithi086 bash[24289]: audit 2024-09-16T07:51:40.331938+0000 mgr.a (mgr.14373) 5822 : audit [DBG] from='client.134619 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:51:41.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:51:41 smithi047 bash[22744]: audit 2024-09-16T07:51:40.331938+0000 mgr.a (mgr.14373) 5822 : audit [DBG] from='client.134619 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:51:42.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:51:42 smithi157 bash[24585]: cluster 2024-09-16T07:51:41.383999+0000 mgr.a (mgr.14373) 5823 : cluster [DBG] pgmap v4038: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:51:42.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:51:42 smithi086 bash[24289]: cluster 2024-09-16T07:51:41.383999+0000 mgr.a (mgr.14373) 5823 : cluster [DBG] pgmap v4038: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:51:42.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:51:42 smithi047 bash[22744]: cluster 2024-09-16T07:51:41.383999+0000 mgr.a (mgr.14373) 5823 : cluster [DBG] pgmap v4038: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:51:44.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:51:44 smithi157 bash[24585]: cluster 2024-09-16T07:51:43.386237+0000 mgr.a (mgr.14373) 5824 : cluster [DBG] pgmap v4039: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:51:44.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:51:44 smithi086 bash[24289]: cluster 2024-09-16T07:51:43.386237+0000 mgr.a (mgr.14373) 5824 : cluster [DBG] pgmap v4039: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:51:44.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:51:44 smithi047 bash[22744]: cluster 2024-09-16T07:51:43.386237+0000 mgr.a (mgr.14373) 5824 : cluster [DBG] pgmap v4039: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:51:45.774 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:51:45.775 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:51:45.775 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:51:46.562 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:51:46.562 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:51:46.562 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:51:46.562 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:51:46.562 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:51:46.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:51:46 smithi157 bash[24585]: cluster 2024-09-16T07:51:45.386955+0000 mgr.a (mgr.14373) 5825 : cluster [DBG] pgmap v4040: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:51:46.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:51:46 smithi157 bash[24585]: audit 2024-09-16T07:51:46.118906+0000 mgr.a (mgr.14373) 5826 : audit [DBG] from='client.134694 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:51:46.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:51:46 smithi086 bash[24289]: cluster 2024-09-16T07:51:45.386955+0000 mgr.a (mgr.14373) 5825 : cluster [DBG] pgmap v4040: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:51:46.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:51:46 smithi086 bash[24289]: audit 2024-09-16T07:51:46.118906+0000 mgr.a (mgr.14373) 5826 : audit [DBG] from='client.134694 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:51:46.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:51:46 smithi047 bash[22744]: cluster 2024-09-16T07:51:45.386955+0000 mgr.a (mgr.14373) 5825 : cluster [DBG] pgmap v4040: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:51:46.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:51:46 smithi047 bash[22744]: audit 2024-09-16T07:51:46.118906+0000 mgr.a (mgr.14373) 5826 : audit [DBG] from='client.134694 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:51:48.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:51:48 smithi157 bash[24585]: cluster 2024-09-16T07:51:47.389265+0000 mgr.a (mgr.14373) 5827 : cluster [DBG] pgmap v4041: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:51:48.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:51:48 smithi086 bash[24289]: cluster 2024-09-16T07:51:47.389265+0000 mgr.a (mgr.14373) 5827 : cluster [DBG] pgmap v4041: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:51:48.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:51:48 smithi047 bash[22744]: cluster 2024-09-16T07:51:47.389265+0000 mgr.a (mgr.14373) 5827 : cluster [DBG] pgmap v4041: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:51:50.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:51:50 smithi157 bash[24585]: cluster 2024-09-16T07:51:49.390011+0000 mgr.a (mgr.14373) 5828 : cluster [DBG] pgmap v4042: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:51:50.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:51:50 smithi157 bash[24585]: audit 2024-09-16T07:51:49.634449+0000 mon.b (mon.2) 562 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T07:51:50.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:51:50 smithi157 bash[24585]: audit 2024-09-16T07:51:50.476564+0000 mon.b (mon.2) 563 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T07:51:50.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:51:50 smithi157 bash[24585]: audit 2024-09-16T07:51:50.478846+0000 mon.b (mon.2) 564 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T07:51:50.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:51:50 smithi157 bash[24585]: audit 2024-09-16T07:51:50.492750+0000 mon.a (mon.0) 918 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:51:50.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:51:50 smithi157 bash[24585]: audit 2024-09-16T07:51:50.496496+0000 mon.b (mon.2) 565 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:51:50.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:51:50 smithi086 bash[24289]: cluster 2024-09-16T07:51:49.390011+0000 mgr.a (mgr.14373) 5828 : cluster [DBG] pgmap v4042: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:51:50.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:51:50 smithi086 bash[24289]: audit 2024-09-16T07:51:49.634449+0000 mon.b (mon.2) 562 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T07:51:50.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:51:50 smithi086 bash[24289]: audit 2024-09-16T07:51:50.476564+0000 mon.b (mon.2) 563 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T07:51:50.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:51:50 smithi086 bash[24289]: audit 2024-09-16T07:51:50.478846+0000 mon.b (mon.2) 564 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T07:51:50.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:51:50 smithi086 bash[24289]: audit 2024-09-16T07:51:50.492750+0000 mon.a (mon.0) 918 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:51:50.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:51:50 smithi086 bash[24289]: audit 2024-09-16T07:51:50.496496+0000 mon.b (mon.2) 565 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:51:50.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:51:50 smithi047 bash[22744]: cluster 2024-09-16T07:51:49.390011+0000 mgr.a (mgr.14373) 5828 : cluster [DBG] pgmap v4042: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:51:50.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:51:50 smithi047 bash[22744]: audit 2024-09-16T07:51:49.634449+0000 mon.b (mon.2) 562 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T07:51:50.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:51:50 smithi047 bash[22744]: audit 2024-09-16T07:51:50.476564+0000 mon.b (mon.2) 563 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T07:51:50.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:51:50 smithi047 bash[22744]: audit 2024-09-16T07:51:50.478846+0000 mon.b (mon.2) 564 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T07:51:50.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:51:50 smithi047 bash[22744]: audit 2024-09-16T07:51:50.492750+0000 mon.a (mon.0) 918 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:51:50.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:51:50 smithi047 bash[22744]: audit 2024-09-16T07:51:50.496496+0000 mon.b (mon.2) 565 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:51:51.539 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 07:51:51 smithi047 bash[22994]: debug 2024-09-16T07:51:51.225+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T07:51:51.539 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 07:51:51 smithi047 bash[22994]: debug 2024-09-16T07:51:51.225+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T07:51:51.563 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:51:51.564 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:51:51.564 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:51:51.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:51:51 smithi157 bash[24585]: audit 2024-09-16T07:51:50.500933+0000 mgr.a (mgr.14373) 5829 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:51:51.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:51:51 smithi086 bash[24289]: audit 2024-09-16T07:51:50.500933+0000 mgr.a (mgr.14373) 5829 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:51:51.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:51:51 smithi047 bash[22744]: audit 2024-09-16T07:51:50.500933+0000 mgr.a (mgr.14373) 5829 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:51:52.344 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:51:52.344 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:51:52.344 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:51:52.345 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:51:52.345 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:51:52.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:51:52 smithi157 bash[24585]: audit 2024-09-16T07:51:51.226996+0000 mgr.a (mgr.14373) 5830 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T07:51:52.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:51:52 smithi157 bash[24585]: cephadm 2024-09-16T07:51:51.229122+0000 mgr.a (mgr.14373) 5831 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T07:51:52.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:51:52 smithi157 bash[24585]: cluster 2024-09-16T07:51:51.390951+0000 mgr.a (mgr.14373) 5832 : cluster [DBG] pgmap v4043: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:51:52.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:51:52 smithi157 bash[24585]: audit 2024-09-16T07:51:51.901709+0000 mgr.a (mgr.14373) 5833 : audit [DBG] from='client.134877 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:51:52.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:51:52 smithi086 bash[24289]: audit 2024-09-16T07:51:51.226996+0000 mgr.a (mgr.14373) 5830 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T07:51:52.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:51:52 smithi086 bash[24289]: cephadm 2024-09-16T07:51:51.229122+0000 mgr.a (mgr.14373) 5831 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T07:51:52.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:51:52 smithi086 bash[24289]: cluster 2024-09-16T07:51:51.390951+0000 mgr.a (mgr.14373) 5832 : cluster [DBG] pgmap v4043: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:51:52.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:51:52 smithi086 bash[24289]: audit 2024-09-16T07:51:51.901709+0000 mgr.a (mgr.14373) 5833 : audit [DBG] from='client.134877 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:51:52.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:51:52 smithi047 bash[22744]: audit 2024-09-16T07:51:51.226996+0000 mgr.a (mgr.14373) 5830 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T07:51:52.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:51:52 smithi047 bash[22744]: cephadm 2024-09-16T07:51:51.229122+0000 mgr.a (mgr.14373) 5831 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T07:51:52.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:51:52 smithi047 bash[22744]: cluster 2024-09-16T07:51:51.390951+0000 mgr.a (mgr.14373) 5832 : cluster [DBG] pgmap v4043: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:51:52.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:51:52 smithi047 bash[22744]: audit 2024-09-16T07:51:51.901709+0000 mgr.a (mgr.14373) 5833 : audit [DBG] from='client.134877 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:51:54.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:51:54 smithi157 bash[24585]: cluster 2024-09-16T07:51:53.393648+0000 mgr.a (mgr.14373) 5834 : cluster [DBG] pgmap v4044: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:51:54.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:51:54 smithi086 bash[24289]: cluster 2024-09-16T07:51:53.393648+0000 mgr.a (mgr.14373) 5834 : cluster [DBG] pgmap v4044: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:51:54.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:51:54 smithi047 bash[22744]: cluster 2024-09-16T07:51:53.393648+0000 mgr.a (mgr.14373) 5834 : cluster [DBG] pgmap v4044: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:51:56.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:51:56 smithi086 bash[24289]: cluster 2024-09-16T07:51:55.394436+0000 mgr.a (mgr.14373) 5835 : cluster [DBG] pgmap v4045: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T07:51:56.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:51:56 smithi047 bash[22744]: cluster 2024-09-16T07:51:55.394436+0000 mgr.a (mgr.14373) 5835 : cluster [DBG] pgmap v4045: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T07:51:57.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:51:56 smithi157 bash[24585]: cluster 2024-09-16T07:51:55.394436+0000 mgr.a (mgr.14373) 5835 : cluster [DBG] pgmap v4045: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T07:51:57.346 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:51:57.347 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:51:57.347 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:51:58.096 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:51:58.096 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:51:58.096 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:51:58.097 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:51:58.097 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:51:58.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:51:58 smithi086 bash[24289]: cluster 2024-09-16T07:51:57.396482+0000 mgr.a (mgr.14373) 5836 : cluster [DBG] pgmap v4046: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:51:58.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:51:58 smithi086 bash[24289]: audit 2024-09-16T07:51:57.682769+0000 mgr.a (mgr.14373) 5837 : audit [DBG] from='client.134955 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:51:58.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:51:58 smithi047 bash[22744]: cluster 2024-09-16T07:51:57.396482+0000 mgr.a (mgr.14373) 5836 : cluster [DBG] pgmap v4046: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:51:58.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:51:58 smithi047 bash[22744]: audit 2024-09-16T07:51:57.682769+0000 mgr.a (mgr.14373) 5837 : audit [DBG] from='client.134955 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:51:59.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:51:58 smithi157 bash[24585]: cluster 2024-09-16T07:51:57.396482+0000 mgr.a (mgr.14373) 5836 : cluster [DBG] pgmap v4046: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:51:59.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:51:58 smithi157 bash[24585]: audit 2024-09-16T07:51:57.682769+0000 mgr.a (mgr.14373) 5837 : audit [DBG] from='client.134955 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:52:00.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:52:00 smithi086 bash[24289]: cluster 2024-09-16T07:51:59.397377+0000 mgr.a (mgr.14373) 5838 : cluster [DBG] pgmap v4047: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T07:52:00.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:52:00 smithi047 bash[22744]: cluster 2024-09-16T07:51:59.397377+0000 mgr.a (mgr.14373) 5838 : cluster [DBG] pgmap v4047: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T07:52:01.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:52:00 smithi157 bash[24585]: cluster 2024-09-16T07:51:59.397377+0000 mgr.a (mgr.14373) 5838 : cluster [DBG] pgmap v4047: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T07:52:02.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:52:02 smithi047 bash[22744]: cluster 2024-09-16T07:52:01.398142+0000 mgr.a (mgr.14373) 5839 : cluster [DBG] pgmap v4048: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T07:52:03.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:52:02 smithi157 bash[24585]: cluster 2024-09-16T07:52:01.398142+0000 mgr.a (mgr.14373) 5839 : cluster [DBG] pgmap v4048: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T07:52:03.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:52:02 smithi086 bash[24289]: cluster 2024-09-16T07:52:01.398142+0000 mgr.a (mgr.14373) 5839 : cluster [DBG] pgmap v4048: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T07:52:03.098 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:52:03.098 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:52:03.099 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:52:03.833 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:52:03.833 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:52:03.833 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:52:03.833 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:52:03.833 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:52:04.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:52:04 smithi047 bash[22744]: cluster 2024-09-16T07:52:03.400263+0000 mgr.a (mgr.14373) 5840 : cluster [DBG] pgmap v4049: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:52:04.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:52:04 smithi047 bash[22744]: audit 2024-09-16T07:52:03.432398+0000 mgr.a (mgr.14373) 5841 : audit [DBG] from='client.135033 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:52:05.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:52:04 smithi157 bash[24585]: cluster 2024-09-16T07:52:03.400263+0000 mgr.a (mgr.14373) 5840 : cluster [DBG] pgmap v4049: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:52:05.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:52:04 smithi157 bash[24585]: audit 2024-09-16T07:52:03.432398+0000 mgr.a (mgr.14373) 5841 : audit [DBG] from='client.135033 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:52:05.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:52:04 smithi086 bash[24289]: cluster 2024-09-16T07:52:03.400263+0000 mgr.a (mgr.14373) 5840 : cluster [DBG] pgmap v4049: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:52:05.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:52:04 smithi086 bash[24289]: audit 2024-09-16T07:52:03.432398+0000 mgr.a (mgr.14373) 5841 : audit [DBG] from='client.135033 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:52:06.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:52:06 smithi047 bash[22744]: cluster 2024-09-16T07:52:05.401166+0000 mgr.a (mgr.14373) 5842 : cluster [DBG] pgmap v4050: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:52:07.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:52:06 smithi157 bash[24585]: cluster 2024-09-16T07:52:05.401166+0000 mgr.a (mgr.14373) 5842 : cluster [DBG] pgmap v4050: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:52:07.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:52:06 smithi086 bash[24289]: cluster 2024-09-16T07:52:05.401166+0000 mgr.a (mgr.14373) 5842 : cluster [DBG] pgmap v4050: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:52:08.834 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:52:08.835 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:52:08.835 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:52:08.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:52:08 smithi047 bash[22744]: cluster 2024-09-16T07:52:07.403343+0000 mgr.a (mgr.14373) 5843 : cluster [DBG] pgmap v4051: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:52:09.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:52:08 smithi157 bash[24585]: cluster 2024-09-16T07:52:07.403343+0000 mgr.a (mgr.14373) 5843 : cluster [DBG] pgmap v4051: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:52:09.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:52:08 smithi086 bash[24289]: cluster 2024-09-16T07:52:07.403343+0000 mgr.a (mgr.14373) 5843 : cluster [DBG] pgmap v4051: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:52:09.604 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:52:09.604 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:52:09.604 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:52:09.604 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:52:09.604 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:52:10.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:52:10 smithi047 bash[22744]: audit 2024-09-16T07:52:09.173466+0000 mgr.a (mgr.14373) 5844 : audit [DBG] from='client.135111 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:52:10.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:52:10 smithi047 bash[22744]: cluster 2024-09-16T07:52:09.411093+0000 mgr.a (mgr.14373) 5845 : cluster [DBG] pgmap v4052: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:52:11.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:52:10 smithi157 bash[24585]: audit 2024-09-16T07:52:09.173466+0000 mgr.a (mgr.14373) 5844 : audit [DBG] from='client.135111 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:52:11.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:52:10 smithi157 bash[24585]: cluster 2024-09-16T07:52:09.411093+0000 mgr.a (mgr.14373) 5845 : cluster [DBG] pgmap v4052: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:52:11.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:52:10 smithi086 bash[24289]: audit 2024-09-16T07:52:09.173466+0000 mgr.a (mgr.14373) 5844 : audit [DBG] from='client.135111 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:52:11.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:52:10 smithi086 bash[24289]: cluster 2024-09-16T07:52:09.411093+0000 mgr.a (mgr.14373) 5845 : cluster [DBG] pgmap v4052: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:52:13.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:52:12 smithi157 bash[24585]: cluster 2024-09-16T07:52:11.411964+0000 mgr.a (mgr.14373) 5846 : cluster [DBG] pgmap v4053: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:52:13.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:52:12 smithi086 bash[24289]: cluster 2024-09-16T07:52:11.411964+0000 mgr.a (mgr.14373) 5846 : cluster [DBG] pgmap v4053: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:52:13.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:52:12 smithi047 bash[22744]: cluster 2024-09-16T07:52:11.411964+0000 mgr.a (mgr.14373) 5846 : cluster [DBG] pgmap v4053: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:52:14.605 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:52:14.606 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:52:14.606 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:52:15.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:52:14 smithi157 bash[24585]: cluster 2024-09-16T07:52:13.414234+0000 mgr.a (mgr.14373) 5847 : cluster [DBG] pgmap v4054: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:52:15.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:52:14 smithi086 bash[24289]: cluster 2024-09-16T07:52:13.414234+0000 mgr.a (mgr.14373) 5847 : cluster [DBG] pgmap v4054: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:52:15.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:52:14 smithi047 bash[22744]: cluster 2024-09-16T07:52:13.414234+0000 mgr.a (mgr.14373) 5847 : cluster [DBG] pgmap v4054: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:52:15.348 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:52:15.349 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:52:15.349 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:52:15.349 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:52:15.349 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:52:16.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:52:15 smithi157 bash[24585]: audit 2024-09-16T07:52:14.940748+0000 mgr.a (mgr.14373) 5848 : audit [DBG] from='client.135189 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:52:16.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:52:15 smithi086 bash[24289]: audit 2024-09-16T07:52:14.940748+0000 mgr.a (mgr.14373) 5848 : audit [DBG] from='client.135189 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:52:16.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:52:15 smithi047 bash[22744]: audit 2024-09-16T07:52:14.940748+0000 mgr.a (mgr.14373) 5848 : audit [DBG] from='client.135189 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:52:17.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:52:16 smithi157 bash[24585]: cluster 2024-09-16T07:52:15.414807+0000 mgr.a (mgr.14373) 5849 : cluster [DBG] pgmap v4055: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:52:17.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:52:16 smithi086 bash[24289]: cluster 2024-09-16T07:52:15.414807+0000 mgr.a (mgr.14373) 5849 : cluster [DBG] pgmap v4055: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:52:17.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:52:16 smithi047 bash[22744]: cluster 2024-09-16T07:52:15.414807+0000 mgr.a (mgr.14373) 5849 : cluster [DBG] pgmap v4055: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:52:19.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:52:18 smithi157 bash[24585]: cluster 2024-09-16T07:52:17.416970+0000 mgr.a (mgr.14373) 5850 : cluster [DBG] pgmap v4056: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:52:19.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:52:18 smithi086 bash[24289]: cluster 2024-09-16T07:52:17.416970+0000 mgr.a (mgr.14373) 5850 : cluster [DBG] pgmap v4056: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:52:19.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:52:18 smithi047 bash[22744]: cluster 2024-09-16T07:52:17.416970+0000 mgr.a (mgr.14373) 5850 : cluster [DBG] pgmap v4056: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:52:20.350 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:52:20.351 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:52:20.351 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:52:21.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:52:20 smithi157 bash[24585]: cluster 2024-09-16T07:52:19.417706+0000 mgr.a (mgr.14373) 5851 : cluster [DBG] pgmap v4057: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:52:21.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:52:20 smithi086 bash[24289]: cluster 2024-09-16T07:52:19.417706+0000 mgr.a (mgr.14373) 5851 : cluster [DBG] pgmap v4057: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:52:21.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:52:20 smithi047 bash[22744]: cluster 2024-09-16T07:52:19.417706+0000 mgr.a (mgr.14373) 5851 : cluster [DBG] pgmap v4057: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:52:21.111 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:52:21.112 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:52:21.112 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:52:21.112 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:52:21.112 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:52:22.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:52:21 smithi157 bash[24585]: audit 2024-09-16T07:52:20.690091+0000 mgr.a (mgr.14373) 5852 : audit [DBG] from='client.135264 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:52:22.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:52:21 smithi086 bash[24289]: audit 2024-09-16T07:52:20.690091+0000 mgr.a (mgr.14373) 5852 : audit [DBG] from='client.135264 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:52:22.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:52:21 smithi047 bash[22744]: audit 2024-09-16T07:52:20.690091+0000 mgr.a (mgr.14373) 5852 : audit [DBG] from='client.135264 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:52:23.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:52:22 smithi157 bash[24585]: cluster 2024-09-16T07:52:21.418657+0000 mgr.a (mgr.14373) 5853 : cluster [DBG] pgmap v4058: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:52:23.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:52:22 smithi086 bash[24289]: cluster 2024-09-16T07:52:21.418657+0000 mgr.a (mgr.14373) 5853 : cluster [DBG] pgmap v4058: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:52:23.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:52:22 smithi047 bash[22744]: cluster 2024-09-16T07:52:21.418657+0000 mgr.a (mgr.14373) 5853 : cluster [DBG] pgmap v4058: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:52:25.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:52:24 smithi157 bash[24585]: cluster 2024-09-16T07:52:23.420926+0000 mgr.a (mgr.14373) 5854 : cluster [DBG] pgmap v4059: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:52:25.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:52:24 smithi086 bash[24289]: cluster 2024-09-16T07:52:23.420926+0000 mgr.a (mgr.14373) 5854 : cluster [DBG] pgmap v4059: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:52:25.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:52:24 smithi047 bash[22744]: cluster 2024-09-16T07:52:23.420926+0000 mgr.a (mgr.14373) 5854 : cluster [DBG] pgmap v4059: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:52:26.113 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:52:26.114 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:52:26.114 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:52:26.878 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:52:26.878 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:52:26.878 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:52:26.879 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:52:26.879 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:52:27.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:52:26 smithi157 bash[24585]: cluster 2024-09-16T07:52:25.421682+0000 mgr.a (mgr.14373) 5855 : cluster [DBG] pgmap v4060: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:52:27.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:52:26 smithi086 bash[24289]: cluster 2024-09-16T07:52:25.421682+0000 mgr.a (mgr.14373) 5855 : cluster [DBG] pgmap v4060: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:52:27.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:52:26 smithi047 bash[22744]: cluster 2024-09-16T07:52:25.421682+0000 mgr.a (mgr.14373) 5855 : cluster [DBG] pgmap v4060: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:52:28.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:52:27 smithi157 bash[24585]: audit 2024-09-16T07:52:26.455008+0000 mgr.a (mgr.14373) 5856 : audit [DBG] from='client.135342 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:52:28.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:52:27 smithi086 bash[24289]: audit 2024-09-16T07:52:26.455008+0000 mgr.a (mgr.14373) 5856 : audit [DBG] from='client.135342 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:52:28.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:52:27 smithi047 bash[22744]: audit 2024-09-16T07:52:26.455008+0000 mgr.a (mgr.14373) 5856 : audit [DBG] from='client.135342 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:52:29.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:52:28 smithi157 bash[24585]: cluster 2024-09-16T07:52:27.424365+0000 mgr.a (mgr.14373) 5857 : cluster [DBG] pgmap v4061: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:52:29.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:52:28 smithi086 bash[24289]: cluster 2024-09-16T07:52:27.424365+0000 mgr.a (mgr.14373) 5857 : cluster [DBG] pgmap v4061: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:52:29.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:52:28 smithi047 bash[22744]: cluster 2024-09-16T07:52:27.424365+0000 mgr.a (mgr.14373) 5857 : cluster [DBG] pgmap v4061: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:52:31.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:52:30 smithi157 bash[24585]: cluster 2024-09-16T07:52:29.425125+0000 mgr.a (mgr.14373) 5858 : cluster [DBG] pgmap v4062: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:52:31.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:52:30 smithi086 bash[24289]: cluster 2024-09-16T07:52:29.425125+0000 mgr.a (mgr.14373) 5858 : cluster [DBG] pgmap v4062: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:52:31.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:52:30 smithi047 bash[22744]: cluster 2024-09-16T07:52:29.425125+0000 mgr.a (mgr.14373) 5858 : cluster [DBG] pgmap v4062: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:52:31.880 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:52:31.881 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:52:31.881 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:52:32.658 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:52:32.658 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:52:32.658 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:52:32.658 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:52:32.658 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:52:33.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:52:32 smithi157 bash[24585]: cluster 2024-09-16T07:52:31.426021+0000 mgr.a (mgr.14373) 5859 : cluster [DBG] pgmap v4063: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T07:52:33.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:52:32 smithi086 bash[24289]: cluster 2024-09-16T07:52:31.426021+0000 mgr.a (mgr.14373) 5859 : cluster [DBG] pgmap v4063: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T07:52:33.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:52:32 smithi047 bash[22744]: cluster 2024-09-16T07:52:31.426021+0000 mgr.a (mgr.14373) 5859 : cluster [DBG] pgmap v4063: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T07:52:34.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:52:33 smithi157 bash[24585]: audit 2024-09-16T07:52:32.218583+0000 mgr.a (mgr.14373) 5860 : audit [DBG] from='client.135420 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:52:34.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:52:33 smithi086 bash[24289]: audit 2024-09-16T07:52:32.218583+0000 mgr.a (mgr.14373) 5860 : audit [DBG] from='client.135420 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:52:34.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:52:33 smithi047 bash[22744]: audit 2024-09-16T07:52:32.218583+0000 mgr.a (mgr.14373) 5860 : audit [DBG] from='client.135420 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:52:35.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:52:34 smithi157 bash[24585]: cluster 2024-09-16T07:52:33.428745+0000 mgr.a (mgr.14373) 5861 : cluster [DBG] pgmap v4064: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:52:35.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:52:34 smithi086 bash[24289]: cluster 2024-09-16T07:52:33.428745+0000 mgr.a (mgr.14373) 5861 : cluster [DBG] pgmap v4064: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:52:35.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:52:34 smithi047 bash[22744]: cluster 2024-09-16T07:52:33.428745+0000 mgr.a (mgr.14373) 5861 : cluster [DBG] pgmap v4064: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:52:37.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:52:36 smithi157 bash[24585]: cluster 2024-09-16T07:52:35.429530+0000 mgr.a (mgr.14373) 5862 : cluster [DBG] pgmap v4065: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:52:37.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:52:36 smithi086 bash[24289]: cluster 2024-09-16T07:52:35.429530+0000 mgr.a (mgr.14373) 5862 : cluster [DBG] pgmap v4065: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:52:37.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:52:36 smithi047 bash[22744]: cluster 2024-09-16T07:52:35.429530+0000 mgr.a (mgr.14373) 5862 : cluster [DBG] pgmap v4065: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:52:37.659 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:52:37.660 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:52:37.660 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:52:38.413 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:52:38.413 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:52:38.413 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:52:38.413 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:52:38.414 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:52:39.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:52:38 smithi157 bash[24585]: cluster 2024-09-16T07:52:37.431585+0000 mgr.a (mgr.14373) 5863 : cluster [DBG] pgmap v4066: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:52:39.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:52:38 smithi157 bash[24585]: audit 2024-09-16T07:52:37.998338+0000 mgr.a (mgr.14373) 5864 : audit [DBG] from='client.135498 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:52:39.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:52:38 smithi086 bash[24289]: cluster 2024-09-16T07:52:37.431585+0000 mgr.a (mgr.14373) 5863 : cluster [DBG] pgmap v4066: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:52:39.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:52:38 smithi086 bash[24289]: audit 2024-09-16T07:52:37.998338+0000 mgr.a (mgr.14373) 5864 : audit [DBG] from='client.135498 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:52:39.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:52:38 smithi047 bash[22744]: cluster 2024-09-16T07:52:37.431585+0000 mgr.a (mgr.14373) 5863 : cluster [DBG] pgmap v4066: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:52:39.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:52:38 smithi047 bash[22744]: audit 2024-09-16T07:52:37.998338+0000 mgr.a (mgr.14373) 5864 : audit [DBG] from='client.135498 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:52:41.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:52:40 smithi157 bash[24585]: cluster 2024-09-16T07:52:39.432499+0000 mgr.a (mgr.14373) 5865 : cluster [DBG] pgmap v4067: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:52:41.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:52:40 smithi086 bash[24289]: cluster 2024-09-16T07:52:39.432499+0000 mgr.a (mgr.14373) 5865 : cluster [DBG] pgmap v4067: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:52:41.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:52:40 smithi047 bash[22744]: cluster 2024-09-16T07:52:39.432499+0000 mgr.a (mgr.14373) 5865 : cluster [DBG] pgmap v4067: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:52:43.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:52:42 smithi157 bash[24585]: cluster 2024-09-16T07:52:41.434610+0000 mgr.a (mgr.14373) 5866 : cluster [DBG] pgmap v4068: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:52:43.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:52:42 smithi086 bash[24289]: cluster 2024-09-16T07:52:41.434610+0000 mgr.a (mgr.14373) 5866 : cluster [DBG] pgmap v4068: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:52:43.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:52:42 smithi047 bash[22744]: cluster 2024-09-16T07:52:41.434610+0000 mgr.a (mgr.14373) 5866 : cluster [DBG] pgmap v4068: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:52:43.414 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:52:43.415 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:52:43.415 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:52:44.201 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:52:44.201 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:52:44.201 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:52:44.201 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:52:44.202 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:52:45.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:52:44 smithi157 bash[24585]: cluster 2024-09-16T07:52:43.435367+0000 mgr.a (mgr.14373) 5867 : cluster [DBG] pgmap v4069: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:52:45.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:52:44 smithi157 bash[24585]: audit 2024-09-16T07:52:43.755086+0000 mgr.a (mgr.14373) 5868 : audit [DBG] from='client.135573 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:52:45.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:52:44 smithi086 bash[24289]: cluster 2024-09-16T07:52:43.435367+0000 mgr.a (mgr.14373) 5867 : cluster [DBG] pgmap v4069: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:52:45.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:52:44 smithi086 bash[24289]: audit 2024-09-16T07:52:43.755086+0000 mgr.a (mgr.14373) 5868 : audit [DBG] from='client.135573 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:52:45.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:52:44 smithi047 bash[22744]: cluster 2024-09-16T07:52:43.435367+0000 mgr.a (mgr.14373) 5867 : cluster [DBG] pgmap v4069: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:52:45.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:52:44 smithi047 bash[22744]: audit 2024-09-16T07:52:43.755086+0000 mgr.a (mgr.14373) 5868 : audit [DBG] from='client.135573 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:52:47.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:52:46 smithi157 bash[24585]: cluster 2024-09-16T07:52:45.436272+0000 mgr.a (mgr.14373) 5869 : cluster [DBG] pgmap v4070: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:52:47.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:52:46 smithi086 bash[24289]: cluster 2024-09-16T07:52:45.436272+0000 mgr.a (mgr.14373) 5869 : cluster [DBG] pgmap v4070: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:52:47.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:52:46 smithi047 bash[22744]: cluster 2024-09-16T07:52:45.436272+0000 mgr.a (mgr.14373) 5869 : cluster [DBG] pgmap v4070: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:52:49.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:52:48 smithi157 bash[24585]: cluster 2024-09-16T07:52:47.438524+0000 mgr.a (mgr.14373) 5870 : cluster [DBG] pgmap v4071: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:52:49.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:52:48 smithi086 bash[24289]: cluster 2024-09-16T07:52:47.438524+0000 mgr.a (mgr.14373) 5870 : cluster [DBG] pgmap v4071: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:52:49.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:52:48 smithi047 bash[22744]: cluster 2024-09-16T07:52:47.438524+0000 mgr.a (mgr.14373) 5870 : cluster [DBG] pgmap v4071: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:52:49.200 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:52:49.201 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:52:49.201 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:52:49.953 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:52:49.953 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:52:49.953 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:52:49.954 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:52:49.954 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:52:51.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:52:50 smithi157 bash[24585]: cluster 2024-09-16T07:52:49.439282+0000 mgr.a (mgr.14373) 5871 : cluster [DBG] pgmap v4072: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:52:51.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:52:50 smithi157 bash[24585]: audit 2024-09-16T07:52:49.534474+0000 mgr.a (mgr.14373) 5872 : audit [DBG] from='client.135648 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:52:51.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:52:50 smithi086 bash[24289]: cluster 2024-09-16T07:52:49.439282+0000 mgr.a (mgr.14373) 5871 : cluster [DBG] pgmap v4072: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:52:51.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:52:50 smithi086 bash[24289]: audit 2024-09-16T07:52:49.534474+0000 mgr.a (mgr.14373) 5872 : audit [DBG] from='client.135648 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:52:51.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:52:50 smithi047 bash[22744]: cluster 2024-09-16T07:52:49.439282+0000 mgr.a (mgr.14373) 5871 : cluster [DBG] pgmap v4072: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:52:51.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:52:50 smithi047 bash[22744]: audit 2024-09-16T07:52:49.534474+0000 mgr.a (mgr.14373) 5872 : audit [DBG] from='client.135648 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:52:52.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:52:51 smithi157 bash[24585]: audit 2024-09-16T07:52:51.279696+0000 mon.b (mon.2) 566 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T07:52:52.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:52:51 smithi086 bash[24289]: audit 2024-09-16T07:52:51.279696+0000 mon.b (mon.2) 566 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T07:52:52.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:52:51 smithi047 bash[22744]: audit 2024-09-16T07:52:51.279696+0000 mon.b (mon.2) 566 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T07:52:53.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:52:52 smithi157 bash[24585]: cluster 2024-09-16T07:52:51.441678+0000 mgr.a (mgr.14373) 5873 : cluster [DBG] pgmap v4073: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:52:53.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:52:52 smithi157 bash[24585]: audit 2024-09-16T07:52:52.144896+0000 mon.b (mon.2) 567 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T07:52:53.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:52:52 smithi157 bash[24585]: audit 2024-09-16T07:52:52.147088+0000 mon.b (mon.2) 568 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T07:52:53.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:52:52 smithi157 bash[24585]: audit 2024-09-16T07:52:52.160920+0000 mon.a (mon.0) 919 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:52:53.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:52:52 smithi157 bash[24585]: audit 2024-09-16T07:52:52.164469+0000 mon.b (mon.2) 569 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:52:53.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:52:52 smithi086 bash[24289]: cluster 2024-09-16T07:52:51.441678+0000 mgr.a (mgr.14373) 5873 : cluster [DBG] pgmap v4073: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:52:53.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:52:52 smithi086 bash[24289]: audit 2024-09-16T07:52:52.144896+0000 mon.b (mon.2) 567 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T07:52:53.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:52:52 smithi086 bash[24289]: audit 2024-09-16T07:52:52.147088+0000 mon.b (mon.2) 568 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T07:52:53.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:52:52 smithi086 bash[24289]: audit 2024-09-16T07:52:52.160920+0000 mon.a (mon.0) 919 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:52:53.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:52:52 smithi086 bash[24289]: audit 2024-09-16T07:52:52.164469+0000 mon.b (mon.2) 569 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:52:53.087 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 07:52:52 smithi047 bash[22994]: debug 2024-09-16T07:52:52.892+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T07:52:53.088 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 07:52:52 smithi047 bash[22994]: debug 2024-09-16T07:52:52.896+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T07:52:53.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:52:52 smithi047 bash[22744]: cluster 2024-09-16T07:52:51.441678+0000 mgr.a (mgr.14373) 5873 : cluster [DBG] pgmap v4073: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:52:53.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:52:52 smithi047 bash[22744]: audit 2024-09-16T07:52:52.144896+0000 mon.b (mon.2) 567 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T07:52:53.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:52:52 smithi047 bash[22744]: audit 2024-09-16T07:52:52.147088+0000 mon.b (mon.2) 568 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T07:52:53.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:52:52 smithi047 bash[22744]: audit 2024-09-16T07:52:52.160920+0000 mon.a (mon.0) 919 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:52:53.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:52:52 smithi047 bash[22744]: audit 2024-09-16T07:52:52.164469+0000 mon.b (mon.2) 569 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:52:54.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:52:53 smithi157 bash[24585]: audit 2024-09-16T07:52:52.168870+0000 mgr.a (mgr.14373) 5874 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:52:54.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:52:53 smithi157 bash[24585]: audit 2024-09-16T07:52:52.896785+0000 mgr.a (mgr.14373) 5875 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T07:52:54.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:52:53 smithi157 bash[24585]: cephadm 2024-09-16T07:52:52.898547+0000 mgr.a (mgr.14373) 5876 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T07:52:54.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:52:53 smithi086 bash[24289]: audit 2024-09-16T07:52:52.168870+0000 mgr.a (mgr.14373) 5874 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:52:54.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:52:53 smithi086 bash[24289]: audit 2024-09-16T07:52:52.896785+0000 mgr.a (mgr.14373) 5875 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T07:52:54.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:52:53 smithi086 bash[24289]: cephadm 2024-09-16T07:52:52.898547+0000 mgr.a (mgr.14373) 5876 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T07:52:54.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:52:53 smithi047 bash[22744]: audit 2024-09-16T07:52:52.168870+0000 mgr.a (mgr.14373) 5874 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:52:54.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:52:53 smithi047 bash[22744]: audit 2024-09-16T07:52:52.896785+0000 mgr.a (mgr.14373) 5875 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T07:52:54.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:52:53 smithi047 bash[22744]: cephadm 2024-09-16T07:52:52.898547+0000 mgr.a (mgr.14373) 5876 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T07:52:54.954 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:52:54.955 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:52:54.955 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:52:55.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:52:54 smithi157 bash[24585]: cluster 2024-09-16T07:52:53.442634+0000 mgr.a (mgr.14373) 5877 : cluster [DBG] pgmap v4074: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:52:55.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:52:54 smithi086 bash[24289]: cluster 2024-09-16T07:52:53.442634+0000 mgr.a (mgr.14373) 5877 : cluster [DBG] pgmap v4074: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:52:55.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:52:54 smithi047 bash[22744]: cluster 2024-09-16T07:52:53.442634+0000 mgr.a (mgr.14373) 5877 : cluster [DBG] pgmap v4074: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:52:55.729 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:52:55.729 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:52:55.729 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:52:55.730 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:52:55.730 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:52:57.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:52:56 smithi157 bash[24585]: audit 2024-09-16T07:52:55.292881+0000 mgr.a (mgr.14373) 5878 : audit [DBG] from='client.135828 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:52:57.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:52:56 smithi157 bash[24585]: cluster 2024-09-16T07:52:55.443331+0000 mgr.a (mgr.14373) 5879 : cluster [DBG] pgmap v4075: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:52:57.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:52:56 smithi086 bash[24289]: audit 2024-09-16T07:52:55.292881+0000 mgr.a (mgr.14373) 5878 : audit [DBG] from='client.135828 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:52:57.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:52:56 smithi086 bash[24289]: cluster 2024-09-16T07:52:55.443331+0000 mgr.a (mgr.14373) 5879 : cluster [DBG] pgmap v4075: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:52:57.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:52:56 smithi047 bash[22744]: audit 2024-09-16T07:52:55.292881+0000 mgr.a (mgr.14373) 5878 : audit [DBG] from='client.135828 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:52:57.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:52:56 smithi047 bash[22744]: cluster 2024-09-16T07:52:55.443331+0000 mgr.a (mgr.14373) 5879 : cluster [DBG] pgmap v4075: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:52:59.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:52:58 smithi157 bash[24585]: cluster 2024-09-16T07:52:57.445641+0000 mgr.a (mgr.14373) 5880 : cluster [DBG] pgmap v4076: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:52:59.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:52:58 smithi086 bash[24289]: cluster 2024-09-16T07:52:57.445641+0000 mgr.a (mgr.14373) 5880 : cluster [DBG] pgmap v4076: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:52:59.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:52:58 smithi047 bash[22744]: cluster 2024-09-16T07:52:57.445641+0000 mgr.a (mgr.14373) 5880 : cluster [DBG] pgmap v4076: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:53:00.731 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:53:00.732 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:53:00.732 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:53:01.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:53:00 smithi157 bash[24585]: cluster 2024-09-16T07:52:59.446419+0000 mgr.a (mgr.14373) 5881 : cluster [DBG] pgmap v4077: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:53:01.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:53:00 smithi086 bash[24289]: cluster 2024-09-16T07:52:59.446419+0000 mgr.a (mgr.14373) 5881 : cluster [DBG] pgmap v4077: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:53:01.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:53:00 smithi047 bash[22744]: cluster 2024-09-16T07:52:59.446419+0000 mgr.a (mgr.14373) 5881 : cluster [DBG] pgmap v4077: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:53:01.505 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:53:01.505 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:53:01.506 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:53:01.506 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:53:01.506 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:53:02.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:53:01 smithi157 bash[24585]: audit 2024-09-16T07:53:01.074642+0000 mgr.a (mgr.14373) 5882 : audit [DBG] from='client.135903 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:53:02.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:53:01 smithi086 bash[24289]: audit 2024-09-16T07:53:01.074642+0000 mgr.a (mgr.14373) 5882 : audit [DBG] from='client.135903 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:53:02.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:53:01 smithi047 bash[22744]: audit 2024-09-16T07:53:01.074642+0000 mgr.a (mgr.14373) 5882 : audit [DBG] from='client.135903 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:53:03.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:53:02 smithi157 bash[24585]: cluster 2024-09-16T07:53:01.449077+0000 mgr.a (mgr.14373) 5883 : cluster [DBG] pgmap v4078: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:53:03.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:53:02 smithi086 bash[24289]: cluster 2024-09-16T07:53:01.449077+0000 mgr.a (mgr.14373) 5883 : cluster [DBG] pgmap v4078: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:53:03.366 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:53:02 smithi047 bash[22744]: cluster 2024-09-16T07:53:01.449077+0000 mgr.a (mgr.14373) 5883 : cluster [DBG] pgmap v4078: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:53:05.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:53:04 smithi157 bash[24585]: cluster 2024-09-16T07:53:03.449884+0000 mgr.a (mgr.14373) 5884 : cluster [DBG] pgmap v4079: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T07:53:05.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:53:04 smithi086 bash[24289]: cluster 2024-09-16T07:53:03.449884+0000 mgr.a (mgr.14373) 5884 : cluster [DBG] pgmap v4079: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T07:53:05.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:53:04 smithi047 bash[22744]: cluster 2024-09-16T07:53:03.449884+0000 mgr.a (mgr.14373) 5884 : cluster [DBG] pgmap v4079: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T07:53:06.507 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:53:06.508 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:53:06.508 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:53:07.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:53:06 smithi157 bash[24585]: cluster 2024-09-16T07:53:05.450691+0000 mgr.a (mgr.14373) 5885 : cluster [DBG] pgmap v4080: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T07:53:07.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:53:06 smithi086 bash[24289]: cluster 2024-09-16T07:53:05.450691+0000 mgr.a (mgr.14373) 5885 : cluster [DBG] pgmap v4080: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T07:53:07.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:53:06 smithi047 bash[22744]: cluster 2024-09-16T07:53:05.450691+0000 mgr.a (mgr.14373) 5885 : cluster [DBG] pgmap v4080: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T07:53:07.276 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:53:07.277 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:53:07.277 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:53:07.277 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:53:07.277 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:53:08.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:53:07 smithi157 bash[24585]: audit 2024-09-16T07:53:06.848025+0000 mgr.a (mgr.14373) 5886 : audit [DBG] from='client.135981 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:53:08.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:53:07 smithi086 bash[24289]: audit 2024-09-16T07:53:06.848025+0000 mgr.a (mgr.14373) 5886 : audit [DBG] from='client.135981 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:53:08.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:53:07 smithi047 bash[22744]: audit 2024-09-16T07:53:06.848025+0000 mgr.a (mgr.14373) 5886 : audit [DBG] from='client.135981 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:53:09.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:53:08 smithi157 bash[24585]: cluster 2024-09-16T07:53:07.453354+0000 mgr.a (mgr.14373) 5887 : cluster [DBG] pgmap v4081: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:53:09.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:53:08 smithi086 bash[24289]: cluster 2024-09-16T07:53:07.453354+0000 mgr.a (mgr.14373) 5887 : cluster [DBG] pgmap v4081: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:53:09.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:53:08 smithi047 bash[22744]: cluster 2024-09-16T07:53:07.453354+0000 mgr.a (mgr.14373) 5887 : cluster [DBG] pgmap v4081: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:53:11.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:53:10 smithi157 bash[24585]: cluster 2024-09-16T07:53:09.454094+0000 mgr.a (mgr.14373) 5888 : cluster [DBG] pgmap v4082: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:53:11.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:53:10 smithi086 bash[24289]: cluster 2024-09-16T07:53:09.454094+0000 mgr.a (mgr.14373) 5888 : cluster [DBG] pgmap v4082: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:53:11.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:53:10 smithi047 bash[22744]: cluster 2024-09-16T07:53:09.454094+0000 mgr.a (mgr.14373) 5888 : cluster [DBG] pgmap v4082: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:53:12.278 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:53:12.279 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:53:12.279 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:53:13.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:53:12 smithi157 bash[24585]: cluster 2024-09-16T07:53:11.456149+0000 mgr.a (mgr.14373) 5889 : cluster [DBG] pgmap v4083: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:53:13.065 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:53:13.065 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:53:13.065 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:53:13.065 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:53:13.065 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:53:13.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:53:12 smithi086 bash[24289]: cluster 2024-09-16T07:53:11.456149+0000 mgr.a (mgr.14373) 5889 : cluster [DBG] pgmap v4083: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:53:13.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:53:12 smithi047 bash[22744]: cluster 2024-09-16T07:53:11.456149+0000 mgr.a (mgr.14373) 5889 : cluster [DBG] pgmap v4083: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:53:14.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:53:13 smithi157 bash[24585]: audit 2024-09-16T07:53:12.622724+0000 mgr.a (mgr.14373) 5890 : audit [DBG] from='client.136059 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:53:14.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:53:13 smithi086 bash[24289]: audit 2024-09-16T07:53:12.622724+0000 mgr.a (mgr.14373) 5890 : audit [DBG] from='client.136059 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:53:14.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:53:13 smithi047 bash[22744]: audit 2024-09-16T07:53:12.622724+0000 mgr.a (mgr.14373) 5890 : audit [DBG] from='client.136059 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:53:15.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:53:14 smithi157 bash[24585]: cluster 2024-09-16T07:53:13.457101+0000 mgr.a (mgr.14373) 5891 : cluster [DBG] pgmap v4084: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-16T07:53:15.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:53:14 smithi086 bash[24289]: cluster 2024-09-16T07:53:13.457101+0000 mgr.a (mgr.14373) 5891 : cluster [DBG] pgmap v4084: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-16T07:53:15.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:53:14 smithi047 bash[22744]: cluster 2024-09-16T07:53:13.457101+0000 mgr.a (mgr.14373) 5891 : cluster [DBG] pgmap v4084: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-16T07:53:17.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:53:16 smithi157 bash[24585]: cluster 2024-09-16T07:53:15.457884+0000 mgr.a (mgr.14373) 5892 : cluster [DBG] pgmap v4085: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-16T07:53:17.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:53:16 smithi086 bash[24289]: cluster 2024-09-16T07:53:15.457884+0000 mgr.a (mgr.14373) 5892 : cluster [DBG] pgmap v4085: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-16T07:53:17.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:53:16 smithi047 bash[22744]: cluster 2024-09-16T07:53:15.457884+0000 mgr.a (mgr.14373) 5892 : cluster [DBG] pgmap v4085: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-16T07:53:18.066 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:53:18.067 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:53:18.067 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:53:18.819 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:53:18.820 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:53:18.820 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:53:18.820 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:53:18.820 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:53:19.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:53:18 smithi157 bash[24585]: cluster 2024-09-16T07:53:17.460111+0000 mgr.a (mgr.14373) 5893 : cluster [DBG] pgmap v4086: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-16T07:53:19.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:53:18 smithi086 bash[24289]: cluster 2024-09-16T07:53:17.460111+0000 mgr.a (mgr.14373) 5893 : cluster [DBG] pgmap v4086: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-16T07:53:19.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:53:18 smithi047 bash[22744]: cluster 2024-09-16T07:53:17.460111+0000 mgr.a (mgr.14373) 5893 : cluster [DBG] pgmap v4086: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-16T07:53:20.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:53:19 smithi157 bash[24585]: audit 2024-09-16T07:53:18.402037+0000 mgr.a (mgr.14373) 5894 : audit [DBG] from='client.136128 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:53:20.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:53:19 smithi086 bash[24289]: audit 2024-09-16T07:53:18.402037+0000 mgr.a (mgr.14373) 5894 : audit [DBG] from='client.136128 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:53:20.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:53:19 smithi047 bash[22744]: audit 2024-09-16T07:53:18.402037+0000 mgr.a (mgr.14373) 5894 : audit [DBG] from='client.136128 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:53:21.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:53:20 smithi157 bash[24585]: cluster 2024-09-16T07:53:19.461035+0000 mgr.a (mgr.14373) 5895 : cluster [DBG] pgmap v4087: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:53:21.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:53:20 smithi086 bash[24289]: cluster 2024-09-16T07:53:19.461035+0000 mgr.a (mgr.14373) 5895 : cluster [DBG] pgmap v4087: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:53:21.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:53:20 smithi047 bash[22744]: cluster 2024-09-16T07:53:19.461035+0000 mgr.a (mgr.14373) 5895 : cluster [DBG] pgmap v4087: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:53:23.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:53:22 smithi086 bash[24289]: cluster 2024-09-16T07:53:21.463192+0000 mgr.a (mgr.14373) 5896 : cluster [DBG] pgmap v4088: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:53:23.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:53:22 smithi047 bash[22744]: cluster 2024-09-16T07:53:21.463192+0000 mgr.a (mgr.14373) 5896 : cluster [DBG] pgmap v4088: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:53:23.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:53:22 smithi157 bash[24585]: cluster 2024-09-16T07:53:21.463192+0000 mgr.a (mgr.14373) 5896 : cluster [DBG] pgmap v4088: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:53:23.821 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:53:23.822 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:53:23.822 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:53:24.574 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:53:24.574 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:53:24.574 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:53:24.574 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:53:24.574 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:53:25.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:53:24 smithi086 bash[24289]: cluster 2024-09-16T07:53:23.463976+0000 mgr.a (mgr.14373) 5897 : cluster [DBG] pgmap v4089: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:53:25.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:53:24 smithi086 bash[24289]: audit 2024-09-16T07:53:24.150415+0000 mgr.a (mgr.14373) 5898 : audit [DBG] from='client.136206 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:53:25.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:53:24 smithi047 bash[22744]: cluster 2024-09-16T07:53:23.463976+0000 mgr.a (mgr.14373) 5897 : cluster [DBG] pgmap v4089: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:53:25.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:53:24 smithi047 bash[22744]: audit 2024-09-16T07:53:24.150415+0000 mgr.a (mgr.14373) 5898 : audit [DBG] from='client.136206 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:53:25.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:53:24 smithi157 bash[24585]: cluster 2024-09-16T07:53:23.463976+0000 mgr.a (mgr.14373) 5897 : cluster [DBG] pgmap v4089: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:53:25.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:53:24 smithi157 bash[24585]: audit 2024-09-16T07:53:24.150415+0000 mgr.a (mgr.14373) 5898 : audit [DBG] from='client.136206 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:53:27.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:53:26 smithi086 bash[24289]: cluster 2024-09-16T07:53:25.464987+0000 mgr.a (mgr.14373) 5899 : cluster [DBG] pgmap v4090: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:53:27.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:53:26 smithi047 bash[22744]: cluster 2024-09-16T07:53:25.464987+0000 mgr.a (mgr.14373) 5899 : cluster [DBG] pgmap v4090: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:53:27.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:53:26 smithi157 bash[24585]: cluster 2024-09-16T07:53:25.464987+0000 mgr.a (mgr.14373) 5899 : cluster [DBG] pgmap v4090: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:53:29.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:53:28 smithi047 bash[22744]: cluster 2024-09-16T07:53:27.467269+0000 mgr.a (mgr.14373) 5900 : cluster [DBG] pgmap v4091: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:53:29.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:53:28 smithi157 bash[24585]: cluster 2024-09-16T07:53:27.467269+0000 mgr.a (mgr.14373) 5900 : cluster [DBG] pgmap v4091: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:53:29.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:53:28 smithi086 bash[24289]: cluster 2024-09-16T07:53:27.467269+0000 mgr.a (mgr.14373) 5900 : cluster [DBG] pgmap v4091: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:53:29.575 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:53:29.576 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:53:29.576 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:53:30.352 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:53:30.352 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:53:30.352 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:53:30.352 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:53:30.353 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:53:31.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:53:30 smithi047 bash[22744]: cluster 2024-09-16T07:53:29.468033+0000 mgr.a (mgr.14373) 5901 : cluster [DBG] pgmap v4092: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:53:31.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:53:30 smithi047 bash[22744]: audit 2024-09-16T07:53:29.921053+0000 mgr.a (mgr.14373) 5902 : audit [DBG] from='client.136281 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:53:31.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:53:30 smithi157 bash[24585]: cluster 2024-09-16T07:53:29.468033+0000 mgr.a (mgr.14373) 5901 : cluster [DBG] pgmap v4092: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:53:31.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:53:30 smithi157 bash[24585]: audit 2024-09-16T07:53:29.921053+0000 mgr.a (mgr.14373) 5902 : audit [DBG] from='client.136281 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:53:31.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:53:30 smithi086 bash[24289]: cluster 2024-09-16T07:53:29.468033+0000 mgr.a (mgr.14373) 5901 : cluster [DBG] pgmap v4092: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:53:31.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:53:30 smithi086 bash[24289]: audit 2024-09-16T07:53:29.921053+0000 mgr.a (mgr.14373) 5902 : audit [DBG] from='client.136281 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:53:33.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:53:32 smithi047 bash[22744]: cluster 2024-09-16T07:53:31.470374+0000 mgr.a (mgr.14373) 5903 : cluster [DBG] pgmap v4093: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:53:33.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:53:32 smithi157 bash[24585]: cluster 2024-09-16T07:53:31.470374+0000 mgr.a (mgr.14373) 5903 : cluster [DBG] pgmap v4093: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:53:33.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:53:32 smithi086 bash[24289]: cluster 2024-09-16T07:53:31.470374+0000 mgr.a (mgr.14373) 5903 : cluster [DBG] pgmap v4093: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:53:35.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:53:34 smithi047 bash[22744]: cluster 2024-09-16T07:53:33.471174+0000 mgr.a (mgr.14373) 5904 : cluster [DBG] pgmap v4094: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:53:35.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:53:34 smithi157 bash[24585]: cluster 2024-09-16T07:53:33.471174+0000 mgr.a (mgr.14373) 5904 : cluster [DBG] pgmap v4094: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:53:35.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:53:34 smithi086 bash[24289]: cluster 2024-09-16T07:53:33.471174+0000 mgr.a (mgr.14373) 5904 : cluster [DBG] pgmap v4094: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:53:35.353 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:53:35.354 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:53:35.354 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:53:36.106 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:53:36.106 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:53:36.106 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:53:36.107 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:53:36.107 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:53:37.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:53:36 smithi047 bash[22744]: cluster 2024-09-16T07:53:35.471660+0000 mgr.a (mgr.14373) 5905 : cluster [DBG] pgmap v4095: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:53:37.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:53:36 smithi047 bash[22744]: audit 2024-09-16T07:53:35.687894+0000 mgr.a (mgr.14373) 5906 : audit [DBG] from='client.136356 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:53:37.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:53:36 smithi157 bash[24585]: cluster 2024-09-16T07:53:35.471660+0000 mgr.a (mgr.14373) 5905 : cluster [DBG] pgmap v4095: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:53:37.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:53:36 smithi157 bash[24585]: audit 2024-09-16T07:53:35.687894+0000 mgr.a (mgr.14373) 5906 : audit [DBG] from='client.136356 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:53:37.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:53:36 smithi086 bash[24289]: cluster 2024-09-16T07:53:35.471660+0000 mgr.a (mgr.14373) 5905 : cluster [DBG] pgmap v4095: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:53:37.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:53:36 smithi086 bash[24289]: audit 2024-09-16T07:53:35.687894+0000 mgr.a (mgr.14373) 5906 : audit [DBG] from='client.136356 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:53:39.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:53:38 smithi157 bash[24585]: cluster 2024-09-16T07:53:37.474071+0000 mgr.a (mgr.14373) 5907 : cluster [DBG] pgmap v4096: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:53:39.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:53:38 smithi086 bash[24289]: cluster 2024-09-16T07:53:37.474071+0000 mgr.a (mgr.14373) 5907 : cluster [DBG] pgmap v4096: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:53:39.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:53:38 smithi047 bash[22744]: cluster 2024-09-16T07:53:37.474071+0000 mgr.a (mgr.14373) 5907 : cluster [DBG] pgmap v4096: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:53:41.107 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:53:41.109 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:53:41.109 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:53:41.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:53:40 smithi157 bash[24585]: cluster 2024-09-16T07:53:39.474868+0000 mgr.a (mgr.14373) 5908 : cluster [DBG] pgmap v4097: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:53:41.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:53:40 smithi086 bash[24289]: cluster 2024-09-16T07:53:39.474868+0000 mgr.a (mgr.14373) 5908 : cluster [DBG] pgmap v4097: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:53:41.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:53:40 smithi047 bash[22744]: cluster 2024-09-16T07:53:39.474868+0000 mgr.a (mgr.14373) 5908 : cluster [DBG] pgmap v4097: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:53:41.885 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:53:41.886 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:53:41.886 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:53:41.886 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:53:41.886 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:53:43.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:53:42 smithi157 bash[24585]: audit 2024-09-16T07:53:41.444804+0000 mgr.a (mgr.14373) 5909 : audit [DBG] from='client.136434 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:53:43.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:53:42 smithi157 bash[24585]: cluster 2024-09-16T07:53:41.478133+0000 mgr.a (mgr.14373) 5910 : cluster [DBG] pgmap v4098: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:53:43.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:53:42 smithi086 bash[24289]: audit 2024-09-16T07:53:41.444804+0000 mgr.a (mgr.14373) 5909 : audit [DBG] from='client.136434 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:53:43.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:53:42 smithi086 bash[24289]: cluster 2024-09-16T07:53:41.478133+0000 mgr.a (mgr.14373) 5910 : cluster [DBG] pgmap v4098: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:53:43.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:53:42 smithi047 bash[22744]: audit 2024-09-16T07:53:41.444804+0000 mgr.a (mgr.14373) 5909 : audit [DBG] from='client.136434 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:53:43.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:53:42 smithi047 bash[22744]: cluster 2024-09-16T07:53:41.478133+0000 mgr.a (mgr.14373) 5910 : cluster [DBG] pgmap v4098: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:53:45.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:53:44 smithi157 bash[24585]: cluster 2024-09-16T07:53:43.479069+0000 mgr.a (mgr.14373) 5911 : cluster [DBG] pgmap v4099: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:53:45.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:53:44 smithi086 bash[24289]: cluster 2024-09-16T07:53:43.479069+0000 mgr.a (mgr.14373) 5911 : cluster [DBG] pgmap v4099: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:53:45.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:53:44 smithi047 bash[22744]: cluster 2024-09-16T07:53:43.479069+0000 mgr.a (mgr.14373) 5911 : cluster [DBG] pgmap v4099: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:53:46.887 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:53:46.888 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:53:46.888 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:53:47.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:53:46 smithi157 bash[24585]: cluster 2024-09-16T07:53:45.479842+0000 mgr.a (mgr.14373) 5912 : cluster [DBG] pgmap v4100: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:53:47.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:53:46 smithi086 bash[24289]: cluster 2024-09-16T07:53:45.479842+0000 mgr.a (mgr.14373) 5912 : cluster [DBG] pgmap v4100: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:53:47.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:53:46 smithi047 bash[22744]: cluster 2024-09-16T07:53:45.479842+0000 mgr.a (mgr.14373) 5912 : cluster [DBG] pgmap v4100: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:53:47.653 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:53:47.653 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:53:47.653 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:53:47.653 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:53:47.653 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:53:49.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:53:48 smithi157 bash[24585]: audit 2024-09-16T07:53:47.224462+0000 mgr.a (mgr.14373) 5913 : audit [DBG] from='client.136509 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:53:49.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:53:48 smithi157 bash[24585]: cluster 2024-09-16T07:53:47.481285+0000 mgr.a (mgr.14373) 5914 : cluster [DBG] pgmap v4101: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:53:49.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:53:48 smithi086 bash[24289]: audit 2024-09-16T07:53:47.224462+0000 mgr.a (mgr.14373) 5913 : audit [DBG] from='client.136509 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:53:49.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:53:48 smithi086 bash[24289]: cluster 2024-09-16T07:53:47.481285+0000 mgr.a (mgr.14373) 5914 : cluster [DBG] pgmap v4101: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:53:49.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:53:48 smithi047 bash[22744]: audit 2024-09-16T07:53:47.224462+0000 mgr.a (mgr.14373) 5913 : audit [DBG] from='client.136509 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:53:49.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:53:48 smithi047 bash[22744]: cluster 2024-09-16T07:53:47.481285+0000 mgr.a (mgr.14373) 5914 : cluster [DBG] pgmap v4101: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:53:51.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:53:50 smithi157 bash[24585]: cluster 2024-09-16T07:53:49.482143+0000 mgr.a (mgr.14373) 5915 : cluster [DBG] pgmap v4102: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:53:51.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:53:50 smithi086 bash[24289]: cluster 2024-09-16T07:53:49.482143+0000 mgr.a (mgr.14373) 5915 : cluster [DBG] pgmap v4102: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:53:51.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:53:50 smithi047 bash[22744]: cluster 2024-09-16T07:53:49.482143+0000 mgr.a (mgr.14373) 5915 : cluster [DBG] pgmap v4102: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:53:52.654 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:53:52.655 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:53:52.655 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:53:53.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:53:52 smithi157 bash[24585]: cluster 2024-09-16T07:53:51.484318+0000 mgr.a (mgr.14373) 5916 : cluster [DBG] pgmap v4103: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:53:53.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:53:52 smithi086 bash[24289]: cluster 2024-09-16T07:53:51.484318+0000 mgr.a (mgr.14373) 5916 : cluster [DBG] pgmap v4103: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:53:53.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:53:52 smithi047 bash[22744]: cluster 2024-09-16T07:53:51.484318+0000 mgr.a (mgr.14373) 5916 : cluster [DBG] pgmap v4103: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:53:53.482 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:53:53.482 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:53:53.482 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:53:53.482 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:53:53.483 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:53:54.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:53:53 smithi157 bash[24585]: audit 2024-09-16T07:53:52.946261+0000 mon.b (mon.2) 570 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T07:53:54.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:53:53 smithi157 bash[24585]: audit 2024-09-16T07:53:53.020388+0000 mgr.a (mgr.14373) 5917 : audit [DBG] from='client.136587 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:53:54.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:53:53 smithi157 bash[24585]: audit 2024-09-16T07:53:53.754239+0000 mon.b (mon.2) 571 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T07:53:54.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:53:53 smithi157 bash[24585]: audit 2024-09-16T07:53:53.756327+0000 mon.b (mon.2) 572 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T07:53:54.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:53:53 smithi157 bash[24585]: audit 2024-09-16T07:53:53.767721+0000 mon.a (mon.0) 920 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:53:54.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:53:53 smithi157 bash[24585]: audit 2024-09-16T07:53:53.768704+0000 mon.b (mon.2) 573 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:53:54.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:53:53 smithi086 bash[24289]: audit 2024-09-16T07:53:52.946261+0000 mon.b (mon.2) 570 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T07:53:54.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:53:53 smithi086 bash[24289]: audit 2024-09-16T07:53:53.020388+0000 mgr.a (mgr.14373) 5917 : audit [DBG] from='client.136587 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:53:54.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:53:53 smithi086 bash[24289]: audit 2024-09-16T07:53:53.754239+0000 mon.b (mon.2) 571 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T07:53:54.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:53:53 smithi086 bash[24289]: audit 2024-09-16T07:53:53.756327+0000 mon.b (mon.2) 572 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T07:53:54.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:53:53 smithi086 bash[24289]: audit 2024-09-16T07:53:53.767721+0000 mon.a (mon.0) 920 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:53:54.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:53:53 smithi086 bash[24289]: audit 2024-09-16T07:53:53.768704+0000 mon.b (mon.2) 573 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:53:54.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:53:53 smithi047 bash[22744]: audit 2024-09-16T07:53:52.946261+0000 mon.b (mon.2) 570 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T07:53:54.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:53:53 smithi047 bash[22744]: audit 2024-09-16T07:53:53.020388+0000 mgr.a (mgr.14373) 5917 : audit [DBG] from='client.136587 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:53:54.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:53:53 smithi047 bash[22744]: audit 2024-09-16T07:53:53.754239+0000 mon.b (mon.2) 571 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T07:53:54.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:53:53 smithi047 bash[22744]: audit 2024-09-16T07:53:53.756327+0000 mon.b (mon.2) 572 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T07:53:54.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:53:53 smithi047 bash[22744]: audit 2024-09-16T07:53:53.767721+0000 mon.a (mon.0) 920 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:53:54.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:53:53 smithi047 bash[22744]: audit 2024-09-16T07:53:53.768704+0000 mon.b (mon.2) 573 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:53:54.837 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 07:53:54 smithi047 bash[22994]: debug 2024-09-16T07:53:54.483+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T07:53:54.838 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 07:53:54 smithi047 bash[22994]: debug 2024-09-16T07:53:54.487+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T07:53:55.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:53:55 smithi157 bash[24585]: cluster 2024-09-16T07:53:53.484832+0000 mgr.a (mgr.14373) 5918 : cluster [DBG] pgmap v4104: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:53:55.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:53:55 smithi157 bash[24585]: audit 2024-09-16T07:53:53.772007+0000 mgr.a (mgr.14373) 5919 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:53:55.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:53:55 smithi086 bash[24289]: cluster 2024-09-16T07:53:53.484832+0000 mgr.a (mgr.14373) 5918 : cluster [DBG] pgmap v4104: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:53:55.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:53:55 smithi086 bash[24289]: audit 2024-09-16T07:53:53.772007+0000 mgr.a (mgr.14373) 5919 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:53:55.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:53:55 smithi047 bash[22744]: cluster 2024-09-16T07:53:53.484832+0000 mgr.a (mgr.14373) 5918 : cluster [DBG] pgmap v4104: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:53:55.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:53:55 smithi047 bash[22744]: audit 2024-09-16T07:53:53.772007+0000 mgr.a (mgr.14373) 5919 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:53:56.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:53:56 smithi157 bash[24585]: audit 2024-09-16T07:53:54.489067+0000 mgr.a (mgr.14373) 5920 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T07:53:56.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:53:56 smithi157 bash[24585]: cephadm 2024-09-16T07:53:54.491129+0000 mgr.a (mgr.14373) 5921 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T07:53:56.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:53:56 smithi086 bash[24289]: audit 2024-09-16T07:53:54.489067+0000 mgr.a (mgr.14373) 5920 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T07:53:56.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:53:56 smithi086 bash[24289]: cephadm 2024-09-16T07:53:54.491129+0000 mgr.a (mgr.14373) 5921 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T07:53:56.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:53:56 smithi047 bash[22744]: audit 2024-09-16T07:53:54.489067+0000 mgr.a (mgr.14373) 5920 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T07:53:56.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:53:56 smithi047 bash[22744]: cephadm 2024-09-16T07:53:54.491129+0000 mgr.a (mgr.14373) 5921 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T07:53:57.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:53:57 smithi157 bash[24585]: cluster 2024-09-16T07:53:55.485763+0000 mgr.a (mgr.14373) 5922 : cluster [DBG] pgmap v4105: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:53:57.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:53:57 smithi086 bash[24289]: cluster 2024-09-16T07:53:55.485763+0000 mgr.a (mgr.14373) 5922 : cluster [DBG] pgmap v4105: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:53:57.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:53:57 smithi047 bash[22744]: cluster 2024-09-16T07:53:55.485763+0000 mgr.a (mgr.14373) 5922 : cluster [DBG] pgmap v4105: 225 pgs: 225 active+clean; 589 KiB data, 130 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:53:58.483 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:53:58.484 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:53:58.484 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:53:59.263 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:53:59.263 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:53:59.263 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:53:59.263 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:53:59.263 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:53:59.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:53:59 smithi157 bash[24585]: cluster 2024-09-16T07:53:57.488036+0000 mgr.a (mgr.14373) 5923 : cluster [DBG] pgmap v4106: 225 pgs: 225 active+clean; 589 KiB data, 134 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:53:59.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:53:59 smithi086 bash[24289]: cluster 2024-09-16T07:53:57.488036+0000 mgr.a (mgr.14373) 5923 : cluster [DBG] pgmap v4106: 225 pgs: 225 active+clean; 589 KiB data, 134 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:53:59.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:53:59 smithi047 bash[22744]: cluster 2024-09-16T07:53:57.488036+0000 mgr.a (mgr.14373) 5923 : cluster [DBG] pgmap v4106: 225 pgs: 225 active+clean; 589 KiB data, 134 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:54:00.573 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:54:00 smithi157 bash[24585]: audit 2024-09-16T07:53:58.821028+0000 mgr.a (mgr.14373) 5924 : audit [DBG] from='client.136767 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:54:00.574 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:54:00 smithi086 bash[24289]: audit 2024-09-16T07:53:58.821028+0000 mgr.a (mgr.14373) 5924 : audit [DBG] from='client.136767 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:54:00.607 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:54:00 smithi047 bash[22744]: audit 2024-09-16T07:53:58.821028+0000 mgr.a (mgr.14373) 5924 : audit [DBG] from='client.136767 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:54:01.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:54:01 smithi157 bash[24585]: cluster 2024-09-16T07:53:59.489045+0000 mgr.a (mgr.14373) 5925 : cluster [DBG] pgmap v4107: 225 pgs: 225 active+clean; 589 KiB data, 134 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:54:01.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:54:01 smithi086 bash[24289]: cluster 2024-09-16T07:53:59.489045+0000 mgr.a (mgr.14373) 5925 : cluster [DBG] pgmap v4107: 225 pgs: 225 active+clean; 589 KiB data, 134 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:54:01.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:54:01 smithi047 bash[22744]: cluster 2024-09-16T07:53:59.489045+0000 mgr.a (mgr.14373) 5925 : cluster [DBG] pgmap v4107: 225 pgs: 225 active+clean; 589 KiB data, 134 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:54:02.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:54:02 smithi157 bash[24585]: cluster 2024-09-16T07:54:01.491263+0000 mgr.a (mgr.14373) 5926 : cluster [DBG] pgmap v4108: 225 pgs: 225 active+clean; 589 KiB data, 134 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:54:02.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:54:02 smithi086 bash[24289]: cluster 2024-09-16T07:54:01.491263+0000 mgr.a (mgr.14373) 5926 : cluster [DBG] pgmap v4108: 225 pgs: 225 active+clean; 589 KiB data, 134 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:54:02.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:54:02 smithi047 bash[22744]: cluster 2024-09-16T07:54:01.491263+0000 mgr.a (mgr.14373) 5926 : cluster [DBG] pgmap v4108: 225 pgs: 225 active+clean; 589 KiB data, 134 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:54:04.264 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:54:04.265 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:54:04.265 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:54:04.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:54:04 smithi157 bash[24585]: cluster 2024-09-16T07:54:03.492021+0000 mgr.a (mgr.14373) 5927 : cluster [DBG] pgmap v4109: 225 pgs: 225 active+clean; 589 KiB data, 134 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:54:04.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:54:04 smithi086 bash[24289]: cluster 2024-09-16T07:54:03.492021+0000 mgr.a (mgr.14373) 5927 : cluster [DBG] pgmap v4109: 225 pgs: 225 active+clean; 589 KiB data, 134 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:54:04.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:54:04 smithi047 bash[22744]: cluster 2024-09-16T07:54:03.492021+0000 mgr.a (mgr.14373) 5927 : cluster [DBG] pgmap v4109: 225 pgs: 225 active+clean; 589 KiB data, 134 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:54:05.013 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:54:05.013 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:54:05.014 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:54:05.014 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:54:05.014 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:54:05.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:54:05 smithi086 bash[24289]: audit 2024-09-16T07:54:04.601505+0000 mgr.a (mgr.14373) 5928 : audit [DBG] from='client.136842 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:54:05.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:54:05 smithi047 bash[22744]: audit 2024-09-16T07:54:04.601505+0000 mgr.a (mgr.14373) 5928 : audit [DBG] from='client.136842 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:54:06.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:54:05 smithi157 bash[24585]: audit 2024-09-16T07:54:04.601505+0000 mgr.a (mgr.14373) 5928 : audit [DBG] from='client.136842 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:54:06.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:54:06 smithi086 bash[24289]: cluster 2024-09-16T07:54:05.492961+0000 mgr.a (mgr.14373) 5929 : cluster [DBG] pgmap v4110: 225 pgs: 225 active+clean; 589 KiB data, 134 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:54:06.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:54:06 smithi047 bash[22744]: cluster 2024-09-16T07:54:05.492961+0000 mgr.a (mgr.14373) 5929 : cluster [DBG] pgmap v4110: 225 pgs: 225 active+clean; 589 KiB data, 134 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:54:07.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:54:06 smithi157 bash[24585]: cluster 2024-09-16T07:54:05.492961+0000 mgr.a (mgr.14373) 5929 : cluster [DBG] pgmap v4110: 225 pgs: 225 active+clean; 589 KiB data, 134 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:54:08.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:54:08 smithi086 bash[24289]: cluster 2024-09-16T07:54:07.495210+0000 mgr.a (mgr.14373) 5930 : cluster [DBG] pgmap v4111: 225 pgs: 225 active+clean; 589 KiB data, 134 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:54:08.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:54:08 smithi047 bash[22744]: cluster 2024-09-16T07:54:07.495210+0000 mgr.a (mgr.14373) 5930 : cluster [DBG] pgmap v4111: 225 pgs: 225 active+clean; 589 KiB data, 134 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:54:09.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:54:08 smithi157 bash[24585]: cluster 2024-09-16T07:54:07.495210+0000 mgr.a (mgr.14373) 5930 : cluster [DBG] pgmap v4111: 225 pgs: 225 active+clean; 589 KiB data, 134 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:54:10.016 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:54:10.016 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:54:10.017 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:54:10.805 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:54:10.806 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:54:10.806 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:54:10.806 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:54:10.806 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:54:10.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:54:10 smithi086 bash[24289]: cluster 2024-09-16T07:54:09.495975+0000 mgr.a (mgr.14373) 5931 : cluster [DBG] pgmap v4112: 225 pgs: 225 active+clean; 589 KiB data, 134 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:54:10.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:54:10 smithi047 bash[22744]: cluster 2024-09-16T07:54:09.495975+0000 mgr.a (mgr.14373) 5931 : cluster [DBG] pgmap v4112: 225 pgs: 225 active+clean; 589 KiB data, 134 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:54:11.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:54:10 smithi157 bash[24585]: cluster 2024-09-16T07:54:09.495975+0000 mgr.a (mgr.14373) 5931 : cluster [DBG] pgmap v4112: 225 pgs: 225 active+clean; 589 KiB data, 134 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:54:11.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:54:11 smithi047 bash[22744]: audit 2024-09-16T07:54:10.364432+0000 mgr.a (mgr.14373) 5932 : audit [DBG] from='client.136920 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:54:12.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:54:11 smithi157 bash[24585]: audit 2024-09-16T07:54:10.364432+0000 mgr.a (mgr.14373) 5932 : audit [DBG] from='client.136920 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:54:12.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:54:11 smithi086 bash[24289]: audit 2024-09-16T07:54:10.364432+0000 mgr.a (mgr.14373) 5932 : audit [DBG] from='client.136920 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:54:12.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:54:12 smithi047 bash[22744]: cluster 2024-09-16T07:54:11.498312+0000 mgr.a (mgr.14373) 5933 : cluster [DBG] pgmap v4113: 225 pgs: 225 active+clean; 589 KiB data, 134 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:54:13.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:54:12 smithi157 bash[24585]: cluster 2024-09-16T07:54:11.498312+0000 mgr.a (mgr.14373) 5933 : cluster [DBG] pgmap v4113: 225 pgs: 225 active+clean; 589 KiB data, 134 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:54:13.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:54:12 smithi086 bash[24289]: cluster 2024-09-16T07:54:11.498312+0000 mgr.a (mgr.14373) 5933 : cluster [DBG] pgmap v4113: 225 pgs: 225 active+clean; 589 KiB data, 134 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:54:14.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:54:14 smithi047 bash[22744]: cluster 2024-09-16T07:54:13.499252+0000 mgr.a (mgr.14373) 5934 : cluster [DBG] pgmap v4114: 225 pgs: 225 active+clean; 589 KiB data, 134 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:54:15.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:54:14 smithi157 bash[24585]: cluster 2024-09-16T07:54:13.499252+0000 mgr.a (mgr.14373) 5934 : cluster [DBG] pgmap v4114: 225 pgs: 225 active+clean; 589 KiB data, 134 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:54:15.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:54:14 smithi086 bash[24289]: cluster 2024-09-16T07:54:13.499252+0000 mgr.a (mgr.14373) 5934 : cluster [DBG] pgmap v4114: 225 pgs: 225 active+clean; 589 KiB data, 134 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:54:15.807 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:54:15.807 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:54:15.808 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:54:16.562 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:54:16.563 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:54:16.563 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:54:16.563 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:54:16.563 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:54:16.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:54:16 smithi047 bash[22744]: cluster 2024-09-16T07:54:15.500216+0000 mgr.a (mgr.14373) 5935 : cluster [DBG] pgmap v4115: 225 pgs: 225 active+clean; 589 KiB data, 134 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:54:16.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:54:16 smithi047 bash[22744]: audit 2024-09-16T07:54:16.141751+0000 mgr.a (mgr.14373) 5936 : audit [DBG] from='client.136992 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:54:17.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:54:16 smithi157 bash[24585]: cluster 2024-09-16T07:54:15.500216+0000 mgr.a (mgr.14373) 5935 : cluster [DBG] pgmap v4115: 225 pgs: 225 active+clean; 589 KiB data, 134 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:54:17.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:54:16 smithi157 bash[24585]: audit 2024-09-16T07:54:16.141751+0000 mgr.a (mgr.14373) 5936 : audit [DBG] from='client.136992 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:54:17.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:54:16 smithi086 bash[24289]: cluster 2024-09-16T07:54:15.500216+0000 mgr.a (mgr.14373) 5935 : cluster [DBG] pgmap v4115: 225 pgs: 225 active+clean; 589 KiB data, 134 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:54:17.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:54:16 smithi086 bash[24289]: audit 2024-09-16T07:54:16.141751+0000 mgr.a (mgr.14373) 5936 : audit [DBG] from='client.136992 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:54:19.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:54:18 smithi157 bash[24585]: cluster 2024-09-16T07:54:17.503619+0000 mgr.a (mgr.14373) 5937 : cluster [DBG] pgmap v4116: 225 pgs: 225 active+clean; 589 KiB data, 134 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-16T07:54:19.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:54:18 smithi086 bash[24289]: cluster 2024-09-16T07:54:17.503619+0000 mgr.a (mgr.14373) 5937 : cluster [DBG] pgmap v4116: 225 pgs: 225 active+clean; 589 KiB data, 134 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-16T07:54:19.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:54:18 smithi047 bash[22744]: cluster 2024-09-16T07:54:17.503619+0000 mgr.a (mgr.14373) 5937 : cluster [DBG] pgmap v4116: 225 pgs: 225 active+clean; 589 KiB data, 134 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-16T07:54:21.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:54:20 smithi157 bash[24585]: cluster 2024-09-16T07:54:19.504418+0000 mgr.a (mgr.14373) 5938 : cluster [DBG] pgmap v4117: 225 pgs: 225 active+clean; 589 KiB data, 134 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-16T07:54:21.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:54:20 smithi086 bash[24289]: cluster 2024-09-16T07:54:19.504418+0000 mgr.a (mgr.14373) 5938 : cluster [DBG] pgmap v4117: 225 pgs: 225 active+clean; 589 KiB data, 134 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-16T07:54:21.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:54:20 smithi047 bash[22744]: cluster 2024-09-16T07:54:19.504418+0000 mgr.a (mgr.14373) 5938 : cluster [DBG] pgmap v4117: 225 pgs: 225 active+clean; 589 KiB data, 134 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-16T07:54:21.564 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:54:21.564 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:54:21.565 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:54:22.322 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:54:22.323 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:54:22.323 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:54:22.323 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:54:22.323 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:54:23.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:54:22 smithi157 bash[24585]: cluster 2024-09-16T07:54:21.506369+0000 mgr.a (mgr.14373) 5939 : cluster [DBG] pgmap v4118: 225 pgs: 225 active+clean; 589 KiB data, 134 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:54:23.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:54:22 smithi157 bash[24585]: audit 2024-09-16T07:54:21.899866+0000 mgr.a (mgr.14373) 5940 : audit [DBG] from='client.137070 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:54:23.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:54:22 smithi086 bash[24289]: cluster 2024-09-16T07:54:21.506369+0000 mgr.a (mgr.14373) 5939 : cluster [DBG] pgmap v4118: 225 pgs: 225 active+clean; 589 KiB data, 134 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:54:23.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:54:22 smithi086 bash[24289]: audit 2024-09-16T07:54:21.899866+0000 mgr.a (mgr.14373) 5940 : audit [DBG] from='client.137070 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:54:23.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:54:22 smithi047 bash[22744]: cluster 2024-09-16T07:54:21.506369+0000 mgr.a (mgr.14373) 5939 : cluster [DBG] pgmap v4118: 225 pgs: 225 active+clean; 589 KiB data, 134 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:54:23.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:54:22 smithi047 bash[22744]: audit 2024-09-16T07:54:21.899866+0000 mgr.a (mgr.14373) 5940 : audit [DBG] from='client.137070 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:54:25.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:54:24 smithi157 bash[24585]: cluster 2024-09-16T07:54:23.507349+0000 mgr.a (mgr.14373) 5941 : cluster [DBG] pgmap v4119: 225 pgs: 225 active+clean; 589 KiB data, 134 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:54:25.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:54:24 smithi086 bash[24289]: cluster 2024-09-16T07:54:23.507349+0000 mgr.a (mgr.14373) 5941 : cluster [DBG] pgmap v4119: 225 pgs: 225 active+clean; 589 KiB data, 134 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:54:25.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:54:24 smithi047 bash[22744]: cluster 2024-09-16T07:54:23.507349+0000 mgr.a (mgr.14373) 5941 : cluster [DBG] pgmap v4119: 225 pgs: 225 active+clean; 589 KiB data, 134 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:54:27.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:54:26 smithi157 bash[24585]: cluster 2024-09-16T07:54:25.508118+0000 mgr.a (mgr.14373) 5942 : cluster [DBG] pgmap v4120: 225 pgs: 225 active+clean; 589 KiB data, 134 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:54:27.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:54:26 smithi086 bash[24289]: cluster 2024-09-16T07:54:25.508118+0000 mgr.a (mgr.14373) 5942 : cluster [DBG] pgmap v4120: 225 pgs: 225 active+clean; 589 KiB data, 134 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:54:27.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:54:26 smithi047 bash[22744]: cluster 2024-09-16T07:54:25.508118+0000 mgr.a (mgr.14373) 5942 : cluster [DBG] pgmap v4120: 225 pgs: 225 active+clean; 589 KiB data, 134 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:54:27.324 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:54:27.325 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:54:27.325 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:54:28.105 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:54:28.106 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:54:28.106 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:54:28.106 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:54:28.106 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:54:29.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:54:29 smithi157 bash[24585]: cluster 2024-09-16T07:54:27.510273+0000 mgr.a (mgr.14373) 5943 : cluster [DBG] pgmap v4121: 225 pgs: 225 active+clean; 589 KiB data, 134 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:54:29.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:54:29 smithi157 bash[24585]: audit 2024-09-16T07:54:27.663616+0000 mgr.a (mgr.14373) 5944 : audit [DBG] from='client.137148 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:54:29.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:54:29 smithi086 bash[24289]: cluster 2024-09-16T07:54:27.510273+0000 mgr.a (mgr.14373) 5943 : cluster [DBG] pgmap v4121: 225 pgs: 225 active+clean; 589 KiB data, 134 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:54:29.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:54:29 smithi086 bash[24289]: audit 2024-09-16T07:54:27.663616+0000 mgr.a (mgr.14373) 5944 : audit [DBG] from='client.137148 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:54:29.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:54:29 smithi047 bash[22744]: cluster 2024-09-16T07:54:27.510273+0000 mgr.a (mgr.14373) 5943 : cluster [DBG] pgmap v4121: 225 pgs: 225 active+clean; 589 KiB data, 134 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:54:29.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:54:29 smithi047 bash[22744]: audit 2024-09-16T07:54:27.663616+0000 mgr.a (mgr.14373) 5944 : audit [DBG] from='client.137148 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:54:31.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:54:31 smithi157 bash[24585]: cluster 2024-09-16T07:54:29.511136+0000 mgr.a (mgr.14373) 5945 : cluster [DBG] pgmap v4122: 225 pgs: 225 active+clean; 589 KiB data, 134 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-16T07:54:31.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:54:31 smithi086 bash[24289]: cluster 2024-09-16T07:54:29.511136+0000 mgr.a (mgr.14373) 5945 : cluster [DBG] pgmap v4122: 225 pgs: 225 active+clean; 589 KiB data, 134 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-16T07:54:31.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:54:31 smithi047 bash[22744]: cluster 2024-09-16T07:54:29.511136+0000 mgr.a (mgr.14373) 5945 : cluster [DBG] pgmap v4122: 225 pgs: 225 active+clean; 589 KiB data, 134 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-16T07:54:33.107 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:54:33.108 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:54:33.108 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:54:33.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:54:33 smithi157 bash[24585]: cluster 2024-09-16T07:54:31.513284+0000 mgr.a (mgr.14373) 5946 : cluster [DBG] pgmap v4123: 225 pgs: 225 active+clean; 589 KiB data, 134 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-09-16T07:54:33.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:54:33 smithi086 bash[24289]: cluster 2024-09-16T07:54:31.513284+0000 mgr.a (mgr.14373) 5946 : cluster [DBG] pgmap v4123: 225 pgs: 225 active+clean; 589 KiB data, 134 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-09-16T07:54:33.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:54:33 smithi047 bash[22744]: cluster 2024-09-16T07:54:31.513284+0000 mgr.a (mgr.14373) 5946 : cluster [DBG] pgmap v4123: 225 pgs: 225 active+clean; 589 KiB data, 134 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-09-16T07:54:33.867 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:54:33.868 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:54:33.868 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:54:33.868 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:54:33.868 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:54:35.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:54:35 smithi157 bash[24585]: audit 2024-09-16T07:54:33.445060+0000 mgr.a (mgr.14373) 5947 : audit [DBG] from='client.137226 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:54:35.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:54:35 smithi157 bash[24585]: cluster 2024-09-16T07:54:33.513799+0000 mgr.a (mgr.14373) 5948 : cluster [DBG] pgmap v4124: 225 pgs: 225 active+clean; 589 KiB data, 134 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:54:35.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:54:35 smithi086 bash[24289]: audit 2024-09-16T07:54:33.445060+0000 mgr.a (mgr.14373) 5947 : audit [DBG] from='client.137226 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:54:35.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:54:35 smithi086 bash[24289]: cluster 2024-09-16T07:54:33.513799+0000 mgr.a (mgr.14373) 5948 : cluster [DBG] pgmap v4124: 225 pgs: 225 active+clean; 589 KiB data, 134 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:54:35.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:54:35 smithi047 bash[22744]: audit 2024-09-16T07:54:33.445060+0000 mgr.a (mgr.14373) 5947 : audit [DBG] from='client.137226 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:54:35.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:54:35 smithi047 bash[22744]: cluster 2024-09-16T07:54:33.513799+0000 mgr.a (mgr.14373) 5948 : cluster [DBG] pgmap v4124: 225 pgs: 225 active+clean; 589 KiB data, 134 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:54:37.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:54:37 smithi157 bash[24585]: cluster 2024-09-16T07:54:35.514701+0000 mgr.a (mgr.14373) 5949 : cluster [DBG] pgmap v4125: 225 pgs: 225 active+clean; 589 KiB data, 134 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:54:37.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:54:37 smithi086 bash[24289]: cluster 2024-09-16T07:54:35.514701+0000 mgr.a (mgr.14373) 5949 : cluster [DBG] pgmap v4125: 225 pgs: 225 active+clean; 589 KiB data, 134 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:54:37.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:54:37 smithi047 bash[22744]: cluster 2024-09-16T07:54:35.514701+0000 mgr.a (mgr.14373) 5949 : cluster [DBG] pgmap v4125: 225 pgs: 225 active+clean; 589 KiB data, 134 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:54:38.869 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:54:38.870 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:54:38.870 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:54:39.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:54:39 smithi157 bash[24585]: cluster 2024-09-16T07:54:37.516893+0000 mgr.a (mgr.14373) 5950 : cluster [DBG] pgmap v4126: 225 pgs: 225 active+clean; 589 KiB data, 134 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:54:39.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:54:39 smithi086 bash[24289]: cluster 2024-09-16T07:54:37.516893+0000 mgr.a (mgr.14373) 5950 : cluster [DBG] pgmap v4126: 225 pgs: 225 active+clean; 589 KiB data, 134 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:54:39.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:54:39 smithi047 bash[22744]: cluster 2024-09-16T07:54:37.516893+0000 mgr.a (mgr.14373) 5950 : cluster [DBG] pgmap v4126: 225 pgs: 225 active+clean; 589 KiB data, 134 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:54:39.648 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:54:39.649 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:54:39.649 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:54:39.649 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:54:39.649 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:54:40.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:54:40 smithi157 bash[24585]: audit 2024-09-16T07:54:39.210881+0000 mgr.a (mgr.14373) 5951 : audit [DBG] from='client.137301 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:54:40.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:54:40 smithi157 bash[24585]: cluster 2024-09-16T07:54:39.517659+0000 mgr.a (mgr.14373) 5952 : cluster [DBG] pgmap v4127: 225 pgs: 225 active+clean; 589 KiB data, 134 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:54:40.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:54:40 smithi086 bash[24289]: audit 2024-09-16T07:54:39.210881+0000 mgr.a (mgr.14373) 5951 : audit [DBG] from='client.137301 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:54:40.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:54:40 smithi086 bash[24289]: cluster 2024-09-16T07:54:39.517659+0000 mgr.a (mgr.14373) 5952 : cluster [DBG] pgmap v4127: 225 pgs: 225 active+clean; 589 KiB data, 134 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:54:40.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:54:40 smithi047 bash[22744]: audit 2024-09-16T07:54:39.210881+0000 mgr.a (mgr.14373) 5951 : audit [DBG] from='client.137301 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:54:40.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:54:40 smithi047 bash[22744]: cluster 2024-09-16T07:54:39.517659+0000 mgr.a (mgr.14373) 5952 : cluster [DBG] pgmap v4127: 225 pgs: 225 active+clean; 589 KiB data, 134 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:54:42.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:54:42 smithi047 bash[22744]: cluster 2024-09-16T07:54:41.519829+0000 mgr.a (mgr.14373) 5953 : cluster [DBG] pgmap v4128: 225 pgs: 225 active+clean; 589 KiB data, 134 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:54:43.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:54:42 smithi157 bash[24585]: cluster 2024-09-16T07:54:41.519829+0000 mgr.a (mgr.14373) 5953 : cluster [DBG] pgmap v4128: 225 pgs: 225 active+clean; 589 KiB data, 134 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:54:43.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:54:42 smithi086 bash[24289]: cluster 2024-09-16T07:54:41.519829+0000 mgr.a (mgr.14373) 5953 : cluster [DBG] pgmap v4128: 225 pgs: 225 active+clean; 589 KiB data, 134 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:54:44.650 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:54:44.651 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:54:44.651 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:54:44.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:54:44 smithi047 bash[22744]: cluster 2024-09-16T07:54:43.520562+0000 mgr.a (mgr.14373) 5954 : cluster [DBG] pgmap v4129: 225 pgs: 225 active+clean; 589 KiB data, 134 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:54:45.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:54:44 smithi157 bash[24585]: cluster 2024-09-16T07:54:43.520562+0000 mgr.a (mgr.14373) 5954 : cluster [DBG] pgmap v4129: 225 pgs: 225 active+clean; 589 KiB data, 134 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:54:45.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:54:44 smithi086 bash[24289]: cluster 2024-09-16T07:54:43.520562+0000 mgr.a (mgr.14373) 5954 : cluster [DBG] pgmap v4129: 225 pgs: 225 active+clean; 589 KiB data, 134 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:54:45.389 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:54:45.390 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:54:45.390 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:54:45.390 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:54:45.390 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:54:45.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:54:45 smithi047 bash[22744]: audit 2024-09-16T07:54:44.987056+0000 mgr.a (mgr.14373) 5955 : audit [DBG] from='client.137376 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:54:46.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:54:45 smithi157 bash[24585]: audit 2024-09-16T07:54:44.987056+0000 mgr.a (mgr.14373) 5955 : audit [DBG] from='client.137376 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:54:46.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:54:45 smithi086 bash[24289]: audit 2024-09-16T07:54:44.987056+0000 mgr.a (mgr.14373) 5955 : audit [DBG] from='client.137376 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:54:47.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:54:46 smithi157 bash[24585]: cluster 2024-09-16T07:54:45.521519+0000 mgr.a (mgr.14373) 5956 : cluster [DBG] pgmap v4130: 225 pgs: 225 active+clean; 589 KiB data, 134 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:54:47.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:54:46 smithi086 bash[24289]: cluster 2024-09-16T07:54:45.521519+0000 mgr.a (mgr.14373) 5956 : cluster [DBG] pgmap v4130: 225 pgs: 225 active+clean; 589 KiB data, 134 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:54:47.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:54:46 smithi047 bash[22744]: cluster 2024-09-16T07:54:45.521519+0000 mgr.a (mgr.14373) 5956 : cluster [DBG] pgmap v4130: 225 pgs: 225 active+clean; 589 KiB data, 134 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:54:49.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:54:48 smithi157 bash[24585]: cluster 2024-09-16T07:54:47.523878+0000 mgr.a (mgr.14373) 5957 : cluster [DBG] pgmap v4131: 225 pgs: 225 active+clean; 589 KiB data, 134 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:54:49.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:54:48 smithi086 bash[24289]: cluster 2024-09-16T07:54:47.523878+0000 mgr.a (mgr.14373) 5957 : cluster [DBG] pgmap v4131: 225 pgs: 225 active+clean; 589 KiB data, 134 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:54:49.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:54:48 smithi047 bash[22744]: cluster 2024-09-16T07:54:47.523878+0000 mgr.a (mgr.14373) 5957 : cluster [DBG] pgmap v4131: 225 pgs: 225 active+clean; 589 KiB data, 134 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:54:50.391 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:54:50.392 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:54:50.392 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:54:51.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:54:50 smithi157 bash[24585]: cluster 2024-09-16T07:54:49.524805+0000 mgr.a (mgr.14373) 5958 : cluster [DBG] pgmap v4132: 225 pgs: 225 active+clean; 589 KiB data, 134 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:54:51.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:54:50 smithi086 bash[24289]: cluster 2024-09-16T07:54:49.524805+0000 mgr.a (mgr.14373) 5958 : cluster [DBG] pgmap v4132: 225 pgs: 225 active+clean; 589 KiB data, 134 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:54:51.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:54:50 smithi047 bash[22744]: cluster 2024-09-16T07:54:49.524805+0000 mgr.a (mgr.14373) 5958 : cluster [DBG] pgmap v4132: 225 pgs: 225 active+clean; 589 KiB data, 134 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:54:51.155 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:54:51.155 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:54:51.156 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:54:51.156 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:54:51.156 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:54:52.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:54:51 smithi157 bash[24585]: audit 2024-09-16T07:54:50.731638+0000 mgr.a (mgr.14373) 5959 : audit [DBG] from='client.137454 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:54:52.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:54:51 smithi086 bash[24289]: audit 2024-09-16T07:54:50.731638+0000 mgr.a (mgr.14373) 5959 : audit [DBG] from='client.137454 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:54:52.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:54:51 smithi047 bash[22744]: audit 2024-09-16T07:54:50.731638+0000 mgr.a (mgr.14373) 5959 : audit [DBG] from='client.137454 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:54:53.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:54:52 smithi157 bash[24585]: cluster 2024-09-16T07:54:51.527287+0000 mgr.a (mgr.14373) 5960 : cluster [DBG] pgmap v4133: 225 pgs: 225 active+clean; 589 KiB data, 134 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:54:53.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:54:52 smithi086 bash[24289]: cluster 2024-09-16T07:54:51.527287+0000 mgr.a (mgr.14373) 5960 : cluster [DBG] pgmap v4133: 225 pgs: 225 active+clean; 589 KiB data, 134 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:54:53.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:54:52 smithi047 bash[22744]: cluster 2024-09-16T07:54:51.527287+0000 mgr.a (mgr.14373) 5960 : cluster [DBG] pgmap v4133: 225 pgs: 225 active+clean; 589 KiB data, 134 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:54:55.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:54:55 smithi157 bash[24585]: cluster 2024-09-16T07:54:53.528214+0000 mgr.a (mgr.14373) 5961 : cluster [DBG] pgmap v4134: 225 pgs: 225 active+clean; 589 KiB data, 134 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:54:55.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:54:55 smithi157 bash[24585]: audit 2024-09-16T07:54:54.540369+0000 mon.b (mon.2) 574 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T07:54:55.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:54:55 smithi086 bash[24289]: cluster 2024-09-16T07:54:53.528214+0000 mgr.a (mgr.14373) 5961 : cluster [DBG] pgmap v4134: 225 pgs: 225 active+clean; 589 KiB data, 134 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:54:55.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:54:55 smithi086 bash[24289]: audit 2024-09-16T07:54:54.540369+0000 mon.b (mon.2) 574 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T07:54:55.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:54:55 smithi047 bash[22744]: cluster 2024-09-16T07:54:53.528214+0000 mgr.a (mgr.14373) 5961 : cluster [DBG] pgmap v4134: 225 pgs: 225 active+clean; 589 KiB data, 134 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:54:55.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:54:55 smithi047 bash[22744]: audit 2024-09-16T07:54:54.540369+0000 mon.b (mon.2) 574 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T07:54:56.157 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:54:56.158 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:54:56.158 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:54:56.897 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:54:56.897 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:54:56.897 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:54:56.898 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:54:56.898 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:54:57.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:54:57 smithi157 bash[24585]: cluster 2024-09-16T07:54:55.528994+0000 mgr.a (mgr.14373) 5962 : cluster [DBG] pgmap v4135: 225 pgs: 225 active+clean; 589 KiB data, 134 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:54:57.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:54:57 smithi086 bash[24289]: cluster 2024-09-16T07:54:55.528994+0000 mgr.a (mgr.14373) 5962 : cluster [DBG] pgmap v4135: 225 pgs: 225 active+clean; 589 KiB data, 134 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:54:57.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:54:57 smithi047 bash[22744]: cluster 2024-09-16T07:54:55.528994+0000 mgr.a (mgr.14373) 5962 : cluster [DBG] pgmap v4135: 225 pgs: 225 active+clean; 589 KiB data, 134 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:54:58.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:54:58 smithi157 bash[24585]: audit 2024-09-16T07:54:56.492696+0000 mgr.a (mgr.14373) 5963 : audit [DBG] from='client.137532 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:54:58.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:54:58 smithi086 bash[24289]: audit 2024-09-16T07:54:56.492696+0000 mgr.a (mgr.14373) 5963 : audit [DBG] from='client.137532 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:54:58.590 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:54:58 smithi047 bash[22744]: audit 2024-09-16T07:54:56.492696+0000 mgr.a (mgr.14373) 5963 : audit [DBG] from='client.137532 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:54:59.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:54:59 smithi157 bash[24585]: cluster 2024-09-16T07:54:57.531770+0000 mgr.a (mgr.14373) 5964 : cluster [DBG] pgmap v4136: 225 pgs: 225 active+clean; 589 KiB data, 134 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:54:59.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:54:59 smithi086 bash[24289]: cluster 2024-09-16T07:54:57.531770+0000 mgr.a (mgr.14373) 5964 : cluster [DBG] pgmap v4136: 225 pgs: 225 active+clean; 589 KiB data, 134 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:54:59.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:54:59 smithi047 bash[22744]: cluster 2024-09-16T07:54:57.531770+0000 mgr.a (mgr.14373) 5964 : cluster [DBG] pgmap v4136: 225 pgs: 225 active+clean; 589 KiB data, 134 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:55:01.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:55:00 smithi157 bash[24585]: cluster 2024-09-16T07:54:59.532570+0000 mgr.a (mgr.14373) 5965 : cluster [DBG] pgmap v4137: 225 pgs: 225 active+clean; 589 KiB data, 134 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:55:01.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:55:00 smithi157 bash[24585]: audit 2024-09-16T07:54:59.889413+0000 mon.a (mon.0) 921 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:55:01.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:55:00 smithi157 bash[24585]: audit 2024-09-16T07:54:59.894424+0000 mon.a (mon.0) 922 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:55:01.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:55:00 smithi157 bash[24585]: audit 2024-09-16T07:54:59.906741+0000 mon.a (mon.0) 923 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:55:01.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:55:00 smithi157 bash[24585]: audit 2024-09-16T07:54:59.912966+0000 mon.a (mon.0) 924 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:55:01.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:55:00 smithi157 bash[24585]: audit 2024-09-16T07:54:59.917274+0000 mon.a (mon.0) 925 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:55:01.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:55:00 smithi157 bash[24585]: audit 2024-09-16T07:54:59.923045+0000 mon.a (mon.0) 926 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:55:01.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:55:00 smithi157 bash[24585]: audit 2024-09-16T07:55:00.672430+0000 mon.b (mon.2) 575 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T07:55:01.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:55:00 smithi157 bash[24585]: audit 2024-09-16T07:55:00.674542+0000 mon.b (mon.2) 576 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T07:55:01.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:55:00 smithi157 bash[24585]: audit 2024-09-16T07:55:00.687955+0000 mon.a (mon.0) 927 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:55:01.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:55:00 smithi157 bash[24585]: audit 2024-09-16T07:55:00.691342+0000 mon.b (mon.2) 577 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:55:01.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:55:00 smithi086 bash[24289]: cluster 2024-09-16T07:54:59.532570+0000 mgr.a (mgr.14373) 5965 : cluster [DBG] pgmap v4137: 225 pgs: 225 active+clean; 589 KiB data, 134 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:55:01.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:55:00 smithi086 bash[24289]: audit 2024-09-16T07:54:59.889413+0000 mon.a (mon.0) 921 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:55:01.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:55:00 smithi086 bash[24289]: audit 2024-09-16T07:54:59.894424+0000 mon.a (mon.0) 922 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:55:01.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:55:00 smithi086 bash[24289]: audit 2024-09-16T07:54:59.906741+0000 mon.a (mon.0) 923 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:55:01.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:55:00 smithi086 bash[24289]: audit 2024-09-16T07:54:59.912966+0000 mon.a (mon.0) 924 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:55:01.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:55:00 smithi086 bash[24289]: audit 2024-09-16T07:54:59.917274+0000 mon.a (mon.0) 925 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:55:01.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:55:00 smithi086 bash[24289]: audit 2024-09-16T07:54:59.923045+0000 mon.a (mon.0) 926 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:55:01.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:55:00 smithi086 bash[24289]: audit 2024-09-16T07:55:00.672430+0000 mon.b (mon.2) 575 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T07:55:01.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:55:00 smithi086 bash[24289]: audit 2024-09-16T07:55:00.674542+0000 mon.b (mon.2) 576 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T07:55:01.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:55:00 smithi086 bash[24289]: audit 2024-09-16T07:55:00.687955+0000 mon.a (mon.0) 927 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:55:01.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:55:00 smithi086 bash[24289]: audit 2024-09-16T07:55:00.691342+0000 mon.b (mon.2) 577 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:55:01.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:55:00 smithi047 bash[22744]: cluster 2024-09-16T07:54:59.532570+0000 mgr.a (mgr.14373) 5965 : cluster [DBG] pgmap v4137: 225 pgs: 225 active+clean; 589 KiB data, 134 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:55:01.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:55:00 smithi047 bash[22744]: audit 2024-09-16T07:54:59.889413+0000 mon.a (mon.0) 921 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:55:01.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:55:00 smithi047 bash[22744]: audit 2024-09-16T07:54:59.894424+0000 mon.a (mon.0) 922 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:55:01.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:55:00 smithi047 bash[22744]: audit 2024-09-16T07:54:59.906741+0000 mon.a (mon.0) 923 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:55:01.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:55:00 smithi047 bash[22744]: audit 2024-09-16T07:54:59.912966+0000 mon.a (mon.0) 924 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:55:01.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:55:00 smithi047 bash[22744]: audit 2024-09-16T07:54:59.917274+0000 mon.a (mon.0) 925 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:55:01.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:55:00 smithi047 bash[22744]: audit 2024-09-16T07:54:59.923045+0000 mon.a (mon.0) 926 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:55:01.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:55:00 smithi047 bash[22744]: audit 2024-09-16T07:55:00.672430+0000 mon.b (mon.2) 575 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T07:55:01.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:55:00 smithi047 bash[22744]: audit 2024-09-16T07:55:00.674542+0000 mon.b (mon.2) 576 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T07:55:01.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:55:00 smithi047 bash[22744]: audit 2024-09-16T07:55:00.687955+0000 mon.a (mon.0) 927 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:55:01.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:55:00 smithi047 bash[22744]: audit 2024-09-16T07:55:00.691342+0000 mon.b (mon.2) 577 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:55:01.837 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 07:55:01 smithi047 bash[22994]: debug 2024-09-16T07:55:01.430+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T07:55:01.837 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 07:55:01 smithi047 bash[22994]: debug 2024-09-16T07:55:01.430+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T07:55:01.898 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:55:01.899 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:55:01.899 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:55:02.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:55:01 smithi157 bash[24585]: audit 2024-09-16T07:55:00.695863+0000 mgr.a (mgr.14373) 5966 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:55:02.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:55:01 smithi086 bash[24289]: audit 2024-09-16T07:55:00.695863+0000 mgr.a (mgr.14373) 5966 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:55:02.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:55:01 smithi047 bash[22744]: audit 2024-09-16T07:55:00.695863+0000 mgr.a (mgr.14373) 5966 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:55:02.660 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:55:02.660 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:55:02.660 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:55:02.660 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:55:02.661 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:55:03.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:55:02 smithi157 bash[24585]: audit 2024-09-16T07:55:01.432497+0000 mgr.a (mgr.14373) 5967 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T07:55:03.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:55:02 smithi157 bash[24585]: cephadm 2024-09-16T07:55:01.434226+0000 mgr.a (mgr.14373) 5968 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T07:55:03.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:55:02 smithi157 bash[24585]: cluster 2024-09-16T07:55:01.533938+0000 mgr.a (mgr.14373) 5969 : cluster [DBG] pgmap v4138: 225 pgs: 225 active+clean; 589 KiB data, 134 MiB used, 268 GiB / 268 GiB avail; 6.0 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-16T07:55:03.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:55:02 smithi086 bash[24289]: audit 2024-09-16T07:55:01.432497+0000 mgr.a (mgr.14373) 5967 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T07:55:03.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:55:02 smithi086 bash[24289]: cephadm 2024-09-16T07:55:01.434226+0000 mgr.a (mgr.14373) 5968 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T07:55:03.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:55:02 smithi086 bash[24289]: cluster 2024-09-16T07:55:01.533938+0000 mgr.a (mgr.14373) 5969 : cluster [DBG] pgmap v4138: 225 pgs: 225 active+clean; 589 KiB data, 134 MiB used, 268 GiB / 268 GiB avail; 6.0 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-16T07:55:03.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:55:02 smithi047 bash[22744]: audit 2024-09-16T07:55:01.432497+0000 mgr.a (mgr.14373) 5967 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T07:55:03.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:55:02 smithi047 bash[22744]: cephadm 2024-09-16T07:55:01.434226+0000 mgr.a (mgr.14373) 5968 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T07:55:03.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:55:02 smithi047 bash[22744]: cluster 2024-09-16T07:55:01.533938+0000 mgr.a (mgr.14373) 5969 : cluster [DBG] pgmap v4138: 225 pgs: 225 active+clean; 589 KiB data, 134 MiB used, 268 GiB / 268 GiB avail; 6.0 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-16T07:55:04.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:55:03 smithi157 bash[24585]: audit 2024-09-16T07:55:02.238570+0000 mgr.a (mgr.14373) 5970 : audit [DBG] from='client.137712 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:55:04.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:55:03 smithi086 bash[24289]: audit 2024-09-16T07:55:02.238570+0000 mgr.a (mgr.14373) 5970 : audit [DBG] from='client.137712 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:55:04.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:55:03 smithi047 bash[22744]: audit 2024-09-16T07:55:02.238570+0000 mgr.a (mgr.14373) 5970 : audit [DBG] from='client.137712 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:55:05.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:55:04 smithi157 bash[24585]: cluster 2024-09-16T07:55:03.535057+0000 mgr.a (mgr.14373) 5971 : cluster [DBG] pgmap v4139: 225 pgs: 225 active+clean; 589 KiB data, 134 MiB used, 268 GiB / 268 GiB avail; 5.1 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-16T07:55:05.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:55:04 smithi086 bash[24289]: cluster 2024-09-16T07:55:03.535057+0000 mgr.a (mgr.14373) 5971 : cluster [DBG] pgmap v4139: 225 pgs: 225 active+clean; 589 KiB data, 134 MiB used, 268 GiB / 268 GiB avail; 5.1 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-16T07:55:05.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:55:04 smithi047 bash[22744]: cluster 2024-09-16T07:55:03.535057+0000 mgr.a (mgr.14373) 5971 : cluster [DBG] pgmap v4139: 225 pgs: 225 active+clean; 589 KiB data, 134 MiB used, 268 GiB / 268 GiB avail; 5.1 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-16T07:55:07.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:55:06 smithi157 bash[24585]: cluster 2024-09-16T07:55:05.535882+0000 mgr.a (mgr.14373) 5972 : cluster [DBG] pgmap v4140: 225 pgs: 225 active+clean; 589 KiB data, 134 MiB used, 268 GiB / 268 GiB avail; 5.1 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-16T07:55:07.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:55:06 smithi086 bash[24289]: cluster 2024-09-16T07:55:05.535882+0000 mgr.a (mgr.14373) 5972 : cluster [DBG] pgmap v4140: 225 pgs: 225 active+clean; 589 KiB data, 134 MiB used, 268 GiB / 268 GiB avail; 5.1 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-16T07:55:07.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:55:06 smithi047 bash[22744]: cluster 2024-09-16T07:55:05.535882+0000 mgr.a (mgr.14373) 5972 : cluster [DBG] pgmap v4140: 225 pgs: 225 active+clean; 589 KiB data, 134 MiB used, 268 GiB / 268 GiB avail; 5.1 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-16T07:55:07.662 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:55:07.662 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:55:07.663 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:55:08.444 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:55:08.444 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:55:08.445 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:55:08.445 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:55:08.445 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:55:09.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:55:08 smithi157 bash[24585]: cluster 2024-09-16T07:55:07.538253+0000 mgr.a (mgr.14373) 5973 : cluster [DBG] pgmap v4141: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:55:09.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:55:08 smithi157 bash[24585]: audit 2024-09-16T07:55:08.005831+0000 mgr.a (mgr.14373) 5974 : audit [DBG] from='client.137784 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:55:09.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:55:08 smithi086 bash[24289]: cluster 2024-09-16T07:55:07.538253+0000 mgr.a (mgr.14373) 5973 : cluster [DBG] pgmap v4141: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:55:09.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:55:08 smithi086 bash[24289]: audit 2024-09-16T07:55:08.005831+0000 mgr.a (mgr.14373) 5974 : audit [DBG] from='client.137784 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:55:09.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:55:08 smithi047 bash[22744]: cluster 2024-09-16T07:55:07.538253+0000 mgr.a (mgr.14373) 5973 : cluster [DBG] pgmap v4141: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:55:09.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:55:08 smithi047 bash[22744]: audit 2024-09-16T07:55:08.005831+0000 mgr.a (mgr.14373) 5974 : audit [DBG] from='client.137784 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:55:11.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:55:10 smithi157 bash[24585]: cluster 2024-09-16T07:55:09.539183+0000 mgr.a (mgr.14373) 5975 : cluster [DBG] pgmap v4142: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:55:11.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:55:10 smithi086 bash[24289]: cluster 2024-09-16T07:55:09.539183+0000 mgr.a (mgr.14373) 5975 : cluster [DBG] pgmap v4142: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:55:11.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:55:10 smithi047 bash[22744]: cluster 2024-09-16T07:55:09.539183+0000 mgr.a (mgr.14373) 5975 : cluster [DBG] pgmap v4142: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:55:13.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:55:12 smithi157 bash[24585]: cluster 2024-09-16T07:55:11.541302+0000 mgr.a (mgr.14373) 5976 : cluster [DBG] pgmap v4143: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:55:13.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:55:12 smithi086 bash[24289]: cluster 2024-09-16T07:55:11.541302+0000 mgr.a (mgr.14373) 5976 : cluster [DBG] pgmap v4143: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:55:13.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:55:12 smithi047 bash[22744]: cluster 2024-09-16T07:55:11.541302+0000 mgr.a (mgr.14373) 5976 : cluster [DBG] pgmap v4143: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:55:13.446 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:55:13.446 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:55:13.447 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:55:14.221 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:55:14.221 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:55:14.221 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:55:14.221 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:55:14.221 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:55:15.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:55:14 smithi157 bash[24585]: cluster 2024-09-16T07:55:13.541797+0000 mgr.a (mgr.14373) 5977 : cluster [DBG] pgmap v4144: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 2.8 KiB/s rd, 170 B/s wr, 2 op/s 2024-09-16T07:55:15.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:55:14 smithi157 bash[24585]: audit 2024-09-16T07:55:13.783743+0000 mgr.a (mgr.14373) 5978 : audit [DBG] from='client.137862 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:55:15.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:55:14 smithi086 bash[24289]: cluster 2024-09-16T07:55:13.541797+0000 mgr.a (mgr.14373) 5977 : cluster [DBG] pgmap v4144: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 2.8 KiB/s rd, 170 B/s wr, 2 op/s 2024-09-16T07:55:15.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:55:14 smithi086 bash[24289]: audit 2024-09-16T07:55:13.783743+0000 mgr.a (mgr.14373) 5978 : audit [DBG] from='client.137862 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:55:15.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:55:14 smithi047 bash[22744]: cluster 2024-09-16T07:55:13.541797+0000 mgr.a (mgr.14373) 5977 : cluster [DBG] pgmap v4144: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 2.8 KiB/s rd, 170 B/s wr, 2 op/s 2024-09-16T07:55:15.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:55:14 smithi047 bash[22744]: audit 2024-09-16T07:55:13.783743+0000 mgr.a (mgr.14373) 5978 : audit [DBG] from='client.137862 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:55:17.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:55:16 smithi157 bash[24585]: cluster 2024-09-16T07:55:15.542687+0000 mgr.a (mgr.14373) 5979 : cluster [DBG] pgmap v4145: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 2.8 KiB/s rd, 170 B/s wr, 2 op/s 2024-09-16T07:55:17.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:55:16 smithi086 bash[24289]: cluster 2024-09-16T07:55:15.542687+0000 mgr.a (mgr.14373) 5979 : cluster [DBG] pgmap v4145: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 2.8 KiB/s rd, 170 B/s wr, 2 op/s 2024-09-16T07:55:17.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:55:16 smithi047 bash[22744]: cluster 2024-09-16T07:55:15.542687+0000 mgr.a (mgr.14373) 5979 : cluster [DBG] pgmap v4145: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 2.8 KiB/s rd, 170 B/s wr, 2 op/s 2024-09-16T07:55:19.222 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:55:19.223 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:55:19.223 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:55:19.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:55:18 smithi157 bash[24585]: cluster 2024-09-16T07:55:17.545005+0000 mgr.a (mgr.14373) 5980 : cluster [DBG] pgmap v4146: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 3.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-09-16T07:55:19.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:55:18 smithi086 bash[24289]: cluster 2024-09-16T07:55:17.545005+0000 mgr.a (mgr.14373) 5980 : cluster [DBG] pgmap v4146: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 3.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-09-16T07:55:19.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:55:18 smithi047 bash[22744]: cluster 2024-09-16T07:55:17.545005+0000 mgr.a (mgr.14373) 5980 : cluster [DBG] pgmap v4146: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 3.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-09-16T07:55:19.995 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:55:19.996 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:55:19.996 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:55:19.996 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:55:19.996 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:55:21.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:55:20 smithi157 bash[24585]: cluster 2024-09-16T07:55:19.545751+0000 mgr.a (mgr.14373) 5981 : cluster [DBG] pgmap v4147: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:55:21.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:55:20 smithi157 bash[24585]: audit 2024-09-16T07:55:19.565910+0000 mgr.a (mgr.14373) 5982 : audit [DBG] from='client.137937 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:55:21.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:55:20 smithi086 bash[24289]: cluster 2024-09-16T07:55:19.545751+0000 mgr.a (mgr.14373) 5981 : cluster [DBG] pgmap v4147: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:55:21.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:55:20 smithi086 bash[24289]: audit 2024-09-16T07:55:19.565910+0000 mgr.a (mgr.14373) 5982 : audit [DBG] from='client.137937 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:55:21.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:55:20 smithi047 bash[22744]: cluster 2024-09-16T07:55:19.545751+0000 mgr.a (mgr.14373) 5981 : cluster [DBG] pgmap v4147: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:55:21.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:55:20 smithi047 bash[22744]: audit 2024-09-16T07:55:19.565910+0000 mgr.a (mgr.14373) 5982 : audit [DBG] from='client.137937 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:55:23.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:55:22 smithi157 bash[24585]: cluster 2024-09-16T07:55:21.548017+0000 mgr.a (mgr.14373) 5983 : cluster [DBG] pgmap v4148: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:55:23.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:55:22 smithi086 bash[24289]: cluster 2024-09-16T07:55:21.548017+0000 mgr.a (mgr.14373) 5983 : cluster [DBG] pgmap v4148: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:55:23.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:55:22 smithi047 bash[22744]: cluster 2024-09-16T07:55:21.548017+0000 mgr.a (mgr.14373) 5983 : cluster [DBG] pgmap v4148: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:55:24.997 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:55:24.998 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:55:24.998 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:55:25.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:55:24 smithi157 bash[24585]: cluster 2024-09-16T07:55:23.548825+0000 mgr.a (mgr.14373) 5984 : cluster [DBG] pgmap v4149: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:55:25.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:55:24 smithi086 bash[24289]: cluster 2024-09-16T07:55:23.548825+0000 mgr.a (mgr.14373) 5984 : cluster [DBG] pgmap v4149: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:55:25.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:55:24 smithi047 bash[22744]: cluster 2024-09-16T07:55:23.548825+0000 mgr.a (mgr.14373) 5984 : cluster [DBG] pgmap v4149: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:55:25.779 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:55:25.779 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:55:25.779 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:55:25.779 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:55:25.780 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:55:27.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:55:26 smithi157 bash[24585]: audit 2024-09-16T07:55:25.338117+0000 mgr.a (mgr.14373) 5985 : audit [DBG] from='client.138015 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:55:27.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:55:26 smithi157 bash[24585]: cluster 2024-09-16T07:55:25.549375+0000 mgr.a (mgr.14373) 5986 : cluster [DBG] pgmap v4150: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:55:27.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:55:26 smithi086 bash[24289]: audit 2024-09-16T07:55:25.338117+0000 mgr.a (mgr.14373) 5985 : audit [DBG] from='client.138015 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:55:27.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:55:26 smithi086 bash[24289]: cluster 2024-09-16T07:55:25.549375+0000 mgr.a (mgr.14373) 5986 : cluster [DBG] pgmap v4150: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:55:27.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:55:26 smithi047 bash[22744]: audit 2024-09-16T07:55:25.338117+0000 mgr.a (mgr.14373) 5985 : audit [DBG] from='client.138015 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:55:27.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:55:26 smithi047 bash[22744]: cluster 2024-09-16T07:55:25.549375+0000 mgr.a (mgr.14373) 5986 : cluster [DBG] pgmap v4150: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:55:29.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:55:28 smithi157 bash[24585]: cluster 2024-09-16T07:55:27.551712+0000 mgr.a (mgr.14373) 5987 : cluster [DBG] pgmap v4151: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:55:29.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:55:28 smithi086 bash[24289]: cluster 2024-09-16T07:55:27.551712+0000 mgr.a (mgr.14373) 5987 : cluster [DBG] pgmap v4151: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:55:29.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:55:28 smithi047 bash[22744]: cluster 2024-09-16T07:55:27.551712+0000 mgr.a (mgr.14373) 5987 : cluster [DBG] pgmap v4151: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:55:30.781 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:55:30.781 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:55:30.782 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:55:31.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:55:30 smithi157 bash[24585]: cluster 2024-09-16T07:55:29.552469+0000 mgr.a (mgr.14373) 5988 : cluster [DBG] pgmap v4152: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:55:31.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:55:30 smithi086 bash[24289]: cluster 2024-09-16T07:55:29.552469+0000 mgr.a (mgr.14373) 5988 : cluster [DBG] pgmap v4152: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:55:31.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:55:30 smithi047 bash[22744]: cluster 2024-09-16T07:55:29.552469+0000 mgr.a (mgr.14373) 5988 : cluster [DBG] pgmap v4152: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:55:31.546 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:55:31.546 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:55:31.546 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:55:31.547 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:55:31.547 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:55:32.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:55:31 smithi157 bash[24585]: audit 2024-09-16T07:55:31.120704+0000 mgr.a (mgr.14373) 5989 : audit [DBG] from='client.138093 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:55:32.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:55:31 smithi086 bash[24289]: audit 2024-09-16T07:55:31.120704+0000 mgr.a (mgr.14373) 5989 : audit [DBG] from='client.138093 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:55:32.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:55:31 smithi047 bash[22744]: audit 2024-09-16T07:55:31.120704+0000 mgr.a (mgr.14373) 5989 : audit [DBG] from='client.138093 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:55:33.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:55:32 smithi157 bash[24585]: cluster 2024-09-16T07:55:31.553870+0000 mgr.a (mgr.14373) 5990 : cluster [DBG] pgmap v4153: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-16T07:55:33.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:55:32 smithi086 bash[24289]: cluster 2024-09-16T07:55:31.553870+0000 mgr.a (mgr.14373) 5990 : cluster [DBG] pgmap v4153: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-16T07:55:33.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:55:32 smithi047 bash[22744]: cluster 2024-09-16T07:55:31.553870+0000 mgr.a (mgr.14373) 5990 : cluster [DBG] pgmap v4153: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-16T07:55:35.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:55:35 smithi157 bash[24585]: cluster 2024-09-16T07:55:33.554646+0000 mgr.a (mgr.14373) 5991 : cluster [DBG] pgmap v4154: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T07:55:35.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:55:35 smithi086 bash[24289]: cluster 2024-09-16T07:55:33.554646+0000 mgr.a (mgr.14373) 5991 : cluster [DBG] pgmap v4154: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T07:55:35.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:55:35 smithi047 bash[22744]: cluster 2024-09-16T07:55:33.554646+0000 mgr.a (mgr.14373) 5991 : cluster [DBG] pgmap v4154: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T07:55:36.548 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:55:36.549 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:55:36.549 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:55:37.332 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:55:37.332 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:55:37.332 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:55:37.332 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:55:37.332 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:55:37.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:55:37 smithi157 bash[24585]: cluster 2024-09-16T07:55:35.555404+0000 mgr.a (mgr.14373) 5992 : cluster [DBG] pgmap v4155: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T07:55:37.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:55:37 smithi086 bash[24289]: cluster 2024-09-16T07:55:35.555404+0000 mgr.a (mgr.14373) 5992 : cluster [DBG] pgmap v4155: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T07:55:37.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:55:37 smithi047 bash[22744]: cluster 2024-09-16T07:55:35.555404+0000 mgr.a (mgr.14373) 5992 : cluster [DBG] pgmap v4155: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T07:55:38.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:55:38 smithi157 bash[24585]: audit 2024-09-16T07:55:36.892941+0000 mgr.a (mgr.14373) 5993 : audit [DBG] from='client.138168 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:55:38.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:55:38 smithi086 bash[24289]: audit 2024-09-16T07:55:36.892941+0000 mgr.a (mgr.14373) 5993 : audit [DBG] from='client.138168 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:55:38.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:55:38 smithi047 bash[22744]: audit 2024-09-16T07:55:36.892941+0000 mgr.a (mgr.14373) 5993 : audit [DBG] from='client.138168 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:55:39.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:55:39 smithi157 bash[24585]: cluster 2024-09-16T07:55:37.558394+0000 mgr.a (mgr.14373) 5994 : cluster [DBG] pgmap v4156: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:55:39.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:55:39 smithi086 bash[24289]: cluster 2024-09-16T07:55:37.558394+0000 mgr.a (mgr.14373) 5994 : cluster [DBG] pgmap v4156: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:55:39.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:55:39 smithi047 bash[22744]: cluster 2024-09-16T07:55:37.558394+0000 mgr.a (mgr.14373) 5994 : cluster [DBG] pgmap v4156: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:55:40.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:55:40 smithi157 bash[24585]: cluster 2024-09-16T07:55:39.559182+0000 mgr.a (mgr.14373) 5995 : cluster [DBG] pgmap v4157: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:55:40.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:55:40 smithi086 bash[24289]: cluster 2024-09-16T07:55:39.559182+0000 mgr.a (mgr.14373) 5995 : cluster [DBG] pgmap v4157: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:55:40.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:55:40 smithi047 bash[22744]: cluster 2024-09-16T07:55:39.559182+0000 mgr.a (mgr.14373) 5995 : cluster [DBG] pgmap v4157: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:55:42.334 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:55:42.334 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:55:42.335 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:55:43.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:55:42 smithi157 bash[24585]: cluster 2024-09-16T07:55:41.561103+0000 mgr.a (mgr.14373) 5996 : cluster [DBG] pgmap v4158: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:55:43.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:55:42 smithi086 bash[24289]: cluster 2024-09-16T07:55:41.561103+0000 mgr.a (mgr.14373) 5996 : cluster [DBG] pgmap v4158: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:55:43.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:55:42 smithi047 bash[22744]: cluster 2024-09-16T07:55:41.561103+0000 mgr.a (mgr.14373) 5996 : cluster [DBG] pgmap v4158: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:55:43.089 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:55:43.089 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:55:43.089 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:55:43.090 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:55:43.090 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:55:44.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:55:43 smithi157 bash[24585]: audit 2024-09-16T07:55:42.672871+0000 mgr.a (mgr.14373) 5997 : audit [DBG] from='client.138246 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:55:44.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:55:43 smithi086 bash[24289]: audit 2024-09-16T07:55:42.672871+0000 mgr.a (mgr.14373) 5997 : audit [DBG] from='client.138246 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:55:44.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:55:43 smithi047 bash[22744]: audit 2024-09-16T07:55:42.672871+0000 mgr.a (mgr.14373) 5997 : audit [DBG] from='client.138246 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:55:45.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:55:44 smithi157 bash[24585]: cluster 2024-09-16T07:55:43.562030+0000 mgr.a (mgr.14373) 5998 : cluster [DBG] pgmap v4159: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-16T07:55:45.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:55:44 smithi086 bash[24289]: cluster 2024-09-16T07:55:43.562030+0000 mgr.a (mgr.14373) 5998 : cluster [DBG] pgmap v4159: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-16T07:55:45.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:55:44 smithi047 bash[22744]: cluster 2024-09-16T07:55:43.562030+0000 mgr.a (mgr.14373) 5998 : cluster [DBG] pgmap v4159: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-16T07:55:47.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:55:46 smithi157 bash[24585]: cluster 2024-09-16T07:55:45.562827+0000 mgr.a (mgr.14373) 5999 : cluster [DBG] pgmap v4160: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-16T07:55:47.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:55:46 smithi086 bash[24289]: cluster 2024-09-16T07:55:45.562827+0000 mgr.a (mgr.14373) 5999 : cluster [DBG] pgmap v4160: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-16T07:55:47.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:55:46 smithi047 bash[22744]: cluster 2024-09-16T07:55:45.562827+0000 mgr.a (mgr.14373) 5999 : cluster [DBG] pgmap v4160: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-16T07:55:48.091 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:55:48.092 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:55:48.092 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:55:48.843 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:55:48.843 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:55:48.843 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:55:48.843 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:55:48.843 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:55:49.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:55:48 smithi157 bash[24585]: cluster 2024-09-16T07:55:47.564969+0000 mgr.a (mgr.14373) 6000 : cluster [DBG] pgmap v4161: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-16T07:55:49.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:55:48 smithi086 bash[24289]: cluster 2024-09-16T07:55:47.564969+0000 mgr.a (mgr.14373) 6000 : cluster [DBG] pgmap v4161: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-16T07:55:49.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:55:48 smithi047 bash[22744]: cluster 2024-09-16T07:55:47.564969+0000 mgr.a (mgr.14373) 6000 : cluster [DBG] pgmap v4161: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-16T07:55:50.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:55:49 smithi157 bash[24585]: audit 2024-09-16T07:55:48.430505+0000 mgr.a (mgr.14373) 6001 : audit [DBG] from='client.138321 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:55:50.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:55:49 smithi086 bash[24289]: audit 2024-09-16T07:55:48.430505+0000 mgr.a (mgr.14373) 6001 : audit [DBG] from='client.138321 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:55:50.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:55:49 smithi047 bash[22744]: audit 2024-09-16T07:55:48.430505+0000 mgr.a (mgr.14373) 6001 : audit [DBG] from='client.138321 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:55:51.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:55:50 smithi157 bash[24585]: cluster 2024-09-16T07:55:49.565858+0000 mgr.a (mgr.14373) 6002 : cluster [DBG] pgmap v4162: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:55:51.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:55:50 smithi086 bash[24289]: cluster 2024-09-16T07:55:49.565858+0000 mgr.a (mgr.14373) 6002 : cluster [DBG] pgmap v4162: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:55:51.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:55:50 smithi047 bash[22744]: cluster 2024-09-16T07:55:49.565858+0000 mgr.a (mgr.14373) 6002 : cluster [DBG] pgmap v4162: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:55:53.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:55:52 smithi157 bash[24585]: cluster 2024-09-16T07:55:51.568013+0000 mgr.a (mgr.14373) 6003 : cluster [DBG] pgmap v4163: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:55:53.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:55:52 smithi086 bash[24289]: cluster 2024-09-16T07:55:51.568013+0000 mgr.a (mgr.14373) 6003 : cluster [DBG] pgmap v4163: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:55:53.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:55:52 smithi047 bash[22744]: cluster 2024-09-16T07:55:51.568013+0000 mgr.a (mgr.14373) 6003 : cluster [DBG] pgmap v4163: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:55:53.845 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:55:53.853 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:55:53.853 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:55:54.620 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:55:54.620 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:55:54.620 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:55:54.621 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:55:54.621 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:55:55.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:55:54 smithi157 bash[24585]: cluster 2024-09-16T07:55:53.568777+0000 mgr.a (mgr.14373) 6004 : cluster [DBG] pgmap v4164: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:55:55.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:55:54 smithi157 bash[24585]: audit 2024-09-16T07:55:54.185951+0000 mgr.a (mgr.14373) 6005 : audit [DBG] from='client.138399 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:55:55.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:55:54 smithi086 bash[24289]: cluster 2024-09-16T07:55:53.568777+0000 mgr.a (mgr.14373) 6004 : cluster [DBG] pgmap v4164: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:55:55.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:55:54 smithi086 bash[24289]: audit 2024-09-16T07:55:54.185951+0000 mgr.a (mgr.14373) 6005 : audit [DBG] from='client.138399 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:55:55.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:55:54 smithi047 bash[22744]: cluster 2024-09-16T07:55:53.568777+0000 mgr.a (mgr.14373) 6004 : cluster [DBG] pgmap v4164: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:55:55.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:55:54 smithi047 bash[22744]: audit 2024-09-16T07:55:54.185951+0000 mgr.a (mgr.14373) 6005 : audit [DBG] from='client.138399 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:55:57.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:55:56 smithi157 bash[24585]: cluster 2024-09-16T07:55:55.569680+0000 mgr.a (mgr.14373) 6006 : cluster [DBG] pgmap v4165: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:55:57.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:55:56 smithi086 bash[24289]: cluster 2024-09-16T07:55:55.569680+0000 mgr.a (mgr.14373) 6006 : cluster [DBG] pgmap v4165: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:55:57.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:55:56 smithi047 bash[22744]: cluster 2024-09-16T07:55:55.569680+0000 mgr.a (mgr.14373) 6006 : cluster [DBG] pgmap v4165: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:55:59.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:55:58 smithi157 bash[24585]: cluster 2024-09-16T07:55:57.571950+0000 mgr.a (mgr.14373) 6007 : cluster [DBG] pgmap v4166: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:55:59.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:55:58 smithi086 bash[24289]: cluster 2024-09-16T07:55:57.571950+0000 mgr.a (mgr.14373) 6007 : cluster [DBG] pgmap v4166: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:55:59.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:55:58 smithi047 bash[22744]: cluster 2024-09-16T07:55:57.571950+0000 mgr.a (mgr.14373) 6007 : cluster [DBG] pgmap v4166: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:55:59.622 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:55:59.622 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:55:59.622 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:56:00.380 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:56:00.380 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:56:00.380 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:56:00.380 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:56:00.380 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:56:01.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:56:00 smithi157 bash[24585]: cluster 2024-09-16T07:55:59.572715+0000 mgr.a (mgr.14373) 6008 : cluster [DBG] pgmap v4167: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:56:01.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:56:00 smithi157 bash[24585]: audit 2024-09-16T07:55:59.961177+0000 mgr.a (mgr.14373) 6009 : audit [DBG] from='client.138477 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:56:01.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:56:00 smithi086 bash[24289]: cluster 2024-09-16T07:55:59.572715+0000 mgr.a (mgr.14373) 6008 : cluster [DBG] pgmap v4167: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:56:01.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:56:00 smithi086 bash[24289]: audit 2024-09-16T07:55:59.961177+0000 mgr.a (mgr.14373) 6009 : audit [DBG] from='client.138477 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:56:01.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:56:00 smithi047 bash[22744]: cluster 2024-09-16T07:55:59.572715+0000 mgr.a (mgr.14373) 6008 : cluster [DBG] pgmap v4167: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:56:01.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:56:00 smithi047 bash[22744]: audit 2024-09-16T07:55:59.961177+0000 mgr.a (mgr.14373) 6009 : audit [DBG] from='client.138477 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:56:02.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:56:01 smithi157 bash[24585]: audit 2024-09-16T07:56:01.482814+0000 mon.b (mon.2) 578 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T07:56:02.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:56:01 smithi086 bash[24289]: audit 2024-09-16T07:56:01.482814+0000 mon.b (mon.2) 578 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T07:56:02.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:56:01 smithi047 bash[22744]: audit 2024-09-16T07:56:01.482814+0000 mon.b (mon.2) 578 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T07:56:03.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:56:02 smithi157 bash[24585]: cluster 2024-09-16T07:56:01.574318+0000 mgr.a (mgr.14373) 6010 : cluster [DBG] pgmap v4168: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:56:03.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:56:02 smithi157 bash[24585]: audit 2024-09-16T07:56:02.313846+0000 mon.b (mon.2) 579 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T07:56:03.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:56:02 smithi157 bash[24585]: audit 2024-09-16T07:56:02.315933+0000 mon.b (mon.2) 580 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T07:56:03.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:56:02 smithi157 bash[24585]: audit 2024-09-16T07:56:02.329059+0000 mon.a (mon.0) 928 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:56:03.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:56:02 smithi157 bash[24585]: audit 2024-09-16T07:56:02.332570+0000 mon.b (mon.2) 581 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:56:03.058 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:56:02 smithi047 bash[22744]: cluster 2024-09-16T07:56:01.574318+0000 mgr.a (mgr.14373) 6010 : cluster [DBG] pgmap v4168: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:56:03.058 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:56:02 smithi047 bash[22744]: audit 2024-09-16T07:56:02.313846+0000 mon.b (mon.2) 579 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T07:56:03.058 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:56:02 smithi047 bash[22744]: audit 2024-09-16T07:56:02.315933+0000 mon.b (mon.2) 580 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T07:56:03.058 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:56:02 smithi047 bash[22744]: audit 2024-09-16T07:56:02.329059+0000 mon.a (mon.0) 928 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:56:03.058 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:56:02 smithi047 bash[22744]: audit 2024-09-16T07:56:02.332570+0000 mon.b (mon.2) 581 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:56:03.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:56:02 smithi086 bash[24289]: cluster 2024-09-16T07:56:01.574318+0000 mgr.a (mgr.14373) 6010 : cluster [DBG] pgmap v4168: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:56:03.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:56:02 smithi086 bash[24289]: audit 2024-09-16T07:56:02.313846+0000 mon.b (mon.2) 579 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T07:56:03.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:56:02 smithi086 bash[24289]: audit 2024-09-16T07:56:02.315933+0000 mon.b (mon.2) 580 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T07:56:03.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:56:02 smithi086 bash[24289]: audit 2024-09-16T07:56:02.329059+0000 mon.a (mon.0) 928 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:56:03.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:56:02 smithi086 bash[24289]: audit 2024-09-16T07:56:02.332570+0000 mon.b (mon.2) 581 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:56:03.337 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 07:56:03 smithi047 bash[22994]: debug 2024-09-16T07:56:03.056+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T07:56:03.337 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 07:56:03 smithi047 bash[22994]: debug 2024-09-16T07:56:03.060+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T07:56:04.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:56:03 smithi157 bash[24585]: audit 2024-09-16T07:56:02.337136+0000 mgr.a (mgr.14373) 6011 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:56:04.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:56:03 smithi157 bash[24585]: audit 2024-09-16T07:56:03.062102+0000 mgr.a (mgr.14373) 6012 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T07:56:04.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:56:03 smithi157 bash[24585]: cephadm 2024-09-16T07:56:03.064221+0000 mgr.a (mgr.14373) 6013 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T07:56:04.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:56:03 smithi086 bash[24289]: audit 2024-09-16T07:56:02.337136+0000 mgr.a (mgr.14373) 6011 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:56:04.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:56:03 smithi086 bash[24289]: audit 2024-09-16T07:56:03.062102+0000 mgr.a (mgr.14373) 6012 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T07:56:04.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:56:03 smithi086 bash[24289]: cephadm 2024-09-16T07:56:03.064221+0000 mgr.a (mgr.14373) 6013 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T07:56:04.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:56:03 smithi047 bash[22744]: audit 2024-09-16T07:56:02.337136+0000 mgr.a (mgr.14373) 6011 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:56:04.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:56:03 smithi047 bash[22744]: audit 2024-09-16T07:56:03.062102+0000 mgr.a (mgr.14373) 6012 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T07:56:04.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:56:03 smithi047 bash[22744]: cephadm 2024-09-16T07:56:03.064221+0000 mgr.a (mgr.14373) 6013 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T07:56:05.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:56:04 smithi157 bash[24585]: cluster 2024-09-16T07:56:03.575308+0000 mgr.a (mgr.14373) 6014 : cluster [DBG] pgmap v4169: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:56:05.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:56:04 smithi086 bash[24289]: cluster 2024-09-16T07:56:03.575308+0000 mgr.a (mgr.14373) 6014 : cluster [DBG] pgmap v4169: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:56:05.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:56:04 smithi047 bash[22744]: cluster 2024-09-16T07:56:03.575308+0000 mgr.a (mgr.14373) 6014 : cluster [DBG] pgmap v4169: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:56:05.381 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:56:05.382 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:56:05.382 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:56:06.155 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:56:06.156 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:56:06.156 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:56:06.156 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:56:06.156 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:56:07.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:56:06 smithi157 bash[24585]: cluster 2024-09-16T07:56:05.576125+0000 mgr.a (mgr.14373) 6015 : cluster [DBG] pgmap v4170: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:56:07.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:56:06 smithi157 bash[24585]: audit 2024-09-16T07:56:05.723573+0000 mgr.a (mgr.14373) 6016 : audit [DBG] from='client.138657 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:56:07.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:56:06 smithi086 bash[24289]: cluster 2024-09-16T07:56:05.576125+0000 mgr.a (mgr.14373) 6015 : cluster [DBG] pgmap v4170: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:56:07.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:56:06 smithi086 bash[24289]: audit 2024-09-16T07:56:05.723573+0000 mgr.a (mgr.14373) 6016 : audit [DBG] from='client.138657 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:56:07.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:56:06 smithi047 bash[22744]: cluster 2024-09-16T07:56:05.576125+0000 mgr.a (mgr.14373) 6015 : cluster [DBG] pgmap v4170: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:56:07.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:56:06 smithi047 bash[22744]: audit 2024-09-16T07:56:05.723573+0000 mgr.a (mgr.14373) 6016 : audit [DBG] from='client.138657 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:56:09.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:56:08 smithi157 bash[24585]: cluster 2024-09-16T07:56:07.578470+0000 mgr.a (mgr.14373) 6017 : cluster [DBG] pgmap v4171: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:56:09.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:56:08 smithi086 bash[24289]: cluster 2024-09-16T07:56:07.578470+0000 mgr.a (mgr.14373) 6017 : cluster [DBG] pgmap v4171: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:56:09.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:56:08 smithi047 bash[22744]: cluster 2024-09-16T07:56:07.578470+0000 mgr.a (mgr.14373) 6017 : cluster [DBG] pgmap v4171: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:56:11.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:56:10 smithi157 bash[24585]: cluster 2024-09-16T07:56:09.579217+0000 mgr.a (mgr.14373) 6018 : cluster [DBG] pgmap v4172: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:56:11.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:56:10 smithi086 bash[24289]: cluster 2024-09-16T07:56:09.579217+0000 mgr.a (mgr.14373) 6018 : cluster [DBG] pgmap v4172: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:56:11.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:56:10 smithi047 bash[22744]: cluster 2024-09-16T07:56:09.579217+0000 mgr.a (mgr.14373) 6018 : cluster [DBG] pgmap v4172: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:56:11.157 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:56:11.158 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:56:11.158 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:56:11.927 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:56:11.928 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:56:11.928 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:56:11.928 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:56:11.928 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:56:13.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:56:12 smithi157 bash[24585]: audit 2024-09-16T07:56:11.496648+0000 mgr.a (mgr.14373) 6019 : audit [DBG] from='client.138735 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:56:13.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:56:12 smithi157 bash[24585]: cluster 2024-09-16T07:56:11.580543+0000 mgr.a (mgr.14373) 6020 : cluster [DBG] pgmap v4173: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:56:13.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:56:12 smithi086 bash[24289]: audit 2024-09-16T07:56:11.496648+0000 mgr.a (mgr.14373) 6019 : audit [DBG] from='client.138735 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:56:13.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:56:12 smithi086 bash[24289]: cluster 2024-09-16T07:56:11.580543+0000 mgr.a (mgr.14373) 6020 : cluster [DBG] pgmap v4173: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:56:13.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:56:12 smithi047 bash[22744]: audit 2024-09-16T07:56:11.496648+0000 mgr.a (mgr.14373) 6019 : audit [DBG] from='client.138735 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:56:13.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:56:12 smithi047 bash[22744]: cluster 2024-09-16T07:56:11.580543+0000 mgr.a (mgr.14373) 6020 : cluster [DBG] pgmap v4173: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:56:15.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:56:14 smithi157 bash[24585]: cluster 2024-09-16T07:56:13.581424+0000 mgr.a (mgr.14373) 6021 : cluster [DBG] pgmap v4174: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T07:56:15.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:56:14 smithi086 bash[24289]: cluster 2024-09-16T07:56:13.581424+0000 mgr.a (mgr.14373) 6021 : cluster [DBG] pgmap v4174: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T07:56:15.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:56:14 smithi047 bash[22744]: cluster 2024-09-16T07:56:13.581424+0000 mgr.a (mgr.14373) 6021 : cluster [DBG] pgmap v4174: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T07:56:16.929 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:56:16.930 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:56:16.930 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:56:17.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:56:16 smithi157 bash[24585]: cluster 2024-09-16T07:56:15.582199+0000 mgr.a (mgr.14373) 6022 : cluster [DBG] pgmap v4175: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T07:56:17.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:56:16 smithi086 bash[24289]: cluster 2024-09-16T07:56:15.582199+0000 mgr.a (mgr.14373) 6022 : cluster [DBG] pgmap v4175: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T07:56:17.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:56:16 smithi047 bash[22744]: cluster 2024-09-16T07:56:15.582199+0000 mgr.a (mgr.14373) 6022 : cluster [DBG] pgmap v4175: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T07:56:17.722 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:56:17.722 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:56:17.723 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:56:17.723 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:56:17.723 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:56:19.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:56:18 smithi157 bash[24585]: audit 2024-09-16T07:56:17.273810+0000 mgr.a (mgr.14373) 6023 : audit [DBG] from='client.138813 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:56:19.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:56:18 smithi157 bash[24585]: cluster 2024-09-16T07:56:17.583764+0000 mgr.a (mgr.14373) 6024 : cluster [DBG] pgmap v4176: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:56:19.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:56:18 smithi086 bash[24289]: audit 2024-09-16T07:56:17.273810+0000 mgr.a (mgr.14373) 6023 : audit [DBG] from='client.138813 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:56:19.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:56:18 smithi086 bash[24289]: cluster 2024-09-16T07:56:17.583764+0000 mgr.a (mgr.14373) 6024 : cluster [DBG] pgmap v4176: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:56:19.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:56:18 smithi047 bash[22744]: audit 2024-09-16T07:56:17.273810+0000 mgr.a (mgr.14373) 6023 : audit [DBG] from='client.138813 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:56:19.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:56:18 smithi047 bash[22744]: cluster 2024-09-16T07:56:17.583764+0000 mgr.a (mgr.14373) 6024 : cluster [DBG] pgmap v4176: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:56:21.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:56:20 smithi157 bash[24585]: cluster 2024-09-16T07:56:19.584616+0000 mgr.a (mgr.14373) 6025 : cluster [DBG] pgmap v4177: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T07:56:21.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:56:20 smithi086 bash[24289]: cluster 2024-09-16T07:56:19.584616+0000 mgr.a (mgr.14373) 6025 : cluster [DBG] pgmap v4177: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T07:56:21.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:56:20 smithi047 bash[22744]: cluster 2024-09-16T07:56:19.584616+0000 mgr.a (mgr.14373) 6025 : cluster [DBG] pgmap v4177: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T07:56:22.724 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:56:22.724 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:56:22.724 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:56:23.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:56:22 smithi157 bash[24585]: cluster 2024-09-16T07:56:21.586745+0000 mgr.a (mgr.14373) 6026 : cluster [DBG] pgmap v4178: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:56:23.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:56:22 smithi086 bash[24289]: cluster 2024-09-16T07:56:21.586745+0000 mgr.a (mgr.14373) 6026 : cluster [DBG] pgmap v4178: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:56:23.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:56:22 smithi047 bash[22744]: cluster 2024-09-16T07:56:21.586745+0000 mgr.a (mgr.14373) 6026 : cluster [DBG] pgmap v4178: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:56:23.507 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:56:23.507 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:56:23.507 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:56:23.508 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:56:23.508 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:56:24.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:56:23 smithi157 bash[24585]: audit 2024-09-16T07:56:23.068293+0000 mgr.a (mgr.14373) 6027 : audit [DBG] from='client.138888 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:56:24.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:56:23 smithi086 bash[24289]: audit 2024-09-16T07:56:23.068293+0000 mgr.a (mgr.14373) 6027 : audit [DBG] from='client.138888 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:56:24.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:56:23 smithi047 bash[22744]: audit 2024-09-16T07:56:23.068293+0000 mgr.a (mgr.14373) 6027 : audit [DBG] from='client.138888 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:56:25.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:56:24 smithi157 bash[24585]: cluster 2024-09-16T07:56:23.587698+0000 mgr.a (mgr.14373) 6028 : cluster [DBG] pgmap v4179: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:56:25.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:56:24 smithi086 bash[24289]: cluster 2024-09-16T07:56:23.587698+0000 mgr.a (mgr.14373) 6028 : cluster [DBG] pgmap v4179: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:56:25.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:56:24 smithi047 bash[22744]: cluster 2024-09-16T07:56:23.587698+0000 mgr.a (mgr.14373) 6028 : cluster [DBG] pgmap v4179: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:56:27.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:56:26 smithi157 bash[24585]: cluster 2024-09-16T07:56:25.588465+0000 mgr.a (mgr.14373) 6029 : cluster [DBG] pgmap v4180: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:56:27.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:56:26 smithi086 bash[24289]: cluster 2024-09-16T07:56:25.588465+0000 mgr.a (mgr.14373) 6029 : cluster [DBG] pgmap v4180: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:56:27.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:56:26 smithi047 bash[22744]: cluster 2024-09-16T07:56:25.588465+0000 mgr.a (mgr.14373) 6029 : cluster [DBG] pgmap v4180: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:56:28.509 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:56:28.509 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:56:28.509 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:56:29.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:56:28 smithi157 bash[24585]: cluster 2024-09-16T07:56:27.590679+0000 mgr.a (mgr.14373) 6030 : cluster [DBG] pgmap v4181: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:56:29.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:56:28 smithi086 bash[24289]: cluster 2024-09-16T07:56:27.590679+0000 mgr.a (mgr.14373) 6030 : cluster [DBG] pgmap v4181: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:56:29.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:56:28 smithi047 bash[22744]: cluster 2024-09-16T07:56:27.590679+0000 mgr.a (mgr.14373) 6030 : cluster [DBG] pgmap v4181: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:56:29.271 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:56:29.271 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:56:29.271 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:56:29.272 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:56:29.272 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:56:30.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:56:29 smithi157 bash[24585]: audit 2024-09-16T07:56:28.845229+0000 mgr.a (mgr.14373) 6031 : audit [DBG] from='client.138966 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:56:30.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:56:29 smithi086 bash[24289]: audit 2024-09-16T07:56:28.845229+0000 mgr.a (mgr.14373) 6031 : audit [DBG] from='client.138966 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:56:30.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:56:29 smithi047 bash[22744]: audit 2024-09-16T07:56:28.845229+0000 mgr.a (mgr.14373) 6031 : audit [DBG] from='client.138966 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:56:31.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:56:30 smithi157 bash[24585]: cluster 2024-09-16T07:56:29.591563+0000 mgr.a (mgr.14373) 6032 : cluster [DBG] pgmap v4182: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:56:31.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:56:30 smithi086 bash[24289]: cluster 2024-09-16T07:56:29.591563+0000 mgr.a (mgr.14373) 6032 : cluster [DBG] pgmap v4182: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:56:31.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:56:30 smithi047 bash[22744]: cluster 2024-09-16T07:56:29.591563+0000 mgr.a (mgr.14373) 6032 : cluster [DBG] pgmap v4182: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:56:33.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:56:32 smithi157 bash[24585]: cluster 2024-09-16T07:56:31.593662+0000 mgr.a (mgr.14373) 6033 : cluster [DBG] pgmap v4183: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:56:33.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:56:32 smithi086 bash[24289]: cluster 2024-09-16T07:56:31.593662+0000 mgr.a (mgr.14373) 6033 : cluster [DBG] pgmap v4183: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:56:33.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:56:32 smithi047 bash[22744]: cluster 2024-09-16T07:56:31.593662+0000 mgr.a (mgr.14373) 6033 : cluster [DBG] pgmap v4183: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:56:34.273 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:56:34.274 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:56:34.274 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:56:35.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:56:34 smithi157 bash[24585]: cluster 2024-09-16T07:56:33.594430+0000 mgr.a (mgr.14373) 6034 : cluster [DBG] pgmap v4184: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:56:35.053 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:56:35.054 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:56:35.054 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:56:35.054 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:56:35.054 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:56:35.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:56:34 smithi086 bash[24289]: cluster 2024-09-16T07:56:33.594430+0000 mgr.a (mgr.14373) 6034 : cluster [DBG] pgmap v4184: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:56:35.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:56:34 smithi047 bash[22744]: cluster 2024-09-16T07:56:33.594430+0000 mgr.a (mgr.14373) 6034 : cluster [DBG] pgmap v4184: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:56:36.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:56:35 smithi157 bash[24585]: audit 2024-09-16T07:56:34.611189+0000 mgr.a (mgr.14373) 6035 : audit [DBG] from='client.139041 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:56:36.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:56:35 smithi086 bash[24289]: audit 2024-09-16T07:56:34.611189+0000 mgr.a (mgr.14373) 6035 : audit [DBG] from='client.139041 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:56:36.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:56:35 smithi047 bash[22744]: audit 2024-09-16T07:56:34.611189+0000 mgr.a (mgr.14373) 6035 : audit [DBG] from='client.139041 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:56:37.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:56:36 smithi157 bash[24585]: cluster 2024-09-16T07:56:35.595331+0000 mgr.a (mgr.14373) 6036 : cluster [DBG] pgmap v4185: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:56:37.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:56:36 smithi086 bash[24289]: cluster 2024-09-16T07:56:35.595331+0000 mgr.a (mgr.14373) 6036 : cluster [DBG] pgmap v4185: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:56:37.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:56:36 smithi047 bash[22744]: cluster 2024-09-16T07:56:35.595331+0000 mgr.a (mgr.14373) 6036 : cluster [DBG] pgmap v4185: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:56:39.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:56:39 smithi157 bash[24585]: cluster 2024-09-16T07:56:37.597531+0000 mgr.a (mgr.14373) 6037 : cluster [DBG] pgmap v4186: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:56:39.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:56:39 smithi086 bash[24289]: cluster 2024-09-16T07:56:37.597531+0000 mgr.a (mgr.14373) 6037 : cluster [DBG] pgmap v4186: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:56:39.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:56:39 smithi047 bash[22744]: cluster 2024-09-16T07:56:37.597531+0000 mgr.a (mgr.14373) 6037 : cluster [DBG] pgmap v4186: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:56:40.055 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:56:40.056 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:56:40.056 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:56:40.795 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:56:40.795 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:56:40.795 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:56:40.795 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:56:40.796 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:56:41.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:56:41 smithi157 bash[24585]: cluster 2024-09-16T07:56:39.598282+0000 mgr.a (mgr.14373) 6038 : cluster [DBG] pgmap v4187: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:56:41.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:56:41 smithi086 bash[24289]: cluster 2024-09-16T07:56:39.598282+0000 mgr.a (mgr.14373) 6038 : cluster [DBG] pgmap v4187: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:56:41.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:56:41 smithi047 bash[22744]: cluster 2024-09-16T07:56:39.598282+0000 mgr.a (mgr.14373) 6038 : cluster [DBG] pgmap v4187: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:56:42.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:56:42 smithi157 bash[24585]: audit 2024-09-16T07:56:40.389507+0000 mgr.a (mgr.14373) 6039 : audit [DBG] from='client.139119 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:56:42.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:56:42 smithi086 bash[24289]: audit 2024-09-16T07:56:40.389507+0000 mgr.a (mgr.14373) 6039 : audit [DBG] from='client.139119 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:56:42.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:56:42 smithi047 bash[22744]: audit 2024-09-16T07:56:40.389507+0000 mgr.a (mgr.14373) 6039 : audit [DBG] from='client.139119 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:56:43.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:56:43 smithi157 bash[24585]: cluster 2024-09-16T07:56:41.600422+0000 mgr.a (mgr.14373) 6040 : cluster [DBG] pgmap v4188: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:56:43.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:56:43 smithi086 bash[24289]: cluster 2024-09-16T07:56:41.600422+0000 mgr.a (mgr.14373) 6040 : cluster [DBG] pgmap v4188: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:56:43.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:56:43 smithi047 bash[22744]: cluster 2024-09-16T07:56:41.600422+0000 mgr.a (mgr.14373) 6040 : cluster [DBG] pgmap v4188: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:56:45.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:56:45 smithi157 bash[24585]: cluster 2024-09-16T07:56:43.601163+0000 mgr.a (mgr.14373) 6041 : cluster [DBG] pgmap v4189: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:56:45.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:56:45 smithi086 bash[24289]: cluster 2024-09-16T07:56:43.601163+0000 mgr.a (mgr.14373) 6041 : cluster [DBG] pgmap v4189: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:56:45.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:56:45 smithi047 bash[22744]: cluster 2024-09-16T07:56:43.601163+0000 mgr.a (mgr.14373) 6041 : cluster [DBG] pgmap v4189: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:56:45.796 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:56:45.798 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:56:45.799 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:56:46.574 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:56:46.574 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:56:46.574 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:56:46.574 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:56:46.574 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:56:47.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:56:47 smithi157 bash[24585]: cluster 2024-09-16T07:56:45.601915+0000 mgr.a (mgr.14373) 6042 : cluster [DBG] pgmap v4190: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:56:47.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:56:47 smithi157 bash[24585]: audit 2024-09-16T07:56:46.136198+0000 mgr.a (mgr.14373) 6043 : audit [DBG] from='client.139194 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:56:47.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:56:47 smithi086 bash[24289]: cluster 2024-09-16T07:56:45.601915+0000 mgr.a (mgr.14373) 6042 : cluster [DBG] pgmap v4190: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:56:47.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:56:47 smithi086 bash[24289]: audit 2024-09-16T07:56:46.136198+0000 mgr.a (mgr.14373) 6043 : audit [DBG] from='client.139194 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:56:47.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:56:47 smithi047 bash[22744]: cluster 2024-09-16T07:56:45.601915+0000 mgr.a (mgr.14373) 6042 : cluster [DBG] pgmap v4190: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:56:47.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:56:47 smithi047 bash[22744]: audit 2024-09-16T07:56:46.136198+0000 mgr.a (mgr.14373) 6043 : audit [DBG] from='client.139194 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:56:48.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:56:48 smithi157 bash[24585]: cluster 2024-09-16T07:56:47.604581+0000 mgr.a (mgr.14373) 6044 : cluster [DBG] pgmap v4191: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-16T07:56:48.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:56:48 smithi086 bash[24289]: cluster 2024-09-16T07:56:47.604581+0000 mgr.a (mgr.14373) 6044 : cluster [DBG] pgmap v4191: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-16T07:56:48.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:56:48 smithi047 bash[22744]: cluster 2024-09-16T07:56:47.604581+0000 mgr.a (mgr.14373) 6044 : cluster [DBG] pgmap v4191: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-16T07:56:51.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:56:50 smithi157 bash[24585]: cluster 2024-09-16T07:56:49.605340+0000 mgr.a (mgr.14373) 6045 : cluster [DBG] pgmap v4192: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T07:56:51.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:56:50 smithi086 bash[24289]: cluster 2024-09-16T07:56:49.605340+0000 mgr.a (mgr.14373) 6045 : cluster [DBG] pgmap v4192: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T07:56:51.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:56:50 smithi047 bash[22744]: cluster 2024-09-16T07:56:49.605340+0000 mgr.a (mgr.14373) 6045 : cluster [DBG] pgmap v4192: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T07:56:51.575 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:56:51.576 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:56:51.576 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:56:52.312 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:56:52.313 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:56:52.313 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:56:52.313 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:56:52.313 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:56:53.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:56:52 smithi157 bash[24585]: cluster 2024-09-16T07:56:51.607376+0000 mgr.a (mgr.14373) 6046 : cluster [DBG] pgmap v4193: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:56:53.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:56:52 smithi157 bash[24585]: audit 2024-09-16T07:56:51.906457+0000 mgr.a (mgr.14373) 6047 : audit [DBG] from='client.139269 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:56:53.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:56:52 smithi086 bash[24289]: cluster 2024-09-16T07:56:51.607376+0000 mgr.a (mgr.14373) 6046 : cluster [DBG] pgmap v4193: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:56:53.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:56:52 smithi086 bash[24289]: audit 2024-09-16T07:56:51.906457+0000 mgr.a (mgr.14373) 6047 : audit [DBG] from='client.139269 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:56:53.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:56:52 smithi047 bash[22744]: cluster 2024-09-16T07:56:51.607376+0000 mgr.a (mgr.14373) 6046 : cluster [DBG] pgmap v4193: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:56:53.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:56:52 smithi047 bash[22744]: audit 2024-09-16T07:56:51.906457+0000 mgr.a (mgr.14373) 6047 : audit [DBG] from='client.139269 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:56:55.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:56:54 smithi157 bash[24585]: cluster 2024-09-16T07:56:53.608237+0000 mgr.a (mgr.14373) 6048 : cluster [DBG] pgmap v4194: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:56:55.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:56:54 smithi086 bash[24289]: cluster 2024-09-16T07:56:53.608237+0000 mgr.a (mgr.14373) 6048 : cluster [DBG] pgmap v4194: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:56:55.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:56:54 smithi047 bash[22744]: cluster 2024-09-16T07:56:53.608237+0000 mgr.a (mgr.14373) 6048 : cluster [DBG] pgmap v4194: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:56:57.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:56:56 smithi157 bash[24585]: cluster 2024-09-16T07:56:55.608994+0000 mgr.a (mgr.14373) 6049 : cluster [DBG] pgmap v4195: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T07:56:57.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:56:56 smithi086 bash[24289]: cluster 2024-09-16T07:56:55.608994+0000 mgr.a (mgr.14373) 6049 : cluster [DBG] pgmap v4195: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T07:56:57.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:56:56 smithi047 bash[22744]: cluster 2024-09-16T07:56:55.608994+0000 mgr.a (mgr.14373) 6049 : cluster [DBG] pgmap v4195: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T07:56:57.313 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:56:57.314 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:56:57.314 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:56:58.086 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:56:58.087 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:56:58.087 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:56:58.087 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:56:58.087 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:56:59.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:56:58 smithi157 bash[24585]: cluster 2024-09-16T07:56:57.611166+0000 mgr.a (mgr.14373) 6050 : cluster [DBG] pgmap v4196: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:56:59.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:56:58 smithi157 bash[24585]: audit 2024-09-16T07:56:57.658678+0000 mgr.a (mgr.14373) 6051 : audit [DBG] from='client.139347 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:56:59.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:56:58 smithi086 bash[24289]: cluster 2024-09-16T07:56:57.611166+0000 mgr.a (mgr.14373) 6050 : cluster [DBG] pgmap v4196: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:56:59.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:56:58 smithi086 bash[24289]: audit 2024-09-16T07:56:57.658678+0000 mgr.a (mgr.14373) 6051 : audit [DBG] from='client.139347 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:56:59.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:56:58 smithi047 bash[22744]: cluster 2024-09-16T07:56:57.611166+0000 mgr.a (mgr.14373) 6050 : cluster [DBG] pgmap v4196: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:56:59.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:56:58 smithi047 bash[22744]: audit 2024-09-16T07:56:57.658678+0000 mgr.a (mgr.14373) 6051 : audit [DBG] from='client.139347 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:57:01.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:57:00 smithi157 bash[24585]: cluster 2024-09-16T07:56:59.612136+0000 mgr.a (mgr.14373) 6052 : cluster [DBG] pgmap v4197: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-16T07:57:01.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:57:00 smithi086 bash[24289]: cluster 2024-09-16T07:56:59.612136+0000 mgr.a (mgr.14373) 6052 : cluster [DBG] pgmap v4197: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-16T07:57:01.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:57:00 smithi047 bash[22744]: cluster 2024-09-16T07:56:59.612136+0000 mgr.a (mgr.14373) 6052 : cluster [DBG] pgmap v4197: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-16T07:57:03.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:57:02 smithi157 bash[24585]: cluster 2024-09-16T07:57:01.614365+0000 mgr.a (mgr.14373) 6053 : cluster [DBG] pgmap v4198: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-16T07:57:03.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:57:02 smithi086 bash[24289]: cluster 2024-09-16T07:57:01.614365+0000 mgr.a (mgr.14373) 6053 : cluster [DBG] pgmap v4198: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-16T07:57:03.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:57:02 smithi047 bash[22744]: cluster 2024-09-16T07:57:01.614365+0000 mgr.a (mgr.14373) 6053 : cluster [DBG] pgmap v4198: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-16T07:57:03.088 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:57:03.089 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:57:03.089 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:57:03.872 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:57:03.872 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:57:03.872 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:57:03.872 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:57:03.872 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:57:04.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:57:03 smithi157 bash[24585]: audit 2024-09-16T07:57:03.112768+0000 mon.b (mon.2) 582 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T07:57:04.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:57:03 smithi086 bash[24289]: audit 2024-09-16T07:57:03.112768+0000 mon.b (mon.2) 582 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T07:57:04.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:57:03 smithi047 bash[22744]: audit 2024-09-16T07:57:03.112768+0000 mon.b (mon.2) 582 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T07:57:05.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:57:04 smithi157 bash[24585]: audit 2024-09-16T07:57:03.430369+0000 mgr.a (mgr.14373) 6054 : audit [DBG] from='client.139422 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:57:05.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:57:04 smithi157 bash[24585]: cluster 2024-09-16T07:57:03.615018+0000 mgr.a (mgr.14373) 6055 : cluster [DBG] pgmap v4199: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:57:05.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:57:04 smithi157 bash[24585]: audit 2024-09-16T07:57:03.957672+0000 mon.b (mon.2) 583 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T07:57:05.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:57:04 smithi157 bash[24585]: audit 2024-09-16T07:57:03.959770+0000 mon.b (mon.2) 584 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T07:57:05.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:57:04 smithi157 bash[24585]: audit 2024-09-16T07:57:03.972904+0000 mon.a (mon.0) 929 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:57:05.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:57:04 smithi157 bash[24585]: audit 2024-09-16T07:57:03.973863+0000 mon.b (mon.2) 585 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:57:05.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:57:04 smithi157 bash[24585]: audit 2024-09-16T07:57:03.978864+0000 mgr.a (mgr.14373) 6056 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:57:05.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:57:04 smithi086 bash[24289]: audit 2024-09-16T07:57:03.430369+0000 mgr.a (mgr.14373) 6054 : audit [DBG] from='client.139422 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:57:05.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:57:04 smithi086 bash[24289]: cluster 2024-09-16T07:57:03.615018+0000 mgr.a (mgr.14373) 6055 : cluster [DBG] pgmap v4199: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:57:05.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:57:04 smithi086 bash[24289]: audit 2024-09-16T07:57:03.957672+0000 mon.b (mon.2) 583 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T07:57:05.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:57:04 smithi086 bash[24289]: audit 2024-09-16T07:57:03.959770+0000 mon.b (mon.2) 584 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T07:57:05.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:57:04 smithi086 bash[24289]: audit 2024-09-16T07:57:03.972904+0000 mon.a (mon.0) 929 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:57:05.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:57:04 smithi086 bash[24289]: audit 2024-09-16T07:57:03.973863+0000 mon.b (mon.2) 585 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:57:05.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:57:04 smithi086 bash[24289]: audit 2024-09-16T07:57:03.978864+0000 mgr.a (mgr.14373) 6056 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:57:05.087 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 07:57:04 smithi047 bash[22994]: debug 2024-09-16T07:57:04.695+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T07:57:05.087 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 07:57:04 smithi047 bash[22994]: debug 2024-09-16T07:57:04.699+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T07:57:05.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:57:04 smithi047 bash[22744]: audit 2024-09-16T07:57:03.430369+0000 mgr.a (mgr.14373) 6054 : audit [DBG] from='client.139422 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:57:05.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:57:04 smithi047 bash[22744]: cluster 2024-09-16T07:57:03.615018+0000 mgr.a (mgr.14373) 6055 : cluster [DBG] pgmap v4199: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:57:05.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:57:04 smithi047 bash[22744]: audit 2024-09-16T07:57:03.957672+0000 mon.b (mon.2) 583 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T07:57:05.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:57:04 smithi047 bash[22744]: audit 2024-09-16T07:57:03.959770+0000 mon.b (mon.2) 584 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T07:57:05.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:57:04 smithi047 bash[22744]: audit 2024-09-16T07:57:03.972904+0000 mon.a (mon.0) 929 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:57:05.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:57:04 smithi047 bash[22744]: audit 2024-09-16T07:57:03.973863+0000 mon.b (mon.2) 585 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:57:05.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:57:04 smithi047 bash[22744]: audit 2024-09-16T07:57:03.978864+0000 mgr.a (mgr.14373) 6056 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:57:06.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:57:05 smithi157 bash[24585]: audit 2024-09-16T07:57:04.700117+0000 mgr.a (mgr.14373) 6057 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T07:57:06.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:57:05 smithi157 bash[24585]: cephadm 2024-09-16T07:57:04.703737+0000 mgr.a (mgr.14373) 6058 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T07:57:06.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:57:05 smithi086 bash[24289]: audit 2024-09-16T07:57:04.700117+0000 mgr.a (mgr.14373) 6057 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T07:57:06.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:57:05 smithi086 bash[24289]: cephadm 2024-09-16T07:57:04.703737+0000 mgr.a (mgr.14373) 6058 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T07:57:06.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:57:05 smithi047 bash[22744]: audit 2024-09-16T07:57:04.700117+0000 mgr.a (mgr.14373) 6057 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T07:57:06.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:57:05 smithi047 bash[22744]: cephadm 2024-09-16T07:57:04.703737+0000 mgr.a (mgr.14373) 6058 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T07:57:07.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:57:06 smithi157 bash[24585]: cluster 2024-09-16T07:57:05.615920+0000 mgr.a (mgr.14373) 6059 : cluster [DBG] pgmap v4200: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:57:07.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:57:06 smithi086 bash[24289]: cluster 2024-09-16T07:57:05.615920+0000 mgr.a (mgr.14373) 6059 : cluster [DBG] pgmap v4200: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:57:07.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:57:06 smithi047 bash[22744]: cluster 2024-09-16T07:57:05.615920+0000 mgr.a (mgr.14373) 6059 : cluster [DBG] pgmap v4200: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:57:08.873 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:57:08.874 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:57:08.874 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:57:09.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:57:08 smithi157 bash[24585]: cluster 2024-09-16T07:57:07.618098+0000 mgr.a (mgr.14373) 6060 : cluster [DBG] pgmap v4201: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:57:09.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:57:08 smithi086 bash[24289]: cluster 2024-09-16T07:57:07.618098+0000 mgr.a (mgr.14373) 6060 : cluster [DBG] pgmap v4201: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:57:09.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:57:08 smithi047 bash[22744]: cluster 2024-09-16T07:57:07.618098+0000 mgr.a (mgr.14373) 6060 : cluster [DBG] pgmap v4201: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:57:09.607 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:57:09.608 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:57:09.608 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:57:09.608 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:57:09.608 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:57:10.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:57:09 smithi157 bash[24585]: audit 2024-09-16T07:57:09.207071+0000 mgr.a (mgr.14373) 6061 : audit [DBG] from='client.139602 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:57:10.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:57:09 smithi086 bash[24289]: audit 2024-09-16T07:57:09.207071+0000 mgr.a (mgr.14373) 6061 : audit [DBG] from='client.139602 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:57:10.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:57:09 smithi047 bash[22744]: audit 2024-09-16T07:57:09.207071+0000 mgr.a (mgr.14373) 6061 : audit [DBG] from='client.139602 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:57:11.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:57:10 smithi157 bash[24585]: cluster 2024-09-16T07:57:09.618716+0000 mgr.a (mgr.14373) 6062 : cluster [DBG] pgmap v4202: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:57:11.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:57:10 smithi086 bash[24289]: cluster 2024-09-16T07:57:09.618716+0000 mgr.a (mgr.14373) 6062 : cluster [DBG] pgmap v4202: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:57:11.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:57:10 smithi047 bash[22744]: cluster 2024-09-16T07:57:09.618716+0000 mgr.a (mgr.14373) 6062 : cluster [DBG] pgmap v4202: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:57:13.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:57:12 smithi157 bash[24585]: cluster 2024-09-16T07:57:11.620946+0000 mgr.a (mgr.14373) 6063 : cluster [DBG] pgmap v4203: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:57:13.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:57:12 smithi086 bash[24289]: cluster 2024-09-16T07:57:11.620946+0000 mgr.a (mgr.14373) 6063 : cluster [DBG] pgmap v4203: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:57:13.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:57:12 smithi047 bash[22744]: cluster 2024-09-16T07:57:11.620946+0000 mgr.a (mgr.14373) 6063 : cluster [DBG] pgmap v4203: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:57:14.609 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:57:14.610 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:57:14.610 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:57:15.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:57:14 smithi157 bash[24585]: cluster 2024-09-16T07:57:13.621756+0000 mgr.a (mgr.14373) 6064 : cluster [DBG] pgmap v4204: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:57:15.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:57:14 smithi086 bash[24289]: cluster 2024-09-16T07:57:13.621756+0000 mgr.a (mgr.14373) 6064 : cluster [DBG] pgmap v4204: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:57:15.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:57:14 smithi047 bash[22744]: cluster 2024-09-16T07:57:13.621756+0000 mgr.a (mgr.14373) 6064 : cluster [DBG] pgmap v4204: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:57:15.356 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:57:15.356 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:57:15.356 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:57:15.356 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:57:15.356 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:57:16.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:57:15 smithi157 bash[24585]: audit 2024-09-16T07:57:14.944470+0000 mgr.a (mgr.14373) 6065 : audit [DBG] from='client.139680 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:57:16.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:57:15 smithi086 bash[24289]: audit 2024-09-16T07:57:14.944470+0000 mgr.a (mgr.14373) 6065 : audit [DBG] from='client.139680 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:57:16.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:57:15 smithi047 bash[22744]: audit 2024-09-16T07:57:14.944470+0000 mgr.a (mgr.14373) 6065 : audit [DBG] from='client.139680 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:57:17.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:57:16 smithi157 bash[24585]: cluster 2024-09-16T07:57:15.622677+0000 mgr.a (mgr.14373) 6066 : cluster [DBG] pgmap v4205: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:57:17.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:57:16 smithi086 bash[24289]: cluster 2024-09-16T07:57:15.622677+0000 mgr.a (mgr.14373) 6066 : cluster [DBG] pgmap v4205: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:57:17.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:57:16 smithi047 bash[22744]: cluster 2024-09-16T07:57:15.622677+0000 mgr.a (mgr.14373) 6066 : cluster [DBG] pgmap v4205: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:57:19.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:57:18 smithi157 bash[24585]: cluster 2024-09-16T07:57:17.624900+0000 mgr.a (mgr.14373) 6067 : cluster [DBG] pgmap v4206: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:57:19.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:57:18 smithi086 bash[24289]: cluster 2024-09-16T07:57:17.624900+0000 mgr.a (mgr.14373) 6067 : cluster [DBG] pgmap v4206: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:57:19.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:57:18 smithi047 bash[22744]: cluster 2024-09-16T07:57:17.624900+0000 mgr.a (mgr.14373) 6067 : cluster [DBG] pgmap v4206: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:57:20.357 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:57:20.358 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:57:20.358 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:57:21.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:57:20 smithi157 bash[24585]: cluster 2024-09-16T07:57:19.625668+0000 mgr.a (mgr.14373) 6068 : cluster [DBG] pgmap v4207: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:57:21.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:57:20 smithi086 bash[24289]: cluster 2024-09-16T07:57:19.625668+0000 mgr.a (mgr.14373) 6068 : cluster [DBG] pgmap v4207: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:57:21.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:57:20 smithi047 bash[22744]: cluster 2024-09-16T07:57:19.625668+0000 mgr.a (mgr.14373) 6068 : cluster [DBG] pgmap v4207: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:57:21.140 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:57:21.140 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:57:21.140 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:57:21.140 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:57:21.140 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:57:22.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:57:21 smithi157 bash[24585]: audit 2024-09-16T07:57:20.698714+0000 mgr.a (mgr.14373) 6069 : audit [DBG] from='client.139758 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:57:22.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:57:21 smithi086 bash[24289]: audit 2024-09-16T07:57:20.698714+0000 mgr.a (mgr.14373) 6069 : audit [DBG] from='client.139758 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:57:22.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:57:21 smithi047 bash[22744]: audit 2024-09-16T07:57:20.698714+0000 mgr.a (mgr.14373) 6069 : audit [DBG] from='client.139758 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:57:23.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:57:22 smithi157 bash[24585]: cluster 2024-09-16T07:57:21.628016+0000 mgr.a (mgr.14373) 6070 : cluster [DBG] pgmap v4208: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:57:23.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:57:22 smithi086 bash[24289]: cluster 2024-09-16T07:57:21.628016+0000 mgr.a (mgr.14373) 6070 : cluster [DBG] pgmap v4208: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:57:23.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:57:22 smithi047 bash[22744]: cluster 2024-09-16T07:57:21.628016+0000 mgr.a (mgr.14373) 6070 : cluster [DBG] pgmap v4208: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:57:25.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:57:24 smithi157 bash[24585]: cluster 2024-09-16T07:57:23.628790+0000 mgr.a (mgr.14373) 6071 : cluster [DBG] pgmap v4209: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:57:25.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:57:24 smithi086 bash[24289]: cluster 2024-09-16T07:57:23.628790+0000 mgr.a (mgr.14373) 6071 : cluster [DBG] pgmap v4209: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:57:25.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:57:24 smithi047 bash[22744]: cluster 2024-09-16T07:57:23.628790+0000 mgr.a (mgr.14373) 6071 : cluster [DBG] pgmap v4209: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:57:26.142 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:57:26.143 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:57:26.143 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:57:26.896 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:57:26.896 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:57:26.896 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:57:26.897 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:57:26.897 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:57:27.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:57:26 smithi157 bash[24585]: cluster 2024-09-16T07:57:25.629557+0000 mgr.a (mgr.14373) 6072 : cluster [DBG] pgmap v4210: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:57:27.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:57:26 smithi086 bash[24289]: cluster 2024-09-16T07:57:25.629557+0000 mgr.a (mgr.14373) 6072 : cluster [DBG] pgmap v4210: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:57:27.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:57:26 smithi047 bash[22744]: cluster 2024-09-16T07:57:25.629557+0000 mgr.a (mgr.14373) 6072 : cluster [DBG] pgmap v4210: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:57:28.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:57:27 smithi157 bash[24585]: audit 2024-09-16T07:57:26.476565+0000 mgr.a (mgr.14373) 6073 : audit [DBG] from='client.139833 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:57:28.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:57:27 smithi086 bash[24289]: audit 2024-09-16T07:57:26.476565+0000 mgr.a (mgr.14373) 6073 : audit [DBG] from='client.139833 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:57:28.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:57:27 smithi047 bash[22744]: audit 2024-09-16T07:57:26.476565+0000 mgr.a (mgr.14373) 6073 : audit [DBG] from='client.139833 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:57:29.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:57:28 smithi157 bash[24585]: cluster 2024-09-16T07:57:27.632363+0000 mgr.a (mgr.14373) 6074 : cluster [DBG] pgmap v4211: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:57:29.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:57:28 smithi086 bash[24289]: cluster 2024-09-16T07:57:27.632363+0000 mgr.a (mgr.14373) 6074 : cluster [DBG] pgmap v4211: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:57:29.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:57:28 smithi047 bash[22744]: cluster 2024-09-16T07:57:27.632363+0000 mgr.a (mgr.14373) 6074 : cluster [DBG] pgmap v4211: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:57:31.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:57:30 smithi157 bash[24585]: cluster 2024-09-16T07:57:29.633145+0000 mgr.a (mgr.14373) 6075 : cluster [DBG] pgmap v4212: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:57:31.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:57:30 smithi086 bash[24289]: cluster 2024-09-16T07:57:29.633145+0000 mgr.a (mgr.14373) 6075 : cluster [DBG] pgmap v4212: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:57:31.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:57:30 smithi047 bash[22744]: cluster 2024-09-16T07:57:29.633145+0000 mgr.a (mgr.14373) 6075 : cluster [DBG] pgmap v4212: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:57:31.898 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:57:31.899 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:57:31.899 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:57:32.685 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:57:32.686 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:57:32.686 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:57:32.686 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:57:32.686 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:57:33.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:57:32 smithi157 bash[24585]: cluster 2024-09-16T07:57:31.635114+0000 mgr.a (mgr.14373) 6076 : cluster [DBG] pgmap v4213: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:57:33.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:57:32 smithi086 bash[24289]: cluster 2024-09-16T07:57:31.635114+0000 mgr.a (mgr.14373) 6076 : cluster [DBG] pgmap v4213: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:57:33.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:57:32 smithi047 bash[22744]: cluster 2024-09-16T07:57:31.635114+0000 mgr.a (mgr.14373) 6076 : cluster [DBG] pgmap v4213: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:57:34.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:57:33 smithi157 bash[24585]: audit 2024-09-16T07:57:32.241568+0000 mgr.a (mgr.14373) 6077 : audit [DBG] from='client.139908 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:57:34.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:57:33 smithi086 bash[24289]: audit 2024-09-16T07:57:32.241568+0000 mgr.a (mgr.14373) 6077 : audit [DBG] from='client.139908 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:57:34.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:57:33 smithi047 bash[22744]: audit 2024-09-16T07:57:32.241568+0000 mgr.a (mgr.14373) 6077 : audit [DBG] from='client.139908 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:57:35.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:57:34 smithi157 bash[24585]: cluster 2024-09-16T07:57:33.636120+0000 mgr.a (mgr.14373) 6078 : cluster [DBG] pgmap v4214: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:57:35.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:57:34 smithi086 bash[24289]: cluster 2024-09-16T07:57:33.636120+0000 mgr.a (mgr.14373) 6078 : cluster [DBG] pgmap v4214: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:57:35.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:57:34 smithi047 bash[22744]: cluster 2024-09-16T07:57:33.636120+0000 mgr.a (mgr.14373) 6078 : cluster [DBG] pgmap v4214: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:57:37.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:57:36 smithi157 bash[24585]: cluster 2024-09-16T07:57:35.636900+0000 mgr.a (mgr.14373) 6079 : cluster [DBG] pgmap v4215: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T07:57:37.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:57:36 smithi086 bash[24289]: cluster 2024-09-16T07:57:35.636900+0000 mgr.a (mgr.14373) 6079 : cluster [DBG] pgmap v4215: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T07:57:37.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:57:36 smithi047 bash[22744]: cluster 2024-09-16T07:57:35.636900+0000 mgr.a (mgr.14373) 6079 : cluster [DBG] pgmap v4215: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T07:57:37.687 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:57:37.688 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:57:37.688 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:57:38.457 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:57:38.457 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:57:38.457 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:57:38.457 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:57:38.458 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:57:39.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:57:38 smithi086 bash[24289]: cluster 2024-09-16T07:57:37.639125+0000 mgr.a (mgr.14373) 6080 : cluster [DBG] pgmap v4216: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:57:39.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:57:38 smithi086 bash[24289]: audit 2024-09-16T07:57:38.029726+0000 mgr.a (mgr.14373) 6081 : audit [DBG] from='client.139983 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:57:39.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:57:38 smithi047 bash[22744]: cluster 2024-09-16T07:57:37.639125+0000 mgr.a (mgr.14373) 6080 : cluster [DBG] pgmap v4216: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:57:39.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:57:38 smithi047 bash[22744]: audit 2024-09-16T07:57:38.029726+0000 mgr.a (mgr.14373) 6081 : audit [DBG] from='client.139983 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:57:39.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:57:38 smithi157 bash[24585]: cluster 2024-09-16T07:57:37.639125+0000 mgr.a (mgr.14373) 6080 : cluster [DBG] pgmap v4216: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:57:39.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:57:38 smithi157 bash[24585]: audit 2024-09-16T07:57:38.029726+0000 mgr.a (mgr.14373) 6081 : audit [DBG] from='client.139983 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:57:41.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:57:40 smithi086 bash[24289]: cluster 2024-09-16T07:57:39.640081+0000 mgr.a (mgr.14373) 6082 : cluster [DBG] pgmap v4217: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:57:41.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:57:40 smithi047 bash[22744]: cluster 2024-09-16T07:57:39.640081+0000 mgr.a (mgr.14373) 6082 : cluster [DBG] pgmap v4217: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:57:41.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:57:40 smithi157 bash[24585]: cluster 2024-09-16T07:57:39.640081+0000 mgr.a (mgr.14373) 6082 : cluster [DBG] pgmap v4217: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:57:43.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:57:42 smithi086 bash[24289]: cluster 2024-09-16T07:57:41.642201+0000 mgr.a (mgr.14373) 6083 : cluster [DBG] pgmap v4218: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:57:43.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:57:42 smithi047 bash[22744]: cluster 2024-09-16T07:57:41.642201+0000 mgr.a (mgr.14373) 6083 : cluster [DBG] pgmap v4218: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:57:43.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:57:42 smithi157 bash[24585]: cluster 2024-09-16T07:57:41.642201+0000 mgr.a (mgr.14373) 6083 : cluster [DBG] pgmap v4218: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:57:43.458 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:57:43.458 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:57:43.459 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:57:44.241 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:57:44.242 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:57:44.242 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:57:44.242 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:57:44.242 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:57:45.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:57:44 smithi086 bash[24289]: cluster 2024-09-16T07:57:43.642654+0000 mgr.a (mgr.14373) 6084 : cluster [DBG] pgmap v4219: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:57:45.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:57:44 smithi086 bash[24289]: audit 2024-09-16T07:57:43.795681+0000 mgr.a (mgr.14373) 6085 : audit [DBG] from='client.140061 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:57:45.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:57:44 smithi047 bash[22744]: cluster 2024-09-16T07:57:43.642654+0000 mgr.a (mgr.14373) 6084 : cluster [DBG] pgmap v4219: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:57:45.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:57:44 smithi047 bash[22744]: audit 2024-09-16T07:57:43.795681+0000 mgr.a (mgr.14373) 6085 : audit [DBG] from='client.140061 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:57:45.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:57:44 smithi157 bash[24585]: cluster 2024-09-16T07:57:43.642654+0000 mgr.a (mgr.14373) 6084 : cluster [DBG] pgmap v4219: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:57:45.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:57:44 smithi157 bash[24585]: audit 2024-09-16T07:57:43.795681+0000 mgr.a (mgr.14373) 6085 : audit [DBG] from='client.140061 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:57:47.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:57:46 smithi047 bash[22744]: cluster 2024-09-16T07:57:45.643551+0000 mgr.a (mgr.14373) 6086 : cluster [DBG] pgmap v4220: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:57:47.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:57:46 smithi157 bash[24585]: cluster 2024-09-16T07:57:45.643551+0000 mgr.a (mgr.14373) 6086 : cluster [DBG] pgmap v4220: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:57:47.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:57:46 smithi086 bash[24289]: cluster 2024-09-16T07:57:45.643551+0000 mgr.a (mgr.14373) 6086 : cluster [DBG] pgmap v4220: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:57:49.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:57:48 smithi047 bash[22744]: cluster 2024-09-16T07:57:47.645785+0000 mgr.a (mgr.14373) 6087 : cluster [DBG] pgmap v4221: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:57:49.243 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:57:49.244 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:57:49.244 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:57:49.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:57:48 smithi157 bash[24585]: cluster 2024-09-16T07:57:47.645785+0000 mgr.a (mgr.14373) 6087 : cluster [DBG] pgmap v4221: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:57:49.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:57:48 smithi086 bash[24289]: cluster 2024-09-16T07:57:47.645785+0000 mgr.a (mgr.14373) 6087 : cluster [DBG] pgmap v4221: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:57:50.021 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:57:50.021 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:57:50.021 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:57:50.021 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:57:50.022 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:57:51.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:57:50 smithi047 bash[22744]: audit 2024-09-16T07:57:49.580569+0000 mgr.a (mgr.14373) 6088 : audit [DBG] from='client.140136 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:57:51.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:57:50 smithi047 bash[22744]: cluster 2024-09-16T07:57:49.646333+0000 mgr.a (mgr.14373) 6089 : cluster [DBG] pgmap v4222: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:57:51.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:57:50 smithi157 bash[24585]: audit 2024-09-16T07:57:49.580569+0000 mgr.a (mgr.14373) 6088 : audit [DBG] from='client.140136 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:57:51.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:57:50 smithi157 bash[24585]: cluster 2024-09-16T07:57:49.646333+0000 mgr.a (mgr.14373) 6089 : cluster [DBG] pgmap v4222: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:57:51.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:57:50 smithi086 bash[24289]: audit 2024-09-16T07:57:49.580569+0000 mgr.a (mgr.14373) 6088 : audit [DBG] from='client.140136 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:57:51.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:57:50 smithi086 bash[24289]: cluster 2024-09-16T07:57:49.646333+0000 mgr.a (mgr.14373) 6089 : cluster [DBG] pgmap v4222: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:57:53.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:57:52 smithi047 bash[22744]: cluster 2024-09-16T07:57:51.648552+0000 mgr.a (mgr.14373) 6090 : cluster [DBG] pgmap v4223: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:57:53.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:57:52 smithi157 bash[24585]: cluster 2024-09-16T07:57:51.648552+0000 mgr.a (mgr.14373) 6090 : cluster [DBG] pgmap v4223: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:57:53.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:57:52 smithi086 bash[24289]: cluster 2024-09-16T07:57:51.648552+0000 mgr.a (mgr.14373) 6090 : cluster [DBG] pgmap v4223: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:57:55.023 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:57:55.024 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:57:55.024 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:57:55.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:57:54 smithi047 bash[22744]: cluster 2024-09-16T07:57:53.649330+0000 mgr.a (mgr.14373) 6091 : cluster [DBG] pgmap v4224: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:57:55.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:57:54 smithi157 bash[24585]: cluster 2024-09-16T07:57:53.649330+0000 mgr.a (mgr.14373) 6091 : cluster [DBG] pgmap v4224: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:57:55.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:57:54 smithi086 bash[24289]: cluster 2024-09-16T07:57:53.649330+0000 mgr.a (mgr.14373) 6091 : cluster [DBG] pgmap v4224: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:57:55.762 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:57:55.762 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:57:55.762 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:57:55.762 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:57:55.762 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:57:57.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:57:56 smithi157 bash[24585]: audit 2024-09-16T07:57:55.353628+0000 mgr.a (mgr.14373) 6092 : audit [DBG] from='client.140214 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:57:57.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:57:56 smithi157 bash[24585]: cluster 2024-09-16T07:57:55.649810+0000 mgr.a (mgr.14373) 6093 : cluster [DBG] pgmap v4225: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:57:57.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:57:56 smithi086 bash[24289]: audit 2024-09-16T07:57:55.353628+0000 mgr.a (mgr.14373) 6092 : audit [DBG] from='client.140214 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:57:57.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:57:56 smithi086 bash[24289]: cluster 2024-09-16T07:57:55.649810+0000 mgr.a (mgr.14373) 6093 : cluster [DBG] pgmap v4225: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:57:57.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:57:56 smithi047 bash[22744]: audit 2024-09-16T07:57:55.353628+0000 mgr.a (mgr.14373) 6092 : audit [DBG] from='client.140214 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:57:57.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:57:56 smithi047 bash[22744]: cluster 2024-09-16T07:57:55.649810+0000 mgr.a (mgr.14373) 6093 : cluster [DBG] pgmap v4225: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:57:59.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:57:58 smithi157 bash[24585]: cluster 2024-09-16T07:57:57.652219+0000 mgr.a (mgr.14373) 6094 : cluster [DBG] pgmap v4226: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:57:59.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:57:58 smithi086 bash[24289]: cluster 2024-09-16T07:57:57.652219+0000 mgr.a (mgr.14373) 6094 : cluster [DBG] pgmap v4226: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:57:59.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:57:58 smithi047 bash[22744]: cluster 2024-09-16T07:57:57.652219+0000 mgr.a (mgr.14373) 6094 : cluster [DBG] pgmap v4226: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:58:00.763 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:58:00.764 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:58:00.764 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:58:01.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:58:00 smithi157 bash[24585]: cluster 2024-09-16T07:57:59.653199+0000 mgr.a (mgr.14373) 6095 : cluster [DBG] pgmap v4227: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:58:01.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:58:00 smithi086 bash[24289]: cluster 2024-09-16T07:57:59.653199+0000 mgr.a (mgr.14373) 6095 : cluster [DBG] pgmap v4227: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:58:01.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:58:00 smithi047 bash[22744]: cluster 2024-09-16T07:57:59.653199+0000 mgr.a (mgr.14373) 6095 : cluster [DBG] pgmap v4227: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:58:01.537 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:58:01.538 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:58:01.538 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:58:01.538 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:58:01.538 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:58:02.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:58:01 smithi157 bash[24585]: audit 2024-09-16T07:58:01.105661+0000 mgr.a (mgr.14373) 6096 : audit [DBG] from='client.140292 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:58:02.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:58:01 smithi086 bash[24289]: audit 2024-09-16T07:58:01.105661+0000 mgr.a (mgr.14373) 6096 : audit [DBG] from='client.140292 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:58:02.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:58:01 smithi047 bash[22744]: audit 2024-09-16T07:58:01.105661+0000 mgr.a (mgr.14373) 6096 : audit [DBG] from='client.140292 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:58:03.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:58:02 smithi157 bash[24585]: cluster 2024-09-16T07:58:01.656047+0000 mgr.a (mgr.14373) 6097 : cluster [DBG] pgmap v4228: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-16T07:58:03.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:58:02 smithi086 bash[24289]: cluster 2024-09-16T07:58:01.656047+0000 mgr.a (mgr.14373) 6097 : cluster [DBG] pgmap v4228: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-16T07:58:03.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:58:02 smithi047 bash[22744]: cluster 2024-09-16T07:58:01.656047+0000 mgr.a (mgr.14373) 6097 : cluster [DBG] pgmap v4228: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-16T07:58:05.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:58:04 smithi157 bash[24585]: cluster 2024-09-16T07:58:03.656853+0000 mgr.a (mgr.14373) 6098 : cluster [DBG] pgmap v4229: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T07:58:05.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:58:04 smithi157 bash[24585]: audit 2024-09-16T07:58:04.757389+0000 mon.b (mon.2) 586 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T07:58:05.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:58:04 smithi086 bash[24289]: cluster 2024-09-16T07:58:03.656853+0000 mgr.a (mgr.14373) 6098 : cluster [DBG] pgmap v4229: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T07:58:05.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:58:04 smithi086 bash[24289]: audit 2024-09-16T07:58:04.757389+0000 mon.b (mon.2) 586 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T07:58:05.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:58:04 smithi047 bash[22744]: cluster 2024-09-16T07:58:03.656853+0000 mgr.a (mgr.14373) 6098 : cluster [DBG] pgmap v4229: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T07:58:05.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:58:04 smithi047 bash[22744]: audit 2024-09-16T07:58:04.757389+0000 mon.b (mon.2) 586 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T07:58:06.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:58:05 smithi157 bash[24585]: audit 2024-09-16T07:58:05.587102+0000 mon.b (mon.2) 587 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T07:58:06.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:58:05 smithi157 bash[24585]: audit 2024-09-16T07:58:05.589144+0000 mon.b (mon.2) 588 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T07:58:06.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:58:05 smithi157 bash[24585]: audit 2024-09-16T07:58:05.602725+0000 mon.a (mon.0) 930 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:58:06.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:58:05 smithi157 bash[24585]: audit 2024-09-16T07:58:05.605985+0000 mon.b (mon.2) 589 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:58:06.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:58:05 smithi086 bash[24289]: audit 2024-09-16T07:58:05.587102+0000 mon.b (mon.2) 587 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T07:58:06.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:58:05 smithi086 bash[24289]: audit 2024-09-16T07:58:05.589144+0000 mon.b (mon.2) 588 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T07:58:06.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:58:05 smithi086 bash[24289]: audit 2024-09-16T07:58:05.602725+0000 mon.a (mon.0) 930 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:58:06.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:58:05 smithi086 bash[24289]: audit 2024-09-16T07:58:05.605985+0000 mon.b (mon.2) 589 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:58:06.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:58:05 smithi047 bash[22744]: audit 2024-09-16T07:58:05.587102+0000 mon.b (mon.2) 587 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T07:58:06.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:58:05 smithi047 bash[22744]: audit 2024-09-16T07:58:05.589144+0000 mon.b (mon.2) 588 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T07:58:06.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:58:05 smithi047 bash[22744]: audit 2024-09-16T07:58:05.602725+0000 mon.a (mon.0) 930 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:58:06.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:58:05 smithi047 bash[22744]: audit 2024-09-16T07:58:05.605985+0000 mon.b (mon.2) 589 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:58:06.539 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:58:06.539 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:58:06.540 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:58:06.837 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 07:58:06 smithi047 bash[22994]: debug 2024-09-16T07:58:06.342+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T07:58:06.837 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 07:58:06 smithi047 bash[22994]: debug 2024-09-16T07:58:06.342+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T07:58:07.289 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:58:07.289 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:58:07.289 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:58:07.289 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:58:07.289 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:58:07.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:58:06 smithi157 bash[24585]: audit 2024-09-16T07:58:05.610672+0000 mgr.a (mgr.14373) 6099 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:58:07.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:58:06 smithi157 bash[24585]: cluster 2024-09-16T07:58:05.657628+0000 mgr.a (mgr.14373) 6100 : cluster [DBG] pgmap v4230: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T07:58:07.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:58:06 smithi086 bash[24289]: audit 2024-09-16T07:58:05.610672+0000 mgr.a (mgr.14373) 6099 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:58:07.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:58:06 smithi086 bash[24289]: cluster 2024-09-16T07:58:05.657628+0000 mgr.a (mgr.14373) 6100 : cluster [DBG] pgmap v4230: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T07:58:07.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:58:06 smithi047 bash[22744]: audit 2024-09-16T07:58:05.610672+0000 mgr.a (mgr.14373) 6099 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:58:07.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:58:06 smithi047 bash[22744]: cluster 2024-09-16T07:58:05.657628+0000 mgr.a (mgr.14373) 6100 : cluster [DBG] pgmap v4230: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T07:58:08.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:58:07 smithi157 bash[24585]: audit 2024-09-16T07:58:06.342623+0000 mgr.a (mgr.14373) 6101 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T07:58:08.653 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:58:07 smithi157 bash[24585]: cephadm 2024-09-16T07:58:06.344690+0000 mgr.a (mgr.14373) 6102 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T07:58:08.654 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:58:07 smithi157 bash[24585]: audit 2024-09-16T07:58:06.873909+0000 mgr.a (mgr.14373) 6103 : audit [DBG] from='client.140469 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:58:08.654 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:58:07 smithi047 bash[22744]: audit 2024-09-16T07:58:06.342623+0000 mgr.a (mgr.14373) 6101 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T07:58:08.654 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:58:07 smithi047 bash[22744]: cephadm 2024-09-16T07:58:06.344690+0000 mgr.a (mgr.14373) 6102 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T07:58:08.655 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:58:07 smithi047 bash[22744]: audit 2024-09-16T07:58:06.873909+0000 mgr.a (mgr.14373) 6103 : audit [DBG] from='client.140469 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:58:08.655 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:58:07 smithi086 bash[24289]: audit 2024-09-16T07:58:06.342623+0000 mgr.a (mgr.14373) 6101 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T07:58:08.655 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:58:07 smithi086 bash[24289]: cephadm 2024-09-16T07:58:06.344690+0000 mgr.a (mgr.14373) 6102 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T07:58:08.655 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:58:07 smithi086 bash[24289]: audit 2024-09-16T07:58:06.873909+0000 mgr.a (mgr.14373) 6103 : audit [DBG] from='client.140469 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:58:09.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:58:08 smithi157 bash[24585]: cluster 2024-09-16T07:58:07.660502+0000 mgr.a (mgr.14373) 6104 : cluster [DBG] pgmap v4231: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 11 KiB/s rd, 426 B/s wr, 13 op/s 2024-09-16T07:58:09.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:58:08 smithi086 bash[24289]: cluster 2024-09-16T07:58:07.660502+0000 mgr.a (mgr.14373) 6104 : cluster [DBG] pgmap v4231: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 11 KiB/s rd, 426 B/s wr, 13 op/s 2024-09-16T07:58:09.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:58:08 smithi047 bash[22744]: cluster 2024-09-16T07:58:07.660502+0000 mgr.a (mgr.14373) 6104 : cluster [DBG] pgmap v4231: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 11 KiB/s rd, 426 B/s wr, 13 op/s 2024-09-16T07:58:11.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:58:10 smithi157 bash[24585]: cluster 2024-09-16T07:58:09.661257+0000 mgr.a (mgr.14373) 6105 : cluster [DBG] pgmap v4232: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 10 KiB/s rd, 426 B/s wr, 12 op/s 2024-09-16T07:58:11.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:58:10 smithi086 bash[24289]: cluster 2024-09-16T07:58:09.661257+0000 mgr.a (mgr.14373) 6105 : cluster [DBG] pgmap v4232: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 10 KiB/s rd, 426 B/s wr, 12 op/s 2024-09-16T07:58:11.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:58:10 smithi047 bash[22744]: cluster 2024-09-16T07:58:09.661257+0000 mgr.a (mgr.14373) 6105 : cluster [DBG] pgmap v4232: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 10 KiB/s rd, 426 B/s wr, 12 op/s 2024-09-16T07:58:12.290 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:58:12.291 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:58:12.291 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:58:13.071 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:58:13.072 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:58:13.072 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:58:13.072 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:58:13.072 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:58:13.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:58:12 smithi157 bash[24585]: cluster 2024-09-16T07:58:11.663206+0000 mgr.a (mgr.14373) 6106 : cluster [DBG] pgmap v4233: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 11 KiB/s rd, 426 B/s wr, 13 op/s 2024-09-16T07:58:13.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:58:12 smithi086 bash[24289]: cluster 2024-09-16T07:58:11.663206+0000 mgr.a (mgr.14373) 6106 : cluster [DBG] pgmap v4233: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 11 KiB/s rd, 426 B/s wr, 13 op/s 2024-09-16T07:58:13.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:58:12 smithi047 bash[22744]: cluster 2024-09-16T07:58:11.663206+0000 mgr.a (mgr.14373) 6106 : cluster [DBG] pgmap v4233: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 11 KiB/s rd, 426 B/s wr, 13 op/s 2024-09-16T07:58:14.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:58:13 smithi157 bash[24585]: audit 2024-09-16T07:58:12.628494+0000 mgr.a (mgr.14373) 6107 : audit [DBG] from='client.140547 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:58:14.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:58:13 smithi086 bash[24289]: audit 2024-09-16T07:58:12.628494+0000 mgr.a (mgr.14373) 6107 : audit [DBG] from='client.140547 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:58:14.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:58:13 smithi047 bash[22744]: audit 2024-09-16T07:58:12.628494+0000 mgr.a (mgr.14373) 6107 : audit [DBG] from='client.140547 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:58:15.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:58:14 smithi157 bash[24585]: cluster 2024-09-16T07:58:13.664245+0000 mgr.a (mgr.14373) 6108 : cluster [DBG] pgmap v4234: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 10 KiB/s rd, 426 B/s wr, 13 op/s 2024-09-16T07:58:15.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:58:14 smithi086 bash[24289]: cluster 2024-09-16T07:58:13.664245+0000 mgr.a (mgr.14373) 6108 : cluster [DBG] pgmap v4234: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 10 KiB/s rd, 426 B/s wr, 13 op/s 2024-09-16T07:58:15.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:58:14 smithi047 bash[22744]: cluster 2024-09-16T07:58:13.664245+0000 mgr.a (mgr.14373) 6108 : cluster [DBG] pgmap v4234: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 10 KiB/s rd, 426 B/s wr, 13 op/s 2024-09-16T07:58:17.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:58:16 smithi157 bash[24585]: cluster 2024-09-16T07:58:15.665051+0000 mgr.a (mgr.14373) 6109 : cluster [DBG] pgmap v4235: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 10 KiB/s rd, 426 B/s wr, 13 op/s 2024-09-16T07:58:17.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:58:16 smithi086 bash[24289]: cluster 2024-09-16T07:58:15.665051+0000 mgr.a (mgr.14373) 6109 : cluster [DBG] pgmap v4235: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 10 KiB/s rd, 426 B/s wr, 13 op/s 2024-09-16T07:58:17.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:58:16 smithi047 bash[22744]: cluster 2024-09-16T07:58:15.665051+0000 mgr.a (mgr.14373) 6109 : cluster [DBG] pgmap v4235: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 10 KiB/s rd, 426 B/s wr, 13 op/s 2024-09-16T07:58:18.073 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:58:18.074 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:58:18.074 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:58:18.859 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:58:18.860 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:58:18.860 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:58:18.860 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:58:18.860 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:58:19.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:58:18 smithi157 bash[24585]: cluster 2024-09-16T07:58:17.667294+0000 mgr.a (mgr.14373) 6110 : cluster [DBG] pgmap v4236: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 75 KiB/s rd, 426 B/s wr, 119 op/s 2024-09-16T07:58:19.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:58:18 smithi086 bash[24289]: cluster 2024-09-16T07:58:17.667294+0000 mgr.a (mgr.14373) 6110 : cluster [DBG] pgmap v4236: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 75 KiB/s rd, 426 B/s wr, 119 op/s 2024-09-16T07:58:19.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:58:18 smithi047 bash[22744]: cluster 2024-09-16T07:58:17.667294+0000 mgr.a (mgr.14373) 6110 : cluster [DBG] pgmap v4236: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 75 KiB/s rd, 426 B/s wr, 119 op/s 2024-09-16T07:58:20.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:58:19 smithi157 bash[24585]: audit 2024-09-16T07:58:18.414894+0000 mgr.a (mgr.14373) 6111 : audit [DBG] from='client.140625 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:58:20.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:58:19 smithi086 bash[24289]: audit 2024-09-16T07:58:18.414894+0000 mgr.a (mgr.14373) 6111 : audit [DBG] from='client.140625 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:58:20.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:58:19 smithi047 bash[22744]: audit 2024-09-16T07:58:18.414894+0000 mgr.a (mgr.14373) 6111 : audit [DBG] from='client.140625 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:58:21.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:58:20 smithi157 bash[24585]: cluster 2024-09-16T07:58:19.668280+0000 mgr.a (mgr.14373) 6112 : cluster [DBG] pgmap v4237: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 65 KiB/s rd, 0 B/s wr, 107 op/s 2024-09-16T07:58:21.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:58:20 smithi086 bash[24289]: cluster 2024-09-16T07:58:19.668280+0000 mgr.a (mgr.14373) 6112 : cluster [DBG] pgmap v4237: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 65 KiB/s rd, 0 B/s wr, 107 op/s 2024-09-16T07:58:21.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:58:20 smithi047 bash[22744]: cluster 2024-09-16T07:58:19.668280+0000 mgr.a (mgr.14373) 6112 : cluster [DBG] pgmap v4237: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 65 KiB/s rd, 0 B/s wr, 107 op/s 2024-09-16T07:58:23.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:58:22 smithi157 bash[24585]: cluster 2024-09-16T07:58:21.670547+0000 mgr.a (mgr.14373) 6113 : cluster [DBG] pgmap v4238: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 66 KiB/s rd, 0 B/s wr, 108 op/s 2024-09-16T07:58:23.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:58:22 smithi086 bash[24289]: cluster 2024-09-16T07:58:21.670547+0000 mgr.a (mgr.14373) 6113 : cluster [DBG] pgmap v4238: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 66 KiB/s rd, 0 B/s wr, 108 op/s 2024-09-16T07:58:23.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:58:22 smithi047 bash[22744]: cluster 2024-09-16T07:58:21.670547+0000 mgr.a (mgr.14373) 6113 : cluster [DBG] pgmap v4238: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 66 KiB/s rd, 0 B/s wr, 108 op/s 2024-09-16T07:58:23.860 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:58:23.861 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:58:23.861 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:58:24.641 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:58:24.641 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:58:24.641 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:58:24.641 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:58:24.642 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:58:25.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:58:24 smithi157 bash[24585]: cluster 2024-09-16T07:58:23.671349+0000 mgr.a (mgr.14373) 6114 : cluster [DBG] pgmap v4239: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 65 KiB/s rd, 0 B/s wr, 107 op/s 2024-09-16T07:58:25.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:58:24 smithi157 bash[24585]: audit 2024-09-16T07:58:24.201454+0000 mgr.a (mgr.14373) 6115 : audit [DBG] from='client.140703 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:58:25.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:58:24 smithi086 bash[24289]: cluster 2024-09-16T07:58:23.671349+0000 mgr.a (mgr.14373) 6114 : cluster [DBG] pgmap v4239: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 65 KiB/s rd, 0 B/s wr, 107 op/s 2024-09-16T07:58:25.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:58:24 smithi086 bash[24289]: audit 2024-09-16T07:58:24.201454+0000 mgr.a (mgr.14373) 6115 : audit [DBG] from='client.140703 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:58:25.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:58:24 smithi047 bash[22744]: cluster 2024-09-16T07:58:23.671349+0000 mgr.a (mgr.14373) 6114 : cluster [DBG] pgmap v4239: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 65 KiB/s rd, 0 B/s wr, 107 op/s 2024-09-16T07:58:25.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:58:24 smithi047 bash[22744]: audit 2024-09-16T07:58:24.201454+0000 mgr.a (mgr.14373) 6115 : audit [DBG] from='client.140703 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:58:27.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:58:26 smithi157 bash[24585]: cluster 2024-09-16T07:58:25.672337+0000 mgr.a (mgr.14373) 6116 : cluster [DBG] pgmap v4240: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 65 KiB/s rd, 0 B/s wr, 107 op/s 2024-09-16T07:58:27.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:58:26 smithi086 bash[24289]: cluster 2024-09-16T07:58:25.672337+0000 mgr.a (mgr.14373) 6116 : cluster [DBG] pgmap v4240: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 65 KiB/s rd, 0 B/s wr, 107 op/s 2024-09-16T07:58:27.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:58:26 smithi047 bash[22744]: cluster 2024-09-16T07:58:25.672337+0000 mgr.a (mgr.14373) 6116 : cluster [DBG] pgmap v4240: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 65 KiB/s rd, 0 B/s wr, 107 op/s 2024-09-16T07:58:29.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:58:28 smithi157 bash[24585]: cluster 2024-09-16T07:58:27.674602+0000 mgr.a (mgr.14373) 6117 : cluster [DBG] pgmap v4241: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 66 KiB/s rd, 0 B/s wr, 108 op/s 2024-09-16T07:58:29.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:58:28 smithi086 bash[24289]: cluster 2024-09-16T07:58:27.674602+0000 mgr.a (mgr.14373) 6117 : cluster [DBG] pgmap v4241: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 66 KiB/s rd, 0 B/s wr, 108 op/s 2024-09-16T07:58:29.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:58:28 smithi047 bash[22744]: cluster 2024-09-16T07:58:27.674602+0000 mgr.a (mgr.14373) 6117 : cluster [DBG] pgmap v4241: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 66 KiB/s rd, 0 B/s wr, 108 op/s 2024-09-16T07:58:29.642 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:58:29.643 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:58:29.644 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:58:30.387 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:58:30.387 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:58:30.388 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:58:30.388 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:58:30.388 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:58:31.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:58:30 smithi157 bash[24585]: cluster 2024-09-16T07:58:29.675221+0000 mgr.a (mgr.14373) 6118 : cluster [DBG] pgmap v4242: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:58:31.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:58:30 smithi157 bash[24585]: audit 2024-09-16T07:58:29.976691+0000 mgr.a (mgr.14373) 6119 : audit [DBG] from='client.140781 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:58:31.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:58:30 smithi086 bash[24289]: cluster 2024-09-16T07:58:29.675221+0000 mgr.a (mgr.14373) 6118 : cluster [DBG] pgmap v4242: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:58:31.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:58:30 smithi086 bash[24289]: audit 2024-09-16T07:58:29.976691+0000 mgr.a (mgr.14373) 6119 : audit [DBG] from='client.140781 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:58:31.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:58:30 smithi047 bash[22744]: cluster 2024-09-16T07:58:29.675221+0000 mgr.a (mgr.14373) 6118 : cluster [DBG] pgmap v4242: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:58:31.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:58:30 smithi047 bash[22744]: audit 2024-09-16T07:58:29.976691+0000 mgr.a (mgr.14373) 6119 : audit [DBG] from='client.140781 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:58:33.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:58:32 smithi157 bash[24585]: cluster 2024-09-16T07:58:31.677437+0000 mgr.a (mgr.14373) 6120 : cluster [DBG] pgmap v4243: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:58:33.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:58:32 smithi086 bash[24289]: cluster 2024-09-16T07:58:31.677437+0000 mgr.a (mgr.14373) 6120 : cluster [DBG] pgmap v4243: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:58:33.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:58:32 smithi047 bash[22744]: cluster 2024-09-16T07:58:31.677437+0000 mgr.a (mgr.14373) 6120 : cluster [DBG] pgmap v4243: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:58:35.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:58:34 smithi157 bash[24585]: cluster 2024-09-16T07:58:33.678214+0000 mgr.a (mgr.14373) 6121 : cluster [DBG] pgmap v4244: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:58:35.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:58:34 smithi086 bash[24289]: cluster 2024-09-16T07:58:33.678214+0000 mgr.a (mgr.14373) 6121 : cluster [DBG] pgmap v4244: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:58:35.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:58:34 smithi047 bash[22744]: cluster 2024-09-16T07:58:33.678214+0000 mgr.a (mgr.14373) 6121 : cluster [DBG] pgmap v4244: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:58:35.389 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:58:35.389 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:58:35.389 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:58:36.144 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:58:36.145 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:58:36.145 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:58:36.145 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:58:36.145 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:58:37.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:58:36 smithi157 bash[24585]: cluster 2024-09-16T07:58:35.679046+0000 mgr.a (mgr.14373) 6122 : cluster [DBG] pgmap v4245: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:58:37.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:58:36 smithi157 bash[24585]: audit 2024-09-16T07:58:35.726176+0000 mgr.a (mgr.14373) 6123 : audit [DBG] from='client.140859 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:58:37.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:58:36 smithi086 bash[24289]: cluster 2024-09-16T07:58:35.679046+0000 mgr.a (mgr.14373) 6122 : cluster [DBG] pgmap v4245: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:58:37.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:58:36 smithi086 bash[24289]: audit 2024-09-16T07:58:35.726176+0000 mgr.a (mgr.14373) 6123 : audit [DBG] from='client.140859 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:58:37.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:58:36 smithi047 bash[22744]: cluster 2024-09-16T07:58:35.679046+0000 mgr.a (mgr.14373) 6122 : cluster [DBG] pgmap v4245: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:58:37.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:58:36 smithi047 bash[22744]: audit 2024-09-16T07:58:35.726176+0000 mgr.a (mgr.14373) 6123 : audit [DBG] from='client.140859 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:58:39.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:58:38 smithi157 bash[24585]: cluster 2024-09-16T07:58:37.681422+0000 mgr.a (mgr.14373) 6124 : cluster [DBG] pgmap v4246: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:58:39.369 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:58:38 smithi047 bash[22744]: cluster 2024-09-16T07:58:37.681422+0000 mgr.a (mgr.14373) 6124 : cluster [DBG] pgmap v4246: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:58:39.370 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:58:38 smithi086 bash[24289]: cluster 2024-09-16T07:58:37.681422+0000 mgr.a (mgr.14373) 6124 : cluster [DBG] pgmap v4246: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:58:41.146 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:58:41.147 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:58:41.147 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:58:41.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:58:40 smithi157 bash[24585]: cluster 2024-09-16T07:58:39.682196+0000 mgr.a (mgr.14373) 6125 : cluster [DBG] pgmap v4247: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:58:41.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:58:40 smithi086 bash[24289]: cluster 2024-09-16T07:58:39.682196+0000 mgr.a (mgr.14373) 6125 : cluster [DBG] pgmap v4247: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:58:41.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:58:40 smithi047 bash[22744]: cluster 2024-09-16T07:58:39.682196+0000 mgr.a (mgr.14373) 6125 : cluster [DBG] pgmap v4247: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:58:41.931 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:58:41.932 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:58:41.932 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:58:41.932 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:58:41.932 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:58:43.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:58:42 smithi157 bash[24585]: audit 2024-09-16T07:58:41.486023+0000 mgr.a (mgr.14373) 6126 : audit [DBG] from='client.140934 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:58:43.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:58:42 smithi157 bash[24585]: cluster 2024-09-16T07:58:41.683556+0000 mgr.a (mgr.14373) 6127 : cluster [DBG] pgmap v4248: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:58:43.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:58:42 smithi086 bash[24289]: audit 2024-09-16T07:58:41.486023+0000 mgr.a (mgr.14373) 6126 : audit [DBG] from='client.140934 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:58:43.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:58:42 smithi086 bash[24289]: cluster 2024-09-16T07:58:41.683556+0000 mgr.a (mgr.14373) 6127 : cluster [DBG] pgmap v4248: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:58:43.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:58:42 smithi047 bash[22744]: audit 2024-09-16T07:58:41.486023+0000 mgr.a (mgr.14373) 6126 : audit [DBG] from='client.140934 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:58:43.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:58:42 smithi047 bash[22744]: cluster 2024-09-16T07:58:41.683556+0000 mgr.a (mgr.14373) 6127 : cluster [DBG] pgmap v4248: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:58:45.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:58:44 smithi157 bash[24585]: cluster 2024-09-16T07:58:43.684442+0000 mgr.a (mgr.14373) 6128 : cluster [DBG] pgmap v4249: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T07:58:45.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:58:44 smithi086 bash[24289]: cluster 2024-09-16T07:58:43.684442+0000 mgr.a (mgr.14373) 6128 : cluster [DBG] pgmap v4249: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T07:58:45.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:58:44 smithi047 bash[22744]: cluster 2024-09-16T07:58:43.684442+0000 mgr.a (mgr.14373) 6128 : cluster [DBG] pgmap v4249: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T07:58:46.933 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:58:46.934 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:58:46.934 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:58:47.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:58:46 smithi157 bash[24585]: cluster 2024-09-16T07:58:45.685201+0000 mgr.a (mgr.14373) 6129 : cluster [DBG] pgmap v4250: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T07:58:47.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:58:46 smithi086 bash[24289]: cluster 2024-09-16T07:58:45.685201+0000 mgr.a (mgr.14373) 6129 : cluster [DBG] pgmap v4250: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T07:58:47.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:58:46 smithi047 bash[22744]: cluster 2024-09-16T07:58:45.685201+0000 mgr.a (mgr.14373) 6129 : cluster [DBG] pgmap v4250: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T07:58:47.679 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:58:47.680 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:58:47.680 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:58:47.680 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:58:47.680 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:58:49.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:58:48 smithi157 bash[24585]: audit 2024-09-16T07:58:47.272800+0000 mgr.a (mgr.14373) 6130 : audit [DBG] from='client.141012 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:58:49.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:58:48 smithi157 bash[24585]: cluster 2024-09-16T07:58:47.686588+0000 mgr.a (mgr.14373) 6131 : cluster [DBG] pgmap v4251: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:58:49.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:58:48 smithi086 bash[24289]: audit 2024-09-16T07:58:47.272800+0000 mgr.a (mgr.14373) 6130 : audit [DBG] from='client.141012 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:58:49.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:58:48 smithi086 bash[24289]: cluster 2024-09-16T07:58:47.686588+0000 mgr.a (mgr.14373) 6131 : cluster [DBG] pgmap v4251: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:58:49.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:58:48 smithi047 bash[22744]: audit 2024-09-16T07:58:47.272800+0000 mgr.a (mgr.14373) 6130 : audit [DBG] from='client.141012 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:58:49.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:58:48 smithi047 bash[22744]: cluster 2024-09-16T07:58:47.686588+0000 mgr.a (mgr.14373) 6131 : cluster [DBG] pgmap v4251: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:58:51.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:58:50 smithi157 bash[24585]: cluster 2024-09-16T07:58:49.687461+0000 mgr.a (mgr.14373) 6132 : cluster [DBG] pgmap v4252: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T07:58:51.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:58:50 smithi086 bash[24289]: cluster 2024-09-16T07:58:49.687461+0000 mgr.a (mgr.14373) 6132 : cluster [DBG] pgmap v4252: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T07:58:51.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:58:50 smithi047 bash[22744]: cluster 2024-09-16T07:58:49.687461+0000 mgr.a (mgr.14373) 6132 : cluster [DBG] pgmap v4252: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T07:58:52.681 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:58:52.682 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:58:52.682 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:58:53.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:58:52 smithi157 bash[24585]: cluster 2024-09-16T07:58:51.689418+0000 mgr.a (mgr.14373) 6133 : cluster [DBG] pgmap v4253: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:58:53.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:58:52 smithi086 bash[24289]: cluster 2024-09-16T07:58:51.689418+0000 mgr.a (mgr.14373) 6133 : cluster [DBG] pgmap v4253: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:58:53.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:58:52 smithi047 bash[22744]: cluster 2024-09-16T07:58:51.689418+0000 mgr.a (mgr.14373) 6133 : cluster [DBG] pgmap v4253: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:58:53.467 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:58:53.467 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:58:53.467 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:58:53.467 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:58:53.468 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:58:54.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:58:54 smithi157 bash[24585]: audit 2024-09-16T07:58:53.021582+0000 mgr.a (mgr.14373) 6134 : audit [DBG] from='client.141087 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:58:54.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:58:54 smithi086 bash[24289]: audit 2024-09-16T07:58:53.021582+0000 mgr.a (mgr.14373) 6134 : audit [DBG] from='client.141087 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:58:54.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:58:54 smithi047 bash[22744]: audit 2024-09-16T07:58:53.021582+0000 mgr.a (mgr.14373) 6134 : audit [DBG] from='client.141087 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:58:55.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:58:55 smithi157 bash[24585]: cluster 2024-09-16T07:58:53.690381+0000 mgr.a (mgr.14373) 6135 : cluster [DBG] pgmap v4254: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:58:55.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:58:55 smithi086 bash[24289]: cluster 2024-09-16T07:58:53.690381+0000 mgr.a (mgr.14373) 6135 : cluster [DBG] pgmap v4254: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:58:55.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:58:55 smithi047 bash[22744]: cluster 2024-09-16T07:58:53.690381+0000 mgr.a (mgr.14373) 6135 : cluster [DBG] pgmap v4254: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:58:57.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:58:57 smithi157 bash[24585]: cluster 2024-09-16T07:58:55.691144+0000 mgr.a (mgr.14373) 6136 : cluster [DBG] pgmap v4255: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:58:57.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:58:57 smithi086 bash[24289]: cluster 2024-09-16T07:58:55.691144+0000 mgr.a (mgr.14373) 6136 : cluster [DBG] pgmap v4255: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:58:57.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:58:57 smithi047 bash[22744]: cluster 2024-09-16T07:58:55.691144+0000 mgr.a (mgr.14373) 6136 : cluster [DBG] pgmap v4255: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:58:58.468 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:58:58.469 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:58:58.469 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:58:59.246 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:58:59.246 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:58:59.246 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:58:59.246 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:58:59.246 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:58:59.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:58:59 smithi157 bash[24585]: cluster 2024-09-16T07:58:57.693346+0000 mgr.a (mgr.14373) 6137 : cluster [DBG] pgmap v4256: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:58:59.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:58:59 smithi086 bash[24289]: cluster 2024-09-16T07:58:57.693346+0000 mgr.a (mgr.14373) 6137 : cluster [DBG] pgmap v4256: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:58:59.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:58:59 smithi047 bash[22744]: cluster 2024-09-16T07:58:57.693346+0000 mgr.a (mgr.14373) 6137 : cluster [DBG] pgmap v4256: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:59:00.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:59:00 smithi157 bash[24585]: audit 2024-09-16T07:58:58.812910+0000 mgr.a (mgr.14373) 6138 : audit [DBG] from='client.141165 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:59:00.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:59:00 smithi086 bash[24289]: audit 2024-09-16T07:58:58.812910+0000 mgr.a (mgr.14373) 6138 : audit [DBG] from='client.141165 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:59:00.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:59:00 smithi047 bash[22744]: audit 2024-09-16T07:58:58.812910+0000 mgr.a (mgr.14373) 6138 : audit [DBG] from='client.141165 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:59:01.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:59:01 smithi157 bash[24585]: cluster 2024-09-16T07:58:59.694325+0000 mgr.a (mgr.14373) 6139 : cluster [DBG] pgmap v4257: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:59:01.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:59:01 smithi086 bash[24289]: cluster 2024-09-16T07:58:59.694325+0000 mgr.a (mgr.14373) 6139 : cluster [DBG] pgmap v4257: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:59:01.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:59:01 smithi047 bash[22744]: cluster 2024-09-16T07:58:59.694325+0000 mgr.a (mgr.14373) 6139 : cluster [DBG] pgmap v4257: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:59:02.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:59:02 smithi157 bash[24585]: cluster 2024-09-16T07:59:01.696654+0000 mgr.a (mgr.14373) 6140 : cluster [DBG] pgmap v4258: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:59:02.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:59:02 smithi086 bash[24289]: cluster 2024-09-16T07:59:01.696654+0000 mgr.a (mgr.14373) 6140 : cluster [DBG] pgmap v4258: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:59:02.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:59:02 smithi047 bash[22744]: cluster 2024-09-16T07:59:01.696654+0000 mgr.a (mgr.14373) 6140 : cluster [DBG] pgmap v4258: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:59:04.248 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:59:04.249 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:59:04.249 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:59:05.005 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:59:05.005 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:59:05.005 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:59:05.006 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:59:05.006 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:59:05.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:59:04 smithi157 bash[24585]: cluster 2024-09-16T07:59:03.697577+0000 mgr.a (mgr.14373) 6141 : cluster [DBG] pgmap v4259: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:59:05.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:59:04 smithi086 bash[24289]: cluster 2024-09-16T07:59:03.697577+0000 mgr.a (mgr.14373) 6141 : cluster [DBG] pgmap v4259: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:59:05.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:59:04 smithi047 bash[22744]: cluster 2024-09-16T07:59:03.697577+0000 mgr.a (mgr.14373) 6141 : cluster [DBG] pgmap v4259: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:59:06.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:59:05 smithi157 bash[24585]: audit 2024-09-16T07:59:04.584909+0000 mgr.a (mgr.14373) 6142 : audit [DBG] from='client.141240 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:59:06.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:59:05 smithi086 bash[24289]: audit 2024-09-16T07:59:04.584909+0000 mgr.a (mgr.14373) 6142 : audit [DBG] from='client.141240 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:59:06.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:59:05 smithi047 bash[22744]: audit 2024-09-16T07:59:04.584909+0000 mgr.a (mgr.14373) 6142 : audit [DBG] from='client.141240 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:59:07.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:59:06 smithi157 bash[24585]: cluster 2024-09-16T07:59:05.698655+0000 mgr.a (mgr.14373) 6143 : cluster [DBG] pgmap v4260: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:59:07.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:59:06 smithi157 bash[24585]: audit 2024-09-16T07:59:06.393640+0000 mon.b (mon.2) 590 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T07:59:07.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:59:06 smithi086 bash[24289]: cluster 2024-09-16T07:59:05.698655+0000 mgr.a (mgr.14373) 6143 : cluster [DBG] pgmap v4260: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:59:07.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:59:06 smithi086 bash[24289]: audit 2024-09-16T07:59:06.393640+0000 mon.b (mon.2) 590 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T07:59:07.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:59:06 smithi047 bash[22744]: cluster 2024-09-16T07:59:05.698655+0000 mgr.a (mgr.14373) 6143 : cluster [DBG] pgmap v4260: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:59:07.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:59:06 smithi047 bash[22744]: audit 2024-09-16T07:59:06.393640+0000 mon.b (mon.2) 590 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T07:59:08.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:59:08 smithi157 bash[24585]: audit 2024-09-16T07:59:07.027406+0000 mon.a (mon.0) 931 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:59:08.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:59:08 smithi157 bash[24585]: audit 2024-09-16T07:59:07.032058+0000 mon.a (mon.0) 932 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:59:08.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:59:08 smithi157 bash[24585]: audit 2024-09-16T07:59:07.838558+0000 mon.b (mon.2) 591 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T07:59:08.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:59:08 smithi157 bash[24585]: audit 2024-09-16T07:59:07.840782+0000 mon.b (mon.2) 592 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T07:59:08.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:59:08 smithi157 bash[24585]: audit 2024-09-16T07:59:07.852715+0000 mon.a (mon.0) 933 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:59:08.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:59:08 smithi157 bash[24585]: audit 2024-09-16T07:59:07.858274+0000 mon.b (mon.2) 593 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:59:08.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:59:08 smithi086 bash[24289]: audit 2024-09-16T07:59:07.027406+0000 mon.a (mon.0) 931 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:59:08.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:59:08 smithi086 bash[24289]: audit 2024-09-16T07:59:07.032058+0000 mon.a (mon.0) 932 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:59:08.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:59:08 smithi086 bash[24289]: audit 2024-09-16T07:59:07.838558+0000 mon.b (mon.2) 591 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T07:59:08.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:59:08 smithi086 bash[24289]: audit 2024-09-16T07:59:07.840782+0000 mon.b (mon.2) 592 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T07:59:08.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:59:08 smithi086 bash[24289]: audit 2024-09-16T07:59:07.852715+0000 mon.a (mon.0) 933 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:59:08.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:59:08 smithi086 bash[24289]: audit 2024-09-16T07:59:07.858274+0000 mon.b (mon.2) 593 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:59:08.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:59:08 smithi047 bash[22744]: audit 2024-09-16T07:59:07.027406+0000 mon.a (mon.0) 931 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:59:08.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:59:08 smithi047 bash[22744]: audit 2024-09-16T07:59:07.032058+0000 mon.a (mon.0) 932 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:59:08.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:59:08 smithi047 bash[22744]: audit 2024-09-16T07:59:07.838558+0000 mon.b (mon.2) 591 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T07:59:08.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:59:08 smithi047 bash[22744]: audit 2024-09-16T07:59:07.840782+0000 mon.b (mon.2) 592 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T07:59:08.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:59:08 smithi047 bash[22744]: audit 2024-09-16T07:59:07.852715+0000 mon.a (mon.0) 933 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T07:59:08.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:59:08 smithi047 bash[22744]: audit 2024-09-16T07:59:07.858274+0000 mon.b (mon.2) 593 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:59:08.837 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 07:59:08 smithi047 bash[22994]: debug 2024-09-16T07:59:08.584+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T07:59:08.837 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 07:59:08 smithi047 bash[22994]: debug 2024-09-16T07:59:08.584+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T07:59:09.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:59:09 smithi157 bash[24585]: cluster 2024-09-16T07:59:07.699835+0000 mgr.a (mgr.14373) 6144 : cluster [DBG] pgmap v4261: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:59:09.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:59:09 smithi157 bash[24585]: audit 2024-09-16T07:59:07.862911+0000 mgr.a (mgr.14373) 6145 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:59:09.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:59:09 smithi086 bash[24289]: cluster 2024-09-16T07:59:07.699835+0000 mgr.a (mgr.14373) 6144 : cluster [DBG] pgmap v4261: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:59:09.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:59:09 smithi086 bash[24289]: audit 2024-09-16T07:59:07.862911+0000 mgr.a (mgr.14373) 6145 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:59:09.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:59:09 smithi047 bash[22744]: cluster 2024-09-16T07:59:07.699835+0000 mgr.a (mgr.14373) 6144 : cluster [DBG] pgmap v4261: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:59:09.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:59:09 smithi047 bash[22744]: audit 2024-09-16T07:59:07.862911+0000 mgr.a (mgr.14373) 6145 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T07:59:10.008 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:59:10.008 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:59:10.009 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:59:10.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:59:10 smithi157 bash[24585]: audit 2024-09-16T07:59:08.587120+0000 mgr.a (mgr.14373) 6146 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T07:59:10.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:59:10 smithi157 bash[24585]: cephadm 2024-09-16T07:59:08.589046+0000 mgr.a (mgr.14373) 6147 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T07:59:10.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:59:10 smithi086 bash[24289]: audit 2024-09-16T07:59:08.587120+0000 mgr.a (mgr.14373) 6146 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T07:59:10.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:59:10 smithi086 bash[24289]: cephadm 2024-09-16T07:59:08.589046+0000 mgr.a (mgr.14373) 6147 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T07:59:10.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:59:10 smithi047 bash[22744]: audit 2024-09-16T07:59:08.587120+0000 mgr.a (mgr.14373) 6146 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T07:59:10.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:59:10 smithi047 bash[22744]: cephadm 2024-09-16T07:59:08.589046+0000 mgr.a (mgr.14373) 6147 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T07:59:10.746 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:59:10.746 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:59:10.746 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:59:10.746 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:59:10.747 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:59:11.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:59:11 smithi157 bash[24585]: cluster 2024-09-16T07:59:09.700829+0000 mgr.a (mgr.14373) 6148 : cluster [DBG] pgmap v4262: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:59:11.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:59:11 smithi086 bash[24289]: cluster 2024-09-16T07:59:09.700829+0000 mgr.a (mgr.14373) 6148 : cluster [DBG] pgmap v4262: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:59:11.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:59:11 smithi047 bash[22744]: cluster 2024-09-16T07:59:09.700829+0000 mgr.a (mgr.14373) 6148 : cluster [DBG] pgmap v4262: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:59:12.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:59:12 smithi086 bash[24289]: audit 2024-09-16T07:59:10.334027+0000 mgr.a (mgr.14373) 6149 : audit [DBG] from='client.141423 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:59:12.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:59:12 smithi047 bash[22744]: audit 2024-09-16T07:59:10.334027+0000 mgr.a (mgr.14373) 6149 : audit [DBG] from='client.141423 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:59:12.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:59:12 smithi157 bash[24585]: audit 2024-09-16T07:59:10.334027+0000 mgr.a (mgr.14373) 6149 : audit [DBG] from='client.141423 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:59:13.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:59:13 smithi086 bash[24289]: cluster 2024-09-16T07:59:11.703195+0000 mgr.a (mgr.14373) 6150 : cluster [DBG] pgmap v4263: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:59:13.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:59:13 smithi047 bash[22744]: cluster 2024-09-16T07:59:11.703195+0000 mgr.a (mgr.14373) 6150 : cluster [DBG] pgmap v4263: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:59:13.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:59:13 smithi157 bash[24585]: cluster 2024-09-16T07:59:11.703195+0000 mgr.a (mgr.14373) 6150 : cluster [DBG] pgmap v4263: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:59:15.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:59:15 smithi086 bash[24289]: cluster 2024-09-16T07:59:13.703963+0000 mgr.a (mgr.14373) 6151 : cluster [DBG] pgmap v4264: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:59:15.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:59:15 smithi047 bash[22744]: cluster 2024-09-16T07:59:13.703963+0000 mgr.a (mgr.14373) 6151 : cluster [DBG] pgmap v4264: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:59:15.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:59:15 smithi157 bash[24585]: cluster 2024-09-16T07:59:13.703963+0000 mgr.a (mgr.14373) 6151 : cluster [DBG] pgmap v4264: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:59:15.748 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:59:15.749 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:59:15.749 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:59:16.522 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:59:16.523 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:59:16.523 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:59:16.523 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:59:16.523 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:59:17.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:59:17 smithi086 bash[24289]: cluster 2024-09-16T07:59:15.704721+0000 mgr.a (mgr.14373) 6152 : cluster [DBG] pgmap v4265: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:59:17.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:59:17 smithi086 bash[24289]: audit 2024-09-16T07:59:16.092597+0000 mgr.a (mgr.14373) 6153 : audit [DBG] from='client.141501 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:59:17.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:59:17 smithi047 bash[22744]: cluster 2024-09-16T07:59:15.704721+0000 mgr.a (mgr.14373) 6152 : cluster [DBG] pgmap v4265: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:59:17.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:59:17 smithi047 bash[22744]: audit 2024-09-16T07:59:16.092597+0000 mgr.a (mgr.14373) 6153 : audit [DBG] from='client.141501 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:59:17.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:59:17 smithi157 bash[24585]: cluster 2024-09-16T07:59:15.704721+0000 mgr.a (mgr.14373) 6152 : cluster [DBG] pgmap v4265: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:59:17.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:59:17 smithi157 bash[24585]: audit 2024-09-16T07:59:16.092597+0000 mgr.a (mgr.14373) 6153 : audit [DBG] from='client.141501 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:59:19.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:59:19 smithi047 bash[22744]: cluster 2024-09-16T07:59:17.707116+0000 mgr.a (mgr.14373) 6154 : cluster [DBG] pgmap v4266: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:59:19.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:59:19 smithi157 bash[24585]: cluster 2024-09-16T07:59:17.707116+0000 mgr.a (mgr.14373) 6154 : cluster [DBG] pgmap v4266: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:59:19.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:59:19 smithi086 bash[24289]: cluster 2024-09-16T07:59:17.707116+0000 mgr.a (mgr.14373) 6154 : cluster [DBG] pgmap v4266: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:59:21.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:59:21 smithi047 bash[22744]: cluster 2024-09-16T07:59:19.707922+0000 mgr.a (mgr.14373) 6155 : cluster [DBG] pgmap v4267: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T07:59:21.524 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:59:21.525 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:59:21.525 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:59:21.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:59:21 smithi157 bash[24585]: cluster 2024-09-16T07:59:19.707922+0000 mgr.a (mgr.14373) 6155 : cluster [DBG] pgmap v4267: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T07:59:21.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:59:21 smithi086 bash[24289]: cluster 2024-09-16T07:59:19.707922+0000 mgr.a (mgr.14373) 6155 : cluster [DBG] pgmap v4267: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T07:59:22.276 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:59:22.276 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:59:22.276 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:59:22.277 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:59:22.277 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:59:23.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:59:23 smithi047 bash[22744]: cluster 2024-09-16T07:59:21.709779+0000 mgr.a (mgr.14373) 6156 : cluster [DBG] pgmap v4268: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:59:23.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:59:23 smithi047 bash[22744]: audit 2024-09-16T07:59:21.861478+0000 mgr.a (mgr.14373) 6157 : audit [DBG] from='client.141579 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:59:23.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:59:23 smithi157 bash[24585]: cluster 2024-09-16T07:59:21.709779+0000 mgr.a (mgr.14373) 6156 : cluster [DBG] pgmap v4268: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:59:23.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:59:23 smithi157 bash[24585]: audit 2024-09-16T07:59:21.861478+0000 mgr.a (mgr.14373) 6157 : audit [DBG] from='client.141579 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:59:23.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:59:23 smithi086 bash[24289]: cluster 2024-09-16T07:59:21.709779+0000 mgr.a (mgr.14373) 6156 : cluster [DBG] pgmap v4268: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T07:59:23.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:59:23 smithi086 bash[24289]: audit 2024-09-16T07:59:21.861478+0000 mgr.a (mgr.14373) 6157 : audit [DBG] from='client.141579 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:59:25.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:59:25 smithi047 bash[22744]: cluster 2024-09-16T07:59:23.710717+0000 mgr.a (mgr.14373) 6158 : cluster [DBG] pgmap v4269: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:59:25.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:59:25 smithi157 bash[24585]: cluster 2024-09-16T07:59:23.710717+0000 mgr.a (mgr.14373) 6158 : cluster [DBG] pgmap v4269: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:59:25.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:59:25 smithi086 bash[24289]: cluster 2024-09-16T07:59:23.710717+0000 mgr.a (mgr.14373) 6158 : cluster [DBG] pgmap v4269: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T07:59:27.278 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:59:27.279 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:59:27.279 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:59:27.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:59:27 smithi047 bash[22744]: cluster 2024-09-16T07:59:25.711489+0000 mgr.a (mgr.14373) 6159 : cluster [DBG] pgmap v4270: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T07:59:27.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:59:27 smithi157 bash[24585]: cluster 2024-09-16T07:59:25.711489+0000 mgr.a (mgr.14373) 6159 : cluster [DBG] pgmap v4270: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T07:59:27.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:59:27 smithi086 bash[24289]: cluster 2024-09-16T07:59:25.711489+0000 mgr.a (mgr.14373) 6159 : cluster [DBG] pgmap v4270: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T07:59:28.050 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:59:28.050 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:59:28.050 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:59:28.050 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:59:28.050 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:59:29.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:59:29 smithi157 bash[24585]: audit 2024-09-16T07:59:27.615481+0000 mgr.a (mgr.14373) 6160 : audit [DBG] from='client.141657 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:59:29.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:59:29 smithi157 bash[24585]: cluster 2024-09-16T07:59:27.712781+0000 mgr.a (mgr.14373) 6161 : cluster [DBG] pgmap v4271: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:59:29.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:59:29 smithi086 bash[24289]: audit 2024-09-16T07:59:27.615481+0000 mgr.a (mgr.14373) 6160 : audit [DBG] from='client.141657 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:59:29.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:59:29 smithi086 bash[24289]: cluster 2024-09-16T07:59:27.712781+0000 mgr.a (mgr.14373) 6161 : cluster [DBG] pgmap v4271: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:59:29.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:59:29 smithi047 bash[22744]: audit 2024-09-16T07:59:27.615481+0000 mgr.a (mgr.14373) 6160 : audit [DBG] from='client.141657 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:59:29.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:59:29 smithi047 bash[22744]: cluster 2024-09-16T07:59:27.712781+0000 mgr.a (mgr.14373) 6161 : cluster [DBG] pgmap v4271: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:59:31.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:59:31 smithi157 bash[24585]: cluster 2024-09-16T07:59:29.713757+0000 mgr.a (mgr.14373) 6162 : cluster [DBG] pgmap v4272: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-16T07:59:31.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:59:31 smithi086 bash[24289]: cluster 2024-09-16T07:59:29.713757+0000 mgr.a (mgr.14373) 6162 : cluster [DBG] pgmap v4272: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-16T07:59:31.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:59:31 smithi047 bash[22744]: cluster 2024-09-16T07:59:29.713757+0000 mgr.a (mgr.14373) 6162 : cluster [DBG] pgmap v4272: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-16T07:59:33.052 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:59:33.052 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:59:33.052 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:59:33.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:59:33 smithi157 bash[24585]: cluster 2024-09-16T07:59:31.715953+0000 mgr.a (mgr.14373) 6163 : cluster [DBG] pgmap v4273: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-16T07:59:33.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:59:33 smithi086 bash[24289]: cluster 2024-09-16T07:59:31.715953+0000 mgr.a (mgr.14373) 6163 : cluster [DBG] pgmap v4273: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-16T07:59:33.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:59:33 smithi047 bash[22744]: cluster 2024-09-16T07:59:31.715953+0000 mgr.a (mgr.14373) 6163 : cluster [DBG] pgmap v4273: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-16T07:59:33.785 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:59:33.785 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:59:33.785 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:59:33.785 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:59:33.785 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:59:35.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:59:35 smithi157 bash[24585]: audit 2024-09-16T07:59:33.387188+0000 mgr.a (mgr.14373) 6164 : audit [DBG] from='client.141732 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:59:35.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:59:35 smithi157 bash[24585]: cluster 2024-09-16T07:59:33.716745+0000 mgr.a (mgr.14373) 6165 : cluster [DBG] pgmap v4274: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:59:35.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:59:35 smithi086 bash[24289]: audit 2024-09-16T07:59:33.387188+0000 mgr.a (mgr.14373) 6164 : audit [DBG] from='client.141732 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:59:35.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:59:35 smithi086 bash[24289]: cluster 2024-09-16T07:59:33.716745+0000 mgr.a (mgr.14373) 6165 : cluster [DBG] pgmap v4274: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:59:35.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:59:35 smithi047 bash[22744]: audit 2024-09-16T07:59:33.387188+0000 mgr.a (mgr.14373) 6164 : audit [DBG] from='client.141732 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:59:35.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:59:35 smithi047 bash[22744]: cluster 2024-09-16T07:59:33.716745+0000 mgr.a (mgr.14373) 6165 : cluster [DBG] pgmap v4274: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:59:37.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:59:37 smithi157 bash[24585]: cluster 2024-09-16T07:59:35.717535+0000 mgr.a (mgr.14373) 6166 : cluster [DBG] pgmap v4275: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:59:37.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:59:37 smithi086 bash[24289]: cluster 2024-09-16T07:59:35.717535+0000 mgr.a (mgr.14373) 6166 : cluster [DBG] pgmap v4275: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:59:37.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:59:37 smithi047 bash[22744]: cluster 2024-09-16T07:59:35.717535+0000 mgr.a (mgr.14373) 6166 : cluster [DBG] pgmap v4275: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:59:38.786 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:59:38.787 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:59:38.787 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:59:39.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:59:39 smithi157 bash[24585]: cluster 2024-09-16T07:59:37.719777+0000 mgr.a (mgr.14373) 6167 : cluster [DBG] pgmap v4276: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:59:39.556 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:59:39.556 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:59:39.556 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:59:39.556 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:59:39.557 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:59:39.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:59:39 smithi086 bash[24289]: cluster 2024-09-16T07:59:37.719777+0000 mgr.a (mgr.14373) 6167 : cluster [DBG] pgmap v4276: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:59:39.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:59:39 smithi047 bash[22744]: cluster 2024-09-16T07:59:37.719777+0000 mgr.a (mgr.14373) 6167 : cluster [DBG] pgmap v4276: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:59:40.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:59:40 smithi157 bash[24585]: audit 2024-09-16T07:59:39.121432+0000 mgr.a (mgr.14373) 6168 : audit [DBG] from='client.141810 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:59:40.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:59:40 smithi086 bash[24289]: audit 2024-09-16T07:59:39.121432+0000 mgr.a (mgr.14373) 6168 : audit [DBG] from='client.141810 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:59:40.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:59:40 smithi047 bash[22744]: audit 2024-09-16T07:59:39.121432+0000 mgr.a (mgr.14373) 6168 : audit [DBG] from='client.141810 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:59:41.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:59:41 smithi157 bash[24585]: cluster 2024-09-16T07:59:39.720452+0000 mgr.a (mgr.14373) 6169 : cluster [DBG] pgmap v4277: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:59:41.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:59:41 smithi086 bash[24289]: cluster 2024-09-16T07:59:39.720452+0000 mgr.a (mgr.14373) 6169 : cluster [DBG] pgmap v4277: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:59:41.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:59:41 smithi047 bash[22744]: cluster 2024-09-16T07:59:39.720452+0000 mgr.a (mgr.14373) 6169 : cluster [DBG] pgmap v4277: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:59:43.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:59:43 smithi157 bash[24585]: cluster 2024-09-16T07:59:41.722600+0000 mgr.a (mgr.14373) 6170 : cluster [DBG] pgmap v4278: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:59:43.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:59:43 smithi086 bash[24289]: cluster 2024-09-16T07:59:41.722600+0000 mgr.a (mgr.14373) 6170 : cluster [DBG] pgmap v4278: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:59:43.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:59:43 smithi047 bash[22744]: cluster 2024-09-16T07:59:41.722600+0000 mgr.a (mgr.14373) 6170 : cluster [DBG] pgmap v4278: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:59:44.558 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:59:44.559 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:59:44.559 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:59:45.353 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:59:45.354 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:59:45.354 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:59:45.354 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:59:45.354 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:59:45.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:59:45 smithi157 bash[24585]: cluster 2024-09-16T07:59:43.723350+0000 mgr.a (mgr.14373) 6171 : cluster [DBG] pgmap v4279: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:59:45.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:59:45 smithi086 bash[24289]: cluster 2024-09-16T07:59:43.723350+0000 mgr.a (mgr.14373) 6171 : cluster [DBG] pgmap v4279: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:59:45.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:59:45 smithi047 bash[22744]: cluster 2024-09-16T07:59:43.723350+0000 mgr.a (mgr.14373) 6171 : cluster [DBG] pgmap v4279: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:59:46.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:59:46 smithi157 bash[24585]: audit 2024-09-16T07:59:44.902511+0000 mgr.a (mgr.14373) 6172 : audit [DBG] from='client.141888 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:59:46.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:59:46 smithi086 bash[24289]: audit 2024-09-16T07:59:44.902511+0000 mgr.a (mgr.14373) 6172 : audit [DBG] from='client.141888 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:59:46.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:59:46 smithi047 bash[22744]: audit 2024-09-16T07:59:44.902511+0000 mgr.a (mgr.14373) 6172 : audit [DBG] from='client.141888 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:59:47.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:59:47 smithi157 bash[24585]: cluster 2024-09-16T07:59:45.724232+0000 mgr.a (mgr.14373) 6173 : cluster [DBG] pgmap v4280: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:59:47.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:59:47 smithi086 bash[24289]: cluster 2024-09-16T07:59:45.724232+0000 mgr.a (mgr.14373) 6173 : cluster [DBG] pgmap v4280: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:59:47.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:59:47 smithi047 bash[22744]: cluster 2024-09-16T07:59:45.724232+0000 mgr.a (mgr.14373) 6173 : cluster [DBG] pgmap v4280: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:59:49.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:59:49 smithi157 bash[24585]: cluster 2024-09-16T07:59:47.726459+0000 mgr.a (mgr.14373) 6174 : cluster [DBG] pgmap v4281: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:59:49.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:59:49 smithi086 bash[24289]: cluster 2024-09-16T07:59:47.726459+0000 mgr.a (mgr.14373) 6174 : cluster [DBG] pgmap v4281: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:59:49.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:59:49 smithi047 bash[22744]: cluster 2024-09-16T07:59:47.726459+0000 mgr.a (mgr.14373) 6174 : cluster [DBG] pgmap v4281: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:59:50.355 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:59:50.355 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:59:50.356 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:59:51.132 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:59:51.132 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:59:51.132 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:59:51.133 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:59:51.133 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:59:51.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:59:51 smithi157 bash[24585]: cluster 2024-09-16T07:59:49.727201+0000 mgr.a (mgr.14373) 6175 : cluster [DBG] pgmap v4282: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:59:51.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:59:51 smithi086 bash[24289]: cluster 2024-09-16T07:59:49.727201+0000 mgr.a (mgr.14373) 6175 : cluster [DBG] pgmap v4282: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:59:51.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:59:51 smithi047 bash[22744]: cluster 2024-09-16T07:59:49.727201+0000 mgr.a (mgr.14373) 6175 : cluster [DBG] pgmap v4282: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:59:52.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:59:52 smithi157 bash[24585]: audit 2024-09-16T07:59:50.692706+0000 mgr.a (mgr.14373) 6176 : audit [DBG] from='client.141966 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:59:52.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:59:52 smithi086 bash[24289]: audit 2024-09-16T07:59:50.692706+0000 mgr.a (mgr.14373) 6176 : audit [DBG] from='client.141966 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:59:52.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:59:52 smithi047 bash[22744]: audit 2024-09-16T07:59:50.692706+0000 mgr.a (mgr.14373) 6176 : audit [DBG] from='client.141966 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:59:53.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:59:53 smithi157 bash[24585]: cluster 2024-09-16T07:59:51.729440+0000 mgr.a (mgr.14373) 6177 : cluster [DBG] pgmap v4283: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:59:53.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:59:53 smithi086 bash[24289]: cluster 2024-09-16T07:59:51.729440+0000 mgr.a (mgr.14373) 6177 : cluster [DBG] pgmap v4283: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:59:53.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:59:53 smithi047 bash[22744]: cluster 2024-09-16T07:59:51.729440+0000 mgr.a (mgr.14373) 6177 : cluster [DBG] pgmap v4283: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T07:59:55.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:59:55 smithi157 bash[24585]: cluster 2024-09-16T07:59:53.730197+0000 mgr.a (mgr.14373) 6178 : cluster [DBG] pgmap v4284: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:59:55.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:59:55 smithi086 bash[24289]: cluster 2024-09-16T07:59:53.730197+0000 mgr.a (mgr.14373) 6178 : cluster [DBG] pgmap v4284: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:59:55.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:59:55 smithi047 bash[22744]: cluster 2024-09-16T07:59:53.730197+0000 mgr.a (mgr.14373) 6178 : cluster [DBG] pgmap v4284: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:59:56.134 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T07:59:56.134 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T07:59:56.134 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T07:59:56.918 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T07:59:56.918 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T07:59:56.918 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T07:59:56.918 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T07:59:56.918 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T07:59:57.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:59:57 smithi157 bash[24585]: cluster 2024-09-16T07:59:55.730921+0000 mgr.a (mgr.14373) 6179 : cluster [DBG] pgmap v4285: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:59:57.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:59:57 smithi086 bash[24289]: cluster 2024-09-16T07:59:55.730921+0000 mgr.a (mgr.14373) 6179 : cluster [DBG] pgmap v4285: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:59:57.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:59:57 smithi047 bash[22744]: cluster 2024-09-16T07:59:55.730921+0000 mgr.a (mgr.14373) 6179 : cluster [DBG] pgmap v4285: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:59:58.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:59:58 smithi157 bash[24585]: audit 2024-09-16T07:59:56.476826+0000 mgr.a (mgr.14373) 6180 : audit [DBG] from='client.142044 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:59:58.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:59:58 smithi086 bash[24289]: audit 2024-09-16T07:59:56.476826+0000 mgr.a (mgr.14373) 6180 : audit [DBG] from='client.142044 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:59:58.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:59:58 smithi047 bash[22744]: audit 2024-09-16T07:59:56.476826+0000 mgr.a (mgr.14373) 6180 : audit [DBG] from='client.142044 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T07:59:59.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 07:59:59 smithi157 bash[24585]: cluster 2024-09-16T07:59:57.733590+0000 mgr.a (mgr.14373) 6181 : cluster [DBG] pgmap v4286: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:59:59.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 07:59:59 smithi086 bash[24289]: cluster 2024-09-16T07:59:57.733590+0000 mgr.a (mgr.14373) 6181 : cluster [DBG] pgmap v4286: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T07:59:59.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 07:59:59 smithi047 bash[22744]: cluster 2024-09-16T07:59:57.733590+0000 mgr.a (mgr.14373) 6181 : cluster [DBG] pgmap v4286: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:00:00.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:00:00 smithi157 bash[24585]: cluster 2024-09-16T08:00:00.000121+0000 mon.a (mon.0) 934 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-16T08:00:00.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:00:00 smithi086 bash[24289]: cluster 2024-09-16T08:00:00.000121+0000 mon.a (mon.0) 934 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-16T08:00:00.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:00:00 smithi047 bash[22744]: cluster 2024-09-16T08:00:00.000121+0000 mon.a (mon.0) 934 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-16T08:00:01.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:00:01 smithi157 bash[24585]: cluster 2024-09-16T07:59:59.734371+0000 mgr.a (mgr.14373) 6182 : cluster [DBG] pgmap v4287: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:00:01.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:00:01 smithi086 bash[24289]: cluster 2024-09-16T07:59:59.734371+0000 mgr.a (mgr.14373) 6182 : cluster [DBG] pgmap v4287: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:00:01.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:00:01 smithi047 bash[22744]: cluster 2024-09-16T07:59:59.734371+0000 mgr.a (mgr.14373) 6182 : cluster [DBG] pgmap v4287: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:00:01.920 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:00:01.920 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:00:01.920 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:00:02.656 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:00:02.657 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:00:02.657 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:00:02.657 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:00:02.657 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:00:03.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:00:03 smithi157 bash[24585]: cluster 2024-09-16T08:00:01.736308+0000 mgr.a (mgr.14373) 6183 : cluster [DBG] pgmap v4288: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:00:03.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:00:03 smithi157 bash[24585]: audit 2024-09-16T08:00:02.255002+0000 mgr.a (mgr.14373) 6184 : audit [DBG] from='client.142122 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:00:03.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:00:03 smithi086 bash[24289]: cluster 2024-09-16T08:00:01.736308+0000 mgr.a (mgr.14373) 6183 : cluster [DBG] pgmap v4288: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:00:03.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:00:03 smithi086 bash[24289]: audit 2024-09-16T08:00:02.255002+0000 mgr.a (mgr.14373) 6184 : audit [DBG] from='client.142122 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:00:03.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:00:03 smithi047 bash[22744]: cluster 2024-09-16T08:00:01.736308+0000 mgr.a (mgr.14373) 6183 : cluster [DBG] pgmap v4288: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:00:03.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:00:03 smithi047 bash[22744]: audit 2024-09-16T08:00:02.255002+0000 mgr.a (mgr.14373) 6184 : audit [DBG] from='client.142122 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:00:05.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:00:05 smithi157 bash[24585]: cluster 2024-09-16T08:00:03.737206+0000 mgr.a (mgr.14373) 6185 : cluster [DBG] pgmap v4289: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:00:05.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:00:05 smithi086 bash[24289]: cluster 2024-09-16T08:00:03.737206+0000 mgr.a (mgr.14373) 6185 : cluster [DBG] pgmap v4289: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:00:05.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:00:05 smithi047 bash[22744]: cluster 2024-09-16T08:00:03.737206+0000 mgr.a (mgr.14373) 6185 : cluster [DBG] pgmap v4289: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:00:07.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:00:07 smithi157 bash[24585]: cluster 2024-09-16T08:00:05.737978+0000 mgr.a (mgr.14373) 6186 : cluster [DBG] pgmap v4290: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T08:00:07.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:00:07 smithi086 bash[24289]: cluster 2024-09-16T08:00:05.737978+0000 mgr.a (mgr.14373) 6186 : cluster [DBG] pgmap v4290: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T08:00:07.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:00:07 smithi047 bash[22744]: cluster 2024-09-16T08:00:05.737978+0000 mgr.a (mgr.14373) 6186 : cluster [DBG] pgmap v4290: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T08:00:07.658 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:00:07.659 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:00:07.659 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:00:08.412 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:00:08.412 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:00:08.412 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:00:08.412 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:00:08.412 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:00:09.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:00:09 smithi157 bash[24585]: cluster 2024-09-16T08:00:07.740173+0000 mgr.a (mgr.14373) 6187 : cluster [DBG] pgmap v4291: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:00:09.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:00:09 smithi157 bash[24585]: audit 2024-09-16T08:00:07.995708+0000 mgr.a (mgr.14373) 6188 : audit [DBG] from='client.142194 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:00:09.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:00:09 smithi157 bash[24585]: audit 2024-09-16T08:00:08.641960+0000 mon.b (mon.2) 594 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T08:00:09.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:00:09 smithi086 bash[24289]: cluster 2024-09-16T08:00:07.740173+0000 mgr.a (mgr.14373) 6187 : cluster [DBG] pgmap v4291: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:00:09.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:00:09 smithi086 bash[24289]: audit 2024-09-16T08:00:07.995708+0000 mgr.a (mgr.14373) 6188 : audit [DBG] from='client.142194 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:00:09.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:00:09 smithi086 bash[24289]: audit 2024-09-16T08:00:08.641960+0000 mon.b (mon.2) 594 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T08:00:09.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:00:09 smithi047 bash[22744]: cluster 2024-09-16T08:00:07.740173+0000 mgr.a (mgr.14373) 6187 : cluster [DBG] pgmap v4291: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:00:09.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:00:09 smithi047 bash[22744]: audit 2024-09-16T08:00:07.995708+0000 mgr.a (mgr.14373) 6188 : audit [DBG] from='client.142194 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:00:09.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:00:09 smithi047 bash[22744]: audit 2024-09-16T08:00:08.641960+0000 mon.b (mon.2) 594 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T08:00:10.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:00:10 smithi157 bash[24585]: audit 2024-09-16T08:00:09.250724+0000 mon.a (mon.0) 935 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:00:10.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:00:10 smithi157 bash[24585]: audit 2024-09-16T08:00:09.254382+0000 mon.a (mon.0) 936 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:00:10.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:00:10 smithi157 bash[24585]: audit 2024-09-16T08:00:09.259841+0000 mon.a (mon.0) 937 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:00:10.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:00:10 smithi157 bash[24585]: audit 2024-09-16T08:00:09.265395+0000 mon.a (mon.0) 938 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:00:10.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:00:10 smithi157 bash[24585]: audit 2024-09-16T08:00:09.983922+0000 mon.b (mon.2) 595 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T08:00:10.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:00:10 smithi157 bash[24585]: audit 2024-09-16T08:00:09.986080+0000 mon.b (mon.2) 596 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T08:00:10.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:00:10 smithi157 bash[24585]: audit 2024-09-16T08:00:10.000132+0000 mon.a (mon.0) 939 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:00:10.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:00:10 smithi157 bash[24585]: audit 2024-09-16T08:00:10.003940+0000 mon.b (mon.2) 597 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:00:10.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:00:10 smithi086 bash[24289]: audit 2024-09-16T08:00:09.250724+0000 mon.a (mon.0) 935 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:00:10.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:00:10 smithi086 bash[24289]: audit 2024-09-16T08:00:09.254382+0000 mon.a (mon.0) 936 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:00:10.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:00:10 smithi086 bash[24289]: audit 2024-09-16T08:00:09.259841+0000 mon.a (mon.0) 937 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:00:10.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:00:10 smithi086 bash[24289]: audit 2024-09-16T08:00:09.265395+0000 mon.a (mon.0) 938 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:00:10.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:00:10 smithi086 bash[24289]: audit 2024-09-16T08:00:09.983922+0000 mon.b (mon.2) 595 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T08:00:10.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:00:10 smithi086 bash[24289]: audit 2024-09-16T08:00:09.986080+0000 mon.b (mon.2) 596 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T08:00:10.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:00:10 smithi086 bash[24289]: audit 2024-09-16T08:00:10.000132+0000 mon.a (mon.0) 939 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:00:10.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:00:10 smithi086 bash[24289]: audit 2024-09-16T08:00:10.003940+0000 mon.b (mon.2) 597 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:00:10.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:00:10 smithi047 bash[22744]: audit 2024-09-16T08:00:09.250724+0000 mon.a (mon.0) 935 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:00:10.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:00:10 smithi047 bash[22744]: audit 2024-09-16T08:00:09.254382+0000 mon.a (mon.0) 936 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:00:10.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:00:10 smithi047 bash[22744]: audit 2024-09-16T08:00:09.259841+0000 mon.a (mon.0) 937 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:00:10.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:00:10 smithi047 bash[22744]: audit 2024-09-16T08:00:09.265395+0000 mon.a (mon.0) 938 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:00:10.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:00:10 smithi047 bash[22744]: audit 2024-09-16T08:00:09.983922+0000 mon.b (mon.2) 595 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T08:00:10.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:00:10 smithi047 bash[22744]: audit 2024-09-16T08:00:09.986080+0000 mon.b (mon.2) 596 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T08:00:10.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:00:10 smithi047 bash[22744]: audit 2024-09-16T08:00:10.000132+0000 mon.a (mon.0) 939 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:00:10.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:00:10 smithi047 bash[22744]: audit 2024-09-16T08:00:10.003940+0000 mon.b (mon.2) 597 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:00:11.087 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 08:00:10 smithi047 bash[22994]: debug 2024-09-16T08:00:10.755+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T08:00:11.087 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 08:00:10 smithi047 bash[22994]: debug 2024-09-16T08:00:10.759+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T08:00:11.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:00:11 smithi157 bash[24585]: cluster 2024-09-16T08:00:09.741037+0000 mgr.a (mgr.14373) 6189 : cluster [DBG] pgmap v4292: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:00:11.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:00:11 smithi157 bash[24585]: audit 2024-09-16T08:00:10.008566+0000 mgr.a (mgr.14373) 6190 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:00:11.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:00:11 smithi086 bash[24289]: cluster 2024-09-16T08:00:09.741037+0000 mgr.a (mgr.14373) 6189 : cluster [DBG] pgmap v4292: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:00:11.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:00:11 smithi086 bash[24289]: audit 2024-09-16T08:00:10.008566+0000 mgr.a (mgr.14373) 6190 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:00:11.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:00:11 smithi047 bash[22744]: cluster 2024-09-16T08:00:09.741037+0000 mgr.a (mgr.14373) 6189 : cluster [DBG] pgmap v4292: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:00:11.610 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:00:11 smithi047 bash[22744]: audit 2024-09-16T08:00:10.008566+0000 mgr.a (mgr.14373) 6190 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:00:12.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:00:12 smithi157 bash[24585]: audit 2024-09-16T08:00:10.761876+0000 mgr.a (mgr.14373) 6191 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T08:00:12.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:00:12 smithi157 bash[24585]: cephadm 2024-09-16T08:00:10.764468+0000 mgr.a (mgr.14373) 6192 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T08:00:12.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:00:12 smithi086 bash[24289]: audit 2024-09-16T08:00:10.761876+0000 mgr.a (mgr.14373) 6191 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T08:00:12.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:00:12 smithi086 bash[24289]: cephadm 2024-09-16T08:00:10.764468+0000 mgr.a (mgr.14373) 6192 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T08:00:12.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:00:12 smithi047 bash[22744]: audit 2024-09-16T08:00:10.761876+0000 mgr.a (mgr.14373) 6191 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T08:00:12.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:00:12 smithi047 bash[22744]: cephadm 2024-09-16T08:00:10.764468+0000 mgr.a (mgr.14373) 6192 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T08:00:13.413 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:00:13.414 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:00:13.414 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:00:13.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:00:13 smithi157 bash[24585]: cluster 2024-09-16T08:00:11.743350+0000 mgr.a (mgr.14373) 6193 : cluster [DBG] pgmap v4293: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:00:13.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:00:13 smithi086 bash[24289]: cluster 2024-09-16T08:00:11.743350+0000 mgr.a (mgr.14373) 6193 : cluster [DBG] pgmap v4293: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:00:13.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:00:13 smithi047 bash[22744]: cluster 2024-09-16T08:00:11.743350+0000 mgr.a (mgr.14373) 6193 : cluster [DBG] pgmap v4293: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:00:14.163 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:00:14.163 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:00:14.163 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:00:14.163 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:00:14.163 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:00:14.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:00:14 smithi157 bash[24585]: cluster 2024-09-16T08:00:13.744059+0000 mgr.a (mgr.14373) 6194 : cluster [DBG] pgmap v4294: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:00:14.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:00:14 smithi157 bash[24585]: audit 2024-09-16T08:00:13.744968+0000 mgr.a (mgr.14373) 6195 : audit [DBG] from='client.142371 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:00:14.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:00:14 smithi086 bash[24289]: cluster 2024-09-16T08:00:13.744059+0000 mgr.a (mgr.14373) 6194 : cluster [DBG] pgmap v4294: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:00:14.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:00:14 smithi086 bash[24289]: audit 2024-09-16T08:00:13.744968+0000 mgr.a (mgr.14373) 6195 : audit [DBG] from='client.142371 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:00:14.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:00:14 smithi047 bash[22744]: cluster 2024-09-16T08:00:13.744059+0000 mgr.a (mgr.14373) 6194 : cluster [DBG] pgmap v4294: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:00:14.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:00:14 smithi047 bash[22744]: audit 2024-09-16T08:00:13.744968+0000 mgr.a (mgr.14373) 6195 : audit [DBG] from='client.142371 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:00:17.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:00:16 smithi157 bash[24585]: cluster 2024-09-16T08:00:15.744964+0000 mgr.a (mgr.14373) 6196 : cluster [DBG] pgmap v4295: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:00:17.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:00:16 smithi086 bash[24289]: cluster 2024-09-16T08:00:15.744964+0000 mgr.a (mgr.14373) 6196 : cluster [DBG] pgmap v4295: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:00:17.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:00:16 smithi047 bash[22744]: cluster 2024-09-16T08:00:15.744964+0000 mgr.a (mgr.14373) 6196 : cluster [DBG] pgmap v4295: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:00:19.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:00:18 smithi086 bash[24289]: cluster 2024-09-16T08:00:17.747212+0000 mgr.a (mgr.14373) 6197 : cluster [DBG] pgmap v4296: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:00:19.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:00:18 smithi047 bash[22744]: cluster 2024-09-16T08:00:17.747212+0000 mgr.a (mgr.14373) 6197 : cluster [DBG] pgmap v4296: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:00:19.164 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:00:19.165 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:00:19.165 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:00:19.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:00:18 smithi157 bash[24585]: cluster 2024-09-16T08:00:17.747212+0000 mgr.a (mgr.14373) 6197 : cluster [DBG] pgmap v4296: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:00:19.947 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:00:19.947 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:00:19.947 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:00:19.947 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:00:19.947 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:00:21.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:00:20 smithi086 bash[24289]: audit 2024-09-16T08:00:19.505905+0000 mgr.a (mgr.14373) 6198 : audit [DBG] from='client.142446 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:00:21.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:00:20 smithi086 bash[24289]: cluster 2024-09-16T08:00:19.747979+0000 mgr.a (mgr.14373) 6199 : cluster [DBG] pgmap v4297: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:00:21.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:00:20 smithi047 bash[22744]: audit 2024-09-16T08:00:19.505905+0000 mgr.a (mgr.14373) 6198 : audit [DBG] from='client.142446 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:00:21.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:00:20 smithi047 bash[22744]: cluster 2024-09-16T08:00:19.747979+0000 mgr.a (mgr.14373) 6199 : cluster [DBG] pgmap v4297: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:00:21.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:00:20 smithi157 bash[24585]: audit 2024-09-16T08:00:19.505905+0000 mgr.a (mgr.14373) 6198 : audit [DBG] from='client.142446 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:00:21.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:00:20 smithi157 bash[24585]: cluster 2024-09-16T08:00:19.747979+0000 mgr.a (mgr.14373) 6199 : cluster [DBG] pgmap v4297: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:00:23.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:00:22 smithi086 bash[24289]: cluster 2024-09-16T08:00:21.750224+0000 mgr.a (mgr.14373) 6200 : cluster [DBG] pgmap v4298: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:00:23.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:00:22 smithi047 bash[22744]: cluster 2024-09-16T08:00:21.750224+0000 mgr.a (mgr.14373) 6200 : cluster [DBG] pgmap v4298: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:00:23.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:00:22 smithi157 bash[24585]: cluster 2024-09-16T08:00:21.750224+0000 mgr.a (mgr.14373) 6200 : cluster [DBG] pgmap v4298: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:00:24.948 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:00:24.949 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:00:24.949 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:00:25.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:00:24 smithi086 bash[24289]: cluster 2024-09-16T08:00:23.750975+0000 mgr.a (mgr.14373) 6201 : cluster [DBG] pgmap v4299: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:00:25.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:00:24 smithi047 bash[22744]: cluster 2024-09-16T08:00:23.750975+0000 mgr.a (mgr.14373) 6201 : cluster [DBG] pgmap v4299: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:00:25.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:00:24 smithi157 bash[24585]: cluster 2024-09-16T08:00:23.750975+0000 mgr.a (mgr.14373) 6201 : cluster [DBG] pgmap v4299: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:00:25.716 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:00:25.717 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:00:25.717 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:00:25.717 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:00:25.717 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:00:27.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:00:26 smithi047 bash[22744]: audit 2024-09-16T08:00:25.290595+0000 mgr.a (mgr.14373) 6202 : audit [DBG] from='client.142524 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:00:27.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:00:26 smithi047 bash[22744]: cluster 2024-09-16T08:00:25.751450+0000 mgr.a (mgr.14373) 6203 : cluster [DBG] pgmap v4300: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:00:27.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:00:26 smithi157 bash[24585]: audit 2024-09-16T08:00:25.290595+0000 mgr.a (mgr.14373) 6202 : audit [DBG] from='client.142524 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:00:27.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:00:26 smithi157 bash[24585]: cluster 2024-09-16T08:00:25.751450+0000 mgr.a (mgr.14373) 6203 : cluster [DBG] pgmap v4300: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:00:27.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:00:26 smithi086 bash[24289]: audit 2024-09-16T08:00:25.290595+0000 mgr.a (mgr.14373) 6202 : audit [DBG] from='client.142524 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:00:27.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:00:26 smithi086 bash[24289]: cluster 2024-09-16T08:00:25.751450+0000 mgr.a (mgr.14373) 6203 : cluster [DBG] pgmap v4300: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:00:29.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:00:28 smithi047 bash[22744]: cluster 2024-09-16T08:00:27.753713+0000 mgr.a (mgr.14373) 6204 : cluster [DBG] pgmap v4301: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:00:29.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:00:28 smithi157 bash[24585]: cluster 2024-09-16T08:00:27.753713+0000 mgr.a (mgr.14373) 6204 : cluster [DBG] pgmap v4301: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:00:29.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:00:28 smithi086 bash[24289]: cluster 2024-09-16T08:00:27.753713+0000 mgr.a (mgr.14373) 6204 : cluster [DBG] pgmap v4301: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:00:30.718 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:00:30.719 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:00:30.719 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:00:31.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:00:30 smithi047 bash[22744]: cluster 2024-09-16T08:00:29.754497+0000 mgr.a (mgr.14373) 6205 : cluster [DBG] pgmap v4302: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:00:31.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:00:30 smithi157 bash[24585]: cluster 2024-09-16T08:00:29.754497+0000 mgr.a (mgr.14373) 6205 : cluster [DBG] pgmap v4302: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:00:31.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:00:30 smithi086 bash[24289]: cluster 2024-09-16T08:00:29.754497+0000 mgr.a (mgr.14373) 6205 : cluster [DBG] pgmap v4302: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:00:31.472 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:00:31.472 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:00:31.473 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:00:31.473 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:00:31.473 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:00:32.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:00:31 smithi047 bash[22744]: audit 2024-09-16T08:00:31.055359+0000 mgr.a (mgr.14373) 6206 : audit [DBG] from='client.142602 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:00:32.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:00:31 smithi157 bash[24585]: audit 2024-09-16T08:00:31.055359+0000 mgr.a (mgr.14373) 6206 : audit [DBG] from='client.142602 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:00:32.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:00:31 smithi086 bash[24289]: audit 2024-09-16T08:00:31.055359+0000 mgr.a (mgr.14373) 6206 : audit [DBG] from='client.142602 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:00:33.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:00:32 smithi157 bash[24585]: cluster 2024-09-16T08:00:31.756891+0000 mgr.a (mgr.14373) 6207 : cluster [DBG] pgmap v4303: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:00:33.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:00:32 smithi086 bash[24289]: cluster 2024-09-16T08:00:31.756891+0000 mgr.a (mgr.14373) 6207 : cluster [DBG] pgmap v4303: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:00:33.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:00:32 smithi047 bash[22744]: cluster 2024-09-16T08:00:31.756891+0000 mgr.a (mgr.14373) 6207 : cluster [DBG] pgmap v4303: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:00:35.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:00:34 smithi157 bash[24585]: cluster 2024-09-16T08:00:33.757802+0000 mgr.a (mgr.14373) 6208 : cluster [DBG] pgmap v4304: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:00:35.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:00:34 smithi086 bash[24289]: cluster 2024-09-16T08:00:33.757802+0000 mgr.a (mgr.14373) 6208 : cluster [DBG] pgmap v4304: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:00:35.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:00:34 smithi047 bash[22744]: cluster 2024-09-16T08:00:33.757802+0000 mgr.a (mgr.14373) 6208 : cluster [DBG] pgmap v4304: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:00:36.474 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:00:36.474 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:00:36.475 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:00:37.208 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:00:37.209 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:00:37.209 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:00:37.209 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:00:37.209 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:00:37.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:00:36 smithi157 bash[24585]: cluster 2024-09-16T08:00:35.758760+0000 mgr.a (mgr.14373) 6209 : cluster [DBG] pgmap v4305: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:00:37.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:00:36 smithi086 bash[24289]: cluster 2024-09-16T08:00:35.758760+0000 mgr.a (mgr.14373) 6209 : cluster [DBG] pgmap v4305: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:00:37.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:00:36 smithi047 bash[22744]: cluster 2024-09-16T08:00:35.758760+0000 mgr.a (mgr.14373) 6209 : cluster [DBG] pgmap v4305: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:00:38.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:00:37 smithi157 bash[24585]: audit 2024-09-16T08:00:36.802457+0000 mgr.a (mgr.14373) 6210 : audit [DBG] from='client.142677 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:00:38.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:00:37 smithi086 bash[24289]: audit 2024-09-16T08:00:36.802457+0000 mgr.a (mgr.14373) 6210 : audit [DBG] from='client.142677 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:00:38.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:00:37 smithi047 bash[22744]: audit 2024-09-16T08:00:36.802457+0000 mgr.a (mgr.14373) 6210 : audit [DBG] from='client.142677 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:00:39.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:00:38 smithi157 bash[24585]: cluster 2024-09-16T08:00:37.761514+0000 mgr.a (mgr.14373) 6211 : cluster [DBG] pgmap v4306: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:00:39.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:00:38 smithi086 bash[24289]: cluster 2024-09-16T08:00:37.761514+0000 mgr.a (mgr.14373) 6211 : cluster [DBG] pgmap v4306: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:00:39.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:00:38 smithi047 bash[22744]: cluster 2024-09-16T08:00:37.761514+0000 mgr.a (mgr.14373) 6211 : cluster [DBG] pgmap v4306: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:00:41.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:00:40 smithi157 bash[24585]: cluster 2024-09-16T08:00:39.762305+0000 mgr.a (mgr.14373) 6212 : cluster [DBG] pgmap v4307: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:00:41.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:00:40 smithi086 bash[24289]: cluster 2024-09-16T08:00:39.762305+0000 mgr.a (mgr.14373) 6212 : cluster [DBG] pgmap v4307: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:00:41.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:00:40 smithi047 bash[22744]: cluster 2024-09-16T08:00:39.762305+0000 mgr.a (mgr.14373) 6212 : cluster [DBG] pgmap v4307: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:00:42.210 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:00:42.211 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:00:42.211 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:00:42.991 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:00:42.991 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:00:42.991 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:00:42.991 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:00:42.991 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:00:43.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:00:42 smithi157 bash[24585]: cluster 2024-09-16T08:00:41.764287+0000 mgr.a (mgr.14373) 6213 : cluster [DBG] pgmap v4308: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:00:43.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:00:42 smithi086 bash[24289]: cluster 2024-09-16T08:00:41.764287+0000 mgr.a (mgr.14373) 6213 : cluster [DBG] pgmap v4308: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:00:43.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:00:42 smithi047 bash[22744]: cluster 2024-09-16T08:00:41.764287+0000 mgr.a (mgr.14373) 6213 : cluster [DBG] pgmap v4308: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:00:44.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:00:43 smithi157 bash[24585]: audit 2024-09-16T08:00:42.554560+0000 mgr.a (mgr.14373) 6214 : audit [DBG] from='client.142755 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:00:44.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:00:43 smithi086 bash[24289]: audit 2024-09-16T08:00:42.554560+0000 mgr.a (mgr.14373) 6214 : audit [DBG] from='client.142755 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:00:44.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:00:43 smithi047 bash[22744]: audit 2024-09-16T08:00:42.554560+0000 mgr.a (mgr.14373) 6214 : audit [DBG] from='client.142755 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:00:45.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:00:44 smithi157 bash[24585]: cluster 2024-09-16T08:00:43.765196+0000 mgr.a (mgr.14373) 6215 : cluster [DBG] pgmap v4309: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:00:45.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:00:44 smithi086 bash[24289]: cluster 2024-09-16T08:00:43.765196+0000 mgr.a (mgr.14373) 6215 : cluster [DBG] pgmap v4309: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:00:45.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:00:44 smithi047 bash[22744]: cluster 2024-09-16T08:00:43.765196+0000 mgr.a (mgr.14373) 6215 : cluster [DBG] pgmap v4309: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:00:47.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:00:46 smithi157 bash[24585]: cluster 2024-09-16T08:00:45.765965+0000 mgr.a (mgr.14373) 6216 : cluster [DBG] pgmap v4310: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T08:00:47.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:00:46 smithi086 bash[24289]: cluster 2024-09-16T08:00:45.765965+0000 mgr.a (mgr.14373) 6216 : cluster [DBG] pgmap v4310: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T08:00:47.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:00:46 smithi047 bash[22744]: cluster 2024-09-16T08:00:45.765965+0000 mgr.a (mgr.14373) 6216 : cluster [DBG] pgmap v4310: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T08:00:47.992 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:00:47.993 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:00:47.993 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:00:48.770 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:00:48.770 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:00:48.770 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:00:48.770 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:00:48.770 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:00:49.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:00:48 smithi157 bash[24585]: cluster 2024-09-16T08:00:47.768216+0000 mgr.a (mgr.14373) 6217 : cluster [DBG] pgmap v4311: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:00:49.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:00:48 smithi086 bash[24289]: cluster 2024-09-16T08:00:47.768216+0000 mgr.a (mgr.14373) 6217 : cluster [DBG] pgmap v4311: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:00:49.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:00:48 smithi047 bash[22744]: cluster 2024-09-16T08:00:47.768216+0000 mgr.a (mgr.14373) 6217 : cluster [DBG] pgmap v4311: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:00:50.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:00:49 smithi157 bash[24585]: audit 2024-09-16T08:00:48.329223+0000 mgr.a (mgr.14373) 6218 : audit [DBG] from='client.142833 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:00:50.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:00:49 smithi086 bash[24289]: audit 2024-09-16T08:00:48.329223+0000 mgr.a (mgr.14373) 6218 : audit [DBG] from='client.142833 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:00:50.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:00:49 smithi047 bash[22744]: audit 2024-09-16T08:00:48.329223+0000 mgr.a (mgr.14373) 6218 : audit [DBG] from='client.142833 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:00:51.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:00:50 smithi157 bash[24585]: cluster 2024-09-16T08:00:49.769187+0000 mgr.a (mgr.14373) 6219 : cluster [DBG] pgmap v4312: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:00:51.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:00:50 smithi086 bash[24289]: cluster 2024-09-16T08:00:49.769187+0000 mgr.a (mgr.14373) 6219 : cluster [DBG] pgmap v4312: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:00:51.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:00:50 smithi047 bash[22744]: cluster 2024-09-16T08:00:49.769187+0000 mgr.a (mgr.14373) 6219 : cluster [DBG] pgmap v4312: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:00:53.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:00:52 smithi157 bash[24585]: cluster 2024-09-16T08:00:51.771408+0000 mgr.a (mgr.14373) 6220 : cluster [DBG] pgmap v4313: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:00:53.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:00:52 smithi086 bash[24289]: cluster 2024-09-16T08:00:51.771408+0000 mgr.a (mgr.14373) 6220 : cluster [DBG] pgmap v4313: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:00:53.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:00:52 smithi047 bash[22744]: cluster 2024-09-16T08:00:51.771408+0000 mgr.a (mgr.14373) 6220 : cluster [DBG] pgmap v4313: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:00:53.771 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:00:53.772 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:00:53.772 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:00:54.543 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:00:54.544 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:00:54.544 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:00:54.544 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:00:54.544 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:00:55.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:00:54 smithi157 bash[24585]: cluster 2024-09-16T08:00:53.772155+0000 mgr.a (mgr.14373) 6221 : cluster [DBG] pgmap v4314: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:00:55.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:00:54 smithi157 bash[24585]: audit 2024-09-16T08:00:54.107707+0000 mgr.a (mgr.14373) 6222 : audit [DBG] from='client.142911 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:00:55.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:00:54 smithi086 bash[24289]: cluster 2024-09-16T08:00:53.772155+0000 mgr.a (mgr.14373) 6221 : cluster [DBG] pgmap v4314: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:00:55.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:00:54 smithi086 bash[24289]: audit 2024-09-16T08:00:54.107707+0000 mgr.a (mgr.14373) 6222 : audit [DBG] from='client.142911 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:00:55.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:00:54 smithi047 bash[22744]: cluster 2024-09-16T08:00:53.772155+0000 mgr.a (mgr.14373) 6221 : cluster [DBG] pgmap v4314: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:00:55.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:00:54 smithi047 bash[22744]: audit 2024-09-16T08:00:54.107707+0000 mgr.a (mgr.14373) 6222 : audit [DBG] from='client.142911 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:00:57.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:00:56 smithi157 bash[24585]: cluster 2024-09-16T08:00:55.773115+0000 mgr.a (mgr.14373) 6223 : cluster [DBG] pgmap v4315: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:00:57.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:00:56 smithi086 bash[24289]: cluster 2024-09-16T08:00:55.773115+0000 mgr.a (mgr.14373) 6223 : cluster [DBG] pgmap v4315: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:00:57.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:00:56 smithi047 bash[22744]: cluster 2024-09-16T08:00:55.773115+0000 mgr.a (mgr.14373) 6223 : cluster [DBG] pgmap v4315: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:00:59.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:00:58 smithi157 bash[24585]: cluster 2024-09-16T08:00:57.775389+0000 mgr.a (mgr.14373) 6224 : cluster [DBG] pgmap v4316: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:00:59.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:00:58 smithi086 bash[24289]: cluster 2024-09-16T08:00:57.775389+0000 mgr.a (mgr.14373) 6224 : cluster [DBG] pgmap v4316: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:00:59.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:00:58 smithi047 bash[22744]: cluster 2024-09-16T08:00:57.775389+0000 mgr.a (mgr.14373) 6224 : cluster [DBG] pgmap v4316: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:00:59.545 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:00:59.546 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:00:59.546 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:01:00.291 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:01:00.292 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:01:00.292 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:01:00.292 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:01:00.292 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:01:01.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:01:00 smithi157 bash[24585]: cluster 2024-09-16T08:00:59.776122+0000 mgr.a (mgr.14373) 6225 : cluster [DBG] pgmap v4317: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:01:01.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:01:00 smithi157 bash[24585]: audit 2024-09-16T08:00:59.877793+0000 mgr.a (mgr.14373) 6226 : audit [DBG] from='client.142986 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:01:01.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:01:00 smithi086 bash[24289]: cluster 2024-09-16T08:00:59.776122+0000 mgr.a (mgr.14373) 6225 : cluster [DBG] pgmap v4317: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:01:01.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:01:00 smithi086 bash[24289]: audit 2024-09-16T08:00:59.877793+0000 mgr.a (mgr.14373) 6226 : audit [DBG] from='client.142986 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:01:01.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:01:00 smithi047 bash[22744]: cluster 2024-09-16T08:00:59.776122+0000 mgr.a (mgr.14373) 6225 : cluster [DBG] pgmap v4317: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:01:01.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:01:00 smithi047 bash[22744]: audit 2024-09-16T08:00:59.877793+0000 mgr.a (mgr.14373) 6226 : audit [DBG] from='client.142986 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:01:03.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:01:02 smithi157 bash[24585]: cluster 2024-09-16T08:01:01.778551+0000 mgr.a (mgr.14373) 6227 : cluster [DBG] pgmap v4318: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:01:03.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:01:02 smithi086 bash[24289]: cluster 2024-09-16T08:01:01.778551+0000 mgr.a (mgr.14373) 6227 : cluster [DBG] pgmap v4318: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:01:03.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:01:02 smithi047 bash[22744]: cluster 2024-09-16T08:01:01.778551+0000 mgr.a (mgr.14373) 6227 : cluster [DBG] pgmap v4318: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:01:05.293 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:01:05.294 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:01:05.294 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:01:05.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:01:04 smithi157 bash[24585]: cluster 2024-09-16T08:01:03.779302+0000 mgr.a (mgr.14373) 6228 : cluster [DBG] pgmap v4319: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:01:05.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:01:04 smithi086 bash[24289]: cluster 2024-09-16T08:01:03.779302+0000 mgr.a (mgr.14373) 6228 : cluster [DBG] pgmap v4319: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:01:05.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:01:04 smithi047 bash[22744]: cluster 2024-09-16T08:01:03.779302+0000 mgr.a (mgr.14373) 6228 : cluster [DBG] pgmap v4319: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:01:06.027 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:01:06.027 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:01:06.027 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:01:06.027 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:01:06.027 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:01:07.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:01:06 smithi157 bash[24585]: audit 2024-09-16T08:01:05.622207+0000 mgr.a (mgr.14373) 6229 : audit [DBG] from='client.143064 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:01:07.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:01:06 smithi157 bash[24585]: cluster 2024-09-16T08:01:05.779845+0000 mgr.a (mgr.14373) 6230 : cluster [DBG] pgmap v4320: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:01:07.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:01:06 smithi086 bash[24289]: audit 2024-09-16T08:01:05.622207+0000 mgr.a (mgr.14373) 6229 : audit [DBG] from='client.143064 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:01:07.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:01:06 smithi086 bash[24289]: cluster 2024-09-16T08:01:05.779845+0000 mgr.a (mgr.14373) 6230 : cluster [DBG] pgmap v4320: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:01:07.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:01:06 smithi047 bash[22744]: audit 2024-09-16T08:01:05.622207+0000 mgr.a (mgr.14373) 6229 : audit [DBG] from='client.143064 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:01:07.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:01:06 smithi047 bash[22744]: cluster 2024-09-16T08:01:05.779845+0000 mgr.a (mgr.14373) 6230 : cluster [DBG] pgmap v4320: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:01:09.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:01:08 smithi157 bash[24585]: cluster 2024-09-16T08:01:07.782158+0000 mgr.a (mgr.14373) 6231 : cluster [DBG] pgmap v4321: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:01:09.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:01:08 smithi086 bash[24289]: cluster 2024-09-16T08:01:07.782158+0000 mgr.a (mgr.14373) 6231 : cluster [DBG] pgmap v4321: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:01:09.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:01:08 smithi047 bash[22744]: cluster 2024-09-16T08:01:07.782158+0000 mgr.a (mgr.14373) 6231 : cluster [DBG] pgmap v4321: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:01:11.028 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:01:11.029 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:01:11.029 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:01:11.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:01:10 smithi157 bash[24585]: cluster 2024-09-16T08:01:09.782984+0000 mgr.a (mgr.14373) 6232 : cluster [DBG] pgmap v4322: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:01:11.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:01:10 smithi157 bash[24585]: audit 2024-09-16T08:01:10.817885+0000 mon.b (mon.2) 598 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T08:01:11.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:01:10 smithi086 bash[24289]: cluster 2024-09-16T08:01:09.782984+0000 mgr.a (mgr.14373) 6232 : cluster [DBG] pgmap v4322: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:01:11.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:01:10 smithi086 bash[24289]: audit 2024-09-16T08:01:10.817885+0000 mon.b (mon.2) 598 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T08:01:11.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:01:10 smithi047 bash[22744]: cluster 2024-09-16T08:01:09.782984+0000 mgr.a (mgr.14373) 6232 : cluster [DBG] pgmap v4322: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:01:11.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:01:10 smithi047 bash[22744]: audit 2024-09-16T08:01:10.817885+0000 mon.b (mon.2) 598 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T08:01:11.800 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:01:11.800 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:01:11.800 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:01:11.800 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:01:11.800 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:01:12.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:01:11 smithi157 bash[24585]: audit 2024-09-16T08:01:11.651650+0000 mon.b (mon.2) 599 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T08:01:12.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:01:11 smithi157 bash[24585]: audit 2024-09-16T08:01:11.653159+0000 mon.b (mon.2) 600 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T08:01:12.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:01:11 smithi157 bash[24585]: audit 2024-09-16T08:01:11.661369+0000 mon.a (mon.0) 940 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:01:12.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:01:11 smithi157 bash[24585]: audit 2024-09-16T08:01:11.664421+0000 mon.b (mon.2) 601 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:01:12.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:01:11 smithi086 bash[24289]: audit 2024-09-16T08:01:11.651650+0000 mon.b (mon.2) 599 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T08:01:12.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:01:11 smithi086 bash[24289]: audit 2024-09-16T08:01:11.653159+0000 mon.b (mon.2) 600 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T08:01:12.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:01:11 smithi086 bash[24289]: audit 2024-09-16T08:01:11.661369+0000 mon.a (mon.0) 940 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:01:12.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:01:11 smithi086 bash[24289]: audit 2024-09-16T08:01:11.664421+0000 mon.b (mon.2) 601 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:01:12.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:01:11 smithi047 bash[22744]: audit 2024-09-16T08:01:11.651650+0000 mon.b (mon.2) 599 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T08:01:12.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:01:11 smithi047 bash[22744]: audit 2024-09-16T08:01:11.653159+0000 mon.b (mon.2) 600 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T08:01:12.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:01:11 smithi047 bash[22744]: audit 2024-09-16T08:01:11.661369+0000 mon.a (mon.0) 940 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:01:12.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:01:11 smithi047 bash[22744]: audit 2024-09-16T08:01:11.664421+0000 mon.b (mon.2) 601 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:01:12.837 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 08:01:12 smithi047 bash[22994]: debug 2024-09-16T08:01:12.482+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T08:01:12.837 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 08:01:12 smithi047 bash[22994]: debug 2024-09-16T08:01:12.486+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T08:01:13.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:01:12 smithi157 bash[24585]: audit 2024-09-16T08:01:11.355459+0000 mgr.a (mgr.14373) 6233 : audit [DBG] from='client.143142 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:01:13.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:01:12 smithi157 bash[24585]: audit 2024-09-16T08:01:11.667700+0000 mgr.a (mgr.14373) 6234 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:01:13.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:01:12 smithi157 bash[24585]: cluster 2024-09-16T08:01:11.784518+0000 mgr.a (mgr.14373) 6235 : cluster [DBG] pgmap v4323: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:01:13.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:01:12 smithi086 bash[24289]: audit 2024-09-16T08:01:11.355459+0000 mgr.a (mgr.14373) 6233 : audit [DBG] from='client.143142 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:01:13.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:01:12 smithi086 bash[24289]: audit 2024-09-16T08:01:11.667700+0000 mgr.a (mgr.14373) 6234 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:01:13.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:01:12 smithi086 bash[24289]: cluster 2024-09-16T08:01:11.784518+0000 mgr.a (mgr.14373) 6235 : cluster [DBG] pgmap v4323: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:01:13.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:01:12 smithi047 bash[22744]: audit 2024-09-16T08:01:11.355459+0000 mgr.a (mgr.14373) 6233 : audit [DBG] from='client.143142 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:01:13.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:01:12 smithi047 bash[22744]: audit 2024-09-16T08:01:11.667700+0000 mgr.a (mgr.14373) 6234 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:01:13.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:01:12 smithi047 bash[22744]: cluster 2024-09-16T08:01:11.784518+0000 mgr.a (mgr.14373) 6235 : cluster [DBG] pgmap v4323: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:01:14.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:01:13 smithi157 bash[24585]: audit 2024-09-16T08:01:12.485537+0000 mgr.a (mgr.14373) 6236 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T08:01:14.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:01:13 smithi157 bash[24585]: cephadm 2024-09-16T08:01:12.487643+0000 mgr.a (mgr.14373) 6237 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T08:01:14.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:01:13 smithi086 bash[24289]: audit 2024-09-16T08:01:12.485537+0000 mgr.a (mgr.14373) 6236 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T08:01:14.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:01:13 smithi086 bash[24289]: cephadm 2024-09-16T08:01:12.487643+0000 mgr.a (mgr.14373) 6237 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T08:01:14.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:01:13 smithi047 bash[22744]: audit 2024-09-16T08:01:12.485537+0000 mgr.a (mgr.14373) 6236 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T08:01:14.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:01:13 smithi047 bash[22744]: cephadm 2024-09-16T08:01:12.487643+0000 mgr.a (mgr.14373) 6237 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T08:01:15.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:01:14 smithi157 bash[24585]: cluster 2024-09-16T08:01:13.785578+0000 mgr.a (mgr.14373) 6238 : cluster [DBG] pgmap v4324: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T08:01:15.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:01:14 smithi086 bash[24289]: cluster 2024-09-16T08:01:13.785578+0000 mgr.a (mgr.14373) 6238 : cluster [DBG] pgmap v4324: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T08:01:15.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:01:14 smithi047 bash[22744]: cluster 2024-09-16T08:01:13.785578+0000 mgr.a (mgr.14373) 6238 : cluster [DBG] pgmap v4324: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T08:01:16.805 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:01:16.805 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:01:16.805 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:01:17.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:01:16 smithi157 bash[24585]: cluster 2024-09-16T08:01:15.786482+0000 mgr.a (mgr.14373) 6239 : cluster [DBG] pgmap v4325: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T08:01:17.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:01:16 smithi086 bash[24289]: cluster 2024-09-16T08:01:15.786482+0000 mgr.a (mgr.14373) 6239 : cluster [DBG] pgmap v4325: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T08:01:17.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:01:16 smithi047 bash[22744]: cluster 2024-09-16T08:01:15.786482+0000 mgr.a (mgr.14373) 6239 : cluster [DBG] pgmap v4325: 225 pgs: 225 active+clean; 589 KiB data, 138 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T08:01:17.578 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:01:17.578 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:01:17.578 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:01:17.578 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:01:17.578 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:01:18.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:01:17 smithi157 bash[24585]: audit 2024-09-16T08:01:17.141434+0000 mgr.a (mgr.14373) 6240 : audit [DBG] from='client.143322 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:01:18.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:01:17 smithi086 bash[24289]: audit 2024-09-16T08:01:17.141434+0000 mgr.a (mgr.14373) 6240 : audit [DBG] from='client.143322 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:01:18.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:01:17 smithi047 bash[22744]: audit 2024-09-16T08:01:17.141434+0000 mgr.a (mgr.14373) 6240 : audit [DBG] from='client.143322 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:01:19.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:01:18 smithi157 bash[24585]: cluster 2024-09-16T08:01:17.789249+0000 mgr.a (mgr.14373) 6241 : cluster [DBG] pgmap v4326: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:01:19.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:01:18 smithi086 bash[24289]: cluster 2024-09-16T08:01:17.789249+0000 mgr.a (mgr.14373) 6241 : cluster [DBG] pgmap v4326: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:01:19.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:01:18 smithi047 bash[22744]: cluster 2024-09-16T08:01:17.789249+0000 mgr.a (mgr.14373) 6241 : cluster [DBG] pgmap v4326: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:01:21.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:01:20 smithi157 bash[24585]: cluster 2024-09-16T08:01:19.790075+0000 mgr.a (mgr.14373) 6242 : cluster [DBG] pgmap v4327: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T08:01:21.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:01:20 smithi086 bash[24289]: cluster 2024-09-16T08:01:19.790075+0000 mgr.a (mgr.14373) 6242 : cluster [DBG] pgmap v4327: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T08:01:21.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:01:20 smithi047 bash[22744]: cluster 2024-09-16T08:01:19.790075+0000 mgr.a (mgr.14373) 6242 : cluster [DBG] pgmap v4327: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T08:01:22.579 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:01:22.580 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:01:22.580 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:01:23.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:01:22 smithi157 bash[24585]: cluster 2024-09-16T08:01:21.792015+0000 mgr.a (mgr.14373) 6243 : cluster [DBG] pgmap v4328: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:01:23.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:01:22 smithi086 bash[24289]: cluster 2024-09-16T08:01:21.792015+0000 mgr.a (mgr.14373) 6243 : cluster [DBG] pgmap v4328: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:01:23.336 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:01:23.337 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:01:23.337 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:01:23.337 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:01:23.337 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:01:23.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:01:22 smithi047 bash[22744]: cluster 2024-09-16T08:01:21.792015+0000 mgr.a (mgr.14373) 6243 : cluster [DBG] pgmap v4328: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:01:24.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:01:23 smithi157 bash[24585]: audit 2024-09-16T08:01:22.912522+0000 mgr.a (mgr.14373) 6244 : audit [DBG] from='client.143394 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:01:24.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:01:23 smithi086 bash[24289]: audit 2024-09-16T08:01:22.912522+0000 mgr.a (mgr.14373) 6244 : audit [DBG] from='client.143394 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:01:24.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:01:23 smithi047 bash[22744]: audit 2024-09-16T08:01:22.912522+0000 mgr.a (mgr.14373) 6244 : audit [DBG] from='client.143394 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:01:25.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:01:24 smithi157 bash[24585]: cluster 2024-09-16T08:01:23.793118+0000 mgr.a (mgr.14373) 6245 : cluster [DBG] pgmap v4329: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:01:25.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:01:24 smithi086 bash[24289]: cluster 2024-09-16T08:01:23.793118+0000 mgr.a (mgr.14373) 6245 : cluster [DBG] pgmap v4329: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:01:25.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:01:24 smithi047 bash[22744]: cluster 2024-09-16T08:01:23.793118+0000 mgr.a (mgr.14373) 6245 : cluster [DBG] pgmap v4329: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:01:27.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:01:26 smithi157 bash[24585]: cluster 2024-09-16T08:01:25.794056+0000 mgr.a (mgr.14373) 6246 : cluster [DBG] pgmap v4330: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:01:27.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:01:26 smithi086 bash[24289]: cluster 2024-09-16T08:01:25.794056+0000 mgr.a (mgr.14373) 6246 : cluster [DBG] pgmap v4330: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:01:27.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:01:26 smithi047 bash[22744]: cluster 2024-09-16T08:01:25.794056+0000 mgr.a (mgr.14373) 6246 : cluster [DBG] pgmap v4330: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:01:28.338 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:01:28.339 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:01:28.339 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:01:29.091 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:01:29.092 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:01:29.092 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:01:29.092 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:01:29.092 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:01:29.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:01:28 smithi157 bash[24585]: cluster 2024-09-16T08:01:27.796446+0000 mgr.a (mgr.14373) 6247 : cluster [DBG] pgmap v4331: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:01:29.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:01:28 smithi086 bash[24289]: cluster 2024-09-16T08:01:27.796446+0000 mgr.a (mgr.14373) 6247 : cluster [DBG] pgmap v4331: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:01:29.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:01:28 smithi047 bash[22744]: cluster 2024-09-16T08:01:27.796446+0000 mgr.a (mgr.14373) 6247 : cluster [DBG] pgmap v4331: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:01:30.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:01:30 smithi157 bash[24585]: audit 2024-09-16T08:01:28.676629+0000 mgr.a (mgr.14373) 6248 : audit [DBG] from='client.143469 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:01:30.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:01:30 smithi086 bash[24289]: audit 2024-09-16T08:01:28.676629+0000 mgr.a (mgr.14373) 6248 : audit [DBG] from='client.143469 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:01:30.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:01:30 smithi047 bash[22744]: audit 2024-09-16T08:01:28.676629+0000 mgr.a (mgr.14373) 6248 : audit [DBG] from='client.143469 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:01:31.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:01:31 smithi157 bash[24585]: cluster 2024-09-16T08:01:29.797475+0000 mgr.a (mgr.14373) 6249 : cluster [DBG] pgmap v4332: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:01:31.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:01:31 smithi086 bash[24289]: cluster 2024-09-16T08:01:29.797475+0000 mgr.a (mgr.14373) 6249 : cluster [DBG] pgmap v4332: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:01:31.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:01:31 smithi047 bash[22744]: cluster 2024-09-16T08:01:29.797475+0000 mgr.a (mgr.14373) 6249 : cluster [DBG] pgmap v4332: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:01:33.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:01:33 smithi157 bash[24585]: cluster 2024-09-16T08:01:31.799669+0000 mgr.a (mgr.14373) 6250 : cluster [DBG] pgmap v4333: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:01:33.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:01:33 smithi086 bash[24289]: cluster 2024-09-16T08:01:31.799669+0000 mgr.a (mgr.14373) 6250 : cluster [DBG] pgmap v4333: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:01:33.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:01:33 smithi047 bash[22744]: cluster 2024-09-16T08:01:31.799669+0000 mgr.a (mgr.14373) 6250 : cluster [DBG] pgmap v4333: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:01:34.093 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:01:34.094 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:01:34.094 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:01:34.876 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:01:34.876 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:01:34.876 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:01:34.876 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:01:34.876 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:01:35.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:01:35 smithi157 bash[24585]: cluster 2024-09-16T08:01:33.800437+0000 mgr.a (mgr.14373) 6251 : cluster [DBG] pgmap v4334: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:01:35.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:01:35 smithi086 bash[24289]: cluster 2024-09-16T08:01:33.800437+0000 mgr.a (mgr.14373) 6251 : cluster [DBG] pgmap v4334: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:01:35.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:01:35 smithi047 bash[22744]: cluster 2024-09-16T08:01:33.800437+0000 mgr.a (mgr.14373) 6251 : cluster [DBG] pgmap v4334: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:01:36.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:01:36 smithi157 bash[24585]: audit 2024-09-16T08:01:34.433542+0000 mgr.a (mgr.14373) 6252 : audit [DBG] from='client.143547 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:01:36.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:01:36 smithi086 bash[24289]: audit 2024-09-16T08:01:34.433542+0000 mgr.a (mgr.14373) 6252 : audit [DBG] from='client.143547 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:01:36.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:01:36 smithi047 bash[22744]: audit 2024-09-16T08:01:34.433542+0000 mgr.a (mgr.14373) 6252 : audit [DBG] from='client.143547 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:01:37.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:01:37 smithi157 bash[24585]: cluster 2024-09-16T08:01:35.801437+0000 mgr.a (mgr.14373) 6253 : cluster [DBG] pgmap v4335: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:01:37.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:01:37 smithi086 bash[24289]: cluster 2024-09-16T08:01:35.801437+0000 mgr.a (mgr.14373) 6253 : cluster [DBG] pgmap v4335: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:01:37.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:01:37 smithi047 bash[22744]: cluster 2024-09-16T08:01:35.801437+0000 mgr.a (mgr.14373) 6253 : cluster [DBG] pgmap v4335: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:01:39.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:01:39 smithi157 bash[24585]: cluster 2024-09-16T08:01:37.803748+0000 mgr.a (mgr.14373) 6254 : cluster [DBG] pgmap v4336: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:01:39.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:01:39 smithi086 bash[24289]: cluster 2024-09-16T08:01:37.803748+0000 mgr.a (mgr.14373) 6254 : cluster [DBG] pgmap v4336: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:01:39.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:01:39 smithi047 bash[22744]: cluster 2024-09-16T08:01:37.803748+0000 mgr.a (mgr.14373) 6254 : cluster [DBG] pgmap v4336: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:01:39.877 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:01:39.878 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:01:39.878 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:01:40.654 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:01:40.655 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:01:40.655 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:01:40.655 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:01:40.655 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:01:41.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:01:41 smithi157 bash[24585]: cluster 2024-09-16T08:01:39.804507+0000 mgr.a (mgr.14373) 6255 : cluster [DBG] pgmap v4337: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:01:41.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:01:41 smithi157 bash[24585]: audit 2024-09-16T08:01:40.220827+0000 mgr.a (mgr.14373) 6256 : audit [DBG] from='client.143619 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:01:41.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:01:41 smithi086 bash[24289]: cluster 2024-09-16T08:01:39.804507+0000 mgr.a (mgr.14373) 6255 : cluster [DBG] pgmap v4337: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:01:41.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:01:41 smithi086 bash[24289]: audit 2024-09-16T08:01:40.220827+0000 mgr.a (mgr.14373) 6256 : audit [DBG] from='client.143619 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:01:41.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:01:41 smithi047 bash[22744]: cluster 2024-09-16T08:01:39.804507+0000 mgr.a (mgr.14373) 6255 : cluster [DBG] pgmap v4337: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:01:41.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:01:41 smithi047 bash[22744]: audit 2024-09-16T08:01:40.220827+0000 mgr.a (mgr.14373) 6256 : audit [DBG] from='client.143619 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:01:43.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:01:43 smithi157 bash[24585]: cluster 2024-09-16T08:01:41.807019+0000 mgr.a (mgr.14373) 6257 : cluster [DBG] pgmap v4338: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:01:43.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:01:43 smithi086 bash[24289]: cluster 2024-09-16T08:01:41.807019+0000 mgr.a (mgr.14373) 6257 : cluster [DBG] pgmap v4338: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:01:43.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:01:43 smithi047 bash[22744]: cluster 2024-09-16T08:01:41.807019+0000 mgr.a (mgr.14373) 6257 : cluster [DBG] pgmap v4338: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:01:45.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:01:45 smithi157 bash[24585]: cluster 2024-09-16T08:01:43.807936+0000 mgr.a (mgr.14373) 6258 : cluster [DBG] pgmap v4339: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:01:45.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:01:45 smithi086 bash[24289]: cluster 2024-09-16T08:01:43.807936+0000 mgr.a (mgr.14373) 6258 : cluster [DBG] pgmap v4339: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:01:45.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:01:45 smithi047 bash[22744]: cluster 2024-09-16T08:01:43.807936+0000 mgr.a (mgr.14373) 6258 : cluster [DBG] pgmap v4339: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:01:45.656 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:01:45.657 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:01:45.657 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:01:46.442 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:01:46.442 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:01:46.442 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:01:46.442 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:01:46.442 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:01:47.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:01:47 smithi157 bash[24585]: cluster 2024-09-16T08:01:45.808461+0000 mgr.a (mgr.14373) 6259 : cluster [DBG] pgmap v4340: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:01:47.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:01:47 smithi157 bash[24585]: audit 2024-09-16T08:01:45.993859+0000 mgr.a (mgr.14373) 6260 : audit [DBG] from='client.143694 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:01:47.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:01:47 smithi086 bash[24289]: cluster 2024-09-16T08:01:45.808461+0000 mgr.a (mgr.14373) 6259 : cluster [DBG] pgmap v4340: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:01:47.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:01:47 smithi086 bash[24289]: audit 2024-09-16T08:01:45.993859+0000 mgr.a (mgr.14373) 6260 : audit [DBG] from='client.143694 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:01:47.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:01:47 smithi047 bash[22744]: cluster 2024-09-16T08:01:45.808461+0000 mgr.a (mgr.14373) 6259 : cluster [DBG] pgmap v4340: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:01:47.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:01:47 smithi047 bash[22744]: audit 2024-09-16T08:01:45.993859+0000 mgr.a (mgr.14373) 6260 : audit [DBG] from='client.143694 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:01:49.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:01:49 smithi086 bash[24289]: cluster 2024-09-16T08:01:47.810822+0000 mgr.a (mgr.14373) 6261 : cluster [DBG] pgmap v4341: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:01:49.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:01:49 smithi047 bash[22744]: cluster 2024-09-16T08:01:47.810822+0000 mgr.a (mgr.14373) 6261 : cluster [DBG] pgmap v4341: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:01:49.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:01:49 smithi157 bash[24585]: cluster 2024-09-16T08:01:47.810822+0000 mgr.a (mgr.14373) 6261 : cluster [DBG] pgmap v4341: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:01:51.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:01:51 smithi086 bash[24289]: cluster 2024-09-16T08:01:49.811594+0000 mgr.a (mgr.14373) 6262 : cluster [DBG] pgmap v4342: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:01:51.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:01:51 smithi047 bash[22744]: cluster 2024-09-16T08:01:49.811594+0000 mgr.a (mgr.14373) 6262 : cluster [DBG] pgmap v4342: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:01:51.443 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:01:51.444 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:01:51.444 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:01:51.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:01:51 smithi157 bash[24585]: cluster 2024-09-16T08:01:49.811594+0000 mgr.a (mgr.14373) 6262 : cluster [DBG] pgmap v4342: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:01:52.213 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:01:52.214 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:01:52.214 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:01:52.214 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:01:52.214 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:01:53.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:01:53 smithi086 bash[24289]: audit 2024-09-16T08:01:51.782248+0000 mgr.a (mgr.14373) 6263 : audit [DBG] from='client.143772 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:01:53.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:01:53 smithi086 bash[24289]: cluster 2024-09-16T08:01:51.813629+0000 mgr.a (mgr.14373) 6264 : cluster [DBG] pgmap v4343: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:01:53.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:01:53 smithi047 bash[22744]: audit 2024-09-16T08:01:51.782248+0000 mgr.a (mgr.14373) 6263 : audit [DBG] from='client.143772 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:01:53.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:01:53 smithi047 bash[22744]: cluster 2024-09-16T08:01:51.813629+0000 mgr.a (mgr.14373) 6264 : cluster [DBG] pgmap v4343: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:01:53.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:01:53 smithi157 bash[24585]: audit 2024-09-16T08:01:51.782248+0000 mgr.a (mgr.14373) 6263 : audit [DBG] from='client.143772 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:01:53.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:01:53 smithi157 bash[24585]: cluster 2024-09-16T08:01:51.813629+0000 mgr.a (mgr.14373) 6264 : cluster [DBG] pgmap v4343: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:01:55.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:01:55 smithi086 bash[24289]: cluster 2024-09-16T08:01:53.814692+0000 mgr.a (mgr.14373) 6265 : cluster [DBG] pgmap v4344: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:01:55.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:01:55 smithi047 bash[22744]: cluster 2024-09-16T08:01:53.814692+0000 mgr.a (mgr.14373) 6265 : cluster [DBG] pgmap v4344: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:01:55.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:01:55 smithi157 bash[24585]: cluster 2024-09-16T08:01:53.814692+0000 mgr.a (mgr.14373) 6265 : cluster [DBG] pgmap v4344: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:01:57.215 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:01:57.216 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:01:57.216 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:01:57.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:01:57 smithi047 bash[22744]: cluster 2024-09-16T08:01:55.815653+0000 mgr.a (mgr.14373) 6266 : cluster [DBG] pgmap v4345: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T08:01:57.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:01:57 smithi157 bash[24585]: cluster 2024-09-16T08:01:55.815653+0000 mgr.a (mgr.14373) 6266 : cluster [DBG] pgmap v4345: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T08:01:57.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:01:57 smithi086 bash[24289]: cluster 2024-09-16T08:01:55.815653+0000 mgr.a (mgr.14373) 6266 : cluster [DBG] pgmap v4345: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T08:01:57.988 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:01:57.988 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:01:57.988 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:01:57.989 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:01:57.989 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:01:59.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:01:59 smithi047 bash[22744]: audit 2024-09-16T08:01:57.554479+0000 mgr.a (mgr.14373) 6267 : audit [DBG] from='client.143850 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:01:59.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:01:59 smithi047 bash[22744]: cluster 2024-09-16T08:01:57.818534+0000 mgr.a (mgr.14373) 6268 : cluster [DBG] pgmap v4346: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:01:59.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:01:59 smithi157 bash[24585]: audit 2024-09-16T08:01:57.554479+0000 mgr.a (mgr.14373) 6267 : audit [DBG] from='client.143850 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:01:59.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:01:59 smithi157 bash[24585]: cluster 2024-09-16T08:01:57.818534+0000 mgr.a (mgr.14373) 6268 : cluster [DBG] pgmap v4346: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:01:59.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:01:59 smithi086 bash[24289]: audit 2024-09-16T08:01:57.554479+0000 mgr.a (mgr.14373) 6267 : audit [DBG] from='client.143850 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:01:59.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:01:59 smithi086 bash[24289]: cluster 2024-09-16T08:01:57.818534+0000 mgr.a (mgr.14373) 6268 : cluster [DBG] pgmap v4346: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:02:01.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:02:01 smithi047 bash[22744]: cluster 2024-09-16T08:01:59.819457+0000 mgr.a (mgr.14373) 6269 : cluster [DBG] pgmap v4347: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:02:01.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:02:01 smithi157 bash[24585]: cluster 2024-09-16T08:01:59.819457+0000 mgr.a (mgr.14373) 6269 : cluster [DBG] pgmap v4347: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:02:01.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:02:01 smithi086 bash[24289]: cluster 2024-09-16T08:01:59.819457+0000 mgr.a (mgr.14373) 6269 : cluster [DBG] pgmap v4347: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:02:02.990 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:02:02.991 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:02:02.991 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:02:03.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:02:03 smithi047 bash[22744]: cluster 2024-09-16T08:02:01.821617+0000 mgr.a (mgr.14373) 6270 : cluster [DBG] pgmap v4348: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:02:03.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:02:03 smithi157 bash[24585]: cluster 2024-09-16T08:02:01.821617+0000 mgr.a (mgr.14373) 6270 : cluster [DBG] pgmap v4348: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:02:03.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:02:03 smithi086 bash[24289]: cluster 2024-09-16T08:02:01.821617+0000 mgr.a (mgr.14373) 6270 : cluster [DBG] pgmap v4348: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:02:03.775 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:02:03.775 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:02:03.775 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:02:03.775 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:02:03.775 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:02:05.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:02:05 smithi047 bash[22744]: audit 2024-09-16T08:02:03.329816+0000 mgr.a (mgr.14373) 6271 : audit [DBG] from='client.143928 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:02:05.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:02:05 smithi047 bash[22744]: cluster 2024-09-16T08:02:03.822241+0000 mgr.a (mgr.14373) 6272 : cluster [DBG] pgmap v4349: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:02:05.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:02:05 smithi157 bash[24585]: audit 2024-09-16T08:02:03.329816+0000 mgr.a (mgr.14373) 6271 : audit [DBG] from='client.143928 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:02:05.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:02:05 smithi157 bash[24585]: cluster 2024-09-16T08:02:03.822241+0000 mgr.a (mgr.14373) 6272 : cluster [DBG] pgmap v4349: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:02:05.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:02:05 smithi086 bash[24289]: audit 2024-09-16T08:02:03.329816+0000 mgr.a (mgr.14373) 6271 : audit [DBG] from='client.143928 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:02:05.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:02:05 smithi086 bash[24289]: cluster 2024-09-16T08:02:03.822241+0000 mgr.a (mgr.14373) 6272 : cluster [DBG] pgmap v4349: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:02:07.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:02:07 smithi157 bash[24585]: cluster 2024-09-16T08:02:05.822979+0000 mgr.a (mgr.14373) 6273 : cluster [DBG] pgmap v4350: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:02:07.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:02:07 smithi086 bash[24289]: cluster 2024-09-16T08:02:05.822979+0000 mgr.a (mgr.14373) 6273 : cluster [DBG] pgmap v4350: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:02:07.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:02:07 smithi047 bash[22744]: cluster 2024-09-16T08:02:05.822979+0000 mgr.a (mgr.14373) 6273 : cluster [DBG] pgmap v4350: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:02:08.776 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:02:08.777 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:02:08.778 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:02:09.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:02:09 smithi157 bash[24585]: cluster 2024-09-16T08:02:07.825192+0000 mgr.a (mgr.14373) 6274 : cluster [DBG] pgmap v4351: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:02:09.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:02:09 smithi086 bash[24289]: cluster 2024-09-16T08:02:07.825192+0000 mgr.a (mgr.14373) 6274 : cluster [DBG] pgmap v4351: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:02:09.569 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:02:09.569 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:02:09.569 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:02:09.569 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:02:09.569 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:02:09.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:02:09 smithi047 bash[22744]: cluster 2024-09-16T08:02:07.825192+0000 mgr.a (mgr.14373) 6274 : cluster [DBG] pgmap v4351: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:02:10.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:02:10 smithi157 bash[24585]: audit 2024-09-16T08:02:09.125250+0000 mgr.a (mgr.14373) 6275 : audit [DBG] from='client.144003 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:02:10.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:02:10 smithi086 bash[24289]: audit 2024-09-16T08:02:09.125250+0000 mgr.a (mgr.14373) 6275 : audit [DBG] from='client.144003 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:02:10.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:02:10 smithi047 bash[22744]: audit 2024-09-16T08:02:09.125250+0000 mgr.a (mgr.14373) 6275 : audit [DBG] from='client.144003 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:02:11.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:02:11 smithi157 bash[24585]: cluster 2024-09-16T08:02:09.826188+0000 mgr.a (mgr.14373) 6276 : cluster [DBG] pgmap v4352: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:02:11.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:02:11 smithi086 bash[24289]: cluster 2024-09-16T08:02:09.826188+0000 mgr.a (mgr.14373) 6276 : cluster [DBG] pgmap v4352: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:02:11.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:02:11 smithi047 bash[22744]: cluster 2024-09-16T08:02:09.826188+0000 mgr.a (mgr.14373) 6276 : cluster [DBG] pgmap v4352: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:02:13.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:02:13 smithi157 bash[24585]: cluster 2024-09-16T08:02:11.828343+0000 mgr.a (mgr.14373) 6277 : cluster [DBG] pgmap v4353: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:02:13.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:02:13 smithi157 bash[24585]: audit 2024-09-16T08:02:12.540683+0000 mon.b (mon.2) 602 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T08:02:13.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:02:13 smithi086 bash[24289]: cluster 2024-09-16T08:02:11.828343+0000 mgr.a (mgr.14373) 6277 : cluster [DBG] pgmap v4353: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:02:13.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:02:13 smithi086 bash[24289]: audit 2024-09-16T08:02:12.540683+0000 mon.b (mon.2) 602 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T08:02:13.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:02:13 smithi047 bash[22744]: cluster 2024-09-16T08:02:11.828343+0000 mgr.a (mgr.14373) 6277 : cluster [DBG] pgmap v4353: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:02:13.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:02:13 smithi047 bash[22744]: audit 2024-09-16T08:02:12.540683+0000 mon.b (mon.2) 602 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T08:02:14.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:02:14 smithi157 bash[24585]: audit 2024-09-16T08:02:13.374349+0000 mon.b (mon.2) 603 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T08:02:14.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:02:14 smithi157 bash[24585]: audit 2024-09-16T08:02:13.376430+0000 mon.b (mon.2) 604 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T08:02:14.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:02:14 smithi157 bash[24585]: audit 2024-09-16T08:02:13.388995+0000 mon.a (mon.0) 941 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:02:14.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:02:14 smithi157 bash[24585]: audit 2024-09-16T08:02:13.390623+0000 mon.b (mon.2) 605 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:02:14.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:02:14 smithi086 bash[24289]: audit 2024-09-16T08:02:13.374349+0000 mon.b (mon.2) 603 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T08:02:14.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:02:14 smithi086 bash[24289]: audit 2024-09-16T08:02:13.376430+0000 mon.b (mon.2) 604 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T08:02:14.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:02:14 smithi086 bash[24289]: audit 2024-09-16T08:02:13.388995+0000 mon.a (mon.0) 941 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:02:14.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:02:14 smithi086 bash[24289]: audit 2024-09-16T08:02:13.390623+0000 mon.b (mon.2) 605 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:02:14.570 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:02:14.571 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:02:14.571 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:02:14.587 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 08:02:14 smithi047 bash[22994]: debug 2024-09-16T08:02:14.132+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T08:02:14.587 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 08:02:14 smithi047 bash[22994]: debug 2024-09-16T08:02:14.132+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T08:02:14.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:02:14 smithi047 bash[22744]: audit 2024-09-16T08:02:13.374349+0000 mon.b (mon.2) 603 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T08:02:14.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:02:14 smithi047 bash[22744]: audit 2024-09-16T08:02:13.376430+0000 mon.b (mon.2) 604 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T08:02:14.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:02:14 smithi047 bash[22744]: audit 2024-09-16T08:02:13.388995+0000 mon.a (mon.0) 941 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:02:14.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:02:14 smithi047 bash[22744]: audit 2024-09-16T08:02:13.390623+0000 mon.b (mon.2) 605 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:02:15.356 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:02:15.356 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:02:15.356 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:02:15.356 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:02:15.356 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:02:15.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:02:15 smithi157 bash[24585]: audit 2024-09-16T08:02:13.395033+0000 mgr.a (mgr.14373) 6278 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:02:15.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:02:15 smithi157 bash[24585]: cluster 2024-09-16T08:02:13.829034+0000 mgr.a (mgr.14373) 6279 : cluster [DBG] pgmap v4354: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:02:15.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:02:15 smithi157 bash[24585]: audit 2024-09-16T08:02:14.136015+0000 mgr.a (mgr.14373) 6280 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T08:02:15.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:02:15 smithi157 bash[24585]: cephadm 2024-09-16T08:02:14.138187+0000 mgr.a (mgr.14373) 6281 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T08:02:15.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:02:15 smithi086 bash[24289]: audit 2024-09-16T08:02:13.395033+0000 mgr.a (mgr.14373) 6278 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:02:15.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:02:15 smithi086 bash[24289]: cluster 2024-09-16T08:02:13.829034+0000 mgr.a (mgr.14373) 6279 : cluster [DBG] pgmap v4354: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:02:15.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:02:15 smithi086 bash[24289]: audit 2024-09-16T08:02:14.136015+0000 mgr.a (mgr.14373) 6280 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T08:02:15.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:02:15 smithi086 bash[24289]: cephadm 2024-09-16T08:02:14.138187+0000 mgr.a (mgr.14373) 6281 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T08:02:15.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:02:15 smithi047 bash[22744]: audit 2024-09-16T08:02:13.395033+0000 mgr.a (mgr.14373) 6278 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:02:15.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:02:15 smithi047 bash[22744]: cluster 2024-09-16T08:02:13.829034+0000 mgr.a (mgr.14373) 6279 : cluster [DBG] pgmap v4354: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:02:15.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:02:15 smithi047 bash[22744]: audit 2024-09-16T08:02:14.136015+0000 mgr.a (mgr.14373) 6280 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T08:02:15.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:02:15 smithi047 bash[22744]: cephadm 2024-09-16T08:02:14.138187+0000 mgr.a (mgr.14373) 6281 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T08:02:16.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:02:16 smithi157 bash[24585]: audit 2024-09-16T08:02:14.905495+0000 mgr.a (mgr.14373) 6282 : audit [DBG] from='client.144183 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:02:16.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:02:16 smithi086 bash[24289]: audit 2024-09-16T08:02:14.905495+0000 mgr.a (mgr.14373) 6282 : audit [DBG] from='client.144183 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:02:16.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:02:16 smithi047 bash[22744]: audit 2024-09-16T08:02:14.905495+0000 mgr.a (mgr.14373) 6282 : audit [DBG] from='client.144183 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:02:17.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:02:17 smithi157 bash[24585]: cluster 2024-09-16T08:02:15.829996+0000 mgr.a (mgr.14373) 6283 : cluster [DBG] pgmap v4355: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:02:17.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:02:17 smithi086 bash[24289]: cluster 2024-09-16T08:02:15.829996+0000 mgr.a (mgr.14373) 6283 : cluster [DBG] pgmap v4355: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:02:17.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:02:17 smithi047 bash[22744]: cluster 2024-09-16T08:02:15.829996+0000 mgr.a (mgr.14373) 6283 : cluster [DBG] pgmap v4355: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:02:19.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:02:19 smithi157 bash[24585]: cluster 2024-09-16T08:02:17.832335+0000 mgr.a (mgr.14373) 6284 : cluster [DBG] pgmap v4356: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:02:19.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:02:19 smithi086 bash[24289]: cluster 2024-09-16T08:02:17.832335+0000 mgr.a (mgr.14373) 6284 : cluster [DBG] pgmap v4356: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:02:19.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:02:19 smithi047 bash[22744]: cluster 2024-09-16T08:02:17.832335+0000 mgr.a (mgr.14373) 6284 : cluster [DBG] pgmap v4356: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:02:20.357 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:02:20.358 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:02:20.358 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:02:21.143 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:02:21.144 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:02:21.144 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:02:21.144 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:02:21.144 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:02:21.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:02:21 smithi157 bash[24585]: cluster 2024-09-16T08:02:19.833116+0000 mgr.a (mgr.14373) 6285 : cluster [DBG] pgmap v4357: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:02:21.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:02:21 smithi086 bash[24289]: cluster 2024-09-16T08:02:19.833116+0000 mgr.a (mgr.14373) 6285 : cluster [DBG] pgmap v4357: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:02:21.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:02:21 smithi047 bash[22744]: cluster 2024-09-16T08:02:19.833116+0000 mgr.a (mgr.14373) 6285 : cluster [DBG] pgmap v4357: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:02:22.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:02:22 smithi157 bash[24585]: audit 2024-09-16T08:02:20.702282+0000 mgr.a (mgr.14373) 6286 : audit [DBG] from='client.144258 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:02:22.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:02:22 smithi086 bash[24289]: audit 2024-09-16T08:02:20.702282+0000 mgr.a (mgr.14373) 6286 : audit [DBG] from='client.144258 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:02:22.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:02:22 smithi047 bash[22744]: audit 2024-09-16T08:02:20.702282+0000 mgr.a (mgr.14373) 6286 : audit [DBG] from='client.144258 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:02:23.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:02:23 smithi157 bash[24585]: cluster 2024-09-16T08:02:21.835501+0000 mgr.a (mgr.14373) 6287 : cluster [DBG] pgmap v4358: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:02:23.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:02:23 smithi086 bash[24289]: cluster 2024-09-16T08:02:21.835501+0000 mgr.a (mgr.14373) 6287 : cluster [DBG] pgmap v4358: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:02:23.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:02:23 smithi047 bash[22744]: cluster 2024-09-16T08:02:21.835501+0000 mgr.a (mgr.14373) 6287 : cluster [DBG] pgmap v4358: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:02:25.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:02:25 smithi157 bash[24585]: cluster 2024-09-16T08:02:23.836304+0000 mgr.a (mgr.14373) 6288 : cluster [DBG] pgmap v4359: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:02:25.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:02:25 smithi086 bash[24289]: cluster 2024-09-16T08:02:23.836304+0000 mgr.a (mgr.14373) 6288 : cluster [DBG] pgmap v4359: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:02:25.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:02:25 smithi047 bash[22744]: cluster 2024-09-16T08:02:23.836304+0000 mgr.a (mgr.14373) 6288 : cluster [DBG] pgmap v4359: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:02:26.145 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:02:26.146 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:02:26.146 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:02:26.902 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:02:26.902 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:02:26.902 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:02:26.902 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:02:26.903 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:02:27.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:02:27 smithi157 bash[24585]: cluster 2024-09-16T08:02:25.837052+0000 mgr.a (mgr.14373) 6289 : cluster [DBG] pgmap v4360: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:02:27.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:02:27 smithi086 bash[24289]: cluster 2024-09-16T08:02:25.837052+0000 mgr.a (mgr.14373) 6289 : cluster [DBG] pgmap v4360: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:02:27.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:02:27 smithi047 bash[22744]: cluster 2024-09-16T08:02:25.837052+0000 mgr.a (mgr.14373) 6289 : cluster [DBG] pgmap v4360: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:02:28.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:02:28 smithi157 bash[24585]: audit 2024-09-16T08:02:26.485803+0000 mgr.a (mgr.14373) 6290 : audit [DBG] from='client.144333 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:02:28.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:02:28 smithi086 bash[24289]: audit 2024-09-16T08:02:26.485803+0000 mgr.a (mgr.14373) 6290 : audit [DBG] from='client.144333 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:02:28.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:02:28 smithi047 bash[22744]: audit 2024-09-16T08:02:26.485803+0000 mgr.a (mgr.14373) 6290 : audit [DBG] from='client.144333 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:02:29.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:02:29 smithi157 bash[24585]: cluster 2024-09-16T08:02:27.839785+0000 mgr.a (mgr.14373) 6291 : cluster [DBG] pgmap v4361: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:02:29.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:02:29 smithi086 bash[24289]: cluster 2024-09-16T08:02:27.839785+0000 mgr.a (mgr.14373) 6291 : cluster [DBG] pgmap v4361: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:02:29.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:02:29 smithi047 bash[22744]: cluster 2024-09-16T08:02:27.839785+0000 mgr.a (mgr.14373) 6291 : cluster [DBG] pgmap v4361: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:02:30.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:02:30 smithi157 bash[24585]: cluster 2024-09-16T08:02:29.840560+0000 mgr.a (mgr.14373) 6292 : cluster [DBG] pgmap v4362: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:02:30.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:02:30 smithi086 bash[24289]: cluster 2024-09-16T08:02:29.840560+0000 mgr.a (mgr.14373) 6292 : cluster [DBG] pgmap v4362: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:02:30.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:02:30 smithi047 bash[22744]: cluster 2024-09-16T08:02:29.840560+0000 mgr.a (mgr.14373) 6292 : cluster [DBG] pgmap v4362: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:02:31.903 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:02:31.904 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:02:31.904 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:02:32.656 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:02:32.657 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:02:32.657 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:02:32.657 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:02:32.657 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:02:33.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:02:32 smithi157 bash[24585]: cluster 2024-09-16T08:02:31.843260+0000 mgr.a (mgr.14373) 6293 : cluster [DBG] pgmap v4363: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:02:33.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:02:32 smithi157 bash[24585]: audit 2024-09-16T08:02:32.242490+0000 mgr.a (mgr.14373) 6294 : audit [DBG] from='client.144408 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:02:33.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:02:32 smithi086 bash[24289]: cluster 2024-09-16T08:02:31.843260+0000 mgr.a (mgr.14373) 6293 : cluster [DBG] pgmap v4363: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:02:33.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:02:32 smithi086 bash[24289]: audit 2024-09-16T08:02:32.242490+0000 mgr.a (mgr.14373) 6294 : audit [DBG] from='client.144408 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:02:33.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:02:32 smithi047 bash[22744]: cluster 2024-09-16T08:02:31.843260+0000 mgr.a (mgr.14373) 6293 : cluster [DBG] pgmap v4363: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:02:33.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:02:32 smithi047 bash[22744]: audit 2024-09-16T08:02:32.242490+0000 mgr.a (mgr.14373) 6294 : audit [DBG] from='client.144408 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:02:35.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:02:34 smithi157 bash[24585]: cluster 2024-09-16T08:02:33.844245+0000 mgr.a (mgr.14373) 6295 : cluster [DBG] pgmap v4364: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:02:35.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:02:34 smithi086 bash[24289]: cluster 2024-09-16T08:02:33.844245+0000 mgr.a (mgr.14373) 6295 : cluster [DBG] pgmap v4364: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:02:35.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:02:34 smithi047 bash[22744]: cluster 2024-09-16T08:02:33.844245+0000 mgr.a (mgr.14373) 6295 : cluster [DBG] pgmap v4364: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:02:37.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:02:36 smithi157 bash[24585]: cluster 2024-09-16T08:02:35.845023+0000 mgr.a (mgr.14373) 6296 : cluster [DBG] pgmap v4365: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:02:37.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:02:36 smithi086 bash[24289]: cluster 2024-09-16T08:02:35.845023+0000 mgr.a (mgr.14373) 6296 : cluster [DBG] pgmap v4365: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:02:37.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:02:36 smithi047 bash[22744]: cluster 2024-09-16T08:02:35.845023+0000 mgr.a (mgr.14373) 6296 : cluster [DBG] pgmap v4365: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:02:37.658 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:02:37.659 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:02:37.659 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:02:38.416 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:02:38.417 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:02:38.417 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:02:38.417 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:02:38.417 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:02:39.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:02:38 smithi157 bash[24585]: cluster 2024-09-16T08:02:37.847196+0000 mgr.a (mgr.14373) 6297 : cluster [DBG] pgmap v4366: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:02:39.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:02:38 smithi157 bash[24585]: audit 2024-09-16T08:02:37.998737+0000 mgr.a (mgr.14373) 6298 : audit [DBG] from='client.144483 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:02:39.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:02:38 smithi086 bash[24289]: cluster 2024-09-16T08:02:37.847196+0000 mgr.a (mgr.14373) 6297 : cluster [DBG] pgmap v4366: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:02:39.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:02:38 smithi086 bash[24289]: audit 2024-09-16T08:02:37.998737+0000 mgr.a (mgr.14373) 6298 : audit [DBG] from='client.144483 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:02:39.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:02:38 smithi047 bash[22744]: cluster 2024-09-16T08:02:37.847196+0000 mgr.a (mgr.14373) 6297 : cluster [DBG] pgmap v4366: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:02:39.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:02:38 smithi047 bash[22744]: audit 2024-09-16T08:02:37.998737+0000 mgr.a (mgr.14373) 6298 : audit [DBG] from='client.144483 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:02:41.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:02:40 smithi157 bash[24585]: cluster 2024-09-16T08:02:39.848041+0000 mgr.a (mgr.14373) 6299 : cluster [DBG] pgmap v4367: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:02:41.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:02:40 smithi086 bash[24289]: cluster 2024-09-16T08:02:39.848041+0000 mgr.a (mgr.14373) 6299 : cluster [DBG] pgmap v4367: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:02:41.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:02:40 smithi047 bash[22744]: cluster 2024-09-16T08:02:39.848041+0000 mgr.a (mgr.14373) 6299 : cluster [DBG] pgmap v4367: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:02:43.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:02:42 smithi157 bash[24585]: cluster 2024-09-16T08:02:41.850140+0000 mgr.a (mgr.14373) 6300 : cluster [DBG] pgmap v4368: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:02:43.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:02:42 smithi086 bash[24289]: cluster 2024-09-16T08:02:41.850140+0000 mgr.a (mgr.14373) 6300 : cluster [DBG] pgmap v4368: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:02:43.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:02:42 smithi047 bash[22744]: cluster 2024-09-16T08:02:41.850140+0000 mgr.a (mgr.14373) 6300 : cluster [DBG] pgmap v4368: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:02:43.418 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:02:43.419 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:02:43.419 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:02:44.190 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:02:44.191 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:02:44.191 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:02:44.191 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:02:44.191 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:02:45.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:02:44 smithi157 bash[24585]: audit 2024-09-16T08:02:43.757250+0000 mgr.a (mgr.14373) 6301 : audit [DBG] from='client.144558 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:02:45.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:02:44 smithi157 bash[24585]: cluster 2024-09-16T08:02:43.850648+0000 mgr.a (mgr.14373) 6302 : cluster [DBG] pgmap v4369: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:02:45.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:02:44 smithi086 bash[24289]: audit 2024-09-16T08:02:43.757250+0000 mgr.a (mgr.14373) 6301 : audit [DBG] from='client.144558 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:02:45.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:02:44 smithi086 bash[24289]: cluster 2024-09-16T08:02:43.850648+0000 mgr.a (mgr.14373) 6302 : cluster [DBG] pgmap v4369: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:02:45.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:02:44 smithi047 bash[22744]: audit 2024-09-16T08:02:43.757250+0000 mgr.a (mgr.14373) 6301 : audit [DBG] from='client.144558 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:02:45.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:02:44 smithi047 bash[22744]: cluster 2024-09-16T08:02:43.850648+0000 mgr.a (mgr.14373) 6302 : cluster [DBG] pgmap v4369: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:02:47.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:02:46 smithi157 bash[24585]: cluster 2024-09-16T08:02:45.851471+0000 mgr.a (mgr.14373) 6303 : cluster [DBG] pgmap v4370: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:02:47.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:02:46 smithi086 bash[24289]: cluster 2024-09-16T08:02:45.851471+0000 mgr.a (mgr.14373) 6303 : cluster [DBG] pgmap v4370: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:02:47.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:02:46 smithi047 bash[22744]: cluster 2024-09-16T08:02:45.851471+0000 mgr.a (mgr.14373) 6303 : cluster [DBG] pgmap v4370: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:02:49.192 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:02:49.192 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:02:49.193 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:02:49.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:02:49 smithi157 bash[24585]: cluster 2024-09-16T08:02:47.853627+0000 mgr.a (mgr.14373) 6304 : cluster [DBG] pgmap v4371: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:02:49.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:02:49 smithi086 bash[24289]: cluster 2024-09-16T08:02:47.853627+0000 mgr.a (mgr.14373) 6304 : cluster [DBG] pgmap v4371: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:02:49.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:02:49 smithi047 bash[22744]: cluster 2024-09-16T08:02:47.853627+0000 mgr.a (mgr.14373) 6304 : cluster [DBG] pgmap v4371: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:02:49.966 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:02:49.966 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:02:49.966 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:02:49.967 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:02:49.967 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:02:51.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:02:51 smithi157 bash[24585]: audit 2024-09-16T08:02:49.532341+0000 mgr.a (mgr.14373) 6305 : audit [DBG] from='client.144630 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:02:51.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:02:51 smithi157 bash[24585]: cluster 2024-09-16T08:02:49.854135+0000 mgr.a (mgr.14373) 6306 : cluster [DBG] pgmap v4372: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:02:51.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:02:51 smithi086 bash[24289]: audit 2024-09-16T08:02:49.532341+0000 mgr.a (mgr.14373) 6305 : audit [DBG] from='client.144630 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:02:51.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:02:51 smithi086 bash[24289]: cluster 2024-09-16T08:02:49.854135+0000 mgr.a (mgr.14373) 6306 : cluster [DBG] pgmap v4372: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:02:51.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:02:51 smithi047 bash[22744]: audit 2024-09-16T08:02:49.532341+0000 mgr.a (mgr.14373) 6305 : audit [DBG] from='client.144630 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:02:51.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:02:51 smithi047 bash[22744]: cluster 2024-09-16T08:02:49.854135+0000 mgr.a (mgr.14373) 6306 : cluster [DBG] pgmap v4372: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:02:53.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:02:53 smithi157 bash[24585]: cluster 2024-09-16T08:02:51.856399+0000 mgr.a (mgr.14373) 6307 : cluster [DBG] pgmap v4373: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:02:53.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:02:53 smithi086 bash[24289]: cluster 2024-09-16T08:02:51.856399+0000 mgr.a (mgr.14373) 6307 : cluster [DBG] pgmap v4373: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:02:53.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:02:53 smithi047 bash[22744]: cluster 2024-09-16T08:02:51.856399+0000 mgr.a (mgr.14373) 6307 : cluster [DBG] pgmap v4373: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:02:54.968 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:02:54.969 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:02:54.969 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:02:55.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:02:55 smithi157 bash[24585]: cluster 2024-09-16T08:02:53.857190+0000 mgr.a (mgr.14373) 6308 : cluster [DBG] pgmap v4374: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:02:55.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:02:55 smithi086 bash[24289]: cluster 2024-09-16T08:02:53.857190+0000 mgr.a (mgr.14373) 6308 : cluster [DBG] pgmap v4374: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:02:55.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:02:55 smithi047 bash[22744]: cluster 2024-09-16T08:02:53.857190+0000 mgr.a (mgr.14373) 6308 : cluster [DBG] pgmap v4374: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:02:55.707 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:02:55.708 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:02:55.708 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:02:55.708 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:02:55.708 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:02:56.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:02:56 smithi157 bash[24585]: audit 2024-09-16T08:02:55.304702+0000 mgr.a (mgr.14373) 6309 : audit [DBG] from='client.144708 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:02:56.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:02:56 smithi157 bash[24585]: cluster 2024-09-16T08:02:55.858118+0000 mgr.a (mgr.14373) 6310 : cluster [DBG] pgmap v4375: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:02:56.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:02:56 smithi086 bash[24289]: audit 2024-09-16T08:02:55.304702+0000 mgr.a (mgr.14373) 6309 : audit [DBG] from='client.144708 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:02:56.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:02:56 smithi086 bash[24289]: cluster 2024-09-16T08:02:55.858118+0000 mgr.a (mgr.14373) 6310 : cluster [DBG] pgmap v4375: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:02:56.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:02:56 smithi047 bash[22744]: audit 2024-09-16T08:02:55.304702+0000 mgr.a (mgr.14373) 6309 : audit [DBG] from='client.144708 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:02:56.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:02:56 smithi047 bash[22744]: cluster 2024-09-16T08:02:55.858118+0000 mgr.a (mgr.14373) 6310 : cluster [DBG] pgmap v4375: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:02:59.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:02:58 smithi157 bash[24585]: cluster 2024-09-16T08:02:57.860292+0000 mgr.a (mgr.14373) 6311 : cluster [DBG] pgmap v4376: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:02:59.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:02:58 smithi086 bash[24289]: cluster 2024-09-16T08:02:57.860292+0000 mgr.a (mgr.14373) 6311 : cluster [DBG] pgmap v4376: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:02:59.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:02:58 smithi047 bash[22744]: cluster 2024-09-16T08:02:57.860292+0000 mgr.a (mgr.14373) 6311 : cluster [DBG] pgmap v4376: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:03:00.709 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:03:00.710 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:03:00.710 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:03:01.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:03:00 smithi157 bash[24585]: cluster 2024-09-16T08:02:59.861049+0000 mgr.a (mgr.14373) 6312 : cluster [DBG] pgmap v4377: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:03:01.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:03:00 smithi086 bash[24289]: cluster 2024-09-16T08:02:59.861049+0000 mgr.a (mgr.14373) 6312 : cluster [DBG] pgmap v4377: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:03:01.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:03:00 smithi047 bash[22744]: cluster 2024-09-16T08:02:59.861049+0000 mgr.a (mgr.14373) 6312 : cluster [DBG] pgmap v4377: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:03:01.482 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:03:01.483 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:03:01.483 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:03:01.483 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:03:01.483 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:03:02.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:03:01 smithi157 bash[24585]: audit 2024-09-16T08:03:01.050066+0000 mgr.a (mgr.14373) 6313 : audit [DBG] from='client.144786 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:03:02.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:03:01 smithi086 bash[24289]: audit 2024-09-16T08:03:01.050066+0000 mgr.a (mgr.14373) 6313 : audit [DBG] from='client.144786 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:03:02.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:03:01 smithi047 bash[22744]: audit 2024-09-16T08:03:01.050066+0000 mgr.a (mgr.14373) 6313 : audit [DBG] from='client.144786 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:03:03.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:03:02 smithi157 bash[24585]: cluster 2024-09-16T08:03:01.863380+0000 mgr.a (mgr.14373) 6314 : cluster [DBG] pgmap v4378: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:03:03.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:03:02 smithi086 bash[24289]: cluster 2024-09-16T08:03:01.863380+0000 mgr.a (mgr.14373) 6314 : cluster [DBG] pgmap v4378: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:03:03.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:03:02 smithi047 bash[22744]: cluster 2024-09-16T08:03:01.863380+0000 mgr.a (mgr.14373) 6314 : cluster [DBG] pgmap v4378: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:03:05.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:03:04 smithi157 bash[24585]: cluster 2024-09-16T08:03:03.864161+0000 mgr.a (mgr.14373) 6315 : cluster [DBG] pgmap v4379: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:03:05.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:03:04 smithi086 bash[24289]: cluster 2024-09-16T08:03:03.864161+0000 mgr.a (mgr.14373) 6315 : cluster [DBG] pgmap v4379: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:03:05.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:03:04 smithi047 bash[22744]: cluster 2024-09-16T08:03:03.864161+0000 mgr.a (mgr.14373) 6315 : cluster [DBG] pgmap v4379: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:03:06.484 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:03:06.485 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:03:06.485 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:03:07.256 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:03:07.257 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:03:07.257 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:03:07.257 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:03:07.257 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:03:07.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:03:06 smithi157 bash[24585]: cluster 2024-09-16T08:03:05.864904+0000 mgr.a (mgr.14373) 6316 : cluster [DBG] pgmap v4380: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:03:07.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:03:06 smithi086 bash[24289]: cluster 2024-09-16T08:03:05.864904+0000 mgr.a (mgr.14373) 6316 : cluster [DBG] pgmap v4380: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:03:07.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:03:06 smithi047 bash[22744]: cluster 2024-09-16T08:03:05.864904+0000 mgr.a (mgr.14373) 6316 : cluster [DBG] pgmap v4380: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:03:08.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:03:07 smithi157 bash[24585]: audit 2024-09-16T08:03:06.824330+0000 mgr.a (mgr.14373) 6317 : audit [DBG] from='client.144864 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:03:08.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:03:07 smithi086 bash[24289]: audit 2024-09-16T08:03:06.824330+0000 mgr.a (mgr.14373) 6317 : audit [DBG] from='client.144864 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:03:08.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:03:07 smithi047 bash[22744]: audit 2024-09-16T08:03:06.824330+0000 mgr.a (mgr.14373) 6317 : audit [DBG] from='client.144864 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:03:09.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:03:08 smithi157 bash[24585]: cluster 2024-09-16T08:03:07.867639+0000 mgr.a (mgr.14373) 6318 : cluster [DBG] pgmap v4381: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:03:09.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:03:08 smithi086 bash[24289]: cluster 2024-09-16T08:03:07.867639+0000 mgr.a (mgr.14373) 6318 : cluster [DBG] pgmap v4381: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:03:09.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:03:08 smithi047 bash[22744]: cluster 2024-09-16T08:03:07.867639+0000 mgr.a (mgr.14373) 6318 : cluster [DBG] pgmap v4381: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:03:11.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:03:10 smithi157 bash[24585]: cluster 2024-09-16T08:03:09.868394+0000 mgr.a (mgr.14373) 6319 : cluster [DBG] pgmap v4382: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:03:11.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:03:10 smithi086 bash[24289]: cluster 2024-09-16T08:03:09.868394+0000 mgr.a (mgr.14373) 6319 : cluster [DBG] pgmap v4382: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:03:11.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:03:10 smithi047 bash[22744]: cluster 2024-09-16T08:03:09.868394+0000 mgr.a (mgr.14373) 6319 : cluster [DBG] pgmap v4382: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:03:12.258 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:03:12.259 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:03:12.259 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:03:13.033 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:03:13.033 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:03:13.033 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:03:13.033 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:03:13.033 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:03:13.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:03:12 smithi157 bash[24585]: cluster 2024-09-16T08:03:11.870321+0000 mgr.a (mgr.14373) 6320 : cluster [DBG] pgmap v4383: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:03:13.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:03:12 smithi086 bash[24289]: cluster 2024-09-16T08:03:11.870321+0000 mgr.a (mgr.14373) 6320 : cluster [DBG] pgmap v4383: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:03:13.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:03:12 smithi047 bash[22744]: cluster 2024-09-16T08:03:11.870321+0000 mgr.a (mgr.14373) 6320 : cluster [DBG] pgmap v4383: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:03:14.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:03:13 smithi157 bash[24585]: audit 2024-09-16T08:03:12.599479+0000 mgr.a (mgr.14373) 6321 : audit [DBG] from='client.144942 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:03:14.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:03:13 smithi086 bash[24289]: audit 2024-09-16T08:03:12.599479+0000 mgr.a (mgr.14373) 6321 : audit [DBG] from='client.144942 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:03:14.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:03:13 smithi047 bash[22744]: audit 2024-09-16T08:03:12.599479+0000 mgr.a (mgr.14373) 6321 : audit [DBG] from='client.144942 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:03:15.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:03:14 smithi157 bash[24585]: cluster 2024-09-16T08:03:13.871176+0000 mgr.a (mgr.14373) 6322 : cluster [DBG] pgmap v4384: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:03:15.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:03:14 smithi157 bash[24585]: audit 2024-09-16T08:03:14.189502+0000 mon.b (mon.2) 606 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T08:03:15.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:03:14 smithi086 bash[24289]: cluster 2024-09-16T08:03:13.871176+0000 mgr.a (mgr.14373) 6322 : cluster [DBG] pgmap v4384: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:03:15.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:03:14 smithi086 bash[24289]: audit 2024-09-16T08:03:14.189502+0000 mon.b (mon.2) 606 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T08:03:15.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:03:14 smithi047 bash[22744]: cluster 2024-09-16T08:03:13.871176+0000 mgr.a (mgr.14373) 6322 : cluster [DBG] pgmap v4384: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:03:15.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:03:14 smithi047 bash[22744]: audit 2024-09-16T08:03:14.189502+0000 mon.b (mon.2) 606 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T08:03:16.088 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 08:03:15 smithi047 bash[22994]: debug 2024-09-16T08:03:15.775+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T08:03:16.088 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 08:03:15 smithi047 bash[22994]: debug 2024-09-16T08:03:15.779+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T08:03:16.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:03:15 smithi047 bash[22744]: audit 2024-09-16T08:03:15.034210+0000 mon.b (mon.2) 607 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T08:03:16.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:03:15 smithi047 bash[22744]: audit 2024-09-16T08:03:15.036665+0000 mon.b (mon.2) 608 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T08:03:16.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:03:15 smithi047 bash[22744]: audit 2024-09-16T08:03:15.049865+0000 mon.a (mon.0) 942 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:03:16.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:03:15 smithi047 bash[22744]: audit 2024-09-16T08:03:15.053171+0000 mon.b (mon.2) 609 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:03:16.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:03:15 smithi047 bash[22744]: audit 2024-09-16T08:03:15.056298+0000 mgr.a (mgr.14373) 6323 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:03:16.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:03:15 smithi157 bash[24585]: audit 2024-09-16T08:03:15.034210+0000 mon.b (mon.2) 607 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T08:03:16.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:03:15 smithi157 bash[24585]: audit 2024-09-16T08:03:15.036665+0000 mon.b (mon.2) 608 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T08:03:16.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:03:15 smithi157 bash[24585]: audit 2024-09-16T08:03:15.049865+0000 mon.a (mon.0) 942 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:03:16.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:03:15 smithi157 bash[24585]: audit 2024-09-16T08:03:15.053171+0000 mon.b (mon.2) 609 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:03:16.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:03:15 smithi157 bash[24585]: audit 2024-09-16T08:03:15.056298+0000 mgr.a (mgr.14373) 6323 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:03:16.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:03:15 smithi086 bash[24289]: audit 2024-09-16T08:03:15.034210+0000 mon.b (mon.2) 607 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T08:03:16.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:03:15 smithi086 bash[24289]: audit 2024-09-16T08:03:15.036665+0000 mon.b (mon.2) 608 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T08:03:16.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:03:15 smithi086 bash[24289]: audit 2024-09-16T08:03:15.049865+0000 mon.a (mon.0) 942 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:03:16.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:03:15 smithi086 bash[24289]: audit 2024-09-16T08:03:15.053171+0000 mon.b (mon.2) 609 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:03:16.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:03:15 smithi086 bash[24289]: audit 2024-09-16T08:03:15.056298+0000 mgr.a (mgr.14373) 6323 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:03:17.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:03:17 smithi157 bash[24585]: audit 2024-09-16T08:03:15.780866+0000 mgr.a (mgr.14373) 6324 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T08:03:17.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:03:17 smithi157 bash[24585]: cephadm 2024-09-16T08:03:15.782676+0000 mgr.a (mgr.14373) 6325 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T08:03:17.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:03:17 smithi157 bash[24585]: cluster 2024-09-16T08:03:15.872071+0000 mgr.a (mgr.14373) 6326 : cluster [DBG] pgmap v4385: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T08:03:17.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:03:17 smithi086 bash[24289]: audit 2024-09-16T08:03:15.780866+0000 mgr.a (mgr.14373) 6324 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T08:03:17.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:03:17 smithi086 bash[24289]: cephadm 2024-09-16T08:03:15.782676+0000 mgr.a (mgr.14373) 6325 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T08:03:17.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:03:17 smithi086 bash[24289]: cluster 2024-09-16T08:03:15.872071+0000 mgr.a (mgr.14373) 6326 : cluster [DBG] pgmap v4385: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T08:03:17.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:03:17 smithi047 bash[22744]: audit 2024-09-16T08:03:15.780866+0000 mgr.a (mgr.14373) 6324 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T08:03:17.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:03:17 smithi047 bash[22744]: cephadm 2024-09-16T08:03:15.782676+0000 mgr.a (mgr.14373) 6325 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T08:03:17.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:03:17 smithi047 bash[22744]: cluster 2024-09-16T08:03:15.872071+0000 mgr.a (mgr.14373) 6326 : cluster [DBG] pgmap v4385: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T08:03:18.034 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:03:18.035 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:03:18.035 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:03:18.795 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:03:18.796 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:03:18.796 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:03:18.796 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:03:18.796 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:03:19.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:03:19 smithi157 bash[24585]: cluster 2024-09-16T08:03:17.874301+0000 mgr.a (mgr.14373) 6327 : cluster [DBG] pgmap v4386: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:03:19.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:03:19 smithi086 bash[24289]: cluster 2024-09-16T08:03:17.874301+0000 mgr.a (mgr.14373) 6327 : cluster [DBG] pgmap v4386: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:03:19.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:03:19 smithi047 bash[22744]: cluster 2024-09-16T08:03:17.874301+0000 mgr.a (mgr.14373) 6327 : cluster [DBG] pgmap v4386: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:03:20.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:03:20 smithi086 bash[24289]: audit 2024-09-16T08:03:18.373943+0000 mgr.a (mgr.14373) 6328 : audit [DBG] from='client.145116 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:03:20.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:03:20 smithi047 bash[22744]: audit 2024-09-16T08:03:18.373943+0000 mgr.a (mgr.14373) 6328 : audit [DBG] from='client.145116 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:03:20.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:03:20 smithi157 bash[24585]: audit 2024-09-16T08:03:18.373943+0000 mgr.a (mgr.14373) 6328 : audit [DBG] from='client.145116 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:03:21.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:03:21 smithi086 bash[24289]: cluster 2024-09-16T08:03:19.875318+0000 mgr.a (mgr.14373) 6329 : cluster [DBG] pgmap v4387: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:03:21.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:03:21 smithi047 bash[22744]: cluster 2024-09-16T08:03:19.875318+0000 mgr.a (mgr.14373) 6329 : cluster [DBG] pgmap v4387: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:03:21.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:03:21 smithi157 bash[24585]: cluster 2024-09-16T08:03:19.875318+0000 mgr.a (mgr.14373) 6329 : cluster [DBG] pgmap v4387: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:03:23.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:03:23 smithi086 bash[24289]: cluster 2024-09-16T08:03:21.877630+0000 mgr.a (mgr.14373) 6330 : cluster [DBG] pgmap v4388: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:03:23.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:03:23 smithi047 bash[22744]: cluster 2024-09-16T08:03:21.877630+0000 mgr.a (mgr.14373) 6330 : cluster [DBG] pgmap v4388: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:03:23.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:03:23 smithi157 bash[24585]: cluster 2024-09-16T08:03:21.877630+0000 mgr.a (mgr.14373) 6330 : cluster [DBG] pgmap v4388: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:03:23.797 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:03:23.798 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:03:23.798 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:03:24.587 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:03:24.588 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:03:24.588 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:03:24.588 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:03:24.588 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:03:25.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:03:25 smithi047 bash[22744]: cluster 2024-09-16T08:03:23.878397+0000 mgr.a (mgr.14373) 6331 : cluster [DBG] pgmap v4389: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:03:25.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:03:25 smithi047 bash[22744]: audit 2024-09-16T08:03:24.136499+0000 mgr.a (mgr.14373) 6332 : audit [DBG] from='client.145194 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:03:25.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:03:25 smithi157 bash[24585]: cluster 2024-09-16T08:03:23.878397+0000 mgr.a (mgr.14373) 6331 : cluster [DBG] pgmap v4389: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:03:25.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:03:25 smithi157 bash[24585]: audit 2024-09-16T08:03:24.136499+0000 mgr.a (mgr.14373) 6332 : audit [DBG] from='client.145194 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:03:25.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:03:25 smithi086 bash[24289]: cluster 2024-09-16T08:03:23.878397+0000 mgr.a (mgr.14373) 6331 : cluster [DBG] pgmap v4389: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:03:25.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:03:25 smithi086 bash[24289]: audit 2024-09-16T08:03:24.136499+0000 mgr.a (mgr.14373) 6332 : audit [DBG] from='client.145194 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:03:27.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:03:27 smithi047 bash[22744]: cluster 2024-09-16T08:03:25.879327+0000 mgr.a (mgr.14373) 6333 : cluster [DBG] pgmap v4390: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:03:27.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:03:27 smithi157 bash[24585]: cluster 2024-09-16T08:03:25.879327+0000 mgr.a (mgr.14373) 6333 : cluster [DBG] pgmap v4390: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:03:27.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:03:27 smithi086 bash[24289]: cluster 2024-09-16T08:03:25.879327+0000 mgr.a (mgr.14373) 6333 : cluster [DBG] pgmap v4390: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:03:29.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:03:29 smithi047 bash[22744]: cluster 2024-09-16T08:03:27.881541+0000 mgr.a (mgr.14373) 6334 : cluster [DBG] pgmap v4391: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:03:29.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:03:29 smithi157 bash[24585]: cluster 2024-09-16T08:03:27.881541+0000 mgr.a (mgr.14373) 6334 : cluster [DBG] pgmap v4391: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:03:29.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:03:29 smithi086 bash[24289]: cluster 2024-09-16T08:03:27.881541+0000 mgr.a (mgr.14373) 6334 : cluster [DBG] pgmap v4391: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:03:29.589 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:03:29.590 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:03:29.590 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:03:30.335 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:03:30.335 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:03:30.335 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:03:30.335 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:03:30.335 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:03:31.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:03:31 smithi047 bash[22744]: cluster 2024-09-16T08:03:29.882255+0000 mgr.a (mgr.14373) 6335 : cluster [DBG] pgmap v4392: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:03:31.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:03:31 smithi047 bash[22744]: audit 2024-09-16T08:03:29.922621+0000 mgr.a (mgr.14373) 6336 : audit [DBG] from='client.145272 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:03:31.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:03:31 smithi157 bash[24585]: cluster 2024-09-16T08:03:29.882255+0000 mgr.a (mgr.14373) 6335 : cluster [DBG] pgmap v4392: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:03:31.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:03:31 smithi157 bash[24585]: audit 2024-09-16T08:03:29.922621+0000 mgr.a (mgr.14373) 6336 : audit [DBG] from='client.145272 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:03:31.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:03:31 smithi086 bash[24289]: cluster 2024-09-16T08:03:29.882255+0000 mgr.a (mgr.14373) 6335 : cluster [DBG] pgmap v4392: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:03:31.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:03:31 smithi086 bash[24289]: audit 2024-09-16T08:03:29.922621+0000 mgr.a (mgr.14373) 6336 : audit [DBG] from='client.145272 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:03:33.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:03:33 smithi047 bash[22744]: cluster 2024-09-16T08:03:31.884510+0000 mgr.a (mgr.14373) 6337 : cluster [DBG] pgmap v4393: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:03:33.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:03:33 smithi157 bash[24585]: cluster 2024-09-16T08:03:31.884510+0000 mgr.a (mgr.14373) 6337 : cluster [DBG] pgmap v4393: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:03:33.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:03:33 smithi086 bash[24289]: cluster 2024-09-16T08:03:31.884510+0000 mgr.a (mgr.14373) 6337 : cluster [DBG] pgmap v4393: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:03:35.336 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:03:35.337 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:03:35.337 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:03:35.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:03:35 smithi157 bash[24585]: cluster 2024-09-16T08:03:33.885281+0000 mgr.a (mgr.14373) 6338 : cluster [DBG] pgmap v4394: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:03:35.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:03:35 smithi086 bash[24289]: cluster 2024-09-16T08:03:33.885281+0000 mgr.a (mgr.14373) 6338 : cluster [DBG] pgmap v4394: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:03:35.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:03:35 smithi047 bash[22744]: cluster 2024-09-16T08:03:33.885281+0000 mgr.a (mgr.14373) 6338 : cluster [DBG] pgmap v4394: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:03:36.080 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:03:36.081 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:03:36.081 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:03:36.081 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:03:36.081 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:03:37.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:03:37 smithi157 bash[24585]: audit 2024-09-16T08:03:35.670948+0000 mgr.a (mgr.14373) 6339 : audit [DBG] from='client.145344 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:03:37.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:03:37 smithi157 bash[24585]: cluster 2024-09-16T08:03:35.894109+0000 mgr.a (mgr.14373) 6340 : cluster [DBG] pgmap v4395: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:03:37.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:03:37 smithi086 bash[24289]: audit 2024-09-16T08:03:35.670948+0000 mgr.a (mgr.14373) 6339 : audit [DBG] from='client.145344 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:03:37.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:03:37 smithi086 bash[24289]: cluster 2024-09-16T08:03:35.894109+0000 mgr.a (mgr.14373) 6340 : cluster [DBG] pgmap v4395: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:03:37.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:03:37 smithi047 bash[22744]: audit 2024-09-16T08:03:35.670948+0000 mgr.a (mgr.14373) 6339 : audit [DBG] from='client.145344 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:03:37.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:03:37 smithi047 bash[22744]: cluster 2024-09-16T08:03:35.894109+0000 mgr.a (mgr.14373) 6340 : cluster [DBG] pgmap v4395: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:03:39.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:03:39 smithi157 bash[24585]: cluster 2024-09-16T08:03:37.896453+0000 mgr.a (mgr.14373) 6341 : cluster [DBG] pgmap v4396: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:03:39.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:03:39 smithi086 bash[24289]: cluster 2024-09-16T08:03:37.896453+0000 mgr.a (mgr.14373) 6341 : cluster [DBG] pgmap v4396: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:03:39.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:03:39 smithi047 bash[22744]: cluster 2024-09-16T08:03:37.896453+0000 mgr.a (mgr.14373) 6341 : cluster [DBG] pgmap v4396: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:03:41.082 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:03:41.083 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:03:41.083 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:03:41.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:03:41 smithi157 bash[24585]: cluster 2024-09-16T08:03:39.897224+0000 mgr.a (mgr.14373) 6342 : cluster [DBG] pgmap v4397: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:03:41.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:03:41 smithi086 bash[24289]: cluster 2024-09-16T08:03:39.897224+0000 mgr.a (mgr.14373) 6342 : cluster [DBG] pgmap v4397: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:03:41.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:03:41 smithi047 bash[22744]: cluster 2024-09-16T08:03:39.897224+0000 mgr.a (mgr.14373) 6342 : cluster [DBG] pgmap v4397: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:03:41.836 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:03:41.836 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:03:41.837 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:03:41.837 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:03:41.837 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:03:43.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:03:43 smithi157 bash[24585]: audit 2024-09-16T08:03:41.417317+0000 mgr.a (mgr.14373) 6343 : audit [DBG] from='client.145419 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:03:43.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:03:43 smithi157 bash[24585]: cluster 2024-09-16T08:03:41.900033+0000 mgr.a (mgr.14373) 6344 : cluster [DBG] pgmap v4398: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:03:43.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:03:43 smithi086 bash[24289]: audit 2024-09-16T08:03:41.417317+0000 mgr.a (mgr.14373) 6343 : audit [DBG] from='client.145419 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:03:43.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:03:43 smithi086 bash[24289]: cluster 2024-09-16T08:03:41.900033+0000 mgr.a (mgr.14373) 6344 : cluster [DBG] pgmap v4398: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:03:43.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:03:43 smithi047 bash[22744]: audit 2024-09-16T08:03:41.417317+0000 mgr.a (mgr.14373) 6343 : audit [DBG] from='client.145419 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:03:43.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:03:43 smithi047 bash[22744]: cluster 2024-09-16T08:03:41.900033+0000 mgr.a (mgr.14373) 6344 : cluster [DBG] pgmap v4398: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:03:45.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:03:45 smithi157 bash[24585]: cluster 2024-09-16T08:03:43.900841+0000 mgr.a (mgr.14373) 6345 : cluster [DBG] pgmap v4399: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:03:45.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:03:45 smithi086 bash[24289]: cluster 2024-09-16T08:03:43.900841+0000 mgr.a (mgr.14373) 6345 : cluster [DBG] pgmap v4399: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:03:45.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:03:45 smithi047 bash[22744]: cluster 2024-09-16T08:03:43.900841+0000 mgr.a (mgr.14373) 6345 : cluster [DBG] pgmap v4399: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:03:46.838 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:03:46.838 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:03:46.839 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:03:47.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:03:47 smithi157 bash[24585]: cluster 2024-09-16T08:03:45.901578+0000 mgr.a (mgr.14373) 6346 : cluster [DBG] pgmap v4400: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:03:47.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:03:47 smithi086 bash[24289]: cluster 2024-09-16T08:03:45.901578+0000 mgr.a (mgr.14373) 6346 : cluster [DBG] pgmap v4400: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:03:47.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:03:47 smithi047 bash[22744]: cluster 2024-09-16T08:03:45.901578+0000 mgr.a (mgr.14373) 6346 : cluster [DBG] pgmap v4400: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:03:47.612 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:03:47.613 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:03:47.613 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:03:47.613 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:03:47.613 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:03:48.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:03:48 smithi157 bash[24585]: audit 2024-09-16T08:03:47.180199+0000 mgr.a (mgr.14373) 6347 : audit [DBG] from='client.145497 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:03:48.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:03:48 smithi086 bash[24289]: audit 2024-09-16T08:03:47.180199+0000 mgr.a (mgr.14373) 6347 : audit [DBG] from='client.145497 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:03:48.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:03:48 smithi047 bash[22744]: audit 2024-09-16T08:03:47.180199+0000 mgr.a (mgr.14373) 6347 : audit [DBG] from='client.145497 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:03:49.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:03:49 smithi157 bash[24585]: cluster 2024-09-16T08:03:47.904197+0000 mgr.a (mgr.14373) 6348 : cluster [DBG] pgmap v4401: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:03:49.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:03:49 smithi086 bash[24289]: cluster 2024-09-16T08:03:47.904197+0000 mgr.a (mgr.14373) 6348 : cluster [DBG] pgmap v4401: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:03:49.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:03:49 smithi047 bash[22744]: cluster 2024-09-16T08:03:47.904197+0000 mgr.a (mgr.14373) 6348 : cluster [DBG] pgmap v4401: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:03:51.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:03:51 smithi157 bash[24585]: cluster 2024-09-16T08:03:49.904966+0000 mgr.a (mgr.14373) 6349 : cluster [DBG] pgmap v4402: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:03:51.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:03:51 smithi086 bash[24289]: cluster 2024-09-16T08:03:49.904966+0000 mgr.a (mgr.14373) 6349 : cluster [DBG] pgmap v4402: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:03:51.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:03:51 smithi047 bash[22744]: cluster 2024-09-16T08:03:49.904966+0000 mgr.a (mgr.14373) 6349 : cluster [DBG] pgmap v4402: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:03:52.614 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:03:52.615 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:03:52.615 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:03:53.398 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:03:53.398 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:03:53.399 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:03:53.399 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:03:53.399 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:03:53.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:03:53 smithi157 bash[24585]: cluster 2024-09-16T08:03:51.906957+0000 mgr.a (mgr.14373) 6350 : cluster [DBG] pgmap v4403: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:03:53.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:03:53 smithi086 bash[24289]: cluster 2024-09-16T08:03:51.906957+0000 mgr.a (mgr.14373) 6350 : cluster [DBG] pgmap v4403: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:03:53.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:03:53 smithi047 bash[22744]: cluster 2024-09-16T08:03:51.906957+0000 mgr.a (mgr.14373) 6350 : cluster [DBG] pgmap v4403: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:03:54.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:03:54 smithi157 bash[24585]: audit 2024-09-16T08:03:52.957925+0000 mgr.a (mgr.14373) 6351 : audit [DBG] from='client.145575 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:03:54.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:03:54 smithi086 bash[24289]: audit 2024-09-16T08:03:52.957925+0000 mgr.a (mgr.14373) 6351 : audit [DBG] from='client.145575 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:03:54.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:03:54 smithi047 bash[22744]: audit 2024-09-16T08:03:52.957925+0000 mgr.a (mgr.14373) 6351 : audit [DBG] from='client.145575 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:03:55.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:03:55 smithi157 bash[24585]: cluster 2024-09-16T08:03:53.907899+0000 mgr.a (mgr.14373) 6352 : cluster [DBG] pgmap v4404: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:03:55.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:03:55 smithi086 bash[24289]: cluster 2024-09-16T08:03:53.907899+0000 mgr.a (mgr.14373) 6352 : cluster [DBG] pgmap v4404: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:03:55.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:03:55 smithi047 bash[22744]: cluster 2024-09-16T08:03:53.907899+0000 mgr.a (mgr.14373) 6352 : cluster [DBG] pgmap v4404: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:03:57.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:03:57 smithi157 bash[24585]: cluster 2024-09-16T08:03:55.908672+0000 mgr.a (mgr.14373) 6353 : cluster [DBG] pgmap v4405: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:03:57.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:03:57 smithi086 bash[24289]: cluster 2024-09-16T08:03:55.908672+0000 mgr.a (mgr.14373) 6353 : cluster [DBG] pgmap v4405: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:03:57.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:03:57 smithi047 bash[22744]: cluster 2024-09-16T08:03:55.908672+0000 mgr.a (mgr.14373) 6353 : cluster [DBG] pgmap v4405: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:03:58.400 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:03:58.401 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:03:58.401 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:03:59.184 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:03:59.185 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:03:59.185 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:03:59.185 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:03:59.185 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:03:59.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:03:59 smithi157 bash[24585]: cluster 2024-09-16T08:03:57.910910+0000 mgr.a (mgr.14373) 6354 : cluster [DBG] pgmap v4406: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:03:59.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:03:59 smithi086 bash[24289]: cluster 2024-09-16T08:03:57.910910+0000 mgr.a (mgr.14373) 6354 : cluster [DBG] pgmap v4406: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:03:59.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:03:59 smithi047 bash[22744]: cluster 2024-09-16T08:03:57.910910+0000 mgr.a (mgr.14373) 6354 : cluster [DBG] pgmap v4406: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:04:00.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:04:00 smithi157 bash[24585]: audit 2024-09-16T08:03:58.740951+0000 mgr.a (mgr.14373) 6355 : audit [DBG] from='client.145650 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:04:00.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:04:00 smithi086 bash[24289]: audit 2024-09-16T08:03:58.740951+0000 mgr.a (mgr.14373) 6355 : audit [DBG] from='client.145650 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:04:00.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:04:00 smithi047 bash[22744]: audit 2024-09-16T08:03:58.740951+0000 mgr.a (mgr.14373) 6355 : audit [DBG] from='client.145650 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:04:01.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:04:01 smithi157 bash[24585]: cluster 2024-09-16T08:03:59.911807+0000 mgr.a (mgr.14373) 6356 : cluster [DBG] pgmap v4407: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:04:01.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:04:01 smithi086 bash[24289]: cluster 2024-09-16T08:03:59.911807+0000 mgr.a (mgr.14373) 6356 : cluster [DBG] pgmap v4407: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:04:01.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:04:01 smithi047 bash[22744]: cluster 2024-09-16T08:03:59.911807+0000 mgr.a (mgr.14373) 6356 : cluster [DBG] pgmap v4407: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:04:03.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:04:03 smithi157 bash[24585]: cluster 2024-09-16T08:04:01.913934+0000 mgr.a (mgr.14373) 6357 : cluster [DBG] pgmap v4408: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:04:03.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:04:03 smithi086 bash[24289]: cluster 2024-09-16T08:04:01.913934+0000 mgr.a (mgr.14373) 6357 : cluster [DBG] pgmap v4408: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:04:03.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:04:03 smithi047 bash[22744]: cluster 2024-09-16T08:04:01.913934+0000 mgr.a (mgr.14373) 6357 : cluster [DBG] pgmap v4408: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:04:04.186 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:04:04.187 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:04:04.187 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:04:04.954 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:04:04.955 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:04:04.955 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:04:04.955 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:04:04.955 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:04:05.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:04:05 smithi157 bash[24585]: cluster 2024-09-16T08:04:03.914687+0000 mgr.a (mgr.14373) 6358 : cluster [DBG] pgmap v4409: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:04:05.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:04:05 smithi086 bash[24289]: cluster 2024-09-16T08:04:03.914687+0000 mgr.a (mgr.14373) 6358 : cluster [DBG] pgmap v4409: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:04:05.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:04:05 smithi047 bash[22744]: cluster 2024-09-16T08:04:03.914687+0000 mgr.a (mgr.14373) 6358 : cluster [DBG] pgmap v4409: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:04:06.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:04:06 smithi157 bash[24585]: audit 2024-09-16T08:04:04.524351+0000 mgr.a (mgr.14373) 6359 : audit [DBG] from='client.145725 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:04:06.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:04:06 smithi086 bash[24289]: audit 2024-09-16T08:04:04.524351+0000 mgr.a (mgr.14373) 6359 : audit [DBG] from='client.145725 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:04:06.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:04:06 smithi047 bash[22744]: audit 2024-09-16T08:04:04.524351+0000 mgr.a (mgr.14373) 6359 : audit [DBG] from='client.145725 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:04:07.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:04:07 smithi157 bash[24585]: cluster 2024-09-16T08:04:05.915725+0000 mgr.a (mgr.14373) 6360 : cluster [DBG] pgmap v4410: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:04:07.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:04:07 smithi086 bash[24289]: cluster 2024-09-16T08:04:05.915725+0000 mgr.a (mgr.14373) 6360 : cluster [DBG] pgmap v4410: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:04:07.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:04:07 smithi047 bash[22744]: cluster 2024-09-16T08:04:05.915725+0000 mgr.a (mgr.14373) 6360 : cluster [DBG] pgmap v4410: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:04:09.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:04:09 smithi157 bash[24585]: cluster 2024-09-16T08:04:07.918153+0000 mgr.a (mgr.14373) 6361 : cluster [DBG] pgmap v4411: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:04:09.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:04:09 smithi086 bash[24289]: cluster 2024-09-16T08:04:07.918153+0000 mgr.a (mgr.14373) 6361 : cluster [DBG] pgmap v4411: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:04:09.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:04:09 smithi047 bash[22744]: cluster 2024-09-16T08:04:07.918153+0000 mgr.a (mgr.14373) 6361 : cluster [DBG] pgmap v4411: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:04:09.956 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:04:09.957 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:04:09.957 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:04:10.707 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:04:10.707 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:04:10.707 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:04:10.707 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:04:10.708 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:04:11.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:04:11 smithi157 bash[24585]: cluster 2024-09-16T08:04:09.919072+0000 mgr.a (mgr.14373) 6362 : cluster [DBG] pgmap v4412: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:04:11.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:04:11 smithi157 bash[24585]: audit 2024-09-16T08:04:10.291849+0000 mgr.a (mgr.14373) 6363 : audit [DBG] from='client.145800 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:04:11.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:04:11 smithi086 bash[24289]: cluster 2024-09-16T08:04:09.919072+0000 mgr.a (mgr.14373) 6362 : cluster [DBG] pgmap v4412: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:04:11.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:04:11 smithi086 bash[24289]: audit 2024-09-16T08:04:10.291849+0000 mgr.a (mgr.14373) 6363 : audit [DBG] from='client.145800 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:04:11.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:04:11 smithi047 bash[22744]: cluster 2024-09-16T08:04:09.919072+0000 mgr.a (mgr.14373) 6362 : cluster [DBG] pgmap v4412: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:04:11.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:04:11 smithi047 bash[22744]: audit 2024-09-16T08:04:10.291849+0000 mgr.a (mgr.14373) 6363 : audit [DBG] from='client.145800 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:04:13.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:04:13 smithi157 bash[24585]: cluster 2024-09-16T08:04:11.921394+0000 mgr.a (mgr.14373) 6364 : cluster [DBG] pgmap v4413: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:04:13.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:04:13 smithi086 bash[24289]: cluster 2024-09-16T08:04:11.921394+0000 mgr.a (mgr.14373) 6364 : cluster [DBG] pgmap v4413: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:04:13.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:04:13 smithi047 bash[22744]: cluster 2024-09-16T08:04:11.921394+0000 mgr.a (mgr.14373) 6364 : cluster [DBG] pgmap v4413: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:04:15.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:04:15 smithi157 bash[24585]: cluster 2024-09-16T08:04:13.922195+0000 mgr.a (mgr.14373) 6365 : cluster [DBG] pgmap v4414: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:04:15.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:04:15 smithi086 bash[24289]: cluster 2024-09-16T08:04:13.922195+0000 mgr.a (mgr.14373) 6365 : cluster [DBG] pgmap v4414: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:04:15.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:04:15 smithi047 bash[22744]: cluster 2024-09-16T08:04:13.922195+0000 mgr.a (mgr.14373) 6365 : cluster [DBG] pgmap v4414: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:04:15.708 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:04:15.709 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:04:15.709 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:04:16.503 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:04:16.503 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:04:16.504 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:04:16.504 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:04:16.504 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:04:16.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:04:16 smithi157 bash[24585]: audit 2024-09-16T08:04:15.831107+0000 mon.b (mon.2) 610 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T08:04:16.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:04:16 smithi086 bash[24289]: audit 2024-09-16T08:04:15.831107+0000 mon.b (mon.2) 610 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T08:04:16.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:04:16 smithi047 bash[22744]: audit 2024-09-16T08:04:15.831107+0000 mon.b (mon.2) 610 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T08:04:17.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:04:17 smithi157 bash[24585]: cluster 2024-09-16T08:04:15.922738+0000 mgr.a (mgr.14373) 6366 : cluster [DBG] pgmap v4415: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:04:17.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:04:17 smithi157 bash[24585]: audit 2024-09-16T08:04:16.053671+0000 mgr.a (mgr.14373) 6367 : audit [DBG] from='client.145878 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:04:17.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:04:17 smithi157 bash[24585]: audit 2024-09-16T08:04:16.629946+0000 mon.b (mon.2) 611 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T08:04:17.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:04:17 smithi157 bash[24585]: audit 2024-09-16T08:04:16.632305+0000 mon.b (mon.2) 612 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T08:04:17.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:04:17 smithi157 bash[24585]: audit 2024-09-16T08:04:16.645629+0000 mon.a (mon.0) 943 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:04:17.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:04:17 smithi157 bash[24585]: audit 2024-09-16T08:04:16.649297+0000 mon.b (mon.2) 613 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:04:17.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:04:17 smithi086 bash[24289]: cluster 2024-09-16T08:04:15.922738+0000 mgr.a (mgr.14373) 6366 : cluster [DBG] pgmap v4415: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:04:17.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:04:17 smithi086 bash[24289]: audit 2024-09-16T08:04:16.053671+0000 mgr.a (mgr.14373) 6367 : audit [DBG] from='client.145878 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:04:17.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:04:17 smithi086 bash[24289]: audit 2024-09-16T08:04:16.629946+0000 mon.b (mon.2) 611 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T08:04:17.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:04:17 smithi086 bash[24289]: audit 2024-09-16T08:04:16.632305+0000 mon.b (mon.2) 612 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T08:04:17.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:04:17 smithi086 bash[24289]: audit 2024-09-16T08:04:16.645629+0000 mon.a (mon.0) 943 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:04:17.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:04:17 smithi086 bash[24289]: audit 2024-09-16T08:04:16.649297+0000 mon.b (mon.2) 613 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:04:17.588 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 08:04:17 smithi047 bash[22994]: debug 2024-09-16T08:04:17.369+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T08:04:17.588 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 08:04:17 smithi047 bash[22994]: debug 2024-09-16T08:04:17.369+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T08:04:17.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:04:17 smithi047 bash[22744]: cluster 2024-09-16T08:04:15.922738+0000 mgr.a (mgr.14373) 6366 : cluster [DBG] pgmap v4415: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:04:17.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:04:17 smithi047 bash[22744]: audit 2024-09-16T08:04:16.053671+0000 mgr.a (mgr.14373) 6367 : audit [DBG] from='client.145878 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:04:17.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:04:17 smithi047 bash[22744]: audit 2024-09-16T08:04:16.629946+0000 mon.b (mon.2) 611 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T08:04:17.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:04:17 smithi047 bash[22744]: audit 2024-09-16T08:04:16.632305+0000 mon.b (mon.2) 612 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T08:04:17.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:04:17 smithi047 bash[22744]: audit 2024-09-16T08:04:16.645629+0000 mon.a (mon.0) 943 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:04:17.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:04:17 smithi047 bash[22744]: audit 2024-09-16T08:04:16.649297+0000 mon.b (mon.2) 613 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:04:18.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:04:18 smithi157 bash[24585]: audit 2024-09-16T08:04:16.653832+0000 mgr.a (mgr.14373) 6368 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:04:18.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:04:18 smithi086 bash[24289]: audit 2024-09-16T08:04:16.653832+0000 mgr.a (mgr.14373) 6368 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:04:18.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:04:18 smithi047 bash[22744]: audit 2024-09-16T08:04:16.653832+0000 mgr.a (mgr.14373) 6368 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:04:19.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:04:19 smithi157 bash[24585]: audit 2024-09-16T08:04:17.371107+0000 mgr.a (mgr.14373) 6369 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T08:04:19.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:04:19 smithi157 bash[24585]: cephadm 2024-09-16T08:04:17.373334+0000 mgr.a (mgr.14373) 6370 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T08:04:19.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:04:19 smithi157 bash[24585]: cluster 2024-09-16T08:04:17.925420+0000 mgr.a (mgr.14373) 6371 : cluster [DBG] pgmap v4416: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:04:19.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:04:19 smithi086 bash[24289]: audit 2024-09-16T08:04:17.371107+0000 mgr.a (mgr.14373) 6369 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T08:04:19.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:04:19 smithi086 bash[24289]: cephadm 2024-09-16T08:04:17.373334+0000 mgr.a (mgr.14373) 6370 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T08:04:19.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:04:19 smithi086 bash[24289]: cluster 2024-09-16T08:04:17.925420+0000 mgr.a (mgr.14373) 6371 : cluster [DBG] pgmap v4416: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:04:19.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:04:19 smithi047 bash[22744]: audit 2024-09-16T08:04:17.371107+0000 mgr.a (mgr.14373) 6369 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T08:04:19.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:04:19 smithi047 bash[22744]: cephadm 2024-09-16T08:04:17.373334+0000 mgr.a (mgr.14373) 6370 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T08:04:19.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:04:19 smithi047 bash[22744]: cluster 2024-09-16T08:04:17.925420+0000 mgr.a (mgr.14373) 6371 : cluster [DBG] pgmap v4416: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:04:21.505 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:04:21.505 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:04:21.506 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:04:21.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:04:21 smithi157 bash[24585]: cluster 2024-09-16T08:04:19.926207+0000 mgr.a (mgr.14373) 6372 : cluster [DBG] pgmap v4417: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:04:21.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:04:21 smithi086 bash[24289]: cluster 2024-09-16T08:04:19.926207+0000 mgr.a (mgr.14373) 6372 : cluster [DBG] pgmap v4417: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:04:21.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:04:21 smithi047 bash[22744]: cluster 2024-09-16T08:04:19.926207+0000 mgr.a (mgr.14373) 6372 : cluster [DBG] pgmap v4417: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:04:22.242 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:04:22.243 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:04:22.243 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:04:22.243 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:04:22.243 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:04:23.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:04:23 smithi157 bash[24585]: audit 2024-09-16T08:04:21.832116+0000 mgr.a (mgr.14373) 6373 : audit [DBG] from='client.146061 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:04:23.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:04:23 smithi157 bash[24585]: cluster 2024-09-16T08:04:21.927381+0000 mgr.a (mgr.14373) 6374 : cluster [DBG] pgmap v4418: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:04:23.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:04:23 smithi086 bash[24289]: audit 2024-09-16T08:04:21.832116+0000 mgr.a (mgr.14373) 6373 : audit [DBG] from='client.146061 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:04:23.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:04:23 smithi086 bash[24289]: cluster 2024-09-16T08:04:21.927381+0000 mgr.a (mgr.14373) 6374 : cluster [DBG] pgmap v4418: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:04:23.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:04:23 smithi047 bash[22744]: audit 2024-09-16T08:04:21.832116+0000 mgr.a (mgr.14373) 6373 : audit [DBG] from='client.146061 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:04:23.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:04:23 smithi047 bash[22744]: cluster 2024-09-16T08:04:21.927381+0000 mgr.a (mgr.14373) 6374 : cluster [DBG] pgmap v4418: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:04:25.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:04:25 smithi157 bash[24585]: cluster 2024-09-16T08:04:23.928316+0000 mgr.a (mgr.14373) 6375 : cluster [DBG] pgmap v4419: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T08:04:25.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:04:25 smithi086 bash[24289]: cluster 2024-09-16T08:04:23.928316+0000 mgr.a (mgr.14373) 6375 : cluster [DBG] pgmap v4419: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T08:04:25.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:04:25 smithi047 bash[22744]: cluster 2024-09-16T08:04:23.928316+0000 mgr.a (mgr.14373) 6375 : cluster [DBG] pgmap v4419: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T08:04:27.244 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:04:27.244 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:04:27.245 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:04:27.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:04:27 smithi157 bash[24585]: cluster 2024-09-16T08:04:25.929115+0000 mgr.a (mgr.14373) 6376 : cluster [DBG] pgmap v4420: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T08:04:27.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:04:27 smithi086 bash[24289]: cluster 2024-09-16T08:04:25.929115+0000 mgr.a (mgr.14373) 6376 : cluster [DBG] pgmap v4420: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T08:04:27.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:04:27 smithi047 bash[22744]: cluster 2024-09-16T08:04:25.929115+0000 mgr.a (mgr.14373) 6376 : cluster [DBG] pgmap v4420: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T08:04:27.987 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:04:27.987 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:04:27.988 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:04:27.988 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:04:27.988 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:04:29.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:04:29 smithi157 bash[24585]: audit 2024-09-16T08:04:27.577599+0000 mgr.a (mgr.14373) 6377 : audit [DBG] from='client.146136 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:04:29.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:04:29 smithi157 bash[24585]: cluster 2024-09-16T08:04:27.930490+0000 mgr.a (mgr.14373) 6378 : cluster [DBG] pgmap v4421: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:04:29.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:04:29 smithi086 bash[24289]: audit 2024-09-16T08:04:27.577599+0000 mgr.a (mgr.14373) 6377 : audit [DBG] from='client.146136 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:04:29.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:04:29 smithi086 bash[24289]: cluster 2024-09-16T08:04:27.930490+0000 mgr.a (mgr.14373) 6378 : cluster [DBG] pgmap v4421: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:04:29.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:04:29 smithi047 bash[22744]: audit 2024-09-16T08:04:27.577599+0000 mgr.a (mgr.14373) 6377 : audit [DBG] from='client.146136 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:04:29.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:04:29 smithi047 bash[22744]: cluster 2024-09-16T08:04:27.930490+0000 mgr.a (mgr.14373) 6378 : cluster [DBG] pgmap v4421: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:04:31.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:04:31 smithi157 bash[24585]: cluster 2024-09-16T08:04:29.931255+0000 mgr.a (mgr.14373) 6379 : cluster [DBG] pgmap v4422: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T08:04:31.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:04:31 smithi086 bash[24289]: cluster 2024-09-16T08:04:29.931255+0000 mgr.a (mgr.14373) 6379 : cluster [DBG] pgmap v4422: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T08:04:31.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:04:31 smithi047 bash[22744]: cluster 2024-09-16T08:04:29.931255+0000 mgr.a (mgr.14373) 6379 : cluster [DBG] pgmap v4422: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T08:04:32.989 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:04:32.989 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:04:32.990 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:04:33.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:04:33 smithi157 bash[24585]: cluster 2024-09-16T08:04:31.933200+0000 mgr.a (mgr.14373) 6380 : cluster [DBG] pgmap v4423: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:04:33.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:04:33 smithi086 bash[24289]: cluster 2024-09-16T08:04:31.933200+0000 mgr.a (mgr.14373) 6380 : cluster [DBG] pgmap v4423: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:04:33.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:04:33 smithi047 bash[22744]: cluster 2024-09-16T08:04:31.933200+0000 mgr.a (mgr.14373) 6380 : cluster [DBG] pgmap v4423: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:04:33.761 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:04:33.761 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:04:33.762 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:04:33.762 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:04:33.762 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:04:35.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:04:35 smithi157 bash[24585]: audit 2024-09-16T08:04:33.325496+0000 mgr.a (mgr.14373) 6381 : audit [DBG] from='client.146214 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:04:35.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:04:35 smithi157 bash[24585]: cluster 2024-09-16T08:04:33.934181+0000 mgr.a (mgr.14373) 6382 : cluster [DBG] pgmap v4424: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:04:35.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:04:35 smithi086 bash[24289]: audit 2024-09-16T08:04:33.325496+0000 mgr.a (mgr.14373) 6381 : audit [DBG] from='client.146214 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:04:35.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:04:35 smithi086 bash[24289]: cluster 2024-09-16T08:04:33.934181+0000 mgr.a (mgr.14373) 6382 : cluster [DBG] pgmap v4424: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:04:35.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:04:35 smithi047 bash[22744]: audit 2024-09-16T08:04:33.325496+0000 mgr.a (mgr.14373) 6381 : audit [DBG] from='client.146214 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:04:35.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:04:35 smithi047 bash[22744]: cluster 2024-09-16T08:04:33.934181+0000 mgr.a (mgr.14373) 6382 : cluster [DBG] pgmap v4424: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:04:37.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:04:37 smithi157 bash[24585]: cluster 2024-09-16T08:04:35.934976+0000 mgr.a (mgr.14373) 6383 : cluster [DBG] pgmap v4425: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:04:37.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:04:37 smithi086 bash[24289]: cluster 2024-09-16T08:04:35.934976+0000 mgr.a (mgr.14373) 6383 : cluster [DBG] pgmap v4425: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:04:37.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:04:37 smithi047 bash[22744]: cluster 2024-09-16T08:04:35.934976+0000 mgr.a (mgr.14373) 6383 : cluster [DBG] pgmap v4425: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:04:38.763 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:04:38.763 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:04:38.764 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:04:39.520 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:04:39.520 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:04:39.520 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:04:39.521 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:04:39.521 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:04:39.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:04:39 smithi157 bash[24585]: cluster 2024-09-16T08:04:37.937209+0000 mgr.a (mgr.14373) 6384 : cluster [DBG] pgmap v4426: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:04:39.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:04:39 smithi086 bash[24289]: cluster 2024-09-16T08:04:37.937209+0000 mgr.a (mgr.14373) 6384 : cluster [DBG] pgmap v4426: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:04:39.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:04:39 smithi047 bash[22744]: cluster 2024-09-16T08:04:37.937209+0000 mgr.a (mgr.14373) 6384 : cluster [DBG] pgmap v4426: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:04:40.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:04:40 smithi157 bash[24585]: audit 2024-09-16T08:04:39.096629+0000 mgr.a (mgr.14373) 6385 : audit [DBG] from='client.146289 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:04:40.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:04:40 smithi086 bash[24289]: audit 2024-09-16T08:04:39.096629+0000 mgr.a (mgr.14373) 6385 : audit [DBG] from='client.146289 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:04:40.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:04:40 smithi047 bash[22744]: audit 2024-09-16T08:04:39.096629+0000 mgr.a (mgr.14373) 6385 : audit [DBG] from='client.146289 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:04:41.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:04:41 smithi157 bash[24585]: cluster 2024-09-16T08:04:39.938178+0000 mgr.a (mgr.14373) 6386 : cluster [DBG] pgmap v4427: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:04:41.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:04:41 smithi086 bash[24289]: cluster 2024-09-16T08:04:39.938178+0000 mgr.a (mgr.14373) 6386 : cluster [DBG] pgmap v4427: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:04:41.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:04:41 smithi047 bash[22744]: cluster 2024-09-16T08:04:39.938178+0000 mgr.a (mgr.14373) 6386 : cluster [DBG] pgmap v4427: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:04:43.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:04:43 smithi157 bash[24585]: cluster 2024-09-16T08:04:41.940343+0000 mgr.a (mgr.14373) 6387 : cluster [DBG] pgmap v4428: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:04:43.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:04:43 smithi086 bash[24289]: cluster 2024-09-16T08:04:41.940343+0000 mgr.a (mgr.14373) 6387 : cluster [DBG] pgmap v4428: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:04:43.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:04:43 smithi047 bash[22744]: cluster 2024-09-16T08:04:41.940343+0000 mgr.a (mgr.14373) 6387 : cluster [DBG] pgmap v4428: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:04:44.521 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:04:44.522 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:04:44.523 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:04:45.298 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:04:45.299 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:04:45.299 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:04:45.299 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:04:45.299 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:04:45.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:04:45 smithi157 bash[24585]: cluster 2024-09-16T08:04:43.941064+0000 mgr.a (mgr.14373) 6388 : cluster [DBG] pgmap v4429: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:04:45.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:04:45 smithi086 bash[24289]: cluster 2024-09-16T08:04:43.941064+0000 mgr.a (mgr.14373) 6388 : cluster [DBG] pgmap v4429: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:04:45.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:04:45 smithi047 bash[22744]: cluster 2024-09-16T08:04:43.941064+0000 mgr.a (mgr.14373) 6388 : cluster [DBG] pgmap v4429: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:04:46.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:04:46 smithi157 bash[24585]: audit 2024-09-16T08:04:44.862526+0000 mgr.a (mgr.14373) 6389 : audit [DBG] from='client.146367 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:04:46.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:04:46 smithi086 bash[24289]: audit 2024-09-16T08:04:44.862526+0000 mgr.a (mgr.14373) 6389 : audit [DBG] from='client.146367 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:04:46.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:04:46 smithi047 bash[22744]: audit 2024-09-16T08:04:44.862526+0000 mgr.a (mgr.14373) 6389 : audit [DBG] from='client.146367 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:04:47.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:04:47 smithi157 bash[24585]: cluster 2024-09-16T08:04:45.942142+0000 mgr.a (mgr.14373) 6390 : cluster [DBG] pgmap v4430: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:04:47.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:04:47 smithi086 bash[24289]: cluster 2024-09-16T08:04:45.942142+0000 mgr.a (mgr.14373) 6390 : cluster [DBG] pgmap v4430: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:04:47.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:04:47 smithi047 bash[22744]: cluster 2024-09-16T08:04:45.942142+0000 mgr.a (mgr.14373) 6390 : cluster [DBG] pgmap v4430: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:04:49.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:04:49 smithi157 bash[24585]: cluster 2024-09-16T08:04:47.944554+0000 mgr.a (mgr.14373) 6391 : cluster [DBG] pgmap v4431: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:04:49.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:04:49 smithi086 bash[24289]: cluster 2024-09-16T08:04:47.944554+0000 mgr.a (mgr.14373) 6391 : cluster [DBG] pgmap v4431: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:04:49.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:04:49 smithi047 bash[22744]: cluster 2024-09-16T08:04:47.944554+0000 mgr.a (mgr.14373) 6391 : cluster [DBG] pgmap v4431: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:04:50.300 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:04:50.301 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:04:50.301 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:04:51.046 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:04:51.047 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:04:51.047 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:04:51.047 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:04:51.047 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:04:51.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:04:51 smithi157 bash[24585]: cluster 2024-09-16T08:04:49.945517+0000 mgr.a (mgr.14373) 6392 : cluster [DBG] pgmap v4432: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:04:51.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:04:51 smithi086 bash[24289]: cluster 2024-09-16T08:04:49.945517+0000 mgr.a (mgr.14373) 6392 : cluster [DBG] pgmap v4432: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:04:51.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:04:51 smithi047 bash[22744]: cluster 2024-09-16T08:04:49.945517+0000 mgr.a (mgr.14373) 6392 : cluster [DBG] pgmap v4432: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:04:52.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:04:52 smithi086 bash[24289]: audit 2024-09-16T08:04:50.634167+0000 mgr.a (mgr.14373) 6393 : audit [DBG] from='client.146445 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:04:52.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:04:52 smithi047 bash[22744]: audit 2024-09-16T08:04:50.634167+0000 mgr.a (mgr.14373) 6393 : audit [DBG] from='client.146445 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:04:52.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:04:52 smithi157 bash[24585]: audit 2024-09-16T08:04:50.634167+0000 mgr.a (mgr.14373) 6393 : audit [DBG] from='client.146445 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:04:53.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:04:53 smithi086 bash[24289]: cluster 2024-09-16T08:04:51.947885+0000 mgr.a (mgr.14373) 6394 : cluster [DBG] pgmap v4433: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:04:53.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:04:53 smithi047 bash[22744]: cluster 2024-09-16T08:04:51.947885+0000 mgr.a (mgr.14373) 6394 : cluster [DBG] pgmap v4433: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:04:53.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:04:53 smithi157 bash[24585]: cluster 2024-09-16T08:04:51.947885+0000 mgr.a (mgr.14373) 6394 : cluster [DBG] pgmap v4433: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:04:55.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:04:55 smithi047 bash[22744]: cluster 2024-09-16T08:04:53.948651+0000 mgr.a (mgr.14373) 6395 : cluster [DBG] pgmap v4434: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:04:55.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:04:55 smithi157 bash[24585]: cluster 2024-09-16T08:04:53.948651+0000 mgr.a (mgr.14373) 6395 : cluster [DBG] pgmap v4434: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:04:55.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:04:55 smithi086 bash[24289]: cluster 2024-09-16T08:04:53.948651+0000 mgr.a (mgr.14373) 6395 : cluster [DBG] pgmap v4434: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:04:56.048 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:04:56.049 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:04:56.049 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:04:56.789 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:04:56.789 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:04:56.789 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:04:56.789 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:04:56.790 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:04:57.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:04:57 smithi047 bash[22744]: cluster 2024-09-16T08:04:55.949412+0000 mgr.a (mgr.14373) 6396 : cluster [DBG] pgmap v4435: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:04:57.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:04:57 smithi047 bash[22744]: audit 2024-09-16T08:04:56.383237+0000 mgr.a (mgr.14373) 6397 : audit [DBG] from='client.146517 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:04:57.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:04:57 smithi157 bash[24585]: cluster 2024-09-16T08:04:55.949412+0000 mgr.a (mgr.14373) 6396 : cluster [DBG] pgmap v4435: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:04:57.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:04:57 smithi157 bash[24585]: audit 2024-09-16T08:04:56.383237+0000 mgr.a (mgr.14373) 6397 : audit [DBG] from='client.146517 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:04:57.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:04:57 smithi086 bash[24289]: cluster 2024-09-16T08:04:55.949412+0000 mgr.a (mgr.14373) 6396 : cluster [DBG] pgmap v4435: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:04:57.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:04:57 smithi086 bash[24289]: audit 2024-09-16T08:04:56.383237+0000 mgr.a (mgr.14373) 6397 : audit [DBG] from='client.146517 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:04:58.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:04:58 smithi047 bash[22744]: cluster 2024-09-16T08:04:57.952212+0000 mgr.a (mgr.14373) 6398 : cluster [DBG] pgmap v4436: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:04:58.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:04:58 smithi157 bash[24585]: cluster 2024-09-16T08:04:57.952212+0000 mgr.a (mgr.14373) 6398 : cluster [DBG] pgmap v4436: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:04:58.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:04:58 smithi086 bash[24289]: cluster 2024-09-16T08:04:57.952212+0000 mgr.a (mgr.14373) 6398 : cluster [DBG] pgmap v4436: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:05:01.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:05:01 smithi157 bash[24585]: cluster 2024-09-16T08:04:59.953012+0000 mgr.a (mgr.14373) 6399 : cluster [DBG] pgmap v4437: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:05:01.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:05:01 smithi086 bash[24289]: cluster 2024-09-16T08:04:59.953012+0000 mgr.a (mgr.14373) 6399 : cluster [DBG] pgmap v4437: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:05:01.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:05:01 smithi047 bash[22744]: cluster 2024-09-16T08:04:59.953012+0000 mgr.a (mgr.14373) 6399 : cluster [DBG] pgmap v4437: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:05:01.790 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:05:01.791 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:05:01.791 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:05:02.571 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:05:02.571 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:05:02.572 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:05:02.572 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:05:02.572 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:05:03.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:05:03 smithi157 bash[24585]: cluster 2024-09-16T08:05:01.954723+0000 mgr.a (mgr.14373) 6400 : cluster [DBG] pgmap v4438: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:05:03.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:05:03 smithi157 bash[24585]: audit 2024-09-16T08:05:02.132031+0000 mgr.a (mgr.14373) 6401 : audit [DBG] from='client.146592 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:05:03.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:05:03 smithi086 bash[24289]: cluster 2024-09-16T08:05:01.954723+0000 mgr.a (mgr.14373) 6400 : cluster [DBG] pgmap v4438: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:05:03.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:05:03 smithi086 bash[24289]: audit 2024-09-16T08:05:02.132031+0000 mgr.a (mgr.14373) 6401 : audit [DBG] from='client.146592 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:05:03.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:05:03 smithi047 bash[22744]: cluster 2024-09-16T08:05:01.954723+0000 mgr.a (mgr.14373) 6400 : cluster [DBG] pgmap v4438: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:05:03.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:05:03 smithi047 bash[22744]: audit 2024-09-16T08:05:02.132031+0000 mgr.a (mgr.14373) 6401 : audit [DBG] from='client.146592 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:05:05.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:05:05 smithi157 bash[24585]: cluster 2024-09-16T08:05:03.955675+0000 mgr.a (mgr.14373) 6402 : cluster [DBG] pgmap v4439: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:05:05.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:05:05 smithi086 bash[24289]: cluster 2024-09-16T08:05:03.955675+0000 mgr.a (mgr.14373) 6402 : cluster [DBG] pgmap v4439: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:05:05.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:05:05 smithi047 bash[22744]: cluster 2024-09-16T08:05:03.955675+0000 mgr.a (mgr.14373) 6402 : cluster [DBG] pgmap v4439: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:05:07.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:05:07 smithi157 bash[24585]: cluster 2024-09-16T08:05:05.956437+0000 mgr.a (mgr.14373) 6403 : cluster [DBG] pgmap v4440: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T08:05:07.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:05:07 smithi086 bash[24289]: cluster 2024-09-16T08:05:05.956437+0000 mgr.a (mgr.14373) 6403 : cluster [DBG] pgmap v4440: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T08:05:07.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:05:07 smithi047 bash[22744]: cluster 2024-09-16T08:05:05.956437+0000 mgr.a (mgr.14373) 6403 : cluster [DBG] pgmap v4440: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T08:05:07.573 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:05:07.574 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:05:07.574 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:05:08.323 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:05:08.323 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:05:08.324 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:05:08.324 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:05:08.324 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:05:09.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:05:09 smithi157 bash[24585]: audit 2024-09-16T08:05:07.908193+0000 mgr.a (mgr.14373) 6404 : audit [DBG] from='client.146664 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:05:09.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:05:09 smithi157 bash[24585]: cluster 2024-09-16T08:05:07.959410+0000 mgr.a (mgr.14373) 6405 : cluster [DBG] pgmap v4441: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:05:09.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:05:09 smithi086 bash[24289]: audit 2024-09-16T08:05:07.908193+0000 mgr.a (mgr.14373) 6404 : audit [DBG] from='client.146664 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:05:09.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:05:09 smithi086 bash[24289]: cluster 2024-09-16T08:05:07.959410+0000 mgr.a (mgr.14373) 6405 : cluster [DBG] pgmap v4441: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:05:09.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:05:09 smithi047 bash[22744]: audit 2024-09-16T08:05:07.908193+0000 mgr.a (mgr.14373) 6404 : audit [DBG] from='client.146664 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:05:09.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:05:09 smithi047 bash[22744]: cluster 2024-09-16T08:05:07.959410+0000 mgr.a (mgr.14373) 6405 : cluster [DBG] pgmap v4441: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:05:11.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:05:11 smithi157 bash[24585]: cluster 2024-09-16T08:05:09.960365+0000 mgr.a (mgr.14373) 6406 : cluster [DBG] pgmap v4442: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:05:11.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:05:11 smithi086 bash[24289]: cluster 2024-09-16T08:05:09.960365+0000 mgr.a (mgr.14373) 6406 : cluster [DBG] pgmap v4442: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:05:11.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:05:11 smithi047 bash[22744]: cluster 2024-09-16T08:05:09.960365+0000 mgr.a (mgr.14373) 6406 : cluster [DBG] pgmap v4442: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:05:13.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:05:13 smithi157 bash[24585]: cluster 2024-09-16T08:05:11.962500+0000 mgr.a (mgr.14373) 6407 : cluster [DBG] pgmap v4443: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:05:13.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:05:13 smithi086 bash[24289]: cluster 2024-09-16T08:05:11.962500+0000 mgr.a (mgr.14373) 6407 : cluster [DBG] pgmap v4443: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:05:13.325 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:05:13.326 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:05:13.326 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:05:13.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:05:13 smithi047 bash[22744]: cluster 2024-09-16T08:05:11.962500+0000 mgr.a (mgr.14373) 6407 : cluster [DBG] pgmap v4443: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:05:14.091 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:05:14.091 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:05:14.091 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:05:14.092 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:05:14.092 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:05:15.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:05:15 smithi157 bash[24585]: audit 2024-09-16T08:05:13.668230+0000 mgr.a (mgr.14373) 6408 : audit [DBG] from='client.146742 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:05:15.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:05:15 smithi157 bash[24585]: cluster 2024-09-16T08:05:13.963079+0000 mgr.a (mgr.14373) 6409 : cluster [DBG] pgmap v4444: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:05:15.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:05:15 smithi086 bash[24289]: audit 2024-09-16T08:05:13.668230+0000 mgr.a (mgr.14373) 6408 : audit [DBG] from='client.146742 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:05:15.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:05:15 smithi086 bash[24289]: cluster 2024-09-16T08:05:13.963079+0000 mgr.a (mgr.14373) 6409 : cluster [DBG] pgmap v4444: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:05:15.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:05:15 smithi047 bash[22744]: audit 2024-09-16T08:05:13.668230+0000 mgr.a (mgr.14373) 6408 : audit [DBG] from='client.146742 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:05:15.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:05:15 smithi047 bash[22744]: cluster 2024-09-16T08:05:13.963079+0000 mgr.a (mgr.14373) 6409 : cluster [DBG] pgmap v4444: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:05:17.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:05:17 smithi157 bash[24585]: cluster 2024-09-16T08:05:15.963918+0000 mgr.a (mgr.14373) 6410 : cluster [DBG] pgmap v4445: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:05:17.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:05:17 smithi086 bash[24289]: cluster 2024-09-16T08:05:15.963918+0000 mgr.a (mgr.14373) 6410 : cluster [DBG] pgmap v4445: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:05:17.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:05:17 smithi047 bash[22744]: cluster 2024-09-16T08:05:15.963918+0000 mgr.a (mgr.14373) 6410 : cluster [DBG] pgmap v4445: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:05:18.305 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:05:18 smithi157 bash[24585]: audit 2024-09-16T08:05:17.427695+0000 mon.b (mon.2) 614 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T08:05:18.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:05:18 smithi086 bash[24289]: audit 2024-09-16T08:05:17.427695+0000 mon.b (mon.2) 614 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T08:05:18.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:05:18 smithi047 bash[22744]: audit 2024-09-16T08:05:17.427695+0000 mon.b (mon.2) 614 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T08:05:19.093 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:05:19.094 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:05:19.094 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:05:19.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:05:19 smithi157 bash[24585]: cluster 2024-09-16T08:05:17.966043+0000 mgr.a (mgr.14373) 6411 : cluster [DBG] pgmap v4446: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:05:19.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:05:19 smithi086 bash[24289]: cluster 2024-09-16T08:05:17.966043+0000 mgr.a (mgr.14373) 6411 : cluster [DBG] pgmap v4446: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:05:19.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:05:19 smithi047 bash[22744]: cluster 2024-09-16T08:05:17.966043+0000 mgr.a (mgr.14373) 6411 : cluster [DBG] pgmap v4446: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:05:19.822 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:05:19.823 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:05:19.823 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:05:19.823 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:05:19.823 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:05:21.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:05:21 smithi157 bash[24585]: audit 2024-09-16T08:05:19.425515+0000 mgr.a (mgr.14373) 6412 : audit [DBG] from='client.146814 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:05:21.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:05:21 smithi157 bash[24585]: cluster 2024-09-16T08:05:19.966998+0000 mgr.a (mgr.14373) 6413 : cluster [DBG] pgmap v4447: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:05:21.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:05:21 smithi086 bash[24289]: audit 2024-09-16T08:05:19.425515+0000 mgr.a (mgr.14373) 6412 : audit [DBG] from='client.146814 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:05:21.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:05:21 smithi086 bash[24289]: cluster 2024-09-16T08:05:19.966998+0000 mgr.a (mgr.14373) 6413 : cluster [DBG] pgmap v4447: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:05:21.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:05:21 smithi047 bash[22744]: audit 2024-09-16T08:05:19.425515+0000 mgr.a (mgr.14373) 6412 : audit [DBG] from='client.146814 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:05:21.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:05:21 smithi047 bash[22744]: cluster 2024-09-16T08:05:19.966998+0000 mgr.a (mgr.14373) 6413 : cluster [DBG] pgmap v4447: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:05:23.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:05:23 smithi086 bash[24289]: cluster 2024-09-16T08:05:21.969149+0000 mgr.a (mgr.14373) 6414 : cluster [DBG] pgmap v4448: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:05:23.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:05:23 smithi086 bash[24289]: audit 2024-09-16T08:05:22.785740+0000 mon.a (mon.0) 944 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:05:23.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:05:23 smithi086 bash[24289]: audit 2024-09-16T08:05:22.791176+0000 mon.a (mon.0) 945 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:05:23.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:05:23 smithi086 bash[24289]: audit 2024-09-16T08:05:22.807216+0000 mon.a (mon.0) 946 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:05:23.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:05:23 smithi086 bash[24289]: audit 2024-09-16T08:05:22.814737+0000 mon.a (mon.0) 947 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:05:23.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:05:23 smithi086 bash[24289]: audit 2024-09-16T08:05:22.817851+0000 mon.a (mon.0) 948 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:05:23.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:05:23 smithi086 bash[24289]: audit 2024-09-16T08:05:22.823886+0000 mon.a (mon.0) 949 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:05:23.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:05:23 smithi047 bash[22744]: cluster 2024-09-16T08:05:21.969149+0000 mgr.a (mgr.14373) 6414 : cluster [DBG] pgmap v4448: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:05:23.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:05:23 smithi047 bash[22744]: audit 2024-09-16T08:05:22.785740+0000 mon.a (mon.0) 944 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:05:23.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:05:23 smithi047 bash[22744]: audit 2024-09-16T08:05:22.791176+0000 mon.a (mon.0) 945 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:05:23.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:05:23 smithi047 bash[22744]: audit 2024-09-16T08:05:22.807216+0000 mon.a (mon.0) 946 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:05:23.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:05:23 smithi047 bash[22744]: audit 2024-09-16T08:05:22.814737+0000 mon.a (mon.0) 947 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:05:23.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:05:23 smithi047 bash[22744]: audit 2024-09-16T08:05:22.817851+0000 mon.a (mon.0) 948 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:05:23.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:05:23 smithi047 bash[22744]: audit 2024-09-16T08:05:22.823886+0000 mon.a (mon.0) 949 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:05:23.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:05:23 smithi157 bash[24585]: cluster 2024-09-16T08:05:21.969149+0000 mgr.a (mgr.14373) 6414 : cluster [DBG] pgmap v4448: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:05:23.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:05:23 smithi157 bash[24585]: audit 2024-09-16T08:05:22.785740+0000 mon.a (mon.0) 944 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:05:23.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:05:23 smithi157 bash[24585]: audit 2024-09-16T08:05:22.791176+0000 mon.a (mon.0) 945 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:05:23.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:05:23 smithi157 bash[24585]: audit 2024-09-16T08:05:22.807216+0000 mon.a (mon.0) 946 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:05:23.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:05:23 smithi157 bash[24585]: audit 2024-09-16T08:05:22.814737+0000 mon.a (mon.0) 947 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:05:23.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:05:23 smithi157 bash[24585]: audit 2024-09-16T08:05:22.817851+0000 mon.a (mon.0) 948 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:05:23.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:05:23 smithi157 bash[24585]: audit 2024-09-16T08:05:22.823886+0000 mon.a (mon.0) 949 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:05:24.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:05:24 smithi086 bash[24289]: audit 2024-09-16T08:05:23.527636+0000 mon.b (mon.2) 615 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T08:05:24.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:05:24 smithi086 bash[24289]: audit 2024-09-16T08:05:23.529583+0000 mon.b (mon.2) 616 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T08:05:24.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:05:24 smithi086 bash[24289]: audit 2024-09-16T08:05:23.542335+0000 mon.a (mon.0) 950 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:05:24.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:05:24 smithi086 bash[24289]: audit 2024-09-16T08:05:23.545659+0000 mon.b (mon.2) 617 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:05:24.337 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 08:05:24 smithi047 bash[22994]: debug 2024-09-16T08:05:24.268+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T08:05:24.337 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 08:05:24 smithi047 bash[22994]: debug 2024-09-16T08:05:24.268+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T08:05:24.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:05:24 smithi047 bash[22744]: audit 2024-09-16T08:05:23.527636+0000 mon.b (mon.2) 615 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T08:05:24.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:05:24 smithi047 bash[22744]: audit 2024-09-16T08:05:23.529583+0000 mon.b (mon.2) 616 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T08:05:24.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:05:24 smithi047 bash[22744]: audit 2024-09-16T08:05:23.542335+0000 mon.a (mon.0) 950 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:05:24.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:05:24 smithi047 bash[22744]: audit 2024-09-16T08:05:23.545659+0000 mon.b (mon.2) 617 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:05:24.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:05:24 smithi157 bash[24585]: audit 2024-09-16T08:05:23.527636+0000 mon.b (mon.2) 615 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T08:05:24.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:05:24 smithi157 bash[24585]: audit 2024-09-16T08:05:23.529583+0000 mon.b (mon.2) 616 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T08:05:24.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:05:24 smithi157 bash[24585]: audit 2024-09-16T08:05:23.542335+0000 mon.a (mon.0) 950 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:05:24.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:05:24 smithi157 bash[24585]: audit 2024-09-16T08:05:23.545659+0000 mon.b (mon.2) 617 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:05:24.824 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:05:24.825 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:05:24.825 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:05:25.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:05:25 smithi086 bash[24289]: audit 2024-09-16T08:05:23.549865+0000 mgr.a (mgr.14373) 6415 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:05:25.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:05:25 smithi086 bash[24289]: cluster 2024-09-16T08:05:23.969729+0000 mgr.a (mgr.14373) 6416 : cluster [DBG] pgmap v4449: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:05:25.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:05:25 smithi086 bash[24289]: audit 2024-09-16T08:05:24.270889+0000 mgr.a (mgr.14373) 6417 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T08:05:25.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:05:25 smithi086 bash[24289]: cephadm 2024-09-16T08:05:24.273546+0000 mgr.a (mgr.14373) 6418 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T08:05:25.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:05:25 smithi047 bash[22744]: audit 2024-09-16T08:05:23.549865+0000 mgr.a (mgr.14373) 6415 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:05:25.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:05:25 smithi047 bash[22744]: cluster 2024-09-16T08:05:23.969729+0000 mgr.a (mgr.14373) 6416 : cluster [DBG] pgmap v4449: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:05:25.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:05:25 smithi047 bash[22744]: audit 2024-09-16T08:05:24.270889+0000 mgr.a (mgr.14373) 6417 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T08:05:25.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:05:25 smithi047 bash[22744]: cephadm 2024-09-16T08:05:24.273546+0000 mgr.a (mgr.14373) 6418 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T08:05:25.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:05:25 smithi157 bash[24585]: audit 2024-09-16T08:05:23.549865+0000 mgr.a (mgr.14373) 6415 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:05:25.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:05:25 smithi157 bash[24585]: cluster 2024-09-16T08:05:23.969729+0000 mgr.a (mgr.14373) 6416 : cluster [DBG] pgmap v4449: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:05:25.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:05:25 smithi157 bash[24585]: audit 2024-09-16T08:05:24.270889+0000 mgr.a (mgr.14373) 6417 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T08:05:25.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:05:25 smithi157 bash[24585]: cephadm 2024-09-16T08:05:24.273546+0000 mgr.a (mgr.14373) 6418 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T08:05:25.568 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:05:25.568 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:05:25.568 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:05:25.568 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:05:25.568 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:05:26.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:05:26 smithi086 bash[24289]: audit 2024-09-16T08:05:25.161852+0000 mgr.a (mgr.14373) 6419 : audit [DBG] from='client.146994 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:05:26.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:05:26 smithi047 bash[22744]: audit 2024-09-16T08:05:25.161852+0000 mgr.a (mgr.14373) 6419 : audit [DBG] from='client.146994 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:05:26.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:05:26 smithi157 bash[24585]: audit 2024-09-16T08:05:25.161852+0000 mgr.a (mgr.14373) 6419 : audit [DBG] from='client.146994 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:05:27.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:05:27 smithi047 bash[22744]: cluster 2024-09-16T08:05:25.970675+0000 mgr.a (mgr.14373) 6420 : cluster [DBG] pgmap v4450: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:05:27.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:05:27 smithi157 bash[24585]: cluster 2024-09-16T08:05:25.970675+0000 mgr.a (mgr.14373) 6420 : cluster [DBG] pgmap v4450: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:05:27.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:05:27 smithi086 bash[24289]: cluster 2024-09-16T08:05:25.970675+0000 mgr.a (mgr.14373) 6420 : cluster [DBG] pgmap v4450: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:05:29.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:05:29 smithi047 bash[22744]: cluster 2024-09-16T08:05:27.972953+0000 mgr.a (mgr.14373) 6421 : cluster [DBG] pgmap v4451: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:05:29.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:05:29 smithi157 bash[24585]: cluster 2024-09-16T08:05:27.972953+0000 mgr.a (mgr.14373) 6421 : cluster [DBG] pgmap v4451: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:05:29.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:05:29 smithi086 bash[24289]: cluster 2024-09-16T08:05:27.972953+0000 mgr.a (mgr.14373) 6421 : cluster [DBG] pgmap v4451: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:05:30.569 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:05:30.570 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:05:30.570 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:05:31.310 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:05:31.311 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:05:31.311 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:05:31.311 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:05:31.311 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:05:31.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:05:31 smithi047 bash[22744]: cluster 2024-09-16T08:05:29.973720+0000 mgr.a (mgr.14373) 6422 : cluster [DBG] pgmap v4452: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:05:31.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:05:31 smithi157 bash[24585]: cluster 2024-09-16T08:05:29.973720+0000 mgr.a (mgr.14373) 6422 : cluster [DBG] pgmap v4452: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:05:31.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:05:31 smithi086 bash[24289]: cluster 2024-09-16T08:05:29.973720+0000 mgr.a (mgr.14373) 6422 : cluster [DBG] pgmap v4452: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:05:32.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:05:32 smithi047 bash[22744]: audit 2024-09-16T08:05:30.902807+0000 mgr.a (mgr.14373) 6423 : audit [DBG] from='client.147072 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:05:32.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:05:32 smithi157 bash[24585]: audit 2024-09-16T08:05:30.902807+0000 mgr.a (mgr.14373) 6423 : audit [DBG] from='client.147072 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:05:32.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:05:32 smithi086 bash[24289]: audit 2024-09-16T08:05:30.902807+0000 mgr.a (mgr.14373) 6423 : audit [DBG] from='client.147072 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:05:33.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:05:33 smithi157 bash[24585]: cluster 2024-09-16T08:05:31.976086+0000 mgr.a (mgr.14373) 6424 : cluster [DBG] pgmap v4453: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:05:33.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:05:33 smithi086 bash[24289]: cluster 2024-09-16T08:05:31.976086+0000 mgr.a (mgr.14373) 6424 : cluster [DBG] pgmap v4453: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:05:33.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:05:33 smithi047 bash[22744]: cluster 2024-09-16T08:05:31.976086+0000 mgr.a (mgr.14373) 6424 : cluster [DBG] pgmap v4453: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:05:35.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:05:35 smithi157 bash[24585]: cluster 2024-09-16T08:05:33.976868+0000 mgr.a (mgr.14373) 6425 : cluster [DBG] pgmap v4454: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:05:35.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:05:35 smithi086 bash[24289]: cluster 2024-09-16T08:05:33.976868+0000 mgr.a (mgr.14373) 6425 : cluster [DBG] pgmap v4454: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:05:35.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:05:35 smithi047 bash[22744]: cluster 2024-09-16T08:05:33.976868+0000 mgr.a (mgr.14373) 6425 : cluster [DBG] pgmap v4454: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:05:36.312 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:05:36.313 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:05:36.313 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:05:37.088 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:05:37.088 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:05:37.088 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:05:37.088 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:05:37.088 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:05:37.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:05:37 smithi157 bash[24585]: cluster 2024-09-16T08:05:35.977665+0000 mgr.a (mgr.14373) 6426 : cluster [DBG] pgmap v4455: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:05:37.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:05:37 smithi086 bash[24289]: cluster 2024-09-16T08:05:35.977665+0000 mgr.a (mgr.14373) 6426 : cluster [DBG] pgmap v4455: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:05:37.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:05:37 smithi047 bash[22744]: cluster 2024-09-16T08:05:35.977665+0000 mgr.a (mgr.14373) 6426 : cluster [DBG] pgmap v4455: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:05:38.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:05:38 smithi157 bash[24585]: audit 2024-09-16T08:05:36.650706+0000 mgr.a (mgr.14373) 6427 : audit [DBG] from='client.147144 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:05:38.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:05:38 smithi086 bash[24289]: audit 2024-09-16T08:05:36.650706+0000 mgr.a (mgr.14373) 6427 : audit [DBG] from='client.147144 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:05:38.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:05:38 smithi047 bash[22744]: audit 2024-09-16T08:05:36.650706+0000 mgr.a (mgr.14373) 6427 : audit [DBG] from='client.147144 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:05:39.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:05:39 smithi157 bash[24585]: cluster 2024-09-16T08:05:37.980461+0000 mgr.a (mgr.14373) 6428 : cluster [DBG] pgmap v4456: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:05:39.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:05:39 smithi086 bash[24289]: cluster 2024-09-16T08:05:37.980461+0000 mgr.a (mgr.14373) 6428 : cluster [DBG] pgmap v4456: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:05:39.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:05:39 smithi047 bash[22744]: cluster 2024-09-16T08:05:37.980461+0000 mgr.a (mgr.14373) 6428 : cluster [DBG] pgmap v4456: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:05:41.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:05:41 smithi157 bash[24585]: cluster 2024-09-16T08:05:39.981258+0000 mgr.a (mgr.14373) 6429 : cluster [DBG] pgmap v4457: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:05:41.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:05:41 smithi086 bash[24289]: cluster 2024-09-16T08:05:39.981258+0000 mgr.a (mgr.14373) 6429 : cluster [DBG] pgmap v4457: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:05:41.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:05:41 smithi047 bash[22744]: cluster 2024-09-16T08:05:39.981258+0000 mgr.a (mgr.14373) 6429 : cluster [DBG] pgmap v4457: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:05:42.089 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:05:42.090 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:05:42.090 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:05:42.871 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:05:42.871 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:05:42.872 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:05:42.872 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:05:42.872 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:05:43.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:05:43 smithi157 bash[24585]: cluster 2024-09-16T08:05:41.983212+0000 mgr.a (mgr.14373) 6430 : cluster [DBG] pgmap v4458: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:05:43.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:05:43 smithi086 bash[24289]: cluster 2024-09-16T08:05:41.983212+0000 mgr.a (mgr.14373) 6430 : cluster [DBG] pgmap v4458: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:05:43.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:05:43 smithi047 bash[22744]: cluster 2024-09-16T08:05:41.983212+0000 mgr.a (mgr.14373) 6430 : cluster [DBG] pgmap v4458: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:05:44.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:05:44 smithi157 bash[24585]: audit 2024-09-16T08:05:42.430423+0000 mgr.a (mgr.14373) 6431 : audit [DBG] from='client.147222 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:05:44.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:05:44 smithi086 bash[24289]: audit 2024-09-16T08:05:42.430423+0000 mgr.a (mgr.14373) 6431 : audit [DBG] from='client.147222 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:05:44.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:05:44 smithi047 bash[22744]: audit 2024-09-16T08:05:42.430423+0000 mgr.a (mgr.14373) 6431 : audit [DBG] from='client.147222 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:05:45.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:05:45 smithi157 bash[24585]: cluster 2024-09-16T08:05:43.984204+0000 mgr.a (mgr.14373) 6432 : cluster [DBG] pgmap v4459: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:05:45.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:05:45 smithi086 bash[24289]: cluster 2024-09-16T08:05:43.984204+0000 mgr.a (mgr.14373) 6432 : cluster [DBG] pgmap v4459: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:05:45.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:05:45 smithi047 bash[22744]: cluster 2024-09-16T08:05:43.984204+0000 mgr.a (mgr.14373) 6432 : cluster [DBG] pgmap v4459: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:05:47.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:05:47 smithi157 bash[24585]: cluster 2024-09-16T08:05:45.985152+0000 mgr.a (mgr.14373) 6433 : cluster [DBG] pgmap v4460: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T08:05:47.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:05:47 smithi086 bash[24289]: cluster 2024-09-16T08:05:45.985152+0000 mgr.a (mgr.14373) 6433 : cluster [DBG] pgmap v4460: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T08:05:47.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:05:47 smithi047 bash[22744]: cluster 2024-09-16T08:05:45.985152+0000 mgr.a (mgr.14373) 6433 : cluster [DBG] pgmap v4460: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T08:05:47.873 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:05:47.874 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:05:47.874 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:05:48.647 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:05:48.648 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:05:48.648 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:05:48.648 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:05:48.648 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:05:49.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:05:49 smithi157 bash[24585]: cluster 2024-09-16T08:05:47.986252+0000 mgr.a (mgr.14373) 6434 : cluster [DBG] pgmap v4461: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:05:49.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:05:49 smithi157 bash[24585]: audit 2024-09-16T08:05:48.213606+0000 mgr.a (mgr.14373) 6435 : audit [DBG] from='client.147300 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:05:49.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:05:49 smithi086 bash[24289]: cluster 2024-09-16T08:05:47.986252+0000 mgr.a (mgr.14373) 6434 : cluster [DBG] pgmap v4461: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:05:49.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:05:49 smithi086 bash[24289]: audit 2024-09-16T08:05:48.213606+0000 mgr.a (mgr.14373) 6435 : audit [DBG] from='client.147300 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:05:49.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:05:49 smithi047 bash[22744]: cluster 2024-09-16T08:05:47.986252+0000 mgr.a (mgr.14373) 6434 : cluster [DBG] pgmap v4461: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:05:49.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:05:49 smithi047 bash[22744]: audit 2024-09-16T08:05:48.213606+0000 mgr.a (mgr.14373) 6435 : audit [DBG] from='client.147300 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:05:51.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:05:51 smithi157 bash[24585]: cluster 2024-09-16T08:05:49.987183+0000 mgr.a (mgr.14373) 6436 : cluster [DBG] pgmap v4462: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:05:51.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:05:51 smithi086 bash[24289]: cluster 2024-09-16T08:05:49.987183+0000 mgr.a (mgr.14373) 6436 : cluster [DBG] pgmap v4462: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:05:51.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:05:51 smithi047 bash[22744]: cluster 2024-09-16T08:05:49.987183+0000 mgr.a (mgr.14373) 6436 : cluster [DBG] pgmap v4462: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:05:53.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:05:53 smithi157 bash[24585]: cluster 2024-09-16T08:05:51.989395+0000 mgr.a (mgr.14373) 6437 : cluster [DBG] pgmap v4463: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:05:53.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:05:53 smithi086 bash[24289]: cluster 2024-09-16T08:05:51.989395+0000 mgr.a (mgr.14373) 6437 : cluster [DBG] pgmap v4463: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:05:53.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:05:53 smithi047 bash[22744]: cluster 2024-09-16T08:05:51.989395+0000 mgr.a (mgr.14373) 6437 : cluster [DBG] pgmap v4463: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:05:53.649 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:05:53.650 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:05:53.650 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:05:54.424 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:05:54.425 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:05:54.425 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:05:54.425 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:05:54.425 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:05:55.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:05:55 smithi157 bash[24585]: audit 2024-09-16T08:05:53.986947+0000 mgr.a (mgr.14373) 6438 : audit [DBG] from='client.147375 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:05:55.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:05:55 smithi157 bash[24585]: cluster 2024-09-16T08:05:53.999922+0000 mgr.a (mgr.14373) 6439 : cluster [DBG] pgmap v4464: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:05:55.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:05:55 smithi086 bash[24289]: audit 2024-09-16T08:05:53.986947+0000 mgr.a (mgr.14373) 6438 : audit [DBG] from='client.147375 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:05:55.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:05:55 smithi086 bash[24289]: cluster 2024-09-16T08:05:53.999922+0000 mgr.a (mgr.14373) 6439 : cluster [DBG] pgmap v4464: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:05:55.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:05:55 smithi047 bash[22744]: audit 2024-09-16T08:05:53.986947+0000 mgr.a (mgr.14373) 6438 : audit [DBG] from='client.147375 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:05:55.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:05:55 smithi047 bash[22744]: cluster 2024-09-16T08:05:53.999922+0000 mgr.a (mgr.14373) 6439 : cluster [DBG] pgmap v4464: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:05:57.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:05:57 smithi157 bash[24585]: cluster 2024-09-16T08:05:56.001002+0000 mgr.a (mgr.14373) 6440 : cluster [DBG] pgmap v4465: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:05:57.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:05:57 smithi086 bash[24289]: cluster 2024-09-16T08:05:56.001002+0000 mgr.a (mgr.14373) 6440 : cluster [DBG] pgmap v4465: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:05:57.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:05:57 smithi047 bash[22744]: cluster 2024-09-16T08:05:56.001002+0000 mgr.a (mgr.14373) 6440 : cluster [DBG] pgmap v4465: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:05:59.426 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:05:59.427 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:05:59.427 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:05:59.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:05:59 smithi157 bash[24585]: cluster 2024-09-16T08:05:58.003266+0000 mgr.a (mgr.14373) 6441 : cluster [DBG] pgmap v4466: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:05:59.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:05:59 smithi086 bash[24289]: cluster 2024-09-16T08:05:58.003266+0000 mgr.a (mgr.14373) 6441 : cluster [DBG] pgmap v4466: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:05:59.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:05:59 smithi047 bash[22744]: cluster 2024-09-16T08:05:58.003266+0000 mgr.a (mgr.14373) 6441 : cluster [DBG] pgmap v4466: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:06:00.201 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:06:00.202 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:06:00.202 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:06:00.202 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:06:00.202 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:06:01.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:06:01 smithi157 bash[24585]: audit 2024-09-16T08:05:59.767228+0000 mgr.a (mgr.14373) 6442 : audit [DBG] from='client.147453 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:06:01.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:06:01 smithi157 bash[24585]: cluster 2024-09-16T08:06:00.003837+0000 mgr.a (mgr.14373) 6443 : cluster [DBG] pgmap v4467: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:06:01.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:06:01 smithi086 bash[24289]: audit 2024-09-16T08:05:59.767228+0000 mgr.a (mgr.14373) 6442 : audit [DBG] from='client.147453 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:06:01.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:06:01 smithi086 bash[24289]: cluster 2024-09-16T08:06:00.003837+0000 mgr.a (mgr.14373) 6443 : cluster [DBG] pgmap v4467: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:06:01.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:06:01 smithi047 bash[22744]: audit 2024-09-16T08:05:59.767228+0000 mgr.a (mgr.14373) 6442 : audit [DBG] from='client.147453 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:06:01.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:06:01 smithi047 bash[22744]: cluster 2024-09-16T08:06:00.003837+0000 mgr.a (mgr.14373) 6443 : cluster [DBG] pgmap v4467: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:06:03.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:06:03 smithi157 bash[24585]: cluster 2024-09-16T08:06:02.006028+0000 mgr.a (mgr.14373) 6444 : cluster [DBG] pgmap v4468: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:06:03.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:06:03 smithi086 bash[24289]: cluster 2024-09-16T08:06:02.006028+0000 mgr.a (mgr.14373) 6444 : cluster [DBG] pgmap v4468: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:06:03.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:06:03 smithi047 bash[22744]: cluster 2024-09-16T08:06:02.006028+0000 mgr.a (mgr.14373) 6444 : cluster [DBG] pgmap v4468: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:06:05.203 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:06:05.204 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:06:05.204 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:06:05.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:06:05 smithi157 bash[24585]: cluster 2024-09-16T08:06:04.006840+0000 mgr.a (mgr.14373) 6445 : cluster [DBG] pgmap v4469: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:06:05.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:06:05 smithi086 bash[24289]: cluster 2024-09-16T08:06:04.006840+0000 mgr.a (mgr.14373) 6445 : cluster [DBG] pgmap v4469: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:06:05.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:06:05 smithi047 bash[22744]: cluster 2024-09-16T08:06:04.006840+0000 mgr.a (mgr.14373) 6445 : cluster [DBG] pgmap v4469: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:06:05.960 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:06:05.960 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:06:05.960 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:06:05.960 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:06:05.960 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:06:07.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:06:07 smithi157 bash[24585]: audit 2024-09-16T08:06:05.540002+0000 mgr.a (mgr.14373) 6446 : audit [DBG] from='client.147531 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:06:07.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:06:07 smithi157 bash[24585]: cluster 2024-09-16T08:06:06.007465+0000 mgr.a (mgr.14373) 6447 : cluster [DBG] pgmap v4470: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:06:07.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:06:07 smithi086 bash[24289]: audit 2024-09-16T08:06:05.540002+0000 mgr.a (mgr.14373) 6446 : audit [DBG] from='client.147531 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:06:07.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:06:07 smithi086 bash[24289]: cluster 2024-09-16T08:06:06.007465+0000 mgr.a (mgr.14373) 6447 : cluster [DBG] pgmap v4470: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:06:07.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:06:07 smithi047 bash[22744]: audit 2024-09-16T08:06:05.540002+0000 mgr.a (mgr.14373) 6446 : audit [DBG] from='client.147531 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:06:07.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:06:07 smithi047 bash[22744]: cluster 2024-09-16T08:06:06.007465+0000 mgr.a (mgr.14373) 6447 : cluster [DBG] pgmap v4470: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:06:09.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:06:09 smithi157 bash[24585]: cluster 2024-09-16T08:06:08.009748+0000 mgr.a (mgr.14373) 6448 : cluster [DBG] pgmap v4471: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:06:09.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:06:09 smithi086 bash[24289]: cluster 2024-09-16T08:06:08.009748+0000 mgr.a (mgr.14373) 6448 : cluster [DBG] pgmap v4471: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:06:09.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:06:09 smithi047 bash[22744]: cluster 2024-09-16T08:06:08.009748+0000 mgr.a (mgr.14373) 6448 : cluster [DBG] pgmap v4471: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:06:10.961 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:06:10.962 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:06:10.962 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:06:11.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:06:11 smithi157 bash[24585]: cluster 2024-09-16T08:06:10.010566+0000 mgr.a (mgr.14373) 6449 : cluster [DBG] pgmap v4472: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:06:11.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:06:11 smithi086 bash[24289]: cluster 2024-09-16T08:06:10.010566+0000 mgr.a (mgr.14373) 6449 : cluster [DBG] pgmap v4472: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:06:11.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:06:11 smithi047 bash[22744]: cluster 2024-09-16T08:06:10.010566+0000 mgr.a (mgr.14373) 6449 : cluster [DBG] pgmap v4472: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:06:11.746 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:06:11.747 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:06:11.747 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:06:11.747 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:06:11.747 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:06:12.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:06:12 smithi157 bash[24585]: audit 2024-09-16T08:06:11.301601+0000 mgr.a (mgr.14373) 6450 : audit [DBG] from='client.147606 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:06:12.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:06:12 smithi086 bash[24289]: audit 2024-09-16T08:06:11.301601+0000 mgr.a (mgr.14373) 6450 : audit [DBG] from='client.147606 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:06:12.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:06:12 smithi047 bash[22744]: audit 2024-09-16T08:06:11.301601+0000 mgr.a (mgr.14373) 6450 : audit [DBG] from='client.147606 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:06:13.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:06:13 smithi157 bash[24585]: cluster 2024-09-16T08:06:12.013410+0000 mgr.a (mgr.14373) 6451 : cluster [DBG] pgmap v4473: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-16T08:06:13.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:06:13 smithi086 bash[24289]: cluster 2024-09-16T08:06:12.013410+0000 mgr.a (mgr.14373) 6451 : cluster [DBG] pgmap v4473: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-16T08:06:13.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:06:13 smithi047 bash[22744]: cluster 2024-09-16T08:06:12.013410+0000 mgr.a (mgr.14373) 6451 : cluster [DBG] pgmap v4473: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-16T08:06:15.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:06:15 smithi157 bash[24585]: cluster 2024-09-16T08:06:14.014190+0000 mgr.a (mgr.14373) 6452 : cluster [DBG] pgmap v4474: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T08:06:15.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:06:15 smithi086 bash[24289]: cluster 2024-09-16T08:06:14.014190+0000 mgr.a (mgr.14373) 6452 : cluster [DBG] pgmap v4474: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T08:06:15.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:06:15 smithi047 bash[22744]: cluster 2024-09-16T08:06:14.014190+0000 mgr.a (mgr.14373) 6452 : cluster [DBG] pgmap v4474: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T08:06:16.748 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:06:16.749 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:06:16.749 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:06:17.484 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:06:17.485 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:06:17.485 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:06:17.485 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:06:17.485 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:06:17.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:06:17 smithi157 bash[24585]: cluster 2024-09-16T08:06:16.014998+0000 mgr.a (mgr.14373) 6453 : cluster [DBG] pgmap v4475: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T08:06:17.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:06:17 smithi086 bash[24289]: cluster 2024-09-16T08:06:16.014998+0000 mgr.a (mgr.14373) 6453 : cluster [DBG] pgmap v4475: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T08:06:17.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:06:17 smithi047 bash[22744]: cluster 2024-09-16T08:06:16.014998+0000 mgr.a (mgr.14373) 6453 : cluster [DBG] pgmap v4475: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T08:06:18.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:06:18 smithi157 bash[24585]: audit 2024-09-16T08:06:17.074358+0000 mgr.a (mgr.14373) 6454 : audit [DBG] from='client.147684 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:06:18.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:06:18 smithi086 bash[24289]: audit 2024-09-16T08:06:17.074358+0000 mgr.a (mgr.14373) 6454 : audit [DBG] from='client.147684 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:06:18.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:06:18 smithi047 bash[22744]: audit 2024-09-16T08:06:17.074358+0000 mgr.a (mgr.14373) 6454 : audit [DBG] from='client.147684 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:06:19.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:06:19 smithi157 bash[24585]: cluster 2024-09-16T08:06:18.017923+0000 mgr.a (mgr.14373) 6455 : cluster [DBG] pgmap v4476: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:06:19.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:06:19 smithi086 bash[24289]: cluster 2024-09-16T08:06:18.017923+0000 mgr.a (mgr.14373) 6455 : cluster [DBG] pgmap v4476: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:06:19.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:06:19 smithi047 bash[22744]: cluster 2024-09-16T08:06:18.017923+0000 mgr.a (mgr.14373) 6455 : cluster [DBG] pgmap v4476: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:06:21.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:06:21 smithi157 bash[24585]: cluster 2024-09-16T08:06:20.018797+0000 mgr.a (mgr.14373) 6456 : cluster [DBG] pgmap v4477: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:06:21.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:06:21 smithi086 bash[24289]: cluster 2024-09-16T08:06:20.018797+0000 mgr.a (mgr.14373) 6456 : cluster [DBG] pgmap v4477: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:06:21.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:06:21 smithi047 bash[22744]: cluster 2024-09-16T08:06:20.018797+0000 mgr.a (mgr.14373) 6456 : cluster [DBG] pgmap v4477: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:06:22.486 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:06:22.487 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:06:22.487 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:06:23.261 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:06:23.262 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:06:23.262 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:06:23.262 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:06:23.262 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:06:23.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:06:23 smithi157 bash[24585]: cluster 2024-09-16T08:06:22.020911+0000 mgr.a (mgr.14373) 6457 : cluster [DBG] pgmap v4478: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:06:23.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:06:23 smithi086 bash[24289]: cluster 2024-09-16T08:06:22.020911+0000 mgr.a (mgr.14373) 6457 : cluster [DBG] pgmap v4478: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:06:23.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:06:23 smithi047 bash[22744]: cluster 2024-09-16T08:06:22.020911+0000 mgr.a (mgr.14373) 6457 : cluster [DBG] pgmap v4478: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:06:24.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:06:24 smithi157 bash[24585]: audit 2024-09-16T08:06:22.825565+0000 mgr.a (mgr.14373) 6458 : audit [DBG] from='client.147762 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:06:24.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:06:24 smithi086 bash[24289]: audit 2024-09-16T08:06:22.825565+0000 mgr.a (mgr.14373) 6458 : audit [DBG] from='client.147762 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:06:24.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:06:24 smithi047 bash[22744]: audit 2024-09-16T08:06:22.825565+0000 mgr.a (mgr.14373) 6458 : audit [DBG] from='client.147762 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:06:25.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:06:25 smithi157 bash[24585]: cluster 2024-09-16T08:06:24.021860+0000 mgr.a (mgr.14373) 6459 : cluster [DBG] pgmap v4479: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-16T08:06:25.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:06:25 smithi157 bash[24585]: audit 2024-09-16T08:06:24.326662+0000 mon.b (mon.2) 618 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T08:06:25.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:06:25 smithi157 bash[24585]: audit 2024-09-16T08:06:25.195850+0000 mon.b (mon.2) 619 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T08:06:25.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:06:25 smithi157 bash[24585]: audit 2024-09-16T08:06:25.197662+0000 mon.b (mon.2) 620 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T08:06:25.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:06:25 smithi157 bash[24585]: audit 2024-09-16T08:06:25.210275+0000 mon.a (mon.0) 951 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:06:25.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:06:25 smithi157 bash[24585]: audit 2024-09-16T08:06:25.214554+0000 mon.b (mon.2) 621 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:06:25.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:06:25 smithi086 bash[24289]: cluster 2024-09-16T08:06:24.021860+0000 mgr.a (mgr.14373) 6459 : cluster [DBG] pgmap v4479: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-16T08:06:25.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:06:25 smithi086 bash[24289]: audit 2024-09-16T08:06:24.326662+0000 mon.b (mon.2) 618 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T08:06:25.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:06:25 smithi086 bash[24289]: audit 2024-09-16T08:06:25.195850+0000 mon.b (mon.2) 619 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T08:06:25.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:06:25 smithi086 bash[24289]: audit 2024-09-16T08:06:25.197662+0000 mon.b (mon.2) 620 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T08:06:25.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:06:25 smithi086 bash[24289]: audit 2024-09-16T08:06:25.210275+0000 mon.a (mon.0) 951 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:06:25.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:06:25 smithi086 bash[24289]: audit 2024-09-16T08:06:25.214554+0000 mon.b (mon.2) 621 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:06:25.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:06:25 smithi047 bash[22744]: cluster 2024-09-16T08:06:24.021860+0000 mgr.a (mgr.14373) 6459 : cluster [DBG] pgmap v4479: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-16T08:06:25.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:06:25 smithi047 bash[22744]: audit 2024-09-16T08:06:24.326662+0000 mon.b (mon.2) 618 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T08:06:25.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:06:25 smithi047 bash[22744]: audit 2024-09-16T08:06:25.195850+0000 mon.b (mon.2) 619 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T08:06:25.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:06:25 smithi047 bash[22744]: audit 2024-09-16T08:06:25.197662+0000 mon.b (mon.2) 620 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T08:06:25.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:06:25 smithi047 bash[22744]: audit 2024-09-16T08:06:25.210275+0000 mon.a (mon.0) 951 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:06:25.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:06:25 smithi047 bash[22744]: audit 2024-09-16T08:06:25.214554+0000 mon.b (mon.2) 621 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:06:26.242 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 08:06:25 smithi047 bash[22994]: debug 2024-09-16T08:06:25.935+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T08:06:26.242 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 08:06:25 smithi047 bash[22994]: debug 2024-09-16T08:06:25.935+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T08:06:26.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:06:26 smithi157 bash[24585]: audit 2024-09-16T08:06:25.218988+0000 mgr.a (mgr.14373) 6460 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:06:26.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:06:26 smithi086 bash[24289]: audit 2024-09-16T08:06:25.218988+0000 mgr.a (mgr.14373) 6460 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:06:26.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:06:26 smithi047 bash[22744]: audit 2024-09-16T08:06:25.218988+0000 mgr.a (mgr.14373) 6460 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:06:27.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:06:27 smithi157 bash[24585]: audit 2024-09-16T08:06:25.938875+0000 mgr.a (mgr.14373) 6461 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T08:06:27.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:06:27 smithi157 bash[24585]: cephadm 2024-09-16T08:06:25.941190+0000 mgr.a (mgr.14373) 6462 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T08:06:27.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:06:27 smithi157 bash[24585]: cluster 2024-09-16T08:06:26.022465+0000 mgr.a (mgr.14373) 6463 : cluster [DBG] pgmap v4480: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-16T08:06:27.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:06:27 smithi086 bash[24289]: audit 2024-09-16T08:06:25.938875+0000 mgr.a (mgr.14373) 6461 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T08:06:27.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:06:27 smithi086 bash[24289]: cephadm 2024-09-16T08:06:25.941190+0000 mgr.a (mgr.14373) 6462 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T08:06:27.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:06:27 smithi086 bash[24289]: cluster 2024-09-16T08:06:26.022465+0000 mgr.a (mgr.14373) 6463 : cluster [DBG] pgmap v4480: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-16T08:06:27.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:06:27 smithi047 bash[22744]: audit 2024-09-16T08:06:25.938875+0000 mgr.a (mgr.14373) 6461 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T08:06:27.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:06:27 smithi047 bash[22744]: cephadm 2024-09-16T08:06:25.941190+0000 mgr.a (mgr.14373) 6462 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T08:06:27.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:06:27 smithi047 bash[22744]: cluster 2024-09-16T08:06:26.022465+0000 mgr.a (mgr.14373) 6463 : cluster [DBG] pgmap v4480: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-16T08:06:28.262 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:06:28.263 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:06:28.263 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:06:29.037 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:06:29.038 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:06:29.038 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:06:29.038 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:06:29.038 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:06:29.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:06:29 smithi157 bash[24585]: cluster 2024-09-16T08:06:28.024637+0000 mgr.a (mgr.14373) 6464 : cluster [DBG] pgmap v4481: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:06:29.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:06:29 smithi086 bash[24289]: cluster 2024-09-16T08:06:28.024637+0000 mgr.a (mgr.14373) 6464 : cluster [DBG] pgmap v4481: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:06:29.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:06:29 smithi047 bash[22744]: cluster 2024-09-16T08:06:28.024637+0000 mgr.a (mgr.14373) 6464 : cluster [DBG] pgmap v4481: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:06:30.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:06:30 smithi157 bash[24585]: audit 2024-09-16T08:06:28.600358+0000 mgr.a (mgr.14373) 6465 : audit [DBG] from='client.147939 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:06:30.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:06:30 smithi086 bash[24289]: audit 2024-09-16T08:06:28.600358+0000 mgr.a (mgr.14373) 6465 : audit [DBG] from='client.147939 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:06:30.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:06:30 smithi047 bash[22744]: audit 2024-09-16T08:06:28.600358+0000 mgr.a (mgr.14373) 6465 : audit [DBG] from='client.147939 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:06:31.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:06:31 smithi157 bash[24585]: cluster 2024-09-16T08:06:30.025557+0000 mgr.a (mgr.14373) 6466 : cluster [DBG] pgmap v4482: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:06:31.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:06:31 smithi086 bash[24289]: cluster 2024-09-16T08:06:30.025557+0000 mgr.a (mgr.14373) 6466 : cluster [DBG] pgmap v4482: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:06:31.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:06:31 smithi047 bash[22744]: cluster 2024-09-16T08:06:30.025557+0000 mgr.a (mgr.14373) 6466 : cluster [DBG] pgmap v4482: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:06:33.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:06:33 smithi157 bash[24585]: cluster 2024-09-16T08:06:32.028098+0000 mgr.a (mgr.14373) 6467 : cluster [DBG] pgmap v4483: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:06:33.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:06:33 smithi086 bash[24289]: cluster 2024-09-16T08:06:32.028098+0000 mgr.a (mgr.14373) 6467 : cluster [DBG] pgmap v4483: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:06:33.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:06:33 smithi047 bash[22744]: cluster 2024-09-16T08:06:32.028098+0000 mgr.a (mgr.14373) 6467 : cluster [DBG] pgmap v4483: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:06:34.039 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:06:34.040 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:06:34.040 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:06:34.788 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:06:34.788 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:06:34.788 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:06:34.788 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:06:34.788 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:06:35.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:06:35 smithi157 bash[24585]: cluster 2024-09-16T08:06:34.028890+0000 mgr.a (mgr.14373) 6468 : cluster [DBG] pgmap v4484: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:06:35.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:06:35 smithi086 bash[24289]: cluster 2024-09-16T08:06:34.028890+0000 mgr.a (mgr.14373) 6468 : cluster [DBG] pgmap v4484: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:06:35.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:06:35 smithi047 bash[22744]: cluster 2024-09-16T08:06:34.028890+0000 mgr.a (mgr.14373) 6468 : cluster [DBG] pgmap v4484: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:06:36.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:06:36 smithi157 bash[24585]: audit 2024-09-16T08:06:34.374043+0000 mgr.a (mgr.14373) 6469 : audit [DBG] from='client.148014 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:06:36.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:06:36 smithi086 bash[24289]: audit 2024-09-16T08:06:34.374043+0000 mgr.a (mgr.14373) 6469 : audit [DBG] from='client.148014 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:06:36.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:06:36 smithi047 bash[22744]: audit 2024-09-16T08:06:34.374043+0000 mgr.a (mgr.14373) 6469 : audit [DBG] from='client.148014 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:06:37.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:06:37 smithi157 bash[24585]: cluster 2024-09-16T08:06:36.029790+0000 mgr.a (mgr.14373) 6470 : cluster [DBG] pgmap v4485: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:06:37.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:06:37 smithi086 bash[24289]: cluster 2024-09-16T08:06:36.029790+0000 mgr.a (mgr.14373) 6470 : cluster [DBG] pgmap v4485: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:06:37.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:06:37 smithi047 bash[22744]: cluster 2024-09-16T08:06:36.029790+0000 mgr.a (mgr.14373) 6470 : cluster [DBG] pgmap v4485: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:06:39.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:06:39 smithi157 bash[24585]: cluster 2024-09-16T08:06:38.032008+0000 mgr.a (mgr.14373) 6471 : cluster [DBG] pgmap v4486: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:06:39.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:06:39 smithi086 bash[24289]: cluster 2024-09-16T08:06:38.032008+0000 mgr.a (mgr.14373) 6471 : cluster [DBG] pgmap v4486: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:06:39.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:06:39 smithi047 bash[22744]: cluster 2024-09-16T08:06:38.032008+0000 mgr.a (mgr.14373) 6471 : cluster [DBG] pgmap v4486: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:06:39.789 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:06:39.790 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:06:39.790 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:06:40.536 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:06:40.536 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:06:40.536 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:06:40.536 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:06:40.536 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:06:41.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:06:41 smithi157 bash[24585]: cluster 2024-09-16T08:06:40.032705+0000 mgr.a (mgr.14373) 6472 : cluster [DBG] pgmap v4487: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:06:41.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:06:41 smithi157 bash[24585]: audit 2024-09-16T08:06:40.127810+0000 mgr.a (mgr.14373) 6473 : audit [DBG] from='client.148092 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:06:41.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:06:41 smithi086 bash[24289]: cluster 2024-09-16T08:06:40.032705+0000 mgr.a (mgr.14373) 6472 : cluster [DBG] pgmap v4487: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:06:41.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:06:41 smithi086 bash[24289]: audit 2024-09-16T08:06:40.127810+0000 mgr.a (mgr.14373) 6473 : audit [DBG] from='client.148092 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:06:41.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:06:41 smithi047 bash[22744]: cluster 2024-09-16T08:06:40.032705+0000 mgr.a (mgr.14373) 6472 : cluster [DBG] pgmap v4487: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:06:41.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:06:41 smithi047 bash[22744]: audit 2024-09-16T08:06:40.127810+0000 mgr.a (mgr.14373) 6473 : audit [DBG] from='client.148092 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:06:43.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:06:43 smithi157 bash[24585]: cluster 2024-09-16T08:06:42.034890+0000 mgr.a (mgr.14373) 6474 : cluster [DBG] pgmap v4488: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:06:43.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:06:43 smithi086 bash[24289]: cluster 2024-09-16T08:06:42.034890+0000 mgr.a (mgr.14373) 6474 : cluster [DBG] pgmap v4488: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:06:43.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:06:43 smithi047 bash[22744]: cluster 2024-09-16T08:06:42.034890+0000 mgr.a (mgr.14373) 6474 : cluster [DBG] pgmap v4488: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:06:45.537 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:06:45.538 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:06:45.538 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:06:45.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:06:45 smithi086 bash[24289]: cluster 2024-09-16T08:06:44.035632+0000 mgr.a (mgr.14373) 6475 : cluster [DBG] pgmap v4489: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:06:45.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:06:45 smithi047 bash[22744]: cluster 2024-09-16T08:06:44.035632+0000 mgr.a (mgr.14373) 6475 : cluster [DBG] pgmap v4489: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:06:45.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:06:45 smithi157 bash[24585]: cluster 2024-09-16T08:06:44.035632+0000 mgr.a (mgr.14373) 6475 : cluster [DBG] pgmap v4489: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:06:46.326 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:06:46.326 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:06:46.327 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:06:46.327 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:06:46.327 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:06:47.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:06:47 smithi086 bash[24289]: audit 2024-09-16T08:06:45.876520+0000 mgr.a (mgr.14373) 6476 : audit [DBG] from='client.148170 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:06:47.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:06:47 smithi086 bash[24289]: cluster 2024-09-16T08:06:46.036253+0000 mgr.a (mgr.14373) 6477 : cluster [DBG] pgmap v4490: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:06:47.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:06:47 smithi047 bash[22744]: audit 2024-09-16T08:06:45.876520+0000 mgr.a (mgr.14373) 6476 : audit [DBG] from='client.148170 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:06:47.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:06:47 smithi047 bash[22744]: cluster 2024-09-16T08:06:46.036253+0000 mgr.a (mgr.14373) 6477 : cluster [DBG] pgmap v4490: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:06:47.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:06:47 smithi157 bash[24585]: audit 2024-09-16T08:06:45.876520+0000 mgr.a (mgr.14373) 6476 : audit [DBG] from='client.148170 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:06:47.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:06:47 smithi157 bash[24585]: cluster 2024-09-16T08:06:46.036253+0000 mgr.a (mgr.14373) 6477 : cluster [DBG] pgmap v4490: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:06:49.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:06:49 smithi086 bash[24289]: cluster 2024-09-16T08:06:48.038982+0000 mgr.a (mgr.14373) 6478 : cluster [DBG] pgmap v4491: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:06:49.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:06:49 smithi047 bash[22744]: cluster 2024-09-16T08:06:48.038982+0000 mgr.a (mgr.14373) 6478 : cluster [DBG] pgmap v4491: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:06:49.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:06:49 smithi157 bash[24585]: cluster 2024-09-16T08:06:48.038982+0000 mgr.a (mgr.14373) 6478 : cluster [DBG] pgmap v4491: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:06:51.328 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:06:51.329 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:06:51.329 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:06:51.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:06:51 smithi086 bash[24289]: cluster 2024-09-16T08:06:50.039881+0000 mgr.a (mgr.14373) 6479 : cluster [DBG] pgmap v4492: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:06:51.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:06:51 smithi047 bash[22744]: cluster 2024-09-16T08:06:50.039881+0000 mgr.a (mgr.14373) 6479 : cluster [DBG] pgmap v4492: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:06:51.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:06:51 smithi157 bash[24585]: cluster 2024-09-16T08:06:50.039881+0000 mgr.a (mgr.14373) 6479 : cluster [DBG] pgmap v4492: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:06:52.109 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:06:52.109 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:06:52.109 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:06:52.109 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:06:52.110 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:06:53.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:06:53 smithi047 bash[22744]: audit 2024-09-16T08:06:51.667399+0000 mgr.a (mgr.14373) 6480 : audit [DBG] from='client.148248 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:06:53.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:06:53 smithi047 bash[22744]: cluster 2024-09-16T08:06:52.041253+0000 mgr.a (mgr.14373) 6481 : cluster [DBG] pgmap v4493: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:06:53.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:06:53 smithi157 bash[24585]: audit 2024-09-16T08:06:51.667399+0000 mgr.a (mgr.14373) 6480 : audit [DBG] from='client.148248 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:06:53.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:06:53 smithi157 bash[24585]: cluster 2024-09-16T08:06:52.041253+0000 mgr.a (mgr.14373) 6481 : cluster [DBG] pgmap v4493: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:06:53.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:06:53 smithi086 bash[24289]: audit 2024-09-16T08:06:51.667399+0000 mgr.a (mgr.14373) 6480 : audit [DBG] from='client.148248 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:06:53.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:06:53 smithi086 bash[24289]: cluster 2024-09-16T08:06:52.041253+0000 mgr.a (mgr.14373) 6481 : cluster [DBG] pgmap v4493: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:06:55.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:06:55 smithi157 bash[24585]: cluster 2024-09-16T08:06:54.042172+0000 mgr.a (mgr.14373) 6482 : cluster [DBG] pgmap v4494: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T08:06:55.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:06:55 smithi086 bash[24289]: cluster 2024-09-16T08:06:54.042172+0000 mgr.a (mgr.14373) 6482 : cluster [DBG] pgmap v4494: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T08:06:55.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:06:55 smithi047 bash[22744]: cluster 2024-09-16T08:06:54.042172+0000 mgr.a (mgr.14373) 6482 : cluster [DBG] pgmap v4494: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T08:06:57.111 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:06:57.112 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:06:57.112 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:06:57.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:06:57 smithi157 bash[24585]: cluster 2024-09-16T08:06:56.042967+0000 mgr.a (mgr.14373) 6483 : cluster [DBG] pgmap v4495: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T08:06:57.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:06:57 smithi086 bash[24289]: cluster 2024-09-16T08:06:56.042967+0000 mgr.a (mgr.14373) 6483 : cluster [DBG] pgmap v4495: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T08:06:57.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:06:57 smithi047 bash[22744]: cluster 2024-09-16T08:06:56.042967+0000 mgr.a (mgr.14373) 6483 : cluster [DBG] pgmap v4495: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T08:06:57.886 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:06:57.886 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:06:57.886 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:06:57.886 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:06:57.887 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:06:59.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:06:59 smithi157 bash[24585]: audit 2024-09-16T08:06:57.450251+0000 mgr.a (mgr.14373) 6484 : audit [DBG] from='client.148326 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:06:59.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:06:59 smithi157 bash[24585]: cluster 2024-09-16T08:06:58.045716+0000 mgr.a (mgr.14373) 6485 : cluster [DBG] pgmap v4496: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:06:59.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:06:59 smithi086 bash[24289]: audit 2024-09-16T08:06:57.450251+0000 mgr.a (mgr.14373) 6484 : audit [DBG] from='client.148326 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:06:59.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:06:59 smithi086 bash[24289]: cluster 2024-09-16T08:06:58.045716+0000 mgr.a (mgr.14373) 6485 : cluster [DBG] pgmap v4496: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:06:59.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:06:59 smithi047 bash[22744]: audit 2024-09-16T08:06:57.450251+0000 mgr.a (mgr.14373) 6484 : audit [DBG] from='client.148326 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:06:59.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:06:59 smithi047 bash[22744]: cluster 2024-09-16T08:06:58.045716+0000 mgr.a (mgr.14373) 6485 : cluster [DBG] pgmap v4496: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:07:00.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:07:00 smithi157 bash[24585]: cluster 2024-09-16T08:07:00.046508+0000 mgr.a (mgr.14373) 6486 : cluster [DBG] pgmap v4497: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:07:00.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:07:00 smithi086 bash[24289]: cluster 2024-09-16T08:07:00.046508+0000 mgr.a (mgr.14373) 6486 : cluster [DBG] pgmap v4497: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:07:00.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:07:00 smithi047 bash[22744]: cluster 2024-09-16T08:07:00.046508+0000 mgr.a (mgr.14373) 6486 : cluster [DBG] pgmap v4497: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:07:02.888 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:07:02.888 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:07:02.888 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:07:03.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:07:03 smithi157 bash[24585]: cluster 2024-09-16T08:07:02.048391+0000 mgr.a (mgr.14373) 6487 : cluster [DBG] pgmap v4498: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:07:03.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:07:03 smithi086 bash[24289]: cluster 2024-09-16T08:07:02.048391+0000 mgr.a (mgr.14373) 6487 : cluster [DBG] pgmap v4498: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:07:03.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:07:03 smithi047 bash[22744]: cluster 2024-09-16T08:07:02.048391+0000 mgr.a (mgr.14373) 6487 : cluster [DBG] pgmap v4498: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:07:03.673 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:07:03.674 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:07:03.674 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:07:03.674 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:07:03.674 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:07:04.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:07:04 smithi157 bash[24585]: audit 2024-09-16T08:07:03.226075+0000 mgr.a (mgr.14373) 6488 : audit [DBG] from='client.148404 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:07:04.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:07:04 smithi086 bash[24289]: audit 2024-09-16T08:07:03.226075+0000 mgr.a (mgr.14373) 6488 : audit [DBG] from='client.148404 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:07:04.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:07:04 smithi047 bash[22744]: audit 2024-09-16T08:07:03.226075+0000 mgr.a (mgr.14373) 6488 : audit [DBG] from='client.148404 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:07:05.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:07:05 smithi157 bash[24585]: cluster 2024-09-16T08:07:04.049329+0000 mgr.a (mgr.14373) 6489 : cluster [DBG] pgmap v4499: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:07:05.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:07:05 smithi086 bash[24289]: cluster 2024-09-16T08:07:04.049329+0000 mgr.a (mgr.14373) 6489 : cluster [DBG] pgmap v4499: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:07:05.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:07:05 smithi047 bash[22744]: cluster 2024-09-16T08:07:04.049329+0000 mgr.a (mgr.14373) 6489 : cluster [DBG] pgmap v4499: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:07:07.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:07:07 smithi157 bash[24585]: cluster 2024-09-16T08:07:06.050108+0000 mgr.a (mgr.14373) 6490 : cluster [DBG] pgmap v4500: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:07:07.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:07:07 smithi086 bash[24289]: cluster 2024-09-16T08:07:06.050108+0000 mgr.a (mgr.14373) 6490 : cluster [DBG] pgmap v4500: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:07:07.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:07:07 smithi047 bash[22744]: cluster 2024-09-16T08:07:06.050108+0000 mgr.a (mgr.14373) 6490 : cluster [DBG] pgmap v4500: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:07:08.675 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:07:08.676 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:07:08.676 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:07:09.451 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:07:09.451 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:07:09.452 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:07:09.452 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:07:09.452 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:07:09.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:07:09 smithi157 bash[24585]: cluster 2024-09-16T08:07:08.052350+0000 mgr.a (mgr.14373) 6491 : cluster [DBG] pgmap v4501: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:07:09.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:07:09 smithi086 bash[24289]: cluster 2024-09-16T08:07:08.052350+0000 mgr.a (mgr.14373) 6491 : cluster [DBG] pgmap v4501: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:07:09.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:07:09 smithi047 bash[22744]: cluster 2024-09-16T08:07:08.052350+0000 mgr.a (mgr.14373) 6491 : cluster [DBG] pgmap v4501: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:07:10.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:07:10 smithi157 bash[24585]: audit 2024-09-16T08:07:09.015148+0000 mgr.a (mgr.14373) 6492 : audit [DBG] from='client.148479 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:07:10.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:07:10 smithi086 bash[24289]: audit 2024-09-16T08:07:09.015148+0000 mgr.a (mgr.14373) 6492 : audit [DBG] from='client.148479 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:07:10.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:07:10 smithi047 bash[22744]: audit 2024-09-16T08:07:09.015148+0000 mgr.a (mgr.14373) 6492 : audit [DBG] from='client.148479 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:07:11.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:07:11 smithi157 bash[24585]: cluster 2024-09-16T08:07:10.053261+0000 mgr.a (mgr.14373) 6493 : cluster [DBG] pgmap v4502: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:07:11.582 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:07:11 smithi086 bash[24289]: cluster 2024-09-16T08:07:10.053261+0000 mgr.a (mgr.14373) 6493 : cluster [DBG] pgmap v4502: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:07:11.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:07:11 smithi047 bash[22744]: cluster 2024-09-16T08:07:10.053261+0000 mgr.a (mgr.14373) 6493 : cluster [DBG] pgmap v4502: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:07:13.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:07:13 smithi157 bash[24585]: cluster 2024-09-16T08:07:12.055473+0000 mgr.a (mgr.14373) 6494 : cluster [DBG] pgmap v4503: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:07:13.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:07:13 smithi086 bash[24289]: cluster 2024-09-16T08:07:12.055473+0000 mgr.a (mgr.14373) 6494 : cluster [DBG] pgmap v4503: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:07:13.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:07:13 smithi047 bash[22744]: cluster 2024-09-16T08:07:12.055473+0000 mgr.a (mgr.14373) 6494 : cluster [DBG] pgmap v4503: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:07:14.453 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:07:14.453 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:07:14.454 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:07:15.205 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:07:15.205 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:07:15.205 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:07:15.206 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:07:15.206 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:07:15.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:07:15 smithi157 bash[24585]: cluster 2024-09-16T08:07:14.056225+0000 mgr.a (mgr.14373) 6495 : cluster [DBG] pgmap v4504: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:07:15.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:07:15 smithi086 bash[24289]: cluster 2024-09-16T08:07:14.056225+0000 mgr.a (mgr.14373) 6495 : cluster [DBG] pgmap v4504: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:07:15.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:07:15 smithi047 bash[22744]: cluster 2024-09-16T08:07:14.056225+0000 mgr.a (mgr.14373) 6495 : cluster [DBG] pgmap v4504: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:07:16.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:07:16 smithi157 bash[24585]: audit 2024-09-16T08:07:14.791715+0000 mgr.a (mgr.14373) 6496 : audit [DBG] from='client.148551 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:07:16.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:07:16 smithi086 bash[24289]: audit 2024-09-16T08:07:14.791715+0000 mgr.a (mgr.14373) 6496 : audit [DBG] from='client.148551 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:07:16.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:07:16 smithi047 bash[22744]: audit 2024-09-16T08:07:14.791715+0000 mgr.a (mgr.14373) 6496 : audit [DBG] from='client.148551 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:07:17.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:07:17 smithi157 bash[24585]: cluster 2024-09-16T08:07:16.057117+0000 mgr.a (mgr.14373) 6497 : cluster [DBG] pgmap v4505: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:07:17.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:07:17 smithi086 bash[24289]: cluster 2024-09-16T08:07:16.057117+0000 mgr.a (mgr.14373) 6497 : cluster [DBG] pgmap v4505: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:07:17.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:07:17 smithi047 bash[22744]: cluster 2024-09-16T08:07:16.057117+0000 mgr.a (mgr.14373) 6497 : cluster [DBG] pgmap v4505: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:07:19.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:07:19 smithi157 bash[24585]: cluster 2024-09-16T08:07:18.059278+0000 mgr.a (mgr.14373) 6498 : cluster [DBG] pgmap v4506: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:07:19.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:07:19 smithi086 bash[24289]: cluster 2024-09-16T08:07:18.059278+0000 mgr.a (mgr.14373) 6498 : cluster [DBG] pgmap v4506: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:07:19.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:07:19 smithi047 bash[22744]: cluster 2024-09-16T08:07:18.059278+0000 mgr.a (mgr.14373) 6498 : cluster [DBG] pgmap v4506: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:07:20.206 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:07:20.207 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:07:20.208 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:07:20.977 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:07:20.977 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:07:20.977 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:07:20.977 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:07:20.977 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:07:21.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:07:21 smithi157 bash[24585]: cluster 2024-09-16T08:07:20.060031+0000 mgr.a (mgr.14373) 6499 : cluster [DBG] pgmap v4507: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:07:21.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:07:21 smithi086 bash[24289]: cluster 2024-09-16T08:07:20.060031+0000 mgr.a (mgr.14373) 6499 : cluster [DBG] pgmap v4507: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:07:21.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:07:21 smithi047 bash[22744]: cluster 2024-09-16T08:07:20.060031+0000 mgr.a (mgr.14373) 6499 : cluster [DBG] pgmap v4507: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:07:22.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:07:22 smithi157 bash[24585]: audit 2024-09-16T08:07:20.542668+0000 mgr.a (mgr.14373) 6500 : audit [DBG] from='client.148629 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:07:22.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:07:22 smithi086 bash[24289]: audit 2024-09-16T08:07:20.542668+0000 mgr.a (mgr.14373) 6500 : audit [DBG] from='client.148629 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:07:22.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:07:22 smithi047 bash[22744]: audit 2024-09-16T08:07:20.542668+0000 mgr.a (mgr.14373) 6500 : audit [DBG] from='client.148629 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:07:23.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:07:23 smithi157 bash[24585]: cluster 2024-09-16T08:07:22.062307+0000 mgr.a (mgr.14373) 6501 : cluster [DBG] pgmap v4508: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:07:23.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:07:23 smithi086 bash[24289]: cluster 2024-09-16T08:07:22.062307+0000 mgr.a (mgr.14373) 6501 : cluster [DBG] pgmap v4508: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:07:23.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:07:23 smithi047 bash[22744]: cluster 2024-09-16T08:07:22.062307+0000 mgr.a (mgr.14373) 6501 : cluster [DBG] pgmap v4508: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:07:25.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:07:25 smithi157 bash[24585]: cluster 2024-09-16T08:07:24.063087+0000 mgr.a (mgr.14373) 6502 : cluster [DBG] pgmap v4509: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:07:25.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:07:25 smithi086 bash[24289]: cluster 2024-09-16T08:07:24.063087+0000 mgr.a (mgr.14373) 6502 : cluster [DBG] pgmap v4509: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:07:25.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:07:25 smithi047 bash[22744]: cluster 2024-09-16T08:07:24.063087+0000 mgr.a (mgr.14373) 6502 : cluster [DBG] pgmap v4509: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:07:25.978 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:07:25.979 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:07:25.979 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:07:26.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:07:26 smithi157 bash[24585]: audit 2024-09-16T08:07:25.991266+0000 mon.b (mon.2) 622 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T08:07:26.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:07:26 smithi086 bash[24289]: audit 2024-09-16T08:07:25.991266+0000 mon.b (mon.2) 622 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T08:07:26.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:07:26 smithi047 bash[22744]: audit 2024-09-16T08:07:25.991266+0000 mon.b (mon.2) 622 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T08:07:26.788 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:07:26.788 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:07:26.788 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:07:26.788 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:07:26.788 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:07:27.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:07:27 smithi157 bash[24585]: cluster 2024-09-16T08:07:26.063830+0000 mgr.a (mgr.14373) 6503 : cluster [DBG] pgmap v4510: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:07:27.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:07:27 smithi157 bash[24585]: audit 2024-09-16T08:07:26.322757+0000 mgr.a (mgr.14373) 6504 : audit [DBG] from='client.148707 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:07:27.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:07:27 smithi086 bash[24289]: cluster 2024-09-16T08:07:26.063830+0000 mgr.a (mgr.14373) 6503 : cluster [DBG] pgmap v4510: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:07:27.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:07:27 smithi086 bash[24289]: audit 2024-09-16T08:07:26.322757+0000 mgr.a (mgr.14373) 6504 : audit [DBG] from='client.148707 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:07:27.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:07:27 smithi047 bash[22744]: cluster 2024-09-16T08:07:26.063830+0000 mgr.a (mgr.14373) 6503 : cluster [DBG] pgmap v4510: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:07:27.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:07:27 smithi047 bash[22744]: audit 2024-09-16T08:07:26.322757+0000 mgr.a (mgr.14373) 6504 : audit [DBG] from='client.148707 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:07:29.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:07:29 smithi157 bash[24585]: cluster 2024-09-16T08:07:28.066464+0000 mgr.a (mgr.14373) 6505 : cluster [DBG] pgmap v4511: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-16T08:07:29.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:07:29 smithi086 bash[24289]: cluster 2024-09-16T08:07:28.066464+0000 mgr.a (mgr.14373) 6505 : cluster [DBG] pgmap v4511: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-16T08:07:29.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:07:29 smithi047 bash[22744]: cluster 2024-09-16T08:07:28.066464+0000 mgr.a (mgr.14373) 6505 : cluster [DBG] pgmap v4511: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-16T08:07:31.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:07:31 smithi157 bash[24585]: cluster 2024-09-16T08:07:30.067256+0000 mgr.a (mgr.14373) 6506 : cluster [DBG] pgmap v4512: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T08:07:31.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:07:31 smithi086 bash[24289]: cluster 2024-09-16T08:07:30.067256+0000 mgr.a (mgr.14373) 6506 : cluster [DBG] pgmap v4512: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T08:07:31.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:07:31 smithi047 bash[22744]: cluster 2024-09-16T08:07:30.067256+0000 mgr.a (mgr.14373) 6506 : cluster [DBG] pgmap v4512: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T08:07:31.789 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:07:31.790 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:07:31.790 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:07:32.534 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:07:32.534 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:07:32.534 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:07:32.534 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:07:32.534 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:07:33.247 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:07:33 smithi047 bash[22744]: cluster 2024-09-16T08:07:32.069146+0000 mgr.a (mgr.14373) 6507 : cluster [DBG] pgmap v4513: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:07:33.247 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:07:33 smithi047 bash[22744]: audit 2024-09-16T08:07:32.125843+0000 mgr.a (mgr.14373) 6508 : audit [DBG] from='client.148785 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:07:33.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:07:33 smithi157 bash[24585]: cluster 2024-09-16T08:07:32.069146+0000 mgr.a (mgr.14373) 6507 : cluster [DBG] pgmap v4513: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:07:33.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:07:33 smithi157 bash[24585]: audit 2024-09-16T08:07:32.125843+0000 mgr.a (mgr.14373) 6508 : audit [DBG] from='client.148785 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:07:33.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:07:33 smithi086 bash[24289]: cluster 2024-09-16T08:07:32.069146+0000 mgr.a (mgr.14373) 6507 : cluster [DBG] pgmap v4513: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:07:33.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:07:33 smithi086 bash[24289]: audit 2024-09-16T08:07:32.125843+0000 mgr.a (mgr.14373) 6508 : audit [DBG] from='client.148785 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:07:35.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:07:35 smithi157 bash[24585]: cluster 2024-09-16T08:07:34.070211+0000 mgr.a (mgr.14373) 6509 : cluster [DBG] pgmap v4514: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:07:35.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:07:35 smithi086 bash[24289]: cluster 2024-09-16T08:07:34.070211+0000 mgr.a (mgr.14373) 6509 : cluster [DBG] pgmap v4514: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:07:35.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:07:35 smithi047 bash[22744]: cluster 2024-09-16T08:07:34.070211+0000 mgr.a (mgr.14373) 6509 : cluster [DBG] pgmap v4514: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:07:37.535 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:07:37.536 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:07:37.536 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:07:37.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:07:37 smithi157 bash[24585]: cluster 2024-09-16T08:07:36.071079+0000 mgr.a (mgr.14373) 6510 : cluster [DBG] pgmap v4515: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T08:07:37.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:07:37 smithi157 bash[24585]: audit 2024-09-16T08:07:36.483254+0000 mon.a (mon.0) 952 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:07:37.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:07:37 smithi157 bash[24585]: audit 2024-09-16T08:07:36.492537+0000 mon.a (mon.0) 953 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:07:37.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:07:37 smithi157 bash[24585]: audit 2024-09-16T08:07:36.494680+0000 mon.b (mon.2) 623 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T08:07:37.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:07:37 smithi157 bash[24585]: audit 2024-09-16T08:07:36.497004+0000 mon.b (mon.2) 624 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T08:07:37.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:07:37 smithi157 bash[24585]: audit 2024-09-16T08:07:36.509602+0000 mon.a (mon.0) 954 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:07:37.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:07:37 smithi157 bash[24585]: audit 2024-09-16T08:07:36.514558+0000 mon.b (mon.2) 625 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:07:37.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:07:37 smithi086 bash[24289]: cluster 2024-09-16T08:07:36.071079+0000 mgr.a (mgr.14373) 6510 : cluster [DBG] pgmap v4515: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T08:07:37.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:07:37 smithi086 bash[24289]: audit 2024-09-16T08:07:36.483254+0000 mon.a (mon.0) 952 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:07:37.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:07:37 smithi086 bash[24289]: audit 2024-09-16T08:07:36.492537+0000 mon.a (mon.0) 953 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:07:37.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:07:37 smithi086 bash[24289]: audit 2024-09-16T08:07:36.494680+0000 mon.b (mon.2) 623 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T08:07:37.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:07:37 smithi086 bash[24289]: audit 2024-09-16T08:07:36.497004+0000 mon.b (mon.2) 624 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T08:07:37.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:07:37 smithi086 bash[24289]: audit 2024-09-16T08:07:36.509602+0000 mon.a (mon.0) 954 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:07:37.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:07:37 smithi086 bash[24289]: audit 2024-09-16T08:07:36.514558+0000 mon.b (mon.2) 625 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:07:37.587 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 08:07:37 smithi047 bash[22994]: debug 2024-09-16T08:07:37.309+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T08:07:37.588 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 08:07:37 smithi047 bash[22994]: debug 2024-09-16T08:07:37.309+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T08:07:37.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:07:37 smithi047 bash[22744]: cluster 2024-09-16T08:07:36.071079+0000 mgr.a (mgr.14373) 6510 : cluster [DBG] pgmap v4515: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T08:07:37.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:07:37 smithi047 bash[22744]: audit 2024-09-16T08:07:36.483254+0000 mon.a (mon.0) 952 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:07:37.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:07:37 smithi047 bash[22744]: audit 2024-09-16T08:07:36.492537+0000 mon.a (mon.0) 953 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:07:37.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:07:37 smithi047 bash[22744]: audit 2024-09-16T08:07:36.494680+0000 mon.b (mon.2) 623 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T08:07:37.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:07:37 smithi047 bash[22744]: audit 2024-09-16T08:07:36.497004+0000 mon.b (mon.2) 624 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T08:07:37.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:07:37 smithi047 bash[22744]: audit 2024-09-16T08:07:36.509602+0000 mon.a (mon.0) 954 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:07:37.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:07:37 smithi047 bash[22744]: audit 2024-09-16T08:07:36.514558+0000 mon.b (mon.2) 625 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:07:38.316 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:07:38.316 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:07:38.316 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:07:38.317 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:07:38.317 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:07:38.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:07:38 smithi157 bash[24585]: audit 2024-09-16T08:07:36.518812+0000 mgr.a (mgr.14373) 6511 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:07:38.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:07:38 smithi157 bash[24585]: audit 2024-09-16T08:07:37.310403+0000 mgr.a (mgr.14373) 6512 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T08:07:38.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:07:38 smithi157 bash[24585]: cephadm 2024-09-16T08:07:37.312675+0000 mgr.a (mgr.14373) 6513 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T08:07:38.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:07:38 smithi086 bash[24289]: audit 2024-09-16T08:07:36.518812+0000 mgr.a (mgr.14373) 6511 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:07:38.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:07:38 smithi086 bash[24289]: audit 2024-09-16T08:07:37.310403+0000 mgr.a (mgr.14373) 6512 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T08:07:38.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:07:38 smithi086 bash[24289]: cephadm 2024-09-16T08:07:37.312675+0000 mgr.a (mgr.14373) 6513 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T08:07:38.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:07:38 smithi047 bash[22744]: audit 2024-09-16T08:07:36.518812+0000 mgr.a (mgr.14373) 6511 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:07:38.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:07:38 smithi047 bash[22744]: audit 2024-09-16T08:07:37.310403+0000 mgr.a (mgr.14373) 6512 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T08:07:38.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:07:38 smithi047 bash[22744]: cephadm 2024-09-16T08:07:37.312675+0000 mgr.a (mgr.14373) 6513 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T08:07:39.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:07:39 smithi157 bash[24585]: audit 2024-09-16T08:07:37.877253+0000 mgr.a (mgr.14373) 6514 : audit [DBG] from='client.148968 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:07:39.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:07:39 smithi157 bash[24585]: cluster 2024-09-16T08:07:38.072365+0000 mgr.a (mgr.14373) 6515 : cluster [DBG] pgmap v4516: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:07:39.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:07:39 smithi086 bash[24289]: audit 2024-09-16T08:07:37.877253+0000 mgr.a (mgr.14373) 6514 : audit [DBG] from='client.148968 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:07:39.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:07:39 smithi086 bash[24289]: cluster 2024-09-16T08:07:38.072365+0000 mgr.a (mgr.14373) 6515 : cluster [DBG] pgmap v4516: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:07:39.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:07:39 smithi047 bash[22744]: audit 2024-09-16T08:07:37.877253+0000 mgr.a (mgr.14373) 6514 : audit [DBG] from='client.148968 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:07:39.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:07:39 smithi047 bash[22744]: cluster 2024-09-16T08:07:38.072365+0000 mgr.a (mgr.14373) 6515 : cluster [DBG] pgmap v4516: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:07:41.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:07:41 smithi157 bash[24585]: cluster 2024-09-16T08:07:40.073348+0000 mgr.a (mgr.14373) 6516 : cluster [DBG] pgmap v4517: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-16T08:07:41.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:07:41 smithi086 bash[24289]: cluster 2024-09-16T08:07:40.073348+0000 mgr.a (mgr.14373) 6516 : cluster [DBG] pgmap v4517: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-16T08:07:41.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:07:41 smithi047 bash[22744]: cluster 2024-09-16T08:07:40.073348+0000 mgr.a (mgr.14373) 6516 : cluster [DBG] pgmap v4517: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-16T08:07:43.318 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:07:43.318 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:07:43.318 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:07:43.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:07:43 smithi157 bash[24585]: cluster 2024-09-16T08:07:42.075586+0000 mgr.a (mgr.14373) 6517 : cluster [DBG] pgmap v4518: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:07:43.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:07:43 smithi086 bash[24289]: cluster 2024-09-16T08:07:42.075586+0000 mgr.a (mgr.14373) 6517 : cluster [DBG] pgmap v4518: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:07:43.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:07:43 smithi047 bash[22744]: cluster 2024-09-16T08:07:42.075586+0000 mgr.a (mgr.14373) 6517 : cluster [DBG] pgmap v4518: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:07:44.072 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:07:44.072 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:07:44.072 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:07:44.072 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:07:44.072 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:07:45.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:07:45 smithi157 bash[24585]: audit 2024-09-16T08:07:43.649555+0000 mgr.a (mgr.14373) 6518 : audit [DBG] from='client.149046 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:07:45.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:07:45 smithi157 bash[24585]: cluster 2024-09-16T08:07:44.076155+0000 mgr.a (mgr.14373) 6519 : cluster [DBG] pgmap v4519: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:07:45.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:07:45 smithi086 bash[24289]: audit 2024-09-16T08:07:43.649555+0000 mgr.a (mgr.14373) 6518 : audit [DBG] from='client.149046 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:07:45.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:07:45 smithi086 bash[24289]: cluster 2024-09-16T08:07:44.076155+0000 mgr.a (mgr.14373) 6519 : cluster [DBG] pgmap v4519: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:07:45.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:07:45 smithi047 bash[22744]: audit 2024-09-16T08:07:43.649555+0000 mgr.a (mgr.14373) 6518 : audit [DBG] from='client.149046 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:07:45.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:07:45 smithi047 bash[22744]: cluster 2024-09-16T08:07:44.076155+0000 mgr.a (mgr.14373) 6519 : cluster [DBG] pgmap v4519: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:07:47.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:07:47 smithi157 bash[24585]: cluster 2024-09-16T08:07:46.076900+0000 mgr.a (mgr.14373) 6520 : cluster [DBG] pgmap v4520: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:07:47.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:07:47 smithi086 bash[24289]: cluster 2024-09-16T08:07:46.076900+0000 mgr.a (mgr.14373) 6520 : cluster [DBG] pgmap v4520: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:07:47.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:07:47 smithi047 bash[22744]: cluster 2024-09-16T08:07:46.076900+0000 mgr.a (mgr.14373) 6520 : cluster [DBG] pgmap v4520: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:07:49.073 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:07:49.074 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:07:49.074 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:07:49.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:07:49 smithi157 bash[24585]: cluster 2024-09-16T08:07:48.079151+0000 mgr.a (mgr.14373) 6521 : cluster [DBG] pgmap v4521: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:07:49.808 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:07:49.808 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:07:49.808 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:07:49.808 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:07:49.809 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:07:49.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:07:49 smithi086 bash[24289]: cluster 2024-09-16T08:07:48.079151+0000 mgr.a (mgr.14373) 6521 : cluster [DBG] pgmap v4521: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:07:49.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:07:49 smithi047 bash[22744]: cluster 2024-09-16T08:07:48.079151+0000 mgr.a (mgr.14373) 6521 : cluster [DBG] pgmap v4521: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:07:51.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:07:51 smithi157 bash[24585]: audit 2024-09-16T08:07:49.400674+0000 mgr.a (mgr.14373) 6522 : audit [DBG] from='client.149124 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:07:51.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:07:51 smithi157 bash[24585]: cluster 2024-09-16T08:07:50.080315+0000 mgr.a (mgr.14373) 6523 : cluster [DBG] pgmap v4522: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:07:51.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:07:51 smithi086 bash[24289]: audit 2024-09-16T08:07:49.400674+0000 mgr.a (mgr.14373) 6522 : audit [DBG] from='client.149124 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:07:51.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:07:51 smithi086 bash[24289]: cluster 2024-09-16T08:07:50.080315+0000 mgr.a (mgr.14373) 6523 : cluster [DBG] pgmap v4522: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:07:51.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:07:51 smithi047 bash[22744]: audit 2024-09-16T08:07:49.400674+0000 mgr.a (mgr.14373) 6522 : audit [DBG] from='client.149124 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:07:51.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:07:51 smithi047 bash[22744]: cluster 2024-09-16T08:07:50.080315+0000 mgr.a (mgr.14373) 6523 : cluster [DBG] pgmap v4522: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:07:53.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:07:53 smithi157 bash[24585]: cluster 2024-09-16T08:07:52.082619+0000 mgr.a (mgr.14373) 6524 : cluster [DBG] pgmap v4523: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:07:53.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:07:53 smithi086 bash[24289]: cluster 2024-09-16T08:07:52.082619+0000 mgr.a (mgr.14373) 6524 : cluster [DBG] pgmap v4523: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:07:53.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:07:53 smithi047 bash[22744]: cluster 2024-09-16T08:07:52.082619+0000 mgr.a (mgr.14373) 6524 : cluster [DBG] pgmap v4523: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:07:54.810 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:07:54.810 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:07:54.811 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:07:55.573 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:07:55.573 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:07:55.573 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:07:55.573 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:07:55.574 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:07:55.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:07:55 smithi157 bash[24585]: cluster 2024-09-16T08:07:54.083395+0000 mgr.a (mgr.14373) 6525 : cluster [DBG] pgmap v4524: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:07:55.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:07:55 smithi157 bash[24585]: audit 2024-09-16T08:07:55.146498+0000 mgr.a (mgr.14373) 6526 : audit [DBG] from='client.149199 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:07:55.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:07:55 smithi086 bash[24289]: cluster 2024-09-16T08:07:54.083395+0000 mgr.a (mgr.14373) 6525 : cluster [DBG] pgmap v4524: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:07:55.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:07:55 smithi086 bash[24289]: audit 2024-09-16T08:07:55.146498+0000 mgr.a (mgr.14373) 6526 : audit [DBG] from='client.149199 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:07:55.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:07:55 smithi047 bash[22744]: cluster 2024-09-16T08:07:54.083395+0000 mgr.a (mgr.14373) 6525 : cluster [DBG] pgmap v4524: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:07:55.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:07:55 smithi047 bash[22744]: audit 2024-09-16T08:07:55.146498+0000 mgr.a (mgr.14373) 6526 : audit [DBG] from='client.149199 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:07:56.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:07:56 smithi157 bash[24585]: cluster 2024-09-16T08:07:56.084399+0000 mgr.a (mgr.14373) 6527 : cluster [DBG] pgmap v4525: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:07:56.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:07:56 smithi086 bash[24289]: cluster 2024-09-16T08:07:56.084399+0000 mgr.a (mgr.14373) 6527 : cluster [DBG] pgmap v4525: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:07:56.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:07:56 smithi047 bash[22744]: cluster 2024-09-16T08:07:56.084399+0000 mgr.a (mgr.14373) 6527 : cluster [DBG] pgmap v4525: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:07:59.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:07:59 smithi157 bash[24585]: cluster 2024-09-16T08:07:58.086676+0000 mgr.a (mgr.14373) 6528 : cluster [DBG] pgmap v4526: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:07:59.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:07:59 smithi086 bash[24289]: cluster 2024-09-16T08:07:58.086676+0000 mgr.a (mgr.14373) 6528 : cluster [DBG] pgmap v4526: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:07:59.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:07:59 smithi047 bash[22744]: cluster 2024-09-16T08:07:58.086676+0000 mgr.a (mgr.14373) 6528 : cluster [DBG] pgmap v4526: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:08:00.575 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:08:00.576 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:08:00.576 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:08:01.366 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:08:01.366 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:08:01.366 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:08:01.366 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:08:01.366 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:08:01.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:08:01 smithi157 bash[24585]: cluster 2024-09-16T08:08:00.087452+0000 mgr.a (mgr.14373) 6529 : cluster [DBG] pgmap v4527: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:08:01.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:08:01 smithi086 bash[24289]: cluster 2024-09-16T08:08:00.087452+0000 mgr.a (mgr.14373) 6529 : cluster [DBG] pgmap v4527: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:08:01.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:08:01 smithi047 bash[22744]: cluster 2024-09-16T08:08:00.087452+0000 mgr.a (mgr.14373) 6529 : cluster [DBG] pgmap v4527: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:08:02.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:08:02 smithi157 bash[24585]: audit 2024-09-16T08:08:00.916999+0000 mgr.a (mgr.14373) 6530 : audit [DBG] from='client.149274 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:08:02.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:08:02 smithi086 bash[24289]: audit 2024-09-16T08:08:00.916999+0000 mgr.a (mgr.14373) 6530 : audit [DBG] from='client.149274 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:08:02.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:08:02 smithi047 bash[22744]: audit 2024-09-16T08:08:00.916999+0000 mgr.a (mgr.14373) 6530 : audit [DBG] from='client.149274 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:08:03.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:08:03 smithi157 bash[24585]: cluster 2024-09-16T08:08:02.089914+0000 mgr.a (mgr.14373) 6531 : cluster [DBG] pgmap v4528: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:08:03.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:08:03 smithi086 bash[24289]: cluster 2024-09-16T08:08:02.089914+0000 mgr.a (mgr.14373) 6531 : cluster [DBG] pgmap v4528: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:08:03.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:08:03 smithi047 bash[22744]: cluster 2024-09-16T08:08:02.089914+0000 mgr.a (mgr.14373) 6531 : cluster [DBG] pgmap v4528: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:08:05.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:08:05 smithi157 bash[24585]: cluster 2024-09-16T08:08:04.090737+0000 mgr.a (mgr.14373) 6532 : cluster [DBG] pgmap v4529: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:08:05.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:08:05 smithi086 bash[24289]: cluster 2024-09-16T08:08:04.090737+0000 mgr.a (mgr.14373) 6532 : cluster [DBG] pgmap v4529: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:08:05.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:08:05 smithi047 bash[22744]: cluster 2024-09-16T08:08:04.090737+0000 mgr.a (mgr.14373) 6532 : cluster [DBG] pgmap v4529: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:08:06.367 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:08:06.368 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:08:06.368 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:08:07.147 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:08:07.148 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:08:07.148 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:08:07.148 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:08:07.148 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:08:07.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:08:07 smithi157 bash[24585]: cluster 2024-09-16T08:08:06.091514+0000 mgr.a (mgr.14373) 6533 : cluster [DBG] pgmap v4530: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:08:07.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:08:07 smithi086 bash[24289]: cluster 2024-09-16T08:08:06.091514+0000 mgr.a (mgr.14373) 6533 : cluster [DBG] pgmap v4530: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:08:07.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:08:07 smithi047 bash[22744]: cluster 2024-09-16T08:08:06.091514+0000 mgr.a (mgr.14373) 6533 : cluster [DBG] pgmap v4530: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:08:08.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:08:08 smithi157 bash[24585]: audit 2024-09-16T08:08:06.706414+0000 mgr.a (mgr.14373) 6534 : audit [DBG] from='client.149352 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:08:08.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:08:08 smithi086 bash[24289]: audit 2024-09-16T08:08:06.706414+0000 mgr.a (mgr.14373) 6534 : audit [DBG] from='client.149352 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:08:08.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:08:08 smithi047 bash[22744]: audit 2024-09-16T08:08:06.706414+0000 mgr.a (mgr.14373) 6534 : audit [DBG] from='client.149352 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:08:09.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:08:09 smithi157 bash[24585]: cluster 2024-09-16T08:08:08.094469+0000 mgr.a (mgr.14373) 6535 : cluster [DBG] pgmap v4531: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-16T08:08:09.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:08:09 smithi086 bash[24289]: cluster 2024-09-16T08:08:08.094469+0000 mgr.a (mgr.14373) 6535 : cluster [DBG] pgmap v4531: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-16T08:08:09.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:08:09 smithi047 bash[22744]: cluster 2024-09-16T08:08:08.094469+0000 mgr.a (mgr.14373) 6535 : cluster [DBG] pgmap v4531: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-16T08:08:11.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:08:11 smithi157 bash[24585]: cluster 2024-09-16T08:08:10.095433+0000 mgr.a (mgr.14373) 6536 : cluster [DBG] pgmap v4532: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 4.9 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-16T08:08:11.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:08:11 smithi086 bash[24289]: cluster 2024-09-16T08:08:10.095433+0000 mgr.a (mgr.14373) 6536 : cluster [DBG] pgmap v4532: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 4.9 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-16T08:08:11.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:08:11 smithi047 bash[22744]: cluster 2024-09-16T08:08:10.095433+0000 mgr.a (mgr.14373) 6536 : cluster [DBG] pgmap v4532: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 4.9 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-16T08:08:12.149 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:08:12.150 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:08:12.150 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:08:12.936 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:08:12.936 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:08:12.936 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:08:12.936 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:08:12.936 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:08:13.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:08:13 smithi157 bash[24585]: cluster 2024-09-16T08:08:12.097528+0000 mgr.a (mgr.14373) 6537 : cluster [DBG] pgmap v4533: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-16T08:08:13.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:08:13 smithi086 bash[24289]: cluster 2024-09-16T08:08:12.097528+0000 mgr.a (mgr.14373) 6537 : cluster [DBG] pgmap v4533: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-16T08:08:13.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:08:13 smithi047 bash[22744]: cluster 2024-09-16T08:08:12.097528+0000 mgr.a (mgr.14373) 6537 : cluster [DBG] pgmap v4533: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-16T08:08:14.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:08:14 smithi157 bash[24585]: audit 2024-09-16T08:08:12.490868+0000 mgr.a (mgr.14373) 6538 : audit [DBG] from='client.149427 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:08:14.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:08:14 smithi086 bash[24289]: audit 2024-09-16T08:08:12.490868+0000 mgr.a (mgr.14373) 6538 : audit [DBG] from='client.149427 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:08:14.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:08:14 smithi047 bash[22744]: audit 2024-09-16T08:08:12.490868+0000 mgr.a (mgr.14373) 6538 : audit [DBG] from='client.149427 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:08:15.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:08:15 smithi157 bash[24585]: cluster 2024-09-16T08:08:14.098662+0000 mgr.a (mgr.14373) 6539 : cluster [DBG] pgmap v4534: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 4.9 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-16T08:08:15.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:08:15 smithi086 bash[24289]: cluster 2024-09-16T08:08:14.098662+0000 mgr.a (mgr.14373) 6539 : cluster [DBG] pgmap v4534: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 4.9 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-16T08:08:15.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:08:15 smithi047 bash[22744]: cluster 2024-09-16T08:08:14.098662+0000 mgr.a (mgr.14373) 6539 : cluster [DBG] pgmap v4534: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 4.9 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-16T08:08:17.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:08:17 smithi157 bash[24585]: cluster 2024-09-16T08:08:16.099466+0000 mgr.a (mgr.14373) 6540 : cluster [DBG] pgmap v4535: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 4.9 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-16T08:08:17.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:08:17 smithi086 bash[24289]: cluster 2024-09-16T08:08:16.099466+0000 mgr.a (mgr.14373) 6540 : cluster [DBG] pgmap v4535: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 4.9 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-16T08:08:17.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:08:17 smithi047 bash[22744]: cluster 2024-09-16T08:08:16.099466+0000 mgr.a (mgr.14373) 6540 : cluster [DBG] pgmap v4535: 225 pgs: 225 active+clean; 589 KiB data, 142 MiB used, 268 GiB / 268 GiB avail; 4.9 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-16T08:08:17.937 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:08:17.938 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:08:17.938 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:08:18.723 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:08:18.724 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:08:18.724 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:08:18.724 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:08:18.724 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:08:19.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:08:19 smithi157 bash[24585]: cluster 2024-09-16T08:08:18.101497+0000 mgr.a (mgr.14373) 6541 : cluster [DBG] pgmap v4536: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 69 KiB/s rd, 0 B/s wr, 114 op/s 2024-09-16T08:08:19.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:08:19 smithi157 bash[24585]: audit 2024-09-16T08:08:18.281432+0000 mgr.a (mgr.14373) 6542 : audit [DBG] from='client.149502 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:08:19.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:08:19 smithi086 bash[24289]: cluster 2024-09-16T08:08:18.101497+0000 mgr.a (mgr.14373) 6541 : cluster [DBG] pgmap v4536: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 69 KiB/s rd, 0 B/s wr, 114 op/s 2024-09-16T08:08:19.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:08:19 smithi086 bash[24289]: audit 2024-09-16T08:08:18.281432+0000 mgr.a (mgr.14373) 6542 : audit [DBG] from='client.149502 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:08:19.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:08:19 smithi047 bash[22744]: cluster 2024-09-16T08:08:18.101497+0000 mgr.a (mgr.14373) 6541 : cluster [DBG] pgmap v4536: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 69 KiB/s rd, 0 B/s wr, 114 op/s 2024-09-16T08:08:19.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:08:19 smithi047 bash[22744]: audit 2024-09-16T08:08:18.281432+0000 mgr.a (mgr.14373) 6542 : audit [DBG] from='client.149502 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:08:21.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:08:21 smithi157 bash[24585]: cluster 2024-09-16T08:08:20.102549+0000 mgr.a (mgr.14373) 6543 : cluster [DBG] pgmap v4537: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 65 KiB/s rd, 0 B/s wr, 107 op/s 2024-09-16T08:08:21.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:08:21 smithi086 bash[24289]: cluster 2024-09-16T08:08:20.102549+0000 mgr.a (mgr.14373) 6543 : cluster [DBG] pgmap v4537: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 65 KiB/s rd, 0 B/s wr, 107 op/s 2024-09-16T08:08:21.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:08:21 smithi047 bash[22744]: cluster 2024-09-16T08:08:20.102549+0000 mgr.a (mgr.14373) 6543 : cluster [DBG] pgmap v4537: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 65 KiB/s rd, 0 B/s wr, 107 op/s 2024-09-16T08:08:23.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:08:23 smithi157 bash[24585]: cluster 2024-09-16T08:08:22.104757+0000 mgr.a (mgr.14373) 6544 : cluster [DBG] pgmap v4538: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 66 KiB/s rd, 0 B/s wr, 108 op/s 2024-09-16T08:08:23.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:08:23 smithi086 bash[24289]: cluster 2024-09-16T08:08:22.104757+0000 mgr.a (mgr.14373) 6544 : cluster [DBG] pgmap v4538: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 66 KiB/s rd, 0 B/s wr, 108 op/s 2024-09-16T08:08:23.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:08:23 smithi047 bash[22744]: cluster 2024-09-16T08:08:22.104757+0000 mgr.a (mgr.14373) 6544 : cluster [DBG] pgmap v4538: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 66 KiB/s rd, 0 B/s wr, 108 op/s 2024-09-16T08:08:23.725 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:08:23.726 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:08:23.726 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:08:24.499 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:08:24.500 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:08:24.500 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:08:24.500 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:08:24.501 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:08:25.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:08:25 smithi157 bash[24585]: audit 2024-09-16T08:08:24.066632+0000 mgr.a (mgr.14373) 6545 : audit [DBG] from='client.149577 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:08:25.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:08:25 smithi157 bash[24585]: cluster 2024-09-16T08:08:24.105816+0000 mgr.a (mgr.14373) 6546 : cluster [DBG] pgmap v4539: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 65 KiB/s rd, 0 B/s wr, 107 op/s 2024-09-16T08:08:25.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:08:25 smithi086 bash[24289]: audit 2024-09-16T08:08:24.066632+0000 mgr.a (mgr.14373) 6545 : audit [DBG] from='client.149577 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:08:25.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:08:25 smithi086 bash[24289]: cluster 2024-09-16T08:08:24.105816+0000 mgr.a (mgr.14373) 6546 : cluster [DBG] pgmap v4539: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 65 KiB/s rd, 0 B/s wr, 107 op/s 2024-09-16T08:08:25.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:08:25 smithi047 bash[22744]: audit 2024-09-16T08:08:24.066632+0000 mgr.a (mgr.14373) 6545 : audit [DBG] from='client.149577 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:08:25.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:08:25 smithi047 bash[22744]: cluster 2024-09-16T08:08:24.105816+0000 mgr.a (mgr.14373) 6546 : cluster [DBG] pgmap v4539: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 65 KiB/s rd, 0 B/s wr, 107 op/s 2024-09-16T08:08:27.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:08:27 smithi157 bash[24585]: cluster 2024-09-16T08:08:26.106771+0000 mgr.a (mgr.14373) 6547 : cluster [DBG] pgmap v4540: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 65 KiB/s rd, 0 B/s wr, 107 op/s 2024-09-16T08:08:27.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:08:27 smithi086 bash[24289]: cluster 2024-09-16T08:08:26.106771+0000 mgr.a (mgr.14373) 6547 : cluster [DBG] pgmap v4540: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 65 KiB/s rd, 0 B/s wr, 107 op/s 2024-09-16T08:08:27.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:08:27 smithi047 bash[22744]: cluster 2024-09-16T08:08:26.106771+0000 mgr.a (mgr.14373) 6547 : cluster [DBG] pgmap v4540: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 65 KiB/s rd, 0 B/s wr, 107 op/s 2024-09-16T08:08:29.501 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:08:29.502 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:08:29.502 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:08:29.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:08:29 smithi157 bash[24585]: cluster 2024-09-16T08:08:28.109031+0000 mgr.a (mgr.14373) 6548 : cluster [DBG] pgmap v4541: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 66 KiB/s rd, 0 B/s wr, 108 op/s 2024-09-16T08:08:29.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:08:29 smithi086 bash[24289]: cluster 2024-09-16T08:08:28.109031+0000 mgr.a (mgr.14373) 6548 : cluster [DBG] pgmap v4541: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 66 KiB/s rd, 0 B/s wr, 108 op/s 2024-09-16T08:08:29.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:08:29 smithi047 bash[22744]: cluster 2024-09-16T08:08:28.109031+0000 mgr.a (mgr.14373) 6548 : cluster [DBG] pgmap v4541: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 66 KiB/s rd, 0 B/s wr, 108 op/s 2024-09-16T08:08:30.289 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:08:30.289 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:08:30.289 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:08:30.289 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:08:30.289 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:08:31.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:08:31 smithi157 bash[24585]: audit 2024-09-16T08:08:29.839859+0000 mgr.a (mgr.14373) 6549 : audit [DBG] from='client.149655 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:08:31.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:08:31 smithi157 bash[24585]: cluster 2024-09-16T08:08:30.109607+0000 mgr.a (mgr.14373) 6550 : cluster [DBG] pgmap v4542: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:08:31.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:08:31 smithi086 bash[24289]: audit 2024-09-16T08:08:29.839859+0000 mgr.a (mgr.14373) 6549 : audit [DBG] from='client.149655 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:08:31.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:08:31 smithi086 bash[24289]: cluster 2024-09-16T08:08:30.109607+0000 mgr.a (mgr.14373) 6550 : cluster [DBG] pgmap v4542: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:08:31.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:08:31 smithi047 bash[22744]: audit 2024-09-16T08:08:29.839859+0000 mgr.a (mgr.14373) 6549 : audit [DBG] from='client.149655 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:08:31.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:08:31 smithi047 bash[22744]: cluster 2024-09-16T08:08:30.109607+0000 mgr.a (mgr.14373) 6550 : cluster [DBG] pgmap v4542: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:08:33.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:08:33 smithi157 bash[24585]: cluster 2024-09-16T08:08:32.111936+0000 mgr.a (mgr.14373) 6551 : cluster [DBG] pgmap v4543: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:08:33.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:08:33 smithi086 bash[24289]: cluster 2024-09-16T08:08:32.111936+0000 mgr.a (mgr.14373) 6551 : cluster [DBG] pgmap v4543: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:08:33.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:08:33 smithi047 bash[22744]: cluster 2024-09-16T08:08:32.111936+0000 mgr.a (mgr.14373) 6551 : cluster [DBG] pgmap v4543: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:08:35.290 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:08:35.291 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:08:35.291 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:08:35.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:08:35 smithi157 bash[24585]: cluster 2024-09-16T08:08:34.112697+0000 mgr.a (mgr.14373) 6552 : cluster [DBG] pgmap v4544: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:08:35.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:08:35 smithi086 bash[24289]: cluster 2024-09-16T08:08:34.112697+0000 mgr.a (mgr.14373) 6552 : cluster [DBG] pgmap v4544: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:08:35.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:08:35 smithi047 bash[22744]: cluster 2024-09-16T08:08:34.112697+0000 mgr.a (mgr.14373) 6552 : cluster [DBG] pgmap v4544: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:08:36.062 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:08:36.062 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:08:36.062 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:08:36.063 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:08:36.063 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:08:37.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:08:37 smithi157 bash[24585]: audit 2024-09-16T08:08:35.630965+0000 mgr.a (mgr.14373) 6553 : audit [DBG] from='client.149730 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:08:37.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:08:37 smithi157 bash[24585]: cluster 2024-09-16T08:08:36.113507+0000 mgr.a (mgr.14373) 6554 : cluster [DBG] pgmap v4545: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:08:37.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:08:37 smithi086 bash[24289]: audit 2024-09-16T08:08:35.630965+0000 mgr.a (mgr.14373) 6553 : audit [DBG] from='client.149730 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:08:37.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:08:37 smithi086 bash[24289]: cluster 2024-09-16T08:08:36.113507+0000 mgr.a (mgr.14373) 6554 : cluster [DBG] pgmap v4545: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:08:37.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:08:37 smithi047 bash[22744]: audit 2024-09-16T08:08:35.630965+0000 mgr.a (mgr.14373) 6553 : audit [DBG] from='client.149730 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:08:37.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:08:37 smithi047 bash[22744]: cluster 2024-09-16T08:08:36.113507+0000 mgr.a (mgr.14373) 6554 : cluster [DBG] pgmap v4545: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:08:38.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:08:38 smithi157 bash[24585]: audit 2024-09-16T08:08:37.379727+0000 mon.b (mon.2) 626 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T08:08:38.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:08:38 smithi086 bash[24289]: audit 2024-09-16T08:08:37.379727+0000 mon.b (mon.2) 626 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T08:08:38.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:08:38 smithi047 bash[22744]: audit 2024-09-16T08:08:37.379727+0000 mon.b (mon.2) 626 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T08:08:39.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:08:39 smithi157 bash[24585]: cluster 2024-09-16T08:08:38.115340+0000 mgr.a (mgr.14373) 6555 : cluster [DBG] pgmap v4546: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:08:39.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:08:39 smithi086 bash[24289]: cluster 2024-09-16T08:08:38.115340+0000 mgr.a (mgr.14373) 6555 : cluster [DBG] pgmap v4546: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:08:39.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:08:39 smithi047 bash[22744]: cluster 2024-09-16T08:08:38.115340+0000 mgr.a (mgr.14373) 6555 : cluster [DBG] pgmap v4546: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:08:41.064 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:08:41.065 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:08:41.065 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:08:41.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:08:41 smithi157 bash[24585]: cluster 2024-09-16T08:08:40.116131+0000 mgr.a (mgr.14373) 6556 : cluster [DBG] pgmap v4547: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:08:41.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:08:41 smithi086 bash[24289]: cluster 2024-09-16T08:08:40.116131+0000 mgr.a (mgr.14373) 6556 : cluster [DBG] pgmap v4547: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:08:41.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:08:41 smithi047 bash[22744]: cluster 2024-09-16T08:08:40.116131+0000 mgr.a (mgr.14373) 6556 : cluster [DBG] pgmap v4547: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:08:41.814 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:08:41.814 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:08:41.814 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:08:41.814 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:08:41.814 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:08:43.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:08:43 smithi157 bash[24585]: audit 2024-09-16T08:08:41.400806+0000 mgr.a (mgr.14373) 6557 : audit [DBG] from='client.149808 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:08:43.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:08:43 smithi157 bash[24585]: cluster 2024-09-16T08:08:42.119047+0000 mgr.a (mgr.14373) 6558 : cluster [DBG] pgmap v4548: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:08:43.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:08:43 smithi086 bash[24289]: audit 2024-09-16T08:08:41.400806+0000 mgr.a (mgr.14373) 6557 : audit [DBG] from='client.149808 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:08:43.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:08:43 smithi086 bash[24289]: cluster 2024-09-16T08:08:42.119047+0000 mgr.a (mgr.14373) 6558 : cluster [DBG] pgmap v4548: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:08:43.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:08:43 smithi047 bash[22744]: audit 2024-09-16T08:08:41.400806+0000 mgr.a (mgr.14373) 6557 : audit [DBG] from='client.149808 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:08:43.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:08:43 smithi047 bash[22744]: cluster 2024-09-16T08:08:42.119047+0000 mgr.a (mgr.14373) 6558 : cluster [DBG] pgmap v4548: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:08:45.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:08:45 smithi157 bash[24585]: cluster 2024-09-16T08:08:44.119784+0000 mgr.a (mgr.14373) 6559 : cluster [DBG] pgmap v4549: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:08:45.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:08:45 smithi086 bash[24289]: cluster 2024-09-16T08:08:44.119784+0000 mgr.a (mgr.14373) 6559 : cluster [DBG] pgmap v4549: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:08:45.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:08:45 smithi047 bash[22744]: cluster 2024-09-16T08:08:44.119784+0000 mgr.a (mgr.14373) 6559 : cluster [DBG] pgmap v4549: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:08:46.815 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:08:46.816 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:08:46.816 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:08:47.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:08:47 smithi157 bash[24585]: cluster 2024-09-16T08:08:46.120542+0000 mgr.a (mgr.14373) 6560 : cluster [DBG] pgmap v4550: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T08:08:47.557 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:08:47.557 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:08:47.558 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:08:47.558 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:08:47.558 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:08:47.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:08:47 smithi086 bash[24289]: cluster 2024-09-16T08:08:46.120542+0000 mgr.a (mgr.14373) 6560 : cluster [DBG] pgmap v4550: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T08:08:47.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:08:47 smithi047 bash[22744]: cluster 2024-09-16T08:08:46.120542+0000 mgr.a (mgr.14373) 6560 : cluster [DBG] pgmap v4550: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T08:08:48.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:08:48 smithi157 bash[24585]: audit 2024-09-16T08:08:47.149290+0000 mgr.a (mgr.14373) 6561 : audit [DBG] from='client.149886 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:08:48.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:08:48 smithi157 bash[24585]: audit 2024-09-16T08:08:47.813149+0000 mon.a (mon.0) 955 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:08:48.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:08:48 smithi157 bash[24585]: audit 2024-09-16T08:08:47.823602+0000 mon.a (mon.0) 956 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:08:48.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:08:48 smithi157 bash[24585]: audit 2024-09-16T08:08:47.824964+0000 mon.b (mon.2) 627 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T08:08:48.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:08:48 smithi157 bash[24585]: audit 2024-09-16T08:08:47.827089+0000 mon.b (mon.2) 628 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T08:08:48.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:08:48 smithi157 bash[24585]: audit 2024-09-16T08:08:47.840115+0000 mon.a (mon.0) 957 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:08:48.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:08:48 smithi157 bash[24585]: audit 2024-09-16T08:08:47.843875+0000 mon.b (mon.2) 629 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:08:48.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:08:48 smithi086 bash[24289]: audit 2024-09-16T08:08:47.149290+0000 mgr.a (mgr.14373) 6561 : audit [DBG] from='client.149886 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:08:48.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:08:48 smithi086 bash[24289]: audit 2024-09-16T08:08:47.813149+0000 mon.a (mon.0) 955 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:08:48.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:08:48 smithi086 bash[24289]: audit 2024-09-16T08:08:47.823602+0000 mon.a (mon.0) 956 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:08:48.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:08:48 smithi086 bash[24289]: audit 2024-09-16T08:08:47.824964+0000 mon.b (mon.2) 627 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T08:08:48.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:08:48 smithi086 bash[24289]: audit 2024-09-16T08:08:47.827089+0000 mon.b (mon.2) 628 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T08:08:48.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:08:48 smithi086 bash[24289]: audit 2024-09-16T08:08:47.840115+0000 mon.a (mon.0) 957 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:08:48.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:08:48 smithi086 bash[24289]: audit 2024-09-16T08:08:47.843875+0000 mon.b (mon.2) 629 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:08:48.574 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:08:48 smithi047 bash[22744]: audit 2024-09-16T08:08:47.149290+0000 mgr.a (mgr.14373) 6561 : audit [DBG] from='client.149886 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:08:48.574 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:08:48 smithi047 bash[22744]: audit 2024-09-16T08:08:47.813149+0000 mon.a (mon.0) 955 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:08:48.574 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:08:48 smithi047 bash[22744]: audit 2024-09-16T08:08:47.823602+0000 mon.a (mon.0) 956 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:08:48.574 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:08:48 smithi047 bash[22744]: audit 2024-09-16T08:08:47.824964+0000 mon.b (mon.2) 627 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T08:08:48.574 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:08:48 smithi047 bash[22744]: audit 2024-09-16T08:08:47.827089+0000 mon.b (mon.2) 628 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T08:08:48.575 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:08:48 smithi047 bash[22744]: audit 2024-09-16T08:08:47.840115+0000 mon.a (mon.0) 957 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:08:48.575 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:08:48 smithi047 bash[22744]: audit 2024-09-16T08:08:47.843875+0000 mon.b (mon.2) 629 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:08:48.837 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 08:08:48 smithi047 bash[22994]: debug 2024-09-16T08:08:48.575+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T08:08:48.838 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 08:08:48 smithi047 bash[22994]: debug 2024-09-16T08:08:48.575+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T08:08:49.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:08:49 smithi157 bash[24585]: audit 2024-09-16T08:08:47.848363+0000 mgr.a (mgr.14373) 6562 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:08:49.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:08:49 smithi157 bash[24585]: cluster 2024-09-16T08:08:48.122039+0000 mgr.a (mgr.14373) 6563 : cluster [DBG] pgmap v4551: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:08:49.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:08:49 smithi086 bash[24289]: audit 2024-09-16T08:08:47.848363+0000 mgr.a (mgr.14373) 6562 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:08:49.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:08:49 smithi086 bash[24289]: cluster 2024-09-16T08:08:48.122039+0000 mgr.a (mgr.14373) 6563 : cluster [DBG] pgmap v4551: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:08:49.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:08:49 smithi047 bash[22744]: audit 2024-09-16T08:08:47.848363+0000 mgr.a (mgr.14373) 6562 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:08:49.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:08:49 smithi047 bash[22744]: cluster 2024-09-16T08:08:48.122039+0000 mgr.a (mgr.14373) 6563 : cluster [DBG] pgmap v4551: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:08:50.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:08:50 smithi157 bash[24585]: audit 2024-09-16T08:08:48.578349+0000 mgr.a (mgr.14373) 6564 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T08:08:50.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:08:50 smithi157 bash[24585]: cephadm 2024-09-16T08:08:48.580526+0000 mgr.a (mgr.14373) 6565 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T08:08:50.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:08:50 smithi086 bash[24289]: audit 2024-09-16T08:08:48.578349+0000 mgr.a (mgr.14373) 6564 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T08:08:50.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:08:50 smithi086 bash[24289]: cephadm 2024-09-16T08:08:48.580526+0000 mgr.a (mgr.14373) 6565 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T08:08:50.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:08:50 smithi047 bash[22744]: audit 2024-09-16T08:08:48.578349+0000 mgr.a (mgr.14373) 6564 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T08:08:50.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:08:50 smithi047 bash[22744]: cephadm 2024-09-16T08:08:48.580526+0000 mgr.a (mgr.14373) 6565 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T08:08:51.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:08:51 smithi157 bash[24585]: cluster 2024-09-16T08:08:50.122968+0000 mgr.a (mgr.14373) 6566 : cluster [DBG] pgmap v4552: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:08:51.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:08:51 smithi086 bash[24289]: cluster 2024-09-16T08:08:50.122968+0000 mgr.a (mgr.14373) 6566 : cluster [DBG] pgmap v4552: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:08:51.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:08:51 smithi047 bash[22744]: cluster 2024-09-16T08:08:50.122968+0000 mgr.a (mgr.14373) 6566 : cluster [DBG] pgmap v4552: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:08:52.559 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:08:52.560 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:08:52.560 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:08:52.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:08:52 smithi157 bash[24585]: cluster 2024-09-16T08:08:52.125166+0000 mgr.a (mgr.14373) 6567 : cluster [DBG] pgmap v4553: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:08:52.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:08:52 smithi086 bash[24289]: cluster 2024-09-16T08:08:52.125166+0000 mgr.a (mgr.14373) 6567 : cluster [DBG] pgmap v4553: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:08:52.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:08:52 smithi047 bash[22744]: cluster 2024-09-16T08:08:52.125166+0000 mgr.a (mgr.14373) 6567 : cluster [DBG] pgmap v4553: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:08:53.340 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:08:53.340 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:08:53.340 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:08:53.341 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:08:53.341 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:08:53.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:08:53 smithi157 bash[24585]: audit 2024-09-16T08:08:52.897332+0000 mgr.a (mgr.14373) 6568 : audit [DBG] from='client.150072 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:08:53.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:08:53 smithi086 bash[24289]: audit 2024-09-16T08:08:52.897332+0000 mgr.a (mgr.14373) 6568 : audit [DBG] from='client.150072 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:08:53.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:08:53 smithi047 bash[22744]: audit 2024-09-16T08:08:52.897332+0000 mgr.a (mgr.14373) 6568 : audit [DBG] from='client.150072 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:08:54.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:08:54 smithi157 bash[24585]: cluster 2024-09-16T08:08:54.126130+0000 mgr.a (mgr.14373) 6569 : cluster [DBG] pgmap v4554: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:08:54.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:08:54 smithi086 bash[24289]: cluster 2024-09-16T08:08:54.126130+0000 mgr.a (mgr.14373) 6569 : cluster [DBG] pgmap v4554: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:08:54.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:08:54 smithi047 bash[22744]: cluster 2024-09-16T08:08:54.126130+0000 mgr.a (mgr.14373) 6569 : cluster [DBG] pgmap v4554: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:08:57.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:08:57 smithi157 bash[24585]: cluster 2024-09-16T08:08:56.126941+0000 mgr.a (mgr.14373) 6570 : cluster [DBG] pgmap v4555: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:08:57.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:08:57 smithi086 bash[24289]: cluster 2024-09-16T08:08:56.126941+0000 mgr.a (mgr.14373) 6570 : cluster [DBG] pgmap v4555: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:08:57.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:08:57 smithi047 bash[22744]: cluster 2024-09-16T08:08:56.126941+0000 mgr.a (mgr.14373) 6570 : cluster [DBG] pgmap v4555: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:08:58.344 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:08:58.344 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:08:58.344 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:08:59.097 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:08:59.097 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:08:59.097 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:08:59.097 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:08:59.097 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:08:59.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:08:59 smithi157 bash[24585]: cluster 2024-09-16T08:08:58.129156+0000 mgr.a (mgr.14373) 6571 : cluster [DBG] pgmap v4556: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:08:59.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:08:59 smithi086 bash[24289]: cluster 2024-09-16T08:08:58.129156+0000 mgr.a (mgr.14373) 6571 : cluster [DBG] pgmap v4556: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:08:59.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:08:59 smithi047 bash[22744]: cluster 2024-09-16T08:08:58.129156+0000 mgr.a (mgr.14373) 6571 : cluster [DBG] pgmap v4556: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:09:00.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:09:00 smithi157 bash[24585]: audit 2024-09-16T08:08:58.675640+0000 mgr.a (mgr.14373) 6572 : audit [DBG] from='client.150147 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:09:00.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:09:00 smithi086 bash[24289]: audit 2024-09-16T08:08:58.675640+0000 mgr.a (mgr.14373) 6572 : audit [DBG] from='client.150147 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:09:00.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:09:00 smithi047 bash[22744]: audit 2024-09-16T08:08:58.675640+0000 mgr.a (mgr.14373) 6572 : audit [DBG] from='client.150147 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:09:01.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:09:01 smithi157 bash[24585]: cluster 2024-09-16T08:09:00.130124+0000 mgr.a (mgr.14373) 6573 : cluster [DBG] pgmap v4557: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:09:01.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:09:01 smithi086 bash[24289]: cluster 2024-09-16T08:09:00.130124+0000 mgr.a (mgr.14373) 6573 : cluster [DBG] pgmap v4557: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:09:01.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:09:01 smithi047 bash[22744]: cluster 2024-09-16T08:09:00.130124+0000 mgr.a (mgr.14373) 6573 : cluster [DBG] pgmap v4557: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:09:03.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:09:03 smithi157 bash[24585]: cluster 2024-09-16T08:09:02.132315+0000 mgr.a (mgr.14373) 6574 : cluster [DBG] pgmap v4558: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:09:03.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:09:03 smithi086 bash[24289]: cluster 2024-09-16T08:09:02.132315+0000 mgr.a (mgr.14373) 6574 : cluster [DBG] pgmap v4558: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:09:03.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:09:03 smithi047 bash[22744]: cluster 2024-09-16T08:09:02.132315+0000 mgr.a (mgr.14373) 6574 : cluster [DBG] pgmap v4558: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:09:04.098 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:09:04.099 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:09:04.099 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:09:04.874 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:09:04.874 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:09:04.874 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:09:04.874 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:09:04.874 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:09:05.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:09:05 smithi157 bash[24585]: cluster 2024-09-16T08:09:04.133098+0000 mgr.a (mgr.14373) 6575 : cluster [DBG] pgmap v4559: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:09:05.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:09:05 smithi086 bash[24289]: cluster 2024-09-16T08:09:04.133098+0000 mgr.a (mgr.14373) 6575 : cluster [DBG] pgmap v4559: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:09:05.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:09:05 smithi047 bash[22744]: cluster 2024-09-16T08:09:04.133098+0000 mgr.a (mgr.14373) 6575 : cluster [DBG] pgmap v4559: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:09:06.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:09:06 smithi157 bash[24585]: audit 2024-09-16T08:09:04.438767+0000 mgr.a (mgr.14373) 6576 : audit [DBG] from='client.150219 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:09:06.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:09:06 smithi086 bash[24289]: audit 2024-09-16T08:09:04.438767+0000 mgr.a (mgr.14373) 6576 : audit [DBG] from='client.150219 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:09:06.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:09:06 smithi047 bash[22744]: audit 2024-09-16T08:09:04.438767+0000 mgr.a (mgr.14373) 6576 : audit [DBG] from='client.150219 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:09:07.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:09:07 smithi157 bash[24585]: cluster 2024-09-16T08:09:06.134097+0000 mgr.a (mgr.14373) 6577 : cluster [DBG] pgmap v4560: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:09:07.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:09:07 smithi086 bash[24289]: cluster 2024-09-16T08:09:06.134097+0000 mgr.a (mgr.14373) 6577 : cluster [DBG] pgmap v4560: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:09:07.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:09:07 smithi047 bash[22744]: cluster 2024-09-16T08:09:06.134097+0000 mgr.a (mgr.14373) 6577 : cluster [DBG] pgmap v4560: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:09:09.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:09:09 smithi157 bash[24585]: cluster 2024-09-16T08:09:08.136330+0000 mgr.a (mgr.14373) 6578 : cluster [DBG] pgmap v4561: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:09:09.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:09:09 smithi086 bash[24289]: cluster 2024-09-16T08:09:08.136330+0000 mgr.a (mgr.14373) 6578 : cluster [DBG] pgmap v4561: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:09:09.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:09:09 smithi047 bash[22744]: cluster 2024-09-16T08:09:08.136330+0000 mgr.a (mgr.14373) 6578 : cluster [DBG] pgmap v4561: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:09:09.875 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:09:09.876 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:09:09.876 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:09:10.647 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:09:10.648 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:09:10.648 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:09:10.648 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:09:10.648 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:09:11.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:09:11 smithi157 bash[24585]: cluster 2024-09-16T08:09:10.137057+0000 mgr.a (mgr.14373) 6579 : cluster [DBG] pgmap v4562: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:09:11.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:09:11 smithi157 bash[24585]: audit 2024-09-16T08:09:10.219885+0000 mgr.a (mgr.14373) 6580 : audit [DBG] from='client.150294 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:09:11.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:09:11 smithi086 bash[24289]: cluster 2024-09-16T08:09:10.137057+0000 mgr.a (mgr.14373) 6579 : cluster [DBG] pgmap v4562: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:09:11.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:09:11 smithi086 bash[24289]: audit 2024-09-16T08:09:10.219885+0000 mgr.a (mgr.14373) 6580 : audit [DBG] from='client.150294 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:09:11.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:09:11 smithi047 bash[22744]: cluster 2024-09-16T08:09:10.137057+0000 mgr.a (mgr.14373) 6579 : cluster [DBG] pgmap v4562: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:09:11.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:09:11 smithi047 bash[22744]: audit 2024-09-16T08:09:10.219885+0000 mgr.a (mgr.14373) 6580 : audit [DBG] from='client.150294 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:09:13.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:09:13 smithi157 bash[24585]: cluster 2024-09-16T08:09:12.139352+0000 mgr.a (mgr.14373) 6581 : cluster [DBG] pgmap v4563: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:09:13.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:09:13 smithi086 bash[24289]: cluster 2024-09-16T08:09:12.139352+0000 mgr.a (mgr.14373) 6581 : cluster [DBG] pgmap v4563: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:09:13.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:09:13 smithi047 bash[22744]: cluster 2024-09-16T08:09:12.139352+0000 mgr.a (mgr.14373) 6581 : cluster [DBG] pgmap v4563: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:09:15.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:09:15 smithi157 bash[24585]: cluster 2024-09-16T08:09:14.140133+0000 mgr.a (mgr.14373) 6582 : cluster [DBG] pgmap v4564: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:09:15.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:09:15 smithi086 bash[24289]: cluster 2024-09-16T08:09:14.140133+0000 mgr.a (mgr.14373) 6582 : cluster [DBG] pgmap v4564: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:09:15.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:09:15 smithi047 bash[22744]: cluster 2024-09-16T08:09:14.140133+0000 mgr.a (mgr.14373) 6582 : cluster [DBG] pgmap v4564: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:09:15.649 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:09:15.650 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:09:15.650 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:09:16.393 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:09:16.393 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:09:16.394 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:09:16.394 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:09:16.394 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:09:17.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:09:17 smithi157 bash[24585]: audit 2024-09-16T08:09:15.984222+0000 mgr.a (mgr.14373) 6583 : audit [DBG] from='client.150369 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:09:17.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:09:17 smithi157 bash[24585]: cluster 2024-09-16T08:09:16.140722+0000 mgr.a (mgr.14373) 6584 : cluster [DBG] pgmap v4565: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:09:17.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:09:17 smithi086 bash[24289]: audit 2024-09-16T08:09:15.984222+0000 mgr.a (mgr.14373) 6583 : audit [DBG] from='client.150369 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:09:17.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:09:17 smithi086 bash[24289]: cluster 2024-09-16T08:09:16.140722+0000 mgr.a (mgr.14373) 6584 : cluster [DBG] pgmap v4565: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:09:17.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:09:17 smithi047 bash[22744]: audit 2024-09-16T08:09:15.984222+0000 mgr.a (mgr.14373) 6583 : audit [DBG] from='client.150369 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:09:17.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:09:17 smithi047 bash[22744]: cluster 2024-09-16T08:09:16.140722+0000 mgr.a (mgr.14373) 6584 : cluster [DBG] pgmap v4565: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:09:19.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:09:19 smithi157 bash[24585]: cluster 2024-09-16T08:09:18.143211+0000 mgr.a (mgr.14373) 6585 : cluster [DBG] pgmap v4566: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-16T08:09:19.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:09:19 smithi086 bash[24289]: cluster 2024-09-16T08:09:18.143211+0000 mgr.a (mgr.14373) 6585 : cluster [DBG] pgmap v4566: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-16T08:09:19.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:09:19 smithi047 bash[22744]: cluster 2024-09-16T08:09:18.143211+0000 mgr.a (mgr.14373) 6585 : cluster [DBG] pgmap v4566: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-16T08:09:21.395 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:09:21.396 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:09:21.396 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:09:21.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:09:21 smithi157 bash[24585]: cluster 2024-09-16T08:09:20.144181+0000 mgr.a (mgr.14373) 6586 : cluster [DBG] pgmap v4567: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T08:09:21.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:09:21 smithi086 bash[24289]: cluster 2024-09-16T08:09:20.144181+0000 mgr.a (mgr.14373) 6586 : cluster [DBG] pgmap v4567: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T08:09:21.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:09:21 smithi047 bash[22744]: cluster 2024-09-16T08:09:20.144181+0000 mgr.a (mgr.14373) 6586 : cluster [DBG] pgmap v4567: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T08:09:22.137 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:09:22.137 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:09:22.137 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:09:22.137 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:09:22.137 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:09:23.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:09:23 smithi157 bash[24585]: audit 2024-09-16T08:09:21.723545+0000 mgr.a (mgr.14373) 6587 : audit [DBG] from='client.150444 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:09:23.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:09:23 smithi157 bash[24585]: cluster 2024-09-16T08:09:22.145383+0000 mgr.a (mgr.14373) 6588 : cluster [DBG] pgmap v4568: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:09:23.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:09:23 smithi086 bash[24289]: audit 2024-09-16T08:09:21.723545+0000 mgr.a (mgr.14373) 6587 : audit [DBG] from='client.150444 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:09:23.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:09:23 smithi086 bash[24289]: cluster 2024-09-16T08:09:22.145383+0000 mgr.a (mgr.14373) 6588 : cluster [DBG] pgmap v4568: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:09:23.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:09:23 smithi047 bash[22744]: audit 2024-09-16T08:09:21.723545+0000 mgr.a (mgr.14373) 6587 : audit [DBG] from='client.150444 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:09:23.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:09:23 smithi047 bash[22744]: cluster 2024-09-16T08:09:22.145383+0000 mgr.a (mgr.14373) 6588 : cluster [DBG] pgmap v4568: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:09:25.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:09:25 smithi157 bash[24585]: cluster 2024-09-16T08:09:24.146108+0000 mgr.a (mgr.14373) 6589 : cluster [DBG] pgmap v4569: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T08:09:25.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:09:25 smithi086 bash[24289]: cluster 2024-09-16T08:09:24.146108+0000 mgr.a (mgr.14373) 6589 : cluster [DBG] pgmap v4569: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T08:09:25.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:09:25 smithi047 bash[22744]: cluster 2024-09-16T08:09:24.146108+0000 mgr.a (mgr.14373) 6589 : cluster [DBG] pgmap v4569: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T08:09:26.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:09:26 smithi157 bash[24585]: cluster 2024-09-16T08:09:26.146896+0000 mgr.a (mgr.14373) 6590 : cluster [DBG] pgmap v4570: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T08:09:26.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:09:26 smithi086 bash[24289]: cluster 2024-09-16T08:09:26.146896+0000 mgr.a (mgr.14373) 6590 : cluster [DBG] pgmap v4570: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T08:09:26.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:09:26 smithi047 bash[22744]: cluster 2024-09-16T08:09:26.146896+0000 mgr.a (mgr.14373) 6590 : cluster [DBG] pgmap v4570: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T08:09:27.138 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:09:27.139 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:09:27.139 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:09:27.890 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:09:27.891 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:09:27.891 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:09:27.891 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:09:27.891 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:09:29.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:09:29 smithi157 bash[24585]: audit 2024-09-16T08:09:27.475410+0000 mgr.a (mgr.14373) 6591 : audit [DBG] from='client.150519 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:09:29.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:09:29 smithi157 bash[24585]: cluster 2024-09-16T08:09:28.149686+0000 mgr.a (mgr.14373) 6592 : cluster [DBG] pgmap v4571: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:09:29.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:09:29 smithi086 bash[24289]: audit 2024-09-16T08:09:27.475410+0000 mgr.a (mgr.14373) 6591 : audit [DBG] from='client.150519 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:09:29.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:09:29 smithi086 bash[24289]: cluster 2024-09-16T08:09:28.149686+0000 mgr.a (mgr.14373) 6592 : cluster [DBG] pgmap v4571: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:09:29.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:09:29 smithi047 bash[22744]: audit 2024-09-16T08:09:27.475410+0000 mgr.a (mgr.14373) 6591 : audit [DBG] from='client.150519 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:09:29.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:09:29 smithi047 bash[22744]: cluster 2024-09-16T08:09:28.149686+0000 mgr.a (mgr.14373) 6592 : cluster [DBG] pgmap v4571: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:09:31.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:09:31 smithi157 bash[24585]: cluster 2024-09-16T08:09:30.150470+0000 mgr.a (mgr.14373) 6593 : cluster [DBG] pgmap v4572: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-16T08:09:31.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:09:31 smithi086 bash[24289]: cluster 2024-09-16T08:09:30.150470+0000 mgr.a (mgr.14373) 6593 : cluster [DBG] pgmap v4572: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-16T08:09:31.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:09:31 smithi047 bash[22744]: cluster 2024-09-16T08:09:30.150470+0000 mgr.a (mgr.14373) 6593 : cluster [DBG] pgmap v4572: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-16T08:09:32.892 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:09:32.893 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:09:32.893 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:09:33.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:09:33 smithi157 bash[24585]: cluster 2024-09-16T08:09:32.152392+0000 mgr.a (mgr.14373) 6594 : cluster [DBG] pgmap v4573: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-16T08:09:33.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:09:33 smithi086 bash[24289]: cluster 2024-09-16T08:09:32.152392+0000 mgr.a (mgr.14373) 6594 : cluster [DBG] pgmap v4573: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-16T08:09:33.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:09:33 smithi047 bash[22744]: cluster 2024-09-16T08:09:32.152392+0000 mgr.a (mgr.14373) 6594 : cluster [DBG] pgmap v4573: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-16T08:09:33.643 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:09:33.643 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:09:33.644 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:09:33.644 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:09:33.644 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:09:34.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:09:34 smithi157 bash[24585]: audit 2024-09-16T08:09:33.227670+0000 mgr.a (mgr.14373) 6595 : audit [DBG] from='client.150597 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:09:34.739 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:09:34 smithi047 bash[22744]: audit 2024-09-16T08:09:33.227670+0000 mgr.a (mgr.14373) 6595 : audit [DBG] from='client.150597 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:09:34.740 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:09:34 smithi086 bash[24289]: audit 2024-09-16T08:09:33.227670+0000 mgr.a (mgr.14373) 6595 : audit [DBG] from='client.150597 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:09:35.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:09:35 smithi157 bash[24585]: cluster 2024-09-16T08:09:34.153343+0000 mgr.a (mgr.14373) 6596 : cluster [DBG] pgmap v4574: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:09:35.566 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:09:35 smithi086 bash[24289]: cluster 2024-09-16T08:09:34.153343+0000 mgr.a (mgr.14373) 6596 : cluster [DBG] pgmap v4574: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:09:35.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:09:35 smithi047 bash[22744]: cluster 2024-09-16T08:09:34.153343+0000 mgr.a (mgr.14373) 6596 : cluster [DBG] pgmap v4574: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:09:37.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:09:37 smithi157 bash[24585]: cluster 2024-09-16T08:09:36.154158+0000 mgr.a (mgr.14373) 6597 : cluster [DBG] pgmap v4575: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:09:37.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:09:37 smithi086 bash[24289]: cluster 2024-09-16T08:09:36.154158+0000 mgr.a (mgr.14373) 6597 : cluster [DBG] pgmap v4575: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:09:37.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:09:37 smithi047 bash[22744]: cluster 2024-09-16T08:09:36.154158+0000 mgr.a (mgr.14373) 6597 : cluster [DBG] pgmap v4575: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:09:38.645 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:09:38.646 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:09:38.646 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:09:39.434 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:09:39.434 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:09:39.435 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:09:39.435 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:09:39.435 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:09:39.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:09:39 smithi157 bash[24585]: cluster 2024-09-16T08:09:38.156385+0000 mgr.a (mgr.14373) 6598 : cluster [DBG] pgmap v4576: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:09:39.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:09:39 smithi086 bash[24289]: cluster 2024-09-16T08:09:38.156385+0000 mgr.a (mgr.14373) 6598 : cluster [DBG] pgmap v4576: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:09:39.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:09:39 smithi047 bash[22744]: cluster 2024-09-16T08:09:38.156385+0000 mgr.a (mgr.14373) 6598 : cluster [DBG] pgmap v4576: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:09:40.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:09:40 smithi157 bash[24585]: audit 2024-09-16T08:09:38.985569+0000 mgr.a (mgr.14373) 6599 : audit [DBG] from='client.150669 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:09:40.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:09:40 smithi086 bash[24289]: audit 2024-09-16T08:09:38.985569+0000 mgr.a (mgr.14373) 6599 : audit [DBG] from='client.150669 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:09:40.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:09:40 smithi047 bash[22744]: audit 2024-09-16T08:09:38.985569+0000 mgr.a (mgr.14373) 6599 : audit [DBG] from='client.150669 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:09:41.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:09:41 smithi157 bash[24585]: cluster 2024-09-16T08:09:40.157392+0000 mgr.a (mgr.14373) 6600 : cluster [DBG] pgmap v4577: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:09:41.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:09:41 smithi086 bash[24289]: cluster 2024-09-16T08:09:40.157392+0000 mgr.a (mgr.14373) 6600 : cluster [DBG] pgmap v4577: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:09:41.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:09:41 smithi047 bash[22744]: cluster 2024-09-16T08:09:40.157392+0000 mgr.a (mgr.14373) 6600 : cluster [DBG] pgmap v4577: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:09:43.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:09:43 smithi157 bash[24585]: cluster 2024-09-16T08:09:42.159593+0000 mgr.a (mgr.14373) 6601 : cluster [DBG] pgmap v4578: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:09:43.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:09:43 smithi086 bash[24289]: cluster 2024-09-16T08:09:42.159593+0000 mgr.a (mgr.14373) 6601 : cluster [DBG] pgmap v4578: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:09:43.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:09:43 smithi047 bash[22744]: cluster 2024-09-16T08:09:42.159593+0000 mgr.a (mgr.14373) 6601 : cluster [DBG] pgmap v4578: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:09:44.435 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:09:44.436 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:09:44.436 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:09:45.174 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:09:45.174 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:09:45.174 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:09:45.174 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:09:45.175 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:09:45.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:09:45 smithi157 bash[24585]: cluster 2024-09-16T08:09:44.160329+0000 mgr.a (mgr.14373) 6602 : cluster [DBG] pgmap v4579: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:09:45.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:09:45 smithi086 bash[24289]: cluster 2024-09-16T08:09:44.160329+0000 mgr.a (mgr.14373) 6602 : cluster [DBG] pgmap v4579: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:09:45.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:09:45 smithi047 bash[22744]: cluster 2024-09-16T08:09:44.160329+0000 mgr.a (mgr.14373) 6602 : cluster [DBG] pgmap v4579: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:09:46.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:09:46 smithi157 bash[24585]: audit 2024-09-16T08:09:44.771528+0000 mgr.a (mgr.14373) 6603 : audit [DBG] from='client.150741 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:09:46.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:09:46 smithi086 bash[24289]: audit 2024-09-16T08:09:44.771528+0000 mgr.a (mgr.14373) 6603 : audit [DBG] from='client.150741 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:09:46.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:09:46 smithi047 bash[22744]: audit 2024-09-16T08:09:44.771528+0000 mgr.a (mgr.14373) 6603 : audit [DBG] from='client.150741 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:09:47.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:09:47 smithi157 bash[24585]: cluster 2024-09-16T08:09:46.161190+0000 mgr.a (mgr.14373) 6604 : cluster [DBG] pgmap v4580: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:09:47.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:09:47 smithi086 bash[24289]: cluster 2024-09-16T08:09:46.161190+0000 mgr.a (mgr.14373) 6604 : cluster [DBG] pgmap v4580: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:09:47.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:09:47 smithi047 bash[22744]: cluster 2024-09-16T08:09:46.161190+0000 mgr.a (mgr.14373) 6604 : cluster [DBG] pgmap v4580: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:09:49.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:09:49 smithi157 bash[24585]: cluster 2024-09-16T08:09:48.163436+0000 mgr.a (mgr.14373) 6605 : cluster [DBG] pgmap v4581: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:09:49.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:09:49 smithi157 bash[24585]: audit 2024-09-16T08:09:48.635646+0000 mon.b (mon.2) 630 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T08:09:49.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:09:49 smithi157 bash[24585]: audit 2024-09-16T08:09:49.262888+0000 mon.a (mon.0) 958 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:09:49.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:09:49 smithi086 bash[24289]: cluster 2024-09-16T08:09:48.163436+0000 mgr.a (mgr.14373) 6605 : cluster [DBG] pgmap v4581: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:09:49.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:09:49 smithi086 bash[24289]: audit 2024-09-16T08:09:48.635646+0000 mon.b (mon.2) 630 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T08:09:49.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:09:49 smithi086 bash[24289]: audit 2024-09-16T08:09:49.262888+0000 mon.a (mon.0) 958 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:09:49.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:09:49 smithi047 bash[22744]: cluster 2024-09-16T08:09:48.163436+0000 mgr.a (mgr.14373) 6605 : cluster [DBG] pgmap v4581: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:09:49.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:09:49 smithi047 bash[22744]: audit 2024-09-16T08:09:48.635646+0000 mon.b (mon.2) 630 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T08:09:49.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:09:49 smithi047 bash[22744]: audit 2024-09-16T08:09:49.262888+0000 mon.a (mon.0) 958 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:09:50.175 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:09:50.176 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:09:50.176 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:09:50.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:09:50 smithi157 bash[24585]: audit 2024-09-16T08:09:49.269656+0000 mon.a (mon.0) 959 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:09:50.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:09:50 smithi086 bash[24289]: audit 2024-09-16T08:09:49.269656+0000 mon.a (mon.0) 959 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:09:50.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:09:50 smithi047 bash[22744]: audit 2024-09-16T08:09:49.269656+0000 mon.a (mon.0) 959 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:09:50.947 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:09:50.947 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:09:50.947 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:09:50.948 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:09:50.948 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:09:51.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:09:51 smithi157 bash[24585]: cluster 2024-09-16T08:09:50.164181+0000 mgr.a (mgr.14373) 6606 : cluster [DBG] pgmap v4582: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:09:51.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:09:51 smithi086 bash[24289]: cluster 2024-09-16T08:09:50.164181+0000 mgr.a (mgr.14373) 6606 : cluster [DBG] pgmap v4582: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:09:51.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:09:51 smithi047 bash[22744]: cluster 2024-09-16T08:09:50.164181+0000 mgr.a (mgr.14373) 6606 : cluster [DBG] pgmap v4582: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:09:52.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:09:52 smithi157 bash[24585]: audit 2024-09-16T08:09:50.519689+0000 mgr.a (mgr.14373) 6607 : audit [DBG] from='client.150819 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:09:52.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:09:52 smithi086 bash[24289]: audit 2024-09-16T08:09:50.519689+0000 mgr.a (mgr.14373) 6607 : audit [DBG] from='client.150819 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:09:52.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:09:52 smithi047 bash[22744]: audit 2024-09-16T08:09:50.519689+0000 mgr.a (mgr.14373) 6607 : audit [DBG] from='client.150819 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:09:53.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:09:53 smithi157 bash[24585]: cluster 2024-09-16T08:09:52.166529+0000 mgr.a (mgr.14373) 6608 : cluster [DBG] pgmap v4583: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:09:53.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:09:53 smithi086 bash[24289]: cluster 2024-09-16T08:09:52.166529+0000 mgr.a (mgr.14373) 6608 : cluster [DBG] pgmap v4583: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:09:53.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:09:53 smithi047 bash[22744]: cluster 2024-09-16T08:09:52.166529+0000 mgr.a (mgr.14373) 6608 : cluster [DBG] pgmap v4583: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:09:55.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:09:55 smithi157 bash[24585]: cluster 2024-09-16T08:09:54.167299+0000 mgr.a (mgr.14373) 6609 : cluster [DBG] pgmap v4584: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:09:55.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:09:55 smithi086 bash[24289]: cluster 2024-09-16T08:09:54.167299+0000 mgr.a (mgr.14373) 6609 : cluster [DBG] pgmap v4584: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:09:55.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:09:55 smithi047 bash[22744]: cluster 2024-09-16T08:09:54.167299+0000 mgr.a (mgr.14373) 6609 : cluster [DBG] pgmap v4584: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:09:55.949 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:09:55.949 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:09:55.950 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:09:56.726 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:09:56.726 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:09:56.726 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:09:56.726 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:09:56.727 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:09:57.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:09:57 smithi157 bash[24585]: cluster 2024-09-16T08:09:56.168039+0000 mgr.a (mgr.14373) 6610 : cluster [DBG] pgmap v4585: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:09:57.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:09:57 smithi157 bash[24585]: audit 2024-09-16T08:09:56.285314+0000 mgr.a (mgr.14373) 6611 : audit [DBG] from='client.150897 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:09:57.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:09:57 smithi086 bash[24289]: cluster 2024-09-16T08:09:56.168039+0000 mgr.a (mgr.14373) 6610 : cluster [DBG] pgmap v4585: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:09:57.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:09:57 smithi086 bash[24289]: audit 2024-09-16T08:09:56.285314+0000 mgr.a (mgr.14373) 6611 : audit [DBG] from='client.150897 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:09:57.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:09:57 smithi047 bash[22744]: cluster 2024-09-16T08:09:56.168039+0000 mgr.a (mgr.14373) 6610 : cluster [DBG] pgmap v4585: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:09:57.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:09:57 smithi047 bash[22744]: audit 2024-09-16T08:09:56.285314+0000 mgr.a (mgr.14373) 6611 : audit [DBG] from='client.150897 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:09:59.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:09:59 smithi086 bash[24289]: cluster 2024-09-16T08:09:58.170739+0000 mgr.a (mgr.14373) 6612 : cluster [DBG] pgmap v4586: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:09:59.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:09:59 smithi086 bash[24289]: audit 2024-09-16T08:09:58.843097+0000 mon.a (mon.0) 960 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:09:59.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:09:59 smithi086 bash[24289]: audit 2024-09-16T08:09:58.853161+0000 mon.a (mon.0) 961 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:09:59.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:09:59 smithi086 bash[24289]: audit 2024-09-16T08:09:58.855171+0000 mon.b (mon.2) 631 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T08:09:59.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:09:59 smithi086 bash[24289]: audit 2024-09-16T08:09:58.857495+0000 mon.b (mon.2) 632 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T08:09:59.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:09:59 smithi086 bash[24289]: audit 2024-09-16T08:09:58.870795+0000 mon.a (mon.0) 962 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:09:59.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:09:59 smithi086 bash[24289]: audit 2024-09-16T08:09:58.875040+0000 mon.b (mon.2) 633 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:09:59.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:09:59 smithi047 bash[22744]: cluster 2024-09-16T08:09:58.170739+0000 mgr.a (mgr.14373) 6612 : cluster [DBG] pgmap v4586: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:09:59.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:09:59 smithi047 bash[22744]: audit 2024-09-16T08:09:58.843097+0000 mon.a (mon.0) 960 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:09:59.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:09:59 smithi047 bash[22744]: audit 2024-09-16T08:09:58.853161+0000 mon.a (mon.0) 961 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:09:59.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:09:59 smithi047 bash[22744]: audit 2024-09-16T08:09:58.855171+0000 mon.b (mon.2) 631 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T08:09:59.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:09:59 smithi047 bash[22744]: audit 2024-09-16T08:09:58.857495+0000 mon.b (mon.2) 632 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T08:09:59.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:09:59 smithi047 bash[22744]: audit 2024-09-16T08:09:58.870795+0000 mon.a (mon.0) 962 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:09:59.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:09:59 smithi047 bash[22744]: audit 2024-09-16T08:09:58.875040+0000 mon.b (mon.2) 633 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:09:59.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:09:59 smithi157 bash[24585]: cluster 2024-09-16T08:09:58.170739+0000 mgr.a (mgr.14373) 6612 : cluster [DBG] pgmap v4586: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:09:59.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:09:59 smithi157 bash[24585]: audit 2024-09-16T08:09:58.843097+0000 mon.a (mon.0) 960 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:09:59.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:09:59 smithi157 bash[24585]: audit 2024-09-16T08:09:58.853161+0000 mon.a (mon.0) 961 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:09:59.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:09:59 smithi157 bash[24585]: audit 2024-09-16T08:09:58.855171+0000 mon.b (mon.2) 631 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T08:09:59.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:09:59 smithi157 bash[24585]: audit 2024-09-16T08:09:58.857495+0000 mon.b (mon.2) 632 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T08:09:59.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:09:59 smithi157 bash[24585]: audit 2024-09-16T08:09:58.870795+0000 mon.a (mon.0) 962 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:09:59.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:09:59 smithi157 bash[24585]: audit 2024-09-16T08:09:58.875040+0000 mon.b (mon.2) 633 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:10:00.087 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 08:09:59 smithi047 bash[22994]: debug 2024-09-16T08:09:59.638+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T08:10:00.088 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 08:09:59 smithi047 bash[22994]: debug 2024-09-16T08:09:59.642+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T08:10:00.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:10:00 smithi086 bash[24289]: audit 2024-09-16T08:09:58.879109+0000 mgr.a (mgr.14373) 6613 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:10:00.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:10:00 smithi086 bash[24289]: cluster 2024-09-16T08:10:00.000153+0000 mon.a (mon.0) 963 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-16T08:10:00.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:10:00 smithi047 bash[22744]: audit 2024-09-16T08:09:58.879109+0000 mgr.a (mgr.14373) 6613 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:10:00.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:10:00 smithi047 bash[22744]: cluster 2024-09-16T08:10:00.000153+0000 mon.a (mon.0) 963 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-16T08:10:00.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:10:00 smithi157 bash[24585]: audit 2024-09-16T08:09:58.879109+0000 mgr.a (mgr.14373) 6613 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:10:00.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:10:00 smithi157 bash[24585]: cluster 2024-09-16T08:10:00.000153+0000 mon.a (mon.0) 963 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-16T08:10:01.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:10:01 smithi086 bash[24289]: audit 2024-09-16T08:09:59.644865+0000 mgr.a (mgr.14373) 6614 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T08:10:01.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:10:01 smithi086 bash[24289]: cephadm 2024-09-16T08:09:59.646954+0000 mgr.a (mgr.14373) 6615 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T08:10:01.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:10:01 smithi086 bash[24289]: cluster 2024-09-16T08:10:00.171832+0000 mgr.a (mgr.14373) 6616 : cluster [DBG] pgmap v4587: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:10:01.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:10:01 smithi047 bash[22744]: audit 2024-09-16T08:09:59.644865+0000 mgr.a (mgr.14373) 6614 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T08:10:01.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:10:01 smithi047 bash[22744]: cephadm 2024-09-16T08:09:59.646954+0000 mgr.a (mgr.14373) 6615 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T08:10:01.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:10:01 smithi047 bash[22744]: cluster 2024-09-16T08:10:00.171832+0000 mgr.a (mgr.14373) 6616 : cluster [DBG] pgmap v4587: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:10:01.728 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:10:01.728 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:10:01.729 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:10:01.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:10:01 smithi157 bash[24585]: audit 2024-09-16T08:09:59.644865+0000 mgr.a (mgr.14373) 6614 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T08:10:01.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:10:01 smithi157 bash[24585]: cephadm 2024-09-16T08:09:59.646954+0000 mgr.a (mgr.14373) 6615 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T08:10:01.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:10:01 smithi157 bash[24585]: cluster 2024-09-16T08:10:00.171832+0000 mgr.a (mgr.14373) 6616 : cluster [DBG] pgmap v4587: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:10:02.521 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:10:02.521 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:10:02.521 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:10:02.521 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:10:02.521 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:10:03.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:10:03 smithi047 bash[22744]: audit 2024-09-16T08:10:02.066443+0000 mgr.a (mgr.14373) 6617 : audit [DBG] from='client.151074 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:10:03.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:10:03 smithi047 bash[22744]: cluster 2024-09-16T08:10:02.173170+0000 mgr.a (mgr.14373) 6618 : cluster [DBG] pgmap v4588: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:10:03.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:10:03 smithi157 bash[24585]: audit 2024-09-16T08:10:02.066443+0000 mgr.a (mgr.14373) 6617 : audit [DBG] from='client.151074 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:10:03.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:10:03 smithi157 bash[24585]: cluster 2024-09-16T08:10:02.173170+0000 mgr.a (mgr.14373) 6618 : cluster [DBG] pgmap v4588: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:10:03.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:10:03 smithi086 bash[24289]: audit 2024-09-16T08:10:02.066443+0000 mgr.a (mgr.14373) 6617 : audit [DBG] from='client.151074 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:10:03.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:10:03 smithi086 bash[24289]: cluster 2024-09-16T08:10:02.173170+0000 mgr.a (mgr.14373) 6618 : cluster [DBG] pgmap v4588: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:10:05.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:10:05 smithi047 bash[22744]: cluster 2024-09-16T08:10:04.174023+0000 mgr.a (mgr.14373) 6619 : cluster [DBG] pgmap v4589: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T08:10:05.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:10:05 smithi157 bash[24585]: cluster 2024-09-16T08:10:04.174023+0000 mgr.a (mgr.14373) 6619 : cluster [DBG] pgmap v4589: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T08:10:05.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:10:05 smithi086 bash[24289]: cluster 2024-09-16T08:10:04.174023+0000 mgr.a (mgr.14373) 6619 : cluster [DBG] pgmap v4589: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T08:10:07.522 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:10:07.523 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:10:07.523 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:10:07.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:10:07 smithi047 bash[22744]: cluster 2024-09-16T08:10:06.174843+0000 mgr.a (mgr.14373) 6620 : cluster [DBG] pgmap v4590: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T08:10:07.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:10:07 smithi157 bash[24585]: cluster 2024-09-16T08:10:06.174843+0000 mgr.a (mgr.14373) 6620 : cluster [DBG] pgmap v4590: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T08:10:07.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:10:07 smithi086 bash[24289]: cluster 2024-09-16T08:10:06.174843+0000 mgr.a (mgr.14373) 6620 : cluster [DBG] pgmap v4590: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T08:10:08.276 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:10:08.277 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:10:08.277 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:10:08.277 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:10:08.277 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:10:09.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:10:09 smithi047 bash[22744]: audit 2024-09-16T08:10:07.862334+0000 mgr.a (mgr.14373) 6621 : audit [DBG] from='client.151146 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:10:09.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:10:09 smithi047 bash[22744]: cluster 2024-09-16T08:10:08.184686+0000 mgr.a (mgr.14373) 6622 : cluster [DBG] pgmap v4591: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:10:09.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:10:09 smithi157 bash[24585]: audit 2024-09-16T08:10:07.862334+0000 mgr.a (mgr.14373) 6621 : audit [DBG] from='client.151146 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:10:09.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:10:09 smithi157 bash[24585]: cluster 2024-09-16T08:10:08.184686+0000 mgr.a (mgr.14373) 6622 : cluster [DBG] pgmap v4591: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:10:09.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:10:09 smithi086 bash[24289]: audit 2024-09-16T08:10:07.862334+0000 mgr.a (mgr.14373) 6621 : audit [DBG] from='client.151146 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:10:09.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:10:09 smithi086 bash[24289]: cluster 2024-09-16T08:10:08.184686+0000 mgr.a (mgr.14373) 6622 : cluster [DBG] pgmap v4591: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:10:11.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:10:11 smithi047 bash[22744]: cluster 2024-09-16T08:10:10.185635+0000 mgr.a (mgr.14373) 6623 : cluster [DBG] pgmap v4592: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:10:11.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:10:11 smithi157 bash[24585]: cluster 2024-09-16T08:10:10.185635+0000 mgr.a (mgr.14373) 6623 : cluster [DBG] pgmap v4592: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:10:11.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:10:11 smithi086 bash[24289]: cluster 2024-09-16T08:10:10.185635+0000 mgr.a (mgr.14373) 6623 : cluster [DBG] pgmap v4592: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:10:13.278 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:10:13.279 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:10:13.279 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:10:13.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:10:13 smithi157 bash[24585]: cluster 2024-09-16T08:10:12.187717+0000 mgr.a (mgr.14373) 6624 : cluster [DBG] pgmap v4593: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:10:13.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:10:13 smithi086 bash[24289]: cluster 2024-09-16T08:10:12.187717+0000 mgr.a (mgr.14373) 6624 : cluster [DBG] pgmap v4593: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:10:13.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:10:13 smithi047 bash[22744]: cluster 2024-09-16T08:10:12.187717+0000 mgr.a (mgr.14373) 6624 : cluster [DBG] pgmap v4593: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:10:14.040 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:10:14.040 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:10:14.040 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:10:14.040 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:10:14.040 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:10:15.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:10:15 smithi157 bash[24585]: audit 2024-09-16T08:10:13.616374+0000 mgr.a (mgr.14373) 6625 : audit [DBG] from='client.151224 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:10:15.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:10:15 smithi157 bash[24585]: cluster 2024-09-16T08:10:14.188680+0000 mgr.a (mgr.14373) 6626 : cluster [DBG] pgmap v4594: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:10:15.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:10:15 smithi086 bash[24289]: audit 2024-09-16T08:10:13.616374+0000 mgr.a (mgr.14373) 6625 : audit [DBG] from='client.151224 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:10:15.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:10:15 smithi086 bash[24289]: cluster 2024-09-16T08:10:14.188680+0000 mgr.a (mgr.14373) 6626 : cluster [DBG] pgmap v4594: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:10:15.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:10:15 smithi047 bash[22744]: audit 2024-09-16T08:10:13.616374+0000 mgr.a (mgr.14373) 6625 : audit [DBG] from='client.151224 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:10:15.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:10:15 smithi047 bash[22744]: cluster 2024-09-16T08:10:14.188680+0000 mgr.a (mgr.14373) 6626 : cluster [DBG] pgmap v4594: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:10:17.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:10:17 smithi157 bash[24585]: cluster 2024-09-16T08:10:16.189481+0000 mgr.a (mgr.14373) 6627 : cluster [DBG] pgmap v4595: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:10:17.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:10:17 smithi086 bash[24289]: cluster 2024-09-16T08:10:16.189481+0000 mgr.a (mgr.14373) 6627 : cluster [DBG] pgmap v4595: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:10:17.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:10:17 smithi047 bash[22744]: cluster 2024-09-16T08:10:16.189481+0000 mgr.a (mgr.14373) 6627 : cluster [DBG] pgmap v4595: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:10:19.042 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:10:19.043 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:10:19.043 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:10:19.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:10:19 smithi157 bash[24585]: cluster 2024-09-16T08:10:18.191788+0000 mgr.a (mgr.14373) 6628 : cluster [DBG] pgmap v4596: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:10:19.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:10:19 smithi086 bash[24289]: cluster 2024-09-16T08:10:18.191788+0000 mgr.a (mgr.14373) 6628 : cluster [DBG] pgmap v4596: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:10:19.817 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:10:19.818 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:10:19.818 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:10:19.818 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:10:19.818 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:10:19.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:10:19 smithi047 bash[22744]: cluster 2024-09-16T08:10:18.191788+0000 mgr.a (mgr.14373) 6628 : cluster [DBG] pgmap v4596: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:10:20.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:10:20 smithi157 bash[24585]: audit 2024-09-16T08:10:19.380775+0000 mgr.a (mgr.14373) 6629 : audit [DBG] from='client.151299 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:10:20.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:10:20 smithi086 bash[24289]: audit 2024-09-16T08:10:19.380775+0000 mgr.a (mgr.14373) 6629 : audit [DBG] from='client.151299 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:10:20.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:10:20 smithi047 bash[22744]: audit 2024-09-16T08:10:19.380775+0000 mgr.a (mgr.14373) 6629 : audit [DBG] from='client.151299 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:10:21.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:10:21 smithi157 bash[24585]: cluster 2024-09-16T08:10:20.192807+0000 mgr.a (mgr.14373) 6630 : cluster [DBG] pgmap v4597: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:10:21.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:10:21 smithi086 bash[24289]: cluster 2024-09-16T08:10:20.192807+0000 mgr.a (mgr.14373) 6630 : cluster [DBG] pgmap v4597: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:10:21.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:10:21 smithi047 bash[22744]: cluster 2024-09-16T08:10:20.192807+0000 mgr.a (mgr.14373) 6630 : cluster [DBG] pgmap v4597: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:10:23.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:10:23 smithi157 bash[24585]: cluster 2024-09-16T08:10:22.195060+0000 mgr.a (mgr.14373) 6631 : cluster [DBG] pgmap v4598: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:10:23.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:10:23 smithi086 bash[24289]: cluster 2024-09-16T08:10:22.195060+0000 mgr.a (mgr.14373) 6631 : cluster [DBG] pgmap v4598: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:10:23.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:10:23 smithi047 bash[22744]: cluster 2024-09-16T08:10:22.195060+0000 mgr.a (mgr.14373) 6631 : cluster [DBG] pgmap v4598: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:10:24.819 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:10:24.820 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:10:24.820 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:10:25.571 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:10:25.571 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:10:25.571 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:10:25.571 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:10:25.571 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:10:25.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:10:25 smithi157 bash[24585]: cluster 2024-09-16T08:10:24.195834+0000 mgr.a (mgr.14373) 6632 : cluster [DBG] pgmap v4599: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:10:25.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:10:25 smithi086 bash[24289]: cluster 2024-09-16T08:10:24.195834+0000 mgr.a (mgr.14373) 6632 : cluster [DBG] pgmap v4599: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:10:25.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:10:25 smithi047 bash[22744]: cluster 2024-09-16T08:10:24.195834+0000 mgr.a (mgr.14373) 6632 : cluster [DBG] pgmap v4599: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:10:26.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:10:26 smithi157 bash[24585]: audit 2024-09-16T08:10:25.154385+0000 mgr.a (mgr.14373) 6633 : audit [DBG] from='client.151377 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:10:26.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:10:26 smithi086 bash[24289]: audit 2024-09-16T08:10:25.154385+0000 mgr.a (mgr.14373) 6633 : audit [DBG] from='client.151377 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:10:26.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:10:26 smithi047 bash[22744]: audit 2024-09-16T08:10:25.154385+0000 mgr.a (mgr.14373) 6633 : audit [DBG] from='client.151377 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:10:27.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:10:27 smithi157 bash[24585]: cluster 2024-09-16T08:10:26.196756+0000 mgr.a (mgr.14373) 6634 : cluster [DBG] pgmap v4600: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:10:27.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:10:27 smithi086 bash[24289]: cluster 2024-09-16T08:10:26.196756+0000 mgr.a (mgr.14373) 6634 : cluster [DBG] pgmap v4600: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:10:27.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:10:27 smithi047 bash[22744]: cluster 2024-09-16T08:10:26.196756+0000 mgr.a (mgr.14373) 6634 : cluster [DBG] pgmap v4600: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:10:29.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:10:29 smithi157 bash[24585]: cluster 2024-09-16T08:10:28.199023+0000 mgr.a (mgr.14373) 6635 : cluster [DBG] pgmap v4601: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:10:29.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:10:29 smithi086 bash[24289]: cluster 2024-09-16T08:10:28.199023+0000 mgr.a (mgr.14373) 6635 : cluster [DBG] pgmap v4601: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:10:29.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:10:29 smithi047 bash[22744]: cluster 2024-09-16T08:10:28.199023+0000 mgr.a (mgr.14373) 6635 : cluster [DBG] pgmap v4601: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:10:30.572 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:10:30.573 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:10:30.573 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:10:30.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:10:30 smithi157 bash[24585]: cluster 2024-09-16T08:10:30.199806+0000 mgr.a (mgr.14373) 6636 : cluster [DBG] pgmap v4602: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:10:30.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:10:30 smithi086 bash[24289]: cluster 2024-09-16T08:10:30.199806+0000 mgr.a (mgr.14373) 6636 : cluster [DBG] pgmap v4602: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:10:30.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:10:30 smithi047 bash[22744]: cluster 2024-09-16T08:10:30.199806+0000 mgr.a (mgr.14373) 6636 : cluster [DBG] pgmap v4602: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:10:31.363 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:10:31.363 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:10:31.363 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:10:31.363 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:10:31.363 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:10:31.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:10:31 smithi157 bash[24585]: audit 2024-09-16T08:10:30.918453+0000 mgr.a (mgr.14373) 6637 : audit [DBG] from='client.151455 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:10:31.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:10:31 smithi086 bash[24289]: audit 2024-09-16T08:10:30.918453+0000 mgr.a (mgr.14373) 6637 : audit [DBG] from='client.151455 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:10:31.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:10:31 smithi047 bash[22744]: audit 2024-09-16T08:10:30.918453+0000 mgr.a (mgr.14373) 6637 : audit [DBG] from='client.151455 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:10:32.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:10:32 smithi157 bash[24585]: cluster 2024-09-16T08:10:32.202184+0000 mgr.a (mgr.14373) 6638 : cluster [DBG] pgmap v4603: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:10:32.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:10:32 smithi086 bash[24289]: cluster 2024-09-16T08:10:32.202184+0000 mgr.a (mgr.14373) 6638 : cluster [DBG] pgmap v4603: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:10:32.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:10:32 smithi047 bash[22744]: cluster 2024-09-16T08:10:32.202184+0000 mgr.a (mgr.14373) 6638 : cluster [DBG] pgmap v4603: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:10:35.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:10:35 smithi157 bash[24585]: cluster 2024-09-16T08:10:34.202960+0000 mgr.a (mgr.14373) 6639 : cluster [DBG] pgmap v4604: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:10:35.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:10:35 smithi086 bash[24289]: cluster 2024-09-16T08:10:34.202960+0000 mgr.a (mgr.14373) 6639 : cluster [DBG] pgmap v4604: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:10:35.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:10:35 smithi047 bash[22744]: cluster 2024-09-16T08:10:34.202960+0000 mgr.a (mgr.14373) 6639 : cluster [DBG] pgmap v4604: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:10:36.364 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:10:36.365 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:10:36.365 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:10:37.112 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:10:37.112 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:10:37.112 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:10:37.112 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:10:37.112 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:10:37.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:10:37 smithi157 bash[24585]: cluster 2024-09-16T08:10:36.203693+0000 mgr.a (mgr.14373) 6640 : cluster [DBG] pgmap v4605: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:10:37.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:10:37 smithi086 bash[24289]: cluster 2024-09-16T08:10:36.203693+0000 mgr.a (mgr.14373) 6640 : cluster [DBG] pgmap v4605: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:10:37.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:10:37 smithi047 bash[22744]: cluster 2024-09-16T08:10:36.203693+0000 mgr.a (mgr.14373) 6640 : cluster [DBG] pgmap v4605: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:10:38.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:10:38 smithi157 bash[24585]: audit 2024-09-16T08:10:36.691551+0000 mgr.a (mgr.14373) 6641 : audit [DBG] from='client.151533 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:10:38.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:10:38 smithi086 bash[24289]: audit 2024-09-16T08:10:36.691551+0000 mgr.a (mgr.14373) 6641 : audit [DBG] from='client.151533 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:10:38.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:10:38 smithi047 bash[22744]: audit 2024-09-16T08:10:36.691551+0000 mgr.a (mgr.14373) 6641 : audit [DBG] from='client.151533 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:10:39.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:10:39 smithi157 bash[24585]: cluster 2024-09-16T08:10:38.206521+0000 mgr.a (mgr.14373) 6642 : cluster [DBG] pgmap v4606: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:10:39.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:10:39 smithi086 bash[24289]: cluster 2024-09-16T08:10:38.206521+0000 mgr.a (mgr.14373) 6642 : cluster [DBG] pgmap v4606: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:10:39.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:10:39 smithi047 bash[22744]: cluster 2024-09-16T08:10:38.206521+0000 mgr.a (mgr.14373) 6642 : cluster [DBG] pgmap v4606: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:10:41.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:10:41 smithi157 bash[24585]: cluster 2024-09-16T08:10:40.207361+0000 mgr.a (mgr.14373) 6643 : cluster [DBG] pgmap v4607: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:10:41.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:10:41 smithi086 bash[24289]: cluster 2024-09-16T08:10:40.207361+0000 mgr.a (mgr.14373) 6643 : cluster [DBG] pgmap v4607: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:10:41.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:10:41 smithi047 bash[22744]: cluster 2024-09-16T08:10:40.207361+0000 mgr.a (mgr.14373) 6643 : cluster [DBG] pgmap v4607: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:10:42.113 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:10:42.114 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:10:42.114 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:10:42.896 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:10:42.897 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:10:42.897 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:10:42.897 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:10:42.897 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:10:43.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:10:43 smithi157 bash[24585]: cluster 2024-09-16T08:10:42.209339+0000 mgr.a (mgr.14373) 6644 : cluster [DBG] pgmap v4608: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:10:43.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:10:43 smithi086 bash[24289]: cluster 2024-09-16T08:10:42.209339+0000 mgr.a (mgr.14373) 6644 : cluster [DBG] pgmap v4608: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:10:43.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:10:43 smithi047 bash[22744]: cluster 2024-09-16T08:10:42.209339+0000 mgr.a (mgr.14373) 6644 : cluster [DBG] pgmap v4608: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:10:44.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:10:44 smithi157 bash[24585]: audit 2024-09-16T08:10:42.455488+0000 mgr.a (mgr.14373) 6645 : audit [DBG] from='client.151608 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:10:44.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:10:44 smithi086 bash[24289]: audit 2024-09-16T08:10:42.455488+0000 mgr.a (mgr.14373) 6645 : audit [DBG] from='client.151608 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:10:44.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:10:44 smithi047 bash[22744]: audit 2024-09-16T08:10:42.455488+0000 mgr.a (mgr.14373) 6645 : audit [DBG] from='client.151608 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:10:45.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:10:45 smithi157 bash[24585]: cluster 2024-09-16T08:10:44.210220+0000 mgr.a (mgr.14373) 6646 : cluster [DBG] pgmap v4609: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:10:45.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:10:45 smithi086 bash[24289]: cluster 2024-09-16T08:10:44.210220+0000 mgr.a (mgr.14373) 6646 : cluster [DBG] pgmap v4609: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:10:45.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:10:45 smithi047 bash[22744]: cluster 2024-09-16T08:10:44.210220+0000 mgr.a (mgr.14373) 6646 : cluster [DBG] pgmap v4609: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:10:47.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:10:47 smithi157 bash[24585]: cluster 2024-09-16T08:10:46.211033+0000 mgr.a (mgr.14373) 6647 : cluster [DBG] pgmap v4610: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T08:10:47.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:10:47 smithi086 bash[24289]: cluster 2024-09-16T08:10:46.211033+0000 mgr.a (mgr.14373) 6647 : cluster [DBG] pgmap v4610: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T08:10:47.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:10:47 smithi047 bash[22744]: cluster 2024-09-16T08:10:46.211033+0000 mgr.a (mgr.14373) 6647 : cluster [DBG] pgmap v4610: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T08:10:47.898 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:10:47.899 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:10:47.899 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:10:48.650 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:10:48.651 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:10:48.651 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:10:48.651 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:10:48.651 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:10:49.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:10:49 smithi157 bash[24585]: cluster 2024-09-16T08:10:48.213212+0000 mgr.a (mgr.14373) 6648 : cluster [DBG] pgmap v4611: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:10:49.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:10:49 smithi157 bash[24585]: audit 2024-09-16T08:10:48.238770+0000 mgr.a (mgr.14373) 6649 : audit [DBG] from='client.151683 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:10:49.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:10:49 smithi086 bash[24289]: cluster 2024-09-16T08:10:48.213212+0000 mgr.a (mgr.14373) 6648 : cluster [DBG] pgmap v4611: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:10:49.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:10:49 smithi086 bash[24289]: audit 2024-09-16T08:10:48.238770+0000 mgr.a (mgr.14373) 6649 : audit [DBG] from='client.151683 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:10:49.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:10:49 smithi047 bash[22744]: cluster 2024-09-16T08:10:48.213212+0000 mgr.a (mgr.14373) 6648 : cluster [DBG] pgmap v4611: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:10:49.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:10:49 smithi047 bash[22744]: audit 2024-09-16T08:10:48.238770+0000 mgr.a (mgr.14373) 6649 : audit [DBG] from='client.151683 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:10:51.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:10:51 smithi157 bash[24585]: cluster 2024-09-16T08:10:50.214263+0000 mgr.a (mgr.14373) 6650 : cluster [DBG] pgmap v4612: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:10:51.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:10:51 smithi086 bash[24289]: cluster 2024-09-16T08:10:50.214263+0000 mgr.a (mgr.14373) 6650 : cluster [DBG] pgmap v4612: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:10:51.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:10:51 smithi047 bash[22744]: cluster 2024-09-16T08:10:50.214263+0000 mgr.a (mgr.14373) 6650 : cluster [DBG] pgmap v4612: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:10:53.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:10:53 smithi086 bash[24289]: cluster 2024-09-16T08:10:52.216544+0000 mgr.a (mgr.14373) 6651 : cluster [DBG] pgmap v4613: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:10:53.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:10:53 smithi047 bash[22744]: cluster 2024-09-16T08:10:52.216544+0000 mgr.a (mgr.14373) 6651 : cluster [DBG] pgmap v4613: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:10:53.652 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:10:53.652 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:10:53.652 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:10:53.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:10:53 smithi157 bash[24585]: cluster 2024-09-16T08:10:52.216544+0000 mgr.a (mgr.14373) 6651 : cluster [DBG] pgmap v4613: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:10:54.408 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:10:54.408 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:10:54.408 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:10:54.408 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:10:54.409 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:10:55.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:10:55 smithi157 bash[24585]: audit 2024-09-16T08:10:53.992504+0000 mgr.a (mgr.14373) 6652 : audit [DBG] from='client.151761 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:10:55.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:10:55 smithi157 bash[24585]: cluster 2024-09-16T08:10:54.222640+0000 mgr.a (mgr.14373) 6653 : cluster [DBG] pgmap v4614: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:10:55.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:10:55 smithi086 bash[24289]: audit 2024-09-16T08:10:53.992504+0000 mgr.a (mgr.14373) 6652 : audit [DBG] from='client.151761 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:10:55.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:10:55 smithi086 bash[24289]: cluster 2024-09-16T08:10:54.222640+0000 mgr.a (mgr.14373) 6653 : cluster [DBG] pgmap v4614: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:10:55.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:10:55 smithi047 bash[22744]: audit 2024-09-16T08:10:53.992504+0000 mgr.a (mgr.14373) 6652 : audit [DBG] from='client.151761 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:10:55.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:10:55 smithi047 bash[22744]: cluster 2024-09-16T08:10:54.222640+0000 mgr.a (mgr.14373) 6653 : cluster [DBG] pgmap v4614: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:10:56.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:10:56 smithi157 bash[24585]: cluster 2024-09-16T08:10:56.223507+0000 mgr.a (mgr.14373) 6654 : cluster [DBG] pgmap v4615: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:10:56.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:10:56 smithi086 bash[24289]: cluster 2024-09-16T08:10:56.223507+0000 mgr.a (mgr.14373) 6654 : cluster [DBG] pgmap v4615: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:10:56.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:10:56 smithi047 bash[22744]: cluster 2024-09-16T08:10:56.223507+0000 mgr.a (mgr.14373) 6654 : cluster [DBG] pgmap v4615: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:10:59.409 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:10:59.410 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:10:59.410 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:10:59.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:10:59 smithi157 bash[24585]: cluster 2024-09-16T08:10:58.225827+0000 mgr.a (mgr.14373) 6655 : cluster [DBG] pgmap v4616: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:10:59.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:10:59 smithi086 bash[24289]: cluster 2024-09-16T08:10:58.225827+0000 mgr.a (mgr.14373) 6655 : cluster [DBG] pgmap v4616: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:10:59.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:10:59 smithi047 bash[22744]: cluster 2024-09-16T08:10:58.225827+0000 mgr.a (mgr.14373) 6655 : cluster [DBG] pgmap v4616: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:11:00.171 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:11:00.171 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:11:00.171 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:11:00.171 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:11:00.171 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:11:00.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:11:00 smithi157 bash[24585]: audit 2024-09-16T08:10:59.709959+0000 mon.b (mon.2) 634 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T08:11:00.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:11:00 smithi086 bash[24289]: audit 2024-09-16T08:10:59.709959+0000 mon.b (mon.2) 634 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T08:11:00.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:11:00 smithi047 bash[22744]: audit 2024-09-16T08:10:59.709959+0000 mon.b (mon.2) 634 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T08:11:01.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:11:01 smithi157 bash[24585]: audit 2024-09-16T08:10:59.740261+0000 mgr.a (mgr.14373) 6656 : audit [DBG] from='client.151836 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:11:01.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:11:01 smithi157 bash[24585]: cluster 2024-09-16T08:11:00.226686+0000 mgr.a (mgr.14373) 6657 : cluster [DBG] pgmap v4617: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:11:01.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:11:01 smithi157 bash[24585]: audit 2024-09-16T08:11:00.340731+0000 mon.a (mon.0) 964 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:11:01.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:11:01 smithi157 bash[24585]: audit 2024-09-16T08:11:00.347234+0000 mon.a (mon.0) 965 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:11:01.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:11:01 smithi157 bash[24585]: audit 2024-09-16T08:11:00.353447+0000 mon.a (mon.0) 966 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:11:01.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:11:01 smithi157 bash[24585]: audit 2024-09-16T08:11:00.361117+0000 mon.a (mon.0) 967 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:11:01.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:11:01 smithi157 bash[24585]: audit 2024-09-16T08:11:01.091004+0000 mon.a (mon.0) 968 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:11:01.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:11:01 smithi157 bash[24585]: audit 2024-09-16T08:11:01.100289+0000 mon.a (mon.0) 969 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:11:01.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:11:01 smithi086 bash[24289]: audit 2024-09-16T08:10:59.740261+0000 mgr.a (mgr.14373) 6656 : audit [DBG] from='client.151836 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:11:01.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:11:01 smithi086 bash[24289]: cluster 2024-09-16T08:11:00.226686+0000 mgr.a (mgr.14373) 6657 : cluster [DBG] pgmap v4617: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:11:01.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:11:01 smithi086 bash[24289]: audit 2024-09-16T08:11:00.340731+0000 mon.a (mon.0) 964 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:11:01.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:11:01 smithi086 bash[24289]: audit 2024-09-16T08:11:00.347234+0000 mon.a (mon.0) 965 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:11:01.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:11:01 smithi086 bash[24289]: audit 2024-09-16T08:11:00.353447+0000 mon.a (mon.0) 966 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:11:01.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:11:01 smithi086 bash[24289]: audit 2024-09-16T08:11:00.361117+0000 mon.a (mon.0) 967 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:11:01.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:11:01 smithi086 bash[24289]: audit 2024-09-16T08:11:01.091004+0000 mon.a (mon.0) 968 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:11:01.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:11:01 smithi086 bash[24289]: audit 2024-09-16T08:11:01.100289+0000 mon.a (mon.0) 969 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:11:01.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:11:01 smithi047 bash[22744]: audit 2024-09-16T08:10:59.740261+0000 mgr.a (mgr.14373) 6656 : audit [DBG] from='client.151836 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:11:01.914 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:11:01 smithi047 bash[22744]: cluster 2024-09-16T08:11:00.226686+0000 mgr.a (mgr.14373) 6657 : cluster [DBG] pgmap v4617: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:11:01.914 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:11:01 smithi047 bash[22744]: audit 2024-09-16T08:11:00.340731+0000 mon.a (mon.0) 964 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:11:01.914 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:11:01 smithi047 bash[22744]: audit 2024-09-16T08:11:00.347234+0000 mon.a (mon.0) 965 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:11:01.914 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:11:01 smithi047 bash[22744]: audit 2024-09-16T08:11:00.353447+0000 mon.a (mon.0) 966 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:11:01.914 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:11:01 smithi047 bash[22744]: audit 2024-09-16T08:11:00.361117+0000 mon.a (mon.0) 967 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:11:01.914 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:11:01 smithi047 bash[22744]: audit 2024-09-16T08:11:01.091004+0000 mon.a (mon.0) 968 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:11:01.914 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:11:01 smithi047 bash[22744]: audit 2024-09-16T08:11:01.100289+0000 mon.a (mon.0) 969 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:11:02.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:11:02 smithi086 bash[24289]: audit 2024-09-16T08:11:01.563307+0000 mon.a (mon.0) 970 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:11:02.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:11:02 smithi086 bash[24289]: audit 2024-09-16T08:11:01.572998+0000 mon.a (mon.0) 971 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:11:02.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:11:02 smithi086 bash[24289]: audit 2024-09-16T08:11:01.596484+0000 mon.a (mon.0) 972 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:11:02.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:11:02 smithi086 bash[24289]: audit 2024-09-16T08:11:01.605914+0000 mon.a (mon.0) 973 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:11:02.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:11:02 smithi086 bash[24289]: audit 2024-09-16T08:11:01.607413+0000 mon.b (mon.2) 635 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T08:11:02.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:11:02 smithi086 bash[24289]: audit 2024-09-16T08:11:01.609009+0000 mon.b (mon.2) 636 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T08:11:02.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:11:02 smithi086 bash[24289]: audit 2024-09-16T08:11:01.621249+0000 mon.a (mon.0) 974 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:11:02.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:11:02 smithi086 bash[24289]: audit 2024-09-16T08:11:01.626082+0000 mon.b (mon.2) 637 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:11:02.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:11:02 smithi086 bash[24289]: audit 2024-09-16T08:11:01.629921+0000 mgr.a (mgr.14373) 6658 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:11:02.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:11:02 smithi086 bash[24289]: cluster 2024-09-16T08:11:02.227855+0000 mgr.a (mgr.14373) 6659 : cluster [DBG] pgmap v4618: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:11:02.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:11:02 smithi086 bash[24289]: audit 2024-09-16T08:11:02.377745+0000 mgr.a (mgr.14373) 6660 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T08:11:02.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:11:02 smithi086 bash[24289]: cephadm 2024-09-16T08:11:02.379992+0000 mgr.a (mgr.14373) 6661 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T08:11:02.837 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 08:11:02 smithi047 bash[22994]: debug 2024-09-16T08:11:02.372+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T08:11:02.838 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 08:11:02 smithi047 bash[22994]: debug 2024-09-16T08:11:02.376+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T08:11:02.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:11:02 smithi047 bash[22744]: audit 2024-09-16T08:11:01.563307+0000 mon.a (mon.0) 970 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:11:02.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:11:02 smithi047 bash[22744]: audit 2024-09-16T08:11:01.572998+0000 mon.a (mon.0) 971 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:11:02.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:11:02 smithi047 bash[22744]: audit 2024-09-16T08:11:01.596484+0000 mon.a (mon.0) 972 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:11:02.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:11:02 smithi047 bash[22744]: audit 2024-09-16T08:11:01.605914+0000 mon.a (mon.0) 973 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:11:02.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:11:02 smithi047 bash[22744]: audit 2024-09-16T08:11:01.607413+0000 mon.b (mon.2) 635 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T08:11:02.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:11:02 smithi047 bash[22744]: audit 2024-09-16T08:11:01.609009+0000 mon.b (mon.2) 636 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T08:11:02.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:11:02 smithi047 bash[22744]: audit 2024-09-16T08:11:01.621249+0000 mon.a (mon.0) 974 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:11:02.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:11:02 smithi047 bash[22744]: audit 2024-09-16T08:11:01.626082+0000 mon.b (mon.2) 637 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:11:02.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:11:02 smithi047 bash[22744]: audit 2024-09-16T08:11:01.629921+0000 mgr.a (mgr.14373) 6658 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:11:02.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:11:02 smithi047 bash[22744]: cluster 2024-09-16T08:11:02.227855+0000 mgr.a (mgr.14373) 6659 : cluster [DBG] pgmap v4618: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:11:02.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:11:02 smithi047 bash[22744]: audit 2024-09-16T08:11:02.377745+0000 mgr.a (mgr.14373) 6660 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T08:11:02.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:11:02 smithi047 bash[22744]: cephadm 2024-09-16T08:11:02.379992+0000 mgr.a (mgr.14373) 6661 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T08:11:03.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:11:02 smithi157 bash[24585]: audit 2024-09-16T08:11:01.563307+0000 mon.a (mon.0) 970 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:11:03.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:11:02 smithi157 bash[24585]: audit 2024-09-16T08:11:01.572998+0000 mon.a (mon.0) 971 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:11:03.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:11:02 smithi157 bash[24585]: audit 2024-09-16T08:11:01.596484+0000 mon.a (mon.0) 972 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:11:03.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:11:02 smithi157 bash[24585]: audit 2024-09-16T08:11:01.605914+0000 mon.a (mon.0) 973 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:11:03.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:11:02 smithi157 bash[24585]: audit 2024-09-16T08:11:01.607413+0000 mon.b (mon.2) 635 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T08:11:03.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:11:02 smithi157 bash[24585]: audit 2024-09-16T08:11:01.609009+0000 mon.b (mon.2) 636 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T08:11:03.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:11:02 smithi157 bash[24585]: audit 2024-09-16T08:11:01.621249+0000 mon.a (mon.0) 974 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:11:03.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:11:02 smithi157 bash[24585]: audit 2024-09-16T08:11:01.626082+0000 mon.b (mon.2) 637 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:11:03.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:11:02 smithi157 bash[24585]: audit 2024-09-16T08:11:01.629921+0000 mgr.a (mgr.14373) 6658 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:11:03.055 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:11:02 smithi157 bash[24585]: cluster 2024-09-16T08:11:02.227855+0000 mgr.a (mgr.14373) 6659 : cluster [DBG] pgmap v4618: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:11:03.055 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:11:02 smithi157 bash[24585]: audit 2024-09-16T08:11:02.377745+0000 mgr.a (mgr.14373) 6660 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T08:11:03.055 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:11:02 smithi157 bash[24585]: cephadm 2024-09-16T08:11:02.379992+0000 mgr.a (mgr.14373) 6661 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T08:11:05.173 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:11:05.173 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:11:05.174 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:11:05.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:11:05 smithi157 bash[24585]: cluster 2024-09-16T08:11:04.228566+0000 mgr.a (mgr.14373) 6662 : cluster [DBG] pgmap v4619: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:11:05.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:11:05 smithi086 bash[24289]: cluster 2024-09-16T08:11:04.228566+0000 mgr.a (mgr.14373) 6662 : cluster [DBG] pgmap v4619: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:11:05.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:11:05 smithi047 bash[22744]: cluster 2024-09-16T08:11:04.228566+0000 mgr.a (mgr.14373) 6662 : cluster [DBG] pgmap v4619: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:11:05.914 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:11:05.914 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:11:05.914 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:11:05.914 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:11:05.914 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:11:07.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:11:07 smithi157 bash[24585]: audit 2024-09-16T08:11:05.505591+0000 mgr.a (mgr.14373) 6663 : audit [DBG] from='client.152010 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:11:07.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:11:07 smithi157 bash[24585]: cluster 2024-09-16T08:11:06.229525+0000 mgr.a (mgr.14373) 6664 : cluster [DBG] pgmap v4620: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:11:07.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:11:07 smithi086 bash[24289]: audit 2024-09-16T08:11:05.505591+0000 mgr.a (mgr.14373) 6663 : audit [DBG] from='client.152010 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:11:07.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:11:07 smithi086 bash[24289]: cluster 2024-09-16T08:11:06.229525+0000 mgr.a (mgr.14373) 6664 : cluster [DBG] pgmap v4620: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:11:07.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:11:07 smithi047 bash[22744]: audit 2024-09-16T08:11:05.505591+0000 mgr.a (mgr.14373) 6663 : audit [DBG] from='client.152010 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:11:07.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:11:07 smithi047 bash[22744]: cluster 2024-09-16T08:11:06.229525+0000 mgr.a (mgr.14373) 6664 : cluster [DBG] pgmap v4620: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:11:09.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:11:09 smithi157 bash[24585]: cluster 2024-09-16T08:11:08.231800+0000 mgr.a (mgr.14373) 6665 : cluster [DBG] pgmap v4621: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:11:09.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:11:09 smithi086 bash[24289]: cluster 2024-09-16T08:11:08.231800+0000 mgr.a (mgr.14373) 6665 : cluster [DBG] pgmap v4621: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:11:09.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:11:09 smithi047 bash[22744]: cluster 2024-09-16T08:11:08.231800+0000 mgr.a (mgr.14373) 6665 : cluster [DBG] pgmap v4621: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:11:10.915 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:11:10.916 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:11:10.916 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:11:11.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:11:11 smithi157 bash[24585]: cluster 2024-09-16T08:11:10.232570+0000 mgr.a (mgr.14373) 6666 : cluster [DBG] pgmap v4622: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:11:11.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:11:11 smithi086 bash[24289]: cluster 2024-09-16T08:11:10.232570+0000 mgr.a (mgr.14373) 6666 : cluster [DBG] pgmap v4622: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:11:11.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:11:11 smithi047 bash[22744]: cluster 2024-09-16T08:11:10.232570+0000 mgr.a (mgr.14373) 6666 : cluster [DBG] pgmap v4622: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:11:11.699 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:11:11.699 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:11:11.699 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:11:11.699 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:11:11.699 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:11:12.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:11:12 smithi157 bash[24585]: audit 2024-09-16T08:11:11.261889+0000 mgr.a (mgr.14373) 6667 : audit [DBG] from='client.152085 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:11:12.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:11:12 smithi086 bash[24289]: audit 2024-09-16T08:11:11.261889+0000 mgr.a (mgr.14373) 6667 : audit [DBG] from='client.152085 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:11:12.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:11:12 smithi047 bash[22744]: audit 2024-09-16T08:11:11.261889+0000 mgr.a (mgr.14373) 6667 : audit [DBG] from='client.152085 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:11:13.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:11:13 smithi086 bash[24289]: cluster 2024-09-16T08:11:12.235289+0000 mgr.a (mgr.14373) 6668 : cluster [DBG] pgmap v4623: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:11:13.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:11:13 smithi047 bash[22744]: cluster 2024-09-16T08:11:12.235289+0000 mgr.a (mgr.14373) 6668 : cluster [DBG] pgmap v4623: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:11:13.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:11:13 smithi157 bash[24585]: cluster 2024-09-16T08:11:12.235289+0000 mgr.a (mgr.14373) 6668 : cluster [DBG] pgmap v4623: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:11:15.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:11:15 smithi086 bash[24289]: cluster 2024-09-16T08:11:14.236034+0000 mgr.a (mgr.14373) 6669 : cluster [DBG] pgmap v4624: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T08:11:15.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:11:15 smithi047 bash[22744]: cluster 2024-09-16T08:11:14.236034+0000 mgr.a (mgr.14373) 6669 : cluster [DBG] pgmap v4624: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T08:11:15.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:11:15 smithi157 bash[24585]: cluster 2024-09-16T08:11:14.236034+0000 mgr.a (mgr.14373) 6669 : cluster [DBG] pgmap v4624: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T08:11:16.700 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:11:16.701 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:11:16.701 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:11:17.455 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:11:17.455 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:11:17.455 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:11:17.455 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:11:17.455 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:11:17.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:11:17 smithi086 bash[24289]: cluster 2024-09-16T08:11:16.236809+0000 mgr.a (mgr.14373) 6670 : cluster [DBG] pgmap v4625: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T08:11:17.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:11:17 smithi047 bash[22744]: cluster 2024-09-16T08:11:16.236809+0000 mgr.a (mgr.14373) 6670 : cluster [DBG] pgmap v4625: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T08:11:17.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:11:17 smithi157 bash[24585]: cluster 2024-09-16T08:11:16.236809+0000 mgr.a (mgr.14373) 6670 : cluster [DBG] pgmap v4625: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T08:11:18.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:11:18 smithi047 bash[22744]: audit 2024-09-16T08:11:17.034073+0000 mgr.a (mgr.14373) 6671 : audit [DBG] from='client.152163 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:11:18.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:11:18 smithi157 bash[24585]: audit 2024-09-16T08:11:17.034073+0000 mgr.a (mgr.14373) 6671 : audit [DBG] from='client.152163 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:11:18.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:11:18 smithi086 bash[24289]: audit 2024-09-16T08:11:17.034073+0000 mgr.a (mgr.14373) 6671 : audit [DBG] from='client.152163 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:11:19.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:11:19 smithi047 bash[22744]: cluster 2024-09-16T08:11:18.240245+0000 mgr.a (mgr.14373) 6672 : cluster [DBG] pgmap v4626: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:11:19.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:11:19 smithi157 bash[24585]: cluster 2024-09-16T08:11:18.240245+0000 mgr.a (mgr.14373) 6672 : cluster [DBG] pgmap v4626: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:11:19.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:11:19 smithi086 bash[24289]: cluster 2024-09-16T08:11:18.240245+0000 mgr.a (mgr.14373) 6672 : cluster [DBG] pgmap v4626: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:11:21.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:11:21 smithi047 bash[22744]: cluster 2024-09-16T08:11:20.241085+0000 mgr.a (mgr.14373) 6673 : cluster [DBG] pgmap v4627: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:11:21.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:11:21 smithi157 bash[24585]: cluster 2024-09-16T08:11:20.241085+0000 mgr.a (mgr.14373) 6673 : cluster [DBG] pgmap v4627: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:11:21.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:11:21 smithi086 bash[24289]: cluster 2024-09-16T08:11:20.241085+0000 mgr.a (mgr.14373) 6673 : cluster [DBG] pgmap v4627: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:11:22.456 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:11:22.457 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:11:22.457 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:11:23.213 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:11:23.213 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:11:23.213 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:11:23.213 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:11:23.213 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:11:23.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:11:23 smithi047 bash[22744]: cluster 2024-09-16T08:11:22.243095+0000 mgr.a (mgr.14373) 6674 : cluster [DBG] pgmap v4628: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:11:23.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:11:23 smithi157 bash[24585]: cluster 2024-09-16T08:11:22.243095+0000 mgr.a (mgr.14373) 6674 : cluster [DBG] pgmap v4628: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:11:23.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:11:23 smithi086 bash[24289]: cluster 2024-09-16T08:11:22.243095+0000 mgr.a (mgr.14373) 6674 : cluster [DBG] pgmap v4628: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:11:24.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:11:24 smithi157 bash[24585]: audit 2024-09-16T08:11:22.793596+0000 mgr.a (mgr.14373) 6675 : audit [DBG] from='client.152235 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:11:24.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:11:24 smithi086 bash[24289]: audit 2024-09-16T08:11:22.793596+0000 mgr.a (mgr.14373) 6675 : audit [DBG] from='client.152235 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:11:24.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:11:24 smithi047 bash[22744]: audit 2024-09-16T08:11:22.793596+0000 mgr.a (mgr.14373) 6675 : audit [DBG] from='client.152235 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:11:25.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:11:25 smithi157 bash[24585]: cluster 2024-09-16T08:11:24.244062+0000 mgr.a (mgr.14373) 6676 : cluster [DBG] pgmap v4629: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:11:25.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:11:25 smithi086 bash[24289]: cluster 2024-09-16T08:11:24.244062+0000 mgr.a (mgr.14373) 6676 : cluster [DBG] pgmap v4629: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:11:25.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:11:25 smithi047 bash[22744]: cluster 2024-09-16T08:11:24.244062+0000 mgr.a (mgr.14373) 6676 : cluster [DBG] pgmap v4629: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:11:27.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:11:27 smithi157 bash[24585]: cluster 2024-09-16T08:11:26.244948+0000 mgr.a (mgr.14373) 6677 : cluster [DBG] pgmap v4630: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:11:27.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:11:27 smithi086 bash[24289]: cluster 2024-09-16T08:11:26.244948+0000 mgr.a (mgr.14373) 6677 : cluster [DBG] pgmap v4630: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:11:27.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:11:27 smithi047 bash[22744]: cluster 2024-09-16T08:11:26.244948+0000 mgr.a (mgr.14373) 6677 : cluster [DBG] pgmap v4630: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:11:28.214 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:11:28.214 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:11:28.214 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:11:28.996 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:11:28.997 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:11:28.997 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:11:28.997 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:11:28.997 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:11:29.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:11:29 smithi157 bash[24585]: cluster 2024-09-16T08:11:28.246564+0000 mgr.a (mgr.14373) 6678 : cluster [DBG] pgmap v4631: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:11:29.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:11:29 smithi086 bash[24289]: cluster 2024-09-16T08:11:28.246564+0000 mgr.a (mgr.14373) 6678 : cluster [DBG] pgmap v4631: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:11:29.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:11:29 smithi047 bash[22744]: cluster 2024-09-16T08:11:28.246564+0000 mgr.a (mgr.14373) 6678 : cluster [DBG] pgmap v4631: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:11:30.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:11:30 smithi157 bash[24585]: audit 2024-09-16T08:11:28.556639+0000 mgr.a (mgr.14373) 6679 : audit [DBG] from='client.152307 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:11:30.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:11:30 smithi086 bash[24289]: audit 2024-09-16T08:11:28.556639+0000 mgr.a (mgr.14373) 6679 : audit [DBG] from='client.152307 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:11:30.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:11:30 smithi047 bash[22744]: audit 2024-09-16T08:11:28.556639+0000 mgr.a (mgr.14373) 6679 : audit [DBG] from='client.152307 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:11:31.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:11:31 smithi157 bash[24585]: cluster 2024-09-16T08:11:30.247550+0000 mgr.a (mgr.14373) 6680 : cluster [DBG] pgmap v4632: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:11:31.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:11:31 smithi086 bash[24289]: cluster 2024-09-16T08:11:30.247550+0000 mgr.a (mgr.14373) 6680 : cluster [DBG] pgmap v4632: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:11:31.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:11:31 smithi047 bash[22744]: cluster 2024-09-16T08:11:30.247550+0000 mgr.a (mgr.14373) 6680 : cluster [DBG] pgmap v4632: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:11:33.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:11:33 smithi157 bash[24585]: cluster 2024-09-16T08:11:32.249751+0000 mgr.a (mgr.14373) 6681 : cluster [DBG] pgmap v4633: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:11:33.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:11:33 smithi086 bash[24289]: cluster 2024-09-16T08:11:32.249751+0000 mgr.a (mgr.14373) 6681 : cluster [DBG] pgmap v4633: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:11:33.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:11:33 smithi047 bash[22744]: cluster 2024-09-16T08:11:32.249751+0000 mgr.a (mgr.14373) 6681 : cluster [DBG] pgmap v4633: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:11:33.998 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:11:33.998 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:11:33.999 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:11:34.776 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:11:34.776 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:11:34.776 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:11:34.776 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:11:34.776 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:11:35.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:11:35 smithi157 bash[24585]: cluster 2024-09-16T08:11:34.250518+0000 mgr.a (mgr.14373) 6682 : cluster [DBG] pgmap v4634: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:11:35.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:11:35 smithi157 bash[24585]: audit 2024-09-16T08:11:34.339593+0000 mgr.a (mgr.14373) 6683 : audit [DBG] from='client.152385 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:11:35.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:11:35 smithi086 bash[24289]: cluster 2024-09-16T08:11:34.250518+0000 mgr.a (mgr.14373) 6682 : cluster [DBG] pgmap v4634: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:11:35.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:11:35 smithi086 bash[24289]: audit 2024-09-16T08:11:34.339593+0000 mgr.a (mgr.14373) 6683 : audit [DBG] from='client.152385 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:11:35.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:11:35 smithi047 bash[22744]: cluster 2024-09-16T08:11:34.250518+0000 mgr.a (mgr.14373) 6682 : cluster [DBG] pgmap v4634: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:11:35.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:11:35 smithi047 bash[22744]: audit 2024-09-16T08:11:34.339593+0000 mgr.a (mgr.14373) 6683 : audit [DBG] from='client.152385 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:11:37.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:11:37 smithi157 bash[24585]: cluster 2024-09-16T08:11:36.251463+0000 mgr.a (mgr.14373) 6684 : cluster [DBG] pgmap v4635: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:11:37.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:11:37 smithi086 bash[24289]: cluster 2024-09-16T08:11:36.251463+0000 mgr.a (mgr.14373) 6684 : cluster [DBG] pgmap v4635: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:11:37.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:11:37 smithi047 bash[22744]: cluster 2024-09-16T08:11:36.251463+0000 mgr.a (mgr.14373) 6684 : cluster [DBG] pgmap v4635: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:11:39.778 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:11:39.779 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:11:39.779 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:11:39.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:11:39 smithi157 bash[24585]: cluster 2024-09-16T08:11:38.253721+0000 mgr.a (mgr.14373) 6685 : cluster [DBG] pgmap v4636: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:11:39.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:11:39 smithi086 bash[24289]: cluster 2024-09-16T08:11:38.253721+0000 mgr.a (mgr.14373) 6685 : cluster [DBG] pgmap v4636: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:11:39.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:11:39 smithi047 bash[22744]: cluster 2024-09-16T08:11:38.253721+0000 mgr.a (mgr.14373) 6685 : cluster [DBG] pgmap v4636: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:11:40.546 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:11:40.546 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:11:40.546 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:11:40.546 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:11:40.546 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:11:41.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:11:41 smithi157 bash[24585]: audit 2024-09-16T08:11:40.121428+0000 mgr.a (mgr.14373) 6686 : audit [DBG] from='client.152463 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:11:41.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:11:41 smithi157 bash[24585]: cluster 2024-09-16T08:11:40.260297+0000 mgr.a (mgr.14373) 6687 : cluster [DBG] pgmap v4637: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:11:41.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:11:41 smithi086 bash[24289]: audit 2024-09-16T08:11:40.121428+0000 mgr.a (mgr.14373) 6686 : audit [DBG] from='client.152463 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:11:41.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:11:41 smithi086 bash[24289]: cluster 2024-09-16T08:11:40.260297+0000 mgr.a (mgr.14373) 6687 : cluster [DBG] pgmap v4637: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:11:41.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:11:41 smithi047 bash[22744]: audit 2024-09-16T08:11:40.121428+0000 mgr.a (mgr.14373) 6686 : audit [DBG] from='client.152463 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:11:41.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:11:41 smithi047 bash[22744]: cluster 2024-09-16T08:11:40.260297+0000 mgr.a (mgr.14373) 6687 : cluster [DBG] pgmap v4637: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:11:43.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:11:43 smithi157 bash[24585]: cluster 2024-09-16T08:11:42.262655+0000 mgr.a (mgr.14373) 6688 : cluster [DBG] pgmap v4638: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:11:43.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:11:43 smithi086 bash[24289]: cluster 2024-09-16T08:11:42.262655+0000 mgr.a (mgr.14373) 6688 : cluster [DBG] pgmap v4638: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:11:43.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:11:43 smithi047 bash[22744]: cluster 2024-09-16T08:11:42.262655+0000 mgr.a (mgr.14373) 6688 : cluster [DBG] pgmap v4638: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:11:45.547 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:11:45.548 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:11:45.548 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:11:45.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:11:45 smithi157 bash[24585]: cluster 2024-09-16T08:11:44.263410+0000 mgr.a (mgr.14373) 6689 : cluster [DBG] pgmap v4639: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:11:45.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:11:45 smithi086 bash[24289]: cluster 2024-09-16T08:11:44.263410+0000 mgr.a (mgr.14373) 6689 : cluster [DBG] pgmap v4639: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:11:45.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:11:45 smithi047 bash[22744]: cluster 2024-09-16T08:11:44.263410+0000 mgr.a (mgr.14373) 6689 : cluster [DBG] pgmap v4639: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:11:46.300 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:11:46.300 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:11:46.300 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:11:46.300 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:11:46.300 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:11:47.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:11:47 smithi157 bash[24585]: audit 2024-09-16T08:11:45.879574+0000 mgr.a (mgr.14373) 6690 : audit [DBG] from='client.152538 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:11:47.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:11:47 smithi157 bash[24585]: cluster 2024-09-16T08:11:46.263930+0000 mgr.a (mgr.14373) 6691 : cluster [DBG] pgmap v4640: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:11:47.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:11:47 smithi086 bash[24289]: audit 2024-09-16T08:11:45.879574+0000 mgr.a (mgr.14373) 6690 : audit [DBG] from='client.152538 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:11:47.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:11:47 smithi086 bash[24289]: cluster 2024-09-16T08:11:46.263930+0000 mgr.a (mgr.14373) 6691 : cluster [DBG] pgmap v4640: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:11:47.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:11:47 smithi047 bash[22744]: audit 2024-09-16T08:11:45.879574+0000 mgr.a (mgr.14373) 6690 : audit [DBG] from='client.152538 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:11:47.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:11:47 smithi047 bash[22744]: cluster 2024-09-16T08:11:46.263930+0000 mgr.a (mgr.14373) 6691 : cluster [DBG] pgmap v4640: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:11:49.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:11:49 smithi157 bash[24585]: cluster 2024-09-16T08:11:48.266151+0000 mgr.a (mgr.14373) 6692 : cluster [DBG] pgmap v4641: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:11:49.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:11:49 smithi086 bash[24289]: cluster 2024-09-16T08:11:48.266151+0000 mgr.a (mgr.14373) 6692 : cluster [DBG] pgmap v4641: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:11:49.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:11:49 smithi047 bash[22744]: cluster 2024-09-16T08:11:48.266151+0000 mgr.a (mgr.14373) 6692 : cluster [DBG] pgmap v4641: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:11:51.301 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:11:51.302 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:11:51.302 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:11:51.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:11:51 smithi157 bash[24585]: cluster 2024-09-16T08:11:50.266898+0000 mgr.a (mgr.14373) 6693 : cluster [DBG] pgmap v4642: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:11:51.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:11:51 smithi086 bash[24289]: cluster 2024-09-16T08:11:50.266898+0000 mgr.a (mgr.14373) 6693 : cluster [DBG] pgmap v4642: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:11:51.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:11:51 smithi047 bash[22744]: cluster 2024-09-16T08:11:50.266898+0000 mgr.a (mgr.14373) 6693 : cluster [DBG] pgmap v4642: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:11:52.100 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:11:52.100 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:11:52.100 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:11:52.100 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:11:52.101 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:11:53.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:11:53 smithi157 bash[24585]: audit 2024-09-16T08:11:51.652820+0000 mgr.a (mgr.14373) 6694 : audit [DBG] from='client.152613 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:11:53.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:11:53 smithi157 bash[24585]: cluster 2024-09-16T08:11:52.269626+0000 mgr.a (mgr.14373) 6695 : cluster [DBG] pgmap v4643: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:11:53.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:11:53 smithi086 bash[24289]: audit 2024-09-16T08:11:51.652820+0000 mgr.a (mgr.14373) 6694 : audit [DBG] from='client.152613 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:11:53.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:11:53 smithi086 bash[24289]: cluster 2024-09-16T08:11:52.269626+0000 mgr.a (mgr.14373) 6695 : cluster [DBG] pgmap v4643: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:11:53.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:11:53 smithi047 bash[22744]: audit 2024-09-16T08:11:51.652820+0000 mgr.a (mgr.14373) 6694 : audit [DBG] from='client.152613 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:11:53.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:11:53 smithi047 bash[22744]: cluster 2024-09-16T08:11:52.269626+0000 mgr.a (mgr.14373) 6695 : cluster [DBG] pgmap v4643: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:11:54.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:11:54 smithi157 bash[24585]: cluster 2024-09-16T08:11:54.270469+0000 mgr.a (mgr.14373) 6696 : cluster [DBG] pgmap v4644: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:11:54.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:11:54 smithi086 bash[24289]: cluster 2024-09-16T08:11:54.270469+0000 mgr.a (mgr.14373) 6696 : cluster [DBG] pgmap v4644: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:11:54.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:11:54 smithi047 bash[22744]: cluster 2024-09-16T08:11:54.270469+0000 mgr.a (mgr.14373) 6696 : cluster [DBG] pgmap v4644: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:11:57.102 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:11:57.102 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:11:57.102 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:11:57.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:11:57 smithi047 bash[22744]: cluster 2024-09-16T08:11:56.271254+0000 mgr.a (mgr.14373) 6697 : cluster [DBG] pgmap v4645: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T08:11:57.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:11:57 smithi157 bash[24585]: cluster 2024-09-16T08:11:56.271254+0000 mgr.a (mgr.14373) 6697 : cluster [DBG] pgmap v4645: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T08:11:57.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:11:57 smithi086 bash[24289]: cluster 2024-09-16T08:11:56.271254+0000 mgr.a (mgr.14373) 6697 : cluster [DBG] pgmap v4645: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T08:11:57.852 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:11:57.853 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:11:57.853 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:11:57.853 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:11:57.853 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:11:59.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:11:59 smithi047 bash[22744]: audit 2024-09-16T08:11:57.437334+0000 mgr.a (mgr.14373) 6698 : audit [DBG] from='client.152691 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:11:59.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:11:59 smithi047 bash[22744]: cluster 2024-09-16T08:11:58.273883+0000 mgr.a (mgr.14373) 6699 : cluster [DBG] pgmap v4646: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:11:59.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:11:59 smithi157 bash[24585]: audit 2024-09-16T08:11:57.437334+0000 mgr.a (mgr.14373) 6698 : audit [DBG] from='client.152691 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:11:59.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:11:59 smithi157 bash[24585]: cluster 2024-09-16T08:11:58.273883+0000 mgr.a (mgr.14373) 6699 : cluster [DBG] pgmap v4646: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:11:59.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:11:59 smithi086 bash[24289]: audit 2024-09-16T08:11:57.437334+0000 mgr.a (mgr.14373) 6698 : audit [DBG] from='client.152691 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:11:59.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:11:59 smithi086 bash[24289]: cluster 2024-09-16T08:11:58.273883+0000 mgr.a (mgr.14373) 6699 : cluster [DBG] pgmap v4646: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:12:01.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:12:01 smithi047 bash[22744]: cluster 2024-09-16T08:12:00.274687+0000 mgr.a (mgr.14373) 6700 : cluster [DBG] pgmap v4647: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:12:01.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:12:01 smithi157 bash[24585]: cluster 2024-09-16T08:12:00.274687+0000 mgr.a (mgr.14373) 6700 : cluster [DBG] pgmap v4647: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:12:01.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:12:01 smithi086 bash[24289]: cluster 2024-09-16T08:12:00.274687+0000 mgr.a (mgr.14373) 6700 : cluster [DBG] pgmap v4647: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:12:02.854 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:12:02.854 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:12:02.855 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:12:03.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:12:03 smithi047 bash[22744]: cluster 2024-09-16T08:12:02.276612+0000 mgr.a (mgr.14373) 6701 : cluster [DBG] pgmap v4648: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:12:03.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:12:03 smithi047 bash[22744]: audit 2024-09-16T08:12:02.451704+0000 mon.b (mon.2) 638 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T08:12:03.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:12:03 smithi047 bash[22744]: audit 2024-09-16T08:12:03.313502+0000 mon.b (mon.2) 639 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T08:12:03.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:12:03 smithi047 bash[22744]: audit 2024-09-16T08:12:03.324428+0000 mon.b (mon.2) 640 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T08:12:03.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:12:03 smithi047 bash[22744]: audit 2024-09-16T08:12:03.333304+0000 mon.a (mon.0) 975 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:12:03.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:12:03 smithi047 bash[22744]: audit 2024-09-16T08:12:03.337046+0000 mon.b (mon.2) 641 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:12:03.600 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:12:03.600 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:12:03.600 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:12:03.600 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:12:03.601 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:12:03.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:12:03 smithi157 bash[24585]: cluster 2024-09-16T08:12:02.276612+0000 mgr.a (mgr.14373) 6701 : cluster [DBG] pgmap v4648: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:12:03.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:12:03 smithi157 bash[24585]: audit 2024-09-16T08:12:02.451704+0000 mon.b (mon.2) 638 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T08:12:03.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:12:03 smithi157 bash[24585]: audit 2024-09-16T08:12:03.313502+0000 mon.b (mon.2) 639 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T08:12:03.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:12:03 smithi157 bash[24585]: audit 2024-09-16T08:12:03.324428+0000 mon.b (mon.2) 640 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T08:12:03.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:12:03 smithi157 bash[24585]: audit 2024-09-16T08:12:03.333304+0000 mon.a (mon.0) 975 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:12:03.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:12:03 smithi157 bash[24585]: audit 2024-09-16T08:12:03.337046+0000 mon.b (mon.2) 641 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:12:03.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:12:03 smithi086 bash[24289]: cluster 2024-09-16T08:12:02.276612+0000 mgr.a (mgr.14373) 6701 : cluster [DBG] pgmap v4648: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:12:03.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:12:03 smithi086 bash[24289]: audit 2024-09-16T08:12:02.451704+0000 mon.b (mon.2) 638 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T08:12:03.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:12:03 smithi086 bash[24289]: audit 2024-09-16T08:12:03.313502+0000 mon.b (mon.2) 639 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T08:12:03.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:12:03 smithi086 bash[24289]: audit 2024-09-16T08:12:03.324428+0000 mon.b (mon.2) 640 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T08:12:03.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:12:03 smithi086 bash[24289]: audit 2024-09-16T08:12:03.333304+0000 mon.a (mon.0) 975 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:12:03.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:12:03 smithi086 bash[24289]: audit 2024-09-16T08:12:03.337046+0000 mon.b (mon.2) 641 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:12:04.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:12:04 smithi047 bash[22744]: audit 2024-09-16T08:12:03.184299+0000 mgr.a (mgr.14373) 6702 : audit [DBG] from='client.152766 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:12:04.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:12:04 smithi047 bash[22744]: audit 2024-09-16T08:12:03.339653+0000 mgr.a (mgr.14373) 6703 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:12:04.588 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 08:12:04 smithi047 bash[22994]: debug 2024-09-16T08:12:04.287+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T08:12:04.588 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 08:12:04 smithi047 bash[22994]: debug 2024-09-16T08:12:04.291+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T08:12:04.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:12:04 smithi157 bash[24585]: audit 2024-09-16T08:12:03.184299+0000 mgr.a (mgr.14373) 6702 : audit [DBG] from='client.152766 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:12:04.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:12:04 smithi157 bash[24585]: audit 2024-09-16T08:12:03.339653+0000 mgr.a (mgr.14373) 6703 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:12:04.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:12:04 smithi086 bash[24289]: audit 2024-09-16T08:12:03.184299+0000 mgr.a (mgr.14373) 6702 : audit [DBG] from='client.152766 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:12:04.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:12:04 smithi086 bash[24289]: audit 2024-09-16T08:12:03.339653+0000 mgr.a (mgr.14373) 6703 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:12:05.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:12:05 smithi157 bash[24585]: cluster 2024-09-16T08:12:04.277610+0000 mgr.a (mgr.14373) 6704 : cluster [DBG] pgmap v4649: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:12:05.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:12:05 smithi157 bash[24585]: audit 2024-09-16T08:12:04.294236+0000 mgr.a (mgr.14373) 6705 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T08:12:05.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:12:05 smithi157 bash[24585]: cephadm 2024-09-16T08:12:04.296759+0000 mgr.a (mgr.14373) 6706 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T08:12:05.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:12:05 smithi086 bash[24289]: cluster 2024-09-16T08:12:04.277610+0000 mgr.a (mgr.14373) 6704 : cluster [DBG] pgmap v4649: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:12:05.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:12:05 smithi086 bash[24289]: audit 2024-09-16T08:12:04.294236+0000 mgr.a (mgr.14373) 6705 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T08:12:05.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:12:05 smithi086 bash[24289]: cephadm 2024-09-16T08:12:04.296759+0000 mgr.a (mgr.14373) 6706 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T08:12:05.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:12:05 smithi047 bash[22744]: cluster 2024-09-16T08:12:04.277610+0000 mgr.a (mgr.14373) 6704 : cluster [DBG] pgmap v4649: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:12:05.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:12:05 smithi047 bash[22744]: audit 2024-09-16T08:12:04.294236+0000 mgr.a (mgr.14373) 6705 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T08:12:05.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:12:05 smithi047 bash[22744]: cephadm 2024-09-16T08:12:04.296759+0000 mgr.a (mgr.14373) 6706 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T08:12:07.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:12:07 smithi157 bash[24585]: cluster 2024-09-16T08:12:06.278418+0000 mgr.a (mgr.14373) 6707 : cluster [DBG] pgmap v4650: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:12:07.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:12:07 smithi086 bash[24289]: cluster 2024-09-16T08:12:06.278418+0000 mgr.a (mgr.14373) 6707 : cluster [DBG] pgmap v4650: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:12:07.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:12:07 smithi047 bash[22744]: cluster 2024-09-16T08:12:06.278418+0000 mgr.a (mgr.14373) 6707 : cluster [DBG] pgmap v4650: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:12:08.605 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:12:08.605 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:12:08.606 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:12:09.348 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:12:09.348 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:12:09.349 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:12:09.349 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:12:09.349 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:12:09.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:12:09 smithi157 bash[24585]: cluster 2024-09-16T08:12:08.280570+0000 mgr.a (mgr.14373) 6708 : cluster [DBG] pgmap v4651: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:12:09.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:12:09 smithi086 bash[24289]: cluster 2024-09-16T08:12:08.280570+0000 mgr.a (mgr.14373) 6708 : cluster [DBG] pgmap v4651: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:12:09.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:12:09 smithi047 bash[22744]: cluster 2024-09-16T08:12:08.280570+0000 mgr.a (mgr.14373) 6708 : cluster [DBG] pgmap v4651: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:12:10.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:12:10 smithi157 bash[24585]: audit 2024-09-16T08:12:08.940184+0000 mgr.a (mgr.14373) 6709 : audit [DBG] from='client.152952 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:12:10.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:12:10 smithi086 bash[24289]: audit 2024-09-16T08:12:08.940184+0000 mgr.a (mgr.14373) 6709 : audit [DBG] from='client.152952 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:12:10.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:12:10 smithi047 bash[22744]: audit 2024-09-16T08:12:08.940184+0000 mgr.a (mgr.14373) 6709 : audit [DBG] from='client.152952 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:12:11.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:12:11 smithi157 bash[24585]: cluster 2024-09-16T08:12:10.281536+0000 mgr.a (mgr.14373) 6710 : cluster [DBG] pgmap v4652: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:12:11.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:12:11 smithi086 bash[24289]: cluster 2024-09-16T08:12:10.281536+0000 mgr.a (mgr.14373) 6710 : cluster [DBG] pgmap v4652: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:12:11.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:12:11 smithi047 bash[22744]: cluster 2024-09-16T08:12:10.281536+0000 mgr.a (mgr.14373) 6710 : cluster [DBG] pgmap v4652: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:12:13.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:12:13 smithi157 bash[24585]: cluster 2024-09-16T08:12:12.283672+0000 mgr.a (mgr.14373) 6711 : cluster [DBG] pgmap v4653: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:12:13.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:12:13 smithi086 bash[24289]: cluster 2024-09-16T08:12:12.283672+0000 mgr.a (mgr.14373) 6711 : cluster [DBG] pgmap v4653: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:12:13.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:12:13 smithi047 bash[22744]: cluster 2024-09-16T08:12:12.283672+0000 mgr.a (mgr.14373) 6711 : cluster [DBG] pgmap v4653: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:12:14.350 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:12:14.350 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:12:14.351 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:12:15.100 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:12:15.101 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:12:15.101 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:12:15.101 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:12:15.101 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:12:15.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:12:15 smithi157 bash[24585]: cluster 2024-09-16T08:12:14.284440+0000 mgr.a (mgr.14373) 6712 : cluster [DBG] pgmap v4654: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:12:15.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:12:15 smithi086 bash[24289]: cluster 2024-09-16T08:12:14.284440+0000 mgr.a (mgr.14373) 6712 : cluster [DBG] pgmap v4654: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:12:15.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:12:15 smithi047 bash[22744]: cluster 2024-09-16T08:12:14.284440+0000 mgr.a (mgr.14373) 6712 : cluster [DBG] pgmap v4654: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:12:16.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:12:16 smithi157 bash[24585]: audit 2024-09-16T08:12:14.684855+0000 mgr.a (mgr.14373) 6713 : audit [DBG] from='client.153030 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:12:16.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:12:16 smithi086 bash[24289]: audit 2024-09-16T08:12:14.684855+0000 mgr.a (mgr.14373) 6713 : audit [DBG] from='client.153030 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:12:16.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:12:16 smithi047 bash[22744]: audit 2024-09-16T08:12:14.684855+0000 mgr.a (mgr.14373) 6713 : audit [DBG] from='client.153030 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:12:17.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:12:17 smithi157 bash[24585]: cluster 2024-09-16T08:12:16.285544+0000 mgr.a (mgr.14373) 6714 : cluster [DBG] pgmap v4655: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:12:17.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:12:17 smithi086 bash[24289]: cluster 2024-09-16T08:12:16.285544+0000 mgr.a (mgr.14373) 6714 : cluster [DBG] pgmap v4655: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:12:17.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:12:17 smithi047 bash[22744]: cluster 2024-09-16T08:12:16.285544+0000 mgr.a (mgr.14373) 6714 : cluster [DBG] pgmap v4655: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:12:19.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:12:19 smithi157 bash[24585]: cluster 2024-09-16T08:12:18.288017+0000 mgr.a (mgr.14373) 6715 : cluster [DBG] pgmap v4656: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:12:19.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:12:19 smithi086 bash[24289]: cluster 2024-09-16T08:12:18.288017+0000 mgr.a (mgr.14373) 6715 : cluster [DBG] pgmap v4656: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:12:19.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:12:19 smithi047 bash[22744]: cluster 2024-09-16T08:12:18.288017+0000 mgr.a (mgr.14373) 6715 : cluster [DBG] pgmap v4656: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:12:20.101 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:12:20.102 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:12:20.102 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:12:20.852 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:12:20.852 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:12:20.852 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:12:20.852 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:12:20.852 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:12:21.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:12:21 smithi157 bash[24585]: cluster 2024-09-16T08:12:20.288789+0000 mgr.a (mgr.14373) 6716 : cluster [DBG] pgmap v4657: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:12:21.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:12:21 smithi086 bash[24289]: cluster 2024-09-16T08:12:20.288789+0000 mgr.a (mgr.14373) 6716 : cluster [DBG] pgmap v4657: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:12:21.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:12:21 smithi047 bash[22744]: cluster 2024-09-16T08:12:20.288789+0000 mgr.a (mgr.14373) 6716 : cluster [DBG] pgmap v4657: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:12:22.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:12:22 smithi157 bash[24585]: audit 2024-09-16T08:12:20.435908+0000 mgr.a (mgr.14373) 6717 : audit [DBG] from='client.153099 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:12:22.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:12:22 smithi086 bash[24289]: audit 2024-09-16T08:12:20.435908+0000 mgr.a (mgr.14373) 6717 : audit [DBG] from='client.153099 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:12:22.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:12:22 smithi047 bash[22744]: audit 2024-09-16T08:12:20.435908+0000 mgr.a (mgr.14373) 6717 : audit [DBG] from='client.153099 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:12:23.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:12:23 smithi157 bash[24585]: cluster 2024-09-16T08:12:22.291113+0000 mgr.a (mgr.14373) 6718 : cluster [DBG] pgmap v4658: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:12:23.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:12:23 smithi086 bash[24289]: cluster 2024-09-16T08:12:22.291113+0000 mgr.a (mgr.14373) 6718 : cluster [DBG] pgmap v4658: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:12:23.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:12:23 smithi047 bash[22744]: cluster 2024-09-16T08:12:22.291113+0000 mgr.a (mgr.14373) 6718 : cluster [DBG] pgmap v4658: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:12:25.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:12:25 smithi157 bash[24585]: cluster 2024-09-16T08:12:24.291893+0000 mgr.a (mgr.14373) 6719 : cluster [DBG] pgmap v4659: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:12:25.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:12:25 smithi086 bash[24289]: cluster 2024-09-16T08:12:24.291893+0000 mgr.a (mgr.14373) 6719 : cluster [DBG] pgmap v4659: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:12:25.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:12:25 smithi047 bash[22744]: cluster 2024-09-16T08:12:24.291893+0000 mgr.a (mgr.14373) 6719 : cluster [DBG] pgmap v4659: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:12:25.853 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:12:25.854 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:12:25.854 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:12:26.640 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:12:26.640 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:12:26.641 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:12:26.641 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:12:26.641 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:12:27.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:12:27 smithi157 bash[24585]: audit 2024-09-16T08:12:26.193045+0000 mgr.a (mgr.14373) 6720 : audit [DBG] from='client.153174 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:12:27.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:12:27 smithi157 bash[24585]: cluster 2024-09-16T08:12:26.292390+0000 mgr.a (mgr.14373) 6721 : cluster [DBG] pgmap v4660: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:12:27.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:12:27 smithi086 bash[24289]: audit 2024-09-16T08:12:26.193045+0000 mgr.a (mgr.14373) 6720 : audit [DBG] from='client.153174 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:12:27.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:12:27 smithi086 bash[24289]: cluster 2024-09-16T08:12:26.292390+0000 mgr.a (mgr.14373) 6721 : cluster [DBG] pgmap v4660: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:12:27.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:12:27 smithi047 bash[22744]: audit 2024-09-16T08:12:26.193045+0000 mgr.a (mgr.14373) 6720 : audit [DBG] from='client.153174 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:12:27.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:12:27 smithi047 bash[22744]: cluster 2024-09-16T08:12:26.292390+0000 mgr.a (mgr.14373) 6721 : cluster [DBG] pgmap v4660: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:12:29.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:12:29 smithi157 bash[24585]: cluster 2024-09-16T08:12:28.295078+0000 mgr.a (mgr.14373) 6722 : cluster [DBG] pgmap v4661: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-16T08:12:29.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:12:29 smithi086 bash[24289]: cluster 2024-09-16T08:12:28.295078+0000 mgr.a (mgr.14373) 6722 : cluster [DBG] pgmap v4661: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-16T08:12:29.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:12:29 smithi047 bash[22744]: cluster 2024-09-16T08:12:28.295078+0000 mgr.a (mgr.14373) 6722 : cluster [DBG] pgmap v4661: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-16T08:12:30.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:12:30 smithi157 bash[24585]: cluster 2024-09-16T08:12:30.295862+0000 mgr.a (mgr.14373) 6723 : cluster [DBG] pgmap v4662: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-16T08:12:30.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:12:30 smithi086 bash[24289]: cluster 2024-09-16T08:12:30.295862+0000 mgr.a (mgr.14373) 6723 : cluster [DBG] pgmap v4662: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-16T08:12:30.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:12:30 smithi047 bash[22744]: cluster 2024-09-16T08:12:30.295862+0000 mgr.a (mgr.14373) 6723 : cluster [DBG] pgmap v4662: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-16T08:12:31.642 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:12:31.643 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:12:31.643 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:12:32.399 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:12:32.399 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:12:32.399 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:12:32.399 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:12:32.399 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:12:33.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:12:33 smithi157 bash[24585]: audit 2024-09-16T08:12:31.977220+0000 mgr.a (mgr.14373) 6724 : audit [DBG] from='client.153249 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:12:33.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:12:33 smithi157 bash[24585]: cluster 2024-09-16T08:12:32.305752+0000 mgr.a (mgr.14373) 6725 : cluster [DBG] pgmap v4663: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:12:33.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:12:33 smithi086 bash[24289]: audit 2024-09-16T08:12:31.977220+0000 mgr.a (mgr.14373) 6724 : audit [DBG] from='client.153249 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:12:33.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:12:33 smithi086 bash[24289]: cluster 2024-09-16T08:12:32.305752+0000 mgr.a (mgr.14373) 6725 : cluster [DBG] pgmap v4663: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:12:33.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:12:33 smithi047 bash[22744]: audit 2024-09-16T08:12:31.977220+0000 mgr.a (mgr.14373) 6724 : audit [DBG] from='client.153249 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:12:33.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:12:33 smithi047 bash[22744]: cluster 2024-09-16T08:12:32.305752+0000 mgr.a (mgr.14373) 6725 : cluster [DBG] pgmap v4663: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:12:35.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:12:35 smithi157 bash[24585]: cluster 2024-09-16T08:12:34.306537+0000 mgr.a (mgr.14373) 6726 : cluster [DBG] pgmap v4664: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:12:35.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:12:35 smithi086 bash[24289]: cluster 2024-09-16T08:12:34.306537+0000 mgr.a (mgr.14373) 6726 : cluster [DBG] pgmap v4664: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:12:35.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:12:35 smithi047 bash[22744]: cluster 2024-09-16T08:12:34.306537+0000 mgr.a (mgr.14373) 6726 : cluster [DBG] pgmap v4664: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:12:37.400 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:12:37.401 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:12:37.401 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:12:37.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:12:37 smithi157 bash[24585]: cluster 2024-09-16T08:12:36.307285+0000 mgr.a (mgr.14373) 6727 : cluster [DBG] pgmap v4665: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:12:37.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:12:37 smithi086 bash[24289]: cluster 2024-09-16T08:12:36.307285+0000 mgr.a (mgr.14373) 6727 : cluster [DBG] pgmap v4665: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:12:37.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:12:37 smithi047 bash[22744]: cluster 2024-09-16T08:12:36.307285+0000 mgr.a (mgr.14373) 6727 : cluster [DBG] pgmap v4665: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:12:38.180 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:12:38.180 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:12:38.180 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:12:38.181 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:12:38.181 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:12:39.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:12:39 smithi157 bash[24585]: audit 2024-09-16T08:12:37.739182+0000 mgr.a (mgr.14373) 6728 : audit [DBG] from='client.153321 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:12:39.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:12:39 smithi157 bash[24585]: cluster 2024-09-16T08:12:38.310058+0000 mgr.a (mgr.14373) 6729 : cluster [DBG] pgmap v4666: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:12:39.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:12:39 smithi086 bash[24289]: audit 2024-09-16T08:12:37.739182+0000 mgr.a (mgr.14373) 6728 : audit [DBG] from='client.153321 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:12:39.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:12:39 smithi086 bash[24289]: cluster 2024-09-16T08:12:38.310058+0000 mgr.a (mgr.14373) 6729 : cluster [DBG] pgmap v4666: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:12:39.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:12:39 smithi047 bash[22744]: audit 2024-09-16T08:12:37.739182+0000 mgr.a (mgr.14373) 6728 : audit [DBG] from='client.153321 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:12:39.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:12:39 smithi047 bash[22744]: cluster 2024-09-16T08:12:38.310058+0000 mgr.a (mgr.14373) 6729 : cluster [DBG] pgmap v4666: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:12:41.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:12:41 smithi157 bash[24585]: cluster 2024-09-16T08:12:40.310871+0000 mgr.a (mgr.14373) 6730 : cluster [DBG] pgmap v4667: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-16T08:12:41.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:12:41 smithi086 bash[24289]: cluster 2024-09-16T08:12:40.310871+0000 mgr.a (mgr.14373) 6730 : cluster [DBG] pgmap v4667: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-16T08:12:41.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:12:41 smithi047 bash[22744]: cluster 2024-09-16T08:12:40.310871+0000 mgr.a (mgr.14373) 6730 : cluster [DBG] pgmap v4667: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-16T08:12:43.182 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:12:43.183 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:12:43.183 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:12:43.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:12:43 smithi157 bash[24585]: cluster 2024-09-16T08:12:42.312974+0000 mgr.a (mgr.14373) 6731 : cluster [DBG] pgmap v4668: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-09-16T08:12:43.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:12:43 smithi086 bash[24289]: cluster 2024-09-16T08:12:42.312974+0000 mgr.a (mgr.14373) 6731 : cluster [DBG] pgmap v4668: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-09-16T08:12:43.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:12:43 smithi047 bash[22744]: cluster 2024-09-16T08:12:42.312974+0000 mgr.a (mgr.14373) 6731 : cluster [DBG] pgmap v4668: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-09-16T08:12:43.931 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:12:43.931 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:12:43.931 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:12:43.931 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:12:43.931 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:12:45.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:12:45 smithi157 bash[24585]: audit 2024-09-16T08:12:43.518020+0000 mgr.a (mgr.14373) 6732 : audit [DBG] from='client.153399 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:12:45.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:12:45 smithi157 bash[24585]: cluster 2024-09-16T08:12:44.313963+0000 mgr.a (mgr.14373) 6733 : cluster [DBG] pgmap v4669: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:12:45.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:12:45 smithi086 bash[24289]: audit 2024-09-16T08:12:43.518020+0000 mgr.a (mgr.14373) 6732 : audit [DBG] from='client.153399 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:12:45.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:12:45 smithi086 bash[24289]: cluster 2024-09-16T08:12:44.313963+0000 mgr.a (mgr.14373) 6733 : cluster [DBG] pgmap v4669: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:12:45.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:12:45 smithi047 bash[22744]: audit 2024-09-16T08:12:43.518020+0000 mgr.a (mgr.14373) 6732 : audit [DBG] from='client.153399 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:12:45.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:12:45 smithi047 bash[22744]: cluster 2024-09-16T08:12:44.313963+0000 mgr.a (mgr.14373) 6733 : cluster [DBG] pgmap v4669: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:12:47.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:12:47 smithi157 bash[24585]: cluster 2024-09-16T08:12:46.314795+0000 mgr.a (mgr.14373) 6734 : cluster [DBG] pgmap v4670: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:12:47.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:12:47 smithi086 bash[24289]: cluster 2024-09-16T08:12:46.314795+0000 mgr.a (mgr.14373) 6734 : cluster [DBG] pgmap v4670: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:12:47.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:12:47 smithi047 bash[22744]: cluster 2024-09-16T08:12:46.314795+0000 mgr.a (mgr.14373) 6734 : cluster [DBG] pgmap v4670: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:12:48.933 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:12:48.933 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:12:48.934 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:12:49.670 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:12:49.671 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:12:49.671 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:12:49.671 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:12:49.671 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:12:49.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:12:49 smithi157 bash[24585]: cluster 2024-09-16T08:12:48.317003+0000 mgr.a (mgr.14373) 6735 : cluster [DBG] pgmap v4671: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:12:49.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:12:49 smithi086 bash[24289]: cluster 2024-09-16T08:12:48.317003+0000 mgr.a (mgr.14373) 6735 : cluster [DBG] pgmap v4671: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:12:49.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:12:49 smithi047 bash[22744]: cluster 2024-09-16T08:12:48.317003+0000 mgr.a (mgr.14373) 6735 : cluster [DBG] pgmap v4671: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:12:50.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:12:50 smithi157 bash[24585]: audit 2024-09-16T08:12:49.268203+0000 mgr.a (mgr.14373) 6736 : audit [DBG] from='client.153474 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:12:50.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:12:50 smithi086 bash[24289]: audit 2024-09-16T08:12:49.268203+0000 mgr.a (mgr.14373) 6736 : audit [DBG] from='client.153474 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:12:50.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:12:50 smithi047 bash[22744]: audit 2024-09-16T08:12:49.268203+0000 mgr.a (mgr.14373) 6736 : audit [DBG] from='client.153474 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:12:51.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:12:51 smithi157 bash[24585]: cluster 2024-09-16T08:12:50.317958+0000 mgr.a (mgr.14373) 6737 : cluster [DBG] pgmap v4672: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:12:51.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:12:51 smithi086 bash[24289]: cluster 2024-09-16T08:12:50.317958+0000 mgr.a (mgr.14373) 6737 : cluster [DBG] pgmap v4672: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:12:51.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:12:51 smithi047 bash[22744]: cluster 2024-09-16T08:12:50.317958+0000 mgr.a (mgr.14373) 6737 : cluster [DBG] pgmap v4672: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:12:53.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:12:53 smithi157 bash[24585]: cluster 2024-09-16T08:12:52.320212+0000 mgr.a (mgr.14373) 6738 : cluster [DBG] pgmap v4673: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:12:53.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:12:53 smithi086 bash[24289]: cluster 2024-09-16T08:12:52.320212+0000 mgr.a (mgr.14373) 6738 : cluster [DBG] pgmap v4673: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:12:53.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:12:53 smithi047 bash[22744]: cluster 2024-09-16T08:12:52.320212+0000 mgr.a (mgr.14373) 6738 : cluster [DBG] pgmap v4673: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:12:54.672 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:12:54.673 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:12:54.673 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:12:55.454 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:12:55.454 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:12:55.454 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:12:55.454 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:12:55.454 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:12:55.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:12:55 smithi157 bash[24585]: cluster 2024-09-16T08:12:54.320982+0000 mgr.a (mgr.14373) 6739 : cluster [DBG] pgmap v4674: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:12:55.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:12:55 smithi086 bash[24289]: cluster 2024-09-16T08:12:54.320982+0000 mgr.a (mgr.14373) 6739 : cluster [DBG] pgmap v4674: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:12:55.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:12:55 smithi047 bash[22744]: cluster 2024-09-16T08:12:54.320982+0000 mgr.a (mgr.14373) 6739 : cluster [DBG] pgmap v4674: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:12:56.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:12:56 smithi157 bash[24585]: audit 2024-09-16T08:12:55.013084+0000 mgr.a (mgr.14373) 6740 : audit [DBG] from='client.153552 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:12:56.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:12:56 smithi086 bash[24289]: audit 2024-09-16T08:12:55.013084+0000 mgr.a (mgr.14373) 6740 : audit [DBG] from='client.153552 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:12:56.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:12:56 smithi047 bash[22744]: audit 2024-09-16T08:12:55.013084+0000 mgr.a (mgr.14373) 6740 : audit [DBG] from='client.153552 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:12:57.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:12:57 smithi157 bash[24585]: cluster 2024-09-16T08:12:56.321956+0000 mgr.a (mgr.14373) 6741 : cluster [DBG] pgmap v4675: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:12:57.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:12:57 smithi086 bash[24289]: cluster 2024-09-16T08:12:56.321956+0000 mgr.a (mgr.14373) 6741 : cluster [DBG] pgmap v4675: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:12:57.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:12:57 smithi047 bash[22744]: cluster 2024-09-16T08:12:56.321956+0000 mgr.a (mgr.14373) 6741 : cluster [DBG] pgmap v4675: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:12:58.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:12:58 smithi157 bash[24585]: cluster 2024-09-16T08:12:58.324208+0000 mgr.a (mgr.14373) 6742 : cluster [DBG] pgmap v4676: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:12:58.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:12:58 smithi086 bash[24289]: cluster 2024-09-16T08:12:58.324208+0000 mgr.a (mgr.14373) 6742 : cluster [DBG] pgmap v4676: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:12:58.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:12:58 smithi047 bash[22744]: cluster 2024-09-16T08:12:58.324208+0000 mgr.a (mgr.14373) 6742 : cluster [DBG] pgmap v4676: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:13:00.456 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:13:00.457 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:13:00.457 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:13:01.209 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:13:01.209 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:13:01.210 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:13:01.210 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:13:01.210 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:13:01.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:13:01 smithi157 bash[24585]: cluster 2024-09-16T08:13:00.324957+0000 mgr.a (mgr.14373) 6743 : cluster [DBG] pgmap v4677: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:13:01.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:13:01 smithi086 bash[24289]: cluster 2024-09-16T08:13:00.324957+0000 mgr.a (mgr.14373) 6743 : cluster [DBG] pgmap v4677: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:13:01.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:13:01 smithi047 bash[22744]: cluster 2024-09-16T08:13:00.324957+0000 mgr.a (mgr.14373) 6743 : cluster [DBG] pgmap v4677: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:13:02.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:13:02 smithi157 bash[24585]: audit 2024-09-16T08:13:00.787968+0000 mgr.a (mgr.14373) 6744 : audit [DBG] from='client.153624 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:13:02.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:13:02 smithi086 bash[24289]: audit 2024-09-16T08:13:00.787968+0000 mgr.a (mgr.14373) 6744 : audit [DBG] from='client.153624 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:13:02.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:13:02 smithi047 bash[22744]: audit 2024-09-16T08:13:00.787968+0000 mgr.a (mgr.14373) 6744 : audit [DBG] from='client.153624 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:13:03.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:13:03 smithi157 bash[24585]: cluster 2024-09-16T08:13:02.327287+0000 mgr.a (mgr.14373) 6745 : cluster [DBG] pgmap v4678: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:13:03.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:13:03 smithi086 bash[24289]: cluster 2024-09-16T08:13:02.327287+0000 mgr.a (mgr.14373) 6745 : cluster [DBG] pgmap v4678: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:13:03.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:13:03 smithi047 bash[22744]: cluster 2024-09-16T08:13:02.327287+0000 mgr.a (mgr.14373) 6745 : cluster [DBG] pgmap v4678: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:13:04.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:13:04 smithi157 bash[24585]: audit 2024-09-16T08:13:04.347161+0000 mon.b (mon.2) 642 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T08:13:04.836 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:13:04 smithi086 bash[24289]: audit 2024-09-16T08:13:04.347161+0000 mon.b (mon.2) 642 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T08:13:04.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:13:04 smithi047 bash[22744]: audit 2024-09-16T08:13:04.347161+0000 mon.b (mon.2) 642 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T08:13:05.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:13:05 smithi157 bash[24585]: cluster 2024-09-16T08:13:04.328155+0000 mgr.a (mgr.14373) 6746 : cluster [DBG] pgmap v4679: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:13:05.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:13:05 smithi157 bash[24585]: audit 2024-09-16T08:13:05.205119+0000 mon.b (mon.2) 643 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T08:13:05.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:13:05 smithi157 bash[24585]: audit 2024-09-16T08:13:05.207225+0000 mon.b (mon.2) 644 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T08:13:05.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:13:05 smithi157 bash[24585]: audit 2024-09-16T08:13:05.220211+0000 mon.a (mon.0) 976 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:13:05.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:13:05 smithi157 bash[24585]: audit 2024-09-16T08:13:05.222202+0000 mon.b (mon.2) 645 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:13:05.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:13:05 smithi086 bash[24289]: cluster 2024-09-16T08:13:04.328155+0000 mgr.a (mgr.14373) 6746 : cluster [DBG] pgmap v4679: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:13:05.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:13:05 smithi086 bash[24289]: audit 2024-09-16T08:13:05.205119+0000 mon.b (mon.2) 643 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T08:13:05.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:13:05 smithi086 bash[24289]: audit 2024-09-16T08:13:05.207225+0000 mon.b (mon.2) 644 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T08:13:05.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:13:05 smithi086 bash[24289]: audit 2024-09-16T08:13:05.220211+0000 mon.a (mon.0) 976 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:13:05.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:13:05 smithi086 bash[24289]: audit 2024-09-16T08:13:05.222202+0000 mon.b (mon.2) 645 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:13:05.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:13:05 smithi047 bash[22744]: cluster 2024-09-16T08:13:04.328155+0000 mgr.a (mgr.14373) 6746 : cluster [DBG] pgmap v4679: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:13:05.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:13:05 smithi047 bash[22744]: audit 2024-09-16T08:13:05.205119+0000 mon.b (mon.2) 643 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T08:13:05.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:13:05 smithi047 bash[22744]: audit 2024-09-16T08:13:05.207225+0000 mon.b (mon.2) 644 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T08:13:05.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:13:05 smithi047 bash[22744]: audit 2024-09-16T08:13:05.220211+0000 mon.a (mon.0) 976 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:13:05.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:13:05 smithi047 bash[22744]: audit 2024-09-16T08:13:05.222202+0000 mon.b (mon.2) 645 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:13:06.211 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:13:06.211 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:13:06.212 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:13:06.338 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 08:13:05 smithi047 bash[22994]: debug 2024-09-16T08:13:05.954+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T08:13:06.338 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 08:13:05 smithi047 bash[22994]: debug 2024-09-16T08:13:05.958+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T08:13:06.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:13:06 smithi157 bash[24585]: audit 2024-09-16T08:13:05.226032+0000 mgr.a (mgr.14373) 6747 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:13:06.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:13:06 smithi086 bash[24289]: audit 2024-09-16T08:13:05.226032+0000 mgr.a (mgr.14373) 6747 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:13:06.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:13:06 smithi047 bash[22744]: audit 2024-09-16T08:13:05.226032+0000 mgr.a (mgr.14373) 6747 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:13:06.953 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:13:06.954 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:13:06.954 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:13:06.954 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:13:06.954 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:13:07.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:13:07 smithi157 bash[24585]: audit 2024-09-16T08:13:05.956732+0000 mgr.a (mgr.14373) 6748 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T08:13:07.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:13:07 smithi157 bash[24585]: cephadm 2024-09-16T08:13:05.958737+0000 mgr.a (mgr.14373) 6749 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T08:13:07.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:13:07 smithi157 bash[24585]: cluster 2024-09-16T08:13:06.328636+0000 mgr.a (mgr.14373) 6750 : cluster [DBG] pgmap v4680: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:13:07.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:13:07 smithi086 bash[24289]: audit 2024-09-16T08:13:05.956732+0000 mgr.a (mgr.14373) 6748 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T08:13:07.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:13:07 smithi086 bash[24289]: cephadm 2024-09-16T08:13:05.958737+0000 mgr.a (mgr.14373) 6749 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T08:13:07.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:13:07 smithi086 bash[24289]: cluster 2024-09-16T08:13:06.328636+0000 mgr.a (mgr.14373) 6750 : cluster [DBG] pgmap v4680: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:13:07.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:13:07 smithi047 bash[22744]: audit 2024-09-16T08:13:05.956732+0000 mgr.a (mgr.14373) 6748 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T08:13:07.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:13:07 smithi047 bash[22744]: cephadm 2024-09-16T08:13:05.958737+0000 mgr.a (mgr.14373) 6749 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T08:13:07.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:13:07 smithi047 bash[22744]: cluster 2024-09-16T08:13:06.328636+0000 mgr.a (mgr.14373) 6750 : cluster [DBG] pgmap v4680: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:13:08.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:13:08 smithi157 bash[24585]: audit 2024-09-16T08:13:06.550617+0000 mgr.a (mgr.14373) 6751 : audit [DBG] from='client.153807 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:13:08.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:13:08 smithi086 bash[24289]: audit 2024-09-16T08:13:06.550617+0000 mgr.a (mgr.14373) 6751 : audit [DBG] from='client.153807 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:13:08.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:13:08 smithi047 bash[22744]: audit 2024-09-16T08:13:06.550617+0000 mgr.a (mgr.14373) 6751 : audit [DBG] from='client.153807 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:13:09.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:13:09 smithi157 bash[24585]: cluster 2024-09-16T08:13:08.331257+0000 mgr.a (mgr.14373) 6752 : cluster [DBG] pgmap v4681: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:13:09.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:13:09 smithi086 bash[24289]: cluster 2024-09-16T08:13:08.331257+0000 mgr.a (mgr.14373) 6752 : cluster [DBG] pgmap v4681: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:13:09.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:13:09 smithi047 bash[22744]: cluster 2024-09-16T08:13:08.331257+0000 mgr.a (mgr.14373) 6752 : cluster [DBG] pgmap v4681: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:13:11.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:13:11 smithi157 bash[24585]: cluster 2024-09-16T08:13:10.332016+0000 mgr.a (mgr.14373) 6753 : cluster [DBG] pgmap v4682: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T08:13:11.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:13:11 smithi086 bash[24289]: cluster 2024-09-16T08:13:10.332016+0000 mgr.a (mgr.14373) 6753 : cluster [DBG] pgmap v4682: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T08:13:11.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:13:11 smithi047 bash[22744]: cluster 2024-09-16T08:13:10.332016+0000 mgr.a (mgr.14373) 6753 : cluster [DBG] pgmap v4682: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T08:13:11.955 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:13:11.957 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:13:11.957 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:13:12.695 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:13:12.696 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:13:12.696 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:13:12.696 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:13:12.696 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:13:12.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:13:12 smithi157 bash[24585]: audit 2024-09-16T08:13:12.283661+0000 mgr.a (mgr.14373) 6754 : audit [DBG] from='client.153879 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:13:12.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:13:12 smithi157 bash[24585]: cluster 2024-09-16T08:13:12.334144+0000 mgr.a (mgr.14373) 6755 : cluster [DBG] pgmap v4683: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:13:12.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:13:12 smithi086 bash[24289]: audit 2024-09-16T08:13:12.283661+0000 mgr.a (mgr.14373) 6754 : audit [DBG] from='client.153879 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:13:12.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:13:12 smithi086 bash[24289]: cluster 2024-09-16T08:13:12.334144+0000 mgr.a (mgr.14373) 6755 : cluster [DBG] pgmap v4683: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:13:12.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:13:12 smithi047 bash[22744]: audit 2024-09-16T08:13:12.283661+0000 mgr.a (mgr.14373) 6754 : audit [DBG] from='client.153879 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:13:12.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:13:12 smithi047 bash[22744]: cluster 2024-09-16T08:13:12.334144+0000 mgr.a (mgr.14373) 6755 : cluster [DBG] pgmap v4683: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:13:15.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:13:15 smithi157 bash[24585]: cluster 2024-09-16T08:13:14.335040+0000 mgr.a (mgr.14373) 6756 : cluster [DBG] pgmap v4684: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T08:13:15.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:13:15 smithi086 bash[24289]: cluster 2024-09-16T08:13:14.335040+0000 mgr.a (mgr.14373) 6756 : cluster [DBG] pgmap v4684: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T08:13:15.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:13:15 smithi047 bash[22744]: cluster 2024-09-16T08:13:14.335040+0000 mgr.a (mgr.14373) 6756 : cluster [DBG] pgmap v4684: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T08:13:17.697 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:13:17.698 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:13:17.698 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:13:17.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:13:17 smithi157 bash[24585]: cluster 2024-09-16T08:13:16.335801+0000 mgr.a (mgr.14373) 6757 : cluster [DBG] pgmap v4685: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T08:13:17.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:13:17 smithi086 bash[24289]: cluster 2024-09-16T08:13:16.335801+0000 mgr.a (mgr.14373) 6757 : cluster [DBG] pgmap v4685: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T08:13:17.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:13:17 smithi047 bash[22744]: cluster 2024-09-16T08:13:16.335801+0000 mgr.a (mgr.14373) 6757 : cluster [DBG] pgmap v4685: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T08:13:18.467 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:13:18.467 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:13:18.467 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:13:18.468 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:13:18.468 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:13:19.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:13:19 smithi157 bash[24585]: audit 2024-09-16T08:13:18.032822+0000 mgr.a (mgr.14373) 6758 : audit [DBG] from='client.153951 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:13:19.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:13:19 smithi157 bash[24585]: cluster 2024-09-16T08:13:18.337341+0000 mgr.a (mgr.14373) 6759 : cluster [DBG] pgmap v4686: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:13:19.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:13:19 smithi086 bash[24289]: audit 2024-09-16T08:13:18.032822+0000 mgr.a (mgr.14373) 6758 : audit [DBG] from='client.153951 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:13:19.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:13:19 smithi086 bash[24289]: cluster 2024-09-16T08:13:18.337341+0000 mgr.a (mgr.14373) 6759 : cluster [DBG] pgmap v4686: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:13:19.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:13:19 smithi047 bash[22744]: audit 2024-09-16T08:13:18.032822+0000 mgr.a (mgr.14373) 6758 : audit [DBG] from='client.153951 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:13:19.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:13:19 smithi047 bash[22744]: cluster 2024-09-16T08:13:18.337341+0000 mgr.a (mgr.14373) 6759 : cluster [DBG] pgmap v4686: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:13:21.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:13:21 smithi157 bash[24585]: cluster 2024-09-16T08:13:20.338400+0000 mgr.a (mgr.14373) 6760 : cluster [DBG] pgmap v4687: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:13:21.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:13:21 smithi086 bash[24289]: cluster 2024-09-16T08:13:20.338400+0000 mgr.a (mgr.14373) 6760 : cluster [DBG] pgmap v4687: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:13:21.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:13:21 smithi047 bash[22744]: cluster 2024-09-16T08:13:20.338400+0000 mgr.a (mgr.14373) 6760 : cluster [DBG] pgmap v4687: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:13:23.469 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:13:23.469 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:13:23.469 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:13:23.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:13:23 smithi157 bash[24585]: cluster 2024-09-16T08:13:22.340704+0000 mgr.a (mgr.14373) 6761 : cluster [DBG] pgmap v4688: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:13:23.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:13:23 smithi086 bash[24289]: cluster 2024-09-16T08:13:22.340704+0000 mgr.a (mgr.14373) 6761 : cluster [DBG] pgmap v4688: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:13:23.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:13:23 smithi047 bash[22744]: cluster 2024-09-16T08:13:22.340704+0000 mgr.a (mgr.14373) 6761 : cluster [DBG] pgmap v4688: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:13:24.228 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:13:24.228 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:13:24.228 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:13:24.229 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:13:24.229 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:13:25.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:13:25 smithi157 bash[24585]: audit 2024-09-16T08:13:23.803945+0000 mgr.a (mgr.14373) 6762 : audit [DBG] from='client.154029 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:13:25.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:13:25 smithi157 bash[24585]: cluster 2024-09-16T08:13:24.341628+0000 mgr.a (mgr.14373) 6763 : cluster [DBG] pgmap v4689: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:13:25.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:13:25 smithi086 bash[24289]: audit 2024-09-16T08:13:23.803945+0000 mgr.a (mgr.14373) 6762 : audit [DBG] from='client.154029 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:13:25.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:13:25 smithi086 bash[24289]: cluster 2024-09-16T08:13:24.341628+0000 mgr.a (mgr.14373) 6763 : cluster [DBG] pgmap v4689: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:13:25.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:13:25 smithi047 bash[22744]: audit 2024-09-16T08:13:23.803945+0000 mgr.a (mgr.14373) 6762 : audit [DBG] from='client.154029 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:13:25.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:13:25 smithi047 bash[22744]: cluster 2024-09-16T08:13:24.341628+0000 mgr.a (mgr.14373) 6763 : cluster [DBG] pgmap v4689: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:13:27.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:13:27 smithi157 bash[24585]: cluster 2024-09-16T08:13:26.342470+0000 mgr.a (mgr.14373) 6764 : cluster [DBG] pgmap v4690: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:13:27.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:13:27 smithi086 bash[24289]: cluster 2024-09-16T08:13:26.342470+0000 mgr.a (mgr.14373) 6764 : cluster [DBG] pgmap v4690: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:13:27.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:13:27 smithi047 bash[22744]: cluster 2024-09-16T08:13:26.342470+0000 mgr.a (mgr.14373) 6764 : cluster [DBG] pgmap v4690: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:13:29.230 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:13:29.230 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:13:29.231 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:13:29.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:13:29 smithi157 bash[24585]: cluster 2024-09-16T08:13:28.344723+0000 mgr.a (mgr.14373) 6765 : cluster [DBG] pgmap v4691: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:13:29.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:13:29 smithi086 bash[24289]: cluster 2024-09-16T08:13:28.344723+0000 mgr.a (mgr.14373) 6765 : cluster [DBG] pgmap v4691: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:13:29.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:13:29 smithi047 bash[22744]: cluster 2024-09-16T08:13:28.344723+0000 mgr.a (mgr.14373) 6765 : cluster [DBG] pgmap v4691: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:13:29.984 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:13:29.985 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:13:29.985 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:13:29.985 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:13:29.985 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:13:31.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:13:31 smithi157 bash[24585]: audit 2024-09-16T08:13:29.568971+0000 mgr.a (mgr.14373) 6766 : audit [DBG] from='client.154107 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:13:31.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:13:31 smithi157 bash[24585]: cluster 2024-09-16T08:13:30.345852+0000 mgr.a (mgr.14373) 6767 : cluster [DBG] pgmap v4692: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:13:31.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:13:31 smithi086 bash[24289]: audit 2024-09-16T08:13:29.568971+0000 mgr.a (mgr.14373) 6766 : audit [DBG] from='client.154107 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:13:31.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:13:31 smithi086 bash[24289]: cluster 2024-09-16T08:13:30.345852+0000 mgr.a (mgr.14373) 6767 : cluster [DBG] pgmap v4692: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:13:31.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:13:31 smithi047 bash[22744]: audit 2024-09-16T08:13:29.568971+0000 mgr.a (mgr.14373) 6766 : audit [DBG] from='client.154107 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:13:31.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:13:31 smithi047 bash[22744]: cluster 2024-09-16T08:13:30.345852+0000 mgr.a (mgr.14373) 6767 : cluster [DBG] pgmap v4692: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:13:33.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:13:33 smithi157 bash[24585]: cluster 2024-09-16T08:13:32.348159+0000 mgr.a (mgr.14373) 6768 : cluster [DBG] pgmap v4693: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:13:33.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:13:33 smithi086 bash[24289]: cluster 2024-09-16T08:13:32.348159+0000 mgr.a (mgr.14373) 6768 : cluster [DBG] pgmap v4693: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:13:33.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:13:33 smithi047 bash[22744]: cluster 2024-09-16T08:13:32.348159+0000 mgr.a (mgr.14373) 6768 : cluster [DBG] pgmap v4693: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:13:34.986 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:13:34.986 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:13:34.987 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:13:35.727 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:13:35.728 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:13:35.728 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:13:35.728 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:13:35.728 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:13:35.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:13:35 smithi157 bash[24585]: cluster 2024-09-16T08:13:34.348910+0000 mgr.a (mgr.14373) 6769 : cluster [DBG] pgmap v4694: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:13:35.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:13:35 smithi157 bash[24585]: audit 2024-09-16T08:13:35.319255+0000 mgr.a (mgr.14373) 6770 : audit [DBG] from='client.154176 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:13:35.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:13:35 smithi086 bash[24289]: cluster 2024-09-16T08:13:34.348910+0000 mgr.a (mgr.14373) 6769 : cluster [DBG] pgmap v4694: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:13:35.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:13:35 smithi086 bash[24289]: audit 2024-09-16T08:13:35.319255+0000 mgr.a (mgr.14373) 6770 : audit [DBG] from='client.154176 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:13:35.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:13:35 smithi047 bash[22744]: cluster 2024-09-16T08:13:34.348910+0000 mgr.a (mgr.14373) 6769 : cluster [DBG] pgmap v4694: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:13:35.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:13:35 smithi047 bash[22744]: audit 2024-09-16T08:13:35.319255+0000 mgr.a (mgr.14373) 6770 : audit [DBG] from='client.154176 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:13:36.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:13:36 smithi157 bash[24585]: cluster 2024-09-16T08:13:36.349890+0000 mgr.a (mgr.14373) 6771 : cluster [DBG] pgmap v4695: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:13:36.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:13:36 smithi086 bash[24289]: cluster 2024-09-16T08:13:36.349890+0000 mgr.a (mgr.14373) 6771 : cluster [DBG] pgmap v4695: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:13:36.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:13:36 smithi047 bash[22744]: cluster 2024-09-16T08:13:36.349890+0000 mgr.a (mgr.14373) 6771 : cluster [DBG] pgmap v4695: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:13:39.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:13:39 smithi157 bash[24585]: cluster 2024-09-16T08:13:38.352141+0000 mgr.a (mgr.14373) 6772 : cluster [DBG] pgmap v4696: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:13:39.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:13:39 smithi086 bash[24289]: cluster 2024-09-16T08:13:38.352141+0000 mgr.a (mgr.14373) 6772 : cluster [DBG] pgmap v4696: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:13:39.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:13:39 smithi047 bash[22744]: cluster 2024-09-16T08:13:38.352141+0000 mgr.a (mgr.14373) 6772 : cluster [DBG] pgmap v4696: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:13:40.730 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:13:40.731 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:13:40.732 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:13:41.493 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:13:41.493 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:13:41.493 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:13:41.493 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:13:41.493 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:13:41.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:13:41 smithi157 bash[24585]: cluster 2024-09-16T08:13:40.352885+0000 mgr.a (mgr.14373) 6773 : cluster [DBG] pgmap v4697: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:13:41.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:13:41 smithi086 bash[24289]: cluster 2024-09-16T08:13:40.352885+0000 mgr.a (mgr.14373) 6773 : cluster [DBG] pgmap v4697: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:13:41.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:13:41 smithi047 bash[22744]: cluster 2024-09-16T08:13:40.352885+0000 mgr.a (mgr.14373) 6773 : cluster [DBG] pgmap v4697: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:13:42.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:13:42 smithi157 bash[24585]: audit 2024-09-16T08:13:41.062137+0000 mgr.a (mgr.14373) 6774 : audit [DBG] from='client.154254 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:13:42.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:13:42 smithi086 bash[24289]: audit 2024-09-16T08:13:41.062137+0000 mgr.a (mgr.14373) 6774 : audit [DBG] from='client.154254 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:13:42.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:13:42 smithi047 bash[22744]: audit 2024-09-16T08:13:41.062137+0000 mgr.a (mgr.14373) 6774 : audit [DBG] from='client.154254 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:13:43.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:13:43 smithi157 bash[24585]: cluster 2024-09-16T08:13:42.355256+0000 mgr.a (mgr.14373) 6775 : cluster [DBG] pgmap v4698: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-16T08:13:43.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:13:43 smithi086 bash[24289]: cluster 2024-09-16T08:13:42.355256+0000 mgr.a (mgr.14373) 6775 : cluster [DBG] pgmap v4698: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-16T08:13:43.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:13:43 smithi047 bash[22744]: cluster 2024-09-16T08:13:42.355256+0000 mgr.a (mgr.14373) 6775 : cluster [DBG] pgmap v4698: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-16T08:13:45.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:13:45 smithi157 bash[24585]: cluster 2024-09-16T08:13:44.355995+0000 mgr.a (mgr.14373) 6776 : cluster [DBG] pgmap v4699: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T08:13:45.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:13:45 smithi086 bash[24289]: cluster 2024-09-16T08:13:44.355995+0000 mgr.a (mgr.14373) 6776 : cluster [DBG] pgmap v4699: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T08:13:45.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:13:45 smithi047 bash[22744]: cluster 2024-09-16T08:13:44.355995+0000 mgr.a (mgr.14373) 6776 : cluster [DBG] pgmap v4699: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T08:13:46.494 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:13:46.495 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:13:46.495 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:13:47.250 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:13:47.250 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:13:47.250 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:13:47.250 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:13:47.250 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:13:47.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:13:47 smithi157 bash[24585]: cluster 2024-09-16T08:13:46.356734+0000 mgr.a (mgr.14373) 6777 : cluster [DBG] pgmap v4700: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T08:13:47.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:13:47 smithi086 bash[24289]: cluster 2024-09-16T08:13:46.356734+0000 mgr.a (mgr.14373) 6777 : cluster [DBG] pgmap v4700: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T08:13:47.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:13:47 smithi047 bash[22744]: cluster 2024-09-16T08:13:46.356734+0000 mgr.a (mgr.14373) 6777 : cluster [DBG] pgmap v4700: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T08:13:48.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:13:48 smithi157 bash[24585]: audit 2024-09-16T08:13:46.829824+0000 mgr.a (mgr.14373) 6778 : audit [DBG] from='client.154329 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:13:48.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:13:48 smithi086 bash[24289]: audit 2024-09-16T08:13:46.829824+0000 mgr.a (mgr.14373) 6778 : audit [DBG] from='client.154329 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:13:48.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:13:48 smithi047 bash[22744]: audit 2024-09-16T08:13:46.829824+0000 mgr.a (mgr.14373) 6778 : audit [DBG] from='client.154329 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:13:49.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:13:49 smithi157 bash[24585]: cluster 2024-09-16T08:13:48.359416+0000 mgr.a (mgr.14373) 6779 : cluster [DBG] pgmap v4701: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:13:49.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:13:49 smithi086 bash[24289]: cluster 2024-09-16T08:13:48.359416+0000 mgr.a (mgr.14373) 6779 : cluster [DBG] pgmap v4701: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:13:49.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:13:49 smithi047 bash[22744]: cluster 2024-09-16T08:13:48.359416+0000 mgr.a (mgr.14373) 6779 : cluster [DBG] pgmap v4701: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:13:50.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:13:50 smithi157 bash[24585]: cluster 2024-09-16T08:13:50.360195+0000 mgr.a (mgr.14373) 6780 : cluster [DBG] pgmap v4702: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:13:50.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:13:50 smithi086 bash[24289]: cluster 2024-09-16T08:13:50.360195+0000 mgr.a (mgr.14373) 6780 : cluster [DBG] pgmap v4702: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:13:50.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:13:50 smithi047 bash[22744]: cluster 2024-09-16T08:13:50.360195+0000 mgr.a (mgr.14373) 6780 : cluster [DBG] pgmap v4702: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:13:52.251 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:13:52.252 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:13:52.252 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:13:52.989 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:13:52.989 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:13:52.990 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:13:52.990 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:13:52.990 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:13:53.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:13:53 smithi157 bash[24585]: cluster 2024-09-16T08:13:52.361122+0000 mgr.a (mgr.14373) 6781 : cluster [DBG] pgmap v4703: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:13:53.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:13:53 smithi086 bash[24289]: cluster 2024-09-16T08:13:52.361122+0000 mgr.a (mgr.14373) 6781 : cluster [DBG] pgmap v4703: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:13:53.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:13:53 smithi047 bash[22744]: cluster 2024-09-16T08:13:52.361122+0000 mgr.a (mgr.14373) 6781 : cluster [DBG] pgmap v4703: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:13:54.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:13:54 smithi157 bash[24585]: audit 2024-09-16T08:13:52.586234+0000 mgr.a (mgr.14373) 6782 : audit [DBG] from='client.154407 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:13:54.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:13:54 smithi086 bash[24289]: audit 2024-09-16T08:13:52.586234+0000 mgr.a (mgr.14373) 6782 : audit [DBG] from='client.154407 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:13:54.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:13:54 smithi047 bash[22744]: audit 2024-09-16T08:13:52.586234+0000 mgr.a (mgr.14373) 6782 : audit [DBG] from='client.154407 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:13:55.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:13:55 smithi157 bash[24585]: cluster 2024-09-16T08:13:54.361957+0000 mgr.a (mgr.14373) 6783 : cluster [DBG] pgmap v4704: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-16T08:13:55.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:13:55 smithi086 bash[24289]: cluster 2024-09-16T08:13:54.361957+0000 mgr.a (mgr.14373) 6783 : cluster [DBG] pgmap v4704: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-16T08:13:55.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:13:55 smithi047 bash[22744]: cluster 2024-09-16T08:13:54.361957+0000 mgr.a (mgr.14373) 6783 : cluster [DBG] pgmap v4704: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-16T08:13:57.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:13:57 smithi157 bash[24585]: cluster 2024-09-16T08:13:56.362749+0000 mgr.a (mgr.14373) 6784 : cluster [DBG] pgmap v4705: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-16T08:13:57.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:13:57 smithi086 bash[24289]: cluster 2024-09-16T08:13:56.362749+0000 mgr.a (mgr.14373) 6784 : cluster [DBG] pgmap v4705: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-16T08:13:57.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:13:57 smithi047 bash[22744]: cluster 2024-09-16T08:13:56.362749+0000 mgr.a (mgr.14373) 6784 : cluster [DBG] pgmap v4705: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-16T08:13:57.991 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:13:57.992 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:13:57.992 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:13:58.776 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:13:58.776 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:13:58.776 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:13:58.776 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:13:58.776 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:13:59.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:13:59 smithi157 bash[24585]: audit 2024-09-16T08:13:58.335057+0000 mgr.a (mgr.14373) 6785 : audit [DBG] from='client.154485 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:13:59.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:13:59 smithi157 bash[24585]: cluster 2024-09-16T08:13:58.365676+0000 mgr.a (mgr.14373) 6786 : cluster [DBG] pgmap v4706: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-16T08:13:59.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:13:59 smithi086 bash[24289]: audit 2024-09-16T08:13:58.335057+0000 mgr.a (mgr.14373) 6785 : audit [DBG] from='client.154485 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:13:59.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:13:59 smithi086 bash[24289]: cluster 2024-09-16T08:13:58.365676+0000 mgr.a (mgr.14373) 6786 : cluster [DBG] pgmap v4706: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-16T08:13:59.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:13:59 smithi047 bash[22744]: audit 2024-09-16T08:13:58.335057+0000 mgr.a (mgr.14373) 6785 : audit [DBG] from='client.154485 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:13:59.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:13:59 smithi047 bash[22744]: cluster 2024-09-16T08:13:58.365676+0000 mgr.a (mgr.14373) 6786 : cluster [DBG] pgmap v4706: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-16T08:14:00.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:14:00 smithi157 bash[24585]: cluster 2024-09-16T08:14:00.366640+0000 mgr.a (mgr.14373) 6787 : cluster [DBG] pgmap v4707: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:14:00.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:14:00 smithi086 bash[24289]: cluster 2024-09-16T08:14:00.366640+0000 mgr.a (mgr.14373) 6787 : cluster [DBG] pgmap v4707: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:14:00.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:14:00 smithi047 bash[22744]: cluster 2024-09-16T08:14:00.366640+0000 mgr.a (mgr.14373) 6787 : cluster [DBG] pgmap v4707: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:14:03.777 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:14:03.778 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:14:03.778 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:14:03.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:14:03 smithi157 bash[24585]: cluster 2024-09-16T08:14:02.368843+0000 mgr.a (mgr.14373) 6788 : cluster [DBG] pgmap v4708: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:14:03.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:14:03 smithi086 bash[24289]: cluster 2024-09-16T08:14:02.368843+0000 mgr.a (mgr.14373) 6788 : cluster [DBG] pgmap v4708: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:14:03.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:14:03 smithi047 bash[22744]: cluster 2024-09-16T08:14:02.368843+0000 mgr.a (mgr.14373) 6788 : cluster [DBG] pgmap v4708: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:14:04.533 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:14:04.533 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:14:04.533 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:14:04.533 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:14:04.533 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:14:05.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:14:05 smithi157 bash[24585]: audit 2024-09-16T08:14:04.110903+0000 mgr.a (mgr.14373) 6789 : audit [DBG] from='client.154563 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:14:05.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:14:05 smithi157 bash[24585]: cluster 2024-09-16T08:14:04.369698+0000 mgr.a (mgr.14373) 6790 : cluster [DBG] pgmap v4709: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:14:05.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:14:05 smithi086 bash[24289]: audit 2024-09-16T08:14:04.110903+0000 mgr.a (mgr.14373) 6789 : audit [DBG] from='client.154563 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:14:05.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:14:05 smithi086 bash[24289]: cluster 2024-09-16T08:14:04.369698+0000 mgr.a (mgr.14373) 6790 : cluster [DBG] pgmap v4709: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:14:05.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:14:05 smithi047 bash[22744]: audit 2024-09-16T08:14:04.110903+0000 mgr.a (mgr.14373) 6789 : audit [DBG] from='client.154563 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:14:05.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:14:05 smithi047 bash[22744]: cluster 2024-09-16T08:14:04.369698+0000 mgr.a (mgr.14373) 6790 : cluster [DBG] pgmap v4709: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:14:06.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:14:06 smithi157 bash[24585]: audit 2024-09-16T08:14:06.009685+0000 mon.b (mon.2) 646 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T08:14:06.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:14:06 smithi086 bash[24289]: audit 2024-09-16T08:14:06.009685+0000 mon.b (mon.2) 646 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T08:14:06.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:14:06 smithi047 bash[22744]: audit 2024-09-16T08:14:06.009685+0000 mon.b (mon.2) 646 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T08:14:07.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:14:07 smithi157 bash[24585]: cluster 2024-09-16T08:14:06.370624+0000 mgr.a (mgr.14373) 6791 : cluster [DBG] pgmap v4710: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:14:07.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:14:07 smithi157 bash[24585]: audit 2024-09-16T08:14:06.835330+0000 mon.b (mon.2) 647 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T08:14:07.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:14:07 smithi157 bash[24585]: audit 2024-09-16T08:14:06.837100+0000 mon.b (mon.2) 648 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T08:14:07.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:14:07 smithi157 bash[24585]: audit 2024-09-16T08:14:06.847500+0000 mon.a (mon.0) 977 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:14:07.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:14:07 smithi157 bash[24585]: audit 2024-09-16T08:14:06.853839+0000 mon.b (mon.2) 649 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:14:07.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:14:07 smithi086 bash[24289]: cluster 2024-09-16T08:14:06.370624+0000 mgr.a (mgr.14373) 6791 : cluster [DBG] pgmap v4710: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:14:07.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:14:07 smithi086 bash[24289]: audit 2024-09-16T08:14:06.835330+0000 mon.b (mon.2) 647 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T08:14:07.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:14:07 smithi086 bash[24289]: audit 2024-09-16T08:14:06.837100+0000 mon.b (mon.2) 648 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T08:14:07.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:14:07 smithi086 bash[24289]: audit 2024-09-16T08:14:06.847500+0000 mon.a (mon.0) 977 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:14:07.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:14:07 smithi086 bash[24289]: audit 2024-09-16T08:14:06.853839+0000 mon.b (mon.2) 649 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:14:07.838 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 08:14:07 smithi047 bash[22994]: debug 2024-09-16T08:14:07.588+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T08:14:07.838 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 08:14:07 smithi047 bash[22994]: debug 2024-09-16T08:14:07.588+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T08:14:07.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:14:07 smithi047 bash[22744]: cluster 2024-09-16T08:14:06.370624+0000 mgr.a (mgr.14373) 6791 : cluster [DBG] pgmap v4710: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:14:07.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:14:07 smithi047 bash[22744]: audit 2024-09-16T08:14:06.835330+0000 mon.b (mon.2) 647 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T08:14:07.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:14:07 smithi047 bash[22744]: audit 2024-09-16T08:14:06.837100+0000 mon.b (mon.2) 648 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T08:14:07.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:14:07 smithi047 bash[22744]: audit 2024-09-16T08:14:06.847500+0000 mon.a (mon.0) 977 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:14:07.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:14:07 smithi047 bash[22744]: audit 2024-09-16T08:14:06.853839+0000 mon.b (mon.2) 649 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:14:08.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:14:08 smithi157 bash[24585]: audit 2024-09-16T08:14:06.857657+0000 mgr.a (mgr.14373) 6792 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:14:08.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:14:08 smithi086 bash[24289]: audit 2024-09-16T08:14:06.857657+0000 mgr.a (mgr.14373) 6792 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:14:08.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:14:08 smithi047 bash[22744]: audit 2024-09-16T08:14:06.857657+0000 mgr.a (mgr.14373) 6792 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:14:09.534 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:14:09.535 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:14:09.535 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:14:09.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:14:09 smithi157 bash[24585]: audit 2024-09-16T08:14:07.592389+0000 mgr.a (mgr.14373) 6793 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T08:14:09.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:14:09 smithi157 bash[24585]: cephadm 2024-09-16T08:14:07.594309+0000 mgr.a (mgr.14373) 6794 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T08:14:09.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:14:09 smithi157 bash[24585]: cluster 2024-09-16T08:14:08.373290+0000 mgr.a (mgr.14373) 6795 : cluster [DBG] pgmap v4711: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:14:09.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:14:09 smithi086 bash[24289]: audit 2024-09-16T08:14:07.592389+0000 mgr.a (mgr.14373) 6793 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T08:14:09.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:14:09 smithi086 bash[24289]: cephadm 2024-09-16T08:14:07.594309+0000 mgr.a (mgr.14373) 6794 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T08:14:09.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:14:09 smithi086 bash[24289]: cluster 2024-09-16T08:14:08.373290+0000 mgr.a (mgr.14373) 6795 : cluster [DBG] pgmap v4711: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:14:09.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:14:09 smithi047 bash[22744]: audit 2024-09-16T08:14:07.592389+0000 mgr.a (mgr.14373) 6793 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T08:14:09.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:14:09 smithi047 bash[22744]: cephadm 2024-09-16T08:14:07.594309+0000 mgr.a (mgr.14373) 6794 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T08:14:09.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:14:09 smithi047 bash[22744]: cluster 2024-09-16T08:14:08.373290+0000 mgr.a (mgr.14373) 6795 : cluster [DBG] pgmap v4711: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:14:10.287 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:14:10.288 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:14:10.288 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:14:10.288 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:14:10.288 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:14:10.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:14:10 smithi157 bash[24585]: audit 2024-09-16T08:14:09.862507+0000 mgr.a (mgr.14373) 6796 : audit [DBG] from='client.154743 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:14:10.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:14:10 smithi157 bash[24585]: cluster 2024-09-16T08:14:10.374239+0000 mgr.a (mgr.14373) 6797 : cluster [DBG] pgmap v4712: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:14:10.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:14:10 smithi086 bash[24289]: audit 2024-09-16T08:14:09.862507+0000 mgr.a (mgr.14373) 6796 : audit [DBG] from='client.154743 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:14:10.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:14:10 smithi086 bash[24289]: cluster 2024-09-16T08:14:10.374239+0000 mgr.a (mgr.14373) 6797 : cluster [DBG] pgmap v4712: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:14:10.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:14:10 smithi047 bash[22744]: audit 2024-09-16T08:14:09.862507+0000 mgr.a (mgr.14373) 6796 : audit [DBG] from='client.154743 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:14:10.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:14:10 smithi047 bash[22744]: cluster 2024-09-16T08:14:10.374239+0000 mgr.a (mgr.14373) 6797 : cluster [DBG] pgmap v4712: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:14:13.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:14:13 smithi157 bash[24585]: cluster 2024-09-16T08:14:12.376463+0000 mgr.a (mgr.14373) 6798 : cluster [DBG] pgmap v4713: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:14:13.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:14:13 smithi086 bash[24289]: cluster 2024-09-16T08:14:12.376463+0000 mgr.a (mgr.14373) 6798 : cluster [DBG] pgmap v4713: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:14:13.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:14:13 smithi047 bash[22744]: cluster 2024-09-16T08:14:12.376463+0000 mgr.a (mgr.14373) 6798 : cluster [DBG] pgmap v4713: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:14:15.290 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:14:15.290 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:14:15.291 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:14:15.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:14:15 smithi157 bash[24585]: cluster 2024-09-16T08:14:14.377226+0000 mgr.a (mgr.14373) 6799 : cluster [DBG] pgmap v4714: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:14:15.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:14:15 smithi086 bash[24289]: cluster 2024-09-16T08:14:14.377226+0000 mgr.a (mgr.14373) 6799 : cluster [DBG] pgmap v4714: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:14:15.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:14:15 smithi047 bash[22744]: cluster 2024-09-16T08:14:14.377226+0000 mgr.a (mgr.14373) 6799 : cluster [DBG] pgmap v4714: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:14:16.044 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:14:16.044 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:14:16.044 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:14:16.044 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:14:16.044 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:14:17.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:14:17 smithi157 bash[24585]: audit 2024-09-16T08:14:15.621366+0000 mgr.a (mgr.14373) 6800 : audit [DBG] from='client.154821 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:14:17.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:14:17 smithi157 bash[24585]: cluster 2024-09-16T08:14:16.378080+0000 mgr.a (mgr.14373) 6801 : cluster [DBG] pgmap v4715: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:14:17.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:14:17 smithi086 bash[24289]: audit 2024-09-16T08:14:15.621366+0000 mgr.a (mgr.14373) 6800 : audit [DBG] from='client.154821 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:14:17.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:14:17 smithi086 bash[24289]: cluster 2024-09-16T08:14:16.378080+0000 mgr.a (mgr.14373) 6801 : cluster [DBG] pgmap v4715: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:14:17.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:14:17 smithi047 bash[22744]: audit 2024-09-16T08:14:15.621366+0000 mgr.a (mgr.14373) 6800 : audit [DBG] from='client.154821 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:14:17.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:14:17 smithi047 bash[22744]: cluster 2024-09-16T08:14:16.378080+0000 mgr.a (mgr.14373) 6801 : cluster [DBG] pgmap v4715: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:14:18.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:14:18 smithi157 bash[24585]: cluster 2024-09-16T08:14:18.380335+0000 mgr.a (mgr.14373) 6802 : cluster [DBG] pgmap v4716: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:14:18.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:14:18 smithi086 bash[24289]: cluster 2024-09-16T08:14:18.380335+0000 mgr.a (mgr.14373) 6802 : cluster [DBG] pgmap v4716: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:14:18.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:14:18 smithi047 bash[22744]: cluster 2024-09-16T08:14:18.380335+0000 mgr.a (mgr.14373) 6802 : cluster [DBG] pgmap v4716: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:14:21.045 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:14:21.046 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:14:21.046 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:14:21.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:14:21 smithi157 bash[24585]: cluster 2024-09-16T08:14:20.381080+0000 mgr.a (mgr.14373) 6803 : cluster [DBG] pgmap v4717: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:14:21.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:14:21 smithi086 bash[24289]: cluster 2024-09-16T08:14:20.381080+0000 mgr.a (mgr.14373) 6803 : cluster [DBG] pgmap v4717: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:14:21.832 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:14:21.833 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:14:21.833 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:14:21.833 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:14:21.833 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:14:21.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:14:21 smithi047 bash[22744]: cluster 2024-09-16T08:14:20.381080+0000 mgr.a (mgr.14373) 6803 : cluster [DBG] pgmap v4717: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:14:22.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:14:22 smithi157 bash[24585]: audit 2024-09-16T08:14:21.387842+0000 mgr.a (mgr.14373) 6804 : audit [DBG] from='client.154896 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:14:22.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:14:22 smithi086 bash[24289]: audit 2024-09-16T08:14:21.387842+0000 mgr.a (mgr.14373) 6804 : audit [DBG] from='client.154896 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:14:22.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:14:22 smithi047 bash[22744]: audit 2024-09-16T08:14:21.387842+0000 mgr.a (mgr.14373) 6804 : audit [DBG] from='client.154896 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:14:23.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:14:23 smithi157 bash[24585]: cluster 2024-09-16T08:14:22.383775+0000 mgr.a (mgr.14373) 6805 : cluster [DBG] pgmap v4718: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:14:23.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:14:23 smithi086 bash[24289]: cluster 2024-09-16T08:14:22.383775+0000 mgr.a (mgr.14373) 6805 : cluster [DBG] pgmap v4718: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:14:23.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:14:23 smithi047 bash[22744]: cluster 2024-09-16T08:14:22.383775+0000 mgr.a (mgr.14373) 6805 : cluster [DBG] pgmap v4718: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:14:24.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:14:24 smithi157 bash[24585]: cluster 2024-09-16T08:14:24.384527+0000 mgr.a (mgr.14373) 6806 : cluster [DBG] pgmap v4719: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:14:24.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:14:24 smithi086 bash[24289]: cluster 2024-09-16T08:14:24.384527+0000 mgr.a (mgr.14373) 6806 : cluster [DBG] pgmap v4719: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:14:24.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:14:24 smithi047 bash[22744]: cluster 2024-09-16T08:14:24.384527+0000 mgr.a (mgr.14373) 6806 : cluster [DBG] pgmap v4719: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:14:26.834 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:14:26.835 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:14:26.835 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:14:27.601 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:14:27.601 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:14:27.601 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:14:27.601 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:14:27.601 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:14:27.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:14:27 smithi157 bash[24585]: cluster 2024-09-16T08:14:26.385417+0000 mgr.a (mgr.14373) 6807 : cluster [DBG] pgmap v4720: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T08:14:27.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:14:27 smithi086 bash[24289]: cluster 2024-09-16T08:14:26.385417+0000 mgr.a (mgr.14373) 6807 : cluster [DBG] pgmap v4720: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T08:14:27.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:14:27 smithi047 bash[22744]: cluster 2024-09-16T08:14:26.385417+0000 mgr.a (mgr.14373) 6807 : cluster [DBG] pgmap v4720: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T08:14:28.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:14:28 smithi157 bash[24585]: audit 2024-09-16T08:14:27.167484+0000 mgr.a (mgr.14373) 6808 : audit [DBG] from='client.154968 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:14:28.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:14:28 smithi086 bash[24289]: audit 2024-09-16T08:14:27.167484+0000 mgr.a (mgr.14373) 6808 : audit [DBG] from='client.154968 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:14:28.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:14:28 smithi047 bash[22744]: audit 2024-09-16T08:14:27.167484+0000 mgr.a (mgr.14373) 6808 : audit [DBG] from='client.154968 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:14:29.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:14:29 smithi157 bash[24585]: cluster 2024-09-16T08:14:28.388158+0000 mgr.a (mgr.14373) 6809 : cluster [DBG] pgmap v4721: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:14:29.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:14:29 smithi086 bash[24289]: cluster 2024-09-16T08:14:28.388158+0000 mgr.a (mgr.14373) 6809 : cluster [DBG] pgmap v4721: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:14:29.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:14:29 smithi047 bash[22744]: cluster 2024-09-16T08:14:28.388158+0000 mgr.a (mgr.14373) 6809 : cluster [DBG] pgmap v4721: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:14:30.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:14:30 smithi157 bash[24585]: cluster 2024-09-16T08:14:30.388917+0000 mgr.a (mgr.14373) 6810 : cluster [DBG] pgmap v4722: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:14:30.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:14:30 smithi086 bash[24289]: cluster 2024-09-16T08:14:30.388917+0000 mgr.a (mgr.14373) 6810 : cluster [DBG] pgmap v4722: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:14:30.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:14:30 smithi047 bash[22744]: cluster 2024-09-16T08:14:30.388917+0000 mgr.a (mgr.14373) 6810 : cluster [DBG] pgmap v4722: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:14:32.602 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:14:32.603 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:14:32.603 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:14:32.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:14:32 smithi157 bash[24585]: cluster 2024-09-16T08:14:32.390940+0000 mgr.a (mgr.14373) 6811 : cluster [DBG] pgmap v4723: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:14:32.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:14:32 smithi086 bash[24289]: cluster 2024-09-16T08:14:32.390940+0000 mgr.a (mgr.14373) 6811 : cluster [DBG] pgmap v4723: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:14:32.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:14:32 smithi047 bash[22744]: cluster 2024-09-16T08:14:32.390940+0000 mgr.a (mgr.14373) 6811 : cluster [DBG] pgmap v4723: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:14:33.348 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:14:33.349 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:14:33.349 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:14:33.349 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:14:33.349 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:14:33.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:14:33 smithi157 bash[24585]: audit 2024-09-16T08:14:32.934299+0000 mgr.a (mgr.14373) 6812 : audit [DBG] from='client.155046 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:14:33.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:14:33 smithi086 bash[24289]: audit 2024-09-16T08:14:32.934299+0000 mgr.a (mgr.14373) 6812 : audit [DBG] from='client.155046 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:14:33.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:14:33 smithi047 bash[22744]: audit 2024-09-16T08:14:32.934299+0000 mgr.a (mgr.14373) 6812 : audit [DBG] from='client.155046 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:14:34.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:14:34 smithi157 bash[24585]: cluster 2024-09-16T08:14:34.391853+0000 mgr.a (mgr.14373) 6813 : cluster [DBG] pgmap v4724: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:14:34.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:14:34 smithi086 bash[24289]: cluster 2024-09-16T08:14:34.391853+0000 mgr.a (mgr.14373) 6813 : cluster [DBG] pgmap v4724: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:14:34.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:14:34 smithi047 bash[22744]: cluster 2024-09-16T08:14:34.391853+0000 mgr.a (mgr.14373) 6813 : cluster [DBG] pgmap v4724: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:14:36.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:14:36 smithi157 bash[24585]: cluster 2024-09-16T08:14:36.392614+0000 mgr.a (mgr.14373) 6814 : cluster [DBG] pgmap v4725: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:14:36.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:14:36 smithi086 bash[24289]: cluster 2024-09-16T08:14:36.392614+0000 mgr.a (mgr.14373) 6814 : cluster [DBG] pgmap v4725: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:14:36.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:14:36 smithi047 bash[22744]: cluster 2024-09-16T08:14:36.392614+0000 mgr.a (mgr.14373) 6814 : cluster [DBG] pgmap v4725: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:14:38.349 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:14:38.350 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:14:38.350 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:14:38.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:14:38 smithi157 bash[24585]: cluster 2024-09-16T08:14:38.394650+0000 mgr.a (mgr.14373) 6815 : cluster [DBG] pgmap v4726: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:14:38.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:14:38 smithi086 bash[24289]: cluster 2024-09-16T08:14:38.394650+0000 mgr.a (mgr.14373) 6815 : cluster [DBG] pgmap v4726: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:14:38.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:14:38 smithi047 bash[22744]: cluster 2024-09-16T08:14:38.394650+0000 mgr.a (mgr.14373) 6815 : cluster [DBG] pgmap v4726: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:14:39.113 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:14:39.113 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:14:39.114 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:14:39.114 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:14:39.114 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:14:39.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:14:39 smithi157 bash[24585]: audit 2024-09-16T08:14:38.687071+0000 mgr.a (mgr.14373) 6816 : audit [DBG] from='client.155124 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:14:39.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:14:39 smithi086 bash[24289]: audit 2024-09-16T08:14:38.687071+0000 mgr.a (mgr.14373) 6816 : audit [DBG] from='client.155124 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:14:39.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:14:39 smithi047 bash[22744]: audit 2024-09-16T08:14:38.687071+0000 mgr.a (mgr.14373) 6816 : audit [DBG] from='client.155124 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:14:40.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:14:40 smithi157 bash[24585]: cluster 2024-09-16T08:14:40.395690+0000 mgr.a (mgr.14373) 6817 : cluster [DBG] pgmap v4727: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:14:40.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:14:40 smithi086 bash[24289]: cluster 2024-09-16T08:14:40.395690+0000 mgr.a (mgr.14373) 6817 : cluster [DBG] pgmap v4727: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:14:40.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:14:40 smithi047 bash[22744]: cluster 2024-09-16T08:14:40.395690+0000 mgr.a (mgr.14373) 6817 : cluster [DBG] pgmap v4727: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:14:42.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:14:42 smithi157 bash[24585]: cluster 2024-09-16T08:14:42.398023+0000 mgr.a (mgr.14373) 6818 : cluster [DBG] pgmap v4728: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:14:42.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:14:42 smithi086 bash[24289]: cluster 2024-09-16T08:14:42.398023+0000 mgr.a (mgr.14373) 6818 : cluster [DBG] pgmap v4728: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:14:42.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:14:42 smithi047 bash[22744]: cluster 2024-09-16T08:14:42.398023+0000 mgr.a (mgr.14373) 6818 : cluster [DBG] pgmap v4728: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:14:44.115 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:14:44.116 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:14:44.116 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:14:44.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:14:44 smithi157 bash[24585]: cluster 2024-09-16T08:14:44.398771+0000 mgr.a (mgr.14373) 6819 : cluster [DBG] pgmap v4729: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:14:44.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:14:44 smithi086 bash[24289]: cluster 2024-09-16T08:14:44.398771+0000 mgr.a (mgr.14373) 6819 : cluster [DBG] pgmap v4729: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:14:44.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:14:44 smithi047 bash[22744]: cluster 2024-09-16T08:14:44.398771+0000 mgr.a (mgr.14373) 6819 : cluster [DBG] pgmap v4729: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:14:44.884 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:14:44.884 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:14:44.884 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:14:44.884 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:14:44.884 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:14:45.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:14:45 smithi157 bash[24585]: audit 2024-09-16T08:14:44.457295+0000 mgr.a (mgr.14373) 6820 : audit [DBG] from='client.155196 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:14:45.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:14:45 smithi086 bash[24289]: audit 2024-09-16T08:14:44.457295+0000 mgr.a (mgr.14373) 6820 : audit [DBG] from='client.155196 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:14:45.841 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:14:45 smithi047 bash[22744]: audit 2024-09-16T08:14:44.457295+0000 mgr.a (mgr.14373) 6820 : audit [DBG] from='client.155196 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:14:46.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:14:46 smithi157 bash[24585]: cluster 2024-09-16T08:14:46.399619+0000 mgr.a (mgr.14373) 6821 : cluster [DBG] pgmap v4730: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:14:46.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:14:46 smithi086 bash[24289]: cluster 2024-09-16T08:14:46.399619+0000 mgr.a (mgr.14373) 6821 : cluster [DBG] pgmap v4730: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:14:46.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:14:46 smithi047 bash[22744]: cluster 2024-09-16T08:14:46.399619+0000 mgr.a (mgr.14373) 6821 : cluster [DBG] pgmap v4730: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:14:48.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:14:48 smithi157 bash[24585]: cluster 2024-09-16T08:14:48.401831+0000 mgr.a (mgr.14373) 6822 : cluster [DBG] pgmap v4731: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:14:48.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:14:48 smithi086 bash[24289]: cluster 2024-09-16T08:14:48.401831+0000 mgr.a (mgr.14373) 6822 : cluster [DBG] pgmap v4731: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:14:48.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:14:48 smithi047 bash[22744]: cluster 2024-09-16T08:14:48.401831+0000 mgr.a (mgr.14373) 6822 : cluster [DBG] pgmap v4731: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:14:49.885 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:14:49.886 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:14:49.886 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:14:50.634 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:14:50.635 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:14:50.635 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:14:50.635 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:14:50.635 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:14:50.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:14:50 smithi157 bash[24585]: audit 2024-09-16T08:14:50.219041+0000 mgr.a (mgr.14373) 6823 : audit [DBG] from='client.155271 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:14:50.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:14:50 smithi157 bash[24585]: cluster 2024-09-16T08:14:50.402292+0000 mgr.a (mgr.14373) 6824 : cluster [DBG] pgmap v4732: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:14:50.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:14:50 smithi086 bash[24289]: audit 2024-09-16T08:14:50.219041+0000 mgr.a (mgr.14373) 6823 : audit [DBG] from='client.155271 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:14:50.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:14:50 smithi086 bash[24289]: cluster 2024-09-16T08:14:50.402292+0000 mgr.a (mgr.14373) 6824 : cluster [DBG] pgmap v4732: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:14:50.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:14:50 smithi047 bash[22744]: audit 2024-09-16T08:14:50.219041+0000 mgr.a (mgr.14373) 6823 : audit [DBG] from='client.155271 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:14:50.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:14:50 smithi047 bash[22744]: cluster 2024-09-16T08:14:50.402292+0000 mgr.a (mgr.14373) 6824 : cluster [DBG] pgmap v4732: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:14:52.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:14:52 smithi157 bash[24585]: cluster 2024-09-16T08:14:52.404478+0000 mgr.a (mgr.14373) 6825 : cluster [DBG] pgmap v4733: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:14:52.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:14:52 smithi086 bash[24289]: cluster 2024-09-16T08:14:52.404478+0000 mgr.a (mgr.14373) 6825 : cluster [DBG] pgmap v4733: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:14:52.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:14:52 smithi047 bash[22744]: cluster 2024-09-16T08:14:52.404478+0000 mgr.a (mgr.14373) 6825 : cluster [DBG] pgmap v4733: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:14:54.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:14:54 smithi157 bash[24585]: cluster 2024-09-16T08:14:54.405264+0000 mgr.a (mgr.14373) 6826 : cluster [DBG] pgmap v4734: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:14:54.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:14:54 smithi086 bash[24289]: cluster 2024-09-16T08:14:54.405264+0000 mgr.a (mgr.14373) 6826 : cluster [DBG] pgmap v4734: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:14:54.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:14:54 smithi047 bash[22744]: cluster 2024-09-16T08:14:54.405264+0000 mgr.a (mgr.14373) 6826 : cluster [DBG] pgmap v4734: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:14:55.636 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:14:55.637 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:14:55.637 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:14:56.404 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:14:56.404 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:14:56.405 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:14:56.405 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:14:56.405 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:14:56.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:14:56 smithi157 bash[24585]: audit 2024-09-16T08:14:55.973698+0000 mgr.a (mgr.14373) 6827 : audit [DBG] from='client.155346 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:14:56.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:14:56 smithi157 bash[24585]: cluster 2024-09-16T08:14:56.405761+0000 mgr.a (mgr.14373) 6828 : cluster [DBG] pgmap v4735: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:14:56.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:14:56 smithi086 bash[24289]: audit 2024-09-16T08:14:55.973698+0000 mgr.a (mgr.14373) 6827 : audit [DBG] from='client.155346 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:14:56.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:14:56 smithi086 bash[24289]: cluster 2024-09-16T08:14:56.405761+0000 mgr.a (mgr.14373) 6828 : cluster [DBG] pgmap v4735: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:14:56.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:14:56 smithi047 bash[22744]: audit 2024-09-16T08:14:55.973698+0000 mgr.a (mgr.14373) 6827 : audit [DBG] from='client.155346 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:14:56.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:14:56 smithi047 bash[22744]: cluster 2024-09-16T08:14:56.405761+0000 mgr.a (mgr.14373) 6828 : cluster [DBG] pgmap v4735: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:14:58.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:14:58 smithi157 bash[24585]: cluster 2024-09-16T08:14:58.408020+0000 mgr.a (mgr.14373) 6829 : cluster [DBG] pgmap v4736: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:14:58.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:14:58 smithi086 bash[24289]: cluster 2024-09-16T08:14:58.408020+0000 mgr.a (mgr.14373) 6829 : cluster [DBG] pgmap v4736: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:14:58.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:14:58 smithi047 bash[22744]: cluster 2024-09-16T08:14:58.408020+0000 mgr.a (mgr.14373) 6829 : cluster [DBG] pgmap v4736: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:15:00.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:15:00 smithi157 bash[24585]: cluster 2024-09-16T08:15:00.408826+0000 mgr.a (mgr.14373) 6830 : cluster [DBG] pgmap v4737: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:15:00.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:15:00 smithi086 bash[24289]: cluster 2024-09-16T08:15:00.408826+0000 mgr.a (mgr.14373) 6830 : cluster [DBG] pgmap v4737: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:15:00.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:15:00 smithi047 bash[22744]: cluster 2024-09-16T08:15:00.408826+0000 mgr.a (mgr.14373) 6830 : cluster [DBG] pgmap v4737: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:15:01.405 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:15:01.406 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:15:01.407 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:15:02.182 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:15:02.182 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:15:02.182 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:15:02.182 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:15:02.182 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:15:02.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:15:02 smithi157 bash[24585]: audit 2024-09-16T08:15:01.743274+0000 mgr.a (mgr.14373) 6831 : audit [DBG] from='client.155418 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:15:02.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:15:02 smithi157 bash[24585]: cluster 2024-09-16T08:15:02.411737+0000 mgr.a (mgr.14373) 6832 : cluster [DBG] pgmap v4738: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:15:02.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:15:02 smithi086 bash[24289]: audit 2024-09-16T08:15:01.743274+0000 mgr.a (mgr.14373) 6831 : audit [DBG] from='client.155418 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:15:02.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:15:02 smithi086 bash[24289]: cluster 2024-09-16T08:15:02.411737+0000 mgr.a (mgr.14373) 6832 : cluster [DBG] pgmap v4738: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:15:02.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:15:02 smithi047 bash[22744]: audit 2024-09-16T08:15:01.743274+0000 mgr.a (mgr.14373) 6831 : audit [DBG] from='client.155418 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:15:02.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:15:02 smithi047 bash[22744]: cluster 2024-09-16T08:15:02.411737+0000 mgr.a (mgr.14373) 6832 : cluster [DBG] pgmap v4738: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:15:04.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:15:04 smithi157 bash[24585]: cluster 2024-09-16T08:15:04.412569+0000 mgr.a (mgr.14373) 6833 : cluster [DBG] pgmap v4739: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:15:04.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:15:04 smithi086 bash[24289]: cluster 2024-09-16T08:15:04.412569+0000 mgr.a (mgr.14373) 6833 : cluster [DBG] pgmap v4739: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:15:04.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:15:04 smithi047 bash[22744]: cluster 2024-09-16T08:15:04.412569+0000 mgr.a (mgr.14373) 6833 : cluster [DBG] pgmap v4739: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:15:06.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:15:06 smithi157 bash[24585]: cluster 2024-09-16T08:15:06.413448+0000 mgr.a (mgr.14373) 6834 : cluster [DBG] pgmap v4740: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T08:15:06.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:15:06 smithi086 bash[24289]: cluster 2024-09-16T08:15:06.413448+0000 mgr.a (mgr.14373) 6834 : cluster [DBG] pgmap v4740: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T08:15:06.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:15:06 smithi047 bash[22744]: cluster 2024-09-16T08:15:06.413448+0000 mgr.a (mgr.14373) 6834 : cluster [DBG] pgmap v4740: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T08:15:07.184 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:15:07.184 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:15:07.184 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:15:07.986 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:15:07.986 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:15:07.986 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:15:07.987 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:15:07.987 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:15:08.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:15:07 smithi157 bash[24585]: audit 2024-09-16T08:15:07.645564+0000 mon.b (mon.2) 650 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T08:15:08.066 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:15:07 smithi086 bash[24289]: audit 2024-09-16T08:15:07.645564+0000 mon.b (mon.2) 650 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T08:15:08.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:15:07 smithi047 bash[22744]: audit 2024-09-16T08:15:07.645564+0000 mon.b (mon.2) 650 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T08:15:09.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:15:08 smithi157 bash[24585]: audit 2024-09-16T08:15:07.523114+0000 mgr.a (mgr.14373) 6835 : audit [DBG] from='client.155487 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:15:09.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:15:08 smithi157 bash[24585]: cluster 2024-09-16T08:15:08.415975+0000 mgr.a (mgr.14373) 6836 : cluster [DBG] pgmap v4741: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:15:09.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:15:08 smithi157 bash[24585]: audit 2024-09-16T08:15:08.448058+0000 mon.b (mon.2) 651 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T08:15:09.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:15:08 smithi157 bash[24585]: audit 2024-09-16T08:15:08.450372+0000 mon.b (mon.2) 652 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T08:15:09.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:15:08 smithi157 bash[24585]: audit 2024-09-16T08:15:08.462733+0000 mon.a (mon.0) 978 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:15:09.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:15:08 smithi157 bash[24585]: audit 2024-09-16T08:15:08.467041+0000 mon.b (mon.2) 653 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:15:09.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:15:08 smithi086 bash[24289]: audit 2024-09-16T08:15:07.523114+0000 mgr.a (mgr.14373) 6835 : audit [DBG] from='client.155487 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:15:09.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:15:08 smithi086 bash[24289]: cluster 2024-09-16T08:15:08.415975+0000 mgr.a (mgr.14373) 6836 : cluster [DBG] pgmap v4741: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:15:09.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:15:08 smithi086 bash[24289]: audit 2024-09-16T08:15:08.448058+0000 mon.b (mon.2) 651 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T08:15:09.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:15:08 smithi086 bash[24289]: audit 2024-09-16T08:15:08.450372+0000 mon.b (mon.2) 652 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T08:15:09.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:15:08 smithi086 bash[24289]: audit 2024-09-16T08:15:08.462733+0000 mon.a (mon.0) 978 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:15:09.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:15:08 smithi086 bash[24289]: audit 2024-09-16T08:15:08.467041+0000 mon.b (mon.2) 653 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:15:09.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:15:08 smithi047 bash[22744]: audit 2024-09-16T08:15:07.523114+0000 mgr.a (mgr.14373) 6835 : audit [DBG] from='client.155487 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:15:09.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:15:08 smithi047 bash[22744]: cluster 2024-09-16T08:15:08.415975+0000 mgr.a (mgr.14373) 6836 : cluster [DBG] pgmap v4741: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:15:09.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:15:08 smithi047 bash[22744]: audit 2024-09-16T08:15:08.448058+0000 mon.b (mon.2) 651 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T08:15:09.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:15:08 smithi047 bash[22744]: audit 2024-09-16T08:15:08.450372+0000 mon.b (mon.2) 652 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T08:15:09.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:15:08 smithi047 bash[22744]: audit 2024-09-16T08:15:08.462733+0000 mon.a (mon.0) 978 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:15:09.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:15:08 smithi047 bash[22744]: audit 2024-09-16T08:15:08.467041+0000 mon.b (mon.2) 653 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:15:09.588 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 08:15:09 smithi047 bash[22994]: debug 2024-09-16T08:15:09.187+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T08:15:09.588 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 08:15:09 smithi047 bash[22994]: debug 2024-09-16T08:15:09.187+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T08:15:10.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:15:09 smithi157 bash[24585]: audit 2024-09-16T08:15:08.469837+0000 mgr.a (mgr.14373) 6837 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:15:10.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:15:09 smithi157 bash[24585]: audit 2024-09-16T08:15:09.191503+0000 mgr.a (mgr.14373) 6838 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T08:15:10.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:15:09 smithi157 bash[24585]: cephadm 2024-09-16T08:15:09.193750+0000 mgr.a (mgr.14373) 6839 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T08:15:10.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:15:09 smithi086 bash[24289]: audit 2024-09-16T08:15:08.469837+0000 mgr.a (mgr.14373) 6837 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:15:10.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:15:09 smithi086 bash[24289]: audit 2024-09-16T08:15:09.191503+0000 mgr.a (mgr.14373) 6838 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T08:15:10.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:15:09 smithi086 bash[24289]: cephadm 2024-09-16T08:15:09.193750+0000 mgr.a (mgr.14373) 6839 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T08:15:10.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:15:09 smithi047 bash[22744]: audit 2024-09-16T08:15:08.469837+0000 mgr.a (mgr.14373) 6837 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:15:10.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:15:09 smithi047 bash[22744]: audit 2024-09-16T08:15:09.191503+0000 mgr.a (mgr.14373) 6838 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T08:15:10.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:15:09 smithi047 bash[22744]: cephadm 2024-09-16T08:15:09.193750+0000 mgr.a (mgr.14373) 6839 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T08:15:11.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:15:10 smithi157 bash[24585]: cluster 2024-09-16T08:15:10.416960+0000 mgr.a (mgr.14373) 6840 : cluster [DBG] pgmap v4742: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:15:11.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:15:10 smithi086 bash[24289]: cluster 2024-09-16T08:15:10.416960+0000 mgr.a (mgr.14373) 6840 : cluster [DBG] pgmap v4742: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:15:11.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:15:10 smithi047 bash[22744]: cluster 2024-09-16T08:15:10.416960+0000 mgr.a (mgr.14373) 6840 : cluster [DBG] pgmap v4742: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:15:12.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:15:12 smithi157 bash[24585]: cluster 2024-09-16T08:15:12.419166+0000 mgr.a (mgr.14373) 6841 : cluster [DBG] pgmap v4743: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:15:12.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:15:12 smithi086 bash[24289]: cluster 2024-09-16T08:15:12.419166+0000 mgr.a (mgr.14373) 6841 : cluster [DBG] pgmap v4743: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:15:12.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:15:12 smithi047 bash[22744]: cluster 2024-09-16T08:15:12.419166+0000 mgr.a (mgr.14373) 6841 : cluster [DBG] pgmap v4743: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:15:12.988 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:15:12.989 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:15:12.989 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:15:13.767 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:15:13.768 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:15:13.768 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:15:13.768 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:15:13.768 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:15:13.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:15:13 smithi157 bash[24585]: audit 2024-09-16T08:15:13.323509+0000 mgr.a (mgr.14373) 6842 : audit [DBG] from='client.155667 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:15:13.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:15:13 smithi086 bash[24289]: audit 2024-09-16T08:15:13.323509+0000 mgr.a (mgr.14373) 6842 : audit [DBG] from='client.155667 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:15:13.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:15:13 smithi047 bash[22744]: audit 2024-09-16T08:15:13.323509+0000 mgr.a (mgr.14373) 6842 : audit [DBG] from='client.155667 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:15:14.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:15:14 smithi157 bash[24585]: cluster 2024-09-16T08:15:14.420169+0000 mgr.a (mgr.14373) 6843 : cluster [DBG] pgmap v4744: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:15:14.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:15:14 smithi086 bash[24289]: cluster 2024-09-16T08:15:14.420169+0000 mgr.a (mgr.14373) 6843 : cluster [DBG] pgmap v4744: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:15:14.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:15:14 smithi047 bash[22744]: cluster 2024-09-16T08:15:14.420169+0000 mgr.a (mgr.14373) 6843 : cluster [DBG] pgmap v4744: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:15:16.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:15:16 smithi157 bash[24585]: cluster 2024-09-16T08:15:16.420974+0000 mgr.a (mgr.14373) 6844 : cluster [DBG] pgmap v4745: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:15:16.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:15:16 smithi086 bash[24289]: cluster 2024-09-16T08:15:16.420974+0000 mgr.a (mgr.14373) 6844 : cluster [DBG] pgmap v4745: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:15:16.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:15:16 smithi047 bash[22744]: cluster 2024-09-16T08:15:16.420974+0000 mgr.a (mgr.14373) 6844 : cluster [DBG] pgmap v4745: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:15:18.769 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:15:18.770 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:15:18.770 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:15:18.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:15:18 smithi157 bash[24585]: cluster 2024-09-16T08:15:18.423339+0000 mgr.a (mgr.14373) 6845 : cluster [DBG] pgmap v4746: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:15:18.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:15:18 smithi086 bash[24289]: cluster 2024-09-16T08:15:18.423339+0000 mgr.a (mgr.14373) 6845 : cluster [DBG] pgmap v4746: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:15:18.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:15:18 smithi047 bash[22744]: cluster 2024-09-16T08:15:18.423339+0000 mgr.a (mgr.14373) 6845 : cluster [DBG] pgmap v4746: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:15:19.544 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:15:19.544 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:15:19.545 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:15:19.545 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:15:19.545 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:15:19.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:15:19 smithi157 bash[24585]: audit 2024-09-16T08:15:19.107292+0000 mgr.a (mgr.14373) 6846 : audit [DBG] from='client.155745 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:15:19.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:15:19 smithi086 bash[24289]: audit 2024-09-16T08:15:19.107292+0000 mgr.a (mgr.14373) 6846 : audit [DBG] from='client.155745 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:15:19.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:15:19 smithi047 bash[22744]: audit 2024-09-16T08:15:19.107292+0000 mgr.a (mgr.14373) 6846 : audit [DBG] from='client.155745 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:15:20.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:15:20 smithi157 bash[24585]: cluster 2024-09-16T08:15:20.424308+0000 mgr.a (mgr.14373) 6847 : cluster [DBG] pgmap v4747: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:15:20.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:15:20 smithi086 bash[24289]: cluster 2024-09-16T08:15:20.424308+0000 mgr.a (mgr.14373) 6847 : cluster [DBG] pgmap v4747: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:15:20.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:15:20 smithi047 bash[22744]: cluster 2024-09-16T08:15:20.424308+0000 mgr.a (mgr.14373) 6847 : cluster [DBG] pgmap v4747: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:15:22.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:15:22 smithi157 bash[24585]: cluster 2024-09-16T08:15:22.426579+0000 mgr.a (mgr.14373) 6848 : cluster [DBG] pgmap v4748: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:15:22.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:15:22 smithi086 bash[24289]: cluster 2024-09-16T08:15:22.426579+0000 mgr.a (mgr.14373) 6848 : cluster [DBG] pgmap v4748: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:15:22.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:15:22 smithi047 bash[22744]: cluster 2024-09-16T08:15:22.426579+0000 mgr.a (mgr.14373) 6848 : cluster [DBG] pgmap v4748: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:15:24.546 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:15:24.546 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:15:24.547 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:15:24.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:15:24 smithi157 bash[24585]: cluster 2024-09-16T08:15:24.427360+0000 mgr.a (mgr.14373) 6849 : cluster [DBG] pgmap v4749: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:15:24.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:15:24 smithi086 bash[24289]: cluster 2024-09-16T08:15:24.427360+0000 mgr.a (mgr.14373) 6849 : cluster [DBG] pgmap v4749: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:15:24.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:15:24 smithi047 bash[22744]: cluster 2024-09-16T08:15:24.427360+0000 mgr.a (mgr.14373) 6849 : cluster [DBG] pgmap v4749: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:15:25.345 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:15:25.346 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:15:25.346 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:15:25.346 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:15:25.346 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:15:25.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:15:25 smithi157 bash[24585]: audit 2024-09-16T08:15:24.887300+0000 mgr.a (mgr.14373) 6850 : audit [DBG] from='client.155820 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:15:25.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:15:25 smithi086 bash[24289]: audit 2024-09-16T08:15:24.887300+0000 mgr.a (mgr.14373) 6850 : audit [DBG] from='client.155820 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:15:25.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:15:25 smithi047 bash[22744]: audit 2024-09-16T08:15:24.887300+0000 mgr.a (mgr.14373) 6850 : audit [DBG] from='client.155820 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:15:26.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:15:26 smithi157 bash[24585]: cluster 2024-09-16T08:15:26.428345+0000 mgr.a (mgr.14373) 6851 : cluster [DBG] pgmap v4750: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:15:26.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:15:26 smithi086 bash[24289]: cluster 2024-09-16T08:15:26.428345+0000 mgr.a (mgr.14373) 6851 : cluster [DBG] pgmap v4750: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:15:26.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:15:26 smithi047 bash[22744]: cluster 2024-09-16T08:15:26.428345+0000 mgr.a (mgr.14373) 6851 : cluster [DBG] pgmap v4750: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:15:28.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:15:28 smithi157 bash[24585]: cluster 2024-09-16T08:15:28.430618+0000 mgr.a (mgr.14373) 6852 : cluster [DBG] pgmap v4751: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:15:28.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:15:28 smithi086 bash[24289]: cluster 2024-09-16T08:15:28.430618+0000 mgr.a (mgr.14373) 6852 : cluster [DBG] pgmap v4751: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:15:28.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:15:28 smithi047 bash[22744]: cluster 2024-09-16T08:15:28.430618+0000 mgr.a (mgr.14373) 6852 : cluster [DBG] pgmap v4751: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:15:30.347 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:15:30.348 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:15:30.348 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:15:30.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:15:30 smithi157 bash[24585]: cluster 2024-09-16T08:15:30.431416+0000 mgr.a (mgr.14373) 6853 : cluster [DBG] pgmap v4752: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:15:30.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:15:30 smithi086 bash[24289]: cluster 2024-09-16T08:15:30.431416+0000 mgr.a (mgr.14373) 6853 : cluster [DBG] pgmap v4752: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:15:30.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:15:30 smithi047 bash[22744]: cluster 2024-09-16T08:15:30.431416+0000 mgr.a (mgr.14373) 6853 : cluster [DBG] pgmap v4752: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:15:31.133 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:15:31.133 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:15:31.133 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:15:31.133 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:15:31.134 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:15:31.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:15:31 smithi157 bash[24585]: audit 2024-09-16T08:15:30.687538+0000 mgr.a (mgr.14373) 6854 : audit [DBG] from='client.155895 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:15:31.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:15:31 smithi086 bash[24289]: audit 2024-09-16T08:15:30.687538+0000 mgr.a (mgr.14373) 6854 : audit [DBG] from='client.155895 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:15:31.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:15:31 smithi047 bash[22744]: audit 2024-09-16T08:15:30.687538+0000 mgr.a (mgr.14373) 6854 : audit [DBG] from='client.155895 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:15:32.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:15:32 smithi157 bash[24585]: cluster 2024-09-16T08:15:32.433850+0000 mgr.a (mgr.14373) 6855 : cluster [DBG] pgmap v4753: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:15:32.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:15:32 smithi086 bash[24289]: cluster 2024-09-16T08:15:32.433850+0000 mgr.a (mgr.14373) 6855 : cluster [DBG] pgmap v4753: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:15:32.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:15:32 smithi047 bash[22744]: cluster 2024-09-16T08:15:32.433850+0000 mgr.a (mgr.14373) 6855 : cluster [DBG] pgmap v4753: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:15:34.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:15:34 smithi157 bash[24585]: cluster 2024-09-16T08:15:34.434654+0000 mgr.a (mgr.14373) 6856 : cluster [DBG] pgmap v4754: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:15:34.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:15:34 smithi086 bash[24289]: cluster 2024-09-16T08:15:34.434654+0000 mgr.a (mgr.14373) 6856 : cluster [DBG] pgmap v4754: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:15:34.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:15:34 smithi047 bash[22744]: cluster 2024-09-16T08:15:34.434654+0000 mgr.a (mgr.14373) 6856 : cluster [DBG] pgmap v4754: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:15:36.131 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:15:36.132 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:15:36.132 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:15:36.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:15:36 smithi157 bash[24585]: cluster 2024-09-16T08:15:36.435353+0000 mgr.a (mgr.14373) 6857 : cluster [DBG] pgmap v4755: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:15:36.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:15:36 smithi086 bash[24289]: cluster 2024-09-16T08:15:36.435353+0000 mgr.a (mgr.14373) 6857 : cluster [DBG] pgmap v4755: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:15:36.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:15:36 smithi047 bash[22744]: cluster 2024-09-16T08:15:36.435353+0000 mgr.a (mgr.14373) 6857 : cluster [DBG] pgmap v4755: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:15:36.896 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:15:36.897 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:15:36.897 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:15:36.897 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:15:36.897 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:15:37.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:15:37 smithi157 bash[24585]: audit 2024-09-16T08:15:36.463129+0000 mgr.a (mgr.14373) 6858 : audit [DBG] from='client.155970 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:15:37.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:15:37 smithi086 bash[24289]: audit 2024-09-16T08:15:36.463129+0000 mgr.a (mgr.14373) 6858 : audit [DBG] from='client.155970 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:15:37.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:15:37 smithi047 bash[22744]: audit 2024-09-16T08:15:36.463129+0000 mgr.a (mgr.14373) 6858 : audit [DBG] from='client.155970 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:15:38.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:15:38 smithi157 bash[24585]: cluster 2024-09-16T08:15:38.437977+0000 mgr.a (mgr.14373) 6859 : cluster [DBG] pgmap v4756: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:15:38.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:15:38 smithi086 bash[24289]: cluster 2024-09-16T08:15:38.437977+0000 mgr.a (mgr.14373) 6859 : cluster [DBG] pgmap v4756: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:15:38.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:15:38 smithi047 bash[22744]: cluster 2024-09-16T08:15:38.437977+0000 mgr.a (mgr.14373) 6859 : cluster [DBG] pgmap v4756: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:15:40.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:15:40 smithi157 bash[24585]: cluster 2024-09-16T08:15:40.438770+0000 mgr.a (mgr.14373) 6860 : cluster [DBG] pgmap v4757: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:15:40.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:15:40 smithi086 bash[24289]: cluster 2024-09-16T08:15:40.438770+0000 mgr.a (mgr.14373) 6860 : cluster [DBG] pgmap v4757: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:15:40.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:15:40 smithi047 bash[22744]: cluster 2024-09-16T08:15:40.438770+0000 mgr.a (mgr.14373) 6860 : cluster [DBG] pgmap v4757: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:15:41.898 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:15:41.899 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:15:41.899 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:15:42.645 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:15:42.645 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:15:42.645 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:15:42.645 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:15:42.645 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:15:42.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:15:42 smithi157 bash[24585]: audit 2024-09-16T08:15:42.234636+0000 mgr.a (mgr.14373) 6861 : audit [DBG] from='client.156045 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:15:42.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:15:42 smithi157 bash[24585]: cluster 2024-09-16T08:15:42.440172+0000 mgr.a (mgr.14373) 6862 : cluster [DBG] pgmap v4758: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:15:42.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:15:42 smithi086 bash[24289]: audit 2024-09-16T08:15:42.234636+0000 mgr.a (mgr.14373) 6861 : audit [DBG] from='client.156045 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:15:42.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:15:42 smithi086 bash[24289]: cluster 2024-09-16T08:15:42.440172+0000 mgr.a (mgr.14373) 6862 : cluster [DBG] pgmap v4758: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:15:42.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:15:42 smithi047 bash[22744]: audit 2024-09-16T08:15:42.234636+0000 mgr.a (mgr.14373) 6861 : audit [DBG] from='client.156045 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:15:42.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:15:42 smithi047 bash[22744]: cluster 2024-09-16T08:15:42.440172+0000 mgr.a (mgr.14373) 6862 : cluster [DBG] pgmap v4758: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:15:44.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:15:44 smithi157 bash[24585]: cluster 2024-09-16T08:15:44.441011+0000 mgr.a (mgr.14373) 6863 : cluster [DBG] pgmap v4759: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:15:44.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:15:44 smithi086 bash[24289]: cluster 2024-09-16T08:15:44.441011+0000 mgr.a (mgr.14373) 6863 : cluster [DBG] pgmap v4759: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:15:44.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:15:44 smithi047 bash[22744]: cluster 2024-09-16T08:15:44.441011+0000 mgr.a (mgr.14373) 6863 : cluster [DBG] pgmap v4759: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:15:46.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:15:46 smithi157 bash[24585]: cluster 2024-09-16T08:15:46.441736+0000 mgr.a (mgr.14373) 6864 : cluster [DBG] pgmap v4760: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T08:15:46.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:15:46 smithi086 bash[24289]: cluster 2024-09-16T08:15:46.441736+0000 mgr.a (mgr.14373) 6864 : cluster [DBG] pgmap v4760: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T08:15:46.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:15:46 smithi047 bash[22744]: cluster 2024-09-16T08:15:46.441736+0000 mgr.a (mgr.14373) 6864 : cluster [DBG] pgmap v4760: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T08:15:47.646 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:15:47.647 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:15:47.647 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:15:48.431 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:15:48.431 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:15:48.431 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:15:48.431 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:15:48.431 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:15:48.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:15:48 smithi157 bash[24585]: audit 2024-09-16T08:15:47.989381+0000 mgr.a (mgr.14373) 6865 : audit [DBG] from='client.156120 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:15:48.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:15:48 smithi157 bash[24585]: cluster 2024-09-16T08:15:48.443380+0000 mgr.a (mgr.14373) 6866 : cluster [DBG] pgmap v4761: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:15:48.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:15:48 smithi086 bash[24289]: audit 2024-09-16T08:15:47.989381+0000 mgr.a (mgr.14373) 6865 : audit [DBG] from='client.156120 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:15:48.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:15:48 smithi086 bash[24289]: cluster 2024-09-16T08:15:48.443380+0000 mgr.a (mgr.14373) 6866 : cluster [DBG] pgmap v4761: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:15:48.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:15:48 smithi047 bash[22744]: audit 2024-09-16T08:15:47.989381+0000 mgr.a (mgr.14373) 6865 : audit [DBG] from='client.156120 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:15:48.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:15:48 smithi047 bash[22744]: cluster 2024-09-16T08:15:48.443380+0000 mgr.a (mgr.14373) 6866 : cluster [DBG] pgmap v4761: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:15:50.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:15:50 smithi157 bash[24585]: cluster 2024-09-16T08:15:50.444108+0000 mgr.a (mgr.14373) 6867 : cluster [DBG] pgmap v4762: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:15:50.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:15:50 smithi086 bash[24289]: cluster 2024-09-16T08:15:50.444108+0000 mgr.a (mgr.14373) 6867 : cluster [DBG] pgmap v4762: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:15:50.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:15:50 smithi047 bash[22744]: cluster 2024-09-16T08:15:50.444108+0000 mgr.a (mgr.14373) 6867 : cluster [DBG] pgmap v4762: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:15:52.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:15:52 smithi157 bash[24585]: cluster 2024-09-16T08:15:52.446101+0000 mgr.a (mgr.14373) 6868 : cluster [DBG] pgmap v4763: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:15:52.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:15:52 smithi086 bash[24289]: cluster 2024-09-16T08:15:52.446101+0000 mgr.a (mgr.14373) 6868 : cluster [DBG] pgmap v4763: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:15:52.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:15:52 smithi047 bash[22744]: cluster 2024-09-16T08:15:52.446101+0000 mgr.a (mgr.14373) 6868 : cluster [DBG] pgmap v4763: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:15:53.432 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:15:53.433 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:15:53.433 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:15:54.192 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:15:54.193 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:15:54.193 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:15:54.193 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:15:54.193 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:15:54.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:15:54 smithi157 bash[24585]: audit 2024-09-16T08:15:53.773233+0000 mgr.a (mgr.14373) 6869 : audit [DBG] from='client.156195 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:15:54.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:15:54 smithi157 bash[24585]: cluster 2024-09-16T08:15:54.447057+0000 mgr.a (mgr.14373) 6870 : cluster [DBG] pgmap v4764: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:15:54.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:15:54 smithi086 bash[24289]: audit 2024-09-16T08:15:53.773233+0000 mgr.a (mgr.14373) 6869 : audit [DBG] from='client.156195 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:15:54.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:15:54 smithi086 bash[24289]: cluster 2024-09-16T08:15:54.447057+0000 mgr.a (mgr.14373) 6870 : cluster [DBG] pgmap v4764: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:15:54.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:15:54 smithi047 bash[22744]: audit 2024-09-16T08:15:53.773233+0000 mgr.a (mgr.14373) 6869 : audit [DBG] from='client.156195 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:15:54.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:15:54 smithi047 bash[22744]: cluster 2024-09-16T08:15:54.447057+0000 mgr.a (mgr.14373) 6870 : cluster [DBG] pgmap v4764: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:15:56.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:15:56 smithi157 bash[24585]: cluster 2024-09-16T08:15:56.448392+0000 mgr.a (mgr.14373) 6871 : cluster [DBG] pgmap v4765: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-16T08:15:56.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:15:56 smithi086 bash[24289]: cluster 2024-09-16T08:15:56.448392+0000 mgr.a (mgr.14373) 6871 : cluster [DBG] pgmap v4765: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-16T08:15:56.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:15:56 smithi047 bash[22744]: cluster 2024-09-16T08:15:56.448392+0000 mgr.a (mgr.14373) 6871 : cluster [DBG] pgmap v4765: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-16T08:15:58.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:15:58 smithi157 bash[24585]: cluster 2024-09-16T08:15:58.450019+0000 mgr.a (mgr.14373) 6872 : cluster [DBG] pgmap v4766: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:15:58.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:15:58 smithi086 bash[24289]: cluster 2024-09-16T08:15:58.450019+0000 mgr.a (mgr.14373) 6872 : cluster [DBG] pgmap v4766: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:15:58.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:15:58 smithi047 bash[22744]: cluster 2024-09-16T08:15:58.450019+0000 mgr.a (mgr.14373) 6872 : cluster [DBG] pgmap v4766: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:15:59.194 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:15:59.195 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:15:59.195 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:15:59.981 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:15:59.982 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:15:59.982 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:15:59.982 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:15:59.982 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:16:00.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:16:00 smithi157 bash[24585]: audit 2024-09-16T08:15:59.530085+0000 mgr.a (mgr.14373) 6873 : audit [DBG] from='client.156273 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:16:00.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:16:00 smithi157 bash[24585]: cluster 2024-09-16T08:16:00.451057+0000 mgr.a (mgr.14373) 6874 : cluster [DBG] pgmap v4767: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:16:00.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:16:00 smithi086 bash[24289]: audit 2024-09-16T08:15:59.530085+0000 mgr.a (mgr.14373) 6873 : audit [DBG] from='client.156273 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:16:00.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:16:00 smithi086 bash[24289]: cluster 2024-09-16T08:16:00.451057+0000 mgr.a (mgr.14373) 6874 : cluster [DBG] pgmap v4767: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:16:00.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:16:00 smithi047 bash[22744]: audit 2024-09-16T08:15:59.530085+0000 mgr.a (mgr.14373) 6873 : audit [DBG] from='client.156273 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:16:00.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:16:00 smithi047 bash[22744]: cluster 2024-09-16T08:16:00.451057+0000 mgr.a (mgr.14373) 6874 : cluster [DBG] pgmap v4767: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:16:02.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:16:02 smithi157 bash[24585]: cluster 2024-09-16T08:16:02.453268+0000 mgr.a (mgr.14373) 6875 : cluster [DBG] pgmap v4768: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:16:02.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:16:02 smithi086 bash[24289]: cluster 2024-09-16T08:16:02.453268+0000 mgr.a (mgr.14373) 6875 : cluster [DBG] pgmap v4768: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:16:02.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:16:02 smithi047 bash[22744]: cluster 2024-09-16T08:16:02.453268+0000 mgr.a (mgr.14373) 6875 : cluster [DBG] pgmap v4768: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:16:04.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:16:04 smithi157 bash[24585]: cluster 2024-09-16T08:16:04.454020+0000 mgr.a (mgr.14373) 6876 : cluster [DBG] pgmap v4769: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:16:04.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:16:04 smithi086 bash[24289]: cluster 2024-09-16T08:16:04.454020+0000 mgr.a (mgr.14373) 6876 : cluster [DBG] pgmap v4769: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:16:04.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:16:04 smithi047 bash[22744]: cluster 2024-09-16T08:16:04.454020+0000 mgr.a (mgr.14373) 6876 : cluster [DBG] pgmap v4769: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:16:04.983 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:16:04.984 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:16:04.984 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:16:05.759 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:16:05.759 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:16:05.759 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:16:05.759 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:16:05.759 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:16:05.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:16:05 smithi157 bash[24585]: audit 2024-09-16T08:16:05.325146+0000 mgr.a (mgr.14373) 6877 : audit [DBG] from='client.156351 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:16:05.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:16:05 smithi086 bash[24289]: audit 2024-09-16T08:16:05.325146+0000 mgr.a (mgr.14373) 6877 : audit [DBG] from='client.156351 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:16:05.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:16:05 smithi047 bash[22744]: audit 2024-09-16T08:16:05.325146+0000 mgr.a (mgr.14373) 6877 : audit [DBG] from='client.156351 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:16:06.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:16:06 smithi157 bash[24585]: cluster 2024-09-16T08:16:06.455564+0000 mgr.a (mgr.14373) 6878 : cluster [DBG] pgmap v4770: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-16T08:16:06.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:16:06 smithi086 bash[24289]: cluster 2024-09-16T08:16:06.455564+0000 mgr.a (mgr.14373) 6878 : cluster [DBG] pgmap v4770: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-16T08:16:06.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:16:06 smithi047 bash[22744]: cluster 2024-09-16T08:16:06.455564+0000 mgr.a (mgr.14373) 6878 : cluster [DBG] pgmap v4770: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-16T08:16:08.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:16:08 smithi157 bash[24585]: cluster 2024-09-16T08:16:08.457234+0000 mgr.a (mgr.14373) 6879 : cluster [DBG] pgmap v4771: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:16:08.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:16:08 smithi086 bash[24289]: cluster 2024-09-16T08:16:08.457234+0000 mgr.a (mgr.14373) 6879 : cluster [DBG] pgmap v4771: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:16:08.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:16:08 smithi047 bash[22744]: cluster 2024-09-16T08:16:08.457234+0000 mgr.a (mgr.14373) 6879 : cluster [DBG] pgmap v4771: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:16:09.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:16:09 smithi157 bash[24585]: audit 2024-09-16T08:16:09.244941+0000 mon.b (mon.2) 654 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T08:16:09.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:16:09 smithi086 bash[24289]: audit 2024-09-16T08:16:09.244941+0000 mon.b (mon.2) 654 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T08:16:09.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:16:09 smithi047 bash[22744]: audit 2024-09-16T08:16:09.244941+0000 mon.b (mon.2) 654 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T08:16:10.760 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:16:10.761 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:16:10.761 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:16:10.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:16:10 smithi157 bash[24585]: cluster 2024-09-16T08:16:10.458006+0000 mgr.a (mgr.14373) 6880 : cluster [DBG] pgmap v4772: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:16:10.816 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:16:10 smithi086 bash[24289]: cluster 2024-09-16T08:16:10.458006+0000 mgr.a (mgr.14373) 6880 : cluster [DBG] pgmap v4772: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:16:10.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:16:10 smithi047 bash[22744]: cluster 2024-09-16T08:16:10.458006+0000 mgr.a (mgr.14373) 6880 : cluster [DBG] pgmap v4772: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:16:11.523 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:16:11.523 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:16:11.523 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:16:11.523 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:16:11.523 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:16:11.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:16:11 smithi157 bash[24585]: audit 2024-09-16T08:16:11.100843+0000 mgr.a (mgr.14373) 6881 : audit [DBG] from='client.156426 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:16:11.816 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:16:11 smithi086 bash[24289]: audit 2024-09-16T08:16:11.100843+0000 mgr.a (mgr.14373) 6881 : audit [DBG] from='client.156426 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:16:11.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:16:11 smithi047 bash[22744]: audit 2024-09-16T08:16:11.100843+0000 mgr.a (mgr.14373) 6881 : audit [DBG] from='client.156426 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:16:12.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:16:12 smithi157 bash[24585]: cluster 2024-09-16T08:16:12.460503+0000 mgr.a (mgr.14373) 6882 : cluster [DBG] pgmap v4773: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-16T08:16:12.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:16:12 smithi086 bash[24289]: cluster 2024-09-16T08:16:12.460503+0000 mgr.a (mgr.14373) 6882 : cluster [DBG] pgmap v4773: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-16T08:16:12.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:16:12 smithi047 bash[22744]: cluster 2024-09-16T08:16:12.460503+0000 mgr.a (mgr.14373) 6882 : cluster [DBG] pgmap v4773: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-16T08:16:14.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:16:14 smithi157 bash[24585]: cluster 2024-09-16T08:16:14.461000+0000 mgr.a (mgr.14373) 6883 : cluster [DBG] pgmap v4774: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T08:16:14.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:16:14 smithi086 bash[24289]: cluster 2024-09-16T08:16:14.461000+0000 mgr.a (mgr.14373) 6883 : cluster [DBG] pgmap v4774: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T08:16:14.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:16:14 smithi047 bash[22744]: cluster 2024-09-16T08:16:14.461000+0000 mgr.a (mgr.14373) 6883 : cluster [DBG] pgmap v4774: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T08:16:16.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:16:15 smithi157 bash[24585]: audit 2024-09-16T08:16:14.600099+0000 mon.a (mon.0) 979 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:16:16.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:16:15 smithi157 bash[24585]: audit 2024-09-16T08:16:14.604988+0000 mon.a (mon.0) 980 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:16:16.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:16:15 smithi157 bash[24585]: audit 2024-09-16T08:16:14.611256+0000 mon.a (mon.0) 981 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:16:16.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:16:15 smithi157 bash[24585]: audit 2024-09-16T08:16:14.614530+0000 mon.a (mon.0) 982 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:16:16.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:16:15 smithi157 bash[24585]: audit 2024-09-16T08:16:14.631169+0000 mon.a (mon.0) 983 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:16:16.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:16:15 smithi157 bash[24585]: audit 2024-09-16T08:16:14.635555+0000 mon.a (mon.0) 984 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:16:16.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:16:15 smithi157 bash[24585]: audit 2024-09-16T08:16:15.363225+0000 mon.b (mon.2) 655 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T08:16:16.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:16:15 smithi157 bash[24585]: audit 2024-09-16T08:16:15.365216+0000 mon.b (mon.2) 656 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T08:16:16.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:16:15 smithi157 bash[24585]: audit 2024-09-16T08:16:15.377926+0000 mon.a (mon.0) 985 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:16:16.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:16:15 smithi157 bash[24585]: audit 2024-09-16T08:16:15.382321+0000 mon.b (mon.2) 657 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:16:16.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:16:15 smithi157 bash[24585]: audit 2024-09-16T08:16:15.386042+0000 mgr.a (mgr.14373) 6884 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:16:16.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:16:15 smithi086 bash[24289]: audit 2024-09-16T08:16:14.600099+0000 mon.a (mon.0) 979 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:16:16.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:16:15 smithi086 bash[24289]: audit 2024-09-16T08:16:14.604988+0000 mon.a (mon.0) 980 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:16:16.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:16:15 smithi086 bash[24289]: audit 2024-09-16T08:16:14.611256+0000 mon.a (mon.0) 981 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:16:16.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:16:15 smithi086 bash[24289]: audit 2024-09-16T08:16:14.614530+0000 mon.a (mon.0) 982 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:16:16.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:16:15 smithi086 bash[24289]: audit 2024-09-16T08:16:14.631169+0000 mon.a (mon.0) 983 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:16:16.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:16:15 smithi086 bash[24289]: audit 2024-09-16T08:16:14.635555+0000 mon.a (mon.0) 984 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:16:16.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:16:15 smithi086 bash[24289]: audit 2024-09-16T08:16:15.363225+0000 mon.b (mon.2) 655 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T08:16:16.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:16:15 smithi086 bash[24289]: audit 2024-09-16T08:16:15.365216+0000 mon.b (mon.2) 656 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T08:16:16.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:16:15 smithi086 bash[24289]: audit 2024-09-16T08:16:15.377926+0000 mon.a (mon.0) 985 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:16:16.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:16:15 smithi086 bash[24289]: audit 2024-09-16T08:16:15.382321+0000 mon.b (mon.2) 657 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:16:16.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:16:15 smithi086 bash[24289]: audit 2024-09-16T08:16:15.386042+0000 mgr.a (mgr.14373) 6884 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:16:16.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:16:15 smithi047 bash[22744]: audit 2024-09-16T08:16:14.600099+0000 mon.a (mon.0) 979 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:16:16.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:16:15 smithi047 bash[22744]: audit 2024-09-16T08:16:14.604988+0000 mon.a (mon.0) 980 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:16:16.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:16:15 smithi047 bash[22744]: audit 2024-09-16T08:16:14.611256+0000 mon.a (mon.0) 981 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:16:16.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:16:15 smithi047 bash[22744]: audit 2024-09-16T08:16:14.614530+0000 mon.a (mon.0) 982 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:16:16.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:16:15 smithi047 bash[22744]: audit 2024-09-16T08:16:14.631169+0000 mon.a (mon.0) 983 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:16:16.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:16:15 smithi047 bash[22744]: audit 2024-09-16T08:16:14.635555+0000 mon.a (mon.0) 984 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:16:16.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:16:15 smithi047 bash[22744]: audit 2024-09-16T08:16:15.363225+0000 mon.b (mon.2) 655 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T08:16:16.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:16:15 smithi047 bash[22744]: audit 2024-09-16T08:16:15.365216+0000 mon.b (mon.2) 656 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T08:16:16.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:16:15 smithi047 bash[22744]: audit 2024-09-16T08:16:15.377926+0000 mon.a (mon.0) 985 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:16:16.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:16:15 smithi047 bash[22744]: audit 2024-09-16T08:16:15.382321+0000 mon.b (mon.2) 657 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:16:16.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:16:15 smithi047 bash[22744]: audit 2024-09-16T08:16:15.386042+0000 mgr.a (mgr.14373) 6884 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:16:16.524 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:16:16.525 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:16:16.525 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:16:16.588 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 08:16:16 smithi047 bash[22994]: debug 2024-09-16T08:16:16.106+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T08:16:16.588 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 08:16:16 smithi047 bash[22994]: debug 2024-09-16T08:16:16.110+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T08:16:17.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:16:16 smithi157 bash[24585]: audit 2024-09-16T08:16:16.108433+0000 mgr.a (mgr.14373) 6885 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T08:16:17.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:16:16 smithi157 bash[24585]: cephadm 2024-09-16T08:16:16.110752+0000 mgr.a (mgr.14373) 6886 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T08:16:17.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:16:16 smithi157 bash[24585]: cluster 2024-09-16T08:16:16.462566+0000 mgr.a (mgr.14373) 6887 : cluster [DBG] pgmap v4775: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.8 KiB/s rd, 85 B/s wr, 2 op/s 2024-09-16T08:16:17.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:16:16 smithi086 bash[24289]: audit 2024-09-16T08:16:16.108433+0000 mgr.a (mgr.14373) 6885 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T08:16:17.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:16:16 smithi086 bash[24289]: cephadm 2024-09-16T08:16:16.110752+0000 mgr.a (mgr.14373) 6886 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T08:16:17.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:16:16 smithi086 bash[24289]: cluster 2024-09-16T08:16:16.462566+0000 mgr.a (mgr.14373) 6887 : cluster [DBG] pgmap v4775: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.8 KiB/s rd, 85 B/s wr, 2 op/s 2024-09-16T08:16:17.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:16:16 smithi047 bash[22744]: audit 2024-09-16T08:16:16.108433+0000 mgr.a (mgr.14373) 6885 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T08:16:17.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:16:16 smithi047 bash[22744]: cephadm 2024-09-16T08:16:16.110752+0000 mgr.a (mgr.14373) 6886 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T08:16:17.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:16:16 smithi047 bash[22744]: cluster 2024-09-16T08:16:16.462566+0000 mgr.a (mgr.14373) 6887 : cluster [DBG] pgmap v4775: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.8 KiB/s rd, 85 B/s wr, 2 op/s 2024-09-16T08:16:17.276 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:16:17.277 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:16:17.277 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:16:17.277 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:16:17.277 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:16:18.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:16:17 smithi157 bash[24585]: audit 2024-09-16T08:16:16.853434+0000 mgr.a (mgr.14373) 6888 : audit [DBG] from='client.156609 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:16:18.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:16:17 smithi086 bash[24289]: audit 2024-09-16T08:16:16.853434+0000 mgr.a (mgr.14373) 6888 : audit [DBG] from='client.156609 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:16:18.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:16:17 smithi047 bash[22744]: audit 2024-09-16T08:16:16.853434+0000 mgr.a (mgr.14373) 6888 : audit [DBG] from='client.156609 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:16:19.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:16:18 smithi157 bash[24585]: cluster 2024-09-16T08:16:18.464796+0000 mgr.a (mgr.14373) 6889 : cluster [DBG] pgmap v4776: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 6.9 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T08:16:19.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:16:18 smithi086 bash[24289]: cluster 2024-09-16T08:16:18.464796+0000 mgr.a (mgr.14373) 6889 : cluster [DBG] pgmap v4776: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 6.9 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T08:16:19.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:16:18 smithi047 bash[22744]: cluster 2024-09-16T08:16:18.464796+0000 mgr.a (mgr.14373) 6889 : cluster [DBG] pgmap v4776: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 6.9 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T08:16:20.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:16:20 smithi157 bash[24585]: cluster 2024-09-16T08:16:20.465581+0000 mgr.a (mgr.14373) 6890 : cluster [DBG] pgmap v4777: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T08:16:20.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:16:20 smithi086 bash[24289]: cluster 2024-09-16T08:16:20.465581+0000 mgr.a (mgr.14373) 6890 : cluster [DBG] pgmap v4777: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T08:16:20.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:16:20 smithi047 bash[22744]: cluster 2024-09-16T08:16:20.465581+0000 mgr.a (mgr.14373) 6890 : cluster [DBG] pgmap v4777: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T08:16:22.278 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:16:22.279 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:16:22.279 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:16:22.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:16:22 smithi157 bash[24585]: cluster 2024-09-16T08:16:22.467533+0000 mgr.a (mgr.14373) 6891 : cluster [DBG] pgmap v4778: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:16:22.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:16:22 smithi086 bash[24289]: cluster 2024-09-16T08:16:22.467533+0000 mgr.a (mgr.14373) 6891 : cluster [DBG] pgmap v4778: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:16:22.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:16:22 smithi047 bash[22744]: cluster 2024-09-16T08:16:22.467533+0000 mgr.a (mgr.14373) 6891 : cluster [DBG] pgmap v4778: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:16:23.029 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:16:23.029 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:16:23.030 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:16:23.030 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:16:23.030 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:16:23.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:16:23 smithi157 bash[24585]: audit 2024-09-16T08:16:22.614272+0000 mgr.a (mgr.14373) 6892 : audit [DBG] from='client.156687 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:16:23.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:16:23 smithi086 bash[24289]: audit 2024-09-16T08:16:22.614272+0000 mgr.a (mgr.14373) 6892 : audit [DBG] from='client.156687 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:16:23.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:16:23 smithi047 bash[22744]: audit 2024-09-16T08:16:22.614272+0000 mgr.a (mgr.14373) 6892 : audit [DBG] from='client.156687 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:16:24.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:16:24 smithi157 bash[24585]: cluster 2024-09-16T08:16:24.468452+0000 mgr.a (mgr.14373) 6893 : cluster [DBG] pgmap v4779: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T08:16:24.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:16:24 smithi086 bash[24289]: cluster 2024-09-16T08:16:24.468452+0000 mgr.a (mgr.14373) 6893 : cluster [DBG] pgmap v4779: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T08:16:24.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:16:24 smithi047 bash[22744]: cluster 2024-09-16T08:16:24.468452+0000 mgr.a (mgr.14373) 6893 : cluster [DBG] pgmap v4779: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T08:16:26.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:16:26 smithi157 bash[24585]: cluster 2024-09-16T08:16:26.470230+0000 mgr.a (mgr.14373) 6894 : cluster [DBG] pgmap v4780: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 6.8 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T08:16:26.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:16:26 smithi086 bash[24289]: cluster 2024-09-16T08:16:26.470230+0000 mgr.a (mgr.14373) 6894 : cluster [DBG] pgmap v4780: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 6.8 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T08:16:26.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:16:26 smithi047 bash[22744]: cluster 2024-09-16T08:16:26.470230+0000 mgr.a (mgr.14373) 6894 : cluster [DBG] pgmap v4780: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 6.8 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T08:16:28.031 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:16:28.032 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:16:28.032 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:16:28.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:16:28 smithi157 bash[24585]: audit 2024-09-16T08:16:28.373232+0000 mgr.a (mgr.14373) 6895 : audit [DBG] from='client.156765 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:16:28.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:16:28 smithi157 bash[24585]: cluster 2024-09-16T08:16:28.471235+0000 mgr.a (mgr.14373) 6896 : cluster [DBG] pgmap v4781: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 6.0 KiB/s rd, 341 B/s wr, 5 op/s 2024-09-16T08:16:28.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:16:28 smithi086 bash[24289]: audit 2024-09-16T08:16:28.373232+0000 mgr.a (mgr.14373) 6895 : audit [DBG] from='client.156765 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:16:28.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:16:28 smithi086 bash[24289]: cluster 2024-09-16T08:16:28.471235+0000 mgr.a (mgr.14373) 6896 : cluster [DBG] pgmap v4781: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 6.0 KiB/s rd, 341 B/s wr, 5 op/s 2024-09-16T08:16:28.820 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:16:28.820 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:16:28.820 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:16:28.821 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:16:28.821 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:16:28.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:16:28 smithi047 bash[22744]: audit 2024-09-16T08:16:28.373232+0000 mgr.a (mgr.14373) 6895 : audit [DBG] from='client.156765 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:16:28.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:16:28 smithi047 bash[22744]: cluster 2024-09-16T08:16:28.471235+0000 mgr.a (mgr.14373) 6896 : cluster [DBG] pgmap v4781: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 6.0 KiB/s rd, 341 B/s wr, 5 op/s 2024-09-16T08:16:30.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:16:30 smithi157 bash[24585]: cluster 2024-09-16T08:16:30.472154+0000 mgr.a (mgr.14373) 6897 : cluster [DBG] pgmap v4782: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:16:30.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:16:30 smithi086 bash[24289]: cluster 2024-09-16T08:16:30.472154+0000 mgr.a (mgr.14373) 6897 : cluster [DBG] pgmap v4782: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:16:30.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:16:30 smithi047 bash[22744]: cluster 2024-09-16T08:16:30.472154+0000 mgr.a (mgr.14373) 6897 : cluster [DBG] pgmap v4782: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:16:33.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:16:33 smithi157 bash[24585]: cluster 2024-09-16T08:16:32.474329+0000 mgr.a (mgr.14373) 6898 : cluster [DBG] pgmap v4783: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:16:33.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:16:33 smithi086 bash[24289]: cluster 2024-09-16T08:16:32.474329+0000 mgr.a (mgr.14373) 6898 : cluster [DBG] pgmap v4783: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:16:33.821 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:16:33.822 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:16:33.822 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:16:33.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:16:33 smithi047 bash[22744]: cluster 2024-09-16T08:16:32.474329+0000 mgr.a (mgr.14373) 6898 : cluster [DBG] pgmap v4783: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:16:34.597 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:16:34.597 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:16:34.597 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:16:34.597 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:16:34.597 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:16:34.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:16:34 smithi157 bash[24585]: audit 2024-09-16T08:16:34.161332+0000 mgr.a (mgr.14373) 6899 : audit [DBG] from='client.156840 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:16:34.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:16:34 smithi086 bash[24289]: audit 2024-09-16T08:16:34.161332+0000 mgr.a (mgr.14373) 6899 : audit [DBG] from='client.156840 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:16:34.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:16:34 smithi047 bash[22744]: audit 2024-09-16T08:16:34.161332+0000 mgr.a (mgr.14373) 6899 : audit [DBG] from='client.156840 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:16:35.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:16:35 smithi157 bash[24585]: cluster 2024-09-16T08:16:34.474878+0000 mgr.a (mgr.14373) 6900 : cluster [DBG] pgmap v4784: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:16:35.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:16:35 smithi086 bash[24289]: cluster 2024-09-16T08:16:34.474878+0000 mgr.a (mgr.14373) 6900 : cluster [DBG] pgmap v4784: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:16:35.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:16:35 smithi047 bash[22744]: cluster 2024-09-16T08:16:34.474878+0000 mgr.a (mgr.14373) 6900 : cluster [DBG] pgmap v4784: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:16:37.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:16:37 smithi157 bash[24585]: cluster 2024-09-16T08:16:36.477064+0000 mgr.a (mgr.14373) 6901 : cluster [DBG] pgmap v4785: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:16:37.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:16:37 smithi086 bash[24289]: cluster 2024-09-16T08:16:36.477064+0000 mgr.a (mgr.14373) 6901 : cluster [DBG] pgmap v4785: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:16:37.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:16:37 smithi047 bash[22744]: cluster 2024-09-16T08:16:36.477064+0000 mgr.a (mgr.14373) 6901 : cluster [DBG] pgmap v4785: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:16:39.598 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:16:39.599 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:16:39.599 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:16:39.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:16:39 smithi157 bash[24585]: cluster 2024-09-16T08:16:38.477848+0000 mgr.a (mgr.14373) 6902 : cluster [DBG] pgmap v4786: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.4 KiB/s rd, 2 op/s 2024-09-16T08:16:39.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:16:39 smithi086 bash[24289]: cluster 2024-09-16T08:16:38.477848+0000 mgr.a (mgr.14373) 6902 : cluster [DBG] pgmap v4786: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.4 KiB/s rd, 2 op/s 2024-09-16T08:16:39.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:16:39 smithi047 bash[22744]: cluster 2024-09-16T08:16:38.477848+0000 mgr.a (mgr.14373) 6902 : cluster [DBG] pgmap v4786: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.4 KiB/s rd, 2 op/s 2024-09-16T08:16:40.374 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:16:40.375 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:16:40.375 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:16:40.375 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:16:40.375 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:16:40.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:16:40 smithi086 bash[24289]: audit 2024-09-16T08:16:39.936723+0000 mgr.a (mgr.14373) 6903 : audit [DBG] from='client.156915 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:16:40.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:16:40 smithi047 bash[22744]: audit 2024-09-16T08:16:39.936723+0000 mgr.a (mgr.14373) 6903 : audit [DBG] from='client.156915 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:16:41.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:16:40 smithi157 bash[24585]: audit 2024-09-16T08:16:39.936723+0000 mgr.a (mgr.14373) 6903 : audit [DBG] from='client.156915 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:16:41.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:16:41 smithi086 bash[24289]: cluster 2024-09-16T08:16:40.478802+0000 mgr.a (mgr.14373) 6904 : cluster [DBG] pgmap v4787: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:16:41.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:16:41 smithi047 bash[22744]: cluster 2024-09-16T08:16:40.478802+0000 mgr.a (mgr.14373) 6904 : cluster [DBG] pgmap v4787: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:16:42.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:16:41 smithi157 bash[24585]: cluster 2024-09-16T08:16:40.478802+0000 mgr.a (mgr.14373) 6904 : cluster [DBG] pgmap v4787: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:16:43.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:16:43 smithi086 bash[24289]: cluster 2024-09-16T08:16:42.481018+0000 mgr.a (mgr.14373) 6905 : cluster [DBG] pgmap v4788: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:16:43.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:16:43 smithi047 bash[22744]: cluster 2024-09-16T08:16:42.481018+0000 mgr.a (mgr.14373) 6905 : cluster [DBG] pgmap v4788: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:16:44.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:16:43 smithi157 bash[24585]: cluster 2024-09-16T08:16:42.481018+0000 mgr.a (mgr.14373) 6905 : cluster [DBG] pgmap v4788: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:16:45.376 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:16:45.377 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:16:45.377 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:16:45.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:16:45 smithi086 bash[24289]: cluster 2024-09-16T08:16:44.481704+0000 mgr.a (mgr.14373) 6906 : cluster [DBG] pgmap v4789: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:16:45.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:16:45 smithi047 bash[22744]: cluster 2024-09-16T08:16:44.481704+0000 mgr.a (mgr.14373) 6906 : cluster [DBG] pgmap v4789: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:16:46.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:16:45 smithi157 bash[24585]: cluster 2024-09-16T08:16:44.481704+0000 mgr.a (mgr.14373) 6906 : cluster [DBG] pgmap v4789: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:16:46.147 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:16:46.147 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:16:46.147 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:16:46.147 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:16:46.147 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:16:46.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:16:46 smithi047 bash[22744]: audit 2024-09-16T08:16:45.715632+0000 mgr.a (mgr.14373) 6907 : audit [DBG] from='client.156990 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:16:47.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:16:46 smithi157 bash[24585]: audit 2024-09-16T08:16:45.715632+0000 mgr.a (mgr.14373) 6907 : audit [DBG] from='client.156990 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:16:47.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:16:46 smithi086 bash[24289]: audit 2024-09-16T08:16:45.715632+0000 mgr.a (mgr.14373) 6907 : audit [DBG] from='client.156990 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:16:47.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:16:47 smithi047 bash[22744]: cluster 2024-09-16T08:16:46.484132+0000 mgr.a (mgr.14373) 6908 : cluster [DBG] pgmap v4790: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:16:48.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:16:47 smithi157 bash[24585]: cluster 2024-09-16T08:16:46.484132+0000 mgr.a (mgr.14373) 6908 : cluster [DBG] pgmap v4790: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:16:48.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:16:47 smithi086 bash[24289]: cluster 2024-09-16T08:16:46.484132+0000 mgr.a (mgr.14373) 6908 : cluster [DBG] pgmap v4790: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:16:49.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:16:49 smithi047 bash[22744]: cluster 2024-09-16T08:16:48.484960+0000 mgr.a (mgr.14373) 6909 : cluster [DBG] pgmap v4791: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:16:50.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:16:49 smithi157 bash[24585]: cluster 2024-09-16T08:16:48.484960+0000 mgr.a (mgr.14373) 6909 : cluster [DBG] pgmap v4791: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:16:50.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:16:49 smithi086 bash[24289]: cluster 2024-09-16T08:16:48.484960+0000 mgr.a (mgr.14373) 6909 : cluster [DBG] pgmap v4791: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:16:51.149 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:16:51.149 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:16:51.149 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:16:51.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:16:51 smithi047 bash[22744]: cluster 2024-09-16T08:16:50.485752+0000 mgr.a (mgr.14373) 6910 : cluster [DBG] pgmap v4792: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:16:51.916 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:16:51.916 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:16:51.916 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:16:51.916 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:16:51.917 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:16:52.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:16:51 smithi157 bash[24585]: cluster 2024-09-16T08:16:50.485752+0000 mgr.a (mgr.14373) 6910 : cluster [DBG] pgmap v4792: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:16:52.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:16:51 smithi086 bash[24289]: cluster 2024-09-16T08:16:50.485752+0000 mgr.a (mgr.14373) 6910 : cluster [DBG] pgmap v4792: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:16:53.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:16:52 smithi157 bash[24585]: audit 2024-09-16T08:16:51.487580+0000 mgr.a (mgr.14373) 6911 : audit [DBG] from='client.157065 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:16:53.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:16:52 smithi086 bash[24289]: audit 2024-09-16T08:16:51.487580+0000 mgr.a (mgr.14373) 6911 : audit [DBG] from='client.157065 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:16:53.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:16:52 smithi047 bash[22744]: audit 2024-09-16T08:16:51.487580+0000 mgr.a (mgr.14373) 6911 : audit [DBG] from='client.157065 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:16:54.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:16:53 smithi157 bash[24585]: cluster 2024-09-16T08:16:52.488581+0000 mgr.a (mgr.14373) 6912 : cluster [DBG] pgmap v4793: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:16:54.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:16:53 smithi086 bash[24289]: cluster 2024-09-16T08:16:52.488581+0000 mgr.a (mgr.14373) 6912 : cluster [DBG] pgmap v4793: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:16:54.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:16:53 smithi047 bash[22744]: cluster 2024-09-16T08:16:52.488581+0000 mgr.a (mgr.14373) 6912 : cluster [DBG] pgmap v4793: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:16:56.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:16:55 smithi157 bash[24585]: cluster 2024-09-16T08:16:54.489367+0000 mgr.a (mgr.14373) 6913 : cluster [DBG] pgmap v4794: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:16:56.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:16:55 smithi086 bash[24289]: cluster 2024-09-16T08:16:54.489367+0000 mgr.a (mgr.14373) 6913 : cluster [DBG] pgmap v4794: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:16:56.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:16:55 smithi047 bash[22744]: cluster 2024-09-16T08:16:54.489367+0000 mgr.a (mgr.14373) 6913 : cluster [DBG] pgmap v4794: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:16:56.918 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:16:56.918 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:16:56.918 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:16:57.665 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:16:57.665 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:16:57.665 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:16:57.665 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:16:57.665 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:16:58.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:16:57 smithi157 bash[24585]: cluster 2024-09-16T08:16:56.491301+0000 mgr.a (mgr.14373) 6914 : cluster [DBG] pgmap v4795: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:16:58.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:16:57 smithi157 bash[24585]: audit 2024-09-16T08:16:57.242434+0000 mgr.a (mgr.14373) 6915 : audit [DBG] from='client.157143 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:16:58.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:16:57 smithi086 bash[24289]: cluster 2024-09-16T08:16:56.491301+0000 mgr.a (mgr.14373) 6914 : cluster [DBG] pgmap v4795: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:16:58.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:16:57 smithi086 bash[24289]: audit 2024-09-16T08:16:57.242434+0000 mgr.a (mgr.14373) 6915 : audit [DBG] from='client.157143 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:16:58.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:16:57 smithi047 bash[22744]: cluster 2024-09-16T08:16:56.491301+0000 mgr.a (mgr.14373) 6914 : cluster [DBG] pgmap v4795: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:16:58.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:16:57 smithi047 bash[22744]: audit 2024-09-16T08:16:57.242434+0000 mgr.a (mgr.14373) 6915 : audit [DBG] from='client.157143 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:17:00.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:16:59 smithi157 bash[24585]: cluster 2024-09-16T08:16:58.492193+0000 mgr.a (mgr.14373) 6916 : cluster [DBG] pgmap v4796: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:17:00.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:16:59 smithi086 bash[24289]: cluster 2024-09-16T08:16:58.492193+0000 mgr.a (mgr.14373) 6916 : cluster [DBG] pgmap v4796: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:17:00.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:16:59 smithi047 bash[22744]: cluster 2024-09-16T08:16:58.492193+0000 mgr.a (mgr.14373) 6916 : cluster [DBG] pgmap v4796: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:17:01.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:17:01 smithi047 bash[22744]: cluster 2024-09-16T08:17:00.492968+0000 mgr.a (mgr.14373) 6917 : cluster [DBG] pgmap v4797: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T08:17:01.865 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:17:01 smithi086 bash[24289]: cluster 2024-09-16T08:17:00.492968+0000 mgr.a (mgr.14373) 6917 : cluster [DBG] pgmap v4797: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T08:17:02.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:17:01 smithi157 bash[24585]: cluster 2024-09-16T08:17:00.492968+0000 mgr.a (mgr.14373) 6917 : cluster [DBG] pgmap v4797: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T08:17:02.666 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:17:02.667 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:17:02.667 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:17:03.447 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:17:03.447 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:17:03.447 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:17:03.447 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:17:03.447 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:17:04.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:17:03 smithi157 bash[24585]: cluster 2024-09-16T08:17:02.495196+0000 mgr.a (mgr.14373) 6918 : cluster [DBG] pgmap v4798: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:17:04.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:17:03 smithi157 bash[24585]: audit 2024-09-16T08:17:03.006027+0000 mgr.a (mgr.14373) 6919 : audit [DBG] from='client.157221 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:17:04.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:17:03 smithi086 bash[24289]: cluster 2024-09-16T08:17:02.495196+0000 mgr.a (mgr.14373) 6918 : cluster [DBG] pgmap v4798: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:17:04.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:17:03 smithi086 bash[24289]: audit 2024-09-16T08:17:03.006027+0000 mgr.a (mgr.14373) 6919 : audit [DBG] from='client.157221 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:17:04.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:17:03 smithi047 bash[22744]: cluster 2024-09-16T08:17:02.495196+0000 mgr.a (mgr.14373) 6918 : cluster [DBG] pgmap v4798: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:17:04.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:17:03 smithi047 bash[22744]: audit 2024-09-16T08:17:03.006027+0000 mgr.a (mgr.14373) 6919 : audit [DBG] from='client.157221 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:17:06.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:17:05 smithi157 bash[24585]: cluster 2024-09-16T08:17:04.496079+0000 mgr.a (mgr.14373) 6920 : cluster [DBG] pgmap v4799: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:17:06.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:17:05 smithi086 bash[24289]: cluster 2024-09-16T08:17:04.496079+0000 mgr.a (mgr.14373) 6920 : cluster [DBG] pgmap v4799: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:17:06.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:17:05 smithi047 bash[22744]: cluster 2024-09-16T08:17:04.496079+0000 mgr.a (mgr.14373) 6920 : cluster [DBG] pgmap v4799: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:17:08.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:17:07 smithi157 bash[24585]: cluster 2024-09-16T08:17:06.498188+0000 mgr.a (mgr.14373) 6921 : cluster [DBG] pgmap v4800: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:17:08.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:17:07 smithi086 bash[24289]: cluster 2024-09-16T08:17:06.498188+0000 mgr.a (mgr.14373) 6921 : cluster [DBG] pgmap v4800: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:17:08.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:17:07 smithi047 bash[22744]: cluster 2024-09-16T08:17:06.498188+0000 mgr.a (mgr.14373) 6921 : cluster [DBG] pgmap v4800: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:17:08.448 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:17:08.449 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:17:08.449 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:17:09.232 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:17:09.232 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:17:09.232 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:17:09.232 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:17:09.232 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:17:10.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:17:09 smithi157 bash[24585]: cluster 2024-09-16T08:17:08.498722+0000 mgr.a (mgr.14373) 6922 : cluster [DBG] pgmap v4801: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:17:10.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:17:09 smithi157 bash[24585]: audit 2024-09-16T08:17:08.786600+0000 mgr.a (mgr.14373) 6923 : audit [DBG] from='client.157296 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:17:10.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:17:09 smithi086 bash[24289]: cluster 2024-09-16T08:17:08.498722+0000 mgr.a (mgr.14373) 6922 : cluster [DBG] pgmap v4801: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:17:10.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:17:09 smithi086 bash[24289]: audit 2024-09-16T08:17:08.786600+0000 mgr.a (mgr.14373) 6923 : audit [DBG] from='client.157296 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:17:10.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:17:09 smithi047 bash[22744]: cluster 2024-09-16T08:17:08.498722+0000 mgr.a (mgr.14373) 6922 : cluster [DBG] pgmap v4801: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:17:10.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:17:09 smithi047 bash[22744]: audit 2024-09-16T08:17:08.786600+0000 mgr.a (mgr.14373) 6923 : audit [DBG] from='client.157296 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:17:12.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:17:11 smithi157 bash[24585]: cluster 2024-09-16T08:17:10.499610+0000 mgr.a (mgr.14373) 6924 : cluster [DBG] pgmap v4802: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:17:12.066 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:17:11 smithi086 bash[24289]: cluster 2024-09-16T08:17:10.499610+0000 mgr.a (mgr.14373) 6924 : cluster [DBG] pgmap v4802: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:17:12.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:17:11 smithi047 bash[22744]: cluster 2024-09-16T08:17:10.499610+0000 mgr.a (mgr.14373) 6924 : cluster [DBG] pgmap v4802: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:17:14.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:17:13 smithi157 bash[24585]: cluster 2024-09-16T08:17:12.501849+0000 mgr.a (mgr.14373) 6925 : cluster [DBG] pgmap v4803: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:17:14.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:17:13 smithi086 bash[24289]: cluster 2024-09-16T08:17:12.501849+0000 mgr.a (mgr.14373) 6925 : cluster [DBG] pgmap v4803: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:17:14.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:17:13 smithi047 bash[22744]: cluster 2024-09-16T08:17:12.501849+0000 mgr.a (mgr.14373) 6925 : cluster [DBG] pgmap v4803: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:17:14.233 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:17:14.234 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:17:14.234 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:17:15.009 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:17:15.009 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:17:15.009 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:17:15.009 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:17:15.010 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:17:16.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:17:15 smithi157 bash[24585]: cluster 2024-09-16T08:17:14.502596+0000 mgr.a (mgr.14373) 6926 : cluster [DBG] pgmap v4804: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:17:16.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:17:15 smithi157 bash[24585]: audit 2024-09-16T08:17:14.576659+0000 mgr.a (mgr.14373) 6927 : audit [DBG] from='client.157371 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:17:16.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:17:15 smithi086 bash[24289]: cluster 2024-09-16T08:17:14.502596+0000 mgr.a (mgr.14373) 6926 : cluster [DBG] pgmap v4804: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:17:16.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:17:15 smithi086 bash[24289]: audit 2024-09-16T08:17:14.576659+0000 mgr.a (mgr.14373) 6927 : audit [DBG] from='client.157371 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:17:16.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:17:15 smithi047 bash[22744]: cluster 2024-09-16T08:17:14.502596+0000 mgr.a (mgr.14373) 6926 : cluster [DBG] pgmap v4804: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:17:16.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:17:15 smithi047 bash[22744]: audit 2024-09-16T08:17:14.576659+0000 mgr.a (mgr.14373) 6927 : audit [DBG] from='client.157371 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:17:17.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:17:16 smithi157 bash[24585]: audit 2024-09-16T08:17:16.160637+0000 mon.b (mon.2) 658 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T08:17:17.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:17:16 smithi086 bash[24289]: audit 2024-09-16T08:17:16.160637+0000 mon.b (mon.2) 658 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T08:17:17.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:17:16 smithi047 bash[22744]: audit 2024-09-16T08:17:16.160637+0000 mon.b (mon.2) 658 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T08:17:18.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:17:17 smithi157 bash[24585]: cluster 2024-09-16T08:17:16.504728+0000 mgr.a (mgr.14373) 6928 : cluster [DBG] pgmap v4805: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:17:18.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:17:17 smithi157 bash[24585]: audit 2024-09-16T08:17:16.977917+0000 mon.b (mon.2) 659 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T08:17:18.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:17:17 smithi157 bash[24585]: audit 2024-09-16T08:17:16.979889+0000 mon.b (mon.2) 660 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T08:17:18.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:17:17 smithi157 bash[24585]: audit 2024-09-16T08:17:16.990955+0000 mon.a (mon.0) 986 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:17:18.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:17:17 smithi157 bash[24585]: audit 2024-09-16T08:17:16.996650+0000 mon.b (mon.2) 661 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:17:18.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:17:17 smithi157 bash[24585]: audit 2024-09-16T08:17:17.000283+0000 mgr.a (mgr.14373) 6929 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:17:18.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:17:17 smithi086 bash[24289]: cluster 2024-09-16T08:17:16.504728+0000 mgr.a (mgr.14373) 6928 : cluster [DBG] pgmap v4805: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:17:18.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:17:17 smithi086 bash[24289]: audit 2024-09-16T08:17:16.977917+0000 mon.b (mon.2) 659 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T08:17:18.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:17:17 smithi086 bash[24289]: audit 2024-09-16T08:17:16.979889+0000 mon.b (mon.2) 660 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T08:17:18.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:17:17 smithi086 bash[24289]: audit 2024-09-16T08:17:16.990955+0000 mon.a (mon.0) 986 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:17:18.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:17:17 smithi086 bash[24289]: audit 2024-09-16T08:17:16.996650+0000 mon.b (mon.2) 661 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:17:18.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:17:17 smithi086 bash[24289]: audit 2024-09-16T08:17:17.000283+0000 mgr.a (mgr.14373) 6929 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:17:18.088 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 08:17:17 smithi047 bash[22994]: debug 2024-09-16T08:17:17.732+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T08:17:18.088 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 08:17:17 smithi047 bash[22994]: debug 2024-09-16T08:17:17.732+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T08:17:18.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:17:17 smithi047 bash[22744]: cluster 2024-09-16T08:17:16.504728+0000 mgr.a (mgr.14373) 6928 : cluster [DBG] pgmap v4805: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:17:18.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:17:17 smithi047 bash[22744]: audit 2024-09-16T08:17:16.977917+0000 mon.b (mon.2) 659 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T08:17:18.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:17:17 smithi047 bash[22744]: audit 2024-09-16T08:17:16.979889+0000 mon.b (mon.2) 660 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T08:17:18.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:17:17 smithi047 bash[22744]: audit 2024-09-16T08:17:16.990955+0000 mon.a (mon.0) 986 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:17:18.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:17:17 smithi047 bash[22744]: audit 2024-09-16T08:17:16.996650+0000 mon.b (mon.2) 661 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:17:18.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:17:17 smithi047 bash[22744]: audit 2024-09-16T08:17:17.000283+0000 mgr.a (mgr.14373) 6929 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:17:19.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:17:18 smithi157 bash[24585]: audit 2024-09-16T08:17:17.734483+0000 mgr.a (mgr.14373) 6930 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T08:17:19.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:17:18 smithi157 bash[24585]: cephadm 2024-09-16T08:17:17.736679+0000 mgr.a (mgr.14373) 6931 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T08:17:19.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:17:18 smithi086 bash[24289]: audit 2024-09-16T08:17:17.734483+0000 mgr.a (mgr.14373) 6930 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T08:17:19.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:17:18 smithi086 bash[24289]: cephadm 2024-09-16T08:17:17.736679+0000 mgr.a (mgr.14373) 6931 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T08:17:19.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:17:18 smithi047 bash[22744]: audit 2024-09-16T08:17:17.734483+0000 mgr.a (mgr.14373) 6930 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T08:17:19.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:17:18 smithi047 bash[22744]: cephadm 2024-09-16T08:17:17.736679+0000 mgr.a (mgr.14373) 6931 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T08:17:20.011 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:17:20.011 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:17:20.011 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:17:20.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:17:19 smithi157 bash[24585]: cluster 2024-09-16T08:17:18.505622+0000 mgr.a (mgr.14373) 6932 : cluster [DBG] pgmap v4806: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:17:20.066 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:17:19 smithi086 bash[24289]: cluster 2024-09-16T08:17:18.505622+0000 mgr.a (mgr.14373) 6932 : cluster [DBG] pgmap v4806: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:17:20.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:17:19 smithi047 bash[22744]: cluster 2024-09-16T08:17:18.505622+0000 mgr.a (mgr.14373) 6932 : cluster [DBG] pgmap v4806: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:17:20.769 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:17:20.769 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:17:20.769 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:17:20.770 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:17:20.770 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:17:21.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:17:20 smithi157 bash[24585]: audit 2024-09-16T08:17:20.340316+0000 mgr.a (mgr.14373) 6933 : audit [DBG] from='client.157551 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:17:21.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:17:20 smithi086 bash[24289]: audit 2024-09-16T08:17:20.340316+0000 mgr.a (mgr.14373) 6933 : audit [DBG] from='client.157551 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:17:21.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:17:20 smithi047 bash[22744]: audit 2024-09-16T08:17:20.340316+0000 mgr.a (mgr.14373) 6933 : audit [DBG] from='client.157551 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:17:22.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:17:21 smithi157 bash[24585]: cluster 2024-09-16T08:17:20.506358+0000 mgr.a (mgr.14373) 6934 : cluster [DBG] pgmap v4807: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:17:22.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:17:21 smithi086 bash[24289]: cluster 2024-09-16T08:17:20.506358+0000 mgr.a (mgr.14373) 6934 : cluster [DBG] pgmap v4807: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:17:22.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:17:21 smithi047 bash[22744]: cluster 2024-09-16T08:17:20.506358+0000 mgr.a (mgr.14373) 6934 : cluster [DBG] pgmap v4807: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:17:24.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:17:23 smithi157 bash[24585]: cluster 2024-09-16T08:17:22.508789+0000 mgr.a (mgr.14373) 6935 : cluster [DBG] pgmap v4808: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:17:24.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:17:23 smithi086 bash[24289]: cluster 2024-09-16T08:17:22.508789+0000 mgr.a (mgr.14373) 6935 : cluster [DBG] pgmap v4808: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:17:24.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:17:23 smithi047 bash[22744]: cluster 2024-09-16T08:17:22.508789+0000 mgr.a (mgr.14373) 6935 : cluster [DBG] pgmap v4808: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:17:25.771 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:17:25.772 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:17:25.772 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:17:26.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:17:25 smithi157 bash[24585]: cluster 2024-09-16T08:17:24.509721+0000 mgr.a (mgr.14373) 6936 : cluster [DBG] pgmap v4809: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:17:26.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:17:25 smithi086 bash[24289]: cluster 2024-09-16T08:17:24.509721+0000 mgr.a (mgr.14373) 6936 : cluster [DBG] pgmap v4809: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:17:26.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:17:25 smithi047 bash[22744]: cluster 2024-09-16T08:17:24.509721+0000 mgr.a (mgr.14373) 6936 : cluster [DBG] pgmap v4809: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:17:26.518 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:17:26.519 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:17:26.519 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:17:26.519 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:17:26.519 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:17:27.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:17:26 smithi157 bash[24585]: audit 2024-09-16T08:17:26.106780+0000 mgr.a (mgr.14373) 6937 : audit [DBG] from='client.157629 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:17:27.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:17:26 smithi086 bash[24289]: audit 2024-09-16T08:17:26.106780+0000 mgr.a (mgr.14373) 6937 : audit [DBG] from='client.157629 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:17:27.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:17:26 smithi047 bash[22744]: audit 2024-09-16T08:17:26.106780+0000 mgr.a (mgr.14373) 6937 : audit [DBG] from='client.157629 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:17:28.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:17:27 smithi157 bash[24585]: cluster 2024-09-16T08:17:26.510860+0000 mgr.a (mgr.14373) 6938 : cluster [DBG] pgmap v4810: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:17:28.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:17:27 smithi086 bash[24289]: cluster 2024-09-16T08:17:26.510860+0000 mgr.a (mgr.14373) 6938 : cluster [DBG] pgmap v4810: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:17:28.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:17:27 smithi047 bash[22744]: cluster 2024-09-16T08:17:26.510860+0000 mgr.a (mgr.14373) 6938 : cluster [DBG] pgmap v4810: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:17:30.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:17:29 smithi157 bash[24585]: cluster 2024-09-16T08:17:28.511766+0000 mgr.a (mgr.14373) 6939 : cluster [DBG] pgmap v4811: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T08:17:30.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:17:29 smithi086 bash[24289]: cluster 2024-09-16T08:17:28.511766+0000 mgr.a (mgr.14373) 6939 : cluster [DBG] pgmap v4811: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T08:17:30.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:17:29 smithi047 bash[22744]: cluster 2024-09-16T08:17:28.511766+0000 mgr.a (mgr.14373) 6939 : cluster [DBG] pgmap v4811: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T08:17:31.520 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:17:31.521 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:17:31.521 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:17:32.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:17:31 smithi157 bash[24585]: cluster 2024-09-16T08:17:30.512698+0000 mgr.a (mgr.14373) 6940 : cluster [DBG] pgmap v4812: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T08:17:32.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:17:31 smithi086 bash[24289]: cluster 2024-09-16T08:17:30.512698+0000 mgr.a (mgr.14373) 6940 : cluster [DBG] pgmap v4812: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T08:17:32.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:17:31 smithi047 bash[22744]: cluster 2024-09-16T08:17:30.512698+0000 mgr.a (mgr.14373) 6940 : cluster [DBG] pgmap v4812: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T08:17:32.291 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:17:32.292 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:17:32.292 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:17:32.292 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:17:32.292 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:17:33.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:17:32 smithi157 bash[24585]: audit 2024-09-16T08:17:31.861300+0000 mgr.a (mgr.14373) 6941 : audit [DBG] from='client.157704 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:17:33.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:17:32 smithi086 bash[24289]: audit 2024-09-16T08:17:31.861300+0000 mgr.a (mgr.14373) 6941 : audit [DBG] from='client.157704 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:17:33.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:17:32 smithi047 bash[22744]: audit 2024-09-16T08:17:31.861300+0000 mgr.a (mgr.14373) 6941 : audit [DBG] from='client.157704 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:17:34.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:17:33 smithi157 bash[24585]: cluster 2024-09-16T08:17:32.515552+0000 mgr.a (mgr.14373) 6942 : cluster [DBG] pgmap v4813: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:17:34.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:17:33 smithi086 bash[24289]: cluster 2024-09-16T08:17:32.515552+0000 mgr.a (mgr.14373) 6942 : cluster [DBG] pgmap v4813: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:17:34.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:17:33 smithi047 bash[22744]: cluster 2024-09-16T08:17:32.515552+0000 mgr.a (mgr.14373) 6942 : cluster [DBG] pgmap v4813: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:17:36.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:17:35 smithi157 bash[24585]: cluster 2024-09-16T08:17:34.516505+0000 mgr.a (mgr.14373) 6943 : cluster [DBG] pgmap v4814: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:17:36.066 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:17:35 smithi086 bash[24289]: cluster 2024-09-16T08:17:34.516505+0000 mgr.a (mgr.14373) 6943 : cluster [DBG] pgmap v4814: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:17:36.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:17:35 smithi047 bash[22744]: cluster 2024-09-16T08:17:34.516505+0000 mgr.a (mgr.14373) 6943 : cluster [DBG] pgmap v4814: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:17:37.293 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:17:37.294 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:17:37.294 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:17:38.044 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:17:38.044 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:17:38.044 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:17:38.045 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:17:38.045 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:17:38.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:17:37 smithi157 bash[24585]: cluster 2024-09-16T08:17:36.518630+0000 mgr.a (mgr.14373) 6944 : cluster [DBG] pgmap v4815: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:17:38.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:17:37 smithi086 bash[24289]: cluster 2024-09-16T08:17:36.518630+0000 mgr.a (mgr.14373) 6944 : cluster [DBG] pgmap v4815: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:17:38.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:17:37 smithi047 bash[22744]: cluster 2024-09-16T08:17:36.518630+0000 mgr.a (mgr.14373) 6944 : cluster [DBG] pgmap v4815: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:17:39.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:17:38 smithi157 bash[24585]: audit 2024-09-16T08:17:37.628439+0000 mgr.a (mgr.14373) 6945 : audit [DBG] from='client.157776 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:17:39.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:17:38 smithi086 bash[24289]: audit 2024-09-16T08:17:37.628439+0000 mgr.a (mgr.14373) 6945 : audit [DBG] from='client.157776 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:17:39.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:17:38 smithi047 bash[22744]: audit 2024-09-16T08:17:37.628439+0000 mgr.a (mgr.14373) 6945 : audit [DBG] from='client.157776 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:17:40.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:17:39 smithi157 bash[24585]: cluster 2024-09-16T08:17:38.519544+0000 mgr.a (mgr.14373) 6946 : cluster [DBG] pgmap v4816: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-16T08:17:40.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:17:39 smithi086 bash[24289]: cluster 2024-09-16T08:17:38.519544+0000 mgr.a (mgr.14373) 6946 : cluster [DBG] pgmap v4816: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-16T08:17:40.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:17:39 smithi047 bash[22744]: cluster 2024-09-16T08:17:38.519544+0000 mgr.a (mgr.14373) 6946 : cluster [DBG] pgmap v4816: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-16T08:17:42.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:17:41 smithi157 bash[24585]: cluster 2024-09-16T08:17:40.520322+0000 mgr.a (mgr.14373) 6947 : cluster [DBG] pgmap v4817: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-16T08:17:42.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:17:41 smithi086 bash[24289]: cluster 2024-09-16T08:17:40.520322+0000 mgr.a (mgr.14373) 6947 : cluster [DBG] pgmap v4817: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-16T08:17:42.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:17:41 smithi047 bash[22744]: cluster 2024-09-16T08:17:40.520322+0000 mgr.a (mgr.14373) 6947 : cluster [DBG] pgmap v4817: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-16T08:17:43.046 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:17:43.047 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:17:43.047 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:17:43.824 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:17:43.825 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:17:43.825 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:17:43.825 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:17:43.825 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:17:44.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:17:43 smithi157 bash[24585]: cluster 2024-09-16T08:17:42.522676+0000 mgr.a (mgr.14373) 6948 : cluster [DBG] pgmap v4818: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-16T08:17:44.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:17:43 smithi157 bash[24585]: audit 2024-09-16T08:17:43.386489+0000 mgr.a (mgr.14373) 6949 : audit [DBG] from='client.157854 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:17:44.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:17:43 smithi086 bash[24289]: cluster 2024-09-16T08:17:42.522676+0000 mgr.a (mgr.14373) 6948 : cluster [DBG] pgmap v4818: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-16T08:17:44.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:17:43 smithi086 bash[24289]: audit 2024-09-16T08:17:43.386489+0000 mgr.a (mgr.14373) 6949 : audit [DBG] from='client.157854 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:17:44.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:17:43 smithi047 bash[22744]: cluster 2024-09-16T08:17:42.522676+0000 mgr.a (mgr.14373) 6948 : cluster [DBG] pgmap v4818: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-16T08:17:44.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:17:43 smithi047 bash[22744]: audit 2024-09-16T08:17:43.386489+0000 mgr.a (mgr.14373) 6949 : audit [DBG] from='client.157854 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:17:46.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:17:45 smithi157 bash[24585]: cluster 2024-09-16T08:17:44.523615+0000 mgr.a (mgr.14373) 6950 : cluster [DBG] pgmap v4819: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:17:46.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:17:45 smithi086 bash[24289]: cluster 2024-09-16T08:17:44.523615+0000 mgr.a (mgr.14373) 6950 : cluster [DBG] pgmap v4819: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:17:46.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:17:45 smithi047 bash[22744]: cluster 2024-09-16T08:17:44.523615+0000 mgr.a (mgr.14373) 6950 : cluster [DBG] pgmap v4819: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:17:48.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:17:47 smithi157 bash[24585]: cluster 2024-09-16T08:17:46.525762+0000 mgr.a (mgr.14373) 6951 : cluster [DBG] pgmap v4820: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:17:48.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:17:47 smithi086 bash[24289]: cluster 2024-09-16T08:17:46.525762+0000 mgr.a (mgr.14373) 6951 : cluster [DBG] pgmap v4820: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:17:48.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:17:47 smithi047 bash[22744]: cluster 2024-09-16T08:17:46.525762+0000 mgr.a (mgr.14373) 6951 : cluster [DBG] pgmap v4820: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:17:48.824 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:17:48.825 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:17:48.825 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:17:49.576 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:17:49.576 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:17:49.576 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:17:49.576 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:17:49.577 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:17:50.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:17:49 smithi157 bash[24585]: cluster 2024-09-16T08:17:48.526571+0000 mgr.a (mgr.14373) 6952 : cluster [DBG] pgmap v4821: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:17:50.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:17:49 smithi157 bash[24585]: audit 2024-09-16T08:17:49.158354+0000 mgr.a (mgr.14373) 6953 : audit [DBG] from='client.157932 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:17:50.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:17:49 smithi086 bash[24289]: cluster 2024-09-16T08:17:48.526571+0000 mgr.a (mgr.14373) 6952 : cluster [DBG] pgmap v4821: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:17:50.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:17:49 smithi086 bash[24289]: audit 2024-09-16T08:17:49.158354+0000 mgr.a (mgr.14373) 6953 : audit [DBG] from='client.157932 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:17:50.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:17:49 smithi047 bash[22744]: cluster 2024-09-16T08:17:48.526571+0000 mgr.a (mgr.14373) 6952 : cluster [DBG] pgmap v4821: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:17:50.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:17:49 smithi047 bash[22744]: audit 2024-09-16T08:17:49.158354+0000 mgr.a (mgr.14373) 6953 : audit [DBG] from='client.157932 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:17:52.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:17:51 smithi157 bash[24585]: cluster 2024-09-16T08:17:50.527639+0000 mgr.a (mgr.14373) 6954 : cluster [DBG] pgmap v4822: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:17:52.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:17:51 smithi086 bash[24289]: cluster 2024-09-16T08:17:50.527639+0000 mgr.a (mgr.14373) 6954 : cluster [DBG] pgmap v4822: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:17:52.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:17:51 smithi047 bash[22744]: cluster 2024-09-16T08:17:50.527639+0000 mgr.a (mgr.14373) 6954 : cluster [DBG] pgmap v4822: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:17:54.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:17:53 smithi157 bash[24585]: cluster 2024-09-16T08:17:52.530015+0000 mgr.a (mgr.14373) 6955 : cluster [DBG] pgmap v4823: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:17:54.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:17:53 smithi086 bash[24289]: cluster 2024-09-16T08:17:52.530015+0000 mgr.a (mgr.14373) 6955 : cluster [DBG] pgmap v4823: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:17:54.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:17:53 smithi047 bash[22744]: cluster 2024-09-16T08:17:52.530015+0000 mgr.a (mgr.14373) 6955 : cluster [DBG] pgmap v4823: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:17:54.578 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:17:54.578 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:17:54.578 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:17:55.332 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:17:55.332 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:17:55.332 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:17:55.332 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:17:55.332 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:17:56.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:17:55 smithi157 bash[24585]: cluster 2024-09-16T08:17:54.530976+0000 mgr.a (mgr.14373) 6956 : cluster [DBG] pgmap v4824: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:17:56.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:17:55 smithi157 bash[24585]: audit 2024-09-16T08:17:54.919175+0000 mgr.a (mgr.14373) 6957 : audit [DBG] from='client.158010 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:17:56.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:17:55 smithi086 bash[24289]: cluster 2024-09-16T08:17:54.530976+0000 mgr.a (mgr.14373) 6956 : cluster [DBG] pgmap v4824: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:17:56.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:17:55 smithi086 bash[24289]: audit 2024-09-16T08:17:54.919175+0000 mgr.a (mgr.14373) 6957 : audit [DBG] from='client.158010 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:17:56.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:17:55 smithi047 bash[22744]: cluster 2024-09-16T08:17:54.530976+0000 mgr.a (mgr.14373) 6956 : cluster [DBG] pgmap v4824: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:17:56.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:17:55 smithi047 bash[22744]: audit 2024-09-16T08:17:54.919175+0000 mgr.a (mgr.14373) 6957 : audit [DBG] from='client.158010 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:17:58.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:17:57 smithi157 bash[24585]: cluster 2024-09-16T08:17:56.533248+0000 mgr.a (mgr.14373) 6958 : cluster [DBG] pgmap v4825: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:17:58.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:17:57 smithi086 bash[24289]: cluster 2024-09-16T08:17:56.533248+0000 mgr.a (mgr.14373) 6958 : cluster [DBG] pgmap v4825: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:17:58.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:17:57 smithi047 bash[22744]: cluster 2024-09-16T08:17:56.533248+0000 mgr.a (mgr.14373) 6958 : cluster [DBG] pgmap v4825: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:18:00.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:17:59 smithi157 bash[24585]: cluster 2024-09-16T08:17:58.534012+0000 mgr.a (mgr.14373) 6959 : cluster [DBG] pgmap v4826: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:18:00.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:17:59 smithi086 bash[24289]: cluster 2024-09-16T08:17:58.534012+0000 mgr.a (mgr.14373) 6959 : cluster [DBG] pgmap v4826: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:18:00.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:17:59 smithi047 bash[22744]: cluster 2024-09-16T08:17:58.534012+0000 mgr.a (mgr.14373) 6959 : cluster [DBG] pgmap v4826: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:18:00.333 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:18:00.333 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:18:00.334 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:18:01.112 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:18:01.112 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:18:01.112 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:18:01.112 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:18:01.112 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:18:02.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:18:01 smithi157 bash[24585]: cluster 2024-09-16T08:18:00.534442+0000 mgr.a (mgr.14373) 6960 : cluster [DBG] pgmap v4827: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:18:02.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:18:01 smithi157 bash[24585]: audit 2024-09-16T08:18:00.671898+0000 mgr.a (mgr.14373) 6961 : audit [DBG] from='client.158085 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:18:02.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:18:01 smithi086 bash[24289]: cluster 2024-09-16T08:18:00.534442+0000 mgr.a (mgr.14373) 6960 : cluster [DBG] pgmap v4827: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:18:02.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:18:01 smithi086 bash[24289]: audit 2024-09-16T08:18:00.671898+0000 mgr.a (mgr.14373) 6961 : audit [DBG] from='client.158085 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:18:02.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:18:01 smithi047 bash[22744]: cluster 2024-09-16T08:18:00.534442+0000 mgr.a (mgr.14373) 6960 : cluster [DBG] pgmap v4827: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:18:02.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:18:01 smithi047 bash[22744]: audit 2024-09-16T08:18:00.671898+0000 mgr.a (mgr.14373) 6961 : audit [DBG] from='client.158085 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:18:04.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:18:03 smithi157 bash[24585]: cluster 2024-09-16T08:18:02.536735+0000 mgr.a (mgr.14373) 6962 : cluster [DBG] pgmap v4828: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:18:04.066 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:18:03 smithi086 bash[24289]: cluster 2024-09-16T08:18:02.536735+0000 mgr.a (mgr.14373) 6962 : cluster [DBG] pgmap v4828: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:18:04.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:18:03 smithi047 bash[22744]: cluster 2024-09-16T08:18:02.536735+0000 mgr.a (mgr.14373) 6962 : cluster [DBG] pgmap v4828: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:18:06.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:18:05 smithi157 bash[24585]: cluster 2024-09-16T08:18:04.537471+0000 mgr.a (mgr.14373) 6963 : cluster [DBG] pgmap v4829: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:18:06.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:18:05 smithi086 bash[24289]: cluster 2024-09-16T08:18:04.537471+0000 mgr.a (mgr.14373) 6963 : cluster [DBG] pgmap v4829: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:18:06.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:18:05 smithi047 bash[22744]: cluster 2024-09-16T08:18:04.537471+0000 mgr.a (mgr.14373) 6963 : cluster [DBG] pgmap v4829: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:18:06.113 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:18:06.114 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:18:06.114 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:18:06.895 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:18:06.895 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:18:06.895 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:18:06.895 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:18:06.895 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:18:07.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:18:06 smithi086 bash[24289]: audit 2024-09-16T08:18:06.457028+0000 mgr.a (mgr.14373) 6964 : audit [DBG] from='client.158163 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:18:07.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:18:06 smithi047 bash[22744]: audit 2024-09-16T08:18:06.457028+0000 mgr.a (mgr.14373) 6964 : audit [DBG] from='client.158163 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:18:07.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:18:06 smithi157 bash[24585]: audit 2024-09-16T08:18:06.457028+0000 mgr.a (mgr.14373) 6964 : audit [DBG] from='client.158163 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:18:08.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:18:07 smithi086 bash[24289]: cluster 2024-09-16T08:18:06.538869+0000 mgr.a (mgr.14373) 6965 : cluster [DBG] pgmap v4830: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-16T08:18:08.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:18:07 smithi047 bash[22744]: cluster 2024-09-16T08:18:06.538869+0000 mgr.a (mgr.14373) 6965 : cluster [DBG] pgmap v4830: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-16T08:18:08.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:18:07 smithi157 bash[24585]: cluster 2024-09-16T08:18:06.538869+0000 mgr.a (mgr.14373) 6965 : cluster [DBG] pgmap v4830: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-16T08:18:10.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:18:09 smithi086 bash[24289]: cluster 2024-09-16T08:18:08.539753+0000 mgr.a (mgr.14373) 6966 : cluster [DBG] pgmap v4831: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 4.9 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-16T08:18:10.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:18:09 smithi047 bash[22744]: cluster 2024-09-16T08:18:08.539753+0000 mgr.a (mgr.14373) 6966 : cluster [DBG] pgmap v4831: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 4.9 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-16T08:18:10.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:18:09 smithi157 bash[24585]: cluster 2024-09-16T08:18:08.539753+0000 mgr.a (mgr.14373) 6966 : cluster [DBG] pgmap v4831: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 4.9 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-16T08:18:11.896 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:18:11.897 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:18:11.897 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:18:12.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:18:11 smithi086 bash[24289]: cluster 2024-09-16T08:18:10.540514+0000 mgr.a (mgr.14373) 6967 : cluster [DBG] pgmap v4832: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 4.9 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-16T08:18:12.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:18:11 smithi047 bash[22744]: cluster 2024-09-16T08:18:10.540514+0000 mgr.a (mgr.14373) 6967 : cluster [DBG] pgmap v4832: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 4.9 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-16T08:18:12.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:18:11 smithi157 bash[24585]: cluster 2024-09-16T08:18:10.540514+0000 mgr.a (mgr.14373) 6967 : cluster [DBG] pgmap v4832: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 4.9 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-16T08:18:12.641 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:18:12.641 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:18:12.641 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:18:12.641 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:18:12.641 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:18:13.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:18:12 smithi047 bash[22744]: audit 2024-09-16T08:18:12.226298+0000 mgr.a (mgr.14373) 6968 : audit [DBG] from='client.158238 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:18:13.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:18:12 smithi157 bash[24585]: audit 2024-09-16T08:18:12.226298+0000 mgr.a (mgr.14373) 6968 : audit [DBG] from='client.158238 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:18:13.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:18:12 smithi086 bash[24289]: audit 2024-09-16T08:18:12.226298+0000 mgr.a (mgr.14373) 6968 : audit [DBG] from='client.158238 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:18:14.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:18:13 smithi047 bash[22744]: cluster 2024-09-16T08:18:12.549272+0000 mgr.a (mgr.14373) 6969 : cluster [DBG] pgmap v4833: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-16T08:18:14.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:18:13 smithi157 bash[24585]: cluster 2024-09-16T08:18:12.549272+0000 mgr.a (mgr.14373) 6969 : cluster [DBG] pgmap v4833: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-16T08:18:14.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:18:13 smithi086 bash[24289]: cluster 2024-09-16T08:18:12.549272+0000 mgr.a (mgr.14373) 6969 : cluster [DBG] pgmap v4833: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-16T08:18:16.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:18:15 smithi047 bash[22744]: cluster 2024-09-16T08:18:14.550027+0000 mgr.a (mgr.14373) 6970 : cluster [DBG] pgmap v4834: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 4.9 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-16T08:18:16.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:18:15 smithi157 bash[24585]: cluster 2024-09-16T08:18:14.550027+0000 mgr.a (mgr.14373) 6970 : cluster [DBG] pgmap v4834: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 4.9 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-16T08:18:16.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:18:15 smithi086 bash[24289]: cluster 2024-09-16T08:18:14.550027+0000 mgr.a (mgr.14373) 6970 : cluster [DBG] pgmap v4834: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 4.9 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-16T08:18:17.642 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:18:17.643 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:18:17.643 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:18:18.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:18:17 smithi047 bash[22744]: cluster 2024-09-16T08:18:16.552008+0000 mgr.a (mgr.14373) 6971 : cluster [DBG] pgmap v4835: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 69 KiB/s rd, 0 B/s wr, 114 op/s 2024-09-16T08:18:18.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:18:17 smithi047 bash[22744]: audit 2024-09-16T08:18:17.788262+0000 mon.b (mon.2) 662 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T08:18:18.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:18:17 smithi157 bash[24585]: cluster 2024-09-16T08:18:16.552008+0000 mgr.a (mgr.14373) 6971 : cluster [DBG] pgmap v4835: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 69 KiB/s rd, 0 B/s wr, 114 op/s 2024-09-16T08:18:18.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:18:17 smithi157 bash[24585]: audit 2024-09-16T08:18:17.788262+0000 mon.b (mon.2) 662 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T08:18:18.316 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:18:17 smithi086 bash[24289]: cluster 2024-09-16T08:18:16.552008+0000 mgr.a (mgr.14373) 6971 : cluster [DBG] pgmap v4835: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 69 KiB/s rd, 0 B/s wr, 114 op/s 2024-09-16T08:18:18.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:18:17 smithi086 bash[24289]: audit 2024-09-16T08:18:17.788262+0000 mon.b (mon.2) 662 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T08:18:18.458 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:18:18.458 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:18:18.458 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:18:18.458 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:18:18.458 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:18:19.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:18:18 smithi047 bash[22744]: audit 2024-09-16T08:18:17.984203+0000 mgr.a (mgr.14373) 6972 : audit [DBG] from='client.158313 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:18:19.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:18:18 smithi047 bash[22744]: audit 2024-09-16T08:18:18.615986+0000 mon.b (mon.2) 663 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T08:18:19.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:18:18 smithi047 bash[22744]: audit 2024-09-16T08:18:18.618490+0000 mon.b (mon.2) 664 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T08:18:19.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:18:18 smithi047 bash[22744]: audit 2024-09-16T08:18:18.629162+0000 mon.a (mon.0) 987 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:18:19.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:18:18 smithi047 bash[22744]: audit 2024-09-16T08:18:18.635512+0000 mon.b (mon.2) 665 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:18:19.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:18:18 smithi157 bash[24585]: audit 2024-09-16T08:18:17.984203+0000 mgr.a (mgr.14373) 6972 : audit [DBG] from='client.158313 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:18:19.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:18:18 smithi157 bash[24585]: audit 2024-09-16T08:18:18.615986+0000 mon.b (mon.2) 663 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T08:18:19.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:18:18 smithi157 bash[24585]: audit 2024-09-16T08:18:18.618490+0000 mon.b (mon.2) 664 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T08:18:19.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:18:18 smithi157 bash[24585]: audit 2024-09-16T08:18:18.629162+0000 mon.a (mon.0) 987 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:18:19.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:18:18 smithi157 bash[24585]: audit 2024-09-16T08:18:18.635512+0000 mon.b (mon.2) 665 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:18:19.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:18:18 smithi086 bash[24289]: audit 2024-09-16T08:18:17.984203+0000 mgr.a (mgr.14373) 6972 : audit [DBG] from='client.158313 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:18:19.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:18:18 smithi086 bash[24289]: audit 2024-09-16T08:18:18.615986+0000 mon.b (mon.2) 663 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T08:18:19.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:18:18 smithi086 bash[24289]: audit 2024-09-16T08:18:18.618490+0000 mon.b (mon.2) 664 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T08:18:19.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:18:18 smithi086 bash[24289]: audit 2024-09-16T08:18:18.629162+0000 mon.a (mon.0) 987 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:18:19.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:18:18 smithi086 bash[24289]: audit 2024-09-16T08:18:18.635512+0000 mon.b (mon.2) 665 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:18:19.838 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 08:18:19 smithi047 bash[22994]: debug 2024-09-16T08:18:19.351+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T08:18:19.838 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 08:18:19 smithi047 bash[22994]: debug 2024-09-16T08:18:19.351+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T08:18:20.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:18:19 smithi157 bash[24585]: cluster 2024-09-16T08:18:18.552600+0000 mgr.a (mgr.14373) 6973 : cluster [DBG] pgmap v4836: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 65 KiB/s rd, 0 B/s wr, 107 op/s 2024-09-16T08:18:20.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:18:19 smithi157 bash[24585]: audit 2024-09-16T08:18:18.639219+0000 mgr.a (mgr.14373) 6974 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:18:20.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:18:19 smithi157 bash[24585]: audit 2024-09-16T08:18:19.355636+0000 mgr.a (mgr.14373) 6975 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T08:18:20.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:18:19 smithi157 bash[24585]: cephadm 2024-09-16T08:18:19.357542+0000 mgr.a (mgr.14373) 6976 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T08:18:20.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:18:19 smithi086 bash[24289]: cluster 2024-09-16T08:18:18.552600+0000 mgr.a (mgr.14373) 6973 : cluster [DBG] pgmap v4836: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 65 KiB/s rd, 0 B/s wr, 107 op/s 2024-09-16T08:18:20.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:18:19 smithi086 bash[24289]: audit 2024-09-16T08:18:18.639219+0000 mgr.a (mgr.14373) 6974 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:18:20.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:18:19 smithi086 bash[24289]: audit 2024-09-16T08:18:19.355636+0000 mgr.a (mgr.14373) 6975 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T08:18:20.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:18:19 smithi086 bash[24289]: cephadm 2024-09-16T08:18:19.357542+0000 mgr.a (mgr.14373) 6976 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T08:18:20.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:18:19 smithi047 bash[22744]: cluster 2024-09-16T08:18:18.552600+0000 mgr.a (mgr.14373) 6973 : cluster [DBG] pgmap v4836: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 65 KiB/s rd, 0 B/s wr, 107 op/s 2024-09-16T08:18:20.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:18:19 smithi047 bash[22744]: audit 2024-09-16T08:18:18.639219+0000 mgr.a (mgr.14373) 6974 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:18:20.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:18:19 smithi047 bash[22744]: audit 2024-09-16T08:18:19.355636+0000 mgr.a (mgr.14373) 6975 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T08:18:20.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:18:19 smithi047 bash[22744]: cephadm 2024-09-16T08:18:19.357542+0000 mgr.a (mgr.14373) 6976 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T08:18:22.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:18:21 smithi157 bash[24585]: cluster 2024-09-16T08:18:20.553457+0000 mgr.a (mgr.14373) 6977 : cluster [DBG] pgmap v4837: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 65 KiB/s rd, 0 B/s wr, 107 op/s 2024-09-16T08:18:22.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:18:21 smithi086 bash[24289]: cluster 2024-09-16T08:18:20.553457+0000 mgr.a (mgr.14373) 6977 : cluster [DBG] pgmap v4837: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 65 KiB/s rd, 0 B/s wr, 107 op/s 2024-09-16T08:18:22.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:18:21 smithi047 bash[22744]: cluster 2024-09-16T08:18:20.553457+0000 mgr.a (mgr.14373) 6977 : cluster [DBG] pgmap v4837: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 65 KiB/s rd, 0 B/s wr, 107 op/s 2024-09-16T08:18:23.460 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:18:23.460 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:18:23.461 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:18:24.246 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:18:24.246 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:18:24.246 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:18:24.246 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:18:24.246 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:18:24.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:18:23 smithi157 bash[24585]: cluster 2024-09-16T08:18:22.555704+0000 mgr.a (mgr.14373) 6978 : cluster [DBG] pgmap v4838: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 71 KiB/s rd, 426 B/s wr, 113 op/s 2024-09-16T08:18:24.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:18:23 smithi086 bash[24289]: cluster 2024-09-16T08:18:22.555704+0000 mgr.a (mgr.14373) 6978 : cluster [DBG] pgmap v4838: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 71 KiB/s rd, 426 B/s wr, 113 op/s 2024-09-16T08:18:24.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:18:23 smithi047 bash[22744]: cluster 2024-09-16T08:18:22.555704+0000 mgr.a (mgr.14373) 6978 : cluster [DBG] pgmap v4838: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 71 KiB/s rd, 426 B/s wr, 113 op/s 2024-09-16T08:18:25.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:18:24 smithi157 bash[24585]: audit 2024-09-16T08:18:23.801005+0000 mgr.a (mgr.14373) 6979 : audit [DBG] from='client.158490 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:18:25.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:18:24 smithi086 bash[24289]: audit 2024-09-16T08:18:23.801005+0000 mgr.a (mgr.14373) 6979 : audit [DBG] from='client.158490 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:18:25.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:18:24 smithi047 bash[22744]: audit 2024-09-16T08:18:23.801005+0000 mgr.a (mgr.14373) 6979 : audit [DBG] from='client.158490 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:18:26.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:18:25 smithi157 bash[24585]: cluster 2024-09-16T08:18:24.556602+0000 mgr.a (mgr.14373) 6980 : cluster [DBG] pgmap v4839: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 70 KiB/s rd, 426 B/s wr, 112 op/s 2024-09-16T08:18:26.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:18:25 smithi086 bash[24289]: cluster 2024-09-16T08:18:24.556602+0000 mgr.a (mgr.14373) 6980 : cluster [DBG] pgmap v4839: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 70 KiB/s rd, 426 B/s wr, 112 op/s 2024-09-16T08:18:26.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:18:25 smithi047 bash[22744]: cluster 2024-09-16T08:18:24.556602+0000 mgr.a (mgr.14373) 6980 : cluster [DBG] pgmap v4839: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 70 KiB/s rd, 426 B/s wr, 112 op/s 2024-09-16T08:18:28.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:18:27 smithi157 bash[24585]: cluster 2024-09-16T08:18:26.558817+0000 mgr.a (mgr.14373) 6981 : cluster [DBG] pgmap v4840: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 71 KiB/s rd, 426 B/s wr, 113 op/s 2024-09-16T08:18:28.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:18:27 smithi086 bash[24289]: cluster 2024-09-16T08:18:26.558817+0000 mgr.a (mgr.14373) 6981 : cluster [DBG] pgmap v4840: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 71 KiB/s rd, 426 B/s wr, 113 op/s 2024-09-16T08:18:28.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:18:27 smithi047 bash[22744]: cluster 2024-09-16T08:18:26.558817+0000 mgr.a (mgr.14373) 6981 : cluster [DBG] pgmap v4840: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 71 KiB/s rd, 426 B/s wr, 113 op/s 2024-09-16T08:18:29.247 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:18:29.248 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:18:29.248 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:18:30.022 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:18:30.022 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:18:30.023 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:18:30.023 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:18:30.023 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:18:30.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:18:29 smithi157 bash[24585]: cluster 2024-09-16T08:18:28.559585+0000 mgr.a (mgr.14373) 6982 : cluster [DBG] pgmap v4841: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:18:30.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:18:29 smithi086 bash[24289]: cluster 2024-09-16T08:18:28.559585+0000 mgr.a (mgr.14373) 6982 : cluster [DBG] pgmap v4841: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:18:30.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:18:29 smithi047 bash[22744]: cluster 2024-09-16T08:18:28.559585+0000 mgr.a (mgr.14373) 6982 : cluster [DBG] pgmap v4841: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:18:31.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:18:30 smithi157 bash[24585]: audit 2024-09-16T08:18:29.583982+0000 mgr.a (mgr.14373) 6983 : audit [DBG] from='client.158568 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:18:31.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:18:30 smithi086 bash[24289]: audit 2024-09-16T08:18:29.583982+0000 mgr.a (mgr.14373) 6983 : audit [DBG] from='client.158568 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:18:31.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:18:30 smithi047 bash[22744]: audit 2024-09-16T08:18:29.583982+0000 mgr.a (mgr.14373) 6983 : audit [DBG] from='client.158568 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:18:32.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:18:31 smithi157 bash[24585]: cluster 2024-09-16T08:18:30.560576+0000 mgr.a (mgr.14373) 6984 : cluster [DBG] pgmap v4842: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:18:32.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:18:31 smithi086 bash[24289]: cluster 2024-09-16T08:18:30.560576+0000 mgr.a (mgr.14373) 6984 : cluster [DBG] pgmap v4842: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:18:32.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:18:31 smithi047 bash[22744]: cluster 2024-09-16T08:18:30.560576+0000 mgr.a (mgr.14373) 6984 : cluster [DBG] pgmap v4842: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:18:34.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:18:33 smithi157 bash[24585]: cluster 2024-09-16T08:18:32.562833+0000 mgr.a (mgr.14373) 6985 : cluster [DBG] pgmap v4843: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:18:34.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:18:33 smithi086 bash[24289]: cluster 2024-09-16T08:18:32.562833+0000 mgr.a (mgr.14373) 6985 : cluster [DBG] pgmap v4843: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:18:34.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:18:33 smithi047 bash[22744]: cluster 2024-09-16T08:18:32.562833+0000 mgr.a (mgr.14373) 6985 : cluster [DBG] pgmap v4843: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:18:35.024 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:18:35.025 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:18:35.025 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:18:35.770 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:18:35.770 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:18:35.770 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:18:35.771 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:18:35.771 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:18:36.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:18:35 smithi157 bash[24585]: cluster 2024-09-16T08:18:34.563624+0000 mgr.a (mgr.14373) 6986 : cluster [DBG] pgmap v4844: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:18:36.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:18:35 smithi157 bash[24585]: audit 2024-09-16T08:18:35.361560+0000 mgr.a (mgr.14373) 6987 : audit [DBG] from='client.158643 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:18:36.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:18:35 smithi086 bash[24289]: cluster 2024-09-16T08:18:34.563624+0000 mgr.a (mgr.14373) 6986 : cluster [DBG] pgmap v4844: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:18:36.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:18:35 smithi086 bash[24289]: audit 2024-09-16T08:18:35.361560+0000 mgr.a (mgr.14373) 6987 : audit [DBG] from='client.158643 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:18:36.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:18:35 smithi047 bash[22744]: cluster 2024-09-16T08:18:34.563624+0000 mgr.a (mgr.14373) 6986 : cluster [DBG] pgmap v4844: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:18:36.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:18:35 smithi047 bash[22744]: audit 2024-09-16T08:18:35.361560+0000 mgr.a (mgr.14373) 6987 : audit [DBG] from='client.158643 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:18:38.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:18:37 smithi157 bash[24585]: cluster 2024-09-16T08:18:36.565992+0000 mgr.a (mgr.14373) 6988 : cluster [DBG] pgmap v4845: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:18:38.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:18:37 smithi086 bash[24289]: cluster 2024-09-16T08:18:36.565992+0000 mgr.a (mgr.14373) 6988 : cluster [DBG] pgmap v4845: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:18:38.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:18:37 smithi047 bash[22744]: cluster 2024-09-16T08:18:36.565992+0000 mgr.a (mgr.14373) 6988 : cluster [DBG] pgmap v4845: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:18:40.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:18:39 smithi157 bash[24585]: cluster 2024-09-16T08:18:38.566806+0000 mgr.a (mgr.14373) 6989 : cluster [DBG] pgmap v4846: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:18:40.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:18:39 smithi086 bash[24289]: cluster 2024-09-16T08:18:38.566806+0000 mgr.a (mgr.14373) 6989 : cluster [DBG] pgmap v4846: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:18:40.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:18:39 smithi047 bash[22744]: cluster 2024-09-16T08:18:38.566806+0000 mgr.a (mgr.14373) 6989 : cluster [DBG] pgmap v4846: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:18:40.771 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:18:40.772 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:18:40.773 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:18:41.545 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:18:41.546 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:18:41.546 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:18:41.546 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:18:41.546 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:18:42.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:18:41 smithi157 bash[24585]: cluster 2024-09-16T08:18:40.567570+0000 mgr.a (mgr.14373) 6990 : cluster [DBG] pgmap v4847: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:18:42.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:18:41 smithi157 bash[24585]: audit 2024-09-16T08:18:41.115253+0000 mgr.a (mgr.14373) 6991 : audit [DBG] from='client.158721 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:18:42.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:18:41 smithi086 bash[24289]: cluster 2024-09-16T08:18:40.567570+0000 mgr.a (mgr.14373) 6990 : cluster [DBG] pgmap v4847: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:18:42.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:18:41 smithi086 bash[24289]: audit 2024-09-16T08:18:41.115253+0000 mgr.a (mgr.14373) 6991 : audit [DBG] from='client.158721 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:18:42.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:18:41 smithi047 bash[22744]: cluster 2024-09-16T08:18:40.567570+0000 mgr.a (mgr.14373) 6990 : cluster [DBG] pgmap v4847: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:18:42.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:18:41 smithi047 bash[22744]: audit 2024-09-16T08:18:41.115253+0000 mgr.a (mgr.14373) 6991 : audit [DBG] from='client.158721 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:18:44.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:18:43 smithi157 bash[24585]: cluster 2024-09-16T08:18:42.570020+0000 mgr.a (mgr.14373) 6992 : cluster [DBG] pgmap v4848: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-16T08:18:44.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:18:43 smithi086 bash[24289]: cluster 2024-09-16T08:18:42.570020+0000 mgr.a (mgr.14373) 6992 : cluster [DBG] pgmap v4848: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-16T08:18:44.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:18:43 smithi047 bash[22744]: cluster 2024-09-16T08:18:42.570020+0000 mgr.a (mgr.14373) 6992 : cluster [DBG] pgmap v4848: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-16T08:18:46.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:18:45 smithi157 bash[24585]: cluster 2024-09-16T08:18:44.570823+0000 mgr.a (mgr.14373) 6993 : cluster [DBG] pgmap v4849: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T08:18:46.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:18:45 smithi086 bash[24289]: cluster 2024-09-16T08:18:44.570823+0000 mgr.a (mgr.14373) 6993 : cluster [DBG] pgmap v4849: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T08:18:46.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:18:45 smithi047 bash[22744]: cluster 2024-09-16T08:18:44.570823+0000 mgr.a (mgr.14373) 6993 : cluster [DBG] pgmap v4849: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T08:18:46.547 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:18:46.548 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:18:46.548 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:18:47.330 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:18:47.330 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:18:47.330 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:18:47.330 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:18:47.330 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:18:48.305 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:18:47 smithi157 bash[24585]: cluster 2024-09-16T08:18:46.572401+0000 mgr.a (mgr.14373) 6994 : cluster [DBG] pgmap v4850: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:18:48.305 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:18:47 smithi157 bash[24585]: audit 2024-09-16T08:18:46.891381+0000 mgr.a (mgr.14373) 6995 : audit [DBG] from='client.158796 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:18:48.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:18:47 smithi086 bash[24289]: cluster 2024-09-16T08:18:46.572401+0000 mgr.a (mgr.14373) 6994 : cluster [DBG] pgmap v4850: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:18:48.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:18:47 smithi086 bash[24289]: audit 2024-09-16T08:18:46.891381+0000 mgr.a (mgr.14373) 6995 : audit [DBG] from='client.158796 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:18:48.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:18:47 smithi047 bash[22744]: cluster 2024-09-16T08:18:46.572401+0000 mgr.a (mgr.14373) 6994 : cluster [DBG] pgmap v4850: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:18:48.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:18:47 smithi047 bash[22744]: audit 2024-09-16T08:18:46.891381+0000 mgr.a (mgr.14373) 6995 : audit [DBG] from='client.158796 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:18:50.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:18:49 smithi157 bash[24585]: cluster 2024-09-16T08:18:48.573391+0000 mgr.a (mgr.14373) 6996 : cluster [DBG] pgmap v4851: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:18:50.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:18:49 smithi086 bash[24289]: cluster 2024-09-16T08:18:48.573391+0000 mgr.a (mgr.14373) 6996 : cluster [DBG] pgmap v4851: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:18:50.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:18:49 smithi047 bash[22744]: cluster 2024-09-16T08:18:48.573391+0000 mgr.a (mgr.14373) 6996 : cluster [DBG] pgmap v4851: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:18:52.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:18:51 smithi157 bash[24585]: cluster 2024-09-16T08:18:50.574188+0000 mgr.a (mgr.14373) 6997 : cluster [DBG] pgmap v4852: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T08:18:52.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:18:51 smithi086 bash[24289]: cluster 2024-09-16T08:18:50.574188+0000 mgr.a (mgr.14373) 6997 : cluster [DBG] pgmap v4852: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T08:18:52.331 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:18:52.332 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:18:52.332 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:18:52.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:18:51 smithi047 bash[22744]: cluster 2024-09-16T08:18:50.574188+0000 mgr.a (mgr.14373) 6997 : cluster [DBG] pgmap v4852: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T08:18:53.121 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:18:53.122 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:18:53.122 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:18:53.122 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:18:53.122 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:18:54.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:18:53 smithi157 bash[24585]: cluster 2024-09-16T08:18:52.576339+0000 mgr.a (mgr.14373) 6998 : cluster [DBG] pgmap v4853: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:18:54.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:18:53 smithi157 bash[24585]: audit 2024-09-16T08:18:52.674247+0000 mgr.a (mgr.14373) 6999 : audit [DBG] from='client.158874 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:18:54.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:18:53 smithi086 bash[24289]: cluster 2024-09-16T08:18:52.576339+0000 mgr.a (mgr.14373) 6998 : cluster [DBG] pgmap v4853: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:18:54.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:18:53 smithi086 bash[24289]: audit 2024-09-16T08:18:52.674247+0000 mgr.a (mgr.14373) 6999 : audit [DBG] from='client.158874 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:18:54.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:18:53 smithi047 bash[22744]: cluster 2024-09-16T08:18:52.576339+0000 mgr.a (mgr.14373) 6998 : cluster [DBG] pgmap v4853: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:18:54.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:18:53 smithi047 bash[22744]: audit 2024-09-16T08:18:52.674247+0000 mgr.a (mgr.14373) 6999 : audit [DBG] from='client.158874 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:18:56.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:18:55 smithi157 bash[24585]: cluster 2024-09-16T08:18:54.577314+0000 mgr.a (mgr.14373) 7000 : cluster [DBG] pgmap v4854: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-16T08:18:56.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:18:55 smithi086 bash[24289]: cluster 2024-09-16T08:18:54.577314+0000 mgr.a (mgr.14373) 7000 : cluster [DBG] pgmap v4854: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-16T08:18:56.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:18:55 smithi047 bash[22744]: cluster 2024-09-16T08:18:54.577314+0000 mgr.a (mgr.14373) 7000 : cluster [DBG] pgmap v4854: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-16T08:18:58.123 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:18:58.124 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:18:58.124 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:18:58.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:18:57 smithi157 bash[24585]: cluster 2024-09-16T08:18:56.579508+0000 mgr.a (mgr.14373) 7001 : cluster [DBG] pgmap v4855: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-16T08:18:58.326 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:18:57 smithi086 bash[24289]: cluster 2024-09-16T08:18:56.579508+0000 mgr.a (mgr.14373) 7001 : cluster [DBG] pgmap v4855: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-16T08:18:58.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:18:57 smithi047 bash[22744]: cluster 2024-09-16T08:18:56.579508+0000 mgr.a (mgr.14373) 7001 : cluster [DBG] pgmap v4855: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-16T08:18:58.894 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:18:58.894 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:18:58.894 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:18:58.894 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:18:58.894 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:18:59.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:18:58 smithi157 bash[24585]: audit 2024-09-16T08:18:58.463403+0000 mgr.a (mgr.14373) 7002 : audit [DBG] from='client.158952 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:18:59.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:18:58 smithi086 bash[24289]: audit 2024-09-16T08:18:58.463403+0000 mgr.a (mgr.14373) 7002 : audit [DBG] from='client.158952 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:18:59.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:18:58 smithi047 bash[22744]: audit 2024-09-16T08:18:58.463403+0000 mgr.a (mgr.14373) 7002 : audit [DBG] from='client.158952 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:19:00.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:18:59 smithi157 bash[24585]: cluster 2024-09-16T08:18:58.580069+0000 mgr.a (mgr.14373) 7003 : cluster [DBG] pgmap v4856: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:19:00.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:18:59 smithi086 bash[24289]: cluster 2024-09-16T08:18:58.580069+0000 mgr.a (mgr.14373) 7003 : cluster [DBG] pgmap v4856: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:19:00.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:18:59 smithi047 bash[22744]: cluster 2024-09-16T08:18:58.580069+0000 mgr.a (mgr.14373) 7003 : cluster [DBG] pgmap v4856: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:19:02.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:19:01 smithi157 bash[24585]: cluster 2024-09-16T08:19:00.581048+0000 mgr.a (mgr.14373) 7004 : cluster [DBG] pgmap v4857: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:19:02.316 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:19:01 smithi086 bash[24289]: cluster 2024-09-16T08:19:00.581048+0000 mgr.a (mgr.14373) 7004 : cluster [DBG] pgmap v4857: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:19:02.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:19:01 smithi047 bash[22744]: cluster 2024-09-16T08:19:00.581048+0000 mgr.a (mgr.14373) 7004 : cluster [DBG] pgmap v4857: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:19:03.896 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:19:03.896 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:19:03.898 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:19:04.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:19:03 smithi157 bash[24585]: cluster 2024-09-16T08:19:02.583444+0000 mgr.a (mgr.14373) 7005 : cluster [DBG] pgmap v4858: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:19:04.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:19:03 smithi086 bash[24289]: cluster 2024-09-16T08:19:02.583444+0000 mgr.a (mgr.14373) 7005 : cluster [DBG] pgmap v4858: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:19:04.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:19:03 smithi047 bash[22744]: cluster 2024-09-16T08:19:02.583444+0000 mgr.a (mgr.14373) 7005 : cluster [DBG] pgmap v4858: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:19:04.685 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:19:04.685 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:19:04.685 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:19:04.685 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:19:04.685 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:19:05.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:19:04 smithi157 bash[24585]: audit 2024-09-16T08:19:04.237396+0000 mgr.a (mgr.14373) 7006 : audit [DBG] from='client.159030 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:19:05.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:19:04 smithi086 bash[24289]: audit 2024-09-16T08:19:04.237396+0000 mgr.a (mgr.14373) 7006 : audit [DBG] from='client.159030 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:19:05.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:19:04 smithi047 bash[22744]: audit 2024-09-16T08:19:04.237396+0000 mgr.a (mgr.14373) 7006 : audit [DBG] from='client.159030 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:19:06.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:19:05 smithi157 bash[24585]: cluster 2024-09-16T08:19:04.584277+0000 mgr.a (mgr.14373) 7007 : cluster [DBG] pgmap v4859: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:19:06.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:19:05 smithi086 bash[24289]: cluster 2024-09-16T08:19:04.584277+0000 mgr.a (mgr.14373) 7007 : cluster [DBG] pgmap v4859: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:19:06.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:19:05 smithi047 bash[22744]: cluster 2024-09-16T08:19:04.584277+0000 mgr.a (mgr.14373) 7007 : cluster [DBG] pgmap v4859: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:19:08.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:19:07 smithi157 bash[24585]: cluster 2024-09-16T08:19:06.586437+0000 mgr.a (mgr.14373) 7008 : cluster [DBG] pgmap v4860: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:19:08.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:19:07 smithi086 bash[24289]: cluster 2024-09-16T08:19:06.586437+0000 mgr.a (mgr.14373) 7008 : cluster [DBG] pgmap v4860: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:19:08.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:19:07 smithi047 bash[22744]: cluster 2024-09-16T08:19:06.586437+0000 mgr.a (mgr.14373) 7008 : cluster [DBG] pgmap v4860: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:19:09.686 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:19:09.687 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:19:09.687 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:19:09.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:19:09 smithi157 bash[24585]: cluster 2024-09-16T08:19:08.587138+0000 mgr.a (mgr.14373) 7009 : cluster [DBG] pgmap v4861: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:19:09.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:19:09 smithi086 bash[24289]: cluster 2024-09-16T08:19:08.587138+0000 mgr.a (mgr.14373) 7009 : cluster [DBG] pgmap v4861: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:19:09.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:19:09 smithi047 bash[22744]: cluster 2024-09-16T08:19:08.587138+0000 mgr.a (mgr.14373) 7009 : cluster [DBG] pgmap v4861: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:19:10.441 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:19:10.441 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:19:10.441 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:19:10.441 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:19:10.442 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:19:10.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:19:10 smithi157 bash[24585]: audit 2024-09-16T08:19:10.022337+0000 mgr.a (mgr.14373) 7010 : audit [DBG] from='client.159105 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:19:10.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:19:10 smithi086 bash[24289]: audit 2024-09-16T08:19:10.022337+0000 mgr.a (mgr.14373) 7010 : audit [DBG] from='client.159105 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:19:10.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:19:10 smithi047 bash[22744]: audit 2024-09-16T08:19:10.022337+0000 mgr.a (mgr.14373) 7010 : audit [DBG] from='client.159105 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:19:11.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:19:11 smithi157 bash[24585]: cluster 2024-09-16T08:19:10.588045+0000 mgr.a (mgr.14373) 7011 : cluster [DBG] pgmap v4862: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:19:11.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:19:11 smithi086 bash[24289]: cluster 2024-09-16T08:19:10.588045+0000 mgr.a (mgr.14373) 7011 : cluster [DBG] pgmap v4862: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:19:11.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:19:11 smithi047 bash[22744]: cluster 2024-09-16T08:19:10.588045+0000 mgr.a (mgr.14373) 7011 : cluster [DBG] pgmap v4862: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:19:14.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:19:13 smithi157 bash[24585]: cluster 2024-09-16T08:19:12.590373+0000 mgr.a (mgr.14373) 7012 : cluster [DBG] pgmap v4863: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:19:14.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:19:13 smithi086 bash[24289]: cluster 2024-09-16T08:19:12.590373+0000 mgr.a (mgr.14373) 7012 : cluster [DBG] pgmap v4863: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:19:14.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:19:13 smithi047 bash[22744]: cluster 2024-09-16T08:19:12.590373+0000 mgr.a (mgr.14373) 7012 : cluster [DBG] pgmap v4863: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:19:15.442 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:19:15.443 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:19:15.443 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:19:16.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:19:15 smithi157 bash[24585]: cluster 2024-09-16T08:19:14.591173+0000 mgr.a (mgr.14373) 7013 : cluster [DBG] pgmap v4864: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:19:16.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:19:15 smithi086 bash[24289]: cluster 2024-09-16T08:19:14.591173+0000 mgr.a (mgr.14373) 7013 : cluster [DBG] pgmap v4864: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:19:16.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:19:15 smithi047 bash[22744]: cluster 2024-09-16T08:19:14.591173+0000 mgr.a (mgr.14373) 7013 : cluster [DBG] pgmap v4864: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:19:16.205 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:19:16.206 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:19:16.206 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:19:16.206 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:19:16.206 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:19:17.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:19:16 smithi157 bash[24585]: audit 2024-09-16T08:19:15.781292+0000 mgr.a (mgr.14373) 7014 : audit [DBG] from='client.159180 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:19:17.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:19:16 smithi086 bash[24289]: audit 2024-09-16T08:19:15.781292+0000 mgr.a (mgr.14373) 7014 : audit [DBG] from='client.159180 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:19:17.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:19:16 smithi047 bash[22744]: audit 2024-09-16T08:19:15.781292+0000 mgr.a (mgr.14373) 7014 : audit [DBG] from='client.159180 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:19:18.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:19:17 smithi157 bash[24585]: cluster 2024-09-16T08:19:16.593463+0000 mgr.a (mgr.14373) 7015 : cluster [DBG] pgmap v4865: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:19:18.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:19:17 smithi086 bash[24289]: cluster 2024-09-16T08:19:16.593463+0000 mgr.a (mgr.14373) 7015 : cluster [DBG] pgmap v4865: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:19:18.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:19:17 smithi047 bash[22744]: cluster 2024-09-16T08:19:16.593463+0000 mgr.a (mgr.14373) 7015 : cluster [DBG] pgmap v4865: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:19:20.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:19:19 smithi157 bash[24585]: cluster 2024-09-16T08:19:18.594231+0000 mgr.a (mgr.14373) 7016 : cluster [DBG] pgmap v4866: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:19:20.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:19:19 smithi157 bash[24585]: audit 2024-09-16T08:19:19.408024+0000 mon.b (mon.2) 666 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T08:19:20.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:19:19 smithi086 bash[24289]: cluster 2024-09-16T08:19:18.594231+0000 mgr.a (mgr.14373) 7016 : cluster [DBG] pgmap v4866: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:19:20.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:19:19 smithi086 bash[24289]: audit 2024-09-16T08:19:19.408024+0000 mon.b (mon.2) 666 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T08:19:20.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:19:19 smithi047 bash[22744]: cluster 2024-09-16T08:19:18.594231+0000 mgr.a (mgr.14373) 7016 : cluster [DBG] pgmap v4866: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:19:20.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:19:19 smithi047 bash[22744]: audit 2024-09-16T08:19:19.408024+0000 mon.b (mon.2) 666 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T08:19:20.997 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:19:20 smithi047 bash[22744]: audit 2024-09-16T08:19:20.238955+0000 mon.b (mon.2) 667 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T08:19:20.997 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:19:20 smithi047 bash[22744]: audit 2024-09-16T08:19:20.241469+0000 mon.b (mon.2) 668 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T08:19:20.997 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:19:20 smithi047 bash[22744]: audit 2024-09-16T08:19:20.254294+0000 mon.a (mon.0) 988 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:19:20.997 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:19:20 smithi047 bash[22744]: audit 2024-09-16T08:19:20.259085+0000 mon.b (mon.2) 669 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:19:20.997 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:19:20 smithi047 bash[22744]: audit 2024-09-16T08:19:20.262663+0000 mgr.a (mgr.14373) 7017 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:19:21.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:19:20 smithi157 bash[24585]: audit 2024-09-16T08:19:20.238955+0000 mon.b (mon.2) 667 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T08:19:21.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:19:20 smithi157 bash[24585]: audit 2024-09-16T08:19:20.241469+0000 mon.b (mon.2) 668 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T08:19:21.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:19:20 smithi157 bash[24585]: audit 2024-09-16T08:19:20.254294+0000 mon.a (mon.0) 988 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:19:21.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:19:20 smithi157 bash[24585]: audit 2024-09-16T08:19:20.259085+0000 mon.b (mon.2) 669 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:19:21.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:19:20 smithi157 bash[24585]: audit 2024-09-16T08:19:20.262663+0000 mgr.a (mgr.14373) 7017 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:19:21.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:19:20 smithi086 bash[24289]: audit 2024-09-16T08:19:20.238955+0000 mon.b (mon.2) 667 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T08:19:21.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:19:20 smithi086 bash[24289]: audit 2024-09-16T08:19:20.241469+0000 mon.b (mon.2) 668 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T08:19:21.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:19:20 smithi086 bash[24289]: audit 2024-09-16T08:19:20.254294+0000 mon.a (mon.0) 988 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:19:21.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:19:20 smithi086 bash[24289]: audit 2024-09-16T08:19:20.259085+0000 mon.b (mon.2) 669 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:19:21.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:19:20 smithi086 bash[24289]: audit 2024-09-16T08:19:20.262663+0000 mgr.a (mgr.14373) 7017 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:19:21.207 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:19:21.207 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:19:21.208 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:19:21.338 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 08:19:21 smithi047 bash[22994]: debug 2024-09-16T08:19:20.998+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T08:19:21.338 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 08:19:21 smithi047 bash[22994]: debug 2024-09-16T08:19:20.998+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T08:19:21.978 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:19:21.978 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:19:21.978 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:19:21.978 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:19:21.978 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:19:22.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:19:22 smithi157 bash[24585]: cluster 2024-09-16T08:19:20.598118+0000 mgr.a (mgr.14373) 7018 : cluster [DBG] pgmap v4867: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:19:22.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:19:22 smithi157 bash[24585]: audit 2024-09-16T08:19:21.000150+0000 mgr.a (mgr.14373) 7019 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T08:19:22.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:19:22 smithi157 bash[24585]: cephadm 2024-09-16T08:19:21.002223+0000 mgr.a (mgr.14373) 7020 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T08:19:22.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:19:22 smithi086 bash[24289]: cluster 2024-09-16T08:19:20.598118+0000 mgr.a (mgr.14373) 7018 : cluster [DBG] pgmap v4867: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:19:22.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:19:22 smithi086 bash[24289]: audit 2024-09-16T08:19:21.000150+0000 mgr.a (mgr.14373) 7019 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T08:19:22.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:19:22 smithi086 bash[24289]: cephadm 2024-09-16T08:19:21.002223+0000 mgr.a (mgr.14373) 7020 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T08:19:22.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:19:22 smithi047 bash[22744]: cluster 2024-09-16T08:19:20.598118+0000 mgr.a (mgr.14373) 7018 : cluster [DBG] pgmap v4867: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:19:22.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:19:22 smithi047 bash[22744]: audit 2024-09-16T08:19:21.000150+0000 mgr.a (mgr.14373) 7019 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T08:19:22.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:19:22 smithi047 bash[22744]: cephadm 2024-09-16T08:19:21.002223+0000 mgr.a (mgr.14373) 7020 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T08:19:23.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:19:23 smithi157 bash[24585]: audit 2024-09-16T08:19:21.543015+0000 mgr.a (mgr.14373) 7021 : audit [DBG] from='client.159360 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:19:23.566 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:19:23 smithi086 bash[24289]: audit 2024-09-16T08:19:21.543015+0000 mgr.a (mgr.14373) 7021 : audit [DBG] from='client.159360 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:19:23.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:19:23 smithi047 bash[22744]: audit 2024-09-16T08:19:21.543015+0000 mgr.a (mgr.14373) 7021 : audit [DBG] from='client.159360 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:19:24.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:19:24 smithi157 bash[24585]: cluster 2024-09-16T08:19:22.600872+0000 mgr.a (mgr.14373) 7022 : cluster [DBG] pgmap v4868: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:19:24.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:19:24 smithi086 bash[24289]: cluster 2024-09-16T08:19:22.600872+0000 mgr.a (mgr.14373) 7022 : cluster [DBG] pgmap v4868: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:19:24.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:19:24 smithi047 bash[22744]: cluster 2024-09-16T08:19:22.600872+0000 mgr.a (mgr.14373) 7022 : cluster [DBG] pgmap v4868: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:19:26.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:19:26 smithi157 bash[24585]: cluster 2024-09-16T08:19:24.601772+0000 mgr.a (mgr.14373) 7023 : cluster [DBG] pgmap v4869: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T08:19:26.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:19:26 smithi086 bash[24289]: cluster 2024-09-16T08:19:24.601772+0000 mgr.a (mgr.14373) 7023 : cluster [DBG] pgmap v4869: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T08:19:26.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:19:26 smithi047 bash[22744]: cluster 2024-09-16T08:19:24.601772+0000 mgr.a (mgr.14373) 7023 : cluster [DBG] pgmap v4869: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T08:19:26.980 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:19:26.981 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:19:26.981 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:19:27.722 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:19:27.722 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:19:27.722 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:19:27.722 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:19:27.722 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:19:28.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:19:28 smithi157 bash[24585]: cluster 2024-09-16T08:19:26.603898+0000 mgr.a (mgr.14373) 7024 : cluster [DBG] pgmap v4870: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:19:28.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:19:28 smithi157 bash[24585]: audit 2024-09-16T08:19:27.315041+0000 mgr.a (mgr.14373) 7025 : audit [DBG] from='client.159438 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:19:28.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:19:28 smithi086 bash[24289]: cluster 2024-09-16T08:19:26.603898+0000 mgr.a (mgr.14373) 7024 : cluster [DBG] pgmap v4870: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:19:28.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:19:28 smithi086 bash[24289]: audit 2024-09-16T08:19:27.315041+0000 mgr.a (mgr.14373) 7025 : audit [DBG] from='client.159438 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:19:28.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:19:28 smithi047 bash[22744]: cluster 2024-09-16T08:19:26.603898+0000 mgr.a (mgr.14373) 7024 : cluster [DBG] pgmap v4870: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:19:28.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:19:28 smithi047 bash[22744]: audit 2024-09-16T08:19:27.315041+0000 mgr.a (mgr.14373) 7025 : audit [DBG] from='client.159438 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:19:30.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:19:30 smithi157 bash[24585]: cluster 2024-09-16T08:19:28.604898+0000 mgr.a (mgr.14373) 7026 : cluster [DBG] pgmap v4871: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T08:19:30.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:19:30 smithi086 bash[24289]: cluster 2024-09-16T08:19:28.604898+0000 mgr.a (mgr.14373) 7026 : cluster [DBG] pgmap v4871: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T08:19:30.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:19:30 smithi047 bash[22744]: cluster 2024-09-16T08:19:28.604898+0000 mgr.a (mgr.14373) 7026 : cluster [DBG] pgmap v4871: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T08:19:32.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:19:32 smithi157 bash[24585]: cluster 2024-09-16T08:19:30.605672+0000 mgr.a (mgr.14373) 7027 : cluster [DBG] pgmap v4872: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T08:19:32.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:19:32 smithi086 bash[24289]: cluster 2024-09-16T08:19:30.605672+0000 mgr.a (mgr.14373) 7027 : cluster [DBG] pgmap v4872: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T08:19:32.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:19:32 smithi047 bash[22744]: cluster 2024-09-16T08:19:30.605672+0000 mgr.a (mgr.14373) 7027 : cluster [DBG] pgmap v4872: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T08:19:32.723 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:19:32.724 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:19:32.724 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:19:33.488 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:19:33.488 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:19:33.488 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:19:33.488 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:19:33.488 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:19:34.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:19:34 smithi157 bash[24585]: cluster 2024-09-16T08:19:32.607914+0000 mgr.a (mgr.14373) 7028 : cluster [DBG] pgmap v4873: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:19:34.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:19:34 smithi157 bash[24585]: audit 2024-09-16T08:19:33.058764+0000 mgr.a (mgr.14373) 7029 : audit [DBG] from='client.159516 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:19:34.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:19:34 smithi086 bash[24289]: cluster 2024-09-16T08:19:32.607914+0000 mgr.a (mgr.14373) 7028 : cluster [DBG] pgmap v4873: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:19:34.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:19:34 smithi086 bash[24289]: audit 2024-09-16T08:19:33.058764+0000 mgr.a (mgr.14373) 7029 : audit [DBG] from='client.159516 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:19:34.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:19:34 smithi047 bash[22744]: cluster 2024-09-16T08:19:32.607914+0000 mgr.a (mgr.14373) 7028 : cluster [DBG] pgmap v4873: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:19:34.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:19:34 smithi047 bash[22744]: audit 2024-09-16T08:19:33.058764+0000 mgr.a (mgr.14373) 7029 : audit [DBG] from='client.159516 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:19:36.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:19:36 smithi157 bash[24585]: cluster 2024-09-16T08:19:34.608890+0000 mgr.a (mgr.14373) 7030 : cluster [DBG] pgmap v4874: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:19:36.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:19:36 smithi086 bash[24289]: cluster 2024-09-16T08:19:34.608890+0000 mgr.a (mgr.14373) 7030 : cluster [DBG] pgmap v4874: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:19:36.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:19:36 smithi047 bash[22744]: cluster 2024-09-16T08:19:34.608890+0000 mgr.a (mgr.14373) 7030 : cluster [DBG] pgmap v4874: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:19:38.489 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:19:38.490 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:19:38.490 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:19:38.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:19:38 smithi157 bash[24585]: cluster 2024-09-16T08:19:36.611023+0000 mgr.a (mgr.14373) 7031 : cluster [DBG] pgmap v4875: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:19:38.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:19:38 smithi086 bash[24289]: cluster 2024-09-16T08:19:36.611023+0000 mgr.a (mgr.14373) 7031 : cluster [DBG] pgmap v4875: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:19:38.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:19:38 smithi047 bash[22744]: cluster 2024-09-16T08:19:36.611023+0000 mgr.a (mgr.14373) 7031 : cluster [DBG] pgmap v4875: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:19:39.234 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:19:39.234 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:19:39.235 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:19:39.235 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:19:39.235 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:19:40.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:19:40 smithi157 bash[24585]: cluster 2024-09-16T08:19:38.611453+0000 mgr.a (mgr.14373) 7032 : cluster [DBG] pgmap v4876: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:19:40.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:19:40 smithi157 bash[24585]: audit 2024-09-16T08:19:38.822960+0000 mgr.a (mgr.14373) 7033 : audit [DBG] from='client.159591 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:19:40.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:19:40 smithi086 bash[24289]: cluster 2024-09-16T08:19:38.611453+0000 mgr.a (mgr.14373) 7032 : cluster [DBG] pgmap v4876: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:19:40.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:19:40 smithi086 bash[24289]: audit 2024-09-16T08:19:38.822960+0000 mgr.a (mgr.14373) 7033 : audit [DBG] from='client.159591 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:19:40.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:19:40 smithi047 bash[22744]: cluster 2024-09-16T08:19:38.611453+0000 mgr.a (mgr.14373) 7032 : cluster [DBG] pgmap v4876: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:19:40.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:19:40 smithi047 bash[22744]: audit 2024-09-16T08:19:38.822960+0000 mgr.a (mgr.14373) 7033 : audit [DBG] from='client.159591 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:19:42.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:19:42 smithi157 bash[24585]: cluster 2024-09-16T08:19:40.612326+0000 mgr.a (mgr.14373) 7034 : cluster [DBG] pgmap v4877: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:19:42.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:19:42 smithi086 bash[24289]: cluster 2024-09-16T08:19:40.612326+0000 mgr.a (mgr.14373) 7034 : cluster [DBG] pgmap v4877: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:19:42.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:19:42 smithi047 bash[22744]: cluster 2024-09-16T08:19:40.612326+0000 mgr.a (mgr.14373) 7034 : cluster [DBG] pgmap v4877: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:19:44.236 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:19:44.237 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:19:44.237 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:19:44.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:19:44 smithi086 bash[24289]: cluster 2024-09-16T08:19:42.614575+0000 mgr.a (mgr.14373) 7035 : cluster [DBG] pgmap v4878: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:19:44.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:19:44 smithi047 bash[22744]: cluster 2024-09-16T08:19:42.614575+0000 mgr.a (mgr.14373) 7035 : cluster [DBG] pgmap v4878: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:19:44.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:19:44 smithi157 bash[24585]: cluster 2024-09-16T08:19:42.614575+0000 mgr.a (mgr.14373) 7035 : cluster [DBG] pgmap v4878: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:19:45.004 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:19:45.005 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:19:45.005 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:19:45.005 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:19:45.005 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:19:46.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:19:46 smithi086 bash[24289]: audit 2024-09-16T08:19:44.582208+0000 mgr.a (mgr.14373) 7036 : audit [DBG] from='client.159669 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:19:46.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:19:46 smithi086 bash[24289]: cluster 2024-09-16T08:19:44.615570+0000 mgr.a (mgr.14373) 7037 : cluster [DBG] pgmap v4879: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:19:46.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:19:46 smithi047 bash[22744]: audit 2024-09-16T08:19:44.582208+0000 mgr.a (mgr.14373) 7036 : audit [DBG] from='client.159669 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:19:46.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:19:46 smithi047 bash[22744]: cluster 2024-09-16T08:19:44.615570+0000 mgr.a (mgr.14373) 7037 : cluster [DBG] pgmap v4879: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:19:46.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:19:46 smithi157 bash[24585]: audit 2024-09-16T08:19:44.582208+0000 mgr.a (mgr.14373) 7036 : audit [DBG] from='client.159669 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:19:46.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:19:46 smithi157 bash[24585]: cluster 2024-09-16T08:19:44.615570+0000 mgr.a (mgr.14373) 7037 : cluster [DBG] pgmap v4879: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:19:48.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:19:48 smithi086 bash[24289]: cluster 2024-09-16T08:19:46.617840+0000 mgr.a (mgr.14373) 7038 : cluster [DBG] pgmap v4880: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:19:48.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:19:48 smithi047 bash[22744]: cluster 2024-09-16T08:19:46.617840+0000 mgr.a (mgr.14373) 7038 : cluster [DBG] pgmap v4880: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:19:48.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:19:48 smithi157 bash[24585]: cluster 2024-09-16T08:19:46.617840+0000 mgr.a (mgr.14373) 7038 : cluster [DBG] pgmap v4880: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:19:50.006 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:19:50.007 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:19:50.007 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:19:50.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:19:50 smithi047 bash[22744]: cluster 2024-09-16T08:19:48.618641+0000 mgr.a (mgr.14373) 7039 : cluster [DBG] pgmap v4881: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:19:50.768 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:19:50.769 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:19:50.769 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:19:50.769 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:19:50.769 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:19:50.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:19:50 smithi157 bash[24585]: cluster 2024-09-16T08:19:48.618641+0000 mgr.a (mgr.14373) 7039 : cluster [DBG] pgmap v4881: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:19:50.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:19:50 smithi086 bash[24289]: cluster 2024-09-16T08:19:48.618641+0000 mgr.a (mgr.14373) 7039 : cluster [DBG] pgmap v4881: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:19:51.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:19:51 smithi047 bash[22744]: audit 2024-09-16T08:19:50.345059+0000 mgr.a (mgr.14373) 7040 : audit [DBG] from='client.159747 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:19:51.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:19:51 smithi157 bash[24585]: audit 2024-09-16T08:19:50.345059+0000 mgr.a (mgr.14373) 7040 : audit [DBG] from='client.159747 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:19:51.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:19:51 smithi086 bash[24289]: audit 2024-09-16T08:19:50.345059+0000 mgr.a (mgr.14373) 7040 : audit [DBG] from='client.159747 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:19:52.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:19:52 smithi047 bash[22744]: cluster 2024-09-16T08:19:50.619184+0000 mgr.a (mgr.14373) 7041 : cluster [DBG] pgmap v4882: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:19:52.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:19:52 smithi157 bash[24585]: cluster 2024-09-16T08:19:50.619184+0000 mgr.a (mgr.14373) 7041 : cluster [DBG] pgmap v4882: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:19:52.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:19:52 smithi086 bash[24289]: cluster 2024-09-16T08:19:50.619184+0000 mgr.a (mgr.14373) 7041 : cluster [DBG] pgmap v4882: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:19:54.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:19:54 smithi047 bash[22744]: cluster 2024-09-16T08:19:52.621640+0000 mgr.a (mgr.14373) 7042 : cluster [DBG] pgmap v4883: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:19:54.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:19:54 smithi157 bash[24585]: cluster 2024-09-16T08:19:52.621640+0000 mgr.a (mgr.14373) 7042 : cluster [DBG] pgmap v4883: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:19:54.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:19:54 smithi086 bash[24289]: cluster 2024-09-16T08:19:52.621640+0000 mgr.a (mgr.14373) 7042 : cluster [DBG] pgmap v4883: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:19:55.770 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:19:55.770 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:19:55.771 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:19:56.507 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:19:56.508 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:19:56.508 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:19:56.508 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:19:56.508 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:19:56.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:19:56 smithi047 bash[22744]: cluster 2024-09-16T08:19:54.622632+0000 mgr.a (mgr.14373) 7043 : cluster [DBG] pgmap v4884: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:19:56.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:19:56 smithi157 bash[24585]: cluster 2024-09-16T08:19:54.622632+0000 mgr.a (mgr.14373) 7043 : cluster [DBG] pgmap v4884: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:19:56.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:19:56 smithi086 bash[24289]: cluster 2024-09-16T08:19:54.622632+0000 mgr.a (mgr.14373) 7043 : cluster [DBG] pgmap v4884: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:19:57.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:19:57 smithi157 bash[24585]: audit 2024-09-16T08:19:56.098793+0000 mgr.a (mgr.14373) 7044 : audit [DBG] from='client.159825 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:19:57.816 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:19:57 smithi086 bash[24289]: audit 2024-09-16T08:19:56.098793+0000 mgr.a (mgr.14373) 7044 : audit [DBG] from='client.159825 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:19:57.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:19:57 smithi047 bash[22744]: audit 2024-09-16T08:19:56.098793+0000 mgr.a (mgr.14373) 7044 : audit [DBG] from='client.159825 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:19:58.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:19:58 smithi157 bash[24585]: cluster 2024-09-16T08:19:56.624948+0000 mgr.a (mgr.14373) 7045 : cluster [DBG] pgmap v4885: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:19:58.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:19:58 smithi086 bash[24289]: cluster 2024-09-16T08:19:56.624948+0000 mgr.a (mgr.14373) 7045 : cluster [DBG] pgmap v4885: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:19:58.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:19:58 smithi047 bash[22744]: cluster 2024-09-16T08:19:56.624948+0000 mgr.a (mgr.14373) 7045 : cluster [DBG] pgmap v4885: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:20:00.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:20:00 smithi157 bash[24585]: cluster 2024-09-16T08:19:58.625771+0000 mgr.a (mgr.14373) 7046 : cluster [DBG] pgmap v4886: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:20:00.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:20:00 smithi157 bash[24585]: cluster 2024-09-16T08:20:00.000137+0000 mon.a (mon.0) 989 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-16T08:20:00.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:20:00 smithi086 bash[24289]: cluster 2024-09-16T08:19:58.625771+0000 mgr.a (mgr.14373) 7046 : cluster [DBG] pgmap v4886: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:20:00.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:20:00 smithi086 bash[24289]: cluster 2024-09-16T08:20:00.000137+0000 mon.a (mon.0) 989 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-16T08:20:00.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:20:00 smithi047 bash[22744]: cluster 2024-09-16T08:19:58.625771+0000 mgr.a (mgr.14373) 7046 : cluster [DBG] pgmap v4886: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:20:00.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:20:00 smithi047 bash[22744]: cluster 2024-09-16T08:20:00.000137+0000 mon.a (mon.0) 989 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-16T08:20:01.509 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:20:01.510 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:20:01.510 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:20:02.263 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:20:02.263 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:20:02.263 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:20:02.263 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:20:02.263 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:20:02.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:20:02 smithi157 bash[24585]: cluster 2024-09-16T08:20:00.626586+0000 mgr.a (mgr.14373) 7047 : cluster [DBG] pgmap v4887: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:20:02.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:20:02 smithi086 bash[24289]: cluster 2024-09-16T08:20:00.626586+0000 mgr.a (mgr.14373) 7047 : cluster [DBG] pgmap v4887: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:20:02.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:20:02 smithi047 bash[22744]: cluster 2024-09-16T08:20:00.626586+0000 mgr.a (mgr.14373) 7047 : cluster [DBG] pgmap v4887: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:20:03.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:20:03 smithi157 bash[24585]: audit 2024-09-16T08:20:01.845342+0000 mgr.a (mgr.14373) 7048 : audit [DBG] from='client.159900 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:20:03.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:20:03 smithi086 bash[24289]: audit 2024-09-16T08:20:01.845342+0000 mgr.a (mgr.14373) 7048 : audit [DBG] from='client.159900 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:20:03.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:20:03 smithi047 bash[22744]: audit 2024-09-16T08:20:01.845342+0000 mgr.a (mgr.14373) 7048 : audit [DBG] from='client.159900 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:20:04.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:20:04 smithi157 bash[24585]: cluster 2024-09-16T08:20:02.629334+0000 mgr.a (mgr.14373) 7049 : cluster [DBG] pgmap v4888: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:20:04.816 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:20:04 smithi086 bash[24289]: cluster 2024-09-16T08:20:02.629334+0000 mgr.a (mgr.14373) 7049 : cluster [DBG] pgmap v4888: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:20:04.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:20:04 smithi047 bash[22744]: cluster 2024-09-16T08:20:02.629334+0000 mgr.a (mgr.14373) 7049 : cluster [DBG] pgmap v4888: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:20:06.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:20:06 smithi157 bash[24585]: cluster 2024-09-16T08:20:04.630153+0000 mgr.a (mgr.14373) 7050 : cluster [DBG] pgmap v4889: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:20:06.816 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:20:06 smithi086 bash[24289]: cluster 2024-09-16T08:20:04.630153+0000 mgr.a (mgr.14373) 7050 : cluster [DBG] pgmap v4889: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:20:06.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:20:06 smithi047 bash[22744]: cluster 2024-09-16T08:20:04.630153+0000 mgr.a (mgr.14373) 7050 : cluster [DBG] pgmap v4889: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:20:07.264 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:20:07.265 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:20:07.265 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:20:08.030 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:20:08.030 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:20:08.030 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:20:08.030 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:20:08.030 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:20:08.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:20:08 smithi157 bash[24585]: cluster 2024-09-16T08:20:06.632065+0000 mgr.a (mgr.14373) 7051 : cluster [DBG] pgmap v4890: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:20:08.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:20:08 smithi086 bash[24289]: cluster 2024-09-16T08:20:06.632065+0000 mgr.a (mgr.14373) 7051 : cluster [DBG] pgmap v4890: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:20:08.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:20:08 smithi047 bash[22744]: cluster 2024-09-16T08:20:06.632065+0000 mgr.a (mgr.14373) 7051 : cluster [DBG] pgmap v4890: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:20:09.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:20:09 smithi157 bash[24585]: audit 2024-09-16T08:20:07.600430+0000 mgr.a (mgr.14373) 7052 : audit [DBG] from='client.159975 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:20:09.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:20:09 smithi086 bash[24289]: audit 2024-09-16T08:20:07.600430+0000 mgr.a (mgr.14373) 7052 : audit [DBG] from='client.159975 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:20:09.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:20:09 smithi047 bash[22744]: audit 2024-09-16T08:20:07.600430+0000 mgr.a (mgr.14373) 7052 : audit [DBG] from='client.159975 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:20:10.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:20:10 smithi157 bash[24585]: cluster 2024-09-16T08:20:08.633064+0000 mgr.a (mgr.14373) 7053 : cluster [DBG] pgmap v4891: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:20:10.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:20:10 smithi086 bash[24289]: cluster 2024-09-16T08:20:08.633064+0000 mgr.a (mgr.14373) 7053 : cluster [DBG] pgmap v4891: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:20:10.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:20:10 smithi047 bash[22744]: cluster 2024-09-16T08:20:08.633064+0000 mgr.a (mgr.14373) 7053 : cluster [DBG] pgmap v4891: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:20:12.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:20:12 smithi157 bash[24585]: cluster 2024-09-16T08:20:10.633859+0000 mgr.a (mgr.14373) 7054 : cluster [DBG] pgmap v4892: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T08:20:12.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:20:12 smithi086 bash[24289]: cluster 2024-09-16T08:20:10.633859+0000 mgr.a (mgr.14373) 7054 : cluster [DBG] pgmap v4892: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T08:20:12.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:20:12 smithi047 bash[22744]: cluster 2024-09-16T08:20:10.633859+0000 mgr.a (mgr.14373) 7054 : cluster [DBG] pgmap v4892: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T08:20:13.031 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:20:13.032 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:20:13.032 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:20:13.800 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:20:13.800 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:20:13.800 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:20:13.800 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:20:13.801 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:20:14.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:20:14 smithi157 bash[24585]: cluster 2024-09-16T08:20:12.636107+0000 mgr.a (mgr.14373) 7055 : cluster [DBG] pgmap v4893: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:20:14.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:20:14 smithi157 bash[24585]: audit 2024-09-16T08:20:13.371487+0000 mgr.a (mgr.14373) 7056 : audit [DBG] from='client.160053 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:20:14.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:20:14 smithi086 bash[24289]: cluster 2024-09-16T08:20:12.636107+0000 mgr.a (mgr.14373) 7055 : cluster [DBG] pgmap v4893: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:20:14.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:20:14 smithi086 bash[24289]: audit 2024-09-16T08:20:13.371487+0000 mgr.a (mgr.14373) 7056 : audit [DBG] from='client.160053 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:20:14.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:20:14 smithi047 bash[22744]: cluster 2024-09-16T08:20:12.636107+0000 mgr.a (mgr.14373) 7055 : cluster [DBG] pgmap v4893: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:20:14.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:20:14 smithi047 bash[22744]: audit 2024-09-16T08:20:13.371487+0000 mgr.a (mgr.14373) 7056 : audit [DBG] from='client.160053 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:20:16.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:20:16 smithi157 bash[24585]: cluster 2024-09-16T08:20:14.637079+0000 mgr.a (mgr.14373) 7057 : cluster [DBG] pgmap v4894: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:20:16.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:20:16 smithi086 bash[24289]: cluster 2024-09-16T08:20:14.637079+0000 mgr.a (mgr.14373) 7057 : cluster [DBG] pgmap v4894: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:20:16.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:20:16 smithi047 bash[22744]: cluster 2024-09-16T08:20:14.637079+0000 mgr.a (mgr.14373) 7057 : cluster [DBG] pgmap v4894: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:20:18.799 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:20:18.800 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:20:18.800 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:20:18.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:20:18 smithi157 bash[24585]: cluster 2024-09-16T08:20:16.639245+0000 mgr.a (mgr.14373) 7058 : cluster [DBG] pgmap v4895: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:20:18.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:20:18 smithi086 bash[24289]: cluster 2024-09-16T08:20:16.639245+0000 mgr.a (mgr.14373) 7058 : cluster [DBG] pgmap v4895: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:20:18.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:20:18 smithi047 bash[22744]: cluster 2024-09-16T08:20:16.639245+0000 mgr.a (mgr.14373) 7058 : cluster [DBG] pgmap v4895: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:20:19.580 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:20:19.581 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:20:19.581 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:20:19.581 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:20:19.581 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:20:20.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:20:20 smithi157 bash[24585]: cluster 2024-09-16T08:20:18.640046+0000 mgr.a (mgr.14373) 7059 : cluster [DBG] pgmap v4896: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:20:20.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:20:20 smithi157 bash[24585]: audit 2024-09-16T08:20:19.139174+0000 mgr.a (mgr.14373) 7060 : audit [DBG] from='client.160128 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:20:20.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:20:20 smithi086 bash[24289]: cluster 2024-09-16T08:20:18.640046+0000 mgr.a (mgr.14373) 7059 : cluster [DBG] pgmap v4896: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:20:20.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:20:20 smithi086 bash[24289]: audit 2024-09-16T08:20:19.139174+0000 mgr.a (mgr.14373) 7060 : audit [DBG] from='client.160128 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:20:20.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:20:20 smithi047 bash[22744]: cluster 2024-09-16T08:20:18.640046+0000 mgr.a (mgr.14373) 7059 : cluster [DBG] pgmap v4896: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:20:20.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:20:20 smithi047 bash[22744]: audit 2024-09-16T08:20:19.139174+0000 mgr.a (mgr.14373) 7060 : audit [DBG] from='client.160128 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:20:21.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:20:21 smithi157 bash[24585]: audit 2024-09-16T08:20:21.054837+0000 mon.b (mon.2) 670 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T08:20:21.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:20:21 smithi086 bash[24289]: audit 2024-09-16T08:20:21.054837+0000 mon.b (mon.2) 670 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T08:20:21.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:20:21 smithi047 bash[22744]: audit 2024-09-16T08:20:21.054837+0000 mon.b (mon.2) 670 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T08:20:22.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:20:22 smithi157 bash[24585]: cluster 2024-09-16T08:20:20.640985+0000 mgr.a (mgr.14373) 7061 : cluster [DBG] pgmap v4897: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:20:22.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:20:22 smithi157 bash[24585]: audit 2024-09-16T08:20:21.682923+0000 mon.a (mon.0) 990 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:20:22.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:20:22 smithi157 bash[24585]: audit 2024-09-16T08:20:21.690195+0000 mon.a (mon.0) 991 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:20:22.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:20:22 smithi086 bash[24289]: cluster 2024-09-16T08:20:20.640985+0000 mgr.a (mgr.14373) 7061 : cluster [DBG] pgmap v4897: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:20:22.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:20:22 smithi086 bash[24289]: audit 2024-09-16T08:20:21.682923+0000 mon.a (mon.0) 990 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:20:22.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:20:22 smithi086 bash[24289]: audit 2024-09-16T08:20:21.690195+0000 mon.a (mon.0) 991 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:20:22.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:20:22 smithi047 bash[22744]: cluster 2024-09-16T08:20:20.640985+0000 mgr.a (mgr.14373) 7061 : cluster [DBG] pgmap v4897: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:20:22.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:20:22 smithi047 bash[22744]: audit 2024-09-16T08:20:21.682923+0000 mon.a (mon.0) 990 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:20:22.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:20:22 smithi047 bash[22744]: audit 2024-09-16T08:20:21.690195+0000 mon.a (mon.0) 991 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:20:23.588 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 08:20:23 smithi047 bash[22994]: debug 2024-09-16T08:20:23.208+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T08:20:23.588 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 08:20:23 smithi047 bash[22994]: debug 2024-09-16T08:20:23.212+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T08:20:23.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:20:23 smithi047 bash[22744]: audit 2024-09-16T08:20:22.457057+0000 mon.b (mon.2) 671 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T08:20:23.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:20:23 smithi047 bash[22744]: audit 2024-09-16T08:20:22.459127+0000 mon.b (mon.2) 672 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T08:20:23.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:20:23 smithi047 bash[22744]: audit 2024-09-16T08:20:22.471251+0000 mon.a (mon.0) 992 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:20:23.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:20:23 smithi047 bash[22744]: audit 2024-09-16T08:20:22.475220+0000 mon.b (mon.2) 673 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:20:23.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:20:23 smithi047 bash[22744]: audit 2024-09-16T08:20:22.478783+0000 mgr.a (mgr.14373) 7062 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:20:23.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:20:23 smithi157 bash[24585]: audit 2024-09-16T08:20:22.457057+0000 mon.b (mon.2) 671 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T08:20:23.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:20:23 smithi157 bash[24585]: audit 2024-09-16T08:20:22.459127+0000 mon.b (mon.2) 672 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T08:20:23.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:20:23 smithi157 bash[24585]: audit 2024-09-16T08:20:22.471251+0000 mon.a (mon.0) 992 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:20:23.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:20:23 smithi157 bash[24585]: audit 2024-09-16T08:20:22.475220+0000 mon.b (mon.2) 673 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:20:23.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:20:23 smithi157 bash[24585]: audit 2024-09-16T08:20:22.478783+0000 mgr.a (mgr.14373) 7062 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:20:23.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:20:23 smithi086 bash[24289]: audit 2024-09-16T08:20:22.457057+0000 mon.b (mon.2) 671 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T08:20:23.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:20:23 smithi086 bash[24289]: audit 2024-09-16T08:20:22.459127+0000 mon.b (mon.2) 672 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T08:20:23.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:20:23 smithi086 bash[24289]: audit 2024-09-16T08:20:22.471251+0000 mon.a (mon.0) 992 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:20:23.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:20:23 smithi086 bash[24289]: audit 2024-09-16T08:20:22.475220+0000 mon.b (mon.2) 673 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:20:23.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:20:23 smithi086 bash[24289]: audit 2024-09-16T08:20:22.478783+0000 mgr.a (mgr.14373) 7062 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:20:24.582 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:20:24.583 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:20:24.583 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:20:24.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:20:24 smithi157 bash[24585]: cluster 2024-09-16T08:20:22.642308+0000 mgr.a (mgr.14373) 7063 : cluster [DBG] pgmap v4898: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:20:24.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:20:24 smithi157 bash[24585]: audit 2024-09-16T08:20:23.212690+0000 mgr.a (mgr.14373) 7064 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T08:20:24.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:20:24 smithi157 bash[24585]: cephadm 2024-09-16T08:20:23.214855+0000 mgr.a (mgr.14373) 7065 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T08:20:24.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:20:24 smithi086 bash[24289]: cluster 2024-09-16T08:20:22.642308+0000 mgr.a (mgr.14373) 7063 : cluster [DBG] pgmap v4898: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:20:24.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:20:24 smithi086 bash[24289]: audit 2024-09-16T08:20:23.212690+0000 mgr.a (mgr.14373) 7064 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T08:20:24.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:20:24 smithi086 bash[24289]: cephadm 2024-09-16T08:20:23.214855+0000 mgr.a (mgr.14373) 7065 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T08:20:24.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:20:24 smithi047 bash[22744]: cluster 2024-09-16T08:20:22.642308+0000 mgr.a (mgr.14373) 7063 : cluster [DBG] pgmap v4898: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:20:24.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:20:24 smithi047 bash[22744]: audit 2024-09-16T08:20:23.212690+0000 mgr.a (mgr.14373) 7064 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T08:20:24.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:20:24 smithi047 bash[22744]: cephadm 2024-09-16T08:20:23.214855+0000 mgr.a (mgr.14373) 7065 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T08:20:25.323 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:20:25.324 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:20:25.324 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:20:25.324 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:20:25.324 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:20:26.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:20:26 smithi157 bash[24585]: cluster 2024-09-16T08:20:24.643123+0000 mgr.a (mgr.14373) 7066 : cluster [DBG] pgmap v4899: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:20:26.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:20:26 smithi157 bash[24585]: audit 2024-09-16T08:20:24.911945+0000 mgr.a (mgr.14373) 7067 : audit [DBG] from='client.160314 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:20:26.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:20:26 smithi086 bash[24289]: cluster 2024-09-16T08:20:24.643123+0000 mgr.a (mgr.14373) 7066 : cluster [DBG] pgmap v4899: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:20:26.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:20:26 smithi086 bash[24289]: audit 2024-09-16T08:20:24.911945+0000 mgr.a (mgr.14373) 7067 : audit [DBG] from='client.160314 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:20:26.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:20:26 smithi047 bash[22744]: cluster 2024-09-16T08:20:24.643123+0000 mgr.a (mgr.14373) 7066 : cluster [DBG] pgmap v4899: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:20:26.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:20:26 smithi047 bash[22744]: audit 2024-09-16T08:20:24.911945+0000 mgr.a (mgr.14373) 7067 : audit [DBG] from='client.160314 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:20:28.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:20:28 smithi157 bash[24585]: cluster 2024-09-16T08:20:26.645379+0000 mgr.a (mgr.14373) 7068 : cluster [DBG] pgmap v4900: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:20:28.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:20:28 smithi086 bash[24289]: cluster 2024-09-16T08:20:26.645379+0000 mgr.a (mgr.14373) 7068 : cluster [DBG] pgmap v4900: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:20:28.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:20:28 smithi047 bash[22744]: cluster 2024-09-16T08:20:26.645379+0000 mgr.a (mgr.14373) 7068 : cluster [DBG] pgmap v4900: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:20:30.325 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:20:30.326 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:20:30.326 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:20:30.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:20:30 smithi157 bash[24585]: cluster 2024-09-16T08:20:28.646165+0000 mgr.a (mgr.14373) 7069 : cluster [DBG] pgmap v4901: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:20:30.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:20:30 smithi086 bash[24289]: cluster 2024-09-16T08:20:28.646165+0000 mgr.a (mgr.14373) 7069 : cluster [DBG] pgmap v4901: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:20:30.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:20:30 smithi047 bash[22744]: cluster 2024-09-16T08:20:28.646165+0000 mgr.a (mgr.14373) 7069 : cluster [DBG] pgmap v4901: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:20:31.084 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:20:31.085 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:20:31.085 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:20:31.085 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:20:31.085 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:20:32.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:20:32 smithi157 bash[24585]: cluster 2024-09-16T08:20:30.646885+0000 mgr.a (mgr.14373) 7070 : cluster [DBG] pgmap v4902: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:20:32.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:20:32 smithi157 bash[24585]: audit 2024-09-16T08:20:30.664581+0000 mgr.a (mgr.14373) 7071 : audit [DBG] from='client.160392 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:20:32.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:20:32 smithi086 bash[24289]: cluster 2024-09-16T08:20:30.646885+0000 mgr.a (mgr.14373) 7070 : cluster [DBG] pgmap v4902: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:20:32.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:20:32 smithi086 bash[24289]: audit 2024-09-16T08:20:30.664581+0000 mgr.a (mgr.14373) 7071 : audit [DBG] from='client.160392 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:20:32.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:20:32 smithi047 bash[22744]: cluster 2024-09-16T08:20:30.646885+0000 mgr.a (mgr.14373) 7070 : cluster [DBG] pgmap v4902: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:20:32.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:20:32 smithi047 bash[22744]: audit 2024-09-16T08:20:30.664581+0000 mgr.a (mgr.14373) 7071 : audit [DBG] from='client.160392 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:20:34.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:20:34 smithi157 bash[24585]: cluster 2024-09-16T08:20:32.649254+0000 mgr.a (mgr.14373) 7072 : cluster [DBG] pgmap v4903: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:20:34.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:20:34 smithi086 bash[24289]: cluster 2024-09-16T08:20:32.649254+0000 mgr.a (mgr.14373) 7072 : cluster [DBG] pgmap v4903: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:20:34.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:20:34 smithi047 bash[22744]: cluster 2024-09-16T08:20:32.649254+0000 mgr.a (mgr.14373) 7072 : cluster [DBG] pgmap v4903: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:20:36.086 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:20:36.087 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:20:36.087 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:20:36.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:20:36 smithi157 bash[24585]: cluster 2024-09-16T08:20:34.650033+0000 mgr.a (mgr.14373) 7073 : cluster [DBG] pgmap v4904: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:20:36.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:20:36 smithi086 bash[24289]: cluster 2024-09-16T08:20:34.650033+0000 mgr.a (mgr.14373) 7073 : cluster [DBG] pgmap v4904: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:20:36.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:20:36 smithi047 bash[22744]: cluster 2024-09-16T08:20:34.650033+0000 mgr.a (mgr.14373) 7073 : cluster [DBG] pgmap v4904: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:20:36.851 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:20:36.851 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:20:36.851 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:20:36.851 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:20:36.851 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:20:37.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:20:37 smithi157 bash[24585]: audit 2024-09-16T08:20:36.425511+0000 mgr.a (mgr.14373) 7074 : audit [DBG] from='client.160467 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:20:37.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:20:37 smithi086 bash[24289]: audit 2024-09-16T08:20:36.425511+0000 mgr.a (mgr.14373) 7074 : audit [DBG] from='client.160467 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:20:37.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:20:37 smithi047 bash[22744]: audit 2024-09-16T08:20:36.425511+0000 mgr.a (mgr.14373) 7074 : audit [DBG] from='client.160467 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:20:38.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:20:38 smithi157 bash[24585]: cluster 2024-09-16T08:20:36.661409+0000 mgr.a (mgr.14373) 7075 : cluster [DBG] pgmap v4905: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:20:38.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:20:38 smithi086 bash[24289]: cluster 2024-09-16T08:20:36.661409+0000 mgr.a (mgr.14373) 7075 : cluster [DBG] pgmap v4905: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:20:38.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:20:38 smithi047 bash[22744]: cluster 2024-09-16T08:20:36.661409+0000 mgr.a (mgr.14373) 7075 : cluster [DBG] pgmap v4905: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:20:40.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:20:40 smithi157 bash[24585]: cluster 2024-09-16T08:20:38.662492+0000 mgr.a (mgr.14373) 7076 : cluster [DBG] pgmap v4906: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:20:40.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:20:40 smithi086 bash[24289]: cluster 2024-09-16T08:20:38.662492+0000 mgr.a (mgr.14373) 7076 : cluster [DBG] pgmap v4906: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:20:40.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:20:40 smithi047 bash[22744]: cluster 2024-09-16T08:20:38.662492+0000 mgr.a (mgr.14373) 7076 : cluster [DBG] pgmap v4906: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:20:41.852 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:20:41.853 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:20:41.853 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:20:42.630 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:20:42.631 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:20:42.631 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:20:42.631 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:20:42.631 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:20:42.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:20:42 smithi157 bash[24585]: cluster 2024-09-16T08:20:40.663435+0000 mgr.a (mgr.14373) 7077 : cluster [DBG] pgmap v4907: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:20:42.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:20:42 smithi086 bash[24289]: cluster 2024-09-16T08:20:40.663435+0000 mgr.a (mgr.14373) 7077 : cluster [DBG] pgmap v4907: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:20:42.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:20:42 smithi047 bash[22744]: cluster 2024-09-16T08:20:40.663435+0000 mgr.a (mgr.14373) 7077 : cluster [DBG] pgmap v4907: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:20:43.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:20:43 smithi157 bash[24585]: audit 2024-09-16T08:20:42.193103+0000 mgr.a (mgr.14373) 7078 : audit [DBG] from='client.160542 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:20:43.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:20:43 smithi086 bash[24289]: audit 2024-09-16T08:20:42.193103+0000 mgr.a (mgr.14373) 7078 : audit [DBG] from='client.160542 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:20:43.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:20:43 smithi047 bash[22744]: audit 2024-09-16T08:20:42.193103+0000 mgr.a (mgr.14373) 7078 : audit [DBG] from='client.160542 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:20:44.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:20:44 smithi086 bash[24289]: cluster 2024-09-16T08:20:42.664957+0000 mgr.a (mgr.14373) 7079 : cluster [DBG] pgmap v4908: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:20:44.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:20:44 smithi047 bash[22744]: cluster 2024-09-16T08:20:42.664957+0000 mgr.a (mgr.14373) 7079 : cluster [DBG] pgmap v4908: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:20:44.838 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:20:44 smithi157 bash[24585]: cluster 2024-09-16T08:20:42.664957+0000 mgr.a (mgr.14373) 7079 : cluster [DBG] pgmap v4908: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:20:45.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:20:45 smithi157 bash[24585]: cluster 2024-09-16T08:20:44.665675+0000 mgr.a (mgr.14373) 7080 : cluster [DBG] pgmap v4909: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:20:45.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:20:45 smithi086 bash[24289]: cluster 2024-09-16T08:20:44.665675+0000 mgr.a (mgr.14373) 7080 : cluster [DBG] pgmap v4909: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:20:45.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:20:45 smithi047 bash[22744]: cluster 2024-09-16T08:20:44.665675+0000 mgr.a (mgr.14373) 7080 : cluster [DBG] pgmap v4909: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:20:47.632 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:20:47.633 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:20:47.633 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:20:48.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:20:47 smithi157 bash[24585]: cluster 2024-09-16T08:20:46.667613+0000 mgr.a (mgr.14373) 7081 : cluster [DBG] pgmap v4910: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:20:48.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:20:47 smithi086 bash[24289]: cluster 2024-09-16T08:20:46.667613+0000 mgr.a (mgr.14373) 7081 : cluster [DBG] pgmap v4910: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:20:48.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:20:47 smithi047 bash[22744]: cluster 2024-09-16T08:20:46.667613+0000 mgr.a (mgr.14373) 7081 : cluster [DBG] pgmap v4910: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:20:48.385 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:20:48.385 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:20:48.385 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:20:48.385 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:20:48.385 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:20:49.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:20:48 smithi157 bash[24585]: audit 2024-09-16T08:20:47.967699+0000 mgr.a (mgr.14373) 7082 : audit [DBG] from='client.160620 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:20:49.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:20:48 smithi086 bash[24289]: audit 2024-09-16T08:20:47.967699+0000 mgr.a (mgr.14373) 7082 : audit [DBG] from='client.160620 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:20:49.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:20:48 smithi047 bash[22744]: audit 2024-09-16T08:20:47.967699+0000 mgr.a (mgr.14373) 7082 : audit [DBG] from='client.160620 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:20:50.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:20:49 smithi157 bash[24585]: cluster 2024-09-16T08:20:48.668550+0000 mgr.a (mgr.14373) 7083 : cluster [DBG] pgmap v4911: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:20:50.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:20:49 smithi086 bash[24289]: cluster 2024-09-16T08:20:48.668550+0000 mgr.a (mgr.14373) 7083 : cluster [DBG] pgmap v4911: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:20:50.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:20:49 smithi047 bash[22744]: cluster 2024-09-16T08:20:48.668550+0000 mgr.a (mgr.14373) 7083 : cluster [DBG] pgmap v4911: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:20:52.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:20:51 smithi157 bash[24585]: cluster 2024-09-16T08:20:50.669321+0000 mgr.a (mgr.14373) 7084 : cluster [DBG] pgmap v4912: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:20:52.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:20:51 smithi086 bash[24289]: cluster 2024-09-16T08:20:50.669321+0000 mgr.a (mgr.14373) 7084 : cluster [DBG] pgmap v4912: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:20:52.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:20:51 smithi047 bash[22744]: cluster 2024-09-16T08:20:50.669321+0000 mgr.a (mgr.14373) 7084 : cluster [DBG] pgmap v4912: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:20:53.386 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:20:53.387 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:20:53.387 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:20:54.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:20:53 smithi157 bash[24585]: cluster 2024-09-16T08:20:52.671583+0000 mgr.a (mgr.14373) 7085 : cluster [DBG] pgmap v4913: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:20:54.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:20:53 smithi086 bash[24289]: cluster 2024-09-16T08:20:52.671583+0000 mgr.a (mgr.14373) 7085 : cluster [DBG] pgmap v4913: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:20:54.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:20:53 smithi047 bash[22744]: cluster 2024-09-16T08:20:52.671583+0000 mgr.a (mgr.14373) 7085 : cluster [DBG] pgmap v4913: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:20:54.167 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:20:54.168 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:20:54.168 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:20:54.168 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:20:54.168 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:20:55.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:20:54 smithi157 bash[24585]: audit 2024-09-16T08:20:53.727813+0000 mgr.a (mgr.14373) 7086 : audit [DBG] from='client.160698 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:20:55.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:20:54 smithi086 bash[24289]: audit 2024-09-16T08:20:53.727813+0000 mgr.a (mgr.14373) 7086 : audit [DBG] from='client.160698 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:20:55.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:20:54 smithi047 bash[22744]: audit 2024-09-16T08:20:53.727813+0000 mgr.a (mgr.14373) 7086 : audit [DBG] from='client.160698 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:20:56.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:20:55 smithi157 bash[24585]: cluster 2024-09-16T08:20:54.672501+0000 mgr.a (mgr.14373) 7087 : cluster [DBG] pgmap v4914: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:20:56.066 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:20:55 smithi086 bash[24289]: cluster 2024-09-16T08:20:54.672501+0000 mgr.a (mgr.14373) 7087 : cluster [DBG] pgmap v4914: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:20:56.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:20:55 smithi047 bash[22744]: cluster 2024-09-16T08:20:54.672501+0000 mgr.a (mgr.14373) 7087 : cluster [DBG] pgmap v4914: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:20:58.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:20:57 smithi157 bash[24585]: cluster 2024-09-16T08:20:56.674703+0000 mgr.a (mgr.14373) 7088 : cluster [DBG] pgmap v4915: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:20:58.066 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:20:57 smithi086 bash[24289]: cluster 2024-09-16T08:20:56.674703+0000 mgr.a (mgr.14373) 7088 : cluster [DBG] pgmap v4915: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:20:58.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:20:57 smithi047 bash[22744]: cluster 2024-09-16T08:20:56.674703+0000 mgr.a (mgr.14373) 7088 : cluster [DBG] pgmap v4915: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:20:59.169 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:20:59.169 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:20:59.169 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:20:59.941 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:20:59.942 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:20:59.942 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:20:59.942 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:20:59.942 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:21:00.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:20:59 smithi157 bash[24585]: cluster 2024-09-16T08:20:58.675480+0000 mgr.a (mgr.14373) 7089 : cluster [DBG] pgmap v4916: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:21:00.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:20:59 smithi157 bash[24585]: audit 2024-09-16T08:20:59.506027+0000 mgr.a (mgr.14373) 7090 : audit [DBG] from='client.160773 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:21:00.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:20:59 smithi086 bash[24289]: cluster 2024-09-16T08:20:58.675480+0000 mgr.a (mgr.14373) 7089 : cluster [DBG] pgmap v4916: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:21:00.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:20:59 smithi086 bash[24289]: audit 2024-09-16T08:20:59.506027+0000 mgr.a (mgr.14373) 7090 : audit [DBG] from='client.160773 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:21:00.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:20:59 smithi047 bash[22744]: cluster 2024-09-16T08:20:58.675480+0000 mgr.a (mgr.14373) 7089 : cluster [DBG] pgmap v4916: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:21:00.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:20:59 smithi047 bash[22744]: audit 2024-09-16T08:20:59.506027+0000 mgr.a (mgr.14373) 7090 : audit [DBG] from='client.160773 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:21:02.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:21:01 smithi157 bash[24585]: cluster 2024-09-16T08:21:00.676381+0000 mgr.a (mgr.14373) 7091 : cluster [DBG] pgmap v4917: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:21:02.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:21:01 smithi086 bash[24289]: cluster 2024-09-16T08:21:00.676381+0000 mgr.a (mgr.14373) 7091 : cluster [DBG] pgmap v4917: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:21:02.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:21:01 smithi047 bash[22744]: cluster 2024-09-16T08:21:00.676381+0000 mgr.a (mgr.14373) 7091 : cluster [DBG] pgmap v4917: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:21:04.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:21:03 smithi157 bash[24585]: cluster 2024-09-16T08:21:02.678637+0000 mgr.a (mgr.14373) 7092 : cluster [DBG] pgmap v4918: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:21:04.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:21:03 smithi086 bash[24289]: cluster 2024-09-16T08:21:02.678637+0000 mgr.a (mgr.14373) 7092 : cluster [DBG] pgmap v4918: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:21:04.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:21:03 smithi047 bash[22744]: cluster 2024-09-16T08:21:02.678637+0000 mgr.a (mgr.14373) 7092 : cluster [DBG] pgmap v4918: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:21:04.943 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:21:04.944 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:21:04.944 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:21:05.691 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:21:05.691 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:21:05.691 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:21:05.691 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:21:05.692 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:21:06.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:21:05 smithi157 bash[24585]: cluster 2024-09-16T08:21:04.679378+0000 mgr.a (mgr.14373) 7093 : cluster [DBG] pgmap v4919: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:21:06.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:21:05 smithi157 bash[24585]: audit 2024-09-16T08:21:05.275074+0000 mgr.a (mgr.14373) 7094 : audit [DBG] from='client.160851 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:21:06.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:21:05 smithi086 bash[24289]: cluster 2024-09-16T08:21:04.679378+0000 mgr.a (mgr.14373) 7093 : cluster [DBG] pgmap v4919: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:21:06.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:21:05 smithi086 bash[24289]: audit 2024-09-16T08:21:05.275074+0000 mgr.a (mgr.14373) 7094 : audit [DBG] from='client.160851 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:21:06.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:21:05 smithi047 bash[22744]: cluster 2024-09-16T08:21:04.679378+0000 mgr.a (mgr.14373) 7093 : cluster [DBG] pgmap v4919: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:21:06.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:21:05 smithi047 bash[22744]: audit 2024-09-16T08:21:05.275074+0000 mgr.a (mgr.14373) 7094 : audit [DBG] from='client.160851 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:21:08.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:21:07 smithi157 bash[24585]: cluster 2024-09-16T08:21:06.681640+0000 mgr.a (mgr.14373) 7095 : cluster [DBG] pgmap v4920: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:21:08.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:21:07 smithi086 bash[24289]: cluster 2024-09-16T08:21:06.681640+0000 mgr.a (mgr.14373) 7095 : cluster [DBG] pgmap v4920: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:21:08.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:21:07 smithi047 bash[22744]: cluster 2024-09-16T08:21:06.681640+0000 mgr.a (mgr.14373) 7095 : cluster [DBG] pgmap v4920: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:21:10.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:21:09 smithi157 bash[24585]: cluster 2024-09-16T08:21:08.682416+0000 mgr.a (mgr.14373) 7096 : cluster [DBG] pgmap v4921: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:21:10.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:21:09 smithi086 bash[24289]: cluster 2024-09-16T08:21:08.682416+0000 mgr.a (mgr.14373) 7096 : cluster [DBG] pgmap v4921: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:21:10.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:21:09 smithi047 bash[22744]: cluster 2024-09-16T08:21:08.682416+0000 mgr.a (mgr.14373) 7096 : cluster [DBG] pgmap v4921: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:21:10.693 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:21:10.693 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:21:10.693 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:21:11.477 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:21:11.478 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:21:11.478 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:21:11.478 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:21:11.478 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:21:12.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:21:11 smithi157 bash[24585]: cluster 2024-09-16T08:21:10.683160+0000 mgr.a (mgr.14373) 7097 : cluster [DBG] pgmap v4922: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:21:12.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:21:11 smithi157 bash[24585]: audit 2024-09-16T08:21:11.034672+0000 mgr.a (mgr.14373) 7098 : audit [DBG] from='client.160926 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:21:12.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:21:11 smithi086 bash[24289]: cluster 2024-09-16T08:21:10.683160+0000 mgr.a (mgr.14373) 7097 : cluster [DBG] pgmap v4922: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:21:12.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:21:11 smithi086 bash[24289]: audit 2024-09-16T08:21:11.034672+0000 mgr.a (mgr.14373) 7098 : audit [DBG] from='client.160926 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:21:12.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:21:11 smithi047 bash[22744]: cluster 2024-09-16T08:21:10.683160+0000 mgr.a (mgr.14373) 7097 : cluster [DBG] pgmap v4922: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:21:12.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:21:11 smithi047 bash[22744]: audit 2024-09-16T08:21:11.034672+0000 mgr.a (mgr.14373) 7098 : audit [DBG] from='client.160926 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:21:14.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:21:13 smithi157 bash[24585]: cluster 2024-09-16T08:21:12.685512+0000 mgr.a (mgr.14373) 7099 : cluster [DBG] pgmap v4923: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:21:14.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:21:13 smithi086 bash[24289]: cluster 2024-09-16T08:21:12.685512+0000 mgr.a (mgr.14373) 7099 : cluster [DBG] pgmap v4923: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:21:14.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:21:13 smithi047 bash[22744]: cluster 2024-09-16T08:21:12.685512+0000 mgr.a (mgr.14373) 7099 : cluster [DBG] pgmap v4923: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:21:16.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:21:15 smithi157 bash[24585]: cluster 2024-09-16T08:21:14.686281+0000 mgr.a (mgr.14373) 7100 : cluster [DBG] pgmap v4924: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:21:16.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:21:15 smithi086 bash[24289]: cluster 2024-09-16T08:21:14.686281+0000 mgr.a (mgr.14373) 7100 : cluster [DBG] pgmap v4924: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:21:16.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:21:15 smithi047 bash[22744]: cluster 2024-09-16T08:21:14.686281+0000 mgr.a (mgr.14373) 7100 : cluster [DBG] pgmap v4924: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:21:16.479 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:21:16.479 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:21:16.480 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:21:17.225 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:21:17.225 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:21:17.225 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:21:17.225 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:21:17.225 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:21:18.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:21:17 smithi157 bash[24585]: cluster 2024-09-16T08:21:16.688111+0000 mgr.a (mgr.14373) 7101 : cluster [DBG] pgmap v4925: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:21:18.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:21:17 smithi157 bash[24585]: audit 2024-09-16T08:21:16.817648+0000 mgr.a (mgr.14373) 7102 : audit [DBG] from='client.160998 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:21:18.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:21:17 smithi086 bash[24289]: cluster 2024-09-16T08:21:16.688111+0000 mgr.a (mgr.14373) 7101 : cluster [DBG] pgmap v4925: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:21:18.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:21:17 smithi086 bash[24289]: audit 2024-09-16T08:21:16.817648+0000 mgr.a (mgr.14373) 7102 : audit [DBG] from='client.160998 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:21:18.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:21:17 smithi047 bash[22744]: cluster 2024-09-16T08:21:16.688111+0000 mgr.a (mgr.14373) 7101 : cluster [DBG] pgmap v4925: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:21:18.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:21:17 smithi047 bash[22744]: audit 2024-09-16T08:21:16.817648+0000 mgr.a (mgr.14373) 7102 : audit [DBG] from='client.160998 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:21:20.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:21:19 smithi086 bash[24289]: cluster 2024-09-16T08:21:18.688998+0000 mgr.a (mgr.14373) 7103 : cluster [DBG] pgmap v4926: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:21:20.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:21:19 smithi047 bash[22744]: cluster 2024-09-16T08:21:18.688998+0000 mgr.a (mgr.14373) 7103 : cluster [DBG] pgmap v4926: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:21:20.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:21:19 smithi157 bash[24585]: cluster 2024-09-16T08:21:18.688998+0000 mgr.a (mgr.14373) 7103 : cluster [DBG] pgmap v4926: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:21:22.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:21:21 smithi086 bash[24289]: cluster 2024-09-16T08:21:20.689813+0000 mgr.a (mgr.14373) 7104 : cluster [DBG] pgmap v4927: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T08:21:22.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:21:21 smithi047 bash[22744]: cluster 2024-09-16T08:21:20.689813+0000 mgr.a (mgr.14373) 7104 : cluster [DBG] pgmap v4927: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T08:21:22.226 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:21:22.227 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:21:22.227 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:21:22.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:21:21 smithi157 bash[24585]: cluster 2024-09-16T08:21:20.689813+0000 mgr.a (mgr.14373) 7104 : cluster [DBG] pgmap v4927: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T08:21:22.979 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:21:22.980 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:21:22.980 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:21:22.980 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:21:22.980 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:21:24.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:21:23 smithi086 bash[24289]: audit 2024-09-16T08:21:22.562306+0000 mgr.a (mgr.14373) 7105 : audit [DBG] from='client.161076 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:21:24.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:21:23 smithi086 bash[24289]: cluster 2024-09-16T08:21:22.699274+0000 mgr.a (mgr.14373) 7106 : cluster [DBG] pgmap v4928: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:21:24.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:21:23 smithi086 bash[24289]: audit 2024-09-16T08:21:23.267304+0000 mon.b (mon.2) 674 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T08:21:24.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:21:23 smithi047 bash[22744]: audit 2024-09-16T08:21:22.562306+0000 mgr.a (mgr.14373) 7105 : audit [DBG] from='client.161076 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:21:24.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:21:23 smithi047 bash[22744]: cluster 2024-09-16T08:21:22.699274+0000 mgr.a (mgr.14373) 7106 : cluster [DBG] pgmap v4928: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:21:24.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:21:23 smithi047 bash[22744]: audit 2024-09-16T08:21:23.267304+0000 mon.b (mon.2) 674 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T08:21:24.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:21:23 smithi157 bash[24585]: audit 2024-09-16T08:21:22.562306+0000 mgr.a (mgr.14373) 7105 : audit [DBG] from='client.161076 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:21:24.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:21:23 smithi157 bash[24585]: cluster 2024-09-16T08:21:22.699274+0000 mgr.a (mgr.14373) 7106 : cluster [DBG] pgmap v4928: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:21:24.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:21:23 smithi157 bash[24585]: audit 2024-09-16T08:21:23.267304+0000 mon.b (mon.2) 674 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T08:21:25.276 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:21:24 smithi047 bash[22744]: audit 2024-09-16T08:21:23.878299+0000 mon.a (mon.0) 993 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:21:25.276 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:21:24 smithi047 bash[22744]: audit 2024-09-16T08:21:23.881838+0000 mon.a (mon.0) 994 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:21:25.276 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:21:24 smithi047 bash[22744]: audit 2024-09-16T08:21:23.886490+0000 mon.a (mon.0) 995 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:21:25.276 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:21:24 smithi047 bash[22744]: audit 2024-09-16T08:21:23.890337+0000 mon.a (mon.0) 996 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:21:25.276 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:21:24 smithi047 bash[22744]: audit 2024-09-16T08:21:24.535887+0000 mon.b (mon.2) 675 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T08:21:25.276 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:21:24 smithi047 bash[22744]: audit 2024-09-16T08:21:24.538230+0000 mon.b (mon.2) 676 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T08:21:25.277 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:21:24 smithi047 bash[22744]: audit 2024-09-16T08:21:24.551130+0000 mon.a (mon.0) 997 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:21:25.277 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:21:24 smithi047 bash[22744]: audit 2024-09-16T08:21:24.555899+0000 mon.b (mon.2) 677 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:21:25.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:21:24 smithi157 bash[24585]: audit 2024-09-16T08:21:23.878299+0000 mon.a (mon.0) 993 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:21:25.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:21:24 smithi157 bash[24585]: audit 2024-09-16T08:21:23.881838+0000 mon.a (mon.0) 994 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:21:25.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:21:24 smithi157 bash[24585]: audit 2024-09-16T08:21:23.886490+0000 mon.a (mon.0) 995 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:21:25.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:21:24 smithi157 bash[24585]: audit 2024-09-16T08:21:23.890337+0000 mon.a (mon.0) 996 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:21:25.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:21:24 smithi157 bash[24585]: audit 2024-09-16T08:21:24.535887+0000 mon.b (mon.2) 675 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T08:21:25.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:21:24 smithi157 bash[24585]: audit 2024-09-16T08:21:24.538230+0000 mon.b (mon.2) 676 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T08:21:25.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:21:24 smithi157 bash[24585]: audit 2024-09-16T08:21:24.551130+0000 mon.a (mon.0) 997 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:21:25.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:21:24 smithi157 bash[24585]: audit 2024-09-16T08:21:24.555899+0000 mon.b (mon.2) 677 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:21:25.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:21:24 smithi086 bash[24289]: audit 2024-09-16T08:21:23.878299+0000 mon.a (mon.0) 993 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:21:25.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:21:24 smithi086 bash[24289]: audit 2024-09-16T08:21:23.881838+0000 mon.a (mon.0) 994 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:21:25.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:21:24 smithi086 bash[24289]: audit 2024-09-16T08:21:23.886490+0000 mon.a (mon.0) 995 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:21:25.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:21:24 smithi086 bash[24289]: audit 2024-09-16T08:21:23.890337+0000 mon.a (mon.0) 996 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:21:25.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:21:24 smithi086 bash[24289]: audit 2024-09-16T08:21:24.535887+0000 mon.b (mon.2) 675 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T08:21:25.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:21:24 smithi086 bash[24289]: audit 2024-09-16T08:21:24.538230+0000 mon.b (mon.2) 676 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T08:21:25.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:21:24 smithi086 bash[24289]: audit 2024-09-16T08:21:24.551130+0000 mon.a (mon.0) 997 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:21:25.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:21:24 smithi086 bash[24289]: audit 2024-09-16T08:21:24.555899+0000 mon.b (mon.2) 677 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:21:25.588 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 08:21:25 smithi047 bash[22994]: debug 2024-09-16T08:21:25.275+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T08:21:25.588 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 08:21:25 smithi047 bash[22994]: debug 2024-09-16T08:21:25.275+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T08:21:26.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:21:25 smithi157 bash[24585]: audit 2024-09-16T08:21:24.559690+0000 mgr.a (mgr.14373) 7107 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:21:26.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:21:25 smithi157 bash[24585]: cluster 2024-09-16T08:21:24.699812+0000 mgr.a (mgr.14373) 7108 : cluster [DBG] pgmap v4929: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:21:26.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:21:25 smithi157 bash[24585]: audit 2024-09-16T08:21:25.279320+0000 mgr.a (mgr.14373) 7109 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T08:21:26.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:21:25 smithi157 bash[24585]: cephadm 2024-09-16T08:21:25.281253+0000 mgr.a (mgr.14373) 7110 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T08:21:26.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:21:25 smithi086 bash[24289]: audit 2024-09-16T08:21:24.559690+0000 mgr.a (mgr.14373) 7107 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:21:26.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:21:25 smithi086 bash[24289]: cluster 2024-09-16T08:21:24.699812+0000 mgr.a (mgr.14373) 7108 : cluster [DBG] pgmap v4929: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:21:26.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:21:25 smithi086 bash[24289]: audit 2024-09-16T08:21:25.279320+0000 mgr.a (mgr.14373) 7109 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T08:21:26.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:21:25 smithi086 bash[24289]: cephadm 2024-09-16T08:21:25.281253+0000 mgr.a (mgr.14373) 7110 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T08:21:26.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:21:25 smithi047 bash[22744]: audit 2024-09-16T08:21:24.559690+0000 mgr.a (mgr.14373) 7107 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:21:26.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:21:25 smithi047 bash[22744]: cluster 2024-09-16T08:21:24.699812+0000 mgr.a (mgr.14373) 7108 : cluster [DBG] pgmap v4929: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:21:26.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:21:25 smithi047 bash[22744]: audit 2024-09-16T08:21:25.279320+0000 mgr.a (mgr.14373) 7109 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T08:21:26.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:21:25 smithi047 bash[22744]: cephadm 2024-09-16T08:21:25.281253+0000 mgr.a (mgr.14373) 7110 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T08:21:27.985 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:21:27.985 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:21:27.985 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:21:28.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:21:27 smithi157 bash[24585]: cluster 2024-09-16T08:21:26.702036+0000 mgr.a (mgr.14373) 7111 : cluster [DBG] pgmap v4930: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:21:28.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:21:27 smithi086 bash[24289]: cluster 2024-09-16T08:21:26.702036+0000 mgr.a (mgr.14373) 7111 : cluster [DBG] pgmap v4930: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:21:28.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:21:27 smithi047 bash[22744]: cluster 2024-09-16T08:21:26.702036+0000 mgr.a (mgr.14373) 7111 : cluster [DBG] pgmap v4930: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:21:28.729 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:21:28.730 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:21:28.730 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:21:28.730 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:21:28.730 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:21:29.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:21:28 smithi157 bash[24585]: audit 2024-09-16T08:21:28.314170+0000 mgr.a (mgr.14373) 7112 : audit [DBG] from='client.161256 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:21:29.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:21:28 smithi086 bash[24289]: audit 2024-09-16T08:21:28.314170+0000 mgr.a (mgr.14373) 7112 : audit [DBG] from='client.161256 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:21:29.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:21:28 smithi047 bash[22744]: audit 2024-09-16T08:21:28.314170+0000 mgr.a (mgr.14373) 7112 : audit [DBG] from='client.161256 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:21:30.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:21:29 smithi157 bash[24585]: cluster 2024-09-16T08:21:28.702559+0000 mgr.a (mgr.14373) 7113 : cluster [DBG] pgmap v4931: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:21:30.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:21:29 smithi086 bash[24289]: cluster 2024-09-16T08:21:28.702559+0000 mgr.a (mgr.14373) 7113 : cluster [DBG] pgmap v4931: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:21:30.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:21:29 smithi047 bash[22744]: cluster 2024-09-16T08:21:28.702559+0000 mgr.a (mgr.14373) 7113 : cluster [DBG] pgmap v4931: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:21:32.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:21:31 smithi157 bash[24585]: cluster 2024-09-16T08:21:30.703297+0000 mgr.a (mgr.14373) 7114 : cluster [DBG] pgmap v4932: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:21:32.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:21:31 smithi086 bash[24289]: cluster 2024-09-16T08:21:30.703297+0000 mgr.a (mgr.14373) 7114 : cluster [DBG] pgmap v4932: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:21:32.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:21:31 smithi047 bash[22744]: cluster 2024-09-16T08:21:30.703297+0000 mgr.a (mgr.14373) 7114 : cluster [DBG] pgmap v4932: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:21:33.731 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:21:33.732 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:21:33.732 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:21:34.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:21:33 smithi157 bash[24585]: cluster 2024-09-16T08:21:32.705540+0000 mgr.a (mgr.14373) 7115 : cluster [DBG] pgmap v4933: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:21:34.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:21:33 smithi086 bash[24289]: cluster 2024-09-16T08:21:32.705540+0000 mgr.a (mgr.14373) 7115 : cluster [DBG] pgmap v4933: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:21:34.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:21:33 smithi047 bash[22744]: cluster 2024-09-16T08:21:32.705540+0000 mgr.a (mgr.14373) 7115 : cluster [DBG] pgmap v4933: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:21:34.472 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:21:34.472 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:21:34.472 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:21:34.472 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:21:34.472 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:21:35.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:21:34 smithi157 bash[24585]: audit 2024-09-16T08:21:34.063602+0000 mgr.a (mgr.14373) 7116 : audit [DBG] from='client.161334 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:21:35.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:21:34 smithi086 bash[24289]: audit 2024-09-16T08:21:34.063602+0000 mgr.a (mgr.14373) 7116 : audit [DBG] from='client.161334 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:21:35.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:21:34 smithi047 bash[22744]: audit 2024-09-16T08:21:34.063602+0000 mgr.a (mgr.14373) 7116 : audit [DBG] from='client.161334 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:21:36.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:21:35 smithi157 bash[24585]: cluster 2024-09-16T08:21:34.706399+0000 mgr.a (mgr.14373) 7117 : cluster [DBG] pgmap v4934: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:21:36.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:21:35 smithi086 bash[24289]: cluster 2024-09-16T08:21:34.706399+0000 mgr.a (mgr.14373) 7117 : cluster [DBG] pgmap v4934: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:21:36.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:21:35 smithi047 bash[22744]: cluster 2024-09-16T08:21:34.706399+0000 mgr.a (mgr.14373) 7117 : cluster [DBG] pgmap v4934: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:21:38.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:21:37 smithi157 bash[24585]: cluster 2024-09-16T08:21:36.708670+0000 mgr.a (mgr.14373) 7118 : cluster [DBG] pgmap v4935: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:21:38.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:21:37 smithi086 bash[24289]: cluster 2024-09-16T08:21:36.708670+0000 mgr.a (mgr.14373) 7118 : cluster [DBG] pgmap v4935: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:21:38.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:21:37 smithi047 bash[22744]: cluster 2024-09-16T08:21:36.708670+0000 mgr.a (mgr.14373) 7118 : cluster [DBG] pgmap v4935: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:21:39.473 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:21:39.474 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:21:39.474 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:21:40.237 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:21:40.238 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:21:40.238 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:21:40.238 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:21:40.238 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:21:40.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:21:39 smithi157 bash[24585]: cluster 2024-09-16T08:21:38.709448+0000 mgr.a (mgr.14373) 7119 : cluster [DBG] pgmap v4936: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:21:40.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:21:39 smithi086 bash[24289]: cluster 2024-09-16T08:21:38.709448+0000 mgr.a (mgr.14373) 7119 : cluster [DBG] pgmap v4936: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:21:40.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:21:39 smithi047 bash[22744]: cluster 2024-09-16T08:21:38.709448+0000 mgr.a (mgr.14373) 7119 : cluster [DBG] pgmap v4936: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:21:41.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:21:40 smithi157 bash[24585]: audit 2024-09-16T08:21:39.812613+0000 mgr.a (mgr.14373) 7120 : audit [DBG] from='client.161412 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:21:41.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:21:40 smithi086 bash[24289]: audit 2024-09-16T08:21:39.812613+0000 mgr.a (mgr.14373) 7120 : audit [DBG] from='client.161412 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:21:41.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:21:40 smithi047 bash[22744]: audit 2024-09-16T08:21:39.812613+0000 mgr.a (mgr.14373) 7120 : audit [DBG] from='client.161412 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:21:42.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:21:41 smithi157 bash[24585]: cluster 2024-09-16T08:21:40.710460+0000 mgr.a (mgr.14373) 7121 : cluster [DBG] pgmap v4937: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:21:42.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:21:41 smithi086 bash[24289]: cluster 2024-09-16T08:21:40.710460+0000 mgr.a (mgr.14373) 7121 : cluster [DBG] pgmap v4937: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:21:42.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:21:41 smithi047 bash[22744]: cluster 2024-09-16T08:21:40.710460+0000 mgr.a (mgr.14373) 7121 : cluster [DBG] pgmap v4937: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:21:44.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:21:43 smithi157 bash[24585]: cluster 2024-09-16T08:21:42.712717+0000 mgr.a (mgr.14373) 7122 : cluster [DBG] pgmap v4938: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:21:44.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:21:43 smithi086 bash[24289]: cluster 2024-09-16T08:21:42.712717+0000 mgr.a (mgr.14373) 7122 : cluster [DBG] pgmap v4938: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:21:44.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:21:43 smithi047 bash[22744]: cluster 2024-09-16T08:21:42.712717+0000 mgr.a (mgr.14373) 7122 : cluster [DBG] pgmap v4938: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:21:45.239 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:21:45.240 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:21:45.240 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:21:46.013 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:21:46.014 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:21:46.014 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:21:46.014 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:21:46.014 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:21:46.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:21:45 smithi157 bash[24585]: cluster 2024-09-16T08:21:44.713455+0000 mgr.a (mgr.14373) 7123 : cluster [DBG] pgmap v4939: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:21:46.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:21:45 smithi086 bash[24289]: cluster 2024-09-16T08:21:44.713455+0000 mgr.a (mgr.14373) 7123 : cluster [DBG] pgmap v4939: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:21:46.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:21:45 smithi047 bash[22744]: cluster 2024-09-16T08:21:44.713455+0000 mgr.a (mgr.14373) 7123 : cluster [DBG] pgmap v4939: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:21:47.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:21:46 smithi157 bash[24585]: audit 2024-09-16T08:21:45.581313+0000 mgr.a (mgr.14373) 7124 : audit [DBG] from='client.161490 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:21:47.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:21:46 smithi086 bash[24289]: audit 2024-09-16T08:21:45.581313+0000 mgr.a (mgr.14373) 7124 : audit [DBG] from='client.161490 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:21:47.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:21:46 smithi047 bash[22744]: audit 2024-09-16T08:21:45.581313+0000 mgr.a (mgr.14373) 7124 : audit [DBG] from='client.161490 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:21:48.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:21:47 smithi157 bash[24585]: cluster 2024-09-16T08:21:46.715695+0000 mgr.a (mgr.14373) 7125 : cluster [DBG] pgmap v4940: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:21:48.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:21:47 smithi086 bash[24289]: cluster 2024-09-16T08:21:46.715695+0000 mgr.a (mgr.14373) 7125 : cluster [DBG] pgmap v4940: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:21:48.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:21:47 smithi047 bash[22744]: cluster 2024-09-16T08:21:46.715695+0000 mgr.a (mgr.14373) 7125 : cluster [DBG] pgmap v4940: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:21:50.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:21:49 smithi157 bash[24585]: cluster 2024-09-16T08:21:48.716444+0000 mgr.a (mgr.14373) 7126 : cluster [DBG] pgmap v4941: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:21:50.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:21:49 smithi086 bash[24289]: cluster 2024-09-16T08:21:48.716444+0000 mgr.a (mgr.14373) 7126 : cluster [DBG] pgmap v4941: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:21:50.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:21:49 smithi047 bash[22744]: cluster 2024-09-16T08:21:48.716444+0000 mgr.a (mgr.14373) 7126 : cluster [DBG] pgmap v4941: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:21:51.015 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:21:51.015 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:21:51.016 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:21:51.802 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:21:51.802 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:21:51.802 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:21:51.802 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:21:51.802 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:21:52.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:21:51 smithi157 bash[24585]: cluster 2024-09-16T08:21:50.717183+0000 mgr.a (mgr.14373) 7127 : cluster [DBG] pgmap v4942: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:21:52.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:21:51 smithi157 bash[24585]: audit 2024-09-16T08:21:51.352876+0000 mgr.a (mgr.14373) 7128 : audit [DBG] from='client.161565 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:21:52.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:21:51 smithi086 bash[24289]: cluster 2024-09-16T08:21:50.717183+0000 mgr.a (mgr.14373) 7127 : cluster [DBG] pgmap v4942: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:21:52.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:21:51 smithi086 bash[24289]: audit 2024-09-16T08:21:51.352876+0000 mgr.a (mgr.14373) 7128 : audit [DBG] from='client.161565 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:21:52.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:21:51 smithi047 bash[22744]: cluster 2024-09-16T08:21:50.717183+0000 mgr.a (mgr.14373) 7127 : cluster [DBG] pgmap v4942: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:21:52.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:21:51 smithi047 bash[22744]: audit 2024-09-16T08:21:51.352876+0000 mgr.a (mgr.14373) 7128 : audit [DBG] from='client.161565 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:21:54.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:21:53 smithi157 bash[24585]: cluster 2024-09-16T08:21:52.719892+0000 mgr.a (mgr.14373) 7129 : cluster [DBG] pgmap v4943: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:21:54.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:21:53 smithi086 bash[24289]: cluster 2024-09-16T08:21:52.719892+0000 mgr.a (mgr.14373) 7129 : cluster [DBG] pgmap v4943: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:21:54.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:21:53 smithi047 bash[22744]: cluster 2024-09-16T08:21:52.719892+0000 mgr.a (mgr.14373) 7129 : cluster [DBG] pgmap v4943: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:21:56.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:21:55 smithi157 bash[24585]: cluster 2024-09-16T08:21:54.720654+0000 mgr.a (mgr.14373) 7130 : cluster [DBG] pgmap v4944: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:21:56.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:21:55 smithi086 bash[24289]: cluster 2024-09-16T08:21:54.720654+0000 mgr.a (mgr.14373) 7130 : cluster [DBG] pgmap v4944: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:21:56.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:21:55 smithi047 bash[22744]: cluster 2024-09-16T08:21:54.720654+0000 mgr.a (mgr.14373) 7130 : cluster [DBG] pgmap v4944: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:21:56.803 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:21:56.804 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:21:56.804 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:21:57.591 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:21:57.591 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:21:57.591 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:21:57.591 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:21:57.591 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:21:58.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:21:57 smithi157 bash[24585]: cluster 2024-09-16T08:21:56.722564+0000 mgr.a (mgr.14373) 7131 : cluster [DBG] pgmap v4945: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:21:58.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:21:57 smithi157 bash[24585]: audit 2024-09-16T08:21:57.143834+0000 mgr.a (mgr.14373) 7132 : audit [DBG] from='client.161643 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:21:58.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:21:57 smithi086 bash[24289]: cluster 2024-09-16T08:21:56.722564+0000 mgr.a (mgr.14373) 7131 : cluster [DBG] pgmap v4945: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:21:58.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:21:57 smithi086 bash[24289]: audit 2024-09-16T08:21:57.143834+0000 mgr.a (mgr.14373) 7132 : audit [DBG] from='client.161643 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:21:58.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:21:57 smithi047 bash[22744]: cluster 2024-09-16T08:21:56.722564+0000 mgr.a (mgr.14373) 7131 : cluster [DBG] pgmap v4945: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:21:58.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:21:57 smithi047 bash[22744]: audit 2024-09-16T08:21:57.143834+0000 mgr.a (mgr.14373) 7132 : audit [DBG] from='client.161643 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:22:00.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:21:59 smithi157 bash[24585]: cluster 2024-09-16T08:21:58.723448+0000 mgr.a (mgr.14373) 7133 : cluster [DBG] pgmap v4946: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:22:00.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:21:59 smithi086 bash[24289]: cluster 2024-09-16T08:21:58.723448+0000 mgr.a (mgr.14373) 7133 : cluster [DBG] pgmap v4946: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:22:00.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:21:59 smithi047 bash[22744]: cluster 2024-09-16T08:21:58.723448+0000 mgr.a (mgr.14373) 7133 : cluster [DBG] pgmap v4946: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:22:02.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:22:01 smithi157 bash[24585]: cluster 2024-09-16T08:22:00.724221+0000 mgr.a (mgr.14373) 7134 : cluster [DBG] pgmap v4947: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T08:22:02.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:22:01 smithi086 bash[24289]: cluster 2024-09-16T08:22:00.724221+0000 mgr.a (mgr.14373) 7134 : cluster [DBG] pgmap v4947: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T08:22:02.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:22:01 smithi047 bash[22744]: cluster 2024-09-16T08:22:00.724221+0000 mgr.a (mgr.14373) 7134 : cluster [DBG] pgmap v4947: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T08:22:02.593 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:22:02.593 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:22:02.594 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:22:03.361 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:22:03.361 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:22:03.361 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:22:03.361 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:22:03.361 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:22:04.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:22:03 smithi157 bash[24585]: cluster 2024-09-16T08:22:02.725778+0000 mgr.a (mgr.14373) 7135 : cluster [DBG] pgmap v4948: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:22:04.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:22:03 smithi157 bash[24585]: audit 2024-09-16T08:22:02.932051+0000 mgr.a (mgr.14373) 7136 : audit [DBG] from='client.161718 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:22:04.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:22:03 smithi086 bash[24289]: cluster 2024-09-16T08:22:02.725778+0000 mgr.a (mgr.14373) 7135 : cluster [DBG] pgmap v4948: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:22:04.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:22:03 smithi086 bash[24289]: audit 2024-09-16T08:22:02.932051+0000 mgr.a (mgr.14373) 7136 : audit [DBG] from='client.161718 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:22:04.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:22:03 smithi047 bash[22744]: cluster 2024-09-16T08:22:02.725778+0000 mgr.a (mgr.14373) 7135 : cluster [DBG] pgmap v4948: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:22:04.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:22:03 smithi047 bash[22744]: audit 2024-09-16T08:22:02.932051+0000 mgr.a (mgr.14373) 7136 : audit [DBG] from='client.161718 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:22:06.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:22:05 smithi157 bash[24585]: cluster 2024-09-16T08:22:04.726717+0000 mgr.a (mgr.14373) 7137 : cluster [DBG] pgmap v4949: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:22:06.316 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:22:05 smithi086 bash[24289]: cluster 2024-09-16T08:22:04.726717+0000 mgr.a (mgr.14373) 7137 : cluster [DBG] pgmap v4949: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:22:06.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:22:05 smithi047 bash[22744]: cluster 2024-09-16T08:22:04.726717+0000 mgr.a (mgr.14373) 7137 : cluster [DBG] pgmap v4949: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:22:08.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:22:07 smithi157 bash[24585]: cluster 2024-09-16T08:22:06.728856+0000 mgr.a (mgr.14373) 7138 : cluster [DBG] pgmap v4950: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:22:08.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:22:07 smithi086 bash[24289]: cluster 2024-09-16T08:22:06.728856+0000 mgr.a (mgr.14373) 7138 : cluster [DBG] pgmap v4950: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:22:08.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:22:07 smithi047 bash[22744]: cluster 2024-09-16T08:22:06.728856+0000 mgr.a (mgr.14373) 7138 : cluster [DBG] pgmap v4950: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:22:08.362 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:22:08.363 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:22:08.363 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:22:09.109 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:22:09.109 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:22:09.109 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:22:09.109 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:22:09.109 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:22:10.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:22:09 smithi157 bash[24585]: audit 2024-09-16T08:22:08.699842+0000 mgr.a (mgr.14373) 7139 : audit [DBG] from='client.161796 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:22:10.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:22:09 smithi157 bash[24585]: cluster 2024-09-16T08:22:08.729814+0000 mgr.a (mgr.14373) 7140 : cluster [DBG] pgmap v4951: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:22:10.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:22:09 smithi086 bash[24289]: audit 2024-09-16T08:22:08.699842+0000 mgr.a (mgr.14373) 7139 : audit [DBG] from='client.161796 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:22:10.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:22:09 smithi086 bash[24289]: cluster 2024-09-16T08:22:08.729814+0000 mgr.a (mgr.14373) 7140 : cluster [DBG] pgmap v4951: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:22:10.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:22:09 smithi047 bash[22744]: audit 2024-09-16T08:22:08.699842+0000 mgr.a (mgr.14373) 7139 : audit [DBG] from='client.161796 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:22:10.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:22:09 smithi047 bash[22744]: cluster 2024-09-16T08:22:08.729814+0000 mgr.a (mgr.14373) 7140 : cluster [DBG] pgmap v4951: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:22:12.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:22:12 smithi157 bash[24585]: cluster 2024-09-16T08:22:10.730822+0000 mgr.a (mgr.14373) 7141 : cluster [DBG] pgmap v4952: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:22:12.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:22:12 smithi086 bash[24289]: cluster 2024-09-16T08:22:10.730822+0000 mgr.a (mgr.14373) 7141 : cluster [DBG] pgmap v4952: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:22:12.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:22:12 smithi047 bash[22744]: cluster 2024-09-16T08:22:10.730822+0000 mgr.a (mgr.14373) 7141 : cluster [DBG] pgmap v4952: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:22:14.110 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:22:14.111 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:22:14.111 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:22:14.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:22:14 smithi157 bash[24585]: cluster 2024-09-16T08:22:12.733044+0000 mgr.a (mgr.14373) 7142 : cluster [DBG] pgmap v4953: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:22:14.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:22:14 smithi086 bash[24289]: cluster 2024-09-16T08:22:12.733044+0000 mgr.a (mgr.14373) 7142 : cluster [DBG] pgmap v4953: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:22:14.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:22:14 smithi047 bash[22744]: cluster 2024-09-16T08:22:12.733044+0000 mgr.a (mgr.14373) 7142 : cluster [DBG] pgmap v4953: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:22:14.851 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:22:14.851 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:22:14.851 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:22:14.851 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:22:14.851 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:22:15.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:22:15 smithi157 bash[24585]: audit 2024-09-16T08:22:14.447143+0000 mgr.a (mgr.14373) 7143 : audit [DBG] from='client.161871 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:22:15.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:22:15 smithi086 bash[24289]: audit 2024-09-16T08:22:14.447143+0000 mgr.a (mgr.14373) 7143 : audit [DBG] from='client.161871 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:22:15.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:22:15 smithi047 bash[22744]: audit 2024-09-16T08:22:14.447143+0000 mgr.a (mgr.14373) 7143 : audit [DBG] from='client.161871 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:22:16.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:22:16 smithi157 bash[24585]: cluster 2024-09-16T08:22:14.733556+0000 mgr.a (mgr.14373) 7144 : cluster [DBG] pgmap v4954: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:22:16.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:22:16 smithi086 bash[24289]: cluster 2024-09-16T08:22:14.733556+0000 mgr.a (mgr.14373) 7144 : cluster [DBG] pgmap v4954: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:22:16.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:22:16 smithi047 bash[22744]: cluster 2024-09-16T08:22:14.733556+0000 mgr.a (mgr.14373) 7144 : cluster [DBG] pgmap v4954: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:22:18.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:22:18 smithi157 bash[24585]: cluster 2024-09-16T08:22:16.735819+0000 mgr.a (mgr.14373) 7145 : cluster [DBG] pgmap v4955: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:22:18.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:22:18 smithi086 bash[24289]: cluster 2024-09-16T08:22:16.735819+0000 mgr.a (mgr.14373) 7145 : cluster [DBG] pgmap v4955: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:22:18.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:22:18 smithi047 bash[22744]: cluster 2024-09-16T08:22:16.735819+0000 mgr.a (mgr.14373) 7145 : cluster [DBG] pgmap v4955: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:22:19.852 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:22:19.853 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:22:19.853 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:22:20.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:22:20 smithi157 bash[24585]: cluster 2024-09-16T08:22:18.736608+0000 mgr.a (mgr.14373) 7146 : cluster [DBG] pgmap v4956: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:22:20.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:22:20 smithi086 bash[24289]: cluster 2024-09-16T08:22:18.736608+0000 mgr.a (mgr.14373) 7146 : cluster [DBG] pgmap v4956: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:22:20.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:22:20 smithi047 bash[22744]: cluster 2024-09-16T08:22:18.736608+0000 mgr.a (mgr.14373) 7146 : cluster [DBG] pgmap v4956: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:22:20.627 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:22:20.628 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:22:20.628 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:22:20.628 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:22:20.628 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:22:21.305 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:22:21 smithi157 bash[24585]: audit 2024-09-16T08:22:20.194126+0000 mgr.a (mgr.14373) 7147 : audit [DBG] from='client.161949 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:22:21.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:22:21 smithi086 bash[24289]: audit 2024-09-16T08:22:20.194126+0000 mgr.a (mgr.14373) 7147 : audit [DBG] from='client.161949 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:22:21.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:22:21 smithi047 bash[22744]: audit 2024-09-16T08:22:20.194126+0000 mgr.a (mgr.14373) 7147 : audit [DBG] from='client.161949 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:22:22.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:22:22 smithi157 bash[24585]: cluster 2024-09-16T08:22:20.737536+0000 mgr.a (mgr.14373) 7148 : cluster [DBG] pgmap v4957: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:22:22.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:22:22 smithi086 bash[24289]: cluster 2024-09-16T08:22:20.737536+0000 mgr.a (mgr.14373) 7148 : cluster [DBG] pgmap v4957: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:22:22.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:22:22 smithi047 bash[22744]: cluster 2024-09-16T08:22:20.737536+0000 mgr.a (mgr.14373) 7148 : cluster [DBG] pgmap v4957: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:22:24.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:22:24 smithi157 bash[24585]: cluster 2024-09-16T08:22:22.739834+0000 mgr.a (mgr.14373) 7149 : cluster [DBG] pgmap v4958: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:22:24.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:22:24 smithi086 bash[24289]: cluster 2024-09-16T08:22:22.739834+0000 mgr.a (mgr.14373) 7149 : cluster [DBG] pgmap v4958: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:22:24.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:22:24 smithi047 bash[22744]: cluster 2024-09-16T08:22:22.739834+0000 mgr.a (mgr.14373) 7149 : cluster [DBG] pgmap v4958: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:22:25.629 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:22:25.630 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:22:25.630 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:22:26.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:22:26 smithi157 bash[24585]: cluster 2024-09-16T08:22:24.740604+0000 mgr.a (mgr.14373) 7150 : cluster [DBG] pgmap v4959: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:22:26.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:22:26 smithi157 bash[24585]: audit 2024-09-16T08:22:25.330256+0000 mon.b (mon.2) 678 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T08:22:26.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:22:26 smithi086 bash[24289]: cluster 2024-09-16T08:22:24.740604+0000 mgr.a (mgr.14373) 7150 : cluster [DBG] pgmap v4959: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:22:26.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:22:26 smithi086 bash[24289]: audit 2024-09-16T08:22:25.330256+0000 mon.b (mon.2) 678 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T08:22:26.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:22:26 smithi047 bash[22744]: cluster 2024-09-16T08:22:24.740604+0000 mgr.a (mgr.14373) 7150 : cluster [DBG] pgmap v4959: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:22:26.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:22:26 smithi047 bash[22744]: audit 2024-09-16T08:22:25.330256+0000 mon.b (mon.2) 678 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T08:22:26.393 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:22:26.393 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:22:26.393 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:22:26.393 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:22:26.393 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:22:27.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:22:27 smithi157 bash[24585]: audit 2024-09-16T08:22:25.959590+0000 mgr.a (mgr.14373) 7151 : audit [DBG] from='client.162027 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:22:27.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:22:27 smithi157 bash[24585]: audit 2024-09-16T08:22:26.168591+0000 mon.b (mon.2) 679 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T08:22:27.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:22:27 smithi157 bash[24585]: audit 2024-09-16T08:22:26.170169+0000 mon.b (mon.2) 680 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T08:22:27.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:22:27 smithi157 bash[24585]: audit 2024-09-16T08:22:26.177735+0000 mon.a (mon.0) 998 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:22:27.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:22:27 smithi157 bash[24585]: audit 2024-09-16T08:22:26.183217+0000 mon.b (mon.2) 681 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:22:27.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:22:27 smithi157 bash[24585]: audit 2024-09-16T08:22:26.185520+0000 mgr.a (mgr.14373) 7152 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:22:27.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:22:27 smithi086 bash[24289]: audit 2024-09-16T08:22:25.959590+0000 mgr.a (mgr.14373) 7151 : audit [DBG] from='client.162027 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:22:27.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:22:27 smithi086 bash[24289]: audit 2024-09-16T08:22:26.168591+0000 mon.b (mon.2) 679 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T08:22:27.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:22:27 smithi086 bash[24289]: audit 2024-09-16T08:22:26.170169+0000 mon.b (mon.2) 680 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T08:22:27.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:22:27 smithi086 bash[24289]: audit 2024-09-16T08:22:26.177735+0000 mon.a (mon.0) 998 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:22:27.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:22:27 smithi086 bash[24289]: audit 2024-09-16T08:22:26.183217+0000 mon.b (mon.2) 681 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:22:27.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:22:27 smithi086 bash[24289]: audit 2024-09-16T08:22:26.185520+0000 mgr.a (mgr.14373) 7152 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:22:27.338 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 08:22:27 smithi047 bash[22994]: debug 2024-09-16T08:22:27.081+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T08:22:27.338 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 08:22:27 smithi047 bash[22994]: debug 2024-09-16T08:22:27.081+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T08:22:27.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:22:27 smithi047 bash[22744]: audit 2024-09-16T08:22:25.959590+0000 mgr.a (mgr.14373) 7151 : audit [DBG] from='client.162027 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:22:27.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:22:27 smithi047 bash[22744]: audit 2024-09-16T08:22:26.168591+0000 mon.b (mon.2) 679 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T08:22:27.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:22:27 smithi047 bash[22744]: audit 2024-09-16T08:22:26.170169+0000 mon.b (mon.2) 680 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T08:22:27.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:22:27 smithi047 bash[22744]: audit 2024-09-16T08:22:26.177735+0000 mon.a (mon.0) 998 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:22:27.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:22:27 smithi047 bash[22744]: audit 2024-09-16T08:22:26.183217+0000 mon.b (mon.2) 681 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:22:27.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:22:27 smithi047 bash[22744]: audit 2024-09-16T08:22:26.185520+0000 mgr.a (mgr.14373) 7152 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:22:28.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:22:28 smithi157 bash[24585]: cluster 2024-09-16T08:22:26.741919+0000 mgr.a (mgr.14373) 7153 : cluster [DBG] pgmap v4960: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 3.2 KiB/s rd, 2 op/s 2024-09-16T08:22:28.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:22:28 smithi157 bash[24585]: audit 2024-09-16T08:22:27.083587+0000 mgr.a (mgr.14373) 7154 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T08:22:28.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:22:28 smithi157 bash[24585]: cephadm 2024-09-16T08:22:27.085416+0000 mgr.a (mgr.14373) 7155 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T08:22:28.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:22:28 smithi086 bash[24289]: cluster 2024-09-16T08:22:26.741919+0000 mgr.a (mgr.14373) 7153 : cluster [DBG] pgmap v4960: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 3.2 KiB/s rd, 2 op/s 2024-09-16T08:22:28.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:22:28 smithi086 bash[24289]: audit 2024-09-16T08:22:27.083587+0000 mgr.a (mgr.14373) 7154 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T08:22:28.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:22:28 smithi086 bash[24289]: cephadm 2024-09-16T08:22:27.085416+0000 mgr.a (mgr.14373) 7155 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T08:22:28.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:22:28 smithi047 bash[22744]: cluster 2024-09-16T08:22:26.741919+0000 mgr.a (mgr.14373) 7153 : cluster [DBG] pgmap v4960: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 3.2 KiB/s rd, 2 op/s 2024-09-16T08:22:28.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:22:28 smithi047 bash[22744]: audit 2024-09-16T08:22:27.083587+0000 mgr.a (mgr.14373) 7154 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T08:22:28.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:22:28 smithi047 bash[22744]: cephadm 2024-09-16T08:22:27.085416+0000 mgr.a (mgr.14373) 7155 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T08:22:30.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:22:30 smithi157 bash[24585]: cluster 2024-09-16T08:22:28.742821+0000 mgr.a (mgr.14373) 7156 : cluster [DBG] pgmap v4961: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-16T08:22:30.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:22:30 smithi086 bash[24289]: cluster 2024-09-16T08:22:28.742821+0000 mgr.a (mgr.14373) 7156 : cluster [DBG] pgmap v4961: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-16T08:22:30.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:22:30 smithi047 bash[22744]: cluster 2024-09-16T08:22:28.742821+0000 mgr.a (mgr.14373) 7156 : cluster [DBG] pgmap v4961: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-16T08:22:31.395 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:22:31.395 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:22:31.395 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:22:32.162 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:22:32.162 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:22:32.162 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:22:32.162 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:22:32.162 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:22:32.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:22:32 smithi157 bash[24585]: cluster 2024-09-16T08:22:30.743592+0000 mgr.a (mgr.14373) 7157 : cluster [DBG] pgmap v4962: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-16T08:22:32.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:22:32 smithi086 bash[24289]: cluster 2024-09-16T08:22:30.743592+0000 mgr.a (mgr.14373) 7157 : cluster [DBG] pgmap v4962: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-16T08:22:32.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:22:32 smithi047 bash[22744]: cluster 2024-09-16T08:22:30.743592+0000 mgr.a (mgr.14373) 7157 : cluster [DBG] pgmap v4962: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-16T08:22:33.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:22:33 smithi157 bash[24585]: audit 2024-09-16T08:22:31.728246+0000 mgr.a (mgr.14373) 7158 : audit [DBG] from='client.162210 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:22:33.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:22:33 smithi086 bash[24289]: audit 2024-09-16T08:22:31.728246+0000 mgr.a (mgr.14373) 7158 : audit [DBG] from='client.162210 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:22:33.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:22:33 smithi047 bash[22744]: audit 2024-09-16T08:22:31.728246+0000 mgr.a (mgr.14373) 7158 : audit [DBG] from='client.162210 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:22:34.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:22:34 smithi157 bash[24585]: cluster 2024-09-16T08:22:32.746417+0000 mgr.a (mgr.14373) 7159 : cluster [DBG] pgmap v4963: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:22:34.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:22:34 smithi086 bash[24289]: cluster 2024-09-16T08:22:32.746417+0000 mgr.a (mgr.14373) 7159 : cluster [DBG] pgmap v4963: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:22:34.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:22:34 smithi047 bash[22744]: cluster 2024-09-16T08:22:32.746417+0000 mgr.a (mgr.14373) 7159 : cluster [DBG] pgmap v4963: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:22:36.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:22:36 smithi157 bash[24585]: cluster 2024-09-16T08:22:34.747246+0000 mgr.a (mgr.14373) 7160 : cluster [DBG] pgmap v4964: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T08:22:36.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:22:36 smithi086 bash[24289]: cluster 2024-09-16T08:22:34.747246+0000 mgr.a (mgr.14373) 7160 : cluster [DBG] pgmap v4964: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T08:22:36.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:22:36 smithi047 bash[22744]: cluster 2024-09-16T08:22:34.747246+0000 mgr.a (mgr.14373) 7160 : cluster [DBG] pgmap v4964: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T08:22:37.163 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:22:37.164 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:22:37.164 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:22:37.936 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:22:37.937 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:22:37.937 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:22:37.937 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:22:37.937 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:22:38.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:22:38 smithi157 bash[24585]: cluster 2024-09-16T08:22:36.749157+0000 mgr.a (mgr.14373) 7161 : cluster [DBG] pgmap v4965: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:22:38.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:22:38 smithi157 bash[24585]: audit 2024-09-16T08:22:37.501954+0000 mgr.a (mgr.14373) 7162 : audit [DBG] from='client.162282 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:22:38.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:22:38 smithi086 bash[24289]: cluster 2024-09-16T08:22:36.749157+0000 mgr.a (mgr.14373) 7161 : cluster [DBG] pgmap v4965: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:22:38.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:22:38 smithi086 bash[24289]: audit 2024-09-16T08:22:37.501954+0000 mgr.a (mgr.14373) 7162 : audit [DBG] from='client.162282 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:22:38.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:22:38 smithi047 bash[22744]: cluster 2024-09-16T08:22:36.749157+0000 mgr.a (mgr.14373) 7161 : cluster [DBG] pgmap v4965: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:22:38.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:22:38 smithi047 bash[22744]: audit 2024-09-16T08:22:37.501954+0000 mgr.a (mgr.14373) 7162 : audit [DBG] from='client.162282 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:22:40.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:22:40 smithi157 bash[24585]: cluster 2024-09-16T08:22:38.750136+0000 mgr.a (mgr.14373) 7163 : cluster [DBG] pgmap v4966: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 5.7 KiB/s rd, 426 B/s wr, 5 op/s 2024-09-16T08:22:40.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:22:40 smithi086 bash[24289]: cluster 2024-09-16T08:22:38.750136+0000 mgr.a (mgr.14373) 7163 : cluster [DBG] pgmap v4966: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 5.7 KiB/s rd, 426 B/s wr, 5 op/s 2024-09-16T08:22:40.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:22:40 smithi047 bash[22744]: cluster 2024-09-16T08:22:38.750136+0000 mgr.a (mgr.14373) 7163 : cluster [DBG] pgmap v4966: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 5.7 KiB/s rd, 426 B/s wr, 5 op/s 2024-09-16T08:22:42.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:22:42 smithi157 bash[24585]: cluster 2024-09-16T08:22:40.750936+0000 mgr.a (mgr.14373) 7164 : cluster [DBG] pgmap v4967: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 5.7 KiB/s rd, 426 B/s wr, 5 op/s 2024-09-16T08:22:42.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:22:42 smithi086 bash[24289]: cluster 2024-09-16T08:22:40.750936+0000 mgr.a (mgr.14373) 7164 : cluster [DBG] pgmap v4967: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 5.7 KiB/s rd, 426 B/s wr, 5 op/s 2024-09-16T08:22:42.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:22:42 smithi047 bash[22744]: cluster 2024-09-16T08:22:40.750936+0000 mgr.a (mgr.14373) 7164 : cluster [DBG] pgmap v4967: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 5.7 KiB/s rd, 426 B/s wr, 5 op/s 2024-09-16T08:22:42.938 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:22:42.938 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:22:42.939 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:22:43.701 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:22:43.701 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:22:43.701 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:22:43.701 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:22:43.702 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:22:44.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:22:44 smithi157 bash[24585]: cluster 2024-09-16T08:22:42.753107+0000 mgr.a (mgr.14373) 7165 : cluster [DBG] pgmap v4968: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T08:22:44.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:22:44 smithi157 bash[24585]: audit 2024-09-16T08:22:43.279235+0000 mgr.a (mgr.14373) 7166 : audit [DBG] from='client.162354 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:22:44.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:22:44 smithi086 bash[24289]: cluster 2024-09-16T08:22:42.753107+0000 mgr.a (mgr.14373) 7165 : cluster [DBG] pgmap v4968: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T08:22:44.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:22:44 smithi086 bash[24289]: audit 2024-09-16T08:22:43.279235+0000 mgr.a (mgr.14373) 7166 : audit [DBG] from='client.162354 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:22:44.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:22:44 smithi047 bash[22744]: cluster 2024-09-16T08:22:42.753107+0000 mgr.a (mgr.14373) 7165 : cluster [DBG] pgmap v4968: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T08:22:44.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:22:44 smithi047 bash[22744]: audit 2024-09-16T08:22:43.279235+0000 mgr.a (mgr.14373) 7166 : audit [DBG] from='client.162354 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:22:46.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:22:46 smithi157 bash[24585]: cluster 2024-09-16T08:22:44.754052+0000 mgr.a (mgr.14373) 7167 : cluster [DBG] pgmap v4969: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:22:46.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:22:46 smithi086 bash[24289]: cluster 2024-09-16T08:22:44.754052+0000 mgr.a (mgr.14373) 7167 : cluster [DBG] pgmap v4969: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:22:46.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:22:46 smithi047 bash[22744]: cluster 2024-09-16T08:22:44.754052+0000 mgr.a (mgr.14373) 7167 : cluster [DBG] pgmap v4969: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:22:48.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:22:48 smithi157 bash[24585]: cluster 2024-09-16T08:22:46.756197+0000 mgr.a (mgr.14373) 7168 : cluster [DBG] pgmap v4970: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:22:48.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:22:48 smithi086 bash[24289]: cluster 2024-09-16T08:22:46.756197+0000 mgr.a (mgr.14373) 7168 : cluster [DBG] pgmap v4970: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:22:48.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:22:48 smithi047 bash[22744]: cluster 2024-09-16T08:22:46.756197+0000 mgr.a (mgr.14373) 7168 : cluster [DBG] pgmap v4970: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:22:48.702 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:22:48.763 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:22:48.763 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:22:49.495 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:22:49.496 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:22:49.496 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:22:49.496 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:22:49.496 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:22:50.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:22:50 smithi157 bash[24585]: cluster 2024-09-16T08:22:48.756824+0000 mgr.a (mgr.14373) 7169 : cluster [DBG] pgmap v4971: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:22:50.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:22:50 smithi157 bash[24585]: audit 2024-09-16T08:22:49.041550+0000 mgr.a (mgr.14373) 7170 : audit [DBG] from='client.162429 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:22:50.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:22:50 smithi086 bash[24289]: cluster 2024-09-16T08:22:48.756824+0000 mgr.a (mgr.14373) 7169 : cluster [DBG] pgmap v4971: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:22:50.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:22:50 smithi086 bash[24289]: audit 2024-09-16T08:22:49.041550+0000 mgr.a (mgr.14373) 7170 : audit [DBG] from='client.162429 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:22:50.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:22:50 smithi047 bash[22744]: cluster 2024-09-16T08:22:48.756824+0000 mgr.a (mgr.14373) 7169 : cluster [DBG] pgmap v4971: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:22:50.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:22:50 smithi047 bash[22744]: audit 2024-09-16T08:22:49.041550+0000 mgr.a (mgr.14373) 7170 : audit [DBG] from='client.162429 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:22:52.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:22:52 smithi157 bash[24585]: cluster 2024-09-16T08:22:50.757751+0000 mgr.a (mgr.14373) 7171 : cluster [DBG] pgmap v4972: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:22:52.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:22:52 smithi086 bash[24289]: cluster 2024-09-16T08:22:50.757751+0000 mgr.a (mgr.14373) 7171 : cluster [DBG] pgmap v4972: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:22:52.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:22:52 smithi047 bash[22744]: cluster 2024-09-16T08:22:50.757751+0000 mgr.a (mgr.14373) 7171 : cluster [DBG] pgmap v4972: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:22:54.497 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:22:54.498 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:22:54.498 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:22:54.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:22:54 smithi157 bash[24585]: cluster 2024-09-16T08:22:52.760062+0000 mgr.a (mgr.14373) 7172 : cluster [DBG] pgmap v4973: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:22:54.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:22:54 smithi086 bash[24289]: cluster 2024-09-16T08:22:52.760062+0000 mgr.a (mgr.14373) 7172 : cluster [DBG] pgmap v4973: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:22:54.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:22:54 smithi047 bash[22744]: cluster 2024-09-16T08:22:52.760062+0000 mgr.a (mgr.14373) 7172 : cluster [DBG] pgmap v4973: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:22:55.245 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:22:55.246 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:22:55.246 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:22:55.246 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:22:55.246 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:22:56.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:22:56 smithi157 bash[24585]: cluster 2024-09-16T08:22:54.760805+0000 mgr.a (mgr.14373) 7173 : cluster [DBG] pgmap v4974: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:22:56.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:22:56 smithi157 bash[24585]: audit 2024-09-16T08:22:54.834422+0000 mgr.a (mgr.14373) 7174 : audit [DBG] from='client.162504 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:22:56.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:22:56 smithi086 bash[24289]: cluster 2024-09-16T08:22:54.760805+0000 mgr.a (mgr.14373) 7173 : cluster [DBG] pgmap v4974: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:22:56.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:22:56 smithi086 bash[24289]: audit 2024-09-16T08:22:54.834422+0000 mgr.a (mgr.14373) 7174 : audit [DBG] from='client.162504 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:22:56.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:22:56 smithi047 bash[22744]: cluster 2024-09-16T08:22:54.760805+0000 mgr.a (mgr.14373) 7173 : cluster [DBG] pgmap v4974: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:22:56.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:22:56 smithi047 bash[22744]: audit 2024-09-16T08:22:54.834422+0000 mgr.a (mgr.14373) 7174 : audit [DBG] from='client.162504 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:22:58.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:22:58 smithi157 bash[24585]: cluster 2024-09-16T08:22:56.763146+0000 mgr.a (mgr.14373) 7175 : cluster [DBG] pgmap v4975: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:22:58.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:22:58 smithi086 bash[24289]: cluster 2024-09-16T08:22:56.763146+0000 mgr.a (mgr.14373) 7175 : cluster [DBG] pgmap v4975: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:22:58.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:22:58 smithi047 bash[22744]: cluster 2024-09-16T08:22:56.763146+0000 mgr.a (mgr.14373) 7175 : cluster [DBG] pgmap v4975: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:23:00.247 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:23:00.248 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:23:00.248 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:23:00.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:23:00 smithi157 bash[24585]: cluster 2024-09-16T08:22:58.763904+0000 mgr.a (mgr.14373) 7176 : cluster [DBG] pgmap v4976: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:23:00.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:23:00 smithi086 bash[24289]: cluster 2024-09-16T08:22:58.763904+0000 mgr.a (mgr.14373) 7176 : cluster [DBG] pgmap v4976: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:23:00.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:23:00 smithi047 bash[22744]: cluster 2024-09-16T08:22:58.763904+0000 mgr.a (mgr.14373) 7176 : cluster [DBG] pgmap v4976: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:23:01.009 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:23:01.009 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:23:01.009 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:23:01.009 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:23:01.010 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:23:02.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:23:02 smithi157 bash[24585]: audit 2024-09-16T08:23:00.586371+0000 mgr.a (mgr.14373) 7177 : audit [DBG] from='client.162579 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:23:02.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:23:02 smithi157 bash[24585]: cluster 2024-09-16T08:23:00.764531+0000 mgr.a (mgr.14373) 7178 : cluster [DBG] pgmap v4977: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:23:02.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:23:02 smithi086 bash[24289]: audit 2024-09-16T08:23:00.586371+0000 mgr.a (mgr.14373) 7177 : audit [DBG] from='client.162579 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:23:02.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:23:02 smithi086 bash[24289]: cluster 2024-09-16T08:23:00.764531+0000 mgr.a (mgr.14373) 7178 : cluster [DBG] pgmap v4977: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:23:02.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:23:02 smithi047 bash[22744]: audit 2024-09-16T08:23:00.586371+0000 mgr.a (mgr.14373) 7177 : audit [DBG] from='client.162579 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:23:02.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:23:02 smithi047 bash[22744]: cluster 2024-09-16T08:23:00.764531+0000 mgr.a (mgr.14373) 7178 : cluster [DBG] pgmap v4977: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:23:04.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:23:04 smithi157 bash[24585]: cluster 2024-09-16T08:23:02.766887+0000 mgr.a (mgr.14373) 7179 : cluster [DBG] pgmap v4978: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:23:04.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:23:04 smithi086 bash[24289]: cluster 2024-09-16T08:23:02.766887+0000 mgr.a (mgr.14373) 7179 : cluster [DBG] pgmap v4978: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:23:04.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:23:04 smithi047 bash[22744]: cluster 2024-09-16T08:23:02.766887+0000 mgr.a (mgr.14373) 7179 : cluster [DBG] pgmap v4978: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:23:06.010 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:23:06.011 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:23:06.011 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:23:06.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:23:06 smithi157 bash[24585]: cluster 2024-09-16T08:23:04.767661+0000 mgr.a (mgr.14373) 7180 : cluster [DBG] pgmap v4979: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:23:06.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:23:06 smithi086 bash[24289]: cluster 2024-09-16T08:23:04.767661+0000 mgr.a (mgr.14373) 7180 : cluster [DBG] pgmap v4979: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:23:06.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:23:06 smithi047 bash[22744]: cluster 2024-09-16T08:23:04.767661+0000 mgr.a (mgr.14373) 7180 : cluster [DBG] pgmap v4979: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:23:06.782 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:23:06.783 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:23:06.783 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:23:06.783 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:23:06.783 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:23:07.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:23:07 smithi157 bash[24585]: audit 2024-09-16T08:23:06.357456+0000 mgr.a (mgr.14373) 7181 : audit [DBG] from='client.162654 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:23:07.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:23:07 smithi086 bash[24289]: audit 2024-09-16T08:23:06.357456+0000 mgr.a (mgr.14373) 7181 : audit [DBG] from='client.162654 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:23:07.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:23:07 smithi047 bash[22744]: audit 2024-09-16T08:23:06.357456+0000 mgr.a (mgr.14373) 7181 : audit [DBG] from='client.162654 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:23:08.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:23:08 smithi157 bash[24585]: cluster 2024-09-16T08:23:06.768831+0000 mgr.a (mgr.14373) 7182 : cluster [DBG] pgmap v4980: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:23:08.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:23:08 smithi086 bash[24289]: cluster 2024-09-16T08:23:06.768831+0000 mgr.a (mgr.14373) 7182 : cluster [DBG] pgmap v4980: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:23:08.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:23:08 smithi047 bash[22744]: cluster 2024-09-16T08:23:06.768831+0000 mgr.a (mgr.14373) 7182 : cluster [DBG] pgmap v4980: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:23:10.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:23:09 smithi157 bash[24585]: cluster 2024-09-16T08:23:08.769563+0000 mgr.a (mgr.14373) 7183 : cluster [DBG] pgmap v4981: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T08:23:10.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:23:09 smithi086 bash[24289]: cluster 2024-09-16T08:23:08.769563+0000 mgr.a (mgr.14373) 7183 : cluster [DBG] pgmap v4981: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T08:23:10.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:23:09 smithi047 bash[22744]: cluster 2024-09-16T08:23:08.769563+0000 mgr.a (mgr.14373) 7183 : cluster [DBG] pgmap v4981: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T08:23:11.784 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:23:11.785 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:23:11.785 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:23:12.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:23:11 smithi047 bash[22744]: cluster 2024-09-16T08:23:10.770339+0000 mgr.a (mgr.14373) 7184 : cluster [DBG] pgmap v4982: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T08:23:12.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:23:11 smithi157 bash[24585]: cluster 2024-09-16T08:23:10.770339+0000 mgr.a (mgr.14373) 7184 : cluster [DBG] pgmap v4982: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T08:23:12.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:23:11 smithi086 bash[24289]: cluster 2024-09-16T08:23:10.770339+0000 mgr.a (mgr.14373) 7184 : cluster [DBG] pgmap v4982: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T08:23:12.533 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:23:12.534 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:23:12.534 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:23:12.534 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:23:12.534 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:23:13.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:23:12 smithi047 bash[22744]: audit 2024-09-16T08:23:12.125191+0000 mgr.a (mgr.14373) 7185 : audit [DBG] from='client.162732 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:23:13.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:23:12 smithi157 bash[24585]: audit 2024-09-16T08:23:12.125191+0000 mgr.a (mgr.14373) 7185 : audit [DBG] from='client.162732 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:23:13.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:23:12 smithi086 bash[24289]: audit 2024-09-16T08:23:12.125191+0000 mgr.a (mgr.14373) 7185 : audit [DBG] from='client.162732 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:23:14.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:23:13 smithi047 bash[22744]: cluster 2024-09-16T08:23:12.773083+0000 mgr.a (mgr.14373) 7186 : cluster [DBG] pgmap v4983: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:23:14.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:23:13 smithi157 bash[24585]: cluster 2024-09-16T08:23:12.773083+0000 mgr.a (mgr.14373) 7186 : cluster [DBG] pgmap v4983: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:23:14.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:23:13 smithi086 bash[24289]: cluster 2024-09-16T08:23:12.773083+0000 mgr.a (mgr.14373) 7186 : cluster [DBG] pgmap v4983: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:23:16.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:23:15 smithi157 bash[24585]: cluster 2024-09-16T08:23:14.773876+0000 mgr.a (mgr.14373) 7187 : cluster [DBG] pgmap v4984: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:23:16.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:23:15 smithi086 bash[24289]: cluster 2024-09-16T08:23:14.773876+0000 mgr.a (mgr.14373) 7187 : cluster [DBG] pgmap v4984: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:23:16.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:23:15 smithi047 bash[22744]: cluster 2024-09-16T08:23:14.773876+0000 mgr.a (mgr.14373) 7187 : cluster [DBG] pgmap v4984: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:23:17.535 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:23:17.536 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:23:17.536 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:23:18.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:23:17 smithi157 bash[24585]: cluster 2024-09-16T08:23:16.775869+0000 mgr.a (mgr.14373) 7188 : cluster [DBG] pgmap v4985: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:23:18.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:23:17 smithi086 bash[24289]: cluster 2024-09-16T08:23:16.775869+0000 mgr.a (mgr.14373) 7188 : cluster [DBG] pgmap v4985: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:23:18.317 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:23:18.317 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:23:18.317 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:23:18.318 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:23:18.318 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:23:18.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:23:17 smithi047 bash[22744]: cluster 2024-09-16T08:23:16.775869+0000 mgr.a (mgr.14373) 7188 : cluster [DBG] pgmap v4985: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:23:19.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:23:18 smithi157 bash[24585]: audit 2024-09-16T08:23:17.875397+0000 mgr.a (mgr.14373) 7189 : audit [DBG] from='client.162804 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:23:19.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:23:18 smithi086 bash[24289]: audit 2024-09-16T08:23:17.875397+0000 mgr.a (mgr.14373) 7189 : audit [DBG] from='client.162804 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:23:19.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:23:18 smithi047 bash[22744]: audit 2024-09-16T08:23:17.875397+0000 mgr.a (mgr.14373) 7189 : audit [DBG] from='client.162804 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:23:20.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:23:19 smithi157 bash[24585]: cluster 2024-09-16T08:23:18.776840+0000 mgr.a (mgr.14373) 7190 : cluster [DBG] pgmap v4986: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:23:20.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:23:19 smithi086 bash[24289]: cluster 2024-09-16T08:23:18.776840+0000 mgr.a (mgr.14373) 7190 : cluster [DBG] pgmap v4986: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:23:20.341 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:23:19 smithi047 bash[22744]: cluster 2024-09-16T08:23:18.776840+0000 mgr.a (mgr.14373) 7190 : cluster [DBG] pgmap v4986: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:23:22.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:23:21 smithi157 bash[24585]: cluster 2024-09-16T08:23:20.777631+0000 mgr.a (mgr.14373) 7191 : cluster [DBG] pgmap v4987: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:23:22.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:23:21 smithi086 bash[24289]: cluster 2024-09-16T08:23:20.777631+0000 mgr.a (mgr.14373) 7191 : cluster [DBG] pgmap v4987: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:23:22.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:23:21 smithi047 bash[22744]: cluster 2024-09-16T08:23:20.777631+0000 mgr.a (mgr.14373) 7191 : cluster [DBG] pgmap v4987: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:23:23.319 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:23:23.320 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:23:23.320 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:23:24.068 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:23:24.069 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:23:24.069 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:23:24.069 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:23:24.069 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:23:24.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:23:23 smithi157 bash[24585]: cluster 2024-09-16T08:23:22.779908+0000 mgr.a (mgr.14373) 7192 : cluster [DBG] pgmap v4988: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:23:24.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:23:23 smithi086 bash[24289]: cluster 2024-09-16T08:23:22.779908+0000 mgr.a (mgr.14373) 7192 : cluster [DBG] pgmap v4988: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:23:24.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:23:23 smithi047 bash[22744]: cluster 2024-09-16T08:23:22.779908+0000 mgr.a (mgr.14373) 7192 : cluster [DBG] pgmap v4988: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:23:25.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:23:24 smithi157 bash[24585]: audit 2024-09-16T08:23:23.655699+0000 mgr.a (mgr.14373) 7193 : audit [DBG] from='client.162882 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:23:25.316 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:23:24 smithi086 bash[24289]: audit 2024-09-16T08:23:23.655699+0000 mgr.a (mgr.14373) 7193 : audit [DBG] from='client.162882 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:23:25.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:23:24 smithi047 bash[22744]: audit 2024-09-16T08:23:23.655699+0000 mgr.a (mgr.14373) 7193 : audit [DBG] from='client.162882 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:23:26.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:23:25 smithi157 bash[24585]: cluster 2024-09-16T08:23:24.780890+0000 mgr.a (mgr.14373) 7194 : cluster [DBG] pgmap v4989: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:23:26.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:23:25 smithi086 bash[24289]: cluster 2024-09-16T08:23:24.780890+0000 mgr.a (mgr.14373) 7194 : cluster [DBG] pgmap v4989: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:23:26.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:23:25 smithi047 bash[22744]: cluster 2024-09-16T08:23:24.780890+0000 mgr.a (mgr.14373) 7194 : cluster [DBG] pgmap v4989: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:23:28.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:23:27 smithi157 bash[24585]: cluster 2024-09-16T08:23:26.783108+0000 mgr.a (mgr.14373) 7195 : cluster [DBG] pgmap v4990: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:23:28.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:23:27 smithi157 bash[24585]: audit 2024-09-16T08:23:27.135656+0000 mon.b (mon.2) 682 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T08:23:28.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:23:27 smithi086 bash[24289]: cluster 2024-09-16T08:23:26.783108+0000 mgr.a (mgr.14373) 7195 : cluster [DBG] pgmap v4990: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:23:28.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:23:27 smithi086 bash[24289]: audit 2024-09-16T08:23:27.135656+0000 mon.b (mon.2) 682 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T08:23:28.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:23:27 smithi047 bash[22744]: cluster 2024-09-16T08:23:26.783108+0000 mgr.a (mgr.14373) 7195 : cluster [DBG] pgmap v4990: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:23:28.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:23:27 smithi047 bash[22744]: audit 2024-09-16T08:23:27.135656+0000 mon.b (mon.2) 682 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T08:23:29.070 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:23:29.071 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:23:29.071 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:23:29.088 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 08:23:28 smithi047 bash[22994]: debug 2024-09-16T08:23:28.720+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T08:23:29.089 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 08:23:28 smithi047 bash[22994]: debug 2024-09-16T08:23:28.720+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T08:23:29.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:23:28 smithi047 bash[22744]: audit 2024-09-16T08:23:27.970433+0000 mon.b (mon.2) 683 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T08:23:29.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:23:28 smithi047 bash[22744]: audit 2024-09-16T08:23:27.972392+0000 mon.b (mon.2) 684 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T08:23:29.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:23:28 smithi047 bash[22744]: audit 2024-09-16T08:23:27.981995+0000 mon.a (mon.0) 999 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:23:29.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:23:28 smithi047 bash[22744]: audit 2024-09-16T08:23:27.987709+0000 mon.b (mon.2) 685 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:23:29.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:23:28 smithi047 bash[22744]: audit 2024-09-16T08:23:27.991309+0000 mgr.a (mgr.14373) 7196 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:23:29.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:23:28 smithi157 bash[24585]: audit 2024-09-16T08:23:27.970433+0000 mon.b (mon.2) 683 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T08:23:29.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:23:28 smithi157 bash[24585]: audit 2024-09-16T08:23:27.972392+0000 mon.b (mon.2) 684 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T08:23:29.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:23:28 smithi157 bash[24585]: audit 2024-09-16T08:23:27.981995+0000 mon.a (mon.0) 999 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:23:29.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:23:28 smithi157 bash[24585]: audit 2024-09-16T08:23:27.987709+0000 mon.b (mon.2) 685 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:23:29.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:23:28 smithi157 bash[24585]: audit 2024-09-16T08:23:27.991309+0000 mgr.a (mgr.14373) 7196 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:23:29.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:23:28 smithi086 bash[24289]: audit 2024-09-16T08:23:27.970433+0000 mon.b (mon.2) 683 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T08:23:29.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:23:28 smithi086 bash[24289]: audit 2024-09-16T08:23:27.972392+0000 mon.b (mon.2) 684 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T08:23:29.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:23:28 smithi086 bash[24289]: audit 2024-09-16T08:23:27.981995+0000 mon.a (mon.0) 999 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:23:29.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:23:28 smithi086 bash[24289]: audit 2024-09-16T08:23:27.987709+0000 mon.b (mon.2) 685 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:23:29.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:23:28 smithi086 bash[24289]: audit 2024-09-16T08:23:27.991309+0000 mgr.a (mgr.14373) 7196 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:23:29.853 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:23:29.853 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:23:29.853 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:23:29.853 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:23:29.853 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:23:30.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:23:29 smithi157 bash[24585]: audit 2024-09-16T08:23:28.723788+0000 mgr.a (mgr.14373) 7197 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T08:23:30.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:23:29 smithi157 bash[24585]: cephadm 2024-09-16T08:23:28.725963+0000 mgr.a (mgr.14373) 7198 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T08:23:30.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:23:29 smithi157 bash[24585]: cluster 2024-09-16T08:23:28.783718+0000 mgr.a (mgr.14373) 7199 : cluster [DBG] pgmap v4991: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:23:30.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:23:29 smithi157 bash[24585]: audit 2024-09-16T08:23:29.409209+0000 mgr.a (mgr.14373) 7200 : audit [DBG] from='client.163068 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:23:30.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:23:29 smithi086 bash[24289]: audit 2024-09-16T08:23:28.723788+0000 mgr.a (mgr.14373) 7197 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T08:23:30.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:23:29 smithi086 bash[24289]: cephadm 2024-09-16T08:23:28.725963+0000 mgr.a (mgr.14373) 7198 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T08:23:30.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:23:29 smithi086 bash[24289]: cluster 2024-09-16T08:23:28.783718+0000 mgr.a (mgr.14373) 7199 : cluster [DBG] pgmap v4991: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:23:30.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:23:29 smithi086 bash[24289]: audit 2024-09-16T08:23:29.409209+0000 mgr.a (mgr.14373) 7200 : audit [DBG] from='client.163068 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:23:30.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:23:29 smithi047 bash[22744]: audit 2024-09-16T08:23:28.723788+0000 mgr.a (mgr.14373) 7197 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T08:23:30.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:23:29 smithi047 bash[22744]: cephadm 2024-09-16T08:23:28.725963+0000 mgr.a (mgr.14373) 7198 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T08:23:30.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:23:29 smithi047 bash[22744]: cluster 2024-09-16T08:23:28.783718+0000 mgr.a (mgr.14373) 7199 : cluster [DBG] pgmap v4991: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:23:30.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:23:29 smithi047 bash[22744]: audit 2024-09-16T08:23:29.409209+0000 mgr.a (mgr.14373) 7200 : audit [DBG] from='client.163068 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:23:32.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:23:31 smithi157 bash[24585]: cluster 2024-09-16T08:23:30.784661+0000 mgr.a (mgr.14373) 7201 : cluster [DBG] pgmap v4992: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:23:32.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:23:31 smithi086 bash[24289]: cluster 2024-09-16T08:23:30.784661+0000 mgr.a (mgr.14373) 7201 : cluster [DBG] pgmap v4992: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:23:32.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:23:31 smithi047 bash[22744]: cluster 2024-09-16T08:23:30.784661+0000 mgr.a (mgr.14373) 7201 : cluster [DBG] pgmap v4992: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:23:34.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:23:33 smithi157 bash[24585]: cluster 2024-09-16T08:23:32.786950+0000 mgr.a (mgr.14373) 7202 : cluster [DBG] pgmap v4993: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:23:34.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:23:33 smithi086 bash[24289]: cluster 2024-09-16T08:23:32.786950+0000 mgr.a (mgr.14373) 7202 : cluster [DBG] pgmap v4993: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:23:34.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:23:33 smithi047 bash[22744]: cluster 2024-09-16T08:23:32.786950+0000 mgr.a (mgr.14373) 7202 : cluster [DBG] pgmap v4993: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:23:34.854 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:23:34.855 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:23:34.855 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:23:35.601 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:23:35.601 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:23:35.602 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:23:35.602 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:23:35.602 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:23:36.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:23:35 smithi157 bash[24585]: cluster 2024-09-16T08:23:34.787732+0000 mgr.a (mgr.14373) 7203 : cluster [DBG] pgmap v4994: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:23:36.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:23:35 smithi157 bash[24585]: audit 2024-09-16T08:23:35.189422+0000 mgr.a (mgr.14373) 7204 : audit [DBG] from='client.163143 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:23:36.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:23:35 smithi086 bash[24289]: cluster 2024-09-16T08:23:34.787732+0000 mgr.a (mgr.14373) 7203 : cluster [DBG] pgmap v4994: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:23:36.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:23:35 smithi086 bash[24289]: audit 2024-09-16T08:23:35.189422+0000 mgr.a (mgr.14373) 7204 : audit [DBG] from='client.163143 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:23:36.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:23:35 smithi047 bash[22744]: cluster 2024-09-16T08:23:34.787732+0000 mgr.a (mgr.14373) 7203 : cluster [DBG] pgmap v4994: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:23:36.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:23:35 smithi047 bash[22744]: audit 2024-09-16T08:23:35.189422+0000 mgr.a (mgr.14373) 7204 : audit [DBG] from='client.163143 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:23:38.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:23:38 smithi157 bash[24585]: cluster 2024-09-16T08:23:36.790048+0000 mgr.a (mgr.14373) 7205 : cluster [DBG] pgmap v4995: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:23:38.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:23:38 smithi086 bash[24289]: cluster 2024-09-16T08:23:36.790048+0000 mgr.a (mgr.14373) 7205 : cluster [DBG] pgmap v4995: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:23:38.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:23:38 smithi047 bash[22744]: cluster 2024-09-16T08:23:36.790048+0000 mgr.a (mgr.14373) 7205 : cluster [DBG] pgmap v4995: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:23:40.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:23:40 smithi157 bash[24585]: cluster 2024-09-16T08:23:38.790897+0000 mgr.a (mgr.14373) 7206 : cluster [DBG] pgmap v4996: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:23:40.316 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:23:40 smithi086 bash[24289]: cluster 2024-09-16T08:23:38.790897+0000 mgr.a (mgr.14373) 7206 : cluster [DBG] pgmap v4996: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:23:40.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:23:40 smithi047 bash[22744]: cluster 2024-09-16T08:23:38.790897+0000 mgr.a (mgr.14373) 7206 : cluster [DBG] pgmap v4996: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:23:40.603 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:23:40.603 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:23:40.604 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:23:41.400 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:23:41.400 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:23:41.400 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:23:41.400 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:23:41.400 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:23:42.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:23:42 smithi157 bash[24585]: cluster 2024-09-16T08:23:40.791561+0000 mgr.a (mgr.14373) 7207 : cluster [DBG] pgmap v4997: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:23:42.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:23:42 smithi157 bash[24585]: audit 2024-09-16T08:23:40.942179+0000 mgr.a (mgr.14373) 7208 : audit [DBG] from='client.163218 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:23:42.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:23:42 smithi086 bash[24289]: cluster 2024-09-16T08:23:40.791561+0000 mgr.a (mgr.14373) 7207 : cluster [DBG] pgmap v4997: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:23:42.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:23:42 smithi086 bash[24289]: audit 2024-09-16T08:23:40.942179+0000 mgr.a (mgr.14373) 7208 : audit [DBG] from='client.163218 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:23:42.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:23:42 smithi047 bash[22744]: cluster 2024-09-16T08:23:40.791561+0000 mgr.a (mgr.14373) 7207 : cluster [DBG] pgmap v4997: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:23:42.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:23:42 smithi047 bash[22744]: audit 2024-09-16T08:23:40.942179+0000 mgr.a (mgr.14373) 7208 : audit [DBG] from='client.163218 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:23:44.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:23:44 smithi157 bash[24585]: cluster 2024-09-16T08:23:42.793959+0000 mgr.a (mgr.14373) 7209 : cluster [DBG] pgmap v4998: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.6 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:23:44.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:23:44 smithi086 bash[24289]: cluster 2024-09-16T08:23:42.793959+0000 mgr.a (mgr.14373) 7209 : cluster [DBG] pgmap v4998: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.6 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:23:44.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:23:44 smithi047 bash[22744]: cluster 2024-09-16T08:23:42.793959+0000 mgr.a (mgr.14373) 7209 : cluster [DBG] pgmap v4998: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.6 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:23:46.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:23:46 smithi157 bash[24585]: cluster 2024-09-16T08:23:44.794750+0000 mgr.a (mgr.14373) 7210 : cluster [DBG] pgmap v4999: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-09-16T08:23:46.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:23:46 smithi086 bash[24289]: cluster 2024-09-16T08:23:44.794750+0000 mgr.a (mgr.14373) 7210 : cluster [DBG] pgmap v4999: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-09-16T08:23:46.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:23:46 smithi047 bash[22744]: cluster 2024-09-16T08:23:44.794750+0000 mgr.a (mgr.14373) 7210 : cluster [DBG] pgmap v4999: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-09-16T08:23:46.404 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:23:46.404 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:23:46.404 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:23:47.169 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:23:47.170 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:23:47.170 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:23:47.170 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:23:47.170 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:23:48.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:23:48 smithi157 bash[24585]: audit 2024-09-16T08:23:46.736776+0000 mgr.a (mgr.14373) 7211 : audit [DBG] from='client.163293 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:23:48.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:23:48 smithi157 bash[24585]: cluster 2024-09-16T08:23:46.797169+0000 mgr.a (mgr.14373) 7212 : cluster [DBG] pgmap v5000: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-16T08:23:48.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:23:48 smithi086 bash[24289]: audit 2024-09-16T08:23:46.736776+0000 mgr.a (mgr.14373) 7211 : audit [DBG] from='client.163293 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:23:48.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:23:48 smithi086 bash[24289]: cluster 2024-09-16T08:23:46.797169+0000 mgr.a (mgr.14373) 7212 : cluster [DBG] pgmap v5000: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-16T08:23:48.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:23:48 smithi047 bash[22744]: audit 2024-09-16T08:23:46.736776+0000 mgr.a (mgr.14373) 7211 : audit [DBG] from='client.163293 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:23:48.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:23:48 smithi047 bash[22744]: cluster 2024-09-16T08:23:46.797169+0000 mgr.a (mgr.14373) 7212 : cluster [DBG] pgmap v5000: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-16T08:23:50.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:23:50 smithi157 bash[24585]: cluster 2024-09-16T08:23:48.798101+0000 mgr.a (mgr.14373) 7213 : cluster [DBG] pgmap v5001: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T08:23:50.316 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:23:50 smithi086 bash[24289]: cluster 2024-09-16T08:23:48.798101+0000 mgr.a (mgr.14373) 7213 : cluster [DBG] pgmap v5001: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T08:23:50.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:23:50 smithi047 bash[22744]: cluster 2024-09-16T08:23:48.798101+0000 mgr.a (mgr.14373) 7213 : cluster [DBG] pgmap v5001: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T08:23:52.171 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:23:52.172 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:23:52.172 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:23:52.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:23:52 smithi157 bash[24585]: cluster 2024-09-16T08:23:50.799041+0000 mgr.a (mgr.14373) 7214 : cluster [DBG] pgmap v5002: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T08:23:52.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:23:52 smithi086 bash[24289]: cluster 2024-09-16T08:23:50.799041+0000 mgr.a (mgr.14373) 7214 : cluster [DBG] pgmap v5002: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T08:23:52.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:23:52 smithi047 bash[22744]: cluster 2024-09-16T08:23:50.799041+0000 mgr.a (mgr.14373) 7214 : cluster [DBG] pgmap v5002: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T08:23:52.921 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:23:52.921 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:23:52.921 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:23:52.921 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:23:52.921 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:23:53.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:23:53 smithi157 bash[24585]: audit 2024-09-16T08:23:52.504270+0000 mgr.a (mgr.14373) 7215 : audit [DBG] from='client.163371 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:23:53.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:23:53 smithi086 bash[24289]: audit 2024-09-16T08:23:52.504270+0000 mgr.a (mgr.14373) 7215 : audit [DBG] from='client.163371 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:23:53.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:23:53 smithi047 bash[22744]: audit 2024-09-16T08:23:52.504270+0000 mgr.a (mgr.14373) 7215 : audit [DBG] from='client.163371 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:23:54.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:23:54 smithi157 bash[24585]: cluster 2024-09-16T08:23:52.800393+0000 mgr.a (mgr.14373) 7216 : cluster [DBG] pgmap v5003: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-16T08:23:54.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:23:54 smithi086 bash[24289]: cluster 2024-09-16T08:23:52.800393+0000 mgr.a (mgr.14373) 7216 : cluster [DBG] pgmap v5003: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-16T08:23:54.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:23:54 smithi047 bash[22744]: cluster 2024-09-16T08:23:52.800393+0000 mgr.a (mgr.14373) 7216 : cluster [DBG] pgmap v5003: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-16T08:23:56.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:23:56 smithi157 bash[24585]: cluster 2024-09-16T08:23:54.801282+0000 mgr.a (mgr.14373) 7217 : cluster [DBG] pgmap v5004: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-16T08:23:56.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:23:56 smithi086 bash[24289]: cluster 2024-09-16T08:23:54.801282+0000 mgr.a (mgr.14373) 7217 : cluster [DBG] pgmap v5004: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-16T08:23:56.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:23:56 smithi047 bash[22744]: cluster 2024-09-16T08:23:54.801282+0000 mgr.a (mgr.14373) 7217 : cluster [DBG] pgmap v5004: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-16T08:23:57.922 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:23:57.923 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:23:57.923 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:23:58.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:23:58 smithi157 bash[24585]: cluster 2024-09-16T08:23:56.803481+0000 mgr.a (mgr.14373) 7218 : cluster [DBG] pgmap v5005: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:23:58.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:23:58 smithi086 bash[24289]: cluster 2024-09-16T08:23:56.803481+0000 mgr.a (mgr.14373) 7218 : cluster [DBG] pgmap v5005: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:23:58.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:23:58 smithi047 bash[22744]: cluster 2024-09-16T08:23:56.803481+0000 mgr.a (mgr.14373) 7218 : cluster [DBG] pgmap v5005: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:23:58.694 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:23:58.694 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:23:58.694 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:23:58.694 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:23:58.694 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:23:59.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:23:59 smithi086 bash[24289]: audit 2024-09-16T08:23:58.262955+0000 mgr.a (mgr.14373) 7219 : audit [DBG] from='client.163449 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:23:59.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:23:59 smithi047 bash[22744]: audit 2024-09-16T08:23:58.262955+0000 mgr.a (mgr.14373) 7219 : audit [DBG] from='client.163449 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:23:59.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:23:59 smithi157 bash[24585]: audit 2024-09-16T08:23:58.262955+0000 mgr.a (mgr.14373) 7219 : audit [DBG] from='client.163449 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:24:00.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:24:00 smithi086 bash[24289]: cluster 2024-09-16T08:23:58.804435+0000 mgr.a (mgr.14373) 7220 : cluster [DBG] pgmap v5006: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:24:00.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:24:00 smithi047 bash[22744]: cluster 2024-09-16T08:23:58.804435+0000 mgr.a (mgr.14373) 7220 : cluster [DBG] pgmap v5006: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:24:00.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:24:00 smithi157 bash[24585]: cluster 2024-09-16T08:23:58.804435+0000 mgr.a (mgr.14373) 7220 : cluster [DBG] pgmap v5006: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:24:02.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:24:02 smithi086 bash[24289]: cluster 2024-09-16T08:24:00.805217+0000 mgr.a (mgr.14373) 7221 : cluster [DBG] pgmap v5007: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:24:02.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:24:02 smithi047 bash[22744]: cluster 2024-09-16T08:24:00.805217+0000 mgr.a (mgr.14373) 7221 : cluster [DBG] pgmap v5007: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:24:02.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:24:02 smithi157 bash[24585]: cluster 2024-09-16T08:24:00.805217+0000 mgr.a (mgr.14373) 7221 : cluster [DBG] pgmap v5007: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:24:03.696 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:24:03.696 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:24:03.696 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:24:04.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:24:04 smithi086 bash[24289]: cluster 2024-09-16T08:24:02.807480+0000 mgr.a (mgr.14373) 7222 : cluster [DBG] pgmap v5008: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:24:04.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:24:04 smithi047 bash[22744]: cluster 2024-09-16T08:24:02.807480+0000 mgr.a (mgr.14373) 7222 : cluster [DBG] pgmap v5008: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:24:04.479 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:24:04.479 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:24:04.480 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:24:04.480 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:24:04.480 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:24:04.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:24:04 smithi157 bash[24585]: cluster 2024-09-16T08:24:02.807480+0000 mgr.a (mgr.14373) 7222 : cluster [DBG] pgmap v5008: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:24:05.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:24:05 smithi047 bash[22744]: audit 2024-09-16T08:24:04.035856+0000 mgr.a (mgr.14373) 7223 : audit [DBG] from='client.163527 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:24:05.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:24:05 smithi157 bash[24585]: audit 2024-09-16T08:24:04.035856+0000 mgr.a (mgr.14373) 7223 : audit [DBG] from='client.163527 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:24:05.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:24:05 smithi086 bash[24289]: audit 2024-09-16T08:24:04.035856+0000 mgr.a (mgr.14373) 7223 : audit [DBG] from='client.163527 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:24:06.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:24:06 smithi047 bash[22744]: cluster 2024-09-16T08:24:04.808449+0000 mgr.a (mgr.14373) 7224 : cluster [DBG] pgmap v5009: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:24:06.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:24:06 smithi157 bash[24585]: cluster 2024-09-16T08:24:04.808449+0000 mgr.a (mgr.14373) 7224 : cluster [DBG] pgmap v5009: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:24:06.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:24:06 smithi086 bash[24289]: cluster 2024-09-16T08:24:04.808449+0000 mgr.a (mgr.14373) 7224 : cluster [DBG] pgmap v5009: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:24:08.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:24:08 smithi047 bash[22744]: cluster 2024-09-16T08:24:06.810613+0000 mgr.a (mgr.14373) 7225 : cluster [DBG] pgmap v5010: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:24:08.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:24:08 smithi157 bash[24585]: cluster 2024-09-16T08:24:06.810613+0000 mgr.a (mgr.14373) 7225 : cluster [DBG] pgmap v5010: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:24:08.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:24:08 smithi086 bash[24289]: cluster 2024-09-16T08:24:06.810613+0000 mgr.a (mgr.14373) 7225 : cluster [DBG] pgmap v5010: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:24:09.481 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:24:09.481 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:24:09.481 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:24:10.223 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:24:10.223 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:24:10.224 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:24:10.224 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:24:10.224 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:24:10.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:24:10 smithi047 bash[22744]: cluster 2024-09-16T08:24:08.811378+0000 mgr.a (mgr.14373) 7226 : cluster [DBG] pgmap v5011: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:24:10.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:24:10 smithi157 bash[24585]: cluster 2024-09-16T08:24:08.811378+0000 mgr.a (mgr.14373) 7226 : cluster [DBG] pgmap v5011: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:24:10.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:24:10 smithi086 bash[24289]: cluster 2024-09-16T08:24:08.811378+0000 mgr.a (mgr.14373) 7226 : cluster [DBG] pgmap v5011: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:24:11.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:24:11 smithi157 bash[24585]: audit 2024-09-16T08:24:09.814215+0000 mgr.a (mgr.14373) 7227 : audit [DBG] from='client.163605 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:24:11.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:24:11 smithi086 bash[24289]: audit 2024-09-16T08:24:09.814215+0000 mgr.a (mgr.14373) 7227 : audit [DBG] from='client.163605 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:24:11.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:24:11 smithi047 bash[22744]: audit 2024-09-16T08:24:09.814215+0000 mgr.a (mgr.14373) 7227 : audit [DBG] from='client.163605 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:24:12.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:24:12 smithi157 bash[24585]: cluster 2024-09-16T08:24:10.812303+0000 mgr.a (mgr.14373) 7228 : cluster [DBG] pgmap v5012: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:24:12.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:24:12 smithi086 bash[24289]: cluster 2024-09-16T08:24:10.812303+0000 mgr.a (mgr.14373) 7228 : cluster [DBG] pgmap v5012: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:24:12.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:24:12 smithi047 bash[22744]: cluster 2024-09-16T08:24:10.812303+0000 mgr.a (mgr.14373) 7228 : cluster [DBG] pgmap v5012: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:24:14.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:24:14 smithi157 bash[24585]: cluster 2024-09-16T08:24:12.814597+0000 mgr.a (mgr.14373) 7229 : cluster [DBG] pgmap v5013: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:24:14.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:24:14 smithi086 bash[24289]: cluster 2024-09-16T08:24:12.814597+0000 mgr.a (mgr.14373) 7229 : cluster [DBG] pgmap v5013: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:24:14.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:24:14 smithi047 bash[22744]: cluster 2024-09-16T08:24:12.814597+0000 mgr.a (mgr.14373) 7229 : cluster [DBG] pgmap v5013: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:24:15.225 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:24:15.225 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:24:15.225 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:24:15.977 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:24:15.977 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:24:15.977 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:24:15.977 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:24:15.977 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:24:16.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:24:16 smithi157 bash[24585]: cluster 2024-09-16T08:24:14.815360+0000 mgr.a (mgr.14373) 7230 : cluster [DBG] pgmap v5014: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:24:16.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:24:16 smithi157 bash[24585]: audit 2024-09-16T08:24:15.555749+0000 mgr.a (mgr.14373) 7231 : audit [DBG] from='client.163683 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:24:16.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:24:16 smithi086 bash[24289]: cluster 2024-09-16T08:24:14.815360+0000 mgr.a (mgr.14373) 7230 : cluster [DBG] pgmap v5014: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:24:16.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:24:16 smithi086 bash[24289]: audit 2024-09-16T08:24:15.555749+0000 mgr.a (mgr.14373) 7231 : audit [DBG] from='client.163683 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:24:16.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:24:16 smithi047 bash[22744]: cluster 2024-09-16T08:24:14.815360+0000 mgr.a (mgr.14373) 7230 : cluster [DBG] pgmap v5014: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:24:16.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:24:16 smithi047 bash[22744]: audit 2024-09-16T08:24:15.555749+0000 mgr.a (mgr.14373) 7231 : audit [DBG] from='client.163683 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:24:18.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:24:18 smithi157 bash[24585]: cluster 2024-09-16T08:24:16.817628+0000 mgr.a (mgr.14373) 7232 : cluster [DBG] pgmap v5015: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:24:18.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:24:18 smithi086 bash[24289]: cluster 2024-09-16T08:24:16.817628+0000 mgr.a (mgr.14373) 7232 : cluster [DBG] pgmap v5015: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:24:18.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:24:18 smithi047 bash[22744]: cluster 2024-09-16T08:24:16.817628+0000 mgr.a (mgr.14373) 7232 : cluster [DBG] pgmap v5015: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:24:20.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:24:20 smithi157 bash[24585]: cluster 2024-09-16T08:24:18.818425+0000 mgr.a (mgr.14373) 7233 : cluster [DBG] pgmap v5016: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:24:20.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:24:20 smithi086 bash[24289]: cluster 2024-09-16T08:24:18.818425+0000 mgr.a (mgr.14373) 7233 : cluster [DBG] pgmap v5016: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:24:20.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:24:20 smithi047 bash[22744]: cluster 2024-09-16T08:24:18.818425+0000 mgr.a (mgr.14373) 7233 : cluster [DBG] pgmap v5016: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:24:20.978 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:24:20.979 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:24:20.979 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:24:21.737 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:24:21.738 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:24:21.738 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:24:21.738 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:24:21.738 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:24:22.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:24:22 smithi157 bash[24585]: cluster 2024-09-16T08:24:20.819289+0000 mgr.a (mgr.14373) 7234 : cluster [DBG] pgmap v5017: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:24:22.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:24:22 smithi157 bash[24585]: audit 2024-09-16T08:24:21.317719+0000 mgr.a (mgr.14373) 7235 : audit [DBG] from='client.163758 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:24:22.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:24:22 smithi086 bash[24289]: cluster 2024-09-16T08:24:20.819289+0000 mgr.a (mgr.14373) 7234 : cluster [DBG] pgmap v5017: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:24:22.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:24:22 smithi086 bash[24289]: audit 2024-09-16T08:24:21.317719+0000 mgr.a (mgr.14373) 7235 : audit [DBG] from='client.163758 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:24:22.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:24:22 smithi047 bash[22744]: cluster 2024-09-16T08:24:20.819289+0000 mgr.a (mgr.14373) 7234 : cluster [DBG] pgmap v5017: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:24:22.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:24:22 smithi047 bash[22744]: audit 2024-09-16T08:24:21.317719+0000 mgr.a (mgr.14373) 7235 : audit [DBG] from='client.163758 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:24:24.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:24:24 smithi157 bash[24585]: cluster 2024-09-16T08:24:22.822037+0000 mgr.a (mgr.14373) 7236 : cluster [DBG] pgmap v5018: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:24:24.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:24:24 smithi086 bash[24289]: cluster 2024-09-16T08:24:22.822037+0000 mgr.a (mgr.14373) 7236 : cluster [DBG] pgmap v5018: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:24:24.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:24:24 smithi047 bash[22744]: cluster 2024-09-16T08:24:22.822037+0000 mgr.a (mgr.14373) 7236 : cluster [DBG] pgmap v5018: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:24:26.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:24:26 smithi157 bash[24585]: cluster 2024-09-16T08:24:24.822833+0000 mgr.a (mgr.14373) 7237 : cluster [DBG] pgmap v5019: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:24:26.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:24:26 smithi086 bash[24289]: cluster 2024-09-16T08:24:24.822833+0000 mgr.a (mgr.14373) 7237 : cluster [DBG] pgmap v5019: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:24:26.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:24:26 smithi047 bash[22744]: cluster 2024-09-16T08:24:24.822833+0000 mgr.a (mgr.14373) 7237 : cluster [DBG] pgmap v5019: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:24:26.739 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:24:26.740 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:24:26.740 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:24:27.496 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:24:27.496 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:24:27.497 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:24:27.497 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:24:27.497 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:24:28.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:24:28 smithi157 bash[24585]: cluster 2024-09-16T08:24:26.824830+0000 mgr.a (mgr.14373) 7238 : cluster [DBG] pgmap v5020: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:24:28.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:24:28 smithi157 bash[24585]: audit 2024-09-16T08:24:27.073732+0000 mgr.a (mgr.14373) 7239 : audit [DBG] from='client.163836 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:24:28.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:24:28 smithi086 bash[24289]: cluster 2024-09-16T08:24:26.824830+0000 mgr.a (mgr.14373) 7238 : cluster [DBG] pgmap v5020: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:24:28.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:24:28 smithi086 bash[24289]: audit 2024-09-16T08:24:27.073732+0000 mgr.a (mgr.14373) 7239 : audit [DBG] from='client.163836 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:24:28.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:24:28 smithi047 bash[22744]: cluster 2024-09-16T08:24:26.824830+0000 mgr.a (mgr.14373) 7238 : cluster [DBG] pgmap v5020: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:24:28.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:24:28 smithi047 bash[22744]: audit 2024-09-16T08:24:27.073732+0000 mgr.a (mgr.14373) 7239 : audit [DBG] from='client.163836 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:24:29.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:24:29 smithi157 bash[24585]: audit 2024-09-16T08:24:28.777706+0000 mon.b (mon.2) 686 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T08:24:29.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:24:29 smithi086 bash[24289]: audit 2024-09-16T08:24:28.777706+0000 mon.b (mon.2) 686 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T08:24:29.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:24:29 smithi047 bash[22744]: audit 2024-09-16T08:24:28.777706+0000 mon.b (mon.2) 686 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T08:24:30.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:24:30 smithi157 bash[24585]: cluster 2024-09-16T08:24:28.825704+0000 mgr.a (mgr.14373) 7240 : cluster [DBG] pgmap v5021: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:24:30.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:24:30 smithi157 bash[24585]: audit 2024-09-16T08:24:29.611835+0000 mon.b (mon.2) 687 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T08:24:30.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:24:30 smithi157 bash[24585]: audit 2024-09-16T08:24:29.614078+0000 mon.b (mon.2) 688 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T08:24:30.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:24:30 smithi157 bash[24585]: audit 2024-09-16T08:24:29.624770+0000 mon.a (mon.0) 1000 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:24:30.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:24:30 smithi157 bash[24585]: audit 2024-09-16T08:24:29.629195+0000 mon.b (mon.2) 689 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:24:30.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:24:30 smithi086 bash[24289]: cluster 2024-09-16T08:24:28.825704+0000 mgr.a (mgr.14373) 7240 : cluster [DBG] pgmap v5021: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:24:30.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:24:30 smithi086 bash[24289]: audit 2024-09-16T08:24:29.611835+0000 mon.b (mon.2) 687 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T08:24:30.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:24:30 smithi086 bash[24289]: audit 2024-09-16T08:24:29.614078+0000 mon.b (mon.2) 688 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T08:24:30.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:24:30 smithi086 bash[24289]: audit 2024-09-16T08:24:29.624770+0000 mon.a (mon.0) 1000 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:24:30.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:24:30 smithi086 bash[24289]: audit 2024-09-16T08:24:29.629195+0000 mon.b (mon.2) 689 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:24:30.588 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 08:24:30 smithi047 bash[22994]: debug 2024-09-16T08:24:30.383+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T08:24:30.588 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 08:24:30 smithi047 bash[22994]: debug 2024-09-16T08:24:30.383+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T08:24:30.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:24:30 smithi047 bash[22744]: cluster 2024-09-16T08:24:28.825704+0000 mgr.a (mgr.14373) 7240 : cluster [DBG] pgmap v5021: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:24:30.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:24:30 smithi047 bash[22744]: audit 2024-09-16T08:24:29.611835+0000 mon.b (mon.2) 687 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T08:24:30.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:24:30 smithi047 bash[22744]: audit 2024-09-16T08:24:29.614078+0000 mon.b (mon.2) 688 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T08:24:30.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:24:30 smithi047 bash[22744]: audit 2024-09-16T08:24:29.624770+0000 mon.a (mon.0) 1000 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:24:30.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:24:30 smithi047 bash[22744]: audit 2024-09-16T08:24:29.629195+0000 mon.b (mon.2) 689 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:24:31.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:24:31 smithi157 bash[24585]: audit 2024-09-16T08:24:29.632841+0000 mgr.a (mgr.14373) 7241 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:24:31.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:24:31 smithi157 bash[24585]: audit 2024-09-16T08:24:30.388007+0000 mgr.a (mgr.14373) 7242 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T08:24:31.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:24:31 smithi157 bash[24585]: cephadm 2024-09-16T08:24:30.390168+0000 mgr.a (mgr.14373) 7243 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T08:24:31.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:24:31 smithi086 bash[24289]: audit 2024-09-16T08:24:29.632841+0000 mgr.a (mgr.14373) 7241 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:24:31.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:24:31 smithi086 bash[24289]: audit 2024-09-16T08:24:30.388007+0000 mgr.a (mgr.14373) 7242 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T08:24:31.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:24:31 smithi086 bash[24289]: cephadm 2024-09-16T08:24:30.390168+0000 mgr.a (mgr.14373) 7243 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T08:24:31.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:24:31 smithi047 bash[22744]: audit 2024-09-16T08:24:29.632841+0000 mgr.a (mgr.14373) 7241 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:24:31.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:24:31 smithi047 bash[22744]: audit 2024-09-16T08:24:30.388007+0000 mgr.a (mgr.14373) 7242 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T08:24:31.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:24:31 smithi047 bash[22744]: cephadm 2024-09-16T08:24:30.390168+0000 mgr.a (mgr.14373) 7243 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T08:24:32.497 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:24:32.498 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:24:32.499 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:24:32.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:24:32 smithi157 bash[24585]: cluster 2024-09-16T08:24:30.826651+0000 mgr.a (mgr.14373) 7244 : cluster [DBG] pgmap v5022: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T08:24:32.566 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:24:32 smithi086 bash[24289]: cluster 2024-09-16T08:24:30.826651+0000 mgr.a (mgr.14373) 7244 : cluster [DBG] pgmap v5022: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T08:24:32.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:24:32 smithi047 bash[22744]: cluster 2024-09-16T08:24:30.826651+0000 mgr.a (mgr.14373) 7244 : cluster [DBG] pgmap v5022: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T08:24:33.287 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:24:33.288 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:24:33.288 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:24:33.288 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:24:33.288 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:24:34.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:24:34 smithi157 bash[24585]: cluster 2024-09-16T08:24:32.828856+0000 mgr.a (mgr.14373) 7245 : cluster [DBG] pgmap v5023: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:24:34.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:24:34 smithi157 bash[24585]: audit 2024-09-16T08:24:32.841081+0000 mgr.a (mgr.14373) 7246 : audit [DBG] from='client.164019 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:24:34.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:24:34 smithi086 bash[24289]: cluster 2024-09-16T08:24:32.828856+0000 mgr.a (mgr.14373) 7245 : cluster [DBG] pgmap v5023: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:24:34.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:24:34 smithi086 bash[24289]: audit 2024-09-16T08:24:32.841081+0000 mgr.a (mgr.14373) 7246 : audit [DBG] from='client.164019 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:24:34.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:24:34 smithi047 bash[22744]: cluster 2024-09-16T08:24:32.828856+0000 mgr.a (mgr.14373) 7245 : cluster [DBG] pgmap v5023: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:24:34.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:24:34 smithi047 bash[22744]: audit 2024-09-16T08:24:32.841081+0000 mgr.a (mgr.14373) 7246 : audit [DBG] from='client.164019 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:24:36.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:24:36 smithi157 bash[24585]: cluster 2024-09-16T08:24:34.829803+0000 mgr.a (mgr.14373) 7247 : cluster [DBG] pgmap v5024: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:24:36.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:24:36 smithi086 bash[24289]: cluster 2024-09-16T08:24:34.829803+0000 mgr.a (mgr.14373) 7247 : cluster [DBG] pgmap v5024: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:24:36.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:24:36 smithi047 bash[22744]: cluster 2024-09-16T08:24:34.829803+0000 mgr.a (mgr.14373) 7247 : cluster [DBG] pgmap v5024: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:24:38.289 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:24:38.290 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:24:38.290 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:24:38.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:24:38 smithi157 bash[24585]: cluster 2024-09-16T08:24:36.831968+0000 mgr.a (mgr.14373) 7248 : cluster [DBG] pgmap v5025: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:24:38.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:24:38 smithi086 bash[24289]: cluster 2024-09-16T08:24:36.831968+0000 mgr.a (mgr.14373) 7248 : cluster [DBG] pgmap v5025: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:24:38.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:24:38 smithi047 bash[22744]: cluster 2024-09-16T08:24:36.831968+0000 mgr.a (mgr.14373) 7248 : cluster [DBG] pgmap v5025: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:24:39.046 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:24:39.047 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:24:39.047 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:24:39.047 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:24:39.047 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:24:40.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:24:40 smithi157 bash[24585]: audit 2024-09-16T08:24:38.623157+0000 mgr.a (mgr.14373) 7249 : audit [DBG] from='client.164097 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:24:40.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:24:40 smithi157 bash[24585]: cluster 2024-09-16T08:24:38.832497+0000 mgr.a (mgr.14373) 7250 : cluster [DBG] pgmap v5026: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:24:40.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:24:40 smithi086 bash[24289]: audit 2024-09-16T08:24:38.623157+0000 mgr.a (mgr.14373) 7249 : audit [DBG] from='client.164097 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:24:40.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:24:40 smithi086 bash[24289]: cluster 2024-09-16T08:24:38.832497+0000 mgr.a (mgr.14373) 7250 : cluster [DBG] pgmap v5026: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:24:40.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:24:40 smithi047 bash[22744]: audit 2024-09-16T08:24:38.623157+0000 mgr.a (mgr.14373) 7249 : audit [DBG] from='client.164097 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:24:40.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:24:40 smithi047 bash[22744]: cluster 2024-09-16T08:24:38.832497+0000 mgr.a (mgr.14373) 7250 : cluster [DBG] pgmap v5026: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:24:42.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:24:42 smithi157 bash[24585]: cluster 2024-09-16T08:24:40.833341+0000 mgr.a (mgr.14373) 7251 : cluster [DBG] pgmap v5027: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:24:42.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:24:42 smithi086 bash[24289]: cluster 2024-09-16T08:24:40.833341+0000 mgr.a (mgr.14373) 7251 : cluster [DBG] pgmap v5027: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:24:42.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:24:42 smithi047 bash[22744]: cluster 2024-09-16T08:24:40.833341+0000 mgr.a (mgr.14373) 7251 : cluster [DBG] pgmap v5027: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:24:44.048 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:24:44.049 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:24:44.049 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:24:44.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:24:44 smithi157 bash[24585]: cluster 2024-09-16T08:24:42.835570+0000 mgr.a (mgr.14373) 7252 : cluster [DBG] pgmap v5028: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:24:44.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:24:44 smithi086 bash[24289]: cluster 2024-09-16T08:24:42.835570+0000 mgr.a (mgr.14373) 7252 : cluster [DBG] pgmap v5028: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:24:44.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:24:44 smithi047 bash[22744]: cluster 2024-09-16T08:24:42.835570+0000 mgr.a (mgr.14373) 7252 : cluster [DBG] pgmap v5028: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:24:44.848 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:24:44.848 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:24:44.848 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:24:44.848 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:24:44.848 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:24:45.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:24:45 smithi157 bash[24585]: audit 2024-09-16T08:24:44.390200+0000 mgr.a (mgr.14373) 7253 : audit [DBG] from='client.164175 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:24:45.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:24:45 smithi086 bash[24289]: audit 2024-09-16T08:24:44.390200+0000 mgr.a (mgr.14373) 7253 : audit [DBG] from='client.164175 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:24:45.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:24:45 smithi047 bash[22744]: audit 2024-09-16T08:24:44.390200+0000 mgr.a (mgr.14373) 7253 : audit [DBG] from='client.164175 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:24:46.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:24:46 smithi157 bash[24585]: cluster 2024-09-16T08:24:44.836095+0000 mgr.a (mgr.14373) 7254 : cluster [DBG] pgmap v5029: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:24:46.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:24:46 smithi086 bash[24289]: cluster 2024-09-16T08:24:44.836095+0000 mgr.a (mgr.14373) 7254 : cluster [DBG] pgmap v5029: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:24:46.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:24:46 smithi047 bash[22744]: cluster 2024-09-16T08:24:44.836095+0000 mgr.a (mgr.14373) 7254 : cluster [DBG] pgmap v5029: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:24:48.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:24:48 smithi157 bash[24585]: cluster 2024-09-16T08:24:46.838184+0000 mgr.a (mgr.14373) 7255 : cluster [DBG] pgmap v5030: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:24:48.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:24:48 smithi086 bash[24289]: cluster 2024-09-16T08:24:46.838184+0000 mgr.a (mgr.14373) 7255 : cluster [DBG] pgmap v5030: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:24:48.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:24:48 smithi047 bash[22744]: cluster 2024-09-16T08:24:46.838184+0000 mgr.a (mgr.14373) 7255 : cluster [DBG] pgmap v5030: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:24:49.850 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:24:49.850 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:24:49.850 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:24:50.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:24:50 smithi157 bash[24585]: cluster 2024-09-16T08:24:48.838935+0000 mgr.a (mgr.14373) 7256 : cluster [DBG] pgmap v5031: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:24:50.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:24:50 smithi086 bash[24289]: cluster 2024-09-16T08:24:48.838935+0000 mgr.a (mgr.14373) 7256 : cluster [DBG] pgmap v5031: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:24:50.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:24:50 smithi047 bash[22744]: cluster 2024-09-16T08:24:48.838935+0000 mgr.a (mgr.14373) 7256 : cluster [DBG] pgmap v5031: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:24:50.596 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:24:50.596 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:24:50.596 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:24:50.596 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:24:50.596 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:24:51.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:24:51 smithi157 bash[24585]: audit 2024-09-16T08:24:50.183226+0000 mgr.a (mgr.14373) 7257 : audit [DBG] from='client.164253 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:24:51.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:24:51 smithi086 bash[24289]: audit 2024-09-16T08:24:50.183226+0000 mgr.a (mgr.14373) 7257 : audit [DBG] from='client.164253 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:24:51.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:24:51 smithi047 bash[22744]: audit 2024-09-16T08:24:50.183226+0000 mgr.a (mgr.14373) 7257 : audit [DBG] from='client.164253 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:24:52.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:24:52 smithi157 bash[24585]: cluster 2024-09-16T08:24:50.839833+0000 mgr.a (mgr.14373) 7258 : cluster [DBG] pgmap v5032: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:24:52.566 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:24:52 smithi086 bash[24289]: cluster 2024-09-16T08:24:50.839833+0000 mgr.a (mgr.14373) 7258 : cluster [DBG] pgmap v5032: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:24:52.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:24:52 smithi047 bash[22744]: cluster 2024-09-16T08:24:50.839833+0000 mgr.a (mgr.14373) 7258 : cluster [DBG] pgmap v5032: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:24:54.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:24:54 smithi157 bash[24585]: cluster 2024-09-16T08:24:52.842058+0000 mgr.a (mgr.14373) 7259 : cluster [DBG] pgmap v5033: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:24:54.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:24:54 smithi086 bash[24289]: cluster 2024-09-16T08:24:52.842058+0000 mgr.a (mgr.14373) 7259 : cluster [DBG] pgmap v5033: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:24:54.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:24:54 smithi047 bash[22744]: cluster 2024-09-16T08:24:52.842058+0000 mgr.a (mgr.14373) 7259 : cluster [DBG] pgmap v5033: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:24:55.598 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:24:55.599 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:24:55.599 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:24:56.355 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:24:56.356 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:24:56.356 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:24:56.356 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:24:56.356 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:24:56.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:24:56 smithi157 bash[24585]: cluster 2024-09-16T08:24:54.842830+0000 mgr.a (mgr.14373) 7260 : cluster [DBG] pgmap v5034: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:24:56.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:24:56 smithi086 bash[24289]: cluster 2024-09-16T08:24:54.842830+0000 mgr.a (mgr.14373) 7260 : cluster [DBG] pgmap v5034: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:24:56.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:24:56 smithi047 bash[22744]: cluster 2024-09-16T08:24:54.842830+0000 mgr.a (mgr.14373) 7260 : cluster [DBG] pgmap v5034: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:24:57.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:24:57 smithi157 bash[24585]: audit 2024-09-16T08:24:55.928853+0000 mgr.a (mgr.14373) 7261 : audit [DBG] from='client.164331 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:24:57.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:24:57 smithi086 bash[24289]: audit 2024-09-16T08:24:55.928853+0000 mgr.a (mgr.14373) 7261 : audit [DBG] from='client.164331 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:24:57.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:24:57 smithi047 bash[22744]: audit 2024-09-16T08:24:55.928853+0000 mgr.a (mgr.14373) 7261 : audit [DBG] from='client.164331 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:24:58.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:24:58 smithi157 bash[24585]: cluster 2024-09-16T08:24:56.845098+0000 mgr.a (mgr.14373) 7262 : cluster [DBG] pgmap v5035: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:24:58.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:24:58 smithi086 bash[24289]: cluster 2024-09-16T08:24:56.845098+0000 mgr.a (mgr.14373) 7262 : cluster [DBG] pgmap v5035: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:24:58.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:24:58 smithi047 bash[22744]: cluster 2024-09-16T08:24:56.845098+0000 mgr.a (mgr.14373) 7262 : cluster [DBG] pgmap v5035: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:25:00.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:25:00 smithi157 bash[24585]: cluster 2024-09-16T08:24:58.845875+0000 mgr.a (mgr.14373) 7263 : cluster [DBG] pgmap v5036: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:25:00.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:25:00 smithi086 bash[24289]: cluster 2024-09-16T08:24:58.845875+0000 mgr.a (mgr.14373) 7263 : cluster [DBG] pgmap v5036: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:25:00.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:25:00 smithi047 bash[22744]: cluster 2024-09-16T08:24:58.845875+0000 mgr.a (mgr.14373) 7263 : cluster [DBG] pgmap v5036: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:25:01.357 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:25:01.357 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:25:01.358 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:25:02.104 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:25:02.105 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:25:02.105 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:25:02.105 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:25:02.105 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:25:02.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:25:02 smithi157 bash[24585]: cluster 2024-09-16T08:25:00.846656+0000 mgr.a (mgr.14373) 7264 : cluster [DBG] pgmap v5037: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:25:02.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:25:02 smithi086 bash[24289]: cluster 2024-09-16T08:25:00.846656+0000 mgr.a (mgr.14373) 7264 : cluster [DBG] pgmap v5037: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:25:02.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:25:02 smithi047 bash[22744]: cluster 2024-09-16T08:25:00.846656+0000 mgr.a (mgr.14373) 7264 : cluster [DBG] pgmap v5037: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:25:03.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:25:03 smithi157 bash[24585]: audit 2024-09-16T08:25:01.696656+0000 mgr.a (mgr.14373) 7265 : audit [DBG] from='client.164403 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:25:03.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:25:03 smithi086 bash[24289]: audit 2024-09-16T08:25:01.696656+0000 mgr.a (mgr.14373) 7265 : audit [DBG] from='client.164403 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:25:03.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:25:03 smithi047 bash[22744]: audit 2024-09-16T08:25:01.696656+0000 mgr.a (mgr.14373) 7265 : audit [DBG] from='client.164403 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:25:04.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:25:04 smithi157 bash[24585]: cluster 2024-09-16T08:25:02.849352+0000 mgr.a (mgr.14373) 7266 : cluster [DBG] pgmap v5038: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:25:04.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:25:04 smithi086 bash[24289]: cluster 2024-09-16T08:25:02.849352+0000 mgr.a (mgr.14373) 7266 : cluster [DBG] pgmap v5038: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:25:04.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:25:04 smithi047 bash[22744]: cluster 2024-09-16T08:25:02.849352+0000 mgr.a (mgr.14373) 7266 : cluster [DBG] pgmap v5038: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:25:06.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:25:06 smithi157 bash[24585]: cluster 2024-09-16T08:25:04.850135+0000 mgr.a (mgr.14373) 7267 : cluster [DBG] pgmap v5039: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:25:06.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:25:06 smithi086 bash[24289]: cluster 2024-09-16T08:25:04.850135+0000 mgr.a (mgr.14373) 7267 : cluster [DBG] pgmap v5039: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:25:06.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:25:06 smithi047 bash[22744]: cluster 2024-09-16T08:25:04.850135+0000 mgr.a (mgr.14373) 7267 : cluster [DBG] pgmap v5039: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:25:07.106 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:25:07.107 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:25:07.107 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:25:07.880 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:25:07.880 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:25:07.880 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:25:07.880 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:25:07.880 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:25:08.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:25:08 smithi157 bash[24585]: cluster 2024-09-16T08:25:06.852107+0000 mgr.a (mgr.14373) 7268 : cluster [DBG] pgmap v5040: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:25:08.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:25:08 smithi157 bash[24585]: audit 2024-09-16T08:25:07.445641+0000 mgr.a (mgr.14373) 7269 : audit [DBG] from='client.164478 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:25:08.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:25:08 smithi086 bash[24289]: cluster 2024-09-16T08:25:06.852107+0000 mgr.a (mgr.14373) 7268 : cluster [DBG] pgmap v5040: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:25:08.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:25:08 smithi086 bash[24289]: audit 2024-09-16T08:25:07.445641+0000 mgr.a (mgr.14373) 7269 : audit [DBG] from='client.164478 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:25:08.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:25:08 smithi047 bash[22744]: cluster 2024-09-16T08:25:06.852107+0000 mgr.a (mgr.14373) 7268 : cluster [DBG] pgmap v5040: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:25:08.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:25:08 smithi047 bash[22744]: audit 2024-09-16T08:25:07.445641+0000 mgr.a (mgr.14373) 7269 : audit [DBG] from='client.164478 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:25:10.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:25:10 smithi157 bash[24585]: cluster 2024-09-16T08:25:08.852996+0000 mgr.a (mgr.14373) 7270 : cluster [DBG] pgmap v5041: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:25:10.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:25:10 smithi086 bash[24289]: cluster 2024-09-16T08:25:08.852996+0000 mgr.a (mgr.14373) 7270 : cluster [DBG] pgmap v5041: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:25:10.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:25:10 smithi047 bash[22744]: cluster 2024-09-16T08:25:08.852996+0000 mgr.a (mgr.14373) 7270 : cluster [DBG] pgmap v5041: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:25:12.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:25:12 smithi157 bash[24585]: cluster 2024-09-16T08:25:10.853755+0000 mgr.a (mgr.14373) 7271 : cluster [DBG] pgmap v5042: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T08:25:12.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:25:12 smithi086 bash[24289]: cluster 2024-09-16T08:25:10.853755+0000 mgr.a (mgr.14373) 7271 : cluster [DBG] pgmap v5042: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T08:25:12.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:25:12 smithi047 bash[22744]: cluster 2024-09-16T08:25:10.853755+0000 mgr.a (mgr.14373) 7271 : cluster [DBG] pgmap v5042: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T08:25:12.882 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:25:12.882 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:25:12.882 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:25:13.657 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:25:13.657 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:25:13.657 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:25:13.657 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:25:13.657 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:25:14.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:25:14 smithi157 bash[24585]: cluster 2024-09-16T08:25:12.856024+0000 mgr.a (mgr.14373) 7272 : cluster [DBG] pgmap v5043: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:25:14.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:25:14 smithi157 bash[24585]: audit 2024-09-16T08:25:13.220378+0000 mgr.a (mgr.14373) 7273 : audit [DBG] from='client.164553 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:25:14.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:25:14 smithi086 bash[24289]: cluster 2024-09-16T08:25:12.856024+0000 mgr.a (mgr.14373) 7272 : cluster [DBG] pgmap v5043: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:25:14.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:25:14 smithi086 bash[24289]: audit 2024-09-16T08:25:13.220378+0000 mgr.a (mgr.14373) 7273 : audit [DBG] from='client.164553 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:25:14.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:25:14 smithi047 bash[22744]: cluster 2024-09-16T08:25:12.856024+0000 mgr.a (mgr.14373) 7272 : cluster [DBG] pgmap v5043: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:25:14.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:25:14 smithi047 bash[22744]: audit 2024-09-16T08:25:13.220378+0000 mgr.a (mgr.14373) 7273 : audit [DBG] from='client.164553 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:25:16.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:25:16 smithi157 bash[24585]: cluster 2024-09-16T08:25:14.856936+0000 mgr.a (mgr.14373) 7274 : cluster [DBG] pgmap v5044: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:25:16.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:25:16 smithi086 bash[24289]: cluster 2024-09-16T08:25:14.856936+0000 mgr.a (mgr.14373) 7274 : cluster [DBG] pgmap v5044: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:25:16.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:25:16 smithi047 bash[22744]: cluster 2024-09-16T08:25:14.856936+0000 mgr.a (mgr.14373) 7274 : cluster [DBG] pgmap v5044: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:25:18.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:25:18 smithi157 bash[24585]: cluster 2024-09-16T08:25:16.859111+0000 mgr.a (mgr.14373) 7275 : cluster [DBG] pgmap v5045: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:25:18.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:25:18 smithi086 bash[24289]: cluster 2024-09-16T08:25:16.859111+0000 mgr.a (mgr.14373) 7275 : cluster [DBG] pgmap v5045: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:25:18.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:25:18 smithi047 bash[22744]: cluster 2024-09-16T08:25:16.859111+0000 mgr.a (mgr.14373) 7275 : cluster [DBG] pgmap v5045: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:25:18.656 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:25:18.657 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:25:18.658 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:25:19.446 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:25:19.446 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:25:19.446 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:25:19.446 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:25:19.447 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:25:20.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:25:20 smithi157 bash[24585]: cluster 2024-09-16T08:25:18.859846+0000 mgr.a (mgr.14373) 7276 : cluster [DBG] pgmap v5046: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:25:20.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:25:20 smithi157 bash[24585]: audit 2024-09-16T08:25:18.994810+0000 mgr.a (mgr.14373) 7277 : audit [DBG] from='client.164628 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:25:20.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:25:20 smithi086 bash[24289]: cluster 2024-09-16T08:25:18.859846+0000 mgr.a (mgr.14373) 7276 : cluster [DBG] pgmap v5046: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:25:20.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:25:20 smithi086 bash[24289]: audit 2024-09-16T08:25:18.994810+0000 mgr.a (mgr.14373) 7277 : audit [DBG] from='client.164628 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:25:20.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:25:20 smithi047 bash[22744]: cluster 2024-09-16T08:25:18.859846+0000 mgr.a (mgr.14373) 7276 : cluster [DBG] pgmap v5046: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:25:20.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:25:20 smithi047 bash[22744]: audit 2024-09-16T08:25:18.994810+0000 mgr.a (mgr.14373) 7277 : audit [DBG] from='client.164628 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:25:22.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:25:22 smithi157 bash[24585]: cluster 2024-09-16T08:25:20.860722+0000 mgr.a (mgr.14373) 7278 : cluster [DBG] pgmap v5047: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:25:22.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:25:22 smithi086 bash[24289]: cluster 2024-09-16T08:25:20.860722+0000 mgr.a (mgr.14373) 7278 : cluster [DBG] pgmap v5047: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:25:22.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:25:22 smithi047 bash[22744]: cluster 2024-09-16T08:25:20.860722+0000 mgr.a (mgr.14373) 7278 : cluster [DBG] pgmap v5047: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:25:24.448 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:25:24.448 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:25:24.448 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:25:24.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:25:24 smithi157 bash[24585]: cluster 2024-09-16T08:25:22.863042+0000 mgr.a (mgr.14373) 7279 : cluster [DBG] pgmap v5048: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:25:24.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:25:24 smithi086 bash[24289]: cluster 2024-09-16T08:25:22.863042+0000 mgr.a (mgr.14373) 7279 : cluster [DBG] pgmap v5048: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:25:24.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:25:24 smithi047 bash[22744]: cluster 2024-09-16T08:25:22.863042+0000 mgr.a (mgr.14373) 7279 : cluster [DBG] pgmap v5048: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:25:25.195 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:25:25.195 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:25:25.195 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:25:25.195 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:25:25.195 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:25:26.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:25:26 smithi157 bash[24585]: audit 2024-09-16T08:25:24.779264+0000 mgr.a (mgr.14373) 7280 : audit [DBG] from='client.164703 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:25:26.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:25:26 smithi157 bash[24585]: cluster 2024-09-16T08:25:24.863646+0000 mgr.a (mgr.14373) 7281 : cluster [DBG] pgmap v5049: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:25:26.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:25:26 smithi086 bash[24289]: audit 2024-09-16T08:25:24.779264+0000 mgr.a (mgr.14373) 7280 : audit [DBG] from='client.164703 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:25:26.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:25:26 smithi086 bash[24289]: cluster 2024-09-16T08:25:24.863646+0000 mgr.a (mgr.14373) 7281 : cluster [DBG] pgmap v5049: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:25:26.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:25:26 smithi047 bash[22744]: audit 2024-09-16T08:25:24.779264+0000 mgr.a (mgr.14373) 7280 : audit [DBG] from='client.164703 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:25:26.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:25:26 smithi047 bash[22744]: cluster 2024-09-16T08:25:24.863646+0000 mgr.a (mgr.14373) 7281 : cluster [DBG] pgmap v5049: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:25:28.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:25:28 smithi086 bash[24289]: cluster 2024-09-16T08:25:26.865903+0000 mgr.a (mgr.14373) 7282 : cluster [DBG] pgmap v5050: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:25:28.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:25:28 smithi047 bash[22744]: cluster 2024-09-16T08:25:26.865903+0000 mgr.a (mgr.14373) 7282 : cluster [DBG] pgmap v5050: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:25:28.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:25:28 smithi157 bash[24585]: cluster 2024-09-16T08:25:26.865903+0000 mgr.a (mgr.14373) 7282 : cluster [DBG] pgmap v5050: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:25:30.196 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:25:30.197 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:25:30.197 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:25:30.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:25:30 smithi086 bash[24289]: cluster 2024-09-16T08:25:28.866678+0000 mgr.a (mgr.14373) 7283 : cluster [DBG] pgmap v5051: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:25:30.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:25:30 smithi047 bash[22744]: cluster 2024-09-16T08:25:28.866678+0000 mgr.a (mgr.14373) 7283 : cluster [DBG] pgmap v5051: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:25:30.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:25:30 smithi157 bash[24585]: cluster 2024-09-16T08:25:28.866678+0000 mgr.a (mgr.14373) 7283 : cluster [DBG] pgmap v5051: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:25:31.004 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:25:31.004 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:25:31.005 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:25:31.005 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:25:31.005 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:25:31.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:25:31 smithi047 bash[22744]: audit 2024-09-16T08:25:30.440672+0000 mon.b (mon.2) 690 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T08:25:31.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:25:31 smithi047 bash[22744]: audit 2024-09-16T08:25:30.539443+0000 mgr.a (mgr.14373) 7284 : audit [DBG] from='client.164778 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:25:31.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:25:31 smithi047 bash[22744]: audit 2024-09-16T08:25:31.261192+0000 mon.b (mon.2) 691 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T08:25:31.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:25:31 smithi047 bash[22744]: audit 2024-09-16T08:25:31.263656+0000 mon.b (mon.2) 692 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T08:25:31.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:25:31 smithi047 bash[22744]: audit 2024-09-16T08:25:31.275976+0000 mon.a (mon.0) 1001 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:25:31.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:25:31 smithi047 bash[22744]: audit 2024-09-16T08:25:31.280503+0000 mon.b (mon.2) 693 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:25:31.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:25:31 smithi157 bash[24585]: audit 2024-09-16T08:25:30.440672+0000 mon.b (mon.2) 690 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T08:25:31.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:25:31 smithi157 bash[24585]: audit 2024-09-16T08:25:30.539443+0000 mgr.a (mgr.14373) 7284 : audit [DBG] from='client.164778 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:25:31.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:25:31 smithi157 bash[24585]: audit 2024-09-16T08:25:31.261192+0000 mon.b (mon.2) 691 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T08:25:31.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:25:31 smithi157 bash[24585]: audit 2024-09-16T08:25:31.263656+0000 mon.b (mon.2) 692 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T08:25:31.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:25:31 smithi157 bash[24585]: audit 2024-09-16T08:25:31.275976+0000 mon.a (mon.0) 1001 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:25:31.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:25:31 smithi157 bash[24585]: audit 2024-09-16T08:25:31.280503+0000 mon.b (mon.2) 693 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:25:31.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:25:31 smithi086 bash[24289]: audit 2024-09-16T08:25:30.440672+0000 mon.b (mon.2) 690 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T08:25:31.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:25:31 smithi086 bash[24289]: audit 2024-09-16T08:25:30.539443+0000 mgr.a (mgr.14373) 7284 : audit [DBG] from='client.164778 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:25:31.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:25:31 smithi086 bash[24289]: audit 2024-09-16T08:25:31.261192+0000 mon.b (mon.2) 691 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T08:25:31.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:25:31 smithi086 bash[24289]: audit 2024-09-16T08:25:31.263656+0000 mon.b (mon.2) 692 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T08:25:31.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:25:31 smithi086 bash[24289]: audit 2024-09-16T08:25:31.275976+0000 mon.a (mon.0) 1001 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:25:31.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:25:31 smithi086 bash[24289]: audit 2024-09-16T08:25:31.280503+0000 mon.b (mon.2) 693 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:25:32.318 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 08:25:32 smithi047 bash[22994]: debug 2024-09-16T08:25:32.006+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T08:25:32.318 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 08:25:32 smithi047 bash[22994]: debug 2024-09-16T08:25:32.010+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T08:25:32.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:25:32 smithi047 bash[22744]: cluster 2024-09-16T08:25:30.867256+0000 mgr.a (mgr.14373) 7285 : cluster [DBG] pgmap v5052: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:25:32.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:25:32 smithi047 bash[22744]: audit 2024-09-16T08:25:31.283083+0000 mgr.a (mgr.14373) 7286 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:25:32.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:25:32 smithi157 bash[24585]: cluster 2024-09-16T08:25:30.867256+0000 mgr.a (mgr.14373) 7285 : cluster [DBG] pgmap v5052: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:25:32.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:25:32 smithi157 bash[24585]: audit 2024-09-16T08:25:31.283083+0000 mgr.a (mgr.14373) 7286 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:25:32.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:25:32 smithi086 bash[24289]: cluster 2024-09-16T08:25:30.867256+0000 mgr.a (mgr.14373) 7285 : cluster [DBG] pgmap v5052: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:25:32.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:25:32 smithi086 bash[24289]: audit 2024-09-16T08:25:31.283083+0000 mgr.a (mgr.14373) 7286 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:25:33.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:25:33 smithi047 bash[22744]: audit 2024-09-16T08:25:32.008479+0000 mgr.a (mgr.14373) 7287 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T08:25:33.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:25:33 smithi047 bash[22744]: cephadm 2024-09-16T08:25:32.010632+0000 mgr.a (mgr.14373) 7288 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T08:25:33.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:25:33 smithi157 bash[24585]: audit 2024-09-16T08:25:32.008479+0000 mgr.a (mgr.14373) 7287 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T08:25:33.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:25:33 smithi157 bash[24585]: cephadm 2024-09-16T08:25:32.010632+0000 mgr.a (mgr.14373) 7288 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T08:25:33.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:25:33 smithi086 bash[24289]: audit 2024-09-16T08:25:32.008479+0000 mgr.a (mgr.14373) 7287 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T08:25:33.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:25:33 smithi086 bash[24289]: cephadm 2024-09-16T08:25:32.010632+0000 mgr.a (mgr.14373) 7288 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T08:25:34.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:25:34 smithi047 bash[22744]: cluster 2024-09-16T08:25:32.869886+0000 mgr.a (mgr.14373) 7289 : cluster [DBG] pgmap v5053: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 3.3 KiB/s rd, 2 op/s 2024-09-16T08:25:34.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:25:34 smithi157 bash[24585]: cluster 2024-09-16T08:25:32.869886+0000 mgr.a (mgr.14373) 7289 : cluster [DBG] pgmap v5053: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 3.3 KiB/s rd, 2 op/s 2024-09-16T08:25:34.816 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:25:34 smithi086 bash[24289]: cluster 2024-09-16T08:25:32.869886+0000 mgr.a (mgr.14373) 7289 : cluster [DBG] pgmap v5053: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 3.3 KiB/s rd, 2 op/s 2024-09-16T08:25:36.006 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:25:36.007 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:25:36.007 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:25:36.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:25:36 smithi047 bash[22744]: cluster 2024-09-16T08:25:34.870731+0000 mgr.a (mgr.14373) 7290 : cluster [DBG] pgmap v5054: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.4 KiB/s rd, 2 op/s 2024-09-16T08:25:36.792 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:25:36.792 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:25:36.793 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:25:36.793 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:25:36.793 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:25:36.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:25:36 smithi157 bash[24585]: cluster 2024-09-16T08:25:34.870731+0000 mgr.a (mgr.14373) 7290 : cluster [DBG] pgmap v5054: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.4 KiB/s rd, 2 op/s 2024-09-16T08:25:36.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:25:36 smithi086 bash[24289]: cluster 2024-09-16T08:25:34.870731+0000 mgr.a (mgr.14373) 7290 : cluster [DBG] pgmap v5054: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.4 KiB/s rd, 2 op/s 2024-09-16T08:25:37.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:25:37 smithi157 bash[24585]: audit 2024-09-16T08:25:36.346021+0000 mgr.a (mgr.14373) 7291 : audit [DBG] from='client.164961 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:25:37.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:25:37 smithi086 bash[24289]: audit 2024-09-16T08:25:36.346021+0000 mgr.a (mgr.14373) 7291 : audit [DBG] from='client.164961 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:25:37.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:25:37 smithi047 bash[22744]: audit 2024-09-16T08:25:36.346021+0000 mgr.a (mgr.14373) 7291 : audit [DBG] from='client.164961 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:25:38.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:25:38 smithi157 bash[24585]: cluster 2024-09-16T08:25:36.873417+0000 mgr.a (mgr.14373) 7292 : cluster [DBG] pgmap v5055: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:25:38.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:25:38 smithi086 bash[24289]: cluster 2024-09-16T08:25:36.873417+0000 mgr.a (mgr.14373) 7292 : cluster [DBG] pgmap v5055: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:25:38.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:25:38 smithi047 bash[22744]: cluster 2024-09-16T08:25:36.873417+0000 mgr.a (mgr.14373) 7292 : cluster [DBG] pgmap v5055: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:25:40.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:25:40 smithi157 bash[24585]: cluster 2024-09-16T08:25:38.874218+0000 mgr.a (mgr.14373) 7293 : cluster [DBG] pgmap v5056: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T08:25:40.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:25:40 smithi086 bash[24289]: cluster 2024-09-16T08:25:38.874218+0000 mgr.a (mgr.14373) 7293 : cluster [DBG] pgmap v5056: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T08:25:40.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:25:40 smithi047 bash[22744]: cluster 2024-09-16T08:25:38.874218+0000 mgr.a (mgr.14373) 7293 : cluster [DBG] pgmap v5056: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T08:25:41.794 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:25:41.794 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:25:41.794 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:25:42.556 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:25:42.556 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:25:42.556 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:25:42.556 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:25:42.557 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:25:42.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:25:42 smithi157 bash[24585]: cluster 2024-09-16T08:25:40.874982+0000 mgr.a (mgr.14373) 7294 : cluster [DBG] pgmap v5057: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T08:25:42.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:25:42 smithi086 bash[24289]: cluster 2024-09-16T08:25:40.874982+0000 mgr.a (mgr.14373) 7294 : cluster [DBG] pgmap v5057: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T08:25:42.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:25:42 smithi047 bash[22744]: cluster 2024-09-16T08:25:40.874982+0000 mgr.a (mgr.14373) 7294 : cluster [DBG] pgmap v5057: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T08:25:43.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:25:43 smithi157 bash[24585]: audit 2024-09-16T08:25:42.125861+0000 mgr.a (mgr.14373) 7295 : audit [DBG] from='client.165036 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:25:43.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:25:43 smithi086 bash[24289]: audit 2024-09-16T08:25:42.125861+0000 mgr.a (mgr.14373) 7295 : audit [DBG] from='client.165036 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:25:43.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:25:43 smithi047 bash[22744]: audit 2024-09-16T08:25:42.125861+0000 mgr.a (mgr.14373) 7295 : audit [DBG] from='client.165036 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:25:44.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:25:44 smithi157 bash[24585]: cluster 2024-09-16T08:25:42.877740+0000 mgr.a (mgr.14373) 7296 : cluster [DBG] pgmap v5058: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:25:44.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:25:44 smithi086 bash[24289]: cluster 2024-09-16T08:25:42.877740+0000 mgr.a (mgr.14373) 7296 : cluster [DBG] pgmap v5058: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:25:44.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:25:44 smithi047 bash[22744]: cluster 2024-09-16T08:25:42.877740+0000 mgr.a (mgr.14373) 7296 : cluster [DBG] pgmap v5058: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:25:46.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:25:46 smithi157 bash[24585]: cluster 2024-09-16T08:25:44.878542+0000 mgr.a (mgr.14373) 7297 : cluster [DBG] pgmap v5059: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 5.5 KiB/s rd, 426 B/s wr, 5 op/s 2024-09-16T08:25:46.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:25:46 smithi086 bash[24289]: cluster 2024-09-16T08:25:44.878542+0000 mgr.a (mgr.14373) 7297 : cluster [DBG] pgmap v5059: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 5.5 KiB/s rd, 426 B/s wr, 5 op/s 2024-09-16T08:25:46.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:25:46 smithi047 bash[22744]: cluster 2024-09-16T08:25:44.878542+0000 mgr.a (mgr.14373) 7297 : cluster [DBG] pgmap v5059: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 5.5 KiB/s rd, 426 B/s wr, 5 op/s 2024-09-16T08:25:47.558 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:25:47.559 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:25:47.559 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:25:48.306 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:25:48.306 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:25:48.306 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:25:48.306 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:25:48.306 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:25:48.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:25:48 smithi157 bash[24585]: cluster 2024-09-16T08:25:46.880492+0000 mgr.a (mgr.14373) 7298 : cluster [DBG] pgmap v5060: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 6.4 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T08:25:48.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:25:48 smithi086 bash[24289]: cluster 2024-09-16T08:25:46.880492+0000 mgr.a (mgr.14373) 7298 : cluster [DBG] pgmap v5060: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 6.4 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T08:25:48.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:25:48 smithi047 bash[22744]: cluster 2024-09-16T08:25:46.880492+0000 mgr.a (mgr.14373) 7298 : cluster [DBG] pgmap v5060: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 6.4 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T08:25:49.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:25:49 smithi157 bash[24585]: audit 2024-09-16T08:25:47.891633+0000 mgr.a (mgr.14373) 7299 : audit [DBG] from='client.165114 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:25:49.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:25:49 smithi086 bash[24289]: audit 2024-09-16T08:25:47.891633+0000 mgr.a (mgr.14373) 7299 : audit [DBG] from='client.165114 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:25:49.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:25:49 smithi047 bash[22744]: audit 2024-09-16T08:25:47.891633+0000 mgr.a (mgr.14373) 7299 : audit [DBG] from='client.165114 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:25:50.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:25:50 smithi157 bash[24585]: cluster 2024-09-16T08:25:48.881458+0000 mgr.a (mgr.14373) 7300 : cluster [DBG] pgmap v5061: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:25:50.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:25:50 smithi086 bash[24289]: cluster 2024-09-16T08:25:48.881458+0000 mgr.a (mgr.14373) 7300 : cluster [DBG] pgmap v5061: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:25:50.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:25:50 smithi047 bash[22744]: cluster 2024-09-16T08:25:48.881458+0000 mgr.a (mgr.14373) 7300 : cluster [DBG] pgmap v5061: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:25:52.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:25:52 smithi157 bash[24585]: cluster 2024-09-16T08:25:50.882234+0000 mgr.a (mgr.14373) 7301 : cluster [DBG] pgmap v5062: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:25:52.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:25:52 smithi086 bash[24289]: cluster 2024-09-16T08:25:50.882234+0000 mgr.a (mgr.14373) 7301 : cluster [DBG] pgmap v5062: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:25:52.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:25:52 smithi047 bash[22744]: cluster 2024-09-16T08:25:50.882234+0000 mgr.a (mgr.14373) 7301 : cluster [DBG] pgmap v5062: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:25:53.307 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:25:53.308 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:25:53.308 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:25:54.052 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:25:54.052 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:25:54.052 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:25:54.052 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:25:54.052 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:25:54.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:25:54 smithi157 bash[24585]: cluster 2024-09-16T08:25:52.884491+0000 mgr.a (mgr.14373) 7302 : cluster [DBG] pgmap v5063: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:25:54.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:25:54 smithi086 bash[24289]: cluster 2024-09-16T08:25:52.884491+0000 mgr.a (mgr.14373) 7302 : cluster [DBG] pgmap v5063: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:25:54.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:25:54 smithi047 bash[22744]: cluster 2024-09-16T08:25:52.884491+0000 mgr.a (mgr.14373) 7302 : cluster [DBG] pgmap v5063: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:25:55.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:25:55 smithi157 bash[24585]: audit 2024-09-16T08:25:53.640506+0000 mgr.a (mgr.14373) 7303 : audit [DBG] from='client.165189 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:25:55.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:25:55 smithi086 bash[24289]: audit 2024-09-16T08:25:53.640506+0000 mgr.a (mgr.14373) 7303 : audit [DBG] from='client.165189 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:25:55.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:25:55 smithi047 bash[22744]: audit 2024-09-16T08:25:53.640506+0000 mgr.a (mgr.14373) 7303 : audit [DBG] from='client.165189 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:25:56.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:25:56 smithi157 bash[24585]: cluster 2024-09-16T08:25:54.885471+0000 mgr.a (mgr.14373) 7304 : cluster [DBG] pgmap v5064: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:25:56.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:25:56 smithi086 bash[24289]: cluster 2024-09-16T08:25:54.885471+0000 mgr.a (mgr.14373) 7304 : cluster [DBG] pgmap v5064: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:25:56.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:25:56 smithi047 bash[22744]: cluster 2024-09-16T08:25:54.885471+0000 mgr.a (mgr.14373) 7304 : cluster [DBG] pgmap v5064: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:25:58.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:25:58 smithi157 bash[24585]: cluster 2024-09-16T08:25:56.887693+0000 mgr.a (mgr.14373) 7305 : cluster [DBG] pgmap v5065: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:25:58.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:25:58 smithi086 bash[24289]: cluster 2024-09-16T08:25:56.887693+0000 mgr.a (mgr.14373) 7305 : cluster [DBG] pgmap v5065: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:25:58.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:25:58 smithi047 bash[22744]: cluster 2024-09-16T08:25:56.887693+0000 mgr.a (mgr.14373) 7305 : cluster [DBG] pgmap v5065: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:25:59.053 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:25:59.054 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:25:59.054 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:25:59.828 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:25:59.828 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:25:59.828 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:25:59.828 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:25:59.829 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:26:00.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:26:00 smithi157 bash[24585]: cluster 2024-09-16T08:25:58.888495+0000 mgr.a (mgr.14373) 7306 : cluster [DBG] pgmap v5066: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:26:00.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:26:00 smithi157 bash[24585]: audit 2024-09-16T08:25:59.392935+0000 mgr.a (mgr.14373) 7307 : audit [DBG] from='client.165267 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:26:00.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:26:00 smithi086 bash[24289]: cluster 2024-09-16T08:25:58.888495+0000 mgr.a (mgr.14373) 7306 : cluster [DBG] pgmap v5066: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:26:00.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:26:00 smithi086 bash[24289]: audit 2024-09-16T08:25:59.392935+0000 mgr.a (mgr.14373) 7307 : audit [DBG] from='client.165267 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:26:00.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:26:00 smithi047 bash[22744]: cluster 2024-09-16T08:25:58.888495+0000 mgr.a (mgr.14373) 7306 : cluster [DBG] pgmap v5066: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:26:00.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:26:00 smithi047 bash[22744]: audit 2024-09-16T08:25:59.392935+0000 mgr.a (mgr.14373) 7307 : audit [DBG] from='client.165267 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:26:02.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:26:02 smithi157 bash[24585]: cluster 2024-09-16T08:26:00.889479+0000 mgr.a (mgr.14373) 7308 : cluster [DBG] pgmap v5067: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:26:02.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:26:02 smithi086 bash[24289]: cluster 2024-09-16T08:26:00.889479+0000 mgr.a (mgr.14373) 7308 : cluster [DBG] pgmap v5067: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:26:02.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:26:02 smithi047 bash[22744]: cluster 2024-09-16T08:26:00.889479+0000 mgr.a (mgr.14373) 7308 : cluster [DBG] pgmap v5067: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:26:04.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:26:04 smithi157 bash[24585]: cluster 2024-09-16T08:26:02.891767+0000 mgr.a (mgr.14373) 7309 : cluster [DBG] pgmap v5068: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:26:04.816 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:26:04 smithi086 bash[24289]: cluster 2024-09-16T08:26:02.891767+0000 mgr.a (mgr.14373) 7309 : cluster [DBG] pgmap v5068: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:26:04.829 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:26:04.830 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:26:04.830 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:26:04.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:26:04 smithi047 bash[22744]: cluster 2024-09-16T08:26:02.891767+0000 mgr.a (mgr.14373) 7309 : cluster [DBG] pgmap v5068: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:26:05.613 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:26:05.614 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:26:05.614 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:26:05.614 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:26:05.614 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:26:06.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:26:06 smithi157 bash[24585]: cluster 2024-09-16T08:26:04.892302+0000 mgr.a (mgr.14373) 7310 : cluster [DBG] pgmap v5069: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:26:06.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:26:06 smithi157 bash[24585]: audit 2024-09-16T08:26:05.167329+0000 mgr.a (mgr.14373) 7311 : audit [DBG] from='client.165345 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:26:06.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:26:06 smithi086 bash[24289]: cluster 2024-09-16T08:26:04.892302+0000 mgr.a (mgr.14373) 7310 : cluster [DBG] pgmap v5069: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:26:06.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:26:06 smithi086 bash[24289]: audit 2024-09-16T08:26:05.167329+0000 mgr.a (mgr.14373) 7311 : audit [DBG] from='client.165345 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:26:06.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:26:06 smithi047 bash[22744]: cluster 2024-09-16T08:26:04.892302+0000 mgr.a (mgr.14373) 7310 : cluster [DBG] pgmap v5069: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:26:06.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:26:06 smithi047 bash[22744]: audit 2024-09-16T08:26:05.167329+0000 mgr.a (mgr.14373) 7311 : audit [DBG] from='client.165345 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:26:08.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:26:08 smithi157 bash[24585]: cluster 2024-09-16T08:26:06.894796+0000 mgr.a (mgr.14373) 7312 : cluster [DBG] pgmap v5070: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:26:08.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:26:08 smithi086 bash[24289]: cluster 2024-09-16T08:26:06.894796+0000 mgr.a (mgr.14373) 7312 : cluster [DBG] pgmap v5070: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:26:08.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:26:08 smithi047 bash[22744]: cluster 2024-09-16T08:26:06.894796+0000 mgr.a (mgr.14373) 7312 : cluster [DBG] pgmap v5070: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:26:10.615 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:26:10.616 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:26:10.616 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:26:10.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:26:10 smithi157 bash[24585]: cluster 2024-09-16T08:26:08.895572+0000 mgr.a (mgr.14373) 7313 : cluster [DBG] pgmap v5071: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:26:10.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:26:10 smithi086 bash[24289]: cluster 2024-09-16T08:26:08.895572+0000 mgr.a (mgr.14373) 7313 : cluster [DBG] pgmap v5071: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:26:10.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:26:10 smithi047 bash[22744]: cluster 2024-09-16T08:26:08.895572+0000 mgr.a (mgr.14373) 7313 : cluster [DBG] pgmap v5071: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:26:11.394 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:26:11.395 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:26:11.395 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:26:11.395 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:26:11.395 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:26:12.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:26:12 smithi157 bash[24585]: cluster 2024-09-16T08:26:10.896433+0000 mgr.a (mgr.14373) 7314 : cluster [DBG] pgmap v5072: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:26:12.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:26:12 smithi157 bash[24585]: audit 2024-09-16T08:26:10.961062+0000 mgr.a (mgr.14373) 7315 : audit [DBG] from='client.165420 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:26:12.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:26:12 smithi086 bash[24289]: cluster 2024-09-16T08:26:10.896433+0000 mgr.a (mgr.14373) 7314 : cluster [DBG] pgmap v5072: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:26:12.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:26:12 smithi086 bash[24289]: audit 2024-09-16T08:26:10.961062+0000 mgr.a (mgr.14373) 7315 : audit [DBG] from='client.165420 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:26:12.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:26:12 smithi047 bash[22744]: cluster 2024-09-16T08:26:10.896433+0000 mgr.a (mgr.14373) 7314 : cluster [DBG] pgmap v5072: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:26:12.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:26:12 smithi047 bash[22744]: audit 2024-09-16T08:26:10.961062+0000 mgr.a (mgr.14373) 7315 : audit [DBG] from='client.165420 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:26:14.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:26:14 smithi157 bash[24585]: cluster 2024-09-16T08:26:12.898910+0000 mgr.a (mgr.14373) 7316 : cluster [DBG] pgmap v5073: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:26:14.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:26:14 smithi086 bash[24289]: cluster 2024-09-16T08:26:12.898910+0000 mgr.a (mgr.14373) 7316 : cluster [DBG] pgmap v5073: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:26:14.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:26:14 smithi047 bash[22744]: cluster 2024-09-16T08:26:12.898910+0000 mgr.a (mgr.14373) 7316 : cluster [DBG] pgmap v5073: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:26:16.396 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:26:16.397 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:26:16.397 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:26:16.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:26:16 smithi157 bash[24585]: cluster 2024-09-16T08:26:14.899672+0000 mgr.a (mgr.14373) 7317 : cluster [DBG] pgmap v5074: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:26:16.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:26:16 smithi086 bash[24289]: cluster 2024-09-16T08:26:14.899672+0000 mgr.a (mgr.14373) 7317 : cluster [DBG] pgmap v5074: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:26:16.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:26:16 smithi047 bash[22744]: cluster 2024-09-16T08:26:14.899672+0000 mgr.a (mgr.14373) 7317 : cluster [DBG] pgmap v5074: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:26:17.170 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:26:17.170 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:26:17.170 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:26:17.170 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:26:17.170 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:26:18.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:26:18 smithi157 bash[24585]: audit 2024-09-16T08:26:16.730569+0000 mgr.a (mgr.14373) 7318 : audit [DBG] from='client.165495 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:26:18.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:26:18 smithi157 bash[24585]: cluster 2024-09-16T08:26:16.901041+0000 mgr.a (mgr.14373) 7319 : cluster [DBG] pgmap v5075: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:26:18.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:26:18 smithi086 bash[24289]: audit 2024-09-16T08:26:16.730569+0000 mgr.a (mgr.14373) 7318 : audit [DBG] from='client.165495 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:26:18.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:26:18 smithi086 bash[24289]: cluster 2024-09-16T08:26:16.901041+0000 mgr.a (mgr.14373) 7319 : cluster [DBG] pgmap v5075: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:26:18.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:26:18 smithi047 bash[22744]: audit 2024-09-16T08:26:16.730569+0000 mgr.a (mgr.14373) 7318 : audit [DBG] from='client.165495 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:26:18.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:26:18 smithi047 bash[22744]: cluster 2024-09-16T08:26:16.901041+0000 mgr.a (mgr.14373) 7319 : cluster [DBG] pgmap v5075: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:26:20.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:26:20 smithi157 bash[24585]: cluster 2024-09-16T08:26:18.901913+0000 mgr.a (mgr.14373) 7320 : cluster [DBG] pgmap v5076: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:26:20.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:26:20 smithi086 bash[24289]: cluster 2024-09-16T08:26:18.901913+0000 mgr.a (mgr.14373) 7320 : cluster [DBG] pgmap v5076: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:26:20.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:26:20 smithi047 bash[22744]: cluster 2024-09-16T08:26:18.901913+0000 mgr.a (mgr.14373) 7320 : cluster [DBG] pgmap v5076: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:26:22.171 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:26:22.172 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:26:22.172 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:26:22.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:26:22 smithi157 bash[24585]: cluster 2024-09-16T08:26:20.902695+0000 mgr.a (mgr.14373) 7321 : cluster [DBG] pgmap v5077: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T08:26:22.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:26:22 smithi086 bash[24289]: cluster 2024-09-16T08:26:20.902695+0000 mgr.a (mgr.14373) 7321 : cluster [DBG] pgmap v5077: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T08:26:22.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:26:22 smithi047 bash[22744]: cluster 2024-09-16T08:26:20.902695+0000 mgr.a (mgr.14373) 7321 : cluster [DBG] pgmap v5077: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T08:26:22.955 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:26:22.956 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:26:22.956 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:26:22.956 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:26:22.956 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:26:23.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:26:23 smithi157 bash[24585]: audit 2024-09-16T08:26:22.510588+0000 mgr.a (mgr.14373) 7322 : audit [DBG] from='client.165573 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:26:23.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:26:23 smithi086 bash[24289]: audit 2024-09-16T08:26:22.510588+0000 mgr.a (mgr.14373) 7322 : audit [DBG] from='client.165573 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:26:23.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:26:23 smithi047 bash[22744]: audit 2024-09-16T08:26:22.510588+0000 mgr.a (mgr.14373) 7322 : audit [DBG] from='client.165573 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:26:24.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:26:24 smithi157 bash[24585]: cluster 2024-09-16T08:26:22.904603+0000 mgr.a (mgr.14373) 7323 : cluster [DBG] pgmap v5078: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:26:24.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:26:24 smithi086 bash[24289]: cluster 2024-09-16T08:26:22.904603+0000 mgr.a (mgr.14373) 7323 : cluster [DBG] pgmap v5078: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:26:24.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:26:24 smithi047 bash[22744]: cluster 2024-09-16T08:26:22.904603+0000 mgr.a (mgr.14373) 7323 : cluster [DBG] pgmap v5078: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:26:26.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:26:26 smithi157 bash[24585]: cluster 2024-09-16T08:26:24.905391+0000 mgr.a (mgr.14373) 7324 : cluster [DBG] pgmap v5079: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T08:26:26.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:26:26 smithi086 bash[24289]: cluster 2024-09-16T08:26:24.905391+0000 mgr.a (mgr.14373) 7324 : cluster [DBG] pgmap v5079: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T08:26:26.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:26:26 smithi047 bash[22744]: cluster 2024-09-16T08:26:24.905391+0000 mgr.a (mgr.14373) 7324 : cluster [DBG] pgmap v5079: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T08:26:27.957 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:26:27.958 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:26:27.958 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:26:28.731 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:26:28.731 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:26:28.731 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:26:28.731 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:26:28.731 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:26:28.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:26:28 smithi157 bash[24585]: cluster 2024-09-16T08:26:26.907402+0000 mgr.a (mgr.14373) 7325 : cluster [DBG] pgmap v5080: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:26:28.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:26:28 smithi086 bash[24289]: cluster 2024-09-16T08:26:26.907402+0000 mgr.a (mgr.14373) 7325 : cluster [DBG] pgmap v5080: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:26:28.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:26:28 smithi047 bash[22744]: cluster 2024-09-16T08:26:26.907402+0000 mgr.a (mgr.14373) 7325 : cluster [DBG] pgmap v5080: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:26:29.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:26:29 smithi157 bash[24585]: audit 2024-09-16T08:26:28.293393+0000 mgr.a (mgr.14373) 7326 : audit [DBG] from='client.165648 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:26:29.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:26:29 smithi086 bash[24289]: audit 2024-09-16T08:26:28.293393+0000 mgr.a (mgr.14373) 7326 : audit [DBG] from='client.165648 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:26:29.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:26:29 smithi047 bash[22744]: audit 2024-09-16T08:26:28.293393+0000 mgr.a (mgr.14373) 7326 : audit [DBG] from='client.165648 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:26:30.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:26:30 smithi157 bash[24585]: cluster 2024-09-16T08:26:28.908382+0000 mgr.a (mgr.14373) 7327 : cluster [DBG] pgmap v5081: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:26:30.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:26:30 smithi086 bash[24289]: cluster 2024-09-16T08:26:28.908382+0000 mgr.a (mgr.14373) 7327 : cluster [DBG] pgmap v5081: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:26:30.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:26:30 smithi047 bash[22744]: cluster 2024-09-16T08:26:28.908382+0000 mgr.a (mgr.14373) 7327 : cluster [DBG] pgmap v5081: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:26:32.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:26:32 smithi157 bash[24585]: cluster 2024-09-16T08:26:30.909179+0000 mgr.a (mgr.14373) 7328 : cluster [DBG] pgmap v5082: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:26:32.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:26:32 smithi157 bash[24585]: audit 2024-09-16T08:26:32.061445+0000 mon.b (mon.2) 694 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T08:26:32.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:26:32 smithi086 bash[24289]: cluster 2024-09-16T08:26:30.909179+0000 mgr.a (mgr.14373) 7328 : cluster [DBG] pgmap v5082: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:26:32.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:26:32 smithi086 bash[24289]: audit 2024-09-16T08:26:32.061445+0000 mon.b (mon.2) 694 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T08:26:32.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:26:32 smithi047 bash[22744]: cluster 2024-09-16T08:26:30.909179+0000 mgr.a (mgr.14373) 7328 : cluster [DBG] pgmap v5082: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:26:32.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:26:32 smithi047 bash[22744]: audit 2024-09-16T08:26:32.061445+0000 mon.b (mon.2) 694 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T08:26:33.733 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:26:33.733 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:26:33.734 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:26:34.469 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:26:34.469 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:26:34.469 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:26:34.469 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:26:34.469 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:26:34.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:26:34 smithi157 bash[24585]: cluster 2024-09-16T08:26:32.911443+0000 mgr.a (mgr.14373) 7329 : cluster [DBG] pgmap v5083: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:26:34.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:26:34 smithi086 bash[24289]: cluster 2024-09-16T08:26:32.911443+0000 mgr.a (mgr.14373) 7329 : cluster [DBG] pgmap v5083: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:26:34.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:26:34 smithi047 bash[22744]: cluster 2024-09-16T08:26:32.911443+0000 mgr.a (mgr.14373) 7329 : cluster [DBG] pgmap v5083: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:26:35.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:26:35 smithi157 bash[24585]: audit 2024-09-16T08:26:34.065234+0000 mgr.a (mgr.14373) 7330 : audit [DBG] from='client.165723 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:26:35.816 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:26:35 smithi086 bash[24289]: audit 2024-09-16T08:26:34.065234+0000 mgr.a (mgr.14373) 7330 : audit [DBG] from='client.165723 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:26:35.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:26:35 smithi047 bash[22744]: audit 2024-09-16T08:26:34.065234+0000 mgr.a (mgr.14373) 7330 : audit [DBG] from='client.165723 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:26:36.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:26:36 smithi157 bash[24585]: cluster 2024-09-16T08:26:34.912409+0000 mgr.a (mgr.14373) 7331 : cluster [DBG] pgmap v5084: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:26:36.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:26:36 smithi086 bash[24289]: cluster 2024-09-16T08:26:34.912409+0000 mgr.a (mgr.14373) 7331 : cluster [DBG] pgmap v5084: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:26:36.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:26:36 smithi047 bash[22744]: cluster 2024-09-16T08:26:34.912409+0000 mgr.a (mgr.14373) 7331 : cluster [DBG] pgmap v5084: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:26:38.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:26:38 smithi157 bash[24585]: cluster 2024-09-16T08:26:36.914713+0000 mgr.a (mgr.14373) 7332 : cluster [DBG] pgmap v5085: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:26:38.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:26:38 smithi157 bash[24585]: audit 2024-09-16T08:26:37.413827+0000 mon.a (mon.0) 1002 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:26:38.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:26:38 smithi157 bash[24585]: audit 2024-09-16T08:26:37.419092+0000 mon.a (mon.0) 1003 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:26:38.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:26:38 smithi157 bash[24585]: audit 2024-09-16T08:26:37.434167+0000 mon.a (mon.0) 1004 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:26:38.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:26:38 smithi157 bash[24585]: audit 2024-09-16T08:26:37.439439+0000 mon.a (mon.0) 1005 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:26:38.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:26:38 smithi157 bash[24585]: audit 2024-09-16T08:26:37.454895+0000 mon.a (mon.0) 1006 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:26:38.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:26:38 smithi157 bash[24585]: audit 2024-09-16T08:26:37.465962+0000 mon.a (mon.0) 1007 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:26:38.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:26:38 smithi157 bash[24585]: audit 2024-09-16T08:26:38.176539+0000 mon.b (mon.2) 695 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T08:26:38.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:26:38 smithi157 bash[24585]: audit 2024-09-16T08:26:38.178789+0000 mon.b (mon.2) 696 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T08:26:38.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:26:38 smithi157 bash[24585]: audit 2024-09-16T08:26:38.191802+0000 mon.a (mon.0) 1008 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:26:38.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:26:38 smithi157 bash[24585]: audit 2024-09-16T08:26:38.196637+0000 mon.b (mon.2) 697 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:26:38.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:26:38 smithi086 bash[24289]: cluster 2024-09-16T08:26:36.914713+0000 mgr.a (mgr.14373) 7332 : cluster [DBG] pgmap v5085: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:26:38.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:26:38 smithi086 bash[24289]: audit 2024-09-16T08:26:37.413827+0000 mon.a (mon.0) 1002 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:26:38.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:26:38 smithi086 bash[24289]: audit 2024-09-16T08:26:37.419092+0000 mon.a (mon.0) 1003 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:26:38.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:26:38 smithi086 bash[24289]: audit 2024-09-16T08:26:37.434167+0000 mon.a (mon.0) 1004 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:26:38.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:26:38 smithi086 bash[24289]: audit 2024-09-16T08:26:37.439439+0000 mon.a (mon.0) 1005 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:26:38.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:26:38 smithi086 bash[24289]: audit 2024-09-16T08:26:37.454895+0000 mon.a (mon.0) 1006 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:26:38.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:26:38 smithi086 bash[24289]: audit 2024-09-16T08:26:37.465962+0000 mon.a (mon.0) 1007 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:26:38.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:26:38 smithi086 bash[24289]: audit 2024-09-16T08:26:38.176539+0000 mon.b (mon.2) 695 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T08:26:38.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:26:38 smithi086 bash[24289]: audit 2024-09-16T08:26:38.178789+0000 mon.b (mon.2) 696 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T08:26:38.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:26:38 smithi086 bash[24289]: audit 2024-09-16T08:26:38.191802+0000 mon.a (mon.0) 1008 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:26:38.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:26:38 smithi086 bash[24289]: audit 2024-09-16T08:26:38.196637+0000 mon.b (mon.2) 697 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:26:38.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:26:38 smithi047 bash[22744]: cluster 2024-09-16T08:26:36.914713+0000 mgr.a (mgr.14373) 7332 : cluster [DBG] pgmap v5085: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:26:38.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:26:38 smithi047 bash[22744]: audit 2024-09-16T08:26:37.413827+0000 mon.a (mon.0) 1002 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:26:38.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:26:38 smithi047 bash[22744]: audit 2024-09-16T08:26:37.419092+0000 mon.a (mon.0) 1003 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:26:38.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:26:38 smithi047 bash[22744]: audit 2024-09-16T08:26:37.434167+0000 mon.a (mon.0) 1004 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:26:38.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:26:38 smithi047 bash[22744]: audit 2024-09-16T08:26:37.439439+0000 mon.a (mon.0) 1005 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:26:38.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:26:38 smithi047 bash[22744]: audit 2024-09-16T08:26:37.454895+0000 mon.a (mon.0) 1006 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:26:38.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:26:38 smithi047 bash[22744]: audit 2024-09-16T08:26:37.465962+0000 mon.a (mon.0) 1007 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:26:38.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:26:38 smithi047 bash[22744]: audit 2024-09-16T08:26:38.176539+0000 mon.b (mon.2) 695 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T08:26:38.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:26:38 smithi047 bash[22744]: audit 2024-09-16T08:26:38.178789+0000 mon.b (mon.2) 696 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T08:26:38.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:26:38 smithi047 bash[22744]: audit 2024-09-16T08:26:38.191802+0000 mon.a (mon.0) 1008 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:26:38.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:26:38 smithi047 bash[22744]: audit 2024-09-16T08:26:38.196637+0000 mon.b (mon.2) 697 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:26:39.338 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 08:26:38 smithi047 bash[22994]: debug 2024-09-16T08:26:38.936+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T08:26:39.338 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 08:26:38 smithi047 bash[22994]: debug 2024-09-16T08:26:38.940+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T08:26:39.470 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:26:39.471 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:26:39.471 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:26:39.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:26:39 smithi157 bash[24585]: audit 2024-09-16T08:26:38.200221+0000 mgr.a (mgr.14373) 7333 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:26:39.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:26:39 smithi086 bash[24289]: audit 2024-09-16T08:26:38.200221+0000 mgr.a (mgr.14373) 7333 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:26:39.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:26:39 smithi047 bash[22744]: audit 2024-09-16T08:26:38.200221+0000 mgr.a (mgr.14373) 7333 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:26:40.224 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:26:40.225 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:26:40.225 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:26:40.225 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:26:40.225 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:26:40.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:26:40 smithi157 bash[24585]: cluster 2024-09-16T08:26:38.915326+0000 mgr.a (mgr.14373) 7334 : cluster [DBG] pgmap v5086: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:26:40.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:26:40 smithi157 bash[24585]: audit 2024-09-16T08:26:38.941413+0000 mgr.a (mgr.14373) 7335 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T08:26:40.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:26:40 smithi157 bash[24585]: cephadm 2024-09-16T08:26:38.943412+0000 mgr.a (mgr.14373) 7336 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T08:26:40.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:26:40 smithi086 bash[24289]: cluster 2024-09-16T08:26:38.915326+0000 mgr.a (mgr.14373) 7334 : cluster [DBG] pgmap v5086: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:26:40.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:26:40 smithi086 bash[24289]: audit 2024-09-16T08:26:38.941413+0000 mgr.a (mgr.14373) 7335 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T08:26:40.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:26:40 smithi086 bash[24289]: cephadm 2024-09-16T08:26:38.943412+0000 mgr.a (mgr.14373) 7336 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T08:26:40.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:26:40 smithi047 bash[22744]: cluster 2024-09-16T08:26:38.915326+0000 mgr.a (mgr.14373) 7334 : cluster [DBG] pgmap v5086: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:26:40.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:26:40 smithi047 bash[22744]: audit 2024-09-16T08:26:38.941413+0000 mgr.a (mgr.14373) 7335 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T08:26:40.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:26:40 smithi047 bash[22744]: cephadm 2024-09-16T08:26:38.943412+0000 mgr.a (mgr.14373) 7336 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T08:26:41.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:26:41 smithi157 bash[24585]: audit 2024-09-16T08:26:39.802919+0000 mgr.a (mgr.14373) 7337 : audit [DBG] from='client.165903 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:26:41.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:26:41 smithi086 bash[24289]: audit 2024-09-16T08:26:39.802919+0000 mgr.a (mgr.14373) 7337 : audit [DBG] from='client.165903 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:26:41.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:26:41 smithi047 bash[22744]: audit 2024-09-16T08:26:39.802919+0000 mgr.a (mgr.14373) 7337 : audit [DBG] from='client.165903 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:26:42.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:26:42 smithi157 bash[24585]: cluster 2024-09-16T08:26:40.916248+0000 mgr.a (mgr.14373) 7338 : cluster [DBG] pgmap v5087: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:26:42.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:26:42 smithi086 bash[24289]: cluster 2024-09-16T08:26:40.916248+0000 mgr.a (mgr.14373) 7338 : cluster [DBG] pgmap v5087: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:26:42.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:26:42 smithi047 bash[22744]: cluster 2024-09-16T08:26:40.916248+0000 mgr.a (mgr.14373) 7338 : cluster [DBG] pgmap v5087: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:26:44.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:26:44 smithi157 bash[24585]: cluster 2024-09-16T08:26:42.918542+0000 mgr.a (mgr.14373) 7339 : cluster [DBG] pgmap v5088: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:26:44.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:26:44 smithi086 bash[24289]: cluster 2024-09-16T08:26:42.918542+0000 mgr.a (mgr.14373) 7339 : cluster [DBG] pgmap v5088: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:26:44.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:26:44 smithi047 bash[22744]: cluster 2024-09-16T08:26:42.918542+0000 mgr.a (mgr.14373) 7339 : cluster [DBG] pgmap v5088: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:26:45.226 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:26:45.227 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:26:45.227 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:26:46.011 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:26:46.011 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:26:46.011 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:26:46.011 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:26:46.012 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:26:46.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:26:46 smithi157 bash[24585]: cluster 2024-09-16T08:26:44.919315+0000 mgr.a (mgr.14373) 7340 : cluster [DBG] pgmap v5089: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:26:46.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:26:46 smithi157 bash[24585]: audit 2024-09-16T08:26:45.565042+0000 mgr.a (mgr.14373) 7341 : audit [DBG] from='client.165978 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:26:46.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:26:46 smithi086 bash[24289]: cluster 2024-09-16T08:26:44.919315+0000 mgr.a (mgr.14373) 7340 : cluster [DBG] pgmap v5089: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:26:46.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:26:46 smithi086 bash[24289]: audit 2024-09-16T08:26:45.565042+0000 mgr.a (mgr.14373) 7341 : audit [DBG] from='client.165978 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:26:46.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:26:46 smithi047 bash[22744]: cluster 2024-09-16T08:26:44.919315+0000 mgr.a (mgr.14373) 7340 : cluster [DBG] pgmap v5089: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:26:46.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:26:46 smithi047 bash[22744]: audit 2024-09-16T08:26:45.565042+0000 mgr.a (mgr.14373) 7341 : audit [DBG] from='client.165978 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:26:48.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:26:48 smithi157 bash[24585]: cluster 2024-09-16T08:26:46.921635+0000 mgr.a (mgr.14373) 7342 : cluster [DBG] pgmap v5090: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:26:48.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:26:48 smithi086 bash[24289]: cluster 2024-09-16T08:26:46.921635+0000 mgr.a (mgr.14373) 7342 : cluster [DBG] pgmap v5090: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:26:48.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:26:48 smithi047 bash[22744]: cluster 2024-09-16T08:26:46.921635+0000 mgr.a (mgr.14373) 7342 : cluster [DBG] pgmap v5090: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:26:50.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:26:50 smithi157 bash[24585]: cluster 2024-09-16T08:26:48.922426+0000 mgr.a (mgr.14373) 7343 : cluster [DBG] pgmap v5091: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:26:50.816 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:26:50 smithi086 bash[24289]: cluster 2024-09-16T08:26:48.922426+0000 mgr.a (mgr.14373) 7343 : cluster [DBG] pgmap v5091: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:26:50.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:26:50 smithi047 bash[22744]: cluster 2024-09-16T08:26:48.922426+0000 mgr.a (mgr.14373) 7343 : cluster [DBG] pgmap v5091: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:26:51.012 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:26:51.013 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:26:51.013 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:26:51.757 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:26:51.757 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:26:51.757 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:26:51.757 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:26:51.758 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:26:52.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:26:52 smithi157 bash[24585]: cluster 2024-09-16T08:26:50.923173+0000 mgr.a (mgr.14373) 7344 : cluster [DBG] pgmap v5092: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:26:52.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:26:52 smithi157 bash[24585]: audit 2024-09-16T08:26:51.349156+0000 mgr.a (mgr.14373) 7345 : audit [DBG] from='client.166053 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:26:52.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:26:52 smithi086 bash[24289]: cluster 2024-09-16T08:26:50.923173+0000 mgr.a (mgr.14373) 7344 : cluster [DBG] pgmap v5092: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:26:52.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:26:52 smithi086 bash[24289]: audit 2024-09-16T08:26:51.349156+0000 mgr.a (mgr.14373) 7345 : audit [DBG] from='client.166053 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:26:52.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:26:52 smithi047 bash[22744]: cluster 2024-09-16T08:26:50.923173+0000 mgr.a (mgr.14373) 7344 : cluster [DBG] pgmap v5092: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:26:52.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:26:52 smithi047 bash[22744]: audit 2024-09-16T08:26:51.349156+0000 mgr.a (mgr.14373) 7345 : audit [DBG] from='client.166053 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:26:54.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:26:54 smithi157 bash[24585]: cluster 2024-09-16T08:26:52.925932+0000 mgr.a (mgr.14373) 7346 : cluster [DBG] pgmap v5093: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:26:54.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:26:54 smithi086 bash[24289]: cluster 2024-09-16T08:26:52.925932+0000 mgr.a (mgr.14373) 7346 : cluster [DBG] pgmap v5093: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:26:54.840 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:26:54 smithi047 bash[22744]: cluster 2024-09-16T08:26:52.925932+0000 mgr.a (mgr.14373) 7346 : cluster [DBG] pgmap v5093: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:26:56.759 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:26:56.759 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:26:56.759 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:26:56.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:26:56 smithi157 bash[24585]: cluster 2024-09-16T08:26:54.926762+0000 mgr.a (mgr.14373) 7347 : cluster [DBG] pgmap v5094: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:26:56.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:26:56 smithi086 bash[24289]: cluster 2024-09-16T08:26:54.926762+0000 mgr.a (mgr.14373) 7347 : cluster [DBG] pgmap v5094: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:26:56.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:26:56 smithi047 bash[22744]: cluster 2024-09-16T08:26:54.926762+0000 mgr.a (mgr.14373) 7347 : cluster [DBG] pgmap v5094: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:26:57.507 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:26:57.507 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:26:57.507 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:26:57.507 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:26:57.508 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:26:58.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:26:58 smithi157 bash[24585]: cluster 2024-09-16T08:26:56.928301+0000 mgr.a (mgr.14373) 7348 : cluster [DBG] pgmap v5095: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:26:58.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:26:58 smithi157 bash[24585]: audit 2024-09-16T08:26:57.094333+0000 mgr.a (mgr.14373) 7349 : audit [DBG] from='client.166131 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:26:58.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:26:58 smithi086 bash[24289]: cluster 2024-09-16T08:26:56.928301+0000 mgr.a (mgr.14373) 7348 : cluster [DBG] pgmap v5095: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:26:58.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:26:58 smithi086 bash[24289]: audit 2024-09-16T08:26:57.094333+0000 mgr.a (mgr.14373) 7349 : audit [DBG] from='client.166131 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:26:58.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:26:58 smithi047 bash[22744]: cluster 2024-09-16T08:26:56.928301+0000 mgr.a (mgr.14373) 7348 : cluster [DBG] pgmap v5095: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:26:58.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:26:58 smithi047 bash[22744]: audit 2024-09-16T08:26:57.094333+0000 mgr.a (mgr.14373) 7349 : audit [DBG] from='client.166131 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:27:00.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:27:00 smithi157 bash[24585]: cluster 2024-09-16T08:26:58.929202+0000 mgr.a (mgr.14373) 7350 : cluster [DBG] pgmap v5096: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:27:00.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:27:00 smithi086 bash[24289]: cluster 2024-09-16T08:26:58.929202+0000 mgr.a (mgr.14373) 7350 : cluster [DBG] pgmap v5096: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:27:00.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:27:00 smithi047 bash[22744]: cluster 2024-09-16T08:26:58.929202+0000 mgr.a (mgr.14373) 7350 : cluster [DBG] pgmap v5096: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:27:02.509 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:27:02.509 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:27:02.509 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:27:02.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:27:02 smithi157 bash[24585]: cluster 2024-09-16T08:27:00.929967+0000 mgr.a (mgr.14373) 7351 : cluster [DBG] pgmap v5097: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T08:27:02.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:27:02 smithi086 bash[24289]: cluster 2024-09-16T08:27:00.929967+0000 mgr.a (mgr.14373) 7351 : cluster [DBG] pgmap v5097: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T08:27:02.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:27:02 smithi047 bash[22744]: cluster 2024-09-16T08:27:00.929967+0000 mgr.a (mgr.14373) 7351 : cluster [DBG] pgmap v5097: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T08:27:03.255 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:27:03.255 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:27:03.255 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:27:03.255 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:27:03.255 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:27:04.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:27:04 smithi157 bash[24585]: audit 2024-09-16T08:27:02.840709+0000 mgr.a (mgr.14373) 7352 : audit [DBG] from='client.166206 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:27:04.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:27:04 smithi157 bash[24585]: cluster 2024-09-16T08:27:02.931311+0000 mgr.a (mgr.14373) 7353 : cluster [DBG] pgmap v5098: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:27:04.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:27:04 smithi086 bash[24289]: audit 2024-09-16T08:27:02.840709+0000 mgr.a (mgr.14373) 7352 : audit [DBG] from='client.166206 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:27:04.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:27:04 smithi086 bash[24289]: cluster 2024-09-16T08:27:02.931311+0000 mgr.a (mgr.14373) 7353 : cluster [DBG] pgmap v5098: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:27:04.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:27:04 smithi047 bash[22744]: audit 2024-09-16T08:27:02.840709+0000 mgr.a (mgr.14373) 7352 : audit [DBG] from='client.166206 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:27:04.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:27:04 smithi047 bash[22744]: cluster 2024-09-16T08:27:02.931311+0000 mgr.a (mgr.14373) 7353 : cluster [DBG] pgmap v5098: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:27:06.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:27:06 smithi157 bash[24585]: cluster 2024-09-16T08:27:04.932191+0000 mgr.a (mgr.14373) 7354 : cluster [DBG] pgmap v5099: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:27:06.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:27:06 smithi086 bash[24289]: cluster 2024-09-16T08:27:04.932191+0000 mgr.a (mgr.14373) 7354 : cluster [DBG] pgmap v5099: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:27:06.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:27:06 smithi047 bash[22744]: cluster 2024-09-16T08:27:04.932191+0000 mgr.a (mgr.14373) 7354 : cluster [DBG] pgmap v5099: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:27:08.257 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:27:08.257 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:27:08.258 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:27:08.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:27:08 smithi157 bash[24585]: cluster 2024-09-16T08:27:06.934423+0000 mgr.a (mgr.14373) 7355 : cluster [DBG] pgmap v5100: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:27:08.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:27:08 smithi086 bash[24289]: cluster 2024-09-16T08:27:06.934423+0000 mgr.a (mgr.14373) 7355 : cluster [DBG] pgmap v5100: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:27:08.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:27:08 smithi047 bash[22744]: cluster 2024-09-16T08:27:06.934423+0000 mgr.a (mgr.14373) 7355 : cluster [DBG] pgmap v5100: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:27:09.029 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:27:09.030 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:27:09.030 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:27:09.030 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:27:09.030 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:27:09.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:27:09 smithi157 bash[24585]: audit 2024-09-16T08:27:08.596275+0000 mgr.a (mgr.14373) 7356 : audit [DBG] from='client.166281 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:27:09.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:27:09 smithi086 bash[24289]: audit 2024-09-16T08:27:08.596275+0000 mgr.a (mgr.14373) 7356 : audit [DBG] from='client.166281 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:27:09.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:27:09 smithi047 bash[22744]: audit 2024-09-16T08:27:08.596275+0000 mgr.a (mgr.14373) 7356 : audit [DBG] from='client.166281 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:27:10.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:27:10 smithi157 bash[24585]: cluster 2024-09-16T08:27:08.935186+0000 mgr.a (mgr.14373) 7357 : cluster [DBG] pgmap v5101: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:27:10.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:27:10 smithi086 bash[24289]: cluster 2024-09-16T08:27:08.935186+0000 mgr.a (mgr.14373) 7357 : cluster [DBG] pgmap v5101: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:27:10.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:27:10 smithi047 bash[22744]: cluster 2024-09-16T08:27:08.935186+0000 mgr.a (mgr.14373) 7357 : cluster [DBG] pgmap v5101: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:27:12.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:27:12 smithi157 bash[24585]: cluster 2024-09-16T08:27:10.935942+0000 mgr.a (mgr.14373) 7358 : cluster [DBG] pgmap v5102: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:27:12.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:27:12 smithi086 bash[24289]: cluster 2024-09-16T08:27:10.935942+0000 mgr.a (mgr.14373) 7358 : cluster [DBG] pgmap v5102: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:27:12.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:27:12 smithi047 bash[22744]: cluster 2024-09-16T08:27:10.935942+0000 mgr.a (mgr.14373) 7358 : cluster [DBG] pgmap v5102: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:27:14.031 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:27:14.032 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:27:14.032 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:27:14.771 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:27:14.771 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:27:14.771 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:27:14.771 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:27:14.771 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:27:14.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:27:14 smithi157 bash[24585]: cluster 2024-09-16T08:27:12.938183+0000 mgr.a (mgr.14373) 7359 : cluster [DBG] pgmap v5103: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:27:14.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:27:14 smithi086 bash[24289]: cluster 2024-09-16T08:27:12.938183+0000 mgr.a (mgr.14373) 7359 : cluster [DBG] pgmap v5103: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:27:14.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:27:14 smithi047 bash[22744]: cluster 2024-09-16T08:27:12.938183+0000 mgr.a (mgr.14373) 7359 : cluster [DBG] pgmap v5103: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:27:15.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:27:15 smithi157 bash[24585]: audit 2024-09-16T08:27:14.366407+0000 mgr.a (mgr.14373) 7360 : audit [DBG] from='client.166359 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:27:15.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:27:15 smithi086 bash[24289]: audit 2024-09-16T08:27:14.366407+0000 mgr.a (mgr.14373) 7360 : audit [DBG] from='client.166359 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:27:15.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:27:15 smithi047 bash[22744]: audit 2024-09-16T08:27:14.366407+0000 mgr.a (mgr.14373) 7360 : audit [DBG] from='client.166359 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:27:16.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:27:16 smithi157 bash[24585]: cluster 2024-09-16T08:27:14.939135+0000 mgr.a (mgr.14373) 7361 : cluster [DBG] pgmap v5104: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:27:16.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:27:16 smithi086 bash[24289]: cluster 2024-09-16T08:27:14.939135+0000 mgr.a (mgr.14373) 7361 : cluster [DBG] pgmap v5104: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:27:16.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:27:16 smithi047 bash[22744]: cluster 2024-09-16T08:27:14.939135+0000 mgr.a (mgr.14373) 7361 : cluster [DBG] pgmap v5104: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:27:18.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:27:18 smithi157 bash[24585]: cluster 2024-09-16T08:27:16.941341+0000 mgr.a (mgr.14373) 7362 : cluster [DBG] pgmap v5105: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:27:18.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:27:18 smithi086 bash[24289]: cluster 2024-09-16T08:27:16.941341+0000 mgr.a (mgr.14373) 7362 : cluster [DBG] pgmap v5105: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:27:18.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:27:18 smithi047 bash[22744]: cluster 2024-09-16T08:27:16.941341+0000 mgr.a (mgr.14373) 7362 : cluster [DBG] pgmap v5105: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:27:19.772 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:27:19.773 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:27:19.773 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:27:20.520 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:27:20.520 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:27:20.521 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:27:20.521 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:27:20.521 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:27:20.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:27:20 smithi157 bash[24585]: cluster 2024-09-16T08:27:18.942124+0000 mgr.a (mgr.14373) 7363 : cluster [DBG] pgmap v5106: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:27:20.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:27:20 smithi086 bash[24289]: cluster 2024-09-16T08:27:18.942124+0000 mgr.a (mgr.14373) 7363 : cluster [DBG] pgmap v5106: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:27:20.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:27:20 smithi047 bash[22744]: cluster 2024-09-16T08:27:18.942124+0000 mgr.a (mgr.14373) 7363 : cluster [DBG] pgmap v5106: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:27:21.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:27:21 smithi157 bash[24585]: audit 2024-09-16T08:27:20.111663+0000 mgr.a (mgr.14373) 7364 : audit [DBG] from='client.166431 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:27:21.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:27:21 smithi086 bash[24289]: audit 2024-09-16T08:27:20.111663+0000 mgr.a (mgr.14373) 7364 : audit [DBG] from='client.166431 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:27:21.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:27:21 smithi047 bash[22744]: audit 2024-09-16T08:27:20.111663+0000 mgr.a (mgr.14373) 7364 : audit [DBG] from='client.166431 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:27:22.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:27:22 smithi157 bash[24585]: cluster 2024-09-16T08:27:20.943077+0000 mgr.a (mgr.14373) 7365 : cluster [DBG] pgmap v5107: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:27:22.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:27:22 smithi086 bash[24289]: cluster 2024-09-16T08:27:20.943077+0000 mgr.a (mgr.14373) 7365 : cluster [DBG] pgmap v5107: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:27:22.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:27:22 smithi047 bash[22744]: cluster 2024-09-16T08:27:20.943077+0000 mgr.a (mgr.14373) 7365 : cluster [DBG] pgmap v5107: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:27:24.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:27:24 smithi157 bash[24585]: cluster 2024-09-16T08:27:22.945315+0000 mgr.a (mgr.14373) 7366 : cluster [DBG] pgmap v5108: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:27:24.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:27:24 smithi086 bash[24289]: cluster 2024-09-16T08:27:22.945315+0000 mgr.a (mgr.14373) 7366 : cluster [DBG] pgmap v5108: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:27:24.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:27:24 smithi047 bash[22744]: cluster 2024-09-16T08:27:22.945315+0000 mgr.a (mgr.14373) 7366 : cluster [DBG] pgmap v5108: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:27:25.521 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:27:25.522 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:27:25.522 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:27:26.275 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:27:26.275 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:27:26.275 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:27:26.275 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:27:26.275 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:27:26.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:27:26 smithi157 bash[24585]: cluster 2024-09-16T08:27:24.946085+0000 mgr.a (mgr.14373) 7367 : cluster [DBG] pgmap v5109: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:27:26.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:27:26 smithi086 bash[24289]: cluster 2024-09-16T08:27:24.946085+0000 mgr.a (mgr.14373) 7367 : cluster [DBG] pgmap v5109: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:27:26.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:27:26 smithi047 bash[22744]: cluster 2024-09-16T08:27:24.946085+0000 mgr.a (mgr.14373) 7367 : cluster [DBG] pgmap v5109: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:27:27.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:27:27 smithi086 bash[24289]: audit 2024-09-16T08:27:25.855094+0000 mgr.a (mgr.14373) 7368 : audit [DBG] from='client.166509 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:27:27.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:27:27 smithi047 bash[22744]: audit 2024-09-16T08:27:25.855094+0000 mgr.a (mgr.14373) 7368 : audit [DBG] from='client.166509 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:27:28.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:27:27 smithi157 bash[24585]: audit 2024-09-16T08:27:25.855094+0000 mgr.a (mgr.14373) 7368 : audit [DBG] from='client.166509 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:27:28.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:27:28 smithi086 bash[24289]: cluster 2024-09-16T08:27:26.948465+0000 mgr.a (mgr.14373) 7369 : cluster [DBG] pgmap v5110: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:27:28.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:27:28 smithi047 bash[22744]: cluster 2024-09-16T08:27:26.948465+0000 mgr.a (mgr.14373) 7369 : cluster [DBG] pgmap v5110: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:27:29.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:27:28 smithi157 bash[24585]: cluster 2024-09-16T08:27:26.948465+0000 mgr.a (mgr.14373) 7369 : cluster [DBG] pgmap v5110: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:27:30.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:27:30 smithi086 bash[24289]: cluster 2024-09-16T08:27:28.949252+0000 mgr.a (mgr.14373) 7370 : cluster [DBG] pgmap v5111: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:27:30.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:27:30 smithi047 bash[22744]: cluster 2024-09-16T08:27:28.949252+0000 mgr.a (mgr.14373) 7370 : cluster [DBG] pgmap v5111: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:27:31.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:27:30 smithi157 bash[24585]: cluster 2024-09-16T08:27:28.949252+0000 mgr.a (mgr.14373) 7370 : cluster [DBG] pgmap v5111: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:27:31.277 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:27:31.277 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:27:31.278 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:27:32.017 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:27:32.017 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:27:32.017 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:27:32.017 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:27:32.018 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:27:32.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:27:32 smithi086 bash[24289]: cluster 2024-09-16T08:27:30.950011+0000 mgr.a (mgr.14373) 7371 : cluster [DBG] pgmap v5112: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:27:32.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:27:32 smithi086 bash[24289]: audit 2024-09-16T08:27:31.610147+0000 mgr.a (mgr.14373) 7372 : audit [DBG] from='client.166587 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:27:32.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:27:32 smithi047 bash[22744]: cluster 2024-09-16T08:27:30.950011+0000 mgr.a (mgr.14373) 7371 : cluster [DBG] pgmap v5112: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:27:32.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:27:32 smithi047 bash[22744]: audit 2024-09-16T08:27:31.610147+0000 mgr.a (mgr.14373) 7372 : audit [DBG] from='client.166587 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:27:33.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:27:32 smithi157 bash[24585]: cluster 2024-09-16T08:27:30.950011+0000 mgr.a (mgr.14373) 7371 : cluster [DBG] pgmap v5112: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:27:33.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:27:32 smithi157 bash[24585]: audit 2024-09-16T08:27:31.610147+0000 mgr.a (mgr.14373) 7372 : audit [DBG] from='client.166587 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:27:34.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:27:34 smithi047 bash[22744]: cluster 2024-09-16T08:27:32.952714+0000 mgr.a (mgr.14373) 7373 : cluster [DBG] pgmap v5113: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:27:35.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:27:34 smithi157 bash[24585]: cluster 2024-09-16T08:27:32.952714+0000 mgr.a (mgr.14373) 7373 : cluster [DBG] pgmap v5113: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:27:35.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:27:34 smithi086 bash[24289]: cluster 2024-09-16T08:27:32.952714+0000 mgr.a (mgr.14373) 7373 : cluster [DBG] pgmap v5113: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:27:36.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:27:36 smithi047 bash[22744]: cluster 2024-09-16T08:27:34.953525+0000 mgr.a (mgr.14373) 7374 : cluster [DBG] pgmap v5114: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:27:37.019 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:27:37.019 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:27:37.019 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:27:37.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:27:36 smithi157 bash[24585]: cluster 2024-09-16T08:27:34.953525+0000 mgr.a (mgr.14373) 7374 : cluster [DBG] pgmap v5114: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:27:37.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:27:36 smithi086 bash[24289]: cluster 2024-09-16T08:27:34.953525+0000 mgr.a (mgr.14373) 7374 : cluster [DBG] pgmap v5114: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:27:37.770 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:27:37.770 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:27:37.770 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:27:37.770 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:27:37.770 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:27:38.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:27:38 smithi047 bash[22744]: cluster 2024-09-16T08:27:36.955507+0000 mgr.a (mgr.14373) 7375 : cluster [DBG] pgmap v5115: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:27:38.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:27:38 smithi047 bash[22744]: audit 2024-09-16T08:27:37.350948+0000 mgr.a (mgr.14373) 7376 : audit [DBG] from='client.166665 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:27:39.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:27:38 smithi157 bash[24585]: cluster 2024-09-16T08:27:36.955507+0000 mgr.a (mgr.14373) 7375 : cluster [DBG] pgmap v5115: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:27:39.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:27:38 smithi157 bash[24585]: audit 2024-09-16T08:27:37.350948+0000 mgr.a (mgr.14373) 7376 : audit [DBG] from='client.166665 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:27:39.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:27:38 smithi086 bash[24289]: cluster 2024-09-16T08:27:36.955507+0000 mgr.a (mgr.14373) 7375 : cluster [DBG] pgmap v5115: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:27:39.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:27:38 smithi086 bash[24289]: audit 2024-09-16T08:27:37.350948+0000 mgr.a (mgr.14373) 7376 : audit [DBG] from='client.166665 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:27:39.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:27:39 smithi047 bash[22744]: audit 2024-09-16T08:27:38.992830+0000 mon.b (mon.2) 698 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T08:27:40.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:27:39 smithi157 bash[24585]: audit 2024-09-16T08:27:38.992830+0000 mon.b (mon.2) 698 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T08:27:40.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:27:39 smithi086 bash[24289]: audit 2024-09-16T08:27:38.992830+0000 mon.b (mon.2) 698 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T08:27:40.838 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 08:27:40 smithi047 bash[22994]: debug 2024-09-16T08:27:40.559+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T08:27:40.838 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 08:27:40 smithi047 bash[22994]: debug 2024-09-16T08:27:40.559+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T08:27:40.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:27:40 smithi047 bash[22744]: cluster 2024-09-16T08:27:38.956402+0000 mgr.a (mgr.14373) 7377 : cluster [DBG] pgmap v5116: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:27:40.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:27:40 smithi047 bash[22744]: audit 2024-09-16T08:27:39.802574+0000 mon.b (mon.2) 699 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T08:27:40.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:27:40 smithi047 bash[22744]: audit 2024-09-16T08:27:39.804553+0000 mon.b (mon.2) 700 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T08:27:40.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:27:40 smithi047 bash[22744]: audit 2024-09-16T08:27:39.816546+0000 mon.a (mon.0) 1009 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:27:40.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:27:40 smithi047 bash[22744]: audit 2024-09-16T08:27:39.818879+0000 mon.b (mon.2) 701 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:27:41.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:27:40 smithi157 bash[24585]: cluster 2024-09-16T08:27:38.956402+0000 mgr.a (mgr.14373) 7377 : cluster [DBG] pgmap v5116: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:27:41.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:27:40 smithi157 bash[24585]: audit 2024-09-16T08:27:39.802574+0000 mon.b (mon.2) 699 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T08:27:41.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:27:40 smithi157 bash[24585]: audit 2024-09-16T08:27:39.804553+0000 mon.b (mon.2) 700 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T08:27:41.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:27:40 smithi157 bash[24585]: audit 2024-09-16T08:27:39.816546+0000 mon.a (mon.0) 1009 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:27:41.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:27:40 smithi157 bash[24585]: audit 2024-09-16T08:27:39.818879+0000 mon.b (mon.2) 701 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:27:41.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:27:40 smithi086 bash[24289]: cluster 2024-09-16T08:27:38.956402+0000 mgr.a (mgr.14373) 7377 : cluster [DBG] pgmap v5116: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:27:41.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:27:40 smithi086 bash[24289]: audit 2024-09-16T08:27:39.802574+0000 mon.b (mon.2) 699 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T08:27:41.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:27:40 smithi086 bash[24289]: audit 2024-09-16T08:27:39.804553+0000 mon.b (mon.2) 700 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T08:27:41.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:27:40 smithi086 bash[24289]: audit 2024-09-16T08:27:39.816546+0000 mon.a (mon.0) 1009 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:27:41.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:27:40 smithi086 bash[24289]: audit 2024-09-16T08:27:39.818879+0000 mon.b (mon.2) 701 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:27:41.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:27:41 smithi047 bash[22744]: audit 2024-09-16T08:27:39.822633+0000 mgr.a (mgr.14373) 7378 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:27:41.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:27:41 smithi047 bash[22744]: audit 2024-09-16T08:27:40.562637+0000 mgr.a (mgr.14373) 7379 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T08:27:41.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:27:41 smithi047 bash[22744]: cephadm 2024-09-16T08:27:40.564806+0000 mgr.a (mgr.14373) 7380 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T08:27:42.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:27:41 smithi157 bash[24585]: audit 2024-09-16T08:27:39.822633+0000 mgr.a (mgr.14373) 7378 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:27:42.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:27:41 smithi157 bash[24585]: audit 2024-09-16T08:27:40.562637+0000 mgr.a (mgr.14373) 7379 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T08:27:42.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:27:41 smithi157 bash[24585]: cephadm 2024-09-16T08:27:40.564806+0000 mgr.a (mgr.14373) 7380 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T08:27:42.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:27:41 smithi086 bash[24289]: audit 2024-09-16T08:27:39.822633+0000 mgr.a (mgr.14373) 7378 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:27:42.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:27:41 smithi086 bash[24289]: audit 2024-09-16T08:27:40.562637+0000 mgr.a (mgr.14373) 7379 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T08:27:42.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:27:41 smithi086 bash[24289]: cephadm 2024-09-16T08:27:40.564806+0000 mgr.a (mgr.14373) 7380 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T08:27:42.773 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:27:42.773 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:27:42.773 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:27:43.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:27:42 smithi157 bash[24585]: cluster 2024-09-16T08:27:40.957298+0000 mgr.a (mgr.14373) 7381 : cluster [DBG] pgmap v5117: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T08:27:43.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:27:42 smithi086 bash[24289]: cluster 2024-09-16T08:27:40.957298+0000 mgr.a (mgr.14373) 7381 : cluster [DBG] pgmap v5117: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T08:27:43.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:27:42 smithi047 bash[22744]: cluster 2024-09-16T08:27:40.957298+0000 mgr.a (mgr.14373) 7381 : cluster [DBG] pgmap v5117: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T08:27:43.536 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:27:43.537 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:27:43.537 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:27:43.537 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:27:43.537 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:27:45.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:27:44 smithi157 bash[24585]: cluster 2024-09-16T08:27:42.959475+0000 mgr.a (mgr.14373) 7382 : cluster [DBG] pgmap v5118: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:27:45.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:27:44 smithi157 bash[24585]: audit 2024-09-16T08:27:43.106838+0000 mgr.a (mgr.14373) 7383 : audit [DBG] from='client.166845 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:27:45.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:27:44 smithi086 bash[24289]: cluster 2024-09-16T08:27:42.959475+0000 mgr.a (mgr.14373) 7382 : cluster [DBG] pgmap v5118: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:27:45.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:27:44 smithi086 bash[24289]: audit 2024-09-16T08:27:43.106838+0000 mgr.a (mgr.14373) 7383 : audit [DBG] from='client.166845 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:27:45.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:27:44 smithi047 bash[22744]: cluster 2024-09-16T08:27:42.959475+0000 mgr.a (mgr.14373) 7382 : cluster [DBG] pgmap v5118: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:27:45.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:27:44 smithi047 bash[22744]: audit 2024-09-16T08:27:43.106838+0000 mgr.a (mgr.14373) 7383 : audit [DBG] from='client.166845 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:27:47.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:27:46 smithi157 bash[24585]: cluster 2024-09-16T08:27:44.960357+0000 mgr.a (mgr.14373) 7384 : cluster [DBG] pgmap v5119: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:27:47.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:27:46 smithi086 bash[24289]: cluster 2024-09-16T08:27:44.960357+0000 mgr.a (mgr.14373) 7384 : cluster [DBG] pgmap v5119: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:27:47.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:27:46 smithi047 bash[22744]: cluster 2024-09-16T08:27:44.960357+0000 mgr.a (mgr.14373) 7384 : cluster [DBG] pgmap v5119: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:27:48.538 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:27:48.539 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:27:48.539 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:27:49.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:27:48 smithi157 bash[24585]: cluster 2024-09-16T08:27:46.962540+0000 mgr.a (mgr.14373) 7385 : cluster [DBG] pgmap v5120: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:27:49.066 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:27:48 smithi086 bash[24289]: cluster 2024-09-16T08:27:46.962540+0000 mgr.a (mgr.14373) 7385 : cluster [DBG] pgmap v5120: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:27:49.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:27:48 smithi047 bash[22744]: cluster 2024-09-16T08:27:46.962540+0000 mgr.a (mgr.14373) 7385 : cluster [DBG] pgmap v5120: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:27:49.285 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:27:49.285 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:27:49.285 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:27:49.285 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:27:49.285 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:27:51.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:27:50 smithi157 bash[24585]: audit 2024-09-16T08:27:48.870987+0000 mgr.a (mgr.14373) 7386 : audit [DBG] from='client.166920 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:27:51.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:27:50 smithi157 bash[24585]: cluster 2024-09-16T08:27:48.963024+0000 mgr.a (mgr.14373) 7387 : cluster [DBG] pgmap v5121: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:27:51.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:27:50 smithi086 bash[24289]: audit 2024-09-16T08:27:48.870987+0000 mgr.a (mgr.14373) 7386 : audit [DBG] from='client.166920 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:27:51.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:27:50 smithi086 bash[24289]: cluster 2024-09-16T08:27:48.963024+0000 mgr.a (mgr.14373) 7387 : cluster [DBG] pgmap v5121: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:27:51.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:27:50 smithi047 bash[22744]: audit 2024-09-16T08:27:48.870987+0000 mgr.a (mgr.14373) 7386 : audit [DBG] from='client.166920 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:27:51.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:27:50 smithi047 bash[22744]: cluster 2024-09-16T08:27:48.963024+0000 mgr.a (mgr.14373) 7387 : cluster [DBG] pgmap v5121: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:27:53.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:27:52 smithi157 bash[24585]: cluster 2024-09-16T08:27:50.963897+0000 mgr.a (mgr.14373) 7388 : cluster [DBG] pgmap v5122: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:27:53.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:27:52 smithi086 bash[24289]: cluster 2024-09-16T08:27:50.963897+0000 mgr.a (mgr.14373) 7388 : cluster [DBG] pgmap v5122: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:27:53.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:27:52 smithi047 bash[22744]: cluster 2024-09-16T08:27:50.963897+0000 mgr.a (mgr.14373) 7388 : cluster [DBG] pgmap v5122: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:27:54.286 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:27:54.287 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:27:54.287 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:27:55.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:27:54 smithi157 bash[24585]: cluster 2024-09-16T08:27:52.966124+0000 mgr.a (mgr.14373) 7389 : cluster [DBG] pgmap v5123: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:27:55.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:27:54 smithi086 bash[24289]: cluster 2024-09-16T08:27:52.966124+0000 mgr.a (mgr.14373) 7389 : cluster [DBG] pgmap v5123: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:27:55.074 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:27:55.074 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:27:55.074 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:27:55.074 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:27:55.074 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:27:55.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:27:54 smithi047 bash[22744]: cluster 2024-09-16T08:27:52.966124+0000 mgr.a (mgr.14373) 7389 : cluster [DBG] pgmap v5123: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:27:56.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:27:55 smithi157 bash[24585]: audit 2024-09-16T08:27:54.627804+0000 mgr.a (mgr.14373) 7390 : audit [DBG] from='client.166995 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:27:56.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:27:55 smithi157 bash[24585]: cluster 2024-09-16T08:27:54.974115+0000 mgr.a (mgr.14373) 7391 : cluster [DBG] pgmap v5124: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:27:56.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:27:55 smithi086 bash[24289]: audit 2024-09-16T08:27:54.627804+0000 mgr.a (mgr.14373) 7390 : audit [DBG] from='client.166995 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:27:56.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:27:55 smithi086 bash[24289]: cluster 2024-09-16T08:27:54.974115+0000 mgr.a (mgr.14373) 7391 : cluster [DBG] pgmap v5124: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:27:56.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:27:55 smithi047 bash[22744]: audit 2024-09-16T08:27:54.627804+0000 mgr.a (mgr.14373) 7390 : audit [DBG] from='client.166995 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:27:56.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:27:55 smithi047 bash[22744]: cluster 2024-09-16T08:27:54.974115+0000 mgr.a (mgr.14373) 7391 : cluster [DBG] pgmap v5124: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:27:58.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:27:58 smithi157 bash[24585]: cluster 2024-09-16T08:27:56.976293+0000 mgr.a (mgr.14373) 7392 : cluster [DBG] pgmap v5125: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:27:58.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:27:58 smithi086 bash[24289]: cluster 2024-09-16T08:27:56.976293+0000 mgr.a (mgr.14373) 7392 : cluster [DBG] pgmap v5125: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:27:58.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:27:58 smithi047 bash[22744]: cluster 2024-09-16T08:27:56.976293+0000 mgr.a (mgr.14373) 7392 : cluster [DBG] pgmap v5125: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:28:00.076 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:28:00.076 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:28:00.077 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:28:00.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:28:00 smithi157 bash[24585]: cluster 2024-09-16T08:27:58.977028+0000 mgr.a (mgr.14373) 7393 : cluster [DBG] pgmap v5126: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:28:00.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:28:00 smithi086 bash[24289]: cluster 2024-09-16T08:27:58.977028+0000 mgr.a (mgr.14373) 7393 : cluster [DBG] pgmap v5126: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:28:00.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:28:00 smithi047 bash[22744]: cluster 2024-09-16T08:27:58.977028+0000 mgr.a (mgr.14373) 7393 : cluster [DBG] pgmap v5126: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:28:00.846 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:28:00.847 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:28:00.847 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:28:00.847 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:28:00.847 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:28:01.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:28:01 smithi157 bash[24585]: audit 2024-09-16T08:28:00.416678+0000 mgr.a (mgr.14373) 7394 : audit [DBG] from='client.167073 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:28:01.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:28:01 smithi086 bash[24289]: audit 2024-09-16T08:28:00.416678+0000 mgr.a (mgr.14373) 7394 : audit [DBG] from='client.167073 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:28:01.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:28:01 smithi047 bash[22744]: audit 2024-09-16T08:28:00.416678+0000 mgr.a (mgr.14373) 7394 : audit [DBG] from='client.167073 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:28:02.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:28:02 smithi157 bash[24585]: cluster 2024-09-16T08:28:00.977987+0000 mgr.a (mgr.14373) 7395 : cluster [DBG] pgmap v5127: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:28:02.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:28:02 smithi086 bash[24289]: cluster 2024-09-16T08:28:00.977987+0000 mgr.a (mgr.14373) 7395 : cluster [DBG] pgmap v5127: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:28:02.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:28:02 smithi047 bash[22744]: cluster 2024-09-16T08:28:00.977987+0000 mgr.a (mgr.14373) 7395 : cluster [DBG] pgmap v5127: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:28:04.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:28:04 smithi157 bash[24585]: cluster 2024-09-16T08:28:02.980257+0000 mgr.a (mgr.14373) 7396 : cluster [DBG] pgmap v5128: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:28:04.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:28:04 smithi086 bash[24289]: cluster 2024-09-16T08:28:02.980257+0000 mgr.a (mgr.14373) 7396 : cluster [DBG] pgmap v5128: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:28:04.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:28:04 smithi047 bash[22744]: cluster 2024-09-16T08:28:02.980257+0000 mgr.a (mgr.14373) 7396 : cluster [DBG] pgmap v5128: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:28:05.848 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:28:05.849 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:28:05.849 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:28:06.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:28:06 smithi086 bash[24289]: cluster 2024-09-16T08:28:04.981021+0000 mgr.a (mgr.14373) 7397 : cluster [DBG] pgmap v5129: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:28:06.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:28:06 smithi047 bash[22744]: cluster 2024-09-16T08:28:04.981021+0000 mgr.a (mgr.14373) 7397 : cluster [DBG] pgmap v5129: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:28:06.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:28:06 smithi157 bash[24585]: cluster 2024-09-16T08:28:04.981021+0000 mgr.a (mgr.14373) 7397 : cluster [DBG] pgmap v5129: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:28:06.620 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:28:06.621 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:28:06.621 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:28:06.621 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:28:06.621 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:28:07.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:28:07 smithi086 bash[24289]: audit 2024-09-16T08:28:06.188324+0000 mgr.a (mgr.14373) 7398 : audit [DBG] from='client.167148 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:28:07.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:28:07 smithi047 bash[22744]: audit 2024-09-16T08:28:06.188324+0000 mgr.a (mgr.14373) 7398 : audit [DBG] from='client.167148 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:28:07.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:28:07 smithi157 bash[24585]: audit 2024-09-16T08:28:06.188324+0000 mgr.a (mgr.14373) 7398 : audit [DBG] from='client.167148 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:28:08.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:28:08 smithi086 bash[24289]: cluster 2024-09-16T08:28:06.983424+0000 mgr.a (mgr.14373) 7399 : cluster [DBG] pgmap v5130: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-16T08:28:08.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:28:08 smithi047 bash[22744]: cluster 2024-09-16T08:28:06.983424+0000 mgr.a (mgr.14373) 7399 : cluster [DBG] pgmap v5130: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-16T08:28:08.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:28:08 smithi157 bash[24585]: cluster 2024-09-16T08:28:06.983424+0000 mgr.a (mgr.14373) 7399 : cluster [DBG] pgmap v5130: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-16T08:28:10.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:28:10 smithi047 bash[22744]: cluster 2024-09-16T08:28:08.984204+0000 mgr.a (mgr.14373) 7400 : cluster [DBG] pgmap v5131: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 5.4 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-16T08:28:10.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:28:10 smithi157 bash[24585]: cluster 2024-09-16T08:28:08.984204+0000 mgr.a (mgr.14373) 7400 : cluster [DBG] pgmap v5131: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 5.4 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-16T08:28:10.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:28:10 smithi086 bash[24289]: cluster 2024-09-16T08:28:08.984204+0000 mgr.a (mgr.14373) 7400 : cluster [DBG] pgmap v5131: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 5.4 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-16T08:28:11.622 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:28:11.622 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:28:11.623 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:28:12.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:28:12 smithi047 bash[22744]: cluster 2024-09-16T08:28:10.984971+0000 mgr.a (mgr.14373) 7401 : cluster [DBG] pgmap v5132: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 5.4 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-16T08:28:12.406 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:28:12.406 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:28:12.406 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:28:12.406 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:28:12.406 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:28:12.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:28:12 smithi157 bash[24585]: cluster 2024-09-16T08:28:10.984971+0000 mgr.a (mgr.14373) 7401 : cluster [DBG] pgmap v5132: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 5.4 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-16T08:28:12.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:28:12 smithi086 bash[24289]: cluster 2024-09-16T08:28:10.984971+0000 mgr.a (mgr.14373) 7401 : cluster [DBG] pgmap v5132: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 5.4 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-16T08:28:13.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:28:13 smithi157 bash[24585]: audit 2024-09-16T08:28:11.959364+0000 mgr.a (mgr.14373) 7402 : audit [DBG] from='client.167223 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:28:13.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:28:13 smithi086 bash[24289]: audit 2024-09-16T08:28:11.959364+0000 mgr.a (mgr.14373) 7402 : audit [DBG] from='client.167223 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:28:13.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:28:13 smithi047 bash[22744]: audit 2024-09-16T08:28:11.959364+0000 mgr.a (mgr.14373) 7402 : audit [DBG] from='client.167223 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:28:14.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:28:14 smithi157 bash[24585]: cluster 2024-09-16T08:28:12.987677+0000 mgr.a (mgr.14373) 7403 : cluster [DBG] pgmap v5133: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-16T08:28:14.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:28:14 smithi086 bash[24289]: cluster 2024-09-16T08:28:12.987677+0000 mgr.a (mgr.14373) 7403 : cluster [DBG] pgmap v5133: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-16T08:28:14.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:28:14 smithi047 bash[22744]: cluster 2024-09-16T08:28:12.987677+0000 mgr.a (mgr.14373) 7403 : cluster [DBG] pgmap v5133: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-16T08:28:16.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:28:16 smithi157 bash[24585]: cluster 2024-09-16T08:28:14.988446+0000 mgr.a (mgr.14373) 7404 : cluster [DBG] pgmap v5134: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 4.9 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-16T08:28:16.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:28:16 smithi086 bash[24289]: cluster 2024-09-16T08:28:14.988446+0000 mgr.a (mgr.14373) 7404 : cluster [DBG] pgmap v5134: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 4.9 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-16T08:28:16.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:28:16 smithi047 bash[22744]: cluster 2024-09-16T08:28:14.988446+0000 mgr.a (mgr.14373) 7404 : cluster [DBG] pgmap v5134: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 4.9 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-16T08:28:17.408 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:28:17.408 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:28:17.409 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:28:18.188 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:28:18.189 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:28:18.189 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:28:18.189 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:28:18.189 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:28:18.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:28:18 smithi157 bash[24585]: cluster 2024-09-16T08:28:16.990473+0000 mgr.a (mgr.14373) 7405 : cluster [DBG] pgmap v5135: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 65 KiB/s rd, 0 B/s wr, 106 op/s 2024-09-16T08:28:18.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:28:18 smithi086 bash[24289]: cluster 2024-09-16T08:28:16.990473+0000 mgr.a (mgr.14373) 7405 : cluster [DBG] pgmap v5135: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 65 KiB/s rd, 0 B/s wr, 106 op/s 2024-09-16T08:28:18.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:28:18 smithi047 bash[22744]: cluster 2024-09-16T08:28:16.990473+0000 mgr.a (mgr.14373) 7405 : cluster [DBG] pgmap v5135: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 65 KiB/s rd, 0 B/s wr, 106 op/s 2024-09-16T08:28:19.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:28:19 smithi157 bash[24585]: audit 2024-09-16T08:28:17.745843+0000 mgr.a (mgr.14373) 7406 : audit [DBG] from='client.167298 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:28:19.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:28:19 smithi086 bash[24289]: audit 2024-09-16T08:28:17.745843+0000 mgr.a (mgr.14373) 7406 : audit [DBG] from='client.167298 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:28:19.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:28:19 smithi047 bash[22744]: audit 2024-09-16T08:28:17.745843+0000 mgr.a (mgr.14373) 7406 : audit [DBG] from='client.167298 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:28:20.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:28:20 smithi157 bash[24585]: cluster 2024-09-16T08:28:18.991375+0000 mgr.a (mgr.14373) 7407 : cluster [DBG] pgmap v5136: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 60 KiB/s rd, 0 B/s wr, 99 op/s 2024-09-16T08:28:20.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:28:20 smithi086 bash[24289]: cluster 2024-09-16T08:28:18.991375+0000 mgr.a (mgr.14373) 7407 : cluster [DBG] pgmap v5136: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 60 KiB/s rd, 0 B/s wr, 99 op/s 2024-09-16T08:28:20.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:28:20 smithi047 bash[22744]: cluster 2024-09-16T08:28:18.991375+0000 mgr.a (mgr.14373) 7407 : cluster [DBG] pgmap v5136: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 60 KiB/s rd, 0 B/s wr, 99 op/s 2024-09-16T08:28:22.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:28:22 smithi157 bash[24585]: cluster 2024-09-16T08:28:20.992145+0000 mgr.a (mgr.14373) 7408 : cluster [DBG] pgmap v5137: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 60 KiB/s rd, 0 B/s wr, 99 op/s 2024-09-16T08:28:22.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:28:22 smithi086 bash[24289]: cluster 2024-09-16T08:28:20.992145+0000 mgr.a (mgr.14373) 7408 : cluster [DBG] pgmap v5137: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 60 KiB/s rd, 0 B/s wr, 99 op/s 2024-09-16T08:28:22.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:28:22 smithi047 bash[22744]: cluster 2024-09-16T08:28:20.992145+0000 mgr.a (mgr.14373) 7408 : cluster [DBG] pgmap v5137: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 60 KiB/s rd, 0 B/s wr, 99 op/s 2024-09-16T08:28:23.190 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:28:23.191 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:28:23.191 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:28:23.959 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:28:23.960 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:28:23.960 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:28:23.960 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:28:23.960 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:28:24.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:28:24 smithi157 bash[24585]: cluster 2024-09-16T08:28:22.994434+0000 mgr.a (mgr.14373) 7409 : cluster [DBG] pgmap v5138: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 66 KiB/s rd, 0 B/s wr, 107 op/s 2024-09-16T08:28:24.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:28:24 smithi157 bash[24585]: audit 2024-09-16T08:28:23.530184+0000 mgr.a (mgr.14373) 7410 : audit [DBG] from='client.167373 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:28:24.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:28:24 smithi086 bash[24289]: cluster 2024-09-16T08:28:22.994434+0000 mgr.a (mgr.14373) 7409 : cluster [DBG] pgmap v5138: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 66 KiB/s rd, 0 B/s wr, 107 op/s 2024-09-16T08:28:24.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:28:24 smithi086 bash[24289]: audit 2024-09-16T08:28:23.530184+0000 mgr.a (mgr.14373) 7410 : audit [DBG] from='client.167373 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:28:24.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:28:24 smithi047 bash[22744]: cluster 2024-09-16T08:28:22.994434+0000 mgr.a (mgr.14373) 7409 : cluster [DBG] pgmap v5138: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 66 KiB/s rd, 0 B/s wr, 107 op/s 2024-09-16T08:28:24.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:28:24 smithi047 bash[22744]: audit 2024-09-16T08:28:23.530184+0000 mgr.a (mgr.14373) 7410 : audit [DBG] from='client.167373 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:28:26.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:28:26 smithi157 bash[24585]: cluster 2024-09-16T08:28:24.995380+0000 mgr.a (mgr.14373) 7411 : cluster [DBG] pgmap v5139: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 65 KiB/s rd, 0 B/s wr, 107 op/s 2024-09-16T08:28:26.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:28:26 smithi086 bash[24289]: cluster 2024-09-16T08:28:24.995380+0000 mgr.a (mgr.14373) 7411 : cluster [DBG] pgmap v5139: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 65 KiB/s rd, 0 B/s wr, 107 op/s 2024-09-16T08:28:26.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:28:26 smithi047 bash[22744]: cluster 2024-09-16T08:28:24.995380+0000 mgr.a (mgr.14373) 7411 : cluster [DBG] pgmap v5139: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 65 KiB/s rd, 0 B/s wr, 107 op/s 2024-09-16T08:28:28.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:28:28 smithi157 bash[24585]: cluster 2024-09-16T08:28:26.997543+0000 mgr.a (mgr.14373) 7412 : cluster [DBG] pgmap v5140: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 66 KiB/s rd, 0 B/s wr, 108 op/s 2024-09-16T08:28:28.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:28:28 smithi086 bash[24289]: cluster 2024-09-16T08:28:26.997543+0000 mgr.a (mgr.14373) 7412 : cluster [DBG] pgmap v5140: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 66 KiB/s rd, 0 B/s wr, 108 op/s 2024-09-16T08:28:28.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:28:28 smithi047 bash[22744]: cluster 2024-09-16T08:28:26.997543+0000 mgr.a (mgr.14373) 7412 : cluster [DBG] pgmap v5140: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 66 KiB/s rd, 0 B/s wr, 108 op/s 2024-09-16T08:28:28.961 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:28:28.962 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:28:28.962 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:28:29.715 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:28:29.715 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:28:29.715 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:28:29.715 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:28:29.715 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:28:30.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:28:30 smithi157 bash[24585]: cluster 2024-09-16T08:28:28.998177+0000 mgr.a (mgr.14373) 7413 : cluster [DBG] pgmap v5141: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 6.4 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-16T08:28:30.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:28:30 smithi157 bash[24585]: audit 2024-09-16T08:28:29.295713+0000 mgr.a (mgr.14373) 7414 : audit [DBG] from='client.167448 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:28:30.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:28:30 smithi086 bash[24289]: cluster 2024-09-16T08:28:28.998177+0000 mgr.a (mgr.14373) 7413 : cluster [DBG] pgmap v5141: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 6.4 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-16T08:28:30.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:28:30 smithi086 bash[24289]: audit 2024-09-16T08:28:29.295713+0000 mgr.a (mgr.14373) 7414 : audit [DBG] from='client.167448 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:28:30.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:28:30 smithi047 bash[22744]: cluster 2024-09-16T08:28:28.998177+0000 mgr.a (mgr.14373) 7413 : cluster [DBG] pgmap v5141: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 6.4 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-16T08:28:30.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:28:30 smithi047 bash[22744]: audit 2024-09-16T08:28:29.295713+0000 mgr.a (mgr.14373) 7414 : audit [DBG] from='client.167448 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:28:32.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:28:32 smithi157 bash[24585]: cluster 2024-09-16T08:28:30.999071+0000 mgr.a (mgr.14373) 7415 : cluster [DBG] pgmap v5142: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 6.4 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-16T08:28:32.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:28:32 smithi086 bash[24289]: cluster 2024-09-16T08:28:30.999071+0000 mgr.a (mgr.14373) 7415 : cluster [DBG] pgmap v5142: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 6.4 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-16T08:28:32.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:28:32 smithi047 bash[22744]: cluster 2024-09-16T08:28:30.999071+0000 mgr.a (mgr.14373) 7415 : cluster [DBG] pgmap v5142: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 6.4 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-16T08:28:34.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:28:34 smithi157 bash[24585]: cluster 2024-09-16T08:28:33.001314+0000 mgr.a (mgr.14373) 7416 : cluster [DBG] pgmap v5143: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.3 KiB/s rd, 0 B/s wr, 10 op/s 2024-09-16T08:28:34.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:28:34 smithi086 bash[24289]: cluster 2024-09-16T08:28:33.001314+0000 mgr.a (mgr.14373) 7416 : cluster [DBG] pgmap v5143: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.3 KiB/s rd, 0 B/s wr, 10 op/s 2024-09-16T08:28:34.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:28:34 smithi047 bash[22744]: cluster 2024-09-16T08:28:33.001314+0000 mgr.a (mgr.14373) 7416 : cluster [DBG] pgmap v5143: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.3 KiB/s rd, 0 B/s wr, 10 op/s 2024-09-16T08:28:34.716 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:28:34.717 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:28:34.717 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:28:35.508 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:28:35.508 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:28:35.508 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:28:35.508 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:28:35.508 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:28:36.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:28:36 smithi157 bash[24585]: cluster 2024-09-16T08:28:35.002059+0000 mgr.a (mgr.14373) 7417 : cluster [DBG] pgmap v5144: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:28:36.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:28:36 smithi157 bash[24585]: audit 2024-09-16T08:28:35.057220+0000 mgr.a (mgr.14373) 7418 : audit [DBG] from='client.167523 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:28:36.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:28:36 smithi086 bash[24289]: cluster 2024-09-16T08:28:35.002059+0000 mgr.a (mgr.14373) 7417 : cluster [DBG] pgmap v5144: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:28:36.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:28:36 smithi086 bash[24289]: audit 2024-09-16T08:28:35.057220+0000 mgr.a (mgr.14373) 7418 : audit [DBG] from='client.167523 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:28:36.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:28:36 smithi047 bash[22744]: cluster 2024-09-16T08:28:35.002059+0000 mgr.a (mgr.14373) 7417 : cluster [DBG] pgmap v5144: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:28:36.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:28:36 smithi047 bash[22744]: audit 2024-09-16T08:28:35.057220+0000 mgr.a (mgr.14373) 7418 : audit [DBG] from='client.167523 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:28:38.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:28:38 smithi157 bash[24585]: cluster 2024-09-16T08:28:37.004331+0000 mgr.a (mgr.14373) 7419 : cluster [DBG] pgmap v5145: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:28:38.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:28:38 smithi086 bash[24289]: cluster 2024-09-16T08:28:37.004331+0000 mgr.a (mgr.14373) 7419 : cluster [DBG] pgmap v5145: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:28:38.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:28:38 smithi047 bash[22744]: cluster 2024-09-16T08:28:37.004331+0000 mgr.a (mgr.14373) 7419 : cluster [DBG] pgmap v5145: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:28:40.509 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:28:40.510 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:28:40.510 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:28:40.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:28:40 smithi157 bash[24585]: cluster 2024-09-16T08:28:39.005125+0000 mgr.a (mgr.14373) 7420 : cluster [DBG] pgmap v5146: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:28:40.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:28:40 smithi086 bash[24289]: cluster 2024-09-16T08:28:39.005125+0000 mgr.a (mgr.14373) 7420 : cluster [DBG] pgmap v5146: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:28:40.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:28:40 smithi047 bash[22744]: cluster 2024-09-16T08:28:39.005125+0000 mgr.a (mgr.14373) 7420 : cluster [DBG] pgmap v5146: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:28:41.278 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:28:41.278 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:28:41.279 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:28:41.279 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:28:41.279 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:28:41.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:28:41 smithi157 bash[24585]: audit 2024-09-16T08:28:40.611964+0000 mon.b (mon.2) 702 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T08:28:41.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:28:41 smithi086 bash[24289]: audit 2024-09-16T08:28:40.611964+0000 mon.b (mon.2) 702 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T08:28:41.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:28:41 smithi047 bash[22744]: audit 2024-09-16T08:28:40.611964+0000 mon.b (mon.2) 702 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T08:28:42.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:28:42 smithi157 bash[24585]: audit 2024-09-16T08:28:40.837883+0000 mgr.a (mgr.14373) 7421 : audit [DBG] from='client.167598 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:28:42.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:28:42 smithi157 bash[24585]: cluster 2024-09-16T08:28:41.005651+0000 mgr.a (mgr.14373) 7422 : cluster [DBG] pgmap v5147: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:28:42.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:28:42 smithi157 bash[24585]: audit 2024-09-16T08:28:41.395678+0000 mon.b (mon.2) 703 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T08:28:42.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:28:42 smithi157 bash[24585]: audit 2024-09-16T08:28:41.397795+0000 mon.b (mon.2) 704 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T08:28:42.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:28:42 smithi157 bash[24585]: audit 2024-09-16T08:28:41.410499+0000 mon.a (mon.0) 1010 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:28:42.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:28:42 smithi157 bash[24585]: audit 2024-09-16T08:28:41.416292+0000 mon.b (mon.2) 705 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:28:42.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:28:42 smithi157 bash[24585]: audit 2024-09-16T08:28:41.420211+0000 mgr.a (mgr.14373) 7423 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:28:42.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:28:42 smithi086 bash[24289]: audit 2024-09-16T08:28:40.837883+0000 mgr.a (mgr.14373) 7421 : audit [DBG] from='client.167598 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:28:42.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:28:42 smithi086 bash[24289]: cluster 2024-09-16T08:28:41.005651+0000 mgr.a (mgr.14373) 7422 : cluster [DBG] pgmap v5147: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:28:42.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:28:42 smithi086 bash[24289]: audit 2024-09-16T08:28:41.395678+0000 mon.b (mon.2) 703 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T08:28:42.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:28:42 smithi086 bash[24289]: audit 2024-09-16T08:28:41.397795+0000 mon.b (mon.2) 704 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T08:28:42.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:28:42 smithi086 bash[24289]: audit 2024-09-16T08:28:41.410499+0000 mon.a (mon.0) 1010 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:28:42.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:28:42 smithi086 bash[24289]: audit 2024-09-16T08:28:41.416292+0000 mon.b (mon.2) 705 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:28:42.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:28:42 smithi086 bash[24289]: audit 2024-09-16T08:28:41.420211+0000 mgr.a (mgr.14373) 7423 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:28:42.588 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 08:28:42 smithi047 bash[22994]: debug 2024-09-16T08:28:42.129+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T08:28:42.588 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 08:28:42 smithi047 bash[22994]: debug 2024-09-16T08:28:42.133+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T08:28:42.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:28:42 smithi047 bash[22744]: audit 2024-09-16T08:28:40.837883+0000 mgr.a (mgr.14373) 7421 : audit [DBG] from='client.167598 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:28:42.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:28:42 smithi047 bash[22744]: cluster 2024-09-16T08:28:41.005651+0000 mgr.a (mgr.14373) 7422 : cluster [DBG] pgmap v5147: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:28:42.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:28:42 smithi047 bash[22744]: audit 2024-09-16T08:28:41.395678+0000 mon.b (mon.2) 703 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T08:28:42.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:28:42 smithi047 bash[22744]: audit 2024-09-16T08:28:41.397795+0000 mon.b (mon.2) 704 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T08:28:42.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:28:42 smithi047 bash[22744]: audit 2024-09-16T08:28:41.410499+0000 mon.a (mon.0) 1010 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:28:42.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:28:42 smithi047 bash[22744]: audit 2024-09-16T08:28:41.416292+0000 mon.b (mon.2) 705 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:28:42.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:28:42 smithi047 bash[22744]: audit 2024-09-16T08:28:41.420211+0000 mgr.a (mgr.14373) 7423 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:28:43.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:28:43 smithi157 bash[24585]: audit 2024-09-16T08:28:42.132538+0000 mgr.a (mgr.14373) 7424 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T08:28:43.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:28:43 smithi157 bash[24585]: cephadm 2024-09-16T08:28:42.134745+0000 mgr.a (mgr.14373) 7425 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T08:28:43.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:28:43 smithi086 bash[24289]: audit 2024-09-16T08:28:42.132538+0000 mgr.a (mgr.14373) 7424 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T08:28:43.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:28:43 smithi086 bash[24289]: cephadm 2024-09-16T08:28:42.134745+0000 mgr.a (mgr.14373) 7425 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T08:28:43.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:28:43 smithi047 bash[22744]: audit 2024-09-16T08:28:42.132538+0000 mgr.a (mgr.14373) 7424 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T08:28:43.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:28:43 smithi047 bash[22744]: cephadm 2024-09-16T08:28:42.134745+0000 mgr.a (mgr.14373) 7425 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T08:28:44.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:28:44 smithi157 bash[24585]: cluster 2024-09-16T08:28:43.008301+0000 mgr.a (mgr.14373) 7426 : cluster [DBG] pgmap v5148: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 3.0 KiB/s rd, 2 op/s 2024-09-16T08:28:44.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:28:44 smithi086 bash[24289]: cluster 2024-09-16T08:28:43.008301+0000 mgr.a (mgr.14373) 7426 : cluster [DBG] pgmap v5148: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 3.0 KiB/s rd, 2 op/s 2024-09-16T08:28:44.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:28:44 smithi047 bash[22744]: cluster 2024-09-16T08:28:43.008301+0000 mgr.a (mgr.14373) 7426 : cluster [DBG] pgmap v5148: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 3.0 KiB/s rd, 2 op/s 2024-09-16T08:28:46.280 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:28:46.281 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:28:46.281 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:28:46.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:28:46 smithi157 bash[24585]: cluster 2024-09-16T08:28:45.009044+0000 mgr.a (mgr.14373) 7427 : cluster [DBG] pgmap v5149: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-16T08:28:46.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:28:46 smithi086 bash[24289]: cluster 2024-09-16T08:28:45.009044+0000 mgr.a (mgr.14373) 7427 : cluster [DBG] pgmap v5149: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-16T08:28:46.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:28:46 smithi047 bash[22744]: cluster 2024-09-16T08:28:45.009044+0000 mgr.a (mgr.14373) 7427 : cluster [DBG] pgmap v5149: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-16T08:28:47.054 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:28:47.055 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:28:47.055 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:28:47.055 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:28:47.055 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:28:47.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:28:47 smithi157 bash[24585]: audit 2024-09-16T08:28:46.618717+0000 mgr.a (mgr.14373) 7428 : audit [DBG] from='client.167784 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:28:47.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:28:47 smithi086 bash[24289]: audit 2024-09-16T08:28:46.618717+0000 mgr.a (mgr.14373) 7428 : audit [DBG] from='client.167784 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:28:47.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:28:47 smithi047 bash[22744]: audit 2024-09-16T08:28:46.618717+0000 mgr.a (mgr.14373) 7428 : audit [DBG] from='client.167784 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:28:48.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:28:48 smithi157 bash[24585]: cluster 2024-09-16T08:28:47.010394+0000 mgr.a (mgr.14373) 7429 : cluster [DBG] pgmap v5150: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:28:48.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:28:48 smithi086 bash[24289]: cluster 2024-09-16T08:28:47.010394+0000 mgr.a (mgr.14373) 7429 : cluster [DBG] pgmap v5150: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:28:48.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:28:48 smithi047 bash[22744]: cluster 2024-09-16T08:28:47.010394+0000 mgr.a (mgr.14373) 7429 : cluster [DBG] pgmap v5150: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:28:50.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:28:50 smithi157 bash[24585]: cluster 2024-09-16T08:28:49.011133+0000 mgr.a (mgr.14373) 7430 : cluster [DBG] pgmap v5151: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T08:28:50.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:28:50 smithi086 bash[24289]: cluster 2024-09-16T08:28:49.011133+0000 mgr.a (mgr.14373) 7430 : cluster [DBG] pgmap v5151: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T08:28:50.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:28:50 smithi047 bash[22744]: cluster 2024-09-16T08:28:49.011133+0000 mgr.a (mgr.14373) 7430 : cluster [DBG] pgmap v5151: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T08:28:52.056 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:28:52.062 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:28:52.062 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:28:52.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:28:52 smithi157 bash[24585]: cluster 2024-09-16T08:28:51.011924+0000 mgr.a (mgr.14373) 7431 : cluster [DBG] pgmap v5152: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T08:28:52.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:28:52 smithi086 bash[24289]: cluster 2024-09-16T08:28:51.011924+0000 mgr.a (mgr.14373) 7431 : cluster [DBG] pgmap v5152: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T08:28:52.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:28:52 smithi047 bash[22744]: cluster 2024-09-16T08:28:51.011924+0000 mgr.a (mgr.14373) 7431 : cluster [DBG] pgmap v5152: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T08:28:52.813 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:28:52.813 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:28:52.813 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:28:52.813 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:28:52.813 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:28:53.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:28:53 smithi157 bash[24585]: audit 2024-09-16T08:28:52.391431+0000 mgr.a (mgr.14373) 7432 : audit [DBG] from='client.167862 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:28:53.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:28:53 smithi086 bash[24289]: audit 2024-09-16T08:28:52.391431+0000 mgr.a (mgr.14373) 7432 : audit [DBG] from='client.167862 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:28:53.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:28:53 smithi047 bash[22744]: audit 2024-09-16T08:28:52.391431+0000 mgr.a (mgr.14373) 7432 : audit [DBG] from='client.167862 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:28:54.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:28:54 smithi157 bash[24585]: cluster 2024-09-16T08:28:53.014603+0000 mgr.a (mgr.14373) 7433 : cluster [DBG] pgmap v5153: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:28:54.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:28:54 smithi086 bash[24289]: cluster 2024-09-16T08:28:53.014603+0000 mgr.a (mgr.14373) 7433 : cluster [DBG] pgmap v5153: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:28:54.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:28:54 smithi047 bash[22744]: cluster 2024-09-16T08:28:53.014603+0000 mgr.a (mgr.14373) 7433 : cluster [DBG] pgmap v5153: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:28:56.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:28:56 smithi157 bash[24585]: cluster 2024-09-16T08:28:55.015365+0000 mgr.a (mgr.14373) 7434 : cluster [DBG] pgmap v5154: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 426 B/s wr, 5 op/s 2024-09-16T08:28:56.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:28:56 smithi086 bash[24289]: cluster 2024-09-16T08:28:55.015365+0000 mgr.a (mgr.14373) 7434 : cluster [DBG] pgmap v5154: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 426 B/s wr, 5 op/s 2024-09-16T08:28:56.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:28:56 smithi047 bash[22744]: cluster 2024-09-16T08:28:55.015365+0000 mgr.a (mgr.14373) 7434 : cluster [DBG] pgmap v5154: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 426 B/s wr, 5 op/s 2024-09-16T08:28:57.814 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:28:57.815 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:28:57.815 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:28:58.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:28:58 smithi157 bash[24585]: cluster 2024-09-16T08:28:57.017298+0000 mgr.a (mgr.14373) 7435 : cluster [DBG] pgmap v5155: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T08:28:58.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:28:58 smithi086 bash[24289]: cluster 2024-09-16T08:28:57.017298+0000 mgr.a (mgr.14373) 7435 : cluster [DBG] pgmap v5155: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T08:28:58.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:28:58 smithi047 bash[22744]: cluster 2024-09-16T08:28:57.017298+0000 mgr.a (mgr.14373) 7435 : cluster [DBG] pgmap v5155: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T08:28:58.588 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:28:58.588 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:28:58.588 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:28:58.588 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:28:58.588 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:28:59.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:28:59 smithi157 bash[24585]: audit 2024-09-16T08:28:58.158992+0000 mgr.a (mgr.14373) 7436 : audit [DBG] from='client.167937 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:28:59.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:28:59 smithi086 bash[24289]: audit 2024-09-16T08:28:58.158992+0000 mgr.a (mgr.14373) 7436 : audit [DBG] from='client.167937 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:28:59.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:28:59 smithi047 bash[22744]: audit 2024-09-16T08:28:58.158992+0000 mgr.a (mgr.14373) 7436 : audit [DBG] from='client.167937 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:29:00.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:29:00 smithi157 bash[24585]: cluster 2024-09-16T08:28:59.018172+0000 mgr.a (mgr.14373) 7437 : cluster [DBG] pgmap v5156: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:29:00.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:29:00 smithi086 bash[24289]: cluster 2024-09-16T08:28:59.018172+0000 mgr.a (mgr.14373) 7437 : cluster [DBG] pgmap v5156: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:29:00.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:29:00 smithi047 bash[22744]: cluster 2024-09-16T08:28:59.018172+0000 mgr.a (mgr.14373) 7437 : cluster [DBG] pgmap v5156: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:29:02.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:29:02 smithi157 bash[24585]: cluster 2024-09-16T08:29:01.019129+0000 mgr.a (mgr.14373) 7438 : cluster [DBG] pgmap v5157: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:29:02.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:29:02 smithi086 bash[24289]: cluster 2024-09-16T08:29:01.019129+0000 mgr.a (mgr.14373) 7438 : cluster [DBG] pgmap v5157: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:29:02.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:29:02 smithi047 bash[22744]: cluster 2024-09-16T08:29:01.019129+0000 mgr.a (mgr.14373) 7438 : cluster [DBG] pgmap v5157: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:29:03.590 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:29:03.590 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:29:03.590 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:29:04.379 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:29:04.379 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:29:04.379 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:29:04.379 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:29:04.379 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:29:04.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:29:04 smithi157 bash[24585]: cluster 2024-09-16T08:29:03.021497+0000 mgr.a (mgr.14373) 7439 : cluster [DBG] pgmap v5158: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:29:04.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:29:04 smithi086 bash[24289]: cluster 2024-09-16T08:29:03.021497+0000 mgr.a (mgr.14373) 7439 : cluster [DBG] pgmap v5158: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:29:04.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:29:04 smithi047 bash[22744]: cluster 2024-09-16T08:29:03.021497+0000 mgr.a (mgr.14373) 7439 : cluster [DBG] pgmap v5158: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:29:05.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:29:05 smithi157 bash[24585]: audit 2024-09-16T08:29:03.931974+0000 mgr.a (mgr.14373) 7440 : audit [DBG] from='client.168012 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:29:05.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:29:05 smithi086 bash[24289]: audit 2024-09-16T08:29:03.931974+0000 mgr.a (mgr.14373) 7440 : audit [DBG] from='client.168012 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:29:05.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:29:05 smithi047 bash[22744]: audit 2024-09-16T08:29:03.931974+0000 mgr.a (mgr.14373) 7440 : audit [DBG] from='client.168012 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:29:06.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:29:06 smithi157 bash[24585]: cluster 2024-09-16T08:29:05.022601+0000 mgr.a (mgr.14373) 7441 : cluster [DBG] pgmap v5159: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:29:06.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:29:06 smithi086 bash[24289]: cluster 2024-09-16T08:29:05.022601+0000 mgr.a (mgr.14373) 7441 : cluster [DBG] pgmap v5159: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:29:06.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:29:06 smithi047 bash[22744]: cluster 2024-09-16T08:29:05.022601+0000 mgr.a (mgr.14373) 7441 : cluster [DBG] pgmap v5159: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:29:08.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:29:08 smithi157 bash[24585]: cluster 2024-09-16T08:29:07.024930+0000 mgr.a (mgr.14373) 7442 : cluster [DBG] pgmap v5160: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:29:08.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:29:08 smithi086 bash[24289]: cluster 2024-09-16T08:29:07.024930+0000 mgr.a (mgr.14373) 7442 : cluster [DBG] pgmap v5160: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:29:08.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:29:08 smithi047 bash[22744]: cluster 2024-09-16T08:29:07.024930+0000 mgr.a (mgr.14373) 7442 : cluster [DBG] pgmap v5160: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:29:09.381 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:29:09.381 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:29:09.381 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:29:10.129 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:29:10.129 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:29:10.129 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:29:10.129 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:29:10.129 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:29:10.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:29:10 smithi157 bash[24585]: cluster 2024-09-16T08:29:09.025861+0000 mgr.a (mgr.14373) 7443 : cluster [DBG] pgmap v5161: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:29:10.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:29:10 smithi086 bash[24289]: cluster 2024-09-16T08:29:09.025861+0000 mgr.a (mgr.14373) 7443 : cluster [DBG] pgmap v5161: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:29:10.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:29:10 smithi047 bash[22744]: cluster 2024-09-16T08:29:09.025861+0000 mgr.a (mgr.14373) 7443 : cluster [DBG] pgmap v5161: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:29:11.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:29:11 smithi157 bash[24585]: audit 2024-09-16T08:29:09.715412+0000 mgr.a (mgr.14373) 7444 : audit [DBG] from='client.168090 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:29:11.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:29:11 smithi086 bash[24289]: audit 2024-09-16T08:29:09.715412+0000 mgr.a (mgr.14373) 7444 : audit [DBG] from='client.168090 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:29:11.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:29:11 smithi047 bash[22744]: audit 2024-09-16T08:29:09.715412+0000 mgr.a (mgr.14373) 7444 : audit [DBG] from='client.168090 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:29:12.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:29:12 smithi157 bash[24585]: cluster 2024-09-16T08:29:11.026796+0000 mgr.a (mgr.14373) 7445 : cluster [DBG] pgmap v5162: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:29:12.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:29:12 smithi086 bash[24289]: cluster 2024-09-16T08:29:11.026796+0000 mgr.a (mgr.14373) 7445 : cluster [DBG] pgmap v5162: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:29:12.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:29:12 smithi047 bash[22744]: cluster 2024-09-16T08:29:11.026796+0000 mgr.a (mgr.14373) 7445 : cluster [DBG] pgmap v5162: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:29:14.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:29:14 smithi157 bash[24585]: cluster 2024-09-16T08:29:13.029053+0000 mgr.a (mgr.14373) 7446 : cluster [DBG] pgmap v5163: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:29:14.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:29:14 smithi086 bash[24289]: cluster 2024-09-16T08:29:13.029053+0000 mgr.a (mgr.14373) 7446 : cluster [DBG] pgmap v5163: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:29:14.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:29:14 smithi047 bash[22744]: cluster 2024-09-16T08:29:13.029053+0000 mgr.a (mgr.14373) 7446 : cluster [DBG] pgmap v5163: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:29:15.131 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:29:15.131 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:29:15.131 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:29:15.869 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:29:15.869 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:29:15.869 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:29:15.869 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:29:15.869 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:29:16.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:29:16 smithi157 bash[24585]: cluster 2024-09-16T08:29:15.029849+0000 mgr.a (mgr.14373) 7447 : cluster [DBG] pgmap v5164: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:29:16.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:29:16 smithi157 bash[24585]: audit 2024-09-16T08:29:15.469386+0000 mgr.a (mgr.14373) 7448 : audit [DBG] from='client.168168 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:29:16.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:29:16 smithi086 bash[24289]: cluster 2024-09-16T08:29:15.029849+0000 mgr.a (mgr.14373) 7447 : cluster [DBG] pgmap v5164: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:29:16.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:29:16 smithi086 bash[24289]: audit 2024-09-16T08:29:15.469386+0000 mgr.a (mgr.14373) 7448 : audit [DBG] from='client.168168 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:29:16.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:29:16 smithi047 bash[22744]: cluster 2024-09-16T08:29:15.029849+0000 mgr.a (mgr.14373) 7447 : cluster [DBG] pgmap v5164: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:29:16.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:29:16 smithi047 bash[22744]: audit 2024-09-16T08:29:15.469386+0000 mgr.a (mgr.14373) 7448 : audit [DBG] from='client.168168 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:29:18.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:29:18 smithi157 bash[24585]: cluster 2024-09-16T08:29:17.032160+0000 mgr.a (mgr.14373) 7449 : cluster [DBG] pgmap v5165: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:29:18.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:29:18 smithi086 bash[24289]: cluster 2024-09-16T08:29:17.032160+0000 mgr.a (mgr.14373) 7449 : cluster [DBG] pgmap v5165: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:29:18.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:29:18 smithi047 bash[22744]: cluster 2024-09-16T08:29:17.032160+0000 mgr.a (mgr.14373) 7449 : cluster [DBG] pgmap v5165: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:29:20.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:29:20 smithi157 bash[24585]: cluster 2024-09-16T08:29:19.032977+0000 mgr.a (mgr.14373) 7450 : cluster [DBG] pgmap v5166: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:29:20.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:29:20 smithi086 bash[24289]: cluster 2024-09-16T08:29:19.032977+0000 mgr.a (mgr.14373) 7450 : cluster [DBG] pgmap v5166: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:29:20.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:29:20 smithi047 bash[22744]: cluster 2024-09-16T08:29:19.032977+0000 mgr.a (mgr.14373) 7450 : cluster [DBG] pgmap v5166: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:29:20.870 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:29:20.871 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:29:20.871 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:29:21.646 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:29:21.647 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:29:21.647 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:29:21.647 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:29:21.647 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:29:22.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:29:22 smithi157 bash[24585]: cluster 2024-09-16T08:29:21.033695+0000 mgr.a (mgr.14373) 7451 : cluster [DBG] pgmap v5167: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:29:22.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:29:22 smithi157 bash[24585]: audit 2024-09-16T08:29:21.212265+0000 mgr.a (mgr.14373) 7452 : audit [DBG] from='client.168246 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:29:22.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:29:22 smithi086 bash[24289]: cluster 2024-09-16T08:29:21.033695+0000 mgr.a (mgr.14373) 7451 : cluster [DBG] pgmap v5167: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:29:22.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:29:22 smithi086 bash[24289]: audit 2024-09-16T08:29:21.212265+0000 mgr.a (mgr.14373) 7452 : audit [DBG] from='client.168246 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:29:22.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:29:22 smithi047 bash[22744]: cluster 2024-09-16T08:29:21.033695+0000 mgr.a (mgr.14373) 7451 : cluster [DBG] pgmap v5167: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:29:22.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:29:22 smithi047 bash[22744]: audit 2024-09-16T08:29:21.212265+0000 mgr.a (mgr.14373) 7452 : audit [DBG] from='client.168246 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:29:24.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:29:24 smithi157 bash[24585]: cluster 2024-09-16T08:29:23.036222+0000 mgr.a (mgr.14373) 7453 : cluster [DBG] pgmap v5168: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 2 op/s 2024-09-16T08:29:24.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:29:24 smithi086 bash[24289]: cluster 2024-09-16T08:29:23.036222+0000 mgr.a (mgr.14373) 7453 : cluster [DBG] pgmap v5168: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 2 op/s 2024-09-16T08:29:24.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:29:24 smithi047 bash[22744]: cluster 2024-09-16T08:29:23.036222+0000 mgr.a (mgr.14373) 7453 : cluster [DBG] pgmap v5168: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 2 op/s 2024-09-16T08:29:26.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:29:26 smithi157 bash[24585]: cluster 2024-09-16T08:29:25.036985+0000 mgr.a (mgr.14373) 7454 : cluster [DBG] pgmap v5169: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-16T08:29:26.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:29:26 smithi086 bash[24289]: cluster 2024-09-16T08:29:25.036985+0000 mgr.a (mgr.14373) 7454 : cluster [DBG] pgmap v5169: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-16T08:29:26.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:29:26 smithi047 bash[22744]: cluster 2024-09-16T08:29:25.036985+0000 mgr.a (mgr.14373) 7454 : cluster [DBG] pgmap v5169: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-16T08:29:26.648 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:29:26.649 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:29:26.649 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:29:27.400 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:29:27.401 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:29:27.401 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:29:27.401 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:29:27.401 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:29:28.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:29:28 smithi157 bash[24585]: audit 2024-09-16T08:29:26.979680+0000 mgr.a (mgr.14373) 7455 : audit [DBG] from='client.168324 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:29:28.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:29:28 smithi157 bash[24585]: cluster 2024-09-16T08:29:27.039245+0000 mgr.a (mgr.14373) 7456 : cluster [DBG] pgmap v5170: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:29:28.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:29:28 smithi086 bash[24289]: audit 2024-09-16T08:29:26.979680+0000 mgr.a (mgr.14373) 7455 : audit [DBG] from='client.168324 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:29:28.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:29:28 smithi086 bash[24289]: cluster 2024-09-16T08:29:27.039245+0000 mgr.a (mgr.14373) 7456 : cluster [DBG] pgmap v5170: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:29:28.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:29:28 smithi047 bash[22744]: audit 2024-09-16T08:29:26.979680+0000 mgr.a (mgr.14373) 7455 : audit [DBG] from='client.168324 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:29:28.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:29:28 smithi047 bash[22744]: cluster 2024-09-16T08:29:27.039245+0000 mgr.a (mgr.14373) 7456 : cluster [DBG] pgmap v5170: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:29:30.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:29:30 smithi157 bash[24585]: cluster 2024-09-16T08:29:29.040187+0000 mgr.a (mgr.14373) 7457 : cluster [DBG] pgmap v5171: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:29:30.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:29:30 smithi086 bash[24289]: cluster 2024-09-16T08:29:29.040187+0000 mgr.a (mgr.14373) 7457 : cluster [DBG] pgmap v5171: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:29:30.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:29:30 smithi047 bash[22744]: cluster 2024-09-16T08:29:29.040187+0000 mgr.a (mgr.14373) 7457 : cluster [DBG] pgmap v5171: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:29:32.402 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:29:32.402 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:29:32.403 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:29:32.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:29:32 smithi157 bash[24585]: cluster 2024-09-16T08:29:31.040968+0000 mgr.a (mgr.14373) 7458 : cluster [DBG] pgmap v5172: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T08:29:32.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:29:32 smithi086 bash[24289]: cluster 2024-09-16T08:29:31.040968+0000 mgr.a (mgr.14373) 7458 : cluster [DBG] pgmap v5172: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T08:29:32.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:29:32 smithi047 bash[22744]: cluster 2024-09-16T08:29:31.040968+0000 mgr.a (mgr.14373) 7458 : cluster [DBG] pgmap v5172: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T08:29:33.146 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:29:33.146 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:29:33.146 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:29:33.146 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:29:33.147 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:29:34.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:29:34 smithi086 bash[24289]: audit 2024-09-16T08:29:32.734734+0000 mgr.a (mgr.14373) 7459 : audit [DBG] from='client.168396 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:29:34.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:29:34 smithi086 bash[24289]: cluster 2024-09-16T08:29:33.042146+0000 mgr.a (mgr.14373) 7460 : cluster [DBG] pgmap v5173: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:29:34.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:29:34 smithi047 bash[22744]: audit 2024-09-16T08:29:32.734734+0000 mgr.a (mgr.14373) 7459 : audit [DBG] from='client.168396 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:29:34.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:29:34 smithi047 bash[22744]: cluster 2024-09-16T08:29:33.042146+0000 mgr.a (mgr.14373) 7460 : cluster [DBG] pgmap v5173: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:29:34.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:29:34 smithi157 bash[24585]: audit 2024-09-16T08:29:32.734734+0000 mgr.a (mgr.14373) 7459 : audit [DBG] from='client.168396 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:29:34.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:29:34 smithi157 bash[24585]: cluster 2024-09-16T08:29:33.042146+0000 mgr.a (mgr.14373) 7460 : cluster [DBG] pgmap v5173: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:29:36.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:29:36 smithi086 bash[24289]: cluster 2024-09-16T08:29:35.043027+0000 mgr.a (mgr.14373) 7461 : cluster [DBG] pgmap v5174: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T08:29:36.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:29:36 smithi047 bash[22744]: cluster 2024-09-16T08:29:35.043027+0000 mgr.a (mgr.14373) 7461 : cluster [DBG] pgmap v5174: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T08:29:36.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:29:36 smithi157 bash[24585]: cluster 2024-09-16T08:29:35.043027+0000 mgr.a (mgr.14373) 7461 : cluster [DBG] pgmap v5174: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T08:29:38.148 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:29:38.149 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:29:38.149 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:29:38.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:29:38 smithi086 bash[24289]: cluster 2024-09-16T08:29:37.045232+0000 mgr.a (mgr.14373) 7462 : cluster [DBG] pgmap v5175: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-16T08:29:38.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:29:38 smithi047 bash[22744]: cluster 2024-09-16T08:29:37.045232+0000 mgr.a (mgr.14373) 7462 : cluster [DBG] pgmap v5175: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-16T08:29:38.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:29:38 smithi157 bash[24585]: cluster 2024-09-16T08:29:37.045232+0000 mgr.a (mgr.14373) 7462 : cluster [DBG] pgmap v5175: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-16T08:29:38.908 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:29:38.909 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:29:38.909 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:29:38.909 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:29:38.909 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:29:39.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:29:39 smithi047 bash[22744]: audit 2024-09-16T08:29:38.493778+0000 mgr.a (mgr.14373) 7463 : audit [DBG] from='client.168468 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:29:39.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:29:39 smithi157 bash[24585]: audit 2024-09-16T08:29:38.493778+0000 mgr.a (mgr.14373) 7463 : audit [DBG] from='client.168468 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:29:39.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:29:39 smithi086 bash[24289]: audit 2024-09-16T08:29:38.493778+0000 mgr.a (mgr.14373) 7463 : audit [DBG] from='client.168468 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:29:40.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:29:40 smithi047 bash[22744]: cluster 2024-09-16T08:29:39.046186+0000 mgr.a (mgr.14373) 7464 : cluster [DBG] pgmap v5176: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:29:40.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:29:40 smithi157 bash[24585]: cluster 2024-09-16T08:29:39.046186+0000 mgr.a (mgr.14373) 7464 : cluster [DBG] pgmap v5176: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:29:40.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:29:40 smithi086 bash[24289]: cluster 2024-09-16T08:29:39.046186+0000 mgr.a (mgr.14373) 7464 : cluster [DBG] pgmap v5176: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:29:42.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:29:42 smithi047 bash[22744]: cluster 2024-09-16T08:29:41.046981+0000 mgr.a (mgr.14373) 7465 : cluster [DBG] pgmap v5177: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:29:42.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:29:42 smithi047 bash[22744]: audit 2024-09-16T08:29:42.183254+0000 mon.b (mon.2) 706 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T08:29:42.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:29:42 smithi157 bash[24585]: cluster 2024-09-16T08:29:41.046981+0000 mgr.a (mgr.14373) 7465 : cluster [DBG] pgmap v5177: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:29:42.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:29:42 smithi157 bash[24585]: audit 2024-09-16T08:29:42.183254+0000 mon.b (mon.2) 706 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T08:29:42.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:29:42 smithi086 bash[24289]: cluster 2024-09-16T08:29:41.046981+0000 mgr.a (mgr.14373) 7465 : cluster [DBG] pgmap v5177: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:29:42.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:29:42 smithi086 bash[24289]: audit 2024-09-16T08:29:42.183254+0000 mon.b (mon.2) 706 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T08:29:43.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:29:43 smithi047 bash[22744]: audit 2024-09-16T08:29:43.025809+0000 mon.b (mon.2) 707 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T08:29:43.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:29:43 smithi047 bash[22744]: audit 2024-09-16T08:29:43.027898+0000 mon.b (mon.2) 708 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T08:29:43.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:29:43 smithi047 bash[22744]: audit 2024-09-16T08:29:43.039386+0000 mon.a (mon.0) 1011 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:29:43.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:29:43 smithi047 bash[22744]: audit 2024-09-16T08:29:43.044027+0000 mon.b (mon.2) 709 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:29:43.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:29:43 smithi157 bash[24585]: audit 2024-09-16T08:29:43.025809+0000 mon.b (mon.2) 707 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T08:29:43.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:29:43 smithi157 bash[24585]: audit 2024-09-16T08:29:43.027898+0000 mon.b (mon.2) 708 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T08:29:43.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:29:43 smithi157 bash[24585]: audit 2024-09-16T08:29:43.039386+0000 mon.a (mon.0) 1011 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:29:43.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:29:43 smithi157 bash[24585]: audit 2024-09-16T08:29:43.044027+0000 mon.b (mon.2) 709 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:29:43.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:29:43 smithi086 bash[24289]: audit 2024-09-16T08:29:43.025809+0000 mon.b (mon.2) 707 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T08:29:43.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:29:43 smithi086 bash[24289]: audit 2024-09-16T08:29:43.027898+0000 mon.b (mon.2) 708 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T08:29:43.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:29:43 smithi086 bash[24289]: audit 2024-09-16T08:29:43.039386+0000 mon.a (mon.0) 1011 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:29:43.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:29:43 smithi086 bash[24289]: audit 2024-09-16T08:29:43.044027+0000 mon.b (mon.2) 709 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:29:43.910 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:29:43.911 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:29:43.911 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:29:44.088 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 08:29:43 smithi047 bash[22994]: debug 2024-09-16T08:29:43.776+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T08:29:44.088 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 08:29:43 smithi047 bash[22994]: debug 2024-09-16T08:29:43.780+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T08:29:44.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:29:44 smithi047 bash[22744]: audit 2024-09-16T08:29:43.047052+0000 mgr.a (mgr.14373) 7466 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:29:44.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:29:44 smithi047 bash[22744]: cluster 2024-09-16T08:29:43.048291+0000 mgr.a (mgr.14373) 7467 : cluster [DBG] pgmap v5178: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:29:44.699 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:29:44.699 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:29:44.699 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:29:44.700 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:29:44.700 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:29:44.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:29:44 smithi157 bash[24585]: audit 2024-09-16T08:29:43.047052+0000 mgr.a (mgr.14373) 7466 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:29:44.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:29:44 smithi157 bash[24585]: cluster 2024-09-16T08:29:43.048291+0000 mgr.a (mgr.14373) 7467 : cluster [DBG] pgmap v5178: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:29:44.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:29:44 smithi086 bash[24289]: audit 2024-09-16T08:29:43.047052+0000 mgr.a (mgr.14373) 7466 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:29:44.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:29:44 smithi086 bash[24289]: cluster 2024-09-16T08:29:43.048291+0000 mgr.a (mgr.14373) 7467 : cluster [DBG] pgmap v5178: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:29:45.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:29:45 smithi157 bash[24585]: audit 2024-09-16T08:29:43.780075+0000 mgr.a (mgr.14373) 7468 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T08:29:45.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:29:45 smithi157 bash[24585]: cephadm 2024-09-16T08:29:43.782551+0000 mgr.a (mgr.14373) 7469 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T08:29:45.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:29:45 smithi157 bash[24585]: audit 2024-09-16T08:29:44.255192+0000 mgr.a (mgr.14373) 7470 : audit [DBG] from='client.168654 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:29:45.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:29:45 smithi086 bash[24289]: audit 2024-09-16T08:29:43.780075+0000 mgr.a (mgr.14373) 7468 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T08:29:45.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:29:45 smithi086 bash[24289]: cephadm 2024-09-16T08:29:43.782551+0000 mgr.a (mgr.14373) 7469 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T08:29:45.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:29:45 smithi086 bash[24289]: audit 2024-09-16T08:29:44.255192+0000 mgr.a (mgr.14373) 7470 : audit [DBG] from='client.168654 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:29:45.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:29:45 smithi047 bash[22744]: audit 2024-09-16T08:29:43.780075+0000 mgr.a (mgr.14373) 7468 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T08:29:45.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:29:45 smithi047 bash[22744]: cephadm 2024-09-16T08:29:43.782551+0000 mgr.a (mgr.14373) 7469 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T08:29:45.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:29:45 smithi047 bash[22744]: audit 2024-09-16T08:29:44.255192+0000 mgr.a (mgr.14373) 7470 : audit [DBG] from='client.168654 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:29:46.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:29:46 smithi157 bash[24585]: cluster 2024-09-16T08:29:45.049236+0000 mgr.a (mgr.14373) 7471 : cluster [DBG] pgmap v5179: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:29:46.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:29:46 smithi086 bash[24289]: cluster 2024-09-16T08:29:45.049236+0000 mgr.a (mgr.14373) 7471 : cluster [DBG] pgmap v5179: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:29:46.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:29:46 smithi047 bash[22744]: cluster 2024-09-16T08:29:45.049236+0000 mgr.a (mgr.14373) 7471 : cluster [DBG] pgmap v5179: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:29:48.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:29:48 smithi157 bash[24585]: cluster 2024-09-16T08:29:47.051378+0000 mgr.a (mgr.14373) 7472 : cluster [DBG] pgmap v5180: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:29:48.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:29:48 smithi086 bash[24289]: cluster 2024-09-16T08:29:47.051378+0000 mgr.a (mgr.14373) 7472 : cluster [DBG] pgmap v5180: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:29:48.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:29:48 smithi047 bash[22744]: cluster 2024-09-16T08:29:47.051378+0000 mgr.a (mgr.14373) 7472 : cluster [DBG] pgmap v5180: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:29:49.701 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:29:49.702 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:29:49.702 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:29:50.464 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:29:50.464 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:29:50.464 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:29:50.464 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:29:50.464 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:29:50.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:29:50 smithi157 bash[24585]: cluster 2024-09-16T08:29:49.052148+0000 mgr.a (mgr.14373) 7473 : cluster [DBG] pgmap v5181: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:29:50.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:29:50 smithi086 bash[24289]: cluster 2024-09-16T08:29:49.052148+0000 mgr.a (mgr.14373) 7473 : cluster [DBG] pgmap v5181: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:29:50.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:29:50 smithi047 bash[22744]: cluster 2024-09-16T08:29:49.052148+0000 mgr.a (mgr.14373) 7473 : cluster [DBG] pgmap v5181: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:29:51.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:29:51 smithi157 bash[24585]: audit 2024-09-16T08:29:50.037453+0000 mgr.a (mgr.14373) 7474 : audit [DBG] from='client.168732 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:29:51.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:29:51 smithi086 bash[24289]: audit 2024-09-16T08:29:50.037453+0000 mgr.a (mgr.14373) 7474 : audit [DBG] from='client.168732 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:29:51.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:29:51 smithi047 bash[22744]: audit 2024-09-16T08:29:50.037453+0000 mgr.a (mgr.14373) 7474 : audit [DBG] from='client.168732 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:29:52.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:29:52 smithi157 bash[24585]: cluster 2024-09-16T08:29:51.053109+0000 mgr.a (mgr.14373) 7475 : cluster [DBG] pgmap v5182: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:29:52.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:29:52 smithi086 bash[24289]: cluster 2024-09-16T08:29:51.053109+0000 mgr.a (mgr.14373) 7475 : cluster [DBG] pgmap v5182: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:29:52.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:29:52 smithi047 bash[22744]: cluster 2024-09-16T08:29:51.053109+0000 mgr.a (mgr.14373) 7475 : cluster [DBG] pgmap v5182: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:29:54.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:29:54 smithi157 bash[24585]: cluster 2024-09-16T08:29:53.055379+0000 mgr.a (mgr.14373) 7476 : cluster [DBG] pgmap v5183: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:29:54.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:29:54 smithi086 bash[24289]: cluster 2024-09-16T08:29:53.055379+0000 mgr.a (mgr.14373) 7476 : cluster [DBG] pgmap v5183: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:29:54.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:29:54 smithi047 bash[22744]: cluster 2024-09-16T08:29:53.055379+0000 mgr.a (mgr.14373) 7476 : cluster [DBG] pgmap v5183: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:29:55.465 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:29:55.466 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:29:55.466 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:29:56.225 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:29:56.225 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:29:56.225 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:29:56.226 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:29:56.226 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:29:56.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:29:56 smithi157 bash[24585]: cluster 2024-09-16T08:29:55.056105+0000 mgr.a (mgr.14373) 7477 : cluster [DBG] pgmap v5184: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:29:56.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:29:56 smithi086 bash[24289]: cluster 2024-09-16T08:29:55.056105+0000 mgr.a (mgr.14373) 7477 : cluster [DBG] pgmap v5184: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:29:56.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:29:56 smithi047 bash[22744]: cluster 2024-09-16T08:29:55.056105+0000 mgr.a (mgr.14373) 7477 : cluster [DBG] pgmap v5184: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:29:57.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:29:57 smithi157 bash[24585]: audit 2024-09-16T08:29:55.803597+0000 mgr.a (mgr.14373) 7478 : audit [DBG] from='client.168807 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:29:57.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:29:57 smithi086 bash[24289]: audit 2024-09-16T08:29:55.803597+0000 mgr.a (mgr.14373) 7478 : audit [DBG] from='client.168807 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:29:57.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:29:57 smithi047 bash[22744]: audit 2024-09-16T08:29:55.803597+0000 mgr.a (mgr.14373) 7478 : audit [DBG] from='client.168807 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:29:58.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:29:58 smithi157 bash[24585]: cluster 2024-09-16T08:29:57.058490+0000 mgr.a (mgr.14373) 7479 : cluster [DBG] pgmap v5185: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:29:58.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:29:58 smithi086 bash[24289]: cluster 2024-09-16T08:29:57.058490+0000 mgr.a (mgr.14373) 7479 : cluster [DBG] pgmap v5185: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:29:58.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:29:58 smithi047 bash[22744]: cluster 2024-09-16T08:29:57.058490+0000 mgr.a (mgr.14373) 7479 : cluster [DBG] pgmap v5185: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:30:00.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:29:59 smithi157 bash[24585]: cluster 2024-09-16T08:29:59.059300+0000 mgr.a (mgr.14373) 7480 : cluster [DBG] pgmap v5186: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:30:00.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:29:59 smithi086 bash[24289]: cluster 2024-09-16T08:29:59.059300+0000 mgr.a (mgr.14373) 7480 : cluster [DBG] pgmap v5186: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:30:00.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:29:59 smithi047 bash[22744]: cluster 2024-09-16T08:29:59.059300+0000 mgr.a (mgr.14373) 7480 : cluster [DBG] pgmap v5186: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:30:01.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:30:00 smithi157 bash[24585]: cluster 2024-09-16T08:30:00.000151+0000 mon.a (mon.0) 1012 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-16T08:30:01.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:30:00 smithi086 bash[24289]: cluster 2024-09-16T08:30:00.000151+0000 mon.a (mon.0) 1012 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-16T08:30:01.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:30:00 smithi047 bash[22744]: cluster 2024-09-16T08:30:00.000151+0000 mon.a (mon.0) 1012 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-16T08:30:01.227 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:30:01.227 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:30:01.227 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:30:02.014 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:30:02.014 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:30:02.014 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:30:02.014 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:30:02.014 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:30:02.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:30:01 smithi157 bash[24585]: cluster 2024-09-16T08:30:01.060050+0000 mgr.a (mgr.14373) 7481 : cluster [DBG] pgmap v5187: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:30:02.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:30:01 smithi157 bash[24585]: audit 2024-09-16T08:30:01.567831+0000 mgr.a (mgr.14373) 7482 : audit [DBG] from='client.168885 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:30:02.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:30:01 smithi086 bash[24289]: cluster 2024-09-16T08:30:01.060050+0000 mgr.a (mgr.14373) 7481 : cluster [DBG] pgmap v5187: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:30:02.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:30:01 smithi086 bash[24289]: audit 2024-09-16T08:30:01.567831+0000 mgr.a (mgr.14373) 7482 : audit [DBG] from='client.168885 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:30:02.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:30:01 smithi047 bash[22744]: cluster 2024-09-16T08:30:01.060050+0000 mgr.a (mgr.14373) 7481 : cluster [DBG] pgmap v5187: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:30:02.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:30:01 smithi047 bash[22744]: audit 2024-09-16T08:30:01.567831+0000 mgr.a (mgr.14373) 7482 : audit [DBG] from='client.168885 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:30:04.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:30:04 smithi157 bash[24585]: cluster 2024-09-16T08:30:03.062808+0000 mgr.a (mgr.14373) 7483 : cluster [DBG] pgmap v5188: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:30:04.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:30:04 smithi086 bash[24289]: cluster 2024-09-16T08:30:03.062808+0000 mgr.a (mgr.14373) 7483 : cluster [DBG] pgmap v5188: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:30:04.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:30:04 smithi047 bash[22744]: cluster 2024-09-16T08:30:03.062808+0000 mgr.a (mgr.14373) 7483 : cluster [DBG] pgmap v5188: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:30:06.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:30:06 smithi157 bash[24585]: cluster 2024-09-16T08:30:05.063628+0000 mgr.a (mgr.14373) 7484 : cluster [DBG] pgmap v5189: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:30:06.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:30:06 smithi086 bash[24289]: cluster 2024-09-16T08:30:05.063628+0000 mgr.a (mgr.14373) 7484 : cluster [DBG] pgmap v5189: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:30:06.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:30:06 smithi047 bash[22744]: cluster 2024-09-16T08:30:05.063628+0000 mgr.a (mgr.14373) 7484 : cluster [DBG] pgmap v5189: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:30:07.015 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:30:07.016 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:30:07.016 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:30:07.801 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:30:07.801 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:30:07.801 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:30:07.801 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:30:07.802 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:30:08.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:30:08 smithi157 bash[24585]: cluster 2024-09-16T08:30:07.065575+0000 mgr.a (mgr.14373) 7485 : cluster [DBG] pgmap v5190: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:30:08.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:30:08 smithi157 bash[24585]: audit 2024-09-16T08:30:07.355276+0000 mgr.a (mgr.14373) 7486 : audit [DBG] from='client.168960 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:30:08.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:30:08 smithi086 bash[24289]: cluster 2024-09-16T08:30:07.065575+0000 mgr.a (mgr.14373) 7485 : cluster [DBG] pgmap v5190: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:30:08.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:30:08 smithi086 bash[24289]: audit 2024-09-16T08:30:07.355276+0000 mgr.a (mgr.14373) 7486 : audit [DBG] from='client.168960 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:30:08.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:30:08 smithi047 bash[22744]: cluster 2024-09-16T08:30:07.065575+0000 mgr.a (mgr.14373) 7485 : cluster [DBG] pgmap v5190: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:30:08.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:30:08 smithi047 bash[22744]: audit 2024-09-16T08:30:07.355276+0000 mgr.a (mgr.14373) 7486 : audit [DBG] from='client.168960 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:30:10.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:30:10 smithi157 bash[24585]: cluster 2024-09-16T08:30:09.066600+0000 mgr.a (mgr.14373) 7487 : cluster [DBG] pgmap v5191: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:30:10.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:30:10 smithi086 bash[24289]: cluster 2024-09-16T08:30:09.066600+0000 mgr.a (mgr.14373) 7487 : cluster [DBG] pgmap v5191: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:30:10.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:30:10 smithi047 bash[22744]: cluster 2024-09-16T08:30:09.066600+0000 mgr.a (mgr.14373) 7487 : cluster [DBG] pgmap v5191: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:30:12.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:30:12 smithi157 bash[24585]: cluster 2024-09-16T08:30:11.067388+0000 mgr.a (mgr.14373) 7488 : cluster [DBG] pgmap v5192: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T08:30:12.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:30:12 smithi086 bash[24289]: cluster 2024-09-16T08:30:11.067388+0000 mgr.a (mgr.14373) 7488 : cluster [DBG] pgmap v5192: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T08:30:12.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:30:12 smithi047 bash[22744]: cluster 2024-09-16T08:30:11.067388+0000 mgr.a (mgr.14373) 7488 : cluster [DBG] pgmap v5192: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T08:30:12.803 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:30:12.803 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:30:12.804 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:30:13.561 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:30:13.562 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:30:13.562 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:30:13.562 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:30:13.562 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:30:14.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:30:14 smithi157 bash[24585]: cluster 2024-09-16T08:30:13.069541+0000 mgr.a (mgr.14373) 7489 : cluster [DBG] pgmap v5193: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:30:14.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:30:14 smithi157 bash[24585]: audit 2024-09-16T08:30:13.140492+0000 mgr.a (mgr.14373) 7490 : audit [DBG] from='client.169035 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:30:14.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:30:14 smithi086 bash[24289]: cluster 2024-09-16T08:30:13.069541+0000 mgr.a (mgr.14373) 7489 : cluster [DBG] pgmap v5193: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:30:14.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:30:14 smithi086 bash[24289]: audit 2024-09-16T08:30:13.140492+0000 mgr.a (mgr.14373) 7490 : audit [DBG] from='client.169035 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:30:14.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:30:14 smithi047 bash[22744]: cluster 2024-09-16T08:30:13.069541+0000 mgr.a (mgr.14373) 7489 : cluster [DBG] pgmap v5193: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:30:14.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:30:14 smithi047 bash[22744]: audit 2024-09-16T08:30:13.140492+0000 mgr.a (mgr.14373) 7490 : audit [DBG] from='client.169035 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:30:16.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:30:16 smithi157 bash[24585]: cluster 2024-09-16T08:30:15.070483+0000 mgr.a (mgr.14373) 7491 : cluster [DBG] pgmap v5194: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:30:16.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:30:16 smithi086 bash[24289]: cluster 2024-09-16T08:30:15.070483+0000 mgr.a (mgr.14373) 7491 : cluster [DBG] pgmap v5194: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:30:16.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:30:16 smithi047 bash[22744]: cluster 2024-09-16T08:30:15.070483+0000 mgr.a (mgr.14373) 7491 : cluster [DBG] pgmap v5194: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:30:18.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:30:18 smithi157 bash[24585]: cluster 2024-09-16T08:30:17.072646+0000 mgr.a (mgr.14373) 7492 : cluster [DBG] pgmap v5195: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:30:18.563 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:30:18.564 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:30:18.564 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:30:18.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:30:18 smithi086 bash[24289]: cluster 2024-09-16T08:30:17.072646+0000 mgr.a (mgr.14373) 7492 : cluster [DBG] pgmap v5195: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:30:18.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:30:18 smithi047 bash[22744]: cluster 2024-09-16T08:30:17.072646+0000 mgr.a (mgr.14373) 7492 : cluster [DBG] pgmap v5195: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:30:19.345 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:30:19.345 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:30:19.345 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:30:19.346 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:30:19.346 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:30:20.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:30:20 smithi157 bash[24585]: audit 2024-09-16T08:30:18.903035+0000 mgr.a (mgr.14373) 7493 : audit [DBG] from='client.169113 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:30:20.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:30:20 smithi157 bash[24585]: cluster 2024-09-16T08:30:19.073244+0000 mgr.a (mgr.14373) 7494 : cluster [DBG] pgmap v5196: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:30:20.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:30:20 smithi086 bash[24289]: audit 2024-09-16T08:30:18.903035+0000 mgr.a (mgr.14373) 7493 : audit [DBG] from='client.169113 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:30:20.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:30:20 smithi086 bash[24289]: cluster 2024-09-16T08:30:19.073244+0000 mgr.a (mgr.14373) 7494 : cluster [DBG] pgmap v5196: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:30:20.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:30:20 smithi047 bash[22744]: audit 2024-09-16T08:30:18.903035+0000 mgr.a (mgr.14373) 7493 : audit [DBG] from='client.169113 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:30:20.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:30:20 smithi047 bash[22744]: cluster 2024-09-16T08:30:19.073244+0000 mgr.a (mgr.14373) 7494 : cluster [DBG] pgmap v5196: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:30:22.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:30:22 smithi157 bash[24585]: cluster 2024-09-16T08:30:21.074177+0000 mgr.a (mgr.14373) 7495 : cluster [DBG] pgmap v5197: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:30:22.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:30:22 smithi086 bash[24289]: cluster 2024-09-16T08:30:21.074177+0000 mgr.a (mgr.14373) 7495 : cluster [DBG] pgmap v5197: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:30:22.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:30:22 smithi047 bash[22744]: cluster 2024-09-16T08:30:21.074177+0000 mgr.a (mgr.14373) 7495 : cluster [DBG] pgmap v5197: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:30:24.347 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:30:24.347 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:30:24.348 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:30:24.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:30:24 smithi157 bash[24585]: cluster 2024-09-16T08:30:23.076454+0000 mgr.a (mgr.14373) 7496 : cluster [DBG] pgmap v5198: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:30:24.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:30:24 smithi086 bash[24289]: cluster 2024-09-16T08:30:23.076454+0000 mgr.a (mgr.14373) 7496 : cluster [DBG] pgmap v5198: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:30:24.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:30:24 smithi047 bash[22744]: cluster 2024-09-16T08:30:23.076454+0000 mgr.a (mgr.14373) 7496 : cluster [DBG] pgmap v5198: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:30:25.107 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:30:25.107 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:30:25.108 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:30:25.108 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:30:25.108 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:30:26.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:30:26 smithi157 bash[24585]: audit 2024-09-16T08:30:24.684716+0000 mgr.a (mgr.14373) 7497 : audit [DBG] from='client.169188 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:30:26.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:30:26 smithi157 bash[24585]: cluster 2024-09-16T08:30:25.077064+0000 mgr.a (mgr.14373) 7498 : cluster [DBG] pgmap v5199: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:30:26.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:30:26 smithi086 bash[24289]: audit 2024-09-16T08:30:24.684716+0000 mgr.a (mgr.14373) 7497 : audit [DBG] from='client.169188 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:30:26.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:30:26 smithi086 bash[24289]: cluster 2024-09-16T08:30:25.077064+0000 mgr.a (mgr.14373) 7498 : cluster [DBG] pgmap v5199: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:30:26.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:30:26 smithi047 bash[22744]: audit 2024-09-16T08:30:24.684716+0000 mgr.a (mgr.14373) 7497 : audit [DBG] from='client.169188 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:30:26.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:30:26 smithi047 bash[22744]: cluster 2024-09-16T08:30:25.077064+0000 mgr.a (mgr.14373) 7498 : cluster [DBG] pgmap v5199: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:30:28.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:30:28 smithi157 bash[24585]: cluster 2024-09-16T08:30:27.079325+0000 mgr.a (mgr.14373) 7499 : cluster [DBG] pgmap v5200: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:30:28.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:30:28 smithi086 bash[24289]: cluster 2024-09-16T08:30:27.079325+0000 mgr.a (mgr.14373) 7499 : cluster [DBG] pgmap v5200: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:30:28.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:30:28 smithi047 bash[22744]: cluster 2024-09-16T08:30:27.079325+0000 mgr.a (mgr.14373) 7499 : cluster [DBG] pgmap v5200: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:30:30.109 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:30:30.110 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:30:30.110 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:30:30.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:30:30 smithi157 bash[24585]: cluster 2024-09-16T08:30:29.080298+0000 mgr.a (mgr.14373) 7500 : cluster [DBG] pgmap v5201: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:30:30.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:30:30 smithi086 bash[24289]: cluster 2024-09-16T08:30:29.080298+0000 mgr.a (mgr.14373) 7500 : cluster [DBG] pgmap v5201: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:30:30.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:30:30 smithi047 bash[22744]: cluster 2024-09-16T08:30:29.080298+0000 mgr.a (mgr.14373) 7500 : cluster [DBG] pgmap v5201: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:30:30.886 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:30:30.886 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:30:30.886 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:30:30.886 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:30:30.887 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:30:31.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:30:31 smithi157 bash[24585]: audit 2024-09-16T08:30:30.455891+0000 mgr.a (mgr.14373) 7501 : audit [DBG] from='client.169260 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:30:31.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:30:31 smithi086 bash[24289]: audit 2024-09-16T08:30:30.455891+0000 mgr.a (mgr.14373) 7501 : audit [DBG] from='client.169260 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:30:31.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:30:31 smithi047 bash[22744]: audit 2024-09-16T08:30:30.455891+0000 mgr.a (mgr.14373) 7501 : audit [DBG] from='client.169260 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:30:32.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:30:32 smithi157 bash[24585]: cluster 2024-09-16T08:30:31.081299+0000 mgr.a (mgr.14373) 7502 : cluster [DBG] pgmap v5202: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:30:32.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:30:32 smithi086 bash[24289]: cluster 2024-09-16T08:30:31.081299+0000 mgr.a (mgr.14373) 7502 : cluster [DBG] pgmap v5202: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:30:32.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:30:32 smithi047 bash[22744]: cluster 2024-09-16T08:30:31.081299+0000 mgr.a (mgr.14373) 7502 : cluster [DBG] pgmap v5202: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:30:34.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:30:34 smithi157 bash[24585]: cluster 2024-09-16T08:30:33.083551+0000 mgr.a (mgr.14373) 7503 : cluster [DBG] pgmap v5203: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:30:34.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:30:34 smithi086 bash[24289]: cluster 2024-09-16T08:30:33.083551+0000 mgr.a (mgr.14373) 7503 : cluster [DBG] pgmap v5203: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:30:34.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:30:34 smithi047 bash[22744]: cluster 2024-09-16T08:30:33.083551+0000 mgr.a (mgr.14373) 7503 : cluster [DBG] pgmap v5203: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:30:35.888 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:30:35.888 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:30:35.888 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:30:36.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:30:36 smithi157 bash[24585]: cluster 2024-09-16T08:30:35.084324+0000 mgr.a (mgr.14373) 7504 : cluster [DBG] pgmap v5204: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:30:36.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:30:36 smithi086 bash[24289]: cluster 2024-09-16T08:30:35.084324+0000 mgr.a (mgr.14373) 7504 : cluster [DBG] pgmap v5204: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:30:36.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:30:36 smithi047 bash[22744]: cluster 2024-09-16T08:30:35.084324+0000 mgr.a (mgr.14373) 7504 : cluster [DBG] pgmap v5204: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:30:36.633 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:30:36.633 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:30:36.633 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:30:36.633 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:30:36.633 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:30:37.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:30:37 smithi157 bash[24585]: audit 2024-09-16T08:30:36.221111+0000 mgr.a (mgr.14373) 7505 : audit [DBG] from='client.169338 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:30:37.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:30:37 smithi086 bash[24289]: audit 2024-09-16T08:30:36.221111+0000 mgr.a (mgr.14373) 7505 : audit [DBG] from='client.169338 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:30:37.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:30:37 smithi047 bash[22744]: audit 2024-09-16T08:30:36.221111+0000 mgr.a (mgr.14373) 7505 : audit [DBG] from='client.169338 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:30:38.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:30:38 smithi157 bash[24585]: cluster 2024-09-16T08:30:37.086732+0000 mgr.a (mgr.14373) 7506 : cluster [DBG] pgmap v5205: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-16T08:30:38.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:30:38 smithi086 bash[24289]: cluster 2024-09-16T08:30:37.086732+0000 mgr.a (mgr.14373) 7506 : cluster [DBG] pgmap v5205: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-16T08:30:38.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:30:38 smithi047 bash[22744]: cluster 2024-09-16T08:30:37.086732+0000 mgr.a (mgr.14373) 7506 : cluster [DBG] pgmap v5205: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-16T08:30:40.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:30:40 smithi157 bash[24585]: cluster 2024-09-16T08:30:39.087501+0000 mgr.a (mgr.14373) 7507 : cluster [DBG] pgmap v5206: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T08:30:40.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:30:40 smithi086 bash[24289]: cluster 2024-09-16T08:30:39.087501+0000 mgr.a (mgr.14373) 7507 : cluster [DBG] pgmap v5206: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T08:30:40.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:30:40 smithi047 bash[22744]: cluster 2024-09-16T08:30:39.087501+0000 mgr.a (mgr.14373) 7507 : cluster [DBG] pgmap v5206: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T08:30:41.634 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:30:41.635 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:30:41.635 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:30:42.384 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:30:42.385 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:30:42.385 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:30:42.385 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:30:42.385 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:30:42.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:30:42 smithi157 bash[24585]: cluster 2024-09-16T08:30:41.088268+0000 mgr.a (mgr.14373) 7508 : cluster [DBG] pgmap v5207: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T08:30:42.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:30:42 smithi086 bash[24289]: cluster 2024-09-16T08:30:41.088268+0000 mgr.a (mgr.14373) 7508 : cluster [DBG] pgmap v5207: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T08:30:42.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:30:42 smithi047 bash[22744]: cluster 2024-09-16T08:30:41.088268+0000 mgr.a (mgr.14373) 7508 : cluster [DBG] pgmap v5207: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T08:30:43.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:30:43 smithi157 bash[24585]: audit 2024-09-16T08:30:41.968648+0000 mgr.a (mgr.14373) 7509 : audit [DBG] from='client.169416 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:30:43.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:30:43 smithi086 bash[24289]: audit 2024-09-16T08:30:41.968648+0000 mgr.a (mgr.14373) 7509 : audit [DBG] from='client.169416 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:30:43.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:30:43 smithi047 bash[22744]: audit 2024-09-16T08:30:41.968648+0000 mgr.a (mgr.14373) 7509 : audit [DBG] from='client.169416 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:30:44.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:30:44 smithi157 bash[24585]: cluster 2024-09-16T08:30:43.091091+0000 mgr.a (mgr.14373) 7510 : cluster [DBG] pgmap v5208: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:30:44.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:30:44 smithi157 bash[24585]: audit 2024-09-16T08:30:43.833673+0000 mon.b (mon.2) 710 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T08:30:44.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:30:44 smithi086 bash[24289]: cluster 2024-09-16T08:30:43.091091+0000 mgr.a (mgr.14373) 7510 : cluster [DBG] pgmap v5208: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:30:44.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:30:44 smithi086 bash[24289]: audit 2024-09-16T08:30:43.833673+0000 mon.b (mon.2) 710 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T08:30:44.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:30:44 smithi047 bash[22744]: cluster 2024-09-16T08:30:43.091091+0000 mgr.a (mgr.14373) 7510 : cluster [DBG] pgmap v5208: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:30:44.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:30:44 smithi047 bash[22744]: audit 2024-09-16T08:30:43.833673+0000 mon.b (mon.2) 710 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T08:30:45.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:30:45 smithi157 bash[24585]: audit 2024-09-16T08:30:44.458891+0000 mon.a (mon.0) 1013 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:30:45.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:30:45 smithi157 bash[24585]: audit 2024-09-16T08:30:44.464325+0000 mon.a (mon.0) 1014 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:30:45.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:30:45 smithi157 bash[24585]: audit 2024-09-16T08:30:45.279375+0000 mon.b (mon.2) 711 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T08:30:45.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:30:45 smithi157 bash[24585]: audit 2024-09-16T08:30:45.281403+0000 mon.b (mon.2) 712 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T08:30:45.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:30:45 smithi157 bash[24585]: audit 2024-09-16T08:30:45.294646+0000 mon.a (mon.0) 1015 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:30:45.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:30:45 smithi157 bash[24585]: audit 2024-09-16T08:30:45.299017+0000 mon.b (mon.2) 713 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:30:45.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:30:45 smithi086 bash[24289]: audit 2024-09-16T08:30:44.458891+0000 mon.a (mon.0) 1013 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:30:45.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:30:45 smithi086 bash[24289]: audit 2024-09-16T08:30:44.464325+0000 mon.a (mon.0) 1014 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:30:45.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:30:45 smithi086 bash[24289]: audit 2024-09-16T08:30:45.279375+0000 mon.b (mon.2) 711 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T08:30:45.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:30:45 smithi086 bash[24289]: audit 2024-09-16T08:30:45.281403+0000 mon.b (mon.2) 712 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T08:30:45.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:30:45 smithi086 bash[24289]: audit 2024-09-16T08:30:45.294646+0000 mon.a (mon.0) 1015 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:30:45.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:30:45 smithi086 bash[24289]: audit 2024-09-16T08:30:45.299017+0000 mon.b (mon.2) 713 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:30:45.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:30:45 smithi047 bash[22744]: audit 2024-09-16T08:30:44.458891+0000 mon.a (mon.0) 1013 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:30:45.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:30:45 smithi047 bash[22744]: audit 2024-09-16T08:30:44.464325+0000 mon.a (mon.0) 1014 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:30:45.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:30:45 smithi047 bash[22744]: audit 2024-09-16T08:30:45.279375+0000 mon.b (mon.2) 711 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T08:30:45.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:30:45 smithi047 bash[22744]: audit 2024-09-16T08:30:45.281403+0000 mon.b (mon.2) 712 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T08:30:45.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:30:45 smithi047 bash[22744]: audit 2024-09-16T08:30:45.294646+0000 mon.a (mon.0) 1015 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:30:45.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:30:45 smithi047 bash[22744]: audit 2024-09-16T08:30:45.299017+0000 mon.b (mon.2) 713 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:30:46.338 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 08:30:46 smithi047 bash[22994]: debug 2024-09-16T08:30:46.055+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T08:30:46.338 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 08:30:46 smithi047 bash[22994]: debug 2024-09-16T08:30:46.055+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T08:30:46.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:30:46 smithi157 bash[24585]: cluster 2024-09-16T08:30:45.091830+0000 mgr.a (mgr.14373) 7511 : cluster [DBG] pgmap v5209: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:30:46.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:30:46 smithi157 bash[24585]: audit 2024-09-16T08:30:45.302953+0000 mgr.a (mgr.14373) 7512 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:30:46.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:30:46 smithi086 bash[24289]: cluster 2024-09-16T08:30:45.091830+0000 mgr.a (mgr.14373) 7511 : cluster [DBG] pgmap v5209: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:30:46.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:30:46 smithi086 bash[24289]: audit 2024-09-16T08:30:45.302953+0000 mgr.a (mgr.14373) 7512 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:30:46.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:30:46 smithi047 bash[22744]: cluster 2024-09-16T08:30:45.091830+0000 mgr.a (mgr.14373) 7511 : cluster [DBG] pgmap v5209: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:30:46.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:30:46 smithi047 bash[22744]: audit 2024-09-16T08:30:45.302953+0000 mgr.a (mgr.14373) 7512 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:30:47.385 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:30:47.386 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:30:47.386 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:30:47.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:30:47 smithi157 bash[24585]: audit 2024-09-16T08:30:46.058990+0000 mgr.a (mgr.14373) 7513 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T08:30:47.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:30:47 smithi157 bash[24585]: cephadm 2024-09-16T08:30:46.060709+0000 mgr.a (mgr.14373) 7514 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T08:30:47.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:30:47 smithi086 bash[24289]: audit 2024-09-16T08:30:46.058990+0000 mgr.a (mgr.14373) 7513 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T08:30:47.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:30:47 smithi086 bash[24289]: cephadm 2024-09-16T08:30:46.060709+0000 mgr.a (mgr.14373) 7514 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T08:30:47.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:30:47 smithi047 bash[22744]: audit 2024-09-16T08:30:46.058990+0000 mgr.a (mgr.14373) 7513 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T08:30:47.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:30:47 smithi047 bash[22744]: cephadm 2024-09-16T08:30:46.060709+0000 mgr.a (mgr.14373) 7514 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T08:30:48.147 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:30:48.147 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:30:48.147 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:30:48.147 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:30:48.148 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:30:48.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:30:48 smithi157 bash[24585]: cluster 2024-09-16T08:30:47.094073+0000 mgr.a (mgr.14373) 7515 : cluster [DBG] pgmap v5210: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:30:48.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:30:48 smithi086 bash[24289]: cluster 2024-09-16T08:30:47.094073+0000 mgr.a (mgr.14373) 7515 : cluster [DBG] pgmap v5210: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:30:48.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:30:48 smithi047 bash[22744]: cluster 2024-09-16T08:30:47.094073+0000 mgr.a (mgr.14373) 7515 : cluster [DBG] pgmap v5210: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:30:49.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:30:49 smithi157 bash[24585]: audit 2024-09-16T08:30:47.723645+0000 mgr.a (mgr.14373) 7516 : audit [DBG] from='client.169599 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:30:49.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:30:49 smithi086 bash[24289]: audit 2024-09-16T08:30:47.723645+0000 mgr.a (mgr.14373) 7516 : audit [DBG] from='client.169599 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:30:49.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:30:49 smithi047 bash[22744]: audit 2024-09-16T08:30:47.723645+0000 mgr.a (mgr.14373) 7516 : audit [DBG] from='client.169599 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:30:50.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:30:50 smithi157 bash[24585]: cluster 2024-09-16T08:30:49.095069+0000 mgr.a (mgr.14373) 7517 : cluster [DBG] pgmap v5211: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T08:30:50.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:30:50 smithi086 bash[24289]: cluster 2024-09-16T08:30:49.095069+0000 mgr.a (mgr.14373) 7517 : cluster [DBG] pgmap v5211: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T08:30:50.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:30:50 smithi047 bash[22744]: cluster 2024-09-16T08:30:49.095069+0000 mgr.a (mgr.14373) 7517 : cluster [DBG] pgmap v5211: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T08:30:52.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:30:52 smithi157 bash[24585]: cluster 2024-09-16T08:30:51.095864+0000 mgr.a (mgr.14373) 7518 : cluster [DBG] pgmap v5212: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T08:30:52.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:30:52 smithi086 bash[24289]: cluster 2024-09-16T08:30:51.095864+0000 mgr.a (mgr.14373) 7518 : cluster [DBG] pgmap v5212: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T08:30:52.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:30:52 smithi047 bash[22744]: cluster 2024-09-16T08:30:51.095864+0000 mgr.a (mgr.14373) 7518 : cluster [DBG] pgmap v5212: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T08:30:53.149 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:30:53.150 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:30:53.150 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:30:53.920 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:30:53.920 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:30:53.920 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:30:53.920 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:30:53.920 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:30:54.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:30:54 smithi157 bash[24585]: cluster 2024-09-16T08:30:53.098121+0000 mgr.a (mgr.14373) 7519 : cluster [DBG] pgmap v5213: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.4 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:30:54.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:30:54 smithi157 bash[24585]: audit 2024-09-16T08:30:53.489465+0000 mgr.a (mgr.14373) 7520 : audit [DBG] from='client.169677 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:30:54.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:30:54 smithi086 bash[24289]: cluster 2024-09-16T08:30:53.098121+0000 mgr.a (mgr.14373) 7519 : cluster [DBG] pgmap v5213: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.4 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:30:54.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:30:54 smithi086 bash[24289]: audit 2024-09-16T08:30:53.489465+0000 mgr.a (mgr.14373) 7520 : audit [DBG] from='client.169677 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:30:54.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:30:54 smithi047 bash[22744]: cluster 2024-09-16T08:30:53.098121+0000 mgr.a (mgr.14373) 7519 : cluster [DBG] pgmap v5213: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.4 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:30:54.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:30:54 smithi047 bash[22744]: audit 2024-09-16T08:30:53.489465+0000 mgr.a (mgr.14373) 7520 : audit [DBG] from='client.169677 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:30:56.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:30:56 smithi157 bash[24585]: cluster 2024-09-16T08:30:55.099202+0000 mgr.a (mgr.14373) 7521 : cluster [DBG] pgmap v5214: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:30:56.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:30:56 smithi086 bash[24289]: cluster 2024-09-16T08:30:55.099202+0000 mgr.a (mgr.14373) 7521 : cluster [DBG] pgmap v5214: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:30:56.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:30:56 smithi047 bash[22744]: cluster 2024-09-16T08:30:55.099202+0000 mgr.a (mgr.14373) 7521 : cluster [DBG] pgmap v5214: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:30:58.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:30:58 smithi157 bash[24585]: cluster 2024-09-16T08:30:57.101475+0000 mgr.a (mgr.14373) 7522 : cluster [DBG] pgmap v5215: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:30:58.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:30:58 smithi086 bash[24289]: cluster 2024-09-16T08:30:57.101475+0000 mgr.a (mgr.14373) 7522 : cluster [DBG] pgmap v5215: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:30:58.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:30:58 smithi047 bash[22744]: cluster 2024-09-16T08:30:57.101475+0000 mgr.a (mgr.14373) 7522 : cluster [DBG] pgmap v5215: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:30:58.921 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:30:58.922 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:30:58.922 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:30:59.672 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:30:59.672 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:30:59.673 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:30:59.673 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:30:59.673 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:31:00.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:31:00 smithi157 bash[24585]: cluster 2024-09-16T08:30:59.102228+0000 mgr.a (mgr.14373) 7523 : cluster [DBG] pgmap v5216: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:31:00.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:31:00 smithi157 bash[24585]: audit 2024-09-16T08:30:59.255149+0000 mgr.a (mgr.14373) 7524 : audit [DBG] from='client.169752 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:31:00.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:31:00 smithi086 bash[24289]: cluster 2024-09-16T08:30:59.102228+0000 mgr.a (mgr.14373) 7523 : cluster [DBG] pgmap v5216: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:31:00.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:31:00 smithi086 bash[24289]: audit 2024-09-16T08:30:59.255149+0000 mgr.a (mgr.14373) 7524 : audit [DBG] from='client.169752 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:31:00.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:31:00 smithi047 bash[22744]: cluster 2024-09-16T08:30:59.102228+0000 mgr.a (mgr.14373) 7523 : cluster [DBG] pgmap v5216: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:31:00.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:31:00 smithi047 bash[22744]: audit 2024-09-16T08:30:59.255149+0000 mgr.a (mgr.14373) 7524 : audit [DBG] from='client.169752 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:31:02.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:31:02 smithi157 bash[24585]: cluster 2024-09-16T08:31:01.103098+0000 mgr.a (mgr.14373) 7525 : cluster [DBG] pgmap v5217: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:31:02.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:31:02 smithi086 bash[24289]: cluster 2024-09-16T08:31:01.103098+0000 mgr.a (mgr.14373) 7525 : cluster [DBG] pgmap v5217: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:31:02.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:31:02 smithi047 bash[22744]: cluster 2024-09-16T08:31:01.103098+0000 mgr.a (mgr.14373) 7525 : cluster [DBG] pgmap v5217: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:31:04.674 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:31:04.674 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:31:04.674 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:31:04.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:31:04 smithi157 bash[24585]: cluster 2024-09-16T08:31:03.105351+0000 mgr.a (mgr.14373) 7526 : cluster [DBG] pgmap v5218: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:31:04.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:31:04 smithi086 bash[24289]: cluster 2024-09-16T08:31:03.105351+0000 mgr.a (mgr.14373) 7526 : cluster [DBG] pgmap v5218: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:31:04.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:31:04 smithi047 bash[22744]: cluster 2024-09-16T08:31:03.105351+0000 mgr.a (mgr.14373) 7526 : cluster [DBG] pgmap v5218: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:31:05.431 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:31:05.431 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:31:05.431 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:31:05.431 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:31:05.431 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:31:06.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:31:06 smithi157 bash[24585]: audit 2024-09-16T08:31:05.009263+0000 mgr.a (mgr.14373) 7527 : audit [DBG] from='client.169827 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:31:06.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:31:06 smithi157 bash[24585]: cluster 2024-09-16T08:31:05.105917+0000 mgr.a (mgr.14373) 7528 : cluster [DBG] pgmap v5219: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:31:06.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:31:06 smithi086 bash[24289]: audit 2024-09-16T08:31:05.009263+0000 mgr.a (mgr.14373) 7527 : audit [DBG] from='client.169827 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:31:06.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:31:06 smithi086 bash[24289]: cluster 2024-09-16T08:31:05.105917+0000 mgr.a (mgr.14373) 7528 : cluster [DBG] pgmap v5219: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:31:06.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:31:06 smithi047 bash[22744]: audit 2024-09-16T08:31:05.009263+0000 mgr.a (mgr.14373) 7527 : audit [DBG] from='client.169827 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:31:06.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:31:06 smithi047 bash[22744]: cluster 2024-09-16T08:31:05.105917+0000 mgr.a (mgr.14373) 7528 : cluster [DBG] pgmap v5219: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:31:08.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:31:08 smithi157 bash[24585]: cluster 2024-09-16T08:31:07.108209+0000 mgr.a (mgr.14373) 7529 : cluster [DBG] pgmap v5220: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:31:08.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:31:08 smithi086 bash[24289]: cluster 2024-09-16T08:31:07.108209+0000 mgr.a (mgr.14373) 7529 : cluster [DBG] pgmap v5220: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:31:08.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:31:08 smithi047 bash[22744]: cluster 2024-09-16T08:31:07.108209+0000 mgr.a (mgr.14373) 7529 : cluster [DBG] pgmap v5220: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:31:10.432 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:31:10.433 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:31:10.433 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:31:10.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:31:10 smithi157 bash[24585]: cluster 2024-09-16T08:31:09.109010+0000 mgr.a (mgr.14373) 7530 : cluster [DBG] pgmap v5221: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:31:10.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:31:10 smithi086 bash[24289]: cluster 2024-09-16T08:31:09.109010+0000 mgr.a (mgr.14373) 7530 : cluster [DBG] pgmap v5221: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:31:10.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:31:10 smithi047 bash[22744]: cluster 2024-09-16T08:31:09.109010+0000 mgr.a (mgr.14373) 7530 : cluster [DBG] pgmap v5221: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:31:11.180 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:31:11.181 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:31:11.181 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:31:11.181 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:31:11.181 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:31:12.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:31:12 smithi157 bash[24585]: audit 2024-09-16T08:31:10.767047+0000 mgr.a (mgr.14373) 7531 : audit [DBG] from='client.169905 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:31:12.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:31:12 smithi157 bash[24585]: cluster 2024-09-16T08:31:11.109553+0000 mgr.a (mgr.14373) 7532 : cluster [DBG] pgmap v5222: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:31:12.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:31:12 smithi086 bash[24289]: audit 2024-09-16T08:31:10.767047+0000 mgr.a (mgr.14373) 7531 : audit [DBG] from='client.169905 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:31:12.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:31:12 smithi086 bash[24289]: cluster 2024-09-16T08:31:11.109553+0000 mgr.a (mgr.14373) 7532 : cluster [DBG] pgmap v5222: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:31:12.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:31:12 smithi047 bash[22744]: audit 2024-09-16T08:31:10.767047+0000 mgr.a (mgr.14373) 7531 : audit [DBG] from='client.169905 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:31:12.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:31:12 smithi047 bash[22744]: cluster 2024-09-16T08:31:11.109553+0000 mgr.a (mgr.14373) 7532 : cluster [DBG] pgmap v5222: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:31:14.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:31:14 smithi157 bash[24585]: cluster 2024-09-16T08:31:13.111812+0000 mgr.a (mgr.14373) 7533 : cluster [DBG] pgmap v5223: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:31:14.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:31:14 smithi086 bash[24289]: cluster 2024-09-16T08:31:13.111812+0000 mgr.a (mgr.14373) 7533 : cluster [DBG] pgmap v5223: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:31:14.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:31:14 smithi047 bash[22744]: cluster 2024-09-16T08:31:13.111812+0000 mgr.a (mgr.14373) 7533 : cluster [DBG] pgmap v5223: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:31:16.182 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:31:16.183 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:31:16.183 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:31:16.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:31:16 smithi157 bash[24585]: cluster 2024-09-16T08:31:15.112604+0000 mgr.a (mgr.14373) 7534 : cluster [DBG] pgmap v5224: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:31:16.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:31:16 smithi086 bash[24289]: cluster 2024-09-16T08:31:15.112604+0000 mgr.a (mgr.14373) 7534 : cluster [DBG] pgmap v5224: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:31:16.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:31:16 smithi047 bash[22744]: cluster 2024-09-16T08:31:15.112604+0000 mgr.a (mgr.14373) 7534 : cluster [DBG] pgmap v5224: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:31:16.963 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:31:16.964 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:31:16.964 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:31:16.964 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:31:16.964 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:31:17.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:31:17 smithi157 bash[24585]: audit 2024-09-16T08:31:16.523229+0000 mgr.a (mgr.14373) 7535 : audit [DBG] from='client.169977 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:31:17.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:31:17 smithi086 bash[24289]: audit 2024-09-16T08:31:16.523229+0000 mgr.a (mgr.14373) 7535 : audit [DBG] from='client.169977 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:31:17.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:31:17 smithi047 bash[22744]: audit 2024-09-16T08:31:16.523229+0000 mgr.a (mgr.14373) 7535 : audit [DBG] from='client.169977 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:31:18.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:31:18 smithi157 bash[24585]: cluster 2024-09-16T08:31:17.115348+0000 mgr.a (mgr.14373) 7536 : cluster [DBG] pgmap v5225: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:31:18.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:31:18 smithi086 bash[24289]: cluster 2024-09-16T08:31:17.115348+0000 mgr.a (mgr.14373) 7536 : cluster [DBG] pgmap v5225: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:31:18.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:31:18 smithi047 bash[22744]: cluster 2024-09-16T08:31:17.115348+0000 mgr.a (mgr.14373) 7536 : cluster [DBG] pgmap v5225: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:31:20.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:31:20 smithi086 bash[24289]: cluster 2024-09-16T08:31:19.116163+0000 mgr.a (mgr.14373) 7537 : cluster [DBG] pgmap v5226: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:31:20.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:31:20 smithi047 bash[22744]: cluster 2024-09-16T08:31:19.116163+0000 mgr.a (mgr.14373) 7537 : cluster [DBG] pgmap v5226: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:31:21.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:31:20 smithi157 bash[24585]: cluster 2024-09-16T08:31:19.116163+0000 mgr.a (mgr.14373) 7537 : cluster [DBG] pgmap v5226: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:31:21.965 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:31:21.965 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:31:21.966 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:31:22.713 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:31:22.713 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:31:22.713 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:31:22.713 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:31:22.713 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:31:22.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:31:22 smithi086 bash[24289]: cluster 2024-09-16T08:31:21.116928+0000 mgr.a (mgr.14373) 7538 : cluster [DBG] pgmap v5227: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T08:31:22.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:31:22 smithi047 bash[22744]: cluster 2024-09-16T08:31:21.116928+0000 mgr.a (mgr.14373) 7538 : cluster [DBG] pgmap v5227: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T08:31:23.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:31:22 smithi157 bash[24585]: cluster 2024-09-16T08:31:21.116928+0000 mgr.a (mgr.14373) 7538 : cluster [DBG] pgmap v5227: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T08:31:23.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:31:23 smithi047 bash[22744]: audit 2024-09-16T08:31:22.299666+0000 mgr.a (mgr.14373) 7539 : audit [DBG] from='client.170052 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:31:24.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:31:23 smithi157 bash[24585]: audit 2024-09-16T08:31:22.299666+0000 mgr.a (mgr.14373) 7539 : audit [DBG] from='client.170052 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:31:24.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:31:23 smithi086 bash[24289]: audit 2024-09-16T08:31:22.299666+0000 mgr.a (mgr.14373) 7539 : audit [DBG] from='client.170052 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:31:24.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:31:24 smithi047 bash[22744]: cluster 2024-09-16T08:31:23.119748+0000 mgr.a (mgr.14373) 7540 : cluster [DBG] pgmap v5228: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:31:25.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:31:24 smithi157 bash[24585]: cluster 2024-09-16T08:31:23.119748+0000 mgr.a (mgr.14373) 7540 : cluster [DBG] pgmap v5228: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:31:25.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:31:24 smithi086 bash[24289]: cluster 2024-09-16T08:31:23.119748+0000 mgr.a (mgr.14373) 7540 : cluster [DBG] pgmap v5228: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:31:26.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:31:26 smithi047 bash[22744]: cluster 2024-09-16T08:31:25.120549+0000 mgr.a (mgr.14373) 7541 : cluster [DBG] pgmap v5229: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:31:27.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:31:26 smithi157 bash[24585]: cluster 2024-09-16T08:31:25.120549+0000 mgr.a (mgr.14373) 7541 : cluster [DBG] pgmap v5229: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:31:27.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:31:26 smithi086 bash[24289]: cluster 2024-09-16T08:31:25.120549+0000 mgr.a (mgr.14373) 7541 : cluster [DBG] pgmap v5229: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:31:27.714 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:31:27.715 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:31:27.715 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:31:28.506 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:31:28.506 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:31:28.507 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:31:28.507 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:31:28.507 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:31:28.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:31:28 smithi047 bash[22744]: cluster 2024-09-16T08:31:27.122570+0000 mgr.a (mgr.14373) 7542 : cluster [DBG] pgmap v5230: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:31:29.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:31:28 smithi157 bash[24585]: cluster 2024-09-16T08:31:27.122570+0000 mgr.a (mgr.14373) 7542 : cluster [DBG] pgmap v5230: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:31:29.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:31:28 smithi086 bash[24289]: cluster 2024-09-16T08:31:27.122570+0000 mgr.a (mgr.14373) 7542 : cluster [DBG] pgmap v5230: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:31:30.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:31:29 smithi157 bash[24585]: audit 2024-09-16T08:31:28.054719+0000 mgr.a (mgr.14373) 7543 : audit [DBG] from='client.170130 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:31:30.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:31:29 smithi086 bash[24289]: audit 2024-09-16T08:31:28.054719+0000 mgr.a (mgr.14373) 7543 : audit [DBG] from='client.170130 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:31:30.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:31:29 smithi047 bash[22744]: audit 2024-09-16T08:31:28.054719+0000 mgr.a (mgr.14373) 7543 : audit [DBG] from='client.170130 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:31:31.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:31:30 smithi157 bash[24585]: cluster 2024-09-16T08:31:29.123561+0000 mgr.a (mgr.14373) 7544 : cluster [DBG] pgmap v5231: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:31:31.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:31:30 smithi086 bash[24289]: cluster 2024-09-16T08:31:29.123561+0000 mgr.a (mgr.14373) 7544 : cluster [DBG] pgmap v5231: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:31:31.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:31:30 smithi047 bash[22744]: cluster 2024-09-16T08:31:29.123561+0000 mgr.a (mgr.14373) 7544 : cluster [DBG] pgmap v5231: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:31:33.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:31:32 smithi157 bash[24585]: cluster 2024-09-16T08:31:31.124375+0000 mgr.a (mgr.14373) 7545 : cluster [DBG] pgmap v5232: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:31:33.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:31:32 smithi086 bash[24289]: cluster 2024-09-16T08:31:31.124375+0000 mgr.a (mgr.14373) 7545 : cluster [DBG] pgmap v5232: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:31:33.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:31:32 smithi047 bash[22744]: cluster 2024-09-16T08:31:31.124375+0000 mgr.a (mgr.14373) 7545 : cluster [DBG] pgmap v5232: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:31:33.508 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:31:33.509 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:31:33.509 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:31:34.257 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:31:34.257 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:31:34.257 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:31:34.257 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:31:34.257 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:31:35.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:31:34 smithi157 bash[24585]: cluster 2024-09-16T08:31:33.126622+0000 mgr.a (mgr.14373) 7546 : cluster [DBG] pgmap v5233: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:31:35.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:31:34 smithi086 bash[24289]: cluster 2024-09-16T08:31:33.126622+0000 mgr.a (mgr.14373) 7546 : cluster [DBG] pgmap v5233: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:31:35.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:31:34 smithi047 bash[22744]: cluster 2024-09-16T08:31:33.126622+0000 mgr.a (mgr.14373) 7546 : cluster [DBG] pgmap v5233: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:31:36.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:31:35 smithi157 bash[24585]: audit 2024-09-16T08:31:33.838992+0000 mgr.a (mgr.14373) 7547 : audit [DBG] from='client.170208 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:31:36.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:31:35 smithi086 bash[24289]: audit 2024-09-16T08:31:33.838992+0000 mgr.a (mgr.14373) 7547 : audit [DBG] from='client.170208 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:31:36.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:31:35 smithi047 bash[22744]: audit 2024-09-16T08:31:33.838992+0000 mgr.a (mgr.14373) 7547 : audit [DBG] from='client.170208 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:31:37.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:31:36 smithi157 bash[24585]: cluster 2024-09-16T08:31:35.127551+0000 mgr.a (mgr.14373) 7548 : cluster [DBG] pgmap v5234: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:31:37.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:31:36 smithi086 bash[24289]: cluster 2024-09-16T08:31:35.127551+0000 mgr.a (mgr.14373) 7548 : cluster [DBG] pgmap v5234: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:31:37.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:31:36 smithi047 bash[22744]: cluster 2024-09-16T08:31:35.127551+0000 mgr.a (mgr.14373) 7548 : cluster [DBG] pgmap v5234: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:31:39.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:31:38 smithi157 bash[24585]: cluster 2024-09-16T08:31:37.129778+0000 mgr.a (mgr.14373) 7549 : cluster [DBG] pgmap v5235: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:31:39.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:31:38 smithi086 bash[24289]: cluster 2024-09-16T08:31:37.129778+0000 mgr.a (mgr.14373) 7549 : cluster [DBG] pgmap v5235: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:31:39.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:31:38 smithi047 bash[22744]: cluster 2024-09-16T08:31:37.129778+0000 mgr.a (mgr.14373) 7549 : cluster [DBG] pgmap v5235: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:31:39.258 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:31:39.259 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:31:39.259 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:31:40.023 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:31:40.023 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:31:40.024 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:31:40.024 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:31:40.024 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:31:41.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:31:40 smithi157 bash[24585]: cluster 2024-09-16T08:31:39.130576+0000 mgr.a (mgr.14373) 7550 : cluster [DBG] pgmap v5236: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:31:41.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:31:40 smithi157 bash[24585]: audit 2024-09-16T08:31:39.596214+0000 mgr.a (mgr.14373) 7551 : audit [DBG] from='client.170286 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:31:41.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:31:40 smithi086 bash[24289]: cluster 2024-09-16T08:31:39.130576+0000 mgr.a (mgr.14373) 7550 : cluster [DBG] pgmap v5236: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:31:41.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:31:40 smithi086 bash[24289]: audit 2024-09-16T08:31:39.596214+0000 mgr.a (mgr.14373) 7551 : audit [DBG] from='client.170286 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:31:41.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:31:40 smithi047 bash[22744]: cluster 2024-09-16T08:31:39.130576+0000 mgr.a (mgr.14373) 7550 : cluster [DBG] pgmap v5236: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:31:41.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:31:40 smithi047 bash[22744]: audit 2024-09-16T08:31:39.596214+0000 mgr.a (mgr.14373) 7551 : audit [DBG] from='client.170286 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:31:43.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:31:42 smithi157 bash[24585]: cluster 2024-09-16T08:31:41.131465+0000 mgr.a (mgr.14373) 7552 : cluster [DBG] pgmap v5237: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:31:43.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:31:42 smithi086 bash[24289]: cluster 2024-09-16T08:31:41.131465+0000 mgr.a (mgr.14373) 7552 : cluster [DBG] pgmap v5237: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:31:43.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:31:42 smithi047 bash[22744]: cluster 2024-09-16T08:31:41.131465+0000 mgr.a (mgr.14373) 7552 : cluster [DBG] pgmap v5237: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:31:45.025 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:31:45.025 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:31:45.025 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:31:45.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:31:44 smithi157 bash[24585]: cluster 2024-09-16T08:31:43.133741+0000 mgr.a (mgr.14373) 7553 : cluster [DBG] pgmap v5238: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:31:45.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:31:44 smithi086 bash[24289]: cluster 2024-09-16T08:31:43.133741+0000 mgr.a (mgr.14373) 7553 : cluster [DBG] pgmap v5238: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:31:45.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:31:44 smithi047 bash[22744]: cluster 2024-09-16T08:31:43.133741+0000 mgr.a (mgr.14373) 7553 : cluster [DBG] pgmap v5238: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:31:45.771 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:31:45.772 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:31:45.772 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:31:45.772 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:31:45.772 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:31:47.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:31:46 smithi157 bash[24585]: cluster 2024-09-16T08:31:45.134447+0000 mgr.a (mgr.14373) 7554 : cluster [DBG] pgmap v5239: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:31:47.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:31:46 smithi157 bash[24585]: audit 2024-09-16T08:31:45.358894+0000 mgr.a (mgr.14373) 7555 : audit [DBG] from='client.170364 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:31:47.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:31:46 smithi157 bash[24585]: audit 2024-09-16T08:31:46.111087+0000 mon.b (mon.2) 714 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T08:31:47.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:31:46 smithi086 bash[24289]: cluster 2024-09-16T08:31:45.134447+0000 mgr.a (mgr.14373) 7554 : cluster [DBG] pgmap v5239: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:31:47.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:31:46 smithi086 bash[24289]: audit 2024-09-16T08:31:45.358894+0000 mgr.a (mgr.14373) 7555 : audit [DBG] from='client.170364 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:31:47.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:31:46 smithi086 bash[24289]: audit 2024-09-16T08:31:46.111087+0000 mon.b (mon.2) 714 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T08:31:47.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:31:46 smithi047 bash[22744]: cluster 2024-09-16T08:31:45.134447+0000 mgr.a (mgr.14373) 7554 : cluster [DBG] pgmap v5239: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:31:47.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:31:46 smithi047 bash[22744]: audit 2024-09-16T08:31:45.358894+0000 mgr.a (mgr.14373) 7555 : audit [DBG] from='client.170364 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:31:47.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:31:46 smithi047 bash[22744]: audit 2024-09-16T08:31:46.111087+0000 mon.b (mon.2) 714 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T08:31:48.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:31:47 smithi157 bash[24585]: audit 2024-09-16T08:31:46.725206+0000 mon.a (mon.0) 1016 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:31:48.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:31:47 smithi157 bash[24585]: audit 2024-09-16T08:31:46.731145+0000 mon.a (mon.0) 1017 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:31:48.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:31:47 smithi157 bash[24585]: audit 2024-09-16T08:31:46.751360+0000 mon.a (mon.0) 1018 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:31:48.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:31:47 smithi157 bash[24585]: audit 2024-09-16T08:31:46.756152+0000 mon.a (mon.0) 1019 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:31:48.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:31:47 smithi157 bash[24585]: cluster 2024-09-16T08:31:47.136770+0000 mgr.a (mgr.14373) 7556 : cluster [DBG] pgmap v5240: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:31:48.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:31:47 smithi157 bash[24585]: audit 2024-09-16T08:31:47.569770+0000 mon.b (mon.2) 715 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T08:31:48.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:31:47 smithi157 bash[24585]: audit 2024-09-16T08:31:47.572013+0000 mon.b (mon.2) 716 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T08:31:48.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:31:47 smithi157 bash[24585]: audit 2024-09-16T08:31:47.585097+0000 mon.a (mon.0) 1020 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:31:48.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:31:47 smithi157 bash[24585]: audit 2024-09-16T08:31:47.588593+0000 mon.b (mon.2) 717 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:31:48.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:31:47 smithi157 bash[24585]: audit 2024-09-16T08:31:47.592579+0000 mgr.a (mgr.14373) 7557 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:31:48.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:31:47 smithi086 bash[24289]: audit 2024-09-16T08:31:46.725206+0000 mon.a (mon.0) 1016 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:31:48.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:31:47 smithi086 bash[24289]: audit 2024-09-16T08:31:46.731145+0000 mon.a (mon.0) 1017 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:31:48.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:31:47 smithi086 bash[24289]: audit 2024-09-16T08:31:46.751360+0000 mon.a (mon.0) 1018 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:31:48.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:31:47 smithi086 bash[24289]: audit 2024-09-16T08:31:46.756152+0000 mon.a (mon.0) 1019 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:31:48.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:31:47 smithi086 bash[24289]: cluster 2024-09-16T08:31:47.136770+0000 mgr.a (mgr.14373) 7556 : cluster [DBG] pgmap v5240: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:31:48.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:31:47 smithi086 bash[24289]: audit 2024-09-16T08:31:47.569770+0000 mon.b (mon.2) 715 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T08:31:48.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:31:47 smithi086 bash[24289]: audit 2024-09-16T08:31:47.572013+0000 mon.b (mon.2) 716 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T08:31:48.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:31:47 smithi086 bash[24289]: audit 2024-09-16T08:31:47.585097+0000 mon.a (mon.0) 1020 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:31:48.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:31:47 smithi086 bash[24289]: audit 2024-09-16T08:31:47.588593+0000 mon.b (mon.2) 717 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:31:48.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:31:47 smithi086 bash[24289]: audit 2024-09-16T08:31:47.592579+0000 mgr.a (mgr.14373) 7557 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:31:48.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:31:47 smithi047 bash[22744]: audit 2024-09-16T08:31:46.725206+0000 mon.a (mon.0) 1016 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:31:48.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:31:47 smithi047 bash[22744]: audit 2024-09-16T08:31:46.731145+0000 mon.a (mon.0) 1017 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:31:48.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:31:47 smithi047 bash[22744]: audit 2024-09-16T08:31:46.751360+0000 mon.a (mon.0) 1018 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:31:48.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:31:47 smithi047 bash[22744]: audit 2024-09-16T08:31:46.756152+0000 mon.a (mon.0) 1019 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:31:48.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:31:47 smithi047 bash[22744]: cluster 2024-09-16T08:31:47.136770+0000 mgr.a (mgr.14373) 7556 : cluster [DBG] pgmap v5240: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:31:48.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:31:47 smithi047 bash[22744]: audit 2024-09-16T08:31:47.569770+0000 mon.b (mon.2) 715 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T08:31:48.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:31:47 smithi047 bash[22744]: audit 2024-09-16T08:31:47.572013+0000 mon.b (mon.2) 716 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T08:31:48.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:31:47 smithi047 bash[22744]: audit 2024-09-16T08:31:47.585097+0000 mon.a (mon.0) 1020 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:31:48.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:31:47 smithi047 bash[22744]: audit 2024-09-16T08:31:47.588593+0000 mon.b (mon.2) 717 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:31:48.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:31:47 smithi047 bash[22744]: audit 2024-09-16T08:31:47.592579+0000 mgr.a (mgr.14373) 7557 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:31:48.588 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 08:31:48 smithi047 bash[22994]: debug 2024-09-16T08:31:48.330+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T08:31:48.588 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 08:31:48 smithi047 bash[22994]: debug 2024-09-16T08:31:48.330+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T08:31:49.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:31:48 smithi157 bash[24585]: audit 2024-09-16T08:31:48.332059+0000 mgr.a (mgr.14373) 7558 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T08:31:49.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:31:48 smithi157 bash[24585]: cephadm 2024-09-16T08:31:48.334109+0000 mgr.a (mgr.14373) 7559 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T08:31:49.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:31:48 smithi086 bash[24289]: audit 2024-09-16T08:31:48.332059+0000 mgr.a (mgr.14373) 7558 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T08:31:49.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:31:48 smithi086 bash[24289]: cephadm 2024-09-16T08:31:48.334109+0000 mgr.a (mgr.14373) 7559 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T08:31:49.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:31:48 smithi047 bash[22744]: audit 2024-09-16T08:31:48.332059+0000 mgr.a (mgr.14373) 7558 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T08:31:49.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:31:48 smithi047 bash[22744]: cephadm 2024-09-16T08:31:48.334109+0000 mgr.a (mgr.14373) 7559 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T08:31:50.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:31:49 smithi157 bash[24585]: cluster 2024-09-16T08:31:49.137687+0000 mgr.a (mgr.14373) 7560 : cluster [DBG] pgmap v5241: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:31:50.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:31:49 smithi086 bash[24289]: cluster 2024-09-16T08:31:49.137687+0000 mgr.a (mgr.14373) 7560 : cluster [DBG] pgmap v5241: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:31:50.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:31:49 smithi047 bash[22744]: cluster 2024-09-16T08:31:49.137687+0000 mgr.a (mgr.14373) 7560 : cluster [DBG] pgmap v5241: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:31:50.773 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:31:50.774 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:31:50.774 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:31:51.534 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:31:51.534 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:31:51.534 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:31:51.535 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:31:51.535 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:31:52.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:31:52 smithi157 bash[24585]: audit 2024-09-16T08:31:51.107246+0000 mgr.a (mgr.14373) 7561 : audit [DBG] from='client.170544 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:31:52.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:31:52 smithi157 bash[24585]: cluster 2024-09-16T08:31:51.138887+0000 mgr.a (mgr.14373) 7562 : cluster [DBG] pgmap v5242: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:31:52.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:31:52 smithi086 bash[24289]: audit 2024-09-16T08:31:51.107246+0000 mgr.a (mgr.14373) 7561 : audit [DBG] from='client.170544 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:31:52.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:31:52 smithi086 bash[24289]: cluster 2024-09-16T08:31:51.138887+0000 mgr.a (mgr.14373) 7562 : cluster [DBG] pgmap v5242: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:31:52.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:31:52 smithi047 bash[22744]: audit 2024-09-16T08:31:51.107246+0000 mgr.a (mgr.14373) 7561 : audit [DBG] from='client.170544 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:31:52.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:31:52 smithi047 bash[22744]: cluster 2024-09-16T08:31:51.138887+0000 mgr.a (mgr.14373) 7562 : cluster [DBG] pgmap v5242: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:31:54.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:31:54 smithi157 bash[24585]: cluster 2024-09-16T08:31:53.141350+0000 mgr.a (mgr.14373) 7563 : cluster [DBG] pgmap v5243: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.6 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:31:54.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:31:54 smithi086 bash[24289]: cluster 2024-09-16T08:31:53.141350+0000 mgr.a (mgr.14373) 7563 : cluster [DBG] pgmap v5243: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.6 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:31:54.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:31:54 smithi047 bash[22744]: cluster 2024-09-16T08:31:53.141350+0000 mgr.a (mgr.14373) 7563 : cluster [DBG] pgmap v5243: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.6 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:31:56.536 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:31:56.537 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:31:56.537 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:31:56.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:31:56 smithi157 bash[24585]: cluster 2024-09-16T08:31:55.142114+0000 mgr.a (mgr.14373) 7564 : cluster [DBG] pgmap v5244: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T08:31:56.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:31:56 smithi086 bash[24289]: cluster 2024-09-16T08:31:55.142114+0000 mgr.a (mgr.14373) 7564 : cluster [DBG] pgmap v5244: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T08:31:56.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:31:56 smithi047 bash[22744]: cluster 2024-09-16T08:31:55.142114+0000 mgr.a (mgr.14373) 7564 : cluster [DBG] pgmap v5244: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T08:31:57.328 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:31:57.328 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:31:57.328 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:31:57.328 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:31:57.328 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:31:58.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:31:58 smithi157 bash[24585]: audit 2024-09-16T08:31:56.879652+0000 mgr.a (mgr.14373) 7565 : audit [DBG] from='client.170622 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:31:58.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:31:58 smithi157 bash[24585]: cluster 2024-09-16T08:31:57.143482+0000 mgr.a (mgr.14373) 7566 : cluster [DBG] pgmap v5245: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:31:58.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:31:58 smithi086 bash[24289]: audit 2024-09-16T08:31:56.879652+0000 mgr.a (mgr.14373) 7565 : audit [DBG] from='client.170622 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:31:58.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:31:58 smithi086 bash[24289]: cluster 2024-09-16T08:31:57.143482+0000 mgr.a (mgr.14373) 7566 : cluster [DBG] pgmap v5245: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:31:58.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:31:58 smithi047 bash[22744]: audit 2024-09-16T08:31:56.879652+0000 mgr.a (mgr.14373) 7565 : audit [DBG] from='client.170622 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:31:58.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:31:58 smithi047 bash[22744]: cluster 2024-09-16T08:31:57.143482+0000 mgr.a (mgr.14373) 7566 : cluster [DBG] pgmap v5245: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:32:00.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:32:00 smithi157 bash[24585]: cluster 2024-09-16T08:31:59.144363+0000 mgr.a (mgr.14373) 7567 : cluster [DBG] pgmap v5246: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T08:32:00.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:32:00 smithi086 bash[24289]: cluster 2024-09-16T08:31:59.144363+0000 mgr.a (mgr.14373) 7567 : cluster [DBG] pgmap v5246: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T08:32:00.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:32:00 smithi047 bash[22744]: cluster 2024-09-16T08:31:59.144363+0000 mgr.a (mgr.14373) 7567 : cluster [DBG] pgmap v5246: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T08:32:02.330 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:32:02.330 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:32:02.330 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:32:02.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:32:02 smithi157 bash[24585]: cluster 2024-09-16T08:32:01.145318+0000 mgr.a (mgr.14373) 7568 : cluster [DBG] pgmap v5247: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T08:32:02.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:32:02 smithi086 bash[24289]: cluster 2024-09-16T08:32:01.145318+0000 mgr.a (mgr.14373) 7568 : cluster [DBG] pgmap v5247: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T08:32:02.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:32:02 smithi047 bash[22744]: cluster 2024-09-16T08:32:01.145318+0000 mgr.a (mgr.14373) 7568 : cluster [DBG] pgmap v5247: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T08:32:03.100 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:32:03.100 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:32:03.100 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:32:03.101 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:32:03.101 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:32:03.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:32:03 smithi157 bash[24585]: audit 2024-09-16T08:32:02.670459+0000 mgr.a (mgr.14373) 7569 : audit [DBG] from='client.170697 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:32:03.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:32:03 smithi086 bash[24289]: audit 2024-09-16T08:32:02.670459+0000 mgr.a (mgr.14373) 7569 : audit [DBG] from='client.170697 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:32:03.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:32:03 smithi047 bash[22744]: audit 2024-09-16T08:32:02.670459+0000 mgr.a (mgr.14373) 7569 : audit [DBG] from='client.170697 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:32:04.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:32:04 smithi157 bash[24585]: cluster 2024-09-16T08:32:03.146991+0000 mgr.a (mgr.14373) 7570 : cluster [DBG] pgmap v5248: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:32:04.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:32:04 smithi086 bash[24289]: cluster 2024-09-16T08:32:03.146991+0000 mgr.a (mgr.14373) 7570 : cluster [DBG] pgmap v5248: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:32:04.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:32:04 smithi047 bash[22744]: cluster 2024-09-16T08:32:03.146991+0000 mgr.a (mgr.14373) 7570 : cluster [DBG] pgmap v5248: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:32:06.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:32:06 smithi157 bash[24585]: cluster 2024-09-16T08:32:05.147712+0000 mgr.a (mgr.14373) 7571 : cluster [DBG] pgmap v5249: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T08:32:06.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:32:06 smithi086 bash[24289]: cluster 2024-09-16T08:32:05.147712+0000 mgr.a (mgr.14373) 7571 : cluster [DBG] pgmap v5249: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T08:32:06.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:32:06 smithi047 bash[22744]: cluster 2024-09-16T08:32:05.147712+0000 mgr.a (mgr.14373) 7571 : cluster [DBG] pgmap v5249: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T08:32:08.102 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:32:08.102 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:32:08.102 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:32:08.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:32:08 smithi157 bash[24585]: cluster 2024-09-16T08:32:07.149673+0000 mgr.a (mgr.14373) 7572 : cluster [DBG] pgmap v5250: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-16T08:32:08.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:32:08 smithi086 bash[24289]: cluster 2024-09-16T08:32:07.149673+0000 mgr.a (mgr.14373) 7572 : cluster [DBG] pgmap v5250: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-16T08:32:08.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:32:08 smithi047 bash[22744]: cluster 2024-09-16T08:32:07.149673+0000 mgr.a (mgr.14373) 7572 : cluster [DBG] pgmap v5250: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-16T08:32:08.888 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:32:08.888 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:32:08.888 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:32:08.889 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:32:08.889 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:32:09.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:32:09 smithi157 bash[24585]: audit 2024-09-16T08:32:08.443737+0000 mgr.a (mgr.14373) 7573 : audit [DBG] from='client.170769 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:32:09.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:32:09 smithi086 bash[24289]: audit 2024-09-16T08:32:08.443737+0000 mgr.a (mgr.14373) 7573 : audit [DBG] from='client.170769 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:32:09.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:32:09 smithi047 bash[22744]: audit 2024-09-16T08:32:08.443737+0000 mgr.a (mgr.14373) 7573 : audit [DBG] from='client.170769 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:32:10.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:32:10 smithi157 bash[24585]: cluster 2024-09-16T08:32:09.150708+0000 mgr.a (mgr.14373) 7574 : cluster [DBG] pgmap v5251: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:32:10.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:32:10 smithi086 bash[24289]: cluster 2024-09-16T08:32:09.150708+0000 mgr.a (mgr.14373) 7574 : cluster [DBG] pgmap v5251: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:32:10.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:32:10 smithi047 bash[22744]: cluster 2024-09-16T08:32:09.150708+0000 mgr.a (mgr.14373) 7574 : cluster [DBG] pgmap v5251: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:32:12.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:32:12 smithi157 bash[24585]: cluster 2024-09-16T08:32:11.151486+0000 mgr.a (mgr.14373) 7575 : cluster [DBG] pgmap v5252: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:32:12.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:32:12 smithi086 bash[24289]: cluster 2024-09-16T08:32:11.151486+0000 mgr.a (mgr.14373) 7575 : cluster [DBG] pgmap v5252: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:32:12.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:32:12 smithi047 bash[22744]: cluster 2024-09-16T08:32:11.151486+0000 mgr.a (mgr.14373) 7575 : cluster [DBG] pgmap v5252: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:32:13.890 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:32:13.890 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:32:13.890 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:32:14.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:32:14 smithi157 bash[24585]: cluster 2024-09-16T08:32:13.153715+0000 mgr.a (mgr.14373) 7576 : cluster [DBG] pgmap v5253: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:32:14.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:32:14 smithi086 bash[24289]: cluster 2024-09-16T08:32:13.153715+0000 mgr.a (mgr.14373) 7576 : cluster [DBG] pgmap v5253: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:32:14.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:32:14 smithi047 bash[22744]: cluster 2024-09-16T08:32:13.153715+0000 mgr.a (mgr.14373) 7576 : cluster [DBG] pgmap v5253: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:32:14.678 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:32:14.678 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:32:14.678 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:32:14.678 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:32:14.678 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:32:15.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:32:15 smithi157 bash[24585]: audit 2024-09-16T08:32:14.232195+0000 mgr.a (mgr.14373) 7577 : audit [DBG] from='client.170844 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:32:15.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:32:15 smithi086 bash[24289]: audit 2024-09-16T08:32:14.232195+0000 mgr.a (mgr.14373) 7577 : audit [DBG] from='client.170844 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:32:15.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:32:15 smithi047 bash[22744]: audit 2024-09-16T08:32:14.232195+0000 mgr.a (mgr.14373) 7577 : audit [DBG] from='client.170844 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:32:16.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:32:16 smithi157 bash[24585]: cluster 2024-09-16T08:32:15.154675+0000 mgr.a (mgr.14373) 7578 : cluster [DBG] pgmap v5254: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:32:16.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:32:16 smithi086 bash[24289]: cluster 2024-09-16T08:32:15.154675+0000 mgr.a (mgr.14373) 7578 : cluster [DBG] pgmap v5254: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:32:16.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:32:16 smithi047 bash[22744]: cluster 2024-09-16T08:32:15.154675+0000 mgr.a (mgr.14373) 7578 : cluster [DBG] pgmap v5254: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:32:18.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:32:18 smithi157 bash[24585]: cluster 2024-09-16T08:32:17.156829+0000 mgr.a (mgr.14373) 7579 : cluster [DBG] pgmap v5255: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:32:18.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:32:18 smithi086 bash[24289]: cluster 2024-09-16T08:32:17.156829+0000 mgr.a (mgr.14373) 7579 : cluster [DBG] pgmap v5255: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:32:18.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:32:18 smithi047 bash[22744]: cluster 2024-09-16T08:32:17.156829+0000 mgr.a (mgr.14373) 7579 : cluster [DBG] pgmap v5255: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:32:19.680 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:32:19.680 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:32:19.680 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:32:20.460 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:32:20.460 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:32:20.460 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:32:20.460 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:32:20.460 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:32:20.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:32:20 smithi157 bash[24585]: cluster 2024-09-16T08:32:19.157589+0000 mgr.a (mgr.14373) 7580 : cluster [DBG] pgmap v5256: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:32:20.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:32:20 smithi086 bash[24289]: cluster 2024-09-16T08:32:19.157589+0000 mgr.a (mgr.14373) 7580 : cluster [DBG] pgmap v5256: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:32:20.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:32:20 smithi047 bash[22744]: cluster 2024-09-16T08:32:19.157589+0000 mgr.a (mgr.14373) 7580 : cluster [DBG] pgmap v5256: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:32:21.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:32:21 smithi157 bash[24585]: audit 2024-09-16T08:32:20.021276+0000 mgr.a (mgr.14373) 7581 : audit [DBG] from='client.170922 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:32:21.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:32:21 smithi086 bash[24289]: audit 2024-09-16T08:32:20.021276+0000 mgr.a (mgr.14373) 7581 : audit [DBG] from='client.170922 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:32:21.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:32:21 smithi047 bash[22744]: audit 2024-09-16T08:32:20.021276+0000 mgr.a (mgr.14373) 7581 : audit [DBG] from='client.170922 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:32:22.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:32:22 smithi157 bash[24585]: cluster 2024-09-16T08:32:21.158499+0000 mgr.a (mgr.14373) 7582 : cluster [DBG] pgmap v5257: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:32:22.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:32:22 smithi086 bash[24289]: cluster 2024-09-16T08:32:21.158499+0000 mgr.a (mgr.14373) 7582 : cluster [DBG] pgmap v5257: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:32:22.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:32:22 smithi047 bash[22744]: cluster 2024-09-16T08:32:21.158499+0000 mgr.a (mgr.14373) 7582 : cluster [DBG] pgmap v5257: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:32:24.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:32:24 smithi157 bash[24585]: cluster 2024-09-16T08:32:23.160793+0000 mgr.a (mgr.14373) 7583 : cluster [DBG] pgmap v5258: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:32:24.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:32:24 smithi086 bash[24289]: cluster 2024-09-16T08:32:23.160793+0000 mgr.a (mgr.14373) 7583 : cluster [DBG] pgmap v5258: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:32:24.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:32:24 smithi047 bash[22744]: cluster 2024-09-16T08:32:23.160793+0000 mgr.a (mgr.14373) 7583 : cluster [DBG] pgmap v5258: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:32:25.461 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:32:25.462 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:32:25.462 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:32:26.237 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:32:26.238 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:32:26.238 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:32:26.238 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:32:26.238 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:32:26.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:32:26 smithi157 bash[24585]: cluster 2024-09-16T08:32:25.161542+0000 mgr.a (mgr.14373) 7584 : cluster [DBG] pgmap v5259: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:32:26.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:32:26 smithi086 bash[24289]: cluster 2024-09-16T08:32:25.161542+0000 mgr.a (mgr.14373) 7584 : cluster [DBG] pgmap v5259: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:32:26.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:32:26 smithi047 bash[22744]: cluster 2024-09-16T08:32:25.161542+0000 mgr.a (mgr.14373) 7584 : cluster [DBG] pgmap v5259: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:32:27.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:32:27 smithi157 bash[24585]: audit 2024-09-16T08:32:25.800733+0000 mgr.a (mgr.14373) 7585 : audit [DBG] from='client.170997 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:32:27.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:32:27 smithi086 bash[24289]: audit 2024-09-16T08:32:25.800733+0000 mgr.a (mgr.14373) 7585 : audit [DBG] from='client.170997 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:32:27.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:32:27 smithi047 bash[22744]: audit 2024-09-16T08:32:25.800733+0000 mgr.a (mgr.14373) 7585 : audit [DBG] from='client.170997 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:32:28.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:32:28 smithi157 bash[24585]: cluster 2024-09-16T08:32:27.163843+0000 mgr.a (mgr.14373) 7586 : cluster [DBG] pgmap v5260: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:32:28.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:32:28 smithi086 bash[24289]: cluster 2024-09-16T08:32:27.163843+0000 mgr.a (mgr.14373) 7586 : cluster [DBG] pgmap v5260: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:32:28.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:32:28 smithi047 bash[22744]: cluster 2024-09-16T08:32:27.163843+0000 mgr.a (mgr.14373) 7586 : cluster [DBG] pgmap v5260: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:32:30.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:32:30 smithi157 bash[24585]: cluster 2024-09-16T08:32:29.164624+0000 mgr.a (mgr.14373) 7587 : cluster [DBG] pgmap v5261: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:32:30.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:32:30 smithi086 bash[24289]: cluster 2024-09-16T08:32:29.164624+0000 mgr.a (mgr.14373) 7587 : cluster [DBG] pgmap v5261: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:32:30.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:32:30 smithi047 bash[22744]: cluster 2024-09-16T08:32:29.164624+0000 mgr.a (mgr.14373) 7587 : cluster [DBG] pgmap v5261: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:32:31.239 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:32:31.239 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:32:31.240 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:32:32.001 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:32:32.001 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:32:32.002 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:32:32.002 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:32:32.002 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:32:32.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:32:32 smithi086 bash[24289]: cluster 2024-09-16T08:32:31.165391+0000 mgr.a (mgr.14373) 7588 : cluster [DBG] pgmap v5262: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:32:32.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:32:32 smithi086 bash[24289]: audit 2024-09-16T08:32:31.571891+0000 mgr.a (mgr.14373) 7589 : audit [DBG] from='client.171075 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:32:32.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:32:32 smithi047 bash[22744]: cluster 2024-09-16T08:32:31.165391+0000 mgr.a (mgr.14373) 7588 : cluster [DBG] pgmap v5262: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:32:32.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:32:32 smithi047 bash[22744]: audit 2024-09-16T08:32:31.571891+0000 mgr.a (mgr.14373) 7589 : audit [DBG] from='client.171075 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:32:32.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:32:32 smithi157 bash[24585]: cluster 2024-09-16T08:32:31.165391+0000 mgr.a (mgr.14373) 7588 : cluster [DBG] pgmap v5262: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:32:32.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:32:32 smithi157 bash[24585]: audit 2024-09-16T08:32:31.571891+0000 mgr.a (mgr.14373) 7589 : audit [DBG] from='client.171075 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:32:34.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:32:34 smithi086 bash[24289]: cluster 2024-09-16T08:32:33.168111+0000 mgr.a (mgr.14373) 7590 : cluster [DBG] pgmap v5263: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:32:34.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:32:34 smithi047 bash[22744]: cluster 2024-09-16T08:32:33.168111+0000 mgr.a (mgr.14373) 7590 : cluster [DBG] pgmap v5263: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:32:34.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:32:34 smithi157 bash[24585]: cluster 2024-09-16T08:32:33.168111+0000 mgr.a (mgr.14373) 7590 : cluster [DBG] pgmap v5263: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:32:36.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:32:36 smithi086 bash[24289]: cluster 2024-09-16T08:32:35.168883+0000 mgr.a (mgr.14373) 7591 : cluster [DBG] pgmap v5264: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:32:36.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:32:36 smithi047 bash[22744]: cluster 2024-09-16T08:32:35.168883+0000 mgr.a (mgr.14373) 7591 : cluster [DBG] pgmap v5264: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:32:36.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:32:36 smithi157 bash[24585]: cluster 2024-09-16T08:32:35.168883+0000 mgr.a (mgr.14373) 7591 : cluster [DBG] pgmap v5264: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:32:37.003 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:32:37.004 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:32:37.004 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:32:37.779 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:32:37.779 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:32:37.779 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:32:37.780 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:32:37.780 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:32:38.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:32:38 smithi047 bash[22744]: cluster 2024-09-16T08:32:37.170875+0000 mgr.a (mgr.14373) 7592 : cluster [DBG] pgmap v5265: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:32:38.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:32:38 smithi047 bash[22744]: audit 2024-09-16T08:32:37.347224+0000 mgr.a (mgr.14373) 7593 : audit [DBG] from='client.171153 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:32:38.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:32:38 smithi157 bash[24585]: cluster 2024-09-16T08:32:37.170875+0000 mgr.a (mgr.14373) 7592 : cluster [DBG] pgmap v5265: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:32:38.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:32:38 smithi157 bash[24585]: audit 2024-09-16T08:32:37.347224+0000 mgr.a (mgr.14373) 7593 : audit [DBG] from='client.171153 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:32:38.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:32:38 smithi086 bash[24289]: cluster 2024-09-16T08:32:37.170875+0000 mgr.a (mgr.14373) 7592 : cluster [DBG] pgmap v5265: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:32:38.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:32:38 smithi086 bash[24289]: audit 2024-09-16T08:32:37.347224+0000 mgr.a (mgr.14373) 7593 : audit [DBG] from='client.171153 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:32:40.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:32:40 smithi047 bash[22744]: cluster 2024-09-16T08:32:39.171772+0000 mgr.a (mgr.14373) 7594 : cluster [DBG] pgmap v5266: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:32:40.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:32:40 smithi157 bash[24585]: cluster 2024-09-16T08:32:39.171772+0000 mgr.a (mgr.14373) 7594 : cluster [DBG] pgmap v5266: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:32:40.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:32:40 smithi086 bash[24289]: cluster 2024-09-16T08:32:39.171772+0000 mgr.a (mgr.14373) 7594 : cluster [DBG] pgmap v5266: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:32:42.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:32:42 smithi047 bash[22744]: cluster 2024-09-16T08:32:41.172556+0000 mgr.a (mgr.14373) 7595 : cluster [DBG] pgmap v5267: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T08:32:42.781 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:32:42.782 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:32:42.782 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:32:42.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:32:42 smithi157 bash[24585]: cluster 2024-09-16T08:32:41.172556+0000 mgr.a (mgr.14373) 7595 : cluster [DBG] pgmap v5267: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T08:32:42.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:32:42 smithi086 bash[24289]: cluster 2024-09-16T08:32:41.172556+0000 mgr.a (mgr.14373) 7595 : cluster [DBG] pgmap v5267: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T08:32:43.563 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:32:43.564 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:32:43.564 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:32:43.564 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:32:43.564 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:32:44.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:32:44 smithi047 bash[22744]: audit 2024-09-16T08:32:43.119138+0000 mgr.a (mgr.14373) 7596 : audit [DBG] from='client.171231 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:32:44.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:32:44 smithi047 bash[22744]: cluster 2024-09-16T08:32:43.175607+0000 mgr.a (mgr.14373) 7597 : cluster [DBG] pgmap v5268: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:32:44.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:32:44 smithi157 bash[24585]: audit 2024-09-16T08:32:43.119138+0000 mgr.a (mgr.14373) 7596 : audit [DBG] from='client.171231 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:32:44.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:32:44 smithi157 bash[24585]: cluster 2024-09-16T08:32:43.175607+0000 mgr.a (mgr.14373) 7597 : cluster [DBG] pgmap v5268: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:32:44.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:32:44 smithi086 bash[24289]: audit 2024-09-16T08:32:43.119138+0000 mgr.a (mgr.14373) 7596 : audit [DBG] from='client.171231 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:32:44.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:32:44 smithi086 bash[24289]: cluster 2024-09-16T08:32:43.175607+0000 mgr.a (mgr.14373) 7597 : cluster [DBG] pgmap v5268: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:32:46.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:32:46 smithi047 bash[22744]: cluster 2024-09-16T08:32:45.176693+0000 mgr.a (mgr.14373) 7598 : cluster [DBG] pgmap v5269: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:32:46.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:32:46 smithi157 bash[24585]: cluster 2024-09-16T08:32:45.176693+0000 mgr.a (mgr.14373) 7598 : cluster [DBG] pgmap v5269: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:32:46.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:32:46 smithi086 bash[24289]: cluster 2024-09-16T08:32:45.176693+0000 mgr.a (mgr.14373) 7598 : cluster [DBG] pgmap v5269: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:32:48.565 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:32:48.565 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:32:48.566 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:32:48.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:32:48 smithi157 bash[24585]: cluster 2024-09-16T08:32:47.179040+0000 mgr.a (mgr.14373) 7599 : cluster [DBG] pgmap v5270: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:32:48.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:32:48 smithi086 bash[24289]: cluster 2024-09-16T08:32:47.179040+0000 mgr.a (mgr.14373) 7599 : cluster [DBG] pgmap v5270: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:32:48.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:32:48 smithi047 bash[22744]: cluster 2024-09-16T08:32:47.179040+0000 mgr.a (mgr.14373) 7599 : cluster [DBG] pgmap v5270: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:32:49.322 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:32:49.322 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:32:49.322 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:32:49.322 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:32:49.323 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:32:49.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:32:49 smithi157 bash[24585]: audit 2024-09-16T08:32:48.391813+0000 mon.b (mon.2) 718 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T08:32:49.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:32:49 smithi157 bash[24585]: audit 2024-09-16T08:32:49.261839+0000 mon.b (mon.2) 719 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T08:32:49.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:32:49 smithi157 bash[24585]: audit 2024-09-16T08:32:49.263265+0000 mon.b (mon.2) 720 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T08:32:49.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:32:49 smithi157 bash[24585]: audit 2024-09-16T08:32:49.271642+0000 mon.a (mon.0) 1021 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:32:49.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:32:49 smithi157 bash[24585]: audit 2024-09-16T08:32:49.275156+0000 mon.b (mon.2) 721 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:32:49.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:32:49 smithi086 bash[24289]: audit 2024-09-16T08:32:48.391813+0000 mon.b (mon.2) 718 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T08:32:49.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:32:49 smithi086 bash[24289]: audit 2024-09-16T08:32:49.261839+0000 mon.b (mon.2) 719 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T08:32:49.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:32:49 smithi086 bash[24289]: audit 2024-09-16T08:32:49.263265+0000 mon.b (mon.2) 720 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T08:32:49.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:32:49 smithi086 bash[24289]: audit 2024-09-16T08:32:49.271642+0000 mon.a (mon.0) 1021 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:32:49.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:32:49 smithi086 bash[24289]: audit 2024-09-16T08:32:49.275156+0000 mon.b (mon.2) 721 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:32:49.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:32:49 smithi047 bash[22744]: audit 2024-09-16T08:32:48.391813+0000 mon.b (mon.2) 718 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T08:32:49.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:32:49 smithi047 bash[22744]: audit 2024-09-16T08:32:49.261839+0000 mon.b (mon.2) 719 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T08:32:49.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:32:49 smithi047 bash[22744]: audit 2024-09-16T08:32:49.263265+0000 mon.b (mon.2) 720 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T08:32:49.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:32:49 smithi047 bash[22744]: audit 2024-09-16T08:32:49.271642+0000 mon.a (mon.0) 1021 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:32:49.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:32:49 smithi047 bash[22744]: audit 2024-09-16T08:32:49.275156+0000 mon.b (mon.2) 721 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:32:50.338 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 08:32:50 smithi047 bash[22994]: debug 2024-09-16T08:32:50.000+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T08:32:50.338 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 08:32:50 smithi047 bash[22994]: debug 2024-09-16T08:32:50.004+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T08:32:50.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:32:50 smithi157 bash[24585]: audit 2024-09-16T08:32:48.893804+0000 mgr.a (mgr.14373) 7600 : audit [DBG] from='client.171303 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:32:50.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:32:50 smithi157 bash[24585]: cluster 2024-09-16T08:32:49.179654+0000 mgr.a (mgr.14373) 7601 : cluster [DBG] pgmap v5271: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:32:50.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:32:50 smithi157 bash[24585]: audit 2024-09-16T08:32:49.278126+0000 mgr.a (mgr.14373) 7602 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:32:50.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:32:50 smithi086 bash[24289]: audit 2024-09-16T08:32:48.893804+0000 mgr.a (mgr.14373) 7600 : audit [DBG] from='client.171303 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:32:50.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:32:50 smithi086 bash[24289]: cluster 2024-09-16T08:32:49.179654+0000 mgr.a (mgr.14373) 7601 : cluster [DBG] pgmap v5271: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:32:50.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:32:50 smithi086 bash[24289]: audit 2024-09-16T08:32:49.278126+0000 mgr.a (mgr.14373) 7602 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:32:50.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:32:50 smithi047 bash[22744]: audit 2024-09-16T08:32:48.893804+0000 mgr.a (mgr.14373) 7600 : audit [DBG] from='client.171303 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:32:50.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:32:50 smithi047 bash[22744]: cluster 2024-09-16T08:32:49.179654+0000 mgr.a (mgr.14373) 7601 : cluster [DBG] pgmap v5271: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:32:50.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:32:50 smithi047 bash[22744]: audit 2024-09-16T08:32:49.278126+0000 mgr.a (mgr.14373) 7602 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:32:51.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:32:51 smithi157 bash[24585]: audit 2024-09-16T08:32:50.004205+0000 mgr.a (mgr.14373) 7603 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T08:32:51.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:32:51 smithi157 bash[24585]: cephadm 2024-09-16T08:32:50.006434+0000 mgr.a (mgr.14373) 7604 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T08:32:51.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:32:51 smithi086 bash[24289]: audit 2024-09-16T08:32:50.004205+0000 mgr.a (mgr.14373) 7603 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T08:32:51.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:32:51 smithi086 bash[24289]: cephadm 2024-09-16T08:32:50.006434+0000 mgr.a (mgr.14373) 7604 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T08:32:51.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:32:51 smithi047 bash[22744]: audit 2024-09-16T08:32:50.004205+0000 mgr.a (mgr.14373) 7603 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T08:32:51.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:32:51 smithi047 bash[22744]: cephadm 2024-09-16T08:32:50.006434+0000 mgr.a (mgr.14373) 7604 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T08:32:52.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:32:52 smithi157 bash[24585]: cluster 2024-09-16T08:32:51.180504+0000 mgr.a (mgr.14373) 7605 : cluster [DBG] pgmap v5272: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:32:52.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:32:52 smithi086 bash[24289]: cluster 2024-09-16T08:32:51.180504+0000 mgr.a (mgr.14373) 7605 : cluster [DBG] pgmap v5272: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:32:52.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:32:52 smithi047 bash[22744]: cluster 2024-09-16T08:32:51.180504+0000 mgr.a (mgr.14373) 7605 : cluster [DBG] pgmap v5272: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:32:54.324 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:32:54.324 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:32:54.325 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:32:54.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:32:54 smithi157 bash[24585]: cluster 2024-09-16T08:32:53.182746+0000 mgr.a (mgr.14373) 7606 : cluster [DBG] pgmap v5273: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:32:54.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:32:54 smithi086 bash[24289]: cluster 2024-09-16T08:32:53.182746+0000 mgr.a (mgr.14373) 7606 : cluster [DBG] pgmap v5273: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:32:54.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:32:54 smithi047 bash[22744]: cluster 2024-09-16T08:32:53.182746+0000 mgr.a (mgr.14373) 7606 : cluster [DBG] pgmap v5273: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:32:55.076 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:32:55.076 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:32:55.076 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:32:55.076 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:32:55.076 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:32:55.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:32:55 smithi157 bash[24585]: audit 2024-09-16T08:32:54.659801+0000 mgr.a (mgr.14373) 7607 : audit [DBG] from='client.171489 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:32:55.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:32:55 smithi086 bash[24289]: audit 2024-09-16T08:32:54.659801+0000 mgr.a (mgr.14373) 7607 : audit [DBG] from='client.171489 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:32:55.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:32:55 smithi047 bash[22744]: audit 2024-09-16T08:32:54.659801+0000 mgr.a (mgr.14373) 7607 : audit [DBG] from='client.171489 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:32:56.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:32:56 smithi157 bash[24585]: cluster 2024-09-16T08:32:55.183336+0000 mgr.a (mgr.14373) 7608 : cluster [DBG] pgmap v5274: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:32:56.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:32:56 smithi086 bash[24289]: cluster 2024-09-16T08:32:55.183336+0000 mgr.a (mgr.14373) 7608 : cluster [DBG] pgmap v5274: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:32:56.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:32:56 smithi047 bash[22744]: cluster 2024-09-16T08:32:55.183336+0000 mgr.a (mgr.14373) 7608 : cluster [DBG] pgmap v5274: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:32:58.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:32:58 smithi157 bash[24585]: cluster 2024-09-16T08:32:57.185419+0000 mgr.a (mgr.14373) 7609 : cluster [DBG] pgmap v5275: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:32:58.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:32:58 smithi086 bash[24289]: cluster 2024-09-16T08:32:57.185419+0000 mgr.a (mgr.14373) 7609 : cluster [DBG] pgmap v5275: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:32:58.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:32:58 smithi047 bash[22744]: cluster 2024-09-16T08:32:57.185419+0000 mgr.a (mgr.14373) 7609 : cluster [DBG] pgmap v5275: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:33:00.077 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:33:00.078 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:33:00.078 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:33:00.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:33:00 smithi157 bash[24585]: cluster 2024-09-16T08:32:59.186173+0000 mgr.a (mgr.14373) 7610 : cluster [DBG] pgmap v5276: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:33:00.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:33:00 smithi086 bash[24289]: cluster 2024-09-16T08:32:59.186173+0000 mgr.a (mgr.14373) 7610 : cluster [DBG] pgmap v5276: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:33:00.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:33:00 smithi047 bash[22744]: cluster 2024-09-16T08:32:59.186173+0000 mgr.a (mgr.14373) 7610 : cluster [DBG] pgmap v5276: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:33:00.853 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:33:00.854 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:33:00.854 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:33:00.854 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:33:00.855 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:33:01.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:33:01 smithi157 bash[24585]: audit 2024-09-16T08:33:00.413541+0000 mgr.a (mgr.14373) 7611 : audit [DBG] from='client.171567 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:33:01.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:33:01 smithi086 bash[24289]: audit 2024-09-16T08:33:00.413541+0000 mgr.a (mgr.14373) 7611 : audit [DBG] from='client.171567 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:33:01.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:33:01 smithi047 bash[22744]: audit 2024-09-16T08:33:00.413541+0000 mgr.a (mgr.14373) 7611 : audit [DBG] from='client.171567 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:33:02.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:33:02 smithi157 bash[24585]: cluster 2024-09-16T08:33:01.187306+0000 mgr.a (mgr.14373) 7612 : cluster [DBG] pgmap v5277: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:33:02.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:33:02 smithi086 bash[24289]: cluster 2024-09-16T08:33:01.187306+0000 mgr.a (mgr.14373) 7612 : cluster [DBG] pgmap v5277: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:33:02.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:33:02 smithi047 bash[22744]: cluster 2024-09-16T08:33:01.187306+0000 mgr.a (mgr.14373) 7612 : cluster [DBG] pgmap v5277: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:33:04.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:33:04 smithi157 bash[24585]: cluster 2024-09-16T08:33:03.189751+0000 mgr.a (mgr.14373) 7613 : cluster [DBG] pgmap v5278: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:33:04.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:33:04 smithi086 bash[24289]: cluster 2024-09-16T08:33:03.189751+0000 mgr.a (mgr.14373) 7613 : cluster [DBG] pgmap v5278: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:33:04.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:33:04 smithi047 bash[22744]: cluster 2024-09-16T08:33:03.189751+0000 mgr.a (mgr.14373) 7613 : cluster [DBG] pgmap v5278: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:33:05.855 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:33:05.856 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:33:05.856 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:33:06.601 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:33:06.602 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:33:06.602 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:33:06.602 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:33:06.602 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:33:06.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:33:06 smithi157 bash[24585]: cluster 2024-09-16T08:33:05.190728+0000 mgr.a (mgr.14373) 7614 : cluster [DBG] pgmap v5279: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:33:06.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:33:06 smithi086 bash[24289]: cluster 2024-09-16T08:33:05.190728+0000 mgr.a (mgr.14373) 7614 : cluster [DBG] pgmap v5279: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:33:06.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:33:06 smithi047 bash[22744]: cluster 2024-09-16T08:33:05.190728+0000 mgr.a (mgr.14373) 7614 : cluster [DBG] pgmap v5279: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:33:07.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:33:07 smithi157 bash[24585]: audit 2024-09-16T08:33:06.194390+0000 mgr.a (mgr.14373) 7615 : audit [DBG] from='client.171645 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:33:07.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:33:07 smithi086 bash[24289]: audit 2024-09-16T08:33:06.194390+0000 mgr.a (mgr.14373) 7615 : audit [DBG] from='client.171645 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:33:07.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:33:07 smithi047 bash[22744]: audit 2024-09-16T08:33:06.194390+0000 mgr.a (mgr.14373) 7615 : audit [DBG] from='client.171645 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:33:08.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:33:08 smithi157 bash[24585]: cluster 2024-09-16T08:33:07.193184+0000 mgr.a (mgr.14373) 7616 : cluster [DBG] pgmap v5280: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.4 KiB/s rd, 2 op/s 2024-09-16T08:33:08.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:33:08 smithi086 bash[24289]: cluster 2024-09-16T08:33:07.193184+0000 mgr.a (mgr.14373) 7616 : cluster [DBG] pgmap v5280: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.4 KiB/s rd, 2 op/s 2024-09-16T08:33:08.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:33:08 smithi047 bash[22744]: cluster 2024-09-16T08:33:07.193184+0000 mgr.a (mgr.14373) 7616 : cluster [DBG] pgmap v5280: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.4 KiB/s rd, 2 op/s 2024-09-16T08:33:10.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:33:10 smithi157 bash[24585]: cluster 2024-09-16T08:33:09.194000+0000 mgr.a (mgr.14373) 7617 : cluster [DBG] pgmap v5281: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-09-16T08:33:10.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:33:10 smithi086 bash[24289]: cluster 2024-09-16T08:33:09.194000+0000 mgr.a (mgr.14373) 7617 : cluster [DBG] pgmap v5281: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-09-16T08:33:10.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:33:10 smithi047 bash[22744]: cluster 2024-09-16T08:33:09.194000+0000 mgr.a (mgr.14373) 7617 : cluster [DBG] pgmap v5281: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-09-16T08:33:11.603 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:33:11.604 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:33:11.604 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:33:12.363 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:33:12.364 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:33:12.364 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:33:12.364 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:33:12.364 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:33:12.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:33:12 smithi157 bash[24585]: cluster 2024-09-16T08:33:11.194803+0000 mgr.a (mgr.14373) 7618 : cluster [DBG] pgmap v5282: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-09-16T08:33:12.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:33:12 smithi086 bash[24289]: cluster 2024-09-16T08:33:11.194803+0000 mgr.a (mgr.14373) 7618 : cluster [DBG] pgmap v5282: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-09-16T08:33:12.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:33:12 smithi047 bash[22744]: cluster 2024-09-16T08:33:11.194803+0000 mgr.a (mgr.14373) 7618 : cluster [DBG] pgmap v5282: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-09-16T08:33:13.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:33:13 smithi157 bash[24585]: audit 2024-09-16T08:33:11.935551+0000 mgr.a (mgr.14373) 7619 : audit [DBG] from='client.171723 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:33:13.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:33:13 smithi086 bash[24289]: audit 2024-09-16T08:33:11.935551+0000 mgr.a (mgr.14373) 7619 : audit [DBG] from='client.171723 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:33:13.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:33:13 smithi047 bash[22744]: audit 2024-09-16T08:33:11.935551+0000 mgr.a (mgr.14373) 7619 : audit [DBG] from='client.171723 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:33:14.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:33:14 smithi157 bash[24585]: cluster 2024-09-16T08:33:13.197622+0000 mgr.a (mgr.14373) 7620 : cluster [DBG] pgmap v5283: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:33:14.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:33:14 smithi086 bash[24289]: cluster 2024-09-16T08:33:13.197622+0000 mgr.a (mgr.14373) 7620 : cluster [DBG] pgmap v5283: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:33:14.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:33:14 smithi047 bash[22744]: cluster 2024-09-16T08:33:13.197622+0000 mgr.a (mgr.14373) 7620 : cluster [DBG] pgmap v5283: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:33:16.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:33:16 smithi157 bash[24585]: cluster 2024-09-16T08:33:15.198501+0000 mgr.a (mgr.14373) 7621 : cluster [DBG] pgmap v5284: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:33:16.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:33:16 smithi086 bash[24289]: cluster 2024-09-16T08:33:15.198501+0000 mgr.a (mgr.14373) 7621 : cluster [DBG] pgmap v5284: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:33:16.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:33:16 smithi047 bash[22744]: cluster 2024-09-16T08:33:15.198501+0000 mgr.a (mgr.14373) 7621 : cluster [DBG] pgmap v5284: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:33:17.365 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:33:17.366 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:33:17.366 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:33:18.140 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:33:18.141 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:33:18.141 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:33:18.141 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:33:18.141 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:33:18.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:33:18 smithi157 bash[24585]: cluster 2024-09-16T08:33:17.200390+0000 mgr.a (mgr.14373) 7622 : cluster [DBG] pgmap v5285: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:33:18.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:33:18 smithi157 bash[24585]: audit 2024-09-16T08:33:17.703998+0000 mgr.a (mgr.14373) 7623 : audit [DBG] from='client.171792 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:33:18.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:33:18 smithi086 bash[24289]: cluster 2024-09-16T08:33:17.200390+0000 mgr.a (mgr.14373) 7622 : cluster [DBG] pgmap v5285: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:33:18.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:33:18 smithi086 bash[24289]: audit 2024-09-16T08:33:17.703998+0000 mgr.a (mgr.14373) 7623 : audit [DBG] from='client.171792 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:33:18.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:33:18 smithi047 bash[22744]: cluster 2024-09-16T08:33:17.200390+0000 mgr.a (mgr.14373) 7622 : cluster [DBG] pgmap v5285: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:33:18.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:33:18 smithi047 bash[22744]: audit 2024-09-16T08:33:17.703998+0000 mgr.a (mgr.14373) 7623 : audit [DBG] from='client.171792 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:33:20.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:33:20 smithi157 bash[24585]: cluster 2024-09-16T08:33:19.201358+0000 mgr.a (mgr.14373) 7624 : cluster [DBG] pgmap v5286: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T08:33:20.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:33:20 smithi086 bash[24289]: cluster 2024-09-16T08:33:19.201358+0000 mgr.a (mgr.14373) 7624 : cluster [DBG] pgmap v5286: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T08:33:20.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:33:20 smithi047 bash[22744]: cluster 2024-09-16T08:33:19.201358+0000 mgr.a (mgr.14373) 7624 : cluster [DBG] pgmap v5286: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T08:33:22.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:33:22 smithi157 bash[24585]: cluster 2024-09-16T08:33:21.202167+0000 mgr.a (mgr.14373) 7625 : cluster [DBG] pgmap v5287: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T08:33:22.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:33:22 smithi086 bash[24289]: cluster 2024-09-16T08:33:21.202167+0000 mgr.a (mgr.14373) 7625 : cluster [DBG] pgmap v5287: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T08:33:22.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:33:22 smithi047 bash[22744]: cluster 2024-09-16T08:33:21.202167+0000 mgr.a (mgr.14373) 7625 : cluster [DBG] pgmap v5287: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T08:33:23.143 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:33:23.144 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:33:23.144 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:33:23.876 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:33:23.877 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:33:23.877 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:33:23.877 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:33:23.877 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:33:24.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:33:24 smithi157 bash[24585]: cluster 2024-09-16T08:33:23.204097+0000 mgr.a (mgr.14373) 7626 : cluster [DBG] pgmap v5288: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-16T08:33:24.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:33:24 smithi157 bash[24585]: audit 2024-09-16T08:33:23.476814+0000 mgr.a (mgr.14373) 7627 : audit [DBG] from='client.171870 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:33:24.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:33:24 smithi086 bash[24289]: cluster 2024-09-16T08:33:23.204097+0000 mgr.a (mgr.14373) 7626 : cluster [DBG] pgmap v5288: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-16T08:33:24.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:33:24 smithi086 bash[24289]: audit 2024-09-16T08:33:23.476814+0000 mgr.a (mgr.14373) 7627 : audit [DBG] from='client.171870 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:33:24.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:33:24 smithi047 bash[22744]: cluster 2024-09-16T08:33:23.204097+0000 mgr.a (mgr.14373) 7626 : cluster [DBG] pgmap v5288: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-16T08:33:24.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:33:24 smithi047 bash[22744]: audit 2024-09-16T08:33:23.476814+0000 mgr.a (mgr.14373) 7627 : audit [DBG] from='client.171870 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:33:26.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:33:26 smithi157 bash[24585]: cluster 2024-09-16T08:33:25.205069+0000 mgr.a (mgr.14373) 7628 : cluster [DBG] pgmap v5289: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:33:26.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:33:26 smithi086 bash[24289]: cluster 2024-09-16T08:33:25.205069+0000 mgr.a (mgr.14373) 7628 : cluster [DBG] pgmap v5289: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:33:26.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:33:26 smithi047 bash[22744]: cluster 2024-09-16T08:33:25.205069+0000 mgr.a (mgr.14373) 7628 : cluster [DBG] pgmap v5289: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:33:28.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:33:28 smithi157 bash[24585]: cluster 2024-09-16T08:33:27.207267+0000 mgr.a (mgr.14373) 7629 : cluster [DBG] pgmap v5290: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:33:28.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:33:28 smithi086 bash[24289]: cluster 2024-09-16T08:33:27.207267+0000 mgr.a (mgr.14373) 7629 : cluster [DBG] pgmap v5290: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:33:28.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:33:28 smithi047 bash[22744]: cluster 2024-09-16T08:33:27.207267+0000 mgr.a (mgr.14373) 7629 : cluster [DBG] pgmap v5290: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:33:28.878 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:33:28.879 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:33:28.879 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:33:29.665 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:33:29.666 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:33:29.666 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:33:29.666 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:33:29.666 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:33:30.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:33:30 smithi157 bash[24585]: cluster 2024-09-16T08:33:29.208008+0000 mgr.a (mgr.14373) 7630 : cluster [DBG] pgmap v5291: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:33:30.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:33:30 smithi157 bash[24585]: audit 2024-09-16T08:33:29.214945+0000 mgr.a (mgr.14373) 7631 : audit [DBG] from='client.171948 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:33:30.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:33:30 smithi086 bash[24289]: cluster 2024-09-16T08:33:29.208008+0000 mgr.a (mgr.14373) 7630 : cluster [DBG] pgmap v5291: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:33:30.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:33:30 smithi086 bash[24289]: audit 2024-09-16T08:33:29.214945+0000 mgr.a (mgr.14373) 7631 : audit [DBG] from='client.171948 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:33:30.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:33:30 smithi047 bash[22744]: cluster 2024-09-16T08:33:29.208008+0000 mgr.a (mgr.14373) 7630 : cluster [DBG] pgmap v5291: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:33:30.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:33:30 smithi047 bash[22744]: audit 2024-09-16T08:33:29.214945+0000 mgr.a (mgr.14373) 7631 : audit [DBG] from='client.171948 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:33:32.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:33:32 smithi157 bash[24585]: cluster 2024-09-16T08:33:31.208936+0000 mgr.a (mgr.14373) 7632 : cluster [DBG] pgmap v5292: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:33:32.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:33:32 smithi086 bash[24289]: cluster 2024-09-16T08:33:31.208936+0000 mgr.a (mgr.14373) 7632 : cluster [DBG] pgmap v5292: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:33:32.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:33:32 smithi047 bash[22744]: cluster 2024-09-16T08:33:31.208936+0000 mgr.a (mgr.14373) 7632 : cluster [DBG] pgmap v5292: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:33:34.667 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:33:34.668 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:33:34.668 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:33:34.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:33:34 smithi157 bash[24585]: cluster 2024-09-16T08:33:33.211122+0000 mgr.a (mgr.14373) 7633 : cluster [DBG] pgmap v5293: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:33:34.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:33:34 smithi086 bash[24289]: cluster 2024-09-16T08:33:33.211122+0000 mgr.a (mgr.14373) 7633 : cluster [DBG] pgmap v5293: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:33:34.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:33:34 smithi047 bash[22744]: cluster 2024-09-16T08:33:33.211122+0000 mgr.a (mgr.14373) 7633 : cluster [DBG] pgmap v5293: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:33:35.429 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:33:35.429 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:33:35.429 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:33:35.430 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:33:35.430 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:33:36.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:33:36 smithi157 bash[24585]: audit 2024-09-16T08:33:35.003145+0000 mgr.a (mgr.14373) 7634 : audit [DBG] from='client.172026 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:33:36.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:33:36 smithi157 bash[24585]: cluster 2024-09-16T08:33:35.211602+0000 mgr.a (mgr.14373) 7635 : cluster [DBG] pgmap v5294: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:33:36.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:33:36 smithi086 bash[24289]: audit 2024-09-16T08:33:35.003145+0000 mgr.a (mgr.14373) 7634 : audit [DBG] from='client.172026 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:33:36.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:33:36 smithi086 bash[24289]: cluster 2024-09-16T08:33:35.211602+0000 mgr.a (mgr.14373) 7635 : cluster [DBG] pgmap v5294: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:33:36.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:33:36 smithi047 bash[22744]: audit 2024-09-16T08:33:35.003145+0000 mgr.a (mgr.14373) 7634 : audit [DBG] from='client.172026 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:33:36.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:33:36 smithi047 bash[22744]: cluster 2024-09-16T08:33:35.211602+0000 mgr.a (mgr.14373) 7635 : cluster [DBG] pgmap v5294: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:33:38.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:33:38 smithi157 bash[24585]: cluster 2024-09-16T08:33:37.213779+0000 mgr.a (mgr.14373) 7636 : cluster [DBG] pgmap v5295: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:33:38.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:33:38 smithi086 bash[24289]: cluster 2024-09-16T08:33:37.213779+0000 mgr.a (mgr.14373) 7636 : cluster [DBG] pgmap v5295: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:33:38.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:33:38 smithi047 bash[22744]: cluster 2024-09-16T08:33:37.213779+0000 mgr.a (mgr.14373) 7636 : cluster [DBG] pgmap v5295: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:33:40.431 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:33:40.431 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:33:40.431 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:33:40.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:33:40 smithi157 bash[24585]: cluster 2024-09-16T08:33:39.214582+0000 mgr.a (mgr.14373) 7637 : cluster [DBG] pgmap v5296: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:33:40.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:33:40 smithi086 bash[24289]: cluster 2024-09-16T08:33:39.214582+0000 mgr.a (mgr.14373) 7637 : cluster [DBG] pgmap v5296: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:33:40.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:33:40 smithi047 bash[22744]: cluster 2024-09-16T08:33:39.214582+0000 mgr.a (mgr.14373) 7637 : cluster [DBG] pgmap v5296: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:33:41.179 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:33:41.179 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:33:41.179 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:33:41.179 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:33:41.179 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:33:42.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:33:42 smithi157 bash[24585]: audit 2024-09-16T08:33:40.766716+0000 mgr.a (mgr.14373) 7638 : audit [DBG] from='client.172104 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:33:42.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:33:42 smithi157 bash[24585]: cluster 2024-09-16T08:33:41.215071+0000 mgr.a (mgr.14373) 7639 : cluster [DBG] pgmap v5297: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:33:42.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:33:42 smithi086 bash[24289]: audit 2024-09-16T08:33:40.766716+0000 mgr.a (mgr.14373) 7638 : audit [DBG] from='client.172104 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:33:42.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:33:42 smithi086 bash[24289]: cluster 2024-09-16T08:33:41.215071+0000 mgr.a (mgr.14373) 7639 : cluster [DBG] pgmap v5297: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:33:42.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:33:42 smithi047 bash[22744]: audit 2024-09-16T08:33:40.766716+0000 mgr.a (mgr.14373) 7638 : audit [DBG] from='client.172104 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:33:42.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:33:42 smithi047 bash[22744]: cluster 2024-09-16T08:33:41.215071+0000 mgr.a (mgr.14373) 7639 : cluster [DBG] pgmap v5297: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:33:44.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:33:44 smithi157 bash[24585]: cluster 2024-09-16T08:33:43.217250+0000 mgr.a (mgr.14373) 7640 : cluster [DBG] pgmap v5298: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:33:44.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:33:44 smithi086 bash[24289]: cluster 2024-09-16T08:33:43.217250+0000 mgr.a (mgr.14373) 7640 : cluster [DBG] pgmap v5298: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:33:44.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:33:44 smithi047 bash[22744]: cluster 2024-09-16T08:33:43.217250+0000 mgr.a (mgr.14373) 7640 : cluster [DBG] pgmap v5298: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:33:46.180 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:33:46.182 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:33:46.182 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:33:46.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:33:46 smithi157 bash[24585]: cluster 2024-09-16T08:33:45.218019+0000 mgr.a (mgr.14373) 7641 : cluster [DBG] pgmap v5299: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:33:46.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:33:46 smithi086 bash[24289]: cluster 2024-09-16T08:33:45.218019+0000 mgr.a (mgr.14373) 7641 : cluster [DBG] pgmap v5299: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:33:46.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:33:46 smithi047 bash[22744]: cluster 2024-09-16T08:33:45.218019+0000 mgr.a (mgr.14373) 7641 : cluster [DBG] pgmap v5299: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:33:46.969 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:33:46.969 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:33:46.970 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:33:46.970 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:33:46.970 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:33:47.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:33:47 smithi157 bash[24585]: audit 2024-09-16T08:33:46.526980+0000 mgr.a (mgr.14373) 7642 : audit [DBG] from='client.172182 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:33:47.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:33:47 smithi086 bash[24289]: audit 2024-09-16T08:33:46.526980+0000 mgr.a (mgr.14373) 7642 : audit [DBG] from='client.172182 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:33:47.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:33:47 smithi047 bash[22744]: audit 2024-09-16T08:33:46.526980+0000 mgr.a (mgr.14373) 7642 : audit [DBG] from='client.172182 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:33:48.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:33:48 smithi157 bash[24585]: cluster 2024-09-16T08:33:47.220750+0000 mgr.a (mgr.14373) 7643 : cluster [DBG] pgmap v5300: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:33:48.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:33:48 smithi086 bash[24289]: cluster 2024-09-16T08:33:47.220750+0000 mgr.a (mgr.14373) 7643 : cluster [DBG] pgmap v5300: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:33:48.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:33:48 smithi047 bash[22744]: cluster 2024-09-16T08:33:47.220750+0000 mgr.a (mgr.14373) 7643 : cluster [DBG] pgmap v5300: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:33:50.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:33:50 smithi157 bash[24585]: cluster 2024-09-16T08:33:49.221518+0000 mgr.a (mgr.14373) 7644 : cluster [DBG] pgmap v5301: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:33:50.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:33:50 smithi157 bash[24585]: audit 2024-09-16T08:33:50.057604+0000 mon.b (mon.2) 722 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T08:33:50.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:33:50 smithi086 bash[24289]: cluster 2024-09-16T08:33:49.221518+0000 mgr.a (mgr.14373) 7644 : cluster [DBG] pgmap v5301: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:33:50.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:33:50 smithi086 bash[24289]: audit 2024-09-16T08:33:50.057604+0000 mon.b (mon.2) 722 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T08:33:50.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:33:50 smithi047 bash[22744]: cluster 2024-09-16T08:33:49.221518+0000 mgr.a (mgr.14373) 7644 : cluster [DBG] pgmap v5301: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:33:50.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:33:50 smithi047 bash[22744]: audit 2024-09-16T08:33:50.057604+0000 mon.b (mon.2) 722 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T08:33:51.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:33:51 smithi157 bash[24585]: audit 2024-09-16T08:33:50.888162+0000 mon.b (mon.2) 723 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T08:33:51.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:33:51 smithi157 bash[24585]: audit 2024-09-16T08:33:50.889816+0000 mon.b (mon.2) 724 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T08:33:51.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:33:51 smithi157 bash[24585]: audit 2024-09-16T08:33:50.899626+0000 mon.a (mon.0) 1022 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:33:51.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:33:51 smithi157 bash[24585]: audit 2024-09-16T08:33:50.905099+0000 mon.b (mon.2) 725 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:33:51.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:33:51 smithi086 bash[24289]: audit 2024-09-16T08:33:50.888162+0000 mon.b (mon.2) 723 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T08:33:51.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:33:51 smithi086 bash[24289]: audit 2024-09-16T08:33:50.889816+0000 mon.b (mon.2) 724 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T08:33:51.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:33:51 smithi086 bash[24289]: audit 2024-09-16T08:33:50.899626+0000 mon.a (mon.0) 1022 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:33:51.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:33:51 smithi086 bash[24289]: audit 2024-09-16T08:33:50.905099+0000 mon.b (mon.2) 725 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:33:51.838 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 08:33:51 smithi047 bash[22994]: debug 2024-09-16T08:33:51.655+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T08:33:51.838 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 08:33:51 smithi047 bash[22994]: debug 2024-09-16T08:33:51.655+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T08:33:51.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:33:51 smithi047 bash[22744]: audit 2024-09-16T08:33:50.888162+0000 mon.b (mon.2) 723 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T08:33:51.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:33:51 smithi047 bash[22744]: audit 2024-09-16T08:33:50.889816+0000 mon.b (mon.2) 724 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T08:33:51.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:33:51 smithi047 bash[22744]: audit 2024-09-16T08:33:50.899626+0000 mon.a (mon.0) 1022 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:33:51.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:33:51 smithi047 bash[22744]: audit 2024-09-16T08:33:50.905099+0000 mon.b (mon.2) 725 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:33:51.971 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:33:51.972 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:33:51.972 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:33:52.717 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:33:52.718 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:33:52.718 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:33:52.718 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:33:52.718 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:33:52.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:33:52 smithi157 bash[24585]: audit 2024-09-16T08:33:50.909360+0000 mgr.a (mgr.14373) 7645 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:33:52.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:33:52 smithi157 bash[24585]: cluster 2024-09-16T08:33:51.222001+0000 mgr.a (mgr.14373) 7646 : cluster [DBG] pgmap v5302: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T08:33:52.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:33:52 smithi157 bash[24585]: audit 2024-09-16T08:33:51.659776+0000 mgr.a (mgr.14373) 7647 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T08:33:52.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:33:52 smithi157 bash[24585]: cephadm 2024-09-16T08:33:51.661724+0000 mgr.a (mgr.14373) 7648 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T08:33:52.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:33:52 smithi086 bash[24289]: audit 2024-09-16T08:33:50.909360+0000 mgr.a (mgr.14373) 7645 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:33:52.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:33:52 smithi086 bash[24289]: cluster 2024-09-16T08:33:51.222001+0000 mgr.a (mgr.14373) 7646 : cluster [DBG] pgmap v5302: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T08:33:52.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:33:52 smithi086 bash[24289]: audit 2024-09-16T08:33:51.659776+0000 mgr.a (mgr.14373) 7647 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T08:33:52.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:33:52 smithi086 bash[24289]: cephadm 2024-09-16T08:33:51.661724+0000 mgr.a (mgr.14373) 7648 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T08:33:52.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:33:52 smithi047 bash[22744]: audit 2024-09-16T08:33:50.909360+0000 mgr.a (mgr.14373) 7645 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:33:52.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:33:52 smithi047 bash[22744]: cluster 2024-09-16T08:33:51.222001+0000 mgr.a (mgr.14373) 7646 : cluster [DBG] pgmap v5302: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T08:33:52.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:33:52 smithi047 bash[22744]: audit 2024-09-16T08:33:51.659776+0000 mgr.a (mgr.14373) 7647 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T08:33:52.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:33:52 smithi047 bash[22744]: cephadm 2024-09-16T08:33:51.661724+0000 mgr.a (mgr.14373) 7648 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T08:33:53.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:33:53 smithi157 bash[24585]: audit 2024-09-16T08:33:52.304196+0000 mgr.a (mgr.14373) 7649 : audit [DBG] from='client.172365 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:33:53.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:33:53 smithi086 bash[24289]: audit 2024-09-16T08:33:52.304196+0000 mgr.a (mgr.14373) 7649 : audit [DBG] from='client.172365 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:33:53.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:33:53 smithi047 bash[22744]: audit 2024-09-16T08:33:52.304196+0000 mgr.a (mgr.14373) 7649 : audit [DBG] from='client.172365 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:33:54.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:33:54 smithi157 bash[24585]: cluster 2024-09-16T08:33:53.224836+0000 mgr.a (mgr.14373) 7650 : cluster [DBG] pgmap v5303: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 4.5 KiB/s rd, 255 B/s wr, 4 op/s 2024-09-16T08:33:54.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:33:54 smithi086 bash[24289]: cluster 2024-09-16T08:33:53.224836+0000 mgr.a (mgr.14373) 7650 : cluster [DBG] pgmap v5303: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 4.5 KiB/s rd, 255 B/s wr, 4 op/s 2024-09-16T08:33:54.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:33:54 smithi047 bash[22744]: cluster 2024-09-16T08:33:53.224836+0000 mgr.a (mgr.14373) 7650 : cluster [DBG] pgmap v5303: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 4.5 KiB/s rd, 255 B/s wr, 4 op/s 2024-09-16T08:33:56.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:33:56 smithi157 bash[24585]: cluster 2024-09-16T08:33:55.225802+0000 mgr.a (mgr.14373) 7651 : cluster [DBG] pgmap v5304: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 3.6 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-16T08:33:56.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:33:56 smithi086 bash[24289]: cluster 2024-09-16T08:33:55.225802+0000 mgr.a (mgr.14373) 7651 : cluster [DBG] pgmap v5304: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 3.6 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-16T08:33:56.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:33:56 smithi047 bash[22744]: cluster 2024-09-16T08:33:55.225802+0000 mgr.a (mgr.14373) 7651 : cluster [DBG] pgmap v5304: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 3.6 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-16T08:33:57.719 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:33:57.720 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:33:57.720 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:33:58.477 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:33:58.477 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:33:58.477 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:33:58.477 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:33:58.478 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:33:58.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:33:58 smithi157 bash[24585]: cluster 2024-09-16T08:33:57.227880+0000 mgr.a (mgr.14373) 7652 : cluster [DBG] pgmap v5305: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:33:58.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:33:58 smithi086 bash[24289]: cluster 2024-09-16T08:33:57.227880+0000 mgr.a (mgr.14373) 7652 : cluster [DBG] pgmap v5305: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:33:58.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:33:58 smithi047 bash[22744]: cluster 2024-09-16T08:33:57.227880+0000 mgr.a (mgr.14373) 7652 : cluster [DBG] pgmap v5305: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:33:59.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:33:59 smithi157 bash[24585]: audit 2024-09-16T08:33:58.058486+0000 mgr.a (mgr.14373) 7653 : audit [DBG] from='client.172440 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:33:59.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:33:59 smithi086 bash[24289]: audit 2024-09-16T08:33:58.058486+0000 mgr.a (mgr.14373) 7653 : audit [DBG] from='client.172440 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:33:59.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:33:59 smithi047 bash[22744]: audit 2024-09-16T08:33:58.058486+0000 mgr.a (mgr.14373) 7653 : audit [DBG] from='client.172440 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:34:00.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:34:00 smithi157 bash[24585]: cluster 2024-09-16T08:33:59.228816+0000 mgr.a (mgr.14373) 7654 : cluster [DBG] pgmap v5306: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:34:00.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:34:00 smithi086 bash[24289]: cluster 2024-09-16T08:33:59.228816+0000 mgr.a (mgr.14373) 7654 : cluster [DBG] pgmap v5306: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:34:00.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:34:00 smithi047 bash[22744]: cluster 2024-09-16T08:33:59.228816+0000 mgr.a (mgr.14373) 7654 : cluster [DBG] pgmap v5306: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:34:02.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:34:02 smithi086 bash[24289]: cluster 2024-09-16T08:34:01.229597+0000 mgr.a (mgr.14373) 7655 : cluster [DBG] pgmap v5307: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:34:02.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:34:02 smithi047 bash[22744]: cluster 2024-09-16T08:34:01.229597+0000 mgr.a (mgr.14373) 7655 : cluster [DBG] pgmap v5307: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:34:03.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:34:02 smithi157 bash[24585]: cluster 2024-09-16T08:34:01.229597+0000 mgr.a (mgr.14373) 7655 : cluster [DBG] pgmap v5307: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:34:03.478 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:34:03.479 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:34:03.479 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:34:04.260 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:34:04.260 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:34:04.261 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:34:04.261 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:34:04.261 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:34:04.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:34:04 smithi086 bash[24289]: cluster 2024-09-16T08:34:03.231845+0000 mgr.a (mgr.14373) 7656 : cluster [DBG] pgmap v5308: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:34:04.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:34:04 smithi047 bash[22744]: cluster 2024-09-16T08:34:03.231845+0000 mgr.a (mgr.14373) 7656 : cluster [DBG] pgmap v5308: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:34:05.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:34:04 smithi157 bash[24585]: cluster 2024-09-16T08:34:03.231845+0000 mgr.a (mgr.14373) 7656 : cluster [DBG] pgmap v5308: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:34:05.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:34:05 smithi086 bash[24289]: audit 2024-09-16T08:34:03.818630+0000 mgr.a (mgr.14373) 7657 : audit [DBG] from='client.172509 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:34:05.840 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:34:05 smithi047 bash[22744]: audit 2024-09-16T08:34:03.818630+0000 mgr.a (mgr.14373) 7657 : audit [DBG] from='client.172509 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:34:06.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:34:05 smithi157 bash[24585]: audit 2024-09-16T08:34:03.818630+0000 mgr.a (mgr.14373) 7657 : audit [DBG] from='client.172509 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:34:06.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:34:06 smithi047 bash[22744]: cluster 2024-09-16T08:34:05.232810+0000 mgr.a (mgr.14373) 7658 : cluster [DBG] pgmap v5309: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 4.3 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-16T08:34:07.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:34:06 smithi157 bash[24585]: cluster 2024-09-16T08:34:05.232810+0000 mgr.a (mgr.14373) 7658 : cluster [DBG] pgmap v5309: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 4.3 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-16T08:34:07.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:34:06 smithi086 bash[24289]: cluster 2024-09-16T08:34:05.232810+0000 mgr.a (mgr.14373) 7658 : cluster [DBG] pgmap v5309: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 4.3 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-16T08:34:08.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:34:08 smithi047 bash[22744]: cluster 2024-09-16T08:34:07.235020+0000 mgr.a (mgr.14373) 7659 : cluster [DBG] pgmap v5310: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 5.2 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-16T08:34:09.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:34:08 smithi157 bash[24585]: cluster 2024-09-16T08:34:07.235020+0000 mgr.a (mgr.14373) 7659 : cluster [DBG] pgmap v5310: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 5.2 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-16T08:34:09.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:34:08 smithi086 bash[24289]: cluster 2024-09-16T08:34:07.235020+0000 mgr.a (mgr.14373) 7659 : cluster [DBG] pgmap v5310: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 5.2 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-16T08:34:09.262 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:34:09.262 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:34:09.262 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:34:10.036 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:34:10.037 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:34:10.037 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:34:10.037 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:34:10.037 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:34:10.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:34:10 smithi047 bash[22744]: cluster 2024-09-16T08:34:09.235786+0000 mgr.a (mgr.14373) 7660 : cluster [DBG] pgmap v5311: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:34:10.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:34:10 smithi047 bash[22744]: audit 2024-09-16T08:34:09.601952+0000 mgr.a (mgr.14373) 7661 : audit [DBG] from='client.172584 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:34:11.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:34:10 smithi157 bash[24585]: cluster 2024-09-16T08:34:09.235786+0000 mgr.a (mgr.14373) 7660 : cluster [DBG] pgmap v5311: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:34:11.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:34:10 smithi157 bash[24585]: audit 2024-09-16T08:34:09.601952+0000 mgr.a (mgr.14373) 7661 : audit [DBG] from='client.172584 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:34:11.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:34:10 smithi086 bash[24289]: cluster 2024-09-16T08:34:09.235786+0000 mgr.a (mgr.14373) 7660 : cluster [DBG] pgmap v5311: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:34:11.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:34:10 smithi086 bash[24289]: audit 2024-09-16T08:34:09.601952+0000 mgr.a (mgr.14373) 7661 : audit [DBG] from='client.172584 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:34:12.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:34:12 smithi047 bash[22744]: cluster 2024-09-16T08:34:11.236819+0000 mgr.a (mgr.14373) 7662 : cluster [DBG] pgmap v5312: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:34:13.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:34:12 smithi157 bash[24585]: cluster 2024-09-16T08:34:11.236819+0000 mgr.a (mgr.14373) 7662 : cluster [DBG] pgmap v5312: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:34:13.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:34:12 smithi086 bash[24289]: cluster 2024-09-16T08:34:11.236819+0000 mgr.a (mgr.14373) 7662 : cluster [DBG] pgmap v5312: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:34:14.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:34:14 smithi047 bash[22744]: cluster 2024-09-16T08:34:13.239247+0000 mgr.a (mgr.14373) 7663 : cluster [DBG] pgmap v5313: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:34:15.038 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:34:15.039 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:34:15.039 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:34:15.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:34:14 smithi157 bash[24585]: cluster 2024-09-16T08:34:13.239247+0000 mgr.a (mgr.14373) 7663 : cluster [DBG] pgmap v5313: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:34:15.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:34:14 smithi086 bash[24289]: cluster 2024-09-16T08:34:13.239247+0000 mgr.a (mgr.14373) 7663 : cluster [DBG] pgmap v5313: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:34:15.824 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:34:15.825 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:34:15.825 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:34:15.825 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:34:15.825 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:34:17.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:34:16 smithi157 bash[24585]: cluster 2024-09-16T08:34:15.240147+0000 mgr.a (mgr.14373) 7664 : cluster [DBG] pgmap v5314: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:34:17.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:34:16 smithi157 bash[24585]: audit 2024-09-16T08:34:15.381029+0000 mgr.a (mgr.14373) 7665 : audit [DBG] from='client.172662 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:34:17.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:34:16 smithi086 bash[24289]: cluster 2024-09-16T08:34:15.240147+0000 mgr.a (mgr.14373) 7664 : cluster [DBG] pgmap v5314: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:34:17.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:34:16 smithi086 bash[24289]: audit 2024-09-16T08:34:15.381029+0000 mgr.a (mgr.14373) 7665 : audit [DBG] from='client.172662 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:34:17.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:34:16 smithi047 bash[22744]: cluster 2024-09-16T08:34:15.240147+0000 mgr.a (mgr.14373) 7664 : cluster [DBG] pgmap v5314: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:34:17.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:34:16 smithi047 bash[22744]: audit 2024-09-16T08:34:15.381029+0000 mgr.a (mgr.14373) 7665 : audit [DBG] from='client.172662 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:34:19.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:34:18 smithi157 bash[24585]: cluster 2024-09-16T08:34:17.242494+0000 mgr.a (mgr.14373) 7666 : cluster [DBG] pgmap v5315: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:34:19.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:34:18 smithi086 bash[24289]: cluster 2024-09-16T08:34:17.242494+0000 mgr.a (mgr.14373) 7666 : cluster [DBG] pgmap v5315: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:34:19.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:34:18 smithi047 bash[22744]: cluster 2024-09-16T08:34:17.242494+0000 mgr.a (mgr.14373) 7666 : cluster [DBG] pgmap v5315: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:34:20.826 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:34:20.827 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:34:20.827 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:34:21.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:34:20 smithi157 bash[24585]: cluster 2024-09-16T08:34:19.243259+0000 mgr.a (mgr.14373) 7667 : cluster [DBG] pgmap v5316: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:34:21.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:34:20 smithi086 bash[24289]: cluster 2024-09-16T08:34:19.243259+0000 mgr.a (mgr.14373) 7667 : cluster [DBG] pgmap v5316: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:34:21.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:34:20 smithi047 bash[22744]: cluster 2024-09-16T08:34:19.243259+0000 mgr.a (mgr.14373) 7667 : cluster [DBG] pgmap v5316: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:34:21.587 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:34:21.588 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:34:21.588 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:34:21.588 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:34:21.588 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:34:23.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:34:22 smithi157 bash[24585]: audit 2024-09-16T08:34:21.164420+0000 mgr.a (mgr.14373) 7668 : audit [DBG] from='client.172740 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:34:23.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:34:22 smithi157 bash[24585]: cluster 2024-09-16T08:34:21.243881+0000 mgr.a (mgr.14373) 7669 : cluster [DBG] pgmap v5317: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:34:23.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:34:22 smithi086 bash[24289]: audit 2024-09-16T08:34:21.164420+0000 mgr.a (mgr.14373) 7668 : audit [DBG] from='client.172740 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:34:23.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:34:22 smithi086 bash[24289]: cluster 2024-09-16T08:34:21.243881+0000 mgr.a (mgr.14373) 7669 : cluster [DBG] pgmap v5317: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:34:23.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:34:22 smithi047 bash[22744]: audit 2024-09-16T08:34:21.164420+0000 mgr.a (mgr.14373) 7668 : audit [DBG] from='client.172740 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:34:23.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:34:22 smithi047 bash[22744]: cluster 2024-09-16T08:34:21.243881+0000 mgr.a (mgr.14373) 7669 : cluster [DBG] pgmap v5317: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:34:25.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:34:24 smithi157 bash[24585]: cluster 2024-09-16T08:34:23.246268+0000 mgr.a (mgr.14373) 7670 : cluster [DBG] pgmap v5318: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.4 KiB/s rd, 2 op/s 2024-09-16T08:34:25.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:34:24 smithi086 bash[24289]: cluster 2024-09-16T08:34:23.246268+0000 mgr.a (mgr.14373) 7670 : cluster [DBG] pgmap v5318: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.4 KiB/s rd, 2 op/s 2024-09-16T08:34:25.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:34:24 smithi047 bash[22744]: cluster 2024-09-16T08:34:23.246268+0000 mgr.a (mgr.14373) 7670 : cluster [DBG] pgmap v5318: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.4 KiB/s rd, 2 op/s 2024-09-16T08:34:26.589 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:34:26.590 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:34:26.590 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:34:27.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:34:26 smithi157 bash[24585]: cluster 2024-09-16T08:34:25.247111+0000 mgr.a (mgr.14373) 7671 : cluster [DBG] pgmap v5319: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-09-16T08:34:27.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:34:26 smithi086 bash[24289]: cluster 2024-09-16T08:34:25.247111+0000 mgr.a (mgr.14373) 7671 : cluster [DBG] pgmap v5319: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-09-16T08:34:27.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:34:26 smithi047 bash[22744]: cluster 2024-09-16T08:34:25.247111+0000 mgr.a (mgr.14373) 7671 : cluster [DBG] pgmap v5319: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-09-16T08:34:27.330 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:34:27.330 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:34:27.330 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:34:27.330 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:34:27.330 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:34:29.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:34:28 smithi157 bash[24585]: audit 2024-09-16T08:34:26.919165+0000 mgr.a (mgr.14373) 7672 : audit [DBG] from='client.172818 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:34:29.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:34:28 smithi157 bash[24585]: cluster 2024-09-16T08:34:27.248424+0000 mgr.a (mgr.14373) 7673 : cluster [DBG] pgmap v5320: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:34:29.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:34:28 smithi086 bash[24289]: audit 2024-09-16T08:34:26.919165+0000 mgr.a (mgr.14373) 7672 : audit [DBG] from='client.172818 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:34:29.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:34:28 smithi086 bash[24289]: cluster 2024-09-16T08:34:27.248424+0000 mgr.a (mgr.14373) 7673 : cluster [DBG] pgmap v5320: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:34:29.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:34:28 smithi047 bash[22744]: audit 2024-09-16T08:34:26.919165+0000 mgr.a (mgr.14373) 7672 : audit [DBG] from='client.172818 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:34:29.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:34:28 smithi047 bash[22744]: cluster 2024-09-16T08:34:27.248424+0000 mgr.a (mgr.14373) 7673 : cluster [DBG] pgmap v5320: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:34:31.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:34:30 smithi157 bash[24585]: cluster 2024-09-16T08:34:29.249172+0000 mgr.a (mgr.14373) 7674 : cluster [DBG] pgmap v5321: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T08:34:31.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:34:30 smithi086 bash[24289]: cluster 2024-09-16T08:34:29.249172+0000 mgr.a (mgr.14373) 7674 : cluster [DBG] pgmap v5321: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T08:34:31.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:34:30 smithi047 bash[22744]: cluster 2024-09-16T08:34:29.249172+0000 mgr.a (mgr.14373) 7674 : cluster [DBG] pgmap v5321: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T08:34:32.331 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:34:32.332 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:34:32.332 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:34:33.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:34:32 smithi157 bash[24585]: cluster 2024-09-16T08:34:31.249961+0000 mgr.a (mgr.14373) 7675 : cluster [DBG] pgmap v5322: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T08:34:33.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:34:32 smithi086 bash[24289]: cluster 2024-09-16T08:34:31.249961+0000 mgr.a (mgr.14373) 7675 : cluster [DBG] pgmap v5322: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T08:34:33.081 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:34:33.082 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:34:33.082 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:34:33.082 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:34:33.082 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:34:33.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:34:32 smithi047 bash[22744]: cluster 2024-09-16T08:34:31.249961+0000 mgr.a (mgr.14373) 7675 : cluster [DBG] pgmap v5322: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T08:34:34.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:34:33 smithi157 bash[24585]: audit 2024-09-16T08:34:32.667655+0000 mgr.a (mgr.14373) 7676 : audit [DBG] from='client.172893 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:34:34.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:34:33 smithi086 bash[24289]: audit 2024-09-16T08:34:32.667655+0000 mgr.a (mgr.14373) 7676 : audit [DBG] from='client.172893 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:34:34.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:34:33 smithi047 bash[22744]: audit 2024-09-16T08:34:32.667655+0000 mgr.a (mgr.14373) 7676 : audit [DBG] from='client.172893 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:34:35.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:34:34 smithi157 bash[24585]: cluster 2024-09-16T08:34:33.252775+0000 mgr.a (mgr.14373) 7677 : cluster [DBG] pgmap v5323: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:34:35.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:34:34 smithi086 bash[24289]: cluster 2024-09-16T08:34:33.252775+0000 mgr.a (mgr.14373) 7677 : cluster [DBG] pgmap v5323: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:34:35.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:34:34 smithi047 bash[22744]: cluster 2024-09-16T08:34:33.252775+0000 mgr.a (mgr.14373) 7677 : cluster [DBG] pgmap v5323: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:34:37.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:34:36 smithi157 bash[24585]: cluster 2024-09-16T08:34:35.253596+0000 mgr.a (mgr.14373) 7678 : cluster [DBG] pgmap v5324: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T08:34:37.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:34:36 smithi086 bash[24289]: cluster 2024-09-16T08:34:35.253596+0000 mgr.a (mgr.14373) 7678 : cluster [DBG] pgmap v5324: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T08:34:37.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:34:36 smithi047 bash[22744]: cluster 2024-09-16T08:34:35.253596+0000 mgr.a (mgr.14373) 7678 : cluster [DBG] pgmap v5324: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T08:34:38.083 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:34:38.084 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:34:38.084 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:34:38.855 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:34:38.855 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:34:38.856 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:34:38.856 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:34:38.856 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:34:39.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:34:38 smithi157 bash[24585]: cluster 2024-09-16T08:34:37.255615+0000 mgr.a (mgr.14373) 7679 : cluster [DBG] pgmap v5325: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-16T08:34:39.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:34:38 smithi086 bash[24289]: cluster 2024-09-16T08:34:37.255615+0000 mgr.a (mgr.14373) 7679 : cluster [DBG] pgmap v5325: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-16T08:34:39.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:34:38 smithi047 bash[22744]: cluster 2024-09-16T08:34:37.255615+0000 mgr.a (mgr.14373) 7679 : cluster [DBG] pgmap v5325: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-16T08:34:40.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:34:39 smithi157 bash[24585]: audit 2024-09-16T08:34:38.424110+0000 mgr.a (mgr.14373) 7680 : audit [DBG] from='client.172971 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:34:40.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:34:39 smithi086 bash[24289]: audit 2024-09-16T08:34:38.424110+0000 mgr.a (mgr.14373) 7680 : audit [DBG] from='client.172971 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:34:40.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:34:39 smithi047 bash[22744]: audit 2024-09-16T08:34:38.424110+0000 mgr.a (mgr.14373) 7680 : audit [DBG] from='client.172971 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:34:41.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:34:40 smithi157 bash[24585]: cluster 2024-09-16T08:34:39.256563+0000 mgr.a (mgr.14373) 7681 : cluster [DBG] pgmap v5326: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:34:41.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:34:40 smithi086 bash[24289]: cluster 2024-09-16T08:34:39.256563+0000 mgr.a (mgr.14373) 7681 : cluster [DBG] pgmap v5326: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:34:41.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:34:40 smithi047 bash[22744]: cluster 2024-09-16T08:34:39.256563+0000 mgr.a (mgr.14373) 7681 : cluster [DBG] pgmap v5326: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:34:43.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:34:42 smithi157 bash[24585]: cluster 2024-09-16T08:34:41.257355+0000 mgr.a (mgr.14373) 7682 : cluster [DBG] pgmap v5327: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:34:43.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:34:42 smithi086 bash[24289]: cluster 2024-09-16T08:34:41.257355+0000 mgr.a (mgr.14373) 7682 : cluster [DBG] pgmap v5327: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:34:43.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:34:42 smithi047 bash[22744]: cluster 2024-09-16T08:34:41.257355+0000 mgr.a (mgr.14373) 7682 : cluster [DBG] pgmap v5327: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:34:43.857 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:34:43.858 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:34:43.858 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:34:44.615 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:34:44.616 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:34:44.616 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:34:44.616 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:34:44.616 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:34:45.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:34:44 smithi157 bash[24585]: cluster 2024-09-16T08:34:43.259592+0000 mgr.a (mgr.14373) 7683 : cluster [DBG] pgmap v5328: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:34:45.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:34:44 smithi086 bash[24289]: cluster 2024-09-16T08:34:43.259592+0000 mgr.a (mgr.14373) 7683 : cluster [DBG] pgmap v5328: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:34:45.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:34:44 smithi047 bash[22744]: cluster 2024-09-16T08:34:43.259592+0000 mgr.a (mgr.14373) 7683 : cluster [DBG] pgmap v5328: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:34:46.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:34:45 smithi157 bash[24585]: audit 2024-09-16T08:34:44.195491+0000 mgr.a (mgr.14373) 7684 : audit [DBG] from='client.173049 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:34:46.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:34:45 smithi086 bash[24289]: audit 2024-09-16T08:34:44.195491+0000 mgr.a (mgr.14373) 7684 : audit [DBG] from='client.173049 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:34:46.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:34:45 smithi047 bash[22744]: audit 2024-09-16T08:34:44.195491+0000 mgr.a (mgr.14373) 7684 : audit [DBG] from='client.173049 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:34:47.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:34:46 smithi157 bash[24585]: cluster 2024-09-16T08:34:45.260558+0000 mgr.a (mgr.14373) 7685 : cluster [DBG] pgmap v5329: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:34:47.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:34:46 smithi086 bash[24289]: cluster 2024-09-16T08:34:45.260558+0000 mgr.a (mgr.14373) 7685 : cluster [DBG] pgmap v5329: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:34:47.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:34:46 smithi047 bash[22744]: cluster 2024-09-16T08:34:45.260558+0000 mgr.a (mgr.14373) 7685 : cluster [DBG] pgmap v5329: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:34:49.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:34:48 smithi157 bash[24585]: cluster 2024-09-16T08:34:47.262762+0000 mgr.a (mgr.14373) 7686 : cluster [DBG] pgmap v5330: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:34:49.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:34:48 smithi086 bash[24289]: cluster 2024-09-16T08:34:47.262762+0000 mgr.a (mgr.14373) 7686 : cluster [DBG] pgmap v5330: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:34:49.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:34:48 smithi047 bash[22744]: cluster 2024-09-16T08:34:47.262762+0000 mgr.a (mgr.14373) 7686 : cluster [DBG] pgmap v5330: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:34:49.617 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:34:49.618 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:34:49.618 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:34:50.376 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:34:50.377 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:34:50.377 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:34:50.377 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:34:50.377 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:34:51.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:34:50 smithi157 bash[24585]: cluster 2024-09-16T08:34:49.263507+0000 mgr.a (mgr.14373) 7687 : cluster [DBG] pgmap v5331: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:34:51.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:34:50 smithi086 bash[24289]: cluster 2024-09-16T08:34:49.263507+0000 mgr.a (mgr.14373) 7687 : cluster [DBG] pgmap v5331: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:34:51.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:34:50 smithi047 bash[22744]: cluster 2024-09-16T08:34:49.263507+0000 mgr.a (mgr.14373) 7687 : cluster [DBG] pgmap v5331: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:34:52.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:34:51 smithi157 bash[24585]: audit 2024-09-16T08:34:49.952176+0000 mgr.a (mgr.14373) 7688 : audit [DBG] from='client.173124 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:34:52.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:34:51 smithi086 bash[24289]: audit 2024-09-16T08:34:49.952176+0000 mgr.a (mgr.14373) 7688 : audit [DBG] from='client.173124 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:34:52.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:34:51 smithi047 bash[22744]: audit 2024-09-16T08:34:49.952176+0000 mgr.a (mgr.14373) 7688 : audit [DBG] from='client.173124 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:34:53.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:34:52 smithi157 bash[24585]: cluster 2024-09-16T08:34:51.264586+0000 mgr.a (mgr.14373) 7689 : cluster [DBG] pgmap v5332: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:34:53.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:34:52 smithi157 bash[24585]: audit 2024-09-16T08:34:51.711361+0000 mon.b (mon.2) 726 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T08:34:53.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:34:52 smithi157 bash[24585]: audit 2024-09-16T08:34:52.554236+0000 mon.b (mon.2) 727 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T08:34:53.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:34:52 smithi157 bash[24585]: audit 2024-09-16T08:34:52.556096+0000 mon.b (mon.2) 728 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T08:34:53.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:34:52 smithi157 bash[24585]: audit 2024-09-16T08:34:52.568192+0000 mon.a (mon.0) 1023 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:34:53.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:34:52 smithi157 bash[24585]: audit 2024-09-16T08:34:52.569579+0000 mon.b (mon.2) 729 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:34:53.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:34:52 smithi086 bash[24289]: cluster 2024-09-16T08:34:51.264586+0000 mgr.a (mgr.14373) 7689 : cluster [DBG] pgmap v5332: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:34:53.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:34:52 smithi086 bash[24289]: audit 2024-09-16T08:34:51.711361+0000 mon.b (mon.2) 726 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T08:34:53.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:34:52 smithi086 bash[24289]: audit 2024-09-16T08:34:52.554236+0000 mon.b (mon.2) 727 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T08:34:53.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:34:52 smithi086 bash[24289]: audit 2024-09-16T08:34:52.556096+0000 mon.b (mon.2) 728 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T08:34:53.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:34:52 smithi086 bash[24289]: audit 2024-09-16T08:34:52.568192+0000 mon.a (mon.0) 1023 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:34:53.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:34:52 smithi086 bash[24289]: audit 2024-09-16T08:34:52.569579+0000 mon.b (mon.2) 729 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:34:53.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:34:52 smithi047 bash[22744]: cluster 2024-09-16T08:34:51.264586+0000 mgr.a (mgr.14373) 7689 : cluster [DBG] pgmap v5332: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:34:53.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:34:52 smithi047 bash[22744]: audit 2024-09-16T08:34:51.711361+0000 mon.b (mon.2) 726 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T08:34:53.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:34:52 smithi047 bash[22744]: audit 2024-09-16T08:34:52.554236+0000 mon.b (mon.2) 727 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T08:34:53.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:34:52 smithi047 bash[22744]: audit 2024-09-16T08:34:52.556096+0000 mon.b (mon.2) 728 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T08:34:53.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:34:52 smithi047 bash[22744]: audit 2024-09-16T08:34:52.568192+0000 mon.a (mon.0) 1023 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:34:53.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:34:52 smithi047 bash[22744]: audit 2024-09-16T08:34:52.569579+0000 mon.b (mon.2) 729 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:34:53.588 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 08:34:53 smithi047 bash[22994]: debug 2024-09-16T08:34:53.294+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T08:34:53.588 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 08:34:53 smithi047 bash[22994]: debug 2024-09-16T08:34:53.294+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T08:34:54.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:34:53 smithi157 bash[24585]: audit 2024-09-16T08:34:52.573821+0000 mgr.a (mgr.14373) 7690 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:34:54.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:34:53 smithi086 bash[24289]: audit 2024-09-16T08:34:52.573821+0000 mgr.a (mgr.14373) 7690 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:34:54.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:34:53 smithi047 bash[22744]: audit 2024-09-16T08:34:52.573821+0000 mgr.a (mgr.14373) 7690 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:34:55.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:34:54 smithi157 bash[24585]: cluster 2024-09-16T08:34:53.266470+0000 mgr.a (mgr.14373) 7691 : cluster [DBG] pgmap v5333: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:34:55.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:34:54 smithi157 bash[24585]: audit 2024-09-16T08:34:53.295685+0000 mgr.a (mgr.14373) 7692 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T08:34:55.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:34:54 smithi157 bash[24585]: cephadm 2024-09-16T08:34:53.297737+0000 mgr.a (mgr.14373) 7693 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T08:34:55.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:34:54 smithi086 bash[24289]: cluster 2024-09-16T08:34:53.266470+0000 mgr.a (mgr.14373) 7691 : cluster [DBG] pgmap v5333: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:34:55.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:34:54 smithi086 bash[24289]: audit 2024-09-16T08:34:53.295685+0000 mgr.a (mgr.14373) 7692 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T08:34:55.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:34:54 smithi086 bash[24289]: cephadm 2024-09-16T08:34:53.297737+0000 mgr.a (mgr.14373) 7693 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T08:34:55.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:34:54 smithi047 bash[22744]: cluster 2024-09-16T08:34:53.266470+0000 mgr.a (mgr.14373) 7691 : cluster [DBG] pgmap v5333: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:34:55.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:34:54 smithi047 bash[22744]: audit 2024-09-16T08:34:53.295685+0000 mgr.a (mgr.14373) 7692 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T08:34:55.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:34:54 smithi047 bash[22744]: cephadm 2024-09-16T08:34:53.297737+0000 mgr.a (mgr.14373) 7693 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T08:34:55.378 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:34:55.379 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:34:55.379 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:34:56.142 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:34:56.143 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:34:56.143 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:34:56.143 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:34:56.143 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:34:57.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:34:56 smithi157 bash[24585]: cluster 2024-09-16T08:34:55.267209+0000 mgr.a (mgr.14373) 7694 : cluster [DBG] pgmap v5334: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:34:57.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:34:56 smithi157 bash[24585]: audit 2024-09-16T08:34:55.716749+0000 mgr.a (mgr.14373) 7695 : audit [DBG] from='client.173310 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:34:57.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:34:56 smithi086 bash[24289]: cluster 2024-09-16T08:34:55.267209+0000 mgr.a (mgr.14373) 7694 : cluster [DBG] pgmap v5334: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:34:57.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:34:56 smithi086 bash[24289]: audit 2024-09-16T08:34:55.716749+0000 mgr.a (mgr.14373) 7695 : audit [DBG] from='client.173310 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:34:57.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:34:56 smithi047 bash[22744]: cluster 2024-09-16T08:34:55.267209+0000 mgr.a (mgr.14373) 7694 : cluster [DBG] pgmap v5334: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:34:57.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:34:56 smithi047 bash[22744]: audit 2024-09-16T08:34:55.716749+0000 mgr.a (mgr.14373) 7695 : audit [DBG] from='client.173310 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:34:59.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:34:58 smithi157 bash[24585]: cluster 2024-09-16T08:34:57.269513+0000 mgr.a (mgr.14373) 7696 : cluster [DBG] pgmap v5335: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:34:59.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:34:58 smithi086 bash[24289]: cluster 2024-09-16T08:34:57.269513+0000 mgr.a (mgr.14373) 7696 : cluster [DBG] pgmap v5335: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:34:59.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:34:58 smithi047 bash[22744]: cluster 2024-09-16T08:34:57.269513+0000 mgr.a (mgr.14373) 7696 : cluster [DBG] pgmap v5335: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:35:01.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:35:00 smithi157 bash[24585]: cluster 2024-09-16T08:34:59.270290+0000 mgr.a (mgr.14373) 7697 : cluster [DBG] pgmap v5336: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:35:01.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:35:00 smithi086 bash[24289]: cluster 2024-09-16T08:34:59.270290+0000 mgr.a (mgr.14373) 7697 : cluster [DBG] pgmap v5336: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:35:01.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:35:00 smithi047 bash[22744]: cluster 2024-09-16T08:34:59.270290+0000 mgr.a (mgr.14373) 7697 : cluster [DBG] pgmap v5336: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:35:01.144 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:35:01.145 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:35:01.145 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:35:01.893 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:35:01.893 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:35:01.893 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:35:01.894 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:35:01.894 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:35:03.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:35:02 smithi157 bash[24585]: cluster 2024-09-16T08:35:01.270734+0000 mgr.a (mgr.14373) 7698 : cluster [DBG] pgmap v5337: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:35:03.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:35:02 smithi157 bash[24585]: audit 2024-09-16T08:35:01.477774+0000 mgr.a (mgr.14373) 7699 : audit [DBG] from='client.173388 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:35:03.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:35:02 smithi086 bash[24289]: cluster 2024-09-16T08:35:01.270734+0000 mgr.a (mgr.14373) 7698 : cluster [DBG] pgmap v5337: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:35:03.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:35:02 smithi086 bash[24289]: audit 2024-09-16T08:35:01.477774+0000 mgr.a (mgr.14373) 7699 : audit [DBG] from='client.173388 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:35:03.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:35:02 smithi047 bash[22744]: cluster 2024-09-16T08:35:01.270734+0000 mgr.a (mgr.14373) 7698 : cluster [DBG] pgmap v5337: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:35:03.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:35:02 smithi047 bash[22744]: audit 2024-09-16T08:35:01.477774+0000 mgr.a (mgr.14373) 7699 : audit [DBG] from='client.173388 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:35:05.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:35:04 smithi157 bash[24585]: cluster 2024-09-16T08:35:03.273367+0000 mgr.a (mgr.14373) 7700 : cluster [DBG] pgmap v5338: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:35:05.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:35:04 smithi086 bash[24289]: cluster 2024-09-16T08:35:03.273367+0000 mgr.a (mgr.14373) 7700 : cluster [DBG] pgmap v5338: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:35:05.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:35:04 smithi047 bash[22744]: cluster 2024-09-16T08:35:03.273367+0000 mgr.a (mgr.14373) 7700 : cluster [DBG] pgmap v5338: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:35:06.894 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:35:06.895 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:35:06.895 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:35:07.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:35:06 smithi157 bash[24585]: cluster 2024-09-16T08:35:05.274174+0000 mgr.a (mgr.14373) 7701 : cluster [DBG] pgmap v5339: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T08:35:07.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:35:06 smithi086 bash[24289]: cluster 2024-09-16T08:35:05.274174+0000 mgr.a (mgr.14373) 7701 : cluster [DBG] pgmap v5339: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T08:35:07.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:35:06 smithi047 bash[22744]: cluster 2024-09-16T08:35:05.274174+0000 mgr.a (mgr.14373) 7701 : cluster [DBG] pgmap v5339: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T08:35:07.677 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:35:07.677 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:35:07.677 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:35:07.677 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:35:07.677 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:35:09.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:35:08 smithi157 bash[24585]: audit 2024-09-16T08:35:07.233643+0000 mgr.a (mgr.14373) 7702 : audit [DBG] from='client.173463 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:35:09.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:35:08 smithi157 bash[24585]: cluster 2024-09-16T08:35:07.275682+0000 mgr.a (mgr.14373) 7703 : cluster [DBG] pgmap v5340: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:35:09.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:35:08 smithi086 bash[24289]: audit 2024-09-16T08:35:07.233643+0000 mgr.a (mgr.14373) 7702 : audit [DBG] from='client.173463 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:35:09.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:35:08 smithi086 bash[24289]: cluster 2024-09-16T08:35:07.275682+0000 mgr.a (mgr.14373) 7703 : cluster [DBG] pgmap v5340: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:35:09.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:35:08 smithi047 bash[22744]: audit 2024-09-16T08:35:07.233643+0000 mgr.a (mgr.14373) 7702 : audit [DBG] from='client.173463 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:35:09.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:35:08 smithi047 bash[22744]: cluster 2024-09-16T08:35:07.275682+0000 mgr.a (mgr.14373) 7703 : cluster [DBG] pgmap v5340: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:35:10.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:35:09 smithi157 bash[24585]: cluster 2024-09-16T08:35:09.276569+0000 mgr.a (mgr.14373) 7704 : cluster [DBG] pgmap v5341: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T08:35:10.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:35:09 smithi086 bash[24289]: cluster 2024-09-16T08:35:09.276569+0000 mgr.a (mgr.14373) 7704 : cluster [DBG] pgmap v5341: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T08:35:10.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:35:09 smithi047 bash[22744]: cluster 2024-09-16T08:35:09.276569+0000 mgr.a (mgr.14373) 7704 : cluster [DBG] pgmap v5341: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T08:35:12.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:35:12 smithi047 bash[22744]: cluster 2024-09-16T08:35:11.277357+0000 mgr.a (mgr.14373) 7705 : cluster [DBG] pgmap v5342: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T08:35:12.678 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:35:12.679 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:35:12.679 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:35:12.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:35:12 smithi157 bash[24585]: cluster 2024-09-16T08:35:11.277357+0000 mgr.a (mgr.14373) 7705 : cluster [DBG] pgmap v5342: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T08:35:12.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:35:12 smithi086 bash[24289]: cluster 2024-09-16T08:35:11.277357+0000 mgr.a (mgr.14373) 7705 : cluster [DBG] pgmap v5342: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T08:35:13.437 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:35:13.437 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:35:13.438 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:35:13.438 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:35:13.438 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:35:14.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:35:14 smithi047 bash[22744]: audit 2024-09-16T08:35:13.015064+0000 mgr.a (mgr.14373) 7706 : audit [DBG] from='client.173538 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:35:14.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:35:14 smithi047 bash[22744]: cluster 2024-09-16T08:35:13.279013+0000 mgr.a (mgr.14373) 7707 : cluster [DBG] pgmap v5343: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:35:14.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:35:14 smithi157 bash[24585]: audit 2024-09-16T08:35:13.015064+0000 mgr.a (mgr.14373) 7706 : audit [DBG] from='client.173538 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:35:14.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:35:14 smithi157 bash[24585]: cluster 2024-09-16T08:35:13.279013+0000 mgr.a (mgr.14373) 7707 : cluster [DBG] pgmap v5343: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:35:14.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:35:14 smithi086 bash[24289]: audit 2024-09-16T08:35:13.015064+0000 mgr.a (mgr.14373) 7706 : audit [DBG] from='client.173538 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:35:14.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:35:14 smithi086 bash[24289]: cluster 2024-09-16T08:35:13.279013+0000 mgr.a (mgr.14373) 7707 : cluster [DBG] pgmap v5343: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:35:16.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:35:16 smithi157 bash[24585]: cluster 2024-09-16T08:35:15.279860+0000 mgr.a (mgr.14373) 7708 : cluster [DBG] pgmap v5344: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:35:16.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:35:16 smithi086 bash[24289]: cluster 2024-09-16T08:35:15.279860+0000 mgr.a (mgr.14373) 7708 : cluster [DBG] pgmap v5344: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:35:16.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:35:16 smithi047 bash[22744]: cluster 2024-09-16T08:35:15.279860+0000 mgr.a (mgr.14373) 7708 : cluster [DBG] pgmap v5344: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:35:18.439 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:35:18.439 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:35:18.440 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:35:18.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:35:18 smithi157 bash[24585]: cluster 2024-09-16T08:35:17.282017+0000 mgr.a (mgr.14373) 7709 : cluster [DBG] pgmap v5345: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:35:18.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:35:18 smithi086 bash[24289]: cluster 2024-09-16T08:35:17.282017+0000 mgr.a (mgr.14373) 7709 : cluster [DBG] pgmap v5345: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:35:18.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:35:18 smithi047 bash[22744]: cluster 2024-09-16T08:35:17.282017+0000 mgr.a (mgr.14373) 7709 : cluster [DBG] pgmap v5345: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:35:19.197 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:35:19.197 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:35:19.197 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:35:19.197 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:35:19.197 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:35:20.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:35:20 smithi157 bash[24585]: audit 2024-09-16T08:35:18.774518+0000 mgr.a (mgr.14373) 7710 : audit [DBG] from='client.173616 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:35:20.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:35:20 smithi157 bash[24585]: cluster 2024-09-16T08:35:19.282873+0000 mgr.a (mgr.14373) 7711 : cluster [DBG] pgmap v5346: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:35:20.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:35:20 smithi086 bash[24289]: audit 2024-09-16T08:35:18.774518+0000 mgr.a (mgr.14373) 7710 : audit [DBG] from='client.173616 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:35:20.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:35:20 smithi086 bash[24289]: cluster 2024-09-16T08:35:19.282873+0000 mgr.a (mgr.14373) 7711 : cluster [DBG] pgmap v5346: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:35:20.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:35:20 smithi047 bash[22744]: audit 2024-09-16T08:35:18.774518+0000 mgr.a (mgr.14373) 7710 : audit [DBG] from='client.173616 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:35:20.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:35:20 smithi047 bash[22744]: cluster 2024-09-16T08:35:19.282873+0000 mgr.a (mgr.14373) 7711 : cluster [DBG] pgmap v5346: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:35:22.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:35:22 smithi157 bash[24585]: cluster 2024-09-16T08:35:21.283582+0000 mgr.a (mgr.14373) 7712 : cluster [DBG] pgmap v5347: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:35:22.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:35:22 smithi086 bash[24289]: cluster 2024-09-16T08:35:21.283582+0000 mgr.a (mgr.14373) 7712 : cluster [DBG] pgmap v5347: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:35:22.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:35:22 smithi047 bash[22744]: cluster 2024-09-16T08:35:21.283582+0000 mgr.a (mgr.14373) 7712 : cluster [DBG] pgmap v5347: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:35:24.198 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:35:24.199 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:35:24.199 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:35:24.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:35:24 smithi157 bash[24585]: cluster 2024-09-16T08:35:23.285794+0000 mgr.a (mgr.14373) 7713 : cluster [DBG] pgmap v5348: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:35:24.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:35:24 smithi086 bash[24289]: cluster 2024-09-16T08:35:23.285794+0000 mgr.a (mgr.14373) 7713 : cluster [DBG] pgmap v5348: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:35:24.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:35:24 smithi047 bash[22744]: cluster 2024-09-16T08:35:23.285794+0000 mgr.a (mgr.14373) 7713 : cluster [DBG] pgmap v5348: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:35:24.974 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:35:24.974 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:35:24.974 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:35:24.974 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:35:24.974 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:35:25.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:35:25 smithi157 bash[24585]: audit 2024-09-16T08:35:24.542754+0000 mgr.a (mgr.14373) 7714 : audit [DBG] from='client.173691 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:35:25.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:35:25 smithi086 bash[24289]: audit 2024-09-16T08:35:24.542754+0000 mgr.a (mgr.14373) 7714 : audit [DBG] from='client.173691 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:35:25.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:35:25 smithi047 bash[22744]: audit 2024-09-16T08:35:24.542754+0000 mgr.a (mgr.14373) 7714 : audit [DBG] from='client.173691 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:35:26.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:35:26 smithi157 bash[24585]: cluster 2024-09-16T08:35:25.286767+0000 mgr.a (mgr.14373) 7715 : cluster [DBG] pgmap v5349: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:35:26.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:35:26 smithi086 bash[24289]: cluster 2024-09-16T08:35:25.286767+0000 mgr.a (mgr.14373) 7715 : cluster [DBG] pgmap v5349: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:35:26.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:35:26 smithi047 bash[22744]: cluster 2024-09-16T08:35:25.286767+0000 mgr.a (mgr.14373) 7715 : cluster [DBG] pgmap v5349: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:35:28.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:35:28 smithi157 bash[24585]: cluster 2024-09-16T08:35:27.288936+0000 mgr.a (mgr.14373) 7716 : cluster [DBG] pgmap v5350: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:35:28.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:35:28 smithi086 bash[24289]: cluster 2024-09-16T08:35:27.288936+0000 mgr.a (mgr.14373) 7716 : cluster [DBG] pgmap v5350: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:35:28.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:35:28 smithi047 bash[22744]: cluster 2024-09-16T08:35:27.288936+0000 mgr.a (mgr.14373) 7716 : cluster [DBG] pgmap v5350: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:35:29.975 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:35:29.976 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:35:29.976 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:35:30.764 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:35:30.764 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:35:30.764 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:35:30.764 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:35:30.764 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:35:30.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:35:30 smithi157 bash[24585]: cluster 2024-09-16T08:35:29.289683+0000 mgr.a (mgr.14373) 7717 : cluster [DBG] pgmap v5351: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:35:30.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:35:30 smithi086 bash[24289]: cluster 2024-09-16T08:35:29.289683+0000 mgr.a (mgr.14373) 7717 : cluster [DBG] pgmap v5351: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:35:30.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:35:30 smithi047 bash[22744]: cluster 2024-09-16T08:35:29.289683+0000 mgr.a (mgr.14373) 7717 : cluster [DBG] pgmap v5351: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:35:31.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:35:31 smithi157 bash[24585]: audit 2024-09-16T08:35:30.319546+0000 mgr.a (mgr.14373) 7718 : audit [DBG] from='client.173766 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:35:31.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:35:31 smithi086 bash[24289]: audit 2024-09-16T08:35:30.319546+0000 mgr.a (mgr.14373) 7718 : audit [DBG] from='client.173766 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:35:31.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:35:31 smithi047 bash[22744]: audit 2024-09-16T08:35:30.319546+0000 mgr.a (mgr.14373) 7718 : audit [DBG] from='client.173766 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:35:32.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:35:32 smithi157 bash[24585]: cluster 2024-09-16T08:35:31.290744+0000 mgr.a (mgr.14373) 7719 : cluster [DBG] pgmap v5352: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:35:32.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:35:32 smithi086 bash[24289]: cluster 2024-09-16T08:35:31.290744+0000 mgr.a (mgr.14373) 7719 : cluster [DBG] pgmap v5352: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:35:32.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:35:32 smithi047 bash[22744]: cluster 2024-09-16T08:35:31.290744+0000 mgr.a (mgr.14373) 7719 : cluster [DBG] pgmap v5352: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:35:34.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:35:34 smithi157 bash[24585]: cluster 2024-09-16T08:35:33.293003+0000 mgr.a (mgr.14373) 7720 : cluster [DBG] pgmap v5353: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:35:34.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:35:34 smithi086 bash[24289]: cluster 2024-09-16T08:35:33.293003+0000 mgr.a (mgr.14373) 7720 : cluster [DBG] pgmap v5353: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:35:34.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:35:34 smithi047 bash[22744]: cluster 2024-09-16T08:35:33.293003+0000 mgr.a (mgr.14373) 7720 : cluster [DBG] pgmap v5353: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:35:35.766 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:35:35.766 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:35:35.766 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:35:36.550 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:35:36.550 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:35:36.550 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:35:36.550 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:35:36.550 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:35:36.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:35:36 smithi157 bash[24585]: cluster 2024-09-16T08:35:35.293756+0000 mgr.a (mgr.14373) 7721 : cluster [DBG] pgmap v5354: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:35:36.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:35:36 smithi086 bash[24289]: cluster 2024-09-16T08:35:35.293756+0000 mgr.a (mgr.14373) 7721 : cluster [DBG] pgmap v5354: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:35:36.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:35:36 smithi047 bash[22744]: cluster 2024-09-16T08:35:35.293756+0000 mgr.a (mgr.14373) 7721 : cluster [DBG] pgmap v5354: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:35:37.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:35:37 smithi157 bash[24585]: audit 2024-09-16T08:35:36.105813+0000 mgr.a (mgr.14373) 7722 : audit [DBG] from='client.173844 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:35:37.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:35:37 smithi086 bash[24289]: audit 2024-09-16T08:35:36.105813+0000 mgr.a (mgr.14373) 7722 : audit [DBG] from='client.173844 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:35:37.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:35:37 smithi047 bash[22744]: audit 2024-09-16T08:35:36.105813+0000 mgr.a (mgr.14373) 7722 : audit [DBG] from='client.173844 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:35:38.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:35:38 smithi157 bash[24585]: cluster 2024-09-16T08:35:37.296034+0000 mgr.a (mgr.14373) 7723 : cluster [DBG] pgmap v5355: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:35:38.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:35:38 smithi086 bash[24289]: cluster 2024-09-16T08:35:37.296034+0000 mgr.a (mgr.14373) 7723 : cluster [DBG] pgmap v5355: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:35:38.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:35:38 smithi047 bash[22744]: cluster 2024-09-16T08:35:37.296034+0000 mgr.a (mgr.14373) 7723 : cluster [DBG] pgmap v5355: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:35:40.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:35:40 smithi157 bash[24585]: cluster 2024-09-16T08:35:39.296847+0000 mgr.a (mgr.14373) 7724 : cluster [DBG] pgmap v5356: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:35:40.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:35:40 smithi086 bash[24289]: cluster 2024-09-16T08:35:39.296847+0000 mgr.a (mgr.14373) 7724 : cluster [DBG] pgmap v5356: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:35:40.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:35:40 smithi047 bash[22744]: cluster 2024-09-16T08:35:39.296847+0000 mgr.a (mgr.14373) 7724 : cluster [DBG] pgmap v5356: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:35:41.551 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:35:41.552 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:35:41.552 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:35:42.293 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:35:42.294 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:35:42.294 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:35:42.294 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:35:42.294 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:35:42.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:35:42 smithi157 bash[24585]: cluster 2024-09-16T08:35:41.297608+0000 mgr.a (mgr.14373) 7725 : cluster [DBG] pgmap v5357: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:35:42.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:35:42 smithi086 bash[24289]: cluster 2024-09-16T08:35:41.297608+0000 mgr.a (mgr.14373) 7725 : cluster [DBG] pgmap v5357: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:35:42.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:35:42 smithi047 bash[22744]: cluster 2024-09-16T08:35:41.297608+0000 mgr.a (mgr.14373) 7725 : cluster [DBG] pgmap v5357: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:35:43.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:35:43 smithi157 bash[24585]: audit 2024-09-16T08:35:41.885972+0000 mgr.a (mgr.14373) 7726 : audit [DBG] from='client.173916 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:35:43.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:35:43 smithi086 bash[24289]: audit 2024-09-16T08:35:41.885972+0000 mgr.a (mgr.14373) 7726 : audit [DBG] from='client.173916 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:35:43.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:35:43 smithi047 bash[22744]: audit 2024-09-16T08:35:41.885972+0000 mgr.a (mgr.14373) 7726 : audit [DBG] from='client.173916 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:35:44.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:35:44 smithi157 bash[24585]: cluster 2024-09-16T08:35:43.300309+0000 mgr.a (mgr.14373) 7727 : cluster [DBG] pgmap v5358: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:35:44.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:35:44 smithi086 bash[24289]: cluster 2024-09-16T08:35:43.300309+0000 mgr.a (mgr.14373) 7727 : cluster [DBG] pgmap v5358: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:35:44.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:35:44 smithi047 bash[22744]: cluster 2024-09-16T08:35:43.300309+0000 mgr.a (mgr.14373) 7727 : cluster [DBG] pgmap v5358: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:35:46.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:35:46 smithi157 bash[24585]: cluster 2024-09-16T08:35:45.301071+0000 mgr.a (mgr.14373) 7728 : cluster [DBG] pgmap v5359: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:35:46.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:35:46 smithi086 bash[24289]: cluster 2024-09-16T08:35:45.301071+0000 mgr.a (mgr.14373) 7728 : cluster [DBG] pgmap v5359: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:35:46.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:35:46 smithi047 bash[22744]: cluster 2024-09-16T08:35:45.301071+0000 mgr.a (mgr.14373) 7728 : cluster [DBG] pgmap v5359: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:35:47.295 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:35:47.296 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:35:47.296 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:35:48.046 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:35:48.046 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:35:48.046 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:35:48.046 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:35:48.046 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:35:48.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:35:48 smithi157 bash[24585]: cluster 2024-09-16T08:35:47.302398+0000 mgr.a (mgr.14373) 7729 : cluster [DBG] pgmap v5360: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:35:48.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:35:48 smithi157 bash[24585]: audit 2024-09-16T08:35:47.625652+0000 mgr.a (mgr.14373) 7730 : audit [DBG] from='client.173994 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:35:48.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:35:48 smithi086 bash[24289]: cluster 2024-09-16T08:35:47.302398+0000 mgr.a (mgr.14373) 7729 : cluster [DBG] pgmap v5360: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:35:48.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:35:48 smithi086 bash[24289]: audit 2024-09-16T08:35:47.625652+0000 mgr.a (mgr.14373) 7730 : audit [DBG] from='client.173994 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:35:48.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:35:48 smithi047 bash[22744]: cluster 2024-09-16T08:35:47.302398+0000 mgr.a (mgr.14373) 7729 : cluster [DBG] pgmap v5360: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:35:48.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:35:48 smithi047 bash[22744]: audit 2024-09-16T08:35:47.625652+0000 mgr.a (mgr.14373) 7730 : audit [DBG] from='client.173994 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:35:50.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:35:50 smithi157 bash[24585]: cluster 2024-09-16T08:35:49.303250+0000 mgr.a (mgr.14373) 7731 : cluster [DBG] pgmap v5361: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:35:50.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:35:50 smithi086 bash[24289]: cluster 2024-09-16T08:35:49.303250+0000 mgr.a (mgr.14373) 7731 : cluster [DBG] pgmap v5361: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:35:50.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:35:50 smithi047 bash[22744]: cluster 2024-09-16T08:35:49.303250+0000 mgr.a (mgr.14373) 7731 : cluster [DBG] pgmap v5361: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:35:52.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:35:52 smithi157 bash[24585]: cluster 2024-09-16T08:35:51.304010+0000 mgr.a (mgr.14373) 7732 : cluster [DBG] pgmap v5362: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T08:35:52.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:35:52 smithi086 bash[24289]: cluster 2024-09-16T08:35:51.304010+0000 mgr.a (mgr.14373) 7732 : cluster [DBG] pgmap v5362: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T08:35:52.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:35:52 smithi047 bash[22744]: cluster 2024-09-16T08:35:51.304010+0000 mgr.a (mgr.14373) 7732 : cluster [DBG] pgmap v5362: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T08:35:53.047 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:35:53.048 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:35:53.048 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:35:53.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:35:53 smithi157 bash[24585]: audit 2024-09-16T08:35:53.345455+0000 mon.b (mon.2) 730 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T08:35:53.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:35:53 smithi086 bash[24289]: audit 2024-09-16T08:35:53.345455+0000 mon.b (mon.2) 730 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T08:35:53.830 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:35:53.830 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:35:53.830 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:35:53.831 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:35:53.831 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:35:53.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:35:53 smithi047 bash[22744]: audit 2024-09-16T08:35:53.345455+0000 mon.b (mon.2) 730 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T08:35:54.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:35:54 smithi157 bash[24585]: cluster 2024-09-16T08:35:53.306171+0000 mgr.a (mgr.14373) 7733 : cluster [DBG] pgmap v5363: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:35:54.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:35:54 smithi157 bash[24585]: audit 2024-09-16T08:35:53.385466+0000 mgr.a (mgr.14373) 7734 : audit [DBG] from='client.174072 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:35:54.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:35:54 smithi157 bash[24585]: audit 2024-09-16T08:35:54.201170+0000 mon.b (mon.2) 731 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T08:35:54.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:35:54 smithi157 bash[24585]: audit 2024-09-16T08:35:54.203093+0000 mon.b (mon.2) 732 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T08:35:54.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:35:54 smithi157 bash[24585]: audit 2024-09-16T08:35:54.215318+0000 mon.a (mon.0) 1024 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:35:54.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:35:54 smithi157 bash[24585]: audit 2024-09-16T08:35:54.218939+0000 mon.b (mon.2) 733 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:35:54.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:35:54 smithi086 bash[24289]: cluster 2024-09-16T08:35:53.306171+0000 mgr.a (mgr.14373) 7733 : cluster [DBG] pgmap v5363: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:35:54.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:35:54 smithi086 bash[24289]: audit 2024-09-16T08:35:53.385466+0000 mgr.a (mgr.14373) 7734 : audit [DBG] from='client.174072 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:35:54.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:35:54 smithi086 bash[24289]: audit 2024-09-16T08:35:54.201170+0000 mon.b (mon.2) 731 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T08:35:54.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:35:54 smithi086 bash[24289]: audit 2024-09-16T08:35:54.203093+0000 mon.b (mon.2) 732 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T08:35:54.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:35:54 smithi086 bash[24289]: audit 2024-09-16T08:35:54.215318+0000 mon.a (mon.0) 1024 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:35:54.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:35:54 smithi086 bash[24289]: audit 2024-09-16T08:35:54.218939+0000 mon.b (mon.2) 733 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:35:54.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:35:54 smithi047 bash[22744]: cluster 2024-09-16T08:35:53.306171+0000 mgr.a (mgr.14373) 7733 : cluster [DBG] pgmap v5363: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:35:54.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:35:54 smithi047 bash[22744]: audit 2024-09-16T08:35:53.385466+0000 mgr.a (mgr.14373) 7734 : audit [DBG] from='client.174072 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:35:54.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:35:54 smithi047 bash[22744]: audit 2024-09-16T08:35:54.201170+0000 mon.b (mon.2) 731 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T08:35:54.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:35:54 smithi047 bash[22744]: audit 2024-09-16T08:35:54.203093+0000 mon.b (mon.2) 732 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T08:35:54.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:35:54 smithi047 bash[22744]: audit 2024-09-16T08:35:54.215318+0000 mon.a (mon.0) 1024 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:35:54.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:35:54 smithi047 bash[22744]: audit 2024-09-16T08:35:54.218939+0000 mon.b (mon.2) 733 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:35:55.338 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 08:35:54 smithi047 bash[22994]: debug 2024-09-16T08:35:54.948+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T08:35:55.338 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 08:35:54 smithi047 bash[22994]: debug 2024-09-16T08:35:54.952+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T08:35:55.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:35:55 smithi157 bash[24585]: audit 2024-09-16T08:35:54.223861+0000 mgr.a (mgr.14373) 7735 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:35:55.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:35:55 smithi086 bash[24289]: audit 2024-09-16T08:35:54.223861+0000 mgr.a (mgr.14373) 7735 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:35:55.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:35:55 smithi047 bash[22744]: audit 2024-09-16T08:35:54.223861+0000 mgr.a (mgr.14373) 7735 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:35:56.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:35:56 smithi157 bash[24585]: audit 2024-09-16T08:35:54.953078+0000 mgr.a (mgr.14373) 7736 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T08:35:56.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:35:56 smithi157 bash[24585]: cephadm 2024-09-16T08:35:54.955419+0000 mgr.a (mgr.14373) 7737 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T08:35:56.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:35:56 smithi157 bash[24585]: cluster 2024-09-16T08:35:55.307054+0000 mgr.a (mgr.14373) 7738 : cluster [DBG] pgmap v5364: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:35:56.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:35:56 smithi086 bash[24289]: audit 2024-09-16T08:35:54.953078+0000 mgr.a (mgr.14373) 7736 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T08:35:56.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:35:56 smithi086 bash[24289]: cephadm 2024-09-16T08:35:54.955419+0000 mgr.a (mgr.14373) 7737 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T08:35:56.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:35:56 smithi086 bash[24289]: cluster 2024-09-16T08:35:55.307054+0000 mgr.a (mgr.14373) 7738 : cluster [DBG] pgmap v5364: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:35:56.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:35:56 smithi047 bash[22744]: audit 2024-09-16T08:35:54.953078+0000 mgr.a (mgr.14373) 7736 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T08:35:56.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:35:56 smithi047 bash[22744]: cephadm 2024-09-16T08:35:54.955419+0000 mgr.a (mgr.14373) 7737 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T08:35:56.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:35:56 smithi047 bash[22744]: cluster 2024-09-16T08:35:55.307054+0000 mgr.a (mgr.14373) 7738 : cluster [DBG] pgmap v5364: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:35:58.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:35:58 smithi157 bash[24585]: cluster 2024-09-16T08:35:57.309159+0000 mgr.a (mgr.14373) 7739 : cluster [DBG] pgmap v5365: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:35:58.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:35:58 smithi086 bash[24289]: cluster 2024-09-16T08:35:57.309159+0000 mgr.a (mgr.14373) 7739 : cluster [DBG] pgmap v5365: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:35:58.832 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:35:58.833 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:35:58.833 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:35:58.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:35:58 smithi047 bash[22744]: cluster 2024-09-16T08:35:57.309159+0000 mgr.a (mgr.14373) 7739 : cluster [DBG] pgmap v5365: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:35:59.573 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:35:59.573 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:35:59.574 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:35:59.574 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:35:59.574 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:36:00.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:36:00 smithi157 bash[24585]: audit 2024-09-16T08:35:59.164767+0000 mgr.a (mgr.14373) 7740 : audit [DBG] from='client.174258 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:36:00.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:36:00 smithi157 bash[24585]: cluster 2024-09-16T08:35:59.309765+0000 mgr.a (mgr.14373) 7741 : cluster [DBG] pgmap v5366: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:36:00.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:36:00 smithi086 bash[24289]: audit 2024-09-16T08:35:59.164767+0000 mgr.a (mgr.14373) 7740 : audit [DBG] from='client.174258 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:36:00.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:36:00 smithi086 bash[24289]: cluster 2024-09-16T08:35:59.309765+0000 mgr.a (mgr.14373) 7741 : cluster [DBG] pgmap v5366: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:36:00.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:36:00 smithi047 bash[22744]: audit 2024-09-16T08:35:59.164767+0000 mgr.a (mgr.14373) 7740 : audit [DBG] from='client.174258 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:36:00.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:36:00 smithi047 bash[22744]: cluster 2024-09-16T08:35:59.309765+0000 mgr.a (mgr.14373) 7741 : cluster [DBG] pgmap v5366: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:36:02.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:36:02 smithi157 bash[24585]: cluster 2024-09-16T08:36:01.310678+0000 mgr.a (mgr.14373) 7742 : cluster [DBG] pgmap v5367: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:36:02.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:36:02 smithi086 bash[24289]: cluster 2024-09-16T08:36:01.310678+0000 mgr.a (mgr.14373) 7742 : cluster [DBG] pgmap v5367: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:36:02.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:36:02 smithi047 bash[22744]: cluster 2024-09-16T08:36:01.310678+0000 mgr.a (mgr.14373) 7742 : cluster [DBG] pgmap v5367: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:36:04.574 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:36:04.575 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:36:04.575 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:36:04.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:36:04 smithi157 bash[24585]: cluster 2024-09-16T08:36:03.312836+0000 mgr.a (mgr.14373) 7743 : cluster [DBG] pgmap v5368: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:36:04.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:36:04 smithi086 bash[24289]: cluster 2024-09-16T08:36:03.312836+0000 mgr.a (mgr.14373) 7743 : cluster [DBG] pgmap v5368: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:36:04.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:36:04 smithi047 bash[22744]: cluster 2024-09-16T08:36:03.312836+0000 mgr.a (mgr.14373) 7743 : cluster [DBG] pgmap v5368: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:36:05.350 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:36:05.350 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:36:05.350 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:36:05.351 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:36:05.351 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:36:06.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:36:06 smithi157 bash[24585]: audit 2024-09-16T08:36:04.913937+0000 mgr.a (mgr.14373) 7744 : audit [DBG] from='client.174336 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:36:06.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:36:06 smithi157 bash[24585]: cluster 2024-09-16T08:36:05.313489+0000 mgr.a (mgr.14373) 7745 : cluster [DBG] pgmap v5369: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:36:06.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:36:06 smithi086 bash[24289]: audit 2024-09-16T08:36:04.913937+0000 mgr.a (mgr.14373) 7744 : audit [DBG] from='client.174336 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:36:06.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:36:06 smithi086 bash[24289]: cluster 2024-09-16T08:36:05.313489+0000 mgr.a (mgr.14373) 7745 : cluster [DBG] pgmap v5369: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:36:06.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:36:06 smithi047 bash[22744]: audit 2024-09-16T08:36:04.913937+0000 mgr.a (mgr.14373) 7744 : audit [DBG] from='client.174336 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:36:06.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:36:06 smithi047 bash[22744]: cluster 2024-09-16T08:36:05.313489+0000 mgr.a (mgr.14373) 7745 : cluster [DBG] pgmap v5369: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:36:08.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:36:08 smithi157 bash[24585]: cluster 2024-09-16T08:36:07.315629+0000 mgr.a (mgr.14373) 7746 : cluster [DBG] pgmap v5370: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:36:08.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:36:08 smithi086 bash[24289]: cluster 2024-09-16T08:36:07.315629+0000 mgr.a (mgr.14373) 7746 : cluster [DBG] pgmap v5370: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:36:08.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:36:08 smithi047 bash[22744]: cluster 2024-09-16T08:36:07.315629+0000 mgr.a (mgr.14373) 7746 : cluster [DBG] pgmap v5370: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:36:10.352 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:36:10.353 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:36:10.353 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:36:10.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:36:10 smithi157 bash[24585]: cluster 2024-09-16T08:36:09.316362+0000 mgr.a (mgr.14373) 7747 : cluster [DBG] pgmap v5371: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:36:10.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:36:10 smithi086 bash[24289]: cluster 2024-09-16T08:36:09.316362+0000 mgr.a (mgr.14373) 7747 : cluster [DBG] pgmap v5371: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:36:10.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:36:10 smithi047 bash[22744]: cluster 2024-09-16T08:36:09.316362+0000 mgr.a (mgr.14373) 7747 : cluster [DBG] pgmap v5371: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:36:11.131 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:36:11.132 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:36:11.132 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:36:11.132 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:36:11.132 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:36:11.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:36:11 smithi157 bash[24585]: audit 2024-09-16T08:36:10.693643+0000 mgr.a (mgr.14373) 7748 : audit [DBG] from='client.174414 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:36:11.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:36:11 smithi086 bash[24289]: audit 2024-09-16T08:36:10.693643+0000 mgr.a (mgr.14373) 7748 : audit [DBG] from='client.174414 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:36:11.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:36:11 smithi047 bash[22744]: audit 2024-09-16T08:36:10.693643+0000 mgr.a (mgr.14373) 7748 : audit [DBG] from='client.174414 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:36:12.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:36:12 smithi157 bash[24585]: cluster 2024-09-16T08:36:11.317410+0000 mgr.a (mgr.14373) 7749 : cluster [DBG] pgmap v5372: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:36:12.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:36:12 smithi086 bash[24289]: cluster 2024-09-16T08:36:11.317410+0000 mgr.a (mgr.14373) 7749 : cluster [DBG] pgmap v5372: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:36:12.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:36:12 smithi047 bash[22744]: cluster 2024-09-16T08:36:11.317410+0000 mgr.a (mgr.14373) 7749 : cluster [DBG] pgmap v5372: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:36:14.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:36:14 smithi157 bash[24585]: cluster 2024-09-16T08:36:13.319650+0000 mgr.a (mgr.14373) 7750 : cluster [DBG] pgmap v5373: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:36:14.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:36:14 smithi086 bash[24289]: cluster 2024-09-16T08:36:13.319650+0000 mgr.a (mgr.14373) 7750 : cluster [DBG] pgmap v5373: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:36:14.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:36:14 smithi047 bash[22744]: cluster 2024-09-16T08:36:13.319650+0000 mgr.a (mgr.14373) 7750 : cluster [DBG] pgmap v5373: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:36:16.133 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:36:16.133 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:36:16.134 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:36:16.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:36:16 smithi157 bash[24585]: cluster 2024-09-16T08:36:15.320399+0000 mgr.a (mgr.14373) 7751 : cluster [DBG] pgmap v5374: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:36:16.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:36:16 smithi086 bash[24289]: cluster 2024-09-16T08:36:15.320399+0000 mgr.a (mgr.14373) 7751 : cluster [DBG] pgmap v5374: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:36:16.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:36:16 smithi047 bash[22744]: cluster 2024-09-16T08:36:15.320399+0000 mgr.a (mgr.14373) 7751 : cluster [DBG] pgmap v5374: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:36:16.913 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:36:16.913 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:36:16.914 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:36:16.914 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:36:16.914 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:36:17.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:36:17 smithi157 bash[24585]: audit 2024-09-16T08:36:16.473372+0000 mgr.a (mgr.14373) 7752 : audit [DBG] from='client.174489 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:36:17.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:36:17 smithi086 bash[24289]: audit 2024-09-16T08:36:16.473372+0000 mgr.a (mgr.14373) 7752 : audit [DBG] from='client.174489 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:36:17.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:36:17 smithi047 bash[22744]: audit 2024-09-16T08:36:16.473372+0000 mgr.a (mgr.14373) 7752 : audit [DBG] from='client.174489 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:36:18.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:36:18 smithi157 bash[24585]: cluster 2024-09-16T08:36:17.323085+0000 mgr.a (mgr.14373) 7753 : cluster [DBG] pgmap v5375: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:36:18.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:36:18 smithi086 bash[24289]: cluster 2024-09-16T08:36:17.323085+0000 mgr.a (mgr.14373) 7753 : cluster [DBG] pgmap v5375: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:36:18.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:36:18 smithi047 bash[22744]: cluster 2024-09-16T08:36:17.323085+0000 mgr.a (mgr.14373) 7753 : cluster [DBG] pgmap v5375: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:36:20.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:36:20 smithi157 bash[24585]: cluster 2024-09-16T08:36:19.323875+0000 mgr.a (mgr.14373) 7754 : cluster [DBG] pgmap v5376: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:36:20.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:36:20 smithi086 bash[24289]: cluster 2024-09-16T08:36:19.323875+0000 mgr.a (mgr.14373) 7754 : cluster [DBG] pgmap v5376: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:36:20.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:36:20 smithi047 bash[22744]: cluster 2024-09-16T08:36:19.323875+0000 mgr.a (mgr.14373) 7754 : cluster [DBG] pgmap v5376: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:36:21.915 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:36:21.916 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:36:21.916 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:36:22.660 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:36:22.660 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:36:22.660 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:36:22.660 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:36:22.660 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:36:22.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:36:22 smithi157 bash[24585]: cluster 2024-09-16T08:36:21.324658+0000 mgr.a (mgr.14373) 7755 : cluster [DBG] pgmap v5377: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T08:36:22.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:36:22 smithi086 bash[24289]: cluster 2024-09-16T08:36:21.324658+0000 mgr.a (mgr.14373) 7755 : cluster [DBG] pgmap v5377: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T08:36:22.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:36:22 smithi047 bash[22744]: cluster 2024-09-16T08:36:21.324658+0000 mgr.a (mgr.14373) 7755 : cluster [DBG] pgmap v5377: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T08:36:23.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:36:23 smithi157 bash[24585]: audit 2024-09-16T08:36:22.250422+0000 mgr.a (mgr.14373) 7756 : audit [DBG] from='client.174567 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:36:23.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:36:23 smithi086 bash[24289]: audit 2024-09-16T08:36:22.250422+0000 mgr.a (mgr.14373) 7756 : audit [DBG] from='client.174567 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:36:23.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:36:23 smithi047 bash[22744]: audit 2024-09-16T08:36:22.250422+0000 mgr.a (mgr.14373) 7756 : audit [DBG] from='client.174567 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:36:24.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:36:24 smithi157 bash[24585]: cluster 2024-09-16T08:36:23.327338+0000 mgr.a (mgr.14373) 7757 : cluster [DBG] pgmap v5378: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:36:24.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:36:24 smithi086 bash[24289]: cluster 2024-09-16T08:36:23.327338+0000 mgr.a (mgr.14373) 7757 : cluster [DBG] pgmap v5378: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:36:24.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:36:24 smithi047 bash[22744]: cluster 2024-09-16T08:36:23.327338+0000 mgr.a (mgr.14373) 7757 : cluster [DBG] pgmap v5378: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:36:26.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:36:26 smithi157 bash[24585]: cluster 2024-09-16T08:36:25.328099+0000 mgr.a (mgr.14373) 7758 : cluster [DBG] pgmap v5379: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:36:26.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:36:26 smithi086 bash[24289]: cluster 2024-09-16T08:36:25.328099+0000 mgr.a (mgr.14373) 7758 : cluster [DBG] pgmap v5379: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:36:26.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:36:26 smithi047 bash[22744]: cluster 2024-09-16T08:36:25.328099+0000 mgr.a (mgr.14373) 7758 : cluster [DBG] pgmap v5379: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:36:27.662 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:36:27.662 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:36:27.662 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:36:28.416 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:36:28.416 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:36:28.416 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:36:28.416 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:36:28.417 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:36:28.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:36:28 smithi086 bash[24289]: cluster 2024-09-16T08:36:27.330043+0000 mgr.a (mgr.14373) 7759 : cluster [DBG] pgmap v5380: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:36:28.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:36:28 smithi047 bash[22744]: cluster 2024-09-16T08:36:27.330043+0000 mgr.a (mgr.14373) 7759 : cluster [DBG] pgmap v5380: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:36:29.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:36:28 smithi157 bash[24585]: cluster 2024-09-16T08:36:27.330043+0000 mgr.a (mgr.14373) 7759 : cluster [DBG] pgmap v5380: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:36:29.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:36:29 smithi086 bash[24289]: audit 2024-09-16T08:36:27.996644+0000 mgr.a (mgr.14373) 7760 : audit [DBG] from='client.174645 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:36:29.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:36:29 smithi047 bash[22744]: audit 2024-09-16T08:36:27.996644+0000 mgr.a (mgr.14373) 7760 : audit [DBG] from='client.174645 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:36:30.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:36:29 smithi157 bash[24585]: audit 2024-09-16T08:36:27.996644+0000 mgr.a (mgr.14373) 7760 : audit [DBG] from='client.174645 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:36:30.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:36:30 smithi086 bash[24289]: cluster 2024-09-16T08:36:29.331014+0000 mgr.a (mgr.14373) 7761 : cluster [DBG] pgmap v5381: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:36:30.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:36:30 smithi047 bash[22744]: cluster 2024-09-16T08:36:29.331014+0000 mgr.a (mgr.14373) 7761 : cluster [DBG] pgmap v5381: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:36:31.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:36:30 smithi157 bash[24585]: cluster 2024-09-16T08:36:29.331014+0000 mgr.a (mgr.14373) 7761 : cluster [DBG] pgmap v5381: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:36:32.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:36:32 smithi047 bash[22744]: cluster 2024-09-16T08:36:31.331805+0000 mgr.a (mgr.14373) 7762 : cluster [DBG] pgmap v5382: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:36:33.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:36:32 smithi157 bash[24585]: cluster 2024-09-16T08:36:31.331805+0000 mgr.a (mgr.14373) 7762 : cluster [DBG] pgmap v5382: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:36:33.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:36:32 smithi086 bash[24289]: cluster 2024-09-16T08:36:31.331805+0000 mgr.a (mgr.14373) 7762 : cluster [DBG] pgmap v5382: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:36:33.417 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:36:33.418 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:36:33.418 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:36:34.161 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:36:34.161 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:36:34.161 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:36:34.161 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:36:34.161 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:36:34.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:36:34 smithi047 bash[22744]: cluster 2024-09-16T08:36:33.334043+0000 mgr.a (mgr.14373) 7763 : cluster [DBG] pgmap v5383: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:36:35.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:36:34 smithi157 bash[24585]: cluster 2024-09-16T08:36:33.334043+0000 mgr.a (mgr.14373) 7763 : cluster [DBG] pgmap v5383: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:36:35.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:36:34 smithi086 bash[24289]: cluster 2024-09-16T08:36:33.334043+0000 mgr.a (mgr.14373) 7763 : cluster [DBG] pgmap v5383: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:36:35.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:36:35 smithi047 bash[22744]: audit 2024-09-16T08:36:33.752029+0000 mgr.a (mgr.14373) 7764 : audit [DBG] from='client.174723 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:36:36.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:36:35 smithi157 bash[24585]: audit 2024-09-16T08:36:33.752029+0000 mgr.a (mgr.14373) 7764 : audit [DBG] from='client.174723 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:36:36.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:36:35 smithi086 bash[24289]: audit 2024-09-16T08:36:33.752029+0000 mgr.a (mgr.14373) 7764 : audit [DBG] from='client.174723 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:36:36.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:36:36 smithi047 bash[22744]: cluster 2024-09-16T08:36:35.335077+0000 mgr.a (mgr.14373) 7765 : cluster [DBG] pgmap v5384: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:36:37.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:36:36 smithi157 bash[24585]: cluster 2024-09-16T08:36:35.335077+0000 mgr.a (mgr.14373) 7765 : cluster [DBG] pgmap v5384: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:36:37.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:36:36 smithi086 bash[24289]: cluster 2024-09-16T08:36:35.335077+0000 mgr.a (mgr.14373) 7765 : cluster [DBG] pgmap v5384: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:36:39.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:36:38 smithi157 bash[24585]: cluster 2024-09-16T08:36:37.337374+0000 mgr.a (mgr.14373) 7766 : cluster [DBG] pgmap v5385: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:36:39.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:36:38 smithi086 bash[24289]: cluster 2024-09-16T08:36:37.337374+0000 mgr.a (mgr.14373) 7766 : cluster [DBG] pgmap v5385: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:36:39.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:36:38 smithi047 bash[22744]: cluster 2024-09-16T08:36:37.337374+0000 mgr.a (mgr.14373) 7766 : cluster [DBG] pgmap v5385: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:36:39.162 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:36:39.163 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:36:39.163 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:36:39.909 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:36:39.909 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:36:39.909 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:36:39.909 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:36:39.909 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:36:41.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:36:40 smithi157 bash[24585]: cluster 2024-09-16T08:36:39.337865+0000 mgr.a (mgr.14373) 7767 : cluster [DBG] pgmap v5386: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:36:41.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:36:40 smithi157 bash[24585]: audit 2024-09-16T08:36:39.500359+0000 mgr.a (mgr.14373) 7768 : audit [DBG] from='client.174801 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:36:41.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:36:40 smithi086 bash[24289]: cluster 2024-09-16T08:36:39.337865+0000 mgr.a (mgr.14373) 7767 : cluster [DBG] pgmap v5386: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:36:41.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:36:40 smithi086 bash[24289]: audit 2024-09-16T08:36:39.500359+0000 mgr.a (mgr.14373) 7768 : audit [DBG] from='client.174801 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:36:41.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:36:40 smithi047 bash[22744]: cluster 2024-09-16T08:36:39.337865+0000 mgr.a (mgr.14373) 7767 : cluster [DBG] pgmap v5386: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:36:41.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:36:40 smithi047 bash[22744]: audit 2024-09-16T08:36:39.500359+0000 mgr.a (mgr.14373) 7768 : audit [DBG] from='client.174801 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:36:43.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:36:42 smithi157 bash[24585]: cluster 2024-09-16T08:36:41.338785+0000 mgr.a (mgr.14373) 7769 : cluster [DBG] pgmap v5387: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:36:43.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:36:42 smithi086 bash[24289]: cluster 2024-09-16T08:36:41.338785+0000 mgr.a (mgr.14373) 7769 : cluster [DBG] pgmap v5387: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:36:43.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:36:42 smithi047 bash[22744]: cluster 2024-09-16T08:36:41.338785+0000 mgr.a (mgr.14373) 7769 : cluster [DBG] pgmap v5387: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:36:44.910 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:36:44.911 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:36:44.911 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:36:45.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:36:44 smithi157 bash[24585]: cluster 2024-09-16T08:36:43.341126+0000 mgr.a (mgr.14373) 7770 : cluster [DBG] pgmap v5388: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:36:45.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:36:44 smithi086 bash[24289]: cluster 2024-09-16T08:36:43.341126+0000 mgr.a (mgr.14373) 7770 : cluster [DBG] pgmap v5388: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:36:45.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:36:44 smithi047 bash[22744]: cluster 2024-09-16T08:36:43.341126+0000 mgr.a (mgr.14373) 7770 : cluster [DBG] pgmap v5388: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:36:45.668 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:36:45.669 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:36:45.669 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:36:45.669 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:36:45.669 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:36:47.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:36:46 smithi157 bash[24585]: audit 2024-09-16T08:36:45.249009+0000 mgr.a (mgr.14373) 7771 : audit [DBG] from='client.174876 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:36:47.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:36:46 smithi157 bash[24585]: cluster 2024-09-16T08:36:45.341640+0000 mgr.a (mgr.14373) 7772 : cluster [DBG] pgmap v5389: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:36:47.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:36:46 smithi086 bash[24289]: audit 2024-09-16T08:36:45.249009+0000 mgr.a (mgr.14373) 7771 : audit [DBG] from='client.174876 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:36:47.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:36:46 smithi086 bash[24289]: cluster 2024-09-16T08:36:45.341640+0000 mgr.a (mgr.14373) 7772 : cluster [DBG] pgmap v5389: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:36:47.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:36:46 smithi047 bash[22744]: audit 2024-09-16T08:36:45.249009+0000 mgr.a (mgr.14373) 7771 : audit [DBG] from='client.174876 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:36:47.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:36:46 smithi047 bash[22744]: cluster 2024-09-16T08:36:45.341640+0000 mgr.a (mgr.14373) 7772 : cluster [DBG] pgmap v5389: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:36:49.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:36:48 smithi157 bash[24585]: cluster 2024-09-16T08:36:47.343926+0000 mgr.a (mgr.14373) 7773 : cluster [DBG] pgmap v5390: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:36:49.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:36:48 smithi086 bash[24289]: cluster 2024-09-16T08:36:47.343926+0000 mgr.a (mgr.14373) 7773 : cluster [DBG] pgmap v5390: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:36:49.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:36:48 smithi047 bash[22744]: cluster 2024-09-16T08:36:47.343926+0000 mgr.a (mgr.14373) 7773 : cluster [DBG] pgmap v5390: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:36:50.670 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:36:50.671 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:36:50.671 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:36:51.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:36:50 smithi157 bash[24585]: cluster 2024-09-16T08:36:49.344701+0000 mgr.a (mgr.14373) 7774 : cluster [DBG] pgmap v5391: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:36:51.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:36:50 smithi086 bash[24289]: cluster 2024-09-16T08:36:49.344701+0000 mgr.a (mgr.14373) 7774 : cluster [DBG] pgmap v5391: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:36:51.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:36:50 smithi047 bash[22744]: cluster 2024-09-16T08:36:49.344701+0000 mgr.a (mgr.14373) 7774 : cluster [DBG] pgmap v5391: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:36:51.450 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:36:51.450 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:36:51.451 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:36:51.451 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:36:51.451 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:36:53.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:36:52 smithi157 bash[24585]: audit 2024-09-16T08:36:51.009473+0000 mgr.a (mgr.14373) 7775 : audit [DBG] from='client.174951 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:36:53.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:36:52 smithi157 bash[24585]: cluster 2024-09-16T08:36:51.351178+0000 mgr.a (mgr.14373) 7776 : cluster [DBG] pgmap v5392: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:36:53.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:36:52 smithi086 bash[24289]: audit 2024-09-16T08:36:51.009473+0000 mgr.a (mgr.14373) 7775 : audit [DBG] from='client.174951 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:36:53.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:36:52 smithi086 bash[24289]: cluster 2024-09-16T08:36:51.351178+0000 mgr.a (mgr.14373) 7776 : cluster [DBG] pgmap v5392: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:36:53.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:36:52 smithi047 bash[22744]: audit 2024-09-16T08:36:51.009473+0000 mgr.a (mgr.14373) 7775 : audit [DBG] from='client.174951 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:36:53.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:36:52 smithi047 bash[22744]: cluster 2024-09-16T08:36:51.351178+0000 mgr.a (mgr.14373) 7776 : cluster [DBG] pgmap v5392: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:36:55.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:36:54 smithi157 bash[24585]: cluster 2024-09-16T08:36:53.353412+0000 mgr.a (mgr.14373) 7777 : cluster [DBG] pgmap v5393: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:36:55.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:36:54 smithi086 bash[24289]: cluster 2024-09-16T08:36:53.353412+0000 mgr.a (mgr.14373) 7777 : cluster [DBG] pgmap v5393: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:36:55.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:36:54 smithi047 bash[22744]: cluster 2024-09-16T08:36:53.353412+0000 mgr.a (mgr.14373) 7777 : cluster [DBG] pgmap v5393: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:36:56.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:36:55 smithi157 bash[24585]: audit 2024-09-16T08:36:55.006142+0000 mon.b (mon.2) 734 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T08:36:56.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:36:55 smithi086 bash[24289]: audit 2024-09-16T08:36:55.006142+0000 mon.b (mon.2) 734 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T08:36:56.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:36:55 smithi047 bash[22744]: audit 2024-09-16T08:36:55.006142+0000 mon.b (mon.2) 734 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T08:36:56.452 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:36:56.452 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:36:56.452 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:36:57.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:36:56 smithi157 bash[24585]: cluster 2024-09-16T08:36:55.353983+0000 mgr.a (mgr.14373) 7778 : cluster [DBG] pgmap v5394: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:36:57.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:36:56 smithi086 bash[24289]: cluster 2024-09-16T08:36:55.353983+0000 mgr.a (mgr.14373) 7778 : cluster [DBG] pgmap v5394: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:36:57.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:36:56 smithi047 bash[22744]: cluster 2024-09-16T08:36:55.353983+0000 mgr.a (mgr.14373) 7778 : cluster [DBG] pgmap v5394: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:36:57.208 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:36:57.209 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:36:57.209 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:36:57.209 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:36:57.209 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:36:59.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:36:58 smithi157 bash[24585]: audit 2024-09-16T08:36:56.789362+0000 mgr.a (mgr.14373) 7779 : audit [DBG] from='client.175026 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:36:59.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:36:58 smithi157 bash[24585]: cluster 2024-09-16T08:36:57.356716+0000 mgr.a (mgr.14373) 7780 : cluster [DBG] pgmap v5395: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:36:59.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:36:58 smithi086 bash[24289]: audit 2024-09-16T08:36:56.789362+0000 mgr.a (mgr.14373) 7779 : audit [DBG] from='client.175026 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:36:59.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:36:58 smithi086 bash[24289]: cluster 2024-09-16T08:36:57.356716+0000 mgr.a (mgr.14373) 7780 : cluster [DBG] pgmap v5395: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:36:59.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:36:58 smithi047 bash[22744]: audit 2024-09-16T08:36:56.789362+0000 mgr.a (mgr.14373) 7779 : audit [DBG] from='client.175026 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:36:59.104 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:36:58 smithi047 bash[22744]: cluster 2024-09-16T08:36:57.356716+0000 mgr.a (mgr.14373) 7780 : cluster [DBG] pgmap v5395: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:37:01.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:37:00 smithi157 bash[24585]: cluster 2024-09-16T08:36:59.357513+0000 mgr.a (mgr.14373) 7781 : cluster [DBG] pgmap v5396: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:37:01.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:37:00 smithi157 bash[24585]: audit 2024-09-16T08:37:00.346651+0000 mon.a (mon.0) 1025 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:37:01.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:37:00 smithi157 bash[24585]: audit 2024-09-16T08:37:00.352259+0000 mon.a (mon.0) 1026 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:37:01.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:37:00 smithi157 bash[24585]: audit 2024-09-16T08:37:00.383182+0000 mon.a (mon.0) 1027 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:37:01.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:37:00 smithi157 bash[24585]: audit 2024-09-16T08:37:00.387593+0000 mon.a (mon.0) 1028 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:37:01.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:37:00 smithi157 bash[24585]: audit 2024-09-16T08:37:00.390355+0000 mon.a (mon.0) 1029 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:37:01.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:37:00 smithi157 bash[24585]: audit 2024-09-16T08:37:00.394434+0000 mon.a (mon.0) 1030 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:37:01.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:37:00 smithi086 bash[24289]: cluster 2024-09-16T08:36:59.357513+0000 mgr.a (mgr.14373) 7781 : cluster [DBG] pgmap v5396: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:37:01.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:37:00 smithi086 bash[24289]: audit 2024-09-16T08:37:00.346651+0000 mon.a (mon.0) 1025 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:37:01.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:37:00 smithi086 bash[24289]: audit 2024-09-16T08:37:00.352259+0000 mon.a (mon.0) 1026 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:37:01.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:37:00 smithi086 bash[24289]: audit 2024-09-16T08:37:00.383182+0000 mon.a (mon.0) 1027 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:37:01.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:37:00 smithi086 bash[24289]: audit 2024-09-16T08:37:00.387593+0000 mon.a (mon.0) 1028 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:37:01.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:37:00 smithi086 bash[24289]: audit 2024-09-16T08:37:00.390355+0000 mon.a (mon.0) 1029 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:37:01.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:37:00 smithi086 bash[24289]: audit 2024-09-16T08:37:00.394434+0000 mon.a (mon.0) 1030 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:37:01.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:37:00 smithi047 bash[22744]: cluster 2024-09-16T08:36:59.357513+0000 mgr.a (mgr.14373) 7781 : cluster [DBG] pgmap v5396: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:37:01.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:37:00 smithi047 bash[22744]: audit 2024-09-16T08:37:00.346651+0000 mon.a (mon.0) 1025 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:37:01.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:37:00 smithi047 bash[22744]: audit 2024-09-16T08:37:00.352259+0000 mon.a (mon.0) 1026 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:37:01.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:37:00 smithi047 bash[22744]: audit 2024-09-16T08:37:00.383182+0000 mon.a (mon.0) 1027 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:37:01.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:37:00 smithi047 bash[22744]: audit 2024-09-16T08:37:00.387593+0000 mon.a (mon.0) 1028 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:37:01.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:37:00 smithi047 bash[22744]: audit 2024-09-16T08:37:00.390355+0000 mon.a (mon.0) 1029 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:37:01.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:37:00 smithi047 bash[22744]: audit 2024-09-16T08:37:00.394434+0000 mon.a (mon.0) 1030 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:37:02.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:37:01 smithi157 bash[24585]: audit 2024-09-16T08:37:01.115812+0000 mon.b (mon.2) 735 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T08:37:02.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:37:01 smithi157 bash[24585]: audit 2024-09-16T08:37:01.117853+0000 mon.b (mon.2) 736 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T08:37:02.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:37:01 smithi157 bash[24585]: audit 2024-09-16T08:37:01.130028+0000 mon.a (mon.0) 1031 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:37:02.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:37:01 smithi157 bash[24585]: audit 2024-09-16T08:37:01.131601+0000 mon.b (mon.2) 737 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:37:02.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:37:01 smithi086 bash[24289]: audit 2024-09-16T08:37:01.115812+0000 mon.b (mon.2) 735 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T08:37:02.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:37:01 smithi086 bash[24289]: audit 2024-09-16T08:37:01.117853+0000 mon.b (mon.2) 736 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T08:37:02.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:37:01 smithi086 bash[24289]: audit 2024-09-16T08:37:01.130028+0000 mon.a (mon.0) 1031 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:37:02.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:37:01 smithi086 bash[24289]: audit 2024-09-16T08:37:01.131601+0000 mon.b (mon.2) 737 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:37:02.087 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 08:37:01 smithi047 bash[22994]: debug 2024-09-16T08:37:01.859+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T08:37:02.088 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 08:37:01 smithi047 bash[22994]: debug 2024-09-16T08:37:01.863+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T08:37:02.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:37:01 smithi047 bash[22744]: audit 2024-09-16T08:37:01.115812+0000 mon.b (mon.2) 735 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T08:37:02.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:37:01 smithi047 bash[22744]: audit 2024-09-16T08:37:01.117853+0000 mon.b (mon.2) 736 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T08:37:02.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:37:01 smithi047 bash[22744]: audit 2024-09-16T08:37:01.130028+0000 mon.a (mon.0) 1031 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:37:02.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:37:01 smithi047 bash[22744]: audit 2024-09-16T08:37:01.131601+0000 mon.b (mon.2) 737 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:37:02.210 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:37:02.211 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:37:02.211 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:37:02.970 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:37:02.970 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:37:02.970 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:37:02.970 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:37:02.970 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:37:03.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:37:02 smithi157 bash[24585]: audit 2024-09-16T08:37:01.136096+0000 mgr.a (mgr.14373) 7782 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:37:03.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:37:02 smithi157 bash[24585]: cluster 2024-09-16T08:37:01.358224+0000 mgr.a (mgr.14373) 7783 : cluster [DBG] pgmap v5397: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:37:03.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:37:02 smithi086 bash[24289]: audit 2024-09-16T08:37:01.136096+0000 mgr.a (mgr.14373) 7782 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:37:03.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:37:02 smithi086 bash[24289]: cluster 2024-09-16T08:37:01.358224+0000 mgr.a (mgr.14373) 7783 : cluster [DBG] pgmap v5397: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:37:03.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:37:02 smithi047 bash[22744]: audit 2024-09-16T08:37:01.136096+0000 mgr.a (mgr.14373) 7782 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:37:03.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:37:02 smithi047 bash[22744]: cluster 2024-09-16T08:37:01.358224+0000 mgr.a (mgr.14373) 7783 : cluster [DBG] pgmap v5397: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:37:04.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:37:03 smithi157 bash[24585]: audit 2024-09-16T08:37:01.865906+0000 mgr.a (mgr.14373) 7784 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T08:37:04.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:37:03 smithi157 bash[24585]: cephadm 2024-09-16T08:37:01.867662+0000 mgr.a (mgr.14373) 7785 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T08:37:04.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:37:03 smithi157 bash[24585]: audit 2024-09-16T08:37:02.545152+0000 mgr.a (mgr.14373) 7786 : audit [DBG] from='client.175206 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:37:04.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:37:03 smithi086 bash[24289]: audit 2024-09-16T08:37:01.865906+0000 mgr.a (mgr.14373) 7784 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T08:37:04.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:37:03 smithi086 bash[24289]: cephadm 2024-09-16T08:37:01.867662+0000 mgr.a (mgr.14373) 7785 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T08:37:04.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:37:03 smithi086 bash[24289]: audit 2024-09-16T08:37:02.545152+0000 mgr.a (mgr.14373) 7786 : audit [DBG] from='client.175206 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:37:04.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:37:03 smithi047 bash[22744]: audit 2024-09-16T08:37:01.865906+0000 mgr.a (mgr.14373) 7784 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T08:37:04.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:37:03 smithi047 bash[22744]: cephadm 2024-09-16T08:37:01.867662+0000 mgr.a (mgr.14373) 7785 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T08:37:04.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:37:03 smithi047 bash[22744]: audit 2024-09-16T08:37:02.545152+0000 mgr.a (mgr.14373) 7786 : audit [DBG] from='client.175206 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:37:05.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:37:04 smithi157 bash[24585]: cluster 2024-09-16T08:37:03.361025+0000 mgr.a (mgr.14373) 7787 : cluster [DBG] pgmap v5398: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 4.1 KiB/s rd, 255 B/s wr, 4 op/s 2024-09-16T08:37:05.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:37:04 smithi086 bash[24289]: cluster 2024-09-16T08:37:03.361025+0000 mgr.a (mgr.14373) 7787 : cluster [DBG] pgmap v5398: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 4.1 KiB/s rd, 255 B/s wr, 4 op/s 2024-09-16T08:37:05.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:37:04 smithi047 bash[22744]: cluster 2024-09-16T08:37:03.361025+0000 mgr.a (mgr.14373) 7787 : cluster [DBG] pgmap v5398: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 4.1 KiB/s rd, 255 B/s wr, 4 op/s 2024-09-16T08:37:07.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:37:06 smithi157 bash[24585]: cluster 2024-09-16T08:37:05.361828+0000 mgr.a (mgr.14373) 7788 : cluster [DBG] pgmap v5399: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 3.2 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-16T08:37:07.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:37:06 smithi086 bash[24289]: cluster 2024-09-16T08:37:05.361828+0000 mgr.a (mgr.14373) 7788 : cluster [DBG] pgmap v5399: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 3.2 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-16T08:37:07.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:37:06 smithi047 bash[22744]: cluster 2024-09-16T08:37:05.361828+0000 mgr.a (mgr.14373) 7788 : cluster [DBG] pgmap v5399: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 3.2 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-16T08:37:07.971 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:37:07.972 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:37:07.972 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:37:08.724 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:37:08.725 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:37:08.725 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:37:08.725 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:37:08.725 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:37:09.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:37:08 smithi157 bash[24585]: cluster 2024-09-16T08:37:07.363839+0000 mgr.a (mgr.14373) 7789 : cluster [DBG] pgmap v5400: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:37:09.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:37:08 smithi086 bash[24289]: cluster 2024-09-16T08:37:07.363839+0000 mgr.a (mgr.14373) 7789 : cluster [DBG] pgmap v5400: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:37:09.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:37:08 smithi047 bash[22744]: cluster 2024-09-16T08:37:07.363839+0000 mgr.a (mgr.14373) 7789 : cluster [DBG] pgmap v5400: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:37:10.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:37:09 smithi157 bash[24585]: audit 2024-09-16T08:37:08.307196+0000 mgr.a (mgr.14373) 7790 : audit [DBG] from='client.175284 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:37:10.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:37:09 smithi086 bash[24289]: audit 2024-09-16T08:37:08.307196+0000 mgr.a (mgr.14373) 7790 : audit [DBG] from='client.175284 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:37:10.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:37:09 smithi047 bash[22744]: audit 2024-09-16T08:37:08.307196+0000 mgr.a (mgr.14373) 7790 : audit [DBG] from='client.175284 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:37:11.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:37:10 smithi157 bash[24585]: cluster 2024-09-16T08:37:09.364811+0000 mgr.a (mgr.14373) 7791 : cluster [DBG] pgmap v5401: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:37:11.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:37:10 smithi086 bash[24289]: cluster 2024-09-16T08:37:09.364811+0000 mgr.a (mgr.14373) 7791 : cluster [DBG] pgmap v5401: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:37:11.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:37:10 smithi047 bash[22744]: cluster 2024-09-16T08:37:09.364811+0000 mgr.a (mgr.14373) 7791 : cluster [DBG] pgmap v5401: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:37:13.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:37:12 smithi157 bash[24585]: cluster 2024-09-16T08:37:11.365618+0000 mgr.a (mgr.14373) 7792 : cluster [DBG] pgmap v5402: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:37:13.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:37:12 smithi086 bash[24289]: cluster 2024-09-16T08:37:11.365618+0000 mgr.a (mgr.14373) 7792 : cluster [DBG] pgmap v5402: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:37:13.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:37:12 smithi047 bash[22744]: cluster 2024-09-16T08:37:11.365618+0000 mgr.a (mgr.14373) 7792 : cluster [DBG] pgmap v5402: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:37:13.726 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:37:13.727 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:37:13.727 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:37:14.481 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:37:14.481 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:37:14.481 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:37:14.481 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:37:14.481 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:37:15.058 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:37:14 smithi157 bash[24585]: cluster 2024-09-16T08:37:13.367874+0000 mgr.a (mgr.14373) 7793 : cluster [DBG] pgmap v5403: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:37:15.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:37:14 smithi086 bash[24289]: cluster 2024-09-16T08:37:13.367874+0000 mgr.a (mgr.14373) 7793 : cluster [DBG] pgmap v5403: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:37:15.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:37:14 smithi047 bash[22744]: cluster 2024-09-16T08:37:13.367874+0000 mgr.a (mgr.14373) 7793 : cluster [DBG] pgmap v5403: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:37:16.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:37:15 smithi157 bash[24585]: audit 2024-09-16T08:37:14.064358+0000 mgr.a (mgr.14373) 7794 : audit [DBG] from='client.175359 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:37:16.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:37:15 smithi086 bash[24289]: audit 2024-09-16T08:37:14.064358+0000 mgr.a (mgr.14373) 7794 : audit [DBG] from='client.175359 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:37:16.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:37:15 smithi047 bash[22744]: audit 2024-09-16T08:37:14.064358+0000 mgr.a (mgr.14373) 7794 : audit [DBG] from='client.175359 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:37:17.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:37:16 smithi157 bash[24585]: cluster 2024-09-16T08:37:15.368847+0000 mgr.a (mgr.14373) 7795 : cluster [DBG] pgmap v5404: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 4.7 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-16T08:37:17.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:37:16 smithi086 bash[24289]: cluster 2024-09-16T08:37:15.368847+0000 mgr.a (mgr.14373) 7795 : cluster [DBG] pgmap v5404: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 4.7 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-16T08:37:17.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:37:16 smithi047 bash[22744]: cluster 2024-09-16T08:37:15.368847+0000 mgr.a (mgr.14373) 7795 : cluster [DBG] pgmap v5404: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 4.7 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-16T08:37:19.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:37:18 smithi157 bash[24585]: cluster 2024-09-16T08:37:17.371054+0000 mgr.a (mgr.14373) 7796 : cluster [DBG] pgmap v5405: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 5.7 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-16T08:37:19.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:37:18 smithi086 bash[24289]: cluster 2024-09-16T08:37:17.371054+0000 mgr.a (mgr.14373) 7796 : cluster [DBG] pgmap v5405: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 5.7 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-16T08:37:19.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:37:18 smithi047 bash[22744]: cluster 2024-09-16T08:37:17.371054+0000 mgr.a (mgr.14373) 7796 : cluster [DBG] pgmap v5405: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 5.7 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-16T08:37:19.483 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:37:19.483 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:37:19.483 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:37:20.220 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:37:20.220 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:37:20.220 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:37:20.221 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:37:20.221 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:37:21.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:37:20 smithi157 bash[24585]: cluster 2024-09-16T08:37:19.371813+0000 mgr.a (mgr.14373) 7797 : cluster [DBG] pgmap v5406: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:37:21.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:37:20 smithi086 bash[24289]: cluster 2024-09-16T08:37:19.371813+0000 mgr.a (mgr.14373) 7797 : cluster [DBG] pgmap v5406: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:37:21.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:37:20 smithi047 bash[22744]: cluster 2024-09-16T08:37:19.371813+0000 mgr.a (mgr.14373) 7797 : cluster [DBG] pgmap v5406: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:37:22.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:37:21 smithi157 bash[24585]: audit 2024-09-16T08:37:19.810989+0000 mgr.a (mgr.14373) 7798 : audit [DBG] from='client.175437 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:37:22.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:37:21 smithi086 bash[24289]: audit 2024-09-16T08:37:19.810989+0000 mgr.a (mgr.14373) 7798 : audit [DBG] from='client.175437 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:37:22.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:37:21 smithi047 bash[22744]: audit 2024-09-16T08:37:19.810989+0000 mgr.a (mgr.14373) 7798 : audit [DBG] from='client.175437 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:37:23.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:37:22 smithi157 bash[24585]: cluster 2024-09-16T08:37:21.372765+0000 mgr.a (mgr.14373) 7799 : cluster [DBG] pgmap v5407: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:37:23.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:37:22 smithi086 bash[24289]: cluster 2024-09-16T08:37:21.372765+0000 mgr.a (mgr.14373) 7799 : cluster [DBG] pgmap v5407: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:37:23.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:37:22 smithi047 bash[22744]: cluster 2024-09-16T08:37:21.372765+0000 mgr.a (mgr.14373) 7799 : cluster [DBG] pgmap v5407: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:37:25.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:37:24 smithi157 bash[24585]: cluster 2024-09-16T08:37:23.375047+0000 mgr.a (mgr.14373) 7800 : cluster [DBG] pgmap v5408: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:37:25.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:37:24 smithi086 bash[24289]: cluster 2024-09-16T08:37:23.375047+0000 mgr.a (mgr.14373) 7800 : cluster [DBG] pgmap v5408: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:37:25.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:37:24 smithi047 bash[22744]: cluster 2024-09-16T08:37:23.375047+0000 mgr.a (mgr.14373) 7800 : cluster [DBG] pgmap v5408: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:37:25.221 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:37:25.222 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:37:25.223 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:37:26.005 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:37:26.005 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:37:26.005 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:37:26.006 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:37:26.006 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:37:27.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:37:26 smithi157 bash[24585]: cluster 2024-09-16T08:37:25.375583+0000 mgr.a (mgr.14373) 7801 : cluster [DBG] pgmap v5409: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:37:27.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:37:26 smithi157 bash[24585]: audit 2024-09-16T08:37:25.558658+0000 mgr.a (mgr.14373) 7802 : audit [DBG] from='client.175512 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:37:27.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:37:26 smithi086 bash[24289]: cluster 2024-09-16T08:37:25.375583+0000 mgr.a (mgr.14373) 7801 : cluster [DBG] pgmap v5409: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:37:27.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:37:26 smithi086 bash[24289]: audit 2024-09-16T08:37:25.558658+0000 mgr.a (mgr.14373) 7802 : audit [DBG] from='client.175512 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:37:27.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:37:26 smithi047 bash[22744]: cluster 2024-09-16T08:37:25.375583+0000 mgr.a (mgr.14373) 7801 : cluster [DBG] pgmap v5409: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:37:27.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:37:26 smithi047 bash[22744]: audit 2024-09-16T08:37:25.558658+0000 mgr.a (mgr.14373) 7802 : audit [DBG] from='client.175512 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:37:29.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:37:28 smithi157 bash[24585]: cluster 2024-09-16T08:37:27.377861+0000 mgr.a (mgr.14373) 7803 : cluster [DBG] pgmap v5410: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:37:29.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:37:28 smithi086 bash[24289]: cluster 2024-09-16T08:37:27.377861+0000 mgr.a (mgr.14373) 7803 : cluster [DBG] pgmap v5410: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:37:29.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:37:28 smithi047 bash[22744]: cluster 2024-09-16T08:37:27.377861+0000 mgr.a (mgr.14373) 7803 : cluster [DBG] pgmap v5410: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:37:31.006 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:37:31.007 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:37:31.007 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:37:31.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:37:30 smithi157 bash[24585]: cluster 2024-09-16T08:37:29.378701+0000 mgr.a (mgr.14373) 7804 : cluster [DBG] pgmap v5411: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:37:31.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:37:30 smithi086 bash[24289]: cluster 2024-09-16T08:37:29.378701+0000 mgr.a (mgr.14373) 7804 : cluster [DBG] pgmap v5411: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:37:31.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:37:30 smithi047 bash[22744]: cluster 2024-09-16T08:37:29.378701+0000 mgr.a (mgr.14373) 7804 : cluster [DBG] pgmap v5411: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:37:31.765 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:37:31.765 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:37:31.765 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:37:31.766 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:37:31.766 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:37:33.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:37:32 smithi157 bash[24585]: audit 2024-09-16T08:37:31.341775+0000 mgr.a (mgr.14373) 7805 : audit [DBG] from='client.175584 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:37:33.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:37:32 smithi157 bash[24585]: cluster 2024-09-16T08:37:31.379522+0000 mgr.a (mgr.14373) 7806 : cluster [DBG] pgmap v5412: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:37:33.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:37:32 smithi086 bash[24289]: audit 2024-09-16T08:37:31.341775+0000 mgr.a (mgr.14373) 7805 : audit [DBG] from='client.175584 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:37:33.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:37:32 smithi086 bash[24289]: cluster 2024-09-16T08:37:31.379522+0000 mgr.a (mgr.14373) 7806 : cluster [DBG] pgmap v5412: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:37:33.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:37:32 smithi047 bash[22744]: audit 2024-09-16T08:37:31.341775+0000 mgr.a (mgr.14373) 7805 : audit [DBG] from='client.175584 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:37:33.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:37:32 smithi047 bash[22744]: cluster 2024-09-16T08:37:31.379522+0000 mgr.a (mgr.14373) 7806 : cluster [DBG] pgmap v5412: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:37:35.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:37:34 smithi157 bash[24585]: cluster 2024-09-16T08:37:33.381911+0000 mgr.a (mgr.14373) 7807 : cluster [DBG] pgmap v5413: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 2 op/s 2024-09-16T08:37:35.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:37:34 smithi086 bash[24289]: cluster 2024-09-16T08:37:33.381911+0000 mgr.a (mgr.14373) 7807 : cluster [DBG] pgmap v5413: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 2 op/s 2024-09-16T08:37:35.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:37:34 smithi047 bash[22744]: cluster 2024-09-16T08:37:33.381911+0000 mgr.a (mgr.14373) 7807 : cluster [DBG] pgmap v5413: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 2 op/s 2024-09-16T08:37:36.766 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:37:36.767 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:37:36.767 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:37:37.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:37:36 smithi157 bash[24585]: cluster 2024-09-16T08:37:35.382712+0000 mgr.a (mgr.14373) 7808 : cluster [DBG] pgmap v5414: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-16T08:37:37.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:37:36 smithi086 bash[24289]: cluster 2024-09-16T08:37:35.382712+0000 mgr.a (mgr.14373) 7808 : cluster [DBG] pgmap v5414: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-16T08:37:37.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:37:36 smithi047 bash[22744]: cluster 2024-09-16T08:37:35.382712+0000 mgr.a (mgr.14373) 7808 : cluster [DBG] pgmap v5414: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-16T08:37:37.548 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:37:37.548 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:37:37.548 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:37:37.548 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:37:37.548 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:37:39.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:37:38 smithi157 bash[24585]: audit 2024-09-16T08:37:37.106499+0000 mgr.a (mgr.14373) 7809 : audit [DBG] from='client.175659 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:37:39.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:37:38 smithi157 bash[24585]: cluster 2024-09-16T08:37:37.384010+0000 mgr.a (mgr.14373) 7810 : cluster [DBG] pgmap v5415: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:37:39.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:37:38 smithi086 bash[24289]: audit 2024-09-16T08:37:37.106499+0000 mgr.a (mgr.14373) 7809 : audit [DBG] from='client.175659 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:37:39.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:37:38 smithi086 bash[24289]: cluster 2024-09-16T08:37:37.384010+0000 mgr.a (mgr.14373) 7810 : cluster [DBG] pgmap v5415: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:37:39.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:37:38 smithi047 bash[22744]: audit 2024-09-16T08:37:37.106499+0000 mgr.a (mgr.14373) 7809 : audit [DBG] from='client.175659 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:37:39.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:37:38 smithi047 bash[22744]: cluster 2024-09-16T08:37:37.384010+0000 mgr.a (mgr.14373) 7810 : cluster [DBG] pgmap v5415: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:37:41.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:37:40 smithi157 bash[24585]: cluster 2024-09-16T08:37:39.384888+0000 mgr.a (mgr.14373) 7811 : cluster [DBG] pgmap v5416: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T08:37:41.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:37:40 smithi086 bash[24289]: cluster 2024-09-16T08:37:39.384888+0000 mgr.a (mgr.14373) 7811 : cluster [DBG] pgmap v5416: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T08:37:41.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:37:40 smithi047 bash[22744]: cluster 2024-09-16T08:37:39.384888+0000 mgr.a (mgr.14373) 7811 : cluster [DBG] pgmap v5416: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T08:37:42.549 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:37:42.550 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:37:42.550 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:37:43.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:37:42 smithi157 bash[24585]: cluster 2024-09-16T08:37:41.387014+0000 mgr.a (mgr.14373) 7812 : cluster [DBG] pgmap v5417: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:37:43.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:37:42 smithi086 bash[24289]: cluster 2024-09-16T08:37:41.387014+0000 mgr.a (mgr.14373) 7812 : cluster [DBG] pgmap v5417: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:37:43.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:37:42 smithi047 bash[22744]: cluster 2024-09-16T08:37:41.387014+0000 mgr.a (mgr.14373) 7812 : cluster [DBG] pgmap v5417: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:37:43.312 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:37:43.312 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:37:43.312 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:37:43.313 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:37:43.313 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:37:45.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:37:44 smithi157 bash[24585]: audit 2024-09-16T08:37:42.887270+0000 mgr.a (mgr.14373) 7813 : audit [DBG] from='client.175737 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:37:45.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:37:44 smithi157 bash[24585]: cluster 2024-09-16T08:37:43.387975+0000 mgr.a (mgr.14373) 7814 : cluster [DBG] pgmap v5418: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:37:45.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:37:44 smithi086 bash[24289]: audit 2024-09-16T08:37:42.887270+0000 mgr.a (mgr.14373) 7813 : audit [DBG] from='client.175737 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:37:45.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:37:44 smithi086 bash[24289]: cluster 2024-09-16T08:37:43.387975+0000 mgr.a (mgr.14373) 7814 : cluster [DBG] pgmap v5418: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:37:45.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:37:44 smithi047 bash[22744]: audit 2024-09-16T08:37:42.887270+0000 mgr.a (mgr.14373) 7813 : audit [DBG] from='client.175737 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:37:45.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:37:44 smithi047 bash[22744]: cluster 2024-09-16T08:37:43.387975+0000 mgr.a (mgr.14373) 7814 : cluster [DBG] pgmap v5418: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:37:47.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:37:46 smithi157 bash[24585]: cluster 2024-09-16T08:37:45.388774+0000 mgr.a (mgr.14373) 7815 : cluster [DBG] pgmap v5419: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T08:37:47.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:37:46 smithi086 bash[24289]: cluster 2024-09-16T08:37:45.388774+0000 mgr.a (mgr.14373) 7815 : cluster [DBG] pgmap v5419: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T08:37:47.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:37:46 smithi047 bash[22744]: cluster 2024-09-16T08:37:45.388774+0000 mgr.a (mgr.14373) 7815 : cluster [DBG] pgmap v5419: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T08:37:48.314 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:37:48.315 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:37:48.315 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:37:49.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:37:48 smithi157 bash[24585]: cluster 2024-09-16T08:37:47.391005+0000 mgr.a (mgr.14373) 7816 : cluster [DBG] pgmap v5420: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-16T08:37:49.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:37:48 smithi157 bash[24585]: audit 2024-09-16T08:37:48.653836+0000 mgr.a (mgr.14373) 7817 : audit [DBG] from='client.175815 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:37:49.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:37:48 smithi086 bash[24289]: cluster 2024-09-16T08:37:47.391005+0000 mgr.a (mgr.14373) 7816 : cluster [DBG] pgmap v5420: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-16T08:37:49.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:37:48 smithi086 bash[24289]: audit 2024-09-16T08:37:48.653836+0000 mgr.a (mgr.14373) 7817 : audit [DBG] from='client.175815 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:37:49.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:37:48 smithi047 bash[22744]: cluster 2024-09-16T08:37:47.391005+0000 mgr.a (mgr.14373) 7816 : cluster [DBG] pgmap v5420: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-16T08:37:49.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:37:48 smithi047 bash[22744]: audit 2024-09-16T08:37:48.653836+0000 mgr.a (mgr.14373) 7817 : audit [DBG] from='client.175815 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:37:49.088 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:37:49.088 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:37:49.088 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:37:49.088 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:37:49.088 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:37:50.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:37:49 smithi157 bash[24585]: cluster 2024-09-16T08:37:49.391968+0000 mgr.a (mgr.14373) 7818 : cluster [DBG] pgmap v5421: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:37:50.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:37:49 smithi086 bash[24289]: cluster 2024-09-16T08:37:49.391968+0000 mgr.a (mgr.14373) 7818 : cluster [DBG] pgmap v5421: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:37:50.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:37:49 smithi047 bash[22744]: cluster 2024-09-16T08:37:49.391968+0000 mgr.a (mgr.14373) 7818 : cluster [DBG] pgmap v5421: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:37:52.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:37:52 smithi157 bash[24585]: cluster 2024-09-16T08:37:51.394076+0000 mgr.a (mgr.14373) 7819 : cluster [DBG] pgmap v5422: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:37:52.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:37:52 smithi086 bash[24289]: cluster 2024-09-16T08:37:51.394076+0000 mgr.a (mgr.14373) 7819 : cluster [DBG] pgmap v5422: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:37:52.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:37:52 smithi047 bash[22744]: cluster 2024-09-16T08:37:51.394076+0000 mgr.a (mgr.14373) 7819 : cluster [DBG] pgmap v5422: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:37:54.089 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:37:54.090 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:37:54.090 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:37:54.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:37:54 smithi157 bash[24585]: cluster 2024-09-16T08:37:53.394870+0000 mgr.a (mgr.14373) 7820 : cluster [DBG] pgmap v5423: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:37:54.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:37:54 smithi086 bash[24289]: cluster 2024-09-16T08:37:53.394870+0000 mgr.a (mgr.14373) 7820 : cluster [DBG] pgmap v5423: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:37:54.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:37:54 smithi047 bash[22744]: cluster 2024-09-16T08:37:53.394870+0000 mgr.a (mgr.14373) 7820 : cluster [DBG] pgmap v5423: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:37:54.871 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:37:54.871 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:37:54.871 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:37:54.872 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:37:54.872 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:37:55.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:37:55 smithi157 bash[24585]: audit 2024-09-16T08:37:54.429855+0000 mgr.a (mgr.14373) 7821 : audit [DBG] from='client.175890 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:37:55.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:37:55 smithi086 bash[24289]: audit 2024-09-16T08:37:54.429855+0000 mgr.a (mgr.14373) 7821 : audit [DBG] from='client.175890 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:37:55.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:37:55 smithi047 bash[22744]: audit 2024-09-16T08:37:54.429855+0000 mgr.a (mgr.14373) 7821 : audit [DBG] from='client.175890 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:37:56.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:37:56 smithi157 bash[24585]: cluster 2024-09-16T08:37:55.396005+0000 mgr.a (mgr.14373) 7822 : cluster [DBG] pgmap v5424: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:37:56.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:37:56 smithi086 bash[24289]: cluster 2024-09-16T08:37:55.396005+0000 mgr.a (mgr.14373) 7822 : cluster [DBG] pgmap v5424: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:37:56.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:37:56 smithi047 bash[22744]: cluster 2024-09-16T08:37:55.396005+0000 mgr.a (mgr.14373) 7822 : cluster [DBG] pgmap v5424: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:37:58.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:37:58 smithi157 bash[24585]: cluster 2024-09-16T08:37:57.398450+0000 mgr.a (mgr.14373) 7823 : cluster [DBG] pgmap v5425: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:37:58.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:37:58 smithi086 bash[24289]: cluster 2024-09-16T08:37:57.398450+0000 mgr.a (mgr.14373) 7823 : cluster [DBG] pgmap v5425: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:37:58.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:37:58 smithi047 bash[22744]: cluster 2024-09-16T08:37:57.398450+0000 mgr.a (mgr.14373) 7823 : cluster [DBG] pgmap v5425: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:37:59.873 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:37:59.874 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:37:59.874 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:38:00.689 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:38:00.690 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:38:00.690 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:38:00.690 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:38:00.690 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:38:00.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:38:00 smithi157 bash[24585]: cluster 2024-09-16T08:37:59.399240+0000 mgr.a (mgr.14373) 7824 : cluster [DBG] pgmap v5426: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:38:00.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:38:00 smithi086 bash[24289]: cluster 2024-09-16T08:37:59.399240+0000 mgr.a (mgr.14373) 7824 : cluster [DBG] pgmap v5426: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:38:00.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:38:00 smithi047 bash[22744]: cluster 2024-09-16T08:37:59.399240+0000 mgr.a (mgr.14373) 7824 : cluster [DBG] pgmap v5426: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:38:01.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:38:01 smithi157 bash[24585]: audit 2024-09-16T08:38:00.275600+0000 mgr.a (mgr.14373) 7825 : audit [DBG] from='client.175968 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:38:01.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:38:01 smithi086 bash[24289]: audit 2024-09-16T08:38:00.275600+0000 mgr.a (mgr.14373) 7825 : audit [DBG] from='client.175968 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:38:01.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:38:01 smithi047 bash[22744]: audit 2024-09-16T08:38:00.275600+0000 mgr.a (mgr.14373) 7825 : audit [DBG] from='client.175968 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:38:02.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:38:02 smithi157 bash[24585]: cluster 2024-09-16T08:38:01.401541+0000 mgr.a (mgr.14373) 7826 : cluster [DBG] pgmap v5427: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:38:02.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:38:02 smithi157 bash[24585]: audit 2024-09-16T08:38:01.917758+0000 mon.b (mon.2) 738 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T08:38:02.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:38:02 smithi086 bash[24289]: cluster 2024-09-16T08:38:01.401541+0000 mgr.a (mgr.14373) 7826 : cluster [DBG] pgmap v5427: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:38:02.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:38:02 smithi086 bash[24289]: audit 2024-09-16T08:38:01.917758+0000 mon.b (mon.2) 738 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T08:38:02.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:38:02 smithi047 bash[22744]: cluster 2024-09-16T08:38:01.401541+0000 mgr.a (mgr.14373) 7826 : cluster [DBG] pgmap v5427: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:38:02.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:38:02 smithi047 bash[22744]: audit 2024-09-16T08:38:01.917758+0000 mon.b (mon.2) 738 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T08:38:04.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:38:04 smithi157 bash[24585]: cluster 2024-09-16T08:38:03.402286+0000 mgr.a (mgr.14373) 7827 : cluster [DBG] pgmap v5428: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:38:04.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:38:04 smithi086 bash[24289]: cluster 2024-09-16T08:38:03.402286+0000 mgr.a (mgr.14373) 7827 : cluster [DBG] pgmap v5428: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:38:04.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:38:04 smithi047 bash[22744]: cluster 2024-09-16T08:38:03.402286+0000 mgr.a (mgr.14373) 7827 : cluster [DBG] pgmap v5428: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:38:05.691 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:38:05.692 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:38:05.692 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:38:06.485 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:38:06.486 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:38:06.486 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:38:06.486 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:38:06.486 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:38:06.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:38:06 smithi157 bash[24585]: cluster 2024-09-16T08:38:05.403093+0000 mgr.a (mgr.14373) 7828 : cluster [DBG] pgmap v5429: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:38:06.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:38:06 smithi086 bash[24289]: cluster 2024-09-16T08:38:05.403093+0000 mgr.a (mgr.14373) 7828 : cluster [DBG] pgmap v5429: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:38:06.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:38:06 smithi047 bash[22744]: cluster 2024-09-16T08:38:05.403093+0000 mgr.a (mgr.14373) 7828 : cluster [DBG] pgmap v5429: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:38:07.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:38:07 smithi157 bash[24585]: audit 2024-09-16T08:38:06.035264+0000 mgr.a (mgr.14373) 7829 : audit [DBG] from='client.176046 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:38:07.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:38:07 smithi086 bash[24289]: audit 2024-09-16T08:38:06.035264+0000 mgr.a (mgr.14373) 7829 : audit [DBG] from='client.176046 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:38:07.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:38:07 smithi047 bash[22744]: audit 2024-09-16T08:38:06.035264+0000 mgr.a (mgr.14373) 7829 : audit [DBG] from='client.176046 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:38:08.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:38:08 smithi157 bash[24585]: cluster 2024-09-16T08:38:07.405861+0000 mgr.a (mgr.14373) 7830 : cluster [DBG] pgmap v5430: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 22 KiB/s rd, 0 B/s wr, 35 op/s 2024-09-16T08:38:08.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:38:08 smithi086 bash[24289]: cluster 2024-09-16T08:38:07.405861+0000 mgr.a (mgr.14373) 7830 : cluster [DBG] pgmap v5430: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 22 KiB/s rd, 0 B/s wr, 35 op/s 2024-09-16T08:38:08.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:38:08 smithi047 bash[22744]: cluster 2024-09-16T08:38:07.405861+0000 mgr.a (mgr.14373) 7830 : cluster [DBG] pgmap v5430: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 22 KiB/s rd, 0 B/s wr, 35 op/s 2024-09-16T08:38:10.756 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:38:10 smithi047 bash[22744]: cluster 2024-09-16T08:38:09.406714+0000 mgr.a (mgr.14373) 7831 : cluster [DBG] pgmap v5431: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 21 KiB/s rd, 0 B/s wr, 34 op/s 2024-09-16T08:38:10.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:38:10 smithi157 bash[24585]: cluster 2024-09-16T08:38:09.406714+0000 mgr.a (mgr.14373) 7831 : cluster [DBG] pgmap v5431: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 21 KiB/s rd, 0 B/s wr, 34 op/s 2024-09-16T08:38:10.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:38:10 smithi086 bash[24289]: cluster 2024-09-16T08:38:09.406714+0000 mgr.a (mgr.14373) 7831 : cluster [DBG] pgmap v5431: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 21 KiB/s rd, 0 B/s wr, 34 op/s 2024-09-16T08:38:11.487 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:38:11.487 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:38:11.488 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:38:12.228 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:38:12.228 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:38:12.228 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:38:12.229 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:38:12.229 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:38:12.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:38:12 smithi157 bash[24585]: cluster 2024-09-16T08:38:11.408104+0000 mgr.a (mgr.14373) 7832 : cluster [DBG] pgmap v5432: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 22 KiB/s rd, 0 B/s wr, 34 op/s 2024-09-16T08:38:12.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:38:12 smithi157 bash[24585]: audit 2024-09-16T08:38:12.485900+0000 mon.a (mon.0) 1032 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:38:12.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:38:12 smithi157 bash[24585]: audit 2024-09-16T08:38:12.495513+0000 mon.a (mon.0) 1033 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:38:12.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:38:12 smithi157 bash[24585]: audit 2024-09-16T08:38:12.498739+0000 mon.b (mon.2) 739 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T08:38:12.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:38:12 smithi157 bash[24585]: audit 2024-09-16T08:38:12.501004+0000 mon.b (mon.2) 740 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T08:38:12.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:38:12 smithi086 bash[24289]: cluster 2024-09-16T08:38:11.408104+0000 mgr.a (mgr.14373) 7832 : cluster [DBG] pgmap v5432: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 22 KiB/s rd, 0 B/s wr, 34 op/s 2024-09-16T08:38:12.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:38:12 smithi086 bash[24289]: audit 2024-09-16T08:38:12.485900+0000 mon.a (mon.0) 1032 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:38:12.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:38:12 smithi086 bash[24289]: audit 2024-09-16T08:38:12.495513+0000 mon.a (mon.0) 1033 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:38:12.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:38:12 smithi086 bash[24289]: audit 2024-09-16T08:38:12.498739+0000 mon.b (mon.2) 739 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T08:38:12.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:38:12 smithi086 bash[24289]: audit 2024-09-16T08:38:12.501004+0000 mon.b (mon.2) 740 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T08:38:12.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:38:12 smithi047 bash[22744]: cluster 2024-09-16T08:38:11.408104+0000 mgr.a (mgr.14373) 7832 : cluster [DBG] pgmap v5432: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 22 KiB/s rd, 0 B/s wr, 34 op/s 2024-09-16T08:38:12.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:38:12 smithi047 bash[22744]: audit 2024-09-16T08:38:12.485900+0000 mon.a (mon.0) 1032 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:38:12.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:38:12 smithi047 bash[22744]: audit 2024-09-16T08:38:12.495513+0000 mon.a (mon.0) 1033 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:38:12.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:38:12 smithi047 bash[22744]: audit 2024-09-16T08:38:12.498739+0000 mon.b (mon.2) 739 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T08:38:12.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:38:12 smithi047 bash[22744]: audit 2024-09-16T08:38:12.501004+0000 mon.b (mon.2) 740 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T08:38:13.522 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 08:38:13 smithi047 bash[22994]: debug 2024-09-16T08:38:13.269+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T08:38:13.522 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 08:38:13 smithi047 bash[22994]: debug 2024-09-16T08:38:13.269+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T08:38:13.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:38:13 smithi157 bash[24585]: audit 2024-09-16T08:38:11.831185+0000 mgr.a (mgr.14373) 7833 : audit [DBG] from='client.176124 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:38:13.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:38:13 smithi157 bash[24585]: audit 2024-09-16T08:38:12.513138+0000 mon.a (mon.0) 1034 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:38:13.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:38:13 smithi157 bash[24585]: audit 2024-09-16T08:38:12.520741+0000 mon.b (mon.2) 741 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:38:13.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:38:13 smithi157 bash[24585]: audit 2024-09-16T08:38:12.525465+0000 mgr.a (mgr.14373) 7834 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:38:13.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:38:13 smithi086 bash[24289]: audit 2024-09-16T08:38:11.831185+0000 mgr.a (mgr.14373) 7833 : audit [DBG] from='client.176124 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:38:13.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:38:13 smithi086 bash[24289]: audit 2024-09-16T08:38:12.513138+0000 mon.a (mon.0) 1034 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:38:13.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:38:13 smithi086 bash[24289]: audit 2024-09-16T08:38:12.520741+0000 mon.b (mon.2) 741 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:38:13.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:38:13 smithi086 bash[24289]: audit 2024-09-16T08:38:12.525465+0000 mgr.a (mgr.14373) 7834 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:38:13.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:38:13 smithi047 bash[22744]: audit 2024-09-16T08:38:11.831185+0000 mgr.a (mgr.14373) 7833 : audit [DBG] from='client.176124 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:38:13.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:38:13 smithi047 bash[22744]: audit 2024-09-16T08:38:12.513138+0000 mon.a (mon.0) 1034 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:38:13.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:38:13 smithi047 bash[22744]: audit 2024-09-16T08:38:12.520741+0000 mon.b (mon.2) 741 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:38:13.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:38:13 smithi047 bash[22744]: audit 2024-09-16T08:38:12.525465+0000 mgr.a (mgr.14373) 7834 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:38:14.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:38:14 smithi157 bash[24585]: audit 2024-09-16T08:38:13.270952+0000 mgr.a (mgr.14373) 7835 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T08:38:14.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:38:14 smithi157 bash[24585]: cephadm 2024-09-16T08:38:13.273097+0000 mgr.a (mgr.14373) 7836 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T08:38:14.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:38:14 smithi157 bash[24585]: cluster 2024-09-16T08:38:13.409027+0000 mgr.a (mgr.14373) 7837 : cluster [DBG] pgmap v5433: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 21 KiB/s rd, 0 B/s wr, 34 op/s 2024-09-16T08:38:14.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:38:14 smithi086 bash[24289]: audit 2024-09-16T08:38:13.270952+0000 mgr.a (mgr.14373) 7835 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T08:38:14.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:38:14 smithi086 bash[24289]: cephadm 2024-09-16T08:38:13.273097+0000 mgr.a (mgr.14373) 7836 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T08:38:14.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:38:14 smithi086 bash[24289]: cluster 2024-09-16T08:38:13.409027+0000 mgr.a (mgr.14373) 7837 : cluster [DBG] pgmap v5433: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 21 KiB/s rd, 0 B/s wr, 34 op/s 2024-09-16T08:38:14.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:38:14 smithi047 bash[22744]: audit 2024-09-16T08:38:13.270952+0000 mgr.a (mgr.14373) 7835 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T08:38:14.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:38:14 smithi047 bash[22744]: cephadm 2024-09-16T08:38:13.273097+0000 mgr.a (mgr.14373) 7836 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T08:38:14.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:38:14 smithi047 bash[22744]: cluster 2024-09-16T08:38:13.409027+0000 mgr.a (mgr.14373) 7837 : cluster [DBG] pgmap v5433: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 21 KiB/s rd, 0 B/s wr, 34 op/s 2024-09-16T08:38:16.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:38:16 smithi157 bash[24585]: cluster 2024-09-16T08:38:15.409972+0000 mgr.a (mgr.14373) 7838 : cluster [DBG] pgmap v5434: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 21 KiB/s rd, 0 B/s wr, 34 op/s 2024-09-16T08:38:16.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:38:16 smithi086 bash[24289]: cluster 2024-09-16T08:38:15.409972+0000 mgr.a (mgr.14373) 7838 : cluster [DBG] pgmap v5434: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 21 KiB/s rd, 0 B/s wr, 34 op/s 2024-09-16T08:38:16.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:38:16 smithi047 bash[22744]: cluster 2024-09-16T08:38:15.409972+0000 mgr.a (mgr.14373) 7838 : cluster [DBG] pgmap v5434: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 21 KiB/s rd, 0 B/s wr, 34 op/s 2024-09-16T08:38:17.230 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:38:17.230 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:38:17.231 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:38:18.035 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:38:18.036 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:38:18.036 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:38:18.036 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:38:18.036 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:38:18.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:38:18 smithi157 bash[24585]: cluster 2024-09-16T08:38:17.412099+0000 mgr.a (mgr.14373) 7839 : cluster [DBG] pgmap v5435: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 27 KiB/s rd, 426 B/s wr, 40 op/s 2024-09-16T08:38:18.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:38:18 smithi157 bash[24585]: audit 2024-09-16T08:38:17.591386+0000 mgr.a (mgr.14373) 7840 : audit [DBG] from='client.176307 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:38:18.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:38:18 smithi086 bash[24289]: cluster 2024-09-16T08:38:17.412099+0000 mgr.a (mgr.14373) 7839 : cluster [DBG] pgmap v5435: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 27 KiB/s rd, 426 B/s wr, 40 op/s 2024-09-16T08:38:18.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:38:18 smithi086 bash[24289]: audit 2024-09-16T08:38:17.591386+0000 mgr.a (mgr.14373) 7840 : audit [DBG] from='client.176307 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:38:18.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:38:18 smithi047 bash[22744]: cluster 2024-09-16T08:38:17.412099+0000 mgr.a (mgr.14373) 7839 : cluster [DBG] pgmap v5435: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 27 KiB/s rd, 426 B/s wr, 40 op/s 2024-09-16T08:38:18.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:38:18 smithi047 bash[22744]: audit 2024-09-16T08:38:17.591386+0000 mgr.a (mgr.14373) 7840 : audit [DBG] from='client.176307 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:38:20.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:38:20 smithi157 bash[24585]: cluster 2024-09-16T08:38:19.412993+0000 mgr.a (mgr.14373) 7841 : cluster [DBG] pgmap v5436: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T08:38:20.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:38:20 smithi086 bash[24289]: cluster 2024-09-16T08:38:19.412993+0000 mgr.a (mgr.14373) 7841 : cluster [DBG] pgmap v5436: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T08:38:20.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:38:20 smithi047 bash[22744]: cluster 2024-09-16T08:38:19.412993+0000 mgr.a (mgr.14373) 7841 : cluster [DBG] pgmap v5436: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T08:38:22.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:38:22 smithi157 bash[24585]: cluster 2024-09-16T08:38:21.415159+0000 mgr.a (mgr.14373) 7842 : cluster [DBG] pgmap v5437: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 71 KiB/s rd, 426 B/s wr, 113 op/s 2024-09-16T08:38:22.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:38:22 smithi086 bash[24289]: cluster 2024-09-16T08:38:21.415159+0000 mgr.a (mgr.14373) 7842 : cluster [DBG] pgmap v5437: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 71 KiB/s rd, 426 B/s wr, 113 op/s 2024-09-16T08:38:22.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:38:22 smithi047 bash[22744]: cluster 2024-09-16T08:38:21.415159+0000 mgr.a (mgr.14373) 7842 : cluster [DBG] pgmap v5437: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 71 KiB/s rd, 426 B/s wr, 113 op/s 2024-09-16T08:38:23.037 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:38:23.038 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:38:23.038 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:38:23.803 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:38:23.803 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:38:23.803 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:38:23.803 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:38:23.803 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:38:24.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:38:24 smithi157 bash[24585]: audit 2024-09-16T08:38:23.373499+0000 mgr.a (mgr.14373) 7843 : audit [DBG] from='client.176385 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:38:24.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:38:24 smithi157 bash[24585]: cluster 2024-09-16T08:38:23.416205+0000 mgr.a (mgr.14373) 7844 : cluster [DBG] pgmap v5438: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 70 KiB/s rd, 426 B/s wr, 112 op/s 2024-09-16T08:38:24.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:38:24 smithi086 bash[24289]: audit 2024-09-16T08:38:23.373499+0000 mgr.a (mgr.14373) 7843 : audit [DBG] from='client.176385 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:38:24.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:38:24 smithi086 bash[24289]: cluster 2024-09-16T08:38:23.416205+0000 mgr.a (mgr.14373) 7844 : cluster [DBG] pgmap v5438: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 70 KiB/s rd, 426 B/s wr, 112 op/s 2024-09-16T08:38:24.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:38:24 smithi047 bash[22744]: audit 2024-09-16T08:38:23.373499+0000 mgr.a (mgr.14373) 7843 : audit [DBG] from='client.176385 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:38:24.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:38:24 smithi047 bash[22744]: cluster 2024-09-16T08:38:23.416205+0000 mgr.a (mgr.14373) 7844 : cluster [DBG] pgmap v5438: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 70 KiB/s rd, 426 B/s wr, 112 op/s 2024-09-16T08:38:26.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:38:26 smithi157 bash[24585]: cluster 2024-09-16T08:38:25.417172+0000 mgr.a (mgr.14373) 7845 : cluster [DBG] pgmap v5439: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 70 KiB/s rd, 426 B/s wr, 112 op/s 2024-09-16T08:38:26.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:38:26 smithi086 bash[24289]: cluster 2024-09-16T08:38:25.417172+0000 mgr.a (mgr.14373) 7845 : cluster [DBG] pgmap v5439: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 70 KiB/s rd, 426 B/s wr, 112 op/s 2024-09-16T08:38:26.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:38:26 smithi047 bash[22744]: cluster 2024-09-16T08:38:25.417172+0000 mgr.a (mgr.14373) 7845 : cluster [DBG] pgmap v5439: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 70 KiB/s rd, 426 B/s wr, 112 op/s 2024-09-16T08:38:28.805 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:38:28.805 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:38:28.805 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:38:28.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:38:28 smithi086 bash[24289]: cluster 2024-09-16T08:38:27.419467+0000 mgr.a (mgr.14373) 7846 : cluster [DBG] pgmap v5440: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 71 KiB/s rd, 426 B/s wr, 113 op/s 2024-09-16T08:38:28.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:38:28 smithi047 bash[22744]: cluster 2024-09-16T08:38:27.419467+0000 mgr.a (mgr.14373) 7846 : cluster [DBG] pgmap v5440: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 71 KiB/s rd, 426 B/s wr, 113 op/s 2024-09-16T08:38:29.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:38:28 smithi157 bash[24585]: cluster 2024-09-16T08:38:27.419467+0000 mgr.a (mgr.14373) 7846 : cluster [DBG] pgmap v5440: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 71 KiB/s rd, 426 B/s wr, 113 op/s 2024-09-16T08:38:29.583 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:38:29.583 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:38:29.583 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:38:29.583 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:38:29.583 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:38:30.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:38:30 smithi086 bash[24289]: audit 2024-09-16T08:38:29.142977+0000 mgr.a (mgr.14373) 7847 : audit [DBG] from='client.176454 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:38:30.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:38:30 smithi086 bash[24289]: cluster 2024-09-16T08:38:29.420151+0000 mgr.a (mgr.14373) 7848 : cluster [DBG] pgmap v5441: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 65 KiB/s rd, 0 B/s wr, 107 op/s 2024-09-16T08:38:30.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:38:30 smithi047 bash[22744]: audit 2024-09-16T08:38:29.142977+0000 mgr.a (mgr.14373) 7847 : audit [DBG] from='client.176454 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:38:30.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:38:30 smithi047 bash[22744]: cluster 2024-09-16T08:38:29.420151+0000 mgr.a (mgr.14373) 7848 : cluster [DBG] pgmap v5441: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 65 KiB/s rd, 0 B/s wr, 107 op/s 2024-09-16T08:38:31.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:38:30 smithi157 bash[24585]: audit 2024-09-16T08:38:29.142977+0000 mgr.a (mgr.14373) 7847 : audit [DBG] from='client.176454 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:38:31.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:38:30 smithi157 bash[24585]: cluster 2024-09-16T08:38:29.420151+0000 mgr.a (mgr.14373) 7848 : cluster [DBG] pgmap v5441: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 65 KiB/s rd, 0 B/s wr, 107 op/s 2024-09-16T08:38:32.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:38:32 smithi086 bash[24289]: cluster 2024-09-16T08:38:31.422545+0000 mgr.a (mgr.14373) 7849 : cluster [DBG] pgmap v5442: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 66 KiB/s rd, 0 B/s wr, 108 op/s 2024-09-16T08:38:32.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:38:32 smithi047 bash[22744]: cluster 2024-09-16T08:38:31.422545+0000 mgr.a (mgr.14373) 7849 : cluster [DBG] pgmap v5442: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 66 KiB/s rd, 0 B/s wr, 108 op/s 2024-09-16T08:38:33.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:38:32 smithi157 bash[24585]: cluster 2024-09-16T08:38:31.422545+0000 mgr.a (mgr.14373) 7849 : cluster [DBG] pgmap v5442: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 66 KiB/s rd, 0 B/s wr, 108 op/s 2024-09-16T08:38:34.584 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:38:34.585 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:38:34.585 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:38:34.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:38:34 smithi086 bash[24289]: cluster 2024-09-16T08:38:33.423366+0000 mgr.a (mgr.14373) 7850 : cluster [DBG] pgmap v5443: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:38:34.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:38:34 smithi047 bash[22744]: cluster 2024-09-16T08:38:33.423366+0000 mgr.a (mgr.14373) 7850 : cluster [DBG] pgmap v5443: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:38:35.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:38:34 smithi157 bash[24585]: cluster 2024-09-16T08:38:33.423366+0000 mgr.a (mgr.14373) 7850 : cluster [DBG] pgmap v5443: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:38:35.365 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:38:35.366 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:38:35.366 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:38:35.366 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:38:35.366 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:38:36.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:38:36 smithi047 bash[22744]: audit 2024-09-16T08:38:34.926155+0000 mgr.a (mgr.14373) 7851 : audit [DBG] from='client.176523 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:38:36.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:38:36 smithi047 bash[22744]: cluster 2024-09-16T08:38:35.424314+0000 mgr.a (mgr.14373) 7852 : cluster [DBG] pgmap v5444: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:38:37.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:38:36 smithi157 bash[24585]: audit 2024-09-16T08:38:34.926155+0000 mgr.a (mgr.14373) 7851 : audit [DBG] from='client.176523 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:38:37.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:38:36 smithi157 bash[24585]: cluster 2024-09-16T08:38:35.424314+0000 mgr.a (mgr.14373) 7852 : cluster [DBG] pgmap v5444: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:38:37.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:38:36 smithi086 bash[24289]: audit 2024-09-16T08:38:34.926155+0000 mgr.a (mgr.14373) 7851 : audit [DBG] from='client.176523 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:38:37.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:38:36 smithi086 bash[24289]: cluster 2024-09-16T08:38:35.424314+0000 mgr.a (mgr.14373) 7852 : cluster [DBG] pgmap v5444: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:38:38.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:38:38 smithi047 bash[22744]: cluster 2024-09-16T08:38:37.426526+0000 mgr.a (mgr.14373) 7853 : cluster [DBG] pgmap v5445: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:38:39.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:38:38 smithi157 bash[24585]: cluster 2024-09-16T08:38:37.426526+0000 mgr.a (mgr.14373) 7853 : cluster [DBG] pgmap v5445: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:38:39.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:38:38 smithi086 bash[24289]: cluster 2024-09-16T08:38:37.426526+0000 mgr.a (mgr.14373) 7853 : cluster [DBG] pgmap v5445: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:38:40.367 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:38:40.368 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:38:40.368 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:38:40.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:38:40 smithi047 bash[22744]: cluster 2024-09-16T08:38:39.427302+0000 mgr.a (mgr.14373) 7854 : cluster [DBG] pgmap v5446: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:38:41.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:38:40 smithi157 bash[24585]: cluster 2024-09-16T08:38:39.427302+0000 mgr.a (mgr.14373) 7854 : cluster [DBG] pgmap v5446: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:38:41.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:38:40 smithi086 bash[24289]: cluster 2024-09-16T08:38:39.427302+0000 mgr.a (mgr.14373) 7854 : cluster [DBG] pgmap v5446: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:38:41.149 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:38:41.150 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:38:41.150 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:38:41.150 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:38:41.150 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:38:41.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:38:41 smithi047 bash[22744]: audit 2024-09-16T08:38:40.708884+0000 mgr.a (mgr.14373) 7855 : audit [DBG] from='client.176598 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:38:42.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:38:41 smithi157 bash[24585]: audit 2024-09-16T08:38:40.708884+0000 mgr.a (mgr.14373) 7855 : audit [DBG] from='client.176598 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:38:42.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:38:41 smithi086 bash[24289]: audit 2024-09-16T08:38:40.708884+0000 mgr.a (mgr.14373) 7855 : audit [DBG] from='client.176598 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:38:43.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:38:42 smithi157 bash[24585]: cluster 2024-09-16T08:38:41.429657+0000 mgr.a (mgr.14373) 7856 : cluster [DBG] pgmap v5447: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:38:43.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:38:42 smithi086 bash[24289]: cluster 2024-09-16T08:38:41.429657+0000 mgr.a (mgr.14373) 7856 : cluster [DBG] pgmap v5447: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:38:43.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:38:42 smithi047 bash[22744]: cluster 2024-09-16T08:38:41.429657+0000 mgr.a (mgr.14373) 7856 : cluster [DBG] pgmap v5447: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:38:45.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:38:44 smithi157 bash[24585]: cluster 2024-09-16T08:38:43.430430+0000 mgr.a (mgr.14373) 7857 : cluster [DBG] pgmap v5448: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:38:45.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:38:44 smithi086 bash[24289]: cluster 2024-09-16T08:38:43.430430+0000 mgr.a (mgr.14373) 7857 : cluster [DBG] pgmap v5448: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:38:45.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:38:44 smithi047 bash[22744]: cluster 2024-09-16T08:38:43.430430+0000 mgr.a (mgr.14373) 7857 : cluster [DBG] pgmap v5448: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:38:46.151 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:38:46.152 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:38:46.152 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:38:46.932 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:38:46.932 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:38:46.932 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:38:46.932 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:38:46.932 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:38:47.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:38:46 smithi157 bash[24585]: cluster 2024-09-16T08:38:45.431137+0000 mgr.a (mgr.14373) 7858 : cluster [DBG] pgmap v5449: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:38:47.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:38:46 smithi086 bash[24289]: cluster 2024-09-16T08:38:45.431137+0000 mgr.a (mgr.14373) 7858 : cluster [DBG] pgmap v5449: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:38:47.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:38:46 smithi047 bash[22744]: cluster 2024-09-16T08:38:45.431137+0000 mgr.a (mgr.14373) 7858 : cluster [DBG] pgmap v5449: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:38:48.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:38:47 smithi157 bash[24585]: audit 2024-09-16T08:38:46.489998+0000 mgr.a (mgr.14373) 7859 : audit [DBG] from='client.176676 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:38:48.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:38:47 smithi086 bash[24289]: audit 2024-09-16T08:38:46.489998+0000 mgr.a (mgr.14373) 7859 : audit [DBG] from='client.176676 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:38:48.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:38:47 smithi047 bash[22744]: audit 2024-09-16T08:38:46.489998+0000 mgr.a (mgr.14373) 7859 : audit [DBG] from='client.176676 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:38:49.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:38:48 smithi157 bash[24585]: cluster 2024-09-16T08:38:47.433910+0000 mgr.a (mgr.14373) 7860 : cluster [DBG] pgmap v5450: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:38:49.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:38:48 smithi086 bash[24289]: cluster 2024-09-16T08:38:47.433910+0000 mgr.a (mgr.14373) 7860 : cluster [DBG] pgmap v5450: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:38:49.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:38:48 smithi047 bash[22744]: cluster 2024-09-16T08:38:47.433910+0000 mgr.a (mgr.14373) 7860 : cluster [DBG] pgmap v5450: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:38:51.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:38:50 smithi157 bash[24585]: cluster 2024-09-16T08:38:49.434713+0000 mgr.a (mgr.14373) 7861 : cluster [DBG] pgmap v5451: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:38:51.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:38:50 smithi086 bash[24289]: cluster 2024-09-16T08:38:49.434713+0000 mgr.a (mgr.14373) 7861 : cluster [DBG] pgmap v5451: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:38:51.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:38:50 smithi047 bash[22744]: cluster 2024-09-16T08:38:49.434713+0000 mgr.a (mgr.14373) 7861 : cluster [DBG] pgmap v5451: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:38:51.933 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:38:51.934 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:38:51.934 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:38:52.702 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:38:52.702 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:38:52.702 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:38:52.702 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:38:52.702 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:38:53.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:38:52 smithi157 bash[24585]: cluster 2024-09-16T08:38:51.436608+0000 mgr.a (mgr.14373) 7862 : cluster [DBG] pgmap v5452: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:38:53.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:38:52 smithi086 bash[24289]: cluster 2024-09-16T08:38:51.436608+0000 mgr.a (mgr.14373) 7862 : cluster [DBG] pgmap v5452: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:38:53.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:38:52 smithi047 bash[22744]: cluster 2024-09-16T08:38:51.436608+0000 mgr.a (mgr.14373) 7862 : cluster [DBG] pgmap v5452: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:38:54.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:38:53 smithi157 bash[24585]: audit 2024-09-16T08:38:52.270511+0000 mgr.a (mgr.14373) 7863 : audit [DBG] from='client.176754 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:38:54.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:38:53 smithi086 bash[24289]: audit 2024-09-16T08:38:52.270511+0000 mgr.a (mgr.14373) 7863 : audit [DBG] from='client.176754 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:38:54.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:38:53 smithi047 bash[22744]: audit 2024-09-16T08:38:52.270511+0000 mgr.a (mgr.14373) 7863 : audit [DBG] from='client.176754 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:38:55.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:38:54 smithi157 bash[24585]: cluster 2024-09-16T08:38:53.437478+0000 mgr.a (mgr.14373) 7864 : cluster [DBG] pgmap v5453: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:38:55.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:38:54 smithi086 bash[24289]: cluster 2024-09-16T08:38:53.437478+0000 mgr.a (mgr.14373) 7864 : cluster [DBG] pgmap v5453: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:38:55.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:38:54 smithi047 bash[22744]: cluster 2024-09-16T08:38:53.437478+0000 mgr.a (mgr.14373) 7864 : cluster [DBG] pgmap v5453: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:38:57.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:38:56 smithi157 bash[24585]: cluster 2024-09-16T08:38:55.438261+0000 mgr.a (mgr.14373) 7865 : cluster [DBG] pgmap v5454: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T08:38:57.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:38:56 smithi086 bash[24289]: cluster 2024-09-16T08:38:55.438261+0000 mgr.a (mgr.14373) 7865 : cluster [DBG] pgmap v5454: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T08:38:57.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:38:56 smithi047 bash[22744]: cluster 2024-09-16T08:38:55.438261+0000 mgr.a (mgr.14373) 7865 : cluster [DBG] pgmap v5454: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T08:38:57.703 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:38:57.704 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:38:57.704 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:38:58.450 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:38:58.450 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:38:58.450 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:38:58.450 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:38:58.450 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:38:59.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:38:58 smithi157 bash[24585]: cluster 2024-09-16T08:38:57.440493+0000 mgr.a (mgr.14373) 7866 : cluster [DBG] pgmap v5455: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:38:59.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:38:58 smithi086 bash[24289]: cluster 2024-09-16T08:38:57.440493+0000 mgr.a (mgr.14373) 7866 : cluster [DBG] pgmap v5455: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:38:59.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:38:58 smithi047 bash[22744]: cluster 2024-09-16T08:38:57.440493+0000 mgr.a (mgr.14373) 7866 : cluster [DBG] pgmap v5455: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:39:00.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:38:59 smithi157 bash[24585]: audit 2024-09-16T08:38:58.034842+0000 mgr.a (mgr.14373) 7867 : audit [DBG] from='client.176829 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:39:00.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:38:59 smithi086 bash[24289]: audit 2024-09-16T08:38:58.034842+0000 mgr.a (mgr.14373) 7867 : audit [DBG] from='client.176829 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:39:00.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:38:59 smithi047 bash[22744]: audit 2024-09-16T08:38:58.034842+0000 mgr.a (mgr.14373) 7867 : audit [DBG] from='client.176829 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:39:01.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:39:00 smithi157 bash[24585]: cluster 2024-09-16T08:38:59.441382+0000 mgr.a (mgr.14373) 7868 : cluster [DBG] pgmap v5456: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:39:01.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:39:00 smithi086 bash[24289]: cluster 2024-09-16T08:38:59.441382+0000 mgr.a (mgr.14373) 7868 : cluster [DBG] pgmap v5456: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:39:01.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:39:00 smithi047 bash[22744]: cluster 2024-09-16T08:38:59.441382+0000 mgr.a (mgr.14373) 7868 : cluster [DBG] pgmap v5456: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:39:03.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:39:02 smithi157 bash[24585]: cluster 2024-09-16T08:39:01.443524+0000 mgr.a (mgr.14373) 7869 : cluster [DBG] pgmap v5457: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:39:03.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:39:02 smithi086 bash[24289]: cluster 2024-09-16T08:39:01.443524+0000 mgr.a (mgr.14373) 7869 : cluster [DBG] pgmap v5457: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:39:03.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:39:02 smithi047 bash[22744]: cluster 2024-09-16T08:39:01.443524+0000 mgr.a (mgr.14373) 7869 : cluster [DBG] pgmap v5457: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:39:03.452 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:39:03.452 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:39:03.452 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:39:04.231 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:39:04.231 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:39:04.231 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:39:04.232 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:39:04.232 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:39:05.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:39:04 smithi157 bash[24585]: cluster 2024-09-16T08:39:03.444283+0000 mgr.a (mgr.14373) 7870 : cluster [DBG] pgmap v5458: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:39:05.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:39:04 smithi086 bash[24289]: cluster 2024-09-16T08:39:03.444283+0000 mgr.a (mgr.14373) 7870 : cluster [DBG] pgmap v5458: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:39:05.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:39:04 smithi047 bash[22744]: cluster 2024-09-16T08:39:03.444283+0000 mgr.a (mgr.14373) 7870 : cluster [DBG] pgmap v5458: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:39:06.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:39:05 smithi157 bash[24585]: audit 2024-09-16T08:39:03.793260+0000 mgr.a (mgr.14373) 7871 : audit [DBG] from='client.176904 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:39:06.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:39:05 smithi086 bash[24289]: audit 2024-09-16T08:39:03.793260+0000 mgr.a (mgr.14373) 7871 : audit [DBG] from='client.176904 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:39:06.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:39:05 smithi047 bash[22744]: audit 2024-09-16T08:39:03.793260+0000 mgr.a (mgr.14373) 7871 : audit [DBG] from='client.176904 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:39:07.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:39:06 smithi157 bash[24585]: cluster 2024-09-16T08:39:05.445194+0000 mgr.a (mgr.14373) 7872 : cluster [DBG] pgmap v5459: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:39:07.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:39:06 smithi086 bash[24289]: cluster 2024-09-16T08:39:05.445194+0000 mgr.a (mgr.14373) 7872 : cluster [DBG] pgmap v5459: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:39:07.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:39:06 smithi047 bash[22744]: cluster 2024-09-16T08:39:05.445194+0000 mgr.a (mgr.14373) 7872 : cluster [DBG] pgmap v5459: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:39:09.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:39:08 smithi157 bash[24585]: cluster 2024-09-16T08:39:07.447421+0000 mgr.a (mgr.14373) 7873 : cluster [DBG] pgmap v5460: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:39:09.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:39:08 smithi086 bash[24289]: cluster 2024-09-16T08:39:07.447421+0000 mgr.a (mgr.14373) 7873 : cluster [DBG] pgmap v5460: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:39:09.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:39:08 smithi047 bash[22744]: cluster 2024-09-16T08:39:07.447421+0000 mgr.a (mgr.14373) 7873 : cluster [DBG] pgmap v5460: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:39:09.233 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:39:09.233 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:39:09.234 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:39:10.007 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:39:10.007 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:39:10.008 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:39:10.008 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:39:10.008 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:39:11.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:39:10 smithi157 bash[24585]: cluster 2024-09-16T08:39:09.448143+0000 mgr.a (mgr.14373) 7874 : cluster [DBG] pgmap v5461: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:39:11.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:39:10 smithi157 bash[24585]: audit 2024-09-16T08:39:09.574100+0000 mgr.a (mgr.14373) 7875 : audit [DBG] from='client.176982 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:39:11.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:39:10 smithi086 bash[24289]: cluster 2024-09-16T08:39:09.448143+0000 mgr.a (mgr.14373) 7874 : cluster [DBG] pgmap v5461: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:39:11.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:39:10 smithi086 bash[24289]: audit 2024-09-16T08:39:09.574100+0000 mgr.a (mgr.14373) 7875 : audit [DBG] from='client.176982 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:39:11.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:39:10 smithi047 bash[22744]: cluster 2024-09-16T08:39:09.448143+0000 mgr.a (mgr.14373) 7874 : cluster [DBG] pgmap v5461: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:39:11.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:39:10 smithi047 bash[22744]: audit 2024-09-16T08:39:09.574100+0000 mgr.a (mgr.14373) 7875 : audit [DBG] from='client.176982 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:39:13.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:39:12 smithi157 bash[24585]: cluster 2024-09-16T08:39:11.450441+0000 mgr.a (mgr.14373) 7876 : cluster [DBG] pgmap v5462: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:39:13.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:39:12 smithi086 bash[24289]: cluster 2024-09-16T08:39:11.450441+0000 mgr.a (mgr.14373) 7876 : cluster [DBG] pgmap v5462: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:39:13.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:39:12 smithi047 bash[22744]: cluster 2024-09-16T08:39:11.450441+0000 mgr.a (mgr.14373) 7876 : cluster [DBG] pgmap v5462: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:39:14.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:39:13 smithi157 bash[24585]: audit 2024-09-16T08:39:13.335110+0000 mon.b (mon.2) 742 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T08:39:14.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:39:13 smithi086 bash[24289]: audit 2024-09-16T08:39:13.335110+0000 mon.b (mon.2) 742 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T08:39:14.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:39:13 smithi047 bash[22744]: audit 2024-09-16T08:39:13.335110+0000 mon.b (mon.2) 742 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T08:39:15.009 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:39:15.009 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:39:15.010 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:39:15.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:39:14 smithi157 bash[24585]: cluster 2024-09-16T08:39:13.451192+0000 mgr.a (mgr.14373) 7877 : cluster [DBG] pgmap v5463: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:39:15.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:39:14 smithi086 bash[24289]: cluster 2024-09-16T08:39:13.451192+0000 mgr.a (mgr.14373) 7877 : cluster [DBG] pgmap v5463: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:39:15.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:39:14 smithi047 bash[22744]: cluster 2024-09-16T08:39:13.451192+0000 mgr.a (mgr.14373) 7877 : cluster [DBG] pgmap v5463: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:39:15.771 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:39:15.771 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:39:15.771 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:39:15.771 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:39:15.771 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:39:17.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:39:16 smithi157 bash[24585]: audit 2024-09-16T08:39:15.347829+0000 mgr.a (mgr.14373) 7878 : audit [DBG] from='client.177060 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:39:17.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:39:16 smithi157 bash[24585]: cluster 2024-09-16T08:39:15.451725+0000 mgr.a (mgr.14373) 7879 : cluster [DBG] pgmap v5464: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:39:17.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:39:16 smithi086 bash[24289]: audit 2024-09-16T08:39:15.347829+0000 mgr.a (mgr.14373) 7878 : audit [DBG] from='client.177060 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:39:17.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:39:16 smithi086 bash[24289]: cluster 2024-09-16T08:39:15.451725+0000 mgr.a (mgr.14373) 7879 : cluster [DBG] pgmap v5464: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:39:17.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:39:16 smithi047 bash[22744]: audit 2024-09-16T08:39:15.347829+0000 mgr.a (mgr.14373) 7878 : audit [DBG] from='client.177060 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:39:17.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:39:16 smithi047 bash[22744]: cluster 2024-09-16T08:39:15.451725+0000 mgr.a (mgr.14373) 7879 : cluster [DBG] pgmap v5464: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:39:19.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:39:18 smithi157 bash[24585]: cluster 2024-09-16T08:39:17.454002+0000 mgr.a (mgr.14373) 7880 : cluster [DBG] pgmap v5465: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:39:19.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:39:18 smithi086 bash[24289]: cluster 2024-09-16T08:39:17.454002+0000 mgr.a (mgr.14373) 7880 : cluster [DBG] pgmap v5465: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:39:19.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:39:18 smithi047 bash[22744]: cluster 2024-09-16T08:39:17.454002+0000 mgr.a (mgr.14373) 7880 : cluster [DBG] pgmap v5465: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:39:20.773 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:39:20.773 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:39:20.774 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:39:20.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:39:20 smithi086 bash[24289]: cluster 2024-09-16T08:39:19.454787+0000 mgr.a (mgr.14373) 7881 : cluster [DBG] pgmap v5466: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:39:21.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:39:20 smithi157 bash[24585]: cluster 2024-09-16T08:39:19.454787+0000 mgr.a (mgr.14373) 7881 : cluster [DBG] pgmap v5466: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:39:21.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:39:20 smithi047 bash[22744]: cluster 2024-09-16T08:39:19.454787+0000 mgr.a (mgr.14373) 7881 : cluster [DBG] pgmap v5466: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:39:21.548 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:39:21.549 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:39:21.549 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:39:21.549 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:39:21.549 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:39:23.000 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:39:22 smithi086 bash[24289]: audit 2024-09-16T08:39:21.107290+0000 mgr.a (mgr.14373) 7882 : audit [DBG] from='client.177138 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:39:23.000 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:39:22 smithi086 bash[24289]: cluster 2024-09-16T08:39:21.456177+0000 mgr.a (mgr.14373) 7883 : cluster [DBG] pgmap v5467: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-16T08:39:23.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:39:22 smithi157 bash[24585]: audit 2024-09-16T08:39:21.107290+0000 mgr.a (mgr.14373) 7882 : audit [DBG] from='client.177138 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:39:23.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:39:22 smithi157 bash[24585]: cluster 2024-09-16T08:39:21.456177+0000 mgr.a (mgr.14373) 7883 : cluster [DBG] pgmap v5467: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-16T08:39:23.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:39:22 smithi047 bash[22744]: audit 2024-09-16T08:39:21.107290+0000 mgr.a (mgr.14373) 7882 : audit [DBG] from='client.177138 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:39:23.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:39:22 smithi047 bash[22744]: cluster 2024-09-16T08:39:21.456177+0000 mgr.a (mgr.14373) 7883 : cluster [DBG] pgmap v5467: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-16T08:39:24.838 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 08:39:24 smithi047 bash[22994]: debug 2024-09-16T08:39:24.528+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T08:39:24.838 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 08:39:24 smithi047 bash[22994]: debug 2024-09-16T08:39:24.532+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T08:39:24.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:39:24 smithi047 bash[22744]: cluster 2024-09-16T08:39:23.456932+0000 mgr.a (mgr.14373) 7884 : cluster [DBG] pgmap v5468: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T08:39:24.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:39:24 smithi047 bash[22744]: audit 2024-09-16T08:39:23.715538+0000 mon.a (mon.0) 1035 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:39:24.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:39:24 smithi047 bash[22744]: audit 2024-09-16T08:39:23.730533+0000 mon.a (mon.0) 1036 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:39:24.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:39:24 smithi047 bash[22744]: audit 2024-09-16T08:39:23.732694+0000 mon.b (mon.2) 743 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T08:39:24.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:39:24 smithi047 bash[22744]: audit 2024-09-16T08:39:23.735186+0000 mon.b (mon.2) 744 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T08:39:24.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:39:24 smithi047 bash[22744]: audit 2024-09-16T08:39:23.749321+0000 mon.a (mon.0) 1037 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:39:24.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:39:24 smithi047 bash[22744]: audit 2024-09-16T08:39:23.754097+0000 mon.b (mon.2) 745 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:39:24.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:39:24 smithi047 bash[22744]: audit 2024-09-16T08:39:23.759028+0000 mgr.a (mgr.14373) 7885 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:39:25.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:39:24 smithi157 bash[24585]: cluster 2024-09-16T08:39:23.456932+0000 mgr.a (mgr.14373) 7884 : cluster [DBG] pgmap v5468: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T08:39:25.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:39:24 smithi157 bash[24585]: audit 2024-09-16T08:39:23.715538+0000 mon.a (mon.0) 1035 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:39:25.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:39:24 smithi157 bash[24585]: audit 2024-09-16T08:39:23.730533+0000 mon.a (mon.0) 1036 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:39:25.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:39:24 smithi157 bash[24585]: audit 2024-09-16T08:39:23.732694+0000 mon.b (mon.2) 743 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T08:39:25.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:39:24 smithi157 bash[24585]: audit 2024-09-16T08:39:23.735186+0000 mon.b (mon.2) 744 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T08:39:25.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:39:24 smithi157 bash[24585]: audit 2024-09-16T08:39:23.749321+0000 mon.a (mon.0) 1037 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:39:25.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:39:24 smithi157 bash[24585]: audit 2024-09-16T08:39:23.754097+0000 mon.b (mon.2) 745 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:39:25.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:39:24 smithi157 bash[24585]: audit 2024-09-16T08:39:23.759028+0000 mgr.a (mgr.14373) 7885 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:39:25.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:39:24 smithi086 bash[24289]: cluster 2024-09-16T08:39:23.456932+0000 mgr.a (mgr.14373) 7884 : cluster [DBG] pgmap v5468: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T08:39:25.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:39:24 smithi086 bash[24289]: audit 2024-09-16T08:39:23.715538+0000 mon.a (mon.0) 1035 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:39:25.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:39:24 smithi086 bash[24289]: audit 2024-09-16T08:39:23.730533+0000 mon.a (mon.0) 1036 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:39:25.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:39:24 smithi086 bash[24289]: audit 2024-09-16T08:39:23.732694+0000 mon.b (mon.2) 743 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T08:39:25.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:39:24 smithi086 bash[24289]: audit 2024-09-16T08:39:23.735186+0000 mon.b (mon.2) 744 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T08:39:25.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:39:24 smithi086 bash[24289]: audit 2024-09-16T08:39:23.749321+0000 mon.a (mon.0) 1037 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:39:25.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:39:24 smithi086 bash[24289]: audit 2024-09-16T08:39:23.754097+0000 mon.b (mon.2) 745 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:39:25.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:39:24 smithi086 bash[24289]: audit 2024-09-16T08:39:23.759028+0000 mgr.a (mgr.14373) 7885 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:39:26.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:39:25 smithi157 bash[24585]: audit 2024-09-16T08:39:24.534165+0000 mgr.a (mgr.14373) 7886 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T08:39:26.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:39:25 smithi157 bash[24585]: cephadm 2024-09-16T08:39:24.536163+0000 mgr.a (mgr.14373) 7887 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T08:39:26.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:39:25 smithi086 bash[24289]: audit 2024-09-16T08:39:24.534165+0000 mgr.a (mgr.14373) 7886 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T08:39:26.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:39:25 smithi086 bash[24289]: cephadm 2024-09-16T08:39:24.536163+0000 mgr.a (mgr.14373) 7887 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T08:39:26.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:39:25 smithi047 bash[22744]: audit 2024-09-16T08:39:24.534165+0000 mgr.a (mgr.14373) 7886 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T08:39:26.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:39:25 smithi047 bash[22744]: cephadm 2024-09-16T08:39:24.536163+0000 mgr.a (mgr.14373) 7887 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T08:39:26.549 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:39:26.550 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:39:26.550 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:39:27.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:39:26 smithi157 bash[24585]: cluster 2024-09-16T08:39:25.457801+0000 mgr.a (mgr.14373) 7888 : cluster [DBG] pgmap v5469: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T08:39:27.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:39:26 smithi086 bash[24289]: cluster 2024-09-16T08:39:25.457801+0000 mgr.a (mgr.14373) 7888 : cluster [DBG] pgmap v5469: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T08:39:27.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:39:26 smithi047 bash[22744]: cluster 2024-09-16T08:39:25.457801+0000 mgr.a (mgr.14373) 7888 : cluster [DBG] pgmap v5469: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T08:39:27.326 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:39:27.327 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:39:27.327 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:39:27.327 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:39:27.327 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:39:29.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:39:28 smithi157 bash[24585]: audit 2024-09-16T08:39:26.889678+0000 mgr.a (mgr.14373) 7889 : audit [DBG] from='client.177318 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:39:29.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:39:28 smithi157 bash[24585]: cluster 2024-09-16T08:39:27.460073+0000 mgr.a (mgr.14373) 7890 : cluster [DBG] pgmap v5470: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:39:29.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:39:28 smithi086 bash[24289]: audit 2024-09-16T08:39:26.889678+0000 mgr.a (mgr.14373) 7889 : audit [DBG] from='client.177318 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:39:29.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:39:28 smithi086 bash[24289]: cluster 2024-09-16T08:39:27.460073+0000 mgr.a (mgr.14373) 7890 : cluster [DBG] pgmap v5470: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:39:29.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:39:28 smithi047 bash[22744]: audit 2024-09-16T08:39:26.889678+0000 mgr.a (mgr.14373) 7889 : audit [DBG] from='client.177318 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:39:29.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:39:28 smithi047 bash[22744]: cluster 2024-09-16T08:39:27.460073+0000 mgr.a (mgr.14373) 7890 : cluster [DBG] pgmap v5470: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:39:31.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:39:30 smithi157 bash[24585]: cluster 2024-09-16T08:39:29.460851+0000 mgr.a (mgr.14373) 7891 : cluster [DBG] pgmap v5471: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T08:39:31.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:39:30 smithi086 bash[24289]: cluster 2024-09-16T08:39:29.460851+0000 mgr.a (mgr.14373) 7891 : cluster [DBG] pgmap v5471: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T08:39:31.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:39:30 smithi047 bash[22744]: cluster 2024-09-16T08:39:29.460851+0000 mgr.a (mgr.14373) 7891 : cluster [DBG] pgmap v5471: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T08:39:32.328 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:39:32.329 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:39:32.329 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:39:33.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:39:32 smithi157 bash[24585]: cluster 2024-09-16T08:39:31.462769+0000 mgr.a (mgr.14373) 7892 : cluster [DBG] pgmap v5472: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:39:33.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:39:32 smithi086 bash[24289]: cluster 2024-09-16T08:39:31.462769+0000 mgr.a (mgr.14373) 7892 : cluster [DBG] pgmap v5472: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:39:33.085 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:39:33.085 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:39:33.085 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:39:33.086 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:39:33.086 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:39:33.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:39:32 smithi047 bash[22744]: cluster 2024-09-16T08:39:31.462769+0000 mgr.a (mgr.14373) 7892 : cluster [DBG] pgmap v5472: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:39:34.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:39:33 smithi157 bash[24585]: audit 2024-09-16T08:39:32.665378+0000 mgr.a (mgr.14373) 7893 : audit [DBG] from='client.177393 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:39:34.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:39:33 smithi086 bash[24289]: audit 2024-09-16T08:39:32.665378+0000 mgr.a (mgr.14373) 7893 : audit [DBG] from='client.177393 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:39:34.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:39:33 smithi047 bash[22744]: audit 2024-09-16T08:39:32.665378+0000 mgr.a (mgr.14373) 7893 : audit [DBG] from='client.177393 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:39:35.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:39:34 smithi157 bash[24585]: cluster 2024-09-16T08:39:33.463325+0000 mgr.a (mgr.14373) 7894 : cluster [DBG] pgmap v5473: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T08:39:35.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:39:34 smithi086 bash[24289]: cluster 2024-09-16T08:39:33.463325+0000 mgr.a (mgr.14373) 7894 : cluster [DBG] pgmap v5473: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T08:39:35.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:39:34 smithi047 bash[22744]: cluster 2024-09-16T08:39:33.463325+0000 mgr.a (mgr.14373) 7894 : cluster [DBG] pgmap v5473: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T08:39:37.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:39:36 smithi157 bash[24585]: cluster 2024-09-16T08:39:35.464079+0000 mgr.a (mgr.14373) 7895 : cluster [DBG] pgmap v5474: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T08:39:37.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:39:36 smithi086 bash[24289]: cluster 2024-09-16T08:39:35.464079+0000 mgr.a (mgr.14373) 7895 : cluster [DBG] pgmap v5474: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T08:39:37.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:39:36 smithi047 bash[22744]: cluster 2024-09-16T08:39:35.464079+0000 mgr.a (mgr.14373) 7895 : cluster [DBG] pgmap v5474: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T08:39:38.086 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:39:38.087 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:39:38.087 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:39:38.849 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:39:38.849 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:39:38.849 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:39:38.849 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:39:38.850 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:39:39.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:39:38 smithi157 bash[24585]: cluster 2024-09-16T08:39:37.466262+0000 mgr.a (mgr.14373) 7896 : cluster [DBG] pgmap v5475: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:39:39.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:39:38 smithi086 bash[24289]: cluster 2024-09-16T08:39:37.466262+0000 mgr.a (mgr.14373) 7896 : cluster [DBG] pgmap v5475: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:39:39.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:39:38 smithi047 bash[22744]: cluster 2024-09-16T08:39:37.466262+0000 mgr.a (mgr.14373) 7896 : cluster [DBG] pgmap v5475: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:39:40.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:39:39 smithi157 bash[24585]: audit 2024-09-16T08:39:38.426460+0000 mgr.a (mgr.14373) 7897 : audit [DBG] from='client.177471 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:39:40.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:39:39 smithi086 bash[24289]: audit 2024-09-16T08:39:38.426460+0000 mgr.a (mgr.14373) 7897 : audit [DBG] from='client.177471 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:39:40.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:39:39 smithi047 bash[22744]: audit 2024-09-16T08:39:38.426460+0000 mgr.a (mgr.14373) 7897 : audit [DBG] from='client.177471 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:39:41.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:39:40 smithi157 bash[24585]: cluster 2024-09-16T08:39:39.467173+0000 mgr.a (mgr.14373) 7898 : cluster [DBG] pgmap v5476: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:39:41.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:39:40 smithi086 bash[24289]: cluster 2024-09-16T08:39:39.467173+0000 mgr.a (mgr.14373) 7898 : cluster [DBG] pgmap v5476: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:39:41.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:39:40 smithi047 bash[22744]: cluster 2024-09-16T08:39:39.467173+0000 mgr.a (mgr.14373) 7898 : cluster [DBG] pgmap v5476: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:39:43.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:39:42 smithi157 bash[24585]: cluster 2024-09-16T08:39:41.469263+0000 mgr.a (mgr.14373) 7899 : cluster [DBG] pgmap v5477: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:39:43.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:39:42 smithi086 bash[24289]: cluster 2024-09-16T08:39:41.469263+0000 mgr.a (mgr.14373) 7899 : cluster [DBG] pgmap v5477: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:39:43.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:39:42 smithi047 bash[22744]: cluster 2024-09-16T08:39:41.469263+0000 mgr.a (mgr.14373) 7899 : cluster [DBG] pgmap v5477: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:39:43.850 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:39:43.851 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:39:43.851 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:39:44.601 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:39:44.601 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:39:44.601 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:39:44.601 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:39:44.602 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:39:45.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:39:44 smithi157 bash[24585]: cluster 2024-09-16T08:39:43.470005+0000 mgr.a (mgr.14373) 7900 : cluster [DBG] pgmap v5478: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:39:45.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:39:44 smithi086 bash[24289]: cluster 2024-09-16T08:39:43.470005+0000 mgr.a (mgr.14373) 7900 : cluster [DBG] pgmap v5478: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:39:45.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:39:44 smithi047 bash[22744]: cluster 2024-09-16T08:39:43.470005+0000 mgr.a (mgr.14373) 7900 : cluster [DBG] pgmap v5478: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:39:46.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:39:45 smithi157 bash[24585]: audit 2024-09-16T08:39:44.187595+0000 mgr.a (mgr.14373) 7901 : audit [DBG] from='client.177549 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:39:46.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:39:45 smithi086 bash[24289]: audit 2024-09-16T08:39:44.187595+0000 mgr.a (mgr.14373) 7901 : audit [DBG] from='client.177549 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:39:46.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:39:45 smithi047 bash[22744]: audit 2024-09-16T08:39:44.187595+0000 mgr.a (mgr.14373) 7901 : audit [DBG] from='client.177549 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:39:47.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:39:46 smithi157 bash[24585]: cluster 2024-09-16T08:39:45.470938+0000 mgr.a (mgr.14373) 7902 : cluster [DBG] pgmap v5479: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:39:47.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:39:46 smithi086 bash[24289]: cluster 2024-09-16T08:39:45.470938+0000 mgr.a (mgr.14373) 7902 : cluster [DBG] pgmap v5479: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:39:47.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:39:46 smithi047 bash[22744]: cluster 2024-09-16T08:39:45.470938+0000 mgr.a (mgr.14373) 7902 : cluster [DBG] pgmap v5479: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:39:49.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:39:48 smithi157 bash[24585]: cluster 2024-09-16T08:39:47.473136+0000 mgr.a (mgr.14373) 7903 : cluster [DBG] pgmap v5480: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:39:49.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:39:48 smithi086 bash[24289]: cluster 2024-09-16T08:39:47.473136+0000 mgr.a (mgr.14373) 7903 : cluster [DBG] pgmap v5480: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:39:49.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:39:48 smithi047 bash[22744]: cluster 2024-09-16T08:39:47.473136+0000 mgr.a (mgr.14373) 7903 : cluster [DBG] pgmap v5480: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:39:49.602 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:39:49.603 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:39:49.603 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:39:50.365 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:39:50.366 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:39:50.366 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:39:50.366 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:39:50.366 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:39:51.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:39:50 smithi157 bash[24585]: cluster 2024-09-16T08:39:49.473875+0000 mgr.a (mgr.14373) 7904 : cluster [DBG] pgmap v5481: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:39:51.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:39:50 smithi086 bash[24289]: cluster 2024-09-16T08:39:49.473875+0000 mgr.a (mgr.14373) 7904 : cluster [DBG] pgmap v5481: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:39:51.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:39:50 smithi047 bash[22744]: cluster 2024-09-16T08:39:49.473875+0000 mgr.a (mgr.14373) 7904 : cluster [DBG] pgmap v5481: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:39:52.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:39:51 smithi157 bash[24585]: audit 2024-09-16T08:39:49.947295+0000 mgr.a (mgr.14373) 7905 : audit [DBG] from='client.177624 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:39:52.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:39:51 smithi086 bash[24289]: audit 2024-09-16T08:39:49.947295+0000 mgr.a (mgr.14373) 7905 : audit [DBG] from='client.177624 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:39:52.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:39:51 smithi047 bash[22744]: audit 2024-09-16T08:39:49.947295+0000 mgr.a (mgr.14373) 7905 : audit [DBG] from='client.177624 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:39:53.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:39:52 smithi157 bash[24585]: cluster 2024-09-16T08:39:51.476089+0000 mgr.a (mgr.14373) 7906 : cluster [DBG] pgmap v5482: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:39:53.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:39:52 smithi086 bash[24289]: cluster 2024-09-16T08:39:51.476089+0000 mgr.a (mgr.14373) 7906 : cluster [DBG] pgmap v5482: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:39:53.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:39:52 smithi047 bash[22744]: cluster 2024-09-16T08:39:51.476089+0000 mgr.a (mgr.14373) 7906 : cluster [DBG] pgmap v5482: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:39:54.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:39:53 smithi086 bash[24289]: cluster 2024-09-16T08:39:53.476819+0000 mgr.a (mgr.14373) 7907 : cluster [DBG] pgmap v5483: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:39:54.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:39:53 smithi047 bash[22744]: cluster 2024-09-16T08:39:53.476819+0000 mgr.a (mgr.14373) 7907 : cluster [DBG] pgmap v5483: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:39:54.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:39:53 smithi157 bash[24585]: cluster 2024-09-16T08:39:53.476819+0000 mgr.a (mgr.14373) 7907 : cluster [DBG] pgmap v5483: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:39:55.367 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:39:55.368 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:39:55.368 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:39:56.109 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:39:56.109 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:39:56.109 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:39:56.109 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:39:56.109 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:39:56.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:39:56 smithi157 bash[24585]: cluster 2024-09-16T08:39:55.477234+0000 mgr.a (mgr.14373) 7908 : cluster [DBG] pgmap v5484: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:39:56.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:39:56 smithi157 bash[24585]: audit 2024-09-16T08:39:55.702485+0000 mgr.a (mgr.14373) 7909 : audit [DBG] from='client.177699 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:39:56.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:39:56 smithi086 bash[24289]: cluster 2024-09-16T08:39:55.477234+0000 mgr.a (mgr.14373) 7908 : cluster [DBG] pgmap v5484: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:39:56.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:39:56 smithi086 bash[24289]: audit 2024-09-16T08:39:55.702485+0000 mgr.a (mgr.14373) 7909 : audit [DBG] from='client.177699 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:39:56.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:39:56 smithi047 bash[22744]: cluster 2024-09-16T08:39:55.477234+0000 mgr.a (mgr.14373) 7908 : cluster [DBG] pgmap v5484: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:39:56.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:39:56 smithi047 bash[22744]: audit 2024-09-16T08:39:55.702485+0000 mgr.a (mgr.14373) 7909 : audit [DBG] from='client.177699 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:39:58.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:39:58 smithi157 bash[24585]: cluster 2024-09-16T08:39:57.479649+0000 mgr.a (mgr.14373) 7910 : cluster [DBG] pgmap v5485: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:39:58.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:39:58 smithi086 bash[24289]: cluster 2024-09-16T08:39:57.479649+0000 mgr.a (mgr.14373) 7910 : cluster [DBG] pgmap v5485: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:39:58.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:39:58 smithi047 bash[22744]: cluster 2024-09-16T08:39:57.479649+0000 mgr.a (mgr.14373) 7910 : cluster [DBG] pgmap v5485: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:40:00.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:40:00 smithi157 bash[24585]: cluster 2024-09-16T08:39:59.480560+0000 mgr.a (mgr.14373) 7911 : cluster [DBG] pgmap v5486: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:40:00.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:40:00 smithi157 bash[24585]: cluster 2024-09-16T08:40:00.000158+0000 mon.a (mon.0) 1038 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-16T08:40:00.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:40:00 smithi086 bash[24289]: cluster 2024-09-16T08:39:59.480560+0000 mgr.a (mgr.14373) 7911 : cluster [DBG] pgmap v5486: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:40:00.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:40:00 smithi086 bash[24289]: cluster 2024-09-16T08:40:00.000158+0000 mon.a (mon.0) 1038 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-16T08:40:00.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:40:00 smithi047 bash[22744]: cluster 2024-09-16T08:39:59.480560+0000 mgr.a (mgr.14373) 7911 : cluster [DBG] pgmap v5486: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:40:00.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:40:00 smithi047 bash[22744]: cluster 2024-09-16T08:40:00.000158+0000 mon.a (mon.0) 1038 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-16T08:40:01.110 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:40:01.111 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:40:01.111 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:40:01.886 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:40:01.886 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:40:01.886 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:40:01.886 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:40:01.886 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:40:02.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:40:02 smithi157 bash[24585]: audit 2024-09-16T08:40:01.451539+0000 mgr.a (mgr.14373) 7912 : audit [DBG] from='client.177777 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:40:02.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:40:02 smithi157 bash[24585]: cluster 2024-09-16T08:40:01.482013+0000 mgr.a (mgr.14373) 7913 : cluster [DBG] pgmap v5487: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:40:02.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:40:02 smithi086 bash[24289]: audit 2024-09-16T08:40:01.451539+0000 mgr.a (mgr.14373) 7912 : audit [DBG] from='client.177777 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:40:02.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:40:02 smithi086 bash[24289]: cluster 2024-09-16T08:40:01.482013+0000 mgr.a (mgr.14373) 7913 : cluster [DBG] pgmap v5487: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:40:02.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:40:02 smithi047 bash[22744]: audit 2024-09-16T08:40:01.451539+0000 mgr.a (mgr.14373) 7912 : audit [DBG] from='client.177777 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:40:02.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:40:02 smithi047 bash[22744]: cluster 2024-09-16T08:40:01.482013+0000 mgr.a (mgr.14373) 7913 : cluster [DBG] pgmap v5487: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:40:04.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:40:04 smithi157 bash[24585]: cluster 2024-09-16T08:40:03.483204+0000 mgr.a (mgr.14373) 7914 : cluster [DBG] pgmap v5488: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T08:40:04.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:40:04 smithi086 bash[24289]: cluster 2024-09-16T08:40:03.483204+0000 mgr.a (mgr.14373) 7914 : cluster [DBG] pgmap v5488: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T08:40:04.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:40:04 smithi047 bash[22744]: cluster 2024-09-16T08:40:03.483204+0000 mgr.a (mgr.14373) 7914 : cluster [DBG] pgmap v5488: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T08:40:06.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:40:06 smithi157 bash[24585]: cluster 2024-09-16T08:40:05.484042+0000 mgr.a (mgr.14373) 7915 : cluster [DBG] pgmap v5489: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T08:40:06.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:40:06 smithi086 bash[24289]: cluster 2024-09-16T08:40:05.484042+0000 mgr.a (mgr.14373) 7915 : cluster [DBG] pgmap v5489: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T08:40:06.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:40:06 smithi047 bash[22744]: cluster 2024-09-16T08:40:05.484042+0000 mgr.a (mgr.14373) 7915 : cluster [DBG] pgmap v5489: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T08:40:06.887 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:40:06.888 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:40:06.888 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:40:07.675 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:40:07.676 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:40:07.676 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:40:07.676 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:40:07.676 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:40:08.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:40:08 smithi086 bash[24289]: audit 2024-09-16T08:40:07.227682+0000 mgr.a (mgr.14373) 7916 : audit [DBG] from='client.177855 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:40:08.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:40:08 smithi086 bash[24289]: cluster 2024-09-16T08:40:07.485349+0000 mgr.a (mgr.14373) 7917 : cluster [DBG] pgmap v5490: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:40:08.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:40:08 smithi047 bash[22744]: audit 2024-09-16T08:40:07.227682+0000 mgr.a (mgr.14373) 7916 : audit [DBG] from='client.177855 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:40:08.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:40:08 smithi047 bash[22744]: cluster 2024-09-16T08:40:07.485349+0000 mgr.a (mgr.14373) 7917 : cluster [DBG] pgmap v5490: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:40:09.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:40:08 smithi157 bash[24585]: audit 2024-09-16T08:40:07.227682+0000 mgr.a (mgr.14373) 7916 : audit [DBG] from='client.177855 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:40:09.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:40:08 smithi157 bash[24585]: cluster 2024-09-16T08:40:07.485349+0000 mgr.a (mgr.14373) 7917 : cluster [DBG] pgmap v5490: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:40:10.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:40:10 smithi086 bash[24289]: cluster 2024-09-16T08:40:09.486498+0000 mgr.a (mgr.14373) 7918 : cluster [DBG] pgmap v5491: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T08:40:10.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:40:10 smithi047 bash[22744]: cluster 2024-09-16T08:40:09.486498+0000 mgr.a (mgr.14373) 7918 : cluster [DBG] pgmap v5491: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T08:40:11.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:40:10 smithi157 bash[24585]: cluster 2024-09-16T08:40:09.486498+0000 mgr.a (mgr.14373) 7918 : cluster [DBG] pgmap v5491: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T08:40:12.677 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:40:12.678 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:40:12.678 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:40:12.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:40:12 smithi086 bash[24289]: cluster 2024-09-16T08:40:11.488707+0000 mgr.a (mgr.14373) 7919 : cluster [DBG] pgmap v5492: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:40:12.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:40:12 smithi047 bash[22744]: cluster 2024-09-16T08:40:11.488707+0000 mgr.a (mgr.14373) 7919 : cluster [DBG] pgmap v5492: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:40:13.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:40:12 smithi157 bash[24585]: cluster 2024-09-16T08:40:11.488707+0000 mgr.a (mgr.14373) 7919 : cluster [DBG] pgmap v5492: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:40:13.444 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:40:13.445 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:40:13.445 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:40:13.445 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:40:13.445 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:40:14.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:40:14 smithi047 bash[22744]: audit 2024-09-16T08:40:13.014640+0000 mgr.a (mgr.14373) 7920 : audit [DBG] from='client.177930 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:40:14.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:40:14 smithi047 bash[22744]: cluster 2024-09-16T08:40:13.489453+0000 mgr.a (mgr.14373) 7921 : cluster [DBG] pgmap v5493: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:40:15.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:40:14 smithi157 bash[24585]: audit 2024-09-16T08:40:13.014640+0000 mgr.a (mgr.14373) 7920 : audit [DBG] from='client.177930 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:40:15.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:40:14 smithi157 bash[24585]: cluster 2024-09-16T08:40:13.489453+0000 mgr.a (mgr.14373) 7921 : cluster [DBG] pgmap v5493: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:40:15.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:40:14 smithi086 bash[24289]: audit 2024-09-16T08:40:13.014640+0000 mgr.a (mgr.14373) 7920 : audit [DBG] from='client.177930 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:40:15.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:40:14 smithi086 bash[24289]: cluster 2024-09-16T08:40:13.489453+0000 mgr.a (mgr.14373) 7921 : cluster [DBG] pgmap v5493: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:40:16.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:40:16 smithi047 bash[22744]: cluster 2024-09-16T08:40:15.490156+0000 mgr.a (mgr.14373) 7922 : cluster [DBG] pgmap v5494: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:40:17.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:40:16 smithi157 bash[24585]: cluster 2024-09-16T08:40:15.490156+0000 mgr.a (mgr.14373) 7922 : cluster [DBG] pgmap v5494: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:40:17.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:40:16 smithi086 bash[24289]: cluster 2024-09-16T08:40:15.490156+0000 mgr.a (mgr.14373) 7922 : cluster [DBG] pgmap v5494: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:40:18.446 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:40:18.447 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:40:18.447 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:40:18.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:40:18 smithi047 bash[22744]: cluster 2024-09-16T08:40:17.492361+0000 mgr.a (mgr.14373) 7923 : cluster [DBG] pgmap v5495: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:40:19.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:40:18 smithi157 bash[24585]: cluster 2024-09-16T08:40:17.492361+0000 mgr.a (mgr.14373) 7923 : cluster [DBG] pgmap v5495: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:40:19.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:40:18 smithi086 bash[24289]: cluster 2024-09-16T08:40:17.492361+0000 mgr.a (mgr.14373) 7923 : cluster [DBG] pgmap v5495: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:40:19.184 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:40:19.184 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:40:19.184 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:40:19.184 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:40:19.184 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:40:19.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:40:19 smithi047 bash[22744]: audit 2024-09-16T08:40:18.782067+0000 mgr.a (mgr.14373) 7924 : audit [DBG] from='client.178008 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:40:20.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:40:19 smithi157 bash[24585]: audit 2024-09-16T08:40:18.782067+0000 mgr.a (mgr.14373) 7924 : audit [DBG] from='client.178008 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:40:20.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:40:19 smithi086 bash[24289]: audit 2024-09-16T08:40:18.782067+0000 mgr.a (mgr.14373) 7924 : audit [DBG] from='client.178008 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:40:20.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:40:20 smithi047 bash[22744]: cluster 2024-09-16T08:40:19.493315+0000 mgr.a (mgr.14373) 7925 : cluster [DBG] pgmap v5496: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:40:21.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:40:20 smithi157 bash[24585]: cluster 2024-09-16T08:40:19.493315+0000 mgr.a (mgr.14373) 7925 : cluster [DBG] pgmap v5496: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:40:21.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:40:20 smithi086 bash[24289]: cluster 2024-09-16T08:40:19.493315+0000 mgr.a (mgr.14373) 7925 : cluster [DBG] pgmap v5496: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:40:23.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:40:22 smithi157 bash[24585]: cluster 2024-09-16T08:40:21.495505+0000 mgr.a (mgr.14373) 7926 : cluster [DBG] pgmap v5497: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:40:23.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:40:22 smithi086 bash[24289]: cluster 2024-09-16T08:40:21.495505+0000 mgr.a (mgr.14373) 7926 : cluster [DBG] pgmap v5497: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:40:23.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:40:22 smithi047 bash[22744]: cluster 2024-09-16T08:40:21.495505+0000 mgr.a (mgr.14373) 7926 : cluster [DBG] pgmap v5497: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:40:24.185 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:40:24.186 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:40:24.186 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:40:24.988 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:40:24.988 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:40:24.988 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:40:24.988 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:40:24.988 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:40:25.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:40:24 smithi157 bash[24585]: cluster 2024-09-16T08:40:23.496291+0000 mgr.a (mgr.14373) 7927 : cluster [DBG] pgmap v5498: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:40:25.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:40:24 smithi157 bash[24585]: audit 2024-09-16T08:40:24.589640+0000 mon.b (mon.2) 746 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T08:40:25.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:40:24 smithi086 bash[24289]: cluster 2024-09-16T08:40:23.496291+0000 mgr.a (mgr.14373) 7927 : cluster [DBG] pgmap v5498: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:40:25.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:40:24 smithi086 bash[24289]: audit 2024-09-16T08:40:24.589640+0000 mon.b (mon.2) 746 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T08:40:25.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:40:24 smithi047 bash[22744]: cluster 2024-09-16T08:40:23.496291+0000 mgr.a (mgr.14373) 7927 : cluster [DBG] pgmap v5498: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:40:25.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:40:24 smithi047 bash[22744]: audit 2024-09-16T08:40:24.589640+0000 mon.b (mon.2) 746 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T08:40:26.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:40:25 smithi157 bash[24585]: audit 2024-09-16T08:40:24.528905+0000 mgr.a (mgr.14373) 7928 : audit [DBG] from='client.178086 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:40:26.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:40:25 smithi086 bash[24289]: audit 2024-09-16T08:40:24.528905+0000 mgr.a (mgr.14373) 7928 : audit [DBG] from='client.178086 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:40:26.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:40:25 smithi047 bash[22744]: audit 2024-09-16T08:40:24.528905+0000 mgr.a (mgr.14373) 7928 : audit [DBG] from='client.178086 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:40:27.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:40:26 smithi157 bash[24585]: cluster 2024-09-16T08:40:25.497164+0000 mgr.a (mgr.14373) 7929 : cluster [DBG] pgmap v5499: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:40:27.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:40:26 smithi086 bash[24289]: cluster 2024-09-16T08:40:25.497164+0000 mgr.a (mgr.14373) 7929 : cluster [DBG] pgmap v5499: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:40:27.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:40:26 smithi047 bash[22744]: cluster 2024-09-16T08:40:25.497164+0000 mgr.a (mgr.14373) 7929 : cluster [DBG] pgmap v5499: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:40:29.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:40:28 smithi157 bash[24585]: cluster 2024-09-16T08:40:27.499421+0000 mgr.a (mgr.14373) 7930 : cluster [DBG] pgmap v5500: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:40:29.139 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:40:28 smithi047 bash[22744]: cluster 2024-09-16T08:40:27.499421+0000 mgr.a (mgr.14373) 7930 : cluster [DBG] pgmap v5500: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:40:29.139 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:40:28 smithi086 bash[24289]: cluster 2024-09-16T08:40:27.499421+0000 mgr.a (mgr.14373) 7930 : cluster [DBG] pgmap v5500: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:40:29.989 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:40:29.990 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:40:29.990 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:40:30.760 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:40:30.760 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:40:30.761 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:40:30.761 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:40:30.761 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:40:30.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:40:30 smithi157 bash[24585]: cluster 2024-09-16T08:40:29.500189+0000 mgr.a (mgr.14373) 7931 : cluster [DBG] pgmap v5501: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:40:31.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:40:30 smithi086 bash[24289]: cluster 2024-09-16T08:40:29.500189+0000 mgr.a (mgr.14373) 7931 : cluster [DBG] pgmap v5501: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:40:31.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:40:30 smithi047 bash[22744]: cluster 2024-09-16T08:40:29.500189+0000 mgr.a (mgr.14373) 7931 : cluster [DBG] pgmap v5501: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:40:31.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:40:31 smithi157 bash[24585]: audit 2024-09-16T08:40:30.327182+0000 mgr.a (mgr.14373) 7932 : audit [DBG] from='client.178164 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:40:32.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:40:31 smithi086 bash[24289]: audit 2024-09-16T08:40:30.327182+0000 mgr.a (mgr.14373) 7932 : audit [DBG] from='client.178164 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:40:32.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:40:31 smithi047 bash[22744]: audit 2024-09-16T08:40:30.327182+0000 mgr.a (mgr.14373) 7932 : audit [DBG] from='client.178164 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:40:33.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:40:32 smithi157 bash[24585]: cluster 2024-09-16T08:40:31.502513+0000 mgr.a (mgr.14373) 7933 : cluster [DBG] pgmap v5502: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:40:33.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:40:32 smithi086 bash[24289]: cluster 2024-09-16T08:40:31.502513+0000 mgr.a (mgr.14373) 7933 : cluster [DBG] pgmap v5502: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:40:33.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:40:32 smithi047 bash[22744]: cluster 2024-09-16T08:40:31.502513+0000 mgr.a (mgr.14373) 7933 : cluster [DBG] pgmap v5502: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:40:35.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:40:34 smithi157 bash[24585]: cluster 2024-09-16T08:40:33.503285+0000 mgr.a (mgr.14373) 7934 : cluster [DBG] pgmap v5503: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:40:35.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:40:34 smithi086 bash[24289]: cluster 2024-09-16T08:40:33.503285+0000 mgr.a (mgr.14373) 7934 : cluster [DBG] pgmap v5503: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:40:35.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:40:34 smithi047 bash[22744]: cluster 2024-09-16T08:40:33.503285+0000 mgr.a (mgr.14373) 7934 : cluster [DBG] pgmap v5503: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:40:35.764 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:40:35.765 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:40:35.765 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:40:36.087 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 08:40:35 smithi047 bash[22994]: debug 2024-09-16T08:40:35.758+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T08:40:36.088 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 08:40:35 smithi047 bash[22994]: debug 2024-09-16T08:40:35.762+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T08:40:36.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:40:35 smithi047 bash[22744]: audit 2024-09-16T08:40:34.956666+0000 mon.a (mon.0) 1039 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:40:36.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:40:35 smithi047 bash[22744]: audit 2024-09-16T08:40:34.966888+0000 mon.a (mon.0) 1040 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:40:36.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:40:35 smithi047 bash[22744]: audit 2024-09-16T08:40:34.967669+0000 mon.b (mon.2) 747 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T08:40:36.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:40:35 smithi047 bash[22744]: audit 2024-09-16T08:40:34.970234+0000 mon.b (mon.2) 748 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T08:40:36.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:40:35 smithi047 bash[22744]: audit 2024-09-16T08:40:34.984436+0000 mon.a (mon.0) 1041 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:40:36.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:40:35 smithi047 bash[22744]: audit 2024-09-16T08:40:34.988273+0000 mon.b (mon.2) 749 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:40:36.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:40:35 smithi047 bash[22744]: audit 2024-09-16T08:40:34.993130+0000 mgr.a (mgr.14373) 7935 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:40:36.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:40:35 smithi047 bash[22744]: cluster 2024-09-16T08:40:35.503826+0000 mgr.a (mgr.14373) 7936 : cluster [DBG] pgmap v5504: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:40:36.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:40:35 smithi047 bash[22744]: audit 2024-09-16T08:40:35.766114+0000 mgr.a (mgr.14373) 7937 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T08:40:36.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:40:35 smithi047 bash[22744]: cephadm 2024-09-16T08:40:35.767955+0000 mgr.a (mgr.14373) 7938 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T08:40:36.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:40:35 smithi157 bash[24585]: audit 2024-09-16T08:40:34.956666+0000 mon.a (mon.0) 1039 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:40:36.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:40:35 smithi157 bash[24585]: audit 2024-09-16T08:40:34.966888+0000 mon.a (mon.0) 1040 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:40:36.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:40:35 smithi157 bash[24585]: audit 2024-09-16T08:40:34.967669+0000 mon.b (mon.2) 747 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T08:40:36.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:40:35 smithi157 bash[24585]: audit 2024-09-16T08:40:34.970234+0000 mon.b (mon.2) 748 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T08:40:36.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:40:35 smithi157 bash[24585]: audit 2024-09-16T08:40:34.984436+0000 mon.a (mon.0) 1041 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:40:36.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:40:35 smithi157 bash[24585]: audit 2024-09-16T08:40:34.988273+0000 mon.b (mon.2) 749 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:40:36.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:40:35 smithi157 bash[24585]: audit 2024-09-16T08:40:34.993130+0000 mgr.a (mgr.14373) 7935 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:40:36.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:40:35 smithi157 bash[24585]: cluster 2024-09-16T08:40:35.503826+0000 mgr.a (mgr.14373) 7936 : cluster [DBG] pgmap v5504: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:40:36.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:40:35 smithi157 bash[24585]: audit 2024-09-16T08:40:35.766114+0000 mgr.a (mgr.14373) 7937 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T08:40:36.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:40:35 smithi157 bash[24585]: cephadm 2024-09-16T08:40:35.767955+0000 mgr.a (mgr.14373) 7938 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T08:40:36.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:40:35 smithi086 bash[24289]: audit 2024-09-16T08:40:34.956666+0000 mon.a (mon.0) 1039 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:40:36.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:40:35 smithi086 bash[24289]: audit 2024-09-16T08:40:34.966888+0000 mon.a (mon.0) 1040 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:40:36.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:40:35 smithi086 bash[24289]: audit 2024-09-16T08:40:34.967669+0000 mon.b (mon.2) 747 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T08:40:36.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:40:35 smithi086 bash[24289]: audit 2024-09-16T08:40:34.970234+0000 mon.b (mon.2) 748 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T08:40:36.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:40:35 smithi086 bash[24289]: audit 2024-09-16T08:40:34.984436+0000 mon.a (mon.0) 1041 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:40:36.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:40:35 smithi086 bash[24289]: audit 2024-09-16T08:40:34.988273+0000 mon.b (mon.2) 749 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:40:36.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:40:35 smithi086 bash[24289]: audit 2024-09-16T08:40:34.993130+0000 mgr.a (mgr.14373) 7935 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:40:36.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:40:35 smithi086 bash[24289]: cluster 2024-09-16T08:40:35.503826+0000 mgr.a (mgr.14373) 7936 : cluster [DBG] pgmap v5504: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:40:36.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:40:35 smithi086 bash[24289]: audit 2024-09-16T08:40:35.766114+0000 mgr.a (mgr.14373) 7937 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T08:40:36.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:40:35 smithi086 bash[24289]: cephadm 2024-09-16T08:40:35.767955+0000 mgr.a (mgr.14373) 7938 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T08:40:36.486 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:40:36.486 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:40:36.486 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:40:36.486 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:40:36.486 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:40:37.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:40:36 smithi157 bash[24585]: audit 2024-09-16T08:40:36.079855+0000 mgr.a (mgr.14373) 7939 : audit [DBG] from='client.178347 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:40:37.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:40:36 smithi086 bash[24289]: audit 2024-09-16T08:40:36.079855+0000 mgr.a (mgr.14373) 7939 : audit [DBG] from='client.178347 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:40:37.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:40:36 smithi047 bash[22744]: audit 2024-09-16T08:40:36.079855+0000 mgr.a (mgr.14373) 7939 : audit [DBG] from='client.178347 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:40:38.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:40:37 smithi157 bash[24585]: cluster 2024-09-16T08:40:37.506168+0000 mgr.a (mgr.14373) 7940 : cluster [DBG] pgmap v5505: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:40:38.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:40:37 smithi086 bash[24289]: cluster 2024-09-16T08:40:37.506168+0000 mgr.a (mgr.14373) 7940 : cluster [DBG] pgmap v5505: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:40:38.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:40:37 smithi047 bash[22744]: cluster 2024-09-16T08:40:37.506168+0000 mgr.a (mgr.14373) 7940 : cluster [DBG] pgmap v5505: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:40:40.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:40:40 smithi086 bash[24289]: cluster 2024-09-16T08:40:39.506942+0000 mgr.a (mgr.14373) 7941 : cluster [DBG] pgmap v5506: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T08:40:40.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:40:40 smithi047 bash[22744]: cluster 2024-09-16T08:40:39.506942+0000 mgr.a (mgr.14373) 7941 : cluster [DBG] pgmap v5506: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T08:40:41.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:40:40 smithi157 bash[24585]: cluster 2024-09-16T08:40:39.506942+0000 mgr.a (mgr.14373) 7941 : cluster [DBG] pgmap v5506: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T08:40:41.487 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:40:41.488 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:40:41.489 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:40:42.266 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:40:42.267 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:40:42.267 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:40:42.267 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:40:42.267 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:40:42.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:40:42 smithi086 bash[24289]: cluster 2024-09-16T08:40:41.508324+0000 mgr.a (mgr.14373) 7942 : cluster [DBG] pgmap v5507: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:40:42.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:40:42 smithi047 bash[22744]: cluster 2024-09-16T08:40:41.508324+0000 mgr.a (mgr.14373) 7942 : cluster [DBG] pgmap v5507: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:40:43.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:40:42 smithi157 bash[24585]: cluster 2024-09-16T08:40:41.508324+0000 mgr.a (mgr.14373) 7942 : cluster [DBG] pgmap v5507: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:40:43.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:40:43 smithi047 bash[22744]: audit 2024-09-16T08:40:41.831204+0000 mgr.a (mgr.14373) 7943 : audit [DBG] from='client.178422 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:40:44.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:40:43 smithi157 bash[24585]: audit 2024-09-16T08:40:41.831204+0000 mgr.a (mgr.14373) 7943 : audit [DBG] from='client.178422 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:40:44.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:40:43 smithi086 bash[24289]: audit 2024-09-16T08:40:41.831204+0000 mgr.a (mgr.14373) 7943 : audit [DBG] from='client.178422 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:40:44.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:40:44 smithi047 bash[22744]: cluster 2024-09-16T08:40:43.509262+0000 mgr.a (mgr.14373) 7944 : cluster [DBG] pgmap v5508: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T08:40:45.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:40:44 smithi157 bash[24585]: cluster 2024-09-16T08:40:43.509262+0000 mgr.a (mgr.14373) 7944 : cluster [DBG] pgmap v5508: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T08:40:45.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:40:44 smithi086 bash[24289]: cluster 2024-09-16T08:40:43.509262+0000 mgr.a (mgr.14373) 7944 : cluster [DBG] pgmap v5508: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T08:40:46.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:40:46 smithi047 bash[22744]: cluster 2024-09-16T08:40:45.510048+0000 mgr.a (mgr.14373) 7945 : cluster [DBG] pgmap v5509: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T08:40:47.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:40:46 smithi157 bash[24585]: cluster 2024-09-16T08:40:45.510048+0000 mgr.a (mgr.14373) 7945 : cluster [DBG] pgmap v5509: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T08:40:47.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:40:46 smithi086 bash[24289]: cluster 2024-09-16T08:40:45.510048+0000 mgr.a (mgr.14373) 7945 : cluster [DBG] pgmap v5509: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T08:40:47.268 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:40:47.269 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:40:47.269 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:40:48.040 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:40:48.040 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:40:48.040 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:40:48.040 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:40:48.040 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:40:48.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:40:48 smithi047 bash[22744]: cluster 2024-09-16T08:40:47.512191+0000 mgr.a (mgr.14373) 7946 : cluster [DBG] pgmap v5510: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:40:48.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:40:48 smithi047 bash[22744]: audit 2024-09-16T08:40:47.611659+0000 mgr.a (mgr.14373) 7947 : audit [DBG] from='client.178500 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:40:49.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:40:48 smithi157 bash[24585]: cluster 2024-09-16T08:40:47.512191+0000 mgr.a (mgr.14373) 7946 : cluster [DBG] pgmap v5510: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:40:49.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:40:48 smithi157 bash[24585]: audit 2024-09-16T08:40:47.611659+0000 mgr.a (mgr.14373) 7947 : audit [DBG] from='client.178500 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:40:49.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:40:48 smithi086 bash[24289]: cluster 2024-09-16T08:40:47.512191+0000 mgr.a (mgr.14373) 7946 : cluster [DBG] pgmap v5510: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:40:49.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:40:48 smithi086 bash[24289]: audit 2024-09-16T08:40:47.611659+0000 mgr.a (mgr.14373) 7947 : audit [DBG] from='client.178500 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:40:51.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:40:50 smithi157 bash[24585]: cluster 2024-09-16T08:40:49.513131+0000 mgr.a (mgr.14373) 7948 : cluster [DBG] pgmap v5511: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-16T08:40:51.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:40:50 smithi086 bash[24289]: cluster 2024-09-16T08:40:49.513131+0000 mgr.a (mgr.14373) 7948 : cluster [DBG] pgmap v5511: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-16T08:40:51.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:40:50 smithi047 bash[22744]: cluster 2024-09-16T08:40:49.513131+0000 mgr.a (mgr.14373) 7948 : cluster [DBG] pgmap v5511: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-16T08:40:53.041 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:40:53.042 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:40:53.042 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:40:53.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:40:52 smithi157 bash[24585]: cluster 2024-09-16T08:40:51.515294+0000 mgr.a (mgr.14373) 7949 : cluster [DBG] pgmap v5512: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-16T08:40:53.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:40:52 smithi086 bash[24289]: cluster 2024-09-16T08:40:51.515294+0000 mgr.a (mgr.14373) 7949 : cluster [DBG] pgmap v5512: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-16T08:40:53.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:40:52 smithi047 bash[22744]: cluster 2024-09-16T08:40:51.515294+0000 mgr.a (mgr.14373) 7949 : cluster [DBG] pgmap v5512: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-16T08:40:53.800 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:40:53.800 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:40:53.800 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:40:53.800 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:40:53.800 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:40:55.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:40:54 smithi157 bash[24585]: audit 2024-09-16T08:40:53.371948+0000 mgr.a (mgr.14373) 7950 : audit [DBG] from='client.178578 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:40:55.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:40:54 smithi157 bash[24585]: cluster 2024-09-16T08:40:53.516001+0000 mgr.a (mgr.14373) 7951 : cluster [DBG] pgmap v5513: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:40:55.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:40:54 smithi086 bash[24289]: audit 2024-09-16T08:40:53.371948+0000 mgr.a (mgr.14373) 7950 : audit [DBG] from='client.178578 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:40:55.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:40:54 smithi086 bash[24289]: cluster 2024-09-16T08:40:53.516001+0000 mgr.a (mgr.14373) 7951 : cluster [DBG] pgmap v5513: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:40:55.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:40:54 smithi047 bash[22744]: audit 2024-09-16T08:40:53.371948+0000 mgr.a (mgr.14373) 7950 : audit [DBG] from='client.178578 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:40:55.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:40:54 smithi047 bash[22744]: cluster 2024-09-16T08:40:53.516001+0000 mgr.a (mgr.14373) 7951 : cluster [DBG] pgmap v5513: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:40:57.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:40:56 smithi157 bash[24585]: cluster 2024-09-16T08:40:55.516974+0000 mgr.a (mgr.14373) 7952 : cluster [DBG] pgmap v5514: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:40:57.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:40:56 smithi086 bash[24289]: cluster 2024-09-16T08:40:55.516974+0000 mgr.a (mgr.14373) 7952 : cluster [DBG] pgmap v5514: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:40:57.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:40:56 smithi047 bash[22744]: cluster 2024-09-16T08:40:55.516974+0000 mgr.a (mgr.14373) 7952 : cluster [DBG] pgmap v5514: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:40:58.801 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:40:58.802 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:40:58.802 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:40:59.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:40:58 smithi157 bash[24585]: cluster 2024-09-16T08:40:57.519340+0000 mgr.a (mgr.14373) 7953 : cluster [DBG] pgmap v5515: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:40:59.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:40:58 smithi086 bash[24289]: cluster 2024-09-16T08:40:57.519340+0000 mgr.a (mgr.14373) 7953 : cluster [DBG] pgmap v5515: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:40:59.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:40:58 smithi047 bash[22744]: cluster 2024-09-16T08:40:57.519340+0000 mgr.a (mgr.14373) 7953 : cluster [DBG] pgmap v5515: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:40:59.584 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:40:59.585 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:40:59.585 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:40:59.585 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:40:59.585 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:41:01.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:41:00 smithi157 bash[24585]: audit 2024-09-16T08:40:59.140926+0000 mgr.a (mgr.14373) 7954 : audit [DBG] from='client.178653 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:41:01.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:41:00 smithi157 bash[24585]: cluster 2024-09-16T08:40:59.520384+0000 mgr.a (mgr.14373) 7955 : cluster [DBG] pgmap v5516: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:41:01.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:41:00 smithi086 bash[24289]: audit 2024-09-16T08:40:59.140926+0000 mgr.a (mgr.14373) 7954 : audit [DBG] from='client.178653 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:41:01.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:41:00 smithi086 bash[24289]: cluster 2024-09-16T08:40:59.520384+0000 mgr.a (mgr.14373) 7955 : cluster [DBG] pgmap v5516: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:41:01.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:41:00 smithi047 bash[22744]: audit 2024-09-16T08:40:59.140926+0000 mgr.a (mgr.14373) 7954 : audit [DBG] from='client.178653 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:41:01.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:41:00 smithi047 bash[22744]: cluster 2024-09-16T08:40:59.520384+0000 mgr.a (mgr.14373) 7955 : cluster [DBG] pgmap v5516: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:41:03.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:41:02 smithi157 bash[24585]: cluster 2024-09-16T08:41:01.522574+0000 mgr.a (mgr.14373) 7956 : cluster [DBG] pgmap v5517: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:41:03.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:41:02 smithi086 bash[24289]: cluster 2024-09-16T08:41:01.522574+0000 mgr.a (mgr.14373) 7956 : cluster [DBG] pgmap v5517: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:41:03.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:41:02 smithi047 bash[22744]: cluster 2024-09-16T08:41:01.522574+0000 mgr.a (mgr.14373) 7956 : cluster [DBG] pgmap v5517: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:41:04.586 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:41:04.586 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:41:04.587 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:41:05.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:41:04 smithi157 bash[24585]: cluster 2024-09-16T08:41:03.523486+0000 mgr.a (mgr.14373) 7957 : cluster [DBG] pgmap v5518: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:41:05.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:41:04 smithi086 bash[24289]: cluster 2024-09-16T08:41:03.523486+0000 mgr.a (mgr.14373) 7957 : cluster [DBG] pgmap v5518: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:41:05.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:41:04 smithi047 bash[22744]: cluster 2024-09-16T08:41:03.523486+0000 mgr.a (mgr.14373) 7957 : cluster [DBG] pgmap v5518: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:41:05.338 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:41:05.338 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:41:05.338 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:41:05.338 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:41:05.338 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:41:07.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:41:06 smithi157 bash[24585]: audit 2024-09-16T08:41:04.922424+0000 mgr.a (mgr.14373) 7958 : audit [DBG] from='client.178731 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:41:07.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:41:06 smithi157 bash[24585]: cluster 2024-09-16T08:41:05.524476+0000 mgr.a (mgr.14373) 7959 : cluster [DBG] pgmap v5519: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:41:07.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:41:06 smithi086 bash[24289]: audit 2024-09-16T08:41:04.922424+0000 mgr.a (mgr.14373) 7958 : audit [DBG] from='client.178731 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:41:07.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:41:06 smithi086 bash[24289]: cluster 2024-09-16T08:41:05.524476+0000 mgr.a (mgr.14373) 7959 : cluster [DBG] pgmap v5519: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:41:07.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:41:06 smithi047 bash[22744]: audit 2024-09-16T08:41:04.922424+0000 mgr.a (mgr.14373) 7958 : audit [DBG] from='client.178731 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:41:07.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:41:06 smithi047 bash[22744]: cluster 2024-09-16T08:41:05.524476+0000 mgr.a (mgr.14373) 7959 : cluster [DBG] pgmap v5519: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:41:09.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:41:08 smithi157 bash[24585]: cluster 2024-09-16T08:41:07.526758+0000 mgr.a (mgr.14373) 7960 : cluster [DBG] pgmap v5520: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:41:09.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:41:08 smithi086 bash[24289]: cluster 2024-09-16T08:41:07.526758+0000 mgr.a (mgr.14373) 7960 : cluster [DBG] pgmap v5520: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:41:09.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:41:08 smithi047 bash[22744]: cluster 2024-09-16T08:41:07.526758+0000 mgr.a (mgr.14373) 7960 : cluster [DBG] pgmap v5520: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:41:10.340 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:41:10.340 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:41:10.340 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:41:11.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:41:10 smithi157 bash[24585]: cluster 2024-09-16T08:41:09.527511+0000 mgr.a (mgr.14373) 7961 : cluster [DBG] pgmap v5521: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:41:11.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:41:10 smithi086 bash[24289]: cluster 2024-09-16T08:41:09.527511+0000 mgr.a (mgr.14373) 7961 : cluster [DBG] pgmap v5521: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:41:11.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:41:10 smithi047 bash[22744]: cluster 2024-09-16T08:41:09.527511+0000 mgr.a (mgr.14373) 7961 : cluster [DBG] pgmap v5521: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:41:11.110 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:41:11.111 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:41:11.111 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:41:11.111 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:41:11.111 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:41:12.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:41:11 smithi157 bash[24585]: audit 2024-09-16T08:41:10.678582+0000 mgr.a (mgr.14373) 7962 : audit [DBG] from='client.178809 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:41:12.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:41:11 smithi086 bash[24289]: audit 2024-09-16T08:41:10.678582+0000 mgr.a (mgr.14373) 7962 : audit [DBG] from='client.178809 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:41:12.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:41:11 smithi047 bash[22744]: audit 2024-09-16T08:41:10.678582+0000 mgr.a (mgr.14373) 7962 : audit [DBG] from='client.178809 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:41:13.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:41:12 smithi157 bash[24585]: cluster 2024-09-16T08:41:11.529835+0000 mgr.a (mgr.14373) 7963 : cluster [DBG] pgmap v5522: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:41:13.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:41:12 smithi086 bash[24289]: cluster 2024-09-16T08:41:11.529835+0000 mgr.a (mgr.14373) 7963 : cluster [DBG] pgmap v5522: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:41:13.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:41:12 smithi047 bash[22744]: cluster 2024-09-16T08:41:11.529835+0000 mgr.a (mgr.14373) 7963 : cluster [DBG] pgmap v5522: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:41:15.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:41:14 smithi157 bash[24585]: cluster 2024-09-16T08:41:13.530599+0000 mgr.a (mgr.14373) 7964 : cluster [DBG] pgmap v5523: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:41:15.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:41:14 smithi086 bash[24289]: cluster 2024-09-16T08:41:13.530599+0000 mgr.a (mgr.14373) 7964 : cluster [DBG] pgmap v5523: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:41:15.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:41:14 smithi047 bash[22744]: cluster 2024-09-16T08:41:13.530599+0000 mgr.a (mgr.14373) 7964 : cluster [DBG] pgmap v5523: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:41:16.113 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:41:16.113 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:41:16.113 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:41:16.899 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:41:16.900 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:41:16.900 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:41:16.900 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:41:16.900 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:41:17.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:41:16 smithi157 bash[24585]: cluster 2024-09-16T08:41:15.531500+0000 mgr.a (mgr.14373) 7965 : cluster [DBG] pgmap v5524: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:41:17.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:41:16 smithi086 bash[24289]: cluster 2024-09-16T08:41:15.531500+0000 mgr.a (mgr.14373) 7965 : cluster [DBG] pgmap v5524: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:41:17.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:41:16 smithi047 bash[22744]: cluster 2024-09-16T08:41:15.531500+0000 mgr.a (mgr.14373) 7965 : cluster [DBG] pgmap v5524: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:41:18.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:41:17 smithi157 bash[24585]: audit 2024-09-16T08:41:16.454359+0000 mgr.a (mgr.14373) 7966 : audit [DBG] from='client.178887 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:41:18.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:41:17 smithi086 bash[24289]: audit 2024-09-16T08:41:16.454359+0000 mgr.a (mgr.14373) 7966 : audit [DBG] from='client.178887 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:41:18.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:41:17 smithi047 bash[22744]: audit 2024-09-16T08:41:16.454359+0000 mgr.a (mgr.14373) 7966 : audit [DBG] from='client.178887 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:41:19.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:41:18 smithi157 bash[24585]: cluster 2024-09-16T08:41:17.534522+0000 mgr.a (mgr.14373) 7967 : cluster [DBG] pgmap v5525: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:41:19.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:41:18 smithi086 bash[24289]: cluster 2024-09-16T08:41:17.534522+0000 mgr.a (mgr.14373) 7967 : cluster [DBG] pgmap v5525: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:41:19.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:41:18 smithi047 bash[22744]: cluster 2024-09-16T08:41:17.534522+0000 mgr.a (mgr.14373) 7967 : cluster [DBG] pgmap v5525: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:41:21.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:41:20 smithi157 bash[24585]: cluster 2024-09-16T08:41:19.535359+0000 mgr.a (mgr.14373) 7968 : cluster [DBG] pgmap v5526: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:41:21.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:41:20 smithi086 bash[24289]: cluster 2024-09-16T08:41:19.535359+0000 mgr.a (mgr.14373) 7968 : cluster [DBG] pgmap v5526: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:41:21.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:41:20 smithi047 bash[22744]: cluster 2024-09-16T08:41:19.535359+0000 mgr.a (mgr.14373) 7968 : cluster [DBG] pgmap v5526: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:41:21.901 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:41:21.902 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:41:21.902 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:41:22.673 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:41:22.674 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:41:22.674 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:41:22.674 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:41:22.674 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:41:23.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:41:22 smithi157 bash[24585]: cluster 2024-09-16T08:41:21.537407+0000 mgr.a (mgr.14373) 7969 : cluster [DBG] pgmap v5527: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:41:23.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:41:22 smithi086 bash[24289]: cluster 2024-09-16T08:41:21.537407+0000 mgr.a (mgr.14373) 7969 : cluster [DBG] pgmap v5527: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:41:23.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:41:22 smithi047 bash[22744]: cluster 2024-09-16T08:41:21.537407+0000 mgr.a (mgr.14373) 7969 : cluster [DBG] pgmap v5527: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:41:24.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:41:23 smithi157 bash[24585]: audit 2024-09-16T08:41:22.243148+0000 mgr.a (mgr.14373) 7970 : audit [DBG] from='client.178965 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:41:24.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:41:23 smithi086 bash[24289]: audit 2024-09-16T08:41:22.243148+0000 mgr.a (mgr.14373) 7970 : audit [DBG] from='client.178965 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:41:24.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:41:23 smithi047 bash[22744]: audit 2024-09-16T08:41:22.243148+0000 mgr.a (mgr.14373) 7970 : audit [DBG] from='client.178965 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:41:25.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:41:24 smithi157 bash[24585]: cluster 2024-09-16T08:41:23.538450+0000 mgr.a (mgr.14373) 7971 : cluster [DBG] pgmap v5528: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:41:25.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:41:24 smithi086 bash[24289]: cluster 2024-09-16T08:41:23.538450+0000 mgr.a (mgr.14373) 7971 : cluster [DBG] pgmap v5528: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:41:25.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:41:24 smithi047 bash[22744]: cluster 2024-09-16T08:41:23.538450+0000 mgr.a (mgr.14373) 7971 : cluster [DBG] pgmap v5528: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:41:27.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:41:26 smithi157 bash[24585]: cluster 2024-09-16T08:41:25.539240+0000 mgr.a (mgr.14373) 7972 : cluster [DBG] pgmap v5529: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:41:27.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:41:26 smithi086 bash[24289]: cluster 2024-09-16T08:41:25.539240+0000 mgr.a (mgr.14373) 7972 : cluster [DBG] pgmap v5529: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:41:27.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:41:26 smithi047 bash[22744]: cluster 2024-09-16T08:41:25.539240+0000 mgr.a (mgr.14373) 7972 : cluster [DBG] pgmap v5529: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:41:27.675 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:41:27.676 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:41:27.676 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:41:28.429 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:41:28.430 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:41:28.430 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:41:28.430 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:41:28.430 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:41:29.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:41:28 smithi157 bash[24585]: cluster 2024-09-16T08:41:27.541438+0000 mgr.a (mgr.14373) 7973 : cluster [DBG] pgmap v5530: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:41:29.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:41:28 smithi086 bash[24289]: cluster 2024-09-16T08:41:27.541438+0000 mgr.a (mgr.14373) 7973 : cluster [DBG] pgmap v5530: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:41:29.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:41:28 smithi047 bash[22744]: cluster 2024-09-16T08:41:27.541438+0000 mgr.a (mgr.14373) 7973 : cluster [DBG] pgmap v5530: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:41:30.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:41:29 smithi157 bash[24585]: audit 2024-09-16T08:41:28.012103+0000 mgr.a (mgr.14373) 7974 : audit [DBG] from='client.179040 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:41:30.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:41:29 smithi086 bash[24289]: audit 2024-09-16T08:41:28.012103+0000 mgr.a (mgr.14373) 7974 : audit [DBG] from='client.179040 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:41:30.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:41:29 smithi047 bash[22744]: audit 2024-09-16T08:41:28.012103+0000 mgr.a (mgr.14373) 7974 : audit [DBG] from='client.179040 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:41:31.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:41:30 smithi157 bash[24585]: cluster 2024-09-16T08:41:29.542383+0000 mgr.a (mgr.14373) 7975 : cluster [DBG] pgmap v5531: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:41:31.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:41:30 smithi086 bash[24289]: cluster 2024-09-16T08:41:29.542383+0000 mgr.a (mgr.14373) 7975 : cluster [DBG] pgmap v5531: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:41:31.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:41:30 smithi047 bash[22744]: cluster 2024-09-16T08:41:29.542383+0000 mgr.a (mgr.14373) 7975 : cluster [DBG] pgmap v5531: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:41:33.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:41:32 smithi157 bash[24585]: cluster 2024-09-16T08:41:31.544447+0000 mgr.a (mgr.14373) 7976 : cluster [DBG] pgmap v5532: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:41:33.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:41:32 smithi086 bash[24289]: cluster 2024-09-16T08:41:31.544447+0000 mgr.a (mgr.14373) 7976 : cluster [DBG] pgmap v5532: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:41:33.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:41:32 smithi047 bash[22744]: cluster 2024-09-16T08:41:31.544447+0000 mgr.a (mgr.14373) 7976 : cluster [DBG] pgmap v5532: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:41:33.431 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:41:33.432 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:41:33.432 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:41:34.198 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:41:34.198 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:41:34.199 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:41:34.199 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:41:34.199 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:41:35.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:41:34 smithi157 bash[24585]: cluster 2024-09-16T08:41:33.545218+0000 mgr.a (mgr.14373) 7977 : cluster [DBG] pgmap v5533: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:41:35.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:41:34 smithi157 bash[24585]: audit 2024-09-16T08:41:33.769808+0000 mgr.a (mgr.14373) 7978 : audit [DBG] from='client.179115 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:41:35.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:41:34 smithi086 bash[24289]: cluster 2024-09-16T08:41:33.545218+0000 mgr.a (mgr.14373) 7977 : cluster [DBG] pgmap v5533: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:41:35.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:41:34 smithi086 bash[24289]: audit 2024-09-16T08:41:33.769808+0000 mgr.a (mgr.14373) 7978 : audit [DBG] from='client.179115 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:41:35.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:41:34 smithi047 bash[22744]: cluster 2024-09-16T08:41:33.545218+0000 mgr.a (mgr.14373) 7977 : cluster [DBG] pgmap v5533: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:41:35.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:41:34 smithi047 bash[22744]: audit 2024-09-16T08:41:33.769808+0000 mgr.a (mgr.14373) 7978 : audit [DBG] from='client.179115 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:41:37.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:41:36 smithi157 bash[24585]: cluster 2024-09-16T08:41:35.546093+0000 mgr.a (mgr.14373) 7979 : cluster [DBG] pgmap v5534: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:41:37.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:41:36 smithi157 bash[24585]: audit 2024-09-16T08:41:35.818673+0000 mon.b (mon.2) 750 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T08:41:37.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:41:36 smithi157 bash[24585]: audit 2024-09-16T08:41:36.445351+0000 mon.a (mon.0) 1042 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:41:37.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:41:36 smithi157 bash[24585]: audit 2024-09-16T08:41:36.450056+0000 mon.a (mon.0) 1043 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:41:37.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:41:36 smithi086 bash[24289]: cluster 2024-09-16T08:41:35.546093+0000 mgr.a (mgr.14373) 7979 : cluster [DBG] pgmap v5534: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:41:37.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:41:36 smithi086 bash[24289]: audit 2024-09-16T08:41:35.818673+0000 mon.b (mon.2) 750 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T08:41:37.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:41:36 smithi086 bash[24289]: audit 2024-09-16T08:41:36.445351+0000 mon.a (mon.0) 1042 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:41:37.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:41:36 smithi086 bash[24289]: audit 2024-09-16T08:41:36.450056+0000 mon.a (mon.0) 1043 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:41:37.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:41:36 smithi047 bash[22744]: cluster 2024-09-16T08:41:35.546093+0000 mgr.a (mgr.14373) 7979 : cluster [DBG] pgmap v5534: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:41:37.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:41:36 smithi047 bash[22744]: audit 2024-09-16T08:41:35.818673+0000 mon.b (mon.2) 750 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T08:41:37.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:41:36 smithi047 bash[22744]: audit 2024-09-16T08:41:36.445351+0000 mon.a (mon.0) 1042 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:41:37.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:41:36 smithi047 bash[22744]: audit 2024-09-16T08:41:36.450056+0000 mon.a (mon.0) 1043 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:41:38.541 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:41:38 smithi047 bash[22744]: audit 2024-09-16T08:41:37.094716+0000 mon.a (mon.0) 1044 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:41:38.541 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:41:38 smithi047 bash[22744]: audit 2024-09-16T08:41:37.099079+0000 mon.a (mon.0) 1045 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:41:38.541 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:41:38 smithi047 bash[22744]: audit 2024-09-16T08:41:37.102994+0000 mon.a (mon.0) 1046 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:41:38.541 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:41:38 smithi047 bash[22744]: audit 2024-09-16T08:41:37.105747+0000 mon.a (mon.0) 1047 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:41:38.541 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:41:38 smithi047 bash[22744]: cluster 2024-09-16T08:41:37.548257+0000 mgr.a (mgr.14373) 7980 : cluster [DBG] pgmap v5535: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:41:38.541 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:41:38 smithi047 bash[22744]: audit 2024-09-16T08:41:37.795259+0000 mon.a (mon.0) 1048 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:41:38.542 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:41:38 smithi047 bash[22744]: audit 2024-09-16T08:41:37.803727+0000 mon.a (mon.0) 1049 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:41:38.542 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:41:38 smithi047 bash[22744]: audit 2024-09-16T08:41:37.806895+0000 mon.b (mon.2) 751 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T08:41:38.542 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:41:38 smithi047 bash[22744]: audit 2024-09-16T08:41:37.808262+0000 mon.b (mon.2) 752 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T08:41:38.542 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:41:38 smithi047 bash[22744]: audit 2024-09-16T08:41:37.817486+0000 mon.a (mon.0) 1050 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:41:38.542 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:41:38 smithi047 bash[22744]: audit 2024-09-16T08:41:37.821598+0000 mon.b (mon.2) 753 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:41:38.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:41:38 smithi157 bash[24585]: audit 2024-09-16T08:41:37.094716+0000 mon.a (mon.0) 1044 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:41:38.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:41:38 smithi157 bash[24585]: audit 2024-09-16T08:41:37.099079+0000 mon.a (mon.0) 1045 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:41:38.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:41:38 smithi157 bash[24585]: audit 2024-09-16T08:41:37.102994+0000 mon.a (mon.0) 1046 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:41:38.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:41:38 smithi157 bash[24585]: audit 2024-09-16T08:41:37.105747+0000 mon.a (mon.0) 1047 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:41:38.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:41:38 smithi157 bash[24585]: cluster 2024-09-16T08:41:37.548257+0000 mgr.a (mgr.14373) 7980 : cluster [DBG] pgmap v5535: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:41:38.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:41:38 smithi157 bash[24585]: audit 2024-09-16T08:41:37.795259+0000 mon.a (mon.0) 1048 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:41:38.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:41:38 smithi157 bash[24585]: audit 2024-09-16T08:41:37.803727+0000 mon.a (mon.0) 1049 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:41:38.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:41:38 smithi157 bash[24585]: audit 2024-09-16T08:41:37.806895+0000 mon.b (mon.2) 751 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T08:41:38.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:41:38 smithi157 bash[24585]: audit 2024-09-16T08:41:37.808262+0000 mon.b (mon.2) 752 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T08:41:38.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:41:38 smithi157 bash[24585]: audit 2024-09-16T08:41:37.817486+0000 mon.a (mon.0) 1050 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:41:38.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:41:38 smithi157 bash[24585]: audit 2024-09-16T08:41:37.821598+0000 mon.b (mon.2) 753 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:41:38.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:41:38 smithi086 bash[24289]: audit 2024-09-16T08:41:37.094716+0000 mon.a (mon.0) 1044 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:41:38.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:41:38 smithi086 bash[24289]: audit 2024-09-16T08:41:37.099079+0000 mon.a (mon.0) 1045 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:41:38.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:41:38 smithi086 bash[24289]: audit 2024-09-16T08:41:37.102994+0000 mon.a (mon.0) 1046 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:41:38.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:41:38 smithi086 bash[24289]: audit 2024-09-16T08:41:37.105747+0000 mon.a (mon.0) 1047 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:41:38.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:41:38 smithi086 bash[24289]: cluster 2024-09-16T08:41:37.548257+0000 mgr.a (mgr.14373) 7980 : cluster [DBG] pgmap v5535: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:41:38.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:41:38 smithi086 bash[24289]: audit 2024-09-16T08:41:37.795259+0000 mon.a (mon.0) 1048 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:41:38.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:41:38 smithi086 bash[24289]: audit 2024-09-16T08:41:37.803727+0000 mon.a (mon.0) 1049 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:41:38.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:41:38 smithi086 bash[24289]: audit 2024-09-16T08:41:37.806895+0000 mon.b (mon.2) 751 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T08:41:38.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:41:38 smithi086 bash[24289]: audit 2024-09-16T08:41:37.808262+0000 mon.b (mon.2) 752 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T08:41:38.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:41:38 smithi086 bash[24289]: audit 2024-09-16T08:41:37.817486+0000 mon.a (mon.0) 1050 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:41:38.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:41:38 smithi086 bash[24289]: audit 2024-09-16T08:41:37.821598+0000 mon.b (mon.2) 753 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:41:38.837 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 08:41:38 smithi047 bash[22994]: debug 2024-09-16T08:41:38.541+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T08:41:38.837 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 08:41:38 smithi047 bash[22994]: debug 2024-09-16T08:41:38.545+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T08:41:39.200 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:41:39.201 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:41:39.201 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:41:39.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:41:39 smithi157 bash[24585]: audit 2024-09-16T08:41:37.825390+0000 mgr.a (mgr.14373) 7981 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:41:39.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:41:39 smithi157 bash[24585]: audit 2024-09-16T08:41:38.544417+0000 mgr.a (mgr.14373) 7982 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T08:41:39.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:41:39 smithi157 bash[24585]: cephadm 2024-09-16T08:41:38.546570+0000 mgr.a (mgr.14373) 7983 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T08:41:39.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:41:39 smithi086 bash[24289]: audit 2024-09-16T08:41:37.825390+0000 mgr.a (mgr.14373) 7981 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:41:39.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:41:39 smithi086 bash[24289]: audit 2024-09-16T08:41:38.544417+0000 mgr.a (mgr.14373) 7982 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T08:41:39.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:41:39 smithi086 bash[24289]: cephadm 2024-09-16T08:41:38.546570+0000 mgr.a (mgr.14373) 7983 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T08:41:39.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:41:39 smithi047 bash[22744]: audit 2024-09-16T08:41:37.825390+0000 mgr.a (mgr.14373) 7981 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:41:39.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:41:39 smithi047 bash[22744]: audit 2024-09-16T08:41:38.544417+0000 mgr.a (mgr.14373) 7982 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T08:41:39.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:41:39 smithi047 bash[22744]: cephadm 2024-09-16T08:41:38.546570+0000 mgr.a (mgr.14373) 7983 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T08:41:39.952 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:41:39.952 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:41:39.952 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:41:39.952 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:41:39.953 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:41:40.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:41:40 smithi157 bash[24585]: audit 2024-09-16T08:41:39.535654+0000 mgr.a (mgr.14373) 7984 : audit [DBG] from='client.179298 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:41:40.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:41:40 smithi157 bash[24585]: cluster 2024-09-16T08:41:39.553494+0000 mgr.a (mgr.14373) 7985 : cluster [DBG] pgmap v5536: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:41:40.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:41:40 smithi086 bash[24289]: audit 2024-09-16T08:41:39.535654+0000 mgr.a (mgr.14373) 7984 : audit [DBG] from='client.179298 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:41:40.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:41:40 smithi086 bash[24289]: cluster 2024-09-16T08:41:39.553494+0000 mgr.a (mgr.14373) 7985 : cluster [DBG] pgmap v5536: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:41:40.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:41:40 smithi047 bash[22744]: audit 2024-09-16T08:41:39.535654+0000 mgr.a (mgr.14373) 7984 : audit [DBG] from='client.179298 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:41:40.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:41:40 smithi047 bash[22744]: cluster 2024-09-16T08:41:39.553494+0000 mgr.a (mgr.14373) 7985 : cluster [DBG] pgmap v5536: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:41:43.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:41:42 smithi157 bash[24585]: cluster 2024-09-16T08:41:41.555759+0000 mgr.a (mgr.14373) 7986 : cluster [DBG] pgmap v5537: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:41:43.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:41:42 smithi086 bash[24289]: cluster 2024-09-16T08:41:41.555759+0000 mgr.a (mgr.14373) 7986 : cluster [DBG] pgmap v5537: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:41:43.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:41:42 smithi047 bash[22744]: cluster 2024-09-16T08:41:41.555759+0000 mgr.a (mgr.14373) 7986 : cluster [DBG] pgmap v5537: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:41:44.954 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:41:44.954 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:41:44.954 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:41:45.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:41:44 smithi157 bash[24585]: cluster 2024-09-16T08:41:43.556548+0000 mgr.a (mgr.14373) 7987 : cluster [DBG] pgmap v5538: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:41:45.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:41:44 smithi086 bash[24289]: cluster 2024-09-16T08:41:43.556548+0000 mgr.a (mgr.14373) 7987 : cluster [DBG] pgmap v5538: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:41:45.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:41:44 smithi047 bash[22744]: cluster 2024-09-16T08:41:43.556548+0000 mgr.a (mgr.14373) 7987 : cluster [DBG] pgmap v5538: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:41:45.729 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:41:45.729 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:41:45.729 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:41:45.729 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:41:45.729 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:41:47.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:41:46 smithi157 bash[24585]: audit 2024-09-16T08:41:45.294363+0000 mgr.a (mgr.14373) 7988 : audit [DBG] from='client.179370 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:41:47.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:41:46 smithi157 bash[24585]: cluster 2024-09-16T08:41:45.557213+0000 mgr.a (mgr.14373) 7989 : cluster [DBG] pgmap v5539: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:41:47.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:41:46 smithi086 bash[24289]: audit 2024-09-16T08:41:45.294363+0000 mgr.a (mgr.14373) 7988 : audit [DBG] from='client.179370 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:41:47.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:41:46 smithi086 bash[24289]: cluster 2024-09-16T08:41:45.557213+0000 mgr.a (mgr.14373) 7989 : cluster [DBG] pgmap v5539: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:41:47.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:41:46 smithi047 bash[22744]: audit 2024-09-16T08:41:45.294363+0000 mgr.a (mgr.14373) 7988 : audit [DBG] from='client.179370 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:41:47.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:41:46 smithi047 bash[22744]: cluster 2024-09-16T08:41:45.557213+0000 mgr.a (mgr.14373) 7989 : cluster [DBG] pgmap v5539: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:41:49.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:41:48 smithi157 bash[24585]: cluster 2024-09-16T08:41:47.559515+0000 mgr.a (mgr.14373) 7990 : cluster [DBG] pgmap v5540: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:41:49.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:41:48 smithi086 bash[24289]: cluster 2024-09-16T08:41:47.559515+0000 mgr.a (mgr.14373) 7990 : cluster [DBG] pgmap v5540: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:41:49.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:41:48 smithi047 bash[22744]: cluster 2024-09-16T08:41:47.559515+0000 mgr.a (mgr.14373) 7990 : cluster [DBG] pgmap v5540: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:41:50.730 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:41:50.731 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:41:50.731 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:41:51.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:41:50 smithi157 bash[24585]: cluster 2024-09-16T08:41:49.560312+0000 mgr.a (mgr.14373) 7991 : cluster [DBG] pgmap v5541: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:41:51.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:41:50 smithi086 bash[24289]: cluster 2024-09-16T08:41:49.560312+0000 mgr.a (mgr.14373) 7991 : cluster [DBG] pgmap v5541: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:41:51.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:41:50 smithi047 bash[22744]: cluster 2024-09-16T08:41:49.560312+0000 mgr.a (mgr.14373) 7991 : cluster [DBG] pgmap v5541: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:41:51.503 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:41:51.503 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:41:51.503 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:41:51.503 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:41:51.503 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:41:53.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:41:52 smithi157 bash[24585]: audit 2024-09-16T08:41:51.070732+0000 mgr.a (mgr.14373) 7992 : audit [DBG] from='client.179442 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:41:53.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:41:52 smithi157 bash[24585]: cluster 2024-09-16T08:41:51.561411+0000 mgr.a (mgr.14373) 7993 : cluster [DBG] pgmap v5542: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:41:53.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:41:52 smithi086 bash[24289]: audit 2024-09-16T08:41:51.070732+0000 mgr.a (mgr.14373) 7992 : audit [DBG] from='client.179442 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:41:53.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:41:52 smithi086 bash[24289]: cluster 2024-09-16T08:41:51.561411+0000 mgr.a (mgr.14373) 7993 : cluster [DBG] pgmap v5542: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:41:53.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:41:52 smithi047 bash[22744]: audit 2024-09-16T08:41:51.070732+0000 mgr.a (mgr.14373) 7992 : audit [DBG] from='client.179442 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:41:53.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:41:52 smithi047 bash[22744]: cluster 2024-09-16T08:41:51.561411+0000 mgr.a (mgr.14373) 7993 : cluster [DBG] pgmap v5542: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:41:55.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:41:54 smithi157 bash[24585]: cluster 2024-09-16T08:41:53.562134+0000 mgr.a (mgr.14373) 7994 : cluster [DBG] pgmap v5543: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T08:41:55.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:41:54 smithi086 bash[24289]: cluster 2024-09-16T08:41:53.562134+0000 mgr.a (mgr.14373) 7994 : cluster [DBG] pgmap v5543: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T08:41:55.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:41:54 smithi047 bash[22744]: cluster 2024-09-16T08:41:53.562134+0000 mgr.a (mgr.14373) 7994 : cluster [DBG] pgmap v5543: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T08:41:56.504 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:41:56.505 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:41:56.505 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:41:57.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:41:56 smithi157 bash[24585]: cluster 2024-09-16T08:41:55.562903+0000 mgr.a (mgr.14373) 7995 : cluster [DBG] pgmap v5544: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T08:41:57.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:41:56 smithi086 bash[24289]: cluster 2024-09-16T08:41:55.562903+0000 mgr.a (mgr.14373) 7995 : cluster [DBG] pgmap v5544: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T08:41:57.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:41:56 smithi047 bash[22744]: cluster 2024-09-16T08:41:55.562903+0000 mgr.a (mgr.14373) 7995 : cluster [DBG] pgmap v5544: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T08:41:57.277 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:41:57.278 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:41:57.278 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:41:57.278 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:41:57.278 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:41:59.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:41:58 smithi157 bash[24585]: audit 2024-09-16T08:41:56.843356+0000 mgr.a (mgr.14373) 7996 : audit [DBG] from='client.179517 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:41:59.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:41:58 smithi157 bash[24585]: cluster 2024-09-16T08:41:57.565625+0000 mgr.a (mgr.14373) 7997 : cluster [DBG] pgmap v5545: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:41:59.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:41:58 smithi086 bash[24289]: audit 2024-09-16T08:41:56.843356+0000 mgr.a (mgr.14373) 7996 : audit [DBG] from='client.179517 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:41:59.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:41:58 smithi086 bash[24289]: cluster 2024-09-16T08:41:57.565625+0000 mgr.a (mgr.14373) 7997 : cluster [DBG] pgmap v5545: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:41:59.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:41:58 smithi047 bash[22744]: audit 2024-09-16T08:41:56.843356+0000 mgr.a (mgr.14373) 7996 : audit [DBG] from='client.179517 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:41:59.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:41:58 smithi047 bash[22744]: cluster 2024-09-16T08:41:57.565625+0000 mgr.a (mgr.14373) 7997 : cluster [DBG] pgmap v5545: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:42:01.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:42:00 smithi157 bash[24585]: cluster 2024-09-16T08:41:59.566435+0000 mgr.a (mgr.14373) 7998 : cluster [DBG] pgmap v5546: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T08:42:01.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:42:00 smithi086 bash[24289]: cluster 2024-09-16T08:41:59.566435+0000 mgr.a (mgr.14373) 7998 : cluster [DBG] pgmap v5546: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T08:42:01.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:42:00 smithi047 bash[22744]: cluster 2024-09-16T08:41:59.566435+0000 mgr.a (mgr.14373) 7998 : cluster [DBG] pgmap v5546: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T08:42:02.279 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:42:02.280 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:42:02.280 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:42:03.024 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:42:03.024 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:42:03.024 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:42:03.025 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:42:03.025 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:42:03.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:42:02 smithi157 bash[24585]: cluster 2024-09-16T08:42:01.568367+0000 mgr.a (mgr.14373) 7999 : cluster [DBG] pgmap v5547: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:42:03.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:42:02 smithi086 bash[24289]: cluster 2024-09-16T08:42:01.568367+0000 mgr.a (mgr.14373) 7999 : cluster [DBG] pgmap v5547: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:42:03.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:42:02 smithi047 bash[22744]: cluster 2024-09-16T08:42:01.568367+0000 mgr.a (mgr.14373) 7999 : cluster [DBG] pgmap v5547: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:42:04.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:42:03 smithi157 bash[24585]: audit 2024-09-16T08:42:02.615667+0000 mgr.a (mgr.14373) 8000 : audit [DBG] from='client.179592 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:42:04.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:42:03 smithi086 bash[24289]: audit 2024-09-16T08:42:02.615667+0000 mgr.a (mgr.14373) 8000 : audit [DBG] from='client.179592 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:42:04.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:42:03 smithi047 bash[22744]: audit 2024-09-16T08:42:02.615667+0000 mgr.a (mgr.14373) 8000 : audit [DBG] from='client.179592 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:42:05.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:42:04 smithi157 bash[24585]: cluster 2024-09-16T08:42:03.569292+0000 mgr.a (mgr.14373) 8001 : cluster [DBG] pgmap v5548: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-16T08:42:05.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:42:04 smithi086 bash[24289]: cluster 2024-09-16T08:42:03.569292+0000 mgr.a (mgr.14373) 8001 : cluster [DBG] pgmap v5548: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-16T08:42:05.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:42:04 smithi047 bash[22744]: cluster 2024-09-16T08:42:03.569292+0000 mgr.a (mgr.14373) 8001 : cluster [DBG] pgmap v5548: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-16T08:42:07.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:42:06 smithi157 bash[24585]: cluster 2024-09-16T08:42:05.570068+0000 mgr.a (mgr.14373) 8002 : cluster [DBG] pgmap v5549: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-16T08:42:07.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:42:06 smithi086 bash[24289]: cluster 2024-09-16T08:42:05.570068+0000 mgr.a (mgr.14373) 8002 : cluster [DBG] pgmap v5549: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-16T08:42:07.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:42:06 smithi047 bash[22744]: cluster 2024-09-16T08:42:05.570068+0000 mgr.a (mgr.14373) 8002 : cluster [DBG] pgmap v5549: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-16T08:42:08.026 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:42:08.026 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:42:08.026 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:42:08.785 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:42:08.785 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:42:08.785 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:42:08.785 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:42:08.786 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:42:09.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:42:08 smithi157 bash[24585]: cluster 2024-09-16T08:42:07.572306+0000 mgr.a (mgr.14373) 8003 : cluster [DBG] pgmap v5550: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-16T08:42:09.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:42:08 smithi086 bash[24289]: cluster 2024-09-16T08:42:07.572306+0000 mgr.a (mgr.14373) 8003 : cluster [DBG] pgmap v5550: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-16T08:42:09.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:42:08 smithi047 bash[22744]: cluster 2024-09-16T08:42:07.572306+0000 mgr.a (mgr.14373) 8003 : cluster [DBG] pgmap v5550: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-16T08:42:10.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:42:09 smithi157 bash[24585]: audit 2024-09-16T08:42:08.364162+0000 mgr.a (mgr.14373) 8004 : audit [DBG] from='client.179670 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:42:10.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:42:09 smithi086 bash[24289]: audit 2024-09-16T08:42:08.364162+0000 mgr.a (mgr.14373) 8004 : audit [DBG] from='client.179670 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:42:10.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:42:09 smithi047 bash[22744]: audit 2024-09-16T08:42:08.364162+0000 mgr.a (mgr.14373) 8004 : audit [DBG] from='client.179670 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:42:11.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:42:10 smithi157 bash[24585]: cluster 2024-09-16T08:42:09.573227+0000 mgr.a (mgr.14373) 8005 : cluster [DBG] pgmap v5551: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:42:11.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:42:10 smithi086 bash[24289]: cluster 2024-09-16T08:42:09.573227+0000 mgr.a (mgr.14373) 8005 : cluster [DBG] pgmap v5551: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:42:11.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:42:10 smithi047 bash[22744]: cluster 2024-09-16T08:42:09.573227+0000 mgr.a (mgr.14373) 8005 : cluster [DBG] pgmap v5551: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:42:13.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:42:12 smithi157 bash[24585]: cluster 2024-09-16T08:42:11.575386+0000 mgr.a (mgr.14373) 8006 : cluster [DBG] pgmap v5552: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:42:13.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:42:12 smithi086 bash[24289]: cluster 2024-09-16T08:42:11.575386+0000 mgr.a (mgr.14373) 8006 : cluster [DBG] pgmap v5552: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:42:13.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:42:12 smithi047 bash[22744]: cluster 2024-09-16T08:42:11.575386+0000 mgr.a (mgr.14373) 8006 : cluster [DBG] pgmap v5552: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:42:13.786 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:42:13.787 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:42:13.787 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:42:14.528 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:42:14.529 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:42:14.529 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:42:14.529 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:42:14.529 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:42:15.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:42:14 smithi157 bash[24585]: cluster 2024-09-16T08:42:13.576165+0000 mgr.a (mgr.14373) 8007 : cluster [DBG] pgmap v5553: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:42:15.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:42:14 smithi086 bash[24289]: cluster 2024-09-16T08:42:13.576165+0000 mgr.a (mgr.14373) 8007 : cluster [DBG] pgmap v5553: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:42:15.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:42:14 smithi047 bash[22744]: cluster 2024-09-16T08:42:13.576165+0000 mgr.a (mgr.14373) 8007 : cluster [DBG] pgmap v5553: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:42:16.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:42:15 smithi157 bash[24585]: audit 2024-09-16T08:42:14.117063+0000 mgr.a (mgr.14373) 8008 : audit [DBG] from='client.179748 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:42:16.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:42:15 smithi086 bash[24289]: audit 2024-09-16T08:42:14.117063+0000 mgr.a (mgr.14373) 8008 : audit [DBG] from='client.179748 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:42:16.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:42:15 smithi047 bash[22744]: audit 2024-09-16T08:42:14.117063+0000 mgr.a (mgr.14373) 8008 : audit [DBG] from='client.179748 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:42:17.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:42:16 smithi157 bash[24585]: cluster 2024-09-16T08:42:15.577057+0000 mgr.a (mgr.14373) 8009 : cluster [DBG] pgmap v5554: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:42:17.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:42:16 smithi086 bash[24289]: cluster 2024-09-16T08:42:15.577057+0000 mgr.a (mgr.14373) 8009 : cluster [DBG] pgmap v5554: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:42:17.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:42:16 smithi047 bash[22744]: cluster 2024-09-16T08:42:15.577057+0000 mgr.a (mgr.14373) 8009 : cluster [DBG] pgmap v5554: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:42:19.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:42:18 smithi157 bash[24585]: cluster 2024-09-16T08:42:17.579413+0000 mgr.a (mgr.14373) 8010 : cluster [DBG] pgmap v5555: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:42:19.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:42:18 smithi086 bash[24289]: cluster 2024-09-16T08:42:17.579413+0000 mgr.a (mgr.14373) 8010 : cluster [DBG] pgmap v5555: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:42:19.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:42:18 smithi047 bash[22744]: cluster 2024-09-16T08:42:17.579413+0000 mgr.a (mgr.14373) 8010 : cluster [DBG] pgmap v5555: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:42:19.530 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:42:19.530 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:42:19.531 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:42:20.311 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:42:20.311 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:42:20.311 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:42:20.311 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:42:20.312 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:42:21.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:42:20 smithi157 bash[24585]: cluster 2024-09-16T08:42:19.580348+0000 mgr.a (mgr.14373) 8011 : cluster [DBG] pgmap v5556: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:42:21.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:42:20 smithi086 bash[24289]: cluster 2024-09-16T08:42:19.580348+0000 mgr.a (mgr.14373) 8011 : cluster [DBG] pgmap v5556: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:42:21.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:42:20 smithi047 bash[22744]: cluster 2024-09-16T08:42:19.580348+0000 mgr.a (mgr.14373) 8011 : cluster [DBG] pgmap v5556: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:42:22.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:42:21 smithi157 bash[24585]: audit 2024-09-16T08:42:19.868272+0000 mgr.a (mgr.14373) 8012 : audit [DBG] from='client.179826 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:42:22.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:42:21 smithi086 bash[24289]: audit 2024-09-16T08:42:19.868272+0000 mgr.a (mgr.14373) 8012 : audit [DBG] from='client.179826 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:42:22.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:42:21 smithi047 bash[22744]: audit 2024-09-16T08:42:19.868272+0000 mgr.a (mgr.14373) 8012 : audit [DBG] from='client.179826 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:42:23.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:42:22 smithi157 bash[24585]: cluster 2024-09-16T08:42:21.582665+0000 mgr.a (mgr.14373) 8013 : cluster [DBG] pgmap v5557: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:42:23.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:42:22 smithi086 bash[24289]: cluster 2024-09-16T08:42:21.582665+0000 mgr.a (mgr.14373) 8013 : cluster [DBG] pgmap v5557: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:42:23.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:42:22 smithi047 bash[22744]: cluster 2024-09-16T08:42:21.582665+0000 mgr.a (mgr.14373) 8013 : cluster [DBG] pgmap v5557: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:42:25.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:42:24 smithi157 bash[24585]: cluster 2024-09-16T08:42:23.583435+0000 mgr.a (mgr.14373) 8014 : cluster [DBG] pgmap v5558: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:42:25.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:42:24 smithi086 bash[24289]: cluster 2024-09-16T08:42:23.583435+0000 mgr.a (mgr.14373) 8014 : cluster [DBG] pgmap v5558: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:42:25.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:42:24 smithi047 bash[22744]: cluster 2024-09-16T08:42:23.583435+0000 mgr.a (mgr.14373) 8014 : cluster [DBG] pgmap v5558: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:42:25.313 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:42:25.313 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:42:25.313 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:42:26.093 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:42:26.093 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:42:26.093 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:42:26.093 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:42:26.093 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:42:27.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:42:26 smithi157 bash[24585]: cluster 2024-09-16T08:42:25.584087+0000 mgr.a (mgr.14373) 8015 : cluster [DBG] pgmap v5559: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:42:27.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:42:26 smithi157 bash[24585]: audit 2024-09-16T08:42:25.650220+0000 mgr.a (mgr.14373) 8016 : audit [DBG] from='client.179904 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:42:27.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:42:26 smithi086 bash[24289]: cluster 2024-09-16T08:42:25.584087+0000 mgr.a (mgr.14373) 8015 : cluster [DBG] pgmap v5559: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:42:27.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:42:26 smithi086 bash[24289]: audit 2024-09-16T08:42:25.650220+0000 mgr.a (mgr.14373) 8016 : audit [DBG] from='client.179904 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:42:27.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:42:26 smithi047 bash[22744]: cluster 2024-09-16T08:42:25.584087+0000 mgr.a (mgr.14373) 8015 : cluster [DBG] pgmap v5559: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:42:27.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:42:26 smithi047 bash[22744]: audit 2024-09-16T08:42:25.650220+0000 mgr.a (mgr.14373) 8016 : audit [DBG] from='client.179904 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:42:29.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:42:28 smithi157 bash[24585]: cluster 2024-09-16T08:42:27.586483+0000 mgr.a (mgr.14373) 8017 : cluster [DBG] pgmap v5560: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:42:29.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:42:28 smithi086 bash[24289]: cluster 2024-09-16T08:42:27.586483+0000 mgr.a (mgr.14373) 8017 : cluster [DBG] pgmap v5560: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:42:29.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:42:28 smithi047 bash[22744]: cluster 2024-09-16T08:42:27.586483+0000 mgr.a (mgr.14373) 8017 : cluster [DBG] pgmap v5560: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:42:31.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:42:30 smithi157 bash[24585]: cluster 2024-09-16T08:42:29.587240+0000 mgr.a (mgr.14373) 8018 : cluster [DBG] pgmap v5561: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:42:31.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:42:30 smithi086 bash[24289]: cluster 2024-09-16T08:42:29.587240+0000 mgr.a (mgr.14373) 8018 : cluster [DBG] pgmap v5561: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:42:31.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:42:30 smithi047 bash[22744]: cluster 2024-09-16T08:42:29.587240+0000 mgr.a (mgr.14373) 8018 : cluster [DBG] pgmap v5561: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:42:31.094 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:42:31.095 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:42:31.096 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:42:31.851 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:42:31.851 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:42:31.851 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:42:31.851 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:42:31.851 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:42:33.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:42:32 smithi157 bash[24585]: audit 2024-09-16T08:42:31.430161+0000 mgr.a (mgr.14373) 8019 : audit [DBG] from='client.179982 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:42:33.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:42:32 smithi157 bash[24585]: cluster 2024-09-16T08:42:31.588920+0000 mgr.a (mgr.14373) 8020 : cluster [DBG] pgmap v5562: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:42:33.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:42:32 smithi086 bash[24289]: audit 2024-09-16T08:42:31.430161+0000 mgr.a (mgr.14373) 8019 : audit [DBG] from='client.179982 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:42:33.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:42:32 smithi086 bash[24289]: cluster 2024-09-16T08:42:31.588920+0000 mgr.a (mgr.14373) 8020 : cluster [DBG] pgmap v5562: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:42:33.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:42:32 smithi047 bash[22744]: audit 2024-09-16T08:42:31.430161+0000 mgr.a (mgr.14373) 8019 : audit [DBG] from='client.179982 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:42:33.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:42:32 smithi047 bash[22744]: cluster 2024-09-16T08:42:31.588920+0000 mgr.a (mgr.14373) 8020 : cluster [DBG] pgmap v5562: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:42:35.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:42:34 smithi157 bash[24585]: cluster 2024-09-16T08:42:33.589799+0000 mgr.a (mgr.14373) 8021 : cluster [DBG] pgmap v5563: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T08:42:35.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:42:34 smithi086 bash[24289]: cluster 2024-09-16T08:42:33.589799+0000 mgr.a (mgr.14373) 8021 : cluster [DBG] pgmap v5563: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T08:42:35.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:42:34 smithi047 bash[22744]: cluster 2024-09-16T08:42:33.589799+0000 mgr.a (mgr.14373) 8021 : cluster [DBG] pgmap v5563: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T08:42:36.852 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:42:36.853 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:42:36.853 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:42:37.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:42:36 smithi157 bash[24585]: cluster 2024-09-16T08:42:35.590576+0000 mgr.a (mgr.14373) 8022 : cluster [DBG] pgmap v5564: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T08:42:37.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:42:36 smithi086 bash[24289]: cluster 2024-09-16T08:42:35.590576+0000 mgr.a (mgr.14373) 8022 : cluster [DBG] pgmap v5564: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T08:42:37.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:42:36 smithi047 bash[22744]: cluster 2024-09-16T08:42:35.590576+0000 mgr.a (mgr.14373) 8022 : cluster [DBG] pgmap v5564: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T08:42:37.630 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:42:37.631 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:42:37.631 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:42:37.631 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:42:37.631 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:42:39.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:42:38 smithi157 bash[24585]: audit 2024-09-16T08:42:37.193023+0000 mgr.a (mgr.14373) 8023 : audit [DBG] from='client.180060 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:42:39.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:42:38 smithi157 bash[24585]: cluster 2024-09-16T08:42:37.591903+0000 mgr.a (mgr.14373) 8024 : cluster [DBG] pgmap v5565: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:42:39.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:42:38 smithi157 bash[24585]: audit 2024-09-16T08:42:38.598287+0000 mon.b (mon.2) 754 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T08:42:39.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:42:38 smithi086 bash[24289]: audit 2024-09-16T08:42:37.193023+0000 mgr.a (mgr.14373) 8023 : audit [DBG] from='client.180060 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:42:39.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:42:38 smithi086 bash[24289]: cluster 2024-09-16T08:42:37.591903+0000 mgr.a (mgr.14373) 8024 : cluster [DBG] pgmap v5565: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:42:39.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:42:38 smithi086 bash[24289]: audit 2024-09-16T08:42:38.598287+0000 mon.b (mon.2) 754 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T08:42:39.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:42:38 smithi047 bash[22744]: audit 2024-09-16T08:42:37.193023+0000 mgr.a (mgr.14373) 8023 : audit [DBG] from='client.180060 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:42:39.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:42:38 smithi047 bash[22744]: cluster 2024-09-16T08:42:37.591903+0000 mgr.a (mgr.14373) 8024 : cluster [DBG] pgmap v5565: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:42:39.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:42:38 smithi047 bash[22744]: audit 2024-09-16T08:42:38.598287+0000 mon.b (mon.2) 754 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T08:42:40.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:42:40 smithi157 bash[24585]: audit 2024-09-16T08:42:39.218557+0000 mon.a (mon.0) 1051 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:42:40.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:42:40 smithi157 bash[24585]: audit 2024-09-16T08:42:39.221606+0000 mon.a (mon.0) 1052 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:42:40.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:42:40 smithi157 bash[24585]: audit 2024-09-16T08:42:39.225823+0000 mon.a (mon.0) 1053 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:42:40.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:42:40 smithi157 bash[24585]: audit 2024-09-16T08:42:39.230408+0000 mon.a (mon.0) 1054 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:42:40.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:42:40 smithi157 bash[24585]: cluster 2024-09-16T08:42:39.592648+0000 mgr.a (mgr.14373) 8025 : cluster [DBG] pgmap v5566: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T08:42:40.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:42:40 smithi157 bash[24585]: audit 2024-09-16T08:42:39.896666+0000 mon.b (mon.2) 755 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T08:42:40.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:42:40 smithi157 bash[24585]: audit 2024-09-16T08:42:39.898705+0000 mon.b (mon.2) 756 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T08:42:40.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:42:40 smithi157 bash[24585]: audit 2024-09-16T08:42:39.910408+0000 mon.a (mon.0) 1055 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:42:40.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:42:40 smithi157 bash[24585]: audit 2024-09-16T08:42:39.916200+0000 mon.b (mon.2) 757 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:42:40.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:42:40 smithi086 bash[24289]: audit 2024-09-16T08:42:39.218557+0000 mon.a (mon.0) 1051 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:42:40.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:42:40 smithi086 bash[24289]: audit 2024-09-16T08:42:39.221606+0000 mon.a (mon.0) 1052 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:42:40.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:42:40 smithi086 bash[24289]: audit 2024-09-16T08:42:39.225823+0000 mon.a (mon.0) 1053 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:42:40.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:42:40 smithi086 bash[24289]: audit 2024-09-16T08:42:39.230408+0000 mon.a (mon.0) 1054 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:42:40.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:42:40 smithi086 bash[24289]: cluster 2024-09-16T08:42:39.592648+0000 mgr.a (mgr.14373) 8025 : cluster [DBG] pgmap v5566: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T08:42:40.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:42:40 smithi086 bash[24289]: audit 2024-09-16T08:42:39.896666+0000 mon.b (mon.2) 755 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T08:42:40.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:42:40 smithi086 bash[24289]: audit 2024-09-16T08:42:39.898705+0000 mon.b (mon.2) 756 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T08:42:40.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:42:40 smithi086 bash[24289]: audit 2024-09-16T08:42:39.910408+0000 mon.a (mon.0) 1055 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:42:40.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:42:40 smithi086 bash[24289]: audit 2024-09-16T08:42:39.916200+0000 mon.b (mon.2) 757 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:42:40.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:42:40 smithi047 bash[22744]: audit 2024-09-16T08:42:39.218557+0000 mon.a (mon.0) 1051 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:42:40.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:42:40 smithi047 bash[22744]: audit 2024-09-16T08:42:39.221606+0000 mon.a (mon.0) 1052 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:42:40.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:42:40 smithi047 bash[22744]: audit 2024-09-16T08:42:39.225823+0000 mon.a (mon.0) 1053 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:42:40.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:42:40 smithi047 bash[22744]: audit 2024-09-16T08:42:39.230408+0000 mon.a (mon.0) 1054 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:42:40.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:42:40 smithi047 bash[22744]: cluster 2024-09-16T08:42:39.592648+0000 mgr.a (mgr.14373) 8025 : cluster [DBG] pgmap v5566: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T08:42:40.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:42:40 smithi047 bash[22744]: audit 2024-09-16T08:42:39.896666+0000 mon.b (mon.2) 755 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T08:42:40.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:42:40 smithi047 bash[22744]: audit 2024-09-16T08:42:39.898705+0000 mon.b (mon.2) 756 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T08:42:40.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:42:40 smithi047 bash[22744]: audit 2024-09-16T08:42:39.910408+0000 mon.a (mon.0) 1055 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:42:40.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:42:40 smithi047 bash[22744]: audit 2024-09-16T08:42:39.916200+0000 mon.b (mon.2) 757 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:42:41.087 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 08:42:40 smithi047 bash[22994]: debug 2024-09-16T08:42:40.652+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T08:42:41.088 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 08:42:40 smithi047 bash[22994]: debug 2024-09-16T08:42:40.656+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T08:42:41.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:42:41 smithi157 bash[24585]: audit 2024-09-16T08:42:39.921202+0000 mgr.a (mgr.14373) 8026 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:42:41.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:42:41 smithi157 bash[24585]: audit 2024-09-16T08:42:40.657672+0000 mgr.a (mgr.14373) 8027 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T08:42:41.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:42:41 smithi157 bash[24585]: cephadm 2024-09-16T08:42:40.659543+0000 mgr.a (mgr.14373) 8028 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T08:42:41.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:42:41 smithi086 bash[24289]: audit 2024-09-16T08:42:39.921202+0000 mgr.a (mgr.14373) 8026 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:42:41.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:42:41 smithi086 bash[24289]: audit 2024-09-16T08:42:40.657672+0000 mgr.a (mgr.14373) 8027 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T08:42:41.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:42:41 smithi086 bash[24289]: cephadm 2024-09-16T08:42:40.659543+0000 mgr.a (mgr.14373) 8028 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T08:42:41.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:42:41 smithi047 bash[22744]: audit 2024-09-16T08:42:39.921202+0000 mgr.a (mgr.14373) 8026 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:42:41.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:42:41 smithi047 bash[22744]: audit 2024-09-16T08:42:40.657672+0000 mgr.a (mgr.14373) 8027 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T08:42:41.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:42:41 smithi047 bash[22744]: cephadm 2024-09-16T08:42:40.659543+0000 mgr.a (mgr.14373) 8028 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T08:42:42.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:42:42 smithi157 bash[24585]: cluster 2024-09-16T08:42:41.594843+0000 mgr.a (mgr.14373) 8029 : cluster [DBG] pgmap v5567: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:42:42.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:42:42 smithi086 bash[24289]: cluster 2024-09-16T08:42:41.594843+0000 mgr.a (mgr.14373) 8029 : cluster [DBG] pgmap v5567: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:42:42.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:42:42 smithi047 bash[22744]: cluster 2024-09-16T08:42:41.594843+0000 mgr.a (mgr.14373) 8029 : cluster [DBG] pgmap v5567: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:42:42.631 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:42:42.632 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:42:42.632 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:42:43.372 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:42:43.372 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:42:43.373 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:42:43.373 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:42:43.373 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:42:45.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:42:44 smithi157 bash[24585]: audit 2024-09-16T08:42:42.965133+0000 mgr.a (mgr.14373) 8030 : audit [DBG] from='client.180243 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:42:45.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:42:44 smithi157 bash[24585]: cluster 2024-09-16T08:42:43.595821+0000 mgr.a (mgr.14373) 8031 : cluster [DBG] pgmap v5568: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:42:45.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:42:44 smithi086 bash[24289]: audit 2024-09-16T08:42:42.965133+0000 mgr.a (mgr.14373) 8030 : audit [DBG] from='client.180243 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:42:45.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:42:44 smithi086 bash[24289]: cluster 2024-09-16T08:42:43.595821+0000 mgr.a (mgr.14373) 8031 : cluster [DBG] pgmap v5568: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:42:45.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:42:44 smithi047 bash[22744]: audit 2024-09-16T08:42:42.965133+0000 mgr.a (mgr.14373) 8030 : audit [DBG] from='client.180243 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:42:45.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:42:44 smithi047 bash[22744]: cluster 2024-09-16T08:42:43.595821+0000 mgr.a (mgr.14373) 8031 : cluster [DBG] pgmap v5568: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:42:47.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:42:46 smithi157 bash[24585]: cluster 2024-09-16T08:42:45.596595+0000 mgr.a (mgr.14373) 8032 : cluster [DBG] pgmap v5569: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:42:47.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:42:46 smithi086 bash[24289]: cluster 2024-09-16T08:42:45.596595+0000 mgr.a (mgr.14373) 8032 : cluster [DBG] pgmap v5569: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:42:47.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:42:46 smithi047 bash[22744]: cluster 2024-09-16T08:42:45.596595+0000 mgr.a (mgr.14373) 8032 : cluster [DBG] pgmap v5569: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:42:48.374 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:42:48.375 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:42:48.375 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:42:49.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:42:48 smithi157 bash[24585]: cluster 2024-09-16T08:42:47.598785+0000 mgr.a (mgr.14373) 8033 : cluster [DBG] pgmap v5570: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:42:49.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:42:48 smithi086 bash[24289]: cluster 2024-09-16T08:42:47.598785+0000 mgr.a (mgr.14373) 8033 : cluster [DBG] pgmap v5570: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:42:49.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:42:48 smithi047 bash[22744]: cluster 2024-09-16T08:42:47.598785+0000 mgr.a (mgr.14373) 8033 : cluster [DBG] pgmap v5570: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:42:49.151 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:42:49.152 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:42:49.152 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:42:49.152 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:42:49.152 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:42:50.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:42:49 smithi157 bash[24585]: audit 2024-09-16T08:42:48.714881+0000 mgr.a (mgr.14373) 8034 : audit [DBG] from='client.180321 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:42:50.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:42:49 smithi086 bash[24289]: audit 2024-09-16T08:42:48.714881+0000 mgr.a (mgr.14373) 8034 : audit [DBG] from='client.180321 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:42:50.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:42:49 smithi047 bash[22744]: audit 2024-09-16T08:42:48.714881+0000 mgr.a (mgr.14373) 8034 : audit [DBG] from='client.180321 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:42:51.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:42:50 smithi157 bash[24585]: cluster 2024-09-16T08:42:49.599686+0000 mgr.a (mgr.14373) 8035 : cluster [DBG] pgmap v5571: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:42:51.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:42:50 smithi086 bash[24289]: cluster 2024-09-16T08:42:49.599686+0000 mgr.a (mgr.14373) 8035 : cluster [DBG] pgmap v5571: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:42:51.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:42:50 smithi047 bash[22744]: cluster 2024-09-16T08:42:49.599686+0000 mgr.a (mgr.14373) 8035 : cluster [DBG] pgmap v5571: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:42:53.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:42:52 smithi157 bash[24585]: cluster 2024-09-16T08:42:51.601841+0000 mgr.a (mgr.14373) 8036 : cluster [DBG] pgmap v5572: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:42:53.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:42:52 smithi086 bash[24289]: cluster 2024-09-16T08:42:51.601841+0000 mgr.a (mgr.14373) 8036 : cluster [DBG] pgmap v5572: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:42:53.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:42:52 smithi047 bash[22744]: cluster 2024-09-16T08:42:51.601841+0000 mgr.a (mgr.14373) 8036 : cluster [DBG] pgmap v5572: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:42:54.153 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:42:54.154 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:42:54.154 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:42:54.924 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:42:54.924 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:42:54.924 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:42:54.924 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:42:54.924 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:42:55.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:42:54 smithi157 bash[24585]: cluster 2024-09-16T08:42:53.602619+0000 mgr.a (mgr.14373) 8037 : cluster [DBG] pgmap v5573: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:42:55.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:42:54 smithi086 bash[24289]: cluster 2024-09-16T08:42:53.602619+0000 mgr.a (mgr.14373) 8037 : cluster [DBG] pgmap v5573: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:42:55.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:42:54 smithi047 bash[22744]: cluster 2024-09-16T08:42:53.602619+0000 mgr.a (mgr.14373) 8037 : cluster [DBG] pgmap v5573: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:42:56.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:42:55 smithi157 bash[24585]: audit 2024-09-16T08:42:54.493622+0000 mgr.a (mgr.14373) 8038 : audit [DBG] from='client.180396 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:42:56.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:42:55 smithi086 bash[24289]: audit 2024-09-16T08:42:54.493622+0000 mgr.a (mgr.14373) 8038 : audit [DBG] from='client.180396 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:42:56.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:42:55 smithi047 bash[22744]: audit 2024-09-16T08:42:54.493622+0000 mgr.a (mgr.14373) 8038 : audit [DBG] from='client.180396 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:42:57.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:42:56 smithi157 bash[24585]: cluster 2024-09-16T08:42:55.603661+0000 mgr.a (mgr.14373) 8039 : cluster [DBG] pgmap v5574: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:42:57.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:42:56 smithi086 bash[24289]: cluster 2024-09-16T08:42:55.603661+0000 mgr.a (mgr.14373) 8039 : cluster [DBG] pgmap v5574: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:42:57.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:42:56 smithi047 bash[22744]: cluster 2024-09-16T08:42:55.603661+0000 mgr.a (mgr.14373) 8039 : cluster [DBG] pgmap v5574: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:42:59.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:42:58 smithi157 bash[24585]: cluster 2024-09-16T08:42:57.606048+0000 mgr.a (mgr.14373) 8040 : cluster [DBG] pgmap v5575: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:42:59.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:42:58 smithi086 bash[24289]: cluster 2024-09-16T08:42:57.606048+0000 mgr.a (mgr.14373) 8040 : cluster [DBG] pgmap v5575: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:42:59.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:42:58 smithi047 bash[22744]: cluster 2024-09-16T08:42:57.606048+0000 mgr.a (mgr.14373) 8040 : cluster [DBG] pgmap v5575: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:42:59.925 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:42:59.926 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:42:59.926 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:43:00.731 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:43:00.731 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:43:00.731 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:43:00.731 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:43:00.732 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:43:01.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:43:00 smithi157 bash[24585]: cluster 2024-09-16T08:42:59.606861+0000 mgr.a (mgr.14373) 8041 : cluster [DBG] pgmap v5576: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:43:01.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:43:00 smithi086 bash[24289]: cluster 2024-09-16T08:42:59.606861+0000 mgr.a (mgr.14373) 8041 : cluster [DBG] pgmap v5576: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:43:01.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:43:00 smithi047 bash[22744]: cluster 2024-09-16T08:42:59.606861+0000 mgr.a (mgr.14373) 8041 : cluster [DBG] pgmap v5576: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:43:02.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:43:01 smithi157 bash[24585]: audit 2024-09-16T08:43:00.287018+0000 mgr.a (mgr.14373) 8042 : audit [DBG] from='client.180474 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:43:02.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:43:01 smithi086 bash[24289]: audit 2024-09-16T08:43:00.287018+0000 mgr.a (mgr.14373) 8042 : audit [DBG] from='client.180474 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:43:02.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:43:01 smithi047 bash[22744]: audit 2024-09-16T08:43:00.287018+0000 mgr.a (mgr.14373) 8042 : audit [DBG] from='client.180474 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:43:03.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:43:02 smithi157 bash[24585]: cluster 2024-09-16T08:43:01.609095+0000 mgr.a (mgr.14373) 8043 : cluster [DBG] pgmap v5577: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:43:03.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:43:02 smithi086 bash[24289]: cluster 2024-09-16T08:43:01.609095+0000 mgr.a (mgr.14373) 8043 : cluster [DBG] pgmap v5577: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:43:03.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:43:02 smithi047 bash[22744]: cluster 2024-09-16T08:43:01.609095+0000 mgr.a (mgr.14373) 8043 : cluster [DBG] pgmap v5577: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:43:05.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:43:04 smithi157 bash[24585]: cluster 2024-09-16T08:43:03.609836+0000 mgr.a (mgr.14373) 8044 : cluster [DBG] pgmap v5578: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:43:05.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:43:04 smithi086 bash[24289]: cluster 2024-09-16T08:43:03.609836+0000 mgr.a (mgr.14373) 8044 : cluster [DBG] pgmap v5578: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:43:05.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:43:04 smithi047 bash[22744]: cluster 2024-09-16T08:43:03.609836+0000 mgr.a (mgr.14373) 8044 : cluster [DBG] pgmap v5578: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:43:05.732 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:43:05.732 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:43:05.733 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:43:06.522 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:43:06.522 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:43:06.522 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:43:06.522 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:43:06.522 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:43:07.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:43:06 smithi157 bash[24585]: cluster 2024-09-16T08:43:05.610582+0000 mgr.a (mgr.14373) 8045 : cluster [DBG] pgmap v5579: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:43:07.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:43:06 smithi086 bash[24289]: cluster 2024-09-16T08:43:05.610582+0000 mgr.a (mgr.14373) 8045 : cluster [DBG] pgmap v5579: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:43:07.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:43:06 smithi047 bash[22744]: cluster 2024-09-16T08:43:05.610582+0000 mgr.a (mgr.14373) 8045 : cluster [DBG] pgmap v5579: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:43:08.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:43:07 smithi157 bash[24585]: audit 2024-09-16T08:43:06.071973+0000 mgr.a (mgr.14373) 8046 : audit [DBG] from='client.180549 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:43:08.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:43:07 smithi086 bash[24289]: audit 2024-09-16T08:43:06.071973+0000 mgr.a (mgr.14373) 8046 : audit [DBG] from='client.180549 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:43:08.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:43:07 smithi047 bash[22744]: audit 2024-09-16T08:43:06.071973+0000 mgr.a (mgr.14373) 8046 : audit [DBG] from='client.180549 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:43:09.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:43:08 smithi157 bash[24585]: cluster 2024-09-16T08:43:07.612924+0000 mgr.a (mgr.14373) 8047 : cluster [DBG] pgmap v5580: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-16T08:43:09.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:43:08 smithi086 bash[24289]: cluster 2024-09-16T08:43:07.612924+0000 mgr.a (mgr.14373) 8047 : cluster [DBG] pgmap v5580: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-16T08:43:09.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:43:08 smithi047 bash[22744]: cluster 2024-09-16T08:43:07.612924+0000 mgr.a (mgr.14373) 8047 : cluster [DBG] pgmap v5580: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-16T08:43:11.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:43:10 smithi157 bash[24585]: cluster 2024-09-16T08:43:09.613680+0000 mgr.a (mgr.14373) 8048 : cluster [DBG] pgmap v5581: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T08:43:11.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:43:10 smithi086 bash[24289]: cluster 2024-09-16T08:43:09.613680+0000 mgr.a (mgr.14373) 8048 : cluster [DBG] pgmap v5581: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T08:43:11.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:43:10 smithi047 bash[22744]: cluster 2024-09-16T08:43:09.613680+0000 mgr.a (mgr.14373) 8048 : cluster [DBG] pgmap v5581: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T08:43:11.524 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:43:11.524 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:43:11.524 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:43:12.298 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:43:12.299 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:43:12.299 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:43:12.299 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:43:12.299 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:43:13.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:43:12 smithi157 bash[24585]: cluster 2024-09-16T08:43:11.615671+0000 mgr.a (mgr.14373) 8049 : cluster [DBG] pgmap v5582: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:43:13.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:43:12 smithi086 bash[24289]: cluster 2024-09-16T08:43:11.615671+0000 mgr.a (mgr.14373) 8049 : cluster [DBG] pgmap v5582: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:43:13.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:43:12 smithi047 bash[22744]: cluster 2024-09-16T08:43:11.615671+0000 mgr.a (mgr.14373) 8049 : cluster [DBG] pgmap v5582: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:43:14.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:43:13 smithi157 bash[24585]: audit 2024-09-16T08:43:11.865771+0000 mgr.a (mgr.14373) 8050 : audit [DBG] from='client.180624 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:43:14.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:43:13 smithi086 bash[24289]: audit 2024-09-16T08:43:11.865771+0000 mgr.a (mgr.14373) 8050 : audit [DBG] from='client.180624 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:43:14.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:43:13 smithi047 bash[22744]: audit 2024-09-16T08:43:11.865771+0000 mgr.a (mgr.14373) 8050 : audit [DBG] from='client.180624 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:43:15.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:43:14 smithi157 bash[24585]: cluster 2024-09-16T08:43:13.616555+0000 mgr.a (mgr.14373) 8051 : cluster [DBG] pgmap v5583: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:43:15.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:43:14 smithi086 bash[24289]: cluster 2024-09-16T08:43:13.616555+0000 mgr.a (mgr.14373) 8051 : cluster [DBG] pgmap v5583: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:43:15.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:43:14 smithi047 bash[22744]: cluster 2024-09-16T08:43:13.616555+0000 mgr.a (mgr.14373) 8051 : cluster [DBG] pgmap v5583: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:43:17.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:43:16 smithi157 bash[24585]: cluster 2024-09-16T08:43:15.617333+0000 mgr.a (mgr.14373) 8052 : cluster [DBG] pgmap v5584: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T08:43:17.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:43:16 smithi086 bash[24289]: cluster 2024-09-16T08:43:15.617333+0000 mgr.a (mgr.14373) 8052 : cluster [DBG] pgmap v5584: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T08:43:17.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:43:16 smithi047 bash[22744]: cluster 2024-09-16T08:43:15.617333+0000 mgr.a (mgr.14373) 8052 : cluster [DBG] pgmap v5584: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T08:43:17.300 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:43:17.301 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:43:17.301 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:43:18.044 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:43:18.044 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:43:18.045 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:43:18.045 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:43:18.045 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:43:19.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:43:18 smithi157 bash[24585]: cluster 2024-09-16T08:43:17.619575+0000 mgr.a (mgr.14373) 8053 : cluster [DBG] pgmap v5585: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:43:19.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:43:18 smithi157 bash[24585]: audit 2024-09-16T08:43:17.632089+0000 mgr.a (mgr.14373) 8054 : audit [DBG] from='client.180699 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:43:19.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:43:18 smithi086 bash[24289]: cluster 2024-09-16T08:43:17.619575+0000 mgr.a (mgr.14373) 8053 : cluster [DBG] pgmap v5585: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:43:19.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:43:18 smithi086 bash[24289]: audit 2024-09-16T08:43:17.632089+0000 mgr.a (mgr.14373) 8054 : audit [DBG] from='client.180699 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:43:19.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:43:18 smithi047 bash[22744]: cluster 2024-09-16T08:43:17.619575+0000 mgr.a (mgr.14373) 8053 : cluster [DBG] pgmap v5585: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:43:19.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:43:18 smithi047 bash[22744]: audit 2024-09-16T08:43:17.632089+0000 mgr.a (mgr.14373) 8054 : audit [DBG] from='client.180699 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:43:21.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:43:20 smithi157 bash[24585]: cluster 2024-09-16T08:43:19.620473+0000 mgr.a (mgr.14373) 8055 : cluster [DBG] pgmap v5586: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-16T08:43:21.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:43:20 smithi086 bash[24289]: cluster 2024-09-16T08:43:19.620473+0000 mgr.a (mgr.14373) 8055 : cluster [DBG] pgmap v5586: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-16T08:43:21.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:43:20 smithi047 bash[22744]: cluster 2024-09-16T08:43:19.620473+0000 mgr.a (mgr.14373) 8055 : cluster [DBG] pgmap v5586: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-16T08:43:23.046 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:43:23.046 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:43:23.047 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:43:23.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:43:22 smithi157 bash[24585]: cluster 2024-09-16T08:43:21.622635+0000 mgr.a (mgr.14373) 8056 : cluster [DBG] pgmap v5587: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-16T08:43:23.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:43:22 smithi086 bash[24289]: cluster 2024-09-16T08:43:21.622635+0000 mgr.a (mgr.14373) 8056 : cluster [DBG] pgmap v5587: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-16T08:43:23.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:43:22 smithi047 bash[22744]: cluster 2024-09-16T08:43:21.622635+0000 mgr.a (mgr.14373) 8056 : cluster [DBG] pgmap v5587: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-16T08:43:23.812 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:43:23.812 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:43:23.812 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:43:23.812 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:43:23.813 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:43:25.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:43:24 smithi157 bash[24585]: audit 2024-09-16T08:43:23.381311+0000 mgr.a (mgr.14373) 8057 : audit [DBG] from='client.180774 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:43:25.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:43:24 smithi157 bash[24585]: cluster 2024-09-16T08:43:23.623311+0000 mgr.a (mgr.14373) 8058 : cluster [DBG] pgmap v5588: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:43:25.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:43:24 smithi086 bash[24289]: audit 2024-09-16T08:43:23.381311+0000 mgr.a (mgr.14373) 8057 : audit [DBG] from='client.180774 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:43:25.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:43:24 smithi086 bash[24289]: cluster 2024-09-16T08:43:23.623311+0000 mgr.a (mgr.14373) 8058 : cluster [DBG] pgmap v5588: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:43:25.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:43:24 smithi047 bash[22744]: audit 2024-09-16T08:43:23.381311+0000 mgr.a (mgr.14373) 8057 : audit [DBG] from='client.180774 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:43:25.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:43:24 smithi047 bash[22744]: cluster 2024-09-16T08:43:23.623311+0000 mgr.a (mgr.14373) 8058 : cluster [DBG] pgmap v5588: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:43:27.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:43:26 smithi157 bash[24585]: cluster 2024-09-16T08:43:25.624309+0000 mgr.a (mgr.14373) 8059 : cluster [DBG] pgmap v5589: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:43:27.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:43:26 smithi086 bash[24289]: cluster 2024-09-16T08:43:25.624309+0000 mgr.a (mgr.14373) 8059 : cluster [DBG] pgmap v5589: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:43:27.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:43:26 smithi047 bash[22744]: cluster 2024-09-16T08:43:25.624309+0000 mgr.a (mgr.14373) 8059 : cluster [DBG] pgmap v5589: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:43:28.814 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:43:28.815 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:43:28.815 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:43:29.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:43:28 smithi157 bash[24585]: cluster 2024-09-16T08:43:27.626589+0000 mgr.a (mgr.14373) 8060 : cluster [DBG] pgmap v5590: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:43:29.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:43:28 smithi086 bash[24289]: cluster 2024-09-16T08:43:27.626589+0000 mgr.a (mgr.14373) 8060 : cluster [DBG] pgmap v5590: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:43:29.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:43:28 smithi047 bash[22744]: cluster 2024-09-16T08:43:27.626589+0000 mgr.a (mgr.14373) 8060 : cluster [DBG] pgmap v5590: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:43:29.577 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:43:29.578 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:43:29.578 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:43:29.578 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:43:29.578 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:43:31.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:43:30 smithi157 bash[24585]: audit 2024-09-16T08:43:29.149888+0000 mgr.a (mgr.14373) 8061 : audit [DBG] from='client.180846 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:43:31.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:43:30 smithi157 bash[24585]: cluster 2024-09-16T08:43:29.627107+0000 mgr.a (mgr.14373) 8062 : cluster [DBG] pgmap v5591: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:43:31.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:43:30 smithi086 bash[24289]: audit 2024-09-16T08:43:29.149888+0000 mgr.a (mgr.14373) 8061 : audit [DBG] from='client.180846 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:43:31.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:43:30 smithi086 bash[24289]: cluster 2024-09-16T08:43:29.627107+0000 mgr.a (mgr.14373) 8062 : cluster [DBG] pgmap v5591: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:43:31.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:43:30 smithi047 bash[22744]: audit 2024-09-16T08:43:29.149888+0000 mgr.a (mgr.14373) 8061 : audit [DBG] from='client.180846 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:43:31.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:43:30 smithi047 bash[22744]: cluster 2024-09-16T08:43:29.627107+0000 mgr.a (mgr.14373) 8062 : cluster [DBG] pgmap v5591: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:43:33.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:43:32 smithi157 bash[24585]: cluster 2024-09-16T08:43:31.629172+0000 mgr.a (mgr.14373) 8063 : cluster [DBG] pgmap v5592: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:43:33.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:43:32 smithi086 bash[24289]: cluster 2024-09-16T08:43:31.629172+0000 mgr.a (mgr.14373) 8063 : cluster [DBG] pgmap v5592: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:43:33.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:43:32 smithi047 bash[22744]: cluster 2024-09-16T08:43:31.629172+0000 mgr.a (mgr.14373) 8063 : cluster [DBG] pgmap v5592: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:43:34.579 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:43:34.580 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:43:34.580 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:43:35.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:43:34 smithi157 bash[24585]: cluster 2024-09-16T08:43:33.629909+0000 mgr.a (mgr.14373) 8064 : cluster [DBG] pgmap v5593: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:43:35.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:43:34 smithi086 bash[24289]: cluster 2024-09-16T08:43:33.629909+0000 mgr.a (mgr.14373) 8064 : cluster [DBG] pgmap v5593: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:43:35.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:43:34 smithi047 bash[22744]: cluster 2024-09-16T08:43:33.629909+0000 mgr.a (mgr.14373) 8064 : cluster [DBG] pgmap v5593: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:43:35.337 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:43:35.337 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:43:35.337 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:43:35.337 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:43:35.337 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:43:37.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:43:36 smithi157 bash[24585]: audit 2024-09-16T08:43:34.916725+0000 mgr.a (mgr.14373) 8065 : audit [DBG] from='client.180918 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:43:37.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:43:36 smithi157 bash[24585]: cluster 2024-09-16T08:43:35.630787+0000 mgr.a (mgr.14373) 8066 : cluster [DBG] pgmap v5594: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:43:37.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:43:36 smithi086 bash[24289]: audit 2024-09-16T08:43:34.916725+0000 mgr.a (mgr.14373) 8065 : audit [DBG] from='client.180918 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:43:37.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:43:36 smithi086 bash[24289]: cluster 2024-09-16T08:43:35.630787+0000 mgr.a (mgr.14373) 8066 : cluster [DBG] pgmap v5594: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:43:37.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:43:36 smithi047 bash[22744]: audit 2024-09-16T08:43:34.916725+0000 mgr.a (mgr.14373) 8065 : audit [DBG] from='client.180918 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:43:37.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:43:36 smithi047 bash[22744]: cluster 2024-09-16T08:43:35.630787+0000 mgr.a (mgr.14373) 8066 : cluster [DBG] pgmap v5594: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:43:39.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:43:38 smithi157 bash[24585]: cluster 2024-09-16T08:43:37.632963+0000 mgr.a (mgr.14373) 8067 : cluster [DBG] pgmap v5595: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:43:39.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:43:38 smithi086 bash[24289]: cluster 2024-09-16T08:43:37.632963+0000 mgr.a (mgr.14373) 8067 : cluster [DBG] pgmap v5595: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:43:39.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:43:38 smithi047 bash[22744]: cluster 2024-09-16T08:43:37.632963+0000 mgr.a (mgr.14373) 8067 : cluster [DBG] pgmap v5595: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:43:40.338 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:43:40.339 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:43:40.339 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:43:41.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:43:40 smithi157 bash[24585]: cluster 2024-09-16T08:43:39.633747+0000 mgr.a (mgr.14373) 8068 : cluster [DBG] pgmap v5596: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:43:41.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:43:40 smithi157 bash[24585]: audit 2024-09-16T08:43:40.711626+0000 mon.b (mon.2) 758 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T08:43:41.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:43:40 smithi086 bash[24289]: cluster 2024-09-16T08:43:39.633747+0000 mgr.a (mgr.14373) 8068 : cluster [DBG] pgmap v5596: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:43:41.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:43:40 smithi086 bash[24289]: audit 2024-09-16T08:43:40.711626+0000 mon.b (mon.2) 758 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T08:43:41.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:43:40 smithi047 bash[22744]: cluster 2024-09-16T08:43:39.633747+0000 mgr.a (mgr.14373) 8068 : cluster [DBG] pgmap v5596: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:43:41.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:43:40 smithi047 bash[22744]: audit 2024-09-16T08:43:40.711626+0000 mon.b (mon.2) 758 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T08:43:41.132 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:43:41.133 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:43:41.133 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:43:41.133 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:43:41.133 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:43:42.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:43:41 smithi157 bash[24585]: audit 2024-09-16T08:43:40.680908+0000 mgr.a (mgr.14373) 8069 : audit [DBG] from='client.180993 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:43:42.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:43:41 smithi157 bash[24585]: audit 2024-09-16T08:43:41.560967+0000 mon.b (mon.2) 759 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T08:43:42.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:43:41 smithi157 bash[24585]: audit 2024-09-16T08:43:41.563641+0000 mon.b (mon.2) 760 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T08:43:42.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:43:41 smithi157 bash[24585]: audit 2024-09-16T08:43:41.578034+0000 mon.a (mon.0) 1056 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:43:42.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:43:41 smithi157 bash[24585]: audit 2024-09-16T08:43:41.580932+0000 mon.b (mon.2) 761 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:43:42.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:43:41 smithi086 bash[24289]: audit 2024-09-16T08:43:40.680908+0000 mgr.a (mgr.14373) 8069 : audit [DBG] from='client.180993 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:43:42.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:43:41 smithi086 bash[24289]: audit 2024-09-16T08:43:41.560967+0000 mon.b (mon.2) 759 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T08:43:42.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:43:41 smithi086 bash[24289]: audit 2024-09-16T08:43:41.563641+0000 mon.b (mon.2) 760 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T08:43:42.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:43:41 smithi086 bash[24289]: audit 2024-09-16T08:43:41.578034+0000 mon.a (mon.0) 1056 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:43:42.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:43:41 smithi086 bash[24289]: audit 2024-09-16T08:43:41.580932+0000 mon.b (mon.2) 761 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:43:42.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:43:41 smithi047 bash[22744]: audit 2024-09-16T08:43:40.680908+0000 mgr.a (mgr.14373) 8069 : audit [DBG] from='client.180993 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:43:42.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:43:41 smithi047 bash[22744]: audit 2024-09-16T08:43:41.560967+0000 mon.b (mon.2) 759 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T08:43:42.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:43:41 smithi047 bash[22744]: audit 2024-09-16T08:43:41.563641+0000 mon.b (mon.2) 760 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T08:43:42.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:43:41 smithi047 bash[22744]: audit 2024-09-16T08:43:41.578034+0000 mon.a (mon.0) 1056 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:43:42.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:43:41 smithi047 bash[22744]: audit 2024-09-16T08:43:41.580932+0000 mon.b (mon.2) 761 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:43:42.588 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 08:43:42 smithi047 bash[22994]: debug 2024-09-16T08:43:42.310+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T08:43:42.588 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 08:43:42 smithi047 bash[22994]: debug 2024-09-16T08:43:42.314+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T08:43:43.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:43:42 smithi157 bash[24585]: audit 2024-09-16T08:43:41.584635+0000 mgr.a (mgr.14373) 8070 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:43:43.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:43:42 smithi157 bash[24585]: cluster 2024-09-16T08:43:41.636745+0000 mgr.a (mgr.14373) 8071 : cluster [DBG] pgmap v5597: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:43:43.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:43:42 smithi086 bash[24289]: audit 2024-09-16T08:43:41.584635+0000 mgr.a (mgr.14373) 8070 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:43:43.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:43:42 smithi086 bash[24289]: cluster 2024-09-16T08:43:41.636745+0000 mgr.a (mgr.14373) 8071 : cluster [DBG] pgmap v5597: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:43:43.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:43:42 smithi047 bash[22744]: audit 2024-09-16T08:43:41.584635+0000 mgr.a (mgr.14373) 8070 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:43:43.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:43:42 smithi047 bash[22744]: cluster 2024-09-16T08:43:41.636745+0000 mgr.a (mgr.14373) 8071 : cluster [DBG] pgmap v5597: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:43:44.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:43:43 smithi086 bash[24289]: audit 2024-09-16T08:43:42.316845+0000 mgr.a (mgr.14373) 8072 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T08:43:44.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:43:43 smithi086 bash[24289]: cephadm 2024-09-16T08:43:42.319024+0000 mgr.a (mgr.14373) 8073 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T08:43:44.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:43:43 smithi047 bash[22744]: audit 2024-09-16T08:43:42.316845+0000 mgr.a (mgr.14373) 8072 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T08:43:44.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:43:43 smithi047 bash[22744]: cephadm 2024-09-16T08:43:42.319024+0000 mgr.a (mgr.14373) 8073 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T08:43:44.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:43:43 smithi157 bash[24585]: audit 2024-09-16T08:43:42.316845+0000 mgr.a (mgr.14373) 8072 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T08:43:44.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:43:43 smithi157 bash[24585]: cephadm 2024-09-16T08:43:42.319024+0000 mgr.a (mgr.14373) 8073 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T08:43:45.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:43:44 smithi086 bash[24289]: cluster 2024-09-16T08:43:43.637707+0000 mgr.a (mgr.14373) 8074 : cluster [DBG] pgmap v5598: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:43:45.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:43:44 smithi047 bash[22744]: cluster 2024-09-16T08:43:43.637707+0000 mgr.a (mgr.14373) 8074 : cluster [DBG] pgmap v5598: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:43:45.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:43:44 smithi157 bash[24585]: cluster 2024-09-16T08:43:43.637707+0000 mgr.a (mgr.14373) 8074 : cluster [DBG] pgmap v5598: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:43:46.134 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:43:46.135 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:43:46.135 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:43:46.917 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:43:46.917 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:43:46.917 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:43:46.917 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:43:46.917 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:43:47.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:43:46 smithi086 bash[24289]: cluster 2024-09-16T08:43:45.638512+0000 mgr.a (mgr.14373) 8075 : cluster [DBG] pgmap v5599: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:43:47.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:43:46 smithi047 bash[22744]: cluster 2024-09-16T08:43:45.638512+0000 mgr.a (mgr.14373) 8075 : cluster [DBG] pgmap v5599: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:43:47.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:43:46 smithi157 bash[24585]: cluster 2024-09-16T08:43:45.638512+0000 mgr.a (mgr.14373) 8075 : cluster [DBG] pgmap v5599: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:43:48.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:43:47 smithi047 bash[22744]: audit 2024-09-16T08:43:46.474169+0000 mgr.a (mgr.14373) 8076 : audit [DBG] from='client.181176 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:43:48.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:43:47 smithi157 bash[24585]: audit 2024-09-16T08:43:46.474169+0000 mgr.a (mgr.14373) 8076 : audit [DBG] from='client.181176 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:43:48.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:43:47 smithi086 bash[24289]: audit 2024-09-16T08:43:46.474169+0000 mgr.a (mgr.14373) 8076 : audit [DBG] from='client.181176 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:43:49.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:43:48 smithi047 bash[22744]: cluster 2024-09-16T08:43:47.641314+0000 mgr.a (mgr.14373) 8077 : cluster [DBG] pgmap v5600: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:43:49.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:43:48 smithi157 bash[24585]: cluster 2024-09-16T08:43:47.641314+0000 mgr.a (mgr.14373) 8077 : cluster [DBG] pgmap v5600: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:43:49.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:43:48 smithi086 bash[24289]: cluster 2024-09-16T08:43:47.641314+0000 mgr.a (mgr.14373) 8077 : cluster [DBG] pgmap v5600: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:43:50.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:43:49 smithi157 bash[24585]: cluster 2024-09-16T08:43:49.642120+0000 mgr.a (mgr.14373) 8078 : cluster [DBG] pgmap v5601: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T08:43:50.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:43:49 smithi086 bash[24289]: cluster 2024-09-16T08:43:49.642120+0000 mgr.a (mgr.14373) 8078 : cluster [DBG] pgmap v5601: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T08:43:50.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:43:49 smithi047 bash[22744]: cluster 2024-09-16T08:43:49.642120+0000 mgr.a (mgr.14373) 8078 : cluster [DBG] pgmap v5601: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T08:43:51.919 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:43:51.919 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:43:51.919 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:43:52.685 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:43:52.685 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:43:52.685 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:43:52.685 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:43:52.685 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:43:53.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:43:52 smithi157 bash[24585]: cluster 2024-09-16T08:43:51.644024+0000 mgr.a (mgr.14373) 8079 : cluster [DBG] pgmap v5602: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:43:53.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:43:52 smithi086 bash[24289]: cluster 2024-09-16T08:43:51.644024+0000 mgr.a (mgr.14373) 8079 : cluster [DBG] pgmap v5602: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:43:53.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:43:52 smithi047 bash[22744]: cluster 2024-09-16T08:43:51.644024+0000 mgr.a (mgr.14373) 8079 : cluster [DBG] pgmap v5602: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:43:54.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:43:53 smithi157 bash[24585]: audit 2024-09-16T08:43:52.260631+0000 mgr.a (mgr.14373) 8080 : audit [DBG] from='client.181254 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:43:54.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:43:53 smithi086 bash[24289]: audit 2024-09-16T08:43:52.260631+0000 mgr.a (mgr.14373) 8080 : audit [DBG] from='client.181254 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:43:54.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:43:53 smithi047 bash[22744]: audit 2024-09-16T08:43:52.260631+0000 mgr.a (mgr.14373) 8080 : audit [DBG] from='client.181254 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:43:55.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:43:54 smithi157 bash[24585]: cluster 2024-09-16T08:43:53.644982+0000 mgr.a (mgr.14373) 8081 : cluster [DBG] pgmap v5603: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T08:43:55.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:43:54 smithi086 bash[24289]: cluster 2024-09-16T08:43:53.644982+0000 mgr.a (mgr.14373) 8081 : cluster [DBG] pgmap v5603: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T08:43:55.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:43:54 smithi047 bash[22744]: cluster 2024-09-16T08:43:53.644982+0000 mgr.a (mgr.14373) 8081 : cluster [DBG] pgmap v5603: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T08:43:57.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:43:56 smithi157 bash[24585]: cluster 2024-09-16T08:43:55.645766+0000 mgr.a (mgr.14373) 8082 : cluster [DBG] pgmap v5604: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T08:43:57.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:43:56 smithi086 bash[24289]: cluster 2024-09-16T08:43:55.645766+0000 mgr.a (mgr.14373) 8082 : cluster [DBG] pgmap v5604: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T08:43:57.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:43:56 smithi047 bash[22744]: cluster 2024-09-16T08:43:55.645766+0000 mgr.a (mgr.14373) 8082 : cluster [DBG] pgmap v5604: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T08:43:57.686 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:43:57.687 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:43:57.687 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:43:58.474 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:43:58.474 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:43:58.474 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:43:58.474 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:43:58.475 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:43:59.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:43:58 smithi157 bash[24585]: cluster 2024-09-16T08:43:57.647994+0000 mgr.a (mgr.14373) 8083 : cluster [DBG] pgmap v5605: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:43:59.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:43:58 smithi086 bash[24289]: cluster 2024-09-16T08:43:57.647994+0000 mgr.a (mgr.14373) 8083 : cluster [DBG] pgmap v5605: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:43:59.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:43:58 smithi047 bash[22744]: cluster 2024-09-16T08:43:57.647994+0000 mgr.a (mgr.14373) 8083 : cluster [DBG] pgmap v5605: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:44:00.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:43:59 smithi157 bash[24585]: audit 2024-09-16T08:43:58.026893+0000 mgr.a (mgr.14373) 8084 : audit [DBG] from='client.181332 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:44:00.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:43:59 smithi086 bash[24289]: audit 2024-09-16T08:43:58.026893+0000 mgr.a (mgr.14373) 8084 : audit [DBG] from='client.181332 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:44:00.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:43:59 smithi047 bash[22744]: audit 2024-09-16T08:43:58.026893+0000 mgr.a (mgr.14373) 8084 : audit [DBG] from='client.181332 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:44:01.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:44:00 smithi157 bash[24585]: cluster 2024-09-16T08:43:59.648972+0000 mgr.a (mgr.14373) 8085 : cluster [DBG] pgmap v5606: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:44:01.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:44:00 smithi086 bash[24289]: cluster 2024-09-16T08:43:59.648972+0000 mgr.a (mgr.14373) 8085 : cluster [DBG] pgmap v5606: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:44:01.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:44:00 smithi047 bash[22744]: cluster 2024-09-16T08:43:59.648972+0000 mgr.a (mgr.14373) 8085 : cluster [DBG] pgmap v5606: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:44:03.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:44:02 smithi157 bash[24585]: cluster 2024-09-16T08:44:01.651163+0000 mgr.a (mgr.14373) 8086 : cluster [DBG] pgmap v5607: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:44:03.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:44:02 smithi086 bash[24289]: cluster 2024-09-16T08:44:01.651163+0000 mgr.a (mgr.14373) 8086 : cluster [DBG] pgmap v5607: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:44:03.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:44:02 smithi047 bash[22744]: cluster 2024-09-16T08:44:01.651163+0000 mgr.a (mgr.14373) 8086 : cluster [DBG] pgmap v5607: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:44:03.476 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:44:03.477 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:44:03.477 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:44:04.228 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:44:04.228 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:44:04.228 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:44:04.228 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:44:04.228 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:44:05.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:44:04 smithi157 bash[24585]: cluster 2024-09-16T08:44:03.651642+0000 mgr.a (mgr.14373) 8087 : cluster [DBG] pgmap v5608: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:44:05.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:44:04 smithi157 bash[24585]: audit 2024-09-16T08:44:03.812143+0000 mgr.a (mgr.14373) 8088 : audit [DBG] from='client.181407 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:44:05.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:44:04 smithi086 bash[24289]: cluster 2024-09-16T08:44:03.651642+0000 mgr.a (mgr.14373) 8087 : cluster [DBG] pgmap v5608: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:44:05.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:44:04 smithi086 bash[24289]: audit 2024-09-16T08:44:03.812143+0000 mgr.a (mgr.14373) 8088 : audit [DBG] from='client.181407 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:44:05.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:44:04 smithi047 bash[22744]: cluster 2024-09-16T08:44:03.651642+0000 mgr.a (mgr.14373) 8087 : cluster [DBG] pgmap v5608: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:44:05.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:44:04 smithi047 bash[22744]: audit 2024-09-16T08:44:03.812143+0000 mgr.a (mgr.14373) 8088 : audit [DBG] from='client.181407 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:44:07.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:44:06 smithi157 bash[24585]: cluster 2024-09-16T08:44:05.652565+0000 mgr.a (mgr.14373) 8089 : cluster [DBG] pgmap v5609: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:44:07.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:44:06 smithi086 bash[24289]: cluster 2024-09-16T08:44:05.652565+0000 mgr.a (mgr.14373) 8089 : cluster [DBG] pgmap v5609: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:44:07.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:44:06 smithi047 bash[22744]: cluster 2024-09-16T08:44:05.652565+0000 mgr.a (mgr.14373) 8089 : cluster [DBG] pgmap v5609: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:44:09.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:44:08 smithi157 bash[24585]: cluster 2024-09-16T08:44:07.654837+0000 mgr.a (mgr.14373) 8090 : cluster [DBG] pgmap v5610: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:44:09.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:44:08 smithi086 bash[24289]: cluster 2024-09-16T08:44:07.654837+0000 mgr.a (mgr.14373) 8090 : cluster [DBG] pgmap v5610: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:44:09.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:44:08 smithi047 bash[22744]: cluster 2024-09-16T08:44:07.654837+0000 mgr.a (mgr.14373) 8090 : cluster [DBG] pgmap v5610: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:44:09.229 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:44:09.230 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:44:09.230 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:44:10.011 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:44:10.012 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:44:10.012 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:44:10.012 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:44:10.012 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:44:11.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:44:10 smithi157 bash[24585]: audit 2024-09-16T08:44:09.570611+0000 mgr.a (mgr.14373) 8091 : audit [DBG] from='client.181485 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:44:11.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:44:10 smithi157 bash[24585]: cluster 2024-09-16T08:44:09.655373+0000 mgr.a (mgr.14373) 8092 : cluster [DBG] pgmap v5611: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:44:11.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:44:10 smithi086 bash[24289]: audit 2024-09-16T08:44:09.570611+0000 mgr.a (mgr.14373) 8091 : audit [DBG] from='client.181485 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:44:11.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:44:10 smithi086 bash[24289]: cluster 2024-09-16T08:44:09.655373+0000 mgr.a (mgr.14373) 8092 : cluster [DBG] pgmap v5611: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:44:11.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:44:10 smithi047 bash[22744]: audit 2024-09-16T08:44:09.570611+0000 mgr.a (mgr.14373) 8091 : audit [DBG] from='client.181485 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:44:11.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:44:10 smithi047 bash[22744]: cluster 2024-09-16T08:44:09.655373+0000 mgr.a (mgr.14373) 8092 : cluster [DBG] pgmap v5611: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:44:13.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:44:12 smithi157 bash[24585]: cluster 2024-09-16T08:44:11.657590+0000 mgr.a (mgr.14373) 8093 : cluster [DBG] pgmap v5612: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:44:13.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:44:12 smithi086 bash[24289]: cluster 2024-09-16T08:44:11.657590+0000 mgr.a (mgr.14373) 8093 : cluster [DBG] pgmap v5612: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:44:13.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:44:12 smithi047 bash[22744]: cluster 2024-09-16T08:44:11.657590+0000 mgr.a (mgr.14373) 8093 : cluster [DBG] pgmap v5612: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:44:15.013 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:44:15.014 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:44:15.014 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:44:15.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:44:14 smithi157 bash[24585]: cluster 2024-09-16T08:44:13.658431+0000 mgr.a (mgr.14373) 8094 : cluster [DBG] pgmap v5613: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:44:15.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:44:14 smithi086 bash[24289]: cluster 2024-09-16T08:44:13.658431+0000 mgr.a (mgr.14373) 8094 : cluster [DBG] pgmap v5613: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:44:15.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:44:14 smithi047 bash[22744]: cluster 2024-09-16T08:44:13.658431+0000 mgr.a (mgr.14373) 8094 : cluster [DBG] pgmap v5613: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:44:15.756 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:44:15.757 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:44:15.757 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:44:15.757 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:44:15.757 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:44:17.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:44:16 smithi157 bash[24585]: audit 2024-09-16T08:44:15.349304+0000 mgr.a (mgr.14373) 8095 : audit [DBG] from='client.181560 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:44:17.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:44:16 smithi157 bash[24585]: cluster 2024-09-16T08:44:15.663008+0000 mgr.a (mgr.14373) 8096 : cluster [DBG] pgmap v5614: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:44:17.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:44:16 smithi086 bash[24289]: audit 2024-09-16T08:44:15.349304+0000 mgr.a (mgr.14373) 8095 : audit [DBG] from='client.181560 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:44:17.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:44:16 smithi086 bash[24289]: cluster 2024-09-16T08:44:15.663008+0000 mgr.a (mgr.14373) 8096 : cluster [DBG] pgmap v5614: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:44:17.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:44:16 smithi047 bash[22744]: audit 2024-09-16T08:44:15.349304+0000 mgr.a (mgr.14373) 8095 : audit [DBG] from='client.181560 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:44:17.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:44:16 smithi047 bash[22744]: cluster 2024-09-16T08:44:15.663008+0000 mgr.a (mgr.14373) 8096 : cluster [DBG] pgmap v5614: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:44:19.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:44:18 smithi157 bash[24585]: cluster 2024-09-16T08:44:17.665232+0000 mgr.a (mgr.14373) 8097 : cluster [DBG] pgmap v5615: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:44:19.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:44:18 smithi086 bash[24289]: cluster 2024-09-16T08:44:17.665232+0000 mgr.a (mgr.14373) 8097 : cluster [DBG] pgmap v5615: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:44:19.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:44:18 smithi047 bash[22744]: cluster 2024-09-16T08:44:17.665232+0000 mgr.a (mgr.14373) 8097 : cluster [DBG] pgmap v5615: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:44:20.758 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:44:20.759 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:44:20.759 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:44:21.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:44:20 smithi157 bash[24585]: cluster 2024-09-16T08:44:19.666005+0000 mgr.a (mgr.14373) 8098 : cluster [DBG] pgmap v5616: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:44:21.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:44:20 smithi086 bash[24289]: cluster 2024-09-16T08:44:19.666005+0000 mgr.a (mgr.14373) 8098 : cluster [DBG] pgmap v5616: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:44:21.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:44:20 smithi047 bash[22744]: cluster 2024-09-16T08:44:19.666005+0000 mgr.a (mgr.14373) 8098 : cluster [DBG] pgmap v5616: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:44:21.507 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:44:21.507 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:44:21.507 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:44:21.507 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:44:21.507 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:44:23.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:44:22 smithi157 bash[24585]: audit 2024-09-16T08:44:21.094334+0000 mgr.a (mgr.14373) 8099 : audit [DBG] from='client.181638 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:44:23.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:44:22 smithi157 bash[24585]: cluster 2024-09-16T08:44:21.668437+0000 mgr.a (mgr.14373) 8100 : cluster [DBG] pgmap v5617: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-16T08:44:23.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:44:22 smithi086 bash[24289]: audit 2024-09-16T08:44:21.094334+0000 mgr.a (mgr.14373) 8099 : audit [DBG] from='client.181638 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:44:23.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:44:22 smithi086 bash[24289]: cluster 2024-09-16T08:44:21.668437+0000 mgr.a (mgr.14373) 8100 : cluster [DBG] pgmap v5617: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-16T08:44:23.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:44:22 smithi047 bash[22744]: audit 2024-09-16T08:44:21.094334+0000 mgr.a (mgr.14373) 8099 : audit [DBG] from='client.181638 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:44:23.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:44:22 smithi047 bash[22744]: cluster 2024-09-16T08:44:21.668437+0000 mgr.a (mgr.14373) 8100 : cluster [DBG] pgmap v5617: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-16T08:44:25.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:44:24 smithi157 bash[24585]: cluster 2024-09-16T08:44:23.669262+0000 mgr.a (mgr.14373) 8101 : cluster [DBG] pgmap v5618: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T08:44:25.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:44:24 smithi086 bash[24289]: cluster 2024-09-16T08:44:23.669262+0000 mgr.a (mgr.14373) 8101 : cluster [DBG] pgmap v5618: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T08:44:25.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:44:24 smithi047 bash[22744]: cluster 2024-09-16T08:44:23.669262+0000 mgr.a (mgr.14373) 8101 : cluster [DBG] pgmap v5618: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T08:44:26.508 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:44:26.509 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:44:26.509 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:44:27.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:44:26 smithi157 bash[24585]: cluster 2024-09-16T08:44:25.670036+0000 mgr.a (mgr.14373) 8102 : cluster [DBG] pgmap v5619: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T08:44:27.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:44:26 smithi086 bash[24289]: cluster 2024-09-16T08:44:25.670036+0000 mgr.a (mgr.14373) 8102 : cluster [DBG] pgmap v5619: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T08:44:27.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:44:26 smithi047 bash[22744]: cluster 2024-09-16T08:44:25.670036+0000 mgr.a (mgr.14373) 8102 : cluster [DBG] pgmap v5619: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T08:44:27.285 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:44:27.286 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:44:27.286 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:44:27.286 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:44:27.286 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:44:28.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:44:27 smithi157 bash[24585]: audit 2024-09-16T08:44:26.846493+0000 mgr.a (mgr.14373) 8103 : audit [DBG] from='client.181716 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:44:28.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:44:27 smithi086 bash[24289]: audit 2024-09-16T08:44:26.846493+0000 mgr.a (mgr.14373) 8103 : audit [DBG] from='client.181716 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:44:28.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:44:27 smithi047 bash[22744]: audit 2024-09-16T08:44:26.846493+0000 mgr.a (mgr.14373) 8103 : audit [DBG] from='client.181716 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:44:29.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:44:28 smithi157 bash[24585]: cluster 2024-09-16T08:44:27.672826+0000 mgr.a (mgr.14373) 8104 : cluster [DBG] pgmap v5620: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:44:29.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:44:28 smithi086 bash[24289]: cluster 2024-09-16T08:44:27.672826+0000 mgr.a (mgr.14373) 8104 : cluster [DBG] pgmap v5620: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:44:29.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:44:28 smithi047 bash[22744]: cluster 2024-09-16T08:44:27.672826+0000 mgr.a (mgr.14373) 8104 : cluster [DBG] pgmap v5620: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:44:31.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:44:30 smithi157 bash[24585]: cluster 2024-09-16T08:44:29.673636+0000 mgr.a (mgr.14373) 8105 : cluster [DBG] pgmap v5621: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:44:31.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:44:30 smithi086 bash[24289]: cluster 2024-09-16T08:44:29.673636+0000 mgr.a (mgr.14373) 8105 : cluster [DBG] pgmap v5621: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:44:31.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:44:30 smithi047 bash[22744]: cluster 2024-09-16T08:44:29.673636+0000 mgr.a (mgr.14373) 8105 : cluster [DBG] pgmap v5621: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:44:32.287 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:44:32.288 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:44:32.288 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:44:33.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:44:32 smithi157 bash[24585]: cluster 2024-09-16T08:44:31.675588+0000 mgr.a (mgr.14373) 8106 : cluster [DBG] pgmap v5622: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:44:33.064 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:44:33.064 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:44:33.064 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:44:33.064 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:44:33.064 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:44:33.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:44:32 smithi086 bash[24289]: cluster 2024-09-16T08:44:31.675588+0000 mgr.a (mgr.14373) 8106 : cluster [DBG] pgmap v5622: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:44:33.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:44:32 smithi047 bash[22744]: cluster 2024-09-16T08:44:31.675588+0000 mgr.a (mgr.14373) 8106 : cluster [DBG] pgmap v5622: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:44:34.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:44:33 smithi086 bash[24289]: audit 2024-09-16T08:44:32.623246+0000 mgr.a (mgr.14373) 8107 : audit [DBG] from='client.181791 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:44:34.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:44:33 smithi047 bash[22744]: audit 2024-09-16T08:44:32.623246+0000 mgr.a (mgr.14373) 8107 : audit [DBG] from='client.181791 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:44:34.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:44:33 smithi157 bash[24585]: audit 2024-09-16T08:44:32.623246+0000 mgr.a (mgr.14373) 8107 : audit [DBG] from='client.181791 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:44:35.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:44:34 smithi086 bash[24289]: cluster 2024-09-16T08:44:33.676579+0000 mgr.a (mgr.14373) 8108 : cluster [DBG] pgmap v5623: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-16T08:44:35.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:44:34 smithi047 bash[22744]: cluster 2024-09-16T08:44:33.676579+0000 mgr.a (mgr.14373) 8108 : cluster [DBG] pgmap v5623: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-16T08:44:35.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:44:34 smithi157 bash[24585]: cluster 2024-09-16T08:44:33.676579+0000 mgr.a (mgr.14373) 8108 : cluster [DBG] pgmap v5623: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-16T08:44:37.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:44:36 smithi086 bash[24289]: cluster 2024-09-16T08:44:35.677388+0000 mgr.a (mgr.14373) 8109 : cluster [DBG] pgmap v5624: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-16T08:44:37.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:44:36 smithi047 bash[22744]: cluster 2024-09-16T08:44:35.677388+0000 mgr.a (mgr.14373) 8109 : cluster [DBG] pgmap v5624: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-16T08:44:37.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:44:36 smithi157 bash[24585]: cluster 2024-09-16T08:44:35.677388+0000 mgr.a (mgr.14373) 8109 : cluster [DBG] pgmap v5624: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-16T08:44:38.065 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:44:38.066 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:44:38.066 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:44:38.847 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:44:38.848 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:44:38.848 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:44:38.848 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:44:38.848 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:44:39.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:44:38 smithi047 bash[22744]: cluster 2024-09-16T08:44:37.679593+0000 mgr.a (mgr.14373) 8110 : cluster [DBG] pgmap v5625: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-16T08:44:39.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:44:38 smithi157 bash[24585]: cluster 2024-09-16T08:44:37.679593+0000 mgr.a (mgr.14373) 8110 : cluster [DBG] pgmap v5625: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-16T08:44:39.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:44:38 smithi086 bash[24289]: cluster 2024-09-16T08:44:37.679593+0000 mgr.a (mgr.14373) 8110 : cluster [DBG] pgmap v5625: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-16T08:44:40.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:44:39 smithi047 bash[22744]: audit 2024-09-16T08:44:38.403750+0000 mgr.a (mgr.14373) 8111 : audit [DBG] from='client.181869 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:44:40.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:44:39 smithi157 bash[24585]: audit 2024-09-16T08:44:38.403750+0000 mgr.a (mgr.14373) 8111 : audit [DBG] from='client.181869 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:44:40.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:44:39 smithi086 bash[24289]: audit 2024-09-16T08:44:38.403750+0000 mgr.a (mgr.14373) 8111 : audit [DBG] from='client.181869 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:44:41.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:44:40 smithi047 bash[22744]: cluster 2024-09-16T08:44:39.680649+0000 mgr.a (mgr.14373) 8112 : cluster [DBG] pgmap v5626: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:44:41.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:44:40 smithi157 bash[24585]: cluster 2024-09-16T08:44:39.680649+0000 mgr.a (mgr.14373) 8112 : cluster [DBG] pgmap v5626: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:44:41.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:44:40 smithi086 bash[24289]: cluster 2024-09-16T08:44:39.680649+0000 mgr.a (mgr.14373) 8112 : cluster [DBG] pgmap v5626: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:44:43.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:44:42 smithi047 bash[22744]: cluster 2024-09-16T08:44:41.682780+0000 mgr.a (mgr.14373) 8113 : cluster [DBG] pgmap v5627: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:44:43.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:44:42 smithi047 bash[22744]: audit 2024-09-16T08:44:42.369738+0000 mon.b (mon.2) 762 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T08:44:43.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:44:42 smithi157 bash[24585]: cluster 2024-09-16T08:44:41.682780+0000 mgr.a (mgr.14373) 8113 : cluster [DBG] pgmap v5627: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:44:43.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:44:42 smithi157 bash[24585]: audit 2024-09-16T08:44:42.369738+0000 mon.b (mon.2) 762 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T08:44:43.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:44:42 smithi086 bash[24289]: cluster 2024-09-16T08:44:41.682780+0000 mgr.a (mgr.14373) 8113 : cluster [DBG] pgmap v5627: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:44:43.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:44:42 smithi086 bash[24289]: audit 2024-09-16T08:44:42.369738+0000 mon.b (mon.2) 762 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T08:44:43.849 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:44:43.849 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:44:43.849 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:44:44.088 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 08:44:43 smithi047 bash[22994]: debug 2024-09-16T08:44:43.921+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T08:44:44.088 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 08:44:43 smithi047 bash[22994]: debug 2024-09-16T08:44:43.925+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T08:44:44.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:44:43 smithi047 bash[22744]: audit 2024-09-16T08:44:43.172742+0000 mon.b (mon.2) 763 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T08:44:44.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:44:43 smithi047 bash[22744]: audit 2024-09-16T08:44:43.174627+0000 mon.b (mon.2) 764 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T08:44:44.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:44:43 smithi047 bash[22744]: audit 2024-09-16T08:44:43.188296+0000 mon.a (mon.0) 1057 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:44:44.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:44:43 smithi047 bash[22744]: audit 2024-09-16T08:44:43.191399+0000 mon.b (mon.2) 765 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:44:44.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:44:43 smithi157 bash[24585]: audit 2024-09-16T08:44:43.172742+0000 mon.b (mon.2) 763 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T08:44:44.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:44:43 smithi157 bash[24585]: audit 2024-09-16T08:44:43.174627+0000 mon.b (mon.2) 764 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T08:44:44.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:44:43 smithi157 bash[24585]: audit 2024-09-16T08:44:43.188296+0000 mon.a (mon.0) 1057 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:44:44.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:44:43 smithi157 bash[24585]: audit 2024-09-16T08:44:43.191399+0000 mon.b (mon.2) 765 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:44:44.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:44:43 smithi086 bash[24289]: audit 2024-09-16T08:44:43.172742+0000 mon.b (mon.2) 763 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T08:44:44.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:44:43 smithi086 bash[24289]: audit 2024-09-16T08:44:43.174627+0000 mon.b (mon.2) 764 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T08:44:44.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:44:43 smithi086 bash[24289]: audit 2024-09-16T08:44:43.188296+0000 mon.a (mon.0) 1057 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:44:44.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:44:43 smithi086 bash[24289]: audit 2024-09-16T08:44:43.191399+0000 mon.b (mon.2) 765 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:44:44.578 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:44:44.578 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:44:44.578 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:44:44.578 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:44:44.578 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:44:45.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:44:44 smithi157 bash[24585]: audit 2024-09-16T08:44:43.196028+0000 mgr.a (mgr.14373) 8114 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:44:45.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:44:44 smithi157 bash[24585]: cluster 2024-09-16T08:44:43.683392+0000 mgr.a (mgr.14373) 8115 : cluster [DBG] pgmap v5628: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:44:45.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:44:44 smithi086 bash[24289]: audit 2024-09-16T08:44:43.196028+0000 mgr.a (mgr.14373) 8114 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:44:45.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:44:44 smithi086 bash[24289]: cluster 2024-09-16T08:44:43.683392+0000 mgr.a (mgr.14373) 8115 : cluster [DBG] pgmap v5628: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:44:45.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:44:44 smithi047 bash[22744]: audit 2024-09-16T08:44:43.196028+0000 mgr.a (mgr.14373) 8114 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:44:45.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:44:44 smithi047 bash[22744]: cluster 2024-09-16T08:44:43.683392+0000 mgr.a (mgr.14373) 8115 : cluster [DBG] pgmap v5628: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:44:46.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:44:45 smithi157 bash[24585]: audit 2024-09-16T08:44:43.925027+0000 mgr.a (mgr.14373) 8116 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T08:44:46.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:44:45 smithi157 bash[24585]: cephadm 2024-09-16T08:44:43.926875+0000 mgr.a (mgr.14373) 8117 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T08:44:46.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:44:45 smithi157 bash[24585]: audit 2024-09-16T08:44:44.168278+0000 mgr.a (mgr.14373) 8118 : audit [DBG] from='client.182049 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:44:46.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:44:45 smithi086 bash[24289]: audit 2024-09-16T08:44:43.925027+0000 mgr.a (mgr.14373) 8116 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T08:44:46.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:44:45 smithi086 bash[24289]: cephadm 2024-09-16T08:44:43.926875+0000 mgr.a (mgr.14373) 8117 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T08:44:46.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:44:45 smithi086 bash[24289]: audit 2024-09-16T08:44:44.168278+0000 mgr.a (mgr.14373) 8118 : audit [DBG] from='client.182049 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:44:46.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:44:45 smithi047 bash[22744]: audit 2024-09-16T08:44:43.925027+0000 mgr.a (mgr.14373) 8116 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T08:44:46.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:44:45 smithi047 bash[22744]: cephadm 2024-09-16T08:44:43.926875+0000 mgr.a (mgr.14373) 8117 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T08:44:46.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:44:45 smithi047 bash[22744]: audit 2024-09-16T08:44:44.168278+0000 mgr.a (mgr.14373) 8118 : audit [DBG] from='client.182049 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:44:47.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:44:46 smithi157 bash[24585]: cluster 2024-09-16T08:44:45.684311+0000 mgr.a (mgr.14373) 8119 : cluster [DBG] pgmap v5629: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:44:47.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:44:46 smithi086 bash[24289]: cluster 2024-09-16T08:44:45.684311+0000 mgr.a (mgr.14373) 8119 : cluster [DBG] pgmap v5629: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:44:47.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:44:46 smithi047 bash[22744]: cluster 2024-09-16T08:44:45.684311+0000 mgr.a (mgr.14373) 8119 : cluster [DBG] pgmap v5629: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:44:49.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:44:48 smithi157 bash[24585]: cluster 2024-09-16T08:44:47.686558+0000 mgr.a (mgr.14373) 8120 : cluster [DBG] pgmap v5630: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:44:49.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:44:48 smithi086 bash[24289]: cluster 2024-09-16T08:44:47.686558+0000 mgr.a (mgr.14373) 8120 : cluster [DBG] pgmap v5630: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:44:49.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:44:48 smithi047 bash[22744]: cluster 2024-09-16T08:44:47.686558+0000 mgr.a (mgr.14373) 8120 : cluster [DBG] pgmap v5630: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:44:49.579 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:44:49.580 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:44:49.580 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:44:50.360 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:44:50.361 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:44:50.361 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:44:50.361 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:44:50.361 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:44:51.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:44:50 smithi157 bash[24585]: cluster 2024-09-16T08:44:49.686974+0000 mgr.a (mgr.14373) 8121 : cluster [DBG] pgmap v5631: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:44:51.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:44:50 smithi086 bash[24289]: cluster 2024-09-16T08:44:49.686974+0000 mgr.a (mgr.14373) 8121 : cluster [DBG] pgmap v5631: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:44:51.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:44:50 smithi047 bash[22744]: cluster 2024-09-16T08:44:49.686974+0000 mgr.a (mgr.14373) 8121 : cluster [DBG] pgmap v5631: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:44:52.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:44:51 smithi157 bash[24585]: audit 2024-09-16T08:44:49.918322+0000 mgr.a (mgr.14373) 8122 : audit [DBG] from='client.182121 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:44:52.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:44:51 smithi086 bash[24289]: audit 2024-09-16T08:44:49.918322+0000 mgr.a (mgr.14373) 8122 : audit [DBG] from='client.182121 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:44:52.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:44:51 smithi047 bash[22744]: audit 2024-09-16T08:44:49.918322+0000 mgr.a (mgr.14373) 8122 : audit [DBG] from='client.182121 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:44:53.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:44:52 smithi157 bash[24585]: cluster 2024-09-16T08:44:51.689199+0000 mgr.a (mgr.14373) 8123 : cluster [DBG] pgmap v5632: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:44:53.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:44:52 smithi086 bash[24289]: cluster 2024-09-16T08:44:51.689199+0000 mgr.a (mgr.14373) 8123 : cluster [DBG] pgmap v5632: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:44:53.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:44:52 smithi047 bash[22744]: cluster 2024-09-16T08:44:51.689199+0000 mgr.a (mgr.14373) 8123 : cluster [DBG] pgmap v5632: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:44:54.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:44:53 smithi157 bash[24585]: cluster 2024-09-16T08:44:53.689964+0000 mgr.a (mgr.14373) 8124 : cluster [DBG] pgmap v5633: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:44:54.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:44:53 smithi086 bash[24289]: cluster 2024-09-16T08:44:53.689964+0000 mgr.a (mgr.14373) 8124 : cluster [DBG] pgmap v5633: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:44:54.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:44:53 smithi047 bash[22744]: cluster 2024-09-16T08:44:53.689964+0000 mgr.a (mgr.14373) 8124 : cluster [DBG] pgmap v5633: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:44:55.362 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:44:55.362 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:44:55.363 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:44:56.145 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:44:56.145 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:44:56.145 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:44:56.145 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:44:56.145 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:44:57.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:44:56 smithi157 bash[24585]: cluster 2024-09-16T08:44:55.690490+0000 mgr.a (mgr.14373) 8125 : cluster [DBG] pgmap v5634: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:44:57.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:44:56 smithi157 bash[24585]: audit 2024-09-16T08:44:55.700518+0000 mgr.a (mgr.14373) 8126 : audit [DBG] from='client.182196 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:44:57.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:44:56 smithi086 bash[24289]: cluster 2024-09-16T08:44:55.690490+0000 mgr.a (mgr.14373) 8125 : cluster [DBG] pgmap v5634: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:44:57.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:44:56 smithi086 bash[24289]: audit 2024-09-16T08:44:55.700518+0000 mgr.a (mgr.14373) 8126 : audit [DBG] from='client.182196 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:44:57.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:44:56 smithi047 bash[22744]: cluster 2024-09-16T08:44:55.690490+0000 mgr.a (mgr.14373) 8125 : cluster [DBG] pgmap v5634: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:44:57.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:44:56 smithi047 bash[22744]: audit 2024-09-16T08:44:55.700518+0000 mgr.a (mgr.14373) 8126 : audit [DBG] from='client.182196 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:44:59.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:44:58 smithi157 bash[24585]: cluster 2024-09-16T08:44:57.692760+0000 mgr.a (mgr.14373) 8127 : cluster [DBG] pgmap v5635: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:44:59.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:44:58 smithi086 bash[24289]: cluster 2024-09-16T08:44:57.692760+0000 mgr.a (mgr.14373) 8127 : cluster [DBG] pgmap v5635: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:44:59.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:44:58 smithi047 bash[22744]: cluster 2024-09-16T08:44:57.692760+0000 mgr.a (mgr.14373) 8127 : cluster [DBG] pgmap v5635: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:45:01.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:45:00 smithi157 bash[24585]: cluster 2024-09-16T08:44:59.693587+0000 mgr.a (mgr.14373) 8128 : cluster [DBG] pgmap v5636: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:45:01.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:45:00 smithi086 bash[24289]: cluster 2024-09-16T08:44:59.693587+0000 mgr.a (mgr.14373) 8128 : cluster [DBG] pgmap v5636: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:45:01.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:45:00 smithi047 bash[22744]: cluster 2024-09-16T08:44:59.693587+0000 mgr.a (mgr.14373) 8128 : cluster [DBG] pgmap v5636: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:45:01.146 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:45:01.147 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:45:01.147 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:45:01.920 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:45:01.920 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:45:01.920 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:45:01.920 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:45:01.920 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:45:03.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:45:02 smithi157 bash[24585]: audit 2024-09-16T08:45:01.485981+0000 mgr.a (mgr.14373) 8129 : audit [DBG] from='client.182274 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:45:03.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:45:02 smithi157 bash[24585]: cluster 2024-09-16T08:45:01.694895+0000 mgr.a (mgr.14373) 8130 : cluster [DBG] pgmap v5637: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:45:03.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:45:02 smithi086 bash[24289]: audit 2024-09-16T08:45:01.485981+0000 mgr.a (mgr.14373) 8129 : audit [DBG] from='client.182274 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:45:03.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:45:02 smithi086 bash[24289]: cluster 2024-09-16T08:45:01.694895+0000 mgr.a (mgr.14373) 8130 : cluster [DBG] pgmap v5637: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:45:03.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:45:02 smithi047 bash[22744]: audit 2024-09-16T08:45:01.485981+0000 mgr.a (mgr.14373) 8129 : audit [DBG] from='client.182274 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:45:03.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:45:02 smithi047 bash[22744]: cluster 2024-09-16T08:45:01.694895+0000 mgr.a (mgr.14373) 8130 : cluster [DBG] pgmap v5637: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:45:05.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:45:04 smithi157 bash[24585]: cluster 2024-09-16T08:45:03.695761+0000 mgr.a (mgr.14373) 8131 : cluster [DBG] pgmap v5638: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T08:45:05.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:45:04 smithi086 bash[24289]: cluster 2024-09-16T08:45:03.695761+0000 mgr.a (mgr.14373) 8131 : cluster [DBG] pgmap v5638: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T08:45:05.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:45:04 smithi047 bash[22744]: cluster 2024-09-16T08:45:03.695761+0000 mgr.a (mgr.14373) 8131 : cluster [DBG] pgmap v5638: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T08:45:06.921 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:45:06.922 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:45:06.922 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:45:07.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:45:06 smithi157 bash[24585]: cluster 2024-09-16T08:45:05.696533+0000 mgr.a (mgr.14373) 8132 : cluster [DBG] pgmap v5639: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T08:45:07.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:45:06 smithi086 bash[24289]: cluster 2024-09-16T08:45:05.696533+0000 mgr.a (mgr.14373) 8132 : cluster [DBG] pgmap v5639: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T08:45:07.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:45:06 smithi047 bash[22744]: cluster 2024-09-16T08:45:05.696533+0000 mgr.a (mgr.14373) 8132 : cluster [DBG] pgmap v5639: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T08:45:07.674 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:45:07.674 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:45:07.674 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:45:07.674 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:45:07.674 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:45:09.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:45:08 smithi157 bash[24585]: audit 2024-09-16T08:45:07.255112+0000 mgr.a (mgr.14373) 8133 : audit [DBG] from='client.182349 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:45:09.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:45:08 smithi157 bash[24585]: cluster 2024-09-16T08:45:07.697861+0000 mgr.a (mgr.14373) 8134 : cluster [DBG] pgmap v5640: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:45:09.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:45:08 smithi086 bash[24289]: audit 2024-09-16T08:45:07.255112+0000 mgr.a (mgr.14373) 8133 : audit [DBG] from='client.182349 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:45:09.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:45:08 smithi086 bash[24289]: cluster 2024-09-16T08:45:07.697861+0000 mgr.a (mgr.14373) 8134 : cluster [DBG] pgmap v5640: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:45:09.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:45:08 smithi047 bash[22744]: audit 2024-09-16T08:45:07.255112+0000 mgr.a (mgr.14373) 8133 : audit [DBG] from='client.182349 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:45:09.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:45:08 smithi047 bash[22744]: cluster 2024-09-16T08:45:07.697861+0000 mgr.a (mgr.14373) 8134 : cluster [DBG] pgmap v5640: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:45:11.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:45:10 smithi157 bash[24585]: cluster 2024-09-16T08:45:09.698587+0000 mgr.a (mgr.14373) 8135 : cluster [DBG] pgmap v5641: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T08:45:11.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:45:10 smithi086 bash[24289]: cluster 2024-09-16T08:45:09.698587+0000 mgr.a (mgr.14373) 8135 : cluster [DBG] pgmap v5641: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T08:45:11.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:45:10 smithi047 bash[22744]: cluster 2024-09-16T08:45:09.698587+0000 mgr.a (mgr.14373) 8135 : cluster [DBG] pgmap v5641: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T08:45:12.675 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:45:12.676 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:45:12.676 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:45:13.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:45:12 smithi157 bash[24585]: cluster 2024-09-16T08:45:11.700513+0000 mgr.a (mgr.14373) 8136 : cluster [DBG] pgmap v5642: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:45:13.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:45:12 smithi086 bash[24289]: cluster 2024-09-16T08:45:11.700513+0000 mgr.a (mgr.14373) 8136 : cluster [DBG] pgmap v5642: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:45:13.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:45:12 smithi047 bash[22744]: cluster 2024-09-16T08:45:11.700513+0000 mgr.a (mgr.14373) 8136 : cluster [DBG] pgmap v5642: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:45:13.461 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:45:13.461 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:45:13.461 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:45:13.461 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:45:13.461 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:45:15.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:45:14 smithi157 bash[24585]: audit 2024-09-16T08:45:13.021088+0000 mgr.a (mgr.14373) 8137 : audit [DBG] from='client.182424 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:45:15.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:45:14 smithi157 bash[24585]: cluster 2024-09-16T08:45:13.701587+0000 mgr.a (mgr.14373) 8138 : cluster [DBG] pgmap v5643: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:45:15.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:45:14 smithi086 bash[24289]: audit 2024-09-16T08:45:13.021088+0000 mgr.a (mgr.14373) 8137 : audit [DBG] from='client.182424 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:45:15.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:45:14 smithi086 bash[24289]: cluster 2024-09-16T08:45:13.701587+0000 mgr.a (mgr.14373) 8138 : cluster [DBG] pgmap v5643: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:45:15.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:45:14 smithi047 bash[22744]: audit 2024-09-16T08:45:13.021088+0000 mgr.a (mgr.14373) 8137 : audit [DBG] from='client.182424 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:45:15.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:45:14 smithi047 bash[22744]: cluster 2024-09-16T08:45:13.701587+0000 mgr.a (mgr.14373) 8138 : cluster [DBG] pgmap v5643: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:45:17.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:45:16 smithi157 bash[24585]: cluster 2024-09-16T08:45:15.702566+0000 mgr.a (mgr.14373) 8139 : cluster [DBG] pgmap v5644: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:45:17.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:45:16 smithi086 bash[24289]: cluster 2024-09-16T08:45:15.702566+0000 mgr.a (mgr.14373) 8139 : cluster [DBG] pgmap v5644: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:45:17.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:45:16 smithi047 bash[22744]: cluster 2024-09-16T08:45:15.702566+0000 mgr.a (mgr.14373) 8139 : cluster [DBG] pgmap v5644: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:45:18.463 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:45:18.463 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:45:18.463 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:45:19.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:45:18 smithi157 bash[24585]: cluster 2024-09-16T08:45:17.704934+0000 mgr.a (mgr.14373) 8140 : cluster [DBG] pgmap v5645: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:45:19.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:45:18 smithi086 bash[24289]: cluster 2024-09-16T08:45:17.704934+0000 mgr.a (mgr.14373) 8140 : cluster [DBG] pgmap v5645: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:45:19.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:45:18 smithi047 bash[22744]: cluster 2024-09-16T08:45:17.704934+0000 mgr.a (mgr.14373) 8140 : cluster [DBG] pgmap v5645: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:45:19.236 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:45:19.236 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:45:19.236 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:45:19.236 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:45:19.236 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:45:20.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:45:19 smithi157 bash[24585]: audit 2024-09-16T08:45:18.802261+0000 mgr.a (mgr.14373) 8141 : audit [DBG] from='client.182499 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:45:20.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:45:19 smithi086 bash[24289]: audit 2024-09-16T08:45:18.802261+0000 mgr.a (mgr.14373) 8141 : audit [DBG] from='client.182499 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:45:20.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:45:19 smithi047 bash[22744]: audit 2024-09-16T08:45:18.802261+0000 mgr.a (mgr.14373) 8141 : audit [DBG] from='client.182499 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:45:21.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:45:20 smithi086 bash[24289]: cluster 2024-09-16T08:45:19.705943+0000 mgr.a (mgr.14373) 8142 : cluster [DBG] pgmap v5646: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:45:21.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:45:20 smithi047 bash[22744]: cluster 2024-09-16T08:45:19.705943+0000 mgr.a (mgr.14373) 8142 : cluster [DBG] pgmap v5646: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:45:21.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:45:20 smithi157 bash[24585]: cluster 2024-09-16T08:45:19.705943+0000 mgr.a (mgr.14373) 8142 : cluster [DBG] pgmap v5646: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:45:23.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:45:22 smithi086 bash[24289]: cluster 2024-09-16T08:45:21.708278+0000 mgr.a (mgr.14373) 8143 : cluster [DBG] pgmap v5647: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:45:23.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:45:22 smithi047 bash[22744]: cluster 2024-09-16T08:45:21.708278+0000 mgr.a (mgr.14373) 8143 : cluster [DBG] pgmap v5647: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:45:23.305 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:45:22 smithi157 bash[24585]: cluster 2024-09-16T08:45:21.708278+0000 mgr.a (mgr.14373) 8143 : cluster [DBG] pgmap v5647: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:45:24.237 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:45:24.238 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:45:24.238 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:45:25.026 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:45:25.026 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:45:25.026 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:45:25.026 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:45:25.027 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:45:25.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:45:24 smithi086 bash[24289]: cluster 2024-09-16T08:45:23.709063+0000 mgr.a (mgr.14373) 8144 : cluster [DBG] pgmap v5648: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:45:25.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:45:24 smithi047 bash[22744]: cluster 2024-09-16T08:45:23.709063+0000 mgr.a (mgr.14373) 8144 : cluster [DBG] pgmap v5648: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:45:25.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:45:24 smithi157 bash[24585]: cluster 2024-09-16T08:45:23.709063+0000 mgr.a (mgr.14373) 8144 : cluster [DBG] pgmap v5648: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:45:26.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:45:25 smithi086 bash[24289]: audit 2024-09-16T08:45:24.577669+0000 mgr.a (mgr.14373) 8145 : audit [DBG] from='client.182571 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:45:26.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:45:25 smithi047 bash[22744]: audit 2024-09-16T08:45:24.577669+0000 mgr.a (mgr.14373) 8145 : audit [DBG] from='client.182571 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:45:26.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:45:25 smithi157 bash[24585]: audit 2024-09-16T08:45:24.577669+0000 mgr.a (mgr.14373) 8145 : audit [DBG] from='client.182571 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:45:27.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:45:26 smithi047 bash[22744]: cluster 2024-09-16T08:45:25.710018+0000 mgr.a (mgr.14373) 8146 : cluster [DBG] pgmap v5649: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:45:27.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:45:26 smithi157 bash[24585]: cluster 2024-09-16T08:45:25.710018+0000 mgr.a (mgr.14373) 8146 : cluster [DBG] pgmap v5649: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:45:27.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:45:26 smithi086 bash[24289]: cluster 2024-09-16T08:45:25.710018+0000 mgr.a (mgr.14373) 8146 : cluster [DBG] pgmap v5649: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:45:29.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:45:28 smithi047 bash[22744]: cluster 2024-09-16T08:45:27.712275+0000 mgr.a (mgr.14373) 8147 : cluster [DBG] pgmap v5650: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:45:29.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:45:28 smithi157 bash[24585]: cluster 2024-09-16T08:45:27.712275+0000 mgr.a (mgr.14373) 8147 : cluster [DBG] pgmap v5650: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:45:29.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:45:28 smithi086 bash[24289]: cluster 2024-09-16T08:45:27.712275+0000 mgr.a (mgr.14373) 8147 : cluster [DBG] pgmap v5650: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:45:30.027 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:45:30.029 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:45:30.029 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:45:30.786 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:45:30.786 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:45:30.786 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:45:30.786 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:45:30.787 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:45:31.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:45:30 smithi047 bash[22744]: cluster 2024-09-16T08:45:29.713057+0000 mgr.a (mgr.14373) 8148 : cluster [DBG] pgmap v5651: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:45:31.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:45:30 smithi157 bash[24585]: cluster 2024-09-16T08:45:29.713057+0000 mgr.a (mgr.14373) 8148 : cluster [DBG] pgmap v5651: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:45:31.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:45:30 smithi086 bash[24289]: cluster 2024-09-16T08:45:29.713057+0000 mgr.a (mgr.14373) 8148 : cluster [DBG] pgmap v5651: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:45:32.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:45:31 smithi157 bash[24585]: audit 2024-09-16T08:45:30.362799+0000 mgr.a (mgr.14373) 8149 : audit [DBG] from='client.182646 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:45:32.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:45:31 smithi086 bash[24289]: audit 2024-09-16T08:45:30.362799+0000 mgr.a (mgr.14373) 8149 : audit [DBG] from='client.182646 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:45:32.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:45:31 smithi047 bash[22744]: audit 2024-09-16T08:45:30.362799+0000 mgr.a (mgr.14373) 8149 : audit [DBG] from='client.182646 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:45:33.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:45:32 smithi157 bash[24585]: cluster 2024-09-16T08:45:31.715341+0000 mgr.a (mgr.14373) 8150 : cluster [DBG] pgmap v5652: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:45:33.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:45:32 smithi086 bash[24289]: cluster 2024-09-16T08:45:31.715341+0000 mgr.a (mgr.14373) 8150 : cluster [DBG] pgmap v5652: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:45:33.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:45:32 smithi047 bash[22744]: cluster 2024-09-16T08:45:31.715341+0000 mgr.a (mgr.14373) 8150 : cluster [DBG] pgmap v5652: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:45:35.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:45:34 smithi157 bash[24585]: cluster 2024-09-16T08:45:33.716153+0000 mgr.a (mgr.14373) 8151 : cluster [DBG] pgmap v5653: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:45:35.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:45:34 smithi086 bash[24289]: cluster 2024-09-16T08:45:33.716153+0000 mgr.a (mgr.14373) 8151 : cluster [DBG] pgmap v5653: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:45:35.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:45:34 smithi047 bash[22744]: cluster 2024-09-16T08:45:33.716153+0000 mgr.a (mgr.14373) 8151 : cluster [DBG] pgmap v5653: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:45:35.787 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:45:35.788 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:45:35.789 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:45:36.571 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:45:36.572 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:45:36.572 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:45:36.572 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:45:36.572 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:45:37.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:45:36 smithi157 bash[24585]: cluster 2024-09-16T08:45:35.716935+0000 mgr.a (mgr.14373) 8152 : cluster [DBG] pgmap v5654: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:45:37.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:45:36 smithi086 bash[24289]: cluster 2024-09-16T08:45:35.716935+0000 mgr.a (mgr.14373) 8152 : cluster [DBG] pgmap v5654: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:45:37.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:45:36 smithi047 bash[22744]: cluster 2024-09-16T08:45:35.716935+0000 mgr.a (mgr.14373) 8152 : cluster [DBG] pgmap v5654: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:45:38.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:45:37 smithi157 bash[24585]: audit 2024-09-16T08:45:36.131888+0000 mgr.a (mgr.14373) 8153 : audit [DBG] from='client.182724 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:45:38.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:45:37 smithi086 bash[24289]: audit 2024-09-16T08:45:36.131888+0000 mgr.a (mgr.14373) 8153 : audit [DBG] from='client.182724 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:45:38.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:45:37 smithi047 bash[22744]: audit 2024-09-16T08:45:36.131888+0000 mgr.a (mgr.14373) 8153 : audit [DBG] from='client.182724 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:45:39.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:45:38 smithi157 bash[24585]: cluster 2024-09-16T08:45:37.719350+0000 mgr.a (mgr.14373) 8154 : cluster [DBG] pgmap v5655: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-16T08:45:39.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:45:38 smithi086 bash[24289]: cluster 2024-09-16T08:45:37.719350+0000 mgr.a (mgr.14373) 8154 : cluster [DBG] pgmap v5655: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-16T08:45:39.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:45:38 smithi047 bash[22744]: cluster 2024-09-16T08:45:37.719350+0000 mgr.a (mgr.14373) 8154 : cluster [DBG] pgmap v5655: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-16T08:45:41.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:45:40 smithi157 bash[24585]: cluster 2024-09-16T08:45:39.720141+0000 mgr.a (mgr.14373) 8155 : cluster [DBG] pgmap v5656: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T08:45:41.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:45:40 smithi086 bash[24289]: cluster 2024-09-16T08:45:39.720141+0000 mgr.a (mgr.14373) 8155 : cluster [DBG] pgmap v5656: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T08:45:41.360 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:45:40 smithi047 bash[22744]: cluster 2024-09-16T08:45:39.720141+0000 mgr.a (mgr.14373) 8155 : cluster [DBG] pgmap v5656: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T08:45:41.573 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:45:41.574 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:45:41.574 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:45:42.356 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:45:42.357 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:45:42.357 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:45:42.357 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:45:42.357 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:45:43.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:45:42 smithi157 bash[24585]: cluster 2024-09-16T08:45:41.721106+0000 mgr.a (mgr.14373) 8156 : cluster [DBG] pgmap v5657: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:45:43.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:45:42 smithi086 bash[24289]: cluster 2024-09-16T08:45:41.721106+0000 mgr.a (mgr.14373) 8156 : cluster [DBG] pgmap v5657: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:45:43.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:45:42 smithi047 bash[22744]: cluster 2024-09-16T08:45:41.721106+0000 mgr.a (mgr.14373) 8156 : cluster [DBG] pgmap v5657: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:45:44.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:45:43 smithi157 bash[24585]: audit 2024-09-16T08:45:41.912164+0000 mgr.a (mgr.14373) 8157 : audit [DBG] from='client.182802 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:45:44.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:45:43 smithi086 bash[24289]: audit 2024-09-16T08:45:41.912164+0000 mgr.a (mgr.14373) 8157 : audit [DBG] from='client.182802 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:45:44.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:45:43 smithi047 bash[22744]: audit 2024-09-16T08:45:41.912164+0000 mgr.a (mgr.14373) 8157 : audit [DBG] from='client.182802 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:45:45.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:45:44 smithi157 bash[24585]: cluster 2024-09-16T08:45:43.721951+0000 mgr.a (mgr.14373) 8158 : cluster [DBG] pgmap v5658: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T08:45:45.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:45:44 smithi157 bash[24585]: audit 2024-09-16T08:45:43.974163+0000 mon.b (mon.2) 766 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T08:45:45.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:45:44 smithi157 bash[24585]: audit 2024-09-16T08:45:44.800600+0000 mon.b (mon.2) 767 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T08:45:45.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:45:44 smithi157 bash[24585]: audit 2024-09-16T08:45:44.802797+0000 mon.b (mon.2) 768 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T08:45:45.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:45:44 smithi157 bash[24585]: audit 2024-09-16T08:45:44.812061+0000 mon.a (mon.0) 1058 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:45:45.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:45:44 smithi157 bash[24585]: audit 2024-09-16T08:45:44.817603+0000 mon.b (mon.2) 769 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:45:45.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:45:44 smithi157 bash[24585]: audit 2024-09-16T08:45:44.822267+0000 mgr.a (mgr.14373) 8159 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:45:45.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:45:44 smithi086 bash[24289]: cluster 2024-09-16T08:45:43.721951+0000 mgr.a (mgr.14373) 8158 : cluster [DBG] pgmap v5658: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T08:45:45.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:45:44 smithi086 bash[24289]: audit 2024-09-16T08:45:43.974163+0000 mon.b (mon.2) 766 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T08:45:45.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:45:44 smithi086 bash[24289]: audit 2024-09-16T08:45:44.800600+0000 mon.b (mon.2) 767 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T08:45:45.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:45:44 smithi086 bash[24289]: audit 2024-09-16T08:45:44.802797+0000 mon.b (mon.2) 768 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T08:45:45.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:45:44 smithi086 bash[24289]: audit 2024-09-16T08:45:44.812061+0000 mon.a (mon.0) 1058 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:45:45.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:45:44 smithi086 bash[24289]: audit 2024-09-16T08:45:44.817603+0000 mon.b (mon.2) 769 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:45:45.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:45:44 smithi086 bash[24289]: audit 2024-09-16T08:45:44.822267+0000 mgr.a (mgr.14373) 8159 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:45:45.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:45:44 smithi047 bash[22744]: cluster 2024-09-16T08:45:43.721951+0000 mgr.a (mgr.14373) 8158 : cluster [DBG] pgmap v5658: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T08:45:45.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:45:44 smithi047 bash[22744]: audit 2024-09-16T08:45:43.974163+0000 mon.b (mon.2) 766 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T08:45:45.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:45:44 smithi047 bash[22744]: audit 2024-09-16T08:45:44.800600+0000 mon.b (mon.2) 767 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T08:45:45.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:45:44 smithi047 bash[22744]: audit 2024-09-16T08:45:44.802797+0000 mon.b (mon.2) 768 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T08:45:45.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:45:44 smithi047 bash[22744]: audit 2024-09-16T08:45:44.812061+0000 mon.a (mon.0) 1058 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:45:45.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:45:44 smithi047 bash[22744]: audit 2024-09-16T08:45:44.817603+0000 mon.b (mon.2) 769 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:45:45.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:45:44 smithi047 bash[22744]: audit 2024-09-16T08:45:44.822267+0000 mgr.a (mgr.14373) 8159 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:45:45.840 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 08:45:45 smithi047 bash[22994]: debug 2024-09-16T08:45:45.543+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T08:45:45.840 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 08:45:45 smithi047 bash[22994]: debug 2024-09-16T08:45:45.543+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T08:45:46.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:45:45 smithi157 bash[24585]: audit 2024-09-16T08:45:45.546331+0000 mgr.a (mgr.14373) 8160 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T08:45:46.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:45:45 smithi157 bash[24585]: cephadm 2024-09-16T08:45:45.548465+0000 mgr.a (mgr.14373) 8161 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T08:45:46.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:45:45 smithi157 bash[24585]: cluster 2024-09-16T08:45:45.722904+0000 mgr.a (mgr.14373) 8162 : cluster [DBG] pgmap v5659: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T08:45:46.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:45:45 smithi086 bash[24289]: audit 2024-09-16T08:45:45.546331+0000 mgr.a (mgr.14373) 8160 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T08:45:46.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:45:45 smithi086 bash[24289]: cephadm 2024-09-16T08:45:45.548465+0000 mgr.a (mgr.14373) 8161 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T08:45:46.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:45:45 smithi086 bash[24289]: cluster 2024-09-16T08:45:45.722904+0000 mgr.a (mgr.14373) 8162 : cluster [DBG] pgmap v5659: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T08:45:46.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:45:45 smithi047 bash[22744]: audit 2024-09-16T08:45:45.546331+0000 mgr.a (mgr.14373) 8160 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T08:45:46.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:45:45 smithi047 bash[22744]: cephadm 2024-09-16T08:45:45.548465+0000 mgr.a (mgr.14373) 8161 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T08:45:46.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:45:45 smithi047 bash[22744]: cluster 2024-09-16T08:45:45.722904+0000 mgr.a (mgr.14373) 8162 : cluster [DBG] pgmap v5659: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T08:45:47.357 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:45:47.358 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:45:47.358 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:45:48.104 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:45:48.104 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:45:48.104 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:45:48.105 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:45:48.105 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:45:49.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:45:48 smithi157 bash[24585]: audit 2024-09-16T08:45:47.689893+0000 mgr.a (mgr.14373) 8163 : audit [DBG] from='client.182985 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:45:49.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:45:48 smithi157 bash[24585]: cluster 2024-09-16T08:45:47.724488+0000 mgr.a (mgr.14373) 8164 : cluster [DBG] pgmap v5660: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:45:49.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:45:48 smithi086 bash[24289]: audit 2024-09-16T08:45:47.689893+0000 mgr.a (mgr.14373) 8163 : audit [DBG] from='client.182985 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:45:49.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:45:48 smithi086 bash[24289]: cluster 2024-09-16T08:45:47.724488+0000 mgr.a (mgr.14373) 8164 : cluster [DBG] pgmap v5660: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:45:49.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:45:48 smithi047 bash[22744]: audit 2024-09-16T08:45:47.689893+0000 mgr.a (mgr.14373) 8163 : audit [DBG] from='client.182985 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:45:49.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:45:48 smithi047 bash[22744]: cluster 2024-09-16T08:45:47.724488+0000 mgr.a (mgr.14373) 8164 : cluster [DBG] pgmap v5660: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:45:51.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:45:50 smithi157 bash[24585]: cluster 2024-09-16T08:45:49.725383+0000 mgr.a (mgr.14373) 8165 : cluster [DBG] pgmap v5661: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T08:45:51.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:45:50 smithi086 bash[24289]: cluster 2024-09-16T08:45:49.725383+0000 mgr.a (mgr.14373) 8165 : cluster [DBG] pgmap v5661: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T08:45:51.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:45:50 smithi047 bash[22744]: cluster 2024-09-16T08:45:49.725383+0000 mgr.a (mgr.14373) 8165 : cluster [DBG] pgmap v5661: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T08:45:53.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:45:52 smithi157 bash[24585]: cluster 2024-09-16T08:45:51.727565+0000 mgr.a (mgr.14373) 8166 : cluster [DBG] pgmap v5662: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.4 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:45:53.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:45:52 smithi086 bash[24289]: cluster 2024-09-16T08:45:51.727565+0000 mgr.a (mgr.14373) 8166 : cluster [DBG] pgmap v5662: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.4 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:45:53.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:45:52 smithi047 bash[22744]: cluster 2024-09-16T08:45:51.727565+0000 mgr.a (mgr.14373) 8166 : cluster [DBG] pgmap v5662: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.4 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:45:53.105 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:45:53.106 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:45:53.106 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:45:53.883 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:45:53.883 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:45:53.884 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:45:53.884 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:45:53.884 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:45:55.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:45:54 smithi157 bash[24585]: audit 2024-09-16T08:45:53.441717+0000 mgr.a (mgr.14373) 8167 : audit [DBG] from='client.183060 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:45:55.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:45:54 smithi157 bash[24585]: cluster 2024-09-16T08:45:53.728264+0000 mgr.a (mgr.14373) 8168 : cluster [DBG] pgmap v5663: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:45:55.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:45:54 smithi086 bash[24289]: audit 2024-09-16T08:45:53.441717+0000 mgr.a (mgr.14373) 8167 : audit [DBG] from='client.183060 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:45:55.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:45:54 smithi086 bash[24289]: cluster 2024-09-16T08:45:53.728264+0000 mgr.a (mgr.14373) 8168 : cluster [DBG] pgmap v5663: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:45:55.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:45:54 smithi047 bash[22744]: audit 2024-09-16T08:45:53.441717+0000 mgr.a (mgr.14373) 8167 : audit [DBG] from='client.183060 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:45:55.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:45:54 smithi047 bash[22744]: cluster 2024-09-16T08:45:53.728264+0000 mgr.a (mgr.14373) 8168 : cluster [DBG] pgmap v5663: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:45:57.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:45:56 smithi157 bash[24585]: cluster 2024-09-16T08:45:55.729141+0000 mgr.a (mgr.14373) 8169 : cluster [DBG] pgmap v5664: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:45:57.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:45:56 smithi086 bash[24289]: cluster 2024-09-16T08:45:55.729141+0000 mgr.a (mgr.14373) 8169 : cluster [DBG] pgmap v5664: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:45:57.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:45:56 smithi047 bash[22744]: cluster 2024-09-16T08:45:55.729141+0000 mgr.a (mgr.14373) 8169 : cluster [DBG] pgmap v5664: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:45:58.885 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:45:58.885 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:45:58.886 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:45:59.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:45:58 smithi157 bash[24585]: cluster 2024-09-16T08:45:57.731371+0000 mgr.a (mgr.14373) 8170 : cluster [DBG] pgmap v5665: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:45:59.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:45:58 smithi086 bash[24289]: cluster 2024-09-16T08:45:57.731371+0000 mgr.a (mgr.14373) 8170 : cluster [DBG] pgmap v5665: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:45:59.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:45:58 smithi047 bash[22744]: cluster 2024-09-16T08:45:57.731371+0000 mgr.a (mgr.14373) 8170 : cluster [DBG] pgmap v5665: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:45:59.640 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:45:59.640 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:45:59.640 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:45:59.640 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:45:59.640 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:46:01.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:46:00 smithi086 bash[24289]: audit 2024-09-16T08:45:59.224709+0000 mgr.a (mgr.14373) 8171 : audit [DBG] from='client.183138 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:46:01.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:46:00 smithi086 bash[24289]: cluster 2024-09-16T08:45:59.731974+0000 mgr.a (mgr.14373) 8172 : cluster [DBG] pgmap v5666: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:46:01.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:46:00 smithi047 bash[22744]: audit 2024-09-16T08:45:59.224709+0000 mgr.a (mgr.14373) 8171 : audit [DBG] from='client.183138 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:46:01.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:46:00 smithi047 bash[22744]: cluster 2024-09-16T08:45:59.731974+0000 mgr.a (mgr.14373) 8172 : cluster [DBG] pgmap v5666: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:46:01.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:46:00 smithi157 bash[24585]: audit 2024-09-16T08:45:59.224709+0000 mgr.a (mgr.14373) 8171 : audit [DBG] from='client.183138 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:46:01.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:46:00 smithi157 bash[24585]: cluster 2024-09-16T08:45:59.731974+0000 mgr.a (mgr.14373) 8172 : cluster [DBG] pgmap v5666: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:46:03.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:46:02 smithi086 bash[24289]: cluster 2024-09-16T08:46:01.734060+0000 mgr.a (mgr.14373) 8173 : cluster [DBG] pgmap v5667: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:46:03.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:46:02 smithi047 bash[22744]: cluster 2024-09-16T08:46:01.734060+0000 mgr.a (mgr.14373) 8173 : cluster [DBG] pgmap v5667: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:46:03.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:46:02 smithi157 bash[24585]: cluster 2024-09-16T08:46:01.734060+0000 mgr.a (mgr.14373) 8173 : cluster [DBG] pgmap v5667: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:46:04.641 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:46:04.642 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:46:04.642 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:46:05.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:46:04 smithi086 bash[24289]: cluster 2024-09-16T08:46:03.734867+0000 mgr.a (mgr.14373) 8174 : cluster [DBG] pgmap v5668: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:46:05.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:46:04 smithi047 bash[22744]: cluster 2024-09-16T08:46:03.734867+0000 mgr.a (mgr.14373) 8174 : cluster [DBG] pgmap v5668: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:46:05.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:46:04 smithi157 bash[24585]: cluster 2024-09-16T08:46:03.734867+0000 mgr.a (mgr.14373) 8174 : cluster [DBG] pgmap v5668: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:46:05.378 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:46:05.379 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:46:05.379 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:46:05.379 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:46:05.379 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:46:07.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:46:06 smithi086 bash[24289]: audit 2024-09-16T08:46:04.972881+0000 mgr.a (mgr.14373) 8175 : audit [DBG] from='client.183216 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:46:07.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:46:06 smithi086 bash[24289]: cluster 2024-09-16T08:46:05.735733+0000 mgr.a (mgr.14373) 8176 : cluster [DBG] pgmap v5669: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:46:07.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:46:06 smithi047 bash[22744]: audit 2024-09-16T08:46:04.972881+0000 mgr.a (mgr.14373) 8175 : audit [DBG] from='client.183216 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:46:07.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:46:06 smithi047 bash[22744]: cluster 2024-09-16T08:46:05.735733+0000 mgr.a (mgr.14373) 8176 : cluster [DBG] pgmap v5669: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:46:07.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:46:06 smithi157 bash[24585]: audit 2024-09-16T08:46:04.972881+0000 mgr.a (mgr.14373) 8175 : audit [DBG] from='client.183216 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:46:07.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:46:06 smithi157 bash[24585]: cluster 2024-09-16T08:46:05.735733+0000 mgr.a (mgr.14373) 8176 : cluster [DBG] pgmap v5669: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:46:09.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:46:08 smithi047 bash[22744]: cluster 2024-09-16T08:46:07.737866+0000 mgr.a (mgr.14373) 8177 : cluster [DBG] pgmap v5670: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:46:09.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:46:08 smithi157 bash[24585]: cluster 2024-09-16T08:46:07.737866+0000 mgr.a (mgr.14373) 8177 : cluster [DBG] pgmap v5670: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:46:09.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:46:08 smithi086 bash[24289]: cluster 2024-09-16T08:46:07.737866+0000 mgr.a (mgr.14373) 8177 : cluster [DBG] pgmap v5670: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:46:10.380 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:46:10.381 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:46:10.381 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:46:11.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:46:10 smithi047 bash[22744]: cluster 2024-09-16T08:46:09.738635+0000 mgr.a (mgr.14373) 8178 : cluster [DBG] pgmap v5671: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:46:11.161 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:46:11.162 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:46:11.162 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:46:11.162 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:46:11.162 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:46:11.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:46:10 smithi157 bash[24585]: cluster 2024-09-16T08:46:09.738635+0000 mgr.a (mgr.14373) 8178 : cluster [DBG] pgmap v5671: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:46:11.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:46:10 smithi086 bash[24289]: cluster 2024-09-16T08:46:09.738635+0000 mgr.a (mgr.14373) 8178 : cluster [DBG] pgmap v5671: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:46:12.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:46:11 smithi157 bash[24585]: audit 2024-09-16T08:46:10.719259+0000 mgr.a (mgr.14373) 8179 : audit [DBG] from='client.183291 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:46:12.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:46:11 smithi086 bash[24289]: audit 2024-09-16T08:46:10.719259+0000 mgr.a (mgr.14373) 8179 : audit [DBG] from='client.183291 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:46:12.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:46:11 smithi047 bash[22744]: audit 2024-09-16T08:46:10.719259+0000 mgr.a (mgr.14373) 8179 : audit [DBG] from='client.183291 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:46:13.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:46:12 smithi157 bash[24585]: cluster 2024-09-16T08:46:11.740909+0000 mgr.a (mgr.14373) 8180 : cluster [DBG] pgmap v5672: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:46:13.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:46:12 smithi086 bash[24289]: cluster 2024-09-16T08:46:11.740909+0000 mgr.a (mgr.14373) 8180 : cluster [DBG] pgmap v5672: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:46:13.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:46:12 smithi047 bash[22744]: cluster 2024-09-16T08:46:11.740909+0000 mgr.a (mgr.14373) 8180 : cluster [DBG] pgmap v5672: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:46:15.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:46:14 smithi157 bash[24585]: cluster 2024-09-16T08:46:13.741678+0000 mgr.a (mgr.14373) 8181 : cluster [DBG] pgmap v5673: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:46:15.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:46:14 smithi086 bash[24289]: cluster 2024-09-16T08:46:13.741678+0000 mgr.a (mgr.14373) 8181 : cluster [DBG] pgmap v5673: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:46:15.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:46:14 smithi047 bash[22744]: cluster 2024-09-16T08:46:13.741678+0000 mgr.a (mgr.14373) 8181 : cluster [DBG] pgmap v5673: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:46:16.163 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:46:16.164 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:46:16.164 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:46:16.918 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:46:16.918 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:46:16.918 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:46:16.919 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:46:16.919 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:46:17.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:46:16 smithi157 bash[24585]: cluster 2024-09-16T08:46:15.742425+0000 mgr.a (mgr.14373) 8182 : cluster [DBG] pgmap v5674: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:46:17.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:46:16 smithi086 bash[24289]: cluster 2024-09-16T08:46:15.742425+0000 mgr.a (mgr.14373) 8182 : cluster [DBG] pgmap v5674: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:46:17.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:46:16 smithi047 bash[22744]: cluster 2024-09-16T08:46:15.742425+0000 mgr.a (mgr.14373) 8182 : cluster [DBG] pgmap v5674: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:46:18.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:46:17 smithi157 bash[24585]: audit 2024-09-16T08:46:16.498958+0000 mgr.a (mgr.14373) 8183 : audit [DBG] from='client.183369 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:46:18.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:46:17 smithi086 bash[24289]: audit 2024-09-16T08:46:16.498958+0000 mgr.a (mgr.14373) 8183 : audit [DBG] from='client.183369 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:46:18.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:46:17 smithi047 bash[22744]: audit 2024-09-16T08:46:16.498958+0000 mgr.a (mgr.14373) 8183 : audit [DBG] from='client.183369 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:46:19.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:46:18 smithi157 bash[24585]: cluster 2024-09-16T08:46:17.745011+0000 mgr.a (mgr.14373) 8184 : cluster [DBG] pgmap v5675: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:46:19.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:46:18 smithi086 bash[24289]: cluster 2024-09-16T08:46:17.745011+0000 mgr.a (mgr.14373) 8184 : cluster [DBG] pgmap v5675: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:46:19.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:46:18 smithi047 bash[22744]: cluster 2024-09-16T08:46:17.745011+0000 mgr.a (mgr.14373) 8184 : cluster [DBG] pgmap v5675: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:46:21.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:46:20 smithi157 bash[24585]: cluster 2024-09-16T08:46:19.745773+0000 mgr.a (mgr.14373) 8185 : cluster [DBG] pgmap v5676: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:46:21.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:46:20 smithi086 bash[24289]: cluster 2024-09-16T08:46:19.745773+0000 mgr.a (mgr.14373) 8185 : cluster [DBG] pgmap v5676: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:46:21.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:46:20 smithi047 bash[22744]: cluster 2024-09-16T08:46:19.745773+0000 mgr.a (mgr.14373) 8185 : cluster [DBG] pgmap v5676: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:46:21.920 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:46:21.920 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:46:21.921 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:46:22.675 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:46:22.675 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:46:22.675 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:46:22.675 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:46:22.675 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:46:23.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:46:22 smithi157 bash[24585]: cluster 2024-09-16T08:46:21.747730+0000 mgr.a (mgr.14373) 8186 : cluster [DBG] pgmap v5677: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:46:23.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:46:22 smithi086 bash[24289]: cluster 2024-09-16T08:46:21.747730+0000 mgr.a (mgr.14373) 8186 : cluster [DBG] pgmap v5677: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:46:23.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:46:22 smithi047 bash[22744]: cluster 2024-09-16T08:46:21.747730+0000 mgr.a (mgr.14373) 8186 : cluster [DBG] pgmap v5677: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:46:24.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:46:23 smithi157 bash[24585]: audit 2024-09-16T08:46:22.258662+0000 mgr.a (mgr.14373) 8187 : audit [DBG] from='client.183447 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:46:24.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:46:23 smithi086 bash[24289]: audit 2024-09-16T08:46:22.258662+0000 mgr.a (mgr.14373) 8187 : audit [DBG] from='client.183447 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:46:24.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:46:23 smithi047 bash[22744]: audit 2024-09-16T08:46:22.258662+0000 mgr.a (mgr.14373) 8187 : audit [DBG] from='client.183447 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:46:25.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:46:24 smithi157 bash[24585]: cluster 2024-09-16T08:46:23.748624+0000 mgr.a (mgr.14373) 8188 : cluster [DBG] pgmap v5678: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:46:25.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:46:24 smithi086 bash[24289]: cluster 2024-09-16T08:46:23.748624+0000 mgr.a (mgr.14373) 8188 : cluster [DBG] pgmap v5678: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:46:25.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:46:24 smithi047 bash[22744]: cluster 2024-09-16T08:46:23.748624+0000 mgr.a (mgr.14373) 8188 : cluster [DBG] pgmap v5678: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:46:26.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:46:25 smithi157 bash[24585]: cluster 2024-09-16T08:46:25.749399+0000 mgr.a (mgr.14373) 8189 : cluster [DBG] pgmap v5679: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T08:46:26.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:46:25 smithi086 bash[24289]: cluster 2024-09-16T08:46:25.749399+0000 mgr.a (mgr.14373) 8189 : cluster [DBG] pgmap v5679: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T08:46:26.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:46:25 smithi047 bash[22744]: cluster 2024-09-16T08:46:25.749399+0000 mgr.a (mgr.14373) 8189 : cluster [DBG] pgmap v5679: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T08:46:27.677 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:46:27.677 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:46:27.677 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:46:28.433 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:46:28.433 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:46:28.433 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:46:28.434 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:46:28.434 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:46:29.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:46:28 smithi086 bash[24289]: cluster 2024-09-16T08:46:27.751809+0000 mgr.a (mgr.14373) 8190 : cluster [DBG] pgmap v5680: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:46:29.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:46:28 smithi047 bash[22744]: cluster 2024-09-16T08:46:27.751809+0000 mgr.a (mgr.14373) 8190 : cluster [DBG] pgmap v5680: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:46:29.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:46:28 smithi157 bash[24585]: cluster 2024-09-16T08:46:27.751809+0000 mgr.a (mgr.14373) 8190 : cluster [DBG] pgmap v5680: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:46:30.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:46:29 smithi086 bash[24289]: audit 2024-09-16T08:46:28.009979+0000 mgr.a (mgr.14373) 8191 : audit [DBG] from='client.183522 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:46:30.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:46:29 smithi047 bash[22744]: audit 2024-09-16T08:46:28.009979+0000 mgr.a (mgr.14373) 8191 : audit [DBG] from='client.183522 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:46:30.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:46:29 smithi157 bash[24585]: audit 2024-09-16T08:46:28.009979+0000 mgr.a (mgr.14373) 8191 : audit [DBG] from='client.183522 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:46:31.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:46:30 smithi086 bash[24289]: cluster 2024-09-16T08:46:29.752700+0000 mgr.a (mgr.14373) 8192 : cluster [DBG] pgmap v5681: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:46:31.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:46:30 smithi047 bash[22744]: cluster 2024-09-16T08:46:29.752700+0000 mgr.a (mgr.14373) 8192 : cluster [DBG] pgmap v5681: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:46:31.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:46:30 smithi157 bash[24585]: cluster 2024-09-16T08:46:29.752700+0000 mgr.a (mgr.14373) 8192 : cluster [DBG] pgmap v5681: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:46:33.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:46:32 smithi047 bash[22744]: cluster 2024-09-16T08:46:31.754868+0000 mgr.a (mgr.14373) 8193 : cluster [DBG] pgmap v5682: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:46:33.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:46:32 smithi157 bash[24585]: cluster 2024-09-16T08:46:31.754868+0000 mgr.a (mgr.14373) 8193 : cluster [DBG] pgmap v5682: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:46:33.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:46:32 smithi086 bash[24289]: cluster 2024-09-16T08:46:31.754868+0000 mgr.a (mgr.14373) 8193 : cluster [DBG] pgmap v5682: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:46:33.434 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:46:33.435 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:46:33.435 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:46:34.208 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:46:34.209 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:46:34.209 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:46:34.209 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:46:34.209 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:46:35.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:46:34 smithi047 bash[22744]: cluster 2024-09-16T08:46:33.755579+0000 mgr.a (mgr.14373) 8194 : cluster [DBG] pgmap v5683: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:46:35.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:46:34 smithi047 bash[22744]: audit 2024-09-16T08:46:33.775970+0000 mgr.a (mgr.14373) 8195 : audit [DBG] from='client.183600 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:46:35.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:46:34 smithi157 bash[24585]: cluster 2024-09-16T08:46:33.755579+0000 mgr.a (mgr.14373) 8194 : cluster [DBG] pgmap v5683: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:46:35.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:46:34 smithi157 bash[24585]: audit 2024-09-16T08:46:33.775970+0000 mgr.a (mgr.14373) 8195 : audit [DBG] from='client.183600 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:46:35.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:46:34 smithi086 bash[24289]: cluster 2024-09-16T08:46:33.755579+0000 mgr.a (mgr.14373) 8194 : cluster [DBG] pgmap v5683: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:46:35.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:46:34 smithi086 bash[24289]: audit 2024-09-16T08:46:33.775970+0000 mgr.a (mgr.14373) 8195 : audit [DBG] from='client.183600 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:46:37.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:46:36 smithi047 bash[22744]: cluster 2024-09-16T08:46:35.756457+0000 mgr.a (mgr.14373) 8196 : cluster [DBG] pgmap v5684: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:46:37.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:46:36 smithi157 bash[24585]: cluster 2024-09-16T08:46:35.756457+0000 mgr.a (mgr.14373) 8196 : cluster [DBG] pgmap v5684: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:46:37.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:46:36 smithi086 bash[24289]: cluster 2024-09-16T08:46:35.756457+0000 mgr.a (mgr.14373) 8196 : cluster [DBG] pgmap v5684: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:46:39.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:46:38 smithi047 bash[22744]: cluster 2024-09-16T08:46:37.758691+0000 mgr.a (mgr.14373) 8197 : cluster [DBG] pgmap v5685: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:46:39.210 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:46:39.211 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:46:39.211 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:46:39.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:46:38 smithi157 bash[24585]: cluster 2024-09-16T08:46:37.758691+0000 mgr.a (mgr.14373) 8197 : cluster [DBG] pgmap v5685: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:46:39.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:46:38 smithi086 bash[24289]: cluster 2024-09-16T08:46:37.758691+0000 mgr.a (mgr.14373) 8197 : cluster [DBG] pgmap v5685: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:46:39.945 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:46:39.945 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:46:39.945 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:46:39.946 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:46:39.946 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:46:41.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:46:40 smithi047 bash[22744]: audit 2024-09-16T08:46:39.543857+0000 mgr.a (mgr.14373) 8198 : audit [DBG] from='client.183672 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:46:41.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:46:40 smithi047 bash[22744]: cluster 2024-09-16T08:46:39.759473+0000 mgr.a (mgr.14373) 8199 : cluster [DBG] pgmap v5686: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:46:41.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:46:40 smithi157 bash[24585]: audit 2024-09-16T08:46:39.543857+0000 mgr.a (mgr.14373) 8198 : audit [DBG] from='client.183672 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:46:41.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:46:40 smithi157 bash[24585]: cluster 2024-09-16T08:46:39.759473+0000 mgr.a (mgr.14373) 8199 : cluster [DBG] pgmap v5686: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:46:41.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:46:40 smithi086 bash[24289]: audit 2024-09-16T08:46:39.543857+0000 mgr.a (mgr.14373) 8198 : audit [DBG] from='client.183672 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:46:41.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:46:40 smithi086 bash[24289]: cluster 2024-09-16T08:46:39.759473+0000 mgr.a (mgr.14373) 8199 : cluster [DBG] pgmap v5686: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:46:43.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:46:42 smithi157 bash[24585]: cluster 2024-09-16T08:46:41.761849+0000 mgr.a (mgr.14373) 8200 : cluster [DBG] pgmap v5687: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:46:43.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:46:42 smithi086 bash[24289]: cluster 2024-09-16T08:46:41.761849+0000 mgr.a (mgr.14373) 8200 : cluster [DBG] pgmap v5687: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:46:43.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:46:42 smithi047 bash[22744]: cluster 2024-09-16T08:46:41.761849+0000 mgr.a (mgr.14373) 8200 : cluster [DBG] pgmap v5687: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:46:44.946 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:46:44.947 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:46:44.947 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:46:45.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:46:44 smithi157 bash[24585]: cluster 2024-09-16T08:46:43.762804+0000 mgr.a (mgr.14373) 8201 : cluster [DBG] pgmap v5688: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:46:45.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:46:44 smithi086 bash[24289]: cluster 2024-09-16T08:46:43.762804+0000 mgr.a (mgr.14373) 8201 : cluster [DBG] pgmap v5688: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:46:45.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:46:44 smithi047 bash[22744]: cluster 2024-09-16T08:46:43.762804+0000 mgr.a (mgr.14373) 8201 : cluster [DBG] pgmap v5688: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:46:45.730 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:46:45.730 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:46:45.730 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:46:45.730 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:46:45.731 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:46:46.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:46:45 smithi157 bash[24585]: audit 2024-09-16T08:46:45.599291+0000 mon.b (mon.2) 770 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T08:46:46.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:46:45 smithi086 bash[24289]: audit 2024-09-16T08:46:45.599291+0000 mon.b (mon.2) 770 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T08:46:46.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:46:45 smithi047 bash[22744]: audit 2024-09-16T08:46:45.599291+0000 mon.b (mon.2) 770 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T08:46:47.135 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:46:46 smithi047 bash[22744]: audit 2024-09-16T08:46:45.285716+0000 mgr.a (mgr.14373) 8202 : audit [DBG] from='client.183747 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:46:47.136 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:46:46 smithi047 bash[22744]: cluster 2024-09-16T08:46:45.763321+0000 mgr.a (mgr.14373) 8203 : cluster [DBG] pgmap v5689: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:46:47.136 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:46:46 smithi047 bash[22744]: audit 2024-09-16T08:46:46.393069+0000 mon.b (mon.2) 771 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T08:46:47.136 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:46:46 smithi047 bash[22744]: audit 2024-09-16T08:46:46.395031+0000 mon.b (mon.2) 772 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T08:46:47.136 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:46:46 smithi047 bash[22744]: audit 2024-09-16T08:46:46.406863+0000 mon.a (mon.0) 1059 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:46:47.136 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:46:46 smithi047 bash[22744]: audit 2024-09-16T08:46:46.408261+0000 mon.b (mon.2) 773 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:46:47.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:46:46 smithi157 bash[24585]: audit 2024-09-16T08:46:45.285716+0000 mgr.a (mgr.14373) 8202 : audit [DBG] from='client.183747 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:46:47.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:46:46 smithi157 bash[24585]: cluster 2024-09-16T08:46:45.763321+0000 mgr.a (mgr.14373) 8203 : cluster [DBG] pgmap v5689: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:46:47.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:46:46 smithi157 bash[24585]: audit 2024-09-16T08:46:46.393069+0000 mon.b (mon.2) 771 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T08:46:47.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:46:46 smithi157 bash[24585]: audit 2024-09-16T08:46:46.395031+0000 mon.b (mon.2) 772 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T08:46:47.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:46:46 smithi157 bash[24585]: audit 2024-09-16T08:46:46.406863+0000 mon.a (mon.0) 1059 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:46:47.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:46:46 smithi157 bash[24585]: audit 2024-09-16T08:46:46.408261+0000 mon.b (mon.2) 773 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:46:47.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:46:46 smithi086 bash[24289]: audit 2024-09-16T08:46:45.285716+0000 mgr.a (mgr.14373) 8202 : audit [DBG] from='client.183747 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:46:47.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:46:46 smithi086 bash[24289]: cluster 2024-09-16T08:46:45.763321+0000 mgr.a (mgr.14373) 8203 : cluster [DBG] pgmap v5689: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:46:47.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:46:46 smithi086 bash[24289]: audit 2024-09-16T08:46:46.393069+0000 mon.b (mon.2) 771 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T08:46:47.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:46:46 smithi086 bash[24289]: audit 2024-09-16T08:46:46.395031+0000 mon.b (mon.2) 772 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T08:46:47.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:46:46 smithi086 bash[24289]: audit 2024-09-16T08:46:46.406863+0000 mon.a (mon.0) 1059 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:46:47.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:46:46 smithi086 bash[24289]: audit 2024-09-16T08:46:46.408261+0000 mon.b (mon.2) 773 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:46:47.588 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 08:46:47 smithi047 bash[22994]: debug 2024-09-16T08:46:47.134+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T08:46:47.588 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 08:46:47 smithi047 bash[22994]: debug 2024-09-16T08:46:47.134+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T08:46:48.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:46:47 smithi157 bash[24585]: audit 2024-09-16T08:46:46.413010+0000 mgr.a (mgr.14373) 8204 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:46:48.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:46:47 smithi086 bash[24289]: audit 2024-09-16T08:46:46.413010+0000 mgr.a (mgr.14373) 8204 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:46:48.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:46:47 smithi047 bash[22744]: audit 2024-09-16T08:46:46.413010+0000 mgr.a (mgr.14373) 8204 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:46:49.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:46:48 smithi157 bash[24585]: audit 2024-09-16T08:46:47.138916+0000 mgr.a (mgr.14373) 8205 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T08:46:49.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:46:48 smithi157 bash[24585]: cephadm 2024-09-16T08:46:47.141016+0000 mgr.a (mgr.14373) 8206 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T08:46:49.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:46:48 smithi157 bash[24585]: cluster 2024-09-16T08:46:47.766037+0000 mgr.a (mgr.14373) 8207 : cluster [DBG] pgmap v5690: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:46:49.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:46:48 smithi086 bash[24289]: audit 2024-09-16T08:46:47.138916+0000 mgr.a (mgr.14373) 8205 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T08:46:49.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:46:48 smithi086 bash[24289]: cephadm 2024-09-16T08:46:47.141016+0000 mgr.a (mgr.14373) 8206 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T08:46:49.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:46:48 smithi086 bash[24289]: cluster 2024-09-16T08:46:47.766037+0000 mgr.a (mgr.14373) 8207 : cluster [DBG] pgmap v5690: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:46:49.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:46:48 smithi047 bash[22744]: audit 2024-09-16T08:46:47.138916+0000 mgr.a (mgr.14373) 8205 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T08:46:49.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:46:48 smithi047 bash[22744]: cephadm 2024-09-16T08:46:47.141016+0000 mgr.a (mgr.14373) 8206 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T08:46:49.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:46:48 smithi047 bash[22744]: cluster 2024-09-16T08:46:47.766037+0000 mgr.a (mgr.14373) 8207 : cluster [DBG] pgmap v5690: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:46:50.731 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:46:50.732 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:46:50.733 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:46:51.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:46:50 smithi157 bash[24585]: cluster 2024-09-16T08:46:49.766992+0000 mgr.a (mgr.14373) 8208 : cluster [DBG] pgmap v5691: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:46:51.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:46:50 smithi086 bash[24289]: cluster 2024-09-16T08:46:49.766992+0000 mgr.a (mgr.14373) 8208 : cluster [DBG] pgmap v5691: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:46:51.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:46:50 smithi047 bash[22744]: cluster 2024-09-16T08:46:49.766992+0000 mgr.a (mgr.14373) 8208 : cluster [DBG] pgmap v5691: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:46:51.498 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:46:51.499 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:46:51.499 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:46:51.499 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:46:51.499 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:46:53.308 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:46:52 smithi157 bash[24585]: audit 2024-09-16T08:46:51.072182+0000 mgr.a (mgr.14373) 8209 : audit [DBG] from='client.183933 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:46:53.308 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:46:52 smithi157 bash[24585]: cluster 2024-09-16T08:46:51.769268+0000 mgr.a (mgr.14373) 8210 : cluster [DBG] pgmap v5692: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.8 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:46:53.327 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:46:52 smithi086 bash[24289]: audit 2024-09-16T08:46:51.072182+0000 mgr.a (mgr.14373) 8209 : audit [DBG] from='client.183933 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:46:53.327 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:46:52 smithi086 bash[24289]: cluster 2024-09-16T08:46:51.769268+0000 mgr.a (mgr.14373) 8210 : cluster [DBG] pgmap v5692: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.8 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:46:53.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:46:52 smithi047 bash[22744]: audit 2024-09-16T08:46:51.072182+0000 mgr.a (mgr.14373) 8209 : audit [DBG] from='client.183933 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:46:53.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:46:52 smithi047 bash[22744]: cluster 2024-09-16T08:46:51.769268+0000 mgr.a (mgr.14373) 8210 : cluster [DBG] pgmap v5692: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.8 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:46:55.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:46:54 smithi157 bash[24585]: cluster 2024-09-16T08:46:53.770029+0000 mgr.a (mgr.14373) 8211 : cluster [DBG] pgmap v5693: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 6.9 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T08:46:55.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:46:54 smithi086 bash[24289]: cluster 2024-09-16T08:46:53.770029+0000 mgr.a (mgr.14373) 8211 : cluster [DBG] pgmap v5693: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 6.9 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T08:46:55.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:46:54 smithi047 bash[22744]: cluster 2024-09-16T08:46:53.770029+0000 mgr.a (mgr.14373) 8211 : cluster [DBG] pgmap v5693: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 6.9 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T08:46:56.500 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:46:56.501 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:46:56.501 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:46:57.257 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:46:57.257 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:46:57.257 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:46:57.258 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:46:57.258 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:46:57.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:46:56 smithi157 bash[24585]: cluster 2024-09-16T08:46:55.770827+0000 mgr.a (mgr.14373) 8212 : cluster [DBG] pgmap v5694: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 6.9 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T08:46:57.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:46:56 smithi086 bash[24289]: cluster 2024-09-16T08:46:55.770827+0000 mgr.a (mgr.14373) 8212 : cluster [DBG] pgmap v5694: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 6.9 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T08:46:57.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:46:56 smithi047 bash[22744]: cluster 2024-09-16T08:46:55.770827+0000 mgr.a (mgr.14373) 8212 : cluster [DBG] pgmap v5694: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 6.9 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T08:46:58.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:46:57 smithi157 bash[24585]: audit 2024-09-16T08:46:56.832430+0000 mgr.a (mgr.14373) 8213 : audit [DBG] from='client.184005 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:46:58.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:46:57 smithi086 bash[24289]: audit 2024-09-16T08:46:56.832430+0000 mgr.a (mgr.14373) 8213 : audit [DBG] from='client.184005 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:46:58.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:46:57 smithi047 bash[22744]: audit 2024-09-16T08:46:56.832430+0000 mgr.a (mgr.14373) 8213 : audit [DBG] from='client.184005 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:46:59.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:46:58 smithi157 bash[24585]: cluster 2024-09-16T08:46:57.773398+0000 mgr.a (mgr.14373) 8214 : cluster [DBG] pgmap v5695: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:46:59.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:46:58 smithi086 bash[24289]: cluster 2024-09-16T08:46:57.773398+0000 mgr.a (mgr.14373) 8214 : cluster [DBG] pgmap v5695: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:46:59.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:46:58 smithi047 bash[22744]: cluster 2024-09-16T08:46:57.773398+0000 mgr.a (mgr.14373) 8214 : cluster [DBG] pgmap v5695: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:47:01.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:47:00 smithi157 bash[24585]: cluster 2024-09-16T08:46:59.774182+0000 mgr.a (mgr.14373) 8215 : cluster [DBG] pgmap v5696: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T08:47:01.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:47:00 smithi086 bash[24289]: cluster 2024-09-16T08:46:59.774182+0000 mgr.a (mgr.14373) 8215 : cluster [DBG] pgmap v5696: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T08:47:01.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:47:00 smithi047 bash[22744]: cluster 2024-09-16T08:46:59.774182+0000 mgr.a (mgr.14373) 8215 : cluster [DBG] pgmap v5696: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T08:47:02.258 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:47:02.259 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:47:02.259 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:47:02.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:47:01 smithi157 bash[24585]: cluster 2024-09-16T08:47:01.776131+0000 mgr.a (mgr.14373) 8216 : cluster [DBG] pgmap v5697: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:47:02.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:47:01 smithi086 bash[24289]: cluster 2024-09-16T08:47:01.776131+0000 mgr.a (mgr.14373) 8216 : cluster [DBG] pgmap v5697: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:47:02.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:47:01 smithi047 bash[22744]: cluster 2024-09-16T08:47:01.776131+0000 mgr.a (mgr.14373) 8216 : cluster [DBG] pgmap v5697: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:47:03.017 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:47:03.017 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:47:03.017 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:47:03.017 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:47:03.017 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:47:03.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:47:02 smithi157 bash[24585]: audit 2024-09-16T08:47:02.596865+0000 mgr.a (mgr.14373) 8217 : audit [DBG] from='client.184083 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:47:03.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:47:02 smithi086 bash[24289]: audit 2024-09-16T08:47:02.596865+0000 mgr.a (mgr.14373) 8217 : audit [DBG] from='client.184083 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:47:03.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:47:02 smithi047 bash[22744]: audit 2024-09-16T08:47:02.596865+0000 mgr.a (mgr.14373) 8217 : audit [DBG] from='client.184083 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:47:04.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:47:03 smithi157 bash[24585]: cluster 2024-09-16T08:47:03.777033+0000 mgr.a (mgr.14373) 8218 : cluster [DBG] pgmap v5698: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-16T08:47:04.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:47:03 smithi086 bash[24289]: cluster 2024-09-16T08:47:03.777033+0000 mgr.a (mgr.14373) 8218 : cluster [DBG] pgmap v5698: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-16T08:47:04.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:47:03 smithi047 bash[22744]: cluster 2024-09-16T08:47:03.777033+0000 mgr.a (mgr.14373) 8218 : cluster [DBG] pgmap v5698: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-16T08:47:07.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:47:06 smithi047 bash[22744]: cluster 2024-09-16T08:47:05.777810+0000 mgr.a (mgr.14373) 8219 : cluster [DBG] pgmap v5699: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-16T08:47:07.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:47:06 smithi157 bash[24585]: cluster 2024-09-16T08:47:05.777810+0000 mgr.a (mgr.14373) 8219 : cluster [DBG] pgmap v5699: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-16T08:47:07.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:47:06 smithi086 bash[24289]: cluster 2024-09-16T08:47:05.777810+0000 mgr.a (mgr.14373) 8219 : cluster [DBG] pgmap v5699: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-16T08:47:08.017 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:47:08.017 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:47:08.017 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:47:08.774 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:47:08.774 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:47:08.774 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:47:08.774 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:47:08.774 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:47:09.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:47:08 smithi047 bash[22744]: cluster 2024-09-16T08:47:07.780064+0000 mgr.a (mgr.14373) 8220 : cluster [DBG] pgmap v5700: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-16T08:47:09.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:47:08 smithi157 bash[24585]: cluster 2024-09-16T08:47:07.780064+0000 mgr.a (mgr.14373) 8220 : cluster [DBG] pgmap v5700: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-16T08:47:09.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:47:08 smithi086 bash[24289]: cluster 2024-09-16T08:47:07.780064+0000 mgr.a (mgr.14373) 8220 : cluster [DBG] pgmap v5700: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-16T08:47:10.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:47:09 smithi157 bash[24585]: audit 2024-09-16T08:47:08.350480+0000 mgr.a (mgr.14373) 8221 : audit [DBG] from='client.184158 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:47:10.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:47:09 smithi086 bash[24289]: audit 2024-09-16T08:47:08.350480+0000 mgr.a (mgr.14373) 8221 : audit [DBG] from='client.184158 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:47:10.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:47:09 smithi047 bash[22744]: audit 2024-09-16T08:47:08.350480+0000 mgr.a (mgr.14373) 8221 : audit [DBG] from='client.184158 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:47:11.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:47:10 smithi157 bash[24585]: cluster 2024-09-16T08:47:09.780938+0000 mgr.a (mgr.14373) 8222 : cluster [DBG] pgmap v5701: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:47:11.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:47:10 smithi086 bash[24289]: cluster 2024-09-16T08:47:09.780938+0000 mgr.a (mgr.14373) 8222 : cluster [DBG] pgmap v5701: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:47:11.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:47:10 smithi047 bash[22744]: cluster 2024-09-16T08:47:09.780938+0000 mgr.a (mgr.14373) 8222 : cluster [DBG] pgmap v5701: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:47:13.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:47:12 smithi157 bash[24585]: cluster 2024-09-16T08:47:11.783145+0000 mgr.a (mgr.14373) 8223 : cluster [DBG] pgmap v5702: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:47:13.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:47:12 smithi086 bash[24289]: cluster 2024-09-16T08:47:11.783145+0000 mgr.a (mgr.14373) 8223 : cluster [DBG] pgmap v5702: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:47:13.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:47:12 smithi047 bash[22744]: cluster 2024-09-16T08:47:11.783145+0000 mgr.a (mgr.14373) 8223 : cluster [DBG] pgmap v5702: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:47:13.774 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:47:13.775 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:47:13.775 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:47:14.556 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:47:14.557 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:47:14.557 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:47:14.557 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:47:14.557 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:47:15.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:47:14 smithi157 bash[24585]: cluster 2024-09-16T08:47:13.783740+0000 mgr.a (mgr.14373) 8224 : cluster [DBG] pgmap v5703: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:47:15.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:47:14 smithi086 bash[24289]: cluster 2024-09-16T08:47:13.783740+0000 mgr.a (mgr.14373) 8224 : cluster [DBG] pgmap v5703: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:47:15.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:47:14 smithi047 bash[22744]: cluster 2024-09-16T08:47:13.783740+0000 mgr.a (mgr.14373) 8224 : cluster [DBG] pgmap v5703: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:47:16.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:47:15 smithi157 bash[24585]: audit 2024-09-16T08:47:14.115798+0000 mgr.a (mgr.14373) 8225 : audit [DBG] from='client.184233 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:47:16.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:47:15 smithi086 bash[24289]: audit 2024-09-16T08:47:14.115798+0000 mgr.a (mgr.14373) 8225 : audit [DBG] from='client.184233 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:47:16.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:47:15 smithi047 bash[22744]: audit 2024-09-16T08:47:14.115798+0000 mgr.a (mgr.14373) 8225 : audit [DBG] from='client.184233 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:47:17.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:47:16 smithi157 bash[24585]: cluster 2024-09-16T08:47:15.784657+0000 mgr.a (mgr.14373) 8226 : cluster [DBG] pgmap v5704: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:47:17.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:47:16 smithi086 bash[24289]: cluster 2024-09-16T08:47:15.784657+0000 mgr.a (mgr.14373) 8226 : cluster [DBG] pgmap v5704: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:47:17.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:47:16 smithi047 bash[22744]: cluster 2024-09-16T08:47:15.784657+0000 mgr.a (mgr.14373) 8226 : cluster [DBG] pgmap v5704: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:47:19.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:47:18 smithi157 bash[24585]: cluster 2024-09-16T08:47:17.786925+0000 mgr.a (mgr.14373) 8227 : cluster [DBG] pgmap v5705: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:47:19.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:47:18 smithi086 bash[24289]: cluster 2024-09-16T08:47:17.786925+0000 mgr.a (mgr.14373) 8227 : cluster [DBG] pgmap v5705: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:47:19.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:47:18 smithi047 bash[22744]: cluster 2024-09-16T08:47:17.786925+0000 mgr.a (mgr.14373) 8227 : cluster [DBG] pgmap v5705: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:47:19.557 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:47:19.558 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:47:19.558 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:47:20.309 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:47:20.309 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:47:20.309 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:47:20.309 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:47:20.309 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:47:21.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:47:20 smithi157 bash[24585]: cluster 2024-09-16T08:47:19.787450+0000 mgr.a (mgr.14373) 8228 : cluster [DBG] pgmap v5706: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:47:21.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:47:20 smithi086 bash[24289]: cluster 2024-09-16T08:47:19.787450+0000 mgr.a (mgr.14373) 8228 : cluster [DBG] pgmap v5706: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:47:21.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:47:20 smithi047 bash[22744]: cluster 2024-09-16T08:47:19.787450+0000 mgr.a (mgr.14373) 8228 : cluster [DBG] pgmap v5706: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:47:22.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:47:21 smithi157 bash[24585]: audit 2024-09-16T08:47:19.894993+0000 mgr.a (mgr.14373) 8229 : audit [DBG] from='client.184311 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:47:22.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:47:21 smithi086 bash[24289]: audit 2024-09-16T08:47:19.894993+0000 mgr.a (mgr.14373) 8229 : audit [DBG] from='client.184311 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:47:22.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:47:21 smithi047 bash[22744]: audit 2024-09-16T08:47:19.894993+0000 mgr.a (mgr.14373) 8229 : audit [DBG] from='client.184311 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:47:23.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:47:22 smithi157 bash[24585]: cluster 2024-09-16T08:47:21.789884+0000 mgr.a (mgr.14373) 8230 : cluster [DBG] pgmap v5707: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:47:23.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:47:22 smithi086 bash[24289]: cluster 2024-09-16T08:47:21.789884+0000 mgr.a (mgr.14373) 8230 : cluster [DBG] pgmap v5707: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:47:23.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:47:22 smithi047 bash[22744]: cluster 2024-09-16T08:47:21.789884+0000 mgr.a (mgr.14373) 8230 : cluster [DBG] pgmap v5707: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:47:25.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:47:24 smithi157 bash[24585]: cluster 2024-09-16T08:47:23.790831+0000 mgr.a (mgr.14373) 8231 : cluster [DBG] pgmap v5708: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:47:25.310 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:47:25.311 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:47:25.311 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:47:25.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:47:24 smithi086 bash[24289]: cluster 2024-09-16T08:47:23.790831+0000 mgr.a (mgr.14373) 8231 : cluster [DBG] pgmap v5708: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:47:25.340 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:47:24 smithi047 bash[22744]: cluster 2024-09-16T08:47:23.790831+0000 mgr.a (mgr.14373) 8231 : cluster [DBG] pgmap v5708: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:47:26.090 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:47:26.090 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:47:26.090 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:47:26.090 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:47:26.090 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:47:27.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:47:26 smithi157 bash[24585]: audit 2024-09-16T08:47:25.651360+0000 mgr.a (mgr.14373) 8232 : audit [DBG] from='client.184386 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:47:27.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:47:26 smithi157 bash[24585]: cluster 2024-09-16T08:47:25.791637+0000 mgr.a (mgr.14373) 8233 : cluster [DBG] pgmap v5709: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:47:27.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:47:26 smithi086 bash[24289]: audit 2024-09-16T08:47:25.651360+0000 mgr.a (mgr.14373) 8232 : audit [DBG] from='client.184386 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:47:27.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:47:26 smithi086 bash[24289]: cluster 2024-09-16T08:47:25.791637+0000 mgr.a (mgr.14373) 8233 : cluster [DBG] pgmap v5709: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:47:27.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:47:26 smithi047 bash[22744]: audit 2024-09-16T08:47:25.651360+0000 mgr.a (mgr.14373) 8232 : audit [DBG] from='client.184386 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:47:27.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:47:26 smithi047 bash[22744]: cluster 2024-09-16T08:47:25.791637+0000 mgr.a (mgr.14373) 8233 : cluster [DBG] pgmap v5709: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:47:29.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:47:28 smithi157 bash[24585]: cluster 2024-09-16T08:47:27.794057+0000 mgr.a (mgr.14373) 8234 : cluster [DBG] pgmap v5710: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:47:29.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:47:28 smithi086 bash[24289]: cluster 2024-09-16T08:47:27.794057+0000 mgr.a (mgr.14373) 8234 : cluster [DBG] pgmap v5710: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:47:29.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:47:28 smithi047 bash[22744]: cluster 2024-09-16T08:47:27.794057+0000 mgr.a (mgr.14373) 8234 : cluster [DBG] pgmap v5710: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:47:30.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:47:29 smithi157 bash[24585]: cluster 2024-09-16T08:47:29.794869+0000 mgr.a (mgr.14373) 8235 : cluster [DBG] pgmap v5711: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:47:30.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:47:29 smithi086 bash[24289]: cluster 2024-09-16T08:47:29.794869+0000 mgr.a (mgr.14373) 8235 : cluster [DBG] pgmap v5711: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:47:30.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:47:29 smithi047 bash[22744]: cluster 2024-09-16T08:47:29.794869+0000 mgr.a (mgr.14373) 8235 : cluster [DBG] pgmap v5711: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:47:31.091 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:47:31.092 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:47:31.092 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:47:31.860 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:47:31.861 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:47:31.861 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:47:31.861 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:47:31.861 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:47:33.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:47:32 smithi157 bash[24585]: audit 2024-09-16T08:47:31.429809+0000 mgr.a (mgr.14373) 8236 : audit [DBG] from='client.184464 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:47:33.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:47:32 smithi157 bash[24585]: cluster 2024-09-16T08:47:31.797317+0000 mgr.a (mgr.14373) 8237 : cluster [DBG] pgmap v5712: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:47:33.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:47:32 smithi086 bash[24289]: audit 2024-09-16T08:47:31.429809+0000 mgr.a (mgr.14373) 8236 : audit [DBG] from='client.184464 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:47:33.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:47:32 smithi086 bash[24289]: cluster 2024-09-16T08:47:31.797317+0000 mgr.a (mgr.14373) 8237 : cluster [DBG] pgmap v5712: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:47:33.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:47:32 smithi047 bash[22744]: audit 2024-09-16T08:47:31.429809+0000 mgr.a (mgr.14373) 8236 : audit [DBG] from='client.184464 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:47:33.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:47:32 smithi047 bash[22744]: cluster 2024-09-16T08:47:31.797317+0000 mgr.a (mgr.14373) 8237 : cluster [DBG] pgmap v5712: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:47:35.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:47:34 smithi157 bash[24585]: cluster 2024-09-16T08:47:33.798148+0000 mgr.a (mgr.14373) 8238 : cluster [DBG] pgmap v5713: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:47:35.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:47:34 smithi086 bash[24289]: cluster 2024-09-16T08:47:33.798148+0000 mgr.a (mgr.14373) 8238 : cluster [DBG] pgmap v5713: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:47:35.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:47:34 smithi047 bash[22744]: cluster 2024-09-16T08:47:33.798148+0000 mgr.a (mgr.14373) 8238 : cluster [DBG] pgmap v5713: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:47:36.862 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:47:36.863 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:47:36.863 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:47:37.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:47:36 smithi157 bash[24585]: cluster 2024-09-16T08:47:35.798922+0000 mgr.a (mgr.14373) 8239 : cluster [DBG] pgmap v5714: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T08:47:37.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:47:36 smithi086 bash[24289]: cluster 2024-09-16T08:47:35.798922+0000 mgr.a (mgr.14373) 8239 : cluster [DBG] pgmap v5714: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T08:47:37.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:47:36 smithi047 bash[22744]: cluster 2024-09-16T08:47:35.798922+0000 mgr.a (mgr.14373) 8239 : cluster [DBG] pgmap v5714: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T08:47:37.617 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:47:37.618 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:47:37.618 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:47:37.618 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:47:37.618 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:47:39.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:47:38 smithi157 bash[24585]: audit 2024-09-16T08:47:37.197754+0000 mgr.a (mgr.14373) 8240 : audit [DBG] from='client.184539 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:47:39.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:47:38 smithi157 bash[24585]: cluster 2024-09-16T08:47:37.801622+0000 mgr.a (mgr.14373) 8241 : cluster [DBG] pgmap v5715: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:47:39.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:47:38 smithi086 bash[24289]: audit 2024-09-16T08:47:37.197754+0000 mgr.a (mgr.14373) 8240 : audit [DBG] from='client.184539 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:47:39.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:47:38 smithi086 bash[24289]: cluster 2024-09-16T08:47:37.801622+0000 mgr.a (mgr.14373) 8241 : cluster [DBG] pgmap v5715: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:47:39.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:47:38 smithi047 bash[22744]: audit 2024-09-16T08:47:37.197754+0000 mgr.a (mgr.14373) 8240 : audit [DBG] from='client.184539 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:47:39.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:47:38 smithi047 bash[22744]: cluster 2024-09-16T08:47:37.801622+0000 mgr.a (mgr.14373) 8241 : cluster [DBG] pgmap v5715: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:47:41.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:47:40 smithi157 bash[24585]: cluster 2024-09-16T08:47:39.802426+0000 mgr.a (mgr.14373) 8242 : cluster [DBG] pgmap v5716: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:47:41.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:47:40 smithi086 bash[24289]: cluster 2024-09-16T08:47:39.802426+0000 mgr.a (mgr.14373) 8242 : cluster [DBG] pgmap v5716: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:47:41.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:47:40 smithi047 bash[22744]: cluster 2024-09-16T08:47:39.802426+0000 mgr.a (mgr.14373) 8242 : cluster [DBG] pgmap v5716: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:47:42.619 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:47:42.620 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:47:42.620 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:47:43.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:47:42 smithi157 bash[24585]: cluster 2024-09-16T08:47:41.804377+0000 mgr.a (mgr.14373) 8243 : cluster [DBG] pgmap v5717: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:47:43.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:47:42 smithi086 bash[24289]: cluster 2024-09-16T08:47:41.804377+0000 mgr.a (mgr.14373) 8243 : cluster [DBG] pgmap v5717: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:47:43.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:47:42 smithi047 bash[22744]: cluster 2024-09-16T08:47:41.804377+0000 mgr.a (mgr.14373) 8243 : cluster [DBG] pgmap v5717: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:47:43.393 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:47:43.393 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:47:43.393 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:47:43.393 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:47:43.393 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:47:45.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:47:44 smithi157 bash[24585]: audit 2024-09-16T08:47:42.957640+0000 mgr.a (mgr.14373) 8244 : audit [DBG] from='client.184617 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:47:45.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:47:44 smithi157 bash[24585]: cluster 2024-09-16T08:47:43.805354+0000 mgr.a (mgr.14373) 8245 : cluster [DBG] pgmap v5718: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:47:45.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:47:44 smithi086 bash[24289]: audit 2024-09-16T08:47:42.957640+0000 mgr.a (mgr.14373) 8244 : audit [DBG] from='client.184617 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:47:45.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:47:44 smithi086 bash[24289]: cluster 2024-09-16T08:47:43.805354+0000 mgr.a (mgr.14373) 8245 : cluster [DBG] pgmap v5718: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:47:45.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:47:44 smithi047 bash[22744]: audit 2024-09-16T08:47:42.957640+0000 mgr.a (mgr.14373) 8244 : audit [DBG] from='client.184617 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:47:45.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:47:44 smithi047 bash[22744]: cluster 2024-09-16T08:47:43.805354+0000 mgr.a (mgr.14373) 8245 : cluster [DBG] pgmap v5718: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:47:47.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:47:46 smithi157 bash[24585]: cluster 2024-09-16T08:47:45.806148+0000 mgr.a (mgr.14373) 8246 : cluster [DBG] pgmap v5719: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:47:47.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:47:46 smithi086 bash[24289]: cluster 2024-09-16T08:47:45.806148+0000 mgr.a (mgr.14373) 8246 : cluster [DBG] pgmap v5719: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:47:47.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:47:46 smithi047 bash[22744]: cluster 2024-09-16T08:47:45.806148+0000 mgr.a (mgr.14373) 8246 : cluster [DBG] pgmap v5719: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:47:48.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:47:47 smithi157 bash[24585]: audit 2024-09-16T08:47:47.192462+0000 mon.b (mon.2) 774 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T08:47:48.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:47:47 smithi086 bash[24289]: audit 2024-09-16T08:47:47.192462+0000 mon.b (mon.2) 774 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T08:47:48.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:47:47 smithi047 bash[22744]: audit 2024-09-16T08:47:47.192462+0000 mon.b (mon.2) 774 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T08:47:48.394 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:47:48.395 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:47:48.396 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:47:49.162 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:47:49.163 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:47:49.163 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:47:49.163 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:47:49.163 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:47:49.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:47:48 smithi157 bash[24585]: cluster 2024-09-16T08:47:47.807229+0000 mgr.a (mgr.14373) 8247 : cluster [DBG] pgmap v5720: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:47:49.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:47:48 smithi086 bash[24289]: cluster 2024-09-16T08:47:47.807229+0000 mgr.a (mgr.14373) 8247 : cluster [DBG] pgmap v5720: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:47:49.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:47:48 smithi047 bash[22744]: cluster 2024-09-16T08:47:47.807229+0000 mgr.a (mgr.14373) 8247 : cluster [DBG] pgmap v5720: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:47:50.305 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:47:49 smithi157 bash[24585]: audit 2024-09-16T08:47:48.738949+0000 mgr.a (mgr.14373) 8248 : audit [DBG] from='client.184692 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:47:50.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:47:49 smithi086 bash[24289]: audit 2024-09-16T08:47:48.738949+0000 mgr.a (mgr.14373) 8248 : audit [DBG] from='client.184692 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:47:50.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:47:49 smithi047 bash[22744]: audit 2024-09-16T08:47:48.738949+0000 mgr.a (mgr.14373) 8248 : audit [DBG] from='client.184692 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:47:51.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:47:50 smithi157 bash[24585]: cluster 2024-09-16T08:47:49.808058+0000 mgr.a (mgr.14373) 8249 : cluster [DBG] pgmap v5721: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:47:51.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:47:50 smithi086 bash[24289]: cluster 2024-09-16T08:47:49.808058+0000 mgr.a (mgr.14373) 8249 : cluster [DBG] pgmap v5721: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:47:51.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:47:50 smithi047 bash[22744]: cluster 2024-09-16T08:47:49.808058+0000 mgr.a (mgr.14373) 8249 : cluster [DBG] pgmap v5721: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:47:52.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:47:51 smithi157 bash[24585]: cluster 2024-09-16T08:47:51.810261+0000 mgr.a (mgr.14373) 8250 : cluster [DBG] pgmap v5722: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:47:52.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:47:51 smithi086 bash[24289]: cluster 2024-09-16T08:47:51.810261+0000 mgr.a (mgr.14373) 8250 : cluster [DBG] pgmap v5722: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:47:52.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:47:51 smithi047 bash[22744]: cluster 2024-09-16T08:47:51.810261+0000 mgr.a (mgr.14373) 8250 : cluster [DBG] pgmap v5722: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:47:53.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:47:53 smithi157 bash[24585]: audit 2024-09-16T08:47:52.533794+0000 mon.a (mon.0) 1060 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:47:53.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:47:53 smithi157 bash[24585]: audit 2024-09-16T08:47:52.539492+0000 mon.a (mon.0) 1061 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:47:53.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:47:53 smithi157 bash[24585]: audit 2024-09-16T08:47:52.556699+0000 mon.a (mon.0) 1062 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:47:53.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:47:53 smithi157 bash[24585]: audit 2024-09-16T08:47:52.559505+0000 mon.a (mon.0) 1063 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:47:53.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:47:53 smithi157 bash[24585]: audit 2024-09-16T08:47:52.564043+0000 mon.a (mon.0) 1064 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:47:53.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:47:53 smithi157 bash[24585]: audit 2024-09-16T08:47:52.568712+0000 mon.a (mon.0) 1065 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:47:53.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:47:53 smithi157 bash[24585]: audit 2024-09-16T08:47:53.290628+0000 mon.b (mon.2) 775 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T08:47:53.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:47:53 smithi157 bash[24585]: audit 2024-09-16T08:47:53.292758+0000 mon.b (mon.2) 776 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T08:47:53.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:47:53 smithi157 bash[24585]: audit 2024-09-16T08:47:53.305888+0000 mon.a (mon.0) 1066 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:47:53.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:47:53 smithi157 bash[24585]: audit 2024-09-16T08:47:53.309758+0000 mon.b (mon.2) 777 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:47:53.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:47:53 smithi086 bash[24289]: audit 2024-09-16T08:47:52.533794+0000 mon.a (mon.0) 1060 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:47:53.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:47:53 smithi086 bash[24289]: audit 2024-09-16T08:47:52.539492+0000 mon.a (mon.0) 1061 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:47:53.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:47:53 smithi086 bash[24289]: audit 2024-09-16T08:47:52.556699+0000 mon.a (mon.0) 1062 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:47:53.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:47:53 smithi086 bash[24289]: audit 2024-09-16T08:47:52.559505+0000 mon.a (mon.0) 1063 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:47:53.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:47:53 smithi086 bash[24289]: audit 2024-09-16T08:47:52.564043+0000 mon.a (mon.0) 1064 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:47:53.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:47:53 smithi086 bash[24289]: audit 2024-09-16T08:47:52.568712+0000 mon.a (mon.0) 1065 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:47:53.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:47:53 smithi086 bash[24289]: audit 2024-09-16T08:47:53.290628+0000 mon.b (mon.2) 775 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T08:47:53.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:47:53 smithi086 bash[24289]: audit 2024-09-16T08:47:53.292758+0000 mon.b (mon.2) 776 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T08:47:53.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:47:53 smithi086 bash[24289]: audit 2024-09-16T08:47:53.305888+0000 mon.a (mon.0) 1066 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:47:53.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:47:53 smithi086 bash[24289]: audit 2024-09-16T08:47:53.309758+0000 mon.b (mon.2) 777 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:47:53.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:47:53 smithi047 bash[22744]: audit 2024-09-16T08:47:52.533794+0000 mon.a (mon.0) 1060 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:47:53.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:47:53 smithi047 bash[22744]: audit 2024-09-16T08:47:52.539492+0000 mon.a (mon.0) 1061 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:47:53.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:47:53 smithi047 bash[22744]: audit 2024-09-16T08:47:52.556699+0000 mon.a (mon.0) 1062 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:47:53.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:47:53 smithi047 bash[22744]: audit 2024-09-16T08:47:52.559505+0000 mon.a (mon.0) 1063 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:47:53.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:47:53 smithi047 bash[22744]: audit 2024-09-16T08:47:52.564043+0000 mon.a (mon.0) 1064 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:47:53.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:47:53 smithi047 bash[22744]: audit 2024-09-16T08:47:52.568712+0000 mon.a (mon.0) 1065 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:47:53.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:47:53 smithi047 bash[22744]: audit 2024-09-16T08:47:53.290628+0000 mon.b (mon.2) 775 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T08:47:53.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:47:53 smithi047 bash[22744]: audit 2024-09-16T08:47:53.292758+0000 mon.b (mon.2) 776 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T08:47:53.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:47:53 smithi047 bash[22744]: audit 2024-09-16T08:47:53.305888+0000 mon.a (mon.0) 1066 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:47:53.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:47:53 smithi047 bash[22744]: audit 2024-09-16T08:47:53.309758+0000 mon.b (mon.2) 777 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:47:54.163 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:47:54.164 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:47:54.165 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:47:54.338 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 08:47:54 smithi047 bash[22994]: debug 2024-09-16T08:47:54.060+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T08:47:54.338 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 08:47:54 smithi047 bash[22994]: debug 2024-09-16T08:47:54.060+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T08:47:54.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:47:54 smithi157 bash[24585]: audit 2024-09-16T08:47:53.313910+0000 mgr.a (mgr.14373) 8251 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:47:54.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:47:54 smithi157 bash[24585]: cluster 2024-09-16T08:47:53.810749+0000 mgr.a (mgr.14373) 8252 : cluster [DBG] pgmap v5723: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:47:54.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:47:54 smithi086 bash[24289]: audit 2024-09-16T08:47:53.313910+0000 mgr.a (mgr.14373) 8251 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:47:54.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:47:54 smithi086 bash[24289]: cluster 2024-09-16T08:47:53.810749+0000 mgr.a (mgr.14373) 8252 : cluster [DBG] pgmap v5723: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:47:54.837 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:47:54 smithi047 bash[22744]: audit 2024-09-16T08:47:53.313910+0000 mgr.a (mgr.14373) 8251 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:47:54.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:47:54 smithi047 bash[22744]: cluster 2024-09-16T08:47:53.810749+0000 mgr.a (mgr.14373) 8252 : cluster [DBG] pgmap v5723: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:47:54.911 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:47:54.912 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:47:54.912 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:47:54.912 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:47:54.912 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:47:55.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:47:55 smithi157 bash[24585]: audit 2024-09-16T08:47:54.062335+0000 mgr.a (mgr.14373) 8253 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T08:47:55.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:47:55 smithi157 bash[24585]: cephadm 2024-09-16T08:47:54.064399+0000 mgr.a (mgr.14373) 8254 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T08:47:55.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:47:55 smithi157 bash[24585]: audit 2024-09-16T08:47:54.496125+0000 mgr.a (mgr.14373) 8255 : audit [DBG] from='client.184872 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:47:55.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:47:55 smithi086 bash[24289]: audit 2024-09-16T08:47:54.062335+0000 mgr.a (mgr.14373) 8253 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T08:47:55.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:47:55 smithi086 bash[24289]: cephadm 2024-09-16T08:47:54.064399+0000 mgr.a (mgr.14373) 8254 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T08:47:55.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:47:55 smithi086 bash[24289]: audit 2024-09-16T08:47:54.496125+0000 mgr.a (mgr.14373) 8255 : audit [DBG] from='client.184872 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:47:55.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:47:55 smithi047 bash[22744]: audit 2024-09-16T08:47:54.062335+0000 mgr.a (mgr.14373) 8253 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T08:47:55.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:47:55 smithi047 bash[22744]: cephadm 2024-09-16T08:47:54.064399+0000 mgr.a (mgr.14373) 8254 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T08:47:55.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:47:55 smithi047 bash[22744]: audit 2024-09-16T08:47:54.496125+0000 mgr.a (mgr.14373) 8255 : audit [DBG] from='client.184872 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:47:56.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:47:56 smithi157 bash[24585]: cluster 2024-09-16T08:47:55.811649+0000 mgr.a (mgr.14373) 8256 : cluster [DBG] pgmap v5724: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:47:56.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:47:56 smithi086 bash[24289]: cluster 2024-09-16T08:47:55.811649+0000 mgr.a (mgr.14373) 8256 : cluster [DBG] pgmap v5724: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:47:56.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:47:56 smithi047 bash[22744]: cluster 2024-09-16T08:47:55.811649+0000 mgr.a (mgr.14373) 8256 : cluster [DBG] pgmap v5724: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:47:59.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:47:58 smithi157 bash[24585]: cluster 2024-09-16T08:47:57.813901+0000 mgr.a (mgr.14373) 8257 : cluster [DBG] pgmap v5725: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:47:59.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:47:58 smithi086 bash[24289]: cluster 2024-09-16T08:47:57.813901+0000 mgr.a (mgr.14373) 8257 : cluster [DBG] pgmap v5725: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:47:59.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:47:58 smithi047 bash[22744]: cluster 2024-09-16T08:47:57.813901+0000 mgr.a (mgr.14373) 8257 : cluster [DBG] pgmap v5725: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:47:59.913 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:47:59.913 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:47:59.914 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:48:00.688 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:48:00.689 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:48:00.689 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:48:00.689 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:48:00.689 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:48:01.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:48:00 smithi157 bash[24585]: cluster 2024-09-16T08:47:59.814689+0000 mgr.a (mgr.14373) 8258 : cluster [DBG] pgmap v5726: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:48:01.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:48:00 smithi086 bash[24289]: cluster 2024-09-16T08:47:59.814689+0000 mgr.a (mgr.14373) 8258 : cluster [DBG] pgmap v5726: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:48:01.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:48:00 smithi047 bash[22744]: cluster 2024-09-16T08:47:59.814689+0000 mgr.a (mgr.14373) 8258 : cluster [DBG] pgmap v5726: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:48:02.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:48:01 smithi157 bash[24585]: audit 2024-09-16T08:48:00.252079+0000 mgr.a (mgr.14373) 8259 : audit [DBG] from='client.184950 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:48:02.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:48:01 smithi086 bash[24289]: audit 2024-09-16T08:48:00.252079+0000 mgr.a (mgr.14373) 8259 : audit [DBG] from='client.184950 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:48:02.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:48:01 smithi047 bash[22744]: audit 2024-09-16T08:48:00.252079+0000 mgr.a (mgr.14373) 8259 : audit [DBG] from='client.184950 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:48:03.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:48:02 smithi157 bash[24585]: cluster 2024-09-16T08:48:01.817012+0000 mgr.a (mgr.14373) 8260 : cluster [DBG] pgmap v5727: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:48:03.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:48:02 smithi086 bash[24289]: cluster 2024-09-16T08:48:01.817012+0000 mgr.a (mgr.14373) 8260 : cluster [DBG] pgmap v5727: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:48:03.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:48:02 smithi047 bash[22744]: cluster 2024-09-16T08:48:01.817012+0000 mgr.a (mgr.14373) 8260 : cluster [DBG] pgmap v5727: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:48:05.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:48:04 smithi157 bash[24585]: cluster 2024-09-16T08:48:03.817802+0000 mgr.a (mgr.14373) 8261 : cluster [DBG] pgmap v5728: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:48:05.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:48:04 smithi086 bash[24289]: cluster 2024-09-16T08:48:03.817802+0000 mgr.a (mgr.14373) 8261 : cluster [DBG] pgmap v5728: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:48:05.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:48:04 smithi047 bash[22744]: cluster 2024-09-16T08:48:03.817802+0000 mgr.a (mgr.14373) 8261 : cluster [DBG] pgmap v5728: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:48:05.690 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:48:05.690 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:48:05.691 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:48:06.436 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:48:06.436 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:48:06.436 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:48:06.436 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:48:06.436 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:48:07.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:48:06 smithi157 bash[24585]: cluster 2024-09-16T08:48:05.818293+0000 mgr.a (mgr.14373) 8262 : cluster [DBG] pgmap v5729: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:48:07.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:48:06 smithi086 bash[24289]: cluster 2024-09-16T08:48:05.818293+0000 mgr.a (mgr.14373) 8262 : cluster [DBG] pgmap v5729: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:48:07.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:48:06 smithi047 bash[22744]: cluster 2024-09-16T08:48:05.818293+0000 mgr.a (mgr.14373) 8262 : cluster [DBG] pgmap v5729: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:48:08.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:48:07 smithi157 bash[24585]: audit 2024-09-16T08:48:06.023694+0000 mgr.a (mgr.14373) 8263 : audit [DBG] from='client.185025 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:48:08.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:48:07 smithi086 bash[24289]: audit 2024-09-16T08:48:06.023694+0000 mgr.a (mgr.14373) 8263 : audit [DBG] from='client.185025 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:48:08.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:48:07 smithi047 bash[22744]: audit 2024-09-16T08:48:06.023694+0000 mgr.a (mgr.14373) 8263 : audit [DBG] from='client.185025 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:48:09.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:48:08 smithi157 bash[24585]: cluster 2024-09-16T08:48:07.820657+0000 mgr.a (mgr.14373) 8264 : cluster [DBG] pgmap v5730: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 12 KiB/s rd, 426 B/s wr, 14 op/s 2024-09-16T08:48:09.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:48:08 smithi086 bash[24289]: cluster 2024-09-16T08:48:07.820657+0000 mgr.a (mgr.14373) 8264 : cluster [DBG] pgmap v5730: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 12 KiB/s rd, 426 B/s wr, 14 op/s 2024-09-16T08:48:09.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:48:08 smithi047 bash[22744]: cluster 2024-09-16T08:48:07.820657+0000 mgr.a (mgr.14373) 8264 : cluster [DBG] pgmap v5730: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 12 KiB/s rd, 426 B/s wr, 14 op/s 2024-09-16T08:48:10.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:48:09 smithi157 bash[24585]: cluster 2024-09-16T08:48:09.821421+0000 mgr.a (mgr.14373) 8265 : cluster [DBG] pgmap v5731: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-16T08:48:10.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:48:09 smithi086 bash[24289]: cluster 2024-09-16T08:48:09.821421+0000 mgr.a (mgr.14373) 8265 : cluster [DBG] pgmap v5731: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-16T08:48:10.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:48:09 smithi047 bash[22744]: cluster 2024-09-16T08:48:09.821421+0000 mgr.a (mgr.14373) 8265 : cluster [DBG] pgmap v5731: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-16T08:48:11.437 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:48:11.438 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:48:11.438 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:48:12.223 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:48:12.223 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:48:12.224 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:48:12.224 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:48:12.224 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:48:13.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:48:12 smithi157 bash[24585]: audit 2024-09-16T08:48:11.778118+0000 mgr.a (mgr.14373) 8266 : audit [DBG] from='client.185103 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:48:13.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:48:12 smithi157 bash[24585]: cluster 2024-09-16T08:48:11.824416+0000 mgr.a (mgr.14373) 8267 : cluster [DBG] pgmap v5732: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-16T08:48:13.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:48:12 smithi086 bash[24289]: audit 2024-09-16T08:48:11.778118+0000 mgr.a (mgr.14373) 8266 : audit [DBG] from='client.185103 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:48:13.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:48:12 smithi086 bash[24289]: cluster 2024-09-16T08:48:11.824416+0000 mgr.a (mgr.14373) 8267 : cluster [DBG] pgmap v5732: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-16T08:48:13.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:48:12 smithi047 bash[22744]: audit 2024-09-16T08:48:11.778118+0000 mgr.a (mgr.14373) 8266 : audit [DBG] from='client.185103 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:48:13.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:48:12 smithi047 bash[22744]: cluster 2024-09-16T08:48:11.824416+0000 mgr.a (mgr.14373) 8267 : cluster [DBG] pgmap v5732: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-16T08:48:15.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:48:14 smithi157 bash[24585]: cluster 2024-09-16T08:48:13.825395+0000 mgr.a (mgr.14373) 8268 : cluster [DBG] pgmap v5733: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 4.9 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-16T08:48:15.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:48:14 smithi086 bash[24289]: cluster 2024-09-16T08:48:13.825395+0000 mgr.a (mgr.14373) 8268 : cluster [DBG] pgmap v5733: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 4.9 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-16T08:48:15.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:48:14 smithi047 bash[22744]: cluster 2024-09-16T08:48:13.825395+0000 mgr.a (mgr.14373) 8268 : cluster [DBG] pgmap v5733: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 4.9 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-16T08:48:17.225 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:48:17.226 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:48:17.226 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:48:17.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:48:16 smithi157 bash[24585]: cluster 2024-09-16T08:48:15.826197+0000 mgr.a (mgr.14373) 8269 : cluster [DBG] pgmap v5734: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 4.9 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-16T08:48:17.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:48:16 smithi086 bash[24289]: cluster 2024-09-16T08:48:15.826197+0000 mgr.a (mgr.14373) 8269 : cluster [DBG] pgmap v5734: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 4.9 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-16T08:48:17.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:48:16 smithi047 bash[22744]: cluster 2024-09-16T08:48:15.826197+0000 mgr.a (mgr.14373) 8269 : cluster [DBG] pgmap v5734: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 4.9 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-16T08:48:18.080 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:48:18.081 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:48:18.081 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:48:18.081 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:48:18.081 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:48:19.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:48:18 smithi157 bash[24585]: audit 2024-09-16T08:48:17.590777+0000 mgr.a (mgr.14373) 8270 : audit [DBG] from='client.185175 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:48:19.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:48:18 smithi157 bash[24585]: cluster 2024-09-16T08:48:17.827584+0000 mgr.a (mgr.14373) 8271 : cluster [DBG] pgmap v5735: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-16T08:48:19.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:48:18 smithi086 bash[24289]: audit 2024-09-16T08:48:17.590777+0000 mgr.a (mgr.14373) 8270 : audit [DBG] from='client.185175 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:48:19.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:48:18 smithi086 bash[24289]: cluster 2024-09-16T08:48:17.827584+0000 mgr.a (mgr.14373) 8271 : cluster [DBG] pgmap v5735: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-16T08:48:19.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:48:18 smithi047 bash[22744]: audit 2024-09-16T08:48:17.590777+0000 mgr.a (mgr.14373) 8270 : audit [DBG] from='client.185175 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:48:19.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:48:18 smithi047 bash[22744]: cluster 2024-09-16T08:48:17.827584+0000 mgr.a (mgr.14373) 8271 : cluster [DBG] pgmap v5735: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-16T08:48:21.315 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:48:20 smithi157 bash[24585]: cluster 2024-09-16T08:48:19.828466+0000 mgr.a (mgr.14373) 8272 : cluster [DBG] pgmap v5736: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:48:21.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:48:20 smithi086 bash[24289]: cluster 2024-09-16T08:48:19.828466+0000 mgr.a (mgr.14373) 8272 : cluster [DBG] pgmap v5736: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:48:21.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:48:20 smithi047 bash[22744]: cluster 2024-09-16T08:48:19.828466+0000 mgr.a (mgr.14373) 8272 : cluster [DBG] pgmap v5736: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:48:23.082 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:48:23.082 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:48:23.083 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:48:23.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:48:22 smithi157 bash[24585]: cluster 2024-09-16T08:48:21.830641+0000 mgr.a (mgr.14373) 8273 : cluster [DBG] pgmap v5737: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 65 KiB/s rd, 0 B/s wr, 107 op/s 2024-09-16T08:48:23.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:48:22 smithi086 bash[24289]: cluster 2024-09-16T08:48:21.830641+0000 mgr.a (mgr.14373) 8273 : cluster [DBG] pgmap v5737: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 65 KiB/s rd, 0 B/s wr, 107 op/s 2024-09-16T08:48:23.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:48:22 smithi047 bash[22744]: cluster 2024-09-16T08:48:21.830641+0000 mgr.a (mgr.14373) 8273 : cluster [DBG] pgmap v5737: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 65 KiB/s rd, 0 B/s wr, 107 op/s 2024-09-16T08:48:23.850 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:48:23.850 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:48:23.850 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:48:23.850 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:48:23.850 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:48:25.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:48:24 smithi157 bash[24585]: audit 2024-09-16T08:48:23.419380+0000 mgr.a (mgr.14373) 8274 : audit [DBG] from='client.185253 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:48:25.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:48:24 smithi157 bash[24585]: cluster 2024-09-16T08:48:23.831116+0000 mgr.a (mgr.14373) 8275 : cluster [DBG] pgmap v5738: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 65 KiB/s rd, 0 B/s wr, 107 op/s 2024-09-16T08:48:25.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:48:24 smithi086 bash[24289]: audit 2024-09-16T08:48:23.419380+0000 mgr.a (mgr.14373) 8274 : audit [DBG] from='client.185253 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:48:25.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:48:24 smithi086 bash[24289]: cluster 2024-09-16T08:48:23.831116+0000 mgr.a (mgr.14373) 8275 : cluster [DBG] pgmap v5738: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 65 KiB/s rd, 0 B/s wr, 107 op/s 2024-09-16T08:48:25.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:48:24 smithi047 bash[22744]: audit 2024-09-16T08:48:23.419380+0000 mgr.a (mgr.14373) 8274 : audit [DBG] from='client.185253 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:48:25.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:48:24 smithi047 bash[22744]: cluster 2024-09-16T08:48:23.831116+0000 mgr.a (mgr.14373) 8275 : cluster [DBG] pgmap v5738: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 65 KiB/s rd, 0 B/s wr, 107 op/s 2024-09-16T08:48:27.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:48:26 smithi157 bash[24585]: cluster 2024-09-16T08:48:25.831857+0000 mgr.a (mgr.14373) 8276 : cluster [DBG] pgmap v5739: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 65 KiB/s rd, 0 B/s wr, 107 op/s 2024-09-16T08:48:27.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:48:26 smithi086 bash[24289]: cluster 2024-09-16T08:48:25.831857+0000 mgr.a (mgr.14373) 8276 : cluster [DBG] pgmap v5739: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 65 KiB/s rd, 0 B/s wr, 107 op/s 2024-09-16T08:48:27.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:48:26 smithi047 bash[22744]: cluster 2024-09-16T08:48:25.831857+0000 mgr.a (mgr.14373) 8276 : cluster [DBG] pgmap v5739: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 65 KiB/s rd, 0 B/s wr, 107 op/s 2024-09-16T08:48:28.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:48:27 smithi157 bash[24585]: cluster 2024-09-16T08:48:27.834100+0000 mgr.a (mgr.14373) 8277 : cluster [DBG] pgmap v5740: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 66 KiB/s rd, 0 B/s wr, 108 op/s 2024-09-16T08:48:28.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:48:27 smithi086 bash[24289]: cluster 2024-09-16T08:48:27.834100+0000 mgr.a (mgr.14373) 8277 : cluster [DBG] pgmap v5740: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 66 KiB/s rd, 0 B/s wr, 108 op/s 2024-09-16T08:48:28.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:48:27 smithi047 bash[22744]: cluster 2024-09-16T08:48:27.834100+0000 mgr.a (mgr.14373) 8277 : cluster [DBG] pgmap v5740: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 66 KiB/s rd, 0 B/s wr, 108 op/s 2024-09-16T08:48:28.852 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:48:28.853 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:48:28.853 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:48:29.604 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:48:29.604 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:48:29.604 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:48:29.605 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:48:29.605 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:48:31.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:48:30 smithi157 bash[24585]: audit 2024-09-16T08:48:29.186436+0000 mgr.a (mgr.14373) 8278 : audit [DBG] from='client.185331 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:48:31.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:48:30 smithi157 bash[24585]: cluster 2024-09-16T08:48:29.835053+0000 mgr.a (mgr.14373) 8279 : cluster [DBG] pgmap v5741: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 65 KiB/s rd, 0 B/s wr, 107 op/s 2024-09-16T08:48:31.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:48:30 smithi086 bash[24289]: audit 2024-09-16T08:48:29.186436+0000 mgr.a (mgr.14373) 8278 : audit [DBG] from='client.185331 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:48:31.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:48:30 smithi086 bash[24289]: cluster 2024-09-16T08:48:29.835053+0000 mgr.a (mgr.14373) 8279 : cluster [DBG] pgmap v5741: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 65 KiB/s rd, 0 B/s wr, 107 op/s 2024-09-16T08:48:31.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:48:30 smithi047 bash[22744]: audit 2024-09-16T08:48:29.186436+0000 mgr.a (mgr.14373) 8278 : audit [DBG] from='client.185331 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:48:31.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:48:30 smithi047 bash[22744]: cluster 2024-09-16T08:48:29.835053+0000 mgr.a (mgr.14373) 8279 : cluster [DBG] pgmap v5741: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 65 KiB/s rd, 0 B/s wr, 107 op/s 2024-09-16T08:48:33.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:48:32 smithi157 bash[24585]: cluster 2024-09-16T08:48:31.837215+0000 mgr.a (mgr.14373) 8280 : cluster [DBG] pgmap v5742: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 66 KiB/s rd, 0 B/s wr, 108 op/s 2024-09-16T08:48:33.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:48:32 smithi086 bash[24289]: cluster 2024-09-16T08:48:31.837215+0000 mgr.a (mgr.14373) 8280 : cluster [DBG] pgmap v5742: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 66 KiB/s rd, 0 B/s wr, 108 op/s 2024-09-16T08:48:33.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:48:32 smithi047 bash[22744]: cluster 2024-09-16T08:48:31.837215+0000 mgr.a (mgr.14373) 8280 : cluster [DBG] pgmap v5742: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 66 KiB/s rd, 0 B/s wr, 108 op/s 2024-09-16T08:48:34.605 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:48:34.606 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:48:34.606 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:48:35.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:48:34 smithi157 bash[24585]: cluster 2024-09-16T08:48:33.837979+0000 mgr.a (mgr.14373) 8281 : cluster [DBG] pgmap v5743: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:48:35.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:48:34 smithi086 bash[24289]: cluster 2024-09-16T08:48:33.837979+0000 mgr.a (mgr.14373) 8281 : cluster [DBG] pgmap v5743: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:48:35.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:48:34 smithi047 bash[22744]: cluster 2024-09-16T08:48:33.837979+0000 mgr.a (mgr.14373) 8281 : cluster [DBG] pgmap v5743: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:48:35.347 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:48:35.347 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:48:35.347 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:48:35.347 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:48:35.347 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:48:37.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:48:36 smithi157 bash[24585]: audit 2024-09-16T08:48:34.940966+0000 mgr.a (mgr.14373) 8282 : audit [DBG] from='client.185409 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:48:37.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:48:36 smithi157 bash[24585]: cluster 2024-09-16T08:48:35.838939+0000 mgr.a (mgr.14373) 8283 : cluster [DBG] pgmap v5744: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:48:37.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:48:36 smithi086 bash[24289]: audit 2024-09-16T08:48:34.940966+0000 mgr.a (mgr.14373) 8282 : audit [DBG] from='client.185409 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:48:37.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:48:36 smithi086 bash[24289]: cluster 2024-09-16T08:48:35.838939+0000 mgr.a (mgr.14373) 8283 : cluster [DBG] pgmap v5744: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:48:37.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:48:36 smithi047 bash[22744]: audit 2024-09-16T08:48:34.940966+0000 mgr.a (mgr.14373) 8282 : audit [DBG] from='client.185409 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:48:37.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:48:36 smithi047 bash[22744]: cluster 2024-09-16T08:48:35.838939+0000 mgr.a (mgr.14373) 8283 : cluster [DBG] pgmap v5744: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:48:39.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:48:38 smithi157 bash[24585]: cluster 2024-09-16T08:48:37.841161+0000 mgr.a (mgr.14373) 8284 : cluster [DBG] pgmap v5745: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:48:39.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:48:38 smithi086 bash[24289]: cluster 2024-09-16T08:48:37.841161+0000 mgr.a (mgr.14373) 8284 : cluster [DBG] pgmap v5745: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:48:39.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:48:38 smithi047 bash[22744]: cluster 2024-09-16T08:48:37.841161+0000 mgr.a (mgr.14373) 8284 : cluster [DBG] pgmap v5745: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:48:40.348 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:48:40.349 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:48:40.349 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:48:41.113 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:48:41.113 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:48:41.113 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:48:41.113 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:48:41.113 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:48:41.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:48:40 smithi157 bash[24585]: cluster 2024-09-16T08:48:39.842070+0000 mgr.a (mgr.14373) 8285 : cluster [DBG] pgmap v5746: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:48:41.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:48:40 smithi157 bash[24585]: audit 2024-09-16T08:48:40.691169+0000 mgr.a (mgr.14373) 8286 : audit [DBG] from='client.185487 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:48:41.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:48:40 smithi086 bash[24289]: cluster 2024-09-16T08:48:39.842070+0000 mgr.a (mgr.14373) 8285 : cluster [DBG] pgmap v5746: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:48:41.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:48:40 smithi086 bash[24289]: audit 2024-09-16T08:48:40.691169+0000 mgr.a (mgr.14373) 8286 : audit [DBG] from='client.185487 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:48:41.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:48:40 smithi047 bash[22744]: cluster 2024-09-16T08:48:39.842070+0000 mgr.a (mgr.14373) 8285 : cluster [DBG] pgmap v5746: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:48:41.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:48:40 smithi047 bash[22744]: audit 2024-09-16T08:48:40.691169+0000 mgr.a (mgr.14373) 8286 : audit [DBG] from='client.185487 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:48:42.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:48:41 smithi157 bash[24585]: cluster 2024-09-16T08:48:41.844403+0000 mgr.a (mgr.14373) 8287 : cluster [DBG] pgmap v5747: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:48:42.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:48:41 smithi086 bash[24289]: cluster 2024-09-16T08:48:41.844403+0000 mgr.a (mgr.14373) 8287 : cluster [DBG] pgmap v5747: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:48:42.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:48:41 smithi047 bash[22744]: cluster 2024-09-16T08:48:41.844403+0000 mgr.a (mgr.14373) 8287 : cluster [DBG] pgmap v5747: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:48:45.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:48:44 smithi157 bash[24585]: cluster 2024-09-16T08:48:43.845162+0000 mgr.a (mgr.14373) 8288 : cluster [DBG] pgmap v5748: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:48:45.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:48:44 smithi086 bash[24289]: cluster 2024-09-16T08:48:43.845162+0000 mgr.a (mgr.14373) 8288 : cluster [DBG] pgmap v5748: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:48:45.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:48:44 smithi047 bash[22744]: cluster 2024-09-16T08:48:43.845162+0000 mgr.a (mgr.14373) 8288 : cluster [DBG] pgmap v5748: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:48:46.114 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:48:46.115 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:48:46.115 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:48:46.865 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:48:46.866 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:48:46.866 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:48:46.866 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:48:46.866 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:48:47.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:48:46 smithi157 bash[24585]: cluster 2024-09-16T08:48:45.845908+0000 mgr.a (mgr.14373) 8289 : cluster [DBG] pgmap v5749: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:48:47.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:48:46 smithi086 bash[24289]: cluster 2024-09-16T08:48:45.845908+0000 mgr.a (mgr.14373) 8289 : cluster [DBG] pgmap v5749: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:48:47.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:48:46 smithi047 bash[22744]: cluster 2024-09-16T08:48:45.845908+0000 mgr.a (mgr.14373) 8289 : cluster [DBG] pgmap v5749: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:48:48.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:48:47 smithi157 bash[24585]: audit 2024-09-16T08:48:46.451600+0000 mgr.a (mgr.14373) 8290 : audit [DBG] from='client.185565 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:48:48.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:48:47 smithi086 bash[24289]: audit 2024-09-16T08:48:46.451600+0000 mgr.a (mgr.14373) 8290 : audit [DBG] from='client.185565 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:48:48.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:48:47 smithi047 bash[22744]: audit 2024-09-16T08:48:46.451600+0000 mgr.a (mgr.14373) 8290 : audit [DBG] from='client.185565 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:48:49.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:48:48 smithi157 bash[24585]: cluster 2024-09-16T08:48:47.848707+0000 mgr.a (mgr.14373) 8291 : cluster [DBG] pgmap v5750: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:48:49.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:48:48 smithi086 bash[24289]: cluster 2024-09-16T08:48:47.848707+0000 mgr.a (mgr.14373) 8291 : cluster [DBG] pgmap v5750: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:48:49.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:48:48 smithi047 bash[22744]: cluster 2024-09-16T08:48:47.848707+0000 mgr.a (mgr.14373) 8291 : cluster [DBG] pgmap v5750: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:48:51.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:48:50 smithi157 bash[24585]: cluster 2024-09-16T08:48:49.849483+0000 mgr.a (mgr.14373) 8292 : cluster [DBG] pgmap v5751: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:48:51.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:48:50 smithi086 bash[24289]: cluster 2024-09-16T08:48:49.849483+0000 mgr.a (mgr.14373) 8292 : cluster [DBG] pgmap v5751: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:48:51.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:48:50 smithi047 bash[22744]: cluster 2024-09-16T08:48:49.849483+0000 mgr.a (mgr.14373) 8292 : cluster [DBG] pgmap v5751: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:48:51.867 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:48:51.968 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:48:51.968 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:48:52.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:48:51 smithi157 bash[24585]: cluster 2024-09-16T08:48:51.851445+0000 mgr.a (mgr.14373) 8293 : cluster [DBG] pgmap v5752: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:48:52.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:48:51 smithi086 bash[24289]: cluster 2024-09-16T08:48:51.851445+0000 mgr.a (mgr.14373) 8293 : cluster [DBG] pgmap v5752: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:48:52.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:48:51 smithi047 bash[22744]: cluster 2024-09-16T08:48:51.851445+0000 mgr.a (mgr.14373) 8293 : cluster [DBG] pgmap v5752: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:48:52.621 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:48:52.621 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:48:52.621 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:48:52.621 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:48:52.621 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:48:53.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:48:52 smithi157 bash[24585]: audit 2024-09-16T08:48:52.206552+0000 mgr.a (mgr.14373) 8294 : audit [DBG] from='client.185643 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:48:53.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:48:52 smithi086 bash[24289]: audit 2024-09-16T08:48:52.206552+0000 mgr.a (mgr.14373) 8294 : audit [DBG] from='client.185643 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:48:53.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:48:52 smithi047 bash[22744]: audit 2024-09-16T08:48:52.206552+0000 mgr.a (mgr.14373) 8294 : audit [DBG] from='client.185643 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:48:54.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:48:53 smithi157 bash[24585]: cluster 2024-09-16T08:48:53.852356+0000 mgr.a (mgr.14373) 8295 : cluster [DBG] pgmap v5753: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:48:54.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:48:53 smithi086 bash[24289]: cluster 2024-09-16T08:48:53.852356+0000 mgr.a (mgr.14373) 8295 : cluster [DBG] pgmap v5753: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:48:54.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:48:53 smithi047 bash[22744]: cluster 2024-09-16T08:48:53.852356+0000 mgr.a (mgr.14373) 8295 : cluster [DBG] pgmap v5753: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:48:55.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:48:54 smithi157 bash[24585]: audit 2024-09-16T08:48:54.117195+0000 mon.b (mon.2) 778 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T08:48:55.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:48:54 smithi086 bash[24289]: audit 2024-09-16T08:48:54.117195+0000 mon.b (mon.2) 778 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T08:48:55.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:48:54 smithi047 bash[22744]: audit 2024-09-16T08:48:54.117195+0000 mon.b (mon.2) 778 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T08:48:56.088 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 08:48:55 smithi047 bash[22994]: debug 2024-09-16T08:48:55.719+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T08:48:56.088 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 08:48:55 smithi047 bash[22994]: debug 2024-09-16T08:48:55.723+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T08:48:56.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:48:55 smithi047 bash[22744]: audit 2024-09-16T08:48:54.961778+0000 mon.b (mon.2) 779 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T08:48:56.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:48:55 smithi047 bash[22744]: audit 2024-09-16T08:48:54.963694+0000 mon.b (mon.2) 780 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T08:48:56.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:48:55 smithi047 bash[22744]: audit 2024-09-16T08:48:54.974560+0000 mon.a (mon.0) 1067 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:48:56.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:48:55 smithi047 bash[22744]: audit 2024-09-16T08:48:54.980071+0000 mon.b (mon.2) 781 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:48:56.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:48:55 smithi047 bash[22744]: audit 2024-09-16T08:48:54.983514+0000 mgr.a (mgr.14373) 8296 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:48:56.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:48:55 smithi047 bash[22744]: audit 2024-09-16T08:48:55.725921+0000 mgr.a (mgr.14373) 8297 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T08:48:56.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:48:55 smithi047 bash[22744]: cephadm 2024-09-16T08:48:55.727845+0000 mgr.a (mgr.14373) 8298 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T08:48:56.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:48:55 smithi047 bash[22744]: cluster 2024-09-16T08:48:55.853301+0000 mgr.a (mgr.14373) 8299 : cluster [DBG] pgmap v5754: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T08:48:56.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:48:55 smithi157 bash[24585]: audit 2024-09-16T08:48:54.961778+0000 mon.b (mon.2) 779 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T08:48:56.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:48:55 smithi157 bash[24585]: audit 2024-09-16T08:48:54.963694+0000 mon.b (mon.2) 780 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T08:48:56.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:48:55 smithi157 bash[24585]: audit 2024-09-16T08:48:54.974560+0000 mon.a (mon.0) 1067 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:48:56.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:48:55 smithi157 bash[24585]: audit 2024-09-16T08:48:54.980071+0000 mon.b (mon.2) 781 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:48:56.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:48:55 smithi157 bash[24585]: audit 2024-09-16T08:48:54.983514+0000 mgr.a (mgr.14373) 8296 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:48:56.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:48:55 smithi157 bash[24585]: audit 2024-09-16T08:48:55.725921+0000 mgr.a (mgr.14373) 8297 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T08:48:56.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:48:55 smithi157 bash[24585]: cephadm 2024-09-16T08:48:55.727845+0000 mgr.a (mgr.14373) 8298 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T08:48:56.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:48:55 smithi157 bash[24585]: cluster 2024-09-16T08:48:55.853301+0000 mgr.a (mgr.14373) 8299 : cluster [DBG] pgmap v5754: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T08:48:56.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:48:55 smithi086 bash[24289]: audit 2024-09-16T08:48:54.961778+0000 mon.b (mon.2) 779 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T08:48:56.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:48:55 smithi086 bash[24289]: audit 2024-09-16T08:48:54.963694+0000 mon.b (mon.2) 780 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T08:48:56.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:48:55 smithi086 bash[24289]: audit 2024-09-16T08:48:54.974560+0000 mon.a (mon.0) 1067 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:48:56.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:48:55 smithi086 bash[24289]: audit 2024-09-16T08:48:54.980071+0000 mon.b (mon.2) 781 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:48:56.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:48:55 smithi086 bash[24289]: audit 2024-09-16T08:48:54.983514+0000 mgr.a (mgr.14373) 8296 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:48:56.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:48:55 smithi086 bash[24289]: audit 2024-09-16T08:48:55.725921+0000 mgr.a (mgr.14373) 8297 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T08:48:56.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:48:55 smithi086 bash[24289]: cephadm 2024-09-16T08:48:55.727845+0000 mgr.a (mgr.14373) 8298 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T08:48:56.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:48:55 smithi086 bash[24289]: cluster 2024-09-16T08:48:55.853301+0000 mgr.a (mgr.14373) 8299 : cluster [DBG] pgmap v5754: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T08:48:57.622 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:48:57.623 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:48:57.623 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:48:58.387 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:48:58.387 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:48:58.387 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:48:58.388 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:48:58.388 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:48:59.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:48:58 smithi157 bash[24585]: cluster 2024-09-16T08:48:57.854665+0000 mgr.a (mgr.14373) 8300 : cluster [DBG] pgmap v5755: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:48:59.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:48:58 smithi086 bash[24289]: cluster 2024-09-16T08:48:57.854665+0000 mgr.a (mgr.14373) 8300 : cluster [DBG] pgmap v5755: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:48:59.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:48:58 smithi047 bash[22744]: cluster 2024-09-16T08:48:57.854665+0000 mgr.a (mgr.14373) 8300 : cluster [DBG] pgmap v5755: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:49:00.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:48:59 smithi157 bash[24585]: audit 2024-09-16T08:48:57.961849+0000 mgr.a (mgr.14373) 8301 : audit [DBG] from='client.185823 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:49:00.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:48:59 smithi086 bash[24289]: audit 2024-09-16T08:48:57.961849+0000 mgr.a (mgr.14373) 8301 : audit [DBG] from='client.185823 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:49:00.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:48:59 smithi047 bash[22744]: audit 2024-09-16T08:48:57.961849+0000 mgr.a (mgr.14373) 8301 : audit [DBG] from='client.185823 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:49:01.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:49:00 smithi157 bash[24585]: cluster 2024-09-16T08:48:59.855529+0000 mgr.a (mgr.14373) 8302 : cluster [DBG] pgmap v5756: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:49:01.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:49:00 smithi086 bash[24289]: cluster 2024-09-16T08:48:59.855529+0000 mgr.a (mgr.14373) 8302 : cluster [DBG] pgmap v5756: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:49:01.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:49:00 smithi047 bash[22744]: cluster 2024-09-16T08:48:59.855529+0000 mgr.a (mgr.14373) 8302 : cluster [DBG] pgmap v5756: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:49:02.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:49:01 smithi157 bash[24585]: cluster 2024-09-16T08:49:01.857706+0000 mgr.a (mgr.14373) 8303 : cluster [DBG] pgmap v5757: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:49:02.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:49:01 smithi086 bash[24289]: cluster 2024-09-16T08:49:01.857706+0000 mgr.a (mgr.14373) 8303 : cluster [DBG] pgmap v5757: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:49:02.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:49:01 smithi047 bash[22744]: cluster 2024-09-16T08:49:01.857706+0000 mgr.a (mgr.14373) 8303 : cluster [DBG] pgmap v5757: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:49:03.389 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:49:03.389 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:49:03.390 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:49:04.137 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:49:04.137 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:49:04.137 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:49:04.137 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:49:04.138 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:49:05.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:49:04 smithi157 bash[24585]: audit 2024-09-16T08:49:03.725067+0000 mgr.a (mgr.14373) 8304 : audit [DBG] from='client.185898 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:49:05.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:49:04 smithi157 bash[24585]: cluster 2024-09-16T08:49:03.858607+0000 mgr.a (mgr.14373) 8305 : cluster [DBG] pgmap v5758: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:49:05.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:49:04 smithi086 bash[24289]: audit 2024-09-16T08:49:03.725067+0000 mgr.a (mgr.14373) 8304 : audit [DBG] from='client.185898 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:49:05.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:49:04 smithi086 bash[24289]: cluster 2024-09-16T08:49:03.858607+0000 mgr.a (mgr.14373) 8305 : cluster [DBG] pgmap v5758: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:49:05.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:49:04 smithi047 bash[22744]: audit 2024-09-16T08:49:03.725067+0000 mgr.a (mgr.14373) 8304 : audit [DBG] from='client.185898 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:49:05.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:49:04 smithi047 bash[22744]: cluster 2024-09-16T08:49:03.858607+0000 mgr.a (mgr.14373) 8305 : cluster [DBG] pgmap v5758: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:49:06.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:49:05 smithi157 bash[24585]: cluster 2024-09-16T08:49:05.859540+0000 mgr.a (mgr.14373) 8306 : cluster [DBG] pgmap v5759: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:49:06.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:49:05 smithi086 bash[24289]: cluster 2024-09-16T08:49:05.859540+0000 mgr.a (mgr.14373) 8306 : cluster [DBG] pgmap v5759: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:49:06.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:49:05 smithi047 bash[22744]: cluster 2024-09-16T08:49:05.859540+0000 mgr.a (mgr.14373) 8306 : cluster [DBG] pgmap v5759: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:49:09.139 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:49:09.139 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:49:09.139 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:49:09.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:49:08 smithi157 bash[24585]: cluster 2024-09-16T08:49:07.861776+0000 mgr.a (mgr.14373) 8307 : cluster [DBG] pgmap v5760: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:49:09.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:49:08 smithi086 bash[24289]: cluster 2024-09-16T08:49:07.861776+0000 mgr.a (mgr.14373) 8307 : cluster [DBG] pgmap v5760: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:49:09.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:49:08 smithi047 bash[22744]: cluster 2024-09-16T08:49:07.861776+0000 mgr.a (mgr.14373) 8307 : cluster [DBG] pgmap v5760: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:49:09.897 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:49:09.897 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:49:09.897 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:49:09.897 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:49:09.897 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:49:10.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:49:09 smithi157 bash[24585]: audit 2024-09-16T08:49:09.478222+0000 mgr.a (mgr.14373) 8308 : audit [DBG] from='client.185976 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:49:10.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:49:09 smithi157 bash[24585]: cluster 2024-09-16T08:49:09.862264+0000 mgr.a (mgr.14373) 8309 : cluster [DBG] pgmap v5761: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:49:10.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:49:09 smithi086 bash[24289]: audit 2024-09-16T08:49:09.478222+0000 mgr.a (mgr.14373) 8308 : audit [DBG] from='client.185976 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:49:10.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:49:09 smithi086 bash[24289]: cluster 2024-09-16T08:49:09.862264+0000 mgr.a (mgr.14373) 8309 : cluster [DBG] pgmap v5761: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:49:10.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:49:09 smithi047 bash[22744]: audit 2024-09-16T08:49:09.478222+0000 mgr.a (mgr.14373) 8308 : audit [DBG] from='client.185976 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:49:10.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:49:09 smithi047 bash[22744]: cluster 2024-09-16T08:49:09.862264+0000 mgr.a (mgr.14373) 8309 : cluster [DBG] pgmap v5761: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:49:12.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:49:11 smithi157 bash[24585]: cluster 2024-09-16T08:49:11.864395+0000 mgr.a (mgr.14373) 8310 : cluster [DBG] pgmap v5762: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:49:12.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:49:11 smithi086 bash[24289]: cluster 2024-09-16T08:49:11.864395+0000 mgr.a (mgr.14373) 8310 : cluster [DBG] pgmap v5762: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:49:12.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:49:11 smithi047 bash[22744]: cluster 2024-09-16T08:49:11.864395+0000 mgr.a (mgr.14373) 8310 : cluster [DBG] pgmap v5762: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:49:14.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:49:13 smithi157 bash[24585]: cluster 2024-09-16T08:49:13.865136+0000 mgr.a (mgr.14373) 8311 : cluster [DBG] pgmap v5763: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:49:14.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:49:13 smithi086 bash[24289]: cluster 2024-09-16T08:49:13.865136+0000 mgr.a (mgr.14373) 8311 : cluster [DBG] pgmap v5763: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:49:14.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:49:13 smithi047 bash[22744]: cluster 2024-09-16T08:49:13.865136+0000 mgr.a (mgr.14373) 8311 : cluster [DBG] pgmap v5763: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:49:14.898 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:49:14.899 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:49:14.899 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:49:15.681 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:49:15.681 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:49:15.681 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:49:15.681 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:49:15.681 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:49:16.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:49:15 smithi157 bash[24585]: audit 2024-09-16T08:49:15.235114+0000 mgr.a (mgr.14373) 8312 : audit [DBG] from='client.186051 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:49:16.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:49:15 smithi157 bash[24585]: cluster 2024-09-16T08:49:15.866089+0000 mgr.a (mgr.14373) 8313 : cluster [DBG] pgmap v5764: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:49:16.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:49:15 smithi086 bash[24289]: audit 2024-09-16T08:49:15.235114+0000 mgr.a (mgr.14373) 8312 : audit [DBG] from='client.186051 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:49:16.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:49:15 smithi086 bash[24289]: cluster 2024-09-16T08:49:15.866089+0000 mgr.a (mgr.14373) 8313 : cluster [DBG] pgmap v5764: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:49:16.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:49:15 smithi047 bash[22744]: audit 2024-09-16T08:49:15.235114+0000 mgr.a (mgr.14373) 8312 : audit [DBG] from='client.186051 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:49:16.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:49:15 smithi047 bash[22744]: cluster 2024-09-16T08:49:15.866089+0000 mgr.a (mgr.14373) 8313 : cluster [DBG] pgmap v5764: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:49:18.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:49:17 smithi157 bash[24585]: cluster 2024-09-16T08:49:17.868364+0000 mgr.a (mgr.14373) 8314 : cluster [DBG] pgmap v5765: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:49:18.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:49:17 smithi086 bash[24289]: cluster 2024-09-16T08:49:17.868364+0000 mgr.a (mgr.14373) 8314 : cluster [DBG] pgmap v5765: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:49:18.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:49:17 smithi047 bash[22744]: cluster 2024-09-16T08:49:17.868364+0000 mgr.a (mgr.14373) 8314 : cluster [DBG] pgmap v5765: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:49:20.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:49:19 smithi157 bash[24585]: cluster 2024-09-16T08:49:19.869118+0000 mgr.a (mgr.14373) 8315 : cluster [DBG] pgmap v5766: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:49:20.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:49:19 smithi086 bash[24289]: cluster 2024-09-16T08:49:19.869118+0000 mgr.a (mgr.14373) 8315 : cluster [DBG] pgmap v5766: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:49:20.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:49:19 smithi047 bash[22744]: cluster 2024-09-16T08:49:19.869118+0000 mgr.a (mgr.14373) 8315 : cluster [DBG] pgmap v5766: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:49:20.682 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:49:20.683 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:49:20.683 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:49:21.456 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:49:21.457 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:49:21.457 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:49:21.457 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:49:21.457 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:49:22.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:49:21 smithi157 bash[24585]: audit 2024-09-16T08:49:21.025712+0000 mgr.a (mgr.14373) 8316 : audit [DBG] from='client.186126 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:49:22.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:49:21 smithi157 bash[24585]: cluster 2024-09-16T08:49:21.871461+0000 mgr.a (mgr.14373) 8317 : cluster [DBG] pgmap v5767: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:49:22.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:49:21 smithi086 bash[24289]: audit 2024-09-16T08:49:21.025712+0000 mgr.a (mgr.14373) 8316 : audit [DBG] from='client.186126 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:49:22.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:49:21 smithi086 bash[24289]: cluster 2024-09-16T08:49:21.871461+0000 mgr.a (mgr.14373) 8317 : cluster [DBG] pgmap v5767: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:49:22.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:49:21 smithi047 bash[22744]: audit 2024-09-16T08:49:21.025712+0000 mgr.a (mgr.14373) 8316 : audit [DBG] from='client.186126 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:49:22.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:49:21 smithi047 bash[22744]: cluster 2024-09-16T08:49:21.871461+0000 mgr.a (mgr.14373) 8317 : cluster [DBG] pgmap v5767: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:49:24.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:49:23 smithi157 bash[24585]: cluster 2024-09-16T08:49:23.872220+0000 mgr.a (mgr.14373) 8318 : cluster [DBG] pgmap v5768: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:49:24.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:49:23 smithi086 bash[24289]: cluster 2024-09-16T08:49:23.872220+0000 mgr.a (mgr.14373) 8318 : cluster [DBG] pgmap v5768: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:49:24.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:49:23 smithi047 bash[22744]: cluster 2024-09-16T08:49:23.872220+0000 mgr.a (mgr.14373) 8318 : cluster [DBG] pgmap v5768: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:49:26.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:49:25 smithi157 bash[24585]: cluster 2024-09-16T08:49:25.872982+0000 mgr.a (mgr.14373) 8319 : cluster [DBG] pgmap v5769: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:49:26.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:49:25 smithi086 bash[24289]: cluster 2024-09-16T08:49:25.872982+0000 mgr.a (mgr.14373) 8319 : cluster [DBG] pgmap v5769: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:49:26.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:49:25 smithi047 bash[22744]: cluster 2024-09-16T08:49:25.872982+0000 mgr.a (mgr.14373) 8319 : cluster [DBG] pgmap v5769: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:49:26.457 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:49:26.458 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:49:26.458 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:49:27.236 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:49:27.237 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:49:27.237 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:49:27.237 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:49:27.237 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:49:27.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:49:26 smithi157 bash[24585]: audit 2024-09-16T08:49:26.796079+0000 mgr.a (mgr.14373) 8320 : audit [DBG] from='client.186204 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:49:27.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:49:26 smithi086 bash[24289]: audit 2024-09-16T08:49:26.796079+0000 mgr.a (mgr.14373) 8320 : audit [DBG] from='client.186204 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:49:27.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:49:26 smithi047 bash[22744]: audit 2024-09-16T08:49:26.796079+0000 mgr.a (mgr.14373) 8320 : audit [DBG] from='client.186204 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:49:28.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:49:27 smithi157 bash[24585]: cluster 2024-09-16T08:49:27.875692+0000 mgr.a (mgr.14373) 8321 : cluster [DBG] pgmap v5770: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:49:28.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:49:27 smithi086 bash[24289]: cluster 2024-09-16T08:49:27.875692+0000 mgr.a (mgr.14373) 8321 : cluster [DBG] pgmap v5770: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:49:28.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:49:27 smithi047 bash[22744]: cluster 2024-09-16T08:49:27.875692+0000 mgr.a (mgr.14373) 8321 : cluster [DBG] pgmap v5770: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:49:30.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:49:29 smithi157 bash[24585]: cluster 2024-09-16T08:49:29.876482+0000 mgr.a (mgr.14373) 8322 : cluster [DBG] pgmap v5771: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:49:30.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:49:29 smithi086 bash[24289]: cluster 2024-09-16T08:49:29.876482+0000 mgr.a (mgr.14373) 8322 : cluster [DBG] pgmap v5771: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:49:30.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:49:29 smithi047 bash[22744]: cluster 2024-09-16T08:49:29.876482+0000 mgr.a (mgr.14373) 8322 : cluster [DBG] pgmap v5771: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:49:32.238 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:49:32.239 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:49:32.239 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:49:32.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:49:31 smithi157 bash[24585]: cluster 2024-09-16T08:49:31.878406+0000 mgr.a (mgr.14373) 8323 : cluster [DBG] pgmap v5772: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:49:32.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:49:31 smithi086 bash[24289]: cluster 2024-09-16T08:49:31.878406+0000 mgr.a (mgr.14373) 8323 : cluster [DBG] pgmap v5772: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:49:32.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:49:31 smithi047 bash[22744]: cluster 2024-09-16T08:49:31.878406+0000 mgr.a (mgr.14373) 8323 : cluster [DBG] pgmap v5772: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:49:32.997 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:49:32.997 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:49:32.998 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:49:32.998 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:49:32.998 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:49:33.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:49:32 smithi157 bash[24585]: audit 2024-09-16T08:49:32.577304+0000 mgr.a (mgr.14373) 8324 : audit [DBG] from='client.186279 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:49:33.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:49:32 smithi086 bash[24289]: audit 2024-09-16T08:49:32.577304+0000 mgr.a (mgr.14373) 8324 : audit [DBG] from='client.186279 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:49:33.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:49:32 smithi047 bash[22744]: audit 2024-09-16T08:49:32.577304+0000 mgr.a (mgr.14373) 8324 : audit [DBG] from='client.186279 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:49:34.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:49:33 smithi157 bash[24585]: cluster 2024-09-16T08:49:33.879256+0000 mgr.a (mgr.14373) 8325 : cluster [DBG] pgmap v5773: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:49:34.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:49:33 smithi086 bash[24289]: cluster 2024-09-16T08:49:33.879256+0000 mgr.a (mgr.14373) 8325 : cluster [DBG] pgmap v5773: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:49:34.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:49:33 smithi047 bash[22744]: cluster 2024-09-16T08:49:33.879256+0000 mgr.a (mgr.14373) 8325 : cluster [DBG] pgmap v5773: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:49:36.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:49:35 smithi157 bash[24585]: cluster 2024-09-16T08:49:35.880013+0000 mgr.a (mgr.14373) 8326 : cluster [DBG] pgmap v5774: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T08:49:36.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:49:35 smithi086 bash[24289]: cluster 2024-09-16T08:49:35.880013+0000 mgr.a (mgr.14373) 8326 : cluster [DBG] pgmap v5774: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T08:49:36.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:49:35 smithi047 bash[22744]: cluster 2024-09-16T08:49:35.880013+0000 mgr.a (mgr.14373) 8326 : cluster [DBG] pgmap v5774: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T08:49:37.999 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:49:37.999 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:49:38.000 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:49:38.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:49:37 smithi157 bash[24585]: cluster 2024-09-16T08:49:37.882234+0000 mgr.a (mgr.14373) 8327 : cluster [DBG] pgmap v5775: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:49:38.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:49:37 smithi086 bash[24289]: cluster 2024-09-16T08:49:37.882234+0000 mgr.a (mgr.14373) 8327 : cluster [DBG] pgmap v5775: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:49:38.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:49:37 smithi047 bash[22744]: cluster 2024-09-16T08:49:37.882234+0000 mgr.a (mgr.14373) 8327 : cluster [DBG] pgmap v5775: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:49:38.747 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:49:38.747 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:49:38.748 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:49:38.748 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:49:38.748 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:49:39.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:49:38 smithi157 bash[24585]: audit 2024-09-16T08:49:38.331599+0000 mgr.a (mgr.14373) 8328 : audit [DBG] from='client.186357 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:49:39.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:49:38 smithi086 bash[24289]: audit 2024-09-16T08:49:38.331599+0000 mgr.a (mgr.14373) 8328 : audit [DBG] from='client.186357 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:49:39.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:49:38 smithi047 bash[22744]: audit 2024-09-16T08:49:38.331599+0000 mgr.a (mgr.14373) 8328 : audit [DBG] from='client.186357 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:49:40.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:49:39 smithi157 bash[24585]: cluster 2024-09-16T08:49:39.883197+0000 mgr.a (mgr.14373) 8329 : cluster [DBG] pgmap v5776: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:49:40.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:49:39 smithi086 bash[24289]: cluster 2024-09-16T08:49:39.883197+0000 mgr.a (mgr.14373) 8329 : cluster [DBG] pgmap v5776: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:49:40.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:49:39 smithi047 bash[22744]: cluster 2024-09-16T08:49:39.883197+0000 mgr.a (mgr.14373) 8329 : cluster [DBG] pgmap v5776: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:49:42.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:49:41 smithi157 bash[24585]: cluster 2024-09-16T08:49:41.885322+0000 mgr.a (mgr.14373) 8330 : cluster [DBG] pgmap v5777: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:49:42.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:49:41 smithi086 bash[24289]: cluster 2024-09-16T08:49:41.885322+0000 mgr.a (mgr.14373) 8330 : cluster [DBG] pgmap v5777: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:49:42.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:49:41 smithi047 bash[22744]: cluster 2024-09-16T08:49:41.885322+0000 mgr.a (mgr.14373) 8330 : cluster [DBG] pgmap v5777: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:49:43.749 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:49:43.749 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:49:43.749 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:49:44.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:49:43 smithi157 bash[24585]: cluster 2024-09-16T08:49:43.885837+0000 mgr.a (mgr.14373) 8331 : cluster [DBG] pgmap v5778: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:49:44.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:49:43 smithi086 bash[24289]: cluster 2024-09-16T08:49:43.885837+0000 mgr.a (mgr.14373) 8331 : cluster [DBG] pgmap v5778: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:49:44.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:49:43 smithi047 bash[22744]: cluster 2024-09-16T08:49:43.885837+0000 mgr.a (mgr.14373) 8331 : cluster [DBG] pgmap v5778: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:49:44.536 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:49:44.536 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:49:44.536 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:49:44.536 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:49:44.536 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:49:45.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:49:44 smithi157 bash[24585]: audit 2024-09-16T08:49:44.093941+0000 mgr.a (mgr.14373) 8332 : audit [DBG] from='client.186432 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:49:45.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:49:44 smithi086 bash[24289]: audit 2024-09-16T08:49:44.093941+0000 mgr.a (mgr.14373) 8332 : audit [DBG] from='client.186432 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:49:45.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:49:44 smithi047 bash[22744]: audit 2024-09-16T08:49:44.093941+0000 mgr.a (mgr.14373) 8332 : audit [DBG] from='client.186432 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:49:46.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:49:45 smithi157 bash[24585]: cluster 2024-09-16T08:49:45.886669+0000 mgr.a (mgr.14373) 8333 : cluster [DBG] pgmap v5779: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:49:46.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:49:45 smithi086 bash[24289]: cluster 2024-09-16T08:49:45.886669+0000 mgr.a (mgr.14373) 8333 : cluster [DBG] pgmap v5779: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:49:46.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:49:45 smithi047 bash[22744]: cluster 2024-09-16T08:49:45.886669+0000 mgr.a (mgr.14373) 8333 : cluster [DBG] pgmap v5779: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:49:48.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:49:47 smithi157 bash[24585]: cluster 2024-09-16T08:49:47.888859+0000 mgr.a (mgr.14373) 8334 : cluster [DBG] pgmap v5780: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:49:48.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:49:47 smithi086 bash[24289]: cluster 2024-09-16T08:49:47.888859+0000 mgr.a (mgr.14373) 8334 : cluster [DBG] pgmap v5780: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:49:48.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:49:47 smithi047 bash[22744]: cluster 2024-09-16T08:49:47.888859+0000 mgr.a (mgr.14373) 8334 : cluster [DBG] pgmap v5780: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:49:49.537 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:49:49.538 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:49:49.538 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:49:50.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:49:49 smithi157 bash[24585]: audit 2024-09-16T08:49:49.876025+0000 mgr.a (mgr.14373) 8335 : audit [DBG] from='client.186510 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:49:50.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:49:49 smithi157 bash[24585]: cluster 2024-09-16T08:49:49.891113+0000 mgr.a (mgr.14373) 8336 : cluster [DBG] pgmap v5781: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:49:50.308 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:49:50.309 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:49:50.309 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:49:50.309 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:49:50.309 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:49:50.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:49:49 smithi086 bash[24289]: audit 2024-09-16T08:49:49.876025+0000 mgr.a (mgr.14373) 8335 : audit [DBG] from='client.186510 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:49:50.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:49:49 smithi086 bash[24289]: cluster 2024-09-16T08:49:49.891113+0000 mgr.a (mgr.14373) 8336 : cluster [DBG] pgmap v5781: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:49:50.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:49:49 smithi047 bash[22744]: audit 2024-09-16T08:49:49.876025+0000 mgr.a (mgr.14373) 8335 : audit [DBG] from='client.186510 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:49:50.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:49:49 smithi047 bash[22744]: cluster 2024-09-16T08:49:49.891113+0000 mgr.a (mgr.14373) 8336 : cluster [DBG] pgmap v5781: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:49:52.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:49:51 smithi157 bash[24585]: cluster 2024-09-16T08:49:51.893480+0000 mgr.a (mgr.14373) 8337 : cluster [DBG] pgmap v5782: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:49:52.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:49:51 smithi086 bash[24289]: cluster 2024-09-16T08:49:51.893480+0000 mgr.a (mgr.14373) 8337 : cluster [DBG] pgmap v5782: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:49:52.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:49:51 smithi047 bash[22744]: cluster 2024-09-16T08:49:51.893480+0000 mgr.a (mgr.14373) 8337 : cluster [DBG] pgmap v5782: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:49:54.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:49:53 smithi157 bash[24585]: cluster 2024-09-16T08:49:53.894246+0000 mgr.a (mgr.14373) 8338 : cluster [DBG] pgmap v5783: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:49:54.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:49:53 smithi086 bash[24289]: cluster 2024-09-16T08:49:53.894246+0000 mgr.a (mgr.14373) 8338 : cluster [DBG] pgmap v5783: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:49:54.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:49:53 smithi047 bash[22744]: cluster 2024-09-16T08:49:53.894246+0000 mgr.a (mgr.14373) 8338 : cluster [DBG] pgmap v5783: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:49:55.310 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:49:55.311 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:49:55.311 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:49:56.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:49:55 smithi047 bash[22744]: audit 2024-09-16T08:49:55.777808+0000 mon.b (mon.2) 782 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T08:49:56.110 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:49:56.110 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:49:56.110 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:49:56.110 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:49:56.110 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:49:56.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:49:55 smithi157 bash[24585]: audit 2024-09-16T08:49:55.777808+0000 mon.b (mon.2) 782 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T08:49:56.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:49:55 smithi086 bash[24289]: audit 2024-09-16T08:49:55.777808+0000 mon.b (mon.2) 782 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T08:49:57.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:49:56 smithi047 bash[22744]: audit 2024-09-16T08:49:55.651724+0000 mgr.a (mgr.14373) 8339 : audit [DBG] from='client.186588 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:49:57.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:49:56 smithi047 bash[22744]: cluster 2024-09-16T08:49:55.894859+0000 mgr.a (mgr.14373) 8340 : cluster [DBG] pgmap v5784: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:49:57.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:49:56 smithi047 bash[22744]: audit 2024-09-16T08:49:56.583228+0000 mon.b (mon.2) 783 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T08:49:57.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:49:56 smithi047 bash[22744]: audit 2024-09-16T08:49:56.585394+0000 mon.b (mon.2) 784 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T08:49:57.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:49:56 smithi047 bash[22744]: audit 2024-09-16T08:49:56.598973+0000 mon.a (mon.0) 1068 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:49:57.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:49:56 smithi047 bash[22744]: audit 2024-09-16T08:49:56.602461+0000 mon.b (mon.2) 785 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:49:57.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:49:56 smithi157 bash[24585]: audit 2024-09-16T08:49:55.651724+0000 mgr.a (mgr.14373) 8339 : audit [DBG] from='client.186588 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:49:57.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:49:56 smithi157 bash[24585]: cluster 2024-09-16T08:49:55.894859+0000 mgr.a (mgr.14373) 8340 : cluster [DBG] pgmap v5784: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:49:57.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:49:56 smithi157 bash[24585]: audit 2024-09-16T08:49:56.583228+0000 mon.b (mon.2) 783 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T08:49:57.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:49:56 smithi157 bash[24585]: audit 2024-09-16T08:49:56.585394+0000 mon.b (mon.2) 784 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T08:49:57.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:49:56 smithi157 bash[24585]: audit 2024-09-16T08:49:56.598973+0000 mon.a (mon.0) 1068 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:49:57.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:49:56 smithi157 bash[24585]: audit 2024-09-16T08:49:56.602461+0000 mon.b (mon.2) 785 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:49:57.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:49:56 smithi086 bash[24289]: audit 2024-09-16T08:49:55.651724+0000 mgr.a (mgr.14373) 8339 : audit [DBG] from='client.186588 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:49:57.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:49:56 smithi086 bash[24289]: cluster 2024-09-16T08:49:55.894859+0000 mgr.a (mgr.14373) 8340 : cluster [DBG] pgmap v5784: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:49:57.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:49:56 smithi086 bash[24289]: audit 2024-09-16T08:49:56.583228+0000 mon.b (mon.2) 783 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T08:49:57.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:49:56 smithi086 bash[24289]: audit 2024-09-16T08:49:56.585394+0000 mon.b (mon.2) 784 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T08:49:57.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:49:56 smithi086 bash[24289]: audit 2024-09-16T08:49:56.598973+0000 mon.a (mon.0) 1068 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:49:57.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:49:56 smithi086 bash[24289]: audit 2024-09-16T08:49:56.602461+0000 mon.b (mon.2) 785 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:49:57.588 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 08:49:57 smithi047 bash[22994]: debug 2024-09-16T08:49:57.334+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T08:49:57.588 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 08:49:57 smithi047 bash[22994]: debug 2024-09-16T08:49:57.338+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T08:49:58.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:49:57 smithi157 bash[24585]: audit 2024-09-16T08:49:56.607243+0000 mgr.a (mgr.14373) 8341 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:49:58.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:49:57 smithi086 bash[24289]: audit 2024-09-16T08:49:56.607243+0000 mgr.a (mgr.14373) 8341 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:49:58.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:49:57 smithi047 bash[22744]: audit 2024-09-16T08:49:56.607243+0000 mgr.a (mgr.14373) 8341 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:49:59.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:49:58 smithi157 bash[24585]: audit 2024-09-16T08:49:57.337440+0000 mgr.a (mgr.14373) 8342 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T08:49:59.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:49:58 smithi157 bash[24585]: cephadm 2024-09-16T08:49:57.339172+0000 mgr.a (mgr.14373) 8343 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T08:49:59.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:49:58 smithi157 bash[24585]: cluster 2024-09-16T08:49:57.907035+0000 mgr.a (mgr.14373) 8344 : cluster [DBG] pgmap v5785: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:49:59.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:49:58 smithi086 bash[24289]: audit 2024-09-16T08:49:57.337440+0000 mgr.a (mgr.14373) 8342 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T08:49:59.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:49:58 smithi086 bash[24289]: cephadm 2024-09-16T08:49:57.339172+0000 mgr.a (mgr.14373) 8343 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T08:49:59.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:49:58 smithi086 bash[24289]: cluster 2024-09-16T08:49:57.907035+0000 mgr.a (mgr.14373) 8344 : cluster [DBG] pgmap v5785: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:49:59.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:49:58 smithi047 bash[22744]: audit 2024-09-16T08:49:57.337440+0000 mgr.a (mgr.14373) 8342 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T08:49:59.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:49:58 smithi047 bash[22744]: cephadm 2024-09-16T08:49:57.339172+0000 mgr.a (mgr.14373) 8343 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T08:49:59.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:49:58 smithi047 bash[22744]: cluster 2024-09-16T08:49:57.907035+0000 mgr.a (mgr.14373) 8344 : cluster [DBG] pgmap v5785: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:50:00.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:49:59 smithi157 bash[24585]: cluster 2024-09-16T08:49:59.907787+0000 mgr.a (mgr.14373) 8345 : cluster [DBG] pgmap v5786: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:50:00.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:49:59 smithi086 bash[24289]: cluster 2024-09-16T08:49:59.907787+0000 mgr.a (mgr.14373) 8345 : cluster [DBG] pgmap v5786: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:50:00.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:49:59 smithi047 bash[22744]: cluster 2024-09-16T08:49:59.907787+0000 mgr.a (mgr.14373) 8345 : cluster [DBG] pgmap v5786: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:50:01.112 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:50:01.113 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:50:01.113 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:50:01.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:50:00 smithi157 bash[24585]: cluster 2024-09-16T08:50:00.000145+0000 mon.a (mon.0) 1069 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-16T08:50:01.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:50:00 smithi086 bash[24289]: cluster 2024-09-16T08:50:00.000145+0000 mon.a (mon.0) 1069 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-16T08:50:01.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:50:00 smithi047 bash[22744]: cluster 2024-09-16T08:50:00.000145+0000 mon.a (mon.0) 1069 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-16T08:50:01.841 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:50:01.841 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:50:01.841 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:50:01.841 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:50:01.841 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:50:02.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:50:01 smithi157 bash[24585]: audit 2024-09-16T08:50:01.444981+0000 mgr.a (mgr.14373) 8346 : audit [DBG] from='client.186768 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:50:02.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:50:01 smithi157 bash[24585]: cluster 2024-09-16T08:50:01.910521+0000 mgr.a (mgr.14373) 8347 : cluster [DBG] pgmap v5787: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:50:02.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:50:01 smithi086 bash[24289]: audit 2024-09-16T08:50:01.444981+0000 mgr.a (mgr.14373) 8346 : audit [DBG] from='client.186768 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:50:02.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:50:01 smithi086 bash[24289]: cluster 2024-09-16T08:50:01.910521+0000 mgr.a (mgr.14373) 8347 : cluster [DBG] pgmap v5787: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:50:02.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:50:01 smithi047 bash[22744]: audit 2024-09-16T08:50:01.444981+0000 mgr.a (mgr.14373) 8346 : audit [DBG] from='client.186768 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:50:02.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:50:01 smithi047 bash[22744]: cluster 2024-09-16T08:50:01.910521+0000 mgr.a (mgr.14373) 8347 : cluster [DBG] pgmap v5787: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:50:04.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:50:03 smithi157 bash[24585]: cluster 2024-09-16T08:50:03.911247+0000 mgr.a (mgr.14373) 8348 : cluster [DBG] pgmap v5788: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 425 B/s wr, 6 op/s 2024-09-16T08:50:04.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:50:03 smithi086 bash[24289]: cluster 2024-09-16T08:50:03.911247+0000 mgr.a (mgr.14373) 8348 : cluster [DBG] pgmap v5788: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 425 B/s wr, 6 op/s 2024-09-16T08:50:04.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:50:03 smithi047 bash[22744]: cluster 2024-09-16T08:50:03.911247+0000 mgr.a (mgr.14373) 8348 : cluster [DBG] pgmap v5788: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 425 B/s wr, 6 op/s 2024-09-16T08:50:06.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:50:05 smithi157 bash[24585]: cluster 2024-09-16T08:50:05.911986+0000 mgr.a (mgr.14373) 8349 : cluster [DBG] pgmap v5789: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T08:50:06.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:50:05 smithi086 bash[24289]: cluster 2024-09-16T08:50:05.911986+0000 mgr.a (mgr.14373) 8349 : cluster [DBG] pgmap v5789: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T08:50:06.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:50:05 smithi047 bash[22744]: cluster 2024-09-16T08:50:05.911986+0000 mgr.a (mgr.14373) 8349 : cluster [DBG] pgmap v5789: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T08:50:06.842 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:50:06.843 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:50:06.843 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:50:07.618 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:50:07.618 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:50:07.619 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:50:07.619 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:50:07.619 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:50:08.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:50:07 smithi157 bash[24585]: audit 2024-09-16T08:50:07.181042+0000 mgr.a (mgr.14373) 8350 : audit [DBG] from='client.186843 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:50:08.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:50:07 smithi157 bash[24585]: cluster 2024-09-16T08:50:07.914724+0000 mgr.a (mgr.14373) 8351 : cluster [DBG] pgmap v5790: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:50:08.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:50:07 smithi086 bash[24289]: audit 2024-09-16T08:50:07.181042+0000 mgr.a (mgr.14373) 8350 : audit [DBG] from='client.186843 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:50:08.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:50:07 smithi086 bash[24289]: cluster 2024-09-16T08:50:07.914724+0000 mgr.a (mgr.14373) 8351 : cluster [DBG] pgmap v5790: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:50:08.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:50:07 smithi047 bash[22744]: audit 2024-09-16T08:50:07.181042+0000 mgr.a (mgr.14373) 8350 : audit [DBG] from='client.186843 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:50:08.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:50:07 smithi047 bash[22744]: cluster 2024-09-16T08:50:07.914724+0000 mgr.a (mgr.14373) 8351 : cluster [DBG] pgmap v5790: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:50:10.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:50:09 smithi157 bash[24585]: cluster 2024-09-16T08:50:09.915482+0000 mgr.a (mgr.14373) 8352 : cluster [DBG] pgmap v5791: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T08:50:10.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:50:09 smithi086 bash[24289]: cluster 2024-09-16T08:50:09.915482+0000 mgr.a (mgr.14373) 8352 : cluster [DBG] pgmap v5791: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T08:50:10.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:50:09 smithi047 bash[22744]: cluster 2024-09-16T08:50:09.915482+0000 mgr.a (mgr.14373) 8352 : cluster [DBG] pgmap v5791: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T08:50:12.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:50:11 smithi157 bash[24585]: cluster 2024-09-16T08:50:11.917404+0000 mgr.a (mgr.14373) 8353 : cluster [DBG] pgmap v5792: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:50:12.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:50:11 smithi086 bash[24289]: cluster 2024-09-16T08:50:11.917404+0000 mgr.a (mgr.14373) 8353 : cluster [DBG] pgmap v5792: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:50:12.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:50:11 smithi047 bash[22744]: cluster 2024-09-16T08:50:11.917404+0000 mgr.a (mgr.14373) 8353 : cluster [DBG] pgmap v5792: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:50:12.620 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:50:12.621 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:50:12.621 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:50:13.372 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:50:13.373 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:50:13.373 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:50:13.373 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:50:13.373 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:50:14.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:50:13 smithi157 bash[24585]: audit 2024-09-16T08:50:12.954498+0000 mgr.a (mgr.14373) 8354 : audit [DBG] from='client.186921 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:50:14.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:50:13 smithi157 bash[24585]: cluster 2024-09-16T08:50:13.918285+0000 mgr.a (mgr.14373) 8355 : cluster [DBG] pgmap v5793: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:50:14.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:50:13 smithi086 bash[24289]: audit 2024-09-16T08:50:12.954498+0000 mgr.a (mgr.14373) 8354 : audit [DBG] from='client.186921 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:50:14.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:50:13 smithi086 bash[24289]: cluster 2024-09-16T08:50:13.918285+0000 mgr.a (mgr.14373) 8355 : cluster [DBG] pgmap v5793: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:50:14.546 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:50:13 smithi047 bash[22744]: audit 2024-09-16T08:50:12.954498+0000 mgr.a (mgr.14373) 8354 : audit [DBG] from='client.186921 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:50:14.547 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:50:13 smithi047 bash[22744]: cluster 2024-09-16T08:50:13.918285+0000 mgr.a (mgr.14373) 8355 : cluster [DBG] pgmap v5793: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:50:16.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:50:15 smithi157 bash[24585]: cluster 2024-09-16T08:50:15.919050+0000 mgr.a (mgr.14373) 8356 : cluster [DBG] pgmap v5794: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:50:16.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:50:15 smithi086 bash[24289]: cluster 2024-09-16T08:50:15.919050+0000 mgr.a (mgr.14373) 8356 : cluster [DBG] pgmap v5794: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:50:16.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:50:15 smithi047 bash[22744]: cluster 2024-09-16T08:50:15.919050+0000 mgr.a (mgr.14373) 8356 : cluster [DBG] pgmap v5794: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:50:18.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:50:17 smithi157 bash[24585]: cluster 2024-09-16T08:50:17.921268+0000 mgr.a (mgr.14373) 8357 : cluster [DBG] pgmap v5795: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:50:18.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:50:17 smithi086 bash[24289]: cluster 2024-09-16T08:50:17.921268+0000 mgr.a (mgr.14373) 8357 : cluster [DBG] pgmap v5795: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:50:18.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:50:17 smithi047 bash[22744]: cluster 2024-09-16T08:50:17.921268+0000 mgr.a (mgr.14373) 8357 : cluster [DBG] pgmap v5795: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:50:18.374 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:50:18.375 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:50:18.375 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:50:19.140 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:50:19.140 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:50:19.141 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:50:19.141 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:50:19.141 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:50:19.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:50:18 smithi157 bash[24585]: audit 2024-09-16T08:50:18.711913+0000 mgr.a (mgr.14373) 8358 : audit [DBG] from='client.186999 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:50:19.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:50:18 smithi086 bash[24289]: audit 2024-09-16T08:50:18.711913+0000 mgr.a (mgr.14373) 8358 : audit [DBG] from='client.186999 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:50:19.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:50:18 smithi047 bash[22744]: audit 2024-09-16T08:50:18.711913+0000 mgr.a (mgr.14373) 8358 : audit [DBG] from='client.186999 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:50:20.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:50:20 smithi157 bash[24585]: cluster 2024-09-16T08:50:19.922174+0000 mgr.a (mgr.14373) 8359 : cluster [DBG] pgmap v5796: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:50:20.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:50:19 smithi086 bash[24289]: cluster 2024-09-16T08:50:19.922174+0000 mgr.a (mgr.14373) 8359 : cluster [DBG] pgmap v5796: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:50:20.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:50:20 smithi047 bash[22744]: cluster 2024-09-16T08:50:19.922174+0000 mgr.a (mgr.14373) 8359 : cluster [DBG] pgmap v5796: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:50:22.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:50:21 smithi157 bash[24585]: cluster 2024-09-16T08:50:21.924349+0000 mgr.a (mgr.14373) 8360 : cluster [DBG] pgmap v5797: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:50:22.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:50:21 smithi086 bash[24289]: cluster 2024-09-16T08:50:21.924349+0000 mgr.a (mgr.14373) 8360 : cluster [DBG] pgmap v5797: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:50:22.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:50:21 smithi047 bash[22744]: cluster 2024-09-16T08:50:21.924349+0000 mgr.a (mgr.14373) 8360 : cluster [DBG] pgmap v5797: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:50:24.142 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:50:24.142 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:50:24.143 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:50:24.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:50:23 smithi157 bash[24585]: cluster 2024-09-16T08:50:23.925082+0000 mgr.a (mgr.14373) 8361 : cluster [DBG] pgmap v5798: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:50:24.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:50:23 smithi086 bash[24289]: cluster 2024-09-16T08:50:23.925082+0000 mgr.a (mgr.14373) 8361 : cluster [DBG] pgmap v5798: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:50:24.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:50:23 smithi047 bash[22744]: cluster 2024-09-16T08:50:23.925082+0000 mgr.a (mgr.14373) 8361 : cluster [DBG] pgmap v5798: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:50:24.895 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:50:24.895 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:50:24.895 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:50:24.895 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:50:24.895 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:50:25.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:50:24 smithi157 bash[24585]: audit 2024-09-16T08:50:24.477583+0000 mgr.a (mgr.14373) 8362 : audit [DBG] from='client.187074 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:50:25.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:50:24 smithi086 bash[24289]: audit 2024-09-16T08:50:24.477583+0000 mgr.a (mgr.14373) 8362 : audit [DBG] from='client.187074 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:50:25.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:50:24 smithi047 bash[22744]: audit 2024-09-16T08:50:24.477583+0000 mgr.a (mgr.14373) 8362 : audit [DBG] from='client.187074 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:50:26.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:50:26 smithi157 bash[24585]: cluster 2024-09-16T08:50:25.925907+0000 mgr.a (mgr.14373) 8363 : cluster [DBG] pgmap v5799: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:50:26.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:50:26 smithi086 bash[24289]: cluster 2024-09-16T08:50:25.925907+0000 mgr.a (mgr.14373) 8363 : cluster [DBG] pgmap v5799: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:50:26.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:50:26 smithi047 bash[22744]: cluster 2024-09-16T08:50:25.925907+0000 mgr.a (mgr.14373) 8363 : cluster [DBG] pgmap v5799: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:50:28.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:50:27 smithi157 bash[24585]: cluster 2024-09-16T08:50:27.928146+0000 mgr.a (mgr.14373) 8364 : cluster [DBG] pgmap v5800: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:50:28.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:50:27 smithi086 bash[24289]: cluster 2024-09-16T08:50:27.928146+0000 mgr.a (mgr.14373) 8364 : cluster [DBG] pgmap v5800: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:50:28.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:50:27 smithi047 bash[22744]: cluster 2024-09-16T08:50:27.928146+0000 mgr.a (mgr.14373) 8364 : cluster [DBG] pgmap v5800: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:50:29.897 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:50:29.897 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:50:29.898 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:50:30.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:50:29 smithi157 bash[24585]: cluster 2024-09-16T08:50:29.928728+0000 mgr.a (mgr.14373) 8365 : cluster [DBG] pgmap v5801: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:50:30.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:50:29 smithi086 bash[24289]: cluster 2024-09-16T08:50:29.928728+0000 mgr.a (mgr.14373) 8365 : cluster [DBG] pgmap v5801: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:50:30.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:50:29 smithi047 bash[22744]: cluster 2024-09-16T08:50:29.928728+0000 mgr.a (mgr.14373) 8365 : cluster [DBG] pgmap v5801: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:50:30.678 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:50:30.678 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:50:30.678 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:50:30.679 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:50:30.679 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:50:31.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:50:30 smithi157 bash[24585]: audit 2024-09-16T08:50:30.241224+0000 mgr.a (mgr.14373) 8366 : audit [DBG] from='client.187146 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:50:31.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:50:30 smithi086 bash[24289]: audit 2024-09-16T08:50:30.241224+0000 mgr.a (mgr.14373) 8366 : audit [DBG] from='client.187146 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:50:31.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:50:30 smithi047 bash[22744]: audit 2024-09-16T08:50:30.241224+0000 mgr.a (mgr.14373) 8366 : audit [DBG] from='client.187146 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:50:32.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:50:32 smithi157 bash[24585]: cluster 2024-09-16T08:50:31.931022+0000 mgr.a (mgr.14373) 8367 : cluster [DBG] pgmap v5802: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:50:32.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:50:32 smithi086 bash[24289]: cluster 2024-09-16T08:50:31.931022+0000 mgr.a (mgr.14373) 8367 : cluster [DBG] pgmap v5802: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:50:32.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:50:32 smithi047 bash[22744]: cluster 2024-09-16T08:50:31.931022+0000 mgr.a (mgr.14373) 8367 : cluster [DBG] pgmap v5802: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:50:34.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:50:33 smithi157 bash[24585]: cluster 2024-09-16T08:50:33.931727+0000 mgr.a (mgr.14373) 8368 : cluster [DBG] pgmap v5803: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:50:34.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:50:33 smithi086 bash[24289]: cluster 2024-09-16T08:50:33.931727+0000 mgr.a (mgr.14373) 8368 : cluster [DBG] pgmap v5803: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:50:34.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:50:33 smithi047 bash[22744]: cluster 2024-09-16T08:50:33.931727+0000 mgr.a (mgr.14373) 8368 : cluster [DBG] pgmap v5803: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:50:35.680 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:50:35.681 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:50:35.681 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:50:36.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:50:35 smithi157 bash[24585]: cluster 2024-09-16T08:50:35.932251+0000 mgr.a (mgr.14373) 8369 : cluster [DBG] pgmap v5804: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:50:36.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:50:35 smithi086 bash[24289]: cluster 2024-09-16T08:50:35.932251+0000 mgr.a (mgr.14373) 8369 : cluster [DBG] pgmap v5804: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:50:36.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:50:35 smithi047 bash[22744]: cluster 2024-09-16T08:50:35.932251+0000 mgr.a (mgr.14373) 8369 : cluster [DBG] pgmap v5804: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:50:36.467 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:50:36.467 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:50:36.467 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:50:36.467 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:50:36.467 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:50:37.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:50:36 smithi157 bash[24585]: audit 2024-09-16T08:50:36.020351+0000 mgr.a (mgr.14373) 8370 : audit [DBG] from='client.187221 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:50:37.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:50:36 smithi086 bash[24289]: audit 2024-09-16T08:50:36.020351+0000 mgr.a (mgr.14373) 8370 : audit [DBG] from='client.187221 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:50:37.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:50:36 smithi047 bash[22744]: audit 2024-09-16T08:50:36.020351+0000 mgr.a (mgr.14373) 8370 : audit [DBG] from='client.187221 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:50:38.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:50:38 smithi157 bash[24585]: cluster 2024-09-16T08:50:37.934686+0000 mgr.a (mgr.14373) 8371 : cluster [DBG] pgmap v5805: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:50:38.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:50:38 smithi086 bash[24289]: cluster 2024-09-16T08:50:37.934686+0000 mgr.a (mgr.14373) 8371 : cluster [DBG] pgmap v5805: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:50:38.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:50:38 smithi047 bash[22744]: cluster 2024-09-16T08:50:37.934686+0000 mgr.a (mgr.14373) 8371 : cluster [DBG] pgmap v5805: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:50:40.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:50:39 smithi157 bash[24585]: cluster 2024-09-16T08:50:39.935556+0000 mgr.a (mgr.14373) 8372 : cluster [DBG] pgmap v5806: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:50:40.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:50:39 smithi086 bash[24289]: cluster 2024-09-16T08:50:39.935556+0000 mgr.a (mgr.14373) 8372 : cluster [DBG] pgmap v5806: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:50:40.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:50:39 smithi047 bash[22744]: cluster 2024-09-16T08:50:39.935556+0000 mgr.a (mgr.14373) 8372 : cluster [DBG] pgmap v5806: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:50:41.468 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:50:41.469 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:50:41.469 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:50:42.221 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:50:42.221 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:50:42.221 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:50:42.221 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:50:42.222 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:50:42.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:50:42 smithi157 bash[24585]: audit 2024-09-16T08:50:41.805682+0000 mgr.a (mgr.14373) 8373 : audit [DBG] from='client.187299 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:50:42.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:50:42 smithi157 bash[24585]: cluster 2024-09-16T08:50:41.941456+0000 mgr.a (mgr.14373) 8374 : cluster [DBG] pgmap v5807: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:50:42.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:50:41 smithi086 bash[24289]: audit 2024-09-16T08:50:41.805682+0000 mgr.a (mgr.14373) 8373 : audit [DBG] from='client.187299 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:50:42.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:50:41 smithi086 bash[24289]: cluster 2024-09-16T08:50:41.941456+0000 mgr.a (mgr.14373) 8374 : cluster [DBG] pgmap v5807: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:50:42.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:50:42 smithi047 bash[22744]: audit 2024-09-16T08:50:41.805682+0000 mgr.a (mgr.14373) 8373 : audit [DBG] from='client.187299 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:50:42.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:50:42 smithi047 bash[22744]: cluster 2024-09-16T08:50:41.941456+0000 mgr.a (mgr.14373) 8374 : cluster [DBG] pgmap v5807: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:50:44.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:50:44 smithi157 bash[24585]: cluster 2024-09-16T08:50:43.942337+0000 mgr.a (mgr.14373) 8375 : cluster [DBG] pgmap v5808: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:50:44.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:50:44 smithi086 bash[24289]: cluster 2024-09-16T08:50:43.942337+0000 mgr.a (mgr.14373) 8375 : cluster [DBG] pgmap v5808: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:50:44.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:50:44 smithi047 bash[22744]: cluster 2024-09-16T08:50:43.942337+0000 mgr.a (mgr.14373) 8375 : cluster [DBG] pgmap v5808: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:50:47.223 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:50:47.223 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:50:47.224 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:50:47.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:50:47 smithi157 bash[24585]: cluster 2024-09-16T08:50:45.943100+0000 mgr.a (mgr.14373) 8376 : cluster [DBG] pgmap v5809: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:50:47.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:50:46 smithi086 bash[24289]: cluster 2024-09-16T08:50:45.943100+0000 mgr.a (mgr.14373) 8376 : cluster [DBG] pgmap v5809: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:50:47.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:50:47 smithi047 bash[22744]: cluster 2024-09-16T08:50:45.943100+0000 mgr.a (mgr.14373) 8376 : cluster [DBG] pgmap v5809: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:50:47.998 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:50:47.998 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:50:47.998 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:50:47.998 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:50:47.998 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:50:48.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:50:48 smithi157 bash[24585]: audit 2024-09-16T08:50:47.559384+0000 mgr.a (mgr.14373) 8377 : audit [DBG] from='client.187371 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:50:48.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:50:48 smithi086 bash[24289]: audit 2024-09-16T08:50:47.559384+0000 mgr.a (mgr.14373) 8377 : audit [DBG] from='client.187371 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:50:48.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:50:48 smithi047 bash[22744]: audit 2024-09-16T08:50:47.559384+0000 mgr.a (mgr.14373) 8377 : audit [DBG] from='client.187371 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:50:49.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:50:49 smithi157 bash[24585]: cluster 2024-09-16T08:50:47.944546+0000 mgr.a (mgr.14373) 8378 : cluster [DBG] pgmap v5810: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:50:49.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:50:49 smithi086 bash[24289]: cluster 2024-09-16T08:50:47.944546+0000 mgr.a (mgr.14373) 8378 : cluster [DBG] pgmap v5810: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:50:49.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:50:49 smithi047 bash[22744]: cluster 2024-09-16T08:50:47.944546+0000 mgr.a (mgr.14373) 8378 : cluster [DBG] pgmap v5810: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:50:51.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:50:51 smithi157 bash[24585]: cluster 2024-09-16T08:50:49.945237+0000 mgr.a (mgr.14373) 8379 : cluster [DBG] pgmap v5811: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:50:51.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:50:51 smithi086 bash[24289]: cluster 2024-09-16T08:50:49.945237+0000 mgr.a (mgr.14373) 8379 : cluster [DBG] pgmap v5811: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:50:51.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:50:51 smithi047 bash[22744]: cluster 2024-09-16T08:50:49.945237+0000 mgr.a (mgr.14373) 8379 : cluster [DBG] pgmap v5811: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:50:52.999 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:50:53.000 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:50:53.000 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:50:53.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:50:53 smithi157 bash[24585]: cluster 2024-09-16T08:50:51.947209+0000 mgr.a (mgr.14373) 8380 : cluster [DBG] pgmap v5812: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:50:53.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:50:53 smithi086 bash[24289]: cluster 2024-09-16T08:50:51.947209+0000 mgr.a (mgr.14373) 8380 : cluster [DBG] pgmap v5812: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:50:53.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:50:53 smithi047 bash[22744]: cluster 2024-09-16T08:50:51.947209+0000 mgr.a (mgr.14373) 8380 : cluster [DBG] pgmap v5812: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:50:53.747 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:50:53.747 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:50:53.748 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:50:53.748 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:50:53.748 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:50:54.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:50:54 smithi157 bash[24585]: audit 2024-09-16T08:50:53.330124+0000 mgr.a (mgr.14373) 8381 : audit [DBG] from='client.187446 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:50:54.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:50:54 smithi086 bash[24289]: audit 2024-09-16T08:50:53.330124+0000 mgr.a (mgr.14373) 8381 : audit [DBG] from='client.187446 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:50:54.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:50:54 smithi047 bash[22744]: audit 2024-09-16T08:50:53.330124+0000 mgr.a (mgr.14373) 8381 : audit [DBG] from='client.187446 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:50:55.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:50:55 smithi157 bash[24585]: cluster 2024-09-16T08:50:53.948126+0000 mgr.a (mgr.14373) 8382 : cluster [DBG] pgmap v5813: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:50:55.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:50:55 smithi086 bash[24289]: cluster 2024-09-16T08:50:53.948126+0000 mgr.a (mgr.14373) 8382 : cluster [DBG] pgmap v5813: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:50:55.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:50:55 smithi047 bash[22744]: cluster 2024-09-16T08:50:53.948126+0000 mgr.a (mgr.14373) 8382 : cluster [DBG] pgmap v5813: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:50:57.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:50:57 smithi157 bash[24585]: cluster 2024-09-16T08:50:55.948903+0000 mgr.a (mgr.14373) 8383 : cluster [DBG] pgmap v5814: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:50:57.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:50:57 smithi086 bash[24289]: cluster 2024-09-16T08:50:55.948903+0000 mgr.a (mgr.14373) 8383 : cluster [DBG] pgmap v5814: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:50:57.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:50:57 smithi047 bash[22744]: cluster 2024-09-16T08:50:55.948903+0000 mgr.a (mgr.14373) 8383 : cluster [DBG] pgmap v5814: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:50:58.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:50:58 smithi157 bash[24585]: audit 2024-09-16T08:50:57.389005+0000 mon.b (mon.2) 786 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T08:50:58.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:50:58 smithi086 bash[24289]: audit 2024-09-16T08:50:57.389005+0000 mon.b (mon.2) 786 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T08:50:58.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:50:58 smithi047 bash[22744]: audit 2024-09-16T08:50:57.389005+0000 mon.b (mon.2) 786 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T08:50:58.748 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:50:58.749 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:50:58.749 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:50:59.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:50:59 smithi157 bash[24585]: cluster 2024-09-16T08:50:57.950092+0000 mgr.a (mgr.14373) 8384 : cluster [DBG] pgmap v5815: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:50:59.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:50:59 smithi157 bash[24585]: audit 2024-09-16T08:50:58.229821+0000 mon.b (mon.2) 787 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T08:50:59.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:50:59 smithi157 bash[24585]: audit 2024-09-16T08:50:58.231984+0000 mon.b (mon.2) 788 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T08:50:59.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:50:59 smithi157 bash[24585]: audit 2024-09-16T08:50:58.245960+0000 mon.a (mon.0) 1070 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:50:59.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:50:59 smithi157 bash[24585]: audit 2024-09-16T08:50:58.249613+0000 mon.b (mon.2) 789 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:50:59.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:50:59 smithi157 bash[24585]: audit 2024-09-16T08:50:58.253990+0000 mgr.a (mgr.14373) 8385 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:50:59.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:50:59 smithi086 bash[24289]: cluster 2024-09-16T08:50:57.950092+0000 mgr.a (mgr.14373) 8384 : cluster [DBG] pgmap v5815: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:50:59.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:50:59 smithi086 bash[24289]: audit 2024-09-16T08:50:58.229821+0000 mon.b (mon.2) 787 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T08:50:59.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:50:59 smithi086 bash[24289]: audit 2024-09-16T08:50:58.231984+0000 mon.b (mon.2) 788 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T08:50:59.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:50:59 smithi086 bash[24289]: audit 2024-09-16T08:50:58.245960+0000 mon.a (mon.0) 1070 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:50:59.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:50:59 smithi086 bash[24289]: audit 2024-09-16T08:50:58.249613+0000 mon.b (mon.2) 789 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:50:59.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:50:59 smithi086 bash[24289]: audit 2024-09-16T08:50:58.253990+0000 mgr.a (mgr.14373) 8385 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:50:59.338 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 08:50:59 smithi047 bash[22994]: debug 2024-09-16T08:50:58.996+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T08:50:59.338 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 08:50:59 smithi047 bash[22994]: debug 2024-09-16T08:50:58.996+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T08:50:59.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:50:59 smithi047 bash[22744]: cluster 2024-09-16T08:50:57.950092+0000 mgr.a (mgr.14373) 8384 : cluster [DBG] pgmap v5815: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:50:59.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:50:59 smithi047 bash[22744]: audit 2024-09-16T08:50:58.229821+0000 mon.b (mon.2) 787 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T08:50:59.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:50:59 smithi047 bash[22744]: audit 2024-09-16T08:50:58.231984+0000 mon.b (mon.2) 788 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T08:50:59.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:50:59 smithi047 bash[22744]: audit 2024-09-16T08:50:58.245960+0000 mon.a (mon.0) 1070 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:50:59.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:50:59 smithi047 bash[22744]: audit 2024-09-16T08:50:58.249613+0000 mon.b (mon.2) 789 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:50:59.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:50:59 smithi047 bash[22744]: audit 2024-09-16T08:50:58.253990+0000 mgr.a (mgr.14373) 8385 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:50:59.481 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:50:59.481 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:50:59.481 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:50:59.481 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:50:59.481 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:51:00.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:51:00 smithi157 bash[24585]: audit 2024-09-16T08:50:59.000016+0000 mgr.a (mgr.14373) 8386 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T08:51:00.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:51:00 smithi157 bash[24585]: cephadm 2024-09-16T08:50:59.001669+0000 mgr.a (mgr.14373) 8387 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T08:51:00.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:51:00 smithi157 bash[24585]: audit 2024-09-16T08:50:59.083044+0000 mgr.a (mgr.14373) 8388 : audit [DBG] from='client.187608 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:51:00.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:51:00 smithi086 bash[24289]: audit 2024-09-16T08:50:59.000016+0000 mgr.a (mgr.14373) 8386 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T08:51:00.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:51:00 smithi086 bash[24289]: cephadm 2024-09-16T08:50:59.001669+0000 mgr.a (mgr.14373) 8387 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T08:51:00.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:51:00 smithi086 bash[24289]: audit 2024-09-16T08:50:59.083044+0000 mgr.a (mgr.14373) 8388 : audit [DBG] from='client.187608 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:51:00.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:51:00 smithi047 bash[22744]: audit 2024-09-16T08:50:59.000016+0000 mgr.a (mgr.14373) 8386 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T08:51:00.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:51:00 smithi047 bash[22744]: cephadm 2024-09-16T08:50:59.001669+0000 mgr.a (mgr.14373) 8387 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T08:51:00.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:51:00 smithi047 bash[22744]: audit 2024-09-16T08:50:59.083044+0000 mgr.a (mgr.14373) 8388 : audit [DBG] from='client.187608 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:51:01.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:51:01 smithi157 bash[24585]: cluster 2024-09-16T08:50:59.951170+0000 mgr.a (mgr.14373) 8389 : cluster [DBG] pgmap v5816: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:51:01.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:51:01 smithi086 bash[24289]: cluster 2024-09-16T08:50:59.951170+0000 mgr.a (mgr.14373) 8389 : cluster [DBG] pgmap v5816: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:51:01.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:51:01 smithi047 bash[22744]: cluster 2024-09-16T08:50:59.951170+0000 mgr.a (mgr.14373) 8389 : cluster [DBG] pgmap v5816: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:51:03.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:51:03 smithi086 bash[24289]: cluster 2024-09-16T08:51:01.953473+0000 mgr.a (mgr.14373) 8390 : cluster [DBG] pgmap v5817: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:51:03.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:51:03 smithi047 bash[22744]: cluster 2024-09-16T08:51:01.953473+0000 mgr.a (mgr.14373) 8390 : cluster [DBG] pgmap v5817: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:51:03.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:51:03 smithi157 bash[24585]: cluster 2024-09-16T08:51:01.953473+0000 mgr.a (mgr.14373) 8390 : cluster [DBG] pgmap v5817: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:51:04.482 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:51:04.483 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:51:04.483 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:51:05.239 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:51:05.240 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:51:05.240 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:51:05.240 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:51:05.240 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:51:05.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:51:05 smithi086 bash[24289]: cluster 2024-09-16T08:51:03.954436+0000 mgr.a (mgr.14373) 8391 : cluster [DBG] pgmap v5818: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:51:05.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:51:05 smithi086 bash[24289]: audit 2024-09-16T08:51:04.812679+0000 mgr.a (mgr.14373) 8392 : audit [DBG] from='client.187698 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:51:05.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:51:05 smithi047 bash[22744]: cluster 2024-09-16T08:51:03.954436+0000 mgr.a (mgr.14373) 8391 : cluster [DBG] pgmap v5818: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:51:05.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:51:05 smithi047 bash[22744]: audit 2024-09-16T08:51:04.812679+0000 mgr.a (mgr.14373) 8392 : audit [DBG] from='client.187698 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:51:05.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:51:05 smithi157 bash[24585]: cluster 2024-09-16T08:51:03.954436+0000 mgr.a (mgr.14373) 8391 : cluster [DBG] pgmap v5818: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:51:05.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:51:05 smithi157 bash[24585]: audit 2024-09-16T08:51:04.812679+0000 mgr.a (mgr.14373) 8392 : audit [DBG] from='client.187698 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:51:07.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:51:07 smithi086 bash[24289]: cluster 2024-09-16T08:51:05.955453+0000 mgr.a (mgr.14373) 8393 : cluster [DBG] pgmap v5819: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:51:07.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:51:07 smithi047 bash[22744]: cluster 2024-09-16T08:51:05.955453+0000 mgr.a (mgr.14373) 8393 : cluster [DBG] pgmap v5819: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:51:07.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:51:07 smithi157 bash[24585]: cluster 2024-09-16T08:51:05.955453+0000 mgr.a (mgr.14373) 8393 : cluster [DBG] pgmap v5819: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:51:09.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:51:09 smithi086 bash[24289]: cluster 2024-09-16T08:51:07.957694+0000 mgr.a (mgr.14373) 8394 : cluster [DBG] pgmap v5820: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:51:09.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:51:09 smithi047 bash[22744]: cluster 2024-09-16T08:51:07.957694+0000 mgr.a (mgr.14373) 8394 : cluster [DBG] pgmap v5820: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:51:09.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:51:09 smithi157 bash[24585]: cluster 2024-09-16T08:51:07.957694+0000 mgr.a (mgr.14373) 8394 : cluster [DBG] pgmap v5820: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:51:10.240 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:51:10.241 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:51:10.241 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:51:10.999 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:51:10.999 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:51:10.999 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:51:10.999 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:51:10.999 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:51:11.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:51:11 smithi047 bash[22744]: cluster 2024-09-16T08:51:09.958495+0000 mgr.a (mgr.14373) 8395 : cluster [DBG] pgmap v5821: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:51:11.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:51:11 smithi047 bash[22744]: audit 2024-09-16T08:51:10.577814+0000 mgr.a (mgr.14373) 8396 : audit [DBG] from='client.187776 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:51:11.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:51:11 smithi157 bash[24585]: cluster 2024-09-16T08:51:09.958495+0000 mgr.a (mgr.14373) 8395 : cluster [DBG] pgmap v5821: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:51:11.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:51:11 smithi157 bash[24585]: audit 2024-09-16T08:51:10.577814+0000 mgr.a (mgr.14373) 8396 : audit [DBG] from='client.187776 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:51:11.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:51:11 smithi086 bash[24289]: cluster 2024-09-16T08:51:09.958495+0000 mgr.a (mgr.14373) 8395 : cluster [DBG] pgmap v5821: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:51:11.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:51:11 smithi086 bash[24289]: audit 2024-09-16T08:51:10.577814+0000 mgr.a (mgr.14373) 8396 : audit [DBG] from='client.187776 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:51:13.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:51:13 smithi047 bash[22744]: cluster 2024-09-16T08:51:11.960826+0000 mgr.a (mgr.14373) 8397 : cluster [DBG] pgmap v5822: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:51:13.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:51:13 smithi157 bash[24585]: cluster 2024-09-16T08:51:11.960826+0000 mgr.a (mgr.14373) 8397 : cluster [DBG] pgmap v5822: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:51:13.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:51:13 smithi086 bash[24289]: cluster 2024-09-16T08:51:11.960826+0000 mgr.a (mgr.14373) 8397 : cluster [DBG] pgmap v5822: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:51:15.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:51:15 smithi047 bash[22744]: cluster 2024-09-16T08:51:13.961619+0000 mgr.a (mgr.14373) 8398 : cluster [DBG] pgmap v5823: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:51:15.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:51:15 smithi157 bash[24585]: cluster 2024-09-16T08:51:13.961619+0000 mgr.a (mgr.14373) 8398 : cluster [DBG] pgmap v5823: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:51:15.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:51:15 smithi086 bash[24289]: cluster 2024-09-16T08:51:13.961619+0000 mgr.a (mgr.14373) 8398 : cluster [DBG] pgmap v5823: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:51:16.001 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:51:16.001 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:51:16.002 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:51:16.781 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:51:16.781 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:51:16.782 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:51:16.782 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:51:16.782 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:51:17.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:51:17 smithi047 bash[22744]: cluster 2024-09-16T08:51:15.962429+0000 mgr.a (mgr.14373) 8399 : cluster [DBG] pgmap v5824: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:51:17.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:51:17 smithi047 bash[22744]: audit 2024-09-16T08:51:16.341302+0000 mgr.a (mgr.14373) 8400 : audit [DBG] from='client.187848 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:51:17.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:51:17 smithi157 bash[24585]: cluster 2024-09-16T08:51:15.962429+0000 mgr.a (mgr.14373) 8399 : cluster [DBG] pgmap v5824: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:51:17.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:51:17 smithi157 bash[24585]: audit 2024-09-16T08:51:16.341302+0000 mgr.a (mgr.14373) 8400 : audit [DBG] from='client.187848 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:51:17.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:51:17 smithi086 bash[24289]: cluster 2024-09-16T08:51:15.962429+0000 mgr.a (mgr.14373) 8399 : cluster [DBG] pgmap v5824: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:51:17.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:51:17 smithi086 bash[24289]: audit 2024-09-16T08:51:16.341302+0000 mgr.a (mgr.14373) 8400 : audit [DBG] from='client.187848 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:51:19.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:51:19 smithi047 bash[22744]: cluster 2024-09-16T08:51:17.965185+0000 mgr.a (mgr.14373) 8401 : cluster [DBG] pgmap v5825: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:51:19.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:51:19 smithi157 bash[24585]: cluster 2024-09-16T08:51:17.965185+0000 mgr.a (mgr.14373) 8401 : cluster [DBG] pgmap v5825: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:51:19.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:51:19 smithi086 bash[24289]: cluster 2024-09-16T08:51:17.965185+0000 mgr.a (mgr.14373) 8401 : cluster [DBG] pgmap v5825: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:51:21.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:51:21 smithi157 bash[24585]: cluster 2024-09-16T08:51:19.965970+0000 mgr.a (mgr.14373) 8402 : cluster [DBG] pgmap v5826: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:51:21.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:51:21 smithi086 bash[24289]: cluster 2024-09-16T08:51:19.965970+0000 mgr.a (mgr.14373) 8402 : cluster [DBG] pgmap v5826: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:51:21.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:51:21 smithi047 bash[22744]: cluster 2024-09-16T08:51:19.965970+0000 mgr.a (mgr.14373) 8402 : cluster [DBG] pgmap v5826: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:51:21.783 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:51:21.784 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:51:21.784 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:51:22.532 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:51:22.532 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:51:22.532 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:51:22.532 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:51:22.532 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:51:23.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:51:23 smithi157 bash[24585]: cluster 2024-09-16T08:51:21.967936+0000 mgr.a (mgr.14373) 8403 : cluster [DBG] pgmap v5827: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:51:23.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:51:23 smithi157 bash[24585]: audit 2024-09-16T08:51:22.117697+0000 mgr.a (mgr.14373) 8404 : audit [DBG] from='client.187926 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:51:23.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:51:23 smithi086 bash[24289]: cluster 2024-09-16T08:51:21.967936+0000 mgr.a (mgr.14373) 8403 : cluster [DBG] pgmap v5827: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:51:23.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:51:23 smithi086 bash[24289]: audit 2024-09-16T08:51:22.117697+0000 mgr.a (mgr.14373) 8404 : audit [DBG] from='client.187926 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:51:23.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:51:23 smithi047 bash[22744]: cluster 2024-09-16T08:51:21.967936+0000 mgr.a (mgr.14373) 8403 : cluster [DBG] pgmap v5827: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:51:23.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:51:23 smithi047 bash[22744]: audit 2024-09-16T08:51:22.117697+0000 mgr.a (mgr.14373) 8404 : audit [DBG] from='client.187926 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:51:25.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:51:25 smithi157 bash[24585]: cluster 2024-09-16T08:51:23.968886+0000 mgr.a (mgr.14373) 8405 : cluster [DBG] pgmap v5828: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:51:25.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:51:25 smithi086 bash[24289]: cluster 2024-09-16T08:51:23.968886+0000 mgr.a (mgr.14373) 8405 : cluster [DBG] pgmap v5828: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:51:25.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:51:25 smithi047 bash[22744]: cluster 2024-09-16T08:51:23.968886+0000 mgr.a (mgr.14373) 8405 : cluster [DBG] pgmap v5828: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:51:27.533 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:51:27.534 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:51:27.534 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:51:27.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:51:27 smithi157 bash[24585]: cluster 2024-09-16T08:51:25.969645+0000 mgr.a (mgr.14373) 8406 : cluster [DBG] pgmap v5829: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T08:51:27.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:51:27 smithi086 bash[24289]: cluster 2024-09-16T08:51:25.969645+0000 mgr.a (mgr.14373) 8406 : cluster [DBG] pgmap v5829: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T08:51:27.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:51:27 smithi047 bash[22744]: cluster 2024-09-16T08:51:25.969645+0000 mgr.a (mgr.14373) 8406 : cluster [DBG] pgmap v5829: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T08:51:28.278 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:51:28.278 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:51:28.278 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:51:28.278 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:51:28.278 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:51:28.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:51:28 smithi157 bash[24585]: audit 2024-09-16T08:51:27.860440+0000 mgr.a (mgr.14373) 8407 : audit [DBG] from='client.188004 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:51:28.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:51:28 smithi086 bash[24289]: audit 2024-09-16T08:51:27.860440+0000 mgr.a (mgr.14373) 8407 : audit [DBG] from='client.188004 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:51:28.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:51:28 smithi047 bash[22744]: audit 2024-09-16T08:51:27.860440+0000 mgr.a (mgr.14373) 8407 : audit [DBG] from='client.188004 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:51:29.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:51:29 smithi157 bash[24585]: cluster 2024-09-16T08:51:27.971097+0000 mgr.a (mgr.14373) 8408 : cluster [DBG] pgmap v5830: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:51:29.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:51:29 smithi086 bash[24289]: cluster 2024-09-16T08:51:27.971097+0000 mgr.a (mgr.14373) 8408 : cluster [DBG] pgmap v5830: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:51:29.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:51:29 smithi047 bash[22744]: cluster 2024-09-16T08:51:27.971097+0000 mgr.a (mgr.14373) 8408 : cluster [DBG] pgmap v5830: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:51:31.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:51:31 smithi157 bash[24585]: cluster 2024-09-16T08:51:29.971968+0000 mgr.a (mgr.14373) 8409 : cluster [DBG] pgmap v5831: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:51:31.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:51:31 smithi086 bash[24289]: cluster 2024-09-16T08:51:29.971968+0000 mgr.a (mgr.14373) 8409 : cluster [DBG] pgmap v5831: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:51:31.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:51:31 smithi047 bash[22744]: cluster 2024-09-16T08:51:29.971968+0000 mgr.a (mgr.14373) 8409 : cluster [DBG] pgmap v5831: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:51:33.279 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:51:33.280 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:51:33.280 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:51:33.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:51:33 smithi157 bash[24585]: cluster 2024-09-16T08:51:31.974227+0000 mgr.a (mgr.14373) 8410 : cluster [DBG] pgmap v5832: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:51:33.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:51:33 smithi086 bash[24289]: cluster 2024-09-16T08:51:31.974227+0000 mgr.a (mgr.14373) 8410 : cluster [DBG] pgmap v5832: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:51:33.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:51:33 smithi047 bash[22744]: cluster 2024-09-16T08:51:31.974227+0000 mgr.a (mgr.14373) 8410 : cluster [DBG] pgmap v5832: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:51:34.026 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:51:34.026 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:51:34.026 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:51:34.026 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:51:34.026 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:51:34.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:51:34 smithi157 bash[24585]: audit 2024-09-16T08:51:33.611829+0000 mgr.a (mgr.14373) 8411 : audit [DBG] from='client.188082 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:51:34.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:51:34 smithi086 bash[24289]: audit 2024-09-16T08:51:33.611829+0000 mgr.a (mgr.14373) 8411 : audit [DBG] from='client.188082 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:51:34.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:51:34 smithi047 bash[22744]: audit 2024-09-16T08:51:33.611829+0000 mgr.a (mgr.14373) 8411 : audit [DBG] from='client.188082 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:51:35.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:51:35 smithi157 bash[24585]: cluster 2024-09-16T08:51:33.974885+0000 mgr.a (mgr.14373) 8412 : cluster [DBG] pgmap v5833: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:51:35.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:51:35 smithi086 bash[24289]: cluster 2024-09-16T08:51:33.974885+0000 mgr.a (mgr.14373) 8412 : cluster [DBG] pgmap v5833: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:51:35.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:51:35 smithi047 bash[22744]: cluster 2024-09-16T08:51:33.974885+0000 mgr.a (mgr.14373) 8412 : cluster [DBG] pgmap v5833: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:51:37.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:51:37 smithi157 bash[24585]: cluster 2024-09-16T08:51:35.975587+0000 mgr.a (mgr.14373) 8413 : cluster [DBG] pgmap v5834: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:51:37.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:51:37 smithi086 bash[24289]: cluster 2024-09-16T08:51:35.975587+0000 mgr.a (mgr.14373) 8413 : cluster [DBG] pgmap v5834: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:51:37.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:51:37 smithi047 bash[22744]: cluster 2024-09-16T08:51:35.975587+0000 mgr.a (mgr.14373) 8413 : cluster [DBG] pgmap v5834: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:51:39.027 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:51:39.028 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:51:39.028 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:51:39.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:51:39 smithi157 bash[24585]: cluster 2024-09-16T08:51:37.977785+0000 mgr.a (mgr.14373) 8414 : cluster [DBG] pgmap v5835: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:51:39.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:51:39 smithi086 bash[24289]: cluster 2024-09-16T08:51:37.977785+0000 mgr.a (mgr.14373) 8414 : cluster [DBG] pgmap v5835: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:51:39.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:51:39 smithi047 bash[22744]: cluster 2024-09-16T08:51:37.977785+0000 mgr.a (mgr.14373) 8414 : cluster [DBG] pgmap v5835: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:51:39.796 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:51:39.796 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:51:39.797 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:51:39.797 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:51:39.797 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:51:40.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:51:40 smithi157 bash[24585]: audit 2024-09-16T08:51:39.366112+0000 mgr.a (mgr.14373) 8415 : audit [DBG] from='client.188160 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:51:40.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:51:40 smithi086 bash[24289]: audit 2024-09-16T08:51:39.366112+0000 mgr.a (mgr.14373) 8415 : audit [DBG] from='client.188160 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:51:40.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:51:40 smithi047 bash[22744]: audit 2024-09-16T08:51:39.366112+0000 mgr.a (mgr.14373) 8415 : audit [DBG] from='client.188160 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:51:41.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:51:41 smithi157 bash[24585]: cluster 2024-09-16T08:51:39.978737+0000 mgr.a (mgr.14373) 8416 : cluster [DBG] pgmap v5836: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:51:41.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:51:41 smithi086 bash[24289]: cluster 2024-09-16T08:51:39.978737+0000 mgr.a (mgr.14373) 8416 : cluster [DBG] pgmap v5836: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:51:41.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:51:41 smithi047 bash[22744]: cluster 2024-09-16T08:51:39.978737+0000 mgr.a (mgr.14373) 8416 : cluster [DBG] pgmap v5836: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:51:43.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:51:43 smithi157 bash[24585]: cluster 2024-09-16T08:51:41.980837+0000 mgr.a (mgr.14373) 8417 : cluster [DBG] pgmap v5837: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:51:43.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:51:43 smithi086 bash[24289]: cluster 2024-09-16T08:51:41.980837+0000 mgr.a (mgr.14373) 8417 : cluster [DBG] pgmap v5837: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:51:43.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:51:43 smithi047 bash[22744]: cluster 2024-09-16T08:51:41.980837+0000 mgr.a (mgr.14373) 8417 : cluster [DBG] pgmap v5837: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:51:44.798 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:51:44.798 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:51:44.799 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:51:45.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:51:45 smithi157 bash[24585]: cluster 2024-09-16T08:51:43.981596+0000 mgr.a (mgr.14373) 8418 : cluster [DBG] pgmap v5838: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:51:45.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:51:45 smithi086 bash[24289]: cluster 2024-09-16T08:51:43.981596+0000 mgr.a (mgr.14373) 8418 : cluster [DBG] pgmap v5838: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:51:45.583 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:51:45.583 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:51:45.583 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:51:45.583 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:51:45.583 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:51:45.587 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:51:45 smithi047 bash[22744]: cluster 2024-09-16T08:51:43.981596+0000 mgr.a (mgr.14373) 8418 : cluster [DBG] pgmap v5838: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:51:46.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:51:46 smithi157 bash[24585]: audit 2024-09-16T08:51:45.143592+0000 mgr.a (mgr.14373) 8419 : audit [DBG] from='client.188235 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:51:46.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:51:46 smithi086 bash[24289]: audit 2024-09-16T08:51:45.143592+0000 mgr.a (mgr.14373) 8419 : audit [DBG] from='client.188235 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:51:46.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:51:46 smithi047 bash[22744]: audit 2024-09-16T08:51:45.143592+0000 mgr.a (mgr.14373) 8419 : audit [DBG] from='client.188235 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:51:47.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:51:47 smithi157 bash[24585]: cluster 2024-09-16T08:51:45.982570+0000 mgr.a (mgr.14373) 8420 : cluster [DBG] pgmap v5839: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:51:47.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:51:47 smithi086 bash[24289]: cluster 2024-09-16T08:51:45.982570+0000 mgr.a (mgr.14373) 8420 : cluster [DBG] pgmap v5839: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:51:47.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:51:47 smithi047 bash[22744]: cluster 2024-09-16T08:51:45.982570+0000 mgr.a (mgr.14373) 8420 : cluster [DBG] pgmap v5839: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:51:49.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:51:49 smithi157 bash[24585]: cluster 2024-09-16T08:51:47.984756+0000 mgr.a (mgr.14373) 8421 : cluster [DBG] pgmap v5840: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:51:49.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:51:49 smithi086 bash[24289]: cluster 2024-09-16T08:51:47.984756+0000 mgr.a (mgr.14373) 8421 : cluster [DBG] pgmap v5840: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:51:49.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:51:49 smithi047 bash[22744]: cluster 2024-09-16T08:51:47.984756+0000 mgr.a (mgr.14373) 8421 : cluster [DBG] pgmap v5840: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:51:50.584 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:51:50.585 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:51:50.585 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:51:51.338 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:51:51.338 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:51:51.338 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:51:51.338 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:51:51.339 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:51:51.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:51:51 smithi157 bash[24585]: cluster 2024-09-16T08:51:49.985568+0000 mgr.a (mgr.14373) 8422 : cluster [DBG] pgmap v5841: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:51:51.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:51:51 smithi157 bash[24585]: audit 2024-09-16T08:51:50.916789+0000 mgr.a (mgr.14373) 8423 : audit [DBG] from='client.188313 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:51:51.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:51:51 smithi086 bash[24289]: cluster 2024-09-16T08:51:49.985568+0000 mgr.a (mgr.14373) 8422 : cluster [DBG] pgmap v5841: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:51:51.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:51:51 smithi086 bash[24289]: audit 2024-09-16T08:51:50.916789+0000 mgr.a (mgr.14373) 8423 : audit [DBG] from='client.188313 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:51:51.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:51:51 smithi047 bash[22744]: cluster 2024-09-16T08:51:49.985568+0000 mgr.a (mgr.14373) 8422 : cluster [DBG] pgmap v5841: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:51:51.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:51:51 smithi047 bash[22744]: audit 2024-09-16T08:51:50.916789+0000 mgr.a (mgr.14373) 8423 : audit [DBG] from='client.188313 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:51:53.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:51:53 smithi157 bash[24585]: cluster 2024-09-16T08:51:51.987920+0000 mgr.a (mgr.14373) 8424 : cluster [DBG] pgmap v5842: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:51:53.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:51:53 smithi086 bash[24289]: cluster 2024-09-16T08:51:51.987920+0000 mgr.a (mgr.14373) 8424 : cluster [DBG] pgmap v5842: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:51:53.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:51:53 smithi047 bash[22744]: cluster 2024-09-16T08:51:51.987920+0000 mgr.a (mgr.14373) 8424 : cluster [DBG] pgmap v5842: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:51:55.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:51:55 smithi157 bash[24585]: cluster 2024-09-16T08:51:53.988718+0000 mgr.a (mgr.14373) 8425 : cluster [DBG] pgmap v5843: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:51:55.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:51:55 smithi086 bash[24289]: cluster 2024-09-16T08:51:53.988718+0000 mgr.a (mgr.14373) 8425 : cluster [DBG] pgmap v5843: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:51:55.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:51:55 smithi047 bash[22744]: cluster 2024-09-16T08:51:53.988718+0000 mgr.a (mgr.14373) 8425 : cluster [DBG] pgmap v5843: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:51:56.339 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:51:56.340 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:51:56.341 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:51:57.120 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:51:57.121 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:51:57.121 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:51:57.121 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:51:57.121 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:51:57.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:51:57 smithi157 bash[24585]: cluster 2024-09-16T08:51:55.989466+0000 mgr.a (mgr.14373) 8426 : cluster [DBG] pgmap v5844: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:51:57.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:51:57 smithi157 bash[24585]: audit 2024-09-16T08:51:56.680473+0000 mgr.a (mgr.14373) 8427 : audit [DBG] from='client.188391 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:51:57.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:51:57 smithi086 bash[24289]: cluster 2024-09-16T08:51:55.989466+0000 mgr.a (mgr.14373) 8426 : cluster [DBG] pgmap v5844: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:51:57.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:51:57 smithi086 bash[24289]: audit 2024-09-16T08:51:56.680473+0000 mgr.a (mgr.14373) 8427 : audit [DBG] from='client.188391 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:51:57.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:51:57 smithi047 bash[22744]: cluster 2024-09-16T08:51:55.989466+0000 mgr.a (mgr.14373) 8426 : cluster [DBG] pgmap v5844: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:51:57.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:51:57 smithi047 bash[22744]: audit 2024-09-16T08:51:56.680473+0000 mgr.a (mgr.14373) 8427 : audit [DBG] from='client.188391 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:51:59.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:51:59 smithi157 bash[24585]: cluster 2024-09-16T08:51:57.992262+0000 mgr.a (mgr.14373) 8428 : cluster [DBG] pgmap v5845: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:51:59.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:51:59 smithi157 bash[24585]: audit 2024-09-16T08:51:59.050201+0000 mon.b (mon.2) 790 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T08:51:59.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:51:59 smithi086 bash[24289]: cluster 2024-09-16T08:51:57.992262+0000 mgr.a (mgr.14373) 8428 : cluster [DBG] pgmap v5845: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:51:59.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:51:59 smithi086 bash[24289]: audit 2024-09-16T08:51:59.050201+0000 mon.b (mon.2) 790 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T08:51:59.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:51:59 smithi047 bash[22744]: cluster 2024-09-16T08:51:57.992262+0000 mgr.a (mgr.14373) 8428 : cluster [DBG] pgmap v5845: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:51:59.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:51:59 smithi047 bash[22744]: audit 2024-09-16T08:51:59.050201+0000 mon.b (mon.2) 790 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T08:52:01.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:52:00 smithi157 bash[24585]: audit 2024-09-16T08:51:59.678374+0000 mon.a (mon.0) 1071 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:52:01.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:52:00 smithi157 bash[24585]: audit 2024-09-16T08:51:59.682885+0000 mon.a (mon.0) 1072 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:52:01.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:52:00 smithi157 bash[24585]: audit 2024-09-16T08:52:00.443755+0000 mon.b (mon.2) 791 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T08:52:01.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:52:00 smithi157 bash[24585]: audit 2024-09-16T08:52:00.445621+0000 mon.b (mon.2) 792 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T08:52:01.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:52:00 smithi157 bash[24585]: audit 2024-09-16T08:52:00.457265+0000 mon.a (mon.0) 1073 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:52:01.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:52:00 smithi157 bash[24585]: audit 2024-09-16T08:52:00.462885+0000 mon.b (mon.2) 793 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:52:01.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:52:00 smithi086 bash[24289]: audit 2024-09-16T08:51:59.678374+0000 mon.a (mon.0) 1071 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:52:01.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:52:00 smithi086 bash[24289]: audit 2024-09-16T08:51:59.682885+0000 mon.a (mon.0) 1072 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:52:01.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:52:00 smithi086 bash[24289]: audit 2024-09-16T08:52:00.443755+0000 mon.b (mon.2) 791 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T08:52:01.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:52:00 smithi086 bash[24289]: audit 2024-09-16T08:52:00.445621+0000 mon.b (mon.2) 792 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T08:52:01.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:52:00 smithi086 bash[24289]: audit 2024-09-16T08:52:00.457265+0000 mon.a (mon.0) 1073 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:52:01.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:52:00 smithi086 bash[24289]: audit 2024-09-16T08:52:00.462885+0000 mon.b (mon.2) 793 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:52:01.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:52:00 smithi047 bash[22744]: audit 2024-09-16T08:51:59.678374+0000 mon.a (mon.0) 1071 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:52:01.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:52:00 smithi047 bash[22744]: audit 2024-09-16T08:51:59.682885+0000 mon.a (mon.0) 1072 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:52:01.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:52:00 smithi047 bash[22744]: audit 2024-09-16T08:52:00.443755+0000 mon.b (mon.2) 791 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T08:52:01.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:52:00 smithi047 bash[22744]: audit 2024-09-16T08:52:00.445621+0000 mon.b (mon.2) 792 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T08:52:01.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:52:00 smithi047 bash[22744]: audit 2024-09-16T08:52:00.457265+0000 mon.a (mon.0) 1073 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:52:01.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:52:00 smithi047 bash[22744]: audit 2024-09-16T08:52:00.462885+0000 mon.b (mon.2) 793 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:52:01.588 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 08:52:01 smithi047 bash[22994]: debug 2024-09-16T08:52:01.195+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T08:52:01.588 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 08:52:01 smithi047 bash[22994]: debug 2024-09-16T08:52:01.199+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T08:52:02.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:52:01 smithi157 bash[24585]: cluster 2024-09-16T08:51:59.992821+0000 mgr.a (mgr.14373) 8429 : cluster [DBG] pgmap v5846: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:52:02.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:52:01 smithi157 bash[24585]: audit 2024-09-16T08:52:00.467379+0000 mgr.a (mgr.14373) 8430 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:52:02.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:52:01 smithi086 bash[24289]: cluster 2024-09-16T08:51:59.992821+0000 mgr.a (mgr.14373) 8429 : cluster [DBG] pgmap v5846: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:52:02.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:52:01 smithi086 bash[24289]: audit 2024-09-16T08:52:00.467379+0000 mgr.a (mgr.14373) 8430 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:52:02.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:52:01 smithi047 bash[22744]: cluster 2024-09-16T08:51:59.992821+0000 mgr.a (mgr.14373) 8429 : cluster [DBG] pgmap v5846: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:52:02.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:52:01 smithi047 bash[22744]: audit 2024-09-16T08:52:00.467379+0000 mgr.a (mgr.14373) 8430 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:52:02.122 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:52:02.123 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:52:02.123 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:52:02.868 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:52:02.868 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:52:02.868 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:52:02.869 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:52:02.869 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:52:03.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:52:02 smithi157 bash[24585]: audit 2024-09-16T08:52:01.200988+0000 mgr.a (mgr.14373) 8431 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T08:52:03.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:52:02 smithi157 bash[24585]: cephadm 2024-09-16T08:52:01.203267+0000 mgr.a (mgr.14373) 8432 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T08:52:03.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:52:02 smithi086 bash[24289]: audit 2024-09-16T08:52:01.200988+0000 mgr.a (mgr.14373) 8431 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T08:52:03.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:52:02 smithi086 bash[24289]: cephadm 2024-09-16T08:52:01.203267+0000 mgr.a (mgr.14373) 8432 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T08:52:03.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:52:02 smithi047 bash[22744]: audit 2024-09-16T08:52:01.200988+0000 mgr.a (mgr.14373) 8431 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T08:52:03.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:52:02 smithi047 bash[22744]: cephadm 2024-09-16T08:52:01.203267+0000 mgr.a (mgr.14373) 8432 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T08:52:04.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:52:03 smithi157 bash[24585]: cluster 2024-09-16T08:52:01.995183+0000 mgr.a (mgr.14373) 8433 : cluster [DBG] pgmap v5847: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:52:04.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:52:03 smithi157 bash[24585]: audit 2024-09-16T08:52:02.451182+0000 mgr.a (mgr.14373) 8434 : audit [DBG] from='client.188574 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:52:04.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:52:03 smithi086 bash[24289]: cluster 2024-09-16T08:52:01.995183+0000 mgr.a (mgr.14373) 8433 : cluster [DBG] pgmap v5847: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:52:04.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:52:03 smithi086 bash[24289]: audit 2024-09-16T08:52:02.451182+0000 mgr.a (mgr.14373) 8434 : audit [DBG] from='client.188574 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:52:04.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:52:03 smithi047 bash[22744]: cluster 2024-09-16T08:52:01.995183+0000 mgr.a (mgr.14373) 8433 : cluster [DBG] pgmap v5847: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:52:04.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:52:03 smithi047 bash[22744]: audit 2024-09-16T08:52:02.451182+0000 mgr.a (mgr.14373) 8434 : audit [DBG] from='client.188574 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:52:06.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:52:05 smithi157 bash[24585]: cluster 2024-09-16T08:52:03.996148+0000 mgr.a (mgr.14373) 8435 : cluster [DBG] pgmap v5848: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T08:52:06.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:52:05 smithi086 bash[24289]: cluster 2024-09-16T08:52:03.996148+0000 mgr.a (mgr.14373) 8435 : cluster [DBG] pgmap v5848: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T08:52:06.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:52:05 smithi047 bash[22744]: cluster 2024-09-16T08:52:03.996148+0000 mgr.a (mgr.14373) 8435 : cluster [DBG] pgmap v5848: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T08:52:07.869 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:52:07.870 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:52:07.870 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:52:08.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:52:07 smithi157 bash[24585]: cluster 2024-09-16T08:52:05.996940+0000 mgr.a (mgr.14373) 8436 : cluster [DBG] pgmap v5849: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T08:52:08.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:52:07 smithi086 bash[24289]: cluster 2024-09-16T08:52:05.996940+0000 mgr.a (mgr.14373) 8436 : cluster [DBG] pgmap v5849: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T08:52:08.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:52:07 smithi047 bash[22744]: cluster 2024-09-16T08:52:05.996940+0000 mgr.a (mgr.14373) 8436 : cluster [DBG] pgmap v5849: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T08:52:08.646 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:52:08.647 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:52:08.647 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:52:08.647 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:52:08.647 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:52:10.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:52:09 smithi157 bash[24585]: cluster 2024-09-16T08:52:07.998044+0000 mgr.a (mgr.14373) 8437 : cluster [DBG] pgmap v5850: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:52:10.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:52:09 smithi157 bash[24585]: audit 2024-09-16T08:52:08.214780+0000 mgr.a (mgr.14373) 8438 : audit [DBG] from='client.188652 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:52:10.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:52:09 smithi086 bash[24289]: cluster 2024-09-16T08:52:07.998044+0000 mgr.a (mgr.14373) 8437 : cluster [DBG] pgmap v5850: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:52:10.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:52:09 smithi086 bash[24289]: audit 2024-09-16T08:52:08.214780+0000 mgr.a (mgr.14373) 8438 : audit [DBG] from='client.188652 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:52:10.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:52:09 smithi047 bash[22744]: cluster 2024-09-16T08:52:07.998044+0000 mgr.a (mgr.14373) 8437 : cluster [DBG] pgmap v5850: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:52:10.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:52:09 smithi047 bash[22744]: audit 2024-09-16T08:52:08.214780+0000 mgr.a (mgr.14373) 8438 : audit [DBG] from='client.188652 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:52:12.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:52:11 smithi157 bash[24585]: cluster 2024-09-16T08:52:09.998949+0000 mgr.a (mgr.14373) 8439 : cluster [DBG] pgmap v5851: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:52:12.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:52:11 smithi086 bash[24289]: cluster 2024-09-16T08:52:09.998949+0000 mgr.a (mgr.14373) 8439 : cluster [DBG] pgmap v5851: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:52:12.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:52:11 smithi047 bash[22744]: cluster 2024-09-16T08:52:09.998949+0000 mgr.a (mgr.14373) 8439 : cluster [DBG] pgmap v5851: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:52:13.648 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:52:13.649 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:52:13.649 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:52:14.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:52:13 smithi157 bash[24585]: cluster 2024-09-16T08:52:12.001193+0000 mgr.a (mgr.14373) 8440 : cluster [DBG] pgmap v5852: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:52:14.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:52:13 smithi086 bash[24289]: cluster 2024-09-16T08:52:12.001193+0000 mgr.a (mgr.14373) 8440 : cluster [DBG] pgmap v5852: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:52:14.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:52:13 smithi047 bash[22744]: cluster 2024-09-16T08:52:12.001193+0000 mgr.a (mgr.14373) 8440 : cluster [DBG] pgmap v5852: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:52:14.417 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:52:14.418 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:52:14.418 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:52:14.418 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:52:14.418 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:52:16.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:52:15 smithi157 bash[24585]: audit 2024-09-16T08:52:13.987050+0000 mgr.a (mgr.14373) 8441 : audit [DBG] from='client.188727 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:52:16.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:52:15 smithi157 bash[24585]: cluster 2024-09-16T08:52:14.002751+0000 mgr.a (mgr.14373) 8442 : cluster [DBG] pgmap v5853: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:52:16.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:52:15 smithi086 bash[24289]: audit 2024-09-16T08:52:13.987050+0000 mgr.a (mgr.14373) 8441 : audit [DBG] from='client.188727 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:52:16.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:52:15 smithi086 bash[24289]: cluster 2024-09-16T08:52:14.002751+0000 mgr.a (mgr.14373) 8442 : cluster [DBG] pgmap v5853: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:52:16.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:52:15 smithi047 bash[22744]: audit 2024-09-16T08:52:13.987050+0000 mgr.a (mgr.14373) 8441 : audit [DBG] from='client.188727 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:52:16.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:52:15 smithi047 bash[22744]: cluster 2024-09-16T08:52:14.002751+0000 mgr.a (mgr.14373) 8442 : cluster [DBG] pgmap v5853: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:52:18.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:52:17 smithi157 bash[24585]: cluster 2024-09-16T08:52:16.003685+0000 mgr.a (mgr.14373) 8443 : cluster [DBG] pgmap v5854: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:52:18.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:52:17 smithi086 bash[24289]: cluster 2024-09-16T08:52:16.003685+0000 mgr.a (mgr.14373) 8443 : cluster [DBG] pgmap v5854: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:52:18.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:52:17 smithi047 bash[22744]: cluster 2024-09-16T08:52:16.003685+0000 mgr.a (mgr.14373) 8443 : cluster [DBG] pgmap v5854: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:52:19.419 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:52:19.420 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:52:19.420 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:52:20.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:52:19 smithi157 bash[24585]: cluster 2024-09-16T08:52:18.005902+0000 mgr.a (mgr.14373) 8444 : cluster [DBG] pgmap v5855: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:52:20.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:52:19 smithi086 bash[24289]: cluster 2024-09-16T08:52:18.005902+0000 mgr.a (mgr.14373) 8444 : cluster [DBG] pgmap v5855: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:52:20.087 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:52:19 smithi047 bash[22744]: cluster 2024-09-16T08:52:18.005902+0000 mgr.a (mgr.14373) 8444 : cluster [DBG] pgmap v5855: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:52:20.202 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:52:20.202 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:52:20.202 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:52:20.202 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:52:20.202 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:52:21.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:52:20 smithi157 bash[24585]: audit 2024-09-16T08:52:19.764428+0000 mgr.a (mgr.14373) 8445 : audit [DBG] from='client.188805 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:52:21.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:52:20 smithi086 bash[24289]: audit 2024-09-16T08:52:19.764428+0000 mgr.a (mgr.14373) 8445 : audit [DBG] from='client.188805 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:52:21.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:52:20 smithi047 bash[22744]: audit 2024-09-16T08:52:19.764428+0000 mgr.a (mgr.14373) 8445 : audit [DBG] from='client.188805 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:52:22.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:52:21 smithi157 bash[24585]: cluster 2024-09-16T08:52:20.006949+0000 mgr.a (mgr.14373) 8446 : cluster [DBG] pgmap v5856: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:52:22.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:52:21 smithi086 bash[24289]: cluster 2024-09-16T08:52:20.006949+0000 mgr.a (mgr.14373) 8446 : cluster [DBG] pgmap v5856: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:52:22.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:52:21 smithi047 bash[22744]: cluster 2024-09-16T08:52:20.006949+0000 mgr.a (mgr.14373) 8446 : cluster [DBG] pgmap v5856: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:52:24.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:52:23 smithi157 bash[24585]: cluster 2024-09-16T08:52:22.009273+0000 mgr.a (mgr.14373) 8447 : cluster [DBG] pgmap v5857: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:52:24.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:52:23 smithi086 bash[24289]: cluster 2024-09-16T08:52:22.009273+0000 mgr.a (mgr.14373) 8447 : cluster [DBG] pgmap v5857: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:52:24.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:52:23 smithi047 bash[22744]: cluster 2024-09-16T08:52:22.009273+0000 mgr.a (mgr.14373) 8447 : cluster [DBG] pgmap v5857: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:52:25.204 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:52:25.204 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:52:25.204 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:52:25.953 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:52:25.953 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:52:25.953 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:52:25.953 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:52:25.954 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:52:26.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:52:25 smithi157 bash[24585]: cluster 2024-09-16T08:52:24.010046+0000 mgr.a (mgr.14373) 8448 : cluster [DBG] pgmap v5858: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:52:26.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:52:25 smithi086 bash[24289]: cluster 2024-09-16T08:52:24.010046+0000 mgr.a (mgr.14373) 8448 : cluster [DBG] pgmap v5858: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:52:26.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:52:25 smithi047 bash[22744]: cluster 2024-09-16T08:52:24.010046+0000 mgr.a (mgr.14373) 8448 : cluster [DBG] pgmap v5858: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:52:27.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:52:26 smithi157 bash[24585]: audit 2024-09-16T08:52:25.534105+0000 mgr.a (mgr.14373) 8449 : audit [DBG] from='client.188883 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:52:27.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:52:26 smithi086 bash[24289]: audit 2024-09-16T08:52:25.534105+0000 mgr.a (mgr.14373) 8449 : audit [DBG] from='client.188883 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:52:27.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:52:26 smithi047 bash[22744]: audit 2024-09-16T08:52:25.534105+0000 mgr.a (mgr.14373) 8449 : audit [DBG] from='client.188883 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:52:28.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:52:27 smithi157 bash[24585]: cluster 2024-09-16T08:52:26.010937+0000 mgr.a (mgr.14373) 8450 : cluster [DBG] pgmap v5859: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:52:28.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:52:27 smithi086 bash[24289]: cluster 2024-09-16T08:52:26.010937+0000 mgr.a (mgr.14373) 8450 : cluster [DBG] pgmap v5859: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:52:28.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:52:27 smithi047 bash[22744]: cluster 2024-09-16T08:52:26.010937+0000 mgr.a (mgr.14373) 8450 : cluster [DBG] pgmap v5859: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:52:30.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:52:29 smithi157 bash[24585]: cluster 2024-09-16T08:52:28.013151+0000 mgr.a (mgr.14373) 8451 : cluster [DBG] pgmap v5860: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:52:30.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:52:29 smithi086 bash[24289]: cluster 2024-09-16T08:52:28.013151+0000 mgr.a (mgr.14373) 8451 : cluster [DBG] pgmap v5860: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:52:30.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:52:29 smithi047 bash[22744]: cluster 2024-09-16T08:52:28.013151+0000 mgr.a (mgr.14373) 8451 : cluster [DBG] pgmap v5860: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:52:30.955 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:52:30.956 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:52:30.956 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:52:31.738 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:52:31.738 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:52:31.738 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:52:31.738 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:52:31.738 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:52:32.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:52:31 smithi157 bash[24585]: cluster 2024-09-16T08:52:30.013917+0000 mgr.a (mgr.14373) 8452 : cluster [DBG] pgmap v5861: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:52:32.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:52:31 smithi086 bash[24289]: cluster 2024-09-16T08:52:30.013917+0000 mgr.a (mgr.14373) 8452 : cluster [DBG] pgmap v5861: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:52:32.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:52:31 smithi047 bash[22744]: cluster 2024-09-16T08:52:30.013917+0000 mgr.a (mgr.14373) 8452 : cluster [DBG] pgmap v5861: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:52:33.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:52:32 smithi157 bash[24585]: audit 2024-09-16T08:52:31.293677+0000 mgr.a (mgr.14373) 8453 : audit [DBG] from='client.188961 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:52:33.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:52:32 smithi086 bash[24289]: audit 2024-09-16T08:52:31.293677+0000 mgr.a (mgr.14373) 8453 : audit [DBG] from='client.188961 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:52:33.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:52:32 smithi047 bash[22744]: audit 2024-09-16T08:52:31.293677+0000 mgr.a (mgr.14373) 8453 : audit [DBG] from='client.188961 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:52:34.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:52:33 smithi157 bash[24585]: cluster 2024-09-16T08:52:32.016639+0000 mgr.a (mgr.14373) 8454 : cluster [DBG] pgmap v5862: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-16T08:52:34.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:52:33 smithi086 bash[24289]: cluster 2024-09-16T08:52:32.016639+0000 mgr.a (mgr.14373) 8454 : cluster [DBG] pgmap v5862: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-16T08:52:34.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:52:33 smithi047 bash[22744]: cluster 2024-09-16T08:52:32.016639+0000 mgr.a (mgr.14373) 8454 : cluster [DBG] pgmap v5862: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-16T08:52:36.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:52:35 smithi157 bash[24585]: cluster 2024-09-16T08:52:34.017404+0000 mgr.a (mgr.14373) 8455 : cluster [DBG] pgmap v5863: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T08:52:36.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:52:35 smithi086 bash[24289]: cluster 2024-09-16T08:52:34.017404+0000 mgr.a (mgr.14373) 8455 : cluster [DBG] pgmap v5863: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T08:52:36.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:52:35 smithi047 bash[22744]: cluster 2024-09-16T08:52:34.017404+0000 mgr.a (mgr.14373) 8455 : cluster [DBG] pgmap v5863: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T08:52:36.739 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:52:36.740 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:52:36.740 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:52:37.542 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:52:37.542 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:52:37.542 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:52:37.542 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:52:37.542 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:52:38.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:52:37 smithi157 bash[24585]: cluster 2024-09-16T08:52:36.018144+0000 mgr.a (mgr.14373) 8456 : cluster [DBG] pgmap v5864: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T08:52:38.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:52:37 smithi086 bash[24289]: cluster 2024-09-16T08:52:36.018144+0000 mgr.a (mgr.14373) 8456 : cluster [DBG] pgmap v5864: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T08:52:38.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:52:37 smithi047 bash[22744]: cluster 2024-09-16T08:52:36.018144+0000 mgr.a (mgr.14373) 8456 : cluster [DBG] pgmap v5864: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T08:52:39.052 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:52:38 smithi157 bash[24585]: audit 2024-09-16T08:52:37.113935+0000 mgr.a (mgr.14373) 8457 : audit [DBG] from='client.189036 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:52:39.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:52:38 smithi086 bash[24289]: audit 2024-09-16T08:52:37.113935+0000 mgr.a (mgr.14373) 8457 : audit [DBG] from='client.189036 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:52:39.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:52:38 smithi047 bash[22744]: audit 2024-09-16T08:52:37.113935+0000 mgr.a (mgr.14373) 8457 : audit [DBG] from='client.189036 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:52:40.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:52:39 smithi157 bash[24585]: cluster 2024-09-16T08:52:38.020952+0000 mgr.a (mgr.14373) 8458 : cluster [DBG] pgmap v5865: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:52:40.067 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:52:39 smithi086 bash[24289]: cluster 2024-09-16T08:52:38.020952+0000 mgr.a (mgr.14373) 8458 : cluster [DBG] pgmap v5865: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:52:40.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:52:39 smithi047 bash[22744]: cluster 2024-09-16T08:52:38.020952+0000 mgr.a (mgr.14373) 8458 : cluster [DBG] pgmap v5865: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:52:42.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:52:41 smithi157 bash[24585]: cluster 2024-09-16T08:52:40.021717+0000 mgr.a (mgr.14373) 8459 : cluster [DBG] pgmap v5866: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:52:42.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:52:41 smithi086 bash[24289]: cluster 2024-09-16T08:52:40.021717+0000 mgr.a (mgr.14373) 8459 : cluster [DBG] pgmap v5866: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:52:42.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:52:41 smithi047 bash[22744]: cluster 2024-09-16T08:52:40.021717+0000 mgr.a (mgr.14373) 8459 : cluster [DBG] pgmap v5866: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:52:42.543 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:52:42.544 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:52:42.544 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:52:43.286 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:52:43.286 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:52:43.286 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:52:43.286 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:52:43.287 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:52:44.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:52:43 smithi086 bash[24289]: cluster 2024-09-16T08:52:42.023784+0000 mgr.a (mgr.14373) 8460 : cluster [DBG] pgmap v5867: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:52:44.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:52:43 smithi086 bash[24289]: audit 2024-09-16T08:52:42.880006+0000 mgr.a (mgr.14373) 8461 : audit [DBG] from='client.189114 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:52:44.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:52:43 smithi047 bash[22744]: cluster 2024-09-16T08:52:42.023784+0000 mgr.a (mgr.14373) 8460 : cluster [DBG] pgmap v5867: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:52:44.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:52:43 smithi047 bash[22744]: audit 2024-09-16T08:52:42.880006+0000 mgr.a (mgr.14373) 8461 : audit [DBG] from='client.189114 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:52:44.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:52:43 smithi157 bash[24585]: cluster 2024-09-16T08:52:42.023784+0000 mgr.a (mgr.14373) 8460 : cluster [DBG] pgmap v5867: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:52:44.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:52:43 smithi157 bash[24585]: audit 2024-09-16T08:52:42.880006+0000 mgr.a (mgr.14373) 8461 : audit [DBG] from='client.189114 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:52:46.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:52:45 smithi086 bash[24289]: cluster 2024-09-16T08:52:44.024787+0000 mgr.a (mgr.14373) 8462 : cluster [DBG] pgmap v5868: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-16T08:52:46.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:52:45 smithi047 bash[22744]: cluster 2024-09-16T08:52:44.024787+0000 mgr.a (mgr.14373) 8462 : cluster [DBG] pgmap v5868: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-16T08:52:46.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:52:45 smithi157 bash[24585]: cluster 2024-09-16T08:52:44.024787+0000 mgr.a (mgr.14373) 8462 : cluster [DBG] pgmap v5868: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-16T08:52:48.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:52:47 smithi086 bash[24289]: cluster 2024-09-16T08:52:46.025591+0000 mgr.a (mgr.14373) 8463 : cluster [DBG] pgmap v5869: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-16T08:52:48.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:52:47 smithi047 bash[22744]: cluster 2024-09-16T08:52:46.025591+0000 mgr.a (mgr.14373) 8463 : cluster [DBG] pgmap v5869: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-16T08:52:48.288 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:52:48.288 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:52:48.288 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:52:48.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:52:47 smithi157 bash[24585]: cluster 2024-09-16T08:52:46.025591+0000 mgr.a (mgr.14373) 8463 : cluster [DBG] pgmap v5869: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-16T08:52:49.069 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:52:49.070 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:52:49.070 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:52:49.070 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:52:49.070 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:52:50.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:52:49 smithi157 bash[24585]: cluster 2024-09-16T08:52:48.028154+0000 mgr.a (mgr.14373) 8464 : cluster [DBG] pgmap v5870: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-16T08:52:50.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:52:49 smithi157 bash[24585]: audit 2024-09-16T08:52:48.625612+0000 mgr.a (mgr.14373) 8465 : audit [DBG] from='client.189192 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:52:50.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:52:49 smithi047 bash[22744]: cluster 2024-09-16T08:52:48.028154+0000 mgr.a (mgr.14373) 8464 : cluster [DBG] pgmap v5870: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-16T08:52:50.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:52:49 smithi047 bash[22744]: audit 2024-09-16T08:52:48.625612+0000 mgr.a (mgr.14373) 8465 : audit [DBG] from='client.189192 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:52:50.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:52:49 smithi086 bash[24289]: cluster 2024-09-16T08:52:48.028154+0000 mgr.a (mgr.14373) 8464 : cluster [DBG] pgmap v5870: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-16T08:52:50.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:52:49 smithi086 bash[24289]: audit 2024-09-16T08:52:48.625612+0000 mgr.a (mgr.14373) 8465 : audit [DBG] from='client.189192 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:52:52.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:52:51 smithi047 bash[22744]: cluster 2024-09-16T08:52:50.029076+0000 mgr.a (mgr.14373) 8466 : cluster [DBG] pgmap v5871: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:52:52.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:52:51 smithi157 bash[24585]: cluster 2024-09-16T08:52:50.029076+0000 mgr.a (mgr.14373) 8466 : cluster [DBG] pgmap v5871: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:52:52.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:52:51 smithi086 bash[24289]: cluster 2024-09-16T08:52:50.029076+0000 mgr.a (mgr.14373) 8466 : cluster [DBG] pgmap v5871: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:52:54.069 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:52:54.069 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:52:54.070 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:52:54.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:52:53 smithi047 bash[22744]: cluster 2024-09-16T08:52:52.031323+0000 mgr.a (mgr.14373) 8467 : cluster [DBG] pgmap v5872: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:52:54.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:52:53 smithi157 bash[24585]: cluster 2024-09-16T08:52:52.031323+0000 mgr.a (mgr.14373) 8467 : cluster [DBG] pgmap v5872: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:52:54.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:52:53 smithi086 bash[24289]: cluster 2024-09-16T08:52:52.031323+0000 mgr.a (mgr.14373) 8467 : cluster [DBG] pgmap v5872: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:52:54.808 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:52:54.809 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:52:54.809 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:52:54.809 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:52:54.809 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:52:56.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:52:55 smithi047 bash[22744]: cluster 2024-09-16T08:52:54.032093+0000 mgr.a (mgr.14373) 8468 : cluster [DBG] pgmap v5873: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:52:56.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:52:55 smithi047 bash[22744]: audit 2024-09-16T08:52:54.403934+0000 mgr.a (mgr.14373) 8469 : audit [DBG] from='client.189267 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:52:56.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:52:55 smithi157 bash[24585]: cluster 2024-09-16T08:52:54.032093+0000 mgr.a (mgr.14373) 8468 : cluster [DBG] pgmap v5873: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:52:56.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:52:55 smithi157 bash[24585]: audit 2024-09-16T08:52:54.403934+0000 mgr.a (mgr.14373) 8469 : audit [DBG] from='client.189267 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:52:56.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:52:55 smithi086 bash[24289]: cluster 2024-09-16T08:52:54.032093+0000 mgr.a (mgr.14373) 8468 : cluster [DBG] pgmap v5873: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:52:56.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:52:55 smithi086 bash[24289]: audit 2024-09-16T08:52:54.403934+0000 mgr.a (mgr.14373) 8469 : audit [DBG] from='client.189267 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:52:58.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:52:57 smithi047 bash[22744]: cluster 2024-09-16T08:52:56.032978+0000 mgr.a (mgr.14373) 8470 : cluster [DBG] pgmap v5874: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:52:58.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:52:57 smithi157 bash[24585]: cluster 2024-09-16T08:52:56.032978+0000 mgr.a (mgr.14373) 8470 : cluster [DBG] pgmap v5874: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:52:58.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:52:57 smithi086 bash[24289]: cluster 2024-09-16T08:52:56.032978+0000 mgr.a (mgr.14373) 8470 : cluster [DBG] pgmap v5874: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:52:59.810 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:52:59.811 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:52:59.811 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:53:00.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:52:59 smithi157 bash[24585]: cluster 2024-09-16T08:52:58.035274+0000 mgr.a (mgr.14373) 8471 : cluster [DBG] pgmap v5875: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:53:00.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:52:59 smithi086 bash[24289]: cluster 2024-09-16T08:52:58.035274+0000 mgr.a (mgr.14373) 8471 : cluster [DBG] pgmap v5875: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:53:00.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:52:59 smithi047 bash[22744]: cluster 2024-09-16T08:52:58.035274+0000 mgr.a (mgr.14373) 8471 : cluster [DBG] pgmap v5875: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:53:00.633 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:53:00.633 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:53:00.633 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:53:00.633 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:53:00.633 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:53:02.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:53:01 smithi157 bash[24585]: cluster 2024-09-16T08:53:00.036014+0000 mgr.a (mgr.14373) 8472 : cluster [DBG] pgmap v5876: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:53:02.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:53:01 smithi157 bash[24585]: audit 2024-09-16T08:53:00.216568+0000 mgr.a (mgr.14373) 8473 : audit [DBG] from='client.189345 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:53:02.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:53:01 smithi157 bash[24585]: audit 2024-09-16T08:53:01.254936+0000 mon.b (mon.2) 794 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T08:53:02.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:53:01 smithi086 bash[24289]: cluster 2024-09-16T08:53:00.036014+0000 mgr.a (mgr.14373) 8472 : cluster [DBG] pgmap v5876: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:53:02.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:53:01 smithi086 bash[24289]: audit 2024-09-16T08:53:00.216568+0000 mgr.a (mgr.14373) 8473 : audit [DBG] from='client.189345 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:53:02.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:53:01 smithi086 bash[24289]: audit 2024-09-16T08:53:01.254936+0000 mon.b (mon.2) 794 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T08:53:02.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:53:01 smithi047 bash[22744]: cluster 2024-09-16T08:53:00.036014+0000 mgr.a (mgr.14373) 8472 : cluster [DBG] pgmap v5876: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:53:02.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:53:01 smithi047 bash[22744]: audit 2024-09-16T08:53:00.216568+0000 mgr.a (mgr.14373) 8473 : audit [DBG] from='client.189345 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:53:02.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:53:01 smithi047 bash[22744]: audit 2024-09-16T08:53:01.254936+0000 mon.b (mon.2) 794 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T08:53:03.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:53:02 smithi157 bash[24585]: audit 2024-09-16T08:53:01.870682+0000 mon.a (mon.0) 1074 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:53:03.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:53:02 smithi157 bash[24585]: audit 2024-09-16T08:53:01.873929+0000 mon.a (mon.0) 1075 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:53:03.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:53:02 smithi157 bash[24585]: audit 2024-09-16T08:53:01.878038+0000 mon.a (mon.0) 1076 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:53:03.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:53:02 smithi157 bash[24585]: audit 2024-09-16T08:53:01.881370+0000 mon.a (mon.0) 1077 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:53:03.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:53:02 smithi157 bash[24585]: audit 2024-09-16T08:53:02.612836+0000 mon.b (mon.2) 795 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T08:53:03.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:53:02 smithi157 bash[24585]: audit 2024-09-16T08:53:02.614965+0000 mon.b (mon.2) 796 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T08:53:03.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:53:02 smithi157 bash[24585]: audit 2024-09-16T08:53:02.628642+0000 mon.a (mon.0) 1078 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:53:03.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:53:02 smithi157 bash[24585]: audit 2024-09-16T08:53:02.632027+0000 mon.b (mon.2) 797 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:53:03.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:53:02 smithi086 bash[24289]: audit 2024-09-16T08:53:01.870682+0000 mon.a (mon.0) 1074 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:53:03.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:53:02 smithi086 bash[24289]: audit 2024-09-16T08:53:01.873929+0000 mon.a (mon.0) 1075 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:53:03.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:53:02 smithi086 bash[24289]: audit 2024-09-16T08:53:01.878038+0000 mon.a (mon.0) 1076 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:53:03.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:53:02 smithi086 bash[24289]: audit 2024-09-16T08:53:01.881370+0000 mon.a (mon.0) 1077 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:53:03.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:53:02 smithi086 bash[24289]: audit 2024-09-16T08:53:02.612836+0000 mon.b (mon.2) 795 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T08:53:03.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:53:02 smithi086 bash[24289]: audit 2024-09-16T08:53:02.614965+0000 mon.b (mon.2) 796 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T08:53:03.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:53:02 smithi086 bash[24289]: audit 2024-09-16T08:53:02.628642+0000 mon.a (mon.0) 1078 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:53:03.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:53:02 smithi086 bash[24289]: audit 2024-09-16T08:53:02.632027+0000 mon.b (mon.2) 797 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:53:03.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:53:02 smithi047 bash[22744]: audit 2024-09-16T08:53:01.870682+0000 mon.a (mon.0) 1074 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:53:03.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:53:02 smithi047 bash[22744]: audit 2024-09-16T08:53:01.873929+0000 mon.a (mon.0) 1075 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:53:03.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:53:02 smithi047 bash[22744]: audit 2024-09-16T08:53:01.878038+0000 mon.a (mon.0) 1076 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:53:03.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:53:02 smithi047 bash[22744]: audit 2024-09-16T08:53:01.881370+0000 mon.a (mon.0) 1077 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:53:03.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:53:02 smithi047 bash[22744]: audit 2024-09-16T08:53:02.612836+0000 mon.b (mon.2) 795 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T08:53:03.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:53:02 smithi047 bash[22744]: audit 2024-09-16T08:53:02.614965+0000 mon.b (mon.2) 796 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T08:53:03.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:53:02 smithi047 bash[22744]: audit 2024-09-16T08:53:02.628642+0000 mon.a (mon.0) 1078 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:53:03.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:53:02 smithi047 bash[22744]: audit 2024-09-16T08:53:02.632027+0000 mon.b (mon.2) 797 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:53:03.838 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 08:53:03 smithi047 bash[22994]: debug 2024-09-16T08:53:03.377+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T08:53:03.838 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 08:53:03 smithi047 bash[22994]: debug 2024-09-16T08:53:03.377+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T08:53:04.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:53:03 smithi157 bash[24585]: cluster 2024-09-16T08:53:02.038393+0000 mgr.a (mgr.14373) 8474 : cluster [DBG] pgmap v5877: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:53:04.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:53:03 smithi157 bash[24585]: audit 2024-09-16T08:53:02.636520+0000 mgr.a (mgr.14373) 8475 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:53:04.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:53:03 smithi086 bash[24289]: cluster 2024-09-16T08:53:02.038393+0000 mgr.a (mgr.14373) 8474 : cluster [DBG] pgmap v5877: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:53:04.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:53:03 smithi086 bash[24289]: audit 2024-09-16T08:53:02.636520+0000 mgr.a (mgr.14373) 8475 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:53:04.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:53:03 smithi047 bash[22744]: cluster 2024-09-16T08:53:02.038393+0000 mgr.a (mgr.14373) 8474 : cluster [DBG] pgmap v5877: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:53:04.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:53:03 smithi047 bash[22744]: audit 2024-09-16T08:53:02.636520+0000 mgr.a (mgr.14373) 8475 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:53:05.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:53:04 smithi157 bash[24585]: audit 2024-09-16T08:53:03.379568+0000 mgr.a (mgr.14373) 8476 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T08:53:05.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:53:04 smithi157 bash[24585]: cephadm 2024-09-16T08:53:03.381366+0000 mgr.a (mgr.14373) 8477 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T08:53:05.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:53:04 smithi086 bash[24289]: audit 2024-09-16T08:53:03.379568+0000 mgr.a (mgr.14373) 8476 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T08:53:05.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:53:04 smithi086 bash[24289]: cephadm 2024-09-16T08:53:03.381366+0000 mgr.a (mgr.14373) 8477 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T08:53:05.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:53:04 smithi047 bash[22744]: audit 2024-09-16T08:53:03.379568+0000 mgr.a (mgr.14373) 8476 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T08:53:05.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:53:04 smithi047 bash[22744]: cephadm 2024-09-16T08:53:03.381366+0000 mgr.a (mgr.14373) 8477 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T08:53:05.635 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:53:05.635 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:53:05.635 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:53:06.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:53:05 smithi157 bash[24585]: cluster 2024-09-16T08:53:04.039335+0000 mgr.a (mgr.14373) 8478 : cluster [DBG] pgmap v5878: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:53:06.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:53:05 smithi086 bash[24289]: cluster 2024-09-16T08:53:04.039335+0000 mgr.a (mgr.14373) 8478 : cluster [DBG] pgmap v5878: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:53:06.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:53:05 smithi047 bash[22744]: cluster 2024-09-16T08:53:04.039335+0000 mgr.a (mgr.14373) 8478 : cluster [DBG] pgmap v5878: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:53:06.406 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:53:06.406 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:53:06.406 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:53:06.406 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:53:06.406 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:53:08.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:53:07 smithi157 bash[24585]: audit 2024-09-16T08:53:05.974051+0000 mgr.a (mgr.14373) 8479 : audit [DBG] from='client.189531 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:53:08.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:53:07 smithi157 bash[24585]: cluster 2024-09-16T08:53:06.039902+0000 mgr.a (mgr.14373) 8480 : cluster [DBG] pgmap v5879: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:53:08.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:53:07 smithi086 bash[24289]: audit 2024-09-16T08:53:05.974051+0000 mgr.a (mgr.14373) 8479 : audit [DBG] from='client.189531 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:53:08.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:53:07 smithi086 bash[24289]: cluster 2024-09-16T08:53:06.039902+0000 mgr.a (mgr.14373) 8480 : cluster [DBG] pgmap v5879: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:53:08.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:53:07 smithi047 bash[22744]: audit 2024-09-16T08:53:05.974051+0000 mgr.a (mgr.14373) 8479 : audit [DBG] from='client.189531 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:53:08.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:53:07 smithi047 bash[22744]: cluster 2024-09-16T08:53:06.039902+0000 mgr.a (mgr.14373) 8480 : cluster [DBG] pgmap v5879: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:53:10.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:53:09 smithi157 bash[24585]: cluster 2024-09-16T08:53:08.042237+0000 mgr.a (mgr.14373) 8481 : cluster [DBG] pgmap v5880: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:53:10.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:53:09 smithi086 bash[24289]: cluster 2024-09-16T08:53:08.042237+0000 mgr.a (mgr.14373) 8481 : cluster [DBG] pgmap v5880: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:53:10.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:53:09 smithi047 bash[22744]: cluster 2024-09-16T08:53:08.042237+0000 mgr.a (mgr.14373) 8481 : cluster [DBG] pgmap v5880: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:53:11.408 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:53:11.408 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:53:11.408 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:53:12.182 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:53:12.182 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:53:12.182 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:53:12.182 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:53:12.182 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:53:12.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:53:11 smithi157 bash[24585]: cluster 2024-09-16T08:53:10.042998+0000 mgr.a (mgr.14373) 8482 : cluster [DBG] pgmap v5881: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T08:53:12.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:53:11 smithi086 bash[24289]: cluster 2024-09-16T08:53:10.042998+0000 mgr.a (mgr.14373) 8482 : cluster [DBG] pgmap v5881: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T08:53:12.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:53:11 smithi047 bash[22744]: cluster 2024-09-16T08:53:10.042998+0000 mgr.a (mgr.14373) 8482 : cluster [DBG] pgmap v5881: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T08:53:13.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:53:12 smithi157 bash[24585]: audit 2024-09-16T08:53:11.746551+0000 mgr.a (mgr.14373) 8483 : audit [DBG] from='client.189606 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:53:13.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:53:12 smithi086 bash[24289]: audit 2024-09-16T08:53:11.746551+0000 mgr.a (mgr.14373) 8483 : audit [DBG] from='client.189606 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:53:13.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:53:12 smithi047 bash[22744]: audit 2024-09-16T08:53:11.746551+0000 mgr.a (mgr.14373) 8483 : audit [DBG] from='client.189606 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:53:14.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:53:13 smithi157 bash[24585]: cluster 2024-09-16T08:53:12.044412+0000 mgr.a (mgr.14373) 8484 : cluster [DBG] pgmap v5882: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:53:14.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:53:13 smithi086 bash[24289]: cluster 2024-09-16T08:53:12.044412+0000 mgr.a (mgr.14373) 8484 : cluster [DBG] pgmap v5882: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:53:14.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:53:13 smithi047 bash[22744]: cluster 2024-09-16T08:53:12.044412+0000 mgr.a (mgr.14373) 8484 : cluster [DBG] pgmap v5882: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:53:16.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:53:15 smithi157 bash[24585]: cluster 2024-09-16T08:53:14.045427+0000 mgr.a (mgr.14373) 8485 : cluster [DBG] pgmap v5883: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T08:53:16.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:53:15 smithi086 bash[24289]: cluster 2024-09-16T08:53:14.045427+0000 mgr.a (mgr.14373) 8485 : cluster [DBG] pgmap v5883: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T08:53:16.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:53:15 smithi047 bash[22744]: cluster 2024-09-16T08:53:14.045427+0000 mgr.a (mgr.14373) 8485 : cluster [DBG] pgmap v5883: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T08:53:17.184 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:53:17.184 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:53:17.184 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:53:17.937 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:53:17.938 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:53:17.938 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:53:17.938 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:53:17.938 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:53:18.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:53:17 smithi157 bash[24585]: cluster 2024-09-16T08:53:16.046433+0000 mgr.a (mgr.14373) 8486 : cluster [DBG] pgmap v5884: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T08:53:18.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:53:17 smithi086 bash[24289]: cluster 2024-09-16T08:53:16.046433+0000 mgr.a (mgr.14373) 8486 : cluster [DBG] pgmap v5884: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T08:53:18.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:53:17 smithi047 bash[22744]: cluster 2024-09-16T08:53:16.046433+0000 mgr.a (mgr.14373) 8486 : cluster [DBG] pgmap v5884: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T08:53:19.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:53:18 smithi157 bash[24585]: audit 2024-09-16T08:53:17.517619+0000 mgr.a (mgr.14373) 8487 : audit [DBG] from='client.189684 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:53:19.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:53:18 smithi086 bash[24289]: audit 2024-09-16T08:53:17.517619+0000 mgr.a (mgr.14373) 8487 : audit [DBG] from='client.189684 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:53:19.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:53:18 smithi047 bash[22744]: audit 2024-09-16T08:53:17.517619+0000 mgr.a (mgr.14373) 8487 : audit [DBG] from='client.189684 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:53:20.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:53:19 smithi157 bash[24585]: cluster 2024-09-16T08:53:18.049198+0000 mgr.a (mgr.14373) 8488 : cluster [DBG] pgmap v5885: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:53:20.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:53:19 smithi086 bash[24289]: cluster 2024-09-16T08:53:18.049198+0000 mgr.a (mgr.14373) 8488 : cluster [DBG] pgmap v5885: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:53:20.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:53:19 smithi047 bash[22744]: cluster 2024-09-16T08:53:18.049198+0000 mgr.a (mgr.14373) 8488 : cluster [DBG] pgmap v5885: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:53:22.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:53:21 smithi157 bash[24585]: cluster 2024-09-16T08:53:20.049998+0000 mgr.a (mgr.14373) 8489 : cluster [DBG] pgmap v5886: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-16T08:53:22.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:53:21 smithi086 bash[24289]: cluster 2024-09-16T08:53:20.049998+0000 mgr.a (mgr.14373) 8489 : cluster [DBG] pgmap v5886: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-16T08:53:22.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:53:21 smithi047 bash[22744]: cluster 2024-09-16T08:53:20.049998+0000 mgr.a (mgr.14373) 8489 : cluster [DBG] pgmap v5886: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-16T08:53:22.939 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:53:22.940 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:53:22.940 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:53:23.700 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:53:23.701 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:53:23.701 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:53:23.701 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:53:23.701 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:53:24.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:53:23 smithi157 bash[24585]: cluster 2024-09-16T08:53:22.052035+0000 mgr.a (mgr.14373) 8490 : cluster [DBG] pgmap v5887: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-16T08:53:24.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:53:23 smithi086 bash[24289]: cluster 2024-09-16T08:53:22.052035+0000 mgr.a (mgr.14373) 8490 : cluster [DBG] pgmap v5887: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-16T08:53:24.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:53:23 smithi047 bash[22744]: cluster 2024-09-16T08:53:22.052035+0000 mgr.a (mgr.14373) 8490 : cluster [DBG] pgmap v5887: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-16T08:53:25.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:53:24 smithi157 bash[24585]: audit 2024-09-16T08:53:23.276471+0000 mgr.a (mgr.14373) 8491 : audit [DBG] from='client.189759 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:53:25.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:53:24 smithi086 bash[24289]: audit 2024-09-16T08:53:23.276471+0000 mgr.a (mgr.14373) 8491 : audit [DBG] from='client.189759 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:53:25.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:53:24 smithi047 bash[22744]: audit 2024-09-16T08:53:23.276471+0000 mgr.a (mgr.14373) 8491 : audit [DBG] from='client.189759 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:53:26.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:53:25 smithi157 bash[24585]: cluster 2024-09-16T08:53:24.052968+0000 mgr.a (mgr.14373) 8492 : cluster [DBG] pgmap v5888: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:53:26.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:53:25 smithi086 bash[24289]: cluster 2024-09-16T08:53:24.052968+0000 mgr.a (mgr.14373) 8492 : cluster [DBG] pgmap v5888: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:53:26.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:53:25 smithi047 bash[22744]: cluster 2024-09-16T08:53:24.052968+0000 mgr.a (mgr.14373) 8492 : cluster [DBG] pgmap v5888: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:53:28.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:53:27 smithi157 bash[24585]: cluster 2024-09-16T08:53:26.053749+0000 mgr.a (mgr.14373) 8493 : cluster [DBG] pgmap v5889: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:53:28.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:53:27 smithi086 bash[24289]: cluster 2024-09-16T08:53:26.053749+0000 mgr.a (mgr.14373) 8493 : cluster [DBG] pgmap v5889: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:53:28.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:53:27 smithi047 bash[22744]: cluster 2024-09-16T08:53:26.053749+0000 mgr.a (mgr.14373) 8493 : cluster [DBG] pgmap v5889: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:53:28.702 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:53:28.703 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:53:28.703 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:53:29.491 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:53:29.491 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:53:29.491 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:53:29.491 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:53:29.491 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:53:30.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:53:29 smithi157 bash[24585]: cluster 2024-09-16T08:53:28.056033+0000 mgr.a (mgr.14373) 8494 : cluster [DBG] pgmap v5890: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:53:30.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:53:29 smithi086 bash[24289]: cluster 2024-09-16T08:53:28.056033+0000 mgr.a (mgr.14373) 8494 : cluster [DBG] pgmap v5890: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:53:30.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:53:29 smithi047 bash[22744]: cluster 2024-09-16T08:53:28.056033+0000 mgr.a (mgr.14373) 8494 : cluster [DBG] pgmap v5890: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:53:31.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:53:30 smithi157 bash[24585]: audit 2024-09-16T08:53:29.043135+0000 mgr.a (mgr.14373) 8495 : audit [DBG] from='client.189831 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:53:31.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:53:30 smithi086 bash[24289]: audit 2024-09-16T08:53:29.043135+0000 mgr.a (mgr.14373) 8495 : audit [DBG] from='client.189831 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:53:31.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:53:30 smithi047 bash[22744]: audit 2024-09-16T08:53:29.043135+0000 mgr.a (mgr.14373) 8495 : audit [DBG] from='client.189831 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:53:32.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:53:31 smithi157 bash[24585]: cluster 2024-09-16T08:53:30.056934+0000 mgr.a (mgr.14373) 8496 : cluster [DBG] pgmap v5891: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:53:32.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:53:31 smithi086 bash[24289]: cluster 2024-09-16T08:53:30.056934+0000 mgr.a (mgr.14373) 8496 : cluster [DBG] pgmap v5891: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:53:32.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:53:31 smithi047 bash[22744]: cluster 2024-09-16T08:53:30.056934+0000 mgr.a (mgr.14373) 8496 : cluster [DBG] pgmap v5891: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:53:34.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:53:33 smithi157 bash[24585]: cluster 2024-09-16T08:53:32.059213+0000 mgr.a (mgr.14373) 8497 : cluster [DBG] pgmap v5892: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:53:34.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:53:33 smithi086 bash[24289]: cluster 2024-09-16T08:53:32.059213+0000 mgr.a (mgr.14373) 8497 : cluster [DBG] pgmap v5892: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:53:34.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:53:33 smithi047 bash[22744]: cluster 2024-09-16T08:53:32.059213+0000 mgr.a (mgr.14373) 8497 : cluster [DBG] pgmap v5892: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:53:34.492 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:53:34.494 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:53:34.494 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:53:35.226 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:53:35.227 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:53:35.227 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:53:35.227 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:53:35.227 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:53:35.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:53:35 smithi157 bash[24585]: cluster 2024-09-16T08:53:34.060005+0000 mgr.a (mgr.14373) 8498 : cluster [DBG] pgmap v5893: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:53:35.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:53:35 smithi157 bash[24585]: audit 2024-09-16T08:53:34.824533+0000 mgr.a (mgr.14373) 8499 : audit [DBG] from='client.189909 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:53:35.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:53:35 smithi086 bash[24289]: cluster 2024-09-16T08:53:34.060005+0000 mgr.a (mgr.14373) 8498 : cluster [DBG] pgmap v5893: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:53:35.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:53:35 smithi086 bash[24289]: audit 2024-09-16T08:53:34.824533+0000 mgr.a (mgr.14373) 8499 : audit [DBG] from='client.189909 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:53:35.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:53:35 smithi047 bash[22744]: cluster 2024-09-16T08:53:34.060005+0000 mgr.a (mgr.14373) 8498 : cluster [DBG] pgmap v5893: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:53:35.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:53:35 smithi047 bash[22744]: audit 2024-09-16T08:53:34.824533+0000 mgr.a (mgr.14373) 8499 : audit [DBG] from='client.189909 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:53:37.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:53:37 smithi157 bash[24585]: cluster 2024-09-16T08:53:36.060988+0000 mgr.a (mgr.14373) 8500 : cluster [DBG] pgmap v5894: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:53:37.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:53:37 smithi086 bash[24289]: cluster 2024-09-16T08:53:36.060988+0000 mgr.a (mgr.14373) 8500 : cluster [DBG] pgmap v5894: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:53:37.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:53:37 smithi047 bash[22744]: cluster 2024-09-16T08:53:36.060988+0000 mgr.a (mgr.14373) 8500 : cluster [DBG] pgmap v5894: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:53:39.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:53:39 smithi157 bash[24585]: cluster 2024-09-16T08:53:38.063282+0000 mgr.a (mgr.14373) 8501 : cluster [DBG] pgmap v5895: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:53:39.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:53:39 smithi086 bash[24289]: cluster 2024-09-16T08:53:38.063282+0000 mgr.a (mgr.14373) 8501 : cluster [DBG] pgmap v5895: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:53:39.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:53:39 smithi047 bash[22744]: cluster 2024-09-16T08:53:38.063282+0000 mgr.a (mgr.14373) 8501 : cluster [DBG] pgmap v5895: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:53:40.228 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:53:40.229 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:53:40.229 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:53:41.010 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:53:41.011 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:53:41.011 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:53:41.011 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:53:41.011 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:53:41.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:53:41 smithi157 bash[24585]: cluster 2024-09-16T08:53:40.064067+0000 mgr.a (mgr.14373) 8502 : cluster [DBG] pgmap v5896: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:53:41.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:53:41 smithi157 bash[24585]: audit 2024-09-16T08:53:40.568477+0000 mgr.a (mgr.14373) 8503 : audit [DBG] from='client.189987 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:53:41.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:53:41 smithi086 bash[24289]: cluster 2024-09-16T08:53:40.064067+0000 mgr.a (mgr.14373) 8502 : cluster [DBG] pgmap v5896: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:53:41.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:53:41 smithi086 bash[24289]: audit 2024-09-16T08:53:40.568477+0000 mgr.a (mgr.14373) 8503 : audit [DBG] from='client.189987 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:53:41.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:53:41 smithi047 bash[22744]: cluster 2024-09-16T08:53:40.064067+0000 mgr.a (mgr.14373) 8502 : cluster [DBG] pgmap v5896: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:53:41.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:53:41 smithi047 bash[22744]: audit 2024-09-16T08:53:40.568477+0000 mgr.a (mgr.14373) 8503 : audit [DBG] from='client.189987 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:53:43.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:53:43 smithi157 bash[24585]: cluster 2024-09-16T08:53:42.066482+0000 mgr.a (mgr.14373) 8504 : cluster [DBG] pgmap v5897: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:53:43.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:53:43 smithi086 bash[24289]: cluster 2024-09-16T08:53:42.066482+0000 mgr.a (mgr.14373) 8504 : cluster [DBG] pgmap v5897: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:53:43.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:53:43 smithi047 bash[22744]: cluster 2024-09-16T08:53:42.066482+0000 mgr.a (mgr.14373) 8504 : cluster [DBG] pgmap v5897: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:53:45.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:53:45 smithi157 bash[24585]: cluster 2024-09-16T08:53:44.067261+0000 mgr.a (mgr.14373) 8505 : cluster [DBG] pgmap v5898: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:53:45.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:53:45 smithi086 bash[24289]: cluster 2024-09-16T08:53:44.067261+0000 mgr.a (mgr.14373) 8505 : cluster [DBG] pgmap v5898: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:53:45.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:53:45 smithi047 bash[22744]: cluster 2024-09-16T08:53:44.067261+0000 mgr.a (mgr.14373) 8505 : cluster [DBG] pgmap v5898: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:53:46.012 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:53:46.013 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:53:46.013 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:53:46.799 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:53:46.799 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:53:46.799 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:53:46.799 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:53:46.799 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:53:47.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:53:47 smithi157 bash[24585]: cluster 2024-09-16T08:53:46.068038+0000 mgr.a (mgr.14373) 8506 : cluster [DBG] pgmap v5899: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:53:47.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:53:47 smithi157 bash[24585]: audit 2024-09-16T08:53:46.353449+0000 mgr.a (mgr.14373) 8507 : audit [DBG] from='client.190062 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:53:47.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:53:47 smithi086 bash[24289]: cluster 2024-09-16T08:53:46.068038+0000 mgr.a (mgr.14373) 8506 : cluster [DBG] pgmap v5899: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:53:47.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:53:47 smithi086 bash[24289]: audit 2024-09-16T08:53:46.353449+0000 mgr.a (mgr.14373) 8507 : audit [DBG] from='client.190062 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:53:47.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:53:47 smithi047 bash[22744]: cluster 2024-09-16T08:53:46.068038+0000 mgr.a (mgr.14373) 8506 : cluster [DBG] pgmap v5899: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:53:47.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:53:47 smithi047 bash[22744]: audit 2024-09-16T08:53:46.353449+0000 mgr.a (mgr.14373) 8507 : audit [DBG] from='client.190062 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:53:49.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:53:49 smithi157 bash[24585]: cluster 2024-09-16T08:53:48.070733+0000 mgr.a (mgr.14373) 8508 : cluster [DBG] pgmap v5900: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:53:49.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:53:49 smithi086 bash[24289]: cluster 2024-09-16T08:53:48.070733+0000 mgr.a (mgr.14373) 8508 : cluster [DBG] pgmap v5900: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:53:49.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:53:49 smithi047 bash[22744]: cluster 2024-09-16T08:53:48.070733+0000 mgr.a (mgr.14373) 8508 : cluster [DBG] pgmap v5900: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:53:51.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:53:51 smithi157 bash[24585]: cluster 2024-09-16T08:53:50.071443+0000 mgr.a (mgr.14373) 8509 : cluster [DBG] pgmap v5901: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:53:51.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:53:51 smithi086 bash[24289]: cluster 2024-09-16T08:53:50.071443+0000 mgr.a (mgr.14373) 8509 : cluster [DBG] pgmap v5901: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:53:51.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:53:51 smithi047 bash[22744]: cluster 2024-09-16T08:53:50.071443+0000 mgr.a (mgr.14373) 8509 : cluster [DBG] pgmap v5901: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:53:51.800 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:53:51.801 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:53:51.801 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:53:52.558 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:53:52.558 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:53:52.558 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:53:52.559 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:53:52.559 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:53:53.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:53:53 smithi157 bash[24585]: cluster 2024-09-16T08:53:52.073348+0000 mgr.a (mgr.14373) 8510 : cluster [DBG] pgmap v5902: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:53:53.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:53:53 smithi157 bash[24585]: audit 2024-09-16T08:53:52.132379+0000 mgr.a (mgr.14373) 8511 : audit [DBG] from='client.190137 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:53:53.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:53:53 smithi086 bash[24289]: cluster 2024-09-16T08:53:52.073348+0000 mgr.a (mgr.14373) 8510 : cluster [DBG] pgmap v5902: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:53:53.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:53:53 smithi086 bash[24289]: audit 2024-09-16T08:53:52.132379+0000 mgr.a (mgr.14373) 8511 : audit [DBG] from='client.190137 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:53:53.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:53:53 smithi047 bash[22744]: cluster 2024-09-16T08:53:52.073348+0000 mgr.a (mgr.14373) 8510 : cluster [DBG] pgmap v5902: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:53:53.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:53:53 smithi047 bash[22744]: audit 2024-09-16T08:53:52.132379+0000 mgr.a (mgr.14373) 8511 : audit [DBG] from='client.190137 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:53:55.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:53:55 smithi157 bash[24585]: cluster 2024-09-16T08:53:54.074232+0000 mgr.a (mgr.14373) 8512 : cluster [DBG] pgmap v5903: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:53:55.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:53:55 smithi086 bash[24289]: cluster 2024-09-16T08:53:54.074232+0000 mgr.a (mgr.14373) 8512 : cluster [DBG] pgmap v5903: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:53:55.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:53:55 smithi047 bash[22744]: cluster 2024-09-16T08:53:54.074232+0000 mgr.a (mgr.14373) 8512 : cluster [DBG] pgmap v5903: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:53:57.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:53:57 smithi157 bash[24585]: cluster 2024-09-16T08:53:56.075030+0000 mgr.a (mgr.14373) 8513 : cluster [DBG] pgmap v5904: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T08:53:57.559 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:53:57.560 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:53:57.560 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:53:57.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:53:57 smithi086 bash[24289]: cluster 2024-09-16T08:53:56.075030+0000 mgr.a (mgr.14373) 8513 : cluster [DBG] pgmap v5904: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T08:53:57.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:53:57 smithi047 bash[22744]: cluster 2024-09-16T08:53:56.075030+0000 mgr.a (mgr.14373) 8513 : cluster [DBG] pgmap v5904: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T08:53:58.316 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:53:58.316 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:53:58.316 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:53:58.316 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:53:58.316 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:53:58.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:53:58 smithi157 bash[24585]: audit 2024-09-16T08:53:57.896560+0000 mgr.a (mgr.14373) 8514 : audit [DBG] from='client.190215 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:53:58.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:53:58 smithi086 bash[24289]: audit 2024-09-16T08:53:57.896560+0000 mgr.a (mgr.14373) 8514 : audit [DBG] from='client.190215 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:53:58.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:53:58 smithi047 bash[22744]: audit 2024-09-16T08:53:57.896560+0000 mgr.a (mgr.14373) 8514 : audit [DBG] from='client.190215 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:53:59.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:53:59 smithi157 bash[24585]: cluster 2024-09-16T08:53:58.076415+0000 mgr.a (mgr.14373) 8515 : cluster [DBG] pgmap v5905: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:53:59.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:53:59 smithi086 bash[24289]: cluster 2024-09-16T08:53:58.076415+0000 mgr.a (mgr.14373) 8515 : cluster [DBG] pgmap v5905: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:53:59.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:53:59 smithi047 bash[22744]: cluster 2024-09-16T08:53:58.076415+0000 mgr.a (mgr.14373) 8515 : cluster [DBG] pgmap v5905: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:54:01.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:54:01 smithi157 bash[24585]: cluster 2024-09-16T08:54:00.077291+0000 mgr.a (mgr.14373) 8516 : cluster [DBG] pgmap v5906: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:54:01.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:54:01 smithi086 bash[24289]: cluster 2024-09-16T08:54:00.077291+0000 mgr.a (mgr.14373) 8516 : cluster [DBG] pgmap v5906: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:54:01.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:54:01 smithi047 bash[22744]: cluster 2024-09-16T08:54:00.077291+0000 mgr.a (mgr.14373) 8516 : cluster [DBG] pgmap v5906: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:54:03.317 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:54:03.318 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:54:03.319 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:54:03.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:54:03 smithi157 bash[24585]: cluster 2024-09-16T08:54:02.079468+0000 mgr.a (mgr.14373) 8517 : cluster [DBG] pgmap v5907: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:54:03.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:54:03 smithi086 bash[24289]: cluster 2024-09-16T08:54:02.079468+0000 mgr.a (mgr.14373) 8517 : cluster [DBG] pgmap v5907: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:54:03.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:54:03 smithi047 bash[22744]: cluster 2024-09-16T08:54:02.079468+0000 mgr.a (mgr.14373) 8517 : cluster [DBG] pgmap v5907: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:54:04.116 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:54:04.116 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:54:04.116 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:54:04.117 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:54:04.117 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:54:04.552 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:54:04 smithi157 bash[24585]: audit 2024-09-16T08:54:03.429581+0000 mon.b (mon.2) 798 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T08:54:04.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:54:04 smithi157 bash[24585]: audit 2024-09-16T08:54:03.679456+0000 mgr.a (mgr.14373) 8518 : audit [DBG] from='client.190293 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:54:04.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:54:04 smithi086 bash[24289]: audit 2024-09-16T08:54:03.429581+0000 mon.b (mon.2) 798 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T08:54:04.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:54:04 smithi086 bash[24289]: audit 2024-09-16T08:54:03.679456+0000 mgr.a (mgr.14373) 8518 : audit [DBG] from='client.190293 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:54:04.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:54:04 smithi047 bash[22744]: audit 2024-09-16T08:54:03.429581+0000 mon.b (mon.2) 798 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T08:54:04.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:54:04 smithi047 bash[22744]: audit 2024-09-16T08:54:03.679456+0000 mgr.a (mgr.14373) 8518 : audit [DBG] from='client.190293 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:54:05.338 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 08:54:04 smithi047 bash[22994]: debug 2024-09-16T08:54:04.980+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T08:54:05.338 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 08:54:04 smithi047 bash[22994]: debug 2024-09-16T08:54:04.984+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T08:54:05.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:54:05 smithi047 bash[22744]: cluster 2024-09-16T08:54:04.080014+0000 mgr.a (mgr.14373) 8519 : cluster [DBG] pgmap v5908: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:54:05.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:54:05 smithi047 bash[22744]: audit 2024-09-16T08:54:04.235083+0000 mon.b (mon.2) 799 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T08:54:05.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:54:05 smithi047 bash[22744]: audit 2024-09-16T08:54:04.237135+0000 mon.b (mon.2) 800 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T08:54:05.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:54:05 smithi047 bash[22744]: audit 2024-09-16T08:54:04.246800+0000 mon.a (mon.0) 1079 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:54:05.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:54:05 smithi047 bash[22744]: audit 2024-09-16T08:54:04.253781+0000 mon.b (mon.2) 801 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:54:05.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:54:05 smithi047 bash[22744]: audit 2024-09-16T08:54:04.257380+0000 mgr.a (mgr.14373) 8520 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:54:05.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:54:05 smithi047 bash[22744]: audit 2024-09-16T08:54:04.984948+0000 mgr.a (mgr.14373) 8521 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T08:54:05.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:54:05 smithi047 bash[22744]: cephadm 2024-09-16T08:54:04.986971+0000 mgr.a (mgr.14373) 8522 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T08:54:05.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:54:05 smithi157 bash[24585]: cluster 2024-09-16T08:54:04.080014+0000 mgr.a (mgr.14373) 8519 : cluster [DBG] pgmap v5908: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:54:05.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:54:05 smithi157 bash[24585]: audit 2024-09-16T08:54:04.235083+0000 mon.b (mon.2) 799 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T08:54:05.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:54:05 smithi157 bash[24585]: audit 2024-09-16T08:54:04.237135+0000 mon.b (mon.2) 800 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T08:54:05.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:54:05 smithi157 bash[24585]: audit 2024-09-16T08:54:04.246800+0000 mon.a (mon.0) 1079 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:54:05.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:54:05 smithi157 bash[24585]: audit 2024-09-16T08:54:04.253781+0000 mon.b (mon.2) 801 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:54:05.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:54:05 smithi157 bash[24585]: audit 2024-09-16T08:54:04.257380+0000 mgr.a (mgr.14373) 8520 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:54:05.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:54:05 smithi157 bash[24585]: audit 2024-09-16T08:54:04.984948+0000 mgr.a (mgr.14373) 8521 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T08:54:05.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:54:05 smithi157 bash[24585]: cephadm 2024-09-16T08:54:04.986971+0000 mgr.a (mgr.14373) 8522 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T08:54:05.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:54:05 smithi086 bash[24289]: cluster 2024-09-16T08:54:04.080014+0000 mgr.a (mgr.14373) 8519 : cluster [DBG] pgmap v5908: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:54:05.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:54:05 smithi086 bash[24289]: audit 2024-09-16T08:54:04.235083+0000 mon.b (mon.2) 799 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T08:54:05.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:54:05 smithi086 bash[24289]: audit 2024-09-16T08:54:04.237135+0000 mon.b (mon.2) 800 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T08:54:05.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:54:05 smithi086 bash[24289]: audit 2024-09-16T08:54:04.246800+0000 mon.a (mon.0) 1079 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:54:05.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:54:05 smithi086 bash[24289]: audit 2024-09-16T08:54:04.253781+0000 mon.b (mon.2) 801 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:54:05.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:54:05 smithi086 bash[24289]: audit 2024-09-16T08:54:04.257380+0000 mgr.a (mgr.14373) 8520 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:54:05.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:54:05 smithi086 bash[24289]: audit 2024-09-16T08:54:04.984948+0000 mgr.a (mgr.14373) 8521 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T08:54:05.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:54:05 smithi086 bash[24289]: cephadm 2024-09-16T08:54:04.986971+0000 mgr.a (mgr.14373) 8522 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T08:54:07.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:54:07 smithi157 bash[24585]: cluster 2024-09-16T08:54:06.081015+0000 mgr.a (mgr.14373) 8523 : cluster [DBG] pgmap v5909: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:54:07.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:54:07 smithi086 bash[24289]: cluster 2024-09-16T08:54:06.081015+0000 mgr.a (mgr.14373) 8523 : cluster [DBG] pgmap v5909: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:54:07.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:54:07 smithi047 bash[22744]: cluster 2024-09-16T08:54:06.081015+0000 mgr.a (mgr.14373) 8523 : cluster [DBG] pgmap v5909: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:54:09.118 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:54:09.118 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:54:09.118 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:54:09.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:54:09 smithi157 bash[24585]: cluster 2024-09-16T08:54:08.083419+0000 mgr.a (mgr.14373) 8524 : cluster [DBG] pgmap v5910: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:54:09.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:54:09 smithi086 bash[24289]: cluster 2024-09-16T08:54:08.083419+0000 mgr.a (mgr.14373) 8524 : cluster [DBG] pgmap v5910: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:54:09.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:54:09 smithi047 bash[22744]: cluster 2024-09-16T08:54:08.083419+0000 mgr.a (mgr.14373) 8524 : cluster [DBG] pgmap v5910: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:54:09.897 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:54:09.897 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:54:09.897 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:54:09.898 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:54:09.898 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:54:10.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:54:10 smithi157 bash[24585]: audit 2024-09-16T08:54:09.454411+0000 mgr.a (mgr.14373) 8525 : audit [DBG] from='client.190476 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:54:10.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:54:10 smithi086 bash[24289]: audit 2024-09-16T08:54:09.454411+0000 mgr.a (mgr.14373) 8525 : audit [DBG] from='client.190476 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:54:10.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:54:10 smithi047 bash[22744]: audit 2024-09-16T08:54:09.454411+0000 mgr.a (mgr.14373) 8525 : audit [DBG] from='client.190476 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:54:11.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:54:11 smithi157 bash[24585]: cluster 2024-09-16T08:54:10.084349+0000 mgr.a (mgr.14373) 8526 : cluster [DBG] pgmap v5911: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:54:11.598 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:54:11 smithi047 bash[22744]: cluster 2024-09-16T08:54:10.084349+0000 mgr.a (mgr.14373) 8526 : cluster [DBG] pgmap v5911: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:54:11.598 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:54:11 smithi086 bash[24289]: cluster 2024-09-16T08:54:10.084349+0000 mgr.a (mgr.14373) 8526 : cluster [DBG] pgmap v5911: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:54:13.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:54:13 smithi157 bash[24585]: cluster 2024-09-16T08:54:12.086530+0000 mgr.a (mgr.14373) 8527 : cluster [DBG] pgmap v5912: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:54:13.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:54:13 smithi086 bash[24289]: cluster 2024-09-16T08:54:12.086530+0000 mgr.a (mgr.14373) 8527 : cluster [DBG] pgmap v5912: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:54:13.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:54:13 smithi047 bash[22744]: cluster 2024-09-16T08:54:12.086530+0000 mgr.a (mgr.14373) 8527 : cluster [DBG] pgmap v5912: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:54:14.899 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:54:14.899 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:54:14.899 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:54:15.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:54:15 smithi157 bash[24585]: cluster 2024-09-16T08:54:14.087263+0000 mgr.a (mgr.14373) 8528 : cluster [DBG] pgmap v5913: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:54:15.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:54:15 smithi086 bash[24289]: cluster 2024-09-16T08:54:14.087263+0000 mgr.a (mgr.14373) 8528 : cluster [DBG] pgmap v5913: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:54:15.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:54:15 smithi047 bash[22744]: cluster 2024-09-16T08:54:14.087263+0000 mgr.a (mgr.14373) 8528 : cluster [DBG] pgmap v5913: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:54:15.677 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:54:15.677 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:54:15.677 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:54:15.678 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:54:15.678 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:54:16.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:54:16 smithi157 bash[24585]: audit 2024-09-16T08:54:15.236580+0000 mgr.a (mgr.14373) 8529 : audit [DBG] from='client.190548 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:54:16.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:54:16 smithi086 bash[24289]: audit 2024-09-16T08:54:15.236580+0000 mgr.a (mgr.14373) 8529 : audit [DBG] from='client.190548 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:54:16.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:54:16 smithi047 bash[22744]: audit 2024-09-16T08:54:15.236580+0000 mgr.a (mgr.14373) 8529 : audit [DBG] from='client.190548 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:54:17.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:54:17 smithi157 bash[24585]: cluster 2024-09-16T08:54:16.088170+0000 mgr.a (mgr.14373) 8530 : cluster [DBG] pgmap v5914: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:54:17.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:54:17 smithi086 bash[24289]: cluster 2024-09-16T08:54:16.088170+0000 mgr.a (mgr.14373) 8530 : cluster [DBG] pgmap v5914: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:54:17.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:54:17 smithi047 bash[22744]: cluster 2024-09-16T08:54:16.088170+0000 mgr.a (mgr.14373) 8530 : cluster [DBG] pgmap v5914: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:54:19.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:54:19 smithi157 bash[24585]: cluster 2024-09-16T08:54:18.090411+0000 mgr.a (mgr.14373) 8531 : cluster [DBG] pgmap v5915: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:54:19.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:54:19 smithi086 bash[24289]: cluster 2024-09-16T08:54:18.090411+0000 mgr.a (mgr.14373) 8531 : cluster [DBG] pgmap v5915: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:54:19.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:54:19 smithi047 bash[22744]: cluster 2024-09-16T08:54:18.090411+0000 mgr.a (mgr.14373) 8531 : cluster [DBG] pgmap v5915: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:54:20.679 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:54:20.680 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:54:20.680 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:54:21.421 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:54:21.421 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:54:21.421 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:54:21.421 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:54:21.421 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:54:21.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:54:21 smithi157 bash[24585]: cluster 2024-09-16T08:54:20.091149+0000 mgr.a (mgr.14373) 8532 : cluster [DBG] pgmap v5916: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:54:21.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:54:21 smithi086 bash[24289]: cluster 2024-09-16T08:54:20.091149+0000 mgr.a (mgr.14373) 8532 : cluster [DBG] pgmap v5916: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:54:21.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:54:21 smithi047 bash[22744]: cluster 2024-09-16T08:54:20.091149+0000 mgr.a (mgr.14373) 8532 : cluster [DBG] pgmap v5916: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:54:22.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:54:22 smithi157 bash[24585]: audit 2024-09-16T08:54:21.007903+0000 mgr.a (mgr.14373) 8533 : audit [DBG] from='client.190623 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:54:22.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:54:22 smithi086 bash[24289]: audit 2024-09-16T08:54:21.007903+0000 mgr.a (mgr.14373) 8533 : audit [DBG] from='client.190623 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:54:22.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:54:22 smithi047 bash[22744]: audit 2024-09-16T08:54:21.007903+0000 mgr.a (mgr.14373) 8533 : audit [DBG] from='client.190623 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:54:23.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:54:23 smithi157 bash[24585]: cluster 2024-09-16T08:54:22.093482+0000 mgr.a (mgr.14373) 8534 : cluster [DBG] pgmap v5917: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-16T08:54:23.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:54:23 smithi086 bash[24289]: cluster 2024-09-16T08:54:22.093482+0000 mgr.a (mgr.14373) 8534 : cluster [DBG] pgmap v5917: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-16T08:54:23.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:54:23 smithi047 bash[22744]: cluster 2024-09-16T08:54:22.093482+0000 mgr.a (mgr.14373) 8534 : cluster [DBG] pgmap v5917: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-16T08:54:25.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:54:25 smithi157 bash[24585]: cluster 2024-09-16T08:54:24.094223+0000 mgr.a (mgr.14373) 8535 : cluster [DBG] pgmap v5918: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T08:54:25.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:54:25 smithi086 bash[24289]: cluster 2024-09-16T08:54:24.094223+0000 mgr.a (mgr.14373) 8535 : cluster [DBG] pgmap v5918: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T08:54:25.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:54:25 smithi047 bash[22744]: cluster 2024-09-16T08:54:24.094223+0000 mgr.a (mgr.14373) 8535 : cluster [DBG] pgmap v5918: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T08:54:26.423 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:54:26.423 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:54:26.423 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:54:27.186 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:54:27.186 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:54:27.186 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:54:27.186 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:54:27.186 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:54:27.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:54:27 smithi157 bash[24585]: cluster 2024-09-16T08:54:26.095011+0000 mgr.a (mgr.14373) 8536 : cluster [DBG] pgmap v5919: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T08:54:27.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:54:27 smithi157 bash[24585]: audit 2024-09-16T08:54:26.760992+0000 mgr.a (mgr.14373) 8537 : audit [DBG] from='client.190698 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:54:27.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:54:27 smithi086 bash[24289]: cluster 2024-09-16T08:54:26.095011+0000 mgr.a (mgr.14373) 8536 : cluster [DBG] pgmap v5919: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T08:54:27.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:54:27 smithi086 bash[24289]: audit 2024-09-16T08:54:26.760992+0000 mgr.a (mgr.14373) 8537 : audit [DBG] from='client.190698 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:54:27.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:54:27 smithi047 bash[22744]: cluster 2024-09-16T08:54:26.095011+0000 mgr.a (mgr.14373) 8536 : cluster [DBG] pgmap v5919: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T08:54:27.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:54:27 smithi047 bash[22744]: audit 2024-09-16T08:54:26.760992+0000 mgr.a (mgr.14373) 8537 : audit [DBG] from='client.190698 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:54:29.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:54:29 smithi157 bash[24585]: cluster 2024-09-16T08:54:28.097815+0000 mgr.a (mgr.14373) 8538 : cluster [DBG] pgmap v5920: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:54:29.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:54:29 smithi086 bash[24289]: cluster 2024-09-16T08:54:28.097815+0000 mgr.a (mgr.14373) 8538 : cluster [DBG] pgmap v5920: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:54:29.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:54:29 smithi047 bash[22744]: cluster 2024-09-16T08:54:28.097815+0000 mgr.a (mgr.14373) 8538 : cluster [DBG] pgmap v5920: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:54:31.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:54:31 smithi157 bash[24585]: cluster 2024-09-16T08:54:30.098807+0000 mgr.a (mgr.14373) 8539 : cluster [DBG] pgmap v5921: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:54:31.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:54:31 smithi086 bash[24289]: cluster 2024-09-16T08:54:30.098807+0000 mgr.a (mgr.14373) 8539 : cluster [DBG] pgmap v5921: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:54:31.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:54:31 smithi047 bash[22744]: cluster 2024-09-16T08:54:30.098807+0000 mgr.a (mgr.14373) 8539 : cluster [DBG] pgmap v5921: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:54:32.185 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:54:32.186 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:54:32.186 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:54:32.973 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:54:32.973 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:54:32.973 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:54:32.973 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:54:32.973 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:54:33.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:54:33 smithi157 bash[24585]: cluster 2024-09-16T08:54:32.100831+0000 mgr.a (mgr.14373) 8540 : cluster [DBG] pgmap v5922: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:54:33.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:54:33 smithi157 bash[24585]: audit 2024-09-16T08:54:32.523063+0000 mgr.a (mgr.14373) 8541 : audit [DBG] from='client.190773 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:54:33.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:54:33 smithi086 bash[24289]: cluster 2024-09-16T08:54:32.100831+0000 mgr.a (mgr.14373) 8540 : cluster [DBG] pgmap v5922: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:54:33.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:54:33 smithi086 bash[24289]: audit 2024-09-16T08:54:32.523063+0000 mgr.a (mgr.14373) 8541 : audit [DBG] from='client.190773 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:54:33.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:54:33 smithi047 bash[22744]: cluster 2024-09-16T08:54:32.100831+0000 mgr.a (mgr.14373) 8540 : cluster [DBG] pgmap v5922: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:54:33.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:54:33 smithi047 bash[22744]: audit 2024-09-16T08:54:32.523063+0000 mgr.a (mgr.14373) 8541 : audit [DBG] from='client.190773 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:54:35.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:54:35 smithi157 bash[24585]: cluster 2024-09-16T08:54:34.101800+0000 mgr.a (mgr.14373) 8542 : cluster [DBG] pgmap v5923: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-16T08:54:35.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:54:35 smithi086 bash[24289]: cluster 2024-09-16T08:54:34.101800+0000 mgr.a (mgr.14373) 8542 : cluster [DBG] pgmap v5923: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-16T08:54:35.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:54:35 smithi047 bash[22744]: cluster 2024-09-16T08:54:34.101800+0000 mgr.a (mgr.14373) 8542 : cluster [DBG] pgmap v5923: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-16T08:54:37.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:54:37 smithi157 bash[24585]: cluster 2024-09-16T08:54:36.102648+0000 mgr.a (mgr.14373) 8543 : cluster [DBG] pgmap v5924: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-16T08:54:37.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:54:37 smithi086 bash[24289]: cluster 2024-09-16T08:54:36.102648+0000 mgr.a (mgr.14373) 8543 : cluster [DBG] pgmap v5924: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-16T08:54:37.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:54:37 smithi047 bash[22744]: cluster 2024-09-16T08:54:36.102648+0000 mgr.a (mgr.14373) 8543 : cluster [DBG] pgmap v5924: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-16T08:54:37.974 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:54:37.975 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:54:37.975 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:54:38.727 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:54:38.727 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:54:38.727 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:54:38.727 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:54:38.727 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:54:39.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:54:39 smithi157 bash[24585]: cluster 2024-09-16T08:54:38.103873+0000 mgr.a (mgr.14373) 8544 : cluster [DBG] pgmap v5925: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-16T08:54:39.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:54:39 smithi157 bash[24585]: audit 2024-09-16T08:54:38.310148+0000 mgr.a (mgr.14373) 8545 : audit [DBG] from='client.190848 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:54:39.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:54:39 smithi086 bash[24289]: cluster 2024-09-16T08:54:38.103873+0000 mgr.a (mgr.14373) 8544 : cluster [DBG] pgmap v5925: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-16T08:54:39.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:54:39 smithi086 bash[24289]: audit 2024-09-16T08:54:38.310148+0000 mgr.a (mgr.14373) 8545 : audit [DBG] from='client.190848 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:54:39.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:54:39 smithi047 bash[22744]: cluster 2024-09-16T08:54:38.103873+0000 mgr.a (mgr.14373) 8544 : cluster [DBG] pgmap v5925: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-16T08:54:39.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:54:39 smithi047 bash[22744]: audit 2024-09-16T08:54:38.310148+0000 mgr.a (mgr.14373) 8545 : audit [DBG] from='client.190848 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:54:41.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:54:41 smithi157 bash[24585]: cluster 2024-09-16T08:54:40.104826+0000 mgr.a (mgr.14373) 8546 : cluster [DBG] pgmap v5926: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:54:41.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:54:41 smithi086 bash[24289]: cluster 2024-09-16T08:54:40.104826+0000 mgr.a (mgr.14373) 8546 : cluster [DBG] pgmap v5926: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:54:41.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:54:41 smithi047 bash[22744]: cluster 2024-09-16T08:54:40.104826+0000 mgr.a (mgr.14373) 8546 : cluster [DBG] pgmap v5926: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:54:43.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:54:43 smithi157 bash[24585]: cluster 2024-09-16T08:54:42.107001+0000 mgr.a (mgr.14373) 8547 : cluster [DBG] pgmap v5927: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:54:43.567 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:54:43 smithi086 bash[24289]: cluster 2024-09-16T08:54:42.107001+0000 mgr.a (mgr.14373) 8547 : cluster [DBG] pgmap v5927: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:54:43.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:54:43 smithi047 bash[22744]: cluster 2024-09-16T08:54:42.107001+0000 mgr.a (mgr.14373) 8547 : cluster [DBG] pgmap v5927: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:54:43.728 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:54:43.729 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:54:43.729 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:54:44.471 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:54:44.472 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:54:44.472 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:54:44.472 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:54:44.472 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:54:45.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:54:45 smithi157 bash[24585]: audit 2024-09-16T08:54:44.059411+0000 mgr.a (mgr.14373) 8548 : audit [DBG] from='client.190926 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:54:45.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:54:45 smithi157 bash[24585]: cluster 2024-09-16T08:54:44.108002+0000 mgr.a (mgr.14373) 8549 : cluster [DBG] pgmap v5928: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:54:45.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:54:45 smithi086 bash[24289]: audit 2024-09-16T08:54:44.059411+0000 mgr.a (mgr.14373) 8548 : audit [DBG] from='client.190926 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:54:45.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:54:45 smithi086 bash[24289]: cluster 2024-09-16T08:54:44.108002+0000 mgr.a (mgr.14373) 8549 : cluster [DBG] pgmap v5928: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:54:45.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:54:45 smithi047 bash[22744]: audit 2024-09-16T08:54:44.059411+0000 mgr.a (mgr.14373) 8548 : audit [DBG] from='client.190926 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:54:45.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:54:45 smithi047 bash[22744]: cluster 2024-09-16T08:54:44.108002+0000 mgr.a (mgr.14373) 8549 : cluster [DBG] pgmap v5928: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:54:47.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:54:47 smithi157 bash[24585]: cluster 2024-09-16T08:54:46.108993+0000 mgr.a (mgr.14373) 8550 : cluster [DBG] pgmap v5929: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:54:47.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:54:47 smithi086 bash[24289]: cluster 2024-09-16T08:54:46.108993+0000 mgr.a (mgr.14373) 8550 : cluster [DBG] pgmap v5929: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:54:47.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:54:47 smithi047 bash[22744]: cluster 2024-09-16T08:54:46.108993+0000 mgr.a (mgr.14373) 8550 : cluster [DBG] pgmap v5929: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:54:49.473 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:54:49.473 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:54:49.474 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:54:49.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:54:49 smithi157 bash[24585]: cluster 2024-09-16T08:54:48.111245+0000 mgr.a (mgr.14373) 8551 : cluster [DBG] pgmap v5930: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:54:49.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:54:49 smithi086 bash[24289]: cluster 2024-09-16T08:54:48.111245+0000 mgr.a (mgr.14373) 8551 : cluster [DBG] pgmap v5930: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:54:49.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:54:49 smithi047 bash[22744]: cluster 2024-09-16T08:54:48.111245+0000 mgr.a (mgr.14373) 8551 : cluster [DBG] pgmap v5930: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:54:50.250 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:54:50.250 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:54:50.250 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:54:50.250 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:54:50.250 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:54:50.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:54:50 smithi086 bash[24289]: audit 2024-09-16T08:54:49.812192+0000 mgr.a (mgr.14373) 8552 : audit [DBG] from='client.191004 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:54:50.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:54:50 smithi047 bash[22744]: audit 2024-09-16T08:54:49.812192+0000 mgr.a (mgr.14373) 8552 : audit [DBG] from='client.191004 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:54:50.802 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:54:50 smithi157 bash[24585]: audit 2024-09-16T08:54:49.812192+0000 mgr.a (mgr.14373) 8552 : audit [DBG] from='client.191004 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:54:51.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:54:51 smithi086 bash[24289]: cluster 2024-09-16T08:54:50.111896+0000 mgr.a (mgr.14373) 8553 : cluster [DBG] pgmap v5931: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:54:51.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:54:51 smithi047 bash[22744]: cluster 2024-09-16T08:54:50.111896+0000 mgr.a (mgr.14373) 8553 : cluster [DBG] pgmap v5931: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:54:51.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:54:51 smithi157 bash[24585]: cluster 2024-09-16T08:54:50.111896+0000 mgr.a (mgr.14373) 8553 : cluster [DBG] pgmap v5931: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:54:53.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:54:53 smithi086 bash[24289]: cluster 2024-09-16T08:54:52.114126+0000 mgr.a (mgr.14373) 8554 : cluster [DBG] pgmap v5932: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:54:53.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:54:53 smithi047 bash[22744]: cluster 2024-09-16T08:54:52.114126+0000 mgr.a (mgr.14373) 8554 : cluster [DBG] pgmap v5932: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:54:53.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:54:53 smithi157 bash[24585]: cluster 2024-09-16T08:54:52.114126+0000 mgr.a (mgr.14373) 8554 : cluster [DBG] pgmap v5932: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:54:55.251 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:54:55.252 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:54:55.252 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:54:55.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:54:55 smithi086 bash[24289]: cluster 2024-09-16T08:54:54.114948+0000 mgr.a (mgr.14373) 8555 : cluster [DBG] pgmap v5933: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:54:55.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:54:55 smithi047 bash[22744]: cluster 2024-09-16T08:54:54.114948+0000 mgr.a (mgr.14373) 8555 : cluster [DBG] pgmap v5933: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:54:55.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:54:55 smithi157 bash[24585]: cluster 2024-09-16T08:54:54.114948+0000 mgr.a (mgr.14373) 8555 : cluster [DBG] pgmap v5933: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:54:55.998 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:54:55.998 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:54:55.998 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:54:55.998 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:54:55.999 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:54:56.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:54:56 smithi086 bash[24289]: audit 2024-09-16T08:54:55.583347+0000 mgr.a (mgr.14373) 8556 : audit [DBG] from='client.191079 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:54:56.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:54:56 smithi047 bash[22744]: audit 2024-09-16T08:54:55.583347+0000 mgr.a (mgr.14373) 8556 : audit [DBG] from='client.191079 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:54:56.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:54:56 smithi157 bash[24585]: audit 2024-09-16T08:54:55.583347+0000 mgr.a (mgr.14373) 8556 : audit [DBG] from='client.191079 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:54:57.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:54:57 smithi086 bash[24289]: cluster 2024-09-16T08:54:56.115509+0000 mgr.a (mgr.14373) 8557 : cluster [DBG] pgmap v5934: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:54:57.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:54:57 smithi047 bash[22744]: cluster 2024-09-16T08:54:56.115509+0000 mgr.a (mgr.14373) 8557 : cluster [DBG] pgmap v5934: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:54:57.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:54:57 smithi157 bash[24585]: cluster 2024-09-16T08:54:56.115509+0000 mgr.a (mgr.14373) 8557 : cluster [DBG] pgmap v5934: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:54:59.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:54:59 smithi157 bash[24585]: cluster 2024-09-16T08:54:58.117852+0000 mgr.a (mgr.14373) 8558 : cluster [DBG] pgmap v5935: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:54:59.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:54:59 smithi086 bash[24289]: cluster 2024-09-16T08:54:58.117852+0000 mgr.a (mgr.14373) 8558 : cluster [DBG] pgmap v5935: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:54:59.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:54:59 smithi047 bash[22744]: cluster 2024-09-16T08:54:58.117852+0000 mgr.a (mgr.14373) 8558 : cluster [DBG] pgmap v5935: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:55:00.999 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:55:01.000 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:55:01.000 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:55:01.466 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:55:01 smithi047 bash[22744]: cluster 2024-09-16T08:55:00.118638+0000 mgr.a (mgr.14373) 8559 : cluster [DBG] pgmap v5936: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:55:01.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:55:01 smithi157 bash[24585]: cluster 2024-09-16T08:55:00.118638+0000 mgr.a (mgr.14373) 8559 : cluster [DBG] pgmap v5936: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:55:01.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:55:01 smithi086 bash[24289]: cluster 2024-09-16T08:55:00.118638+0000 mgr.a (mgr.14373) 8559 : cluster [DBG] pgmap v5936: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:55:01.732 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:55:01.733 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:55:01.733 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:55:01.733 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:55:01.733 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:55:02.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:55:02 smithi157 bash[24585]: audit 2024-09-16T08:55:01.334373+0000 mgr.a (mgr.14373) 8560 : audit [DBG] from='client.191157 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:55:02.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:55:02 smithi086 bash[24289]: audit 2024-09-16T08:55:01.334373+0000 mgr.a (mgr.14373) 8560 : audit [DBG] from='client.191157 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:55:02.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:55:02 smithi047 bash[22744]: audit 2024-09-16T08:55:01.334373+0000 mgr.a (mgr.14373) 8560 : audit [DBG] from='client.191157 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:55:03.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:55:03 smithi157 bash[24585]: cluster 2024-09-16T08:55:02.121384+0000 mgr.a (mgr.14373) 8561 : cluster [DBG] pgmap v5937: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:55:03.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:55:03 smithi086 bash[24289]: cluster 2024-09-16T08:55:02.121384+0000 mgr.a (mgr.14373) 8561 : cluster [DBG] pgmap v5937: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:55:03.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:55:03 smithi047 bash[22744]: cluster 2024-09-16T08:55:02.121384+0000 mgr.a (mgr.14373) 8561 : cluster [DBG] pgmap v5937: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:55:05.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:55:05 smithi157 bash[24585]: cluster 2024-09-16T08:55:04.122238+0000 mgr.a (mgr.14373) 8562 : cluster [DBG] pgmap v5938: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:55:05.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:55:05 smithi157 bash[24585]: audit 2024-09-16T08:55:05.036898+0000 mon.b (mon.2) 802 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T08:55:05.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:55:05 smithi086 bash[24289]: cluster 2024-09-16T08:55:04.122238+0000 mgr.a (mgr.14373) 8562 : cluster [DBG] pgmap v5938: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:55:05.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:55:05 smithi086 bash[24289]: audit 2024-09-16T08:55:05.036898+0000 mon.b (mon.2) 802 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T08:55:05.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:55:05 smithi047 bash[22744]: cluster 2024-09-16T08:55:04.122238+0000 mgr.a (mgr.14373) 8562 : cluster [DBG] pgmap v5938: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:55:05.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:55:05 smithi047 bash[22744]: audit 2024-09-16T08:55:05.036898+0000 mon.b (mon.2) 802 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T08:55:06.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:55:06 smithi157 bash[24585]: audit 2024-09-16T08:55:05.862420+0000 mon.b (mon.2) 803 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T08:55:06.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:55:06 smithi157 bash[24585]: audit 2024-09-16T08:55:05.864637+0000 mon.b (mon.2) 804 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T08:55:06.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:55:06 smithi157 bash[24585]: audit 2024-09-16T08:55:05.876028+0000 mon.a (mon.0) 1080 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:55:06.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:55:06 smithi157 bash[24585]: audit 2024-09-16T08:55:05.881590+0000 mon.b (mon.2) 805 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:55:06.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:55:06 smithi157 bash[24585]: audit 2024-09-16T08:55:05.886053+0000 mgr.a (mgr.14373) 8563 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:55:06.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:55:06 smithi086 bash[24289]: audit 2024-09-16T08:55:05.862420+0000 mon.b (mon.2) 803 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T08:55:06.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:55:06 smithi086 bash[24289]: audit 2024-09-16T08:55:05.864637+0000 mon.b (mon.2) 804 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T08:55:06.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:55:06 smithi086 bash[24289]: audit 2024-09-16T08:55:05.876028+0000 mon.a (mon.0) 1080 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:55:06.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:55:06 smithi086 bash[24289]: audit 2024-09-16T08:55:05.881590+0000 mon.b (mon.2) 805 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:55:06.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:55:06 smithi086 bash[24289]: audit 2024-09-16T08:55:05.886053+0000 mgr.a (mgr.14373) 8563 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:55:06.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:55:06 smithi047 bash[22744]: audit 2024-09-16T08:55:05.862420+0000 mon.b (mon.2) 803 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T08:55:06.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:55:06 smithi047 bash[22744]: audit 2024-09-16T08:55:05.864637+0000 mon.b (mon.2) 804 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T08:55:06.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:55:06 smithi047 bash[22744]: audit 2024-09-16T08:55:05.876028+0000 mon.a (mon.0) 1080 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:55:06.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:55:06 smithi047 bash[22744]: audit 2024-09-16T08:55:05.881590+0000 mon.b (mon.2) 805 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:55:06.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:55:06 smithi047 bash[22744]: audit 2024-09-16T08:55:05.886053+0000 mgr.a (mgr.14373) 8563 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:55:06.734 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:55:06.734 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:55:06.734 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:55:07.088 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 08:55:06 smithi047 bash[22994]: debug 2024-09-16T08:55:06.611+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T08:55:07.088 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 08:55:06 smithi047 bash[22994]: debug 2024-09-16T08:55:06.611+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T08:55:07.472 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:55:07.472 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:55:07.472 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:55:07.472 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:55:07.472 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:55:08.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:55:07 smithi157 bash[24585]: cluster 2024-09-16T08:55:06.122811+0000 mgr.a (mgr.14373) 8564 : cluster [DBG] pgmap v5939: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T08:55:08.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:55:07 smithi157 bash[24585]: audit 2024-09-16T08:55:06.614991+0000 mgr.a (mgr.14373) 8565 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T08:55:08.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:55:07 smithi157 bash[24585]: cephadm 2024-09-16T08:55:06.616974+0000 mgr.a (mgr.14373) 8566 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T08:55:08.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:55:07 smithi086 bash[24289]: cluster 2024-09-16T08:55:06.122811+0000 mgr.a (mgr.14373) 8564 : cluster [DBG] pgmap v5939: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T08:55:08.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:55:07 smithi086 bash[24289]: audit 2024-09-16T08:55:06.614991+0000 mgr.a (mgr.14373) 8565 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T08:55:08.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:55:07 smithi086 bash[24289]: cephadm 2024-09-16T08:55:06.616974+0000 mgr.a (mgr.14373) 8566 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T08:55:08.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:55:07 smithi047 bash[22744]: cluster 2024-09-16T08:55:06.122811+0000 mgr.a (mgr.14373) 8564 : cluster [DBG] pgmap v5939: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T08:55:08.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:55:07 smithi047 bash[22744]: audit 2024-09-16T08:55:06.614991+0000 mgr.a (mgr.14373) 8565 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T08:55:08.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:55:07 smithi047 bash[22744]: cephadm 2024-09-16T08:55:06.616974+0000 mgr.a (mgr.14373) 8566 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T08:55:09.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:55:08 smithi157 bash[24585]: audit 2024-09-16T08:55:07.054880+0000 mgr.a (mgr.14373) 8567 : audit [DBG] from='client.191340 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:55:09.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:55:08 smithi086 bash[24289]: audit 2024-09-16T08:55:07.054880+0000 mgr.a (mgr.14373) 8567 : audit [DBG] from='client.191340 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:55:09.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:55:08 smithi047 bash[22744]: audit 2024-09-16T08:55:07.054880+0000 mgr.a (mgr.14373) 8567 : audit [DBG] from='client.191340 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:55:10.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:55:09 smithi157 bash[24585]: cluster 2024-09-16T08:55:08.125552+0000 mgr.a (mgr.14373) 8568 : cluster [DBG] pgmap v5940: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 3.7 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-16T08:55:10.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:55:09 smithi086 bash[24289]: cluster 2024-09-16T08:55:08.125552+0000 mgr.a (mgr.14373) 8568 : cluster [DBG] pgmap v5940: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 3.7 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-16T08:55:10.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:55:09 smithi047 bash[22744]: cluster 2024-09-16T08:55:08.125552+0000 mgr.a (mgr.14373) 8568 : cluster [DBG] pgmap v5940: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 3.7 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-16T08:55:12.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:55:11 smithi157 bash[24585]: cluster 2024-09-16T08:55:10.126381+0000 mgr.a (mgr.14373) 8569 : cluster [DBG] pgmap v5941: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.8 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-16T08:55:12.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:55:11 smithi086 bash[24289]: cluster 2024-09-16T08:55:10.126381+0000 mgr.a (mgr.14373) 8569 : cluster [DBG] pgmap v5941: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.8 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-16T08:55:12.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:55:11 smithi047 bash[22744]: cluster 2024-09-16T08:55:10.126381+0000 mgr.a (mgr.14373) 8569 : cluster [DBG] pgmap v5941: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.8 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-16T08:55:12.473 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:55:12.474 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:55:12.474 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:55:13.225 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:55:13.225 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:55:13.225 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:55:13.226 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:55:13.226 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:55:14.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:55:13 smithi157 bash[24585]: cluster 2024-09-16T08:55:12.128408+0000 mgr.a (mgr.14373) 8570 : cluster [DBG] pgmap v5942: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:55:14.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:55:13 smithi157 bash[24585]: audit 2024-09-16T08:55:12.806985+0000 mgr.a (mgr.14373) 8571 : audit [DBG] from='client.191418 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:55:14.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:55:13 smithi086 bash[24289]: cluster 2024-09-16T08:55:12.128408+0000 mgr.a (mgr.14373) 8570 : cluster [DBG] pgmap v5942: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:55:14.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:55:13 smithi086 bash[24289]: audit 2024-09-16T08:55:12.806985+0000 mgr.a (mgr.14373) 8571 : audit [DBG] from='client.191418 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:55:14.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:55:13 smithi047 bash[22744]: cluster 2024-09-16T08:55:12.128408+0000 mgr.a (mgr.14373) 8570 : cluster [DBG] pgmap v5942: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:55:14.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:55:13 smithi047 bash[22744]: audit 2024-09-16T08:55:12.806985+0000 mgr.a (mgr.14373) 8571 : audit [DBG] from='client.191418 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:55:16.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:55:15 smithi157 bash[24585]: cluster 2024-09-16T08:55:14.129368+0000 mgr.a (mgr.14373) 8572 : cluster [DBG] pgmap v5943: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:55:16.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:55:15 smithi086 bash[24289]: cluster 2024-09-16T08:55:14.129368+0000 mgr.a (mgr.14373) 8572 : cluster [DBG] pgmap v5943: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:55:16.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:55:15 smithi047 bash[22744]: cluster 2024-09-16T08:55:14.129368+0000 mgr.a (mgr.14373) 8572 : cluster [DBG] pgmap v5943: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:55:18.227 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:55:18.227 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:55:18.228 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:55:18.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:55:17 smithi157 bash[24585]: cluster 2024-09-16T08:55:16.130153+0000 mgr.a (mgr.14373) 8573 : cluster [DBG] pgmap v5944: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:55:18.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:55:17 smithi086 bash[24289]: cluster 2024-09-16T08:55:16.130153+0000 mgr.a (mgr.14373) 8573 : cluster [DBG] pgmap v5944: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:55:18.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:55:17 smithi047 bash[22744]: cluster 2024-09-16T08:55:16.130153+0000 mgr.a (mgr.14373) 8573 : cluster [DBG] pgmap v5944: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:55:19.005 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:55:19.115 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:55:19.115 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:55:19.115 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:55:19.115 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:55:20.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:55:19 smithi157 bash[24585]: cluster 2024-09-16T08:55:18.132410+0000 mgr.a (mgr.14373) 8574 : cluster [DBG] pgmap v5945: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:55:20.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:55:19 smithi157 bash[24585]: audit 2024-09-16T08:55:18.566661+0000 mgr.a (mgr.14373) 8575 : audit [DBG] from='client.191496 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:55:20.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:55:19 smithi086 bash[24289]: cluster 2024-09-16T08:55:18.132410+0000 mgr.a (mgr.14373) 8574 : cluster [DBG] pgmap v5945: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:55:20.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:55:19 smithi086 bash[24289]: audit 2024-09-16T08:55:18.566661+0000 mgr.a (mgr.14373) 8575 : audit [DBG] from='client.191496 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:55:20.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:55:19 smithi047 bash[22744]: cluster 2024-09-16T08:55:18.132410+0000 mgr.a (mgr.14373) 8574 : cluster [DBG] pgmap v5945: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:55:20.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:55:19 smithi047 bash[22744]: audit 2024-09-16T08:55:18.566661+0000 mgr.a (mgr.14373) 8575 : audit [DBG] from='client.191496 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:55:22.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:55:21 smithi157 bash[24585]: cluster 2024-09-16T08:55:20.133306+0000 mgr.a (mgr.14373) 8576 : cluster [DBG] pgmap v5946: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 5.1 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-16T08:55:22.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:55:21 smithi086 bash[24289]: cluster 2024-09-16T08:55:20.133306+0000 mgr.a (mgr.14373) 8576 : cluster [DBG] pgmap v5946: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 5.1 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-16T08:55:22.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:55:21 smithi047 bash[22744]: cluster 2024-09-16T08:55:20.133306+0000 mgr.a (mgr.14373) 8576 : cluster [DBG] pgmap v5946: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 5.1 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-16T08:55:24.007 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:55:24.008 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:55:24.008 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:55:24.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:55:23 smithi157 bash[24585]: cluster 2024-09-16T08:55:22.135558+0000 mgr.a (mgr.14373) 8577 : cluster [DBG] pgmap v5947: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.0 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-16T08:55:24.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:55:23 smithi086 bash[24289]: cluster 2024-09-16T08:55:22.135558+0000 mgr.a (mgr.14373) 8577 : cluster [DBG] pgmap v5947: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.0 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-16T08:55:24.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:55:23 smithi047 bash[22744]: cluster 2024-09-16T08:55:22.135558+0000 mgr.a (mgr.14373) 8577 : cluster [DBG] pgmap v5947: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.0 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-16T08:55:24.746 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:55:24.746 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:55:24.746 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:55:24.746 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:55:24.747 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:55:26.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:55:25 smithi157 bash[24585]: cluster 2024-09-16T08:55:24.136048+0000 mgr.a (mgr.14373) 8578 : cluster [DBG] pgmap v5948: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:55:26.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:55:25 smithi157 bash[24585]: audit 2024-09-16T08:55:24.335947+0000 mgr.a (mgr.14373) 8579 : audit [DBG] from='client.191571 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:55:26.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:55:25 smithi086 bash[24289]: cluster 2024-09-16T08:55:24.136048+0000 mgr.a (mgr.14373) 8578 : cluster [DBG] pgmap v5948: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:55:26.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:55:25 smithi086 bash[24289]: audit 2024-09-16T08:55:24.335947+0000 mgr.a (mgr.14373) 8579 : audit [DBG] from='client.191571 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:55:26.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:55:25 smithi047 bash[22744]: cluster 2024-09-16T08:55:24.136048+0000 mgr.a (mgr.14373) 8578 : cluster [DBG] pgmap v5948: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:55:26.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:55:25 smithi047 bash[22744]: audit 2024-09-16T08:55:24.335947+0000 mgr.a (mgr.14373) 8579 : audit [DBG] from='client.191571 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:55:28.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:55:27 smithi157 bash[24585]: cluster 2024-09-16T08:55:26.136930+0000 mgr.a (mgr.14373) 8580 : cluster [DBG] pgmap v5949: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:55:28.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:55:27 smithi086 bash[24289]: cluster 2024-09-16T08:55:26.136930+0000 mgr.a (mgr.14373) 8580 : cluster [DBG] pgmap v5949: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:55:28.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:55:27 smithi047 bash[22744]: cluster 2024-09-16T08:55:26.136930+0000 mgr.a (mgr.14373) 8580 : cluster [DBG] pgmap v5949: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:55:29.747 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:55:29.748 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:55:29.748 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:55:30.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:55:29 smithi157 bash[24585]: cluster 2024-09-16T08:55:28.139196+0000 mgr.a (mgr.14373) 8581 : cluster [DBG] pgmap v5950: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:55:30.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:55:29 smithi086 bash[24289]: cluster 2024-09-16T08:55:28.139196+0000 mgr.a (mgr.14373) 8581 : cluster [DBG] pgmap v5950: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:55:30.337 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:55:29 smithi047 bash[22744]: cluster 2024-09-16T08:55:28.139196+0000 mgr.a (mgr.14373) 8581 : cluster [DBG] pgmap v5950: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:55:30.520 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:55:30.520 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:55:30.520 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:55:30.520 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:55:30.520 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:55:32.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:55:31 smithi157 bash[24585]: audit 2024-09-16T08:55:30.088870+0000 mgr.a (mgr.14373) 8582 : audit [DBG] from='client.191649 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:55:32.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:55:31 smithi157 bash[24585]: cluster 2024-09-16T08:55:30.140113+0000 mgr.a (mgr.14373) 8583 : cluster [DBG] pgmap v5951: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:55:32.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:55:31 smithi086 bash[24289]: audit 2024-09-16T08:55:30.088870+0000 mgr.a (mgr.14373) 8582 : audit [DBG] from='client.191649 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:55:32.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:55:31 smithi086 bash[24289]: cluster 2024-09-16T08:55:30.140113+0000 mgr.a (mgr.14373) 8583 : cluster [DBG] pgmap v5951: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:55:32.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:55:31 smithi047 bash[22744]: audit 2024-09-16T08:55:30.088870+0000 mgr.a (mgr.14373) 8582 : audit [DBG] from='client.191649 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:55:32.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:55:31 smithi047 bash[22744]: cluster 2024-09-16T08:55:30.140113+0000 mgr.a (mgr.14373) 8583 : cluster [DBG] pgmap v5951: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:55:34.305 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:55:33 smithi157 bash[24585]: cluster 2024-09-16T08:55:32.142496+0000 mgr.a (mgr.14373) 8584 : cluster [DBG] pgmap v5952: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:55:34.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:55:33 smithi086 bash[24289]: cluster 2024-09-16T08:55:32.142496+0000 mgr.a (mgr.14373) 8584 : cluster [DBG] pgmap v5952: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:55:34.544 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:55:33 smithi047 bash[22744]: cluster 2024-09-16T08:55:32.142496+0000 mgr.a (mgr.14373) 8584 : cluster [DBG] pgmap v5952: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:55:35.521 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:55:35.522 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:55:35.522 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:55:36.293 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:55:36.293 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:55:36.294 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:55:36.294 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:55:36.294 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:55:36.302 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:55:35 smithi157 bash[24585]: cluster 2024-09-16T08:55:34.143243+0000 mgr.a (mgr.14373) 8585 : cluster [DBG] pgmap v5953: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:55:36.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:55:35 smithi086 bash[24289]: cluster 2024-09-16T08:55:34.143243+0000 mgr.a (mgr.14373) 8585 : cluster [DBG] pgmap v5953: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:55:36.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:55:35 smithi047 bash[22744]: cluster 2024-09-16T08:55:34.143243+0000 mgr.a (mgr.14373) 8585 : cluster [DBG] pgmap v5953: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:55:37.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:55:36 smithi157 bash[24585]: audit 2024-09-16T08:55:35.864351+0000 mgr.a (mgr.14373) 8586 : audit [DBG] from='client.191727 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:55:37.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:55:36 smithi086 bash[24289]: audit 2024-09-16T08:55:35.864351+0000 mgr.a (mgr.14373) 8586 : audit [DBG] from='client.191727 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:55:37.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:55:36 smithi047 bash[22744]: audit 2024-09-16T08:55:35.864351+0000 mgr.a (mgr.14373) 8586 : audit [DBG] from='client.191727 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:55:38.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:55:37 smithi157 bash[24585]: cluster 2024-09-16T08:55:36.143784+0000 mgr.a (mgr.14373) 8587 : cluster [DBG] pgmap v5954: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:55:38.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:55:37 smithi086 bash[24289]: cluster 2024-09-16T08:55:36.143784+0000 mgr.a (mgr.14373) 8587 : cluster [DBG] pgmap v5954: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:55:38.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:55:37 smithi047 bash[22744]: cluster 2024-09-16T08:55:36.143784+0000 mgr.a (mgr.14373) 8587 : cluster [DBG] pgmap v5954: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:55:40.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:55:39 smithi157 bash[24585]: cluster 2024-09-16T08:55:38.146212+0000 mgr.a (mgr.14373) 8588 : cluster [DBG] pgmap v5955: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:55:40.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:55:39 smithi086 bash[24289]: cluster 2024-09-16T08:55:38.146212+0000 mgr.a (mgr.14373) 8588 : cluster [DBG] pgmap v5955: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:55:40.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:55:39 smithi047 bash[22744]: cluster 2024-09-16T08:55:38.146212+0000 mgr.a (mgr.14373) 8588 : cluster [DBG] pgmap v5955: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:55:41.295 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:55:41.295 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:55:41.296 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:55:42.055 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:55:42.056 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:55:42.056 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:55:42.056 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:55:42.056 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:55:42.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:55:41 smithi157 bash[24585]: cluster 2024-09-16T08:55:40.147024+0000 mgr.a (mgr.14373) 8589 : cluster [DBG] pgmap v5956: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:55:42.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:55:41 smithi086 bash[24289]: cluster 2024-09-16T08:55:40.147024+0000 mgr.a (mgr.14373) 8589 : cluster [DBG] pgmap v5956: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:55:42.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:55:41 smithi047 bash[22744]: cluster 2024-09-16T08:55:40.147024+0000 mgr.a (mgr.14373) 8589 : cluster [DBG] pgmap v5956: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:55:43.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:55:42 smithi157 bash[24585]: audit 2024-09-16T08:55:41.639193+0000 mgr.a (mgr.14373) 8590 : audit [DBG] from='client.191805 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:55:43.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:55:42 smithi086 bash[24289]: audit 2024-09-16T08:55:41.639193+0000 mgr.a (mgr.14373) 8590 : audit [DBG] from='client.191805 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:55:43.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:55:42 smithi047 bash[22744]: audit 2024-09-16T08:55:41.639193+0000 mgr.a (mgr.14373) 8590 : audit [DBG] from='client.191805 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:55:44.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:55:43 smithi157 bash[24585]: cluster 2024-09-16T08:55:42.149575+0000 mgr.a (mgr.14373) 8591 : cluster [DBG] pgmap v5957: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:55:44.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:55:43 smithi086 bash[24289]: cluster 2024-09-16T08:55:42.149575+0000 mgr.a (mgr.14373) 8591 : cluster [DBG] pgmap v5957: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:55:44.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:55:43 smithi047 bash[22744]: cluster 2024-09-16T08:55:42.149575+0000 mgr.a (mgr.14373) 8591 : cluster [DBG] pgmap v5957: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:55:46.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:55:45 smithi157 bash[24585]: cluster 2024-09-16T08:55:44.150404+0000 mgr.a (mgr.14373) 8592 : cluster [DBG] pgmap v5958: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:55:46.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:55:45 smithi086 bash[24289]: cluster 2024-09-16T08:55:44.150404+0000 mgr.a (mgr.14373) 8592 : cluster [DBG] pgmap v5958: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:55:46.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:55:45 smithi047 bash[22744]: cluster 2024-09-16T08:55:44.150404+0000 mgr.a (mgr.14373) 8592 : cluster [DBG] pgmap v5958: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:55:47.057 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:55:47.058 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:55:47.058 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:55:47.800 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:55:47.800 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:55:47.800 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:55:47.800 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:55:47.800 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:55:48.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:55:47 smithi157 bash[24585]: cluster 2024-09-16T08:55:46.151172+0000 mgr.a (mgr.14373) 8593 : cluster [DBG] pgmap v5959: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T08:55:48.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:55:47 smithi086 bash[24289]: cluster 2024-09-16T08:55:46.151172+0000 mgr.a (mgr.14373) 8593 : cluster [DBG] pgmap v5959: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T08:55:48.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:55:47 smithi047 bash[22744]: cluster 2024-09-16T08:55:46.151172+0000 mgr.a (mgr.14373) 8593 : cluster [DBG] pgmap v5959: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T08:55:49.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:55:48 smithi157 bash[24585]: audit 2024-09-16T08:55:47.389864+0000 mgr.a (mgr.14373) 8594 : audit [DBG] from='client.191880 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:55:49.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:55:48 smithi086 bash[24289]: audit 2024-09-16T08:55:47.389864+0000 mgr.a (mgr.14373) 8594 : audit [DBG] from='client.191880 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:55:49.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:55:48 smithi047 bash[22744]: audit 2024-09-16T08:55:47.389864+0000 mgr.a (mgr.14373) 8594 : audit [DBG] from='client.191880 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:55:50.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:55:49 smithi157 bash[24585]: cluster 2024-09-16T08:55:48.153888+0000 mgr.a (mgr.14373) 8595 : cluster [DBG] pgmap v5960: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:55:50.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:55:49 smithi086 bash[24289]: cluster 2024-09-16T08:55:48.153888+0000 mgr.a (mgr.14373) 8595 : cluster [DBG] pgmap v5960: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:55:50.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:55:49 smithi047 bash[22744]: cluster 2024-09-16T08:55:48.153888+0000 mgr.a (mgr.14373) 8595 : cluster [DBG] pgmap v5960: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:55:52.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:55:51 smithi157 bash[24585]: cluster 2024-09-16T08:55:50.154690+0000 mgr.a (mgr.14373) 8596 : cluster [DBG] pgmap v5961: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:55:52.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:55:51 smithi086 bash[24289]: cluster 2024-09-16T08:55:50.154690+0000 mgr.a (mgr.14373) 8596 : cluster [DBG] pgmap v5961: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:55:52.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:55:51 smithi047 bash[22744]: cluster 2024-09-16T08:55:50.154690+0000 mgr.a (mgr.14373) 8596 : cluster [DBG] pgmap v5961: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:55:52.801 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:55:52.802 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:55:52.802 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:55:53.549 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:55:53.549 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:55:53.549 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:55:53.550 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:55:53.550 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:55:54.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:55:54 smithi157 bash[24585]: cluster 2024-09-16T08:55:52.156698+0000 mgr.a (mgr.14373) 8597 : cluster [DBG] pgmap v5962: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:55:54.317 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:55:54 smithi086 bash[24289]: cluster 2024-09-16T08:55:52.156698+0000 mgr.a (mgr.14373) 8597 : cluster [DBG] pgmap v5962: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:55:54.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:55:54 smithi047 bash[22744]: cluster 2024-09-16T08:55:52.156698+0000 mgr.a (mgr.14373) 8597 : cluster [DBG] pgmap v5962: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:55:55.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:55:55 smithi157 bash[24585]: audit 2024-09-16T08:55:53.135964+0000 mgr.a (mgr.14373) 8598 : audit [DBG] from='client.191958 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:55:55.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:55:55 smithi086 bash[24289]: audit 2024-09-16T08:55:53.135964+0000 mgr.a (mgr.14373) 8598 : audit [DBG] from='client.191958 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:55:55.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:55:55 smithi047 bash[22744]: audit 2024-09-16T08:55:53.135964+0000 mgr.a (mgr.14373) 8598 : audit [DBG] from='client.191958 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:55:56.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:55:56 smithi157 bash[24585]: cluster 2024-09-16T08:55:54.157658+0000 mgr.a (mgr.14373) 8599 : cluster [DBG] pgmap v5963: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:55:56.322 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:55:56 smithi086 bash[24289]: cluster 2024-09-16T08:55:54.157658+0000 mgr.a (mgr.14373) 8599 : cluster [DBG] pgmap v5963: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:55:56.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:55:56 smithi047 bash[22744]: cluster 2024-09-16T08:55:54.157658+0000 mgr.a (mgr.14373) 8599 : cluster [DBG] pgmap v5963: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:55:58.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:55:58 smithi157 bash[24585]: cluster 2024-09-16T08:55:56.158478+0000 mgr.a (mgr.14373) 8600 : cluster [DBG] pgmap v5964: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:55:58.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:55:58 smithi086 bash[24289]: cluster 2024-09-16T08:55:56.158478+0000 mgr.a (mgr.14373) 8600 : cluster [DBG] pgmap v5964: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:55:58.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:55:58 smithi047 bash[22744]: cluster 2024-09-16T08:55:56.158478+0000 mgr.a (mgr.14373) 8600 : cluster [DBG] pgmap v5964: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:55:58.551 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:55:58.551 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:55:58.551 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:55:59.300 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:55:59.301 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:55:59.301 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:55:59.301 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:55:59.301 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:56:00.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:56:00 smithi157 bash[24585]: cluster 2024-09-16T08:55:58.160696+0000 mgr.a (mgr.14373) 8601 : cluster [DBG] pgmap v5965: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:56:00.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:56:00 smithi157 bash[24585]: audit 2024-09-16T08:55:58.882925+0000 mgr.a (mgr.14373) 8602 : audit [DBG] from='client.192033 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:56:00.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:56:00 smithi086 bash[24289]: cluster 2024-09-16T08:55:58.160696+0000 mgr.a (mgr.14373) 8601 : cluster [DBG] pgmap v5965: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:56:00.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:56:00 smithi086 bash[24289]: audit 2024-09-16T08:55:58.882925+0000 mgr.a (mgr.14373) 8602 : audit [DBG] from='client.192033 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:56:00.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:56:00 smithi047 bash[22744]: cluster 2024-09-16T08:55:58.160696+0000 mgr.a (mgr.14373) 8601 : cluster [DBG] pgmap v5965: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:56:00.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:56:00 smithi047 bash[22744]: audit 2024-09-16T08:55:58.882925+0000 mgr.a (mgr.14373) 8602 : audit [DBG] from='client.192033 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:56:01.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:56:01 smithi157 bash[24585]: cluster 2024-09-16T08:56:00.161730+0000 mgr.a (mgr.14373) 8603 : cluster [DBG] pgmap v5966: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:56:01.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:56:01 smithi086 bash[24289]: cluster 2024-09-16T08:56:00.161730+0000 mgr.a (mgr.14373) 8603 : cluster [DBG] pgmap v5966: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:56:01.338 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:56:01 smithi047 bash[22744]: cluster 2024-09-16T08:56:00.161730+0000 mgr.a (mgr.14373) 8603 : cluster [DBG] pgmap v5966: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:56:03.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:56:03 smithi157 bash[24585]: cluster 2024-09-16T08:56:02.163921+0000 mgr.a (mgr.14373) 8604 : cluster [DBG] pgmap v5967: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:56:03.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:56:03 smithi086 bash[24289]: cluster 2024-09-16T08:56:02.163921+0000 mgr.a (mgr.14373) 8604 : cluster [DBG] pgmap v5967: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:56:03.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:56:03 smithi047 bash[22744]: cluster 2024-09-16T08:56:02.163921+0000 mgr.a (mgr.14373) 8604 : cluster [DBG] pgmap v5967: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:56:04.302 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:56:04.302 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:56:04.303 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:56:05.057 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:56:05.057 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:56:05.057 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:56:05.057 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:56:05.057 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:56:05.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:56:05 smithi157 bash[24585]: cluster 2024-09-16T08:56:04.164677+0000 mgr.a (mgr.14373) 8605 : cluster [DBG] pgmap v5968: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:56:05.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:56:05 smithi157 bash[24585]: audit 2024-09-16T08:56:04.639992+0000 mgr.a (mgr.14373) 8606 : audit [DBG] from='client.192108 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:56:05.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:56:05 smithi086 bash[24289]: cluster 2024-09-16T08:56:04.164677+0000 mgr.a (mgr.14373) 8605 : cluster [DBG] pgmap v5968: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:56:05.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:56:05 smithi086 bash[24289]: audit 2024-09-16T08:56:04.639992+0000 mgr.a (mgr.14373) 8606 : audit [DBG] from='client.192108 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:56:05.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:56:05 smithi047 bash[22744]: cluster 2024-09-16T08:56:04.164677+0000 mgr.a (mgr.14373) 8605 : cluster [DBG] pgmap v5968: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:56:05.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:56:05 smithi047 bash[22744]: audit 2024-09-16T08:56:04.639992+0000 mgr.a (mgr.14373) 8606 : audit [DBG] from='client.192108 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:56:07.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:56:07 smithi157 bash[24585]: cluster 2024-09-16T08:56:06.165577+0000 mgr.a (mgr.14373) 8607 : cluster [DBG] pgmap v5969: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:56:07.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:56:07 smithi157 bash[24585]: audit 2024-09-16T08:56:06.666748+0000 mon.b (mon.2) 806 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T08:56:07.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:56:07 smithi086 bash[24289]: cluster 2024-09-16T08:56:06.165577+0000 mgr.a (mgr.14373) 8607 : cluster [DBG] pgmap v5969: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:56:07.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:56:07 smithi086 bash[24289]: audit 2024-09-16T08:56:06.666748+0000 mon.b (mon.2) 806 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T08:56:07.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:56:07 smithi047 bash[22744]: cluster 2024-09-16T08:56:06.165577+0000 mgr.a (mgr.14373) 8607 : cluster [DBG] pgmap v5969: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:56:07.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:56:07 smithi047 bash[22744]: audit 2024-09-16T08:56:06.666748+0000 mon.b (mon.2) 806 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T08:56:08.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:56:08 smithi157 bash[24585]: audit 2024-09-16T08:56:07.508246+0000 mon.b (mon.2) 807 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T08:56:08.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:56:08 smithi157 bash[24585]: audit 2024-09-16T08:56:07.510091+0000 mon.b (mon.2) 808 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T08:56:08.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:56:08 smithi157 bash[24585]: audit 2024-09-16T08:56:07.522126+0000 mon.a (mon.0) 1081 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:56:08.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:56:08 smithi157 bash[24585]: audit 2024-09-16T08:56:07.526687+0000 mon.b (mon.2) 809 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:56:08.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:56:08 smithi157 bash[24585]: audit 2024-09-16T08:56:07.531093+0000 mgr.a (mgr.14373) 8608 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:56:08.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:56:08 smithi086 bash[24289]: audit 2024-09-16T08:56:07.508246+0000 mon.b (mon.2) 807 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T08:56:08.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:56:08 smithi086 bash[24289]: audit 2024-09-16T08:56:07.510091+0000 mon.b (mon.2) 808 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T08:56:08.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:56:08 smithi086 bash[24289]: audit 2024-09-16T08:56:07.522126+0000 mon.a (mon.0) 1081 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:56:08.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:56:08 smithi086 bash[24289]: audit 2024-09-16T08:56:07.526687+0000 mon.b (mon.2) 809 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:56:08.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:56:08 smithi086 bash[24289]: audit 2024-09-16T08:56:07.531093+0000 mgr.a (mgr.14373) 8608 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:56:08.589 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 08:56:08 smithi047 bash[22994]: debug 2024-09-16T08:56:08.269+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T08:56:08.589 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 08:56:08 smithi047 bash[22994]: debug 2024-09-16T08:56:08.269+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T08:56:08.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:56:08 smithi047 bash[22744]: audit 2024-09-16T08:56:07.508246+0000 mon.b (mon.2) 807 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T08:56:08.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:56:08 smithi047 bash[22744]: audit 2024-09-16T08:56:07.510091+0000 mon.b (mon.2) 808 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T08:56:08.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:56:08 smithi047 bash[22744]: audit 2024-09-16T08:56:07.522126+0000 mon.a (mon.0) 1081 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:56:08.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:56:08 smithi047 bash[22744]: audit 2024-09-16T08:56:07.526687+0000 mon.b (mon.2) 809 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:56:08.590 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:56:08 smithi047 bash[22744]: audit 2024-09-16T08:56:07.531093+0000 mgr.a (mgr.14373) 8608 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:56:09.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:56:09 smithi157 bash[24585]: cluster 2024-09-16T08:56:08.166740+0000 mgr.a (mgr.14373) 8609 : cluster [DBG] pgmap v5970: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:56:09.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:56:09 smithi157 bash[24585]: audit 2024-09-16T08:56:08.271243+0000 mgr.a (mgr.14373) 8610 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T08:56:09.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:56:09 smithi157 bash[24585]: cephadm 2024-09-16T08:56:08.273354+0000 mgr.a (mgr.14373) 8611 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T08:56:09.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:56:09 smithi086 bash[24289]: cluster 2024-09-16T08:56:08.166740+0000 mgr.a (mgr.14373) 8609 : cluster [DBG] pgmap v5970: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:56:09.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:56:09 smithi086 bash[24289]: audit 2024-09-16T08:56:08.271243+0000 mgr.a (mgr.14373) 8610 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T08:56:09.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:56:09 smithi086 bash[24289]: cephadm 2024-09-16T08:56:08.273354+0000 mgr.a (mgr.14373) 8611 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T08:56:09.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:56:09 smithi047 bash[22744]: cluster 2024-09-16T08:56:08.166740+0000 mgr.a (mgr.14373) 8609 : cluster [DBG] pgmap v5970: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:56:09.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:56:09 smithi047 bash[22744]: audit 2024-09-16T08:56:08.271243+0000 mgr.a (mgr.14373) 8610 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T08:56:09.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:56:09 smithi047 bash[22744]: cephadm 2024-09-16T08:56:08.273354+0000 mgr.a (mgr.14373) 8611 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T08:56:10.058 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:56:10.059 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:56:10.059 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:56:10.835 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:56:10.836 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:56:10.836 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:56:10.836 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:56:10.836 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:56:11.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:56:11 smithi157 bash[24585]: cluster 2024-09-16T08:56:10.167200+0000 mgr.a (mgr.14373) 8612 : cluster [DBG] pgmap v5971: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:56:11.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:56:11 smithi157 bash[24585]: audit 2024-09-16T08:56:10.393737+0000 mgr.a (mgr.14373) 8613 : audit [DBG] from='client.192282 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:56:11.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:56:11 smithi086 bash[24289]: cluster 2024-09-16T08:56:10.167200+0000 mgr.a (mgr.14373) 8612 : cluster [DBG] pgmap v5971: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:56:11.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:56:11 smithi086 bash[24289]: audit 2024-09-16T08:56:10.393737+0000 mgr.a (mgr.14373) 8613 : audit [DBG] from='client.192282 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:56:11.840 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:56:11 smithi047 bash[22744]: cluster 2024-09-16T08:56:10.167200+0000 mgr.a (mgr.14373) 8612 : cluster [DBG] pgmap v5971: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:56:11.840 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:56:11 smithi047 bash[22744]: audit 2024-09-16T08:56:10.393737+0000 mgr.a (mgr.14373) 8613 : audit [DBG] from='client.192282 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:56:13.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:56:13 smithi157 bash[24585]: cluster 2024-09-16T08:56:12.169492+0000 mgr.a (mgr.14373) 8614 : cluster [DBG] pgmap v5972: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:56:13.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:56:13 smithi086 bash[24289]: cluster 2024-09-16T08:56:12.169492+0000 mgr.a (mgr.14373) 8614 : cluster [DBG] pgmap v5972: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:56:13.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:56:13 smithi047 bash[22744]: cluster 2024-09-16T08:56:12.169492+0000 mgr.a (mgr.14373) 8614 : cluster [DBG] pgmap v5972: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:56:15.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:56:15 smithi157 bash[24585]: cluster 2024-09-16T08:56:14.170273+0000 mgr.a (mgr.14373) 8615 : cluster [DBG] pgmap v5973: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:56:15.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:56:15 smithi086 bash[24289]: cluster 2024-09-16T08:56:14.170273+0000 mgr.a (mgr.14373) 8615 : cluster [DBG] pgmap v5973: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:56:15.837 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:56:15.838 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:56:15.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:56:15 smithi047 bash[22744]: cluster 2024-09-16T08:56:14.170273+0000 mgr.a (mgr.14373) 8615 : cluster [DBG] pgmap v5973: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:56:15.838 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:56:16.593 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:56:16.593 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:56:16.593 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:56:16.593 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:56:16.593 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:56:17.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:56:17 smithi157 bash[24585]: cluster 2024-09-16T08:56:16.171011+0000 mgr.a (mgr.14373) 8616 : cluster [DBG] pgmap v5974: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:56:17.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:56:17 smithi157 bash[24585]: audit 2024-09-16T08:56:16.175745+0000 mgr.a (mgr.14373) 8617 : audit [DBG] from='client.192360 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:56:17.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:56:17 smithi086 bash[24289]: cluster 2024-09-16T08:56:16.171011+0000 mgr.a (mgr.14373) 8616 : cluster [DBG] pgmap v5974: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:56:17.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:56:17 smithi086 bash[24289]: audit 2024-09-16T08:56:16.175745+0000 mgr.a (mgr.14373) 8617 : audit [DBG] from='client.192360 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:56:17.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:56:17 smithi047 bash[22744]: cluster 2024-09-16T08:56:16.171011+0000 mgr.a (mgr.14373) 8616 : cluster [DBG] pgmap v5974: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:56:17.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:56:17 smithi047 bash[22744]: audit 2024-09-16T08:56:16.175745+0000 mgr.a (mgr.14373) 8617 : audit [DBG] from='client.192360 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:56:19.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:56:19 smithi157 bash[24585]: cluster 2024-09-16T08:56:18.173721+0000 mgr.a (mgr.14373) 8618 : cluster [DBG] pgmap v5975: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:56:19.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:56:19 smithi086 bash[24289]: cluster 2024-09-16T08:56:18.173721+0000 mgr.a (mgr.14373) 8618 : cluster [DBG] pgmap v5975: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:56:19.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:56:19 smithi047 bash[22744]: cluster 2024-09-16T08:56:18.173721+0000 mgr.a (mgr.14373) 8618 : cluster [DBG] pgmap v5975: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:56:21.594 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:56:21.595 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:56:21.595 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:56:21.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:56:21 smithi157 bash[24585]: cluster 2024-09-16T08:56:20.174577+0000 mgr.a (mgr.14373) 8619 : cluster [DBG] pgmap v5976: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T08:56:21.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:56:21 smithi086 bash[24289]: cluster 2024-09-16T08:56:20.174577+0000 mgr.a (mgr.14373) 8619 : cluster [DBG] pgmap v5976: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T08:56:21.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:56:21 smithi047 bash[22744]: cluster 2024-09-16T08:56:20.174577+0000 mgr.a (mgr.14373) 8619 : cluster [DBG] pgmap v5976: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T08:56:22.344 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:56:22.344 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:56:22.344 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:56:22.344 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:56:22.344 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:56:22.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:56:22 smithi086 bash[24289]: audit 2024-09-16T08:56:21.927035+0000 mgr.a (mgr.14373) 8620 : audit [DBG] from='client.192438 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:56:22.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:56:22 smithi047 bash[22744]: audit 2024-09-16T08:56:21.927035+0000 mgr.a (mgr.14373) 8620 : audit [DBG] from='client.192438 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:56:23.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:56:22 smithi157 bash[24585]: audit 2024-09-16T08:56:21.927035+0000 mgr.a (mgr.14373) 8620 : audit [DBG] from='client.192438 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:56:23.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:56:23 smithi086 bash[24289]: cluster 2024-09-16T08:56:22.175856+0000 mgr.a (mgr.14373) 8621 : cluster [DBG] pgmap v5977: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:56:23.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:56:23 smithi047 bash[22744]: cluster 2024-09-16T08:56:22.175856+0000 mgr.a (mgr.14373) 8621 : cluster [DBG] pgmap v5977: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:56:24.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:56:23 smithi157 bash[24585]: cluster 2024-09-16T08:56:22.175856+0000 mgr.a (mgr.14373) 8621 : cluster [DBG] pgmap v5977: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:56:25.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:56:25 smithi086 bash[24289]: cluster 2024-09-16T08:56:24.176737+0000 mgr.a (mgr.14373) 8622 : cluster [DBG] pgmap v5978: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:56:25.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:56:25 smithi047 bash[22744]: cluster 2024-09-16T08:56:24.176737+0000 mgr.a (mgr.14373) 8622 : cluster [DBG] pgmap v5978: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:56:26.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:56:25 smithi157 bash[24585]: cluster 2024-09-16T08:56:24.176737+0000 mgr.a (mgr.14373) 8622 : cluster [DBG] pgmap v5978: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:56:27.346 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:56:27.346 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:56:27.346 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:56:27.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:56:27 smithi086 bash[24289]: cluster 2024-09-16T08:56:26.177558+0000 mgr.a (mgr.14373) 8623 : cluster [DBG] pgmap v5979: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T08:56:27.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:56:27 smithi047 bash[22744]: cluster 2024-09-16T08:56:26.177558+0000 mgr.a (mgr.14373) 8623 : cluster [DBG] pgmap v5979: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T08:56:28.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:56:27 smithi157 bash[24585]: cluster 2024-09-16T08:56:26.177558+0000 mgr.a (mgr.14373) 8623 : cluster [DBG] pgmap v5979: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T08:56:28.123 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:56:28.123 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:56:28.123 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:56:28.123 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:56:28.123 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:56:28.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:56:28 smithi086 bash[24289]: audit 2024-09-16T08:56:27.679906+0000 mgr.a (mgr.14373) 8624 : audit [DBG] from='client.192516 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:56:28.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:56:28 smithi047 bash[22744]: audit 2024-09-16T08:56:27.679906+0000 mgr.a (mgr.14373) 8624 : audit [DBG] from='client.192516 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:56:29.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:56:28 smithi157 bash[24585]: audit 2024-09-16T08:56:27.679906+0000 mgr.a (mgr.14373) 8624 : audit [DBG] from='client.192516 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:56:29.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:56:29 smithi047 bash[22744]: cluster 2024-09-16T08:56:28.180387+0000 mgr.a (mgr.14373) 8625 : cluster [DBG] pgmap v5980: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:56:30.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:56:29 smithi157 bash[24585]: cluster 2024-09-16T08:56:28.180387+0000 mgr.a (mgr.14373) 8625 : cluster [DBG] pgmap v5980: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:56:30.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:56:29 smithi086 bash[24289]: cluster 2024-09-16T08:56:28.180387+0000 mgr.a (mgr.14373) 8625 : cluster [DBG] pgmap v5980: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:56:31.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:56:31 smithi047 bash[22744]: cluster 2024-09-16T08:56:30.181179+0000 mgr.a (mgr.14373) 8626 : cluster [DBG] pgmap v5981: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-16T08:56:32.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:56:31 smithi157 bash[24585]: cluster 2024-09-16T08:56:30.181179+0000 mgr.a (mgr.14373) 8626 : cluster [DBG] pgmap v5981: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-16T08:56:32.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:56:31 smithi086 bash[24289]: cluster 2024-09-16T08:56:30.181179+0000 mgr.a (mgr.14373) 8626 : cluster [DBG] pgmap v5981: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-16T08:56:33.124 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:56:33.125 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:56:33.125 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:56:33.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:56:33 smithi047 bash[22744]: cluster 2024-09-16T08:56:32.183265+0000 mgr.a (mgr.14373) 8627 : cluster [DBG] pgmap v5982: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-16T08:56:33.872 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:56:33.873 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:56:33.873 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:56:33.873 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:56:33.873 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:56:34.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:56:33 smithi157 bash[24585]: cluster 2024-09-16T08:56:32.183265+0000 mgr.a (mgr.14373) 8627 : cluster [DBG] pgmap v5982: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-16T08:56:34.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:56:33 smithi086 bash[24289]: cluster 2024-09-16T08:56:32.183265+0000 mgr.a (mgr.14373) 8627 : cluster [DBG] pgmap v5982: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-16T08:56:35.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:56:34 smithi157 bash[24585]: audit 2024-09-16T08:56:33.458049+0000 mgr.a (mgr.14373) 8628 : audit [DBG] from='client.192594 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:56:35.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:56:34 smithi086 bash[24289]: audit 2024-09-16T08:56:33.458049+0000 mgr.a (mgr.14373) 8628 : audit [DBG] from='client.192594 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:56:35.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:56:34 smithi047 bash[22744]: audit 2024-09-16T08:56:33.458049+0000 mgr.a (mgr.14373) 8628 : audit [DBG] from='client.192594 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:56:36.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:56:35 smithi157 bash[24585]: cluster 2024-09-16T08:56:34.184195+0000 mgr.a (mgr.14373) 8629 : cluster [DBG] pgmap v5983: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:56:36.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:56:35 smithi086 bash[24289]: cluster 2024-09-16T08:56:34.184195+0000 mgr.a (mgr.14373) 8629 : cluster [DBG] pgmap v5983: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:56:36.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:56:35 smithi047 bash[22744]: cluster 2024-09-16T08:56:34.184195+0000 mgr.a (mgr.14373) 8629 : cluster [DBG] pgmap v5983: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:56:38.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:56:37 smithi157 bash[24585]: cluster 2024-09-16T08:56:36.184954+0000 mgr.a (mgr.14373) 8630 : cluster [DBG] pgmap v5984: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:56:38.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:56:37 smithi086 bash[24289]: cluster 2024-09-16T08:56:36.184954+0000 mgr.a (mgr.14373) 8630 : cluster [DBG] pgmap v5984: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:56:38.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:56:37 smithi047 bash[22744]: cluster 2024-09-16T08:56:36.184954+0000 mgr.a (mgr.14373) 8630 : cluster [DBG] pgmap v5984: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:56:38.874 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:56:38.875 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:56:38.875 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:56:39.617 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:56:39.617 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:56:39.617 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:56:39.617 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:56:39.617 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:56:40.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:56:39 smithi157 bash[24585]: cluster 2024-09-16T08:56:38.187211+0000 mgr.a (mgr.14373) 8631 : cluster [DBG] pgmap v5985: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:56:40.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:56:39 smithi086 bash[24289]: cluster 2024-09-16T08:56:38.187211+0000 mgr.a (mgr.14373) 8631 : cluster [DBG] pgmap v5985: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:56:40.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:56:39 smithi047 bash[22744]: cluster 2024-09-16T08:56:38.187211+0000 mgr.a (mgr.14373) 8631 : cluster [DBG] pgmap v5985: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:56:41.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:56:40 smithi157 bash[24585]: audit 2024-09-16T08:56:39.206247+0000 mgr.a (mgr.14373) 8632 : audit [DBG] from='client.192672 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:56:41.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:56:40 smithi086 bash[24289]: audit 2024-09-16T08:56:39.206247+0000 mgr.a (mgr.14373) 8632 : audit [DBG] from='client.192672 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:56:41.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:56:40 smithi047 bash[22744]: audit 2024-09-16T08:56:39.206247+0000 mgr.a (mgr.14373) 8632 : audit [DBG] from='client.192672 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:56:42.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:56:41 smithi157 bash[24585]: cluster 2024-09-16T08:56:40.188143+0000 mgr.a (mgr.14373) 8633 : cluster [DBG] pgmap v5986: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:56:42.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:56:41 smithi086 bash[24289]: cluster 2024-09-16T08:56:40.188143+0000 mgr.a (mgr.14373) 8633 : cluster [DBG] pgmap v5986: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:56:42.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:56:41 smithi047 bash[22744]: cluster 2024-09-16T08:56:40.188143+0000 mgr.a (mgr.14373) 8633 : cluster [DBG] pgmap v5986: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:56:44.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:56:43 smithi157 bash[24585]: cluster 2024-09-16T08:56:42.190439+0000 mgr.a (mgr.14373) 8634 : cluster [DBG] pgmap v5987: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:56:44.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:56:43 smithi086 bash[24289]: cluster 2024-09-16T08:56:42.190439+0000 mgr.a (mgr.14373) 8634 : cluster [DBG] pgmap v5987: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:56:44.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:56:43 smithi047 bash[22744]: cluster 2024-09-16T08:56:42.190439+0000 mgr.a (mgr.14373) 8634 : cluster [DBG] pgmap v5987: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:56:44.618 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:56:44.619 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:56:44.619 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:56:45.369 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:56:45.369 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:56:45.369 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:56:45.369 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:56:45.369 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:56:46.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:56:45 smithi157 bash[24585]: cluster 2024-09-16T08:56:44.191193+0000 mgr.a (mgr.14373) 8635 : cluster [DBG] pgmap v5988: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:56:46.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:56:45 smithi157 bash[24585]: audit 2024-09-16T08:56:44.948597+0000 mgr.a (mgr.14373) 8636 : audit [DBG] from='client.192744 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:56:46.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:56:45 smithi086 bash[24289]: cluster 2024-09-16T08:56:44.191193+0000 mgr.a (mgr.14373) 8635 : cluster [DBG] pgmap v5988: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:56:46.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:56:45 smithi086 bash[24289]: audit 2024-09-16T08:56:44.948597+0000 mgr.a (mgr.14373) 8636 : audit [DBG] from='client.192744 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:56:46.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:56:45 smithi047 bash[22744]: cluster 2024-09-16T08:56:44.191193+0000 mgr.a (mgr.14373) 8635 : cluster [DBG] pgmap v5988: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:56:46.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:56:45 smithi047 bash[22744]: audit 2024-09-16T08:56:44.948597+0000 mgr.a (mgr.14373) 8636 : audit [DBG] from='client.192744 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:56:48.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:56:47 smithi157 bash[24585]: cluster 2024-09-16T08:56:46.192092+0000 mgr.a (mgr.14373) 8637 : cluster [DBG] pgmap v5989: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:56:48.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:56:47 smithi086 bash[24289]: cluster 2024-09-16T08:56:46.192092+0000 mgr.a (mgr.14373) 8637 : cluster [DBG] pgmap v5989: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:56:48.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:56:47 smithi047 bash[22744]: cluster 2024-09-16T08:56:46.192092+0000 mgr.a (mgr.14373) 8637 : cluster [DBG] pgmap v5989: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:56:50.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:56:49 smithi157 bash[24585]: cluster 2024-09-16T08:56:48.194287+0000 mgr.a (mgr.14373) 8638 : cluster [DBG] pgmap v5990: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:56:50.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:56:49 smithi086 bash[24289]: cluster 2024-09-16T08:56:48.194287+0000 mgr.a (mgr.14373) 8638 : cluster [DBG] pgmap v5990: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:56:50.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:56:49 smithi047 bash[22744]: cluster 2024-09-16T08:56:48.194287+0000 mgr.a (mgr.14373) 8638 : cluster [DBG] pgmap v5990: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:56:50.370 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:56:50.371 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:56:50.371 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:56:51.120 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:56:51.121 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:56:51.121 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:56:51.121 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:56:51.122 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:56:52.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:56:51 smithi157 bash[24585]: cluster 2024-09-16T08:56:50.195079+0000 mgr.a (mgr.14373) 8639 : cluster [DBG] pgmap v5991: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:56:52.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:56:51 smithi157 bash[24585]: audit 2024-09-16T08:56:50.706478+0000 mgr.a (mgr.14373) 8640 : audit [DBG] from='client.192822 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:56:52.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:56:51 smithi086 bash[24289]: cluster 2024-09-16T08:56:50.195079+0000 mgr.a (mgr.14373) 8639 : cluster [DBG] pgmap v5991: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:56:52.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:56:51 smithi086 bash[24289]: audit 2024-09-16T08:56:50.706478+0000 mgr.a (mgr.14373) 8640 : audit [DBG] from='client.192822 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:56:52.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:56:51 smithi047 bash[22744]: cluster 2024-09-16T08:56:50.195079+0000 mgr.a (mgr.14373) 8639 : cluster [DBG] pgmap v5991: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:56:52.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:56:51 smithi047 bash[22744]: audit 2024-09-16T08:56:50.706478+0000 mgr.a (mgr.14373) 8640 : audit [DBG] from='client.192822 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:56:54.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:56:53 smithi157 bash[24585]: cluster 2024-09-16T08:56:52.197455+0000 mgr.a (mgr.14373) 8641 : cluster [DBG] pgmap v5992: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:56:54.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:56:53 smithi086 bash[24289]: cluster 2024-09-16T08:56:52.197455+0000 mgr.a (mgr.14373) 8641 : cluster [DBG] pgmap v5992: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:56:54.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:56:53 smithi047 bash[22744]: cluster 2024-09-16T08:56:52.197455+0000 mgr.a (mgr.14373) 8641 : cluster [DBG] pgmap v5992: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:56:56.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:56:55 smithi157 bash[24585]: cluster 2024-09-16T08:56:54.198217+0000 mgr.a (mgr.14373) 8642 : cluster [DBG] pgmap v5993: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:56:56.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:56:55 smithi086 bash[24289]: cluster 2024-09-16T08:56:54.198217+0000 mgr.a (mgr.14373) 8642 : cluster [DBG] pgmap v5993: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:56:56.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:56:55 smithi047 bash[22744]: cluster 2024-09-16T08:56:54.198217+0000 mgr.a (mgr.14373) 8642 : cluster [DBG] pgmap v5993: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:56:56.122 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:56:56.122 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:56:56.123 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:56:56.916 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:56:56.917 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:56:56.917 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:56:56.917 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:56:56.917 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:56:58.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:56:57 smithi157 bash[24585]: cluster 2024-09-16T08:56:56.198776+0000 mgr.a (mgr.14373) 8643 : cluster [DBG] pgmap v5994: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:56:58.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:56:57 smithi157 bash[24585]: audit 2024-09-16T08:56:56.470732+0000 mgr.a (mgr.14373) 8644 : audit [DBG] from='client.80857 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:56:58.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:56:57 smithi086 bash[24289]: cluster 2024-09-16T08:56:56.198776+0000 mgr.a (mgr.14373) 8643 : cluster [DBG] pgmap v5994: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:56:58.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:56:57 smithi086 bash[24289]: audit 2024-09-16T08:56:56.470732+0000 mgr.a (mgr.14373) 8644 : audit [DBG] from='client.80857 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:56:58.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:56:57 smithi047 bash[22744]: cluster 2024-09-16T08:56:56.198776+0000 mgr.a (mgr.14373) 8643 : cluster [DBG] pgmap v5994: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:56:58.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:56:57 smithi047 bash[22744]: audit 2024-09-16T08:56:56.470732+0000 mgr.a (mgr.14373) 8644 : audit [DBG] from='client.80857 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:57:00.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:56:59 smithi157 bash[24585]: cluster 2024-09-16T08:56:58.201436+0000 mgr.a (mgr.14373) 8645 : cluster [DBG] pgmap v5995: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:57:00.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:56:59 smithi086 bash[24289]: cluster 2024-09-16T08:56:58.201436+0000 mgr.a (mgr.14373) 8645 : cluster [DBG] pgmap v5995: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:57:00.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:56:59 smithi047 bash[22744]: cluster 2024-09-16T08:56:58.201436+0000 mgr.a (mgr.14373) 8645 : cluster [DBG] pgmap v5995: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:57:01.918 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:57:01.918 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:57:01.918 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:57:02.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:57:01 smithi157 bash[24585]: cluster 2024-09-16T08:57:00.202221+0000 mgr.a (mgr.14373) 8646 : cluster [DBG] pgmap v5996: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:57:02.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:57:01 smithi086 bash[24289]: cluster 2024-09-16T08:57:00.202221+0000 mgr.a (mgr.14373) 8646 : cluster [DBG] pgmap v5996: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:57:02.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:57:01 smithi047 bash[22744]: cluster 2024-09-16T08:57:00.202221+0000 mgr.a (mgr.14373) 8646 : cluster [DBG] pgmap v5996: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:57:02.668 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:57:02.668 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:57:02.668 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:57:02.668 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:57:02.669 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:57:04.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:57:03 smithi157 bash[24585]: cluster 2024-09-16T08:57:02.204156+0000 mgr.a (mgr.14373) 8647 : cluster [DBG] pgmap v5997: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:57:04.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:57:03 smithi157 bash[24585]: audit 2024-09-16T08:57:02.249818+0000 mgr.a (mgr.14373) 8648 : audit [DBG] from='client.192972 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:57:04.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:57:03 smithi086 bash[24289]: cluster 2024-09-16T08:57:02.204156+0000 mgr.a (mgr.14373) 8647 : cluster [DBG] pgmap v5997: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:57:04.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:57:03 smithi086 bash[24289]: audit 2024-09-16T08:57:02.249818+0000 mgr.a (mgr.14373) 8648 : audit [DBG] from='client.192972 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:57:04.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:57:03 smithi047 bash[22744]: cluster 2024-09-16T08:57:02.204156+0000 mgr.a (mgr.14373) 8647 : cluster [DBG] pgmap v5997: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:57:04.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:57:03 smithi047 bash[22744]: audit 2024-09-16T08:57:02.249818+0000 mgr.a (mgr.14373) 8648 : audit [DBG] from='client.192972 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:57:06.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:57:05 smithi157 bash[24585]: cluster 2024-09-16T08:57:04.205011+0000 mgr.a (mgr.14373) 8649 : cluster [DBG] pgmap v5998: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:57:06.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:57:05 smithi086 bash[24289]: cluster 2024-09-16T08:57:04.205011+0000 mgr.a (mgr.14373) 8649 : cluster [DBG] pgmap v5998: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:57:06.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:57:05 smithi047 bash[22744]: cluster 2024-09-16T08:57:04.205011+0000 mgr.a (mgr.14373) 8649 : cluster [DBG] pgmap v5998: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:57:07.670 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:57:07.670 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:57:07.670 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:57:08.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:57:07 smithi157 bash[24585]: cluster 2024-09-16T08:57:06.205843+0000 mgr.a (mgr.14373) 8650 : cluster [DBG] pgmap v5999: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T08:57:08.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:57:07 smithi086 bash[24289]: cluster 2024-09-16T08:57:06.205843+0000 mgr.a (mgr.14373) 8650 : cluster [DBG] pgmap v5999: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T08:57:08.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:57:07 smithi047 bash[22744]: cluster 2024-09-16T08:57:06.205843+0000 mgr.a (mgr.14373) 8650 : cluster [DBG] pgmap v5999: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T08:57:08.460 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:57:08.460 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:57:08.460 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:57:08.460 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:57:08.461 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:57:09.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:57:08 smithi157 bash[24585]: audit 2024-09-16T08:57:08.012707+0000 mgr.a (mgr.14373) 8651 : audit [DBG] from='client.193047 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:57:09.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:57:08 smithi157 bash[24585]: audit 2024-09-16T08:57:08.322967+0000 mon.b (mon.2) 810 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T08:57:09.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:57:08 smithi086 bash[24289]: audit 2024-09-16T08:57:08.012707+0000 mgr.a (mgr.14373) 8651 : audit [DBG] from='client.193047 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:57:09.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:57:08 smithi086 bash[24289]: audit 2024-09-16T08:57:08.322967+0000 mon.b (mon.2) 810 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T08:57:09.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:57:08 smithi047 bash[22744]: audit 2024-09-16T08:57:08.012707+0000 mgr.a (mgr.14373) 8651 : audit [DBG] from='client.193047 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:57:09.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:57:08 smithi047 bash[22744]: audit 2024-09-16T08:57:08.322967+0000 mon.b (mon.2) 810 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T08:57:10.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:57:09 smithi157 bash[24585]: cluster 2024-09-16T08:57:08.207214+0000 mgr.a (mgr.14373) 8652 : cluster [DBG] pgmap v6000: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:57:10.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:57:09 smithi157 bash[24585]: audit 2024-09-16T08:57:09.122265+0000 mon.b (mon.2) 811 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T08:57:10.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:57:09 smithi157 bash[24585]: audit 2024-09-16T08:57:09.124864+0000 mon.b (mon.2) 812 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T08:57:10.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:57:09 smithi157 bash[24585]: audit 2024-09-16T08:57:09.139094+0000 mon.a (mon.0) 1082 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:57:10.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:57:09 smithi157 bash[24585]: audit 2024-09-16T08:57:09.142737+0000 mon.b (mon.2) 813 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:57:10.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:57:09 smithi086 bash[24289]: cluster 2024-09-16T08:57:08.207214+0000 mgr.a (mgr.14373) 8652 : cluster [DBG] pgmap v6000: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:57:10.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:57:09 smithi086 bash[24289]: audit 2024-09-16T08:57:09.122265+0000 mon.b (mon.2) 811 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T08:57:10.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:57:09 smithi086 bash[24289]: audit 2024-09-16T08:57:09.124864+0000 mon.b (mon.2) 812 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T08:57:10.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:57:09 smithi086 bash[24289]: audit 2024-09-16T08:57:09.139094+0000 mon.a (mon.0) 1082 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:57:10.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:57:09 smithi086 bash[24289]: audit 2024-09-16T08:57:09.142737+0000 mon.b (mon.2) 813 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:57:10.088 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 08:57:09 smithi047 bash[22994]: debug 2024-09-16T08:57:09.876+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T08:57:10.088 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 08:57:09 smithi047 bash[22994]: debug 2024-09-16T08:57:09.880+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T08:57:10.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:57:09 smithi047 bash[22744]: cluster 2024-09-16T08:57:08.207214+0000 mgr.a (mgr.14373) 8652 : cluster [DBG] pgmap v6000: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:57:10.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:57:09 smithi047 bash[22744]: audit 2024-09-16T08:57:09.122265+0000 mon.b (mon.2) 811 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T08:57:10.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:57:09 smithi047 bash[22744]: audit 2024-09-16T08:57:09.124864+0000 mon.b (mon.2) 812 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T08:57:10.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:57:09 smithi047 bash[22744]: audit 2024-09-16T08:57:09.139094+0000 mon.a (mon.0) 1082 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:57:10.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:57:09 smithi047 bash[22744]: audit 2024-09-16T08:57:09.142737+0000 mon.b (mon.2) 813 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:57:11.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:57:10 smithi157 bash[24585]: audit 2024-09-16T08:57:09.147467+0000 mgr.a (mgr.14373) 8653 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:57:11.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:57:10 smithi157 bash[24585]: audit 2024-09-16T08:57:09.881028+0000 mgr.a (mgr.14373) 8654 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T08:57:11.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:57:10 smithi157 bash[24585]: cephadm 2024-09-16T08:57:09.882820+0000 mgr.a (mgr.14373) 8655 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T08:57:11.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:57:10 smithi086 bash[24289]: audit 2024-09-16T08:57:09.147467+0000 mgr.a (mgr.14373) 8653 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:57:11.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:57:10 smithi086 bash[24289]: audit 2024-09-16T08:57:09.881028+0000 mgr.a (mgr.14373) 8654 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T08:57:11.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:57:10 smithi086 bash[24289]: cephadm 2024-09-16T08:57:09.882820+0000 mgr.a (mgr.14373) 8655 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T08:57:11.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:57:10 smithi047 bash[22744]: audit 2024-09-16T08:57:09.147467+0000 mgr.a (mgr.14373) 8653 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:57:11.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:57:10 smithi047 bash[22744]: audit 2024-09-16T08:57:09.881028+0000 mgr.a (mgr.14373) 8654 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T08:57:11.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:57:10 smithi047 bash[22744]: cephadm 2024-09-16T08:57:09.882820+0000 mgr.a (mgr.14373) 8655 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T08:57:12.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:57:11 smithi157 bash[24585]: cluster 2024-09-16T08:57:10.208077+0000 mgr.a (mgr.14373) 8656 : cluster [DBG] pgmap v6001: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:57:12.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:57:11 smithi086 bash[24289]: cluster 2024-09-16T08:57:10.208077+0000 mgr.a (mgr.14373) 8656 : cluster [DBG] pgmap v6001: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:57:12.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:57:11 smithi047 bash[22744]: cluster 2024-09-16T08:57:10.208077+0000 mgr.a (mgr.14373) 8656 : cluster [DBG] pgmap v6001: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:57:13.462 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:57:13.462 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:57:13.463 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:57:14.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:57:13 smithi157 bash[24585]: cluster 2024-09-16T08:57:12.210253+0000 mgr.a (mgr.14373) 8657 : cluster [DBG] pgmap v6002: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:57:14.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:57:13 smithi086 bash[24289]: cluster 2024-09-16T08:57:12.210253+0000 mgr.a (mgr.14373) 8657 : cluster [DBG] pgmap v6002: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:57:14.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:57:13 smithi047 bash[22744]: cluster 2024-09-16T08:57:12.210253+0000 mgr.a (mgr.14373) 8657 : cluster [DBG] pgmap v6002: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:57:14.206 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:57:14.207 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:57:14.207 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:57:14.207 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:57:14.207 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:57:15.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:57:14 smithi157 bash[24585]: audit 2024-09-16T08:57:13.797901+0000 mgr.a (mgr.14373) 8658 : audit [DBG] from='client.193233 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:57:15.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:57:14 smithi086 bash[24289]: audit 2024-09-16T08:57:13.797901+0000 mgr.a (mgr.14373) 8658 : audit [DBG] from='client.193233 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:57:15.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:57:14 smithi047 bash[22744]: audit 2024-09-16T08:57:13.797901+0000 mgr.a (mgr.14373) 8658 : audit [DBG] from='client.193233 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:57:16.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:57:15 smithi157 bash[24585]: cluster 2024-09-16T08:57:14.210776+0000 mgr.a (mgr.14373) 8659 : cluster [DBG] pgmap v6003: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:57:16.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:57:15 smithi086 bash[24289]: cluster 2024-09-16T08:57:14.210776+0000 mgr.a (mgr.14373) 8659 : cluster [DBG] pgmap v6003: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:57:16.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:57:15 smithi047 bash[22744]: cluster 2024-09-16T08:57:14.210776+0000 mgr.a (mgr.14373) 8659 : cluster [DBG] pgmap v6003: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:57:18.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:57:17 smithi157 bash[24585]: cluster 2024-09-16T08:57:16.211533+0000 mgr.a (mgr.14373) 8660 : cluster [DBG] pgmap v6004: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:57:18.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:57:17 smithi086 bash[24289]: cluster 2024-09-16T08:57:16.211533+0000 mgr.a (mgr.14373) 8660 : cluster [DBG] pgmap v6004: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:57:18.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:57:17 smithi047 bash[22744]: cluster 2024-09-16T08:57:16.211533+0000 mgr.a (mgr.14373) 8660 : cluster [DBG] pgmap v6004: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:57:19.208 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:57:19.209 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:57:19.209 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:57:19.967 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:57:19.968 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:57:19.968 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:57:19.968 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:57:19.968 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:57:20.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:57:19 smithi157 bash[24585]: cluster 2024-09-16T08:57:18.213743+0000 mgr.a (mgr.14373) 8661 : cluster [DBG] pgmap v6005: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:57:20.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:57:19 smithi086 bash[24289]: cluster 2024-09-16T08:57:18.213743+0000 mgr.a (mgr.14373) 8661 : cluster [DBG] pgmap v6005: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:57:20.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:57:19 smithi047 bash[22744]: cluster 2024-09-16T08:57:18.213743+0000 mgr.a (mgr.14373) 8661 : cluster [DBG] pgmap v6005: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:57:21.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:57:20 smithi157 bash[24585]: audit 2024-09-16T08:57:19.546488+0000 mgr.a (mgr.14373) 8662 : audit [DBG] from='client.193311 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:57:21.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:57:20 smithi086 bash[24289]: audit 2024-09-16T08:57:19.546488+0000 mgr.a (mgr.14373) 8662 : audit [DBG] from='client.193311 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:57:21.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:57:20 smithi047 bash[22744]: audit 2024-09-16T08:57:19.546488+0000 mgr.a (mgr.14373) 8662 : audit [DBG] from='client.193311 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:57:22.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:57:21 smithi157 bash[24585]: cluster 2024-09-16T08:57:20.214664+0000 mgr.a (mgr.14373) 8663 : cluster [DBG] pgmap v6006: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:57:22.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:57:21 smithi086 bash[24289]: cluster 2024-09-16T08:57:20.214664+0000 mgr.a (mgr.14373) 8663 : cluster [DBG] pgmap v6006: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:57:22.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:57:21 smithi047 bash[22744]: cluster 2024-09-16T08:57:20.214664+0000 mgr.a (mgr.14373) 8663 : cluster [DBG] pgmap v6006: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:57:24.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:57:23 smithi157 bash[24585]: cluster 2024-09-16T08:57:22.216919+0000 mgr.a (mgr.14373) 8664 : cluster [DBG] pgmap v6007: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:57:24.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:57:23 smithi086 bash[24289]: cluster 2024-09-16T08:57:22.216919+0000 mgr.a (mgr.14373) 8664 : cluster [DBG] pgmap v6007: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:57:24.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:57:23 smithi047 bash[22744]: cluster 2024-09-16T08:57:22.216919+0000 mgr.a (mgr.14373) 8664 : cluster [DBG] pgmap v6007: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:57:24.969 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:57:24.970 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:57:24.970 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:57:25.743 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:57:25.743 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:57:25.743 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:57:25.743 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:57:25.744 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:57:26.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:57:25 smithi157 bash[24585]: cluster 2024-09-16T08:57:24.217696+0000 mgr.a (mgr.14373) 8665 : cluster [DBG] pgmap v6008: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:57:26.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:57:25 smithi086 bash[24289]: cluster 2024-09-16T08:57:24.217696+0000 mgr.a (mgr.14373) 8665 : cluster [DBG] pgmap v6008: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:57:26.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:57:25 smithi047 bash[22744]: cluster 2024-09-16T08:57:24.217696+0000 mgr.a (mgr.14373) 8665 : cluster [DBG] pgmap v6008: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:57:27.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:57:26 smithi157 bash[24585]: audit 2024-09-16T08:57:25.303841+0000 mgr.a (mgr.14373) 8666 : audit [DBG] from='client.193389 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:57:27.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:57:26 smithi086 bash[24289]: audit 2024-09-16T08:57:25.303841+0000 mgr.a (mgr.14373) 8666 : audit [DBG] from='client.193389 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:57:27.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:57:26 smithi047 bash[22744]: audit 2024-09-16T08:57:25.303841+0000 mgr.a (mgr.14373) 8666 : audit [DBG] from='client.193389 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:57:28.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:57:27 smithi157 bash[24585]: cluster 2024-09-16T08:57:26.218654+0000 mgr.a (mgr.14373) 8667 : cluster [DBG] pgmap v6009: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:57:28.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:57:27 smithi086 bash[24289]: cluster 2024-09-16T08:57:26.218654+0000 mgr.a (mgr.14373) 8667 : cluster [DBG] pgmap v6009: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:57:28.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:57:27 smithi047 bash[22744]: cluster 2024-09-16T08:57:26.218654+0000 mgr.a (mgr.14373) 8667 : cluster [DBG] pgmap v6009: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:57:30.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:57:29 smithi157 bash[24585]: cluster 2024-09-16T08:57:28.220872+0000 mgr.a (mgr.14373) 8668 : cluster [DBG] pgmap v6010: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:57:30.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:57:29 smithi086 bash[24289]: cluster 2024-09-16T08:57:28.220872+0000 mgr.a (mgr.14373) 8668 : cluster [DBG] pgmap v6010: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:57:30.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:57:29 smithi047 bash[22744]: cluster 2024-09-16T08:57:28.220872+0000 mgr.a (mgr.14373) 8668 : cluster [DBG] pgmap v6010: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:57:30.745 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:57:30.745 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:57:30.745 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:57:31.527 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:57:31.527 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:57:31.527 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:57:31.527 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:57:31.527 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:57:32.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:57:31 smithi157 bash[24585]: cluster 2024-09-16T08:57:30.221618+0000 mgr.a (mgr.14373) 8669 : cluster [DBG] pgmap v6011: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:57:32.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:57:31 smithi086 bash[24289]: cluster 2024-09-16T08:57:30.221618+0000 mgr.a (mgr.14373) 8669 : cluster [DBG] pgmap v6011: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:57:32.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:57:31 smithi047 bash[22744]: cluster 2024-09-16T08:57:30.221618+0000 mgr.a (mgr.14373) 8669 : cluster [DBG] pgmap v6011: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:57:33.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:57:32 smithi157 bash[24585]: audit 2024-09-16T08:57:31.086675+0000 mgr.a (mgr.14373) 8670 : audit [DBG] from='client.193464 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:57:33.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:57:32 smithi086 bash[24289]: audit 2024-09-16T08:57:31.086675+0000 mgr.a (mgr.14373) 8670 : audit [DBG] from='client.193464 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:57:33.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:57:32 smithi047 bash[22744]: audit 2024-09-16T08:57:31.086675+0000 mgr.a (mgr.14373) 8670 : audit [DBG] from='client.193464 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:57:34.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:57:33 smithi157 bash[24585]: cluster 2024-09-16T08:57:32.223979+0000 mgr.a (mgr.14373) 8671 : cluster [DBG] pgmap v6012: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-16T08:57:34.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:57:33 smithi086 bash[24289]: cluster 2024-09-16T08:57:32.223979+0000 mgr.a (mgr.14373) 8671 : cluster [DBG] pgmap v6012: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-16T08:57:34.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:57:33 smithi047 bash[22744]: cluster 2024-09-16T08:57:32.223979+0000 mgr.a (mgr.14373) 8671 : cluster [DBG] pgmap v6012: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-16T08:57:35.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:57:35 smithi157 bash[24585]: cluster 2024-09-16T08:57:34.224963+0000 mgr.a (mgr.14373) 8672 : cluster [DBG] pgmap v6013: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T08:57:35.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:57:35 smithi086 bash[24289]: cluster 2024-09-16T08:57:34.224963+0000 mgr.a (mgr.14373) 8672 : cluster [DBG] pgmap v6013: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T08:57:35.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:57:35 smithi047 bash[22744]: cluster 2024-09-16T08:57:34.224963+0000 mgr.a (mgr.14373) 8672 : cluster [DBG] pgmap v6013: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T08:57:36.528 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:57:36.529 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:57:36.529 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:57:37.290 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:57:37.291 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:57:37.291 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:57:37.291 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:57:37.291 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:57:37.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:57:37 smithi157 bash[24585]: cluster 2024-09-16T08:57:36.225786+0000 mgr.a (mgr.14373) 8673 : cluster [DBG] pgmap v6014: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T08:57:37.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:57:37 smithi157 bash[24585]: audit 2024-09-16T08:57:36.863469+0000 mgr.a (mgr.14373) 8674 : audit [DBG] from='client.193542 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:57:37.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:57:37 smithi086 bash[24289]: cluster 2024-09-16T08:57:36.225786+0000 mgr.a (mgr.14373) 8673 : cluster [DBG] pgmap v6014: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T08:57:37.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:57:37 smithi086 bash[24289]: audit 2024-09-16T08:57:36.863469+0000 mgr.a (mgr.14373) 8674 : audit [DBG] from='client.193542 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:57:37.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:57:37 smithi047 bash[22744]: cluster 2024-09-16T08:57:36.225786+0000 mgr.a (mgr.14373) 8673 : cluster [DBG] pgmap v6014: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T08:57:37.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:57:37 smithi047 bash[22744]: audit 2024-09-16T08:57:36.863469+0000 mgr.a (mgr.14373) 8674 : audit [DBG] from='client.193542 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:57:39.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:57:39 smithi157 bash[24585]: cluster 2024-09-16T08:57:38.228482+0000 mgr.a (mgr.14373) 8675 : cluster [DBG] pgmap v6015: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:57:39.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:57:39 smithi086 bash[24289]: cluster 2024-09-16T08:57:38.228482+0000 mgr.a (mgr.14373) 8675 : cluster [DBG] pgmap v6015: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:57:39.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:57:39 smithi047 bash[22744]: cluster 2024-09-16T08:57:38.228482+0000 mgr.a (mgr.14373) 8675 : cluster [DBG] pgmap v6015: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:57:41.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:57:41 smithi157 bash[24585]: cluster 2024-09-16T08:57:40.229242+0000 mgr.a (mgr.14373) 8676 : cluster [DBG] pgmap v6016: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:57:41.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:57:41 smithi086 bash[24289]: cluster 2024-09-16T08:57:40.229242+0000 mgr.a (mgr.14373) 8676 : cluster [DBG] pgmap v6016: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:57:41.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:57:41 smithi047 bash[22744]: cluster 2024-09-16T08:57:40.229242+0000 mgr.a (mgr.14373) 8676 : cluster [DBG] pgmap v6016: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:57:42.292 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:57:42.293 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:57:42.293 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:57:43.062 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:57:43.063 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:57:43.063 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:57:43.063 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:57:43.063 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:57:43.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:57:43 smithi157 bash[24585]: cluster 2024-09-16T08:57:42.231167+0000 mgr.a (mgr.14373) 8677 : cluster [DBG] pgmap v6017: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:57:43.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:57:43 smithi157 bash[24585]: audit 2024-09-16T08:57:42.631647+0000 mgr.a (mgr.14373) 8678 : audit [DBG] from='client.193617 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:57:43.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:57:43 smithi086 bash[24289]: cluster 2024-09-16T08:57:42.231167+0000 mgr.a (mgr.14373) 8677 : cluster [DBG] pgmap v6017: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:57:43.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:57:43 smithi086 bash[24289]: audit 2024-09-16T08:57:42.631647+0000 mgr.a (mgr.14373) 8678 : audit [DBG] from='client.193617 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:57:43.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:57:43 smithi047 bash[22744]: cluster 2024-09-16T08:57:42.231167+0000 mgr.a (mgr.14373) 8677 : cluster [DBG] pgmap v6017: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:57:43.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:57:43 smithi047 bash[22744]: audit 2024-09-16T08:57:42.631647+0000 mgr.a (mgr.14373) 8678 : audit [DBG] from='client.193617 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:57:45.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:57:45 smithi157 bash[24585]: cluster 2024-09-16T08:57:44.232205+0000 mgr.a (mgr.14373) 8679 : cluster [DBG] pgmap v6018: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-16T08:57:45.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:57:45 smithi086 bash[24289]: cluster 2024-09-16T08:57:44.232205+0000 mgr.a (mgr.14373) 8679 : cluster [DBG] pgmap v6018: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-16T08:57:45.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:57:45 smithi047 bash[22744]: cluster 2024-09-16T08:57:44.232205+0000 mgr.a (mgr.14373) 8679 : cluster [DBG] pgmap v6018: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-16T08:57:47.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:57:47 smithi157 bash[24585]: cluster 2024-09-16T08:57:46.233169+0000 mgr.a (mgr.14373) 8680 : cluster [DBG] pgmap v6019: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-16T08:57:47.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:57:47 smithi086 bash[24289]: cluster 2024-09-16T08:57:46.233169+0000 mgr.a (mgr.14373) 8680 : cluster [DBG] pgmap v6019: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-16T08:57:47.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:57:47 smithi047 bash[22744]: cluster 2024-09-16T08:57:46.233169+0000 mgr.a (mgr.14373) 8680 : cluster [DBG] pgmap v6019: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-16T08:57:48.064 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:57:48.065 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:57:48.065 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:57:48.819 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:57:48.820 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:57:48.820 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:57:48.820 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:57:48.820 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:57:49.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:57:49 smithi086 bash[24289]: cluster 2024-09-16T08:57:48.235414+0000 mgr.a (mgr.14373) 8681 : cluster [DBG] pgmap v6020: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-16T08:57:49.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:57:49 smithi086 bash[24289]: audit 2024-09-16T08:57:48.401610+0000 mgr.a (mgr.14373) 8682 : audit [DBG] from='client.193695 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:57:49.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:57:49 smithi047 bash[22744]: cluster 2024-09-16T08:57:48.235414+0000 mgr.a (mgr.14373) 8681 : cluster [DBG] pgmap v6020: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-16T08:57:49.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:57:49 smithi047 bash[22744]: audit 2024-09-16T08:57:48.401610+0000 mgr.a (mgr.14373) 8682 : audit [DBG] from='client.193695 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:57:49.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:57:49 smithi157 bash[24585]: cluster 2024-09-16T08:57:48.235414+0000 mgr.a (mgr.14373) 8681 : cluster [DBG] pgmap v6020: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-16T08:57:49.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:57:49 smithi157 bash[24585]: audit 2024-09-16T08:57:48.401610+0000 mgr.a (mgr.14373) 8682 : audit [DBG] from='client.193695 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:57:51.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:57:51 smithi086 bash[24289]: cluster 2024-09-16T08:57:50.236285+0000 mgr.a (mgr.14373) 8683 : cluster [DBG] pgmap v6021: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:57:51.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:57:51 smithi047 bash[22744]: cluster 2024-09-16T08:57:50.236285+0000 mgr.a (mgr.14373) 8683 : cluster [DBG] pgmap v6021: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:57:51.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:57:51 smithi157 bash[24585]: cluster 2024-09-16T08:57:50.236285+0000 mgr.a (mgr.14373) 8683 : cluster [DBG] pgmap v6021: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:57:53.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:57:53 smithi086 bash[24289]: cluster 2024-09-16T08:57:52.238533+0000 mgr.a (mgr.14373) 8684 : cluster [DBG] pgmap v6022: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:57:53.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:57:53 smithi047 bash[22744]: cluster 2024-09-16T08:57:52.238533+0000 mgr.a (mgr.14373) 8684 : cluster [DBG] pgmap v6022: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:57:53.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:57:53 smithi157 bash[24585]: cluster 2024-09-16T08:57:52.238533+0000 mgr.a (mgr.14373) 8684 : cluster [DBG] pgmap v6022: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:57:53.821 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:57:53.822 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:57:53.822 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:57:54.606 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:57:54.606 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:57:54.606 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:57:54.606 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:57:54.606 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:57:55.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:57:55 smithi047 bash[22744]: audit 2024-09-16T08:57:54.160682+0000 mgr.a (mgr.14373) 8685 : audit [DBG] from='client.193767 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:57:55.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:57:55 smithi047 bash[22744]: cluster 2024-09-16T08:57:54.239165+0000 mgr.a (mgr.14373) 8686 : cluster [DBG] pgmap v6023: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:57:55.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:57:55 smithi157 bash[24585]: audit 2024-09-16T08:57:54.160682+0000 mgr.a (mgr.14373) 8685 : audit [DBG] from='client.193767 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:57:55.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:57:55 smithi157 bash[24585]: cluster 2024-09-16T08:57:54.239165+0000 mgr.a (mgr.14373) 8686 : cluster [DBG] pgmap v6023: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:57:55.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:57:55 smithi086 bash[24289]: audit 2024-09-16T08:57:54.160682+0000 mgr.a (mgr.14373) 8685 : audit [DBG] from='client.193767 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:57:55.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:57:55 smithi086 bash[24289]: cluster 2024-09-16T08:57:54.239165+0000 mgr.a (mgr.14373) 8686 : cluster [DBG] pgmap v6023: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:57:57.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:57:57 smithi047 bash[22744]: cluster 2024-09-16T08:57:56.240006+0000 mgr.a (mgr.14373) 8687 : cluster [DBG] pgmap v6024: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:57:57.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:57:57 smithi157 bash[24585]: cluster 2024-09-16T08:57:56.240006+0000 mgr.a (mgr.14373) 8687 : cluster [DBG] pgmap v6024: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:57:57.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:57:57 smithi086 bash[24289]: cluster 2024-09-16T08:57:56.240006+0000 mgr.a (mgr.14373) 8687 : cluster [DBG] pgmap v6024: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:57:59.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:57:59 smithi047 bash[22744]: cluster 2024-09-16T08:57:58.242234+0000 mgr.a (mgr.14373) 8688 : cluster [DBG] pgmap v6025: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:57:59.608 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:57:59.608 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:57:59.609 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:57:59.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:57:59 smithi157 bash[24585]: cluster 2024-09-16T08:57:58.242234+0000 mgr.a (mgr.14373) 8688 : cluster [DBG] pgmap v6025: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:57:59.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:57:59 smithi086 bash[24289]: cluster 2024-09-16T08:57:58.242234+0000 mgr.a (mgr.14373) 8688 : cluster [DBG] pgmap v6025: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:58:00.399 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:58:00.399 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:58:00.400 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:58:00.400 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:58:00.400 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:58:00.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:58:00 smithi047 bash[22744]: audit 2024-09-16T08:57:59.950308+0000 mgr.a (mgr.14373) 8689 : audit [DBG] from='client.193845 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:58:00.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:58:00 smithi157 bash[24585]: audit 2024-09-16T08:57:59.950308+0000 mgr.a (mgr.14373) 8689 : audit [DBG] from='client.193845 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:58:00.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:58:00 smithi086 bash[24289]: audit 2024-09-16T08:57:59.950308+0000 mgr.a (mgr.14373) 8689 : audit [DBG] from='client.193845 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:58:01.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:58:01 smithi047 bash[22744]: cluster 2024-09-16T08:58:00.242689+0000 mgr.a (mgr.14373) 8690 : cluster [DBG] pgmap v6026: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:58:01.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:58:01 smithi157 bash[24585]: cluster 2024-09-16T08:58:00.242689+0000 mgr.a (mgr.14373) 8690 : cluster [DBG] pgmap v6026: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:58:01.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:58:01 smithi086 bash[24289]: cluster 2024-09-16T08:58:00.242689+0000 mgr.a (mgr.14373) 8690 : cluster [DBG] pgmap v6026: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:58:03.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:58:03 smithi157 bash[24585]: cluster 2024-09-16T08:58:02.244909+0000 mgr.a (mgr.14373) 8691 : cluster [DBG] pgmap v6027: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:58:03.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:58:03 smithi086 bash[24289]: cluster 2024-09-16T08:58:02.244909+0000 mgr.a (mgr.14373) 8691 : cluster [DBG] pgmap v6027: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:58:03.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:58:03 smithi047 bash[22744]: cluster 2024-09-16T08:58:02.244909+0000 mgr.a (mgr.14373) 8691 : cluster [DBG] pgmap v6027: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:58:05.400 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:58:05.401 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:58:05.401 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:58:05.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:58:05 smithi157 bash[24585]: cluster 2024-09-16T08:58:04.245675+0000 mgr.a (mgr.14373) 8692 : cluster [DBG] pgmap v6028: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:58:05.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:58:05 smithi086 bash[24289]: cluster 2024-09-16T08:58:04.245675+0000 mgr.a (mgr.14373) 8692 : cluster [DBG] pgmap v6028: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:58:05.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:58:05 smithi047 bash[22744]: cluster 2024-09-16T08:58:04.245675+0000 mgr.a (mgr.14373) 8692 : cluster [DBG] pgmap v6028: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:58:06.171 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:58:06.171 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:58:06.171 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:58:06.171 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:58:06.171 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:58:06.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:58:06 smithi157 bash[24585]: audit 2024-09-16T08:58:05.740213+0000 mgr.a (mgr.14373) 8693 : audit [DBG] from='client.193920 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:58:06.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:58:06 smithi086 bash[24289]: audit 2024-09-16T08:58:05.740213+0000 mgr.a (mgr.14373) 8693 : audit [DBG] from='client.193920 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:58:06.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:58:06 smithi047 bash[22744]: audit 2024-09-16T08:58:05.740213+0000 mgr.a (mgr.14373) 8693 : audit [DBG] from='client.193920 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:58:07.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:58:07 smithi157 bash[24585]: cluster 2024-09-16T08:58:06.246249+0000 mgr.a (mgr.14373) 8694 : cluster [DBG] pgmap v6029: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:58:07.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:58:07 smithi086 bash[24289]: cluster 2024-09-16T08:58:06.246249+0000 mgr.a (mgr.14373) 8694 : cluster [DBG] pgmap v6029: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:58:07.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:58:07 smithi047 bash[22744]: cluster 2024-09-16T08:58:06.246249+0000 mgr.a (mgr.14373) 8694 : cluster [DBG] pgmap v6029: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:58:09.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:58:09 smithi157 bash[24585]: cluster 2024-09-16T08:58:08.248508+0000 mgr.a (mgr.14373) 8695 : cluster [DBG] pgmap v6030: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-16T08:58:09.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:58:09 smithi086 bash[24289]: cluster 2024-09-16T08:58:08.248508+0000 mgr.a (mgr.14373) 8695 : cluster [DBG] pgmap v6030: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-16T08:58:09.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:58:09 smithi047 bash[22744]: cluster 2024-09-16T08:58:08.248508+0000 mgr.a (mgr.14373) 8695 : cluster [DBG] pgmap v6030: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-16T08:58:10.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:58:10 smithi157 bash[24585]: audit 2024-09-16T08:58:09.932033+0000 mon.b (mon.2) 814 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T08:58:10.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:58:10 smithi086 bash[24289]: audit 2024-09-16T08:58:09.932033+0000 mon.b (mon.2) 814 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T08:58:10.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:58:10 smithi047 bash[22744]: audit 2024-09-16T08:58:09.932033+0000 mon.b (mon.2) 814 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T08:58:11.172 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:58:11.173 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:58:11.173 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:58:11.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:58:11 smithi157 bash[24585]: cluster 2024-09-16T08:58:10.249307+0000 mgr.a (mgr.14373) 8696 : cluster [DBG] pgmap v6031: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-16T08:58:11.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:58:11 smithi086 bash[24289]: cluster 2024-09-16T08:58:10.249307+0000 mgr.a (mgr.14373) 8696 : cluster [DBG] pgmap v6031: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-16T08:58:11.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:58:11 smithi047 bash[22744]: cluster 2024-09-16T08:58:10.249307+0000 mgr.a (mgr.14373) 8696 : cluster [DBG] pgmap v6031: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-16T08:58:11.919 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:58:11.919 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:58:11.919 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:58:11.919 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:58:11.919 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:58:12.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:58:12 smithi157 bash[24585]: audit 2024-09-16T08:58:11.509296+0000 mgr.a (mgr.14373) 8697 : audit [DBG] from='client.193995 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:58:12.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:58:12 smithi086 bash[24289]: audit 2024-09-16T08:58:11.509296+0000 mgr.a (mgr.14373) 8697 : audit [DBG] from='client.193995 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:58:12.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:58:12 smithi047 bash[22744]: audit 2024-09-16T08:58:11.509296+0000 mgr.a (mgr.14373) 8697 : audit [DBG] from='client.193995 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:58:13.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:58:13 smithi157 bash[24585]: cluster 2024-09-16T08:58:12.252047+0000 mgr.a (mgr.14373) 8698 : cluster [DBG] pgmap v6032: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-16T08:58:13.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:58:13 smithi086 bash[24289]: cluster 2024-09-16T08:58:12.252047+0000 mgr.a (mgr.14373) 8698 : cluster [DBG] pgmap v6032: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-16T08:58:13.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:58:13 smithi047 bash[22744]: cluster 2024-09-16T08:58:12.252047+0000 mgr.a (mgr.14373) 8698 : cluster [DBG] pgmap v6032: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-16T08:58:15.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:58:15 smithi157 bash[24585]: cluster 2024-09-16T08:58:14.252829+0000 mgr.a (mgr.14373) 8699 : cluster [DBG] pgmap v6033: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 4.9 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-16T08:58:15.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:58:15 smithi157 bash[24585]: audit 2024-09-16T08:58:15.293326+0000 mon.a (mon.0) 1083 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:58:15.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:58:15 smithi157 bash[24585]: audit 2024-09-16T08:58:15.301681+0000 mon.a (mon.0) 1084 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:58:15.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:58:15 smithi157 bash[24585]: audit 2024-09-16T08:58:15.314579+0000 mon.a (mon.0) 1085 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:58:15.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:58:15 smithi157 bash[24585]: audit 2024-09-16T08:58:15.321645+0000 mon.a (mon.0) 1086 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:58:15.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:58:15 smithi157 bash[24585]: audit 2024-09-16T08:58:15.333211+0000 mon.a (mon.0) 1087 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:58:15.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:58:15 smithi157 bash[24585]: audit 2024-09-16T08:58:15.338214+0000 mon.a (mon.0) 1088 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:58:15.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:58:15 smithi086 bash[24289]: cluster 2024-09-16T08:58:14.252829+0000 mgr.a (mgr.14373) 8699 : cluster [DBG] pgmap v6033: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 4.9 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-16T08:58:15.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:58:15 smithi086 bash[24289]: audit 2024-09-16T08:58:15.293326+0000 mon.a (mon.0) 1083 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:58:15.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:58:15 smithi086 bash[24289]: audit 2024-09-16T08:58:15.301681+0000 mon.a (mon.0) 1084 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:58:15.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:58:15 smithi086 bash[24289]: audit 2024-09-16T08:58:15.314579+0000 mon.a (mon.0) 1085 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:58:15.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:58:15 smithi086 bash[24289]: audit 2024-09-16T08:58:15.321645+0000 mon.a (mon.0) 1086 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:58:15.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:58:15 smithi086 bash[24289]: audit 2024-09-16T08:58:15.333211+0000 mon.a (mon.0) 1087 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:58:15.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:58:15 smithi086 bash[24289]: audit 2024-09-16T08:58:15.338214+0000 mon.a (mon.0) 1088 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:58:15.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:58:15 smithi047 bash[22744]: cluster 2024-09-16T08:58:14.252829+0000 mgr.a (mgr.14373) 8699 : cluster [DBG] pgmap v6033: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 4.9 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-16T08:58:15.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:58:15 smithi047 bash[22744]: audit 2024-09-16T08:58:15.293326+0000 mon.a (mon.0) 1083 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:58:15.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:58:15 smithi047 bash[22744]: audit 2024-09-16T08:58:15.301681+0000 mon.a (mon.0) 1084 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:58:15.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:58:15 smithi047 bash[22744]: audit 2024-09-16T08:58:15.314579+0000 mon.a (mon.0) 1085 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:58:15.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:58:15 smithi047 bash[22744]: audit 2024-09-16T08:58:15.321645+0000 mon.a (mon.0) 1086 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:58:15.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:58:15 smithi047 bash[22744]: audit 2024-09-16T08:58:15.333211+0000 mon.a (mon.0) 1087 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:58:15.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:58:15 smithi047 bash[22744]: audit 2024-09-16T08:58:15.338214+0000 mon.a (mon.0) 1088 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:58:16.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:58:16 smithi157 bash[24585]: audit 2024-09-16T08:58:16.054837+0000 mon.b (mon.2) 815 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T08:58:16.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:58:16 smithi157 bash[24585]: audit 2024-09-16T08:58:16.057321+0000 mon.b (mon.2) 816 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T08:58:16.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:58:16 smithi157 bash[24585]: audit 2024-09-16T08:58:16.068880+0000 mon.a (mon.0) 1089 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:58:16.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:58:16 smithi157 bash[24585]: audit 2024-09-16T08:58:16.074643+0000 mon.b (mon.2) 817 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:58:16.812 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:58:16 smithi047 bash[22744]: audit 2024-09-16T08:58:16.054837+0000 mon.b (mon.2) 815 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T08:58:16.812 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:58:16 smithi047 bash[22744]: audit 2024-09-16T08:58:16.057321+0000 mon.b (mon.2) 816 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T08:58:16.812 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:58:16 smithi047 bash[22744]: audit 2024-09-16T08:58:16.068880+0000 mon.a (mon.0) 1089 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:58:16.812 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:58:16 smithi047 bash[22744]: audit 2024-09-16T08:58:16.074643+0000 mon.b (mon.2) 817 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:58:16.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:58:16 smithi086 bash[24289]: audit 2024-09-16T08:58:16.054837+0000 mon.b (mon.2) 815 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T08:58:16.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:58:16 smithi086 bash[24289]: audit 2024-09-16T08:58:16.057321+0000 mon.b (mon.2) 816 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T08:58:16.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:58:16 smithi086 bash[24289]: audit 2024-09-16T08:58:16.068880+0000 mon.a (mon.0) 1089 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:58:16.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:58:16 smithi086 bash[24289]: audit 2024-09-16T08:58:16.074643+0000 mon.b (mon.2) 817 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:58:16.920 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:58:16.921 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:58:16.921 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:58:17.088 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 08:58:16 smithi047 bash[22994]: debug 2024-09-16T08:58:16.810+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T08:58:17.089 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 08:58:16 smithi047 bash[22994]: debug 2024-09-16T08:58:16.810+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T08:58:17.672 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:58:17.672 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:58:17.672 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:58:17.673 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:58:17.673 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:58:17.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:58:17 smithi157 bash[24585]: audit 2024-09-16T08:58:16.078076+0000 mgr.a (mgr.14373) 8700 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:58:17.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:58:17 smithi157 bash[24585]: cluster 2024-09-16T08:58:16.253571+0000 mgr.a (mgr.14373) 8701 : cluster [DBG] pgmap v6034: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 4.9 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-16T08:58:17.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:58:17 smithi157 bash[24585]: audit 2024-09-16T08:58:16.815030+0000 mgr.a (mgr.14373) 8702 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T08:58:17.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:58:17 smithi157 bash[24585]: cephadm 2024-09-16T08:58:16.817073+0000 mgr.a (mgr.14373) 8703 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T08:58:17.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:58:17 smithi086 bash[24289]: audit 2024-09-16T08:58:16.078076+0000 mgr.a (mgr.14373) 8700 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:58:17.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:58:17 smithi086 bash[24289]: cluster 2024-09-16T08:58:16.253571+0000 mgr.a (mgr.14373) 8701 : cluster [DBG] pgmap v6034: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 4.9 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-16T08:58:17.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:58:17 smithi086 bash[24289]: audit 2024-09-16T08:58:16.815030+0000 mgr.a (mgr.14373) 8702 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T08:58:17.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:58:17 smithi086 bash[24289]: cephadm 2024-09-16T08:58:16.817073+0000 mgr.a (mgr.14373) 8703 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T08:58:17.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:58:17 smithi047 bash[22744]: audit 2024-09-16T08:58:16.078076+0000 mgr.a (mgr.14373) 8700 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:58:17.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:58:17 smithi047 bash[22744]: cluster 2024-09-16T08:58:16.253571+0000 mgr.a (mgr.14373) 8701 : cluster [DBG] pgmap v6034: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 4.9 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-16T08:58:17.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:58:17 smithi047 bash[22744]: audit 2024-09-16T08:58:16.815030+0000 mgr.a (mgr.14373) 8702 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T08:58:17.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:58:17 smithi047 bash[22744]: cephadm 2024-09-16T08:58:16.817073+0000 mgr.a (mgr.14373) 8703 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T08:58:18.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:58:18 smithi157 bash[24585]: audit 2024-09-16T08:58:17.253492+0000 mgr.a (mgr.14373) 8704 : audit [DBG] from='client.194175 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:58:18.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:58:18 smithi086 bash[24289]: audit 2024-09-16T08:58:17.253492+0000 mgr.a (mgr.14373) 8704 : audit [DBG] from='client.194175 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:58:18.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:58:18 smithi047 bash[22744]: audit 2024-09-16T08:58:17.253492+0000 mgr.a (mgr.14373) 8704 : audit [DBG] from='client.194175 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:58:19.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:58:19 smithi157 bash[24585]: cluster 2024-09-16T08:58:18.256726+0000 mgr.a (mgr.14373) 8705 : cluster [DBG] pgmap v6035: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.4 KiB/s rd, 255 B/s wr, 10 op/s 2024-09-16T08:58:19.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:58:19 smithi086 bash[24289]: cluster 2024-09-16T08:58:18.256726+0000 mgr.a (mgr.14373) 8705 : cluster [DBG] pgmap v6035: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.4 KiB/s rd, 255 B/s wr, 10 op/s 2024-09-16T08:58:19.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:58:19 smithi047 bash[22744]: cluster 2024-09-16T08:58:18.256726+0000 mgr.a (mgr.14373) 8705 : cluster [DBG] pgmap v6035: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.4 KiB/s rd, 255 B/s wr, 10 op/s 2024-09-16T08:58:21.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:58:21 smithi157 bash[24585]: cluster 2024-09-16T08:58:20.257523+0000 mgr.a (mgr.14373) 8706 : cluster [DBG] pgmap v6036: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-16T08:58:21.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:58:21 smithi086 bash[24289]: cluster 2024-09-16T08:58:20.257523+0000 mgr.a (mgr.14373) 8706 : cluster [DBG] pgmap v6036: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-16T08:58:21.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:58:21 smithi047 bash[22744]: cluster 2024-09-16T08:58:20.257523+0000 mgr.a (mgr.14373) 8706 : cluster [DBG] pgmap v6036: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-16T08:58:22.674 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:58:22.675 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:58:22.675 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:58:23.419 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:58:23.420 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:58:23.420 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:58:23.420 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:58:23.420 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:58:23.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:58:23 smithi157 bash[24585]: cluster 2024-09-16T08:58:22.259556+0000 mgr.a (mgr.14373) 8707 : cluster [DBG] pgmap v6037: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 70 KiB/s rd, 426 B/s wr, 112 op/s 2024-09-16T08:58:23.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:58:23 smithi157 bash[24585]: audit 2024-09-16T08:58:23.009874+0000 mgr.a (mgr.14373) 8708 : audit [DBG] from='client.194253 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:58:23.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:58:23 smithi086 bash[24289]: cluster 2024-09-16T08:58:22.259556+0000 mgr.a (mgr.14373) 8707 : cluster [DBG] pgmap v6037: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 70 KiB/s rd, 426 B/s wr, 112 op/s 2024-09-16T08:58:23.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:58:23 smithi086 bash[24289]: audit 2024-09-16T08:58:23.009874+0000 mgr.a (mgr.14373) 8708 : audit [DBG] from='client.194253 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:58:23.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:58:23 smithi047 bash[22744]: cluster 2024-09-16T08:58:22.259556+0000 mgr.a (mgr.14373) 8707 : cluster [DBG] pgmap v6037: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 70 KiB/s rd, 426 B/s wr, 112 op/s 2024-09-16T08:58:23.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:58:23 smithi047 bash[22744]: audit 2024-09-16T08:58:23.009874+0000 mgr.a (mgr.14373) 8708 : audit [DBG] from='client.194253 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:58:25.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:58:25 smithi157 bash[24585]: cluster 2024-09-16T08:58:24.260556+0000 mgr.a (mgr.14373) 8709 : cluster [DBG] pgmap v6038: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 70 KiB/s rd, 426 B/s wr, 112 op/s 2024-09-16T08:58:25.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:58:25 smithi086 bash[24289]: cluster 2024-09-16T08:58:24.260556+0000 mgr.a (mgr.14373) 8709 : cluster [DBG] pgmap v6038: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 70 KiB/s rd, 426 B/s wr, 112 op/s 2024-09-16T08:58:25.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:58:25 smithi047 bash[22744]: cluster 2024-09-16T08:58:24.260556+0000 mgr.a (mgr.14373) 8709 : cluster [DBG] pgmap v6038: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 70 KiB/s rd, 426 B/s wr, 112 op/s 2024-09-16T08:58:27.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:58:27 smithi157 bash[24585]: cluster 2024-09-16T08:58:26.261357+0000 mgr.a (mgr.14373) 8710 : cluster [DBG] pgmap v6039: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 70 KiB/s rd, 426 B/s wr, 112 op/s 2024-09-16T08:58:27.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:58:27 smithi086 bash[24289]: cluster 2024-09-16T08:58:26.261357+0000 mgr.a (mgr.14373) 8710 : cluster [DBG] pgmap v6039: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 70 KiB/s rd, 426 B/s wr, 112 op/s 2024-09-16T08:58:27.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:58:27 smithi047 bash[22744]: cluster 2024-09-16T08:58:26.261357+0000 mgr.a (mgr.14373) 8710 : cluster [DBG] pgmap v6039: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 70 KiB/s rd, 426 B/s wr, 112 op/s 2024-09-16T08:58:28.420 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:58:28.421 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:58:28.421 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:58:29.184 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:58:29.185 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:58:29.185 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:58:29.185 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:58:29.185 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:58:29.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:58:29 smithi157 bash[24585]: cluster 2024-09-16T08:58:28.263730+0000 mgr.a (mgr.14373) 8711 : cluster [DBG] pgmap v6040: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 71 KiB/s rd, 426 B/s wr, 113 op/s 2024-09-16T08:58:29.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:58:29 smithi157 bash[24585]: audit 2024-09-16T08:58:28.754703+0000 mgr.a (mgr.14373) 8712 : audit [DBG] from='client.194331 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:58:29.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:58:29 smithi086 bash[24289]: cluster 2024-09-16T08:58:28.263730+0000 mgr.a (mgr.14373) 8711 : cluster [DBG] pgmap v6040: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 71 KiB/s rd, 426 B/s wr, 113 op/s 2024-09-16T08:58:29.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:58:29 smithi086 bash[24289]: audit 2024-09-16T08:58:28.754703+0000 mgr.a (mgr.14373) 8712 : audit [DBG] from='client.194331 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:58:29.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:58:29 smithi047 bash[22744]: cluster 2024-09-16T08:58:28.263730+0000 mgr.a (mgr.14373) 8711 : cluster [DBG] pgmap v6040: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 71 KiB/s rd, 426 B/s wr, 113 op/s 2024-09-16T08:58:29.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:58:29 smithi047 bash[22744]: audit 2024-09-16T08:58:28.754703+0000 mgr.a (mgr.14373) 8712 : audit [DBG] from='client.194331 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:58:31.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:58:31 smithi157 bash[24585]: cluster 2024-09-16T08:58:30.264733+0000 mgr.a (mgr.14373) 8713 : cluster [DBG] pgmap v6041: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 69 KiB/s rd, 170 B/s wr, 110 op/s 2024-09-16T08:58:31.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:58:31 smithi086 bash[24289]: cluster 2024-09-16T08:58:30.264733+0000 mgr.a (mgr.14373) 8713 : cluster [DBG] pgmap v6041: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 69 KiB/s rd, 170 B/s wr, 110 op/s 2024-09-16T08:58:31.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:58:31 smithi047 bash[22744]: cluster 2024-09-16T08:58:30.264733+0000 mgr.a (mgr.14373) 8713 : cluster [DBG] pgmap v6041: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 69 KiB/s rd, 170 B/s wr, 110 op/s 2024-09-16T08:58:33.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:58:33 smithi157 bash[24585]: cluster 2024-09-16T08:58:32.266977+0000 mgr.a (mgr.14373) 8714 : cluster [DBG] pgmap v6042: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 70 KiB/s rd, 170 B/s wr, 111 op/s 2024-09-16T08:58:33.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:58:33 smithi086 bash[24289]: cluster 2024-09-16T08:58:32.266977+0000 mgr.a (mgr.14373) 8714 : cluster [DBG] pgmap v6042: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 70 KiB/s rd, 170 B/s wr, 111 op/s 2024-09-16T08:58:33.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:58:33 smithi047 bash[22744]: cluster 2024-09-16T08:58:32.266977+0000 mgr.a (mgr.14373) 8714 : cluster [DBG] pgmap v6042: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 70 KiB/s rd, 170 B/s wr, 111 op/s 2024-09-16T08:58:34.186 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:58:34.187 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:58:34.187 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:58:34.963 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:58:34.963 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:58:34.963 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:58:34.963 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:58:34.963 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:58:35.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:58:35 smithi157 bash[24585]: cluster 2024-09-16T08:58:34.267563+0000 mgr.a (mgr.14373) 8715 : cluster [DBG] pgmap v6043: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:58:35.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:58:35 smithi157 bash[24585]: audit 2024-09-16T08:58:34.528721+0000 mgr.a (mgr.14373) 8716 : audit [DBG] from='client.194409 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:58:35.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:58:35 smithi086 bash[24289]: cluster 2024-09-16T08:58:34.267563+0000 mgr.a (mgr.14373) 8715 : cluster [DBG] pgmap v6043: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:58:35.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:58:35 smithi086 bash[24289]: audit 2024-09-16T08:58:34.528721+0000 mgr.a (mgr.14373) 8716 : audit [DBG] from='client.194409 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:58:35.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:58:35 smithi047 bash[22744]: cluster 2024-09-16T08:58:34.267563+0000 mgr.a (mgr.14373) 8715 : cluster [DBG] pgmap v6043: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:58:35.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:58:35 smithi047 bash[22744]: audit 2024-09-16T08:58:34.528721+0000 mgr.a (mgr.14373) 8716 : audit [DBG] from='client.194409 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:58:37.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:58:37 smithi157 bash[24585]: cluster 2024-09-16T08:58:36.268484+0000 mgr.a (mgr.14373) 8717 : cluster [DBG] pgmap v6044: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:58:37.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:58:37 smithi086 bash[24289]: cluster 2024-09-16T08:58:36.268484+0000 mgr.a (mgr.14373) 8717 : cluster [DBG] pgmap v6044: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:58:37.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:58:37 smithi047 bash[22744]: cluster 2024-09-16T08:58:36.268484+0000 mgr.a (mgr.14373) 8717 : cluster [DBG] pgmap v6044: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:58:39.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:58:39 smithi157 bash[24585]: cluster 2024-09-16T08:58:38.270733+0000 mgr.a (mgr.14373) 8718 : cluster [DBG] pgmap v6045: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:58:39.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:58:39 smithi086 bash[24289]: cluster 2024-09-16T08:58:38.270733+0000 mgr.a (mgr.14373) 8718 : cluster [DBG] pgmap v6045: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:58:39.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:58:39 smithi047 bash[22744]: cluster 2024-09-16T08:58:38.270733+0000 mgr.a (mgr.14373) 8718 : cluster [DBG] pgmap v6045: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:58:39.964 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:58:39.965 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:58:39.965 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:58:40.750 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:58:40.750 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:58:40.750 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:58:40.750 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:58:40.750 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:58:41.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:58:41 smithi157 bash[24585]: cluster 2024-09-16T08:58:40.271498+0000 mgr.a (mgr.14373) 8719 : cluster [DBG] pgmap v6046: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:58:41.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:58:41 smithi157 bash[24585]: audit 2024-09-16T08:58:40.312732+0000 mgr.a (mgr.14373) 8720 : audit [DBG] from='client.194484 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:58:41.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:58:41 smithi086 bash[24289]: cluster 2024-09-16T08:58:40.271498+0000 mgr.a (mgr.14373) 8719 : cluster [DBG] pgmap v6046: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:58:41.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:58:41 smithi086 bash[24289]: audit 2024-09-16T08:58:40.312732+0000 mgr.a (mgr.14373) 8720 : audit [DBG] from='client.194484 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:58:41.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:58:41 smithi047 bash[22744]: cluster 2024-09-16T08:58:40.271498+0000 mgr.a (mgr.14373) 8719 : cluster [DBG] pgmap v6046: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:58:41.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:58:41 smithi047 bash[22744]: audit 2024-09-16T08:58:40.312732+0000 mgr.a (mgr.14373) 8720 : audit [DBG] from='client.194484 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:58:43.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:58:43 smithi157 bash[24585]: cluster 2024-09-16T08:58:42.273804+0000 mgr.a (mgr.14373) 8721 : cluster [DBG] pgmap v6047: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:58:43.817 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:58:43 smithi086 bash[24289]: cluster 2024-09-16T08:58:42.273804+0000 mgr.a (mgr.14373) 8721 : cluster [DBG] pgmap v6047: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:58:43.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:58:43 smithi047 bash[22744]: cluster 2024-09-16T08:58:42.273804+0000 mgr.a (mgr.14373) 8721 : cluster [DBG] pgmap v6047: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:58:45.751 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:58:45.752 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:58:45.752 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:58:45.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:58:45 smithi157 bash[24585]: cluster 2024-09-16T08:58:44.274758+0000 mgr.a (mgr.14373) 8722 : cluster [DBG] pgmap v6048: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:58:45.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:58:45 smithi086 bash[24289]: cluster 2024-09-16T08:58:44.274758+0000 mgr.a (mgr.14373) 8722 : cluster [DBG] pgmap v6048: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:58:45.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:58:45 smithi047 bash[22744]: cluster 2024-09-16T08:58:44.274758+0000 mgr.a (mgr.14373) 8722 : cluster [DBG] pgmap v6048: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:58:46.497 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:58:46.498 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:58:46.498 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:58:46.498 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:58:46.498 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:58:47.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:58:47 smithi157 bash[24585]: audit 2024-09-16T08:58:46.089154+0000 mgr.a (mgr.14373) 8723 : audit [DBG] from='client.194562 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:58:47.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:58:47 smithi157 bash[24585]: cluster 2024-09-16T08:58:46.275310+0000 mgr.a (mgr.14373) 8724 : cluster [DBG] pgmap v6049: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:58:47.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:58:47 smithi086 bash[24289]: audit 2024-09-16T08:58:46.089154+0000 mgr.a (mgr.14373) 8723 : audit [DBG] from='client.194562 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:58:47.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:58:47 smithi086 bash[24289]: cluster 2024-09-16T08:58:46.275310+0000 mgr.a (mgr.14373) 8724 : cluster [DBG] pgmap v6049: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:58:47.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:58:47 smithi047 bash[22744]: audit 2024-09-16T08:58:46.089154+0000 mgr.a (mgr.14373) 8723 : audit [DBG] from='client.194562 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:58:47.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:58:47 smithi047 bash[22744]: cluster 2024-09-16T08:58:46.275310+0000 mgr.a (mgr.14373) 8724 : cluster [DBG] pgmap v6049: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:58:49.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:58:49 smithi157 bash[24585]: cluster 2024-09-16T08:58:48.277721+0000 mgr.a (mgr.14373) 8725 : cluster [DBG] pgmap v6050: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-16T08:58:49.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:58:49 smithi086 bash[24289]: cluster 2024-09-16T08:58:48.277721+0000 mgr.a (mgr.14373) 8725 : cluster [DBG] pgmap v6050: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-16T08:58:49.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:58:49 smithi047 bash[22744]: cluster 2024-09-16T08:58:48.277721+0000 mgr.a (mgr.14373) 8725 : cluster [DBG] pgmap v6050: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-16T08:58:51.499 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:58:51.499 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:58:51.500 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:58:51.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:58:51 smithi157 bash[24585]: cluster 2024-09-16T08:58:50.278570+0000 mgr.a (mgr.14373) 8726 : cluster [DBG] pgmap v6051: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T08:58:51.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:58:51 smithi086 bash[24289]: cluster 2024-09-16T08:58:50.278570+0000 mgr.a (mgr.14373) 8726 : cluster [DBG] pgmap v6051: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T08:58:51.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:58:51 smithi047 bash[22744]: cluster 2024-09-16T08:58:50.278570+0000 mgr.a (mgr.14373) 8726 : cluster [DBG] pgmap v6051: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T08:58:52.251 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:58:52.251 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:58:52.251 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:58:52.252 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:58:52.252 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:58:52.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:58:52 smithi157 bash[24585]: audit 2024-09-16T08:58:51.839604+0000 mgr.a (mgr.14373) 8727 : audit [DBG] from='client.194640 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:58:52.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:58:52 smithi086 bash[24289]: audit 2024-09-16T08:58:51.839604+0000 mgr.a (mgr.14373) 8727 : audit [DBG] from='client.194640 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:58:52.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:58:52 smithi047 bash[22744]: audit 2024-09-16T08:58:51.839604+0000 mgr.a (mgr.14373) 8727 : audit [DBG] from='client.194640 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:58:53.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:58:53 smithi157 bash[24585]: cluster 2024-09-16T08:58:52.279728+0000 mgr.a (mgr.14373) 8728 : cluster [DBG] pgmap v6052: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:58:53.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:58:53 smithi086 bash[24289]: cluster 2024-09-16T08:58:52.279728+0000 mgr.a (mgr.14373) 8728 : cluster [DBG] pgmap v6052: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:58:53.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:58:53 smithi047 bash[22744]: cluster 2024-09-16T08:58:52.279728+0000 mgr.a (mgr.14373) 8728 : cluster [DBG] pgmap v6052: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:58:55.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:58:55 smithi157 bash[24585]: cluster 2024-09-16T08:58:54.280483+0000 mgr.a (mgr.14373) 8729 : cluster [DBG] pgmap v6053: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T08:58:55.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:58:55 smithi086 bash[24289]: cluster 2024-09-16T08:58:54.280483+0000 mgr.a (mgr.14373) 8729 : cluster [DBG] pgmap v6053: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T08:58:55.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:58:55 smithi047 bash[22744]: cluster 2024-09-16T08:58:54.280483+0000 mgr.a (mgr.14373) 8729 : cluster [DBG] pgmap v6053: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T08:58:57.253 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:58:57.253 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:58:57.253 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:58:57.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:58:57 smithi047 bash[22744]: cluster 2024-09-16T08:58:56.281229+0000 mgr.a (mgr.14373) 8730 : cluster [DBG] pgmap v6054: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T08:58:57.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:58:57 smithi157 bash[24585]: cluster 2024-09-16T08:58:56.281229+0000 mgr.a (mgr.14373) 8730 : cluster [DBG] pgmap v6054: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T08:58:57.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:58:57 smithi086 bash[24289]: cluster 2024-09-16T08:58:56.281229+0000 mgr.a (mgr.14373) 8730 : cluster [DBG] pgmap v6054: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T08:58:58.012 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:58:58.012 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:58:58.012 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:58:58.012 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:58:58.012 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:58:58.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:58:58 smithi157 bash[24585]: audit 2024-09-16T08:58:57.589473+0000 mgr.a (mgr.14373) 8731 : audit [DBG] from='client.194718 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:58:58.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:58:58 smithi086 bash[24289]: audit 2024-09-16T08:58:57.589473+0000 mgr.a (mgr.14373) 8731 : audit [DBG] from='client.194718 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:58:58.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:58:58 smithi047 bash[22744]: audit 2024-09-16T08:58:57.589473+0000 mgr.a (mgr.14373) 8731 : audit [DBG] from='client.194718 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:58:59.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:58:59 smithi157 bash[24585]: cluster 2024-09-16T08:58:58.283982+0000 mgr.a (mgr.14373) 8732 : cluster [DBG] pgmap v6055: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:58:59.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:58:59 smithi086 bash[24289]: cluster 2024-09-16T08:58:58.283982+0000 mgr.a (mgr.14373) 8732 : cluster [DBG] pgmap v6055: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:58:59.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:58:59 smithi047 bash[22744]: cluster 2024-09-16T08:58:58.283982+0000 mgr.a (mgr.14373) 8732 : cluster [DBG] pgmap v6055: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:59:01.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:59:01 smithi157 bash[24585]: cluster 2024-09-16T08:59:00.284736+0000 mgr.a (mgr.14373) 8733 : cluster [DBG] pgmap v6056: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-16T08:59:01.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:59:01 smithi086 bash[24289]: cluster 2024-09-16T08:59:00.284736+0000 mgr.a (mgr.14373) 8733 : cluster [DBG] pgmap v6056: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-16T08:59:01.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:59:01 smithi047 bash[22744]: cluster 2024-09-16T08:59:00.284736+0000 mgr.a (mgr.14373) 8733 : cluster [DBG] pgmap v6056: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-16T08:59:03.014 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:59:03.014 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:59:03.014 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:59:03.755 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:59:03.756 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:59:03.756 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:59:03.756 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:59:03.756 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:59:03.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:59:03 smithi157 bash[24585]: cluster 2024-09-16T08:59:02.286737+0000 mgr.a (mgr.14373) 8734 : cluster [DBG] pgmap v6057: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-16T08:59:03.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:59:03 smithi086 bash[24289]: cluster 2024-09-16T08:59:02.286737+0000 mgr.a (mgr.14373) 8734 : cluster [DBG] pgmap v6057: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-16T08:59:03.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:59:03 smithi047 bash[22744]: cluster 2024-09-16T08:59:02.286737+0000 mgr.a (mgr.14373) 8734 : cluster [DBG] pgmap v6057: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-16T08:59:04.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:59:04 smithi157 bash[24585]: audit 2024-09-16T08:59:03.347513+0000 mgr.a (mgr.14373) 8735 : audit [DBG] from='client.194796 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:59:04.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:59:04 smithi086 bash[24289]: audit 2024-09-16T08:59:03.347513+0000 mgr.a (mgr.14373) 8735 : audit [DBG] from='client.194796 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:59:04.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:59:04 smithi047 bash[22744]: audit 2024-09-16T08:59:03.347513+0000 mgr.a (mgr.14373) 8735 : audit [DBG] from='client.194796 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:59:05.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:59:05 smithi157 bash[24585]: cluster 2024-09-16T08:59:04.287736+0000 mgr.a (mgr.14373) 8736 : cluster [DBG] pgmap v6058: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:59:05.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:59:05 smithi086 bash[24289]: cluster 2024-09-16T08:59:04.287736+0000 mgr.a (mgr.14373) 8736 : cluster [DBG] pgmap v6058: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:59:05.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:59:05 smithi047 bash[22744]: cluster 2024-09-16T08:59:04.287736+0000 mgr.a (mgr.14373) 8736 : cluster [DBG] pgmap v6058: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:59:07.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:59:07 smithi157 bash[24585]: cluster 2024-09-16T08:59:06.288524+0000 mgr.a (mgr.14373) 8737 : cluster [DBG] pgmap v6059: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:59:07.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:59:07 smithi086 bash[24289]: cluster 2024-09-16T08:59:06.288524+0000 mgr.a (mgr.14373) 8737 : cluster [DBG] pgmap v6059: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:59:07.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:59:07 smithi047 bash[22744]: cluster 2024-09-16T08:59:06.288524+0000 mgr.a (mgr.14373) 8737 : cluster [DBG] pgmap v6059: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:59:08.757 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:59:08.758 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:59:08.758 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:59:09.530 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:59:09.531 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:59:09.531 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:59:09.531 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:59:09.531 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:59:09.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:59:09 smithi157 bash[24585]: cluster 2024-09-16T08:59:08.290775+0000 mgr.a (mgr.14373) 8738 : cluster [DBG] pgmap v6060: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:59:09.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:59:09 smithi086 bash[24289]: cluster 2024-09-16T08:59:08.290775+0000 mgr.a (mgr.14373) 8738 : cluster [DBG] pgmap v6060: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:59:09.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:59:09 smithi047 bash[22744]: cluster 2024-09-16T08:59:08.290775+0000 mgr.a (mgr.14373) 8738 : cluster [DBG] pgmap v6060: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:59:10.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:59:10 smithi157 bash[24585]: audit 2024-09-16T08:59:09.096696+0000 mgr.a (mgr.14373) 8739 : audit [DBG] from='client.194871 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:59:10.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:59:10 smithi086 bash[24289]: audit 2024-09-16T08:59:09.096696+0000 mgr.a (mgr.14373) 8739 : audit [DBG] from='client.194871 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:59:10.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:59:10 smithi047 bash[22744]: audit 2024-09-16T08:59:09.096696+0000 mgr.a (mgr.14373) 8739 : audit [DBG] from='client.194871 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:59:11.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:59:11 smithi157 bash[24585]: cluster 2024-09-16T08:59:10.291748+0000 mgr.a (mgr.14373) 8740 : cluster [DBG] pgmap v6061: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:59:11.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:59:11 smithi086 bash[24289]: cluster 2024-09-16T08:59:10.291748+0000 mgr.a (mgr.14373) 8740 : cluster [DBG] pgmap v6061: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:59:11.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:59:11 smithi047 bash[22744]: cluster 2024-09-16T08:59:10.291748+0000 mgr.a (mgr.14373) 8740 : cluster [DBG] pgmap v6061: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:59:13.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:59:13 smithi157 bash[24585]: cluster 2024-09-16T08:59:12.293945+0000 mgr.a (mgr.14373) 8741 : cluster [DBG] pgmap v6062: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:59:13.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:59:13 smithi086 bash[24289]: cluster 2024-09-16T08:59:12.293945+0000 mgr.a (mgr.14373) 8741 : cluster [DBG] pgmap v6062: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:59:13.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:59:13 smithi047 bash[22744]: cluster 2024-09-16T08:59:12.293945+0000 mgr.a (mgr.14373) 8741 : cluster [DBG] pgmap v6062: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:59:14.532 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:59:14.533 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:59:14.533 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:59:15.306 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:59:15.307 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:59:15.307 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:59:15.307 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:59:15.307 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:59:15.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:59:15 smithi157 bash[24585]: cluster 2024-09-16T08:59:14.294734+0000 mgr.a (mgr.14373) 8742 : cluster [DBG] pgmap v6063: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:59:15.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:59:15 smithi157 bash[24585]: audit 2024-09-16T08:59:14.866829+0000 mgr.a (mgr.14373) 8743 : audit [DBG] from='client.194949 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:59:15.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:59:15 smithi086 bash[24289]: cluster 2024-09-16T08:59:14.294734+0000 mgr.a (mgr.14373) 8742 : cluster [DBG] pgmap v6063: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:59:15.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:59:15 smithi086 bash[24289]: audit 2024-09-16T08:59:14.866829+0000 mgr.a (mgr.14373) 8743 : audit [DBG] from='client.194949 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:59:15.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:59:15 smithi047 bash[22744]: cluster 2024-09-16T08:59:14.294734+0000 mgr.a (mgr.14373) 8742 : cluster [DBG] pgmap v6063: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:59:15.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:59:15 smithi047 bash[22744]: audit 2024-09-16T08:59:14.866829+0000 mgr.a (mgr.14373) 8743 : audit [DBG] from='client.194949 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:59:17.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:59:17 smithi157 bash[24585]: cluster 2024-09-16T08:59:16.295688+0000 mgr.a (mgr.14373) 8744 : cluster [DBG] pgmap v6064: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:59:17.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:59:17 smithi157 bash[24585]: audit 2024-09-16T08:59:16.871286+0000 mon.b (mon.2) 818 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T08:59:17.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:59:17 smithi086 bash[24289]: cluster 2024-09-16T08:59:16.295688+0000 mgr.a (mgr.14373) 8744 : cluster [DBG] pgmap v6064: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:59:17.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:59:17 smithi086 bash[24289]: audit 2024-09-16T08:59:16.871286+0000 mon.b (mon.2) 818 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T08:59:17.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:59:17 smithi047 bash[22744]: cluster 2024-09-16T08:59:16.295688+0000 mgr.a (mgr.14373) 8744 : cluster [DBG] pgmap v6064: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:59:17.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:59:17 smithi047 bash[22744]: audit 2024-09-16T08:59:16.871286+0000 mon.b (mon.2) 818 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T08:59:18.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:59:18 smithi157 bash[24585]: audit 2024-09-16T08:59:17.716539+0000 mon.b (mon.2) 819 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T08:59:18.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:59:18 smithi157 bash[24585]: audit 2024-09-16T08:59:17.718650+0000 mon.b (mon.2) 820 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T08:59:18.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:59:18 smithi157 bash[24585]: audit 2024-09-16T08:59:17.732376+0000 mon.a (mon.0) 1090 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:59:18.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:59:18 smithi157 bash[24585]: audit 2024-09-16T08:59:17.736278+0000 mon.b (mon.2) 821 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:59:18.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:59:18 smithi157 bash[24585]: audit 2024-09-16T08:59:17.740305+0000 mgr.a (mgr.14373) 8745 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:59:18.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:59:18 smithi086 bash[24289]: audit 2024-09-16T08:59:17.716539+0000 mon.b (mon.2) 819 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T08:59:18.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:59:18 smithi086 bash[24289]: audit 2024-09-16T08:59:17.718650+0000 mon.b (mon.2) 820 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T08:59:18.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:59:18 smithi086 bash[24289]: audit 2024-09-16T08:59:17.732376+0000 mon.a (mon.0) 1090 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:59:18.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:59:18 smithi086 bash[24289]: audit 2024-09-16T08:59:17.736278+0000 mon.b (mon.2) 821 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:59:18.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:59:18 smithi086 bash[24289]: audit 2024-09-16T08:59:17.740305+0000 mgr.a (mgr.14373) 8745 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:59:18.839 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 08:59:18 smithi047 bash[22994]: debug 2024-09-16T08:59:18.473+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T08:59:18.839 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 08:59:18 smithi047 bash[22994]: debug 2024-09-16T08:59:18.473+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T08:59:18.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:59:18 smithi047 bash[22744]: audit 2024-09-16T08:59:17.716539+0000 mon.b (mon.2) 819 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T08:59:18.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:59:18 smithi047 bash[22744]: audit 2024-09-16T08:59:17.718650+0000 mon.b (mon.2) 820 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T08:59:18.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:59:18 smithi047 bash[22744]: audit 2024-09-16T08:59:17.732376+0000 mon.a (mon.0) 1090 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T08:59:18.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:59:18 smithi047 bash[22744]: audit 2024-09-16T08:59:17.736278+0000 mon.b (mon.2) 821 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:59:18.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:59:18 smithi047 bash[22744]: audit 2024-09-16T08:59:17.740305+0000 mgr.a (mgr.14373) 8745 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T08:59:20.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:59:19 smithi157 bash[24585]: cluster 2024-09-16T08:59:18.298218+0000 mgr.a (mgr.14373) 8746 : cluster [DBG] pgmap v6065: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:59:20.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:59:19 smithi157 bash[24585]: audit 2024-09-16T08:59:18.475194+0000 mgr.a (mgr.14373) 8747 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T08:59:20.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:59:19 smithi157 bash[24585]: cephadm 2024-09-16T08:59:18.477016+0000 mgr.a (mgr.14373) 8748 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T08:59:20.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:59:19 smithi086 bash[24289]: cluster 2024-09-16T08:59:18.298218+0000 mgr.a (mgr.14373) 8746 : cluster [DBG] pgmap v6065: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:59:20.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:59:19 smithi086 bash[24289]: audit 2024-09-16T08:59:18.475194+0000 mgr.a (mgr.14373) 8747 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T08:59:20.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:59:19 smithi086 bash[24289]: cephadm 2024-09-16T08:59:18.477016+0000 mgr.a (mgr.14373) 8748 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T08:59:20.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:59:19 smithi047 bash[22744]: cluster 2024-09-16T08:59:18.298218+0000 mgr.a (mgr.14373) 8746 : cluster [DBG] pgmap v6065: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:59:20.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:59:19 smithi047 bash[22744]: audit 2024-09-16T08:59:18.475194+0000 mgr.a (mgr.14373) 8747 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T08:59:20.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:59:19 smithi047 bash[22744]: cephadm 2024-09-16T08:59:18.477016+0000 mgr.a (mgr.14373) 8748 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T08:59:20.308 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:59:20.308 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:59:20.308 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:59:21.058 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:59:21.058 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:59:21.058 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:59:21.058 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:59:21.058 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:59:22.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:59:21 smithi157 bash[24585]: cluster 2024-09-16T08:59:20.299030+0000 mgr.a (mgr.14373) 8749 : cluster [DBG] pgmap v6066: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:59:22.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:59:21 smithi157 bash[24585]: audit 2024-09-16T08:59:20.639462+0000 mgr.a (mgr.14373) 8750 : audit [DBG] from='client.195129 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:59:22.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:59:21 smithi086 bash[24289]: cluster 2024-09-16T08:59:20.299030+0000 mgr.a (mgr.14373) 8749 : cluster [DBG] pgmap v6066: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:59:22.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:59:21 smithi086 bash[24289]: audit 2024-09-16T08:59:20.639462+0000 mgr.a (mgr.14373) 8750 : audit [DBG] from='client.195129 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:59:22.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:59:21 smithi047 bash[22744]: cluster 2024-09-16T08:59:20.299030+0000 mgr.a (mgr.14373) 8749 : cluster [DBG] pgmap v6066: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:59:22.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:59:21 smithi047 bash[22744]: audit 2024-09-16T08:59:20.639462+0000 mgr.a (mgr.14373) 8750 : audit [DBG] from='client.195129 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:59:24.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:59:23 smithi157 bash[24585]: cluster 2024-09-16T08:59:22.301327+0000 mgr.a (mgr.14373) 8751 : cluster [DBG] pgmap v6067: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:59:24.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:59:23 smithi086 bash[24289]: cluster 2024-09-16T08:59:22.301327+0000 mgr.a (mgr.14373) 8751 : cluster [DBG] pgmap v6067: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:59:24.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:59:23 smithi047 bash[22744]: cluster 2024-09-16T08:59:22.301327+0000 mgr.a (mgr.14373) 8751 : cluster [DBG] pgmap v6067: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:59:26.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:59:25 smithi157 bash[24585]: cluster 2024-09-16T08:59:24.302117+0000 mgr.a (mgr.14373) 8752 : cluster [DBG] pgmap v6068: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:59:26.059 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:59:26.060 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:59:26.060 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:59:26.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:59:25 smithi086 bash[24289]: cluster 2024-09-16T08:59:24.302117+0000 mgr.a (mgr.14373) 8752 : cluster [DBG] pgmap v6068: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:59:26.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:59:25 smithi047 bash[22744]: cluster 2024-09-16T08:59:24.302117+0000 mgr.a (mgr.14373) 8752 : cluster [DBG] pgmap v6068: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:59:26.805 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:59:26.805 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:59:26.805 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:59:26.805 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:59:26.805 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:59:28.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:59:27 smithi157 bash[24585]: cluster 2024-09-16T08:59:26.302875+0000 mgr.a (mgr.14373) 8753 : cluster [DBG] pgmap v6069: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:59:28.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:59:27 smithi157 bash[24585]: audit 2024-09-16T08:59:26.393023+0000 mgr.a (mgr.14373) 8754 : audit [DBG] from='client.195207 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:59:28.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:59:27 smithi086 bash[24289]: cluster 2024-09-16T08:59:26.302875+0000 mgr.a (mgr.14373) 8753 : cluster [DBG] pgmap v6069: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:59:28.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:59:27 smithi086 bash[24289]: audit 2024-09-16T08:59:26.393023+0000 mgr.a (mgr.14373) 8754 : audit [DBG] from='client.195207 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:59:28.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:59:27 smithi047 bash[22744]: cluster 2024-09-16T08:59:26.302875+0000 mgr.a (mgr.14373) 8753 : cluster [DBG] pgmap v6069: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:59:28.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:59:27 smithi047 bash[22744]: audit 2024-09-16T08:59:26.393023+0000 mgr.a (mgr.14373) 8754 : audit [DBG] from='client.195207 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:59:30.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:59:29 smithi157 bash[24585]: cluster 2024-09-16T08:59:28.305549+0000 mgr.a (mgr.14373) 8755 : cluster [DBG] pgmap v6070: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:59:30.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:59:29 smithi086 bash[24289]: cluster 2024-09-16T08:59:28.305549+0000 mgr.a (mgr.14373) 8755 : cluster [DBG] pgmap v6070: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:59:30.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:59:29 smithi047 bash[22744]: cluster 2024-09-16T08:59:28.305549+0000 mgr.a (mgr.14373) 8755 : cluster [DBG] pgmap v6070: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:59:31.806 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:59:31.807 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:59:31.807 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:59:32.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:59:31 smithi157 bash[24585]: cluster 2024-09-16T08:59:30.306367+0000 mgr.a (mgr.14373) 8756 : cluster [DBG] pgmap v6071: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T08:59:32.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:59:31 smithi086 bash[24289]: cluster 2024-09-16T08:59:30.306367+0000 mgr.a (mgr.14373) 8756 : cluster [DBG] pgmap v6071: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T08:59:32.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:59:31 smithi047 bash[22744]: cluster 2024-09-16T08:59:30.306367+0000 mgr.a (mgr.14373) 8756 : cluster [DBG] pgmap v6071: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T08:59:32.566 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:59:32.566 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:59:32.566 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:59:32.566 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:59:32.566 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:59:34.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:59:33 smithi157 bash[24585]: audit 2024-09-16T08:59:32.139934+0000 mgr.a (mgr.14373) 8757 : audit [DBG] from='client.195285 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:59:34.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:59:33 smithi157 bash[24585]: cluster 2024-09-16T08:59:32.307668+0000 mgr.a (mgr.14373) 8758 : cluster [DBG] pgmap v6072: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:59:34.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:59:33 smithi086 bash[24289]: audit 2024-09-16T08:59:32.139934+0000 mgr.a (mgr.14373) 8757 : audit [DBG] from='client.195285 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:59:34.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:59:33 smithi086 bash[24289]: cluster 2024-09-16T08:59:32.307668+0000 mgr.a (mgr.14373) 8758 : cluster [DBG] pgmap v6072: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:59:34.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:59:33 smithi047 bash[22744]: audit 2024-09-16T08:59:32.139934+0000 mgr.a (mgr.14373) 8757 : audit [DBG] from='client.195285 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:59:34.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:59:33 smithi047 bash[22744]: cluster 2024-09-16T08:59:32.307668+0000 mgr.a (mgr.14373) 8758 : cluster [DBG] pgmap v6072: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T08:59:36.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:59:35 smithi157 bash[24585]: cluster 2024-09-16T08:59:34.308524+0000 mgr.a (mgr.14373) 8759 : cluster [DBG] pgmap v6073: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:59:36.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:59:35 smithi086 bash[24289]: cluster 2024-09-16T08:59:34.308524+0000 mgr.a (mgr.14373) 8759 : cluster [DBG] pgmap v6073: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:59:36.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:59:35 smithi047 bash[22744]: cluster 2024-09-16T08:59:34.308524+0000 mgr.a (mgr.14373) 8759 : cluster [DBG] pgmap v6073: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T08:59:37.568 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:59:37.568 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:59:37.569 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:59:38.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:59:37 smithi157 bash[24585]: cluster 2024-09-16T08:59:36.309289+0000 mgr.a (mgr.14373) 8760 : cluster [DBG] pgmap v6074: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T08:59:38.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:59:37 smithi086 bash[24289]: cluster 2024-09-16T08:59:36.309289+0000 mgr.a (mgr.14373) 8760 : cluster [DBG] pgmap v6074: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T08:59:38.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:59:37 smithi047 bash[22744]: cluster 2024-09-16T08:59:36.309289+0000 mgr.a (mgr.14373) 8760 : cluster [DBG] pgmap v6074: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T08:59:38.363 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:59:38.363 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:59:38.363 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:59:38.363 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:59:38.363 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:59:39.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:59:38 smithi157 bash[24585]: audit 2024-09-16T08:59:37.911844+0000 mgr.a (mgr.14373) 8761 : audit [DBG] from='client.195363 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:59:39.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:59:38 smithi086 bash[24289]: audit 2024-09-16T08:59:37.911844+0000 mgr.a (mgr.14373) 8761 : audit [DBG] from='client.195363 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:59:39.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:59:38 smithi047 bash[22744]: audit 2024-09-16T08:59:37.911844+0000 mgr.a (mgr.14373) 8761 : audit [DBG] from='client.195363 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:59:40.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:59:39 smithi157 bash[24585]: cluster 2024-09-16T08:59:38.310624+0000 mgr.a (mgr.14373) 8762 : cluster [DBG] pgmap v6075: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:59:40.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:59:39 smithi086 bash[24289]: cluster 2024-09-16T08:59:38.310624+0000 mgr.a (mgr.14373) 8762 : cluster [DBG] pgmap v6075: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:59:40.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:59:39 smithi047 bash[22744]: cluster 2024-09-16T08:59:38.310624+0000 mgr.a (mgr.14373) 8762 : cluster [DBG] pgmap v6075: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:59:42.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:59:41 smithi157 bash[24585]: cluster 2024-09-16T08:59:40.311434+0000 mgr.a (mgr.14373) 8763 : cluster [DBG] pgmap v6076: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:59:42.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:59:41 smithi086 bash[24289]: cluster 2024-09-16T08:59:40.311434+0000 mgr.a (mgr.14373) 8763 : cluster [DBG] pgmap v6076: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:59:42.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:59:41 smithi047 bash[22744]: cluster 2024-09-16T08:59:40.311434+0000 mgr.a (mgr.14373) 8763 : cluster [DBG] pgmap v6076: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:59:43.364 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:59:43.365 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:59:43.365 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:59:44.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:59:43 smithi157 bash[24585]: cluster 2024-09-16T08:59:42.313504+0000 mgr.a (mgr.14373) 8764 : cluster [DBG] pgmap v6077: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:59:44.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:59:43 smithi086 bash[24289]: cluster 2024-09-16T08:59:42.313504+0000 mgr.a (mgr.14373) 8764 : cluster [DBG] pgmap v6077: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:59:44.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:59:43 smithi047 bash[22744]: cluster 2024-09-16T08:59:42.313504+0000 mgr.a (mgr.14373) 8764 : cluster [DBG] pgmap v6077: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:59:44.140 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:59:44.140 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:59:44.141 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:59:44.141 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:59:44.141 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:59:45.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:59:44 smithi157 bash[24585]: audit 2024-09-16T08:59:43.703440+0000 mgr.a (mgr.14373) 8765 : audit [DBG] from='client.195438 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:59:45.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:59:44 smithi086 bash[24289]: audit 2024-09-16T08:59:43.703440+0000 mgr.a (mgr.14373) 8765 : audit [DBG] from='client.195438 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:59:45.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:59:44 smithi047 bash[22744]: audit 2024-09-16T08:59:43.703440+0000 mgr.a (mgr.14373) 8765 : audit [DBG] from='client.195438 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:59:46.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:59:45 smithi157 bash[24585]: cluster 2024-09-16T08:59:44.314518+0000 mgr.a (mgr.14373) 8766 : cluster [DBG] pgmap v6078: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:59:46.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:59:45 smithi086 bash[24289]: cluster 2024-09-16T08:59:44.314518+0000 mgr.a (mgr.14373) 8766 : cluster [DBG] pgmap v6078: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:59:46.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:59:45 smithi047 bash[22744]: cluster 2024-09-16T08:59:44.314518+0000 mgr.a (mgr.14373) 8766 : cluster [DBG] pgmap v6078: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:59:48.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:59:47 smithi157 bash[24585]: cluster 2024-09-16T08:59:46.315331+0000 mgr.a (mgr.14373) 8767 : cluster [DBG] pgmap v6079: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:59:48.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:59:47 smithi086 bash[24289]: cluster 2024-09-16T08:59:46.315331+0000 mgr.a (mgr.14373) 8767 : cluster [DBG] pgmap v6079: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:59:48.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:59:47 smithi047 bash[22744]: cluster 2024-09-16T08:59:46.315331+0000 mgr.a (mgr.14373) 8767 : cluster [DBG] pgmap v6079: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:59:49.142 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:59:49.143 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:59:49.143 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:59:49.892 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:59:49.892 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:59:49.892 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:59:49.892 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:59:49.892 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:59:50.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:59:49 smithi086 bash[24289]: cluster 2024-09-16T08:59:48.317514+0000 mgr.a (mgr.14373) 8768 : cluster [DBG] pgmap v6080: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:59:50.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:59:49 smithi047 bash[22744]: cluster 2024-09-16T08:59:48.317514+0000 mgr.a (mgr.14373) 8768 : cluster [DBG] pgmap v6080: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:59:50.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:59:49 smithi157 bash[24585]: cluster 2024-09-16T08:59:48.317514+0000 mgr.a (mgr.14373) 8768 : cluster [DBG] pgmap v6080: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:59:51.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:59:50 smithi086 bash[24289]: audit 2024-09-16T08:59:49.472571+0000 mgr.a (mgr.14373) 8769 : audit [DBG] from='client.195516 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:59:51.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:59:50 smithi047 bash[22744]: audit 2024-09-16T08:59:49.472571+0000 mgr.a (mgr.14373) 8769 : audit [DBG] from='client.195516 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:59:51.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:59:50 smithi157 bash[24585]: audit 2024-09-16T08:59:49.472571+0000 mgr.a (mgr.14373) 8769 : audit [DBG] from='client.195516 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:59:52.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:59:51 smithi086 bash[24289]: cluster 2024-09-16T08:59:50.318468+0000 mgr.a (mgr.14373) 8770 : cluster [DBG] pgmap v6081: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:59:52.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:59:51 smithi047 bash[22744]: cluster 2024-09-16T08:59:50.318468+0000 mgr.a (mgr.14373) 8770 : cluster [DBG] pgmap v6081: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:59:52.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:59:51 smithi157 bash[24585]: cluster 2024-09-16T08:59:50.318468+0000 mgr.a (mgr.14373) 8770 : cluster [DBG] pgmap v6081: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:59:54.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:59:53 smithi047 bash[22744]: cluster 2024-09-16T08:59:52.320710+0000 mgr.a (mgr.14373) 8771 : cluster [DBG] pgmap v6082: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:59:54.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:59:53 smithi157 bash[24585]: cluster 2024-09-16T08:59:52.320710+0000 mgr.a (mgr.14373) 8771 : cluster [DBG] pgmap v6082: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:59:54.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:59:53 smithi086 bash[24289]: cluster 2024-09-16T08:59:52.320710+0000 mgr.a (mgr.14373) 8771 : cluster [DBG] pgmap v6082: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:59:54.893 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T08:59:54.894 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T08:59:54.894 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T08:59:55.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:59:55 smithi157 bash[24585]: cluster 2024-09-16T08:59:54.321483+0000 mgr.a (mgr.14373) 8772 : cluster [DBG] pgmap v6083: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:59:55.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:59:55 smithi086 bash[24289]: cluster 2024-09-16T08:59:54.321483+0000 mgr.a (mgr.14373) 8772 : cluster [DBG] pgmap v6083: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:59:55.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:59:55 smithi047 bash[22744]: cluster 2024-09-16T08:59:54.321483+0000 mgr.a (mgr.14373) 8772 : cluster [DBG] pgmap v6083: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:59:55.647 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T08:59:55.647 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T08:59:55.647 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T08:59:55.647 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T08:59:55.647 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T08:59:56.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:59:56 smithi157 bash[24585]: audit 2024-09-16T08:59:55.231048+0000 mgr.a (mgr.14373) 8773 : audit [DBG] from='client.195591 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:59:56.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:59:56 smithi086 bash[24289]: audit 2024-09-16T08:59:55.231048+0000 mgr.a (mgr.14373) 8773 : audit [DBG] from='client.195591 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:59:56.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:59:56 smithi047 bash[22744]: audit 2024-09-16T08:59:55.231048+0000 mgr.a (mgr.14373) 8773 : audit [DBG] from='client.195591 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T08:59:57.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:59:57 smithi157 bash[24585]: cluster 2024-09-16T08:59:56.322450+0000 mgr.a (mgr.14373) 8774 : cluster [DBG] pgmap v6084: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:59:57.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:59:57 smithi086 bash[24289]: cluster 2024-09-16T08:59:56.322450+0000 mgr.a (mgr.14373) 8774 : cluster [DBG] pgmap v6084: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:59:57.588 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:59:57 smithi047 bash[22744]: cluster 2024-09-16T08:59:56.322450+0000 mgr.a (mgr.14373) 8774 : cluster [DBG] pgmap v6084: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T08:59:59.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 08:59:59 smithi157 bash[24585]: cluster 2024-09-16T08:59:58.324694+0000 mgr.a (mgr.14373) 8775 : cluster [DBG] pgmap v6085: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:59:59.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 08:59:59 smithi086 bash[24289]: cluster 2024-09-16T08:59:58.324694+0000 mgr.a (mgr.14373) 8775 : cluster [DBG] pgmap v6085: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T08:59:59.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 08:59:59 smithi047 bash[22744]: cluster 2024-09-16T08:59:58.324694+0000 mgr.a (mgr.14373) 8775 : cluster [DBG] pgmap v6085: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:00:00.648 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:00:00.649 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:00:00.649 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:00:00.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:00:00 smithi157 bash[24585]: cluster 2024-09-16T09:00:00.000153+0000 mon.a (mon.0) 1091 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-16T09:00:00.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:00:00 smithi086 bash[24289]: cluster 2024-09-16T09:00:00.000153+0000 mon.a (mon.0) 1091 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-16T09:00:00.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:00:00 smithi047 bash[22744]: cluster 2024-09-16T09:00:00.000153+0000 mon.a (mon.0) 1091 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-16T09:00:01.392 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:00:01.393 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:00:01.393 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:00:01.393 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:00:01.393 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:00:01.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:00:01 smithi157 bash[24585]: cluster 2024-09-16T09:00:00.325470+0000 mgr.a (mgr.14373) 8776 : cluster [DBG] pgmap v6086: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:00:01.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:00:01 smithi157 bash[24585]: audit 2024-09-16T09:00:00.978119+0000 mgr.a (mgr.14373) 8777 : audit [DBG] from='client.195669 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:00:01.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:00:01 smithi086 bash[24289]: cluster 2024-09-16T09:00:00.325470+0000 mgr.a (mgr.14373) 8776 : cluster [DBG] pgmap v6086: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:00:01.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:00:01 smithi086 bash[24289]: audit 2024-09-16T09:00:00.978119+0000 mgr.a (mgr.14373) 8777 : audit [DBG] from='client.195669 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:00:01.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:00:01 smithi047 bash[22744]: cluster 2024-09-16T09:00:00.325470+0000 mgr.a (mgr.14373) 8776 : cluster [DBG] pgmap v6086: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:00:01.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:00:01 smithi047 bash[22744]: audit 2024-09-16T09:00:00.978119+0000 mgr.a (mgr.14373) 8777 : audit [DBG] from='client.195669 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:00:03.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:00:03 smithi157 bash[24585]: cluster 2024-09-16T09:00:02.328280+0000 mgr.a (mgr.14373) 8778 : cluster [DBG] pgmap v6087: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:00:03.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:00:03 smithi086 bash[24289]: cluster 2024-09-16T09:00:02.328280+0000 mgr.a (mgr.14373) 8778 : cluster [DBG] pgmap v6087: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:00:03.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:00:03 smithi047 bash[22744]: cluster 2024-09-16T09:00:02.328280+0000 mgr.a (mgr.14373) 8778 : cluster [DBG] pgmap v6087: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:00:05.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:00:05 smithi157 bash[24585]: cluster 2024-09-16T09:00:04.329098+0000 mgr.a (mgr.14373) 8779 : cluster [DBG] pgmap v6088: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:00:05.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:00:05 smithi086 bash[24289]: cluster 2024-09-16T09:00:04.329098+0000 mgr.a (mgr.14373) 8779 : cluster [DBG] pgmap v6088: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:00:05.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:00:05 smithi047 bash[22744]: cluster 2024-09-16T09:00:04.329098+0000 mgr.a (mgr.14373) 8779 : cluster [DBG] pgmap v6088: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:00:06.394 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:00:06.395 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:00:06.395 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:00:07.160 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:00:07.160 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:00:07.160 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:00:07.161 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:00:07.161 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:00:07.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:00:07 smithi157 bash[24585]: cluster 2024-09-16T09:00:06.329856+0000 mgr.a (mgr.14373) 8780 : cluster [DBG] pgmap v6089: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:00:07.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:00:07 smithi157 bash[24585]: audit 2024-09-16T09:00:06.730950+0000 mgr.a (mgr.14373) 8781 : audit [DBG] from='client.195747 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:00:07.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:00:07 smithi086 bash[24289]: cluster 2024-09-16T09:00:06.329856+0000 mgr.a (mgr.14373) 8780 : cluster [DBG] pgmap v6089: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:00:07.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:00:07 smithi086 bash[24289]: audit 2024-09-16T09:00:06.730950+0000 mgr.a (mgr.14373) 8781 : audit [DBG] from='client.195747 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:00:07.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:00:07 smithi047 bash[22744]: cluster 2024-09-16T09:00:06.329856+0000 mgr.a (mgr.14373) 8780 : cluster [DBG] pgmap v6089: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:00:07.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:00:07 smithi047 bash[22744]: audit 2024-09-16T09:00:06.730950+0000 mgr.a (mgr.14373) 8781 : audit [DBG] from='client.195747 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:00:09.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:00:09 smithi157 bash[24585]: cluster 2024-09-16T09:00:08.332568+0000 mgr.a (mgr.14373) 8782 : cluster [DBG] pgmap v6090: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:00:09.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:00:09 smithi086 bash[24289]: cluster 2024-09-16T09:00:08.332568+0000 mgr.a (mgr.14373) 8782 : cluster [DBG] pgmap v6090: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:00:09.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:00:09 smithi047 bash[22744]: cluster 2024-09-16T09:00:08.332568+0000 mgr.a (mgr.14373) 8782 : cluster [DBG] pgmap v6090: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:00:11.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:00:11 smithi157 bash[24585]: cluster 2024-09-16T09:00:10.333287+0000 mgr.a (mgr.14373) 8783 : cluster [DBG] pgmap v6091: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:00:11.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:00:11 smithi086 bash[24289]: cluster 2024-09-16T09:00:10.333287+0000 mgr.a (mgr.14373) 8783 : cluster [DBG] pgmap v6091: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:00:11.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:00:11 smithi047 bash[22744]: cluster 2024-09-16T09:00:10.333287+0000 mgr.a (mgr.14373) 8783 : cluster [DBG] pgmap v6091: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:00:12.161 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:00:12.162 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:00:12.162 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:00:12.912 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:00:12.913 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:00:12.913 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:00:12.913 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:00:12.913 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:00:13.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:00:13 smithi157 bash[24585]: cluster 2024-09-16T09:00:12.335172+0000 mgr.a (mgr.14373) 8784 : cluster [DBG] pgmap v6092: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:00:13.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:00:13 smithi157 bash[24585]: audit 2024-09-16T09:00:12.493979+0000 mgr.a (mgr.14373) 8785 : audit [DBG] from='client.195825 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:00:13.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:00:13 smithi086 bash[24289]: cluster 2024-09-16T09:00:12.335172+0000 mgr.a (mgr.14373) 8784 : cluster [DBG] pgmap v6092: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:00:13.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:00:13 smithi086 bash[24289]: audit 2024-09-16T09:00:12.493979+0000 mgr.a (mgr.14373) 8785 : audit [DBG] from='client.195825 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:00:13.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:00:13 smithi047 bash[22744]: cluster 2024-09-16T09:00:12.335172+0000 mgr.a (mgr.14373) 8784 : cluster [DBG] pgmap v6092: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:00:13.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:00:13 smithi047 bash[22744]: audit 2024-09-16T09:00:12.493979+0000 mgr.a (mgr.14373) 8785 : audit [DBG] from='client.195825 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:00:15.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:00:15 smithi157 bash[24585]: cluster 2024-09-16T09:00:14.336107+0000 mgr.a (mgr.14373) 8786 : cluster [DBG] pgmap v6093: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:00:15.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:00:15 smithi086 bash[24289]: cluster 2024-09-16T09:00:14.336107+0000 mgr.a (mgr.14373) 8786 : cluster [DBG] pgmap v6093: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:00:15.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:00:15 smithi047 bash[22744]: cluster 2024-09-16T09:00:14.336107+0000 mgr.a (mgr.14373) 8786 : cluster [DBG] pgmap v6093: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:00:17.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:00:17 smithi157 bash[24585]: cluster 2024-09-16T09:00:16.336887+0000 mgr.a (mgr.14373) 8787 : cluster [DBG] pgmap v6094: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T09:00:17.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:00:17 smithi086 bash[24289]: cluster 2024-09-16T09:00:16.336887+0000 mgr.a (mgr.14373) 8787 : cluster [DBG] pgmap v6094: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T09:00:17.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:00:17 smithi047 bash[22744]: cluster 2024-09-16T09:00:16.336887+0000 mgr.a (mgr.14373) 8787 : cluster [DBG] pgmap v6094: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T09:00:17.914 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:00:17.915 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:00:17.915 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:00:18.711 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:00:18.711 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:00:18.711 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:00:18.711 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:00:18.711 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:00:19.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:00:19 smithi157 bash[24585]: audit 2024-09-16T09:00:18.250397+0000 mgr.a (mgr.14373) 8788 : audit [DBG] from='client.195903 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:00:19.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:00:19 smithi157 bash[24585]: cluster 2024-09-16T09:00:18.338253+0000 mgr.a (mgr.14373) 8789 : cluster [DBG] pgmap v6095: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:00:19.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:00:19 smithi157 bash[24585]: audit 2024-09-16T09:00:18.525756+0000 mon.b (mon.2) 822 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T09:00:19.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:00:19 smithi157 bash[24585]: audit 2024-09-16T09:00:19.324635+0000 mon.b (mon.2) 823 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:00:19.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:00:19 smithi157 bash[24585]: audit 2024-09-16T09:00:19.327199+0000 mon.b (mon.2) 824 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T09:00:19.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:00:19 smithi157 bash[24585]: audit 2024-09-16T09:00:19.340473+0000 mon.a (mon.0) 1092 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:00:19.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:00:19 smithi157 bash[24585]: audit 2024-09-16T09:00:19.344449+0000 mon.b (mon.2) 825 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:00:19.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:00:19 smithi086 bash[24289]: audit 2024-09-16T09:00:18.250397+0000 mgr.a (mgr.14373) 8788 : audit [DBG] from='client.195903 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:00:19.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:00:19 smithi086 bash[24289]: cluster 2024-09-16T09:00:18.338253+0000 mgr.a (mgr.14373) 8789 : cluster [DBG] pgmap v6095: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:00:19.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:00:19 smithi086 bash[24289]: audit 2024-09-16T09:00:18.525756+0000 mon.b (mon.2) 822 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T09:00:19.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:00:19 smithi086 bash[24289]: audit 2024-09-16T09:00:19.324635+0000 mon.b (mon.2) 823 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:00:19.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:00:19 smithi086 bash[24289]: audit 2024-09-16T09:00:19.327199+0000 mon.b (mon.2) 824 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T09:00:19.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:00:19 smithi086 bash[24289]: audit 2024-09-16T09:00:19.340473+0000 mon.a (mon.0) 1092 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:00:19.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:00:19 smithi086 bash[24289]: audit 2024-09-16T09:00:19.344449+0000 mon.b (mon.2) 825 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:00:19.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:00:19 smithi047 bash[22744]: audit 2024-09-16T09:00:18.250397+0000 mgr.a (mgr.14373) 8788 : audit [DBG] from='client.195903 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:00:19.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:00:19 smithi047 bash[22744]: cluster 2024-09-16T09:00:18.338253+0000 mgr.a (mgr.14373) 8789 : cluster [DBG] pgmap v6095: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:00:19.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:00:19 smithi047 bash[22744]: audit 2024-09-16T09:00:18.525756+0000 mon.b (mon.2) 822 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T09:00:19.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:00:19 smithi047 bash[22744]: audit 2024-09-16T09:00:19.324635+0000 mon.b (mon.2) 823 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:00:19.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:00:19 smithi047 bash[22744]: audit 2024-09-16T09:00:19.327199+0000 mon.b (mon.2) 824 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T09:00:19.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:00:19 smithi047 bash[22744]: audit 2024-09-16T09:00:19.340473+0000 mon.a (mon.0) 1092 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:00:19.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:00:19 smithi047 bash[22744]: audit 2024-09-16T09:00:19.344449+0000 mon.b (mon.2) 825 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:00:20.339 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 09:00:20 smithi047 bash[22994]: debug 2024-09-16T09:00:20.067+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T09:00:20.339 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 09:00:20 smithi047 bash[22994]: debug 2024-09-16T09:00:20.067+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T09:00:20.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:00:20 smithi157 bash[24585]: audit 2024-09-16T09:00:19.347765+0000 mgr.a (mgr.14373) 8790 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:00:20.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:00:20 smithi157 bash[24585]: audit 2024-09-16T09:00:20.072246+0000 mgr.a (mgr.14373) 8791 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T09:00:20.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:00:20 smithi157 bash[24585]: cephadm 2024-09-16T09:00:20.074330+0000 mgr.a (mgr.14373) 8792 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T09:00:20.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:00:20 smithi086 bash[24289]: audit 2024-09-16T09:00:19.347765+0000 mgr.a (mgr.14373) 8790 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:00:20.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:00:20 smithi086 bash[24289]: audit 2024-09-16T09:00:20.072246+0000 mgr.a (mgr.14373) 8791 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T09:00:20.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:00:20 smithi086 bash[24289]: cephadm 2024-09-16T09:00:20.074330+0000 mgr.a (mgr.14373) 8792 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T09:00:20.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:00:20 smithi047 bash[22744]: audit 2024-09-16T09:00:19.347765+0000 mgr.a (mgr.14373) 8790 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:00:20.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:00:20 smithi047 bash[22744]: audit 2024-09-16T09:00:20.072246+0000 mgr.a (mgr.14373) 8791 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T09:00:20.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:00:20 smithi047 bash[22744]: cephadm 2024-09-16T09:00:20.074330+0000 mgr.a (mgr.14373) 8792 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T09:00:21.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:00:21 smithi157 bash[24585]: cluster 2024-09-16T09:00:20.339153+0000 mgr.a (mgr.14373) 8793 : cluster [DBG] pgmap v6096: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:00:21.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:00:21 smithi086 bash[24289]: cluster 2024-09-16T09:00:20.339153+0000 mgr.a (mgr.14373) 8793 : cluster [DBG] pgmap v6096: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:00:21.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:00:21 smithi047 bash[22744]: cluster 2024-09-16T09:00:20.339153+0000 mgr.a (mgr.14373) 8793 : cluster [DBG] pgmap v6096: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:00:23.712 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:00:23.713 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:00:23.713 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:00:23.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:00:23 smithi157 bash[24585]: cluster 2024-09-16T09:00:22.341362+0000 mgr.a (mgr.14373) 8794 : cluster [DBG] pgmap v6097: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:00:23.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:00:23 smithi086 bash[24289]: cluster 2024-09-16T09:00:22.341362+0000 mgr.a (mgr.14373) 8794 : cluster [DBG] pgmap v6097: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:00:23.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:00:23 smithi047 bash[22744]: cluster 2024-09-16T09:00:22.341362+0000 mgr.a (mgr.14373) 8794 : cluster [DBG] pgmap v6097: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:00:24.491 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:00:24.491 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:00:24.491 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:00:24.492 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:00:24.492 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:00:24.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:00:24 smithi157 bash[24585]: audit 2024-09-16T09:00:24.048733+0000 mgr.a (mgr.14373) 8795 : audit [DBG] from='client.196080 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:00:24.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:00:24 smithi086 bash[24289]: audit 2024-09-16T09:00:24.048733+0000 mgr.a (mgr.14373) 8795 : audit [DBG] from='client.196080 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:00:24.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:00:24 smithi047 bash[22744]: audit 2024-09-16T09:00:24.048733+0000 mgr.a (mgr.14373) 8795 : audit [DBG] from='client.196080 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:00:25.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:00:25 smithi157 bash[24585]: cluster 2024-09-16T09:00:24.341952+0000 mgr.a (mgr.14373) 8796 : cluster [DBG] pgmap v6098: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:00:25.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:00:25 smithi086 bash[24289]: cluster 2024-09-16T09:00:24.341952+0000 mgr.a (mgr.14373) 8796 : cluster [DBG] pgmap v6098: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:00:25.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:00:25 smithi047 bash[22744]: cluster 2024-09-16T09:00:24.341952+0000 mgr.a (mgr.14373) 8796 : cluster [DBG] pgmap v6098: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:00:27.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:00:27 smithi157 bash[24585]: cluster 2024-09-16T09:00:26.342850+0000 mgr.a (mgr.14373) 8797 : cluster [DBG] pgmap v6099: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:00:27.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:00:27 smithi086 bash[24289]: cluster 2024-09-16T09:00:26.342850+0000 mgr.a (mgr.14373) 8797 : cluster [DBG] pgmap v6099: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:00:27.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:00:27 smithi047 bash[22744]: cluster 2024-09-16T09:00:26.342850+0000 mgr.a (mgr.14373) 8797 : cluster [DBG] pgmap v6099: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:00:29.493 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:00:29.493 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:00:29.493 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:00:29.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:00:29 smithi157 bash[24585]: cluster 2024-09-16T09:00:28.345050+0000 mgr.a (mgr.14373) 8798 : cluster [DBG] pgmap v6100: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:00:29.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:00:29 smithi086 bash[24289]: cluster 2024-09-16T09:00:28.345050+0000 mgr.a (mgr.14373) 8798 : cluster [DBG] pgmap v6100: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:00:29.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:00:29 smithi047 bash[22744]: cluster 2024-09-16T09:00:28.345050+0000 mgr.a (mgr.14373) 8798 : cluster [DBG] pgmap v6100: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:00:30.275 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:00:30.275 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:00:30.275 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:00:30.275 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:00:30.275 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:00:30.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:00:30 smithi157 bash[24585]: audit 2024-09-16T09:00:29.830738+0000 mgr.a (mgr.14373) 8799 : audit [DBG] from='client.196158 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:00:30.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:00:30 smithi086 bash[24289]: audit 2024-09-16T09:00:29.830738+0000 mgr.a (mgr.14373) 8799 : audit [DBG] from='client.196158 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:00:30.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:00:30 smithi047 bash[22744]: audit 2024-09-16T09:00:29.830738+0000 mgr.a (mgr.14373) 8799 : audit [DBG] from='client.196158 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:00:31.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:00:31 smithi157 bash[24585]: cluster 2024-09-16T09:00:30.345633+0000 mgr.a (mgr.14373) 8800 : cluster [DBG] pgmap v6101: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:00:31.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:00:31 smithi086 bash[24289]: cluster 2024-09-16T09:00:30.345633+0000 mgr.a (mgr.14373) 8800 : cluster [DBG] pgmap v6101: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:00:31.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:00:31 smithi047 bash[22744]: cluster 2024-09-16T09:00:30.345633+0000 mgr.a (mgr.14373) 8800 : cluster [DBG] pgmap v6101: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:00:33.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:00:33 smithi157 bash[24585]: cluster 2024-09-16T09:00:32.347848+0000 mgr.a (mgr.14373) 8801 : cluster [DBG] pgmap v6102: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:00:33.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:00:33 smithi086 bash[24289]: cluster 2024-09-16T09:00:32.347848+0000 mgr.a (mgr.14373) 8801 : cluster [DBG] pgmap v6102: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:00:33.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:00:33 smithi047 bash[22744]: cluster 2024-09-16T09:00:32.347848+0000 mgr.a (mgr.14373) 8801 : cluster [DBG] pgmap v6102: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:00:35.276 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:00:35.277 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:00:35.277 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:00:35.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:00:35 smithi157 bash[24585]: cluster 2024-09-16T09:00:34.348634+0000 mgr.a (mgr.14373) 8802 : cluster [DBG] pgmap v6103: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:00:35.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:00:35 smithi086 bash[24289]: cluster 2024-09-16T09:00:34.348634+0000 mgr.a (mgr.14373) 8802 : cluster [DBG] pgmap v6103: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:00:35.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:00:35 smithi047 bash[22744]: cluster 2024-09-16T09:00:34.348634+0000 mgr.a (mgr.14373) 8802 : cluster [DBG] pgmap v6103: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:00:36.037 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:00:36.038 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:00:36.038 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:00:36.038 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:00:36.038 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:00:36.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:00:36 smithi157 bash[24585]: audit 2024-09-16T09:00:35.610445+0000 mgr.a (mgr.14373) 8803 : audit [DBG] from='client.196233 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:00:36.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:00:36 smithi086 bash[24289]: audit 2024-09-16T09:00:35.610445+0000 mgr.a (mgr.14373) 8803 : audit [DBG] from='client.196233 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:00:36.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:00:36 smithi047 bash[22744]: audit 2024-09-16T09:00:35.610445+0000 mgr.a (mgr.14373) 8803 : audit [DBG] from='client.196233 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:00:37.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:00:37 smithi157 bash[24585]: cluster 2024-09-16T09:00:36.349607+0000 mgr.a (mgr.14373) 8804 : cluster [DBG] pgmap v6104: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:00:37.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:00:37 smithi086 bash[24289]: cluster 2024-09-16T09:00:36.349607+0000 mgr.a (mgr.14373) 8804 : cluster [DBG] pgmap v6104: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:00:37.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:00:37 smithi047 bash[22744]: cluster 2024-09-16T09:00:36.349607+0000 mgr.a (mgr.14373) 8804 : cluster [DBG] pgmap v6104: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:00:39.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:00:39 smithi157 bash[24585]: cluster 2024-09-16T09:00:38.351881+0000 mgr.a (mgr.14373) 8805 : cluster [DBG] pgmap v6105: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:00:39.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:00:39 smithi086 bash[24289]: cluster 2024-09-16T09:00:38.351881+0000 mgr.a (mgr.14373) 8805 : cluster [DBG] pgmap v6105: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:00:39.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:00:39 smithi047 bash[22744]: cluster 2024-09-16T09:00:38.351881+0000 mgr.a (mgr.14373) 8805 : cluster [DBG] pgmap v6105: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:00:41.039 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:00:41.040 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:00:41.040 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:00:41.782 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:00:41.866 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:00:41.866 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:00:41.866 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:00:41.866 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:00:41.866 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:00:41 smithi047 bash[22744]: cluster 2024-09-16T09:00:40.352643+0000 mgr.a (mgr.14373) 8806 : cluster [DBG] pgmap v6106: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:00:41.867 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:00:41 smithi086 bash[24289]: cluster 2024-09-16T09:00:40.352643+0000 mgr.a (mgr.14373) 8806 : cluster [DBG] pgmap v6106: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:00:41.867 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:00:41 smithi157 bash[24585]: cluster 2024-09-16T09:00:40.352643+0000 mgr.a (mgr.14373) 8806 : cluster [DBG] pgmap v6106: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:00:42.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:00:42 smithi157 bash[24585]: audit 2024-09-16T09:00:41.370457+0000 mgr.a (mgr.14373) 8807 : audit [DBG] from='client.196311 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:00:42.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:00:42 smithi086 bash[24289]: audit 2024-09-16T09:00:41.370457+0000 mgr.a (mgr.14373) 8807 : audit [DBG] from='client.196311 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:00:42.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:00:42 smithi047 bash[22744]: audit 2024-09-16T09:00:41.370457+0000 mgr.a (mgr.14373) 8807 : audit [DBG] from='client.196311 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:00:43.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:00:43 smithi157 bash[24585]: cluster 2024-09-16T09:00:42.355318+0000 mgr.a (mgr.14373) 8808 : cluster [DBG] pgmap v6107: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:00:43.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:00:43 smithi086 bash[24289]: cluster 2024-09-16T09:00:42.355318+0000 mgr.a (mgr.14373) 8808 : cluster [DBG] pgmap v6107: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:00:43.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:00:43 smithi047 bash[22744]: cluster 2024-09-16T09:00:42.355318+0000 mgr.a (mgr.14373) 8808 : cluster [DBG] pgmap v6107: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:00:45.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:00:45 smithi157 bash[24585]: cluster 2024-09-16T09:00:44.356078+0000 mgr.a (mgr.14373) 8809 : cluster [DBG] pgmap v6108: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:00:45.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:00:45 smithi086 bash[24289]: cluster 2024-09-16T09:00:44.356078+0000 mgr.a (mgr.14373) 8809 : cluster [DBG] pgmap v6108: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:00:45.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:00:45 smithi047 bash[22744]: cluster 2024-09-16T09:00:44.356078+0000 mgr.a (mgr.14373) 8809 : cluster [DBG] pgmap v6108: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:00:46.784 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:00:46.784 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:00:46.784 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:00:47.567 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:00:47.568 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:00:47.568 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:00:47.568 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:00:47.568 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:00:47.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:00:47 smithi157 bash[24585]: cluster 2024-09-16T09:00:46.356828+0000 mgr.a (mgr.14373) 8810 : cluster [DBG] pgmap v6109: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T09:00:47.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:00:47 smithi086 bash[24289]: cluster 2024-09-16T09:00:46.356828+0000 mgr.a (mgr.14373) 8810 : cluster [DBG] pgmap v6109: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T09:00:47.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:00:47 smithi047 bash[22744]: cluster 2024-09-16T09:00:46.356828+0000 mgr.a (mgr.14373) 8810 : cluster [DBG] pgmap v6109: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T09:00:48.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:00:48 smithi157 bash[24585]: audit 2024-09-16T09:00:47.121265+0000 mgr.a (mgr.14373) 8811 : audit [DBG] from='client.196389 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:00:48.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:00:48 smithi086 bash[24289]: audit 2024-09-16T09:00:47.121265+0000 mgr.a (mgr.14373) 8811 : audit [DBG] from='client.196389 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:00:48.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:00:48 smithi047 bash[22744]: audit 2024-09-16T09:00:47.121265+0000 mgr.a (mgr.14373) 8811 : audit [DBG] from='client.196389 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:00:49.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:00:49 smithi157 bash[24585]: cluster 2024-09-16T09:00:48.359563+0000 mgr.a (mgr.14373) 8812 : cluster [DBG] pgmap v6110: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:00:49.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:00:49 smithi086 bash[24289]: cluster 2024-09-16T09:00:48.359563+0000 mgr.a (mgr.14373) 8812 : cluster [DBG] pgmap v6110: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:00:49.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:00:49 smithi047 bash[22744]: cluster 2024-09-16T09:00:48.359563+0000 mgr.a (mgr.14373) 8812 : cluster [DBG] pgmap v6110: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:00:51.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:00:51 smithi157 bash[24585]: cluster 2024-09-16T09:00:50.360315+0000 mgr.a (mgr.14373) 8813 : cluster [DBG] pgmap v6111: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:00:51.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:00:51 smithi086 bash[24289]: cluster 2024-09-16T09:00:50.360315+0000 mgr.a (mgr.14373) 8813 : cluster [DBG] pgmap v6111: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:00:51.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:00:51 smithi047 bash[22744]: cluster 2024-09-16T09:00:50.360315+0000 mgr.a (mgr.14373) 8813 : cluster [DBG] pgmap v6111: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:00:52.569 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:00:52.570 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:00:52.570 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:00:53.341 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:00:53.341 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:00:53.341 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:00:53.341 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:00:53.341 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:00:53.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:00:53 smithi157 bash[24585]: cluster 2024-09-16T09:00:52.362430+0000 mgr.a (mgr.14373) 8814 : cluster [DBG] pgmap v6112: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:00:53.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:00:53 smithi157 bash[24585]: audit 2024-09-16T09:00:52.905770+0000 mgr.a (mgr.14373) 8815 : audit [DBG] from='client.196467 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:00:53.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:00:53 smithi086 bash[24289]: cluster 2024-09-16T09:00:52.362430+0000 mgr.a (mgr.14373) 8814 : cluster [DBG] pgmap v6112: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:00:53.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:00:53 smithi086 bash[24289]: audit 2024-09-16T09:00:52.905770+0000 mgr.a (mgr.14373) 8815 : audit [DBG] from='client.196467 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:00:53.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:00:53 smithi047 bash[22744]: cluster 2024-09-16T09:00:52.362430+0000 mgr.a (mgr.14373) 8814 : cluster [DBG] pgmap v6112: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:00:53.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:00:53 smithi047 bash[22744]: audit 2024-09-16T09:00:52.905770+0000 mgr.a (mgr.14373) 8815 : audit [DBG] from='client.196467 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:00:55.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:00:55 smithi157 bash[24585]: cluster 2024-09-16T09:00:54.363349+0000 mgr.a (mgr.14373) 8816 : cluster [DBG] pgmap v6113: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:00:55.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:00:55 smithi086 bash[24289]: cluster 2024-09-16T09:00:54.363349+0000 mgr.a (mgr.14373) 8816 : cluster [DBG] pgmap v6113: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:00:55.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:00:55 smithi047 bash[22744]: cluster 2024-09-16T09:00:54.363349+0000 mgr.a (mgr.14373) 8816 : cluster [DBG] pgmap v6113: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:00:57.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:00:57 smithi086 bash[24289]: cluster 2024-09-16T09:00:56.364172+0000 mgr.a (mgr.14373) 8817 : cluster [DBG] pgmap v6114: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:00:57.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:00:57 smithi047 bash[22744]: cluster 2024-09-16T09:00:56.364172+0000 mgr.a (mgr.14373) 8817 : cluster [DBG] pgmap v6114: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:00:58.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:00:57 smithi157 bash[24585]: cluster 2024-09-16T09:00:56.364172+0000 mgr.a (mgr.14373) 8817 : cluster [DBG] pgmap v6114: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:00:58.342 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:00:58.343 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:00:58.343 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:00:59.098 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:00:59.098 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:00:59.098 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:00:59.098 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:00:59.098 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:00:59.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:00:59 smithi086 bash[24289]: cluster 2024-09-16T09:00:58.365719+0000 mgr.a (mgr.14373) 8818 : cluster [DBG] pgmap v6115: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:00:59.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:00:59 smithi086 bash[24289]: audit 2024-09-16T09:00:58.675724+0000 mgr.a (mgr.14373) 8819 : audit [DBG] from='client.196545 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:00:59.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:00:59 smithi047 bash[22744]: cluster 2024-09-16T09:00:58.365719+0000 mgr.a (mgr.14373) 8818 : cluster [DBG] pgmap v6115: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:00:59.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:00:59 smithi047 bash[22744]: audit 2024-09-16T09:00:58.675724+0000 mgr.a (mgr.14373) 8819 : audit [DBG] from='client.196545 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:01:00.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:00:59 smithi157 bash[24585]: cluster 2024-09-16T09:00:58.365719+0000 mgr.a (mgr.14373) 8818 : cluster [DBG] pgmap v6115: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:01:00.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:00:59 smithi157 bash[24585]: audit 2024-09-16T09:00:58.675724+0000 mgr.a (mgr.14373) 8819 : audit [DBG] from='client.196545 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:01:01.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:01:01 smithi086 bash[24289]: cluster 2024-09-16T09:01:00.366621+0000 mgr.a (mgr.14373) 8820 : cluster [DBG] pgmap v6116: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:01:01.838 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:01:01 smithi047 bash[22744]: cluster 2024-09-16T09:01:00.366621+0000 mgr.a (mgr.14373) 8820 : cluster [DBG] pgmap v6116: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:01:02.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:01:01 smithi157 bash[24585]: cluster 2024-09-16T09:01:00.366621+0000 mgr.a (mgr.14373) 8820 : cluster [DBG] pgmap v6116: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:01:03.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:01:03 smithi086 bash[24289]: cluster 2024-09-16T09:01:02.368796+0000 mgr.a (mgr.14373) 8821 : cluster [DBG] pgmap v6117: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:01:03.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:01:03 smithi047 bash[22744]: cluster 2024-09-16T09:01:02.368796+0000 mgr.a (mgr.14373) 8821 : cluster [DBG] pgmap v6117: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:01:04.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:01:03 smithi157 bash[24585]: cluster 2024-09-16T09:01:02.368796+0000 mgr.a (mgr.14373) 8821 : cluster [DBG] pgmap v6117: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:01:04.099 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:01:04.100 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:01:04.100 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:01:04.857 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:01:04.857 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:01:04.857 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:01:04.857 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:01:04.857 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:01:05.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:01:05 smithi047 bash[22744]: cluster 2024-09-16T09:01:04.369558+0000 mgr.a (mgr.14373) 8822 : cluster [DBG] pgmap v6118: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:01:05.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:01:05 smithi047 bash[22744]: audit 2024-09-16T09:01:04.435397+0000 mgr.a (mgr.14373) 8823 : audit [DBG] from='client.196620 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:01:06.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:01:05 smithi157 bash[24585]: cluster 2024-09-16T09:01:04.369558+0000 mgr.a (mgr.14373) 8822 : cluster [DBG] pgmap v6118: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:01:06.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:01:05 smithi157 bash[24585]: audit 2024-09-16T09:01:04.435397+0000 mgr.a (mgr.14373) 8823 : audit [DBG] from='client.196620 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:01:06.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:01:05 smithi086 bash[24289]: cluster 2024-09-16T09:01:04.369558+0000 mgr.a (mgr.14373) 8822 : cluster [DBG] pgmap v6118: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:01:06.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:01:05 smithi086 bash[24289]: audit 2024-09-16T09:01:04.435397+0000 mgr.a (mgr.14373) 8823 : audit [DBG] from='client.196620 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:01:07.840 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:01:07 smithi047 bash[22744]: cluster 2024-09-16T09:01:06.370492+0000 mgr.a (mgr.14373) 8824 : cluster [DBG] pgmap v6119: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:01:08.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:01:07 smithi157 bash[24585]: cluster 2024-09-16T09:01:06.370492+0000 mgr.a (mgr.14373) 8824 : cluster [DBG] pgmap v6119: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:01:08.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:01:07 smithi086 bash[24289]: cluster 2024-09-16T09:01:06.370492+0000 mgr.a (mgr.14373) 8824 : cluster [DBG] pgmap v6119: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:01:09.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:01:09 smithi047 bash[22744]: cluster 2024-09-16T09:01:08.372628+0000 mgr.a (mgr.14373) 8825 : cluster [DBG] pgmap v6120: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:01:09.858 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:01:09.859 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:01:09.859 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:01:10.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:01:09 smithi157 bash[24585]: cluster 2024-09-16T09:01:08.372628+0000 mgr.a (mgr.14373) 8825 : cluster [DBG] pgmap v6120: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:01:10.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:01:09 smithi086 bash[24289]: cluster 2024-09-16T09:01:08.372628+0000 mgr.a (mgr.14373) 8825 : cluster [DBG] pgmap v6120: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:01:10.646 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:01:10.646 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:01:10.646 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:01:10.646 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:01:10.647 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:01:11.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:01:11 smithi047 bash[22744]: audit 2024-09-16T09:01:10.203316+0000 mgr.a (mgr.14373) 8826 : audit [DBG] from='client.196695 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:01:11.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:01:11 smithi047 bash[22744]: cluster 2024-09-16T09:01:10.373193+0000 mgr.a (mgr.14373) 8827 : cluster [DBG] pgmap v6121: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:01:12.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:01:11 smithi157 bash[24585]: audit 2024-09-16T09:01:10.203316+0000 mgr.a (mgr.14373) 8826 : audit [DBG] from='client.196695 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:01:12.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:01:11 smithi157 bash[24585]: cluster 2024-09-16T09:01:10.373193+0000 mgr.a (mgr.14373) 8827 : cluster [DBG] pgmap v6121: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:01:12.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:01:11 smithi086 bash[24289]: audit 2024-09-16T09:01:10.203316+0000 mgr.a (mgr.14373) 8826 : audit [DBG] from='client.196695 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:01:12.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:01:11 smithi086 bash[24289]: cluster 2024-09-16T09:01:10.373193+0000 mgr.a (mgr.14373) 8827 : cluster [DBG] pgmap v6121: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:01:13.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:01:13 smithi047 bash[22744]: cluster 2024-09-16T09:01:12.375513+0000 mgr.a (mgr.14373) 8828 : cluster [DBG] pgmap v6122: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:01:14.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:01:13 smithi157 bash[24585]: cluster 2024-09-16T09:01:12.375513+0000 mgr.a (mgr.14373) 8828 : cluster [DBG] pgmap v6122: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:01:14.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:01:13 smithi086 bash[24289]: cluster 2024-09-16T09:01:12.375513+0000 mgr.a (mgr.14373) 8828 : cluster [DBG] pgmap v6122: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:01:15.647 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:01:15.648 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:01:15.648 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:01:16.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:01:15 smithi157 bash[24585]: cluster 2024-09-16T09:01:14.376278+0000 mgr.a (mgr.14373) 8829 : cluster [DBG] pgmap v6123: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:01:16.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:01:15 smithi086 bash[24289]: cluster 2024-09-16T09:01:14.376278+0000 mgr.a (mgr.14373) 8829 : cluster [DBG] pgmap v6123: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:01:16.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:01:15 smithi047 bash[22744]: cluster 2024-09-16T09:01:14.376278+0000 mgr.a (mgr.14373) 8829 : cluster [DBG] pgmap v6123: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:01:16.425 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:01:16.425 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:01:16.425 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:01:16.425 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:01:16.425 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:01:17.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:01:16 smithi157 bash[24585]: audit 2024-09-16T09:01:15.985667+0000 mgr.a (mgr.14373) 8830 : audit [DBG] from='client.196770 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:01:17.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:01:16 smithi086 bash[24289]: audit 2024-09-16T09:01:15.985667+0000 mgr.a (mgr.14373) 8830 : audit [DBG] from='client.196770 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:01:17.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:01:16 smithi047 bash[22744]: audit 2024-09-16T09:01:15.985667+0000 mgr.a (mgr.14373) 8830 : audit [DBG] from='client.196770 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:01:18.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:01:17 smithi157 bash[24585]: cluster 2024-09-16T09:01:16.376796+0000 mgr.a (mgr.14373) 8831 : cluster [DBG] pgmap v6124: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:01:18.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:01:17 smithi086 bash[24289]: cluster 2024-09-16T09:01:16.376796+0000 mgr.a (mgr.14373) 8831 : cluster [DBG] pgmap v6124: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:01:18.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:01:17 smithi047 bash[22744]: cluster 2024-09-16T09:01:16.376796+0000 mgr.a (mgr.14373) 8831 : cluster [DBG] pgmap v6124: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:01:20.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:01:19 smithi157 bash[24585]: cluster 2024-09-16T09:01:18.379044+0000 mgr.a (mgr.14373) 8832 : cluster [DBG] pgmap v6125: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:01:20.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:01:19 smithi086 bash[24289]: cluster 2024-09-16T09:01:18.379044+0000 mgr.a (mgr.14373) 8832 : cluster [DBG] pgmap v6125: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:01:20.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:01:19 smithi047 bash[22744]: cluster 2024-09-16T09:01:18.379044+0000 mgr.a (mgr.14373) 8832 : cluster [DBG] pgmap v6125: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:01:21.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:01:20 smithi157 bash[24585]: audit 2024-09-16T09:01:20.125533+0000 mon.b (mon.2) 826 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T09:01:21.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:01:20 smithi086 bash[24289]: audit 2024-09-16T09:01:20.125533+0000 mon.b (mon.2) 826 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T09:01:21.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:01:20 smithi047 bash[22744]: audit 2024-09-16T09:01:20.125533+0000 mon.b (mon.2) 826 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T09:01:21.426 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:01:21.426 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:01:21.426 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:01:22.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:01:21 smithi157 bash[24585]: cluster 2024-09-16T09:01:20.379789+0000 mgr.a (mgr.14373) 8833 : cluster [DBG] pgmap v6126: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:01:22.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:01:21 smithi157 bash[24585]: audit 2024-09-16T09:01:20.966602+0000 mon.b (mon.2) 827 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:01:22.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:01:21 smithi157 bash[24585]: audit 2024-09-16T09:01:20.968810+0000 mon.b (mon.2) 828 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T09:01:22.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:01:21 smithi157 bash[24585]: audit 2024-09-16T09:01:20.982026+0000 mon.a (mon.0) 1093 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:01:22.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:01:21 smithi157 bash[24585]: audit 2024-09-16T09:01:20.986760+0000 mon.b (mon.2) 829 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:01:22.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:01:21 smithi157 bash[24585]: audit 2024-09-16T09:01:20.990633+0000 mgr.a (mgr.14373) 8834 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:01:22.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:01:21 smithi086 bash[24289]: cluster 2024-09-16T09:01:20.379789+0000 mgr.a (mgr.14373) 8833 : cluster [DBG] pgmap v6126: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:01:22.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:01:21 smithi086 bash[24289]: audit 2024-09-16T09:01:20.966602+0000 mon.b (mon.2) 827 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:01:22.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:01:21 smithi086 bash[24289]: audit 2024-09-16T09:01:20.968810+0000 mon.b (mon.2) 828 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T09:01:22.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:01:21 smithi086 bash[24289]: audit 2024-09-16T09:01:20.982026+0000 mon.a (mon.0) 1093 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:01:22.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:01:21 smithi086 bash[24289]: audit 2024-09-16T09:01:20.986760+0000 mon.b (mon.2) 829 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:01:22.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:01:21 smithi086 bash[24289]: audit 2024-09-16T09:01:20.990633+0000 mgr.a (mgr.14373) 8834 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:01:22.088 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 09:01:21 smithi047 bash[22994]: debug 2024-09-16T09:01:21.730+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T09:01:22.089 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 09:01:21 smithi047 bash[22994]: debug 2024-09-16T09:01:21.730+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T09:01:22.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:01:21 smithi047 bash[22744]: cluster 2024-09-16T09:01:20.379789+0000 mgr.a (mgr.14373) 8833 : cluster [DBG] pgmap v6126: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:01:22.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:01:21 smithi047 bash[22744]: audit 2024-09-16T09:01:20.966602+0000 mon.b (mon.2) 827 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:01:22.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:01:21 smithi047 bash[22744]: audit 2024-09-16T09:01:20.968810+0000 mon.b (mon.2) 828 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T09:01:22.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:01:21 smithi047 bash[22744]: audit 2024-09-16T09:01:20.982026+0000 mon.a (mon.0) 1093 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:01:22.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:01:21 smithi047 bash[22744]: audit 2024-09-16T09:01:20.986760+0000 mon.b (mon.2) 829 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:01:22.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:01:21 smithi047 bash[22744]: audit 2024-09-16T09:01:20.990633+0000 mgr.a (mgr.14373) 8834 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:01:22.170 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:01:22.171 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:01:22.171 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:01:22.171 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:01:22.171 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:01:23.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:01:22 smithi157 bash[24585]: audit 2024-09-16T09:01:21.730851+0000 mgr.a (mgr.14373) 8835 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T09:01:23.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:01:22 smithi157 bash[24585]: cephadm 2024-09-16T09:01:21.732777+0000 mgr.a (mgr.14373) 8836 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T09:01:23.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:01:22 smithi157 bash[24585]: audit 2024-09-16T09:01:21.770821+0000 mgr.a (mgr.14373) 8837 : audit [DBG] from='client.196932 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:01:23.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:01:22 smithi086 bash[24289]: audit 2024-09-16T09:01:21.730851+0000 mgr.a (mgr.14373) 8835 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T09:01:23.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:01:22 smithi086 bash[24289]: cephadm 2024-09-16T09:01:21.732777+0000 mgr.a (mgr.14373) 8836 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T09:01:23.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:01:22 smithi086 bash[24289]: audit 2024-09-16T09:01:21.770821+0000 mgr.a (mgr.14373) 8837 : audit [DBG] from='client.196932 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:01:23.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:01:22 smithi047 bash[22744]: audit 2024-09-16T09:01:21.730851+0000 mgr.a (mgr.14373) 8835 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T09:01:23.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:01:22 smithi047 bash[22744]: cephadm 2024-09-16T09:01:21.732777+0000 mgr.a (mgr.14373) 8836 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T09:01:23.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:01:22 smithi047 bash[22744]: audit 2024-09-16T09:01:21.770821+0000 mgr.a (mgr.14373) 8837 : audit [DBG] from='client.196932 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:01:24.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:01:23 smithi157 bash[24585]: cluster 2024-09-16T09:01:22.382448+0000 mgr.a (mgr.14373) 8838 : cluster [DBG] pgmap v6127: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 3.7 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-16T09:01:24.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:01:23 smithi086 bash[24289]: cluster 2024-09-16T09:01:22.382448+0000 mgr.a (mgr.14373) 8838 : cluster [DBG] pgmap v6127: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 3.7 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-16T09:01:24.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:01:23 smithi047 bash[22744]: cluster 2024-09-16T09:01:22.382448+0000 mgr.a (mgr.14373) 8838 : cluster [DBG] pgmap v6127: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 3.7 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-16T09:01:26.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:01:25 smithi157 bash[24585]: cluster 2024-09-16T09:01:24.383236+0000 mgr.a (mgr.14373) 8839 : cluster [DBG] pgmap v6128: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-16T09:01:26.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:01:25 smithi086 bash[24289]: cluster 2024-09-16T09:01:24.383236+0000 mgr.a (mgr.14373) 8839 : cluster [DBG] pgmap v6128: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-16T09:01:26.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:01:25 smithi047 bash[22744]: cluster 2024-09-16T09:01:24.383236+0000 mgr.a (mgr.14373) 8839 : cluster [DBG] pgmap v6128: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-16T09:01:27.172 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:01:27.173 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:01:27.173 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:01:27.915 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:01:27.916 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:01:27.916 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:01:27.916 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:01:27.916 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:01:28.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:01:27 smithi157 bash[24585]: cluster 2024-09-16T09:01:26.383974+0000 mgr.a (mgr.14373) 8840 : cluster [DBG] pgmap v6129: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-16T09:01:28.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:01:27 smithi086 bash[24289]: cluster 2024-09-16T09:01:26.383974+0000 mgr.a (mgr.14373) 8840 : cluster [DBG] pgmap v6129: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-16T09:01:28.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:01:27 smithi047 bash[22744]: cluster 2024-09-16T09:01:26.383974+0000 mgr.a (mgr.14373) 8840 : cluster [DBG] pgmap v6129: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-16T09:01:29.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:01:28 smithi157 bash[24585]: audit 2024-09-16T09:01:27.496157+0000 mgr.a (mgr.14373) 8841 : audit [DBG] from='client.197022 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:01:29.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:01:28 smithi086 bash[24289]: audit 2024-09-16T09:01:27.496157+0000 mgr.a (mgr.14373) 8841 : audit [DBG] from='client.197022 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:01:29.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:01:28 smithi047 bash[22744]: audit 2024-09-16T09:01:27.496157+0000 mgr.a (mgr.14373) 8841 : audit [DBG] from='client.197022 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:01:30.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:01:29 smithi157 bash[24585]: cluster 2024-09-16T09:01:28.386645+0000 mgr.a (mgr.14373) 8842 : cluster [DBG] pgmap v6130: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:01:30.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:01:29 smithi086 bash[24289]: cluster 2024-09-16T09:01:28.386645+0000 mgr.a (mgr.14373) 8842 : cluster [DBG] pgmap v6130: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:01:30.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:01:29 smithi047 bash[22744]: cluster 2024-09-16T09:01:28.386645+0000 mgr.a (mgr.14373) 8842 : cluster [DBG] pgmap v6130: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:01:32.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:01:31 smithi157 bash[24585]: cluster 2024-09-16T09:01:30.387373+0000 mgr.a (mgr.14373) 8843 : cluster [DBG] pgmap v6131: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T09:01:32.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:01:31 smithi086 bash[24289]: cluster 2024-09-16T09:01:30.387373+0000 mgr.a (mgr.14373) 8843 : cluster [DBG] pgmap v6131: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T09:01:32.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:01:31 smithi047 bash[22744]: cluster 2024-09-16T09:01:30.387373+0000 mgr.a (mgr.14373) 8843 : cluster [DBG] pgmap v6131: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T09:01:32.917 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:01:32.918 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:01:32.918 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:01:33.698 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:01:33.698 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:01:33.699 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:01:33.699 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:01:33.699 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:01:34.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:01:33 smithi157 bash[24585]: cluster 2024-09-16T09:01:32.389387+0000 mgr.a (mgr.14373) 8844 : cluster [DBG] pgmap v6132: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:01:34.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:01:33 smithi086 bash[24289]: cluster 2024-09-16T09:01:32.389387+0000 mgr.a (mgr.14373) 8844 : cluster [DBG] pgmap v6132: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:01:34.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:01:33 smithi047 bash[22744]: cluster 2024-09-16T09:01:32.389387+0000 mgr.a (mgr.14373) 8844 : cluster [DBG] pgmap v6132: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:01:35.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:01:34 smithi157 bash[24585]: audit 2024-09-16T09:01:33.253668+0000 mgr.a (mgr.14373) 8845 : audit [DBG] from='client.197094 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:01:35.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:01:34 smithi086 bash[24289]: audit 2024-09-16T09:01:33.253668+0000 mgr.a (mgr.14373) 8845 : audit [DBG] from='client.197094 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:01:35.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:01:34 smithi047 bash[22744]: audit 2024-09-16T09:01:33.253668+0000 mgr.a (mgr.14373) 8845 : audit [DBG] from='client.197094 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:01:36.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:01:35 smithi157 bash[24585]: cluster 2024-09-16T09:01:34.390281+0000 mgr.a (mgr.14373) 8846 : cluster [DBG] pgmap v6133: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 5.2 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-16T09:01:36.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:01:35 smithi086 bash[24289]: cluster 2024-09-16T09:01:34.390281+0000 mgr.a (mgr.14373) 8846 : cluster [DBG] pgmap v6133: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 5.2 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-16T09:01:36.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:01:35 smithi047 bash[22744]: cluster 2024-09-16T09:01:34.390281+0000 mgr.a (mgr.14373) 8846 : cluster [DBG] pgmap v6133: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 5.2 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-16T09:01:38.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:01:37 smithi157 bash[24585]: cluster 2024-09-16T09:01:36.391074+0000 mgr.a (mgr.14373) 8847 : cluster [DBG] pgmap v6134: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 5.2 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-16T09:01:38.116 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:01:37 smithi047 bash[22744]: cluster 2024-09-16T09:01:36.391074+0000 mgr.a (mgr.14373) 8847 : cluster [DBG] pgmap v6134: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 5.2 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-16T09:01:38.116 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:01:37 smithi086 bash[24289]: cluster 2024-09-16T09:01:36.391074+0000 mgr.a (mgr.14373) 8847 : cluster [DBG] pgmap v6134: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 5.2 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-16T09:01:38.700 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:01:38.701 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:01:38.701 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:01:39.479 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:01:39.480 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:01:39.480 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:01:39.480 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:01:39.480 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:01:40.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:01:39 smithi157 bash[24585]: cluster 2024-09-16T09:01:38.393343+0000 mgr.a (mgr.14373) 8848 : cluster [DBG] pgmap v6135: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-16T09:01:40.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:01:39 smithi157 bash[24585]: audit 2024-09-16T09:01:39.038006+0000 mgr.a (mgr.14373) 8849 : audit [DBG] from='client.197172 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:01:40.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:01:39 smithi086 bash[24289]: cluster 2024-09-16T09:01:38.393343+0000 mgr.a (mgr.14373) 8848 : cluster [DBG] pgmap v6135: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-16T09:01:40.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:01:39 smithi086 bash[24289]: audit 2024-09-16T09:01:39.038006+0000 mgr.a (mgr.14373) 8849 : audit [DBG] from='client.197172 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:01:40.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:01:39 smithi047 bash[22744]: cluster 2024-09-16T09:01:38.393343+0000 mgr.a (mgr.14373) 8848 : cluster [DBG] pgmap v6135: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-16T09:01:40.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:01:39 smithi047 bash[22744]: audit 2024-09-16T09:01:39.038006+0000 mgr.a (mgr.14373) 8849 : audit [DBG] from='client.197172 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:01:42.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:01:41 smithi157 bash[24585]: cluster 2024-09-16T09:01:40.394322+0000 mgr.a (mgr.14373) 8850 : cluster [DBG] pgmap v6136: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:01:42.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:01:41 smithi086 bash[24289]: cluster 2024-09-16T09:01:40.394322+0000 mgr.a (mgr.14373) 8850 : cluster [DBG] pgmap v6136: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:01:42.088 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:01:41 smithi047 bash[22744]: cluster 2024-09-16T09:01:40.394322+0000 mgr.a (mgr.14373) 8850 : cluster [DBG] pgmap v6136: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:01:44.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:01:43 smithi157 bash[24585]: cluster 2024-09-16T09:01:42.396675+0000 mgr.a (mgr.14373) 8851 : cluster [DBG] pgmap v6137: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:01:44.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:01:43 smithi086 bash[24289]: cluster 2024-09-16T09:01:42.396675+0000 mgr.a (mgr.14373) 8851 : cluster [DBG] pgmap v6137: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:01:44.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:01:43 smithi047 bash[22744]: cluster 2024-09-16T09:01:42.396675+0000 mgr.a (mgr.14373) 8851 : cluster [DBG] pgmap v6137: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:01:44.480 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:01:44.481 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:01:44.481 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:01:45.229 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:01:45.230 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:01:45.230 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:01:45.230 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:01:45.230 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:01:46.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:01:45 smithi157 bash[24585]: cluster 2024-09-16T09:01:44.397618+0000 mgr.a (mgr.14373) 8852 : cluster [DBG] pgmap v6138: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:01:46.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:01:45 smithi157 bash[24585]: audit 2024-09-16T09:01:44.818563+0000 mgr.a (mgr.14373) 8853 : audit [DBG] from='client.197250 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:01:46.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:01:45 smithi086 bash[24289]: cluster 2024-09-16T09:01:44.397618+0000 mgr.a (mgr.14373) 8852 : cluster [DBG] pgmap v6138: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:01:46.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:01:45 smithi086 bash[24289]: audit 2024-09-16T09:01:44.818563+0000 mgr.a (mgr.14373) 8853 : audit [DBG] from='client.197250 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:01:46.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:01:45 smithi047 bash[22744]: cluster 2024-09-16T09:01:44.397618+0000 mgr.a (mgr.14373) 8852 : cluster [DBG] pgmap v6138: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:01:46.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:01:45 smithi047 bash[22744]: audit 2024-09-16T09:01:44.818563+0000 mgr.a (mgr.14373) 8853 : audit [DBG] from='client.197250 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:01:48.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:01:47 smithi157 bash[24585]: cluster 2024-09-16T09:01:46.399281+0000 mgr.a (mgr.14373) 8854 : cluster [DBG] pgmap v6139: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:01:48.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:01:47 smithi086 bash[24289]: cluster 2024-09-16T09:01:46.399281+0000 mgr.a (mgr.14373) 8854 : cluster [DBG] pgmap v6139: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:01:48.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:01:47 smithi047 bash[22744]: cluster 2024-09-16T09:01:46.399281+0000 mgr.a (mgr.14373) 8854 : cluster [DBG] pgmap v6139: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:01:50.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:01:49 smithi157 bash[24585]: cluster 2024-09-16T09:01:48.401549+0000 mgr.a (mgr.14373) 8855 : cluster [DBG] pgmap v6140: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:01:50.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:01:49 smithi086 bash[24289]: cluster 2024-09-16T09:01:48.401549+0000 mgr.a (mgr.14373) 8855 : cluster [DBG] pgmap v6140: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:01:50.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:01:49 smithi047 bash[22744]: cluster 2024-09-16T09:01:48.401549+0000 mgr.a (mgr.14373) 8855 : cluster [DBG] pgmap v6140: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:01:50.231 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:01:50.232 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:01:50.232 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:01:51.000 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:01:51.000 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:01:51.000 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:01:51.000 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:01:51.000 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:01:52.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:01:51 smithi157 bash[24585]: cluster 2024-09-16T09:01:50.402320+0000 mgr.a (mgr.14373) 8856 : cluster [DBG] pgmap v6141: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:01:52.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:01:51 smithi157 bash[24585]: audit 2024-09-16T09:01:50.569702+0000 mgr.a (mgr.14373) 8857 : audit [DBG] from='client.197325 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:01:52.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:01:51 smithi086 bash[24289]: cluster 2024-09-16T09:01:50.402320+0000 mgr.a (mgr.14373) 8856 : cluster [DBG] pgmap v6141: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:01:52.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:01:51 smithi086 bash[24289]: audit 2024-09-16T09:01:50.569702+0000 mgr.a (mgr.14373) 8857 : audit [DBG] from='client.197325 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:01:52.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:01:51 smithi047 bash[22744]: cluster 2024-09-16T09:01:50.402320+0000 mgr.a (mgr.14373) 8856 : cluster [DBG] pgmap v6141: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:01:52.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:01:51 smithi047 bash[22744]: audit 2024-09-16T09:01:50.569702+0000 mgr.a (mgr.14373) 8857 : audit [DBG] from='client.197325 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:01:54.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:01:53 smithi157 bash[24585]: cluster 2024-09-16T09:01:52.404765+0000 mgr.a (mgr.14373) 8858 : cluster [DBG] pgmap v6142: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:01:54.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:01:53 smithi086 bash[24289]: cluster 2024-09-16T09:01:52.404765+0000 mgr.a (mgr.14373) 8858 : cluster [DBG] pgmap v6142: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:01:54.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:01:53 smithi047 bash[22744]: cluster 2024-09-16T09:01:52.404765+0000 mgr.a (mgr.14373) 8858 : cluster [DBG] pgmap v6142: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:01:56.001 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:01:56.002 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:01:56.002 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:01:56.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:01:55 smithi157 bash[24585]: cluster 2024-09-16T09:01:54.405510+0000 mgr.a (mgr.14373) 8859 : cluster [DBG] pgmap v6143: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:01:56.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:01:55 smithi086 bash[24289]: cluster 2024-09-16T09:01:54.405510+0000 mgr.a (mgr.14373) 8859 : cluster [DBG] pgmap v6143: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:01:56.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:01:55 smithi047 bash[22744]: cluster 2024-09-16T09:01:54.405510+0000 mgr.a (mgr.14373) 8859 : cluster [DBG] pgmap v6143: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:01:56.751 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:01:56.752 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:01:56.752 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:01:56.752 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:01:56.752 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:01:58.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:01:57 smithi157 bash[24585]: audit 2024-09-16T09:01:56.337341+0000 mgr.a (mgr.14373) 8860 : audit [DBG] from='client.197400 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:01:58.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:01:57 smithi157 bash[24585]: cluster 2024-09-16T09:01:56.406016+0000 mgr.a (mgr.14373) 8861 : cluster [DBG] pgmap v6144: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:01:58.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:01:57 smithi086 bash[24289]: audit 2024-09-16T09:01:56.337341+0000 mgr.a (mgr.14373) 8860 : audit [DBG] from='client.197400 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:01:58.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:01:57 smithi086 bash[24289]: cluster 2024-09-16T09:01:56.406016+0000 mgr.a (mgr.14373) 8861 : cluster [DBG] pgmap v6144: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:01:58.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:01:57 smithi047 bash[22744]: audit 2024-09-16T09:01:56.337341+0000 mgr.a (mgr.14373) 8860 : audit [DBG] from='client.197400 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:01:58.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:01:57 smithi047 bash[22744]: cluster 2024-09-16T09:01:56.406016+0000 mgr.a (mgr.14373) 8861 : cluster [DBG] pgmap v6144: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:02:00.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:01:59 smithi157 bash[24585]: cluster 2024-09-16T09:01:58.408932+0000 mgr.a (mgr.14373) 8862 : cluster [DBG] pgmap v6145: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:02:00.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:01:59 smithi086 bash[24289]: cluster 2024-09-16T09:01:58.408932+0000 mgr.a (mgr.14373) 8862 : cluster [DBG] pgmap v6145: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:02:00.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:01:59 smithi047 bash[22744]: cluster 2024-09-16T09:01:58.408932+0000 mgr.a (mgr.14373) 8862 : cluster [DBG] pgmap v6145: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:02:01.753 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:02:01.754 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:02:01.754 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:02:02.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:02:01 smithi157 bash[24585]: cluster 2024-09-16T09:02:00.409895+0000 mgr.a (mgr.14373) 8863 : cluster [DBG] pgmap v6146: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:02:02.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:02:01 smithi086 bash[24289]: cluster 2024-09-16T09:02:00.409895+0000 mgr.a (mgr.14373) 8863 : cluster [DBG] pgmap v6146: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:02:02.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:02:01 smithi047 bash[22744]: cluster 2024-09-16T09:02:00.409895+0000 mgr.a (mgr.14373) 8863 : cluster [DBG] pgmap v6146: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:02:02.494 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:02:02.494 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:02:02.495 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:02:02.495 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:02:02.495 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:02:03.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:02:02 smithi157 bash[24585]: audit 2024-09-16T09:02:02.084394+0000 mgr.a (mgr.14373) 8864 : audit [DBG] from='client.197478 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:02:03.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:02:02 smithi086 bash[24289]: audit 2024-09-16T09:02:02.084394+0000 mgr.a (mgr.14373) 8864 : audit [DBG] from='client.197478 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:02:03.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:02:02 smithi047 bash[22744]: audit 2024-09-16T09:02:02.084394+0000 mgr.a (mgr.14373) 8864 : audit [DBG] from='client.197478 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:02:04.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:02:03 smithi157 bash[24585]: cluster 2024-09-16T09:02:02.411228+0000 mgr.a (mgr.14373) 8865 : cluster [DBG] pgmap v6147: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:02:04.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:02:03 smithi086 bash[24289]: cluster 2024-09-16T09:02:02.411228+0000 mgr.a (mgr.14373) 8865 : cluster [DBG] pgmap v6147: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:02:04.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:02:03 smithi047 bash[22744]: cluster 2024-09-16T09:02:02.411228+0000 mgr.a (mgr.14373) 8865 : cluster [DBG] pgmap v6147: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:02:06.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:02:05 smithi157 bash[24585]: cluster 2024-09-16T09:02:04.411974+0000 mgr.a (mgr.14373) 8866 : cluster [DBG] pgmap v6148: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:02:06.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:02:05 smithi086 bash[24289]: cluster 2024-09-16T09:02:04.411974+0000 mgr.a (mgr.14373) 8866 : cluster [DBG] pgmap v6148: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:02:06.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:02:05 smithi047 bash[22744]: cluster 2024-09-16T09:02:04.411974+0000 mgr.a (mgr.14373) 8866 : cluster [DBG] pgmap v6148: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:02:07.496 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:02:07.497 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:02:07.497 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:02:08.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:02:07 smithi157 bash[24585]: cluster 2024-09-16T09:02:06.412739+0000 mgr.a (mgr.14373) 8867 : cluster [DBG] pgmap v6149: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T09:02:08.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:02:07 smithi086 bash[24289]: cluster 2024-09-16T09:02:06.412739+0000 mgr.a (mgr.14373) 8867 : cluster [DBG] pgmap v6149: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T09:02:08.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:02:07 smithi047 bash[22744]: cluster 2024-09-16T09:02:06.412739+0000 mgr.a (mgr.14373) 8867 : cluster [DBG] pgmap v6149: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T09:02:08.281 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:02:08.281 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:02:08.281 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:02:08.281 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:02:08.281 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:02:09.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:02:08 smithi157 bash[24585]: audit 2024-09-16T09:02:07.832828+0000 mgr.a (mgr.14373) 8868 : audit [DBG] from='client.197553 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:02:09.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:02:08 smithi086 bash[24289]: audit 2024-09-16T09:02:07.832828+0000 mgr.a (mgr.14373) 8868 : audit [DBG] from='client.197553 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:02:09.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:02:08 smithi047 bash[22744]: audit 2024-09-16T09:02:07.832828+0000 mgr.a (mgr.14373) 8868 : audit [DBG] from='client.197553 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:02:10.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:02:09 smithi157 bash[24585]: cluster 2024-09-16T09:02:08.415706+0000 mgr.a (mgr.14373) 8869 : cluster [DBG] pgmap v6150: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:02:10.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:02:09 smithi086 bash[24289]: cluster 2024-09-16T09:02:08.415706+0000 mgr.a (mgr.14373) 8869 : cluster [DBG] pgmap v6150: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:02:10.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:02:09 smithi047 bash[22744]: cluster 2024-09-16T09:02:08.415706+0000 mgr.a (mgr.14373) 8869 : cluster [DBG] pgmap v6150: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:02:12.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:02:11 smithi157 bash[24585]: cluster 2024-09-16T09:02:10.416572+0000 mgr.a (mgr.14373) 8870 : cluster [DBG] pgmap v6151: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:02:12.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:02:11 smithi086 bash[24289]: cluster 2024-09-16T09:02:10.416572+0000 mgr.a (mgr.14373) 8870 : cluster [DBG] pgmap v6151: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:02:12.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:02:11 smithi047 bash[22744]: cluster 2024-09-16T09:02:10.416572+0000 mgr.a (mgr.14373) 8870 : cluster [DBG] pgmap v6151: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:02:13.282 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:02:13.283 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:02:13.283 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:02:14.052 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:02:14.053 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:02:14.053 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:02:14.053 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:02:14.053 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:02:14.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:02:13 smithi157 bash[24585]: cluster 2024-09-16T09:02:12.418582+0000 mgr.a (mgr.14373) 8871 : cluster [DBG] pgmap v6152: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:02:14.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:02:13 smithi086 bash[24289]: cluster 2024-09-16T09:02:12.418582+0000 mgr.a (mgr.14373) 8871 : cluster [DBG] pgmap v6152: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:02:14.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:02:13 smithi047 bash[22744]: cluster 2024-09-16T09:02:12.418582+0000 mgr.a (mgr.14373) 8871 : cluster [DBG] pgmap v6152: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:02:15.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:02:14 smithi157 bash[24585]: audit 2024-09-16T09:02:13.617832+0000 mgr.a (mgr.14373) 8872 : audit [DBG] from='client.197631 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:02:15.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:02:14 smithi086 bash[24289]: audit 2024-09-16T09:02:13.617832+0000 mgr.a (mgr.14373) 8872 : audit [DBG] from='client.197631 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:02:15.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:02:14 smithi047 bash[22744]: audit 2024-09-16T09:02:13.617832+0000 mgr.a (mgr.14373) 8872 : audit [DBG] from='client.197631 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:02:16.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:02:15 smithi157 bash[24585]: cluster 2024-09-16T09:02:14.419762+0000 mgr.a (mgr.14373) 8873 : cluster [DBG] pgmap v6153: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:02:16.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:02:15 smithi086 bash[24289]: cluster 2024-09-16T09:02:14.419762+0000 mgr.a (mgr.14373) 8873 : cluster [DBG] pgmap v6153: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:02:16.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:02:15 smithi047 bash[22744]: cluster 2024-09-16T09:02:14.419762+0000 mgr.a (mgr.14373) 8873 : cluster [DBG] pgmap v6153: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:02:18.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:02:17 smithi157 bash[24585]: cluster 2024-09-16T09:02:16.420590+0000 mgr.a (mgr.14373) 8874 : cluster [DBG] pgmap v6154: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:02:18.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:02:17 smithi086 bash[24289]: cluster 2024-09-16T09:02:16.420590+0000 mgr.a (mgr.14373) 8874 : cluster [DBG] pgmap v6154: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:02:18.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:02:17 smithi047 bash[22744]: cluster 2024-09-16T09:02:16.420590+0000 mgr.a (mgr.14373) 8874 : cluster [DBG] pgmap v6154: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:02:19.054 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:02:19.054 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:02:19.055 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:02:19.835 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:02:19.836 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:02:19.836 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:02:19.836 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:02:19.836 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:02:20.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:02:19 smithi157 bash[24585]: cluster 2024-09-16T09:02:18.422885+0000 mgr.a (mgr.14373) 8875 : cluster [DBG] pgmap v6155: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:02:20.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:02:19 smithi086 bash[24289]: cluster 2024-09-16T09:02:18.422885+0000 mgr.a (mgr.14373) 8875 : cluster [DBG] pgmap v6155: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:02:20.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:02:19 smithi047 bash[22744]: cluster 2024-09-16T09:02:18.422885+0000 mgr.a (mgr.14373) 8875 : cluster [DBG] pgmap v6155: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:02:21.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:02:20 smithi157 bash[24585]: audit 2024-09-16T09:02:19.386375+0000 mgr.a (mgr.14373) 8876 : audit [DBG] from='client.197706 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:02:21.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:02:20 smithi086 bash[24289]: audit 2024-09-16T09:02:19.386375+0000 mgr.a (mgr.14373) 8876 : audit [DBG] from='client.197706 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:02:21.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:02:20 smithi047 bash[22744]: audit 2024-09-16T09:02:19.386375+0000 mgr.a (mgr.14373) 8876 : audit [DBG] from='client.197706 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:02:22.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:02:21 smithi157 bash[24585]: cluster 2024-09-16T09:02:20.423877+0000 mgr.a (mgr.14373) 8877 : cluster [DBG] pgmap v6156: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:02:22.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:02:21 smithi086 bash[24289]: cluster 2024-09-16T09:02:20.423877+0000 mgr.a (mgr.14373) 8877 : cluster [DBG] pgmap v6156: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:02:22.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:02:21 smithi047 bash[22744]: cluster 2024-09-16T09:02:20.423877+0000 mgr.a (mgr.14373) 8877 : cluster [DBG] pgmap v6156: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:02:23.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:02:22 smithi157 bash[24585]: audit 2024-09-16T09:02:21.795795+0000 mon.b (mon.2) 830 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T09:02:23.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:02:22 smithi157 bash[24585]: audit 2024-09-16T09:02:22.424827+0000 mon.a (mon.0) 1094 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:02:23.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:02:22 smithi157 bash[24585]: audit 2024-09-16T09:02:22.431978+0000 mon.a (mon.0) 1095 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:02:23.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:02:22 smithi086 bash[24289]: audit 2024-09-16T09:02:21.795795+0000 mon.b (mon.2) 830 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T09:02:23.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:02:22 smithi086 bash[24289]: audit 2024-09-16T09:02:22.424827+0000 mon.a (mon.0) 1094 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:02:23.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:02:22 smithi086 bash[24289]: audit 2024-09-16T09:02:22.431978+0000 mon.a (mon.0) 1095 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:02:23.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:02:22 smithi047 bash[22744]: audit 2024-09-16T09:02:21.795795+0000 mon.b (mon.2) 830 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T09:02:23.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:02:22 smithi047 bash[22744]: audit 2024-09-16T09:02:22.424827+0000 mon.a (mon.0) 1094 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:02:23.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:02:22 smithi047 bash[22744]: audit 2024-09-16T09:02:22.431978+0000 mon.a (mon.0) 1095 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:02:24.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:02:23 smithi157 bash[24585]: cluster 2024-09-16T09:02:22.425202+0000 mgr.a (mgr.14373) 8878 : cluster [DBG] pgmap v6157: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:02:24.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:02:23 smithi157 bash[24585]: audit 2024-09-16T09:02:23.219751+0000 mon.b (mon.2) 831 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:02:24.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:02:23 smithi157 bash[24585]: audit 2024-09-16T09:02:23.221457+0000 mon.b (mon.2) 832 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T09:02:24.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:02:23 smithi157 bash[24585]: audit 2024-09-16T09:02:23.233022+0000 mon.a (mon.0) 1096 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:02:24.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:02:23 smithi157 bash[24585]: audit 2024-09-16T09:02:23.237394+0000 mon.b (mon.2) 833 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:02:24.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:02:23 smithi086 bash[24289]: cluster 2024-09-16T09:02:22.425202+0000 mgr.a (mgr.14373) 8878 : cluster [DBG] pgmap v6157: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:02:24.245 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:02:23 smithi086 bash[24289]: audit 2024-09-16T09:02:23.219751+0000 mon.b (mon.2) 831 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:02:24.245 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:02:23 smithi086 bash[24289]: audit 2024-09-16T09:02:23.221457+0000 mon.b (mon.2) 832 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T09:02:24.245 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:02:23 smithi086 bash[24289]: audit 2024-09-16T09:02:23.233022+0000 mon.a (mon.0) 1096 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:02:24.245 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:02:23 smithi086 bash[24289]: audit 2024-09-16T09:02:23.237394+0000 mon.b (mon.2) 833 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:02:24.246 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 09:02:23 smithi047 bash[22994]: debug 2024-09-16T09:02:23.960+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T09:02:24.246 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 09:02:23 smithi047 bash[22994]: debug 2024-09-16T09:02:23.964+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T09:02:24.247 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:02:23 smithi047 bash[22744]: cluster 2024-09-16T09:02:22.425202+0000 mgr.a (mgr.14373) 8878 : cluster [DBG] pgmap v6157: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:02:24.247 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:02:23 smithi047 bash[22744]: audit 2024-09-16T09:02:23.219751+0000 mon.b (mon.2) 831 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:02:24.247 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:02:23 smithi047 bash[22744]: audit 2024-09-16T09:02:23.221457+0000 mon.b (mon.2) 832 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T09:02:24.247 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:02:23 smithi047 bash[22744]: audit 2024-09-16T09:02:23.233022+0000 mon.a (mon.0) 1096 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:02:24.247 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:02:23 smithi047 bash[22744]: audit 2024-09-16T09:02:23.237394+0000 mon.b (mon.2) 833 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:02:24.837 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:02:24.837 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:02:24.838 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:02:25.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:02:24 smithi157 bash[24585]: audit 2024-09-16T09:02:23.239821+0000 mgr.a (mgr.14373) 8879 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:02:25.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:02:24 smithi157 bash[24585]: audit 2024-09-16T09:02:23.965866+0000 mgr.a (mgr.14373) 8880 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T09:02:25.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:02:24 smithi157 bash[24585]: cephadm 2024-09-16T09:02:23.968042+0000 mgr.a (mgr.14373) 8881 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T09:02:25.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:02:24 smithi086 bash[24289]: audit 2024-09-16T09:02:23.239821+0000 mgr.a (mgr.14373) 8879 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:02:25.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:02:24 smithi086 bash[24289]: audit 2024-09-16T09:02:23.965866+0000 mgr.a (mgr.14373) 8880 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T09:02:25.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:02:24 smithi086 bash[24289]: cephadm 2024-09-16T09:02:23.968042+0000 mgr.a (mgr.14373) 8881 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T09:02:25.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:02:24 smithi047 bash[22744]: audit 2024-09-16T09:02:23.239821+0000 mgr.a (mgr.14373) 8879 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:02:25.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:02:24 smithi047 bash[22744]: audit 2024-09-16T09:02:23.965866+0000 mgr.a (mgr.14373) 8880 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T09:02:25.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:02:24 smithi047 bash[22744]: cephadm 2024-09-16T09:02:23.968042+0000 mgr.a (mgr.14373) 8881 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T09:02:25.622 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:02:25.623 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:02:25.623 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:02:25.623 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:02:25.623 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:02:26.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:02:25 smithi086 bash[24289]: cluster 2024-09-16T09:02:24.426232+0000 mgr.a (mgr.14373) 8882 : cluster [DBG] pgmap v6158: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:02:26.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:02:25 smithi047 bash[22744]: cluster 2024-09-16T09:02:24.426232+0000 mgr.a (mgr.14373) 8882 : cluster [DBG] pgmap v6158: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:02:26.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:02:25 smithi157 bash[24585]: cluster 2024-09-16T09:02:24.426232+0000 mgr.a (mgr.14373) 8882 : cluster [DBG] pgmap v6158: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:02:27.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:02:26 smithi086 bash[24289]: audit 2024-09-16T09:02:25.178291+0000 mgr.a (mgr.14373) 8883 : audit [DBG] from='client.197889 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:02:27.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:02:26 smithi047 bash[22744]: audit 2024-09-16T09:02:25.178291+0000 mgr.a (mgr.14373) 8883 : audit [DBG] from='client.197889 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:02:27.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:02:26 smithi157 bash[24585]: audit 2024-09-16T09:02:25.178291+0000 mgr.a (mgr.14373) 8883 : audit [DBG] from='client.197889 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:02:28.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:02:27 smithi086 bash[24289]: cluster 2024-09-16T09:02:26.427251+0000 mgr.a (mgr.14373) 8884 : cluster [DBG] pgmap v6159: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:02:28.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:02:27 smithi047 bash[22744]: cluster 2024-09-16T09:02:26.427251+0000 mgr.a (mgr.14373) 8884 : cluster [DBG] pgmap v6159: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:02:28.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:02:27 smithi157 bash[24585]: cluster 2024-09-16T09:02:26.427251+0000 mgr.a (mgr.14373) 8884 : cluster [DBG] pgmap v6159: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:02:30.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:02:29 smithi047 bash[22744]: cluster 2024-09-16T09:02:28.429510+0000 mgr.a (mgr.14373) 8885 : cluster [DBG] pgmap v6160: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:02:30.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:02:29 smithi157 bash[24585]: cluster 2024-09-16T09:02:28.429510+0000 mgr.a (mgr.14373) 8885 : cluster [DBG] pgmap v6160: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:02:30.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:02:29 smithi086 bash[24289]: cluster 2024-09-16T09:02:28.429510+0000 mgr.a (mgr.14373) 8885 : cluster [DBG] pgmap v6160: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:02:30.624 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:02:30.625 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:02:30.625 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:02:31.399 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:02:31.400 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:02:31.400 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:02:31.400 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:02:31.400 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:02:32.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:02:31 smithi047 bash[22744]: cluster 2024-09-16T09:02:30.430272+0000 mgr.a (mgr.14373) 8886 : cluster [DBG] pgmap v6161: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:02:32.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:02:31 smithi047 bash[22744]: audit 2024-09-16T09:02:30.964194+0000 mgr.a (mgr.14373) 8887 : audit [DBG] from='client.197964 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:02:32.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:02:31 smithi157 bash[24585]: cluster 2024-09-16T09:02:30.430272+0000 mgr.a (mgr.14373) 8886 : cluster [DBG] pgmap v6161: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:02:32.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:02:31 smithi157 bash[24585]: audit 2024-09-16T09:02:30.964194+0000 mgr.a (mgr.14373) 8887 : audit [DBG] from='client.197964 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:02:32.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:02:31 smithi086 bash[24289]: cluster 2024-09-16T09:02:30.430272+0000 mgr.a (mgr.14373) 8886 : cluster [DBG] pgmap v6161: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:02:32.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:02:31 smithi086 bash[24289]: audit 2024-09-16T09:02:30.964194+0000 mgr.a (mgr.14373) 8887 : audit [DBG] from='client.197964 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:02:34.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:02:33 smithi047 bash[22744]: cluster 2024-09-16T09:02:32.432693+0000 mgr.a (mgr.14373) 8888 : cluster [DBG] pgmap v6162: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:02:34.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:02:33 smithi157 bash[24585]: cluster 2024-09-16T09:02:32.432693+0000 mgr.a (mgr.14373) 8888 : cluster [DBG] pgmap v6162: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:02:34.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:02:33 smithi086 bash[24289]: cluster 2024-09-16T09:02:32.432693+0000 mgr.a (mgr.14373) 8888 : cluster [DBG] pgmap v6162: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:02:36.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:02:35 smithi047 bash[22744]: cluster 2024-09-16T09:02:34.433496+0000 mgr.a (mgr.14373) 8889 : cluster [DBG] pgmap v6163: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:02:36.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:02:35 smithi157 bash[24585]: cluster 2024-09-16T09:02:34.433496+0000 mgr.a (mgr.14373) 8889 : cluster [DBG] pgmap v6163: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:02:36.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:02:35 smithi086 bash[24289]: cluster 2024-09-16T09:02:34.433496+0000 mgr.a (mgr.14373) 8889 : cluster [DBG] pgmap v6163: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:02:36.401 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:02:36.402 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:02:36.402 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:02:37.180 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:02:37.181 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:02:37.181 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:02:37.181 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:02:37.181 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:02:38.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:02:37 smithi047 bash[22744]: cluster 2024-09-16T09:02:36.434267+0000 mgr.a (mgr.14373) 8890 : cluster [DBG] pgmap v6164: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:02:38.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:02:37 smithi047 bash[22744]: audit 2024-09-16T09:02:36.733631+0000 mgr.a (mgr.14373) 8891 : audit [DBG] from='client.198042 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:02:38.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:02:37 smithi157 bash[24585]: cluster 2024-09-16T09:02:36.434267+0000 mgr.a (mgr.14373) 8890 : cluster [DBG] pgmap v6164: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:02:38.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:02:37 smithi157 bash[24585]: audit 2024-09-16T09:02:36.733631+0000 mgr.a (mgr.14373) 8891 : audit [DBG] from='client.198042 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:02:38.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:02:37 smithi086 bash[24289]: cluster 2024-09-16T09:02:36.434267+0000 mgr.a (mgr.14373) 8890 : cluster [DBG] pgmap v6164: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:02:38.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:02:37 smithi086 bash[24289]: audit 2024-09-16T09:02:36.733631+0000 mgr.a (mgr.14373) 8891 : audit [DBG] from='client.198042 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:02:40.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:02:39 smithi157 bash[24585]: cluster 2024-09-16T09:02:38.437050+0000 mgr.a (mgr.14373) 8892 : cluster [DBG] pgmap v6165: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:02:40.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:02:39 smithi086 bash[24289]: cluster 2024-09-16T09:02:38.437050+0000 mgr.a (mgr.14373) 8892 : cluster [DBG] pgmap v6165: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:02:40.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:02:39 smithi047 bash[22744]: cluster 2024-09-16T09:02:38.437050+0000 mgr.a (mgr.14373) 8892 : cluster [DBG] pgmap v6165: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:02:42.182 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:02:42.183 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:02:42.183 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:02:42.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:02:41 smithi157 bash[24585]: cluster 2024-09-16T09:02:40.437892+0000 mgr.a (mgr.14373) 8893 : cluster [DBG] pgmap v6166: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:02:42.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:02:41 smithi086 bash[24289]: cluster 2024-09-16T09:02:40.437892+0000 mgr.a (mgr.14373) 8893 : cluster [DBG] pgmap v6166: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:02:42.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:02:41 smithi047 bash[22744]: cluster 2024-09-16T09:02:40.437892+0000 mgr.a (mgr.14373) 8893 : cluster [DBG] pgmap v6166: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:02:42.972 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:02:42.973 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:02:42.973 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:02:42.973 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:02:42.973 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:02:44.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:02:43 smithi157 bash[24585]: cluster 2024-09-16T09:02:42.439906+0000 mgr.a (mgr.14373) 8894 : cluster [DBG] pgmap v6167: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:02:44.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:02:43 smithi157 bash[24585]: audit 2024-09-16T09:02:42.521639+0000 mgr.a (mgr.14373) 8895 : audit [DBG] from='client.198117 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:02:44.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:02:43 smithi086 bash[24289]: cluster 2024-09-16T09:02:42.439906+0000 mgr.a (mgr.14373) 8894 : cluster [DBG] pgmap v6167: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:02:44.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:02:43 smithi086 bash[24289]: audit 2024-09-16T09:02:42.521639+0000 mgr.a (mgr.14373) 8895 : audit [DBG] from='client.198117 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:02:44.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:02:43 smithi047 bash[22744]: cluster 2024-09-16T09:02:42.439906+0000 mgr.a (mgr.14373) 8894 : cluster [DBG] pgmap v6167: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:02:44.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:02:43 smithi047 bash[22744]: audit 2024-09-16T09:02:42.521639+0000 mgr.a (mgr.14373) 8895 : audit [DBG] from='client.198117 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:02:46.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:02:45 smithi157 bash[24585]: cluster 2024-09-16T09:02:44.440865+0000 mgr.a (mgr.14373) 8896 : cluster [DBG] pgmap v6168: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:02:46.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:02:45 smithi086 bash[24289]: cluster 2024-09-16T09:02:44.440865+0000 mgr.a (mgr.14373) 8896 : cluster [DBG] pgmap v6168: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:02:46.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:02:45 smithi047 bash[22744]: cluster 2024-09-16T09:02:44.440865+0000 mgr.a (mgr.14373) 8896 : cluster [DBG] pgmap v6168: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:02:47.974 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:02:47.974 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:02:47.975 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:02:48.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:02:47 smithi157 bash[24585]: cluster 2024-09-16T09:02:46.441630+0000 mgr.a (mgr.14373) 8897 : cluster [DBG] pgmap v6169: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T09:02:48.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:02:47 smithi086 bash[24289]: cluster 2024-09-16T09:02:46.441630+0000 mgr.a (mgr.14373) 8897 : cluster [DBG] pgmap v6169: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T09:02:48.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:02:47 smithi047 bash[22744]: cluster 2024-09-16T09:02:46.441630+0000 mgr.a (mgr.14373) 8897 : cluster [DBG] pgmap v6169: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T09:02:48.760 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:02:48.760 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:02:48.760 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:02:48.760 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:02:48.761 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:02:50.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:02:49 smithi157 bash[24585]: audit 2024-09-16T09:02:48.316671+0000 mgr.a (mgr.14373) 8898 : audit [DBG] from='client.198195 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:02:50.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:02:49 smithi157 bash[24585]: cluster 2024-09-16T09:02:48.443280+0000 mgr.a (mgr.14373) 8899 : cluster [DBG] pgmap v6170: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:02:50.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:02:49 smithi086 bash[24289]: audit 2024-09-16T09:02:48.316671+0000 mgr.a (mgr.14373) 8898 : audit [DBG] from='client.198195 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:02:50.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:02:49 smithi086 bash[24289]: cluster 2024-09-16T09:02:48.443280+0000 mgr.a (mgr.14373) 8899 : cluster [DBG] pgmap v6170: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:02:50.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:02:49 smithi047 bash[22744]: audit 2024-09-16T09:02:48.316671+0000 mgr.a (mgr.14373) 8898 : audit [DBG] from='client.198195 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:02:50.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:02:49 smithi047 bash[22744]: cluster 2024-09-16T09:02:48.443280+0000 mgr.a (mgr.14373) 8899 : cluster [DBG] pgmap v6170: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:02:52.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:02:51 smithi157 bash[24585]: cluster 2024-09-16T09:02:50.444186+0000 mgr.a (mgr.14373) 8900 : cluster [DBG] pgmap v6171: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:02:52.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:02:51 smithi086 bash[24289]: cluster 2024-09-16T09:02:50.444186+0000 mgr.a (mgr.14373) 8900 : cluster [DBG] pgmap v6171: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:02:52.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:02:51 smithi047 bash[22744]: cluster 2024-09-16T09:02:50.444186+0000 mgr.a (mgr.14373) 8900 : cluster [DBG] pgmap v6171: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:02:53.762 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:02:53.762 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:02:53.762 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:02:54.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:02:53 smithi157 bash[24585]: cluster 2024-09-16T09:02:52.446483+0000 mgr.a (mgr.14373) 8901 : cluster [DBG] pgmap v6172: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:02:54.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:02:53 smithi086 bash[24289]: cluster 2024-09-16T09:02:52.446483+0000 mgr.a (mgr.14373) 8901 : cluster [DBG] pgmap v6172: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:02:54.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:02:53 smithi047 bash[22744]: cluster 2024-09-16T09:02:52.446483+0000 mgr.a (mgr.14373) 8901 : cluster [DBG] pgmap v6172: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:02:54.528 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:02:54.528 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:02:54.528 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:02:54.528 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:02:54.528 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:02:55.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:02:54 smithi157 bash[24585]: audit 2024-09-16T09:02:54.100558+0000 mgr.a (mgr.14373) 8902 : audit [DBG] from='client.198270 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:02:55.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:02:54 smithi086 bash[24289]: audit 2024-09-16T09:02:54.100558+0000 mgr.a (mgr.14373) 8902 : audit [DBG] from='client.198270 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:02:55.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:02:54 smithi047 bash[22744]: audit 2024-09-16T09:02:54.100558+0000 mgr.a (mgr.14373) 8902 : audit [DBG] from='client.198270 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:02:56.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:02:55 smithi157 bash[24585]: cluster 2024-09-16T09:02:54.447027+0000 mgr.a (mgr.14373) 8903 : cluster [DBG] pgmap v6173: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:02:56.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:02:55 smithi086 bash[24289]: cluster 2024-09-16T09:02:54.447027+0000 mgr.a (mgr.14373) 8903 : cluster [DBG] pgmap v6173: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:02:56.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:02:55 smithi047 bash[22744]: cluster 2024-09-16T09:02:54.447027+0000 mgr.a (mgr.14373) 8903 : cluster [DBG] pgmap v6173: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:02:58.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:02:57 smithi157 bash[24585]: cluster 2024-09-16T09:02:56.447746+0000 mgr.a (mgr.14373) 8904 : cluster [DBG] pgmap v6174: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:02:58.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:02:57 smithi086 bash[24289]: cluster 2024-09-16T09:02:56.447746+0000 mgr.a (mgr.14373) 8904 : cluster [DBG] pgmap v6174: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:02:58.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:02:57 smithi047 bash[22744]: cluster 2024-09-16T09:02:56.447746+0000 mgr.a (mgr.14373) 8904 : cluster [DBG] pgmap v6174: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:02:59.529 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:02:59.530 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:02:59.531 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:03:00.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:02:59 smithi157 bash[24585]: cluster 2024-09-16T09:02:58.449977+0000 mgr.a (mgr.14373) 8905 : cluster [DBG] pgmap v6175: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:03:00.309 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:03:00.310 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:03:00.310 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:03:00.310 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:03:00.310 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:03:00.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:02:59 smithi086 bash[24289]: cluster 2024-09-16T09:02:58.449977+0000 mgr.a (mgr.14373) 8905 : cluster [DBG] pgmap v6175: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:03:00.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:02:59 smithi047 bash[22744]: cluster 2024-09-16T09:02:58.449977+0000 mgr.a (mgr.14373) 8905 : cluster [DBG] pgmap v6175: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:03:01.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:03:00 smithi157 bash[24585]: audit 2024-09-16T09:02:59.865924+0000 mgr.a (mgr.14373) 8906 : audit [DBG] from='client.198348 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:03:01.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:03:00 smithi086 bash[24289]: audit 2024-09-16T09:02:59.865924+0000 mgr.a (mgr.14373) 8906 : audit [DBG] from='client.198348 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:03:01.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:03:00 smithi047 bash[22744]: audit 2024-09-16T09:02:59.865924+0000 mgr.a (mgr.14373) 8906 : audit [DBG] from='client.198348 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:03:02.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:03:01 smithi157 bash[24585]: cluster 2024-09-16T09:03:00.450958+0000 mgr.a (mgr.14373) 8907 : cluster [DBG] pgmap v6176: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:03:02.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:03:01 smithi086 bash[24289]: cluster 2024-09-16T09:03:00.450958+0000 mgr.a (mgr.14373) 8907 : cluster [DBG] pgmap v6176: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:03:02.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:03:01 smithi047 bash[22744]: cluster 2024-09-16T09:03:00.450958+0000 mgr.a (mgr.14373) 8907 : cluster [DBG] pgmap v6176: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:03:04.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:03:03 smithi157 bash[24585]: cluster 2024-09-16T09:03:02.453193+0000 mgr.a (mgr.14373) 8908 : cluster [DBG] pgmap v6177: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:03:04.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:03:03 smithi086 bash[24289]: cluster 2024-09-16T09:03:02.453193+0000 mgr.a (mgr.14373) 8908 : cluster [DBG] pgmap v6177: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:03:04.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:03:03 smithi047 bash[22744]: cluster 2024-09-16T09:03:02.453193+0000 mgr.a (mgr.14373) 8908 : cluster [DBG] pgmap v6177: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:03:05.311 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:03:05.312 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:03:05.312 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:03:06.080 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:03:06.080 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:03:06.080 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:03:06.080 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:03:06.080 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:03:06.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:03:05 smithi157 bash[24585]: cluster 2024-09-16T09:03:04.454050+0000 mgr.a (mgr.14373) 8909 : cluster [DBG] pgmap v6178: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:03:06.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:03:05 smithi086 bash[24289]: cluster 2024-09-16T09:03:04.454050+0000 mgr.a (mgr.14373) 8909 : cluster [DBG] pgmap v6178: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:03:06.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:03:05 smithi047 bash[22744]: cluster 2024-09-16T09:03:04.454050+0000 mgr.a (mgr.14373) 8909 : cluster [DBG] pgmap v6178: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:03:07.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:03:06 smithi157 bash[24585]: audit 2024-09-16T09:03:05.645575+0000 mgr.a (mgr.14373) 8910 : audit [DBG] from='client.198423 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:03:07.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:03:06 smithi086 bash[24289]: audit 2024-09-16T09:03:05.645575+0000 mgr.a (mgr.14373) 8910 : audit [DBG] from='client.198423 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:03:07.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:03:06 smithi047 bash[22744]: audit 2024-09-16T09:03:05.645575+0000 mgr.a (mgr.14373) 8910 : audit [DBG] from='client.198423 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:03:08.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:03:07 smithi157 bash[24585]: cluster 2024-09-16T09:03:06.455066+0000 mgr.a (mgr.14373) 8911 : cluster [DBG] pgmap v6179: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:03:08.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:03:07 smithi086 bash[24289]: cluster 2024-09-16T09:03:06.455066+0000 mgr.a (mgr.14373) 8911 : cluster [DBG] pgmap v6179: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:03:08.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:03:07 smithi047 bash[22744]: cluster 2024-09-16T09:03:06.455066+0000 mgr.a (mgr.14373) 8911 : cluster [DBG] pgmap v6179: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:03:10.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:03:09 smithi157 bash[24585]: cluster 2024-09-16T09:03:08.457317+0000 mgr.a (mgr.14373) 8912 : cluster [DBG] pgmap v6180: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:03:10.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:03:09 smithi086 bash[24289]: cluster 2024-09-16T09:03:08.457317+0000 mgr.a (mgr.14373) 8912 : cluster [DBG] pgmap v6180: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:03:10.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:03:09 smithi047 bash[22744]: cluster 2024-09-16T09:03:08.457317+0000 mgr.a (mgr.14373) 8912 : cluster [DBG] pgmap v6180: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:03:11.081 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:03:11.082 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:03:11.082 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:03:11.838 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:03:11.838 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:03:11.838 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:03:11.838 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:03:11.838 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:03:12.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:03:11 smithi157 bash[24585]: cluster 2024-09-16T09:03:10.458120+0000 mgr.a (mgr.14373) 8913 : cluster [DBG] pgmap v6181: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:03:12.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:03:11 smithi086 bash[24289]: cluster 2024-09-16T09:03:10.458120+0000 mgr.a (mgr.14373) 8913 : cluster [DBG] pgmap v6181: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:03:12.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:03:11 smithi047 bash[22744]: cluster 2024-09-16T09:03:10.458120+0000 mgr.a (mgr.14373) 8913 : cluster [DBG] pgmap v6181: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:03:13.305 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:03:12 smithi157 bash[24585]: audit 2024-09-16T09:03:11.416909+0000 mgr.a (mgr.14373) 8914 : audit [DBG] from='client.198501 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:03:13.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:03:12 smithi086 bash[24289]: audit 2024-09-16T09:03:11.416909+0000 mgr.a (mgr.14373) 8914 : audit [DBG] from='client.198501 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:03:13.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:03:12 smithi047 bash[22744]: audit 2024-09-16T09:03:11.416909+0000 mgr.a (mgr.14373) 8914 : audit [DBG] from='client.198501 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:03:14.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:03:13 smithi157 bash[24585]: cluster 2024-09-16T09:03:12.460984+0000 mgr.a (mgr.14373) 8915 : cluster [DBG] pgmap v6182: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:03:14.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:03:13 smithi086 bash[24289]: cluster 2024-09-16T09:03:12.460984+0000 mgr.a (mgr.14373) 8915 : cluster [DBG] pgmap v6182: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:03:14.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:03:13 smithi047 bash[22744]: cluster 2024-09-16T09:03:12.460984+0000 mgr.a (mgr.14373) 8915 : cluster [DBG] pgmap v6182: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:03:16.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:03:15 smithi157 bash[24585]: cluster 2024-09-16T09:03:14.461773+0000 mgr.a (mgr.14373) 8916 : cluster [DBG] pgmap v6183: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:03:16.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:03:15 smithi086 bash[24289]: cluster 2024-09-16T09:03:14.461773+0000 mgr.a (mgr.14373) 8916 : cluster [DBG] pgmap v6183: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:03:16.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:03:15 smithi047 bash[22744]: cluster 2024-09-16T09:03:14.461773+0000 mgr.a (mgr.14373) 8916 : cluster [DBG] pgmap v6183: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:03:16.839 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:03:16.840 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:03:16.840 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:03:17.601 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:03:17.602 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:03:17.602 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:03:17.602 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:03:17.602 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:03:18.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:03:17 smithi157 bash[24585]: cluster 2024-09-16T09:03:16.462593+0000 mgr.a (mgr.14373) 8917 : cluster [DBG] pgmap v6184: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:03:18.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:03:17 smithi086 bash[24289]: cluster 2024-09-16T09:03:16.462593+0000 mgr.a (mgr.14373) 8917 : cluster [DBG] pgmap v6184: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:03:18.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:03:17 smithi047 bash[22744]: cluster 2024-09-16T09:03:16.462593+0000 mgr.a (mgr.14373) 8917 : cluster [DBG] pgmap v6184: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:03:19.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:03:18 smithi157 bash[24585]: audit 2024-09-16T09:03:17.176497+0000 mgr.a (mgr.14373) 8918 : audit [DBG] from='client.198579 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:03:19.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:03:18 smithi086 bash[24289]: audit 2024-09-16T09:03:17.176497+0000 mgr.a (mgr.14373) 8918 : audit [DBG] from='client.198579 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:03:19.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:03:18 smithi047 bash[22744]: audit 2024-09-16T09:03:17.176497+0000 mgr.a (mgr.14373) 8918 : audit [DBG] from='client.198579 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:03:20.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:03:19 smithi157 bash[24585]: cluster 2024-09-16T09:03:18.465440+0000 mgr.a (mgr.14373) 8919 : cluster [DBG] pgmap v6185: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:03:20.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:03:19 smithi086 bash[24289]: cluster 2024-09-16T09:03:18.465440+0000 mgr.a (mgr.14373) 8919 : cluster [DBG] pgmap v6185: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:03:20.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:03:19 smithi047 bash[22744]: cluster 2024-09-16T09:03:18.465440+0000 mgr.a (mgr.14373) 8919 : cluster [DBG] pgmap v6185: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:03:22.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:03:21 smithi157 bash[24585]: cluster 2024-09-16T09:03:20.466241+0000 mgr.a (mgr.14373) 8920 : cluster [DBG] pgmap v6186: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:03:22.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:03:21 smithi086 bash[24289]: cluster 2024-09-16T09:03:20.466241+0000 mgr.a (mgr.14373) 8920 : cluster [DBG] pgmap v6186: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:03:22.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:03:21 smithi047 bash[22744]: cluster 2024-09-16T09:03:20.466241+0000 mgr.a (mgr.14373) 8920 : cluster [DBG] pgmap v6186: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:03:22.603 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:03:22.604 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:03:22.604 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:03:23.376 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:03:23.377 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:03:23.377 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:03:23.377 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:03:23.377 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:03:24.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:03:23 smithi157 bash[24585]: cluster 2024-09-16T09:03:22.468269+0000 mgr.a (mgr.14373) 8921 : cluster [DBG] pgmap v6187: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:03:24.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:03:23 smithi157 bash[24585]: audit 2024-09-16T09:03:22.936186+0000 mgr.a (mgr.14373) 8922 : audit [DBG] from='client.198654 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:03:24.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:03:23 smithi086 bash[24289]: cluster 2024-09-16T09:03:22.468269+0000 mgr.a (mgr.14373) 8921 : cluster [DBG] pgmap v6187: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:03:24.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:03:23 smithi086 bash[24289]: audit 2024-09-16T09:03:22.936186+0000 mgr.a (mgr.14373) 8922 : audit [DBG] from='client.198654 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:03:24.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:03:23 smithi047 bash[22744]: cluster 2024-09-16T09:03:22.468269+0000 mgr.a (mgr.14373) 8921 : cluster [DBG] pgmap v6187: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:03:24.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:03:23 smithi047 bash[22744]: audit 2024-09-16T09:03:22.936186+0000 mgr.a (mgr.14373) 8922 : audit [DBG] from='client.198654 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:03:25.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:03:24 smithi157 bash[24585]: audit 2024-09-16T09:03:24.018391+0000 mon.b (mon.2) 834 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T09:03:25.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:03:24 smithi157 bash[24585]: audit 2024-09-16T09:03:24.633784+0000 mon.a (mon.0) 1097 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:03:25.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:03:24 smithi157 bash[24585]: audit 2024-09-16T09:03:24.640560+0000 mon.a (mon.0) 1098 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:03:25.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:03:24 smithi157 bash[24585]: audit 2024-09-16T09:03:24.644175+0000 mon.a (mon.0) 1099 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:03:25.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:03:24 smithi157 bash[24585]: audit 2024-09-16T09:03:24.649100+0000 mon.a (mon.0) 1100 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:03:25.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:03:24 smithi086 bash[24289]: audit 2024-09-16T09:03:24.018391+0000 mon.b (mon.2) 834 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T09:03:25.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:03:24 smithi086 bash[24289]: audit 2024-09-16T09:03:24.633784+0000 mon.a (mon.0) 1097 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:03:25.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:03:24 smithi086 bash[24289]: audit 2024-09-16T09:03:24.640560+0000 mon.a (mon.0) 1098 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:03:25.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:03:24 smithi086 bash[24289]: audit 2024-09-16T09:03:24.644175+0000 mon.a (mon.0) 1099 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:03:25.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:03:24 smithi086 bash[24289]: audit 2024-09-16T09:03:24.649100+0000 mon.a (mon.0) 1100 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:03:25.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:03:24 smithi047 bash[22744]: audit 2024-09-16T09:03:24.018391+0000 mon.b (mon.2) 834 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T09:03:25.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:03:24 smithi047 bash[22744]: audit 2024-09-16T09:03:24.633784+0000 mon.a (mon.0) 1097 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:03:25.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:03:24 smithi047 bash[22744]: audit 2024-09-16T09:03:24.640560+0000 mon.a (mon.0) 1098 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:03:25.340 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:03:24 smithi047 bash[22744]: audit 2024-09-16T09:03:24.644175+0000 mon.a (mon.0) 1099 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:03:25.340 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:03:24 smithi047 bash[22744]: audit 2024-09-16T09:03:24.649100+0000 mon.a (mon.0) 1100 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:03:26.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:03:25 smithi157 bash[24585]: cluster 2024-09-16T09:03:24.469109+0000 mgr.a (mgr.14373) 8923 : cluster [DBG] pgmap v6188: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:03:26.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:03:25 smithi157 bash[24585]: audit 2024-09-16T09:03:25.454579+0000 mon.b (mon.2) 835 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:03:26.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:03:25 smithi157 bash[24585]: audit 2024-09-16T09:03:25.456791+0000 mon.b (mon.2) 836 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T09:03:26.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:03:25 smithi157 bash[24585]: audit 2024-09-16T09:03:25.468411+0000 mon.a (mon.0) 1101 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:03:26.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:03:25 smithi157 bash[24585]: audit 2024-09-16T09:03:25.478394+0000 mon.b (mon.2) 837 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:03:26.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:03:25 smithi086 bash[24289]: cluster 2024-09-16T09:03:24.469109+0000 mgr.a (mgr.14373) 8923 : cluster [DBG] pgmap v6188: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:03:26.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:03:25 smithi086 bash[24289]: audit 2024-09-16T09:03:25.454579+0000 mon.b (mon.2) 835 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:03:26.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:03:25 smithi086 bash[24289]: audit 2024-09-16T09:03:25.456791+0000 mon.b (mon.2) 836 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T09:03:26.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:03:25 smithi086 bash[24289]: audit 2024-09-16T09:03:25.468411+0000 mon.a (mon.0) 1101 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:03:26.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:03:25 smithi086 bash[24289]: audit 2024-09-16T09:03:25.478394+0000 mon.b (mon.2) 837 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:03:26.339 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 09:03:26 smithi047 bash[22994]: debug 2024-09-16T09:03:26.202+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T09:03:26.339 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 09:03:26 smithi047 bash[22994]: debug 2024-09-16T09:03:26.202+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T09:03:26.340 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:03:25 smithi047 bash[22744]: cluster 2024-09-16T09:03:24.469109+0000 mgr.a (mgr.14373) 8923 : cluster [DBG] pgmap v6188: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:03:26.340 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:03:25 smithi047 bash[22744]: audit 2024-09-16T09:03:25.454579+0000 mon.b (mon.2) 835 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:03:26.340 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:03:25 smithi047 bash[22744]: audit 2024-09-16T09:03:25.456791+0000 mon.b (mon.2) 836 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T09:03:26.340 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:03:25 smithi047 bash[22744]: audit 2024-09-16T09:03:25.468411+0000 mon.a (mon.0) 1101 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:03:26.340 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:03:25 smithi047 bash[22744]: audit 2024-09-16T09:03:25.478394+0000 mon.b (mon.2) 837 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:03:27.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:03:26 smithi157 bash[24585]: audit 2024-09-16T09:03:25.481706+0000 mgr.a (mgr.14373) 8924 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:03:27.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:03:26 smithi086 bash[24289]: audit 2024-09-16T09:03:25.481706+0000 mgr.a (mgr.14373) 8924 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:03:27.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:03:26 smithi047 bash[22744]: audit 2024-09-16T09:03:25.481706+0000 mgr.a (mgr.14373) 8924 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:03:28.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:03:27 smithi157 bash[24585]: audit 2024-09-16T09:03:26.207185+0000 mgr.a (mgr.14373) 8925 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T09:03:28.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:03:27 smithi157 bash[24585]: cephadm 2024-09-16T09:03:26.209376+0000 mgr.a (mgr.14373) 8926 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T09:03:28.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:03:27 smithi157 bash[24585]: cluster 2024-09-16T09:03:26.470076+0000 mgr.a (mgr.14373) 8927 : cluster [DBG] pgmap v6189: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:03:28.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:03:27 smithi086 bash[24289]: audit 2024-09-16T09:03:26.207185+0000 mgr.a (mgr.14373) 8925 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T09:03:28.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:03:27 smithi086 bash[24289]: cephadm 2024-09-16T09:03:26.209376+0000 mgr.a (mgr.14373) 8926 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T09:03:28.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:03:27 smithi086 bash[24289]: cluster 2024-09-16T09:03:26.470076+0000 mgr.a (mgr.14373) 8927 : cluster [DBG] pgmap v6189: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:03:28.340 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:03:27 smithi047 bash[22744]: audit 2024-09-16T09:03:26.207185+0000 mgr.a (mgr.14373) 8925 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T09:03:28.340 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:03:27 smithi047 bash[22744]: cephadm 2024-09-16T09:03:26.209376+0000 mgr.a (mgr.14373) 8926 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T09:03:28.340 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:03:27 smithi047 bash[22744]: cluster 2024-09-16T09:03:26.470076+0000 mgr.a (mgr.14373) 8927 : cluster [DBG] pgmap v6189: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:03:28.378 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:03:28.379 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:03:28.379 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:03:29.127 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:03:29.127 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:03:29.128 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:03:29.128 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:03:29.128 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:03:30.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:03:29 smithi157 bash[24585]: cluster 2024-09-16T09:03:28.472259+0000 mgr.a (mgr.14373) 8928 : cluster [DBG] pgmap v6190: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:03:30.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:03:29 smithi157 bash[24585]: audit 2024-09-16T09:03:28.713508+0000 mgr.a (mgr.14373) 8929 : audit [DBG] from='client.198840 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:03:30.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:03:29 smithi086 bash[24289]: cluster 2024-09-16T09:03:28.472259+0000 mgr.a (mgr.14373) 8928 : cluster [DBG] pgmap v6190: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:03:30.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:03:29 smithi086 bash[24289]: audit 2024-09-16T09:03:28.713508+0000 mgr.a (mgr.14373) 8929 : audit [DBG] from='client.198840 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:03:30.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:03:29 smithi047 bash[22744]: cluster 2024-09-16T09:03:28.472259+0000 mgr.a (mgr.14373) 8928 : cluster [DBG] pgmap v6190: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:03:30.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:03:29 smithi047 bash[22744]: audit 2024-09-16T09:03:28.713508+0000 mgr.a (mgr.14373) 8929 : audit [DBG] from='client.198840 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:03:32.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:03:31 smithi157 bash[24585]: cluster 2024-09-16T09:03:30.473326+0000 mgr.a (mgr.14373) 8930 : cluster [DBG] pgmap v6191: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:03:32.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:03:31 smithi086 bash[24289]: cluster 2024-09-16T09:03:30.473326+0000 mgr.a (mgr.14373) 8930 : cluster [DBG] pgmap v6191: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:03:32.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:03:31 smithi047 bash[22744]: cluster 2024-09-16T09:03:30.473326+0000 mgr.a (mgr.14373) 8930 : cluster [DBG] pgmap v6191: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:03:34.129 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:03:34.130 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:03:34.130 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:03:34.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:03:33 smithi157 bash[24585]: cluster 2024-09-16T09:03:32.475709+0000 mgr.a (mgr.14373) 8931 : cluster [DBG] pgmap v6192: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:03:34.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:03:33 smithi086 bash[24289]: cluster 2024-09-16T09:03:32.475709+0000 mgr.a (mgr.14373) 8931 : cluster [DBG] pgmap v6192: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:03:34.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:03:33 smithi047 bash[22744]: cluster 2024-09-16T09:03:32.475709+0000 mgr.a (mgr.14373) 8931 : cluster [DBG] pgmap v6192: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:03:34.897 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:03:34.898 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:03:34.898 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:03:34.898 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:03:34.898 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:03:36.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:03:35 smithi157 bash[24585]: audit 2024-09-16T09:03:34.464635+0000 mgr.a (mgr.14373) 8932 : audit [DBG] from='client.198918 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:03:36.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:03:35 smithi157 bash[24585]: cluster 2024-09-16T09:03:34.484182+0000 mgr.a (mgr.14373) 8933 : cluster [DBG] pgmap v6193: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:03:36.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:03:35 smithi086 bash[24289]: audit 2024-09-16T09:03:34.464635+0000 mgr.a (mgr.14373) 8932 : audit [DBG] from='client.198918 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:03:36.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:03:35 smithi086 bash[24289]: cluster 2024-09-16T09:03:34.484182+0000 mgr.a (mgr.14373) 8933 : cluster [DBG] pgmap v6193: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:03:36.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:03:35 smithi047 bash[22744]: audit 2024-09-16T09:03:34.464635+0000 mgr.a (mgr.14373) 8932 : audit [DBG] from='client.198918 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:03:36.340 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:03:35 smithi047 bash[22744]: cluster 2024-09-16T09:03:34.484182+0000 mgr.a (mgr.14373) 8933 : cluster [DBG] pgmap v6193: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:03:38.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:03:38 smithi157 bash[24585]: cluster 2024-09-16T09:03:36.485227+0000 mgr.a (mgr.14373) 8934 : cluster [DBG] pgmap v6194: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:03:38.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:03:38 smithi086 bash[24289]: cluster 2024-09-16T09:03:36.485227+0000 mgr.a (mgr.14373) 8934 : cluster [DBG] pgmap v6194: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:03:38.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:03:38 smithi047 bash[22744]: cluster 2024-09-16T09:03:36.485227+0000 mgr.a (mgr.14373) 8934 : cluster [DBG] pgmap v6194: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:03:39.899 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:03:39.900 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:03:39.900 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:03:40.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:03:40 smithi157 bash[24585]: cluster 2024-09-16T09:03:38.487497+0000 mgr.a (mgr.14373) 8935 : cluster [DBG] pgmap v6195: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:03:40.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:03:40 smithi086 bash[24289]: cluster 2024-09-16T09:03:38.487497+0000 mgr.a (mgr.14373) 8935 : cluster [DBG] pgmap v6195: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:03:40.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:03:40 smithi047 bash[22744]: cluster 2024-09-16T09:03:38.487497+0000 mgr.a (mgr.14373) 8935 : cluster [DBG] pgmap v6195: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:03:40.656 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:03:40.656 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:03:40.656 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:03:40.656 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:03:40.657 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:03:42.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:03:42 smithi157 bash[24585]: audit 2024-09-16T09:03:40.233106+0000 mgr.a (mgr.14373) 8936 : audit [DBG] from='client.198996 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:03:42.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:03:42 smithi157 bash[24585]: cluster 2024-09-16T09:03:40.488277+0000 mgr.a (mgr.14373) 8937 : cluster [DBG] pgmap v6196: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:03:42.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:03:42 smithi086 bash[24289]: audit 2024-09-16T09:03:40.233106+0000 mgr.a (mgr.14373) 8936 : audit [DBG] from='client.198996 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:03:42.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:03:42 smithi086 bash[24289]: cluster 2024-09-16T09:03:40.488277+0000 mgr.a (mgr.14373) 8937 : cluster [DBG] pgmap v6196: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:03:42.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:03:42 smithi047 bash[22744]: audit 2024-09-16T09:03:40.233106+0000 mgr.a (mgr.14373) 8936 : audit [DBG] from='client.198996 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:03:42.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:03:42 smithi047 bash[22744]: cluster 2024-09-16T09:03:40.488277+0000 mgr.a (mgr.14373) 8937 : cluster [DBG] pgmap v6196: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:03:44.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:03:44 smithi157 bash[24585]: cluster 2024-09-16T09:03:42.490671+0000 mgr.a (mgr.14373) 8938 : cluster [DBG] pgmap v6197: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:03:44.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:03:44 smithi086 bash[24289]: cluster 2024-09-16T09:03:42.490671+0000 mgr.a (mgr.14373) 8938 : cluster [DBG] pgmap v6197: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:03:44.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:03:44 smithi047 bash[22744]: cluster 2024-09-16T09:03:42.490671+0000 mgr.a (mgr.14373) 8938 : cluster [DBG] pgmap v6197: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:03:45.657 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:03:45.658 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:03:45.658 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:03:46.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:03:46 smithi157 bash[24585]: cluster 2024-09-16T09:03:44.491445+0000 mgr.a (mgr.14373) 8939 : cluster [DBG] pgmap v6198: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:03:46.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:03:46 smithi086 bash[24289]: cluster 2024-09-16T09:03:44.491445+0000 mgr.a (mgr.14373) 8939 : cluster [DBG] pgmap v6198: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:03:46.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:03:46 smithi047 bash[22744]: cluster 2024-09-16T09:03:44.491445+0000 mgr.a (mgr.14373) 8939 : cluster [DBG] pgmap v6198: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:03:46.417 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:03:46.417 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:03:46.417 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:03:46.417 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:03:46.418 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:03:47.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:03:47 smithi157 bash[24585]: audit 2024-09-16T09:03:45.987426+0000 mgr.a (mgr.14373) 8940 : audit [DBG] from='client.199071 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:03:47.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:03:47 smithi086 bash[24289]: audit 2024-09-16T09:03:45.987426+0000 mgr.a (mgr.14373) 8940 : audit [DBG] from='client.199071 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:03:47.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:03:47 smithi047 bash[22744]: audit 2024-09-16T09:03:45.987426+0000 mgr.a (mgr.14373) 8940 : audit [DBG] from='client.199071 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:03:48.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:03:48 smithi157 bash[24585]: cluster 2024-09-16T09:03:46.492060+0000 mgr.a (mgr.14373) 8941 : cluster [DBG] pgmap v6199: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:03:48.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:03:48 smithi086 bash[24289]: cluster 2024-09-16T09:03:46.492060+0000 mgr.a (mgr.14373) 8941 : cluster [DBG] pgmap v6199: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:03:48.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:03:48 smithi047 bash[22744]: cluster 2024-09-16T09:03:46.492060+0000 mgr.a (mgr.14373) 8941 : cluster [DBG] pgmap v6199: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:03:50.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:03:50 smithi157 bash[24585]: cluster 2024-09-16T09:03:48.494261+0000 mgr.a (mgr.14373) 8942 : cluster [DBG] pgmap v6200: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:03:50.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:03:50 smithi086 bash[24289]: cluster 2024-09-16T09:03:48.494261+0000 mgr.a (mgr.14373) 8942 : cluster [DBG] pgmap v6200: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:03:50.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:03:50 smithi047 bash[22744]: cluster 2024-09-16T09:03:48.494261+0000 mgr.a (mgr.14373) 8942 : cluster [DBG] pgmap v6200: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:03:51.419 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:03:51.420 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:03:51.420 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:03:52.176 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:03:52.176 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:03:52.176 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:03:52.176 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:03:52.176 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:03:52.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:03:52 smithi157 bash[24585]: cluster 2024-09-16T09:03:50.495046+0000 mgr.a (mgr.14373) 8943 : cluster [DBG] pgmap v6201: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:03:52.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:03:52 smithi086 bash[24289]: cluster 2024-09-16T09:03:50.495046+0000 mgr.a (mgr.14373) 8943 : cluster [DBG] pgmap v6201: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:03:52.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:03:52 smithi047 bash[22744]: cluster 2024-09-16T09:03:50.495046+0000 mgr.a (mgr.14373) 8943 : cluster [DBG] pgmap v6201: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:03:53.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:03:53 smithi157 bash[24585]: audit 2024-09-16T09:03:51.749915+0000 mgr.a (mgr.14373) 8944 : audit [DBG] from='client.199146 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:03:53.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:03:53 smithi086 bash[24289]: audit 2024-09-16T09:03:51.749915+0000 mgr.a (mgr.14373) 8944 : audit [DBG] from='client.199146 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:03:53.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:03:53 smithi047 bash[22744]: audit 2024-09-16T09:03:51.749915+0000 mgr.a (mgr.14373) 8944 : audit [DBG] from='client.199146 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:03:54.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:03:54 smithi086 bash[24289]: cluster 2024-09-16T09:03:52.497683+0000 mgr.a (mgr.14373) 8945 : cluster [DBG] pgmap v6202: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:03:54.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:03:54 smithi047 bash[22744]: cluster 2024-09-16T09:03:52.497683+0000 mgr.a (mgr.14373) 8945 : cluster [DBG] pgmap v6202: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:03:54.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:03:54 smithi157 bash[24585]: cluster 2024-09-16T09:03:52.497683+0000 mgr.a (mgr.14373) 8945 : cluster [DBG] pgmap v6202: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:03:56.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:03:56 smithi086 bash[24289]: cluster 2024-09-16T09:03:54.498489+0000 mgr.a (mgr.14373) 8946 : cluster [DBG] pgmap v6203: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:03:56.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:03:56 smithi047 bash[22744]: cluster 2024-09-16T09:03:54.498489+0000 mgr.a (mgr.14373) 8946 : cluster [DBG] pgmap v6203: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:03:56.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:03:56 smithi157 bash[24585]: cluster 2024-09-16T09:03:54.498489+0000 mgr.a (mgr.14373) 8946 : cluster [DBG] pgmap v6203: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:03:57.177 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:03:57.178 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:03:57.178 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:03:57.923 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:03:57.924 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:03:57.924 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:03:57.924 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:03:57.924 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:03:58.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:03:58 smithi086 bash[24289]: cluster 2024-09-16T09:03:56.499268+0000 mgr.a (mgr.14373) 8947 : cluster [DBG] pgmap v6204: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T09:03:58.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:03:58 smithi047 bash[22744]: cluster 2024-09-16T09:03:56.499268+0000 mgr.a (mgr.14373) 8947 : cluster [DBG] pgmap v6204: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T09:03:58.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:03:58 smithi157 bash[24585]: cluster 2024-09-16T09:03:56.499268+0000 mgr.a (mgr.14373) 8947 : cluster [DBG] pgmap v6204: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T09:03:59.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:03:59 smithi047 bash[22744]: audit 2024-09-16T09:03:57.513660+0000 mgr.a (mgr.14373) 8948 : audit [DBG] from='client.199224 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:03:59.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:03:59 smithi157 bash[24585]: audit 2024-09-16T09:03:57.513660+0000 mgr.a (mgr.14373) 8948 : audit [DBG] from='client.199224 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:03:59.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:03:59 smithi086 bash[24289]: audit 2024-09-16T09:03:57.513660+0000 mgr.a (mgr.14373) 8948 : audit [DBG] from='client.199224 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:04:00.340 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:04:00 smithi047 bash[22744]: cluster 2024-09-16T09:03:58.502056+0000 mgr.a (mgr.14373) 8949 : cluster [DBG] pgmap v6205: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:04:00.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:04:00 smithi157 bash[24585]: cluster 2024-09-16T09:03:58.502056+0000 mgr.a (mgr.14373) 8949 : cluster [DBG] pgmap v6205: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:04:00.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:04:00 smithi086 bash[24289]: cluster 2024-09-16T09:03:58.502056+0000 mgr.a (mgr.14373) 8949 : cluster [DBG] pgmap v6205: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:04:02.339 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:04:02 smithi047 bash[22744]: cluster 2024-09-16T09:04:00.502906+0000 mgr.a (mgr.14373) 8950 : cluster [DBG] pgmap v6206: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:04:02.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:04:02 smithi157 bash[24585]: cluster 2024-09-16T09:04:00.502906+0000 mgr.a (mgr.14373) 8950 : cluster [DBG] pgmap v6206: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:04:02.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:04:02 smithi086 bash[24289]: cluster 2024-09-16T09:04:00.502906+0000 mgr.a (mgr.14373) 8950 : cluster [DBG] pgmap v6206: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:04:02.925 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:04:02.926 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:04:02.926 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:04:03.707 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:04:03.708 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:04:03.708 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:04:03.708 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:04:03.708 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:04:04.340 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:04:04 smithi047 bash[22744]: cluster 2024-09-16T09:04:02.504958+0000 mgr.a (mgr.14373) 8951 : cluster [DBG] pgmap v6207: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:04:04.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:04:04 smithi157 bash[24585]: cluster 2024-09-16T09:04:02.504958+0000 mgr.a (mgr.14373) 8951 : cluster [DBG] pgmap v6207: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:04:04.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:04:04 smithi086 bash[24289]: cluster 2024-09-16T09:04:02.504958+0000 mgr.a (mgr.14373) 8951 : cluster [DBG] pgmap v6207: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:04:05.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:04:05 smithi157 bash[24585]: audit 2024-09-16T09:04:03.264435+0000 mgr.a (mgr.14373) 8952 : audit [DBG] from='client.199296 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:04:05.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:04:05 smithi086 bash[24289]: audit 2024-09-16T09:04:03.264435+0000 mgr.a (mgr.14373) 8952 : audit [DBG] from='client.199296 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:04:05.590 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:04:05 smithi047 bash[22744]: audit 2024-09-16T09:04:03.264435+0000 mgr.a (mgr.14373) 8952 : audit [DBG] from='client.199296 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:04:06.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:04:06 smithi157 bash[24585]: cluster 2024-09-16T09:04:04.505893+0000 mgr.a (mgr.14373) 8953 : cluster [DBG] pgmap v6208: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:04:06.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:04:06 smithi086 bash[24289]: cluster 2024-09-16T09:04:04.505893+0000 mgr.a (mgr.14373) 8953 : cluster [DBG] pgmap v6208: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:04:06.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:04:06 smithi047 bash[22744]: cluster 2024-09-16T09:04:04.505893+0000 mgr.a (mgr.14373) 8953 : cluster [DBG] pgmap v6208: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:04:08.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:04:08 smithi157 bash[24585]: cluster 2024-09-16T09:04:06.507339+0000 mgr.a (mgr.14373) 8954 : cluster [DBG] pgmap v6209: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-16T09:04:08.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:04:08 smithi086 bash[24289]: cluster 2024-09-16T09:04:06.507339+0000 mgr.a (mgr.14373) 8954 : cluster [DBG] pgmap v6209: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-16T09:04:08.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:04:08 smithi047 bash[22744]: cluster 2024-09-16T09:04:06.507339+0000 mgr.a (mgr.14373) 8954 : cluster [DBG] pgmap v6209: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-16T09:04:08.709 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:04:08.709 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:04:08.709 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:04:09.491 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:04:09.492 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:04:09.492 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:04:09.492 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:04:09.492 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:04:10.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:04:10 smithi157 bash[24585]: cluster 2024-09-16T09:04:08.509027+0000 mgr.a (mgr.14373) 8955 : cluster [DBG] pgmap v6210: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:04:10.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:04:10 smithi157 bash[24585]: audit 2024-09-16T09:04:09.048347+0000 mgr.a (mgr.14373) 8956 : audit [DBG] from='client.199374 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:04:10.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:04:10 smithi086 bash[24289]: cluster 2024-09-16T09:04:08.509027+0000 mgr.a (mgr.14373) 8955 : cluster [DBG] pgmap v6210: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:04:10.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:04:10 smithi086 bash[24289]: audit 2024-09-16T09:04:09.048347+0000 mgr.a (mgr.14373) 8956 : audit [DBG] from='client.199374 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:04:10.590 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:04:10 smithi047 bash[22744]: cluster 2024-09-16T09:04:08.509027+0000 mgr.a (mgr.14373) 8955 : cluster [DBG] pgmap v6210: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:04:10.590 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:04:10 smithi047 bash[22744]: audit 2024-09-16T09:04:09.048347+0000 mgr.a (mgr.14373) 8956 : audit [DBG] from='client.199374 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:04:12.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:04:12 smithi157 bash[24585]: cluster 2024-09-16T09:04:10.509998+0000 mgr.a (mgr.14373) 8957 : cluster [DBG] pgmap v6211: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:04:12.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:04:12 smithi086 bash[24289]: cluster 2024-09-16T09:04:10.509998+0000 mgr.a (mgr.14373) 8957 : cluster [DBG] pgmap v6211: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:04:12.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:04:12 smithi047 bash[22744]: cluster 2024-09-16T09:04:10.509998+0000 mgr.a (mgr.14373) 8957 : cluster [DBG] pgmap v6211: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:04:14.493 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:04:14.494 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:04:14.494 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:04:14.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:04:14 smithi157 bash[24585]: cluster 2024-09-16T09:04:12.512397+0000 mgr.a (mgr.14373) 8958 : cluster [DBG] pgmap v6212: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:04:14.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:04:14 smithi086 bash[24289]: cluster 2024-09-16T09:04:12.512397+0000 mgr.a (mgr.14373) 8958 : cluster [DBG] pgmap v6212: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:04:14.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:04:14 smithi047 bash[22744]: cluster 2024-09-16T09:04:12.512397+0000 mgr.a (mgr.14373) 8958 : cluster [DBG] pgmap v6212: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:04:15.272 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:04:15.272 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:04:15.272 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:04:15.272 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:04:15.273 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:04:16.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:04:16 smithi157 bash[24585]: cluster 2024-09-16T09:04:14.513346+0000 mgr.a (mgr.14373) 8959 : cluster [DBG] pgmap v6213: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:04:16.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:04:16 smithi157 bash[24585]: audit 2024-09-16T09:04:14.830696+0000 mgr.a (mgr.14373) 8960 : audit [DBG] from='client.199452 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:04:16.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:04:16 smithi086 bash[24289]: cluster 2024-09-16T09:04:14.513346+0000 mgr.a (mgr.14373) 8959 : cluster [DBG] pgmap v6213: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:04:16.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:04:16 smithi086 bash[24289]: audit 2024-09-16T09:04:14.830696+0000 mgr.a (mgr.14373) 8960 : audit [DBG] from='client.199452 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:04:16.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:04:16 smithi047 bash[22744]: cluster 2024-09-16T09:04:14.513346+0000 mgr.a (mgr.14373) 8959 : cluster [DBG] pgmap v6213: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:04:16.590 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:04:16 smithi047 bash[22744]: audit 2024-09-16T09:04:14.830696+0000 mgr.a (mgr.14373) 8960 : audit [DBG] from='client.199452 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:04:18.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:04:18 smithi157 bash[24585]: cluster 2024-09-16T09:04:16.514914+0000 mgr.a (mgr.14373) 8961 : cluster [DBG] pgmap v6214: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-16T09:04:18.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:04:18 smithi086 bash[24289]: cluster 2024-09-16T09:04:16.514914+0000 mgr.a (mgr.14373) 8961 : cluster [DBG] pgmap v6214: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-16T09:04:18.590 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:04:18 smithi047 bash[22744]: cluster 2024-09-16T09:04:16.514914+0000 mgr.a (mgr.14373) 8961 : cluster [DBG] pgmap v6214: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-16T09:04:20.274 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:04:20.274 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:04:20.274 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:04:20.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:04:20 smithi157 bash[24585]: cluster 2024-09-16T09:04:18.516571+0000 mgr.a (mgr.14373) 8962 : cluster [DBG] pgmap v6215: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:04:20.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:04:20 smithi086 bash[24289]: cluster 2024-09-16T09:04:18.516571+0000 mgr.a (mgr.14373) 8962 : cluster [DBG] pgmap v6215: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:04:20.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:04:20 smithi047 bash[22744]: cluster 2024-09-16T09:04:18.516571+0000 mgr.a (mgr.14373) 8962 : cluster [DBG] pgmap v6215: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:04:21.060 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:04:21.060 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:04:21.061 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:04:21.061 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:04:21.061 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:04:21.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:04:21 smithi157 bash[24585]: cluster 2024-09-16T09:04:20.517304+0000 mgr.a (mgr.14373) 8963 : cluster [DBG] pgmap v6216: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:04:21.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:04:21 smithi157 bash[24585]: audit 2024-09-16T09:04:20.610926+0000 mgr.a (mgr.14373) 8964 : audit [DBG] from='client.199521 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:04:21.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:04:21 smithi086 bash[24289]: cluster 2024-09-16T09:04:20.517304+0000 mgr.a (mgr.14373) 8963 : cluster [DBG] pgmap v6216: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:04:21.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:04:21 smithi086 bash[24289]: audit 2024-09-16T09:04:20.610926+0000 mgr.a (mgr.14373) 8964 : audit [DBG] from='client.199521 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:04:21.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:04:21 smithi047 bash[22744]: cluster 2024-09-16T09:04:20.517304+0000 mgr.a (mgr.14373) 8963 : cluster [DBG] pgmap v6216: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:04:21.590 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:04:21 smithi047 bash[22744]: audit 2024-09-16T09:04:20.610926+0000 mgr.a (mgr.14373) 8964 : audit [DBG] from='client.199521 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:04:23.840 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:04:23 smithi047 bash[22744]: cluster 2024-09-16T09:04:22.519687+0000 mgr.a (mgr.14373) 8965 : cluster [DBG] pgmap v6217: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:04:24.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:04:23 smithi157 bash[24585]: cluster 2024-09-16T09:04:22.519687+0000 mgr.a (mgr.14373) 8965 : cluster [DBG] pgmap v6217: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:04:24.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:04:23 smithi086 bash[24289]: cluster 2024-09-16T09:04:22.519687+0000 mgr.a (mgr.14373) 8965 : cluster [DBG] pgmap v6217: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:04:25.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:04:25 smithi157 bash[24585]: cluster 2024-09-16T09:04:24.520503+0000 mgr.a (mgr.14373) 8966 : cluster [DBG] pgmap v6218: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:04:25.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:04:25 smithi086 bash[24289]: cluster 2024-09-16T09:04:24.520503+0000 mgr.a (mgr.14373) 8966 : cluster [DBG] pgmap v6218: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:04:25.590 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:04:25 smithi047 bash[22744]: cluster 2024-09-16T09:04:24.520503+0000 mgr.a (mgr.14373) 8966 : cluster [DBG] pgmap v6218: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:04:26.062 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:04:26.063 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:04:26.063 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:04:26.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:04:26 smithi086 bash[24289]: audit 2024-09-16T09:04:26.264528+0000 mon.b (mon.2) 838 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T09:04:26.589 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:04:26 smithi047 bash[22744]: audit 2024-09-16T09:04:26.264528+0000 mon.b (mon.2) 838 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T09:04:26.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:04:26 smithi157 bash[24585]: audit 2024-09-16T09:04:26.264528+0000 mon.b (mon.2) 838 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T09:04:26.803 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:04:26.804 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:04:26.804 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:04:26.804 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:04:26.804 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:04:27.590 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:04:27 smithi047 bash[22744]: audit 2024-09-16T09:04:26.398251+0000 mgr.a (mgr.14373) 8967 : audit [DBG] from='client.199596 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:04:27.590 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:04:27 smithi047 bash[22744]: cluster 2024-09-16T09:04:26.521775+0000 mgr.a (mgr.14373) 8968 : cluster [DBG] pgmap v6219: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:04:27.590 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:04:27 smithi047 bash[22744]: audit 2024-09-16T09:04:27.066676+0000 mon.b (mon.2) 839 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:04:27.590 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:04:27 smithi047 bash[22744]: audit 2024-09-16T09:04:27.069165+0000 mon.b (mon.2) 840 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T09:04:27.590 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:04:27 smithi047 bash[22744]: audit 2024-09-16T09:04:27.080994+0000 mon.a (mon.0) 1102 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:04:27.590 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:04:27 smithi047 bash[22744]: audit 2024-09-16T09:04:27.085772+0000 mon.b (mon.2) 841 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:04:27.590 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:04:27 smithi047 bash[22744]: audit 2024-09-16T09:04:27.089017+0000 mgr.a (mgr.14373) 8969 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:04:27.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:04:27 smithi157 bash[24585]: audit 2024-09-16T09:04:26.398251+0000 mgr.a (mgr.14373) 8967 : audit [DBG] from='client.199596 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:04:27.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:04:27 smithi157 bash[24585]: cluster 2024-09-16T09:04:26.521775+0000 mgr.a (mgr.14373) 8968 : cluster [DBG] pgmap v6219: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:04:27.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:04:27 smithi157 bash[24585]: audit 2024-09-16T09:04:27.066676+0000 mon.b (mon.2) 839 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:04:27.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:04:27 smithi157 bash[24585]: audit 2024-09-16T09:04:27.069165+0000 mon.b (mon.2) 840 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T09:04:27.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:04:27 smithi157 bash[24585]: audit 2024-09-16T09:04:27.080994+0000 mon.a (mon.0) 1102 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:04:27.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:04:27 smithi157 bash[24585]: audit 2024-09-16T09:04:27.085772+0000 mon.b (mon.2) 841 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:04:27.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:04:27 smithi157 bash[24585]: audit 2024-09-16T09:04:27.089017+0000 mgr.a (mgr.14373) 8969 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:04:27.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:04:27 smithi086 bash[24289]: audit 2024-09-16T09:04:26.398251+0000 mgr.a (mgr.14373) 8967 : audit [DBG] from='client.199596 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:04:27.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:04:27 smithi086 bash[24289]: cluster 2024-09-16T09:04:26.521775+0000 mgr.a (mgr.14373) 8968 : cluster [DBG] pgmap v6219: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:04:27.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:04:27 smithi086 bash[24289]: audit 2024-09-16T09:04:27.066676+0000 mon.b (mon.2) 839 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:04:27.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:04:27 smithi086 bash[24289]: audit 2024-09-16T09:04:27.069165+0000 mon.b (mon.2) 840 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T09:04:27.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:04:27 smithi086 bash[24289]: audit 2024-09-16T09:04:27.080994+0000 mon.a (mon.0) 1102 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:04:27.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:04:27 smithi086 bash[24289]: audit 2024-09-16T09:04:27.085772+0000 mon.b (mon.2) 841 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:04:27.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:04:27 smithi086 bash[24289]: audit 2024-09-16T09:04:27.089017+0000 mgr.a (mgr.14373) 8969 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:04:28.090 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 09:04:27 smithi047 bash[22994]: debug 2024-09-16T09:04:27.793+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T09:04:28.090 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 09:04:27 smithi047 bash[22994]: debug 2024-09-16T09:04:27.797+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T09:04:28.590 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:04:28 smithi047 bash[22744]: audit 2024-09-16T09:04:27.797859+0000 mgr.a (mgr.14373) 8970 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T09:04:28.590 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:04:28 smithi047 bash[22744]: cephadm 2024-09-16T09:04:27.799599+0000 mgr.a (mgr.14373) 8971 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T09:04:28.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:04:28 smithi157 bash[24585]: audit 2024-09-16T09:04:27.797859+0000 mgr.a (mgr.14373) 8970 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T09:04:28.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:04:28 smithi157 bash[24585]: cephadm 2024-09-16T09:04:27.799599+0000 mgr.a (mgr.14373) 8971 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T09:04:28.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:04:28 smithi086 bash[24289]: audit 2024-09-16T09:04:27.797859+0000 mgr.a (mgr.14373) 8970 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T09:04:28.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:04:28 smithi086 bash[24289]: cephadm 2024-09-16T09:04:27.799599+0000 mgr.a (mgr.14373) 8971 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T09:04:29.590 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:04:29 smithi047 bash[22744]: cluster 2024-09-16T09:04:28.523766+0000 mgr.a (mgr.14373) 8972 : cluster [DBG] pgmap v6220: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-16T09:04:29.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:04:29 smithi157 bash[24585]: cluster 2024-09-16T09:04:28.523766+0000 mgr.a (mgr.14373) 8972 : cluster [DBG] pgmap v6220: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-16T09:04:29.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:04:29 smithi086 bash[24289]: cluster 2024-09-16T09:04:28.523766+0000 mgr.a (mgr.14373) 8972 : cluster [DBG] pgmap v6220: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-16T09:04:31.809 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:04:31.809 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:04:31.809 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:04:31.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:04:31 smithi047 bash[22744]: cluster 2024-09-16T09:04:30.524714+0000 mgr.a (mgr.14373) 8973 : cluster [DBG] pgmap v6221: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:04:32.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:04:31 smithi157 bash[24585]: cluster 2024-09-16T09:04:30.524714+0000 mgr.a (mgr.14373) 8973 : cluster [DBG] pgmap v6221: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:04:32.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:04:31 smithi086 bash[24289]: cluster 2024-09-16T09:04:30.524714+0000 mgr.a (mgr.14373) 8973 : cluster [DBG] pgmap v6221: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:04:32.595 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:04:32.595 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:04:32.595 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:04:32.595 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:04:32.596 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:04:33.840 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:04:33 smithi047 bash[22744]: audit 2024-09-16T09:04:32.147784+0000 mgr.a (mgr.14373) 8974 : audit [DBG] from='client.199779 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:04:33.840 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:04:33 smithi047 bash[22744]: cluster 2024-09-16T09:04:32.526120+0000 mgr.a (mgr.14373) 8975 : cluster [DBG] pgmap v6222: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:04:34.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:04:33 smithi157 bash[24585]: audit 2024-09-16T09:04:32.147784+0000 mgr.a (mgr.14373) 8974 : audit [DBG] from='client.199779 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:04:34.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:04:33 smithi157 bash[24585]: cluster 2024-09-16T09:04:32.526120+0000 mgr.a (mgr.14373) 8975 : cluster [DBG] pgmap v6222: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:04:34.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:04:33 smithi086 bash[24289]: audit 2024-09-16T09:04:32.147784+0000 mgr.a (mgr.14373) 8974 : audit [DBG] from='client.199779 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:04:34.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:04:33 smithi086 bash[24289]: cluster 2024-09-16T09:04:32.526120+0000 mgr.a (mgr.14373) 8975 : cluster [DBG] pgmap v6222: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:04:35.840 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:04:35 smithi047 bash[22744]: cluster 2024-09-16T09:04:34.526905+0000 mgr.a (mgr.14373) 8976 : cluster [DBG] pgmap v6223: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T09:04:36.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:04:35 smithi157 bash[24585]: cluster 2024-09-16T09:04:34.526905+0000 mgr.a (mgr.14373) 8976 : cluster [DBG] pgmap v6223: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T09:04:36.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:04:35 smithi086 bash[24289]: cluster 2024-09-16T09:04:34.526905+0000 mgr.a (mgr.14373) 8976 : cluster [DBG] pgmap v6223: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T09:04:37.597 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:04:37.597 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:04:37.598 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:04:38.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:04:37 smithi157 bash[24585]: cluster 2024-09-16T09:04:36.528600+0000 mgr.a (mgr.14373) 8977 : cluster [DBG] pgmap v6224: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 6.4 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T09:04:38.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:04:37 smithi086 bash[24289]: cluster 2024-09-16T09:04:36.528600+0000 mgr.a (mgr.14373) 8977 : cluster [DBG] pgmap v6224: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 6.4 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T09:04:38.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:04:37 smithi047 bash[22744]: cluster 2024-09-16T09:04:36.528600+0000 mgr.a (mgr.14373) 8977 : cluster [DBG] pgmap v6224: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 6.4 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T09:04:38.348 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:04:38.348 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:04:38.348 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:04:38.348 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:04:38.348 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:04:39.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:04:38 smithi157 bash[24585]: audit 2024-09-16T09:04:37.928459+0000 mgr.a (mgr.14373) 8978 : audit [DBG] from='client.199857 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:04:39.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:04:38 smithi086 bash[24289]: audit 2024-09-16T09:04:37.928459+0000 mgr.a (mgr.14373) 8978 : audit [DBG] from='client.199857 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:04:39.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:04:38 smithi047 bash[22744]: audit 2024-09-16T09:04:37.928459+0000 mgr.a (mgr.14373) 8978 : audit [DBG] from='client.199857 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:04:40.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:04:39 smithi157 bash[24585]: cluster 2024-09-16T09:04:38.530538+0000 mgr.a (mgr.14373) 8979 : cluster [DBG] pgmap v6225: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:04:40.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:04:39 smithi086 bash[24289]: cluster 2024-09-16T09:04:38.530538+0000 mgr.a (mgr.14373) 8979 : cluster [DBG] pgmap v6225: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:04:40.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:04:39 smithi047 bash[22744]: cluster 2024-09-16T09:04:38.530538+0000 mgr.a (mgr.14373) 8979 : cluster [DBG] pgmap v6225: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:04:42.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:04:41 smithi157 bash[24585]: cluster 2024-09-16T09:04:40.531313+0000 mgr.a (mgr.14373) 8980 : cluster [DBG] pgmap v6226: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:04:42.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:04:41 smithi086 bash[24289]: cluster 2024-09-16T09:04:40.531313+0000 mgr.a (mgr.14373) 8980 : cluster [DBG] pgmap v6226: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:04:42.090 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:04:41 smithi047 bash[22744]: cluster 2024-09-16T09:04:40.531313+0000 mgr.a (mgr.14373) 8980 : cluster [DBG] pgmap v6226: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:04:43.349 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:04:43.350 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:04:43.350 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:04:44.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:04:43 smithi157 bash[24585]: cluster 2024-09-16T09:04:42.533391+0000 mgr.a (mgr.14373) 8981 : cluster [DBG] pgmap v6227: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:04:44.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:04:43 smithi086 bash[24289]: cluster 2024-09-16T09:04:42.533391+0000 mgr.a (mgr.14373) 8981 : cluster [DBG] pgmap v6227: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:04:44.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:04:43 smithi047 bash[22744]: cluster 2024-09-16T09:04:42.533391+0000 mgr.a (mgr.14373) 8981 : cluster [DBG] pgmap v6227: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:04:44.148 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:04:44.148 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:04:44.148 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:04:44.148 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:04:44.148 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:04:45.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:04:44 smithi157 bash[24585]: audit 2024-09-16T09:04:43.686600+0000 mgr.a (mgr.14373) 8982 : audit [DBG] from='client.199935 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:04:45.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:04:44 smithi086 bash[24289]: audit 2024-09-16T09:04:43.686600+0000 mgr.a (mgr.14373) 8982 : audit [DBG] from='client.199935 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:04:45.090 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:04:44 smithi047 bash[22744]: audit 2024-09-16T09:04:43.686600+0000 mgr.a (mgr.14373) 8982 : audit [DBG] from='client.199935 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:04:46.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:04:45 smithi157 bash[24585]: cluster 2024-09-16T09:04:44.534303+0000 mgr.a (mgr.14373) 8983 : cluster [DBG] pgmap v6228: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:04:46.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:04:45 smithi086 bash[24289]: cluster 2024-09-16T09:04:44.534303+0000 mgr.a (mgr.14373) 8983 : cluster [DBG] pgmap v6228: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:04:46.090 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:04:45 smithi047 bash[22744]: cluster 2024-09-16T09:04:44.534303+0000 mgr.a (mgr.14373) 8983 : cluster [DBG] pgmap v6228: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:04:48.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:04:47 smithi157 bash[24585]: cluster 2024-09-16T09:04:46.536457+0000 mgr.a (mgr.14373) 8984 : cluster [DBG] pgmap v6229: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:04:48.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:04:47 smithi086 bash[24289]: cluster 2024-09-16T09:04:46.536457+0000 mgr.a (mgr.14373) 8984 : cluster [DBG] pgmap v6229: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:04:48.090 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:04:47 smithi047 bash[22744]: cluster 2024-09-16T09:04:46.536457+0000 mgr.a (mgr.14373) 8984 : cluster [DBG] pgmap v6229: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:04:49.150 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:04:49.150 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:04:49.150 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:04:49.931 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:04:49.931 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:04:49.931 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:04:49.931 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:04:49.931 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:04:50.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:04:49 smithi157 bash[24585]: cluster 2024-09-16T09:04:48.537195+0000 mgr.a (mgr.14373) 8985 : cluster [DBG] pgmap v6230: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.4 KiB/s rd, 2 op/s 2024-09-16T09:04:50.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:04:49 smithi086 bash[24289]: cluster 2024-09-16T09:04:48.537195+0000 mgr.a (mgr.14373) 8985 : cluster [DBG] pgmap v6230: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.4 KiB/s rd, 2 op/s 2024-09-16T09:04:50.090 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:04:49 smithi047 bash[22744]: cluster 2024-09-16T09:04:48.537195+0000 mgr.a (mgr.14373) 8985 : cluster [DBG] pgmap v6230: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.4 KiB/s rd, 2 op/s 2024-09-16T09:04:51.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:04:50 smithi157 bash[24585]: audit 2024-09-16T09:04:49.486669+0000 mgr.a (mgr.14373) 8986 : audit [DBG] from='client.200013 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:04:51.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:04:50 smithi086 bash[24289]: audit 2024-09-16T09:04:49.486669+0000 mgr.a (mgr.14373) 8986 : audit [DBG] from='client.200013 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:04:51.090 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:04:50 smithi047 bash[22744]: audit 2024-09-16T09:04:49.486669+0000 mgr.a (mgr.14373) 8986 : audit [DBG] from='client.200013 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:04:52.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:04:51 smithi157 bash[24585]: cluster 2024-09-16T09:04:50.538119+0000 mgr.a (mgr.14373) 8987 : cluster [DBG] pgmap v6231: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:04:52.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:04:51 smithi086 bash[24289]: cluster 2024-09-16T09:04:50.538119+0000 mgr.a (mgr.14373) 8987 : cluster [DBG] pgmap v6231: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:04:52.090 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:04:51 smithi047 bash[22744]: cluster 2024-09-16T09:04:50.538119+0000 mgr.a (mgr.14373) 8987 : cluster [DBG] pgmap v6231: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:04:54.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:04:53 smithi157 bash[24585]: cluster 2024-09-16T09:04:52.540387+0000 mgr.a (mgr.14373) 8988 : cluster [DBG] pgmap v6232: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:04:54.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:04:53 smithi086 bash[24289]: cluster 2024-09-16T09:04:52.540387+0000 mgr.a (mgr.14373) 8988 : cluster [DBG] pgmap v6232: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:04:54.090 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:04:53 smithi047 bash[22744]: cluster 2024-09-16T09:04:52.540387+0000 mgr.a (mgr.14373) 8988 : cluster [DBG] pgmap v6232: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:04:54.932 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:04:54.933 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:04:54.933 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:04:55.711 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:04:55.712 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:04:55.712 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:04:55.712 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:04:55.712 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:04:56.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:04:55 smithi157 bash[24585]: cluster 2024-09-16T09:04:54.541139+0000 mgr.a (mgr.14373) 8989 : cluster [DBG] pgmap v6233: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:04:56.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:04:55 smithi086 bash[24289]: cluster 2024-09-16T09:04:54.541139+0000 mgr.a (mgr.14373) 8989 : cluster [DBG] pgmap v6233: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:04:56.090 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:04:55 smithi047 bash[22744]: cluster 2024-09-16T09:04:54.541139+0000 mgr.a (mgr.14373) 8989 : cluster [DBG] pgmap v6233: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:04:57.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:04:56 smithi157 bash[24585]: audit 2024-09-16T09:04:55.267397+0000 mgr.a (mgr.14373) 8990 : audit [DBG] from='client.200088 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:04:57.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:04:56 smithi086 bash[24289]: audit 2024-09-16T09:04:55.267397+0000 mgr.a (mgr.14373) 8990 : audit [DBG] from='client.200088 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:04:57.090 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:04:56 smithi047 bash[22744]: audit 2024-09-16T09:04:55.267397+0000 mgr.a (mgr.14373) 8990 : audit [DBG] from='client.200088 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:04:58.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:04:57 smithi157 bash[24585]: cluster 2024-09-16T09:04:56.543397+0000 mgr.a (mgr.14373) 8991 : cluster [DBG] pgmap v6234: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:04:58.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:04:57 smithi086 bash[24289]: cluster 2024-09-16T09:04:56.543397+0000 mgr.a (mgr.14373) 8991 : cluster [DBG] pgmap v6234: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:04:58.090 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:04:57 smithi047 bash[22744]: cluster 2024-09-16T09:04:56.543397+0000 mgr.a (mgr.14373) 8991 : cluster [DBG] pgmap v6234: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:05:00.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:04:59 smithi157 bash[24585]: cluster 2024-09-16T09:04:58.544173+0000 mgr.a (mgr.14373) 8992 : cluster [DBG] pgmap v6235: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:05:00.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:04:59 smithi086 bash[24289]: cluster 2024-09-16T09:04:58.544173+0000 mgr.a (mgr.14373) 8992 : cluster [DBG] pgmap v6235: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:05:00.090 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:04:59 smithi047 bash[22744]: cluster 2024-09-16T09:04:58.544173+0000 mgr.a (mgr.14373) 8992 : cluster [DBG] pgmap v6235: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:05:00.713 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:05:00.714 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:05:00.714 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:05:01.466 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:05:01.467 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:05:01.467 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:05:01.467 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:05:01.467 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:05:01.840 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:05:01 smithi047 bash[22744]: cluster 2024-09-16T09:05:00.544936+0000 mgr.a (mgr.14373) 8993 : cluster [DBG] pgmap v6236: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:05:01.840 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:05:01 smithi047 bash[22744]: audit 2024-09-16T09:05:01.046860+0000 mgr.a (mgr.14373) 8994 : audit [DBG] from='client.200163 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:05:02.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:05:01 smithi157 bash[24585]: cluster 2024-09-16T09:05:00.544936+0000 mgr.a (mgr.14373) 8993 : cluster [DBG] pgmap v6236: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:05:02.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:05:01 smithi157 bash[24585]: audit 2024-09-16T09:05:01.046860+0000 mgr.a (mgr.14373) 8994 : audit [DBG] from='client.200163 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:05:02.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:05:01 smithi086 bash[24289]: cluster 2024-09-16T09:05:00.544936+0000 mgr.a (mgr.14373) 8993 : cluster [DBG] pgmap v6236: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:05:02.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:05:01 smithi086 bash[24289]: audit 2024-09-16T09:05:01.046860+0000 mgr.a (mgr.14373) 8994 : audit [DBG] from='client.200163 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:05:04.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:05:03 smithi157 bash[24585]: cluster 2024-09-16T09:05:02.547300+0000 mgr.a (mgr.14373) 8995 : cluster [DBG] pgmap v6237: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:05:04.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:05:03 smithi086 bash[24289]: cluster 2024-09-16T09:05:02.547300+0000 mgr.a (mgr.14373) 8995 : cluster [DBG] pgmap v6237: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:05:04.090 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:05:03 smithi047 bash[22744]: cluster 2024-09-16T09:05:02.547300+0000 mgr.a (mgr.14373) 8995 : cluster [DBG] pgmap v6237: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:05:06.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:05:05 smithi157 bash[24585]: cluster 2024-09-16T09:05:04.548059+0000 mgr.a (mgr.14373) 8996 : cluster [DBG] pgmap v6238: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:05:06.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:05:05 smithi086 bash[24289]: cluster 2024-09-16T09:05:04.548059+0000 mgr.a (mgr.14373) 8996 : cluster [DBG] pgmap v6238: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:05:06.090 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:05:05 smithi047 bash[22744]: cluster 2024-09-16T09:05:04.548059+0000 mgr.a (mgr.14373) 8996 : cluster [DBG] pgmap v6238: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:05:06.468 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:05:06.469 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:05:06.469 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:05:07.236 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:05:07.236 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:05:07.236 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:05:07.236 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:05:07.236 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:05:08.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:05:07 smithi157 bash[24585]: cluster 2024-09-16T09:05:06.549355+0000 mgr.a (mgr.14373) 8997 : cluster [DBG] pgmap v6239: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:05:08.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:05:07 smithi157 bash[24585]: audit 2024-09-16T09:05:06.805407+0000 mgr.a (mgr.14373) 8998 : audit [DBG] from='client.200241 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:05:08.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:05:07 smithi086 bash[24289]: cluster 2024-09-16T09:05:06.549355+0000 mgr.a (mgr.14373) 8997 : cluster [DBG] pgmap v6239: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:05:08.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:05:07 smithi086 bash[24289]: audit 2024-09-16T09:05:06.805407+0000 mgr.a (mgr.14373) 8998 : audit [DBG] from='client.200241 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:05:08.090 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:05:07 smithi047 bash[22744]: cluster 2024-09-16T09:05:06.549355+0000 mgr.a (mgr.14373) 8997 : cluster [DBG] pgmap v6239: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:05:08.090 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:05:07 smithi047 bash[22744]: audit 2024-09-16T09:05:06.805407+0000 mgr.a (mgr.14373) 8998 : audit [DBG] from='client.200241 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:05:10.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:05:09 smithi157 bash[24585]: cluster 2024-09-16T09:05:08.550200+0000 mgr.a (mgr.14373) 8999 : cluster [DBG] pgmap v6240: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T09:05:10.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:05:09 smithi086 bash[24289]: cluster 2024-09-16T09:05:08.550200+0000 mgr.a (mgr.14373) 8999 : cluster [DBG] pgmap v6240: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T09:05:10.090 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:05:09 smithi047 bash[22744]: cluster 2024-09-16T09:05:08.550200+0000 mgr.a (mgr.14373) 8999 : cluster [DBG] pgmap v6240: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T09:05:12.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:05:11 smithi157 bash[24585]: cluster 2024-09-16T09:05:10.550976+0000 mgr.a (mgr.14373) 9000 : cluster [DBG] pgmap v6241: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T09:05:12.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:05:11 smithi086 bash[24289]: cluster 2024-09-16T09:05:10.550976+0000 mgr.a (mgr.14373) 9000 : cluster [DBG] pgmap v6241: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T09:05:12.090 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:05:11 smithi047 bash[22744]: cluster 2024-09-16T09:05:10.550976+0000 mgr.a (mgr.14373) 9000 : cluster [DBG] pgmap v6241: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T09:05:12.237 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:05:12.238 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:05:12.238 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:05:13.018 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:05:13.018 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:05:13.018 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:05:13.018 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:05:13.018 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:05:14.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:05:13 smithi157 bash[24585]: cluster 2024-09-16T09:05:12.553121+0000 mgr.a (mgr.14373) 9001 : cluster [DBG] pgmap v6242: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:05:14.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:05:13 smithi157 bash[24585]: audit 2024-09-16T09:05:12.573818+0000 mgr.a (mgr.14373) 9002 : audit [DBG] from='client.200316 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:05:14.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:05:13 smithi086 bash[24289]: cluster 2024-09-16T09:05:12.553121+0000 mgr.a (mgr.14373) 9001 : cluster [DBG] pgmap v6242: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:05:14.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:05:13 smithi086 bash[24289]: audit 2024-09-16T09:05:12.573818+0000 mgr.a (mgr.14373) 9002 : audit [DBG] from='client.200316 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:05:14.090 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:05:13 smithi047 bash[22744]: cluster 2024-09-16T09:05:12.553121+0000 mgr.a (mgr.14373) 9001 : cluster [DBG] pgmap v6242: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:05:14.090 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:05:13 smithi047 bash[22744]: audit 2024-09-16T09:05:12.573818+0000 mgr.a (mgr.14373) 9002 : audit [DBG] from='client.200316 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:05:16.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:05:15 smithi157 bash[24585]: cluster 2024-09-16T09:05:14.554047+0000 mgr.a (mgr.14373) 9003 : cluster [DBG] pgmap v6243: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T09:05:16.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:05:15 smithi086 bash[24289]: cluster 2024-09-16T09:05:14.554047+0000 mgr.a (mgr.14373) 9003 : cluster [DBG] pgmap v6243: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T09:05:16.090 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:05:15 smithi047 bash[22744]: cluster 2024-09-16T09:05:14.554047+0000 mgr.a (mgr.14373) 9003 : cluster [DBG] pgmap v6243: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T09:05:18.019 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:05:18.020 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:05:18.020 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:05:18.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:05:17 smithi157 bash[24585]: cluster 2024-09-16T09:05:16.556243+0000 mgr.a (mgr.14373) 9004 : cluster [DBG] pgmap v6244: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:05:18.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:05:17 smithi086 bash[24289]: cluster 2024-09-16T09:05:16.556243+0000 mgr.a (mgr.14373) 9004 : cluster [DBG] pgmap v6244: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:05:18.090 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:05:17 smithi047 bash[22744]: cluster 2024-09-16T09:05:16.556243+0000 mgr.a (mgr.14373) 9004 : cluster [DBG] pgmap v6244: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:05:18.774 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:05:18.775 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:05:18.775 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:05:18.775 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:05:18.775 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:05:20.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:05:19 smithi157 bash[24585]: audit 2024-09-16T09:05:18.353764+0000 mgr.a (mgr.14373) 9005 : audit [DBG] from='client.200391 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:05:20.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:05:19 smithi157 bash[24585]: cluster 2024-09-16T09:05:18.556813+0000 mgr.a (mgr.14373) 9006 : cluster [DBG] pgmap v6245: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:05:20.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:05:19 smithi086 bash[24289]: audit 2024-09-16T09:05:18.353764+0000 mgr.a (mgr.14373) 9005 : audit [DBG] from='client.200391 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:05:20.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:05:19 smithi086 bash[24289]: cluster 2024-09-16T09:05:18.556813+0000 mgr.a (mgr.14373) 9006 : cluster [DBG] pgmap v6245: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:05:20.090 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:05:19 smithi047 bash[22744]: audit 2024-09-16T09:05:18.353764+0000 mgr.a (mgr.14373) 9005 : audit [DBG] from='client.200391 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:05:20.090 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:05:19 smithi047 bash[22744]: cluster 2024-09-16T09:05:18.556813+0000 mgr.a (mgr.14373) 9006 : cluster [DBG] pgmap v6245: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:05:22.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:05:21 smithi157 bash[24585]: cluster 2024-09-16T09:05:20.557770+0000 mgr.a (mgr.14373) 9007 : cluster [DBG] pgmap v6246: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:05:22.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:05:21 smithi086 bash[24289]: cluster 2024-09-16T09:05:20.557770+0000 mgr.a (mgr.14373) 9007 : cluster [DBG] pgmap v6246: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:05:22.090 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:05:21 smithi047 bash[22744]: cluster 2024-09-16T09:05:20.557770+0000 mgr.a (mgr.14373) 9007 : cluster [DBG] pgmap v6246: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:05:23.776 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:05:23.777 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:05:23.777 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:05:24.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:05:23 smithi157 bash[24585]: cluster 2024-09-16T09:05:22.560048+0000 mgr.a (mgr.14373) 9008 : cluster [DBG] pgmap v6247: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:05:24.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:05:23 smithi086 bash[24289]: cluster 2024-09-16T09:05:22.560048+0000 mgr.a (mgr.14373) 9008 : cluster [DBG] pgmap v6247: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:05:24.090 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:05:23 smithi047 bash[22744]: cluster 2024-09-16T09:05:22.560048+0000 mgr.a (mgr.14373) 9008 : cluster [DBG] pgmap v6247: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:05:24.561 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:05:24.561 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:05:24.561 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:05:24.561 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:05:24.561 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:05:25.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:05:24 smithi157 bash[24585]: audit 2024-09-16T09:05:24.119612+0000 mgr.a (mgr.14373) 9009 : audit [DBG] from='client.200469 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:05:25.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:05:24 smithi086 bash[24289]: audit 2024-09-16T09:05:24.119612+0000 mgr.a (mgr.14373) 9009 : audit [DBG] from='client.200469 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:05:25.090 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:05:24 smithi047 bash[22744]: audit 2024-09-16T09:05:24.119612+0000 mgr.a (mgr.14373) 9009 : audit [DBG] from='client.200469 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:05:26.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:05:25 smithi157 bash[24585]: cluster 2024-09-16T09:05:24.560574+0000 mgr.a (mgr.14373) 9010 : cluster [DBG] pgmap v6248: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:05:26.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:05:25 smithi086 bash[24289]: cluster 2024-09-16T09:05:24.560574+0000 mgr.a (mgr.14373) 9010 : cluster [DBG] pgmap v6248: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:05:26.090 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:05:25 smithi047 bash[22744]: cluster 2024-09-16T09:05:24.560574+0000 mgr.a (mgr.14373) 9010 : cluster [DBG] pgmap v6248: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:05:28.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:05:27 smithi157 bash[24585]: cluster 2024-09-16T09:05:26.562699+0000 mgr.a (mgr.14373) 9011 : cluster [DBG] pgmap v6249: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:05:28.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:05:27 smithi086 bash[24289]: cluster 2024-09-16T09:05:26.562699+0000 mgr.a (mgr.14373) 9011 : cluster [DBG] pgmap v6249: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:05:28.090 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:05:27 smithi047 bash[22744]: cluster 2024-09-16T09:05:26.562699+0000 mgr.a (mgr.14373) 9011 : cluster [DBG] pgmap v6249: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:05:29.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:05:28 smithi157 bash[24585]: audit 2024-09-16T09:05:27.850204+0000 mon.b (mon.2) 842 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T09:05:29.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:05:28 smithi157 bash[24585]: audit 2024-09-16T09:05:28.695217+0000 mon.b (mon.2) 843 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:05:29.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:05:28 smithi157 bash[24585]: audit 2024-09-16T09:05:28.697120+0000 mon.b (mon.2) 844 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T09:05:29.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:05:28 smithi157 bash[24585]: audit 2024-09-16T09:05:28.708921+0000 mon.a (mon.0) 1103 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:05:29.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:05:28 smithi157 bash[24585]: audit 2024-09-16T09:05:28.714510+0000 mon.b (mon.2) 845 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:05:29.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:05:28 smithi086 bash[24289]: audit 2024-09-16T09:05:27.850204+0000 mon.b (mon.2) 842 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T09:05:29.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:05:28 smithi086 bash[24289]: audit 2024-09-16T09:05:28.695217+0000 mon.b (mon.2) 843 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:05:29.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:05:28 smithi086 bash[24289]: audit 2024-09-16T09:05:28.697120+0000 mon.b (mon.2) 844 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T09:05:29.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:05:28 smithi086 bash[24289]: audit 2024-09-16T09:05:28.708921+0000 mon.a (mon.0) 1103 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:05:29.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:05:28 smithi086 bash[24289]: audit 2024-09-16T09:05:28.714510+0000 mon.b (mon.2) 845 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:05:29.090 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:05:28 smithi047 bash[22744]: audit 2024-09-16T09:05:27.850204+0000 mon.b (mon.2) 842 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T09:05:29.090 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:05:28 smithi047 bash[22744]: audit 2024-09-16T09:05:28.695217+0000 mon.b (mon.2) 843 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:05:29.090 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:05:28 smithi047 bash[22744]: audit 2024-09-16T09:05:28.697120+0000 mon.b (mon.2) 844 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T09:05:29.090 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:05:28 smithi047 bash[22744]: audit 2024-09-16T09:05:28.708921+0000 mon.a (mon.0) 1103 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:05:29.090 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:05:28 smithi047 bash[22744]: audit 2024-09-16T09:05:28.714510+0000 mon.b (mon.2) 845 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:05:29.562 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:05:29.563 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:05:29.563 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:05:29.741 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 09:05:29 smithi047 bash[22994]: debug 2024-09-16T09:05:29.443+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T09:05:29.741 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 09:05:29 smithi047 bash[22994]: debug 2024-09-16T09:05:29.443+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T09:05:30.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:05:29 smithi157 bash[24585]: cluster 2024-09-16T09:05:28.563136+0000 mgr.a (mgr.14373) 9012 : cluster [DBG] pgmap v6250: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:05:30.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:05:29 smithi157 bash[24585]: audit 2024-09-16T09:05:28.716232+0000 mgr.a (mgr.14373) 9013 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:05:30.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:05:29 smithi086 bash[24289]: cluster 2024-09-16T09:05:28.563136+0000 mgr.a (mgr.14373) 9012 : cluster [DBG] pgmap v6250: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:05:30.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:05:29 smithi086 bash[24289]: audit 2024-09-16T09:05:28.716232+0000 mgr.a (mgr.14373) 9013 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:05:30.089 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:05:29 smithi047 bash[22744]: cluster 2024-09-16T09:05:28.563136+0000 mgr.a (mgr.14373) 9012 : cluster [DBG] pgmap v6250: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:05:30.090 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:05:29 smithi047 bash[22744]: audit 2024-09-16T09:05:28.716232+0000 mgr.a (mgr.14373) 9013 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:05:30.307 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:05:30.308 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:05:30.308 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:05:30.308 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:05:30.308 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:05:31.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:05:30 smithi157 bash[24585]: audit 2024-09-16T09:05:29.447517+0000 mgr.a (mgr.14373) 9014 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T09:05:31.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:05:30 smithi157 bash[24585]: cephadm 2024-09-16T09:05:29.449564+0000 mgr.a (mgr.14373) 9015 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T09:05:31.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:05:30 smithi157 bash[24585]: audit 2024-09-16T09:05:29.887270+0000 mgr.a (mgr.14373) 9016 : audit [DBG] from='client.200655 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:05:31.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:05:30 smithi086 bash[24289]: audit 2024-09-16T09:05:29.447517+0000 mgr.a (mgr.14373) 9014 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T09:05:31.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:05:30 smithi086 bash[24289]: cephadm 2024-09-16T09:05:29.449564+0000 mgr.a (mgr.14373) 9015 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T09:05:31.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:05:30 smithi086 bash[24289]: audit 2024-09-16T09:05:29.887270+0000 mgr.a (mgr.14373) 9016 : audit [DBG] from='client.200655 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:05:31.090 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:05:30 smithi047 bash[22744]: audit 2024-09-16T09:05:29.447517+0000 mgr.a (mgr.14373) 9014 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T09:05:31.090 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:05:30 smithi047 bash[22744]: cephadm 2024-09-16T09:05:29.449564+0000 mgr.a (mgr.14373) 9015 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T09:05:31.090 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:05:30 smithi047 bash[22744]: audit 2024-09-16T09:05:29.887270+0000 mgr.a (mgr.14373) 9016 : audit [DBG] from='client.200655 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:05:32.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:05:31 smithi157 bash[24585]: cluster 2024-09-16T09:05:30.564032+0000 mgr.a (mgr.14373) 9017 : cluster [DBG] pgmap v6251: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:05:32.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:05:31 smithi086 bash[24289]: cluster 2024-09-16T09:05:30.564032+0000 mgr.a (mgr.14373) 9017 : cluster [DBG] pgmap v6251: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:05:32.090 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:05:31 smithi047 bash[22744]: cluster 2024-09-16T09:05:30.564032+0000 mgr.a (mgr.14373) 9017 : cluster [DBG] pgmap v6251: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:05:34.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:05:33 smithi157 bash[24585]: cluster 2024-09-16T09:05:32.566427+0000 mgr.a (mgr.14373) 9018 : cluster [DBG] pgmap v6252: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:05:34.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:05:33 smithi086 bash[24289]: cluster 2024-09-16T09:05:32.566427+0000 mgr.a (mgr.14373) 9018 : cluster [DBG] pgmap v6252: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:05:34.090 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:05:33 smithi047 bash[22744]: cluster 2024-09-16T09:05:32.566427+0000 mgr.a (mgr.14373) 9018 : cluster [DBG] pgmap v6252: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:05:35.309 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:05:35.310 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:05:35.310 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:05:36.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:05:35 smithi157 bash[24585]: cluster 2024-09-16T09:05:34.567388+0000 mgr.a (mgr.14373) 9019 : cluster [DBG] pgmap v6253: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:05:36.054 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:05:36.055 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:05:36.055 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:05:36.055 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:05:36.055 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:05:36.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:05:35 smithi086 bash[24289]: cluster 2024-09-16T09:05:34.567388+0000 mgr.a (mgr.14373) 9019 : cluster [DBG] pgmap v6253: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:05:36.090 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:05:35 smithi047 bash[22744]: cluster 2024-09-16T09:05:34.567388+0000 mgr.a (mgr.14373) 9019 : cluster [DBG] pgmap v6253: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:05:37.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:05:36 smithi157 bash[24585]: audit 2024-09-16T09:05:35.642546+0000 mgr.a (mgr.14373) 9020 : audit [DBG] from='client.200733 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:05:37.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:05:36 smithi086 bash[24289]: audit 2024-09-16T09:05:35.642546+0000 mgr.a (mgr.14373) 9020 : audit [DBG] from='client.200733 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:05:37.090 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:05:36 smithi047 bash[22744]: audit 2024-09-16T09:05:35.642546+0000 mgr.a (mgr.14373) 9020 : audit [DBG] from='client.200733 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:05:38.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:05:37 smithi157 bash[24585]: cluster 2024-09-16T09:05:36.569725+0000 mgr.a (mgr.14373) 9021 : cluster [DBG] pgmap v6254: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:05:38.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:05:37 smithi086 bash[24289]: cluster 2024-09-16T09:05:36.569725+0000 mgr.a (mgr.14373) 9021 : cluster [DBG] pgmap v6254: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:05:38.090 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:05:37 smithi047 bash[22744]: cluster 2024-09-16T09:05:36.569725+0000 mgr.a (mgr.14373) 9021 : cluster [DBG] pgmap v6254: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:05:40.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:05:39 smithi157 bash[24585]: cluster 2024-09-16T09:05:38.570531+0000 mgr.a (mgr.14373) 9022 : cluster [DBG] pgmap v6255: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:05:40.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:05:39 smithi086 bash[24289]: cluster 2024-09-16T09:05:38.570531+0000 mgr.a (mgr.14373) 9022 : cluster [DBG] pgmap v6255: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:05:40.090 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:05:39 smithi047 bash[22744]: cluster 2024-09-16T09:05:38.570531+0000 mgr.a (mgr.14373) 9022 : cluster [DBG] pgmap v6255: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:05:41.056 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:05:41.057 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:05:41.057 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:05:41.835 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:05:41.835 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:05:41.835 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:05:41.835 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:05:41.835 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:05:42.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:05:41 smithi157 bash[24585]: cluster 2024-09-16T09:05:40.571312+0000 mgr.a (mgr.14373) 9023 : cluster [DBG] pgmap v6256: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:05:42.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:05:41 smithi086 bash[24289]: cluster 2024-09-16T09:05:40.571312+0000 mgr.a (mgr.14373) 9023 : cluster [DBG] pgmap v6256: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:05:42.090 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:05:41 smithi047 bash[22744]: cluster 2024-09-16T09:05:40.571312+0000 mgr.a (mgr.14373) 9023 : cluster [DBG] pgmap v6256: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:05:43.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:05:42 smithi157 bash[24585]: audit 2024-09-16T09:05:41.391796+0000 mgr.a (mgr.14373) 9024 : audit [DBG] from='client.200808 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:05:43.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:05:42 smithi086 bash[24289]: audit 2024-09-16T09:05:41.391796+0000 mgr.a (mgr.14373) 9024 : audit [DBG] from='client.200808 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:05:43.090 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:05:42 smithi047 bash[22744]: audit 2024-09-16T09:05:41.391796+0000 mgr.a (mgr.14373) 9024 : audit [DBG] from='client.200808 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:05:44.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:05:43 smithi157 bash[24585]: cluster 2024-09-16T09:05:42.574134+0000 mgr.a (mgr.14373) 9025 : cluster [DBG] pgmap v6257: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:05:44.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:05:43 smithi086 bash[24289]: cluster 2024-09-16T09:05:42.574134+0000 mgr.a (mgr.14373) 9025 : cluster [DBG] pgmap v6257: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:05:44.090 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:05:43 smithi047 bash[22744]: cluster 2024-09-16T09:05:42.574134+0000 mgr.a (mgr.14373) 9025 : cluster [DBG] pgmap v6257: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:05:46.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:05:45 smithi157 bash[24585]: cluster 2024-09-16T09:05:44.574942+0000 mgr.a (mgr.14373) 9026 : cluster [DBG] pgmap v6258: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:05:46.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:05:45 smithi086 bash[24289]: cluster 2024-09-16T09:05:44.574942+0000 mgr.a (mgr.14373) 9026 : cluster [DBG] pgmap v6258: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:05:46.090 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:05:45 smithi047 bash[22744]: cluster 2024-09-16T09:05:44.574942+0000 mgr.a (mgr.14373) 9026 : cluster [DBG] pgmap v6258: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:05:46.836 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:05:46.837 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:05:46.837 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:05:47.615 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:05:47.615 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:05:47.615 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:05:47.616 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:05:47.616 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:05:48.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:05:47 smithi157 bash[24585]: cluster 2024-09-16T09:05:46.576866+0000 mgr.a (mgr.14373) 9027 : cluster [DBG] pgmap v6259: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:05:48.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:05:47 smithi086 bash[24289]: cluster 2024-09-16T09:05:46.576866+0000 mgr.a (mgr.14373) 9027 : cluster [DBG] pgmap v6259: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:05:48.090 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:05:47 smithi047 bash[22744]: cluster 2024-09-16T09:05:46.576866+0000 mgr.a (mgr.14373) 9027 : cluster [DBG] pgmap v6259: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:05:49.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:05:48 smithi086 bash[24289]: audit 2024-09-16T09:05:47.170847+0000 mgr.a (mgr.14373) 9028 : audit [DBG] from='client.200886 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:05:49.090 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:05:48 smithi047 bash[22744]: audit 2024-09-16T09:05:47.170847+0000 mgr.a (mgr.14373) 9028 : audit [DBG] from='client.200886 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:05:49.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:05:48 smithi157 bash[24585]: audit 2024-09-16T09:05:47.170847+0000 mgr.a (mgr.14373) 9028 : audit [DBG] from='client.200886 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:05:50.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:05:49 smithi086 bash[24289]: cluster 2024-09-16T09:05:48.577819+0000 mgr.a (mgr.14373) 9029 : cluster [DBG] pgmap v6260: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:05:50.090 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:05:49 smithi047 bash[22744]: cluster 2024-09-16T09:05:48.577819+0000 mgr.a (mgr.14373) 9029 : cluster [DBG] pgmap v6260: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:05:50.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:05:49 smithi157 bash[24585]: cluster 2024-09-16T09:05:48.577819+0000 mgr.a (mgr.14373) 9029 : cluster [DBG] pgmap v6260: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:05:52.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:05:51 smithi086 bash[24289]: cluster 2024-09-16T09:05:50.578645+0000 mgr.a (mgr.14373) 9030 : cluster [DBG] pgmap v6261: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T09:05:52.090 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:05:51 smithi047 bash[22744]: cluster 2024-09-16T09:05:50.578645+0000 mgr.a (mgr.14373) 9030 : cluster [DBG] pgmap v6261: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T09:05:52.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:05:51 smithi157 bash[24585]: cluster 2024-09-16T09:05:50.578645+0000 mgr.a (mgr.14373) 9030 : cluster [DBG] pgmap v6261: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T09:05:52.617 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:05:52.617 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:05:52.617 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:05:53.383 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:05:53.383 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:05:53.383 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:05:53.384 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:05:53.384 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:05:54.090 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:05:53 smithi047 bash[22744]: cluster 2024-09-16T09:05:52.580883+0000 mgr.a (mgr.14373) 9031 : cluster [DBG] pgmap v6262: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:05:54.090 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:05:53 smithi047 bash[22744]: audit 2024-09-16T09:05:52.955384+0000 mgr.a (mgr.14373) 9032 : audit [DBG] from='client.200958 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:05:54.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:05:53 smithi157 bash[24585]: cluster 2024-09-16T09:05:52.580883+0000 mgr.a (mgr.14373) 9031 : cluster [DBG] pgmap v6262: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:05:54.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:05:53 smithi157 bash[24585]: audit 2024-09-16T09:05:52.955384+0000 mgr.a (mgr.14373) 9032 : audit [DBG] from='client.200958 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:05:54.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:05:53 smithi086 bash[24289]: cluster 2024-09-16T09:05:52.580883+0000 mgr.a (mgr.14373) 9031 : cluster [DBG] pgmap v6262: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:05:54.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:05:53 smithi086 bash[24289]: audit 2024-09-16T09:05:52.955384+0000 mgr.a (mgr.14373) 9032 : audit [DBG] from='client.200958 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:05:56.090 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:05:55 smithi047 bash[22744]: cluster 2024-09-16T09:05:54.581831+0000 mgr.a (mgr.14373) 9033 : cluster [DBG] pgmap v6263: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:05:56.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:05:55 smithi157 bash[24585]: cluster 2024-09-16T09:05:54.581831+0000 mgr.a (mgr.14373) 9033 : cluster [DBG] pgmap v6263: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:05:56.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:05:55 smithi086 bash[24289]: cluster 2024-09-16T09:05:54.581831+0000 mgr.a (mgr.14373) 9033 : cluster [DBG] pgmap v6263: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:05:58.090 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:05:57 smithi047 bash[22744]: cluster 2024-09-16T09:05:56.584017+0000 mgr.a (mgr.14373) 9034 : cluster [DBG] pgmap v6264: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:05:58.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:05:57 smithi157 bash[24585]: cluster 2024-09-16T09:05:56.584017+0000 mgr.a (mgr.14373) 9034 : cluster [DBG] pgmap v6264: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:05:58.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:05:57 smithi086 bash[24289]: cluster 2024-09-16T09:05:56.584017+0000 mgr.a (mgr.14373) 9034 : cluster [DBG] pgmap v6264: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:05:58.385 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:05:58.386 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:05:58.386 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:05:59.147 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:05:59.147 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:05:59.147 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:05:59.147 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:05:59.147 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:06:00.090 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:05:59 smithi047 bash[22744]: cluster 2024-09-16T09:05:58.584754+0000 mgr.a (mgr.14373) 9035 : cluster [DBG] pgmap v6265: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:06:00.090 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:05:59 smithi047 bash[22744]: audit 2024-09-16T09:05:58.719008+0000 mgr.a (mgr.14373) 9036 : audit [DBG] from='client.201036 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:06:00.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:05:59 smithi157 bash[24585]: cluster 2024-09-16T09:05:58.584754+0000 mgr.a (mgr.14373) 9035 : cluster [DBG] pgmap v6265: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:06:00.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:05:59 smithi157 bash[24585]: audit 2024-09-16T09:05:58.719008+0000 mgr.a (mgr.14373) 9036 : audit [DBG] from='client.201036 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:06:00.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:05:59 smithi086 bash[24289]: cluster 2024-09-16T09:05:58.584754+0000 mgr.a (mgr.14373) 9035 : cluster [DBG] pgmap v6265: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:06:00.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:05:59 smithi086 bash[24289]: audit 2024-09-16T09:05:58.719008+0000 mgr.a (mgr.14373) 9036 : audit [DBG] from='client.201036 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:06:02.090 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:06:01 smithi047 bash[22744]: cluster 2024-09-16T09:06:00.585762+0000 mgr.a (mgr.14373) 9037 : cluster [DBG] pgmap v6266: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:06:02.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:06:01 smithi157 bash[24585]: cluster 2024-09-16T09:06:00.585762+0000 mgr.a (mgr.14373) 9037 : cluster [DBG] pgmap v6266: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:06:02.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:06:01 smithi086 bash[24289]: cluster 2024-09-16T09:06:00.585762+0000 mgr.a (mgr.14373) 9037 : cluster [DBG] pgmap v6266: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:06:04.148 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:06:04.149 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:06:04.149 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:06:04.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:06:03 smithi157 bash[24585]: cluster 2024-09-16T09:06:02.588021+0000 mgr.a (mgr.14373) 9038 : cluster [DBG] pgmap v6267: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:06:04.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:06:03 smithi086 bash[24289]: cluster 2024-09-16T09:06:02.588021+0000 mgr.a (mgr.14373) 9038 : cluster [DBG] pgmap v6267: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:06:04.340 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:06:03 smithi047 bash[22744]: cluster 2024-09-16T09:06:02.588021+0000 mgr.a (mgr.14373) 9038 : cluster [DBG] pgmap v6267: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:06:04.915 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:06:04.915 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:06:04.915 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:06:04.915 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:06:04.915 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:06:06.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:06:05 smithi157 bash[24585]: audit 2024-09-16T09:06:04.485137+0000 mgr.a (mgr.14373) 9039 : audit [DBG] from='client.201111 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:06:06.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:06:05 smithi157 bash[24585]: cluster 2024-09-16T09:06:04.588506+0000 mgr.a (mgr.14373) 9040 : cluster [DBG] pgmap v6268: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:06:06.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:06:05 smithi086 bash[24289]: audit 2024-09-16T09:06:04.485137+0000 mgr.a (mgr.14373) 9039 : audit [DBG] from='client.201111 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:06:06.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:06:05 smithi086 bash[24289]: cluster 2024-09-16T09:06:04.588506+0000 mgr.a (mgr.14373) 9040 : cluster [DBG] pgmap v6268: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:06:06.340 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:06:05 smithi047 bash[22744]: audit 2024-09-16T09:06:04.485137+0000 mgr.a (mgr.14373) 9039 : audit [DBG] from='client.201111 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:06:06.340 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:06:05 smithi047 bash[22744]: cluster 2024-09-16T09:06:04.588506+0000 mgr.a (mgr.14373) 9040 : cluster [DBG] pgmap v6268: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:06:08.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:06:07 smithi157 bash[24585]: cluster 2024-09-16T09:06:06.590744+0000 mgr.a (mgr.14373) 9041 : cluster [DBG] pgmap v6269: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:06:08.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:06:07 smithi086 bash[24289]: cluster 2024-09-16T09:06:06.590744+0000 mgr.a (mgr.14373) 9041 : cluster [DBG] pgmap v6269: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:06:08.340 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:06:07 smithi047 bash[22744]: cluster 2024-09-16T09:06:06.590744+0000 mgr.a (mgr.14373) 9041 : cluster [DBG] pgmap v6269: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:06:09.917 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:06:09.917 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:06:09.917 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:06:10.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:06:09 smithi157 bash[24585]: cluster 2024-09-16T09:06:08.591533+0000 mgr.a (mgr.14373) 9042 : cluster [DBG] pgmap v6270: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:06:10.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:06:09 smithi086 bash[24289]: cluster 2024-09-16T09:06:08.591533+0000 mgr.a (mgr.14373) 9042 : cluster [DBG] pgmap v6270: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:06:10.340 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:06:09 smithi047 bash[22744]: cluster 2024-09-16T09:06:08.591533+0000 mgr.a (mgr.14373) 9042 : cluster [DBG] pgmap v6270: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:06:10.692 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:06:10.693 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:06:10.693 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:06:10.693 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:06:10.693 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:06:12.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:06:11 smithi157 bash[24585]: audit 2024-09-16T09:06:10.256646+0000 mgr.a (mgr.14373) 9043 : audit [DBG] from='client.201189 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:06:12.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:06:11 smithi157 bash[24585]: cluster 2024-09-16T09:06:10.598140+0000 mgr.a (mgr.14373) 9044 : cluster [DBG] pgmap v6271: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:06:12.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:06:11 smithi086 bash[24289]: audit 2024-09-16T09:06:10.256646+0000 mgr.a (mgr.14373) 9043 : audit [DBG] from='client.201189 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:06:12.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:06:11 smithi086 bash[24289]: cluster 2024-09-16T09:06:10.598140+0000 mgr.a (mgr.14373) 9044 : cluster [DBG] pgmap v6271: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:06:12.340 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:06:11 smithi047 bash[22744]: audit 2024-09-16T09:06:10.256646+0000 mgr.a (mgr.14373) 9043 : audit [DBG] from='client.201189 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:06:12.340 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:06:11 smithi047 bash[22744]: cluster 2024-09-16T09:06:10.598140+0000 mgr.a (mgr.14373) 9044 : cluster [DBG] pgmap v6271: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:06:14.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:06:13 smithi157 bash[24585]: cluster 2024-09-16T09:06:12.600398+0000 mgr.a (mgr.14373) 9045 : cluster [DBG] pgmap v6272: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:06:14.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:06:13 smithi086 bash[24289]: cluster 2024-09-16T09:06:12.600398+0000 mgr.a (mgr.14373) 9045 : cluster [DBG] pgmap v6272: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:06:14.340 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:06:13 smithi047 bash[22744]: cluster 2024-09-16T09:06:12.600398+0000 mgr.a (mgr.14373) 9045 : cluster [DBG] pgmap v6272: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:06:15.694 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:06:15.694 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:06:15.695 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:06:16.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:06:15 smithi157 bash[24585]: cluster 2024-09-16T09:06:14.601165+0000 mgr.a (mgr.14373) 9046 : cluster [DBG] pgmap v6273: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:06:16.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:06:15 smithi086 bash[24289]: cluster 2024-09-16T09:06:14.601165+0000 mgr.a (mgr.14373) 9046 : cluster [DBG] pgmap v6273: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:06:16.340 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:06:15 smithi047 bash[22744]: cluster 2024-09-16T09:06:14.601165+0000 mgr.a (mgr.14373) 9046 : cluster [DBG] pgmap v6273: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:06:16.435 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:06:16.436 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:06:16.436 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:06:16.436 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:06:16.436 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:06:17.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:06:16 smithi157 bash[24585]: audit 2024-09-16T09:06:16.023197+0000 mgr.a (mgr.14373) 9047 : audit [DBG] from='client.201261 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:06:17.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:06:16 smithi086 bash[24289]: audit 2024-09-16T09:06:16.023197+0000 mgr.a (mgr.14373) 9047 : audit [DBG] from='client.201261 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:06:17.340 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:06:16 smithi047 bash[22744]: audit 2024-09-16T09:06:16.023197+0000 mgr.a (mgr.14373) 9047 : audit [DBG] from='client.201261 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:06:18.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:06:17 smithi157 bash[24585]: cluster 2024-09-16T09:06:16.603504+0000 mgr.a (mgr.14373) 9048 : cluster [DBG] pgmap v6274: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:06:18.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:06:17 smithi086 bash[24289]: cluster 2024-09-16T09:06:16.603504+0000 mgr.a (mgr.14373) 9048 : cluster [DBG] pgmap v6274: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:06:18.340 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:06:17 smithi047 bash[22744]: cluster 2024-09-16T09:06:16.603504+0000 mgr.a (mgr.14373) 9048 : cluster [DBG] pgmap v6274: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:06:20.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:06:19 smithi157 bash[24585]: cluster 2024-09-16T09:06:18.604286+0000 mgr.a (mgr.14373) 9049 : cluster [DBG] pgmap v6275: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:06:20.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:06:19 smithi086 bash[24289]: cluster 2024-09-16T09:06:18.604286+0000 mgr.a (mgr.14373) 9049 : cluster [DBG] pgmap v6275: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:06:20.340 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:06:19 smithi047 bash[22744]: cluster 2024-09-16T09:06:18.604286+0000 mgr.a (mgr.14373) 9049 : cluster [DBG] pgmap v6275: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:06:21.437 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:06:21.438 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:06:21.438 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:06:22.212 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:06:22.213 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:06:22.213 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:06:22.213 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:06:22.213 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:06:22.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:06:21 smithi157 bash[24585]: cluster 2024-09-16T09:06:20.605064+0000 mgr.a (mgr.14373) 9050 : cluster [DBG] pgmap v6276: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:06:22.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:06:21 smithi086 bash[24289]: cluster 2024-09-16T09:06:20.605064+0000 mgr.a (mgr.14373) 9050 : cluster [DBG] pgmap v6276: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:06:22.340 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:06:21 smithi047 bash[22744]: cluster 2024-09-16T09:06:20.605064+0000 mgr.a (mgr.14373) 9050 : cluster [DBG] pgmap v6276: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:06:23.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:06:22 smithi157 bash[24585]: audit 2024-09-16T09:06:21.776386+0000 mgr.a (mgr.14373) 9051 : audit [DBG] from='client.201339 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:06:23.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:06:22 smithi086 bash[24289]: audit 2024-09-16T09:06:21.776386+0000 mgr.a (mgr.14373) 9051 : audit [DBG] from='client.201339 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:06:23.340 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:06:22 smithi047 bash[22744]: audit 2024-09-16T09:06:21.776386+0000 mgr.a (mgr.14373) 9051 : audit [DBG] from='client.201339 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:06:24.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:06:23 smithi157 bash[24585]: cluster 2024-09-16T09:06:22.607822+0000 mgr.a (mgr.14373) 9052 : cluster [DBG] pgmap v6277: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:06:24.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:06:23 smithi086 bash[24289]: cluster 2024-09-16T09:06:22.607822+0000 mgr.a (mgr.14373) 9052 : cluster [DBG] pgmap v6277: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:06:24.340 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:06:23 smithi047 bash[22744]: cluster 2024-09-16T09:06:22.607822+0000 mgr.a (mgr.14373) 9052 : cluster [DBG] pgmap v6277: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:06:26.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:06:25 smithi157 bash[24585]: cluster 2024-09-16T09:06:24.608623+0000 mgr.a (mgr.14373) 9053 : cluster [DBG] pgmap v6278: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:06:26.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:06:25 smithi086 bash[24289]: cluster 2024-09-16T09:06:24.608623+0000 mgr.a (mgr.14373) 9053 : cluster [DBG] pgmap v6278: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:06:26.340 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:06:25 smithi047 bash[22744]: cluster 2024-09-16T09:06:24.608623+0000 mgr.a (mgr.14373) 9053 : cluster [DBG] pgmap v6278: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:06:27.214 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:06:27.214 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:06:27.215 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:06:27.993 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:06:27.994 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:06:27.994 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:06:27.994 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:06:27.994 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:06:28.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:06:27 smithi157 bash[24585]: cluster 2024-09-16T09:06:26.610566+0000 mgr.a (mgr.14373) 9054 : cluster [DBG] pgmap v6279: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:06:28.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:06:27 smithi086 bash[24289]: cluster 2024-09-16T09:06:26.610566+0000 mgr.a (mgr.14373) 9054 : cluster [DBG] pgmap v6279: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:06:28.340 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:06:27 smithi047 bash[22744]: cluster 2024-09-16T09:06:26.610566+0000 mgr.a (mgr.14373) 9054 : cluster [DBG] pgmap v6279: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:06:29.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:06:28 smithi157 bash[24585]: audit 2024-09-16T09:06:27.550333+0000 mgr.a (mgr.14373) 9055 : audit [DBG] from='client.201411 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:06:29.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:06:28 smithi086 bash[24289]: audit 2024-09-16T09:06:27.550333+0000 mgr.a (mgr.14373) 9055 : audit [DBG] from='client.201411 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:06:29.340 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:06:28 smithi047 bash[22744]: audit 2024-09-16T09:06:27.550333+0000 mgr.a (mgr.14373) 9055 : audit [DBG] from='client.201411 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:06:30.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:06:29 smithi157 bash[24585]: cluster 2024-09-16T09:06:28.611520+0000 mgr.a (mgr.14373) 9056 : cluster [DBG] pgmap v6280: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:06:30.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:06:29 smithi157 bash[24585]: audit 2024-09-16T09:06:29.502702+0000 mon.b (mon.2) 846 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T09:06:30.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:06:29 smithi086 bash[24289]: cluster 2024-09-16T09:06:28.611520+0000 mgr.a (mgr.14373) 9056 : cluster [DBG] pgmap v6280: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:06:30.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:06:29 smithi086 bash[24289]: audit 2024-09-16T09:06:29.502702+0000 mon.b (mon.2) 846 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T09:06:30.340 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:06:29 smithi047 bash[22744]: cluster 2024-09-16T09:06:28.611520+0000 mgr.a (mgr.14373) 9056 : cluster [DBG] pgmap v6280: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:06:30.340 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:06:29 smithi047 bash[22744]: audit 2024-09-16T09:06:29.502702+0000 mon.b (mon.2) 846 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T09:06:31.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:06:30 smithi157 bash[24585]: audit 2024-09-16T09:06:30.334009+0000 mon.b (mon.2) 847 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:06:31.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:06:30 smithi157 bash[24585]: audit 2024-09-16T09:06:30.336332+0000 mon.b (mon.2) 848 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T09:06:31.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:06:30 smithi157 bash[24585]: audit 2024-09-16T09:06:30.348393+0000 mon.a (mon.0) 1104 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:06:31.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:06:30 smithi157 bash[24585]: audit 2024-09-16T09:06:30.355373+0000 mon.b (mon.2) 849 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:06:31.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:06:30 smithi086 bash[24289]: audit 2024-09-16T09:06:30.334009+0000 mon.b (mon.2) 847 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:06:31.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:06:30 smithi086 bash[24289]: audit 2024-09-16T09:06:30.336332+0000 mon.b (mon.2) 848 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T09:06:31.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:06:30 smithi086 bash[24289]: audit 2024-09-16T09:06:30.348393+0000 mon.a (mon.0) 1104 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:06:31.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:06:30 smithi086 bash[24289]: audit 2024-09-16T09:06:30.355373+0000 mon.b (mon.2) 849 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:06:31.340 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 09:06:31 smithi047 bash[22994]: debug 2024-09-16T09:06:31.105+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T09:06:31.340 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 09:06:31 smithi047 bash[22994]: debug 2024-09-16T09:06:31.109+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T09:06:31.341 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:06:30 smithi047 bash[22744]: audit 2024-09-16T09:06:30.334009+0000 mon.b (mon.2) 847 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:06:31.341 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:06:30 smithi047 bash[22744]: audit 2024-09-16T09:06:30.336332+0000 mon.b (mon.2) 848 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T09:06:31.341 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:06:30 smithi047 bash[22744]: audit 2024-09-16T09:06:30.348393+0000 mon.a (mon.0) 1104 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:06:31.341 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:06:30 smithi047 bash[22744]: audit 2024-09-16T09:06:30.355373+0000 mon.b (mon.2) 849 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:06:32.305 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:06:31 smithi157 bash[24585]: audit 2024-09-16T09:06:30.358006+0000 mgr.a (mgr.14373) 9057 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:06:32.305 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:06:31 smithi157 bash[24585]: cluster 2024-09-16T09:06:30.612091+0000 mgr.a (mgr.14373) 9058 : cluster [DBG] pgmap v6281: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T09:06:32.305 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:06:31 smithi157 bash[24585]: audit 2024-09-16T09:06:31.110128+0000 mgr.a (mgr.14373) 9059 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T09:06:32.305 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:06:31 smithi157 bash[24585]: cephadm 2024-09-16T09:06:31.111921+0000 mgr.a (mgr.14373) 9060 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T09:06:32.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:06:31 smithi086 bash[24289]: audit 2024-09-16T09:06:30.358006+0000 mgr.a (mgr.14373) 9057 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:06:32.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:06:31 smithi086 bash[24289]: cluster 2024-09-16T09:06:30.612091+0000 mgr.a (mgr.14373) 9058 : cluster [DBG] pgmap v6281: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T09:06:32.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:06:31 smithi086 bash[24289]: audit 2024-09-16T09:06:31.110128+0000 mgr.a (mgr.14373) 9059 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T09:06:32.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:06:31 smithi086 bash[24289]: cephadm 2024-09-16T09:06:31.111921+0000 mgr.a (mgr.14373) 9060 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T09:06:32.340 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:06:31 smithi047 bash[22744]: audit 2024-09-16T09:06:30.358006+0000 mgr.a (mgr.14373) 9057 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:06:32.341 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:06:31 smithi047 bash[22744]: cluster 2024-09-16T09:06:30.612091+0000 mgr.a (mgr.14373) 9058 : cluster [DBG] pgmap v6281: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T09:06:32.341 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:06:31 smithi047 bash[22744]: audit 2024-09-16T09:06:31.110128+0000 mgr.a (mgr.14373) 9059 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T09:06:32.341 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:06:31 smithi047 bash[22744]: cephadm 2024-09-16T09:06:31.111921+0000 mgr.a (mgr.14373) 9060 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T09:06:32.995 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:06:32.996 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:06:32.996 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:06:33.784 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:06:33.784 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:06:33.784 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:06:33.784 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:06:33.785 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:06:34.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:06:33 smithi157 bash[24585]: cluster 2024-09-16T09:06:32.614419+0000 mgr.a (mgr.14373) 9061 : cluster [DBG] pgmap v6282: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:06:34.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:06:33 smithi086 bash[24289]: cluster 2024-09-16T09:06:32.614419+0000 mgr.a (mgr.14373) 9061 : cluster [DBG] pgmap v6282: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:06:34.340 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:06:33 smithi047 bash[22744]: cluster 2024-09-16T09:06:32.614419+0000 mgr.a (mgr.14373) 9061 : cluster [DBG] pgmap v6282: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:06:35.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:06:34 smithi157 bash[24585]: audit 2024-09-16T09:06:33.335971+0000 mgr.a (mgr.14373) 9062 : audit [DBG] from='client.201591 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:06:35.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:06:34 smithi086 bash[24289]: audit 2024-09-16T09:06:33.335971+0000 mgr.a (mgr.14373) 9062 : audit [DBG] from='client.201591 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:06:35.340 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:06:34 smithi047 bash[22744]: audit 2024-09-16T09:06:33.335971+0000 mgr.a (mgr.14373) 9062 : audit [DBG] from='client.201591 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:06:36.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:06:35 smithi157 bash[24585]: cluster 2024-09-16T09:06:34.615383+0000 mgr.a (mgr.14373) 9063 : cluster [DBG] pgmap v6283: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:06:36.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:06:35 smithi086 bash[24289]: cluster 2024-09-16T09:06:34.615383+0000 mgr.a (mgr.14373) 9063 : cluster [DBG] pgmap v6283: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:06:36.340 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:06:35 smithi047 bash[22744]: cluster 2024-09-16T09:06:34.615383+0000 mgr.a (mgr.14373) 9063 : cluster [DBG] pgmap v6283: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:06:38.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:06:37 smithi157 bash[24585]: cluster 2024-09-16T09:06:36.617544+0000 mgr.a (mgr.14373) 9064 : cluster [DBG] pgmap v6284: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:06:38.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:06:37 smithi086 bash[24289]: cluster 2024-09-16T09:06:36.617544+0000 mgr.a (mgr.14373) 9064 : cluster [DBG] pgmap v6284: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:06:38.340 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:06:37 smithi047 bash[22744]: cluster 2024-09-16T09:06:36.617544+0000 mgr.a (mgr.14373) 9064 : cluster [DBG] pgmap v6284: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:06:38.786 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:06:38.786 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:06:38.786 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:06:39.536 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:06:39.537 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:06:39.537 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:06:39.537 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:06:39.537 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:06:40.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:06:39 smithi157 bash[24585]: cluster 2024-09-16T09:06:38.618334+0000 mgr.a (mgr.14373) 9065 : cluster [DBG] pgmap v6285: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:06:40.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:06:39 smithi157 bash[24585]: audit 2024-09-16T09:06:39.114700+0000 mgr.a (mgr.14373) 9066 : audit [DBG] from='client.201666 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:06:40.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:06:39 smithi086 bash[24289]: cluster 2024-09-16T09:06:38.618334+0000 mgr.a (mgr.14373) 9065 : cluster [DBG] pgmap v6285: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:06:40.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:06:39 smithi086 bash[24289]: audit 2024-09-16T09:06:39.114700+0000 mgr.a (mgr.14373) 9066 : audit [DBG] from='client.201666 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:06:40.340 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:06:39 smithi047 bash[22744]: cluster 2024-09-16T09:06:38.618334+0000 mgr.a (mgr.14373) 9065 : cluster [DBG] pgmap v6285: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:06:40.340 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:06:39 smithi047 bash[22744]: audit 2024-09-16T09:06:39.114700+0000 mgr.a (mgr.14373) 9066 : audit [DBG] from='client.201666 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:06:42.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:06:41 smithi157 bash[24585]: cluster 2024-09-16T09:06:40.619511+0000 mgr.a (mgr.14373) 9067 : cluster [DBG] pgmap v6286: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:06:42.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:06:41 smithi086 bash[24289]: cluster 2024-09-16T09:06:40.619511+0000 mgr.a (mgr.14373) 9067 : cluster [DBG] pgmap v6286: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:06:42.340 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:06:41 smithi047 bash[22744]: cluster 2024-09-16T09:06:40.619511+0000 mgr.a (mgr.14373) 9067 : cluster [DBG] pgmap v6286: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:06:44.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:06:43 smithi157 bash[24585]: cluster 2024-09-16T09:06:42.621798+0000 mgr.a (mgr.14373) 9068 : cluster [DBG] pgmap v6287: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:06:44.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:06:43 smithi086 bash[24289]: cluster 2024-09-16T09:06:42.621798+0000 mgr.a (mgr.14373) 9068 : cluster [DBG] pgmap v6287: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:06:44.340 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:06:43 smithi047 bash[22744]: cluster 2024-09-16T09:06:42.621798+0000 mgr.a (mgr.14373) 9068 : cluster [DBG] pgmap v6287: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:06:44.538 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:06:44.539 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:06:44.539 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:06:45.281 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:06:45.281 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:06:45.281 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:06:45.282 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:06:45.282 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:06:46.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:06:45 smithi157 bash[24585]: cluster 2024-09-16T09:06:44.622711+0000 mgr.a (mgr.14373) 9069 : cluster [DBG] pgmap v6288: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:06:46.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:06:45 smithi157 bash[24585]: audit 2024-09-16T09:06:44.869348+0000 mgr.a (mgr.14373) 9070 : audit [DBG] from='client.201744 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:06:46.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:06:45 smithi086 bash[24289]: cluster 2024-09-16T09:06:44.622711+0000 mgr.a (mgr.14373) 9069 : cluster [DBG] pgmap v6288: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:06:46.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:06:45 smithi086 bash[24289]: audit 2024-09-16T09:06:44.869348+0000 mgr.a (mgr.14373) 9070 : audit [DBG] from='client.201744 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:06:46.340 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:06:45 smithi047 bash[22744]: cluster 2024-09-16T09:06:44.622711+0000 mgr.a (mgr.14373) 9069 : cluster [DBG] pgmap v6288: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:06:46.340 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:06:45 smithi047 bash[22744]: audit 2024-09-16T09:06:44.869348+0000 mgr.a (mgr.14373) 9070 : audit [DBG] from='client.201744 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:06:48.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:06:47 smithi157 bash[24585]: cluster 2024-09-16T09:06:46.624991+0000 mgr.a (mgr.14373) 9071 : cluster [DBG] pgmap v6289: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:06:48.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:06:47 smithi086 bash[24289]: cluster 2024-09-16T09:06:46.624991+0000 mgr.a (mgr.14373) 9071 : cluster [DBG] pgmap v6289: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:06:48.340 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:06:47 smithi047 bash[22744]: cluster 2024-09-16T09:06:46.624991+0000 mgr.a (mgr.14373) 9071 : cluster [DBG] pgmap v6289: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:06:50.283 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:06:50.283 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:06:50.283 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:06:50.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:06:49 smithi157 bash[24585]: cluster 2024-09-16T09:06:48.625762+0000 mgr.a (mgr.14373) 9072 : cluster [DBG] pgmap v6290: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:06:50.349 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:06:49 smithi047 bash[22744]: cluster 2024-09-16T09:06:48.625762+0000 mgr.a (mgr.14373) 9072 : cluster [DBG] pgmap v6290: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:06:50.349 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:06:49 smithi086 bash[24289]: cluster 2024-09-16T09:06:48.625762+0000 mgr.a (mgr.14373) 9072 : cluster [DBG] pgmap v6290: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:06:51.068 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:06:51.068 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:06:51.068 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:06:51.068 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:06:51.069 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:06:52.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:06:51 smithi157 bash[24585]: audit 2024-09-16T09:06:50.622808+0000 mgr.a (mgr.14373) 9073 : audit [DBG] from='client.201822 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:06:52.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:06:51 smithi157 bash[24585]: cluster 2024-09-16T09:06:50.639843+0000 mgr.a (mgr.14373) 9074 : cluster [DBG] pgmap v6291: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:06:52.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:06:51 smithi086 bash[24289]: audit 2024-09-16T09:06:50.622808+0000 mgr.a (mgr.14373) 9073 : audit [DBG] from='client.201822 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:06:52.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:06:51 smithi086 bash[24289]: cluster 2024-09-16T09:06:50.639843+0000 mgr.a (mgr.14373) 9074 : cluster [DBG] pgmap v6291: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:06:52.340 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:06:51 smithi047 bash[22744]: audit 2024-09-16T09:06:50.622808+0000 mgr.a (mgr.14373) 9073 : audit [DBG] from='client.201822 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:06:52.341 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:06:51 smithi047 bash[22744]: cluster 2024-09-16T09:06:50.639843+0000 mgr.a (mgr.14373) 9074 : cluster [DBG] pgmap v6291: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:06:54.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:06:53 smithi157 bash[24585]: cluster 2024-09-16T09:06:52.642415+0000 mgr.a (mgr.14373) 9075 : cluster [DBG] pgmap v6292: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:06:54.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:06:53 smithi086 bash[24289]: cluster 2024-09-16T09:06:52.642415+0000 mgr.a (mgr.14373) 9075 : cluster [DBG] pgmap v6292: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:06:54.341 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:06:53 smithi047 bash[22744]: cluster 2024-09-16T09:06:52.642415+0000 mgr.a (mgr.14373) 9075 : cluster [DBG] pgmap v6292: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:06:55.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:06:55 smithi157 bash[24585]: cluster 2024-09-16T09:06:54.643207+0000 mgr.a (mgr.14373) 9076 : cluster [DBG] pgmap v6293: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:06:55.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:06:55 smithi086 bash[24289]: cluster 2024-09-16T09:06:54.643207+0000 mgr.a (mgr.14373) 9076 : cluster [DBG] pgmap v6293: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:06:55.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:06:55 smithi047 bash[22744]: cluster 2024-09-16T09:06:54.643207+0000 mgr.a (mgr.14373) 9076 : cluster [DBG] pgmap v6293: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:06:56.070 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:06:56.070 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:06:56.071 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:06:56.862 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:06:56.862 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:06:56.862 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:06:56.862 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:06:56.862 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:06:58.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:06:57 smithi157 bash[24585]: audit 2024-09-16T09:06:56.412426+0000 mgr.a (mgr.14373) 9077 : audit [DBG] from='client.201900 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:06:58.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:06:57 smithi157 bash[24585]: cluster 2024-09-16T09:06:56.644361+0000 mgr.a (mgr.14373) 9078 : cluster [DBG] pgmap v6294: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:06:58.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:06:57 smithi086 bash[24289]: audit 2024-09-16T09:06:56.412426+0000 mgr.a (mgr.14373) 9077 : audit [DBG] from='client.201900 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:06:58.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:06:57 smithi086 bash[24289]: cluster 2024-09-16T09:06:56.644361+0000 mgr.a (mgr.14373) 9078 : cluster [DBG] pgmap v6294: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:06:58.090 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:06:57 smithi047 bash[22744]: audit 2024-09-16T09:06:56.412426+0000 mgr.a (mgr.14373) 9077 : audit [DBG] from='client.201900 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:06:58.090 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:06:57 smithi047 bash[22744]: cluster 2024-09-16T09:06:56.644361+0000 mgr.a (mgr.14373) 9078 : cluster [DBG] pgmap v6294: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:07:00.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:06:59 smithi157 bash[24585]: cluster 2024-09-16T09:06:58.645226+0000 mgr.a (mgr.14373) 9079 : cluster [DBG] pgmap v6295: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 936 B/s rd, 0 op/s 2024-09-16T09:07:00.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:06:59 smithi086 bash[24289]: cluster 2024-09-16T09:06:58.645226+0000 mgr.a (mgr.14373) 9079 : cluster [DBG] pgmap v6295: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 936 B/s rd, 0 op/s 2024-09-16T09:07:00.090 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:06:59 smithi047 bash[22744]: cluster 2024-09-16T09:06:58.645226+0000 mgr.a (mgr.14373) 9079 : cluster [DBG] pgmap v6295: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 936 B/s rd, 0 op/s 2024-09-16T09:07:01.863 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:07:01.863 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:07:01.864 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:07:02.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:07:01 smithi157 bash[24585]: cluster 2024-09-16T09:07:00.646004+0000 mgr.a (mgr.14373) 9080 : cluster [DBG] pgmap v6296: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:07:02.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:07:01 smithi086 bash[24289]: cluster 2024-09-16T09:07:00.646004+0000 mgr.a (mgr.14373) 9080 : cluster [DBG] pgmap v6296: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:07:02.090 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:07:01 smithi047 bash[22744]: cluster 2024-09-16T09:07:00.646004+0000 mgr.a (mgr.14373) 9080 : cluster [DBG] pgmap v6296: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:07:02.615 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:07:02.616 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:07:02.616 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:07:02.616 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:07:02.616 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:07:04.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:07:03 smithi157 bash[24585]: audit 2024-09-16T09:07:02.190869+0000 mgr.a (mgr.14373) 9081 : audit [DBG] from='client.201975 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:07:04.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:07:03 smithi157 bash[24585]: cluster 2024-09-16T09:07:02.647350+0000 mgr.a (mgr.14373) 9082 : cluster [DBG] pgmap v6297: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:07:04.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:07:03 smithi086 bash[24289]: audit 2024-09-16T09:07:02.190869+0000 mgr.a (mgr.14373) 9081 : audit [DBG] from='client.201975 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:07:04.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:07:03 smithi086 bash[24289]: cluster 2024-09-16T09:07:02.647350+0000 mgr.a (mgr.14373) 9082 : cluster [DBG] pgmap v6297: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:07:04.090 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:07:03 smithi047 bash[22744]: audit 2024-09-16T09:07:02.190869+0000 mgr.a (mgr.14373) 9081 : audit [DBG] from='client.201975 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:07:04.090 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:07:03 smithi047 bash[22744]: cluster 2024-09-16T09:07:02.647350+0000 mgr.a (mgr.14373) 9082 : cluster [DBG] pgmap v6297: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:07:06.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:07:05 smithi157 bash[24585]: cluster 2024-09-16T09:07:04.648093+0000 mgr.a (mgr.14373) 9083 : cluster [DBG] pgmap v6298: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T09:07:06.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:07:05 smithi086 bash[24289]: cluster 2024-09-16T09:07:04.648093+0000 mgr.a (mgr.14373) 9083 : cluster [DBG] pgmap v6298: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T09:07:06.090 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:07:05 smithi047 bash[22744]: cluster 2024-09-16T09:07:04.648093+0000 mgr.a (mgr.14373) 9083 : cluster [DBG] pgmap v6298: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T09:07:07.617 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:07:07.618 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:07:07.618 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:07:08.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:07:07 smithi157 bash[24585]: cluster 2024-09-16T09:07:06.649986+0000 mgr.a (mgr.14373) 9084 : cluster [DBG] pgmap v6299: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:07:08.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:07:07 smithi086 bash[24289]: cluster 2024-09-16T09:07:06.649986+0000 mgr.a (mgr.14373) 9084 : cluster [DBG] pgmap v6299: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:07:08.090 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:07:07 smithi047 bash[22744]: cluster 2024-09-16T09:07:06.649986+0000 mgr.a (mgr.14373) 9084 : cluster [DBG] pgmap v6299: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:07:08.376 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:07:08.377 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:07:08.377 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:07:08.377 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:07:08.377 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:07:09.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:07:08 smithi157 bash[24585]: audit 2024-09-16T09:07:07.950987+0000 mgr.a (mgr.14373) 9085 : audit [DBG] from='client.202050 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:07:09.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:07:08 smithi086 bash[24289]: audit 2024-09-16T09:07:07.950987+0000 mgr.a (mgr.14373) 9085 : audit [DBG] from='client.202050 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:07:09.090 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:07:08 smithi047 bash[22744]: audit 2024-09-16T09:07:07.950987+0000 mgr.a (mgr.14373) 9085 : audit [DBG] from='client.202050 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:07:10.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:07:09 smithi157 bash[24585]: cluster 2024-09-16T09:07:08.650956+0000 mgr.a (mgr.14373) 9086 : cluster [DBG] pgmap v6300: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:07:10.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:07:09 smithi086 bash[24289]: cluster 2024-09-16T09:07:08.650956+0000 mgr.a (mgr.14373) 9086 : cluster [DBG] pgmap v6300: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:07:10.090 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:07:09 smithi047 bash[22744]: cluster 2024-09-16T09:07:08.650956+0000 mgr.a (mgr.14373) 9086 : cluster [DBG] pgmap v6300: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:07:12.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:07:11 smithi157 bash[24585]: cluster 2024-09-16T09:07:10.651750+0000 mgr.a (mgr.14373) 9087 : cluster [DBG] pgmap v6301: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:07:12.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:07:11 smithi086 bash[24289]: cluster 2024-09-16T09:07:10.651750+0000 mgr.a (mgr.14373) 9087 : cluster [DBG] pgmap v6301: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:07:12.090 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:07:11 smithi047 bash[22744]: cluster 2024-09-16T09:07:10.651750+0000 mgr.a (mgr.14373) 9087 : cluster [DBG] pgmap v6301: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:07:13.378 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:07:13.379 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:07:13.379 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:07:14.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:07:13 smithi157 bash[24585]: cluster 2024-09-16T09:07:12.653963+0000 mgr.a (mgr.14373) 9088 : cluster [DBG] pgmap v6302: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:07:14.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:07:13 smithi086 bash[24289]: cluster 2024-09-16T09:07:12.653963+0000 mgr.a (mgr.14373) 9088 : cluster [DBG] pgmap v6302: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:07:14.090 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:07:13 smithi047 bash[22744]: cluster 2024-09-16T09:07:12.653963+0000 mgr.a (mgr.14373) 9088 : cluster [DBG] pgmap v6302: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:07:14.153 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:07:14.153 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:07:14.153 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:07:14.153 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:07:14.154 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:07:15.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:07:14 smithi157 bash[24585]: audit 2024-09-16T09:07:13.714397+0000 mgr.a (mgr.14373) 9089 : audit [DBG] from='client.202125 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:07:15.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:07:14 smithi086 bash[24289]: audit 2024-09-16T09:07:13.714397+0000 mgr.a (mgr.14373) 9089 : audit [DBG] from='client.202125 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:07:15.090 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:07:14 smithi047 bash[22744]: audit 2024-09-16T09:07:13.714397+0000 mgr.a (mgr.14373) 9089 : audit [DBG] from='client.202125 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:07:16.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:07:15 smithi157 bash[24585]: cluster 2024-09-16T09:07:14.654942+0000 mgr.a (mgr.14373) 9090 : cluster [DBG] pgmap v6303: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:07:16.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:07:15 smithi086 bash[24289]: cluster 2024-09-16T09:07:14.654942+0000 mgr.a (mgr.14373) 9090 : cluster [DBG] pgmap v6303: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:07:16.090 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:07:15 smithi047 bash[22744]: cluster 2024-09-16T09:07:14.654942+0000 mgr.a (mgr.14373) 9090 : cluster [DBG] pgmap v6303: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:07:18.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:07:17 smithi157 bash[24585]: cluster 2024-09-16T09:07:16.657107+0000 mgr.a (mgr.14373) 9091 : cluster [DBG] pgmap v6304: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:07:18.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:07:17 smithi086 bash[24289]: cluster 2024-09-16T09:07:16.657107+0000 mgr.a (mgr.14373) 9091 : cluster [DBG] pgmap v6304: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:07:18.091 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:07:17 smithi047 bash[22744]: cluster 2024-09-16T09:07:16.657107+0000 mgr.a (mgr.14373) 9091 : cluster [DBG] pgmap v6304: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:07:19.155 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:07:19.155 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:07:19.156 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:07:19.915 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:07:19.915 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:07:19.916 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:07:19.916 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:07:19.916 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:07:20.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:07:19 smithi157 bash[24585]: cluster 2024-09-16T09:07:18.657856+0000 mgr.a (mgr.14373) 9092 : cluster [DBG] pgmap v6305: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:07:20.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:07:19 smithi086 bash[24289]: cluster 2024-09-16T09:07:18.657856+0000 mgr.a (mgr.14373) 9092 : cluster [DBG] pgmap v6305: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:07:20.090 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:07:19 smithi047 bash[22744]: cluster 2024-09-16T09:07:18.657856+0000 mgr.a (mgr.14373) 9092 : cluster [DBG] pgmap v6305: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:07:21.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:07:20 smithi157 bash[24585]: audit 2024-09-16T09:07:19.486285+0000 mgr.a (mgr.14373) 9093 : audit [DBG] from='client.202203 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:07:21.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:07:20 smithi086 bash[24289]: audit 2024-09-16T09:07:19.486285+0000 mgr.a (mgr.14373) 9093 : audit [DBG] from='client.202203 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:07:21.090 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:07:20 smithi047 bash[22744]: audit 2024-09-16T09:07:19.486285+0000 mgr.a (mgr.14373) 9093 : audit [DBG] from='client.202203 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:07:22.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:07:21 smithi157 bash[24585]: cluster 2024-09-16T09:07:20.658778+0000 mgr.a (mgr.14373) 9094 : cluster [DBG] pgmap v6306: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:07:22.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:07:21 smithi086 bash[24289]: cluster 2024-09-16T09:07:20.658778+0000 mgr.a (mgr.14373) 9094 : cluster [DBG] pgmap v6306: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:07:22.090 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:07:21 smithi047 bash[22744]: cluster 2024-09-16T09:07:20.658778+0000 mgr.a (mgr.14373) 9094 : cluster [DBG] pgmap v6306: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:07:24.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:07:23 smithi157 bash[24585]: cluster 2024-09-16T09:07:22.661189+0000 mgr.a (mgr.14373) 9095 : cluster [DBG] pgmap v6307: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:07:24.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:07:23 smithi086 bash[24289]: cluster 2024-09-16T09:07:22.661189+0000 mgr.a (mgr.14373) 9095 : cluster [DBG] pgmap v6307: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:07:24.090 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:07:23 smithi047 bash[22744]: cluster 2024-09-16T09:07:22.661189+0000 mgr.a (mgr.14373) 9095 : cluster [DBG] pgmap v6307: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:07:24.917 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:07:24.917 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:07:24.917 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:07:25.673 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:07:25.674 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:07:25.674 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:07:25.674 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:07:25.674 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:07:26.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:07:25 smithi157 bash[24585]: cluster 2024-09-16T09:07:24.662123+0000 mgr.a (mgr.14373) 9096 : cluster [DBG] pgmap v6308: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:07:26.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:07:25 smithi086 bash[24289]: cluster 2024-09-16T09:07:24.662123+0000 mgr.a (mgr.14373) 9096 : cluster [DBG] pgmap v6308: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:07:26.090 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:07:25 smithi047 bash[22744]: cluster 2024-09-16T09:07:24.662123+0000 mgr.a (mgr.14373) 9096 : cluster [DBG] pgmap v6308: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:07:27.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:07:26 smithi157 bash[24585]: audit 2024-09-16T09:07:25.251984+0000 mgr.a (mgr.14373) 9097 : audit [DBG] from='client.202281 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:07:27.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:07:26 smithi086 bash[24289]: audit 2024-09-16T09:07:25.251984+0000 mgr.a (mgr.14373) 9097 : audit [DBG] from='client.202281 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:07:27.090 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:07:26 smithi047 bash[22744]: audit 2024-09-16T09:07:25.251984+0000 mgr.a (mgr.14373) 9097 : audit [DBG] from='client.202281 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:07:28.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:07:27 smithi157 bash[24585]: cluster 2024-09-16T09:07:26.664412+0000 mgr.a (mgr.14373) 9098 : cluster [DBG] pgmap v6309: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:07:28.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:07:27 smithi086 bash[24289]: cluster 2024-09-16T09:07:26.664412+0000 mgr.a (mgr.14373) 9098 : cluster [DBG] pgmap v6309: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:07:28.090 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:07:27 smithi047 bash[22744]: cluster 2024-09-16T09:07:26.664412+0000 mgr.a (mgr.14373) 9098 : cluster [DBG] pgmap v6309: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:07:30.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:07:29 smithi157 bash[24585]: cluster 2024-09-16T09:07:28.665185+0000 mgr.a (mgr.14373) 9099 : cluster [DBG] pgmap v6310: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:07:30.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:07:29 smithi086 bash[24289]: cluster 2024-09-16T09:07:28.665185+0000 mgr.a (mgr.14373) 9099 : cluster [DBG] pgmap v6310: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:07:30.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:07:29 smithi047 bash[22744]: cluster 2024-09-16T09:07:28.665185+0000 mgr.a (mgr.14373) 9099 : cluster [DBG] pgmap v6310: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:07:30.675 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:07:30.676 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:07:30.676 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:07:31.449 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:07:31.450 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:07:31.450 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:07:31.450 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:07:31.450 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:07:32.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:07:31 smithi157 bash[24585]: cluster 2024-09-16T09:07:30.665947+0000 mgr.a (mgr.14373) 9100 : cluster [DBG] pgmap v6311: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:07:32.053 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:07:31 smithi157 bash[24585]: audit 2024-09-16T09:07:31.011376+0000 mgr.a (mgr.14373) 9101 : audit [DBG] from='client.202353 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:07:32.054 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:07:31 smithi157 bash[24585]: audit 2024-09-16T09:07:31.167689+0000 mon.b (mon.2) 850 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T09:07:32.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:07:31 smithi086 bash[24289]: cluster 2024-09-16T09:07:30.665947+0000 mgr.a (mgr.14373) 9100 : cluster [DBG] pgmap v6311: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:07:32.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:07:31 smithi086 bash[24289]: audit 2024-09-16T09:07:31.011376+0000 mgr.a (mgr.14373) 9101 : audit [DBG] from='client.202353 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:07:32.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:07:31 smithi086 bash[24289]: audit 2024-09-16T09:07:31.167689+0000 mon.b (mon.2) 850 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T09:07:32.090 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:07:31 smithi047 bash[22744]: cluster 2024-09-16T09:07:30.665947+0000 mgr.a (mgr.14373) 9100 : cluster [DBG] pgmap v6311: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:07:32.090 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:07:31 smithi047 bash[22744]: audit 2024-09-16T09:07:31.011376+0000 mgr.a (mgr.14373) 9101 : audit [DBG] from='client.202353 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:07:32.090 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:07:31 smithi047 bash[22744]: audit 2024-09-16T09:07:31.167689+0000 mon.b (mon.2) 850 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T09:07:33.068 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:07:32 smithi086 bash[24289]: audit 2024-09-16T09:07:31.970330+0000 mon.b (mon.2) 851 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:07:33.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:07:32 smithi086 bash[24289]: audit 2024-09-16T09:07:31.972810+0000 mon.b (mon.2) 852 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T09:07:33.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:07:32 smithi086 bash[24289]: audit 2024-09-16T09:07:31.984022+0000 mon.a (mon.0) 1105 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:07:33.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:07:32 smithi086 bash[24289]: audit 2024-09-16T09:07:31.990892+0000 mon.b (mon.2) 853 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:07:33.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:07:32 smithi086 bash[24289]: audit 2024-09-16T09:07:31.993121+0000 mgr.a (mgr.14373) 9102 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:07:33.091 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 09:07:32 smithi047 bash[22994]: debug 2024-09-16T09:07:32.728+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T09:07:33.091 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 09:07:32 smithi047 bash[22994]: debug 2024-09-16T09:07:32.732+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T09:07:33.091 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:07:32 smithi047 bash[22744]: audit 2024-09-16T09:07:31.970330+0000 mon.b (mon.2) 851 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:07:33.091 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:07:32 smithi047 bash[22744]: audit 2024-09-16T09:07:31.972810+0000 mon.b (mon.2) 852 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T09:07:33.091 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:07:32 smithi047 bash[22744]: audit 2024-09-16T09:07:31.984022+0000 mon.a (mon.0) 1105 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:07:33.091 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:07:32 smithi047 bash[22744]: audit 2024-09-16T09:07:31.990892+0000 mon.b (mon.2) 853 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:07:33.091 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:07:32 smithi047 bash[22744]: audit 2024-09-16T09:07:31.993121+0000 mgr.a (mgr.14373) 9102 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:07:33.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:07:32 smithi157 bash[24585]: audit 2024-09-16T09:07:31.970330+0000 mon.b (mon.2) 851 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:07:33.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:07:32 smithi157 bash[24585]: audit 2024-09-16T09:07:31.972810+0000 mon.b (mon.2) 852 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T09:07:33.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:07:32 smithi157 bash[24585]: audit 2024-09-16T09:07:31.984022+0000 mon.a (mon.0) 1105 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:07:33.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:07:32 smithi157 bash[24585]: audit 2024-09-16T09:07:31.990892+0000 mon.b (mon.2) 853 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:07:33.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:07:32 smithi157 bash[24585]: audit 2024-09-16T09:07:31.993121+0000 mgr.a (mgr.14373) 9102 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:07:34.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:07:33 smithi157 bash[24585]: cluster 2024-09-16T09:07:32.667492+0000 mgr.a (mgr.14373) 9103 : cluster [DBG] pgmap v6312: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:07:34.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:07:33 smithi157 bash[24585]: audit 2024-09-16T09:07:32.732911+0000 mgr.a (mgr.14373) 9104 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T09:07:34.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:07:33 smithi157 bash[24585]: cephadm 2024-09-16T09:07:32.735167+0000 mgr.a (mgr.14373) 9105 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T09:07:34.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:07:33 smithi086 bash[24289]: cluster 2024-09-16T09:07:32.667492+0000 mgr.a (mgr.14373) 9103 : cluster [DBG] pgmap v6312: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:07:34.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:07:33 smithi086 bash[24289]: audit 2024-09-16T09:07:32.732911+0000 mgr.a (mgr.14373) 9104 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T09:07:34.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:07:33 smithi086 bash[24289]: cephadm 2024-09-16T09:07:32.735167+0000 mgr.a (mgr.14373) 9105 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T09:07:34.341 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:07:33 smithi047 bash[22744]: cluster 2024-09-16T09:07:32.667492+0000 mgr.a (mgr.14373) 9103 : cluster [DBG] pgmap v6312: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:07:34.341 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:07:33 smithi047 bash[22744]: audit 2024-09-16T09:07:32.732911+0000 mgr.a (mgr.14373) 9104 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T09:07:34.341 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:07:33 smithi047 bash[22744]: cephadm 2024-09-16T09:07:32.735167+0000 mgr.a (mgr.14373) 9105 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T09:07:36.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:07:35 smithi157 bash[24585]: cluster 2024-09-16T09:07:34.668238+0000 mgr.a (mgr.14373) 9106 : cluster [DBG] pgmap v6313: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:07:36.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:07:35 smithi086 bash[24289]: cluster 2024-09-16T09:07:34.668238+0000 mgr.a (mgr.14373) 9106 : cluster [DBG] pgmap v6313: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:07:36.341 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:07:35 smithi047 bash[22744]: cluster 2024-09-16T09:07:34.668238+0000 mgr.a (mgr.14373) 9106 : cluster [DBG] pgmap v6313: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:07:36.451 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:07:36.452 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:07:36.452 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:07:37.232 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:07:37.233 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:07:37.233 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:07:37.233 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:07:37.233 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:07:38.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:07:37 smithi157 bash[24585]: cluster 2024-09-16T09:07:36.670201+0000 mgr.a (mgr.14373) 9107 : cluster [DBG] pgmap v6314: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:07:38.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:07:37 smithi157 bash[24585]: audit 2024-09-16T09:07:36.785918+0000 mgr.a (mgr.14373) 9108 : audit [DBG] from='client.202539 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:07:38.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:07:37 smithi086 bash[24289]: cluster 2024-09-16T09:07:36.670201+0000 mgr.a (mgr.14373) 9107 : cluster [DBG] pgmap v6314: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:07:38.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:07:37 smithi086 bash[24289]: audit 2024-09-16T09:07:36.785918+0000 mgr.a (mgr.14373) 9108 : audit [DBG] from='client.202539 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:07:38.341 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:07:37 smithi047 bash[22744]: cluster 2024-09-16T09:07:36.670201+0000 mgr.a (mgr.14373) 9107 : cluster [DBG] pgmap v6314: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:07:38.341 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:07:37 smithi047 bash[22744]: audit 2024-09-16T09:07:36.785918+0000 mgr.a (mgr.14373) 9108 : audit [DBG] from='client.202539 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:07:40.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:07:39 smithi157 bash[24585]: cluster 2024-09-16T09:07:38.671135+0000 mgr.a (mgr.14373) 9109 : cluster [DBG] pgmap v6315: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T09:07:40.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:07:39 smithi086 bash[24289]: cluster 2024-09-16T09:07:38.671135+0000 mgr.a (mgr.14373) 9109 : cluster [DBG] pgmap v6315: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T09:07:40.341 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:07:39 smithi047 bash[22744]: cluster 2024-09-16T09:07:38.671135+0000 mgr.a (mgr.14373) 9109 : cluster [DBG] pgmap v6315: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T09:07:42.234 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:07:42.235 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:07:42.235 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:07:42.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:07:42 smithi157 bash[24585]: cluster 2024-09-16T09:07:40.671926+0000 mgr.a (mgr.14373) 9110 : cluster [DBG] pgmap v6316: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T09:07:42.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:07:42 smithi086 bash[24289]: cluster 2024-09-16T09:07:40.671926+0000 mgr.a (mgr.14373) 9110 : cluster [DBG] pgmap v6316: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T09:07:42.340 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:07:42 smithi047 bash[22744]: cluster 2024-09-16T09:07:40.671926+0000 mgr.a (mgr.14373) 9110 : cluster [DBG] pgmap v6316: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T09:07:43.001 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:07:43.001 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:07:43.001 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:07:43.002 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:07:43.002 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:07:44.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:07:44 smithi157 bash[24585]: audit 2024-09-16T09:07:42.571167+0000 mgr.a (mgr.14373) 9111 : audit [DBG] from='client.202617 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:07:44.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:07:44 smithi157 bash[24585]: cluster 2024-09-16T09:07:42.673225+0000 mgr.a (mgr.14373) 9112 : cluster [DBG] pgmap v6317: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:07:44.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:07:44 smithi086 bash[24289]: audit 2024-09-16T09:07:42.571167+0000 mgr.a (mgr.14373) 9111 : audit [DBG] from='client.202617 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:07:44.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:07:44 smithi086 bash[24289]: cluster 2024-09-16T09:07:42.673225+0000 mgr.a (mgr.14373) 9112 : cluster [DBG] pgmap v6317: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:07:44.341 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:07:44 smithi047 bash[22744]: audit 2024-09-16T09:07:42.571167+0000 mgr.a (mgr.14373) 9111 : audit [DBG] from='client.202617 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:07:44.341 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:07:44 smithi047 bash[22744]: cluster 2024-09-16T09:07:42.673225+0000 mgr.a (mgr.14373) 9112 : cluster [DBG] pgmap v6317: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:07:46.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:07:46 smithi157 bash[24585]: cluster 2024-09-16T09:07:44.674167+0000 mgr.a (mgr.14373) 9113 : cluster [DBG] pgmap v6318: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T09:07:46.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:07:46 smithi086 bash[24289]: cluster 2024-09-16T09:07:44.674167+0000 mgr.a (mgr.14373) 9113 : cluster [DBG] pgmap v6318: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T09:07:46.340 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:07:46 smithi047 bash[22744]: cluster 2024-09-16T09:07:44.674167+0000 mgr.a (mgr.14373) 9113 : cluster [DBG] pgmap v6318: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T09:07:48.003 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:07:48.003 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:07:48.004 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:07:48.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:07:48 smithi157 bash[24585]: cluster 2024-09-16T09:07:46.676311+0000 mgr.a (mgr.14373) 9114 : cluster [DBG] pgmap v6319: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:07:48.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:07:48 smithi086 bash[24289]: cluster 2024-09-16T09:07:46.676311+0000 mgr.a (mgr.14373) 9114 : cluster [DBG] pgmap v6319: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:07:48.341 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:07:48 smithi047 bash[22744]: cluster 2024-09-16T09:07:46.676311+0000 mgr.a (mgr.14373) 9114 : cluster [DBG] pgmap v6319: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:07:48.786 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:07:48.786 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:07:48.787 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:07:48.787 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:07:48.787 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:07:50.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:07:50 smithi157 bash[24585]: audit 2024-09-16T09:07:48.341067+0000 mgr.a (mgr.14373) 9115 : audit [DBG] from='client.202692 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:07:50.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:07:50 smithi157 bash[24585]: cluster 2024-09-16T09:07:48.684511+0000 mgr.a (mgr.14373) 9116 : cluster [DBG] pgmap v6320: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:07:50.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:07:50 smithi086 bash[24289]: audit 2024-09-16T09:07:48.341067+0000 mgr.a (mgr.14373) 9115 : audit [DBG] from='client.202692 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:07:50.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:07:50 smithi086 bash[24289]: cluster 2024-09-16T09:07:48.684511+0000 mgr.a (mgr.14373) 9116 : cluster [DBG] pgmap v6320: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:07:50.341 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:07:50 smithi047 bash[22744]: audit 2024-09-16T09:07:48.341067+0000 mgr.a (mgr.14373) 9115 : audit [DBG] from='client.202692 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:07:50.341 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:07:50 smithi047 bash[22744]: cluster 2024-09-16T09:07:48.684511+0000 mgr.a (mgr.14373) 9116 : cluster [DBG] pgmap v6320: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:07:52.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:07:52 smithi157 bash[24585]: cluster 2024-09-16T09:07:50.685297+0000 mgr.a (mgr.14373) 9117 : cluster [DBG] pgmap v6321: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:07:52.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:07:52 smithi086 bash[24289]: cluster 2024-09-16T09:07:50.685297+0000 mgr.a (mgr.14373) 9117 : cluster [DBG] pgmap v6321: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:07:52.341 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:07:52 smithi047 bash[22744]: cluster 2024-09-16T09:07:50.685297+0000 mgr.a (mgr.14373) 9117 : cluster [DBG] pgmap v6321: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:07:53.787 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:07:53.788 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:07:53.788 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:07:54.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:07:54 smithi157 bash[24585]: cluster 2024-09-16T09:07:52.687554+0000 mgr.a (mgr.14373) 9118 : cluster [DBG] pgmap v6322: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:07:54.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:07:54 smithi086 bash[24289]: cluster 2024-09-16T09:07:52.687554+0000 mgr.a (mgr.14373) 9118 : cluster [DBG] pgmap v6322: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:07:54.341 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:07:54 smithi047 bash[22744]: cluster 2024-09-16T09:07:52.687554+0000 mgr.a (mgr.14373) 9118 : cluster [DBG] pgmap v6322: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:07:54.587 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:07:54.588 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:07:54.588 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:07:54.588 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:07:54.588 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:07:55.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:07:55 smithi157 bash[24585]: audit 2024-09-16T09:07:54.137733+0000 mgr.a (mgr.14373) 9119 : audit [DBG] from='client.202767 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:07:55.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:07:55 smithi086 bash[24289]: audit 2024-09-16T09:07:54.137733+0000 mgr.a (mgr.14373) 9119 : audit [DBG] from='client.202767 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:07:55.341 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:07:55 smithi047 bash[22744]: audit 2024-09-16T09:07:54.137733+0000 mgr.a (mgr.14373) 9119 : audit [DBG] from='client.202767 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:07:56.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:07:56 smithi157 bash[24585]: cluster 2024-09-16T09:07:54.688533+0000 mgr.a (mgr.14373) 9120 : cluster [DBG] pgmap v6323: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:07:56.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:07:56 smithi086 bash[24289]: cluster 2024-09-16T09:07:54.688533+0000 mgr.a (mgr.14373) 9120 : cluster [DBG] pgmap v6323: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:07:56.341 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:07:56 smithi047 bash[22744]: cluster 2024-09-16T09:07:54.688533+0000 mgr.a (mgr.14373) 9120 : cluster [DBG] pgmap v6323: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:07:58.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:07:58 smithi157 bash[24585]: cluster 2024-09-16T09:07:56.690680+0000 mgr.a (mgr.14373) 9121 : cluster [DBG] pgmap v6324: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:07:58.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:07:58 smithi086 bash[24289]: cluster 2024-09-16T09:07:56.690680+0000 mgr.a (mgr.14373) 9121 : cluster [DBG] pgmap v6324: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:07:58.341 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:07:58 smithi047 bash[22744]: cluster 2024-09-16T09:07:56.690680+0000 mgr.a (mgr.14373) 9121 : cluster [DBG] pgmap v6324: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:07:59.589 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:07:59.590 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:07:59.590 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:08:00.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:08:00 smithi157 bash[24585]: cluster 2024-09-16T09:07:58.691486+0000 mgr.a (mgr.14373) 9122 : cluster [DBG] pgmap v6325: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:08:00.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:08:00 smithi086 bash[24289]: cluster 2024-09-16T09:07:58.691486+0000 mgr.a (mgr.14373) 9122 : cluster [DBG] pgmap v6325: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:08:00.340 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:08:00 smithi047 bash[22744]: cluster 2024-09-16T09:07:58.691486+0000 mgr.a (mgr.14373) 9122 : cluster [DBG] pgmap v6325: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:08:00.373 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:08:00.374 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:08:00.374 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:08:00.374 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:08:00.374 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:08:01.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:08:01 smithi086 bash[24289]: audit 2024-09-16T09:07:59.922262+0000 mgr.a (mgr.14373) 9123 : audit [DBG] from='client.202839 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:08:01.340 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:08:01 smithi047 bash[22744]: audit 2024-09-16T09:07:59.922262+0000 mgr.a (mgr.14373) 9123 : audit [DBG] from='client.202839 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:08:01.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:08:01 smithi157 bash[24585]: audit 2024-09-16T09:07:59.922262+0000 mgr.a (mgr.14373) 9123 : audit [DBG] from='client.202839 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:08:02.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:08:02 smithi086 bash[24289]: cluster 2024-09-16T09:08:00.692476+0000 mgr.a (mgr.14373) 9124 : cluster [DBG] pgmap v6326: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:08:02.341 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:08:02 smithi047 bash[22744]: cluster 2024-09-16T09:08:00.692476+0000 mgr.a (mgr.14373) 9124 : cluster [DBG] pgmap v6326: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:08:02.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:08:02 smithi157 bash[24585]: cluster 2024-09-16T09:08:00.692476+0000 mgr.a (mgr.14373) 9124 : cluster [DBG] pgmap v6326: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:08:04.341 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:08:04 smithi047 bash[22744]: cluster 2024-09-16T09:08:02.694736+0000 mgr.a (mgr.14373) 9125 : cluster [DBG] pgmap v6327: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:08:04.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:08:04 smithi157 bash[24585]: cluster 2024-09-16T09:08:02.694736+0000 mgr.a (mgr.14373) 9125 : cluster [DBG] pgmap v6327: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:08:04.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:08:04 smithi086 bash[24289]: cluster 2024-09-16T09:08:02.694736+0000 mgr.a (mgr.14373) 9125 : cluster [DBG] pgmap v6327: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:08:05.375 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:08:05.376 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:08:05.376 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:08:06.141 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:08:06.141 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:08:06.141 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:08:06.141 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:08:06.141 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:08:06.341 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:08:06 smithi047 bash[22744]: cluster 2024-09-16T09:08:04.695530+0000 mgr.a (mgr.14373) 9126 : cluster [DBG] pgmap v6328: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:08:06.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:08:06 smithi157 bash[24585]: cluster 2024-09-16T09:08:04.695530+0000 mgr.a (mgr.14373) 9126 : cluster [DBG] pgmap v6328: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:08:06.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:08:06 smithi086 bash[24289]: cluster 2024-09-16T09:08:04.695530+0000 mgr.a (mgr.14373) 9126 : cluster [DBG] pgmap v6328: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:08:07.341 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:08:07 smithi047 bash[22744]: audit 2024-09-16T09:08:05.706722+0000 mgr.a (mgr.14373) 9127 : audit [DBG] from='client.202917 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:08:07.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:08:07 smithi157 bash[24585]: audit 2024-09-16T09:08:05.706722+0000 mgr.a (mgr.14373) 9127 : audit [DBG] from='client.202917 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:08:07.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:08:07 smithi086 bash[24289]: audit 2024-09-16T09:08:05.706722+0000 mgr.a (mgr.14373) 9127 : audit [DBG] from='client.202917 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:08:08.341 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:08:08 smithi047 bash[22744]: cluster 2024-09-16T09:08:06.697887+0000 mgr.a (mgr.14373) 9128 : cluster [DBG] pgmap v6329: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-16T09:08:08.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:08:08 smithi157 bash[24585]: cluster 2024-09-16T09:08:06.697887+0000 mgr.a (mgr.14373) 9128 : cluster [DBG] pgmap v6329: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-16T09:08:08.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:08:08 smithi086 bash[24289]: cluster 2024-09-16T09:08:06.697887+0000 mgr.a (mgr.14373) 9128 : cluster [DBG] pgmap v6329: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-16T09:08:10.341 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:08:10 smithi047 bash[22744]: cluster 2024-09-16T09:08:08.698664+0000 mgr.a (mgr.14373) 9129 : cluster [DBG] pgmap v6330: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-16T09:08:10.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:08:10 smithi157 bash[24585]: cluster 2024-09-16T09:08:08.698664+0000 mgr.a (mgr.14373) 9129 : cluster [DBG] pgmap v6330: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-16T09:08:10.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:08:10 smithi086 bash[24289]: cluster 2024-09-16T09:08:08.698664+0000 mgr.a (mgr.14373) 9129 : cluster [DBG] pgmap v6330: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-16T09:08:11.142 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:08:11.143 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:08:11.143 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:08:11.926 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:08:11.926 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:08:11.926 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:08:11.926 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:08:11.926 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:08:12.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:08:12 smithi157 bash[24585]: cluster 2024-09-16T09:08:10.699443+0000 mgr.a (mgr.14373) 9130 : cluster [DBG] pgmap v6331: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-16T09:08:12.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:08:12 smithi086 bash[24289]: cluster 2024-09-16T09:08:10.699443+0000 mgr.a (mgr.14373) 9130 : cluster [DBG] pgmap v6331: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-16T09:08:12.591 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:08:12 smithi047 bash[22744]: cluster 2024-09-16T09:08:10.699443+0000 mgr.a (mgr.14373) 9130 : cluster [DBG] pgmap v6331: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-16T09:08:13.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:08:13 smithi157 bash[24585]: audit 2024-09-16T09:08:11.485119+0000 mgr.a (mgr.14373) 9131 : audit [DBG] from='client.202992 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:08:13.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:08:13 smithi086 bash[24289]: audit 2024-09-16T09:08:11.485119+0000 mgr.a (mgr.14373) 9131 : audit [DBG] from='client.202992 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:08:13.591 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:08:13 smithi047 bash[22744]: audit 2024-09-16T09:08:11.485119+0000 mgr.a (mgr.14373) 9131 : audit [DBG] from='client.202992 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:08:14.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:08:14 smithi157 bash[24585]: cluster 2024-09-16T09:08:12.702273+0000 mgr.a (mgr.14373) 9132 : cluster [DBG] pgmap v6332: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-16T09:08:14.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:08:14 smithi086 bash[24289]: cluster 2024-09-16T09:08:12.702273+0000 mgr.a (mgr.14373) 9132 : cluster [DBG] pgmap v6332: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-16T09:08:14.591 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:08:14 smithi047 bash[22744]: cluster 2024-09-16T09:08:12.702273+0000 mgr.a (mgr.14373) 9132 : cluster [DBG] pgmap v6332: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-16T09:08:16.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:08:16 smithi157 bash[24585]: cluster 2024-09-16T09:08:14.703065+0000 mgr.a (mgr.14373) 9133 : cluster [DBG] pgmap v6333: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 4.9 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-16T09:08:16.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:08:16 smithi086 bash[24289]: cluster 2024-09-16T09:08:14.703065+0000 mgr.a (mgr.14373) 9133 : cluster [DBG] pgmap v6333: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 4.9 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-16T09:08:16.591 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:08:16 smithi047 bash[22744]: cluster 2024-09-16T09:08:14.703065+0000 mgr.a (mgr.14373) 9133 : cluster [DBG] pgmap v6333: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 4.9 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-16T09:08:16.927 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:08:16.928 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:08:16.928 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:08:17.693 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:08:17.694 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:08:17.694 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:08:17.694 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:08:17.694 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:08:18.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:08:18 smithi157 bash[24585]: cluster 2024-09-16T09:08:16.705169+0000 mgr.a (mgr.14373) 9134 : cluster [DBG] pgmap v6334: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-16T09:08:18.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:08:18 smithi086 bash[24289]: cluster 2024-09-16T09:08:16.705169+0000 mgr.a (mgr.14373) 9134 : cluster [DBG] pgmap v6334: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-16T09:08:18.591 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:08:18 smithi047 bash[22744]: cluster 2024-09-16T09:08:16.705169+0000 mgr.a (mgr.14373) 9134 : cluster [DBG] pgmap v6334: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-16T09:08:19.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:08:19 smithi157 bash[24585]: audit 2024-09-16T09:08:17.263050+0000 mgr.a (mgr.14373) 9135 : audit [DBG] from='client.203064 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:08:19.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:08:19 smithi086 bash[24289]: audit 2024-09-16T09:08:17.263050+0000 mgr.a (mgr.14373) 9135 : audit [DBG] from='client.203064 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:08:19.591 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:08:19 smithi047 bash[22744]: audit 2024-09-16T09:08:17.263050+0000 mgr.a (mgr.14373) 9135 : audit [DBG] from='client.203064 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:08:20.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:08:20 smithi157 bash[24585]: cluster 2024-09-16T09:08:18.706100+0000 mgr.a (mgr.14373) 9136 : cluster [DBG] pgmap v6335: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:08:20.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:08:20 smithi086 bash[24289]: cluster 2024-09-16T09:08:18.706100+0000 mgr.a (mgr.14373) 9136 : cluster [DBG] pgmap v6335: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:08:20.591 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:08:20 smithi047 bash[22744]: cluster 2024-09-16T09:08:18.706100+0000 mgr.a (mgr.14373) 9136 : cluster [DBG] pgmap v6335: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:08:22.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:08:22 smithi157 bash[24585]: cluster 2024-09-16T09:08:20.706885+0000 mgr.a (mgr.14373) 9137 : cluster [DBG] pgmap v6336: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T09:08:22.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:08:22 smithi086 bash[24289]: cluster 2024-09-16T09:08:20.706885+0000 mgr.a (mgr.14373) 9137 : cluster [DBG] pgmap v6336: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T09:08:22.591 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:08:22 smithi047 bash[22744]: cluster 2024-09-16T09:08:20.706885+0000 mgr.a (mgr.14373) 9137 : cluster [DBG] pgmap v6336: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T09:08:22.695 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:08:22.696 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:08:22.696 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:08:23.464 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:08:23.465 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:08:23.465 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:08:23.465 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:08:23.465 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:08:24.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:08:24 smithi157 bash[24585]: cluster 2024-09-16T09:08:22.709129+0000 mgr.a (mgr.14373) 9138 : cluster [DBG] pgmap v6337: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 65 KiB/s rd, 0 B/s wr, 107 op/s 2024-09-16T09:08:24.723 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:08:24 smithi157 bash[24585]: audit 2024-09-16T09:08:23.028485+0000 mgr.a (mgr.14373) 9139 : audit [DBG] from='client.203142 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:08:24.724 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:08:24 smithi047 bash[22744]: cluster 2024-09-16T09:08:22.709129+0000 mgr.a (mgr.14373) 9138 : cluster [DBG] pgmap v6337: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 65 KiB/s rd, 0 B/s wr, 107 op/s 2024-09-16T09:08:24.724 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:08:24 smithi047 bash[22744]: audit 2024-09-16T09:08:23.028485+0000 mgr.a (mgr.14373) 9139 : audit [DBG] from='client.203142 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:08:24.724 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:08:24 smithi086 bash[24289]: cluster 2024-09-16T09:08:22.709129+0000 mgr.a (mgr.14373) 9138 : cluster [DBG] pgmap v6337: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 65 KiB/s rd, 0 B/s wr, 107 op/s 2024-09-16T09:08:24.724 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:08:24 smithi086 bash[24289]: audit 2024-09-16T09:08:23.028485+0000 mgr.a (mgr.14373) 9139 : audit [DBG] from='client.203142 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:08:26.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:08:26 smithi157 bash[24585]: cluster 2024-09-16T09:08:24.710056+0000 mgr.a (mgr.14373) 9140 : cluster [DBG] pgmap v6338: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 65 KiB/s rd, 0 B/s wr, 107 op/s 2024-09-16T09:08:26.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:08:26 smithi086 bash[24289]: cluster 2024-09-16T09:08:24.710056+0000 mgr.a (mgr.14373) 9140 : cluster [DBG] pgmap v6338: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 65 KiB/s rd, 0 B/s wr, 107 op/s 2024-09-16T09:08:26.591 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:08:26 smithi047 bash[22744]: cluster 2024-09-16T09:08:24.710056+0000 mgr.a (mgr.14373) 9140 : cluster [DBG] pgmap v6338: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 65 KiB/s rd, 0 B/s wr, 107 op/s 2024-09-16T09:08:28.466 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:08:28.467 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:08:28.467 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:08:28.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:08:28 smithi157 bash[24585]: cluster 2024-09-16T09:08:26.712246+0000 mgr.a (mgr.14373) 9141 : cluster [DBG] pgmap v6339: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 66 KiB/s rd, 0 B/s wr, 108 op/s 2024-09-16T09:08:28.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:08:28 smithi086 bash[24289]: cluster 2024-09-16T09:08:26.712246+0000 mgr.a (mgr.14373) 9141 : cluster [DBG] pgmap v6339: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 66 KiB/s rd, 0 B/s wr, 108 op/s 2024-09-16T09:08:28.591 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:08:28 smithi047 bash[22744]: cluster 2024-09-16T09:08:26.712246+0000 mgr.a (mgr.14373) 9141 : cluster [DBG] pgmap v6339: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 66 KiB/s rd, 0 B/s wr, 108 op/s 2024-09-16T09:08:29.213 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:08:29.213 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:08:29.213 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:08:29.213 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:08:29.213 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:08:30.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:08:30 smithi157 bash[24585]: cluster 2024-09-16T09:08:28.712974+0000 mgr.a (mgr.14373) 9142 : cluster [DBG] pgmap v6340: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 65 KiB/s rd, 0 B/s wr, 107 op/s 2024-09-16T09:08:30.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:08:30 smithi157 bash[24585]: audit 2024-09-16T09:08:28.800025+0000 mgr.a (mgr.14373) 9143 : audit [DBG] from='client.203217 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:08:30.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:08:30 smithi086 bash[24289]: cluster 2024-09-16T09:08:28.712974+0000 mgr.a (mgr.14373) 9142 : cluster [DBG] pgmap v6340: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 65 KiB/s rd, 0 B/s wr, 107 op/s 2024-09-16T09:08:30.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:08:30 smithi086 bash[24289]: audit 2024-09-16T09:08:28.800025+0000 mgr.a (mgr.14373) 9143 : audit [DBG] from='client.203217 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:08:30.591 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:08:30 smithi047 bash[22744]: cluster 2024-09-16T09:08:28.712974+0000 mgr.a (mgr.14373) 9142 : cluster [DBG] pgmap v6340: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 65 KiB/s rd, 0 B/s wr, 107 op/s 2024-09-16T09:08:30.591 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:08:30 smithi047 bash[22744]: audit 2024-09-16T09:08:28.800025+0000 mgr.a (mgr.14373) 9143 : audit [DBG] from='client.203217 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:08:32.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:08:32 smithi157 bash[24585]: cluster 2024-09-16T09:08:30.713875+0000 mgr.a (mgr.14373) 9144 : cluster [DBG] pgmap v6341: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 65 KiB/s rd, 0 B/s wr, 107 op/s 2024-09-16T09:08:32.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:08:32 smithi086 bash[24289]: cluster 2024-09-16T09:08:30.713875+0000 mgr.a (mgr.14373) 9144 : cluster [DBG] pgmap v6341: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 65 KiB/s rd, 0 B/s wr, 107 op/s 2024-09-16T09:08:32.591 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:08:32 smithi047 bash[22744]: cluster 2024-09-16T09:08:30.713875+0000 mgr.a (mgr.14373) 9144 : cluster [DBG] pgmap v6341: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 65 KiB/s rd, 0 B/s wr, 107 op/s 2024-09-16T09:08:33.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:08:33 smithi157 bash[24585]: audit 2024-09-16T09:08:32.789709+0000 mon.b (mon.2) 854 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T09:08:33.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:08:33 smithi086 bash[24289]: audit 2024-09-16T09:08:32.789709+0000 mon.b (mon.2) 854 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T09:08:33.591 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:08:33 smithi047 bash[22744]: audit 2024-09-16T09:08:32.789709+0000 mon.b (mon.2) 854 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T09:08:34.214 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:08:34.215 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:08:34.215 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:08:34.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:08:34 smithi157 bash[24585]: cluster 2024-09-16T09:08:32.716130+0000 mgr.a (mgr.14373) 9145 : cluster [DBG] pgmap v6342: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 66 KiB/s rd, 0 B/s wr, 108 op/s 2024-09-16T09:08:34.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:08:34 smithi086 bash[24289]: cluster 2024-09-16T09:08:32.716130+0000 mgr.a (mgr.14373) 9145 : cluster [DBG] pgmap v6342: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 66 KiB/s rd, 0 B/s wr, 108 op/s 2024-09-16T09:08:34.591 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:08:34 smithi047 bash[22744]: cluster 2024-09-16T09:08:32.716130+0000 mgr.a (mgr.14373) 9145 : cluster [DBG] pgmap v6342: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 66 KiB/s rd, 0 B/s wr, 108 op/s 2024-09-16T09:08:34.973 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:08:34.973 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:08:34.973 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:08:34.973 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:08:34.973 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:08:36.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:08:36 smithi157 bash[24585]: audit 2024-09-16T09:08:34.543815+0000 mgr.a (mgr.14373) 9146 : audit [DBG] from='client.203295 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:08:36.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:08:36 smithi157 bash[24585]: cluster 2024-09-16T09:08:34.717038+0000 mgr.a (mgr.14373) 9147 : cluster [DBG] pgmap v6343: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:08:36.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:08:36 smithi086 bash[24289]: audit 2024-09-16T09:08:34.543815+0000 mgr.a (mgr.14373) 9146 : audit [DBG] from='client.203295 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:08:36.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:08:36 smithi086 bash[24289]: cluster 2024-09-16T09:08:34.717038+0000 mgr.a (mgr.14373) 9147 : cluster [DBG] pgmap v6343: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:08:36.591 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:08:36 smithi047 bash[22744]: audit 2024-09-16T09:08:34.543815+0000 mgr.a (mgr.14373) 9146 : audit [DBG] from='client.203295 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:08:36.591 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:08:36 smithi047 bash[22744]: cluster 2024-09-16T09:08:34.717038+0000 mgr.a (mgr.14373) 9147 : cluster [DBG] pgmap v6343: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:08:38.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:08:38 smithi157 bash[24585]: cluster 2024-09-16T09:08:36.719450+0000 mgr.a (mgr.14373) 9148 : cluster [DBG] pgmap v6344: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:08:38.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:08:38 smithi157 bash[24585]: audit 2024-09-16T09:08:38.129642+0000 mon.a (mon.0) 1106 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:08:38.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:08:38 smithi157 bash[24585]: audit 2024-09-16T09:08:38.135457+0000 mon.a (mon.0) 1107 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:08:38.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:08:38 smithi086 bash[24289]: cluster 2024-09-16T09:08:36.719450+0000 mgr.a (mgr.14373) 9148 : cluster [DBG] pgmap v6344: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:08:38.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:08:38 smithi086 bash[24289]: audit 2024-09-16T09:08:38.129642+0000 mon.a (mon.0) 1106 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:08:38.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:08:38 smithi086 bash[24289]: audit 2024-09-16T09:08:38.135457+0000 mon.a (mon.0) 1107 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:08:38.591 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:08:38 smithi047 bash[22744]: cluster 2024-09-16T09:08:36.719450+0000 mgr.a (mgr.14373) 9148 : cluster [DBG] pgmap v6344: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:08:38.591 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:08:38 smithi047 bash[22744]: audit 2024-09-16T09:08:38.129642+0000 mon.a (mon.0) 1106 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:08:38.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:08:38 smithi047 bash[22744]: audit 2024-09-16T09:08:38.135457+0000 mon.a (mon.0) 1107 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:08:39.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:08:39 smithi157 bash[24585]: audit 2024-09-16T09:08:38.173205+0000 mon.a (mon.0) 1108 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:08:39.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:08:39 smithi157 bash[24585]: audit 2024-09-16T09:08:38.178086+0000 mon.a (mon.0) 1109 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:08:39.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:08:39 smithi157 bash[24585]: audit 2024-09-16T09:08:38.183401+0000 mon.a (mon.0) 1110 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:08:39.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:08:39 smithi157 bash[24585]: audit 2024-09-16T09:08:38.188404+0000 mon.a (mon.0) 1111 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:08:39.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:08:39 smithi086 bash[24289]: audit 2024-09-16T09:08:38.173205+0000 mon.a (mon.0) 1108 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:08:39.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:08:39 smithi086 bash[24289]: audit 2024-09-16T09:08:38.178086+0000 mon.a (mon.0) 1109 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:08:39.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:08:39 smithi086 bash[24289]: audit 2024-09-16T09:08:38.183401+0000 mon.a (mon.0) 1110 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:08:39.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:08:39 smithi086 bash[24289]: audit 2024-09-16T09:08:38.188404+0000 mon.a (mon.0) 1111 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:08:39.591 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:08:39 smithi047 bash[22744]: audit 2024-09-16T09:08:38.173205+0000 mon.a (mon.0) 1108 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:08:39.591 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:08:39 smithi047 bash[22744]: audit 2024-09-16T09:08:38.178086+0000 mon.a (mon.0) 1109 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:08:39.591 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:08:39 smithi047 bash[22744]: audit 2024-09-16T09:08:38.183401+0000 mon.a (mon.0) 1110 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:08:39.591 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:08:39 smithi047 bash[22744]: audit 2024-09-16T09:08:38.188404+0000 mon.a (mon.0) 1111 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:08:39.973 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:08:39.973 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:08:39.974 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:08:40.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:08:40 smithi157 bash[24585]: cluster 2024-09-16T09:08:38.720018+0000 mgr.a (mgr.14373) 9149 : cluster [DBG] pgmap v6345: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:08:40.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:08:40 smithi086 bash[24289]: cluster 2024-09-16T09:08:38.720018+0000 mgr.a (mgr.14373) 9149 : cluster [DBG] pgmap v6345: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:08:40.591 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:08:40 smithi047 bash[22744]: cluster 2024-09-16T09:08:38.720018+0000 mgr.a (mgr.14373) 9149 : cluster [DBG] pgmap v6345: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:08:40.741 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:08:40.741 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:08:40.742 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:08:40.742 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:08:40.742 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:08:42.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:08:42 smithi157 bash[24585]: audit 2024-09-16T09:08:40.306389+0000 mgr.a (mgr.14373) 9150 : audit [DBG] from='client.203373 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:08:42.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:08:42 smithi157 bash[24585]: cluster 2024-09-16T09:08:40.720571+0000 mgr.a (mgr.14373) 9151 : cluster [DBG] pgmap v6346: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:08:42.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:08:42 smithi086 bash[24289]: audit 2024-09-16T09:08:40.306389+0000 mgr.a (mgr.14373) 9150 : audit [DBG] from='client.203373 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:08:42.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:08:42 smithi086 bash[24289]: cluster 2024-09-16T09:08:40.720571+0000 mgr.a (mgr.14373) 9151 : cluster [DBG] pgmap v6346: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:08:42.591 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:08:42 smithi047 bash[22744]: audit 2024-09-16T09:08:40.306389+0000 mgr.a (mgr.14373) 9150 : audit [DBG] from='client.203373 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:08:42.591 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:08:42 smithi047 bash[22744]: cluster 2024-09-16T09:08:40.720571+0000 mgr.a (mgr.14373) 9151 : cluster [DBG] pgmap v6346: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:08:44.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:08:44 smithi047 bash[22744]: cluster 2024-09-16T09:08:42.722838+0000 mgr.a (mgr.14373) 9152 : cluster [DBG] pgmap v6347: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:08:44.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:08:44 smithi157 bash[24585]: cluster 2024-09-16T09:08:42.722838+0000 mgr.a (mgr.14373) 9152 : cluster [DBG] pgmap v6347: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:08:44.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:08:44 smithi086 bash[24289]: cluster 2024-09-16T09:08:42.722838+0000 mgr.a (mgr.14373) 9152 : cluster [DBG] pgmap v6347: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:08:45.467 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:08:45 smithi047 bash[22744]: cluster 2024-09-16T09:08:44.723609+0000 mgr.a (mgr.14373) 9153 : cluster [DBG] pgmap v6348: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:08:45.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:08:45 smithi157 bash[24585]: cluster 2024-09-16T09:08:44.723609+0000 mgr.a (mgr.14373) 9153 : cluster [DBG] pgmap v6348: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:08:45.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:08:45 smithi086 bash[24289]: cluster 2024-09-16T09:08:44.723609+0000 mgr.a (mgr.14373) 9153 : cluster [DBG] pgmap v6348: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:08:45.743 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:08:45.744 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:08:45.744 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:08:46.341 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:08:46 smithi047 bash[22744]: audit 2024-09-16T09:08:46.077582+0000 mgr.a (mgr.14373) 9154 : audit [DBG] from='client.203448 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:08:46.501 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:08:46.501 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:08:46.501 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:08:46.501 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:08:46.501 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:08:46.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:08:46 smithi157 bash[24585]: audit 2024-09-16T09:08:46.077582+0000 mgr.a (mgr.14373) 9154 : audit [DBG] from='client.203448 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:08:46.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:08:46 smithi086 bash[24289]: audit 2024-09-16T09:08:46.077582+0000 mgr.a (mgr.14373) 9154 : audit [DBG] from='client.203448 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:08:47.341 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:08:47 smithi047 bash[22744]: cluster 2024-09-16T09:08:46.726047+0000 mgr.a (mgr.14373) 9155 : cluster [DBG] pgmap v6349: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-16T09:08:47.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:08:47 smithi157 bash[24585]: cluster 2024-09-16T09:08:46.726047+0000 mgr.a (mgr.14373) 9155 : cluster [DBG] pgmap v6349: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-16T09:08:47.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:08:47 smithi086 bash[24289]: cluster 2024-09-16T09:08:46.726047+0000 mgr.a (mgr.14373) 9155 : cluster [DBG] pgmap v6349: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-16T09:08:50.091 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 09:08:49 smithi047 bash[22994]: debug 2024-09-16T09:08:49.662+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T09:08:50.092 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 09:08:49 smithi047 bash[22994]: debug 2024-09-16T09:08:49.666+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T09:08:50.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:08:49 smithi047 bash[22744]: cluster 2024-09-16T09:08:48.726821+0000 mgr.a (mgr.14373) 9156 : cluster [DBG] pgmap v6350: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T09:08:50.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:08:49 smithi047 bash[22744]: audit 2024-09-16T09:08:48.851881+0000 mon.a (mon.0) 1112 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:08:50.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:08:49 smithi047 bash[22744]: audit 2024-09-16T09:08:48.862358+0000 mon.a (mon.0) 1113 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:08:50.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:08:49 smithi047 bash[22744]: audit 2024-09-16T09:08:48.867603+0000 mon.b (mon.2) 855 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:08:50.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:08:49 smithi047 bash[22744]: audit 2024-09-16T09:08:48.869868+0000 mon.b (mon.2) 856 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T09:08:50.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:08:49 smithi047 bash[22744]: audit 2024-09-16T09:08:48.881064+0000 mon.a (mon.0) 1114 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:08:50.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:08:49 smithi047 bash[22744]: audit 2024-09-16T09:08:48.887447+0000 mon.b (mon.2) 857 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:08:50.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:08:49 smithi047 bash[22744]: audit 2024-09-16T09:08:48.889330+0000 mgr.a (mgr.14373) 9157 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:08:50.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:08:49 smithi157 bash[24585]: cluster 2024-09-16T09:08:48.726821+0000 mgr.a (mgr.14373) 9156 : cluster [DBG] pgmap v6350: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T09:08:50.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:08:49 smithi157 bash[24585]: audit 2024-09-16T09:08:48.851881+0000 mon.a (mon.0) 1112 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:08:50.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:08:49 smithi157 bash[24585]: audit 2024-09-16T09:08:48.862358+0000 mon.a (mon.0) 1113 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:08:50.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:08:49 smithi157 bash[24585]: audit 2024-09-16T09:08:48.867603+0000 mon.b (mon.2) 855 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:08:50.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:08:49 smithi157 bash[24585]: audit 2024-09-16T09:08:48.869868+0000 mon.b (mon.2) 856 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T09:08:50.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:08:49 smithi157 bash[24585]: audit 2024-09-16T09:08:48.881064+0000 mon.a (mon.0) 1114 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:08:50.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:08:49 smithi157 bash[24585]: audit 2024-09-16T09:08:48.887447+0000 mon.b (mon.2) 857 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:08:50.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:08:49 smithi157 bash[24585]: audit 2024-09-16T09:08:48.889330+0000 mgr.a (mgr.14373) 9157 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:08:50.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:08:49 smithi086 bash[24289]: cluster 2024-09-16T09:08:48.726821+0000 mgr.a (mgr.14373) 9156 : cluster [DBG] pgmap v6350: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T09:08:50.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:08:49 smithi086 bash[24289]: audit 2024-09-16T09:08:48.851881+0000 mon.a (mon.0) 1112 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:08:50.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:08:49 smithi086 bash[24289]: audit 2024-09-16T09:08:48.862358+0000 mon.a (mon.0) 1113 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:08:50.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:08:49 smithi086 bash[24289]: audit 2024-09-16T09:08:48.867603+0000 mon.b (mon.2) 855 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:08:50.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:08:49 smithi086 bash[24289]: audit 2024-09-16T09:08:48.869868+0000 mon.b (mon.2) 856 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T09:08:50.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:08:49 smithi086 bash[24289]: audit 2024-09-16T09:08:48.881064+0000 mon.a (mon.0) 1114 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:08:50.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:08:49 smithi086 bash[24289]: audit 2024-09-16T09:08:48.887447+0000 mon.b (mon.2) 857 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:08:50.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:08:49 smithi086 bash[24289]: audit 2024-09-16T09:08:48.889330+0000 mgr.a (mgr.14373) 9157 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:08:51.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:08:50 smithi157 bash[24585]: audit 2024-09-16T09:08:49.664604+0000 mgr.a (mgr.14373) 9158 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T09:08:51.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:08:50 smithi157 bash[24585]: cephadm 2024-09-16T09:08:49.666838+0000 mgr.a (mgr.14373) 9159 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T09:08:51.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:08:50 smithi086 bash[24289]: audit 2024-09-16T09:08:49.664604+0000 mgr.a (mgr.14373) 9158 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T09:08:51.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:08:50 smithi086 bash[24289]: cephadm 2024-09-16T09:08:49.666838+0000 mgr.a (mgr.14373) 9159 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T09:08:51.341 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:08:50 smithi047 bash[22744]: audit 2024-09-16T09:08:49.664604+0000 mgr.a (mgr.14373) 9158 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T09:08:51.341 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:08:50 smithi047 bash[22744]: cephadm 2024-09-16T09:08:49.666838+0000 mgr.a (mgr.14373) 9159 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T09:08:51.502 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:08:51.503 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:08:51.503 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:08:52.276 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:08:52.277 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:08:52.277 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:08:52.277 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:08:52.277 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:08:52.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:08:51 smithi157 bash[24585]: cluster 2024-09-16T09:08:50.727948+0000 mgr.a (mgr.14373) 9160 : cluster [DBG] pgmap v6351: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T09:08:52.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:08:51 smithi086 bash[24289]: cluster 2024-09-16T09:08:50.727948+0000 mgr.a (mgr.14373) 9160 : cluster [DBG] pgmap v6351: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T09:08:52.341 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:08:51 smithi047 bash[22744]: cluster 2024-09-16T09:08:50.727948+0000 mgr.a (mgr.14373) 9160 : cluster [DBG] pgmap v6351: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T09:08:53.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:08:52 smithi157 bash[24585]: audit 2024-09-16T09:08:51.840527+0000 mgr.a (mgr.14373) 9161 : audit [DBG] from='client.203625 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:08:53.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:08:52 smithi086 bash[24289]: audit 2024-09-16T09:08:51.840527+0000 mgr.a (mgr.14373) 9161 : audit [DBG] from='client.203625 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:08:53.341 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:08:52 smithi047 bash[22744]: audit 2024-09-16T09:08:51.840527+0000 mgr.a (mgr.14373) 9161 : audit [DBG] from='client.203625 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:08:54.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:08:53 smithi157 bash[24585]: cluster 2024-09-16T09:08:52.730816+0000 mgr.a (mgr.14373) 9162 : cluster [DBG] pgmap v6352: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:08:54.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:08:53 smithi086 bash[24289]: cluster 2024-09-16T09:08:52.730816+0000 mgr.a (mgr.14373) 9162 : cluster [DBG] pgmap v6352: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:08:54.341 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:08:53 smithi047 bash[22744]: cluster 2024-09-16T09:08:52.730816+0000 mgr.a (mgr.14373) 9162 : cluster [DBG] pgmap v6352: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:08:56.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:08:55 smithi157 bash[24585]: cluster 2024-09-16T09:08:54.731643+0000 mgr.a (mgr.14373) 9163 : cluster [DBG] pgmap v6353: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T09:08:56.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:08:55 smithi086 bash[24289]: cluster 2024-09-16T09:08:54.731643+0000 mgr.a (mgr.14373) 9163 : cluster [DBG] pgmap v6353: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T09:08:56.341 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:08:55 smithi047 bash[22744]: cluster 2024-09-16T09:08:54.731643+0000 mgr.a (mgr.14373) 9163 : cluster [DBG] pgmap v6353: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T09:08:57.278 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:08:57.279 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:08:57.279 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:08:58.063 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:08:58.063 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:08:58.064 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:08:58.064 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:08:58.064 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:08:58.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:08:57 smithi157 bash[24585]: cluster 2024-09-16T09:08:56.733585+0000 mgr.a (mgr.14373) 9164 : cluster [DBG] pgmap v6354: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:08:58.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:08:57 smithi086 bash[24289]: cluster 2024-09-16T09:08:56.733585+0000 mgr.a (mgr.14373) 9164 : cluster [DBG] pgmap v6354: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:08:58.341 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:08:57 smithi047 bash[22744]: cluster 2024-09-16T09:08:56.733585+0000 mgr.a (mgr.14373) 9164 : cluster [DBG] pgmap v6354: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:08:59.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:08:58 smithi157 bash[24585]: audit 2024-09-16T09:08:57.615049+0000 mgr.a (mgr.14373) 9165 : audit [DBG] from='client.203703 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:08:59.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:08:58 smithi086 bash[24289]: audit 2024-09-16T09:08:57.615049+0000 mgr.a (mgr.14373) 9165 : audit [DBG] from='client.203703 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:08:59.341 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:08:58 smithi047 bash[22744]: audit 2024-09-16T09:08:57.615049+0000 mgr.a (mgr.14373) 9165 : audit [DBG] from='client.203703 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:09:00.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:08:59 smithi157 bash[24585]: cluster 2024-09-16T09:08:58.734597+0000 mgr.a (mgr.14373) 9166 : cluster [DBG] pgmap v6355: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T09:09:00.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:08:59 smithi086 bash[24289]: cluster 2024-09-16T09:08:58.734597+0000 mgr.a (mgr.14373) 9166 : cluster [DBG] pgmap v6355: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T09:09:00.341 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:08:59 smithi047 bash[22744]: cluster 2024-09-16T09:08:58.734597+0000 mgr.a (mgr.14373) 9166 : cluster [DBG] pgmap v6355: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T09:09:02.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:09:01 smithi157 bash[24585]: cluster 2024-09-16T09:09:00.735592+0000 mgr.a (mgr.14373) 9167 : cluster [DBG] pgmap v6356: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T09:09:02.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:09:01 smithi086 bash[24289]: cluster 2024-09-16T09:09:00.735592+0000 mgr.a (mgr.14373) 9167 : cluster [DBG] pgmap v6356: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T09:09:02.341 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:09:01 smithi047 bash[22744]: cluster 2024-09-16T09:09:00.735592+0000 mgr.a (mgr.14373) 9167 : cluster [DBG] pgmap v6356: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T09:09:03.065 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:09:03.065 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:09:03.066 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:09:03.813 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:09:03.814 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:09:03.814 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:09:03.814 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:09:03.814 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:09:04.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:09:03 smithi157 bash[24585]: cluster 2024-09-16T09:09:02.737974+0000 mgr.a (mgr.14373) 9168 : cluster [DBG] pgmap v6357: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:09:04.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:09:03 smithi086 bash[24289]: cluster 2024-09-16T09:09:02.737974+0000 mgr.a (mgr.14373) 9168 : cluster [DBG] pgmap v6357: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:09:04.341 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:09:03 smithi047 bash[22744]: cluster 2024-09-16T09:09:02.737974+0000 mgr.a (mgr.14373) 9168 : cluster [DBG] pgmap v6357: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:09:05.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:09:04 smithi157 bash[24585]: audit 2024-09-16T09:09:03.395453+0000 mgr.a (mgr.14373) 9169 : audit [DBG] from='client.203775 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:09:05.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:09:04 smithi086 bash[24289]: audit 2024-09-16T09:09:03.395453+0000 mgr.a (mgr.14373) 9169 : audit [DBG] from='client.203775 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:09:05.341 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:09:04 smithi047 bash[22744]: audit 2024-09-16T09:09:03.395453+0000 mgr.a (mgr.14373) 9169 : audit [DBG] from='client.203775 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:09:06.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:09:05 smithi157 bash[24585]: cluster 2024-09-16T09:09:04.738996+0000 mgr.a (mgr.14373) 9170 : cluster [DBG] pgmap v6358: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:09:06.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:09:05 smithi086 bash[24289]: cluster 2024-09-16T09:09:04.738996+0000 mgr.a (mgr.14373) 9170 : cluster [DBG] pgmap v6358: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:09:06.341 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:09:05 smithi047 bash[22744]: cluster 2024-09-16T09:09:04.738996+0000 mgr.a (mgr.14373) 9170 : cluster [DBG] pgmap v6358: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:09:08.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:09:07 smithi157 bash[24585]: cluster 2024-09-16T09:09:06.741176+0000 mgr.a (mgr.14373) 9171 : cluster [DBG] pgmap v6359: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:09:08.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:09:07 smithi086 bash[24289]: cluster 2024-09-16T09:09:06.741176+0000 mgr.a (mgr.14373) 9171 : cluster [DBG] pgmap v6359: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:09:08.341 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:09:07 smithi047 bash[22744]: cluster 2024-09-16T09:09:06.741176+0000 mgr.a (mgr.14373) 9171 : cluster [DBG] pgmap v6359: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:09:08.816 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:09:08.816 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:09:08.816 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:09:09.570 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:09:09.570 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:09:09.570 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:09:09.570 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:09:09.570 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:09:10.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:09:09 smithi157 bash[24585]: cluster 2024-09-16T09:09:08.741944+0000 mgr.a (mgr.14373) 9172 : cluster [DBG] pgmap v6360: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:09:10.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:09:09 smithi157 bash[24585]: audit 2024-09-16T09:09:09.145711+0000 mgr.a (mgr.14373) 9173 : audit [DBG] from='client.203850 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:09:10.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:09:09 smithi086 bash[24289]: cluster 2024-09-16T09:09:08.741944+0000 mgr.a (mgr.14373) 9172 : cluster [DBG] pgmap v6360: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:09:10.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:09:09 smithi086 bash[24289]: audit 2024-09-16T09:09:09.145711+0000 mgr.a (mgr.14373) 9173 : audit [DBG] from='client.203850 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:09:10.341 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:09:09 smithi047 bash[22744]: cluster 2024-09-16T09:09:08.741944+0000 mgr.a (mgr.14373) 9172 : cluster [DBG] pgmap v6360: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:09:10.341 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:09:09 smithi047 bash[22744]: audit 2024-09-16T09:09:09.145711+0000 mgr.a (mgr.14373) 9173 : audit [DBG] from='client.203850 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:09:12.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:09:11 smithi157 bash[24585]: cluster 2024-09-16T09:09:10.743030+0000 mgr.a (mgr.14373) 9174 : cluster [DBG] pgmap v6361: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:09:12.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:09:11 smithi086 bash[24289]: cluster 2024-09-16T09:09:10.743030+0000 mgr.a (mgr.14373) 9174 : cluster [DBG] pgmap v6361: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:09:12.341 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:09:11 smithi047 bash[22744]: cluster 2024-09-16T09:09:10.743030+0000 mgr.a (mgr.14373) 9174 : cluster [DBG] pgmap v6361: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:09:14.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:09:13 smithi157 bash[24585]: cluster 2024-09-16T09:09:12.745353+0000 mgr.a (mgr.14373) 9175 : cluster [DBG] pgmap v6362: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:09:14.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:09:13 smithi086 bash[24289]: cluster 2024-09-16T09:09:12.745353+0000 mgr.a (mgr.14373) 9175 : cluster [DBG] pgmap v6362: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:09:14.341 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:09:13 smithi047 bash[22744]: cluster 2024-09-16T09:09:12.745353+0000 mgr.a (mgr.14373) 9175 : cluster [DBG] pgmap v6362: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:09:14.571 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:09:14.572 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:09:14.572 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:09:15.311 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:09:15.311 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:09:15.311 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:09:15.311 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:09:15.311 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:09:16.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:09:15 smithi157 bash[24585]: cluster 2024-09-16T09:09:14.746119+0000 mgr.a (mgr.14373) 9176 : cluster [DBG] pgmap v6363: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:09:16.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:09:15 smithi157 bash[24585]: audit 2024-09-16T09:09:14.901558+0000 mgr.a (mgr.14373) 9177 : audit [DBG] from='client.203925 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:09:16.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:09:15 smithi086 bash[24289]: cluster 2024-09-16T09:09:14.746119+0000 mgr.a (mgr.14373) 9176 : cluster [DBG] pgmap v6363: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:09:16.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:09:15 smithi086 bash[24289]: audit 2024-09-16T09:09:14.901558+0000 mgr.a (mgr.14373) 9177 : audit [DBG] from='client.203925 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:09:16.341 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:09:15 smithi047 bash[22744]: cluster 2024-09-16T09:09:14.746119+0000 mgr.a (mgr.14373) 9176 : cluster [DBG] pgmap v6363: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:09:16.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:09:15 smithi047 bash[22744]: audit 2024-09-16T09:09:14.901558+0000 mgr.a (mgr.14373) 9177 : audit [DBG] from='client.203925 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:09:18.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:09:17 smithi157 bash[24585]: cluster 2024-09-16T09:09:16.748607+0000 mgr.a (mgr.14373) 9178 : cluster [DBG] pgmap v6364: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:09:18.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:09:17 smithi086 bash[24289]: cluster 2024-09-16T09:09:16.748607+0000 mgr.a (mgr.14373) 9178 : cluster [DBG] pgmap v6364: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:09:18.341 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:09:17 smithi047 bash[22744]: cluster 2024-09-16T09:09:16.748607+0000 mgr.a (mgr.14373) 9178 : cluster [DBG] pgmap v6364: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:09:20.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:09:19 smithi157 bash[24585]: cluster 2024-09-16T09:09:18.749567+0000 mgr.a (mgr.14373) 9179 : cluster [DBG] pgmap v6365: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:09:20.312 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:09:20.313 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:09:20.313 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:09:20.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:09:19 smithi086 bash[24289]: cluster 2024-09-16T09:09:18.749567+0000 mgr.a (mgr.14373) 9179 : cluster [DBG] pgmap v6365: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:09:20.341 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:09:19 smithi047 bash[22744]: cluster 2024-09-16T09:09:18.749567+0000 mgr.a (mgr.14373) 9179 : cluster [DBG] pgmap v6365: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:09:21.076 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:09:21.076 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:09:21.077 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:09:21.077 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:09:21.077 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:09:22.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:09:21 smithi157 bash[24585]: audit 2024-09-16T09:09:20.647081+0000 mgr.a (mgr.14373) 9180 : audit [DBG] from='client.204000 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:09:22.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:09:21 smithi157 bash[24585]: cluster 2024-09-16T09:09:20.750079+0000 mgr.a (mgr.14373) 9181 : cluster [DBG] pgmap v6366: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:09:22.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:09:21 smithi086 bash[24289]: audit 2024-09-16T09:09:20.647081+0000 mgr.a (mgr.14373) 9180 : audit [DBG] from='client.204000 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:09:22.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:09:21 smithi086 bash[24289]: cluster 2024-09-16T09:09:20.750079+0000 mgr.a (mgr.14373) 9181 : cluster [DBG] pgmap v6366: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:09:22.341 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:09:21 smithi047 bash[22744]: audit 2024-09-16T09:09:20.647081+0000 mgr.a (mgr.14373) 9180 : audit [DBG] from='client.204000 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:09:22.341 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:09:21 smithi047 bash[22744]: cluster 2024-09-16T09:09:20.750079+0000 mgr.a (mgr.14373) 9181 : cluster [DBG] pgmap v6366: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:09:24.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:09:23 smithi157 bash[24585]: cluster 2024-09-16T09:09:22.752402+0000 mgr.a (mgr.14373) 9182 : cluster [DBG] pgmap v6367: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:09:24.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:09:23 smithi086 bash[24289]: cluster 2024-09-16T09:09:22.752402+0000 mgr.a (mgr.14373) 9182 : cluster [DBG] pgmap v6367: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:09:24.341 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:09:23 smithi047 bash[22744]: cluster 2024-09-16T09:09:22.752402+0000 mgr.a (mgr.14373) 9182 : cluster [DBG] pgmap v6367: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:09:26.078 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:09:26.078 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:09:26.079 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:09:26.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:09:25 smithi157 bash[24585]: cluster 2024-09-16T09:09:24.753185+0000 mgr.a (mgr.14373) 9183 : cluster [DBG] pgmap v6368: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:09:26.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:09:25 smithi086 bash[24289]: cluster 2024-09-16T09:09:24.753185+0000 mgr.a (mgr.14373) 9183 : cluster [DBG] pgmap v6368: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:09:26.341 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:09:25 smithi047 bash[22744]: cluster 2024-09-16T09:09:24.753185+0000 mgr.a (mgr.14373) 9183 : cluster [DBG] pgmap v6368: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:09:26.829 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:09:26.829 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:09:26.830 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:09:26.830 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:09:26.830 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:09:28.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:09:27 smithi157 bash[24585]: audit 2024-09-16T09:09:26.417270+0000 mgr.a (mgr.14373) 9184 : audit [DBG] from='client.204075 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:09:28.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:09:27 smithi157 bash[24585]: cluster 2024-09-16T09:09:26.754521+0000 mgr.a (mgr.14373) 9185 : cluster [DBG] pgmap v6369: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:09:28.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:09:27 smithi086 bash[24289]: audit 2024-09-16T09:09:26.417270+0000 mgr.a (mgr.14373) 9184 : audit [DBG] from='client.204075 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:09:28.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:09:27 smithi086 bash[24289]: cluster 2024-09-16T09:09:26.754521+0000 mgr.a (mgr.14373) 9185 : cluster [DBG] pgmap v6369: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:09:28.341 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:09:27 smithi047 bash[22744]: audit 2024-09-16T09:09:26.417270+0000 mgr.a (mgr.14373) 9184 : audit [DBG] from='client.204075 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:09:28.341 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:09:27 smithi047 bash[22744]: cluster 2024-09-16T09:09:26.754521+0000 mgr.a (mgr.14373) 9185 : cluster [DBG] pgmap v6369: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:09:30.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:09:29 smithi157 bash[24585]: cluster 2024-09-16T09:09:28.755205+0000 mgr.a (mgr.14373) 9186 : cluster [DBG] pgmap v6370: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T09:09:30.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:09:29 smithi086 bash[24289]: cluster 2024-09-16T09:09:28.755205+0000 mgr.a (mgr.14373) 9186 : cluster [DBG] pgmap v6370: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T09:09:30.341 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:09:29 smithi047 bash[22744]: cluster 2024-09-16T09:09:28.755205+0000 mgr.a (mgr.14373) 9186 : cluster [DBG] pgmap v6370: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T09:09:31.831 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:09:31.832 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:09:31.832 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:09:32.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:09:31 smithi157 bash[24585]: cluster 2024-09-16T09:09:30.755977+0000 mgr.a (mgr.14373) 9187 : cluster [DBG] pgmap v6371: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T09:09:32.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:09:31 smithi086 bash[24289]: cluster 2024-09-16T09:09:30.755977+0000 mgr.a (mgr.14373) 9187 : cluster [DBG] pgmap v6371: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T09:09:32.341 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:09:31 smithi047 bash[22744]: cluster 2024-09-16T09:09:30.755977+0000 mgr.a (mgr.14373) 9187 : cluster [DBG] pgmap v6371: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T09:09:32.605 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:09:32.605 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:09:32.605 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:09:32.606 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:09:32.606 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:09:33.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:09:32 smithi157 bash[24585]: audit 2024-09-16T09:09:32.166142+0000 mgr.a (mgr.14373) 9188 : audit [DBG] from='client.204153 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:09:33.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:09:32 smithi086 bash[24289]: audit 2024-09-16T09:09:32.166142+0000 mgr.a (mgr.14373) 9188 : audit [DBG] from='client.204153 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:09:33.341 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:09:32 smithi047 bash[22744]: audit 2024-09-16T09:09:32.166142+0000 mgr.a (mgr.14373) 9188 : audit [DBG] from='client.204153 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:09:34.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:09:33 smithi157 bash[24585]: cluster 2024-09-16T09:09:32.758829+0000 mgr.a (mgr.14373) 9189 : cluster [DBG] pgmap v6372: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:09:34.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:09:33 smithi086 bash[24289]: cluster 2024-09-16T09:09:32.758829+0000 mgr.a (mgr.14373) 9189 : cluster [DBG] pgmap v6372: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:09:34.341 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:09:33 smithi047 bash[22744]: cluster 2024-09-16T09:09:32.758829+0000 mgr.a (mgr.14373) 9189 : cluster [DBG] pgmap v6372: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:09:36.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:09:35 smithi157 bash[24585]: cluster 2024-09-16T09:09:34.759652+0000 mgr.a (mgr.14373) 9190 : cluster [DBG] pgmap v6373: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:09:36.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:09:35 smithi086 bash[24289]: cluster 2024-09-16T09:09:34.759652+0000 mgr.a (mgr.14373) 9190 : cluster [DBG] pgmap v6373: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:09:36.341 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:09:35 smithi047 bash[22744]: cluster 2024-09-16T09:09:34.759652+0000 mgr.a (mgr.14373) 9190 : cluster [DBG] pgmap v6373: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:09:37.612 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:09:37.612 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:09:37.612 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:09:38.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:09:37 smithi157 bash[24585]: cluster 2024-09-16T09:09:36.761581+0000 mgr.a (mgr.14373) 9191 : cluster [DBG] pgmap v6374: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:09:38.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:09:37 smithi086 bash[24289]: cluster 2024-09-16T09:09:36.761581+0000 mgr.a (mgr.14373) 9191 : cluster [DBG] pgmap v6374: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:09:38.341 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:09:37 smithi047 bash[22744]: cluster 2024-09-16T09:09:36.761581+0000 mgr.a (mgr.14373) 9191 : cluster [DBG] pgmap v6374: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:09:38.395 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:09:38.395 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:09:38.395 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:09:38.395 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:09:38.395 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:09:39.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:09:38 smithi157 bash[24585]: audit 2024-09-16T09:09:37.947133+0000 mgr.a (mgr.14373) 9192 : audit [DBG] from='client.204228 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:09:39.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:09:38 smithi086 bash[24289]: audit 2024-09-16T09:09:37.947133+0000 mgr.a (mgr.14373) 9192 : audit [DBG] from='client.204228 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:09:39.341 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:09:38 smithi047 bash[22744]: audit 2024-09-16T09:09:37.947133+0000 mgr.a (mgr.14373) 9192 : audit [DBG] from='client.204228 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:09:40.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:09:39 smithi157 bash[24585]: cluster 2024-09-16T09:09:38.762545+0000 mgr.a (mgr.14373) 9193 : cluster [DBG] pgmap v6375: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:09:40.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:09:39 smithi086 bash[24289]: cluster 2024-09-16T09:09:38.762545+0000 mgr.a (mgr.14373) 9193 : cluster [DBG] pgmap v6375: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:09:40.341 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:09:39 smithi047 bash[22744]: cluster 2024-09-16T09:09:38.762545+0000 mgr.a (mgr.14373) 9193 : cluster [DBG] pgmap v6375: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:09:42.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:09:42 smithi157 bash[24585]: cluster 2024-09-16T09:09:40.763329+0000 mgr.a (mgr.14373) 9194 : cluster [DBG] pgmap v6376: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:09:42.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:09:41 smithi086 bash[24289]: cluster 2024-09-16T09:09:40.763329+0000 mgr.a (mgr.14373) 9194 : cluster [DBG] pgmap v6376: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:09:42.341 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:09:41 smithi047 bash[22744]: cluster 2024-09-16T09:09:40.763329+0000 mgr.a (mgr.14373) 9194 : cluster [DBG] pgmap v6376: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:09:43.396 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:09:43.397 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:09:43.397 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:09:44.140 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:09:44.141 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:09:44.141 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:09:44.141 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:09:44.141 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:09:44.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:09:44 smithi157 bash[24585]: cluster 2024-09-16T09:09:42.765541+0000 mgr.a (mgr.14373) 9195 : cluster [DBG] pgmap v6377: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:09:44.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:09:44 smithi086 bash[24289]: cluster 2024-09-16T09:09:42.765541+0000 mgr.a (mgr.14373) 9195 : cluster [DBG] pgmap v6377: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:09:44.341 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:09:44 smithi047 bash[22744]: cluster 2024-09-16T09:09:42.765541+0000 mgr.a (mgr.14373) 9195 : cluster [DBG] pgmap v6377: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:09:45.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:09:45 smithi157 bash[24585]: audit 2024-09-16T09:09:43.725726+0000 mgr.a (mgr.14373) 9196 : audit [DBG] from='client.204303 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:09:45.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:09:45 smithi086 bash[24289]: audit 2024-09-16T09:09:43.725726+0000 mgr.a (mgr.14373) 9196 : audit [DBG] from='client.204303 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:09:45.341 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:09:45 smithi047 bash[22744]: audit 2024-09-16T09:09:43.725726+0000 mgr.a (mgr.14373) 9196 : audit [DBG] from='client.204303 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:09:46.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:09:46 smithi157 bash[24585]: cluster 2024-09-16T09:09:44.766569+0000 mgr.a (mgr.14373) 9197 : cluster [DBG] pgmap v6378: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:09:46.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:09:46 smithi086 bash[24289]: cluster 2024-09-16T09:09:44.766569+0000 mgr.a (mgr.14373) 9197 : cluster [DBG] pgmap v6378: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:09:46.341 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:09:46 smithi047 bash[22744]: cluster 2024-09-16T09:09:44.766569+0000 mgr.a (mgr.14373) 9197 : cluster [DBG] pgmap v6378: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:09:48.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:09:48 smithi157 bash[24585]: cluster 2024-09-16T09:09:46.768681+0000 mgr.a (mgr.14373) 9198 : cluster [DBG] pgmap v6379: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:09:48.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:09:48 smithi086 bash[24289]: cluster 2024-09-16T09:09:46.768681+0000 mgr.a (mgr.14373) 9198 : cluster [DBG] pgmap v6379: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:09:48.341 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:09:48 smithi047 bash[22744]: cluster 2024-09-16T09:09:46.768681+0000 mgr.a (mgr.14373) 9198 : cluster [DBG] pgmap v6379: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:09:49.142 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:09:49.143 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:09:49.143 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:09:49.936 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:09:49.936 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:09:49.936 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:09:49.936 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:09:49.937 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:09:50.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:09:50 smithi157 bash[24585]: cluster 2024-09-16T09:09:48.769441+0000 mgr.a (mgr.14373) 9199 : cluster [DBG] pgmap v6380: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:09:50.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:09:50 smithi157 bash[24585]: audit 2024-09-16T09:09:49.732713+0000 mon.b (mon.2) 858 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T09:09:50.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:09:50 smithi086 bash[24289]: cluster 2024-09-16T09:09:48.769441+0000 mgr.a (mgr.14373) 9199 : cluster [DBG] pgmap v6380: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:09:50.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:09:50 smithi086 bash[24289]: audit 2024-09-16T09:09:49.732713+0000 mon.b (mon.2) 858 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T09:09:50.341 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:09:50 smithi047 bash[22744]: cluster 2024-09-16T09:09:48.769441+0000 mgr.a (mgr.14373) 9199 : cluster [DBG] pgmap v6380: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:09:50.341 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:09:50 smithi047 bash[22744]: audit 2024-09-16T09:09:49.732713+0000 mon.b (mon.2) 858 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T09:09:51.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:09:51 smithi157 bash[24585]: audit 2024-09-16T09:09:49.476824+0000 mgr.a (mgr.14373) 9200 : audit [DBG] from='client.204381 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:09:51.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:09:51 smithi086 bash[24289]: audit 2024-09-16T09:09:49.476824+0000 mgr.a (mgr.14373) 9200 : audit [DBG] from='client.204381 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:09:51.341 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:09:51 smithi047 bash[22744]: audit 2024-09-16T09:09:49.476824+0000 mgr.a (mgr.14373) 9200 : audit [DBG] from='client.204381 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:09:52.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:09:52 smithi157 bash[24585]: cluster 2024-09-16T09:09:50.770438+0000 mgr.a (mgr.14373) 9201 : cluster [DBG] pgmap v6381: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:09:52.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:09:52 smithi086 bash[24289]: cluster 2024-09-16T09:09:50.770438+0000 mgr.a (mgr.14373) 9201 : cluster [DBG] pgmap v6381: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:09:52.341 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:09:52 smithi047 bash[22744]: cluster 2024-09-16T09:09:50.770438+0000 mgr.a (mgr.14373) 9201 : cluster [DBG] pgmap v6381: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:09:54.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:09:54 smithi157 bash[24585]: cluster 2024-09-16T09:09:52.772678+0000 mgr.a (mgr.14373) 9202 : cluster [DBG] pgmap v6382: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:09:54.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:09:54 smithi086 bash[24289]: cluster 2024-09-16T09:09:52.772678+0000 mgr.a (mgr.14373) 9202 : cluster [DBG] pgmap v6382: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:09:54.341 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:09:54 smithi047 bash[22744]: cluster 2024-09-16T09:09:52.772678+0000 mgr.a (mgr.14373) 9202 : cluster [DBG] pgmap v6382: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:09:54.938 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:09:54.938 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:09:54.939 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:09:55.711 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:09:55.712 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:09:55.712 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:09:55.712 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:09:55.712 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:09:56.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:09:56 smithi157 bash[24585]: cluster 2024-09-16T09:09:54.773462+0000 mgr.a (mgr.14373) 9203 : cluster [DBG] pgmap v6383: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:09:56.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:09:56 smithi086 bash[24289]: cluster 2024-09-16T09:09:54.773462+0000 mgr.a (mgr.14373) 9203 : cluster [DBG] pgmap v6383: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:09:56.341 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:09:56 smithi047 bash[22744]: cluster 2024-09-16T09:09:54.773462+0000 mgr.a (mgr.14373) 9203 : cluster [DBG] pgmap v6383: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:09:57.221 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:09:57 smithi086 bash[24289]: audit 2024-09-16T09:09:55.277332+0000 mgr.a (mgr.14373) 9204 : audit [DBG] from='client.204453 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:09:57.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:09:57 smithi157 bash[24585]: audit 2024-09-16T09:09:55.277332+0000 mgr.a (mgr.14373) 9204 : audit [DBG] from='client.204453 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:09:57.341 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:09:57 smithi047 bash[22744]: audit 2024-09-16T09:09:55.277332+0000 mgr.a (mgr.14373) 9204 : audit [DBG] from='client.204453 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:09:58.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:09:58 smithi157 bash[24585]: cluster 2024-09-16T09:09:56.775774+0000 mgr.a (mgr.14373) 9205 : cluster [DBG] pgmap v6384: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:09:58.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:09:58 smithi086 bash[24289]: cluster 2024-09-16T09:09:56.775774+0000 mgr.a (mgr.14373) 9205 : cluster [DBG] pgmap v6384: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:09:58.341 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:09:58 smithi047 bash[22744]: cluster 2024-09-16T09:09:56.775774+0000 mgr.a (mgr.14373) 9205 : cluster [DBG] pgmap v6384: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:10:00.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:10:00 smithi086 bash[24289]: cluster 2024-09-16T09:09:58.776566+0000 mgr.a (mgr.14373) 9206 : cluster [DBG] pgmap v6385: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:10:00.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:10:00 smithi086 bash[24289]: cluster 2024-09-16T09:10:00.000128+0000 mon.a (mon.0) 1115 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-16T09:10:00.341 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:10:00 smithi047 bash[22744]: cluster 2024-09-16T09:09:58.776566+0000 mgr.a (mgr.14373) 9206 : cluster [DBG] pgmap v6385: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:10:00.341 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:10:00 smithi047 bash[22744]: cluster 2024-09-16T09:10:00.000128+0000 mon.a (mon.0) 1115 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-16T09:10:00.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:10:00 smithi157 bash[24585]: cluster 2024-09-16T09:09:58.776566+0000 mgr.a (mgr.14373) 9206 : cluster [DBG] pgmap v6385: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:10:00.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:10:00 smithi157 bash[24585]: cluster 2024-09-16T09:10:00.000128+0000 mon.a (mon.0) 1115 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-16T09:10:00.713 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:10:00.713 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:10:00.713 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:10:01.591 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 09:10:01 smithi047 bash[22994]: debug 2024-09-16T09:10:01.264+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T09:10:01.591 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 09:10:01 smithi047 bash[22994]: debug 2024-09-16T09:10:01.280+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T09:10:01.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:10:01 smithi047 bash[22744]: audit 2024-09-16T09:10:00.455923+0000 mon.a (mon.0) 1116 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:10:01.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:10:01 smithi047 bash[22744]: audit 2024-09-16T09:10:00.466976+0000 mon.a (mon.0) 1117 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:10:01.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:10:01 smithi047 bash[22744]: audit 2024-09-16T09:10:00.471197+0000 mon.b (mon.2) 859 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:10:01.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:10:01 smithi047 bash[22744]: audit 2024-09-16T09:10:00.473655+0000 mon.b (mon.2) 860 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T09:10:01.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:10:01 smithi047 bash[22744]: audit 2024-09-16T09:10:00.484538+0000 mon.a (mon.0) 1118 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:10:01.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:10:01 smithi047 bash[22744]: audit 2024-09-16T09:10:00.491218+0000 mon.b (mon.2) 861 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:10:01.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:10:01 smithi047 bash[22744]: audit 2024-09-16T09:10:00.492658+0000 mgr.a (mgr.14373) 9207 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:10:01.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:10:01 smithi047 bash[22744]: cluster 2024-09-16T09:10:00.777176+0000 mgr.a (mgr.14373) 9208 : cluster [DBG] pgmap v6386: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:10:01.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:10:01 smithi047 bash[22744]: audit 2024-09-16T09:10:01.050894+0000 mgr.a (mgr.14373) 9209 : audit [DBG] from='client.204567 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:10:01.676 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:10:01.676 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:10:01.676 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:10:01.676 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:10:01.676 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:10:01.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:10:01 smithi157 bash[24585]: audit 2024-09-16T09:10:00.455923+0000 mon.a (mon.0) 1116 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:10:01.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:10:01 smithi157 bash[24585]: audit 2024-09-16T09:10:00.466976+0000 mon.a (mon.0) 1117 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:10:01.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:10:01 smithi157 bash[24585]: audit 2024-09-16T09:10:00.471197+0000 mon.b (mon.2) 859 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:10:01.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:10:01 smithi157 bash[24585]: audit 2024-09-16T09:10:00.473655+0000 mon.b (mon.2) 860 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T09:10:01.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:10:01 smithi157 bash[24585]: audit 2024-09-16T09:10:00.484538+0000 mon.a (mon.0) 1118 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:10:01.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:10:01 smithi157 bash[24585]: audit 2024-09-16T09:10:00.491218+0000 mon.b (mon.2) 861 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:10:01.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:10:01 smithi157 bash[24585]: audit 2024-09-16T09:10:00.492658+0000 mgr.a (mgr.14373) 9207 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:10:01.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:10:01 smithi157 bash[24585]: cluster 2024-09-16T09:10:00.777176+0000 mgr.a (mgr.14373) 9208 : cluster [DBG] pgmap v6386: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:10:01.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:10:01 smithi157 bash[24585]: audit 2024-09-16T09:10:01.050894+0000 mgr.a (mgr.14373) 9209 : audit [DBG] from='client.204567 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:10:01.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:10:01 smithi086 bash[24289]: audit 2024-09-16T09:10:00.455923+0000 mon.a (mon.0) 1116 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:10:01.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:10:01 smithi086 bash[24289]: audit 2024-09-16T09:10:00.466976+0000 mon.a (mon.0) 1117 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:10:01.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:10:01 smithi086 bash[24289]: audit 2024-09-16T09:10:00.471197+0000 mon.b (mon.2) 859 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:10:01.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:10:01 smithi086 bash[24289]: audit 2024-09-16T09:10:00.473655+0000 mon.b (mon.2) 860 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T09:10:01.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:10:01 smithi086 bash[24289]: audit 2024-09-16T09:10:00.484538+0000 mon.a (mon.0) 1118 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:10:01.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:10:01 smithi086 bash[24289]: audit 2024-09-16T09:10:00.491218+0000 mon.b (mon.2) 861 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:10:01.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:10:01 smithi086 bash[24289]: audit 2024-09-16T09:10:00.492658+0000 mgr.a (mgr.14373) 9207 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:10:01.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:10:01 smithi086 bash[24289]: cluster 2024-09-16T09:10:00.777176+0000 mgr.a (mgr.14373) 9208 : cluster [DBG] pgmap v6386: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:10:01.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:10:01 smithi086 bash[24289]: audit 2024-09-16T09:10:01.050894+0000 mgr.a (mgr.14373) 9209 : audit [DBG] from='client.204567 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:10:02.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:10:02 smithi157 bash[24585]: audit 2024-09-16T09:10:01.270296+0000 mgr.a (mgr.14373) 9210 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T09:10:02.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:10:02 smithi157 bash[24585]: cephadm 2024-09-16T09:10:01.283562+0000 mgr.a (mgr.14373) 9211 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T09:10:02.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:10:02 smithi086 bash[24289]: audit 2024-09-16T09:10:01.270296+0000 mgr.a (mgr.14373) 9210 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T09:10:02.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:10:02 smithi086 bash[24289]: cephadm 2024-09-16T09:10:01.283562+0000 mgr.a (mgr.14373) 9211 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T09:10:02.841 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:10:02 smithi047 bash[22744]: audit 2024-09-16T09:10:01.270296+0000 mgr.a (mgr.14373) 9210 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T09:10:02.841 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:10:02 smithi047 bash[22744]: cephadm 2024-09-16T09:10:01.283562+0000 mgr.a (mgr.14373) 9211 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T09:10:03.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:10:03 smithi157 bash[24585]: cluster 2024-09-16T09:10:02.779974+0000 mgr.a (mgr.14373) 9212 : cluster [DBG] pgmap v6387: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:10:03.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:10:03 smithi086 bash[24289]: cluster 2024-09-16T09:10:02.779974+0000 mgr.a (mgr.14373) 9212 : cluster [DBG] pgmap v6387: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:10:03.841 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:10:03 smithi047 bash[22744]: cluster 2024-09-16T09:10:02.779974+0000 mgr.a (mgr.14373) 9212 : cluster [DBG] pgmap v6387: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:10:06.091 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:10:05 smithi047 bash[22744]: cluster 2024-09-16T09:10:04.780775+0000 mgr.a (mgr.14373) 9213 : cluster [DBG] pgmap v6388: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T09:10:06.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:10:05 smithi157 bash[24585]: cluster 2024-09-16T09:10:04.780775+0000 mgr.a (mgr.14373) 9213 : cluster [DBG] pgmap v6388: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T09:10:06.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:10:05 smithi086 bash[24289]: cluster 2024-09-16T09:10:04.780775+0000 mgr.a (mgr.14373) 9213 : cluster [DBG] pgmap v6388: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T09:10:06.677 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:10:06.678 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:10:06.678 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:10:07.429 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:10:07.429 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:10:07.429 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:10:07.429 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:10:07.430 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:10:08.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:10:07 smithi157 bash[24585]: cluster 2024-09-16T09:10:06.781783+0000 mgr.a (mgr.14373) 9214 : cluster [DBG] pgmap v6389: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:10:08.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:10:07 smithi157 bash[24585]: audit 2024-09-16T09:10:07.010337+0000 mgr.a (mgr.14373) 9215 : audit [DBG] from='client.204714 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:10:08.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:10:07 smithi086 bash[24289]: cluster 2024-09-16T09:10:06.781783+0000 mgr.a (mgr.14373) 9214 : cluster [DBG] pgmap v6389: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:10:08.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:10:07 smithi086 bash[24289]: audit 2024-09-16T09:10:07.010337+0000 mgr.a (mgr.14373) 9215 : audit [DBG] from='client.204714 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:10:08.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:10:07 smithi047 bash[22744]: cluster 2024-09-16T09:10:06.781783+0000 mgr.a (mgr.14373) 9214 : cluster [DBG] pgmap v6389: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:10:08.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:10:07 smithi047 bash[22744]: audit 2024-09-16T09:10:07.010337+0000 mgr.a (mgr.14373) 9215 : audit [DBG] from='client.204714 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:10:10.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:10:09 smithi157 bash[24585]: cluster 2024-09-16T09:10:08.782831+0000 mgr.a (mgr.14373) 9216 : cluster [DBG] pgmap v6390: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T09:10:10.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:10:09 smithi086 bash[24289]: cluster 2024-09-16T09:10:08.782831+0000 mgr.a (mgr.14373) 9216 : cluster [DBG] pgmap v6390: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T09:10:10.345 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:10:09 smithi047 bash[22744]: cluster 2024-09-16T09:10:08.782831+0000 mgr.a (mgr.14373) 9216 : cluster [DBG] pgmap v6390: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T09:10:12.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:10:11 smithi157 bash[24585]: cluster 2024-09-16T09:10:10.783676+0000 mgr.a (mgr.14373) 9217 : cluster [DBG] pgmap v6391: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T09:10:12.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:10:11 smithi086 bash[24289]: cluster 2024-09-16T09:10:10.783676+0000 mgr.a (mgr.14373) 9217 : cluster [DBG] pgmap v6391: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T09:10:12.341 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:10:11 smithi047 bash[22744]: cluster 2024-09-16T09:10:10.783676+0000 mgr.a (mgr.14373) 9217 : cluster [DBG] pgmap v6391: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T09:10:12.430 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:10:12.431 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:10:12.432 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:10:13.221 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:10:13.221 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:10:13.222 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:10:13.222 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:10:13.222 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:10:14.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:10:13 smithi157 bash[24585]: audit 2024-09-16T09:10:12.770114+0000 mgr.a (mgr.14373) 9218 : audit [DBG] from='client.204789 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:10:14.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:10:13 smithi157 bash[24585]: cluster 2024-09-16T09:10:12.790534+0000 mgr.a (mgr.14373) 9219 : cluster [DBG] pgmap v6392: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:10:14.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:10:13 smithi086 bash[24289]: audit 2024-09-16T09:10:12.770114+0000 mgr.a (mgr.14373) 9218 : audit [DBG] from='client.204789 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:10:14.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:10:13 smithi086 bash[24289]: cluster 2024-09-16T09:10:12.790534+0000 mgr.a (mgr.14373) 9219 : cluster [DBG] pgmap v6392: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:10:14.341 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:10:13 smithi047 bash[22744]: audit 2024-09-16T09:10:12.770114+0000 mgr.a (mgr.14373) 9218 : audit [DBG] from='client.204789 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:10:14.341 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:10:13 smithi047 bash[22744]: cluster 2024-09-16T09:10:12.790534+0000 mgr.a (mgr.14373) 9219 : cluster [DBG] pgmap v6392: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:10:16.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:10:15 smithi157 bash[24585]: cluster 2024-09-16T09:10:14.791591+0000 mgr.a (mgr.14373) 9220 : cluster [DBG] pgmap v6393: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:10:16.431 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:10:15 smithi047 bash[22744]: cluster 2024-09-16T09:10:14.791591+0000 mgr.a (mgr.14373) 9220 : cluster [DBG] pgmap v6393: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:10:16.431 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:10:15 smithi086 bash[24289]: cluster 2024-09-16T09:10:14.791591+0000 mgr.a (mgr.14373) 9220 : cluster [DBG] pgmap v6393: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:10:18.222 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:10:18.223 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:10:18.223 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:10:18.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:10:17 smithi157 bash[24585]: cluster 2024-09-16T09:10:16.793905+0000 mgr.a (mgr.14373) 9221 : cluster [DBG] pgmap v6394: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:10:18.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:10:17 smithi086 bash[24289]: cluster 2024-09-16T09:10:16.793905+0000 mgr.a (mgr.14373) 9221 : cluster [DBG] pgmap v6394: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:10:18.341 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:10:17 smithi047 bash[22744]: cluster 2024-09-16T09:10:16.793905+0000 mgr.a (mgr.14373) 9221 : cluster [DBG] pgmap v6394: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:10:19.012 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:10:19.012 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:10:19.012 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:10:19.012 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:10:19.013 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:10:20.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:10:19 smithi157 bash[24585]: audit 2024-09-16T09:10:18.562903+0000 mgr.a (mgr.14373) 9222 : audit [DBG] from='client.204861 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:10:20.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:10:19 smithi157 bash[24585]: cluster 2024-09-16T09:10:18.794473+0000 mgr.a (mgr.14373) 9223 : cluster [DBG] pgmap v6395: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:10:20.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:10:19 smithi086 bash[24289]: audit 2024-09-16T09:10:18.562903+0000 mgr.a (mgr.14373) 9222 : audit [DBG] from='client.204861 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:10:20.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:10:19 smithi086 bash[24289]: cluster 2024-09-16T09:10:18.794473+0000 mgr.a (mgr.14373) 9223 : cluster [DBG] pgmap v6395: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:10:20.341 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:10:19 smithi047 bash[22744]: audit 2024-09-16T09:10:18.562903+0000 mgr.a (mgr.14373) 9222 : audit [DBG] from='client.204861 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:10:20.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:10:19 smithi047 bash[22744]: cluster 2024-09-16T09:10:18.794473+0000 mgr.a (mgr.14373) 9223 : cluster [DBG] pgmap v6395: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:10:22.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:10:21 smithi157 bash[24585]: cluster 2024-09-16T09:10:20.795349+0000 mgr.a (mgr.14373) 9224 : cluster [DBG] pgmap v6396: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:10:22.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:10:21 smithi086 bash[24289]: cluster 2024-09-16T09:10:20.795349+0000 mgr.a (mgr.14373) 9224 : cluster [DBG] pgmap v6396: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:10:22.341 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:10:21 smithi047 bash[22744]: cluster 2024-09-16T09:10:20.795349+0000 mgr.a (mgr.14373) 9224 : cluster [DBG] pgmap v6396: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:10:24.014 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:10:24.014 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:10:24.014 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:10:24.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:10:23 smithi157 bash[24585]: cluster 2024-09-16T09:10:22.797599+0000 mgr.a (mgr.14373) 9225 : cluster [DBG] pgmap v6397: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:10:24.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:10:23 smithi086 bash[24289]: cluster 2024-09-16T09:10:22.797599+0000 mgr.a (mgr.14373) 9225 : cluster [DBG] pgmap v6397: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:10:24.341 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:10:23 smithi047 bash[22744]: cluster 2024-09-16T09:10:22.797599+0000 mgr.a (mgr.14373) 9225 : cluster [DBG] pgmap v6397: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:10:24.772 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:10:24.773 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:10:24.773 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:10:24.773 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:10:24.773 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:10:26.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:10:25 smithi157 bash[24585]: audit 2024-09-16T09:10:24.348058+0000 mgr.a (mgr.14373) 9226 : audit [DBG] from='client.204939 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:10:26.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:10:25 smithi157 bash[24585]: cluster 2024-09-16T09:10:24.798259+0000 mgr.a (mgr.14373) 9227 : cluster [DBG] pgmap v6398: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:10:26.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:10:25 smithi086 bash[24289]: audit 2024-09-16T09:10:24.348058+0000 mgr.a (mgr.14373) 9226 : audit [DBG] from='client.204939 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:10:26.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:10:25 smithi086 bash[24289]: cluster 2024-09-16T09:10:24.798259+0000 mgr.a (mgr.14373) 9227 : cluster [DBG] pgmap v6398: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:10:26.341 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:10:25 smithi047 bash[22744]: audit 2024-09-16T09:10:24.348058+0000 mgr.a (mgr.14373) 9226 : audit [DBG] from='client.204939 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:10:26.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:10:25 smithi047 bash[22744]: cluster 2024-09-16T09:10:24.798259+0000 mgr.a (mgr.14373) 9227 : cluster [DBG] pgmap v6398: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:10:28.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:10:27 smithi157 bash[24585]: cluster 2024-09-16T09:10:26.800496+0000 mgr.a (mgr.14373) 9228 : cluster [DBG] pgmap v6399: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:10:28.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:10:27 smithi086 bash[24289]: cluster 2024-09-16T09:10:26.800496+0000 mgr.a (mgr.14373) 9228 : cluster [DBG] pgmap v6399: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:10:28.341 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:10:27 smithi047 bash[22744]: cluster 2024-09-16T09:10:26.800496+0000 mgr.a (mgr.14373) 9228 : cluster [DBG] pgmap v6399: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:10:29.773 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:10:29.774 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:10:29.774 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:10:30.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:10:29 smithi157 bash[24585]: cluster 2024-09-16T09:10:28.801284+0000 mgr.a (mgr.14373) 9229 : cluster [DBG] pgmap v6400: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:10:30.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:10:29 smithi086 bash[24289]: cluster 2024-09-16T09:10:28.801284+0000 mgr.a (mgr.14373) 9229 : cluster [DBG] pgmap v6400: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:10:30.341 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:10:29 smithi047 bash[22744]: cluster 2024-09-16T09:10:28.801284+0000 mgr.a (mgr.14373) 9229 : cluster [DBG] pgmap v6400: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:10:30.551 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:10:30.551 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:10:30.551 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:10:30.552 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:10:30.552 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:10:31.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:10:30 smithi157 bash[24585]: audit 2024-09-16T09:10:30.108534+0000 mgr.a (mgr.14373) 9230 : audit [DBG] from='client.205011 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:10:31.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:10:30 smithi086 bash[24289]: audit 2024-09-16T09:10:30.108534+0000 mgr.a (mgr.14373) 9230 : audit [DBG] from='client.205011 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:10:31.341 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:10:30 smithi047 bash[22744]: audit 2024-09-16T09:10:30.108534+0000 mgr.a (mgr.14373) 9230 : audit [DBG] from='client.205011 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:10:32.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:10:31 smithi157 bash[24585]: cluster 2024-09-16T09:10:30.802248+0000 mgr.a (mgr.14373) 9231 : cluster [DBG] pgmap v6401: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:10:32.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:10:31 smithi086 bash[24289]: cluster 2024-09-16T09:10:30.802248+0000 mgr.a (mgr.14373) 9231 : cluster [DBG] pgmap v6401: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:10:32.341 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:10:31 smithi047 bash[22744]: cluster 2024-09-16T09:10:30.802248+0000 mgr.a (mgr.14373) 9231 : cluster [DBG] pgmap v6401: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:10:34.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:10:33 smithi157 bash[24585]: cluster 2024-09-16T09:10:32.804559+0000 mgr.a (mgr.14373) 9232 : cluster [DBG] pgmap v6402: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:10:34.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:10:33 smithi086 bash[24289]: cluster 2024-09-16T09:10:32.804559+0000 mgr.a (mgr.14373) 9232 : cluster [DBG] pgmap v6402: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:10:34.341 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:10:33 smithi047 bash[22744]: cluster 2024-09-16T09:10:32.804559+0000 mgr.a (mgr.14373) 9232 : cluster [DBG] pgmap v6402: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:10:35.553 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:10:35.553 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:10:35.553 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:10:36.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:10:35 smithi157 bash[24585]: cluster 2024-09-16T09:10:34.805332+0000 mgr.a (mgr.14373) 9233 : cluster [DBG] pgmap v6403: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:10:36.304 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:10:36.304 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:10:36.304 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:10:36.304 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:10:36.304 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:10:36.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:10:35 smithi086 bash[24289]: cluster 2024-09-16T09:10:34.805332+0000 mgr.a (mgr.14373) 9233 : cluster [DBG] pgmap v6403: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:10:36.341 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:10:35 smithi047 bash[22744]: cluster 2024-09-16T09:10:34.805332+0000 mgr.a (mgr.14373) 9233 : cluster [DBG] pgmap v6403: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:10:37.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:10:36 smithi157 bash[24585]: audit 2024-09-16T09:10:35.885078+0000 mgr.a (mgr.14373) 9234 : audit [DBG] from='client.205086 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:10:37.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:10:36 smithi086 bash[24289]: audit 2024-09-16T09:10:35.885078+0000 mgr.a (mgr.14373) 9234 : audit [DBG] from='client.205086 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:10:37.341 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:10:36 smithi047 bash[22744]: audit 2024-09-16T09:10:35.885078+0000 mgr.a (mgr.14373) 9234 : audit [DBG] from='client.205086 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:10:38.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:10:37 smithi157 bash[24585]: cluster 2024-09-16T09:10:36.807742+0000 mgr.a (mgr.14373) 9235 : cluster [DBG] pgmap v6404: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:10:38.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:10:37 smithi086 bash[24289]: cluster 2024-09-16T09:10:36.807742+0000 mgr.a (mgr.14373) 9235 : cluster [DBG] pgmap v6404: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:10:38.341 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:10:37 smithi047 bash[22744]: cluster 2024-09-16T09:10:36.807742+0000 mgr.a (mgr.14373) 9235 : cluster [DBG] pgmap v6404: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:10:40.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:10:39 smithi157 bash[24585]: cluster 2024-09-16T09:10:38.808533+0000 mgr.a (mgr.14373) 9236 : cluster [DBG] pgmap v6405: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:10:40.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:10:39 smithi086 bash[24289]: cluster 2024-09-16T09:10:38.808533+0000 mgr.a (mgr.14373) 9236 : cluster [DBG] pgmap v6405: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:10:40.341 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:10:39 smithi047 bash[22744]: cluster 2024-09-16T09:10:38.808533+0000 mgr.a (mgr.14373) 9236 : cluster [DBG] pgmap v6405: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:10:41.305 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:10:41.306 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:10:41.306 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:10:42.084 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:10:42.085 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:10:42.085 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:10:42.085 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:10:42.085 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:10:42.309 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:10:41 smithi157 bash[24585]: cluster 2024-09-16T09:10:40.809296+0000 mgr.a (mgr.14373) 9237 : cluster [DBG] pgmap v6406: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:10:42.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:10:41 smithi086 bash[24289]: cluster 2024-09-16T09:10:40.809296+0000 mgr.a (mgr.14373) 9237 : cluster [DBG] pgmap v6406: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:10:42.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:10:41 smithi047 bash[22744]: cluster 2024-09-16T09:10:40.809296+0000 mgr.a (mgr.14373) 9237 : cluster [DBG] pgmap v6406: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:10:43.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:10:42 smithi157 bash[24585]: audit 2024-09-16T09:10:41.640373+0000 mgr.a (mgr.14373) 9238 : audit [DBG] from='client.205164 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:10:43.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:10:42 smithi086 bash[24289]: audit 2024-09-16T09:10:41.640373+0000 mgr.a (mgr.14373) 9238 : audit [DBG] from='client.205164 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:10:43.341 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:10:42 smithi047 bash[22744]: audit 2024-09-16T09:10:41.640373+0000 mgr.a (mgr.14373) 9238 : audit [DBG] from='client.205164 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:10:44.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:10:43 smithi157 bash[24585]: cluster 2024-09-16T09:10:42.812103+0000 mgr.a (mgr.14373) 9239 : cluster [DBG] pgmap v6407: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:10:44.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:10:43 smithi086 bash[24289]: cluster 2024-09-16T09:10:42.812103+0000 mgr.a (mgr.14373) 9239 : cluster [DBG] pgmap v6407: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:10:44.341 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:10:43 smithi047 bash[22744]: cluster 2024-09-16T09:10:42.812103+0000 mgr.a (mgr.14373) 9239 : cluster [DBG] pgmap v6407: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:10:46.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:10:45 smithi157 bash[24585]: cluster 2024-09-16T09:10:44.812906+0000 mgr.a (mgr.14373) 9240 : cluster [DBG] pgmap v6408: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:10:46.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:10:45 smithi086 bash[24289]: cluster 2024-09-16T09:10:44.812906+0000 mgr.a (mgr.14373) 9240 : cluster [DBG] pgmap v6408: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:10:46.341 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:10:45 smithi047 bash[22744]: cluster 2024-09-16T09:10:44.812906+0000 mgr.a (mgr.14373) 9240 : cluster [DBG] pgmap v6408: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:10:47.089 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:10:47.089 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:10:47.090 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:10:47.858 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:10:47.858 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:10:47.858 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:10:47.858 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:10:47.858 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:10:48.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:10:47 smithi157 bash[24585]: cluster 2024-09-16T09:10:46.814872+0000 mgr.a (mgr.14373) 9241 : cluster [DBG] pgmap v6409: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:10:48.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:10:47 smithi086 bash[24289]: cluster 2024-09-16T09:10:46.814872+0000 mgr.a (mgr.14373) 9241 : cluster [DBG] pgmap v6409: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:10:48.341 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:10:47 smithi047 bash[22744]: cluster 2024-09-16T09:10:46.814872+0000 mgr.a (mgr.14373) 9241 : cluster [DBG] pgmap v6409: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:10:49.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:10:48 smithi157 bash[24585]: audit 2024-09-16T09:10:47.417967+0000 mgr.a (mgr.14373) 9242 : audit [DBG] from='client.205242 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:10:49.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:10:48 smithi086 bash[24289]: audit 2024-09-16T09:10:47.417967+0000 mgr.a (mgr.14373) 9242 : audit [DBG] from='client.205242 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:10:49.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:10:48 smithi047 bash[22744]: audit 2024-09-16T09:10:47.417967+0000 mgr.a (mgr.14373) 9242 : audit [DBG] from='client.205242 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:10:50.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:10:49 smithi157 bash[24585]: cluster 2024-09-16T09:10:48.815767+0000 mgr.a (mgr.14373) 9243 : cluster [DBG] pgmap v6410: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:10:50.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:10:49 smithi086 bash[24289]: cluster 2024-09-16T09:10:48.815767+0000 mgr.a (mgr.14373) 9243 : cluster [DBG] pgmap v6410: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:10:50.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:10:49 smithi047 bash[22744]: cluster 2024-09-16T09:10:48.815767+0000 mgr.a (mgr.14373) 9243 : cluster [DBG] pgmap v6410: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:10:52.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:10:51 smithi157 bash[24585]: cluster 2024-09-16T09:10:50.816550+0000 mgr.a (mgr.14373) 9244 : cluster [DBG] pgmap v6411: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T09:10:52.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:10:51 smithi086 bash[24289]: cluster 2024-09-16T09:10:50.816550+0000 mgr.a (mgr.14373) 9244 : cluster [DBG] pgmap v6411: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T09:10:52.341 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:10:51 smithi047 bash[22744]: cluster 2024-09-16T09:10:50.816550+0000 mgr.a (mgr.14373) 9244 : cluster [DBG] pgmap v6411: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T09:10:52.859 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:10:52.860 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:10:52.860 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:10:53.640 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:10:53.640 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:10:53.640 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:10:53.640 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:10:53.640 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:10:54.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:10:53 smithi157 bash[24585]: cluster 2024-09-16T09:10:52.818922+0000 mgr.a (mgr.14373) 9245 : cluster [DBG] pgmap v6412: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:10:54.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:10:53 smithi157 bash[24585]: audit 2024-09-16T09:10:53.195906+0000 mgr.a (mgr.14373) 9246 : audit [DBG] from='client.205320 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:10:54.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:10:53 smithi086 bash[24289]: cluster 2024-09-16T09:10:52.818922+0000 mgr.a (mgr.14373) 9245 : cluster [DBG] pgmap v6412: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:10:54.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:10:53 smithi086 bash[24289]: audit 2024-09-16T09:10:53.195906+0000 mgr.a (mgr.14373) 9246 : audit [DBG] from='client.205320 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:10:54.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:10:53 smithi047 bash[22744]: cluster 2024-09-16T09:10:52.818922+0000 mgr.a (mgr.14373) 9245 : cluster [DBG] pgmap v6412: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:10:54.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:10:53 smithi047 bash[22744]: audit 2024-09-16T09:10:53.195906+0000 mgr.a (mgr.14373) 9246 : audit [DBG] from='client.205320 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:10:55.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:10:55 smithi157 bash[24585]: cluster 2024-09-16T09:10:54.820036+0000 mgr.a (mgr.14373) 9247 : cluster [DBG] pgmap v6413: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:10:55.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:10:55 smithi086 bash[24289]: cluster 2024-09-16T09:10:54.820036+0000 mgr.a (mgr.14373) 9247 : cluster [DBG] pgmap v6413: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:10:55.591 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:10:55 smithi047 bash[22744]: cluster 2024-09-16T09:10:54.820036+0000 mgr.a (mgr.14373) 9247 : cluster [DBG] pgmap v6413: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:10:58.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:10:57 smithi157 bash[24585]: cluster 2024-09-16T09:10:56.822425+0000 mgr.a (mgr.14373) 9248 : cluster [DBG] pgmap v6414: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:10:58.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:10:57 smithi086 bash[24289]: cluster 2024-09-16T09:10:56.822425+0000 mgr.a (mgr.14373) 9248 : cluster [DBG] pgmap v6414: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:10:58.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:10:57 smithi047 bash[22744]: cluster 2024-09-16T09:10:56.822425+0000 mgr.a (mgr.14373) 9248 : cluster [DBG] pgmap v6414: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:10:58.642 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:10:58.642 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:10:58.643 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:10:59.427 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:10:59.427 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:10:59.427 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:10:59.427 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:10:59.427 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:11:00.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:10:59 smithi157 bash[24585]: cluster 2024-09-16T09:10:58.823344+0000 mgr.a (mgr.14373) 9249 : cluster [DBG] pgmap v6415: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:11:00.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:10:59 smithi157 bash[24585]: audit 2024-09-16T09:10:58.978319+0000 mgr.a (mgr.14373) 9250 : audit [DBG] from='client.205398 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:11:00.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:10:59 smithi086 bash[24289]: cluster 2024-09-16T09:10:58.823344+0000 mgr.a (mgr.14373) 9249 : cluster [DBG] pgmap v6415: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:11:00.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:10:59 smithi086 bash[24289]: audit 2024-09-16T09:10:58.978319+0000 mgr.a (mgr.14373) 9250 : audit [DBG] from='client.205398 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:11:00.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:10:59 smithi047 bash[22744]: cluster 2024-09-16T09:10:58.823344+0000 mgr.a (mgr.14373) 9249 : cluster [DBG] pgmap v6415: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:11:00.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:10:59 smithi047 bash[22744]: audit 2024-09-16T09:10:58.978319+0000 mgr.a (mgr.14373) 9250 : audit [DBG] from='client.205398 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:11:02.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:11:01 smithi157 bash[24585]: cluster 2024-09-16T09:11:00.824275+0000 mgr.a (mgr.14373) 9251 : cluster [DBG] pgmap v6416: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:11:02.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:11:01 smithi157 bash[24585]: audit 2024-09-16T09:11:01.347659+0000 mon.b (mon.2) 862 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T09:11:02.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:11:01 smithi086 bash[24289]: cluster 2024-09-16T09:11:00.824275+0000 mgr.a (mgr.14373) 9251 : cluster [DBG] pgmap v6416: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:11:02.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:11:01 smithi086 bash[24289]: audit 2024-09-16T09:11:01.347659+0000 mon.b (mon.2) 862 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T09:11:02.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:11:01 smithi047 bash[22744]: cluster 2024-09-16T09:11:00.824275+0000 mgr.a (mgr.14373) 9251 : cluster [DBG] pgmap v6416: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:11:02.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:11:01 smithi047 bash[22744]: audit 2024-09-16T09:11:01.347659+0000 mon.b (mon.2) 862 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T09:11:04.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:11:03 smithi157 bash[24585]: cluster 2024-09-16T09:11:02.826559+0000 mgr.a (mgr.14373) 9252 : cluster [DBG] pgmap v6417: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:11:04.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:11:03 smithi086 bash[24289]: cluster 2024-09-16T09:11:02.826559+0000 mgr.a (mgr.14373) 9252 : cluster [DBG] pgmap v6417: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:11:04.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:11:03 smithi047 bash[22744]: cluster 2024-09-16T09:11:02.826559+0000 mgr.a (mgr.14373) 9252 : cluster [DBG] pgmap v6417: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:11:04.428 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:11:04.429 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:11:04.429 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:11:05.211 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:11:05.211 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:11:05.211 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:11:05.212 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:11:05.212 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:11:06.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:11:05 smithi157 bash[24585]: audit 2024-09-16T09:11:04.771161+0000 mgr.a (mgr.14373) 9253 : audit [DBG] from='client.205470 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:11:06.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:11:05 smithi157 bash[24585]: cluster 2024-09-16T09:11:04.827572+0000 mgr.a (mgr.14373) 9254 : cluster [DBG] pgmap v6418: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:11:06.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:11:05 smithi086 bash[24289]: audit 2024-09-16T09:11:04.771161+0000 mgr.a (mgr.14373) 9253 : audit [DBG] from='client.205470 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:11:06.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:11:05 smithi086 bash[24289]: cluster 2024-09-16T09:11:04.827572+0000 mgr.a (mgr.14373) 9254 : cluster [DBG] pgmap v6418: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:11:06.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:11:05 smithi047 bash[22744]: audit 2024-09-16T09:11:04.771161+0000 mgr.a (mgr.14373) 9253 : audit [DBG] from='client.205470 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:11:06.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:11:05 smithi047 bash[22744]: cluster 2024-09-16T09:11:04.827572+0000 mgr.a (mgr.14373) 9254 : cluster [DBG] pgmap v6418: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:11:08.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:11:07 smithi157 bash[24585]: cluster 2024-09-16T09:11:06.829851+0000 mgr.a (mgr.14373) 9255 : cluster [DBG] pgmap v6419: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:11:08.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:11:07 smithi086 bash[24289]: cluster 2024-09-16T09:11:06.829851+0000 mgr.a (mgr.14373) 9255 : cluster [DBG] pgmap v6419: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:11:08.341 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:11:07 smithi047 bash[22744]: cluster 2024-09-16T09:11:06.829851+0000 mgr.a (mgr.14373) 9255 : cluster [DBG] pgmap v6419: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:11:10.213 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:11:10.214 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:11:10.214 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:11:10.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:11:09 smithi157 bash[24585]: cluster 2024-09-16T09:11:08.830667+0000 mgr.a (mgr.14373) 9256 : cluster [DBG] pgmap v6420: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:11:10.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:11:09 smithi086 bash[24289]: cluster 2024-09-16T09:11:08.830667+0000 mgr.a (mgr.14373) 9256 : cluster [DBG] pgmap v6420: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:11:10.341 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:11:09 smithi047 bash[22744]: cluster 2024-09-16T09:11:08.830667+0000 mgr.a (mgr.14373) 9256 : cluster [DBG] pgmap v6420: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:11:10.982 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:11:10.982 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:11:10.983 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:11:10.983 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:11:10.983 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:11:12.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:11:11 smithi157 bash[24585]: audit 2024-09-16T09:11:10.549799+0000 mgr.a (mgr.14373) 9257 : audit [DBG] from='client.205548 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:11:12.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:11:11 smithi157 bash[24585]: cluster 2024-09-16T09:11:10.831195+0000 mgr.a (mgr.14373) 9258 : cluster [DBG] pgmap v6421: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:11:12.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:11:11 smithi157 bash[24585]: audit 2024-09-16T09:11:11.773910+0000 mon.a (mon.0) 1119 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:11:12.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:11:11 smithi157 bash[24585]: audit 2024-09-16T09:11:11.784030+0000 mon.a (mon.0) 1120 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:11:12.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:11:11 smithi157 bash[24585]: audit 2024-09-16T09:11:11.789629+0000 mon.b (mon.2) 863 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:11:12.305 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:11:11 smithi157 bash[24585]: audit 2024-09-16T09:11:11.792113+0000 mon.b (mon.2) 864 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T09:11:12.305 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:11:11 smithi157 bash[24585]: audit 2024-09-16T09:11:11.802689+0000 mon.a (mon.0) 1121 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:11:12.305 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:11:11 smithi157 bash[24585]: audit 2024-09-16T09:11:11.811573+0000 mon.b (mon.2) 865 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:11:12.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:11:11 smithi086 bash[24289]: audit 2024-09-16T09:11:10.549799+0000 mgr.a (mgr.14373) 9257 : audit [DBG] from='client.205548 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:11:12.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:11:11 smithi086 bash[24289]: cluster 2024-09-16T09:11:10.831195+0000 mgr.a (mgr.14373) 9258 : cluster [DBG] pgmap v6421: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:11:12.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:11:11 smithi086 bash[24289]: audit 2024-09-16T09:11:11.773910+0000 mon.a (mon.0) 1119 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:11:12.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:11:11 smithi086 bash[24289]: audit 2024-09-16T09:11:11.784030+0000 mon.a (mon.0) 1120 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:11:12.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:11:11 smithi086 bash[24289]: audit 2024-09-16T09:11:11.789629+0000 mon.b (mon.2) 863 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:11:12.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:11:11 smithi086 bash[24289]: audit 2024-09-16T09:11:11.792113+0000 mon.b (mon.2) 864 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T09:11:12.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:11:11 smithi086 bash[24289]: audit 2024-09-16T09:11:11.802689+0000 mon.a (mon.0) 1121 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:11:12.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:11:11 smithi086 bash[24289]: audit 2024-09-16T09:11:11.811573+0000 mon.b (mon.2) 865 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:11:12.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:11:11 smithi047 bash[22744]: audit 2024-09-16T09:11:10.549799+0000 mgr.a (mgr.14373) 9257 : audit [DBG] from='client.205548 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:11:12.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:11:11 smithi047 bash[22744]: cluster 2024-09-16T09:11:10.831195+0000 mgr.a (mgr.14373) 9258 : cluster [DBG] pgmap v6421: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:11:12.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:11:11 smithi047 bash[22744]: audit 2024-09-16T09:11:11.773910+0000 mon.a (mon.0) 1119 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:11:12.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:11:11 smithi047 bash[22744]: audit 2024-09-16T09:11:11.784030+0000 mon.a (mon.0) 1120 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:11:12.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:11:11 smithi047 bash[22744]: audit 2024-09-16T09:11:11.789629+0000 mon.b (mon.2) 863 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:11:12.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:11:11 smithi047 bash[22744]: audit 2024-09-16T09:11:11.792113+0000 mon.b (mon.2) 864 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T09:11:12.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:11:11 smithi047 bash[22744]: audit 2024-09-16T09:11:11.802689+0000 mon.a (mon.0) 1121 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:11:12.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:11:11 smithi047 bash[22744]: audit 2024-09-16T09:11:11.811573+0000 mon.b (mon.2) 865 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:11:12.842 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 09:11:12 smithi047 bash[22994]: debug 2024-09-16T09:11:12.554+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T09:11:12.842 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 09:11:12 smithi047 bash[22994]: debug 2024-09-16T09:11:12.554+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T09:11:13.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:11:12 smithi157 bash[24585]: audit 2024-09-16T09:11:11.813126+0000 mgr.a (mgr.14373) 9259 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:11:13.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:11:12 smithi086 bash[24289]: audit 2024-09-16T09:11:11.813126+0000 mgr.a (mgr.14373) 9259 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:11:13.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:11:12 smithi047 bash[22744]: audit 2024-09-16T09:11:11.813126+0000 mgr.a (mgr.14373) 9259 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:11:14.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:11:13 smithi157 bash[24585]: audit 2024-09-16T09:11:12.560047+0000 mgr.a (mgr.14373) 9260 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T09:11:14.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:11:13 smithi157 bash[24585]: cephadm 2024-09-16T09:11:12.562262+0000 mgr.a (mgr.14373) 9261 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T09:11:14.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:11:13 smithi157 bash[24585]: cluster 2024-09-16T09:11:12.833987+0000 mgr.a (mgr.14373) 9262 : cluster [DBG] pgmap v6422: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:11:14.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:11:13 smithi086 bash[24289]: audit 2024-09-16T09:11:12.560047+0000 mgr.a (mgr.14373) 9260 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T09:11:14.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:11:13 smithi086 bash[24289]: cephadm 2024-09-16T09:11:12.562262+0000 mgr.a (mgr.14373) 9261 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T09:11:14.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:11:13 smithi086 bash[24289]: cluster 2024-09-16T09:11:12.833987+0000 mgr.a (mgr.14373) 9262 : cluster [DBG] pgmap v6422: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:11:14.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:11:13 smithi047 bash[22744]: audit 2024-09-16T09:11:12.560047+0000 mgr.a (mgr.14373) 9260 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T09:11:14.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:11:13 smithi047 bash[22744]: cephadm 2024-09-16T09:11:12.562262+0000 mgr.a (mgr.14373) 9261 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T09:11:14.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:11:13 smithi047 bash[22744]: cluster 2024-09-16T09:11:12.833987+0000 mgr.a (mgr.14373) 9262 : cluster [DBG] pgmap v6422: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:11:15.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:11:15 smithi086 bash[24289]: cluster 2024-09-16T09:11:14.834781+0000 mgr.a (mgr.14373) 9263 : cluster [DBG] pgmap v6423: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:11:15.591 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:11:15 smithi047 bash[22744]: cluster 2024-09-16T09:11:14.834781+0000 mgr.a (mgr.14373) 9263 : cluster [DBG] pgmap v6423: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:11:15.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:11:15 smithi157 bash[24585]: cluster 2024-09-16T09:11:14.834781+0000 mgr.a (mgr.14373) 9263 : cluster [DBG] pgmap v6423: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:11:15.984 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:11:15.984 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:11:15.984 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:11:16.747 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:11:16.747 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:11:16.747 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:11:16.747 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:11:16.747 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:11:18.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:11:17 smithi157 bash[24585]: audit 2024-09-16T09:11:16.312255+0000 mgr.a (mgr.14373) 9264 : audit [DBG] from='client.205725 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:11:18.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:11:17 smithi157 bash[24585]: cluster 2024-09-16T09:11:16.837538+0000 mgr.a (mgr.14373) 9265 : cluster [DBG] pgmap v6424: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:11:18.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:11:17 smithi086 bash[24289]: audit 2024-09-16T09:11:16.312255+0000 mgr.a (mgr.14373) 9264 : audit [DBG] from='client.205725 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:11:18.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:11:17 smithi086 bash[24289]: cluster 2024-09-16T09:11:16.837538+0000 mgr.a (mgr.14373) 9265 : cluster [DBG] pgmap v6424: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:11:18.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:11:17 smithi047 bash[22744]: audit 2024-09-16T09:11:16.312255+0000 mgr.a (mgr.14373) 9264 : audit [DBG] from='client.205725 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:11:18.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:11:17 smithi047 bash[22744]: cluster 2024-09-16T09:11:16.837538+0000 mgr.a (mgr.14373) 9265 : cluster [DBG] pgmap v6424: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:11:20.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:11:19 smithi157 bash[24585]: cluster 2024-09-16T09:11:18.838325+0000 mgr.a (mgr.14373) 9266 : cluster [DBG] pgmap v6425: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T09:11:20.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:11:19 smithi086 bash[24289]: cluster 2024-09-16T09:11:18.838325+0000 mgr.a (mgr.14373) 9266 : cluster [DBG] pgmap v6425: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T09:11:20.341 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:11:19 smithi047 bash[22744]: cluster 2024-09-16T09:11:18.838325+0000 mgr.a (mgr.14373) 9266 : cluster [DBG] pgmap v6425: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T09:11:21.748 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:11:21.749 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:11:21.749 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:11:22.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:11:21 smithi157 bash[24585]: cluster 2024-09-16T09:11:20.839096+0000 mgr.a (mgr.14373) 9267 : cluster [DBG] pgmap v6426: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T09:11:22.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:11:21 smithi086 bash[24289]: cluster 2024-09-16T09:11:20.839096+0000 mgr.a (mgr.14373) 9267 : cluster [DBG] pgmap v6426: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T09:11:22.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:11:21 smithi047 bash[22744]: cluster 2024-09-16T09:11:20.839096+0000 mgr.a (mgr.14373) 9267 : cluster [DBG] pgmap v6426: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T09:11:22.530 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:11:22.531 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:11:22.531 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:11:22.531 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:11:22.531 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:11:23.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:11:22 smithi157 bash[24585]: audit 2024-09-16T09:11:22.084628+0000 mgr.a (mgr.14373) 9268 : audit [DBG] from='client.205800 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:11:23.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:11:22 smithi086 bash[24289]: audit 2024-09-16T09:11:22.084628+0000 mgr.a (mgr.14373) 9268 : audit [DBG] from='client.205800 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:11:23.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:11:22 smithi047 bash[22744]: audit 2024-09-16T09:11:22.084628+0000 mgr.a (mgr.14373) 9268 : audit [DBG] from='client.205800 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:11:24.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:11:23 smithi157 bash[24585]: cluster 2024-09-16T09:11:22.841851+0000 mgr.a (mgr.14373) 9269 : cluster [DBG] pgmap v6427: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:11:24.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:11:23 smithi086 bash[24289]: cluster 2024-09-16T09:11:22.841851+0000 mgr.a (mgr.14373) 9269 : cluster [DBG] pgmap v6427: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:11:24.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:11:23 smithi047 bash[22744]: cluster 2024-09-16T09:11:22.841851+0000 mgr.a (mgr.14373) 9269 : cluster [DBG] pgmap v6427: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:11:26.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:11:25 smithi157 bash[24585]: cluster 2024-09-16T09:11:24.842705+0000 mgr.a (mgr.14373) 9270 : cluster [DBG] pgmap v6428: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T09:11:26.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:11:25 smithi086 bash[24289]: cluster 2024-09-16T09:11:24.842705+0000 mgr.a (mgr.14373) 9270 : cluster [DBG] pgmap v6428: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T09:11:26.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:11:25 smithi047 bash[22744]: cluster 2024-09-16T09:11:24.842705+0000 mgr.a (mgr.14373) 9270 : cluster [DBG] pgmap v6428: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T09:11:27.532 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:11:27.533 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:11:27.533 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:11:28.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:11:27 smithi157 bash[24585]: cluster 2024-09-16T09:11:26.844650+0000 mgr.a (mgr.14373) 9271 : cluster [DBG] pgmap v6429: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:11:28.318 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:11:28.318 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:11:28.318 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:11:28.318 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:11:28.318 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:11:28.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:11:27 smithi086 bash[24289]: cluster 2024-09-16T09:11:26.844650+0000 mgr.a (mgr.14373) 9271 : cluster [DBG] pgmap v6429: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:11:28.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:11:27 smithi047 bash[22744]: cluster 2024-09-16T09:11:26.844650+0000 mgr.a (mgr.14373) 9271 : cluster [DBG] pgmap v6429: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:11:29.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:11:28 smithi157 bash[24585]: audit 2024-09-16T09:11:27.863917+0000 mgr.a (mgr.14373) 9272 : audit [DBG] from='client.205878 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:11:29.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:11:28 smithi086 bash[24289]: audit 2024-09-16T09:11:27.863917+0000 mgr.a (mgr.14373) 9272 : audit [DBG] from='client.205878 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:11:29.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:11:28 smithi047 bash[22744]: audit 2024-09-16T09:11:27.863917+0000 mgr.a (mgr.14373) 9272 : audit [DBG] from='client.205878 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:11:30.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:11:29 smithi157 bash[24585]: cluster 2024-09-16T09:11:28.845568+0000 mgr.a (mgr.14373) 9273 : cluster [DBG] pgmap v6430: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:11:30.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:11:29 smithi086 bash[24289]: cluster 2024-09-16T09:11:28.845568+0000 mgr.a (mgr.14373) 9273 : cluster [DBG] pgmap v6430: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:11:30.341 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:11:29 smithi047 bash[22744]: cluster 2024-09-16T09:11:28.845568+0000 mgr.a (mgr.14373) 9273 : cluster [DBG] pgmap v6430: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:11:32.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:11:31 smithi157 bash[24585]: cluster 2024-09-16T09:11:30.846370+0000 mgr.a (mgr.14373) 9274 : cluster [DBG] pgmap v6431: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:11:32.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:11:31 smithi086 bash[24289]: cluster 2024-09-16T09:11:30.846370+0000 mgr.a (mgr.14373) 9274 : cluster [DBG] pgmap v6431: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:11:32.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:11:31 smithi047 bash[22744]: cluster 2024-09-16T09:11:30.846370+0000 mgr.a (mgr.14373) 9274 : cluster [DBG] pgmap v6431: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:11:33.319 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:11:33.320 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:11:33.321 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:11:34.106 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:11:34.106 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:11:34.106 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:11:34.107 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:11:34.107 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:11:34.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:11:33 smithi157 bash[24585]: cluster 2024-09-16T09:11:32.848538+0000 mgr.a (mgr.14373) 9275 : cluster [DBG] pgmap v6432: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:11:34.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:11:33 smithi086 bash[24289]: cluster 2024-09-16T09:11:32.848538+0000 mgr.a (mgr.14373) 9275 : cluster [DBG] pgmap v6432: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:11:34.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:11:33 smithi047 bash[22744]: cluster 2024-09-16T09:11:32.848538+0000 mgr.a (mgr.14373) 9275 : cluster [DBG] pgmap v6432: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:11:35.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:11:34 smithi157 bash[24585]: audit 2024-09-16T09:11:33.658377+0000 mgr.a (mgr.14373) 9276 : audit [DBG] from='client.205956 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:11:35.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:11:34 smithi086 bash[24289]: audit 2024-09-16T09:11:33.658377+0000 mgr.a (mgr.14373) 9276 : audit [DBG] from='client.205956 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:11:35.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:11:34 smithi047 bash[22744]: audit 2024-09-16T09:11:33.658377+0000 mgr.a (mgr.14373) 9276 : audit [DBG] from='client.205956 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:11:36.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:11:35 smithi157 bash[24585]: cluster 2024-09-16T09:11:34.849466+0000 mgr.a (mgr.14373) 9277 : cluster [DBG] pgmap v6433: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:11:36.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:11:35 smithi086 bash[24289]: cluster 2024-09-16T09:11:34.849466+0000 mgr.a (mgr.14373) 9277 : cluster [DBG] pgmap v6433: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:11:36.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:11:35 smithi047 bash[22744]: cluster 2024-09-16T09:11:34.849466+0000 mgr.a (mgr.14373) 9277 : cluster [DBG] pgmap v6433: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:11:38.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:11:37 smithi157 bash[24585]: cluster 2024-09-16T09:11:36.851625+0000 mgr.a (mgr.14373) 9278 : cluster [DBG] pgmap v6434: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:11:38.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:11:37 smithi086 bash[24289]: cluster 2024-09-16T09:11:36.851625+0000 mgr.a (mgr.14373) 9278 : cluster [DBG] pgmap v6434: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:11:38.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:11:37 smithi047 bash[22744]: cluster 2024-09-16T09:11:36.851625+0000 mgr.a (mgr.14373) 9278 : cluster [DBG] pgmap v6434: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:11:39.109 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:11:39.109 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:11:39.109 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:11:39.880 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:11:39.881 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:11:39.881 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:11:39.881 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:11:39.882 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:11:40.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:11:39 smithi157 bash[24585]: cluster 2024-09-16T09:11:38.852358+0000 mgr.a (mgr.14373) 9279 : cluster [DBG] pgmap v6435: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:11:40.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:11:39 smithi086 bash[24289]: cluster 2024-09-16T09:11:38.852358+0000 mgr.a (mgr.14373) 9279 : cluster [DBG] pgmap v6435: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:11:40.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:11:39 smithi047 bash[22744]: cluster 2024-09-16T09:11:38.852358+0000 mgr.a (mgr.14373) 9279 : cluster [DBG] pgmap v6435: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:11:41.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:11:40 smithi157 bash[24585]: audit 2024-09-16T09:11:39.442822+0000 mgr.a (mgr.14373) 9280 : audit [DBG] from='client.206034 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:11:41.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:11:40 smithi086 bash[24289]: audit 2024-09-16T09:11:39.442822+0000 mgr.a (mgr.14373) 9280 : audit [DBG] from='client.206034 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:11:41.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:11:40 smithi047 bash[22744]: audit 2024-09-16T09:11:39.442822+0000 mgr.a (mgr.14373) 9280 : audit [DBG] from='client.206034 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:11:42.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:11:41 smithi157 bash[24585]: cluster 2024-09-16T09:11:40.853259+0000 mgr.a (mgr.14373) 9281 : cluster [DBG] pgmap v6436: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:11:42.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:11:41 smithi086 bash[24289]: cluster 2024-09-16T09:11:40.853259+0000 mgr.a (mgr.14373) 9281 : cluster [DBG] pgmap v6436: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:11:42.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:11:41 smithi047 bash[22744]: cluster 2024-09-16T09:11:40.853259+0000 mgr.a (mgr.14373) 9281 : cluster [DBG] pgmap v6436: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:11:44.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:11:43 smithi157 bash[24585]: cluster 2024-09-16T09:11:42.855505+0000 mgr.a (mgr.14373) 9282 : cluster [DBG] pgmap v6437: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:11:44.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:11:43 smithi086 bash[24289]: cluster 2024-09-16T09:11:42.855505+0000 mgr.a (mgr.14373) 9282 : cluster [DBG] pgmap v6437: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:11:44.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:11:43 smithi047 bash[22744]: cluster 2024-09-16T09:11:42.855505+0000 mgr.a (mgr.14373) 9282 : cluster [DBG] pgmap v6437: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:11:44.882 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:11:44.883 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:11:44.883 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:11:45.658 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:11:45.658 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:11:45.658 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:11:45.658 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:11:45.658 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:11:46.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:11:45 smithi157 bash[24585]: cluster 2024-09-16T09:11:44.856262+0000 mgr.a (mgr.14373) 9283 : cluster [DBG] pgmap v6438: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:11:46.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:11:45 smithi157 bash[24585]: audit 2024-09-16T09:11:45.217176+0000 mgr.a (mgr.14373) 9284 : audit [DBG] from='client.206109 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:11:46.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:11:45 smithi086 bash[24289]: cluster 2024-09-16T09:11:44.856262+0000 mgr.a (mgr.14373) 9283 : cluster [DBG] pgmap v6438: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:11:46.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:11:45 smithi086 bash[24289]: audit 2024-09-16T09:11:45.217176+0000 mgr.a (mgr.14373) 9284 : audit [DBG] from='client.206109 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:11:46.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:11:45 smithi047 bash[22744]: cluster 2024-09-16T09:11:44.856262+0000 mgr.a (mgr.14373) 9283 : cluster [DBG] pgmap v6438: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:11:46.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:11:45 smithi047 bash[22744]: audit 2024-09-16T09:11:45.217176+0000 mgr.a (mgr.14373) 9284 : audit [DBG] from='client.206109 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:11:48.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:11:47 smithi157 bash[24585]: cluster 2024-09-16T09:11:46.858537+0000 mgr.a (mgr.14373) 9285 : cluster [DBG] pgmap v6439: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:11:48.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:11:47 smithi086 bash[24289]: cluster 2024-09-16T09:11:46.858537+0000 mgr.a (mgr.14373) 9285 : cluster [DBG] pgmap v6439: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:11:48.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:11:47 smithi047 bash[22744]: cluster 2024-09-16T09:11:46.858537+0000 mgr.a (mgr.14373) 9285 : cluster [DBG] pgmap v6439: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:11:50.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:11:49 smithi157 bash[24585]: cluster 2024-09-16T09:11:48.859313+0000 mgr.a (mgr.14373) 9286 : cluster [DBG] pgmap v6440: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:11:50.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:11:49 smithi086 bash[24289]: cluster 2024-09-16T09:11:48.859313+0000 mgr.a (mgr.14373) 9286 : cluster [DBG] pgmap v6440: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:11:50.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:11:49 smithi047 bash[22744]: cluster 2024-09-16T09:11:48.859313+0000 mgr.a (mgr.14373) 9286 : cluster [DBG] pgmap v6440: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:11:50.659 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:11:50.660 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:11:50.661 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:11:51.429 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:11:51.430 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:11:51.430 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:11:51.430 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:11:51.430 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:11:52.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:11:51 smithi157 bash[24585]: cluster 2024-09-16T09:11:50.860039+0000 mgr.a (mgr.14373) 9287 : cluster [DBG] pgmap v6441: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:11:52.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:11:51 smithi157 bash[24585]: audit 2024-09-16T09:11:50.996099+0000 mgr.a (mgr.14373) 9288 : audit [DBG] from='client.206181 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:11:52.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:11:51 smithi086 bash[24289]: cluster 2024-09-16T09:11:50.860039+0000 mgr.a (mgr.14373) 9287 : cluster [DBG] pgmap v6441: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:11:52.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:11:51 smithi086 bash[24289]: audit 2024-09-16T09:11:50.996099+0000 mgr.a (mgr.14373) 9288 : audit [DBG] from='client.206181 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:11:52.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:11:51 smithi047 bash[22744]: cluster 2024-09-16T09:11:50.860039+0000 mgr.a (mgr.14373) 9287 : cluster [DBG] pgmap v6441: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:11:52.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:11:51 smithi047 bash[22744]: audit 2024-09-16T09:11:50.996099+0000 mgr.a (mgr.14373) 9288 : audit [DBG] from='client.206181 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:11:54.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:11:53 smithi157 bash[24585]: cluster 2024-09-16T09:11:52.862392+0000 mgr.a (mgr.14373) 9289 : cluster [DBG] pgmap v6442: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:11:54.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:11:53 smithi086 bash[24289]: cluster 2024-09-16T09:11:52.862392+0000 mgr.a (mgr.14373) 9289 : cluster [DBG] pgmap v6442: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:11:54.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:11:53 smithi047 bash[22744]: cluster 2024-09-16T09:11:52.862392+0000 mgr.a (mgr.14373) 9289 : cluster [DBG] pgmap v6442: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:11:56.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:11:56 smithi157 bash[24585]: cluster 2024-09-16T09:11:54.863117+0000 mgr.a (mgr.14373) 9290 : cluster [DBG] pgmap v6443: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:11:56.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:11:56 smithi086 bash[24289]: cluster 2024-09-16T09:11:54.863117+0000 mgr.a (mgr.14373) 9290 : cluster [DBG] pgmap v6443: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:11:56.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:11:56 smithi047 bash[22744]: cluster 2024-09-16T09:11:54.863117+0000 mgr.a (mgr.14373) 9290 : cluster [DBG] pgmap v6443: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:11:56.431 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:11:56.432 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:11:56.432 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:11:57.174 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:11:57.174 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:11:57.174 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:11:57.174 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:11:57.174 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:11:58.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:11:58 smithi157 bash[24585]: audit 2024-09-16T09:11:56.757256+0000 mgr.a (mgr.14373) 9291 : audit [DBG] from='client.206250 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:11:58.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:11:58 smithi157 bash[24585]: cluster 2024-09-16T09:11:56.864364+0000 mgr.a (mgr.14373) 9292 : cluster [DBG] pgmap v6444: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:11:58.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:11:58 smithi086 bash[24289]: audit 2024-09-16T09:11:56.757256+0000 mgr.a (mgr.14373) 9291 : audit [DBG] from='client.206250 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:11:58.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:11:58 smithi086 bash[24289]: cluster 2024-09-16T09:11:56.864364+0000 mgr.a (mgr.14373) 9292 : cluster [DBG] pgmap v6444: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:11:58.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:11:58 smithi047 bash[22744]: audit 2024-09-16T09:11:56.757256+0000 mgr.a (mgr.14373) 9291 : audit [DBG] from='client.206250 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:11:58.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:11:58 smithi047 bash[22744]: cluster 2024-09-16T09:11:56.864364+0000 mgr.a (mgr.14373) 9292 : cluster [DBG] pgmap v6444: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:12:00.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:12:00 smithi157 bash[24585]: cluster 2024-09-16T09:11:58.865251+0000 mgr.a (mgr.14373) 9293 : cluster [DBG] pgmap v6445: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T09:12:00.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:12:00 smithi086 bash[24289]: cluster 2024-09-16T09:11:58.865251+0000 mgr.a (mgr.14373) 9293 : cluster [DBG] pgmap v6445: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T09:12:00.344 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:12:00 smithi047 bash[22744]: cluster 2024-09-16T09:11:58.865251+0000 mgr.a (mgr.14373) 9293 : cluster [DBG] pgmap v6445: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T09:12:02.175 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:12:02.176 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:12:02.176 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:12:02.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:12:02 smithi157 bash[24585]: cluster 2024-09-16T09:12:00.866006+0000 mgr.a (mgr.14373) 9294 : cluster [DBG] pgmap v6446: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T09:12:02.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:12:02 smithi086 bash[24289]: cluster 2024-09-16T09:12:00.866006+0000 mgr.a (mgr.14373) 9294 : cluster [DBG] pgmap v6446: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T09:12:02.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:12:02 smithi047 bash[22744]: cluster 2024-09-16T09:12:00.866006+0000 mgr.a (mgr.14373) 9294 : cluster [DBG] pgmap v6446: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T09:12:02.924 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:12:02.924 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:12:02.924 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:12:02.924 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:12:02.924 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:12:04.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:12:04 smithi157 bash[24585]: audit 2024-09-16T09:12:02.508573+0000 mgr.a (mgr.14373) 9295 : audit [DBG] from='client.206328 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:12:04.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:12:04 smithi157 bash[24585]: cluster 2024-09-16T09:12:02.867303+0000 mgr.a (mgr.14373) 9296 : cluster [DBG] pgmap v6447: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:12:04.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:12:04 smithi086 bash[24289]: audit 2024-09-16T09:12:02.508573+0000 mgr.a (mgr.14373) 9295 : audit [DBG] from='client.206328 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:12:04.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:12:04 smithi086 bash[24289]: cluster 2024-09-16T09:12:02.867303+0000 mgr.a (mgr.14373) 9296 : cluster [DBG] pgmap v6447: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:12:04.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:12:04 smithi047 bash[22744]: audit 2024-09-16T09:12:02.508573+0000 mgr.a (mgr.14373) 9295 : audit [DBG] from='client.206328 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:12:04.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:12:04 smithi047 bash[22744]: cluster 2024-09-16T09:12:02.867303+0000 mgr.a (mgr.14373) 9296 : cluster [DBG] pgmap v6447: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:12:06.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:12:06 smithi157 bash[24585]: cluster 2024-09-16T09:12:04.868019+0000 mgr.a (mgr.14373) 9297 : cluster [DBG] pgmap v6448: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T09:12:06.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:12:06 smithi086 bash[24289]: cluster 2024-09-16T09:12:04.868019+0000 mgr.a (mgr.14373) 9297 : cluster [DBG] pgmap v6448: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T09:12:06.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:12:06 smithi047 bash[22744]: cluster 2024-09-16T09:12:04.868019+0000 mgr.a (mgr.14373) 9297 : cluster [DBG] pgmap v6448: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T09:12:07.926 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:12:07.926 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:12:07.926 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:12:08.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:12:08 smithi157 bash[24585]: cluster 2024-09-16T09:12:06.869985+0000 mgr.a (mgr.14373) 9298 : cluster [DBG] pgmap v6449: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:12:08.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:12:08 smithi086 bash[24289]: cluster 2024-09-16T09:12:06.869985+0000 mgr.a (mgr.14373) 9298 : cluster [DBG] pgmap v6449: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:12:08.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:12:08 smithi047 bash[22744]: cluster 2024-09-16T09:12:06.869985+0000 mgr.a (mgr.14373) 9298 : cluster [DBG] pgmap v6449: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:12:08.679 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:12:08.679 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:12:08.679 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:12:08.680 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:12:08.680 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:12:10.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:12:10 smithi157 bash[24585]: audit 2024-09-16T09:12:08.258020+0000 mgr.a (mgr.14373) 9299 : audit [DBG] from='client.206406 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:12:10.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:12:10 smithi157 bash[24585]: cluster 2024-09-16T09:12:08.870881+0000 mgr.a (mgr.14373) 9300 : cluster [DBG] pgmap v6450: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:12:10.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:12:10 smithi086 bash[24289]: audit 2024-09-16T09:12:08.258020+0000 mgr.a (mgr.14373) 9299 : audit [DBG] from='client.206406 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:12:10.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:12:10 smithi086 bash[24289]: cluster 2024-09-16T09:12:08.870881+0000 mgr.a (mgr.14373) 9300 : cluster [DBG] pgmap v6450: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:12:10.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:12:10 smithi047 bash[22744]: audit 2024-09-16T09:12:08.258020+0000 mgr.a (mgr.14373) 9299 : audit [DBG] from='client.206406 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:12:10.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:12:10 smithi047 bash[22744]: cluster 2024-09-16T09:12:08.870881+0000 mgr.a (mgr.14373) 9300 : cluster [DBG] pgmap v6450: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:12:12.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:12:12 smithi157 bash[24585]: cluster 2024-09-16T09:12:10.871656+0000 mgr.a (mgr.14373) 9301 : cluster [DBG] pgmap v6451: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:12:12.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:12:12 smithi086 bash[24289]: cluster 2024-09-16T09:12:10.871656+0000 mgr.a (mgr.14373) 9301 : cluster [DBG] pgmap v6451: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:12:12.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:12:12 smithi047 bash[22744]: cluster 2024-09-16T09:12:10.871656+0000 mgr.a (mgr.14373) 9301 : cluster [DBG] pgmap v6451: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:12:13.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:12:13 smithi157 bash[24585]: audit 2024-09-16T09:12:12.626349+0000 mon.b (mon.2) 866 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T09:12:13.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:12:13 smithi086 bash[24289]: audit 2024-09-16T09:12:12.626349+0000 mon.b (mon.2) 866 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T09:12:13.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:12:13 smithi047 bash[22744]: audit 2024-09-16T09:12:12.626349+0000 mon.b (mon.2) 866 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T09:12:13.681 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:12:13.681 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:12:13.681 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:12:14.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:12:14 smithi157 bash[24585]: cluster 2024-09-16T09:12:12.873801+0000 mgr.a (mgr.14373) 9302 : cluster [DBG] pgmap v6452: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:12:14.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:12:14 smithi157 bash[24585]: audit 2024-09-16T09:12:13.957252+0000 mon.a (mon.0) 1122 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:12:14.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:12:14 smithi157 bash[24585]: audit 2024-09-16T09:12:13.962702+0000 mon.a (mon.0) 1123 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:12:14.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:12:14 smithi157 bash[24585]: audit 2024-09-16T09:12:13.967117+0000 mon.a (mon.0) 1124 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:12:14.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:12:14 smithi157 bash[24585]: audit 2024-09-16T09:12:13.972723+0000 mon.a (mon.0) 1125 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:12:14.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:12:14 smithi157 bash[24585]: audit 2024-09-16T09:12:13.987279+0000 mon.a (mon.0) 1126 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:12:14.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:12:14 smithi157 bash[24585]: audit 2024-09-16T09:12:13.993247+0000 mon.a (mon.0) 1127 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:12:14.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:12:14 smithi157 bash[24585]: audit 2024-09-16T09:12:13.996041+0000 mon.b (mon.2) 867 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:12:14.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:12:14 smithi157 bash[24585]: audit 2024-09-16T09:12:13.997094+0000 mon.b (mon.2) 868 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T09:12:14.305 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:12:14 smithi157 bash[24585]: audit 2024-09-16T09:12:14.002048+0000 mon.a (mon.0) 1128 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:12:14.305 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:12:14 smithi157 bash[24585]: audit 2024-09-16T09:12:14.009585+0000 mon.b (mon.2) 869 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:12:14.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:12:14 smithi086 bash[24289]: cluster 2024-09-16T09:12:12.873801+0000 mgr.a (mgr.14373) 9302 : cluster [DBG] pgmap v6452: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:12:14.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:12:14 smithi086 bash[24289]: audit 2024-09-16T09:12:13.957252+0000 mon.a (mon.0) 1122 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:12:14.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:12:14 smithi086 bash[24289]: audit 2024-09-16T09:12:13.962702+0000 mon.a (mon.0) 1123 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:12:14.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:12:14 smithi086 bash[24289]: audit 2024-09-16T09:12:13.967117+0000 mon.a (mon.0) 1124 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:12:14.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:12:14 smithi086 bash[24289]: audit 2024-09-16T09:12:13.972723+0000 mon.a (mon.0) 1125 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:12:14.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:12:14 smithi086 bash[24289]: audit 2024-09-16T09:12:13.987279+0000 mon.a (mon.0) 1126 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:12:14.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:12:14 smithi086 bash[24289]: audit 2024-09-16T09:12:13.993247+0000 mon.a (mon.0) 1127 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:12:14.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:12:14 smithi086 bash[24289]: audit 2024-09-16T09:12:13.996041+0000 mon.b (mon.2) 867 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:12:14.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:12:14 smithi086 bash[24289]: audit 2024-09-16T09:12:13.997094+0000 mon.b (mon.2) 868 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T09:12:14.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:12:14 smithi086 bash[24289]: audit 2024-09-16T09:12:14.002048+0000 mon.a (mon.0) 1128 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:12:14.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:12:14 smithi086 bash[24289]: audit 2024-09-16T09:12:14.009585+0000 mon.b (mon.2) 869 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:12:14.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:12:14 smithi047 bash[22744]: cluster 2024-09-16T09:12:12.873801+0000 mgr.a (mgr.14373) 9302 : cluster [DBG] pgmap v6452: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:12:14.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:12:14 smithi047 bash[22744]: audit 2024-09-16T09:12:13.957252+0000 mon.a (mon.0) 1122 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:12:14.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:12:14 smithi047 bash[22744]: audit 2024-09-16T09:12:13.962702+0000 mon.a (mon.0) 1123 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:12:14.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:12:14 smithi047 bash[22744]: audit 2024-09-16T09:12:13.967117+0000 mon.a (mon.0) 1124 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:12:14.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:12:14 smithi047 bash[22744]: audit 2024-09-16T09:12:13.972723+0000 mon.a (mon.0) 1125 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:12:14.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:12:14 smithi047 bash[22744]: audit 2024-09-16T09:12:13.987279+0000 mon.a (mon.0) 1126 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:12:14.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:12:14 smithi047 bash[22744]: audit 2024-09-16T09:12:13.993247+0000 mon.a (mon.0) 1127 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:12:14.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:12:14 smithi047 bash[22744]: audit 2024-09-16T09:12:13.996041+0000 mon.b (mon.2) 867 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:12:14.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:12:14 smithi047 bash[22744]: audit 2024-09-16T09:12:13.997094+0000 mon.b (mon.2) 868 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T09:12:14.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:12:14 smithi047 bash[22744]: audit 2024-09-16T09:12:14.002048+0000 mon.a (mon.0) 1128 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:12:14.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:12:14 smithi047 bash[22744]: audit 2024-09-16T09:12:14.009585+0000 mon.b (mon.2) 869 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:12:15.051 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 09:12:14 smithi047 bash[22994]: debug 2024-09-16T09:12:14.720+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T09:12:15.051 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 09:12:14 smithi047 bash[22994]: debug 2024-09-16T09:12:14.732+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T09:12:15.131 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:12:15.131 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:12:15.132 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:12:15.132 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:12:15.132 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:12:15.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:12:15 smithi157 bash[24585]: audit 2024-09-16T09:12:14.010576+0000 mgr.a (mgr.14373) 9303 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:12:15.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:12:15 smithi157 bash[24585]: audit 2024-09-16T09:12:14.029955+0000 mgr.a (mgr.14373) 9304 : audit [DBG] from='client.206484 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:12:15.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:12:15 smithi086 bash[24289]: audit 2024-09-16T09:12:14.010576+0000 mgr.a (mgr.14373) 9303 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:12:15.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:12:15 smithi086 bash[24289]: audit 2024-09-16T09:12:14.029955+0000 mgr.a (mgr.14373) 9304 : audit [DBG] from='client.206484 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:12:15.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:12:15 smithi047 bash[22744]: audit 2024-09-16T09:12:14.010576+0000 mgr.a (mgr.14373) 9303 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:12:15.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:12:15 smithi047 bash[22744]: audit 2024-09-16T09:12:14.029955+0000 mgr.a (mgr.14373) 9304 : audit [DBG] from='client.206484 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:12:16.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:12:16 smithi086 bash[24289]: audit 2024-09-16T09:12:14.722412+0000 mgr.a (mgr.14373) 9305 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T09:12:16.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:12:16 smithi086 bash[24289]: cephadm 2024-09-16T09:12:14.735721+0000 mgr.a (mgr.14373) 9306 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T09:12:16.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:12:16 smithi086 bash[24289]: cluster 2024-09-16T09:12:14.874335+0000 mgr.a (mgr.14373) 9307 : cluster [DBG] pgmap v6453: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:12:16.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:12:16 smithi047 bash[22744]: audit 2024-09-16T09:12:14.722412+0000 mgr.a (mgr.14373) 9305 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T09:12:16.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:12:16 smithi047 bash[22744]: cephadm 2024-09-16T09:12:14.735721+0000 mgr.a (mgr.14373) 9306 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T09:12:16.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:12:16 smithi047 bash[22744]: cluster 2024-09-16T09:12:14.874335+0000 mgr.a (mgr.14373) 9307 : cluster [DBG] pgmap v6453: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:12:16.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:12:16 smithi157 bash[24585]: audit 2024-09-16T09:12:14.722412+0000 mgr.a (mgr.14373) 9305 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T09:12:16.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:12:16 smithi157 bash[24585]: cephadm 2024-09-16T09:12:14.735721+0000 mgr.a (mgr.14373) 9306 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T09:12:16.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:12:16 smithi157 bash[24585]: cluster 2024-09-16T09:12:14.874335+0000 mgr.a (mgr.14373) 9307 : cluster [DBG] pgmap v6453: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:12:18.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:12:18 smithi086 bash[24289]: cluster 2024-09-16T09:12:16.876648+0000 mgr.a (mgr.14373) 9308 : cluster [DBG] pgmap v6454: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:12:18.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:12:18 smithi047 bash[22744]: cluster 2024-09-16T09:12:16.876648+0000 mgr.a (mgr.14373) 9308 : cluster [DBG] pgmap v6454: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:12:18.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:12:18 smithi157 bash[24585]: cluster 2024-09-16T09:12:16.876648+0000 mgr.a (mgr.14373) 9308 : cluster [DBG] pgmap v6454: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:12:20.133 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:12:20.134 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:12:20.134 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:12:20.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:12:20 smithi086 bash[24289]: cluster 2024-09-16T09:12:18.877396+0000 mgr.a (mgr.14373) 9309 : cluster [DBG] pgmap v6455: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:12:20.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:12:20 smithi047 bash[22744]: cluster 2024-09-16T09:12:18.877396+0000 mgr.a (mgr.14373) 9309 : cluster [DBG] pgmap v6455: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:12:20.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:12:20 smithi157 bash[24585]: cluster 2024-09-16T09:12:18.877396+0000 mgr.a (mgr.14373) 9309 : cluster [DBG] pgmap v6455: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:12:20.911 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:12:20.911 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:12:20.911 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:12:20.911 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:12:20.911 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:12:22.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:12:22 smithi086 bash[24289]: audit 2024-09-16T09:12:20.464649+0000 mgr.a (mgr.14373) 9310 : audit [DBG] from='client.206667 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:12:22.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:12:22 smithi086 bash[24289]: cluster 2024-09-16T09:12:20.877957+0000 mgr.a (mgr.14373) 9311 : cluster [DBG] pgmap v6456: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:12:22.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:12:22 smithi047 bash[22744]: audit 2024-09-16T09:12:20.464649+0000 mgr.a (mgr.14373) 9310 : audit [DBG] from='client.206667 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:12:22.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:12:22 smithi047 bash[22744]: cluster 2024-09-16T09:12:20.877957+0000 mgr.a (mgr.14373) 9311 : cluster [DBG] pgmap v6456: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:12:22.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:12:22 smithi157 bash[24585]: audit 2024-09-16T09:12:20.464649+0000 mgr.a (mgr.14373) 9310 : audit [DBG] from='client.206667 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:12:22.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:12:22 smithi157 bash[24585]: cluster 2024-09-16T09:12:20.877957+0000 mgr.a (mgr.14373) 9311 : cluster [DBG] pgmap v6456: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:12:24.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:12:24 smithi047 bash[22744]: cluster 2024-09-16T09:12:22.880170+0000 mgr.a (mgr.14373) 9312 : cluster [DBG] pgmap v6457: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:12:24.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:12:24 smithi157 bash[24585]: cluster 2024-09-16T09:12:22.880170+0000 mgr.a (mgr.14373) 9312 : cluster [DBG] pgmap v6457: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:12:24.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:12:24 smithi086 bash[24289]: cluster 2024-09-16T09:12:22.880170+0000 mgr.a (mgr.14373) 9312 : cluster [DBG] pgmap v6457: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:12:25.912 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:12:25.913 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:12:25.913 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:12:26.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:12:26 smithi047 bash[22744]: cluster 2024-09-16T09:12:24.880914+0000 mgr.a (mgr.14373) 9313 : cluster [DBG] pgmap v6458: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:12:26.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:12:26 smithi157 bash[24585]: cluster 2024-09-16T09:12:24.880914+0000 mgr.a (mgr.14373) 9313 : cluster [DBG] pgmap v6458: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:12:26.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:12:26 smithi086 bash[24289]: cluster 2024-09-16T09:12:24.880914+0000 mgr.a (mgr.14373) 9313 : cluster [DBG] pgmap v6458: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:12:26.689 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:12:26.690 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:12:26.690 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:12:26.690 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:12:26.690 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:12:28.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:12:28 smithi047 bash[22744]: audit 2024-09-16T09:12:26.248747+0000 mgr.a (mgr.14373) 9314 : audit [DBG] from='client.206742 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:12:28.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:12:28 smithi047 bash[22744]: cluster 2024-09-16T09:12:26.883550+0000 mgr.a (mgr.14373) 9315 : cluster [DBG] pgmap v6459: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:12:28.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:12:28 smithi157 bash[24585]: audit 2024-09-16T09:12:26.248747+0000 mgr.a (mgr.14373) 9314 : audit [DBG] from='client.206742 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:12:28.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:12:28 smithi157 bash[24585]: cluster 2024-09-16T09:12:26.883550+0000 mgr.a (mgr.14373) 9315 : cluster [DBG] pgmap v6459: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:12:28.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:12:28 smithi086 bash[24289]: audit 2024-09-16T09:12:26.248747+0000 mgr.a (mgr.14373) 9314 : audit [DBG] from='client.206742 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:12:28.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:12:28 smithi086 bash[24289]: cluster 2024-09-16T09:12:26.883550+0000 mgr.a (mgr.14373) 9315 : cluster [DBG] pgmap v6459: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:12:30.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:12:30 smithi047 bash[22744]: cluster 2024-09-16T09:12:28.884380+0000 mgr.a (mgr.14373) 9316 : cluster [DBG] pgmap v6460: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:12:30.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:12:30 smithi157 bash[24585]: cluster 2024-09-16T09:12:28.884380+0000 mgr.a (mgr.14373) 9316 : cluster [DBG] pgmap v6460: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:12:30.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:12:30 smithi086 bash[24289]: cluster 2024-09-16T09:12:28.884380+0000 mgr.a (mgr.14373) 9316 : cluster [DBG] pgmap v6460: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:12:31.691 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:12:31.692 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:12:31.692 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:12:32.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:12:32 smithi047 bash[22744]: cluster 2024-09-16T09:12:30.885213+0000 mgr.a (mgr.14373) 9317 : cluster [DBG] pgmap v6461: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T09:12:32.462 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:12:32.463 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:12:32.463 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:12:32.463 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:12:32.463 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:12:32.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:12:32 smithi157 bash[24585]: cluster 2024-09-16T09:12:30.885213+0000 mgr.a (mgr.14373) 9317 : cluster [DBG] pgmap v6461: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T09:12:32.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:12:32 smithi086 bash[24289]: cluster 2024-09-16T09:12:30.885213+0000 mgr.a (mgr.14373) 9317 : cluster [DBG] pgmap v6461: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T09:12:33.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:12:33 smithi157 bash[24585]: audit 2024-09-16T09:12:32.027683+0000 mgr.a (mgr.14373) 9318 : audit [DBG] from='client.206820 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:12:33.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:12:33 smithi086 bash[24289]: audit 2024-09-16T09:12:32.027683+0000 mgr.a (mgr.14373) 9318 : audit [DBG] from='client.206820 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:12:33.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:12:33 smithi047 bash[22744]: audit 2024-09-16T09:12:32.027683+0000 mgr.a (mgr.14373) 9318 : audit [DBG] from='client.206820 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:12:34.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:12:34 smithi157 bash[24585]: cluster 2024-09-16T09:12:32.887954+0000 mgr.a (mgr.14373) 9319 : cluster [DBG] pgmap v6462: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:12:34.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:12:34 smithi086 bash[24289]: cluster 2024-09-16T09:12:32.887954+0000 mgr.a (mgr.14373) 9319 : cluster [DBG] pgmap v6462: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:12:34.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:12:34 smithi047 bash[22744]: cluster 2024-09-16T09:12:32.887954+0000 mgr.a (mgr.14373) 9319 : cluster [DBG] pgmap v6462: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:12:36.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:12:36 smithi157 bash[24585]: cluster 2024-09-16T09:12:34.888769+0000 mgr.a (mgr.14373) 9320 : cluster [DBG] pgmap v6463: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:12:36.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:12:36 smithi086 bash[24289]: cluster 2024-09-16T09:12:34.888769+0000 mgr.a (mgr.14373) 9320 : cluster [DBG] pgmap v6463: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:12:36.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:12:36 smithi047 bash[22744]: cluster 2024-09-16T09:12:34.888769+0000 mgr.a (mgr.14373) 9320 : cluster [DBG] pgmap v6463: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:12:37.464 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:12:37.465 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:12:37.465 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:12:38.233 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:12:38.233 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:12:38.233 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:12:38.234 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:12:38.234 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:12:38.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:12:38 smithi157 bash[24585]: cluster 2024-09-16T09:12:36.890731+0000 mgr.a (mgr.14373) 9321 : cluster [DBG] pgmap v6464: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:12:38.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:12:38 smithi086 bash[24289]: cluster 2024-09-16T09:12:36.890731+0000 mgr.a (mgr.14373) 9321 : cluster [DBG] pgmap v6464: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:12:38.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:12:38 smithi047 bash[22744]: cluster 2024-09-16T09:12:36.890731+0000 mgr.a (mgr.14373) 9321 : cluster [DBG] pgmap v6464: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:12:39.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:12:39 smithi157 bash[24585]: audit 2024-09-16T09:12:37.795346+0000 mgr.a (mgr.14373) 9322 : audit [DBG] from='client.206895 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:12:39.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:12:39 smithi086 bash[24289]: audit 2024-09-16T09:12:37.795346+0000 mgr.a (mgr.14373) 9322 : audit [DBG] from='client.206895 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:12:39.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:12:39 smithi047 bash[22744]: audit 2024-09-16T09:12:37.795346+0000 mgr.a (mgr.14373) 9322 : audit [DBG] from='client.206895 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:12:40.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:12:40 smithi157 bash[24585]: cluster 2024-09-16T09:12:38.891689+0000 mgr.a (mgr.14373) 9323 : cluster [DBG] pgmap v6465: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:12:40.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:12:40 smithi086 bash[24289]: cluster 2024-09-16T09:12:38.891689+0000 mgr.a (mgr.14373) 9323 : cluster [DBG] pgmap v6465: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:12:40.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:12:40 smithi047 bash[22744]: cluster 2024-09-16T09:12:38.891689+0000 mgr.a (mgr.14373) 9323 : cluster [DBG] pgmap v6465: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:12:42.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:12:42 smithi157 bash[24585]: cluster 2024-09-16T09:12:40.892490+0000 mgr.a (mgr.14373) 9324 : cluster [DBG] pgmap v6466: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:12:42.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:12:42 smithi086 bash[24289]: cluster 2024-09-16T09:12:40.892490+0000 mgr.a (mgr.14373) 9324 : cluster [DBG] pgmap v6466: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:12:42.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:12:42 smithi047 bash[22744]: cluster 2024-09-16T09:12:40.892490+0000 mgr.a (mgr.14373) 9324 : cluster [DBG] pgmap v6466: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:12:43.235 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:12:43.235 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:12:43.235 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:12:44.015 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:12:44.015 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:12:44.015 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:12:44.015 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:12:44.015 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:12:44.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:12:44 smithi157 bash[24585]: cluster 2024-09-16T09:12:42.894715+0000 mgr.a (mgr.14373) 9325 : cluster [DBG] pgmap v6467: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:12:44.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:12:44 smithi086 bash[24289]: cluster 2024-09-16T09:12:42.894715+0000 mgr.a (mgr.14373) 9325 : cluster [DBG] pgmap v6467: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:12:44.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:12:44 smithi047 bash[22744]: cluster 2024-09-16T09:12:42.894715+0000 mgr.a (mgr.14373) 9325 : cluster [DBG] pgmap v6467: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:12:45.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:12:45 smithi157 bash[24585]: audit 2024-09-16T09:12:43.573746+0000 mgr.a (mgr.14373) 9326 : audit [DBG] from='client.206973 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:12:45.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:12:45 smithi086 bash[24289]: audit 2024-09-16T09:12:43.573746+0000 mgr.a (mgr.14373) 9326 : audit [DBG] from='client.206973 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:12:45.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:12:45 smithi047 bash[22744]: audit 2024-09-16T09:12:43.573746+0000 mgr.a (mgr.14373) 9326 : audit [DBG] from='client.206973 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:12:46.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:12:46 smithi157 bash[24585]: cluster 2024-09-16T09:12:44.895681+0000 mgr.a (mgr.14373) 9327 : cluster [DBG] pgmap v6468: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:12:46.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:12:46 smithi086 bash[24289]: cluster 2024-09-16T09:12:44.895681+0000 mgr.a (mgr.14373) 9327 : cluster [DBG] pgmap v6468: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:12:46.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:12:46 smithi047 bash[22744]: cluster 2024-09-16T09:12:44.895681+0000 mgr.a (mgr.14373) 9327 : cluster [DBG] pgmap v6468: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:12:48.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:12:48 smithi157 bash[24585]: cluster 2024-09-16T09:12:46.897828+0000 mgr.a (mgr.14373) 9328 : cluster [DBG] pgmap v6469: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:12:48.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:12:48 smithi086 bash[24289]: cluster 2024-09-16T09:12:46.897828+0000 mgr.a (mgr.14373) 9328 : cluster [DBG] pgmap v6469: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:12:48.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:12:48 smithi047 bash[22744]: cluster 2024-09-16T09:12:46.897828+0000 mgr.a (mgr.14373) 9328 : cluster [DBG] pgmap v6469: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:12:49.016 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:12:49.017 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:12:49.017 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:12:49.794 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:12:49.795 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:12:49.795 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:12:49.795 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:12:49.795 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:12:50.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:12:50 smithi157 bash[24585]: cluster 2024-09-16T09:12:48.898636+0000 mgr.a (mgr.14373) 9329 : cluster [DBG] pgmap v6470: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:12:50.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:12:50 smithi086 bash[24289]: cluster 2024-09-16T09:12:48.898636+0000 mgr.a (mgr.14373) 9329 : cluster [DBG] pgmap v6470: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:12:50.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:12:50 smithi047 bash[22744]: cluster 2024-09-16T09:12:48.898636+0000 mgr.a (mgr.14373) 9329 : cluster [DBG] pgmap v6470: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:12:51.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:12:51 smithi157 bash[24585]: audit 2024-09-16T09:12:49.355031+0000 mgr.a (mgr.14373) 9330 : audit [DBG] from='client.207051 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:12:51.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:12:51 smithi086 bash[24289]: audit 2024-09-16T09:12:49.355031+0000 mgr.a (mgr.14373) 9330 : audit [DBG] from='client.207051 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:12:51.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:12:51 smithi047 bash[22744]: audit 2024-09-16T09:12:49.355031+0000 mgr.a (mgr.14373) 9330 : audit [DBG] from='client.207051 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:12:52.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:12:52 smithi157 bash[24585]: cluster 2024-09-16T09:12:50.899591+0000 mgr.a (mgr.14373) 9331 : cluster [DBG] pgmap v6471: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:12:52.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:12:52 smithi086 bash[24289]: cluster 2024-09-16T09:12:50.899591+0000 mgr.a (mgr.14373) 9331 : cluster [DBG] pgmap v6471: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:12:52.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:12:52 smithi047 bash[22744]: cluster 2024-09-16T09:12:50.899591+0000 mgr.a (mgr.14373) 9331 : cluster [DBG] pgmap v6471: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:12:54.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:12:54 smithi157 bash[24585]: cluster 2024-09-16T09:12:52.901985+0000 mgr.a (mgr.14373) 9332 : cluster [DBG] pgmap v6472: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:12:54.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:12:54 smithi086 bash[24289]: cluster 2024-09-16T09:12:52.901985+0000 mgr.a (mgr.14373) 9332 : cluster [DBG] pgmap v6472: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:12:54.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:12:54 smithi047 bash[22744]: cluster 2024-09-16T09:12:52.901985+0000 mgr.a (mgr.14373) 9332 : cluster [DBG] pgmap v6472: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:12:54.796 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:12:54.796 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:12:54.797 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:12:55.544 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:12:55.545 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:12:55.545 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:12:55.545 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:12:55.545 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:12:56.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:12:56 smithi157 bash[24585]: cluster 2024-09-16T09:12:54.902440+0000 mgr.a (mgr.14373) 9333 : cluster [DBG] pgmap v6473: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:12:56.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:12:56 smithi157 bash[24585]: audit 2024-09-16T09:12:55.126265+0000 mgr.a (mgr.14373) 9334 : audit [DBG] from='client.207126 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:12:56.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:12:56 smithi086 bash[24289]: cluster 2024-09-16T09:12:54.902440+0000 mgr.a (mgr.14373) 9333 : cluster [DBG] pgmap v6473: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:12:56.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:12:56 smithi086 bash[24289]: audit 2024-09-16T09:12:55.126265+0000 mgr.a (mgr.14373) 9334 : audit [DBG] from='client.207126 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:12:56.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:12:56 smithi047 bash[22744]: cluster 2024-09-16T09:12:54.902440+0000 mgr.a (mgr.14373) 9333 : cluster [DBG] pgmap v6473: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:12:56.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:12:56 smithi047 bash[22744]: audit 2024-09-16T09:12:55.126265+0000 mgr.a (mgr.14373) 9334 : audit [DBG] from='client.207126 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:12:58.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:12:58 smithi157 bash[24585]: cluster 2024-09-16T09:12:56.904750+0000 mgr.a (mgr.14373) 9335 : cluster [DBG] pgmap v6474: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:12:58.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:12:58 smithi086 bash[24289]: cluster 2024-09-16T09:12:56.904750+0000 mgr.a (mgr.14373) 9335 : cluster [DBG] pgmap v6474: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:12:58.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:12:58 smithi047 bash[22744]: cluster 2024-09-16T09:12:56.904750+0000 mgr.a (mgr.14373) 9335 : cluster [DBG] pgmap v6474: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:13:00.546 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:13:00.546 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:13:00.547 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:13:00.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:13:00 smithi157 bash[24585]: cluster 2024-09-16T09:12:58.905516+0000 mgr.a (mgr.14373) 9336 : cluster [DBG] pgmap v6475: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:13:00.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:13:00 smithi086 bash[24289]: cluster 2024-09-16T09:12:58.905516+0000 mgr.a (mgr.14373) 9336 : cluster [DBG] pgmap v6475: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:13:00.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:13:00 smithi047 bash[22744]: cluster 2024-09-16T09:12:58.905516+0000 mgr.a (mgr.14373) 9336 : cluster [DBG] pgmap v6475: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:13:01.320 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:13:01.321 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:13:01.321 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:13:01.321 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:13:01.321 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:13:02.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:13:02 smithi157 bash[24585]: audit 2024-09-16T09:13:00.881932+0000 mgr.a (mgr.14373) 9337 : audit [DBG] from='client.207204 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:13:02.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:13:02 smithi157 bash[24585]: cluster 2024-09-16T09:13:00.906155+0000 mgr.a (mgr.14373) 9338 : cluster [DBG] pgmap v6476: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:13:02.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:13:02 smithi086 bash[24289]: audit 2024-09-16T09:13:00.881932+0000 mgr.a (mgr.14373) 9337 : audit [DBG] from='client.207204 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:13:02.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:13:02 smithi086 bash[24289]: cluster 2024-09-16T09:13:00.906155+0000 mgr.a (mgr.14373) 9338 : cluster [DBG] pgmap v6476: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:13:02.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:13:02 smithi047 bash[22744]: audit 2024-09-16T09:13:00.881932+0000 mgr.a (mgr.14373) 9337 : audit [DBG] from='client.207204 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:13:02.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:13:02 smithi047 bash[22744]: cluster 2024-09-16T09:13:00.906155+0000 mgr.a (mgr.14373) 9338 : cluster [DBG] pgmap v6476: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:13:04.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:13:04 smithi157 bash[24585]: cluster 2024-09-16T09:13:02.908514+0000 mgr.a (mgr.14373) 9339 : cluster [DBG] pgmap v6477: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:13:04.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:13:04 smithi086 bash[24289]: cluster 2024-09-16T09:13:02.908514+0000 mgr.a (mgr.14373) 9339 : cluster [DBG] pgmap v6477: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:13:04.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:13:04 smithi047 bash[22744]: cluster 2024-09-16T09:13:02.908514+0000 mgr.a (mgr.14373) 9339 : cluster [DBG] pgmap v6477: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:13:06.322 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:13:06.323 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:13:06.323 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:13:06.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:13:06 smithi157 bash[24585]: cluster 2024-09-16T09:13:04.909290+0000 mgr.a (mgr.14373) 9340 : cluster [DBG] pgmap v6478: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:13:06.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:13:06 smithi086 bash[24289]: cluster 2024-09-16T09:13:04.909290+0000 mgr.a (mgr.14373) 9340 : cluster [DBG] pgmap v6478: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:13:06.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:13:06 smithi047 bash[22744]: cluster 2024-09-16T09:13:04.909290+0000 mgr.a (mgr.14373) 9340 : cluster [DBG] pgmap v6478: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:13:07.101 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:13:07.101 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:13:07.101 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:13:07.101 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:13:07.101 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:13:08.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:13:08 smithi157 bash[24585]: audit 2024-09-16T09:13:06.659711+0000 mgr.a (mgr.14373) 9341 : audit [DBG] from='client.207282 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:13:08.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:13:08 smithi157 bash[24585]: cluster 2024-09-16T09:13:06.910699+0000 mgr.a (mgr.14373) 9342 : cluster [DBG] pgmap v6479: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:13:08.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:13:08 smithi086 bash[24289]: audit 2024-09-16T09:13:06.659711+0000 mgr.a (mgr.14373) 9341 : audit [DBG] from='client.207282 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:13:08.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:13:08 smithi086 bash[24289]: cluster 2024-09-16T09:13:06.910699+0000 mgr.a (mgr.14373) 9342 : cluster [DBG] pgmap v6479: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:13:08.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:13:08 smithi047 bash[22744]: audit 2024-09-16T09:13:06.659711+0000 mgr.a (mgr.14373) 9341 : audit [DBG] from='client.207282 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:13:08.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:13:08 smithi047 bash[22744]: cluster 2024-09-16T09:13:06.910699+0000 mgr.a (mgr.14373) 9342 : cluster [DBG] pgmap v6479: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:13:10.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:13:10 smithi157 bash[24585]: cluster 2024-09-16T09:13:08.911574+0000 mgr.a (mgr.14373) 9343 : cluster [DBG] pgmap v6480: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T09:13:10.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:13:10 smithi086 bash[24289]: cluster 2024-09-16T09:13:08.911574+0000 mgr.a (mgr.14373) 9343 : cluster [DBG] pgmap v6480: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T09:13:10.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:13:10 smithi047 bash[22744]: cluster 2024-09-16T09:13:08.911574+0000 mgr.a (mgr.14373) 9343 : cluster [DBG] pgmap v6480: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T09:13:12.109 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:13:12.109 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:13:12.109 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:13:12.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:13:12 smithi157 bash[24585]: cluster 2024-09-16T09:13:10.912349+0000 mgr.a (mgr.14373) 9344 : cluster [DBG] pgmap v6481: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T09:13:12.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:13:12 smithi086 bash[24289]: cluster 2024-09-16T09:13:10.912349+0000 mgr.a (mgr.14373) 9344 : cluster [DBG] pgmap v6481: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T09:13:12.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:13:12 smithi047 bash[22744]: cluster 2024-09-16T09:13:10.912349+0000 mgr.a (mgr.14373) 9344 : cluster [DBG] pgmap v6481: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T09:13:12.855 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:13:12.856 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:13:12.856 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:13:12.856 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:13:12.856 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:13:14.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:13:14 smithi157 bash[24585]: audit 2024-09-16T09:13:12.438392+0000 mgr.a (mgr.14373) 9345 : audit [DBG] from='client.207360 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:13:14.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:13:14 smithi157 bash[24585]: cluster 2024-09-16T09:13:12.915205+0000 mgr.a (mgr.14373) 9346 : cluster [DBG] pgmap v6482: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:13:14.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:13:14 smithi086 bash[24289]: audit 2024-09-16T09:13:12.438392+0000 mgr.a (mgr.14373) 9345 : audit [DBG] from='client.207360 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:13:14.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:13:14 smithi086 bash[24289]: cluster 2024-09-16T09:13:12.915205+0000 mgr.a (mgr.14373) 9346 : cluster [DBG] pgmap v6482: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:13:14.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:13:14 smithi047 bash[22744]: audit 2024-09-16T09:13:12.438392+0000 mgr.a (mgr.14373) 9345 : audit [DBG] from='client.207360 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:13:14.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:13:14 smithi047 bash[22744]: cluster 2024-09-16T09:13:12.915205+0000 mgr.a (mgr.14373) 9346 : cluster [DBG] pgmap v6482: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:13:15.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:13:15 smithi157 bash[24585]: audit 2024-09-16T09:13:14.803542+0000 mon.b (mon.2) 870 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T09:13:15.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:13:15 smithi086 bash[24289]: audit 2024-09-16T09:13:14.803542+0000 mon.b (mon.2) 870 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T09:13:15.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:13:15 smithi047 bash[22744]: audit 2024-09-16T09:13:14.803542+0000 mon.b (mon.2) 870 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T09:13:16.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:13:16 smithi157 bash[24585]: cluster 2024-09-16T09:13:14.916064+0000 mgr.a (mgr.14373) 9347 : cluster [DBG] pgmap v6483: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:13:16.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:13:16 smithi157 bash[24585]: audit 2024-09-16T09:13:15.431993+0000 mon.a (mon.0) 1129 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:13:16.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:13:16 smithi157 bash[24585]: audit 2024-09-16T09:13:15.436689+0000 mon.a (mon.0) 1130 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:13:16.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:13:16 smithi086 bash[24289]: cluster 2024-09-16T09:13:14.916064+0000 mgr.a (mgr.14373) 9347 : cluster [DBG] pgmap v6483: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:13:16.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:13:16 smithi086 bash[24289]: audit 2024-09-16T09:13:15.431993+0000 mon.a (mon.0) 1129 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:13:16.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:13:16 smithi086 bash[24289]: audit 2024-09-16T09:13:15.436689+0000 mon.a (mon.0) 1130 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:13:16.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:13:16 smithi047 bash[22744]: cluster 2024-09-16T09:13:14.916064+0000 mgr.a (mgr.14373) 9347 : cluster [DBG] pgmap v6483: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:13:16.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:13:16 smithi047 bash[22744]: audit 2024-09-16T09:13:15.431993+0000 mon.a (mon.0) 1129 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:13:16.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:13:16 smithi047 bash[22744]: audit 2024-09-16T09:13:15.436689+0000 mon.a (mon.0) 1130 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:13:17.342 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 09:13:16 smithi047 bash[22994]: debug 2024-09-16T09:13:16.967+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T09:13:17.342 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 09:13:16 smithi047 bash[22994]: debug 2024-09-16T09:13:16.971+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T09:13:17.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:13:17 smithi047 bash[22744]: audit 2024-09-16T09:13:16.220859+0000 mon.b (mon.2) 871 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:13:17.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:13:17 smithi047 bash[22744]: audit 2024-09-16T09:13:16.222670+0000 mon.b (mon.2) 872 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T09:13:17.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:13:17 smithi047 bash[22744]: audit 2024-09-16T09:13:16.228331+0000 mon.a (mon.0) 1131 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:13:17.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:13:17 smithi047 bash[22744]: audit 2024-09-16T09:13:16.234641+0000 mon.b (mon.2) 873 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:13:17.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:13:17 smithi047 bash[22744]: audit 2024-09-16T09:13:16.235185+0000 mgr.a (mgr.14373) 9348 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:13:17.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:13:17 smithi157 bash[24585]: audit 2024-09-16T09:13:16.220859+0000 mon.b (mon.2) 871 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:13:17.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:13:17 smithi157 bash[24585]: audit 2024-09-16T09:13:16.222670+0000 mon.b (mon.2) 872 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T09:13:17.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:13:17 smithi157 bash[24585]: audit 2024-09-16T09:13:16.228331+0000 mon.a (mon.0) 1131 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:13:17.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:13:17 smithi157 bash[24585]: audit 2024-09-16T09:13:16.234641+0000 mon.b (mon.2) 873 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:13:17.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:13:17 smithi157 bash[24585]: audit 2024-09-16T09:13:16.235185+0000 mgr.a (mgr.14373) 9348 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:13:17.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:13:17 smithi086 bash[24289]: audit 2024-09-16T09:13:16.220859+0000 mon.b (mon.2) 871 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:13:17.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:13:17 smithi086 bash[24289]: audit 2024-09-16T09:13:16.222670+0000 mon.b (mon.2) 872 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T09:13:17.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:13:17 smithi086 bash[24289]: audit 2024-09-16T09:13:16.228331+0000 mon.a (mon.0) 1131 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:13:17.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:13:17 smithi086 bash[24289]: audit 2024-09-16T09:13:16.234641+0000 mon.b (mon.2) 873 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:13:17.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:13:17 smithi086 bash[24289]: audit 2024-09-16T09:13:16.235185+0000 mgr.a (mgr.14373) 9348 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:13:17.857 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:13:17.857 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:13:17.858 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:13:18.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:13:18 smithi157 bash[24585]: cluster 2024-09-16T09:13:16.918863+0000 mgr.a (mgr.14373) 9349 : cluster [DBG] pgmap v6484: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-16T09:13:18.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:13:18 smithi157 bash[24585]: audit 2024-09-16T09:13:16.973201+0000 mgr.a (mgr.14373) 9350 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T09:13:18.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:13:18 smithi157 bash[24585]: cephadm 2024-09-16T09:13:16.975323+0000 mgr.a (mgr.14373) 9351 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T09:13:18.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:13:18 smithi086 bash[24289]: cluster 2024-09-16T09:13:16.918863+0000 mgr.a (mgr.14373) 9349 : cluster [DBG] pgmap v6484: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-16T09:13:18.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:13:18 smithi086 bash[24289]: audit 2024-09-16T09:13:16.973201+0000 mgr.a (mgr.14373) 9350 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T09:13:18.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:13:18 smithi086 bash[24289]: cephadm 2024-09-16T09:13:16.975323+0000 mgr.a (mgr.14373) 9351 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T09:13:18.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:13:18 smithi047 bash[22744]: cluster 2024-09-16T09:13:16.918863+0000 mgr.a (mgr.14373) 9349 : cluster [DBG] pgmap v6484: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-16T09:13:18.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:13:18 smithi047 bash[22744]: audit 2024-09-16T09:13:16.973201+0000 mgr.a (mgr.14373) 9350 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T09:13:18.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:13:18 smithi047 bash[22744]: cephadm 2024-09-16T09:13:16.975323+0000 mgr.a (mgr.14373) 9351 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T09:13:18.600 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:13:18.600 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:13:18.600 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:13:18.600 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:13:18.600 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:13:19.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:13:19 smithi157 bash[24585]: audit 2024-09-16T09:13:18.184725+0000 mgr.a (mgr.14373) 9352 : audit [DBG] from='client.207540 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:13:19.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:13:19 smithi086 bash[24289]: audit 2024-09-16T09:13:18.184725+0000 mgr.a (mgr.14373) 9352 : audit [DBG] from='client.207540 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:13:19.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:13:19 smithi047 bash[22744]: audit 2024-09-16T09:13:18.184725+0000 mgr.a (mgr.14373) 9352 : audit [DBG] from='client.207540 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:13:20.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:13:20 smithi157 bash[24585]: cluster 2024-09-16T09:13:18.919830+0000 mgr.a (mgr.14373) 9353 : cluster [DBG] pgmap v6485: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-16T09:13:20.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:13:20 smithi086 bash[24289]: cluster 2024-09-16T09:13:18.919830+0000 mgr.a (mgr.14373) 9353 : cluster [DBG] pgmap v6485: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-16T09:13:20.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:13:20 smithi047 bash[22744]: cluster 2024-09-16T09:13:18.919830+0000 mgr.a (mgr.14373) 9353 : cluster [DBG] pgmap v6485: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-16T09:13:22.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:13:22 smithi157 bash[24585]: cluster 2024-09-16T09:13:20.920614+0000 mgr.a (mgr.14373) 9354 : cluster [DBG] pgmap v6486: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-16T09:13:22.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:13:22 smithi086 bash[24289]: cluster 2024-09-16T09:13:20.920614+0000 mgr.a (mgr.14373) 9354 : cluster [DBG] pgmap v6486: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-16T09:13:22.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:13:22 smithi047 bash[22744]: cluster 2024-09-16T09:13:20.920614+0000 mgr.a (mgr.14373) 9354 : cluster [DBG] pgmap v6486: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-16T09:13:23.602 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:13:23.602 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:13:23.602 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:13:24.341 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:13:24.341 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:13:24.341 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:13:24.341 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:13:24.341 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:13:24.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:13:24 smithi157 bash[24585]: cluster 2024-09-16T09:13:22.922861+0000 mgr.a (mgr.14373) 9355 : cluster [DBG] pgmap v6487: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:13:24.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:13:24 smithi086 bash[24289]: cluster 2024-09-16T09:13:22.922861+0000 mgr.a (mgr.14373) 9355 : cluster [DBG] pgmap v6487: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:13:24.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:13:24 smithi047 bash[22744]: cluster 2024-09-16T09:13:22.922861+0000 mgr.a (mgr.14373) 9355 : cluster [DBG] pgmap v6487: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:13:25.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:13:25 smithi157 bash[24585]: audit 2024-09-16T09:13:23.929037+0000 mgr.a (mgr.14373) 9356 : audit [DBG] from='client.207618 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:13:25.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:13:25 smithi086 bash[24289]: audit 2024-09-16T09:13:23.929037+0000 mgr.a (mgr.14373) 9356 : audit [DBG] from='client.207618 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:13:25.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:13:25 smithi047 bash[22744]: audit 2024-09-16T09:13:23.929037+0000 mgr.a (mgr.14373) 9356 : audit [DBG] from='client.207618 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:13:26.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:13:26 smithi157 bash[24585]: cluster 2024-09-16T09:13:24.923860+0000 mgr.a (mgr.14373) 9357 : cluster [DBG] pgmap v6488: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:13:26.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:13:26 smithi086 bash[24289]: cluster 2024-09-16T09:13:24.923860+0000 mgr.a (mgr.14373) 9357 : cluster [DBG] pgmap v6488: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:13:26.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:13:26 smithi047 bash[22744]: cluster 2024-09-16T09:13:24.923860+0000 mgr.a (mgr.14373) 9357 : cluster [DBG] pgmap v6488: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:13:28.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:13:28 smithi157 bash[24585]: cluster 2024-09-16T09:13:26.926168+0000 mgr.a (mgr.14373) 9358 : cluster [DBG] pgmap v6489: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:13:28.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:13:28 smithi086 bash[24289]: cluster 2024-09-16T09:13:26.926168+0000 mgr.a (mgr.14373) 9358 : cluster [DBG] pgmap v6489: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:13:28.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:13:28 smithi047 bash[22744]: cluster 2024-09-16T09:13:26.926168+0000 mgr.a (mgr.14373) 9358 : cluster [DBG] pgmap v6489: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:13:29.342 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:13:29.343 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:13:29.343 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:13:29.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:13:29 smithi157 bash[24585]: cluster 2024-09-16T09:13:28.927121+0000 mgr.a (mgr.14373) 9359 : cluster [DBG] pgmap v6490: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T09:13:29.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:13:29 smithi086 bash[24289]: cluster 2024-09-16T09:13:28.927121+0000 mgr.a (mgr.14373) 9359 : cluster [DBG] pgmap v6490: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T09:13:29.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:13:29 smithi047 bash[22744]: cluster 2024-09-16T09:13:28.927121+0000 mgr.a (mgr.14373) 9359 : cluster [DBG] pgmap v6490: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T09:13:30.106 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:13:30.106 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:13:30.106 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:13:30.107 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:13:30.107 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:13:30.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:13:30 smithi157 bash[24585]: audit 2024-09-16T09:13:29.677876+0000 mgr.a (mgr.14373) 9360 : audit [DBG] from='client.207693 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:13:30.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:13:30 smithi086 bash[24289]: audit 2024-09-16T09:13:29.677876+0000 mgr.a (mgr.14373) 9360 : audit [DBG] from='client.207693 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:13:30.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:13:30 smithi047 bash[22744]: audit 2024-09-16T09:13:29.677876+0000 mgr.a (mgr.14373) 9360 : audit [DBG] from='client.207693 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:13:31.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:13:31 smithi157 bash[24585]: cluster 2024-09-16T09:13:30.928113+0000 mgr.a (mgr.14373) 9361 : cluster [DBG] pgmap v6491: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T09:13:31.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:13:31 smithi086 bash[24289]: cluster 2024-09-16T09:13:30.928113+0000 mgr.a (mgr.14373) 9361 : cluster [DBG] pgmap v6491: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T09:13:31.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:13:31 smithi047 bash[22744]: cluster 2024-09-16T09:13:30.928113+0000 mgr.a (mgr.14373) 9361 : cluster [DBG] pgmap v6491: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T09:13:34.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:13:33 smithi157 bash[24585]: cluster 2024-09-16T09:13:32.930389+0000 mgr.a (mgr.14373) 9362 : cluster [DBG] pgmap v6492: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.4 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:13:34.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:13:33 smithi086 bash[24289]: cluster 2024-09-16T09:13:32.930389+0000 mgr.a (mgr.14373) 9362 : cluster [DBG] pgmap v6492: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.4 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:13:34.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:13:33 smithi047 bash[22744]: cluster 2024-09-16T09:13:32.930389+0000 mgr.a (mgr.14373) 9362 : cluster [DBG] pgmap v6492: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.4 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:13:35.108 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:13:35.108 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:13:35.109 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:13:35.896 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:13:35.896 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:13:35.896 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:13:35.897 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:13:35.897 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:13:36.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:13:35 smithi157 bash[24585]: cluster 2024-09-16T09:13:34.931142+0000 mgr.a (mgr.14373) 9363 : cluster [DBG] pgmap v6493: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:13:36.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:13:35 smithi086 bash[24289]: cluster 2024-09-16T09:13:34.931142+0000 mgr.a (mgr.14373) 9363 : cluster [DBG] pgmap v6493: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:13:36.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:13:35 smithi047 bash[22744]: cluster 2024-09-16T09:13:34.931142+0000 mgr.a (mgr.14373) 9363 : cluster [DBG] pgmap v6493: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:13:37.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:13:37 smithi157 bash[24585]: audit 2024-09-16T09:13:35.442884+0000 mgr.a (mgr.14373) 9364 : audit [DBG] from='client.207771 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:13:37.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:13:37 smithi086 bash[24289]: audit 2024-09-16T09:13:35.442884+0000 mgr.a (mgr.14373) 9364 : audit [DBG] from='client.207771 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:13:37.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:13:37 smithi047 bash[22744]: audit 2024-09-16T09:13:35.442884+0000 mgr.a (mgr.14373) 9364 : audit [DBG] from='client.207771 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:13:38.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:13:38 smithi157 bash[24585]: cluster 2024-09-16T09:13:36.933625+0000 mgr.a (mgr.14373) 9365 : cluster [DBG] pgmap v6494: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:13:38.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:13:38 smithi086 bash[24289]: cluster 2024-09-16T09:13:36.933625+0000 mgr.a (mgr.14373) 9365 : cluster [DBG] pgmap v6494: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:13:38.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:13:38 smithi047 bash[22744]: cluster 2024-09-16T09:13:36.933625+0000 mgr.a (mgr.14373) 9365 : cluster [DBG] pgmap v6494: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:13:40.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:13:40 smithi157 bash[24585]: cluster 2024-09-16T09:13:38.934450+0000 mgr.a (mgr.14373) 9366 : cluster [DBG] pgmap v6495: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:13:40.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:13:40 smithi086 bash[24289]: cluster 2024-09-16T09:13:38.934450+0000 mgr.a (mgr.14373) 9366 : cluster [DBG] pgmap v6495: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:13:40.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:13:40 smithi047 bash[22744]: cluster 2024-09-16T09:13:38.934450+0000 mgr.a (mgr.14373) 9366 : cluster [DBG] pgmap v6495: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:13:40.898 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:13:40.898 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:13:40.899 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:13:41.647 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:13:41.647 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:13:41.647 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:13:41.647 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:13:41.647 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:13:42.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:13:42 smithi157 bash[24585]: cluster 2024-09-16T09:13:40.935076+0000 mgr.a (mgr.14373) 9367 : cluster [DBG] pgmap v6496: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:13:42.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:13:42 smithi157 bash[24585]: audit 2024-09-16T09:13:41.227354+0000 mgr.a (mgr.14373) 9368 : audit [DBG] from='client.207849 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:13:42.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:13:42 smithi086 bash[24289]: cluster 2024-09-16T09:13:40.935076+0000 mgr.a (mgr.14373) 9367 : cluster [DBG] pgmap v6496: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:13:42.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:13:42 smithi086 bash[24289]: audit 2024-09-16T09:13:41.227354+0000 mgr.a (mgr.14373) 9368 : audit [DBG] from='client.207849 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:13:42.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:13:42 smithi047 bash[22744]: cluster 2024-09-16T09:13:40.935076+0000 mgr.a (mgr.14373) 9367 : cluster [DBG] pgmap v6496: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:13:42.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:13:42 smithi047 bash[22744]: audit 2024-09-16T09:13:41.227354+0000 mgr.a (mgr.14373) 9368 : audit [DBG] from='client.207849 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:13:44.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:13:44 smithi157 bash[24585]: cluster 2024-09-16T09:13:42.937685+0000 mgr.a (mgr.14373) 9369 : cluster [DBG] pgmap v6497: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-16T09:13:44.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:13:44 smithi086 bash[24289]: cluster 2024-09-16T09:13:42.937685+0000 mgr.a (mgr.14373) 9369 : cluster [DBG] pgmap v6497: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-16T09:13:44.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:13:44 smithi047 bash[22744]: cluster 2024-09-16T09:13:42.937685+0000 mgr.a (mgr.14373) 9369 : cluster [DBG] pgmap v6497: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-16T09:13:46.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:13:46 smithi157 bash[24585]: cluster 2024-09-16T09:13:44.938510+0000 mgr.a (mgr.14373) 9370 : cluster [DBG] pgmap v6498: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-16T09:13:46.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:13:46 smithi086 bash[24289]: cluster 2024-09-16T09:13:44.938510+0000 mgr.a (mgr.14373) 9370 : cluster [DBG] pgmap v6498: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-16T09:13:46.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:13:46 smithi047 bash[22744]: cluster 2024-09-16T09:13:44.938510+0000 mgr.a (mgr.14373) 9370 : cluster [DBG] pgmap v6498: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-16T09:13:46.648 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:13:46.649 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:13:46.650 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:13:47.425 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:13:47.426 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:13:47.426 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:13:47.426 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:13:47.426 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:13:48.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:13:48 smithi157 bash[24585]: cluster 2024-09-16T09:13:46.940477+0000 mgr.a (mgr.14373) 9371 : cluster [DBG] pgmap v6499: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:13:48.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:13:48 smithi157 bash[24585]: audit 2024-09-16T09:13:46.983589+0000 mgr.a (mgr.14373) 9372 : audit [DBG] from='client.207927 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:13:48.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:13:48 smithi086 bash[24289]: cluster 2024-09-16T09:13:46.940477+0000 mgr.a (mgr.14373) 9371 : cluster [DBG] pgmap v6499: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:13:48.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:13:48 smithi086 bash[24289]: audit 2024-09-16T09:13:46.983589+0000 mgr.a (mgr.14373) 9372 : audit [DBG] from='client.207927 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:13:48.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:13:48 smithi047 bash[22744]: cluster 2024-09-16T09:13:46.940477+0000 mgr.a (mgr.14373) 9371 : cluster [DBG] pgmap v6499: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:13:48.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:13:48 smithi047 bash[22744]: audit 2024-09-16T09:13:46.983589+0000 mgr.a (mgr.14373) 9372 : audit [DBG] from='client.207927 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:13:50.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:13:50 smithi157 bash[24585]: cluster 2024-09-16T09:13:48.941379+0000 mgr.a (mgr.14373) 9373 : cluster [DBG] pgmap v6500: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:13:50.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:13:50 smithi086 bash[24289]: cluster 2024-09-16T09:13:48.941379+0000 mgr.a (mgr.14373) 9373 : cluster [DBG] pgmap v6500: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:13:50.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:13:50 smithi047 bash[22744]: cluster 2024-09-16T09:13:48.941379+0000 mgr.a (mgr.14373) 9373 : cluster [DBG] pgmap v6500: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:13:52.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:13:52 smithi157 bash[24585]: cluster 2024-09-16T09:13:50.942166+0000 mgr.a (mgr.14373) 9374 : cluster [DBG] pgmap v6501: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T09:13:52.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:13:52 smithi086 bash[24289]: cluster 2024-09-16T09:13:50.942166+0000 mgr.a (mgr.14373) 9374 : cluster [DBG] pgmap v6501: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T09:13:52.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:13:52 smithi047 bash[22744]: cluster 2024-09-16T09:13:50.942166+0000 mgr.a (mgr.14373) 9374 : cluster [DBG] pgmap v6501: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T09:13:52.427 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:13:52.428 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:13:52.428 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:13:53.206 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:13:53.206 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:13:53.206 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:13:53.206 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:13:53.207 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:13:54.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:13:54 smithi157 bash[24585]: audit 2024-09-16T09:13:52.761270+0000 mgr.a (mgr.14373) 9375 : audit [DBG] from='client.208002 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:13:54.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:13:54 smithi157 bash[24585]: cluster 2024-09-16T09:13:52.943854+0000 mgr.a (mgr.14373) 9376 : cluster [DBG] pgmap v6502: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:13:54.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:13:54 smithi086 bash[24289]: audit 2024-09-16T09:13:52.761270+0000 mgr.a (mgr.14373) 9375 : audit [DBG] from='client.208002 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:13:54.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:13:54 smithi086 bash[24289]: cluster 2024-09-16T09:13:52.943854+0000 mgr.a (mgr.14373) 9376 : cluster [DBG] pgmap v6502: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:13:54.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:13:54 smithi047 bash[22744]: audit 2024-09-16T09:13:52.761270+0000 mgr.a (mgr.14373) 9375 : audit [DBG] from='client.208002 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:13:54.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:13:54 smithi047 bash[22744]: cluster 2024-09-16T09:13:52.943854+0000 mgr.a (mgr.14373) 9376 : cluster [DBG] pgmap v6502: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:13:56.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:13:56 smithi157 bash[24585]: cluster 2024-09-16T09:13:54.944727+0000 mgr.a (mgr.14373) 9377 : cluster [DBG] pgmap v6503: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-16T09:13:56.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:13:56 smithi086 bash[24289]: cluster 2024-09-16T09:13:54.944727+0000 mgr.a (mgr.14373) 9377 : cluster [DBG] pgmap v6503: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-16T09:13:56.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:13:56 smithi047 bash[22744]: cluster 2024-09-16T09:13:54.944727+0000 mgr.a (mgr.14373) 9377 : cluster [DBG] pgmap v6503: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-16T09:13:58.208 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:13:58.208 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:13:58.209 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:13:58.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:13:58 smithi157 bash[24585]: cluster 2024-09-16T09:13:56.946968+0000 mgr.a (mgr.14373) 9378 : cluster [DBG] pgmap v6504: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-09-16T09:13:58.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:13:58 smithi086 bash[24289]: cluster 2024-09-16T09:13:56.946968+0000 mgr.a (mgr.14373) 9378 : cluster [DBG] pgmap v6504: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-09-16T09:13:58.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:13:58 smithi047 bash[22744]: cluster 2024-09-16T09:13:56.946968+0000 mgr.a (mgr.14373) 9378 : cluster [DBG] pgmap v6504: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-09-16T09:13:58.995 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:13:58.995 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:13:58.996 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:13:58.996 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:13:58.996 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:14:00.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:14:00 smithi157 bash[24585]: audit 2024-09-16T09:13:58.543276+0000 mgr.a (mgr.14373) 9379 : audit [DBG] from='client.208077 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:14:00.304 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:14:00 smithi157 bash[24585]: cluster 2024-09-16T09:13:58.947519+0000 mgr.a (mgr.14373) 9380 : cluster [DBG] pgmap v6505: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:14:00.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:14:00 smithi086 bash[24289]: audit 2024-09-16T09:13:58.543276+0000 mgr.a (mgr.14373) 9379 : audit [DBG] from='client.208077 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:14:00.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:14:00 smithi086 bash[24289]: cluster 2024-09-16T09:13:58.947519+0000 mgr.a (mgr.14373) 9380 : cluster [DBG] pgmap v6505: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:14:00.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:14:00 smithi047 bash[22744]: audit 2024-09-16T09:13:58.543276+0000 mgr.a (mgr.14373) 9379 : audit [DBG] from='client.208077 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:14:00.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:14:00 smithi047 bash[22744]: cluster 2024-09-16T09:13:58.947519+0000 mgr.a (mgr.14373) 9380 : cluster [DBG] pgmap v6505: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:14:02.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:14:02 smithi086 bash[24289]: cluster 2024-09-16T09:14:00.948421+0000 mgr.a (mgr.14373) 9381 : cluster [DBG] pgmap v6506: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:14:02.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:14:02 smithi047 bash[22744]: cluster 2024-09-16T09:14:00.948421+0000 mgr.a (mgr.14373) 9381 : cluster [DBG] pgmap v6506: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:14:02.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:14:02 smithi157 bash[24585]: cluster 2024-09-16T09:14:00.948421+0000 mgr.a (mgr.14373) 9381 : cluster [DBG] pgmap v6506: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:14:03.997 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:14:03.997 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:14:03.997 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:14:04.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:14:04 smithi086 bash[24289]: cluster 2024-09-16T09:14:02.950803+0000 mgr.a (mgr.14373) 9382 : cluster [DBG] pgmap v6507: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:14:04.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:14:04 smithi047 bash[22744]: cluster 2024-09-16T09:14:02.950803+0000 mgr.a (mgr.14373) 9382 : cluster [DBG] pgmap v6507: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:14:04.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:14:04 smithi157 bash[24585]: cluster 2024-09-16T09:14:02.950803+0000 mgr.a (mgr.14373) 9382 : cluster [DBG] pgmap v6507: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:14:04.775 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:14:04.775 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:14:04.775 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:14:04.775 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:14:04.775 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:14:06.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:14:06 smithi086 bash[24289]: audit 2024-09-16T09:14:04.331375+0000 mgr.a (mgr.14373) 9383 : audit [DBG] from='client.208152 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:14:06.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:14:06 smithi086 bash[24289]: cluster 2024-09-16T09:14:04.951800+0000 mgr.a (mgr.14373) 9384 : cluster [DBG] pgmap v6508: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:14:06.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:14:06 smithi047 bash[22744]: audit 2024-09-16T09:14:04.331375+0000 mgr.a (mgr.14373) 9383 : audit [DBG] from='client.208152 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:14:06.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:14:06 smithi047 bash[22744]: cluster 2024-09-16T09:14:04.951800+0000 mgr.a (mgr.14373) 9384 : cluster [DBG] pgmap v6508: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:14:06.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:14:06 smithi157 bash[24585]: audit 2024-09-16T09:14:04.331375+0000 mgr.a (mgr.14373) 9383 : audit [DBG] from='client.208152 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:14:06.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:14:06 smithi157 bash[24585]: cluster 2024-09-16T09:14:04.951800+0000 mgr.a (mgr.14373) 9384 : cluster [DBG] pgmap v6508: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:14:08.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:14:08 smithi086 bash[24289]: cluster 2024-09-16T09:14:06.954166+0000 mgr.a (mgr.14373) 9385 : cluster [DBG] pgmap v6509: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:14:08.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:14:08 smithi047 bash[22744]: cluster 2024-09-16T09:14:06.954166+0000 mgr.a (mgr.14373) 9385 : cluster [DBG] pgmap v6509: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:14:08.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:14:08 smithi157 bash[24585]: cluster 2024-09-16T09:14:06.954166+0000 mgr.a (mgr.14373) 9385 : cluster [DBG] pgmap v6509: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:14:09.776 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:14:09.777 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:14:09.777 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:14:10.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:14:10 smithi047 bash[22744]: cluster 2024-09-16T09:14:08.955132+0000 mgr.a (mgr.14373) 9386 : cluster [DBG] pgmap v6510: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:14:10.524 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:14:10.524 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:14:10.524 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:14:10.524 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:14:10.524 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:14:10.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:14:10 smithi157 bash[24585]: cluster 2024-09-16T09:14:08.955132+0000 mgr.a (mgr.14373) 9386 : cluster [DBG] pgmap v6510: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:14:10.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:14:10 smithi086 bash[24289]: cluster 2024-09-16T09:14:08.955132+0000 mgr.a (mgr.14373) 9386 : cluster [DBG] pgmap v6510: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:14:11.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:14:11 smithi047 bash[22744]: audit 2024-09-16T09:14:10.106232+0000 mgr.a (mgr.14373) 9387 : audit [DBG] from='client.208227 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:14:11.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:14:11 smithi157 bash[24585]: audit 2024-09-16T09:14:10.106232+0000 mgr.a (mgr.14373) 9387 : audit [DBG] from='client.208227 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:14:11.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:14:11 smithi086 bash[24289]: audit 2024-09-16T09:14:10.106232+0000 mgr.a (mgr.14373) 9387 : audit [DBG] from='client.208227 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:14:12.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:14:12 smithi047 bash[22744]: cluster 2024-09-16T09:14:10.956106+0000 mgr.a (mgr.14373) 9388 : cluster [DBG] pgmap v6511: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:14:12.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:14:12 smithi157 bash[24585]: cluster 2024-09-16T09:14:10.956106+0000 mgr.a (mgr.14373) 9388 : cluster [DBG] pgmap v6511: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:14:12.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:14:12 smithi086 bash[24289]: cluster 2024-09-16T09:14:10.956106+0000 mgr.a (mgr.14373) 9388 : cluster [DBG] pgmap v6511: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:14:14.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:14:14 smithi047 bash[22744]: cluster 2024-09-16T09:14:12.958328+0000 mgr.a (mgr.14373) 9389 : cluster [DBG] pgmap v6512: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:14:14.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:14:14 smithi157 bash[24585]: cluster 2024-09-16T09:14:12.958328+0000 mgr.a (mgr.14373) 9389 : cluster [DBG] pgmap v6512: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:14:14.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:14:14 smithi086 bash[24289]: cluster 2024-09-16T09:14:12.958328+0000 mgr.a (mgr.14373) 9389 : cluster [DBG] pgmap v6512: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:14:15.526 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:14:15.526 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:14:15.526 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:14:16.319 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:14:16.319 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:14:16.319 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:14:16.319 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:14:16.319 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:14:16.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:14:16 smithi047 bash[22744]: cluster 2024-09-16T09:14:14.959051+0000 mgr.a (mgr.14373) 9390 : cluster [DBG] pgmap v6513: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:14:16.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:14:16 smithi157 bash[24585]: cluster 2024-09-16T09:14:14.959051+0000 mgr.a (mgr.14373) 9390 : cluster [DBG] pgmap v6513: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:14:16.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:14:16 smithi086 bash[24289]: cluster 2024-09-16T09:14:14.959051+0000 mgr.a (mgr.14373) 9390 : cluster [DBG] pgmap v6513: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:14:17.567 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:14:17 smithi157 bash[24585]: audit 2024-09-16T09:14:15.862816+0000 mgr.a (mgr.14373) 9391 : audit [DBG] from='client.208305 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:14:17.568 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:14:17 smithi157 bash[24585]: audit 2024-09-16T09:14:17.035509+0000 mon.b (mon.2) 874 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T09:14:17.582 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:14:17 smithi086 bash[24289]: audit 2024-09-16T09:14:15.862816+0000 mgr.a (mgr.14373) 9391 : audit [DBG] from='client.208305 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:14:17.582 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:14:17 smithi086 bash[24289]: audit 2024-09-16T09:14:17.035509+0000 mon.b (mon.2) 874 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T09:14:17.602 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:14:17 smithi047 bash[22744]: audit 2024-09-16T09:14:15.862816+0000 mgr.a (mgr.14373) 9391 : audit [DBG] from='client.208305 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:14:17.602 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:14:17 smithi047 bash[22744]: audit 2024-09-16T09:14:17.035509+0000 mon.b (mon.2) 874 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T09:14:18.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:14:18 smithi157 bash[24585]: cluster 2024-09-16T09:14:16.961478+0000 mgr.a (mgr.14373) 9392 : cluster [DBG] pgmap v6514: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:14:18.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:14:18 smithi157 bash[24585]: audit 2024-09-16T09:14:17.666714+0000 mon.a (mon.0) 1132 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:14:18.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:14:18 smithi157 bash[24585]: audit 2024-09-16T09:14:17.671902+0000 mon.a (mon.0) 1133 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:14:18.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:14:18 smithi157 bash[24585]: audit 2024-09-16T09:14:17.678777+0000 mon.a (mon.0) 1134 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:14:18.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:14:18 smithi157 bash[24585]: audit 2024-09-16T09:14:17.683058+0000 mon.a (mon.0) 1135 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:14:18.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:14:18 smithi086 bash[24289]: cluster 2024-09-16T09:14:16.961478+0000 mgr.a (mgr.14373) 9392 : cluster [DBG] pgmap v6514: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:14:18.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:14:18 smithi086 bash[24289]: audit 2024-09-16T09:14:17.666714+0000 mon.a (mon.0) 1132 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:14:18.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:14:18 smithi086 bash[24289]: audit 2024-09-16T09:14:17.671902+0000 mon.a (mon.0) 1133 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:14:18.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:14:18 smithi086 bash[24289]: audit 2024-09-16T09:14:17.678777+0000 mon.a (mon.0) 1134 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:14:18.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:14:18 smithi086 bash[24289]: audit 2024-09-16T09:14:17.683058+0000 mon.a (mon.0) 1135 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:14:18.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:14:18 smithi047 bash[22744]: cluster 2024-09-16T09:14:16.961478+0000 mgr.a (mgr.14373) 9392 : cluster [DBG] pgmap v6514: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:14:18.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:14:18 smithi047 bash[22744]: audit 2024-09-16T09:14:17.666714+0000 mon.a (mon.0) 1132 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:14:18.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:14:18 smithi047 bash[22744]: audit 2024-09-16T09:14:17.671902+0000 mon.a (mon.0) 1133 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:14:18.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:14:18 smithi047 bash[22744]: audit 2024-09-16T09:14:17.678777+0000 mon.a (mon.0) 1134 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:14:18.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:14:18 smithi047 bash[22744]: audit 2024-09-16T09:14:17.683058+0000 mon.a (mon.0) 1135 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:14:19.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:14:19 smithi157 bash[24585]: audit 2024-09-16T09:14:18.462426+0000 mon.b (mon.2) 875 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:14:19.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:14:19 smithi157 bash[24585]: audit 2024-09-16T09:14:18.464694+0000 mon.b (mon.2) 876 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T09:14:19.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:14:19 smithi157 bash[24585]: audit 2024-09-16T09:14:18.474941+0000 mon.a (mon.0) 1136 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:14:19.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:14:19 smithi157 bash[24585]: audit 2024-09-16T09:14:18.481874+0000 mon.b (mon.2) 877 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:14:19.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:14:19 smithi086 bash[24289]: audit 2024-09-16T09:14:18.462426+0000 mon.b (mon.2) 875 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:14:19.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:14:19 smithi086 bash[24289]: audit 2024-09-16T09:14:18.464694+0000 mon.b (mon.2) 876 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T09:14:19.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:14:19 smithi086 bash[24289]: audit 2024-09-16T09:14:18.474941+0000 mon.a (mon.0) 1136 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:14:19.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:14:19 smithi086 bash[24289]: audit 2024-09-16T09:14:18.481874+0000 mon.b (mon.2) 877 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:14:19.592 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 09:14:19 smithi047 bash[22994]: debug 2024-09-16T09:14:19.221+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T09:14:19.592 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 09:14:19 smithi047 bash[22994]: debug 2024-09-16T09:14:19.225+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T09:14:19.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:14:19 smithi047 bash[22744]: audit 2024-09-16T09:14:18.462426+0000 mon.b (mon.2) 875 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:14:19.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:14:19 smithi047 bash[22744]: audit 2024-09-16T09:14:18.464694+0000 mon.b (mon.2) 876 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T09:14:19.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:14:19 smithi047 bash[22744]: audit 2024-09-16T09:14:18.474941+0000 mon.a (mon.0) 1136 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:14:19.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:14:19 smithi047 bash[22744]: audit 2024-09-16T09:14:18.481874+0000 mon.b (mon.2) 877 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:14:20.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:14:20 smithi157 bash[24585]: audit 2024-09-16T09:14:18.482516+0000 mgr.a (mgr.14373) 9393 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:14:20.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:14:20 smithi157 bash[24585]: cluster 2024-09-16T09:14:18.962184+0000 mgr.a (mgr.14373) 9394 : cluster [DBG] pgmap v6515: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:14:20.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:14:20 smithi157 bash[24585]: audit 2024-09-16T09:14:19.225237+0000 mgr.a (mgr.14373) 9395 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T09:14:20.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:14:20 smithi157 bash[24585]: cephadm 2024-09-16T09:14:19.227698+0000 mgr.a (mgr.14373) 9396 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T09:14:20.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:14:20 smithi086 bash[24289]: audit 2024-09-16T09:14:18.482516+0000 mgr.a (mgr.14373) 9393 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:14:20.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:14:20 smithi086 bash[24289]: cluster 2024-09-16T09:14:18.962184+0000 mgr.a (mgr.14373) 9394 : cluster [DBG] pgmap v6515: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:14:20.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:14:20 smithi086 bash[24289]: audit 2024-09-16T09:14:19.225237+0000 mgr.a (mgr.14373) 9395 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T09:14:20.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:14:20 smithi086 bash[24289]: cephadm 2024-09-16T09:14:19.227698+0000 mgr.a (mgr.14373) 9396 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T09:14:20.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:14:20 smithi047 bash[22744]: audit 2024-09-16T09:14:18.482516+0000 mgr.a (mgr.14373) 9393 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:14:20.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:14:20 smithi047 bash[22744]: cluster 2024-09-16T09:14:18.962184+0000 mgr.a (mgr.14373) 9394 : cluster [DBG] pgmap v6515: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:14:20.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:14:20 smithi047 bash[22744]: audit 2024-09-16T09:14:19.225237+0000 mgr.a (mgr.14373) 9395 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T09:14:20.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:14:20 smithi047 bash[22744]: cephadm 2024-09-16T09:14:19.227698+0000 mgr.a (mgr.14373) 9396 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T09:14:21.320 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:14:21.321 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:14:21.321 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:14:22.109 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:14:22.109 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:14:22.109 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:14:22.110 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:14:22.110 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:14:22.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:14:22 smithi157 bash[24585]: cluster 2024-09-16T09:14:20.963076+0000 mgr.a (mgr.14373) 9397 : cluster [DBG] pgmap v6516: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:14:22.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:14:22 smithi086 bash[24289]: cluster 2024-09-16T09:14:20.963076+0000 mgr.a (mgr.14373) 9397 : cluster [DBG] pgmap v6516: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:14:22.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:14:22 smithi047 bash[22744]: cluster 2024-09-16T09:14:20.963076+0000 mgr.a (mgr.14373) 9397 : cluster [DBG] pgmap v6516: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:14:23.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:14:23 smithi157 bash[24585]: audit 2024-09-16T09:14:21.657403+0000 mgr.a (mgr.14373) 9398 : audit [DBG] from='client.208482 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:14:23.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:14:23 smithi086 bash[24289]: audit 2024-09-16T09:14:21.657403+0000 mgr.a (mgr.14373) 9398 : audit [DBG] from='client.208482 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:14:23.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:14:23 smithi047 bash[22744]: audit 2024-09-16T09:14:21.657403+0000 mgr.a (mgr.14373) 9398 : audit [DBG] from='client.208482 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:14:24.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:14:24 smithi157 bash[24585]: cluster 2024-09-16T09:14:22.965771+0000 mgr.a (mgr.14373) 9399 : cluster [DBG] pgmap v6517: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:14:24.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:14:24 smithi086 bash[24289]: cluster 2024-09-16T09:14:22.965771+0000 mgr.a (mgr.14373) 9399 : cluster [DBG] pgmap v6517: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:14:24.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:14:24 smithi047 bash[22744]: cluster 2024-09-16T09:14:22.965771+0000 mgr.a (mgr.14373) 9399 : cluster [DBG] pgmap v6517: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:14:26.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:14:26 smithi157 bash[24585]: cluster 2024-09-16T09:14:24.966591+0000 mgr.a (mgr.14373) 9400 : cluster [DBG] pgmap v6518: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T09:14:26.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:14:26 smithi086 bash[24289]: cluster 2024-09-16T09:14:24.966591+0000 mgr.a (mgr.14373) 9400 : cluster [DBG] pgmap v6518: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T09:14:26.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:14:26 smithi047 bash[22744]: cluster 2024-09-16T09:14:24.966591+0000 mgr.a (mgr.14373) 9400 : cluster [DBG] pgmap v6518: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T09:14:27.111 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:14:27.112 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:14:27.112 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:14:27.890 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:14:27.890 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:14:27.890 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:14:27.890 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:14:27.890 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:14:28.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:14:28 smithi157 bash[24585]: cluster 2024-09-16T09:14:26.968541+0000 mgr.a (mgr.14373) 9401 : cluster [DBG] pgmap v6519: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:14:28.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:14:28 smithi086 bash[24289]: cluster 2024-09-16T09:14:26.968541+0000 mgr.a (mgr.14373) 9401 : cluster [DBG] pgmap v6519: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:14:28.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:14:28 smithi047 bash[22744]: cluster 2024-09-16T09:14:26.968541+0000 mgr.a (mgr.14373) 9401 : cluster [DBG] pgmap v6519: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:14:29.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:14:29 smithi157 bash[24585]: audit 2024-09-16T09:14:27.451036+0000 mgr.a (mgr.14373) 9402 : audit [DBG] from='client.208557 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:14:29.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:14:29 smithi086 bash[24289]: audit 2024-09-16T09:14:27.451036+0000 mgr.a (mgr.14373) 9402 : audit [DBG] from='client.208557 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:14:29.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:14:29 smithi047 bash[22744]: audit 2024-09-16T09:14:27.451036+0000 mgr.a (mgr.14373) 9402 : audit [DBG] from='client.208557 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:14:30.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:14:30 smithi157 bash[24585]: cluster 2024-09-16T09:14:28.969458+0000 mgr.a (mgr.14373) 9403 : cluster [DBG] pgmap v6520: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T09:14:30.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:14:30 smithi086 bash[24289]: cluster 2024-09-16T09:14:28.969458+0000 mgr.a (mgr.14373) 9403 : cluster [DBG] pgmap v6520: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T09:14:30.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:14:30 smithi047 bash[22744]: cluster 2024-09-16T09:14:28.969458+0000 mgr.a (mgr.14373) 9403 : cluster [DBG] pgmap v6520: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T09:14:32.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:14:32 smithi157 bash[24585]: cluster 2024-09-16T09:14:30.970257+0000 mgr.a (mgr.14373) 9404 : cluster [DBG] pgmap v6521: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T09:14:32.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:14:32 smithi086 bash[24289]: cluster 2024-09-16T09:14:30.970257+0000 mgr.a (mgr.14373) 9404 : cluster [DBG] pgmap v6521: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T09:14:32.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:14:32 smithi047 bash[22744]: cluster 2024-09-16T09:14:30.970257+0000 mgr.a (mgr.14373) 9404 : cluster [DBG] pgmap v6521: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T09:14:32.891 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:14:32.892 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:14:32.892 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:14:33.646 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:14:33.646 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:14:33.646 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:14:33.646 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:14:33.646 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:14:34.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:14:34 smithi157 bash[24585]: cluster 2024-09-16T09:14:32.972310+0000 mgr.a (mgr.14373) 9405 : cluster [DBG] pgmap v6522: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:14:34.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:14:34 smithi157 bash[24585]: audit 2024-09-16T09:14:33.225493+0000 mgr.a (mgr.14373) 9406 : audit [DBG] from='client.208632 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:14:34.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:14:34 smithi086 bash[24289]: cluster 2024-09-16T09:14:32.972310+0000 mgr.a (mgr.14373) 9405 : cluster [DBG] pgmap v6522: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:14:34.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:14:34 smithi086 bash[24289]: audit 2024-09-16T09:14:33.225493+0000 mgr.a (mgr.14373) 9406 : audit [DBG] from='client.208632 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:14:34.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:14:34 smithi047 bash[22744]: cluster 2024-09-16T09:14:32.972310+0000 mgr.a (mgr.14373) 9405 : cluster [DBG] pgmap v6522: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:14:34.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:14:34 smithi047 bash[22744]: audit 2024-09-16T09:14:33.225493+0000 mgr.a (mgr.14373) 9406 : audit [DBG] from='client.208632 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:14:36.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:14:36 smithi157 bash[24585]: cluster 2024-09-16T09:14:34.973206+0000 mgr.a (mgr.14373) 9407 : cluster [DBG] pgmap v6523: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:14:36.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:14:36 smithi086 bash[24289]: cluster 2024-09-16T09:14:34.973206+0000 mgr.a (mgr.14373) 9407 : cluster [DBG] pgmap v6523: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:14:36.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:14:36 smithi047 bash[22744]: cluster 2024-09-16T09:14:34.973206+0000 mgr.a (mgr.14373) 9407 : cluster [DBG] pgmap v6523: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:14:38.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:14:38 smithi157 bash[24585]: cluster 2024-09-16T09:14:36.975615+0000 mgr.a (mgr.14373) 9408 : cluster [DBG] pgmap v6524: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:14:38.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:14:38 smithi086 bash[24289]: cluster 2024-09-16T09:14:36.975615+0000 mgr.a (mgr.14373) 9408 : cluster [DBG] pgmap v6524: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:14:38.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:14:38 smithi047 bash[22744]: cluster 2024-09-16T09:14:36.975615+0000 mgr.a (mgr.14373) 9408 : cluster [DBG] pgmap v6524: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:14:38.647 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:14:38.647 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:14:38.648 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:14:39.401 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:14:39.401 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:14:39.401 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:14:39.402 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:14:39.402 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:14:40.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:14:40 smithi157 bash[24585]: audit 2024-09-16T09:14:38.976931+0000 mgr.a (mgr.14373) 9409 : audit [DBG] from='client.208707 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:14:40.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:14:40 smithi157 bash[24585]: cluster 2024-09-16T09:14:38.977644+0000 mgr.a (mgr.14373) 9410 : cluster [DBG] pgmap v6525: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:14:40.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:14:40 smithi086 bash[24289]: audit 2024-09-16T09:14:38.976931+0000 mgr.a (mgr.14373) 9409 : audit [DBG] from='client.208707 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:14:40.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:14:40 smithi086 bash[24289]: cluster 2024-09-16T09:14:38.977644+0000 mgr.a (mgr.14373) 9410 : cluster [DBG] pgmap v6525: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:14:40.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:14:40 smithi047 bash[22744]: audit 2024-09-16T09:14:38.976931+0000 mgr.a (mgr.14373) 9409 : audit [DBG] from='client.208707 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:14:40.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:14:40 smithi047 bash[22744]: cluster 2024-09-16T09:14:38.977644+0000 mgr.a (mgr.14373) 9410 : cluster [DBG] pgmap v6525: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:14:42.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:14:42 smithi157 bash[24585]: cluster 2024-09-16T09:14:40.978606+0000 mgr.a (mgr.14373) 9411 : cluster [DBG] pgmap v6526: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:14:42.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:14:42 smithi086 bash[24289]: cluster 2024-09-16T09:14:40.978606+0000 mgr.a (mgr.14373) 9411 : cluster [DBG] pgmap v6526: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:14:42.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:14:42 smithi047 bash[22744]: cluster 2024-09-16T09:14:40.978606+0000 mgr.a (mgr.14373) 9411 : cluster [DBG] pgmap v6526: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:14:44.402 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:14:44.403 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:14:44.403 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:14:44.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:14:44 smithi157 bash[24585]: cluster 2024-09-16T09:14:42.980818+0000 mgr.a (mgr.14373) 9412 : cluster [DBG] pgmap v6527: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:14:44.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:14:44 smithi086 bash[24289]: cluster 2024-09-16T09:14:42.980818+0000 mgr.a (mgr.14373) 9412 : cluster [DBG] pgmap v6527: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:14:44.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:14:44 smithi047 bash[22744]: cluster 2024-09-16T09:14:42.980818+0000 mgr.a (mgr.14373) 9412 : cluster [DBG] pgmap v6527: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:14:45.172 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:14:45.172 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:14:45.172 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:14:45.172 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:14:45.172 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:14:46.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:14:46 smithi157 bash[24585]: audit 2024-09-16T09:14:44.736934+0000 mgr.a (mgr.14373) 9413 : audit [DBG] from='client.208785 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:14:46.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:14:46 smithi157 bash[24585]: cluster 2024-09-16T09:14:44.981494+0000 mgr.a (mgr.14373) 9414 : cluster [DBG] pgmap v6528: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:14:46.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:14:46 smithi086 bash[24289]: audit 2024-09-16T09:14:44.736934+0000 mgr.a (mgr.14373) 9413 : audit [DBG] from='client.208785 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:14:46.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:14:46 smithi086 bash[24289]: cluster 2024-09-16T09:14:44.981494+0000 mgr.a (mgr.14373) 9414 : cluster [DBG] pgmap v6528: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:14:46.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:14:46 smithi047 bash[22744]: audit 2024-09-16T09:14:44.736934+0000 mgr.a (mgr.14373) 9413 : audit [DBG] from='client.208785 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:14:46.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:14:46 smithi047 bash[22744]: cluster 2024-09-16T09:14:44.981494+0000 mgr.a (mgr.14373) 9414 : cluster [DBG] pgmap v6528: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:14:48.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:14:48 smithi157 bash[24585]: cluster 2024-09-16T09:14:46.983947+0000 mgr.a (mgr.14373) 9415 : cluster [DBG] pgmap v6529: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:14:48.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:14:48 smithi086 bash[24289]: cluster 2024-09-16T09:14:46.983947+0000 mgr.a (mgr.14373) 9415 : cluster [DBG] pgmap v6529: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:14:48.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:14:48 smithi047 bash[22744]: cluster 2024-09-16T09:14:46.983947+0000 mgr.a (mgr.14373) 9415 : cluster [DBG] pgmap v6529: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:14:50.174 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:14:50.174 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:14:50.175 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:14:50.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:14:50 smithi157 bash[24585]: cluster 2024-09-16T09:14:48.984772+0000 mgr.a (mgr.14373) 9416 : cluster [DBG] pgmap v6530: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:14:50.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:14:50 smithi086 bash[24289]: cluster 2024-09-16T09:14:48.984772+0000 mgr.a (mgr.14373) 9416 : cluster [DBG] pgmap v6530: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:14:50.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:14:50 smithi047 bash[22744]: cluster 2024-09-16T09:14:48.984772+0000 mgr.a (mgr.14373) 9416 : cluster [DBG] pgmap v6530: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:14:50.946 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:14:50.946 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:14:50.947 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:14:50.947 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:14:50.947 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:14:52.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:14:52 smithi157 bash[24585]: audit 2024-09-16T09:14:50.512250+0000 mgr.a (mgr.14373) 9417 : audit [DBG] from='client.208863 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:14:52.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:14:52 smithi157 bash[24585]: cluster 2024-09-16T09:14:50.985341+0000 mgr.a (mgr.14373) 9418 : cluster [DBG] pgmap v6531: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:14:52.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:14:52 smithi086 bash[24289]: audit 2024-09-16T09:14:50.512250+0000 mgr.a (mgr.14373) 9417 : audit [DBG] from='client.208863 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:14:52.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:14:52 smithi086 bash[24289]: cluster 2024-09-16T09:14:50.985341+0000 mgr.a (mgr.14373) 9418 : cluster [DBG] pgmap v6531: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:14:52.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:14:52 smithi047 bash[22744]: audit 2024-09-16T09:14:50.512250+0000 mgr.a (mgr.14373) 9417 : audit [DBG] from='client.208863 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:14:52.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:14:52 smithi047 bash[22744]: cluster 2024-09-16T09:14:50.985341+0000 mgr.a (mgr.14373) 9418 : cluster [DBG] pgmap v6531: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:14:54.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:14:54 smithi157 bash[24585]: cluster 2024-09-16T09:14:52.987562+0000 mgr.a (mgr.14373) 9419 : cluster [DBG] pgmap v6532: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:14:54.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:14:54 smithi086 bash[24289]: cluster 2024-09-16T09:14:52.987562+0000 mgr.a (mgr.14373) 9419 : cluster [DBG] pgmap v6532: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:14:54.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:14:54 smithi047 bash[22744]: cluster 2024-09-16T09:14:52.987562+0000 mgr.a (mgr.14373) 9419 : cluster [DBG] pgmap v6532: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:14:55.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:14:55 smithi157 bash[24585]: cluster 2024-09-16T09:14:54.988337+0000 mgr.a (mgr.14373) 9420 : cluster [DBG] pgmap v6533: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:14:55.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:14:55 smithi086 bash[24289]: cluster 2024-09-16T09:14:54.988337+0000 mgr.a (mgr.14373) 9420 : cluster [DBG] pgmap v6533: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:14:55.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:14:55 smithi047 bash[22744]: cluster 2024-09-16T09:14:54.988337+0000 mgr.a (mgr.14373) 9420 : cluster [DBG] pgmap v6533: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:14:55.948 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:14:55.948 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:14:55.949 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:14:56.702 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:14:56.702 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:14:56.702 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:14:56.702 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:14:56.702 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:14:56.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:14:56 smithi157 bash[24585]: audit 2024-09-16T09:14:56.274552+0000 mgr.a (mgr.14373) 9421 : audit [DBG] from='client.208941 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:14:56.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:14:56 smithi086 bash[24289]: audit 2024-09-16T09:14:56.274552+0000 mgr.a (mgr.14373) 9421 : audit [DBG] from='client.208941 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:14:56.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:14:56 smithi047 bash[22744]: audit 2024-09-16T09:14:56.274552+0000 mgr.a (mgr.14373) 9421 : audit [DBG] from='client.208941 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:14:57.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:14:57 smithi157 bash[24585]: cluster 2024-09-16T09:14:56.991120+0000 mgr.a (mgr.14373) 9422 : cluster [DBG] pgmap v6534: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:14:57.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:14:57 smithi086 bash[24289]: cluster 2024-09-16T09:14:56.991120+0000 mgr.a (mgr.14373) 9422 : cluster [DBG] pgmap v6534: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:14:57.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:14:57 smithi047 bash[22744]: cluster 2024-09-16T09:14:56.991120+0000 mgr.a (mgr.14373) 9422 : cluster [DBG] pgmap v6534: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:15:00.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:15:00 smithi157 bash[24585]: cluster 2024-09-16T09:14:58.991918+0000 mgr.a (mgr.14373) 9423 : cluster [DBG] pgmap v6535: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:15:00.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:15:00 smithi086 bash[24289]: cluster 2024-09-16T09:14:58.991918+0000 mgr.a (mgr.14373) 9423 : cluster [DBG] pgmap v6535: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:15:00.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:15:00 smithi047 bash[22744]: cluster 2024-09-16T09:14:58.991918+0000 mgr.a (mgr.14373) 9423 : cluster [DBG] pgmap v6535: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:15:01.703 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:15:01.704 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:15:01.704 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:15:02.303 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:15:02 smithi157 bash[24585]: cluster 2024-09-16T09:15:00.992691+0000 mgr.a (mgr.14373) 9424 : cluster [DBG] pgmap v6536: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T09:15:02.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:15:02 smithi086 bash[24289]: cluster 2024-09-16T09:15:00.992691+0000 mgr.a (mgr.14373) 9424 : cluster [DBG] pgmap v6536: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T09:15:02.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:15:02 smithi047 bash[22744]: cluster 2024-09-16T09:15:00.992691+0000 mgr.a (mgr.14373) 9424 : cluster [DBG] pgmap v6536: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T09:15:02.474 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:15:02.474 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:15:02.474 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:15:02.474 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:15:02.475 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:15:03.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:15:03 smithi086 bash[24289]: audit 2024-09-16T09:15:02.039469+0000 mgr.a (mgr.14373) 9425 : audit [DBG] from='client.209016 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:15:03.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:15:03 smithi047 bash[22744]: audit 2024-09-16T09:15:02.039469+0000 mgr.a (mgr.14373) 9425 : audit [DBG] from='client.209016 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:15:03.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:15:03 smithi157 bash[24585]: audit 2024-09-16T09:15:02.039469+0000 mgr.a (mgr.14373) 9425 : audit [DBG] from='client.209016 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:15:04.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:15:04 smithi086 bash[24289]: cluster 2024-09-16T09:15:02.995425+0000 mgr.a (mgr.14373) 9426 : cluster [DBG] pgmap v6537: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:15:04.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:15:04 smithi047 bash[22744]: cluster 2024-09-16T09:15:02.995425+0000 mgr.a (mgr.14373) 9426 : cluster [DBG] pgmap v6537: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:15:04.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:15:04 smithi157 bash[24585]: cluster 2024-09-16T09:15:02.995425+0000 mgr.a (mgr.14373) 9426 : cluster [DBG] pgmap v6537: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:15:06.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:15:06 smithi047 bash[22744]: cluster 2024-09-16T09:15:04.996203+0000 mgr.a (mgr.14373) 9427 : cluster [DBG] pgmap v6538: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:15:06.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:15:06 smithi157 bash[24585]: cluster 2024-09-16T09:15:04.996203+0000 mgr.a (mgr.14373) 9427 : cluster [DBG] pgmap v6538: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:15:06.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:15:06 smithi086 bash[24289]: cluster 2024-09-16T09:15:04.996203+0000 mgr.a (mgr.14373) 9427 : cluster [DBG] pgmap v6538: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:15:07.475 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:15:07.476 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:15:07.477 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:15:08.259 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:15:08.259 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:15:08.259 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:15:08.259 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:15:08.259 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:15:08.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:15:08 smithi047 bash[22744]: cluster 2024-09-16T09:15:06.998166+0000 mgr.a (mgr.14373) 9428 : cluster [DBG] pgmap v6539: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:15:08.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:15:08 smithi157 bash[24585]: cluster 2024-09-16T09:15:06.998166+0000 mgr.a (mgr.14373) 9428 : cluster [DBG] pgmap v6539: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:15:08.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:15:08 smithi086 bash[24289]: cluster 2024-09-16T09:15:06.998166+0000 mgr.a (mgr.14373) 9428 : cluster [DBG] pgmap v6539: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:15:09.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:15:09 smithi047 bash[22744]: audit 2024-09-16T09:15:07.810727+0000 mgr.a (mgr.14373) 9429 : audit [DBG] from='client.209094 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:15:09.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:15:09 smithi157 bash[24585]: audit 2024-09-16T09:15:07.810727+0000 mgr.a (mgr.14373) 9429 : audit [DBG] from='client.209094 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:15:09.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:15:09 smithi086 bash[24289]: audit 2024-09-16T09:15:07.810727+0000 mgr.a (mgr.14373) 9429 : audit [DBG] from='client.209094 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:15:10.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:15:10 smithi047 bash[22744]: cluster 2024-09-16T09:15:08.999074+0000 mgr.a (mgr.14373) 9430 : cluster [DBG] pgmap v6540: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:15:10.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:15:10 smithi157 bash[24585]: cluster 2024-09-16T09:15:08.999074+0000 mgr.a (mgr.14373) 9430 : cluster [DBG] pgmap v6540: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:15:10.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:15:10 smithi086 bash[24289]: cluster 2024-09-16T09:15:08.999074+0000 mgr.a (mgr.14373) 9430 : cluster [DBG] pgmap v6540: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:15:12.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:15:12 smithi047 bash[22744]: cluster 2024-09-16T09:15:10.999871+0000 mgr.a (mgr.14373) 9431 : cluster [DBG] pgmap v6541: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:15:12.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:15:12 smithi157 bash[24585]: cluster 2024-09-16T09:15:10.999871+0000 mgr.a (mgr.14373) 9431 : cluster [DBG] pgmap v6541: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:15:12.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:15:12 smithi086 bash[24289]: cluster 2024-09-16T09:15:10.999871+0000 mgr.a (mgr.14373) 9431 : cluster [DBG] pgmap v6541: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:15:13.260 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:15:13.261 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:15:13.261 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:15:14.041 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:15:14.041 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:15:14.041 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:15:14.041 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:15:14.041 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:15:14.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:15:14 smithi157 bash[24585]: cluster 2024-09-16T09:15:13.002092+0000 mgr.a (mgr.14373) 9432 : cluster [DBG] pgmap v6542: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:15:14.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:15:14 smithi086 bash[24289]: cluster 2024-09-16T09:15:13.002092+0000 mgr.a (mgr.14373) 9432 : cluster [DBG] pgmap v6542: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:15:14.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:15:14 smithi047 bash[22744]: cluster 2024-09-16T09:15:13.002092+0000 mgr.a (mgr.14373) 9432 : cluster [DBG] pgmap v6542: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:15:15.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:15:15 smithi157 bash[24585]: audit 2024-09-16T09:15:13.597097+0000 mgr.a (mgr.14373) 9433 : audit [DBG] from='client.209166 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:15:15.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:15:15 smithi086 bash[24289]: audit 2024-09-16T09:15:13.597097+0000 mgr.a (mgr.14373) 9433 : audit [DBG] from='client.209166 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:15:15.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:15:15 smithi047 bash[22744]: audit 2024-09-16T09:15:13.597097+0000 mgr.a (mgr.14373) 9433 : audit [DBG] from='client.209166 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:15:16.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:15:16 smithi157 bash[24585]: cluster 2024-09-16T09:15:15.003049+0000 mgr.a (mgr.14373) 9434 : cluster [DBG] pgmap v6543: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:15:16.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:15:16 smithi086 bash[24289]: cluster 2024-09-16T09:15:15.003049+0000 mgr.a (mgr.14373) 9434 : cluster [DBG] pgmap v6543: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:15:16.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:15:16 smithi047 bash[22744]: cluster 2024-09-16T09:15:15.003049+0000 mgr.a (mgr.14373) 9434 : cluster [DBG] pgmap v6543: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:15:18.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:15:18 smithi157 bash[24585]: cluster 2024-09-16T09:15:17.005276+0000 mgr.a (mgr.14373) 9435 : cluster [DBG] pgmap v6544: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:15:18.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:15:18 smithi086 bash[24289]: cluster 2024-09-16T09:15:17.005276+0000 mgr.a (mgr.14373) 9435 : cluster [DBG] pgmap v6544: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:15:18.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:15:18 smithi047 bash[22744]: cluster 2024-09-16T09:15:17.005276+0000 mgr.a (mgr.14373) 9435 : cluster [DBG] pgmap v6544: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:15:19.042 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:15:19.043 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:15:19.043 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:15:19.795 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:15:19.795 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:15:19.796 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:15:19.796 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:15:19.796 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:15:20.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:15:20 smithi157 bash[24585]: cluster 2024-09-16T09:15:19.006052+0000 mgr.a (mgr.14373) 9436 : cluster [DBG] pgmap v6545: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:15:20.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:15:20 smithi157 bash[24585]: audit 2024-09-16T09:15:19.289644+0000 mon.b (mon.2) 878 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T09:15:20.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:15:20 smithi086 bash[24289]: cluster 2024-09-16T09:15:19.006052+0000 mgr.a (mgr.14373) 9436 : cluster [DBG] pgmap v6545: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:15:20.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:15:20 smithi086 bash[24289]: audit 2024-09-16T09:15:19.289644+0000 mon.b (mon.2) 878 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T09:15:20.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:15:20 smithi047 bash[22744]: cluster 2024-09-16T09:15:19.006052+0000 mgr.a (mgr.14373) 9436 : cluster [DBG] pgmap v6545: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:15:20.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:15:20 smithi047 bash[22744]: audit 2024-09-16T09:15:19.289644+0000 mon.b (mon.2) 878 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T09:15:21.343 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 09:15:20 smithi047 bash[22994]: debug 2024-09-16T09:15:20.884+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T09:15:21.343 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 09:15:20 smithi047 bash[22994]: debug 2024-09-16T09:15:20.888+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T09:15:21.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:15:21 smithi047 bash[22744]: audit 2024-09-16T09:15:19.376424+0000 mgr.a (mgr.14373) 9437 : audit [DBG] from='client.209238 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:15:21.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:15:21 smithi047 bash[22744]: audit 2024-09-16T09:15:20.145891+0000 mon.b (mon.2) 879 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:15:21.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:15:21 smithi047 bash[22744]: audit 2024-09-16T09:15:20.148341+0000 mon.b (mon.2) 880 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T09:15:21.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:15:21 smithi047 bash[22744]: audit 2024-09-16T09:15:20.157665+0000 mon.a (mon.0) 1137 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:15:21.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:15:21 smithi047 bash[22744]: audit 2024-09-16T09:15:20.164592+0000 mon.b (mon.2) 881 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:15:21.344 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:15:21 smithi047 bash[22744]: audit 2024-09-16T09:15:20.165575+0000 mgr.a (mgr.14373) 9438 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:15:21.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:15:21 smithi157 bash[24585]: audit 2024-09-16T09:15:19.376424+0000 mgr.a (mgr.14373) 9437 : audit [DBG] from='client.209238 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:15:21.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:15:21 smithi157 bash[24585]: audit 2024-09-16T09:15:20.145891+0000 mon.b (mon.2) 879 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:15:21.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:15:21 smithi157 bash[24585]: audit 2024-09-16T09:15:20.148341+0000 mon.b (mon.2) 880 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T09:15:21.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:15:21 smithi157 bash[24585]: audit 2024-09-16T09:15:20.157665+0000 mon.a (mon.0) 1137 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:15:21.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:15:21 smithi157 bash[24585]: audit 2024-09-16T09:15:20.164592+0000 mon.b (mon.2) 881 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:15:21.555 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:15:21 smithi157 bash[24585]: audit 2024-09-16T09:15:20.165575+0000 mgr.a (mgr.14373) 9438 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:15:21.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:15:21 smithi086 bash[24289]: audit 2024-09-16T09:15:19.376424+0000 mgr.a (mgr.14373) 9437 : audit [DBG] from='client.209238 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:15:21.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:15:21 smithi086 bash[24289]: audit 2024-09-16T09:15:20.145891+0000 mon.b (mon.2) 879 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:15:21.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:15:21 smithi086 bash[24289]: audit 2024-09-16T09:15:20.148341+0000 mon.b (mon.2) 880 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T09:15:21.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:15:21 smithi086 bash[24289]: audit 2024-09-16T09:15:20.157665+0000 mon.a (mon.0) 1137 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:15:21.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:15:21 smithi086 bash[24289]: audit 2024-09-16T09:15:20.164592+0000 mon.b (mon.2) 881 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:15:21.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:15:21 smithi086 bash[24289]: audit 2024-09-16T09:15:20.165575+0000 mgr.a (mgr.14373) 9438 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:15:22.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:15:22 smithi157 bash[24585]: audit 2024-09-16T09:15:20.888571+0000 mgr.a (mgr.14373) 9439 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T09:15:22.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:15:22 smithi157 bash[24585]: cephadm 2024-09-16T09:15:20.890750+0000 mgr.a (mgr.14373) 9440 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T09:15:22.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:15:22 smithi157 bash[24585]: cluster 2024-09-16T09:15:21.006964+0000 mgr.a (mgr.14373) 9441 : cluster [DBG] pgmap v6546: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:15:22.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:15:22 smithi086 bash[24289]: audit 2024-09-16T09:15:20.888571+0000 mgr.a (mgr.14373) 9439 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T09:15:22.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:15:22 smithi086 bash[24289]: cephadm 2024-09-16T09:15:20.890750+0000 mgr.a (mgr.14373) 9440 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T09:15:22.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:15:22 smithi086 bash[24289]: cluster 2024-09-16T09:15:21.006964+0000 mgr.a (mgr.14373) 9441 : cluster [DBG] pgmap v6546: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:15:22.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:15:22 smithi047 bash[22744]: audit 2024-09-16T09:15:20.888571+0000 mgr.a (mgr.14373) 9439 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T09:15:22.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:15:22 smithi047 bash[22744]: cephadm 2024-09-16T09:15:20.890750+0000 mgr.a (mgr.14373) 9440 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T09:15:22.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:15:22 smithi047 bash[22744]: cluster 2024-09-16T09:15:21.006964+0000 mgr.a (mgr.14373) 9441 : cluster [DBG] pgmap v6546: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:15:24.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:15:24 smithi157 bash[24585]: cluster 2024-09-16T09:15:23.009209+0000 mgr.a (mgr.14373) 9442 : cluster [DBG] pgmap v6547: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:15:24.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:15:24 smithi086 bash[24289]: cluster 2024-09-16T09:15:23.009209+0000 mgr.a (mgr.14373) 9442 : cluster [DBG] pgmap v6547: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:15:24.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:15:24 smithi047 bash[22744]: cluster 2024-09-16T09:15:23.009209+0000 mgr.a (mgr.14373) 9442 : cluster [DBG] pgmap v6547: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:15:24.797 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:15:24.798 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:15:24.798 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:15:25.571 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:15:25.571 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:15:25.571 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:15:25.571 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:15:25.572 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:15:26.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:15:26 smithi157 bash[24585]: cluster 2024-09-16T09:15:25.009942+0000 mgr.a (mgr.14373) 9443 : cluster [DBG] pgmap v6548: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:15:26.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:15:26 smithi157 bash[24585]: audit 2024-09-16T09:15:25.130106+0000 mgr.a (mgr.14373) 9444 : audit [DBG] from='client.209421 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:15:26.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:15:26 smithi086 bash[24289]: cluster 2024-09-16T09:15:25.009942+0000 mgr.a (mgr.14373) 9443 : cluster [DBG] pgmap v6548: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:15:26.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:15:26 smithi086 bash[24289]: audit 2024-09-16T09:15:25.130106+0000 mgr.a (mgr.14373) 9444 : audit [DBG] from='client.209421 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:15:26.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:15:26 smithi047 bash[22744]: cluster 2024-09-16T09:15:25.009942+0000 mgr.a (mgr.14373) 9443 : cluster [DBG] pgmap v6548: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:15:26.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:15:26 smithi047 bash[22744]: audit 2024-09-16T09:15:25.130106+0000 mgr.a (mgr.14373) 9444 : audit [DBG] from='client.209421 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:15:28.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:15:28 smithi157 bash[24585]: cluster 2024-09-16T09:15:27.012267+0000 mgr.a (mgr.14373) 9445 : cluster [DBG] pgmap v6549: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:15:28.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:15:28 smithi086 bash[24289]: cluster 2024-09-16T09:15:27.012267+0000 mgr.a (mgr.14373) 9445 : cluster [DBG] pgmap v6549: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:15:28.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:15:28 smithi047 bash[22744]: cluster 2024-09-16T09:15:27.012267+0000 mgr.a (mgr.14373) 9445 : cluster [DBG] pgmap v6549: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:15:30.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:15:30 smithi157 bash[24585]: cluster 2024-09-16T09:15:29.013027+0000 mgr.a (mgr.14373) 9446 : cluster [DBG] pgmap v6550: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:15:30.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:15:30 smithi086 bash[24289]: cluster 2024-09-16T09:15:29.013027+0000 mgr.a (mgr.14373) 9446 : cluster [DBG] pgmap v6550: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:15:30.572 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:15:30.573 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:15:30.573 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:15:30.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:15:30 smithi047 bash[22744]: cluster 2024-09-16T09:15:29.013027+0000 mgr.a (mgr.14373) 9446 : cluster [DBG] pgmap v6550: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:15:31.343 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:15:31.343 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:15:31.343 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:15:31.343 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:15:31.343 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:15:32.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:15:32 smithi157 bash[24585]: audit 2024-09-16T09:15:30.909872+0000 mgr.a (mgr.14373) 9447 : audit [DBG] from='client.209499 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:15:32.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:15:32 smithi157 bash[24585]: cluster 2024-09-16T09:15:31.013535+0000 mgr.a (mgr.14373) 9448 : cluster [DBG] pgmap v6551: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:15:32.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:15:32 smithi086 bash[24289]: audit 2024-09-16T09:15:30.909872+0000 mgr.a (mgr.14373) 9447 : audit [DBG] from='client.209499 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:15:32.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:15:32 smithi086 bash[24289]: cluster 2024-09-16T09:15:31.013535+0000 mgr.a (mgr.14373) 9448 : cluster [DBG] pgmap v6551: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:15:32.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:15:32 smithi047 bash[22744]: audit 2024-09-16T09:15:30.909872+0000 mgr.a (mgr.14373) 9447 : audit [DBG] from='client.209499 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:15:32.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:15:32 smithi047 bash[22744]: cluster 2024-09-16T09:15:31.013535+0000 mgr.a (mgr.14373) 9448 : cluster [DBG] pgmap v6551: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:15:34.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:15:34 smithi157 bash[24585]: cluster 2024-09-16T09:15:33.015865+0000 mgr.a (mgr.14373) 9449 : cluster [DBG] pgmap v6552: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:15:34.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:15:34 smithi086 bash[24289]: cluster 2024-09-16T09:15:33.015865+0000 mgr.a (mgr.14373) 9449 : cluster [DBG] pgmap v6552: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:15:34.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:15:34 smithi047 bash[22744]: cluster 2024-09-16T09:15:33.015865+0000 mgr.a (mgr.14373) 9449 : cluster [DBG] pgmap v6552: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:15:36.344 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:15:36.345 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:15:36.345 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:15:36.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:15:36 smithi157 bash[24585]: cluster 2024-09-16T09:15:35.016615+0000 mgr.a (mgr.14373) 9450 : cluster [DBG] pgmap v6553: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:15:36.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:15:36 smithi086 bash[24289]: cluster 2024-09-16T09:15:35.016615+0000 mgr.a (mgr.14373) 9450 : cluster [DBG] pgmap v6553: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:15:36.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:15:36 smithi047 bash[22744]: cluster 2024-09-16T09:15:35.016615+0000 mgr.a (mgr.14373) 9450 : cluster [DBG] pgmap v6553: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:15:37.128 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:15:37.128 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:15:37.129 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:15:37.129 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:15:37.129 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:15:38.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:15:38 smithi157 bash[24585]: audit 2024-09-16T09:15:36.681561+0000 mgr.a (mgr.14373) 9451 : audit [DBG] from='client.209568 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:15:38.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:15:38 smithi157 bash[24585]: cluster 2024-09-16T09:15:37.027305+0000 mgr.a (mgr.14373) 9452 : cluster [DBG] pgmap v6554: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:15:38.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:15:38 smithi086 bash[24289]: audit 2024-09-16T09:15:36.681561+0000 mgr.a (mgr.14373) 9451 : audit [DBG] from='client.209568 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:15:38.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:15:38 smithi086 bash[24289]: cluster 2024-09-16T09:15:37.027305+0000 mgr.a (mgr.14373) 9452 : cluster [DBG] pgmap v6554: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:15:38.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:15:38 smithi047 bash[22744]: audit 2024-09-16T09:15:36.681561+0000 mgr.a (mgr.14373) 9451 : audit [DBG] from='client.209568 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:15:38.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:15:38 smithi047 bash[22744]: cluster 2024-09-16T09:15:37.027305+0000 mgr.a (mgr.14373) 9452 : cluster [DBG] pgmap v6554: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:15:40.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:15:40 smithi157 bash[24585]: cluster 2024-09-16T09:15:39.028074+0000 mgr.a (mgr.14373) 9453 : cluster [DBG] pgmap v6555: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:15:40.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:15:40 smithi086 bash[24289]: cluster 2024-09-16T09:15:39.028074+0000 mgr.a (mgr.14373) 9453 : cluster [DBG] pgmap v6555: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:15:40.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:15:40 smithi047 bash[22744]: cluster 2024-09-16T09:15:39.028074+0000 mgr.a (mgr.14373) 9453 : cluster [DBG] pgmap v6555: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:15:42.130 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:15:42.131 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:15:42.131 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:15:42.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:15:42 smithi157 bash[24585]: cluster 2024-09-16T09:15:41.028836+0000 mgr.a (mgr.14373) 9454 : cluster [DBG] pgmap v6556: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:15:42.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:15:42 smithi086 bash[24289]: cluster 2024-09-16T09:15:41.028836+0000 mgr.a (mgr.14373) 9454 : cluster [DBG] pgmap v6556: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:15:42.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:15:42 smithi047 bash[22744]: cluster 2024-09-16T09:15:41.028836+0000 mgr.a (mgr.14373) 9454 : cluster [DBG] pgmap v6556: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:15:42.875 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:15:42.876 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:15:42.876 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:15:42.876 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:15:42.876 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:15:44.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:15:44 smithi157 bash[24585]: audit 2024-09-16T09:15:42.461947+0000 mgr.a (mgr.14373) 9455 : audit [DBG] from='client.209643 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:15:44.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:15:44 smithi157 bash[24585]: cluster 2024-09-16T09:15:43.031523+0000 mgr.a (mgr.14373) 9456 : cluster [DBG] pgmap v6557: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:15:44.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:15:44 smithi086 bash[24289]: audit 2024-09-16T09:15:42.461947+0000 mgr.a (mgr.14373) 9455 : audit [DBG] from='client.209643 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:15:44.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:15:44 smithi086 bash[24289]: cluster 2024-09-16T09:15:43.031523+0000 mgr.a (mgr.14373) 9456 : cluster [DBG] pgmap v6557: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:15:44.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:15:44 smithi047 bash[22744]: audit 2024-09-16T09:15:42.461947+0000 mgr.a (mgr.14373) 9455 : audit [DBG] from='client.209643 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:15:44.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:15:44 smithi047 bash[22744]: cluster 2024-09-16T09:15:43.031523+0000 mgr.a (mgr.14373) 9456 : cluster [DBG] pgmap v6557: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:15:46.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:15:46 smithi157 bash[24585]: cluster 2024-09-16T09:15:45.032317+0000 mgr.a (mgr.14373) 9457 : cluster [DBG] pgmap v6558: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:15:46.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:15:46 smithi086 bash[24289]: cluster 2024-09-16T09:15:45.032317+0000 mgr.a (mgr.14373) 9457 : cluster [DBG] pgmap v6558: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:15:46.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:15:46 smithi047 bash[22744]: cluster 2024-09-16T09:15:45.032317+0000 mgr.a (mgr.14373) 9457 : cluster [DBG] pgmap v6558: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:15:47.877 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:15:47.878 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:15:47.879 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:15:48.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:15:48 smithi157 bash[24585]: cluster 2024-09-16T09:15:47.034312+0000 mgr.a (mgr.14373) 9458 : cluster [DBG] pgmap v6559: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:15:48.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:15:48 smithi086 bash[24289]: cluster 2024-09-16T09:15:47.034312+0000 mgr.a (mgr.14373) 9458 : cluster [DBG] pgmap v6559: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:15:48.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:15:48 smithi047 bash[22744]: cluster 2024-09-16T09:15:47.034312+0000 mgr.a (mgr.14373) 9458 : cluster [DBG] pgmap v6559: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:15:48.646 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:15:48.646 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:15:48.646 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:15:48.646 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:15:48.646 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:15:49.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:15:49 smithi157 bash[24585]: audit 2024-09-16T09:15:48.210144+0000 mgr.a (mgr.14373) 9459 : audit [DBG] from='client.209718 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:15:49.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:15:49 smithi086 bash[24289]: audit 2024-09-16T09:15:48.210144+0000 mgr.a (mgr.14373) 9459 : audit [DBG] from='client.209718 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:15:49.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:15:49 smithi047 bash[22744]: audit 2024-09-16T09:15:48.210144+0000 mgr.a (mgr.14373) 9459 : audit [DBG] from='client.209718 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:15:50.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:15:50 smithi157 bash[24585]: cluster 2024-09-16T09:15:49.035343+0000 mgr.a (mgr.14373) 9460 : cluster [DBG] pgmap v6560: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:15:50.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:15:50 smithi086 bash[24289]: cluster 2024-09-16T09:15:49.035343+0000 mgr.a (mgr.14373) 9460 : cluster [DBG] pgmap v6560: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:15:50.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:15:50 smithi047 bash[22744]: cluster 2024-09-16T09:15:49.035343+0000 mgr.a (mgr.14373) 9460 : cluster [DBG] pgmap v6560: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:15:52.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:15:52 smithi157 bash[24585]: cluster 2024-09-16T09:15:51.036294+0000 mgr.a (mgr.14373) 9461 : cluster [DBG] pgmap v6561: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:15:52.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:15:52 smithi086 bash[24289]: cluster 2024-09-16T09:15:51.036294+0000 mgr.a (mgr.14373) 9461 : cluster [DBG] pgmap v6561: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:15:52.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:15:52 smithi047 bash[22744]: cluster 2024-09-16T09:15:51.036294+0000 mgr.a (mgr.14373) 9461 : cluster [DBG] pgmap v6561: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:15:53.647 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:15:53.648 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:15:53.648 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:15:54.397 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:15:54.398 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:15:54.398 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:15:54.398 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:15:54.398 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:15:54.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:15:54 smithi157 bash[24585]: cluster 2024-09-16T09:15:53.038662+0000 mgr.a (mgr.14373) 9462 : cluster [DBG] pgmap v6562: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:15:54.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:15:54 smithi086 bash[24289]: cluster 2024-09-16T09:15:53.038662+0000 mgr.a (mgr.14373) 9462 : cluster [DBG] pgmap v6562: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:15:54.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:15:54 smithi047 bash[22744]: cluster 2024-09-16T09:15:53.038662+0000 mgr.a (mgr.14373) 9462 : cluster [DBG] pgmap v6562: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:15:55.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:15:55 smithi157 bash[24585]: audit 2024-09-16T09:15:53.974958+0000 mgr.a (mgr.14373) 9463 : audit [DBG] from='client.209793 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:15:55.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:15:55 smithi086 bash[24289]: audit 2024-09-16T09:15:53.974958+0000 mgr.a (mgr.14373) 9463 : audit [DBG] from='client.209793 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:15:55.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:15:55 smithi047 bash[22744]: audit 2024-09-16T09:15:53.974958+0000 mgr.a (mgr.14373) 9463 : audit [DBG] from='client.209793 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:15:56.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:15:56 smithi157 bash[24585]: cluster 2024-09-16T09:15:55.039571+0000 mgr.a (mgr.14373) 9464 : cluster [DBG] pgmap v6563: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:15:56.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:15:56 smithi086 bash[24289]: cluster 2024-09-16T09:15:55.039571+0000 mgr.a (mgr.14373) 9464 : cluster [DBG] pgmap v6563: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:15:56.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:15:56 smithi047 bash[22744]: cluster 2024-09-16T09:15:55.039571+0000 mgr.a (mgr.14373) 9464 : cluster [DBG] pgmap v6563: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:15:58.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:15:58 smithi157 bash[24585]: cluster 2024-09-16T09:15:57.041928+0000 mgr.a (mgr.14373) 9465 : cluster [DBG] pgmap v6564: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:15:58.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:15:58 smithi086 bash[24289]: cluster 2024-09-16T09:15:57.041928+0000 mgr.a (mgr.14373) 9465 : cluster [DBG] pgmap v6564: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:15:58.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:15:58 smithi047 bash[22744]: cluster 2024-09-16T09:15:57.041928+0000 mgr.a (mgr.14373) 9465 : cluster [DBG] pgmap v6564: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:15:59.399 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:15:59.400 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:15:59.400 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:16:00.161 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:16:00.161 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:16:00.161 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:16:00.162 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:16:00.162 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:16:00.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:16:00 smithi157 bash[24585]: cluster 2024-09-16T09:15:59.042875+0000 mgr.a (mgr.14373) 9466 : cluster [DBG] pgmap v6565: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:16:00.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:16:00 smithi086 bash[24289]: cluster 2024-09-16T09:15:59.042875+0000 mgr.a (mgr.14373) 9466 : cluster [DBG] pgmap v6565: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:16:00.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:16:00 smithi047 bash[22744]: cluster 2024-09-16T09:15:59.042875+0000 mgr.a (mgr.14373) 9466 : cluster [DBG] pgmap v6565: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:16:01.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:16:01 smithi157 bash[24585]: audit 2024-09-16T09:15:59.727090+0000 mgr.a (mgr.14373) 9467 : audit [DBG] from='client.209868 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:16:01.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:16:01 smithi086 bash[24289]: audit 2024-09-16T09:15:59.727090+0000 mgr.a (mgr.14373) 9467 : audit [DBG] from='client.209868 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:16:01.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:16:01 smithi047 bash[22744]: audit 2024-09-16T09:15:59.727090+0000 mgr.a (mgr.14373) 9467 : audit [DBG] from='client.209868 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:16:02.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:16:02 smithi157 bash[24585]: cluster 2024-09-16T09:16:01.043826+0000 mgr.a (mgr.14373) 9468 : cluster [DBG] pgmap v6566: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:16:02.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:16:02 smithi086 bash[24289]: cluster 2024-09-16T09:16:01.043826+0000 mgr.a (mgr.14373) 9468 : cluster [DBG] pgmap v6566: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:16:02.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:16:02 smithi047 bash[22744]: cluster 2024-09-16T09:16:01.043826+0000 mgr.a (mgr.14373) 9468 : cluster [DBG] pgmap v6566: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:16:04.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:16:04 smithi157 bash[24585]: cluster 2024-09-16T09:16:03.046146+0000 mgr.a (mgr.14373) 9469 : cluster [DBG] pgmap v6567: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:16:04.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:16:04 smithi086 bash[24289]: cluster 2024-09-16T09:16:03.046146+0000 mgr.a (mgr.14373) 9469 : cluster [DBG] pgmap v6567: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:16:04.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:16:04 smithi047 bash[22744]: cluster 2024-09-16T09:16:03.046146+0000 mgr.a (mgr.14373) 9469 : cluster [DBG] pgmap v6567: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:16:05.163 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:16:05.163 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:16:05.163 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:16:05.956 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:16:05.956 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:16:05.956 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:16:05.956 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:16:05.956 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:16:06.553 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:16:06 smithi157 bash[24585]: cluster 2024-09-16T09:16:05.047084+0000 mgr.a (mgr.14373) 9470 : cluster [DBG] pgmap v6568: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:16:06.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:16:06 smithi086 bash[24289]: cluster 2024-09-16T09:16:05.047084+0000 mgr.a (mgr.14373) 9470 : cluster [DBG] pgmap v6568: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:16:06.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:16:06 smithi047 bash[22744]: cluster 2024-09-16T09:16:05.047084+0000 mgr.a (mgr.14373) 9470 : cluster [DBG] pgmap v6568: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:16:07.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:16:07 smithi157 bash[24585]: audit 2024-09-16T09:16:05.504069+0000 mgr.a (mgr.14373) 9471 : audit [DBG] from='client.209946 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:16:07.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:16:07 smithi086 bash[24289]: audit 2024-09-16T09:16:05.504069+0000 mgr.a (mgr.14373) 9471 : audit [DBG] from='client.209946 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:16:07.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:16:07 smithi047 bash[22744]: audit 2024-09-16T09:16:05.504069+0000 mgr.a (mgr.14373) 9471 : audit [DBG] from='client.209946 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:16:08.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:16:08 smithi157 bash[24585]: cluster 2024-09-16T09:16:07.049510+0000 mgr.a (mgr.14373) 9472 : cluster [DBG] pgmap v6569: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:16:08.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:16:08 smithi086 bash[24289]: cluster 2024-09-16T09:16:07.049510+0000 mgr.a (mgr.14373) 9472 : cluster [DBG] pgmap v6569: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:16:08.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:16:08 smithi047 bash[22744]: cluster 2024-09-16T09:16:07.049510+0000 mgr.a (mgr.14373) 9472 : cluster [DBG] pgmap v6569: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:16:10.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:16:10 smithi157 bash[24585]: cluster 2024-09-16T09:16:09.050320+0000 mgr.a (mgr.14373) 9473 : cluster [DBG] pgmap v6570: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:16:10.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:16:10 smithi086 bash[24289]: cluster 2024-09-16T09:16:09.050320+0000 mgr.a (mgr.14373) 9473 : cluster [DBG] pgmap v6570: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:16:10.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:16:10 smithi047 bash[22744]: cluster 2024-09-16T09:16:09.050320+0000 mgr.a (mgr.14373) 9473 : cluster [DBG] pgmap v6570: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:16:10.957 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:16:10.958 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:16:10.958 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:16:11.742 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:16:11.742 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:16:11.742 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:16:11.742 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:16:11.742 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:16:12.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:16:12 smithi157 bash[24585]: cluster 2024-09-16T09:16:11.050996+0000 mgr.a (mgr.14373) 9474 : cluster [DBG] pgmap v6571: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:16:12.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:16:12 smithi157 bash[24585]: audit 2024-09-16T09:16:11.290095+0000 mgr.a (mgr.14373) 9475 : audit [DBG] from='client.210021 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:16:12.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:16:12 smithi086 bash[24289]: cluster 2024-09-16T09:16:11.050996+0000 mgr.a (mgr.14373) 9474 : cluster [DBG] pgmap v6571: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:16:12.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:16:12 smithi086 bash[24289]: audit 2024-09-16T09:16:11.290095+0000 mgr.a (mgr.14373) 9475 : audit [DBG] from='client.210021 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:16:12.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:16:12 smithi047 bash[22744]: cluster 2024-09-16T09:16:11.050996+0000 mgr.a (mgr.14373) 9474 : cluster [DBG] pgmap v6571: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:16:12.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:16:12 smithi047 bash[22744]: audit 2024-09-16T09:16:11.290095+0000 mgr.a (mgr.14373) 9475 : audit [DBG] from='client.210021 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:16:14.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:16:14 smithi157 bash[24585]: cluster 2024-09-16T09:16:13.053774+0000 mgr.a (mgr.14373) 9476 : cluster [DBG] pgmap v6572: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:16:14.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:16:14 smithi086 bash[24289]: cluster 2024-09-16T09:16:13.053774+0000 mgr.a (mgr.14373) 9476 : cluster [DBG] pgmap v6572: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:16:14.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:16:14 smithi047 bash[22744]: cluster 2024-09-16T09:16:13.053774+0000 mgr.a (mgr.14373) 9476 : cluster [DBG] pgmap v6572: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:16:16.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:16:16 smithi086 bash[24289]: cluster 2024-09-16T09:16:15.054737+0000 mgr.a (mgr.14373) 9477 : cluster [DBG] pgmap v6573: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:16:16.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:16:16 smithi047 bash[22744]: cluster 2024-09-16T09:16:15.054737+0000 mgr.a (mgr.14373) 9477 : cluster [DBG] pgmap v6573: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:16:16.743 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:16:16.744 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:16:16.744 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:16:16.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:16:16 smithi157 bash[24585]: cluster 2024-09-16T09:16:15.054737+0000 mgr.a (mgr.14373) 9477 : cluster [DBG] pgmap v6573: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:16:17.490 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:16:17.490 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:16:17.490 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:16:17.490 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:16:17.490 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:16:18.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:16:18 smithi086 bash[24289]: cluster 2024-09-16T09:16:17.056664+0000 mgr.a (mgr.14373) 9478 : cluster [DBG] pgmap v6574: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:16:18.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:16:18 smithi086 bash[24289]: audit 2024-09-16T09:16:17.074435+0000 mgr.a (mgr.14373) 9479 : audit [DBG] from='client.210096 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:16:18.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:16:18 smithi047 bash[22744]: cluster 2024-09-16T09:16:17.056664+0000 mgr.a (mgr.14373) 9478 : cluster [DBG] pgmap v6574: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:16:18.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:16:18 smithi047 bash[22744]: audit 2024-09-16T09:16:17.074435+0000 mgr.a (mgr.14373) 9479 : audit [DBG] from='client.210096 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:16:18.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:16:18 smithi157 bash[24585]: cluster 2024-09-16T09:16:17.056664+0000 mgr.a (mgr.14373) 9478 : cluster [DBG] pgmap v6574: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:16:18.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:16:18 smithi157 bash[24585]: audit 2024-09-16T09:16:17.074435+0000 mgr.a (mgr.14373) 9479 : audit [DBG] from='client.210096 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:16:20.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:16:20 smithi086 bash[24289]: cluster 2024-09-16T09:16:19.057594+0000 mgr.a (mgr.14373) 9480 : cluster [DBG] pgmap v6575: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:16:20.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:16:20 smithi047 bash[22744]: cluster 2024-09-16T09:16:19.057594+0000 mgr.a (mgr.14373) 9480 : cluster [DBG] pgmap v6575: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:16:20.803 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:16:20 smithi157 bash[24585]: cluster 2024-09-16T09:16:19.057594+0000 mgr.a (mgr.14373) 9480 : cluster [DBG] pgmap v6575: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:16:21.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:16:21 smithi047 bash[22744]: audit 2024-09-16T09:16:20.945636+0000 mon.b (mon.2) 882 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T09:16:21.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:16:21 smithi157 bash[24585]: audit 2024-09-16T09:16:20.945636+0000 mon.b (mon.2) 882 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T09:16:21.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:16:21 smithi086 bash[24289]: audit 2024-09-16T09:16:20.945636+0000 mon.b (mon.2) 882 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T09:16:22.491 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:16:22.491 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:16:22.492 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:16:22.593 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 09:16:22 smithi047 bash[22994]: debug 2024-09-16T09:16:22.542+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T09:16:22.593 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 09:16:22 smithi047 bash[22994]: debug 2024-09-16T09:16:22.546+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T09:16:22.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:16:22 smithi047 bash[22744]: cluster 2024-09-16T09:16:21.058278+0000 mgr.a (mgr.14373) 9481 : cluster [DBG] pgmap v6576: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T09:16:22.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:16:22 smithi047 bash[22744]: audit 2024-09-16T09:16:21.792201+0000 mon.b (mon.2) 883 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:16:22.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:16:22 smithi047 bash[22744]: audit 2024-09-16T09:16:21.794243+0000 mon.b (mon.2) 884 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T09:16:22.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:16:22 smithi047 bash[22744]: audit 2024-09-16T09:16:21.803716+0000 mon.a (mon.0) 1138 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:16:22.594 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:16:22 smithi047 bash[22744]: audit 2024-09-16T09:16:21.812789+0000 mon.b (mon.2) 885 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:16:22.594 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:16:22 smithi047 bash[22744]: audit 2024-09-16T09:16:21.813214+0000 mgr.a (mgr.14373) 9482 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:16:22.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:16:22 smithi157 bash[24585]: cluster 2024-09-16T09:16:21.058278+0000 mgr.a (mgr.14373) 9481 : cluster [DBG] pgmap v6576: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T09:16:22.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:16:22 smithi157 bash[24585]: audit 2024-09-16T09:16:21.792201+0000 mon.b (mon.2) 883 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:16:22.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:16:22 smithi157 bash[24585]: audit 2024-09-16T09:16:21.794243+0000 mon.b (mon.2) 884 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T09:16:22.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:16:22 smithi157 bash[24585]: audit 2024-09-16T09:16:21.803716+0000 mon.a (mon.0) 1138 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:16:22.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:16:22 smithi157 bash[24585]: audit 2024-09-16T09:16:21.812789+0000 mon.b (mon.2) 885 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:16:22.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:16:22 smithi157 bash[24585]: audit 2024-09-16T09:16:21.813214+0000 mgr.a (mgr.14373) 9482 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:16:22.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:16:22 smithi086 bash[24289]: cluster 2024-09-16T09:16:21.058278+0000 mgr.a (mgr.14373) 9481 : cluster [DBG] pgmap v6576: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T09:16:22.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:16:22 smithi086 bash[24289]: audit 2024-09-16T09:16:21.792201+0000 mon.b (mon.2) 883 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:16:22.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:16:22 smithi086 bash[24289]: audit 2024-09-16T09:16:21.794243+0000 mon.b (mon.2) 884 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T09:16:22.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:16:22 smithi086 bash[24289]: audit 2024-09-16T09:16:21.803716+0000 mon.a (mon.0) 1138 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:16:22.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:16:22 smithi086 bash[24289]: audit 2024-09-16T09:16:21.812789+0000 mon.b (mon.2) 885 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:16:22.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:16:22 smithi086 bash[24289]: audit 2024-09-16T09:16:21.813214+0000 mgr.a (mgr.14373) 9482 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:16:23.225 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:16:23.225 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:16:23.225 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:16:23.225 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:16:23.226 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:16:23.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:16:23 smithi047 bash[22744]: audit 2024-09-16T09:16:22.548518+0000 mgr.a (mgr.14373) 9483 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T09:16:23.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:16:23 smithi047 bash[22744]: cephadm 2024-09-16T09:16:22.550687+0000 mgr.a (mgr.14373) 9484 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T09:16:23.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:16:23 smithi047 bash[22744]: audit 2024-09-16T09:16:22.812303+0000 mgr.a (mgr.14373) 9485 : audit [DBG] from='client.210279 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:16:23.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:16:23 smithi047 bash[22744]: cluster 2024-09-16T09:16:23.061023+0000 mgr.a (mgr.14373) 9486 : cluster [DBG] pgmap v6577: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:16:23.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:16:23 smithi157 bash[24585]: audit 2024-09-16T09:16:22.548518+0000 mgr.a (mgr.14373) 9483 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T09:16:23.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:16:23 smithi157 bash[24585]: cephadm 2024-09-16T09:16:22.550687+0000 mgr.a (mgr.14373) 9484 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T09:16:23.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:16:23 smithi157 bash[24585]: audit 2024-09-16T09:16:22.812303+0000 mgr.a (mgr.14373) 9485 : audit [DBG] from='client.210279 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:16:23.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:16:23 smithi157 bash[24585]: cluster 2024-09-16T09:16:23.061023+0000 mgr.a (mgr.14373) 9486 : cluster [DBG] pgmap v6577: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:16:23.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:16:23 smithi086 bash[24289]: audit 2024-09-16T09:16:22.548518+0000 mgr.a (mgr.14373) 9483 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T09:16:23.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:16:23 smithi086 bash[24289]: cephadm 2024-09-16T09:16:22.550687+0000 mgr.a (mgr.14373) 9484 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T09:16:23.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:16:23 smithi086 bash[24289]: audit 2024-09-16T09:16:22.812303+0000 mgr.a (mgr.14373) 9485 : audit [DBG] from='client.210279 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:16:23.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:16:23 smithi086 bash[24289]: cluster 2024-09-16T09:16:23.061023+0000 mgr.a (mgr.14373) 9486 : cluster [DBG] pgmap v6577: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:16:26.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:16:26 smithi157 bash[24585]: cluster 2024-09-16T09:16:25.062003+0000 mgr.a (mgr.14373) 9487 : cluster [DBG] pgmap v6578: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:16:26.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:16:26 smithi086 bash[24289]: cluster 2024-09-16T09:16:25.062003+0000 mgr.a (mgr.14373) 9487 : cluster [DBG] pgmap v6578: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:16:26.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:16:26 smithi047 bash[22744]: cluster 2024-09-16T09:16:25.062003+0000 mgr.a (mgr.14373) 9487 : cluster [DBG] pgmap v6578: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:16:28.225 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:16:28.226 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:16:28.226 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:16:28.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:16:28 smithi157 bash[24585]: cluster 2024-09-16T09:16:27.064161+0000 mgr.a (mgr.14373) 9488 : cluster [DBG] pgmap v6579: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:16:28.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:16:28 smithi086 bash[24289]: cluster 2024-09-16T09:16:27.064161+0000 mgr.a (mgr.14373) 9488 : cluster [DBG] pgmap v6579: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:16:28.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:16:28 smithi047 bash[22744]: cluster 2024-09-16T09:16:27.064161+0000 mgr.a (mgr.14373) 9488 : cluster [DBG] pgmap v6579: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:16:29.013 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:16:29.013 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:16:29.013 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:16:29.013 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:16:29.013 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:16:30.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:16:30 smithi157 bash[24585]: audit 2024-09-16T09:16:28.563815+0000 mgr.a (mgr.14373) 9489 : audit [DBG] from='client.210354 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:16:30.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:16:30 smithi157 bash[24585]: cluster 2024-09-16T09:16:29.065160+0000 mgr.a (mgr.14373) 9490 : cluster [DBG] pgmap v6580: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:16:30.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:16:30 smithi086 bash[24289]: audit 2024-09-16T09:16:28.563815+0000 mgr.a (mgr.14373) 9489 : audit [DBG] from='client.210354 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:16:30.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:16:30 smithi086 bash[24289]: cluster 2024-09-16T09:16:29.065160+0000 mgr.a (mgr.14373) 9490 : cluster [DBG] pgmap v6580: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:16:30.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:16:30 smithi047 bash[22744]: audit 2024-09-16T09:16:28.563815+0000 mgr.a (mgr.14373) 9489 : audit [DBG] from='client.210354 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:16:30.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:16:30 smithi047 bash[22744]: cluster 2024-09-16T09:16:29.065160+0000 mgr.a (mgr.14373) 9490 : cluster [DBG] pgmap v6580: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:16:32.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:16:32 smithi157 bash[24585]: cluster 2024-09-16T09:16:31.065942+0000 mgr.a (mgr.14373) 9491 : cluster [DBG] pgmap v6581: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:16:32.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:16:32 smithi086 bash[24289]: cluster 2024-09-16T09:16:31.065942+0000 mgr.a (mgr.14373) 9491 : cluster [DBG] pgmap v6581: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:16:32.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:16:32 smithi047 bash[22744]: cluster 2024-09-16T09:16:31.065942+0000 mgr.a (mgr.14373) 9491 : cluster [DBG] pgmap v6581: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:16:34.014 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:16:34.015 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:16:34.015 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:16:34.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:16:34 smithi157 bash[24585]: cluster 2024-09-16T09:16:33.068220+0000 mgr.a (mgr.14373) 9492 : cluster [DBG] pgmap v6582: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:16:34.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:16:34 smithi086 bash[24289]: cluster 2024-09-16T09:16:33.068220+0000 mgr.a (mgr.14373) 9492 : cluster [DBG] pgmap v6582: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:16:34.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:16:34 smithi047 bash[22744]: cluster 2024-09-16T09:16:33.068220+0000 mgr.a (mgr.14373) 9492 : cluster [DBG] pgmap v6582: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:16:34.782 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:16:34.782 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:16:34.782 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:16:34.783 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:16:34.783 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:16:36.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:16:36 smithi157 bash[24585]: audit 2024-09-16T09:16:34.345329+0000 mgr.a (mgr.14373) 9493 : audit [DBG] from='client.210432 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:16:36.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:16:36 smithi157 bash[24585]: cluster 2024-09-16T09:16:35.069208+0000 mgr.a (mgr.14373) 9494 : cluster [DBG] pgmap v6583: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:16:36.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:16:36 smithi086 bash[24289]: audit 2024-09-16T09:16:34.345329+0000 mgr.a (mgr.14373) 9493 : audit [DBG] from='client.210432 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:16:36.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:16:36 smithi086 bash[24289]: cluster 2024-09-16T09:16:35.069208+0000 mgr.a (mgr.14373) 9494 : cluster [DBG] pgmap v6583: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:16:36.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:16:36 smithi047 bash[22744]: audit 2024-09-16T09:16:34.345329+0000 mgr.a (mgr.14373) 9493 : audit [DBG] from='client.210432 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:16:36.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:16:36 smithi047 bash[22744]: cluster 2024-09-16T09:16:35.069208+0000 mgr.a (mgr.14373) 9494 : cluster [DBG] pgmap v6583: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:16:38.555 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:16:38 smithi157 bash[24585]: cluster 2024-09-16T09:16:37.071470+0000 mgr.a (mgr.14373) 9495 : cluster [DBG] pgmap v6584: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:16:38.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:16:38 smithi086 bash[24289]: cluster 2024-09-16T09:16:37.071470+0000 mgr.a (mgr.14373) 9495 : cluster [DBG] pgmap v6584: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:16:38.595 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:16:38 smithi047 bash[22744]: cluster 2024-09-16T09:16:37.071470+0000 mgr.a (mgr.14373) 9495 : cluster [DBG] pgmap v6584: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:16:39.784 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:16:39.785 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:16:39.785 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:16:40.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:16:40 smithi157 bash[24585]: cluster 2024-09-16T09:16:39.072238+0000 mgr.a (mgr.14373) 9496 : cluster [DBG] pgmap v6585: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:16:40.562 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:16:40.562 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:16:40.562 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:16:40.562 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:16:40.562 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:16:40.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:16:40 smithi086 bash[24289]: cluster 2024-09-16T09:16:39.072238+0000 mgr.a (mgr.14373) 9496 : cluster [DBG] pgmap v6585: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:16:40.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:16:40 smithi047 bash[22744]: cluster 2024-09-16T09:16:39.072238+0000 mgr.a (mgr.14373) 9496 : cluster [DBG] pgmap v6585: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:16:41.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:16:41 smithi157 bash[24585]: audit 2024-09-16T09:16:40.120587+0000 mgr.a (mgr.14373) 9497 : audit [DBG] from='client.210507 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:16:41.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:16:41 smithi086 bash[24289]: audit 2024-09-16T09:16:40.120587+0000 mgr.a (mgr.14373) 9497 : audit [DBG] from='client.210507 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:16:41.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:16:41 smithi047 bash[22744]: audit 2024-09-16T09:16:40.120587+0000 mgr.a (mgr.14373) 9497 : audit [DBG] from='client.210507 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:16:42.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:16:42 smithi157 bash[24585]: cluster 2024-09-16T09:16:41.073194+0000 mgr.a (mgr.14373) 9498 : cluster [DBG] pgmap v6586: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:16:42.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:16:42 smithi086 bash[24289]: cluster 2024-09-16T09:16:41.073194+0000 mgr.a (mgr.14373) 9498 : cluster [DBG] pgmap v6586: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:16:42.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:16:42 smithi047 bash[22744]: cluster 2024-09-16T09:16:41.073194+0000 mgr.a (mgr.14373) 9498 : cluster [DBG] pgmap v6586: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:16:44.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:16:44 smithi157 bash[24585]: cluster 2024-09-16T09:16:43.075477+0000 mgr.a (mgr.14373) 9499 : cluster [DBG] pgmap v6587: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:16:44.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:16:44 smithi086 bash[24289]: cluster 2024-09-16T09:16:43.075477+0000 mgr.a (mgr.14373) 9499 : cluster [DBG] pgmap v6587: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:16:44.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:16:44 smithi047 bash[22744]: cluster 2024-09-16T09:16:43.075477+0000 mgr.a (mgr.14373) 9499 : cluster [DBG] pgmap v6587: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:16:45.564 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:16:45.565 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:16:45.565 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:16:46.340 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:16:46.340 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:16:46.340 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:16:46.340 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:16:46.340 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:16:46.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:16:46 smithi157 bash[24585]: cluster 2024-09-16T09:16:45.076235+0000 mgr.a (mgr.14373) 9500 : cluster [DBG] pgmap v6588: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:16:46.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:16:46 smithi086 bash[24289]: cluster 2024-09-16T09:16:45.076235+0000 mgr.a (mgr.14373) 9500 : cluster [DBG] pgmap v6588: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:16:46.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:16:46 smithi047 bash[22744]: cluster 2024-09-16T09:16:45.076235+0000 mgr.a (mgr.14373) 9500 : cluster [DBG] pgmap v6588: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:16:47.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:16:47 smithi157 bash[24585]: audit 2024-09-16T09:16:45.896532+0000 mgr.a (mgr.14373) 9501 : audit [DBG] from='client.210582 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:16:47.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:16:47 smithi086 bash[24289]: audit 2024-09-16T09:16:45.896532+0000 mgr.a (mgr.14373) 9501 : audit [DBG] from='client.210582 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:16:47.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:16:47 smithi047 bash[22744]: audit 2024-09-16T09:16:45.896532+0000 mgr.a (mgr.14373) 9501 : audit [DBG] from='client.210582 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:16:48.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:16:48 smithi157 bash[24585]: cluster 2024-09-16T09:16:47.078629+0000 mgr.a (mgr.14373) 9502 : cluster [DBG] pgmap v6589: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:16:48.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:16:48 smithi086 bash[24289]: cluster 2024-09-16T09:16:47.078629+0000 mgr.a (mgr.14373) 9502 : cluster [DBG] pgmap v6589: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:16:48.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:16:48 smithi047 bash[22744]: cluster 2024-09-16T09:16:47.078629+0000 mgr.a (mgr.14373) 9502 : cluster [DBG] pgmap v6589: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:16:50.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:16:50 smithi157 bash[24585]: cluster 2024-09-16T09:16:49.079397+0000 mgr.a (mgr.14373) 9503 : cluster [DBG] pgmap v6590: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:16:50.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:16:50 smithi086 bash[24289]: cluster 2024-09-16T09:16:49.079397+0000 mgr.a (mgr.14373) 9503 : cluster [DBG] pgmap v6590: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:16:50.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:16:50 smithi047 bash[22744]: cluster 2024-09-16T09:16:49.079397+0000 mgr.a (mgr.14373) 9503 : cluster [DBG] pgmap v6590: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:16:51.341 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:16:51.342 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:16:51.342 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:16:52.090 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:16:52.090 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:16:52.090 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:16:52.090 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:16:52.090 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:16:52.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:16:52 smithi157 bash[24585]: cluster 2024-09-16T09:16:51.080163+0000 mgr.a (mgr.14373) 9504 : cluster [DBG] pgmap v6591: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:16:52.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:16:52 smithi086 bash[24289]: cluster 2024-09-16T09:16:51.080163+0000 mgr.a (mgr.14373) 9504 : cluster [DBG] pgmap v6591: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:16:52.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:16:52 smithi047 bash[22744]: cluster 2024-09-16T09:16:51.080163+0000 mgr.a (mgr.14373) 9504 : cluster [DBG] pgmap v6591: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:16:53.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:16:53 smithi157 bash[24585]: audit 2024-09-16T09:16:51.663010+0000 mgr.a (mgr.14373) 9505 : audit [DBG] from='client.210654 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:16:53.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:16:53 smithi086 bash[24289]: audit 2024-09-16T09:16:51.663010+0000 mgr.a (mgr.14373) 9505 : audit [DBG] from='client.210654 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:16:53.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:16:53 smithi047 bash[22744]: audit 2024-09-16T09:16:51.663010+0000 mgr.a (mgr.14373) 9505 : audit [DBG] from='client.210654 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:16:54.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:16:54 smithi157 bash[24585]: cluster 2024-09-16T09:16:53.082928+0000 mgr.a (mgr.14373) 9506 : cluster [DBG] pgmap v6592: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:16:54.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:16:54 smithi086 bash[24289]: cluster 2024-09-16T09:16:53.082928+0000 mgr.a (mgr.14373) 9506 : cluster [DBG] pgmap v6592: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:16:54.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:16:54 smithi047 bash[22744]: cluster 2024-09-16T09:16:53.082928+0000 mgr.a (mgr.14373) 9506 : cluster [DBG] pgmap v6592: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:16:56.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:16:56 smithi157 bash[24585]: cluster 2024-09-16T09:16:55.083700+0000 mgr.a (mgr.14373) 9507 : cluster [DBG] pgmap v6593: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:16:56.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:16:56 smithi086 bash[24289]: cluster 2024-09-16T09:16:55.083700+0000 mgr.a (mgr.14373) 9507 : cluster [DBG] pgmap v6593: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:16:56.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:16:56 smithi047 bash[22744]: cluster 2024-09-16T09:16:55.083700+0000 mgr.a (mgr.14373) 9507 : cluster [DBG] pgmap v6593: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:16:57.092 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:16:57.092 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:16:57.092 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:16:57.862 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:16:57.862 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:16:57.862 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:16:57.863 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:16:57.863 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:16:58.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:16:58 smithi157 bash[24585]: cluster 2024-09-16T09:16:57.085642+0000 mgr.a (mgr.14373) 9508 : cluster [DBG] pgmap v6594: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:16:58.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:16:58 smithi086 bash[24289]: cluster 2024-09-16T09:16:57.085642+0000 mgr.a (mgr.14373) 9508 : cluster [DBG] pgmap v6594: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:16:58.621 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:16:58 smithi047 bash[22744]: cluster 2024-09-16T09:16:57.085642+0000 mgr.a (mgr.14373) 9508 : cluster [DBG] pgmap v6594: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:16:59.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:16:59 smithi157 bash[24585]: audit 2024-09-16T09:16:57.426841+0000 mgr.a (mgr.14373) 9509 : audit [DBG] from='client.210732 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:16:59.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:16:59 smithi086 bash[24289]: audit 2024-09-16T09:16:57.426841+0000 mgr.a (mgr.14373) 9509 : audit [DBG] from='client.210732 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:16:59.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:16:59 smithi047 bash[22744]: audit 2024-09-16T09:16:57.426841+0000 mgr.a (mgr.14373) 9509 : audit [DBG] from='client.210732 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:17:00.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:17:00 smithi157 bash[24585]: cluster 2024-09-16T09:16:59.086647+0000 mgr.a (mgr.14373) 9510 : cluster [DBG] pgmap v6595: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:17:00.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:17:00 smithi086 bash[24289]: cluster 2024-09-16T09:16:59.086647+0000 mgr.a (mgr.14373) 9510 : cluster [DBG] pgmap v6595: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:17:00.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:17:00 smithi047 bash[22744]: cluster 2024-09-16T09:16:59.086647+0000 mgr.a (mgr.14373) 9510 : cluster [DBG] pgmap v6595: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:17:02.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:17:02 smithi157 bash[24585]: cluster 2024-09-16T09:17:01.087409+0000 mgr.a (mgr.14373) 9511 : cluster [DBG] pgmap v6596: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T09:17:02.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:17:02 smithi086 bash[24289]: cluster 2024-09-16T09:17:01.087409+0000 mgr.a (mgr.14373) 9511 : cluster [DBG] pgmap v6596: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T09:17:02.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:17:02 smithi047 bash[22744]: cluster 2024-09-16T09:17:01.087409+0000 mgr.a (mgr.14373) 9511 : cluster [DBG] pgmap v6596: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T09:17:02.863 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:17:02.864 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:17:02.864 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:17:03.652 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:17:03.652 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:17:03.652 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:17:03.652 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:17:03.652 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:17:04.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:17:04 smithi157 bash[24585]: cluster 2024-09-16T09:17:03.089583+0000 mgr.a (mgr.14373) 9512 : cluster [DBG] pgmap v6597: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:17:04.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:17:04 smithi157 bash[24585]: audit 2024-09-16T09:17:03.198865+0000 mgr.a (mgr.14373) 9513 : audit [DBG] from='client.210810 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:17:04.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:17:04 smithi086 bash[24289]: cluster 2024-09-16T09:17:03.089583+0000 mgr.a (mgr.14373) 9512 : cluster [DBG] pgmap v6597: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:17:04.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:17:04 smithi086 bash[24289]: audit 2024-09-16T09:17:03.198865+0000 mgr.a (mgr.14373) 9513 : audit [DBG] from='client.210810 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:17:04.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:17:04 smithi047 bash[22744]: cluster 2024-09-16T09:17:03.089583+0000 mgr.a (mgr.14373) 9512 : cluster [DBG] pgmap v6597: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:17:04.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:17:04 smithi047 bash[22744]: audit 2024-09-16T09:17:03.198865+0000 mgr.a (mgr.14373) 9513 : audit [DBG] from='client.210810 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:17:06.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:17:06 smithi157 bash[24585]: cluster 2024-09-16T09:17:05.090527+0000 mgr.a (mgr.14373) 9514 : cluster [DBG] pgmap v6598: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:17:06.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:17:06 smithi086 bash[24289]: cluster 2024-09-16T09:17:05.090527+0000 mgr.a (mgr.14373) 9514 : cluster [DBG] pgmap v6598: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:17:06.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:17:06 smithi047 bash[22744]: cluster 2024-09-16T09:17:05.090527+0000 mgr.a (mgr.14373) 9514 : cluster [DBG] pgmap v6598: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:17:08.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:17:08 smithi157 bash[24585]: cluster 2024-09-16T09:17:07.092655+0000 mgr.a (mgr.14373) 9515 : cluster [DBG] pgmap v6599: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:17:08.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:17:08 smithi086 bash[24289]: cluster 2024-09-16T09:17:07.092655+0000 mgr.a (mgr.14373) 9515 : cluster [DBG] pgmap v6599: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:17:08.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:17:08 smithi047 bash[22744]: cluster 2024-09-16T09:17:07.092655+0000 mgr.a (mgr.14373) 9515 : cluster [DBG] pgmap v6599: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:17:08.653 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:17:08.654 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:17:08.654 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:17:09.414 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:17:09.415 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:17:09.415 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:17:09.415 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:17:09.415 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:17:10.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:17:10 smithi157 bash[24585]: audit 2024-09-16T09:17:08.980296+0000 mgr.a (mgr.14373) 9516 : audit [DBG] from='client.210885 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:17:10.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:17:10 smithi157 bash[24585]: cluster 2024-09-16T09:17:09.093279+0000 mgr.a (mgr.14373) 9517 : cluster [DBG] pgmap v6600: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:17:10.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:17:10 smithi086 bash[24289]: audit 2024-09-16T09:17:08.980296+0000 mgr.a (mgr.14373) 9516 : audit [DBG] from='client.210885 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:17:10.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:17:10 smithi086 bash[24289]: cluster 2024-09-16T09:17:09.093279+0000 mgr.a (mgr.14373) 9517 : cluster [DBG] pgmap v6600: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:17:10.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:17:10 smithi047 bash[22744]: audit 2024-09-16T09:17:08.980296+0000 mgr.a (mgr.14373) 9516 : audit [DBG] from='client.210885 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:17:10.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:17:10 smithi047 bash[22744]: cluster 2024-09-16T09:17:09.093279+0000 mgr.a (mgr.14373) 9517 : cluster [DBG] pgmap v6600: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:17:12.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:17:12 smithi157 bash[24585]: cluster 2024-09-16T09:17:11.094124+0000 mgr.a (mgr.14373) 9518 : cluster [DBG] pgmap v6601: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:17:12.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:17:12 smithi086 bash[24289]: cluster 2024-09-16T09:17:11.094124+0000 mgr.a (mgr.14373) 9518 : cluster [DBG] pgmap v6601: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:17:12.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:17:12 smithi047 bash[22744]: cluster 2024-09-16T09:17:11.094124+0000 mgr.a (mgr.14373) 9518 : cluster [DBG] pgmap v6601: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:17:14.415 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:17:14.416 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:17:14.416 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:17:14.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:17:14 smithi157 bash[24585]: cluster 2024-09-16T09:17:13.096382+0000 mgr.a (mgr.14373) 9519 : cluster [DBG] pgmap v6602: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:17:14.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:17:14 smithi086 bash[24289]: cluster 2024-09-16T09:17:13.096382+0000 mgr.a (mgr.14373) 9519 : cluster [DBG] pgmap v6602: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:17:14.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:17:14 smithi047 bash[22744]: cluster 2024-09-16T09:17:13.096382+0000 mgr.a (mgr.14373) 9519 : cluster [DBG] pgmap v6602: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:17:15.190 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:17:15.191 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:17:15.191 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:17:15.191 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:17:15.191 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:17:16.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:17:16 smithi157 bash[24585]: audit 2024-09-16T09:17:14.746783+0000 mgr.a (mgr.14373) 9520 : audit [DBG] from='client.210963 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:17:16.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:17:16 smithi157 bash[24585]: cluster 2024-09-16T09:17:15.096939+0000 mgr.a (mgr.14373) 9521 : cluster [DBG] pgmap v6603: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:17:16.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:17:16 smithi086 bash[24289]: audit 2024-09-16T09:17:14.746783+0000 mgr.a (mgr.14373) 9520 : audit [DBG] from='client.210963 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:17:16.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:17:16 smithi086 bash[24289]: cluster 2024-09-16T09:17:15.096939+0000 mgr.a (mgr.14373) 9521 : cluster [DBG] pgmap v6603: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:17:16.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:17:16 smithi047 bash[22744]: audit 2024-09-16T09:17:14.746783+0000 mgr.a (mgr.14373) 9520 : audit [DBG] from='client.210963 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:17:16.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:17:16 smithi047 bash[22744]: cluster 2024-09-16T09:17:15.096939+0000 mgr.a (mgr.14373) 9521 : cluster [DBG] pgmap v6603: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:17:18.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:17:18 smithi157 bash[24585]: cluster 2024-09-16T09:17:17.099155+0000 mgr.a (mgr.14373) 9522 : cluster [DBG] pgmap v6604: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:17:18.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:17:18 smithi086 bash[24289]: cluster 2024-09-16T09:17:17.099155+0000 mgr.a (mgr.14373) 9522 : cluster [DBG] pgmap v6604: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:17:18.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:17:18 smithi047 bash[22744]: cluster 2024-09-16T09:17:17.099155+0000 mgr.a (mgr.14373) 9522 : cluster [DBG] pgmap v6604: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:17:20.192 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:17:20.193 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:17:20.193 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:17:20.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:17:20 smithi157 bash[24585]: cluster 2024-09-16T09:17:19.099933+0000 mgr.a (mgr.14373) 9523 : cluster [DBG] pgmap v6605: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:17:20.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:17:20 smithi086 bash[24289]: cluster 2024-09-16T09:17:19.099933+0000 mgr.a (mgr.14373) 9523 : cluster [DBG] pgmap v6605: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:17:20.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:17:20 smithi047 bash[22744]: cluster 2024-09-16T09:17:19.099933+0000 mgr.a (mgr.14373) 9523 : cluster [DBG] pgmap v6605: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:17:20.971 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:17:20.972 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:17:20.972 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:17:20.972 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:17:20.972 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:17:22.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:17:22 smithi157 bash[24585]: audit 2024-09-16T09:17:20.528225+0000 mgr.a (mgr.14373) 9524 : audit [DBG] from='client.211041 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:17:22.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:17:22 smithi157 bash[24585]: cluster 2024-09-16T09:17:21.100887+0000 mgr.a (mgr.14373) 9525 : cluster [DBG] pgmap v6606: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:17:22.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:17:22 smithi086 bash[24289]: audit 2024-09-16T09:17:20.528225+0000 mgr.a (mgr.14373) 9524 : audit [DBG] from='client.211041 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:17:22.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:17:22 smithi086 bash[24289]: cluster 2024-09-16T09:17:21.100887+0000 mgr.a (mgr.14373) 9525 : cluster [DBG] pgmap v6606: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:17:22.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:17:22 smithi047 bash[22744]: audit 2024-09-16T09:17:20.528225+0000 mgr.a (mgr.14373) 9524 : audit [DBG] from='client.211041 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:17:22.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:17:22 smithi047 bash[22744]: cluster 2024-09-16T09:17:21.100887+0000 mgr.a (mgr.14373) 9525 : cluster [DBG] pgmap v6606: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:17:23.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:17:23 smithi157 bash[24585]: audit 2024-09-16T09:17:22.609382+0000 mon.b (mon.2) 886 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T09:17:23.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:17:23 smithi086 bash[24289]: audit 2024-09-16T09:17:22.609382+0000 mon.b (mon.2) 886 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T09:17:23.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:17:23 smithi047 bash[22744]: audit 2024-09-16T09:17:22.609382+0000 mon.b (mon.2) 886 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T09:17:24.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:17:24 smithi157 bash[24585]: cluster 2024-09-16T09:17:23.103205+0000 mgr.a (mgr.14373) 9526 : cluster [DBG] pgmap v6607: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:17:24.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:17:24 smithi157 bash[24585]: audit 2024-09-16T09:17:23.452251+0000 mon.b (mon.2) 887 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:17:24.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:17:24 smithi157 bash[24585]: audit 2024-09-16T09:17:23.454530+0000 mon.b (mon.2) 888 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T09:17:24.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:17:24 smithi157 bash[24585]: audit 2024-09-16T09:17:23.464107+0000 mon.a (mon.0) 1139 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:17:24.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:17:24 smithi157 bash[24585]: audit 2024-09-16T09:17:23.469296+0000 mon.b (mon.2) 889 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:17:24.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:17:24 smithi086 bash[24289]: cluster 2024-09-16T09:17:23.103205+0000 mgr.a (mgr.14373) 9526 : cluster [DBG] pgmap v6607: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:17:24.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:17:24 smithi086 bash[24289]: audit 2024-09-16T09:17:23.452251+0000 mon.b (mon.2) 887 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:17:24.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:17:24 smithi086 bash[24289]: audit 2024-09-16T09:17:23.454530+0000 mon.b (mon.2) 888 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T09:17:24.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:17:24 smithi086 bash[24289]: audit 2024-09-16T09:17:23.464107+0000 mon.a (mon.0) 1139 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:17:24.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:17:24 smithi086 bash[24289]: audit 2024-09-16T09:17:23.469296+0000 mon.b (mon.2) 889 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:17:24.593 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 09:17:24 smithi047 bash[22994]: debug 2024-09-16T09:17:24.221+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T09:17:24.593 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 09:17:24 smithi047 bash[22994]: debug 2024-09-16T09:17:24.225+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T09:17:24.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:17:24 smithi047 bash[22744]: cluster 2024-09-16T09:17:23.103205+0000 mgr.a (mgr.14373) 9526 : cluster [DBG] pgmap v6607: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:17:24.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:17:24 smithi047 bash[22744]: audit 2024-09-16T09:17:23.452251+0000 mon.b (mon.2) 887 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:17:24.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:17:24 smithi047 bash[22744]: audit 2024-09-16T09:17:23.454530+0000 mon.b (mon.2) 888 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T09:17:24.594 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:17:24 smithi047 bash[22744]: audit 2024-09-16T09:17:23.464107+0000 mon.a (mon.0) 1139 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:17:24.594 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:17:24 smithi047 bash[22744]: audit 2024-09-16T09:17:23.469296+0000 mon.b (mon.2) 889 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:17:25.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:17:25 smithi157 bash[24585]: audit 2024-09-16T09:17:23.469473+0000 mgr.a (mgr.14373) 9527 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:17:25.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:17:25 smithi157 bash[24585]: audit 2024-09-16T09:17:24.224617+0000 mgr.a (mgr.14373) 9528 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T09:17:25.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:17:25 smithi157 bash[24585]: cephadm 2024-09-16T09:17:24.226586+0000 mgr.a (mgr.14373) 9529 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T09:17:25.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:17:25 smithi086 bash[24289]: audit 2024-09-16T09:17:23.469473+0000 mgr.a (mgr.14373) 9527 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:17:25.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:17:25 smithi086 bash[24289]: audit 2024-09-16T09:17:24.224617+0000 mgr.a (mgr.14373) 9528 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T09:17:25.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:17:25 smithi086 bash[24289]: cephadm 2024-09-16T09:17:24.226586+0000 mgr.a (mgr.14373) 9529 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T09:17:25.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:17:25 smithi047 bash[22744]: audit 2024-09-16T09:17:23.469473+0000 mgr.a (mgr.14373) 9527 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:17:25.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:17:25 smithi047 bash[22744]: audit 2024-09-16T09:17:24.224617+0000 mgr.a (mgr.14373) 9528 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T09:17:25.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:17:25 smithi047 bash[22744]: cephadm 2024-09-16T09:17:24.226586+0000 mgr.a (mgr.14373) 9529 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T09:17:25.973 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:17:25.974 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:17:25.974 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:17:26.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:17:26 smithi157 bash[24585]: cluster 2024-09-16T09:17:25.104334+0000 mgr.a (mgr.14373) 9530 : cluster [DBG] pgmap v6608: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:17:26.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:17:26 smithi086 bash[24289]: cluster 2024-09-16T09:17:25.104334+0000 mgr.a (mgr.14373) 9530 : cluster [DBG] pgmap v6608: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:17:26.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:17:26 smithi047 bash[22744]: cluster 2024-09-16T09:17:25.104334+0000 mgr.a (mgr.14373) 9530 : cluster [DBG] pgmap v6608: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:17:26.716 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:17:26.717 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:17:26.717 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:17:26.717 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:17:26.717 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:17:27.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:17:27 smithi157 bash[24585]: audit 2024-09-16T09:17:26.305283+0000 mgr.a (mgr.14373) 9531 : audit [DBG] from='client.211221 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:17:27.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:17:27 smithi086 bash[24289]: audit 2024-09-16T09:17:26.305283+0000 mgr.a (mgr.14373) 9531 : audit [DBG] from='client.211221 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:17:27.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:17:27 smithi047 bash[22744]: audit 2024-09-16T09:17:26.305283+0000 mgr.a (mgr.14373) 9531 : audit [DBG] from='client.211221 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:17:28.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:17:28 smithi157 bash[24585]: cluster 2024-09-16T09:17:27.107194+0000 mgr.a (mgr.14373) 9532 : cluster [DBG] pgmap v6609: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:17:28.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:17:28 smithi086 bash[24289]: cluster 2024-09-16T09:17:27.107194+0000 mgr.a (mgr.14373) 9532 : cluster [DBG] pgmap v6609: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:17:28.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:17:28 smithi047 bash[22744]: cluster 2024-09-16T09:17:27.107194+0000 mgr.a (mgr.14373) 9532 : cluster [DBG] pgmap v6609: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:17:30.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:17:30 smithi157 bash[24585]: cluster 2024-09-16T09:17:29.108002+0000 mgr.a (mgr.14373) 9533 : cluster [DBG] pgmap v6610: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T09:17:30.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:17:30 smithi086 bash[24289]: cluster 2024-09-16T09:17:29.108002+0000 mgr.a (mgr.14373) 9533 : cluster [DBG] pgmap v6610: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T09:17:30.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:17:30 smithi047 bash[22744]: cluster 2024-09-16T09:17:29.108002+0000 mgr.a (mgr.14373) 9533 : cluster [DBG] pgmap v6610: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T09:17:31.718 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:17:31.719 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:17:31.719 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:17:32.493 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:17:32.493 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:17:32.493 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:17:32.493 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:17:32.493 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:17:32.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:17:32 smithi157 bash[24585]: cluster 2024-09-16T09:17:31.108777+0000 mgr.a (mgr.14373) 9534 : cluster [DBG] pgmap v6611: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T09:17:32.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:17:32 smithi086 bash[24289]: cluster 2024-09-16T09:17:31.108777+0000 mgr.a (mgr.14373) 9534 : cluster [DBG] pgmap v6611: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T09:17:32.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:17:32 smithi047 bash[22744]: cluster 2024-09-16T09:17:31.108777+0000 mgr.a (mgr.14373) 9534 : cluster [DBG] pgmap v6611: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T09:17:33.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:17:33 smithi086 bash[24289]: audit 2024-09-16T09:17:32.048777+0000 mgr.a (mgr.14373) 9535 : audit [DBG] from='client.211299 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:17:33.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:17:33 smithi047 bash[22744]: audit 2024-09-16T09:17:32.048777+0000 mgr.a (mgr.14373) 9535 : audit [DBG] from='client.211299 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:17:33.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:17:33 smithi157 bash[24585]: audit 2024-09-16T09:17:32.048777+0000 mgr.a (mgr.14373) 9535 : audit [DBG] from='client.211299 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:17:34.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:17:34 smithi086 bash[24289]: cluster 2024-09-16T09:17:33.111653+0000 mgr.a (mgr.14373) 9536 : cluster [DBG] pgmap v6612: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:17:34.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:17:34 smithi047 bash[22744]: cluster 2024-09-16T09:17:33.111653+0000 mgr.a (mgr.14373) 9536 : cluster [DBG] pgmap v6612: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:17:34.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:17:34 smithi157 bash[24585]: cluster 2024-09-16T09:17:33.111653+0000 mgr.a (mgr.14373) 9536 : cluster [DBG] pgmap v6612: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:17:36.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:17:36 smithi086 bash[24289]: cluster 2024-09-16T09:17:35.112610+0000 mgr.a (mgr.14373) 9537 : cluster [DBG] pgmap v6613: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T09:17:36.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:17:36 smithi047 bash[22744]: cluster 2024-09-16T09:17:35.112610+0000 mgr.a (mgr.14373) 9537 : cluster [DBG] pgmap v6613: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T09:17:36.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:17:36 smithi157 bash[24585]: cluster 2024-09-16T09:17:35.112610+0000 mgr.a (mgr.14373) 9537 : cluster [DBG] pgmap v6613: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T09:17:37.494 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:17:37.495 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:17:37.495 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:17:38.278 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:17:38.278 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:17:38.279 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:17:38.279 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:17:38.279 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:17:38.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:17:38 smithi047 bash[22744]: cluster 2024-09-16T09:17:37.114590+0000 mgr.a (mgr.14373) 9538 : cluster [DBG] pgmap v6614: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:17:38.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:17:38 smithi157 bash[24585]: cluster 2024-09-16T09:17:37.114590+0000 mgr.a (mgr.14373) 9538 : cluster [DBG] pgmap v6614: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:17:38.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:17:38 smithi086 bash[24289]: cluster 2024-09-16T09:17:37.114590+0000 mgr.a (mgr.14373) 9538 : cluster [DBG] pgmap v6614: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:17:39.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:17:39 smithi047 bash[22744]: audit 2024-09-16T09:17:37.830671+0000 mgr.a (mgr.14373) 9539 : audit [DBG] from='client.211374 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:17:39.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:17:39 smithi157 bash[24585]: audit 2024-09-16T09:17:37.830671+0000 mgr.a (mgr.14373) 9539 : audit [DBG] from='client.211374 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:17:39.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:17:39 smithi086 bash[24289]: audit 2024-09-16T09:17:37.830671+0000 mgr.a (mgr.14373) 9539 : audit [DBG] from='client.211374 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:17:40.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:17:40 smithi047 bash[22744]: cluster 2024-09-16T09:17:39.115555+0000 mgr.a (mgr.14373) 9540 : cluster [DBG] pgmap v6615: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:17:40.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:17:40 smithi157 bash[24585]: cluster 2024-09-16T09:17:39.115555+0000 mgr.a (mgr.14373) 9540 : cluster [DBG] pgmap v6615: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:17:40.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:17:40 smithi086 bash[24289]: cluster 2024-09-16T09:17:39.115555+0000 mgr.a (mgr.14373) 9540 : cluster [DBG] pgmap v6615: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:17:42.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:17:42 smithi047 bash[22744]: cluster 2024-09-16T09:17:41.116361+0000 mgr.a (mgr.14373) 9541 : cluster [DBG] pgmap v6616: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:17:42.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:17:42 smithi157 bash[24585]: cluster 2024-09-16T09:17:41.116361+0000 mgr.a (mgr.14373) 9541 : cluster [DBG] pgmap v6616: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:17:42.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:17:42 smithi086 bash[24289]: cluster 2024-09-16T09:17:41.116361+0000 mgr.a (mgr.14373) 9541 : cluster [DBG] pgmap v6616: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:17:43.279 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:17:43.280 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:17:43.280 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:17:43.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:17:43 smithi047 bash[22744]: cluster 2024-09-16T09:17:43.118557+0000 mgr.a (mgr.14373) 9542 : cluster [DBG] pgmap v6617: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:17:43.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:17:43 smithi157 bash[24585]: cluster 2024-09-16T09:17:43.118557+0000 mgr.a (mgr.14373) 9542 : cluster [DBG] pgmap v6617: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:17:43.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:17:43 smithi086 bash[24289]: cluster 2024-09-16T09:17:43.118557+0000 mgr.a (mgr.14373) 9542 : cluster [DBG] pgmap v6617: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:17:44.061 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:17:44.061 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:17:44.061 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:17:44.061 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:17:44.062 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:17:44.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:17:44 smithi047 bash[22744]: audit 2024-09-16T09:17:43.613109+0000 mgr.a (mgr.14373) 9543 : audit [DBG] from='client.211452 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:17:44.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:17:44 smithi157 bash[24585]: audit 2024-09-16T09:17:43.613109+0000 mgr.a (mgr.14373) 9543 : audit [DBG] from='client.211452 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:17:44.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:17:44 smithi086 bash[24289]: audit 2024-09-16T09:17:43.613109+0000 mgr.a (mgr.14373) 9543 : audit [DBG] from='client.211452 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:17:45.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:17:45 smithi157 bash[24585]: cluster 2024-09-16T09:17:45.119626+0000 mgr.a (mgr.14373) 9544 : cluster [DBG] pgmap v6618: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:17:45.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:17:45 smithi086 bash[24289]: cluster 2024-09-16T09:17:45.119626+0000 mgr.a (mgr.14373) 9544 : cluster [DBG] pgmap v6618: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:17:45.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:17:45 smithi047 bash[22744]: cluster 2024-09-16T09:17:45.119626+0000 mgr.a (mgr.14373) 9544 : cluster [DBG] pgmap v6618: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:17:48.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:17:48 smithi157 bash[24585]: cluster 2024-09-16T09:17:47.121953+0000 mgr.a (mgr.14373) 9545 : cluster [DBG] pgmap v6619: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:17:48.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:17:48 smithi086 bash[24289]: cluster 2024-09-16T09:17:47.121953+0000 mgr.a (mgr.14373) 9545 : cluster [DBG] pgmap v6619: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:17:48.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:17:48 smithi047 bash[22744]: cluster 2024-09-16T09:17:47.121953+0000 mgr.a (mgr.14373) 9545 : cluster [DBG] pgmap v6619: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:17:49.063 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:17:49.063 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:17:49.063 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:17:49.843 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:17:49.843 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:17:49.843 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:17:49.844 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:17:49.844 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:17:50.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:17:50 smithi157 bash[24585]: cluster 2024-09-16T09:17:49.122839+0000 mgr.a (mgr.14373) 9546 : cluster [DBG] pgmap v6620: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:17:50.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:17:50 smithi086 bash[24289]: cluster 2024-09-16T09:17:49.122839+0000 mgr.a (mgr.14373) 9546 : cluster [DBG] pgmap v6620: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:17:50.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:17:50 smithi047 bash[22744]: cluster 2024-09-16T09:17:49.122839+0000 mgr.a (mgr.14373) 9546 : cluster [DBG] pgmap v6620: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:17:51.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:17:51 smithi157 bash[24585]: audit 2024-09-16T09:17:49.399576+0000 mgr.a (mgr.14373) 9547 : audit [DBG] from='client.211524 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:17:51.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:17:51 smithi086 bash[24289]: audit 2024-09-16T09:17:49.399576+0000 mgr.a (mgr.14373) 9547 : audit [DBG] from='client.211524 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:17:51.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:17:51 smithi047 bash[22744]: audit 2024-09-16T09:17:49.399576+0000 mgr.a (mgr.14373) 9547 : audit [DBG] from='client.211524 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:17:52.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:17:52 smithi157 bash[24585]: cluster 2024-09-16T09:17:51.123772+0000 mgr.a (mgr.14373) 9548 : cluster [DBG] pgmap v6621: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:17:52.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:17:52 smithi086 bash[24289]: cluster 2024-09-16T09:17:51.123772+0000 mgr.a (mgr.14373) 9548 : cluster [DBG] pgmap v6621: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:17:52.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:17:52 smithi047 bash[22744]: cluster 2024-09-16T09:17:51.123772+0000 mgr.a (mgr.14373) 9548 : cluster [DBG] pgmap v6621: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:17:54.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:17:54 smithi157 bash[24585]: cluster 2024-09-16T09:17:53.126042+0000 mgr.a (mgr.14373) 9549 : cluster [DBG] pgmap v6622: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:17:54.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:17:54 smithi086 bash[24289]: cluster 2024-09-16T09:17:53.126042+0000 mgr.a (mgr.14373) 9549 : cluster [DBG] pgmap v6622: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:17:54.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:17:54 smithi047 bash[22744]: cluster 2024-09-16T09:17:53.126042+0000 mgr.a (mgr.14373) 9549 : cluster [DBG] pgmap v6622: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:17:54.844 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:17:54.845 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:17:54.846 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:17:55.602 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:17:55.602 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:17:55.602 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:17:55.603 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:17:55.603 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:17:56.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:17:56 smithi157 bash[24585]: cluster 2024-09-16T09:17:55.126566+0000 mgr.a (mgr.14373) 9550 : cluster [DBG] pgmap v6623: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:17:56.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:17:56 smithi157 bash[24585]: audit 2024-09-16T09:17:55.177724+0000 mgr.a (mgr.14373) 9551 : audit [DBG] from='client.211599 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:17:56.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:17:56 smithi086 bash[24289]: cluster 2024-09-16T09:17:55.126566+0000 mgr.a (mgr.14373) 9550 : cluster [DBG] pgmap v6623: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:17:56.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:17:56 smithi086 bash[24289]: audit 2024-09-16T09:17:55.177724+0000 mgr.a (mgr.14373) 9551 : audit [DBG] from='client.211599 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:17:56.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:17:56 smithi047 bash[22744]: cluster 2024-09-16T09:17:55.126566+0000 mgr.a (mgr.14373) 9550 : cluster [DBG] pgmap v6623: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:17:56.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:17:56 smithi047 bash[22744]: audit 2024-09-16T09:17:55.177724+0000 mgr.a (mgr.14373) 9551 : audit [DBG] from='client.211599 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:17:58.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:17:58 smithi157 bash[24585]: cluster 2024-09-16T09:17:57.128948+0000 mgr.a (mgr.14373) 9552 : cluster [DBG] pgmap v6624: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:17:58.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:17:58 smithi086 bash[24289]: cluster 2024-09-16T09:17:57.128948+0000 mgr.a (mgr.14373) 9552 : cluster [DBG] pgmap v6624: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:17:58.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:17:58 smithi047 bash[22744]: cluster 2024-09-16T09:17:57.128948+0000 mgr.a (mgr.14373) 9552 : cluster [DBG] pgmap v6624: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:18:00.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:18:00 smithi157 bash[24585]: cluster 2024-09-16T09:17:59.129787+0000 mgr.a (mgr.14373) 9553 : cluster [DBG] pgmap v6625: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:18:00.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:18:00 smithi086 bash[24289]: cluster 2024-09-16T09:17:59.129787+0000 mgr.a (mgr.14373) 9553 : cluster [DBG] pgmap v6625: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:18:00.597 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:18:00 smithi047 bash[22744]: cluster 2024-09-16T09:17:59.129787+0000 mgr.a (mgr.14373) 9553 : cluster [DBG] pgmap v6625: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:18:01.383 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:18:01.383 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:18:01.383 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:18:01.390 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:18:01.390 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:18:01.390 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:18:01.390 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:18:01.390 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:18:02.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:18:02 smithi157 bash[24585]: audit 2024-09-16T09:18:00.943608+0000 mgr.a (mgr.14373) 9554 : audit [DBG] from='client.211677 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:18:02.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:18:02 smithi157 bash[24585]: cluster 2024-09-16T09:18:01.130403+0000 mgr.a (mgr.14373) 9555 : cluster [DBG] pgmap v6626: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:18:02.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:18:02 smithi086 bash[24289]: audit 2024-09-16T09:18:00.943608+0000 mgr.a (mgr.14373) 9554 : audit [DBG] from='client.211677 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:18:02.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:18:02 smithi086 bash[24289]: cluster 2024-09-16T09:18:01.130403+0000 mgr.a (mgr.14373) 9555 : cluster [DBG] pgmap v6626: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:18:02.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:18:02 smithi047 bash[22744]: audit 2024-09-16T09:18:00.943608+0000 mgr.a (mgr.14373) 9554 : audit [DBG] from='client.211677 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:18:02.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:18:02 smithi047 bash[22744]: cluster 2024-09-16T09:18:01.130403+0000 mgr.a (mgr.14373) 9555 : cluster [DBG] pgmap v6626: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:18:04.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:18:04 smithi157 bash[24585]: cluster 2024-09-16T09:18:03.132695+0000 mgr.a (mgr.14373) 9556 : cluster [DBG] pgmap v6627: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:18:04.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:18:04 smithi086 bash[24289]: cluster 2024-09-16T09:18:03.132695+0000 mgr.a (mgr.14373) 9556 : cluster [DBG] pgmap v6627: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:18:04.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:18:04 smithi047 bash[22744]: cluster 2024-09-16T09:18:03.132695+0000 mgr.a (mgr.14373) 9556 : cluster [DBG] pgmap v6627: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:18:06.389 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:18:06.390 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:18:06.390 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:18:06.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:18:06 smithi157 bash[24585]: cluster 2024-09-16T09:18:05.133499+0000 mgr.a (mgr.14373) 9557 : cluster [DBG] pgmap v6628: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:18:06.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:18:06 smithi086 bash[24289]: cluster 2024-09-16T09:18:05.133499+0000 mgr.a (mgr.14373) 9557 : cluster [DBG] pgmap v6628: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:18:06.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:18:06 smithi047 bash[22744]: cluster 2024-09-16T09:18:05.133499+0000 mgr.a (mgr.14373) 9557 : cluster [DBG] pgmap v6628: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:18:07.146 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:18:07.147 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:18:07.147 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:18:07.147 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:18:07.147 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:18:08.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:18:08 smithi157 bash[24585]: audit 2024-09-16T09:18:06.720894+0000 mgr.a (mgr.14373) 9558 : audit [DBG] from='client.211755 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:18:08.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:18:08 smithi157 bash[24585]: cluster 2024-09-16T09:18:07.135013+0000 mgr.a (mgr.14373) 9559 : cluster [DBG] pgmap v6629: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-16T09:18:08.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:18:08 smithi086 bash[24289]: audit 2024-09-16T09:18:06.720894+0000 mgr.a (mgr.14373) 9558 : audit [DBG] from='client.211755 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:18:08.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:18:08 smithi086 bash[24289]: cluster 2024-09-16T09:18:07.135013+0000 mgr.a (mgr.14373) 9559 : cluster [DBG] pgmap v6629: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-16T09:18:08.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:18:08 smithi047 bash[22744]: audit 2024-09-16T09:18:06.720894+0000 mgr.a (mgr.14373) 9558 : audit [DBG] from='client.211755 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:18:08.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:18:08 smithi047 bash[22744]: cluster 2024-09-16T09:18:07.135013+0000 mgr.a (mgr.14373) 9559 : cluster [DBG] pgmap v6629: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-16T09:18:10.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:18:10 smithi157 bash[24585]: cluster 2024-09-16T09:18:09.135742+0000 mgr.a (mgr.14373) 9560 : cluster [DBG] pgmap v6630: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 4.9 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-16T09:18:10.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:18:10 smithi086 bash[24289]: cluster 2024-09-16T09:18:09.135742+0000 mgr.a (mgr.14373) 9560 : cluster [DBG] pgmap v6630: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 4.9 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-16T09:18:10.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:18:10 smithi047 bash[22744]: cluster 2024-09-16T09:18:09.135742+0000 mgr.a (mgr.14373) 9560 : cluster [DBG] pgmap v6630: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 4.9 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-16T09:18:12.148 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:18:12.149 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:18:12.149 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:18:12.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:18:12 smithi157 bash[24585]: cluster 2024-09-16T09:18:11.136519+0000 mgr.a (mgr.14373) 9561 : cluster [DBG] pgmap v6631: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 4.9 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-16T09:18:12.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:18:12 smithi086 bash[24289]: cluster 2024-09-16T09:18:11.136519+0000 mgr.a (mgr.14373) 9561 : cluster [DBG] pgmap v6631: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 4.9 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-16T09:18:12.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:18:12 smithi047 bash[22744]: cluster 2024-09-16T09:18:11.136519+0000 mgr.a (mgr.14373) 9561 : cluster [DBG] pgmap v6631: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 4.9 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-16T09:18:12.894 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:18:12.894 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:18:12.894 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:18:12.894 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:18:12.894 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:18:14.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:18:14 smithi157 bash[24585]: audit 2024-09-16T09:18:12.470694+0000 mgr.a (mgr.14373) 9562 : audit [DBG] from='client.211833 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:18:14.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:18:14 smithi157 bash[24585]: cluster 2024-09-16T09:18:13.139304+0000 mgr.a (mgr.14373) 9563 : cluster [DBG] pgmap v6632: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-16T09:18:14.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:18:14 smithi086 bash[24289]: audit 2024-09-16T09:18:12.470694+0000 mgr.a (mgr.14373) 9562 : audit [DBG] from='client.211833 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:18:14.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:18:14 smithi086 bash[24289]: cluster 2024-09-16T09:18:13.139304+0000 mgr.a (mgr.14373) 9563 : cluster [DBG] pgmap v6632: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-16T09:18:14.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:18:14 smithi047 bash[22744]: audit 2024-09-16T09:18:12.470694+0000 mgr.a (mgr.14373) 9562 : audit [DBG] from='client.211833 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:18:14.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:18:14 smithi047 bash[22744]: cluster 2024-09-16T09:18:13.139304+0000 mgr.a (mgr.14373) 9563 : cluster [DBG] pgmap v6632: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-16T09:18:15.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:18:15 smithi157 bash[24585]: cluster 2024-09-16T09:18:15.140096+0000 mgr.a (mgr.14373) 9564 : cluster [DBG] pgmap v6633: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 4.9 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-16T09:18:15.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:18:15 smithi086 bash[24289]: cluster 2024-09-16T09:18:15.140096+0000 mgr.a (mgr.14373) 9564 : cluster [DBG] pgmap v6633: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 4.9 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-16T09:18:15.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:18:15 smithi047 bash[22744]: cluster 2024-09-16T09:18:15.140096+0000 mgr.a (mgr.14373) 9564 : cluster [DBG] pgmap v6633: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 4.9 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-16T09:18:17.895 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:18:17.896 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:18:17.896 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:18:18.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:18:18 smithi157 bash[24585]: cluster 2024-09-16T09:18:17.142163+0000 mgr.a (mgr.14373) 9565 : cluster [DBG] pgmap v6634: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-16T09:18:18.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:18:18 smithi086 bash[24289]: cluster 2024-09-16T09:18:17.142163+0000 mgr.a (mgr.14373) 9565 : cluster [DBG] pgmap v6634: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-16T09:18:18.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:18:18 smithi047 bash[22744]: cluster 2024-09-16T09:18:17.142163+0000 mgr.a (mgr.14373) 9565 : cluster [DBG] pgmap v6634: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-16T09:18:18.667 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:18:18.667 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:18:18.667 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:18:18.667 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:18:18.667 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:18:19.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:18:19 smithi157 bash[24585]: audit 2024-09-16T09:18:18.237030+0000 mgr.a (mgr.14373) 9566 : audit [DBG] from='client.211911 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:18:19.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:18:19 smithi086 bash[24289]: audit 2024-09-16T09:18:18.237030+0000 mgr.a (mgr.14373) 9566 : audit [DBG] from='client.211911 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:18:19.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:18:19 smithi047 bash[22744]: audit 2024-09-16T09:18:18.237030+0000 mgr.a (mgr.14373) 9566 : audit [DBG] from='client.211911 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:18:20.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:18:20 smithi157 bash[24585]: cluster 2024-09-16T09:18:19.143149+0000 mgr.a (mgr.14373) 9567 : cluster [DBG] pgmap v6635: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:18:20.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:18:20 smithi086 bash[24289]: cluster 2024-09-16T09:18:19.143149+0000 mgr.a (mgr.14373) 9567 : cluster [DBG] pgmap v6635: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:18:20.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:18:20 smithi047 bash[22744]: cluster 2024-09-16T09:18:19.143149+0000 mgr.a (mgr.14373) 9567 : cluster [DBG] pgmap v6635: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:18:22.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:18:22 smithi157 bash[24585]: cluster 2024-09-16T09:18:21.143970+0000 mgr.a (mgr.14373) 9568 : cluster [DBG] pgmap v6636: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:18:22.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:18:22 smithi086 bash[24289]: cluster 2024-09-16T09:18:21.143970+0000 mgr.a (mgr.14373) 9568 : cluster [DBG] pgmap v6636: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:18:22.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:18:22 smithi047 bash[22744]: cluster 2024-09-16T09:18:21.143970+0000 mgr.a (mgr.14373) 9568 : cluster [DBG] pgmap v6636: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:18:23.669 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:18:23.669 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:18:23.669 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:18:24.457 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:18:24.458 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:18:24.458 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:18:24.458 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:18:24.458 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:18:24.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:18:24 smithi157 bash[24585]: cluster 2024-09-16T09:18:23.146182+0000 mgr.a (mgr.14373) 9569 : cluster [DBG] pgmap v6637: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 66 KiB/s rd, 0 B/s wr, 108 op/s 2024-09-16T09:18:24.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:18:24 smithi086 bash[24289]: cluster 2024-09-16T09:18:23.146182+0000 mgr.a (mgr.14373) 9569 : cluster [DBG] pgmap v6637: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 66 KiB/s rd, 0 B/s wr, 108 op/s 2024-09-16T09:18:24.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:18:24 smithi047 bash[22744]: cluster 2024-09-16T09:18:23.146182+0000 mgr.a (mgr.14373) 9569 : cluster [DBG] pgmap v6637: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 66 KiB/s rd, 0 B/s wr, 108 op/s 2024-09-16T09:18:25.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:18:25 smithi157 bash[24585]: audit 2024-09-16T09:18:23.998489+0000 mgr.a (mgr.14373) 9570 : audit [DBG] from='client.211989 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:18:25.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:18:25 smithi157 bash[24585]: audit 2024-09-16T09:18:24.279739+0000 mon.b (mon.2) 890 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T09:18:25.555 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:18:25 smithi157 bash[24585]: audit 2024-09-16T09:18:25.096896+0000 mon.b (mon.2) 891 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:18:25.555 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:18:25 smithi157 bash[24585]: audit 2024-09-16T09:18:25.099035+0000 mon.b (mon.2) 892 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T09:18:25.555 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:18:25 smithi157 bash[24585]: audit 2024-09-16T09:18:25.108307+0000 mon.a (mon.0) 1140 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:18:25.555 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:18:25 smithi157 bash[24585]: audit 2024-09-16T09:18:25.116373+0000 mon.b (mon.2) 893 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:18:25.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:18:25 smithi086 bash[24289]: audit 2024-09-16T09:18:23.998489+0000 mgr.a (mgr.14373) 9570 : audit [DBG] from='client.211989 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:18:25.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:18:25 smithi086 bash[24289]: audit 2024-09-16T09:18:24.279739+0000 mon.b (mon.2) 890 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T09:18:25.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:18:25 smithi086 bash[24289]: audit 2024-09-16T09:18:25.096896+0000 mon.b (mon.2) 891 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:18:25.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:18:25 smithi086 bash[24289]: audit 2024-09-16T09:18:25.099035+0000 mon.b (mon.2) 892 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T09:18:25.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:18:25 smithi086 bash[24289]: audit 2024-09-16T09:18:25.108307+0000 mon.a (mon.0) 1140 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:18:25.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:18:25 smithi086 bash[24289]: audit 2024-09-16T09:18:25.116373+0000 mon.b (mon.2) 893 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:18:25.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:18:25 smithi047 bash[22744]: audit 2024-09-16T09:18:23.998489+0000 mgr.a (mgr.14373) 9570 : audit [DBG] from='client.211989 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:18:25.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:18:25 smithi047 bash[22744]: audit 2024-09-16T09:18:24.279739+0000 mon.b (mon.2) 890 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T09:18:25.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:18:25 smithi047 bash[22744]: audit 2024-09-16T09:18:25.096896+0000 mon.b (mon.2) 891 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:18:25.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:18:25 smithi047 bash[22744]: audit 2024-09-16T09:18:25.099035+0000 mon.b (mon.2) 892 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T09:18:25.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:18:25 smithi047 bash[22744]: audit 2024-09-16T09:18:25.108307+0000 mon.a (mon.0) 1140 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:18:25.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:18:25 smithi047 bash[22744]: audit 2024-09-16T09:18:25.116373+0000 mon.b (mon.2) 893 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:18:26.226 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 09:18:25 smithi047 bash[22994]: debug 2024-09-16T09:18:25.859+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T09:18:26.226 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 09:18:25 smithi047 bash[22994]: debug 2024-09-16T09:18:25.863+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T09:18:26.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:18:26 smithi157 bash[24585]: audit 2024-09-16T09:18:25.116719+0000 mgr.a (mgr.14373) 9571 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:18:26.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:18:26 smithi157 bash[24585]: cluster 2024-09-16T09:18:25.147280+0000 mgr.a (mgr.14373) 9572 : cluster [DBG] pgmap v6638: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 65 KiB/s rd, 0 B/s wr, 107 op/s 2024-09-16T09:18:26.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:18:26 smithi086 bash[24289]: audit 2024-09-16T09:18:25.116719+0000 mgr.a (mgr.14373) 9571 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:18:26.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:18:26 smithi086 bash[24289]: cluster 2024-09-16T09:18:25.147280+0000 mgr.a (mgr.14373) 9572 : cluster [DBG] pgmap v6638: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 65 KiB/s rd, 0 B/s wr, 107 op/s 2024-09-16T09:18:26.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:18:26 smithi047 bash[22744]: audit 2024-09-16T09:18:25.116719+0000 mgr.a (mgr.14373) 9571 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:18:26.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:18:26 smithi047 bash[22744]: cluster 2024-09-16T09:18:25.147280+0000 mgr.a (mgr.14373) 9572 : cluster [DBG] pgmap v6638: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 65 KiB/s rd, 0 B/s wr, 107 op/s 2024-09-16T09:18:27.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:18:27 smithi157 bash[24585]: audit 2024-09-16T09:18:25.864016+0000 mgr.a (mgr.14373) 9573 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T09:18:27.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:18:27 smithi157 bash[24585]: cephadm 2024-09-16T09:18:25.866610+0000 mgr.a (mgr.14373) 9574 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T09:18:27.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:18:27 smithi086 bash[24289]: audit 2024-09-16T09:18:25.864016+0000 mgr.a (mgr.14373) 9573 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T09:18:27.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:18:27 smithi086 bash[24289]: cephadm 2024-09-16T09:18:25.866610+0000 mgr.a (mgr.14373) 9574 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T09:18:27.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:18:27 smithi047 bash[22744]: audit 2024-09-16T09:18:25.864016+0000 mgr.a (mgr.14373) 9573 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T09:18:27.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:18:27 smithi047 bash[22744]: cephadm 2024-09-16T09:18:25.866610+0000 mgr.a (mgr.14373) 9574 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T09:18:28.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:18:28 smithi157 bash[24585]: cluster 2024-09-16T09:18:27.149572+0000 mgr.a (mgr.14373) 9575 : cluster [DBG] pgmap v6639: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 71 KiB/s rd, 426 B/s wr, 113 op/s 2024-09-16T09:18:28.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:18:28 smithi086 bash[24289]: cluster 2024-09-16T09:18:27.149572+0000 mgr.a (mgr.14373) 9575 : cluster [DBG] pgmap v6639: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 71 KiB/s rd, 426 B/s wr, 113 op/s 2024-09-16T09:18:28.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:18:28 smithi047 bash[22744]: cluster 2024-09-16T09:18:27.149572+0000 mgr.a (mgr.14373) 9575 : cluster [DBG] pgmap v6639: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 71 KiB/s rd, 426 B/s wr, 113 op/s 2024-09-16T09:18:29.459 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:18:29.459 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:18:29.460 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:18:30.238 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:18:30.238 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:18:30.238 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:18:30.239 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:18:30.239 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:18:30.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:18:30 smithi157 bash[24585]: cluster 2024-09-16T09:18:29.150496+0000 mgr.a (mgr.14373) 9576 : cluster [DBG] pgmap v6640: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 70 KiB/s rd, 426 B/s wr, 112 op/s 2024-09-16T09:18:30.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:18:30 smithi086 bash[24289]: cluster 2024-09-16T09:18:29.150496+0000 mgr.a (mgr.14373) 9576 : cluster [DBG] pgmap v6640: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 70 KiB/s rd, 426 B/s wr, 112 op/s 2024-09-16T09:18:30.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:18:30 smithi047 bash[22744]: cluster 2024-09-16T09:18:29.150496+0000 mgr.a (mgr.14373) 9576 : cluster [DBG] pgmap v6640: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 70 KiB/s rd, 426 B/s wr, 112 op/s 2024-09-16T09:18:31.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:18:31 smithi157 bash[24585]: audit 2024-09-16T09:18:29.794066+0000 mgr.a (mgr.14373) 9577 : audit [DBG] from='client.212169 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:18:31.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:18:31 smithi086 bash[24289]: audit 2024-09-16T09:18:29.794066+0000 mgr.a (mgr.14373) 9577 : audit [DBG] from='client.212169 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:18:31.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:18:31 smithi047 bash[22744]: audit 2024-09-16T09:18:29.794066+0000 mgr.a (mgr.14373) 9577 : audit [DBG] from='client.212169 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:18:32.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:18:32 smithi157 bash[24585]: cluster 2024-09-16T09:18:31.151436+0000 mgr.a (mgr.14373) 9578 : cluster [DBG] pgmap v6641: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 70 KiB/s rd, 426 B/s wr, 112 op/s 2024-09-16T09:18:32.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:18:32 smithi086 bash[24289]: cluster 2024-09-16T09:18:31.151436+0000 mgr.a (mgr.14373) 9578 : cluster [DBG] pgmap v6641: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 70 KiB/s rd, 426 B/s wr, 112 op/s 2024-09-16T09:18:32.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:18:32 smithi047 bash[22744]: cluster 2024-09-16T09:18:31.151436+0000 mgr.a (mgr.14373) 9578 : cluster [DBG] pgmap v6641: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 70 KiB/s rd, 426 B/s wr, 112 op/s 2024-09-16T09:18:34.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:18:34 smithi157 bash[24585]: cluster 2024-09-16T09:18:33.153802+0000 mgr.a (mgr.14373) 9579 : cluster [DBG] pgmap v6642: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 71 KiB/s rd, 426 B/s wr, 113 op/s 2024-09-16T09:18:34.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:18:34 smithi086 bash[24289]: cluster 2024-09-16T09:18:33.153802+0000 mgr.a (mgr.14373) 9579 : cluster [DBG] pgmap v6642: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 71 KiB/s rd, 426 B/s wr, 113 op/s 2024-09-16T09:18:34.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:18:34 smithi047 bash[22744]: cluster 2024-09-16T09:18:33.153802+0000 mgr.a (mgr.14373) 9579 : cluster [DBG] pgmap v6642: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 71 KiB/s rd, 426 B/s wr, 113 op/s 2024-09-16T09:18:35.239 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:18:35.240 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:18:35.240 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:18:35.988 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:18:35.988 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:18:35.988 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:18:35.988 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:18:35.988 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:18:36.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:18:36 smithi157 bash[24585]: cluster 2024-09-16T09:18:35.154755+0000 mgr.a (mgr.14373) 9580 : cluster [DBG] pgmap v6643: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:18:36.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:18:36 smithi086 bash[24289]: cluster 2024-09-16T09:18:35.154755+0000 mgr.a (mgr.14373) 9580 : cluster [DBG] pgmap v6643: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:18:36.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:18:36 smithi047 bash[22744]: cluster 2024-09-16T09:18:35.154755+0000 mgr.a (mgr.14373) 9580 : cluster [DBG] pgmap v6643: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:18:37.558 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:18:37 smithi157 bash[24585]: audit 2024-09-16T09:18:35.568318+0000 mgr.a (mgr.14373) 9581 : audit [DBG] from='client.212244 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:18:37.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:18:37 smithi086 bash[24289]: audit 2024-09-16T09:18:35.568318+0000 mgr.a (mgr.14373) 9581 : audit [DBG] from='client.212244 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:18:37.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:18:37 smithi047 bash[22744]: audit 2024-09-16T09:18:35.568318+0000 mgr.a (mgr.14373) 9581 : audit [DBG] from='client.212244 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:18:38.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:18:38 smithi157 bash[24585]: cluster 2024-09-16T09:18:37.157236+0000 mgr.a (mgr.14373) 9582 : cluster [DBG] pgmap v6644: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:18:38.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:18:38 smithi086 bash[24289]: cluster 2024-09-16T09:18:37.157236+0000 mgr.a (mgr.14373) 9582 : cluster [DBG] pgmap v6644: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:18:38.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:18:38 smithi047 bash[22744]: cluster 2024-09-16T09:18:37.157236+0000 mgr.a (mgr.14373) 9582 : cluster [DBG] pgmap v6644: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:18:40.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:18:40 smithi157 bash[24585]: cluster 2024-09-16T09:18:39.158174+0000 mgr.a (mgr.14373) 9583 : cluster [DBG] pgmap v6645: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:18:40.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:18:40 smithi086 bash[24289]: cluster 2024-09-16T09:18:39.158174+0000 mgr.a (mgr.14373) 9583 : cluster [DBG] pgmap v6645: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:18:40.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:18:40 smithi047 bash[22744]: cluster 2024-09-16T09:18:39.158174+0000 mgr.a (mgr.14373) 9583 : cluster [DBG] pgmap v6645: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:18:40.989 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:18:40.990 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:18:40.990 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:18:41.735 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:18:41.736 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:18:41.736 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:18:41.736 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:18:41.736 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:18:42.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:18:42 smithi157 bash[24585]: cluster 2024-09-16T09:18:41.159045+0000 mgr.a (mgr.14373) 9584 : cluster [DBG] pgmap v6646: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:18:42.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:18:42 smithi157 bash[24585]: audit 2024-09-16T09:18:41.317299+0000 mgr.a (mgr.14373) 9585 : audit [DBG] from='client.212319 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:18:42.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:18:42 smithi086 bash[24289]: cluster 2024-09-16T09:18:41.159045+0000 mgr.a (mgr.14373) 9584 : cluster [DBG] pgmap v6646: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:18:42.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:18:42 smithi086 bash[24289]: audit 2024-09-16T09:18:41.317299+0000 mgr.a (mgr.14373) 9585 : audit [DBG] from='client.212319 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:18:42.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:18:42 smithi047 bash[22744]: cluster 2024-09-16T09:18:41.159045+0000 mgr.a (mgr.14373) 9584 : cluster [DBG] pgmap v6646: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:18:42.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:18:42 smithi047 bash[22744]: audit 2024-09-16T09:18:41.317299+0000 mgr.a (mgr.14373) 9585 : audit [DBG] from='client.212319 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:18:44.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:18:44 smithi157 bash[24585]: cluster 2024-09-16T09:18:43.161746+0000 mgr.a (mgr.14373) 9586 : cluster [DBG] pgmap v6647: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:18:44.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:18:44 smithi086 bash[24289]: cluster 2024-09-16T09:18:43.161746+0000 mgr.a (mgr.14373) 9586 : cluster [DBG] pgmap v6647: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:18:44.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:18:44 smithi047 bash[22744]: cluster 2024-09-16T09:18:43.161746+0000 mgr.a (mgr.14373) 9586 : cluster [DBG] pgmap v6647: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:18:46.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:18:46 smithi157 bash[24585]: cluster 2024-09-16T09:18:45.162526+0000 mgr.a (mgr.14373) 9587 : cluster [DBG] pgmap v6648: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:18:46.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:18:46 smithi086 bash[24289]: cluster 2024-09-16T09:18:45.162526+0000 mgr.a (mgr.14373) 9587 : cluster [DBG] pgmap v6648: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:18:46.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:18:46 smithi047 bash[22744]: cluster 2024-09-16T09:18:45.162526+0000 mgr.a (mgr.14373) 9587 : cluster [DBG] pgmap v6648: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:18:46.737 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:18:46.737 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:18:46.738 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:18:47.503 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:18:47.503 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:18:47.503 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:18:47.503 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:18:47.503 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:18:48.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:18:48 smithi157 bash[24585]: audit 2024-09-16T09:18:47.066726+0000 mgr.a (mgr.14373) 9588 : audit [DBG] from='client.212397 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:18:48.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:18:48 smithi157 bash[24585]: cluster 2024-09-16T09:18:47.163705+0000 mgr.a (mgr.14373) 9589 : cluster [DBG] pgmap v6649: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:18:48.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:18:48 smithi086 bash[24289]: audit 2024-09-16T09:18:47.066726+0000 mgr.a (mgr.14373) 9588 : audit [DBG] from='client.212397 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:18:48.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:18:48 smithi086 bash[24289]: cluster 2024-09-16T09:18:47.163705+0000 mgr.a (mgr.14373) 9589 : cluster [DBG] pgmap v6649: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:18:48.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:18:48 smithi047 bash[22744]: audit 2024-09-16T09:18:47.066726+0000 mgr.a (mgr.14373) 9588 : audit [DBG] from='client.212397 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:18:48.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:18:48 smithi047 bash[22744]: cluster 2024-09-16T09:18:47.163705+0000 mgr.a (mgr.14373) 9589 : cluster [DBG] pgmap v6649: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:18:50.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:18:50 smithi157 bash[24585]: cluster 2024-09-16T09:18:49.164528+0000 mgr.a (mgr.14373) 9590 : cluster [DBG] pgmap v6650: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:18:50.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:18:50 smithi086 bash[24289]: cluster 2024-09-16T09:18:49.164528+0000 mgr.a (mgr.14373) 9590 : cluster [DBG] pgmap v6650: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:18:50.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:18:50 smithi047 bash[22744]: cluster 2024-09-16T09:18:49.164528+0000 mgr.a (mgr.14373) 9590 : cluster [DBG] pgmap v6650: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:18:52.504 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:18:52.505 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:18:52.505 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:18:52.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:18:52 smithi157 bash[24585]: cluster 2024-09-16T09:18:51.165277+0000 mgr.a (mgr.14373) 9591 : cluster [DBG] pgmap v6651: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T09:18:52.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:18:52 smithi086 bash[24289]: cluster 2024-09-16T09:18:51.165277+0000 mgr.a (mgr.14373) 9591 : cluster [DBG] pgmap v6651: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T09:18:52.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:18:52 smithi047 bash[22744]: cluster 2024-09-16T09:18:51.165277+0000 mgr.a (mgr.14373) 9591 : cluster [DBG] pgmap v6651: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T09:18:53.293 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:18:53.293 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:18:53.293 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:18:53.293 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:18:53.293 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:18:54.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:18:54 smithi086 bash[24289]: audit 2024-09-16T09:18:52.848592+0000 mgr.a (mgr.14373) 9592 : audit [DBG] from='client.212472 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:18:54.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:18:54 smithi086 bash[24289]: cluster 2024-09-16T09:18:53.166670+0000 mgr.a (mgr.14373) 9593 : cluster [DBG] pgmap v6652: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:18:54.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:18:54 smithi047 bash[22744]: audit 2024-09-16T09:18:52.848592+0000 mgr.a (mgr.14373) 9592 : audit [DBG] from='client.212472 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:18:54.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:18:54 smithi047 bash[22744]: cluster 2024-09-16T09:18:53.166670+0000 mgr.a (mgr.14373) 9593 : cluster [DBG] pgmap v6652: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:18:54.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:18:54 smithi157 bash[24585]: audit 2024-09-16T09:18:52.848592+0000 mgr.a (mgr.14373) 9592 : audit [DBG] from='client.212472 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:18:54.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:18:54 smithi157 bash[24585]: cluster 2024-09-16T09:18:53.166670+0000 mgr.a (mgr.14373) 9593 : cluster [DBG] pgmap v6652: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:18:55.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:18:55 smithi157 bash[24585]: cluster 2024-09-16T09:18:55.167677+0000 mgr.a (mgr.14373) 9594 : cluster [DBG] pgmap v6653: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:18:55.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:18:55 smithi086 bash[24289]: cluster 2024-09-16T09:18:55.167677+0000 mgr.a (mgr.14373) 9594 : cluster [DBG] pgmap v6653: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:18:55.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:18:55 smithi047 bash[22744]: cluster 2024-09-16T09:18:55.167677+0000 mgr.a (mgr.14373) 9594 : cluster [DBG] pgmap v6653: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:18:58.295 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:18:58.295 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:18:58.295 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:18:58.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:18:58 smithi157 bash[24585]: cluster 2024-09-16T09:18:57.169999+0000 mgr.a (mgr.14373) 9595 : cluster [DBG] pgmap v6654: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:18:58.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:18:58 smithi086 bash[24289]: cluster 2024-09-16T09:18:57.169999+0000 mgr.a (mgr.14373) 9595 : cluster [DBG] pgmap v6654: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:18:58.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:18:58 smithi047 bash[22744]: cluster 2024-09-16T09:18:57.169999+0000 mgr.a (mgr.14373) 9595 : cluster [DBG] pgmap v6654: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:18:59.073 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:18:59.073 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:18:59.073 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:18:59.073 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:18:59.074 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:19:00.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:19:00 smithi157 bash[24585]: audit 2024-09-16T09:18:58.630767+0000 mgr.a (mgr.14373) 9596 : audit [DBG] from='client.212550 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:19:00.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:19:00 smithi157 bash[24585]: cluster 2024-09-16T09:18:59.170994+0000 mgr.a (mgr.14373) 9597 : cluster [DBG] pgmap v6655: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:19:00.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:19:00 smithi086 bash[24289]: audit 2024-09-16T09:18:58.630767+0000 mgr.a (mgr.14373) 9596 : audit [DBG] from='client.212550 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:19:00.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:19:00 smithi086 bash[24289]: cluster 2024-09-16T09:18:59.170994+0000 mgr.a (mgr.14373) 9597 : cluster [DBG] pgmap v6655: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:19:00.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:19:00 smithi047 bash[22744]: audit 2024-09-16T09:18:58.630767+0000 mgr.a (mgr.14373) 9596 : audit [DBG] from='client.212550 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:19:00.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:19:00 smithi047 bash[22744]: cluster 2024-09-16T09:18:59.170994+0000 mgr.a (mgr.14373) 9597 : cluster [DBG] pgmap v6655: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:19:02.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:19:02 smithi157 bash[24585]: cluster 2024-09-16T09:19:01.171785+0000 mgr.a (mgr.14373) 9598 : cluster [DBG] pgmap v6656: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:19:02.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:19:02 smithi086 bash[24289]: cluster 2024-09-16T09:19:01.171785+0000 mgr.a (mgr.14373) 9598 : cluster [DBG] pgmap v6656: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:19:02.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:19:02 smithi047 bash[22744]: cluster 2024-09-16T09:19:01.171785+0000 mgr.a (mgr.14373) 9598 : cluster [DBG] pgmap v6656: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:19:04.075 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:19:04.075 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:19:04.075 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:19:04.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:19:04 smithi157 bash[24585]: cluster 2024-09-16T09:19:03.174046+0000 mgr.a (mgr.14373) 9599 : cluster [DBG] pgmap v6657: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:19:04.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:19:04 smithi086 bash[24289]: cluster 2024-09-16T09:19:03.174046+0000 mgr.a (mgr.14373) 9599 : cluster [DBG] pgmap v6657: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:19:04.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:19:04 smithi047 bash[22744]: cluster 2024-09-16T09:19:03.174046+0000 mgr.a (mgr.14373) 9599 : cluster [DBG] pgmap v6657: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:19:04.866 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:19:04.866 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:19:04.866 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:19:04.866 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:19:04.866 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:19:06.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:19:06 smithi157 bash[24585]: audit 2024-09-16T09:19:04.415413+0000 mgr.a (mgr.14373) 9600 : audit [DBG] from='client.212625 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:19:06.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:19:06 smithi157 bash[24585]: cluster 2024-09-16T09:19:05.174934+0000 mgr.a (mgr.14373) 9601 : cluster [DBG] pgmap v6658: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:19:06.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:19:06 smithi086 bash[24289]: audit 2024-09-16T09:19:04.415413+0000 mgr.a (mgr.14373) 9600 : audit [DBG] from='client.212625 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:19:06.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:19:06 smithi086 bash[24289]: cluster 2024-09-16T09:19:05.174934+0000 mgr.a (mgr.14373) 9601 : cluster [DBG] pgmap v6658: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:19:06.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:19:06 smithi047 bash[22744]: audit 2024-09-16T09:19:04.415413+0000 mgr.a (mgr.14373) 9600 : audit [DBG] from='client.212625 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:19:06.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:19:06 smithi047 bash[22744]: cluster 2024-09-16T09:19:05.174934+0000 mgr.a (mgr.14373) 9601 : cluster [DBG] pgmap v6658: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:19:08.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:19:08 smithi157 bash[24585]: cluster 2024-09-16T09:19:07.177061+0000 mgr.a (mgr.14373) 9602 : cluster [DBG] pgmap v6659: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 3.2 KiB/s rd, 2 op/s 2024-09-16T09:19:08.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:19:08 smithi086 bash[24289]: cluster 2024-09-16T09:19:07.177061+0000 mgr.a (mgr.14373) 9602 : cluster [DBG] pgmap v6659: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 3.2 KiB/s rd, 2 op/s 2024-09-16T09:19:08.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:19:08 smithi047 bash[22744]: cluster 2024-09-16T09:19:07.177061+0000 mgr.a (mgr.14373) 9602 : cluster [DBG] pgmap v6659: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 3.2 KiB/s rd, 2 op/s 2024-09-16T09:19:09.867 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:19:09.868 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:19:09.868 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:19:10.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:19:10 smithi157 bash[24585]: cluster 2024-09-16T09:19:09.177786+0000 mgr.a (mgr.14373) 9603 : cluster [DBG] pgmap v6660: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-16T09:19:10.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:19:10 smithi086 bash[24289]: cluster 2024-09-16T09:19:09.177786+0000 mgr.a (mgr.14373) 9603 : cluster [DBG] pgmap v6660: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-16T09:19:10.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:19:10 smithi047 bash[22744]: cluster 2024-09-16T09:19:09.177786+0000 mgr.a (mgr.14373) 9603 : cluster [DBG] pgmap v6660: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-16T09:19:10.640 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:19:10.640 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:19:10.640 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:19:10.640 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:19:10.640 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:19:11.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:19:11 smithi157 bash[24585]: audit 2024-09-16T09:19:10.200450+0000 mgr.a (mgr.14373) 9604 : audit [DBG] from='client.212703 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:19:11.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:19:11 smithi086 bash[24289]: audit 2024-09-16T09:19:10.200450+0000 mgr.a (mgr.14373) 9604 : audit [DBG] from='client.212703 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:19:11.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:19:11 smithi047 bash[22744]: audit 2024-09-16T09:19:10.200450+0000 mgr.a (mgr.14373) 9604 : audit [DBG] from='client.212703 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:19:12.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:19:12 smithi157 bash[24585]: cluster 2024-09-16T09:19:11.178703+0000 mgr.a (mgr.14373) 9605 : cluster [DBG] pgmap v6661: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-16T09:19:12.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:19:12 smithi086 bash[24289]: cluster 2024-09-16T09:19:11.178703+0000 mgr.a (mgr.14373) 9605 : cluster [DBG] pgmap v6661: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-16T09:19:12.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:19:12 smithi047 bash[22744]: cluster 2024-09-16T09:19:11.178703+0000 mgr.a (mgr.14373) 9605 : cluster [DBG] pgmap v6661: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-16T09:19:14.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:19:14 smithi157 bash[24585]: cluster 2024-09-16T09:19:13.180928+0000 mgr.a (mgr.14373) 9606 : cluster [DBG] pgmap v6662: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 3.2 KiB/s rd, 2 op/s 2024-09-16T09:19:14.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:19:14 smithi086 bash[24289]: cluster 2024-09-16T09:19:13.180928+0000 mgr.a (mgr.14373) 9606 : cluster [DBG] pgmap v6662: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 3.2 KiB/s rd, 2 op/s 2024-09-16T09:19:14.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:19:14 smithi047 bash[22744]: cluster 2024-09-16T09:19:13.180928+0000 mgr.a (mgr.14373) 9606 : cluster [DBG] pgmap v6662: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 3.2 KiB/s rd, 2 op/s 2024-09-16T09:19:15.641 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:19:15.642 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:19:15.642 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:19:16.409 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:19:16.409 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:19:16.409 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:19:16.409 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:19:16.409 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:19:16.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:19:16 smithi157 bash[24585]: cluster 2024-09-16T09:19:15.181677+0000 mgr.a (mgr.14373) 9607 : cluster [DBG] pgmap v6663: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-16T09:19:16.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:19:16 smithi086 bash[24289]: cluster 2024-09-16T09:19:15.181677+0000 mgr.a (mgr.14373) 9607 : cluster [DBG] pgmap v6663: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-16T09:19:16.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:19:16 smithi047 bash[22744]: cluster 2024-09-16T09:19:15.181677+0000 mgr.a (mgr.14373) 9607 : cluster [DBG] pgmap v6663: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-16T09:19:17.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:19:17 smithi157 bash[24585]: audit 2024-09-16T09:19:15.967401+0000 mgr.a (mgr.14373) 9608 : audit [DBG] from='client.212781 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:19:17.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:19:17 smithi086 bash[24289]: audit 2024-09-16T09:19:15.967401+0000 mgr.a (mgr.14373) 9608 : audit [DBG] from='client.212781 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:19:17.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:19:17 smithi047 bash[22744]: audit 2024-09-16T09:19:15.967401+0000 mgr.a (mgr.14373) 9608 : audit [DBG] from='client.212781 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:19:18.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:19:18 smithi157 bash[24585]: cluster 2024-09-16T09:19:17.183961+0000 mgr.a (mgr.14373) 9609 : cluster [DBG] pgmap v6664: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 3.2 KiB/s rd, 2 op/s 2024-09-16T09:19:18.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:19:18 smithi086 bash[24289]: cluster 2024-09-16T09:19:17.183961+0000 mgr.a (mgr.14373) 9609 : cluster [DBG] pgmap v6664: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 3.2 KiB/s rd, 2 op/s 2024-09-16T09:19:18.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:19:18 smithi047 bash[22744]: cluster 2024-09-16T09:19:17.183961+0000 mgr.a (mgr.14373) 9609 : cluster [DBG] pgmap v6664: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 3.2 KiB/s rd, 2 op/s 2024-09-16T09:19:20.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:19:20 smithi157 bash[24585]: cluster 2024-09-16T09:19:19.184744+0000 mgr.a (mgr.14373) 9610 : cluster [DBG] pgmap v6665: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:19:20.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:19:20 smithi086 bash[24289]: cluster 2024-09-16T09:19:19.184744+0000 mgr.a (mgr.14373) 9610 : cluster [DBG] pgmap v6665: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:19:20.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:19:20 smithi047 bash[22744]: cluster 2024-09-16T09:19:19.184744+0000 mgr.a (mgr.14373) 9610 : cluster [DBG] pgmap v6665: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:19:21.410 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:19:21.411 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:19:21.411 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:19:22.189 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:19:22.190 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:19:22.190 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:19:22.190 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:19:22.190 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:19:22.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:19:22 smithi157 bash[24585]: cluster 2024-09-16T09:19:21.185489+0000 mgr.a (mgr.14373) 9611 : cluster [DBG] pgmap v6666: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:19:22.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:19:22 smithi086 bash[24289]: cluster 2024-09-16T09:19:21.185489+0000 mgr.a (mgr.14373) 9611 : cluster [DBG] pgmap v6666: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:19:22.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:19:22 smithi047 bash[22744]: cluster 2024-09-16T09:19:21.185489+0000 mgr.a (mgr.14373) 9611 : cluster [DBG] pgmap v6666: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:19:23.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:19:23 smithi157 bash[24585]: audit 2024-09-16T09:19:21.743884+0000 mgr.a (mgr.14373) 9612 : audit [DBG] from='client.212856 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:19:23.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:19:23 smithi086 bash[24289]: audit 2024-09-16T09:19:21.743884+0000 mgr.a (mgr.14373) 9612 : audit [DBG] from='client.212856 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:19:23.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:19:23 smithi047 bash[22744]: audit 2024-09-16T09:19:21.743884+0000 mgr.a (mgr.14373) 9612 : audit [DBG] from='client.212856 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:19:24.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:19:24 smithi086 bash[24289]: cluster 2024-09-16T09:19:23.188216+0000 mgr.a (mgr.14373) 9613 : cluster [DBG] pgmap v6667: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:19:24.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:19:24 smithi047 bash[22744]: cluster 2024-09-16T09:19:23.188216+0000 mgr.a (mgr.14373) 9613 : cluster [DBG] pgmap v6667: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:19:24.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:19:24 smithi157 bash[24585]: cluster 2024-09-16T09:19:23.188216+0000 mgr.a (mgr.14373) 9613 : cluster [DBG] pgmap v6667: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:19:26.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:19:26 smithi086 bash[24289]: cluster 2024-09-16T09:19:25.188980+0000 mgr.a (mgr.14373) 9614 : cluster [DBG] pgmap v6668: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:19:26.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:19:26 smithi086 bash[24289]: audit 2024-09-16T09:19:25.922067+0000 mon.b (mon.2) 894 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T09:19:26.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:19:26 smithi047 bash[22744]: cluster 2024-09-16T09:19:25.188980+0000 mgr.a (mgr.14373) 9614 : cluster [DBG] pgmap v6668: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:19:26.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:19:26 smithi047 bash[22744]: audit 2024-09-16T09:19:25.922067+0000 mon.b (mon.2) 894 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T09:19:26.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:19:26 smithi157 bash[24585]: cluster 2024-09-16T09:19:25.188980+0000 mgr.a (mgr.14373) 9614 : cluster [DBG] pgmap v6668: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:19:26.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:19:26 smithi157 bash[24585]: audit 2024-09-16T09:19:25.922067+0000 mon.b (mon.2) 894 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T09:19:27.191 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:19:27.192 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:19:27.192 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:19:27.926 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:19:27.926 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:19:27.926 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:19:27.926 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:19:27.926 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:19:28.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:19:28 smithi086 bash[24289]: cluster 2024-09-16T09:19:27.191063+0000 mgr.a (mgr.14373) 9615 : cluster [DBG] pgmap v6669: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:19:28.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:19:28 smithi047 bash[22744]: cluster 2024-09-16T09:19:27.191063+0000 mgr.a (mgr.14373) 9615 : cluster [DBG] pgmap v6669: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:19:28.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:19:28 smithi157 bash[24585]: cluster 2024-09-16T09:19:27.191063+0000 mgr.a (mgr.14373) 9615 : cluster [DBG] pgmap v6669: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:19:29.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:19:29 smithi047 bash[22744]: audit 2024-09-16T09:19:27.517668+0000 mgr.a (mgr.14373) 9616 : audit [DBG] from='client.212931 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:19:29.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:19:29 smithi157 bash[24585]: audit 2024-09-16T09:19:27.517668+0000 mgr.a (mgr.14373) 9616 : audit [DBG] from='client.212931 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:19:29.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:19:29 smithi086 bash[24289]: audit 2024-09-16T09:19:27.517668+0000 mgr.a (mgr.14373) 9616 : audit [DBG] from='client.212931 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:19:30.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:19:30 smithi047 bash[22744]: cluster 2024-09-16T09:19:29.191978+0000 mgr.a (mgr.14373) 9617 : cluster [DBG] pgmap v6670: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:19:30.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:19:30 smithi157 bash[24585]: cluster 2024-09-16T09:19:29.191978+0000 mgr.a (mgr.14373) 9617 : cluster [DBG] pgmap v6670: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:19:30.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:19:30 smithi086 bash[24289]: cluster 2024-09-16T09:19:29.191978+0000 mgr.a (mgr.14373) 9617 : cluster [DBG] pgmap v6670: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:19:32.555 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:19:32 smithi157 bash[24585]: cluster 2024-09-16T09:19:31.192461+0000 mgr.a (mgr.14373) 9618 : cluster [DBG] pgmap v6671: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T09:19:32.555 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:19:32 smithi157 bash[24585]: audit 2024-09-16T09:19:31.283103+0000 mon.a (mon.0) 1141 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:19:32.555 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:19:32 smithi157 bash[24585]: audit 2024-09-16T09:19:31.289877+0000 mon.a (mon.0) 1142 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:19:32.555 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:19:32 smithi157 bash[24585]: audit 2024-09-16T09:19:31.310246+0000 mon.a (mon.0) 1143 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:19:32.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:19:32 smithi157 bash[24585]: audit 2024-09-16T09:19:31.315636+0000 mon.a (mon.0) 1144 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:19:32.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:19:32 smithi157 bash[24585]: audit 2024-09-16T09:19:31.322828+0000 mon.a (mon.0) 1145 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:19:32.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:19:32 smithi157 bash[24585]: audit 2024-09-16T09:19:31.329013+0000 mon.a (mon.0) 1146 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:19:32.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:19:32 smithi157 bash[24585]: audit 2024-09-16T09:19:32.066985+0000 mon.b (mon.2) 895 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:19:32.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:19:32 smithi157 bash[24585]: audit 2024-09-16T09:19:32.069212+0000 mon.b (mon.2) 896 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T09:19:32.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:19:32 smithi157 bash[24585]: audit 2024-09-16T09:19:32.078220+0000 mon.a (mon.0) 1147 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:19:32.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:19:32 smithi157 bash[24585]: audit 2024-09-16T09:19:32.084188+0000 mon.b (mon.2) 897 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:19:32.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:19:32 smithi086 bash[24289]: cluster 2024-09-16T09:19:31.192461+0000 mgr.a (mgr.14373) 9618 : cluster [DBG] pgmap v6671: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T09:19:32.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:19:32 smithi086 bash[24289]: audit 2024-09-16T09:19:31.283103+0000 mon.a (mon.0) 1141 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:19:32.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:19:32 smithi086 bash[24289]: audit 2024-09-16T09:19:31.289877+0000 mon.a (mon.0) 1142 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:19:32.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:19:32 smithi086 bash[24289]: audit 2024-09-16T09:19:31.310246+0000 mon.a (mon.0) 1143 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:19:32.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:19:32 smithi086 bash[24289]: audit 2024-09-16T09:19:31.315636+0000 mon.a (mon.0) 1144 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:19:32.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:19:32 smithi086 bash[24289]: audit 2024-09-16T09:19:31.322828+0000 mon.a (mon.0) 1145 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:19:32.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:19:32 smithi086 bash[24289]: audit 2024-09-16T09:19:31.329013+0000 mon.a (mon.0) 1146 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:19:32.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:19:32 smithi086 bash[24289]: audit 2024-09-16T09:19:32.066985+0000 mon.b (mon.2) 895 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:19:32.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:19:32 smithi086 bash[24289]: audit 2024-09-16T09:19:32.069212+0000 mon.b (mon.2) 896 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T09:19:32.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:19:32 smithi086 bash[24289]: audit 2024-09-16T09:19:32.078220+0000 mon.a (mon.0) 1147 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:19:32.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:19:32 smithi086 bash[24289]: audit 2024-09-16T09:19:32.084188+0000 mon.b (mon.2) 897 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:19:32.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:19:32 smithi047 bash[22744]: cluster 2024-09-16T09:19:31.192461+0000 mgr.a (mgr.14373) 9618 : cluster [DBG] pgmap v6671: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T09:19:32.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:19:32 smithi047 bash[22744]: audit 2024-09-16T09:19:31.283103+0000 mon.a (mon.0) 1141 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:19:32.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:19:32 smithi047 bash[22744]: audit 2024-09-16T09:19:31.289877+0000 mon.a (mon.0) 1142 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:19:32.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:19:32 smithi047 bash[22744]: audit 2024-09-16T09:19:31.310246+0000 mon.a (mon.0) 1143 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:19:32.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:19:32 smithi047 bash[22744]: audit 2024-09-16T09:19:31.315636+0000 mon.a (mon.0) 1144 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:19:32.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:19:32 smithi047 bash[22744]: audit 2024-09-16T09:19:31.322828+0000 mon.a (mon.0) 1145 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:19:32.594 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:19:32 smithi047 bash[22744]: audit 2024-09-16T09:19:31.329013+0000 mon.a (mon.0) 1146 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:19:32.594 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:19:32 smithi047 bash[22744]: audit 2024-09-16T09:19:32.066985+0000 mon.b (mon.2) 895 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:19:32.594 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:19:32 smithi047 bash[22744]: audit 2024-09-16T09:19:32.069212+0000 mon.b (mon.2) 896 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T09:19:32.594 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:19:32 smithi047 bash[22744]: audit 2024-09-16T09:19:32.078220+0000 mon.a (mon.0) 1147 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:19:32.594 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:19:32 smithi047 bash[22744]: audit 2024-09-16T09:19:32.084188+0000 mon.b (mon.2) 897 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:19:32.927 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:19:32.927 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:19:32.928 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:19:33.093 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 09:19:32 smithi047 bash[22994]: debug 2024-09-16T09:19:32.818+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T09:19:33.093 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 09:19:32 smithi047 bash[22994]: debug 2024-09-16T09:19:32.822+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T09:19:33.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:19:33 smithi157 bash[24585]: audit 2024-09-16T09:19:32.083175+0000 mgr.a (mgr.14373) 9619 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:19:33.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:19:33 smithi086 bash[24289]: audit 2024-09-16T09:19:32.083175+0000 mgr.a (mgr.14373) 9619 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:19:33.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:19:33 smithi047 bash[22744]: audit 2024-09-16T09:19:32.083175+0000 mgr.a (mgr.14373) 9619 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:19:33.671 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:19:33.672 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:19:33.672 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:19:33.672 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:19:33.672 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:19:34.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:19:34 smithi157 bash[24585]: audit 2024-09-16T09:19:32.821597+0000 mgr.a (mgr.14373) 9620 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T09:19:34.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:19:34 smithi157 bash[24585]: cephadm 2024-09-16T09:19:32.823620+0000 mgr.a (mgr.14373) 9621 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T09:19:34.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:19:34 smithi157 bash[24585]: cluster 2024-09-16T09:19:33.195004+0000 mgr.a (mgr.14373) 9622 : cluster [DBG] pgmap v6672: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:19:34.555 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:19:34 smithi157 bash[24585]: audit 2024-09-16T09:19:33.253712+0000 mgr.a (mgr.14373) 9623 : audit [DBG] from='client.213114 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:19:34.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:19:34 smithi086 bash[24289]: audit 2024-09-16T09:19:32.821597+0000 mgr.a (mgr.14373) 9620 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T09:19:34.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:19:34 smithi086 bash[24289]: cephadm 2024-09-16T09:19:32.823620+0000 mgr.a (mgr.14373) 9621 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T09:19:34.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:19:34 smithi086 bash[24289]: cluster 2024-09-16T09:19:33.195004+0000 mgr.a (mgr.14373) 9622 : cluster [DBG] pgmap v6672: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:19:34.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:19:34 smithi086 bash[24289]: audit 2024-09-16T09:19:33.253712+0000 mgr.a (mgr.14373) 9623 : audit [DBG] from='client.213114 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:19:34.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:19:34 smithi047 bash[22744]: audit 2024-09-16T09:19:32.821597+0000 mgr.a (mgr.14373) 9620 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T09:19:34.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:19:34 smithi047 bash[22744]: cephadm 2024-09-16T09:19:32.823620+0000 mgr.a (mgr.14373) 9621 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T09:19:34.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:19:34 smithi047 bash[22744]: cluster 2024-09-16T09:19:33.195004+0000 mgr.a (mgr.14373) 9622 : cluster [DBG] pgmap v6672: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:19:34.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:19:34 smithi047 bash[22744]: audit 2024-09-16T09:19:33.253712+0000 mgr.a (mgr.14373) 9623 : audit [DBG] from='client.213114 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:19:36.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:19:36 smithi157 bash[24585]: cluster 2024-09-16T09:19:35.195892+0000 mgr.a (mgr.14373) 9624 : cluster [DBG] pgmap v6673: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:19:36.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:19:36 smithi086 bash[24289]: cluster 2024-09-16T09:19:35.195892+0000 mgr.a (mgr.14373) 9624 : cluster [DBG] pgmap v6673: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:19:36.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:19:36 smithi047 bash[22744]: cluster 2024-09-16T09:19:35.195892+0000 mgr.a (mgr.14373) 9624 : cluster [DBG] pgmap v6673: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:19:38.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:19:38 smithi086 bash[24289]: cluster 2024-09-16T09:19:37.197992+0000 mgr.a (mgr.14373) 9625 : cluster [DBG] pgmap v6674: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:19:38.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:19:38 smithi047 bash[22744]: cluster 2024-09-16T09:19:37.197992+0000 mgr.a (mgr.14373) 9625 : cluster [DBG] pgmap v6674: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:19:38.672 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:19:38.673 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:19:38.674 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:19:38.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:19:38 smithi157 bash[24585]: cluster 2024-09-16T09:19:37.197992+0000 mgr.a (mgr.14373) 9625 : cluster [DBG] pgmap v6674: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:19:39.459 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:19:39.460 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:19:39.460 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:19:39.460 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:19:39.460 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:19:40.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:19:40 smithi086 bash[24289]: audit 2024-09-16T09:19:39.007701+0000 mgr.a (mgr.14373) 9626 : audit [DBG] from='client.213189 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:19:40.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:19:40 smithi086 bash[24289]: cluster 2024-09-16T09:19:39.198496+0000 mgr.a (mgr.14373) 9627 : cluster [DBG] pgmap v6675: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:19:40.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:19:40 smithi047 bash[22744]: audit 2024-09-16T09:19:39.007701+0000 mgr.a (mgr.14373) 9626 : audit [DBG] from='client.213189 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:19:40.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:19:40 smithi047 bash[22744]: cluster 2024-09-16T09:19:39.198496+0000 mgr.a (mgr.14373) 9627 : cluster [DBG] pgmap v6675: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:19:40.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:19:40 smithi157 bash[24585]: audit 2024-09-16T09:19:39.007701+0000 mgr.a (mgr.14373) 9626 : audit [DBG] from='client.213189 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:19:40.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:19:40 smithi157 bash[24585]: cluster 2024-09-16T09:19:39.198496+0000 mgr.a (mgr.14373) 9627 : cluster [DBG] pgmap v6675: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:19:42.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:19:42 smithi086 bash[24289]: cluster 2024-09-16T09:19:41.199410+0000 mgr.a (mgr.14373) 9628 : cluster [DBG] pgmap v6676: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:19:42.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:19:42 smithi047 bash[22744]: cluster 2024-09-16T09:19:41.199410+0000 mgr.a (mgr.14373) 9628 : cluster [DBG] pgmap v6676: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:19:42.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:19:42 smithi157 bash[24585]: cluster 2024-09-16T09:19:41.199410+0000 mgr.a (mgr.14373) 9628 : cluster [DBG] pgmap v6676: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:19:44.461 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:19:44.462 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:19:44.462 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:19:44.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:19:44 smithi086 bash[24289]: cluster 2024-09-16T09:19:43.201794+0000 mgr.a (mgr.14373) 9629 : cluster [DBG] pgmap v6677: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:19:44.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:19:44 smithi047 bash[22744]: cluster 2024-09-16T09:19:43.201794+0000 mgr.a (mgr.14373) 9629 : cluster [DBG] pgmap v6677: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:19:44.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:19:44 smithi157 bash[24585]: cluster 2024-09-16T09:19:43.201794+0000 mgr.a (mgr.14373) 9629 : cluster [DBG] pgmap v6677: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:19:45.241 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:19:45.242 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:19:45.242 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:19:45.242 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:19:45.242 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:19:46.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:19:46 smithi047 bash[22744]: audit 2024-09-16T09:19:44.793521+0000 mgr.a (mgr.14373) 9630 : audit [DBG] from='client.213267 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:19:46.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:19:46 smithi047 bash[22744]: cluster 2024-09-16T09:19:45.202330+0000 mgr.a (mgr.14373) 9631 : cluster [DBG] pgmap v6678: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:19:46.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:19:46 smithi157 bash[24585]: audit 2024-09-16T09:19:44.793521+0000 mgr.a (mgr.14373) 9630 : audit [DBG] from='client.213267 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:19:46.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:19:46 smithi157 bash[24585]: cluster 2024-09-16T09:19:45.202330+0000 mgr.a (mgr.14373) 9631 : cluster [DBG] pgmap v6678: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:19:46.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:19:46 smithi086 bash[24289]: audit 2024-09-16T09:19:44.793521+0000 mgr.a (mgr.14373) 9630 : audit [DBG] from='client.213267 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:19:46.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:19:46 smithi086 bash[24289]: cluster 2024-09-16T09:19:45.202330+0000 mgr.a (mgr.14373) 9631 : cluster [DBG] pgmap v6678: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:19:48.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:19:48 smithi047 bash[22744]: cluster 2024-09-16T09:19:47.204449+0000 mgr.a (mgr.14373) 9632 : cluster [DBG] pgmap v6679: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:19:48.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:19:48 smithi157 bash[24585]: cluster 2024-09-16T09:19:47.204449+0000 mgr.a (mgr.14373) 9632 : cluster [DBG] pgmap v6679: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:19:48.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:19:48 smithi086 bash[24289]: cluster 2024-09-16T09:19:47.204449+0000 mgr.a (mgr.14373) 9632 : cluster [DBG] pgmap v6679: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:19:50.242 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:19:50.243 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:19:50.243 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:19:50.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:19:50 smithi047 bash[22744]: cluster 2024-09-16T09:19:49.205203+0000 mgr.a (mgr.14373) 9633 : cluster [DBG] pgmap v6680: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:19:50.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:19:50 smithi157 bash[24585]: cluster 2024-09-16T09:19:49.205203+0000 mgr.a (mgr.14373) 9633 : cluster [DBG] pgmap v6680: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:19:50.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:19:50 smithi086 bash[24289]: cluster 2024-09-16T09:19:49.205203+0000 mgr.a (mgr.14373) 9633 : cluster [DBG] pgmap v6680: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:19:51.028 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:19:51.029 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:19:51.029 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:19:51.029 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:19:51.029 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:19:52.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:19:52 smithi047 bash[22744]: audit 2024-09-16T09:19:50.585185+0000 mgr.a (mgr.14373) 9634 : audit [DBG] from='client.213345 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:19:52.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:19:52 smithi047 bash[22744]: cluster 2024-09-16T09:19:51.206141+0000 mgr.a (mgr.14373) 9635 : cluster [DBG] pgmap v6681: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:19:52.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:19:52 smithi157 bash[24585]: audit 2024-09-16T09:19:50.585185+0000 mgr.a (mgr.14373) 9634 : audit [DBG] from='client.213345 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:19:52.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:19:52 smithi157 bash[24585]: cluster 2024-09-16T09:19:51.206141+0000 mgr.a (mgr.14373) 9635 : cluster [DBG] pgmap v6681: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:19:52.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:19:52 smithi086 bash[24289]: audit 2024-09-16T09:19:50.585185+0000 mgr.a (mgr.14373) 9634 : audit [DBG] from='client.213345 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:19:52.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:19:52 smithi086 bash[24289]: cluster 2024-09-16T09:19:51.206141+0000 mgr.a (mgr.14373) 9635 : cluster [DBG] pgmap v6681: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:19:54.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:19:54 smithi047 bash[22744]: cluster 2024-09-16T09:19:53.208387+0000 mgr.a (mgr.14373) 9636 : cluster [DBG] pgmap v6682: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:19:54.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:19:54 smithi157 bash[24585]: cluster 2024-09-16T09:19:53.208387+0000 mgr.a (mgr.14373) 9636 : cluster [DBG] pgmap v6682: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:19:54.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:19:54 smithi086 bash[24289]: cluster 2024-09-16T09:19:53.208387+0000 mgr.a (mgr.14373) 9636 : cluster [DBG] pgmap v6682: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:19:56.030 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:19:56.031 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:19:56.031 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:19:56.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:19:56 smithi047 bash[22744]: cluster 2024-09-16T09:19:55.209185+0000 mgr.a (mgr.14373) 9637 : cluster [DBG] pgmap v6683: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:19:56.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:19:56 smithi157 bash[24585]: cluster 2024-09-16T09:19:55.209185+0000 mgr.a (mgr.14373) 9637 : cluster [DBG] pgmap v6683: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:19:56.805 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:19:56.805 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:19:56.806 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:19:56.806 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:19:56.806 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:19:56.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:19:56 smithi086 bash[24289]: cluster 2024-09-16T09:19:55.209185+0000 mgr.a (mgr.14373) 9637 : cluster [DBG] pgmap v6683: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:19:58.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:19:58 smithi157 bash[24585]: audit 2024-09-16T09:19:56.366318+0000 mgr.a (mgr.14373) 9638 : audit [DBG] from='client.213420 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:19:58.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:19:58 smithi157 bash[24585]: cluster 2024-09-16T09:19:57.212057+0000 mgr.a (mgr.14373) 9639 : cluster [DBG] pgmap v6684: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:19:58.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:19:58 smithi086 bash[24289]: audit 2024-09-16T09:19:56.366318+0000 mgr.a (mgr.14373) 9638 : audit [DBG] from='client.213420 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:19:58.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:19:58 smithi086 bash[24289]: cluster 2024-09-16T09:19:57.212057+0000 mgr.a (mgr.14373) 9639 : cluster [DBG] pgmap v6684: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:19:58.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:19:58 smithi047 bash[22744]: audit 2024-09-16T09:19:56.366318+0000 mgr.a (mgr.14373) 9638 : audit [DBG] from='client.213420 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:19:58.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:19:58 smithi047 bash[22744]: cluster 2024-09-16T09:19:57.212057+0000 mgr.a (mgr.14373) 9639 : cluster [DBG] pgmap v6684: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:20:00.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:20:00 smithi157 bash[24585]: cluster 2024-09-16T09:19:59.212874+0000 mgr.a (mgr.14373) 9640 : cluster [DBG] pgmap v6685: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:20:00.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:20:00 smithi157 bash[24585]: cluster 2024-09-16T09:20:00.000127+0000 mon.a (mon.0) 1148 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-16T09:20:00.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:20:00 smithi086 bash[24289]: cluster 2024-09-16T09:19:59.212874+0000 mgr.a (mgr.14373) 9640 : cluster [DBG] pgmap v6685: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:20:00.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:20:00 smithi086 bash[24289]: cluster 2024-09-16T09:20:00.000127+0000 mon.a (mon.0) 1148 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-16T09:20:00.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:20:00 smithi047 bash[22744]: cluster 2024-09-16T09:19:59.212874+0000 mgr.a (mgr.14373) 9640 : cluster [DBG] pgmap v6685: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:20:00.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:20:00 smithi047 bash[22744]: cluster 2024-09-16T09:20:00.000127+0000 mon.a (mon.0) 1148 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-16T09:20:01.807 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:20:01.808 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:20:01.808 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:20:02.597 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:20:02.598 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:20:02.598 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:20:02.598 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:20:02.598 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:20:02.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:20:02 smithi157 bash[24585]: cluster 2024-09-16T09:20:01.213646+0000 mgr.a (mgr.14373) 9641 : cluster [DBG] pgmap v6686: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T09:20:02.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:20:02 smithi086 bash[24289]: cluster 2024-09-16T09:20:01.213646+0000 mgr.a (mgr.14373) 9641 : cluster [DBG] pgmap v6686: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T09:20:02.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:20:02 smithi047 bash[22744]: cluster 2024-09-16T09:20:01.213646+0000 mgr.a (mgr.14373) 9641 : cluster [DBG] pgmap v6686: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T09:20:03.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:20:03 smithi157 bash[24585]: audit 2024-09-16T09:20:02.147518+0000 mgr.a (mgr.14373) 9642 : audit [DBG] from='client.213498 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:20:03.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:20:03 smithi086 bash[24289]: audit 2024-09-16T09:20:02.147518+0000 mgr.a (mgr.14373) 9642 : audit [DBG] from='client.213498 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:20:03.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:20:03 smithi047 bash[22744]: audit 2024-09-16T09:20:02.147518+0000 mgr.a (mgr.14373) 9642 : audit [DBG] from='client.213498 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:20:04.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:20:04 smithi157 bash[24585]: cluster 2024-09-16T09:20:03.216526+0000 mgr.a (mgr.14373) 9643 : cluster [DBG] pgmap v6687: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:20:04.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:20:04 smithi086 bash[24289]: cluster 2024-09-16T09:20:03.216526+0000 mgr.a (mgr.14373) 9643 : cluster [DBG] pgmap v6687: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:20:04.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:20:04 smithi047 bash[22744]: cluster 2024-09-16T09:20:03.216526+0000 mgr.a (mgr.14373) 9643 : cluster [DBG] pgmap v6687: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:20:05.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:20:05 smithi157 bash[24585]: cluster 2024-09-16T09:20:05.217324+0000 mgr.a (mgr.14373) 9644 : cluster [DBG] pgmap v6688: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:20:05.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:20:05 smithi086 bash[24289]: cluster 2024-09-16T09:20:05.217324+0000 mgr.a (mgr.14373) 9644 : cluster [DBG] pgmap v6688: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:20:05.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:20:05 smithi047 bash[22744]: cluster 2024-09-16T09:20:05.217324+0000 mgr.a (mgr.14373) 9644 : cluster [DBG] pgmap v6688: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:20:07.599 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:20:07.600 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:20:07.600 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:20:08.380 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:20:08.380 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:20:08.380 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:20:08.381 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:20:08.381 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:20:08.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:20:08 smithi157 bash[24585]: cluster 2024-09-16T09:20:07.219310+0000 mgr.a (mgr.14373) 9645 : cluster [DBG] pgmap v6689: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:20:08.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:20:08 smithi086 bash[24289]: cluster 2024-09-16T09:20:07.219310+0000 mgr.a (mgr.14373) 9645 : cluster [DBG] pgmap v6689: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:20:08.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:20:08 smithi047 bash[22744]: cluster 2024-09-16T09:20:07.219310+0000 mgr.a (mgr.14373) 9645 : cluster [DBG] pgmap v6689: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:20:09.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:20:09 smithi157 bash[24585]: audit 2024-09-16T09:20:07.930966+0000 mgr.a (mgr.14373) 9646 : audit [DBG] from='client.213576 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:20:09.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:20:09 smithi086 bash[24289]: audit 2024-09-16T09:20:07.930966+0000 mgr.a (mgr.14373) 9646 : audit [DBG] from='client.213576 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:20:09.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:20:09 smithi047 bash[22744]: audit 2024-09-16T09:20:07.930966+0000 mgr.a (mgr.14373) 9646 : audit [DBG] from='client.213576 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:20:10.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:20:10 smithi157 bash[24585]: cluster 2024-09-16T09:20:09.220263+0000 mgr.a (mgr.14373) 9647 : cluster [DBG] pgmap v6690: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:20:10.617 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:20:10 smithi047 bash[22744]: cluster 2024-09-16T09:20:09.220263+0000 mgr.a (mgr.14373) 9647 : cluster [DBG] pgmap v6690: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:20:10.617 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:20:10 smithi086 bash[24289]: cluster 2024-09-16T09:20:09.220263+0000 mgr.a (mgr.14373) 9647 : cluster [DBG] pgmap v6690: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:20:12.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:20:12 smithi157 bash[24585]: cluster 2024-09-16T09:20:11.221034+0000 mgr.a (mgr.14373) 9648 : cluster [DBG] pgmap v6691: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:20:12.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:20:12 smithi086 bash[24289]: cluster 2024-09-16T09:20:11.221034+0000 mgr.a (mgr.14373) 9648 : cluster [DBG] pgmap v6691: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:20:12.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:20:12 smithi047 bash[22744]: cluster 2024-09-16T09:20:11.221034+0000 mgr.a (mgr.14373) 9648 : cluster [DBG] pgmap v6691: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:20:13.381 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:20:13.382 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:20:13.383 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:20:14.138 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:20:14.139 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:20:14.139 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:20:14.139 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:20:14.139 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:20:14.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:20:14 smithi157 bash[24585]: cluster 2024-09-16T09:20:13.223276+0000 mgr.a (mgr.14373) 9649 : cluster [DBG] pgmap v6692: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:20:14.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:20:14 smithi086 bash[24289]: cluster 2024-09-16T09:20:13.223276+0000 mgr.a (mgr.14373) 9649 : cluster [DBG] pgmap v6692: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:20:14.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:20:14 smithi047 bash[22744]: cluster 2024-09-16T09:20:13.223276+0000 mgr.a (mgr.14373) 9649 : cluster [DBG] pgmap v6692: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:20:15.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:20:15 smithi086 bash[24289]: audit 2024-09-16T09:20:13.711738+0000 mgr.a (mgr.14373) 9650 : audit [DBG] from='client.213648 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:20:15.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:20:15 smithi047 bash[22744]: audit 2024-09-16T09:20:13.711738+0000 mgr.a (mgr.14373) 9650 : audit [DBG] from='client.213648 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:20:15.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:20:15 smithi157 bash[24585]: audit 2024-09-16T09:20:13.711738+0000 mgr.a (mgr.14373) 9650 : audit [DBG] from='client.213648 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:20:16.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:20:16 smithi086 bash[24289]: cluster 2024-09-16T09:20:15.224273+0000 mgr.a (mgr.14373) 9651 : cluster [DBG] pgmap v6693: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:20:16.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:20:16 smithi047 bash[22744]: cluster 2024-09-16T09:20:15.224273+0000 mgr.a (mgr.14373) 9651 : cluster [DBG] pgmap v6693: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:20:16.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:20:16 smithi157 bash[24585]: cluster 2024-09-16T09:20:15.224273+0000 mgr.a (mgr.14373) 9651 : cluster [DBG] pgmap v6693: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:20:18.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:20:18 smithi086 bash[24289]: cluster 2024-09-16T09:20:17.226460+0000 mgr.a (mgr.14373) 9652 : cluster [DBG] pgmap v6694: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:20:18.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:20:18 smithi047 bash[22744]: cluster 2024-09-16T09:20:17.226460+0000 mgr.a (mgr.14373) 9652 : cluster [DBG] pgmap v6694: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:20:18.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:20:18 smithi157 bash[24585]: cluster 2024-09-16T09:20:17.226460+0000 mgr.a (mgr.14373) 9652 : cluster [DBG] pgmap v6694: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:20:19.140 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:20:19.141 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:20:19.141 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:20:19.910 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:20:19.911 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:20:19.911 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:20:19.911 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:20:19.911 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:20:20.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:20:20 smithi086 bash[24289]: cluster 2024-09-16T09:20:19.227088+0000 mgr.a (mgr.14373) 9653 : cluster [DBG] pgmap v6695: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:20:20.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:20:20 smithi047 bash[22744]: cluster 2024-09-16T09:20:19.227088+0000 mgr.a (mgr.14373) 9653 : cluster [DBG] pgmap v6695: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:20:20.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:20:20 smithi157 bash[24585]: cluster 2024-09-16T09:20:19.227088+0000 mgr.a (mgr.14373) 9653 : cluster [DBG] pgmap v6695: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:20:21.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:20:21 smithi047 bash[22744]: audit 2024-09-16T09:20:19.479413+0000 mgr.a (mgr.14373) 9654 : audit [DBG] from='client.213723 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:20:21.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:20:21 smithi157 bash[24585]: audit 2024-09-16T09:20:19.479413+0000 mgr.a (mgr.14373) 9654 : audit [DBG] from='client.213723 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:20:21.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:20:21 smithi086 bash[24289]: audit 2024-09-16T09:20:19.479413+0000 mgr.a (mgr.14373) 9654 : audit [DBG] from='client.213723 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:20:22.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:20:22 smithi047 bash[22744]: cluster 2024-09-16T09:20:21.228012+0000 mgr.a (mgr.14373) 9655 : cluster [DBG] pgmap v6696: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:20:22.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:20:22 smithi157 bash[24585]: cluster 2024-09-16T09:20:21.228012+0000 mgr.a (mgr.14373) 9655 : cluster [DBG] pgmap v6696: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:20:22.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:20:22 smithi086 bash[24289]: cluster 2024-09-16T09:20:21.228012+0000 mgr.a (mgr.14373) 9655 : cluster [DBG] pgmap v6696: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:20:24.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:20:24 smithi047 bash[22744]: cluster 2024-09-16T09:20:23.230258+0000 mgr.a (mgr.14373) 9656 : cluster [DBG] pgmap v6697: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:20:24.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:20:24 smithi157 bash[24585]: cluster 2024-09-16T09:20:23.230258+0000 mgr.a (mgr.14373) 9656 : cluster [DBG] pgmap v6697: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:20:24.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:20:24 smithi086 bash[24289]: cluster 2024-09-16T09:20:23.230258+0000 mgr.a (mgr.14373) 9656 : cluster [DBG] pgmap v6697: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:20:24.912 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:20:24.913 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:20:24.913 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:20:25.686 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:20:25.687 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:20:25.687 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:20:25.687 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:20:25.687 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:20:26.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:20:26 smithi047 bash[22744]: cluster 2024-09-16T09:20:25.231039+0000 mgr.a (mgr.14373) 9657 : cluster [DBG] pgmap v6698: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:20:26.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:20:26 smithi047 bash[22744]: audit 2024-09-16T09:20:25.248296+0000 mgr.a (mgr.14373) 9658 : audit [DBG] from='client.213801 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:20:26.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:20:26 smithi157 bash[24585]: cluster 2024-09-16T09:20:25.231039+0000 mgr.a (mgr.14373) 9657 : cluster [DBG] pgmap v6698: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:20:26.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:20:26 smithi157 bash[24585]: audit 2024-09-16T09:20:25.248296+0000 mgr.a (mgr.14373) 9658 : audit [DBG] from='client.213801 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:20:26.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:20:26 smithi086 bash[24289]: cluster 2024-09-16T09:20:25.231039+0000 mgr.a (mgr.14373) 9657 : cluster [DBG] pgmap v6698: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:20:26.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:20:26 smithi086 bash[24289]: audit 2024-09-16T09:20:25.248296+0000 mgr.a (mgr.14373) 9658 : audit [DBG] from='client.213801 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:20:28.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:20:28 smithi047 bash[22744]: cluster 2024-09-16T09:20:27.233297+0000 mgr.a (mgr.14373) 9659 : cluster [DBG] pgmap v6699: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:20:28.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:20:28 smithi157 bash[24585]: cluster 2024-09-16T09:20:27.233297+0000 mgr.a (mgr.14373) 9659 : cluster [DBG] pgmap v6699: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:20:28.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:20:28 smithi086 bash[24289]: cluster 2024-09-16T09:20:27.233297+0000 mgr.a (mgr.14373) 9659 : cluster [DBG] pgmap v6699: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:20:30.688 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:20:30.689 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:20:30.689 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:20:30.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:20:30 smithi157 bash[24585]: cluster 2024-09-16T09:20:29.234071+0000 mgr.a (mgr.14373) 9660 : cluster [DBG] pgmap v6700: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:20:30.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:20:30 smithi086 bash[24289]: cluster 2024-09-16T09:20:29.234071+0000 mgr.a (mgr.14373) 9660 : cluster [DBG] pgmap v6700: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:20:30.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:20:30 smithi047 bash[22744]: cluster 2024-09-16T09:20:29.234071+0000 mgr.a (mgr.14373) 9660 : cluster [DBG] pgmap v6700: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:20:31.470 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:20:31.471 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:20:31.471 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:20:31.471 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:20:31.471 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:20:32.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:20:32 smithi157 bash[24585]: audit 2024-09-16T09:20:31.026008+0000 mgr.a (mgr.14373) 9661 : audit [DBG] from='client.213879 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:20:32.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:20:32 smithi157 bash[24585]: cluster 2024-09-16T09:20:31.234674+0000 mgr.a (mgr.14373) 9662 : cluster [DBG] pgmap v6701: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:20:32.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:20:32 smithi086 bash[24289]: audit 2024-09-16T09:20:31.026008+0000 mgr.a (mgr.14373) 9661 : audit [DBG] from='client.213879 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:20:32.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:20:32 smithi086 bash[24289]: cluster 2024-09-16T09:20:31.234674+0000 mgr.a (mgr.14373) 9662 : cluster [DBG] pgmap v6701: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:20:32.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:20:32 smithi047 bash[22744]: audit 2024-09-16T09:20:31.026008+0000 mgr.a (mgr.14373) 9661 : audit [DBG] from='client.213879 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:20:32.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:20:32 smithi047 bash[22744]: cluster 2024-09-16T09:20:31.234674+0000 mgr.a (mgr.14373) 9662 : cluster [DBG] pgmap v6701: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:20:33.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:20:33 smithi157 bash[24585]: audit 2024-09-16T09:20:32.880152+0000 mon.b (mon.2) 898 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T09:20:33.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:20:33 smithi086 bash[24289]: audit 2024-09-16T09:20:32.880152+0000 mon.b (mon.2) 898 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T09:20:33.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:20:33 smithi047 bash[22744]: audit 2024-09-16T09:20:32.880152+0000 mon.b (mon.2) 898 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T09:20:34.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:20:34 smithi157 bash[24585]: cluster 2024-09-16T09:20:33.236930+0000 mgr.a (mgr.14373) 9663 : cluster [DBG] pgmap v6702: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:20:34.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:20:34 smithi157 bash[24585]: audit 2024-09-16T09:20:33.711739+0000 mon.b (mon.2) 899 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:20:34.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:20:34 smithi157 bash[24585]: audit 2024-09-16T09:20:33.713716+0000 mon.b (mon.2) 900 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T09:20:34.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:20:34 smithi157 bash[24585]: audit 2024-09-16T09:20:33.722989+0000 mon.a (mon.0) 1149 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:20:34.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:20:34 smithi157 bash[24585]: audit 2024-09-16T09:20:33.745664+0000 mon.b (mon.2) 901 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:20:34.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:20:34 smithi086 bash[24289]: cluster 2024-09-16T09:20:33.236930+0000 mgr.a (mgr.14373) 9663 : cluster [DBG] pgmap v6702: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:20:34.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:20:34 smithi086 bash[24289]: audit 2024-09-16T09:20:33.711739+0000 mon.b (mon.2) 899 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:20:34.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:20:34 smithi086 bash[24289]: audit 2024-09-16T09:20:33.713716+0000 mon.b (mon.2) 900 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T09:20:34.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:20:34 smithi086 bash[24289]: audit 2024-09-16T09:20:33.722989+0000 mon.a (mon.0) 1149 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:20:34.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:20:34 smithi086 bash[24289]: audit 2024-09-16T09:20:33.745664+0000 mon.b (mon.2) 901 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:20:34.843 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 09:20:34 smithi047 bash[22994]: debug 2024-09-16T09:20:34.468+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T09:20:34.843 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 09:20:34 smithi047 bash[22994]: debug 2024-09-16T09:20:34.472+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T09:20:34.844 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:20:34 smithi047 bash[22744]: cluster 2024-09-16T09:20:33.236930+0000 mgr.a (mgr.14373) 9663 : cluster [DBG] pgmap v6702: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:20:34.844 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:20:34 smithi047 bash[22744]: audit 2024-09-16T09:20:33.711739+0000 mon.b (mon.2) 899 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:20:34.844 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:20:34 smithi047 bash[22744]: audit 2024-09-16T09:20:33.713716+0000 mon.b (mon.2) 900 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T09:20:34.844 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:20:34 smithi047 bash[22744]: audit 2024-09-16T09:20:33.722989+0000 mon.a (mon.0) 1149 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:20:34.844 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:20:34 smithi047 bash[22744]: audit 2024-09-16T09:20:33.745664+0000 mon.b (mon.2) 901 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:20:35.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:20:35 smithi157 bash[24585]: audit 2024-09-16T09:20:33.744947+0000 mgr.a (mgr.14373) 9664 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:20:35.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:20:35 smithi086 bash[24289]: audit 2024-09-16T09:20:33.744947+0000 mgr.a (mgr.14373) 9664 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:20:35.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:20:35 smithi047 bash[22744]: audit 2024-09-16T09:20:33.744947+0000 mgr.a (mgr.14373) 9664 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:20:36.472 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:20:36.473 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:20:36.473 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:20:36.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:20:36 smithi157 bash[24585]: audit 2024-09-16T09:20:34.474202+0000 mgr.a (mgr.14373) 9665 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T09:20:36.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:20:36 smithi157 bash[24585]: cephadm 2024-09-16T09:20:34.476315+0000 mgr.a (mgr.14373) 9666 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T09:20:36.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:20:36 smithi157 bash[24585]: cluster 2024-09-16T09:20:35.237920+0000 mgr.a (mgr.14373) 9667 : cluster [DBG] pgmap v6703: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:20:36.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:20:36 smithi086 bash[24289]: audit 2024-09-16T09:20:34.474202+0000 mgr.a (mgr.14373) 9665 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T09:20:36.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:20:36 smithi086 bash[24289]: cephadm 2024-09-16T09:20:34.476315+0000 mgr.a (mgr.14373) 9666 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T09:20:36.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:20:36 smithi086 bash[24289]: cluster 2024-09-16T09:20:35.237920+0000 mgr.a (mgr.14373) 9667 : cluster [DBG] pgmap v6703: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:20:36.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:20:36 smithi047 bash[22744]: audit 2024-09-16T09:20:34.474202+0000 mgr.a (mgr.14373) 9665 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T09:20:36.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:20:36 smithi047 bash[22744]: cephadm 2024-09-16T09:20:34.476315+0000 mgr.a (mgr.14373) 9666 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T09:20:36.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:20:36 smithi047 bash[22744]: cluster 2024-09-16T09:20:35.237920+0000 mgr.a (mgr.14373) 9667 : cluster [DBG] pgmap v6703: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:20:37.235 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:20:37.235 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:20:37.235 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:20:37.235 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:20:37.235 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:20:37.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:20:37 smithi157 bash[24585]: audit 2024-09-16T09:20:36.807215+0000 mgr.a (mgr.14373) 9668 : audit [DBG] from='client.214059 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:20:37.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:20:37 smithi157 bash[24585]: cluster 2024-09-16T09:20:37.239399+0000 mgr.a (mgr.14373) 9669 : cluster [DBG] pgmap v6704: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:20:37.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:20:37 smithi086 bash[24289]: audit 2024-09-16T09:20:36.807215+0000 mgr.a (mgr.14373) 9668 : audit [DBG] from='client.214059 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:20:37.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:20:37 smithi086 bash[24289]: cluster 2024-09-16T09:20:37.239399+0000 mgr.a (mgr.14373) 9669 : cluster [DBG] pgmap v6704: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:20:37.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:20:37 smithi047 bash[22744]: audit 2024-09-16T09:20:36.807215+0000 mgr.a (mgr.14373) 9668 : audit [DBG] from='client.214059 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:20:37.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:20:37 smithi047 bash[22744]: cluster 2024-09-16T09:20:37.239399+0000 mgr.a (mgr.14373) 9669 : cluster [DBG] pgmap v6704: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:20:40.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:20:40 smithi157 bash[24585]: cluster 2024-09-16T09:20:39.240142+0000 mgr.a (mgr.14373) 9670 : cluster [DBG] pgmap v6705: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T09:20:40.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:20:40 smithi086 bash[24289]: cluster 2024-09-16T09:20:39.240142+0000 mgr.a (mgr.14373) 9670 : cluster [DBG] pgmap v6705: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T09:20:40.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:20:40 smithi047 bash[22744]: cluster 2024-09-16T09:20:39.240142+0000 mgr.a (mgr.14373) 9670 : cluster [DBG] pgmap v6705: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T09:20:42.236 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:20:42.237 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:20:42.237 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:20:42.554 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:20:42 smithi157 bash[24585]: cluster 2024-09-16T09:20:41.240919+0000 mgr.a (mgr.14373) 9671 : cluster [DBG] pgmap v6706: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T09:20:42.568 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:20:42 smithi086 bash[24289]: cluster 2024-09-16T09:20:41.240919+0000 mgr.a (mgr.14373) 9671 : cluster [DBG] pgmap v6706: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T09:20:42.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:20:42 smithi047 bash[22744]: cluster 2024-09-16T09:20:41.240919+0000 mgr.a (mgr.14373) 9671 : cluster [DBG] pgmap v6706: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T09:20:43.027 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:20:43.027 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:20:43.027 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:20:43.027 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:20:43.027 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:20:44.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:20:44 smithi047 bash[22744]: audit 2024-09-16T09:20:42.576461+0000 mgr.a (mgr.14373) 9672 : audit [DBG] from='client.214137 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:20:44.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:20:44 smithi047 bash[22744]: cluster 2024-09-16T09:20:43.243768+0000 mgr.a (mgr.14373) 9673 : cluster [DBG] pgmap v6707: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:20:44.606 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:20:44 smithi086 bash[24289]: audit 2024-09-16T09:20:42.576461+0000 mgr.a (mgr.14373) 9672 : audit [DBG] from='client.214137 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:20:44.606 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:20:44 smithi086 bash[24289]: cluster 2024-09-16T09:20:43.243768+0000 mgr.a (mgr.14373) 9673 : cluster [DBG] pgmap v6707: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:20:44.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:20:44 smithi157 bash[24585]: audit 2024-09-16T09:20:42.576461+0000 mgr.a (mgr.14373) 9672 : audit [DBG] from='client.214137 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:20:44.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:20:44 smithi157 bash[24585]: cluster 2024-09-16T09:20:43.243768+0000 mgr.a (mgr.14373) 9673 : cluster [DBG] pgmap v6707: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:20:46.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:20:46 smithi086 bash[24289]: cluster 2024-09-16T09:20:45.244611+0000 mgr.a (mgr.14373) 9674 : cluster [DBG] pgmap v6708: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T09:20:46.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:20:46 smithi047 bash[22744]: cluster 2024-09-16T09:20:45.244611+0000 mgr.a (mgr.14373) 9674 : cluster [DBG] pgmap v6708: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T09:20:46.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:20:46 smithi157 bash[24585]: cluster 2024-09-16T09:20:45.244611+0000 mgr.a (mgr.14373) 9674 : cluster [DBG] pgmap v6708: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T09:20:48.028 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:20:48.029 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:20:48.029 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:20:48.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:20:48 smithi086 bash[24289]: cluster 2024-09-16T09:20:47.246597+0000 mgr.a (mgr.14373) 9675 : cluster [DBG] pgmap v6709: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:20:48.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:20:48 smithi047 bash[22744]: cluster 2024-09-16T09:20:47.246597+0000 mgr.a (mgr.14373) 9675 : cluster [DBG] pgmap v6709: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:20:48.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:20:48 smithi157 bash[24585]: cluster 2024-09-16T09:20:47.246597+0000 mgr.a (mgr.14373) 9675 : cluster [DBG] pgmap v6709: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:20:48.806 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:20:48.806 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:20:48.806 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:20:48.807 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:20:48.807 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:20:49.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:20:49 smithi047 bash[22744]: audit 2024-09-16T09:20:48.363580+0000 mgr.a (mgr.14373) 9676 : audit [DBG] from='client.214215 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:20:49.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:20:49 smithi157 bash[24585]: audit 2024-09-16T09:20:48.363580+0000 mgr.a (mgr.14373) 9676 : audit [DBG] from='client.214215 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:20:49.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:20:49 smithi086 bash[24289]: audit 2024-09-16T09:20:48.363580+0000 mgr.a (mgr.14373) 9676 : audit [DBG] from='client.214215 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:20:50.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:20:50 smithi047 bash[22744]: cluster 2024-09-16T09:20:49.247704+0000 mgr.a (mgr.14373) 9677 : cluster [DBG] pgmap v6710: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:20:50.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:20:50 smithi157 bash[24585]: cluster 2024-09-16T09:20:49.247704+0000 mgr.a (mgr.14373) 9677 : cluster [DBG] pgmap v6710: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:20:50.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:20:50 smithi086 bash[24289]: cluster 2024-09-16T09:20:49.247704+0000 mgr.a (mgr.14373) 9677 : cluster [DBG] pgmap v6710: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:20:52.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:20:52 smithi047 bash[22744]: cluster 2024-09-16T09:20:51.248705+0000 mgr.a (mgr.14373) 9678 : cluster [DBG] pgmap v6711: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:20:52.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:20:52 smithi157 bash[24585]: cluster 2024-09-16T09:20:51.248705+0000 mgr.a (mgr.14373) 9678 : cluster [DBG] pgmap v6711: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:20:52.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:20:52 smithi086 bash[24289]: cluster 2024-09-16T09:20:51.248705+0000 mgr.a (mgr.14373) 9678 : cluster [DBG] pgmap v6711: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:20:53.808 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:20:53.809 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:20:53.809 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:20:54.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:20:54 smithi047 bash[22744]: cluster 2024-09-16T09:20:53.251129+0000 mgr.a (mgr.14373) 9679 : cluster [DBG] pgmap v6712: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:20:54.593 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:20:54.594 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:20:54.594 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:20:54.594 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:20:54.594 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:20:54.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:20:54 smithi157 bash[24585]: cluster 2024-09-16T09:20:53.251129+0000 mgr.a (mgr.14373) 9679 : cluster [DBG] pgmap v6712: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:20:54.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:20:54 smithi086 bash[24289]: cluster 2024-09-16T09:20:53.251129+0000 mgr.a (mgr.14373) 9679 : cluster [DBG] pgmap v6712: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:20:55.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:20:55 smithi047 bash[22744]: audit 2024-09-16T09:20:54.143505+0000 mgr.a (mgr.14373) 9680 : audit [DBG] from='client.214290 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:20:55.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:20:55 smithi157 bash[24585]: audit 2024-09-16T09:20:54.143505+0000 mgr.a (mgr.14373) 9680 : audit [DBG] from='client.214290 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:20:55.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:20:55 smithi086 bash[24289]: audit 2024-09-16T09:20:54.143505+0000 mgr.a (mgr.14373) 9680 : audit [DBG] from='client.214290 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:20:56.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:20:56 smithi157 bash[24585]: cluster 2024-09-16T09:20:55.252127+0000 mgr.a (mgr.14373) 9681 : cluster [DBG] pgmap v6713: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:20:56.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:20:56 smithi086 bash[24289]: cluster 2024-09-16T09:20:55.252127+0000 mgr.a (mgr.14373) 9681 : cluster [DBG] pgmap v6713: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:20:56.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:20:56 smithi047 bash[22744]: cluster 2024-09-16T09:20:55.252127+0000 mgr.a (mgr.14373) 9681 : cluster [DBG] pgmap v6713: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:20:58.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:20:58 smithi157 bash[24585]: cluster 2024-09-16T09:20:57.254331+0000 mgr.a (mgr.14373) 9682 : cluster [DBG] pgmap v6714: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:20:58.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:20:58 smithi086 bash[24289]: cluster 2024-09-16T09:20:57.254331+0000 mgr.a (mgr.14373) 9682 : cluster [DBG] pgmap v6714: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:20:58.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:20:58 smithi047 bash[22744]: cluster 2024-09-16T09:20:57.254331+0000 mgr.a (mgr.14373) 9682 : cluster [DBG] pgmap v6714: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:20:59.595 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:20:59.596 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:20:59.596 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:21:00.339 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:21:00.340 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:21:00.340 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:21:00.340 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:21:00.340 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:21:00.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:21:00 smithi157 bash[24585]: cluster 2024-09-16T09:20:59.255132+0000 mgr.a (mgr.14373) 9683 : cluster [DBG] pgmap v6715: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:21:00.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:21:00 smithi086 bash[24289]: cluster 2024-09-16T09:20:59.255132+0000 mgr.a (mgr.14373) 9683 : cluster [DBG] pgmap v6715: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:21:00.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:21:00 smithi047 bash[22744]: cluster 2024-09-16T09:20:59.255132+0000 mgr.a (mgr.14373) 9683 : cluster [DBG] pgmap v6715: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:21:01.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:21:01 smithi157 bash[24585]: audit 2024-09-16T09:20:59.927709+0000 mgr.a (mgr.14373) 9684 : audit [DBG] from='client.214368 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:21:01.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:21:01 smithi086 bash[24289]: audit 2024-09-16T09:20:59.927709+0000 mgr.a (mgr.14373) 9684 : audit [DBG] from='client.214368 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:21:01.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:21:01 smithi047 bash[22744]: audit 2024-09-16T09:20:59.927709+0000 mgr.a (mgr.14373) 9684 : audit [DBG] from='client.214368 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:21:02.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:21:02 smithi157 bash[24585]: cluster 2024-09-16T09:21:01.256081+0000 mgr.a (mgr.14373) 9685 : cluster [DBG] pgmap v6716: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:21:02.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:21:02 smithi086 bash[24289]: cluster 2024-09-16T09:21:01.256081+0000 mgr.a (mgr.14373) 9685 : cluster [DBG] pgmap v6716: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:21:02.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:21:02 smithi047 bash[22744]: cluster 2024-09-16T09:21:01.256081+0000 mgr.a (mgr.14373) 9685 : cluster [DBG] pgmap v6716: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:21:04.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:21:04 smithi157 bash[24585]: cluster 2024-09-16T09:21:03.258390+0000 mgr.a (mgr.14373) 9686 : cluster [DBG] pgmap v6717: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:21:04.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:21:04 smithi086 bash[24289]: cluster 2024-09-16T09:21:03.258390+0000 mgr.a (mgr.14373) 9686 : cluster [DBG] pgmap v6717: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:21:04.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:21:04 smithi047 bash[22744]: cluster 2024-09-16T09:21:03.258390+0000 mgr.a (mgr.14373) 9686 : cluster [DBG] pgmap v6717: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:21:05.341 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:21:05.341 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:21:05.342 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:21:06.099 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:21:06.099 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:21:06.099 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:21:06.099 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:21:06.099 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:21:06.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:21:06 smithi157 bash[24585]: cluster 2024-09-16T09:21:05.259181+0000 mgr.a (mgr.14373) 9687 : cluster [DBG] pgmap v6718: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:21:06.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:21:06 smithi086 bash[24289]: cluster 2024-09-16T09:21:05.259181+0000 mgr.a (mgr.14373) 9687 : cluster [DBG] pgmap v6718: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:21:06.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:21:06 smithi047 bash[22744]: cluster 2024-09-16T09:21:05.259181+0000 mgr.a (mgr.14373) 9687 : cluster [DBG] pgmap v6718: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:21:07.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:21:07 smithi157 bash[24585]: audit 2024-09-16T09:21:05.667898+0000 mgr.a (mgr.14373) 9688 : audit [DBG] from='client.214446 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:21:07.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:21:07 smithi086 bash[24289]: audit 2024-09-16T09:21:05.667898+0000 mgr.a (mgr.14373) 9688 : audit [DBG] from='client.214446 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:21:07.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:21:07 smithi047 bash[22744]: audit 2024-09-16T09:21:05.667898+0000 mgr.a (mgr.14373) 9688 : audit [DBG] from='client.214446 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:21:08.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:21:08 smithi157 bash[24585]: cluster 2024-09-16T09:21:07.261583+0000 mgr.a (mgr.14373) 9689 : cluster [DBG] pgmap v6719: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:21:08.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:21:08 smithi086 bash[24289]: cluster 2024-09-16T09:21:07.261583+0000 mgr.a (mgr.14373) 9689 : cluster [DBG] pgmap v6719: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:21:08.844 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:21:08 smithi047 bash[22744]: cluster 2024-09-16T09:21:07.261583+0000 mgr.a (mgr.14373) 9689 : cluster [DBG] pgmap v6719: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:21:10.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:21:10 smithi157 bash[24585]: cluster 2024-09-16T09:21:09.262565+0000 mgr.a (mgr.14373) 9690 : cluster [DBG] pgmap v6720: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:21:10.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:21:10 smithi086 bash[24289]: cluster 2024-09-16T09:21:09.262565+0000 mgr.a (mgr.14373) 9690 : cluster [DBG] pgmap v6720: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:21:10.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:21:10 smithi047 bash[22744]: cluster 2024-09-16T09:21:09.262565+0000 mgr.a (mgr.14373) 9690 : cluster [DBG] pgmap v6720: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:21:11.100 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:21:11.101 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:21:11.101 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:21:11.876 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:21:11.876 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:21:11.876 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:21:11.877 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:21:11.877 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:21:12.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:21:12 smithi157 bash[24585]: cluster 2024-09-16T09:21:11.263484+0000 mgr.a (mgr.14373) 9691 : cluster [DBG] pgmap v6721: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:21:12.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:21:12 smithi086 bash[24289]: cluster 2024-09-16T09:21:11.263484+0000 mgr.a (mgr.14373) 9691 : cluster [DBG] pgmap v6721: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:21:12.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:21:12 smithi047 bash[22744]: cluster 2024-09-16T09:21:11.263484+0000 mgr.a (mgr.14373) 9691 : cluster [DBG] pgmap v6721: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:21:13.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:21:13 smithi157 bash[24585]: audit 2024-09-16T09:21:11.434650+0000 mgr.a (mgr.14373) 9692 : audit [DBG] from='client.214524 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:21:13.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:21:13 smithi086 bash[24289]: audit 2024-09-16T09:21:11.434650+0000 mgr.a (mgr.14373) 9692 : audit [DBG] from='client.214524 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:21:13.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:21:13 smithi047 bash[22744]: audit 2024-09-16T09:21:11.434650+0000 mgr.a (mgr.14373) 9692 : audit [DBG] from='client.214524 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:21:14.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:21:14 smithi157 bash[24585]: cluster 2024-09-16T09:21:13.266388+0000 mgr.a (mgr.14373) 9693 : cluster [DBG] pgmap v6722: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:21:14.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:21:14 smithi086 bash[24289]: cluster 2024-09-16T09:21:13.266388+0000 mgr.a (mgr.14373) 9693 : cluster [DBG] pgmap v6722: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:21:14.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:21:14 smithi047 bash[22744]: cluster 2024-09-16T09:21:13.266388+0000 mgr.a (mgr.14373) 9693 : cluster [DBG] pgmap v6722: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:21:15.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:21:15 smithi157 bash[24585]: cluster 2024-09-16T09:21:15.267370+0000 mgr.a (mgr.14373) 9694 : cluster [DBG] pgmap v6723: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:21:15.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:21:15 smithi086 bash[24289]: cluster 2024-09-16T09:21:15.267370+0000 mgr.a (mgr.14373) 9694 : cluster [DBG] pgmap v6723: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:21:15.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:21:15 smithi047 bash[22744]: cluster 2024-09-16T09:21:15.267370+0000 mgr.a (mgr.14373) 9694 : cluster [DBG] pgmap v6723: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:21:16.877 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:21:16.943 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:21:16.943 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:21:17.618 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:21:17.618 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:21:17.618 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:21:17.618 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:21:17.619 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:21:18.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:21:18 smithi047 bash[22744]: audit 2024-09-16T09:21:17.204150+0000 mgr.a (mgr.14373) 9695 : audit [DBG] from='client.214599 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:21:18.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:21:18 smithi047 bash[22744]: cluster 2024-09-16T09:21:17.268828+0000 mgr.a (mgr.14373) 9696 : cluster [DBG] pgmap v6724: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:21:18.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:21:18 smithi157 bash[24585]: audit 2024-09-16T09:21:17.204150+0000 mgr.a (mgr.14373) 9695 : audit [DBG] from='client.214599 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:21:18.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:21:18 smithi157 bash[24585]: cluster 2024-09-16T09:21:17.268828+0000 mgr.a (mgr.14373) 9696 : cluster [DBG] pgmap v6724: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:21:18.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:21:18 smithi086 bash[24289]: audit 2024-09-16T09:21:17.204150+0000 mgr.a (mgr.14373) 9695 : audit [DBG] from='client.214599 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:21:18.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:21:18 smithi086 bash[24289]: cluster 2024-09-16T09:21:17.268828+0000 mgr.a (mgr.14373) 9696 : cluster [DBG] pgmap v6724: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:21:20.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:21:20 smithi047 bash[22744]: cluster 2024-09-16T09:21:19.269697+0000 mgr.a (mgr.14373) 9697 : cluster [DBG] pgmap v6725: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:21:20.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:21:20 smithi157 bash[24585]: cluster 2024-09-16T09:21:19.269697+0000 mgr.a (mgr.14373) 9697 : cluster [DBG] pgmap v6725: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:21:20.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:21:20 smithi086 bash[24289]: cluster 2024-09-16T09:21:19.269697+0000 mgr.a (mgr.14373) 9697 : cluster [DBG] pgmap v6725: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:21:22.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:21:22 smithi047 bash[22744]: cluster 2024-09-16T09:21:21.270644+0000 mgr.a (mgr.14373) 9698 : cluster [DBG] pgmap v6726: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T09:21:22.619 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:21:22.620 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:21:22.621 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:21:22.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:21:22 smithi157 bash[24585]: cluster 2024-09-16T09:21:21.270644+0000 mgr.a (mgr.14373) 9698 : cluster [DBG] pgmap v6726: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T09:21:22.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:21:22 smithi086 bash[24289]: cluster 2024-09-16T09:21:21.270644+0000 mgr.a (mgr.14373) 9698 : cluster [DBG] pgmap v6726: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T09:21:23.383 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:21:23.384 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:21:23.384 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:21:23.384 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:21:23.384 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:21:24.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:21:24 smithi047 bash[22744]: audit 2024-09-16T09:21:22.950884+0000 mgr.a (mgr.14373) 9699 : audit [DBG] from='client.214677 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:21:24.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:21:24 smithi047 bash[22744]: cluster 2024-09-16T09:21:23.281028+0000 mgr.a (mgr.14373) 9700 : cluster [DBG] pgmap v6727: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:21:24.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:21:24 smithi157 bash[24585]: audit 2024-09-16T09:21:22.950884+0000 mgr.a (mgr.14373) 9699 : audit [DBG] from='client.214677 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:21:24.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:21:24 smithi157 bash[24585]: cluster 2024-09-16T09:21:23.281028+0000 mgr.a (mgr.14373) 9700 : cluster [DBG] pgmap v6727: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:21:24.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:21:24 smithi086 bash[24289]: audit 2024-09-16T09:21:22.950884+0000 mgr.a (mgr.14373) 9699 : audit [DBG] from='client.214677 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:21:24.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:21:24 smithi086 bash[24289]: cluster 2024-09-16T09:21:23.281028+0000 mgr.a (mgr.14373) 9700 : cluster [DBG] pgmap v6727: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:21:26.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:21:26 smithi047 bash[22744]: cluster 2024-09-16T09:21:25.281794+0000 mgr.a (mgr.14373) 9701 : cluster [DBG] pgmap v6728: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:21:26.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:21:26 smithi157 bash[24585]: cluster 2024-09-16T09:21:25.281794+0000 mgr.a (mgr.14373) 9701 : cluster [DBG] pgmap v6728: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:21:26.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:21:26 smithi086 bash[24289]: cluster 2024-09-16T09:21:25.281794+0000 mgr.a (mgr.14373) 9701 : cluster [DBG] pgmap v6728: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:21:28.385 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:21:28.385 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:21:28.386 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:21:28.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:21:28 smithi157 bash[24585]: cluster 2024-09-16T09:21:27.283889+0000 mgr.a (mgr.14373) 9702 : cluster [DBG] pgmap v6729: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:21:28.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:21:28 smithi086 bash[24289]: cluster 2024-09-16T09:21:27.283889+0000 mgr.a (mgr.14373) 9702 : cluster [DBG] pgmap v6729: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:21:28.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:21:28 smithi047 bash[22744]: cluster 2024-09-16T09:21:27.283889+0000 mgr.a (mgr.14373) 9702 : cluster [DBG] pgmap v6729: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:21:29.152 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:21:29.152 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:21:29.153 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:21:29.153 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:21:29.153 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:21:30.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:21:30 smithi157 bash[24585]: audit 2024-09-16T09:21:28.716455+0000 mgr.a (mgr.14373) 9703 : audit [DBG] from='client.214755 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:21:30.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:21:30 smithi157 bash[24585]: cluster 2024-09-16T09:21:29.284829+0000 mgr.a (mgr.14373) 9704 : cluster [DBG] pgmap v6730: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:21:30.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:21:30 smithi086 bash[24289]: audit 2024-09-16T09:21:28.716455+0000 mgr.a (mgr.14373) 9703 : audit [DBG] from='client.214755 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:21:30.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:21:30 smithi086 bash[24289]: cluster 2024-09-16T09:21:29.284829+0000 mgr.a (mgr.14373) 9704 : cluster [DBG] pgmap v6730: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:21:30.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:21:30 smithi047 bash[22744]: audit 2024-09-16T09:21:28.716455+0000 mgr.a (mgr.14373) 9703 : audit [DBG] from='client.214755 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:21:30.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:21:30 smithi047 bash[22744]: cluster 2024-09-16T09:21:29.284829+0000 mgr.a (mgr.14373) 9704 : cluster [DBG] pgmap v6730: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:21:32.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:21:32 smithi157 bash[24585]: cluster 2024-09-16T09:21:31.285623+0000 mgr.a (mgr.14373) 9705 : cluster [DBG] pgmap v6731: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:21:32.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:21:32 smithi086 bash[24289]: cluster 2024-09-16T09:21:31.285623+0000 mgr.a (mgr.14373) 9705 : cluster [DBG] pgmap v6731: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:21:32.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:21:32 smithi047 bash[22744]: cluster 2024-09-16T09:21:31.285623+0000 mgr.a (mgr.14373) 9705 : cluster [DBG] pgmap v6731: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:21:34.154 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:21:34.154 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:21:34.155 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:21:34.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:21:34 smithi157 bash[24585]: cluster 2024-09-16T09:21:33.287895+0000 mgr.a (mgr.14373) 9706 : cluster [DBG] pgmap v6732: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:21:34.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:21:34 smithi086 bash[24289]: cluster 2024-09-16T09:21:33.287895+0000 mgr.a (mgr.14373) 9706 : cluster [DBG] pgmap v6732: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:21:34.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:21:34 smithi047 bash[22744]: cluster 2024-09-16T09:21:33.287895+0000 mgr.a (mgr.14373) 9706 : cluster [DBG] pgmap v6732: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:21:34.947 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:21:34.947 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:21:34.948 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:21:34.948 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:21:34.948 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:21:35.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:21:35 smithi157 bash[24585]: audit 2024-09-16T09:21:34.531075+0000 mon.b (mon.2) 902 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T09:21:35.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:21:35 smithi157 bash[24585]: audit 2024-09-16T09:21:35.321809+0000 mon.b (mon.2) 903 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:21:35.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:21:35 smithi157 bash[24585]: audit 2024-09-16T09:21:35.323612+0000 mon.b (mon.2) 904 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T09:21:35.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:21:35 smithi157 bash[24585]: audit 2024-09-16T09:21:35.330946+0000 mon.a (mon.0) 1150 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:21:35.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:21:35 smithi157 bash[24585]: audit 2024-09-16T09:21:35.336507+0000 mon.b (mon.2) 905 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:21:35.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:21:35 smithi086 bash[24289]: audit 2024-09-16T09:21:34.531075+0000 mon.b (mon.2) 902 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T09:21:35.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:21:35 smithi086 bash[24289]: audit 2024-09-16T09:21:35.321809+0000 mon.b (mon.2) 903 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:21:35.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:21:35 smithi086 bash[24289]: audit 2024-09-16T09:21:35.323612+0000 mon.b (mon.2) 904 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T09:21:35.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:21:35 smithi086 bash[24289]: audit 2024-09-16T09:21:35.330946+0000 mon.a (mon.0) 1150 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:21:35.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:21:35 smithi086 bash[24289]: audit 2024-09-16T09:21:35.336507+0000 mon.b (mon.2) 905 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:21:35.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:21:35 smithi047 bash[22744]: audit 2024-09-16T09:21:34.531075+0000 mon.b (mon.2) 902 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T09:21:35.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:21:35 smithi047 bash[22744]: audit 2024-09-16T09:21:35.321809+0000 mon.b (mon.2) 903 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:21:35.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:21:35 smithi047 bash[22744]: audit 2024-09-16T09:21:35.323612+0000 mon.b (mon.2) 904 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T09:21:35.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:21:35 smithi047 bash[22744]: audit 2024-09-16T09:21:35.330946+0000 mon.a (mon.0) 1150 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:21:35.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:21:35 smithi047 bash[22744]: audit 2024-09-16T09:21:35.336507+0000 mon.b (mon.2) 905 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:21:36.343 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 09:21:36 smithi047 bash[22994]: debug 2024-09-16T09:21:36.059+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T09:21:36.343 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 09:21:36 smithi047 bash[22994]: debug 2024-09-16T09:21:36.063+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T09:21:36.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:21:36 smithi157 bash[24585]: audit 2024-09-16T09:21:34.492690+0000 mgr.a (mgr.14373) 9707 : audit [DBG] from='client.214830 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:21:36.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:21:36 smithi157 bash[24585]: cluster 2024-09-16T09:21:35.288822+0000 mgr.a (mgr.14373) 9708 : cluster [DBG] pgmap v6733: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:21:36.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:21:36 smithi157 bash[24585]: audit 2024-09-16T09:21:35.335418+0000 mgr.a (mgr.14373) 9709 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:21:36.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:21:36 smithi086 bash[24289]: audit 2024-09-16T09:21:34.492690+0000 mgr.a (mgr.14373) 9707 : audit [DBG] from='client.214830 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:21:36.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:21:36 smithi086 bash[24289]: cluster 2024-09-16T09:21:35.288822+0000 mgr.a (mgr.14373) 9708 : cluster [DBG] pgmap v6733: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:21:36.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:21:36 smithi086 bash[24289]: audit 2024-09-16T09:21:35.335418+0000 mgr.a (mgr.14373) 9709 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:21:36.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:21:36 smithi047 bash[22744]: audit 2024-09-16T09:21:34.492690+0000 mgr.a (mgr.14373) 9707 : audit [DBG] from='client.214830 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:21:36.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:21:36 smithi047 bash[22744]: cluster 2024-09-16T09:21:35.288822+0000 mgr.a (mgr.14373) 9708 : cluster [DBG] pgmap v6733: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:21:36.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:21:36 smithi047 bash[22744]: audit 2024-09-16T09:21:35.335418+0000 mgr.a (mgr.14373) 9709 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:21:37.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:21:37 smithi157 bash[24585]: audit 2024-09-16T09:21:36.065269+0000 mgr.a (mgr.14373) 9710 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T09:21:37.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:21:37 smithi157 bash[24585]: cephadm 2024-09-16T09:21:36.067860+0000 mgr.a (mgr.14373) 9711 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T09:21:37.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:21:37 smithi086 bash[24289]: audit 2024-09-16T09:21:36.065269+0000 mgr.a (mgr.14373) 9710 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T09:21:37.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:21:37 smithi086 bash[24289]: cephadm 2024-09-16T09:21:36.067860+0000 mgr.a (mgr.14373) 9711 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T09:21:37.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:21:37 smithi047 bash[22744]: audit 2024-09-16T09:21:36.065269+0000 mgr.a (mgr.14373) 9710 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T09:21:37.844 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:21:37 smithi047 bash[22744]: cephadm 2024-09-16T09:21:36.067860+0000 mgr.a (mgr.14373) 9711 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T09:21:38.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:21:38 smithi157 bash[24585]: cluster 2024-09-16T09:21:37.291109+0000 mgr.a (mgr.14373) 9712 : cluster [DBG] pgmap v6734: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:21:38.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:21:38 smithi086 bash[24289]: cluster 2024-09-16T09:21:37.291109+0000 mgr.a (mgr.14373) 9712 : cluster [DBG] pgmap v6734: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:21:38.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:21:38 smithi047 bash[22744]: cluster 2024-09-16T09:21:37.291109+0000 mgr.a (mgr.14373) 9712 : cluster [DBG] pgmap v6734: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:21:39.949 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:21:39.949 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:21:39.949 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:21:40.730 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:21:40.730 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:21:40.730 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:21:40.730 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:21:40.730 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:21:40.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:21:40 smithi157 bash[24585]: cluster 2024-09-16T09:21:39.291868+0000 mgr.a (mgr.14373) 9713 : cluster [DBG] pgmap v6735: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:21:40.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:21:40 smithi086 bash[24289]: cluster 2024-09-16T09:21:39.291868+0000 mgr.a (mgr.14373) 9713 : cluster [DBG] pgmap v6735: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:21:40.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:21:40 smithi047 bash[22744]: cluster 2024-09-16T09:21:39.291868+0000 mgr.a (mgr.14373) 9713 : cluster [DBG] pgmap v6735: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:21:41.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:21:41 smithi157 bash[24585]: audit 2024-09-16T09:21:40.284961+0000 mgr.a (mgr.14373) 9714 : audit [DBG] from='client.215013 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:21:41.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:21:41 smithi086 bash[24289]: audit 2024-09-16T09:21:40.284961+0000 mgr.a (mgr.14373) 9714 : audit [DBG] from='client.215013 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:21:41.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:21:41 smithi047 bash[22744]: audit 2024-09-16T09:21:40.284961+0000 mgr.a (mgr.14373) 9714 : audit [DBG] from='client.215013 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:21:42.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:21:42 smithi157 bash[24585]: cluster 2024-09-16T09:21:41.292824+0000 mgr.a (mgr.14373) 9715 : cluster [DBG] pgmap v6736: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:21:42.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:21:42 smithi086 bash[24289]: cluster 2024-09-16T09:21:41.292824+0000 mgr.a (mgr.14373) 9715 : cluster [DBG] pgmap v6736: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:21:42.844 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:21:42 smithi047 bash[22744]: cluster 2024-09-16T09:21:41.292824+0000 mgr.a (mgr.14373) 9715 : cluster [DBG] pgmap v6736: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:21:44.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:21:44 smithi157 bash[24585]: cluster 2024-09-16T09:21:43.295090+0000 mgr.a (mgr.14373) 9716 : cluster [DBG] pgmap v6737: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:21:44.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:21:44 smithi086 bash[24289]: cluster 2024-09-16T09:21:43.295090+0000 mgr.a (mgr.14373) 9716 : cluster [DBG] pgmap v6737: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:21:44.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:21:44 smithi047 bash[22744]: cluster 2024-09-16T09:21:43.295090+0000 mgr.a (mgr.14373) 9716 : cluster [DBG] pgmap v6737: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:21:45.732 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:21:45.732 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:21:45.732 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:21:45.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:21:45 smithi157 bash[24585]: cluster 2024-09-16T09:21:45.295844+0000 mgr.a (mgr.14373) 9717 : cluster [DBG] pgmap v6738: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:21:45.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:21:45 smithi086 bash[24289]: cluster 2024-09-16T09:21:45.295844+0000 mgr.a (mgr.14373) 9717 : cluster [DBG] pgmap v6738: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:21:45.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:21:45 smithi047 bash[22744]: cluster 2024-09-16T09:21:45.295844+0000 mgr.a (mgr.14373) 9717 : cluster [DBG] pgmap v6738: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:21:46.509 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:21:46.509 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:21:46.510 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:21:46.510 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:21:46.510 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:21:46.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:21:46 smithi157 bash[24585]: audit 2024-09-16T09:21:46.067222+0000 mgr.a (mgr.14373) 9718 : audit [DBG] from='client.215085 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:21:46.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:21:46 smithi086 bash[24289]: audit 2024-09-16T09:21:46.067222+0000 mgr.a (mgr.14373) 9718 : audit [DBG] from='client.215085 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:21:46.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:21:46 smithi047 bash[22744]: audit 2024-09-16T09:21:46.067222+0000 mgr.a (mgr.14373) 9718 : audit [DBG] from='client.215085 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:21:47.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:21:47 smithi157 bash[24585]: cluster 2024-09-16T09:21:47.298129+0000 mgr.a (mgr.14373) 9719 : cluster [DBG] pgmap v6739: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:21:47.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:21:47 smithi086 bash[24289]: cluster 2024-09-16T09:21:47.298129+0000 mgr.a (mgr.14373) 9719 : cluster [DBG] pgmap v6739: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:21:47.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:21:47 smithi047 bash[22744]: cluster 2024-09-16T09:21:47.298129+0000 mgr.a (mgr.14373) 9719 : cluster [DBG] pgmap v6739: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:21:50.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:21:50 smithi157 bash[24585]: cluster 2024-09-16T09:21:49.298892+0000 mgr.a (mgr.14373) 9720 : cluster [DBG] pgmap v6740: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:21:50.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:21:50 smithi086 bash[24289]: cluster 2024-09-16T09:21:49.298892+0000 mgr.a (mgr.14373) 9720 : cluster [DBG] pgmap v6740: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:21:50.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:21:50 smithi047 bash[22744]: cluster 2024-09-16T09:21:49.298892+0000 mgr.a (mgr.14373) 9720 : cluster [DBG] pgmap v6740: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:21:51.510 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:21:51.511 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:21:51.511 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:21:52.272 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:21:52.273 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:21:52.273 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:21:52.273 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:21:52.273 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:21:52.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:21:52 smithi157 bash[24585]: cluster 2024-09-16T09:21:51.299640+0000 mgr.a (mgr.14373) 9721 : cluster [DBG] pgmap v6741: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:21:52.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:21:52 smithi086 bash[24289]: cluster 2024-09-16T09:21:51.299640+0000 mgr.a (mgr.14373) 9721 : cluster [DBG] pgmap v6741: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:21:52.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:21:52 smithi047 bash[22744]: cluster 2024-09-16T09:21:51.299640+0000 mgr.a (mgr.14373) 9721 : cluster [DBG] pgmap v6741: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:21:53.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:21:53 smithi157 bash[24585]: audit 2024-09-16T09:21:51.830712+0000 mgr.a (mgr.14373) 9722 : audit [DBG] from='client.215163 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:21:53.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:21:53 smithi086 bash[24289]: audit 2024-09-16T09:21:51.830712+0000 mgr.a (mgr.14373) 9722 : audit [DBG] from='client.215163 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:21:53.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:21:53 smithi047 bash[22744]: audit 2024-09-16T09:21:51.830712+0000 mgr.a (mgr.14373) 9722 : audit [DBG] from='client.215163 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:21:54.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:21:54 smithi157 bash[24585]: cluster 2024-09-16T09:21:53.302453+0000 mgr.a (mgr.14373) 9723 : cluster [DBG] pgmap v6742: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:21:54.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:21:54 smithi086 bash[24289]: cluster 2024-09-16T09:21:53.302453+0000 mgr.a (mgr.14373) 9723 : cluster [DBG] pgmap v6742: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:21:54.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:21:54 smithi047 bash[22744]: cluster 2024-09-16T09:21:53.302453+0000 mgr.a (mgr.14373) 9723 : cluster [DBG] pgmap v6742: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:21:55.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:21:55 smithi157 bash[24585]: cluster 2024-09-16T09:21:55.303416+0000 mgr.a (mgr.14373) 9724 : cluster [DBG] pgmap v6743: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:21:55.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:21:55 smithi086 bash[24289]: cluster 2024-09-16T09:21:55.303416+0000 mgr.a (mgr.14373) 9724 : cluster [DBG] pgmap v6743: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:21:55.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:21:55 smithi047 bash[22744]: cluster 2024-09-16T09:21:55.303416+0000 mgr.a (mgr.14373) 9724 : cluster [DBG] pgmap v6743: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:21:57.274 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:21:57.275 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:21:57.275 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:21:58.049 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:21:58.050 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:21:58.050 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:21:58.050 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:21:58.050 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:21:58.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:21:58 smithi157 bash[24585]: cluster 2024-09-16T09:21:57.305519+0000 mgr.a (mgr.14373) 9725 : cluster [DBG] pgmap v6744: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:21:58.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:21:58 smithi086 bash[24289]: cluster 2024-09-16T09:21:57.305519+0000 mgr.a (mgr.14373) 9725 : cluster [DBG] pgmap v6744: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:21:58.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:21:58 smithi047 bash[22744]: cluster 2024-09-16T09:21:57.305519+0000 mgr.a (mgr.14373) 9725 : cluster [DBG] pgmap v6744: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:21:59.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:21:59 smithi157 bash[24585]: audit 2024-09-16T09:21:57.605185+0000 mgr.a (mgr.14373) 9726 : audit [DBG] from='client.215241 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:21:59.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:21:59 smithi086 bash[24289]: audit 2024-09-16T09:21:57.605185+0000 mgr.a (mgr.14373) 9726 : audit [DBG] from='client.215241 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:21:59.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:21:59 smithi047 bash[22744]: audit 2024-09-16T09:21:57.605185+0000 mgr.a (mgr.14373) 9726 : audit [DBG] from='client.215241 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:22:00.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:22:00 smithi157 bash[24585]: cluster 2024-09-16T09:21:59.306472+0000 mgr.a (mgr.14373) 9727 : cluster [DBG] pgmap v6745: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:22:00.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:22:00 smithi086 bash[24289]: cluster 2024-09-16T09:21:59.306472+0000 mgr.a (mgr.14373) 9727 : cluster [DBG] pgmap v6745: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:22:00.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:22:00 smithi047 bash[22744]: cluster 2024-09-16T09:21:59.306472+0000 mgr.a (mgr.14373) 9727 : cluster [DBG] pgmap v6745: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:22:02.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:22:02 smithi157 bash[24585]: cluster 2024-09-16T09:22:01.307244+0000 mgr.a (mgr.14373) 9728 : cluster [DBG] pgmap v6746: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T09:22:02.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:22:02 smithi086 bash[24289]: cluster 2024-09-16T09:22:01.307244+0000 mgr.a (mgr.14373) 9728 : cluster [DBG] pgmap v6746: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T09:22:02.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:22:02 smithi047 bash[22744]: cluster 2024-09-16T09:22:01.307244+0000 mgr.a (mgr.14373) 9728 : cluster [DBG] pgmap v6746: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T09:22:03.051 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:22:03.051 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:22:03.051 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:22:03.822 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:22:03.823 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:22:03.823 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:22:03.823 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:22:03.823 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:22:04.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:22:04 smithi157 bash[24585]: cluster 2024-09-16T09:22:03.308574+0000 mgr.a (mgr.14373) 9729 : cluster [DBG] pgmap v6747: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:22:04.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:22:04 smithi157 bash[24585]: audit 2024-09-16T09:22:03.381836+0000 mgr.a (mgr.14373) 9730 : audit [DBG] from='client.215316 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:22:04.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:22:04 smithi086 bash[24289]: cluster 2024-09-16T09:22:03.308574+0000 mgr.a (mgr.14373) 9729 : cluster [DBG] pgmap v6747: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:22:04.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:22:04 smithi086 bash[24289]: audit 2024-09-16T09:22:03.381836+0000 mgr.a (mgr.14373) 9730 : audit [DBG] from='client.215316 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:22:04.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:22:04 smithi047 bash[22744]: cluster 2024-09-16T09:22:03.308574+0000 mgr.a (mgr.14373) 9729 : cluster [DBG] pgmap v6747: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:22:04.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:22:04 smithi047 bash[22744]: audit 2024-09-16T09:22:03.381836+0000 mgr.a (mgr.14373) 9730 : audit [DBG] from='client.215316 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:22:06.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:22:06 smithi157 bash[24585]: cluster 2024-09-16T09:22:05.309584+0000 mgr.a (mgr.14373) 9731 : cluster [DBG] pgmap v6748: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:22:06.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:22:06 smithi086 bash[24289]: cluster 2024-09-16T09:22:05.309584+0000 mgr.a (mgr.14373) 9731 : cluster [DBG] pgmap v6748: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:22:06.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:22:06 smithi047 bash[22744]: cluster 2024-09-16T09:22:05.309584+0000 mgr.a (mgr.14373) 9731 : cluster [DBG] pgmap v6748: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:22:08.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:22:08 smithi157 bash[24585]: cluster 2024-09-16T09:22:07.311807+0000 mgr.a (mgr.14373) 9732 : cluster [DBG] pgmap v6749: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:22:08.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:22:08 smithi086 bash[24289]: cluster 2024-09-16T09:22:07.311807+0000 mgr.a (mgr.14373) 9732 : cluster [DBG] pgmap v6749: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:22:08.825 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:22:08.826 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:22:08.826 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:22:08.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:22:08 smithi047 bash[22744]: cluster 2024-09-16T09:22:07.311807+0000 mgr.a (mgr.14373) 9732 : cluster [DBG] pgmap v6749: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:22:09.601 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:22:09.601 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:22:09.601 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:22:09.601 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:22:09.601 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:22:10.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:22:10 smithi157 bash[24585]: audit 2024-09-16T09:22:09.158846+0000 mgr.a (mgr.14373) 9733 : audit [DBG] from='client.215391 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:22:10.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:22:10 smithi157 bash[24585]: cluster 2024-09-16T09:22:09.312418+0000 mgr.a (mgr.14373) 9734 : cluster [DBG] pgmap v6750: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:22:10.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:22:10 smithi086 bash[24289]: audit 2024-09-16T09:22:09.158846+0000 mgr.a (mgr.14373) 9733 : audit [DBG] from='client.215391 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:22:10.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:22:10 smithi086 bash[24289]: cluster 2024-09-16T09:22:09.312418+0000 mgr.a (mgr.14373) 9734 : cluster [DBG] pgmap v6750: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:22:10.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:22:10 smithi047 bash[22744]: audit 2024-09-16T09:22:09.158846+0000 mgr.a (mgr.14373) 9733 : audit [DBG] from='client.215391 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:22:10.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:22:10 smithi047 bash[22744]: cluster 2024-09-16T09:22:09.312418+0000 mgr.a (mgr.14373) 9734 : cluster [DBG] pgmap v6750: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:22:12.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:22:12 smithi157 bash[24585]: cluster 2024-09-16T09:22:11.313290+0000 mgr.a (mgr.14373) 9735 : cluster [DBG] pgmap v6751: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:22:12.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:22:12 smithi086 bash[24289]: cluster 2024-09-16T09:22:11.313290+0000 mgr.a (mgr.14373) 9735 : cluster [DBG] pgmap v6751: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:22:12.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:22:12 smithi047 bash[22744]: cluster 2024-09-16T09:22:11.313290+0000 mgr.a (mgr.14373) 9735 : cluster [DBG] pgmap v6751: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:22:14.606 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:22:14.606 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:22:14.606 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:22:14.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:22:14 smithi157 bash[24585]: cluster 2024-09-16T09:22:13.315517+0000 mgr.a (mgr.14373) 9736 : cluster [DBG] pgmap v6752: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:22:14.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:22:14 smithi086 bash[24289]: cluster 2024-09-16T09:22:13.315517+0000 mgr.a (mgr.14373) 9736 : cluster [DBG] pgmap v6752: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:22:14.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:22:14 smithi047 bash[22744]: cluster 2024-09-16T09:22:13.315517+0000 mgr.a (mgr.14373) 9736 : cluster [DBG] pgmap v6752: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:22:15.340 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:22:15.340 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:22:15.341 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:22:15.341 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:22:15.341 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:22:15.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:22:15 smithi157 bash[24585]: audit 2024-09-16T09:22:14.931144+0000 mgr.a (mgr.14373) 9737 : audit [DBG] from='client.215466 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:22:15.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:22:15 smithi157 bash[24585]: cluster 2024-09-16T09:22:15.316002+0000 mgr.a (mgr.14373) 9738 : cluster [DBG] pgmap v6753: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:22:15.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:22:15 smithi086 bash[24289]: audit 2024-09-16T09:22:14.931144+0000 mgr.a (mgr.14373) 9737 : audit [DBG] from='client.215466 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:22:15.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:22:15 smithi086 bash[24289]: cluster 2024-09-16T09:22:15.316002+0000 mgr.a (mgr.14373) 9738 : cluster [DBG] pgmap v6753: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:22:15.845 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:22:15 smithi047 bash[22744]: audit 2024-09-16T09:22:14.931144+0000 mgr.a (mgr.14373) 9737 : audit [DBG] from='client.215466 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:22:15.845 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:22:15 smithi047 bash[22744]: cluster 2024-09-16T09:22:15.316002+0000 mgr.a (mgr.14373) 9738 : cluster [DBG] pgmap v6753: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:22:18.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:22:18 smithi157 bash[24585]: cluster 2024-09-16T09:22:17.318111+0000 mgr.a (mgr.14373) 9739 : cluster [DBG] pgmap v6754: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:22:18.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:22:18 smithi086 bash[24289]: cluster 2024-09-16T09:22:17.318111+0000 mgr.a (mgr.14373) 9739 : cluster [DBG] pgmap v6754: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:22:18.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:22:18 smithi047 bash[22744]: cluster 2024-09-16T09:22:17.318111+0000 mgr.a (mgr.14373) 9739 : cluster [DBG] pgmap v6754: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:22:20.342 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:22:20.342 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:22:20.342 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:22:20.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:22:20 smithi157 bash[24585]: cluster 2024-09-16T09:22:19.318872+0000 mgr.a (mgr.14373) 9740 : cluster [DBG] pgmap v6755: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:22:20.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:22:20 smithi086 bash[24289]: cluster 2024-09-16T09:22:19.318872+0000 mgr.a (mgr.14373) 9740 : cluster [DBG] pgmap v6755: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:22:20.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:22:20 smithi047 bash[22744]: cluster 2024-09-16T09:22:19.318872+0000 mgr.a (mgr.14373) 9740 : cluster [DBG] pgmap v6755: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:22:21.097 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:22:21.098 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:22:21.098 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:22:21.098 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:22:21.098 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:22:22.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:22:22 smithi157 bash[24585]: audit 2024-09-16T09:22:20.681837+0000 mgr.a (mgr.14373) 9741 : audit [DBG] from='client.215544 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:22:22.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:22:22 smithi157 bash[24585]: cluster 2024-09-16T09:22:21.319862+0000 mgr.a (mgr.14373) 9742 : cluster [DBG] pgmap v6756: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:22:22.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:22:22 smithi086 bash[24289]: audit 2024-09-16T09:22:20.681837+0000 mgr.a (mgr.14373) 9741 : audit [DBG] from='client.215544 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:22:22.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:22:22 smithi086 bash[24289]: cluster 2024-09-16T09:22:21.319862+0000 mgr.a (mgr.14373) 9742 : cluster [DBG] pgmap v6756: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:22:22.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:22:22 smithi047 bash[22744]: audit 2024-09-16T09:22:20.681837+0000 mgr.a (mgr.14373) 9741 : audit [DBG] from='client.215544 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:22:22.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:22:22 smithi047 bash[22744]: cluster 2024-09-16T09:22:21.319862+0000 mgr.a (mgr.14373) 9742 : cluster [DBG] pgmap v6756: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:22:24.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:22:24 smithi157 bash[24585]: cluster 2024-09-16T09:22:23.322090+0000 mgr.a (mgr.14373) 9743 : cluster [DBG] pgmap v6757: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:22:24.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:22:24 smithi086 bash[24289]: cluster 2024-09-16T09:22:23.322090+0000 mgr.a (mgr.14373) 9743 : cluster [DBG] pgmap v6757: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:22:24.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:22:24 smithi047 bash[22744]: cluster 2024-09-16T09:22:23.322090+0000 mgr.a (mgr.14373) 9743 : cluster [DBG] pgmap v6757: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:22:26.099 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:22:26.099 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:22:26.100 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:22:26.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:22:26 smithi157 bash[24585]: cluster 2024-09-16T09:22:25.322861+0000 mgr.a (mgr.14373) 9744 : cluster [DBG] pgmap v6758: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:22:26.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:22:26 smithi086 bash[24289]: cluster 2024-09-16T09:22:25.322861+0000 mgr.a (mgr.14373) 9744 : cluster [DBG] pgmap v6758: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:22:26.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:22:26 smithi047 bash[22744]: cluster 2024-09-16T09:22:25.322861+0000 mgr.a (mgr.14373) 9744 : cluster [DBG] pgmap v6758: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:22:26.846 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:22:26.847 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:22:26.847 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:22:26.847 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:22:26.847 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:22:28.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:22:28 smithi157 bash[24585]: audit 2024-09-16T09:22:26.428587+0000 mgr.a (mgr.14373) 9745 : audit [DBG] from='client.215619 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:22:28.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:22:28 smithi157 bash[24585]: cluster 2024-09-16T09:22:27.325477+0000 mgr.a (mgr.14373) 9746 : cluster [DBG] pgmap v6759: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:22:28.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:22:28 smithi086 bash[24289]: audit 2024-09-16T09:22:26.428587+0000 mgr.a (mgr.14373) 9745 : audit [DBG] from='client.215619 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:22:28.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:22:28 smithi086 bash[24289]: cluster 2024-09-16T09:22:27.325477+0000 mgr.a (mgr.14373) 9746 : cluster [DBG] pgmap v6759: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:22:28.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:22:28 smithi047 bash[22744]: audit 2024-09-16T09:22:26.428587+0000 mgr.a (mgr.14373) 9745 : audit [DBG] from='client.215619 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:22:28.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:22:28 smithi047 bash[22744]: cluster 2024-09-16T09:22:27.325477+0000 mgr.a (mgr.14373) 9746 : cluster [DBG] pgmap v6759: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:22:30.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:22:30 smithi157 bash[24585]: cluster 2024-09-16T09:22:29.326293+0000 mgr.a (mgr.14373) 9747 : cluster [DBG] pgmap v6760: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:22:30.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:22:30 smithi086 bash[24289]: cluster 2024-09-16T09:22:29.326293+0000 mgr.a (mgr.14373) 9747 : cluster [DBG] pgmap v6760: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:22:30.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:22:30 smithi047 bash[22744]: cluster 2024-09-16T09:22:29.326293+0000 mgr.a (mgr.14373) 9747 : cluster [DBG] pgmap v6760: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:22:31.848 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:22:31.849 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:22:31.849 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:22:32.595 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:22:32.595 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:22:32.595 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:22:32.595 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:22:32.595 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:22:32.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:22:32 smithi157 bash[24585]: cluster 2024-09-16T09:22:31.327071+0000 mgr.a (mgr.14373) 9748 : cluster [DBG] pgmap v6761: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T09:22:32.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:22:32 smithi086 bash[24289]: cluster 2024-09-16T09:22:31.327071+0000 mgr.a (mgr.14373) 9748 : cluster [DBG] pgmap v6761: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T09:22:32.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:22:32 smithi047 bash[22744]: cluster 2024-09-16T09:22:31.327071+0000 mgr.a (mgr.14373) 9748 : cluster [DBG] pgmap v6761: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T09:22:33.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:22:33 smithi157 bash[24585]: audit 2024-09-16T09:22:32.183202+0000 mgr.a (mgr.14373) 9749 : audit [DBG] from='client.215697 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:22:33.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:22:33 smithi086 bash[24289]: audit 2024-09-16T09:22:32.183202+0000 mgr.a (mgr.14373) 9749 : audit [DBG] from='client.215697 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:22:33.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:22:33 smithi047 bash[22744]: audit 2024-09-16T09:22:32.183202+0000 mgr.a (mgr.14373) 9749 : audit [DBG] from='client.215697 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:22:34.809 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:22:34 smithi157 bash[24585]: cluster 2024-09-16T09:22:33.329776+0000 mgr.a (mgr.14373) 9750 : cluster [DBG] pgmap v6762: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:22:34.825 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:22:34 smithi086 bash[24289]: cluster 2024-09-16T09:22:33.329776+0000 mgr.a (mgr.14373) 9750 : cluster [DBG] pgmap v6762: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:22:34.844 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:22:34 smithi047 bash[22744]: cluster 2024-09-16T09:22:33.329776+0000 mgr.a (mgr.14373) 9750 : cluster [DBG] pgmap v6762: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:22:35.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:22:35 smithi157 bash[24585]: cluster 2024-09-16T09:22:35.330568+0000 mgr.a (mgr.14373) 9751 : cluster [DBG] pgmap v6763: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:22:35.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:22:35 smithi086 bash[24289]: cluster 2024-09-16T09:22:35.330568+0000 mgr.a (mgr.14373) 9751 : cluster [DBG] pgmap v6763: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:22:35.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:22:35 smithi047 bash[22744]: cluster 2024-09-16T09:22:35.330568+0000 mgr.a (mgr.14373) 9751 : cluster [DBG] pgmap v6763: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:22:36.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:22:36 smithi157 bash[24585]: audit 2024-09-16T09:22:36.128035+0000 mon.b (mon.2) 906 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T09:22:36.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:22:36 smithi086 bash[24289]: audit 2024-09-16T09:22:36.128035+0000 mon.b (mon.2) 906 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T09:22:36.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:22:36 smithi047 bash[22744]: audit 2024-09-16T09:22:36.128035+0000 mon.b (mon.2) 906 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T09:22:37.596 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:22:37.596 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:22:37.596 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:22:37.708 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:22:37 smithi047 bash[22744]: audit 2024-09-16T09:22:36.963627+0000 mon.b (mon.2) 907 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:22:37.709 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:22:37 smithi047 bash[22744]: audit 2024-09-16T09:22:36.965605+0000 mon.b (mon.2) 908 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T09:22:37.709 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:22:37 smithi047 bash[22744]: audit 2024-09-16T09:22:36.973468+0000 mon.a (mon.0) 1151 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:22:37.709 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:22:37 smithi047 bash[22744]: audit 2024-09-16T09:22:36.978185+0000 mgr.a (mgr.14373) 9752 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:22:37.709 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:22:37 smithi047 bash[22744]: audit 2024-09-16T09:22:36.979193+0000 mon.b (mon.2) 909 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:22:37.709 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:22:37 smithi047 bash[22744]: cluster 2024-09-16T09:22:37.331848+0000 mgr.a (mgr.14373) 9753 : cluster [DBG] pgmap v6764: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:22:37.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:22:37 smithi157 bash[24585]: audit 2024-09-16T09:22:36.963627+0000 mon.b (mon.2) 907 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:22:37.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:22:37 smithi157 bash[24585]: audit 2024-09-16T09:22:36.965605+0000 mon.b (mon.2) 908 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T09:22:37.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:22:37 smithi157 bash[24585]: audit 2024-09-16T09:22:36.973468+0000 mon.a (mon.0) 1151 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:22:37.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:22:37 smithi157 bash[24585]: audit 2024-09-16T09:22:36.978185+0000 mgr.a (mgr.14373) 9752 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:22:37.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:22:37 smithi157 bash[24585]: audit 2024-09-16T09:22:36.979193+0000 mon.b (mon.2) 909 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:22:37.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:22:37 smithi157 bash[24585]: cluster 2024-09-16T09:22:37.331848+0000 mgr.a (mgr.14373) 9753 : cluster [DBG] pgmap v6764: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:22:37.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:22:37 smithi086 bash[24289]: audit 2024-09-16T09:22:36.963627+0000 mon.b (mon.2) 907 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:22:37.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:22:37 smithi086 bash[24289]: audit 2024-09-16T09:22:36.965605+0000 mon.b (mon.2) 908 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T09:22:37.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:22:37 smithi086 bash[24289]: audit 2024-09-16T09:22:36.973468+0000 mon.a (mon.0) 1151 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:22:37.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:22:37 smithi086 bash[24289]: audit 2024-09-16T09:22:36.978185+0000 mgr.a (mgr.14373) 9752 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:22:37.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:22:37 smithi086 bash[24289]: audit 2024-09-16T09:22:36.979193+0000 mon.b (mon.2) 909 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:22:37.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:22:37 smithi086 bash[24289]: cluster 2024-09-16T09:22:37.331848+0000 mgr.a (mgr.14373) 9753 : cluster [DBG] pgmap v6764: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:22:38.093 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 09:22:37 smithi047 bash[22994]: debug 2024-09-16T09:22:37.706+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T09:22:38.093 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 09:22:37 smithi047 bash[22994]: debug 2024-09-16T09:22:37.706+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T09:22:38.319 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:22:38.320 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:22:38.320 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:22:38.320 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:22:38.320 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:22:39.305 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:22:38 smithi157 bash[24585]: audit 2024-09-16T09:22:37.706740+0000 mgr.a (mgr.14373) 9754 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T09:22:39.305 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:22:38 smithi157 bash[24585]: cephadm 2024-09-16T09:22:37.708502+0000 mgr.a (mgr.14373) 9755 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T09:22:39.305 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:22:38 smithi157 bash[24585]: audit 2024-09-16T09:22:37.905030+0000 mgr.a (mgr.14373) 9756 : audit [DBG] from='client.215877 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:22:39.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:22:38 smithi086 bash[24289]: audit 2024-09-16T09:22:37.706740+0000 mgr.a (mgr.14373) 9754 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T09:22:39.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:22:38 smithi086 bash[24289]: cephadm 2024-09-16T09:22:37.708502+0000 mgr.a (mgr.14373) 9755 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T09:22:39.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:22:38 smithi086 bash[24289]: audit 2024-09-16T09:22:37.905030+0000 mgr.a (mgr.14373) 9756 : audit [DBG] from='client.215877 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:22:39.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:22:38 smithi047 bash[22744]: audit 2024-09-16T09:22:37.706740+0000 mgr.a (mgr.14373) 9754 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T09:22:39.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:22:38 smithi047 bash[22744]: cephadm 2024-09-16T09:22:37.708502+0000 mgr.a (mgr.14373) 9755 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T09:22:39.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:22:38 smithi047 bash[22744]: audit 2024-09-16T09:22:37.905030+0000 mgr.a (mgr.14373) 9756 : audit [DBG] from='client.215877 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:22:40.305 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:22:39 smithi157 bash[24585]: cluster 2024-09-16T09:22:39.332744+0000 mgr.a (mgr.14373) 9757 : cluster [DBG] pgmap v6765: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:22:40.318 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:22:39 smithi086 bash[24289]: cluster 2024-09-16T09:22:39.332744+0000 mgr.a (mgr.14373) 9757 : cluster [DBG] pgmap v6765: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:22:40.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:22:39 smithi047 bash[22744]: cluster 2024-09-16T09:22:39.332744+0000 mgr.a (mgr.14373) 9757 : cluster [DBG] pgmap v6765: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:22:42.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:22:42 smithi157 bash[24585]: cluster 2024-09-16T09:22:41.333543+0000 mgr.a (mgr.14373) 9758 : cluster [DBG] pgmap v6766: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:22:42.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:22:42 smithi086 bash[24289]: cluster 2024-09-16T09:22:41.333543+0000 mgr.a (mgr.14373) 9758 : cluster [DBG] pgmap v6766: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:22:42.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:22:42 smithi047 bash[22744]: cluster 2024-09-16T09:22:41.333543+0000 mgr.a (mgr.14373) 9758 : cluster [DBG] pgmap v6766: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:22:43.321 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:22:43.322 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:22:43.322 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:22:44.094 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:22:44.094 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:22:44.094 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:22:44.095 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:22:44.095 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:22:44.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:22:44 smithi157 bash[24585]: cluster 2024-09-16T09:22:43.335322+0000 mgr.a (mgr.14373) 9759 : cluster [DBG] pgmap v6767: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:22:44.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:22:44 smithi086 bash[24289]: cluster 2024-09-16T09:22:43.335322+0000 mgr.a (mgr.14373) 9759 : cluster [DBG] pgmap v6767: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:22:44.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:22:44 smithi047 bash[22744]: cluster 2024-09-16T09:22:43.335322+0000 mgr.a (mgr.14373) 9759 : cluster [DBG] pgmap v6767: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:22:45.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:22:45 smithi157 bash[24585]: audit 2024-09-16T09:22:43.658595+0000 mgr.a (mgr.14373) 9760 : audit [DBG] from='client.215952 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:22:45.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:22:45 smithi086 bash[24289]: audit 2024-09-16T09:22:43.658595+0000 mgr.a (mgr.14373) 9760 : audit [DBG] from='client.215952 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:22:45.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:22:45 smithi047 bash[22744]: audit 2024-09-16T09:22:43.658595+0000 mgr.a (mgr.14373) 9760 : audit [DBG] from='client.215952 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:22:46.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:22:46 smithi157 bash[24585]: cluster 2024-09-16T09:22:45.336340+0000 mgr.a (mgr.14373) 9761 : cluster [DBG] pgmap v6768: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:22:46.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:22:46 smithi086 bash[24289]: cluster 2024-09-16T09:22:45.336340+0000 mgr.a (mgr.14373) 9761 : cluster [DBG] pgmap v6768: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:22:46.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:22:46 smithi047 bash[22744]: cluster 2024-09-16T09:22:45.336340+0000 mgr.a (mgr.14373) 9761 : cluster [DBG] pgmap v6768: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:22:48.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:22:48 smithi157 bash[24585]: cluster 2024-09-16T09:22:47.338724+0000 mgr.a (mgr.14373) 9762 : cluster [DBG] pgmap v6769: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:22:48.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:22:48 smithi086 bash[24289]: cluster 2024-09-16T09:22:47.338724+0000 mgr.a (mgr.14373) 9762 : cluster [DBG] pgmap v6769: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:22:48.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:22:48 smithi047 bash[22744]: cluster 2024-09-16T09:22:47.338724+0000 mgr.a (mgr.14373) 9762 : cluster [DBG] pgmap v6769: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:22:49.096 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:22:49.096 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:22:49.097 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:22:49.858 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:22:49.858 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:22:49.858 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:22:49.858 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:22:49.859 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:22:50.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:22:50 smithi157 bash[24585]: cluster 2024-09-16T09:22:49.339622+0000 mgr.a (mgr.14373) 9763 : cluster [DBG] pgmap v6770: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:22:50.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:22:50 smithi086 bash[24289]: cluster 2024-09-16T09:22:49.339622+0000 mgr.a (mgr.14373) 9763 : cluster [DBG] pgmap v6770: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:22:50.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:22:50 smithi047 bash[22744]: cluster 2024-09-16T09:22:49.339622+0000 mgr.a (mgr.14373) 9763 : cluster [DBG] pgmap v6770: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:22:51.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:22:51 smithi157 bash[24585]: audit 2024-09-16T09:22:49.427230+0000 mgr.a (mgr.14373) 9764 : audit [DBG] from='client.216027 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:22:51.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:22:51 smithi086 bash[24289]: audit 2024-09-16T09:22:49.427230+0000 mgr.a (mgr.14373) 9764 : audit [DBG] from='client.216027 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:22:51.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:22:51 smithi047 bash[22744]: audit 2024-09-16T09:22:49.427230+0000 mgr.a (mgr.14373) 9764 : audit [DBG] from='client.216027 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:22:52.804 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:22:52 smithi157 bash[24585]: cluster 2024-09-16T09:22:51.341132+0000 mgr.a (mgr.14373) 9765 : cluster [DBG] pgmap v6771: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.1 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:22:52.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:22:52 smithi086 bash[24289]: cluster 2024-09-16T09:22:51.341132+0000 mgr.a (mgr.14373) 9765 : cluster [DBG] pgmap v6771: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.1 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:22:52.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:22:52 smithi047 bash[22744]: cluster 2024-09-16T09:22:51.341132+0000 mgr.a (mgr.14373) 9765 : cluster [DBG] pgmap v6771: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.1 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:22:53.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:22:53 smithi157 bash[24585]: cluster 2024-09-16T09:22:53.342830+0000 mgr.a (mgr.14373) 9766 : cluster [DBG] pgmap v6772: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:22:53.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:22:53 smithi086 bash[24289]: cluster 2024-09-16T09:22:53.342830+0000 mgr.a (mgr.14373) 9766 : cluster [DBG] pgmap v6772: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:22:53.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:22:53 smithi047 bash[22744]: cluster 2024-09-16T09:22:53.342830+0000 mgr.a (mgr.14373) 9766 : cluster [DBG] pgmap v6772: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:22:54.859 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:22:54.860 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:22:54.860 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:22:55.638 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:22:55.638 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:22:55.638 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:22:55.638 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:22:55.638 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:22:55.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:22:55 smithi157 bash[24585]: audit 2024-09-16T09:22:55.191571+0000 mgr.a (mgr.14373) 9767 : audit [DBG] from='client.216105 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:22:55.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:22:55 smithi157 bash[24585]: cluster 2024-09-16T09:22:55.343399+0000 mgr.a (mgr.14373) 9768 : cluster [DBG] pgmap v6773: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:22:55.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:22:55 smithi086 bash[24289]: audit 2024-09-16T09:22:55.191571+0000 mgr.a (mgr.14373) 9767 : audit [DBG] from='client.216105 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:22:55.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:22:55 smithi086 bash[24289]: cluster 2024-09-16T09:22:55.343399+0000 mgr.a (mgr.14373) 9768 : cluster [DBG] pgmap v6773: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:22:55.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:22:55 smithi047 bash[22744]: audit 2024-09-16T09:22:55.191571+0000 mgr.a (mgr.14373) 9767 : audit [DBG] from='client.216105 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:22:55.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:22:55 smithi047 bash[22744]: cluster 2024-09-16T09:22:55.343399+0000 mgr.a (mgr.14373) 9768 : cluster [DBG] pgmap v6773: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:22:58.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:22:58 smithi157 bash[24585]: cluster 2024-09-16T09:22:57.345618+0000 mgr.a (mgr.14373) 9769 : cluster [DBG] pgmap v6774: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:22:58.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:22:58 smithi086 bash[24289]: cluster 2024-09-16T09:22:57.345618+0000 mgr.a (mgr.14373) 9769 : cluster [DBG] pgmap v6774: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:22:58.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:22:58 smithi047 bash[22744]: cluster 2024-09-16T09:22:57.345618+0000 mgr.a (mgr.14373) 9769 : cluster [DBG] pgmap v6774: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:23:00.639 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:23:00.640 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:23:00.640 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:23:00.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:23:00 smithi157 bash[24585]: cluster 2024-09-16T09:22:59.346398+0000 mgr.a (mgr.14373) 9770 : cluster [DBG] pgmap v6775: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:23:00.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:23:00 smithi086 bash[24289]: cluster 2024-09-16T09:22:59.346398+0000 mgr.a (mgr.14373) 9770 : cluster [DBG] pgmap v6775: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:23:00.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:23:00 smithi047 bash[22744]: cluster 2024-09-16T09:22:59.346398+0000 mgr.a (mgr.14373) 9770 : cluster [DBG] pgmap v6775: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:23:01.429 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:23:01.429 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:23:01.430 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:23:01.430 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:23:01.430 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:23:02.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:23:02 smithi157 bash[24585]: audit 2024-09-16T09:23:00.979554+0000 mgr.a (mgr.14373) 9771 : audit [DBG] from='client.216183 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:23:02.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:23:02 smithi157 bash[24585]: cluster 2024-09-16T09:23:01.347175+0000 mgr.a (mgr.14373) 9772 : cluster [DBG] pgmap v6776: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-16T09:23:02.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:23:02 smithi086 bash[24289]: audit 2024-09-16T09:23:00.979554+0000 mgr.a (mgr.14373) 9771 : audit [DBG] from='client.216183 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:23:02.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:23:02 smithi086 bash[24289]: cluster 2024-09-16T09:23:01.347175+0000 mgr.a (mgr.14373) 9772 : cluster [DBG] pgmap v6776: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-16T09:23:02.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:23:02 smithi047 bash[22744]: audit 2024-09-16T09:23:00.979554+0000 mgr.a (mgr.14373) 9771 : audit [DBG] from='client.216183 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:23:02.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:23:02 smithi047 bash[22744]: cluster 2024-09-16T09:23:01.347175+0000 mgr.a (mgr.14373) 9772 : cluster [DBG] pgmap v6776: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-16T09:23:04.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:23:04 smithi157 bash[24585]: cluster 2024-09-16T09:23:03.348804+0000 mgr.a (mgr.14373) 9773 : cluster [DBG] pgmap v6777: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 2 op/s 2024-09-16T09:23:04.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:23:04 smithi086 bash[24289]: cluster 2024-09-16T09:23:03.348804+0000 mgr.a (mgr.14373) 9773 : cluster [DBG] pgmap v6777: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 2 op/s 2024-09-16T09:23:04.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:23:04 smithi047 bash[22744]: cluster 2024-09-16T09:23:03.348804+0000 mgr.a (mgr.14373) 9773 : cluster [DBG] pgmap v6777: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 2 op/s 2024-09-16T09:23:06.431 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:23:06.431 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:23:06.432 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:23:06.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:23:06 smithi157 bash[24585]: cluster 2024-09-16T09:23:05.349548+0000 mgr.a (mgr.14373) 9774 : cluster [DBG] pgmap v6778: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T09:23:06.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:23:06 smithi086 bash[24289]: cluster 2024-09-16T09:23:05.349548+0000 mgr.a (mgr.14373) 9774 : cluster [DBG] pgmap v6778: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T09:23:06.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:23:06 smithi047 bash[22744]: cluster 2024-09-16T09:23:05.349548+0000 mgr.a (mgr.14373) 9774 : cluster [DBG] pgmap v6778: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T09:23:07.207 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:23:07.207 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:23:07.207 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:23:07.207 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:23:07.208 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:23:07.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:23:07 smithi157 bash[24585]: audit 2024-09-16T09:23:06.762651+0000 mgr.a (mgr.14373) 9775 : audit [DBG] from='client.216261 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:23:07.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:23:07 smithi157 bash[24585]: cluster 2024-09-16T09:23:07.352212+0000 mgr.a (mgr.14373) 9776 : cluster [DBG] pgmap v6779: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:23:07.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:23:07 smithi086 bash[24289]: audit 2024-09-16T09:23:06.762651+0000 mgr.a (mgr.14373) 9775 : audit [DBG] from='client.216261 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:23:07.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:23:07 smithi086 bash[24289]: cluster 2024-09-16T09:23:07.352212+0000 mgr.a (mgr.14373) 9776 : cluster [DBG] pgmap v6779: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:23:07.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:23:07 smithi047 bash[22744]: audit 2024-09-16T09:23:06.762651+0000 mgr.a (mgr.14373) 9775 : audit [DBG] from='client.216261 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:23:07.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:23:07 smithi047 bash[22744]: cluster 2024-09-16T09:23:07.352212+0000 mgr.a (mgr.14373) 9776 : cluster [DBG] pgmap v6779: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:23:10.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:23:10 smithi157 bash[24585]: cluster 2024-09-16T09:23:09.352994+0000 mgr.a (mgr.14373) 9777 : cluster [DBG] pgmap v6780: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:23:10.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:23:10 smithi086 bash[24289]: cluster 2024-09-16T09:23:09.352994+0000 mgr.a (mgr.14373) 9777 : cluster [DBG] pgmap v6780: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:23:10.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:23:10 smithi047 bash[22744]: cluster 2024-09-16T09:23:09.352994+0000 mgr.a (mgr.14373) 9777 : cluster [DBG] pgmap v6780: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:23:12.209 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:23:12.209 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:23:12.209 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:23:12.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:23:12 smithi157 bash[24585]: cluster 2024-09-16T09:23:11.354208+0000 mgr.a (mgr.14373) 9778 : cluster [DBG] pgmap v6781: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-16T09:23:12.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:23:12 smithi086 bash[24289]: cluster 2024-09-16T09:23:11.354208+0000 mgr.a (mgr.14373) 9778 : cluster [DBG] pgmap v6781: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-16T09:23:12.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:23:12 smithi047 bash[22744]: cluster 2024-09-16T09:23:11.354208+0000 mgr.a (mgr.14373) 9778 : cluster [DBG] pgmap v6781: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-16T09:23:12.978 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:23:12.978 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:23:12.978 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:23:12.979 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:23:12.979 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:23:14.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:23:14 smithi157 bash[24585]: audit 2024-09-16T09:23:12.543497+0000 mgr.a (mgr.14373) 9779 : audit [DBG] from='client.216336 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:23:14.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:23:14 smithi157 bash[24585]: cluster 2024-09-16T09:23:13.356361+0000 mgr.a (mgr.14373) 9780 : cluster [DBG] pgmap v6782: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-16T09:23:14.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:23:14 smithi086 bash[24289]: audit 2024-09-16T09:23:12.543497+0000 mgr.a (mgr.14373) 9779 : audit [DBG] from='client.216336 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:23:14.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:23:14 smithi086 bash[24289]: cluster 2024-09-16T09:23:13.356361+0000 mgr.a (mgr.14373) 9780 : cluster [DBG] pgmap v6782: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-16T09:23:14.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:23:14 smithi047 bash[22744]: audit 2024-09-16T09:23:12.543497+0000 mgr.a (mgr.14373) 9779 : audit [DBG] from='client.216336 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:23:14.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:23:14 smithi047 bash[22744]: cluster 2024-09-16T09:23:13.356361+0000 mgr.a (mgr.14373) 9780 : cluster [DBG] pgmap v6782: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-16T09:23:16.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:23:16 smithi157 bash[24585]: cluster 2024-09-16T09:23:15.357153+0000 mgr.a (mgr.14373) 9781 : cluster [DBG] pgmap v6783: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-16T09:23:16.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:23:16 smithi086 bash[24289]: cluster 2024-09-16T09:23:15.357153+0000 mgr.a (mgr.14373) 9781 : cluster [DBG] pgmap v6783: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-16T09:23:16.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:23:16 smithi047 bash[22744]: cluster 2024-09-16T09:23:15.357153+0000 mgr.a (mgr.14373) 9781 : cluster [DBG] pgmap v6783: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-16T09:23:17.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:23:17 smithi157 bash[24585]: cluster 2024-09-16T09:23:17.359243+0000 mgr.a (mgr.14373) 9782 : cluster [DBG] pgmap v6784: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-16T09:23:17.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:23:17 smithi086 bash[24289]: cluster 2024-09-16T09:23:17.359243+0000 mgr.a (mgr.14373) 9782 : cluster [DBG] pgmap v6784: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-16T09:23:17.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:23:17 smithi047 bash[22744]: cluster 2024-09-16T09:23:17.359243+0000 mgr.a (mgr.14373) 9782 : cluster [DBG] pgmap v6784: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-16T09:23:17.979 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:23:17.981 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:23:17.981 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:23:18.726 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:23:18.726 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:23:18.726 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:23:18.726 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:23:18.726 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:23:18.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:23:18 smithi157 bash[24585]: audit 2024-09-16T09:23:18.314690+0000 mgr.a (mgr.14373) 9783 : audit [DBG] from='client.216411 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:23:18.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:23:18 smithi086 bash[24289]: audit 2024-09-16T09:23:18.314690+0000 mgr.a (mgr.14373) 9783 : audit [DBG] from='client.216411 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:23:18.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:23:18 smithi047 bash[22744]: audit 2024-09-16T09:23:18.314690+0000 mgr.a (mgr.14373) 9783 : audit [DBG] from='client.216411 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:23:19.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:23:19 smithi157 bash[24585]: cluster 2024-09-16T09:23:19.360368+0000 mgr.a (mgr.14373) 9784 : cluster [DBG] pgmap v6785: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:23:19.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:23:19 smithi086 bash[24289]: cluster 2024-09-16T09:23:19.360368+0000 mgr.a (mgr.14373) 9784 : cluster [DBG] pgmap v6785: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:23:19.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:23:19 smithi047 bash[22744]: cluster 2024-09-16T09:23:19.360368+0000 mgr.a (mgr.14373) 9784 : cluster [DBG] pgmap v6785: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:23:22.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:23:22 smithi157 bash[24585]: cluster 2024-09-16T09:23:21.361969+0000 mgr.a (mgr.14373) 9785 : cluster [DBG] pgmap v6786: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-16T09:23:22.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:23:22 smithi086 bash[24289]: cluster 2024-09-16T09:23:21.361969+0000 mgr.a (mgr.14373) 9785 : cluster [DBG] pgmap v6786: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-16T09:23:22.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:23:22 smithi047 bash[22744]: cluster 2024-09-16T09:23:21.361969+0000 mgr.a (mgr.14373) 9785 : cluster [DBG] pgmap v6786: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-16T09:23:23.727 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:23:23.728 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:23:23.728 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:23:24.479 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:23:24.479 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:23:24.479 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:23:24.479 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:23:24.479 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:23:24.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:23:24 smithi157 bash[24585]: cluster 2024-09-16T09:23:23.363977+0000 mgr.a (mgr.14373) 9786 : cluster [DBG] pgmap v6787: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:23:24.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:23:24 smithi086 bash[24289]: cluster 2024-09-16T09:23:23.363977+0000 mgr.a (mgr.14373) 9786 : cluster [DBG] pgmap v6787: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:23:24.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:23:24 smithi047 bash[22744]: cluster 2024-09-16T09:23:23.363977+0000 mgr.a (mgr.14373) 9786 : cluster [DBG] pgmap v6787: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:23:25.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:23:25 smithi157 bash[24585]: audit 2024-09-16T09:23:24.056019+0000 mgr.a (mgr.14373) 9787 : audit [DBG] from='client.216486 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:23:25.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:23:25 smithi086 bash[24289]: audit 2024-09-16T09:23:24.056019+0000 mgr.a (mgr.14373) 9787 : audit [DBG] from='client.216486 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:23:25.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:23:25 smithi047 bash[22744]: audit 2024-09-16T09:23:24.056019+0000 mgr.a (mgr.14373) 9787 : audit [DBG] from='client.216486 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:23:26.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:23:26 smithi157 bash[24585]: cluster 2024-09-16T09:23:25.364989+0000 mgr.a (mgr.14373) 9788 : cluster [DBG] pgmap v6788: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:23:26.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:23:26 smithi086 bash[24289]: cluster 2024-09-16T09:23:25.364989+0000 mgr.a (mgr.14373) 9788 : cluster [DBG] pgmap v6788: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:23:26.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:23:26 smithi047 bash[22744]: cluster 2024-09-16T09:23:25.364989+0000 mgr.a (mgr.14373) 9788 : cluster [DBG] pgmap v6788: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:23:27.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:23:27 smithi157 bash[24585]: cluster 2024-09-16T09:23:27.367230+0000 mgr.a (mgr.14373) 9789 : cluster [DBG] pgmap v6789: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:23:27.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:23:27 smithi086 bash[24289]: cluster 2024-09-16T09:23:27.367230+0000 mgr.a (mgr.14373) 9789 : cluster [DBG] pgmap v6789: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:23:27.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:23:27 smithi047 bash[22744]: cluster 2024-09-16T09:23:27.367230+0000 mgr.a (mgr.14373) 9789 : cluster [DBG] pgmap v6789: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:23:29.480 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:23:29.481 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:23:29.481 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:23:30.229 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:23:30.229 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:23:30.229 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:23:30.229 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:23:30.229 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:23:30.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:23:30 smithi157 bash[24585]: cluster 2024-09-16T09:23:29.368006+0000 mgr.a (mgr.14373) 9790 : cluster [DBG] pgmap v6790: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:23:30.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:23:30 smithi086 bash[24289]: cluster 2024-09-16T09:23:29.368006+0000 mgr.a (mgr.14373) 9790 : cluster [DBG] pgmap v6790: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:23:30.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:23:30 smithi047 bash[22744]: cluster 2024-09-16T09:23:29.368006+0000 mgr.a (mgr.14373) 9790 : cluster [DBG] pgmap v6790: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:23:31.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:23:31 smithi157 bash[24585]: audit 2024-09-16T09:23:29.808951+0000 mgr.a (mgr.14373) 9791 : audit [DBG] from='client.216564 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:23:31.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:23:31 smithi157 bash[24585]: cluster 2024-09-16T09:23:31.370113+0000 mgr.a (mgr.14373) 9792 : cluster [DBG] pgmap v6791: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-16T09:23:31.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:23:31 smithi086 bash[24289]: audit 2024-09-16T09:23:29.808951+0000 mgr.a (mgr.14373) 9791 : audit [DBG] from='client.216564 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:23:31.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:23:31 smithi086 bash[24289]: cluster 2024-09-16T09:23:31.370113+0000 mgr.a (mgr.14373) 9792 : cluster [DBG] pgmap v6791: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-16T09:23:31.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:23:31 smithi047 bash[22744]: audit 2024-09-16T09:23:29.808951+0000 mgr.a (mgr.14373) 9791 : audit [DBG] from='client.216564 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:23:31.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:23:31 smithi047 bash[22744]: cluster 2024-09-16T09:23:31.370113+0000 mgr.a (mgr.14373) 9792 : cluster [DBG] pgmap v6791: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-16T09:23:33.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:23:33 smithi157 bash[24585]: cluster 2024-09-16T09:23:33.371404+0000 mgr.a (mgr.14373) 9793 : cluster [DBG] pgmap v6792: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:23:33.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:23:33 smithi086 bash[24289]: cluster 2024-09-16T09:23:33.371404+0000 mgr.a (mgr.14373) 9793 : cluster [DBG] pgmap v6792: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:23:33.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:23:33 smithi047 bash[22744]: cluster 2024-09-16T09:23:33.371404+0000 mgr.a (mgr.14373) 9793 : cluster [DBG] pgmap v6792: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:23:35.230 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:23:35.231 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:23:35.231 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:23:36.023 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:23:36.024 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:23:36.024 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:23:36.024 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:23:36.024 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:23:36.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:23:36 smithi157 bash[24585]: cluster 2024-09-16T09:23:35.371960+0000 mgr.a (mgr.14373) 9794 : cluster [DBG] pgmap v6793: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:23:36.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:23:36 smithi157 bash[24585]: audit 2024-09-16T09:23:35.568245+0000 mgr.a (mgr.14373) 9795 : audit [DBG] from='client.216642 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:23:36.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:23:36 smithi086 bash[24289]: cluster 2024-09-16T09:23:35.371960+0000 mgr.a (mgr.14373) 9794 : cluster [DBG] pgmap v6793: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:23:36.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:23:36 smithi086 bash[24289]: audit 2024-09-16T09:23:35.568245+0000 mgr.a (mgr.14373) 9795 : audit [DBG] from='client.216642 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:23:36.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:23:36 smithi047 bash[22744]: cluster 2024-09-16T09:23:35.371960+0000 mgr.a (mgr.14373) 9794 : cluster [DBG] pgmap v6793: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:23:36.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:23:36 smithi047 bash[22744]: audit 2024-09-16T09:23:35.568245+0000 mgr.a (mgr.14373) 9795 : audit [DBG] from='client.216642 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:23:37.808 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:23:37 smithi157 bash[24585]: cluster 2024-09-16T09:23:37.374390+0000 mgr.a (mgr.14373) 9796 : cluster [DBG] pgmap v6794: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:23:37.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:23:37 smithi086 bash[24289]: cluster 2024-09-16T09:23:37.374390+0000 mgr.a (mgr.14373) 9796 : cluster [DBG] pgmap v6794: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:23:37.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:23:37 smithi047 bash[22744]: cluster 2024-09-16T09:23:37.374390+0000 mgr.a (mgr.14373) 9796 : cluster [DBG] pgmap v6794: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:23:38.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:23:38 smithi157 bash[24585]: audit 2024-09-16T09:23:37.759419+0000 mon.b (mon.2) 910 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T09:23:38.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:23:38 smithi157 bash[24585]: audit 2024-09-16T09:23:38.398127+0000 mon.a (mon.0) 1152 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:23:38.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:23:38 smithi157 bash[24585]: audit 2024-09-16T09:23:38.404531+0000 mon.a (mon.0) 1153 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:23:38.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:23:38 smithi086 bash[24289]: audit 2024-09-16T09:23:37.759419+0000 mon.b (mon.2) 910 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T09:23:38.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:23:38 smithi086 bash[24289]: audit 2024-09-16T09:23:38.398127+0000 mon.a (mon.0) 1152 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:23:38.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:23:38 smithi086 bash[24289]: audit 2024-09-16T09:23:38.404531+0000 mon.a (mon.0) 1153 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:23:38.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:23:38 smithi047 bash[22744]: audit 2024-09-16T09:23:37.759419+0000 mon.b (mon.2) 910 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T09:23:38.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:23:38 smithi047 bash[22744]: audit 2024-09-16T09:23:38.398127+0000 mon.a (mon.0) 1152 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:23:38.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:23:38 smithi047 bash[22744]: audit 2024-09-16T09:23:38.404531+0000 mon.a (mon.0) 1153 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:23:39.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:23:39 smithi157 bash[24585]: audit 2024-09-16T09:23:39.162981+0000 mon.b (mon.2) 911 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:23:39.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:23:39 smithi157 bash[24585]: audit 2024-09-16T09:23:39.165070+0000 mon.b (mon.2) 912 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T09:23:39.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:23:39 smithi157 bash[24585]: audit 2024-09-16T09:23:39.173393+0000 mon.a (mon.0) 1154 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:23:39.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:23:39 smithi157 bash[24585]: audit 2024-09-16T09:23:39.179290+0000 mon.b (mon.2) 913 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:23:39.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:23:39 smithi157 bash[24585]: audit 2024-09-16T09:23:39.179762+0000 mgr.a (mgr.14373) 9797 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:23:39.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:23:39 smithi157 bash[24585]: cluster 2024-09-16T09:23:39.374952+0000 mgr.a (mgr.14373) 9798 : cluster [DBG] pgmap v6795: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:23:39.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:23:39 smithi086 bash[24289]: audit 2024-09-16T09:23:39.162981+0000 mon.b (mon.2) 911 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:23:39.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:23:39 smithi086 bash[24289]: audit 2024-09-16T09:23:39.165070+0000 mon.b (mon.2) 912 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T09:23:39.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:23:39 smithi086 bash[24289]: audit 2024-09-16T09:23:39.173393+0000 mon.a (mon.0) 1154 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:23:39.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:23:39 smithi086 bash[24289]: audit 2024-09-16T09:23:39.179290+0000 mon.b (mon.2) 913 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:23:39.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:23:39 smithi086 bash[24289]: audit 2024-09-16T09:23:39.179762+0000 mgr.a (mgr.14373) 9797 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:23:39.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:23:39 smithi086 bash[24289]: cluster 2024-09-16T09:23:39.374952+0000 mgr.a (mgr.14373) 9798 : cluster [DBG] pgmap v6795: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:23:39.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:23:39 smithi047 bash[22744]: audit 2024-09-16T09:23:39.162981+0000 mon.b (mon.2) 911 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:23:39.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:23:39 smithi047 bash[22744]: audit 2024-09-16T09:23:39.165070+0000 mon.b (mon.2) 912 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T09:23:39.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:23:39 smithi047 bash[22744]: audit 2024-09-16T09:23:39.173393+0000 mon.a (mon.0) 1154 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:23:39.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:23:39 smithi047 bash[22744]: audit 2024-09-16T09:23:39.179290+0000 mon.b (mon.2) 913 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:23:39.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:23:39 smithi047 bash[22744]: audit 2024-09-16T09:23:39.179762+0000 mgr.a (mgr.14373) 9797 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:23:39.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:23:39 smithi047 bash[22744]: cluster 2024-09-16T09:23:39.374952+0000 mgr.a (mgr.14373) 9798 : cluster [DBG] pgmap v6795: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:23:40.343 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 09:23:39 smithi047 bash[22994]: debug 2024-09-16T09:23:39.917+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T09:23:40.343 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 09:23:39 smithi047 bash[22994]: debug 2024-09-16T09:23:39.917+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T09:23:41.025 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:23:41.026 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:23:41.026 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:23:41.555 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:23:41 smithi157 bash[24585]: audit 2024-09-16T09:23:39.918535+0000 mgr.a (mgr.14373) 9799 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T09:23:41.555 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:23:41 smithi157 bash[24585]: cephadm 2024-09-16T09:23:39.920849+0000 mgr.a (mgr.14373) 9800 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T09:23:41.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:23:41 smithi086 bash[24289]: audit 2024-09-16T09:23:39.918535+0000 mgr.a (mgr.14373) 9799 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T09:23:41.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:23:41 smithi086 bash[24289]: cephadm 2024-09-16T09:23:39.920849+0000 mgr.a (mgr.14373) 9800 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T09:23:41.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:23:41 smithi047 bash[22744]: audit 2024-09-16T09:23:39.918535+0000 mgr.a (mgr.14373) 9799 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T09:23:41.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:23:41 smithi047 bash[22744]: cephadm 2024-09-16T09:23:39.920849+0000 mgr.a (mgr.14373) 9800 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T09:23:41.778 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:23:41.778 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:23:41.779 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:23:41.779 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:23:41.779 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:23:42.555 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:23:42 smithi157 bash[24585]: audit 2024-09-16T09:23:41.354783+0000 mgr.a (mgr.14373) 9801 : audit [DBG] from='client.216828 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:23:42.555 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:23:42 smithi157 bash[24585]: cluster 2024-09-16T09:23:41.376448+0000 mgr.a (mgr.14373) 9802 : cluster [DBG] pgmap v6796: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:23:42.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:23:42 smithi086 bash[24289]: audit 2024-09-16T09:23:41.354783+0000 mgr.a (mgr.14373) 9801 : audit [DBG] from='client.216828 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:23:42.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:23:42 smithi086 bash[24289]: cluster 2024-09-16T09:23:41.376448+0000 mgr.a (mgr.14373) 9802 : cluster [DBG] pgmap v6796: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:23:42.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:23:42 smithi047 bash[22744]: audit 2024-09-16T09:23:41.354783+0000 mgr.a (mgr.14373) 9801 : audit [DBG] from='client.216828 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:23:42.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:23:42 smithi047 bash[22744]: cluster 2024-09-16T09:23:41.376448+0000 mgr.a (mgr.14373) 9802 : cluster [DBG] pgmap v6796: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:23:43.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:23:43 smithi157 bash[24585]: cluster 2024-09-16T09:23:43.377427+0000 mgr.a (mgr.14373) 9803 : cluster [DBG] pgmap v6797: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T09:23:43.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:23:43 smithi086 bash[24289]: cluster 2024-09-16T09:23:43.377427+0000 mgr.a (mgr.14373) 9803 : cluster [DBG] pgmap v6797: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T09:23:43.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:23:43 smithi047 bash[22744]: cluster 2024-09-16T09:23:43.377427+0000 mgr.a (mgr.14373) 9803 : cluster [DBG] pgmap v6797: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T09:23:45.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:23:45 smithi157 bash[24585]: cluster 2024-09-16T09:23:45.378325+0000 mgr.a (mgr.14373) 9804 : cluster [DBG] pgmap v6798: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T09:23:45.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:23:45 smithi086 bash[24289]: cluster 2024-09-16T09:23:45.378325+0000 mgr.a (mgr.14373) 9804 : cluster [DBG] pgmap v6798: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T09:23:45.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:23:45 smithi047 bash[22744]: cluster 2024-09-16T09:23:45.378325+0000 mgr.a (mgr.14373) 9804 : cluster [DBG] pgmap v6798: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T09:23:46.780 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:23:46.780 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:23:46.780 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:23:47.562 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:23:47.562 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:23:47.562 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:23:47.562 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:23:47.563 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:23:47.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:23:47 smithi157 bash[24585]: audit 2024-09-16T09:23:47.113832+0000 mgr.a (mgr.14373) 9805 : audit [DBG] from='client.216903 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:23:47.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:23:47 smithi157 bash[24585]: cluster 2024-09-16T09:23:47.379694+0000 mgr.a (mgr.14373) 9806 : cluster [DBG] pgmap v6799: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:23:47.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:23:47 smithi086 bash[24289]: audit 2024-09-16T09:23:47.113832+0000 mgr.a (mgr.14373) 9805 : audit [DBG] from='client.216903 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:23:47.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:23:47 smithi086 bash[24289]: cluster 2024-09-16T09:23:47.379694+0000 mgr.a (mgr.14373) 9806 : cluster [DBG] pgmap v6799: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:23:47.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:23:47 smithi047 bash[22744]: audit 2024-09-16T09:23:47.113832+0000 mgr.a (mgr.14373) 9805 : audit [DBG] from='client.216903 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:23:47.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:23:47 smithi047 bash[22744]: cluster 2024-09-16T09:23:47.379694+0000 mgr.a (mgr.14373) 9806 : cluster [DBG] pgmap v6799: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:23:49.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:23:49 smithi157 bash[24585]: cluster 2024-09-16T09:23:49.380556+0000 mgr.a (mgr.14373) 9807 : cluster [DBG] pgmap v6800: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T09:23:49.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:23:49 smithi086 bash[24289]: cluster 2024-09-16T09:23:49.380556+0000 mgr.a (mgr.14373) 9807 : cluster [DBG] pgmap v6800: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T09:23:49.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:23:49 smithi047 bash[22744]: cluster 2024-09-16T09:23:49.380556+0000 mgr.a (mgr.14373) 9807 : cluster [DBG] pgmap v6800: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T09:23:51.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:23:51 smithi157 bash[24585]: cluster 2024-09-16T09:23:51.382699+0000 mgr.a (mgr.14373) 9808 : cluster [DBG] pgmap v6801: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:23:51.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:23:51 smithi086 bash[24289]: cluster 2024-09-16T09:23:51.382699+0000 mgr.a (mgr.14373) 9808 : cluster [DBG] pgmap v6801: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:23:51.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:23:51 smithi047 bash[22744]: cluster 2024-09-16T09:23:51.382699+0000 mgr.a (mgr.14373) 9808 : cluster [DBG] pgmap v6801: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:23:52.563 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:23:52.564 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:23:52.564 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:23:53.343 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:23:53.343 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:23:53.343 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:23:53.343 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:23:53.344 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:23:53.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:23:53 smithi157 bash[24585]: audit 2024-09-16T09:23:52.901804+0000 mgr.a (mgr.14373) 9809 : audit [DBG] from='client.216978 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:23:53.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:23:53 smithi157 bash[24585]: cluster 2024-09-16T09:23:53.383415+0000 mgr.a (mgr.14373) 9810 : cluster [DBG] pgmap v6802: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:23:53.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:23:53 smithi086 bash[24289]: audit 2024-09-16T09:23:52.901804+0000 mgr.a (mgr.14373) 9809 : audit [DBG] from='client.216978 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:23:53.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:23:53 smithi086 bash[24289]: cluster 2024-09-16T09:23:53.383415+0000 mgr.a (mgr.14373) 9810 : cluster [DBG] pgmap v6802: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:23:53.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:23:53 smithi047 bash[22744]: audit 2024-09-16T09:23:52.901804+0000 mgr.a (mgr.14373) 9809 : audit [DBG] from='client.216978 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:23:53.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:23:53 smithi047 bash[22744]: cluster 2024-09-16T09:23:53.383415+0000 mgr.a (mgr.14373) 9810 : cluster [DBG] pgmap v6802: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:23:55.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:23:55 smithi157 bash[24585]: cluster 2024-09-16T09:23:55.384148+0000 mgr.a (mgr.14373) 9811 : cluster [DBG] pgmap v6803: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:23:55.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:23:55 smithi086 bash[24289]: cluster 2024-09-16T09:23:55.384148+0000 mgr.a (mgr.14373) 9811 : cluster [DBG] pgmap v6803: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:23:55.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:23:55 smithi047 bash[22744]: cluster 2024-09-16T09:23:55.384148+0000 mgr.a (mgr.14373) 9811 : cluster [DBG] pgmap v6803: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:23:57.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:23:57 smithi157 bash[24585]: cluster 2024-09-16T09:23:57.386298+0000 mgr.a (mgr.14373) 9812 : cluster [DBG] pgmap v6804: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:23:57.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:23:57 smithi086 bash[24289]: cluster 2024-09-16T09:23:57.386298+0000 mgr.a (mgr.14373) 9812 : cluster [DBG] pgmap v6804: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:23:57.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:23:57 smithi047 bash[22744]: cluster 2024-09-16T09:23:57.386298+0000 mgr.a (mgr.14373) 9812 : cluster [DBG] pgmap v6804: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:23:58.345 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:23:58.345 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:23:58.346 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:23:59.104 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:23:59.105 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:23:59.105 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:23:59.105 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:23:59.105 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:23:59.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:23:59 smithi157 bash[24585]: audit 2024-09-16T09:23:58.674219+0000 mgr.a (mgr.14373) 9813 : audit [DBG] from='client.217053 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:23:59.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:23:59 smithi157 bash[24585]: cluster 2024-09-16T09:23:59.387201+0000 mgr.a (mgr.14373) 9814 : cluster [DBG] pgmap v6805: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:23:59.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:23:59 smithi086 bash[24289]: audit 2024-09-16T09:23:58.674219+0000 mgr.a (mgr.14373) 9813 : audit [DBG] from='client.217053 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:23:59.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:23:59 smithi086 bash[24289]: cluster 2024-09-16T09:23:59.387201+0000 mgr.a (mgr.14373) 9814 : cluster [DBG] pgmap v6805: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:23:59.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:23:59 smithi047 bash[22744]: audit 2024-09-16T09:23:58.674219+0000 mgr.a (mgr.14373) 9813 : audit [DBG] from='client.217053 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:23:59.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:23:59 smithi047 bash[22744]: cluster 2024-09-16T09:23:59.387201+0000 mgr.a (mgr.14373) 9814 : cluster [DBG] pgmap v6805: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:24:01.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:24:01 smithi157 bash[24585]: cluster 2024-09-16T09:24:01.389364+0000 mgr.a (mgr.14373) 9815 : cluster [DBG] pgmap v6806: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:24:01.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:24:01 smithi086 bash[24289]: cluster 2024-09-16T09:24:01.389364+0000 mgr.a (mgr.14373) 9815 : cluster [DBG] pgmap v6806: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:24:01.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:24:01 smithi047 bash[22744]: cluster 2024-09-16T09:24:01.389364+0000 mgr.a (mgr.14373) 9815 : cluster [DBG] pgmap v6806: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:24:03.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:24:03 smithi157 bash[24585]: cluster 2024-09-16T09:24:03.390129+0000 mgr.a (mgr.14373) 9816 : cluster [DBG] pgmap v6807: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:24:03.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:24:03 smithi086 bash[24289]: cluster 2024-09-16T09:24:03.390129+0000 mgr.a (mgr.14373) 9816 : cluster [DBG] pgmap v6807: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:24:03.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:24:03 smithi047 bash[22744]: cluster 2024-09-16T09:24:03.390129+0000 mgr.a (mgr.14373) 9816 : cluster [DBG] pgmap v6807: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:24:04.106 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:24:04.107 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:24:04.107 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:24:04.855 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:24:04.855 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:24:04.855 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:24:04.855 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:24:04.855 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:24:05.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:24:05 smithi157 bash[24585]: audit 2024-09-16T09:24:04.432033+0000 mgr.a (mgr.14373) 9817 : audit [DBG] from='client.217131 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:24:05.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:24:05 smithi157 bash[24585]: cluster 2024-09-16T09:24:05.391130+0000 mgr.a (mgr.14373) 9818 : cluster [DBG] pgmap v6808: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:24:05.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:24:05 smithi086 bash[24289]: audit 2024-09-16T09:24:04.432033+0000 mgr.a (mgr.14373) 9817 : audit [DBG] from='client.217131 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:24:05.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:24:05 smithi086 bash[24289]: cluster 2024-09-16T09:24:05.391130+0000 mgr.a (mgr.14373) 9818 : cluster [DBG] pgmap v6808: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:24:05.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:24:05 smithi047 bash[22744]: audit 2024-09-16T09:24:04.432033+0000 mgr.a (mgr.14373) 9817 : audit [DBG] from='client.217131 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:24:05.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:24:05 smithi047 bash[22744]: cluster 2024-09-16T09:24:05.391130+0000 mgr.a (mgr.14373) 9818 : cluster [DBG] pgmap v6808: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:24:07.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:24:07 smithi157 bash[24585]: cluster 2024-09-16T09:24:07.393273+0000 mgr.a (mgr.14373) 9819 : cluster [DBG] pgmap v6809: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:24:07.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:24:07 smithi086 bash[24289]: cluster 2024-09-16T09:24:07.393273+0000 mgr.a (mgr.14373) 9819 : cluster [DBG] pgmap v6809: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:24:07.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:24:07 smithi047 bash[22744]: cluster 2024-09-16T09:24:07.393273+0000 mgr.a (mgr.14373) 9819 : cluster [DBG] pgmap v6809: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:24:09.809 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:24:09 smithi157 bash[24585]: cluster 2024-09-16T09:24:09.394022+0000 mgr.a (mgr.14373) 9820 : cluster [DBG] pgmap v6810: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:24:09.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:24:09 smithi086 bash[24289]: cluster 2024-09-16T09:24:09.394022+0000 mgr.a (mgr.14373) 9820 : cluster [DBG] pgmap v6810: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:24:09.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:24:09 smithi047 bash[22744]: cluster 2024-09-16T09:24:09.394022+0000 mgr.a (mgr.14373) 9820 : cluster [DBG] pgmap v6810: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:24:09.857 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:24:09.857 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:24:09.857 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:24:10.602 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:24:10.603 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:24:10.603 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:24:10.603 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:24:10.603 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:24:10.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:24:10 smithi157 bash[24585]: audit 2024-09-16T09:24:10.186188+0000 mgr.a (mgr.14373) 9821 : audit [DBG] from='client.217206 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:24:10.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:24:10 smithi086 bash[24289]: audit 2024-09-16T09:24:10.186188+0000 mgr.a (mgr.14373) 9821 : audit [DBG] from='client.217206 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:24:10.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:24:10 smithi047 bash[22744]: audit 2024-09-16T09:24:10.186188+0000 mgr.a (mgr.14373) 9821 : audit [DBG] from='client.217206 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:24:11.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:24:11 smithi157 bash[24585]: cluster 2024-09-16T09:24:11.396365+0000 mgr.a (mgr.14373) 9822 : cluster [DBG] pgmap v6811: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:24:11.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:24:11 smithi086 bash[24289]: cluster 2024-09-16T09:24:11.396365+0000 mgr.a (mgr.14373) 9822 : cluster [DBG] pgmap v6811: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:24:11.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:24:11 smithi047 bash[22744]: cluster 2024-09-16T09:24:11.396365+0000 mgr.a (mgr.14373) 9822 : cluster [DBG] pgmap v6811: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:24:13.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:24:13 smithi157 bash[24585]: cluster 2024-09-16T09:24:13.397125+0000 mgr.a (mgr.14373) 9823 : cluster [DBG] pgmap v6812: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:24:13.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:24:13 smithi086 bash[24289]: cluster 2024-09-16T09:24:13.397125+0000 mgr.a (mgr.14373) 9823 : cluster [DBG] pgmap v6812: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:24:13.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:24:13 smithi047 bash[22744]: cluster 2024-09-16T09:24:13.397125+0000 mgr.a (mgr.14373) 9823 : cluster [DBG] pgmap v6812: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:24:15.604 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:24:15.605 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:24:15.605 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:24:15.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:24:15 smithi157 bash[24585]: cluster 2024-09-16T09:24:15.398036+0000 mgr.a (mgr.14373) 9824 : cluster [DBG] pgmap v6813: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:24:15.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:24:15 smithi086 bash[24289]: cluster 2024-09-16T09:24:15.398036+0000 mgr.a (mgr.14373) 9824 : cluster [DBG] pgmap v6813: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:24:15.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:24:15 smithi047 bash[22744]: cluster 2024-09-16T09:24:15.398036+0000 mgr.a (mgr.14373) 9824 : cluster [DBG] pgmap v6813: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:24:16.388 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:24:16.388 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:24:16.388 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:24:16.388 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:24:16.389 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:24:16.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:24:16 smithi157 bash[24585]: audit 2024-09-16T09:24:15.934617+0000 mgr.a (mgr.14373) 9825 : audit [DBG] from='client.217284 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:24:16.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:24:16 smithi086 bash[24289]: audit 2024-09-16T09:24:15.934617+0000 mgr.a (mgr.14373) 9825 : audit [DBG] from='client.217284 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:24:16.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:24:16 smithi047 bash[22744]: audit 2024-09-16T09:24:15.934617+0000 mgr.a (mgr.14373) 9825 : audit [DBG] from='client.217284 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:24:17.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:24:17 smithi157 bash[24585]: cluster 2024-09-16T09:24:17.400492+0000 mgr.a (mgr.14373) 9826 : cluster [DBG] pgmap v6814: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:24:17.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:24:17 smithi086 bash[24289]: cluster 2024-09-16T09:24:17.400492+0000 mgr.a (mgr.14373) 9826 : cluster [DBG] pgmap v6814: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:24:17.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:24:17 smithi047 bash[22744]: cluster 2024-09-16T09:24:17.400492+0000 mgr.a (mgr.14373) 9826 : cluster [DBG] pgmap v6814: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:24:19.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:24:19 smithi157 bash[24585]: cluster 2024-09-16T09:24:19.401250+0000 mgr.a (mgr.14373) 9827 : cluster [DBG] pgmap v6815: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:24:19.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:24:19 smithi086 bash[24289]: cluster 2024-09-16T09:24:19.401250+0000 mgr.a (mgr.14373) 9827 : cluster [DBG] pgmap v6815: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:24:19.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:24:19 smithi047 bash[22744]: cluster 2024-09-16T09:24:19.401250+0000 mgr.a (mgr.14373) 9827 : cluster [DBG] pgmap v6815: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:24:21.389 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:24:21.390 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:24:21.390 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:24:21.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:24:21 smithi157 bash[24585]: cluster 2024-09-16T09:24:21.402869+0000 mgr.a (mgr.14373) 9828 : cluster [DBG] pgmap v6816: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:24:21.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:24:21 smithi086 bash[24289]: cluster 2024-09-16T09:24:21.402869+0000 mgr.a (mgr.14373) 9828 : cluster [DBG] pgmap v6816: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:24:21.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:24:21 smithi047 bash[22744]: cluster 2024-09-16T09:24:21.402869+0000 mgr.a (mgr.14373) 9828 : cluster [DBG] pgmap v6816: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:24:22.147 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:24:22.148 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:24:22.148 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:24:22.148 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:24:22.148 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:24:22.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:24:22 smithi157 bash[24585]: audit 2024-09-16T09:24:21.728108+0000 mgr.a (mgr.14373) 9829 : audit [DBG] from='client.217359 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:24:22.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:24:22 smithi086 bash[24289]: audit 2024-09-16T09:24:21.728108+0000 mgr.a (mgr.14373) 9829 : audit [DBG] from='client.217359 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:24:22.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:24:22 smithi047 bash[22744]: audit 2024-09-16T09:24:21.728108+0000 mgr.a (mgr.14373) 9829 : audit [DBG] from='client.217359 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:24:23.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:24:23 smithi157 bash[24585]: cluster 2024-09-16T09:24:23.403789+0000 mgr.a (mgr.14373) 9830 : cluster [DBG] pgmap v6817: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:24:23.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:24:23 smithi086 bash[24289]: cluster 2024-09-16T09:24:23.403789+0000 mgr.a (mgr.14373) 9830 : cluster [DBG] pgmap v6817: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:24:23.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:24:23 smithi047 bash[22744]: cluster 2024-09-16T09:24:23.403789+0000 mgr.a (mgr.14373) 9830 : cluster [DBG] pgmap v6817: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:24:25.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:24:25 smithi157 bash[24585]: cluster 2024-09-16T09:24:25.404560+0000 mgr.a (mgr.14373) 9831 : cluster [DBG] pgmap v6818: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T09:24:25.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:24:25 smithi086 bash[24289]: cluster 2024-09-16T09:24:25.404560+0000 mgr.a (mgr.14373) 9831 : cluster [DBG] pgmap v6818: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T09:24:25.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:24:25 smithi047 bash[22744]: cluster 2024-09-16T09:24:25.404560+0000 mgr.a (mgr.14373) 9831 : cluster [DBG] pgmap v6818: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T09:24:27.149 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:24:27.150 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:24:27.150 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:24:27.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:24:27 smithi157 bash[24585]: cluster 2024-09-16T09:24:27.406714+0000 mgr.a (mgr.14373) 9832 : cluster [DBG] pgmap v6819: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:24:27.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:24:27 smithi086 bash[24289]: cluster 2024-09-16T09:24:27.406714+0000 mgr.a (mgr.14373) 9832 : cluster [DBG] pgmap v6819: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:24:27.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:24:27 smithi047 bash[22744]: cluster 2024-09-16T09:24:27.406714+0000 mgr.a (mgr.14373) 9832 : cluster [DBG] pgmap v6819: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:24:27.921 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:24:27.921 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:24:27.921 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:24:27.921 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:24:27.921 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:24:28.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:24:28 smithi157 bash[24585]: audit 2024-09-16T09:24:27.484726+0000 mgr.a (mgr.14373) 9833 : audit [DBG] from='client.217437 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:24:28.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:24:28 smithi086 bash[24289]: audit 2024-09-16T09:24:27.484726+0000 mgr.a (mgr.14373) 9833 : audit [DBG] from='client.217437 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:24:28.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:24:28 smithi047 bash[22744]: audit 2024-09-16T09:24:27.484726+0000 mgr.a (mgr.14373) 9833 : audit [DBG] from='client.217437 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:24:29.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:24:29 smithi157 bash[24585]: cluster 2024-09-16T09:24:29.407767+0000 mgr.a (mgr.14373) 9834 : cluster [DBG] pgmap v6820: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:24:29.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:24:29 smithi086 bash[24289]: cluster 2024-09-16T09:24:29.407767+0000 mgr.a (mgr.14373) 9834 : cluster [DBG] pgmap v6820: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:24:29.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:24:29 smithi047 bash[22744]: cluster 2024-09-16T09:24:29.407767+0000 mgr.a (mgr.14373) 9834 : cluster [DBG] pgmap v6820: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:24:31.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:24:31 smithi157 bash[24585]: cluster 2024-09-16T09:24:31.409965+0000 mgr.a (mgr.14373) 9835 : cluster [DBG] pgmap v6821: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:24:31.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:24:31 smithi086 bash[24289]: cluster 2024-09-16T09:24:31.409965+0000 mgr.a (mgr.14373) 9835 : cluster [DBG] pgmap v6821: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:24:31.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:24:31 smithi047 bash[22744]: cluster 2024-09-16T09:24:31.409965+0000 mgr.a (mgr.14373) 9835 : cluster [DBG] pgmap v6821: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:24:32.922 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:24:32.923 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:24:32.923 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:24:33.693 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:24:33.694 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:24:33.694 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:24:33.694 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:24:33.694 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:24:33.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:24:33 smithi157 bash[24585]: audit 2024-09-16T09:24:33.254173+0000 mgr.a (mgr.14373) 9836 : audit [DBG] from='client.217515 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:24:33.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:24:33 smithi157 bash[24585]: cluster 2024-09-16T09:24:33.410533+0000 mgr.a (mgr.14373) 9837 : cluster [DBG] pgmap v6822: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:24:33.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:24:33 smithi086 bash[24289]: audit 2024-09-16T09:24:33.254173+0000 mgr.a (mgr.14373) 9836 : audit [DBG] from='client.217515 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:24:33.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:24:33 smithi086 bash[24289]: cluster 2024-09-16T09:24:33.410533+0000 mgr.a (mgr.14373) 9837 : cluster [DBG] pgmap v6822: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:24:33.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:24:33 smithi047 bash[22744]: audit 2024-09-16T09:24:33.254173+0000 mgr.a (mgr.14373) 9836 : audit [DBG] from='client.217515 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:24:33.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:24:33 smithi047 bash[22744]: cluster 2024-09-16T09:24:33.410533+0000 mgr.a (mgr.14373) 9837 : cluster [DBG] pgmap v6822: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:24:35.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:24:35 smithi157 bash[24585]: cluster 2024-09-16T09:24:35.411408+0000 mgr.a (mgr.14373) 9838 : cluster [DBG] pgmap v6823: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:24:35.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:24:35 smithi086 bash[24289]: cluster 2024-09-16T09:24:35.411408+0000 mgr.a (mgr.14373) 9838 : cluster [DBG] pgmap v6823: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:24:35.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:24:35 smithi047 bash[22744]: cluster 2024-09-16T09:24:35.411408+0000 mgr.a (mgr.14373) 9838 : cluster [DBG] pgmap v6823: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:24:37.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:24:37 smithi157 bash[24585]: cluster 2024-09-16T09:24:37.413590+0000 mgr.a (mgr.14373) 9839 : cluster [DBG] pgmap v6824: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:24:37.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:24:37 smithi086 bash[24289]: cluster 2024-09-16T09:24:37.413590+0000 mgr.a (mgr.14373) 9839 : cluster [DBG] pgmap v6824: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:24:37.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:24:37 smithi047 bash[22744]: cluster 2024-09-16T09:24:37.413590+0000 mgr.a (mgr.14373) 9839 : cluster [DBG] pgmap v6824: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:24:38.695 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:24:38.696 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:24:38.696 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:24:39.451 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:24:39.451 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:24:39.451 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:24:39.451 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:24:39.451 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:24:39.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:24:39 smithi157 bash[24585]: audit 2024-09-16T09:24:39.025704+0000 mgr.a (mgr.14373) 9840 : audit [DBG] from='client.217587 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:24:39.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:24:39 smithi157 bash[24585]: cluster 2024-09-16T09:24:39.414066+0000 mgr.a (mgr.14373) 9841 : cluster [DBG] pgmap v6825: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:24:39.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:24:39 smithi086 bash[24289]: audit 2024-09-16T09:24:39.025704+0000 mgr.a (mgr.14373) 9840 : audit [DBG] from='client.217587 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:24:39.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:24:39 smithi086 bash[24289]: cluster 2024-09-16T09:24:39.414066+0000 mgr.a (mgr.14373) 9841 : cluster [DBG] pgmap v6825: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:24:39.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:24:39 smithi047 bash[22744]: audit 2024-09-16T09:24:39.025704+0000 mgr.a (mgr.14373) 9840 : audit [DBG] from='client.217587 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:24:39.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:24:39 smithi047 bash[22744]: cluster 2024-09-16T09:24:39.414066+0000 mgr.a (mgr.14373) 9841 : cluster [DBG] pgmap v6825: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:24:40.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:24:40 smithi157 bash[24585]: audit 2024-09-16T09:24:39.973078+0000 mon.b (mon.2) 914 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T09:24:40.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:24:40 smithi086 bash[24289]: audit 2024-09-16T09:24:39.973078+0000 mon.b (mon.2) 914 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T09:24:40.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:24:40 smithi047 bash[22744]: audit 2024-09-16T09:24:39.973078+0000 mon.b (mon.2) 914 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T09:24:42.055 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:24:41 smithi157 bash[24585]: audit 2024-09-16T09:24:40.600702+0000 mon.a (mon.0) 1155 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:24:42.055 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:24:41 smithi157 bash[24585]: audit 2024-09-16T09:24:40.604975+0000 mon.a (mon.0) 1156 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:24:42.055 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:24:41 smithi157 bash[24585]: audit 2024-09-16T09:24:40.608478+0000 mon.a (mon.0) 1157 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:24:42.055 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:24:41 smithi157 bash[24585]: audit 2024-09-16T09:24:40.612637+0000 mon.a (mon.0) 1158 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:24:42.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:24:41 smithi157 bash[24585]: cluster 2024-09-16T09:24:41.415217+0000 mgr.a (mgr.14373) 9842 : cluster [DBG] pgmap v6826: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:24:42.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:24:41 smithi157 bash[24585]: audit 2024-09-16T09:24:41.435918+0000 mon.b (mon.2) 915 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:24:42.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:24:41 smithi157 bash[24585]: audit 2024-09-16T09:24:41.438044+0000 mon.b (mon.2) 916 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T09:24:42.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:24:41 smithi157 bash[24585]: audit 2024-09-16T09:24:41.446329+0000 mon.a (mon.0) 1159 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:24:42.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:24:41 smithi157 bash[24585]: audit 2024-09-16T09:24:41.453807+0000 mon.b (mon.2) 917 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:24:42.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:24:41 smithi086 bash[24289]: audit 2024-09-16T09:24:40.600702+0000 mon.a (mon.0) 1155 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:24:42.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:24:41 smithi086 bash[24289]: audit 2024-09-16T09:24:40.604975+0000 mon.a (mon.0) 1156 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:24:42.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:24:41 smithi086 bash[24289]: audit 2024-09-16T09:24:40.608478+0000 mon.a (mon.0) 1157 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:24:42.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:24:41 smithi086 bash[24289]: audit 2024-09-16T09:24:40.612637+0000 mon.a (mon.0) 1158 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:24:42.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:24:41 smithi086 bash[24289]: cluster 2024-09-16T09:24:41.415217+0000 mgr.a (mgr.14373) 9842 : cluster [DBG] pgmap v6826: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:24:42.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:24:41 smithi086 bash[24289]: audit 2024-09-16T09:24:41.435918+0000 mon.b (mon.2) 915 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:24:42.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:24:41 smithi086 bash[24289]: audit 2024-09-16T09:24:41.438044+0000 mon.b (mon.2) 916 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T09:24:42.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:24:41 smithi086 bash[24289]: audit 2024-09-16T09:24:41.446329+0000 mon.a (mon.0) 1159 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:24:42.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:24:41 smithi086 bash[24289]: audit 2024-09-16T09:24:41.453807+0000 mon.b (mon.2) 917 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:24:42.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:24:41 smithi047 bash[22744]: audit 2024-09-16T09:24:40.600702+0000 mon.a (mon.0) 1155 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:24:42.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:24:41 smithi047 bash[22744]: audit 2024-09-16T09:24:40.604975+0000 mon.a (mon.0) 1156 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:24:42.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:24:41 smithi047 bash[22744]: audit 2024-09-16T09:24:40.608478+0000 mon.a (mon.0) 1157 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:24:42.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:24:41 smithi047 bash[22744]: audit 2024-09-16T09:24:40.612637+0000 mon.a (mon.0) 1158 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:24:42.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:24:41 smithi047 bash[22744]: cluster 2024-09-16T09:24:41.415217+0000 mgr.a (mgr.14373) 9842 : cluster [DBG] pgmap v6826: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:24:42.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:24:41 smithi047 bash[22744]: audit 2024-09-16T09:24:41.435918+0000 mon.b (mon.2) 915 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:24:42.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:24:41 smithi047 bash[22744]: audit 2024-09-16T09:24:41.438044+0000 mon.b (mon.2) 916 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T09:24:42.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:24:41 smithi047 bash[22744]: audit 2024-09-16T09:24:41.446329+0000 mon.a (mon.0) 1159 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:24:42.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:24:41 smithi047 bash[22744]: audit 2024-09-16T09:24:41.453807+0000 mon.b (mon.2) 917 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:24:42.593 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 09:24:42 smithi047 bash[22994]: debug 2024-09-16T09:24:42.183+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T09:24:42.593 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 09:24:42 smithi047 bash[22994]: debug 2024-09-16T09:24:42.187+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T09:24:43.055 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:24:42 smithi157 bash[24585]: audit 2024-09-16T09:24:41.454313+0000 mgr.a (mgr.14373) 9843 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:24:43.055 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:24:42 smithi157 bash[24585]: audit 2024-09-16T09:24:42.190034+0000 mgr.a (mgr.14373) 9844 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T09:24:43.055 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:24:42 smithi157 bash[24585]: cephadm 2024-09-16T09:24:42.191754+0000 mgr.a (mgr.14373) 9845 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T09:24:43.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:24:42 smithi086 bash[24289]: audit 2024-09-16T09:24:41.454313+0000 mgr.a (mgr.14373) 9843 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:24:43.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:24:42 smithi086 bash[24289]: audit 2024-09-16T09:24:42.190034+0000 mgr.a (mgr.14373) 9844 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T09:24:43.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:24:42 smithi086 bash[24289]: cephadm 2024-09-16T09:24:42.191754+0000 mgr.a (mgr.14373) 9845 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T09:24:43.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:24:42 smithi047 bash[22744]: audit 2024-09-16T09:24:41.454313+0000 mgr.a (mgr.14373) 9843 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:24:43.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:24:42 smithi047 bash[22744]: audit 2024-09-16T09:24:42.190034+0000 mgr.a (mgr.14373) 9844 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T09:24:43.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:24:42 smithi047 bash[22744]: cephadm 2024-09-16T09:24:42.191754+0000 mgr.a (mgr.14373) 9845 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T09:24:44.055 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:24:43 smithi157 bash[24585]: cluster 2024-09-16T09:24:43.416076+0000 mgr.a (mgr.14373) 9846 : cluster [DBG] pgmap v6827: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:24:44.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:24:43 smithi086 bash[24289]: cluster 2024-09-16T09:24:43.416076+0000 mgr.a (mgr.14373) 9846 : cluster [DBG] pgmap v6827: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:24:44.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:24:43 smithi047 bash[22744]: cluster 2024-09-16T09:24:43.416076+0000 mgr.a (mgr.14373) 9846 : cluster [DBG] pgmap v6827: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:24:44.453 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:24:44.453 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:24:44.453 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:24:45.218 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:24:45.218 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:24:45.218 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:24:45.218 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:24:45.219 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:24:45.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:24:45 smithi157 bash[24585]: audit 2024-09-16T09:24:44.785939+0000 mgr.a (mgr.14373) 9847 : audit [DBG] from='client.217773 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:24:45.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:24:45 smithi157 bash[24585]: cluster 2024-09-16T09:24:45.417002+0000 mgr.a (mgr.14373) 9848 : cluster [DBG] pgmap v6828: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:24:45.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:24:45 smithi086 bash[24289]: audit 2024-09-16T09:24:44.785939+0000 mgr.a (mgr.14373) 9847 : audit [DBG] from='client.217773 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:24:45.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:24:45 smithi086 bash[24289]: cluster 2024-09-16T09:24:45.417002+0000 mgr.a (mgr.14373) 9848 : cluster [DBG] pgmap v6828: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:24:45.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:24:45 smithi047 bash[22744]: audit 2024-09-16T09:24:44.785939+0000 mgr.a (mgr.14373) 9847 : audit [DBG] from='client.217773 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:24:45.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:24:45 smithi047 bash[22744]: cluster 2024-09-16T09:24:45.417002+0000 mgr.a (mgr.14373) 9848 : cluster [DBG] pgmap v6828: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:24:47.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:24:47 smithi157 bash[24585]: cluster 2024-09-16T09:24:47.419193+0000 mgr.a (mgr.14373) 9849 : cluster [DBG] pgmap v6829: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:24:47.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:24:47 smithi086 bash[24289]: cluster 2024-09-16T09:24:47.419193+0000 mgr.a (mgr.14373) 9849 : cluster [DBG] pgmap v6829: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:24:47.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:24:47 smithi047 bash[22744]: cluster 2024-09-16T09:24:47.419193+0000 mgr.a (mgr.14373) 9849 : cluster [DBG] pgmap v6829: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:24:49.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:24:49 smithi157 bash[24585]: cluster 2024-09-16T09:24:49.420010+0000 mgr.a (mgr.14373) 9850 : cluster [DBG] pgmap v6830: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:24:49.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:24:49 smithi086 bash[24289]: cluster 2024-09-16T09:24:49.420010+0000 mgr.a (mgr.14373) 9850 : cluster [DBG] pgmap v6830: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:24:49.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:24:49 smithi047 bash[22744]: cluster 2024-09-16T09:24:49.420010+0000 mgr.a (mgr.14373) 9850 : cluster [DBG] pgmap v6830: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:24:50.220 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:24:50.220 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:24:50.220 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:24:50.966 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:24:50.966 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:24:50.967 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:24:50.967 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:24:50.967 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:24:51.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:24:51 smithi157 bash[24585]: audit 2024-09-16T09:24:50.548162+0000 mgr.a (mgr.14373) 9851 : audit [DBG] from='client.217851 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:24:51.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:24:51 smithi157 bash[24585]: cluster 2024-09-16T09:24:51.422321+0000 mgr.a (mgr.14373) 9852 : cluster [DBG] pgmap v6831: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:24:51.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:24:51 smithi086 bash[24289]: audit 2024-09-16T09:24:50.548162+0000 mgr.a (mgr.14373) 9851 : audit [DBG] from='client.217851 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:24:51.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:24:51 smithi086 bash[24289]: cluster 2024-09-16T09:24:51.422321+0000 mgr.a (mgr.14373) 9852 : cluster [DBG] pgmap v6831: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:24:51.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:24:51 smithi047 bash[22744]: audit 2024-09-16T09:24:50.548162+0000 mgr.a (mgr.14373) 9851 : audit [DBG] from='client.217851 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:24:51.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:24:51 smithi047 bash[22744]: cluster 2024-09-16T09:24:51.422321+0000 mgr.a (mgr.14373) 9852 : cluster [DBG] pgmap v6831: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:24:53.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:24:53 smithi157 bash[24585]: cluster 2024-09-16T09:24:53.423104+0000 mgr.a (mgr.14373) 9853 : cluster [DBG] pgmap v6832: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:24:53.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:24:53 smithi086 bash[24289]: cluster 2024-09-16T09:24:53.423104+0000 mgr.a (mgr.14373) 9853 : cluster [DBG] pgmap v6832: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:24:53.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:24:53 smithi047 bash[22744]: cluster 2024-09-16T09:24:53.423104+0000 mgr.a (mgr.14373) 9853 : cluster [DBG] pgmap v6832: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:24:55.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:24:55 smithi157 bash[24585]: cluster 2024-09-16T09:24:55.423854+0000 mgr.a (mgr.14373) 9854 : cluster [DBG] pgmap v6833: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:24:55.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:24:55 smithi086 bash[24289]: cluster 2024-09-16T09:24:55.423854+0000 mgr.a (mgr.14373) 9854 : cluster [DBG] pgmap v6833: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:24:55.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:24:55 smithi047 bash[22744]: cluster 2024-09-16T09:24:55.423854+0000 mgr.a (mgr.14373) 9854 : cluster [DBG] pgmap v6833: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:24:55.968 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:24:55.969 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:24:55.969 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:24:56.714 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:24:56.714 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:24:56.714 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:24:56.714 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:24:56.714 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:24:56.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:24:56 smithi157 bash[24585]: audit 2024-09-16T09:24:56.297866+0000 mgr.a (mgr.14373) 9855 : audit [DBG] from='client.217929 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:24:56.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:24:56 smithi086 bash[24289]: audit 2024-09-16T09:24:56.297866+0000 mgr.a (mgr.14373) 9855 : audit [DBG] from='client.217929 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:24:56.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:24:56 smithi047 bash[22744]: audit 2024-09-16T09:24:56.297866+0000 mgr.a (mgr.14373) 9855 : audit [DBG] from='client.217929 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:24:57.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:24:57 smithi157 bash[24585]: cluster 2024-09-16T09:24:57.426697+0000 mgr.a (mgr.14373) 9856 : cluster [DBG] pgmap v6834: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:24:57.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:24:57 smithi086 bash[24289]: cluster 2024-09-16T09:24:57.426697+0000 mgr.a (mgr.14373) 9856 : cluster [DBG] pgmap v6834: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:24:57.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:24:57 smithi047 bash[22744]: cluster 2024-09-16T09:24:57.426697+0000 mgr.a (mgr.14373) 9856 : cluster [DBG] pgmap v6834: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:24:59.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:24:59 smithi157 bash[24585]: cluster 2024-09-16T09:24:59.427481+0000 mgr.a (mgr.14373) 9857 : cluster [DBG] pgmap v6835: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:24:59.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:24:59 smithi086 bash[24289]: cluster 2024-09-16T09:24:59.427481+0000 mgr.a (mgr.14373) 9857 : cluster [DBG] pgmap v6835: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:24:59.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:24:59 smithi047 bash[22744]: cluster 2024-09-16T09:24:59.427481+0000 mgr.a (mgr.14373) 9857 : cluster [DBG] pgmap v6835: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:25:01.716 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:25:01.716 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:25:01.716 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:25:01.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:25:01 smithi157 bash[24585]: cluster 2024-09-16T09:25:01.429445+0000 mgr.a (mgr.14373) 9858 : cluster [DBG] pgmap v6836: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:25:01.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:25:01 smithi086 bash[24289]: cluster 2024-09-16T09:25:01.429445+0000 mgr.a (mgr.14373) 9858 : cluster [DBG] pgmap v6836: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:25:01.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:25:01 smithi047 bash[22744]: cluster 2024-09-16T09:25:01.429445+0000 mgr.a (mgr.14373) 9858 : cluster [DBG] pgmap v6836: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:25:02.462 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:25:02.462 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:25:02.462 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:25:02.462 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:25:02.463 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:25:02.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:25:02 smithi157 bash[24585]: audit 2024-09-16T09:25:02.043510+0000 mgr.a (mgr.14373) 9859 : audit [DBG] from='client.218007 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:25:02.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:25:02 smithi086 bash[24289]: audit 2024-09-16T09:25:02.043510+0000 mgr.a (mgr.14373) 9859 : audit [DBG] from='client.218007 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:25:02.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:25:02 smithi047 bash[22744]: audit 2024-09-16T09:25:02.043510+0000 mgr.a (mgr.14373) 9859 : audit [DBG] from='client.218007 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:25:03.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:25:03 smithi157 bash[24585]: cluster 2024-09-16T09:25:03.430547+0000 mgr.a (mgr.14373) 9860 : cluster [DBG] pgmap v6837: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:25:03.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:25:03 smithi086 bash[24289]: cluster 2024-09-16T09:25:03.430547+0000 mgr.a (mgr.14373) 9860 : cluster [DBG] pgmap v6837: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:25:03.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:25:03 smithi047 bash[22744]: cluster 2024-09-16T09:25:03.430547+0000 mgr.a (mgr.14373) 9860 : cluster [DBG] pgmap v6837: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:25:05.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:25:05 smithi157 bash[24585]: cluster 2024-09-16T09:25:05.431484+0000 mgr.a (mgr.14373) 9861 : cluster [DBG] pgmap v6838: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T09:25:05.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:25:05 smithi086 bash[24289]: cluster 2024-09-16T09:25:05.431484+0000 mgr.a (mgr.14373) 9861 : cluster [DBG] pgmap v6838: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T09:25:05.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:25:05 smithi047 bash[22744]: cluster 2024-09-16T09:25:05.431484+0000 mgr.a (mgr.14373) 9861 : cluster [DBG] pgmap v6838: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T09:25:07.464 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:25:07.464 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:25:07.465 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:25:07.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:25:07 smithi157 bash[24585]: cluster 2024-09-16T09:25:07.433822+0000 mgr.a (mgr.14373) 9862 : cluster [DBG] pgmap v6839: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:25:07.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:25:07 smithi086 bash[24289]: cluster 2024-09-16T09:25:07.433822+0000 mgr.a (mgr.14373) 9862 : cluster [DBG] pgmap v6839: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:25:07.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:25:07 smithi047 bash[22744]: cluster 2024-09-16T09:25:07.433822+0000 mgr.a (mgr.14373) 9862 : cluster [DBG] pgmap v6839: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:25:08.221 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:25:08.221 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:25:08.221 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:25:08.221 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:25:08.221 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:25:08.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:25:08 smithi157 bash[24585]: audit 2024-09-16T09:25:07.801578+0000 mgr.a (mgr.14373) 9863 : audit [DBG] from='client.218082 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:25:08.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:25:08 smithi086 bash[24289]: audit 2024-09-16T09:25:07.801578+0000 mgr.a (mgr.14373) 9863 : audit [DBG] from='client.218082 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:25:08.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:25:08 smithi047 bash[22744]: audit 2024-09-16T09:25:07.801578+0000 mgr.a (mgr.14373) 9863 : audit [DBG] from='client.218082 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:25:09.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:25:09 smithi157 bash[24585]: cluster 2024-09-16T09:25:09.434756+0000 mgr.a (mgr.14373) 9864 : cluster [DBG] pgmap v6840: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:25:09.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:25:09 smithi086 bash[24289]: cluster 2024-09-16T09:25:09.434756+0000 mgr.a (mgr.14373) 9864 : cluster [DBG] pgmap v6840: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:25:09.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:25:09 smithi047 bash[22744]: cluster 2024-09-16T09:25:09.434756+0000 mgr.a (mgr.14373) 9864 : cluster [DBG] pgmap v6840: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:25:11.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:25:11 smithi157 bash[24585]: cluster 2024-09-16T09:25:11.436865+0000 mgr.a (mgr.14373) 9865 : cluster [DBG] pgmap v6841: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:25:11.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:25:11 smithi086 bash[24289]: cluster 2024-09-16T09:25:11.436865+0000 mgr.a (mgr.14373) 9865 : cluster [DBG] pgmap v6841: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:25:11.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:25:11 smithi047 bash[22744]: cluster 2024-09-16T09:25:11.436865+0000 mgr.a (mgr.14373) 9865 : cluster [DBG] pgmap v6841: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:25:13.219 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:25:13.220 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:25:13.220 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:25:13.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:25:13 smithi157 bash[24585]: cluster 2024-09-16T09:25:13.437398+0000 mgr.a (mgr.14373) 9866 : cluster [DBG] pgmap v6842: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:25:13.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:25:13 smithi086 bash[24289]: cluster 2024-09-16T09:25:13.437398+0000 mgr.a (mgr.14373) 9866 : cluster [DBG] pgmap v6842: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:25:13.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:25:13 smithi047 bash[22744]: cluster 2024-09-16T09:25:13.437398+0000 mgr.a (mgr.14373) 9866 : cluster [DBG] pgmap v6842: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:25:13.997 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:25:13.997 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:25:13.997 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:25:13.998 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:25:13.998 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:25:14.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:25:14 smithi157 bash[24585]: audit 2024-09-16T09:25:13.556088+0000 mgr.a (mgr.14373) 9867 : audit [DBG] from='client.218157 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:25:14.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:25:14 smithi086 bash[24289]: audit 2024-09-16T09:25:13.556088+0000 mgr.a (mgr.14373) 9867 : audit [DBG] from='client.218157 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:25:14.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:25:14 smithi047 bash[22744]: audit 2024-09-16T09:25:13.556088+0000 mgr.a (mgr.14373) 9867 : audit [DBG] from='client.218157 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:25:15.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:25:15 smithi157 bash[24585]: cluster 2024-09-16T09:25:15.438262+0000 mgr.a (mgr.14373) 9868 : cluster [DBG] pgmap v6843: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:25:15.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:25:15 smithi086 bash[24289]: cluster 2024-09-16T09:25:15.438262+0000 mgr.a (mgr.14373) 9868 : cluster [DBG] pgmap v6843: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:25:15.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:25:15 smithi047 bash[22744]: cluster 2024-09-16T09:25:15.438262+0000 mgr.a (mgr.14373) 9868 : cluster [DBG] pgmap v6843: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:25:17.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:25:17 smithi157 bash[24585]: cluster 2024-09-16T09:25:17.440503+0000 mgr.a (mgr.14373) 9869 : cluster [DBG] pgmap v6844: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:25:17.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:25:17 smithi086 bash[24289]: cluster 2024-09-16T09:25:17.440503+0000 mgr.a (mgr.14373) 9869 : cluster [DBG] pgmap v6844: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:25:17.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:25:17 smithi047 bash[22744]: cluster 2024-09-16T09:25:17.440503+0000 mgr.a (mgr.14373) 9869 : cluster [DBG] pgmap v6844: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:25:18.999 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:25:19.000 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:25:19.000 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:25:19.755 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:25:19.756 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:25:19.756 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:25:19.756 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:25:19.756 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:25:19.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:25:19 smithi157 bash[24585]: audit 2024-09-16T09:25:19.331839+0000 mgr.a (mgr.14373) 9870 : audit [DBG] from='client.218235 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:25:19.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:25:19 smithi157 bash[24585]: cluster 2024-09-16T09:25:19.440996+0000 mgr.a (mgr.14373) 9871 : cluster [DBG] pgmap v6845: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:25:19.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:25:19 smithi086 bash[24289]: audit 2024-09-16T09:25:19.331839+0000 mgr.a (mgr.14373) 9870 : audit [DBG] from='client.218235 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:25:19.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:25:19 smithi086 bash[24289]: cluster 2024-09-16T09:25:19.440996+0000 mgr.a (mgr.14373) 9871 : cluster [DBG] pgmap v6845: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:25:19.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:25:19 smithi047 bash[22744]: audit 2024-09-16T09:25:19.331839+0000 mgr.a (mgr.14373) 9870 : audit [DBG] from='client.218235 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:25:19.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:25:19 smithi047 bash[22744]: cluster 2024-09-16T09:25:19.440996+0000 mgr.a (mgr.14373) 9871 : cluster [DBG] pgmap v6845: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:25:21.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:25:21 smithi157 bash[24585]: cluster 2024-09-16T09:25:21.443212+0000 mgr.a (mgr.14373) 9872 : cluster [DBG] pgmap v6846: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:25:21.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:25:21 smithi086 bash[24289]: cluster 2024-09-16T09:25:21.443212+0000 mgr.a (mgr.14373) 9872 : cluster [DBG] pgmap v6846: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:25:21.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:25:21 smithi047 bash[22744]: cluster 2024-09-16T09:25:21.443212+0000 mgr.a (mgr.14373) 9872 : cluster [DBG] pgmap v6846: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:25:23.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:25:23 smithi157 bash[24585]: cluster 2024-09-16T09:25:23.443950+0000 mgr.a (mgr.14373) 9873 : cluster [DBG] pgmap v6847: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:25:23.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:25:23 smithi086 bash[24289]: cluster 2024-09-16T09:25:23.443950+0000 mgr.a (mgr.14373) 9873 : cluster [DBG] pgmap v6847: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:25:23.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:25:23 smithi047 bash[22744]: cluster 2024-09-16T09:25:23.443950+0000 mgr.a (mgr.14373) 9873 : cluster [DBG] pgmap v6847: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:25:24.757 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:25:24.757 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:25:24.758 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:25:25.522 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:25:25.522 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:25:25.523 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:25:25.523 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:25:25.523 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:25:25.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:25:25 smithi157 bash[24585]: audit 2024-09-16T09:25:25.092086+0000 mgr.a (mgr.14373) 9874 : audit [DBG] from='client.218310 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:25:25.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:25:25 smithi157 bash[24585]: cluster 2024-09-16T09:25:25.444751+0000 mgr.a (mgr.14373) 9875 : cluster [DBG] pgmap v6848: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:25:25.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:25:25 smithi086 bash[24289]: audit 2024-09-16T09:25:25.092086+0000 mgr.a (mgr.14373) 9874 : audit [DBG] from='client.218310 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:25:25.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:25:25 smithi086 bash[24289]: cluster 2024-09-16T09:25:25.444751+0000 mgr.a (mgr.14373) 9875 : cluster [DBG] pgmap v6848: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:25:25.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:25:25 smithi047 bash[22744]: audit 2024-09-16T09:25:25.092086+0000 mgr.a (mgr.14373) 9874 : audit [DBG] from='client.218310 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:25:25.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:25:25 smithi047 bash[22744]: cluster 2024-09-16T09:25:25.444751+0000 mgr.a (mgr.14373) 9875 : cluster [DBG] pgmap v6848: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:25:28.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:25:28 smithi157 bash[24585]: cluster 2024-09-16T09:25:27.447005+0000 mgr.a (mgr.14373) 9876 : cluster [DBG] pgmap v6849: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:25:28.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:25:28 smithi086 bash[24289]: cluster 2024-09-16T09:25:27.447005+0000 mgr.a (mgr.14373) 9876 : cluster [DBG] pgmap v6849: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:25:28.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:25:28 smithi047 bash[22744]: cluster 2024-09-16T09:25:27.447005+0000 mgr.a (mgr.14373) 9876 : cluster [DBG] pgmap v6849: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:25:30.524 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:25:30.524 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:25:30.525 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:25:30.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:25:30 smithi157 bash[24585]: cluster 2024-09-16T09:25:29.447753+0000 mgr.a (mgr.14373) 9877 : cluster [DBG] pgmap v6850: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:25:30.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:25:30 smithi086 bash[24289]: cluster 2024-09-16T09:25:29.447753+0000 mgr.a (mgr.14373) 9877 : cluster [DBG] pgmap v6850: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:25:30.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:25:30 smithi047 bash[22744]: cluster 2024-09-16T09:25:29.447753+0000 mgr.a (mgr.14373) 9877 : cluster [DBG] pgmap v6850: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:25:31.295 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:25:31.296 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:25:31.296 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:25:31.296 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:25:31.296 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:25:31.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:25:31 smithi157 bash[24585]: audit 2024-09-16T09:25:30.858677+0000 mgr.a (mgr.14373) 9878 : audit [DBG] from='client.218385 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:25:31.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:25:31 smithi086 bash[24289]: audit 2024-09-16T09:25:30.858677+0000 mgr.a (mgr.14373) 9878 : audit [DBG] from='client.218385 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:25:31.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:25:31 smithi047 bash[22744]: audit 2024-09-16T09:25:30.858677+0000 mgr.a (mgr.14373) 9878 : audit [DBG] from='client.218385 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:25:32.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:25:32 smithi157 bash[24585]: cluster 2024-09-16T09:25:31.450119+0000 mgr.a (mgr.14373) 9879 : cluster [DBG] pgmap v6851: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:25:32.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:25:32 smithi086 bash[24289]: cluster 2024-09-16T09:25:31.450119+0000 mgr.a (mgr.14373) 9879 : cluster [DBG] pgmap v6851: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:25:32.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:25:32 smithi047 bash[22744]: cluster 2024-09-16T09:25:31.450119+0000 mgr.a (mgr.14373) 9879 : cluster [DBG] pgmap v6851: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:25:34.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:25:34 smithi157 bash[24585]: cluster 2024-09-16T09:25:33.450921+0000 mgr.a (mgr.14373) 9880 : cluster [DBG] pgmap v6852: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:25:34.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:25:34 smithi086 bash[24289]: cluster 2024-09-16T09:25:33.450921+0000 mgr.a (mgr.14373) 9880 : cluster [DBG] pgmap v6852: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:25:34.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:25:34 smithi047 bash[22744]: cluster 2024-09-16T09:25:33.450921+0000 mgr.a (mgr.14373) 9880 : cluster [DBG] pgmap v6852: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:25:36.297 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:25:36.298 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:25:36.298 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:25:36.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:25:36 smithi157 bash[24585]: cluster 2024-09-16T09:25:35.451684+0000 mgr.a (mgr.14373) 9881 : cluster [DBG] pgmap v6853: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:25:36.818 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:25:36 smithi086 bash[24289]: cluster 2024-09-16T09:25:35.451684+0000 mgr.a (mgr.14373) 9881 : cluster [DBG] pgmap v6853: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:25:36.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:25:36 smithi047 bash[22744]: cluster 2024-09-16T09:25:35.451684+0000 mgr.a (mgr.14373) 9881 : cluster [DBG] pgmap v6853: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:25:37.072 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:25:37.073 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:25:37.073 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:25:37.073 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:25:37.073 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:25:37.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:25:37 smithi157 bash[24585]: audit 2024-09-16T09:25:36.631974+0000 mgr.a (mgr.14373) 9882 : audit [DBG] from='client.218463 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:25:37.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:25:37 smithi086 bash[24289]: audit 2024-09-16T09:25:36.631974+0000 mgr.a (mgr.14373) 9882 : audit [DBG] from='client.218463 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:25:37.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:25:37 smithi047 bash[22744]: audit 2024-09-16T09:25:36.631974+0000 mgr.a (mgr.14373) 9882 : audit [DBG] from='client.218463 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:25:38.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:25:38 smithi157 bash[24585]: cluster 2024-09-16T09:25:37.454535+0000 mgr.a (mgr.14373) 9883 : cluster [DBG] pgmap v6854: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:25:38.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:25:38 smithi086 bash[24289]: cluster 2024-09-16T09:25:37.454535+0000 mgr.a (mgr.14373) 9883 : cluster [DBG] pgmap v6854: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:25:38.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:25:38 smithi047 bash[22744]: cluster 2024-09-16T09:25:37.454535+0000 mgr.a (mgr.14373) 9883 : cluster [DBG] pgmap v6854: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:25:40.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:25:40 smithi157 bash[24585]: cluster 2024-09-16T09:25:39.455487+0000 mgr.a (mgr.14373) 9884 : cluster [DBG] pgmap v6855: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:25:40.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:25:40 smithi086 bash[24289]: cluster 2024-09-16T09:25:39.455487+0000 mgr.a (mgr.14373) 9884 : cluster [DBG] pgmap v6855: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:25:40.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:25:40 smithi047 bash[22744]: cluster 2024-09-16T09:25:39.455487+0000 mgr.a (mgr.14373) 9884 : cluster [DBG] pgmap v6855: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:25:42.074 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:25:42.075 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:25:42.075 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:25:42.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:25:42 smithi086 bash[24289]: cluster 2024-09-16T09:25:41.457441+0000 mgr.a (mgr.14373) 9885 : cluster [DBG] pgmap v6856: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:25:42.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:25:42 smithi086 bash[24289]: audit 2024-09-16T09:25:42.248183+0000 mon.b (mon.2) 918 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T09:25:42.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:25:42 smithi086 bash[24289]: audit 2024-09-16T09:25:42.408465+0000 mgr.a (mgr.14373) 9886 : audit [DBG] from='client.218541 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:25:42.838 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:25:42.839 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:25:42.839 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:25:42.839 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:25:42.839 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:25:42.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:25:42 smithi047 bash[22744]: cluster 2024-09-16T09:25:41.457441+0000 mgr.a (mgr.14373) 9885 : cluster [DBG] pgmap v6856: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:25:42.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:25:42 smithi047 bash[22744]: audit 2024-09-16T09:25:42.248183+0000 mon.b (mon.2) 918 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T09:25:42.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:25:42 smithi047 bash[22744]: audit 2024-09-16T09:25:42.408465+0000 mgr.a (mgr.14373) 9886 : audit [DBG] from='client.218541 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:25:43.055 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:25:42 smithi157 bash[24585]: cluster 2024-09-16T09:25:41.457441+0000 mgr.a (mgr.14373) 9885 : cluster [DBG] pgmap v6856: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:25:43.055 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:25:42 smithi157 bash[24585]: audit 2024-09-16T09:25:42.248183+0000 mon.b (mon.2) 918 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T09:25:43.055 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:25:42 smithi157 bash[24585]: audit 2024-09-16T09:25:42.408465+0000 mgr.a (mgr.14373) 9886 : audit [DBG] from='client.218541 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:25:43.810 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 09:25:43 smithi047 bash[22994]: debug 2024-09-16T09:25:43.802+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T09:25:43.810 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 09:25:43 smithi047 bash[22994]: debug 2024-09-16T09:25:43.802+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T09:25:43.811 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:25:43 smithi047 bash[22744]: audit 2024-09-16T09:25:43.055010+0000 mon.b (mon.2) 919 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:25:43.811 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:25:43 smithi047 bash[22744]: audit 2024-09-16T09:25:43.057345+0000 mon.b (mon.2) 920 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T09:25:43.811 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:25:43 smithi047 bash[22744]: audit 2024-09-16T09:25:43.067106+0000 mon.a (mon.0) 1160 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:25:43.811 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:25:43 smithi047 bash[22744]: audit 2024-09-16T09:25:43.075988+0000 mgr.a (mgr.14373) 9887 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:25:43.811 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:25:43 smithi047 bash[22744]: audit 2024-09-16T09:25:43.076213+0000 mon.b (mon.2) 921 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:25:43.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:25:43 smithi086 bash[24289]: audit 2024-09-16T09:25:43.055010+0000 mon.b (mon.2) 919 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:25:43.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:25:43 smithi086 bash[24289]: audit 2024-09-16T09:25:43.057345+0000 mon.b (mon.2) 920 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T09:25:43.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:25:43 smithi086 bash[24289]: audit 2024-09-16T09:25:43.067106+0000 mon.a (mon.0) 1160 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:25:43.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:25:43 smithi086 bash[24289]: audit 2024-09-16T09:25:43.075988+0000 mgr.a (mgr.14373) 9887 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:25:43.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:25:43 smithi086 bash[24289]: audit 2024-09-16T09:25:43.076213+0000 mon.b (mon.2) 921 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:25:44.055 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:25:43 smithi157 bash[24585]: audit 2024-09-16T09:25:43.055010+0000 mon.b (mon.2) 919 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:25:44.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:25:43 smithi157 bash[24585]: audit 2024-09-16T09:25:43.057345+0000 mon.b (mon.2) 920 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T09:25:44.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:25:43 smithi157 bash[24585]: audit 2024-09-16T09:25:43.067106+0000 mon.a (mon.0) 1160 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:25:44.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:25:43 smithi157 bash[24585]: audit 2024-09-16T09:25:43.075988+0000 mgr.a (mgr.14373) 9887 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:25:44.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:25:43 smithi157 bash[24585]: audit 2024-09-16T09:25:43.076213+0000 mon.b (mon.2) 921 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:25:45.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:25:45 smithi047 bash[22744]: cluster 2024-09-16T09:25:43.458017+0000 mgr.a (mgr.14373) 9888 : cluster [DBG] pgmap v6857: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:25:45.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:25:45 smithi047 bash[22744]: audit 2024-09-16T09:25:43.806767+0000 mgr.a (mgr.14373) 9889 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T09:25:45.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:25:45 smithi047 bash[22744]: cephadm 2024-09-16T09:25:43.808712+0000 mgr.a (mgr.14373) 9890 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T09:25:45.555 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:25:45 smithi157 bash[24585]: cluster 2024-09-16T09:25:43.458017+0000 mgr.a (mgr.14373) 9888 : cluster [DBG] pgmap v6857: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:25:45.555 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:25:45 smithi157 bash[24585]: audit 2024-09-16T09:25:43.806767+0000 mgr.a (mgr.14373) 9889 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T09:25:45.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:25:45 smithi157 bash[24585]: cephadm 2024-09-16T09:25:43.808712+0000 mgr.a (mgr.14373) 9890 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T09:25:45.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:25:45 smithi086 bash[24289]: cluster 2024-09-16T09:25:43.458017+0000 mgr.a (mgr.14373) 9888 : cluster [DBG] pgmap v6857: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:25:45.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:25:45 smithi086 bash[24289]: audit 2024-09-16T09:25:43.806767+0000 mgr.a (mgr.14373) 9889 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T09:25:45.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:25:45 smithi086 bash[24289]: cephadm 2024-09-16T09:25:43.808712+0000 mgr.a (mgr.14373) 9890 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T09:25:47.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:25:47 smithi047 bash[22744]: cluster 2024-09-16T09:25:45.459006+0000 mgr.a (mgr.14373) 9891 : cluster [DBG] pgmap v6858: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T09:25:47.555 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:25:47 smithi157 bash[24585]: cluster 2024-09-16T09:25:45.459006+0000 mgr.a (mgr.14373) 9891 : cluster [DBG] pgmap v6858: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T09:25:47.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:25:47 smithi086 bash[24289]: cluster 2024-09-16T09:25:45.459006+0000 mgr.a (mgr.14373) 9891 : cluster [DBG] pgmap v6858: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T09:25:47.840 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:25:47.840 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:25:47.841 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:25:48.629 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:25:48.629 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:25:48.629 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:25:48.629 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:25:48.629 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:25:49.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:25:49 smithi047 bash[22744]: cluster 2024-09-16T09:25:47.461287+0000 mgr.a (mgr.14373) 9892 : cluster [DBG] pgmap v6859: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:25:49.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:25:49 smithi047 bash[22744]: audit 2024-09-16T09:25:48.176130+0000 mgr.a (mgr.14373) 9893 : audit [DBG] from='client.218724 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:25:49.555 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:25:49 smithi157 bash[24585]: cluster 2024-09-16T09:25:47.461287+0000 mgr.a (mgr.14373) 9892 : cluster [DBG] pgmap v6859: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:25:49.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:25:49 smithi157 bash[24585]: audit 2024-09-16T09:25:48.176130+0000 mgr.a (mgr.14373) 9893 : audit [DBG] from='client.218724 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:25:49.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:25:49 smithi086 bash[24289]: cluster 2024-09-16T09:25:47.461287+0000 mgr.a (mgr.14373) 9892 : cluster [DBG] pgmap v6859: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:25:49.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:25:49 smithi086 bash[24289]: audit 2024-09-16T09:25:48.176130+0000 mgr.a (mgr.14373) 9893 : audit [DBG] from='client.218724 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:25:51.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:25:51 smithi047 bash[22744]: cluster 2024-09-16T09:25:49.462197+0000 mgr.a (mgr.14373) 9894 : cluster [DBG] pgmap v6860: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:25:51.555 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:25:51 smithi157 bash[24585]: cluster 2024-09-16T09:25:49.462197+0000 mgr.a (mgr.14373) 9894 : cluster [DBG] pgmap v6860: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:25:51.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:25:51 smithi086 bash[24289]: cluster 2024-09-16T09:25:49.462197+0000 mgr.a (mgr.14373) 9894 : cluster [DBG] pgmap v6860: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:25:53.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:25:53 smithi047 bash[22744]: cluster 2024-09-16T09:25:51.464333+0000 mgr.a (mgr.14373) 9895 : cluster [DBG] pgmap v6861: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:25:53.555 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:25:53 smithi157 bash[24585]: cluster 2024-09-16T09:25:51.464333+0000 mgr.a (mgr.14373) 9895 : cluster [DBG] pgmap v6861: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:25:53.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:25:53 smithi086 bash[24289]: cluster 2024-09-16T09:25:51.464333+0000 mgr.a (mgr.14373) 9895 : cluster [DBG] pgmap v6861: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:25:53.631 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:25:53.631 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:25:53.631 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:25:54.409 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:25:54.409 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:25:54.409 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:25:54.409 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:25:54.409 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:25:55.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:25:55 smithi047 bash[22744]: cluster 2024-09-16T09:25:53.465103+0000 mgr.a (mgr.14373) 9896 : cluster [DBG] pgmap v6862: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:25:55.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:25:55 smithi047 bash[22744]: audit 2024-09-16T09:25:53.963165+0000 mgr.a (mgr.14373) 9897 : audit [DBG] from='client.218796 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:25:55.555 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:25:55 smithi157 bash[24585]: cluster 2024-09-16T09:25:53.465103+0000 mgr.a (mgr.14373) 9896 : cluster [DBG] pgmap v6862: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:25:55.555 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:25:55 smithi157 bash[24585]: audit 2024-09-16T09:25:53.963165+0000 mgr.a (mgr.14373) 9897 : audit [DBG] from='client.218796 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:25:55.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:25:55 smithi086 bash[24289]: cluster 2024-09-16T09:25:53.465103+0000 mgr.a (mgr.14373) 9896 : cluster [DBG] pgmap v6862: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:25:55.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:25:55 smithi086 bash[24289]: audit 2024-09-16T09:25:53.963165+0000 mgr.a (mgr.14373) 9897 : audit [DBG] from='client.218796 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:25:57.555 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:25:57 smithi157 bash[24585]: cluster 2024-09-16T09:25:55.466028+0000 mgr.a (mgr.14373) 9898 : cluster [DBG] pgmap v6863: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:25:57.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:25:57 smithi086 bash[24289]: cluster 2024-09-16T09:25:55.466028+0000 mgr.a (mgr.14373) 9898 : cluster [DBG] pgmap v6863: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:25:57.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:25:57 smithi047 bash[22744]: cluster 2024-09-16T09:25:55.466028+0000 mgr.a (mgr.14373) 9898 : cluster [DBG] pgmap v6863: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:25:59.410 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:25:59.411 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:25:59.411 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:25:59.555 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:25:59 smithi157 bash[24585]: cluster 2024-09-16T09:25:57.468280+0000 mgr.a (mgr.14373) 9899 : cluster [DBG] pgmap v6864: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:25:59.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:25:59 smithi086 bash[24289]: cluster 2024-09-16T09:25:57.468280+0000 mgr.a (mgr.14373) 9899 : cluster [DBG] pgmap v6864: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:25:59.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:25:59 smithi047 bash[22744]: cluster 2024-09-16T09:25:57.468280+0000 mgr.a (mgr.14373) 9899 : cluster [DBG] pgmap v6864: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:26:00.188 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:26:00.188 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:26:00.188 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:26:00.188 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:26:00.188 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:26:01.555 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:26:01 smithi157 bash[24585]: cluster 2024-09-16T09:25:59.468900+0000 mgr.a (mgr.14373) 9900 : cluster [DBG] pgmap v6865: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:26:01.555 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:26:01 smithi157 bash[24585]: audit 2024-09-16T09:25:59.743735+0000 mgr.a (mgr.14373) 9901 : audit [DBG] from='client.218874 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:26:01.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:26:01 smithi086 bash[24289]: cluster 2024-09-16T09:25:59.468900+0000 mgr.a (mgr.14373) 9900 : cluster [DBG] pgmap v6865: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:26:01.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:26:01 smithi086 bash[24289]: audit 2024-09-16T09:25:59.743735+0000 mgr.a (mgr.14373) 9901 : audit [DBG] from='client.218874 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:26:01.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:26:01 smithi047 bash[22744]: cluster 2024-09-16T09:25:59.468900+0000 mgr.a (mgr.14373) 9900 : cluster [DBG] pgmap v6865: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:26:01.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:26:01 smithi047 bash[22744]: audit 2024-09-16T09:25:59.743735+0000 mgr.a (mgr.14373) 9901 : audit [DBG] from='client.218874 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:26:03.555 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:26:03 smithi157 bash[24585]: cluster 2024-09-16T09:26:01.471242+0000 mgr.a (mgr.14373) 9902 : cluster [DBG] pgmap v6866: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:26:03.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:26:03 smithi086 bash[24289]: cluster 2024-09-16T09:26:01.471242+0000 mgr.a (mgr.14373) 9902 : cluster [DBG] pgmap v6866: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:26:03.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:26:03 smithi047 bash[22744]: cluster 2024-09-16T09:26:01.471242+0000 mgr.a (mgr.14373) 9902 : cluster [DBG] pgmap v6866: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:26:05.189 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:26:05.190 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:26:05.190 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:26:05.555 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:26:05 smithi157 bash[24585]: cluster 2024-09-16T09:26:03.472025+0000 mgr.a (mgr.14373) 9903 : cluster [DBG] pgmap v6867: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:26:05.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:26:05 smithi086 bash[24289]: cluster 2024-09-16T09:26:03.472025+0000 mgr.a (mgr.14373) 9903 : cluster [DBG] pgmap v6867: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:26:05.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:26:05 smithi047 bash[22744]: cluster 2024-09-16T09:26:03.472025+0000 mgr.a (mgr.14373) 9903 : cluster [DBG] pgmap v6867: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:26:05.959 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:26:05.959 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:26:05.959 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:26:05.959 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:26:05.960 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:26:07.555 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:26:07 smithi157 bash[24585]: cluster 2024-09-16T09:26:05.472781+0000 mgr.a (mgr.14373) 9904 : cluster [DBG] pgmap v6868: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:26:07.555 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:26:07 smithi157 bash[24585]: audit 2024-09-16T09:26:05.523390+0000 mgr.a (mgr.14373) 9905 : audit [DBG] from='client.218952 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:26:07.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:26:07 smithi086 bash[24289]: cluster 2024-09-16T09:26:05.472781+0000 mgr.a (mgr.14373) 9904 : cluster [DBG] pgmap v6868: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:26:07.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:26:07 smithi086 bash[24289]: audit 2024-09-16T09:26:05.523390+0000 mgr.a (mgr.14373) 9905 : audit [DBG] from='client.218952 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:26:07.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:26:07 smithi047 bash[22744]: cluster 2024-09-16T09:26:05.472781+0000 mgr.a (mgr.14373) 9904 : cluster [DBG] pgmap v6868: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:26:07.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:26:07 smithi047 bash[22744]: audit 2024-09-16T09:26:05.523390+0000 mgr.a (mgr.14373) 9905 : audit [DBG] from='client.218952 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:26:09.555 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:26:09 smithi157 bash[24585]: cluster 2024-09-16T09:26:07.475183+0000 mgr.a (mgr.14373) 9906 : cluster [DBG] pgmap v6869: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:26:09.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:26:09 smithi086 bash[24289]: cluster 2024-09-16T09:26:07.475183+0000 mgr.a (mgr.14373) 9906 : cluster [DBG] pgmap v6869: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:26:09.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:26:09 smithi047 bash[22744]: cluster 2024-09-16T09:26:07.475183+0000 mgr.a (mgr.14373) 9906 : cluster [DBG] pgmap v6869: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:26:10.960 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:26:10.964 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:26:10.965 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:26:11.555 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:26:11 smithi157 bash[24585]: cluster 2024-09-16T09:26:09.475964+0000 mgr.a (mgr.14373) 9907 : cluster [DBG] pgmap v6870: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:26:11.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:26:11 smithi086 bash[24289]: cluster 2024-09-16T09:26:09.475964+0000 mgr.a (mgr.14373) 9907 : cluster [DBG] pgmap v6870: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:26:11.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:26:11 smithi047 bash[22744]: cluster 2024-09-16T09:26:09.475964+0000 mgr.a (mgr.14373) 9907 : cluster [DBG] pgmap v6870: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:26:11.715 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:26:11.716 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:26:11.716 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:26:11.716 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:26:11.716 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:26:12.555 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:26:12 smithi157 bash[24585]: audit 2024-09-16T09:26:11.289573+0000 mgr.a (mgr.14373) 9908 : audit [DBG] from='client.219027 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:26:12.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:26:12 smithi086 bash[24289]: audit 2024-09-16T09:26:11.289573+0000 mgr.a (mgr.14373) 9908 : audit [DBG] from='client.219027 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:26:12.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:26:12 smithi047 bash[22744]: audit 2024-09-16T09:26:11.289573+0000 mgr.a (mgr.14373) 9908 : audit [DBG] from='client.219027 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:26:13.555 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:26:13 smithi157 bash[24585]: cluster 2024-09-16T09:26:11.477434+0000 mgr.a (mgr.14373) 9909 : cluster [DBG] pgmap v6871: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:26:13.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:26:13 smithi086 bash[24289]: cluster 2024-09-16T09:26:11.477434+0000 mgr.a (mgr.14373) 9909 : cluster [DBG] pgmap v6871: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:26:13.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:26:13 smithi047 bash[22744]: cluster 2024-09-16T09:26:11.477434+0000 mgr.a (mgr.14373) 9909 : cluster [DBG] pgmap v6871: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:26:15.555 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:26:15 smithi157 bash[24585]: cluster 2024-09-16T09:26:13.478472+0000 mgr.a (mgr.14373) 9910 : cluster [DBG] pgmap v6872: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T09:26:15.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:26:15 smithi086 bash[24289]: cluster 2024-09-16T09:26:13.478472+0000 mgr.a (mgr.14373) 9910 : cluster [DBG] pgmap v6872: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T09:26:15.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:26:15 smithi047 bash[22744]: cluster 2024-09-16T09:26:13.478472+0000 mgr.a (mgr.14373) 9910 : cluster [DBG] pgmap v6872: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T09:26:16.717 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:26:16.718 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:26:16.718 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:26:17.497 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:26:17.497 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:26:17.497 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:26:17.497 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:26:17.497 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:26:17.555 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:26:17 smithi157 bash[24585]: cluster 2024-09-16T09:26:15.479432+0000 mgr.a (mgr.14373) 9911 : cluster [DBG] pgmap v6873: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T09:26:17.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:26:17 smithi086 bash[24289]: cluster 2024-09-16T09:26:15.479432+0000 mgr.a (mgr.14373) 9911 : cluster [DBG] pgmap v6873: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T09:26:17.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:26:17 smithi047 bash[22744]: cluster 2024-09-16T09:26:15.479432+0000 mgr.a (mgr.14373) 9911 : cluster [DBG] pgmap v6873: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T09:26:18.555 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:26:18 smithi157 bash[24585]: audit 2024-09-16T09:26:17.050419+0000 mgr.a (mgr.14373) 9912 : audit [DBG] from='client.219102 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:26:18.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:26:18 smithi086 bash[24289]: audit 2024-09-16T09:26:17.050419+0000 mgr.a (mgr.14373) 9912 : audit [DBG] from='client.219102 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:26:18.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:26:18 smithi047 bash[22744]: audit 2024-09-16T09:26:17.050419+0000 mgr.a (mgr.14373) 9912 : audit [DBG] from='client.219102 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:26:19.555 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:26:19 smithi157 bash[24585]: cluster 2024-09-16T09:26:17.480703+0000 mgr.a (mgr.14373) 9913 : cluster [DBG] pgmap v6874: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:26:19.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:26:19 smithi086 bash[24289]: cluster 2024-09-16T09:26:17.480703+0000 mgr.a (mgr.14373) 9913 : cluster [DBG] pgmap v6874: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:26:19.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:26:19 smithi047 bash[22744]: cluster 2024-09-16T09:26:17.480703+0000 mgr.a (mgr.14373) 9913 : cluster [DBG] pgmap v6874: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:26:21.555 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:26:21 smithi157 bash[24585]: cluster 2024-09-16T09:26:19.481431+0000 mgr.a (mgr.14373) 9914 : cluster [DBG] pgmap v6875: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T09:26:21.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:26:21 smithi086 bash[24289]: cluster 2024-09-16T09:26:19.481431+0000 mgr.a (mgr.14373) 9914 : cluster [DBG] pgmap v6875: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T09:26:21.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:26:21 smithi047 bash[22744]: cluster 2024-09-16T09:26:19.481431+0000 mgr.a (mgr.14373) 9914 : cluster [DBG] pgmap v6875: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T09:26:22.498 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:26:22.499 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:26:22.499 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:26:23.269 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:26:23.269 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:26:23.269 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:26:23.269 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:26:23.269 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:26:23.555 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:26:23 smithi157 bash[24585]: cluster 2024-09-16T09:26:21.483381+0000 mgr.a (mgr.14373) 9915 : cluster [DBG] pgmap v6876: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:26:23.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:26:23 smithi086 bash[24289]: cluster 2024-09-16T09:26:21.483381+0000 mgr.a (mgr.14373) 9915 : cluster [DBG] pgmap v6876: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:26:23.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:26:23 smithi047 bash[22744]: cluster 2024-09-16T09:26:21.483381+0000 mgr.a (mgr.14373) 9915 : cluster [DBG] pgmap v6876: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:26:24.555 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:26:24 smithi157 bash[24585]: audit 2024-09-16T09:26:22.833211+0000 mgr.a (mgr.14373) 9916 : audit [DBG] from='client.219177 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:26:24.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:26:24 smithi086 bash[24289]: audit 2024-09-16T09:26:22.833211+0000 mgr.a (mgr.14373) 9916 : audit [DBG] from='client.219177 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:26:24.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:26:24 smithi047 bash[22744]: audit 2024-09-16T09:26:22.833211+0000 mgr.a (mgr.14373) 9916 : audit [DBG] from='client.219177 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:26:25.555 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:26:25 smithi157 bash[24585]: cluster 2024-09-16T09:26:23.484236+0000 mgr.a (mgr.14373) 9917 : cluster [DBG] pgmap v6877: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:26:25.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:26:25 smithi086 bash[24289]: cluster 2024-09-16T09:26:23.484236+0000 mgr.a (mgr.14373) 9917 : cluster [DBG] pgmap v6877: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:26:25.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:26:25 smithi047 bash[22744]: cluster 2024-09-16T09:26:23.484236+0000 mgr.a (mgr.14373) 9917 : cluster [DBG] pgmap v6877: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:26:27.555 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:26:27 smithi157 bash[24585]: cluster 2024-09-16T09:26:25.484997+0000 mgr.a (mgr.14373) 9918 : cluster [DBG] pgmap v6878: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:26:27.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:26:27 smithi086 bash[24289]: cluster 2024-09-16T09:26:25.484997+0000 mgr.a (mgr.14373) 9918 : cluster [DBG] pgmap v6878: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:26:27.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:26:27 smithi047 bash[22744]: cluster 2024-09-16T09:26:25.484997+0000 mgr.a (mgr.14373) 9918 : cluster [DBG] pgmap v6878: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:26:28.270 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:26:28.271 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:26:28.271 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:26:29.024 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:26:29.025 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:26:29.025 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:26:29.025 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:26:29.025 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:26:29.555 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:26:29 smithi157 bash[24585]: cluster 2024-09-16T09:26:27.487194+0000 mgr.a (mgr.14373) 9919 : cluster [DBG] pgmap v6879: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:26:29.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:26:29 smithi086 bash[24289]: cluster 2024-09-16T09:26:27.487194+0000 mgr.a (mgr.14373) 9919 : cluster [DBG] pgmap v6879: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:26:29.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:26:29 smithi047 bash[22744]: cluster 2024-09-16T09:26:27.487194+0000 mgr.a (mgr.14373) 9919 : cluster [DBG] pgmap v6879: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:26:30.555 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:26:30 smithi157 bash[24585]: audit 2024-09-16T09:26:28.598401+0000 mgr.a (mgr.14373) 9920 : audit [DBG] from='client.219255 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:26:30.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:26:30 smithi086 bash[24289]: audit 2024-09-16T09:26:28.598401+0000 mgr.a (mgr.14373) 9920 : audit [DBG] from='client.219255 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:26:30.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:26:30 smithi047 bash[22744]: audit 2024-09-16T09:26:28.598401+0000 mgr.a (mgr.14373) 9920 : audit [DBG] from='client.219255 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:26:31.555 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:26:31 smithi157 bash[24585]: cluster 2024-09-16T09:26:29.488193+0000 mgr.a (mgr.14373) 9921 : cluster [DBG] pgmap v6880: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:26:31.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:26:31 smithi086 bash[24289]: cluster 2024-09-16T09:26:29.488193+0000 mgr.a (mgr.14373) 9921 : cluster [DBG] pgmap v6880: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:26:31.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:26:31 smithi047 bash[22744]: cluster 2024-09-16T09:26:29.488193+0000 mgr.a (mgr.14373) 9921 : cluster [DBG] pgmap v6880: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:26:33.555 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:26:33 smithi157 bash[24585]: cluster 2024-09-16T09:26:31.490379+0000 mgr.a (mgr.14373) 9922 : cluster [DBG] pgmap v6881: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:26:33.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:26:33 smithi086 bash[24289]: cluster 2024-09-16T09:26:31.490379+0000 mgr.a (mgr.14373) 9922 : cluster [DBG] pgmap v6881: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:26:33.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:26:33 smithi047 bash[22744]: cluster 2024-09-16T09:26:31.490379+0000 mgr.a (mgr.14373) 9922 : cluster [DBG] pgmap v6881: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:26:34.026 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:26:34.026 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:26:34.026 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:26:34.811 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:26:34.811 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:26:34.811 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:26:34.811 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:26:34.812 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:26:35.555 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:26:35 smithi157 bash[24585]: cluster 2024-09-16T09:26:33.491079+0000 mgr.a (mgr.14373) 9923 : cluster [DBG] pgmap v6882: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:26:35.555 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:26:35 smithi157 bash[24585]: audit 2024-09-16T09:26:34.357999+0000 mgr.a (mgr.14373) 9924 : audit [DBG] from='client.219333 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:26:35.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:26:35 smithi086 bash[24289]: cluster 2024-09-16T09:26:33.491079+0000 mgr.a (mgr.14373) 9923 : cluster [DBG] pgmap v6882: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:26:35.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:26:35 smithi086 bash[24289]: audit 2024-09-16T09:26:34.357999+0000 mgr.a (mgr.14373) 9924 : audit [DBG] from='client.219333 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:26:35.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:26:35 smithi047 bash[22744]: cluster 2024-09-16T09:26:33.491079+0000 mgr.a (mgr.14373) 9923 : cluster [DBG] pgmap v6882: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:26:35.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:26:35 smithi047 bash[22744]: audit 2024-09-16T09:26:34.357999+0000 mgr.a (mgr.14373) 9924 : audit [DBG] from='client.219333 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:26:37.555 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:26:37 smithi157 bash[24585]: cluster 2024-09-16T09:26:35.491987+0000 mgr.a (mgr.14373) 9925 : cluster [DBG] pgmap v6883: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:26:37.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:26:37 smithi086 bash[24289]: cluster 2024-09-16T09:26:35.491987+0000 mgr.a (mgr.14373) 9925 : cluster [DBG] pgmap v6883: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:26:37.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:26:37 smithi047 bash[22744]: cluster 2024-09-16T09:26:35.491987+0000 mgr.a (mgr.14373) 9925 : cluster [DBG] pgmap v6883: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:26:39.555 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:26:39 smithi157 bash[24585]: cluster 2024-09-16T09:26:37.494192+0000 mgr.a (mgr.14373) 9926 : cluster [DBG] pgmap v6884: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:26:39.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:26:39 smithi086 bash[24289]: cluster 2024-09-16T09:26:37.494192+0000 mgr.a (mgr.14373) 9926 : cluster [DBG] pgmap v6884: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:26:39.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:26:39 smithi047 bash[22744]: cluster 2024-09-16T09:26:37.494192+0000 mgr.a (mgr.14373) 9926 : cluster [DBG] pgmap v6884: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:26:39.813 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:26:39.813 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:26:39.813 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:26:40.601 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:26:40.601 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:26:40.601 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:26:40.602 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:26:40.602 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:26:41.555 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:26:41 smithi157 bash[24585]: cluster 2024-09-16T09:26:39.494940+0000 mgr.a (mgr.14373) 9927 : cluster [DBG] pgmap v6885: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:26:41.555 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:26:41 smithi157 bash[24585]: audit 2024-09-16T09:26:40.148525+0000 mgr.a (mgr.14373) 9928 : audit [DBG] from='client.219408 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:26:41.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:26:41 smithi086 bash[24289]: cluster 2024-09-16T09:26:39.494940+0000 mgr.a (mgr.14373) 9927 : cluster [DBG] pgmap v6885: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:26:41.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:26:41 smithi086 bash[24289]: audit 2024-09-16T09:26:40.148525+0000 mgr.a (mgr.14373) 9928 : audit [DBG] from='client.219408 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:26:41.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:26:41 smithi047 bash[22744]: cluster 2024-09-16T09:26:39.494940+0000 mgr.a (mgr.14373) 9927 : cluster [DBG] pgmap v6885: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:26:41.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:26:41 smithi047 bash[22744]: audit 2024-09-16T09:26:40.148525+0000 mgr.a (mgr.14373) 9928 : audit [DBG] from='client.219408 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:26:43.555 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:26:43 smithi157 bash[24585]: cluster 2024-09-16T09:26:41.497284+0000 mgr.a (mgr.14373) 9929 : cluster [DBG] pgmap v6886: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:26:43.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:26:43 smithi086 bash[24289]: cluster 2024-09-16T09:26:41.497284+0000 mgr.a (mgr.14373) 9929 : cluster [DBG] pgmap v6886: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:26:43.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:26:43 smithi047 bash[22744]: cluster 2024-09-16T09:26:41.497284+0000 mgr.a (mgr.14373) 9929 : cluster [DBG] pgmap v6886: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:26:44.555 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:26:44 smithi157 bash[24585]: audit 2024-09-16T09:26:43.862474+0000 mon.b (mon.2) 922 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T09:26:44.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:26:44 smithi086 bash[24289]: audit 2024-09-16T09:26:43.862474+0000 mon.b (mon.2) 922 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T09:26:44.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:26:44 smithi047 bash[22744]: audit 2024-09-16T09:26:43.862474+0000 mon.b (mon.2) 922 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T09:26:45.555 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:26:45 smithi157 bash[24585]: cluster 2024-09-16T09:26:43.498214+0000 mgr.a (mgr.14373) 9930 : cluster [DBG] pgmap v6887: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:26:45.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:26:45 smithi157 bash[24585]: audit 2024-09-16T09:26:44.696527+0000 mon.b (mon.2) 923 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:26:45.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:26:45 smithi157 bash[24585]: audit 2024-09-16T09:26:44.698697+0000 mon.b (mon.2) 924 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T09:26:45.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:26:45 smithi157 bash[24585]: audit 2024-09-16T09:26:44.708460+0000 mon.a (mon.0) 1161 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:26:45.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:26:45 smithi157 bash[24585]: audit 2024-09-16T09:26:44.713070+0000 mon.b (mon.2) 925 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:26:45.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:26:45 smithi086 bash[24289]: cluster 2024-09-16T09:26:43.498214+0000 mgr.a (mgr.14373) 9930 : cluster [DBG] pgmap v6887: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:26:45.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:26:45 smithi086 bash[24289]: audit 2024-09-16T09:26:44.696527+0000 mon.b (mon.2) 923 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:26:45.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:26:45 smithi086 bash[24289]: audit 2024-09-16T09:26:44.698697+0000 mon.b (mon.2) 924 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T09:26:45.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:26:45 smithi086 bash[24289]: audit 2024-09-16T09:26:44.708460+0000 mon.a (mon.0) 1161 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:26:45.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:26:45 smithi086 bash[24289]: audit 2024-09-16T09:26:44.713070+0000 mon.b (mon.2) 925 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:26:45.593 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 09:26:45 smithi047 bash[22994]: debug 2024-09-16T09:26:45.465+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T09:26:45.593 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 09:26:45 smithi047 bash[22994]: debug 2024-09-16T09:26:45.469+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T09:26:45.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:26:45 smithi047 bash[22744]: cluster 2024-09-16T09:26:43.498214+0000 mgr.a (mgr.14373) 9930 : cluster [DBG] pgmap v6887: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:26:45.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:26:45 smithi047 bash[22744]: audit 2024-09-16T09:26:44.696527+0000 mon.b (mon.2) 923 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:26:45.594 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:26:45 smithi047 bash[22744]: audit 2024-09-16T09:26:44.698697+0000 mon.b (mon.2) 924 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T09:26:45.594 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:26:45 smithi047 bash[22744]: audit 2024-09-16T09:26:44.708460+0000 mon.a (mon.0) 1161 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:26:45.594 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:26:45 smithi047 bash[22744]: audit 2024-09-16T09:26:44.713070+0000 mon.b (mon.2) 925 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:26:45.602 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:26:45.603 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:26:45.603 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:26:46.374 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:26:46.374 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:26:46.375 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:26:46.375 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:26:46.375 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:26:46.555 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:26:46 smithi157 bash[24585]: audit 2024-09-16T09:26:44.713872+0000 mgr.a (mgr.14373) 9931 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:26:46.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:26:46 smithi086 bash[24289]: audit 2024-09-16T09:26:44.713872+0000 mgr.a (mgr.14373) 9931 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:26:46.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:26:46 smithi047 bash[22744]: audit 2024-09-16T09:26:44.713872+0000 mgr.a (mgr.14373) 9931 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:26:47.555 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:26:47 smithi157 bash[24585]: audit 2024-09-16T09:26:45.469064+0000 mgr.a (mgr.14373) 9932 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T09:26:47.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:26:47 smithi157 bash[24585]: cephadm 2024-09-16T09:26:45.470966+0000 mgr.a (mgr.14373) 9933 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T09:26:47.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:26:47 smithi157 bash[24585]: cluster 2024-09-16T09:26:45.498861+0000 mgr.a (mgr.14373) 9934 : cluster [DBG] pgmap v6888: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:26:47.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:26:47 smithi157 bash[24585]: audit 2024-09-16T09:26:45.935785+0000 mgr.a (mgr.14373) 9935 : audit [DBG] from='client.219594 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:26:47.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:26:47 smithi086 bash[24289]: audit 2024-09-16T09:26:45.469064+0000 mgr.a (mgr.14373) 9932 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T09:26:47.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:26:47 smithi086 bash[24289]: cephadm 2024-09-16T09:26:45.470966+0000 mgr.a (mgr.14373) 9933 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T09:26:47.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:26:47 smithi086 bash[24289]: cluster 2024-09-16T09:26:45.498861+0000 mgr.a (mgr.14373) 9934 : cluster [DBG] pgmap v6888: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:26:47.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:26:47 smithi086 bash[24289]: audit 2024-09-16T09:26:45.935785+0000 mgr.a (mgr.14373) 9935 : audit [DBG] from='client.219594 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:26:47.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:26:47 smithi047 bash[22744]: audit 2024-09-16T09:26:45.469064+0000 mgr.a (mgr.14373) 9932 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T09:26:47.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:26:47 smithi047 bash[22744]: cephadm 2024-09-16T09:26:45.470966+0000 mgr.a (mgr.14373) 9933 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T09:26:47.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:26:47 smithi047 bash[22744]: cluster 2024-09-16T09:26:45.498861+0000 mgr.a (mgr.14373) 9934 : cluster [DBG] pgmap v6888: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:26:47.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:26:47 smithi047 bash[22744]: audit 2024-09-16T09:26:45.935785+0000 mgr.a (mgr.14373) 9935 : audit [DBG] from='client.219594 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:26:49.555 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:26:49 smithi157 bash[24585]: cluster 2024-09-16T09:26:47.501237+0000 mgr.a (mgr.14373) 9936 : cluster [DBG] pgmap v6889: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:26:49.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:26:49 smithi086 bash[24289]: cluster 2024-09-16T09:26:47.501237+0000 mgr.a (mgr.14373) 9936 : cluster [DBG] pgmap v6889: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:26:49.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:26:49 smithi047 bash[22744]: cluster 2024-09-16T09:26:47.501237+0000 mgr.a (mgr.14373) 9936 : cluster [DBG] pgmap v6889: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:26:51.376 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:26:51.377 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:26:51.377 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:26:51.555 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:26:51 smithi157 bash[24585]: cluster 2024-09-16T09:26:49.502165+0000 mgr.a (mgr.14373) 9937 : cluster [DBG] pgmap v6890: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:26:51.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:26:51 smithi086 bash[24289]: cluster 2024-09-16T09:26:49.502165+0000 mgr.a (mgr.14373) 9937 : cluster [DBG] pgmap v6890: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:26:51.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:26:51 smithi047 bash[22744]: cluster 2024-09-16T09:26:49.502165+0000 mgr.a (mgr.14373) 9937 : cluster [DBG] pgmap v6890: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:26:52.141 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:26:52.141 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:26:52.141 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:26:52.141 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:26:52.141 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:26:53.555 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:26:53 smithi157 bash[24585]: cluster 2024-09-16T09:26:51.503202+0000 mgr.a (mgr.14373) 9938 : cluster [DBG] pgmap v6891: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:26:53.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:26:53 smithi157 bash[24585]: audit 2024-09-16T09:26:51.711114+0000 mgr.a (mgr.14373) 9939 : audit [DBG] from='client.219672 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:26:53.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:26:53 smithi086 bash[24289]: cluster 2024-09-16T09:26:51.503202+0000 mgr.a (mgr.14373) 9938 : cluster [DBG] pgmap v6891: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:26:53.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:26:53 smithi086 bash[24289]: audit 2024-09-16T09:26:51.711114+0000 mgr.a (mgr.14373) 9939 : audit [DBG] from='client.219672 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:26:53.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:26:53 smithi047 bash[22744]: cluster 2024-09-16T09:26:51.503202+0000 mgr.a (mgr.14373) 9938 : cluster [DBG] pgmap v6891: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:26:53.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:26:53 smithi047 bash[22744]: audit 2024-09-16T09:26:51.711114+0000 mgr.a (mgr.14373) 9939 : audit [DBG] from='client.219672 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:26:55.555 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:26:55 smithi157 bash[24585]: cluster 2024-09-16T09:26:53.504141+0000 mgr.a (mgr.14373) 9940 : cluster [DBG] pgmap v6892: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T09:26:55.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:26:55 smithi086 bash[24289]: cluster 2024-09-16T09:26:53.504141+0000 mgr.a (mgr.14373) 9940 : cluster [DBG] pgmap v6892: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T09:26:55.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:26:55 smithi047 bash[22744]: cluster 2024-09-16T09:26:53.504141+0000 mgr.a (mgr.14373) 9940 : cluster [DBG] pgmap v6892: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T09:26:57.142 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:26:57.143 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:26:57.143 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:26:57.555 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:26:57 smithi157 bash[24585]: cluster 2024-09-16T09:26:55.504958+0000 mgr.a (mgr.14373) 9941 : cluster [DBG] pgmap v6893: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T09:26:57.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:26:57 smithi086 bash[24289]: cluster 2024-09-16T09:26:55.504958+0000 mgr.a (mgr.14373) 9941 : cluster [DBG] pgmap v6893: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T09:26:57.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:26:57 smithi047 bash[22744]: cluster 2024-09-16T09:26:55.504958+0000 mgr.a (mgr.14373) 9941 : cluster [DBG] pgmap v6893: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T09:26:57.912 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:26:57.912 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:26:57.912 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:26:57.912 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:26:57.912 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:26:59.555 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:26:59 smithi157 bash[24585]: audit 2024-09-16T09:26:57.475204+0000 mgr.a (mgr.14373) 9942 : audit [DBG] from='client.219750 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:26:59.555 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:26:59 smithi157 bash[24585]: cluster 2024-09-16T09:26:57.506510+0000 mgr.a (mgr.14373) 9943 : cluster [DBG] pgmap v6894: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:26:59.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:26:59 smithi086 bash[24289]: audit 2024-09-16T09:26:57.475204+0000 mgr.a (mgr.14373) 9942 : audit [DBG] from='client.219750 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:26:59.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:26:59 smithi086 bash[24289]: cluster 2024-09-16T09:26:57.506510+0000 mgr.a (mgr.14373) 9943 : cluster [DBG] pgmap v6894: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:26:59.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:26:59 smithi047 bash[22744]: audit 2024-09-16T09:26:57.475204+0000 mgr.a (mgr.14373) 9942 : audit [DBG] from='client.219750 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:26:59.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:26:59 smithi047 bash[22744]: cluster 2024-09-16T09:26:57.506510+0000 mgr.a (mgr.14373) 9943 : cluster [DBG] pgmap v6894: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:27:01.555 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:27:01 smithi157 bash[24585]: cluster 2024-09-16T09:26:59.507446+0000 mgr.a (mgr.14373) 9944 : cluster [DBG] pgmap v6895: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T09:27:01.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:27:01 smithi086 bash[24289]: cluster 2024-09-16T09:26:59.507446+0000 mgr.a (mgr.14373) 9944 : cluster [DBG] pgmap v6895: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T09:27:01.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:27:01 smithi047 bash[22744]: cluster 2024-09-16T09:26:59.507446+0000 mgr.a (mgr.14373) 9944 : cluster [DBG] pgmap v6895: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T09:27:02.913 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:27:02.914 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:27:02.914 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:27:03.555 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:27:03 smithi157 bash[24585]: cluster 2024-09-16T09:27:01.509606+0000 mgr.a (mgr.14373) 9945 : cluster [DBG] pgmap v6896: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:27:03.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:27:03 smithi086 bash[24289]: cluster 2024-09-16T09:27:01.509606+0000 mgr.a (mgr.14373) 9945 : cluster [DBG] pgmap v6896: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:27:03.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:27:03 smithi047 bash[22744]: cluster 2024-09-16T09:27:01.509606+0000 mgr.a (mgr.14373) 9945 : cluster [DBG] pgmap v6896: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:27:03.688 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:27:03.688 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:27:03.688 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:27:03.688 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:27:03.689 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:27:04.555 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:27:04 smithi157 bash[24585]: audit 2024-09-16T09:27:03.244818+0000 mgr.a (mgr.14373) 9946 : audit [DBG] from='client.219828 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:27:04.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:27:04 smithi086 bash[24289]: audit 2024-09-16T09:27:03.244818+0000 mgr.a (mgr.14373) 9946 : audit [DBG] from='client.219828 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:27:04.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:27:04 smithi047 bash[22744]: audit 2024-09-16T09:27:03.244818+0000 mgr.a (mgr.14373) 9946 : audit [DBG] from='client.219828 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:27:05.555 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:27:05 smithi157 bash[24585]: cluster 2024-09-16T09:27:03.510230+0000 mgr.a (mgr.14373) 9947 : cluster [DBG] pgmap v6897: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:27:05.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:27:05 smithi086 bash[24289]: cluster 2024-09-16T09:27:03.510230+0000 mgr.a (mgr.14373) 9947 : cluster [DBG] pgmap v6897: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:27:05.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:27:05 smithi047 bash[22744]: cluster 2024-09-16T09:27:03.510230+0000 mgr.a (mgr.14373) 9947 : cluster [DBG] pgmap v6897: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:27:07.555 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:27:07 smithi157 bash[24585]: cluster 2024-09-16T09:27:05.511119+0000 mgr.a (mgr.14373) 9948 : cluster [DBG] pgmap v6898: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:27:07.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:27:07 smithi086 bash[24289]: cluster 2024-09-16T09:27:05.511119+0000 mgr.a (mgr.14373) 9948 : cluster [DBG] pgmap v6898: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:27:07.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:27:07 smithi047 bash[22744]: cluster 2024-09-16T09:27:05.511119+0000 mgr.a (mgr.14373) 9948 : cluster [DBG] pgmap v6898: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:27:08.689 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:27:08.690 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:27:08.690 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:27:09.476 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:27:09.477 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:27:09.477 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:27:09.477 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:27:09.477 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:27:09.555 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:27:09 smithi157 bash[24585]: cluster 2024-09-16T09:27:07.513350+0000 mgr.a (mgr.14373) 9949 : cluster [DBG] pgmap v6899: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:27:09.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:27:09 smithi086 bash[24289]: cluster 2024-09-16T09:27:07.513350+0000 mgr.a (mgr.14373) 9949 : cluster [DBG] pgmap v6899: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:27:09.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:27:09 smithi047 bash[22744]: cluster 2024-09-16T09:27:07.513350+0000 mgr.a (mgr.14373) 9949 : cluster [DBG] pgmap v6899: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:27:10.555 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:27:10 smithi157 bash[24585]: audit 2024-09-16T09:27:09.022330+0000 mgr.a (mgr.14373) 9950 : audit [DBG] from='client.219906 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:27:10.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:27:10 smithi047 bash[22744]: audit 2024-09-16T09:27:09.022330+0000 mgr.a (mgr.14373) 9950 : audit [DBG] from='client.219906 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:27:10.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:27:10 smithi086 bash[24289]: audit 2024-09-16T09:27:09.022330+0000 mgr.a (mgr.14373) 9950 : audit [DBG] from='client.219906 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:27:11.555 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:27:11 smithi157 bash[24585]: cluster 2024-09-16T09:27:09.514016+0000 mgr.a (mgr.14373) 9951 : cluster [DBG] pgmap v6900: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:27:11.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:27:11 smithi086 bash[24289]: cluster 2024-09-16T09:27:09.514016+0000 mgr.a (mgr.14373) 9951 : cluster [DBG] pgmap v6900: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:27:11.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:27:11 smithi047 bash[22744]: cluster 2024-09-16T09:27:09.514016+0000 mgr.a (mgr.14373) 9951 : cluster [DBG] pgmap v6900: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:27:13.555 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:27:13 smithi157 bash[24585]: cluster 2024-09-16T09:27:11.516285+0000 mgr.a (mgr.14373) 9952 : cluster [DBG] pgmap v6901: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:27:13.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:27:13 smithi086 bash[24289]: cluster 2024-09-16T09:27:11.516285+0000 mgr.a (mgr.14373) 9952 : cluster [DBG] pgmap v6901: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:27:13.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:27:13 smithi047 bash[22744]: cluster 2024-09-16T09:27:11.516285+0000 mgr.a (mgr.14373) 9952 : cluster [DBG] pgmap v6901: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:27:14.478 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:27:14.479 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:27:14.479 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:27:15.260 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:27:15.260 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:27:15.260 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:27:15.260 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:27:15.261 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:27:15.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:27:15 smithi086 bash[24289]: cluster 2024-09-16T09:27:13.517227+0000 mgr.a (mgr.14373) 9953 : cluster [DBG] pgmap v6902: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:27:15.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:27:15 smithi047 bash[22744]: cluster 2024-09-16T09:27:13.517227+0000 mgr.a (mgr.14373) 9953 : cluster [DBG] pgmap v6902: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:27:15.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:27:15 smithi157 bash[24585]: cluster 2024-09-16T09:27:13.517227+0000 mgr.a (mgr.14373) 9953 : cluster [DBG] pgmap v6902: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:27:16.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:27:16 smithi086 bash[24289]: audit 2024-09-16T09:27:14.810400+0000 mgr.a (mgr.14373) 9954 : audit [DBG] from='client.219981 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:27:16.615 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:27:16 smithi047 bash[22744]: audit 2024-09-16T09:27:14.810400+0000 mgr.a (mgr.14373) 9954 : audit [DBG] from='client.219981 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:27:16.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:27:16 smithi157 bash[24585]: audit 2024-09-16T09:27:14.810400+0000 mgr.a (mgr.14373) 9954 : audit [DBG] from='client.219981 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:27:17.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:27:17 smithi086 bash[24289]: cluster 2024-09-16T09:27:15.518424+0000 mgr.a (mgr.14373) 9955 : cluster [DBG] pgmap v6903: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:27:17.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:27:17 smithi047 bash[22744]: cluster 2024-09-16T09:27:15.518424+0000 mgr.a (mgr.14373) 9955 : cluster [DBG] pgmap v6903: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:27:17.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:27:17 smithi157 bash[24585]: cluster 2024-09-16T09:27:15.518424+0000 mgr.a (mgr.14373) 9955 : cluster [DBG] pgmap v6903: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:27:19.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:27:19 smithi047 bash[22744]: cluster 2024-09-16T09:27:17.520770+0000 mgr.a (mgr.14373) 9956 : cluster [DBG] pgmap v6904: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:27:19.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:27:19 smithi157 bash[24585]: cluster 2024-09-16T09:27:17.520770+0000 mgr.a (mgr.14373) 9956 : cluster [DBG] pgmap v6904: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:27:19.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:27:19 smithi086 bash[24289]: cluster 2024-09-16T09:27:17.520770+0000 mgr.a (mgr.14373) 9956 : cluster [DBG] pgmap v6904: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:27:20.262 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:27:20.262 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:27:20.263 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:27:21.046 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:27:21.046 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:27:21.046 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:27:21.046 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:27:21.046 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:27:21.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:27:21 smithi047 bash[22744]: cluster 2024-09-16T09:27:19.521574+0000 mgr.a (mgr.14373) 9957 : cluster [DBG] pgmap v6905: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:27:21.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:27:21 smithi157 bash[24585]: cluster 2024-09-16T09:27:19.521574+0000 mgr.a (mgr.14373) 9957 : cluster [DBG] pgmap v6905: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:27:21.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:27:21 smithi086 bash[24289]: cluster 2024-09-16T09:27:19.521574+0000 mgr.a (mgr.14373) 9957 : cluster [DBG] pgmap v6905: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:27:22.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:27:22 smithi047 bash[22744]: audit 2024-09-16T09:27:20.599516+0000 mgr.a (mgr.14373) 9958 : audit [DBG] from='client.220056 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:27:22.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:27:22 smithi157 bash[24585]: audit 2024-09-16T09:27:20.599516+0000 mgr.a (mgr.14373) 9958 : audit [DBG] from='client.220056 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:27:22.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:27:22 smithi086 bash[24289]: audit 2024-09-16T09:27:20.599516+0000 mgr.a (mgr.14373) 9958 : audit [DBG] from='client.220056 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:27:23.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:27:23 smithi047 bash[22744]: cluster 2024-09-16T09:27:21.523924+0000 mgr.a (mgr.14373) 9959 : cluster [DBG] pgmap v6906: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:27:23.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:27:23 smithi157 bash[24585]: cluster 2024-09-16T09:27:21.523924+0000 mgr.a (mgr.14373) 9959 : cluster [DBG] pgmap v6906: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:27:23.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:27:23 smithi086 bash[24289]: cluster 2024-09-16T09:27:21.523924+0000 mgr.a (mgr.14373) 9959 : cluster [DBG] pgmap v6906: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:27:25.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:27:25 smithi047 bash[22744]: cluster 2024-09-16T09:27:23.524722+0000 mgr.a (mgr.14373) 9960 : cluster [DBG] pgmap v6907: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:27:25.808 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:27:25 smithi157 bash[24585]: cluster 2024-09-16T09:27:23.524722+0000 mgr.a (mgr.14373) 9960 : cluster [DBG] pgmap v6907: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:27:25.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:27:25 smithi086 bash[24289]: cluster 2024-09-16T09:27:23.524722+0000 mgr.a (mgr.14373) 9960 : cluster [DBG] pgmap v6907: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:27:26.047 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:27:26.048 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:27:26.048 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:27:26.810 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:27:26.810 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:27:26.810 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:27:26.810 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:27:26.810 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:27:27.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:27:27 smithi157 bash[24585]: cluster 2024-09-16T09:27:25.525514+0000 mgr.a (mgr.14373) 9961 : cluster [DBG] pgmap v6908: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:27:27.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:27:27 smithi157 bash[24585]: audit 2024-09-16T09:27:26.382895+0000 mgr.a (mgr.14373) 9962 : audit [DBG] from='client.220134 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:27:27.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:27:27 smithi086 bash[24289]: cluster 2024-09-16T09:27:25.525514+0000 mgr.a (mgr.14373) 9961 : cluster [DBG] pgmap v6908: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:27:27.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:27:27 smithi086 bash[24289]: audit 2024-09-16T09:27:26.382895+0000 mgr.a (mgr.14373) 9962 : audit [DBG] from='client.220134 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:27:27.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:27:27 smithi047 bash[22744]: cluster 2024-09-16T09:27:25.525514+0000 mgr.a (mgr.14373) 9961 : cluster [DBG] pgmap v6908: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:27:27.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:27:27 smithi047 bash[22744]: audit 2024-09-16T09:27:26.382895+0000 mgr.a (mgr.14373) 9962 : audit [DBG] from='client.220134 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:27:29.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:27:29 smithi157 bash[24585]: cluster 2024-09-16T09:27:27.528276+0000 mgr.a (mgr.14373) 9963 : cluster [DBG] pgmap v6909: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:27:29.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:27:29 smithi086 bash[24289]: cluster 2024-09-16T09:27:27.528276+0000 mgr.a (mgr.14373) 9963 : cluster [DBG] pgmap v6909: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:27:29.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:27:29 smithi047 bash[22744]: cluster 2024-09-16T09:27:27.528276+0000 mgr.a (mgr.14373) 9963 : cluster [DBG] pgmap v6909: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:27:31.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:27:31 smithi157 bash[24585]: cluster 2024-09-16T09:27:29.529099+0000 mgr.a (mgr.14373) 9964 : cluster [DBG] pgmap v6910: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:27:31.811 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:27:31.812 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:27:31.812 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:27:31.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:27:31 smithi086 bash[24289]: cluster 2024-09-16T09:27:29.529099+0000 mgr.a (mgr.14373) 9964 : cluster [DBG] pgmap v6910: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:27:31.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:27:31 smithi047 bash[22744]: cluster 2024-09-16T09:27:29.529099+0000 mgr.a (mgr.14373) 9964 : cluster [DBG] pgmap v6910: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:27:32.566 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:27:32.566 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:27:32.566 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:27:32.566 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:27:32.566 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:27:33.808 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:27:33 smithi157 bash[24585]: cluster 2024-09-16T09:27:31.531093+0000 mgr.a (mgr.14373) 9965 : cluster [DBG] pgmap v6911: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:27:33.808 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:27:33 smithi157 bash[24585]: audit 2024-09-16T09:27:32.144485+0000 mgr.a (mgr.14373) 9966 : audit [DBG] from='client.220209 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:27:33.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:27:33 smithi086 bash[24289]: cluster 2024-09-16T09:27:31.531093+0000 mgr.a (mgr.14373) 9965 : cluster [DBG] pgmap v6911: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:27:33.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:27:33 smithi086 bash[24289]: audit 2024-09-16T09:27:32.144485+0000 mgr.a (mgr.14373) 9966 : audit [DBG] from='client.220209 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:27:33.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:27:33 smithi047 bash[22744]: cluster 2024-09-16T09:27:31.531093+0000 mgr.a (mgr.14373) 9965 : cluster [DBG] pgmap v6911: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:27:33.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:27:33 smithi047 bash[22744]: audit 2024-09-16T09:27:32.144485+0000 mgr.a (mgr.14373) 9966 : audit [DBG] from='client.220209 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:27:35.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:27:35 smithi157 bash[24585]: cluster 2024-09-16T09:27:33.532089+0000 mgr.a (mgr.14373) 9967 : cluster [DBG] pgmap v6912: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:27:35.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:27:35 smithi086 bash[24289]: cluster 2024-09-16T09:27:33.532089+0000 mgr.a (mgr.14373) 9967 : cluster [DBG] pgmap v6912: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:27:35.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:27:35 smithi047 bash[22744]: cluster 2024-09-16T09:27:33.532089+0000 mgr.a (mgr.14373) 9967 : cluster [DBG] pgmap v6912: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:27:37.567 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:27:37.568 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:27:37.568 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:27:37.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:27:37 smithi157 bash[24585]: cluster 2024-09-16T09:27:35.532898+0000 mgr.a (mgr.14373) 9968 : cluster [DBG] pgmap v6913: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T09:27:37.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:27:37 smithi086 bash[24289]: cluster 2024-09-16T09:27:35.532898+0000 mgr.a (mgr.14373) 9968 : cluster [DBG] pgmap v6913: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T09:27:37.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:27:37 smithi047 bash[22744]: cluster 2024-09-16T09:27:35.532898+0000 mgr.a (mgr.14373) 9968 : cluster [DBG] pgmap v6913: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T09:27:38.347 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:27:38.348 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:27:38.348 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:27:38.348 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:27:38.348 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:27:39.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:27:39 smithi157 bash[24585]: cluster 2024-09-16T09:27:37.535122+0000 mgr.a (mgr.14373) 9969 : cluster [DBG] pgmap v6914: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:27:39.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:27:39 smithi157 bash[24585]: audit 2024-09-16T09:27:37.908721+0000 mgr.a (mgr.14373) 9970 : audit [DBG] from='client.220287 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:27:39.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:27:39 smithi086 bash[24289]: cluster 2024-09-16T09:27:37.535122+0000 mgr.a (mgr.14373) 9969 : cluster [DBG] pgmap v6914: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:27:39.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:27:39 smithi086 bash[24289]: audit 2024-09-16T09:27:37.908721+0000 mgr.a (mgr.14373) 9970 : audit [DBG] from='client.220287 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:27:39.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:27:39 smithi047 bash[22744]: cluster 2024-09-16T09:27:37.535122+0000 mgr.a (mgr.14373) 9969 : cluster [DBG] pgmap v6914: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:27:39.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:27:39 smithi047 bash[22744]: audit 2024-09-16T09:27:37.908721+0000 mgr.a (mgr.14373) 9970 : audit [DBG] from='client.220287 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:27:41.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:27:41 smithi157 bash[24585]: cluster 2024-09-16T09:27:39.536235+0000 mgr.a (mgr.14373) 9971 : cluster [DBG] pgmap v6915: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:27:41.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:27:41 smithi086 bash[24289]: cluster 2024-09-16T09:27:39.536235+0000 mgr.a (mgr.14373) 9971 : cluster [DBG] pgmap v6915: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:27:41.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:27:41 smithi047 bash[22744]: cluster 2024-09-16T09:27:39.536235+0000 mgr.a (mgr.14373) 9971 : cluster [DBG] pgmap v6915: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:27:43.349 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:27:43.349 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:27:43.350 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:27:43.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:27:43 smithi157 bash[24585]: cluster 2024-09-16T09:27:41.538581+0000 mgr.a (mgr.14373) 9972 : cluster [DBG] pgmap v6916: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:27:43.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:27:43 smithi086 bash[24289]: cluster 2024-09-16T09:27:41.538581+0000 mgr.a (mgr.14373) 9972 : cluster [DBG] pgmap v6916: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:27:43.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:27:43 smithi047 bash[22744]: cluster 2024-09-16T09:27:41.538581+0000 mgr.a (mgr.14373) 9972 : cluster [DBG] pgmap v6916: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:27:44.101 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:27:44.102 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:27:44.102 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:27:44.102 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:27:44.102 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:27:45.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:27:45 smithi157 bash[24585]: cluster 2024-09-16T09:27:43.539455+0000 mgr.a (mgr.14373) 9973 : cluster [DBG] pgmap v6917: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:27:45.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:27:45 smithi157 bash[24585]: audit 2024-09-16T09:27:43.676706+0000 mgr.a (mgr.14373) 9974 : audit [DBG] from='client.220365 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:27:45.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:27:45 smithi086 bash[24289]: cluster 2024-09-16T09:27:43.539455+0000 mgr.a (mgr.14373) 9973 : cluster [DBG] pgmap v6917: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:27:45.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:27:45 smithi086 bash[24289]: audit 2024-09-16T09:27:43.676706+0000 mgr.a (mgr.14373) 9974 : audit [DBG] from='client.220365 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:27:45.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:27:45 smithi047 bash[22744]: cluster 2024-09-16T09:27:43.539455+0000 mgr.a (mgr.14373) 9973 : cluster [DBG] pgmap v6917: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:27:45.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:27:45 smithi047 bash[22744]: audit 2024-09-16T09:27:43.676706+0000 mgr.a (mgr.14373) 9974 : audit [DBG] from='client.220365 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:27:46.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:27:46 smithi157 bash[24585]: audit 2024-09-16T09:27:45.530192+0000 mon.b (mon.2) 926 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T09:27:46.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:27:46 smithi157 bash[24585]: audit 2024-09-16T09:27:46.369223+0000 mon.b (mon.2) 927 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:27:46.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:27:46 smithi157 bash[24585]: audit 2024-09-16T09:27:46.371435+0000 mon.b (mon.2) 928 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T09:27:46.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:27:46 smithi086 bash[24289]: audit 2024-09-16T09:27:45.530192+0000 mon.b (mon.2) 926 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T09:27:46.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:27:46 smithi086 bash[24289]: audit 2024-09-16T09:27:46.369223+0000 mon.b (mon.2) 927 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:27:46.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:27:46 smithi086 bash[24289]: audit 2024-09-16T09:27:46.371435+0000 mon.b (mon.2) 928 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T09:27:46.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:27:46 smithi047 bash[22744]: audit 2024-09-16T09:27:45.530192+0000 mon.b (mon.2) 926 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T09:27:46.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:27:46 smithi047 bash[22744]: audit 2024-09-16T09:27:46.369223+0000 mon.b (mon.2) 927 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:27:46.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:27:46 smithi047 bash[22744]: audit 2024-09-16T09:27:46.371435+0000 mon.b (mon.2) 928 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T09:27:47.393 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 09:27:47 smithi047 bash[22994]: debug 2024-09-16T09:27:47.124+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T09:27:47.394 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 09:27:47 smithi047 bash[22994]: debug 2024-09-16T09:27:47.124+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T09:27:47.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:27:47 smithi157 bash[24585]: cluster 2024-09-16T09:27:45.540424+0000 mgr.a (mgr.14373) 9975 : cluster [DBG] pgmap v6918: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:27:47.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:27:47 smithi157 bash[24585]: audit 2024-09-16T09:27:46.381910+0000 mon.a (mon.0) 1162 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:27:47.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:27:47 smithi157 bash[24585]: audit 2024-09-16T09:27:46.390283+0000 mon.b (mon.2) 929 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:27:47.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:27:47 smithi157 bash[24585]: audit 2024-09-16T09:27:46.391367+0000 mgr.a (mgr.14373) 9976 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:27:47.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:27:47 smithi086 bash[24289]: cluster 2024-09-16T09:27:45.540424+0000 mgr.a (mgr.14373) 9975 : cluster [DBG] pgmap v6918: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:27:47.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:27:47 smithi086 bash[24289]: audit 2024-09-16T09:27:46.381910+0000 mon.a (mon.0) 1162 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:27:47.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:27:47 smithi086 bash[24289]: audit 2024-09-16T09:27:46.390283+0000 mon.b (mon.2) 929 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:27:47.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:27:47 smithi086 bash[24289]: audit 2024-09-16T09:27:46.391367+0000 mgr.a (mgr.14373) 9976 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:27:47.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:27:47 smithi047 bash[22744]: cluster 2024-09-16T09:27:45.540424+0000 mgr.a (mgr.14373) 9975 : cluster [DBG] pgmap v6918: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:27:47.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:27:47 smithi047 bash[22744]: audit 2024-09-16T09:27:46.381910+0000 mon.a (mon.0) 1162 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:27:47.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:27:47 smithi047 bash[22744]: audit 2024-09-16T09:27:46.390283+0000 mon.b (mon.2) 929 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:27:47.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:27:47 smithi047 bash[22744]: audit 2024-09-16T09:27:46.391367+0000 mgr.a (mgr.14373) 9976 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:27:48.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:27:48 smithi157 bash[24585]: audit 2024-09-16T09:27:47.127850+0000 mgr.a (mgr.14373) 9977 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T09:27:48.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:27:48 smithi157 bash[24585]: cephadm 2024-09-16T09:27:47.130092+0000 mgr.a (mgr.14373) 9978 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T09:27:48.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:27:48 smithi086 bash[24289]: audit 2024-09-16T09:27:47.127850+0000 mgr.a (mgr.14373) 9977 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T09:27:48.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:27:48 smithi086 bash[24289]: cephadm 2024-09-16T09:27:47.130092+0000 mgr.a (mgr.14373) 9978 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T09:27:48.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:27:48 smithi047 bash[22744]: audit 2024-09-16T09:27:47.127850+0000 mgr.a (mgr.14373) 9977 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T09:27:48.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:27:48 smithi047 bash[22744]: cephadm 2024-09-16T09:27:47.130092+0000 mgr.a (mgr.14373) 9978 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T09:27:49.103 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:27:49.104 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:27:49.104 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:27:49.808 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:27:49 smithi157 bash[24585]: cluster 2024-09-16T09:27:47.543167+0000 mgr.a (mgr.14373) 9979 : cluster [DBG] pgmap v6919: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:27:49.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:27:49 smithi086 bash[24289]: cluster 2024-09-16T09:27:47.543167+0000 mgr.a (mgr.14373) 9979 : cluster [DBG] pgmap v6919: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:27:49.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:27:49 smithi047 bash[22744]: cluster 2024-09-16T09:27:47.543167+0000 mgr.a (mgr.14373) 9979 : cluster [DBG] pgmap v6919: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:27:49.862 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:27:49.862 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:27:49.862 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:27:49.862 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:27:49.862 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:27:50.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:27:50 smithi157 bash[24585]: audit 2024-09-16T09:27:49.437384+0000 mgr.a (mgr.14373) 9980 : audit [DBG] from='client.220551 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:27:50.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:27:50 smithi086 bash[24289]: audit 2024-09-16T09:27:49.437384+0000 mgr.a (mgr.14373) 9980 : audit [DBG] from='client.220551 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:27:50.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:27:50 smithi047 bash[22744]: audit 2024-09-16T09:27:49.437384+0000 mgr.a (mgr.14373) 9980 : audit [DBG] from='client.220551 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:27:51.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:27:51 smithi157 bash[24585]: cluster 2024-09-16T09:27:49.543654+0000 mgr.a (mgr.14373) 9981 : cluster [DBG] pgmap v6920: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:27:51.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:27:51 smithi086 bash[24289]: cluster 2024-09-16T09:27:49.543654+0000 mgr.a (mgr.14373) 9981 : cluster [DBG] pgmap v6920: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:27:51.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:27:51 smithi047 bash[22744]: cluster 2024-09-16T09:27:49.543654+0000 mgr.a (mgr.14373) 9981 : cluster [DBG] pgmap v6920: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:27:53.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:27:53 smithi157 bash[24585]: cluster 2024-09-16T09:27:51.545801+0000 mgr.a (mgr.14373) 9982 : cluster [DBG] pgmap v6921: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:27:53.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:27:53 smithi086 bash[24289]: cluster 2024-09-16T09:27:51.545801+0000 mgr.a (mgr.14373) 9982 : cluster [DBG] pgmap v6921: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:27:53.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:27:53 smithi047 bash[22744]: cluster 2024-09-16T09:27:51.545801+0000 mgr.a (mgr.14373) 9982 : cluster [DBG] pgmap v6921: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:27:54.863 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:27:54.864 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:27:54.864 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:27:55.656 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:27:55.657 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:27:55.657 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:27:55.657 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:27:55.657 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:27:55.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:27:55 smithi157 bash[24585]: cluster 2024-09-16T09:27:53.546582+0000 mgr.a (mgr.14373) 9983 : cluster [DBG] pgmap v6922: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:27:55.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:27:55 smithi086 bash[24289]: cluster 2024-09-16T09:27:53.546582+0000 mgr.a (mgr.14373) 9983 : cluster [DBG] pgmap v6922: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:27:55.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:27:55 smithi047 bash[22744]: cluster 2024-09-16T09:27:53.546582+0000 mgr.a (mgr.14373) 9983 : cluster [DBG] pgmap v6922: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:27:56.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:27:56 smithi157 bash[24585]: audit 2024-09-16T09:27:55.195874+0000 mgr.a (mgr.14373) 9984 : audit [DBG] from='client.220629 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:27:56.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:27:56 smithi086 bash[24289]: audit 2024-09-16T09:27:55.195874+0000 mgr.a (mgr.14373) 9984 : audit [DBG] from='client.220629 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:27:56.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:27:56 smithi047 bash[22744]: audit 2024-09-16T09:27:55.195874+0000 mgr.a (mgr.14373) 9984 : audit [DBG] from='client.220629 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:27:57.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:27:57 smithi157 bash[24585]: cluster 2024-09-16T09:27:55.552618+0000 mgr.a (mgr.14373) 9985 : cluster [DBG] pgmap v6923: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:27:57.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:27:57 smithi086 bash[24289]: cluster 2024-09-16T09:27:55.552618+0000 mgr.a (mgr.14373) 9985 : cluster [DBG] pgmap v6923: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:27:57.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:27:57 smithi047 bash[22744]: cluster 2024-09-16T09:27:55.552618+0000 mgr.a (mgr.14373) 9985 : cluster [DBG] pgmap v6923: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:27:59.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:27:59 smithi157 bash[24585]: cluster 2024-09-16T09:27:57.554834+0000 mgr.a (mgr.14373) 9986 : cluster [DBG] pgmap v6924: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:27:59.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:27:59 smithi086 bash[24289]: cluster 2024-09-16T09:27:57.554834+0000 mgr.a (mgr.14373) 9986 : cluster [DBG] pgmap v6924: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:27:59.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:27:59 smithi047 bash[22744]: cluster 2024-09-16T09:27:57.554834+0000 mgr.a (mgr.14373) 9986 : cluster [DBG] pgmap v6924: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:28:00.658 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:28:00.658 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:28:00.658 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:28:01.401 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:28:01.401 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:28:01.401 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:28:01.401 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:28:01.402 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:28:01.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:28:01 smithi157 bash[24585]: cluster 2024-09-16T09:27:59.555622+0000 mgr.a (mgr.14373) 9987 : cluster [DBG] pgmap v6925: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:28:01.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:28:01 smithi086 bash[24289]: cluster 2024-09-16T09:27:59.555622+0000 mgr.a (mgr.14373) 9987 : cluster [DBG] pgmap v6925: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:28:01.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:28:01 smithi047 bash[22744]: cluster 2024-09-16T09:27:59.555622+0000 mgr.a (mgr.14373) 9987 : cluster [DBG] pgmap v6925: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:28:02.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:28:02 smithi157 bash[24585]: audit 2024-09-16T09:28:00.986021+0000 mgr.a (mgr.14373) 9988 : audit [DBG] from='client.220701 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:28:02.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:28:02 smithi086 bash[24289]: audit 2024-09-16T09:28:00.986021+0000 mgr.a (mgr.14373) 9988 : audit [DBG] from='client.220701 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:28:02.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:28:02 smithi047 bash[22744]: audit 2024-09-16T09:28:00.986021+0000 mgr.a (mgr.14373) 9988 : audit [DBG] from='client.220701 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:28:03.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:28:03 smithi157 bash[24585]: cluster 2024-09-16T09:28:01.557950+0000 mgr.a (mgr.14373) 9989 : cluster [DBG] pgmap v6926: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:28:03.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:28:03 smithi086 bash[24289]: cluster 2024-09-16T09:28:01.557950+0000 mgr.a (mgr.14373) 9989 : cluster [DBG] pgmap v6926: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:28:03.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:28:03 smithi047 bash[22744]: cluster 2024-09-16T09:28:01.557950+0000 mgr.a (mgr.14373) 9989 : cluster [DBG] pgmap v6926: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:28:05.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:28:05 smithi157 bash[24585]: cluster 2024-09-16T09:28:03.558737+0000 mgr.a (mgr.14373) 9990 : cluster [DBG] pgmap v6927: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:28:05.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:28:05 smithi086 bash[24289]: cluster 2024-09-16T09:28:03.558737+0000 mgr.a (mgr.14373) 9990 : cluster [DBG] pgmap v6927: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:28:05.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:28:05 smithi047 bash[22744]: cluster 2024-09-16T09:28:03.558737+0000 mgr.a (mgr.14373) 9990 : cluster [DBG] pgmap v6927: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:28:06.402 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:28:06.403 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:28:06.403 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:28:07.177 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:28:07.177 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:28:07.177 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:28:07.177 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:28:07.177 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:28:07.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:28:07 smithi157 bash[24585]: cluster 2024-09-16T09:28:05.559532+0000 mgr.a (mgr.14373) 9991 : cluster [DBG] pgmap v6928: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:28:07.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:28:07 smithi086 bash[24289]: cluster 2024-09-16T09:28:05.559532+0000 mgr.a (mgr.14373) 9991 : cluster [DBG] pgmap v6928: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:28:07.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:28:07 smithi047 bash[22744]: cluster 2024-09-16T09:28:05.559532+0000 mgr.a (mgr.14373) 9991 : cluster [DBG] pgmap v6928: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:28:08.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:28:08 smithi157 bash[24585]: audit 2024-09-16T09:28:06.740640+0000 mgr.a (mgr.14373) 9992 : audit [DBG] from='client.220779 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:28:08.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:28:08 smithi086 bash[24289]: audit 2024-09-16T09:28:06.740640+0000 mgr.a (mgr.14373) 9992 : audit [DBG] from='client.220779 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:28:08.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:28:08 smithi047 bash[22744]: audit 2024-09-16T09:28:06.740640+0000 mgr.a (mgr.14373) 9992 : audit [DBG] from='client.220779 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:28:09.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:28:09 smithi157 bash[24585]: cluster 2024-09-16T09:28:07.562203+0000 mgr.a (mgr.14373) 9993 : cluster [DBG] pgmap v6929: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-16T09:28:09.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:28:09 smithi086 bash[24289]: cluster 2024-09-16T09:28:07.562203+0000 mgr.a (mgr.14373) 9993 : cluster [DBG] pgmap v6929: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-16T09:28:09.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:28:09 smithi047 bash[22744]: cluster 2024-09-16T09:28:07.562203+0000 mgr.a (mgr.14373) 9993 : cluster [DBG] pgmap v6929: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-16T09:28:11.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:28:11 smithi157 bash[24585]: cluster 2024-09-16T09:28:09.562982+0000 mgr.a (mgr.14373) 9994 : cluster [DBG] pgmap v6930: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 4.9 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-16T09:28:11.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:28:11 smithi086 bash[24289]: cluster 2024-09-16T09:28:09.562982+0000 mgr.a (mgr.14373) 9994 : cluster [DBG] pgmap v6930: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 4.9 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-16T09:28:11.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:28:11 smithi047 bash[22744]: cluster 2024-09-16T09:28:09.562982+0000 mgr.a (mgr.14373) 9994 : cluster [DBG] pgmap v6930: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 4.9 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-16T09:28:12.178 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:28:12.179 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:28:12.179 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:28:12.959 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:28:12.960 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:28:12.960 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:28:12.960 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:28:12.960 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:28:13.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:28:13 smithi157 bash[24585]: cluster 2024-09-16T09:28:11.564952+0000 mgr.a (mgr.14373) 9995 : cluster [DBG] pgmap v6931: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-16T09:28:13.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:28:13 smithi086 bash[24289]: cluster 2024-09-16T09:28:11.564952+0000 mgr.a (mgr.14373) 9995 : cluster [DBG] pgmap v6931: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-16T09:28:13.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:28:13 smithi047 bash[22744]: cluster 2024-09-16T09:28:11.564952+0000 mgr.a (mgr.14373) 9995 : cluster [DBG] pgmap v6931: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-16T09:28:14.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:28:14 smithi157 bash[24585]: audit 2024-09-16T09:28:12.519567+0000 mgr.a (mgr.14373) 9996 : audit [DBG] from='client.220857 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:28:14.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:28:14 smithi086 bash[24289]: audit 2024-09-16T09:28:12.519567+0000 mgr.a (mgr.14373) 9996 : audit [DBG] from='client.220857 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:28:14.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:28:14 smithi047 bash[22744]: audit 2024-09-16T09:28:12.519567+0000 mgr.a (mgr.14373) 9996 : audit [DBG] from='client.220857 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:28:15.808 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:28:15 smithi157 bash[24585]: cluster 2024-09-16T09:28:13.565909+0000 mgr.a (mgr.14373) 9997 : cluster [DBG] pgmap v6932: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 4.9 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-16T09:28:15.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:28:15 smithi086 bash[24289]: cluster 2024-09-16T09:28:13.565909+0000 mgr.a (mgr.14373) 9997 : cluster [DBG] pgmap v6932: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 4.9 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-16T09:28:15.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:28:15 smithi047 bash[22744]: cluster 2024-09-16T09:28:13.565909+0000 mgr.a (mgr.14373) 9997 : cluster [DBG] pgmap v6932: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 4.9 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-16T09:28:16.805 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:28:16 smithi157 bash[24585]: cluster 2024-09-16T09:28:15.566712+0000 mgr.a (mgr.14373) 9998 : cluster [DBG] pgmap v6933: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 4.9 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-16T09:28:16.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:28:16 smithi086 bash[24289]: cluster 2024-09-16T09:28:15.566712+0000 mgr.a (mgr.14373) 9998 : cluster [DBG] pgmap v6933: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 4.9 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-16T09:28:16.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:28:16 smithi047 bash[22744]: cluster 2024-09-16T09:28:15.566712+0000 mgr.a (mgr.14373) 9998 : cluster [DBG] pgmap v6933: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 4.9 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-16T09:28:17.961 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:28:17.961 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:28:17.962 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:28:18.713 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:28:18.714 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:28:18.714 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:28:18.714 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:28:18.714 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:28:19.055 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:28:18 smithi157 bash[24585]: cluster 2024-09-16T09:28:17.568883+0000 mgr.a (mgr.14373) 9999 : cluster [DBG] pgmap v6934: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-16T09:28:19.055 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:28:18 smithi157 bash[24585]: audit 2024-09-16T09:28:18.289214+0000 mgr.a (mgr.14373) 10000 : audit [DBG] from='client.220935 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:28:19.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:28:18 smithi086 bash[24289]: cluster 2024-09-16T09:28:17.568883+0000 mgr.a (mgr.14373) 9999 : cluster [DBG] pgmap v6934: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-16T09:28:19.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:28:18 smithi086 bash[24289]: audit 2024-09-16T09:28:18.289214+0000 mgr.a (mgr.14373) 10000 : audit [DBG] from='client.220935 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:28:19.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:28:18 smithi047 bash[22744]: cluster 2024-09-16T09:28:17.568883+0000 mgr.a (mgr.14373) 9999 : cluster [DBG] pgmap v6934: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-16T09:28:19.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:28:18 smithi047 bash[22744]: audit 2024-09-16T09:28:18.289214+0000 mgr.a (mgr.14373) 10000 : audit [DBG] from='client.220935 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:28:21.055 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:28:20 smithi157 bash[24585]: cluster 2024-09-16T09:28:19.569869+0000 mgr.a (mgr.14373) 10001 : cluster [DBG] pgmap v6935: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:28:21.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:28:20 smithi086 bash[24289]: cluster 2024-09-16T09:28:19.569869+0000 mgr.a (mgr.14373) 10001 : cluster [DBG] pgmap v6935: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:28:21.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:28:20 smithi047 bash[22744]: cluster 2024-09-16T09:28:19.569869+0000 mgr.a (mgr.14373) 10001 : cluster [DBG] pgmap v6935: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:28:23.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:28:22 smithi157 bash[24585]: cluster 2024-09-16T09:28:21.572110+0000 mgr.a (mgr.14373) 10002 : cluster [DBG] pgmap v6936: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 53 KiB/s rd, 0 B/s wr, 85 op/s 2024-09-16T09:28:23.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:28:22 smithi086 bash[24289]: cluster 2024-09-16T09:28:21.572110+0000 mgr.a (mgr.14373) 10002 : cluster [DBG] pgmap v6936: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 53 KiB/s rd, 0 B/s wr, 85 op/s 2024-09-16T09:28:23.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:28:22 smithi047 bash[22744]: cluster 2024-09-16T09:28:21.572110+0000 mgr.a (mgr.14373) 10002 : cluster [DBG] pgmap v6936: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 53 KiB/s rd, 0 B/s wr, 85 op/s 2024-09-16T09:28:23.715 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:28:23.715 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:28:23.716 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:28:24.490 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:28:24.490 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:28:24.491 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:28:24.491 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:28:24.491 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:28:25.055 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:28:24 smithi157 bash[24585]: cluster 2024-09-16T09:28:23.572881+0000 mgr.a (mgr.14373) 10003 : cluster [DBG] pgmap v6937: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 52 KiB/s rd, 0 B/s wr, 84 op/s 2024-09-16T09:28:25.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:28:24 smithi157 bash[24585]: audit 2024-09-16T09:28:24.054627+0000 mgr.a (mgr.14373) 10004 : audit [DBG] from='client.221010 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:28:25.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:28:24 smithi086 bash[24289]: cluster 2024-09-16T09:28:23.572881+0000 mgr.a (mgr.14373) 10003 : cluster [DBG] pgmap v6937: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 52 KiB/s rd, 0 B/s wr, 84 op/s 2024-09-16T09:28:25.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:28:24 smithi086 bash[24289]: audit 2024-09-16T09:28:24.054627+0000 mgr.a (mgr.14373) 10004 : audit [DBG] from='client.221010 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:28:25.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:28:24 smithi047 bash[22744]: cluster 2024-09-16T09:28:23.572881+0000 mgr.a (mgr.14373) 10003 : cluster [DBG] pgmap v6937: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 52 KiB/s rd, 0 B/s wr, 84 op/s 2024-09-16T09:28:25.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:28:24 smithi047 bash[22744]: audit 2024-09-16T09:28:24.054627+0000 mgr.a (mgr.14373) 10004 : audit [DBG] from='client.221010 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:28:27.055 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:28:26 smithi157 bash[24585]: cluster 2024-09-16T09:28:25.573796+0000 mgr.a (mgr.14373) 10005 : cluster [DBG] pgmap v6938: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 52 KiB/s rd, 0 B/s wr, 84 op/s 2024-09-16T09:28:27.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:28:26 smithi086 bash[24289]: cluster 2024-09-16T09:28:25.573796+0000 mgr.a (mgr.14373) 10005 : cluster [DBG] pgmap v6938: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 52 KiB/s rd, 0 B/s wr, 84 op/s 2024-09-16T09:28:27.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:28:26 smithi047 bash[22744]: cluster 2024-09-16T09:28:25.573796+0000 mgr.a (mgr.14373) 10005 : cluster [DBG] pgmap v6938: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 52 KiB/s rd, 0 B/s wr, 84 op/s 2024-09-16T09:28:29.055 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:28:28 smithi157 bash[24585]: cluster 2024-09-16T09:28:27.576071+0000 mgr.a (mgr.14373) 10006 : cluster [DBG] pgmap v6939: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 66 KiB/s rd, 0 B/s wr, 108 op/s 2024-09-16T09:28:29.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:28:28 smithi086 bash[24289]: cluster 2024-09-16T09:28:27.576071+0000 mgr.a (mgr.14373) 10006 : cluster [DBG] pgmap v6939: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 66 KiB/s rd, 0 B/s wr, 108 op/s 2024-09-16T09:28:29.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:28:28 smithi047 bash[22744]: cluster 2024-09-16T09:28:27.576071+0000 mgr.a (mgr.14373) 10006 : cluster [DBG] pgmap v6939: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 66 KiB/s rd, 0 B/s wr, 108 op/s 2024-09-16T09:28:29.492 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:28:29.493 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:28:29.493 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:28:30.245 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:28:30.246 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:28:30.246 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:28:30.246 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:28:30.246 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:28:31.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:28:30 smithi157 bash[24585]: cluster 2024-09-16T09:28:29.576818+0000 mgr.a (mgr.14373) 10007 : cluster [DBG] pgmap v6940: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 65 KiB/s rd, 0 B/s wr, 107 op/s 2024-09-16T09:28:31.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:28:30 smithi157 bash[24585]: audit 2024-09-16T09:28:29.822861+0000 mgr.a (mgr.14373) 10008 : audit [DBG] from='client.221085 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:28:31.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:28:30 smithi086 bash[24289]: cluster 2024-09-16T09:28:29.576818+0000 mgr.a (mgr.14373) 10007 : cluster [DBG] pgmap v6940: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 65 KiB/s rd, 0 B/s wr, 107 op/s 2024-09-16T09:28:31.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:28:30 smithi086 bash[24289]: audit 2024-09-16T09:28:29.822861+0000 mgr.a (mgr.14373) 10008 : audit [DBG] from='client.221085 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:28:31.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:28:30 smithi047 bash[22744]: cluster 2024-09-16T09:28:29.576818+0000 mgr.a (mgr.14373) 10007 : cluster [DBG] pgmap v6940: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 65 KiB/s rd, 0 B/s wr, 107 op/s 2024-09-16T09:28:31.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:28:30 smithi047 bash[22744]: audit 2024-09-16T09:28:29.822861+0000 mgr.a (mgr.14373) 10008 : audit [DBG] from='client.221085 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:28:33.055 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:28:32 smithi157 bash[24585]: cluster 2024-09-16T09:28:31.579093+0000 mgr.a (mgr.14373) 10009 : cluster [DBG] pgmap v6941: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 66 KiB/s rd, 0 B/s wr, 108 op/s 2024-09-16T09:28:33.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:28:32 smithi086 bash[24289]: cluster 2024-09-16T09:28:31.579093+0000 mgr.a (mgr.14373) 10009 : cluster [DBG] pgmap v6941: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 66 KiB/s rd, 0 B/s wr, 108 op/s 2024-09-16T09:28:33.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:28:32 smithi047 bash[22744]: cluster 2024-09-16T09:28:31.579093+0000 mgr.a (mgr.14373) 10009 : cluster [DBG] pgmap v6941: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 66 KiB/s rd, 0 B/s wr, 108 op/s 2024-09-16T09:28:35.055 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:28:34 smithi157 bash[24585]: cluster 2024-09-16T09:28:33.579895+0000 mgr.a (mgr.14373) 10010 : cluster [DBG] pgmap v6942: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 15 KiB/s rd, 0 B/s wr, 24 op/s 2024-09-16T09:28:35.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:28:34 smithi086 bash[24289]: cluster 2024-09-16T09:28:33.579895+0000 mgr.a (mgr.14373) 10010 : cluster [DBG] pgmap v6942: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 15 KiB/s rd, 0 B/s wr, 24 op/s 2024-09-16T09:28:35.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:28:34 smithi047 bash[22744]: cluster 2024-09-16T09:28:33.579895+0000 mgr.a (mgr.14373) 10010 : cluster [DBG] pgmap v6942: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 15 KiB/s rd, 0 B/s wr, 24 op/s 2024-09-16T09:28:35.247 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:28:35.248 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:28:35.248 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:28:35.993 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:28:35.993 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:28:35.993 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:28:35.993 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:28:35.994 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:28:37.055 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:28:36 smithi157 bash[24585]: audit 2024-09-16T09:28:35.576680+0000 mgr.a (mgr.14373) 10011 : audit [DBG] from='client.221160 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:28:37.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:28:36 smithi157 bash[24585]: cluster 2024-09-16T09:28:35.591185+0000 mgr.a (mgr.14373) 10012 : cluster [DBG] pgmap v6943: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 15 KiB/s rd, 0 B/s wr, 24 op/s 2024-09-16T09:28:37.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:28:36 smithi086 bash[24289]: audit 2024-09-16T09:28:35.576680+0000 mgr.a (mgr.14373) 10011 : audit [DBG] from='client.221160 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:28:37.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:28:36 smithi086 bash[24289]: cluster 2024-09-16T09:28:35.591185+0000 mgr.a (mgr.14373) 10012 : cluster [DBG] pgmap v6943: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 15 KiB/s rd, 0 B/s wr, 24 op/s 2024-09-16T09:28:37.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:28:36 smithi047 bash[22744]: audit 2024-09-16T09:28:35.576680+0000 mgr.a (mgr.14373) 10011 : audit [DBG] from='client.221160 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:28:37.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:28:36 smithi047 bash[22744]: cluster 2024-09-16T09:28:35.591185+0000 mgr.a (mgr.14373) 10012 : cluster [DBG] pgmap v6943: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 15 KiB/s rd, 0 B/s wr, 24 op/s 2024-09-16T09:28:39.055 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:28:38 smithi157 bash[24585]: cluster 2024-09-16T09:28:37.593625+0000 mgr.a (mgr.14373) 10013 : cluster [DBG] pgmap v6944: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 16 KiB/s rd, 0 B/s wr, 24 op/s 2024-09-16T09:28:39.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:28:38 smithi086 bash[24289]: cluster 2024-09-16T09:28:37.593625+0000 mgr.a (mgr.14373) 10013 : cluster [DBG] pgmap v6944: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 16 KiB/s rd, 0 B/s wr, 24 op/s 2024-09-16T09:28:39.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:28:38 smithi047 bash[22744]: cluster 2024-09-16T09:28:37.593625+0000 mgr.a (mgr.14373) 10013 : cluster [DBG] pgmap v6944: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 16 KiB/s rd, 0 B/s wr, 24 op/s 2024-09-16T09:28:40.995 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:28:40.995 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:28:40.996 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:28:41.055 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:28:40 smithi157 bash[24585]: cluster 2024-09-16T09:28:39.594420+0000 mgr.a (mgr.14373) 10014 : cluster [DBG] pgmap v6945: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:28:41.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:28:40 smithi086 bash[24289]: cluster 2024-09-16T09:28:39.594420+0000 mgr.a (mgr.14373) 10014 : cluster [DBG] pgmap v6945: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:28:41.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:28:40 smithi047 bash[22744]: cluster 2024-09-16T09:28:39.594420+0000 mgr.a (mgr.14373) 10014 : cluster [DBG] pgmap v6945: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:28:41.771 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:28:41.771 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:28:41.771 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:28:41.771 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:28:41.771 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:28:42.055 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:28:41 smithi157 bash[24585]: audit 2024-09-16T09:28:41.327140+0000 mgr.a (mgr.14373) 10015 : audit [DBG] from='client.221238 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:28:42.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:28:41 smithi086 bash[24289]: audit 2024-09-16T09:28:41.327140+0000 mgr.a (mgr.14373) 10015 : audit [DBG] from='client.221238 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:28:42.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:28:41 smithi047 bash[22744]: audit 2024-09-16T09:28:41.327140+0000 mgr.a (mgr.14373) 10015 : audit [DBG] from='client.221238 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:28:43.055 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:28:42 smithi157 bash[24585]: cluster 2024-09-16T09:28:41.595751+0000 mgr.a (mgr.14373) 10016 : cluster [DBG] pgmap v6946: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:28:43.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:28:42 smithi086 bash[24289]: cluster 2024-09-16T09:28:41.595751+0000 mgr.a (mgr.14373) 10016 : cluster [DBG] pgmap v6946: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:28:43.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:28:42 smithi047 bash[22744]: cluster 2024-09-16T09:28:41.595751+0000 mgr.a (mgr.14373) 10016 : cluster [DBG] pgmap v6946: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:28:45.055 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:28:44 smithi157 bash[24585]: cluster 2024-09-16T09:28:43.596608+0000 mgr.a (mgr.14373) 10017 : cluster [DBG] pgmap v6947: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:28:45.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:28:44 smithi086 bash[24289]: cluster 2024-09-16T09:28:43.596608+0000 mgr.a (mgr.14373) 10017 : cluster [DBG] pgmap v6947: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:28:45.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:28:44 smithi047 bash[22744]: cluster 2024-09-16T09:28:43.596608+0000 mgr.a (mgr.14373) 10017 : cluster [DBG] pgmap v6947: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:28:46.773 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:28:46.773 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:28:46.774 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:28:47.055 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:28:46 smithi157 bash[24585]: cluster 2024-09-16T09:28:45.597387+0000 mgr.a (mgr.14373) 10018 : cluster [DBG] pgmap v6948: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:28:47.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:28:46 smithi086 bash[24289]: cluster 2024-09-16T09:28:45.597387+0000 mgr.a (mgr.14373) 10018 : cluster [DBG] pgmap v6948: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:28:47.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:28:46 smithi047 bash[22744]: cluster 2024-09-16T09:28:45.597387+0000 mgr.a (mgr.14373) 10018 : cluster [DBG] pgmap v6948: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:28:47.551 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:28:47.552 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:28:47.552 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:28:47.552 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:28:47.552 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:28:48.055 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:28:47 smithi157 bash[24585]: audit 2024-09-16T09:28:47.105672+0000 mgr.a (mgr.14373) 10019 : audit [DBG] from='client.221313 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:28:48.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:28:47 smithi157 bash[24585]: audit 2024-09-16T09:28:47.184028+0000 mon.b (mon.2) 930 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T09:28:48.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:28:47 smithi086 bash[24289]: audit 2024-09-16T09:28:47.105672+0000 mgr.a (mgr.14373) 10019 : audit [DBG] from='client.221313 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:28:48.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:28:47 smithi086 bash[24289]: audit 2024-09-16T09:28:47.184028+0000 mon.b (mon.2) 930 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T09:28:48.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:28:47 smithi047 bash[22744]: audit 2024-09-16T09:28:47.105672+0000 mgr.a (mgr.14373) 10019 : audit [DBG] from='client.221313 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:28:48.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:28:47 smithi047 bash[22744]: audit 2024-09-16T09:28:47.184028+0000 mon.b (mon.2) 930 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T09:28:49.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:28:48 smithi157 bash[24585]: cluster 2024-09-16T09:28:47.598944+0000 mgr.a (mgr.14373) 10020 : cluster [DBG] pgmap v6949: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:28:49.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:28:48 smithi157 bash[24585]: audit 2024-09-16T09:28:48.018946+0000 mon.b (mon.2) 931 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:28:49.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:28:48 smithi157 bash[24585]: audit 2024-09-16T09:28:48.021429+0000 mon.b (mon.2) 932 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T09:28:49.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:28:48 smithi157 bash[24585]: audit 2024-09-16T09:28:48.031063+0000 mon.a (mon.0) 1163 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:28:49.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:28:48 smithi157 bash[24585]: audit 2024-09-16T09:28:48.038172+0000 mon.b (mon.2) 933 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:28:49.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:28:48 smithi157 bash[24585]: audit 2024-09-16T09:28:48.039476+0000 mgr.a (mgr.14373) 10021 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:28:49.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:28:48 smithi086 bash[24289]: cluster 2024-09-16T09:28:47.598944+0000 mgr.a (mgr.14373) 10020 : cluster [DBG] pgmap v6949: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:28:49.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:28:48 smithi086 bash[24289]: audit 2024-09-16T09:28:48.018946+0000 mon.b (mon.2) 931 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:28:49.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:28:48 smithi086 bash[24289]: audit 2024-09-16T09:28:48.021429+0000 mon.b (mon.2) 932 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T09:28:49.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:28:48 smithi086 bash[24289]: audit 2024-09-16T09:28:48.031063+0000 mon.a (mon.0) 1163 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:28:49.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:28:48 smithi086 bash[24289]: audit 2024-09-16T09:28:48.038172+0000 mon.b (mon.2) 933 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:28:49.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:28:48 smithi086 bash[24289]: audit 2024-09-16T09:28:48.039476+0000 mgr.a (mgr.14373) 10021 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:28:49.092 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 09:28:48 smithi047 bash[22994]: debug 2024-09-16T09:28:48.774+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T09:28:49.093 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 09:28:48 smithi047 bash[22994]: debug 2024-09-16T09:28:48.778+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T09:28:49.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:28:48 smithi047 bash[22744]: cluster 2024-09-16T09:28:47.598944+0000 mgr.a (mgr.14373) 10020 : cluster [DBG] pgmap v6949: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:28:49.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:28:48 smithi047 bash[22744]: audit 2024-09-16T09:28:48.018946+0000 mon.b (mon.2) 931 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:28:49.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:28:48 smithi047 bash[22744]: audit 2024-09-16T09:28:48.021429+0000 mon.b (mon.2) 932 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T09:28:49.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:28:48 smithi047 bash[22744]: audit 2024-09-16T09:28:48.031063+0000 mon.a (mon.0) 1163 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:28:49.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:28:48 smithi047 bash[22744]: audit 2024-09-16T09:28:48.038172+0000 mon.b (mon.2) 933 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:28:49.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:28:48 smithi047 bash[22744]: audit 2024-09-16T09:28:48.039476+0000 mgr.a (mgr.14373) 10021 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:28:50.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:28:49 smithi157 bash[24585]: audit 2024-09-16T09:28:48.781046+0000 mgr.a (mgr.14373) 10022 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T09:28:50.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:28:49 smithi157 bash[24585]: cephadm 2024-09-16T09:28:48.783026+0000 mgr.a (mgr.14373) 10023 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T09:28:50.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:28:49 smithi086 bash[24289]: audit 2024-09-16T09:28:48.781046+0000 mgr.a (mgr.14373) 10022 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T09:28:50.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:28:49 smithi086 bash[24289]: cephadm 2024-09-16T09:28:48.783026+0000 mgr.a (mgr.14373) 10023 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T09:28:50.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:28:49 smithi047 bash[22744]: audit 2024-09-16T09:28:48.781046+0000 mgr.a (mgr.14373) 10022 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T09:28:50.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:28:49 smithi047 bash[22744]: cephadm 2024-09-16T09:28:48.783026+0000 mgr.a (mgr.14373) 10023 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T09:28:51.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:28:50 smithi157 bash[24585]: cluster 2024-09-16T09:28:49.599823+0000 mgr.a (mgr.14373) 10024 : cluster [DBG] pgmap v6950: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T09:28:51.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:28:50 smithi086 bash[24289]: cluster 2024-09-16T09:28:49.599823+0000 mgr.a (mgr.14373) 10024 : cluster [DBG] pgmap v6950: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T09:28:51.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:28:50 smithi047 bash[22744]: cluster 2024-09-16T09:28:49.599823+0000 mgr.a (mgr.14373) 10024 : cluster [DBG] pgmap v6950: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T09:28:52.553 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:28:52.554 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:28:52.554 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:28:53.055 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:28:52 smithi157 bash[24585]: cluster 2024-09-16T09:28:51.602014+0000 mgr.a (mgr.14373) 10025 : cluster [DBG] pgmap v6951: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:28:53.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:28:52 smithi086 bash[24289]: cluster 2024-09-16T09:28:51.602014+0000 mgr.a (mgr.14373) 10025 : cluster [DBG] pgmap v6951: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:28:53.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:28:52 smithi047 bash[22744]: cluster 2024-09-16T09:28:51.602014+0000 mgr.a (mgr.14373) 10025 : cluster [DBG] pgmap v6951: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:28:53.317 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:28:53.317 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:28:53.317 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:28:53.317 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:28:53.317 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:28:54.055 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:28:53 smithi157 bash[24585]: audit 2024-09-16T09:28:52.889540+0000 mgr.a (mgr.14373) 10026 : audit [DBG] from='client.221490 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:28:54.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:28:53 smithi086 bash[24289]: audit 2024-09-16T09:28:52.889540+0000 mgr.a (mgr.14373) 10026 : audit [DBG] from='client.221490 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:28:54.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:28:53 smithi047 bash[22744]: audit 2024-09-16T09:28:52.889540+0000 mgr.a (mgr.14373) 10026 : audit [DBG] from='client.221490 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:28:55.055 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:28:54 smithi157 bash[24585]: cluster 2024-09-16T09:28:53.603129+0000 mgr.a (mgr.14373) 10027 : cluster [DBG] pgmap v6952: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:28:55.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:28:54 smithi086 bash[24289]: cluster 2024-09-16T09:28:53.603129+0000 mgr.a (mgr.14373) 10027 : cluster [DBG] pgmap v6952: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:28:55.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:28:54 smithi047 bash[22744]: cluster 2024-09-16T09:28:53.603129+0000 mgr.a (mgr.14373) 10027 : cluster [DBG] pgmap v6952: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:28:57.055 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:28:56 smithi157 bash[24585]: cluster 2024-09-16T09:28:55.603929+0000 mgr.a (mgr.14373) 10028 : cluster [DBG] pgmap v6953: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:28:57.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:28:56 smithi086 bash[24289]: cluster 2024-09-16T09:28:55.603929+0000 mgr.a (mgr.14373) 10028 : cluster [DBG] pgmap v6953: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:28:57.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:28:56 smithi047 bash[22744]: cluster 2024-09-16T09:28:55.603929+0000 mgr.a (mgr.14373) 10028 : cluster [DBG] pgmap v6953: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:28:58.319 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:28:58.319 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:28:58.319 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:28:59.055 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:28:58 smithi157 bash[24585]: cluster 2024-09-16T09:28:57.606123+0000 mgr.a (mgr.14373) 10029 : cluster [DBG] pgmap v6954: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:28:59.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:28:58 smithi086 bash[24289]: cluster 2024-09-16T09:28:57.606123+0000 mgr.a (mgr.14373) 10029 : cluster [DBG] pgmap v6954: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:28:59.071 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:28:59.072 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:28:59.072 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:28:59.072 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:28:59.072 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:28:59.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:28:58 smithi047 bash[22744]: cluster 2024-09-16T09:28:57.606123+0000 mgr.a (mgr.14373) 10029 : cluster [DBG] pgmap v6954: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:29:00.055 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:28:59 smithi157 bash[24585]: audit 2024-09-16T09:28:58.648578+0000 mgr.a (mgr.14373) 10030 : audit [DBG] from='client.221568 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:29:00.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:28:59 smithi086 bash[24289]: audit 2024-09-16T09:28:58.648578+0000 mgr.a (mgr.14373) 10030 : audit [DBG] from='client.221568 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:29:00.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:28:59 smithi047 bash[22744]: audit 2024-09-16T09:28:58.648578+0000 mgr.a (mgr.14373) 10030 : audit [DBG] from='client.221568 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:29:01.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:29:00 smithi157 bash[24585]: cluster 2024-09-16T09:28:59.607094+0000 mgr.a (mgr.14373) 10031 : cluster [DBG] pgmap v6955: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:29:01.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:29:00 smithi086 bash[24289]: cluster 2024-09-16T09:28:59.607094+0000 mgr.a (mgr.14373) 10031 : cluster [DBG] pgmap v6955: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:29:01.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:29:00 smithi047 bash[22744]: cluster 2024-09-16T09:28:59.607094+0000 mgr.a (mgr.14373) 10031 : cluster [DBG] pgmap v6955: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:29:03.055 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:29:02 smithi157 bash[24585]: cluster 2024-09-16T09:29:01.609261+0000 mgr.a (mgr.14373) 10032 : cluster [DBG] pgmap v6956: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:29:03.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:29:02 smithi086 bash[24289]: cluster 2024-09-16T09:29:01.609261+0000 mgr.a (mgr.14373) 10032 : cluster [DBG] pgmap v6956: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:29:03.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:29:02 smithi047 bash[22744]: cluster 2024-09-16T09:29:01.609261+0000 mgr.a (mgr.14373) 10032 : cluster [DBG] pgmap v6956: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:29:04.073 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:29:04.074 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:29:04.074 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:29:04.863 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:29:04.863 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:29:04.863 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:29:04.863 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:29:04.863 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:29:05.055 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:29:04 smithi157 bash[24585]: cluster 2024-09-16T09:29:03.610013+0000 mgr.a (mgr.14373) 10033 : cluster [DBG] pgmap v6957: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:29:05.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:29:04 smithi157 bash[24585]: audit 2024-09-16T09:29:04.410578+0000 mgr.a (mgr.14373) 10034 : audit [DBG] from='client.221646 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:29:05.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:29:04 smithi086 bash[24289]: cluster 2024-09-16T09:29:03.610013+0000 mgr.a (mgr.14373) 10033 : cluster [DBG] pgmap v6957: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:29:05.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:29:04 smithi086 bash[24289]: audit 2024-09-16T09:29:04.410578+0000 mgr.a (mgr.14373) 10034 : audit [DBG] from='client.221646 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:29:05.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:29:04 smithi047 bash[22744]: cluster 2024-09-16T09:29:03.610013+0000 mgr.a (mgr.14373) 10033 : cluster [DBG] pgmap v6957: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:29:05.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:29:04 smithi047 bash[22744]: audit 2024-09-16T09:29:04.410578+0000 mgr.a (mgr.14373) 10034 : audit [DBG] from='client.221646 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:29:07.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:29:06 smithi157 bash[24585]: cluster 2024-09-16T09:29:05.610901+0000 mgr.a (mgr.14373) 10035 : cluster [DBG] pgmap v6958: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:29:07.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:29:06 smithi086 bash[24289]: cluster 2024-09-16T09:29:05.610901+0000 mgr.a (mgr.14373) 10035 : cluster [DBG] pgmap v6958: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:29:07.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:29:06 smithi047 bash[22744]: cluster 2024-09-16T09:29:05.610901+0000 mgr.a (mgr.14373) 10035 : cluster [DBG] pgmap v6958: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:29:09.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:29:08 smithi157 bash[24585]: cluster 2024-09-16T09:29:07.613101+0000 mgr.a (mgr.14373) 10036 : cluster [DBG] pgmap v6959: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:29:09.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:29:08 smithi086 bash[24289]: cluster 2024-09-16T09:29:07.613101+0000 mgr.a (mgr.14373) 10036 : cluster [DBG] pgmap v6959: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:29:09.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:29:08 smithi047 bash[22744]: cluster 2024-09-16T09:29:07.613101+0000 mgr.a (mgr.14373) 10036 : cluster [DBG] pgmap v6959: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:29:09.865 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:29:09.865 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:29:09.865 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:29:10.617 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:29:10.618 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:29:10.618 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:29:10.618 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:29:10.618 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:29:11.055 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:29:10 smithi157 bash[24585]: cluster 2024-09-16T09:29:09.613917+0000 mgr.a (mgr.14373) 10037 : cluster [DBG] pgmap v6960: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:29:11.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:29:10 smithi157 bash[24585]: audit 2024-09-16T09:29:10.197273+0000 mgr.a (mgr.14373) 10038 : audit [DBG] from='client.221721 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:29:11.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:29:10 smithi086 bash[24289]: cluster 2024-09-16T09:29:09.613917+0000 mgr.a (mgr.14373) 10037 : cluster [DBG] pgmap v6960: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:29:11.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:29:10 smithi086 bash[24289]: audit 2024-09-16T09:29:10.197273+0000 mgr.a (mgr.14373) 10038 : audit [DBG] from='client.221721 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:29:11.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:29:10 smithi047 bash[22744]: cluster 2024-09-16T09:29:09.613917+0000 mgr.a (mgr.14373) 10037 : cluster [DBG] pgmap v6960: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:29:11.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:29:10 smithi047 bash[22744]: audit 2024-09-16T09:29:10.197273+0000 mgr.a (mgr.14373) 10038 : audit [DBG] from='client.221721 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:29:13.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:29:12 smithi157 bash[24585]: cluster 2024-09-16T09:29:11.616150+0000 mgr.a (mgr.14373) 10039 : cluster [DBG] pgmap v6961: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:29:13.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:29:12 smithi086 bash[24289]: cluster 2024-09-16T09:29:11.616150+0000 mgr.a (mgr.14373) 10039 : cluster [DBG] pgmap v6961: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:29:13.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:29:12 smithi047 bash[22744]: cluster 2024-09-16T09:29:11.616150+0000 mgr.a (mgr.14373) 10039 : cluster [DBG] pgmap v6961: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:29:15.055 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:29:14 smithi157 bash[24585]: cluster 2024-09-16T09:29:13.616919+0000 mgr.a (mgr.14373) 10040 : cluster [DBG] pgmap v6962: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:29:15.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:29:14 smithi086 bash[24289]: cluster 2024-09-16T09:29:13.616919+0000 mgr.a (mgr.14373) 10040 : cluster [DBG] pgmap v6962: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:29:15.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:29:14 smithi047 bash[22744]: cluster 2024-09-16T09:29:13.616919+0000 mgr.a (mgr.14373) 10040 : cluster [DBG] pgmap v6962: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:29:15.619 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:29:15.620 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:29:15.620 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:29:16.371 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:29:16.371 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:29:16.371 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:29:16.371 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:29:16.371 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:29:17.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:29:16 smithi157 bash[24585]: cluster 2024-09-16T09:29:15.617662+0000 mgr.a (mgr.14373) 10041 : cluster [DBG] pgmap v6963: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:29:17.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:29:16 smithi157 bash[24585]: audit 2024-09-16T09:29:15.950988+0000 mgr.a (mgr.14373) 10042 : audit [DBG] from='client.221796 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:29:17.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:29:16 smithi086 bash[24289]: cluster 2024-09-16T09:29:15.617662+0000 mgr.a (mgr.14373) 10041 : cluster [DBG] pgmap v6963: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:29:17.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:29:16 smithi086 bash[24289]: audit 2024-09-16T09:29:15.950988+0000 mgr.a (mgr.14373) 10042 : audit [DBG] from='client.221796 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:29:17.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:29:16 smithi047 bash[22744]: cluster 2024-09-16T09:29:15.617662+0000 mgr.a (mgr.14373) 10041 : cluster [DBG] pgmap v6963: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:29:17.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:29:16 smithi047 bash[22744]: audit 2024-09-16T09:29:15.950988+0000 mgr.a (mgr.14373) 10042 : audit [DBG] from='client.221796 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:29:19.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:29:18 smithi157 bash[24585]: cluster 2024-09-16T09:29:17.619968+0000 mgr.a (mgr.14373) 10043 : cluster [DBG] pgmap v6964: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:29:19.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:29:18 smithi086 bash[24289]: cluster 2024-09-16T09:29:17.619968+0000 mgr.a (mgr.14373) 10043 : cluster [DBG] pgmap v6964: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:29:19.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:29:18 smithi047 bash[22744]: cluster 2024-09-16T09:29:17.619968+0000 mgr.a (mgr.14373) 10043 : cluster [DBG] pgmap v6964: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:29:21.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:29:20 smithi157 bash[24585]: cluster 2024-09-16T09:29:19.620742+0000 mgr.a (mgr.14373) 10044 : cluster [DBG] pgmap v6965: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:29:21.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:29:20 smithi086 bash[24289]: cluster 2024-09-16T09:29:19.620742+0000 mgr.a (mgr.14373) 10044 : cluster [DBG] pgmap v6965: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:29:21.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:29:20 smithi047 bash[22744]: cluster 2024-09-16T09:29:19.620742+0000 mgr.a (mgr.14373) 10044 : cluster [DBG] pgmap v6965: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:29:21.372 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:29:21.373 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:29:21.373 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:29:22.161 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:29:22.161 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:29:22.161 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:29:22.161 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:29:22.161 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:29:23.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:29:22 smithi157 bash[24585]: cluster 2024-09-16T09:29:21.622709+0000 mgr.a (mgr.14373) 10045 : cluster [DBG] pgmap v6966: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:29:23.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:29:22 smithi157 bash[24585]: audit 2024-09-16T09:29:21.709517+0000 mgr.a (mgr.14373) 10046 : audit [DBG] from='client.221874 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:29:23.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:29:22 smithi086 bash[24289]: cluster 2024-09-16T09:29:21.622709+0000 mgr.a (mgr.14373) 10045 : cluster [DBG] pgmap v6966: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:29:23.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:29:22 smithi086 bash[24289]: audit 2024-09-16T09:29:21.709517+0000 mgr.a (mgr.14373) 10046 : audit [DBG] from='client.221874 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:29:23.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:29:22 smithi047 bash[22744]: cluster 2024-09-16T09:29:21.622709+0000 mgr.a (mgr.14373) 10045 : cluster [DBG] pgmap v6966: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:29:23.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:29:22 smithi047 bash[22744]: audit 2024-09-16T09:29:21.709517+0000 mgr.a (mgr.14373) 10046 : audit [DBG] from='client.221874 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:29:25.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:29:24 smithi157 bash[24585]: cluster 2024-09-16T09:29:23.623595+0000 mgr.a (mgr.14373) 10047 : cluster [DBG] pgmap v6967: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:29:25.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:29:24 smithi086 bash[24289]: cluster 2024-09-16T09:29:23.623595+0000 mgr.a (mgr.14373) 10047 : cluster [DBG] pgmap v6967: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:29:25.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:29:24 smithi047 bash[22744]: cluster 2024-09-16T09:29:23.623595+0000 mgr.a (mgr.14373) 10047 : cluster [DBG] pgmap v6967: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:29:27.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:29:26 smithi086 bash[24289]: cluster 2024-09-16T09:29:25.624397+0000 mgr.a (mgr.14373) 10048 : cluster [DBG] pgmap v6968: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T09:29:27.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:29:26 smithi047 bash[22744]: cluster 2024-09-16T09:29:25.624397+0000 mgr.a (mgr.14373) 10048 : cluster [DBG] pgmap v6968: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T09:29:27.162 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:29:27.163 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:29:27.163 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:29:27.305 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:29:26 smithi157 bash[24585]: cluster 2024-09-16T09:29:25.624397+0000 mgr.a (mgr.14373) 10048 : cluster [DBG] pgmap v6968: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T09:29:27.942 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:29:27.942 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:29:27.942 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:29:27.942 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:29:27.942 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:29:29.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:29:28 smithi086 bash[24289]: audit 2024-09-16T09:29:27.498328+0000 mgr.a (mgr.14373) 10049 : audit [DBG] from='client.221952 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:29:29.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:29:28 smithi086 bash[24289]: cluster 2024-09-16T09:29:27.625830+0000 mgr.a (mgr.14373) 10050 : cluster [DBG] pgmap v6969: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:29:29.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:29:28 smithi047 bash[22744]: audit 2024-09-16T09:29:27.498328+0000 mgr.a (mgr.14373) 10049 : audit [DBG] from='client.221952 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:29:29.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:29:28 smithi047 bash[22744]: cluster 2024-09-16T09:29:27.625830+0000 mgr.a (mgr.14373) 10050 : cluster [DBG] pgmap v6969: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:29:29.305 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:29:28 smithi157 bash[24585]: audit 2024-09-16T09:29:27.498328+0000 mgr.a (mgr.14373) 10049 : audit [DBG] from='client.221952 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:29:29.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:29:28 smithi157 bash[24585]: cluster 2024-09-16T09:29:27.625830+0000 mgr.a (mgr.14373) 10050 : cluster [DBG] pgmap v6969: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:29:31.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:29:30 smithi086 bash[24289]: cluster 2024-09-16T09:29:29.626838+0000 mgr.a (mgr.14373) 10051 : cluster [DBG] pgmap v6970: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T09:29:31.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:29:30 smithi047 bash[22744]: cluster 2024-09-16T09:29:29.626838+0000 mgr.a (mgr.14373) 10051 : cluster [DBG] pgmap v6970: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T09:29:31.305 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:29:30 smithi157 bash[24585]: cluster 2024-09-16T09:29:29.626838+0000 mgr.a (mgr.14373) 10051 : cluster [DBG] pgmap v6970: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T09:29:32.943 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:29:32.944 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:29:32.944 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:29:33.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:29:32 smithi047 bash[22744]: cluster 2024-09-16T09:29:31.629150+0000 mgr.a (mgr.14373) 10052 : cluster [DBG] pgmap v6971: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:29:33.305 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:29:32 smithi157 bash[24585]: cluster 2024-09-16T09:29:31.629150+0000 mgr.a (mgr.14373) 10052 : cluster [DBG] pgmap v6971: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:29:33.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:29:32 smithi086 bash[24289]: cluster 2024-09-16T09:29:31.629150+0000 mgr.a (mgr.14373) 10052 : cluster [DBG] pgmap v6971: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:29:33.689 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:29:33.689 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:29:33.689 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:29:33.689 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:29:33.690 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:29:34.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:29:33 smithi047 bash[22744]: audit 2024-09-16T09:29:33.277693+0000 mgr.a (mgr.14373) 10053 : audit [DBG] from='client.222030 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:29:34.305 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:29:33 smithi157 bash[24585]: audit 2024-09-16T09:29:33.277693+0000 mgr.a (mgr.14373) 10053 : audit [DBG] from='client.222030 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:29:34.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:29:33 smithi086 bash[24289]: audit 2024-09-16T09:29:33.277693+0000 mgr.a (mgr.14373) 10053 : audit [DBG] from='client.222030 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:29:35.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:29:34 smithi047 bash[22744]: cluster 2024-09-16T09:29:33.630099+0000 mgr.a (mgr.14373) 10054 : cluster [DBG] pgmap v6972: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:29:35.305 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:29:34 smithi157 bash[24585]: cluster 2024-09-16T09:29:33.630099+0000 mgr.a (mgr.14373) 10054 : cluster [DBG] pgmap v6972: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:29:35.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:29:34 smithi086 bash[24289]: cluster 2024-09-16T09:29:33.630099+0000 mgr.a (mgr.14373) 10054 : cluster [DBG] pgmap v6972: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:29:37.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:29:36 smithi047 bash[22744]: cluster 2024-09-16T09:29:35.630914+0000 mgr.a (mgr.14373) 10055 : cluster [DBG] pgmap v6973: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:29:37.305 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:29:36 smithi157 bash[24585]: cluster 2024-09-16T09:29:35.630914+0000 mgr.a (mgr.14373) 10055 : cluster [DBG] pgmap v6973: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:29:37.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:29:36 smithi086 bash[24289]: cluster 2024-09-16T09:29:35.630914+0000 mgr.a (mgr.14373) 10055 : cluster [DBG] pgmap v6973: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:29:38.691 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:29:38.691 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:29:38.691 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:29:39.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:29:38 smithi047 bash[22744]: cluster 2024-09-16T09:29:37.633104+0000 mgr.a (mgr.14373) 10056 : cluster [DBG] pgmap v6974: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:29:39.305 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:29:38 smithi157 bash[24585]: cluster 2024-09-16T09:29:37.633104+0000 mgr.a (mgr.14373) 10056 : cluster [DBG] pgmap v6974: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:29:39.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:29:38 smithi086 bash[24289]: cluster 2024-09-16T09:29:37.633104+0000 mgr.a (mgr.14373) 10056 : cluster [DBG] pgmap v6974: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:29:39.467 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:29:39.467 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:29:39.467 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:29:39.468 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:29:39.468 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:29:40.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:29:39 smithi047 bash[22744]: audit 2024-09-16T09:29:39.028692+0000 mgr.a (mgr.14373) 10057 : audit [DBG] from='client.222105 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:29:40.305 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:29:39 smithi157 bash[24585]: audit 2024-09-16T09:29:39.028692+0000 mgr.a (mgr.14373) 10057 : audit [DBG] from='client.222105 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:29:40.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:29:39 smithi086 bash[24289]: audit 2024-09-16T09:29:39.028692+0000 mgr.a (mgr.14373) 10057 : audit [DBG] from='client.222105 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:29:41.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:29:40 smithi157 bash[24585]: cluster 2024-09-16T09:29:39.634026+0000 mgr.a (mgr.14373) 10058 : cluster [DBG] pgmap v6975: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:29:41.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:29:40 smithi086 bash[24289]: cluster 2024-09-16T09:29:39.634026+0000 mgr.a (mgr.14373) 10058 : cluster [DBG] pgmap v6975: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:29:41.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:29:40 smithi047 bash[22744]: cluster 2024-09-16T09:29:39.634026+0000 mgr.a (mgr.14373) 10058 : cluster [DBG] pgmap v6975: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:29:43.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:29:42 smithi157 bash[24585]: cluster 2024-09-16T09:29:41.636183+0000 mgr.a (mgr.14373) 10059 : cluster [DBG] pgmap v6976: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:29:43.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:29:42 smithi086 bash[24289]: cluster 2024-09-16T09:29:41.636183+0000 mgr.a (mgr.14373) 10059 : cluster [DBG] pgmap v6976: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:29:43.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:29:42 smithi047 bash[22744]: cluster 2024-09-16T09:29:41.636183+0000 mgr.a (mgr.14373) 10059 : cluster [DBG] pgmap v6976: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:29:44.469 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:29:44.470 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:29:44.470 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:29:45.251 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:29:45.252 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:29:45.252 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:29:45.252 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:29:45.252 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:29:45.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:29:44 smithi157 bash[24585]: cluster 2024-09-16T09:29:43.636942+0000 mgr.a (mgr.14373) 10060 : cluster [DBG] pgmap v6977: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:29:45.360 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:29:44 smithi047 bash[22744]: cluster 2024-09-16T09:29:43.636942+0000 mgr.a (mgr.14373) 10060 : cluster [DBG] pgmap v6977: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:29:45.360 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:29:44 smithi086 bash[24289]: cluster 2024-09-16T09:29:43.636942+0000 mgr.a (mgr.14373) 10060 : cluster [DBG] pgmap v6977: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:29:46.305 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:29:45 smithi157 bash[24585]: audit 2024-09-16T09:29:44.801298+0000 mgr.a (mgr.14373) 10061 : audit [DBG] from='client.222180 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:29:46.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:29:45 smithi086 bash[24289]: audit 2024-09-16T09:29:44.801298+0000 mgr.a (mgr.14373) 10061 : audit [DBG] from='client.222180 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:29:46.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:29:45 smithi047 bash[22744]: audit 2024-09-16T09:29:44.801298+0000 mgr.a (mgr.14373) 10061 : audit [DBG] from='client.222180 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:29:47.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:29:46 smithi157 bash[24585]: cluster 2024-09-16T09:29:45.637840+0000 mgr.a (mgr.14373) 10062 : cluster [DBG] pgmap v6978: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:29:47.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:29:46 smithi086 bash[24289]: cluster 2024-09-16T09:29:45.637840+0000 mgr.a (mgr.14373) 10062 : cluster [DBG] pgmap v6978: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:29:47.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:29:46 smithi047 bash[22744]: cluster 2024-09-16T09:29:45.637840+0000 mgr.a (mgr.14373) 10062 : cluster [DBG] pgmap v6978: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:29:49.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:29:48 smithi157 bash[24585]: cluster 2024-09-16T09:29:47.640066+0000 mgr.a (mgr.14373) 10063 : cluster [DBG] pgmap v6979: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:29:49.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:29:48 smithi157 bash[24585]: audit 2024-09-16T09:29:48.832735+0000 mon.b (mon.2) 934 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T09:29:49.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:29:48 smithi086 bash[24289]: cluster 2024-09-16T09:29:47.640066+0000 mgr.a (mgr.14373) 10063 : cluster [DBG] pgmap v6979: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:29:49.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:29:48 smithi086 bash[24289]: audit 2024-09-16T09:29:48.832735+0000 mon.b (mon.2) 934 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T09:29:49.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:29:48 smithi047 bash[22744]: cluster 2024-09-16T09:29:47.640066+0000 mgr.a (mgr.14373) 10063 : cluster [DBG] pgmap v6979: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:29:49.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:29:48 smithi047 bash[22744]: audit 2024-09-16T09:29:48.832735+0000 mon.b (mon.2) 934 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T09:29:50.253 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:29:50.254 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:29:50.254 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:29:51.009 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:29:51.009 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:29:51.009 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:29:51.009 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:29:51.009 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:29:51.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:29:50 smithi157 bash[24585]: cluster 2024-09-16T09:29:49.640804+0000 mgr.a (mgr.14373) 10064 : cluster [DBG] pgmap v6980: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:29:51.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:29:50 smithi086 bash[24289]: cluster 2024-09-16T09:29:49.640804+0000 mgr.a (mgr.14373) 10064 : cluster [DBG] pgmap v6980: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:29:51.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:29:50 smithi047 bash[22744]: cluster 2024-09-16T09:29:49.640804+0000 mgr.a (mgr.14373) 10064 : cluster [DBG] pgmap v6980: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:29:52.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:29:51 smithi157 bash[24585]: audit 2024-09-16T09:29:50.587052+0000 mgr.a (mgr.14373) 10065 : audit [DBG] from='client.222252 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:29:52.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:29:51 smithi086 bash[24289]: audit 2024-09-16T09:29:50.587052+0000 mgr.a (mgr.14373) 10065 : audit [DBG] from='client.222252 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:29:52.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:29:51 smithi047 bash[22744]: audit 2024-09-16T09:29:50.587052+0000 mgr.a (mgr.14373) 10065 : audit [DBG] from='client.222252 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:29:53.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:29:52 smithi157 bash[24585]: cluster 2024-09-16T09:29:51.643198+0000 mgr.a (mgr.14373) 10066 : cluster [DBG] pgmap v6981: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:29:53.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:29:52 smithi086 bash[24289]: cluster 2024-09-16T09:29:51.643198+0000 mgr.a (mgr.14373) 10066 : cluster [DBG] pgmap v6981: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:29:53.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:29:52 smithi047 bash[22744]: cluster 2024-09-16T09:29:51.643198+0000 mgr.a (mgr.14373) 10066 : cluster [DBG] pgmap v6981: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:29:55.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:29:55 smithi157 bash[24585]: cluster 2024-09-16T09:29:53.644011+0000 mgr.a (mgr.14373) 10067 : cluster [DBG] pgmap v6982: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:29:55.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:29:55 smithi157 bash[24585]: audit 2024-09-16T09:29:54.175082+0000 mon.a (mon.0) 1164 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:29:55.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:29:55 smithi157 bash[24585]: audit 2024-09-16T09:29:54.184201+0000 mon.a (mon.0) 1165 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:29:55.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:29:55 smithi157 bash[24585]: audit 2024-09-16T09:29:54.207579+0000 mon.a (mon.0) 1166 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:29:55.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:29:55 smithi157 bash[24585]: audit 2024-09-16T09:29:54.216101+0000 mon.a (mon.0) 1167 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:29:55.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:29:55 smithi157 bash[24585]: audit 2024-09-16T09:29:54.222295+0000 mon.a (mon.0) 1168 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:29:55.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:29:55 smithi157 bash[24585]: audit 2024-09-16T09:29:54.231984+0000 mon.a (mon.0) 1169 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:29:55.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:29:55 smithi157 bash[24585]: audit 2024-09-16T09:29:54.948507+0000 mon.b (mon.2) 935 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:29:55.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:29:55 smithi157 bash[24585]: audit 2024-09-16T09:29:54.950570+0000 mon.b (mon.2) 936 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T09:29:55.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:29:55 smithi157 bash[24585]: audit 2024-09-16T09:29:54.960734+0000 mon.a (mon.0) 1170 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:29:55.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:29:55 smithi157 bash[24585]: audit 2024-09-16T09:29:54.967571+0000 mon.b (mon.2) 937 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:29:55.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:29:55 smithi086 bash[24289]: cluster 2024-09-16T09:29:53.644011+0000 mgr.a (mgr.14373) 10067 : cluster [DBG] pgmap v6982: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:29:55.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:29:55 smithi086 bash[24289]: audit 2024-09-16T09:29:54.175082+0000 mon.a (mon.0) 1164 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:29:55.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:29:55 smithi086 bash[24289]: audit 2024-09-16T09:29:54.184201+0000 mon.a (mon.0) 1165 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:29:55.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:29:55 smithi086 bash[24289]: audit 2024-09-16T09:29:54.207579+0000 mon.a (mon.0) 1166 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:29:55.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:29:55 smithi086 bash[24289]: audit 2024-09-16T09:29:54.216101+0000 mon.a (mon.0) 1167 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:29:55.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:29:55 smithi086 bash[24289]: audit 2024-09-16T09:29:54.222295+0000 mon.a (mon.0) 1168 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:29:55.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:29:55 smithi086 bash[24289]: audit 2024-09-16T09:29:54.231984+0000 mon.a (mon.0) 1169 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:29:55.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:29:55 smithi086 bash[24289]: audit 2024-09-16T09:29:54.948507+0000 mon.b (mon.2) 935 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:29:55.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:29:55 smithi086 bash[24289]: audit 2024-09-16T09:29:54.950570+0000 mon.b (mon.2) 936 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T09:29:55.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:29:55 smithi086 bash[24289]: audit 2024-09-16T09:29:54.960734+0000 mon.a (mon.0) 1170 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:29:55.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:29:55 smithi086 bash[24289]: audit 2024-09-16T09:29:54.967571+0000 mon.b (mon.2) 937 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:29:55.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:29:55 smithi047 bash[22744]: cluster 2024-09-16T09:29:53.644011+0000 mgr.a (mgr.14373) 10067 : cluster [DBG] pgmap v6982: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:29:55.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:29:55 smithi047 bash[22744]: audit 2024-09-16T09:29:54.175082+0000 mon.a (mon.0) 1164 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:29:55.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:29:55 smithi047 bash[22744]: audit 2024-09-16T09:29:54.184201+0000 mon.a (mon.0) 1165 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:29:55.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:29:55 smithi047 bash[22744]: audit 2024-09-16T09:29:54.207579+0000 mon.a (mon.0) 1166 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:29:55.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:29:55 smithi047 bash[22744]: audit 2024-09-16T09:29:54.216101+0000 mon.a (mon.0) 1167 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:29:55.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:29:55 smithi047 bash[22744]: audit 2024-09-16T09:29:54.222295+0000 mon.a (mon.0) 1168 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:29:55.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:29:55 smithi047 bash[22744]: audit 2024-09-16T09:29:54.231984+0000 mon.a (mon.0) 1169 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:29:55.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:29:55 smithi047 bash[22744]: audit 2024-09-16T09:29:54.948507+0000 mon.b (mon.2) 935 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:29:55.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:29:55 smithi047 bash[22744]: audit 2024-09-16T09:29:54.950570+0000 mon.b (mon.2) 936 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T09:29:55.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:29:55 smithi047 bash[22744]: audit 2024-09-16T09:29:54.960734+0000 mon.a (mon.0) 1170 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:29:55.594 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:29:55 smithi047 bash[22744]: audit 2024-09-16T09:29:54.967571+0000 mon.b (mon.2) 937 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:29:56.010 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:29:56.011 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:29:56.011 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:29:56.092 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 09:29:55 smithi047 bash[22994]: debug 2024-09-16T09:29:55.721+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T09:29:56.093 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 09:29:55 smithi047 bash[22994]: debug 2024-09-16T09:29:55.725+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T09:29:56.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:29:56 smithi157 bash[24585]: audit 2024-09-16T09:29:54.968617+0000 mgr.a (mgr.14373) 10068 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:29:56.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:29:56 smithi086 bash[24289]: audit 2024-09-16T09:29:54.968617+0000 mgr.a (mgr.14373) 10068 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:29:56.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:29:56 smithi047 bash[22744]: audit 2024-09-16T09:29:54.968617+0000 mgr.a (mgr.14373) 10068 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:29:56.759 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:29:56.759 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:29:56.760 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:29:56.760 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:29:56.760 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:29:57.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:29:57 smithi157 bash[24585]: cluster 2024-09-16T09:29:55.644533+0000 mgr.a (mgr.14373) 10069 : cluster [DBG] pgmap v6983: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:29:57.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:29:57 smithi157 bash[24585]: audit 2024-09-16T09:29:55.725628+0000 mgr.a (mgr.14373) 10070 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T09:29:57.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:29:57 smithi157 bash[24585]: cephadm 2024-09-16T09:29:55.727562+0000 mgr.a (mgr.14373) 10071 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T09:29:57.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:29:57 smithi157 bash[24585]: audit 2024-09-16T09:29:56.337971+0000 mgr.a (mgr.14373) 10072 : audit [DBG] from='client.222423 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:29:57.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:29:57 smithi086 bash[24289]: cluster 2024-09-16T09:29:55.644533+0000 mgr.a (mgr.14373) 10069 : cluster [DBG] pgmap v6983: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:29:57.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:29:57 smithi086 bash[24289]: audit 2024-09-16T09:29:55.725628+0000 mgr.a (mgr.14373) 10070 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T09:29:57.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:29:57 smithi086 bash[24289]: cephadm 2024-09-16T09:29:55.727562+0000 mgr.a (mgr.14373) 10071 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T09:29:57.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:29:57 smithi086 bash[24289]: audit 2024-09-16T09:29:56.337971+0000 mgr.a (mgr.14373) 10072 : audit [DBG] from='client.222423 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:29:57.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:29:57 smithi047 bash[22744]: cluster 2024-09-16T09:29:55.644533+0000 mgr.a (mgr.14373) 10069 : cluster [DBG] pgmap v6983: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:29:57.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:29:57 smithi047 bash[22744]: audit 2024-09-16T09:29:55.725628+0000 mgr.a (mgr.14373) 10070 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T09:29:57.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:29:57 smithi047 bash[22744]: cephadm 2024-09-16T09:29:55.727562+0000 mgr.a (mgr.14373) 10071 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T09:29:57.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:29:57 smithi047 bash[22744]: audit 2024-09-16T09:29:56.337971+0000 mgr.a (mgr.14373) 10072 : audit [DBG] from='client.222423 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:29:59.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:29:59 smithi157 bash[24585]: cluster 2024-09-16T09:29:57.647167+0000 mgr.a (mgr.14373) 10073 : cluster [DBG] pgmap v6984: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:29:59.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:29:59 smithi086 bash[24289]: cluster 2024-09-16T09:29:57.647167+0000 mgr.a (mgr.14373) 10073 : cluster [DBG] pgmap v6984: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:29:59.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:29:59 smithi047 bash[22744]: cluster 2024-09-16T09:29:57.647167+0000 mgr.a (mgr.14373) 10073 : cluster [DBG] pgmap v6984: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:30:00.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:30:00 smithi157 bash[24585]: cluster 2024-09-16T09:30:00.000147+0000 mon.a (mon.0) 1171 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-16T09:30:00.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:30:00 smithi086 bash[24289]: cluster 2024-09-16T09:30:00.000147+0000 mon.a (mon.0) 1171 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-16T09:30:00.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:30:00 smithi047 bash[22744]: cluster 2024-09-16T09:30:00.000147+0000 mon.a (mon.0) 1171 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-16T09:30:01.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:30:01 smithi157 bash[24585]: cluster 2024-09-16T09:29:59.647937+0000 mgr.a (mgr.14373) 10074 : cluster [DBG] pgmap v6985: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T09:30:01.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:30:01 smithi086 bash[24289]: cluster 2024-09-16T09:29:59.647937+0000 mgr.a (mgr.14373) 10074 : cluster [DBG] pgmap v6985: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T09:30:01.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:30:01 smithi047 bash[22744]: cluster 2024-09-16T09:29:59.647937+0000 mgr.a (mgr.14373) 10074 : cluster [DBG] pgmap v6985: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T09:30:01.761 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:30:01.761 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:30:01.762 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:30:02.547 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:30:02.547 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:30:02.547 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:30:02.548 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:30:02.548 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:30:03.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:30:03 smithi157 bash[24585]: cluster 2024-09-16T09:30:01.649862+0000 mgr.a (mgr.14373) 10075 : cluster [DBG] pgmap v6986: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:30:03.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:30:03 smithi157 bash[24585]: audit 2024-09-16T09:30:02.096955+0000 mgr.a (mgr.14373) 10076 : audit [DBG] from='client.222501 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:30:03.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:30:03 smithi086 bash[24289]: cluster 2024-09-16T09:30:01.649862+0000 mgr.a (mgr.14373) 10075 : cluster [DBG] pgmap v6986: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:30:03.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:30:03 smithi086 bash[24289]: audit 2024-09-16T09:30:02.096955+0000 mgr.a (mgr.14373) 10076 : audit [DBG] from='client.222501 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:30:03.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:30:03 smithi047 bash[22744]: cluster 2024-09-16T09:30:01.649862+0000 mgr.a (mgr.14373) 10075 : cluster [DBG] pgmap v6986: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:30:03.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:30:03 smithi047 bash[22744]: audit 2024-09-16T09:30:02.096955+0000 mgr.a (mgr.14373) 10076 : audit [DBG] from='client.222501 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:30:05.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:30:05 smithi157 bash[24585]: cluster 2024-09-16T09:30:03.650764+0000 mgr.a (mgr.14373) 10077 : cluster [DBG] pgmap v6987: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T09:30:05.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:30:05 smithi086 bash[24289]: cluster 2024-09-16T09:30:03.650764+0000 mgr.a (mgr.14373) 10077 : cluster [DBG] pgmap v6987: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T09:30:05.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:30:05 smithi047 bash[22744]: cluster 2024-09-16T09:30:03.650764+0000 mgr.a (mgr.14373) 10077 : cluster [DBG] pgmap v6987: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T09:30:07.549 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:30:07.550 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:30:07.550 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:30:07.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:30:07 smithi157 bash[24585]: cluster 2024-09-16T09:30:05.651530+0000 mgr.a (mgr.14373) 10078 : cluster [DBG] pgmap v6988: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T09:30:07.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:30:07 smithi086 bash[24289]: cluster 2024-09-16T09:30:05.651530+0000 mgr.a (mgr.14373) 10078 : cluster [DBG] pgmap v6988: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T09:30:07.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:30:07 smithi047 bash[22744]: cluster 2024-09-16T09:30:05.651530+0000 mgr.a (mgr.14373) 10078 : cluster [DBG] pgmap v6988: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T09:30:08.303 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:30:08.303 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:30:08.303 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:30:08.303 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:30:08.303 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:30:09.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:30:09 smithi157 bash[24585]: cluster 2024-09-16T09:30:07.652791+0000 mgr.a (mgr.14373) 10079 : cluster [DBG] pgmap v6989: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:30:09.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:30:09 smithi157 bash[24585]: audit 2024-09-16T09:30:07.885210+0000 mgr.a (mgr.14373) 10080 : audit [DBG] from='client.222579 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:30:09.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:30:09 smithi086 bash[24289]: cluster 2024-09-16T09:30:07.652791+0000 mgr.a (mgr.14373) 10079 : cluster [DBG] pgmap v6989: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:30:09.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:30:09 smithi086 bash[24289]: audit 2024-09-16T09:30:07.885210+0000 mgr.a (mgr.14373) 10080 : audit [DBG] from='client.222579 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:30:09.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:30:09 smithi047 bash[22744]: cluster 2024-09-16T09:30:07.652791+0000 mgr.a (mgr.14373) 10079 : cluster [DBG] pgmap v6989: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:30:09.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:30:09 smithi047 bash[22744]: audit 2024-09-16T09:30:07.885210+0000 mgr.a (mgr.14373) 10080 : audit [DBG] from='client.222579 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:30:11.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:30:11 smithi157 bash[24585]: cluster 2024-09-16T09:30:09.653649+0000 mgr.a (mgr.14373) 10081 : cluster [DBG] pgmap v6990: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:30:11.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:30:11 smithi086 bash[24289]: cluster 2024-09-16T09:30:09.653649+0000 mgr.a (mgr.14373) 10081 : cluster [DBG] pgmap v6990: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:30:11.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:30:11 smithi047 bash[22744]: cluster 2024-09-16T09:30:09.653649+0000 mgr.a (mgr.14373) 10081 : cluster [DBG] pgmap v6990: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:30:13.304 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:30:13.305 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:30:13.305 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:30:13.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:30:13 smithi157 bash[24585]: cluster 2024-09-16T09:30:11.656000+0000 mgr.a (mgr.14373) 10082 : cluster [DBG] pgmap v6991: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:30:13.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:30:13 smithi086 bash[24289]: cluster 2024-09-16T09:30:11.656000+0000 mgr.a (mgr.14373) 10082 : cluster [DBG] pgmap v6991: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:30:13.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:30:13 smithi047 bash[22744]: cluster 2024-09-16T09:30:11.656000+0000 mgr.a (mgr.14373) 10082 : cluster [DBG] pgmap v6991: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:30:14.057 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:30:14.057 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:30:14.057 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:30:14.057 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:30:14.057 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:30:15.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:30:15 smithi157 bash[24585]: audit 2024-09-16T09:30:13.632325+0000 mgr.a (mgr.14373) 10083 : audit [DBG] from='client.222654 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:30:15.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:30:15 smithi157 bash[24585]: cluster 2024-09-16T09:30:13.657028+0000 mgr.a (mgr.14373) 10084 : cluster [DBG] pgmap v6992: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:30:15.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:30:15 smithi086 bash[24289]: audit 2024-09-16T09:30:13.632325+0000 mgr.a (mgr.14373) 10083 : audit [DBG] from='client.222654 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:30:15.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:30:15 smithi086 bash[24289]: cluster 2024-09-16T09:30:13.657028+0000 mgr.a (mgr.14373) 10084 : cluster [DBG] pgmap v6992: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:30:15.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:30:15 smithi047 bash[22744]: audit 2024-09-16T09:30:13.632325+0000 mgr.a (mgr.14373) 10083 : audit [DBG] from='client.222654 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:30:15.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:30:15 smithi047 bash[22744]: cluster 2024-09-16T09:30:13.657028+0000 mgr.a (mgr.14373) 10084 : cluster [DBG] pgmap v6992: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:30:17.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:30:17 smithi157 bash[24585]: cluster 2024-09-16T09:30:15.657950+0000 mgr.a (mgr.14373) 10085 : cluster [DBG] pgmap v6993: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:30:17.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:30:17 smithi086 bash[24289]: cluster 2024-09-16T09:30:15.657950+0000 mgr.a (mgr.14373) 10085 : cluster [DBG] pgmap v6993: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:30:17.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:30:17 smithi047 bash[22744]: cluster 2024-09-16T09:30:15.657950+0000 mgr.a (mgr.14373) 10085 : cluster [DBG] pgmap v6993: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:30:19.058 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:30:19.059 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:30:19.059 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:30:19.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:30:19 smithi157 bash[24585]: cluster 2024-09-16T09:30:17.660156+0000 mgr.a (mgr.14373) 10086 : cluster [DBG] pgmap v6994: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:30:19.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:30:19 smithi086 bash[24289]: cluster 2024-09-16T09:30:17.660156+0000 mgr.a (mgr.14373) 10086 : cluster [DBG] pgmap v6994: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:30:19.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:30:19 smithi047 bash[22744]: cluster 2024-09-16T09:30:17.660156+0000 mgr.a (mgr.14373) 10086 : cluster [DBG] pgmap v6994: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:30:19.831 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:30:19.831 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:30:19.831 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:30:19.831 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:30:19.831 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:30:20.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:30:20 smithi157 bash[24585]: audit 2024-09-16T09:30:19.394550+0000 mgr.a (mgr.14373) 10087 : audit [DBG] from='client.222732 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:30:20.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:30:20 smithi086 bash[24289]: audit 2024-09-16T09:30:19.394550+0000 mgr.a (mgr.14373) 10087 : audit [DBG] from='client.222732 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:30:20.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:30:20 smithi047 bash[22744]: audit 2024-09-16T09:30:19.394550+0000 mgr.a (mgr.14373) 10087 : audit [DBG] from='client.222732 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:30:21.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:30:21 smithi157 bash[24585]: cluster 2024-09-16T09:30:19.660717+0000 mgr.a (mgr.14373) 10088 : cluster [DBG] pgmap v6995: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:30:21.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:30:21 smithi086 bash[24289]: cluster 2024-09-16T09:30:19.660717+0000 mgr.a (mgr.14373) 10088 : cluster [DBG] pgmap v6995: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:30:21.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:30:21 smithi047 bash[22744]: cluster 2024-09-16T09:30:19.660717+0000 mgr.a (mgr.14373) 10088 : cluster [DBG] pgmap v6995: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:30:23.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:30:23 smithi157 bash[24585]: cluster 2024-09-16T09:30:21.662987+0000 mgr.a (mgr.14373) 10089 : cluster [DBG] pgmap v6996: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:30:23.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:30:23 smithi086 bash[24289]: cluster 2024-09-16T09:30:21.662987+0000 mgr.a (mgr.14373) 10089 : cluster [DBG] pgmap v6996: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:30:23.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:30:23 smithi047 bash[22744]: cluster 2024-09-16T09:30:21.662987+0000 mgr.a (mgr.14373) 10089 : cluster [DBG] pgmap v6996: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:30:24.832 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:30:24.833 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:30:24.833 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:30:25.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:30:25 smithi157 bash[24585]: cluster 2024-09-16T09:30:23.663771+0000 mgr.a (mgr.14373) 10090 : cluster [DBG] pgmap v6997: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:30:25.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:30:25 smithi086 bash[24289]: cluster 2024-09-16T09:30:23.663771+0000 mgr.a (mgr.14373) 10090 : cluster [DBG] pgmap v6997: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:30:25.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:30:25 smithi047 bash[22744]: cluster 2024-09-16T09:30:23.663771+0000 mgr.a (mgr.14373) 10090 : cluster [DBG] pgmap v6997: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:30:25.593 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:30:25.593 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:30:25.593 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:30:25.593 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:30:25.594 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:30:26.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:30:26 smithi157 bash[24585]: audit 2024-09-16T09:30:25.164839+0000 mgr.a (mgr.14373) 10091 : audit [DBG] from='client.222810 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:30:26.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:30:26 smithi086 bash[24289]: audit 2024-09-16T09:30:25.164839+0000 mgr.a (mgr.14373) 10091 : audit [DBG] from='client.222810 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:30:26.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:30:26 smithi047 bash[22744]: audit 2024-09-16T09:30:25.164839+0000 mgr.a (mgr.14373) 10091 : audit [DBG] from='client.222810 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:30:27.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:30:27 smithi157 bash[24585]: cluster 2024-09-16T09:30:25.664534+0000 mgr.a (mgr.14373) 10092 : cluster [DBG] pgmap v6998: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:30:27.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:30:27 smithi086 bash[24289]: cluster 2024-09-16T09:30:25.664534+0000 mgr.a (mgr.14373) 10092 : cluster [DBG] pgmap v6998: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:30:27.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:30:27 smithi047 bash[22744]: cluster 2024-09-16T09:30:25.664534+0000 mgr.a (mgr.14373) 10092 : cluster [DBG] pgmap v6998: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:30:29.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:30:29 smithi157 bash[24585]: cluster 2024-09-16T09:30:27.666862+0000 mgr.a (mgr.14373) 10093 : cluster [DBG] pgmap v6999: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:30:29.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:30:29 smithi086 bash[24289]: cluster 2024-09-16T09:30:27.666862+0000 mgr.a (mgr.14373) 10093 : cluster [DBG] pgmap v6999: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:30:29.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:30:29 smithi047 bash[22744]: cluster 2024-09-16T09:30:27.666862+0000 mgr.a (mgr.14373) 10093 : cluster [DBG] pgmap v6999: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:30:30.595 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:30:30.596 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:30:30.596 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:30:31.365 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:30:31.366 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:30:31.366 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:30:31.366 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:30:31.366 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:30:31.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:30:31 smithi157 bash[24585]: cluster 2024-09-16T09:30:29.667654+0000 mgr.a (mgr.14373) 10094 : cluster [DBG] pgmap v7000: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:30:31.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:30:31 smithi086 bash[24289]: cluster 2024-09-16T09:30:29.667654+0000 mgr.a (mgr.14373) 10094 : cluster [DBG] pgmap v7000: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:30:31.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:30:31 smithi047 bash[22744]: cluster 2024-09-16T09:30:29.667654+0000 mgr.a (mgr.14373) 10094 : cluster [DBG] pgmap v7000: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:30:32.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:30:32 smithi157 bash[24585]: audit 2024-09-16T09:30:30.932886+0000 mgr.a (mgr.14373) 10095 : audit [DBG] from='client.222888 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:30:32.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:30:32 smithi086 bash[24289]: audit 2024-09-16T09:30:30.932886+0000 mgr.a (mgr.14373) 10095 : audit [DBG] from='client.222888 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:30:32.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:30:32 smithi047 bash[22744]: audit 2024-09-16T09:30:30.932886+0000 mgr.a (mgr.14373) 10095 : audit [DBG] from='client.222888 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:30:33.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:30:33 smithi157 bash[24585]: cluster 2024-09-16T09:30:31.669961+0000 mgr.a (mgr.14373) 10096 : cluster [DBG] pgmap v7001: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:30:33.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:30:33 smithi086 bash[24289]: cluster 2024-09-16T09:30:31.669961+0000 mgr.a (mgr.14373) 10096 : cluster [DBG] pgmap v7001: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:30:33.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:30:33 smithi047 bash[22744]: cluster 2024-09-16T09:30:31.669961+0000 mgr.a (mgr.14373) 10096 : cluster [DBG] pgmap v7001: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:30:35.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:30:35 smithi157 bash[24585]: cluster 2024-09-16T09:30:33.670765+0000 mgr.a (mgr.14373) 10097 : cluster [DBG] pgmap v7002: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:30:35.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:30:35 smithi086 bash[24289]: cluster 2024-09-16T09:30:33.670765+0000 mgr.a (mgr.14373) 10097 : cluster [DBG] pgmap v7002: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:30:35.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:30:35 smithi047 bash[22744]: cluster 2024-09-16T09:30:33.670765+0000 mgr.a (mgr.14373) 10097 : cluster [DBG] pgmap v7002: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:30:36.367 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:30:36.368 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:30:36.368 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:30:37.108 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:30:37.108 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:30:37.108 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:30:37.108 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:30:37.108 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:30:37.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:30:37 smithi157 bash[24585]: cluster 2024-09-16T09:30:35.671572+0000 mgr.a (mgr.14373) 10098 : cluster [DBG] pgmap v7003: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:30:37.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:30:37 smithi086 bash[24289]: cluster 2024-09-16T09:30:35.671572+0000 mgr.a (mgr.14373) 10098 : cluster [DBG] pgmap v7003: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:30:37.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:30:37 smithi047 bash[22744]: cluster 2024-09-16T09:30:35.671572+0000 mgr.a (mgr.14373) 10098 : cluster [DBG] pgmap v7003: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:30:38.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:30:38 smithi086 bash[24289]: audit 2024-09-16T09:30:36.698115+0000 mgr.a (mgr.14373) 10099 : audit [DBG] from='client.222966 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:30:38.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:30:38 smithi047 bash[22744]: audit 2024-09-16T09:30:36.698115+0000 mgr.a (mgr.14373) 10099 : audit [DBG] from='client.222966 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:30:38.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:30:38 smithi157 bash[24585]: audit 2024-09-16T09:30:36.698115+0000 mgr.a (mgr.14373) 10099 : audit [DBG] from='client.222966 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:30:39.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:30:39 smithi086 bash[24289]: cluster 2024-09-16T09:30:37.674505+0000 mgr.a (mgr.14373) 10100 : cluster [DBG] pgmap v7004: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:30:39.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:30:39 smithi047 bash[22744]: cluster 2024-09-16T09:30:37.674505+0000 mgr.a (mgr.14373) 10100 : cluster [DBG] pgmap v7004: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:30:39.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:30:39 smithi157 bash[24585]: cluster 2024-09-16T09:30:37.674505+0000 mgr.a (mgr.14373) 10100 : cluster [DBG] pgmap v7004: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:30:41.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:30:41 smithi086 bash[24289]: cluster 2024-09-16T09:30:39.675496+0000 mgr.a (mgr.14373) 10101 : cluster [DBG] pgmap v7005: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:30:41.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:30:41 smithi047 bash[22744]: cluster 2024-09-16T09:30:39.675496+0000 mgr.a (mgr.14373) 10101 : cluster [DBG] pgmap v7005: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:30:41.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:30:41 smithi157 bash[24585]: cluster 2024-09-16T09:30:39.675496+0000 mgr.a (mgr.14373) 10101 : cluster [DBG] pgmap v7005: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:30:42.109 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:30:42.110 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:30:42.110 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:30:42.892 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:30:42.892 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:30:42.892 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:30:42.893 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:30:42.893 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:30:43.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:30:43 smithi086 bash[24289]: cluster 2024-09-16T09:30:41.677615+0000 mgr.a (mgr.14373) 10102 : cluster [DBG] pgmap v7006: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:30:43.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:30:43 smithi086 bash[24289]: audit 2024-09-16T09:30:42.448124+0000 mgr.a (mgr.14373) 10103 : audit [DBG] from='client.223044 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:30:43.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:30:43 smithi047 bash[22744]: cluster 2024-09-16T09:30:41.677615+0000 mgr.a (mgr.14373) 10102 : cluster [DBG] pgmap v7006: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:30:43.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:30:43 smithi047 bash[22744]: audit 2024-09-16T09:30:42.448124+0000 mgr.a (mgr.14373) 10103 : audit [DBG] from='client.223044 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:30:43.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:30:43 smithi157 bash[24585]: cluster 2024-09-16T09:30:41.677615+0000 mgr.a (mgr.14373) 10102 : cluster [DBG] pgmap v7006: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:30:43.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:30:43 smithi157 bash[24585]: audit 2024-09-16T09:30:42.448124+0000 mgr.a (mgr.14373) 10103 : audit [DBG] from='client.223044 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:30:45.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:30:45 smithi047 bash[22744]: cluster 2024-09-16T09:30:43.678809+0000 mgr.a (mgr.14373) 10104 : cluster [DBG] pgmap v7007: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:30:45.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:30:45 smithi157 bash[24585]: cluster 2024-09-16T09:30:43.678809+0000 mgr.a (mgr.14373) 10104 : cluster [DBG] pgmap v7007: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:30:45.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:30:45 smithi086 bash[24289]: cluster 2024-09-16T09:30:43.678809+0000 mgr.a (mgr.14373) 10104 : cluster [DBG] pgmap v7007: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:30:47.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:30:47 smithi047 bash[22744]: cluster 2024-09-16T09:30:45.679763+0000 mgr.a (mgr.14373) 10105 : cluster [DBG] pgmap v7008: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:30:47.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:30:47 smithi157 bash[24585]: cluster 2024-09-16T09:30:45.679763+0000 mgr.a (mgr.14373) 10105 : cluster [DBG] pgmap v7008: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:30:47.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:30:47 smithi086 bash[24289]: cluster 2024-09-16T09:30:45.679763+0000 mgr.a (mgr.14373) 10105 : cluster [DBG] pgmap v7008: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:30:47.894 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:30:47.894 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:30:47.895 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:30:48.637 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:30:48.637 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:30:48.637 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:30:48.637 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:30:48.637 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:30:49.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:30:49 smithi047 bash[22744]: cluster 2024-09-16T09:30:47.682005+0000 mgr.a (mgr.14373) 10106 : cluster [DBG] pgmap v7009: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:30:49.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:30:49 smithi047 bash[22744]: audit 2024-09-16T09:30:48.220670+0000 mgr.a (mgr.14373) 10107 : audit [DBG] from='client.223116 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:30:49.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:30:49 smithi157 bash[24585]: cluster 2024-09-16T09:30:47.682005+0000 mgr.a (mgr.14373) 10106 : cluster [DBG] pgmap v7009: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:30:49.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:30:49 smithi157 bash[24585]: audit 2024-09-16T09:30:48.220670+0000 mgr.a (mgr.14373) 10107 : audit [DBG] from='client.223116 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:30:49.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:30:49 smithi086 bash[24289]: cluster 2024-09-16T09:30:47.682005+0000 mgr.a (mgr.14373) 10106 : cluster [DBG] pgmap v7009: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:30:49.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:30:49 smithi086 bash[24289]: audit 2024-09-16T09:30:48.220670+0000 mgr.a (mgr.14373) 10107 : audit [DBG] from='client.223116 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:30:51.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:30:51 smithi047 bash[22744]: cluster 2024-09-16T09:30:49.682992+0000 mgr.a (mgr.14373) 10108 : cluster [DBG] pgmap v7010: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:30:51.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:30:51 smithi157 bash[24585]: cluster 2024-09-16T09:30:49.682992+0000 mgr.a (mgr.14373) 10108 : cluster [DBG] pgmap v7010: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:30:51.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:30:51 smithi086 bash[24289]: cluster 2024-09-16T09:30:49.682992+0000 mgr.a (mgr.14373) 10108 : cluster [DBG] pgmap v7010: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:30:53.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:30:53 smithi047 bash[22744]: cluster 2024-09-16T09:30:51.685156+0000 mgr.a (mgr.14373) 10109 : cluster [DBG] pgmap v7011: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:30:53.639 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:30:53.639 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:30:53.639 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:30:53.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:30:53 smithi157 bash[24585]: cluster 2024-09-16T09:30:51.685156+0000 mgr.a (mgr.14373) 10109 : cluster [DBG] pgmap v7011: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:30:53.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:30:53 smithi086 bash[24289]: cluster 2024-09-16T09:30:51.685156+0000 mgr.a (mgr.14373) 10109 : cluster [DBG] pgmap v7011: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:30:54.415 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:30:54.416 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:30:54.416 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:30:54.416 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:30:54.416 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:30:55.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:30:55 smithi047 bash[22744]: cluster 2024-09-16T09:30:53.685917+0000 mgr.a (mgr.14373) 10110 : cluster [DBG] pgmap v7012: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:30:55.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:30:55 smithi047 bash[22744]: audit 2024-09-16T09:30:53.974527+0000 mgr.a (mgr.14373) 10111 : audit [DBG] from='client.223188 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:30:55.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:30:55 smithi157 bash[24585]: cluster 2024-09-16T09:30:53.685917+0000 mgr.a (mgr.14373) 10110 : cluster [DBG] pgmap v7012: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:30:55.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:30:55 smithi157 bash[24585]: audit 2024-09-16T09:30:53.974527+0000 mgr.a (mgr.14373) 10111 : audit [DBG] from='client.223188 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:30:55.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:30:55 smithi086 bash[24289]: cluster 2024-09-16T09:30:53.685917+0000 mgr.a (mgr.14373) 10110 : cluster [DBG] pgmap v7012: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:30:55.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:30:55 smithi086 bash[24289]: audit 2024-09-16T09:30:53.974527+0000 mgr.a (mgr.14373) 10111 : audit [DBG] from='client.223188 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:30:56.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:30:56 smithi157 bash[24585]: audit 2024-09-16T09:30:55.778172+0000 mon.b (mon.2) 938 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T09:30:56.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:30:56 smithi086 bash[24289]: audit 2024-09-16T09:30:55.778172+0000 mon.b (mon.2) 938 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T09:30:56.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:30:56 smithi047 bash[22744]: audit 2024-09-16T09:30:55.778172+0000 mon.b (mon.2) 938 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T09:30:57.808 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:30:57 smithi157 bash[24585]: cluster 2024-09-16T09:30:55.686915+0000 mgr.a (mgr.14373) 10112 : cluster [DBG] pgmap v7013: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:30:57.809 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:30:57 smithi157 bash[24585]: audit 2024-09-16T09:30:56.624970+0000 mon.b (mon.2) 939 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:30:57.809 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:30:57 smithi157 bash[24585]: audit 2024-09-16T09:30:56.626969+0000 mon.b (mon.2) 940 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T09:30:57.809 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:30:57 smithi157 bash[24585]: audit 2024-09-16T09:30:56.637390+0000 mon.a (mon.0) 1172 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:30:57.809 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:30:57 smithi157 bash[24585]: audit 2024-09-16T09:30:56.644574+0000 mon.b (mon.2) 941 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:30:57.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:30:57 smithi086 bash[24289]: cluster 2024-09-16T09:30:55.686915+0000 mgr.a (mgr.14373) 10112 : cluster [DBG] pgmap v7013: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:30:57.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:30:57 smithi086 bash[24289]: audit 2024-09-16T09:30:56.624970+0000 mon.b (mon.2) 939 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:30:57.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:30:57 smithi086 bash[24289]: audit 2024-09-16T09:30:56.626969+0000 mon.b (mon.2) 940 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T09:30:57.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:30:57 smithi086 bash[24289]: audit 2024-09-16T09:30:56.637390+0000 mon.a (mon.0) 1172 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:30:57.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:30:57 smithi086 bash[24289]: audit 2024-09-16T09:30:56.644574+0000 mon.b (mon.2) 941 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:30:57.843 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 09:30:57 smithi047 bash[22994]: debug 2024-09-16T09:30:57.376+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T09:30:57.843 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 09:30:57 smithi047 bash[22994]: debug 2024-09-16T09:30:57.376+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T09:30:57.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:30:57 smithi047 bash[22744]: cluster 2024-09-16T09:30:55.686915+0000 mgr.a (mgr.14373) 10112 : cluster [DBG] pgmap v7013: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:30:57.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:30:57 smithi047 bash[22744]: audit 2024-09-16T09:30:56.624970+0000 mon.b (mon.2) 939 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:30:57.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:30:57 smithi047 bash[22744]: audit 2024-09-16T09:30:56.626969+0000 mon.b (mon.2) 940 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T09:30:57.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:30:57 smithi047 bash[22744]: audit 2024-09-16T09:30:56.637390+0000 mon.a (mon.0) 1172 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:30:57.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:30:57 smithi047 bash[22744]: audit 2024-09-16T09:30:56.644574+0000 mon.b (mon.2) 941 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:30:58.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:30:58 smithi157 bash[24585]: audit 2024-09-16T09:30:56.645733+0000 mgr.a (mgr.14373) 10113 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:30:58.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:30:58 smithi157 bash[24585]: audit 2024-09-16T09:30:57.378803+0000 mgr.a (mgr.14373) 10114 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T09:30:58.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:30:58 smithi157 bash[24585]: cephadm 2024-09-16T09:30:57.381080+0000 mgr.a (mgr.14373) 10115 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T09:30:58.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:30:58 smithi086 bash[24289]: audit 2024-09-16T09:30:56.645733+0000 mgr.a (mgr.14373) 10113 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:30:58.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:30:58 smithi086 bash[24289]: audit 2024-09-16T09:30:57.378803+0000 mgr.a (mgr.14373) 10114 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T09:30:58.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:30:58 smithi086 bash[24289]: cephadm 2024-09-16T09:30:57.381080+0000 mgr.a (mgr.14373) 10115 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T09:30:58.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:30:58 smithi047 bash[22744]: audit 2024-09-16T09:30:56.645733+0000 mgr.a (mgr.14373) 10113 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:30:58.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:30:58 smithi047 bash[22744]: audit 2024-09-16T09:30:57.378803+0000 mgr.a (mgr.14373) 10114 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T09:30:58.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:30:58 smithi047 bash[22744]: cephadm 2024-09-16T09:30:57.381080+0000 mgr.a (mgr.14373) 10115 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T09:30:59.417 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:30:59.418 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:30:59.418 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:30:59.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:30:59 smithi157 bash[24585]: cluster 2024-09-16T09:30:57.689581+0000 mgr.a (mgr.14373) 10116 : cluster [DBG] pgmap v7014: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:30:59.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:30:59 smithi086 bash[24289]: cluster 2024-09-16T09:30:57.689581+0000 mgr.a (mgr.14373) 10116 : cluster [DBG] pgmap v7014: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:30:59.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:30:59 smithi047 bash[22744]: cluster 2024-09-16T09:30:57.689581+0000 mgr.a (mgr.14373) 10116 : cluster [DBG] pgmap v7014: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:31:00.224 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:31:00.225 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:31:00.225 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:31:00.225 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:31:00.225 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:31:01.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:31:01 smithi157 bash[24585]: cluster 2024-09-16T09:30:59.690111+0000 mgr.a (mgr.14373) 10117 : cluster [DBG] pgmap v7015: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:31:01.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:31:01 smithi157 bash[24585]: audit 2024-09-16T09:30:59.751820+0000 mgr.a (mgr.14373) 10118 : audit [DBG] from='client.223368 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:31:01.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:31:01 smithi086 bash[24289]: cluster 2024-09-16T09:30:59.690111+0000 mgr.a (mgr.14373) 10117 : cluster [DBG] pgmap v7015: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:31:01.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:31:01 smithi086 bash[24289]: audit 2024-09-16T09:30:59.751820+0000 mgr.a (mgr.14373) 10118 : audit [DBG] from='client.223368 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:31:01.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:31:01 smithi047 bash[22744]: cluster 2024-09-16T09:30:59.690111+0000 mgr.a (mgr.14373) 10117 : cluster [DBG] pgmap v7015: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:31:01.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:31:01 smithi047 bash[22744]: audit 2024-09-16T09:30:59.751820+0000 mgr.a (mgr.14373) 10118 : audit [DBG] from='client.223368 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:31:03.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:31:03 smithi157 bash[24585]: cluster 2024-09-16T09:31:01.692561+0000 mgr.a (mgr.14373) 10119 : cluster [DBG] pgmap v7016: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:31:03.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:31:03 smithi086 bash[24289]: cluster 2024-09-16T09:31:01.692561+0000 mgr.a (mgr.14373) 10119 : cluster [DBG] pgmap v7016: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:31:03.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:31:03 smithi047 bash[22744]: cluster 2024-09-16T09:31:01.692561+0000 mgr.a (mgr.14373) 10119 : cluster [DBG] pgmap v7016: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:31:05.226 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:31:05.227 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:31:05.227 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:31:05.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:31:05 smithi157 bash[24585]: cluster 2024-09-16T09:31:03.693527+0000 mgr.a (mgr.14373) 10120 : cluster [DBG] pgmap v7017: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:31:05.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:31:05 smithi086 bash[24289]: cluster 2024-09-16T09:31:03.693527+0000 mgr.a (mgr.14373) 10120 : cluster [DBG] pgmap v7017: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:31:05.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:31:05 smithi047 bash[22744]: cluster 2024-09-16T09:31:03.693527+0000 mgr.a (mgr.14373) 10120 : cluster [DBG] pgmap v7017: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:31:06.004 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:31:06.004 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:31:06.004 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:31:06.005 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:31:06.005 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:31:07.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:31:07 smithi157 bash[24585]: audit 2024-09-16T09:31:05.559186+0000 mgr.a (mgr.14373) 10121 : audit [DBG] from='client.223446 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:31:07.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:31:07 smithi157 bash[24585]: cluster 2024-09-16T09:31:05.694090+0000 mgr.a (mgr.14373) 10122 : cluster [DBG] pgmap v7018: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:31:07.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:31:07 smithi086 bash[24289]: audit 2024-09-16T09:31:05.559186+0000 mgr.a (mgr.14373) 10121 : audit [DBG] from='client.223446 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:31:07.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:31:07 smithi086 bash[24289]: cluster 2024-09-16T09:31:05.694090+0000 mgr.a (mgr.14373) 10122 : cluster [DBG] pgmap v7018: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:31:07.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:31:07 smithi047 bash[22744]: audit 2024-09-16T09:31:05.559186+0000 mgr.a (mgr.14373) 10121 : audit [DBG] from='client.223446 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:31:07.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:31:07 smithi047 bash[22744]: cluster 2024-09-16T09:31:05.694090+0000 mgr.a (mgr.14373) 10122 : cluster [DBG] pgmap v7018: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:31:09.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:31:09 smithi157 bash[24585]: cluster 2024-09-16T09:31:07.696419+0000 mgr.a (mgr.14373) 10123 : cluster [DBG] pgmap v7019: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:31:09.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:31:09 smithi086 bash[24289]: cluster 2024-09-16T09:31:07.696419+0000 mgr.a (mgr.14373) 10123 : cluster [DBG] pgmap v7019: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:31:09.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:31:09 smithi047 bash[22744]: cluster 2024-09-16T09:31:07.696419+0000 mgr.a (mgr.14373) 10123 : cluster [DBG] pgmap v7019: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:31:11.006 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:31:11.006 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:31:11.007 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:31:11.764 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:31:11.764 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:31:11.764 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:31:11.764 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:31:11.764 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:31:11.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:31:11 smithi157 bash[24585]: cluster 2024-09-16T09:31:09.697227+0000 mgr.a (mgr.14373) 10124 : cluster [DBG] pgmap v7020: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:31:11.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:31:11 smithi086 bash[24289]: cluster 2024-09-16T09:31:09.697227+0000 mgr.a (mgr.14373) 10124 : cluster [DBG] pgmap v7020: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:31:11.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:31:11 smithi047 bash[22744]: cluster 2024-09-16T09:31:09.697227+0000 mgr.a (mgr.14373) 10124 : cluster [DBG] pgmap v7020: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:31:12.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:31:12 smithi157 bash[24585]: audit 2024-09-16T09:31:11.332354+0000 mgr.a (mgr.14373) 10125 : audit [DBG] from='client.223524 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:31:12.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:31:12 smithi086 bash[24289]: audit 2024-09-16T09:31:11.332354+0000 mgr.a (mgr.14373) 10125 : audit [DBG] from='client.223524 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:31:12.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:31:12 smithi047 bash[22744]: audit 2024-09-16T09:31:11.332354+0000 mgr.a (mgr.14373) 10125 : audit [DBG] from='client.223524 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:31:13.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:31:13 smithi157 bash[24585]: cluster 2024-09-16T09:31:11.698816+0000 mgr.a (mgr.14373) 10126 : cluster [DBG] pgmap v7021: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:31:13.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:31:13 smithi086 bash[24289]: cluster 2024-09-16T09:31:11.698816+0000 mgr.a (mgr.14373) 10126 : cluster [DBG] pgmap v7021: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:31:13.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:31:13 smithi047 bash[22744]: cluster 2024-09-16T09:31:11.698816+0000 mgr.a (mgr.14373) 10126 : cluster [DBG] pgmap v7021: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:31:15.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:31:15 smithi157 bash[24585]: cluster 2024-09-16T09:31:13.699562+0000 mgr.a (mgr.14373) 10127 : cluster [DBG] pgmap v7022: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:31:15.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:31:15 smithi086 bash[24289]: cluster 2024-09-16T09:31:13.699562+0000 mgr.a (mgr.14373) 10127 : cluster [DBG] pgmap v7022: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:31:15.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:31:15 smithi047 bash[22744]: cluster 2024-09-16T09:31:13.699562+0000 mgr.a (mgr.14373) 10127 : cluster [DBG] pgmap v7022: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:31:16.765 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:31:16.766 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:31:16.766 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:31:17.511 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:31:17.512 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:31:17.512 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:31:17.512 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:31:17.512 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:31:17.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:31:17 smithi157 bash[24585]: cluster 2024-09-16T09:31:15.700458+0000 mgr.a (mgr.14373) 10128 : cluster [DBG] pgmap v7023: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T09:31:17.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:31:17 smithi086 bash[24289]: cluster 2024-09-16T09:31:15.700458+0000 mgr.a (mgr.14373) 10128 : cluster [DBG] pgmap v7023: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T09:31:17.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:31:17 smithi047 bash[22744]: cluster 2024-09-16T09:31:15.700458+0000 mgr.a (mgr.14373) 10128 : cluster [DBG] pgmap v7023: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T09:31:18.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:31:18 smithi157 bash[24585]: audit 2024-09-16T09:31:17.092250+0000 mgr.a (mgr.14373) 10129 : audit [DBG] from='client.223602 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:31:18.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:31:18 smithi086 bash[24289]: audit 2024-09-16T09:31:17.092250+0000 mgr.a (mgr.14373) 10129 : audit [DBG] from='client.223602 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:31:18.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:31:18 smithi047 bash[22744]: audit 2024-09-16T09:31:17.092250+0000 mgr.a (mgr.14373) 10129 : audit [DBG] from='client.223602 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:31:19.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:31:19 smithi157 bash[24585]: cluster 2024-09-16T09:31:17.703397+0000 mgr.a (mgr.14373) 10130 : cluster [DBG] pgmap v7024: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:31:19.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:31:19 smithi086 bash[24289]: cluster 2024-09-16T09:31:17.703397+0000 mgr.a (mgr.14373) 10130 : cluster [DBG] pgmap v7024: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:31:19.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:31:19 smithi047 bash[22744]: cluster 2024-09-16T09:31:17.703397+0000 mgr.a (mgr.14373) 10130 : cluster [DBG] pgmap v7024: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:31:21.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:31:21 smithi157 bash[24585]: cluster 2024-09-16T09:31:19.704382+0000 mgr.a (mgr.14373) 10131 : cluster [DBG] pgmap v7025: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:31:21.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:31:21 smithi086 bash[24289]: cluster 2024-09-16T09:31:19.704382+0000 mgr.a (mgr.14373) 10131 : cluster [DBG] pgmap v7025: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:31:21.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:31:21 smithi047 bash[22744]: cluster 2024-09-16T09:31:19.704382+0000 mgr.a (mgr.14373) 10131 : cluster [DBG] pgmap v7025: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:31:22.513 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:31:22.513 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:31:22.514 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:31:23.289 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:31:23.289 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:31:23.290 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:31:23.290 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:31:23.290 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:31:23.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:31:23 smithi157 bash[24585]: cluster 2024-09-16T09:31:21.706546+0000 mgr.a (mgr.14373) 10132 : cluster [DBG] pgmap v7026: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:31:23.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:31:23 smithi086 bash[24289]: cluster 2024-09-16T09:31:21.706546+0000 mgr.a (mgr.14373) 10132 : cluster [DBG] pgmap v7026: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:31:23.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:31:23 smithi047 bash[22744]: cluster 2024-09-16T09:31:21.706546+0000 mgr.a (mgr.14373) 10132 : cluster [DBG] pgmap v7026: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:31:24.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:31:24 smithi157 bash[24585]: audit 2024-09-16T09:31:22.845441+0000 mgr.a (mgr.14373) 10133 : audit [DBG] from='client.223677 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:31:24.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:31:24 smithi086 bash[24289]: audit 2024-09-16T09:31:22.845441+0000 mgr.a (mgr.14373) 10133 : audit [DBG] from='client.223677 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:31:24.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:31:24 smithi047 bash[22744]: audit 2024-09-16T09:31:22.845441+0000 mgr.a (mgr.14373) 10133 : audit [DBG] from='client.223677 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:31:25.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:31:25 smithi157 bash[24585]: cluster 2024-09-16T09:31:23.707715+0000 mgr.a (mgr.14373) 10134 : cluster [DBG] pgmap v7027: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:31:25.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:31:25 smithi086 bash[24289]: cluster 2024-09-16T09:31:23.707715+0000 mgr.a (mgr.14373) 10134 : cluster [DBG] pgmap v7027: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:31:25.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:31:25 smithi047 bash[22744]: cluster 2024-09-16T09:31:23.707715+0000 mgr.a (mgr.14373) 10134 : cluster [DBG] pgmap v7027: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:31:27.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:31:27 smithi157 bash[24585]: cluster 2024-09-16T09:31:25.708654+0000 mgr.a (mgr.14373) 10135 : cluster [DBG] pgmap v7028: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:31:27.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:31:27 smithi086 bash[24289]: cluster 2024-09-16T09:31:25.708654+0000 mgr.a (mgr.14373) 10135 : cluster [DBG] pgmap v7028: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:31:27.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:31:27 smithi047 bash[22744]: cluster 2024-09-16T09:31:25.708654+0000 mgr.a (mgr.14373) 10135 : cluster [DBG] pgmap v7028: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:31:28.291 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:31:28.292 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:31:28.292 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:31:29.076 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:31:29.076 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:31:29.076 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:31:29.076 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:31:29.076 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:31:29.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:31:29 smithi157 bash[24585]: cluster 2024-09-16T09:31:27.711035+0000 mgr.a (mgr.14373) 10136 : cluster [DBG] pgmap v7029: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:31:29.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:31:29 smithi086 bash[24289]: cluster 2024-09-16T09:31:27.711035+0000 mgr.a (mgr.14373) 10136 : cluster [DBG] pgmap v7029: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:31:29.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:31:29 smithi047 bash[22744]: cluster 2024-09-16T09:31:27.711035+0000 mgr.a (mgr.14373) 10136 : cluster [DBG] pgmap v7029: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:31:30.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:31:30 smithi157 bash[24585]: audit 2024-09-16T09:31:28.629649+0000 mgr.a (mgr.14373) 10137 : audit [DBG] from='client.223755 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:31:30.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:31:30 smithi086 bash[24289]: audit 2024-09-16T09:31:28.629649+0000 mgr.a (mgr.14373) 10137 : audit [DBG] from='client.223755 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:31:30.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:31:30 smithi047 bash[22744]: audit 2024-09-16T09:31:28.629649+0000 mgr.a (mgr.14373) 10137 : audit [DBG] from='client.223755 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:31:31.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:31:31 smithi157 bash[24585]: cluster 2024-09-16T09:31:29.711984+0000 mgr.a (mgr.14373) 10138 : cluster [DBG] pgmap v7030: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:31:31.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:31:31 smithi086 bash[24289]: cluster 2024-09-16T09:31:29.711984+0000 mgr.a (mgr.14373) 10138 : cluster [DBG] pgmap v7030: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:31:31.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:31:31 smithi047 bash[22744]: cluster 2024-09-16T09:31:29.711984+0000 mgr.a (mgr.14373) 10138 : cluster [DBG] pgmap v7030: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:31:33.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:31:33 smithi157 bash[24585]: cluster 2024-09-16T09:31:31.714183+0000 mgr.a (mgr.14373) 10139 : cluster [DBG] pgmap v7031: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:31:33.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:31:33 smithi086 bash[24289]: cluster 2024-09-16T09:31:31.714183+0000 mgr.a (mgr.14373) 10139 : cluster [DBG] pgmap v7031: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:31:33.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:31:33 smithi047 bash[22744]: cluster 2024-09-16T09:31:31.714183+0000 mgr.a (mgr.14373) 10139 : cluster [DBG] pgmap v7031: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:31:34.077 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:31:34.078 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:31:34.078 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:31:34.832 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:31:34.833 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:31:34.833 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:31:34.833 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:31:34.833 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:31:35.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:31:35 smithi157 bash[24585]: cluster 2024-09-16T09:31:33.714957+0000 mgr.a (mgr.14373) 10140 : cluster [DBG] pgmap v7032: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:31:35.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:31:35 smithi157 bash[24585]: audit 2024-09-16T09:31:34.405588+0000 mgr.a (mgr.14373) 10141 : audit [DBG] from='client.223833 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:31:35.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:31:35 smithi086 bash[24289]: cluster 2024-09-16T09:31:33.714957+0000 mgr.a (mgr.14373) 10140 : cluster [DBG] pgmap v7032: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:31:35.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:31:35 smithi086 bash[24289]: audit 2024-09-16T09:31:34.405588+0000 mgr.a (mgr.14373) 10141 : audit [DBG] from='client.223833 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:31:35.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:31:35 smithi047 bash[22744]: cluster 2024-09-16T09:31:33.714957+0000 mgr.a (mgr.14373) 10140 : cluster [DBG] pgmap v7032: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:31:35.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:31:35 smithi047 bash[22744]: audit 2024-09-16T09:31:34.405588+0000 mgr.a (mgr.14373) 10141 : audit [DBG] from='client.223833 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:31:37.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:31:37 smithi157 bash[24585]: cluster 2024-09-16T09:31:35.715941+0000 mgr.a (mgr.14373) 10142 : cluster [DBG] pgmap v7033: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:31:37.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:31:37 smithi086 bash[24289]: cluster 2024-09-16T09:31:35.715941+0000 mgr.a (mgr.14373) 10142 : cluster [DBG] pgmap v7033: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:31:37.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:31:37 smithi047 bash[22744]: cluster 2024-09-16T09:31:35.715941+0000 mgr.a (mgr.14373) 10142 : cluster [DBG] pgmap v7033: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:31:39.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:31:39 smithi157 bash[24585]: cluster 2024-09-16T09:31:37.718171+0000 mgr.a (mgr.14373) 10143 : cluster [DBG] pgmap v7034: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:31:39.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:31:39 smithi086 bash[24289]: cluster 2024-09-16T09:31:37.718171+0000 mgr.a (mgr.14373) 10143 : cluster [DBG] pgmap v7034: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:31:39.834 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:31:39.836 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:31:39.836 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:31:39.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:31:39 smithi047 bash[22744]: cluster 2024-09-16T09:31:37.718171+0000 mgr.a (mgr.14373) 10143 : cluster [DBG] pgmap v7034: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:31:40.579 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:31:40.579 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:31:40.579 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:31:40.579 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:31:40.579 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:31:41.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:31:41 smithi157 bash[24585]: cluster 2024-09-16T09:31:39.718941+0000 mgr.a (mgr.14373) 10144 : cluster [DBG] pgmap v7035: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:31:41.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:31:41 smithi157 bash[24585]: audit 2024-09-16T09:31:40.166117+0000 mgr.a (mgr.14373) 10145 : audit [DBG] from='client.223905 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:31:41.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:31:41 smithi086 bash[24289]: cluster 2024-09-16T09:31:39.718941+0000 mgr.a (mgr.14373) 10144 : cluster [DBG] pgmap v7035: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:31:41.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:31:41 smithi086 bash[24289]: audit 2024-09-16T09:31:40.166117+0000 mgr.a (mgr.14373) 10145 : audit [DBG] from='client.223905 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:31:41.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:31:41 smithi047 bash[22744]: cluster 2024-09-16T09:31:39.718941+0000 mgr.a (mgr.14373) 10144 : cluster [DBG] pgmap v7035: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:31:41.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:31:41 smithi047 bash[22744]: audit 2024-09-16T09:31:40.166117+0000 mgr.a (mgr.14373) 10145 : audit [DBG] from='client.223905 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:31:43.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:31:43 smithi157 bash[24585]: cluster 2024-09-16T09:31:41.721332+0000 mgr.a (mgr.14373) 10146 : cluster [DBG] pgmap v7036: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:31:43.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:31:43 smithi086 bash[24289]: cluster 2024-09-16T09:31:41.721332+0000 mgr.a (mgr.14373) 10146 : cluster [DBG] pgmap v7036: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:31:43.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:31:43 smithi047 bash[22744]: cluster 2024-09-16T09:31:41.721332+0000 mgr.a (mgr.14373) 10146 : cluster [DBG] pgmap v7036: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:31:45.581 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:31:45.581 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:31:45.581 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:31:45.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:31:45 smithi157 bash[24585]: cluster 2024-09-16T09:31:43.722288+0000 mgr.a (mgr.14373) 10147 : cluster [DBG] pgmap v7037: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:31:45.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:31:45 smithi086 bash[24289]: cluster 2024-09-16T09:31:43.722288+0000 mgr.a (mgr.14373) 10147 : cluster [DBG] pgmap v7037: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:31:45.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:31:45 smithi047 bash[22744]: cluster 2024-09-16T09:31:43.722288+0000 mgr.a (mgr.14373) 10147 : cluster [DBG] pgmap v7037: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:31:46.345 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:31:46.345 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:31:46.345 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:31:46.345 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:31:46.345 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:31:47.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:31:47 smithi157 bash[24585]: cluster 2024-09-16T09:31:45.722892+0000 mgr.a (mgr.14373) 10148 : cluster [DBG] pgmap v7038: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:31:47.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:31:47 smithi157 bash[24585]: audit 2024-09-16T09:31:45.914762+0000 mgr.a (mgr.14373) 10149 : audit [DBG] from='client.223980 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:31:47.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:31:47 smithi086 bash[24289]: cluster 2024-09-16T09:31:45.722892+0000 mgr.a (mgr.14373) 10148 : cluster [DBG] pgmap v7038: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:31:47.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:31:47 smithi086 bash[24289]: audit 2024-09-16T09:31:45.914762+0000 mgr.a (mgr.14373) 10149 : audit [DBG] from='client.223980 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:31:47.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:31:47 smithi047 bash[22744]: cluster 2024-09-16T09:31:45.722892+0000 mgr.a (mgr.14373) 10148 : cluster [DBG] pgmap v7038: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:31:47.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:31:47 smithi047 bash[22744]: audit 2024-09-16T09:31:45.914762+0000 mgr.a (mgr.14373) 10149 : audit [DBG] from='client.223980 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:31:49.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:31:49 smithi157 bash[24585]: cluster 2024-09-16T09:31:47.725187+0000 mgr.a (mgr.14373) 10150 : cluster [DBG] pgmap v7039: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:31:49.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:31:49 smithi086 bash[24289]: cluster 2024-09-16T09:31:47.725187+0000 mgr.a (mgr.14373) 10150 : cluster [DBG] pgmap v7039: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:31:49.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:31:49 smithi047 bash[22744]: cluster 2024-09-16T09:31:47.725187+0000 mgr.a (mgr.14373) 10150 : cluster [DBG] pgmap v7039: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:31:51.346 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:31:51.347 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:31:51.348 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:31:51.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:31:51 smithi157 bash[24585]: cluster 2024-09-16T09:31:49.725974+0000 mgr.a (mgr.14373) 10151 : cluster [DBG] pgmap v7040: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:31:51.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:31:51 smithi086 bash[24289]: cluster 2024-09-16T09:31:49.725974+0000 mgr.a (mgr.14373) 10151 : cluster [DBG] pgmap v7040: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:31:51.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:31:51 smithi047 bash[22744]: cluster 2024-09-16T09:31:49.725974+0000 mgr.a (mgr.14373) 10151 : cluster [DBG] pgmap v7040: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:31:52.100 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:31:52.101 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:31:52.101 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:31:52.101 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:31:52.101 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:31:53.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:31:53 smithi157 bash[24585]: audit 2024-09-16T09:31:51.676610+0000 mgr.a (mgr.14373) 10152 : audit [DBG] from='client.224058 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:31:53.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:31:53 smithi157 bash[24585]: cluster 2024-09-16T09:31:51.728940+0000 mgr.a (mgr.14373) 10153 : cluster [DBG] pgmap v7041: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:31:53.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:31:53 smithi086 bash[24289]: audit 2024-09-16T09:31:51.676610+0000 mgr.a (mgr.14373) 10152 : audit [DBG] from='client.224058 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:31:53.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:31:53 smithi086 bash[24289]: cluster 2024-09-16T09:31:51.728940+0000 mgr.a (mgr.14373) 10153 : cluster [DBG] pgmap v7041: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:31:53.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:31:53 smithi047 bash[22744]: audit 2024-09-16T09:31:51.676610+0000 mgr.a (mgr.14373) 10152 : audit [DBG] from='client.224058 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:31:53.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:31:53 smithi047 bash[22744]: cluster 2024-09-16T09:31:51.728940+0000 mgr.a (mgr.14373) 10153 : cluster [DBG] pgmap v7041: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:31:55.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:31:55 smithi157 bash[24585]: cluster 2024-09-16T09:31:53.729850+0000 mgr.a (mgr.14373) 10154 : cluster [DBG] pgmap v7042: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:31:55.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:31:55 smithi086 bash[24289]: cluster 2024-09-16T09:31:53.729850+0000 mgr.a (mgr.14373) 10154 : cluster [DBG] pgmap v7042: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:31:55.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:31:55 smithi047 bash[22744]: cluster 2024-09-16T09:31:53.729850+0000 mgr.a (mgr.14373) 10154 : cluster [DBG] pgmap v7042: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:31:57.102 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:31:57.103 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:31:57.103 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:31:57.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:31:57 smithi157 bash[24585]: cluster 2024-09-16T09:31:55.730590+0000 mgr.a (mgr.14373) 10155 : cluster [DBG] pgmap v7043: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T09:31:57.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:31:57 smithi157 bash[24585]: audit 2024-09-16T09:31:57.441527+0000 mon.b (mon.2) 942 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T09:31:57.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:31:57 smithi086 bash[24289]: cluster 2024-09-16T09:31:55.730590+0000 mgr.a (mgr.14373) 10155 : cluster [DBG] pgmap v7043: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T09:31:57.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:31:57 smithi086 bash[24289]: audit 2024-09-16T09:31:57.441527+0000 mon.b (mon.2) 942 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T09:31:57.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:31:57 smithi047 bash[22744]: cluster 2024-09-16T09:31:55.730590+0000 mgr.a (mgr.14373) 10155 : cluster [DBG] pgmap v7043: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T09:31:57.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:31:57 smithi047 bash[22744]: audit 2024-09-16T09:31:57.441527+0000 mon.b (mon.2) 942 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T09:31:57.848 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:31:57.849 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:31:57.849 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:31:57.849 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:31:57.849 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:31:58.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:31:58 smithi157 bash[24585]: audit 2024-09-16T09:31:57.428377+0000 mgr.a (mgr.14373) 10156 : audit [DBG] from='client.224133 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:31:58.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:31:58 smithi157 bash[24585]: audit 2024-09-16T09:31:58.271778+0000 mon.b (mon.2) 943 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:31:58.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:31:58 smithi157 bash[24585]: audit 2024-09-16T09:31:58.274115+0000 mon.b (mon.2) 944 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T09:31:58.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:31:58 smithi157 bash[24585]: audit 2024-09-16T09:31:58.282626+0000 mon.a (mon.0) 1173 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:31:58.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:31:58 smithi157 bash[24585]: audit 2024-09-16T09:31:58.289340+0000 mon.b (mon.2) 945 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:31:58.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:31:58 smithi086 bash[24289]: audit 2024-09-16T09:31:57.428377+0000 mgr.a (mgr.14373) 10156 : audit [DBG] from='client.224133 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:31:58.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:31:58 smithi086 bash[24289]: audit 2024-09-16T09:31:58.271778+0000 mon.b (mon.2) 943 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:31:58.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:31:58 smithi086 bash[24289]: audit 2024-09-16T09:31:58.274115+0000 mon.b (mon.2) 944 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T09:31:58.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:31:58 smithi086 bash[24289]: audit 2024-09-16T09:31:58.282626+0000 mon.a (mon.0) 1173 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:31:58.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:31:58 smithi086 bash[24289]: audit 2024-09-16T09:31:58.289340+0000 mon.b (mon.2) 945 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:31:58.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:31:58 smithi047 bash[22744]: audit 2024-09-16T09:31:57.428377+0000 mgr.a (mgr.14373) 10156 : audit [DBG] from='client.224133 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:31:58.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:31:58 smithi047 bash[22744]: audit 2024-09-16T09:31:58.271778+0000 mon.b (mon.2) 943 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:31:58.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:31:58 smithi047 bash[22744]: audit 2024-09-16T09:31:58.274115+0000 mon.b (mon.2) 944 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T09:31:58.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:31:58 smithi047 bash[22744]: audit 2024-09-16T09:31:58.282626+0000 mon.a (mon.0) 1173 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:31:58.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:31:58 smithi047 bash[22744]: audit 2024-09-16T09:31:58.289340+0000 mon.b (mon.2) 945 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:31:59.342 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 09:31:59 smithi047 bash[22994]: debug 2024-09-16T09:31:59.014+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T09:31:59.343 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 09:31:59 smithi047 bash[22994]: debug 2024-09-16T09:31:59.018+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T09:31:59.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:31:59 smithi157 bash[24585]: cluster 2024-09-16T09:31:57.731782+0000 mgr.a (mgr.14373) 10157 : cluster [DBG] pgmap v7044: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:31:59.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:31:59 smithi157 bash[24585]: audit 2024-09-16T09:31:58.291133+0000 mgr.a (mgr.14373) 10158 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:31:59.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:31:59 smithi086 bash[24289]: cluster 2024-09-16T09:31:57.731782+0000 mgr.a (mgr.14373) 10157 : cluster [DBG] pgmap v7044: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:31:59.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:31:59 smithi086 bash[24289]: audit 2024-09-16T09:31:58.291133+0000 mgr.a (mgr.14373) 10158 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:31:59.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:31:59 smithi047 bash[22744]: cluster 2024-09-16T09:31:57.731782+0000 mgr.a (mgr.14373) 10157 : cluster [DBG] pgmap v7044: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:31:59.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:31:59 smithi047 bash[22744]: audit 2024-09-16T09:31:58.291133+0000 mgr.a (mgr.14373) 10158 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:32:00.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:32:00 smithi157 bash[24585]: audit 2024-09-16T09:31:59.020418+0000 mgr.a (mgr.14373) 10159 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T09:32:00.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:32:00 smithi157 bash[24585]: cephadm 2024-09-16T09:31:59.022614+0000 mgr.a (mgr.14373) 10160 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T09:32:00.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:32:00 smithi086 bash[24289]: audit 2024-09-16T09:31:59.020418+0000 mgr.a (mgr.14373) 10159 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T09:32:00.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:32:00 smithi086 bash[24289]: cephadm 2024-09-16T09:31:59.022614+0000 mgr.a (mgr.14373) 10160 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T09:32:00.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:32:00 smithi047 bash[22744]: audit 2024-09-16T09:31:59.020418+0000 mgr.a (mgr.14373) 10159 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T09:32:00.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:32:00 smithi047 bash[22744]: cephadm 2024-09-16T09:31:59.022614+0000 mgr.a (mgr.14373) 10160 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T09:32:01.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:32:01 smithi157 bash[24585]: cluster 2024-09-16T09:31:59.732841+0000 mgr.a (mgr.14373) 10161 : cluster [DBG] pgmap v7045: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:32:01.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:32:01 smithi086 bash[24289]: cluster 2024-09-16T09:31:59.732841+0000 mgr.a (mgr.14373) 10161 : cluster [DBG] pgmap v7045: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:32:01.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:32:01 smithi047 bash[22744]: cluster 2024-09-16T09:31:59.732841+0000 mgr.a (mgr.14373) 10161 : cluster [DBG] pgmap v7045: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:32:02.850 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:32:02.851 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:32:02.851 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:32:03.595 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:32:03.595 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:32:03.595 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:32:03.595 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:32:03.596 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:32:03.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:32:03 smithi157 bash[24585]: cluster 2024-09-16T09:32:01.735125+0000 mgr.a (mgr.14373) 10162 : cluster [DBG] pgmap v7046: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:32:03.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:32:03 smithi086 bash[24289]: cluster 2024-09-16T09:32:01.735125+0000 mgr.a (mgr.14373) 10162 : cluster [DBG] pgmap v7046: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:32:03.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:32:03 smithi047 bash[22744]: cluster 2024-09-16T09:32:01.735125+0000 mgr.a (mgr.14373) 10162 : cluster [DBG] pgmap v7046: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:32:04.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:32:04 smithi157 bash[24585]: audit 2024-09-16T09:32:03.179573+0000 mgr.a (mgr.14373) 10163 : audit [DBG] from='client.224319 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:32:04.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:32:04 smithi086 bash[24289]: audit 2024-09-16T09:32:03.179573+0000 mgr.a (mgr.14373) 10163 : audit [DBG] from='client.224319 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:32:04.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:32:04 smithi047 bash[22744]: audit 2024-09-16T09:32:03.179573+0000 mgr.a (mgr.14373) 10163 : audit [DBG] from='client.224319 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:32:05.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:32:05 smithi157 bash[24585]: cluster 2024-09-16T09:32:03.736068+0000 mgr.a (mgr.14373) 10164 : cluster [DBG] pgmap v7047: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:32:05.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:32:05 smithi086 bash[24289]: cluster 2024-09-16T09:32:03.736068+0000 mgr.a (mgr.14373) 10164 : cluster [DBG] pgmap v7047: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:32:05.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:32:05 smithi047 bash[22744]: cluster 2024-09-16T09:32:03.736068+0000 mgr.a (mgr.14373) 10164 : cluster [DBG] pgmap v7047: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:32:06.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:32:06 smithi157 bash[24585]: cluster 2024-09-16T09:32:05.736865+0000 mgr.a (mgr.14373) 10165 : cluster [DBG] pgmap v7048: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:32:06.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:32:06 smithi086 bash[24289]: cluster 2024-09-16T09:32:05.736865+0000 mgr.a (mgr.14373) 10165 : cluster [DBG] pgmap v7048: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:32:06.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:32:06 smithi047 bash[22744]: cluster 2024-09-16T09:32:05.736865+0000 mgr.a (mgr.14373) 10165 : cluster [DBG] pgmap v7048: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:32:08.597 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:32:08.597 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:32:08.598 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:32:09.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:32:08 smithi157 bash[24585]: cluster 2024-09-16T09:32:07.739113+0000 mgr.a (mgr.14373) 10166 : cluster [DBG] pgmap v7049: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:32:09.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:32:08 smithi086 bash[24289]: cluster 2024-09-16T09:32:07.739113+0000 mgr.a (mgr.14373) 10166 : cluster [DBG] pgmap v7049: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:32:09.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:32:08 smithi047 bash[22744]: cluster 2024-09-16T09:32:07.739113+0000 mgr.a (mgr.14373) 10166 : cluster [DBG] pgmap v7049: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:32:09.388 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:32:09.388 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:32:09.388 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:32:09.389 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:32:09.389 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:32:10.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:32:09 smithi086 bash[24289]: audit 2024-09-16T09:32:08.936144+0000 mgr.a (mgr.14373) 10167 : audit [DBG] from='client.224394 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:32:10.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:32:09 smithi047 bash[22744]: audit 2024-09-16T09:32:08.936144+0000 mgr.a (mgr.14373) 10167 : audit [DBG] from='client.224394 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:32:10.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:32:09 smithi157 bash[24585]: audit 2024-09-16T09:32:08.936144+0000 mgr.a (mgr.14373) 10167 : audit [DBG] from='client.224394 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:32:11.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:32:10 smithi086 bash[24289]: cluster 2024-09-16T09:32:09.740226+0000 mgr.a (mgr.14373) 10168 : cluster [DBG] pgmap v7050: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:32:11.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:32:10 smithi047 bash[22744]: cluster 2024-09-16T09:32:09.740226+0000 mgr.a (mgr.14373) 10168 : cluster [DBG] pgmap v7050: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:32:11.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:32:10 smithi157 bash[24585]: cluster 2024-09-16T09:32:09.740226+0000 mgr.a (mgr.14373) 10168 : cluster [DBG] pgmap v7050: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:32:13.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:32:12 smithi086 bash[24289]: cluster 2024-09-16T09:32:11.742581+0000 mgr.a (mgr.14373) 10169 : cluster [DBG] pgmap v7051: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:32:13.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:32:12 smithi047 bash[22744]: cluster 2024-09-16T09:32:11.742581+0000 mgr.a (mgr.14373) 10169 : cluster [DBG] pgmap v7051: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:32:13.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:32:12 smithi157 bash[24585]: cluster 2024-09-16T09:32:11.742581+0000 mgr.a (mgr.14373) 10169 : cluster [DBG] pgmap v7051: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:32:14.390 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:32:14.390 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:32:14.390 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:32:15.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:32:14 smithi086 bash[24289]: cluster 2024-09-16T09:32:13.743376+0000 mgr.a (mgr.14373) 10170 : cluster [DBG] pgmap v7052: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:32:15.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:32:14 smithi047 bash[22744]: cluster 2024-09-16T09:32:13.743376+0000 mgr.a (mgr.14373) 10170 : cluster [DBG] pgmap v7052: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:32:15.156 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:32:15.157 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:32:15.157 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:32:15.157 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:32:15.157 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:32:15.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:32:14 smithi157 bash[24585]: cluster 2024-09-16T09:32:13.743376+0000 mgr.a (mgr.14373) 10170 : cluster [DBG] pgmap v7052: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:32:16.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:32:15 smithi047 bash[22744]: audit 2024-09-16T09:32:14.725768+0000 mgr.a (mgr.14373) 10171 : audit [DBG] from='client.224469 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:32:16.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:32:15 smithi157 bash[24585]: audit 2024-09-16T09:32:14.725768+0000 mgr.a (mgr.14373) 10171 : audit [DBG] from='client.224469 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:32:16.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:32:15 smithi086 bash[24289]: audit 2024-09-16T09:32:14.725768+0000 mgr.a (mgr.14373) 10171 : audit [DBG] from='client.224469 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:32:17.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:32:16 smithi047 bash[22744]: cluster 2024-09-16T09:32:15.744327+0000 mgr.a (mgr.14373) 10172 : cluster [DBG] pgmap v7053: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:32:17.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:32:16 smithi157 bash[24585]: cluster 2024-09-16T09:32:15.744327+0000 mgr.a (mgr.14373) 10172 : cluster [DBG] pgmap v7053: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:32:17.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:32:16 smithi086 bash[24289]: cluster 2024-09-16T09:32:15.744327+0000 mgr.a (mgr.14373) 10172 : cluster [DBG] pgmap v7053: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:32:19.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:32:18 smithi047 bash[22744]: cluster 2024-09-16T09:32:17.746581+0000 mgr.a (mgr.14373) 10173 : cluster [DBG] pgmap v7054: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:32:19.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:32:18 smithi157 bash[24585]: cluster 2024-09-16T09:32:17.746581+0000 mgr.a (mgr.14373) 10173 : cluster [DBG] pgmap v7054: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:32:19.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:32:18 smithi086 bash[24289]: cluster 2024-09-16T09:32:17.746581+0000 mgr.a (mgr.14373) 10173 : cluster [DBG] pgmap v7054: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:32:20.158 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:32:20.159 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:32:20.159 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:32:20.949 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:32:20.949 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:32:20.949 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:32:20.949 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:32:20.949 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:32:21.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:32:20 smithi047 bash[22744]: cluster 2024-09-16T09:32:19.747347+0000 mgr.a (mgr.14373) 10174 : cluster [DBG] pgmap v7055: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:32:21.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:32:20 smithi047 bash[22744]: audit 2024-09-16T09:32:20.490840+0000 mgr.a (mgr.14373) 10175 : audit [DBG] from='client.224544 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:32:21.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:32:20 smithi157 bash[24585]: cluster 2024-09-16T09:32:19.747347+0000 mgr.a (mgr.14373) 10174 : cluster [DBG] pgmap v7055: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:32:21.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:32:20 smithi157 bash[24585]: audit 2024-09-16T09:32:20.490840+0000 mgr.a (mgr.14373) 10175 : audit [DBG] from='client.224544 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:32:21.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:32:20 smithi086 bash[24289]: cluster 2024-09-16T09:32:19.747347+0000 mgr.a (mgr.14373) 10174 : cluster [DBG] pgmap v7055: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:32:21.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:32:20 smithi086 bash[24289]: audit 2024-09-16T09:32:20.490840+0000 mgr.a (mgr.14373) 10175 : audit [DBG] from='client.224544 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:32:23.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:32:22 smithi047 bash[22744]: cluster 2024-09-16T09:32:21.749659+0000 mgr.a (mgr.14373) 10176 : cluster [DBG] pgmap v7056: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:32:23.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:32:22 smithi157 bash[24585]: cluster 2024-09-16T09:32:21.749659+0000 mgr.a (mgr.14373) 10176 : cluster [DBG] pgmap v7056: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:32:23.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:32:22 smithi086 bash[24289]: cluster 2024-09-16T09:32:21.749659+0000 mgr.a (mgr.14373) 10176 : cluster [DBG] pgmap v7056: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:32:25.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:32:24 smithi047 bash[22744]: cluster 2024-09-16T09:32:23.750444+0000 mgr.a (mgr.14373) 10177 : cluster [DBG] pgmap v7057: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:32:25.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:32:24 smithi157 bash[24585]: cluster 2024-09-16T09:32:23.750444+0000 mgr.a (mgr.14373) 10177 : cluster [DBG] pgmap v7057: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:32:25.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:32:24 smithi086 bash[24289]: cluster 2024-09-16T09:32:23.750444+0000 mgr.a (mgr.14373) 10177 : cluster [DBG] pgmap v7057: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:32:25.951 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:32:25.952 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:32:25.952 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:32:26.737 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:32:26.737 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:32:26.737 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:32:26.737 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:32:26.737 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:32:27.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:32:26 smithi157 bash[24585]: cluster 2024-09-16T09:32:25.751173+0000 mgr.a (mgr.14373) 10178 : cluster [DBG] pgmap v7058: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:32:27.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:32:26 smithi157 bash[24585]: audit 2024-09-16T09:32:26.287038+0000 mgr.a (mgr.14373) 10179 : audit [DBG] from='client.224619 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:32:27.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:32:26 smithi086 bash[24289]: cluster 2024-09-16T09:32:25.751173+0000 mgr.a (mgr.14373) 10178 : cluster [DBG] pgmap v7058: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:32:27.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:32:26 smithi086 bash[24289]: audit 2024-09-16T09:32:26.287038+0000 mgr.a (mgr.14373) 10179 : audit [DBG] from='client.224619 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:32:27.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:32:26 smithi047 bash[22744]: cluster 2024-09-16T09:32:25.751173+0000 mgr.a (mgr.14373) 10178 : cluster [DBG] pgmap v7058: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:32:27.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:32:26 smithi047 bash[22744]: audit 2024-09-16T09:32:26.287038+0000 mgr.a (mgr.14373) 10179 : audit [DBG] from='client.224619 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:32:29.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:32:28 smithi157 bash[24585]: cluster 2024-09-16T09:32:27.753822+0000 mgr.a (mgr.14373) 10180 : cluster [DBG] pgmap v7059: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:32:29.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:32:28 smithi086 bash[24289]: cluster 2024-09-16T09:32:27.753822+0000 mgr.a (mgr.14373) 10180 : cluster [DBG] pgmap v7059: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:32:29.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:32:28 smithi047 bash[22744]: cluster 2024-09-16T09:32:27.753822+0000 mgr.a (mgr.14373) 10180 : cluster [DBG] pgmap v7059: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:32:31.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:32:30 smithi157 bash[24585]: cluster 2024-09-16T09:32:29.754587+0000 mgr.a (mgr.14373) 10181 : cluster [DBG] pgmap v7060: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:32:31.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:32:30 smithi086 bash[24289]: cluster 2024-09-16T09:32:29.754587+0000 mgr.a (mgr.14373) 10181 : cluster [DBG] pgmap v7060: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:32:31.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:32:30 smithi047 bash[22744]: cluster 2024-09-16T09:32:29.754587+0000 mgr.a (mgr.14373) 10181 : cluster [DBG] pgmap v7060: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:32:31.738 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:32:31.739 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:32:31.739 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:32:32.528 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:32:32.528 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:32:32.528 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:32:32.528 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:32:32.529 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:32:33.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:32:32 smithi157 bash[24585]: cluster 2024-09-16T09:32:31.756310+0000 mgr.a (mgr.14373) 10182 : cluster [DBG] pgmap v7061: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:32:33.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:32:32 smithi157 bash[24585]: audit 2024-09-16T09:32:32.073720+0000 mgr.a (mgr.14373) 10183 : audit [DBG] from='client.224697 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:32:33.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:32:32 smithi086 bash[24289]: cluster 2024-09-16T09:32:31.756310+0000 mgr.a (mgr.14373) 10182 : cluster [DBG] pgmap v7061: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:32:33.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:32:32 smithi086 bash[24289]: audit 2024-09-16T09:32:32.073720+0000 mgr.a (mgr.14373) 10183 : audit [DBG] from='client.224697 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:32:33.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:32:32 smithi047 bash[22744]: cluster 2024-09-16T09:32:31.756310+0000 mgr.a (mgr.14373) 10182 : cluster [DBG] pgmap v7061: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:32:33.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:32:32 smithi047 bash[22744]: audit 2024-09-16T09:32:32.073720+0000 mgr.a (mgr.14373) 10183 : audit [DBG] from='client.224697 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:32:35.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:32:34 smithi157 bash[24585]: cluster 2024-09-16T09:32:33.757183+0000 mgr.a (mgr.14373) 10184 : cluster [DBG] pgmap v7062: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:32:35.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:32:34 smithi086 bash[24289]: cluster 2024-09-16T09:32:33.757183+0000 mgr.a (mgr.14373) 10184 : cluster [DBG] pgmap v7062: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:32:35.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:32:34 smithi047 bash[22744]: cluster 2024-09-16T09:32:33.757183+0000 mgr.a (mgr.14373) 10184 : cluster [DBG] pgmap v7062: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:32:37.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:32:36 smithi157 bash[24585]: cluster 2024-09-16T09:32:35.757938+0000 mgr.a (mgr.14373) 10185 : cluster [DBG] pgmap v7063: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T09:32:37.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:32:36 smithi086 bash[24289]: cluster 2024-09-16T09:32:35.757938+0000 mgr.a (mgr.14373) 10185 : cluster [DBG] pgmap v7063: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T09:32:37.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:32:36 smithi047 bash[22744]: cluster 2024-09-16T09:32:35.757938+0000 mgr.a (mgr.14373) 10185 : cluster [DBG] pgmap v7063: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T09:32:37.526 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:32:37.526 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:32:37.526 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:32:38.302 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:32:38.302 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:32:38.302 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:32:38.302 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:32:38.302 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:32:39.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:32:38 smithi157 bash[24585]: cluster 2024-09-16T09:32:37.760099+0000 mgr.a (mgr.14373) 10186 : cluster [DBG] pgmap v7064: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:32:39.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:32:38 smithi157 bash[24585]: audit 2024-09-16T09:32:37.858362+0000 mgr.a (mgr.14373) 10187 : audit [DBG] from='client.224772 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:32:39.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:32:38 smithi086 bash[24289]: cluster 2024-09-16T09:32:37.760099+0000 mgr.a (mgr.14373) 10186 : cluster [DBG] pgmap v7064: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:32:39.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:32:38 smithi086 bash[24289]: audit 2024-09-16T09:32:37.858362+0000 mgr.a (mgr.14373) 10187 : audit [DBG] from='client.224772 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:32:39.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:32:38 smithi047 bash[22744]: cluster 2024-09-16T09:32:37.760099+0000 mgr.a (mgr.14373) 10186 : cluster [DBG] pgmap v7064: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:32:39.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:32:38 smithi047 bash[22744]: audit 2024-09-16T09:32:37.858362+0000 mgr.a (mgr.14373) 10187 : audit [DBG] from='client.224772 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:32:41.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:32:40 smithi157 bash[24585]: cluster 2024-09-16T09:32:39.760993+0000 mgr.a (mgr.14373) 10188 : cluster [DBG] pgmap v7065: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:32:41.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:32:40 smithi086 bash[24289]: cluster 2024-09-16T09:32:39.760993+0000 mgr.a (mgr.14373) 10188 : cluster [DBG] pgmap v7065: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:32:41.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:32:40 smithi047 bash[22744]: cluster 2024-09-16T09:32:39.760993+0000 mgr.a (mgr.14373) 10188 : cluster [DBG] pgmap v7065: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:32:43.303 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:32:43.304 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:32:43.304 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:32:43.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:32:42 smithi157 bash[24585]: cluster 2024-09-16T09:32:41.763138+0000 mgr.a (mgr.14373) 10189 : cluster [DBG] pgmap v7066: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:32:43.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:32:42 smithi086 bash[24289]: cluster 2024-09-16T09:32:41.763138+0000 mgr.a (mgr.14373) 10189 : cluster [DBG] pgmap v7066: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:32:43.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:32:42 smithi047 bash[22744]: cluster 2024-09-16T09:32:41.763138+0000 mgr.a (mgr.14373) 10189 : cluster [DBG] pgmap v7066: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:32:44.067 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:32:44.068 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:32:44.068 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:32:44.068 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:32:44.068 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:32:45.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:32:44 smithi157 bash[24585]: audit 2024-09-16T09:32:43.641773+0000 mgr.a (mgr.14373) 10190 : audit [DBG] from='client.224850 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:32:45.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:32:44 smithi157 bash[24585]: cluster 2024-09-16T09:32:43.763803+0000 mgr.a (mgr.14373) 10191 : cluster [DBG] pgmap v7067: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:32:45.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:32:44 smithi086 bash[24289]: audit 2024-09-16T09:32:43.641773+0000 mgr.a (mgr.14373) 10190 : audit [DBG] from='client.224850 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:32:45.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:32:44 smithi086 bash[24289]: cluster 2024-09-16T09:32:43.763803+0000 mgr.a (mgr.14373) 10191 : cluster [DBG] pgmap v7067: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:32:45.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:32:44 smithi047 bash[22744]: audit 2024-09-16T09:32:43.641773+0000 mgr.a (mgr.14373) 10190 : audit [DBG] from='client.224850 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:32:45.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:32:44 smithi047 bash[22744]: cluster 2024-09-16T09:32:43.763803+0000 mgr.a (mgr.14373) 10191 : cluster [DBG] pgmap v7067: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:32:47.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:32:46 smithi157 bash[24585]: cluster 2024-09-16T09:32:45.764682+0000 mgr.a (mgr.14373) 10192 : cluster [DBG] pgmap v7068: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:32:47.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:32:46 smithi086 bash[24289]: cluster 2024-09-16T09:32:45.764682+0000 mgr.a (mgr.14373) 10192 : cluster [DBG] pgmap v7068: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:32:47.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:32:46 smithi047 bash[22744]: cluster 2024-09-16T09:32:45.764682+0000 mgr.a (mgr.14373) 10192 : cluster [DBG] pgmap v7068: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:32:49.069 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:32:49.070 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:32:49.070 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:32:49.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:32:48 smithi157 bash[24585]: cluster 2024-09-16T09:32:47.766932+0000 mgr.a (mgr.14373) 10193 : cluster [DBG] pgmap v7069: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:32:49.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:32:48 smithi086 bash[24289]: cluster 2024-09-16T09:32:47.766932+0000 mgr.a (mgr.14373) 10193 : cluster [DBG] pgmap v7069: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:32:49.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:32:48 smithi047 bash[22744]: cluster 2024-09-16T09:32:47.766932+0000 mgr.a (mgr.14373) 10193 : cluster [DBG] pgmap v7069: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:32:49.812 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:32:49.812 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:32:49.813 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:32:49.813 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:32:49.813 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:32:50.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:32:49 smithi157 bash[24585]: audit 2024-09-16T09:32:49.394768+0000 mgr.a (mgr.14373) 10194 : audit [DBG] from='client.224928 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:32:50.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:32:49 smithi086 bash[24289]: audit 2024-09-16T09:32:49.394768+0000 mgr.a (mgr.14373) 10194 : audit [DBG] from='client.224928 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:32:50.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:32:49 smithi047 bash[22744]: audit 2024-09-16T09:32:49.394768+0000 mgr.a (mgr.14373) 10194 : audit [DBG] from='client.224928 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:32:51.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:32:50 smithi157 bash[24585]: cluster 2024-09-16T09:32:49.767535+0000 mgr.a (mgr.14373) 10195 : cluster [DBG] pgmap v7070: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:32:51.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:32:50 smithi086 bash[24289]: cluster 2024-09-16T09:32:49.767535+0000 mgr.a (mgr.14373) 10195 : cluster [DBG] pgmap v7070: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:32:51.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:32:50 smithi047 bash[22744]: cluster 2024-09-16T09:32:49.767535+0000 mgr.a (mgr.14373) 10195 : cluster [DBG] pgmap v7070: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:32:53.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:32:52 smithi157 bash[24585]: cluster 2024-09-16T09:32:51.769660+0000 mgr.a (mgr.14373) 10196 : cluster [DBG] pgmap v7071: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:32:53.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:32:52 smithi086 bash[24289]: cluster 2024-09-16T09:32:51.769660+0000 mgr.a (mgr.14373) 10196 : cluster [DBG] pgmap v7071: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:32:53.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:32:52 smithi047 bash[22744]: cluster 2024-09-16T09:32:51.769660+0000 mgr.a (mgr.14373) 10196 : cluster [DBG] pgmap v7071: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:32:54.814 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:32:54.815 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:32:54.815 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:32:55.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:32:54 smithi157 bash[24585]: cluster 2024-09-16T09:32:53.770442+0000 mgr.a (mgr.14373) 10197 : cluster [DBG] pgmap v7072: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:32:55.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:32:54 smithi086 bash[24289]: cluster 2024-09-16T09:32:53.770442+0000 mgr.a (mgr.14373) 10197 : cluster [DBG] pgmap v7072: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:32:55.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:32:54 smithi047 bash[22744]: cluster 2024-09-16T09:32:53.770442+0000 mgr.a (mgr.14373) 10197 : cluster [DBG] pgmap v7072: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:32:55.592 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:32:55.592 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:32:55.593 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:32:55.593 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:32:55.593 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:32:56.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:32:55 smithi157 bash[24585]: audit 2024-09-16T09:32:55.146778+0000 mgr.a (mgr.14373) 10198 : audit [DBG] from='client.225006 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:32:56.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:32:55 smithi086 bash[24289]: audit 2024-09-16T09:32:55.146778+0000 mgr.a (mgr.14373) 10198 : audit [DBG] from='client.225006 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:32:56.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:32:55 smithi047 bash[22744]: audit 2024-09-16T09:32:55.146778+0000 mgr.a (mgr.14373) 10198 : audit [DBG] from='client.225006 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:32:57.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:32:56 smithi157 bash[24585]: cluster 2024-09-16T09:32:55.771409+0000 mgr.a (mgr.14373) 10199 : cluster [DBG] pgmap v7073: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:32:57.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:32:56 smithi086 bash[24289]: cluster 2024-09-16T09:32:55.771409+0000 mgr.a (mgr.14373) 10199 : cluster [DBG] pgmap v7073: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:32:57.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:32:56 smithi047 bash[22744]: cluster 2024-09-16T09:32:55.771409+0000 mgr.a (mgr.14373) 10199 : cluster [DBG] pgmap v7073: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:32:59.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:32:58 smithi157 bash[24585]: cluster 2024-09-16T09:32:57.773639+0000 mgr.a (mgr.14373) 10200 : cluster [DBG] pgmap v7074: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:32:59.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:32:58 smithi086 bash[24289]: cluster 2024-09-16T09:32:57.773639+0000 mgr.a (mgr.14373) 10200 : cluster [DBG] pgmap v7074: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:32:59.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:32:58 smithi047 bash[22744]: cluster 2024-09-16T09:32:57.773639+0000 mgr.a (mgr.14373) 10200 : cluster [DBG] pgmap v7074: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:33:00.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:32:59 smithi157 bash[24585]: audit 2024-09-16T09:32:59.079127+0000 mon.b (mon.2) 946 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T09:33:00.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:32:59 smithi157 bash[24585]: audit 2024-09-16T09:32:59.917912+0000 mon.b (mon.2) 947 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:33:00.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:32:59 smithi157 bash[24585]: audit 2024-09-16T09:32:59.920279+0000 mon.b (mon.2) 948 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T09:33:00.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:32:59 smithi157 bash[24585]: audit 2024-09-16T09:32:59.930628+0000 mon.a (mon.0) 1174 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:33:00.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:32:59 smithi086 bash[24289]: audit 2024-09-16T09:32:59.079127+0000 mon.b (mon.2) 946 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T09:33:00.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:32:59 smithi086 bash[24289]: audit 2024-09-16T09:32:59.917912+0000 mon.b (mon.2) 947 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:33:00.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:32:59 smithi086 bash[24289]: audit 2024-09-16T09:32:59.920279+0000 mon.b (mon.2) 948 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T09:33:00.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:32:59 smithi086 bash[24289]: audit 2024-09-16T09:32:59.930628+0000 mon.a (mon.0) 1174 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:33:00.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:32:59 smithi047 bash[22744]: audit 2024-09-16T09:32:59.079127+0000 mon.b (mon.2) 946 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T09:33:00.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:32:59 smithi047 bash[22744]: audit 2024-09-16T09:32:59.917912+0000 mon.b (mon.2) 947 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:33:00.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:32:59 smithi047 bash[22744]: audit 2024-09-16T09:32:59.920279+0000 mon.b (mon.2) 948 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T09:33:00.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:32:59 smithi047 bash[22744]: audit 2024-09-16T09:32:59.930628+0000 mon.a (mon.0) 1174 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:33:00.593 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:33:00.594 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:33:00.594 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:33:00.943 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 09:33:00 smithi047 bash[22994]: debug 2024-09-16T09:33:00.657+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T09:33:00.944 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 09:33:00 smithi047 bash[22994]: debug 2024-09-16T09:33:00.661+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T09:33:01.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:33:00 smithi157 bash[24585]: cluster 2024-09-16T09:32:59.774080+0000 mgr.a (mgr.14373) 10201 : cluster [DBG] pgmap v7075: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:33:01.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:33:00 smithi157 bash[24585]: audit 2024-09-16T09:32:59.939474+0000 mon.b (mon.2) 949 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:33:01.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:33:00 smithi157 bash[24585]: audit 2024-09-16T09:32:59.939892+0000 mgr.a (mgr.14373) 10202 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:33:01.316 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:33:01.317 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:33:01.317 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:33:01.317 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:33:01.317 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:33:01.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:33:00 smithi086 bash[24289]: cluster 2024-09-16T09:32:59.774080+0000 mgr.a (mgr.14373) 10201 : cluster [DBG] pgmap v7075: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:33:01.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:33:00 smithi086 bash[24289]: audit 2024-09-16T09:32:59.939474+0000 mon.b (mon.2) 949 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:33:01.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:33:00 smithi086 bash[24289]: audit 2024-09-16T09:32:59.939892+0000 mgr.a (mgr.14373) 10202 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:33:01.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:33:00 smithi047 bash[22744]: cluster 2024-09-16T09:32:59.774080+0000 mgr.a (mgr.14373) 10201 : cluster [DBG] pgmap v7075: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:33:01.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:33:00 smithi047 bash[22744]: audit 2024-09-16T09:32:59.939474+0000 mon.b (mon.2) 949 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:33:01.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:33:00 smithi047 bash[22744]: audit 2024-09-16T09:32:59.939892+0000 mgr.a (mgr.14373) 10202 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:33:02.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:33:01 smithi157 bash[24585]: audit 2024-09-16T09:33:00.661684+0000 mgr.a (mgr.14373) 10203 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T09:33:02.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:33:01 smithi157 bash[24585]: cephadm 2024-09-16T09:33:00.663410+0000 mgr.a (mgr.14373) 10204 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T09:33:02.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:33:01 smithi157 bash[24585]: audit 2024-09-16T09:33:00.899223+0000 mgr.a (mgr.14373) 10205 : audit [DBG] from='client.225189 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:33:02.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:33:01 smithi086 bash[24289]: audit 2024-09-16T09:33:00.661684+0000 mgr.a (mgr.14373) 10203 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T09:33:02.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:33:01 smithi086 bash[24289]: cephadm 2024-09-16T09:33:00.663410+0000 mgr.a (mgr.14373) 10204 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T09:33:02.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:33:01 smithi086 bash[24289]: audit 2024-09-16T09:33:00.899223+0000 mgr.a (mgr.14373) 10205 : audit [DBG] from='client.225189 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:33:02.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:33:01 smithi047 bash[22744]: audit 2024-09-16T09:33:00.661684+0000 mgr.a (mgr.14373) 10203 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T09:33:02.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:33:01 smithi047 bash[22744]: cephadm 2024-09-16T09:33:00.663410+0000 mgr.a (mgr.14373) 10204 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T09:33:02.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:33:01 smithi047 bash[22744]: audit 2024-09-16T09:33:00.899223+0000 mgr.a (mgr.14373) 10205 : audit [DBG] from='client.225189 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:33:03.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:33:02 smithi157 bash[24585]: cluster 2024-09-16T09:33:01.776372+0000 mgr.a (mgr.14373) 10206 : cluster [DBG] pgmap v7076: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:33:03.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:33:02 smithi086 bash[24289]: cluster 2024-09-16T09:33:01.776372+0000 mgr.a (mgr.14373) 10206 : cluster [DBG] pgmap v7076: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:33:03.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:33:02 smithi047 bash[22744]: cluster 2024-09-16T09:33:01.776372+0000 mgr.a (mgr.14373) 10206 : cluster [DBG] pgmap v7076: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:33:05.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:33:04 smithi157 bash[24585]: cluster 2024-09-16T09:33:03.777128+0000 mgr.a (mgr.14373) 10207 : cluster [DBG] pgmap v7077: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:33:05.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:33:04 smithi086 bash[24289]: cluster 2024-09-16T09:33:03.777128+0000 mgr.a (mgr.14373) 10207 : cluster [DBG] pgmap v7077: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:33:05.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:33:04 smithi047 bash[22744]: cluster 2024-09-16T09:33:03.777128+0000 mgr.a (mgr.14373) 10207 : cluster [DBG] pgmap v7077: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:33:06.318 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:33:06.319 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:33:06.319 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:33:07.072 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:33:07.073 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:33:07.073 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:33:07.073 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:33:07.073 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:33:07.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:33:06 smithi157 bash[24585]: cluster 2024-09-16T09:33:05.777932+0000 mgr.a (mgr.14373) 10208 : cluster [DBG] pgmap v7078: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:33:07.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:33:06 smithi086 bash[24289]: cluster 2024-09-16T09:33:05.777932+0000 mgr.a (mgr.14373) 10208 : cluster [DBG] pgmap v7078: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:33:07.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:33:06 smithi047 bash[22744]: cluster 2024-09-16T09:33:05.777932+0000 mgr.a (mgr.14373) 10208 : cluster [DBG] pgmap v7078: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:33:08.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:33:07 smithi157 bash[24585]: audit 2024-09-16T09:33:06.653931+0000 mgr.a (mgr.14373) 10209 : audit [DBG] from='client.225267 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:33:08.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:33:07 smithi086 bash[24289]: audit 2024-09-16T09:33:06.653931+0000 mgr.a (mgr.14373) 10209 : audit [DBG] from='client.225267 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:33:08.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:33:07 smithi047 bash[22744]: audit 2024-09-16T09:33:06.653931+0000 mgr.a (mgr.14373) 10209 : audit [DBG] from='client.225267 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:33:09.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:33:08 smithi157 bash[24585]: cluster 2024-09-16T09:33:07.780651+0000 mgr.a (mgr.14373) 10210 : cluster [DBG] pgmap v7079: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:33:09.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:33:08 smithi086 bash[24289]: cluster 2024-09-16T09:33:07.780651+0000 mgr.a (mgr.14373) 10210 : cluster [DBG] pgmap v7079: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:33:09.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:33:08 smithi047 bash[22744]: cluster 2024-09-16T09:33:07.780651+0000 mgr.a (mgr.14373) 10210 : cluster [DBG] pgmap v7079: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:33:11.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:33:10 smithi157 bash[24585]: cluster 2024-09-16T09:33:09.781461+0000 mgr.a (mgr.14373) 10211 : cluster [DBG] pgmap v7080: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T09:33:11.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:33:10 smithi086 bash[24289]: cluster 2024-09-16T09:33:09.781461+0000 mgr.a (mgr.14373) 10211 : cluster [DBG] pgmap v7080: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T09:33:11.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:33:10 smithi047 bash[22744]: cluster 2024-09-16T09:33:09.781461+0000 mgr.a (mgr.14373) 10211 : cluster [DBG] pgmap v7080: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T09:33:12.074 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:33:12.074 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:33:12.075 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:33:12.864 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:33:12.865 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:33:12.865 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:33:12.865 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:33:12.865 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:33:13.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:33:12 smithi157 bash[24585]: cluster 2024-09-16T09:33:11.783464+0000 mgr.a (mgr.14373) 10212 : cluster [DBG] pgmap v7081: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:33:13.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:33:12 smithi157 bash[24585]: audit 2024-09-16T09:33:12.411057+0000 mgr.a (mgr.14373) 10213 : audit [DBG] from='client.225345 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:33:13.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:33:12 smithi086 bash[24289]: cluster 2024-09-16T09:33:11.783464+0000 mgr.a (mgr.14373) 10212 : cluster [DBG] pgmap v7081: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:33:13.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:33:12 smithi086 bash[24289]: audit 2024-09-16T09:33:12.411057+0000 mgr.a (mgr.14373) 10213 : audit [DBG] from='client.225345 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:33:13.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:33:12 smithi047 bash[22744]: cluster 2024-09-16T09:33:11.783464+0000 mgr.a (mgr.14373) 10212 : cluster [DBG] pgmap v7081: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:33:13.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:33:12 smithi047 bash[22744]: audit 2024-09-16T09:33:12.411057+0000 mgr.a (mgr.14373) 10213 : audit [DBG] from='client.225345 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:33:15.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:33:14 smithi157 bash[24585]: cluster 2024-09-16T09:33:13.784388+0000 mgr.a (mgr.14373) 10214 : cluster [DBG] pgmap v7082: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:33:15.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:33:14 smithi086 bash[24289]: cluster 2024-09-16T09:33:13.784388+0000 mgr.a (mgr.14373) 10214 : cluster [DBG] pgmap v7082: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:33:15.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:33:14 smithi047 bash[22744]: cluster 2024-09-16T09:33:13.784388+0000 mgr.a (mgr.14373) 10214 : cluster [DBG] pgmap v7082: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:33:17.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:33:16 smithi157 bash[24585]: cluster 2024-09-16T09:33:15.785118+0000 mgr.a (mgr.14373) 10215 : cluster [DBG] pgmap v7083: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T09:33:17.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:33:16 smithi086 bash[24289]: cluster 2024-09-16T09:33:15.785118+0000 mgr.a (mgr.14373) 10215 : cluster [DBG] pgmap v7083: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T09:33:17.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:33:16 smithi047 bash[22744]: cluster 2024-09-16T09:33:15.785118+0000 mgr.a (mgr.14373) 10215 : cluster [DBG] pgmap v7083: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T09:33:17.866 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:33:17.867 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:33:17.867 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:33:18.615 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:33:18.616 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:33:18.616 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:33:18.616 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:33:18.616 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:33:19.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:33:18 smithi157 bash[24585]: cluster 2024-09-16T09:33:17.787392+0000 mgr.a (mgr.14373) 10216 : cluster [DBG] pgmap v7084: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:33:19.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:33:18 smithi157 bash[24585]: audit 2024-09-16T09:33:18.200374+0000 mgr.a (mgr.14373) 10217 : audit [DBG] from='client.225423 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:33:19.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:33:18 smithi086 bash[24289]: cluster 2024-09-16T09:33:17.787392+0000 mgr.a (mgr.14373) 10216 : cluster [DBG] pgmap v7084: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:33:19.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:33:18 smithi086 bash[24289]: audit 2024-09-16T09:33:18.200374+0000 mgr.a (mgr.14373) 10217 : audit [DBG] from='client.225423 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:33:19.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:33:18 smithi047 bash[22744]: cluster 2024-09-16T09:33:17.787392+0000 mgr.a (mgr.14373) 10216 : cluster [DBG] pgmap v7084: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:33:19.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:33:18 smithi047 bash[22744]: audit 2024-09-16T09:33:18.200374+0000 mgr.a (mgr.14373) 10217 : audit [DBG] from='client.225423 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:33:21.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:33:20 smithi157 bash[24585]: cluster 2024-09-16T09:33:19.788310+0000 mgr.a (mgr.14373) 10218 : cluster [DBG] pgmap v7085: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:33:21.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:33:20 smithi086 bash[24289]: cluster 2024-09-16T09:33:19.788310+0000 mgr.a (mgr.14373) 10218 : cluster [DBG] pgmap v7085: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:33:21.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:33:20 smithi047 bash[22744]: cluster 2024-09-16T09:33:19.788310+0000 mgr.a (mgr.14373) 10218 : cluster [DBG] pgmap v7085: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:33:23.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:33:23 smithi157 bash[24585]: cluster 2024-09-16T09:33:21.790553+0000 mgr.a (mgr.14373) 10219 : cluster [DBG] pgmap v7086: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:33:23.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:33:23 smithi086 bash[24289]: cluster 2024-09-16T09:33:21.790553+0000 mgr.a (mgr.14373) 10219 : cluster [DBG] pgmap v7086: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:33:23.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:33:22 smithi047 bash[22744]: cluster 2024-09-16T09:33:21.790553+0000 mgr.a (mgr.14373) 10219 : cluster [DBG] pgmap v7086: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:33:23.617 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:33:23.618 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:33:23.618 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:33:24.390 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:33:24.390 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:33:24.390 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:33:24.390 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:33:24.390 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:33:25.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:33:25 smithi157 bash[24585]: cluster 2024-09-16T09:33:23.791308+0000 mgr.a (mgr.14373) 10220 : cluster [DBG] pgmap v7087: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:33:25.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:33:25 smithi157 bash[24585]: audit 2024-09-16T09:33:23.951748+0000 mgr.a (mgr.14373) 10221 : audit [DBG] from='client.225501 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:33:25.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:33:25 smithi086 bash[24289]: cluster 2024-09-16T09:33:23.791308+0000 mgr.a (mgr.14373) 10220 : cluster [DBG] pgmap v7087: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:33:25.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:33:25 smithi086 bash[24289]: audit 2024-09-16T09:33:23.951748+0000 mgr.a (mgr.14373) 10221 : audit [DBG] from='client.225501 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:33:25.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:33:25 smithi047 bash[22744]: cluster 2024-09-16T09:33:23.791308+0000 mgr.a (mgr.14373) 10220 : cluster [DBG] pgmap v7087: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:33:25.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:33:25 smithi047 bash[22744]: audit 2024-09-16T09:33:23.951748+0000 mgr.a (mgr.14373) 10221 : audit [DBG] from='client.225501 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:33:27.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:33:27 smithi157 bash[24585]: cluster 2024-09-16T09:33:25.792221+0000 mgr.a (mgr.14373) 10222 : cluster [DBG] pgmap v7088: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:33:27.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:33:27 smithi086 bash[24289]: cluster 2024-09-16T09:33:25.792221+0000 mgr.a (mgr.14373) 10222 : cluster [DBG] pgmap v7088: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:33:27.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:33:27 smithi047 bash[22744]: cluster 2024-09-16T09:33:25.792221+0000 mgr.a (mgr.14373) 10222 : cluster [DBG] pgmap v7088: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:33:29.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:33:29 smithi157 bash[24585]: cluster 2024-09-16T09:33:27.794527+0000 mgr.a (mgr.14373) 10223 : cluster [DBG] pgmap v7089: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:33:29.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:33:29 smithi086 bash[24289]: cluster 2024-09-16T09:33:27.794527+0000 mgr.a (mgr.14373) 10223 : cluster [DBG] pgmap v7089: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:33:29.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:33:29 smithi047 bash[22744]: cluster 2024-09-16T09:33:27.794527+0000 mgr.a (mgr.14373) 10223 : cluster [DBG] pgmap v7089: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:33:29.391 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:33:29.392 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:33:29.392 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:33:30.151 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:33:30.151 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:33:30.151 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:33:30.151 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:33:30.152 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:33:31.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:33:31 smithi157 bash[24585]: audit 2024-09-16T09:33:29.722521+0000 mgr.a (mgr.14373) 10224 : audit [DBG] from='client.225573 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:33:31.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:33:31 smithi157 bash[24585]: cluster 2024-09-16T09:33:29.795252+0000 mgr.a (mgr.14373) 10225 : cluster [DBG] pgmap v7090: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:33:31.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:33:31 smithi086 bash[24289]: audit 2024-09-16T09:33:29.722521+0000 mgr.a (mgr.14373) 10224 : audit [DBG] from='client.225573 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:33:31.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:33:31 smithi086 bash[24289]: cluster 2024-09-16T09:33:29.795252+0000 mgr.a (mgr.14373) 10225 : cluster [DBG] pgmap v7090: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:33:31.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:33:31 smithi047 bash[22744]: audit 2024-09-16T09:33:29.722521+0000 mgr.a (mgr.14373) 10224 : audit [DBG] from='client.225573 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:33:31.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:33:31 smithi047 bash[22744]: cluster 2024-09-16T09:33:29.795252+0000 mgr.a (mgr.14373) 10225 : cluster [DBG] pgmap v7090: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:33:33.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:33:33 smithi157 bash[24585]: cluster 2024-09-16T09:33:31.797634+0000 mgr.a (mgr.14373) 10226 : cluster [DBG] pgmap v7091: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:33:33.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:33:33 smithi086 bash[24289]: cluster 2024-09-16T09:33:31.797634+0000 mgr.a (mgr.14373) 10226 : cluster [DBG] pgmap v7091: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:33:33.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:33:33 smithi047 bash[22744]: cluster 2024-09-16T09:33:31.797634+0000 mgr.a (mgr.14373) 10226 : cluster [DBG] pgmap v7091: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:33:35.153 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:33:35.153 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:33:35.154 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:33:35.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:33:35 smithi157 bash[24585]: cluster 2024-09-16T09:33:33.798644+0000 mgr.a (mgr.14373) 10227 : cluster [DBG] pgmap v7092: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:33:35.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:33:35 smithi086 bash[24289]: cluster 2024-09-16T09:33:33.798644+0000 mgr.a (mgr.14373) 10227 : cluster [DBG] pgmap v7092: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:33:35.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:33:35 smithi047 bash[22744]: cluster 2024-09-16T09:33:33.798644+0000 mgr.a (mgr.14373) 10227 : cluster [DBG] pgmap v7092: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:33:35.937 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:33:35.937 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:33:35.937 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:33:35.937 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:33:35.937 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:33:36.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:33:36 smithi157 bash[24585]: audit 2024-09-16T09:33:35.484571+0000 mgr.a (mgr.14373) 10228 : audit [DBG] from='client.225648 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:33:36.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:33:36 smithi086 bash[24289]: audit 2024-09-16T09:33:35.484571+0000 mgr.a (mgr.14373) 10228 : audit [DBG] from='client.225648 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:33:36.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:33:36 smithi047 bash[22744]: audit 2024-09-16T09:33:35.484571+0000 mgr.a (mgr.14373) 10228 : audit [DBG] from='client.225648 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:33:37.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:33:37 smithi157 bash[24585]: cluster 2024-09-16T09:33:35.799323+0000 mgr.a (mgr.14373) 10229 : cluster [DBG] pgmap v7093: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:33:37.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:33:37 smithi086 bash[24289]: cluster 2024-09-16T09:33:35.799323+0000 mgr.a (mgr.14373) 10229 : cluster [DBG] pgmap v7093: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:33:37.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:33:37 smithi047 bash[22744]: cluster 2024-09-16T09:33:35.799323+0000 mgr.a (mgr.14373) 10229 : cluster [DBG] pgmap v7093: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:33:39.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:33:39 smithi157 bash[24585]: cluster 2024-09-16T09:33:37.801616+0000 mgr.a (mgr.14373) 10230 : cluster [DBG] pgmap v7094: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:33:39.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:33:39 smithi086 bash[24289]: cluster 2024-09-16T09:33:37.801616+0000 mgr.a (mgr.14373) 10230 : cluster [DBG] pgmap v7094: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:33:39.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:33:39 smithi047 bash[22744]: cluster 2024-09-16T09:33:37.801616+0000 mgr.a (mgr.14373) 10230 : cluster [DBG] pgmap v7094: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:33:40.938 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:33:40.939 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:33:40.939 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:33:41.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:33:41 smithi157 bash[24585]: cluster 2024-09-16T09:33:39.802465+0000 mgr.a (mgr.14373) 10231 : cluster [DBG] pgmap v7095: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:33:41.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:33:41 smithi086 bash[24289]: cluster 2024-09-16T09:33:39.802465+0000 mgr.a (mgr.14373) 10231 : cluster [DBG] pgmap v7095: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:33:41.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:33:41 smithi047 bash[22744]: cluster 2024-09-16T09:33:39.802465+0000 mgr.a (mgr.14373) 10231 : cluster [DBG] pgmap v7095: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:33:41.694 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:33:41.694 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:33:41.695 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:33:41.695 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:33:41.695 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:33:42.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:33:42 smithi157 bash[24585]: audit 2024-09-16T09:33:41.266747+0000 mgr.a (mgr.14373) 10232 : audit [DBG] from='client.225723 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:33:42.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:33:42 smithi086 bash[24289]: audit 2024-09-16T09:33:41.266747+0000 mgr.a (mgr.14373) 10232 : audit [DBG] from='client.225723 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:33:42.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:33:42 smithi047 bash[22744]: audit 2024-09-16T09:33:41.266747+0000 mgr.a (mgr.14373) 10232 : audit [DBG] from='client.225723 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:33:43.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:33:43 smithi086 bash[24289]: cluster 2024-09-16T09:33:41.805046+0000 mgr.a (mgr.14373) 10233 : cluster [DBG] pgmap v7096: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-16T09:33:43.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:33:43 smithi047 bash[22744]: cluster 2024-09-16T09:33:41.805046+0000 mgr.a (mgr.14373) 10233 : cluster [DBG] pgmap v7096: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-16T09:33:43.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:33:43 smithi157 bash[24585]: cluster 2024-09-16T09:33:41.805046+0000 mgr.a (mgr.14373) 10233 : cluster [DBG] pgmap v7096: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-16T09:33:45.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:33:45 smithi086 bash[24289]: cluster 2024-09-16T09:33:43.805814+0000 mgr.a (mgr.14373) 10234 : cluster [DBG] pgmap v7097: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T09:33:45.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:33:45 smithi047 bash[22744]: cluster 2024-09-16T09:33:43.805814+0000 mgr.a (mgr.14373) 10234 : cluster [DBG] pgmap v7097: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T09:33:45.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:33:45 smithi157 bash[24585]: cluster 2024-09-16T09:33:43.805814+0000 mgr.a (mgr.14373) 10234 : cluster [DBG] pgmap v7097: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T09:33:46.696 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:33:46.696 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:33:46.697 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:33:47.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:33:47 smithi047 bash[22744]: cluster 2024-09-16T09:33:45.806625+0000 mgr.a (mgr.14373) 10235 : cluster [DBG] pgmap v7098: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T09:33:47.441 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:33:47.441 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:33:47.441 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:33:47.441 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:33:47.441 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:33:47.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:33:47 smithi157 bash[24585]: cluster 2024-09-16T09:33:45.806625+0000 mgr.a (mgr.14373) 10235 : cluster [DBG] pgmap v7098: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T09:33:47.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:33:47 smithi086 bash[24289]: cluster 2024-09-16T09:33:45.806625+0000 mgr.a (mgr.14373) 10235 : cluster [DBG] pgmap v7098: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T09:33:48.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:33:48 smithi047 bash[22744]: audit 2024-09-16T09:33:47.023761+0000 mgr.a (mgr.14373) 10236 : audit [DBG] from='client.225801 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:33:48.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:33:48 smithi157 bash[24585]: audit 2024-09-16T09:33:47.023761+0000 mgr.a (mgr.14373) 10236 : audit [DBG] from='client.225801 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:33:48.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:33:48 smithi086 bash[24289]: audit 2024-09-16T09:33:47.023761+0000 mgr.a (mgr.14373) 10236 : audit [DBG] from='client.225801 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:33:49.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:33:49 smithi047 bash[22744]: cluster 2024-09-16T09:33:47.809208+0000 mgr.a (mgr.14373) 10237 : cluster [DBG] pgmap v7099: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:33:49.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:33:49 smithi157 bash[24585]: cluster 2024-09-16T09:33:47.809208+0000 mgr.a (mgr.14373) 10237 : cluster [DBG] pgmap v7099: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:33:49.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:33:49 smithi086 bash[24289]: cluster 2024-09-16T09:33:47.809208+0000 mgr.a (mgr.14373) 10237 : cluster [DBG] pgmap v7099: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:33:51.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:33:51 smithi047 bash[22744]: cluster 2024-09-16T09:33:49.809991+0000 mgr.a (mgr.14373) 10238 : cluster [DBG] pgmap v7100: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:33:51.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:33:51 smithi157 bash[24585]: cluster 2024-09-16T09:33:49.809991+0000 mgr.a (mgr.14373) 10238 : cluster [DBG] pgmap v7100: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:33:51.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:33:51 smithi086 bash[24289]: cluster 2024-09-16T09:33:49.809991+0000 mgr.a (mgr.14373) 10238 : cluster [DBG] pgmap v7100: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:33:52.442 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:33:52.443 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:33:52.444 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:33:53.189 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:33:53.190 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:33:53.190 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:33:53.190 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:33:53.190 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:33:53.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:33:53 smithi047 bash[22744]: cluster 2024-09-16T09:33:51.811954+0000 mgr.a (mgr.14373) 10239 : cluster [DBG] pgmap v7101: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:33:53.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:33:53 smithi157 bash[24585]: cluster 2024-09-16T09:33:51.811954+0000 mgr.a (mgr.14373) 10239 : cluster [DBG] pgmap v7101: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:33:53.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:33:53 smithi086 bash[24289]: cluster 2024-09-16T09:33:51.811954+0000 mgr.a (mgr.14373) 10239 : cluster [DBG] pgmap v7101: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:33:54.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:33:54 smithi157 bash[24585]: audit 2024-09-16T09:33:52.770093+0000 mgr.a (mgr.14373) 10240 : audit [DBG] from='client.225873 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:33:54.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:33:54 smithi086 bash[24289]: audit 2024-09-16T09:33:52.770093+0000 mgr.a (mgr.14373) 10240 : audit [DBG] from='client.225873 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:33:54.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:33:54 smithi047 bash[22744]: audit 2024-09-16T09:33:52.770093+0000 mgr.a (mgr.14373) 10240 : audit [DBG] from='client.225873 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:33:55.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:33:55 smithi157 bash[24585]: cluster 2024-09-16T09:33:53.812854+0000 mgr.a (mgr.14373) 10241 : cluster [DBG] pgmap v7102: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-16T09:33:55.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:33:55 smithi086 bash[24289]: cluster 2024-09-16T09:33:53.812854+0000 mgr.a (mgr.14373) 10241 : cluster [DBG] pgmap v7102: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-16T09:33:55.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:33:55 smithi047 bash[22744]: cluster 2024-09-16T09:33:53.812854+0000 mgr.a (mgr.14373) 10241 : cluster [DBG] pgmap v7102: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-16T09:33:57.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:33:57 smithi157 bash[24585]: cluster 2024-09-16T09:33:55.813656+0000 mgr.a (mgr.14373) 10242 : cluster [DBG] pgmap v7103: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-16T09:33:57.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:33:57 smithi086 bash[24289]: cluster 2024-09-16T09:33:55.813656+0000 mgr.a (mgr.14373) 10242 : cluster [DBG] pgmap v7103: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-16T09:33:57.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:33:57 smithi047 bash[22744]: cluster 2024-09-16T09:33:55.813656+0000 mgr.a (mgr.14373) 10242 : cluster [DBG] pgmap v7103: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-16T09:33:58.191 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:33:58.192 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:33:58.192 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:33:58.932 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:33:58.933 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:33:58.933 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:33:58.933 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:33:58.933 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:33:59.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:33:59 smithi157 bash[24585]: cluster 2024-09-16T09:33:57.815880+0000 mgr.a (mgr.14373) 10243 : cluster [DBG] pgmap v7104: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-16T09:33:59.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:33:59 smithi157 bash[24585]: audit 2024-09-16T09:33:58.522722+0000 mgr.a (mgr.14373) 10244 : audit [DBG] from='client.225948 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:33:59.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:33:59 smithi086 bash[24289]: cluster 2024-09-16T09:33:57.815880+0000 mgr.a (mgr.14373) 10243 : cluster [DBG] pgmap v7104: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-16T09:33:59.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:33:59 smithi086 bash[24289]: audit 2024-09-16T09:33:58.522722+0000 mgr.a (mgr.14373) 10244 : audit [DBG] from='client.225948 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:33:59.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:33:59 smithi047 bash[22744]: cluster 2024-09-16T09:33:57.815880+0000 mgr.a (mgr.14373) 10243 : cluster [DBG] pgmap v7104: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-16T09:33:59.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:33:59 smithi047 bash[22744]: audit 2024-09-16T09:33:58.522722+0000 mgr.a (mgr.14373) 10244 : audit [DBG] from='client.225948 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:34:01.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:34:01 smithi157 bash[24585]: cluster 2024-09-16T09:33:59.816731+0000 mgr.a (mgr.14373) 10245 : cluster [DBG] pgmap v7105: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:34:01.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:34:01 smithi157 bash[24585]: audit 2024-09-16T09:34:00.714197+0000 mon.b (mon.2) 950 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T09:34:01.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:34:01 smithi086 bash[24289]: cluster 2024-09-16T09:33:59.816731+0000 mgr.a (mgr.14373) 10245 : cluster [DBG] pgmap v7105: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:34:01.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:34:01 smithi086 bash[24289]: audit 2024-09-16T09:34:00.714197+0000 mon.b (mon.2) 950 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T09:34:01.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:34:01 smithi047 bash[22744]: cluster 2024-09-16T09:33:59.816731+0000 mgr.a (mgr.14373) 10245 : cluster [DBG] pgmap v7105: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:34:01.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:34:01 smithi047 bash[22744]: audit 2024-09-16T09:34:00.714197+0000 mon.b (mon.2) 950 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T09:34:02.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:34:02 smithi157 bash[24585]: audit 2024-09-16T09:34:01.345291+0000 mon.a (mon.0) 1175 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:34:02.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:34:02 smithi157 bash[24585]: audit 2024-09-16T09:34:01.353450+0000 mon.a (mon.0) 1176 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:34:02.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:34:02 smithi157 bash[24585]: audit 2024-09-16T09:34:02.158174+0000 mon.b (mon.2) 951 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:34:02.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:34:02 smithi157 bash[24585]: audit 2024-09-16T09:34:02.160149+0000 mon.b (mon.2) 952 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T09:34:02.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:34:02 smithi157 bash[24585]: audit 2024-09-16T09:34:02.170493+0000 mon.a (mon.0) 1177 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:34:02.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:34:02 smithi157 bash[24585]: audit 2024-09-16T09:34:02.177613+0000 mon.b (mon.2) 953 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:34:02.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:34:02 smithi086 bash[24289]: audit 2024-09-16T09:34:01.345291+0000 mon.a (mon.0) 1175 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:34:02.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:34:02 smithi086 bash[24289]: audit 2024-09-16T09:34:01.353450+0000 mon.a (mon.0) 1176 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:34:02.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:34:02 smithi086 bash[24289]: audit 2024-09-16T09:34:02.158174+0000 mon.b (mon.2) 951 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:34:02.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:34:02 smithi086 bash[24289]: audit 2024-09-16T09:34:02.160149+0000 mon.b (mon.2) 952 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T09:34:02.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:34:02 smithi086 bash[24289]: audit 2024-09-16T09:34:02.170493+0000 mon.a (mon.0) 1177 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:34:02.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:34:02 smithi086 bash[24289]: audit 2024-09-16T09:34:02.177613+0000 mon.b (mon.2) 953 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:34:02.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:34:02 smithi047 bash[22744]: audit 2024-09-16T09:34:01.345291+0000 mon.a (mon.0) 1175 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:34:02.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:34:02 smithi047 bash[22744]: audit 2024-09-16T09:34:01.353450+0000 mon.a (mon.0) 1176 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:34:02.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:34:02 smithi047 bash[22744]: audit 2024-09-16T09:34:02.158174+0000 mon.b (mon.2) 951 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:34:02.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:34:02 smithi047 bash[22744]: audit 2024-09-16T09:34:02.160149+0000 mon.b (mon.2) 952 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T09:34:02.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:34:02 smithi047 bash[22744]: audit 2024-09-16T09:34:02.170493+0000 mon.a (mon.0) 1177 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:34:02.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:34:02 smithi047 bash[22744]: audit 2024-09-16T09:34:02.177613+0000 mon.b (mon.2) 953 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:34:03.342 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 09:34:02 smithi047 bash[22994]: debug 2024-09-16T09:34:02.900+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T09:34:03.342 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 09:34:02 smithi047 bash[22994]: debug 2024-09-16T09:34:02.900+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T09:34:03.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:34:03 smithi157 bash[24585]: cluster 2024-09-16T09:34:01.818880+0000 mgr.a (mgr.14373) 10246 : cluster [DBG] pgmap v7106: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:34:03.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:34:03 smithi157 bash[24585]: audit 2024-09-16T09:34:02.179085+0000 mgr.a (mgr.14373) 10247 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:34:03.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:34:03 smithi086 bash[24289]: cluster 2024-09-16T09:34:01.818880+0000 mgr.a (mgr.14373) 10246 : cluster [DBG] pgmap v7106: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:34:03.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:34:03 smithi086 bash[24289]: audit 2024-09-16T09:34:02.179085+0000 mgr.a (mgr.14373) 10247 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:34:03.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:34:03 smithi047 bash[22744]: cluster 2024-09-16T09:34:01.818880+0000 mgr.a (mgr.14373) 10246 : cluster [DBG] pgmap v7106: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:34:03.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:34:03 smithi047 bash[22744]: audit 2024-09-16T09:34:02.179085+0000 mgr.a (mgr.14373) 10247 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:34:03.934 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:34:03.935 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:34:03.935 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:34:04.679 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:34:04.680 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:34:04.680 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:34:04.680 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:34:04.680 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:34:04.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:34:04 smithi157 bash[24585]: audit 2024-09-16T09:34:02.904395+0000 mgr.a (mgr.14373) 10248 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T09:34:04.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:34:04 smithi157 bash[24585]: cephadm 2024-09-16T09:34:02.906241+0000 mgr.a (mgr.14373) 10249 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T09:34:04.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:34:04 smithi086 bash[24289]: audit 2024-09-16T09:34:02.904395+0000 mgr.a (mgr.14373) 10248 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T09:34:04.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:34:04 smithi086 bash[24289]: cephadm 2024-09-16T09:34:02.906241+0000 mgr.a (mgr.14373) 10249 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T09:34:04.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:34:04 smithi047 bash[22744]: audit 2024-09-16T09:34:02.904395+0000 mgr.a (mgr.14373) 10248 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T09:34:04.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:34:04 smithi047 bash[22744]: cephadm 2024-09-16T09:34:02.906241+0000 mgr.a (mgr.14373) 10249 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T09:34:05.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:34:05 smithi157 bash[24585]: cluster 2024-09-16T09:34:03.819822+0000 mgr.a (mgr.14373) 10250 : cluster [DBG] pgmap v7107: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:34:05.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:34:05 smithi157 bash[24585]: audit 2024-09-16T09:34:04.262034+0000 mgr.a (mgr.14373) 10251 : audit [DBG] from='client.226125 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:34:05.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:34:05 smithi086 bash[24289]: cluster 2024-09-16T09:34:03.819822+0000 mgr.a (mgr.14373) 10250 : cluster [DBG] pgmap v7107: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:34:05.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:34:05 smithi086 bash[24289]: audit 2024-09-16T09:34:04.262034+0000 mgr.a (mgr.14373) 10251 : audit [DBG] from='client.226125 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:34:05.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:34:05 smithi047 bash[22744]: cluster 2024-09-16T09:34:03.819822+0000 mgr.a (mgr.14373) 10250 : cluster [DBG] pgmap v7107: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:34:05.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:34:05 smithi047 bash[22744]: audit 2024-09-16T09:34:04.262034+0000 mgr.a (mgr.14373) 10251 : audit [DBG] from='client.226125 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:34:07.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:34:07 smithi157 bash[24585]: cluster 2024-09-16T09:34:05.820822+0000 mgr.a (mgr.14373) 10252 : cluster [DBG] pgmap v7108: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:34:07.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:34:07 smithi086 bash[24289]: cluster 2024-09-16T09:34:05.820822+0000 mgr.a (mgr.14373) 10252 : cluster [DBG] pgmap v7108: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:34:07.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:34:07 smithi047 bash[22744]: cluster 2024-09-16T09:34:05.820822+0000 mgr.a (mgr.14373) 10252 : cluster [DBG] pgmap v7108: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:34:09.681 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:34:09.682 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:34:09.682 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:34:09.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:34:09 smithi157 bash[24585]: cluster 2024-09-16T09:34:07.823081+0000 mgr.a (mgr.14373) 10253 : cluster [DBG] pgmap v7109: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:34:09.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:34:09 smithi086 bash[24289]: cluster 2024-09-16T09:34:07.823081+0000 mgr.a (mgr.14373) 10253 : cluster [DBG] pgmap v7109: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:34:09.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:34:09 smithi047 bash[22744]: cluster 2024-09-16T09:34:07.823081+0000 mgr.a (mgr.14373) 10253 : cluster [DBG] pgmap v7109: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:34:10.431 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:34:10.432 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:34:10.432 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:34:10.432 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:34:10.432 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:34:11.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:34:11 smithi157 bash[24585]: cluster 2024-09-16T09:34:09.823554+0000 mgr.a (mgr.14373) 10254 : cluster [DBG] pgmap v7110: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:34:11.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:34:11 smithi157 bash[24585]: audit 2024-09-16T09:34:10.008847+0000 mgr.a (mgr.14373) 10255 : audit [DBG] from='client.226200 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:34:11.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:34:11 smithi086 bash[24289]: cluster 2024-09-16T09:34:09.823554+0000 mgr.a (mgr.14373) 10254 : cluster [DBG] pgmap v7110: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:34:11.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:34:11 smithi086 bash[24289]: audit 2024-09-16T09:34:10.008847+0000 mgr.a (mgr.14373) 10255 : audit [DBG] from='client.226200 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:34:11.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:34:11 smithi047 bash[22744]: cluster 2024-09-16T09:34:09.823554+0000 mgr.a (mgr.14373) 10254 : cluster [DBG] pgmap v7110: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:34:11.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:34:11 smithi047 bash[22744]: audit 2024-09-16T09:34:10.008847+0000 mgr.a (mgr.14373) 10255 : audit [DBG] from='client.226200 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:34:13.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:34:13 smithi157 bash[24585]: cluster 2024-09-16T09:34:11.825758+0000 mgr.a (mgr.14373) 10256 : cluster [DBG] pgmap v7111: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:34:13.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:34:13 smithi086 bash[24289]: cluster 2024-09-16T09:34:11.825758+0000 mgr.a (mgr.14373) 10256 : cluster [DBG] pgmap v7111: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:34:13.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:34:13 smithi047 bash[22744]: cluster 2024-09-16T09:34:11.825758+0000 mgr.a (mgr.14373) 10256 : cluster [DBG] pgmap v7111: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:34:15.433 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:34:15.434 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:34:15.435 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:34:15.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:34:15 smithi157 bash[24585]: cluster 2024-09-16T09:34:13.826603+0000 mgr.a (mgr.14373) 10257 : cluster [DBG] pgmap v7112: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:34:15.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:34:15 smithi086 bash[24289]: cluster 2024-09-16T09:34:13.826603+0000 mgr.a (mgr.14373) 10257 : cluster [DBG] pgmap v7112: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:34:15.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:34:15 smithi047 bash[22744]: cluster 2024-09-16T09:34:13.826603+0000 mgr.a (mgr.14373) 10257 : cluster [DBG] pgmap v7112: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:34:16.215 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:34:16.215 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:34:16.215 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:34:16.216 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:34:16.216 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:34:17.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:34:17 smithi157 bash[24585]: audit 2024-09-16T09:34:15.770980+0000 mgr.a (mgr.14373) 10258 : audit [DBG] from='client.226278 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:34:17.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:34:17 smithi157 bash[24585]: cluster 2024-09-16T09:34:15.827622+0000 mgr.a (mgr.14373) 10259 : cluster [DBG] pgmap v7113: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:34:17.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:34:17 smithi086 bash[24289]: audit 2024-09-16T09:34:15.770980+0000 mgr.a (mgr.14373) 10258 : audit [DBG] from='client.226278 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:34:17.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:34:17 smithi086 bash[24289]: cluster 2024-09-16T09:34:15.827622+0000 mgr.a (mgr.14373) 10259 : cluster [DBG] pgmap v7113: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:34:17.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:34:17 smithi047 bash[22744]: audit 2024-09-16T09:34:15.770980+0000 mgr.a (mgr.14373) 10258 : audit [DBG] from='client.226278 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:34:17.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:34:17 smithi047 bash[22744]: cluster 2024-09-16T09:34:15.827622+0000 mgr.a (mgr.14373) 10259 : cluster [DBG] pgmap v7113: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:34:19.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:34:19 smithi157 bash[24585]: cluster 2024-09-16T09:34:17.830010+0000 mgr.a (mgr.14373) 10260 : cluster [DBG] pgmap v7114: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:34:19.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:34:19 smithi086 bash[24289]: cluster 2024-09-16T09:34:17.830010+0000 mgr.a (mgr.14373) 10260 : cluster [DBG] pgmap v7114: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:34:19.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:34:19 smithi047 bash[22744]: cluster 2024-09-16T09:34:17.830010+0000 mgr.a (mgr.14373) 10260 : cluster [DBG] pgmap v7114: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:34:21.217 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:34:21.218 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:34:21.218 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:34:21.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:34:21 smithi157 bash[24585]: cluster 2024-09-16T09:34:19.830802+0000 mgr.a (mgr.14373) 10261 : cluster [DBG] pgmap v7115: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:34:21.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:34:21 smithi086 bash[24289]: cluster 2024-09-16T09:34:19.830802+0000 mgr.a (mgr.14373) 10261 : cluster [DBG] pgmap v7115: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:34:21.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:34:21 smithi047 bash[22744]: cluster 2024-09-16T09:34:19.830802+0000 mgr.a (mgr.14373) 10261 : cluster [DBG] pgmap v7115: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:34:22.007 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:34:22.007 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:34:22.008 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:34:22.008 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:34:22.008 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:34:22.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:34:22 smithi157 bash[24585]: audit 2024-09-16T09:34:21.555041+0000 mgr.a (mgr.14373) 10262 : audit [DBG] from='client.226356 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:34:22.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:34:22 smithi086 bash[24289]: audit 2024-09-16T09:34:21.555041+0000 mgr.a (mgr.14373) 10262 : audit [DBG] from='client.226356 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:34:22.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:34:22 smithi047 bash[22744]: audit 2024-09-16T09:34:21.555041+0000 mgr.a (mgr.14373) 10262 : audit [DBG] from='client.226356 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:34:23.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:34:23 smithi157 bash[24585]: cluster 2024-09-16T09:34:21.832159+0000 mgr.a (mgr.14373) 10263 : cluster [DBG] pgmap v7116: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:34:23.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:34:23 smithi086 bash[24289]: cluster 2024-09-16T09:34:21.832159+0000 mgr.a (mgr.14373) 10263 : cluster [DBG] pgmap v7116: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:34:23.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:34:23 smithi047 bash[22744]: cluster 2024-09-16T09:34:21.832159+0000 mgr.a (mgr.14373) 10263 : cluster [DBG] pgmap v7116: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:34:25.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:34:25 smithi157 bash[24585]: cluster 2024-09-16T09:34:23.833031+0000 mgr.a (mgr.14373) 10264 : cluster [DBG] pgmap v7117: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:34:25.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:34:25 smithi086 bash[24289]: cluster 2024-09-16T09:34:23.833031+0000 mgr.a (mgr.14373) 10264 : cluster [DBG] pgmap v7117: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:34:25.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:34:25 smithi047 bash[22744]: cluster 2024-09-16T09:34:23.833031+0000 mgr.a (mgr.14373) 10264 : cluster [DBG] pgmap v7117: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:34:27.009 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:34:27.010 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:34:27.010 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:34:27.787 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:34:27.787 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:34:27.787 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:34:27.787 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:34:27.787 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:34:27.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:34:27 smithi157 bash[24585]: cluster 2024-09-16T09:34:25.833818+0000 mgr.a (mgr.14373) 10265 : cluster [DBG] pgmap v7118: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T09:34:27.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:34:27 smithi086 bash[24289]: cluster 2024-09-16T09:34:25.833818+0000 mgr.a (mgr.14373) 10265 : cluster [DBG] pgmap v7118: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T09:34:27.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:34:27 smithi047 bash[22744]: cluster 2024-09-16T09:34:25.833818+0000 mgr.a (mgr.14373) 10265 : cluster [DBG] pgmap v7118: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T09:34:28.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:34:28 smithi157 bash[24585]: audit 2024-09-16T09:34:27.342215+0000 mgr.a (mgr.14373) 10266 : audit [DBG] from='client.226431 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:34:28.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:34:28 smithi086 bash[24289]: audit 2024-09-16T09:34:27.342215+0000 mgr.a (mgr.14373) 10266 : audit [DBG] from='client.226431 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:34:28.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:34:28 smithi047 bash[22744]: audit 2024-09-16T09:34:27.342215+0000 mgr.a (mgr.14373) 10266 : audit [DBG] from='client.226431 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:34:29.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:34:29 smithi157 bash[24585]: cluster 2024-09-16T09:34:27.835058+0000 mgr.a (mgr.14373) 10267 : cluster [DBG] pgmap v7119: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:34:29.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:34:29 smithi086 bash[24289]: cluster 2024-09-16T09:34:27.835058+0000 mgr.a (mgr.14373) 10267 : cluster [DBG] pgmap v7119: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:34:29.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:34:29 smithi047 bash[22744]: cluster 2024-09-16T09:34:27.835058+0000 mgr.a (mgr.14373) 10267 : cluster [DBG] pgmap v7119: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:34:31.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:34:31 smithi157 bash[24585]: cluster 2024-09-16T09:34:29.835781+0000 mgr.a (mgr.14373) 10268 : cluster [DBG] pgmap v7120: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T09:34:31.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:34:31 smithi086 bash[24289]: cluster 2024-09-16T09:34:29.835781+0000 mgr.a (mgr.14373) 10268 : cluster [DBG] pgmap v7120: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T09:34:31.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:34:31 smithi047 bash[22744]: cluster 2024-09-16T09:34:29.835781+0000 mgr.a (mgr.14373) 10268 : cluster [DBG] pgmap v7120: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T09:34:32.788 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:34:32.789 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:34:32.789 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:34:33.555 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:34:33.555 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:34:33.555 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:34:33.555 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:34:33.555 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:34:33.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:34:33 smithi157 bash[24585]: cluster 2024-09-16T09:34:31.838056+0000 mgr.a (mgr.14373) 10269 : cluster [DBG] pgmap v7121: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:34:33.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:34:33 smithi086 bash[24289]: cluster 2024-09-16T09:34:31.838056+0000 mgr.a (mgr.14373) 10269 : cluster [DBG] pgmap v7121: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:34:33.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:34:33 smithi047 bash[22744]: cluster 2024-09-16T09:34:31.838056+0000 mgr.a (mgr.14373) 10269 : cluster [DBG] pgmap v7121: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:34:34.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:34:34 smithi157 bash[24585]: audit 2024-09-16T09:34:33.117521+0000 mgr.a (mgr.14373) 10270 : audit [DBG] from='client.226506 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:34:34.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:34:34 smithi086 bash[24289]: audit 2024-09-16T09:34:33.117521+0000 mgr.a (mgr.14373) 10270 : audit [DBG] from='client.226506 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:34:34.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:34:34 smithi047 bash[22744]: audit 2024-09-16T09:34:33.117521+0000 mgr.a (mgr.14373) 10270 : audit [DBG] from='client.226506 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:34:35.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:34:35 smithi157 bash[24585]: cluster 2024-09-16T09:34:33.839157+0000 mgr.a (mgr.14373) 10271 : cluster [DBG] pgmap v7122: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:34:35.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:34:35 smithi086 bash[24289]: cluster 2024-09-16T09:34:33.839157+0000 mgr.a (mgr.14373) 10271 : cluster [DBG] pgmap v7122: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:34:35.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:34:35 smithi047 bash[22744]: cluster 2024-09-16T09:34:33.839157+0000 mgr.a (mgr.14373) 10271 : cluster [DBG] pgmap v7122: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:34:37.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:34:37 smithi157 bash[24585]: cluster 2024-09-16T09:34:35.840109+0000 mgr.a (mgr.14373) 10272 : cluster [DBG] pgmap v7123: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:34:37.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:34:37 smithi086 bash[24289]: cluster 2024-09-16T09:34:35.840109+0000 mgr.a (mgr.14373) 10272 : cluster [DBG] pgmap v7123: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:34:37.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:34:37 smithi047 bash[22744]: cluster 2024-09-16T09:34:35.840109+0000 mgr.a (mgr.14373) 10272 : cluster [DBG] pgmap v7123: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:34:38.556 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:34:38.557 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:34:38.558 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:34:39.297 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:34:39.297 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:34:39.297 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:34:39.297 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:34:39.297 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:34:39.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:34:39 smithi157 bash[24585]: cluster 2024-09-16T09:34:37.842504+0000 mgr.a (mgr.14373) 10273 : cluster [DBG] pgmap v7124: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:34:39.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:34:39 smithi086 bash[24289]: cluster 2024-09-16T09:34:37.842504+0000 mgr.a (mgr.14373) 10273 : cluster [DBG] pgmap v7124: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:34:39.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:34:39 smithi047 bash[22744]: cluster 2024-09-16T09:34:37.842504+0000 mgr.a (mgr.14373) 10273 : cluster [DBG] pgmap v7124: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:34:40.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:34:40 smithi157 bash[24585]: audit 2024-09-16T09:34:38.887314+0000 mgr.a (mgr.14373) 10274 : audit [DBG] from='client.226584 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:34:40.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:34:40 smithi086 bash[24289]: audit 2024-09-16T09:34:38.887314+0000 mgr.a (mgr.14373) 10274 : audit [DBG] from='client.226584 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:34:40.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:34:40 smithi047 bash[22744]: audit 2024-09-16T09:34:38.887314+0000 mgr.a (mgr.14373) 10274 : audit [DBG] from='client.226584 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:34:41.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:34:41 smithi157 bash[24585]: cluster 2024-09-16T09:34:39.843433+0000 mgr.a (mgr.14373) 10275 : cluster [DBG] pgmap v7125: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:34:41.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:34:41 smithi086 bash[24289]: cluster 2024-09-16T09:34:39.843433+0000 mgr.a (mgr.14373) 10275 : cluster [DBG] pgmap v7125: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:34:41.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:34:41 smithi047 bash[22744]: cluster 2024-09-16T09:34:39.843433+0000 mgr.a (mgr.14373) 10275 : cluster [DBG] pgmap v7125: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:34:43.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:34:43 smithi157 bash[24585]: cluster 2024-09-16T09:34:41.845795+0000 mgr.a (mgr.14373) 10276 : cluster [DBG] pgmap v7126: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:34:43.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:34:43 smithi086 bash[24289]: cluster 2024-09-16T09:34:41.845795+0000 mgr.a (mgr.14373) 10276 : cluster [DBG] pgmap v7126: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:34:43.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:34:43 smithi047 bash[22744]: cluster 2024-09-16T09:34:41.845795+0000 mgr.a (mgr.14373) 10276 : cluster [DBG] pgmap v7126: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:34:44.298 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:34:44.299 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:34:44.299 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:34:45.054 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:34:45.054 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:34:45.054 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:34:45.054 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:34:45.054 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:34:45.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:34:45 smithi157 bash[24585]: cluster 2024-09-16T09:34:43.846638+0000 mgr.a (mgr.14373) 10277 : cluster [DBG] pgmap v7127: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:34:45.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:34:45 smithi086 bash[24289]: cluster 2024-09-16T09:34:43.846638+0000 mgr.a (mgr.14373) 10277 : cluster [DBG] pgmap v7127: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:34:45.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:34:45 smithi047 bash[22744]: cluster 2024-09-16T09:34:43.846638+0000 mgr.a (mgr.14373) 10277 : cluster [DBG] pgmap v7127: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:34:46.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:34:46 smithi157 bash[24585]: audit 2024-09-16T09:34:44.635060+0000 mgr.a (mgr.14373) 10278 : audit [DBG] from='client.226662 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:34:46.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:34:46 smithi086 bash[24289]: audit 2024-09-16T09:34:44.635060+0000 mgr.a (mgr.14373) 10278 : audit [DBG] from='client.226662 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:34:46.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:34:46 smithi047 bash[22744]: audit 2024-09-16T09:34:44.635060+0000 mgr.a (mgr.14373) 10278 : audit [DBG] from='client.226662 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:34:47.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:34:47 smithi157 bash[24585]: cluster 2024-09-16T09:34:45.847713+0000 mgr.a (mgr.14373) 10279 : cluster [DBG] pgmap v7128: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:34:47.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:34:47 smithi086 bash[24289]: cluster 2024-09-16T09:34:45.847713+0000 mgr.a (mgr.14373) 10279 : cluster [DBG] pgmap v7128: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:34:47.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:34:47 smithi047 bash[22744]: cluster 2024-09-16T09:34:45.847713+0000 mgr.a (mgr.14373) 10279 : cluster [DBG] pgmap v7128: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:34:49.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:34:49 smithi157 bash[24585]: cluster 2024-09-16T09:34:47.850106+0000 mgr.a (mgr.14373) 10280 : cluster [DBG] pgmap v7129: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:34:49.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:34:49 smithi086 bash[24289]: cluster 2024-09-16T09:34:47.850106+0000 mgr.a (mgr.14373) 10280 : cluster [DBG] pgmap v7129: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:34:49.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:34:49 smithi047 bash[22744]: cluster 2024-09-16T09:34:47.850106+0000 mgr.a (mgr.14373) 10280 : cluster [DBG] pgmap v7129: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:34:50.055 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:34:50.056 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:34:50.056 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:34:50.805 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:34:50.805 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:34:50.805 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:34:50.805 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:34:50.805 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:34:51.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:34:51 smithi157 bash[24585]: cluster 2024-09-16T09:34:49.851060+0000 mgr.a (mgr.14373) 10281 : cluster [DBG] pgmap v7130: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:34:51.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:34:51 smithi157 bash[24585]: audit 2024-09-16T09:34:50.382365+0000 mgr.a (mgr.14373) 10282 : audit [DBG] from='client.226737 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:34:51.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:34:51 smithi086 bash[24289]: cluster 2024-09-16T09:34:49.851060+0000 mgr.a (mgr.14373) 10281 : cluster [DBG] pgmap v7130: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:34:51.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:34:51 smithi086 bash[24289]: audit 2024-09-16T09:34:50.382365+0000 mgr.a (mgr.14373) 10282 : audit [DBG] from='client.226737 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:34:51.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:34:51 smithi047 bash[22744]: cluster 2024-09-16T09:34:49.851060+0000 mgr.a (mgr.14373) 10281 : cluster [DBG] pgmap v7130: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:34:51.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:34:51 smithi047 bash[22744]: audit 2024-09-16T09:34:50.382365+0000 mgr.a (mgr.14373) 10282 : audit [DBG] from='client.226737 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:34:53.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:34:53 smithi157 bash[24585]: cluster 2024-09-16T09:34:51.853625+0000 mgr.a (mgr.14373) 10283 : cluster [DBG] pgmap v7131: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:34:53.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:34:53 smithi086 bash[24289]: cluster 2024-09-16T09:34:51.853625+0000 mgr.a (mgr.14373) 10283 : cluster [DBG] pgmap v7131: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:34:53.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:34:53 smithi047 bash[22744]: cluster 2024-09-16T09:34:51.853625+0000 mgr.a (mgr.14373) 10283 : cluster [DBG] pgmap v7131: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:34:55.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:34:55 smithi157 bash[24585]: cluster 2024-09-16T09:34:53.854445+0000 mgr.a (mgr.14373) 10284 : cluster [DBG] pgmap v7132: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:34:55.807 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:34:55.807 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:34:55.807 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:34:55.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:34:55 smithi086 bash[24289]: cluster 2024-09-16T09:34:53.854445+0000 mgr.a (mgr.14373) 10284 : cluster [DBG] pgmap v7132: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:34:55.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:34:55 smithi047 bash[22744]: cluster 2024-09-16T09:34:53.854445+0000 mgr.a (mgr.14373) 10284 : cluster [DBG] pgmap v7132: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:34:56.599 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:34:56.600 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:34:56.600 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:34:56.600 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:34:56.600 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:34:57.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:34:57 smithi157 bash[24585]: cluster 2024-09-16T09:34:55.855178+0000 mgr.a (mgr.14373) 10285 : cluster [DBG] pgmap v7133: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:34:57.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:34:57 smithi157 bash[24585]: audit 2024-09-16T09:34:56.143883+0000 mgr.a (mgr.14373) 10286 : audit [DBG] from='client.226812 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:34:57.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:34:57 smithi086 bash[24289]: cluster 2024-09-16T09:34:55.855178+0000 mgr.a (mgr.14373) 10285 : cluster [DBG] pgmap v7133: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:34:57.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:34:57 smithi086 bash[24289]: audit 2024-09-16T09:34:56.143883+0000 mgr.a (mgr.14373) 10286 : audit [DBG] from='client.226812 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:34:57.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:34:57 smithi047 bash[22744]: cluster 2024-09-16T09:34:55.855178+0000 mgr.a (mgr.14373) 10285 : cluster [DBG] pgmap v7133: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:34:57.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:34:57 smithi047 bash[22744]: audit 2024-09-16T09:34:56.143883+0000 mgr.a (mgr.14373) 10286 : audit [DBG] from='client.226812 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:34:59.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:34:59 smithi157 bash[24585]: cluster 2024-09-16T09:34:57.857608+0000 mgr.a (mgr.14373) 10287 : cluster [DBG] pgmap v7134: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-16T09:34:59.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:34:59 smithi086 bash[24289]: cluster 2024-09-16T09:34:57.857608+0000 mgr.a (mgr.14373) 10287 : cluster [DBG] pgmap v7134: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-16T09:34:59.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:34:59 smithi047 bash[22744]: cluster 2024-09-16T09:34:57.857608+0000 mgr.a (mgr.14373) 10287 : cluster [DBG] pgmap v7134: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-16T09:35:01.601 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:35:01.602 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:35:01.602 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:35:01.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:35:01 smithi157 bash[24585]: cluster 2024-09-16T09:34:59.858439+0000 mgr.a (mgr.14373) 10288 : cluster [DBG] pgmap v7135: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T09:35:01.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:35:01 smithi086 bash[24289]: cluster 2024-09-16T09:34:59.858439+0000 mgr.a (mgr.14373) 10288 : cluster [DBG] pgmap v7135: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T09:35:01.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:35:01 smithi047 bash[22744]: cluster 2024-09-16T09:34:59.858439+0000 mgr.a (mgr.14373) 10288 : cluster [DBG] pgmap v7135: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T09:35:02.384 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:35:02.384 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:35:02.385 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:35:02.385 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:35:02.385 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:35:03.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:35:03 smithi157 bash[24585]: cluster 2024-09-16T09:35:01.860347+0000 mgr.a (mgr.14373) 10289 : cluster [DBG] pgmap v7136: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:35:03.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:35:03 smithi157 bash[24585]: audit 2024-09-16T09:35:01.933416+0000 mgr.a (mgr.14373) 10290 : audit [DBG] from='client.226887 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:35:03.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:35:03 smithi157 bash[24585]: audit 2024-09-16T09:35:02.960927+0000 mon.b (mon.2) 954 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T09:35:03.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:35:03 smithi086 bash[24289]: cluster 2024-09-16T09:35:01.860347+0000 mgr.a (mgr.14373) 10289 : cluster [DBG] pgmap v7136: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:35:03.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:35:03 smithi086 bash[24289]: audit 2024-09-16T09:35:01.933416+0000 mgr.a (mgr.14373) 10290 : audit [DBG] from='client.226887 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:35:03.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:35:03 smithi086 bash[24289]: audit 2024-09-16T09:35:02.960927+0000 mon.b (mon.2) 954 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T09:35:03.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:35:03 smithi047 bash[22744]: cluster 2024-09-16T09:35:01.860347+0000 mgr.a (mgr.14373) 10289 : cluster [DBG] pgmap v7136: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:35:03.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:35:03 smithi047 bash[22744]: audit 2024-09-16T09:35:01.933416+0000 mgr.a (mgr.14373) 10290 : audit [DBG] from='client.226887 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:35:03.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:35:03 smithi047 bash[22744]: audit 2024-09-16T09:35:02.960927+0000 mon.b (mon.2) 954 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T09:35:04.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:35:04 smithi047 bash[22744]: audit 2024-09-16T09:35:03.569514+0000 mon.a (mon.0) 1178 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:35:04.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:35:04 smithi047 bash[22744]: audit 2024-09-16T09:35:03.575282+0000 mon.a (mon.0) 1179 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:35:04.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:35:04 smithi047 bash[22744]: audit 2024-09-16T09:35:03.578860+0000 mon.a (mon.0) 1180 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:35:04.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:35:04 smithi047 bash[22744]: audit 2024-09-16T09:35:03.583240+0000 mon.a (mon.0) 1181 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:35:04.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:35:04 smithi047 bash[22744]: audit 2024-09-16T09:35:04.386282+0000 mon.b (mon.2) 955 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:35:04.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:35:04 smithi047 bash[22744]: audit 2024-09-16T09:35:04.388383+0000 mon.b (mon.2) 956 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T09:35:04.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:35:04 smithi047 bash[22744]: audit 2024-09-16T09:35:04.399260+0000 mon.a (mon.0) 1182 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:35:04.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:35:04 smithi047 bash[22744]: audit 2024-09-16T09:35:04.405435+0000 mon.b (mon.2) 957 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:35:05.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:35:04 smithi157 bash[24585]: audit 2024-09-16T09:35:03.569514+0000 mon.a (mon.0) 1178 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:35:05.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:35:04 smithi157 bash[24585]: audit 2024-09-16T09:35:03.575282+0000 mon.a (mon.0) 1179 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:35:05.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:35:04 smithi157 bash[24585]: audit 2024-09-16T09:35:03.578860+0000 mon.a (mon.0) 1180 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:35:05.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:35:04 smithi157 bash[24585]: audit 2024-09-16T09:35:03.583240+0000 mon.a (mon.0) 1181 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:35:05.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:35:04 smithi157 bash[24585]: audit 2024-09-16T09:35:04.386282+0000 mon.b (mon.2) 955 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:35:05.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:35:04 smithi157 bash[24585]: audit 2024-09-16T09:35:04.388383+0000 mon.b (mon.2) 956 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T09:35:05.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:35:04 smithi157 bash[24585]: audit 2024-09-16T09:35:04.399260+0000 mon.a (mon.0) 1182 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:35:05.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:35:04 smithi157 bash[24585]: audit 2024-09-16T09:35:04.405435+0000 mon.b (mon.2) 957 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:35:05.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:35:04 smithi086 bash[24289]: audit 2024-09-16T09:35:03.569514+0000 mon.a (mon.0) 1178 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:35:05.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:35:04 smithi086 bash[24289]: audit 2024-09-16T09:35:03.575282+0000 mon.a (mon.0) 1179 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:35:05.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:35:04 smithi086 bash[24289]: audit 2024-09-16T09:35:03.578860+0000 mon.a (mon.0) 1180 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:35:05.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:35:04 smithi086 bash[24289]: audit 2024-09-16T09:35:03.583240+0000 mon.a (mon.0) 1181 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:35:05.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:35:04 smithi086 bash[24289]: audit 2024-09-16T09:35:04.386282+0000 mon.b (mon.2) 955 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:35:05.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:35:04 smithi086 bash[24289]: audit 2024-09-16T09:35:04.388383+0000 mon.b (mon.2) 956 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T09:35:05.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:35:04 smithi086 bash[24289]: audit 2024-09-16T09:35:04.399260+0000 mon.a (mon.0) 1182 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:35:05.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:35:04 smithi086 bash[24289]: audit 2024-09-16T09:35:04.405435+0000 mon.b (mon.2) 957 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:35:05.586 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 09:35:05 smithi047 bash[22994]: debug 2024-09-16T09:35:05.138+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T09:35:05.587 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 09:35:05 smithi047 bash[22994]: debug 2024-09-16T09:35:05.138+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T09:35:05.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:35:05 smithi047 bash[22744]: cluster 2024-09-16T09:35:03.861181+0000 mgr.a (mgr.14373) 10291 : cluster [DBG] pgmap v7137: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:35:05.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:35:05 smithi047 bash[22744]: audit 2024-09-16T09:35:04.406962+0000 mgr.a (mgr.14373) 10292 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:35:06.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:35:05 smithi157 bash[24585]: cluster 2024-09-16T09:35:03.861181+0000 mgr.a (mgr.14373) 10291 : cluster [DBG] pgmap v7137: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:35:06.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:35:05 smithi157 bash[24585]: audit 2024-09-16T09:35:04.406962+0000 mgr.a (mgr.14373) 10292 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:35:06.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:35:05 smithi086 bash[24289]: cluster 2024-09-16T09:35:03.861181+0000 mgr.a (mgr.14373) 10291 : cluster [DBG] pgmap v7137: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:35:06.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:35:05 smithi086 bash[24289]: audit 2024-09-16T09:35:04.406962+0000 mgr.a (mgr.14373) 10292 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:35:07.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:35:06 smithi157 bash[24585]: audit 2024-09-16T09:35:05.143748+0000 mgr.a (mgr.14373) 10293 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T09:35:07.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:35:06 smithi157 bash[24585]: cephadm 2024-09-16T09:35:05.145797+0000 mgr.a (mgr.14373) 10294 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T09:35:07.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:35:06 smithi157 bash[24585]: cluster 2024-09-16T09:35:05.862160+0000 mgr.a (mgr.14373) 10295 : cluster [DBG] pgmap v7138: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T09:35:07.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:35:06 smithi086 bash[24289]: audit 2024-09-16T09:35:05.143748+0000 mgr.a (mgr.14373) 10293 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T09:35:07.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:35:06 smithi086 bash[24289]: cephadm 2024-09-16T09:35:05.145797+0000 mgr.a (mgr.14373) 10294 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T09:35:07.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:35:06 smithi086 bash[24289]: cluster 2024-09-16T09:35:05.862160+0000 mgr.a (mgr.14373) 10295 : cluster [DBG] pgmap v7138: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T09:35:07.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:35:06 smithi047 bash[22744]: audit 2024-09-16T09:35:05.143748+0000 mgr.a (mgr.14373) 10293 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T09:35:07.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:35:06 smithi047 bash[22744]: cephadm 2024-09-16T09:35:05.145797+0000 mgr.a (mgr.14373) 10294 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T09:35:07.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:35:06 smithi047 bash[22744]: cluster 2024-09-16T09:35:05.862160+0000 mgr.a (mgr.14373) 10295 : cluster [DBG] pgmap v7138: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T09:35:07.386 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:35:07.387 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:35:07.387 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:35:08.157 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:35:08.157 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:35:08.157 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:35:08.157 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:35:08.157 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:35:09.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:35:08 smithi157 bash[24585]: audit 2024-09-16T09:35:07.723270+0000 mgr.a (mgr.14373) 10296 : audit [DBG] from='client.227070 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:35:09.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:35:08 smithi157 bash[24585]: cluster 2024-09-16T09:35:07.864526+0000 mgr.a (mgr.14373) 10297 : cluster [DBG] pgmap v7139: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:35:09.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:35:08 smithi086 bash[24289]: audit 2024-09-16T09:35:07.723270+0000 mgr.a (mgr.14373) 10296 : audit [DBG] from='client.227070 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:35:09.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:35:08 smithi086 bash[24289]: cluster 2024-09-16T09:35:07.864526+0000 mgr.a (mgr.14373) 10297 : cluster [DBG] pgmap v7139: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:35:09.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:35:08 smithi047 bash[22744]: audit 2024-09-16T09:35:07.723270+0000 mgr.a (mgr.14373) 10296 : audit [DBG] from='client.227070 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:35:09.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:35:08 smithi047 bash[22744]: cluster 2024-09-16T09:35:07.864526+0000 mgr.a (mgr.14373) 10297 : cluster [DBG] pgmap v7139: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:35:11.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:35:10 smithi157 bash[24585]: cluster 2024-09-16T09:35:09.865437+0000 mgr.a (mgr.14373) 10298 : cluster [DBG] pgmap v7140: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T09:35:11.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:35:10 smithi086 bash[24289]: cluster 2024-09-16T09:35:09.865437+0000 mgr.a (mgr.14373) 10298 : cluster [DBG] pgmap v7140: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T09:35:11.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:35:10 smithi047 bash[22744]: cluster 2024-09-16T09:35:09.865437+0000 mgr.a (mgr.14373) 10298 : cluster [DBG] pgmap v7140: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T09:35:13.158 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:35:13.159 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:35:13.159 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:35:13.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:35:12 smithi157 bash[24585]: cluster 2024-09-16T09:35:11.867652+0000 mgr.a (mgr.14373) 10299 : cluster [DBG] pgmap v7141: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.4 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:35:13.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:35:12 smithi086 bash[24289]: cluster 2024-09-16T09:35:11.867652+0000 mgr.a (mgr.14373) 10299 : cluster [DBG] pgmap v7141: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.4 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:35:13.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:35:12 smithi047 bash[22744]: cluster 2024-09-16T09:35:11.867652+0000 mgr.a (mgr.14373) 10299 : cluster [DBG] pgmap v7141: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.4 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:35:13.893 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:35:13.893 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:35:13.894 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:35:13.894 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:35:13.894 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:35:14.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:35:13 smithi157 bash[24585]: audit 2024-09-16T09:35:13.480810+0000 mgr.a (mgr.14373) 10300 : audit [DBG] from='client.227148 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:35:14.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:35:13 smithi086 bash[24289]: audit 2024-09-16T09:35:13.480810+0000 mgr.a (mgr.14373) 10300 : audit [DBG] from='client.227148 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:35:14.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:35:13 smithi047 bash[22744]: audit 2024-09-16T09:35:13.480810+0000 mgr.a (mgr.14373) 10300 : audit [DBG] from='client.227148 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:35:15.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:35:14 smithi157 bash[24585]: cluster 2024-09-16T09:35:13.868190+0000 mgr.a (mgr.14373) 10301 : cluster [DBG] pgmap v7142: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:35:15.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:35:14 smithi086 bash[24289]: cluster 2024-09-16T09:35:13.868190+0000 mgr.a (mgr.14373) 10301 : cluster [DBG] pgmap v7142: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:35:15.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:35:14 smithi047 bash[22744]: cluster 2024-09-16T09:35:13.868190+0000 mgr.a (mgr.14373) 10301 : cluster [DBG] pgmap v7142: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:35:17.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:35:16 smithi157 bash[24585]: cluster 2024-09-16T09:35:15.868933+0000 mgr.a (mgr.14373) 10302 : cluster [DBG] pgmap v7143: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:35:17.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:35:16 smithi086 bash[24289]: cluster 2024-09-16T09:35:15.868933+0000 mgr.a (mgr.14373) 10302 : cluster [DBG] pgmap v7143: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:35:17.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:35:16 smithi047 bash[22744]: cluster 2024-09-16T09:35:15.868933+0000 mgr.a (mgr.14373) 10302 : cluster [DBG] pgmap v7143: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:35:18.895 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:35:18.895 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:35:18.895 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:35:19.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:35:18 smithi157 bash[24585]: cluster 2024-09-16T09:35:17.871186+0000 mgr.a (mgr.14373) 10303 : cluster [DBG] pgmap v7144: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:35:19.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:35:18 smithi086 bash[24289]: cluster 2024-09-16T09:35:17.871186+0000 mgr.a (mgr.14373) 10303 : cluster [DBG] pgmap v7144: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:35:19.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:35:18 smithi047 bash[22744]: cluster 2024-09-16T09:35:17.871186+0000 mgr.a (mgr.14373) 10303 : cluster [DBG] pgmap v7144: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:35:19.662 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:35:19.663 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:35:19.663 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:35:19.663 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:35:19.663 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:35:20.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:35:19 smithi157 bash[24585]: audit 2024-09-16T09:35:19.224136+0000 mgr.a (mgr.14373) 10304 : audit [DBG] from='client.227226 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:35:20.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:35:19 smithi086 bash[24289]: audit 2024-09-16T09:35:19.224136+0000 mgr.a (mgr.14373) 10304 : audit [DBG] from='client.227226 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:35:20.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:35:19 smithi047 bash[22744]: audit 2024-09-16T09:35:19.224136+0000 mgr.a (mgr.14373) 10304 : audit [DBG] from='client.227226 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:35:21.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:35:20 smithi157 bash[24585]: cluster 2024-09-16T09:35:19.872110+0000 mgr.a (mgr.14373) 10305 : cluster [DBG] pgmap v7145: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:35:21.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:35:20 smithi086 bash[24289]: cluster 2024-09-16T09:35:19.872110+0000 mgr.a (mgr.14373) 10305 : cluster [DBG] pgmap v7145: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:35:21.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:35:20 smithi047 bash[22744]: cluster 2024-09-16T09:35:19.872110+0000 mgr.a (mgr.14373) 10305 : cluster [DBG] pgmap v7145: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:35:23.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:35:22 smithi157 bash[24585]: cluster 2024-09-16T09:35:21.874292+0000 mgr.a (mgr.14373) 10306 : cluster [DBG] pgmap v7146: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:35:23.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:35:22 smithi086 bash[24289]: cluster 2024-09-16T09:35:21.874292+0000 mgr.a (mgr.14373) 10306 : cluster [DBG] pgmap v7146: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:35:23.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:35:22 smithi047 bash[22744]: cluster 2024-09-16T09:35:21.874292+0000 mgr.a (mgr.14373) 10306 : cluster [DBG] pgmap v7146: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:35:24.664 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:35:24.665 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:35:24.665 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:35:25.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:35:24 smithi157 bash[24585]: cluster 2024-09-16T09:35:23.875054+0000 mgr.a (mgr.14373) 10307 : cluster [DBG] pgmap v7147: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:35:25.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:35:24 smithi086 bash[24289]: cluster 2024-09-16T09:35:23.875054+0000 mgr.a (mgr.14373) 10307 : cluster [DBG] pgmap v7147: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:35:25.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:35:24 smithi047 bash[22744]: cluster 2024-09-16T09:35:23.875054+0000 mgr.a (mgr.14373) 10307 : cluster [DBG] pgmap v7147: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:35:25.436 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:35:25.436 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:35:25.436 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:35:25.437 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:35:25.437 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:35:26.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:35:25 smithi157 bash[24585]: audit 2024-09-16T09:35:24.999238+0000 mgr.a (mgr.14373) 10308 : audit [DBG] from='client.227301 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:35:26.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:35:25 smithi086 bash[24289]: audit 2024-09-16T09:35:24.999238+0000 mgr.a (mgr.14373) 10308 : audit [DBG] from='client.227301 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:35:26.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:35:25 smithi047 bash[22744]: audit 2024-09-16T09:35:24.999238+0000 mgr.a (mgr.14373) 10308 : audit [DBG] from='client.227301 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:35:27.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:35:26 smithi157 bash[24585]: cluster 2024-09-16T09:35:25.875947+0000 mgr.a (mgr.14373) 10309 : cluster [DBG] pgmap v7148: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:35:27.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:35:26 smithi086 bash[24289]: cluster 2024-09-16T09:35:25.875947+0000 mgr.a (mgr.14373) 10309 : cluster [DBG] pgmap v7148: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:35:27.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:35:26 smithi047 bash[22744]: cluster 2024-09-16T09:35:25.875947+0000 mgr.a (mgr.14373) 10309 : cluster [DBG] pgmap v7148: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:35:29.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:35:28 smithi157 bash[24585]: cluster 2024-09-16T09:35:27.878129+0000 mgr.a (mgr.14373) 10310 : cluster [DBG] pgmap v7149: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:35:29.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:35:28 smithi086 bash[24289]: cluster 2024-09-16T09:35:27.878129+0000 mgr.a (mgr.14373) 10310 : cluster [DBG] pgmap v7149: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:35:29.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:35:28 smithi047 bash[22744]: cluster 2024-09-16T09:35:27.878129+0000 mgr.a (mgr.14373) 10310 : cluster [DBG] pgmap v7149: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:35:30.438 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:35:30.439 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:35:30.439 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:35:31.185 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:35:31.186 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:35:31.186 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:35:31.186 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:35:31.186 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:35:31.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:35:30 smithi157 bash[24585]: cluster 2024-09-16T09:35:29.878884+0000 mgr.a (mgr.14373) 10311 : cluster [DBG] pgmap v7150: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:35:31.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:35:30 smithi086 bash[24289]: cluster 2024-09-16T09:35:29.878884+0000 mgr.a (mgr.14373) 10311 : cluster [DBG] pgmap v7150: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:35:31.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:35:30 smithi047 bash[22744]: cluster 2024-09-16T09:35:29.878884+0000 mgr.a (mgr.14373) 10311 : cluster [DBG] pgmap v7150: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:35:32.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:35:31 smithi157 bash[24585]: audit 2024-09-16T09:35:30.765840+0000 mgr.a (mgr.14373) 10312 : audit [DBG] from='client.227376 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:35:32.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:35:31 smithi086 bash[24289]: audit 2024-09-16T09:35:30.765840+0000 mgr.a (mgr.14373) 10312 : audit [DBG] from='client.227376 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:35:32.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:35:31 smithi047 bash[22744]: audit 2024-09-16T09:35:30.765840+0000 mgr.a (mgr.14373) 10312 : audit [DBG] from='client.227376 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:35:33.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:35:32 smithi157 bash[24585]: cluster 2024-09-16T09:35:31.881186+0000 mgr.a (mgr.14373) 10313 : cluster [DBG] pgmap v7151: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:35:33.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:35:32 smithi086 bash[24289]: cluster 2024-09-16T09:35:31.881186+0000 mgr.a (mgr.14373) 10313 : cluster [DBG] pgmap v7151: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:35:33.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:35:32 smithi047 bash[22744]: cluster 2024-09-16T09:35:31.881186+0000 mgr.a (mgr.14373) 10313 : cluster [DBG] pgmap v7151: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:35:35.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:35:35 smithi157 bash[24585]: cluster 2024-09-16T09:35:33.881957+0000 mgr.a (mgr.14373) 10314 : cluster [DBG] pgmap v7152: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:35:35.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:35:35 smithi086 bash[24289]: cluster 2024-09-16T09:35:33.881957+0000 mgr.a (mgr.14373) 10314 : cluster [DBG] pgmap v7152: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:35:35.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:35:35 smithi047 bash[22744]: cluster 2024-09-16T09:35:33.881957+0000 mgr.a (mgr.14373) 10314 : cluster [DBG] pgmap v7152: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:35:36.187 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:35:36.187 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:35:36.187 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:35:36.925 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:35:36.925 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:35:36.925 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:35:36.925 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:35:36.925 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:35:37.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:35:37 smithi157 bash[24585]: cluster 2024-09-16T09:35:35.882733+0000 mgr.a (mgr.14373) 10315 : cluster [DBG] pgmap v7153: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:35:37.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:35:37 smithi157 bash[24585]: audit 2024-09-16T09:35:36.519633+0000 mgr.a (mgr.14373) 10316 : audit [DBG] from='client.227454 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:35:37.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:35:37 smithi086 bash[24289]: cluster 2024-09-16T09:35:35.882733+0000 mgr.a (mgr.14373) 10315 : cluster [DBG] pgmap v7153: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:35:37.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:35:37 smithi086 bash[24289]: audit 2024-09-16T09:35:36.519633+0000 mgr.a (mgr.14373) 10316 : audit [DBG] from='client.227454 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:35:37.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:35:37 smithi047 bash[22744]: cluster 2024-09-16T09:35:35.882733+0000 mgr.a (mgr.14373) 10315 : cluster [DBG] pgmap v7153: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:35:37.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:35:37 smithi047 bash[22744]: audit 2024-09-16T09:35:36.519633+0000 mgr.a (mgr.14373) 10316 : audit [DBG] from='client.227454 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:35:39.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:35:39 smithi157 bash[24585]: cluster 2024-09-16T09:35:37.885506+0000 mgr.a (mgr.14373) 10317 : cluster [DBG] pgmap v7154: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:35:39.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:35:39 smithi086 bash[24289]: cluster 2024-09-16T09:35:37.885506+0000 mgr.a (mgr.14373) 10317 : cluster [DBG] pgmap v7154: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:35:39.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:35:39 smithi047 bash[22744]: cluster 2024-09-16T09:35:37.885506+0000 mgr.a (mgr.14373) 10317 : cluster [DBG] pgmap v7154: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:35:41.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:35:41 smithi157 bash[24585]: cluster 2024-09-16T09:35:39.886297+0000 mgr.a (mgr.14373) 10318 : cluster [DBG] pgmap v7155: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:35:41.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:35:41 smithi086 bash[24289]: cluster 2024-09-16T09:35:39.886297+0000 mgr.a (mgr.14373) 10318 : cluster [DBG] pgmap v7155: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:35:41.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:35:41 smithi047 bash[22744]: cluster 2024-09-16T09:35:39.886297+0000 mgr.a (mgr.14373) 10318 : cluster [DBG] pgmap v7155: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:35:41.926 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:35:41.927 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:35:41.927 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:35:42.694 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:35:42.694 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:35:42.694 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:35:42.694 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:35:42.694 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:35:43.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:35:43 smithi157 bash[24585]: cluster 2024-09-16T09:35:41.888181+0000 mgr.a (mgr.14373) 10319 : cluster [DBG] pgmap v7156: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:35:43.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:35:43 smithi157 bash[24585]: audit 2024-09-16T09:35:42.256429+0000 mgr.a (mgr.14373) 10320 : audit [DBG] from='client.227532 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:35:43.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:35:43 smithi086 bash[24289]: cluster 2024-09-16T09:35:41.888181+0000 mgr.a (mgr.14373) 10319 : cluster [DBG] pgmap v7156: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:35:43.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:35:43 smithi086 bash[24289]: audit 2024-09-16T09:35:42.256429+0000 mgr.a (mgr.14373) 10320 : audit [DBG] from='client.227532 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:35:43.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:35:43 smithi047 bash[22744]: cluster 2024-09-16T09:35:41.888181+0000 mgr.a (mgr.14373) 10319 : cluster [DBG] pgmap v7156: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:35:43.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:35:43 smithi047 bash[22744]: audit 2024-09-16T09:35:42.256429+0000 mgr.a (mgr.14373) 10320 : audit [DBG] from='client.227532 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:35:45.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:35:45 smithi157 bash[24585]: cluster 2024-09-16T09:35:43.889114+0000 mgr.a (mgr.14373) 10321 : cluster [DBG] pgmap v7157: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:35:45.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:35:45 smithi086 bash[24289]: cluster 2024-09-16T09:35:43.889114+0000 mgr.a (mgr.14373) 10321 : cluster [DBG] pgmap v7157: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:35:45.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:35:45 smithi047 bash[22744]: cluster 2024-09-16T09:35:43.889114+0000 mgr.a (mgr.14373) 10321 : cluster [DBG] pgmap v7157: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:35:47.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:35:47 smithi157 bash[24585]: cluster 2024-09-16T09:35:45.890071+0000 mgr.a (mgr.14373) 10322 : cluster [DBG] pgmap v7158: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T09:35:47.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:35:47 smithi086 bash[24289]: cluster 2024-09-16T09:35:45.890071+0000 mgr.a (mgr.14373) 10322 : cluster [DBG] pgmap v7158: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T09:35:47.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:35:47 smithi047 bash[22744]: cluster 2024-09-16T09:35:45.890071+0000 mgr.a (mgr.14373) 10322 : cluster [DBG] pgmap v7158: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T09:35:47.695 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:35:47.696 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:35:47.696 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:35:48.454 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:35:48.454 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:35:48.454 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:35:48.454 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:35:48.455 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:35:49.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:35:49 smithi157 bash[24585]: cluster 2024-09-16T09:35:47.892363+0000 mgr.a (mgr.14373) 10323 : cluster [DBG] pgmap v7159: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:35:49.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:35:49 smithi157 bash[24585]: audit 2024-09-16T09:35:48.022846+0000 mgr.a (mgr.14373) 10324 : audit [DBG] from='client.227610 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:35:49.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:35:49 smithi086 bash[24289]: cluster 2024-09-16T09:35:47.892363+0000 mgr.a (mgr.14373) 10323 : cluster [DBG] pgmap v7159: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:35:49.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:35:49 smithi086 bash[24289]: audit 2024-09-16T09:35:48.022846+0000 mgr.a (mgr.14373) 10324 : audit [DBG] from='client.227610 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:35:49.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:35:49 smithi047 bash[22744]: cluster 2024-09-16T09:35:47.892363+0000 mgr.a (mgr.14373) 10323 : cluster [DBG] pgmap v7159: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:35:49.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:35:49 smithi047 bash[22744]: audit 2024-09-16T09:35:48.022846+0000 mgr.a (mgr.14373) 10324 : audit [DBG] from='client.227610 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:35:51.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:35:51 smithi157 bash[24585]: cluster 2024-09-16T09:35:49.893316+0000 mgr.a (mgr.14373) 10325 : cluster [DBG] pgmap v7160: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:35:51.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:35:51 smithi086 bash[24289]: cluster 2024-09-16T09:35:49.893316+0000 mgr.a (mgr.14373) 10325 : cluster [DBG] pgmap v7160: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:35:51.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:35:51 smithi047 bash[22744]: cluster 2024-09-16T09:35:49.893316+0000 mgr.a (mgr.14373) 10325 : cluster [DBG] pgmap v7160: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:35:53.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:35:53 smithi157 bash[24585]: cluster 2024-09-16T09:35:51.895494+0000 mgr.a (mgr.14373) 10326 : cluster [DBG] pgmap v7161: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:35:53.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:35:53 smithi086 bash[24289]: cluster 2024-09-16T09:35:51.895494+0000 mgr.a (mgr.14373) 10326 : cluster [DBG] pgmap v7161: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:35:53.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:35:53 smithi047 bash[22744]: cluster 2024-09-16T09:35:51.895494+0000 mgr.a (mgr.14373) 10326 : cluster [DBG] pgmap v7161: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:35:53.456 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:35:53.456 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:35:53.457 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:35:54.234 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:35:54.234 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:35:54.234 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:35:54.234 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:35:54.235 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:35:55.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:35:55 smithi157 bash[24585]: audit 2024-09-16T09:35:53.791598+0000 mgr.a (mgr.14373) 10327 : audit [DBG] from='client.227688 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:35:55.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:35:55 smithi157 bash[24585]: cluster 2024-09-16T09:35:53.895974+0000 mgr.a (mgr.14373) 10328 : cluster [DBG] pgmap v7162: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:35:55.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:35:55 smithi086 bash[24289]: audit 2024-09-16T09:35:53.791598+0000 mgr.a (mgr.14373) 10327 : audit [DBG] from='client.227688 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:35:55.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:35:55 smithi086 bash[24289]: cluster 2024-09-16T09:35:53.895974+0000 mgr.a (mgr.14373) 10328 : cluster [DBG] pgmap v7162: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:35:55.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:35:55 smithi047 bash[22744]: audit 2024-09-16T09:35:53.791598+0000 mgr.a (mgr.14373) 10327 : audit [DBG] from='client.227688 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:35:55.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:35:55 smithi047 bash[22744]: cluster 2024-09-16T09:35:53.895974+0000 mgr.a (mgr.14373) 10328 : cluster [DBG] pgmap v7162: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:35:57.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:35:57 smithi157 bash[24585]: cluster 2024-09-16T09:35:55.896971+0000 mgr.a (mgr.14373) 10329 : cluster [DBG] pgmap v7163: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:35:57.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:35:57 smithi086 bash[24289]: cluster 2024-09-16T09:35:55.896971+0000 mgr.a (mgr.14373) 10329 : cluster [DBG] pgmap v7163: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:35:57.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:35:57 smithi047 bash[22744]: cluster 2024-09-16T09:35:55.896971+0000 mgr.a (mgr.14373) 10329 : cluster [DBG] pgmap v7163: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:35:59.236 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:35:59.237 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:35:59.237 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:35:59.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:35:59 smithi157 bash[24585]: cluster 2024-09-16T09:35:57.899405+0000 mgr.a (mgr.14373) 10330 : cluster [DBG] pgmap v7164: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:35:59.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:35:59 smithi086 bash[24289]: cluster 2024-09-16T09:35:57.899405+0000 mgr.a (mgr.14373) 10330 : cluster [DBG] pgmap v7164: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:35:59.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:35:59 smithi047 bash[22744]: cluster 2024-09-16T09:35:57.899405+0000 mgr.a (mgr.14373) 10330 : cluster [DBG] pgmap v7164: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:36:00.017 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:36:00.017 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:36:00.017 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:36:00.018 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:36:00.018 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:36:00.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:36:00 smithi086 bash[24289]: audit 2024-09-16T09:35:59.572598+0000 mgr.a (mgr.14373) 10331 : audit [DBG] from='client.227766 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:36:00.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:36:00 smithi047 bash[22744]: audit 2024-09-16T09:35:59.572598+0000 mgr.a (mgr.14373) 10331 : audit [DBG] from='client.227766 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:36:00.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:36:00 smithi157 bash[24585]: audit 2024-09-16T09:35:59.572598+0000 mgr.a (mgr.14373) 10331 : audit [DBG] from='client.227766 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:36:01.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:36:01 smithi086 bash[24289]: cluster 2024-09-16T09:35:59.899956+0000 mgr.a (mgr.14373) 10332 : cluster [DBG] pgmap v7165: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:36:01.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:36:01 smithi047 bash[22744]: cluster 2024-09-16T09:35:59.899956+0000 mgr.a (mgr.14373) 10332 : cluster [DBG] pgmap v7165: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:36:01.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:36:01 smithi157 bash[24585]: cluster 2024-09-16T09:35:59.899956+0000 mgr.a (mgr.14373) 10332 : cluster [DBG] pgmap v7165: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:36:03.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:36:03 smithi086 bash[24289]: cluster 2024-09-16T09:36:01.902289+0000 mgr.a (mgr.14373) 10333 : cluster [DBG] pgmap v7166: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:36:03.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:36:03 smithi047 bash[22744]: cluster 2024-09-16T09:36:01.902289+0000 mgr.a (mgr.14373) 10333 : cluster [DBG] pgmap v7166: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:36:03.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:36:03 smithi157 bash[24585]: cluster 2024-09-16T09:36:01.902289+0000 mgr.a (mgr.14373) 10333 : cluster [DBG] pgmap v7166: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:36:05.019 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:36:05.019 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:36:05.019 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:36:05.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:36:05 smithi047 bash[22744]: cluster 2024-09-16T09:36:03.903242+0000 mgr.a (mgr.14373) 10334 : cluster [DBG] pgmap v7167: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:36:05.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:36:05 smithi157 bash[24585]: cluster 2024-09-16T09:36:03.903242+0000 mgr.a (mgr.14373) 10334 : cluster [DBG] pgmap v7167: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:36:05.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:36:05 smithi086 bash[24289]: cluster 2024-09-16T09:36:03.903242+0000 mgr.a (mgr.14373) 10334 : cluster [DBG] pgmap v7167: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:36:05.809 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:36:05.810 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:36:05.810 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:36:05.810 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:36:05.810 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:36:06.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:36:06 smithi047 bash[22744]: audit 2024-09-16T09:36:05.201219+0000 mon.b (mon.2) 958 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T09:36:06.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:36:06 smithi047 bash[22744]: audit 2024-09-16T09:36:05.377870+0000 mgr.a (mgr.14373) 10335 : audit [DBG] from='client.227841 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:36:06.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:36:06 smithi047 bash[22744]: audit 2024-09-16T09:36:05.983806+0000 mon.b (mon.2) 959 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:36:06.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:36:06 smithi047 bash[22744]: audit 2024-09-16T09:36:05.985745+0000 mon.b (mon.2) 960 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T09:36:06.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:36:06 smithi047 bash[22744]: audit 2024-09-16T09:36:05.995844+0000 mon.a (mon.0) 1183 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:36:06.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:36:06 smithi047 bash[22744]: audit 2024-09-16T09:36:06.003065+0000 mon.b (mon.2) 961 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:36:06.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:36:06 smithi157 bash[24585]: audit 2024-09-16T09:36:05.201219+0000 mon.b (mon.2) 958 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T09:36:06.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:36:06 smithi157 bash[24585]: audit 2024-09-16T09:36:05.377870+0000 mgr.a (mgr.14373) 10335 : audit [DBG] from='client.227841 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:36:06.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:36:06 smithi157 bash[24585]: audit 2024-09-16T09:36:05.983806+0000 mon.b (mon.2) 959 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:36:06.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:36:06 smithi157 bash[24585]: audit 2024-09-16T09:36:05.985745+0000 mon.b (mon.2) 960 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T09:36:06.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:36:06 smithi157 bash[24585]: audit 2024-09-16T09:36:05.995844+0000 mon.a (mon.0) 1183 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:36:06.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:36:06 smithi157 bash[24585]: audit 2024-09-16T09:36:06.003065+0000 mon.b (mon.2) 961 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:36:06.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:36:06 smithi086 bash[24289]: audit 2024-09-16T09:36:05.201219+0000 mon.b (mon.2) 958 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T09:36:06.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:36:06 smithi086 bash[24289]: audit 2024-09-16T09:36:05.377870+0000 mgr.a (mgr.14373) 10335 : audit [DBG] from='client.227841 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:36:06.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:36:06 smithi086 bash[24289]: audit 2024-09-16T09:36:05.983806+0000 mon.b (mon.2) 959 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:36:06.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:36:06 smithi086 bash[24289]: audit 2024-09-16T09:36:05.985745+0000 mon.b (mon.2) 960 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T09:36:06.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:36:06 smithi086 bash[24289]: audit 2024-09-16T09:36:05.995844+0000 mon.a (mon.0) 1183 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:36:06.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:36:06 smithi086 bash[24289]: audit 2024-09-16T09:36:06.003065+0000 mon.b (mon.2) 961 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:36:07.079 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 09:36:06 smithi047 bash[22994]: debug 2024-09-16T09:36:06.721+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T09:36:07.079 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 09:36:06 smithi047 bash[22994]: debug 2024-09-16T09:36:06.721+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T09:36:07.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:36:07 smithi047 bash[22744]: cluster 2024-09-16T09:36:05.904177+0000 mgr.a (mgr.14373) 10336 : cluster [DBG] pgmap v7168: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:36:07.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:36:07 smithi047 bash[22744]: audit 2024-09-16T09:36:06.003628+0000 mgr.a (mgr.14373) 10337 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:36:07.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:36:07 smithi157 bash[24585]: cluster 2024-09-16T09:36:05.904177+0000 mgr.a (mgr.14373) 10336 : cluster [DBG] pgmap v7168: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:36:07.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:36:07 smithi157 bash[24585]: audit 2024-09-16T09:36:06.003628+0000 mgr.a (mgr.14373) 10337 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:36:07.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:36:07 smithi086 bash[24289]: cluster 2024-09-16T09:36:05.904177+0000 mgr.a (mgr.14373) 10336 : cluster [DBG] pgmap v7168: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:36:07.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:36:07 smithi086 bash[24289]: audit 2024-09-16T09:36:06.003628+0000 mgr.a (mgr.14373) 10337 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:36:08.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:36:08 smithi047 bash[22744]: audit 2024-09-16T09:36:06.723243+0000 mgr.a (mgr.14373) 10338 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T09:36:08.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:36:08 smithi047 bash[22744]: cephadm 2024-09-16T09:36:06.725386+0000 mgr.a (mgr.14373) 10339 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T09:36:08.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:36:08 smithi157 bash[24585]: audit 2024-09-16T09:36:06.723243+0000 mgr.a (mgr.14373) 10338 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T09:36:08.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:36:08 smithi157 bash[24585]: cephadm 2024-09-16T09:36:06.725386+0000 mgr.a (mgr.14373) 10339 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T09:36:08.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:36:08 smithi086 bash[24289]: audit 2024-09-16T09:36:06.723243+0000 mgr.a (mgr.14373) 10338 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T09:36:08.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:36:08 smithi086 bash[24289]: cephadm 2024-09-16T09:36:06.725386+0000 mgr.a (mgr.14373) 10339 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T09:36:09.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:36:09 smithi047 bash[22744]: cluster 2024-09-16T09:36:07.906557+0000 mgr.a (mgr.14373) 10340 : cluster [DBG] pgmap v7169: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 4.8 KiB/s rd, 255 B/s wr, 4 op/s 2024-09-16T09:36:09.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:36:09 smithi157 bash[24585]: cluster 2024-09-16T09:36:07.906557+0000 mgr.a (mgr.14373) 10340 : cluster [DBG] pgmap v7169: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 4.8 KiB/s rd, 255 B/s wr, 4 op/s 2024-09-16T09:36:09.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:36:09 smithi086 bash[24289]: cluster 2024-09-16T09:36:07.906557+0000 mgr.a (mgr.14373) 10340 : cluster [DBG] pgmap v7169: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 4.8 KiB/s rd, 255 B/s wr, 4 op/s 2024-09-16T09:36:10.811 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:36:10.812 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:36:10.812 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:36:11.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:36:11 smithi157 bash[24585]: cluster 2024-09-16T09:36:09.907326+0000 mgr.a (mgr.14373) 10341 : cluster [DBG] pgmap v7170: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 3.9 KiB/s rd, 255 B/s wr, 4 op/s 2024-09-16T09:36:11.559 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:36:11.560 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:36:11.560 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:36:11.560 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:36:11.560 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:36:11.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:36:11 smithi086 bash[24289]: cluster 2024-09-16T09:36:09.907326+0000 mgr.a (mgr.14373) 10341 : cluster [DBG] pgmap v7170: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 3.9 KiB/s rd, 255 B/s wr, 4 op/s 2024-09-16T09:36:11.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:36:11 smithi047 bash[22744]: cluster 2024-09-16T09:36:09.907326+0000 mgr.a (mgr.14373) 10341 : cluster [DBG] pgmap v7170: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 3.9 KiB/s rd, 255 B/s wr, 4 op/s 2024-09-16T09:36:12.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:36:12 smithi157 bash[24585]: audit 2024-09-16T09:36:11.143969+0000 mgr.a (mgr.14373) 10342 : audit [DBG] from='client.228021 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:36:12.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:36:12 smithi086 bash[24289]: audit 2024-09-16T09:36:11.143969+0000 mgr.a (mgr.14373) 10342 : audit [DBG] from='client.228021 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:36:12.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:36:12 smithi047 bash[22744]: audit 2024-09-16T09:36:11.143969+0000 mgr.a (mgr.14373) 10342 : audit [DBG] from='client.228021 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:36:13.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:36:13 smithi157 bash[24585]: cluster 2024-09-16T09:36:11.909740+0000 mgr.a (mgr.14373) 10343 : cluster [DBG] pgmap v7171: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:36:13.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:36:13 smithi086 bash[24289]: cluster 2024-09-16T09:36:11.909740+0000 mgr.a (mgr.14373) 10343 : cluster [DBG] pgmap v7171: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:36:13.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:36:13 smithi047 bash[22744]: cluster 2024-09-16T09:36:11.909740+0000 mgr.a (mgr.14373) 10343 : cluster [DBG] pgmap v7171: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:36:15.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:36:15 smithi157 bash[24585]: cluster 2024-09-16T09:36:13.910526+0000 mgr.a (mgr.14373) 10344 : cluster [DBG] pgmap v7172: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:36:15.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:36:15 smithi086 bash[24289]: cluster 2024-09-16T09:36:13.910526+0000 mgr.a (mgr.14373) 10344 : cluster [DBG] pgmap v7172: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:36:15.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:36:15 smithi047 bash[22744]: cluster 2024-09-16T09:36:13.910526+0000 mgr.a (mgr.14373) 10344 : cluster [DBG] pgmap v7172: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:36:16.561 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:36:16.562 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:36:16.562 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:36:17.344 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:36:17.344 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:36:17.344 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:36:17.344 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:36:17.345 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:36:17.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:36:17 smithi157 bash[24585]: cluster 2024-09-16T09:36:15.911312+0000 mgr.a (mgr.14373) 10345 : cluster [DBG] pgmap v7173: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:36:17.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:36:17 smithi086 bash[24289]: cluster 2024-09-16T09:36:15.911312+0000 mgr.a (mgr.14373) 10345 : cluster [DBG] pgmap v7173: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:36:17.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:36:17 smithi047 bash[22744]: cluster 2024-09-16T09:36:15.911312+0000 mgr.a (mgr.14373) 10345 : cluster [DBG] pgmap v7173: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:36:18.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:36:18 smithi157 bash[24585]: audit 2024-09-16T09:36:16.893956+0000 mgr.a (mgr.14373) 10346 : audit [DBG] from='client.228099 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:36:18.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:36:18 smithi086 bash[24289]: audit 2024-09-16T09:36:16.893956+0000 mgr.a (mgr.14373) 10346 : audit [DBG] from='client.228099 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:36:18.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:36:18 smithi047 bash[22744]: audit 2024-09-16T09:36:16.893956+0000 mgr.a (mgr.14373) 10346 : audit [DBG] from='client.228099 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:36:19.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:36:19 smithi157 bash[24585]: cluster 2024-09-16T09:36:17.914256+0000 mgr.a (mgr.14373) 10347 : cluster [DBG] pgmap v7174: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:36:19.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:36:19 smithi086 bash[24289]: cluster 2024-09-16T09:36:17.914256+0000 mgr.a (mgr.14373) 10347 : cluster [DBG] pgmap v7174: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:36:19.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:36:19 smithi047 bash[22744]: cluster 2024-09-16T09:36:17.914256+0000 mgr.a (mgr.14373) 10347 : cluster [DBG] pgmap v7174: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:36:21.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:36:21 smithi157 bash[24585]: cluster 2024-09-16T09:36:19.915078+0000 mgr.a (mgr.14373) 10348 : cluster [DBG] pgmap v7175: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 4.0 KiB/s rd, 170 B/s wr, 3 op/s 2024-09-16T09:36:21.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:36:21 smithi086 bash[24289]: cluster 2024-09-16T09:36:19.915078+0000 mgr.a (mgr.14373) 10348 : cluster [DBG] pgmap v7175: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 4.0 KiB/s rd, 170 B/s wr, 3 op/s 2024-09-16T09:36:21.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:36:21 smithi047 bash[22744]: cluster 2024-09-16T09:36:19.915078+0000 mgr.a (mgr.14373) 10348 : cluster [DBG] pgmap v7175: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 4.0 KiB/s rd, 170 B/s wr, 3 op/s 2024-09-16T09:36:22.346 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:36:22.347 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:36:22.347 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:36:23.142 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:36:23.142 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:36:23.142 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:36:23.143 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:36:23.143 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:36:23.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:36:23 smithi157 bash[24585]: cluster 2024-09-16T09:36:21.916999+0000 mgr.a (mgr.14373) 10349 : cluster [DBG] pgmap v7176: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 4.9 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-16T09:36:23.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:36:23 smithi086 bash[24289]: cluster 2024-09-16T09:36:21.916999+0000 mgr.a (mgr.14373) 10349 : cluster [DBG] pgmap v7176: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 4.9 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-16T09:36:23.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:36:23 smithi047 bash[22744]: cluster 2024-09-16T09:36:21.916999+0000 mgr.a (mgr.14373) 10349 : cluster [DBG] pgmap v7176: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 4.9 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-16T09:36:24.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:36:24 smithi157 bash[24585]: audit 2024-09-16T09:36:22.685004+0000 mgr.a (mgr.14373) 10350 : audit [DBG] from='client.228177 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:36:24.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:36:24 smithi086 bash[24289]: audit 2024-09-16T09:36:22.685004+0000 mgr.a (mgr.14373) 10350 : audit [DBG] from='client.228177 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:36:24.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:36:24 smithi047 bash[22744]: audit 2024-09-16T09:36:22.685004+0000 mgr.a (mgr.14373) 10350 : audit [DBG] from='client.228177 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:36:25.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:36:25 smithi157 bash[24585]: cluster 2024-09-16T09:36:23.917891+0000 mgr.a (mgr.14373) 10351 : cluster [DBG] pgmap v7177: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:36:25.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:36:25 smithi086 bash[24289]: cluster 2024-09-16T09:36:23.917891+0000 mgr.a (mgr.14373) 10351 : cluster [DBG] pgmap v7177: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:36:25.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:36:25 smithi047 bash[22744]: cluster 2024-09-16T09:36:23.917891+0000 mgr.a (mgr.14373) 10351 : cluster [DBG] pgmap v7177: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:36:27.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:36:27 smithi157 bash[24585]: cluster 2024-09-16T09:36:25.918695+0000 mgr.a (mgr.14373) 10352 : cluster [DBG] pgmap v7178: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T09:36:27.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:36:27 smithi086 bash[24289]: cluster 2024-09-16T09:36:25.918695+0000 mgr.a (mgr.14373) 10352 : cluster [DBG] pgmap v7178: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T09:36:27.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:36:27 smithi047 bash[22744]: cluster 2024-09-16T09:36:25.918695+0000 mgr.a (mgr.14373) 10352 : cluster [DBG] pgmap v7178: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T09:36:28.143 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:36:28.144 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:36:28.145 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:36:28.889 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:36:28.889 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:36:28.889 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:36:28.889 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:36:28.890 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:36:29.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:36:29 smithi157 bash[24585]: cluster 2024-09-16T09:36:27.921017+0000 mgr.a (mgr.14373) 10353 : cluster [DBG] pgmap v7179: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:36:29.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:36:29 smithi157 bash[24585]: audit 2024-09-16T09:36:28.473246+0000 mgr.a (mgr.14373) 10354 : audit [DBG] from='client.228255 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:36:29.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:36:29 smithi086 bash[24289]: cluster 2024-09-16T09:36:27.921017+0000 mgr.a (mgr.14373) 10353 : cluster [DBG] pgmap v7179: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:36:29.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:36:29 smithi086 bash[24289]: audit 2024-09-16T09:36:28.473246+0000 mgr.a (mgr.14373) 10354 : audit [DBG] from='client.228255 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:36:29.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:36:29 smithi047 bash[22744]: cluster 2024-09-16T09:36:27.921017+0000 mgr.a (mgr.14373) 10353 : cluster [DBG] pgmap v7179: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:36:29.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:36:29 smithi047 bash[22744]: audit 2024-09-16T09:36:28.473246+0000 mgr.a (mgr.14373) 10354 : audit [DBG] from='client.228255 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:36:31.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:36:31 smithi157 bash[24585]: cluster 2024-09-16T09:36:29.921953+0000 mgr.a (mgr.14373) 10355 : cluster [DBG] pgmap v7180: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:36:31.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:36:31 smithi086 bash[24289]: cluster 2024-09-16T09:36:29.921953+0000 mgr.a (mgr.14373) 10355 : cluster [DBG] pgmap v7180: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:36:31.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:36:31 smithi047 bash[22744]: cluster 2024-09-16T09:36:29.921953+0000 mgr.a (mgr.14373) 10355 : cluster [DBG] pgmap v7180: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:36:33.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:36:33 smithi157 bash[24585]: cluster 2024-09-16T09:36:31.924148+0000 mgr.a (mgr.14373) 10356 : cluster [DBG] pgmap v7181: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:36:33.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:36:33 smithi086 bash[24289]: cluster 2024-09-16T09:36:31.924148+0000 mgr.a (mgr.14373) 10356 : cluster [DBG] pgmap v7181: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:36:33.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:36:33 smithi047 bash[22744]: cluster 2024-09-16T09:36:31.924148+0000 mgr.a (mgr.14373) 10356 : cluster [DBG] pgmap v7181: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:36:33.891 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:36:33.892 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:36:33.892 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:36:34.666 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:36:34.667 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:36:34.667 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:36:34.667 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:36:34.667 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:36:35.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:36:35 smithi157 bash[24585]: cluster 2024-09-16T09:36:33.924745+0000 mgr.a (mgr.14373) 10357 : cluster [DBG] pgmap v7182: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:36:35.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:36:35 smithi157 bash[24585]: audit 2024-09-16T09:36:34.223705+0000 mgr.a (mgr.14373) 10358 : audit [DBG] from='client.228330 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:36:35.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:36:35 smithi086 bash[24289]: cluster 2024-09-16T09:36:33.924745+0000 mgr.a (mgr.14373) 10357 : cluster [DBG] pgmap v7182: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:36:35.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:36:35 smithi086 bash[24289]: audit 2024-09-16T09:36:34.223705+0000 mgr.a (mgr.14373) 10358 : audit [DBG] from='client.228330 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:36:35.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:36:35 smithi047 bash[22744]: cluster 2024-09-16T09:36:33.924745+0000 mgr.a (mgr.14373) 10357 : cluster [DBG] pgmap v7182: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:36:35.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:36:35 smithi047 bash[22744]: audit 2024-09-16T09:36:34.223705+0000 mgr.a (mgr.14373) 10358 : audit [DBG] from='client.228330 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:36:37.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:36:37 smithi157 bash[24585]: cluster 2024-09-16T09:36:35.925638+0000 mgr.a (mgr.14373) 10359 : cluster [DBG] pgmap v7183: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:36:37.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:36:37 smithi086 bash[24289]: cluster 2024-09-16T09:36:35.925638+0000 mgr.a (mgr.14373) 10359 : cluster [DBG] pgmap v7183: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:36:37.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:36:37 smithi047 bash[22744]: cluster 2024-09-16T09:36:35.925638+0000 mgr.a (mgr.14373) 10359 : cluster [DBG] pgmap v7183: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:36:39.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:36:39 smithi157 bash[24585]: cluster 2024-09-16T09:36:37.927897+0000 mgr.a (mgr.14373) 10360 : cluster [DBG] pgmap v7184: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:36:39.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:36:39 smithi086 bash[24289]: cluster 2024-09-16T09:36:37.927897+0000 mgr.a (mgr.14373) 10360 : cluster [DBG] pgmap v7184: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:36:39.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:36:39 smithi047 bash[22744]: cluster 2024-09-16T09:36:37.927897+0000 mgr.a (mgr.14373) 10360 : cluster [DBG] pgmap v7184: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:36:39.668 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:36:39.669 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:36:39.669 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:36:40.442 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:36:40.442 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:36:40.442 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:36:40.442 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:36:40.443 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:36:41.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:36:41 smithi157 bash[24585]: cluster 2024-09-16T09:36:39.928663+0000 mgr.a (mgr.14373) 10361 : cluster [DBG] pgmap v7185: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:36:41.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:36:41 smithi157 bash[24585]: audit 2024-09-16T09:36:40.004900+0000 mgr.a (mgr.14373) 10362 : audit [DBG] from='client.228405 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:36:41.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:36:41 smithi086 bash[24289]: cluster 2024-09-16T09:36:39.928663+0000 mgr.a (mgr.14373) 10361 : cluster [DBG] pgmap v7185: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:36:41.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:36:41 smithi086 bash[24289]: audit 2024-09-16T09:36:40.004900+0000 mgr.a (mgr.14373) 10362 : audit [DBG] from='client.228405 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:36:41.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:36:41 smithi047 bash[22744]: cluster 2024-09-16T09:36:39.928663+0000 mgr.a (mgr.14373) 10361 : cluster [DBG] pgmap v7185: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:36:41.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:36:41 smithi047 bash[22744]: audit 2024-09-16T09:36:40.004900+0000 mgr.a (mgr.14373) 10362 : audit [DBG] from='client.228405 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:36:43.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:36:43 smithi157 bash[24585]: cluster 2024-09-16T09:36:41.930951+0000 mgr.a (mgr.14373) 10363 : cluster [DBG] pgmap v7186: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:36:43.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:36:43 smithi086 bash[24289]: cluster 2024-09-16T09:36:41.930951+0000 mgr.a (mgr.14373) 10363 : cluster [DBG] pgmap v7186: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:36:43.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:36:43 smithi047 bash[22744]: cluster 2024-09-16T09:36:41.930951+0000 mgr.a (mgr.14373) 10363 : cluster [DBG] pgmap v7186: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:36:45.444 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:36:45.444 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:36:45.444 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:36:45.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:36:45 smithi157 bash[24585]: cluster 2024-09-16T09:36:43.931757+0000 mgr.a (mgr.14373) 10364 : cluster [DBG] pgmap v7187: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:36:45.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:36:45 smithi086 bash[24289]: cluster 2024-09-16T09:36:43.931757+0000 mgr.a (mgr.14373) 10364 : cluster [DBG] pgmap v7187: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:36:45.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:36:45 smithi047 bash[22744]: cluster 2024-09-16T09:36:43.931757+0000 mgr.a (mgr.14373) 10364 : cluster [DBG] pgmap v7187: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:36:46.249 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:36:46.249 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:36:46.249 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:36:46.249 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:36:46.249 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:36:47.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:36:47 smithi157 bash[24585]: audit 2024-09-16T09:36:45.789233+0000 mgr.a (mgr.14373) 10365 : audit [DBG] from='client.228483 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:36:47.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:36:47 smithi157 bash[24585]: cluster 2024-09-16T09:36:45.938850+0000 mgr.a (mgr.14373) 10366 : cluster [DBG] pgmap v7188: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:36:47.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:36:47 smithi086 bash[24289]: audit 2024-09-16T09:36:45.789233+0000 mgr.a (mgr.14373) 10365 : audit [DBG] from='client.228483 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:36:47.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:36:47 smithi086 bash[24289]: cluster 2024-09-16T09:36:45.938850+0000 mgr.a (mgr.14373) 10366 : cluster [DBG] pgmap v7188: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:36:47.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:36:47 smithi047 bash[22744]: audit 2024-09-16T09:36:45.789233+0000 mgr.a (mgr.14373) 10365 : audit [DBG] from='client.228483 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:36:47.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:36:47 smithi047 bash[22744]: cluster 2024-09-16T09:36:45.938850+0000 mgr.a (mgr.14373) 10366 : cluster [DBG] pgmap v7188: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:36:49.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:36:49 smithi157 bash[24585]: cluster 2024-09-16T09:36:47.941175+0000 mgr.a (mgr.14373) 10367 : cluster [DBG] pgmap v7189: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:36:49.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:36:49 smithi086 bash[24289]: cluster 2024-09-16T09:36:47.941175+0000 mgr.a (mgr.14373) 10367 : cluster [DBG] pgmap v7189: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:36:49.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:36:49 smithi047 bash[22744]: cluster 2024-09-16T09:36:47.941175+0000 mgr.a (mgr.14373) 10367 : cluster [DBG] pgmap v7189: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:36:51.250 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:36:51.251 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:36:51.251 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:36:51.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:36:51 smithi157 bash[24585]: cluster 2024-09-16T09:36:49.941937+0000 mgr.a (mgr.14373) 10368 : cluster [DBG] pgmap v7190: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:36:51.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:36:51 smithi086 bash[24289]: cluster 2024-09-16T09:36:49.941937+0000 mgr.a (mgr.14373) 10368 : cluster [DBG] pgmap v7190: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:36:51.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:36:51 smithi047 bash[22744]: cluster 2024-09-16T09:36:49.941937+0000 mgr.a (mgr.14373) 10368 : cluster [DBG] pgmap v7190: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:36:52.006 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:36:52.007 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:36:52.007 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:36:52.007 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:36:52.007 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:36:52.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:36:52 smithi157 bash[24585]: audit 2024-09-16T09:36:51.584997+0000 mgr.a (mgr.14373) 10369 : audit [DBG] from='client.228555 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:36:52.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:36:52 smithi086 bash[24289]: audit 2024-09-16T09:36:51.584997+0000 mgr.a (mgr.14373) 10369 : audit [DBG] from='client.228555 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:36:52.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:36:52 smithi047 bash[22744]: audit 2024-09-16T09:36:51.584997+0000 mgr.a (mgr.14373) 10369 : audit [DBG] from='client.228555 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:36:53.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:36:53 smithi157 bash[24585]: cluster 2024-09-16T09:36:51.943502+0000 mgr.a (mgr.14373) 10370 : cluster [DBG] pgmap v7191: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:36:53.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:36:53 smithi086 bash[24289]: cluster 2024-09-16T09:36:51.943502+0000 mgr.a (mgr.14373) 10370 : cluster [DBG] pgmap v7191: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:36:53.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:36:53 smithi047 bash[22744]: cluster 2024-09-16T09:36:51.943502+0000 mgr.a (mgr.14373) 10370 : cluster [DBG] pgmap v7191: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:36:55.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:36:55 smithi157 bash[24585]: cluster 2024-09-16T09:36:53.944325+0000 mgr.a (mgr.14373) 10371 : cluster [DBG] pgmap v7192: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:36:55.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:36:55 smithi086 bash[24289]: cluster 2024-09-16T09:36:53.944325+0000 mgr.a (mgr.14373) 10371 : cluster [DBG] pgmap v7192: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:36:55.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:36:55 smithi047 bash[22744]: cluster 2024-09-16T09:36:53.944325+0000 mgr.a (mgr.14373) 10371 : cluster [DBG] pgmap v7192: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:36:57.008 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:36:57.009 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:36:57.009 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:36:57.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:36:57 smithi157 bash[24585]: cluster 2024-09-16T09:36:55.945075+0000 mgr.a (mgr.14373) 10372 : cluster [DBG] pgmap v7193: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:36:57.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:36:57 smithi086 bash[24289]: cluster 2024-09-16T09:36:55.945075+0000 mgr.a (mgr.14373) 10372 : cluster [DBG] pgmap v7193: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:36:57.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:36:57 smithi047 bash[22744]: cluster 2024-09-16T09:36:55.945075+0000 mgr.a (mgr.14373) 10372 : cluster [DBG] pgmap v7193: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:36:57.784 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:36:57.784 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:36:57.784 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:36:57.785 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:36:57.785 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:36:58.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:36:58 smithi157 bash[24585]: audit 2024-09-16T09:36:57.340684+0000 mgr.a (mgr.14373) 10373 : audit [DBG] from='client.228633 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:36:58.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:36:58 smithi086 bash[24289]: audit 2024-09-16T09:36:57.340684+0000 mgr.a (mgr.14373) 10373 : audit [DBG] from='client.228633 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:36:58.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:36:58 smithi047 bash[22744]: audit 2024-09-16T09:36:57.340684+0000 mgr.a (mgr.14373) 10373 : audit [DBG] from='client.228633 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:36:59.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:36:59 smithi157 bash[24585]: cluster 2024-09-16T09:36:57.947919+0000 mgr.a (mgr.14373) 10374 : cluster [DBG] pgmap v7194: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:36:59.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:36:59 smithi086 bash[24289]: cluster 2024-09-16T09:36:57.947919+0000 mgr.a (mgr.14373) 10374 : cluster [DBG] pgmap v7194: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:36:59.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:36:59 smithi047 bash[22744]: cluster 2024-09-16T09:36:57.947919+0000 mgr.a (mgr.14373) 10374 : cluster [DBG] pgmap v7194: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:37:01.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:37:01 smithi157 bash[24585]: cluster 2024-09-16T09:36:59.948729+0000 mgr.a (mgr.14373) 10375 : cluster [DBG] pgmap v7195: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:37:01.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:37:01 smithi086 bash[24289]: cluster 2024-09-16T09:36:59.948729+0000 mgr.a (mgr.14373) 10375 : cluster [DBG] pgmap v7195: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:37:01.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:37:01 smithi047 bash[22744]: cluster 2024-09-16T09:36:59.948729+0000 mgr.a (mgr.14373) 10375 : cluster [DBG] pgmap v7195: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:37:02.786 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:37:02.787 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:37:02.787 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:37:03.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:37:03 smithi157 bash[24585]: cluster 2024-09-16T09:37:01.950723+0000 mgr.a (mgr.14373) 10376 : cluster [DBG] pgmap v7196: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:37:03.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:37:03 smithi086 bash[24289]: cluster 2024-09-16T09:37:01.950723+0000 mgr.a (mgr.14373) 10376 : cluster [DBG] pgmap v7196: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:37:03.570 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:37:03.570 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:37:03.571 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:37:03.571 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:37:03.571 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:37:03.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:37:03 smithi047 bash[22744]: cluster 2024-09-16T09:37:01.950723+0000 mgr.a (mgr.14373) 10376 : cluster [DBG] pgmap v7196: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:37:04.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:37:04 smithi157 bash[24585]: audit 2024-09-16T09:37:03.124437+0000 mgr.a (mgr.14373) 10377 : audit [DBG] from='client.228708 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:37:04.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:37:04 smithi086 bash[24289]: audit 2024-09-16T09:37:03.124437+0000 mgr.a (mgr.14373) 10377 : audit [DBG] from='client.228708 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:37:04.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:37:04 smithi047 bash[22744]: audit 2024-09-16T09:37:03.124437+0000 mgr.a (mgr.14373) 10377 : audit [DBG] from='client.228708 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:37:05.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:37:05 smithi157 bash[24585]: cluster 2024-09-16T09:37:03.951615+0000 mgr.a (mgr.14373) 10378 : cluster [DBG] pgmap v7197: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:37:05.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:37:05 smithi086 bash[24289]: cluster 2024-09-16T09:37:03.951615+0000 mgr.a (mgr.14373) 10378 : cluster [DBG] pgmap v7197: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:37:05.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:37:05 smithi047 bash[22744]: cluster 2024-09-16T09:37:03.951615+0000 mgr.a (mgr.14373) 10378 : cluster [DBG] pgmap v7197: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:37:07.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:37:07 smithi157 bash[24585]: cluster 2024-09-16T09:37:05.952394+0000 mgr.a (mgr.14373) 10379 : cluster [DBG] pgmap v7198: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:37:07.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:37:07 smithi157 bash[24585]: audit 2024-09-16T09:37:06.776536+0000 mon.b (mon.2) 962 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T09:37:07.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:37:07 smithi086 bash[24289]: cluster 2024-09-16T09:37:05.952394+0000 mgr.a (mgr.14373) 10379 : cluster [DBG] pgmap v7198: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:37:07.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:37:07 smithi086 bash[24289]: audit 2024-09-16T09:37:06.776536+0000 mon.b (mon.2) 962 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T09:37:07.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:37:07 smithi047 bash[22744]: cluster 2024-09-16T09:37:05.952394+0000 mgr.a (mgr.14373) 10379 : cluster [DBG] pgmap v7198: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:37:07.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:37:07 smithi047 bash[22744]: audit 2024-09-16T09:37:06.776536+0000 mon.b (mon.2) 962 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T09:37:08.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:37:08 smithi157 bash[24585]: audit 2024-09-16T09:37:07.622068+0000 mon.b (mon.2) 963 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:37:08.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:37:08 smithi157 bash[24585]: audit 2024-09-16T09:37:07.624064+0000 mon.b (mon.2) 964 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T09:37:08.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:37:08 smithi157 bash[24585]: audit 2024-09-16T09:37:07.634729+0000 mon.a (mon.0) 1184 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:37:08.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:37:08 smithi157 bash[24585]: audit 2024-09-16T09:37:07.640849+0000 mon.b (mon.2) 965 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:37:08.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:37:08 smithi086 bash[24289]: audit 2024-09-16T09:37:07.622068+0000 mon.b (mon.2) 963 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:37:08.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:37:08 smithi086 bash[24289]: audit 2024-09-16T09:37:07.624064+0000 mon.b (mon.2) 964 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T09:37:08.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:37:08 smithi086 bash[24289]: audit 2024-09-16T09:37:07.634729+0000 mon.a (mon.0) 1184 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:37:08.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:37:08 smithi086 bash[24289]: audit 2024-09-16T09:37:07.640849+0000 mon.b (mon.2) 965 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:37:08.572 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:37:08.573 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:37:08.573 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:37:08.592 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 09:37:08 smithi047 bash[22994]: debug 2024-09-16T09:37:08.372+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T09:37:08.592 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 09:37:08 smithi047 bash[22994]: debug 2024-09-16T09:37:08.372+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T09:37:08.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:37:08 smithi047 bash[22744]: audit 2024-09-16T09:37:07.622068+0000 mon.b (mon.2) 963 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:37:08.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:37:08 smithi047 bash[22744]: audit 2024-09-16T09:37:07.624064+0000 mon.b (mon.2) 964 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T09:37:08.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:37:08 smithi047 bash[22744]: audit 2024-09-16T09:37:07.634729+0000 mon.a (mon.0) 1184 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:37:08.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:37:08 smithi047 bash[22744]: audit 2024-09-16T09:37:07.640849+0000 mon.b (mon.2) 965 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:37:09.314 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:37:09.314 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:37:09.314 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:37:09.314 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:37:09.314 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:37:09.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:37:09 smithi157 bash[24585]: audit 2024-09-16T09:37:07.642408+0000 mgr.a (mgr.14373) 10380 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:37:09.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:37:09 smithi157 bash[24585]: cluster 2024-09-16T09:37:07.953653+0000 mgr.a (mgr.14373) 10381 : cluster [DBG] pgmap v7199: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:37:09.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:37:09 smithi157 bash[24585]: audit 2024-09-16T09:37:08.375028+0000 mgr.a (mgr.14373) 10382 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T09:37:09.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:37:09 smithi157 bash[24585]: cephadm 2024-09-16T09:37:08.376835+0000 mgr.a (mgr.14373) 10383 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T09:37:09.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:37:09 smithi086 bash[24289]: audit 2024-09-16T09:37:07.642408+0000 mgr.a (mgr.14373) 10380 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:37:09.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:37:09 smithi086 bash[24289]: cluster 2024-09-16T09:37:07.953653+0000 mgr.a (mgr.14373) 10381 : cluster [DBG] pgmap v7199: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:37:09.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:37:09 smithi086 bash[24289]: audit 2024-09-16T09:37:08.375028+0000 mgr.a (mgr.14373) 10382 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T09:37:09.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:37:09 smithi086 bash[24289]: cephadm 2024-09-16T09:37:08.376835+0000 mgr.a (mgr.14373) 10383 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T09:37:09.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:37:09 smithi047 bash[22744]: audit 2024-09-16T09:37:07.642408+0000 mgr.a (mgr.14373) 10380 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:37:09.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:37:09 smithi047 bash[22744]: cluster 2024-09-16T09:37:07.953653+0000 mgr.a (mgr.14373) 10381 : cluster [DBG] pgmap v7199: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:37:09.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:37:09 smithi047 bash[22744]: audit 2024-09-16T09:37:08.375028+0000 mgr.a (mgr.14373) 10382 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T09:37:09.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:37:09 smithi047 bash[22744]: cephadm 2024-09-16T09:37:08.376835+0000 mgr.a (mgr.14373) 10383 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T09:37:10.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:37:10 smithi157 bash[24585]: audit 2024-09-16T09:37:08.896543+0000 mgr.a (mgr.14373) 10384 : audit [DBG] from='client.228891 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:37:10.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:37:10 smithi086 bash[24289]: audit 2024-09-16T09:37:08.896543+0000 mgr.a (mgr.14373) 10384 : audit [DBG] from='client.228891 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:37:10.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:37:10 smithi047 bash[22744]: audit 2024-09-16T09:37:08.896543+0000 mgr.a (mgr.14373) 10384 : audit [DBG] from='client.228891 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:37:11.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:37:11 smithi157 bash[24585]: cluster 2024-09-16T09:37:09.954522+0000 mgr.a (mgr.14373) 10385 : cluster [DBG] pgmap v7200: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:37:11.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:37:11 smithi086 bash[24289]: cluster 2024-09-16T09:37:09.954522+0000 mgr.a (mgr.14373) 10385 : cluster [DBG] pgmap v7200: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:37:11.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:37:11 smithi047 bash[22744]: cluster 2024-09-16T09:37:09.954522+0000 mgr.a (mgr.14373) 10385 : cluster [DBG] pgmap v7200: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:37:13.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:37:13 smithi157 bash[24585]: cluster 2024-09-16T09:37:11.956710+0000 mgr.a (mgr.14373) 10386 : cluster [DBG] pgmap v7201: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:37:13.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:37:13 smithi086 bash[24289]: cluster 2024-09-16T09:37:11.956710+0000 mgr.a (mgr.14373) 10386 : cluster [DBG] pgmap v7201: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:37:13.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:37:13 smithi047 bash[22744]: cluster 2024-09-16T09:37:11.956710+0000 mgr.a (mgr.14373) 10386 : cluster [DBG] pgmap v7201: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:37:14.315 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:37:14.316 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:37:14.316 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:37:15.098 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:37:15.098 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:37:15.098 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:37:15.098 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:37:15.098 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:37:15.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:37:15 smithi157 bash[24585]: cluster 2024-09-16T09:37:13.957443+0000 mgr.a (mgr.14373) 10387 : cluster [DBG] pgmap v7202: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:37:15.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:37:15 smithi086 bash[24289]: cluster 2024-09-16T09:37:13.957443+0000 mgr.a (mgr.14373) 10387 : cluster [DBG] pgmap v7202: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:37:15.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:37:15 smithi047 bash[22744]: cluster 2024-09-16T09:37:13.957443+0000 mgr.a (mgr.14373) 10387 : cluster [DBG] pgmap v7202: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:37:16.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:37:16 smithi157 bash[24585]: audit 2024-09-16T09:37:14.653583+0000 mgr.a (mgr.14373) 10388 : audit [DBG] from='client.228969 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:37:16.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:37:16 smithi086 bash[24289]: audit 2024-09-16T09:37:14.653583+0000 mgr.a (mgr.14373) 10388 : audit [DBG] from='client.228969 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:37:16.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:37:16 smithi047 bash[22744]: audit 2024-09-16T09:37:14.653583+0000 mgr.a (mgr.14373) 10388 : audit [DBG] from='client.228969 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:37:17.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:37:17 smithi157 bash[24585]: cluster 2024-09-16T09:37:15.958319+0000 mgr.a (mgr.14373) 10389 : cluster [DBG] pgmap v7203: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:37:17.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:37:17 smithi086 bash[24289]: cluster 2024-09-16T09:37:15.958319+0000 mgr.a (mgr.14373) 10389 : cluster [DBG] pgmap v7203: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:37:17.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:37:17 smithi047 bash[22744]: cluster 2024-09-16T09:37:15.958319+0000 mgr.a (mgr.14373) 10389 : cluster [DBG] pgmap v7203: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:37:19.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:37:19 smithi157 bash[24585]: cluster 2024-09-16T09:37:17.960546+0000 mgr.a (mgr.14373) 10390 : cluster [DBG] pgmap v7204: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:37:19.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:37:19 smithi086 bash[24289]: cluster 2024-09-16T09:37:17.960546+0000 mgr.a (mgr.14373) 10390 : cluster [DBG] pgmap v7204: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:37:19.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:37:19 smithi047 bash[22744]: cluster 2024-09-16T09:37:17.960546+0000 mgr.a (mgr.14373) 10390 : cluster [DBG] pgmap v7204: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:37:20.099 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:37:20.100 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:37:20.100 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:37:20.856 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:37:20.856 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:37:20.856 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:37:20.856 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:37:20.856 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:37:21.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:37:21 smithi157 bash[24585]: cluster 2024-09-16T09:37:19.961293+0000 mgr.a (mgr.14373) 10391 : cluster [DBG] pgmap v7205: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:37:21.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:37:21 smithi157 bash[24585]: audit 2024-09-16T09:37:20.428529+0000 mgr.a (mgr.14373) 10392 : audit [DBG] from='client.229044 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:37:21.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:37:21 smithi086 bash[24289]: cluster 2024-09-16T09:37:19.961293+0000 mgr.a (mgr.14373) 10391 : cluster [DBG] pgmap v7205: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:37:21.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:37:21 smithi086 bash[24289]: audit 2024-09-16T09:37:20.428529+0000 mgr.a (mgr.14373) 10392 : audit [DBG] from='client.229044 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:37:21.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:37:21 smithi047 bash[22744]: cluster 2024-09-16T09:37:19.961293+0000 mgr.a (mgr.14373) 10391 : cluster [DBG] pgmap v7205: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:37:21.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:37:21 smithi047 bash[22744]: audit 2024-09-16T09:37:20.428529+0000 mgr.a (mgr.14373) 10392 : audit [DBG] from='client.229044 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:37:23.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:37:23 smithi086 bash[24289]: cluster 2024-09-16T09:37:21.963568+0000 mgr.a (mgr.14373) 10393 : cluster [DBG] pgmap v7206: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:37:23.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:37:23 smithi047 bash[22744]: cluster 2024-09-16T09:37:21.963568+0000 mgr.a (mgr.14373) 10393 : cluster [DBG] pgmap v7206: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:37:23.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:37:23 smithi157 bash[24585]: cluster 2024-09-16T09:37:21.963568+0000 mgr.a (mgr.14373) 10393 : cluster [DBG] pgmap v7206: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:37:25.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:37:25 smithi086 bash[24289]: cluster 2024-09-16T09:37:23.964334+0000 mgr.a (mgr.14373) 10394 : cluster [DBG] pgmap v7207: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:37:25.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:37:25 smithi047 bash[22744]: cluster 2024-09-16T09:37:23.964334+0000 mgr.a (mgr.14373) 10394 : cluster [DBG] pgmap v7207: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:37:25.808 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:37:25 smithi157 bash[24585]: cluster 2024-09-16T09:37:23.964334+0000 mgr.a (mgr.14373) 10394 : cluster [DBG] pgmap v7207: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:37:25.857 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:37:25.858 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:37:25.858 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:37:26.633 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:37:26.634 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:37:26.634 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:37:26.634 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:37:26.634 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:37:27.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:37:27 smithi086 bash[24289]: cluster 2024-09-16T09:37:25.964778+0000 mgr.a (mgr.14373) 10395 : cluster [DBG] pgmap v7208: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:37:27.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:37:27 smithi086 bash[24289]: audit 2024-09-16T09:37:26.189383+0000 mgr.a (mgr.14373) 10396 : audit [DBG] from='client.229119 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:37:27.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:37:27 smithi047 bash[22744]: cluster 2024-09-16T09:37:25.964778+0000 mgr.a (mgr.14373) 10395 : cluster [DBG] pgmap v7208: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:37:27.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:37:27 smithi047 bash[22744]: audit 2024-09-16T09:37:26.189383+0000 mgr.a (mgr.14373) 10396 : audit [DBG] from='client.229119 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:37:27.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:37:27 smithi157 bash[24585]: cluster 2024-09-16T09:37:25.964778+0000 mgr.a (mgr.14373) 10395 : cluster [DBG] pgmap v7208: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:37:27.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:37:27 smithi157 bash[24585]: audit 2024-09-16T09:37:26.189383+0000 mgr.a (mgr.14373) 10396 : audit [DBG] from='client.229119 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:37:29.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:37:29 smithi047 bash[22744]: cluster 2024-09-16T09:37:27.967124+0000 mgr.a (mgr.14373) 10397 : cluster [DBG] pgmap v7209: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-16T09:37:29.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:37:29 smithi157 bash[24585]: cluster 2024-09-16T09:37:27.967124+0000 mgr.a (mgr.14373) 10397 : cluster [DBG] pgmap v7209: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-16T09:37:29.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:37:29 smithi086 bash[24289]: cluster 2024-09-16T09:37:27.967124+0000 mgr.a (mgr.14373) 10397 : cluster [DBG] pgmap v7209: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-16T09:37:31.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:37:31 smithi047 bash[22744]: cluster 2024-09-16T09:37:29.967900+0000 mgr.a (mgr.14373) 10398 : cluster [DBG] pgmap v7210: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T09:37:31.635 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:37:31.636 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:37:31.636 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:37:31.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:37:31 smithi157 bash[24585]: cluster 2024-09-16T09:37:29.967900+0000 mgr.a (mgr.14373) 10398 : cluster [DBG] pgmap v7210: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T09:37:31.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:37:31 smithi086 bash[24289]: cluster 2024-09-16T09:37:29.967900+0000 mgr.a (mgr.14373) 10398 : cluster [DBG] pgmap v7210: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T09:37:32.373 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:37:32.373 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:37:32.373 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:37:32.374 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:37:32.374 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:37:33.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:37:33 smithi047 bash[22744]: audit 2024-09-16T09:37:31.963356+0000 mgr.a (mgr.14373) 10399 : audit [DBG] from='client.229197 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:37:33.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:37:33 smithi047 bash[22744]: cluster 2024-09-16T09:37:31.974756+0000 mgr.a (mgr.14373) 10400 : cluster [DBG] pgmap v7211: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:37:33.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:37:33 smithi157 bash[24585]: audit 2024-09-16T09:37:31.963356+0000 mgr.a (mgr.14373) 10399 : audit [DBG] from='client.229197 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:37:33.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:37:33 smithi157 bash[24585]: cluster 2024-09-16T09:37:31.974756+0000 mgr.a (mgr.14373) 10400 : cluster [DBG] pgmap v7211: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:37:33.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:37:33 smithi086 bash[24289]: audit 2024-09-16T09:37:31.963356+0000 mgr.a (mgr.14373) 10399 : audit [DBG] from='client.229197 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:37:33.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:37:33 smithi086 bash[24289]: cluster 2024-09-16T09:37:31.974756+0000 mgr.a (mgr.14373) 10400 : cluster [DBG] pgmap v7211: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:37:35.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:37:35 smithi047 bash[22744]: cluster 2024-09-16T09:37:33.975630+0000 mgr.a (mgr.14373) 10401 : cluster [DBG] pgmap v7212: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:37:35.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:37:35 smithi157 bash[24585]: cluster 2024-09-16T09:37:33.975630+0000 mgr.a (mgr.14373) 10401 : cluster [DBG] pgmap v7212: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:37:35.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:37:35 smithi086 bash[24289]: cluster 2024-09-16T09:37:33.975630+0000 mgr.a (mgr.14373) 10401 : cluster [DBG] pgmap v7212: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:37:37.375 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:37:37.375 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:37:37.376 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:37:37.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:37:37 smithi047 bash[22744]: cluster 2024-09-16T09:37:35.976376+0000 mgr.a (mgr.14373) 10402 : cluster [DBG] pgmap v7213: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:37:37.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:37:37 smithi157 bash[24585]: cluster 2024-09-16T09:37:35.976376+0000 mgr.a (mgr.14373) 10402 : cluster [DBG] pgmap v7213: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:37:37.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:37:37 smithi086 bash[24289]: cluster 2024-09-16T09:37:35.976376+0000 mgr.a (mgr.14373) 10402 : cluster [DBG] pgmap v7213: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:37:38.167 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:37:38.167 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:37:38.167 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:37:38.167 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:37:38.168 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:37:39.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:37:39 smithi047 bash[22744]: audit 2024-09-16T09:37:37.713208+0000 mgr.a (mgr.14373) 10403 : audit [DBG] from='client.229275 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:37:39.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:37:39 smithi047 bash[22744]: cluster 2024-09-16T09:37:37.977675+0000 mgr.a (mgr.14373) 10404 : cluster [DBG] pgmap v7214: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:37:39.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:37:39 smithi157 bash[24585]: audit 2024-09-16T09:37:37.713208+0000 mgr.a (mgr.14373) 10403 : audit [DBG] from='client.229275 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:37:39.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:37:39 smithi157 bash[24585]: cluster 2024-09-16T09:37:37.977675+0000 mgr.a (mgr.14373) 10404 : cluster [DBG] pgmap v7214: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:37:39.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:37:39 smithi086 bash[24289]: audit 2024-09-16T09:37:37.713208+0000 mgr.a (mgr.14373) 10403 : audit [DBG] from='client.229275 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:37:39.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:37:39 smithi086 bash[24289]: cluster 2024-09-16T09:37:37.977675+0000 mgr.a (mgr.14373) 10404 : cluster [DBG] pgmap v7214: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:37:41.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:37:41 smithi157 bash[24585]: cluster 2024-09-16T09:37:39.978662+0000 mgr.a (mgr.14373) 10405 : cluster [DBG] pgmap v7215: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-16T09:37:41.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:37:41 smithi086 bash[24289]: cluster 2024-09-16T09:37:39.978662+0000 mgr.a (mgr.14373) 10405 : cluster [DBG] pgmap v7215: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-16T09:37:41.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:37:41 smithi047 bash[22744]: cluster 2024-09-16T09:37:39.978662+0000 mgr.a (mgr.14373) 10405 : cluster [DBG] pgmap v7215: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-16T09:37:43.169 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:37:43.169 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:37:43.169 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:37:43.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:37:43 smithi157 bash[24585]: cluster 2024-09-16T09:37:41.980788+0000 mgr.a (mgr.14373) 10406 : cluster [DBG] pgmap v7216: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-16T09:37:43.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:37:43 smithi086 bash[24289]: cluster 2024-09-16T09:37:41.980788+0000 mgr.a (mgr.14373) 10406 : cluster [DBG] pgmap v7216: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-16T09:37:43.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:37:43 smithi047 bash[22744]: cluster 2024-09-16T09:37:41.980788+0000 mgr.a (mgr.14373) 10406 : cluster [DBG] pgmap v7216: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-16T09:37:43.957 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:37:43.957 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:37:43.957 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:37:43.957 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:37:43.958 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:37:44.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:37:44 smithi157 bash[24585]: audit 2024-09-16T09:37:43.508732+0000 mgr.a (mgr.14373) 10407 : audit [DBG] from='client.229353 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:37:44.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:37:44 smithi086 bash[24289]: audit 2024-09-16T09:37:43.508732+0000 mgr.a (mgr.14373) 10407 : audit [DBG] from='client.229353 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:37:44.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:37:44 smithi047 bash[22744]: audit 2024-09-16T09:37:43.508732+0000 mgr.a (mgr.14373) 10407 : audit [DBG] from='client.229353 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:37:45.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:37:45 smithi157 bash[24585]: cluster 2024-09-16T09:37:43.981410+0000 mgr.a (mgr.14373) 10408 : cluster [DBG] pgmap v7217: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:37:45.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:37:45 smithi086 bash[24289]: cluster 2024-09-16T09:37:43.981410+0000 mgr.a (mgr.14373) 10408 : cluster [DBG] pgmap v7217: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:37:45.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:37:45 smithi047 bash[22744]: cluster 2024-09-16T09:37:43.981410+0000 mgr.a (mgr.14373) 10408 : cluster [DBG] pgmap v7217: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:37:47.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:37:47 smithi157 bash[24585]: cluster 2024-09-16T09:37:45.982133+0000 mgr.a (mgr.14373) 10409 : cluster [DBG] pgmap v7218: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:37:47.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:37:47 smithi086 bash[24289]: cluster 2024-09-16T09:37:45.982133+0000 mgr.a (mgr.14373) 10409 : cluster [DBG] pgmap v7218: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:37:47.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:37:47 smithi047 bash[22744]: cluster 2024-09-16T09:37:45.982133+0000 mgr.a (mgr.14373) 10409 : cluster [DBG] pgmap v7218: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:37:48.961 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:37:48.961 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:37:48.961 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:37:49.737 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:37:49.738 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:37:49.738 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:37:49.738 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:37:49.738 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:37:49.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:37:49 smithi157 bash[24585]: cluster 2024-09-16T09:37:47.984340+0000 mgr.a (mgr.14373) 10410 : cluster [DBG] pgmap v7219: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:37:49.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:37:49 smithi086 bash[24289]: cluster 2024-09-16T09:37:47.984340+0000 mgr.a (mgr.14373) 10410 : cluster [DBG] pgmap v7219: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:37:49.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:37:49 smithi047 bash[22744]: cluster 2024-09-16T09:37:47.984340+0000 mgr.a (mgr.14373) 10410 : cluster [DBG] pgmap v7219: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:37:50.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:37:50 smithi157 bash[24585]: audit 2024-09-16T09:37:49.296802+0000 mgr.a (mgr.14373) 10411 : audit [DBG] from='client.229425 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:37:50.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:37:50 smithi086 bash[24289]: audit 2024-09-16T09:37:49.296802+0000 mgr.a (mgr.14373) 10411 : audit [DBG] from='client.229425 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:37:50.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:37:50 smithi047 bash[22744]: audit 2024-09-16T09:37:49.296802+0000 mgr.a (mgr.14373) 10411 : audit [DBG] from='client.229425 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:37:51.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:37:51 smithi157 bash[24585]: cluster 2024-09-16T09:37:49.985304+0000 mgr.a (mgr.14373) 10412 : cluster [DBG] pgmap v7220: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:37:51.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:37:51 smithi086 bash[24289]: cluster 2024-09-16T09:37:49.985304+0000 mgr.a (mgr.14373) 10412 : cluster [DBG] pgmap v7220: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:37:51.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:37:51 smithi047 bash[22744]: cluster 2024-09-16T09:37:49.985304+0000 mgr.a (mgr.14373) 10412 : cluster [DBG] pgmap v7220: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:37:53.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:37:53 smithi157 bash[24585]: cluster 2024-09-16T09:37:51.987513+0000 mgr.a (mgr.14373) 10413 : cluster [DBG] pgmap v7221: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:37:53.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:37:53 smithi086 bash[24289]: cluster 2024-09-16T09:37:51.987513+0000 mgr.a (mgr.14373) 10413 : cluster [DBG] pgmap v7221: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:37:53.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:37:53 smithi047 bash[22744]: cluster 2024-09-16T09:37:51.987513+0000 mgr.a (mgr.14373) 10413 : cluster [DBG] pgmap v7221: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:37:54.739 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:37:54.740 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:37:54.740 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:37:55.504 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:37:55.505 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:37:55.505 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:37:55.505 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:37:55.505 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:37:55.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:37:55 smithi157 bash[24585]: cluster 2024-09-16T09:37:53.988293+0000 mgr.a (mgr.14373) 10414 : cluster [DBG] pgmap v7222: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:37:55.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:37:55 smithi086 bash[24289]: cluster 2024-09-16T09:37:53.988293+0000 mgr.a (mgr.14373) 10414 : cluster [DBG] pgmap v7222: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:37:55.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:37:55 smithi047 bash[22744]: cluster 2024-09-16T09:37:53.988293+0000 mgr.a (mgr.14373) 10414 : cluster [DBG] pgmap v7222: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:37:56.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:37:56 smithi157 bash[24585]: audit 2024-09-16T09:37:55.072442+0000 mgr.a (mgr.14373) 10415 : audit [DBG] from='client.229503 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:37:56.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:37:56 smithi086 bash[24289]: audit 2024-09-16T09:37:55.072442+0000 mgr.a (mgr.14373) 10415 : audit [DBG] from='client.229503 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:37:56.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:37:56 smithi047 bash[22744]: audit 2024-09-16T09:37:55.072442+0000 mgr.a (mgr.14373) 10415 : audit [DBG] from='client.229503 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:37:57.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:37:57 smithi157 bash[24585]: cluster 2024-09-16T09:37:55.989236+0000 mgr.a (mgr.14373) 10416 : cluster [DBG] pgmap v7223: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:37:57.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:37:57 smithi086 bash[24289]: cluster 2024-09-16T09:37:55.989236+0000 mgr.a (mgr.14373) 10416 : cluster [DBG] pgmap v7223: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:37:57.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:37:57 smithi047 bash[22744]: cluster 2024-09-16T09:37:55.989236+0000 mgr.a (mgr.14373) 10416 : cluster [DBG] pgmap v7223: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:37:59.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:37:59 smithi157 bash[24585]: cluster 2024-09-16T09:37:57.991474+0000 mgr.a (mgr.14373) 10417 : cluster [DBG] pgmap v7224: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:37:59.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:37:59 smithi086 bash[24289]: cluster 2024-09-16T09:37:57.991474+0000 mgr.a (mgr.14373) 10417 : cluster [DBG] pgmap v7224: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:37:59.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:37:59 smithi047 bash[22744]: cluster 2024-09-16T09:37:57.991474+0000 mgr.a (mgr.14373) 10417 : cluster [DBG] pgmap v7224: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:38:00.506 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:38:00.506 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:38:00.507 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:38:01.266 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:38:01.267 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:38:01.267 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:38:01.267 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:38:01.267 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:38:01.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:38:01 smithi157 bash[24585]: cluster 2024-09-16T09:37:59.992280+0000 mgr.a (mgr.14373) 10418 : cluster [DBG] pgmap v7225: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:38:01.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:38:01 smithi086 bash[24289]: cluster 2024-09-16T09:37:59.992280+0000 mgr.a (mgr.14373) 10418 : cluster [DBG] pgmap v7225: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:38:01.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:38:01 smithi047 bash[22744]: cluster 2024-09-16T09:37:59.992280+0000 mgr.a (mgr.14373) 10418 : cluster [DBG] pgmap v7225: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:38:02.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:38:02 smithi157 bash[24585]: audit 2024-09-16T09:38:00.835717+0000 mgr.a (mgr.14373) 10419 : audit [DBG] from='client.229581 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:38:02.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:38:02 smithi086 bash[24289]: audit 2024-09-16T09:38:00.835717+0000 mgr.a (mgr.14373) 10419 : audit [DBG] from='client.229581 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:38:02.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:38:02 smithi047 bash[22744]: audit 2024-09-16T09:38:00.835717+0000 mgr.a (mgr.14373) 10419 : audit [DBG] from='client.229581 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:38:03.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:38:03 smithi157 bash[24585]: cluster 2024-09-16T09:38:01.994696+0000 mgr.a (mgr.14373) 10420 : cluster [DBG] pgmap v7226: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:38:03.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:38:03 smithi086 bash[24289]: cluster 2024-09-16T09:38:01.994696+0000 mgr.a (mgr.14373) 10420 : cluster [DBG] pgmap v7226: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:38:03.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:38:03 smithi047 bash[22744]: cluster 2024-09-16T09:38:01.994696+0000 mgr.a (mgr.14373) 10420 : cluster [DBG] pgmap v7226: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:38:05.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:38:05 smithi157 bash[24585]: cluster 2024-09-16T09:38:03.995490+0000 mgr.a (mgr.14373) 10421 : cluster [DBG] pgmap v7227: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:38:05.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:38:05 smithi086 bash[24289]: cluster 2024-09-16T09:38:03.995490+0000 mgr.a (mgr.14373) 10421 : cluster [DBG] pgmap v7227: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:38:05.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:38:05 smithi047 bash[22744]: cluster 2024-09-16T09:38:03.995490+0000 mgr.a (mgr.14373) 10421 : cluster [DBG] pgmap v7227: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:38:06.268 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:38:06.269 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:38:06.269 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:38:07.019 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:38:07.019 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:38:07.019 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:38:07.020 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:38:07.020 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:38:07.808 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:38:07 smithi157 bash[24585]: cluster 2024-09-16T09:38:05.996259+0000 mgr.a (mgr.14373) 10422 : cluster [DBG] pgmap v7228: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:38:07.809 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:38:07 smithi157 bash[24585]: audit 2024-09-16T09:38:06.604698+0000 mgr.a (mgr.14373) 10423 : audit [DBG] from='client.229659 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:38:07.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:38:07 smithi086 bash[24289]: cluster 2024-09-16T09:38:05.996259+0000 mgr.a (mgr.14373) 10422 : cluster [DBG] pgmap v7228: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:38:07.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:38:07 smithi086 bash[24289]: audit 2024-09-16T09:38:06.604698+0000 mgr.a (mgr.14373) 10423 : audit [DBG] from='client.229659 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:38:07.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:38:07 smithi047 bash[22744]: cluster 2024-09-16T09:38:05.996259+0000 mgr.a (mgr.14373) 10422 : cluster [DBG] pgmap v7228: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:38:07.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:38:07 smithi047 bash[22744]: audit 2024-09-16T09:38:06.604698+0000 mgr.a (mgr.14373) 10423 : audit [DBG] from='client.229659 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:38:09.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:38:09 smithi157 bash[24585]: cluster 2024-09-16T09:38:07.999066+0000 mgr.a (mgr.14373) 10424 : cluster [DBG] pgmap v7229: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 22 KiB/s rd, 0 B/s wr, 34 op/s 2024-09-16T09:38:09.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:38:09 smithi157 bash[24585]: audit 2024-09-16T09:38:08.437113+0000 mon.b (mon.2) 966 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T09:38:09.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:38:09 smithi157 bash[24585]: audit 2024-09-16T09:38:09.249823+0000 mon.b (mon.2) 967 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:38:09.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:38:09 smithi157 bash[24585]: audit 2024-09-16T09:38:09.252112+0000 mon.b (mon.2) 968 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T09:38:09.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:38:09 smithi157 bash[24585]: audit 2024-09-16T09:38:09.260820+0000 mon.a (mon.0) 1185 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:38:09.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:38:09 smithi157 bash[24585]: audit 2024-09-16T09:38:09.267292+0000 mon.b (mon.2) 969 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:38:09.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:38:09 smithi086 bash[24289]: cluster 2024-09-16T09:38:07.999066+0000 mgr.a (mgr.14373) 10424 : cluster [DBG] pgmap v7229: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 22 KiB/s rd, 0 B/s wr, 34 op/s 2024-09-16T09:38:09.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:38:09 smithi086 bash[24289]: audit 2024-09-16T09:38:08.437113+0000 mon.b (mon.2) 966 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T09:38:09.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:38:09 smithi086 bash[24289]: audit 2024-09-16T09:38:09.249823+0000 mon.b (mon.2) 967 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:38:09.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:38:09 smithi086 bash[24289]: audit 2024-09-16T09:38:09.252112+0000 mon.b (mon.2) 968 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T09:38:09.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:38:09 smithi086 bash[24289]: audit 2024-09-16T09:38:09.260820+0000 mon.a (mon.0) 1185 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:38:09.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:38:09 smithi086 bash[24289]: audit 2024-09-16T09:38:09.267292+0000 mon.b (mon.2) 969 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:38:09.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:38:09 smithi047 bash[22744]: cluster 2024-09-16T09:38:07.999066+0000 mgr.a (mgr.14373) 10424 : cluster [DBG] pgmap v7229: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 22 KiB/s rd, 0 B/s wr, 34 op/s 2024-09-16T09:38:09.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:38:09 smithi047 bash[22744]: audit 2024-09-16T09:38:08.437113+0000 mon.b (mon.2) 966 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T09:38:09.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:38:09 smithi047 bash[22744]: audit 2024-09-16T09:38:09.249823+0000 mon.b (mon.2) 967 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:38:09.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:38:09 smithi047 bash[22744]: audit 2024-09-16T09:38:09.252112+0000 mon.b (mon.2) 968 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T09:38:09.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:38:09 smithi047 bash[22744]: audit 2024-09-16T09:38:09.260820+0000 mon.a (mon.0) 1185 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:38:09.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:38:09 smithi047 bash[22744]: audit 2024-09-16T09:38:09.267292+0000 mon.b (mon.2) 969 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:38:10.342 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 09:38:10 smithi047 bash[22994]: debug 2024-09-16T09:38:10.002+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T09:38:10.342 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 09:38:10 smithi047 bash[22994]: debug 2024-09-16T09:38:10.006+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T09:38:10.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:38:10 smithi157 bash[24585]: audit 2024-09-16T09:38:09.267777+0000 mgr.a (mgr.14373) 10425 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:38:10.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:38:10 smithi086 bash[24289]: audit 2024-09-16T09:38:09.267777+0000 mgr.a (mgr.14373) 10425 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:38:10.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:38:10 smithi047 bash[22744]: audit 2024-09-16T09:38:09.267777+0000 mgr.a (mgr.14373) 10425 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:38:11.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:38:11 smithi157 bash[24585]: cluster 2024-09-16T09:38:09.999885+0000 mgr.a (mgr.14373) 10426 : cluster [DBG] pgmap v7230: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 21 KiB/s rd, 0 B/s wr, 34 op/s 2024-09-16T09:38:11.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:38:11 smithi157 bash[24585]: audit 2024-09-16T09:38:10.009743+0000 mgr.a (mgr.14373) 10427 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T09:38:11.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:38:11 smithi157 bash[24585]: cephadm 2024-09-16T09:38:10.011989+0000 mgr.a (mgr.14373) 10428 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T09:38:11.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:38:11 smithi086 bash[24289]: cluster 2024-09-16T09:38:09.999885+0000 mgr.a (mgr.14373) 10426 : cluster [DBG] pgmap v7230: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 21 KiB/s rd, 0 B/s wr, 34 op/s 2024-09-16T09:38:11.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:38:11 smithi086 bash[24289]: audit 2024-09-16T09:38:10.009743+0000 mgr.a (mgr.14373) 10427 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T09:38:11.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:38:11 smithi086 bash[24289]: cephadm 2024-09-16T09:38:10.011989+0000 mgr.a (mgr.14373) 10428 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T09:38:11.845 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:38:11 smithi047 bash[22744]: cluster 2024-09-16T09:38:09.999885+0000 mgr.a (mgr.14373) 10426 : cluster [DBG] pgmap v7230: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 21 KiB/s rd, 0 B/s wr, 34 op/s 2024-09-16T09:38:11.845 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:38:11 smithi047 bash[22744]: audit 2024-09-16T09:38:10.009743+0000 mgr.a (mgr.14373) 10427 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T09:38:11.845 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:38:11 smithi047 bash[22744]: cephadm 2024-09-16T09:38:10.011989+0000 mgr.a (mgr.14373) 10428 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T09:38:12.021 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:38:12.021 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:38:12.021 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:38:12.770 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:38:12.770 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:38:12.770 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:38:12.770 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:38:12.770 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:38:13.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:38:13 smithi157 bash[24585]: cluster 2024-09-16T09:38:12.002033+0000 mgr.a (mgr.14373) 10429 : cluster [DBG] pgmap v7231: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 27 KiB/s rd, 426 B/s wr, 40 op/s 2024-09-16T09:38:13.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:38:13 smithi157 bash[24585]: audit 2024-09-16T09:38:12.347358+0000 mgr.a (mgr.14373) 10430 : audit [DBG] from='client.229842 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:38:13.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:38:13 smithi086 bash[24289]: cluster 2024-09-16T09:38:12.002033+0000 mgr.a (mgr.14373) 10429 : cluster [DBG] pgmap v7231: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 27 KiB/s rd, 426 B/s wr, 40 op/s 2024-09-16T09:38:13.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:38:13 smithi086 bash[24289]: audit 2024-09-16T09:38:12.347358+0000 mgr.a (mgr.14373) 10430 : audit [DBG] from='client.229842 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:38:13.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:38:13 smithi047 bash[22744]: cluster 2024-09-16T09:38:12.002033+0000 mgr.a (mgr.14373) 10429 : cluster [DBG] pgmap v7231: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 27 KiB/s rd, 426 B/s wr, 40 op/s 2024-09-16T09:38:13.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:38:13 smithi047 bash[22744]: audit 2024-09-16T09:38:12.347358+0000 mgr.a (mgr.14373) 10430 : audit [DBG] from='client.229842 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:38:15.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:38:15 smithi157 bash[24585]: cluster 2024-09-16T09:38:14.003047+0000 mgr.a (mgr.14373) 10431 : cluster [DBG] pgmap v7232: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 26 KiB/s rd, 426 B/s wr, 39 op/s 2024-09-16T09:38:15.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:38:15 smithi086 bash[24289]: cluster 2024-09-16T09:38:14.003047+0000 mgr.a (mgr.14373) 10431 : cluster [DBG] pgmap v7232: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 26 KiB/s rd, 426 B/s wr, 39 op/s 2024-09-16T09:38:15.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:38:15 smithi047 bash[22744]: cluster 2024-09-16T09:38:14.003047+0000 mgr.a (mgr.14373) 10431 : cluster [DBG] pgmap v7232: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 26 KiB/s rd, 426 B/s wr, 39 op/s 2024-09-16T09:38:17.771 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:38:17.772 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:38:17.772 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:38:17.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:38:17 smithi157 bash[24585]: cluster 2024-09-16T09:38:16.003853+0000 mgr.a (mgr.14373) 10432 : cluster [DBG] pgmap v7233: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 26 KiB/s rd, 426 B/s wr, 39 op/s 2024-09-16T09:38:17.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:38:17 smithi086 bash[24289]: cluster 2024-09-16T09:38:16.003853+0000 mgr.a (mgr.14373) 10432 : cluster [DBG] pgmap v7233: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 26 KiB/s rd, 426 B/s wr, 39 op/s 2024-09-16T09:38:17.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:38:17 smithi047 bash[22744]: cluster 2024-09-16T09:38:16.003853+0000 mgr.a (mgr.14373) 10432 : cluster [DBG] pgmap v7233: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 26 KiB/s rd, 426 B/s wr, 39 op/s 2024-09-16T09:38:18.562 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:38:18.563 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:38:18.563 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:38:18.563 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:38:18.563 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:38:19.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:38:19 smithi157 bash[24585]: cluster 2024-09-16T09:38:18.006005+0000 mgr.a (mgr.14373) 10433 : cluster [DBG] pgmap v7234: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 27 KiB/s rd, 426 B/s wr, 40 op/s 2024-09-16T09:38:19.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:38:19 smithi157 bash[24585]: audit 2024-09-16T09:38:18.105224+0000 mgr.a (mgr.14373) 10434 : audit [DBG] from='client.229920 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:38:19.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:38:19 smithi086 bash[24289]: cluster 2024-09-16T09:38:18.006005+0000 mgr.a (mgr.14373) 10433 : cluster [DBG] pgmap v7234: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 27 KiB/s rd, 426 B/s wr, 40 op/s 2024-09-16T09:38:19.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:38:19 smithi086 bash[24289]: audit 2024-09-16T09:38:18.105224+0000 mgr.a (mgr.14373) 10434 : audit [DBG] from='client.229920 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:38:19.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:38:19 smithi047 bash[22744]: cluster 2024-09-16T09:38:18.006005+0000 mgr.a (mgr.14373) 10433 : cluster [DBG] pgmap v7234: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 27 KiB/s rd, 426 B/s wr, 40 op/s 2024-09-16T09:38:19.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:38:19 smithi047 bash[22744]: audit 2024-09-16T09:38:18.105224+0000 mgr.a (mgr.14373) 10434 : audit [DBG] from='client.229920 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:38:21.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:38:21 smithi157 bash[24585]: cluster 2024-09-16T09:38:20.007071+0000 mgr.a (mgr.14373) 10435 : cluster [DBG] pgmap v7235: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:38:21.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:38:21 smithi086 bash[24289]: cluster 2024-09-16T09:38:20.007071+0000 mgr.a (mgr.14373) 10435 : cluster [DBG] pgmap v7235: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:38:21.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:38:21 smithi047 bash[22744]: cluster 2024-09-16T09:38:20.007071+0000 mgr.a (mgr.14373) 10435 : cluster [DBG] pgmap v7235: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:38:23.564 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:38:23.565 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:38:23.565 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:38:23.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:38:23 smithi157 bash[24585]: cluster 2024-09-16T09:38:22.009981+0000 mgr.a (mgr.14373) 10436 : cluster [DBG] pgmap v7236: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 8.9 KiB/s rd, 426 B/s wr, 9 op/s 2024-09-16T09:38:23.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:38:23 smithi086 bash[24289]: cluster 2024-09-16T09:38:22.009981+0000 mgr.a (mgr.14373) 10436 : cluster [DBG] pgmap v7236: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 8.9 KiB/s rd, 426 B/s wr, 9 op/s 2024-09-16T09:38:23.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:38:23 smithi047 bash[22744]: cluster 2024-09-16T09:38:22.009981+0000 mgr.a (mgr.14373) 10436 : cluster [DBG] pgmap v7236: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 8.9 KiB/s rd, 426 B/s wr, 9 op/s 2024-09-16T09:38:24.339 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:38:24.340 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:38:24.340 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:38:24.340 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:38:24.340 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:38:25.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:38:25 smithi157 bash[24585]: audit 2024-09-16T09:38:23.897243+0000 mgr.a (mgr.14373) 10437 : audit [DBG] from='client.229995 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:38:25.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:38:25 smithi157 bash[24585]: cluster 2024-09-16T09:38:24.010547+0000 mgr.a (mgr.14373) 10438 : cluster [DBG] pgmap v7237: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.8 KiB/s rd, 0 B/s wr, 3 op/s 2024-09-16T09:38:25.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:38:25 smithi086 bash[24289]: audit 2024-09-16T09:38:23.897243+0000 mgr.a (mgr.14373) 10437 : audit [DBG] from='client.229995 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:38:25.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:38:25 smithi086 bash[24289]: cluster 2024-09-16T09:38:24.010547+0000 mgr.a (mgr.14373) 10438 : cluster [DBG] pgmap v7237: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.8 KiB/s rd, 0 B/s wr, 3 op/s 2024-09-16T09:38:25.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:38:25 smithi047 bash[22744]: audit 2024-09-16T09:38:23.897243+0000 mgr.a (mgr.14373) 10437 : audit [DBG] from='client.229995 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:38:25.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:38:25 smithi047 bash[22744]: cluster 2024-09-16T09:38:24.010547+0000 mgr.a (mgr.14373) 10438 : cluster [DBG] pgmap v7237: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.8 KiB/s rd, 0 B/s wr, 3 op/s 2024-09-16T09:38:27.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:38:27 smithi157 bash[24585]: cluster 2024-09-16T09:38:26.011368+0000 mgr.a (mgr.14373) 10439 : cluster [DBG] pgmap v7238: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.8 KiB/s rd, 0 B/s wr, 3 op/s 2024-09-16T09:38:27.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:38:27 smithi086 bash[24289]: cluster 2024-09-16T09:38:26.011368+0000 mgr.a (mgr.14373) 10439 : cluster [DBG] pgmap v7238: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.8 KiB/s rd, 0 B/s wr, 3 op/s 2024-09-16T09:38:27.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:38:27 smithi047 bash[22744]: cluster 2024-09-16T09:38:26.011368+0000 mgr.a (mgr.14373) 10439 : cluster [DBG] pgmap v7238: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.8 KiB/s rd, 0 B/s wr, 3 op/s 2024-09-16T09:38:29.341 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:38:29.342 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:38:29.342 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:38:29.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:38:29 smithi157 bash[24585]: cluster 2024-09-16T09:38:28.013601+0000 mgr.a (mgr.14373) 10440 : cluster [DBG] pgmap v7239: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 66 KiB/s rd, 0 B/s wr, 108 op/s 2024-09-16T09:38:29.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:38:29 smithi086 bash[24289]: cluster 2024-09-16T09:38:28.013601+0000 mgr.a (mgr.14373) 10440 : cluster [DBG] pgmap v7239: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 66 KiB/s rd, 0 B/s wr, 108 op/s 2024-09-16T09:38:29.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:38:29 smithi047 bash[22744]: cluster 2024-09-16T09:38:28.013601+0000 mgr.a (mgr.14373) 10440 : cluster [DBG] pgmap v7239: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 66 KiB/s rd, 0 B/s wr, 108 op/s 2024-09-16T09:38:30.122 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:38:30.122 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:38:30.122 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:38:30.123 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:38:30.123 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:38:31.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:38:31 smithi157 bash[24585]: audit 2024-09-16T09:38:29.677032+0000 mgr.a (mgr.14373) 10441 : audit [DBG] from='client.230070 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:38:31.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:38:31 smithi157 bash[24585]: cluster 2024-09-16T09:38:30.019138+0000 mgr.a (mgr.14373) 10442 : cluster [DBG] pgmap v7240: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 65 KiB/s rd, 0 B/s wr, 107 op/s 2024-09-16T09:38:31.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:38:31 smithi086 bash[24289]: audit 2024-09-16T09:38:29.677032+0000 mgr.a (mgr.14373) 10441 : audit [DBG] from='client.230070 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:38:31.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:38:31 smithi086 bash[24289]: cluster 2024-09-16T09:38:30.019138+0000 mgr.a (mgr.14373) 10442 : cluster [DBG] pgmap v7240: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 65 KiB/s rd, 0 B/s wr, 107 op/s 2024-09-16T09:38:31.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:38:31 smithi047 bash[22744]: audit 2024-09-16T09:38:29.677032+0000 mgr.a (mgr.14373) 10441 : audit [DBG] from='client.230070 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:38:31.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:38:31 smithi047 bash[22744]: cluster 2024-09-16T09:38:30.019138+0000 mgr.a (mgr.14373) 10442 : cluster [DBG] pgmap v7240: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 65 KiB/s rd, 0 B/s wr, 107 op/s 2024-09-16T09:38:33.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:38:33 smithi157 bash[24585]: cluster 2024-09-16T09:38:32.021513+0000 mgr.a (mgr.14373) 10443 : cluster [DBG] pgmap v7241: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 66 KiB/s rd, 0 B/s wr, 108 op/s 2024-09-16T09:38:33.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:38:33 smithi086 bash[24289]: cluster 2024-09-16T09:38:32.021513+0000 mgr.a (mgr.14373) 10443 : cluster [DBG] pgmap v7241: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 66 KiB/s rd, 0 B/s wr, 108 op/s 2024-09-16T09:38:33.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:38:33 smithi047 bash[22744]: cluster 2024-09-16T09:38:32.021513+0000 mgr.a (mgr.14373) 10443 : cluster [DBG] pgmap v7241: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 66 KiB/s rd, 0 B/s wr, 108 op/s 2024-09-16T09:38:35.124 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:38:35.125 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:38:35.125 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:38:35.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:38:35 smithi157 bash[24585]: cluster 2024-09-16T09:38:34.022498+0000 mgr.a (mgr.14373) 10444 : cluster [DBG] pgmap v7242: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 64 KiB/s rd, 0 B/s wr, 105 op/s 2024-09-16T09:38:35.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:38:35 smithi086 bash[24289]: cluster 2024-09-16T09:38:34.022498+0000 mgr.a (mgr.14373) 10444 : cluster [DBG] pgmap v7242: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 64 KiB/s rd, 0 B/s wr, 105 op/s 2024-09-16T09:38:35.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:38:35 smithi047 bash[22744]: cluster 2024-09-16T09:38:34.022498+0000 mgr.a (mgr.14373) 10444 : cluster [DBG] pgmap v7242: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 64 KiB/s rd, 0 B/s wr, 105 op/s 2024-09-16T09:38:35.868 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:38:35.868 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:38:35.868 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:38:35.868 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:38:35.868 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:38:36.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:38:36 smithi157 bash[24585]: audit 2024-09-16T09:38:35.455045+0000 mgr.a (mgr.14373) 10445 : audit [DBG] from='client.230148 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:38:36.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:38:36 smithi086 bash[24289]: audit 2024-09-16T09:38:35.455045+0000 mgr.a (mgr.14373) 10445 : audit [DBG] from='client.230148 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:38:36.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:38:36 smithi047 bash[22744]: audit 2024-09-16T09:38:35.455045+0000 mgr.a (mgr.14373) 10445 : audit [DBG] from='client.230148 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:38:37.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:38:37 smithi157 bash[24585]: cluster 2024-09-16T09:38:36.023247+0000 mgr.a (mgr.14373) 10446 : cluster [DBG] pgmap v7243: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 64 KiB/s rd, 0 B/s wr, 105 op/s 2024-09-16T09:38:37.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:38:37 smithi086 bash[24289]: cluster 2024-09-16T09:38:36.023247+0000 mgr.a (mgr.14373) 10446 : cluster [DBG] pgmap v7243: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 64 KiB/s rd, 0 B/s wr, 105 op/s 2024-09-16T09:38:37.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:38:37 smithi047 bash[22744]: cluster 2024-09-16T09:38:36.023247+0000 mgr.a (mgr.14373) 10446 : cluster [DBG] pgmap v7243: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 64 KiB/s rd, 0 B/s wr, 105 op/s 2024-09-16T09:38:39.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:38:39 smithi157 bash[24585]: cluster 2024-09-16T09:38:38.025498+0000 mgr.a (mgr.14373) 10447 : cluster [DBG] pgmap v7244: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 65 KiB/s rd, 0 B/s wr, 106 op/s 2024-09-16T09:38:39.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:38:39 smithi086 bash[24289]: cluster 2024-09-16T09:38:38.025498+0000 mgr.a (mgr.14373) 10447 : cluster [DBG] pgmap v7244: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 65 KiB/s rd, 0 B/s wr, 106 op/s 2024-09-16T09:38:39.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:38:39 smithi047 bash[22744]: cluster 2024-09-16T09:38:38.025498+0000 mgr.a (mgr.14373) 10447 : cluster [DBG] pgmap v7244: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 65 KiB/s rd, 0 B/s wr, 106 op/s 2024-09-16T09:38:40.869 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:38:40.870 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:38:40.870 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:38:41.634 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:38:41.635 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:38:41.635 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:38:41.635 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:38:41.635 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:38:41.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:38:41 smithi157 bash[24585]: cluster 2024-09-16T09:38:40.026268+0000 mgr.a (mgr.14373) 10448 : cluster [DBG] pgmap v7245: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:38:41.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:38:41 smithi086 bash[24289]: cluster 2024-09-16T09:38:40.026268+0000 mgr.a (mgr.14373) 10448 : cluster [DBG] pgmap v7245: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:38:41.844 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:38:41 smithi047 bash[22744]: cluster 2024-09-16T09:38:40.026268+0000 mgr.a (mgr.14373) 10448 : cluster [DBG] pgmap v7245: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:38:42.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:38:42 smithi157 bash[24585]: audit 2024-09-16T09:38:41.195040+0000 mgr.a (mgr.14373) 10449 : audit [DBG] from='client.230226 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:38:42.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:38:42 smithi086 bash[24289]: audit 2024-09-16T09:38:41.195040+0000 mgr.a (mgr.14373) 10449 : audit [DBG] from='client.230226 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:38:42.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:38:42 smithi047 bash[22744]: audit 2024-09-16T09:38:41.195040+0000 mgr.a (mgr.14373) 10449 : audit [DBG] from='client.230226 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:38:43.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:38:43 smithi157 bash[24585]: cluster 2024-09-16T09:38:42.028767+0000 mgr.a (mgr.14373) 10450 : cluster [DBG] pgmap v7246: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-16T09:38:43.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:38:43 smithi086 bash[24289]: cluster 2024-09-16T09:38:42.028767+0000 mgr.a (mgr.14373) 10450 : cluster [DBG] pgmap v7246: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-16T09:38:43.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:38:43 smithi047 bash[22744]: cluster 2024-09-16T09:38:42.028767+0000 mgr.a (mgr.14373) 10450 : cluster [DBG] pgmap v7246: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-16T09:38:45.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:38:45 smithi157 bash[24585]: cluster 2024-09-16T09:38:44.029529+0000 mgr.a (mgr.14373) 10451 : cluster [DBG] pgmap v7247: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-16T09:38:45.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:38:45 smithi086 bash[24289]: cluster 2024-09-16T09:38:44.029529+0000 mgr.a (mgr.14373) 10451 : cluster [DBG] pgmap v7247: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-16T09:38:45.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:38:45 smithi047 bash[22744]: cluster 2024-09-16T09:38:44.029529+0000 mgr.a (mgr.14373) 10451 : cluster [DBG] pgmap v7247: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-16T09:38:46.636 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:38:46.636 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:38:46.639 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:38:47.425 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:38:47.425 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:38:47.425 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:38:47.426 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:38:47.426 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:38:47.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:38:47 smithi157 bash[24585]: cluster 2024-09-16T09:38:46.030276+0000 mgr.a (mgr.14373) 10452 : cluster [DBG] pgmap v7248: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-16T09:38:47.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:38:47 smithi086 bash[24289]: cluster 2024-09-16T09:38:46.030276+0000 mgr.a (mgr.14373) 10452 : cluster [DBG] pgmap v7248: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-16T09:38:47.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:38:47 smithi047 bash[22744]: cluster 2024-09-16T09:38:46.030276+0000 mgr.a (mgr.14373) 10452 : cluster [DBG] pgmap v7248: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-16T09:38:48.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:38:48 smithi157 bash[24585]: audit 2024-09-16T09:38:46.975600+0000 mgr.a (mgr.14373) 10453 : audit [DBG] from='client.230298 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:38:48.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:38:48 smithi086 bash[24289]: audit 2024-09-16T09:38:46.975600+0000 mgr.a (mgr.14373) 10453 : audit [DBG] from='client.230298 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:38:48.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:38:48 smithi047 bash[22744]: audit 2024-09-16T09:38:46.975600+0000 mgr.a (mgr.14373) 10453 : audit [DBG] from='client.230298 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:38:49.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:38:49 smithi157 bash[24585]: cluster 2024-09-16T09:38:48.033049+0000 mgr.a (mgr.14373) 10454 : cluster [DBG] pgmap v7249: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:38:49.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:38:49 smithi086 bash[24289]: cluster 2024-09-16T09:38:48.033049+0000 mgr.a (mgr.14373) 10454 : cluster [DBG] pgmap v7249: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:38:49.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:38:49 smithi047 bash[22744]: cluster 2024-09-16T09:38:48.033049+0000 mgr.a (mgr.14373) 10454 : cluster [DBG] pgmap v7249: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:38:51.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:38:51 smithi157 bash[24585]: cluster 2024-09-16T09:38:50.033833+0000 mgr.a (mgr.14373) 10455 : cluster [DBG] pgmap v7250: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:38:51.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:38:51 smithi086 bash[24289]: cluster 2024-09-16T09:38:50.033833+0000 mgr.a (mgr.14373) 10455 : cluster [DBG] pgmap v7250: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:38:51.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:38:51 smithi047 bash[22744]: cluster 2024-09-16T09:38:50.033833+0000 mgr.a (mgr.14373) 10455 : cluster [DBG] pgmap v7250: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:38:52.426 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:38:52.427 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:38:52.427 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:38:53.183 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:38:53.184 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:38:53.184 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:38:53.184 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:38:53.184 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:38:53.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:38:53 smithi157 bash[24585]: cluster 2024-09-16T09:38:52.035869+0000 mgr.a (mgr.14373) 10456 : cluster [DBG] pgmap v7251: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:38:53.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:38:53 smithi086 bash[24289]: cluster 2024-09-16T09:38:52.035869+0000 mgr.a (mgr.14373) 10456 : cluster [DBG] pgmap v7251: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:38:53.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:38:53 smithi047 bash[22744]: cluster 2024-09-16T09:38:52.035869+0000 mgr.a (mgr.14373) 10456 : cluster [DBG] pgmap v7251: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:38:54.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:38:54 smithi086 bash[24289]: audit 2024-09-16T09:38:52.758835+0000 mgr.a (mgr.14373) 10457 : audit [DBG] from='client.230373 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:38:54.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:38:54 smithi047 bash[22744]: audit 2024-09-16T09:38:52.758835+0000 mgr.a (mgr.14373) 10457 : audit [DBG] from='client.230373 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:38:55.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:38:54 smithi157 bash[24585]: audit 2024-09-16T09:38:52.758835+0000 mgr.a (mgr.14373) 10457 : audit [DBG] from='client.230373 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:38:55.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:38:55 smithi086 bash[24289]: cluster 2024-09-16T09:38:54.036830+0000 mgr.a (mgr.14373) 10458 : cluster [DBG] pgmap v7252: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-16T09:38:55.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:38:55 smithi047 bash[22744]: cluster 2024-09-16T09:38:54.036830+0000 mgr.a (mgr.14373) 10458 : cluster [DBG] pgmap v7252: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-16T09:38:56.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:38:55 smithi157 bash[24585]: cluster 2024-09-16T09:38:54.036830+0000 mgr.a (mgr.14373) 10458 : cluster [DBG] pgmap v7252: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-16T09:38:57.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:38:57 smithi086 bash[24289]: cluster 2024-09-16T09:38:56.037608+0000 mgr.a (mgr.14373) 10459 : cluster [DBG] pgmap v7253: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-16T09:38:57.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:38:57 smithi047 bash[22744]: cluster 2024-09-16T09:38:56.037608+0000 mgr.a (mgr.14373) 10459 : cluster [DBG] pgmap v7253: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-16T09:38:58.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:38:57 smithi157 bash[24585]: cluster 2024-09-16T09:38:56.037608+0000 mgr.a (mgr.14373) 10459 : cluster [DBG] pgmap v7253: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-16T09:38:58.185 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:38:58.185 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:38:58.185 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:38:58.934 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:38:58.934 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:38:58.934 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:38:58.934 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:38:58.934 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:38:59.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:38:59 smithi086 bash[24289]: cluster 2024-09-16T09:38:58.039867+0000 mgr.a (mgr.14373) 10460 : cluster [DBG] pgmap v7254: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:38:59.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:38:59 smithi086 bash[24289]: audit 2024-09-16T09:38:58.519058+0000 mgr.a (mgr.14373) 10461 : audit [DBG] from='client.230451 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:38:59.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:38:59 smithi047 bash[22744]: cluster 2024-09-16T09:38:58.039867+0000 mgr.a (mgr.14373) 10460 : cluster [DBG] pgmap v7254: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:38:59.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:38:59 smithi047 bash[22744]: audit 2024-09-16T09:38:58.519058+0000 mgr.a (mgr.14373) 10461 : audit [DBG] from='client.230451 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:39:00.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:38:59 smithi157 bash[24585]: cluster 2024-09-16T09:38:58.039867+0000 mgr.a (mgr.14373) 10460 : cluster [DBG] pgmap v7254: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:39:00.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:38:59 smithi157 bash[24585]: audit 2024-09-16T09:38:58.519058+0000 mgr.a (mgr.14373) 10461 : audit [DBG] from='client.230451 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:39:01.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:39:00 smithi157 bash[24585]: cluster 2024-09-16T09:39:00.040849+0000 mgr.a (mgr.14373) 10462 : cluster [DBG] pgmap v7255: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:39:01.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:39:00 smithi086 bash[24289]: cluster 2024-09-16T09:39:00.040849+0000 mgr.a (mgr.14373) 10462 : cluster [DBG] pgmap v7255: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:39:01.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:39:00 smithi047 bash[22744]: cluster 2024-09-16T09:39:00.040849+0000 mgr.a (mgr.14373) 10462 : cluster [DBG] pgmap v7255: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:39:03.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:39:03 smithi157 bash[24585]: cluster 2024-09-16T09:39:02.043070+0000 mgr.a (mgr.14373) 10463 : cluster [DBG] pgmap v7256: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:39:03.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:39:03 smithi086 bash[24289]: cluster 2024-09-16T09:39:02.043070+0000 mgr.a (mgr.14373) 10463 : cluster [DBG] pgmap v7256: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:39:03.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:39:03 smithi047 bash[22744]: cluster 2024-09-16T09:39:02.043070+0000 mgr.a (mgr.14373) 10463 : cluster [DBG] pgmap v7256: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:39:03.935 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:39:03.936 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:39:03.936 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:39:04.692 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:39:04.692 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:39:04.692 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:39:04.693 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:39:04.693 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:39:05.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:39:05 smithi157 bash[24585]: cluster 2024-09-16T09:39:04.043539+0000 mgr.a (mgr.14373) 10464 : cluster [DBG] pgmap v7257: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:39:05.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:39:05 smithi157 bash[24585]: audit 2024-09-16T09:39:04.268812+0000 mgr.a (mgr.14373) 10465 : audit [DBG] from='client.230523 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:39:05.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:39:05 smithi086 bash[24289]: cluster 2024-09-16T09:39:04.043539+0000 mgr.a (mgr.14373) 10464 : cluster [DBG] pgmap v7257: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:39:05.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:39:05 smithi086 bash[24289]: audit 2024-09-16T09:39:04.268812+0000 mgr.a (mgr.14373) 10465 : audit [DBG] from='client.230523 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:39:05.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:39:05 smithi047 bash[22744]: cluster 2024-09-16T09:39:04.043539+0000 mgr.a (mgr.14373) 10464 : cluster [DBG] pgmap v7257: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:39:05.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:39:05 smithi047 bash[22744]: audit 2024-09-16T09:39:04.268812+0000 mgr.a (mgr.14373) 10465 : audit [DBG] from='client.230523 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:39:07.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:39:07 smithi157 bash[24585]: cluster 2024-09-16T09:39:06.044407+0000 mgr.a (mgr.14373) 10466 : cluster [DBG] pgmap v7258: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:39:07.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:39:07 smithi086 bash[24289]: cluster 2024-09-16T09:39:06.044407+0000 mgr.a (mgr.14373) 10466 : cluster [DBG] pgmap v7258: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:39:07.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:39:07 smithi047 bash[22744]: cluster 2024-09-16T09:39:06.044407+0000 mgr.a (mgr.14373) 10466 : cluster [DBG] pgmap v7258: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:39:09.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:39:09 smithi157 bash[24585]: cluster 2024-09-16T09:39:08.046688+0000 mgr.a (mgr.14373) 10467 : cluster [DBG] pgmap v7259: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:39:09.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:39:09 smithi086 bash[24289]: cluster 2024-09-16T09:39:08.046688+0000 mgr.a (mgr.14373) 10467 : cluster [DBG] pgmap v7259: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:39:09.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:39:09 smithi047 bash[22744]: cluster 2024-09-16T09:39:08.046688+0000 mgr.a (mgr.14373) 10467 : cluster [DBG] pgmap v7259: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:39:09.693 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:39:09.695 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:39:09.695 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:39:10.444 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:39:10.444 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:39:10.444 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:39:10.444 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:39:10.444 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:39:10.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:39:10 smithi157 bash[24585]: audit 2024-09-16T09:39:10.072207+0000 mon.b (mon.2) 970 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T09:39:10.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:39:10 smithi086 bash[24289]: audit 2024-09-16T09:39:10.072207+0000 mon.b (mon.2) 970 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T09:39:10.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:39:10 smithi047 bash[22744]: audit 2024-09-16T09:39:10.072207+0000 mon.b (mon.2) 970 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T09:39:11.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:39:11 smithi157 bash[24585]: audit 2024-09-16T09:39:10.020860+0000 mgr.a (mgr.14373) 10468 : audit [DBG] from='client.230598 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:39:11.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:39:11 smithi157 bash[24585]: cluster 2024-09-16T09:39:10.047681+0000 mgr.a (mgr.14373) 10469 : cluster [DBG] pgmap v7260: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:39:11.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:39:11 smithi086 bash[24289]: audit 2024-09-16T09:39:10.020860+0000 mgr.a (mgr.14373) 10468 : audit [DBG] from='client.230598 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:39:11.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:39:11 smithi086 bash[24289]: cluster 2024-09-16T09:39:10.047681+0000 mgr.a (mgr.14373) 10469 : cluster [DBG] pgmap v7260: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:39:11.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:39:11 smithi047 bash[22744]: audit 2024-09-16T09:39:10.020860+0000 mgr.a (mgr.14373) 10468 : audit [DBG] from='client.230598 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:39:11.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:39:11 smithi047 bash[22744]: cluster 2024-09-16T09:39:10.047681+0000 mgr.a (mgr.14373) 10469 : cluster [DBG] pgmap v7260: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:39:13.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:39:13 smithi157 bash[24585]: cluster 2024-09-16T09:39:12.049974+0000 mgr.a (mgr.14373) 10470 : cluster [DBG] pgmap v7261: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:39:13.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:39:13 smithi086 bash[24289]: cluster 2024-09-16T09:39:12.049974+0000 mgr.a (mgr.14373) 10470 : cluster [DBG] pgmap v7261: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:39:13.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:39:13 smithi047 bash[22744]: cluster 2024-09-16T09:39:12.049974+0000 mgr.a (mgr.14373) 10470 : cluster [DBG] pgmap v7261: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:39:15.445 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:39:15.446 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:39:15.446 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:39:15.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:39:15 smithi157 bash[24585]: cluster 2024-09-16T09:39:14.050816+0000 mgr.a (mgr.14373) 10471 : cluster [DBG] pgmap v7262: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:39:15.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:39:15 smithi086 bash[24289]: cluster 2024-09-16T09:39:14.050816+0000 mgr.a (mgr.14373) 10471 : cluster [DBG] pgmap v7262: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:39:15.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:39:15 smithi047 bash[22744]: cluster 2024-09-16T09:39:14.050816+0000 mgr.a (mgr.14373) 10471 : cluster [DBG] pgmap v7262: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:39:16.223 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:39:16.224 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:39:16.224 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:39:16.224 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:39:16.224 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:39:17.444 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:39:17 smithi047 bash[22744]: audit 2024-09-16T09:39:15.774960+0000 mgr.a (mgr.14373) 10472 : audit [DBG] from='client.230673 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:39:17.444 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:39:17 smithi047 bash[22744]: cluster 2024-09-16T09:39:16.051382+0000 mgr.a (mgr.14373) 10473 : cluster [DBG] pgmap v7263: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:39:17.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:39:17 smithi157 bash[24585]: audit 2024-09-16T09:39:15.774960+0000 mgr.a (mgr.14373) 10472 : audit [DBG] from='client.230673 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:39:17.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:39:17 smithi157 bash[24585]: cluster 2024-09-16T09:39:16.051382+0000 mgr.a (mgr.14373) 10473 : cluster [DBG] pgmap v7263: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:39:17.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:39:17 smithi086 bash[24289]: audit 2024-09-16T09:39:15.774960+0000 mgr.a (mgr.14373) 10472 : audit [DBG] from='client.230673 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:39:17.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:39:17 smithi086 bash[24289]: cluster 2024-09-16T09:39:16.051382+0000 mgr.a (mgr.14373) 10473 : cluster [DBG] pgmap v7263: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:39:19.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:39:19 smithi047 bash[22744]: cluster 2024-09-16T09:39:18.053758+0000 mgr.a (mgr.14373) 10474 : cluster [DBG] pgmap v7264: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:39:19.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:39:19 smithi157 bash[24585]: cluster 2024-09-16T09:39:18.053758+0000 mgr.a (mgr.14373) 10474 : cluster [DBG] pgmap v7264: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:39:19.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:39:19 smithi086 bash[24289]: cluster 2024-09-16T09:39:18.053758+0000 mgr.a (mgr.14373) 10474 : cluster [DBG] pgmap v7264: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:39:21.225 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:39:21.225 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:39:21.225 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:39:21.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:39:21 smithi157 bash[24585]: cluster 2024-09-16T09:39:20.054658+0000 mgr.a (mgr.14373) 10475 : cluster [DBG] pgmap v7265: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:39:21.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:39:21 smithi157 bash[24585]: audit 2024-09-16T09:39:20.837846+0000 mon.a (mon.0) 1186 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:39:21.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:39:21 smithi157 bash[24585]: audit 2024-09-16T09:39:20.848807+0000 mon.a (mon.0) 1187 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:39:21.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:39:21 smithi157 bash[24585]: audit 2024-09-16T09:39:20.852311+0000 mon.b (mon.2) 971 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:39:21.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:39:21 smithi157 bash[24585]: audit 2024-09-16T09:39:20.854862+0000 mon.b (mon.2) 972 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T09:39:21.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:39:21 smithi157 bash[24585]: audit 2024-09-16T09:39:20.866081+0000 mon.a (mon.0) 1188 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:39:21.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:39:21 smithi157 bash[24585]: audit 2024-09-16T09:39:20.873112+0000 mon.b (mon.2) 973 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:39:21.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:39:21 smithi086 bash[24289]: cluster 2024-09-16T09:39:20.054658+0000 mgr.a (mgr.14373) 10475 : cluster [DBG] pgmap v7265: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:39:21.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:39:21 smithi086 bash[24289]: audit 2024-09-16T09:39:20.837846+0000 mon.a (mon.0) 1186 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:39:21.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:39:21 smithi086 bash[24289]: audit 2024-09-16T09:39:20.848807+0000 mon.a (mon.0) 1187 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:39:21.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:39:21 smithi086 bash[24289]: audit 2024-09-16T09:39:20.852311+0000 mon.b (mon.2) 971 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:39:21.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:39:21 smithi086 bash[24289]: audit 2024-09-16T09:39:20.854862+0000 mon.b (mon.2) 972 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T09:39:21.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:39:21 smithi086 bash[24289]: audit 2024-09-16T09:39:20.866081+0000 mon.a (mon.0) 1188 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:39:21.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:39:21 smithi086 bash[24289]: audit 2024-09-16T09:39:20.873112+0000 mon.b (mon.2) 973 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:39:21.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:39:21 smithi047 bash[22744]: cluster 2024-09-16T09:39:20.054658+0000 mgr.a (mgr.14373) 10475 : cluster [DBG] pgmap v7265: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:39:21.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:39:21 smithi047 bash[22744]: audit 2024-09-16T09:39:20.837846+0000 mon.a (mon.0) 1186 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:39:21.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:39:21 smithi047 bash[22744]: audit 2024-09-16T09:39:20.848807+0000 mon.a (mon.0) 1187 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:39:21.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:39:21 smithi047 bash[22744]: audit 2024-09-16T09:39:20.852311+0000 mon.b (mon.2) 971 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:39:21.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:39:21 smithi047 bash[22744]: audit 2024-09-16T09:39:20.854862+0000 mon.b (mon.2) 972 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T09:39:21.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:39:21 smithi047 bash[22744]: audit 2024-09-16T09:39:20.866081+0000 mon.a (mon.0) 1188 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:39:21.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:39:21 smithi047 bash[22744]: audit 2024-09-16T09:39:20.873112+0000 mon.b (mon.2) 973 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:39:22.071 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:39:22.071 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:39:22.071 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:39:22.072 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:39:22.072 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:39:22.092 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 09:39:21 smithi047 bash[22994]: debug 2024-09-16T09:39:21.657+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T09:39:22.092 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 09:39:21 smithi047 bash[22994]: debug 2024-09-16T09:39:21.669+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T09:39:22.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:39:22 smithi157 bash[24585]: audit 2024-09-16T09:39:20.874865+0000 mgr.a (mgr.14373) 10476 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:39:22.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:39:22 smithi157 bash[24585]: audit 2024-09-16T09:39:21.559518+0000 mgr.a (mgr.14373) 10477 : audit [DBG] from='client.230814 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:39:22.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:39:22 smithi086 bash[24289]: audit 2024-09-16T09:39:20.874865+0000 mgr.a (mgr.14373) 10476 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:39:22.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:39:22 smithi086 bash[24289]: audit 2024-09-16T09:39:21.559518+0000 mgr.a (mgr.14373) 10477 : audit [DBG] from='client.230814 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:39:22.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:39:22 smithi047 bash[22744]: audit 2024-09-16T09:39:20.874865+0000 mgr.a (mgr.14373) 10476 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:39:22.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:39:22 smithi047 bash[22744]: audit 2024-09-16T09:39:21.559518+0000 mgr.a (mgr.14373) 10477 : audit [DBG] from='client.230814 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:39:23.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:39:23 smithi157 bash[24585]: audit 2024-09-16T09:39:21.660069+0000 mgr.a (mgr.14373) 10478 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T09:39:23.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:39:23 smithi157 bash[24585]: cephadm 2024-09-16T09:39:21.671295+0000 mgr.a (mgr.14373) 10479 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T09:39:23.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:39:23 smithi157 bash[24585]: cluster 2024-09-16T09:39:22.055915+0000 mgr.a (mgr.14373) 10480 : cluster [DBG] pgmap v7266: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 4.3 KiB/s rd, 255 B/s wr, 4 op/s 2024-09-16T09:39:23.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:39:23 smithi086 bash[24289]: audit 2024-09-16T09:39:21.660069+0000 mgr.a (mgr.14373) 10478 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T09:39:23.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:39:23 smithi086 bash[24289]: cephadm 2024-09-16T09:39:21.671295+0000 mgr.a (mgr.14373) 10479 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T09:39:23.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:39:23 smithi086 bash[24289]: cluster 2024-09-16T09:39:22.055915+0000 mgr.a (mgr.14373) 10480 : cluster [DBG] pgmap v7266: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 4.3 KiB/s rd, 255 B/s wr, 4 op/s 2024-09-16T09:39:23.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:39:23 smithi047 bash[22744]: audit 2024-09-16T09:39:21.660069+0000 mgr.a (mgr.14373) 10478 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T09:39:23.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:39:23 smithi047 bash[22744]: cephadm 2024-09-16T09:39:21.671295+0000 mgr.a (mgr.14373) 10479 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T09:39:23.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:39:23 smithi047 bash[22744]: cluster 2024-09-16T09:39:22.055915+0000 mgr.a (mgr.14373) 10480 : cluster [DBG] pgmap v7266: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 4.3 KiB/s rd, 255 B/s wr, 4 op/s 2024-09-16T09:39:25.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:39:25 smithi157 bash[24585]: cluster 2024-09-16T09:39:24.056797+0000 mgr.a (mgr.14373) 10481 : cluster [DBG] pgmap v7267: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 3.4 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-16T09:39:25.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:39:25 smithi086 bash[24289]: cluster 2024-09-16T09:39:24.056797+0000 mgr.a (mgr.14373) 10481 : cluster [DBG] pgmap v7267: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 3.4 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-16T09:39:25.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:39:25 smithi047 bash[22744]: cluster 2024-09-16T09:39:24.056797+0000 mgr.a (mgr.14373) 10481 : cluster [DBG] pgmap v7267: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 3.4 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-16T09:39:27.073 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:39:27.073 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:39:27.073 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:39:27.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:39:27 smithi157 bash[24585]: cluster 2024-09-16T09:39:26.057739+0000 mgr.a (mgr.14373) 10482 : cluster [DBG] pgmap v7268: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 3.4 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-16T09:39:27.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:39:27 smithi086 bash[24289]: cluster 2024-09-16T09:39:26.057739+0000 mgr.a (mgr.14373) 10482 : cluster [DBG] pgmap v7268: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 3.4 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-16T09:39:27.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:39:27 smithi047 bash[22744]: cluster 2024-09-16T09:39:26.057739+0000 mgr.a (mgr.14373) 10482 : cluster [DBG] pgmap v7268: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 3.4 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-16T09:39:27.830 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:39:27.831 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:39:27.831 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:39:27.831 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:39:27.831 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:39:28.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:39:28 smithi157 bash[24585]: audit 2024-09-16T09:39:27.405715+0000 mgr.a (mgr.14373) 10483 : audit [DBG] from='client.230928 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:39:28.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:39:28 smithi086 bash[24289]: audit 2024-09-16T09:39:27.405715+0000 mgr.a (mgr.14373) 10483 : audit [DBG] from='client.230928 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:39:28.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:39:28 smithi047 bash[22744]: audit 2024-09-16T09:39:27.405715+0000 mgr.a (mgr.14373) 10483 : audit [DBG] from='client.230928 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:39:29.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:39:29 smithi157 bash[24585]: cluster 2024-09-16T09:39:28.059934+0000 mgr.a (mgr.14373) 10484 : cluster [DBG] pgmap v7269: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:39:29.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:39:29 smithi086 bash[24289]: cluster 2024-09-16T09:39:28.059934+0000 mgr.a (mgr.14373) 10484 : cluster [DBG] pgmap v7269: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:39:29.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:39:29 smithi047 bash[22744]: cluster 2024-09-16T09:39:28.059934+0000 mgr.a (mgr.14373) 10484 : cluster [DBG] pgmap v7269: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:39:31.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:39:31 smithi157 bash[24585]: cluster 2024-09-16T09:39:30.060719+0000 mgr.a (mgr.14373) 10485 : cluster [DBG] pgmap v7270: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T09:39:31.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:39:31 smithi086 bash[24289]: cluster 2024-09-16T09:39:30.060719+0000 mgr.a (mgr.14373) 10485 : cluster [DBG] pgmap v7270: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T09:39:31.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:39:31 smithi047 bash[22744]: cluster 2024-09-16T09:39:30.060719+0000 mgr.a (mgr.14373) 10485 : cluster [DBG] pgmap v7270: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T09:39:32.832 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:39:32.833 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:39:32.833 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:39:33.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:39:33 smithi157 bash[24585]: cluster 2024-09-16T09:39:32.062710+0000 mgr.a (mgr.14373) 10486 : cluster [DBG] pgmap v7271: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:39:33.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:39:33 smithi086 bash[24289]: cluster 2024-09-16T09:39:32.062710+0000 mgr.a (mgr.14373) 10486 : cluster [DBG] pgmap v7271: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:39:33.578 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:39:33.578 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:39:33.579 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:39:33.579 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:39:33.579 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:39:33.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:39:33 smithi047 bash[22744]: cluster 2024-09-16T09:39:32.062710+0000 mgr.a (mgr.14373) 10486 : cluster [DBG] pgmap v7271: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:39:34.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:39:34 smithi157 bash[24585]: audit 2024-09-16T09:39:33.165791+0000 mgr.a (mgr.14373) 10487 : audit [DBG] from='client.231006 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:39:34.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:39:34 smithi086 bash[24289]: audit 2024-09-16T09:39:33.165791+0000 mgr.a (mgr.14373) 10487 : audit [DBG] from='client.231006 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:39:34.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:39:34 smithi047 bash[22744]: audit 2024-09-16T09:39:33.165791+0000 mgr.a (mgr.14373) 10487 : audit [DBG] from='client.231006 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:39:35.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:39:35 smithi157 bash[24585]: cluster 2024-09-16T09:39:34.063675+0000 mgr.a (mgr.14373) 10488 : cluster [DBG] pgmap v7272: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 4.5 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-16T09:39:35.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:39:35 smithi086 bash[24289]: cluster 2024-09-16T09:39:34.063675+0000 mgr.a (mgr.14373) 10488 : cluster [DBG] pgmap v7272: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 4.5 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-16T09:39:35.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:39:35 smithi047 bash[22744]: cluster 2024-09-16T09:39:34.063675+0000 mgr.a (mgr.14373) 10488 : cluster [DBG] pgmap v7272: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 4.5 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-16T09:39:37.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:39:37 smithi157 bash[24585]: cluster 2024-09-16T09:39:36.064456+0000 mgr.a (mgr.14373) 10489 : cluster [DBG] pgmap v7273: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 4.5 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-16T09:39:37.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:39:37 smithi086 bash[24289]: cluster 2024-09-16T09:39:36.064456+0000 mgr.a (mgr.14373) 10489 : cluster [DBG] pgmap v7273: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 4.5 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-16T09:39:37.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:39:37 smithi047 bash[22744]: cluster 2024-09-16T09:39:36.064456+0000 mgr.a (mgr.14373) 10489 : cluster [DBG] pgmap v7273: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 4.5 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-16T09:39:38.580 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:39:38.581 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:39:38.581 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:39:39.337 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:39:39.337 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:39:39.337 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:39:39.337 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:39:39.337 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:39:39.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:39:39 smithi157 bash[24585]: cluster 2024-09-16T09:39:38.066689+0000 mgr.a (mgr.14373) 10490 : cluster [DBG] pgmap v7274: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 5.4 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-16T09:39:39.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:39:39 smithi086 bash[24289]: cluster 2024-09-16T09:39:38.066689+0000 mgr.a (mgr.14373) 10490 : cluster [DBG] pgmap v7274: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 5.4 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-16T09:39:39.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:39:39 smithi047 bash[22744]: cluster 2024-09-16T09:39:38.066689+0000 mgr.a (mgr.14373) 10490 : cluster [DBG] pgmap v7274: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 5.4 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-16T09:39:40.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:39:40 smithi157 bash[24585]: audit 2024-09-16T09:39:38.910071+0000 mgr.a (mgr.14373) 10491 : audit [DBG] from='client.231084 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:39:40.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:39:40 smithi086 bash[24289]: audit 2024-09-16T09:39:38.910071+0000 mgr.a (mgr.14373) 10491 : audit [DBG] from='client.231084 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:39:40.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:39:40 smithi047 bash[22744]: audit 2024-09-16T09:39:38.910071+0000 mgr.a (mgr.14373) 10491 : audit [DBG] from='client.231084 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:39:41.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:39:41 smithi157 bash[24585]: cluster 2024-09-16T09:39:40.067674+0000 mgr.a (mgr.14373) 10492 : cluster [DBG] pgmap v7275: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:39:41.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:39:41 smithi086 bash[24289]: cluster 2024-09-16T09:39:40.067674+0000 mgr.a (mgr.14373) 10492 : cluster [DBG] pgmap v7275: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:39:41.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:39:41 smithi047 bash[22744]: cluster 2024-09-16T09:39:40.067674+0000 mgr.a (mgr.14373) 10492 : cluster [DBG] pgmap v7275: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:39:43.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:39:43 smithi157 bash[24585]: cluster 2024-09-16T09:39:42.069865+0000 mgr.a (mgr.14373) 10493 : cluster [DBG] pgmap v7276: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:39:43.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:39:43 smithi086 bash[24289]: cluster 2024-09-16T09:39:42.069865+0000 mgr.a (mgr.14373) 10493 : cluster [DBG] pgmap v7276: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:39:43.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:39:43 smithi047 bash[22744]: cluster 2024-09-16T09:39:42.069865+0000 mgr.a (mgr.14373) 10493 : cluster [DBG] pgmap v7276: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:39:44.338 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:39:44.339 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:39:44.339 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:39:45.084 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:39:45.085 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:39:45.085 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:39:45.085 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:39:45.085 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:39:45.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:39:45 smithi157 bash[24585]: cluster 2024-09-16T09:39:44.070628+0000 mgr.a (mgr.14373) 10494 : cluster [DBG] pgmap v7277: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:39:45.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:39:45 smithi086 bash[24289]: cluster 2024-09-16T09:39:44.070628+0000 mgr.a (mgr.14373) 10494 : cluster [DBG] pgmap v7277: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:39:45.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:39:45 smithi047 bash[22744]: cluster 2024-09-16T09:39:44.070628+0000 mgr.a (mgr.14373) 10494 : cluster [DBG] pgmap v7277: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:39:46.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:39:46 smithi157 bash[24585]: audit 2024-09-16T09:39:44.668582+0000 mgr.a (mgr.14373) 10495 : audit [DBG] from='client.231162 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:39:46.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:39:46 smithi086 bash[24289]: audit 2024-09-16T09:39:44.668582+0000 mgr.a (mgr.14373) 10495 : audit [DBG] from='client.231162 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:39:46.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:39:46 smithi047 bash[22744]: audit 2024-09-16T09:39:44.668582+0000 mgr.a (mgr.14373) 10495 : audit [DBG] from='client.231162 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:39:47.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:39:47 smithi157 bash[24585]: cluster 2024-09-16T09:39:46.071681+0000 mgr.a (mgr.14373) 10496 : cluster [DBG] pgmap v7278: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:39:47.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:39:47 smithi086 bash[24289]: cluster 2024-09-16T09:39:46.071681+0000 mgr.a (mgr.14373) 10496 : cluster [DBG] pgmap v7278: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:39:47.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:39:47 smithi047 bash[22744]: cluster 2024-09-16T09:39:46.071681+0000 mgr.a (mgr.14373) 10496 : cluster [DBG] pgmap v7278: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:39:49.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:39:49 smithi157 bash[24585]: cluster 2024-09-16T09:39:48.074053+0000 mgr.a (mgr.14373) 10497 : cluster [DBG] pgmap v7279: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:39:49.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:39:49 smithi086 bash[24289]: cluster 2024-09-16T09:39:48.074053+0000 mgr.a (mgr.14373) 10497 : cluster [DBG] pgmap v7279: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:39:49.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:39:49 smithi047 bash[22744]: cluster 2024-09-16T09:39:48.074053+0000 mgr.a (mgr.14373) 10497 : cluster [DBG] pgmap v7279: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:39:50.085 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:39:50.086 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:39:50.087 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:39:50.842 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:39:50.842 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:39:50.842 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:39:50.842 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:39:50.843 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:39:51.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:39:51 smithi157 bash[24585]: cluster 2024-09-16T09:39:50.074955+0000 mgr.a (mgr.14373) 10498 : cluster [DBG] pgmap v7280: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:39:51.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:39:51 smithi157 bash[24585]: audit 2024-09-16T09:39:50.419693+0000 mgr.a (mgr.14373) 10499 : audit [DBG] from='client.231240 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:39:51.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:39:51 smithi086 bash[24289]: cluster 2024-09-16T09:39:50.074955+0000 mgr.a (mgr.14373) 10498 : cluster [DBG] pgmap v7280: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:39:51.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:39:51 smithi086 bash[24289]: audit 2024-09-16T09:39:50.419693+0000 mgr.a (mgr.14373) 10499 : audit [DBG] from='client.231240 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:39:51.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:39:51 smithi047 bash[22744]: cluster 2024-09-16T09:39:50.074955+0000 mgr.a (mgr.14373) 10498 : cluster [DBG] pgmap v7280: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:39:51.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:39:51 smithi047 bash[22744]: audit 2024-09-16T09:39:50.419693+0000 mgr.a (mgr.14373) 10499 : audit [DBG] from='client.231240 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:39:53.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:39:53 smithi157 bash[24585]: cluster 2024-09-16T09:39:52.077291+0000 mgr.a (mgr.14373) 10500 : cluster [DBG] pgmap v7281: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:39:53.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:39:53 smithi086 bash[24289]: cluster 2024-09-16T09:39:52.077291+0000 mgr.a (mgr.14373) 10500 : cluster [DBG] pgmap v7281: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:39:53.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:39:53 smithi047 bash[22744]: cluster 2024-09-16T09:39:52.077291+0000 mgr.a (mgr.14373) 10500 : cluster [DBG] pgmap v7281: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:39:55.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:39:55 smithi157 bash[24585]: cluster 2024-09-16T09:39:54.078058+0000 mgr.a (mgr.14373) 10501 : cluster [DBG] pgmap v7282: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:39:55.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:39:55 smithi086 bash[24289]: cluster 2024-09-16T09:39:54.078058+0000 mgr.a (mgr.14373) 10501 : cluster [DBG] pgmap v7282: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:39:55.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:39:55 smithi047 bash[22744]: cluster 2024-09-16T09:39:54.078058+0000 mgr.a (mgr.14373) 10501 : cluster [DBG] pgmap v7282: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:39:55.844 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:39:55.844 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:39:55.845 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:39:56.627 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:39:56.627 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:39:56.628 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:39:56.628 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:39:56.628 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:39:57.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:39:57 smithi157 bash[24585]: cluster 2024-09-16T09:39:56.078818+0000 mgr.a (mgr.14373) 10502 : cluster [DBG] pgmap v7283: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:39:57.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:39:57 smithi157 bash[24585]: audit 2024-09-16T09:39:56.174955+0000 mgr.a (mgr.14373) 10503 : audit [DBG] from='client.231315 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:39:57.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:39:57 smithi086 bash[24289]: cluster 2024-09-16T09:39:56.078818+0000 mgr.a (mgr.14373) 10502 : cluster [DBG] pgmap v7283: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:39:57.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:39:57 smithi086 bash[24289]: audit 2024-09-16T09:39:56.174955+0000 mgr.a (mgr.14373) 10503 : audit [DBG] from='client.231315 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:39:57.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:39:57 smithi047 bash[22744]: cluster 2024-09-16T09:39:56.078818+0000 mgr.a (mgr.14373) 10502 : cluster [DBG] pgmap v7283: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:39:57.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:39:57 smithi047 bash[22744]: audit 2024-09-16T09:39:56.174955+0000 mgr.a (mgr.14373) 10503 : audit [DBG] from='client.231315 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:39:59.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:39:59 smithi157 bash[24585]: cluster 2024-09-16T09:39:58.081194+0000 mgr.a (mgr.14373) 10504 : cluster [DBG] pgmap v7284: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-16T09:39:59.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:39:59 smithi086 bash[24289]: cluster 2024-09-16T09:39:58.081194+0000 mgr.a (mgr.14373) 10504 : cluster [DBG] pgmap v7284: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-16T09:39:59.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:39:59 smithi047 bash[22744]: cluster 2024-09-16T09:39:58.081194+0000 mgr.a (mgr.14373) 10504 : cluster [DBG] pgmap v7284: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-16T09:40:00.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:40:00 smithi157 bash[24585]: cluster 2024-09-16T09:40:00.000155+0000 mon.a (mon.0) 1189 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-16T09:40:00.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:40:00 smithi086 bash[24289]: cluster 2024-09-16T09:40:00.000155+0000 mon.a (mon.0) 1189 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-16T09:40:00.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:40:00 smithi047 bash[22744]: cluster 2024-09-16T09:40:00.000155+0000 mon.a (mon.0) 1189 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-16T09:40:01.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:40:01 smithi157 bash[24585]: cluster 2024-09-16T09:40:00.081954+0000 mgr.a (mgr.14373) 10505 : cluster [DBG] pgmap v7285: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-16T09:40:01.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:40:01 smithi086 bash[24289]: cluster 2024-09-16T09:40:00.081954+0000 mgr.a (mgr.14373) 10505 : cluster [DBG] pgmap v7285: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-16T09:40:01.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:40:01 smithi047 bash[22744]: cluster 2024-09-16T09:40:00.081954+0000 mgr.a (mgr.14373) 10505 : cluster [DBG] pgmap v7285: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-16T09:40:01.629 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:40:01.629 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:40:01.629 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:40:02.416 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:40:02.417 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:40:02.417 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:40:02.417 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:40:02.417 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:40:03.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:40:03 smithi157 bash[24585]: audit 2024-09-16T09:40:01.965888+0000 mgr.a (mgr.14373) 10506 : audit [DBG] from='client.231390 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:40:03.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:40:03 smithi157 bash[24585]: cluster 2024-09-16T09:40:02.083313+0000 mgr.a (mgr.14373) 10507 : cluster [DBG] pgmap v7286: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:40:03.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:40:03 smithi086 bash[24289]: audit 2024-09-16T09:40:01.965888+0000 mgr.a (mgr.14373) 10506 : audit [DBG] from='client.231390 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:40:03.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:40:03 smithi086 bash[24289]: cluster 2024-09-16T09:40:02.083313+0000 mgr.a (mgr.14373) 10507 : cluster [DBG] pgmap v7286: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:40:03.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:40:03 smithi047 bash[22744]: audit 2024-09-16T09:40:01.965888+0000 mgr.a (mgr.14373) 10506 : audit [DBG] from='client.231390 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:40:03.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:40:03 smithi047 bash[22744]: cluster 2024-09-16T09:40:02.083313+0000 mgr.a (mgr.14373) 10507 : cluster [DBG] pgmap v7286: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:40:05.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:40:05 smithi157 bash[24585]: cluster 2024-09-16T09:40:04.084358+0000 mgr.a (mgr.14373) 10508 : cluster [DBG] pgmap v7287: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T09:40:05.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:40:05 smithi086 bash[24289]: cluster 2024-09-16T09:40:04.084358+0000 mgr.a (mgr.14373) 10508 : cluster [DBG] pgmap v7287: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T09:40:05.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:40:05 smithi047 bash[22744]: cluster 2024-09-16T09:40:04.084358+0000 mgr.a (mgr.14373) 10508 : cluster [DBG] pgmap v7287: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T09:40:07.418 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:40:07.419 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:40:07.419 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:40:07.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:40:07 smithi157 bash[24585]: cluster 2024-09-16T09:40:06.085303+0000 mgr.a (mgr.14373) 10509 : cluster [DBG] pgmap v7288: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T09:40:07.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:40:07 smithi086 bash[24289]: cluster 2024-09-16T09:40:06.085303+0000 mgr.a (mgr.14373) 10509 : cluster [DBG] pgmap v7288: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T09:40:07.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:40:07 smithi047 bash[22744]: cluster 2024-09-16T09:40:06.085303+0000 mgr.a (mgr.14373) 10509 : cluster [DBG] pgmap v7288: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T09:40:08.176 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:40:08.176 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:40:08.176 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:40:08.177 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:40:08.177 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:40:09.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:40:09 smithi157 bash[24585]: audit 2024-09-16T09:40:07.748340+0000 mgr.a (mgr.14373) 10510 : audit [DBG] from='client.231465 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:40:09.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:40:09 smithi157 bash[24585]: cluster 2024-09-16T09:40:08.086746+0000 mgr.a (mgr.14373) 10511 : cluster [DBG] pgmap v7289: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:40:09.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:40:09 smithi086 bash[24289]: audit 2024-09-16T09:40:07.748340+0000 mgr.a (mgr.14373) 10510 : audit [DBG] from='client.231465 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:40:09.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:40:09 smithi086 bash[24289]: cluster 2024-09-16T09:40:08.086746+0000 mgr.a (mgr.14373) 10511 : cluster [DBG] pgmap v7289: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:40:09.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:40:09 smithi047 bash[22744]: audit 2024-09-16T09:40:07.748340+0000 mgr.a (mgr.14373) 10510 : audit [DBG] from='client.231465 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:40:09.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:40:09 smithi047 bash[22744]: cluster 2024-09-16T09:40:08.086746+0000 mgr.a (mgr.14373) 10511 : cluster [DBG] pgmap v7289: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:40:11.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:40:11 smithi157 bash[24585]: cluster 2024-09-16T09:40:10.087498+0000 mgr.a (mgr.14373) 10512 : cluster [DBG] pgmap v7290: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-16T09:40:11.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:40:11 smithi086 bash[24289]: cluster 2024-09-16T09:40:10.087498+0000 mgr.a (mgr.14373) 10512 : cluster [DBG] pgmap v7290: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-16T09:40:11.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:40:11 smithi047 bash[22744]: cluster 2024-09-16T09:40:10.087498+0000 mgr.a (mgr.14373) 10512 : cluster [DBG] pgmap v7290: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-16T09:40:13.178 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:40:13.179 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:40:13.179 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:40:13.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:40:13 smithi157 bash[24585]: cluster 2024-09-16T09:40:12.089381+0000 mgr.a (mgr.14373) 10513 : cluster [DBG] pgmap v7291: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:40:13.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:40:13 smithi086 bash[24289]: cluster 2024-09-16T09:40:12.089381+0000 mgr.a (mgr.14373) 10513 : cluster [DBG] pgmap v7291: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:40:13.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:40:13 smithi047 bash[22744]: cluster 2024-09-16T09:40:12.089381+0000 mgr.a (mgr.14373) 10513 : cluster [DBG] pgmap v7291: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:40:13.968 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:40:13.969 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:40:13.969 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:40:13.969 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:40:13.969 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:40:14.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:40:14 smithi157 bash[24585]: audit 2024-09-16T09:40:13.521008+0000 mgr.a (mgr.14373) 10514 : audit [DBG] from='client.231540 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:40:14.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:40:14 smithi086 bash[24289]: audit 2024-09-16T09:40:13.521008+0000 mgr.a (mgr.14373) 10514 : audit [DBG] from='client.231540 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:40:14.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:40:14 smithi047 bash[22744]: audit 2024-09-16T09:40:13.521008+0000 mgr.a (mgr.14373) 10514 : audit [DBG] from='client.231540 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:40:15.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:40:15 smithi086 bash[24289]: cluster 2024-09-16T09:40:14.090334+0000 mgr.a (mgr.14373) 10515 : cluster [DBG] pgmap v7292: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:40:15.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:40:15 smithi047 bash[22744]: cluster 2024-09-16T09:40:14.090334+0000 mgr.a (mgr.14373) 10515 : cluster [DBG] pgmap v7292: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:40:15.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:40:15 smithi157 bash[24585]: cluster 2024-09-16T09:40:14.090334+0000 mgr.a (mgr.14373) 10515 : cluster [DBG] pgmap v7292: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:40:17.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:40:17 smithi086 bash[24289]: cluster 2024-09-16T09:40:16.091115+0000 mgr.a (mgr.14373) 10516 : cluster [DBG] pgmap v7293: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:40:17.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:40:17 smithi047 bash[22744]: cluster 2024-09-16T09:40:16.091115+0000 mgr.a (mgr.14373) 10516 : cluster [DBG] pgmap v7293: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:40:17.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:40:17 smithi157 bash[24585]: cluster 2024-09-16T09:40:16.091115+0000 mgr.a (mgr.14373) 10516 : cluster [DBG] pgmap v7293: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:40:18.970 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:40:18.971 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:40:18.971 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:40:19.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:40:19 smithi047 bash[22744]: cluster 2024-09-16T09:40:18.093315+0000 mgr.a (mgr.14373) 10517 : cluster [DBG] pgmap v7294: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:40:19.741 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:40:19.742 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:40:19.742 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:40:19.742 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:40:19.742 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:40:19.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:40:19 smithi157 bash[24585]: cluster 2024-09-16T09:40:18.093315+0000 mgr.a (mgr.14373) 10517 : cluster [DBG] pgmap v7294: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:40:19.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:40:19 smithi086 bash[24289]: cluster 2024-09-16T09:40:18.093315+0000 mgr.a (mgr.14373) 10517 : cluster [DBG] pgmap v7294: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:40:20.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:40:20 smithi047 bash[22744]: audit 2024-09-16T09:40:19.302753+0000 mgr.a (mgr.14373) 10518 : audit [DBG] from='client.231618 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:40:20.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:40:20 smithi157 bash[24585]: audit 2024-09-16T09:40:19.302753+0000 mgr.a (mgr.14373) 10518 : audit [DBG] from='client.231618 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:40:20.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:40:20 smithi086 bash[24289]: audit 2024-09-16T09:40:19.302753+0000 mgr.a (mgr.14373) 10518 : audit [DBG] from='client.231618 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:40:21.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:40:21 smithi047 bash[22744]: cluster 2024-09-16T09:40:20.094261+0000 mgr.a (mgr.14373) 10519 : cluster [DBG] pgmap v7295: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:40:21.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:40:21 smithi157 bash[24585]: cluster 2024-09-16T09:40:20.094261+0000 mgr.a (mgr.14373) 10519 : cluster [DBG] pgmap v7295: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:40:21.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:40:21 smithi086 bash[24289]: cluster 2024-09-16T09:40:20.094261+0000 mgr.a (mgr.14373) 10519 : cluster [DBG] pgmap v7295: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:40:22.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:40:22 smithi047 bash[22744]: audit 2024-09-16T09:40:21.730480+0000 mon.b (mon.2) 974 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T09:40:22.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:40:22 smithi157 bash[24585]: audit 2024-09-16T09:40:21.730480+0000 mon.b (mon.2) 974 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T09:40:22.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:40:22 smithi086 bash[24289]: audit 2024-09-16T09:40:21.730480+0000 mon.b (mon.2) 974 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T09:40:23.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:40:23 smithi047 bash[22744]: cluster 2024-09-16T09:40:22.096373+0000 mgr.a (mgr.14373) 10520 : cluster [DBG] pgmap v7296: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:40:23.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:40:23 smithi157 bash[24585]: cluster 2024-09-16T09:40:22.096373+0000 mgr.a (mgr.14373) 10520 : cluster [DBG] pgmap v7296: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:40:23.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:40:23 smithi086 bash[24289]: cluster 2024-09-16T09:40:22.096373+0000 mgr.a (mgr.14373) 10520 : cluster [DBG] pgmap v7296: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:40:24.743 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:40:24.744 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:40:24.744 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:40:25.486 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:40:25.486 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:40:25.486 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:40:25.486 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:40:25.486 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:40:25.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:40:25 smithi157 bash[24585]: cluster 2024-09-16T09:40:24.097141+0000 mgr.a (mgr.14373) 10521 : cluster [DBG] pgmap v7297: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:40:25.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:40:25 smithi086 bash[24289]: cluster 2024-09-16T09:40:24.097141+0000 mgr.a (mgr.14373) 10521 : cluster [DBG] pgmap v7297: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:40:25.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:40:25 smithi047 bash[22744]: cluster 2024-09-16T09:40:24.097141+0000 mgr.a (mgr.14373) 10521 : cluster [DBG] pgmap v7297: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:40:26.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:40:26 smithi157 bash[24585]: audit 2024-09-16T09:40:25.069764+0000 mgr.a (mgr.14373) 10522 : audit [DBG] from='client.231696 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:40:26.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:40:26 smithi086 bash[24289]: audit 2024-09-16T09:40:25.069764+0000 mgr.a (mgr.14373) 10522 : audit [DBG] from='client.231696 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:40:26.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:40:26 smithi047 bash[22744]: audit 2024-09-16T09:40:25.069764+0000 mgr.a (mgr.14373) 10522 : audit [DBG] from='client.231696 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:40:27.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:40:27 smithi157 bash[24585]: cluster 2024-09-16T09:40:26.098054+0000 mgr.a (mgr.14373) 10523 : cluster [DBG] pgmap v7298: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:40:27.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:40:27 smithi157 bash[24585]: audit 2024-09-16T09:40:27.084513+0000 mon.a (mon.0) 1190 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:40:27.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:40:27 smithi157 bash[24585]: audit 2024-09-16T09:40:27.087530+0000 mon.a (mon.0) 1191 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:40:27.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:40:27 smithi157 bash[24585]: audit 2024-09-16T09:40:27.091987+0000 mon.a (mon.0) 1192 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:40:27.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:40:27 smithi157 bash[24585]: audit 2024-09-16T09:40:27.094707+0000 mon.a (mon.0) 1193 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:40:27.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:40:27 smithi157 bash[24585]: audit 2024-09-16T09:40:27.109819+0000 mon.a (mon.0) 1194 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:40:27.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:40:27 smithi157 bash[24585]: audit 2024-09-16T09:40:27.115022+0000 mon.a (mon.0) 1195 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:40:27.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:40:27 smithi086 bash[24289]: cluster 2024-09-16T09:40:26.098054+0000 mgr.a (mgr.14373) 10523 : cluster [DBG] pgmap v7298: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:40:27.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:40:27 smithi086 bash[24289]: audit 2024-09-16T09:40:27.084513+0000 mon.a (mon.0) 1190 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:40:27.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:40:27 smithi086 bash[24289]: audit 2024-09-16T09:40:27.087530+0000 mon.a (mon.0) 1191 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:40:27.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:40:27 smithi086 bash[24289]: audit 2024-09-16T09:40:27.091987+0000 mon.a (mon.0) 1192 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:40:27.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:40:27 smithi086 bash[24289]: audit 2024-09-16T09:40:27.094707+0000 mon.a (mon.0) 1193 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:40:27.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:40:27 smithi086 bash[24289]: audit 2024-09-16T09:40:27.109819+0000 mon.a (mon.0) 1194 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:40:27.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:40:27 smithi086 bash[24289]: audit 2024-09-16T09:40:27.115022+0000 mon.a (mon.0) 1195 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:40:27.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:40:27 smithi047 bash[22744]: cluster 2024-09-16T09:40:26.098054+0000 mgr.a (mgr.14373) 10523 : cluster [DBG] pgmap v7298: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:40:27.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:40:27 smithi047 bash[22744]: audit 2024-09-16T09:40:27.084513+0000 mon.a (mon.0) 1190 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:40:27.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:40:27 smithi047 bash[22744]: audit 2024-09-16T09:40:27.087530+0000 mon.a (mon.0) 1191 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:40:27.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:40:27 smithi047 bash[22744]: audit 2024-09-16T09:40:27.091987+0000 mon.a (mon.0) 1192 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:40:27.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:40:27 smithi047 bash[22744]: audit 2024-09-16T09:40:27.094707+0000 mon.a (mon.0) 1193 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:40:27.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:40:27 smithi047 bash[22744]: audit 2024-09-16T09:40:27.109819+0000 mon.a (mon.0) 1194 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:40:27.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:40:27 smithi047 bash[22744]: audit 2024-09-16T09:40:27.115022+0000 mon.a (mon.0) 1195 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:40:29.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:40:29 smithi157 bash[24585]: cluster 2024-09-16T09:40:28.100268+0000 mgr.a (mgr.14373) 10524 : cluster [DBG] pgmap v7299: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:40:29.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:40:29 smithi086 bash[24289]: cluster 2024-09-16T09:40:28.100268+0000 mgr.a (mgr.14373) 10524 : cluster [DBG] pgmap v7299: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:40:29.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:40:29 smithi047 bash[22744]: cluster 2024-09-16T09:40:28.100268+0000 mgr.a (mgr.14373) 10524 : cluster [DBG] pgmap v7299: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:40:30.487 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:40:30.488 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:40:30.488 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:40:31.243 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:40:31.243 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:40:31.243 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:40:31.244 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:40:31.244 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:40:31.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:40:31 smithi157 bash[24585]: cluster 2024-09-16T09:40:30.101038+0000 mgr.a (mgr.14373) 10525 : cluster [DBG] pgmap v7300: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:40:31.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:40:31 smithi086 bash[24289]: cluster 2024-09-16T09:40:30.101038+0000 mgr.a (mgr.14373) 10525 : cluster [DBG] pgmap v7300: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:40:31.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:40:31 smithi047 bash[22744]: cluster 2024-09-16T09:40:30.101038+0000 mgr.a (mgr.14373) 10525 : cluster [DBG] pgmap v7300: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:40:32.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:40:32 smithi157 bash[24585]: audit 2024-09-16T09:40:30.822082+0000 mgr.a (mgr.14373) 10526 : audit [DBG] from='client.231771 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:40:32.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:40:32 smithi086 bash[24289]: audit 2024-09-16T09:40:30.822082+0000 mgr.a (mgr.14373) 10526 : audit [DBG] from='client.231771 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:40:32.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:40:32 smithi047 bash[22744]: audit 2024-09-16T09:40:30.822082+0000 mgr.a (mgr.14373) 10526 : audit [DBG] from='client.231771 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:40:33.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:40:33 smithi157 bash[24585]: cluster 2024-09-16T09:40:32.103359+0000 mgr.a (mgr.14373) 10527 : cluster [DBG] pgmap v7301: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:40:33.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:40:33 smithi086 bash[24289]: cluster 2024-09-16T09:40:32.103359+0000 mgr.a (mgr.14373) 10527 : cluster [DBG] pgmap v7301: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:40:33.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:40:33 smithi047 bash[22744]: cluster 2024-09-16T09:40:32.103359+0000 mgr.a (mgr.14373) 10527 : cluster [DBG] pgmap v7301: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:40:35.802 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:40:35 smithi086 bash[24289]: cluster 2024-09-16T09:40:34.104112+0000 mgr.a (mgr.14373) 10528 : cluster [DBG] pgmap v7302: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:40:35.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:40:35 smithi157 bash[24585]: cluster 2024-09-16T09:40:34.104112+0000 mgr.a (mgr.14373) 10528 : cluster [DBG] pgmap v7302: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:40:35.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:40:35 smithi047 bash[22744]: cluster 2024-09-16T09:40:34.104112+0000 mgr.a (mgr.14373) 10528 : cluster [DBG] pgmap v7302: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:40:36.245 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:40:36.245 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:40:36.245 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:40:36.993 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:40:36.993 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:40:36.993 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:40:36.994 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:40:36.994 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:40:37.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:40:37 smithi157 bash[24585]: cluster 2024-09-16T09:40:36.104857+0000 mgr.a (mgr.14373) 10529 : cluster [DBG] pgmap v7303: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:40:37.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:40:37 smithi157 bash[24585]: audit 2024-09-16T09:40:36.574508+0000 mgr.a (mgr.14373) 10530 : audit [DBG] from='client.231849 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:40:37.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:40:37 smithi086 bash[24289]: cluster 2024-09-16T09:40:36.104857+0000 mgr.a (mgr.14373) 10529 : cluster [DBG] pgmap v7303: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:40:37.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:40:37 smithi086 bash[24289]: audit 2024-09-16T09:40:36.574508+0000 mgr.a (mgr.14373) 10530 : audit [DBG] from='client.231849 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:40:37.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:40:37 smithi047 bash[22744]: cluster 2024-09-16T09:40:36.104857+0000 mgr.a (mgr.14373) 10529 : cluster [DBG] pgmap v7303: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:40:37.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:40:37 smithi047 bash[22744]: audit 2024-09-16T09:40:36.574508+0000 mgr.a (mgr.14373) 10530 : audit [DBG] from='client.231849 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:40:38.842 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 09:40:38 smithi047 bash[22994]: debug 2024-09-16T09:40:38.375+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T09:40:38.843 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 09:40:38 smithi047 bash[22994]: debug 2024-09-16T09:40:38.375+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T09:40:38.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:40:38 smithi047 bash[22744]: audit 2024-09-16T09:40:37.584664+0000 mon.a (mon.0) 1196 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:40:38.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:40:38 smithi047 bash[22744]: audit 2024-09-16T09:40:37.595913+0000 mon.a (mon.0) 1197 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:40:38.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:40:38 smithi047 bash[22744]: audit 2024-09-16T09:40:37.602812+0000 mon.b (mon.2) 975 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:40:38.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:40:38 smithi047 bash[22744]: audit 2024-09-16T09:40:37.605089+0000 mon.b (mon.2) 976 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T09:40:38.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:40:38 smithi047 bash[22744]: audit 2024-09-16T09:40:37.616106+0000 mon.a (mon.0) 1198 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:40:38.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:40:38 smithi047 bash[22744]: audit 2024-09-16T09:40:37.624067+0000 mon.b (mon.2) 977 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:40:38.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:40:38 smithi047 bash[22744]: audit 2024-09-16T09:40:37.626328+0000 mgr.a (mgr.14373) 10531 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:40:39.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:40:38 smithi157 bash[24585]: audit 2024-09-16T09:40:37.584664+0000 mon.a (mon.0) 1196 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:40:39.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:40:38 smithi157 bash[24585]: audit 2024-09-16T09:40:37.595913+0000 mon.a (mon.0) 1197 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:40:39.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:40:38 smithi157 bash[24585]: audit 2024-09-16T09:40:37.602812+0000 mon.b (mon.2) 975 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:40:39.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:40:38 smithi157 bash[24585]: audit 2024-09-16T09:40:37.605089+0000 mon.b (mon.2) 976 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T09:40:39.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:40:38 smithi157 bash[24585]: audit 2024-09-16T09:40:37.616106+0000 mon.a (mon.0) 1198 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:40:39.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:40:38 smithi157 bash[24585]: audit 2024-09-16T09:40:37.624067+0000 mon.b (mon.2) 977 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:40:39.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:40:38 smithi157 bash[24585]: audit 2024-09-16T09:40:37.626328+0000 mgr.a (mgr.14373) 10531 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:40:39.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:40:38 smithi086 bash[24289]: audit 2024-09-16T09:40:37.584664+0000 mon.a (mon.0) 1196 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:40:39.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:40:38 smithi086 bash[24289]: audit 2024-09-16T09:40:37.595913+0000 mon.a (mon.0) 1197 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:40:39.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:40:38 smithi086 bash[24289]: audit 2024-09-16T09:40:37.602812+0000 mon.b (mon.2) 975 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:40:39.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:40:38 smithi086 bash[24289]: audit 2024-09-16T09:40:37.605089+0000 mon.b (mon.2) 976 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T09:40:39.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:40:38 smithi086 bash[24289]: audit 2024-09-16T09:40:37.616106+0000 mon.a (mon.0) 1198 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:40:39.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:40:38 smithi086 bash[24289]: audit 2024-09-16T09:40:37.624067+0000 mon.b (mon.2) 977 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:40:39.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:40:38 smithi086 bash[24289]: audit 2024-09-16T09:40:37.626328+0000 mgr.a (mgr.14373) 10531 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:40:40.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:40:39 smithi157 bash[24585]: cluster 2024-09-16T09:40:38.107370+0000 mgr.a (mgr.14373) 10532 : cluster [DBG] pgmap v7304: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:40:40.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:40:39 smithi157 bash[24585]: audit 2024-09-16T09:40:38.379248+0000 mgr.a (mgr.14373) 10533 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T09:40:40.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:40:39 smithi157 bash[24585]: cephadm 2024-09-16T09:40:38.381094+0000 mgr.a (mgr.14373) 10534 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T09:40:40.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:40:39 smithi086 bash[24289]: cluster 2024-09-16T09:40:38.107370+0000 mgr.a (mgr.14373) 10532 : cluster [DBG] pgmap v7304: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:40:40.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:40:39 smithi086 bash[24289]: audit 2024-09-16T09:40:38.379248+0000 mgr.a (mgr.14373) 10533 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T09:40:40.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:40:39 smithi086 bash[24289]: cephadm 2024-09-16T09:40:38.381094+0000 mgr.a (mgr.14373) 10534 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T09:40:40.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:40:39 smithi047 bash[22744]: cluster 2024-09-16T09:40:38.107370+0000 mgr.a (mgr.14373) 10532 : cluster [DBG] pgmap v7304: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:40:40.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:40:39 smithi047 bash[22744]: audit 2024-09-16T09:40:38.379248+0000 mgr.a (mgr.14373) 10533 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T09:40:40.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:40:39 smithi047 bash[22744]: cephadm 2024-09-16T09:40:38.381094+0000 mgr.a (mgr.14373) 10534 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T09:40:41.995 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:40:41.995 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:40:41.995 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:40:42.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:40:41 smithi157 bash[24585]: cluster 2024-09-16T09:40:40.108321+0000 mgr.a (mgr.14373) 10535 : cluster [DBG] pgmap v7305: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:40:42.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:40:41 smithi086 bash[24289]: cluster 2024-09-16T09:40:40.108321+0000 mgr.a (mgr.14373) 10535 : cluster [DBG] pgmap v7305: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:40:42.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:40:41 smithi047 bash[22744]: cluster 2024-09-16T09:40:40.108321+0000 mgr.a (mgr.14373) 10535 : cluster [DBG] pgmap v7305: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:40:42.793 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:40:42.793 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:40:42.793 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:40:42.793 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:40:42.794 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:40:44.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:40:43 smithi157 bash[24585]: cluster 2024-09-16T09:40:42.109396+0000 mgr.a (mgr.14373) 10536 : cluster [DBG] pgmap v7306: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:40:44.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:40:43 smithi157 bash[24585]: audit 2024-09-16T09:40:42.333620+0000 mgr.a (mgr.14373) 10537 : audit [DBG] from='client.232029 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:40:44.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:40:43 smithi086 bash[24289]: cluster 2024-09-16T09:40:42.109396+0000 mgr.a (mgr.14373) 10536 : cluster [DBG] pgmap v7306: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:40:44.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:40:43 smithi086 bash[24289]: audit 2024-09-16T09:40:42.333620+0000 mgr.a (mgr.14373) 10537 : audit [DBG] from='client.232029 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:40:44.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:40:43 smithi047 bash[22744]: cluster 2024-09-16T09:40:42.109396+0000 mgr.a (mgr.14373) 10536 : cluster [DBG] pgmap v7306: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:40:44.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:40:43 smithi047 bash[22744]: audit 2024-09-16T09:40:42.333620+0000 mgr.a (mgr.14373) 10537 : audit [DBG] from='client.232029 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:40:46.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:40:45 smithi157 bash[24585]: cluster 2024-09-16T09:40:44.110265+0000 mgr.a (mgr.14373) 10538 : cluster [DBG] pgmap v7307: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T09:40:46.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:40:45 smithi086 bash[24289]: cluster 2024-09-16T09:40:44.110265+0000 mgr.a (mgr.14373) 10538 : cluster [DBG] pgmap v7307: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T09:40:46.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:40:45 smithi047 bash[22744]: cluster 2024-09-16T09:40:44.110265+0000 mgr.a (mgr.14373) 10538 : cluster [DBG] pgmap v7307: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T09:40:47.794 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:40:47.795 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:40:47.795 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:40:48.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:40:47 smithi157 bash[24585]: cluster 2024-09-16T09:40:46.111043+0000 mgr.a (mgr.14373) 10539 : cluster [DBG] pgmap v7308: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T09:40:48.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:40:47 smithi086 bash[24289]: cluster 2024-09-16T09:40:46.111043+0000 mgr.a (mgr.14373) 10539 : cluster [DBG] pgmap v7308: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T09:40:48.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:40:47 smithi047 bash[22744]: cluster 2024-09-16T09:40:46.111043+0000 mgr.a (mgr.14373) 10539 : cluster [DBG] pgmap v7308: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T09:40:48.573 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:40:48.573 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:40:48.573 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:40:48.573 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:40:48.574 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:40:50.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:40:49 smithi157 bash[24585]: cluster 2024-09-16T09:40:48.113313+0000 mgr.a (mgr.14373) 10540 : cluster [DBG] pgmap v7309: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:40:50.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:40:49 smithi157 bash[24585]: audit 2024-09-16T09:40:48.133211+0000 mgr.a (mgr.14373) 10541 : audit [DBG] from='client.232101 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:40:50.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:40:49 smithi086 bash[24289]: cluster 2024-09-16T09:40:48.113313+0000 mgr.a (mgr.14373) 10540 : cluster [DBG] pgmap v7309: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:40:50.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:40:49 smithi086 bash[24289]: audit 2024-09-16T09:40:48.133211+0000 mgr.a (mgr.14373) 10541 : audit [DBG] from='client.232101 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:40:50.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:40:49 smithi047 bash[22744]: cluster 2024-09-16T09:40:48.113313+0000 mgr.a (mgr.14373) 10540 : cluster [DBG] pgmap v7309: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:40:50.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:40:49 smithi047 bash[22744]: audit 2024-09-16T09:40:48.133211+0000 mgr.a (mgr.14373) 10541 : audit [DBG] from='client.232101 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:40:52.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:40:51 smithi157 bash[24585]: cluster 2024-09-16T09:40:50.114251+0000 mgr.a (mgr.14373) 10542 : cluster [DBG] pgmap v7310: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:40:52.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:40:51 smithi086 bash[24289]: cluster 2024-09-16T09:40:50.114251+0000 mgr.a (mgr.14373) 10542 : cluster [DBG] pgmap v7310: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:40:52.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:40:51 smithi047 bash[22744]: cluster 2024-09-16T09:40:50.114251+0000 mgr.a (mgr.14373) 10542 : cluster [DBG] pgmap v7310: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:40:53.577 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:40:53.577 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:40:53.577 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:40:54.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:40:53 smithi157 bash[24585]: cluster 2024-09-16T09:40:52.116493+0000 mgr.a (mgr.14373) 10543 : cluster [DBG] pgmap v7311: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:40:54.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:40:53 smithi086 bash[24289]: cluster 2024-09-16T09:40:52.116493+0000 mgr.a (mgr.14373) 10543 : cluster [DBG] pgmap v7311: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:40:54.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:40:53 smithi047 bash[22744]: cluster 2024-09-16T09:40:52.116493+0000 mgr.a (mgr.14373) 10543 : cluster [DBG] pgmap v7311: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:40:54.354 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:40:54.354 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:40:54.354 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:40:54.354 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:40:54.354 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:40:56.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:40:55 smithi157 bash[24585]: audit 2024-09-16T09:40:53.911853+0000 mgr.a (mgr.14373) 10544 : audit [DBG] from='client.232179 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:40:56.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:40:55 smithi157 bash[24585]: cluster 2024-09-16T09:40:54.117101+0000 mgr.a (mgr.14373) 10545 : cluster [DBG] pgmap v7312: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:40:56.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:40:55 smithi086 bash[24289]: audit 2024-09-16T09:40:53.911853+0000 mgr.a (mgr.14373) 10544 : audit [DBG] from='client.232179 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:40:56.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:40:55 smithi086 bash[24289]: cluster 2024-09-16T09:40:54.117101+0000 mgr.a (mgr.14373) 10545 : cluster [DBG] pgmap v7312: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:40:56.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:40:55 smithi047 bash[22744]: audit 2024-09-16T09:40:53.911853+0000 mgr.a (mgr.14373) 10544 : audit [DBG] from='client.232179 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:40:56.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:40:55 smithi047 bash[22744]: cluster 2024-09-16T09:40:54.117101+0000 mgr.a (mgr.14373) 10545 : cluster [DBG] pgmap v7312: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:40:58.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:40:57 smithi157 bash[24585]: cluster 2024-09-16T09:40:56.117963+0000 mgr.a (mgr.14373) 10546 : cluster [DBG] pgmap v7313: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:40:58.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:40:57 smithi086 bash[24289]: cluster 2024-09-16T09:40:56.117963+0000 mgr.a (mgr.14373) 10546 : cluster [DBG] pgmap v7313: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:40:58.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:40:57 smithi047 bash[22744]: cluster 2024-09-16T09:40:56.117963+0000 mgr.a (mgr.14373) 10546 : cluster [DBG] pgmap v7313: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:40:59.355 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:40:59.356 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:40:59.356 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:41:00.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:40:59 smithi157 bash[24585]: cluster 2024-09-16T09:40:58.120363+0000 mgr.a (mgr.14373) 10547 : cluster [DBG] pgmap v7314: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:41:00.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:40:59 smithi086 bash[24289]: cluster 2024-09-16T09:40:58.120363+0000 mgr.a (mgr.14373) 10547 : cluster [DBG] pgmap v7314: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:41:00.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:40:59 smithi047 bash[22744]: cluster 2024-09-16T09:40:58.120363+0000 mgr.a (mgr.14373) 10547 : cluster [DBG] pgmap v7314: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:41:00.105 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:41:00.105 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:41:00.105 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:41:00.106 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:41:00.106 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:41:02.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:41:01 smithi157 bash[24585]: audit 2024-09-16T09:40:59.685661+0000 mgr.a (mgr.14373) 10548 : audit [DBG] from='client.232251 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:41:02.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:41:01 smithi157 bash[24585]: cluster 2024-09-16T09:41:00.120902+0000 mgr.a (mgr.14373) 10549 : cluster [DBG] pgmap v7315: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:41:02.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:41:01 smithi086 bash[24289]: audit 2024-09-16T09:40:59.685661+0000 mgr.a (mgr.14373) 10548 : audit [DBG] from='client.232251 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:41:02.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:41:01 smithi086 bash[24289]: cluster 2024-09-16T09:41:00.120902+0000 mgr.a (mgr.14373) 10549 : cluster [DBG] pgmap v7315: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:41:02.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:41:01 smithi047 bash[22744]: audit 2024-09-16T09:40:59.685661+0000 mgr.a (mgr.14373) 10548 : audit [DBG] from='client.232251 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:41:02.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:41:01 smithi047 bash[22744]: cluster 2024-09-16T09:41:00.120902+0000 mgr.a (mgr.14373) 10549 : cluster [DBG] pgmap v7315: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:41:03.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:41:02 smithi157 bash[24585]: cluster 2024-09-16T09:41:02.123087+0000 mgr.a (mgr.14373) 10550 : cluster [DBG] pgmap v7316: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:41:03.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:41:02 smithi086 bash[24289]: cluster 2024-09-16T09:41:02.123087+0000 mgr.a (mgr.14373) 10550 : cluster [DBG] pgmap v7316: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:41:03.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:41:02 smithi047 bash[22744]: cluster 2024-09-16T09:41:02.123087+0000 mgr.a (mgr.14373) 10550 : cluster [DBG] pgmap v7316: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:41:05.107 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:41:05.108 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:41:05.108 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:41:05.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:41:05 smithi157 bash[24585]: cluster 2024-09-16T09:41:04.123839+0000 mgr.a (mgr.14373) 10551 : cluster [DBG] pgmap v7317: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:41:05.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:41:05 smithi086 bash[24289]: cluster 2024-09-16T09:41:04.123839+0000 mgr.a (mgr.14373) 10551 : cluster [DBG] pgmap v7317: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:41:05.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:41:05 smithi047 bash[22744]: cluster 2024-09-16T09:41:04.123839+0000 mgr.a (mgr.14373) 10551 : cluster [DBG] pgmap v7317: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:41:05.840 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:41:05.841 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:41:05.841 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:41:05.841 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:41:05.841 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:41:06.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:41:06 smithi157 bash[24585]: audit 2024-09-16T09:41:05.428257+0000 mgr.a (mgr.14373) 10552 : audit [DBG] from='client.232329 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:41:06.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:41:06 smithi086 bash[24289]: audit 2024-09-16T09:41:05.428257+0000 mgr.a (mgr.14373) 10552 : audit [DBG] from='client.232329 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:41:06.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:41:06 smithi047 bash[22744]: audit 2024-09-16T09:41:05.428257+0000 mgr.a (mgr.14373) 10552 : audit [DBG] from='client.232329 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:41:07.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:41:07 smithi157 bash[24585]: cluster 2024-09-16T09:41:06.124672+0000 mgr.a (mgr.14373) 10553 : cluster [DBG] pgmap v7318: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:41:07.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:41:07 smithi086 bash[24289]: cluster 2024-09-16T09:41:06.124672+0000 mgr.a (mgr.14373) 10553 : cluster [DBG] pgmap v7318: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:41:07.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:41:07 smithi047 bash[22744]: cluster 2024-09-16T09:41:06.124672+0000 mgr.a (mgr.14373) 10553 : cluster [DBG] pgmap v7318: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:41:09.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:41:09 smithi157 bash[24585]: cluster 2024-09-16T09:41:08.126923+0000 mgr.a (mgr.14373) 10554 : cluster [DBG] pgmap v7319: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:41:09.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:41:09 smithi086 bash[24289]: cluster 2024-09-16T09:41:08.126923+0000 mgr.a (mgr.14373) 10554 : cluster [DBG] pgmap v7319: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:41:09.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:41:09 smithi047 bash[22744]: cluster 2024-09-16T09:41:08.126923+0000 mgr.a (mgr.14373) 10554 : cluster [DBG] pgmap v7319: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:41:10.842 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:41:10.842 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:41:10.843 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:41:11.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:41:11 smithi157 bash[24585]: cluster 2024-09-16T09:41:10.127658+0000 mgr.a (mgr.14373) 10555 : cluster [DBG] pgmap v7320: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:41:11.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:41:11 smithi086 bash[24289]: cluster 2024-09-16T09:41:10.127658+0000 mgr.a (mgr.14373) 10555 : cluster [DBG] pgmap v7320: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:41:11.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:41:11 smithi047 bash[22744]: cluster 2024-09-16T09:41:10.127658+0000 mgr.a (mgr.14373) 10555 : cluster [DBG] pgmap v7320: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:41:11.594 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:41:11.594 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:41:11.594 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:41:11.594 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:41:11.594 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:41:12.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:41:12 smithi157 bash[24585]: audit 2024-09-16T09:41:11.169197+0000 mgr.a (mgr.14373) 10556 : audit [DBG] from='client.232407 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:41:12.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:41:12 smithi086 bash[24289]: audit 2024-09-16T09:41:11.169197+0000 mgr.a (mgr.14373) 10556 : audit [DBG] from='client.232407 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:41:12.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:41:12 smithi047 bash[22744]: audit 2024-09-16T09:41:11.169197+0000 mgr.a (mgr.14373) 10556 : audit [DBG] from='client.232407 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:41:13.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:41:13 smithi157 bash[24585]: cluster 2024-09-16T09:41:12.130025+0000 mgr.a (mgr.14373) 10557 : cluster [DBG] pgmap v7321: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-16T09:41:13.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:41:13 smithi086 bash[24289]: cluster 2024-09-16T09:41:12.130025+0000 mgr.a (mgr.14373) 10557 : cluster [DBG] pgmap v7321: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-16T09:41:13.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:41:13 smithi047 bash[22744]: cluster 2024-09-16T09:41:12.130025+0000 mgr.a (mgr.14373) 10557 : cluster [DBG] pgmap v7321: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-16T09:41:15.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:41:15 smithi157 bash[24585]: cluster 2024-09-16T09:41:14.130910+0000 mgr.a (mgr.14373) 10558 : cluster [DBG] pgmap v7322: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T09:41:15.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:41:15 smithi086 bash[24289]: cluster 2024-09-16T09:41:14.130910+0000 mgr.a (mgr.14373) 10558 : cluster [DBG] pgmap v7322: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T09:41:15.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:41:15 smithi047 bash[22744]: cluster 2024-09-16T09:41:14.130910+0000 mgr.a (mgr.14373) 10558 : cluster [DBG] pgmap v7322: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T09:41:16.596 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:41:16.596 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:41:16.596 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:41:17.385 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:41:17.386 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:41:17.386 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:41:17.386 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:41:17.386 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:41:17.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:41:17 smithi157 bash[24585]: cluster 2024-09-16T09:41:16.131694+0000 mgr.a (mgr.14373) 10559 : cluster [DBG] pgmap v7323: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T09:41:17.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:41:17 smithi086 bash[24289]: cluster 2024-09-16T09:41:16.131694+0000 mgr.a (mgr.14373) 10559 : cluster [DBG] pgmap v7323: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T09:41:17.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:41:17 smithi047 bash[22744]: cluster 2024-09-16T09:41:16.131694+0000 mgr.a (mgr.14373) 10559 : cluster [DBG] pgmap v7323: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T09:41:18.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:41:18 smithi157 bash[24585]: audit 2024-09-16T09:41:16.932922+0000 mgr.a (mgr.14373) 10560 : audit [DBG] from='client.232485 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:41:18.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:41:18 smithi086 bash[24289]: audit 2024-09-16T09:41:16.932922+0000 mgr.a (mgr.14373) 10560 : audit [DBG] from='client.232485 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:41:18.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:41:18 smithi047 bash[22744]: audit 2024-09-16T09:41:16.932922+0000 mgr.a (mgr.14373) 10560 : audit [DBG] from='client.232485 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:41:19.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:41:19 smithi157 bash[24585]: cluster 2024-09-16T09:41:18.134550+0000 mgr.a (mgr.14373) 10561 : cluster [DBG] pgmap v7324: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:41:19.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:41:19 smithi086 bash[24289]: cluster 2024-09-16T09:41:18.134550+0000 mgr.a (mgr.14373) 10561 : cluster [DBG] pgmap v7324: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:41:19.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:41:19 smithi047 bash[22744]: cluster 2024-09-16T09:41:18.134550+0000 mgr.a (mgr.14373) 10561 : cluster [DBG] pgmap v7324: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:41:21.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:41:21 smithi157 bash[24585]: cluster 2024-09-16T09:41:20.135382+0000 mgr.a (mgr.14373) 10562 : cluster [DBG] pgmap v7325: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:41:21.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:41:21 smithi086 bash[24289]: cluster 2024-09-16T09:41:20.135382+0000 mgr.a (mgr.14373) 10562 : cluster [DBG] pgmap v7325: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:41:21.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:41:21 smithi047 bash[22744]: cluster 2024-09-16T09:41:20.135382+0000 mgr.a (mgr.14373) 10562 : cluster [DBG] pgmap v7325: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:41:22.387 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:41:22.387 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:41:22.388 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:41:23.146 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:41:23.146 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:41:23.146 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:41:23.146 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:41:23.146 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:41:23.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:41:23 smithi157 bash[24585]: cluster 2024-09-16T09:41:22.137355+0000 mgr.a (mgr.14373) 10563 : cluster [DBG] pgmap v7326: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:41:23.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:41:23 smithi086 bash[24289]: cluster 2024-09-16T09:41:22.137355+0000 mgr.a (mgr.14373) 10563 : cluster [DBG] pgmap v7326: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:41:23.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:41:23 smithi047 bash[22744]: cluster 2024-09-16T09:41:22.137355+0000 mgr.a (mgr.14373) 10563 : cluster [DBG] pgmap v7326: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:41:24.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:41:24 smithi157 bash[24585]: audit 2024-09-16T09:41:22.720116+0000 mgr.a (mgr.14373) 10564 : audit [DBG] from='client.232560 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:41:24.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:41:24 smithi086 bash[24289]: audit 2024-09-16T09:41:22.720116+0000 mgr.a (mgr.14373) 10564 : audit [DBG] from='client.232560 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:41:24.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:41:24 smithi047 bash[22744]: audit 2024-09-16T09:41:22.720116+0000 mgr.a (mgr.14373) 10564 : audit [DBG] from='client.232560 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:41:25.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:41:25 smithi157 bash[24585]: cluster 2024-09-16T09:41:24.138332+0000 mgr.a (mgr.14373) 10565 : cluster [DBG] pgmap v7327: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-16T09:41:25.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:41:25 smithi086 bash[24289]: cluster 2024-09-16T09:41:24.138332+0000 mgr.a (mgr.14373) 10565 : cluster [DBG] pgmap v7327: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-16T09:41:25.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:41:25 smithi047 bash[22744]: cluster 2024-09-16T09:41:24.138332+0000 mgr.a (mgr.14373) 10565 : cluster [DBG] pgmap v7327: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-16T09:41:27.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:41:27 smithi157 bash[24585]: cluster 2024-09-16T09:41:26.139145+0000 mgr.a (mgr.14373) 10566 : cluster [DBG] pgmap v7328: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-16T09:41:27.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:41:27 smithi086 bash[24289]: cluster 2024-09-16T09:41:26.139145+0000 mgr.a (mgr.14373) 10566 : cluster [DBG] pgmap v7328: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-16T09:41:27.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:41:27 smithi047 bash[22744]: cluster 2024-09-16T09:41:26.139145+0000 mgr.a (mgr.14373) 10566 : cluster [DBG] pgmap v7328: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-16T09:41:28.147 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:41:28.148 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:41:28.148 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:41:28.932 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:41:28.933 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:41:28.933 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:41:28.933 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:41:28.933 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:41:29.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:41:29 smithi157 bash[24585]: cluster 2024-09-16T09:41:28.141373+0000 mgr.a (mgr.14373) 10567 : cluster [DBG] pgmap v7329: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-16T09:41:29.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:41:29 smithi157 bash[24585]: audit 2024-09-16T09:41:28.486869+0000 mgr.a (mgr.14373) 10568 : audit [DBG] from='client.232638 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:41:29.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:41:29 smithi086 bash[24289]: cluster 2024-09-16T09:41:28.141373+0000 mgr.a (mgr.14373) 10567 : cluster [DBG] pgmap v7329: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-16T09:41:29.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:41:29 smithi086 bash[24289]: audit 2024-09-16T09:41:28.486869+0000 mgr.a (mgr.14373) 10568 : audit [DBG] from='client.232638 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:41:29.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:41:29 smithi047 bash[22744]: cluster 2024-09-16T09:41:28.141373+0000 mgr.a (mgr.14373) 10567 : cluster [DBG] pgmap v7329: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-16T09:41:29.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:41:29 smithi047 bash[22744]: audit 2024-09-16T09:41:28.486869+0000 mgr.a (mgr.14373) 10568 : audit [DBG] from='client.232638 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:41:31.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:41:31 smithi157 bash[24585]: cluster 2024-09-16T09:41:30.142328+0000 mgr.a (mgr.14373) 10569 : cluster [DBG] pgmap v7330: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:41:31.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:41:31 smithi086 bash[24289]: cluster 2024-09-16T09:41:30.142328+0000 mgr.a (mgr.14373) 10569 : cluster [DBG] pgmap v7330: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:41:31.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:41:31 smithi047 bash[22744]: cluster 2024-09-16T09:41:30.142328+0000 mgr.a (mgr.14373) 10569 : cluster [DBG] pgmap v7330: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:41:33.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:41:33 smithi157 bash[24585]: cluster 2024-09-16T09:41:32.144563+0000 mgr.a (mgr.14373) 10570 : cluster [DBG] pgmap v7331: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:41:33.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:41:33 smithi086 bash[24289]: cluster 2024-09-16T09:41:32.144563+0000 mgr.a (mgr.14373) 10570 : cluster [DBG] pgmap v7331: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:41:33.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:41:33 smithi047 bash[22744]: cluster 2024-09-16T09:41:32.144563+0000 mgr.a (mgr.14373) 10570 : cluster [DBG] pgmap v7331: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:41:33.934 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:41:33.935 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:41:33.935 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:41:34.702 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:41:34.702 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:41:34.702 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:41:34.702 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:41:34.702 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:41:35.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:41:35 smithi157 bash[24585]: cluster 2024-09-16T09:41:34.145298+0000 mgr.a (mgr.14373) 10571 : cluster [DBG] pgmap v7332: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:41:35.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:41:35 smithi157 bash[24585]: audit 2024-09-16T09:41:34.266006+0000 mgr.a (mgr.14373) 10572 : audit [DBG] from='client.232716 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:41:35.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:41:35 smithi086 bash[24289]: cluster 2024-09-16T09:41:34.145298+0000 mgr.a (mgr.14373) 10571 : cluster [DBG] pgmap v7332: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:41:35.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:41:35 smithi086 bash[24289]: audit 2024-09-16T09:41:34.266006+0000 mgr.a (mgr.14373) 10572 : audit [DBG] from='client.232716 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:41:35.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:41:35 smithi047 bash[22744]: cluster 2024-09-16T09:41:34.145298+0000 mgr.a (mgr.14373) 10571 : cluster [DBG] pgmap v7332: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:41:35.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:41:35 smithi047 bash[22744]: audit 2024-09-16T09:41:34.266006+0000 mgr.a (mgr.14373) 10572 : audit [DBG] from='client.232716 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:41:37.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:41:37 smithi157 bash[24585]: cluster 2024-09-16T09:41:36.146266+0000 mgr.a (mgr.14373) 10573 : cluster [DBG] pgmap v7333: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:41:37.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:41:37 smithi086 bash[24289]: cluster 2024-09-16T09:41:36.146266+0000 mgr.a (mgr.14373) 10573 : cluster [DBG] pgmap v7333: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:41:37.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:41:37 smithi047 bash[22744]: cluster 2024-09-16T09:41:36.146266+0000 mgr.a (mgr.14373) 10573 : cluster [DBG] pgmap v7333: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:41:39.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:41:39 smithi157 bash[24585]: cluster 2024-09-16T09:41:38.148528+0000 mgr.a (mgr.14373) 10574 : cluster [DBG] pgmap v7334: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:41:39.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:41:39 smithi157 bash[24585]: audit 2024-09-16T09:41:38.442717+0000 mon.b (mon.2) 978 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T09:41:39.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:41:39 smithi086 bash[24289]: cluster 2024-09-16T09:41:38.148528+0000 mgr.a (mgr.14373) 10574 : cluster [DBG] pgmap v7334: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:41:39.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:41:39 smithi086 bash[24289]: audit 2024-09-16T09:41:38.442717+0000 mon.b (mon.2) 978 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T09:41:39.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:41:39 smithi047 bash[22744]: cluster 2024-09-16T09:41:38.148528+0000 mgr.a (mgr.14373) 10574 : cluster [DBG] pgmap v7334: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:41:39.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:41:39 smithi047 bash[22744]: audit 2024-09-16T09:41:38.442717+0000 mon.b (mon.2) 978 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T09:41:39.703 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:41:39.704 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:41:39.704 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:41:40.465 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:41:40.465 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:41:40.465 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:41:40.465 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:41:40.465 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:41:41.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:41:41 smithi157 bash[24585]: audit 2024-09-16T09:41:40.031456+0000 mgr.a (mgr.14373) 10575 : audit [DBG] from='client.232794 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:41:41.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:41:41 smithi157 bash[24585]: cluster 2024-09-16T09:41:40.149041+0000 mgr.a (mgr.14373) 10576 : cluster [DBG] pgmap v7335: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:41:41.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:41:41 smithi086 bash[24289]: audit 2024-09-16T09:41:40.031456+0000 mgr.a (mgr.14373) 10575 : audit [DBG] from='client.232794 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:41:41.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:41:41 smithi086 bash[24289]: cluster 2024-09-16T09:41:40.149041+0000 mgr.a (mgr.14373) 10576 : cluster [DBG] pgmap v7335: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:41:41.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:41:41 smithi047 bash[22744]: audit 2024-09-16T09:41:40.031456+0000 mgr.a (mgr.14373) 10575 : audit [DBG] from='client.232794 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:41:41.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:41:41 smithi047 bash[22744]: cluster 2024-09-16T09:41:40.149041+0000 mgr.a (mgr.14373) 10576 : cluster [DBG] pgmap v7335: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:41:43.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:41:43 smithi157 bash[24585]: cluster 2024-09-16T09:41:42.151247+0000 mgr.a (mgr.14373) 10577 : cluster [DBG] pgmap v7336: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:41:43.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:41:43 smithi086 bash[24289]: cluster 2024-09-16T09:41:42.151247+0000 mgr.a (mgr.14373) 10577 : cluster [DBG] pgmap v7336: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:41:43.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:41:43 smithi047 bash[22744]: cluster 2024-09-16T09:41:42.151247+0000 mgr.a (mgr.14373) 10577 : cluster [DBG] pgmap v7336: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:41:45.466 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:41:45.467 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:41:45.467 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:41:45.549 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:41:45 smithi157 bash[24585]: cluster 2024-09-16T09:41:44.152042+0000 mgr.a (mgr.14373) 10578 : cluster [DBG] pgmap v7337: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:41:45.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:41:45 smithi086 bash[24289]: cluster 2024-09-16T09:41:44.152042+0000 mgr.a (mgr.14373) 10578 : cluster [DBG] pgmap v7337: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:41:45.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:41:45 smithi047 bash[22744]: cluster 2024-09-16T09:41:44.152042+0000 mgr.a (mgr.14373) 10578 : cluster [DBG] pgmap v7337: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:41:46.219 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:41:46.220 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:41:46.220 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:41:46.220 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:41:46.220 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:41:47.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:41:47 smithi157 bash[24585]: audit 2024-09-16T09:41:45.794957+0000 mgr.a (mgr.14373) 10579 : audit [DBG] from='client.232872 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:41:47.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:41:47 smithi157 bash[24585]: cluster 2024-09-16T09:41:46.152585+0000 mgr.a (mgr.14373) 10580 : cluster [DBG] pgmap v7338: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:41:47.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:41:47 smithi086 bash[24289]: audit 2024-09-16T09:41:45.794957+0000 mgr.a (mgr.14373) 10579 : audit [DBG] from='client.232872 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:41:47.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:41:47 smithi086 bash[24289]: cluster 2024-09-16T09:41:46.152585+0000 mgr.a (mgr.14373) 10580 : cluster [DBG] pgmap v7338: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:41:47.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:41:47 smithi047 bash[22744]: audit 2024-09-16T09:41:45.794957+0000 mgr.a (mgr.14373) 10579 : audit [DBG] from='client.232872 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:41:47.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:41:47 smithi047 bash[22744]: cluster 2024-09-16T09:41:46.152585+0000 mgr.a (mgr.14373) 10580 : cluster [DBG] pgmap v7338: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:41:49.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:41:49 smithi157 bash[24585]: cluster 2024-09-16T09:41:48.154835+0000 mgr.a (mgr.14373) 10581 : cluster [DBG] pgmap v7339: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:41:49.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:41:49 smithi157 bash[24585]: audit 2024-09-16T09:41:48.947522+0000 mon.a (mon.0) 1199 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:41:49.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:41:49 smithi157 bash[24585]: audit 2024-09-16T09:41:48.957677+0000 mon.a (mon.0) 1200 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:41:49.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:41:49 smithi157 bash[24585]: audit 2024-09-16T09:41:48.961702+0000 mon.b (mon.2) 979 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:41:49.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:41:49 smithi157 bash[24585]: audit 2024-09-16T09:41:48.964067+0000 mon.b (mon.2) 980 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T09:41:49.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:41:49 smithi157 bash[24585]: audit 2024-09-16T09:41:48.975189+0000 mon.a (mon.0) 1201 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:41:49.558 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:41:49 smithi157 bash[24585]: audit 2024-09-16T09:41:48.982482+0000 mon.b (mon.2) 981 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:41:49.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:41:49 smithi086 bash[24289]: cluster 2024-09-16T09:41:48.154835+0000 mgr.a (mgr.14373) 10581 : cluster [DBG] pgmap v7339: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:41:49.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:41:49 smithi086 bash[24289]: audit 2024-09-16T09:41:48.947522+0000 mon.a (mon.0) 1199 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:41:49.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:41:49 smithi086 bash[24289]: audit 2024-09-16T09:41:48.957677+0000 mon.a (mon.0) 1200 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:41:49.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:41:49 smithi086 bash[24289]: audit 2024-09-16T09:41:48.961702+0000 mon.b (mon.2) 979 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:41:49.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:41:49 smithi086 bash[24289]: audit 2024-09-16T09:41:48.964067+0000 mon.b (mon.2) 980 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T09:41:49.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:41:49 smithi086 bash[24289]: audit 2024-09-16T09:41:48.975189+0000 mon.a (mon.0) 1201 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:41:49.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:41:49 smithi086 bash[24289]: audit 2024-09-16T09:41:48.982482+0000 mon.b (mon.2) 981 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:41:49.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:41:49 smithi047 bash[22744]: cluster 2024-09-16T09:41:48.154835+0000 mgr.a (mgr.14373) 10581 : cluster [DBG] pgmap v7339: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:41:49.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:41:49 smithi047 bash[22744]: audit 2024-09-16T09:41:48.947522+0000 mon.a (mon.0) 1199 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:41:49.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:41:49 smithi047 bash[22744]: audit 2024-09-16T09:41:48.957677+0000 mon.a (mon.0) 1200 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:41:49.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:41:49 smithi047 bash[22744]: audit 2024-09-16T09:41:48.961702+0000 mon.b (mon.2) 979 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:41:49.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:41:49 smithi047 bash[22744]: audit 2024-09-16T09:41:48.964067+0000 mon.b (mon.2) 980 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T09:41:49.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:41:49 smithi047 bash[22744]: audit 2024-09-16T09:41:48.975189+0000 mon.a (mon.0) 1201 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:41:49.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:41:49 smithi047 bash[22744]: audit 2024-09-16T09:41:48.982482+0000 mon.b (mon.2) 981 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:41:50.092 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 09:41:49 smithi047 bash[22994]: debug 2024-09-16T09:41:49.778+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T09:41:50.093 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 09:41:49 smithi047 bash[22994]: debug 2024-09-16T09:41:49.782+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T09:41:50.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:41:50 smithi157 bash[24585]: audit 2024-09-16T09:41:48.984408+0000 mgr.a (mgr.14373) 10582 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:41:50.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:41:50 smithi086 bash[24289]: audit 2024-09-16T09:41:48.984408+0000 mgr.a (mgr.14373) 10582 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:41:50.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:41:50 smithi047 bash[22744]: audit 2024-09-16T09:41:48.984408+0000 mgr.a (mgr.14373) 10582 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:41:51.221 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:41:51.221 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:41:51.222 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:41:51.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:41:51 smithi086 bash[24289]: audit 2024-09-16T09:41:49.779487+0000 mgr.a (mgr.14373) 10583 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T09:41:51.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:41:51 smithi086 bash[24289]: cephadm 2024-09-16T09:41:49.782475+0000 mgr.a (mgr.14373) 10584 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T09:41:51.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:41:51 smithi086 bash[24289]: cluster 2024-09-16T09:41:50.155828+0000 mgr.a (mgr.14373) 10585 : cluster [DBG] pgmap v7340: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:41:51.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:41:51 smithi047 bash[22744]: audit 2024-09-16T09:41:49.779487+0000 mgr.a (mgr.14373) 10583 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T09:41:51.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:41:51 smithi047 bash[22744]: cephadm 2024-09-16T09:41:49.782475+0000 mgr.a (mgr.14373) 10584 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T09:41:51.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:41:51 smithi047 bash[22744]: cluster 2024-09-16T09:41:50.155828+0000 mgr.a (mgr.14373) 10585 : cluster [DBG] pgmap v7340: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:41:51.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:41:51 smithi157 bash[24585]: audit 2024-09-16T09:41:49.779487+0000 mgr.a (mgr.14373) 10583 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T09:41:51.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:41:51 smithi157 bash[24585]: cephadm 2024-09-16T09:41:49.782475+0000 mgr.a (mgr.14373) 10584 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T09:41:51.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:41:51 smithi157 bash[24585]: cluster 2024-09-16T09:41:50.155828+0000 mgr.a (mgr.14373) 10585 : cluster [DBG] pgmap v7340: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:41:52.003 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:41:52.003 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:41:52.003 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:41:52.003 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:41:52.004 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:41:52.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:41:52 smithi047 bash[22744]: audit 2024-09-16T09:41:51.558960+0000 mgr.a (mgr.14373) 10586 : audit [DBG] from='client.233058 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:41:52.808 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:41:52 smithi157 bash[24585]: audit 2024-09-16T09:41:51.558960+0000 mgr.a (mgr.14373) 10586 : audit [DBG] from='client.233058 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:41:52.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:41:52 smithi086 bash[24289]: audit 2024-09-16T09:41:51.558960+0000 mgr.a (mgr.14373) 10586 : audit [DBG] from='client.233058 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:41:53.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:41:53 smithi047 bash[22744]: cluster 2024-09-16T09:41:52.158722+0000 mgr.a (mgr.14373) 10587 : cluster [DBG] pgmap v7341: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:41:53.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:41:53 smithi157 bash[24585]: cluster 2024-09-16T09:41:52.158722+0000 mgr.a (mgr.14373) 10587 : cluster [DBG] pgmap v7341: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:41:53.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:41:53 smithi086 bash[24289]: cluster 2024-09-16T09:41:52.158722+0000 mgr.a (mgr.14373) 10587 : cluster [DBG] pgmap v7341: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:41:55.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:41:55 smithi047 bash[22744]: cluster 2024-09-16T09:41:54.159494+0000 mgr.a (mgr.14373) 10588 : cluster [DBG] pgmap v7342: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T09:41:55.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:41:55 smithi157 bash[24585]: cluster 2024-09-16T09:41:54.159494+0000 mgr.a (mgr.14373) 10588 : cluster [DBG] pgmap v7342: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T09:41:55.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:41:55 smithi086 bash[24289]: cluster 2024-09-16T09:41:54.159494+0000 mgr.a (mgr.14373) 10588 : cluster [DBG] pgmap v7342: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T09:41:57.005 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:41:57.005 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:41:57.006 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:41:57.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:41:57 smithi047 bash[22744]: cluster 2024-09-16T09:41:56.160323+0000 mgr.a (mgr.14373) 10589 : cluster [DBG] pgmap v7343: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T09:41:57.754 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:41:57.755 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:41:57.755 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:41:57.755 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:41:57.755 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:41:57.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:41:57 smithi157 bash[24585]: cluster 2024-09-16T09:41:56.160323+0000 mgr.a (mgr.14373) 10589 : cluster [DBG] pgmap v7343: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T09:41:57.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:41:57 smithi086 bash[24289]: cluster 2024-09-16T09:41:56.160323+0000 mgr.a (mgr.14373) 10589 : cluster [DBG] pgmap v7343: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T09:41:58.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:41:58 smithi047 bash[22744]: audit 2024-09-16T09:41:57.337886+0000 mgr.a (mgr.14373) 10590 : audit [DBG] from='client.233133 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:41:58.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:41:58 smithi157 bash[24585]: audit 2024-09-16T09:41:57.337886+0000 mgr.a (mgr.14373) 10590 : audit [DBG] from='client.233133 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:41:58.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:41:58 smithi086 bash[24289]: audit 2024-09-16T09:41:57.337886+0000 mgr.a (mgr.14373) 10590 : audit [DBG] from='client.233133 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:41:59.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:41:59 smithi047 bash[22744]: cluster 2024-09-16T09:41:58.163105+0000 mgr.a (mgr.14373) 10591 : cluster [DBG] pgmap v7344: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:41:59.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:41:59 smithi157 bash[24585]: cluster 2024-09-16T09:41:58.163105+0000 mgr.a (mgr.14373) 10591 : cluster [DBG] pgmap v7344: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:41:59.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:41:59 smithi086 bash[24289]: cluster 2024-09-16T09:41:58.163105+0000 mgr.a (mgr.14373) 10591 : cluster [DBG] pgmap v7344: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:42:01.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:42:01 smithi157 bash[24585]: cluster 2024-09-16T09:42:00.163883+0000 mgr.a (mgr.14373) 10592 : cluster [DBG] pgmap v7345: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T09:42:01.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:42:01 smithi086 bash[24289]: cluster 2024-09-16T09:42:00.163883+0000 mgr.a (mgr.14373) 10592 : cluster [DBG] pgmap v7345: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T09:42:01.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:42:01 smithi047 bash[22744]: cluster 2024-09-16T09:42:00.163883+0000 mgr.a (mgr.14373) 10592 : cluster [DBG] pgmap v7345: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T09:42:02.755 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:42:02.756 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:42:02.756 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:42:03.514 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:42:03.514 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:42:03.514 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:42:03.514 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:42:03.514 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:42:03.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:42:03 smithi157 bash[24585]: cluster 2024-09-16T09:42:02.165847+0000 mgr.a (mgr.14373) 10593 : cluster [DBG] pgmap v7346: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:42:03.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:42:03 smithi086 bash[24289]: cluster 2024-09-16T09:42:02.165847+0000 mgr.a (mgr.14373) 10593 : cluster [DBG] pgmap v7346: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:42:03.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:42:03 smithi047 bash[22744]: cluster 2024-09-16T09:42:02.165847+0000 mgr.a (mgr.14373) 10593 : cluster [DBG] pgmap v7346: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:42:04.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:42:04 smithi157 bash[24585]: audit 2024-09-16T09:42:03.086967+0000 mgr.a (mgr.14373) 10594 : audit [DBG] from='client.233211 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:42:04.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:42:04 smithi086 bash[24289]: audit 2024-09-16T09:42:03.086967+0000 mgr.a (mgr.14373) 10594 : audit [DBG] from='client.233211 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:42:04.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:42:04 smithi047 bash[22744]: audit 2024-09-16T09:42:03.086967+0000 mgr.a (mgr.14373) 10594 : audit [DBG] from='client.233211 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:42:05.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:42:05 smithi157 bash[24585]: cluster 2024-09-16T09:42:04.166812+0000 mgr.a (mgr.14373) 10595 : cluster [DBG] pgmap v7347: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:42:05.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:42:05 smithi086 bash[24289]: cluster 2024-09-16T09:42:04.166812+0000 mgr.a (mgr.14373) 10595 : cluster [DBG] pgmap v7347: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:42:05.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:42:05 smithi047 bash[22744]: cluster 2024-09-16T09:42:04.166812+0000 mgr.a (mgr.14373) 10595 : cluster [DBG] pgmap v7347: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:42:07.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:42:07 smithi157 bash[24585]: cluster 2024-09-16T09:42:06.167616+0000 mgr.a (mgr.14373) 10596 : cluster [DBG] pgmap v7348: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:42:07.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:42:07 smithi086 bash[24289]: cluster 2024-09-16T09:42:06.167616+0000 mgr.a (mgr.14373) 10596 : cluster [DBG] pgmap v7348: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:42:07.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:42:07 smithi047 bash[22744]: cluster 2024-09-16T09:42:06.167616+0000 mgr.a (mgr.14373) 10596 : cluster [DBG] pgmap v7348: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:42:08.516 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:42:08.517 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:42:08.517 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:42:09.302 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:42:09.303 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:42:09.303 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:42:09.303 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:42:09.303 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:42:09.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:42:09 smithi157 bash[24585]: cluster 2024-09-16T09:42:08.169965+0000 mgr.a (mgr.14373) 10597 : cluster [DBG] pgmap v7349: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:42:09.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:42:09 smithi086 bash[24289]: cluster 2024-09-16T09:42:08.169965+0000 mgr.a (mgr.14373) 10597 : cluster [DBG] pgmap v7349: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:42:09.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:42:09 smithi047 bash[22744]: cluster 2024-09-16T09:42:08.169965+0000 mgr.a (mgr.14373) 10597 : cluster [DBG] pgmap v7349: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:42:10.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:42:10 smithi157 bash[24585]: audit 2024-09-16T09:42:08.852199+0000 mgr.a (mgr.14373) 10598 : audit [DBG] from='client.233289 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:42:10.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:42:10 smithi086 bash[24289]: audit 2024-09-16T09:42:08.852199+0000 mgr.a (mgr.14373) 10598 : audit [DBG] from='client.233289 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:42:10.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:42:10 smithi047 bash[22744]: audit 2024-09-16T09:42:08.852199+0000 mgr.a (mgr.14373) 10598 : audit [DBG] from='client.233289 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:42:11.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:42:11 smithi157 bash[24585]: cluster 2024-09-16T09:42:10.171023+0000 mgr.a (mgr.14373) 10599 : cluster [DBG] pgmap v7350: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:42:11.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:42:11 smithi086 bash[24289]: cluster 2024-09-16T09:42:10.171023+0000 mgr.a (mgr.14373) 10599 : cluster [DBG] pgmap v7350: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:42:11.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:42:11 smithi047 bash[22744]: cluster 2024-09-16T09:42:10.171023+0000 mgr.a (mgr.14373) 10599 : cluster [DBG] pgmap v7350: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:42:13.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:42:13 smithi157 bash[24585]: cluster 2024-09-16T09:42:12.173247+0000 mgr.a (mgr.14373) 10600 : cluster [DBG] pgmap v7351: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:42:13.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:42:13 smithi086 bash[24289]: cluster 2024-09-16T09:42:12.173247+0000 mgr.a (mgr.14373) 10600 : cluster [DBG] pgmap v7351: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:42:13.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:42:13 smithi047 bash[22744]: cluster 2024-09-16T09:42:12.173247+0000 mgr.a (mgr.14373) 10600 : cluster [DBG] pgmap v7351: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:42:14.304 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:42:14.305 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:42:14.305 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:42:15.070 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:42:15.070 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:42:15.070 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:42:15.070 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:42:15.071 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:42:15.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:42:15 smithi157 bash[24585]: cluster 2024-09-16T09:42:14.174025+0000 mgr.a (mgr.14373) 10601 : cluster [DBG] pgmap v7352: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:42:15.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:42:15 smithi157 bash[24585]: audit 2024-09-16T09:42:14.642268+0000 mgr.a (mgr.14373) 10602 : audit [DBG] from='client.233364 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:42:15.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:42:15 smithi086 bash[24289]: cluster 2024-09-16T09:42:14.174025+0000 mgr.a (mgr.14373) 10601 : cluster [DBG] pgmap v7352: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:42:15.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:42:15 smithi086 bash[24289]: audit 2024-09-16T09:42:14.642268+0000 mgr.a (mgr.14373) 10602 : audit [DBG] from='client.233364 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:42:15.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:42:15 smithi047 bash[22744]: cluster 2024-09-16T09:42:14.174025+0000 mgr.a (mgr.14373) 10601 : cluster [DBG] pgmap v7352: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:42:15.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:42:15 smithi047 bash[22744]: audit 2024-09-16T09:42:14.642268+0000 mgr.a (mgr.14373) 10602 : audit [DBG] from='client.233364 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:42:17.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:42:17 smithi157 bash[24585]: cluster 2024-09-16T09:42:16.175046+0000 mgr.a (mgr.14373) 10603 : cluster [DBG] pgmap v7353: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:42:17.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:42:17 smithi086 bash[24289]: cluster 2024-09-16T09:42:16.175046+0000 mgr.a (mgr.14373) 10603 : cluster [DBG] pgmap v7353: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:42:17.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:42:17 smithi047 bash[22744]: cluster 2024-09-16T09:42:16.175046+0000 mgr.a (mgr.14373) 10603 : cluster [DBG] pgmap v7353: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:42:19.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:42:19 smithi157 bash[24585]: cluster 2024-09-16T09:42:18.177224+0000 mgr.a (mgr.14373) 10604 : cluster [DBG] pgmap v7354: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:42:19.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:42:19 smithi086 bash[24289]: cluster 2024-09-16T09:42:18.177224+0000 mgr.a (mgr.14373) 10604 : cluster [DBG] pgmap v7354: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:42:19.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:42:19 smithi047 bash[22744]: cluster 2024-09-16T09:42:18.177224+0000 mgr.a (mgr.14373) 10604 : cluster [DBG] pgmap v7354: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:42:20.071 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:42:20.072 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:42:20.072 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:42:20.854 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:42:20.855 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:42:20.855 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:42:20.855 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:42:20.855 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:42:21.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:42:21 smithi157 bash[24585]: cluster 2024-09-16T09:42:20.177641+0000 mgr.a (mgr.14373) 10605 : cluster [DBG] pgmap v7355: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:42:21.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:42:21 smithi157 bash[24585]: audit 2024-09-16T09:42:20.404285+0000 mgr.a (mgr.14373) 10606 : audit [DBG] from='client.233442 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:42:21.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:42:21 smithi086 bash[24289]: cluster 2024-09-16T09:42:20.177641+0000 mgr.a (mgr.14373) 10605 : cluster [DBG] pgmap v7355: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:42:21.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:42:21 smithi086 bash[24289]: audit 2024-09-16T09:42:20.404285+0000 mgr.a (mgr.14373) 10606 : audit [DBG] from='client.233442 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:42:21.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:42:21 smithi047 bash[22744]: cluster 2024-09-16T09:42:20.177641+0000 mgr.a (mgr.14373) 10605 : cluster [DBG] pgmap v7355: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:42:21.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:42:21 smithi047 bash[22744]: audit 2024-09-16T09:42:20.404285+0000 mgr.a (mgr.14373) 10606 : audit [DBG] from='client.233442 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:42:23.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:42:23 smithi157 bash[24585]: cluster 2024-09-16T09:42:22.179922+0000 mgr.a (mgr.14373) 10607 : cluster [DBG] pgmap v7356: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:42:23.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:42:23 smithi086 bash[24289]: cluster 2024-09-16T09:42:22.179922+0000 mgr.a (mgr.14373) 10607 : cluster [DBG] pgmap v7356: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:42:23.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:42:23 smithi047 bash[22744]: cluster 2024-09-16T09:42:22.179922+0000 mgr.a (mgr.14373) 10607 : cluster [DBG] pgmap v7356: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:42:25.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:42:25 smithi157 bash[24585]: cluster 2024-09-16T09:42:24.180714+0000 mgr.a (mgr.14373) 10608 : cluster [DBG] pgmap v7357: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:42:25.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:42:25 smithi086 bash[24289]: cluster 2024-09-16T09:42:24.180714+0000 mgr.a (mgr.14373) 10608 : cluster [DBG] pgmap v7357: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:42:25.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:42:25 smithi047 bash[22744]: cluster 2024-09-16T09:42:24.180714+0000 mgr.a (mgr.14373) 10608 : cluster [DBG] pgmap v7357: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:42:25.856 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:42:25.857 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:42:25.857 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:42:26.642 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:42:26.642 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:42:26.642 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:42:26.642 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:42:26.642 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:42:27.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:42:27 smithi157 bash[24585]: cluster 2024-09-16T09:42:26.181219+0000 mgr.a (mgr.14373) 10609 : cluster [DBG] pgmap v7358: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:42:27.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:42:27 smithi157 bash[24585]: audit 2024-09-16T09:42:26.190706+0000 mgr.a (mgr.14373) 10610 : audit [DBG] from='client.233520 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:42:27.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:42:27 smithi086 bash[24289]: cluster 2024-09-16T09:42:26.181219+0000 mgr.a (mgr.14373) 10609 : cluster [DBG] pgmap v7358: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:42:27.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:42:27 smithi086 bash[24289]: audit 2024-09-16T09:42:26.190706+0000 mgr.a (mgr.14373) 10610 : audit [DBG] from='client.233520 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:42:27.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:42:27 smithi047 bash[22744]: cluster 2024-09-16T09:42:26.181219+0000 mgr.a (mgr.14373) 10609 : cluster [DBG] pgmap v7358: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:42:27.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:42:27 smithi047 bash[22744]: audit 2024-09-16T09:42:26.190706+0000 mgr.a (mgr.14373) 10610 : audit [DBG] from='client.233520 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:42:29.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:42:29 smithi157 bash[24585]: cluster 2024-09-16T09:42:28.183619+0000 mgr.a (mgr.14373) 10611 : cluster [DBG] pgmap v7359: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-16T09:42:29.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:42:29 smithi086 bash[24289]: cluster 2024-09-16T09:42:28.183619+0000 mgr.a (mgr.14373) 10611 : cluster [DBG] pgmap v7359: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-16T09:42:29.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:42:29 smithi047 bash[22744]: cluster 2024-09-16T09:42:28.183619+0000 mgr.a (mgr.14373) 10611 : cluster [DBG] pgmap v7359: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-16T09:42:31.643 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:42:31.644 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:42:31.644 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:42:31.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:42:31 smithi157 bash[24585]: cluster 2024-09-16T09:42:30.184406+0000 mgr.a (mgr.14373) 10612 : cluster [DBG] pgmap v7360: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T09:42:31.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:42:31 smithi086 bash[24289]: cluster 2024-09-16T09:42:30.184406+0000 mgr.a (mgr.14373) 10612 : cluster [DBG] pgmap v7360: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T09:42:31.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:42:31 smithi047 bash[22744]: cluster 2024-09-16T09:42:30.184406+0000 mgr.a (mgr.14373) 10612 : cluster [DBG] pgmap v7360: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T09:42:32.429 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:42:32.429 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:42:32.429 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:42:32.429 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:42:32.429 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:42:33.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:42:33 smithi157 bash[24585]: audit 2024-09-16T09:42:31.975506+0000 mgr.a (mgr.14373) 10613 : audit [DBG] from='client.233598 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:42:33.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:42:33 smithi157 bash[24585]: cluster 2024-09-16T09:42:32.185944+0000 mgr.a (mgr.14373) 10614 : cluster [DBG] pgmap v7361: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:42:33.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:42:33 smithi086 bash[24289]: audit 2024-09-16T09:42:31.975506+0000 mgr.a (mgr.14373) 10613 : audit [DBG] from='client.233598 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:42:33.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:42:33 smithi086 bash[24289]: cluster 2024-09-16T09:42:32.185944+0000 mgr.a (mgr.14373) 10614 : cluster [DBG] pgmap v7361: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:42:33.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:42:33 smithi047 bash[22744]: audit 2024-09-16T09:42:31.975506+0000 mgr.a (mgr.14373) 10613 : audit [DBG] from='client.233598 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:42:33.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:42:33 smithi047 bash[22744]: cluster 2024-09-16T09:42:32.185944+0000 mgr.a (mgr.14373) 10614 : cluster [DBG] pgmap v7361: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:42:35.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:42:35 smithi157 bash[24585]: cluster 2024-09-16T09:42:34.186837+0000 mgr.a (mgr.14373) 10615 : cluster [DBG] pgmap v7362: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T09:42:35.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:42:35 smithi086 bash[24289]: cluster 2024-09-16T09:42:34.186837+0000 mgr.a (mgr.14373) 10615 : cluster [DBG] pgmap v7362: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T09:42:35.845 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:42:35 smithi047 bash[22744]: cluster 2024-09-16T09:42:34.186837+0000 mgr.a (mgr.14373) 10615 : cluster [DBG] pgmap v7362: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T09:42:37.430 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:42:37.431 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:42:37.431 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:42:37.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:42:37 smithi157 bash[24585]: cluster 2024-09-16T09:42:36.187618+0000 mgr.a (mgr.14373) 10616 : cluster [DBG] pgmap v7363: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T09:42:37.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:42:37 smithi086 bash[24289]: cluster 2024-09-16T09:42:36.187618+0000 mgr.a (mgr.14373) 10616 : cluster [DBG] pgmap v7363: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T09:42:37.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:42:37 smithi047 bash[22744]: cluster 2024-09-16T09:42:36.187618+0000 mgr.a (mgr.14373) 10616 : cluster [DBG] pgmap v7363: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T09:42:38.178 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:42:38.179 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:42:38.179 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:42:38.179 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:42:38.179 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:42:39.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:42:39 smithi157 bash[24585]: audit 2024-09-16T09:42:37.764326+0000 mgr.a (mgr.14373) 10617 : audit [DBG] from='client.233676 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:42:39.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:42:39 smithi157 bash[24585]: cluster 2024-09-16T09:42:38.188874+0000 mgr.a (mgr.14373) 10618 : cluster [DBG] pgmap v7364: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:42:39.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:42:39 smithi086 bash[24289]: audit 2024-09-16T09:42:37.764326+0000 mgr.a (mgr.14373) 10617 : audit [DBG] from='client.233676 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:42:39.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:42:39 smithi086 bash[24289]: cluster 2024-09-16T09:42:38.188874+0000 mgr.a (mgr.14373) 10618 : cluster [DBG] pgmap v7364: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:42:39.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:42:39 smithi047 bash[22744]: audit 2024-09-16T09:42:37.764326+0000 mgr.a (mgr.14373) 10617 : audit [DBG] from='client.233676 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:42:39.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:42:39 smithi047 bash[22744]: cluster 2024-09-16T09:42:38.188874+0000 mgr.a (mgr.14373) 10618 : cluster [DBG] pgmap v7364: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:42:41.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:42:41 smithi157 bash[24585]: cluster 2024-09-16T09:42:40.189650+0000 mgr.a (mgr.14373) 10619 : cluster [DBG] pgmap v7365: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-16T09:42:41.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:42:41 smithi086 bash[24289]: cluster 2024-09-16T09:42:40.189650+0000 mgr.a (mgr.14373) 10619 : cluster [DBG] pgmap v7365: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-16T09:42:41.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:42:41 smithi047 bash[22744]: cluster 2024-09-16T09:42:40.189650+0000 mgr.a (mgr.14373) 10619 : cluster [DBG] pgmap v7365: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-16T09:42:43.180 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:42:43.181 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:42:43.181 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:42:43.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:42:43 smithi157 bash[24585]: cluster 2024-09-16T09:42:42.191689+0000 mgr.a (mgr.14373) 10620 : cluster [DBG] pgmap v7366: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-16T09:42:43.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:42:43 smithi086 bash[24289]: cluster 2024-09-16T09:42:42.191689+0000 mgr.a (mgr.14373) 10620 : cluster [DBG] pgmap v7366: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-16T09:42:43.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:42:43 smithi047 bash[22744]: cluster 2024-09-16T09:42:42.191689+0000 mgr.a (mgr.14373) 10620 : cluster [DBG] pgmap v7366: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-16T09:42:43.941 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:42:43.941 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:42:43.941 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:42:43.941 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:42:43.941 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:42:44.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:42:44 smithi157 bash[24585]: audit 2024-09-16T09:42:43.510533+0000 mgr.a (mgr.14373) 10621 : audit [DBG] from='client.233751 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:42:44.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:42:44 smithi086 bash[24289]: audit 2024-09-16T09:42:43.510533+0000 mgr.a (mgr.14373) 10621 : audit [DBG] from='client.233751 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:42:44.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:42:44 smithi047 bash[22744]: audit 2024-09-16T09:42:43.510533+0000 mgr.a (mgr.14373) 10621 : audit [DBG] from='client.233751 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:42:45.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:42:45 smithi157 bash[24585]: cluster 2024-09-16T09:42:44.192657+0000 mgr.a (mgr.14373) 10622 : cluster [DBG] pgmap v7367: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:42:45.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:42:45 smithi086 bash[24289]: cluster 2024-09-16T09:42:44.192657+0000 mgr.a (mgr.14373) 10622 : cluster [DBG] pgmap v7367: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:42:45.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:42:45 smithi047 bash[22744]: cluster 2024-09-16T09:42:44.192657+0000 mgr.a (mgr.14373) 10622 : cluster [DBG] pgmap v7367: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:42:47.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:42:47 smithi157 bash[24585]: cluster 2024-09-16T09:42:46.193431+0000 mgr.a (mgr.14373) 10623 : cluster [DBG] pgmap v7368: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:42:47.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:42:47 smithi086 bash[24289]: cluster 2024-09-16T09:42:46.193431+0000 mgr.a (mgr.14373) 10623 : cluster [DBG] pgmap v7368: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:42:47.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:42:47 smithi047 bash[22744]: cluster 2024-09-16T09:42:46.193431+0000 mgr.a (mgr.14373) 10623 : cluster [DBG] pgmap v7368: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:42:48.942 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:42:48.943 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:42:48.943 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:42:49.715 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:42:49.715 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:42:49.715 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:42:49.715 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:42:49.716 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:42:49.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:42:49 smithi157 bash[24585]: cluster 2024-09-16T09:42:48.195803+0000 mgr.a (mgr.14373) 10624 : cluster [DBG] pgmap v7369: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:42:49.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:42:49 smithi086 bash[24289]: cluster 2024-09-16T09:42:48.195803+0000 mgr.a (mgr.14373) 10624 : cluster [DBG] pgmap v7369: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:42:49.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:42:49 smithi047 bash[22744]: cluster 2024-09-16T09:42:48.195803+0000 mgr.a (mgr.14373) 10624 : cluster [DBG] pgmap v7369: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:42:50.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:42:50 smithi157 bash[24585]: audit 2024-09-16T09:42:49.275764+0000 mgr.a (mgr.14373) 10625 : audit [DBG] from='client.233826 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:42:50.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:42:50 smithi157 bash[24585]: audit 2024-09-16T09:42:49.847830+0000 mon.b (mon.2) 982 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T09:42:50.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:42:50 smithi086 bash[24289]: audit 2024-09-16T09:42:49.275764+0000 mgr.a (mgr.14373) 10625 : audit [DBG] from='client.233826 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:42:50.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:42:50 smithi086 bash[24289]: audit 2024-09-16T09:42:49.847830+0000 mon.b (mon.2) 982 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T09:42:50.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:42:50 smithi047 bash[22744]: audit 2024-09-16T09:42:49.275764+0000 mgr.a (mgr.14373) 10625 : audit [DBG] from='client.233826 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:42:50.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:42:50 smithi047 bash[22744]: audit 2024-09-16T09:42:49.847830+0000 mon.b (mon.2) 982 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T09:42:51.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:42:51 smithi157 bash[24585]: cluster 2024-09-16T09:42:50.196786+0000 mgr.a (mgr.14373) 10626 : cluster [DBG] pgmap v7370: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:42:51.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:42:51 smithi157 bash[24585]: audit 2024-09-16T09:42:51.180984+0000 mon.a (mon.0) 1202 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:42:51.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:42:51 smithi157 bash[24585]: audit 2024-09-16T09:42:51.188352+0000 mon.a (mon.0) 1203 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:42:51.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:42:51 smithi157 bash[24585]: audit 2024-09-16T09:42:51.193075+0000 mon.a (mon.0) 1204 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:42:51.808 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:42:51 smithi157 bash[24585]: audit 2024-09-16T09:42:51.198768+0000 mon.a (mon.0) 1205 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:42:51.808 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:42:51 smithi157 bash[24585]: audit 2024-09-16T09:42:51.221231+0000 mon.a (mon.0) 1206 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:42:51.808 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:42:51 smithi157 bash[24585]: audit 2024-09-16T09:42:51.229819+0000 mon.a (mon.0) 1207 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:42:51.808 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:42:51 smithi157 bash[24585]: audit 2024-09-16T09:42:51.233991+0000 mon.b (mon.2) 983 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:42:51.808 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:42:51 smithi157 bash[24585]: audit 2024-09-16T09:42:51.235862+0000 mon.b (mon.2) 984 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T09:42:51.808 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:42:51 smithi157 bash[24585]: audit 2024-09-16T09:42:51.244701+0000 mon.a (mon.0) 1208 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:42:51.808 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:42:51 smithi157 bash[24585]: audit 2024-09-16T09:42:51.249201+0000 mon.b (mon.2) 985 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:42:51.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:42:51 smithi086 bash[24289]: cluster 2024-09-16T09:42:50.196786+0000 mgr.a (mgr.14373) 10626 : cluster [DBG] pgmap v7370: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:42:51.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:42:51 smithi086 bash[24289]: audit 2024-09-16T09:42:51.180984+0000 mon.a (mon.0) 1202 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:42:51.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:42:51 smithi086 bash[24289]: audit 2024-09-16T09:42:51.188352+0000 mon.a (mon.0) 1203 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:42:51.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:42:51 smithi086 bash[24289]: audit 2024-09-16T09:42:51.193075+0000 mon.a (mon.0) 1204 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:42:51.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:42:51 smithi086 bash[24289]: audit 2024-09-16T09:42:51.198768+0000 mon.a (mon.0) 1205 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:42:51.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:42:51 smithi086 bash[24289]: audit 2024-09-16T09:42:51.221231+0000 mon.a (mon.0) 1206 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:42:51.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:42:51 smithi086 bash[24289]: audit 2024-09-16T09:42:51.229819+0000 mon.a (mon.0) 1207 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:42:51.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:42:51 smithi086 bash[24289]: audit 2024-09-16T09:42:51.233991+0000 mon.b (mon.2) 983 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:42:51.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:42:51 smithi086 bash[24289]: audit 2024-09-16T09:42:51.235862+0000 mon.b (mon.2) 984 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T09:42:51.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:42:51 smithi086 bash[24289]: audit 2024-09-16T09:42:51.244701+0000 mon.a (mon.0) 1208 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:42:51.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:42:51 smithi086 bash[24289]: audit 2024-09-16T09:42:51.249201+0000 mon.b (mon.2) 985 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:42:51.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:42:51 smithi047 bash[22744]: cluster 2024-09-16T09:42:50.196786+0000 mgr.a (mgr.14373) 10626 : cluster [DBG] pgmap v7370: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:42:51.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:42:51 smithi047 bash[22744]: audit 2024-09-16T09:42:51.180984+0000 mon.a (mon.0) 1202 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:42:51.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:42:51 smithi047 bash[22744]: audit 2024-09-16T09:42:51.188352+0000 mon.a (mon.0) 1203 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:42:51.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:42:51 smithi047 bash[22744]: audit 2024-09-16T09:42:51.193075+0000 mon.a (mon.0) 1204 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:42:51.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:42:51 smithi047 bash[22744]: audit 2024-09-16T09:42:51.198768+0000 mon.a (mon.0) 1205 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:42:51.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:42:51 smithi047 bash[22744]: audit 2024-09-16T09:42:51.221231+0000 mon.a (mon.0) 1206 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:42:51.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:42:51 smithi047 bash[22744]: audit 2024-09-16T09:42:51.229819+0000 mon.a (mon.0) 1207 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:42:51.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:42:51 smithi047 bash[22744]: audit 2024-09-16T09:42:51.233991+0000 mon.b (mon.2) 983 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:42:51.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:42:51 smithi047 bash[22744]: audit 2024-09-16T09:42:51.235862+0000 mon.b (mon.2) 984 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T09:42:51.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:42:51 smithi047 bash[22744]: audit 2024-09-16T09:42:51.244701+0000 mon.a (mon.0) 1208 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:42:51.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:42:51 smithi047 bash[22744]: audit 2024-09-16T09:42:51.249201+0000 mon.b (mon.2) 985 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:42:52.342 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 09:42:51 smithi047 bash[22994]: debug 2024-09-16T09:42:51.976+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T09:42:52.342 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 09:42:51 smithi047 bash[22994]: debug 2024-09-16T09:42:51.976+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T09:42:52.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:42:52 smithi157 bash[24585]: audit 2024-09-16T09:42:51.251104+0000 mgr.a (mgr.14373) 10627 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:42:52.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:42:52 smithi086 bash[24289]: audit 2024-09-16T09:42:51.251104+0000 mgr.a (mgr.14373) 10627 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:42:52.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:42:52 smithi047 bash[22744]: audit 2024-09-16T09:42:51.251104+0000 mgr.a (mgr.14373) 10627 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:42:53.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:42:53 smithi157 bash[24585]: audit 2024-09-16T09:42:51.980137+0000 mgr.a (mgr.14373) 10628 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T09:42:53.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:42:53 smithi157 bash[24585]: cephadm 2024-09-16T09:42:51.982123+0000 mgr.a (mgr.14373) 10629 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T09:42:53.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:42:53 smithi157 bash[24585]: cluster 2024-09-16T09:42:52.199594+0000 mgr.a (mgr.14373) 10630 : cluster [DBG] pgmap v7371: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 3.6 KiB/s rd, 85 B/s wr, 3 op/s 2024-09-16T09:42:53.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:42:53 smithi086 bash[24289]: audit 2024-09-16T09:42:51.980137+0000 mgr.a (mgr.14373) 10628 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T09:42:53.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:42:53 smithi086 bash[24289]: cephadm 2024-09-16T09:42:51.982123+0000 mgr.a (mgr.14373) 10629 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T09:42:53.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:42:53 smithi086 bash[24289]: cluster 2024-09-16T09:42:52.199594+0000 mgr.a (mgr.14373) 10630 : cluster [DBG] pgmap v7371: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 3.6 KiB/s rd, 85 B/s wr, 3 op/s 2024-09-16T09:42:53.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:42:53 smithi047 bash[22744]: audit 2024-09-16T09:42:51.980137+0000 mgr.a (mgr.14373) 10628 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T09:42:53.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:42:53 smithi047 bash[22744]: cephadm 2024-09-16T09:42:51.982123+0000 mgr.a (mgr.14373) 10629 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T09:42:53.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:42:53 smithi047 bash[22744]: cluster 2024-09-16T09:42:52.199594+0000 mgr.a (mgr.14373) 10630 : cluster [DBG] pgmap v7371: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 3.6 KiB/s rd, 85 B/s wr, 3 op/s 2024-09-16T09:42:54.717 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:42:54.717 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:42:54.718 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:42:55.466 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:42:55.466 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:42:55.466 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:42:55.466 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:42:55.466 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:42:55.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:42:55 smithi157 bash[24585]: cluster 2024-09-16T09:42:54.200377+0000 mgr.a (mgr.14373) 10631 : cluster [DBG] pgmap v7372: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 85 B/s wr, 2 op/s 2024-09-16T09:42:55.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:42:55 smithi086 bash[24289]: cluster 2024-09-16T09:42:54.200377+0000 mgr.a (mgr.14373) 10631 : cluster [DBG] pgmap v7372: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 85 B/s wr, 2 op/s 2024-09-16T09:42:55.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:42:55 smithi047 bash[22744]: cluster 2024-09-16T09:42:54.200377+0000 mgr.a (mgr.14373) 10631 : cluster [DBG] pgmap v7372: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 85 B/s wr, 2 op/s 2024-09-16T09:42:56.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:42:56 smithi157 bash[24585]: audit 2024-09-16T09:42:55.043845+0000 mgr.a (mgr.14373) 10632 : audit [DBG] from='client.234012 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:42:56.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:42:56 smithi086 bash[24289]: audit 2024-09-16T09:42:55.043845+0000 mgr.a (mgr.14373) 10632 : audit [DBG] from='client.234012 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:42:56.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:42:56 smithi047 bash[22744]: audit 2024-09-16T09:42:55.043845+0000 mgr.a (mgr.14373) 10632 : audit [DBG] from='client.234012 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:42:57.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:42:57 smithi157 bash[24585]: cluster 2024-09-16T09:42:56.201309+0000 mgr.a (mgr.14373) 10633 : cluster [DBG] pgmap v7373: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 85 B/s wr, 2 op/s 2024-09-16T09:42:57.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:42:57 smithi086 bash[24289]: cluster 2024-09-16T09:42:56.201309+0000 mgr.a (mgr.14373) 10633 : cluster [DBG] pgmap v7373: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 85 B/s wr, 2 op/s 2024-09-16T09:42:57.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:42:57 smithi047 bash[22744]: cluster 2024-09-16T09:42:56.201309+0000 mgr.a (mgr.14373) 10633 : cluster [DBG] pgmap v7373: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 85 B/s wr, 2 op/s 2024-09-16T09:42:59.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:42:59 smithi157 bash[24585]: cluster 2024-09-16T09:42:58.203557+0000 mgr.a (mgr.14373) 10634 : cluster [DBG] pgmap v7374: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:42:59.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:42:59 smithi086 bash[24289]: cluster 2024-09-16T09:42:58.203557+0000 mgr.a (mgr.14373) 10634 : cluster [DBG] pgmap v7374: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:42:59.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:42:59 smithi047 bash[22744]: cluster 2024-09-16T09:42:58.203557+0000 mgr.a (mgr.14373) 10634 : cluster [DBG] pgmap v7374: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:43:00.467 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:43:00.595 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:43:00.595 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:43:01.250 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:43:01.250 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:43:01.250 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:43:01.250 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:43:01.251 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:43:01.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:43:01 smithi157 bash[24585]: cluster 2024-09-16T09:43:00.204324+0000 mgr.a (mgr.14373) 10635 : cluster [DBG] pgmap v7375: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:43:01.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:43:01 smithi086 bash[24289]: cluster 2024-09-16T09:43:00.204324+0000 mgr.a (mgr.14373) 10635 : cluster [DBG] pgmap v7375: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:43:01.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:43:01 smithi047 bash[22744]: cluster 2024-09-16T09:43:00.204324+0000 mgr.a (mgr.14373) 10635 : cluster [DBG] pgmap v7375: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:43:02.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:43:02 smithi157 bash[24585]: audit 2024-09-16T09:43:00.803690+0000 mgr.a (mgr.14373) 10636 : audit [DBG] from='client.234087 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:43:02.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:43:02 smithi086 bash[24289]: audit 2024-09-16T09:43:00.803690+0000 mgr.a (mgr.14373) 10636 : audit [DBG] from='client.234087 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:43:02.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:43:02 smithi047 bash[22744]: audit 2024-09-16T09:43:00.803690+0000 mgr.a (mgr.14373) 10636 : audit [DBG] from='client.234087 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:43:03.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:43:03 smithi157 bash[24585]: cluster 2024-09-16T09:43:02.206731+0000 mgr.a (mgr.14373) 10637 : cluster [DBG] pgmap v7376: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:43:03.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:43:03 smithi086 bash[24289]: cluster 2024-09-16T09:43:02.206731+0000 mgr.a (mgr.14373) 10637 : cluster [DBG] pgmap v7376: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:43:03.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:43:03 smithi047 bash[22744]: cluster 2024-09-16T09:43:02.206731+0000 mgr.a (mgr.14373) 10637 : cluster [DBG] pgmap v7376: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:43:05.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:43:05 smithi157 bash[24585]: cluster 2024-09-16T09:43:04.207450+0000 mgr.a (mgr.14373) 10638 : cluster [DBG] pgmap v7377: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 6.2 KiB/s rd, 341 B/s wr, 6 op/s 2024-09-16T09:43:05.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:43:05 smithi086 bash[24289]: cluster 2024-09-16T09:43:04.207450+0000 mgr.a (mgr.14373) 10638 : cluster [DBG] pgmap v7377: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 6.2 KiB/s rd, 341 B/s wr, 6 op/s 2024-09-16T09:43:05.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:43:05 smithi047 bash[22744]: cluster 2024-09-16T09:43:04.207450+0000 mgr.a (mgr.14373) 10638 : cluster [DBG] pgmap v7377: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 6.2 KiB/s rd, 341 B/s wr, 6 op/s 2024-09-16T09:43:06.251 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:43:06.253 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:43:06.253 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:43:07.039 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:43:07.039 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:43:07.039 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:43:07.039 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:43:07.039 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:43:07.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:43:07 smithi157 bash[24585]: cluster 2024-09-16T09:43:06.208196+0000 mgr.a (mgr.14373) 10639 : cluster [DBG] pgmap v7378: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 6.2 KiB/s rd, 341 B/s wr, 6 op/s 2024-09-16T09:43:07.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:43:07 smithi157 bash[24585]: audit 2024-09-16T09:43:06.592204+0000 mgr.a (mgr.14373) 10640 : audit [DBG] from='client.234162 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:43:07.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:43:07 smithi086 bash[24289]: cluster 2024-09-16T09:43:06.208196+0000 mgr.a (mgr.14373) 10639 : cluster [DBG] pgmap v7378: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 6.2 KiB/s rd, 341 B/s wr, 6 op/s 2024-09-16T09:43:07.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:43:07 smithi086 bash[24289]: audit 2024-09-16T09:43:06.592204+0000 mgr.a (mgr.14373) 10640 : audit [DBG] from='client.234162 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:43:07.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:43:07 smithi047 bash[22744]: cluster 2024-09-16T09:43:06.208196+0000 mgr.a (mgr.14373) 10639 : cluster [DBG] pgmap v7378: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 6.2 KiB/s rd, 341 B/s wr, 6 op/s 2024-09-16T09:43:07.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:43:07 smithi047 bash[22744]: audit 2024-09-16T09:43:06.592204+0000 mgr.a (mgr.14373) 10640 : audit [DBG] from='client.234162 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:43:09.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:43:09 smithi157 bash[24585]: cluster 2024-09-16T09:43:08.210928+0000 mgr.a (mgr.14373) 10641 : cluster [DBG] pgmap v7379: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 6.2 KiB/s rd, 341 B/s wr, 6 op/s 2024-09-16T09:43:09.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:43:09 smithi086 bash[24289]: cluster 2024-09-16T09:43:08.210928+0000 mgr.a (mgr.14373) 10641 : cluster [DBG] pgmap v7379: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 6.2 KiB/s rd, 341 B/s wr, 6 op/s 2024-09-16T09:43:09.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:43:09 smithi047 bash[22744]: cluster 2024-09-16T09:43:08.210928+0000 mgr.a (mgr.14373) 10641 : cluster [DBG] pgmap v7379: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 6.2 KiB/s rd, 341 B/s wr, 6 op/s 2024-09-16T09:43:11.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:43:11 smithi157 bash[24585]: cluster 2024-09-16T09:43:10.211715+0000 mgr.a (mgr.14373) 10642 : cluster [DBG] pgmap v7380: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:43:11.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:43:11 smithi086 bash[24289]: cluster 2024-09-16T09:43:10.211715+0000 mgr.a (mgr.14373) 10642 : cluster [DBG] pgmap v7380: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:43:11.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:43:11 smithi047 bash[22744]: cluster 2024-09-16T09:43:10.211715+0000 mgr.a (mgr.14373) 10642 : cluster [DBG] pgmap v7380: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:43:12.040 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:43:12.041 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:43:12.041 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:43:12.831 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:43:12.831 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:43:12.831 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:43:12.831 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:43:12.831 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:43:13.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:43:13 smithi157 bash[24585]: cluster 2024-09-16T09:43:12.213692+0000 mgr.a (mgr.14373) 10643 : cluster [DBG] pgmap v7381: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:43:13.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:43:13 smithi157 bash[24585]: audit 2024-09-16T09:43:12.377239+0000 mgr.a (mgr.14373) 10644 : audit [DBG] from='client.234240 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:43:13.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:43:13 smithi086 bash[24289]: cluster 2024-09-16T09:43:12.213692+0000 mgr.a (mgr.14373) 10643 : cluster [DBG] pgmap v7381: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:43:13.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:43:13 smithi086 bash[24289]: audit 2024-09-16T09:43:12.377239+0000 mgr.a (mgr.14373) 10644 : audit [DBG] from='client.234240 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:43:13.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:43:13 smithi047 bash[22744]: cluster 2024-09-16T09:43:12.213692+0000 mgr.a (mgr.14373) 10643 : cluster [DBG] pgmap v7381: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:43:13.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:43:13 smithi047 bash[22744]: audit 2024-09-16T09:43:12.377239+0000 mgr.a (mgr.14373) 10644 : audit [DBG] from='client.234240 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:43:15.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:43:15 smithi157 bash[24585]: cluster 2024-09-16T09:43:14.214623+0000 mgr.a (mgr.14373) 10645 : cluster [DBG] pgmap v7382: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:43:15.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:43:15 smithi086 bash[24289]: cluster 2024-09-16T09:43:14.214623+0000 mgr.a (mgr.14373) 10645 : cluster [DBG] pgmap v7382: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:43:15.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:43:15 smithi047 bash[22744]: cluster 2024-09-16T09:43:14.214623+0000 mgr.a (mgr.14373) 10645 : cluster [DBG] pgmap v7382: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:43:17.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:43:17 smithi157 bash[24585]: cluster 2024-09-16T09:43:16.215379+0000 mgr.a (mgr.14373) 10646 : cluster [DBG] pgmap v7383: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T09:43:17.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:43:17 smithi086 bash[24289]: cluster 2024-09-16T09:43:16.215379+0000 mgr.a (mgr.14373) 10646 : cluster [DBG] pgmap v7383: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T09:43:17.832 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:43:17.833 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:43:17.833 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:43:17.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:43:17 smithi047 bash[22744]: cluster 2024-09-16T09:43:16.215379+0000 mgr.a (mgr.14373) 10646 : cluster [DBG] pgmap v7383: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T09:43:18.618 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:43:18.618 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:43:18.619 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:43:18.619 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:43:18.619 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:43:19.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:43:19 smithi157 bash[24585]: audit 2024-09-16T09:43:18.167264+0000 mgr.a (mgr.14373) 10647 : audit [DBG] from='client.234315 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:43:19.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:43:19 smithi157 bash[24585]: cluster 2024-09-16T09:43:18.218406+0000 mgr.a (mgr.14373) 10648 : cluster [DBG] pgmap v7384: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:43:19.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:43:19 smithi086 bash[24289]: audit 2024-09-16T09:43:18.167264+0000 mgr.a (mgr.14373) 10647 : audit [DBG] from='client.234315 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:43:19.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:43:19 smithi086 bash[24289]: cluster 2024-09-16T09:43:18.218406+0000 mgr.a (mgr.14373) 10648 : cluster [DBG] pgmap v7384: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:43:19.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:43:19 smithi047 bash[22744]: audit 2024-09-16T09:43:18.167264+0000 mgr.a (mgr.14373) 10647 : audit [DBG] from='client.234315 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:43:19.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:43:19 smithi047 bash[22744]: cluster 2024-09-16T09:43:18.218406+0000 mgr.a (mgr.14373) 10648 : cluster [DBG] pgmap v7384: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:43:21.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:43:21 smithi157 bash[24585]: cluster 2024-09-16T09:43:20.219323+0000 mgr.a (mgr.14373) 10649 : cluster [DBG] pgmap v7385: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:43:21.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:43:21 smithi086 bash[24289]: cluster 2024-09-16T09:43:20.219323+0000 mgr.a (mgr.14373) 10649 : cluster [DBG] pgmap v7385: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:43:21.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:43:21 smithi047 bash[22744]: cluster 2024-09-16T09:43:20.219323+0000 mgr.a (mgr.14373) 10649 : cluster [DBG] pgmap v7385: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:43:23.620 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:43:23.620 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:43:23.620 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:43:23.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:43:23 smithi086 bash[24289]: cluster 2024-09-16T09:43:22.221553+0000 mgr.a (mgr.14373) 10650 : cluster [DBG] pgmap v7386: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:43:23.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:43:23 smithi047 bash[22744]: cluster 2024-09-16T09:43:22.221553+0000 mgr.a (mgr.14373) 10650 : cluster [DBG] pgmap v7386: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:43:24.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:43:23 smithi157 bash[24585]: cluster 2024-09-16T09:43:22.221553+0000 mgr.a (mgr.14373) 10650 : cluster [DBG] pgmap v7386: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:43:24.369 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:43:24.369 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:43:24.369 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:43:24.369 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:43:24.369 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:43:25.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:43:25 smithi086 bash[24289]: audit 2024-09-16T09:43:23.944305+0000 mgr.a (mgr.14373) 10651 : audit [DBG] from='client.234393 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:43:25.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:43:25 smithi086 bash[24289]: cluster 2024-09-16T09:43:24.222122+0000 mgr.a (mgr.14373) 10652 : cluster [DBG] pgmap v7387: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:43:25.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:43:25 smithi047 bash[22744]: audit 2024-09-16T09:43:23.944305+0000 mgr.a (mgr.14373) 10651 : audit [DBG] from='client.234393 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:43:25.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:43:25 smithi047 bash[22744]: cluster 2024-09-16T09:43:24.222122+0000 mgr.a (mgr.14373) 10652 : cluster [DBG] pgmap v7387: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:43:26.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:43:25 smithi157 bash[24585]: audit 2024-09-16T09:43:23.944305+0000 mgr.a (mgr.14373) 10651 : audit [DBG] from='client.234393 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:43:26.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:43:25 smithi157 bash[24585]: cluster 2024-09-16T09:43:24.222122+0000 mgr.a (mgr.14373) 10652 : cluster [DBG] pgmap v7387: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:43:27.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:43:27 smithi086 bash[24289]: cluster 2024-09-16T09:43:26.223012+0000 mgr.a (mgr.14373) 10653 : cluster [DBG] pgmap v7388: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:43:27.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:43:27 smithi047 bash[22744]: cluster 2024-09-16T09:43:26.223012+0000 mgr.a (mgr.14373) 10653 : cluster [DBG] pgmap v7388: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:43:28.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:43:27 smithi157 bash[24585]: cluster 2024-09-16T09:43:26.223012+0000 mgr.a (mgr.14373) 10653 : cluster [DBG] pgmap v7388: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:43:29.370 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:43:29.371 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:43:29.371 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:43:29.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:43:29 smithi047 bash[22744]: cluster 2024-09-16T09:43:28.225252+0000 mgr.a (mgr.14373) 10654 : cluster [DBG] pgmap v7389: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:43:30.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:43:29 smithi157 bash[24585]: cluster 2024-09-16T09:43:28.225252+0000 mgr.a (mgr.14373) 10654 : cluster [DBG] pgmap v7389: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:43:30.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:43:29 smithi086 bash[24289]: cluster 2024-09-16T09:43:28.225252+0000 mgr.a (mgr.14373) 10654 : cluster [DBG] pgmap v7389: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:43:30.151 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:43:30.152 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:43:30.152 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:43:30.152 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:43:30.152 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:43:31.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:43:31 smithi047 bash[22744]: audit 2024-09-16T09:43:29.705485+0000 mgr.a (mgr.14373) 10655 : audit [DBG] from='client.234468 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:43:31.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:43:31 smithi047 bash[22744]: cluster 2024-09-16T09:43:30.225929+0000 mgr.a (mgr.14373) 10656 : cluster [DBG] pgmap v7390: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:43:32.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:43:31 smithi157 bash[24585]: audit 2024-09-16T09:43:29.705485+0000 mgr.a (mgr.14373) 10655 : audit [DBG] from='client.234468 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:43:32.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:43:31 smithi157 bash[24585]: cluster 2024-09-16T09:43:30.225929+0000 mgr.a (mgr.14373) 10656 : cluster [DBG] pgmap v7390: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:43:32.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:43:31 smithi086 bash[24289]: audit 2024-09-16T09:43:29.705485+0000 mgr.a (mgr.14373) 10655 : audit [DBG] from='client.234468 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:43:32.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:43:31 smithi086 bash[24289]: cluster 2024-09-16T09:43:30.225929+0000 mgr.a (mgr.14373) 10656 : cluster [DBG] pgmap v7390: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:43:33.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:43:33 smithi047 bash[22744]: cluster 2024-09-16T09:43:32.228151+0000 mgr.a (mgr.14373) 10657 : cluster [DBG] pgmap v7391: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:43:34.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:43:33 smithi157 bash[24585]: cluster 2024-09-16T09:43:32.228151+0000 mgr.a (mgr.14373) 10657 : cluster [DBG] pgmap v7391: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:43:34.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:43:33 smithi086 bash[24289]: cluster 2024-09-16T09:43:32.228151+0000 mgr.a (mgr.14373) 10657 : cluster [DBG] pgmap v7391: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:43:35.153 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:43:35.154 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:43:35.154 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:43:35.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:43:35 smithi047 bash[22744]: cluster 2024-09-16T09:43:34.228907+0000 mgr.a (mgr.14373) 10658 : cluster [DBG] pgmap v7392: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:43:35.915 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:43:35.916 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:43:35.916 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:43:35.916 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:43:35.916 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:43:36.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:43:35 smithi157 bash[24585]: cluster 2024-09-16T09:43:34.228907+0000 mgr.a (mgr.14373) 10658 : cluster [DBG] pgmap v7392: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:43:36.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:43:35 smithi086 bash[24289]: cluster 2024-09-16T09:43:34.228907+0000 mgr.a (mgr.14373) 10658 : cluster [DBG] pgmap v7392: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:43:37.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:43:36 smithi157 bash[24585]: audit 2024-09-16T09:43:35.482879+0000 mgr.a (mgr.14373) 10659 : audit [DBG] from='client.234546 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:43:37.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:43:36 smithi086 bash[24289]: audit 2024-09-16T09:43:35.482879+0000 mgr.a (mgr.14373) 10659 : audit [DBG] from='client.234546 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:43:37.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:43:36 smithi047 bash[22744]: audit 2024-09-16T09:43:35.482879+0000 mgr.a (mgr.14373) 10659 : audit [DBG] from='client.234546 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:43:38.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:43:37 smithi157 bash[24585]: cluster 2024-09-16T09:43:36.229850+0000 mgr.a (mgr.14373) 10660 : cluster [DBG] pgmap v7393: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:43:38.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:43:37 smithi086 bash[24289]: cluster 2024-09-16T09:43:36.229850+0000 mgr.a (mgr.14373) 10660 : cluster [DBG] pgmap v7393: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:43:38.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:43:37 smithi047 bash[22744]: cluster 2024-09-16T09:43:36.229850+0000 mgr.a (mgr.14373) 10660 : cluster [DBG] pgmap v7393: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:43:40.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:43:39 smithi157 bash[24585]: cluster 2024-09-16T09:43:38.232110+0000 mgr.a (mgr.14373) 10661 : cluster [DBG] pgmap v7394: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:43:40.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:43:39 smithi086 bash[24289]: cluster 2024-09-16T09:43:38.232110+0000 mgr.a (mgr.14373) 10661 : cluster [DBG] pgmap v7394: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:43:40.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:43:39 smithi047 bash[22744]: cluster 2024-09-16T09:43:38.232110+0000 mgr.a (mgr.14373) 10661 : cluster [DBG] pgmap v7394: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:43:40.917 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:43:40.918 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:43:40.918 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:43:41.721 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:43:41.722 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:43:41.722 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:43:41.722 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:43:41.722 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:43:42.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:43:41 smithi157 bash[24585]: cluster 2024-09-16T09:43:40.232870+0000 mgr.a (mgr.14373) 10662 : cluster [DBG] pgmap v7395: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:43:42.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:43:41 smithi086 bash[24289]: cluster 2024-09-16T09:43:40.232870+0000 mgr.a (mgr.14373) 10662 : cluster [DBG] pgmap v7395: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:43:42.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:43:41 smithi047 bash[22744]: cluster 2024-09-16T09:43:40.232870+0000 mgr.a (mgr.14373) 10662 : cluster [DBG] pgmap v7395: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:43:43.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:43:42 smithi157 bash[24585]: audit 2024-09-16T09:43:41.254966+0000 mgr.a (mgr.14373) 10663 : audit [DBG] from='client.234624 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:43:43.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:43:42 smithi086 bash[24289]: audit 2024-09-16T09:43:41.254966+0000 mgr.a (mgr.14373) 10663 : audit [DBG] from='client.234624 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:43:43.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:43:42 smithi047 bash[22744]: audit 2024-09-16T09:43:41.254966+0000 mgr.a (mgr.14373) 10663 : audit [DBG] from='client.234624 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:43:44.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:43:43 smithi157 bash[24585]: cluster 2024-09-16T09:43:42.235261+0000 mgr.a (mgr.14373) 10664 : cluster [DBG] pgmap v7396: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-16T09:43:44.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:43:43 smithi086 bash[24289]: cluster 2024-09-16T09:43:42.235261+0000 mgr.a (mgr.14373) 10664 : cluster [DBG] pgmap v7396: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-16T09:43:44.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:43:43 smithi047 bash[22744]: cluster 2024-09-16T09:43:42.235261+0000 mgr.a (mgr.14373) 10664 : cluster [DBG] pgmap v7396: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-16T09:43:46.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:43:45 smithi157 bash[24585]: cluster 2024-09-16T09:43:44.236053+0000 mgr.a (mgr.14373) 10665 : cluster [DBG] pgmap v7397: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-16T09:43:46.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:43:45 smithi086 bash[24289]: cluster 2024-09-16T09:43:44.236053+0000 mgr.a (mgr.14373) 10665 : cluster [DBG] pgmap v7397: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-16T09:43:46.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:43:45 smithi047 bash[22744]: cluster 2024-09-16T09:43:44.236053+0000 mgr.a (mgr.14373) 10665 : cluster [DBG] pgmap v7397: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-16T09:43:46.723 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:43:46.724 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:43:46.724 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:43:47.498 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:43:47.498 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:43:47.498 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:43:47.498 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:43:47.498 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:43:48.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:43:47 smithi157 bash[24585]: cluster 2024-09-16T09:43:46.236804+0000 mgr.a (mgr.14373) 10666 : cluster [DBG] pgmap v7398: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-16T09:43:48.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:43:47 smithi086 bash[24289]: cluster 2024-09-16T09:43:46.236804+0000 mgr.a (mgr.14373) 10666 : cluster [DBG] pgmap v7398: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-16T09:43:48.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:43:47 smithi047 bash[22744]: cluster 2024-09-16T09:43:46.236804+0000 mgr.a (mgr.14373) 10666 : cluster [DBG] pgmap v7398: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-16T09:43:49.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:43:48 smithi157 bash[24585]: audit 2024-09-16T09:43:47.063662+0000 mgr.a (mgr.14373) 10667 : audit [DBG] from='client.234699 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:43:49.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:43:48 smithi086 bash[24289]: audit 2024-09-16T09:43:47.063662+0000 mgr.a (mgr.14373) 10667 : audit [DBG] from='client.234699 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:43:49.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:43:48 smithi047 bash[22744]: audit 2024-09-16T09:43:47.063662+0000 mgr.a (mgr.14373) 10667 : audit [DBG] from='client.234699 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:43:50.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:43:49 smithi157 bash[24585]: cluster 2024-09-16T09:43:48.239508+0000 mgr.a (mgr.14373) 10668 : cluster [DBG] pgmap v7399: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:43:50.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:43:49 smithi086 bash[24289]: cluster 2024-09-16T09:43:48.239508+0000 mgr.a (mgr.14373) 10668 : cluster [DBG] pgmap v7399: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:43:50.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:43:49 smithi047 bash[22744]: cluster 2024-09-16T09:43:48.239508+0000 mgr.a (mgr.14373) 10668 : cluster [DBG] pgmap v7399: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:43:52.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:43:51 smithi157 bash[24585]: cluster 2024-09-16T09:43:50.240297+0000 mgr.a (mgr.14373) 10669 : cluster [DBG] pgmap v7400: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:43:52.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:43:51 smithi086 bash[24289]: cluster 2024-09-16T09:43:50.240297+0000 mgr.a (mgr.14373) 10669 : cluster [DBG] pgmap v7400: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:43:52.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:43:51 smithi047 bash[22744]: cluster 2024-09-16T09:43:50.240297+0000 mgr.a (mgr.14373) 10669 : cluster [DBG] pgmap v7400: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:43:52.499 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:43:52.500 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:43:52.500 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:43:53.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:43:52 smithi157 bash[24585]: audit 2024-09-16T09:43:52.049893+0000 mon.b (mon.2) 986 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T09:43:53.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:43:52 smithi086 bash[24289]: audit 2024-09-16T09:43:52.049893+0000 mon.b (mon.2) 986 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T09:43:53.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:43:52 smithi047 bash[22744]: audit 2024-09-16T09:43:52.049893+0000 mon.b (mon.2) 986 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T09:43:53.252 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:43:53.252 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:43:53.252 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:43:53.252 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:43:53.252 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:43:53.965 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:43:53 smithi047 bash[22744]: cluster 2024-09-16T09:43:52.242277+0000 mgr.a (mgr.14373) 10670 : cluster [DBG] pgmap v7401: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:43:53.965 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:43:53 smithi047 bash[22744]: audit 2024-09-16T09:43:52.891175+0000 mon.b (mon.2) 987 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:43:53.965 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:43:53 smithi047 bash[22744]: audit 2024-09-16T09:43:52.893278+0000 mon.b (mon.2) 988 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T09:43:53.966 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:43:53 smithi047 bash[22744]: audit 2024-09-16T09:43:52.899291+0000 mon.a (mon.0) 1209 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:43:53.966 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:43:53 smithi047 bash[22744]: audit 2024-09-16T09:43:52.904744+0000 mon.b (mon.2) 989 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:43:54.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:43:53 smithi157 bash[24585]: cluster 2024-09-16T09:43:52.242277+0000 mgr.a (mgr.14373) 10670 : cluster [DBG] pgmap v7401: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:43:54.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:43:53 smithi157 bash[24585]: audit 2024-09-16T09:43:52.891175+0000 mon.b (mon.2) 987 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:43:54.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:43:53 smithi157 bash[24585]: audit 2024-09-16T09:43:52.893278+0000 mon.b (mon.2) 988 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T09:43:54.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:43:53 smithi157 bash[24585]: audit 2024-09-16T09:43:52.899291+0000 mon.a (mon.0) 1209 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:43:54.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:43:53 smithi157 bash[24585]: audit 2024-09-16T09:43:52.904744+0000 mon.b (mon.2) 989 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:43:54.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:43:53 smithi086 bash[24289]: cluster 2024-09-16T09:43:52.242277+0000 mgr.a (mgr.14373) 10670 : cluster [DBG] pgmap v7401: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:43:54.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:43:53 smithi086 bash[24289]: audit 2024-09-16T09:43:52.891175+0000 mon.b (mon.2) 987 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:43:54.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:43:53 smithi086 bash[24289]: audit 2024-09-16T09:43:52.893278+0000 mon.b (mon.2) 988 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T09:43:54.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:43:53 smithi086 bash[24289]: audit 2024-09-16T09:43:52.899291+0000 mon.a (mon.0) 1209 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:43:54.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:43:53 smithi086 bash[24289]: audit 2024-09-16T09:43:52.904744+0000 mon.b (mon.2) 989 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:43:54.342 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 09:43:53 smithi047 bash[22994]: debug 2024-09-16T09:43:53.959+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T09:43:54.342 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 09:43:53 smithi047 bash[22994]: debug 2024-09-16T09:43:53.963+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T09:43:55.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:43:54 smithi157 bash[24585]: audit 2024-09-16T09:43:52.817382+0000 mgr.a (mgr.14373) 10671 : audit [DBG] from='client.234777 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:43:55.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:43:54 smithi157 bash[24585]: audit 2024-09-16T09:43:52.905511+0000 mgr.a (mgr.14373) 10672 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:43:55.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:43:54 smithi086 bash[24289]: audit 2024-09-16T09:43:52.817382+0000 mgr.a (mgr.14373) 10671 : audit [DBG] from='client.234777 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:43:55.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:43:54 smithi086 bash[24289]: audit 2024-09-16T09:43:52.905511+0000 mgr.a (mgr.14373) 10672 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:43:55.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:43:54 smithi047 bash[22744]: audit 2024-09-16T09:43:52.817382+0000 mgr.a (mgr.14373) 10671 : audit [DBG] from='client.234777 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:43:55.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:43:54 smithi047 bash[22744]: audit 2024-09-16T09:43:52.905511+0000 mgr.a (mgr.14373) 10672 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:43:56.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:43:55 smithi157 bash[24585]: audit 2024-09-16T09:43:53.964082+0000 mgr.a (mgr.14373) 10673 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T09:43:56.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:43:55 smithi157 bash[24585]: cephadm 2024-09-16T09:43:53.966441+0000 mgr.a (mgr.14373) 10674 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T09:43:56.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:43:55 smithi157 bash[24585]: cluster 2024-09-16T09:43:54.243206+0000 mgr.a (mgr.14373) 10675 : cluster [DBG] pgmap v7402: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-16T09:43:56.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:43:55 smithi086 bash[24289]: audit 2024-09-16T09:43:53.964082+0000 mgr.a (mgr.14373) 10673 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T09:43:56.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:43:55 smithi086 bash[24289]: cephadm 2024-09-16T09:43:53.966441+0000 mgr.a (mgr.14373) 10674 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T09:43:56.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:43:55 smithi086 bash[24289]: cluster 2024-09-16T09:43:54.243206+0000 mgr.a (mgr.14373) 10675 : cluster [DBG] pgmap v7402: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-16T09:43:56.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:43:55 smithi047 bash[22744]: audit 2024-09-16T09:43:53.964082+0000 mgr.a (mgr.14373) 10673 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T09:43:56.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:43:55 smithi047 bash[22744]: cephadm 2024-09-16T09:43:53.966441+0000 mgr.a (mgr.14373) 10674 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T09:43:56.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:43:55 smithi047 bash[22744]: cluster 2024-09-16T09:43:54.243206+0000 mgr.a (mgr.14373) 10675 : cluster [DBG] pgmap v7402: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-16T09:43:58.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:43:57 smithi157 bash[24585]: cluster 2024-09-16T09:43:56.243972+0000 mgr.a (mgr.14373) 10676 : cluster [DBG] pgmap v7403: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-16T09:43:58.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:43:57 smithi086 bash[24289]: cluster 2024-09-16T09:43:56.243972+0000 mgr.a (mgr.14373) 10676 : cluster [DBG] pgmap v7403: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-16T09:43:58.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:43:57 smithi047 bash[22744]: cluster 2024-09-16T09:43:56.243972+0000 mgr.a (mgr.14373) 10676 : cluster [DBG] pgmap v7403: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-16T09:43:58.253 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:43:58.254 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:43:58.254 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:43:59.023 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:43:59.024 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:43:59.024 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:43:59.024 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:43:59.024 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:44:00.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:43:59 smithi157 bash[24585]: cluster 2024-09-16T09:43:58.246192+0000 mgr.a (mgr.14373) 10677 : cluster [DBG] pgmap v7404: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.8 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:44:00.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:43:59 smithi157 bash[24585]: audit 2024-09-16T09:43:58.583432+0000 mgr.a (mgr.14373) 10678 : audit [DBG] from='client.234957 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:44:00.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:43:59 smithi086 bash[24289]: cluster 2024-09-16T09:43:58.246192+0000 mgr.a (mgr.14373) 10677 : cluster [DBG] pgmap v7404: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.8 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:44:00.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:43:59 smithi086 bash[24289]: audit 2024-09-16T09:43:58.583432+0000 mgr.a (mgr.14373) 10678 : audit [DBG] from='client.234957 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:44:00.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:43:59 smithi047 bash[22744]: cluster 2024-09-16T09:43:58.246192+0000 mgr.a (mgr.14373) 10677 : cluster [DBG] pgmap v7404: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.8 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:44:00.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:43:59 smithi047 bash[22744]: audit 2024-09-16T09:43:58.583432+0000 mgr.a (mgr.14373) 10678 : audit [DBG] from='client.234957 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:44:02.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:44:01 smithi157 bash[24585]: cluster 2024-09-16T09:44:00.247106+0000 mgr.a (mgr.14373) 10679 : cluster [DBG] pgmap v7405: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:44:02.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:44:01 smithi086 bash[24289]: cluster 2024-09-16T09:44:00.247106+0000 mgr.a (mgr.14373) 10679 : cluster [DBG] pgmap v7405: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:44:02.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:44:01 smithi047 bash[22744]: cluster 2024-09-16T09:44:00.247106+0000 mgr.a (mgr.14373) 10679 : cluster [DBG] pgmap v7405: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:44:04.025 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:44:04.025 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:44:04.026 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:44:04.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:44:03 smithi157 bash[24585]: cluster 2024-09-16T09:44:02.249363+0000 mgr.a (mgr.14373) 10680 : cluster [DBG] pgmap v7406: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:44:04.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:44:03 smithi086 bash[24289]: cluster 2024-09-16T09:44:02.249363+0000 mgr.a (mgr.14373) 10680 : cluster [DBG] pgmap v7406: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:44:04.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:44:03 smithi047 bash[22744]: cluster 2024-09-16T09:44:02.249363+0000 mgr.a (mgr.14373) 10680 : cluster [DBG] pgmap v7406: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:44:04.792 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:44:04.793 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:44:04.793 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:44:04.793 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:44:04.793 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:44:06.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:44:05 smithi157 bash[24585]: cluster 2024-09-16T09:44:04.250104+0000 mgr.a (mgr.14373) 10681 : cluster [DBG] pgmap v7407: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:44:06.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:44:05 smithi157 bash[24585]: audit 2024-09-16T09:44:04.361074+0000 mgr.a (mgr.14373) 10682 : audit [DBG] from='client.235032 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:44:06.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:44:05 smithi086 bash[24289]: cluster 2024-09-16T09:44:04.250104+0000 mgr.a (mgr.14373) 10681 : cluster [DBG] pgmap v7407: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:44:06.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:44:05 smithi086 bash[24289]: audit 2024-09-16T09:44:04.361074+0000 mgr.a (mgr.14373) 10682 : audit [DBG] from='client.235032 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:44:06.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:44:05 smithi047 bash[22744]: cluster 2024-09-16T09:44:04.250104+0000 mgr.a (mgr.14373) 10681 : cluster [DBG] pgmap v7407: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:44:06.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:44:05 smithi047 bash[22744]: audit 2024-09-16T09:44:04.361074+0000 mgr.a (mgr.14373) 10682 : audit [DBG] from='client.235032 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:44:08.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:44:07 smithi157 bash[24585]: cluster 2024-09-16T09:44:06.250997+0000 mgr.a (mgr.14373) 10683 : cluster [DBG] pgmap v7408: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:44:08.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:44:07 smithi086 bash[24289]: cluster 2024-09-16T09:44:06.250997+0000 mgr.a (mgr.14373) 10683 : cluster [DBG] pgmap v7408: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:44:08.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:44:07 smithi047 bash[22744]: cluster 2024-09-16T09:44:06.250997+0000 mgr.a (mgr.14373) 10683 : cluster [DBG] pgmap v7408: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:44:09.794 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:44:09.795 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:44:09.795 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:44:10.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:44:09 smithi157 bash[24585]: cluster 2024-09-16T09:44:08.253242+0000 mgr.a (mgr.14373) 10684 : cluster [DBG] pgmap v7409: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:44:10.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:44:09 smithi086 bash[24289]: cluster 2024-09-16T09:44:08.253242+0000 mgr.a (mgr.14373) 10684 : cluster [DBG] pgmap v7409: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:44:10.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:44:09 smithi047 bash[22744]: cluster 2024-09-16T09:44:08.253242+0000 mgr.a (mgr.14373) 10684 : cluster [DBG] pgmap v7409: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:44:10.569 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:44:10.569 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:44:10.569 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:44:10.569 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:44:10.569 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:44:12.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:44:11 smithi157 bash[24585]: audit 2024-09-16T09:44:10.126634+0000 mgr.a (mgr.14373) 10685 : audit [DBG] from='client.235110 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:44:12.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:44:11 smithi157 bash[24585]: cluster 2024-09-16T09:44:10.253803+0000 mgr.a (mgr.14373) 10686 : cluster [DBG] pgmap v7410: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:44:12.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:44:11 smithi086 bash[24289]: audit 2024-09-16T09:44:10.126634+0000 mgr.a (mgr.14373) 10685 : audit [DBG] from='client.235110 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:44:12.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:44:11 smithi086 bash[24289]: cluster 2024-09-16T09:44:10.253803+0000 mgr.a (mgr.14373) 10686 : cluster [DBG] pgmap v7410: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:44:12.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:44:11 smithi047 bash[22744]: audit 2024-09-16T09:44:10.126634+0000 mgr.a (mgr.14373) 10685 : audit [DBG] from='client.235110 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:44:12.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:44:11 smithi047 bash[22744]: cluster 2024-09-16T09:44:10.253803+0000 mgr.a (mgr.14373) 10686 : cluster [DBG] pgmap v7410: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:44:13.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:44:12 smithi157 bash[24585]: cluster 2024-09-16T09:44:12.256261+0000 mgr.a (mgr.14373) 10687 : cluster [DBG] pgmap v7411: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:44:13.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:44:12 smithi086 bash[24289]: cluster 2024-09-16T09:44:12.256261+0000 mgr.a (mgr.14373) 10687 : cluster [DBG] pgmap v7411: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:44:13.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:44:12 smithi047 bash[22744]: cluster 2024-09-16T09:44:12.256261+0000 mgr.a (mgr.14373) 10687 : cluster [DBG] pgmap v7411: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:44:15.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:44:15 smithi086 bash[24289]: cluster 2024-09-16T09:44:14.257204+0000 mgr.a (mgr.14373) 10688 : cluster [DBG] pgmap v7412: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:44:15.570 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:44:15.571 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:44:15.572 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:44:15.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:44:15 smithi047 bash[22744]: cluster 2024-09-16T09:44:14.257204+0000 mgr.a (mgr.14373) 10688 : cluster [DBG] pgmap v7412: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:44:15.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:44:15 smithi157 bash[24585]: cluster 2024-09-16T09:44:14.257204+0000 mgr.a (mgr.14373) 10688 : cluster [DBG] pgmap v7412: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:44:16.361 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:44:16.361 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:44:16.361 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:44:16.361 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:44:16.361 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:44:17.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:44:17 smithi047 bash[22744]: audit 2024-09-16T09:44:15.909429+0000 mgr.a (mgr.14373) 10689 : audit [DBG] from='client.235188 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:44:17.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:44:17 smithi047 bash[22744]: cluster 2024-09-16T09:44:16.257812+0000 mgr.a (mgr.14373) 10690 : cluster [DBG] pgmap v7413: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:44:17.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:44:17 smithi157 bash[24585]: audit 2024-09-16T09:44:15.909429+0000 mgr.a (mgr.14373) 10689 : audit [DBG] from='client.235188 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:44:17.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:44:17 smithi157 bash[24585]: cluster 2024-09-16T09:44:16.257812+0000 mgr.a (mgr.14373) 10690 : cluster [DBG] pgmap v7413: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:44:17.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:44:17 smithi086 bash[24289]: audit 2024-09-16T09:44:15.909429+0000 mgr.a (mgr.14373) 10689 : audit [DBG] from='client.235188 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:44:17.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:44:17 smithi086 bash[24289]: cluster 2024-09-16T09:44:16.257812+0000 mgr.a (mgr.14373) 10690 : cluster [DBG] pgmap v7413: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:44:19.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:44:19 smithi047 bash[22744]: cluster 2024-09-16T09:44:18.260142+0000 mgr.a (mgr.14373) 10691 : cluster [DBG] pgmap v7414: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:44:19.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:44:19 smithi157 bash[24585]: cluster 2024-09-16T09:44:18.260142+0000 mgr.a (mgr.14373) 10691 : cluster [DBG] pgmap v7414: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:44:19.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:44:19 smithi086 bash[24289]: cluster 2024-09-16T09:44:18.260142+0000 mgr.a (mgr.14373) 10691 : cluster [DBG] pgmap v7414: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:44:21.363 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:44:21.363 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:44:21.364 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:44:21.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:44:21 smithi047 bash[22744]: cluster 2024-09-16T09:44:20.261077+0000 mgr.a (mgr.14373) 10692 : cluster [DBG] pgmap v7415: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:44:21.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:44:21 smithi157 bash[24585]: cluster 2024-09-16T09:44:20.261077+0000 mgr.a (mgr.14373) 10692 : cluster [DBG] pgmap v7415: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:44:21.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:44:21 smithi086 bash[24289]: cluster 2024-09-16T09:44:20.261077+0000 mgr.a (mgr.14373) 10692 : cluster [DBG] pgmap v7415: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:44:22.148 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:44:22.148 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:44:22.148 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:44:22.148 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:44:22.148 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:44:23.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:44:23 smithi047 bash[22744]: audit 2024-09-16T09:44:21.702256+0000 mgr.a (mgr.14373) 10693 : audit [DBG] from='client.235266 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:44:23.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:44:23 smithi047 bash[22744]: cluster 2024-09-16T09:44:22.263872+0000 mgr.a (mgr.14373) 10694 : cluster [DBG] pgmap v7416: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:44:23.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:44:23 smithi157 bash[24585]: audit 2024-09-16T09:44:21.702256+0000 mgr.a (mgr.14373) 10693 : audit [DBG] from='client.235266 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:44:23.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:44:23 smithi157 bash[24585]: cluster 2024-09-16T09:44:22.263872+0000 mgr.a (mgr.14373) 10694 : cluster [DBG] pgmap v7416: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:44:23.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:44:23 smithi086 bash[24289]: audit 2024-09-16T09:44:21.702256+0000 mgr.a (mgr.14373) 10693 : audit [DBG] from='client.235266 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:44:23.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:44:23 smithi086 bash[24289]: cluster 2024-09-16T09:44:22.263872+0000 mgr.a (mgr.14373) 10694 : cluster [DBG] pgmap v7416: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:44:25.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:44:25 smithi047 bash[22744]: cluster 2024-09-16T09:44:24.264798+0000 mgr.a (mgr.14373) 10695 : cluster [DBG] pgmap v7417: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:44:25.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:44:25 smithi157 bash[24585]: cluster 2024-09-16T09:44:24.264798+0000 mgr.a (mgr.14373) 10695 : cluster [DBG] pgmap v7417: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:44:25.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:44:25 smithi086 bash[24289]: cluster 2024-09-16T09:44:24.264798+0000 mgr.a (mgr.14373) 10695 : cluster [DBG] pgmap v7417: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:44:27.149 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:44:27.150 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:44:27.150 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:44:27.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:44:27 smithi047 bash[22744]: cluster 2024-09-16T09:44:26.265737+0000 mgr.a (mgr.14373) 10696 : cluster [DBG] pgmap v7418: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:44:27.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:44:27 smithi157 bash[24585]: cluster 2024-09-16T09:44:26.265737+0000 mgr.a (mgr.14373) 10696 : cluster [DBG] pgmap v7418: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:44:27.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:44:27 smithi086 bash[24289]: cluster 2024-09-16T09:44:26.265737+0000 mgr.a (mgr.14373) 10696 : cluster [DBG] pgmap v7418: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:44:27.885 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:44:27.886 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:44:27.886 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:44:27.886 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:44:27.886 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:44:28.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:44:28 smithi157 bash[24585]: audit 2024-09-16T09:44:27.479874+0000 mgr.a (mgr.14373) 10697 : audit [DBG] from='client.235344 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:44:28.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:44:28 smithi086 bash[24289]: audit 2024-09-16T09:44:27.479874+0000 mgr.a (mgr.14373) 10697 : audit [DBG] from='client.235344 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:44:28.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:44:28 smithi047 bash[22744]: audit 2024-09-16T09:44:27.479874+0000 mgr.a (mgr.14373) 10697 : audit [DBG] from='client.235344 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:44:29.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:44:29 smithi157 bash[24585]: cluster 2024-09-16T09:44:28.268597+0000 mgr.a (mgr.14373) 10698 : cluster [DBG] pgmap v7419: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:44:29.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:44:29 smithi086 bash[24289]: cluster 2024-09-16T09:44:28.268597+0000 mgr.a (mgr.14373) 10698 : cluster [DBG] pgmap v7419: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:44:29.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:44:29 smithi047 bash[22744]: cluster 2024-09-16T09:44:28.268597+0000 mgr.a (mgr.14373) 10698 : cluster [DBG] pgmap v7419: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:44:31.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:44:31 smithi157 bash[24585]: cluster 2024-09-16T09:44:30.269412+0000 mgr.a (mgr.14373) 10699 : cluster [DBG] pgmap v7420: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:44:31.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:44:31 smithi086 bash[24289]: cluster 2024-09-16T09:44:30.269412+0000 mgr.a (mgr.14373) 10699 : cluster [DBG] pgmap v7420: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:44:31.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:44:31 smithi047 bash[22744]: cluster 2024-09-16T09:44:30.269412+0000 mgr.a (mgr.14373) 10699 : cluster [DBG] pgmap v7420: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:44:32.887 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:44:32.887 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:44:32.888 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:44:33.653 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:44:33.653 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:44:33.653 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:44:33.654 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:44:33.654 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:44:33.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:44:33 smithi157 bash[24585]: cluster 2024-09-16T09:44:32.271501+0000 mgr.a (mgr.14373) 10700 : cluster [DBG] pgmap v7421: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:44:33.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:44:33 smithi086 bash[24289]: cluster 2024-09-16T09:44:32.271501+0000 mgr.a (mgr.14373) 10700 : cluster [DBG] pgmap v7421: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:44:33.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:44:33 smithi047 bash[22744]: cluster 2024-09-16T09:44:32.271501+0000 mgr.a (mgr.14373) 10700 : cluster [DBG] pgmap v7421: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:44:34.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:44:34 smithi157 bash[24585]: audit 2024-09-16T09:44:33.218563+0000 mgr.a (mgr.14373) 10701 : audit [DBG] from='client.235419 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:44:34.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:44:34 smithi086 bash[24289]: audit 2024-09-16T09:44:33.218563+0000 mgr.a (mgr.14373) 10701 : audit [DBG] from='client.235419 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:44:34.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:44:34 smithi047 bash[22744]: audit 2024-09-16T09:44:33.218563+0000 mgr.a (mgr.14373) 10701 : audit [DBG] from='client.235419 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:44:35.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:44:35 smithi157 bash[24585]: cluster 2024-09-16T09:44:34.272562+0000 mgr.a (mgr.14373) 10702 : cluster [DBG] pgmap v7422: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:44:35.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:44:35 smithi086 bash[24289]: cluster 2024-09-16T09:44:34.272562+0000 mgr.a (mgr.14373) 10702 : cluster [DBG] pgmap v7422: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:44:35.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:44:35 smithi047 bash[22744]: cluster 2024-09-16T09:44:34.272562+0000 mgr.a (mgr.14373) 10702 : cluster [DBG] pgmap v7422: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:44:37.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:44:37 smithi157 bash[24585]: cluster 2024-09-16T09:44:36.273497+0000 mgr.a (mgr.14373) 10703 : cluster [DBG] pgmap v7423: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:44:37.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:44:37 smithi086 bash[24289]: cluster 2024-09-16T09:44:36.273497+0000 mgr.a (mgr.14373) 10703 : cluster [DBG] pgmap v7423: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:44:37.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:44:37 smithi047 bash[22744]: cluster 2024-09-16T09:44:36.273497+0000 mgr.a (mgr.14373) 10703 : cluster [DBG] pgmap v7423: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:44:38.655 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:44:38.655 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:44:38.655 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:44:39.409 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:44:39.409 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:44:39.409 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:44:39.409 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:44:39.409 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:44:39.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:44:39 smithi157 bash[24585]: cluster 2024-09-16T09:44:38.275892+0000 mgr.a (mgr.14373) 10704 : cluster [DBG] pgmap v7424: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:44:39.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:44:39 smithi086 bash[24289]: cluster 2024-09-16T09:44:38.275892+0000 mgr.a (mgr.14373) 10704 : cluster [DBG] pgmap v7424: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:44:39.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:44:39 smithi047 bash[22744]: cluster 2024-09-16T09:44:38.275892+0000 mgr.a (mgr.14373) 10704 : cluster [DBG] pgmap v7424: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:44:40.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:44:40 smithi157 bash[24585]: audit 2024-09-16T09:44:38.988922+0000 mgr.a (mgr.14373) 10705 : audit [DBG] from='client.235497 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:44:40.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:44:40 smithi086 bash[24289]: audit 2024-09-16T09:44:38.988922+0000 mgr.a (mgr.14373) 10705 : audit [DBG] from='client.235497 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:44:40.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:44:40 smithi047 bash[22744]: audit 2024-09-16T09:44:38.988922+0000 mgr.a (mgr.14373) 10705 : audit [DBG] from='client.235497 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:44:41.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:44:41 smithi157 bash[24585]: cluster 2024-09-16T09:44:40.276860+0000 mgr.a (mgr.14373) 10706 : cluster [DBG] pgmap v7425: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:44:41.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:44:41 smithi086 bash[24289]: cluster 2024-09-16T09:44:40.276860+0000 mgr.a (mgr.14373) 10706 : cluster [DBG] pgmap v7425: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:44:41.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:44:41 smithi047 bash[22744]: cluster 2024-09-16T09:44:40.276860+0000 mgr.a (mgr.14373) 10706 : cluster [DBG] pgmap v7425: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:44:43.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:44:43 smithi157 bash[24585]: cluster 2024-09-16T09:44:42.279071+0000 mgr.a (mgr.14373) 10707 : cluster [DBG] pgmap v7426: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:44:43.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:44:43 smithi086 bash[24289]: cluster 2024-09-16T09:44:42.279071+0000 mgr.a (mgr.14373) 10707 : cluster [DBG] pgmap v7426: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:44:43.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:44:43 smithi047 bash[22744]: cluster 2024-09-16T09:44:42.279071+0000 mgr.a (mgr.14373) 10707 : cluster [DBG] pgmap v7426: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:44:44.410 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:44:44.411 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:44:44.411 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:44:45.193 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:44:45.194 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:44:45.194 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:44:45.194 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:44:45.194 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:44:45.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:44:45 smithi157 bash[24585]: cluster 2024-09-16T09:44:44.279823+0000 mgr.a (mgr.14373) 10708 : cluster [DBG] pgmap v7427: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:44:45.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:44:45 smithi086 bash[24289]: cluster 2024-09-16T09:44:44.279823+0000 mgr.a (mgr.14373) 10708 : cluster [DBG] pgmap v7427: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:44:45.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:44:45 smithi047 bash[22744]: cluster 2024-09-16T09:44:44.279823+0000 mgr.a (mgr.14373) 10708 : cluster [DBG] pgmap v7427: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:44:46.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:44:46 smithi157 bash[24585]: audit 2024-09-16T09:44:44.745324+0000 mgr.a (mgr.14373) 10709 : audit [DBG] from='client.235569 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:44:46.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:44:46 smithi086 bash[24289]: audit 2024-09-16T09:44:44.745324+0000 mgr.a (mgr.14373) 10709 : audit [DBG] from='client.235569 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:44:46.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:44:46 smithi047 bash[22744]: audit 2024-09-16T09:44:44.745324+0000 mgr.a (mgr.14373) 10709 : audit [DBG] from='client.235569 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:44:47.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:44:47 smithi157 bash[24585]: cluster 2024-09-16T09:44:46.280709+0000 mgr.a (mgr.14373) 10710 : cluster [DBG] pgmap v7428: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:44:47.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:44:47 smithi086 bash[24289]: cluster 2024-09-16T09:44:46.280709+0000 mgr.a (mgr.14373) 10710 : cluster [DBG] pgmap v7428: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:44:47.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:44:47 smithi047 bash[22744]: cluster 2024-09-16T09:44:46.280709+0000 mgr.a (mgr.14373) 10710 : cluster [DBG] pgmap v7428: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:44:49.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:44:49 smithi157 bash[24585]: cluster 2024-09-16T09:44:48.283429+0000 mgr.a (mgr.14373) 10711 : cluster [DBG] pgmap v7429: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:44:49.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:44:49 smithi086 bash[24289]: cluster 2024-09-16T09:44:48.283429+0000 mgr.a (mgr.14373) 10711 : cluster [DBG] pgmap v7429: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:44:49.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:44:49 smithi047 bash[22744]: cluster 2024-09-16T09:44:48.283429+0000 mgr.a (mgr.14373) 10711 : cluster [DBG] pgmap v7429: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:44:50.195 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:44:50.196 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:44:50.196 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:44:50.951 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:44:50.951 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:44:50.951 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:44:50.951 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:44:50.951 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:44:51.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:44:51 smithi157 bash[24585]: cluster 2024-09-16T09:44:50.284316+0000 mgr.a (mgr.14373) 10712 : cluster [DBG] pgmap v7430: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:44:51.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:44:51 smithi157 bash[24585]: audit 2024-09-16T09:44:50.529062+0000 mgr.a (mgr.14373) 10713 : audit [DBG] from='client.235647 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:44:51.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:44:51 smithi086 bash[24289]: cluster 2024-09-16T09:44:50.284316+0000 mgr.a (mgr.14373) 10712 : cluster [DBG] pgmap v7430: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:44:51.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:44:51 smithi086 bash[24289]: audit 2024-09-16T09:44:50.529062+0000 mgr.a (mgr.14373) 10713 : audit [DBG] from='client.235647 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:44:51.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:44:51 smithi047 bash[22744]: cluster 2024-09-16T09:44:50.284316+0000 mgr.a (mgr.14373) 10712 : cluster [DBG] pgmap v7430: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:44:51.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:44:51 smithi047 bash[22744]: audit 2024-09-16T09:44:50.529062+0000 mgr.a (mgr.14373) 10713 : audit [DBG] from='client.235647 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:44:53.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:44:53 smithi157 bash[24585]: cluster 2024-09-16T09:44:52.286889+0000 mgr.a (mgr.14373) 10714 : cluster [DBG] pgmap v7431: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:44:53.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:44:53 smithi086 bash[24289]: cluster 2024-09-16T09:44:52.286889+0000 mgr.a (mgr.14373) 10714 : cluster [DBG] pgmap v7431: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:44:53.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:44:53 smithi047 bash[22744]: cluster 2024-09-16T09:44:52.286889+0000 mgr.a (mgr.14373) 10714 : cluster [DBG] pgmap v7431: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:44:54.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:44:54 smithi157 bash[24585]: audit 2024-09-16T09:44:54.019950+0000 mon.b (mon.2) 990 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T09:44:54.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:44:54 smithi086 bash[24289]: audit 2024-09-16T09:44:54.019950+0000 mon.b (mon.2) 990 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T09:44:54.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:44:54 smithi047 bash[22744]: audit 2024-09-16T09:44:54.019950+0000 mon.b (mon.2) 990 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T09:44:55.952 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:44:55.952 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:44:55.952 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:44:56.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:44:55 smithi157 bash[24585]: cluster 2024-09-16T09:44:54.287676+0000 mgr.a (mgr.14373) 10715 : cluster [DBG] pgmap v7432: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:44:56.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:44:55 smithi157 bash[24585]: audit 2024-09-16T09:44:54.652361+0000 mon.a (mon.0) 1210 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:44:56.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:44:55 smithi157 bash[24585]: audit 2024-09-16T09:44:54.658688+0000 mon.a (mon.0) 1211 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:44:56.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:44:55 smithi157 bash[24585]: audit 2024-09-16T09:44:55.465503+0000 mon.b (mon.2) 991 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:44:56.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:44:55 smithi157 bash[24585]: audit 2024-09-16T09:44:55.467637+0000 mon.b (mon.2) 992 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T09:44:56.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:44:55 smithi157 bash[24585]: audit 2024-09-16T09:44:55.478635+0000 mon.a (mon.0) 1212 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:44:56.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:44:55 smithi157 bash[24585]: audit 2024-09-16T09:44:55.484813+0000 mon.b (mon.2) 993 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:44:56.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:44:55 smithi086 bash[24289]: cluster 2024-09-16T09:44:54.287676+0000 mgr.a (mgr.14373) 10715 : cluster [DBG] pgmap v7432: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:44:56.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:44:55 smithi086 bash[24289]: audit 2024-09-16T09:44:54.652361+0000 mon.a (mon.0) 1210 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:44:56.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:44:55 smithi086 bash[24289]: audit 2024-09-16T09:44:54.658688+0000 mon.a (mon.0) 1211 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:44:56.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:44:55 smithi086 bash[24289]: audit 2024-09-16T09:44:55.465503+0000 mon.b (mon.2) 991 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:44:56.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:44:55 smithi086 bash[24289]: audit 2024-09-16T09:44:55.467637+0000 mon.b (mon.2) 992 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T09:44:56.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:44:55 smithi086 bash[24289]: audit 2024-09-16T09:44:55.478635+0000 mon.a (mon.0) 1212 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:44:56.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:44:55 smithi086 bash[24289]: audit 2024-09-16T09:44:55.484813+0000 mon.b (mon.2) 993 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:44:56.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:44:55 smithi047 bash[22744]: cluster 2024-09-16T09:44:54.287676+0000 mgr.a (mgr.14373) 10715 : cluster [DBG] pgmap v7432: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:44:56.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:44:55 smithi047 bash[22744]: audit 2024-09-16T09:44:54.652361+0000 mon.a (mon.0) 1210 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:44:56.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:44:55 smithi047 bash[22744]: audit 2024-09-16T09:44:54.658688+0000 mon.a (mon.0) 1211 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:44:56.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:44:55 smithi047 bash[22744]: audit 2024-09-16T09:44:55.465503+0000 mon.b (mon.2) 991 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:44:56.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:44:55 smithi047 bash[22744]: audit 2024-09-16T09:44:55.467637+0000 mon.b (mon.2) 992 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T09:44:56.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:44:55 smithi047 bash[22744]: audit 2024-09-16T09:44:55.478635+0000 mon.a (mon.0) 1212 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:44:56.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:44:55 smithi047 bash[22744]: audit 2024-09-16T09:44:55.484813+0000 mon.b (mon.2) 993 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:44:56.592 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 09:44:56 smithi047 bash[22994]: debug 2024-09-16T09:44:56.226+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T09:44:56.592 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 09:44:56 smithi047 bash[22994]: debug 2024-09-16T09:44:56.226+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T09:44:56.728 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:44:56.728 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:44:56.728 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:44:56.728 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:44:56.728 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:44:57.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:44:56 smithi157 bash[24585]: audit 2024-09-16T09:44:55.486808+0000 mgr.a (mgr.14373) 10716 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:44:57.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:44:56 smithi086 bash[24289]: audit 2024-09-16T09:44:55.486808+0000 mgr.a (mgr.14373) 10716 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:44:57.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:44:56 smithi047 bash[22744]: audit 2024-09-16T09:44:55.486808+0000 mgr.a (mgr.14373) 10716 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:44:58.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:44:57 smithi157 bash[24585]: audit 2024-09-16T09:44:56.226339+0000 mgr.a (mgr.14373) 10717 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T09:44:58.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:44:57 smithi157 bash[24585]: cephadm 2024-09-16T09:44:56.228923+0000 mgr.a (mgr.14373) 10718 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T09:44:58.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:44:57 smithi157 bash[24585]: cluster 2024-09-16T09:44:56.288251+0000 mgr.a (mgr.14373) 10719 : cluster [DBG] pgmap v7433: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:44:58.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:44:57 smithi157 bash[24585]: audit 2024-09-16T09:44:56.322737+0000 mgr.a (mgr.14373) 10720 : audit [DBG] from='client.235815 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:44:58.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:44:57 smithi086 bash[24289]: audit 2024-09-16T09:44:56.226339+0000 mgr.a (mgr.14373) 10717 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T09:44:58.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:44:57 smithi086 bash[24289]: cephadm 2024-09-16T09:44:56.228923+0000 mgr.a (mgr.14373) 10718 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T09:44:58.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:44:57 smithi086 bash[24289]: cluster 2024-09-16T09:44:56.288251+0000 mgr.a (mgr.14373) 10719 : cluster [DBG] pgmap v7433: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:44:58.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:44:57 smithi086 bash[24289]: audit 2024-09-16T09:44:56.322737+0000 mgr.a (mgr.14373) 10720 : audit [DBG] from='client.235815 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:44:58.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:44:57 smithi047 bash[22744]: audit 2024-09-16T09:44:56.226339+0000 mgr.a (mgr.14373) 10717 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T09:44:58.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:44:57 smithi047 bash[22744]: cephadm 2024-09-16T09:44:56.228923+0000 mgr.a (mgr.14373) 10718 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T09:44:58.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:44:57 smithi047 bash[22744]: cluster 2024-09-16T09:44:56.288251+0000 mgr.a (mgr.14373) 10719 : cluster [DBG] pgmap v7433: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:44:58.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:44:57 smithi047 bash[22744]: audit 2024-09-16T09:44:56.322737+0000 mgr.a (mgr.14373) 10720 : audit [DBG] from='client.235815 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:45:00.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:44:59 smithi157 bash[24585]: cluster 2024-09-16T09:44:58.290670+0000 mgr.a (mgr.14373) 10721 : cluster [DBG] pgmap v7434: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.1 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:45:00.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:44:59 smithi086 bash[24289]: cluster 2024-09-16T09:44:58.290670+0000 mgr.a (mgr.14373) 10721 : cluster [DBG] pgmap v7434: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.1 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:45:00.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:44:59 smithi047 bash[22744]: cluster 2024-09-16T09:44:58.290670+0000 mgr.a (mgr.14373) 10721 : cluster [DBG] pgmap v7434: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.1 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:45:01.729 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:45:01.730 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:45:01.730 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:45:01.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:45:01 smithi047 bash[22744]: cluster 2024-09-16T09:45:00.291466+0000 mgr.a (mgr.14373) 10722 : cluster [DBG] pgmap v7435: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 6.2 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T09:45:01.967 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:45:01 smithi086 bash[24289]: cluster 2024-09-16T09:45:00.291466+0000 mgr.a (mgr.14373) 10722 : cluster [DBG] pgmap v7435: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 6.2 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T09:45:02.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:45:01 smithi157 bash[24585]: cluster 2024-09-16T09:45:00.291466+0000 mgr.a (mgr.14373) 10722 : cluster [DBG] pgmap v7435: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 6.2 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T09:45:02.508 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:45:02.509 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:45:02.509 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:45:02.509 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:45:02.509 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:45:04.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:45:03 smithi157 bash[24585]: audit 2024-09-16T09:45:02.062078+0000 mgr.a (mgr.14373) 10723 : audit [DBG] from='client.235911 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:45:04.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:45:03 smithi157 bash[24585]: cluster 2024-09-16T09:45:02.301732+0000 mgr.a (mgr.14373) 10724 : cluster [DBG] pgmap v7436: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:45:04.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:45:03 smithi086 bash[24289]: audit 2024-09-16T09:45:02.062078+0000 mgr.a (mgr.14373) 10723 : audit [DBG] from='client.235911 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:45:04.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:45:03 smithi086 bash[24289]: cluster 2024-09-16T09:45:02.301732+0000 mgr.a (mgr.14373) 10724 : cluster [DBG] pgmap v7436: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:45:04.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:45:03 smithi047 bash[22744]: audit 2024-09-16T09:45:02.062078+0000 mgr.a (mgr.14373) 10723 : audit [DBG] from='client.235911 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:45:04.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:45:03 smithi047 bash[22744]: cluster 2024-09-16T09:45:02.301732+0000 mgr.a (mgr.14373) 10724 : cluster [DBG] pgmap v7436: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:45:06.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:45:05 smithi157 bash[24585]: cluster 2024-09-16T09:45:04.302695+0000 mgr.a (mgr.14373) 10725 : cluster [DBG] pgmap v7437: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T09:45:06.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:45:05 smithi086 bash[24289]: cluster 2024-09-16T09:45:04.302695+0000 mgr.a (mgr.14373) 10725 : cluster [DBG] pgmap v7437: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T09:45:06.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:45:05 smithi047 bash[22744]: cluster 2024-09-16T09:45:04.302695+0000 mgr.a (mgr.14373) 10725 : cluster [DBG] pgmap v7437: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T09:45:07.510 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:45:07.511 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:45:07.511 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:45:08.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:45:07 smithi157 bash[24585]: cluster 2024-09-16T09:45:06.303470+0000 mgr.a (mgr.14373) 10726 : cluster [DBG] pgmap v7438: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T09:45:08.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:45:07 smithi086 bash[24289]: cluster 2024-09-16T09:45:06.303470+0000 mgr.a (mgr.14373) 10726 : cluster [DBG] pgmap v7438: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T09:45:08.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:45:07 smithi047 bash[22744]: cluster 2024-09-16T09:45:06.303470+0000 mgr.a (mgr.14373) 10726 : cluster [DBG] pgmap v7438: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T09:45:08.288 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:45:08.288 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:45:08.288 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:45:08.288 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:45:08.288 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:45:10.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:45:09 smithi157 bash[24585]: audit 2024-09-16T09:45:07.844786+0000 mgr.a (mgr.14373) 10727 : audit [DBG] from='client.235989 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:45:10.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:45:09 smithi157 bash[24585]: cluster 2024-09-16T09:45:08.304858+0000 mgr.a (mgr.14373) 10728 : cluster [DBG] pgmap v7439: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:45:10.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:45:09 smithi086 bash[24289]: audit 2024-09-16T09:45:07.844786+0000 mgr.a (mgr.14373) 10727 : audit [DBG] from='client.235989 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:45:10.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:45:09 smithi086 bash[24289]: cluster 2024-09-16T09:45:08.304858+0000 mgr.a (mgr.14373) 10728 : cluster [DBG] pgmap v7439: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:45:10.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:45:09 smithi047 bash[22744]: audit 2024-09-16T09:45:07.844786+0000 mgr.a (mgr.14373) 10727 : audit [DBG] from='client.235989 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:45:10.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:45:09 smithi047 bash[22744]: cluster 2024-09-16T09:45:08.304858+0000 mgr.a (mgr.14373) 10728 : cluster [DBG] pgmap v7439: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:45:12.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:45:11 smithi157 bash[24585]: cluster 2024-09-16T09:45:10.305612+0000 mgr.a (mgr.14373) 10729 : cluster [DBG] pgmap v7440: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-16T09:45:12.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:45:11 smithi086 bash[24289]: cluster 2024-09-16T09:45:10.305612+0000 mgr.a (mgr.14373) 10729 : cluster [DBG] pgmap v7440: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-16T09:45:12.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:45:11 smithi047 bash[22744]: cluster 2024-09-16T09:45:10.305612+0000 mgr.a (mgr.14373) 10729 : cluster [DBG] pgmap v7440: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-16T09:45:13.289 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:45:13.290 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:45:13.290 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:45:14.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:45:13 smithi157 bash[24585]: cluster 2024-09-16T09:45:12.307689+0000 mgr.a (mgr.14373) 10730 : cluster [DBG] pgmap v7441: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:45:14.062 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:45:14.062 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:45:14.062 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:45:14.062 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:45:14.062 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:45:14.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:45:13 smithi086 bash[24289]: cluster 2024-09-16T09:45:12.307689+0000 mgr.a (mgr.14373) 10730 : cluster [DBG] pgmap v7441: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:45:14.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:45:13 smithi047 bash[22744]: cluster 2024-09-16T09:45:12.307689+0000 mgr.a (mgr.14373) 10730 : cluster [DBG] pgmap v7441: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:45:15.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:45:14 smithi157 bash[24585]: audit 2024-09-16T09:45:13.627435+0000 mgr.a (mgr.14373) 10731 : audit [DBG] from='client.236067 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:45:15.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:45:14 smithi086 bash[24289]: audit 2024-09-16T09:45:13.627435+0000 mgr.a (mgr.14373) 10731 : audit [DBG] from='client.236067 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:45:15.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:45:14 smithi047 bash[22744]: audit 2024-09-16T09:45:13.627435+0000 mgr.a (mgr.14373) 10731 : audit [DBG] from='client.236067 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:45:16.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:45:15 smithi157 bash[24585]: cluster 2024-09-16T09:45:14.308667+0000 mgr.a (mgr.14373) 10732 : cluster [DBG] pgmap v7442: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:45:16.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:45:15 smithi086 bash[24289]: cluster 2024-09-16T09:45:14.308667+0000 mgr.a (mgr.14373) 10732 : cluster [DBG] pgmap v7442: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:45:16.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:45:15 smithi047 bash[22744]: cluster 2024-09-16T09:45:14.308667+0000 mgr.a (mgr.14373) 10732 : cluster [DBG] pgmap v7442: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:45:18.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:45:17 smithi157 bash[24585]: cluster 2024-09-16T09:45:16.309460+0000 mgr.a (mgr.14373) 10733 : cluster [DBG] pgmap v7443: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:45:18.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:45:17 smithi086 bash[24289]: cluster 2024-09-16T09:45:16.309460+0000 mgr.a (mgr.14373) 10733 : cluster [DBG] pgmap v7443: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:45:18.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:45:17 smithi047 bash[22744]: cluster 2024-09-16T09:45:16.309460+0000 mgr.a (mgr.14373) 10733 : cluster [DBG] pgmap v7443: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:45:19.064 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:45:19.065 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:45:19.065 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:45:19.829 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:45:19.829 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:45:19.829 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:45:19.829 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:45:19.830 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:45:20.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:45:19 smithi157 bash[24585]: cluster 2024-09-16T09:45:18.311749+0000 mgr.a (mgr.14373) 10734 : cluster [DBG] pgmap v7444: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:45:20.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:45:19 smithi157 bash[24585]: audit 2024-09-16T09:45:19.394669+0000 mgr.a (mgr.14373) 10735 : audit [DBG] from='client.236145 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:45:20.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:45:19 smithi086 bash[24289]: cluster 2024-09-16T09:45:18.311749+0000 mgr.a (mgr.14373) 10734 : cluster [DBG] pgmap v7444: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:45:20.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:45:19 smithi086 bash[24289]: audit 2024-09-16T09:45:19.394669+0000 mgr.a (mgr.14373) 10735 : audit [DBG] from='client.236145 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:45:20.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:45:19 smithi047 bash[22744]: cluster 2024-09-16T09:45:18.311749+0000 mgr.a (mgr.14373) 10734 : cluster [DBG] pgmap v7444: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:45:20.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:45:19 smithi047 bash[22744]: audit 2024-09-16T09:45:19.394669+0000 mgr.a (mgr.14373) 10735 : audit [DBG] from='client.236145 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:45:21.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:45:20 smithi157 bash[24585]: cluster 2024-09-16T09:45:20.312757+0000 mgr.a (mgr.14373) 10736 : cluster [DBG] pgmap v7445: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:45:21.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:45:20 smithi086 bash[24289]: cluster 2024-09-16T09:45:20.312757+0000 mgr.a (mgr.14373) 10736 : cluster [DBG] pgmap v7445: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:45:21.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:45:20 smithi047 bash[22744]: cluster 2024-09-16T09:45:20.312757+0000 mgr.a (mgr.14373) 10736 : cluster [DBG] pgmap v7445: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:45:23.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:45:23 smithi157 bash[24585]: cluster 2024-09-16T09:45:22.315043+0000 mgr.a (mgr.14373) 10737 : cluster [DBG] pgmap v7446: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:45:23.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:45:23 smithi086 bash[24289]: cluster 2024-09-16T09:45:22.315043+0000 mgr.a (mgr.14373) 10737 : cluster [DBG] pgmap v7446: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:45:23.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:45:23 smithi047 bash[22744]: cluster 2024-09-16T09:45:22.315043+0000 mgr.a (mgr.14373) 10737 : cluster [DBG] pgmap v7446: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:45:24.831 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:45:24.831 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:45:24.832 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:45:25.613 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:45:25.613 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:45:25.613 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:45:25.613 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:45:25.613 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:45:25.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:45:25 smithi157 bash[24585]: cluster 2024-09-16T09:45:24.315939+0000 mgr.a (mgr.14373) 10738 : cluster [DBG] pgmap v7447: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:45:25.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:45:25 smithi086 bash[24289]: cluster 2024-09-16T09:45:24.315939+0000 mgr.a (mgr.14373) 10738 : cluster [DBG] pgmap v7447: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:45:25.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:45:25 smithi047 bash[22744]: cluster 2024-09-16T09:45:24.315939+0000 mgr.a (mgr.14373) 10738 : cluster [DBG] pgmap v7447: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:45:26.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:45:26 smithi157 bash[24585]: audit 2024-09-16T09:45:25.167775+0000 mgr.a (mgr.14373) 10739 : audit [DBG] from='client.236223 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:45:26.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:45:26 smithi086 bash[24289]: audit 2024-09-16T09:45:25.167775+0000 mgr.a (mgr.14373) 10739 : audit [DBG] from='client.236223 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:45:26.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:45:26 smithi047 bash[22744]: audit 2024-09-16T09:45:25.167775+0000 mgr.a (mgr.14373) 10739 : audit [DBG] from='client.236223 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:45:27.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:45:27 smithi157 bash[24585]: cluster 2024-09-16T09:45:26.316957+0000 mgr.a (mgr.14373) 10740 : cluster [DBG] pgmap v7448: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:45:27.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:45:27 smithi086 bash[24289]: cluster 2024-09-16T09:45:26.316957+0000 mgr.a (mgr.14373) 10740 : cluster [DBG] pgmap v7448: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:45:27.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:45:27 smithi047 bash[22744]: cluster 2024-09-16T09:45:26.316957+0000 mgr.a (mgr.14373) 10740 : cluster [DBG] pgmap v7448: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:45:29.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:45:29 smithi157 bash[24585]: cluster 2024-09-16T09:45:28.319220+0000 mgr.a (mgr.14373) 10741 : cluster [DBG] pgmap v7449: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:45:29.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:45:29 smithi086 bash[24289]: cluster 2024-09-16T09:45:28.319220+0000 mgr.a (mgr.14373) 10741 : cluster [DBG] pgmap v7449: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:45:29.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:45:29 smithi047 bash[22744]: cluster 2024-09-16T09:45:28.319220+0000 mgr.a (mgr.14373) 10741 : cluster [DBG] pgmap v7449: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:45:30.614 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:45:30.615 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:45:30.615 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:45:31.386 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:45:31.387 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:45:31.387 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:45:31.387 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:45:31.387 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:45:31.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:45:31 smithi157 bash[24585]: cluster 2024-09-16T09:45:30.320012+0000 mgr.a (mgr.14373) 10742 : cluster [DBG] pgmap v7450: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:45:31.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:45:31 smithi086 bash[24289]: cluster 2024-09-16T09:45:30.320012+0000 mgr.a (mgr.14373) 10742 : cluster [DBG] pgmap v7450: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:45:31.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:45:31 smithi047 bash[22744]: cluster 2024-09-16T09:45:30.320012+0000 mgr.a (mgr.14373) 10742 : cluster [DBG] pgmap v7450: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:45:32.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:45:32 smithi157 bash[24585]: audit 2024-09-16T09:45:30.945985+0000 mgr.a (mgr.14373) 10743 : audit [DBG] from='client.236301 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:45:32.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:45:32 smithi086 bash[24289]: audit 2024-09-16T09:45:30.945985+0000 mgr.a (mgr.14373) 10743 : audit [DBG] from='client.236301 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:45:32.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:45:32 smithi047 bash[22744]: audit 2024-09-16T09:45:30.945985+0000 mgr.a (mgr.14373) 10743 : audit [DBG] from='client.236301 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:45:33.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:45:33 smithi157 bash[24585]: cluster 2024-09-16T09:45:32.322461+0000 mgr.a (mgr.14373) 10744 : cluster [DBG] pgmap v7451: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:45:33.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:45:33 smithi086 bash[24289]: cluster 2024-09-16T09:45:32.322461+0000 mgr.a (mgr.14373) 10744 : cluster [DBG] pgmap v7451: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:45:33.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:45:33 smithi047 bash[22744]: cluster 2024-09-16T09:45:32.322461+0000 mgr.a (mgr.14373) 10744 : cluster [DBG] pgmap v7451: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:45:35.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:45:35 smithi157 bash[24585]: cluster 2024-09-16T09:45:34.323234+0000 mgr.a (mgr.14373) 10745 : cluster [DBG] pgmap v7452: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:45:35.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:45:35 smithi086 bash[24289]: cluster 2024-09-16T09:45:34.323234+0000 mgr.a (mgr.14373) 10745 : cluster [DBG] pgmap v7452: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:45:35.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:45:35 smithi047 bash[22744]: cluster 2024-09-16T09:45:34.323234+0000 mgr.a (mgr.14373) 10745 : cluster [DBG] pgmap v7452: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:45:36.388 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:45:36.388 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:45:36.388 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:45:37.167 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:45:37.168 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:45:37.168 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:45:37.168 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:45:37.168 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:45:37.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:45:37 smithi157 bash[24585]: cluster 2024-09-16T09:45:36.324010+0000 mgr.a (mgr.14373) 10746 : cluster [DBG] pgmap v7453: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:45:37.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:45:37 smithi086 bash[24289]: cluster 2024-09-16T09:45:36.324010+0000 mgr.a (mgr.14373) 10746 : cluster [DBG] pgmap v7453: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:45:37.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:45:37 smithi047 bash[22744]: cluster 2024-09-16T09:45:36.324010+0000 mgr.a (mgr.14373) 10746 : cluster [DBG] pgmap v7453: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:45:38.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:45:38 smithi157 bash[24585]: audit 2024-09-16T09:45:36.726644+0000 mgr.a (mgr.14373) 10747 : audit [DBG] from='client.236379 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:45:38.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:45:38 smithi086 bash[24289]: audit 2024-09-16T09:45:36.726644+0000 mgr.a (mgr.14373) 10747 : audit [DBG] from='client.236379 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:45:38.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:45:38 smithi047 bash[22744]: audit 2024-09-16T09:45:36.726644+0000 mgr.a (mgr.14373) 10747 : audit [DBG] from='client.236379 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:45:39.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:45:39 smithi157 bash[24585]: cluster 2024-09-16T09:45:38.326839+0000 mgr.a (mgr.14373) 10748 : cluster [DBG] pgmap v7454: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:45:39.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:45:39 smithi086 bash[24289]: cluster 2024-09-16T09:45:38.326839+0000 mgr.a (mgr.14373) 10748 : cluster [DBG] pgmap v7454: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:45:39.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:45:39 smithi047 bash[22744]: cluster 2024-09-16T09:45:38.326839+0000 mgr.a (mgr.14373) 10748 : cluster [DBG] pgmap v7454: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:45:41.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:45:41 smithi157 bash[24585]: cluster 2024-09-16T09:45:40.327641+0000 mgr.a (mgr.14373) 10749 : cluster [DBG] pgmap v7455: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:45:41.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:45:41 smithi086 bash[24289]: cluster 2024-09-16T09:45:40.327641+0000 mgr.a (mgr.14373) 10749 : cluster [DBG] pgmap v7455: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:45:41.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:45:41 smithi047 bash[22744]: cluster 2024-09-16T09:45:40.327641+0000 mgr.a (mgr.14373) 10749 : cluster [DBG] pgmap v7455: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:45:42.169 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:45:42.170 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:45:42.170 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:45:42.951 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:45:42.951 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:45:42.951 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:45:42.951 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:45:42.951 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:45:43.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:45:43 smithi157 bash[24585]: cluster 2024-09-16T09:45:42.329619+0000 mgr.a (mgr.14373) 10750 : cluster [DBG] pgmap v7456: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:45:43.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:45:43 smithi157 bash[24585]: audit 2024-09-16T09:45:42.508688+0000 mgr.a (mgr.14373) 10751 : audit [DBG] from='client.236454 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:45:43.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:45:43 smithi086 bash[24289]: cluster 2024-09-16T09:45:42.329619+0000 mgr.a (mgr.14373) 10750 : cluster [DBG] pgmap v7456: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:45:43.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:45:43 smithi086 bash[24289]: audit 2024-09-16T09:45:42.508688+0000 mgr.a (mgr.14373) 10751 : audit [DBG] from='client.236454 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:45:43.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:45:43 smithi047 bash[22744]: cluster 2024-09-16T09:45:42.329619+0000 mgr.a (mgr.14373) 10750 : cluster [DBG] pgmap v7456: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:45:43.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:45:43 smithi047 bash[22744]: audit 2024-09-16T09:45:42.508688+0000 mgr.a (mgr.14373) 10751 : audit [DBG] from='client.236454 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:45:45.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:45:45 smithi157 bash[24585]: cluster 2024-09-16T09:45:44.330763+0000 mgr.a (mgr.14373) 10752 : cluster [DBG] pgmap v7457: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:45:45.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:45:45 smithi086 bash[24289]: cluster 2024-09-16T09:45:44.330763+0000 mgr.a (mgr.14373) 10752 : cluster [DBG] pgmap v7457: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:45:45.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:45:45 smithi047 bash[22744]: cluster 2024-09-16T09:45:44.330763+0000 mgr.a (mgr.14373) 10752 : cluster [DBG] pgmap v7457: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:45:47.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:45:47 smithi157 bash[24585]: cluster 2024-09-16T09:45:46.331694+0000 mgr.a (mgr.14373) 10753 : cluster [DBG] pgmap v7458: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T09:45:47.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:45:47 smithi086 bash[24289]: cluster 2024-09-16T09:45:46.331694+0000 mgr.a (mgr.14373) 10753 : cluster [DBG] pgmap v7458: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T09:45:47.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:45:47 smithi047 bash[22744]: cluster 2024-09-16T09:45:46.331694+0000 mgr.a (mgr.14373) 10753 : cluster [DBG] pgmap v7458: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T09:45:47.952 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:45:47.953 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:45:47.953 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:45:48.748 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:45:48.748 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:45:48.749 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:45:48.749 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:45:48.749 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:45:49.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:45:49 smithi157 bash[24585]: audit 2024-09-16T09:45:48.287395+0000 mgr.a (mgr.14373) 10754 : audit [DBG] from='client.236529 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:45:49.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:45:49 smithi157 bash[24585]: cluster 2024-09-16T09:45:48.333670+0000 mgr.a (mgr.14373) 10755 : cluster [DBG] pgmap v7459: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:45:49.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:45:49 smithi086 bash[24289]: audit 2024-09-16T09:45:48.287395+0000 mgr.a (mgr.14373) 10754 : audit [DBG] from='client.236529 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:45:49.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:45:49 smithi086 bash[24289]: cluster 2024-09-16T09:45:48.333670+0000 mgr.a (mgr.14373) 10755 : cluster [DBG] pgmap v7459: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:45:49.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:45:49 smithi047 bash[22744]: audit 2024-09-16T09:45:48.287395+0000 mgr.a (mgr.14373) 10754 : audit [DBG] from='client.236529 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:45:49.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:45:49 smithi047 bash[22744]: cluster 2024-09-16T09:45:48.333670+0000 mgr.a (mgr.14373) 10755 : cluster [DBG] pgmap v7459: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:45:51.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:45:51 smithi157 bash[24585]: cluster 2024-09-16T09:45:50.334590+0000 mgr.a (mgr.14373) 10756 : cluster [DBG] pgmap v7460: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:45:51.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:45:51 smithi086 bash[24289]: cluster 2024-09-16T09:45:50.334590+0000 mgr.a (mgr.14373) 10756 : cluster [DBG] pgmap v7460: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:45:51.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:45:51 smithi047 bash[22744]: cluster 2024-09-16T09:45:50.334590+0000 mgr.a (mgr.14373) 10756 : cluster [DBG] pgmap v7460: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:45:53.749 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:45:53.750 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:45:53.750 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:45:53.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:45:53 smithi157 bash[24585]: cluster 2024-09-16T09:45:52.336952+0000 mgr.a (mgr.14373) 10757 : cluster [DBG] pgmap v7461: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:45:53.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:45:53 smithi086 bash[24289]: cluster 2024-09-16T09:45:52.336952+0000 mgr.a (mgr.14373) 10757 : cluster [DBG] pgmap v7461: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:45:53.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:45:53 smithi047 bash[22744]: cluster 2024-09-16T09:45:52.336952+0000 mgr.a (mgr.14373) 10757 : cluster [DBG] pgmap v7461: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:45:54.528 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:45:54.528 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:45:54.529 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:45:54.529 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:45:54.529 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:45:55.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:45:55 smithi157 bash[24585]: audit 2024-09-16T09:45:54.089138+0000 mgr.a (mgr.14373) 10758 : audit [DBG] from='client.236607 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:45:55.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:45:55 smithi157 bash[24585]: cluster 2024-09-16T09:45:54.337635+0000 mgr.a (mgr.14373) 10759 : cluster [DBG] pgmap v7462: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:45:55.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:45:55 smithi086 bash[24289]: audit 2024-09-16T09:45:54.089138+0000 mgr.a (mgr.14373) 10758 : audit [DBG] from='client.236607 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:45:55.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:45:55 smithi086 bash[24289]: cluster 2024-09-16T09:45:54.337635+0000 mgr.a (mgr.14373) 10759 : cluster [DBG] pgmap v7462: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:45:55.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:45:55 smithi047 bash[22744]: audit 2024-09-16T09:45:54.089138+0000 mgr.a (mgr.14373) 10758 : audit [DBG] from='client.236607 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:45:55.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:45:55 smithi047 bash[22744]: cluster 2024-09-16T09:45:54.337635+0000 mgr.a (mgr.14373) 10759 : cluster [DBG] pgmap v7462: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:45:56.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:45:56 smithi157 bash[24585]: audit 2024-09-16T09:45:56.289355+0000 mon.b (mon.2) 994 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T09:45:56.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:45:56 smithi086 bash[24289]: audit 2024-09-16T09:45:56.289355+0000 mon.b (mon.2) 994 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T09:45:56.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:45:56 smithi047 bash[22744]: audit 2024-09-16T09:45:56.289355+0000 mon.b (mon.2) 994 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T09:45:57.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:45:57 smithi157 bash[24585]: cluster 2024-09-16T09:45:56.338531+0000 mgr.a (mgr.14373) 10760 : cluster [DBG] pgmap v7463: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:45:57.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:45:57 smithi157 bash[24585]: audit 2024-09-16T09:45:56.902567+0000 mon.a (mon.0) 1213 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:45:57.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:45:57 smithi157 bash[24585]: audit 2024-09-16T09:45:56.908404+0000 mon.a (mon.0) 1214 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:45:57.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:45:57 smithi157 bash[24585]: audit 2024-09-16T09:45:56.925412+0000 mon.a (mon.0) 1215 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:45:57.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:45:57 smithi157 bash[24585]: audit 2024-09-16T09:45:56.931434+0000 mon.a (mon.0) 1216 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:45:57.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:45:57 smithi086 bash[24289]: cluster 2024-09-16T09:45:56.338531+0000 mgr.a (mgr.14373) 10760 : cluster [DBG] pgmap v7463: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:45:57.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:45:57 smithi086 bash[24289]: audit 2024-09-16T09:45:56.902567+0000 mon.a (mon.0) 1213 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:45:57.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:45:57 smithi086 bash[24289]: audit 2024-09-16T09:45:56.908404+0000 mon.a (mon.0) 1214 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:45:57.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:45:57 smithi086 bash[24289]: audit 2024-09-16T09:45:56.925412+0000 mon.a (mon.0) 1215 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:45:57.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:45:57 smithi086 bash[24289]: audit 2024-09-16T09:45:56.931434+0000 mon.a (mon.0) 1216 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:45:57.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:45:57 smithi047 bash[22744]: cluster 2024-09-16T09:45:56.338531+0000 mgr.a (mgr.14373) 10760 : cluster [DBG] pgmap v7463: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:45:57.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:45:57 smithi047 bash[22744]: audit 2024-09-16T09:45:56.902567+0000 mon.a (mon.0) 1213 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:45:57.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:45:57 smithi047 bash[22744]: audit 2024-09-16T09:45:56.908404+0000 mon.a (mon.0) 1214 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:45:57.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:45:57 smithi047 bash[22744]: audit 2024-09-16T09:45:56.925412+0000 mon.a (mon.0) 1215 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:45:57.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:45:57 smithi047 bash[22744]: audit 2024-09-16T09:45:56.931434+0000 mon.a (mon.0) 1216 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:45:58.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:45:58 smithi157 bash[24585]: audit 2024-09-16T09:45:57.578764+0000 mon.b (mon.2) 995 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:45:58.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:45:58 smithi157 bash[24585]: audit 2024-09-16T09:45:57.580728+0000 mon.b (mon.2) 996 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T09:45:58.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:45:58 smithi157 bash[24585]: audit 2024-09-16T09:45:57.591755+0000 mon.a (mon.0) 1217 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:45:58.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:45:58 smithi157 bash[24585]: audit 2024-09-16T09:45:57.597291+0000 mon.b (mon.2) 997 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:45:58.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:45:58 smithi157 bash[24585]: audit 2024-09-16T09:45:57.599316+0000 mgr.a (mgr.14373) 10761 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:45:58.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:45:58 smithi086 bash[24289]: audit 2024-09-16T09:45:57.578764+0000 mon.b (mon.2) 995 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:45:58.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:45:58 smithi086 bash[24289]: audit 2024-09-16T09:45:57.580728+0000 mon.b (mon.2) 996 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T09:45:58.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:45:58 smithi086 bash[24289]: audit 2024-09-16T09:45:57.591755+0000 mon.a (mon.0) 1217 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:45:58.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:45:58 smithi086 bash[24289]: audit 2024-09-16T09:45:57.597291+0000 mon.b (mon.2) 997 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:45:58.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:45:58 smithi086 bash[24289]: audit 2024-09-16T09:45:57.599316+0000 mgr.a (mgr.14373) 10761 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:45:58.842 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 09:45:58 smithi047 bash[22994]: debug 2024-09-16T09:45:58.340+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T09:45:58.842 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 09:45:58 smithi047 bash[22994]: debug 2024-09-16T09:45:58.340+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T09:45:58.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:45:58 smithi047 bash[22744]: audit 2024-09-16T09:45:57.578764+0000 mon.b (mon.2) 995 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:45:58.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:45:58 smithi047 bash[22744]: audit 2024-09-16T09:45:57.580728+0000 mon.b (mon.2) 996 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T09:45:58.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:45:58 smithi047 bash[22744]: audit 2024-09-16T09:45:57.591755+0000 mon.a (mon.0) 1217 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:45:58.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:45:58 smithi047 bash[22744]: audit 2024-09-16T09:45:57.597291+0000 mon.b (mon.2) 997 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:45:58.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:45:58 smithi047 bash[22744]: audit 2024-09-16T09:45:57.599316+0000 mgr.a (mgr.14373) 10761 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:45:59.530 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:45:59.531 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:45:59.531 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:46:00.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:45:59 smithi157 bash[24585]: cluster 2024-09-16T09:45:58.339818+0000 mgr.a (mgr.14373) 10762 : cluster [DBG] pgmap v7464: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:46:00.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:45:59 smithi157 bash[24585]: audit 2024-09-16T09:45:58.343362+0000 mgr.a (mgr.14373) 10763 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T09:46:00.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:45:59 smithi157 bash[24585]: cephadm 2024-09-16T09:45:58.345957+0000 mgr.a (mgr.14373) 10764 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T09:46:00.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:45:59 smithi086 bash[24289]: cluster 2024-09-16T09:45:58.339818+0000 mgr.a (mgr.14373) 10762 : cluster [DBG] pgmap v7464: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:46:00.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:45:59 smithi086 bash[24289]: audit 2024-09-16T09:45:58.343362+0000 mgr.a (mgr.14373) 10763 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T09:46:00.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:45:59 smithi086 bash[24289]: cephadm 2024-09-16T09:45:58.345957+0000 mgr.a (mgr.14373) 10764 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T09:46:00.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:45:59 smithi047 bash[22744]: cluster 2024-09-16T09:45:58.339818+0000 mgr.a (mgr.14373) 10762 : cluster [DBG] pgmap v7464: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:46:00.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:45:59 smithi047 bash[22744]: audit 2024-09-16T09:45:58.343362+0000 mgr.a (mgr.14373) 10763 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T09:46:00.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:45:59 smithi047 bash[22744]: cephadm 2024-09-16T09:45:58.345957+0000 mgr.a (mgr.14373) 10764 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T09:46:00.277 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:46:00.277 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:46:00.277 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:46:00.277 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:46:00.277 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:46:01.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:46:00 smithi086 bash[24289]: audit 2024-09-16T09:45:59.857426+0000 mgr.a (mgr.14373) 10765 : audit [DBG] from='client.236790 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:46:01.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:46:00 smithi086 bash[24289]: cluster 2024-09-16T09:46:00.340388+0000 mgr.a (mgr.14373) 10766 : cluster [DBG] pgmap v7465: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:46:01.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:46:00 smithi047 bash[22744]: audit 2024-09-16T09:45:59.857426+0000 mgr.a (mgr.14373) 10765 : audit [DBG] from='client.236790 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:46:01.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:46:00 smithi047 bash[22744]: cluster 2024-09-16T09:46:00.340388+0000 mgr.a (mgr.14373) 10766 : cluster [DBG] pgmap v7465: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:46:01.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:46:00 smithi157 bash[24585]: audit 2024-09-16T09:45:59.857426+0000 mgr.a (mgr.14373) 10765 : audit [DBG] from='client.236790 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:46:01.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:46:00 smithi157 bash[24585]: cluster 2024-09-16T09:46:00.340388+0000 mgr.a (mgr.14373) 10766 : cluster [DBG] pgmap v7465: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:46:03.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:46:03 smithi157 bash[24585]: cluster 2024-09-16T09:46:02.342586+0000 mgr.a (mgr.14373) 10767 : cluster [DBG] pgmap v7466: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:46:03.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:46:03 smithi086 bash[24289]: cluster 2024-09-16T09:46:02.342586+0000 mgr.a (mgr.14373) 10767 : cluster [DBG] pgmap v7466: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:46:03.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:46:03 smithi047 bash[22744]: cluster 2024-09-16T09:46:02.342586+0000 mgr.a (mgr.14373) 10767 : cluster [DBG] pgmap v7466: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:46:05.278 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:46:05.279 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:46:05.279 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:46:05.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:46:05 smithi157 bash[24585]: cluster 2024-09-16T09:46:04.343355+0000 mgr.a (mgr.14373) 10768 : cluster [DBG] pgmap v7467: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:46:05.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:46:05 smithi086 bash[24289]: cluster 2024-09-16T09:46:04.343355+0000 mgr.a (mgr.14373) 10768 : cluster [DBG] pgmap v7467: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:46:05.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:46:05 smithi047 bash[22744]: cluster 2024-09-16T09:46:04.343355+0000 mgr.a (mgr.14373) 10768 : cluster [DBG] pgmap v7467: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:46:06.016 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:46:06.017 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:46:06.017 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:46:06.017 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:46:06.017 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:46:06.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:46:06 smithi157 bash[24585]: audit 2024-09-16T09:46:05.608272+0000 mgr.a (mgr.14373) 10769 : audit [DBG] from='client.236865 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:46:06.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:46:06 smithi086 bash[24289]: audit 2024-09-16T09:46:05.608272+0000 mgr.a (mgr.14373) 10769 : audit [DBG] from='client.236865 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:46:06.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:46:06 smithi047 bash[22744]: audit 2024-09-16T09:46:05.608272+0000 mgr.a (mgr.14373) 10769 : audit [DBG] from='client.236865 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:46:07.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:46:07 smithi157 bash[24585]: cluster 2024-09-16T09:46:06.344468+0000 mgr.a (mgr.14373) 10770 : cluster [DBG] pgmap v7468: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:46:07.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:46:07 smithi086 bash[24289]: cluster 2024-09-16T09:46:06.344468+0000 mgr.a (mgr.14373) 10770 : cluster [DBG] pgmap v7468: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:46:07.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:46:07 smithi047 bash[22744]: cluster 2024-09-16T09:46:06.344468+0000 mgr.a (mgr.14373) 10770 : cluster [DBG] pgmap v7468: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:46:09.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:46:09 smithi157 bash[24585]: cluster 2024-09-16T09:46:08.346908+0000 mgr.a (mgr.14373) 10771 : cluster [DBG] pgmap v7469: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:46:09.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:46:09 smithi086 bash[24289]: cluster 2024-09-16T09:46:08.346908+0000 mgr.a (mgr.14373) 10771 : cluster [DBG] pgmap v7469: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:46:09.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:46:09 smithi047 bash[22744]: cluster 2024-09-16T09:46:08.346908+0000 mgr.a (mgr.14373) 10771 : cluster [DBG] pgmap v7469: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:46:11.020 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:46:11.021 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:46:11.021 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:46:11.803 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:46:11.803 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:46:11.803 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:46:11.803 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:46:11.804 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:46:11.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:46:11 smithi157 bash[24585]: cluster 2024-09-16T09:46:10.347852+0000 mgr.a (mgr.14373) 10772 : cluster [DBG] pgmap v7470: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:46:11.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:46:11 smithi086 bash[24289]: cluster 2024-09-16T09:46:10.347852+0000 mgr.a (mgr.14373) 10772 : cluster [DBG] pgmap v7470: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:46:11.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:46:11 smithi047 bash[22744]: cluster 2024-09-16T09:46:10.347852+0000 mgr.a (mgr.14373) 10772 : cluster [DBG] pgmap v7470: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:46:12.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:46:12 smithi157 bash[24585]: audit 2024-09-16T09:46:11.356083+0000 mgr.a (mgr.14373) 10773 : audit [DBG] from='client.236937 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:46:12.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:46:12 smithi086 bash[24289]: audit 2024-09-16T09:46:11.356083+0000 mgr.a (mgr.14373) 10773 : audit [DBG] from='client.236937 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:46:12.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:46:12 smithi047 bash[22744]: audit 2024-09-16T09:46:11.356083+0000 mgr.a (mgr.14373) 10773 : audit [DBG] from='client.236937 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:46:13.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:46:13 smithi157 bash[24585]: cluster 2024-09-16T09:46:12.350795+0000 mgr.a (mgr.14373) 10774 : cluster [DBG] pgmap v7471: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.1 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:46:13.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:46:13 smithi086 bash[24289]: cluster 2024-09-16T09:46:12.350795+0000 mgr.a (mgr.14373) 10774 : cluster [DBG] pgmap v7471: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.1 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:46:13.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:46:13 smithi047 bash[22744]: cluster 2024-09-16T09:46:12.350795+0000 mgr.a (mgr.14373) 10774 : cluster [DBG] pgmap v7471: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.1 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:46:15.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:46:15 smithi157 bash[24585]: cluster 2024-09-16T09:46:14.351615+0000 mgr.a (mgr.14373) 10775 : cluster [DBG] pgmap v7472: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-16T09:46:15.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:46:15 smithi086 bash[24289]: cluster 2024-09-16T09:46:14.351615+0000 mgr.a (mgr.14373) 10775 : cluster [DBG] pgmap v7472: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-16T09:46:15.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:46:15 smithi047 bash[22744]: cluster 2024-09-16T09:46:14.351615+0000 mgr.a (mgr.14373) 10775 : cluster [DBG] pgmap v7472: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-16T09:46:16.805 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:46:16.806 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:46:16.806 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:46:17.551 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:46:17.551 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:46:17.551 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:46:17.552 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:46:17.552 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:46:17.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:46:17 smithi157 bash[24585]: cluster 2024-09-16T09:46:16.352390+0000 mgr.a (mgr.14373) 10776 : cluster [DBG] pgmap v7473: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-16T09:46:17.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:46:17 smithi086 bash[24289]: cluster 2024-09-16T09:46:16.352390+0000 mgr.a (mgr.14373) 10776 : cluster [DBG] pgmap v7473: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-16T09:46:17.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:46:17 smithi047 bash[22744]: cluster 2024-09-16T09:46:16.352390+0000 mgr.a (mgr.14373) 10776 : cluster [DBG] pgmap v7473: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-16T09:46:18.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:46:18 smithi157 bash[24585]: audit 2024-09-16T09:46:17.135581+0000 mgr.a (mgr.14373) 10777 : audit [DBG] from='client.237015 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:46:18.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:46:18 smithi086 bash[24289]: audit 2024-09-16T09:46:17.135581+0000 mgr.a (mgr.14373) 10777 : audit [DBG] from='client.237015 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:46:18.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:46:18 smithi047 bash[22744]: audit 2024-09-16T09:46:17.135581+0000 mgr.a (mgr.14373) 10777 : audit [DBG] from='client.237015 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:46:19.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:46:19 smithi157 bash[24585]: cluster 2024-09-16T09:46:18.355238+0000 mgr.a (mgr.14373) 10778 : cluster [DBG] pgmap v7474: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:46:19.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:46:19 smithi086 bash[24289]: cluster 2024-09-16T09:46:18.355238+0000 mgr.a (mgr.14373) 10778 : cluster [DBG] pgmap v7474: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:46:19.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:46:19 smithi047 bash[22744]: cluster 2024-09-16T09:46:18.355238+0000 mgr.a (mgr.14373) 10778 : cluster [DBG] pgmap v7474: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:46:21.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:46:21 smithi157 bash[24585]: cluster 2024-09-16T09:46:20.356062+0000 mgr.a (mgr.14373) 10779 : cluster [DBG] pgmap v7475: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:46:21.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:46:21 smithi086 bash[24289]: cluster 2024-09-16T09:46:20.356062+0000 mgr.a (mgr.14373) 10779 : cluster [DBG] pgmap v7475: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:46:21.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:46:21 smithi047 bash[22744]: cluster 2024-09-16T09:46:20.356062+0000 mgr.a (mgr.14373) 10779 : cluster [DBG] pgmap v7475: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:46:22.553 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:46:22.553 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:46:22.554 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:46:23.324 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:46:23.325 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:46:23.325 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:46:23.325 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:46:23.325 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:46:23.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:46:23 smithi157 bash[24585]: cluster 2024-09-16T09:46:22.358091+0000 mgr.a (mgr.14373) 10780 : cluster [DBG] pgmap v7476: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:46:23.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:46:23 smithi086 bash[24289]: cluster 2024-09-16T09:46:22.358091+0000 mgr.a (mgr.14373) 10780 : cluster [DBG] pgmap v7476: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:46:23.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:46:23 smithi047 bash[22744]: cluster 2024-09-16T09:46:22.358091+0000 mgr.a (mgr.14373) 10780 : cluster [DBG] pgmap v7476: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:46:24.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:46:24 smithi157 bash[24585]: audit 2024-09-16T09:46:22.886025+0000 mgr.a (mgr.14373) 10781 : audit [DBG] from='client.237093 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:46:24.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:46:24 smithi086 bash[24289]: audit 2024-09-16T09:46:22.886025+0000 mgr.a (mgr.14373) 10781 : audit [DBG] from='client.237093 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:46:24.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:46:24 smithi047 bash[22744]: audit 2024-09-16T09:46:22.886025+0000 mgr.a (mgr.14373) 10781 : audit [DBG] from='client.237093 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:46:25.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:46:25 smithi157 bash[24585]: cluster 2024-09-16T09:46:24.359016+0000 mgr.a (mgr.14373) 10782 : cluster [DBG] pgmap v7477: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-16T09:46:25.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:46:25 smithi086 bash[24289]: cluster 2024-09-16T09:46:24.359016+0000 mgr.a (mgr.14373) 10782 : cluster [DBG] pgmap v7477: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-16T09:46:25.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:46:25 smithi047 bash[22744]: cluster 2024-09-16T09:46:24.359016+0000 mgr.a (mgr.14373) 10782 : cluster [DBG] pgmap v7477: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-16T09:46:27.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:46:27 smithi157 bash[24585]: cluster 2024-09-16T09:46:26.359817+0000 mgr.a (mgr.14373) 10783 : cluster [DBG] pgmap v7478: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-16T09:46:27.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:46:27 smithi086 bash[24289]: cluster 2024-09-16T09:46:26.359817+0000 mgr.a (mgr.14373) 10783 : cluster [DBG] pgmap v7478: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-16T09:46:27.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:46:27 smithi047 bash[22744]: cluster 2024-09-16T09:46:26.359817+0000 mgr.a (mgr.14373) 10783 : cluster [DBG] pgmap v7478: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-16T09:46:28.326 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:46:28.327 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:46:28.327 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:46:29.123 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:46:29.123 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:46:29.123 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:46:29.123 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:46:29.123 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:46:29.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:46:29 smithi157 bash[24585]: cluster 2024-09-16T09:46:28.361841+0000 mgr.a (mgr.14373) 10784 : cluster [DBG] pgmap v7479: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:46:29.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:46:29 smithi157 bash[24585]: audit 2024-09-16T09:46:28.666669+0000 mgr.a (mgr.14373) 10785 : audit [DBG] from='client.237171 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:46:29.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:46:29 smithi086 bash[24289]: cluster 2024-09-16T09:46:28.361841+0000 mgr.a (mgr.14373) 10784 : cluster [DBG] pgmap v7479: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:46:29.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:46:29 smithi086 bash[24289]: audit 2024-09-16T09:46:28.666669+0000 mgr.a (mgr.14373) 10785 : audit [DBG] from='client.237171 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:46:29.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:46:29 smithi047 bash[22744]: cluster 2024-09-16T09:46:28.361841+0000 mgr.a (mgr.14373) 10784 : cluster [DBG] pgmap v7479: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:46:29.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:46:29 smithi047 bash[22744]: audit 2024-09-16T09:46:28.666669+0000 mgr.a (mgr.14373) 10785 : audit [DBG] from='client.237171 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:46:31.808 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:46:31 smithi157 bash[24585]: cluster 2024-09-16T09:46:30.362790+0000 mgr.a (mgr.14373) 10786 : cluster [DBG] pgmap v7480: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:46:31.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:46:31 smithi086 bash[24289]: cluster 2024-09-16T09:46:30.362790+0000 mgr.a (mgr.14373) 10786 : cluster [DBG] pgmap v7480: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:46:31.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:46:31 smithi047 bash[22744]: cluster 2024-09-16T09:46:30.362790+0000 mgr.a (mgr.14373) 10786 : cluster [DBG] pgmap v7480: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:46:33.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:46:33 smithi157 bash[24585]: cluster 2024-09-16T09:46:32.365036+0000 mgr.a (mgr.14373) 10787 : cluster [DBG] pgmap v7481: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:46:33.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:46:33 smithi086 bash[24289]: cluster 2024-09-16T09:46:32.365036+0000 mgr.a (mgr.14373) 10787 : cluster [DBG] pgmap v7481: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:46:33.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:46:33 smithi047 bash[22744]: cluster 2024-09-16T09:46:32.365036+0000 mgr.a (mgr.14373) 10787 : cluster [DBG] pgmap v7481: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:46:34.124 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:46:34.125 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:46:34.125 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:46:34.885 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:46:34.886 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:46:34.886 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:46:34.886 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:46:34.886 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:46:35.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:46:35 smithi157 bash[24585]: cluster 2024-09-16T09:46:34.365747+0000 mgr.a (mgr.14373) 10788 : cluster [DBG] pgmap v7482: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:46:35.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:46:35 smithi157 bash[24585]: audit 2024-09-16T09:46:34.457436+0000 mgr.a (mgr.14373) 10789 : audit [DBG] from='client.237249 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:46:35.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:46:35 smithi086 bash[24289]: cluster 2024-09-16T09:46:34.365747+0000 mgr.a (mgr.14373) 10788 : cluster [DBG] pgmap v7482: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:46:35.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:46:35 smithi086 bash[24289]: audit 2024-09-16T09:46:34.457436+0000 mgr.a (mgr.14373) 10789 : audit [DBG] from='client.237249 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:46:35.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:46:35 smithi047 bash[22744]: cluster 2024-09-16T09:46:34.365747+0000 mgr.a (mgr.14373) 10788 : cluster [DBG] pgmap v7482: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:46:35.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:46:35 smithi047 bash[22744]: audit 2024-09-16T09:46:34.457436+0000 mgr.a (mgr.14373) 10789 : audit [DBG] from='client.237249 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:46:37.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:46:37 smithi157 bash[24585]: cluster 2024-09-16T09:46:36.366678+0000 mgr.a (mgr.14373) 10790 : cluster [DBG] pgmap v7483: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:46:37.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:46:37 smithi086 bash[24289]: cluster 2024-09-16T09:46:36.366678+0000 mgr.a (mgr.14373) 10790 : cluster [DBG] pgmap v7483: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:46:37.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:46:37 smithi047 bash[22744]: cluster 2024-09-16T09:46:36.366678+0000 mgr.a (mgr.14373) 10790 : cluster [DBG] pgmap v7483: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:46:39.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:46:39 smithi157 bash[24585]: cluster 2024-09-16T09:46:38.368920+0000 mgr.a (mgr.14373) 10791 : cluster [DBG] pgmap v7484: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:46:39.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:46:39 smithi086 bash[24289]: cluster 2024-09-16T09:46:38.368920+0000 mgr.a (mgr.14373) 10791 : cluster [DBG] pgmap v7484: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:46:39.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:46:39 smithi047 bash[22744]: cluster 2024-09-16T09:46:38.368920+0000 mgr.a (mgr.14373) 10791 : cluster [DBG] pgmap v7484: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:46:39.887 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:46:39.888 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:46:39.888 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:46:40.646 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:46:40.647 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:46:40.647 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:46:40.647 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:46:40.647 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:46:41.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:46:41 smithi157 bash[24585]: audit 2024-09-16T09:46:40.220194+0000 mgr.a (mgr.14373) 10792 : audit [DBG] from='client.237327 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:46:42.185 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:46:41 smithi157 bash[24585]: cluster 2024-09-16T09:46:40.369741+0000 mgr.a (mgr.14373) 10793 : cluster [DBG] pgmap v7485: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:46:42.186 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:46:41 smithi047 bash[22744]: audit 2024-09-16T09:46:40.220194+0000 mgr.a (mgr.14373) 10792 : audit [DBG] from='client.237327 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:46:42.187 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:46:41 smithi047 bash[22744]: cluster 2024-09-16T09:46:40.369741+0000 mgr.a (mgr.14373) 10793 : cluster [DBG] pgmap v7485: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:46:42.187 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:46:41 smithi086 bash[24289]: audit 2024-09-16T09:46:40.220194+0000 mgr.a (mgr.14373) 10792 : audit [DBG] from='client.237327 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:46:42.187 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:46:41 smithi086 bash[24289]: cluster 2024-09-16T09:46:40.369741+0000 mgr.a (mgr.14373) 10793 : cluster [DBG] pgmap v7485: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:46:43.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:46:43 smithi157 bash[24585]: cluster 2024-09-16T09:46:42.372726+0000 mgr.a (mgr.14373) 10794 : cluster [DBG] pgmap v7486: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:46:43.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:46:43 smithi086 bash[24289]: cluster 2024-09-16T09:46:42.372726+0000 mgr.a (mgr.14373) 10794 : cluster [DBG] pgmap v7486: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:46:43.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:46:43 smithi047 bash[22744]: cluster 2024-09-16T09:46:42.372726+0000 mgr.a (mgr.14373) 10794 : cluster [DBG] pgmap v7486: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:46:45.648 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:46:45.649 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:46:45.649 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:46:45.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:46:45 smithi157 bash[24585]: cluster 2024-09-16T09:46:44.373515+0000 mgr.a (mgr.14373) 10795 : cluster [DBG] pgmap v7487: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:46:45.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:46:45 smithi086 bash[24289]: cluster 2024-09-16T09:46:44.373515+0000 mgr.a (mgr.14373) 10795 : cluster [DBG] pgmap v7487: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:46:45.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:46:45 smithi047 bash[22744]: cluster 2024-09-16T09:46:44.373515+0000 mgr.a (mgr.14373) 10795 : cluster [DBG] pgmap v7487: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:46:46.430 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:46:46.430 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:46:46.430 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:46:46.430 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:46:46.430 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:46:47.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:46:47 smithi157 bash[24585]: audit 2024-09-16T09:46:45.982156+0000 mgr.a (mgr.14373) 10796 : audit [DBG] from='client.237405 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:46:47.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:46:47 smithi157 bash[24585]: cluster 2024-09-16T09:46:46.374058+0000 mgr.a (mgr.14373) 10797 : cluster [DBG] pgmap v7488: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:46:47.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:46:47 smithi086 bash[24289]: audit 2024-09-16T09:46:45.982156+0000 mgr.a (mgr.14373) 10796 : audit [DBG] from='client.237405 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:46:47.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:46:47 smithi086 bash[24289]: cluster 2024-09-16T09:46:46.374058+0000 mgr.a (mgr.14373) 10797 : cluster [DBG] pgmap v7488: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:46:47.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:46:47 smithi047 bash[22744]: audit 2024-09-16T09:46:45.982156+0000 mgr.a (mgr.14373) 10796 : audit [DBG] from='client.237405 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:46:47.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:46:47 smithi047 bash[22744]: cluster 2024-09-16T09:46:46.374058+0000 mgr.a (mgr.14373) 10797 : cluster [DBG] pgmap v7488: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:46:49.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:46:49 smithi157 bash[24585]: cluster 2024-09-16T09:46:48.376212+0000 mgr.a (mgr.14373) 10798 : cluster [DBG] pgmap v7489: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:46:49.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:46:49 smithi086 bash[24289]: cluster 2024-09-16T09:46:48.376212+0000 mgr.a (mgr.14373) 10798 : cluster [DBG] pgmap v7489: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:46:49.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:46:49 smithi047 bash[22744]: cluster 2024-09-16T09:46:48.376212+0000 mgr.a (mgr.14373) 10798 : cluster [DBG] pgmap v7489: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:46:51.431 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:46:51.432 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:46:51.432 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:46:51.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:46:51 smithi157 bash[24585]: cluster 2024-09-16T09:46:50.376979+0000 mgr.a (mgr.14373) 10799 : cluster [DBG] pgmap v7490: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:46:51.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:46:51 smithi086 bash[24289]: cluster 2024-09-16T09:46:50.376979+0000 mgr.a (mgr.14373) 10799 : cluster [DBG] pgmap v7490: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:46:51.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:46:51 smithi047 bash[22744]: cluster 2024-09-16T09:46:50.376979+0000 mgr.a (mgr.14373) 10799 : cluster [DBG] pgmap v7490: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:46:52.169 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:46:52.170 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:46:52.170 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:46:52.170 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:46:52.170 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:46:53.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:46:53 smithi157 bash[24585]: audit 2024-09-16T09:46:51.760666+0000 mgr.a (mgr.14373) 10800 : audit [DBG] from='client.237480 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:46:53.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:46:53 smithi157 bash[24585]: cluster 2024-09-16T09:46:52.379773+0000 mgr.a (mgr.14373) 10801 : cluster [DBG] pgmap v7491: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:46:53.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:46:53 smithi086 bash[24289]: audit 2024-09-16T09:46:51.760666+0000 mgr.a (mgr.14373) 10800 : audit [DBG] from='client.237480 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:46:53.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:46:53 smithi086 bash[24289]: cluster 2024-09-16T09:46:52.379773+0000 mgr.a (mgr.14373) 10801 : cluster [DBG] pgmap v7491: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:46:53.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:46:53 smithi047 bash[22744]: audit 2024-09-16T09:46:51.760666+0000 mgr.a (mgr.14373) 10800 : audit [DBG] from='client.237480 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:46:53.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:46:53 smithi047 bash[22744]: cluster 2024-09-16T09:46:52.379773+0000 mgr.a (mgr.14373) 10801 : cluster [DBG] pgmap v7491: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:46:55.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:46:55 smithi157 bash[24585]: cluster 2024-09-16T09:46:54.380588+0000 mgr.a (mgr.14373) 10802 : cluster [DBG] pgmap v7492: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:46:55.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:46:55 smithi086 bash[24289]: cluster 2024-09-16T09:46:54.380588+0000 mgr.a (mgr.14373) 10802 : cluster [DBG] pgmap v7492: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:46:55.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:46:55 smithi047 bash[22744]: cluster 2024-09-16T09:46:54.380588+0000 mgr.a (mgr.14373) 10802 : cluster [DBG] pgmap v7492: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:46:57.171 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:46:57.172 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:46:57.172 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:46:57.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:46:57 smithi157 bash[24585]: cluster 2024-09-16T09:46:56.381380+0000 mgr.a (mgr.14373) 10803 : cluster [DBG] pgmap v7493: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T09:46:57.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:46:57 smithi086 bash[24289]: cluster 2024-09-16T09:46:56.381380+0000 mgr.a (mgr.14373) 10803 : cluster [DBG] pgmap v7493: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T09:46:57.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:46:57 smithi047 bash[22744]: cluster 2024-09-16T09:46:56.381380+0000 mgr.a (mgr.14373) 10803 : cluster [DBG] pgmap v7493: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T09:46:57.927 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:46:57.927 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:46:57.927 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:46:57.927 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:46:57.927 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:46:58.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:46:58 smithi157 bash[24585]: audit 2024-09-16T09:46:57.501706+0000 mgr.a (mgr.14373) 10804 : audit [DBG] from='client.237558 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:46:58.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:46:58 smithi157 bash[24585]: audit 2024-09-16T09:46:58.402298+0000 mon.b (mon.2) 998 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T09:46:58.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:46:58 smithi086 bash[24289]: audit 2024-09-16T09:46:57.501706+0000 mgr.a (mgr.14373) 10804 : audit [DBG] from='client.237558 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:46:58.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:46:58 smithi086 bash[24289]: audit 2024-09-16T09:46:58.402298+0000 mon.b (mon.2) 998 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T09:46:58.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:46:58 smithi047 bash[22744]: audit 2024-09-16T09:46:57.501706+0000 mgr.a (mgr.14373) 10804 : audit [DBG] from='client.237558 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:46:58.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:46:58 smithi047 bash[22744]: audit 2024-09-16T09:46:58.402298+0000 mon.b (mon.2) 998 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T09:46:59.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:46:59 smithi157 bash[24585]: cluster 2024-09-16T09:46:58.384226+0000 mgr.a (mgr.14373) 10805 : cluster [DBG] pgmap v7494: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:46:59.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:46:59 smithi157 bash[24585]: audit 2024-09-16T09:46:59.251117+0000 mon.b (mon.2) 999 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:46:59.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:46:59 smithi157 bash[24585]: audit 2024-09-16T09:46:59.253244+0000 mon.b (mon.2) 1000 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T09:46:59.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:46:59 smithi157 bash[24585]: audit 2024-09-16T09:46:59.264365+0000 mon.a (mon.0) 1218 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:46:59.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:46:59 smithi157 bash[24585]: audit 2024-09-16T09:46:59.270096+0000 mon.b (mon.2) 1001 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:46:59.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:46:59 smithi086 bash[24289]: cluster 2024-09-16T09:46:58.384226+0000 mgr.a (mgr.14373) 10805 : cluster [DBG] pgmap v7494: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:46:59.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:46:59 smithi086 bash[24289]: audit 2024-09-16T09:46:59.251117+0000 mon.b (mon.2) 999 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:46:59.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:46:59 smithi086 bash[24289]: audit 2024-09-16T09:46:59.253244+0000 mon.b (mon.2) 1000 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T09:46:59.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:46:59 smithi086 bash[24289]: audit 2024-09-16T09:46:59.264365+0000 mon.a (mon.0) 1218 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:46:59.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:46:59 smithi086 bash[24289]: audit 2024-09-16T09:46:59.270096+0000 mon.b (mon.2) 1001 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:46:59.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:46:59 smithi047 bash[22744]: cluster 2024-09-16T09:46:58.384226+0000 mgr.a (mgr.14373) 10805 : cluster [DBG] pgmap v7494: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:46:59.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:46:59 smithi047 bash[22744]: audit 2024-09-16T09:46:59.251117+0000 mon.b (mon.2) 999 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:46:59.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:46:59 smithi047 bash[22744]: audit 2024-09-16T09:46:59.253244+0000 mon.b (mon.2) 1000 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T09:46:59.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:46:59 smithi047 bash[22744]: audit 2024-09-16T09:46:59.264365+0000 mon.a (mon.0) 1218 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:46:59.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:46:59 smithi047 bash[22744]: audit 2024-09-16T09:46:59.270096+0000 mon.b (mon.2) 1001 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:47:00.342 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 09:47:00 smithi047 bash[22994]: debug 2024-09-16T09:47:00.011+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T09:47:00.342 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 09:47:00 smithi047 bash[22994]: debug 2024-09-16T09:47:00.015+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T09:47:00.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:47:00 smithi157 bash[24585]: audit 2024-09-16T09:46:59.272612+0000 mgr.a (mgr.14373) 10806 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:47:00.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:47:00 smithi086 bash[24289]: audit 2024-09-16T09:46:59.272612+0000 mgr.a (mgr.14373) 10806 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:47:00.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:47:00 smithi047 bash[22744]: audit 2024-09-16T09:46:59.272612+0000 mgr.a (mgr.14373) 10806 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:47:01.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:47:01 smithi086 bash[24289]: audit 2024-09-16T09:47:00.017492+0000 mgr.a (mgr.14373) 10807 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T09:47:01.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:47:01 smithi086 bash[24289]: cephadm 2024-09-16T09:47:00.019756+0000 mgr.a (mgr.14373) 10808 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T09:47:01.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:47:01 smithi086 bash[24289]: cluster 2024-09-16T09:47:00.385198+0000 mgr.a (mgr.14373) 10809 : cluster [DBG] pgmap v7495: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:47:01.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:47:01 smithi047 bash[22744]: audit 2024-09-16T09:47:00.017492+0000 mgr.a (mgr.14373) 10807 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T09:47:01.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:47:01 smithi047 bash[22744]: cephadm 2024-09-16T09:47:00.019756+0000 mgr.a (mgr.14373) 10808 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T09:47:01.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:47:01 smithi047 bash[22744]: cluster 2024-09-16T09:47:00.385198+0000 mgr.a (mgr.14373) 10809 : cluster [DBG] pgmap v7495: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:47:02.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:47:01 smithi157 bash[24585]: audit 2024-09-16T09:47:00.017492+0000 mgr.a (mgr.14373) 10807 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T09:47:02.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:47:01 smithi157 bash[24585]: cephadm 2024-09-16T09:47:00.019756+0000 mgr.a (mgr.14373) 10808 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T09:47:02.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:47:01 smithi157 bash[24585]: cluster 2024-09-16T09:47:00.385198+0000 mgr.a (mgr.14373) 10809 : cluster [DBG] pgmap v7495: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:47:02.928 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:47:02.929 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:47:02.930 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:47:03.668 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:47:03.668 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:47:03.668 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:47:03.668 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:47:03.668 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:47:03.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:47:03 smithi086 bash[24289]: cluster 2024-09-16T09:47:02.387407+0000 mgr.a (mgr.14373) 10810 : cluster [DBG] pgmap v7496: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:47:03.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:47:03 smithi047 bash[22744]: cluster 2024-09-16T09:47:02.387407+0000 mgr.a (mgr.14373) 10810 : cluster [DBG] pgmap v7496: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:47:04.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:47:03 smithi157 bash[24585]: cluster 2024-09-16T09:47:02.387407+0000 mgr.a (mgr.14373) 10810 : cluster [DBG] pgmap v7496: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:47:04.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:47:04 smithi086 bash[24289]: audit 2024-09-16T09:47:03.251526+0000 mgr.a (mgr.14373) 10811 : audit [DBG] from='client.237744 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:47:04.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:47:04 smithi047 bash[22744]: audit 2024-09-16T09:47:03.251526+0000 mgr.a (mgr.14373) 10811 : audit [DBG] from='client.237744 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:47:05.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:47:04 smithi157 bash[24585]: audit 2024-09-16T09:47:03.251526+0000 mgr.a (mgr.14373) 10811 : audit [DBG] from='client.237744 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:47:05.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:47:05 smithi047 bash[22744]: cluster 2024-09-16T09:47:04.388459+0000 mgr.a (mgr.14373) 10812 : cluster [DBG] pgmap v7497: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:47:06.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:47:05 smithi157 bash[24585]: cluster 2024-09-16T09:47:04.388459+0000 mgr.a (mgr.14373) 10812 : cluster [DBG] pgmap v7497: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:47:06.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:47:05 smithi086 bash[24289]: cluster 2024-09-16T09:47:04.388459+0000 mgr.a (mgr.14373) 10812 : cluster [DBG] pgmap v7497: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:47:07.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:47:07 smithi047 bash[22744]: cluster 2024-09-16T09:47:06.389263+0000 mgr.a (mgr.14373) 10813 : cluster [DBG] pgmap v7498: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:47:08.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:47:07 smithi157 bash[24585]: cluster 2024-09-16T09:47:06.389263+0000 mgr.a (mgr.14373) 10813 : cluster [DBG] pgmap v7498: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:47:08.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:47:07 smithi086 bash[24289]: cluster 2024-09-16T09:47:06.389263+0000 mgr.a (mgr.14373) 10813 : cluster [DBG] pgmap v7498: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:47:08.669 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:47:08.670 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:47:08.670 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:47:09.418 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:47:09.419 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:47:09.419 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:47:09.419 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:47:09.419 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:47:09.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:47:09 smithi047 bash[22744]: cluster 2024-09-16T09:47:08.391476+0000 mgr.a (mgr.14373) 10814 : cluster [DBG] pgmap v7499: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:47:10.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:47:09 smithi157 bash[24585]: cluster 2024-09-16T09:47:08.391476+0000 mgr.a (mgr.14373) 10814 : cluster [DBG] pgmap v7499: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:47:10.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:47:09 smithi086 bash[24289]: cluster 2024-09-16T09:47:08.391476+0000 mgr.a (mgr.14373) 10814 : cluster [DBG] pgmap v7499: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:47:11.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:47:10 smithi157 bash[24585]: audit 2024-09-16T09:47:09.000006+0000 mgr.a (mgr.14373) 10815 : audit [DBG] from='client.237822 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:47:11.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:47:10 smithi086 bash[24289]: audit 2024-09-16T09:47:09.000006+0000 mgr.a (mgr.14373) 10815 : audit [DBG] from='client.237822 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:47:11.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:47:10 smithi047 bash[22744]: audit 2024-09-16T09:47:09.000006+0000 mgr.a (mgr.14373) 10815 : audit [DBG] from='client.237822 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:47:12.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:47:11 smithi157 bash[24585]: cluster 2024-09-16T09:47:10.392386+0000 mgr.a (mgr.14373) 10816 : cluster [DBG] pgmap v7500: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:47:12.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:47:11 smithi086 bash[24289]: cluster 2024-09-16T09:47:10.392386+0000 mgr.a (mgr.14373) 10816 : cluster [DBG] pgmap v7500: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:47:12.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:47:11 smithi047 bash[22744]: cluster 2024-09-16T09:47:10.392386+0000 mgr.a (mgr.14373) 10816 : cluster [DBG] pgmap v7500: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:47:14.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:47:13 smithi157 bash[24585]: cluster 2024-09-16T09:47:12.394634+0000 mgr.a (mgr.14373) 10817 : cluster [DBG] pgmap v7501: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:47:14.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:47:13 smithi086 bash[24289]: cluster 2024-09-16T09:47:12.394634+0000 mgr.a (mgr.14373) 10817 : cluster [DBG] pgmap v7501: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:47:14.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:47:13 smithi047 bash[22744]: cluster 2024-09-16T09:47:12.394634+0000 mgr.a (mgr.14373) 10817 : cluster [DBG] pgmap v7501: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:47:14.420 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:47:14.421 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:47:14.421 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:47:15.191 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:47:15.191 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:47:15.191 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:47:15.191 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:47:15.191 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:47:16.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:47:15 smithi157 bash[24585]: cluster 2024-09-16T09:47:14.395391+0000 mgr.a (mgr.14373) 10818 : cluster [DBG] pgmap v7502: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:47:16.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:47:15 smithi086 bash[24289]: cluster 2024-09-16T09:47:14.395391+0000 mgr.a (mgr.14373) 10818 : cluster [DBG] pgmap v7502: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:47:16.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:47:15 smithi047 bash[22744]: cluster 2024-09-16T09:47:14.395391+0000 mgr.a (mgr.14373) 10818 : cluster [DBG] pgmap v7502: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:47:17.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:47:16 smithi157 bash[24585]: audit 2024-09-16T09:47:14.758475+0000 mgr.a (mgr.14373) 10819 : audit [DBG] from='client.237891 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:47:17.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:47:16 smithi086 bash[24289]: audit 2024-09-16T09:47:14.758475+0000 mgr.a (mgr.14373) 10819 : audit [DBG] from='client.237891 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:47:17.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:47:16 smithi047 bash[22744]: audit 2024-09-16T09:47:14.758475+0000 mgr.a (mgr.14373) 10819 : audit [DBG] from='client.237891 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:47:18.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:47:17 smithi157 bash[24585]: cluster 2024-09-16T09:47:16.396282+0000 mgr.a (mgr.14373) 10820 : cluster [DBG] pgmap v7503: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:47:18.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:47:17 smithi086 bash[24289]: cluster 2024-09-16T09:47:16.396282+0000 mgr.a (mgr.14373) 10820 : cluster [DBG] pgmap v7503: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:47:18.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:47:17 smithi047 bash[22744]: cluster 2024-09-16T09:47:16.396282+0000 mgr.a (mgr.14373) 10820 : cluster [DBG] pgmap v7503: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:47:20.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:47:19 smithi157 bash[24585]: cluster 2024-09-16T09:47:18.398548+0000 mgr.a (mgr.14373) 10821 : cluster [DBG] pgmap v7504: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:47:20.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:47:19 smithi086 bash[24289]: cluster 2024-09-16T09:47:18.398548+0000 mgr.a (mgr.14373) 10821 : cluster [DBG] pgmap v7504: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:47:20.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:47:19 smithi047 bash[22744]: cluster 2024-09-16T09:47:18.398548+0000 mgr.a (mgr.14373) 10821 : cluster [DBG] pgmap v7504: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:47:20.192 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:47:20.193 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:47:20.193 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:47:20.958 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:47:20.958 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:47:20.958 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:47:20.958 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:47:20.958 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:47:22.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:47:21 smithi157 bash[24585]: cluster 2024-09-16T09:47:20.399286+0000 mgr.a (mgr.14373) 10822 : cluster [DBG] pgmap v7505: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:47:22.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:47:21 smithi157 bash[24585]: audit 2024-09-16T09:47:20.532238+0000 mgr.a (mgr.14373) 10823 : audit [DBG] from='client.237963 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:47:22.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:47:21 smithi086 bash[24289]: cluster 2024-09-16T09:47:20.399286+0000 mgr.a (mgr.14373) 10822 : cluster [DBG] pgmap v7505: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:47:22.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:47:21 smithi086 bash[24289]: audit 2024-09-16T09:47:20.532238+0000 mgr.a (mgr.14373) 10823 : audit [DBG] from='client.237963 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:47:22.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:47:21 smithi047 bash[22744]: cluster 2024-09-16T09:47:20.399286+0000 mgr.a (mgr.14373) 10822 : cluster [DBG] pgmap v7505: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:47:22.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:47:21 smithi047 bash[22744]: audit 2024-09-16T09:47:20.532238+0000 mgr.a (mgr.14373) 10823 : audit [DBG] from='client.237963 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:47:24.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:47:23 smithi157 bash[24585]: cluster 2024-09-16T09:47:22.401587+0000 mgr.a (mgr.14373) 10824 : cluster [DBG] pgmap v7506: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:47:24.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:47:23 smithi086 bash[24289]: cluster 2024-09-16T09:47:22.401587+0000 mgr.a (mgr.14373) 10824 : cluster [DBG] pgmap v7506: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:47:24.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:47:23 smithi047 bash[22744]: cluster 2024-09-16T09:47:22.401587+0000 mgr.a (mgr.14373) 10824 : cluster [DBG] pgmap v7506: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:47:25.959 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:47:25.960 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:47:25.960 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:47:26.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:47:25 smithi157 bash[24585]: cluster 2024-09-16T09:47:24.402323+0000 mgr.a (mgr.14373) 10825 : cluster [DBG] pgmap v7507: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:47:26.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:47:25 smithi086 bash[24289]: cluster 2024-09-16T09:47:24.402323+0000 mgr.a (mgr.14373) 10825 : cluster [DBG] pgmap v7507: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:47:26.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:47:25 smithi047 bash[22744]: cluster 2024-09-16T09:47:24.402323+0000 mgr.a (mgr.14373) 10825 : cluster [DBG] pgmap v7507: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:47:26.737 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:47:26.737 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:47:26.737 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:47:26.738 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:47:26.738 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:47:28.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:47:27 smithi157 bash[24585]: audit 2024-09-16T09:47:26.294568+0000 mgr.a (mgr.14373) 10826 : audit [DBG] from='client.238035 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:47:28.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:47:27 smithi157 bash[24585]: cluster 2024-09-16T09:47:26.403038+0000 mgr.a (mgr.14373) 10827 : cluster [DBG] pgmap v7508: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:47:28.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:47:27 smithi086 bash[24289]: audit 2024-09-16T09:47:26.294568+0000 mgr.a (mgr.14373) 10826 : audit [DBG] from='client.238035 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:47:28.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:47:27 smithi086 bash[24289]: cluster 2024-09-16T09:47:26.403038+0000 mgr.a (mgr.14373) 10827 : cluster [DBG] pgmap v7508: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:47:28.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:47:27 smithi047 bash[22744]: audit 2024-09-16T09:47:26.294568+0000 mgr.a (mgr.14373) 10826 : audit [DBG] from='client.238035 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:47:28.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:47:27 smithi047 bash[22744]: cluster 2024-09-16T09:47:26.403038+0000 mgr.a (mgr.14373) 10827 : cluster [DBG] pgmap v7508: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:47:30.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:47:29 smithi157 bash[24585]: cluster 2024-09-16T09:47:28.405416+0000 mgr.a (mgr.14373) 10828 : cluster [DBG] pgmap v7509: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-16T09:47:30.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:47:29 smithi086 bash[24289]: cluster 2024-09-16T09:47:28.405416+0000 mgr.a (mgr.14373) 10828 : cluster [DBG] pgmap v7509: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-16T09:47:30.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:47:29 smithi047 bash[22744]: cluster 2024-09-16T09:47:28.405416+0000 mgr.a (mgr.14373) 10828 : cluster [DBG] pgmap v7509: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-16T09:47:31.739 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:47:31.739 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:47:31.739 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:47:32.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:47:31 smithi157 bash[24585]: cluster 2024-09-16T09:47:30.406197+0000 mgr.a (mgr.14373) 10829 : cluster [DBG] pgmap v7510: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-16T09:47:32.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:47:31 smithi086 bash[24289]: cluster 2024-09-16T09:47:30.406197+0000 mgr.a (mgr.14373) 10829 : cluster [DBG] pgmap v7510: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-16T09:47:32.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:47:31 smithi047 bash[22744]: cluster 2024-09-16T09:47:30.406197+0000 mgr.a (mgr.14373) 10829 : cluster [DBG] pgmap v7510: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-16T09:47:32.503 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:47:32.504 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:47:32.504 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:47:32.504 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:47:32.504 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:47:34.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:47:33 smithi157 bash[24585]: audit 2024-09-16T09:47:32.072488+0000 mgr.a (mgr.14373) 10830 : audit [DBG] from='client.238113 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:47:34.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:47:33 smithi157 bash[24585]: cluster 2024-09-16T09:47:32.408445+0000 mgr.a (mgr.14373) 10831 : cluster [DBG] pgmap v7511: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:47:34.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:47:33 smithi086 bash[24289]: audit 2024-09-16T09:47:32.072488+0000 mgr.a (mgr.14373) 10830 : audit [DBG] from='client.238113 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:47:34.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:47:33 smithi086 bash[24289]: cluster 2024-09-16T09:47:32.408445+0000 mgr.a (mgr.14373) 10831 : cluster [DBG] pgmap v7511: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:47:34.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:47:33 smithi047 bash[22744]: audit 2024-09-16T09:47:32.072488+0000 mgr.a (mgr.14373) 10830 : audit [DBG] from='client.238113 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:47:34.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:47:33 smithi047 bash[22744]: cluster 2024-09-16T09:47:32.408445+0000 mgr.a (mgr.14373) 10831 : cluster [DBG] pgmap v7511: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:47:36.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:47:35 smithi157 bash[24585]: cluster 2024-09-16T09:47:34.409223+0000 mgr.a (mgr.14373) 10832 : cluster [DBG] pgmap v7512: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:47:36.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:47:35 smithi086 bash[24289]: cluster 2024-09-16T09:47:34.409223+0000 mgr.a (mgr.14373) 10832 : cluster [DBG] pgmap v7512: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:47:36.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:47:35 smithi047 bash[22744]: cluster 2024-09-16T09:47:34.409223+0000 mgr.a (mgr.14373) 10832 : cluster [DBG] pgmap v7512: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:47:37.505 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:47:37.506 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:47:37.506 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:47:38.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:47:37 smithi157 bash[24585]: cluster 2024-09-16T09:47:36.409914+0000 mgr.a (mgr.14373) 10833 : cluster [DBG] pgmap v7513: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T09:47:38.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:47:37 smithi086 bash[24289]: cluster 2024-09-16T09:47:36.409914+0000 mgr.a (mgr.14373) 10833 : cluster [DBG] pgmap v7513: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T09:47:38.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:47:37 smithi047 bash[22744]: cluster 2024-09-16T09:47:36.409914+0000 mgr.a (mgr.14373) 10833 : cluster [DBG] pgmap v7513: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T09:47:38.287 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:47:38.287 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:47:38.287 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:47:38.287 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:47:38.287 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:47:40.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:47:39 smithi157 bash[24585]: audit 2024-09-16T09:47:37.836664+0000 mgr.a (mgr.14373) 10834 : audit [DBG] from='client.238191 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:47:40.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:47:39 smithi157 bash[24585]: cluster 2024-09-16T09:47:38.412835+0000 mgr.a (mgr.14373) 10835 : cluster [DBG] pgmap v7514: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:47:40.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:47:39 smithi086 bash[24289]: audit 2024-09-16T09:47:37.836664+0000 mgr.a (mgr.14373) 10834 : audit [DBG] from='client.238191 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:47:40.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:47:39 smithi086 bash[24289]: cluster 2024-09-16T09:47:38.412835+0000 mgr.a (mgr.14373) 10835 : cluster [DBG] pgmap v7514: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:47:40.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:47:39 smithi047 bash[22744]: audit 2024-09-16T09:47:37.836664+0000 mgr.a (mgr.14373) 10834 : audit [DBG] from='client.238191 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:47:40.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:47:39 smithi047 bash[22744]: cluster 2024-09-16T09:47:38.412835+0000 mgr.a (mgr.14373) 10835 : cluster [DBG] pgmap v7514: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:47:42.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:47:41 smithi157 bash[24585]: cluster 2024-09-16T09:47:40.413627+0000 mgr.a (mgr.14373) 10836 : cluster [DBG] pgmap v7515: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-16T09:47:42.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:47:41 smithi086 bash[24289]: cluster 2024-09-16T09:47:40.413627+0000 mgr.a (mgr.14373) 10836 : cluster [DBG] pgmap v7515: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-16T09:47:42.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:47:41 smithi047 bash[22744]: cluster 2024-09-16T09:47:40.413627+0000 mgr.a (mgr.14373) 10836 : cluster [DBG] pgmap v7515: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-16T09:47:43.289 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:47:43.289 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:47:43.289 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:47:44.030 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:47:44.030 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:47:44.030 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:47:44.030 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:47:44.030 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:47:44.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:47:43 smithi157 bash[24585]: cluster 2024-09-16T09:47:42.415691+0000 mgr.a (mgr.14373) 10837 : cluster [DBG] pgmap v7516: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:47:44.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:47:43 smithi086 bash[24289]: cluster 2024-09-16T09:47:42.415691+0000 mgr.a (mgr.14373) 10837 : cluster [DBG] pgmap v7516: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:47:44.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:47:43 smithi047 bash[22744]: cluster 2024-09-16T09:47:42.415691+0000 mgr.a (mgr.14373) 10837 : cluster [DBG] pgmap v7516: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:47:45.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:47:44 smithi157 bash[24585]: audit 2024-09-16T09:47:43.617500+0000 mgr.a (mgr.14373) 10838 : audit [DBG] from='client.238269 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:47:45.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:47:44 smithi086 bash[24289]: audit 2024-09-16T09:47:43.617500+0000 mgr.a (mgr.14373) 10838 : audit [DBG] from='client.238269 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:47:45.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:47:44 smithi047 bash[22744]: audit 2024-09-16T09:47:43.617500+0000 mgr.a (mgr.14373) 10838 : audit [DBG] from='client.238269 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:47:46.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:47:45 smithi157 bash[24585]: cluster 2024-09-16T09:47:44.416608+0000 mgr.a (mgr.14373) 10839 : cluster [DBG] pgmap v7517: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:47:46.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:47:45 smithi086 bash[24289]: cluster 2024-09-16T09:47:44.416608+0000 mgr.a (mgr.14373) 10839 : cluster [DBG] pgmap v7517: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:47:46.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:47:45 smithi047 bash[22744]: cluster 2024-09-16T09:47:44.416608+0000 mgr.a (mgr.14373) 10839 : cluster [DBG] pgmap v7517: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:47:48.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:47:47 smithi157 bash[24585]: cluster 2024-09-16T09:47:46.417364+0000 mgr.a (mgr.14373) 10840 : cluster [DBG] pgmap v7518: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:47:48.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:47:47 smithi086 bash[24289]: cluster 2024-09-16T09:47:46.417364+0000 mgr.a (mgr.14373) 10840 : cluster [DBG] pgmap v7518: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:47:48.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:47:47 smithi047 bash[22744]: cluster 2024-09-16T09:47:46.417364+0000 mgr.a (mgr.14373) 10840 : cluster [DBG] pgmap v7518: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:47:49.032 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:47:49.034 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:47:49.034 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:47:49.774 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:47:49.775 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:47:49.775 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:47:49.775 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:47:49.775 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:47:50.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:47:49 smithi157 bash[24585]: cluster 2024-09-16T09:47:48.419601+0000 mgr.a (mgr.14373) 10841 : cluster [DBG] pgmap v7519: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:47:50.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:47:49 smithi086 bash[24289]: cluster 2024-09-16T09:47:48.419601+0000 mgr.a (mgr.14373) 10841 : cluster [DBG] pgmap v7519: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:47:50.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:47:49 smithi047 bash[22744]: cluster 2024-09-16T09:47:48.419601+0000 mgr.a (mgr.14373) 10841 : cluster [DBG] pgmap v7519: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:47:51.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:47:50 smithi157 bash[24585]: audit 2024-09-16T09:47:49.361367+0000 mgr.a (mgr.14373) 10842 : audit [DBG] from='client.238344 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:47:51.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:47:50 smithi086 bash[24289]: audit 2024-09-16T09:47:49.361367+0000 mgr.a (mgr.14373) 10842 : audit [DBG] from='client.238344 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:47:51.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:47:50 smithi047 bash[22744]: audit 2024-09-16T09:47:49.361367+0000 mgr.a (mgr.14373) 10842 : audit [DBG] from='client.238344 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:47:52.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:47:51 smithi157 bash[24585]: cluster 2024-09-16T09:47:50.420487+0000 mgr.a (mgr.14373) 10843 : cluster [DBG] pgmap v7520: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:47:52.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:47:51 smithi086 bash[24289]: cluster 2024-09-16T09:47:50.420487+0000 mgr.a (mgr.14373) 10843 : cluster [DBG] pgmap v7520: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:47:52.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:47:51 smithi047 bash[22744]: cluster 2024-09-16T09:47:50.420487+0000 mgr.a (mgr.14373) 10843 : cluster [DBG] pgmap v7520: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:47:54.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:47:53 smithi157 bash[24585]: cluster 2024-09-16T09:47:52.422759+0000 mgr.a (mgr.14373) 10844 : cluster [DBG] pgmap v7521: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:47:54.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:47:53 smithi086 bash[24289]: cluster 2024-09-16T09:47:52.422759+0000 mgr.a (mgr.14373) 10844 : cluster [DBG] pgmap v7521: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:47:54.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:47:53 smithi047 bash[22744]: cluster 2024-09-16T09:47:52.422759+0000 mgr.a (mgr.14373) 10844 : cluster [DBG] pgmap v7521: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:47:54.776 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:47:54.777 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:47:54.777 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:47:55.546 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:47:55.546 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:47:55.546 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:47:55.546 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:47:55.547 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:47:56.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:47:55 smithi157 bash[24585]: cluster 2024-09-16T09:47:54.423502+0000 mgr.a (mgr.14373) 10845 : cluster [DBG] pgmap v7522: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:47:56.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:47:55 smithi086 bash[24289]: cluster 2024-09-16T09:47:54.423502+0000 mgr.a (mgr.14373) 10845 : cluster [DBG] pgmap v7522: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:47:56.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:47:55 smithi047 bash[22744]: cluster 2024-09-16T09:47:54.423502+0000 mgr.a (mgr.14373) 10845 : cluster [DBG] pgmap v7522: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:47:57.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:47:56 smithi157 bash[24585]: audit 2024-09-16T09:47:55.113021+0000 mgr.a (mgr.14373) 10846 : audit [DBG] from='client.238419 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:47:57.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:47:56 smithi086 bash[24289]: audit 2024-09-16T09:47:55.113021+0000 mgr.a (mgr.14373) 10846 : audit [DBG] from='client.238419 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:47:57.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:47:56 smithi047 bash[22744]: audit 2024-09-16T09:47:55.113021+0000 mgr.a (mgr.14373) 10846 : audit [DBG] from='client.238419 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:47:58.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:47:57 smithi157 bash[24585]: cluster 2024-09-16T09:47:56.424360+0000 mgr.a (mgr.14373) 10847 : cluster [DBG] pgmap v7523: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:47:58.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:47:57 smithi086 bash[24289]: cluster 2024-09-16T09:47:56.424360+0000 mgr.a (mgr.14373) 10847 : cluster [DBG] pgmap v7523: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:47:58.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:47:57 smithi047 bash[22744]: cluster 2024-09-16T09:47:56.424360+0000 mgr.a (mgr.14373) 10847 : cluster [DBG] pgmap v7523: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:48:00.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:47:59 smithi157 bash[24585]: cluster 2024-09-16T09:47:58.426620+0000 mgr.a (mgr.14373) 10848 : cluster [DBG] pgmap v7524: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:48:00.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:47:59 smithi086 bash[24289]: cluster 2024-09-16T09:47:58.426620+0000 mgr.a (mgr.14373) 10848 : cluster [DBG] pgmap v7524: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:48:00.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:47:59 smithi047 bash[22744]: cluster 2024-09-16T09:47:58.426620+0000 mgr.a (mgr.14373) 10848 : cluster [DBG] pgmap v7524: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:48:00.548 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:48:00.548 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:48:00.548 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:48:01.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:48:00 smithi157 bash[24585]: audit 2024-09-16T09:48:00.069596+0000 mon.b (mon.2) 1002 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T09:48:01.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:48:00 smithi086 bash[24289]: audit 2024-09-16T09:48:00.069596+0000 mon.b (mon.2) 1002 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T09:48:01.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:48:00 smithi047 bash[22744]: audit 2024-09-16T09:48:00.069596+0000 mon.b (mon.2) 1002 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T09:48:01.316 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:48:01.316 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:48:01.317 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:48:01.317 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:48:01.317 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:48:02.024 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:48:01 smithi047 bash[22744]: cluster 2024-09-16T09:48:00.427340+0000 mgr.a (mgr.14373) 10849 : cluster [DBG] pgmap v7525: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:48:02.024 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:48:01 smithi047 bash[22744]: audit 2024-09-16T09:48:00.927829+0000 mon.b (mon.2) 1003 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:48:02.024 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:48:01 smithi047 bash[22744]: audit 2024-09-16T09:48:00.930140+0000 mon.b (mon.2) 1004 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T09:48:02.024 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:48:01 smithi047 bash[22744]: audit 2024-09-16T09:48:00.940566+0000 mon.a (mon.0) 1219 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:48:02.024 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:48:01 smithi047 bash[22744]: audit 2024-09-16T09:48:00.947154+0000 mon.b (mon.2) 1005 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:48:02.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:48:01 smithi157 bash[24585]: cluster 2024-09-16T09:48:00.427340+0000 mgr.a (mgr.14373) 10849 : cluster [DBG] pgmap v7525: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:48:02.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:48:01 smithi157 bash[24585]: audit 2024-09-16T09:48:00.927829+0000 mon.b (mon.2) 1003 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:48:02.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:48:01 smithi157 bash[24585]: audit 2024-09-16T09:48:00.930140+0000 mon.b (mon.2) 1004 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T09:48:02.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:48:01 smithi157 bash[24585]: audit 2024-09-16T09:48:00.940566+0000 mon.a (mon.0) 1219 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:48:02.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:48:01 smithi157 bash[24585]: audit 2024-09-16T09:48:00.947154+0000 mon.b (mon.2) 1005 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:48:02.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:48:01 smithi086 bash[24289]: cluster 2024-09-16T09:48:00.427340+0000 mgr.a (mgr.14373) 10849 : cluster [DBG] pgmap v7525: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:48:02.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:48:01 smithi086 bash[24289]: audit 2024-09-16T09:48:00.927829+0000 mon.b (mon.2) 1003 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:48:02.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:48:01 smithi086 bash[24289]: audit 2024-09-16T09:48:00.930140+0000 mon.b (mon.2) 1004 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T09:48:02.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:48:01 smithi086 bash[24289]: audit 2024-09-16T09:48:00.940566+0000 mon.a (mon.0) 1219 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:48:02.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:48:01 smithi086 bash[24289]: audit 2024-09-16T09:48:00.947154+0000 mon.b (mon.2) 1005 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:48:02.342 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 09:48:02 smithi047 bash[22994]: debug 2024-09-16T09:48:02.022+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T09:48:02.342 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 09:48:02 smithi047 bash[22994]: debug 2024-09-16T09:48:02.022+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T09:48:03.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:48:02 smithi157 bash[24585]: audit 2024-09-16T09:48:00.879166+0000 mgr.a (mgr.14373) 10850 : audit [DBG] from='client.238494 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:48:03.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:48:02 smithi157 bash[24585]: audit 2024-09-16T09:48:00.949083+0000 mgr.a (mgr.14373) 10851 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:48:03.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:48:02 smithi086 bash[24289]: audit 2024-09-16T09:48:00.879166+0000 mgr.a (mgr.14373) 10850 : audit [DBG] from='client.238494 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:48:03.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:48:02 smithi086 bash[24289]: audit 2024-09-16T09:48:00.949083+0000 mgr.a (mgr.14373) 10851 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:48:03.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:48:02 smithi047 bash[22744]: audit 2024-09-16T09:48:00.879166+0000 mgr.a (mgr.14373) 10850 : audit [DBG] from='client.238494 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:48:03.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:48:02 smithi047 bash[22744]: audit 2024-09-16T09:48:00.949083+0000 mgr.a (mgr.14373) 10851 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:48:04.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:48:03 smithi157 bash[24585]: audit 2024-09-16T09:48:02.022915+0000 mgr.a (mgr.14373) 10852 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T09:48:04.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:48:03 smithi157 bash[24585]: cephadm 2024-09-16T09:48:02.025514+0000 mgr.a (mgr.14373) 10853 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T09:48:04.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:48:03 smithi157 bash[24585]: cluster 2024-09-16T09:48:02.430041+0000 mgr.a (mgr.14373) 10854 : cluster [DBG] pgmap v7526: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 3.8 KiB/s rd, 85 B/s wr, 3 op/s 2024-09-16T09:48:04.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:48:03 smithi086 bash[24289]: audit 2024-09-16T09:48:02.022915+0000 mgr.a (mgr.14373) 10852 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T09:48:04.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:48:03 smithi086 bash[24289]: cephadm 2024-09-16T09:48:02.025514+0000 mgr.a (mgr.14373) 10853 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T09:48:04.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:48:03 smithi086 bash[24289]: cluster 2024-09-16T09:48:02.430041+0000 mgr.a (mgr.14373) 10854 : cluster [DBG] pgmap v7526: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 3.8 KiB/s rd, 85 B/s wr, 3 op/s 2024-09-16T09:48:04.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:48:03 smithi047 bash[22744]: audit 2024-09-16T09:48:02.022915+0000 mgr.a (mgr.14373) 10852 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T09:48:04.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:48:03 smithi047 bash[22744]: cephadm 2024-09-16T09:48:02.025514+0000 mgr.a (mgr.14373) 10853 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T09:48:04.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:48:03 smithi047 bash[22744]: cluster 2024-09-16T09:48:02.430041+0000 mgr.a (mgr.14373) 10854 : cluster [DBG] pgmap v7526: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 3.8 KiB/s rd, 85 B/s wr, 3 op/s 2024-09-16T09:48:06.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:48:05 smithi157 bash[24585]: cluster 2024-09-16T09:48:04.430840+0000 mgr.a (mgr.14373) 10855 : cluster [DBG] pgmap v7527: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.9 KiB/s rd, 85 B/s wr, 2 op/s 2024-09-16T09:48:06.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:48:05 smithi086 bash[24289]: cluster 2024-09-16T09:48:04.430840+0000 mgr.a (mgr.14373) 10855 : cluster [DBG] pgmap v7527: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.9 KiB/s rd, 85 B/s wr, 2 op/s 2024-09-16T09:48:06.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:48:05 smithi047 bash[22744]: cluster 2024-09-16T09:48:04.430840+0000 mgr.a (mgr.14373) 10855 : cluster [DBG] pgmap v7527: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.9 KiB/s rd, 85 B/s wr, 2 op/s 2024-09-16T09:48:06.318 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:48:06.318 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:48:06.319 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:48:07.100 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:48:07.100 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:48:07.100 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:48:07.100 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:48:07.100 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:48:08.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:48:07 smithi157 bash[24585]: cluster 2024-09-16T09:48:06.431308+0000 mgr.a (mgr.14373) 10856 : cluster [DBG] pgmap v7528: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.9 KiB/s rd, 85 B/s wr, 2 op/s 2024-09-16T09:48:08.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:48:07 smithi157 bash[24585]: audit 2024-09-16T09:48:06.655710+0000 mgr.a (mgr.14373) 10857 : audit [DBG] from='client.238677 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:48:08.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:48:07 smithi086 bash[24289]: cluster 2024-09-16T09:48:06.431308+0000 mgr.a (mgr.14373) 10856 : cluster [DBG] pgmap v7528: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.9 KiB/s rd, 85 B/s wr, 2 op/s 2024-09-16T09:48:08.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:48:07 smithi086 bash[24289]: audit 2024-09-16T09:48:06.655710+0000 mgr.a (mgr.14373) 10857 : audit [DBG] from='client.238677 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:48:08.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:48:07 smithi047 bash[22744]: cluster 2024-09-16T09:48:06.431308+0000 mgr.a (mgr.14373) 10856 : cluster [DBG] pgmap v7528: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.9 KiB/s rd, 85 B/s wr, 2 op/s 2024-09-16T09:48:08.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:48:07 smithi047 bash[22744]: audit 2024-09-16T09:48:06.655710+0000 mgr.a (mgr.14373) 10857 : audit [DBG] from='client.238677 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:48:10.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:48:09 smithi157 bash[24585]: cluster 2024-09-16T09:48:08.433980+0000 mgr.a (mgr.14373) 10858 : cluster [DBG] pgmap v7529: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 11 KiB/s rd, 426 B/s wr, 13 op/s 2024-09-16T09:48:10.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:48:09 smithi086 bash[24289]: cluster 2024-09-16T09:48:08.433980+0000 mgr.a (mgr.14373) 10858 : cluster [DBG] pgmap v7529: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 11 KiB/s rd, 426 B/s wr, 13 op/s 2024-09-16T09:48:10.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:48:09 smithi047 bash[22744]: cluster 2024-09-16T09:48:08.433980+0000 mgr.a (mgr.14373) 10858 : cluster [DBG] pgmap v7529: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 11 KiB/s rd, 426 B/s wr, 13 op/s 2024-09-16T09:48:11.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:48:10 smithi157 bash[24585]: cluster 2024-09-16T09:48:10.434824+0000 mgr.a (mgr.14373) 10859 : cluster [DBG] pgmap v7530: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 10 KiB/s rd, 426 B/s wr, 12 op/s 2024-09-16T09:48:11.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:48:10 smithi086 bash[24289]: cluster 2024-09-16T09:48:10.434824+0000 mgr.a (mgr.14373) 10859 : cluster [DBG] pgmap v7530: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 10 KiB/s rd, 426 B/s wr, 12 op/s 2024-09-16T09:48:11.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:48:10 smithi047 bash[22744]: cluster 2024-09-16T09:48:10.434824+0000 mgr.a (mgr.14373) 10859 : cluster [DBG] pgmap v7530: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 10 KiB/s rd, 426 B/s wr, 12 op/s 2024-09-16T09:48:12.101 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:48:12.102 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:48:12.102 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:48:12.843 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:48:12.844 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:48:12.844 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:48:12.844 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:48:12.844 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:48:13.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:48:13 smithi157 bash[24585]: audit 2024-09-16T09:48:12.431552+0000 mgr.a (mgr.14373) 10860 : audit [DBG] from='client.238755 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:48:13.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:48:13 smithi157 bash[24585]: cluster 2024-09-16T09:48:12.446912+0000 mgr.a (mgr.14373) 10861 : cluster [DBG] pgmap v7531: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 11 KiB/s rd, 426 B/s wr, 13 op/s 2024-09-16T09:48:13.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:48:13 smithi086 bash[24289]: audit 2024-09-16T09:48:12.431552+0000 mgr.a (mgr.14373) 10860 : audit [DBG] from='client.238755 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:48:13.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:48:13 smithi086 bash[24289]: cluster 2024-09-16T09:48:12.446912+0000 mgr.a (mgr.14373) 10861 : cluster [DBG] pgmap v7531: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 11 KiB/s rd, 426 B/s wr, 13 op/s 2024-09-16T09:48:13.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:48:13 smithi047 bash[22744]: audit 2024-09-16T09:48:12.431552+0000 mgr.a (mgr.14373) 10860 : audit [DBG] from='client.238755 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:48:13.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:48:13 smithi047 bash[22744]: cluster 2024-09-16T09:48:12.446912+0000 mgr.a (mgr.14373) 10861 : cluster [DBG] pgmap v7531: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 11 KiB/s rd, 426 B/s wr, 13 op/s 2024-09-16T09:48:15.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:48:15 smithi157 bash[24585]: cluster 2024-09-16T09:48:14.447921+0000 mgr.a (mgr.14373) 10862 : cluster [DBG] pgmap v7532: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 9.0 KiB/s rd, 340 B/s wr, 11 op/s 2024-09-16T09:48:15.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:48:15 smithi086 bash[24289]: cluster 2024-09-16T09:48:14.447921+0000 mgr.a (mgr.14373) 10862 : cluster [DBG] pgmap v7532: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 9.0 KiB/s rd, 340 B/s wr, 11 op/s 2024-09-16T09:48:15.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:48:15 smithi047 bash[22744]: cluster 2024-09-16T09:48:14.447921+0000 mgr.a (mgr.14373) 10862 : cluster [DBG] pgmap v7532: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 9.0 KiB/s rd, 340 B/s wr, 11 op/s 2024-09-16T09:48:17.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:48:17 smithi157 bash[24585]: cluster 2024-09-16T09:48:16.448697+0000 mgr.a (mgr.14373) 10863 : cluster [DBG] pgmap v7533: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 9.0 KiB/s rd, 340 B/s wr, 11 op/s 2024-09-16T09:48:17.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:48:17 smithi086 bash[24289]: cluster 2024-09-16T09:48:16.448697+0000 mgr.a (mgr.14373) 10863 : cluster [DBG] pgmap v7533: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 9.0 KiB/s rd, 340 B/s wr, 11 op/s 2024-09-16T09:48:17.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:48:17 smithi047 bash[22744]: cluster 2024-09-16T09:48:16.448697+0000 mgr.a (mgr.14373) 10863 : cluster [DBG] pgmap v7533: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 9.0 KiB/s rd, 340 B/s wr, 11 op/s 2024-09-16T09:48:17.845 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:48:17.846 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:48:17.846 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:48:18.625 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:48:18.625 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:48:18.625 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:48:18.625 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:48:18.625 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:48:19.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:48:19 smithi157 bash[24585]: audit 2024-09-16T09:48:18.178981+0000 mgr.a (mgr.14373) 10864 : audit [DBG] from='client.238833 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:48:19.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:48:19 smithi157 bash[24585]: cluster 2024-09-16T09:48:18.450057+0000 mgr.a (mgr.14373) 10865 : cluster [DBG] pgmap v7534: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 9.9 KiB/s rd, 340 B/s wr, 12 op/s 2024-09-16T09:48:19.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:48:19 smithi086 bash[24289]: audit 2024-09-16T09:48:18.178981+0000 mgr.a (mgr.14373) 10864 : audit [DBG] from='client.238833 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:48:19.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:48:19 smithi086 bash[24289]: cluster 2024-09-16T09:48:18.450057+0000 mgr.a (mgr.14373) 10865 : cluster [DBG] pgmap v7534: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 9.9 KiB/s rd, 340 B/s wr, 12 op/s 2024-09-16T09:48:19.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:48:19 smithi047 bash[22744]: audit 2024-09-16T09:48:18.178981+0000 mgr.a (mgr.14373) 10864 : audit [DBG] from='client.238833 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:48:19.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:48:19 smithi047 bash[22744]: cluster 2024-09-16T09:48:18.450057+0000 mgr.a (mgr.14373) 10865 : cluster [DBG] pgmap v7534: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 9.9 KiB/s rd, 340 B/s wr, 12 op/s 2024-09-16T09:48:21.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:48:21 smithi157 bash[24585]: cluster 2024-09-16T09:48:20.450962+0000 mgr.a (mgr.14373) 10866 : cluster [DBG] pgmap v7535: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:48:21.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:48:21 smithi086 bash[24289]: cluster 2024-09-16T09:48:20.450962+0000 mgr.a (mgr.14373) 10866 : cluster [DBG] pgmap v7535: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:48:21.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:48:21 smithi047 bash[22744]: cluster 2024-09-16T09:48:20.450962+0000 mgr.a (mgr.14373) 10866 : cluster [DBG] pgmap v7535: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:48:23.626 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:48:23.627 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:48:23.627 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:48:23.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:48:23 smithi157 bash[24585]: cluster 2024-09-16T09:48:22.453285+0000 mgr.a (mgr.14373) 10867 : cluster [DBG] pgmap v7536: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:48:23.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:48:23 smithi086 bash[24289]: cluster 2024-09-16T09:48:22.453285+0000 mgr.a (mgr.14373) 10867 : cluster [DBG] pgmap v7536: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:48:23.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:48:23 smithi047 bash[22744]: cluster 2024-09-16T09:48:22.453285+0000 mgr.a (mgr.14373) 10867 : cluster [DBG] pgmap v7536: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:48:24.416 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:48:24.417 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:48:24.417 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:48:24.417 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:48:24.417 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:48:25.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:48:25 smithi157 bash[24585]: audit 2024-09-16T09:48:23.961762+0000 mgr.a (mgr.14373) 10868 : audit [DBG] from='client.238908 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:48:25.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:48:25 smithi157 bash[24585]: cluster 2024-09-16T09:48:24.453951+0000 mgr.a (mgr.14373) 10869 : cluster [DBG] pgmap v7537: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:48:25.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:48:25 smithi086 bash[24289]: audit 2024-09-16T09:48:23.961762+0000 mgr.a (mgr.14373) 10868 : audit [DBG] from='client.238908 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:48:25.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:48:25 smithi086 bash[24289]: cluster 2024-09-16T09:48:24.453951+0000 mgr.a (mgr.14373) 10869 : cluster [DBG] pgmap v7537: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:48:25.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:48:25 smithi047 bash[22744]: audit 2024-09-16T09:48:23.961762+0000 mgr.a (mgr.14373) 10868 : audit [DBG] from='client.238908 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:48:25.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:48:25 smithi047 bash[22744]: cluster 2024-09-16T09:48:24.453951+0000 mgr.a (mgr.14373) 10869 : cluster [DBG] pgmap v7537: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:48:27.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:48:27 smithi157 bash[24585]: cluster 2024-09-16T09:48:26.454748+0000 mgr.a (mgr.14373) 10870 : cluster [DBG] pgmap v7538: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:48:27.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:48:27 smithi086 bash[24289]: cluster 2024-09-16T09:48:26.454748+0000 mgr.a (mgr.14373) 10870 : cluster [DBG] pgmap v7538: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:48:27.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:48:27 smithi047 bash[22744]: cluster 2024-09-16T09:48:26.454748+0000 mgr.a (mgr.14373) 10870 : cluster [DBG] pgmap v7538: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:48:29.418 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:48:29.418 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:48:29.419 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:48:29.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:48:29 smithi157 bash[24585]: cluster 2024-09-16T09:48:28.456990+0000 mgr.a (mgr.14373) 10871 : cluster [DBG] pgmap v7539: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 66 KiB/s rd, 0 B/s wr, 108 op/s 2024-09-16T09:48:29.834 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:48:29 smithi086 bash[24289]: cluster 2024-09-16T09:48:28.456990+0000 mgr.a (mgr.14373) 10871 : cluster [DBG] pgmap v7539: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 66 KiB/s rd, 0 B/s wr, 108 op/s 2024-09-16T09:48:29.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:48:29 smithi047 bash[22744]: cluster 2024-09-16T09:48:28.456990+0000 mgr.a (mgr.14373) 10871 : cluster [DBG] pgmap v7539: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 66 KiB/s rd, 0 B/s wr, 108 op/s 2024-09-16T09:48:30.193 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:48:30.193 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:48:30.193 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:48:30.193 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:48:30.193 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:48:31.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:48:31 smithi157 bash[24585]: audit 2024-09-16T09:48:29.761145+0000 mgr.a (mgr.14373) 10872 : audit [DBG] from='client.238983 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:48:31.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:48:31 smithi157 bash[24585]: cluster 2024-09-16T09:48:30.457966+0000 mgr.a (mgr.14373) 10873 : cluster [DBG] pgmap v7540: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 65 KiB/s rd, 0 B/s wr, 107 op/s 2024-09-16T09:48:31.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:48:31 smithi086 bash[24289]: audit 2024-09-16T09:48:29.761145+0000 mgr.a (mgr.14373) 10872 : audit [DBG] from='client.238983 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:48:31.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:48:31 smithi086 bash[24289]: cluster 2024-09-16T09:48:30.457966+0000 mgr.a (mgr.14373) 10873 : cluster [DBG] pgmap v7540: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 65 KiB/s rd, 0 B/s wr, 107 op/s 2024-09-16T09:48:31.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:48:31 smithi047 bash[22744]: audit 2024-09-16T09:48:29.761145+0000 mgr.a (mgr.14373) 10872 : audit [DBG] from='client.238983 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:48:31.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:48:31 smithi047 bash[22744]: cluster 2024-09-16T09:48:30.457966+0000 mgr.a (mgr.14373) 10873 : cluster [DBG] pgmap v7540: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 65 KiB/s rd, 0 B/s wr, 107 op/s 2024-09-16T09:48:33.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:48:33 smithi157 bash[24585]: cluster 2024-09-16T09:48:32.460246+0000 mgr.a (mgr.14373) 10874 : cluster [DBG] pgmap v7541: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 66 KiB/s rd, 0 B/s wr, 108 op/s 2024-09-16T09:48:33.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:48:33 smithi086 bash[24289]: cluster 2024-09-16T09:48:32.460246+0000 mgr.a (mgr.14373) 10874 : cluster [DBG] pgmap v7541: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 66 KiB/s rd, 0 B/s wr, 108 op/s 2024-09-16T09:48:33.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:48:33 smithi047 bash[22744]: cluster 2024-09-16T09:48:32.460246+0000 mgr.a (mgr.14373) 10874 : cluster [DBG] pgmap v7541: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 66 KiB/s rd, 0 B/s wr, 108 op/s 2024-09-16T09:48:35.194 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:48:35.195 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:48:35.195 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:48:35.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:48:35 smithi157 bash[24585]: cluster 2024-09-16T09:48:34.461026+0000 mgr.a (mgr.14373) 10875 : cluster [DBG] pgmap v7542: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 65 KiB/s rd, 0 B/s wr, 107 op/s 2024-09-16T09:48:35.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:48:35 smithi086 bash[24289]: cluster 2024-09-16T09:48:34.461026+0000 mgr.a (mgr.14373) 10875 : cluster [DBG] pgmap v7542: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 65 KiB/s rd, 0 B/s wr, 107 op/s 2024-09-16T09:48:35.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:48:35 smithi047 bash[22744]: cluster 2024-09-16T09:48:34.461026+0000 mgr.a (mgr.14373) 10875 : cluster [DBG] pgmap v7542: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 65 KiB/s rd, 0 B/s wr, 107 op/s 2024-09-16T09:48:35.979 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:48:35.979 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:48:35.980 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:48:35.980 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:48:35.980 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:48:36.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:48:36 smithi086 bash[24289]: audit 2024-09-16T09:48:35.530532+0000 mgr.a (mgr.14373) 10876 : audit [DBG] from='client.239055 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:48:36.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:48:36 smithi047 bash[22744]: audit 2024-09-16T09:48:35.530532+0000 mgr.a (mgr.14373) 10876 : audit [DBG] from='client.239055 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:48:37.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:48:36 smithi157 bash[24585]: audit 2024-09-16T09:48:35.530532+0000 mgr.a (mgr.14373) 10876 : audit [DBG] from='client.239055 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:48:37.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:48:37 smithi086 bash[24289]: cluster 2024-09-16T09:48:36.461983+0000 mgr.a (mgr.14373) 10877 : cluster [DBG] pgmap v7543: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 65 KiB/s rd, 0 B/s wr, 107 op/s 2024-09-16T09:48:37.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:48:37 smithi047 bash[22744]: cluster 2024-09-16T09:48:36.461983+0000 mgr.a (mgr.14373) 10877 : cluster [DBG] pgmap v7543: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 65 KiB/s rd, 0 B/s wr, 107 op/s 2024-09-16T09:48:38.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:48:37 smithi157 bash[24585]: cluster 2024-09-16T09:48:36.461983+0000 mgr.a (mgr.14373) 10877 : cluster [DBG] pgmap v7543: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 65 KiB/s rd, 0 B/s wr, 107 op/s 2024-09-16T09:48:39.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:48:39 smithi086 bash[24289]: cluster 2024-09-16T09:48:38.464261+0000 mgr.a (mgr.14373) 10878 : cluster [DBG] pgmap v7544: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 66 KiB/s rd, 0 B/s wr, 108 op/s 2024-09-16T09:48:39.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:48:39 smithi047 bash[22744]: cluster 2024-09-16T09:48:38.464261+0000 mgr.a (mgr.14373) 10878 : cluster [DBG] pgmap v7544: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 66 KiB/s rd, 0 B/s wr, 108 op/s 2024-09-16T09:48:40.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:48:39 smithi157 bash[24585]: cluster 2024-09-16T09:48:38.464261+0000 mgr.a (mgr.14373) 10878 : cluster [DBG] pgmap v7544: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 66 KiB/s rd, 0 B/s wr, 108 op/s 2024-09-16T09:48:40.981 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:48:40.982 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:48:40.982 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:48:41.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:48:40 smithi047 bash[22744]: cluster 2024-09-16T09:48:40.465029+0000 mgr.a (mgr.14373) 10879 : cluster [DBG] pgmap v7545: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:48:41.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:48:40 smithi157 bash[24585]: cluster 2024-09-16T09:48:40.465029+0000 mgr.a (mgr.14373) 10879 : cluster [DBG] pgmap v7545: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:48:41.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:48:40 smithi086 bash[24289]: cluster 2024-09-16T09:48:40.465029+0000 mgr.a (mgr.14373) 10879 : cluster [DBG] pgmap v7545: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:48:41.748 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:48:41.748 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:48:41.749 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:48:41.749 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:48:41.749 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:48:42.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:48:41 smithi047 bash[22744]: audit 2024-09-16T09:48:41.313248+0000 mgr.a (mgr.14373) 10880 : audit [DBG] from='client.239133 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:48:42.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:48:41 smithi157 bash[24585]: audit 2024-09-16T09:48:41.313248+0000 mgr.a (mgr.14373) 10880 : audit [DBG] from='client.239133 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:48:42.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:48:41 smithi086 bash[24289]: audit 2024-09-16T09:48:41.313248+0000 mgr.a (mgr.14373) 10880 : audit [DBG] from='client.239133 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:48:43.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:48:42 smithi157 bash[24585]: cluster 2024-09-16T09:48:42.467445+0000 mgr.a (mgr.14373) 10881 : cluster [DBG] pgmap v7546: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-16T09:48:43.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:48:42 smithi086 bash[24289]: cluster 2024-09-16T09:48:42.467445+0000 mgr.a (mgr.14373) 10881 : cluster [DBG] pgmap v7546: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-16T09:48:43.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:48:42 smithi047 bash[22744]: cluster 2024-09-16T09:48:42.467445+0000 mgr.a (mgr.14373) 10881 : cluster [DBG] pgmap v7546: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-16T09:48:45.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:48:45 smithi157 bash[24585]: cluster 2024-09-16T09:48:44.468228+0000 mgr.a (mgr.14373) 10882 : cluster [DBG] pgmap v7547: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-16T09:48:45.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:48:45 smithi086 bash[24289]: cluster 2024-09-16T09:48:44.468228+0000 mgr.a (mgr.14373) 10882 : cluster [DBG] pgmap v7547: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-16T09:48:45.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:48:45 smithi047 bash[22744]: cluster 2024-09-16T09:48:44.468228+0000 mgr.a (mgr.14373) 10882 : cluster [DBG] pgmap v7547: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-16T09:48:46.750 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:48:46.750 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:48:46.751 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:48:47.513 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:48:47.513 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:48:47.513 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:48:47.513 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:48:47.513 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:48:47.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:48:47 smithi157 bash[24585]: cluster 2024-09-16T09:48:46.468987+0000 mgr.a (mgr.14373) 10883 : cluster [DBG] pgmap v7548: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-16T09:48:47.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:48:47 smithi086 bash[24289]: cluster 2024-09-16T09:48:46.468987+0000 mgr.a (mgr.14373) 10883 : cluster [DBG] pgmap v7548: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-16T09:48:47.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:48:47 smithi047 bash[22744]: cluster 2024-09-16T09:48:46.468987+0000 mgr.a (mgr.14373) 10883 : cluster [DBG] pgmap v7548: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-16T09:48:48.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:48:48 smithi157 bash[24585]: audit 2024-09-16T09:48:47.081595+0000 mgr.a (mgr.14373) 10884 : audit [DBG] from='client.239208 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:48:48.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:48:48 smithi086 bash[24289]: audit 2024-09-16T09:48:47.081595+0000 mgr.a (mgr.14373) 10884 : audit [DBG] from='client.239208 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:48:48.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:48:48 smithi047 bash[22744]: audit 2024-09-16T09:48:47.081595+0000 mgr.a (mgr.14373) 10884 : audit [DBG] from='client.239208 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:48:49.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:48:49 smithi157 bash[24585]: cluster 2024-09-16T09:48:48.471772+0000 mgr.a (mgr.14373) 10885 : cluster [DBG] pgmap v7549: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:48:49.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:48:49 smithi086 bash[24289]: cluster 2024-09-16T09:48:48.471772+0000 mgr.a (mgr.14373) 10885 : cluster [DBG] pgmap v7549: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:48:49.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:48:49 smithi047 bash[22744]: cluster 2024-09-16T09:48:48.471772+0000 mgr.a (mgr.14373) 10885 : cluster [DBG] pgmap v7549: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:48:51.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:48:51 smithi157 bash[24585]: cluster 2024-09-16T09:48:50.472592+0000 mgr.a (mgr.14373) 10886 : cluster [DBG] pgmap v7550: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:48:51.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:48:51 smithi086 bash[24289]: cluster 2024-09-16T09:48:50.472592+0000 mgr.a (mgr.14373) 10886 : cluster [DBG] pgmap v7550: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:48:51.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:48:51 smithi047 bash[22744]: cluster 2024-09-16T09:48:50.472592+0000 mgr.a (mgr.14373) 10886 : cluster [DBG] pgmap v7550: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:48:52.513 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:48:52.514 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:48:52.514 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:48:53.245 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:48:53.246 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:48:53.246 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:48:53.246 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:48:53.246 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:48:53.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:48:53 smithi157 bash[24585]: cluster 2024-09-16T09:48:52.474601+0000 mgr.a (mgr.14373) 10887 : cluster [DBG] pgmap v7551: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:48:53.819 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:48:53 smithi086 bash[24289]: cluster 2024-09-16T09:48:52.474601+0000 mgr.a (mgr.14373) 10887 : cluster [DBG] pgmap v7551: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:48:53.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:48:53 smithi047 bash[22744]: cluster 2024-09-16T09:48:52.474601+0000 mgr.a (mgr.14373) 10887 : cluster [DBG] pgmap v7551: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:48:54.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:48:54 smithi086 bash[24289]: audit 2024-09-16T09:48:52.843114+0000 mgr.a (mgr.14373) 10888 : audit [DBG] from='client.239283 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:48:54.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:48:54 smithi047 bash[22744]: audit 2024-09-16T09:48:52.843114+0000 mgr.a (mgr.14373) 10888 : audit [DBG] from='client.239283 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:48:55.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:48:54 smithi157 bash[24585]: audit 2024-09-16T09:48:52.843114+0000 mgr.a (mgr.14373) 10888 : audit [DBG] from='client.239283 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:48:55.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:48:55 smithi086 bash[24289]: cluster 2024-09-16T09:48:54.475532+0000 mgr.a (mgr.14373) 10889 : cluster [DBG] pgmap v7552: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-16T09:48:55.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:48:55 smithi047 bash[22744]: cluster 2024-09-16T09:48:54.475532+0000 mgr.a (mgr.14373) 10889 : cluster [DBG] pgmap v7552: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-16T09:48:56.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:48:55 smithi157 bash[24585]: cluster 2024-09-16T09:48:54.475532+0000 mgr.a (mgr.14373) 10889 : cluster [DBG] pgmap v7552: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-16T09:48:57.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:48:57 smithi086 bash[24289]: cluster 2024-09-16T09:48:56.476324+0000 mgr.a (mgr.14373) 10890 : cluster [DBG] pgmap v7553: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-16T09:48:57.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:48:57 smithi047 bash[22744]: cluster 2024-09-16T09:48:56.476324+0000 mgr.a (mgr.14373) 10890 : cluster [DBG] pgmap v7553: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-16T09:48:58.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:48:57 smithi157 bash[24585]: cluster 2024-09-16T09:48:56.476324+0000 mgr.a (mgr.14373) 10890 : cluster [DBG] pgmap v7553: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-16T09:48:58.247 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:48:58.248 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:48:58.248 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:48:59.032 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:48:59.033 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:48:59.033 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:48:59.033 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:48:59.033 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:48:59.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:48:59 smithi047 bash[22744]: cluster 2024-09-16T09:48:58.478473+0000 mgr.a (mgr.14373) 10891 : cluster [DBG] pgmap v7554: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:48:59.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:48:59 smithi047 bash[22744]: audit 2024-09-16T09:48:58.583404+0000 mgr.a (mgr.14373) 10892 : audit [DBG] from='client.239361 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:49:00.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:48:59 smithi157 bash[24585]: cluster 2024-09-16T09:48:58.478473+0000 mgr.a (mgr.14373) 10891 : cluster [DBG] pgmap v7554: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:49:00.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:48:59 smithi157 bash[24585]: audit 2024-09-16T09:48:58.583404+0000 mgr.a (mgr.14373) 10892 : audit [DBG] from='client.239361 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:49:00.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:48:59 smithi086 bash[24289]: cluster 2024-09-16T09:48:58.478473+0000 mgr.a (mgr.14373) 10891 : cluster [DBG] pgmap v7554: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:49:00.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:48:59 smithi086 bash[24289]: audit 2024-09-16T09:48:58.583404+0000 mgr.a (mgr.14373) 10892 : audit [DBG] from='client.239361 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:49:01.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:49:01 smithi047 bash[22744]: cluster 2024-09-16T09:49:00.479481+0000 mgr.a (mgr.14373) 10893 : cluster [DBG] pgmap v7555: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:49:02.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:49:01 smithi157 bash[24585]: cluster 2024-09-16T09:49:00.479481+0000 mgr.a (mgr.14373) 10893 : cluster [DBG] pgmap v7555: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:49:02.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:49:01 smithi086 bash[24289]: cluster 2024-09-16T09:49:00.479481+0000 mgr.a (mgr.14373) 10893 : cluster [DBG] pgmap v7555: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:49:02.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:49:02 smithi047 bash[22744]: audit 2024-09-16T09:49:02.085815+0000 mon.b (mon.2) 1006 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T09:49:03.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:49:02 smithi157 bash[24585]: audit 2024-09-16T09:49:02.085815+0000 mon.b (mon.2) 1006 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T09:49:03.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:49:02 smithi086 bash[24289]: audit 2024-09-16T09:49:02.085815+0000 mon.b (mon.2) 1006 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T09:49:03.842 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 09:49:03 smithi047 bash[22994]: debug 2024-09-16T09:49:03.684+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T09:49:03.842 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 09:49:03 smithi047 bash[22994]: debug 2024-09-16T09:49:03.684+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T09:49:03.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:49:03 smithi047 bash[22744]: cluster 2024-09-16T09:49:02.481642+0000 mgr.a (mgr.14373) 10894 : cluster [DBG] pgmap v7556: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:49:03.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:49:03 smithi047 bash[22744]: audit 2024-09-16T09:49:02.930977+0000 mon.b (mon.2) 1007 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:49:03.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:49:03 smithi047 bash[22744]: audit 2024-09-16T09:49:02.933075+0000 mon.b (mon.2) 1008 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T09:49:03.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:49:03 smithi047 bash[22744]: audit 2024-09-16T09:49:02.944425+0000 mon.a (mon.0) 1220 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:49:03.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:49:03 smithi047 bash[22744]: audit 2024-09-16T09:49:02.950008+0000 mon.b (mon.2) 1009 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:49:04.033 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:49:04.034 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:49:04.034 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:49:04.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:49:03 smithi157 bash[24585]: cluster 2024-09-16T09:49:02.481642+0000 mgr.a (mgr.14373) 10894 : cluster [DBG] pgmap v7556: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:49:04.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:49:03 smithi157 bash[24585]: audit 2024-09-16T09:49:02.930977+0000 mon.b (mon.2) 1007 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:49:04.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:49:03 smithi157 bash[24585]: audit 2024-09-16T09:49:02.933075+0000 mon.b (mon.2) 1008 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T09:49:04.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:49:03 smithi157 bash[24585]: audit 2024-09-16T09:49:02.944425+0000 mon.a (mon.0) 1220 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:49:04.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:49:03 smithi157 bash[24585]: audit 2024-09-16T09:49:02.950008+0000 mon.b (mon.2) 1009 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:49:04.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:49:03 smithi086 bash[24289]: cluster 2024-09-16T09:49:02.481642+0000 mgr.a (mgr.14373) 10894 : cluster [DBG] pgmap v7556: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:49:04.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:49:03 smithi086 bash[24289]: audit 2024-09-16T09:49:02.930977+0000 mon.b (mon.2) 1007 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:49:04.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:49:03 smithi086 bash[24289]: audit 2024-09-16T09:49:02.933075+0000 mon.b (mon.2) 1008 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T09:49:04.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:49:03 smithi086 bash[24289]: audit 2024-09-16T09:49:02.944425+0000 mon.a (mon.0) 1220 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:49:04.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:49:03 smithi086 bash[24289]: audit 2024-09-16T09:49:02.950008+0000 mon.b (mon.2) 1009 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:49:04.758 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:49:04.759 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:49:04.759 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:49:04.759 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:49:04.759 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:49:05.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:49:04 smithi157 bash[24585]: audit 2024-09-16T09:49:02.952300+0000 mgr.a (mgr.14373) 10895 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:49:05.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:49:04 smithi157 bash[24585]: audit 2024-09-16T09:49:03.687672+0000 mgr.a (mgr.14373) 10896 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T09:49:05.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:49:04 smithi157 bash[24585]: cephadm 2024-09-16T09:49:03.689629+0000 mgr.a (mgr.14373) 10897 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T09:49:05.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:49:04 smithi086 bash[24289]: audit 2024-09-16T09:49:02.952300+0000 mgr.a (mgr.14373) 10895 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:49:05.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:49:04 smithi086 bash[24289]: audit 2024-09-16T09:49:03.687672+0000 mgr.a (mgr.14373) 10896 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T09:49:05.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:49:04 smithi086 bash[24289]: cephadm 2024-09-16T09:49:03.689629+0000 mgr.a (mgr.14373) 10897 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T09:49:05.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:49:04 smithi047 bash[22744]: audit 2024-09-16T09:49:02.952300+0000 mgr.a (mgr.14373) 10895 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:49:05.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:49:04 smithi047 bash[22744]: audit 2024-09-16T09:49:03.687672+0000 mgr.a (mgr.14373) 10896 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T09:49:05.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:49:04 smithi047 bash[22744]: cephadm 2024-09-16T09:49:03.689629+0000 mgr.a (mgr.14373) 10897 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T09:49:06.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:49:05 smithi157 bash[24585]: audit 2024-09-16T09:49:04.354162+0000 mgr.a (mgr.14373) 10898 : audit [DBG] from='client.239544 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:49:06.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:49:05 smithi157 bash[24585]: cluster 2024-09-16T09:49:04.482378+0000 mgr.a (mgr.14373) 10899 : cluster [DBG] pgmap v7557: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:49:06.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:49:05 smithi086 bash[24289]: audit 2024-09-16T09:49:04.354162+0000 mgr.a (mgr.14373) 10898 : audit [DBG] from='client.239544 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:49:06.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:49:05 smithi086 bash[24289]: cluster 2024-09-16T09:49:04.482378+0000 mgr.a (mgr.14373) 10899 : cluster [DBG] pgmap v7557: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:49:06.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:49:05 smithi047 bash[22744]: audit 2024-09-16T09:49:04.354162+0000 mgr.a (mgr.14373) 10898 : audit [DBG] from='client.239544 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:49:06.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:49:05 smithi047 bash[22744]: cluster 2024-09-16T09:49:04.482378+0000 mgr.a (mgr.14373) 10899 : cluster [DBG] pgmap v7557: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:49:08.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:49:07 smithi157 bash[24585]: cluster 2024-09-16T09:49:06.483261+0000 mgr.a (mgr.14373) 10900 : cluster [DBG] pgmap v7558: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:49:08.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:49:07 smithi086 bash[24289]: cluster 2024-09-16T09:49:06.483261+0000 mgr.a (mgr.14373) 10900 : cluster [DBG] pgmap v7558: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:49:08.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:49:07 smithi047 bash[22744]: cluster 2024-09-16T09:49:06.483261+0000 mgr.a (mgr.14373) 10900 : cluster [DBG] pgmap v7558: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:49:09.760 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:49:09.761 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:49:09.761 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:49:10.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:49:09 smithi157 bash[24585]: cluster 2024-09-16T09:49:08.485491+0000 mgr.a (mgr.14373) 10901 : cluster [DBG] pgmap v7559: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:49:10.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:49:09 smithi086 bash[24289]: cluster 2024-09-16T09:49:08.485491+0000 mgr.a (mgr.14373) 10901 : cluster [DBG] pgmap v7559: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:49:10.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:49:09 smithi047 bash[22744]: cluster 2024-09-16T09:49:08.485491+0000 mgr.a (mgr.14373) 10901 : cluster [DBG] pgmap v7559: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:49:10.544 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:49:10.545 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:49:10.545 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:49:10.545 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:49:10.545 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:49:12.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:49:11 smithi157 bash[24585]: audit 2024-09-16T09:49:10.097697+0000 mgr.a (mgr.14373) 10902 : audit [DBG] from='client.239619 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:49:12.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:49:11 smithi157 bash[24585]: cluster 2024-09-16T09:49:10.486016+0000 mgr.a (mgr.14373) 10903 : cluster [DBG] pgmap v7560: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:49:12.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:49:11 smithi086 bash[24289]: audit 2024-09-16T09:49:10.097697+0000 mgr.a (mgr.14373) 10902 : audit [DBG] from='client.239619 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:49:12.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:49:11 smithi086 bash[24289]: cluster 2024-09-16T09:49:10.486016+0000 mgr.a (mgr.14373) 10903 : cluster [DBG] pgmap v7560: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:49:12.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:49:11 smithi047 bash[22744]: audit 2024-09-16T09:49:10.097697+0000 mgr.a (mgr.14373) 10902 : audit [DBG] from='client.239619 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:49:12.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:49:11 smithi047 bash[22744]: cluster 2024-09-16T09:49:10.486016+0000 mgr.a (mgr.14373) 10903 : cluster [DBG] pgmap v7560: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:49:14.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:49:13 smithi157 bash[24585]: cluster 2024-09-16T09:49:12.488199+0000 mgr.a (mgr.14373) 10904 : cluster [DBG] pgmap v7561: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:49:14.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:49:13 smithi086 bash[24289]: cluster 2024-09-16T09:49:12.488199+0000 mgr.a (mgr.14373) 10904 : cluster [DBG] pgmap v7561: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:49:14.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:49:13 smithi047 bash[22744]: cluster 2024-09-16T09:49:12.488199+0000 mgr.a (mgr.14373) 10904 : cluster [DBG] pgmap v7561: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:49:15.546 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:49:15.547 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:49:15.547 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:49:16.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:49:15 smithi157 bash[24585]: cluster 2024-09-16T09:49:14.488969+0000 mgr.a (mgr.14373) 10905 : cluster [DBG] pgmap v7562: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:49:16.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:49:15 smithi086 bash[24289]: cluster 2024-09-16T09:49:14.488969+0000 mgr.a (mgr.14373) 10905 : cluster [DBG] pgmap v7562: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:49:16.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:49:15 smithi047 bash[22744]: cluster 2024-09-16T09:49:14.488969+0000 mgr.a (mgr.14373) 10905 : cluster [DBG] pgmap v7562: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:49:16.301 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:49:16.301 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:49:16.302 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:49:16.302 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:49:16.302 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:49:18.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:49:17 smithi157 bash[24585]: audit 2024-09-16T09:49:15.875185+0000 mgr.a (mgr.14373) 10906 : audit [DBG] from='client.239694 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:49:18.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:49:17 smithi157 bash[24585]: cluster 2024-09-16T09:49:16.489873+0000 mgr.a (mgr.14373) 10907 : cluster [DBG] pgmap v7563: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:49:18.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:49:17 smithi086 bash[24289]: audit 2024-09-16T09:49:15.875185+0000 mgr.a (mgr.14373) 10906 : audit [DBG] from='client.239694 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:49:18.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:49:17 smithi086 bash[24289]: cluster 2024-09-16T09:49:16.489873+0000 mgr.a (mgr.14373) 10907 : cluster [DBG] pgmap v7563: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:49:18.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:49:17 smithi047 bash[22744]: audit 2024-09-16T09:49:15.875185+0000 mgr.a (mgr.14373) 10906 : audit [DBG] from='client.239694 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:49:18.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:49:17 smithi047 bash[22744]: cluster 2024-09-16T09:49:16.489873+0000 mgr.a (mgr.14373) 10907 : cluster [DBG] pgmap v7563: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:49:20.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:49:19 smithi157 bash[24585]: cluster 2024-09-16T09:49:18.492113+0000 mgr.a (mgr.14373) 10908 : cluster [DBG] pgmap v7564: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:49:20.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:49:19 smithi086 bash[24289]: cluster 2024-09-16T09:49:18.492113+0000 mgr.a (mgr.14373) 10908 : cluster [DBG] pgmap v7564: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:49:20.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:49:19 smithi047 bash[22744]: cluster 2024-09-16T09:49:18.492113+0000 mgr.a (mgr.14373) 10908 : cluster [DBG] pgmap v7564: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:49:21.303 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:49:21.304 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:49:21.304 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:49:22.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:49:21 smithi157 bash[24585]: cluster 2024-09-16T09:49:20.492890+0000 mgr.a (mgr.14373) 10909 : cluster [DBG] pgmap v7565: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:49:22.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:49:21 smithi086 bash[24289]: cluster 2024-09-16T09:49:20.492890+0000 mgr.a (mgr.14373) 10909 : cluster [DBG] pgmap v7565: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:49:22.078 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:49:22.078 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:49:22.078 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:49:22.078 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:49:22.079 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:49:22.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:49:21 smithi047 bash[22744]: cluster 2024-09-16T09:49:20.492890+0000 mgr.a (mgr.14373) 10909 : cluster [DBG] pgmap v7565: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:49:23.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:49:22 smithi157 bash[24585]: audit 2024-09-16T09:49:21.638358+0000 mgr.a (mgr.14373) 10910 : audit [DBG] from='client.239769 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:49:23.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:49:22 smithi086 bash[24289]: audit 2024-09-16T09:49:21.638358+0000 mgr.a (mgr.14373) 10910 : audit [DBG] from='client.239769 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:49:23.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:49:22 smithi047 bash[22744]: audit 2024-09-16T09:49:21.638358+0000 mgr.a (mgr.14373) 10910 : audit [DBG] from='client.239769 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:49:24.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:49:23 smithi157 bash[24585]: cluster 2024-09-16T09:49:22.495762+0000 mgr.a (mgr.14373) 10911 : cluster [DBG] pgmap v7566: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:49:24.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:49:23 smithi086 bash[24289]: cluster 2024-09-16T09:49:22.495762+0000 mgr.a (mgr.14373) 10911 : cluster [DBG] pgmap v7566: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:49:24.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:49:23 smithi047 bash[22744]: cluster 2024-09-16T09:49:22.495762+0000 mgr.a (mgr.14373) 10911 : cluster [DBG] pgmap v7566: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:49:26.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:49:25 smithi157 bash[24585]: cluster 2024-09-16T09:49:24.496559+0000 mgr.a (mgr.14373) 10912 : cluster [DBG] pgmap v7567: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:49:26.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:49:25 smithi086 bash[24289]: cluster 2024-09-16T09:49:24.496559+0000 mgr.a (mgr.14373) 10912 : cluster [DBG] pgmap v7567: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:49:26.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:49:25 smithi047 bash[22744]: cluster 2024-09-16T09:49:24.496559+0000 mgr.a (mgr.14373) 10912 : cluster [DBG] pgmap v7567: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:49:27.080 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:49:27.081 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:49:27.081 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:49:27.833 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:49:27.834 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:49:27.834 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:49:27.834 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:49:27.834 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:49:28.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:49:27 smithi157 bash[24585]: cluster 2024-09-16T09:49:26.497316+0000 mgr.a (mgr.14373) 10913 : cluster [DBG] pgmap v7568: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T09:49:28.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:49:27 smithi086 bash[24289]: cluster 2024-09-16T09:49:26.497316+0000 mgr.a (mgr.14373) 10913 : cluster [DBG] pgmap v7568: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T09:49:28.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:49:27 smithi047 bash[22744]: cluster 2024-09-16T09:49:26.497316+0000 mgr.a (mgr.14373) 10913 : cluster [DBG] pgmap v7568: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T09:49:29.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:49:28 smithi157 bash[24585]: audit 2024-09-16T09:49:27.404442+0000 mgr.a (mgr.14373) 10914 : audit [DBG] from='client.239844 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:49:29.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:49:28 smithi086 bash[24289]: audit 2024-09-16T09:49:27.404442+0000 mgr.a (mgr.14373) 10914 : audit [DBG] from='client.239844 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:49:29.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:49:28 smithi047 bash[22744]: audit 2024-09-16T09:49:27.404442+0000 mgr.a (mgr.14373) 10914 : audit [DBG] from='client.239844 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:49:30.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:49:29 smithi157 bash[24585]: cluster 2024-09-16T09:49:28.500208+0000 mgr.a (mgr.14373) 10915 : cluster [DBG] pgmap v7569: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:49:30.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:49:29 smithi086 bash[24289]: cluster 2024-09-16T09:49:28.500208+0000 mgr.a (mgr.14373) 10915 : cluster [DBG] pgmap v7569: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:49:30.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:49:29 smithi047 bash[22744]: cluster 2024-09-16T09:49:28.500208+0000 mgr.a (mgr.14373) 10915 : cluster [DBG] pgmap v7569: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:49:32.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:49:31 smithi157 bash[24585]: cluster 2024-09-16T09:49:30.500983+0000 mgr.a (mgr.14373) 10916 : cluster [DBG] pgmap v7570: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:49:32.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:49:31 smithi086 bash[24289]: cluster 2024-09-16T09:49:30.500983+0000 mgr.a (mgr.14373) 10916 : cluster [DBG] pgmap v7570: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:49:32.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:49:31 smithi047 bash[22744]: cluster 2024-09-16T09:49:30.500983+0000 mgr.a (mgr.14373) 10916 : cluster [DBG] pgmap v7570: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:49:32.835 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:49:32.836 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:49:32.836 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:49:33.623 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:49:33.624 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:49:33.624 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:49:33.624 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:49:33.624 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:49:34.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:49:33 smithi157 bash[24585]: cluster 2024-09-16T09:49:32.503060+0000 mgr.a (mgr.14373) 10917 : cluster [DBG] pgmap v7571: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:49:34.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:49:33 smithi086 bash[24289]: cluster 2024-09-16T09:49:32.503060+0000 mgr.a (mgr.14373) 10917 : cluster [DBG] pgmap v7571: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:49:34.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:49:33 smithi047 bash[22744]: cluster 2024-09-16T09:49:32.503060+0000 mgr.a (mgr.14373) 10917 : cluster [DBG] pgmap v7571: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:49:35.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:49:34 smithi157 bash[24585]: audit 2024-09-16T09:49:33.171366+0000 mgr.a (mgr.14373) 10918 : audit [DBG] from='client.239919 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:49:35.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:49:34 smithi086 bash[24289]: audit 2024-09-16T09:49:33.171366+0000 mgr.a (mgr.14373) 10918 : audit [DBG] from='client.239919 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:49:35.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:49:34 smithi047 bash[22744]: audit 2024-09-16T09:49:33.171366+0000 mgr.a (mgr.14373) 10918 : audit [DBG] from='client.239919 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:49:36.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:49:35 smithi157 bash[24585]: cluster 2024-09-16T09:49:34.504046+0000 mgr.a (mgr.14373) 10919 : cluster [DBG] pgmap v7572: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:49:36.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:49:35 smithi086 bash[24289]: cluster 2024-09-16T09:49:34.504046+0000 mgr.a (mgr.14373) 10919 : cluster [DBG] pgmap v7572: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:49:36.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:49:35 smithi047 bash[22744]: cluster 2024-09-16T09:49:34.504046+0000 mgr.a (mgr.14373) 10919 : cluster [DBG] pgmap v7572: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:49:38.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:49:37 smithi157 bash[24585]: cluster 2024-09-16T09:49:36.504817+0000 mgr.a (mgr.14373) 10920 : cluster [DBG] pgmap v7573: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:49:38.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:49:37 smithi086 bash[24289]: cluster 2024-09-16T09:49:36.504817+0000 mgr.a (mgr.14373) 10920 : cluster [DBG] pgmap v7573: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:49:38.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:49:37 smithi047 bash[22744]: cluster 2024-09-16T09:49:36.504817+0000 mgr.a (mgr.14373) 10920 : cluster [DBG] pgmap v7573: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:49:38.625 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:49:38.626 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:49:38.626 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:49:39.375 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:49:39.376 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:49:39.376 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:49:39.376 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:49:39.376 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:49:40.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:49:39 smithi157 bash[24585]: cluster 2024-09-16T09:49:38.507056+0000 mgr.a (mgr.14373) 10921 : cluster [DBG] pgmap v7574: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:49:40.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:49:39 smithi086 bash[24289]: cluster 2024-09-16T09:49:38.507056+0000 mgr.a (mgr.14373) 10921 : cluster [DBG] pgmap v7574: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:49:40.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:49:39 smithi047 bash[22744]: cluster 2024-09-16T09:49:38.507056+0000 mgr.a (mgr.14373) 10921 : cluster [DBG] pgmap v7574: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:49:41.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:49:40 smithi157 bash[24585]: audit 2024-09-16T09:49:38.957084+0000 mgr.a (mgr.14373) 10922 : audit [DBG] from='client.239994 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:49:41.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:49:40 smithi086 bash[24289]: audit 2024-09-16T09:49:38.957084+0000 mgr.a (mgr.14373) 10922 : audit [DBG] from='client.239994 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:49:41.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:49:40 smithi047 bash[22744]: audit 2024-09-16T09:49:38.957084+0000 mgr.a (mgr.14373) 10922 : audit [DBG] from='client.239994 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:49:42.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:49:41 smithi157 bash[24585]: cluster 2024-09-16T09:49:40.508009+0000 mgr.a (mgr.14373) 10923 : cluster [DBG] pgmap v7575: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:49:42.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:49:41 smithi086 bash[24289]: cluster 2024-09-16T09:49:40.508009+0000 mgr.a (mgr.14373) 10923 : cluster [DBG] pgmap v7575: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:49:42.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:49:41 smithi047 bash[22744]: cluster 2024-09-16T09:49:40.508009+0000 mgr.a (mgr.14373) 10923 : cluster [DBG] pgmap v7575: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:49:44.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:49:43 smithi157 bash[24585]: cluster 2024-09-16T09:49:42.510219+0000 mgr.a (mgr.14373) 10924 : cluster [DBG] pgmap v7576: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:49:44.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:49:43 smithi086 bash[24289]: cluster 2024-09-16T09:49:42.510219+0000 mgr.a (mgr.14373) 10924 : cluster [DBG] pgmap v7576: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:49:44.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:49:43 smithi047 bash[22744]: cluster 2024-09-16T09:49:42.510219+0000 mgr.a (mgr.14373) 10924 : cluster [DBG] pgmap v7576: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:49:44.377 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:49:44.378 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:49:44.378 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:49:45.157 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:49:45.158 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:49:45.158 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:49:45.158 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:49:45.158 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:49:46.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:49:45 smithi157 bash[24585]: cluster 2024-09-16T09:49:44.510698+0000 mgr.a (mgr.14373) 10925 : cluster [DBG] pgmap v7577: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:49:46.060 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:49:45 smithi157 bash[24585]: audit 2024-09-16T09:49:44.714288+0000 mgr.a (mgr.14373) 10926 : audit [DBG] from='client.240072 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:49:46.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:49:45 smithi086 bash[24289]: cluster 2024-09-16T09:49:44.510698+0000 mgr.a (mgr.14373) 10925 : cluster [DBG] pgmap v7577: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:49:46.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:49:45 smithi086 bash[24289]: audit 2024-09-16T09:49:44.714288+0000 mgr.a (mgr.14373) 10926 : audit [DBG] from='client.240072 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:49:46.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:49:45 smithi047 bash[22744]: cluster 2024-09-16T09:49:44.510698+0000 mgr.a (mgr.14373) 10925 : cluster [DBG] pgmap v7577: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:49:46.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:49:45 smithi047 bash[22744]: audit 2024-09-16T09:49:44.714288+0000 mgr.a (mgr.14373) 10926 : audit [DBG] from='client.240072 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:49:48.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:49:47 smithi157 bash[24585]: cluster 2024-09-16T09:49:46.511670+0000 mgr.a (mgr.14373) 10927 : cluster [DBG] pgmap v7578: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:49:48.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:49:47 smithi086 bash[24289]: cluster 2024-09-16T09:49:46.511670+0000 mgr.a (mgr.14373) 10927 : cluster [DBG] pgmap v7578: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:49:48.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:49:47 smithi047 bash[22744]: cluster 2024-09-16T09:49:46.511670+0000 mgr.a (mgr.14373) 10927 : cluster [DBG] pgmap v7578: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:49:50.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:49:49 smithi157 bash[24585]: cluster 2024-09-16T09:49:48.513910+0000 mgr.a (mgr.14373) 10928 : cluster [DBG] pgmap v7579: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:49:50.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:49:49 smithi086 bash[24289]: cluster 2024-09-16T09:49:48.513910+0000 mgr.a (mgr.14373) 10928 : cluster [DBG] pgmap v7579: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:49:50.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:49:49 smithi047 bash[22744]: cluster 2024-09-16T09:49:48.513910+0000 mgr.a (mgr.14373) 10928 : cluster [DBG] pgmap v7579: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:49:50.161 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:49:50.161 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:49:50.161 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:49:50.944 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:49:50.944 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:49:50.944 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:49:50.944 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:49:50.945 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:49:52.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:49:51 smithi157 bash[24585]: audit 2024-09-16T09:49:50.494262+0000 mgr.a (mgr.14373) 10929 : audit [DBG] from='client.240147 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:49:52.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:49:51 smithi157 bash[24585]: cluster 2024-09-16T09:49:50.515177+0000 mgr.a (mgr.14373) 10930 : cluster [DBG] pgmap v7580: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:49:52.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:49:51 smithi086 bash[24289]: audit 2024-09-16T09:49:50.494262+0000 mgr.a (mgr.14373) 10929 : audit [DBG] from='client.240147 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:49:52.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:49:51 smithi086 bash[24289]: cluster 2024-09-16T09:49:50.515177+0000 mgr.a (mgr.14373) 10930 : cluster [DBG] pgmap v7580: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:49:52.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:49:51 smithi047 bash[22744]: audit 2024-09-16T09:49:50.494262+0000 mgr.a (mgr.14373) 10929 : audit [DBG] from='client.240147 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:49:52.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:49:51 smithi047 bash[22744]: cluster 2024-09-16T09:49:50.515177+0000 mgr.a (mgr.14373) 10930 : cluster [DBG] pgmap v7580: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:49:54.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:49:53 smithi157 bash[24585]: cluster 2024-09-16T09:49:52.517606+0000 mgr.a (mgr.14373) 10931 : cluster [DBG] pgmap v7581: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:49:54.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:49:53 smithi086 bash[24289]: cluster 2024-09-16T09:49:52.517606+0000 mgr.a (mgr.14373) 10931 : cluster [DBG] pgmap v7581: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:49:54.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:49:53 smithi047 bash[22744]: cluster 2024-09-16T09:49:52.517606+0000 mgr.a (mgr.14373) 10931 : cluster [DBG] pgmap v7581: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:49:55.946 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:49:55.946 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:49:55.947 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:49:56.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:49:55 smithi157 bash[24585]: cluster 2024-09-16T09:49:54.518339+0000 mgr.a (mgr.14373) 10932 : cluster [DBG] pgmap v7582: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:49:56.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:49:55 smithi086 bash[24289]: cluster 2024-09-16T09:49:54.518339+0000 mgr.a (mgr.14373) 10932 : cluster [DBG] pgmap v7582: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:49:56.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:49:55 smithi047 bash[22744]: cluster 2024-09-16T09:49:54.518339+0000 mgr.a (mgr.14373) 10932 : cluster [DBG] pgmap v7582: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:49:56.725 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:49:56.726 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:49:56.726 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:49:56.726 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:49:56.726 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:49:58.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:49:57 smithi157 bash[24585]: audit 2024-09-16T09:49:56.283267+0000 mgr.a (mgr.14373) 10933 : audit [DBG] from='client.240222 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:49:58.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:49:57 smithi157 bash[24585]: cluster 2024-09-16T09:49:56.523632+0000 mgr.a (mgr.14373) 10934 : cluster [DBG] pgmap v7583: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:49:58.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:49:57 smithi086 bash[24289]: audit 2024-09-16T09:49:56.283267+0000 mgr.a (mgr.14373) 10933 : audit [DBG] from='client.240222 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:49:58.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:49:57 smithi086 bash[24289]: cluster 2024-09-16T09:49:56.523632+0000 mgr.a (mgr.14373) 10934 : cluster [DBG] pgmap v7583: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:49:58.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:49:57 smithi047 bash[22744]: audit 2024-09-16T09:49:56.283267+0000 mgr.a (mgr.14373) 10933 : audit [DBG] from='client.240222 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:49:58.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:49:57 smithi047 bash[22744]: cluster 2024-09-16T09:49:56.523632+0000 mgr.a (mgr.14373) 10934 : cluster [DBG] pgmap v7583: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:50:00.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:49:59 smithi157 bash[24585]: cluster 2024-09-16T09:49:58.526066+0000 mgr.a (mgr.14373) 10935 : cluster [DBG] pgmap v7584: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-16T09:50:00.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:49:59 smithi086 bash[24289]: cluster 2024-09-16T09:49:58.526066+0000 mgr.a (mgr.14373) 10935 : cluster [DBG] pgmap v7584: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-16T09:50:00.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:49:59 smithi047 bash[22744]: cluster 2024-09-16T09:49:58.526066+0000 mgr.a (mgr.14373) 10935 : cluster [DBG] pgmap v7584: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-16T09:50:01.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:50:00 smithi157 bash[24585]: cluster 2024-09-16T09:50:00.000154+0000 mon.a (mon.0) 1221 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-16T09:50:01.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:50:00 smithi086 bash[24289]: cluster 2024-09-16T09:50:00.000154+0000 mon.a (mon.0) 1221 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-16T09:50:01.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:50:00 smithi047 bash[22744]: cluster 2024-09-16T09:50:00.000154+0000 mon.a (mon.0) 1221 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-16T09:50:01.727 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:50:01.728 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:50:01.728 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:50:02.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:50:01 smithi157 bash[24585]: cluster 2024-09-16T09:50:00.526897+0000 mgr.a (mgr.14373) 10936 : cluster [DBG] pgmap v7585: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T09:50:02.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:50:01 smithi086 bash[24289]: cluster 2024-09-16T09:50:00.526897+0000 mgr.a (mgr.14373) 10936 : cluster [DBG] pgmap v7585: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T09:50:02.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:50:01 smithi047 bash[22744]: cluster 2024-09-16T09:50:00.526897+0000 mgr.a (mgr.14373) 10936 : cluster [DBG] pgmap v7585: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T09:50:02.516 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:50:02.517 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:50:02.517 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:50:02.517 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:50:02.517 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:50:04.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:50:03 smithi157 bash[24585]: audit 2024-09-16T09:50:02.067353+0000 mgr.a (mgr.14373) 10937 : audit [DBG] from='client.240300 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:50:04.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:50:03 smithi157 bash[24585]: cluster 2024-09-16T09:50:02.528338+0000 mgr.a (mgr.14373) 10938 : cluster [DBG] pgmap v7586: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:50:04.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:50:03 smithi157 bash[24585]: audit 2024-09-16T09:50:03.741582+0000 mon.b (mon.2) 1010 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T09:50:04.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:50:03 smithi086 bash[24289]: audit 2024-09-16T09:50:02.067353+0000 mgr.a (mgr.14373) 10937 : audit [DBG] from='client.240300 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:50:04.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:50:03 smithi086 bash[24289]: cluster 2024-09-16T09:50:02.528338+0000 mgr.a (mgr.14373) 10938 : cluster [DBG] pgmap v7586: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:50:04.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:50:03 smithi086 bash[24289]: audit 2024-09-16T09:50:03.741582+0000 mon.b (mon.2) 1010 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T09:50:04.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:50:03 smithi047 bash[22744]: audit 2024-09-16T09:50:02.067353+0000 mgr.a (mgr.14373) 10937 : audit [DBG] from='client.240300 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:50:04.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:50:03 smithi047 bash[22744]: cluster 2024-09-16T09:50:02.528338+0000 mgr.a (mgr.14373) 10938 : cluster [DBG] pgmap v7586: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:50:04.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:50:03 smithi047 bash[22744]: audit 2024-09-16T09:50:03.741582+0000 mon.b (mon.2) 1010 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T09:50:05.062 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:50:04 smithi157 bash[24585]: audit 2024-09-16T09:50:04.581607+0000 mon.b (mon.2) 1011 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:50:05.062 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:50:04 smithi157 bash[24585]: audit 2024-09-16T09:50:04.583714+0000 mon.b (mon.2) 1012 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T09:50:05.062 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:50:04 smithi157 bash[24585]: audit 2024-09-16T09:50:04.593583+0000 mon.a (mon.0) 1222 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:50:05.062 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:50:04 smithi157 bash[24585]: audit 2024-09-16T09:50:04.601161+0000 mon.b (mon.2) 1013 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:50:05.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:50:04 smithi086 bash[24289]: audit 2024-09-16T09:50:04.581607+0000 mon.b (mon.2) 1011 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:50:05.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:50:04 smithi086 bash[24289]: audit 2024-09-16T09:50:04.583714+0000 mon.b (mon.2) 1012 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T09:50:05.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:50:04 smithi086 bash[24289]: audit 2024-09-16T09:50:04.593583+0000 mon.a (mon.0) 1222 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:50:05.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:50:04 smithi086 bash[24289]: audit 2024-09-16T09:50:04.601161+0000 mon.b (mon.2) 1013 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:50:05.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:50:04 smithi047 bash[22744]: audit 2024-09-16T09:50:04.581607+0000 mon.b (mon.2) 1011 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:50:05.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:50:04 smithi047 bash[22744]: audit 2024-09-16T09:50:04.583714+0000 mon.b (mon.2) 1012 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T09:50:05.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:50:04 smithi047 bash[22744]: audit 2024-09-16T09:50:04.593583+0000 mon.a (mon.0) 1222 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:50:05.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:50:04 smithi047 bash[22744]: audit 2024-09-16T09:50:04.601161+0000 mon.b (mon.2) 1013 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:50:05.760 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 09:50:05 smithi047 bash[22994]: debug 2024-09-16T09:50:05.335+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T09:50:05.760 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 09:50:05 smithi047 bash[22994]: debug 2024-09-16T09:50:05.339+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T09:50:06.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:50:05 smithi157 bash[24585]: cluster 2024-09-16T09:50:04.528822+0000 mgr.a (mgr.14373) 10939 : cluster [DBG] pgmap v7587: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:50:06.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:50:05 smithi157 bash[24585]: audit 2024-09-16T09:50:04.603690+0000 mgr.a (mgr.14373) 10940 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:50:06.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:50:05 smithi086 bash[24289]: cluster 2024-09-16T09:50:04.528822+0000 mgr.a (mgr.14373) 10939 : cluster [DBG] pgmap v7587: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:50:06.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:50:05 smithi086 bash[24289]: audit 2024-09-16T09:50:04.603690+0000 mgr.a (mgr.14373) 10940 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:50:06.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:50:05 smithi047 bash[22744]: cluster 2024-09-16T09:50:04.528822+0000 mgr.a (mgr.14373) 10939 : cluster [DBG] pgmap v7587: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:50:06.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:50:05 smithi047 bash[22744]: audit 2024-09-16T09:50:04.603690+0000 mgr.a (mgr.14373) 10940 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:50:07.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:50:06 smithi157 bash[24585]: audit 2024-09-16T09:50:05.341906+0000 mgr.a (mgr.14373) 10941 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T09:50:07.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:50:06 smithi157 bash[24585]: cephadm 2024-09-16T09:50:05.344090+0000 mgr.a (mgr.14373) 10942 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T09:50:07.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:50:06 smithi086 bash[24289]: audit 2024-09-16T09:50:05.341906+0000 mgr.a (mgr.14373) 10941 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T09:50:07.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:50:06 smithi086 bash[24289]: cephadm 2024-09-16T09:50:05.344090+0000 mgr.a (mgr.14373) 10942 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T09:50:07.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:50:06 smithi047 bash[22744]: audit 2024-09-16T09:50:05.341906+0000 mgr.a (mgr.14373) 10941 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T09:50:07.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:50:06 smithi047 bash[22744]: cephadm 2024-09-16T09:50:05.344090+0000 mgr.a (mgr.14373) 10942 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T09:50:07.518 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:50:07.518 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:50:07.519 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:50:08.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:50:07 smithi157 bash[24585]: cluster 2024-09-16T09:50:06.529674+0000 mgr.a (mgr.14373) 10943 : cluster [DBG] pgmap v7588: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:50:08.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:50:07 smithi086 bash[24289]: cluster 2024-09-16T09:50:06.529674+0000 mgr.a (mgr.14373) 10943 : cluster [DBG] pgmap v7588: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:50:08.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:50:07 smithi047 bash[22744]: cluster 2024-09-16T09:50:06.529674+0000 mgr.a (mgr.14373) 10943 : cluster [DBG] pgmap v7588: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:50:08.264 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:50:08.264 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:50:08.264 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:50:08.264 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:50:08.264 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:50:10.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:50:09 smithi157 bash[24585]: audit 2024-09-16T09:50:07.842591+0000 mgr.a (mgr.14373) 10944 : audit [DBG] from='client.240486 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:50:10.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:50:09 smithi157 bash[24585]: cluster 2024-09-16T09:50:08.532472+0000 mgr.a (mgr.14373) 10945 : cluster [DBG] pgmap v7589: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:50:10.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:50:09 smithi086 bash[24289]: audit 2024-09-16T09:50:07.842591+0000 mgr.a (mgr.14373) 10944 : audit [DBG] from='client.240486 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:50:10.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:50:09 smithi086 bash[24289]: cluster 2024-09-16T09:50:08.532472+0000 mgr.a (mgr.14373) 10945 : cluster [DBG] pgmap v7589: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:50:10.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:50:09 smithi047 bash[22744]: audit 2024-09-16T09:50:07.842591+0000 mgr.a (mgr.14373) 10944 : audit [DBG] from='client.240486 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:50:10.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:50:09 smithi047 bash[22744]: cluster 2024-09-16T09:50:08.532472+0000 mgr.a (mgr.14373) 10945 : cluster [DBG] pgmap v7589: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:50:12.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:50:11 smithi157 bash[24585]: cluster 2024-09-16T09:50:10.533259+0000 mgr.a (mgr.14373) 10946 : cluster [DBG] pgmap v7590: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T09:50:12.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:50:11 smithi086 bash[24289]: cluster 2024-09-16T09:50:10.533259+0000 mgr.a (mgr.14373) 10946 : cluster [DBG] pgmap v7590: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T09:50:12.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:50:11 smithi047 bash[22744]: cluster 2024-09-16T09:50:10.533259+0000 mgr.a (mgr.14373) 10946 : cluster [DBG] pgmap v7590: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T09:50:13.265 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:50:13.266 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:50:13.266 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:50:14.016 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:50:14.017 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:50:14.017 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:50:14.017 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:50:14.017 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:50:14.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:50:13 smithi157 bash[24585]: cluster 2024-09-16T09:50:12.535298+0000 mgr.a (mgr.14373) 10947 : cluster [DBG] pgmap v7591: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:50:14.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:50:13 smithi086 bash[24289]: cluster 2024-09-16T09:50:12.535298+0000 mgr.a (mgr.14373) 10947 : cluster [DBG] pgmap v7591: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:50:14.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:50:13 smithi047 bash[22744]: cluster 2024-09-16T09:50:12.535298+0000 mgr.a (mgr.14373) 10947 : cluster [DBG] pgmap v7591: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:50:15.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:50:14 smithi157 bash[24585]: audit 2024-09-16T09:50:13.594382+0000 mgr.a (mgr.14373) 10948 : audit [DBG] from='client.240564 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:50:15.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:50:14 smithi086 bash[24289]: audit 2024-09-16T09:50:13.594382+0000 mgr.a (mgr.14373) 10948 : audit [DBG] from='client.240564 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:50:15.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:50:14 smithi047 bash[22744]: audit 2024-09-16T09:50:13.594382+0000 mgr.a (mgr.14373) 10948 : audit [DBG] from='client.240564 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:50:16.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:50:15 smithi157 bash[24585]: cluster 2024-09-16T09:50:14.536317+0000 mgr.a (mgr.14373) 10949 : cluster [DBG] pgmap v7592: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:50:16.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:50:15 smithi086 bash[24289]: cluster 2024-09-16T09:50:14.536317+0000 mgr.a (mgr.14373) 10949 : cluster [DBG] pgmap v7592: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:50:16.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:50:15 smithi047 bash[22744]: cluster 2024-09-16T09:50:14.536317+0000 mgr.a (mgr.14373) 10949 : cluster [DBG] pgmap v7592: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:50:17.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:50:16 smithi157 bash[24585]: cluster 2024-09-16T09:50:16.537117+0000 mgr.a (mgr.14373) 10950 : cluster [DBG] pgmap v7593: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:50:17.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:50:16 smithi086 bash[24289]: cluster 2024-09-16T09:50:16.537117+0000 mgr.a (mgr.14373) 10950 : cluster [DBG] pgmap v7593: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:50:17.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:50:16 smithi047 bash[22744]: cluster 2024-09-16T09:50:16.537117+0000 mgr.a (mgr.14373) 10950 : cluster [DBG] pgmap v7593: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:50:19.019 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:50:19.020 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:50:19.020 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:50:19.796 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:50:19.796 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:50:19.796 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:50:19.796 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:50:19.796 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:50:20.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:50:19 smithi157 bash[24585]: cluster 2024-09-16T09:50:18.539367+0000 mgr.a (mgr.14373) 10951 : cluster [DBG] pgmap v7594: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:50:20.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:50:19 smithi086 bash[24289]: cluster 2024-09-16T09:50:18.539367+0000 mgr.a (mgr.14373) 10951 : cluster [DBG] pgmap v7594: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:50:20.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:50:19 smithi047 bash[22744]: cluster 2024-09-16T09:50:18.539367+0000 mgr.a (mgr.14373) 10951 : cluster [DBG] pgmap v7594: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:50:21.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:50:20 smithi157 bash[24585]: audit 2024-09-16T09:50:19.354081+0000 mgr.a (mgr.14373) 10952 : audit [DBG] from='client.240642 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:50:21.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:50:20 smithi086 bash[24289]: audit 2024-09-16T09:50:19.354081+0000 mgr.a (mgr.14373) 10952 : audit [DBG] from='client.240642 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:50:21.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:50:20 smithi047 bash[22744]: audit 2024-09-16T09:50:19.354081+0000 mgr.a (mgr.14373) 10952 : audit [DBG] from='client.240642 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:50:22.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:50:21 smithi157 bash[24585]: cluster 2024-09-16T09:50:20.540361+0000 mgr.a (mgr.14373) 10953 : cluster [DBG] pgmap v7595: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:50:22.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:50:21 smithi086 bash[24289]: cluster 2024-09-16T09:50:20.540361+0000 mgr.a (mgr.14373) 10953 : cluster [DBG] pgmap v7595: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:50:22.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:50:21 smithi047 bash[22744]: cluster 2024-09-16T09:50:20.540361+0000 mgr.a (mgr.14373) 10953 : cluster [DBG] pgmap v7595: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:50:24.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:50:23 smithi157 bash[24585]: cluster 2024-09-16T09:50:22.542645+0000 mgr.a (mgr.14373) 10954 : cluster [DBG] pgmap v7596: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:50:24.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:50:23 smithi086 bash[24289]: cluster 2024-09-16T09:50:22.542645+0000 mgr.a (mgr.14373) 10954 : cluster [DBG] pgmap v7596: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:50:24.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:50:23 smithi047 bash[22744]: cluster 2024-09-16T09:50:22.542645+0000 mgr.a (mgr.14373) 10954 : cluster [DBG] pgmap v7596: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:50:24.797 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:50:24.798 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:50:24.798 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:50:25.554 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:50:25.554 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:50:25.554 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:50:25.554 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:50:25.554 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:50:26.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:50:25 smithi157 bash[24585]: cluster 2024-09-16T09:50:24.543450+0000 mgr.a (mgr.14373) 10955 : cluster [DBG] pgmap v7597: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:50:26.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:50:25 smithi086 bash[24289]: cluster 2024-09-16T09:50:24.543450+0000 mgr.a (mgr.14373) 10955 : cluster [DBG] pgmap v7597: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:50:26.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:50:25 smithi047 bash[22744]: cluster 2024-09-16T09:50:24.543450+0000 mgr.a (mgr.14373) 10955 : cluster [DBG] pgmap v7597: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:50:27.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:50:26 smithi157 bash[24585]: audit 2024-09-16T09:50:25.128073+0000 mgr.a (mgr.14373) 10956 : audit [DBG] from='client.240717 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:50:27.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:50:26 smithi086 bash[24289]: audit 2024-09-16T09:50:25.128073+0000 mgr.a (mgr.14373) 10956 : audit [DBG] from='client.240717 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:50:27.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:50:26 smithi047 bash[22744]: audit 2024-09-16T09:50:25.128073+0000 mgr.a (mgr.14373) 10956 : audit [DBG] from='client.240717 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:50:28.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:50:27 smithi157 bash[24585]: cluster 2024-09-16T09:50:26.544330+0000 mgr.a (mgr.14373) 10957 : cluster [DBG] pgmap v7598: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:50:28.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:50:27 smithi086 bash[24289]: cluster 2024-09-16T09:50:26.544330+0000 mgr.a (mgr.14373) 10957 : cluster [DBG] pgmap v7598: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:50:28.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:50:27 smithi047 bash[22744]: cluster 2024-09-16T09:50:26.544330+0000 mgr.a (mgr.14373) 10957 : cluster [DBG] pgmap v7598: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:50:30.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:50:29 smithi157 bash[24585]: cluster 2024-09-16T09:50:28.546602+0000 mgr.a (mgr.14373) 10958 : cluster [DBG] pgmap v7599: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:50:30.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:50:29 smithi086 bash[24289]: cluster 2024-09-16T09:50:28.546602+0000 mgr.a (mgr.14373) 10958 : cluster [DBG] pgmap v7599: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:50:30.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:50:29 smithi047 bash[22744]: cluster 2024-09-16T09:50:28.546602+0000 mgr.a (mgr.14373) 10958 : cluster [DBG] pgmap v7599: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:50:30.555 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:50:30.556 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:50:30.556 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:50:31.318 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:50:31.318 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:50:31.318 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:50:31.318 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:50:31.318 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:50:32.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:50:31 smithi157 bash[24585]: cluster 2024-09-16T09:50:30.547396+0000 mgr.a (mgr.14373) 10959 : cluster [DBG] pgmap v7600: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:50:32.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:50:31 smithi086 bash[24289]: cluster 2024-09-16T09:50:30.547396+0000 mgr.a (mgr.14373) 10959 : cluster [DBG] pgmap v7600: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:50:32.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:50:31 smithi047 bash[22744]: cluster 2024-09-16T09:50:30.547396+0000 mgr.a (mgr.14373) 10959 : cluster [DBG] pgmap v7600: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:50:33.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:50:32 smithi157 bash[24585]: audit 2024-09-16T09:50:30.886083+0000 mgr.a (mgr.14373) 10960 : audit [DBG] from='client.240795 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:50:33.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:50:32 smithi086 bash[24289]: audit 2024-09-16T09:50:30.886083+0000 mgr.a (mgr.14373) 10960 : audit [DBG] from='client.240795 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:50:33.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:50:32 smithi047 bash[22744]: audit 2024-09-16T09:50:30.886083+0000 mgr.a (mgr.14373) 10960 : audit [DBG] from='client.240795 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:50:34.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:50:33 smithi157 bash[24585]: cluster 2024-09-16T09:50:32.549743+0000 mgr.a (mgr.14373) 10961 : cluster [DBG] pgmap v7601: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:50:34.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:50:33 smithi086 bash[24289]: cluster 2024-09-16T09:50:32.549743+0000 mgr.a (mgr.14373) 10961 : cluster [DBG] pgmap v7601: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:50:34.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:50:33 smithi047 bash[22744]: cluster 2024-09-16T09:50:32.549743+0000 mgr.a (mgr.14373) 10961 : cluster [DBG] pgmap v7601: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:50:36.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:50:35 smithi157 bash[24585]: cluster 2024-09-16T09:50:34.550598+0000 mgr.a (mgr.14373) 10962 : cluster [DBG] pgmap v7602: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:50:36.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:50:35 smithi086 bash[24289]: cluster 2024-09-16T09:50:34.550598+0000 mgr.a (mgr.14373) 10962 : cluster [DBG] pgmap v7602: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:50:36.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:50:35 smithi047 bash[22744]: cluster 2024-09-16T09:50:34.550598+0000 mgr.a (mgr.14373) 10962 : cluster [DBG] pgmap v7602: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:50:36.319 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:50:36.320 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:50:36.320 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:50:37.072 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:50:37.073 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:50:37.073 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:50:37.073 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:50:37.073 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:50:38.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:50:37 smithi157 bash[24585]: cluster 2024-09-16T09:50:36.551729+0000 mgr.a (mgr.14373) 10963 : cluster [DBG] pgmap v7603: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:50:38.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:50:37 smithi157 bash[24585]: audit 2024-09-16T09:50:36.654611+0000 mgr.a (mgr.14373) 10964 : audit [DBG] from='client.240870 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:50:38.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:50:37 smithi086 bash[24289]: cluster 2024-09-16T09:50:36.551729+0000 mgr.a (mgr.14373) 10963 : cluster [DBG] pgmap v7603: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:50:38.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:50:37 smithi086 bash[24289]: audit 2024-09-16T09:50:36.654611+0000 mgr.a (mgr.14373) 10964 : audit [DBG] from='client.240870 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:50:38.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:50:37 smithi047 bash[22744]: cluster 2024-09-16T09:50:36.551729+0000 mgr.a (mgr.14373) 10963 : cluster [DBG] pgmap v7603: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:50:38.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:50:37 smithi047 bash[22744]: audit 2024-09-16T09:50:36.654611+0000 mgr.a (mgr.14373) 10964 : audit [DBG] from='client.240870 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:50:40.058 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:50:39 smithi157 bash[24585]: cluster 2024-09-16T09:50:38.554191+0000 mgr.a (mgr.14373) 10965 : cluster [DBG] pgmap v7604: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:50:40.072 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:50:39 smithi086 bash[24289]: cluster 2024-09-16T09:50:38.554191+0000 mgr.a (mgr.14373) 10965 : cluster [DBG] pgmap v7604: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:50:40.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:50:39 smithi047 bash[22744]: cluster 2024-09-16T09:50:38.554191+0000 mgr.a (mgr.14373) 10965 : cluster [DBG] pgmap v7604: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:50:42.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:50:41 smithi157 bash[24585]: cluster 2024-09-16T09:50:40.555199+0000 mgr.a (mgr.14373) 10966 : cluster [DBG] pgmap v7605: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:50:42.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:50:41 smithi086 bash[24289]: cluster 2024-09-16T09:50:40.555199+0000 mgr.a (mgr.14373) 10966 : cluster [DBG] pgmap v7605: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:50:42.074 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:50:42.075 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:50:42.075 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:50:42.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:50:41 smithi047 bash[22744]: cluster 2024-09-16T09:50:40.555199+0000 mgr.a (mgr.14373) 10966 : cluster [DBG] pgmap v7605: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:50:42.837 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:50:42.837 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:50:42.837 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:50:42.838 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:50:42.838 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:50:44.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:50:43 smithi157 bash[24585]: audit 2024-09-16T09:50:42.405455+0000 mgr.a (mgr.14373) 10967 : audit [DBG] from='client.240942 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:50:44.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:50:43 smithi157 bash[24585]: cluster 2024-09-16T09:50:42.556553+0000 mgr.a (mgr.14373) 10968 : cluster [DBG] pgmap v7606: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:50:44.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:50:43 smithi086 bash[24289]: audit 2024-09-16T09:50:42.405455+0000 mgr.a (mgr.14373) 10967 : audit [DBG] from='client.240942 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:50:44.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:50:43 smithi086 bash[24289]: cluster 2024-09-16T09:50:42.556553+0000 mgr.a (mgr.14373) 10968 : cluster [DBG] pgmap v7606: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:50:44.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:50:43 smithi047 bash[22744]: audit 2024-09-16T09:50:42.405455+0000 mgr.a (mgr.14373) 10967 : audit [DBG] from='client.240942 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:50:44.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:50:43 smithi047 bash[22744]: cluster 2024-09-16T09:50:42.556553+0000 mgr.a (mgr.14373) 10968 : cluster [DBG] pgmap v7606: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:50:46.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:50:45 smithi157 bash[24585]: cluster 2024-09-16T09:50:44.557419+0000 mgr.a (mgr.14373) 10969 : cluster [DBG] pgmap v7607: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:50:46.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:50:45 smithi086 bash[24289]: cluster 2024-09-16T09:50:44.557419+0000 mgr.a (mgr.14373) 10969 : cluster [DBG] pgmap v7607: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:50:46.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:50:45 smithi047 bash[22744]: cluster 2024-09-16T09:50:44.557419+0000 mgr.a (mgr.14373) 10969 : cluster [DBG] pgmap v7607: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:50:47.841 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:50:47.842 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:50:47.842 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:50:48.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:50:47 smithi157 bash[24585]: cluster 2024-09-16T09:50:46.559189+0000 mgr.a (mgr.14373) 10970 : cluster [DBG] pgmap v7608: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-16T09:50:48.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:50:47 smithi086 bash[24289]: cluster 2024-09-16T09:50:46.559189+0000 mgr.a (mgr.14373) 10970 : cluster [DBG] pgmap v7608: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-16T09:50:48.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:50:47 smithi047 bash[22744]: cluster 2024-09-16T09:50:46.559189+0000 mgr.a (mgr.14373) 10970 : cluster [DBG] pgmap v7608: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-16T09:50:48.599 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:50:48.600 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:50:48.600 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:50:48.600 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:50:48.600 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:50:50.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:50:49 smithi157 bash[24585]: audit 2024-09-16T09:50:48.167781+0000 mgr.a (mgr.14373) 10971 : audit [DBG] from='client.241020 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:50:50.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:50:49 smithi157 bash[24585]: cluster 2024-09-16T09:50:48.560223+0000 mgr.a (mgr.14373) 10972 : cluster [DBG] pgmap v7609: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:50:50.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:50:49 smithi086 bash[24289]: audit 2024-09-16T09:50:48.167781+0000 mgr.a (mgr.14373) 10971 : audit [DBG] from='client.241020 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:50:50.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:50:49 smithi086 bash[24289]: cluster 2024-09-16T09:50:48.560223+0000 mgr.a (mgr.14373) 10972 : cluster [DBG] pgmap v7609: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:50:50.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:50:49 smithi047 bash[22744]: audit 2024-09-16T09:50:48.167781+0000 mgr.a (mgr.14373) 10971 : audit [DBG] from='client.241020 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:50:50.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:50:49 smithi047 bash[22744]: cluster 2024-09-16T09:50:48.560223+0000 mgr.a (mgr.14373) 10972 : cluster [DBG] pgmap v7609: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:50:52.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:50:51 smithi157 bash[24585]: cluster 2024-09-16T09:50:50.560919+0000 mgr.a (mgr.14373) 10973 : cluster [DBG] pgmap v7610: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:50:52.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:50:51 smithi086 bash[24289]: cluster 2024-09-16T09:50:50.560919+0000 mgr.a (mgr.14373) 10973 : cluster [DBG] pgmap v7610: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:50:52.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:50:51 smithi047 bash[22744]: cluster 2024-09-16T09:50:50.560919+0000 mgr.a (mgr.14373) 10973 : cluster [DBG] pgmap v7610: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:50:53.601 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:50:53.602 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:50:53.602 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:50:54.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:50:53 smithi157 bash[24585]: cluster 2024-09-16T09:50:52.562961+0000 mgr.a (mgr.14373) 10974 : cluster [DBG] pgmap v7611: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:50:54.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:50:53 smithi086 bash[24289]: cluster 2024-09-16T09:50:52.562961+0000 mgr.a (mgr.14373) 10974 : cluster [DBG] pgmap v7611: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:50:54.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:50:53 smithi047 bash[22744]: cluster 2024-09-16T09:50:52.562961+0000 mgr.a (mgr.14373) 10974 : cluster [DBG] pgmap v7611: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:50:54.362 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:50:54.363 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:50:54.363 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:50:54.363 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:50:54.363 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:50:56.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:50:55 smithi157 bash[24585]: audit 2024-09-16T09:50:53.938339+0000 mgr.a (mgr.14373) 10975 : audit [DBG] from='client.241098 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:50:56.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:50:55 smithi157 bash[24585]: cluster 2024-09-16T09:50:54.563897+0000 mgr.a (mgr.14373) 10976 : cluster [DBG] pgmap v7612: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:50:56.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:50:55 smithi086 bash[24289]: audit 2024-09-16T09:50:53.938339+0000 mgr.a (mgr.14373) 10975 : audit [DBG] from='client.241098 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:50:56.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:50:55 smithi086 bash[24289]: cluster 2024-09-16T09:50:54.563897+0000 mgr.a (mgr.14373) 10976 : cluster [DBG] pgmap v7612: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:50:56.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:50:55 smithi047 bash[22744]: audit 2024-09-16T09:50:53.938339+0000 mgr.a (mgr.14373) 10975 : audit [DBG] from='client.241098 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:50:56.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:50:55 smithi047 bash[22744]: cluster 2024-09-16T09:50:54.563897+0000 mgr.a (mgr.14373) 10976 : cluster [DBG] pgmap v7612: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:50:58.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:50:57 smithi157 bash[24585]: cluster 2024-09-16T09:50:56.565627+0000 mgr.a (mgr.14373) 10977 : cluster [DBG] pgmap v7613: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:50:58.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:50:57 smithi086 bash[24289]: cluster 2024-09-16T09:50:56.565627+0000 mgr.a (mgr.14373) 10977 : cluster [DBG] pgmap v7613: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:50:58.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:50:57 smithi047 bash[22744]: cluster 2024-09-16T09:50:56.565627+0000 mgr.a (mgr.14373) 10977 : cluster [DBG] pgmap v7613: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:50:59.364 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:50:59.365 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:50:59.365 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:51:00.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:50:59 smithi157 bash[24585]: cluster 2024-09-16T09:50:58.566966+0000 mgr.a (mgr.14373) 10978 : cluster [DBG] pgmap v7614: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-16T09:51:00.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:50:59 smithi086 bash[24289]: cluster 2024-09-16T09:50:58.566966+0000 mgr.a (mgr.14373) 10978 : cluster [DBG] pgmap v7614: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-16T09:51:00.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:50:59 smithi047 bash[22744]: cluster 2024-09-16T09:50:58.566966+0000 mgr.a (mgr.14373) 10978 : cluster [DBG] pgmap v7614: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-16T09:51:00.126 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:51:00.126 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:51:00.126 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:51:00.127 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:51:00.127 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:51:01.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:51:00 smithi157 bash[24585]: audit 2024-09-16T09:50:59.694699+0000 mgr.a (mgr.14373) 10979 : audit [DBG] from='client.241176 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:51:01.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:51:00 smithi086 bash[24289]: audit 2024-09-16T09:50:59.694699+0000 mgr.a (mgr.14373) 10979 : audit [DBG] from='client.241176 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:51:01.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:51:00 smithi047 bash[22744]: audit 2024-09-16T09:50:59.694699+0000 mgr.a (mgr.14373) 10979 : audit [DBG] from='client.241176 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:51:02.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:51:01 smithi157 bash[24585]: cluster 2024-09-16T09:51:00.568135+0000 mgr.a (mgr.14373) 10980 : cluster [DBG] pgmap v7615: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:51:02.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:51:01 smithi086 bash[24289]: cluster 2024-09-16T09:51:00.568135+0000 mgr.a (mgr.14373) 10980 : cluster [DBG] pgmap v7615: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:51:02.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:51:01 smithi047 bash[22744]: cluster 2024-09-16T09:51:00.568135+0000 mgr.a (mgr.14373) 10980 : cluster [DBG] pgmap v7615: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:51:04.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:51:03 smithi157 bash[24585]: cluster 2024-09-16T09:51:02.570439+0000 mgr.a (mgr.14373) 10981 : cluster [DBG] pgmap v7616: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:51:04.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:51:03 smithi086 bash[24289]: cluster 2024-09-16T09:51:02.570439+0000 mgr.a (mgr.14373) 10981 : cluster [DBG] pgmap v7616: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:51:04.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:51:03 smithi047 bash[22744]: cluster 2024-09-16T09:51:02.570439+0000 mgr.a (mgr.14373) 10981 : cluster [DBG] pgmap v7616: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:51:05.127 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:51:05.128 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:51:05.128 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:51:05.872 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:51:05.872 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:51:05.872 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:51:05.872 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:51:05.872 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:51:06.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:51:05 smithi157 bash[24585]: cluster 2024-09-16T09:51:04.571211+0000 mgr.a (mgr.14373) 10982 : cluster [DBG] pgmap v7617: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:51:06.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:51:05 smithi157 bash[24585]: audit 2024-09-16T09:51:05.400631+0000 mon.b (mon.2) 1014 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T09:51:06.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:51:05 smithi086 bash[24289]: cluster 2024-09-16T09:51:04.571211+0000 mgr.a (mgr.14373) 10982 : cluster [DBG] pgmap v7617: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:51:06.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:51:05 smithi086 bash[24289]: audit 2024-09-16T09:51:05.400631+0000 mon.b (mon.2) 1014 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T09:51:06.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:51:05 smithi047 bash[22744]: cluster 2024-09-16T09:51:04.571211+0000 mgr.a (mgr.14373) 10982 : cluster [DBG] pgmap v7617: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:51:06.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:51:05 smithi047 bash[22744]: audit 2024-09-16T09:51:05.400631+0000 mon.b (mon.2) 1014 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T09:51:07.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:51:06 smithi157 bash[24585]: audit 2024-09-16T09:51:05.454566+0000 mgr.a (mgr.14373) 10983 : audit [DBG] from='client.241254 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:51:07.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:51:06 smithi086 bash[24289]: audit 2024-09-16T09:51:05.454566+0000 mgr.a (mgr.14373) 10983 : audit [DBG] from='client.241254 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:51:07.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:51:06 smithi047 bash[22744]: audit 2024-09-16T09:51:05.454566+0000 mgr.a (mgr.14373) 10983 : audit [DBG] from='client.241254 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:51:08.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:51:07 smithi157 bash[24585]: cluster 2024-09-16T09:51:06.573090+0000 mgr.a (mgr.14373) 10984 : cluster [DBG] pgmap v7618: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:51:08.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:51:07 smithi086 bash[24289]: cluster 2024-09-16T09:51:06.573090+0000 mgr.a (mgr.14373) 10984 : cluster [DBG] pgmap v7618: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:51:08.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:51:07 smithi047 bash[22744]: cluster 2024-09-16T09:51:06.573090+0000 mgr.a (mgr.14373) 10984 : cluster [DBG] pgmap v7618: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:51:10.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:51:09 smithi157 bash[24585]: cluster 2024-09-16T09:51:08.574282+0000 mgr.a (mgr.14373) 10985 : cluster [DBG] pgmap v7619: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-16T09:51:10.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:51:09 smithi086 bash[24289]: cluster 2024-09-16T09:51:08.574282+0000 mgr.a (mgr.14373) 10985 : cluster [DBG] pgmap v7619: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-16T09:51:10.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:51:09 smithi047 bash[22744]: cluster 2024-09-16T09:51:08.574282+0000 mgr.a (mgr.14373) 10985 : cluster [DBG] pgmap v7619: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-16T09:51:10.890 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:51:10.891 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:51:10.891 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:51:11.642 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:51:11.642 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:51:11.643 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:51:11.643 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:51:11.643 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:51:12.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:51:11 smithi157 bash[24585]: cluster 2024-09-16T09:51:10.574849+0000 mgr.a (mgr.14373) 10986 : cluster [DBG] pgmap v7620: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:51:12.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:51:11 smithi157 bash[24585]: audit 2024-09-16T09:51:10.758184+0000 mon.a (mon.0) 1223 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:51:12.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:51:11 smithi157 bash[24585]: audit 2024-09-16T09:51:10.766528+0000 mon.a (mon.0) 1224 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:51:12.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:51:11 smithi157 bash[24585]: audit 2024-09-16T09:51:10.800089+0000 mon.a (mon.0) 1225 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:51:12.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:51:11 smithi157 bash[24585]: audit 2024-09-16T09:51:10.809022+0000 mon.a (mon.0) 1226 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:51:12.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:51:11 smithi157 bash[24585]: audit 2024-09-16T09:51:10.829054+0000 mon.a (mon.0) 1227 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:51:12.058 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:51:11 smithi157 bash[24585]: audit 2024-09-16T09:51:10.836177+0000 mon.a (mon.0) 1228 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:51:12.058 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:51:11 smithi157 bash[24585]: audit 2024-09-16T09:51:11.583973+0000 mon.b (mon.2) 1015 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:51:12.058 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:51:11 smithi157 bash[24585]: audit 2024-09-16T09:51:11.585380+0000 mon.b (mon.2) 1016 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T09:51:12.058 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:51:11 smithi157 bash[24585]: audit 2024-09-16T09:51:11.591676+0000 mon.a (mon.0) 1229 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:51:12.058 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:51:11 smithi157 bash[24585]: audit 2024-09-16T09:51:11.596683+0000 mon.b (mon.2) 1017 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:51:12.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:51:11 smithi086 bash[24289]: cluster 2024-09-16T09:51:10.574849+0000 mgr.a (mgr.14373) 10986 : cluster [DBG] pgmap v7620: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:51:12.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:51:11 smithi086 bash[24289]: audit 2024-09-16T09:51:10.758184+0000 mon.a (mon.0) 1223 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:51:12.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:51:11 smithi086 bash[24289]: audit 2024-09-16T09:51:10.766528+0000 mon.a (mon.0) 1224 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:51:12.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:51:11 smithi086 bash[24289]: audit 2024-09-16T09:51:10.800089+0000 mon.a (mon.0) 1225 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:51:12.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:51:11 smithi086 bash[24289]: audit 2024-09-16T09:51:10.809022+0000 mon.a (mon.0) 1226 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:51:12.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:51:11 smithi086 bash[24289]: audit 2024-09-16T09:51:10.829054+0000 mon.a (mon.0) 1227 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:51:12.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:51:11 smithi086 bash[24289]: audit 2024-09-16T09:51:10.836177+0000 mon.a (mon.0) 1228 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:51:12.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:51:11 smithi086 bash[24289]: audit 2024-09-16T09:51:11.583973+0000 mon.b (mon.2) 1015 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:51:12.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:51:11 smithi086 bash[24289]: audit 2024-09-16T09:51:11.585380+0000 mon.b (mon.2) 1016 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T09:51:12.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:51:11 smithi086 bash[24289]: audit 2024-09-16T09:51:11.591676+0000 mon.a (mon.0) 1229 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:51:12.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:51:11 smithi086 bash[24289]: audit 2024-09-16T09:51:11.596683+0000 mon.b (mon.2) 1017 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:51:12.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:51:11 smithi047 bash[22744]: cluster 2024-09-16T09:51:10.574849+0000 mgr.a (mgr.14373) 10986 : cluster [DBG] pgmap v7620: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:51:12.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:51:11 smithi047 bash[22744]: audit 2024-09-16T09:51:10.758184+0000 mon.a (mon.0) 1223 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:51:12.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:51:11 smithi047 bash[22744]: audit 2024-09-16T09:51:10.766528+0000 mon.a (mon.0) 1224 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:51:12.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:51:11 smithi047 bash[22744]: audit 2024-09-16T09:51:10.800089+0000 mon.a (mon.0) 1225 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:51:12.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:51:11 smithi047 bash[22744]: audit 2024-09-16T09:51:10.809022+0000 mon.a (mon.0) 1226 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:51:12.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:51:11 smithi047 bash[22744]: audit 2024-09-16T09:51:10.829054+0000 mon.a (mon.0) 1227 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:51:12.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:51:11 smithi047 bash[22744]: audit 2024-09-16T09:51:10.836177+0000 mon.a (mon.0) 1228 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:51:12.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:51:11 smithi047 bash[22744]: audit 2024-09-16T09:51:11.583973+0000 mon.b (mon.2) 1015 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:51:12.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:51:11 smithi047 bash[22744]: audit 2024-09-16T09:51:11.585380+0000 mon.b (mon.2) 1016 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T09:51:12.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:51:11 smithi047 bash[22744]: audit 2024-09-16T09:51:11.591676+0000 mon.a (mon.0) 1229 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:51:12.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:51:11 smithi047 bash[22744]: audit 2024-09-16T09:51:11.596683+0000 mon.b (mon.2) 1017 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:51:12.592 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 09:51:12 smithi047 bash[22994]: debug 2024-09-16T09:51:12.334+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T09:51:12.592 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 09:51:12 smithi047 bash[22994]: debug 2024-09-16T09:51:12.334+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T09:51:13.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:51:12 smithi157 bash[24585]: audit 2024-09-16T09:51:11.199079+0000 mgr.a (mgr.14373) 10987 : audit [DBG] from='client.241332 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:51:13.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:51:12 smithi157 bash[24585]: audit 2024-09-16T09:51:11.597843+0000 mgr.a (mgr.14373) 10988 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:51:13.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:51:12 smithi086 bash[24289]: audit 2024-09-16T09:51:11.199079+0000 mgr.a (mgr.14373) 10987 : audit [DBG] from='client.241332 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:51:13.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:51:12 smithi086 bash[24289]: audit 2024-09-16T09:51:11.597843+0000 mgr.a (mgr.14373) 10988 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:51:13.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:51:12 smithi047 bash[22744]: audit 2024-09-16T09:51:11.199079+0000 mgr.a (mgr.14373) 10987 : audit [DBG] from='client.241332 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:51:13.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:51:12 smithi047 bash[22744]: audit 2024-09-16T09:51:11.597843+0000 mgr.a (mgr.14373) 10988 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:51:14.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:51:13 smithi157 bash[24585]: audit 2024-09-16T09:51:12.335995+0000 mgr.a (mgr.14373) 10989 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T09:51:14.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:51:13 smithi157 bash[24585]: cephadm 2024-09-16T09:51:12.337773+0000 mgr.a (mgr.14373) 10990 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T09:51:14.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:51:13 smithi157 bash[24585]: cluster 2024-09-16T09:51:12.577429+0000 mgr.a (mgr.14373) 10991 : cluster [DBG] pgmap v7621: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-16T09:51:14.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:51:13 smithi086 bash[24289]: audit 2024-09-16T09:51:12.335995+0000 mgr.a (mgr.14373) 10989 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T09:51:14.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:51:13 smithi086 bash[24289]: cephadm 2024-09-16T09:51:12.337773+0000 mgr.a (mgr.14373) 10990 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T09:51:14.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:51:13 smithi086 bash[24289]: cluster 2024-09-16T09:51:12.577429+0000 mgr.a (mgr.14373) 10991 : cluster [DBG] pgmap v7621: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-16T09:51:14.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:51:13 smithi047 bash[22744]: audit 2024-09-16T09:51:12.335995+0000 mgr.a (mgr.14373) 10989 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T09:51:14.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:51:13 smithi047 bash[22744]: cephadm 2024-09-16T09:51:12.337773+0000 mgr.a (mgr.14373) 10990 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T09:51:14.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:51:13 smithi047 bash[22744]: cluster 2024-09-16T09:51:12.577429+0000 mgr.a (mgr.14373) 10991 : cluster [DBG] pgmap v7621: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-16T09:51:16.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:51:15 smithi157 bash[24585]: cluster 2024-09-16T09:51:14.578202+0000 mgr.a (mgr.14373) 10992 : cluster [DBG] pgmap v7622: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T09:51:16.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:51:15 smithi086 bash[24289]: cluster 2024-09-16T09:51:14.578202+0000 mgr.a (mgr.14373) 10992 : cluster [DBG] pgmap v7622: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T09:51:16.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:51:15 smithi047 bash[22744]: cluster 2024-09-16T09:51:14.578202+0000 mgr.a (mgr.14373) 10992 : cluster [DBG] pgmap v7622: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T09:51:16.644 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:51:16.644 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:51:16.644 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:51:17.418 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:51:17.419 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:51:17.419 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:51:17.419 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:51:17.419 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:51:18.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:51:17 smithi157 bash[24585]: cluster 2024-09-16T09:51:16.579757+0000 mgr.a (mgr.14373) 10993 : cluster [DBG] pgmap v7623: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 5.6 KiB/s rd, 341 B/s wr, 5 op/s 2024-09-16T09:51:18.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:51:17 smithi086 bash[24289]: cluster 2024-09-16T09:51:16.579757+0000 mgr.a (mgr.14373) 10993 : cluster [DBG] pgmap v7623: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 5.6 KiB/s rd, 341 B/s wr, 5 op/s 2024-09-16T09:51:18.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:51:17 smithi047 bash[22744]: cluster 2024-09-16T09:51:16.579757+0000 mgr.a (mgr.14373) 10993 : cluster [DBG] pgmap v7623: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 5.6 KiB/s rd, 341 B/s wr, 5 op/s 2024-09-16T09:51:19.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:51:18 smithi157 bash[24585]: audit 2024-09-16T09:51:16.983639+0000 mgr.a (mgr.14373) 10994 : audit [DBG] from='client.241515 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:51:19.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:51:18 smithi086 bash[24289]: audit 2024-09-16T09:51:16.983639+0000 mgr.a (mgr.14373) 10994 : audit [DBG] from='client.241515 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:51:19.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:51:18 smithi047 bash[22744]: audit 2024-09-16T09:51:16.983639+0000 mgr.a (mgr.14373) 10994 : audit [DBG] from='client.241515 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:51:20.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:51:19 smithi157 bash[24585]: cluster 2024-09-16T09:51:18.581664+0000 mgr.a (mgr.14373) 10995 : cluster [DBG] pgmap v7624: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 6.2 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T09:51:20.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:51:19 smithi086 bash[24289]: cluster 2024-09-16T09:51:18.581664+0000 mgr.a (mgr.14373) 10995 : cluster [DBG] pgmap v7624: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 6.2 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T09:51:20.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:51:19 smithi047 bash[22744]: cluster 2024-09-16T09:51:18.581664+0000 mgr.a (mgr.14373) 10995 : cluster [DBG] pgmap v7624: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 6.2 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T09:51:22.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:51:21 smithi157 bash[24585]: cluster 2024-09-16T09:51:20.582644+0000 mgr.a (mgr.14373) 10996 : cluster [DBG] pgmap v7625: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T09:51:22.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:51:21 smithi086 bash[24289]: cluster 2024-09-16T09:51:20.582644+0000 mgr.a (mgr.14373) 10996 : cluster [DBG] pgmap v7625: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T09:51:22.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:51:21 smithi047 bash[22744]: cluster 2024-09-16T09:51:20.582644+0000 mgr.a (mgr.14373) 10996 : cluster [DBG] pgmap v7625: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T09:51:22.420 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:51:22.421 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:51:22.421 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:51:23.171 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:51:23.172 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:51:23.172 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:51:23.172 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:51:23.172 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:51:24.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:51:23 smithi157 bash[24585]: cluster 2024-09-16T09:51:22.584201+0000 mgr.a (mgr.14373) 10997 : cluster [DBG] pgmap v7626: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:51:24.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:51:23 smithi157 bash[24585]: audit 2024-09-16T09:51:22.750189+0000 mgr.a (mgr.14373) 10998 : audit [DBG] from='client.241590 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:51:24.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:51:23 smithi086 bash[24289]: cluster 2024-09-16T09:51:22.584201+0000 mgr.a (mgr.14373) 10997 : cluster [DBG] pgmap v7626: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:51:24.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:51:23 smithi086 bash[24289]: audit 2024-09-16T09:51:22.750189+0000 mgr.a (mgr.14373) 10998 : audit [DBG] from='client.241590 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:51:24.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:51:23 smithi047 bash[22744]: cluster 2024-09-16T09:51:22.584201+0000 mgr.a (mgr.14373) 10997 : cluster [DBG] pgmap v7626: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:51:24.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:51:23 smithi047 bash[22744]: audit 2024-09-16T09:51:22.750189+0000 mgr.a (mgr.14373) 10998 : audit [DBG] from='client.241590 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:51:26.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:51:25 smithi157 bash[24585]: cluster 2024-09-16T09:51:24.585080+0000 mgr.a (mgr.14373) 10999 : cluster [DBG] pgmap v7627: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T09:51:26.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:51:25 smithi086 bash[24289]: cluster 2024-09-16T09:51:24.585080+0000 mgr.a (mgr.14373) 10999 : cluster [DBG] pgmap v7627: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T09:51:26.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:51:25 smithi047 bash[22744]: cluster 2024-09-16T09:51:24.585080+0000 mgr.a (mgr.14373) 10999 : cluster [DBG] pgmap v7627: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T09:51:27.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:51:26 smithi086 bash[24289]: cluster 2024-09-16T09:51:26.586948+0000 mgr.a (mgr.14373) 11000 : cluster [DBG] pgmap v7628: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.3 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:51:27.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:51:26 smithi047 bash[22744]: cluster 2024-09-16T09:51:26.586948+0000 mgr.a (mgr.14373) 11000 : cluster [DBG] pgmap v7628: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.3 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:51:27.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:51:26 smithi157 bash[24585]: cluster 2024-09-16T09:51:26.586948+0000 mgr.a (mgr.14373) 11000 : cluster [DBG] pgmap v7628: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.3 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:51:28.173 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:51:28.174 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:51:28.174 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:51:28.925 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:51:28.926 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:51:28.926 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:51:28.926 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:51:28.926 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:51:30.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:51:29 smithi157 bash[24585]: audit 2024-09-16T09:51:28.505294+0000 mgr.a (mgr.14373) 11001 : audit [DBG] from='client.241662 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:51:30.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:51:29 smithi157 bash[24585]: cluster 2024-09-16T09:51:28.587871+0000 mgr.a (mgr.14373) 11002 : cluster [DBG] pgmap v7629: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 3.2 KiB/s rd, 85 B/s wr, 3 op/s 2024-09-16T09:51:30.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:51:29 smithi086 bash[24289]: audit 2024-09-16T09:51:28.505294+0000 mgr.a (mgr.14373) 11001 : audit [DBG] from='client.241662 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:51:30.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:51:29 smithi086 bash[24289]: cluster 2024-09-16T09:51:28.587871+0000 mgr.a (mgr.14373) 11002 : cluster [DBG] pgmap v7629: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 3.2 KiB/s rd, 85 B/s wr, 3 op/s 2024-09-16T09:51:30.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:51:29 smithi047 bash[22744]: audit 2024-09-16T09:51:28.505294+0000 mgr.a (mgr.14373) 11001 : audit [DBG] from='client.241662 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:51:30.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:51:29 smithi047 bash[22744]: cluster 2024-09-16T09:51:28.587871+0000 mgr.a (mgr.14373) 11002 : cluster [DBG] pgmap v7629: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 3.2 KiB/s rd, 85 B/s wr, 3 op/s 2024-09-16T09:51:32.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:51:31 smithi157 bash[24585]: cluster 2024-09-16T09:51:30.588721+0000 mgr.a (mgr.14373) 11003 : cluster [DBG] pgmap v7630: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:51:32.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:51:31 smithi086 bash[24289]: cluster 2024-09-16T09:51:30.588721+0000 mgr.a (mgr.14373) 11003 : cluster [DBG] pgmap v7630: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:51:32.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:51:31 smithi047 bash[22744]: cluster 2024-09-16T09:51:30.588721+0000 mgr.a (mgr.14373) 11003 : cluster [DBG] pgmap v7630: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:51:33.927 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:51:33.928 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:51:33.928 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:51:34.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:51:33 smithi157 bash[24585]: cluster 2024-09-16T09:51:32.590937+0000 mgr.a (mgr.14373) 11004 : cluster [DBG] pgmap v7631: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:51:34.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:51:33 smithi086 bash[24289]: cluster 2024-09-16T09:51:32.590937+0000 mgr.a (mgr.14373) 11004 : cluster [DBG] pgmap v7631: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:51:34.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:51:33 smithi047 bash[22744]: cluster 2024-09-16T09:51:32.590937+0000 mgr.a (mgr.14373) 11004 : cluster [DBG] pgmap v7631: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:51:34.682 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:51:34.682 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:51:34.683 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:51:34.683 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:51:34.683 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:51:36.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:51:35 smithi157 bash[24585]: audit 2024-09-16T09:51:34.255412+0000 mgr.a (mgr.14373) 11005 : audit [DBG] from='client.241740 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:51:36.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:51:35 smithi157 bash[24585]: cluster 2024-09-16T09:51:34.591452+0000 mgr.a (mgr.14373) 11006 : cluster [DBG] pgmap v7632: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:51:36.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:51:35 smithi086 bash[24289]: audit 2024-09-16T09:51:34.255412+0000 mgr.a (mgr.14373) 11005 : audit [DBG] from='client.241740 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:51:36.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:51:35 smithi086 bash[24289]: cluster 2024-09-16T09:51:34.591452+0000 mgr.a (mgr.14373) 11006 : cluster [DBG] pgmap v7632: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:51:36.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:51:35 smithi047 bash[22744]: audit 2024-09-16T09:51:34.255412+0000 mgr.a (mgr.14373) 11005 : audit [DBG] from='client.241740 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:51:36.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:51:35 smithi047 bash[22744]: cluster 2024-09-16T09:51:34.591452+0000 mgr.a (mgr.14373) 11006 : cluster [DBG] pgmap v7632: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:51:38.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:51:37 smithi157 bash[24585]: cluster 2024-09-16T09:51:36.593115+0000 mgr.a (mgr.14373) 11007 : cluster [DBG] pgmap v7633: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:51:38.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:51:37 smithi086 bash[24289]: cluster 2024-09-16T09:51:36.593115+0000 mgr.a (mgr.14373) 11007 : cluster [DBG] pgmap v7633: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:51:38.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:51:37 smithi047 bash[22744]: cluster 2024-09-16T09:51:36.593115+0000 mgr.a (mgr.14373) 11007 : cluster [DBG] pgmap v7633: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:51:39.684 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:51:39.685 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:51:39.685 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:51:40.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:51:39 smithi157 bash[24585]: cluster 2024-09-16T09:51:38.594402+0000 mgr.a (mgr.14373) 11008 : cluster [DBG] pgmap v7634: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-16T09:51:40.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:51:39 smithi086 bash[24289]: cluster 2024-09-16T09:51:38.594402+0000 mgr.a (mgr.14373) 11008 : cluster [DBG] pgmap v7634: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-16T09:51:40.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:51:39 smithi047 bash[22744]: cluster 2024-09-16T09:51:38.594402+0000 mgr.a (mgr.14373) 11008 : cluster [DBG] pgmap v7634: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-16T09:51:40.466 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:51:40.467 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:51:40.467 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:51:40.467 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:51:40.467 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:51:42.074 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:51:41 smithi086 bash[24289]: audit 2024-09-16T09:51:40.020814+0000 mgr.a (mgr.14373) 11009 : audit [DBG] from='client.241818 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:51:42.074 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:51:41 smithi086 bash[24289]: cluster 2024-09-16T09:51:40.595264+0000 mgr.a (mgr.14373) 11010 : cluster [DBG] pgmap v7635: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:51:42.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:51:41 smithi047 bash[22744]: audit 2024-09-16T09:51:40.020814+0000 mgr.a (mgr.14373) 11009 : audit [DBG] from='client.241818 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:51:42.094 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:51:41 smithi047 bash[22744]: cluster 2024-09-16T09:51:40.595264+0000 mgr.a (mgr.14373) 11010 : cluster [DBG] pgmap v7635: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:51:42.261 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:51:41 smithi157 bash[24585]: audit 2024-09-16T09:51:40.020814+0000 mgr.a (mgr.14373) 11009 : audit [DBG] from='client.241818 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:51:42.261 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:51:41 smithi157 bash[24585]: cluster 2024-09-16T09:51:40.595264+0000 mgr.a (mgr.14373) 11010 : cluster [DBG] pgmap v7635: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:51:44.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:51:43 smithi157 bash[24585]: cluster 2024-09-16T09:51:42.597402+0000 mgr.a (mgr.14373) 11011 : cluster [DBG] pgmap v7636: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:51:44.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:51:43 smithi086 bash[24289]: cluster 2024-09-16T09:51:42.597402+0000 mgr.a (mgr.14373) 11011 : cluster [DBG] pgmap v7636: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:51:44.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:51:43 smithi047 bash[22744]: cluster 2024-09-16T09:51:42.597402+0000 mgr.a (mgr.14373) 11011 : cluster [DBG] pgmap v7636: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:51:45.468 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:51:45.469 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:51:45.469 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:51:46.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:51:45 smithi157 bash[24585]: cluster 2024-09-16T09:51:44.598163+0000 mgr.a (mgr.14373) 11012 : cluster [DBG] pgmap v7637: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:51:46.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:51:45 smithi086 bash[24289]: cluster 2024-09-16T09:51:44.598163+0000 mgr.a (mgr.14373) 11012 : cluster [DBG] pgmap v7637: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:51:46.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:51:45 smithi047 bash[22744]: cluster 2024-09-16T09:51:44.598163+0000 mgr.a (mgr.14373) 11012 : cluster [DBG] pgmap v7637: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:51:46.237 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:51:46.238 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:51:46.238 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:51:46.238 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:51:46.238 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:51:47.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:51:46 smithi157 bash[24585]: audit 2024-09-16T09:51:45.800581+0000 mgr.a (mgr.14373) 11013 : audit [DBG] from='client.241896 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:51:47.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:51:46 smithi086 bash[24289]: audit 2024-09-16T09:51:45.800581+0000 mgr.a (mgr.14373) 11013 : audit [DBG] from='client.241896 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:51:47.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:51:46 smithi047 bash[22744]: audit 2024-09-16T09:51:45.800581+0000 mgr.a (mgr.14373) 11013 : audit [DBG] from='client.241896 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:51:48.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:51:47 smithi157 bash[24585]: cluster 2024-09-16T09:51:46.599938+0000 mgr.a (mgr.14373) 11014 : cluster [DBG] pgmap v7638: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:51:48.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:51:47 smithi086 bash[24289]: cluster 2024-09-16T09:51:46.599938+0000 mgr.a (mgr.14373) 11014 : cluster [DBG] pgmap v7638: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:51:48.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:51:47 smithi047 bash[22744]: cluster 2024-09-16T09:51:46.599938+0000 mgr.a (mgr.14373) 11014 : cluster [DBG] pgmap v7638: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:51:50.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:51:49 smithi157 bash[24585]: cluster 2024-09-16T09:51:48.601188+0000 mgr.a (mgr.14373) 11015 : cluster [DBG] pgmap v7639: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-16T09:51:50.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:51:49 smithi086 bash[24289]: cluster 2024-09-16T09:51:48.601188+0000 mgr.a (mgr.14373) 11015 : cluster [DBG] pgmap v7639: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-16T09:51:50.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:51:49 smithi047 bash[22744]: cluster 2024-09-16T09:51:48.601188+0000 mgr.a (mgr.14373) 11015 : cluster [DBG] pgmap v7639: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-16T09:51:51.239 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:51:51.239 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:51:51.240 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:51:51.991 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:51:51.991 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:51:51.991 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:51:51.991 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:51:51.991 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:51:52.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:51:51 smithi157 bash[24585]: cluster 2024-09-16T09:51:50.601972+0000 mgr.a (mgr.14373) 11016 : cluster [DBG] pgmap v7640: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:51:52.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:51:51 smithi086 bash[24289]: cluster 2024-09-16T09:51:50.601972+0000 mgr.a (mgr.14373) 11016 : cluster [DBG] pgmap v7640: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:51:52.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:51:51 smithi047 bash[22744]: cluster 2024-09-16T09:51:50.601972+0000 mgr.a (mgr.14373) 11016 : cluster [DBG] pgmap v7640: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:51:53.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:51:52 smithi157 bash[24585]: audit 2024-09-16T09:51:51.568867+0000 mgr.a (mgr.14373) 11017 : audit [DBG] from='client.241974 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:51:53.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:51:52 smithi086 bash[24289]: audit 2024-09-16T09:51:51.568867+0000 mgr.a (mgr.14373) 11017 : audit [DBG] from='client.241974 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:51:53.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:51:52 smithi047 bash[22744]: audit 2024-09-16T09:51:51.568867+0000 mgr.a (mgr.14373) 11017 : audit [DBG] from='client.241974 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:51:54.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:51:53 smithi157 bash[24585]: cluster 2024-09-16T09:51:52.604702+0000 mgr.a (mgr.14373) 11018 : cluster [DBG] pgmap v7641: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-16T09:51:54.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:51:53 smithi086 bash[24289]: cluster 2024-09-16T09:51:52.604702+0000 mgr.a (mgr.14373) 11018 : cluster [DBG] pgmap v7641: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-16T09:51:54.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:51:53 smithi047 bash[22744]: cluster 2024-09-16T09:51:52.604702+0000 mgr.a (mgr.14373) 11018 : cluster [DBG] pgmap v7641: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-16T09:51:56.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:51:55 smithi157 bash[24585]: cluster 2024-09-16T09:51:54.605452+0000 mgr.a (mgr.14373) 11019 : cluster [DBG] pgmap v7642: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-16T09:51:56.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:51:55 smithi086 bash[24289]: cluster 2024-09-16T09:51:54.605452+0000 mgr.a (mgr.14373) 11019 : cluster [DBG] pgmap v7642: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-16T09:51:56.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:51:55 smithi047 bash[22744]: cluster 2024-09-16T09:51:54.605452+0000 mgr.a (mgr.14373) 11019 : cluster [DBG] pgmap v7642: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-16T09:51:56.992 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:51:56.993 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:51:56.993 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:51:57.777 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:51:57.777 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:51:57.778 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:51:57.778 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:51:57.778 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:51:58.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:51:57 smithi157 bash[24585]: cluster 2024-09-16T09:51:56.607115+0000 mgr.a (mgr.14373) 11020 : cluster [DBG] pgmap v7643: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:51:58.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:51:57 smithi086 bash[24289]: cluster 2024-09-16T09:51:56.607115+0000 mgr.a (mgr.14373) 11020 : cluster [DBG] pgmap v7643: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:51:58.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:51:57 smithi047 bash[22744]: cluster 2024-09-16T09:51:56.607115+0000 mgr.a (mgr.14373) 11020 : cluster [DBG] pgmap v7643: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:51:59.058 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:51:58 smithi157 bash[24585]: audit 2024-09-16T09:51:57.324945+0000 mgr.a (mgr.14373) 11021 : audit [DBG] from='client.242049 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:51:59.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:51:58 smithi086 bash[24289]: audit 2024-09-16T09:51:57.324945+0000 mgr.a (mgr.14373) 11021 : audit [DBG] from='client.242049 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:51:59.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:51:58 smithi047 bash[22744]: audit 2024-09-16T09:51:57.324945+0000 mgr.a (mgr.14373) 11021 : audit [DBG] from='client.242049 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:52:00.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:51:59 smithi157 bash[24585]: cluster 2024-09-16T09:51:58.608810+0000 mgr.a (mgr.14373) 11022 : cluster [DBG] pgmap v7644: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-16T09:52:00.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:51:59 smithi086 bash[24289]: cluster 2024-09-16T09:51:58.608810+0000 mgr.a (mgr.14373) 11022 : cluster [DBG] pgmap v7644: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-16T09:52:00.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:51:59 smithi047 bash[22744]: cluster 2024-09-16T09:51:58.608810+0000 mgr.a (mgr.14373) 11022 : cluster [DBG] pgmap v7644: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-16T09:52:02.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:52:01 smithi157 bash[24585]: cluster 2024-09-16T09:52:00.609587+0000 mgr.a (mgr.14373) 11023 : cluster [DBG] pgmap v7645: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:52:02.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:52:01 smithi086 bash[24289]: cluster 2024-09-16T09:52:00.609587+0000 mgr.a (mgr.14373) 11023 : cluster [DBG] pgmap v7645: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:52:02.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:52:01 smithi047 bash[22744]: cluster 2024-09-16T09:52:00.609587+0000 mgr.a (mgr.14373) 11023 : cluster [DBG] pgmap v7645: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:52:02.778 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:52:02.780 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:52:02.780 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:52:03.559 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:52:03.559 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:52:03.559 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:52:03.559 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:52:03.559 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:52:04.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:52:03 smithi157 bash[24585]: cluster 2024-09-16T09:52:02.611695+0000 mgr.a (mgr.14373) 11024 : cluster [DBG] pgmap v7646: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:52:04.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:52:03 smithi086 bash[24289]: cluster 2024-09-16T09:52:02.611695+0000 mgr.a (mgr.14373) 11024 : cluster [DBG] pgmap v7646: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:52:04.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:52:03 smithi047 bash[22744]: cluster 2024-09-16T09:52:02.611695+0000 mgr.a (mgr.14373) 11024 : cluster [DBG] pgmap v7646: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:52:05.060 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:52:04 smithi157 bash[24585]: audit 2024-09-16T09:52:03.111227+0000 mgr.a (mgr.14373) 11025 : audit [DBG] from='client.242121 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:52:05.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:52:04 smithi086 bash[24289]: audit 2024-09-16T09:52:03.111227+0000 mgr.a (mgr.14373) 11025 : audit [DBG] from='client.242121 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:52:05.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:52:04 smithi047 bash[22744]: audit 2024-09-16T09:52:03.111227+0000 mgr.a (mgr.14373) 11025 : audit [DBG] from='client.242121 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:52:06.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:52:05 smithi157 bash[24585]: cluster 2024-09-16T09:52:04.612682+0000 mgr.a (mgr.14373) 11026 : cluster [DBG] pgmap v7647: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-16T09:52:06.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:52:05 smithi086 bash[24289]: cluster 2024-09-16T09:52:04.612682+0000 mgr.a (mgr.14373) 11026 : cluster [DBG] pgmap v7647: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-16T09:52:06.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:52:05 smithi047 bash[22744]: cluster 2024-09-16T09:52:04.612682+0000 mgr.a (mgr.14373) 11026 : cluster [DBG] pgmap v7647: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-16T09:52:08.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:52:07 smithi157 bash[24585]: cluster 2024-09-16T09:52:06.614476+0000 mgr.a (mgr.14373) 11027 : cluster [DBG] pgmap v7648: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-09-16T09:52:08.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:52:07 smithi086 bash[24289]: cluster 2024-09-16T09:52:06.614476+0000 mgr.a (mgr.14373) 11027 : cluster [DBG] pgmap v7648: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-09-16T09:52:08.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:52:07 smithi047 bash[22744]: cluster 2024-09-16T09:52:06.614476+0000 mgr.a (mgr.14373) 11027 : cluster [DBG] pgmap v7648: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-09-16T09:52:08.560 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:52:08.561 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:52:08.561 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:52:09.329 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:52:09.329 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:52:09.329 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:52:09.329 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:52:09.330 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:52:10.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:52:09 smithi157 bash[24585]: cluster 2024-09-16T09:52:08.615383+0000 mgr.a (mgr.14373) 11028 : cluster [DBG] pgmap v7649: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:52:10.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:52:09 smithi086 bash[24289]: cluster 2024-09-16T09:52:08.615383+0000 mgr.a (mgr.14373) 11028 : cluster [DBG] pgmap v7649: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:52:10.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:52:09 smithi047 bash[22744]: cluster 2024-09-16T09:52:08.615383+0000 mgr.a (mgr.14373) 11028 : cluster [DBG] pgmap v7649: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:52:11.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:52:10 smithi157 bash[24585]: audit 2024-09-16T09:52:08.896204+0000 mgr.a (mgr.14373) 11029 : audit [DBG] from='client.242199 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:52:11.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:52:10 smithi086 bash[24289]: audit 2024-09-16T09:52:08.896204+0000 mgr.a (mgr.14373) 11029 : audit [DBG] from='client.242199 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:52:11.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:52:10 smithi047 bash[22744]: audit 2024-09-16T09:52:08.896204+0000 mgr.a (mgr.14373) 11029 : audit [DBG] from='client.242199 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:52:12.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:52:11 smithi157 bash[24585]: cluster 2024-09-16T09:52:10.616327+0000 mgr.a (mgr.14373) 11030 : cluster [DBG] pgmap v7650: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:52:12.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:52:11 smithi086 bash[24289]: cluster 2024-09-16T09:52:10.616327+0000 mgr.a (mgr.14373) 11030 : cluster [DBG] pgmap v7650: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:52:12.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:52:11 smithi047 bash[22744]: cluster 2024-09-16T09:52:10.616327+0000 mgr.a (mgr.14373) 11030 : cluster [DBG] pgmap v7650: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:52:13.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:52:12 smithi157 bash[24585]: audit 2024-09-16T09:52:12.388083+0000 mon.b (mon.2) 1018 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T09:52:13.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:52:12 smithi086 bash[24289]: audit 2024-09-16T09:52:12.388083+0000 mon.b (mon.2) 1018 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T09:52:13.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:52:12 smithi047 bash[22744]: audit 2024-09-16T09:52:12.388083+0000 mon.b (mon.2) 1018 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T09:52:14.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:52:13 smithi157 bash[24585]: cluster 2024-09-16T09:52:12.618528+0000 mgr.a (mgr.14373) 11031 : cluster [DBG] pgmap v7651: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:52:14.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:52:13 smithi157 bash[24585]: audit 2024-09-16T09:52:13.243458+0000 mon.b (mon.2) 1019 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:52:14.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:52:13 smithi157 bash[24585]: audit 2024-09-16T09:52:13.245682+0000 mon.b (mon.2) 1020 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T09:52:14.058 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:52:13 smithi157 bash[24585]: audit 2024-09-16T09:52:13.257486+0000 mon.a (mon.0) 1230 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:52:14.058 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:52:13 smithi157 bash[24585]: audit 2024-09-16T09:52:13.263267+0000 mon.b (mon.2) 1021 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:52:14.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:52:13 smithi086 bash[24289]: cluster 2024-09-16T09:52:12.618528+0000 mgr.a (mgr.14373) 11031 : cluster [DBG] pgmap v7651: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:52:14.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:52:13 smithi086 bash[24289]: audit 2024-09-16T09:52:13.243458+0000 mon.b (mon.2) 1019 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:52:14.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:52:13 smithi086 bash[24289]: audit 2024-09-16T09:52:13.245682+0000 mon.b (mon.2) 1020 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T09:52:14.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:52:13 smithi086 bash[24289]: audit 2024-09-16T09:52:13.257486+0000 mon.a (mon.0) 1230 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:52:14.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:52:13 smithi086 bash[24289]: audit 2024-09-16T09:52:13.263267+0000 mon.b (mon.2) 1021 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:52:14.092 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 09:52:14 smithi047 bash[22994]: debug 2024-09-16T09:52:14.016+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T09:52:14.092 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 09:52:14 smithi047 bash[22994]: debug 2024-09-16T09:52:14.020+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T09:52:14.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:52:13 smithi047 bash[22744]: cluster 2024-09-16T09:52:12.618528+0000 mgr.a (mgr.14373) 11031 : cluster [DBG] pgmap v7651: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:52:14.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:52:13 smithi047 bash[22744]: audit 2024-09-16T09:52:13.243458+0000 mon.b (mon.2) 1019 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:52:14.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:52:13 smithi047 bash[22744]: audit 2024-09-16T09:52:13.245682+0000 mon.b (mon.2) 1020 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T09:52:14.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:52:13 smithi047 bash[22744]: audit 2024-09-16T09:52:13.257486+0000 mon.a (mon.0) 1230 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:52:14.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:52:13 smithi047 bash[22744]: audit 2024-09-16T09:52:13.263267+0000 mon.b (mon.2) 1021 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:52:14.330 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:52:14.331 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:52:14.331 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:52:15.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:52:14 smithi157 bash[24585]: audit 2024-09-16T09:52:13.265714+0000 mgr.a (mgr.14373) 11032 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:52:15.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:52:14 smithi086 bash[24289]: audit 2024-09-16T09:52:13.265714+0000 mgr.a (mgr.14373) 11032 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:52:15.089 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:52:15.090 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:52:15.090 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:52:15.090 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:52:15.090 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:52:15.091 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:52:14 smithi047 bash[22744]: audit 2024-09-16T09:52:13.265714+0000 mgr.a (mgr.14373) 11032 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:52:16.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:52:15 smithi157 bash[24585]: audit 2024-09-16T09:52:14.020169+0000 mgr.a (mgr.14373) 11033 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T09:52:16.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:52:15 smithi157 bash[24585]: cephadm 2024-09-16T09:52:14.022501+0000 mgr.a (mgr.14373) 11034 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T09:52:16.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:52:15 smithi157 bash[24585]: cluster 2024-09-16T09:52:14.619479+0000 mgr.a (mgr.14373) 11035 : cluster [DBG] pgmap v7652: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:52:16.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:52:15 smithi157 bash[24585]: audit 2024-09-16T09:52:14.664835+0000 mgr.a (mgr.14373) 11036 : audit [DBG] from='client.242379 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:52:16.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:52:15 smithi086 bash[24289]: audit 2024-09-16T09:52:14.020169+0000 mgr.a (mgr.14373) 11033 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T09:52:16.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:52:15 smithi086 bash[24289]: cephadm 2024-09-16T09:52:14.022501+0000 mgr.a (mgr.14373) 11034 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T09:52:16.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:52:15 smithi086 bash[24289]: cluster 2024-09-16T09:52:14.619479+0000 mgr.a (mgr.14373) 11035 : cluster [DBG] pgmap v7652: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:52:16.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:52:15 smithi086 bash[24289]: audit 2024-09-16T09:52:14.664835+0000 mgr.a (mgr.14373) 11036 : audit [DBG] from='client.242379 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:52:16.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:52:15 smithi047 bash[22744]: audit 2024-09-16T09:52:14.020169+0000 mgr.a (mgr.14373) 11033 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T09:52:16.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:52:15 smithi047 bash[22744]: cephadm 2024-09-16T09:52:14.022501+0000 mgr.a (mgr.14373) 11034 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T09:52:16.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:52:15 smithi047 bash[22744]: cluster 2024-09-16T09:52:14.619479+0000 mgr.a (mgr.14373) 11035 : cluster [DBG] pgmap v7652: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:52:16.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:52:15 smithi047 bash[22744]: audit 2024-09-16T09:52:14.664835+0000 mgr.a (mgr.14373) 11036 : audit [DBG] from='client.242379 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:52:18.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:52:17 smithi157 bash[24585]: cluster 2024-09-16T09:52:16.621379+0000 mgr.a (mgr.14373) 11037 : cluster [DBG] pgmap v7653: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 6.4 KiB/s rd, 341 B/s wr, 6 op/s 2024-09-16T09:52:18.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:52:17 smithi086 bash[24289]: cluster 2024-09-16T09:52:16.621379+0000 mgr.a (mgr.14373) 11037 : cluster [DBG] pgmap v7653: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 6.4 KiB/s rd, 341 B/s wr, 6 op/s 2024-09-16T09:52:18.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:52:17 smithi047 bash[22744]: cluster 2024-09-16T09:52:16.621379+0000 mgr.a (mgr.14373) 11037 : cluster [DBG] pgmap v7653: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 6.4 KiB/s rd, 341 B/s wr, 6 op/s 2024-09-16T09:52:20.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:52:19 smithi157 bash[24585]: cluster 2024-09-16T09:52:18.622682+0000 mgr.a (mgr.14373) 11038 : cluster [DBG] pgmap v7654: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.1 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:52:20.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:52:19 smithi086 bash[24289]: cluster 2024-09-16T09:52:18.622682+0000 mgr.a (mgr.14373) 11038 : cluster [DBG] pgmap v7654: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.1 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:52:20.091 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:52:20.091 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:52:19 smithi047 bash[22744]: cluster 2024-09-16T09:52:18.622682+0000 mgr.a (mgr.14373) 11038 : cluster [DBG] pgmap v7654: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.1 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:52:20.092 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:52:20.092 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:52:20.861 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:52:20.862 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:52:20.862 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:52:20.862 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:52:20.862 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:52:22.060 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:52:21 smithi157 bash[24585]: audit 2024-09-16T09:52:20.425773+0000 mgr.a (mgr.14373) 11039 : audit [DBG] from='client.242457 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:52:22.060 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:52:21 smithi157 bash[24585]: cluster 2024-09-16T09:52:20.623306+0000 mgr.a (mgr.14373) 11040 : cluster [DBG] pgmap v7655: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:52:22.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:52:21 smithi086 bash[24289]: audit 2024-09-16T09:52:20.425773+0000 mgr.a (mgr.14373) 11039 : audit [DBG] from='client.242457 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:52:22.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:52:21 smithi086 bash[24289]: cluster 2024-09-16T09:52:20.623306+0000 mgr.a (mgr.14373) 11040 : cluster [DBG] pgmap v7655: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:52:22.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:52:21 smithi047 bash[22744]: audit 2024-09-16T09:52:20.425773+0000 mgr.a (mgr.14373) 11039 : audit [DBG] from='client.242457 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:52:22.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:52:21 smithi047 bash[22744]: cluster 2024-09-16T09:52:20.623306+0000 mgr.a (mgr.14373) 11040 : cluster [DBG] pgmap v7655: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:52:24.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:52:23 smithi157 bash[24585]: cluster 2024-09-16T09:52:22.625620+0000 mgr.a (mgr.14373) 11041 : cluster [DBG] pgmap v7656: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:52:24.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:52:23 smithi086 bash[24289]: cluster 2024-09-16T09:52:22.625620+0000 mgr.a (mgr.14373) 11041 : cluster [DBG] pgmap v7656: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:52:24.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:52:23 smithi047 bash[22744]: cluster 2024-09-16T09:52:22.625620+0000 mgr.a (mgr.14373) 11041 : cluster [DBG] pgmap v7656: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:52:25.863 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:52:25.864 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:52:25.864 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:52:26.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:52:25 smithi086 bash[24289]: cluster 2024-09-16T09:52:24.626430+0000 mgr.a (mgr.14373) 11042 : cluster [DBG] pgmap v7657: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:52:26.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:52:25 smithi047 bash[22744]: cluster 2024-09-16T09:52:24.626430+0000 mgr.a (mgr.14373) 11042 : cluster [DBG] pgmap v7657: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:52:26.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:52:25 smithi157 bash[24585]: cluster 2024-09-16T09:52:24.626430+0000 mgr.a (mgr.14373) 11042 : cluster [DBG] pgmap v7657: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:52:26.599 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:52:26.600 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:52:26.600 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:52:26.600 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:52:26.600 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:52:28.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:52:27 smithi086 bash[24289]: audit 2024-09-16T09:52:26.187032+0000 mgr.a (mgr.14373) 11043 : audit [DBG] from='client.242532 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:52:28.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:52:27 smithi086 bash[24289]: cluster 2024-09-16T09:52:26.627348+0000 mgr.a (mgr.14373) 11044 : cluster [DBG] pgmap v7658: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.8 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:52:28.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:52:27 smithi047 bash[22744]: audit 2024-09-16T09:52:26.187032+0000 mgr.a (mgr.14373) 11043 : audit [DBG] from='client.242532 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:52:28.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:52:27 smithi047 bash[22744]: cluster 2024-09-16T09:52:26.627348+0000 mgr.a (mgr.14373) 11044 : cluster [DBG] pgmap v7658: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.8 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:52:28.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:52:27 smithi157 bash[24585]: audit 2024-09-16T09:52:26.187032+0000 mgr.a (mgr.14373) 11043 : audit [DBG] from='client.242532 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:52:28.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:52:27 smithi157 bash[24585]: cluster 2024-09-16T09:52:26.627348+0000 mgr.a (mgr.14373) 11044 : cluster [DBG] pgmap v7658: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.8 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:52:30.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:52:29 smithi086 bash[24289]: cluster 2024-09-16T09:52:28.628558+0000 mgr.a (mgr.14373) 11045 : cluster [DBG] pgmap v7659: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 3.3 KiB/s rd, 85 B/s wr, 3 op/s 2024-09-16T09:52:30.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:52:29 smithi047 bash[22744]: cluster 2024-09-16T09:52:28.628558+0000 mgr.a (mgr.14373) 11045 : cluster [DBG] pgmap v7659: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 3.3 KiB/s rd, 85 B/s wr, 3 op/s 2024-09-16T09:52:30.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:52:29 smithi157 bash[24585]: cluster 2024-09-16T09:52:28.628558+0000 mgr.a (mgr.14373) 11045 : cluster [DBG] pgmap v7659: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 3.3 KiB/s rd, 85 B/s wr, 3 op/s 2024-09-16T09:52:31.601 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:52:31.601 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:52:31.602 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:52:32.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:52:31 smithi047 bash[22744]: cluster 2024-09-16T09:52:30.629322+0000 mgr.a (mgr.14373) 11046 : cluster [DBG] pgmap v7660: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:52:32.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:52:31 smithi157 bash[24585]: cluster 2024-09-16T09:52:30.629322+0000 mgr.a (mgr.14373) 11046 : cluster [DBG] pgmap v7660: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:52:32.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:52:31 smithi086 bash[24289]: cluster 2024-09-16T09:52:30.629322+0000 mgr.a (mgr.14373) 11046 : cluster [DBG] pgmap v7660: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:52:32.350 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:52:32.351 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:52:32.351 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:52:32.351 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:52:32.351 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:52:34.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:52:33 smithi047 bash[22744]: audit 2024-09-16T09:52:31.931455+0000 mgr.a (mgr.14373) 11047 : audit [DBG] from='client.242607 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:52:34.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:52:33 smithi047 bash[22744]: cluster 2024-09-16T09:52:32.632057+0000 mgr.a (mgr.14373) 11048 : cluster [DBG] pgmap v7661: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:52:34.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:52:33 smithi157 bash[24585]: audit 2024-09-16T09:52:31.931455+0000 mgr.a (mgr.14373) 11047 : audit [DBG] from='client.242607 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:52:34.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:52:33 smithi157 bash[24585]: cluster 2024-09-16T09:52:32.632057+0000 mgr.a (mgr.14373) 11048 : cluster [DBG] pgmap v7661: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:52:34.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:52:33 smithi086 bash[24289]: audit 2024-09-16T09:52:31.931455+0000 mgr.a (mgr.14373) 11047 : audit [DBG] from='client.242607 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:52:34.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:52:33 smithi086 bash[24289]: cluster 2024-09-16T09:52:32.632057+0000 mgr.a (mgr.14373) 11048 : cluster [DBG] pgmap v7661: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:52:35.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:52:34 smithi157 bash[24585]: cluster 2024-09-16T09:52:34.632836+0000 mgr.a (mgr.14373) 11049 : cluster [DBG] pgmap v7662: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:52:35.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:52:34 smithi086 bash[24289]: cluster 2024-09-16T09:52:34.632836+0000 mgr.a (mgr.14373) 11049 : cluster [DBG] pgmap v7662: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:52:35.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:52:34 smithi047 bash[22744]: cluster 2024-09-16T09:52:34.632836+0000 mgr.a (mgr.14373) 11049 : cluster [DBG] pgmap v7662: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:52:37.352 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:52:37.353 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:52:37.353 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:52:38.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:52:37 smithi157 bash[24585]: cluster 2024-09-16T09:52:36.634427+0000 mgr.a (mgr.14373) 11050 : cluster [DBG] pgmap v7663: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-16T09:52:38.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:52:37 smithi086 bash[24289]: cluster 2024-09-16T09:52:36.634427+0000 mgr.a (mgr.14373) 11050 : cluster [DBG] pgmap v7663: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-16T09:52:38.091 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:52:37 smithi047 bash[22744]: cluster 2024-09-16T09:52:36.634427+0000 mgr.a (mgr.14373) 11050 : cluster [DBG] pgmap v7663: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-16T09:52:38.120 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:52:38.120 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:52:38.120 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:52:38.120 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:52:38.120 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:52:39.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:52:38 smithi157 bash[24585]: audit 2024-09-16T09:52:37.688852+0000 mgr.a (mgr.14373) 11051 : audit [DBG] from='client.242685 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:52:39.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:52:38 smithi086 bash[24289]: audit 2024-09-16T09:52:37.688852+0000 mgr.a (mgr.14373) 11051 : audit [DBG] from='client.242685 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:52:39.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:52:38 smithi047 bash[22744]: audit 2024-09-16T09:52:37.688852+0000 mgr.a (mgr.14373) 11051 : audit [DBG] from='client.242685 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:52:40.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:52:39 smithi157 bash[24585]: cluster 2024-09-16T09:52:38.636189+0000 mgr.a (mgr.14373) 11052 : cluster [DBG] pgmap v7664: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-16T09:52:40.072 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:52:39 smithi086 bash[24289]: cluster 2024-09-16T09:52:38.636189+0000 mgr.a (mgr.14373) 11052 : cluster [DBG] pgmap v7664: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-16T09:52:40.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:52:39 smithi047 bash[22744]: cluster 2024-09-16T09:52:38.636189+0000 mgr.a (mgr.14373) 11052 : cluster [DBG] pgmap v7664: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-16T09:52:42.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:52:41 smithi157 bash[24585]: cluster 2024-09-16T09:52:40.636998+0000 mgr.a (mgr.14373) 11053 : cluster [DBG] pgmap v7665: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:52:42.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:52:41 smithi086 bash[24289]: cluster 2024-09-16T09:52:40.636998+0000 mgr.a (mgr.14373) 11053 : cluster [DBG] pgmap v7665: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:52:42.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:52:41 smithi047 bash[22744]: cluster 2024-09-16T09:52:40.636998+0000 mgr.a (mgr.14373) 11053 : cluster [DBG] pgmap v7665: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:52:43.122 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:52:43.122 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:52:43.122 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:52:43.890 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:52:43.890 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:52:43.890 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:52:43.890 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:52:43.890 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:52:44.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:52:43 smithi157 bash[24585]: cluster 2024-09-16T09:52:42.639129+0000 mgr.a (mgr.14373) 11054 : cluster [DBG] pgmap v7666: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:52:44.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:52:43 smithi086 bash[24289]: cluster 2024-09-16T09:52:42.639129+0000 mgr.a (mgr.14373) 11054 : cluster [DBG] pgmap v7666: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:52:44.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:52:43 smithi047 bash[22744]: cluster 2024-09-16T09:52:42.639129+0000 mgr.a (mgr.14373) 11054 : cluster [DBG] pgmap v7666: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:52:45.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:52:44 smithi157 bash[24585]: audit 2024-09-16T09:52:43.455056+0000 mgr.a (mgr.14373) 11055 : audit [DBG] from='client.242760 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:52:45.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:52:44 smithi086 bash[24289]: audit 2024-09-16T09:52:43.455056+0000 mgr.a (mgr.14373) 11055 : audit [DBG] from='client.242760 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:52:45.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:52:44 smithi047 bash[22744]: audit 2024-09-16T09:52:43.455056+0000 mgr.a (mgr.14373) 11055 : audit [DBG] from='client.242760 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:52:46.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:52:45 smithi157 bash[24585]: cluster 2024-09-16T09:52:44.640191+0000 mgr.a (mgr.14373) 11056 : cluster [DBG] pgmap v7667: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:52:46.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:52:45 smithi086 bash[24289]: cluster 2024-09-16T09:52:44.640191+0000 mgr.a (mgr.14373) 11056 : cluster [DBG] pgmap v7667: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:52:46.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:52:45 smithi047 bash[22744]: cluster 2024-09-16T09:52:44.640191+0000 mgr.a (mgr.14373) 11056 : cluster [DBG] pgmap v7667: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:52:48.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:52:47 smithi157 bash[24585]: cluster 2024-09-16T09:52:46.642382+0000 mgr.a (mgr.14373) 11057 : cluster [DBG] pgmap v7668: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:52:48.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:52:47 smithi086 bash[24289]: cluster 2024-09-16T09:52:46.642382+0000 mgr.a (mgr.14373) 11057 : cluster [DBG] pgmap v7668: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:52:48.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:52:47 smithi047 bash[22744]: cluster 2024-09-16T09:52:46.642382+0000 mgr.a (mgr.14373) 11057 : cluster [DBG] pgmap v7668: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:52:48.892 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:52:48.892 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:52:48.892 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:52:49.680 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:52:49.680 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:52:49.680 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:52:49.681 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:52:49.681 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:52:50.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:52:49 smithi157 bash[24585]: cluster 2024-09-16T09:52:48.643142+0000 mgr.a (mgr.14373) 11058 : cluster [DBG] pgmap v7669: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-16T09:52:50.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:52:49 smithi086 bash[24289]: cluster 2024-09-16T09:52:48.643142+0000 mgr.a (mgr.14373) 11058 : cluster [DBG] pgmap v7669: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-16T09:52:50.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:52:49 smithi047 bash[22744]: cluster 2024-09-16T09:52:48.643142+0000 mgr.a (mgr.14373) 11058 : cluster [DBG] pgmap v7669: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-16T09:52:51.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:52:50 smithi157 bash[24585]: audit 2024-09-16T09:52:49.230249+0000 mgr.a (mgr.14373) 11059 : audit [DBG] from='client.242835 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:52:51.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:52:50 smithi086 bash[24289]: audit 2024-09-16T09:52:49.230249+0000 mgr.a (mgr.14373) 11059 : audit [DBG] from='client.242835 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:52:51.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:52:50 smithi047 bash[22744]: audit 2024-09-16T09:52:49.230249+0000 mgr.a (mgr.14373) 11059 : audit [DBG] from='client.242835 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:52:52.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:52:51 smithi157 bash[24585]: cluster 2024-09-16T09:52:50.644147+0000 mgr.a (mgr.14373) 11060 : cluster [DBG] pgmap v7670: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:52:52.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:52:51 smithi086 bash[24289]: cluster 2024-09-16T09:52:50.644147+0000 mgr.a (mgr.14373) 11060 : cluster [DBG] pgmap v7670: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:52:52.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:52:51 smithi047 bash[22744]: cluster 2024-09-16T09:52:50.644147+0000 mgr.a (mgr.14373) 11060 : cluster [DBG] pgmap v7670: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:52:54.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:52:53 smithi157 bash[24585]: cluster 2024-09-16T09:52:52.647057+0000 mgr.a (mgr.14373) 11061 : cluster [DBG] pgmap v7671: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:52:54.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:52:53 smithi086 bash[24289]: cluster 2024-09-16T09:52:52.647057+0000 mgr.a (mgr.14373) 11061 : cluster [DBG] pgmap v7671: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:52:54.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:52:53 smithi047 bash[22744]: cluster 2024-09-16T09:52:52.647057+0000 mgr.a (mgr.14373) 11061 : cluster [DBG] pgmap v7671: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:52:54.682 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:52:54.682 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:52:54.682 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:52:55.444 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:52:55.444 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:52:55.444 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:52:55.445 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:52:55.445 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:52:56.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:52:55 smithi157 bash[24585]: cluster 2024-09-16T09:52:54.647872+0000 mgr.a (mgr.14373) 11062 : cluster [DBG] pgmap v7672: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:52:56.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:52:55 smithi086 bash[24289]: cluster 2024-09-16T09:52:54.647872+0000 mgr.a (mgr.14373) 11062 : cluster [DBG] pgmap v7672: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:52:56.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:52:55 smithi047 bash[22744]: cluster 2024-09-16T09:52:54.647872+0000 mgr.a (mgr.14373) 11062 : cluster [DBG] pgmap v7672: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:52:57.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:52:56 smithi157 bash[24585]: audit 2024-09-16T09:52:55.015177+0000 mgr.a (mgr.14373) 11063 : audit [DBG] from='client.242910 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:52:57.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:52:56 smithi086 bash[24289]: audit 2024-09-16T09:52:55.015177+0000 mgr.a (mgr.14373) 11063 : audit [DBG] from='client.242910 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:52:57.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:52:56 smithi047 bash[22744]: audit 2024-09-16T09:52:55.015177+0000 mgr.a (mgr.14373) 11063 : audit [DBG] from='client.242910 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:52:58.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:52:57 smithi157 bash[24585]: cluster 2024-09-16T09:52:56.650156+0000 mgr.a (mgr.14373) 11064 : cluster [DBG] pgmap v7673: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:52:58.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:52:57 smithi086 bash[24289]: cluster 2024-09-16T09:52:56.650156+0000 mgr.a (mgr.14373) 11064 : cluster [DBG] pgmap v7673: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:52:58.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:52:57 smithi047 bash[22744]: cluster 2024-09-16T09:52:56.650156+0000 mgr.a (mgr.14373) 11064 : cluster [DBG] pgmap v7673: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:53:00.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:52:59 smithi157 bash[24585]: cluster 2024-09-16T09:52:58.650957+0000 mgr.a (mgr.14373) 11065 : cluster [DBG] pgmap v7674: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:53:00.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:52:59 smithi086 bash[24289]: cluster 2024-09-16T09:52:58.650957+0000 mgr.a (mgr.14373) 11065 : cluster [DBG] pgmap v7674: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:53:00.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:52:59 smithi047 bash[22744]: cluster 2024-09-16T09:52:58.650957+0000 mgr.a (mgr.14373) 11065 : cluster [DBG] pgmap v7674: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:53:00.446 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:53:00.446 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:53:00.446 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:53:01.230 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:53:01.230 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:53:01.230 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:53:01.230 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:53:01.230 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:53:02.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:53:01 smithi157 bash[24585]: cluster 2024-09-16T09:53:00.651658+0000 mgr.a (mgr.14373) 11066 : cluster [DBG] pgmap v7675: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:53:02.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:53:01 smithi157 bash[24585]: audit 2024-09-16T09:53:00.786583+0000 mgr.a (mgr.14373) 11067 : audit [DBG] from='client.242985 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:53:02.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:53:01 smithi086 bash[24289]: cluster 2024-09-16T09:53:00.651658+0000 mgr.a (mgr.14373) 11066 : cluster [DBG] pgmap v7675: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:53:02.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:53:01 smithi086 bash[24289]: audit 2024-09-16T09:53:00.786583+0000 mgr.a (mgr.14373) 11067 : audit [DBG] from='client.242985 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:53:02.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:53:01 smithi047 bash[22744]: cluster 2024-09-16T09:53:00.651658+0000 mgr.a (mgr.14373) 11066 : cluster [DBG] pgmap v7675: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:53:02.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:53:01 smithi047 bash[22744]: audit 2024-09-16T09:53:00.786583+0000 mgr.a (mgr.14373) 11067 : audit [DBG] from='client.242985 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:53:04.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:53:03 smithi157 bash[24585]: cluster 2024-09-16T09:53:02.654009+0000 mgr.a (mgr.14373) 11068 : cluster [DBG] pgmap v7676: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:53:04.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:53:03 smithi086 bash[24289]: cluster 2024-09-16T09:53:02.654009+0000 mgr.a (mgr.14373) 11068 : cluster [DBG] pgmap v7676: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:53:04.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:53:03 smithi047 bash[22744]: cluster 2024-09-16T09:53:02.654009+0000 mgr.a (mgr.14373) 11068 : cluster [DBG] pgmap v7676: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:53:06.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:53:05 smithi157 bash[24585]: cluster 2024-09-16T09:53:04.654852+0000 mgr.a (mgr.14373) 11069 : cluster [DBG] pgmap v7677: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:53:06.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:53:05 smithi086 bash[24289]: cluster 2024-09-16T09:53:04.654852+0000 mgr.a (mgr.14373) 11069 : cluster [DBG] pgmap v7677: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:53:06.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:53:05 smithi047 bash[22744]: cluster 2024-09-16T09:53:04.654852+0000 mgr.a (mgr.14373) 11069 : cluster [DBG] pgmap v7677: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:53:06.230 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:53:06.231 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:53:06.231 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:53:07.020 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:53:07.021 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:53:07.021 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:53:07.021 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:53:07.021 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:53:08.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:53:07 smithi157 bash[24585]: audit 2024-09-16T09:53:06.568063+0000 mgr.a (mgr.14373) 11070 : audit [DBG] from='client.243063 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:53:08.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:53:07 smithi157 bash[24585]: cluster 2024-09-16T09:53:06.656294+0000 mgr.a (mgr.14373) 11071 : cluster [DBG] pgmap v7678: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:53:08.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:53:07 smithi086 bash[24289]: audit 2024-09-16T09:53:06.568063+0000 mgr.a (mgr.14373) 11070 : audit [DBG] from='client.243063 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:53:08.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:53:07 smithi086 bash[24289]: cluster 2024-09-16T09:53:06.656294+0000 mgr.a (mgr.14373) 11071 : cluster [DBG] pgmap v7678: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:53:08.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:53:07 smithi047 bash[22744]: audit 2024-09-16T09:53:06.568063+0000 mgr.a (mgr.14373) 11070 : audit [DBG] from='client.243063 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:53:08.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:53:07 smithi047 bash[22744]: cluster 2024-09-16T09:53:06.656294+0000 mgr.a (mgr.14373) 11071 : cluster [DBG] pgmap v7678: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:53:10.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:53:09 smithi157 bash[24585]: cluster 2024-09-16T09:53:08.657131+0000 mgr.a (mgr.14373) 11072 : cluster [DBG] pgmap v7679: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T09:53:10.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:53:09 smithi086 bash[24289]: cluster 2024-09-16T09:53:08.657131+0000 mgr.a (mgr.14373) 11072 : cluster [DBG] pgmap v7679: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T09:53:10.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:53:09 smithi047 bash[22744]: cluster 2024-09-16T09:53:08.657131+0000 mgr.a (mgr.14373) 11072 : cluster [DBG] pgmap v7679: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T09:53:12.022 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:53:12.023 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:53:12.023 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:53:12.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:53:11 smithi157 bash[24585]: cluster 2024-09-16T09:53:10.657918+0000 mgr.a (mgr.14373) 11073 : cluster [DBG] pgmap v7680: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T09:53:12.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:53:11 smithi086 bash[24289]: cluster 2024-09-16T09:53:10.657918+0000 mgr.a (mgr.14373) 11073 : cluster [DBG] pgmap v7680: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T09:53:12.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:53:11 smithi047 bash[22744]: cluster 2024-09-16T09:53:10.657918+0000 mgr.a (mgr.14373) 11073 : cluster [DBG] pgmap v7680: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T09:53:12.758 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:53:12.758 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:53:12.758 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:53:12.758 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:53:12.758 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:53:14.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:53:13 smithi157 bash[24585]: audit 2024-09-16T09:53:12.352779+0000 mgr.a (mgr.14373) 11074 : audit [DBG] from='client.243138 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:53:14.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:53:13 smithi157 bash[24585]: cluster 2024-09-16T09:53:12.659887+0000 mgr.a (mgr.14373) 11075 : cluster [DBG] pgmap v7681: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:53:14.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:53:13 smithi086 bash[24289]: audit 2024-09-16T09:53:12.352779+0000 mgr.a (mgr.14373) 11074 : audit [DBG] from='client.243138 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:53:14.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:53:13 smithi086 bash[24289]: cluster 2024-09-16T09:53:12.659887+0000 mgr.a (mgr.14373) 11075 : cluster [DBG] pgmap v7681: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:53:14.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:53:13 smithi047 bash[22744]: audit 2024-09-16T09:53:12.352779+0000 mgr.a (mgr.14373) 11074 : audit [DBG] from='client.243138 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:53:14.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:53:13 smithi047 bash[22744]: cluster 2024-09-16T09:53:12.659887+0000 mgr.a (mgr.14373) 11075 : cluster [DBG] pgmap v7681: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:53:15.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:53:14 smithi157 bash[24585]: audit 2024-09-16T09:53:14.077000+0000 mon.b (mon.2) 1022 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T09:53:15.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:53:14 smithi086 bash[24289]: audit 2024-09-16T09:53:14.077000+0000 mon.b (mon.2) 1022 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T09:53:15.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:53:14 smithi047 bash[22744]: audit 2024-09-16T09:53:14.077000+0000 mon.b (mon.2) 1022 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T09:53:16.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:53:15 smithi157 bash[24585]: cluster 2024-09-16T09:53:14.660403+0000 mgr.a (mgr.14373) 11076 : cluster [DBG] pgmap v7682: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T09:53:16.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:53:15 smithi157 bash[24585]: audit 2024-09-16T09:53:14.919547+0000 mon.b (mon.2) 1023 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:53:16.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:53:15 smithi157 bash[24585]: audit 2024-09-16T09:53:14.921786+0000 mon.b (mon.2) 1024 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T09:53:16.058 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:53:15 smithi157 bash[24585]: audit 2024-09-16T09:53:14.932710+0000 mon.a (mon.0) 1231 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:53:16.058 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:53:15 smithi157 bash[24585]: audit 2024-09-16T09:53:14.936033+0000 mon.b (mon.2) 1025 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:53:16.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:53:15 smithi086 bash[24289]: cluster 2024-09-16T09:53:14.660403+0000 mgr.a (mgr.14373) 11076 : cluster [DBG] pgmap v7682: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T09:53:16.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:53:15 smithi086 bash[24289]: audit 2024-09-16T09:53:14.919547+0000 mon.b (mon.2) 1023 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:53:16.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:53:15 smithi086 bash[24289]: audit 2024-09-16T09:53:14.921786+0000 mon.b (mon.2) 1024 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T09:53:16.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:53:15 smithi086 bash[24289]: audit 2024-09-16T09:53:14.932710+0000 mon.a (mon.0) 1231 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:53:16.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:53:15 smithi086 bash[24289]: audit 2024-09-16T09:53:14.936033+0000 mon.b (mon.2) 1025 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:53:16.093 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 09:53:15 smithi047 bash[22994]: debug 2024-09-16T09:53:15.679+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T09:53:16.093 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 09:53:15 smithi047 bash[22994]: debug 2024-09-16T09:53:15.679+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T09:53:16.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:53:15 smithi047 bash[22744]: cluster 2024-09-16T09:53:14.660403+0000 mgr.a (mgr.14373) 11076 : cluster [DBG] pgmap v7682: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T09:53:16.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:53:15 smithi047 bash[22744]: audit 2024-09-16T09:53:14.919547+0000 mon.b (mon.2) 1023 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:53:16.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:53:15 smithi047 bash[22744]: audit 2024-09-16T09:53:14.921786+0000 mon.b (mon.2) 1024 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T09:53:16.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:53:15 smithi047 bash[22744]: audit 2024-09-16T09:53:14.932710+0000 mon.a (mon.0) 1231 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:53:16.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:53:15 smithi047 bash[22744]: audit 2024-09-16T09:53:14.936033+0000 mon.b (mon.2) 1025 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:53:17.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:53:16 smithi086 bash[24289]: audit 2024-09-16T09:53:14.938695+0000 mgr.a (mgr.14373) 11077 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:53:17.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:53:16 smithi086 bash[24289]: audit 2024-09-16T09:53:15.682526+0000 mgr.a (mgr.14373) 11078 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T09:53:17.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:53:16 smithi086 bash[24289]: cephadm 2024-09-16T09:53:15.684311+0000 mgr.a (mgr.14373) 11079 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T09:53:17.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:53:16 smithi047 bash[22744]: audit 2024-09-16T09:53:14.938695+0000 mgr.a (mgr.14373) 11077 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:53:17.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:53:16 smithi047 bash[22744]: audit 2024-09-16T09:53:15.682526+0000 mgr.a (mgr.14373) 11078 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T09:53:17.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:53:16 smithi047 bash[22744]: cephadm 2024-09-16T09:53:15.684311+0000 mgr.a (mgr.14373) 11079 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T09:53:17.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:53:16 smithi157 bash[24585]: audit 2024-09-16T09:53:14.938695+0000 mgr.a (mgr.14373) 11077 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:53:17.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:53:16 smithi157 bash[24585]: audit 2024-09-16T09:53:15.682526+0000 mgr.a (mgr.14373) 11078 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T09:53:17.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:53:16 smithi157 bash[24585]: cephadm 2024-09-16T09:53:15.684311+0000 mgr.a (mgr.14373) 11079 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T09:53:17.759 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:53:17.760 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:53:17.760 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:53:18.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:53:17 smithi086 bash[24289]: cluster 2024-09-16T09:53:16.662689+0000 mgr.a (mgr.14373) 11080 : cluster [DBG] pgmap v7683: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:53:18.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:53:17 smithi047 bash[22744]: cluster 2024-09-16T09:53:16.662689+0000 mgr.a (mgr.14373) 11080 : cluster [DBG] pgmap v7683: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:53:18.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:53:17 smithi157 bash[24585]: cluster 2024-09-16T09:53:16.662689+0000 mgr.a (mgr.14373) 11080 : cluster [DBG] pgmap v7683: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:53:18.543 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:53:18.543 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:53:18.543 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:53:18.544 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:53:18.544 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:53:20.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:53:19 smithi047 bash[22744]: audit 2024-09-16T09:53:18.097206+0000 mgr.a (mgr.14373) 11081 : audit [DBG] from='client.243315 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:53:20.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:53:19 smithi047 bash[22744]: cluster 2024-09-16T09:53:18.663634+0000 mgr.a (mgr.14373) 11082 : cluster [DBG] pgmap v7684: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:53:20.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:53:19 smithi157 bash[24585]: audit 2024-09-16T09:53:18.097206+0000 mgr.a (mgr.14373) 11081 : audit [DBG] from='client.243315 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:53:20.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:53:19 smithi157 bash[24585]: cluster 2024-09-16T09:53:18.663634+0000 mgr.a (mgr.14373) 11082 : cluster [DBG] pgmap v7684: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:53:20.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:53:19 smithi086 bash[24289]: audit 2024-09-16T09:53:18.097206+0000 mgr.a (mgr.14373) 11081 : audit [DBG] from='client.243315 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:53:20.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:53:19 smithi086 bash[24289]: cluster 2024-09-16T09:53:18.663634+0000 mgr.a (mgr.14373) 11082 : cluster [DBG] pgmap v7684: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:53:22.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:53:21 smithi047 bash[22744]: cluster 2024-09-16T09:53:20.664453+0000 mgr.a (mgr.14373) 11083 : cluster [DBG] pgmap v7685: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:53:22.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:53:21 smithi157 bash[24585]: cluster 2024-09-16T09:53:20.664453+0000 mgr.a (mgr.14373) 11083 : cluster [DBG] pgmap v7685: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:53:22.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:53:21 smithi086 bash[24289]: cluster 2024-09-16T09:53:20.664453+0000 mgr.a (mgr.14373) 11083 : cluster [DBG] pgmap v7685: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:53:23.545 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:53:23.545 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:53:23.545 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:53:24.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:53:23 smithi047 bash[22744]: cluster 2024-09-16T09:53:22.666717+0000 mgr.a (mgr.14373) 11084 : cluster [DBG] pgmap v7686: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:53:24.296 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:53:24.296 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:53:24.296 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:53:24.296 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:53:24.296 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:53:24.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:53:23 smithi157 bash[24585]: cluster 2024-09-16T09:53:22.666717+0000 mgr.a (mgr.14373) 11084 : cluster [DBG] pgmap v7686: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:53:24.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:53:23 smithi086 bash[24289]: cluster 2024-09-16T09:53:22.666717+0000 mgr.a (mgr.14373) 11084 : cluster [DBG] pgmap v7686: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:53:26.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:53:25 smithi047 bash[22744]: audit 2024-09-16T09:53:23.874725+0000 mgr.a (mgr.14373) 11085 : audit [DBG] from='client.243393 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:53:26.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:53:25 smithi047 bash[22744]: cluster 2024-09-16T09:53:24.667733+0000 mgr.a (mgr.14373) 11086 : cluster [DBG] pgmap v7687: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:53:26.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:53:25 smithi157 bash[24585]: audit 2024-09-16T09:53:23.874725+0000 mgr.a (mgr.14373) 11085 : audit [DBG] from='client.243393 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:53:26.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:53:25 smithi157 bash[24585]: cluster 2024-09-16T09:53:24.667733+0000 mgr.a (mgr.14373) 11086 : cluster [DBG] pgmap v7687: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:53:26.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:53:25 smithi086 bash[24289]: audit 2024-09-16T09:53:23.874725+0000 mgr.a (mgr.14373) 11085 : audit [DBG] from='client.243393 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:53:26.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:53:25 smithi086 bash[24289]: cluster 2024-09-16T09:53:24.667733+0000 mgr.a (mgr.14373) 11086 : cluster [DBG] pgmap v7687: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:53:27.317 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:53:26 smithi157 bash[24585]: cluster 2024-09-16T09:53:26.669944+0000 mgr.a (mgr.14373) 11087 : cluster [DBG] pgmap v7688: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:53:27.322 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:53:26 smithi086 bash[24289]: cluster 2024-09-16T09:53:26.669944+0000 mgr.a (mgr.14373) 11087 : cluster [DBG] pgmap v7688: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:53:27.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:53:26 smithi047 bash[22744]: cluster 2024-09-16T09:53:26.669944+0000 mgr.a (mgr.14373) 11087 : cluster [DBG] pgmap v7688: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:53:29.298 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:53:29.298 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:53:29.298 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:53:30.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:53:29 smithi157 bash[24585]: cluster 2024-09-16T09:53:28.670718+0000 mgr.a (mgr.14373) 11088 : cluster [DBG] pgmap v7689: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:53:30.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:53:29 smithi086 bash[24289]: cluster 2024-09-16T09:53:28.670718+0000 mgr.a (mgr.14373) 11088 : cluster [DBG] pgmap v7689: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:53:30.089 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:53:30.090 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:53:30.090 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:53:30.090 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:53:30.090 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:53:30.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:53:29 smithi047 bash[22744]: cluster 2024-09-16T09:53:28.670718+0000 mgr.a (mgr.14373) 11088 : cluster [DBG] pgmap v7689: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:53:31.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:53:30 smithi157 bash[24585]: audit 2024-09-16T09:53:29.638579+0000 mgr.a (mgr.14373) 11089 : audit [DBG] from='client.243465 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:53:31.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:53:30 smithi086 bash[24289]: audit 2024-09-16T09:53:29.638579+0000 mgr.a (mgr.14373) 11089 : audit [DBG] from='client.243465 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:53:31.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:53:30 smithi047 bash[22744]: audit 2024-09-16T09:53:29.638579+0000 mgr.a (mgr.14373) 11089 : audit [DBG] from='client.243465 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:53:32.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:53:31 smithi157 bash[24585]: cluster 2024-09-16T09:53:30.671711+0000 mgr.a (mgr.14373) 11090 : cluster [DBG] pgmap v7690: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:53:32.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:53:31 smithi086 bash[24289]: cluster 2024-09-16T09:53:30.671711+0000 mgr.a (mgr.14373) 11090 : cluster [DBG] pgmap v7690: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:53:32.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:53:31 smithi047 bash[22744]: cluster 2024-09-16T09:53:30.671711+0000 mgr.a (mgr.14373) 11090 : cluster [DBG] pgmap v7690: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:53:34.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:53:33 smithi157 bash[24585]: cluster 2024-09-16T09:53:32.673851+0000 mgr.a (mgr.14373) 11091 : cluster [DBG] pgmap v7691: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:53:34.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:53:33 smithi086 bash[24289]: cluster 2024-09-16T09:53:32.673851+0000 mgr.a (mgr.14373) 11091 : cluster [DBG] pgmap v7691: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:53:34.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:53:33 smithi047 bash[22744]: cluster 2024-09-16T09:53:32.673851+0000 mgr.a (mgr.14373) 11091 : cluster [DBG] pgmap v7691: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:53:35.091 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:53:35.092 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:53:35.092 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:53:35.873 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:53:35.873 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:53:35.873 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:53:35.873 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:53:35.873 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:53:36.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:53:35 smithi157 bash[24585]: cluster 2024-09-16T09:53:34.674662+0000 mgr.a (mgr.14373) 11092 : cluster [DBG] pgmap v7692: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:53:36.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:53:35 smithi086 bash[24289]: cluster 2024-09-16T09:53:34.674662+0000 mgr.a (mgr.14373) 11092 : cluster [DBG] pgmap v7692: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:53:36.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:53:35 smithi047 bash[22744]: cluster 2024-09-16T09:53:34.674662+0000 mgr.a (mgr.14373) 11092 : cluster [DBG] pgmap v7692: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:53:37.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:53:36 smithi157 bash[24585]: audit 2024-09-16T09:53:35.422466+0000 mgr.a (mgr.14373) 11093 : audit [DBG] from='client.243537 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:53:37.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:53:36 smithi086 bash[24289]: audit 2024-09-16T09:53:35.422466+0000 mgr.a (mgr.14373) 11093 : audit [DBG] from='client.243537 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:53:37.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:53:36 smithi047 bash[22744]: audit 2024-09-16T09:53:35.422466+0000 mgr.a (mgr.14373) 11093 : audit [DBG] from='client.243537 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:53:38.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:53:37 smithi157 bash[24585]: cluster 2024-09-16T09:53:36.677002+0000 mgr.a (mgr.14373) 11094 : cluster [DBG] pgmap v7693: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:53:38.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:53:37 smithi086 bash[24289]: cluster 2024-09-16T09:53:36.677002+0000 mgr.a (mgr.14373) 11094 : cluster [DBG] pgmap v7693: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:53:38.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:53:37 smithi047 bash[22744]: cluster 2024-09-16T09:53:36.677002+0000 mgr.a (mgr.14373) 11094 : cluster [DBG] pgmap v7693: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:53:40.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:53:39 smithi157 bash[24585]: cluster 2024-09-16T09:53:38.677786+0000 mgr.a (mgr.14373) 11095 : cluster [DBG] pgmap v7694: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:53:40.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:53:39 smithi086 bash[24289]: cluster 2024-09-16T09:53:38.677786+0000 mgr.a (mgr.14373) 11095 : cluster [DBG] pgmap v7694: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:53:40.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:53:39 smithi047 bash[22744]: cluster 2024-09-16T09:53:38.677786+0000 mgr.a (mgr.14373) 11095 : cluster [DBG] pgmap v7694: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:53:40.874 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:53:40.875 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:53:40.875 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:53:41.654 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:53:41.654 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:53:41.654 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:53:41.654 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:53:41.654 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:53:42.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:53:41 smithi157 bash[24585]: cluster 2024-09-16T09:53:40.678612+0000 mgr.a (mgr.14373) 11096 : cluster [DBG] pgmap v7695: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:53:42.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:53:41 smithi086 bash[24289]: cluster 2024-09-16T09:53:40.678612+0000 mgr.a (mgr.14373) 11096 : cluster [DBG] pgmap v7695: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:53:42.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:53:41 smithi047 bash[22744]: cluster 2024-09-16T09:53:40.678612+0000 mgr.a (mgr.14373) 11096 : cluster [DBG] pgmap v7695: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:53:43.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:53:42 smithi157 bash[24585]: audit 2024-09-16T09:53:41.208813+0000 mgr.a (mgr.14373) 11097 : audit [DBG] from='client.243612 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:53:43.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:53:42 smithi086 bash[24289]: audit 2024-09-16T09:53:41.208813+0000 mgr.a (mgr.14373) 11097 : audit [DBG] from='client.243612 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:53:43.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:53:42 smithi047 bash[22744]: audit 2024-09-16T09:53:41.208813+0000 mgr.a (mgr.14373) 11097 : audit [DBG] from='client.243612 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:53:44.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:53:43 smithi157 bash[24585]: cluster 2024-09-16T09:53:42.681340+0000 mgr.a (mgr.14373) 11098 : cluster [DBG] pgmap v7696: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:53:44.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:53:43 smithi086 bash[24289]: cluster 2024-09-16T09:53:42.681340+0000 mgr.a (mgr.14373) 11098 : cluster [DBG] pgmap v7696: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:53:44.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:53:43 smithi047 bash[22744]: cluster 2024-09-16T09:53:42.681340+0000 mgr.a (mgr.14373) 11098 : cluster [DBG] pgmap v7696: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:53:46.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:53:45 smithi157 bash[24585]: cluster 2024-09-16T09:53:44.682108+0000 mgr.a (mgr.14373) 11099 : cluster [DBG] pgmap v7697: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:53:46.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:53:45 smithi086 bash[24289]: cluster 2024-09-16T09:53:44.682108+0000 mgr.a (mgr.14373) 11099 : cluster [DBG] pgmap v7697: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:53:46.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:53:45 smithi047 bash[22744]: cluster 2024-09-16T09:53:44.682108+0000 mgr.a (mgr.14373) 11099 : cluster [DBG] pgmap v7697: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:53:46.655 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:53:46.656 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:53:46.656 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:53:47.448 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:53:47.448 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:53:47.448 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:53:47.448 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:53:47.448 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:53:48.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:53:47 smithi157 bash[24585]: cluster 2024-09-16T09:53:46.683541+0000 mgr.a (mgr.14373) 11100 : cluster [DBG] pgmap v7698: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:53:48.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:53:47 smithi086 bash[24289]: cluster 2024-09-16T09:53:46.683541+0000 mgr.a (mgr.14373) 11100 : cluster [DBG] pgmap v7698: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:53:48.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:53:47 smithi047 bash[22744]: cluster 2024-09-16T09:53:46.683541+0000 mgr.a (mgr.14373) 11100 : cluster [DBG] pgmap v7698: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:53:49.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:53:48 smithi157 bash[24585]: audit 2024-09-16T09:53:46.995201+0000 mgr.a (mgr.14373) 11101 : audit [DBG] from='client.243690 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:53:49.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:53:48 smithi086 bash[24289]: audit 2024-09-16T09:53:46.995201+0000 mgr.a (mgr.14373) 11101 : audit [DBG] from='client.243690 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:53:49.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:53:48 smithi047 bash[22744]: audit 2024-09-16T09:53:46.995201+0000 mgr.a (mgr.14373) 11101 : audit [DBG] from='client.243690 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:53:50.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:53:49 smithi157 bash[24585]: cluster 2024-09-16T09:53:48.684414+0000 mgr.a (mgr.14373) 11102 : cluster [DBG] pgmap v7699: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:53:50.069 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:53:49 smithi086 bash[24289]: cluster 2024-09-16T09:53:48.684414+0000 mgr.a (mgr.14373) 11102 : cluster [DBG] pgmap v7699: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:53:50.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:53:49 smithi047 bash[22744]: cluster 2024-09-16T09:53:48.684414+0000 mgr.a (mgr.14373) 11102 : cluster [DBG] pgmap v7699: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:53:52.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:53:51 smithi157 bash[24585]: cluster 2024-09-16T09:53:50.685349+0000 mgr.a (mgr.14373) 11103 : cluster [DBG] pgmap v7700: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T09:53:52.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:53:51 smithi086 bash[24289]: cluster 2024-09-16T09:53:50.685349+0000 mgr.a (mgr.14373) 11103 : cluster [DBG] pgmap v7700: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T09:53:52.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:53:51 smithi047 bash[22744]: cluster 2024-09-16T09:53:50.685349+0000 mgr.a (mgr.14373) 11103 : cluster [DBG] pgmap v7700: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T09:53:52.450 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:53:52.451 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:53:52.451 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:53:53.192 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:53:53.192 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:53:53.193 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:53:53.193 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:53:53.193 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:53:54.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:53:53 smithi086 bash[24289]: cluster 2024-09-16T09:53:52.687610+0000 mgr.a (mgr.14373) 11104 : cluster [DBG] pgmap v7701: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:53:54.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:53:53 smithi086 bash[24289]: audit 2024-09-16T09:53:52.779376+0000 mgr.a (mgr.14373) 11105 : audit [DBG] from='client.243765 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:53:54.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:53:53 smithi047 bash[22744]: cluster 2024-09-16T09:53:52.687610+0000 mgr.a (mgr.14373) 11104 : cluster [DBG] pgmap v7701: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:53:54.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:53:53 smithi047 bash[22744]: audit 2024-09-16T09:53:52.779376+0000 mgr.a (mgr.14373) 11105 : audit [DBG] from='client.243765 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:53:54.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:53:53 smithi157 bash[24585]: cluster 2024-09-16T09:53:52.687610+0000 mgr.a (mgr.14373) 11104 : cluster [DBG] pgmap v7701: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:53:54.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:53:53 smithi157 bash[24585]: audit 2024-09-16T09:53:52.779376+0000 mgr.a (mgr.14373) 11105 : audit [DBG] from='client.243765 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:53:56.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:53:55 smithi086 bash[24289]: cluster 2024-09-16T09:53:54.688530+0000 mgr.a (mgr.14373) 11106 : cluster [DBG] pgmap v7702: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:53:56.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:53:55 smithi047 bash[22744]: cluster 2024-09-16T09:53:54.688530+0000 mgr.a (mgr.14373) 11106 : cluster [DBG] pgmap v7702: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:53:56.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:53:55 smithi157 bash[24585]: cluster 2024-09-16T09:53:54.688530+0000 mgr.a (mgr.14373) 11106 : cluster [DBG] pgmap v7702: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:53:58.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:53:57 smithi086 bash[24289]: cluster 2024-09-16T09:53:56.690705+0000 mgr.a (mgr.14373) 11107 : cluster [DBG] pgmap v7703: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:53:58.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:53:57 smithi047 bash[22744]: cluster 2024-09-16T09:53:56.690705+0000 mgr.a (mgr.14373) 11107 : cluster [DBG] pgmap v7703: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:53:58.194 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:53:58.195 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:53:58.195 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:53:58.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:53:57 smithi157 bash[24585]: cluster 2024-09-16T09:53:56.690705+0000 mgr.a (mgr.14373) 11107 : cluster [DBG] pgmap v7703: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:53:58.977 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:53:58.977 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:53:58.978 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:53:58.978 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:53:58.978 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:54:00.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:53:59 smithi047 bash[22744]: audit 2024-09-16T09:53:58.531968+0000 mgr.a (mgr.14373) 11108 : audit [DBG] from='client.243840 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:54:00.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:53:59 smithi047 bash[22744]: cluster 2024-09-16T09:53:58.691247+0000 mgr.a (mgr.14373) 11109 : cluster [DBG] pgmap v7704: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:54:00.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:53:59 smithi157 bash[24585]: audit 2024-09-16T09:53:58.531968+0000 mgr.a (mgr.14373) 11108 : audit [DBG] from='client.243840 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:54:00.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:53:59 smithi157 bash[24585]: cluster 2024-09-16T09:53:58.691247+0000 mgr.a (mgr.14373) 11109 : cluster [DBG] pgmap v7704: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:54:00.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:53:59 smithi086 bash[24289]: audit 2024-09-16T09:53:58.531968+0000 mgr.a (mgr.14373) 11108 : audit [DBG] from='client.243840 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:54:00.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:53:59 smithi086 bash[24289]: cluster 2024-09-16T09:53:58.691247+0000 mgr.a (mgr.14373) 11109 : cluster [DBG] pgmap v7704: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:54:02.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:54:01 smithi047 bash[22744]: cluster 2024-09-16T09:54:00.692138+0000 mgr.a (mgr.14373) 11110 : cluster [DBG] pgmap v7705: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:54:02.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:54:01 smithi157 bash[24585]: cluster 2024-09-16T09:54:00.692138+0000 mgr.a (mgr.14373) 11110 : cluster [DBG] pgmap v7705: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:54:02.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:54:01 smithi086 bash[24289]: cluster 2024-09-16T09:54:00.692138+0000 mgr.a (mgr.14373) 11110 : cluster [DBG] pgmap v7705: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:54:03.979 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:54:03.979 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:54:03.979 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:54:04.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:54:03 smithi047 bash[22744]: cluster 2024-09-16T09:54:02.694388+0000 mgr.a (mgr.14373) 11111 : cluster [DBG] pgmap v7706: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:54:04.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:54:03 smithi157 bash[24585]: cluster 2024-09-16T09:54:02.694388+0000 mgr.a (mgr.14373) 11111 : cluster [DBG] pgmap v7706: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:54:04.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:54:03 smithi086 bash[24289]: cluster 2024-09-16T09:54:02.694388+0000 mgr.a (mgr.14373) 11111 : cluster [DBG] pgmap v7706: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:54:04.748 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:54:04.748 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:54:04.749 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:54:04.749 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:54:04.749 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:54:06.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:54:05 smithi047 bash[22744]: audit 2024-09-16T09:54:04.318903+0000 mgr.a (mgr.14373) 11112 : audit [DBG] from='client.243918 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:54:06.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:54:05 smithi047 bash[22744]: cluster 2024-09-16T09:54:04.694889+0000 mgr.a (mgr.14373) 11113 : cluster [DBG] pgmap v7707: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:54:06.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:54:05 smithi157 bash[24585]: audit 2024-09-16T09:54:04.318903+0000 mgr.a (mgr.14373) 11112 : audit [DBG] from='client.243918 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:54:06.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:54:05 smithi157 bash[24585]: cluster 2024-09-16T09:54:04.694889+0000 mgr.a (mgr.14373) 11113 : cluster [DBG] pgmap v7707: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:54:06.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:54:05 smithi086 bash[24289]: audit 2024-09-16T09:54:04.318903+0000 mgr.a (mgr.14373) 11112 : audit [DBG] from='client.243918 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:54:06.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:54:05 smithi086 bash[24289]: cluster 2024-09-16T09:54:04.694889+0000 mgr.a (mgr.14373) 11113 : cluster [DBG] pgmap v7707: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:54:08.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:54:07 smithi047 bash[22744]: cluster 2024-09-16T09:54:06.697111+0000 mgr.a (mgr.14373) 11114 : cluster [DBG] pgmap v7708: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:54:08.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:54:07 smithi157 bash[24585]: cluster 2024-09-16T09:54:06.697111+0000 mgr.a (mgr.14373) 11114 : cluster [DBG] pgmap v7708: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:54:08.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:54:07 smithi086 bash[24289]: cluster 2024-09-16T09:54:06.697111+0000 mgr.a (mgr.14373) 11114 : cluster [DBG] pgmap v7708: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:54:09.750 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:54:09.751 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:54:09.751 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:54:10.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:54:09 smithi047 bash[22744]: cluster 2024-09-16T09:54:08.698045+0000 mgr.a (mgr.14373) 11115 : cluster [DBG] pgmap v7709: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:54:10.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:54:09 smithi157 bash[24585]: cluster 2024-09-16T09:54:08.698045+0000 mgr.a (mgr.14373) 11115 : cluster [DBG] pgmap v7709: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:54:10.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:54:09 smithi086 bash[24289]: cluster 2024-09-16T09:54:08.698045+0000 mgr.a (mgr.14373) 11115 : cluster [DBG] pgmap v7709: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:54:10.497 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:54:10.497 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:54:10.497 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:54:10.497 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:54:10.498 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:54:12.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:54:11 smithi157 bash[24585]: audit 2024-09-16T09:54:10.080914+0000 mgr.a (mgr.14373) 11116 : audit [DBG] from='client.243993 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:54:12.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:54:11 smithi157 bash[24585]: cluster 2024-09-16T09:54:10.699176+0000 mgr.a (mgr.14373) 11117 : cluster [DBG] pgmap v7710: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:54:12.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:54:11 smithi086 bash[24289]: audit 2024-09-16T09:54:10.080914+0000 mgr.a (mgr.14373) 11116 : audit [DBG] from='client.243993 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:54:12.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:54:11 smithi086 bash[24289]: cluster 2024-09-16T09:54:10.699176+0000 mgr.a (mgr.14373) 11117 : cluster [DBG] pgmap v7710: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:54:12.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:54:11 smithi047 bash[22744]: audit 2024-09-16T09:54:10.080914+0000 mgr.a (mgr.14373) 11116 : audit [DBG] from='client.243993 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:54:12.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:54:11 smithi047 bash[22744]: cluster 2024-09-16T09:54:10.699176+0000 mgr.a (mgr.14373) 11117 : cluster [DBG] pgmap v7710: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:54:13.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:54:12 smithi157 bash[24585]: cluster 2024-09-16T09:54:12.701580+0000 mgr.a (mgr.14373) 11118 : cluster [DBG] pgmap v7711: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:54:13.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:54:12 smithi086 bash[24289]: cluster 2024-09-16T09:54:12.701580+0000 mgr.a (mgr.14373) 11118 : cluster [DBG] pgmap v7711: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:54:13.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:54:12 smithi047 bash[22744]: cluster 2024-09-16T09:54:12.701580+0000 mgr.a (mgr.14373) 11118 : cluster [DBG] pgmap v7711: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:54:15.499 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:54:15.500 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:54:15.500 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:54:16.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:54:15 smithi157 bash[24585]: cluster 2024-09-16T09:54:14.702548+0000 mgr.a (mgr.14373) 11119 : cluster [DBG] pgmap v7712: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:54:16.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:54:15 smithi157 bash[24585]: audit 2024-09-16T09:54:15.735498+0000 mon.b (mon.2) 1026 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T09:54:16.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:54:15 smithi086 bash[24289]: cluster 2024-09-16T09:54:14.702548+0000 mgr.a (mgr.14373) 11119 : cluster [DBG] pgmap v7712: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:54:16.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:54:15 smithi086 bash[24289]: audit 2024-09-16T09:54:15.735498+0000 mon.b (mon.2) 1026 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T09:54:16.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:54:15 smithi047 bash[22744]: cluster 2024-09-16T09:54:14.702548+0000 mgr.a (mgr.14373) 11119 : cluster [DBG] pgmap v7712: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:54:16.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:54:15 smithi047 bash[22744]: audit 2024-09-16T09:54:15.735498+0000 mon.b (mon.2) 1026 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T09:54:16.288 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:54:16.289 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:54:16.289 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:54:16.289 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:54:16.289 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:54:17.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:54:16 smithi157 bash[24585]: audit 2024-09-16T09:54:15.834990+0000 mgr.a (mgr.14373) 11120 : audit [DBG] from='client.244065 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:54:17.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:54:16 smithi157 bash[24585]: audit 2024-09-16T09:54:16.573792+0000 mon.b (mon.2) 1027 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:54:17.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:54:16 smithi157 bash[24585]: audit 2024-09-16T09:54:16.576251+0000 mon.b (mon.2) 1028 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T09:54:17.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:54:16 smithi157 bash[24585]: audit 2024-09-16T09:54:16.587243+0000 mon.a (mon.0) 1232 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:54:17.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:54:16 smithi157 bash[24585]: audit 2024-09-16T09:54:16.592750+0000 mon.b (mon.2) 1029 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:54:17.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:54:16 smithi086 bash[24289]: audit 2024-09-16T09:54:15.834990+0000 mgr.a (mgr.14373) 11120 : audit [DBG] from='client.244065 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:54:17.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:54:16 smithi086 bash[24289]: audit 2024-09-16T09:54:16.573792+0000 mon.b (mon.2) 1027 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:54:17.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:54:16 smithi086 bash[24289]: audit 2024-09-16T09:54:16.576251+0000 mon.b (mon.2) 1028 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T09:54:17.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:54:16 smithi086 bash[24289]: audit 2024-09-16T09:54:16.587243+0000 mon.a (mon.0) 1232 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:54:17.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:54:16 smithi086 bash[24289]: audit 2024-09-16T09:54:16.592750+0000 mon.b (mon.2) 1029 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:54:17.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:54:16 smithi047 bash[22744]: audit 2024-09-16T09:54:15.834990+0000 mgr.a (mgr.14373) 11120 : audit [DBG] from='client.244065 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:54:17.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:54:16 smithi047 bash[22744]: audit 2024-09-16T09:54:16.573792+0000 mon.b (mon.2) 1027 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:54:17.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:54:16 smithi047 bash[22744]: audit 2024-09-16T09:54:16.576251+0000 mon.b (mon.2) 1028 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T09:54:17.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:54:16 smithi047 bash[22744]: audit 2024-09-16T09:54:16.587243+0000 mon.a (mon.0) 1232 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:54:17.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:54:16 smithi047 bash[22744]: audit 2024-09-16T09:54:16.592750+0000 mon.b (mon.2) 1029 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:54:17.592 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 09:54:17 smithi047 bash[22994]: debug 2024-09-16T09:54:17.338+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T09:54:17.592 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 09:54:17 smithi047 bash[22994]: debug 2024-09-16T09:54:17.338+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T09:54:18.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:54:17 smithi157 bash[24585]: audit 2024-09-16T09:54:16.595579+0000 mgr.a (mgr.14373) 11121 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:54:18.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:54:17 smithi157 bash[24585]: cluster 2024-09-16T09:54:16.703773+0000 mgr.a (mgr.14373) 11122 : cluster [DBG] pgmap v7713: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:54:18.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:54:17 smithi086 bash[24289]: audit 2024-09-16T09:54:16.595579+0000 mgr.a (mgr.14373) 11121 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:54:18.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:54:17 smithi086 bash[24289]: cluster 2024-09-16T09:54:16.703773+0000 mgr.a (mgr.14373) 11122 : cluster [DBG] pgmap v7713: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:54:18.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:54:17 smithi047 bash[22744]: audit 2024-09-16T09:54:16.595579+0000 mgr.a (mgr.14373) 11121 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:54:18.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:54:17 smithi047 bash[22744]: cluster 2024-09-16T09:54:16.703773+0000 mgr.a (mgr.14373) 11122 : cluster [DBG] pgmap v7713: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:54:19.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:54:18 smithi157 bash[24585]: audit 2024-09-16T09:54:17.338959+0000 mgr.a (mgr.14373) 11123 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T09:54:19.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:54:18 smithi157 bash[24585]: cephadm 2024-09-16T09:54:17.341243+0000 mgr.a (mgr.14373) 11124 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T09:54:19.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:54:18 smithi086 bash[24289]: audit 2024-09-16T09:54:17.338959+0000 mgr.a (mgr.14373) 11123 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T09:54:19.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:54:18 smithi086 bash[24289]: cephadm 2024-09-16T09:54:17.341243+0000 mgr.a (mgr.14373) 11124 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T09:54:19.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:54:18 smithi047 bash[22744]: audit 2024-09-16T09:54:17.338959+0000 mgr.a (mgr.14373) 11123 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T09:54:19.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:54:18 smithi047 bash[22744]: cephadm 2024-09-16T09:54:17.341243+0000 mgr.a (mgr.14373) 11124 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T09:54:20.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:54:19 smithi157 bash[24585]: cluster 2024-09-16T09:54:18.704618+0000 mgr.a (mgr.14373) 11125 : cluster [DBG] pgmap v7714: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:54:20.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:54:19 smithi086 bash[24289]: cluster 2024-09-16T09:54:18.704618+0000 mgr.a (mgr.14373) 11125 : cluster [DBG] pgmap v7714: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:54:20.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:54:19 smithi047 bash[22744]: cluster 2024-09-16T09:54:18.704618+0000 mgr.a (mgr.14373) 11125 : cluster [DBG] pgmap v7714: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:54:21.290 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:54:21.291 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:54:21.291 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:54:22.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:54:21 smithi157 bash[24585]: cluster 2024-09-16T09:54:20.705371+0000 mgr.a (mgr.14373) 11126 : cluster [DBG] pgmap v7715: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:54:22.058 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:54:22.059 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:54:22.059 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:54:22.059 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:54:22.059 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:54:22.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:54:21 smithi086 bash[24289]: cluster 2024-09-16T09:54:20.705371+0000 mgr.a (mgr.14373) 11126 : cluster [DBG] pgmap v7715: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:54:22.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:54:21 smithi047 bash[22744]: cluster 2024-09-16T09:54:20.705371+0000 mgr.a (mgr.14373) 11126 : cluster [DBG] pgmap v7715: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:54:23.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:54:22 smithi157 bash[24585]: audit 2024-09-16T09:54:21.626211+0000 mgr.a (mgr.14373) 11127 : audit [DBG] from='client.244245 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:54:23.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:54:22 smithi086 bash[24289]: audit 2024-09-16T09:54:21.626211+0000 mgr.a (mgr.14373) 11127 : audit [DBG] from='client.244245 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:54:23.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:54:22 smithi047 bash[22744]: audit 2024-09-16T09:54:21.626211+0000 mgr.a (mgr.14373) 11127 : audit [DBG] from='client.244245 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:54:24.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:54:23 smithi157 bash[24585]: cluster 2024-09-16T09:54:22.708142+0000 mgr.a (mgr.14373) 11128 : cluster [DBG] pgmap v7716: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:54:24.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:54:23 smithi086 bash[24289]: cluster 2024-09-16T09:54:22.708142+0000 mgr.a (mgr.14373) 11128 : cluster [DBG] pgmap v7716: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:54:24.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:54:23 smithi047 bash[22744]: cluster 2024-09-16T09:54:22.708142+0000 mgr.a (mgr.14373) 11128 : cluster [DBG] pgmap v7716: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:54:26.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:54:25 smithi157 bash[24585]: cluster 2024-09-16T09:54:24.708930+0000 mgr.a (mgr.14373) 11129 : cluster [DBG] pgmap v7717: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T09:54:26.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:54:25 smithi086 bash[24289]: cluster 2024-09-16T09:54:24.708930+0000 mgr.a (mgr.14373) 11129 : cluster [DBG] pgmap v7717: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T09:54:26.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:54:25 smithi047 bash[22744]: cluster 2024-09-16T09:54:24.708930+0000 mgr.a (mgr.14373) 11129 : cluster [DBG] pgmap v7717: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T09:54:27.060 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:54:27.061 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:54:27.061 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:54:27.838 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:54:27.838 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:54:27.838 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:54:27.839 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:54:27.839 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:54:28.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:54:27 smithi086 bash[24289]: cluster 2024-09-16T09:54:26.710878+0000 mgr.a (mgr.14373) 11130 : cluster [DBG] pgmap v7718: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:54:28.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:54:27 smithi047 bash[22744]: cluster 2024-09-16T09:54:26.710878+0000 mgr.a (mgr.14373) 11130 : cluster [DBG] pgmap v7718: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:54:28.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:54:27 smithi157 bash[24585]: cluster 2024-09-16T09:54:26.710878+0000 mgr.a (mgr.14373) 11130 : cluster [DBG] pgmap v7718: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:54:29.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:54:28 smithi086 bash[24289]: audit 2024-09-16T09:54:27.392247+0000 mgr.a (mgr.14373) 11131 : audit [DBG] from='client.244323 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:54:29.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:54:28 smithi047 bash[22744]: audit 2024-09-16T09:54:27.392247+0000 mgr.a (mgr.14373) 11131 : audit [DBG] from='client.244323 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:54:29.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:54:28 smithi157 bash[24585]: audit 2024-09-16T09:54:27.392247+0000 mgr.a (mgr.14373) 11131 : audit [DBG] from='client.244323 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:54:30.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:54:29 smithi086 bash[24289]: cluster 2024-09-16T09:54:28.711788+0000 mgr.a (mgr.14373) 11132 : cluster [DBG] pgmap v7719: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T09:54:30.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:54:29 smithi047 bash[22744]: cluster 2024-09-16T09:54:28.711788+0000 mgr.a (mgr.14373) 11132 : cluster [DBG] pgmap v7719: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T09:54:30.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:54:29 smithi157 bash[24585]: cluster 2024-09-16T09:54:28.711788+0000 mgr.a (mgr.14373) 11132 : cluster [DBG] pgmap v7719: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T09:54:32.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:54:31 smithi047 bash[22744]: cluster 2024-09-16T09:54:30.712541+0000 mgr.a (mgr.14373) 11133 : cluster [DBG] pgmap v7720: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T09:54:32.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:54:31 smithi157 bash[24585]: cluster 2024-09-16T09:54:30.712541+0000 mgr.a (mgr.14373) 11133 : cluster [DBG] pgmap v7720: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T09:54:32.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:54:31 smithi086 bash[24289]: cluster 2024-09-16T09:54:30.712541+0000 mgr.a (mgr.14373) 11133 : cluster [DBG] pgmap v7720: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T09:54:32.840 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:54:32.840 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:54:32.840 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:54:33.624 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:54:33.625 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:54:33.625 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:54:33.625 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:54:33.625 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:54:34.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:54:33 smithi047 bash[22744]: cluster 2024-09-16T09:54:32.714784+0000 mgr.a (mgr.14373) 11134 : cluster [DBG] pgmap v7721: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:54:34.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:54:33 smithi157 bash[24585]: cluster 2024-09-16T09:54:32.714784+0000 mgr.a (mgr.14373) 11134 : cluster [DBG] pgmap v7721: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:54:34.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:54:33 smithi086 bash[24289]: cluster 2024-09-16T09:54:32.714784+0000 mgr.a (mgr.14373) 11134 : cluster [DBG] pgmap v7721: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:54:35.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:54:34 smithi047 bash[22744]: audit 2024-09-16T09:54:33.179977+0000 mgr.a (mgr.14373) 11135 : audit [DBG] from='client.244398 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:54:35.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:54:34 smithi157 bash[24585]: audit 2024-09-16T09:54:33.179977+0000 mgr.a (mgr.14373) 11135 : audit [DBG] from='client.244398 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:54:35.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:54:34 smithi086 bash[24289]: audit 2024-09-16T09:54:33.179977+0000 mgr.a (mgr.14373) 11135 : audit [DBG] from='client.244398 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:54:36.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:54:35 smithi047 bash[22744]: cluster 2024-09-16T09:54:34.715665+0000 mgr.a (mgr.14373) 11136 : cluster [DBG] pgmap v7722: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:54:36.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:54:35 smithi157 bash[24585]: cluster 2024-09-16T09:54:34.715665+0000 mgr.a (mgr.14373) 11136 : cluster [DBG] pgmap v7722: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:54:36.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:54:35 smithi086 bash[24289]: cluster 2024-09-16T09:54:34.715665+0000 mgr.a (mgr.14373) 11136 : cluster [DBG] pgmap v7722: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:54:38.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:54:37 smithi157 bash[24585]: cluster 2024-09-16T09:54:36.717810+0000 mgr.a (mgr.14373) 11137 : cluster [DBG] pgmap v7723: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:54:38.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:54:37 smithi086 bash[24289]: cluster 2024-09-16T09:54:36.717810+0000 mgr.a (mgr.14373) 11137 : cluster [DBG] pgmap v7723: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:54:38.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:54:37 smithi047 bash[22744]: cluster 2024-09-16T09:54:36.717810+0000 mgr.a (mgr.14373) 11137 : cluster [DBG] pgmap v7723: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:54:38.625 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:54:38.626 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:54:38.627 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:54:39.415 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:54:39.415 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:54:39.415 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:54:39.415 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:54:39.415 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:54:40.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:54:39 smithi157 bash[24585]: cluster 2024-09-16T09:54:38.718459+0000 mgr.a (mgr.14373) 11138 : cluster [DBG] pgmap v7724: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:54:40.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:54:39 smithi086 bash[24289]: cluster 2024-09-16T09:54:38.718459+0000 mgr.a (mgr.14373) 11138 : cluster [DBG] pgmap v7724: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:54:40.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:54:39 smithi047 bash[22744]: cluster 2024-09-16T09:54:38.718459+0000 mgr.a (mgr.14373) 11138 : cluster [DBG] pgmap v7724: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:54:41.309 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:54:40 smithi157 bash[24585]: audit 2024-09-16T09:54:38.961280+0000 mgr.a (mgr.14373) 11139 : audit [DBG] from='client.244473 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:54:41.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:54:40 smithi086 bash[24289]: audit 2024-09-16T09:54:38.961280+0000 mgr.a (mgr.14373) 11139 : audit [DBG] from='client.244473 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:54:41.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:54:40 smithi047 bash[22744]: audit 2024-09-16T09:54:38.961280+0000 mgr.a (mgr.14373) 11139 : audit [DBG] from='client.244473 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:54:42.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:54:41 smithi157 bash[24585]: cluster 2024-09-16T09:54:40.719329+0000 mgr.a (mgr.14373) 11140 : cluster [DBG] pgmap v7725: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:54:42.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:54:41 smithi086 bash[24289]: cluster 2024-09-16T09:54:40.719329+0000 mgr.a (mgr.14373) 11140 : cluster [DBG] pgmap v7725: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:54:42.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:54:41 smithi047 bash[22744]: cluster 2024-09-16T09:54:40.719329+0000 mgr.a (mgr.14373) 11140 : cluster [DBG] pgmap v7725: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:54:44.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:54:43 smithi157 bash[24585]: cluster 2024-09-16T09:54:42.721552+0000 mgr.a (mgr.14373) 11141 : cluster [DBG] pgmap v7726: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:54:44.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:54:43 smithi086 bash[24289]: cluster 2024-09-16T09:54:42.721552+0000 mgr.a (mgr.14373) 11141 : cluster [DBG] pgmap v7726: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:54:44.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:54:43 smithi047 bash[22744]: cluster 2024-09-16T09:54:42.721552+0000 mgr.a (mgr.14373) 11141 : cluster [DBG] pgmap v7726: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:54:44.416 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:54:44.417 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:54:44.417 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:54:45.181 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:54:45.181 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:54:45.182 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:54:45.182 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:54:45.182 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:54:46.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:54:45 smithi157 bash[24585]: cluster 2024-09-16T09:54:44.722426+0000 mgr.a (mgr.14373) 11142 : cluster [DBG] pgmap v7727: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:54:46.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:54:45 smithi157 bash[24585]: audit 2024-09-16T09:54:44.744939+0000 mgr.a (mgr.14373) 11143 : audit [DBG] from='client.244551 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:54:46.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:54:45 smithi086 bash[24289]: cluster 2024-09-16T09:54:44.722426+0000 mgr.a (mgr.14373) 11142 : cluster [DBG] pgmap v7727: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:54:46.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:54:45 smithi086 bash[24289]: audit 2024-09-16T09:54:44.744939+0000 mgr.a (mgr.14373) 11143 : audit [DBG] from='client.244551 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:54:46.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:54:45 smithi047 bash[22744]: cluster 2024-09-16T09:54:44.722426+0000 mgr.a (mgr.14373) 11142 : cluster [DBG] pgmap v7727: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:54:46.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:54:45 smithi047 bash[22744]: audit 2024-09-16T09:54:44.744939+0000 mgr.a (mgr.14373) 11143 : audit [DBG] from='client.244551 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:54:47.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:54:46 smithi157 bash[24585]: cluster 2024-09-16T09:54:46.724744+0000 mgr.a (mgr.14373) 11144 : cluster [DBG] pgmap v7728: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:54:47.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:54:46 smithi086 bash[24289]: cluster 2024-09-16T09:54:46.724744+0000 mgr.a (mgr.14373) 11144 : cluster [DBG] pgmap v7728: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:54:47.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:54:46 smithi047 bash[22744]: cluster 2024-09-16T09:54:46.724744+0000 mgr.a (mgr.14373) 11144 : cluster [DBG] pgmap v7728: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:54:50.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:54:49 smithi157 bash[24585]: cluster 2024-09-16T09:54:48.725529+0000 mgr.a (mgr.14373) 11145 : cluster [DBG] pgmap v7729: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:54:50.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:54:49 smithi086 bash[24289]: cluster 2024-09-16T09:54:48.725529+0000 mgr.a (mgr.14373) 11145 : cluster [DBG] pgmap v7729: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:54:50.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:54:49 smithi047 bash[22744]: cluster 2024-09-16T09:54:48.725529+0000 mgr.a (mgr.14373) 11145 : cluster [DBG] pgmap v7729: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:54:50.183 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:54:50.183 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:54:50.184 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:54:50.968 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:54:50.968 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:54:50.968 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:54:50.968 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:54:50.968 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:54:52.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:54:51 smithi157 bash[24585]: audit 2024-09-16T09:54:50.518461+0000 mgr.a (mgr.14373) 11146 : audit [DBG] from='client.244629 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:54:52.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:54:51 smithi157 bash[24585]: cluster 2024-09-16T09:54:50.726108+0000 mgr.a (mgr.14373) 11147 : cluster [DBG] pgmap v7730: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:54:52.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:54:51 smithi086 bash[24289]: audit 2024-09-16T09:54:50.518461+0000 mgr.a (mgr.14373) 11146 : audit [DBG] from='client.244629 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:54:52.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:54:51 smithi086 bash[24289]: cluster 2024-09-16T09:54:50.726108+0000 mgr.a (mgr.14373) 11147 : cluster [DBG] pgmap v7730: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:54:52.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:54:51 smithi047 bash[22744]: audit 2024-09-16T09:54:50.518461+0000 mgr.a (mgr.14373) 11146 : audit [DBG] from='client.244629 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:54:52.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:54:51 smithi047 bash[22744]: cluster 2024-09-16T09:54:50.726108+0000 mgr.a (mgr.14373) 11147 : cluster [DBG] pgmap v7730: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:54:54.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:54:53 smithi157 bash[24585]: cluster 2024-09-16T09:54:52.728435+0000 mgr.a (mgr.14373) 11148 : cluster [DBG] pgmap v7731: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:54:54.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:54:53 smithi086 bash[24289]: cluster 2024-09-16T09:54:52.728435+0000 mgr.a (mgr.14373) 11148 : cluster [DBG] pgmap v7731: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:54:54.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:54:53 smithi047 bash[22744]: cluster 2024-09-16T09:54:52.728435+0000 mgr.a (mgr.14373) 11148 : cluster [DBG] pgmap v7731: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:54:55.969 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:54:55.970 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:54:55.970 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:54:56.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:54:55 smithi157 bash[24585]: cluster 2024-09-16T09:54:54.729205+0000 mgr.a (mgr.14373) 11149 : cluster [DBG] pgmap v7732: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:54:56.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:54:55 smithi086 bash[24289]: cluster 2024-09-16T09:54:54.729205+0000 mgr.a (mgr.14373) 11149 : cluster [DBG] pgmap v7732: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:54:56.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:54:55 smithi047 bash[22744]: cluster 2024-09-16T09:54:54.729205+0000 mgr.a (mgr.14373) 11149 : cluster [DBG] pgmap v7732: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:54:56.738 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:54:56.738 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:54:56.738 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:54:56.738 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:54:56.738 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:54:58.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:54:57 smithi157 bash[24585]: audit 2024-09-16T09:54:56.304303+0000 mgr.a (mgr.14373) 11150 : audit [DBG] from='client.244707 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:54:58.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:54:57 smithi157 bash[24585]: cluster 2024-09-16T09:54:56.730406+0000 mgr.a (mgr.14373) 11151 : cluster [DBG] pgmap v7733: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:54:58.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:54:57 smithi086 bash[24289]: audit 2024-09-16T09:54:56.304303+0000 mgr.a (mgr.14373) 11150 : audit [DBG] from='client.244707 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:54:58.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:54:57 smithi086 bash[24289]: cluster 2024-09-16T09:54:56.730406+0000 mgr.a (mgr.14373) 11151 : cluster [DBG] pgmap v7733: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:54:58.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:54:57 smithi047 bash[22744]: audit 2024-09-16T09:54:56.304303+0000 mgr.a (mgr.14373) 11150 : audit [DBG] from='client.244707 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:54:58.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:54:57 smithi047 bash[22744]: cluster 2024-09-16T09:54:56.730406+0000 mgr.a (mgr.14373) 11151 : cluster [DBG] pgmap v7733: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:55:00.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:54:59 smithi157 bash[24585]: cluster 2024-09-16T09:54:58.731132+0000 mgr.a (mgr.14373) 11152 : cluster [DBG] pgmap v7734: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T09:55:00.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:54:59 smithi086 bash[24289]: cluster 2024-09-16T09:54:58.731132+0000 mgr.a (mgr.14373) 11152 : cluster [DBG] pgmap v7734: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T09:55:00.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:54:59 smithi047 bash[22744]: cluster 2024-09-16T09:54:58.731132+0000 mgr.a (mgr.14373) 11152 : cluster [DBG] pgmap v7734: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T09:55:01.739 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:55:01.740 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:55:01.740 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:55:02.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:55:01 smithi086 bash[24289]: cluster 2024-09-16T09:55:00.731887+0000 mgr.a (mgr.14373) 11153 : cluster [DBG] pgmap v7735: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T09:55:02.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:55:01 smithi047 bash[22744]: cluster 2024-09-16T09:55:00.731887+0000 mgr.a (mgr.14373) 11153 : cluster [DBG] pgmap v7735: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T09:55:02.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:55:01 smithi157 bash[24585]: cluster 2024-09-16T09:55:00.731887+0000 mgr.a (mgr.14373) 11153 : cluster [DBG] pgmap v7735: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T09:55:02.528 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:55:02.529 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:55:02.529 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:55:02.529 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:55:02.529 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:55:04.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:55:03 smithi086 bash[24289]: audit 2024-09-16T09:55:02.077625+0000 mgr.a (mgr.14373) 11154 : audit [DBG] from='client.244785 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:55:04.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:55:03 smithi086 bash[24289]: cluster 2024-09-16T09:55:02.734606+0000 mgr.a (mgr.14373) 11155 : cluster [DBG] pgmap v7736: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:55:04.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:55:03 smithi047 bash[22744]: audit 2024-09-16T09:55:02.077625+0000 mgr.a (mgr.14373) 11154 : audit [DBG] from='client.244785 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:55:04.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:55:03 smithi047 bash[22744]: cluster 2024-09-16T09:55:02.734606+0000 mgr.a (mgr.14373) 11155 : cluster [DBG] pgmap v7736: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:55:04.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:55:03 smithi157 bash[24585]: audit 2024-09-16T09:55:02.077625+0000 mgr.a (mgr.14373) 11154 : audit [DBG] from='client.244785 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:55:04.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:55:03 smithi157 bash[24585]: cluster 2024-09-16T09:55:02.734606+0000 mgr.a (mgr.14373) 11155 : cluster [DBG] pgmap v7736: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:55:06.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:55:05 smithi086 bash[24289]: cluster 2024-09-16T09:55:04.735369+0000 mgr.a (mgr.14373) 11156 : cluster [DBG] pgmap v7737: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T09:55:06.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:55:05 smithi047 bash[22744]: cluster 2024-09-16T09:55:04.735369+0000 mgr.a (mgr.14373) 11156 : cluster [DBG] pgmap v7737: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T09:55:06.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:55:05 smithi157 bash[24585]: cluster 2024-09-16T09:55:04.735369+0000 mgr.a (mgr.14373) 11156 : cluster [DBG] pgmap v7737: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T09:55:07.530 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:55:07.531 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:55:07.531 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:55:08.091 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:55:07 smithi047 bash[22744]: cluster 2024-09-16T09:55:06.737327+0000 mgr.a (mgr.14373) 11157 : cluster [DBG] pgmap v7738: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:55:08.304 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:55:08.305 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:55:08.305 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:55:08.305 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:55:08.305 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:55:08.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:55:07 smithi157 bash[24585]: cluster 2024-09-16T09:55:06.737327+0000 mgr.a (mgr.14373) 11157 : cluster [DBG] pgmap v7738: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:55:08.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:55:07 smithi086 bash[24289]: cluster 2024-09-16T09:55:06.737327+0000 mgr.a (mgr.14373) 11157 : cluster [DBG] pgmap v7738: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:55:09.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:55:08 smithi047 bash[22744]: audit 2024-09-16T09:55:07.864114+0000 mgr.a (mgr.14373) 11158 : audit [DBG] from='client.244863 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:55:09.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:55:08 smithi157 bash[24585]: audit 2024-09-16T09:55:07.864114+0000 mgr.a (mgr.14373) 11158 : audit [DBG] from='client.244863 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:55:09.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:55:08 smithi086 bash[24289]: audit 2024-09-16T09:55:07.864114+0000 mgr.a (mgr.14373) 11158 : audit [DBG] from='client.244863 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:55:10.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:55:09 smithi047 bash[22744]: cluster 2024-09-16T09:55:08.738208+0000 mgr.a (mgr.14373) 11159 : cluster [DBG] pgmap v7739: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:55:10.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:55:09 smithi157 bash[24585]: cluster 2024-09-16T09:55:08.738208+0000 mgr.a (mgr.14373) 11159 : cluster [DBG] pgmap v7739: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:55:10.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:55:09 smithi086 bash[24289]: cluster 2024-09-16T09:55:08.738208+0000 mgr.a (mgr.14373) 11159 : cluster [DBG] pgmap v7739: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:55:12.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:55:11 smithi047 bash[22744]: cluster 2024-09-16T09:55:10.738962+0000 mgr.a (mgr.14373) 11160 : cluster [DBG] pgmap v7740: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:55:12.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:55:11 smithi157 bash[24585]: cluster 2024-09-16T09:55:10.738962+0000 mgr.a (mgr.14373) 11160 : cluster [DBG] pgmap v7740: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:55:12.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:55:11 smithi086 bash[24289]: cluster 2024-09-16T09:55:10.738962+0000 mgr.a (mgr.14373) 11160 : cluster [DBG] pgmap v7740: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:55:13.306 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:55:13.307 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:55:13.307 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:55:14.063 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:55:14.063 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:55:14.063 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:55:14.063 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:55:14.064 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:55:14.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:55:13 smithi047 bash[22744]: cluster 2024-09-16T09:55:12.741157+0000 mgr.a (mgr.14373) 11161 : cluster [DBG] pgmap v7741: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:55:14.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:55:13 smithi157 bash[24585]: cluster 2024-09-16T09:55:12.741157+0000 mgr.a (mgr.14373) 11161 : cluster [DBG] pgmap v7741: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:55:14.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:55:13 smithi086 bash[24289]: cluster 2024-09-16T09:55:12.741157+0000 mgr.a (mgr.14373) 11161 : cluster [DBG] pgmap v7741: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:55:15.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:55:14 smithi047 bash[22744]: audit 2024-09-16T09:55:13.640746+0000 mgr.a (mgr.14373) 11162 : audit [DBG] from='client.244935 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:55:15.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:55:14 smithi157 bash[24585]: audit 2024-09-16T09:55:13.640746+0000 mgr.a (mgr.14373) 11162 : audit [DBG] from='client.244935 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:55:15.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:55:14 smithi086 bash[24289]: audit 2024-09-16T09:55:13.640746+0000 mgr.a (mgr.14373) 11162 : audit [DBG] from='client.244935 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:55:16.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:55:15 smithi157 bash[24585]: cluster 2024-09-16T09:55:14.742203+0000 mgr.a (mgr.14373) 11163 : cluster [DBG] pgmap v7742: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:55:16.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:55:15 smithi086 bash[24289]: cluster 2024-09-16T09:55:14.742203+0000 mgr.a (mgr.14373) 11163 : cluster [DBG] pgmap v7742: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:55:16.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:55:15 smithi047 bash[22744]: cluster 2024-09-16T09:55:14.742203+0000 mgr.a (mgr.14373) 11163 : cluster [DBG] pgmap v7742: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:55:18.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:55:17 smithi157 bash[24585]: cluster 2024-09-16T09:55:16.744541+0000 mgr.a (mgr.14373) 11164 : cluster [DBG] pgmap v7743: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:55:18.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:55:17 smithi157 bash[24585]: audit 2024-09-16T09:55:17.395481+0000 mon.b (mon.2) 1030 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T09:55:18.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:55:17 smithi086 bash[24289]: cluster 2024-09-16T09:55:16.744541+0000 mgr.a (mgr.14373) 11164 : cluster [DBG] pgmap v7743: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:55:18.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:55:17 smithi086 bash[24289]: audit 2024-09-16T09:55:17.395481+0000 mon.b (mon.2) 1030 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T09:55:18.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:55:17 smithi047 bash[22744]: cluster 2024-09-16T09:55:16.744541+0000 mgr.a (mgr.14373) 11164 : cluster [DBG] pgmap v7743: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:55:18.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:55:17 smithi047 bash[22744]: audit 2024-09-16T09:55:17.395481+0000 mon.b (mon.2) 1030 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T09:55:19.064 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:55:19.065 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:55:19.065 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:55:19.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:55:19 smithi157 bash[24585]: audit 2024-09-16T09:55:18.002001+0000 mon.a (mon.0) 1233 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:55:19.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:55:19 smithi157 bash[24585]: audit 2024-09-16T09:55:18.008865+0000 mon.a (mon.0) 1234 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:55:19.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:55:19 smithi157 bash[24585]: audit 2024-09-16T09:55:18.651893+0000 mon.b (mon.2) 1031 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:55:19.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:55:19 smithi157 bash[24585]: audit 2024-09-16T09:55:18.654121+0000 mon.b (mon.2) 1032 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T09:55:19.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:55:19 smithi157 bash[24585]: audit 2024-09-16T09:55:18.661867+0000 mon.a (mon.0) 1235 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:55:19.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:55:19 smithi157 bash[24585]: audit 2024-09-16T09:55:18.666843+0000 mon.b (mon.2) 1033 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:55:19.308 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:55:19 smithi157 bash[24585]: audit 2024-09-16T09:55:18.669314+0000 mgr.a (mgr.14373) 11165 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:55:19.308 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:55:19 smithi157 bash[24585]: cluster 2024-09-16T09:55:18.745100+0000 mgr.a (mgr.14373) 11166 : cluster [DBG] pgmap v7744: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:55:19.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:55:19 smithi086 bash[24289]: audit 2024-09-16T09:55:18.002001+0000 mon.a (mon.0) 1233 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:55:19.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:55:19 smithi086 bash[24289]: audit 2024-09-16T09:55:18.008865+0000 mon.a (mon.0) 1234 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:55:19.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:55:19 smithi086 bash[24289]: audit 2024-09-16T09:55:18.651893+0000 mon.b (mon.2) 1031 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:55:19.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:55:19 smithi086 bash[24289]: audit 2024-09-16T09:55:18.654121+0000 mon.b (mon.2) 1032 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T09:55:19.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:55:19 smithi086 bash[24289]: audit 2024-09-16T09:55:18.661867+0000 mon.a (mon.0) 1235 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:55:19.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:55:19 smithi086 bash[24289]: audit 2024-09-16T09:55:18.666843+0000 mon.b (mon.2) 1033 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:55:19.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:55:19 smithi086 bash[24289]: audit 2024-09-16T09:55:18.669314+0000 mgr.a (mgr.14373) 11165 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:55:19.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:55:19 smithi086 bash[24289]: cluster 2024-09-16T09:55:18.745100+0000 mgr.a (mgr.14373) 11166 : cluster [DBG] pgmap v7744: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:55:19.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:55:19 smithi047 bash[22744]: audit 2024-09-16T09:55:18.002001+0000 mon.a (mon.0) 1233 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:55:19.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:55:19 smithi047 bash[22744]: audit 2024-09-16T09:55:18.008865+0000 mon.a (mon.0) 1234 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:55:19.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:55:19 smithi047 bash[22744]: audit 2024-09-16T09:55:18.651893+0000 mon.b (mon.2) 1031 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:55:19.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:55:19 smithi047 bash[22744]: audit 2024-09-16T09:55:18.654121+0000 mon.b (mon.2) 1032 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T09:55:19.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:55:19 smithi047 bash[22744]: audit 2024-09-16T09:55:18.661867+0000 mon.a (mon.0) 1235 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:55:19.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:55:19 smithi047 bash[22744]: audit 2024-09-16T09:55:18.666843+0000 mon.b (mon.2) 1033 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:55:19.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:55:19 smithi047 bash[22744]: audit 2024-09-16T09:55:18.669314+0000 mgr.a (mgr.14373) 11165 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:55:19.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:55:19 smithi047 bash[22744]: cluster 2024-09-16T09:55:18.745100+0000 mgr.a (mgr.14373) 11166 : cluster [DBG] pgmap v7744: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:55:19.805 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:55:19.805 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:55:19.805 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:55:19.805 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:55:19.806 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:55:19.842 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 09:55:19 smithi047 bash[22994]: debug 2024-09-16T09:55:19.400+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T09:55:19.842 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 09:55:19 smithi047 bash[22994]: debug 2024-09-16T09:55:19.412+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T09:55:21.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:55:20 smithi157 bash[24585]: audit 2024-09-16T09:55:19.402100+0000 mgr.a (mgr.14373) 11167 : audit [DBG] from='client.245088 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:55:21.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:55:20 smithi157 bash[24585]: audit 2024-09-16T09:55:19.404395+0000 mgr.a (mgr.14373) 11168 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T09:55:21.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:55:20 smithi157 bash[24585]: cephadm 2024-09-16T09:55:19.415648+0000 mgr.a (mgr.14373) 11169 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T09:55:21.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:55:20 smithi086 bash[24289]: audit 2024-09-16T09:55:19.402100+0000 mgr.a (mgr.14373) 11167 : audit [DBG] from='client.245088 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:55:21.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:55:20 smithi086 bash[24289]: audit 2024-09-16T09:55:19.404395+0000 mgr.a (mgr.14373) 11168 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T09:55:21.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:55:20 smithi086 bash[24289]: cephadm 2024-09-16T09:55:19.415648+0000 mgr.a (mgr.14373) 11169 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T09:55:21.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:55:20 smithi047 bash[22744]: audit 2024-09-16T09:55:19.402100+0000 mgr.a (mgr.14373) 11167 : audit [DBG] from='client.245088 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:55:21.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:55:20 smithi047 bash[22744]: audit 2024-09-16T09:55:19.404395+0000 mgr.a (mgr.14373) 11168 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T09:55:21.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:55:20 smithi047 bash[22744]: cephadm 2024-09-16T09:55:19.415648+0000 mgr.a (mgr.14373) 11169 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T09:55:22.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:55:21 smithi157 bash[24585]: cluster 2024-09-16T09:55:20.745968+0000 mgr.a (mgr.14373) 11170 : cluster [DBG] pgmap v7745: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:55:22.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:55:21 smithi086 bash[24289]: cluster 2024-09-16T09:55:20.745968+0000 mgr.a (mgr.14373) 11170 : cluster [DBG] pgmap v7745: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:55:22.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:55:21 smithi047 bash[22744]: cluster 2024-09-16T09:55:20.745968+0000 mgr.a (mgr.14373) 11170 : cluster [DBG] pgmap v7745: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:55:24.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:55:23 smithi086 bash[24289]: cluster 2024-09-16T09:55:22.748220+0000 mgr.a (mgr.14373) 11171 : cluster [DBG] pgmap v7746: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:55:24.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:55:23 smithi047 bash[22744]: cluster 2024-09-16T09:55:22.748220+0000 mgr.a (mgr.14373) 11171 : cluster [DBG] pgmap v7746: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:55:24.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:55:23 smithi157 bash[24585]: cluster 2024-09-16T09:55:22.748220+0000 mgr.a (mgr.14373) 11171 : cluster [DBG] pgmap v7746: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:55:24.807 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:55:24.808 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:55:24.808 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:55:25.596 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:55:25.596 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:55:25.596 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:55:25.596 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:55:25.596 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:55:26.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:55:25 smithi086 bash[24289]: cluster 2024-09-16T09:55:24.748983+0000 mgr.a (mgr.14373) 11172 : cluster [DBG] pgmap v7747: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:55:26.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:55:25 smithi047 bash[22744]: cluster 2024-09-16T09:55:24.748983+0000 mgr.a (mgr.14373) 11172 : cluster [DBG] pgmap v7747: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:55:26.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:55:25 smithi157 bash[24585]: cluster 2024-09-16T09:55:24.748983+0000 mgr.a (mgr.14373) 11172 : cluster [DBG] pgmap v7747: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:55:27.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:55:26 smithi086 bash[24289]: audit 2024-09-16T09:55:25.143503+0000 mgr.a (mgr.14373) 11173 : audit [DBG] from='client.245196 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:55:27.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:55:26 smithi047 bash[22744]: audit 2024-09-16T09:55:25.143503+0000 mgr.a (mgr.14373) 11173 : audit [DBG] from='client.245196 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:55:27.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:55:26 smithi157 bash[24585]: audit 2024-09-16T09:55:25.143503+0000 mgr.a (mgr.14373) 11173 : audit [DBG] from='client.245196 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:55:28.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:55:27 smithi047 bash[22744]: cluster 2024-09-16T09:55:26.751286+0000 mgr.a (mgr.14373) 11174 : cluster [DBG] pgmap v7748: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:55:28.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:55:27 smithi157 bash[24585]: cluster 2024-09-16T09:55:26.751286+0000 mgr.a (mgr.14373) 11174 : cluster [DBG] pgmap v7748: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:55:28.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:55:27 smithi086 bash[24289]: cluster 2024-09-16T09:55:26.751286+0000 mgr.a (mgr.14373) 11174 : cluster [DBG] pgmap v7748: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:55:30.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:55:29 smithi047 bash[22744]: cluster 2024-09-16T09:55:28.752060+0000 mgr.a (mgr.14373) 11175 : cluster [DBG] pgmap v7749: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:55:30.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:55:29 smithi157 bash[24585]: cluster 2024-09-16T09:55:28.752060+0000 mgr.a (mgr.14373) 11175 : cluster [DBG] pgmap v7749: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:55:30.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:55:29 smithi086 bash[24289]: cluster 2024-09-16T09:55:28.752060+0000 mgr.a (mgr.14373) 11175 : cluster [DBG] pgmap v7749: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:55:30.597 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:55:30.598 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:55:30.598 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:55:31.376 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:55:31.376 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:55:31.377 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:55:31.377 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:55:31.377 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:55:32.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:55:31 smithi047 bash[22744]: cluster 2024-09-16T09:55:30.752537+0000 mgr.a (mgr.14373) 11176 : cluster [DBG] pgmap v7750: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:55:32.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:55:31 smithi157 bash[24585]: cluster 2024-09-16T09:55:30.752537+0000 mgr.a (mgr.14373) 11176 : cluster [DBG] pgmap v7750: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:55:32.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:55:31 smithi086 bash[24289]: cluster 2024-09-16T09:55:30.752537+0000 mgr.a (mgr.14373) 11176 : cluster [DBG] pgmap v7750: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:55:33.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:55:32 smithi047 bash[22744]: audit 2024-09-16T09:55:30.936763+0000 mgr.a (mgr.14373) 11177 : audit [DBG] from='client.245271 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:55:33.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:55:32 smithi157 bash[24585]: audit 2024-09-16T09:55:30.936763+0000 mgr.a (mgr.14373) 11177 : audit [DBG] from='client.245271 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:55:33.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:55:32 smithi086 bash[24289]: audit 2024-09-16T09:55:30.936763+0000 mgr.a (mgr.14373) 11177 : audit [DBG] from='client.245271 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:55:34.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:55:33 smithi047 bash[22744]: cluster 2024-09-16T09:55:32.755164+0000 mgr.a (mgr.14373) 11178 : cluster [DBG] pgmap v7751: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:55:34.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:55:33 smithi157 bash[24585]: cluster 2024-09-16T09:55:32.755164+0000 mgr.a (mgr.14373) 11178 : cluster [DBG] pgmap v7751: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:55:34.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:55:33 smithi086 bash[24289]: cluster 2024-09-16T09:55:32.755164+0000 mgr.a (mgr.14373) 11178 : cluster [DBG] pgmap v7751: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:55:36.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:55:35 smithi157 bash[24585]: cluster 2024-09-16T09:55:34.755934+0000 mgr.a (mgr.14373) 11179 : cluster [DBG] pgmap v7752: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:55:36.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:55:35 smithi086 bash[24289]: cluster 2024-09-16T09:55:34.755934+0000 mgr.a (mgr.14373) 11179 : cluster [DBG] pgmap v7752: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:55:36.347 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:55:35 smithi047 bash[22744]: cluster 2024-09-16T09:55:34.755934+0000 mgr.a (mgr.14373) 11179 : cluster [DBG] pgmap v7752: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:55:36.378 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:55:36.380 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:55:36.380 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:55:37.165 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:55:37.165 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:55:37.166 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:55:37.166 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:55:37.166 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:55:38.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:55:37 smithi157 bash[24585]: audit 2024-09-16T09:55:36.713219+0000 mgr.a (mgr.14373) 11180 : audit [DBG] from='client.245346 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:55:38.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:55:37 smithi157 bash[24585]: cluster 2024-09-16T09:55:36.758945+0000 mgr.a (mgr.14373) 11181 : cluster [DBG] pgmap v7753: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:55:38.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:55:37 smithi086 bash[24289]: audit 2024-09-16T09:55:36.713219+0000 mgr.a (mgr.14373) 11180 : audit [DBG] from='client.245346 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:55:38.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:55:37 smithi086 bash[24289]: cluster 2024-09-16T09:55:36.758945+0000 mgr.a (mgr.14373) 11181 : cluster [DBG] pgmap v7753: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:55:38.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:55:37 smithi047 bash[22744]: audit 2024-09-16T09:55:36.713219+0000 mgr.a (mgr.14373) 11180 : audit [DBG] from='client.245346 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:55:38.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:55:37 smithi047 bash[22744]: cluster 2024-09-16T09:55:36.758945+0000 mgr.a (mgr.14373) 11181 : cluster [DBG] pgmap v7753: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:55:40.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:55:39 smithi157 bash[24585]: cluster 2024-09-16T09:55:38.759960+0000 mgr.a (mgr.14373) 11182 : cluster [DBG] pgmap v7754: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:55:40.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:55:39 smithi086 bash[24289]: cluster 2024-09-16T09:55:38.759960+0000 mgr.a (mgr.14373) 11182 : cluster [DBG] pgmap v7754: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:55:40.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:55:39 smithi047 bash[22744]: cluster 2024-09-16T09:55:38.759960+0000 mgr.a (mgr.14373) 11182 : cluster [DBG] pgmap v7754: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:55:42.167 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:55:42.168 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:55:42.168 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:55:42.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:55:41 smithi157 bash[24585]: cluster 2024-09-16T09:55:40.760735+0000 mgr.a (mgr.14373) 11183 : cluster [DBG] pgmap v7755: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:55:42.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:55:41 smithi086 bash[24289]: cluster 2024-09-16T09:55:40.760735+0000 mgr.a (mgr.14373) 11183 : cluster [DBG] pgmap v7755: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:55:42.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:55:41 smithi047 bash[22744]: cluster 2024-09-16T09:55:40.760735+0000 mgr.a (mgr.14373) 11183 : cluster [DBG] pgmap v7755: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:55:42.913 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:55:42.913 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:55:42.914 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:55:42.914 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:55:42.914 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:55:44.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:55:43 smithi157 bash[24585]: audit 2024-09-16T09:55:42.488482+0000 mgr.a (mgr.14373) 11184 : audit [DBG] from='client.245421 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:55:44.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:55:43 smithi157 bash[24585]: cluster 2024-09-16T09:55:42.762065+0000 mgr.a (mgr.14373) 11185 : cluster [DBG] pgmap v7756: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:55:44.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:55:43 smithi086 bash[24289]: audit 2024-09-16T09:55:42.488482+0000 mgr.a (mgr.14373) 11184 : audit [DBG] from='client.245421 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:55:44.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:55:43 smithi086 bash[24289]: cluster 2024-09-16T09:55:42.762065+0000 mgr.a (mgr.14373) 11185 : cluster [DBG] pgmap v7756: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:55:44.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:55:43 smithi047 bash[22744]: audit 2024-09-16T09:55:42.488482+0000 mgr.a (mgr.14373) 11184 : audit [DBG] from='client.245421 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:55:44.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:55:43 smithi047 bash[22744]: cluster 2024-09-16T09:55:42.762065+0000 mgr.a (mgr.14373) 11185 : cluster [DBG] pgmap v7756: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:55:46.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:55:45 smithi157 bash[24585]: cluster 2024-09-16T09:55:44.762961+0000 mgr.a (mgr.14373) 11186 : cluster [DBG] pgmap v7757: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:55:46.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:55:45 smithi086 bash[24289]: cluster 2024-09-16T09:55:44.762961+0000 mgr.a (mgr.14373) 11186 : cluster [DBG] pgmap v7757: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:55:46.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:55:45 smithi047 bash[22744]: cluster 2024-09-16T09:55:44.762961+0000 mgr.a (mgr.14373) 11186 : cluster [DBG] pgmap v7757: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:55:47.915 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:55:47.916 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:55:47.916 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:55:48.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:55:47 smithi157 bash[24585]: cluster 2024-09-16T09:55:46.765089+0000 mgr.a (mgr.14373) 11187 : cluster [DBG] pgmap v7758: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:55:48.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:55:47 smithi086 bash[24289]: cluster 2024-09-16T09:55:46.765089+0000 mgr.a (mgr.14373) 11187 : cluster [DBG] pgmap v7758: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:55:48.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:55:47 smithi047 bash[22744]: cluster 2024-09-16T09:55:46.765089+0000 mgr.a (mgr.14373) 11187 : cluster [DBG] pgmap v7758: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:55:48.656 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:55:48.656 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:55:48.656 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:55:48.656 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:55:48.656 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:55:50.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:55:49 smithi157 bash[24585]: audit 2024-09-16T09:55:48.244995+0000 mgr.a (mgr.14373) 11188 : audit [DBG] from='client.245499 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:55:50.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:55:49 smithi157 bash[24585]: cluster 2024-09-16T09:55:48.765795+0000 mgr.a (mgr.14373) 11189 : cluster [DBG] pgmap v7759: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:55:50.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:55:49 smithi086 bash[24289]: audit 2024-09-16T09:55:48.244995+0000 mgr.a (mgr.14373) 11188 : audit [DBG] from='client.245499 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:55:50.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:55:49 smithi086 bash[24289]: cluster 2024-09-16T09:55:48.765795+0000 mgr.a (mgr.14373) 11189 : cluster [DBG] pgmap v7759: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:55:50.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:55:49 smithi047 bash[22744]: audit 2024-09-16T09:55:48.244995+0000 mgr.a (mgr.14373) 11188 : audit [DBG] from='client.245499 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:55:50.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:55:49 smithi047 bash[22744]: cluster 2024-09-16T09:55:48.765795+0000 mgr.a (mgr.14373) 11189 : cluster [DBG] pgmap v7759: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:55:52.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:55:51 smithi157 bash[24585]: cluster 2024-09-16T09:55:50.766603+0000 mgr.a (mgr.14373) 11190 : cluster [DBG] pgmap v7760: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:55:52.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:55:51 smithi086 bash[24289]: cluster 2024-09-16T09:55:50.766603+0000 mgr.a (mgr.14373) 11190 : cluster [DBG] pgmap v7760: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:55:52.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:55:51 smithi047 bash[22744]: cluster 2024-09-16T09:55:50.766603+0000 mgr.a (mgr.14373) 11190 : cluster [DBG] pgmap v7760: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:55:53.658 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:55:53.658 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:55:53.658 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:55:54.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:55:53 smithi157 bash[24585]: cluster 2024-09-16T09:55:52.768766+0000 mgr.a (mgr.14373) 11191 : cluster [DBG] pgmap v7761: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:55:54.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:55:53 smithi086 bash[24289]: cluster 2024-09-16T09:55:52.768766+0000 mgr.a (mgr.14373) 11191 : cluster [DBG] pgmap v7761: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:55:54.341 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:55:53 smithi047 bash[22744]: cluster 2024-09-16T09:55:52.768766+0000 mgr.a (mgr.14373) 11191 : cluster [DBG] pgmap v7761: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:55:54.394 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:55:54.394 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:55:54.394 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:55:54.394 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:55:54.394 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:55:56.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:55:55 smithi157 bash[24585]: audit 2024-09-16T09:55:53.975406+0000 mgr.a (mgr.14373) 11192 : audit [DBG] from='client.245577 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:55:56.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:55:55 smithi157 bash[24585]: cluster 2024-09-16T09:55:54.769857+0000 mgr.a (mgr.14373) 11193 : cluster [DBG] pgmap v7762: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:55:56.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:55:55 smithi086 bash[24289]: audit 2024-09-16T09:55:53.975406+0000 mgr.a (mgr.14373) 11192 : audit [DBG] from='client.245577 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:55:56.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:55:55 smithi086 bash[24289]: cluster 2024-09-16T09:55:54.769857+0000 mgr.a (mgr.14373) 11193 : cluster [DBG] pgmap v7762: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:55:56.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:55:55 smithi047 bash[22744]: audit 2024-09-16T09:55:53.975406+0000 mgr.a (mgr.14373) 11192 : audit [DBG] from='client.245577 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:55:56.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:55:55 smithi047 bash[22744]: cluster 2024-09-16T09:55:54.769857+0000 mgr.a (mgr.14373) 11193 : cluster [DBG] pgmap v7762: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:55:58.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:55:57 smithi157 bash[24585]: cluster 2024-09-16T09:55:56.772089+0000 mgr.a (mgr.14373) 11194 : cluster [DBG] pgmap v7763: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:55:58.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:55:57 smithi086 bash[24289]: cluster 2024-09-16T09:55:56.772089+0000 mgr.a (mgr.14373) 11194 : cluster [DBG] pgmap v7763: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:55:58.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:55:57 smithi047 bash[22744]: cluster 2024-09-16T09:55:56.772089+0000 mgr.a (mgr.14373) 11194 : cluster [DBG] pgmap v7763: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:55:59.396 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:55:59.396 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:55:59.396 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:56:00.181 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:56:00.182 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:56:00.182 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:56:00.182 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:56:00.182 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:56:00.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:55:59 smithi157 bash[24585]: cluster 2024-09-16T09:55:58.772848+0000 mgr.a (mgr.14373) 11195 : cluster [DBG] pgmap v7764: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:56:00.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:55:59 smithi086 bash[24289]: cluster 2024-09-16T09:55:58.772848+0000 mgr.a (mgr.14373) 11195 : cluster [DBG] pgmap v7764: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:56:00.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:55:59 smithi047 bash[22744]: cluster 2024-09-16T09:55:58.772848+0000 mgr.a (mgr.14373) 11195 : cluster [DBG] pgmap v7764: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:56:01.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:56:00 smithi157 bash[24585]: audit 2024-09-16T09:55:59.727455+0000 mgr.a (mgr.14373) 11196 : audit [DBG] from='client.245655 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:56:01.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:56:00 smithi157 bash[24585]: cluster 2024-09-16T09:56:00.773817+0000 mgr.a (mgr.14373) 11197 : cluster [DBG] pgmap v7765: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:56:01.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:56:00 smithi086 bash[24289]: audit 2024-09-16T09:55:59.727455+0000 mgr.a (mgr.14373) 11196 : audit [DBG] from='client.245655 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:56:01.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:56:00 smithi086 bash[24289]: cluster 2024-09-16T09:56:00.773817+0000 mgr.a (mgr.14373) 11197 : cluster [DBG] pgmap v7765: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:56:01.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:56:00 smithi047 bash[22744]: audit 2024-09-16T09:55:59.727455+0000 mgr.a (mgr.14373) 11196 : audit [DBG] from='client.245655 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:56:01.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:56:00 smithi047 bash[22744]: cluster 2024-09-16T09:56:00.773817+0000 mgr.a (mgr.14373) 11197 : cluster [DBG] pgmap v7765: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:56:04.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:56:03 smithi047 bash[22744]: cluster 2024-09-16T09:56:02.776034+0000 mgr.a (mgr.14373) 11198 : cluster [DBG] pgmap v7766: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:56:04.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:56:03 smithi157 bash[24585]: cluster 2024-09-16T09:56:02.776034+0000 mgr.a (mgr.14373) 11198 : cluster [DBG] pgmap v7766: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:56:04.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:56:03 smithi086 bash[24289]: cluster 2024-09-16T09:56:02.776034+0000 mgr.a (mgr.14373) 11198 : cluster [DBG] pgmap v7766: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:56:05.183 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:56:05.184 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:56:05.184 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:56:05.962 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:56:05.962 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:56:05.962 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:56:05.962 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:56:05.962 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:56:06.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:56:05 smithi047 bash[22744]: cluster 2024-09-16T09:56:04.776811+0000 mgr.a (mgr.14373) 11199 : cluster [DBG] pgmap v7767: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:56:06.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:56:05 smithi157 bash[24585]: cluster 2024-09-16T09:56:04.776811+0000 mgr.a (mgr.14373) 11199 : cluster [DBG] pgmap v7767: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:56:06.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:56:05 smithi086 bash[24289]: cluster 2024-09-16T09:56:04.776811+0000 mgr.a (mgr.14373) 11199 : cluster [DBG] pgmap v7767: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:56:07.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:56:06 smithi157 bash[24585]: audit 2024-09-16T09:56:05.516278+0000 mgr.a (mgr.14373) 11200 : audit [DBG] from='client.245730 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:56:07.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:56:06 smithi086 bash[24289]: audit 2024-09-16T09:56:05.516278+0000 mgr.a (mgr.14373) 11200 : audit [DBG] from='client.245730 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:56:07.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:56:06 smithi047 bash[22744]: audit 2024-09-16T09:56:05.516278+0000 mgr.a (mgr.14373) 11200 : audit [DBG] from='client.245730 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:56:08.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:56:07 smithi157 bash[24585]: cluster 2024-09-16T09:56:06.779204+0000 mgr.a (mgr.14373) 11201 : cluster [DBG] pgmap v7768: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:56:08.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:56:07 smithi086 bash[24289]: cluster 2024-09-16T09:56:06.779204+0000 mgr.a (mgr.14373) 11201 : cluster [DBG] pgmap v7768: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:56:08.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:56:07 smithi047 bash[22744]: cluster 2024-09-16T09:56:06.779204+0000 mgr.a (mgr.14373) 11201 : cluster [DBG] pgmap v7768: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:56:10.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:56:09 smithi157 bash[24585]: cluster 2024-09-16T09:56:08.779979+0000 mgr.a (mgr.14373) 11202 : cluster [DBG] pgmap v7769: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:56:10.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:56:09 smithi086 bash[24289]: cluster 2024-09-16T09:56:08.779979+0000 mgr.a (mgr.14373) 11202 : cluster [DBG] pgmap v7769: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:56:10.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:56:09 smithi047 bash[22744]: cluster 2024-09-16T09:56:08.779979+0000 mgr.a (mgr.14373) 11202 : cluster [DBG] pgmap v7769: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:56:10.963 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:56:10.964 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:56:10.964 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:56:11.745 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:56:11.745 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:56:11.746 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:56:11.746 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:56:11.746 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:56:12.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:56:11 smithi157 bash[24585]: cluster 2024-09-16T09:56:10.780723+0000 mgr.a (mgr.14373) 11203 : cluster [DBG] pgmap v7770: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:56:12.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:56:11 smithi086 bash[24289]: cluster 2024-09-16T09:56:10.780723+0000 mgr.a (mgr.14373) 11203 : cluster [DBG] pgmap v7770: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:56:12.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:56:11 smithi047 bash[22744]: cluster 2024-09-16T09:56:10.780723+0000 mgr.a (mgr.14373) 11203 : cluster [DBG] pgmap v7770: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:56:13.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:56:12 smithi157 bash[24585]: audit 2024-09-16T09:56:11.301427+0000 mgr.a (mgr.14373) 11204 : audit [DBG] from='client.245805 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:56:13.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:56:12 smithi086 bash[24289]: audit 2024-09-16T09:56:11.301427+0000 mgr.a (mgr.14373) 11204 : audit [DBG] from='client.245805 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:56:13.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:56:12 smithi047 bash[22744]: audit 2024-09-16T09:56:11.301427+0000 mgr.a (mgr.14373) 11204 : audit [DBG] from='client.245805 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:56:14.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:56:13 smithi157 bash[24585]: cluster 2024-09-16T09:56:12.783566+0000 mgr.a (mgr.14373) 11205 : cluster [DBG] pgmap v7771: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:56:14.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:56:13 smithi086 bash[24289]: cluster 2024-09-16T09:56:12.783566+0000 mgr.a (mgr.14373) 11205 : cluster [DBG] pgmap v7771: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:56:14.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:56:13 smithi047 bash[22744]: cluster 2024-09-16T09:56:12.783566+0000 mgr.a (mgr.14373) 11205 : cluster [DBG] pgmap v7771: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:56:16.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:56:15 smithi157 bash[24585]: cluster 2024-09-16T09:56:14.784354+0000 mgr.a (mgr.14373) 11206 : cluster [DBG] pgmap v7772: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:56:16.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:56:15 smithi086 bash[24289]: cluster 2024-09-16T09:56:14.784354+0000 mgr.a (mgr.14373) 11206 : cluster [DBG] pgmap v7772: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:56:16.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:56:15 smithi047 bash[22744]: cluster 2024-09-16T09:56:14.784354+0000 mgr.a (mgr.14373) 11206 : cluster [DBG] pgmap v7772: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:56:16.747 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:56:16.747 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:56:16.748 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:56:17.504 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:56:17.504 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:56:17.504 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:56:17.505 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:56:17.505 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:56:18.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:56:17 smithi157 bash[24585]: cluster 2024-09-16T09:56:16.785661+0000 mgr.a (mgr.14373) 11207 : cluster [DBG] pgmap v7773: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:56:18.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:56:17 smithi086 bash[24289]: cluster 2024-09-16T09:56:16.785661+0000 mgr.a (mgr.14373) 11207 : cluster [DBG] pgmap v7773: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:56:18.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:56:17 smithi047 bash[22744]: cluster 2024-09-16T09:56:16.785661+0000 mgr.a (mgr.14373) 11207 : cluster [DBG] pgmap v7773: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:56:19.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:56:18 smithi157 bash[24585]: audit 2024-09-16T09:56:17.079197+0000 mgr.a (mgr.14373) 11208 : audit [DBG] from='client.245883 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:56:19.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:56:18 smithi086 bash[24289]: audit 2024-09-16T09:56:17.079197+0000 mgr.a (mgr.14373) 11208 : audit [DBG] from='client.245883 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:56:19.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:56:18 smithi047 bash[22744]: audit 2024-09-16T09:56:17.079197+0000 mgr.a (mgr.14373) 11208 : audit [DBG] from='client.245883 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:56:20.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:56:19 smithi157 bash[24585]: cluster 2024-09-16T09:56:18.786627+0000 mgr.a (mgr.14373) 11209 : cluster [DBG] pgmap v7774: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:56:20.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:56:19 smithi157 bash[24585]: audit 2024-09-16T09:56:19.471053+0000 mon.b (mon.2) 1034 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T09:56:20.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:56:19 smithi086 bash[24289]: cluster 2024-09-16T09:56:18.786627+0000 mgr.a (mgr.14373) 11209 : cluster [DBG] pgmap v7774: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:56:20.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:56:19 smithi086 bash[24289]: audit 2024-09-16T09:56:19.471053+0000 mon.b (mon.2) 1034 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T09:56:20.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:56:19 smithi047 bash[22744]: cluster 2024-09-16T09:56:18.786627+0000 mgr.a (mgr.14373) 11209 : cluster [DBG] pgmap v7774: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:56:20.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:56:19 smithi047 bash[22744]: audit 2024-09-16T09:56:19.471053+0000 mon.b (mon.2) 1034 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T09:56:21.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:56:21 smithi047 bash[22744]: audit 2024-09-16T09:56:20.081770+0000 mon.a (mon.0) 1236 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:56:21.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:56:21 smithi047 bash[22744]: audit 2024-09-16T09:56:20.085876+0000 mon.a (mon.0) 1237 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:56:21.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:56:21 smithi047 bash[22744]: audit 2024-09-16T09:56:20.092764+0000 mon.a (mon.0) 1238 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:56:21.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:56:21 smithi047 bash[22744]: audit 2024-09-16T09:56:20.096435+0000 mon.a (mon.0) 1239 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:56:21.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:56:21 smithi047 bash[22744]: audit 2024-09-16T09:56:20.753573+0000 mon.b (mon.2) 1035 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:56:21.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:56:21 smithi047 bash[22744]: audit 2024-09-16T09:56:20.755651+0000 mon.b (mon.2) 1036 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T09:56:21.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:56:21 smithi047 bash[22744]: audit 2024-09-16T09:56:20.764993+0000 mon.a (mon.0) 1240 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:56:21.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:56:21 smithi047 bash[22744]: audit 2024-09-16T09:56:20.772072+0000 mon.b (mon.2) 1037 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:56:21.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:56:21 smithi047 bash[22744]: audit 2024-09-16T09:56:20.774779+0000 mgr.a (mgr.14373) 11210 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:56:21.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:56:21 smithi047 bash[22744]: cluster 2024-09-16T09:56:20.791308+0000 mgr.a (mgr.14373) 11211 : cluster [DBG] pgmap v7775: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:56:21.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:56:21 smithi157 bash[24585]: audit 2024-09-16T09:56:20.081770+0000 mon.a (mon.0) 1236 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:56:21.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:56:21 smithi157 bash[24585]: audit 2024-09-16T09:56:20.085876+0000 mon.a (mon.0) 1237 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:56:21.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:56:21 smithi157 bash[24585]: audit 2024-09-16T09:56:20.092764+0000 mon.a (mon.0) 1238 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:56:21.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:56:21 smithi157 bash[24585]: audit 2024-09-16T09:56:20.096435+0000 mon.a (mon.0) 1239 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:56:21.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:56:21 smithi157 bash[24585]: audit 2024-09-16T09:56:20.753573+0000 mon.b (mon.2) 1035 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:56:21.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:56:21 smithi157 bash[24585]: audit 2024-09-16T09:56:20.755651+0000 mon.b (mon.2) 1036 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T09:56:21.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:56:21 smithi157 bash[24585]: audit 2024-09-16T09:56:20.764993+0000 mon.a (mon.0) 1240 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:56:21.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:56:21 smithi157 bash[24585]: audit 2024-09-16T09:56:20.772072+0000 mon.b (mon.2) 1037 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:56:21.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:56:21 smithi157 bash[24585]: audit 2024-09-16T09:56:20.774779+0000 mgr.a (mgr.14373) 11210 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:56:21.558 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:56:21 smithi157 bash[24585]: cluster 2024-09-16T09:56:20.791308+0000 mgr.a (mgr.14373) 11211 : cluster [DBG] pgmap v7775: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:56:21.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:56:21 smithi086 bash[24289]: audit 2024-09-16T09:56:20.081770+0000 mon.a (mon.0) 1236 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:56:21.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:56:21 smithi086 bash[24289]: audit 2024-09-16T09:56:20.085876+0000 mon.a (mon.0) 1237 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:56:21.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:56:21 smithi086 bash[24289]: audit 2024-09-16T09:56:20.092764+0000 mon.a (mon.0) 1238 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:56:21.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:56:21 smithi086 bash[24289]: audit 2024-09-16T09:56:20.096435+0000 mon.a (mon.0) 1239 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:56:21.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:56:21 smithi086 bash[24289]: audit 2024-09-16T09:56:20.753573+0000 mon.b (mon.2) 1035 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:56:21.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:56:21 smithi086 bash[24289]: audit 2024-09-16T09:56:20.755651+0000 mon.b (mon.2) 1036 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T09:56:21.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:56:21 smithi086 bash[24289]: audit 2024-09-16T09:56:20.764993+0000 mon.a (mon.0) 1240 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:56:21.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:56:21 smithi086 bash[24289]: audit 2024-09-16T09:56:20.772072+0000 mon.b (mon.2) 1037 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:56:21.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:56:21 smithi086 bash[24289]: audit 2024-09-16T09:56:20.774779+0000 mgr.a (mgr.14373) 11210 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:56:21.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:56:21 smithi086 bash[24289]: cluster 2024-09-16T09:56:20.791308+0000 mgr.a (mgr.14373) 11211 : cluster [DBG] pgmap v7775: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:56:21.842 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 09:56:21 smithi047 bash[22994]: debug 2024-09-16T09:56:21.511+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T09:56:21.842 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 09:56:21 smithi047 bash[22994]: debug 2024-09-16T09:56:21.515+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T09:56:22.506 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:56:22.549 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:56:22.549 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:56:23.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:56:22 smithi157 bash[24585]: audit 2024-09-16T09:56:21.518162+0000 mgr.a (mgr.14373) 11212 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T09:56:23.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:56:22 smithi157 bash[24585]: cephadm 2024-09-16T09:56:21.519961+0000 mgr.a (mgr.14373) 11213 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T09:56:23.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:56:22 smithi086 bash[24289]: audit 2024-09-16T09:56:21.518162+0000 mgr.a (mgr.14373) 11212 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T09:56:23.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:56:22 smithi086 bash[24289]: cephadm 2024-09-16T09:56:21.519961+0000 mgr.a (mgr.14373) 11213 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T09:56:23.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:56:22 smithi047 bash[22744]: audit 2024-09-16T09:56:21.518162+0000 mgr.a (mgr.14373) 11212 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T09:56:23.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:56:22 smithi047 bash[22744]: cephadm 2024-09-16T09:56:21.519961+0000 mgr.a (mgr.14373) 11213 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T09:56:23.269 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:56:23.270 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:56:23.270 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:56:23.270 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:56:23.270 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:56:24.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:56:23 smithi157 bash[24585]: cluster 2024-09-16T09:56:22.793738+0000 mgr.a (mgr.14373) 11214 : cluster [DBG] pgmap v7776: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 5.5 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-16T09:56:24.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:56:23 smithi157 bash[24585]: audit 2024-09-16T09:56:22.839088+0000 mgr.a (mgr.14373) 11215 : audit [DBG] from='client.246066 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:56:24.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:56:23 smithi086 bash[24289]: cluster 2024-09-16T09:56:22.793738+0000 mgr.a (mgr.14373) 11214 : cluster [DBG] pgmap v7776: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 5.5 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-16T09:56:24.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:56:23 smithi086 bash[24289]: audit 2024-09-16T09:56:22.839088+0000 mgr.a (mgr.14373) 11215 : audit [DBG] from='client.246066 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:56:24.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:56:23 smithi047 bash[22744]: cluster 2024-09-16T09:56:22.793738+0000 mgr.a (mgr.14373) 11214 : cluster [DBG] pgmap v7776: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 5.5 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-16T09:56:24.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:56:23 smithi047 bash[22744]: audit 2024-09-16T09:56:22.839088+0000 mgr.a (mgr.14373) 11215 : audit [DBG] from='client.246066 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:56:26.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:56:25 smithi157 bash[24585]: cluster 2024-09-16T09:56:24.794701+0000 mgr.a (mgr.14373) 11216 : cluster [DBG] pgmap v7777: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 5.5 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-16T09:56:26.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:56:25 smithi086 bash[24289]: cluster 2024-09-16T09:56:24.794701+0000 mgr.a (mgr.14373) 11216 : cluster [DBG] pgmap v7777: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 5.5 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-16T09:56:26.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:56:25 smithi047 bash[22744]: cluster 2024-09-16T09:56:24.794701+0000 mgr.a (mgr.14373) 11216 : cluster [DBG] pgmap v7777: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 5.5 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-16T09:56:28.271 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:56:28.272 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:56:28.272 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:56:28.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:56:27 smithi157 bash[24585]: cluster 2024-09-16T09:56:26.796818+0000 mgr.a (mgr.14373) 11217 : cluster [DBG] pgmap v7778: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:56:28.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:56:27 smithi086 bash[24289]: cluster 2024-09-16T09:56:26.796818+0000 mgr.a (mgr.14373) 11217 : cluster [DBG] pgmap v7778: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:56:28.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:56:27 smithi047 bash[22744]: cluster 2024-09-16T09:56:26.796818+0000 mgr.a (mgr.14373) 11217 : cluster [DBG] pgmap v7778: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:56:29.030 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:56:29.031 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:56:29.031 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:56:29.031 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:56:29.031 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:56:30.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:56:29 smithi157 bash[24585]: audit 2024-09-16T09:56:28.601820+0000 mgr.a (mgr.14373) 11218 : audit [DBG] from='client.246144 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:56:30.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:56:29 smithi157 bash[24585]: cluster 2024-09-16T09:56:28.797407+0000 mgr.a (mgr.14373) 11219 : cluster [DBG] pgmap v7779: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:56:30.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:56:29 smithi086 bash[24289]: audit 2024-09-16T09:56:28.601820+0000 mgr.a (mgr.14373) 11218 : audit [DBG] from='client.246144 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:56:30.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:56:29 smithi086 bash[24289]: cluster 2024-09-16T09:56:28.797407+0000 mgr.a (mgr.14373) 11219 : cluster [DBG] pgmap v7779: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:56:30.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:56:29 smithi047 bash[22744]: audit 2024-09-16T09:56:28.601820+0000 mgr.a (mgr.14373) 11218 : audit [DBG] from='client.246144 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:56:30.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:56:29 smithi047 bash[22744]: cluster 2024-09-16T09:56:28.797407+0000 mgr.a (mgr.14373) 11219 : cluster [DBG] pgmap v7779: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:56:32.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:56:31 smithi157 bash[24585]: cluster 2024-09-16T09:56:30.798299+0000 mgr.a (mgr.14373) 11220 : cluster [DBG] pgmap v7780: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:56:32.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:56:31 smithi086 bash[24289]: cluster 2024-09-16T09:56:30.798299+0000 mgr.a (mgr.14373) 11220 : cluster [DBG] pgmap v7780: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:56:32.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:56:31 smithi047 bash[22744]: cluster 2024-09-16T09:56:30.798299+0000 mgr.a (mgr.14373) 11220 : cluster [DBG] pgmap v7780: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:56:34.032 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:56:34.033 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:56:34.033 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:56:34.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:56:33 smithi157 bash[24585]: cluster 2024-09-16T09:56:32.800552+0000 mgr.a (mgr.14373) 11221 : cluster [DBG] pgmap v7781: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:56:34.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:56:33 smithi086 bash[24289]: cluster 2024-09-16T09:56:32.800552+0000 mgr.a (mgr.14373) 11221 : cluster [DBG] pgmap v7781: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:56:34.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:56:33 smithi047 bash[22744]: cluster 2024-09-16T09:56:32.800552+0000 mgr.a (mgr.14373) 11221 : cluster [DBG] pgmap v7781: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:56:34.789 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:56:34.789 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:56:34.789 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:56:34.789 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:56:34.789 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:56:36.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:56:35 smithi157 bash[24585]: audit 2024-09-16T09:56:34.362887+0000 mgr.a (mgr.14373) 11222 : audit [DBG] from='client.246219 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:56:36.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:56:35 smithi157 bash[24585]: cluster 2024-09-16T09:56:34.801227+0000 mgr.a (mgr.14373) 11223 : cluster [DBG] pgmap v7782: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 3.3 KiB/s rd, 170 B/s wr, 3 op/s 2024-09-16T09:56:36.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:56:35 smithi086 bash[24289]: audit 2024-09-16T09:56:34.362887+0000 mgr.a (mgr.14373) 11222 : audit [DBG] from='client.246219 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:56:36.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:56:35 smithi086 bash[24289]: cluster 2024-09-16T09:56:34.801227+0000 mgr.a (mgr.14373) 11223 : cluster [DBG] pgmap v7782: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 3.3 KiB/s rd, 170 B/s wr, 3 op/s 2024-09-16T09:56:36.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:56:35 smithi047 bash[22744]: audit 2024-09-16T09:56:34.362887+0000 mgr.a (mgr.14373) 11222 : audit [DBG] from='client.246219 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:56:36.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:56:35 smithi047 bash[22744]: cluster 2024-09-16T09:56:34.801227+0000 mgr.a (mgr.14373) 11223 : cluster [DBG] pgmap v7782: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 3.3 KiB/s rd, 170 B/s wr, 3 op/s 2024-09-16T09:56:38.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:56:37 smithi157 bash[24585]: cluster 2024-09-16T09:56:36.803343+0000 mgr.a (mgr.14373) 11224 : cluster [DBG] pgmap v7783: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 4.2 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-16T09:56:38.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:56:37 smithi086 bash[24289]: cluster 2024-09-16T09:56:36.803343+0000 mgr.a (mgr.14373) 11224 : cluster [DBG] pgmap v7783: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 4.2 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-16T09:56:38.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:56:37 smithi047 bash[22744]: cluster 2024-09-16T09:56:36.803343+0000 mgr.a (mgr.14373) 11224 : cluster [DBG] pgmap v7783: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 4.2 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-16T09:56:39.790 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:56:39.791 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:56:39.791 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:56:40.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:56:39 smithi157 bash[24585]: cluster 2024-09-16T09:56:38.804106+0000 mgr.a (mgr.14373) 11225 : cluster [DBG] pgmap v7784: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:56:40.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:56:39 smithi086 bash[24289]: cluster 2024-09-16T09:56:38.804106+0000 mgr.a (mgr.14373) 11225 : cluster [DBG] pgmap v7784: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:56:40.341 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:56:39 smithi047 bash[22744]: cluster 2024-09-16T09:56:38.804106+0000 mgr.a (mgr.14373) 11225 : cluster [DBG] pgmap v7784: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:56:40.575 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:56:40.576 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:56:40.576 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:56:40.576 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:56:40.576 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:56:42.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:56:41 smithi157 bash[24585]: audit 2024-09-16T09:56:40.124967+0000 mgr.a (mgr.14373) 11226 : audit [DBG] from='client.246297 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:56:42.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:56:41 smithi157 bash[24585]: cluster 2024-09-16T09:56:40.805082+0000 mgr.a (mgr.14373) 11227 : cluster [DBG] pgmap v7785: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:56:42.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:56:41 smithi086 bash[24289]: audit 2024-09-16T09:56:40.124967+0000 mgr.a (mgr.14373) 11226 : audit [DBG] from='client.246297 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:56:42.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:56:41 smithi086 bash[24289]: cluster 2024-09-16T09:56:40.805082+0000 mgr.a (mgr.14373) 11227 : cluster [DBG] pgmap v7785: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:56:42.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:56:41 smithi047 bash[22744]: audit 2024-09-16T09:56:40.124967+0000 mgr.a (mgr.14373) 11226 : audit [DBG] from='client.246297 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:56:42.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:56:41 smithi047 bash[22744]: cluster 2024-09-16T09:56:40.805082+0000 mgr.a (mgr.14373) 11227 : cluster [DBG] pgmap v7785: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:56:44.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:56:43 smithi157 bash[24585]: cluster 2024-09-16T09:56:42.807345+0000 mgr.a (mgr.14373) 11228 : cluster [DBG] pgmap v7786: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:56:44.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:56:43 smithi086 bash[24289]: cluster 2024-09-16T09:56:42.807345+0000 mgr.a (mgr.14373) 11228 : cluster [DBG] pgmap v7786: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:56:44.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:56:43 smithi047 bash[22744]: cluster 2024-09-16T09:56:42.807345+0000 mgr.a (mgr.14373) 11228 : cluster [DBG] pgmap v7786: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:56:45.577 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:56:45.578 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:56:45.578 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:56:46.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:56:45 smithi157 bash[24585]: cluster 2024-09-16T09:56:44.808102+0000 mgr.a (mgr.14373) 11229 : cluster [DBG] pgmap v7787: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:56:46.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:56:45 smithi086 bash[24289]: cluster 2024-09-16T09:56:44.808102+0000 mgr.a (mgr.14373) 11229 : cluster [DBG] pgmap v7787: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:56:46.341 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:56:45 smithi047 bash[22744]: cluster 2024-09-16T09:56:44.808102+0000 mgr.a (mgr.14373) 11229 : cluster [DBG] pgmap v7787: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:56:46.365 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:56:46.365 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:56:46.365 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:56:46.365 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:56:46.365 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:56:48.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:56:47 smithi157 bash[24585]: audit 2024-09-16T09:56:45.919382+0000 mgr.a (mgr.14373) 11230 : audit [DBG] from='client.246375 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:56:48.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:56:47 smithi157 bash[24585]: cluster 2024-09-16T09:56:46.810425+0000 mgr.a (mgr.14373) 11231 : cluster [DBG] pgmap v7788: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:56:48.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:56:47 smithi086 bash[24289]: audit 2024-09-16T09:56:45.919382+0000 mgr.a (mgr.14373) 11230 : audit [DBG] from='client.246375 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:56:48.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:56:47 smithi086 bash[24289]: cluster 2024-09-16T09:56:46.810425+0000 mgr.a (mgr.14373) 11231 : cluster [DBG] pgmap v7788: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:56:48.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:56:47 smithi047 bash[22744]: audit 2024-09-16T09:56:45.919382+0000 mgr.a (mgr.14373) 11230 : audit [DBG] from='client.246375 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:56:48.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:56:47 smithi047 bash[22744]: cluster 2024-09-16T09:56:46.810425+0000 mgr.a (mgr.14373) 11231 : cluster [DBG] pgmap v7788: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:56:50.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:56:49 smithi157 bash[24585]: cluster 2024-09-16T09:56:48.811181+0000 mgr.a (mgr.14373) 11232 : cluster [DBG] pgmap v7789: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:56:50.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:56:49 smithi086 bash[24289]: cluster 2024-09-16T09:56:48.811181+0000 mgr.a (mgr.14373) 11232 : cluster [DBG] pgmap v7789: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:56:50.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:56:49 smithi047 bash[22744]: cluster 2024-09-16T09:56:48.811181+0000 mgr.a (mgr.14373) 11232 : cluster [DBG] pgmap v7789: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:56:51.367 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:56:51.367 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:56:51.368 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:56:52.140 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:56:52.141 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:56:52.141 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:56:52.141 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:56:52.141 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:56:52.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:56:51 smithi157 bash[24585]: cluster 2024-09-16T09:56:50.811967+0000 mgr.a (mgr.14373) 11233 : cluster [DBG] pgmap v7790: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:56:52.319 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:56:51 smithi086 bash[24289]: cluster 2024-09-16T09:56:50.811967+0000 mgr.a (mgr.14373) 11233 : cluster [DBG] pgmap v7790: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:56:52.341 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:56:51 smithi047 bash[22744]: cluster 2024-09-16T09:56:50.811967+0000 mgr.a (mgr.14373) 11233 : cluster [DBG] pgmap v7790: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:56:53.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:56:52 smithi157 bash[24585]: audit 2024-09-16T09:56:51.704266+0000 mgr.a (mgr.14373) 11234 : audit [DBG] from='client.246453 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:56:53.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:56:52 smithi157 bash[24585]: cluster 2024-09-16T09:56:52.814908+0000 mgr.a (mgr.14373) 11235 : cluster [DBG] pgmap v7791: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:56:53.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:56:52 smithi086 bash[24289]: audit 2024-09-16T09:56:51.704266+0000 mgr.a (mgr.14373) 11234 : audit [DBG] from='client.246453 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:56:53.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:56:52 smithi086 bash[24289]: cluster 2024-09-16T09:56:52.814908+0000 mgr.a (mgr.14373) 11235 : cluster [DBG] pgmap v7791: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:56:53.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:56:52 smithi047 bash[22744]: audit 2024-09-16T09:56:51.704266+0000 mgr.a (mgr.14373) 11234 : audit [DBG] from='client.246453 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:56:53.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:56:52 smithi047 bash[22744]: cluster 2024-09-16T09:56:52.814908+0000 mgr.a (mgr.14373) 11235 : cluster [DBG] pgmap v7791: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:56:56.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:56:55 smithi157 bash[24585]: cluster 2024-09-16T09:56:54.815878+0000 mgr.a (mgr.14373) 11236 : cluster [DBG] pgmap v7792: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:56:56.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:56:55 smithi086 bash[24289]: cluster 2024-09-16T09:56:54.815878+0000 mgr.a (mgr.14373) 11236 : cluster [DBG] pgmap v7792: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:56:56.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:56:55 smithi047 bash[22744]: cluster 2024-09-16T09:56:54.815878+0000 mgr.a (mgr.14373) 11236 : cluster [DBG] pgmap v7792: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:56:57.142 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:56:57.143 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:56:57.143 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:56:57.887 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:56:57.887 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:56:57.888 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:56:57.888 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:56:57.888 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:56:58.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:56:57 smithi157 bash[24585]: cluster 2024-09-16T09:56:56.817987+0000 mgr.a (mgr.14373) 11237 : cluster [DBG] pgmap v7793: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:56:58.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:56:57 smithi086 bash[24289]: cluster 2024-09-16T09:56:56.817987+0000 mgr.a (mgr.14373) 11237 : cluster [DBG] pgmap v7793: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:56:58.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:56:57 smithi047 bash[22744]: cluster 2024-09-16T09:56:56.817987+0000 mgr.a (mgr.14373) 11237 : cluster [DBG] pgmap v7793: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:56:59.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:56:58 smithi157 bash[24585]: audit 2024-09-16T09:56:57.466544+0000 mgr.a (mgr.14373) 11238 : audit [DBG] from='client.246528 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:56:59.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:56:58 smithi086 bash[24289]: audit 2024-09-16T09:56:57.466544+0000 mgr.a (mgr.14373) 11238 : audit [DBG] from='client.246528 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:56:59.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:56:58 smithi047 bash[22744]: audit 2024-09-16T09:56:57.466544+0000 mgr.a (mgr.14373) 11238 : audit [DBG] from='client.246528 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:57:00.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:56:59 smithi157 bash[24585]: cluster 2024-09-16T09:56:58.819011+0000 mgr.a (mgr.14373) 11239 : cluster [DBG] pgmap v7794: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:57:00.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:56:59 smithi086 bash[24289]: cluster 2024-09-16T09:56:58.819011+0000 mgr.a (mgr.14373) 11239 : cluster [DBG] pgmap v7794: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:57:00.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:56:59 smithi047 bash[22744]: cluster 2024-09-16T09:56:58.819011+0000 mgr.a (mgr.14373) 11239 : cluster [DBG] pgmap v7794: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:57:02.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:57:01 smithi157 bash[24585]: cluster 2024-09-16T09:57:00.819809+0000 mgr.a (mgr.14373) 11240 : cluster [DBG] pgmap v7795: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:57:02.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:57:01 smithi086 bash[24289]: cluster 2024-09-16T09:57:00.819809+0000 mgr.a (mgr.14373) 11240 : cluster [DBG] pgmap v7795: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:57:02.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:57:01 smithi047 bash[22744]: cluster 2024-09-16T09:57:00.819809+0000 mgr.a (mgr.14373) 11240 : cluster [DBG] pgmap v7795: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:57:02.889 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:57:02.889 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:57:02.890 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:57:03.661 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:57:03.662 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:57:03.662 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:57:03.662 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:57:03.662 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:57:04.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:57:03 smithi157 bash[24585]: cluster 2024-09-16T09:57:02.821983+0000 mgr.a (mgr.14373) 11241 : cluster [DBG] pgmap v7796: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:57:04.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:57:03 smithi086 bash[24289]: cluster 2024-09-16T09:57:02.821983+0000 mgr.a (mgr.14373) 11241 : cluster [DBG] pgmap v7796: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:57:04.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:57:03 smithi047 bash[22744]: cluster 2024-09-16T09:57:02.821983+0000 mgr.a (mgr.14373) 11241 : cluster [DBG] pgmap v7796: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:57:05.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:57:04 smithi157 bash[24585]: audit 2024-09-16T09:57:03.223931+0000 mgr.a (mgr.14373) 11242 : audit [DBG] from='client.246603 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:57:05.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:57:04 smithi086 bash[24289]: audit 2024-09-16T09:57:03.223931+0000 mgr.a (mgr.14373) 11242 : audit [DBG] from='client.246603 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:57:05.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:57:04 smithi047 bash[22744]: audit 2024-09-16T09:57:03.223931+0000 mgr.a (mgr.14373) 11242 : audit [DBG] from='client.246603 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:57:06.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:57:05 smithi157 bash[24585]: cluster 2024-09-16T09:57:04.822894+0000 mgr.a (mgr.14373) 11243 : cluster [DBG] pgmap v7797: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:57:06.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:57:05 smithi086 bash[24289]: cluster 2024-09-16T09:57:04.822894+0000 mgr.a (mgr.14373) 11243 : cluster [DBG] pgmap v7797: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:57:06.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:57:05 smithi047 bash[22744]: cluster 2024-09-16T09:57:04.822894+0000 mgr.a (mgr.14373) 11243 : cluster [DBG] pgmap v7797: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:57:07.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:57:06 smithi157 bash[24585]: cluster 2024-09-16T09:57:06.825051+0000 mgr.a (mgr.14373) 11244 : cluster [DBG] pgmap v7798: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:57:07.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:57:06 smithi086 bash[24289]: cluster 2024-09-16T09:57:06.825051+0000 mgr.a (mgr.14373) 11244 : cluster [DBG] pgmap v7798: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:57:07.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:57:06 smithi047 bash[22744]: cluster 2024-09-16T09:57:06.825051+0000 mgr.a (mgr.14373) 11244 : cluster [DBG] pgmap v7798: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:57:08.664 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:57:08.664 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:57:08.664 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:57:09.447 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:57:09.447 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:57:09.447 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:57:09.447 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:57:09.447 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:57:10.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:57:09 smithi157 bash[24585]: cluster 2024-09-16T09:57:08.825563+0000 mgr.a (mgr.14373) 11245 : cluster [DBG] pgmap v7799: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:57:10.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:57:09 smithi086 bash[24289]: cluster 2024-09-16T09:57:08.825563+0000 mgr.a (mgr.14373) 11245 : cluster [DBG] pgmap v7799: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:57:10.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:57:09 smithi047 bash[22744]: cluster 2024-09-16T09:57:08.825563+0000 mgr.a (mgr.14373) 11245 : cluster [DBG] pgmap v7799: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:57:11.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:57:10 smithi157 bash[24585]: audit 2024-09-16T09:57:08.995138+0000 mgr.a (mgr.14373) 11246 : audit [DBG] from='client.246681 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:57:11.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:57:10 smithi086 bash[24289]: audit 2024-09-16T09:57:08.995138+0000 mgr.a (mgr.14373) 11246 : audit [DBG] from='client.246681 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:57:11.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:57:10 smithi047 bash[22744]: audit 2024-09-16T09:57:08.995138+0000 mgr.a (mgr.14373) 11246 : audit [DBG] from='client.246681 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:57:12.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:57:11 smithi157 bash[24585]: cluster 2024-09-16T09:57:10.826460+0000 mgr.a (mgr.14373) 11247 : cluster [DBG] pgmap v7800: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:57:12.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:57:11 smithi086 bash[24289]: cluster 2024-09-16T09:57:10.826460+0000 mgr.a (mgr.14373) 11247 : cluster [DBG] pgmap v7800: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:57:12.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:57:11 smithi047 bash[22744]: cluster 2024-09-16T09:57:10.826460+0000 mgr.a (mgr.14373) 11247 : cluster [DBG] pgmap v7800: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:57:14.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:57:13 smithi157 bash[24585]: cluster 2024-09-16T09:57:12.828680+0000 mgr.a (mgr.14373) 11248 : cluster [DBG] pgmap v7801: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:57:14.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:57:13 smithi086 bash[24289]: cluster 2024-09-16T09:57:12.828680+0000 mgr.a (mgr.14373) 11248 : cluster [DBG] pgmap v7801: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:57:14.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:57:13 smithi047 bash[22744]: cluster 2024-09-16T09:57:12.828680+0000 mgr.a (mgr.14373) 11248 : cluster [DBG] pgmap v7801: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:57:14.448 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:57:14.449 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:57:14.449 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:57:15.223 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:57:15.224 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:57:15.224 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:57:15.224 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:57:15.224 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:57:16.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:57:15 smithi157 bash[24585]: audit 2024-09-16T09:57:14.782816+0000 mgr.a (mgr.14373) 11249 : audit [DBG] from='client.246759 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:57:16.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:57:15 smithi157 bash[24585]: cluster 2024-09-16T09:57:14.829724+0000 mgr.a (mgr.14373) 11250 : cluster [DBG] pgmap v7802: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:57:16.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:57:15 smithi086 bash[24289]: audit 2024-09-16T09:57:14.782816+0000 mgr.a (mgr.14373) 11249 : audit [DBG] from='client.246759 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:57:16.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:57:15 smithi086 bash[24289]: cluster 2024-09-16T09:57:14.829724+0000 mgr.a (mgr.14373) 11250 : cluster [DBG] pgmap v7802: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:57:16.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:57:15 smithi047 bash[22744]: audit 2024-09-16T09:57:14.782816+0000 mgr.a (mgr.14373) 11249 : audit [DBG] from='client.246759 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:57:16.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:57:15 smithi047 bash[22744]: cluster 2024-09-16T09:57:14.829724+0000 mgr.a (mgr.14373) 11250 : cluster [DBG] pgmap v7802: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:57:18.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:57:17 smithi157 bash[24585]: cluster 2024-09-16T09:57:16.832005+0000 mgr.a (mgr.14373) 11251 : cluster [DBG] pgmap v7803: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:57:18.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:57:17 smithi086 bash[24289]: cluster 2024-09-16T09:57:16.832005+0000 mgr.a (mgr.14373) 11251 : cluster [DBG] pgmap v7803: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:57:18.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:57:17 smithi047 bash[22744]: cluster 2024-09-16T09:57:16.832005+0000 mgr.a (mgr.14373) 11251 : cluster [DBG] pgmap v7803: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:57:20.225 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:57:20.226 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:57:20.226 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:57:20.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:57:19 smithi157 bash[24585]: cluster 2024-09-16T09:57:18.832774+0000 mgr.a (mgr.14373) 11252 : cluster [DBG] pgmap v7804: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:57:20.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:57:19 smithi086 bash[24289]: cluster 2024-09-16T09:57:18.832774+0000 mgr.a (mgr.14373) 11252 : cluster [DBG] pgmap v7804: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:57:20.341 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:57:19 smithi047 bash[22744]: cluster 2024-09-16T09:57:18.832774+0000 mgr.a (mgr.14373) 11252 : cluster [DBG] pgmap v7804: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:57:20.994 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:57:20.994 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:57:20.994 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:57:20.994 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:57:20.994 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:57:22.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:57:21 smithi157 bash[24585]: audit 2024-09-16T09:57:20.560583+0000 mgr.a (mgr.14373) 11253 : audit [DBG] from='client.246834 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:57:22.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:57:21 smithi157 bash[24585]: cluster 2024-09-16T09:57:20.833314+0000 mgr.a (mgr.14373) 11254 : cluster [DBG] pgmap v7805: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:57:22.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:57:21 smithi157 bash[24585]: audit 2024-09-16T09:57:21.572645+0000 mon.b (mon.2) 1038 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T09:57:22.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:57:21 smithi086 bash[24289]: audit 2024-09-16T09:57:20.560583+0000 mgr.a (mgr.14373) 11253 : audit [DBG] from='client.246834 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:57:22.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:57:21 smithi086 bash[24289]: cluster 2024-09-16T09:57:20.833314+0000 mgr.a (mgr.14373) 11254 : cluster [DBG] pgmap v7805: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:57:22.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:57:21 smithi086 bash[24289]: audit 2024-09-16T09:57:21.572645+0000 mon.b (mon.2) 1038 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T09:57:22.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:57:21 smithi047 bash[22744]: audit 2024-09-16T09:57:20.560583+0000 mgr.a (mgr.14373) 11253 : audit [DBG] from='client.246834 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:57:22.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:57:21 smithi047 bash[22744]: cluster 2024-09-16T09:57:20.833314+0000 mgr.a (mgr.14373) 11254 : cluster [DBG] pgmap v7805: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:57:22.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:57:21 smithi047 bash[22744]: audit 2024-09-16T09:57:21.572645+0000 mon.b (mon.2) 1038 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T09:57:23.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:57:22 smithi157 bash[24585]: audit 2024-09-16T09:57:22.396443+0000 mon.b (mon.2) 1039 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:57:23.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:57:22 smithi157 bash[24585]: audit 2024-09-16T09:57:22.398626+0000 mon.b (mon.2) 1040 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T09:57:23.308 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:57:22 smithi157 bash[24585]: audit 2024-09-16T09:57:22.410737+0000 mon.a (mon.0) 1241 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:57:23.308 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:57:22 smithi157 bash[24585]: audit 2024-09-16T09:57:22.416059+0000 mon.b (mon.2) 1041 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:57:23.308 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:57:22 smithi157 bash[24585]: audit 2024-09-16T09:57:22.417782+0000 mgr.a (mgr.14373) 11255 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:57:23.308 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:57:22 smithi157 bash[24585]: cluster 2024-09-16T09:57:22.843261+0000 mgr.a (mgr.14373) 11256 : cluster [DBG] pgmap v7806: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:57:23.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:57:22 smithi086 bash[24289]: audit 2024-09-16T09:57:22.396443+0000 mon.b (mon.2) 1039 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:57:23.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:57:22 smithi086 bash[24289]: audit 2024-09-16T09:57:22.398626+0000 mon.b (mon.2) 1040 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T09:57:23.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:57:22 smithi086 bash[24289]: audit 2024-09-16T09:57:22.410737+0000 mon.a (mon.0) 1241 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:57:23.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:57:22 smithi086 bash[24289]: audit 2024-09-16T09:57:22.416059+0000 mon.b (mon.2) 1041 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:57:23.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:57:22 smithi086 bash[24289]: audit 2024-09-16T09:57:22.417782+0000 mgr.a (mgr.14373) 11255 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:57:23.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:57:22 smithi086 bash[24289]: cluster 2024-09-16T09:57:22.843261+0000 mgr.a (mgr.14373) 11256 : cluster [DBG] pgmap v7806: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:57:23.342 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 09:57:23 smithi047 bash[22994]: debug 2024-09-16T09:57:23.158+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T09:57:23.342 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 09:57:23 smithi047 bash[22994]: debug 2024-09-16T09:57:23.158+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T09:57:23.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:57:22 smithi047 bash[22744]: audit 2024-09-16T09:57:22.396443+0000 mon.b (mon.2) 1039 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:57:23.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:57:22 smithi047 bash[22744]: audit 2024-09-16T09:57:22.398626+0000 mon.b (mon.2) 1040 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T09:57:23.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:57:22 smithi047 bash[22744]: audit 2024-09-16T09:57:22.410737+0000 mon.a (mon.0) 1241 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:57:23.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:57:22 smithi047 bash[22744]: audit 2024-09-16T09:57:22.416059+0000 mon.b (mon.2) 1041 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:57:23.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:57:22 smithi047 bash[22744]: audit 2024-09-16T09:57:22.417782+0000 mgr.a (mgr.14373) 11255 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:57:23.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:57:22 smithi047 bash[22744]: cluster 2024-09-16T09:57:22.843261+0000 mgr.a (mgr.14373) 11256 : cluster [DBG] pgmap v7806: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:57:24.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:57:24 smithi157 bash[24585]: audit 2024-09-16T09:57:23.160279+0000 mgr.a (mgr.14373) 11257 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T09:57:24.808 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:57:24 smithi157 bash[24585]: cephadm 2024-09-16T09:57:23.162224+0000 mgr.a (mgr.14373) 11258 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T09:57:24.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:57:24 smithi086 bash[24289]: audit 2024-09-16T09:57:23.160279+0000 mgr.a (mgr.14373) 11257 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T09:57:24.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:57:24 smithi086 bash[24289]: cephadm 2024-09-16T09:57:23.162224+0000 mgr.a (mgr.14373) 11258 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T09:57:24.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:57:24 smithi047 bash[22744]: audit 2024-09-16T09:57:23.160279+0000 mgr.a (mgr.14373) 11257 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T09:57:24.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:57:24 smithi047 bash[22744]: cephadm 2024-09-16T09:57:23.162224+0000 mgr.a (mgr.14373) 11258 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T09:57:25.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:57:25 smithi157 bash[24585]: cluster 2024-09-16T09:57:24.844122+0000 mgr.a (mgr.14373) 11259 : cluster [DBG] pgmap v7807: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:57:25.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:57:25 smithi086 bash[24289]: cluster 2024-09-16T09:57:24.844122+0000 mgr.a (mgr.14373) 11259 : cluster [DBG] pgmap v7807: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:57:25.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:57:25 smithi047 bash[22744]: cluster 2024-09-16T09:57:24.844122+0000 mgr.a (mgr.14373) 11259 : cluster [DBG] pgmap v7807: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:57:25.995 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:57:25.996 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:57:25.996 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:57:26.778 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:57:26.778 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:57:26.779 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:57:26.779 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:57:26.779 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:57:28.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:57:27 smithi157 bash[24585]: audit 2024-09-16T09:57:26.329784+0000 mgr.a (mgr.14373) 11260 : audit [DBG] from='client.247017 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:57:28.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:57:27 smithi157 bash[24585]: cluster 2024-09-16T09:57:26.846884+0000 mgr.a (mgr.14373) 11261 : cluster [DBG] pgmap v7808: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:57:28.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:57:27 smithi086 bash[24289]: audit 2024-09-16T09:57:26.329784+0000 mgr.a (mgr.14373) 11260 : audit [DBG] from='client.247017 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:57:28.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:57:27 smithi086 bash[24289]: cluster 2024-09-16T09:57:26.846884+0000 mgr.a (mgr.14373) 11261 : cluster [DBG] pgmap v7808: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:57:28.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:57:27 smithi047 bash[22744]: audit 2024-09-16T09:57:26.329784+0000 mgr.a (mgr.14373) 11260 : audit [DBG] from='client.247017 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:57:28.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:57:27 smithi047 bash[22744]: cluster 2024-09-16T09:57:26.846884+0000 mgr.a (mgr.14373) 11261 : cluster [DBG] pgmap v7808: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:57:30.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:57:29 smithi157 bash[24585]: cluster 2024-09-16T09:57:28.847610+0000 mgr.a (mgr.14373) 11262 : cluster [DBG] pgmap v7809: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T09:57:30.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:57:29 smithi086 bash[24289]: cluster 2024-09-16T09:57:28.847610+0000 mgr.a (mgr.14373) 11262 : cluster [DBG] pgmap v7809: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T09:57:30.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:57:29 smithi047 bash[22744]: cluster 2024-09-16T09:57:28.847610+0000 mgr.a (mgr.14373) 11262 : cluster [DBG] pgmap v7809: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T09:57:31.780 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:57:31.781 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:57:31.781 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:57:32.308 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:57:31 smithi157 bash[24585]: cluster 2024-09-16T09:57:30.848370+0000 mgr.a (mgr.14373) 11263 : cluster [DBG] pgmap v7810: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T09:57:32.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:57:31 smithi086 bash[24289]: cluster 2024-09-16T09:57:30.848370+0000 mgr.a (mgr.14373) 11263 : cluster [DBG] pgmap v7810: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T09:57:32.341 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:57:31 smithi047 bash[22744]: cluster 2024-09-16T09:57:30.848370+0000 mgr.a (mgr.14373) 11263 : cluster [DBG] pgmap v7810: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T09:57:32.532 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:57:32.533 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:57:32.533 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:57:32.533 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:57:32.533 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:57:34.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:57:33 smithi157 bash[24585]: audit 2024-09-16T09:57:32.113854+0000 mgr.a (mgr.14373) 11264 : audit [DBG] from='client.247092 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:57:34.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:57:33 smithi157 bash[24585]: cluster 2024-09-16T09:57:32.851130+0000 mgr.a (mgr.14373) 11265 : cluster [DBG] pgmap v7811: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:57:34.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:57:33 smithi086 bash[24289]: audit 2024-09-16T09:57:32.113854+0000 mgr.a (mgr.14373) 11264 : audit [DBG] from='client.247092 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:57:34.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:57:33 smithi086 bash[24289]: cluster 2024-09-16T09:57:32.851130+0000 mgr.a (mgr.14373) 11265 : cluster [DBG] pgmap v7811: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:57:34.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:57:33 smithi047 bash[22744]: audit 2024-09-16T09:57:32.113854+0000 mgr.a (mgr.14373) 11264 : audit [DBG] from='client.247092 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:57:34.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:57:33 smithi047 bash[22744]: cluster 2024-09-16T09:57:32.851130+0000 mgr.a (mgr.14373) 11265 : cluster [DBG] pgmap v7811: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:57:35.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:57:34 smithi157 bash[24585]: cluster 2024-09-16T09:57:34.851910+0000 mgr.a (mgr.14373) 11266 : cluster [DBG] pgmap v7812: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T09:57:35.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:57:34 smithi086 bash[24289]: cluster 2024-09-16T09:57:34.851910+0000 mgr.a (mgr.14373) 11266 : cluster [DBG] pgmap v7812: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T09:57:35.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:57:34 smithi047 bash[22744]: cluster 2024-09-16T09:57:34.851910+0000 mgr.a (mgr.14373) 11266 : cluster [DBG] pgmap v7812: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T09:57:37.534 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:57:37.535 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:57:37.535 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:57:38.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:57:37 smithi157 bash[24585]: cluster 2024-09-16T09:57:36.853878+0000 mgr.a (mgr.14373) 11267 : cluster [DBG] pgmap v7813: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:57:38.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:57:37 smithi086 bash[24289]: cluster 2024-09-16T09:57:36.853878+0000 mgr.a (mgr.14373) 11267 : cluster [DBG] pgmap v7813: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:57:38.322 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:57:38.322 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:57:38.322 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:57:38.322 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:57:38.323 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:57:38.341 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:57:37 smithi047 bash[22744]: cluster 2024-09-16T09:57:36.853878+0000 mgr.a (mgr.14373) 11267 : cluster [DBG] pgmap v7813: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:57:39.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:57:38 smithi157 bash[24585]: audit 2024-09-16T09:57:37.869601+0000 mgr.a (mgr.14373) 11268 : audit [DBG] from='client.247170 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:57:39.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:57:38 smithi086 bash[24289]: audit 2024-09-16T09:57:37.869601+0000 mgr.a (mgr.14373) 11268 : audit [DBG] from='client.247170 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:57:39.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:57:38 smithi047 bash[22744]: audit 2024-09-16T09:57:37.869601+0000 mgr.a (mgr.14373) 11268 : audit [DBG] from='client.247170 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:57:40.308 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:57:39 smithi157 bash[24585]: cluster 2024-09-16T09:57:38.854853+0000 mgr.a (mgr.14373) 11269 : cluster [DBG] pgmap v7814: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:57:40.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:57:39 smithi086 bash[24289]: cluster 2024-09-16T09:57:38.854853+0000 mgr.a (mgr.14373) 11269 : cluster [DBG] pgmap v7814: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:57:40.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:57:39 smithi047 bash[22744]: cluster 2024-09-16T09:57:38.854853+0000 mgr.a (mgr.14373) 11269 : cluster [DBG] pgmap v7814: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:57:41.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:57:40 smithi157 bash[24585]: cluster 2024-09-16T09:57:40.855658+0000 mgr.a (mgr.14373) 11270 : cluster [DBG] pgmap v7815: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:57:41.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:57:40 smithi086 bash[24289]: cluster 2024-09-16T09:57:40.855658+0000 mgr.a (mgr.14373) 11270 : cluster [DBG] pgmap v7815: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:57:41.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:57:40 smithi047 bash[22744]: cluster 2024-09-16T09:57:40.855658+0000 mgr.a (mgr.14373) 11270 : cluster [DBG] pgmap v7815: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:57:43.324 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:57:43.325 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:57:43.325 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:57:44.082 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:57:44.082 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:57:44.082 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:57:44.082 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:57:44.082 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:57:44.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:57:43 smithi157 bash[24585]: cluster 2024-09-16T09:57:42.857812+0000 mgr.a (mgr.14373) 11271 : cluster [DBG] pgmap v7816: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:57:44.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:57:43 smithi086 bash[24289]: cluster 2024-09-16T09:57:42.857812+0000 mgr.a (mgr.14373) 11271 : cluster [DBG] pgmap v7816: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:57:44.341 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:57:43 smithi047 bash[22744]: cluster 2024-09-16T09:57:42.857812+0000 mgr.a (mgr.14373) 11271 : cluster [DBG] pgmap v7816: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:57:45.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:57:44 smithi157 bash[24585]: audit 2024-09-16T09:57:43.653866+0000 mgr.a (mgr.14373) 11272 : audit [DBG] from='client.247248 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:57:45.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:57:44 smithi086 bash[24289]: audit 2024-09-16T09:57:43.653866+0000 mgr.a (mgr.14373) 11272 : audit [DBG] from='client.247248 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:57:45.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:57:44 smithi047 bash[22744]: audit 2024-09-16T09:57:43.653866+0000 mgr.a (mgr.14373) 11272 : audit [DBG] from='client.247248 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:57:46.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:57:45 smithi157 bash[24585]: cluster 2024-09-16T09:57:44.858748+0000 mgr.a (mgr.14373) 11273 : cluster [DBG] pgmap v7817: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:57:46.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:57:45 smithi086 bash[24289]: cluster 2024-09-16T09:57:44.858748+0000 mgr.a (mgr.14373) 11273 : cluster [DBG] pgmap v7817: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:57:46.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:57:45 smithi047 bash[22744]: cluster 2024-09-16T09:57:44.858748+0000 mgr.a (mgr.14373) 11273 : cluster [DBG] pgmap v7817: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:57:47.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:57:46 smithi157 bash[24585]: cluster 2024-09-16T09:57:46.860909+0000 mgr.a (mgr.14373) 11274 : cluster [DBG] pgmap v7818: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:57:47.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:57:46 smithi086 bash[24289]: cluster 2024-09-16T09:57:46.860909+0000 mgr.a (mgr.14373) 11274 : cluster [DBG] pgmap v7818: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:57:47.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:57:46 smithi047 bash[22744]: cluster 2024-09-16T09:57:46.860909+0000 mgr.a (mgr.14373) 11274 : cluster [DBG] pgmap v7818: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:57:49.083 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:57:49.084 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:57:49.084 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:57:49.849 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:57:49.850 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:57:49.850 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:57:49.850 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:57:49.850 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:57:50.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:57:49 smithi157 bash[24585]: cluster 2024-09-16T09:57:48.861640+0000 mgr.a (mgr.14373) 11275 : cluster [DBG] pgmap v7819: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:57:50.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:57:49 smithi086 bash[24289]: cluster 2024-09-16T09:57:48.861640+0000 mgr.a (mgr.14373) 11275 : cluster [DBG] pgmap v7819: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:57:50.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:57:49 smithi047 bash[22744]: cluster 2024-09-16T09:57:48.861640+0000 mgr.a (mgr.14373) 11275 : cluster [DBG] pgmap v7819: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:57:51.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:57:50 smithi157 bash[24585]: audit 2024-09-16T09:57:49.417989+0000 mgr.a (mgr.14373) 11276 : audit [DBG] from='client.247326 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:57:51.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:57:50 smithi157 bash[24585]: cluster 2024-09-16T09:57:50.862553+0000 mgr.a (mgr.14373) 11277 : cluster [DBG] pgmap v7820: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:57:51.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:57:50 smithi086 bash[24289]: audit 2024-09-16T09:57:49.417989+0000 mgr.a (mgr.14373) 11276 : audit [DBG] from='client.247326 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:57:51.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:57:50 smithi086 bash[24289]: cluster 2024-09-16T09:57:50.862553+0000 mgr.a (mgr.14373) 11277 : cluster [DBG] pgmap v7820: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:57:51.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:57:50 smithi047 bash[22744]: audit 2024-09-16T09:57:49.417989+0000 mgr.a (mgr.14373) 11276 : audit [DBG] from='client.247326 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:57:51.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:57:50 smithi047 bash[22744]: cluster 2024-09-16T09:57:50.862553+0000 mgr.a (mgr.14373) 11277 : cluster [DBG] pgmap v7820: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:57:53.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:57:52 smithi157 bash[24585]: cluster 2024-09-16T09:57:52.864745+0000 mgr.a (mgr.14373) 11278 : cluster [DBG] pgmap v7821: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:57:53.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:57:52 smithi086 bash[24289]: cluster 2024-09-16T09:57:52.864745+0000 mgr.a (mgr.14373) 11278 : cluster [DBG] pgmap v7821: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:57:53.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:57:52 smithi047 bash[22744]: cluster 2024-09-16T09:57:52.864745+0000 mgr.a (mgr.14373) 11278 : cluster [DBG] pgmap v7821: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:57:54.851 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:57:54.852 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:57:54.852 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:57:55.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:57:54 smithi157 bash[24585]: cluster 2024-09-16T09:57:54.865327+0000 mgr.a (mgr.14373) 11279 : cluster [DBG] pgmap v7822: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:57:55.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:57:54 smithi086 bash[24289]: cluster 2024-09-16T09:57:54.865327+0000 mgr.a (mgr.14373) 11279 : cluster [DBG] pgmap v7822: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:57:55.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:57:54 smithi047 bash[22744]: cluster 2024-09-16T09:57:54.865327+0000 mgr.a (mgr.14373) 11279 : cluster [DBG] pgmap v7822: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:57:55.632 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:57:55.633 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:57:55.633 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:57:55.633 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:57:55.633 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:57:56.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:57:55 smithi157 bash[24585]: audit 2024-09-16T09:57:55.188666+0000 mgr.a (mgr.14373) 11280 : audit [DBG] from='client.247404 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:57:56.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:57:55 smithi086 bash[24289]: audit 2024-09-16T09:57:55.188666+0000 mgr.a (mgr.14373) 11280 : audit [DBG] from='client.247404 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:57:56.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:57:55 smithi047 bash[22744]: audit 2024-09-16T09:57:55.188666+0000 mgr.a (mgr.14373) 11280 : audit [DBG] from='client.247404 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:57:57.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:57:56 smithi157 bash[24585]: cluster 2024-09-16T09:57:56.867539+0000 mgr.a (mgr.14373) 11281 : cluster [DBG] pgmap v7823: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:57:57.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:57:56 smithi086 bash[24289]: cluster 2024-09-16T09:57:56.867539+0000 mgr.a (mgr.14373) 11281 : cluster [DBG] pgmap v7823: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:57:57.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:57:56 smithi047 bash[22744]: cluster 2024-09-16T09:57:56.867539+0000 mgr.a (mgr.14373) 11281 : cluster [DBG] pgmap v7823: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:57:59.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:57:58 smithi157 bash[24585]: cluster 2024-09-16T09:57:58.868290+0000 mgr.a (mgr.14373) 11282 : cluster [DBG] pgmap v7824: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:57:59.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:57:58 smithi086 bash[24289]: cluster 2024-09-16T09:57:58.868290+0000 mgr.a (mgr.14373) 11282 : cluster [DBG] pgmap v7824: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:57:59.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:57:58 smithi047 bash[22744]: cluster 2024-09-16T09:57:58.868290+0000 mgr.a (mgr.14373) 11282 : cluster [DBG] pgmap v7824: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:58:00.632 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:58:00.633 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:58:00.633 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:58:01.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:58:00 smithi157 bash[24585]: cluster 2024-09-16T09:58:00.869014+0000 mgr.a (mgr.14373) 11283 : cluster [DBG] pgmap v7825: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:58:01.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:58:00 smithi086 bash[24289]: cluster 2024-09-16T09:58:00.869014+0000 mgr.a (mgr.14373) 11283 : cluster [DBG] pgmap v7825: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:58:01.341 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:58:00 smithi047 bash[22744]: cluster 2024-09-16T09:58:00.869014+0000 mgr.a (mgr.14373) 11283 : cluster [DBG] pgmap v7825: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:58:01.381 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:58:01.382 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:58:01.382 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:58:01.382 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:58:01.382 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:58:02.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:58:01 smithi157 bash[24585]: audit 2024-09-16T09:58:00.958902+0000 mgr.a (mgr.14373) 11284 : audit [DBG] from='client.247473 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:58:02.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:58:01 smithi086 bash[24289]: audit 2024-09-16T09:58:00.958902+0000 mgr.a (mgr.14373) 11284 : audit [DBG] from='client.247473 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:58:02.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:58:01 smithi047 bash[22744]: audit 2024-09-16T09:58:00.958902+0000 mgr.a (mgr.14373) 11284 : audit [DBG] from='client.247473 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:58:03.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:58:02 smithi157 bash[24585]: cluster 2024-09-16T09:58:02.871513+0000 mgr.a (mgr.14373) 11285 : cluster [DBG] pgmap v7826: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:58:03.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:58:02 smithi086 bash[24289]: cluster 2024-09-16T09:58:02.871513+0000 mgr.a (mgr.14373) 11285 : cluster [DBG] pgmap v7826: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:58:03.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:58:02 smithi047 bash[22744]: cluster 2024-09-16T09:58:02.871513+0000 mgr.a (mgr.14373) 11285 : cluster [DBG] pgmap v7826: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:58:05.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:58:04 smithi157 bash[24585]: cluster 2024-09-16T09:58:04.872459+0000 mgr.a (mgr.14373) 11286 : cluster [DBG] pgmap v7827: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:58:05.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:58:04 smithi086 bash[24289]: cluster 2024-09-16T09:58:04.872459+0000 mgr.a (mgr.14373) 11286 : cluster [DBG] pgmap v7827: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:58:05.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:58:04 smithi047 bash[22744]: cluster 2024-09-16T09:58:04.872459+0000 mgr.a (mgr.14373) 11286 : cluster [DBG] pgmap v7827: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:58:06.383 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:58:06.383 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:58:06.384 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:58:07.163 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:58:07.164 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:58:07.164 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:58:07.164 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:58:07.164 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:58:07.309 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:58:06 smithi157 bash[24585]: audit 2024-09-16T09:58:06.718770+0000 mgr.a (mgr.14373) 11287 : audit [DBG] from='client.247548 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:58:07.309 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:58:06 smithi157 bash[24585]: cluster 2024-09-16T09:58:06.873818+0000 mgr.a (mgr.14373) 11288 : cluster [DBG] pgmap v7828: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-16T09:58:07.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:58:06 smithi086 bash[24289]: audit 2024-09-16T09:58:06.718770+0000 mgr.a (mgr.14373) 11287 : audit [DBG] from='client.247548 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:58:07.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:58:06 smithi086 bash[24289]: cluster 2024-09-16T09:58:06.873818+0000 mgr.a (mgr.14373) 11288 : cluster [DBG] pgmap v7828: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-16T09:58:07.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:58:06 smithi047 bash[22744]: audit 2024-09-16T09:58:06.718770+0000 mgr.a (mgr.14373) 11287 : audit [DBG] from='client.247548 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:58:07.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:58:06 smithi047 bash[22744]: cluster 2024-09-16T09:58:06.873818+0000 mgr.a (mgr.14373) 11288 : cluster [DBG] pgmap v7828: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-16T09:58:09.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:58:08 smithi157 bash[24585]: cluster 2024-09-16T09:58:08.874698+0000 mgr.a (mgr.14373) 11289 : cluster [DBG] pgmap v7829: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 4.9 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-16T09:58:09.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:58:08 smithi086 bash[24289]: cluster 2024-09-16T09:58:08.874698+0000 mgr.a (mgr.14373) 11289 : cluster [DBG] pgmap v7829: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 4.9 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-16T09:58:09.345 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:58:08 smithi047 bash[22744]: cluster 2024-09-16T09:58:08.874698+0000 mgr.a (mgr.14373) 11289 : cluster [DBG] pgmap v7829: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 4.9 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-16T09:58:11.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:58:10 smithi157 bash[24585]: cluster 2024-09-16T09:58:10.875486+0000 mgr.a (mgr.14373) 11290 : cluster [DBG] pgmap v7830: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 4.9 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-16T09:58:11.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:58:10 smithi086 bash[24289]: cluster 2024-09-16T09:58:10.875486+0000 mgr.a (mgr.14373) 11290 : cluster [DBG] pgmap v7830: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 4.9 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-16T09:58:11.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:58:10 smithi047 bash[22744]: cluster 2024-09-16T09:58:10.875486+0000 mgr.a (mgr.14373) 11290 : cluster [DBG] pgmap v7830: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 4.9 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-16T09:58:12.165 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:58:12.166 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:58:12.166 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:58:12.940 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:58:12.940 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:58:12.940 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:58:12.940 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:58:12.940 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:58:13.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:58:12 smithi157 bash[24585]: audit 2024-09-16T09:58:12.500334+0000 mgr.a (mgr.14373) 11291 : audit [DBG] from='client.247623 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:58:13.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:58:12 smithi157 bash[24585]: cluster 2024-09-16T09:58:12.876778+0000 mgr.a (mgr.14373) 11292 : cluster [DBG] pgmap v7831: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-16T09:58:13.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:58:12 smithi086 bash[24289]: audit 2024-09-16T09:58:12.500334+0000 mgr.a (mgr.14373) 11291 : audit [DBG] from='client.247623 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:58:13.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:58:12 smithi086 bash[24289]: cluster 2024-09-16T09:58:12.876778+0000 mgr.a (mgr.14373) 11292 : cluster [DBG] pgmap v7831: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-16T09:58:13.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:58:12 smithi047 bash[22744]: audit 2024-09-16T09:58:12.500334+0000 mgr.a (mgr.14373) 11291 : audit [DBG] from='client.247623 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:58:13.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:58:12 smithi047 bash[22744]: cluster 2024-09-16T09:58:12.876778+0000 mgr.a (mgr.14373) 11292 : cluster [DBG] pgmap v7831: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-16T09:58:15.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:58:14 smithi157 bash[24585]: cluster 2024-09-16T09:58:14.877529+0000 mgr.a (mgr.14373) 11293 : cluster [DBG] pgmap v7832: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 4.9 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-16T09:58:15.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:58:14 smithi086 bash[24289]: cluster 2024-09-16T09:58:14.877529+0000 mgr.a (mgr.14373) 11293 : cluster [DBG] pgmap v7832: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 4.9 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-16T09:58:15.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:58:14 smithi047 bash[22744]: cluster 2024-09-16T09:58:14.877529+0000 mgr.a (mgr.14373) 11293 : cluster [DBG] pgmap v7832: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 4.9 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-16T09:58:17.310 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:58:16 smithi157 bash[24585]: cluster 2024-09-16T09:58:16.879490+0000 mgr.a (mgr.14373) 11294 : cluster [DBG] pgmap v7833: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-16T09:58:17.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:58:16 smithi086 bash[24289]: cluster 2024-09-16T09:58:16.879490+0000 mgr.a (mgr.14373) 11294 : cluster [DBG] pgmap v7833: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-16T09:58:17.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:58:16 smithi047 bash[22744]: cluster 2024-09-16T09:58:16.879490+0000 mgr.a (mgr.14373) 11294 : cluster [DBG] pgmap v7833: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-16T09:58:17.941 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:58:17.942 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:58:17.942 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:58:18.699 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:58:18.699 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:58:18.699 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:58:18.699 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:58:18.699 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:58:19.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:58:18 smithi157 bash[24585]: audit 2024-09-16T09:58:18.270649+0000 mgr.a (mgr.14373) 11295 : audit [DBG] from='client.247698 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:58:19.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:58:18 smithi157 bash[24585]: cluster 2024-09-16T09:58:18.880394+0000 mgr.a (mgr.14373) 11296 : cluster [DBG] pgmap v7834: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:58:19.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:58:18 smithi086 bash[24289]: audit 2024-09-16T09:58:18.270649+0000 mgr.a (mgr.14373) 11295 : audit [DBG] from='client.247698 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:58:19.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:58:18 smithi086 bash[24289]: cluster 2024-09-16T09:58:18.880394+0000 mgr.a (mgr.14373) 11296 : cluster [DBG] pgmap v7834: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:58:19.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:58:18 smithi047 bash[22744]: audit 2024-09-16T09:58:18.270649+0000 mgr.a (mgr.14373) 11295 : audit [DBG] from='client.247698 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:58:19.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:58:18 smithi047 bash[22744]: cluster 2024-09-16T09:58:18.880394+0000 mgr.a (mgr.14373) 11296 : cluster [DBG] pgmap v7834: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:58:21.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:58:20 smithi157 bash[24585]: cluster 2024-09-16T09:58:20.881146+0000 mgr.a (mgr.14373) 11297 : cluster [DBG] pgmap v7835: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:58:21.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:58:20 smithi086 bash[24289]: cluster 2024-09-16T09:58:20.881146+0000 mgr.a (mgr.14373) 11297 : cluster [DBG] pgmap v7835: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:58:21.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:58:20 smithi047 bash[22744]: cluster 2024-09-16T09:58:20.881146+0000 mgr.a (mgr.14373) 11297 : cluster [DBG] pgmap v7835: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:58:23.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:58:22 smithi157 bash[24585]: cluster 2024-09-16T09:58:22.883300+0000 mgr.a (mgr.14373) 11298 : cluster [DBG] pgmap v7836: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:58:23.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:58:22 smithi086 bash[24289]: cluster 2024-09-16T09:58:22.883300+0000 mgr.a (mgr.14373) 11298 : cluster [DBG] pgmap v7836: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:58:23.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:58:22 smithi047 bash[22744]: cluster 2024-09-16T09:58:22.883300+0000 mgr.a (mgr.14373) 11298 : cluster [DBG] pgmap v7836: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:58:23.700 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:58:23.702 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:58:23.702 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:58:24.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:58:23 smithi157 bash[24585]: audit 2024-09-16T09:58:23.213909+0000 mon.b (mon.2) 1042 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T09:58:24.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:58:23 smithi086 bash[24289]: audit 2024-09-16T09:58:23.213909+0000 mon.b (mon.2) 1042 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T09:58:24.341 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:58:23 smithi047 bash[22744]: audit 2024-09-16T09:58:23.213909+0000 mon.b (mon.2) 1042 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T09:58:24.493 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:58:24.494 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:58:24.494 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:58:24.494 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:58:24.494 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:58:25.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:58:24 smithi157 bash[24585]: audit 2024-09-16T09:58:24.076534+0000 mgr.a (mgr.14373) 11299 : audit [DBG] from='client.247776 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:58:25.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:58:24 smithi157 bash[24585]: audit 2024-09-16T09:58:24.130813+0000 mon.b (mon.2) 1043 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:58:25.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:58:24 smithi157 bash[24585]: audit 2024-09-16T09:58:24.132975+0000 mon.b (mon.2) 1044 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T09:58:25.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:58:24 smithi157 bash[24585]: audit 2024-09-16T09:58:24.139413+0000 mon.a (mon.0) 1242 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:58:25.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:58:24 smithi157 bash[24585]: audit 2024-09-16T09:58:24.145257+0000 mon.b (mon.2) 1045 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:58:25.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:58:24 smithi157 bash[24585]: audit 2024-09-16T09:58:24.147395+0000 mgr.a (mgr.14373) 11300 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:58:25.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:58:24 smithi157 bash[24585]: cluster 2024-09-16T09:58:24.891373+0000 mgr.a (mgr.14373) 11301 : cluster [DBG] pgmap v7837: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:58:25.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:58:24 smithi086 bash[24289]: audit 2024-09-16T09:58:24.076534+0000 mgr.a (mgr.14373) 11299 : audit [DBG] from='client.247776 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:58:25.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:58:24 smithi086 bash[24289]: audit 2024-09-16T09:58:24.130813+0000 mon.b (mon.2) 1043 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:58:25.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:58:24 smithi086 bash[24289]: audit 2024-09-16T09:58:24.132975+0000 mon.b (mon.2) 1044 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T09:58:25.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:58:24 smithi086 bash[24289]: audit 2024-09-16T09:58:24.139413+0000 mon.a (mon.0) 1242 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:58:25.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:58:24 smithi086 bash[24289]: audit 2024-09-16T09:58:24.145257+0000 mon.b (mon.2) 1045 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:58:25.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:58:24 smithi086 bash[24289]: audit 2024-09-16T09:58:24.147395+0000 mgr.a (mgr.14373) 11300 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:58:25.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:58:24 smithi086 bash[24289]: cluster 2024-09-16T09:58:24.891373+0000 mgr.a (mgr.14373) 11301 : cluster [DBG] pgmap v7837: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:58:25.342 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 09:58:25 smithi047 bash[22994]: debug 2024-09-16T09:58:25.200+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T09:58:25.342 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 09:58:25 smithi047 bash[22994]: debug 2024-09-16T09:58:25.200+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T09:58:25.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:58:24 smithi047 bash[22744]: audit 2024-09-16T09:58:24.076534+0000 mgr.a (mgr.14373) 11299 : audit [DBG] from='client.247776 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:58:25.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:58:24 smithi047 bash[22744]: audit 2024-09-16T09:58:24.130813+0000 mon.b (mon.2) 1043 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:58:25.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:58:24 smithi047 bash[22744]: audit 2024-09-16T09:58:24.132975+0000 mon.b (mon.2) 1044 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T09:58:25.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:58:24 smithi047 bash[22744]: audit 2024-09-16T09:58:24.139413+0000 mon.a (mon.0) 1242 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:58:25.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:58:24 smithi047 bash[22744]: audit 2024-09-16T09:58:24.145257+0000 mon.b (mon.2) 1045 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:58:25.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:58:24 smithi047 bash[22744]: audit 2024-09-16T09:58:24.147395+0000 mgr.a (mgr.14373) 11300 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:58:25.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:58:24 smithi047 bash[22744]: cluster 2024-09-16T09:58:24.891373+0000 mgr.a (mgr.14373) 11301 : cluster [DBG] pgmap v7837: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:58:26.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:58:26 smithi157 bash[24585]: audit 2024-09-16T09:58:25.202891+0000 mgr.a (mgr.14373) 11302 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T09:58:26.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:58:26 smithi157 bash[24585]: cephadm 2024-09-16T09:58:25.204917+0000 mgr.a (mgr.14373) 11303 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T09:58:26.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:58:26 smithi086 bash[24289]: audit 2024-09-16T09:58:25.202891+0000 mgr.a (mgr.14373) 11302 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T09:58:26.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:58:26 smithi086 bash[24289]: cephadm 2024-09-16T09:58:25.204917+0000 mgr.a (mgr.14373) 11303 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T09:58:26.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:58:26 smithi047 bash[22744]: audit 2024-09-16T09:58:25.202891+0000 mgr.a (mgr.14373) 11302 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T09:58:26.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:58:26 smithi047 bash[22744]: cephadm 2024-09-16T09:58:25.204917+0000 mgr.a (mgr.14373) 11303 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T09:58:27.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:58:27 smithi157 bash[24585]: cluster 2024-09-16T09:58:26.893672+0000 mgr.a (mgr.14373) 11304 : cluster [DBG] pgmap v7838: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 71 KiB/s rd, 426 B/s wr, 113 op/s 2024-09-16T09:58:27.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:58:27 smithi086 bash[24289]: cluster 2024-09-16T09:58:26.893672+0000 mgr.a (mgr.14373) 11304 : cluster [DBG] pgmap v7838: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 71 KiB/s rd, 426 B/s wr, 113 op/s 2024-09-16T09:58:27.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:58:27 smithi047 bash[22744]: cluster 2024-09-16T09:58:26.893672+0000 mgr.a (mgr.14373) 11304 : cluster [DBG] pgmap v7838: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 71 KiB/s rd, 426 B/s wr, 113 op/s 2024-09-16T09:58:29.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:58:28 smithi157 bash[24585]: cluster 2024-09-16T09:58:28.894458+0000 mgr.a (mgr.14373) 11305 : cluster [DBG] pgmap v7839: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 70 KiB/s rd, 426 B/s wr, 112 op/s 2024-09-16T09:58:29.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:58:28 smithi086 bash[24289]: cluster 2024-09-16T09:58:28.894458+0000 mgr.a (mgr.14373) 11305 : cluster [DBG] pgmap v7839: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 70 KiB/s rd, 426 B/s wr, 112 op/s 2024-09-16T09:58:29.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:58:28 smithi047 bash[22744]: cluster 2024-09-16T09:58:28.894458+0000 mgr.a (mgr.14373) 11305 : cluster [DBG] pgmap v7839: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 70 KiB/s rd, 426 B/s wr, 112 op/s 2024-09-16T09:58:29.495 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:58:29.496 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:58:29.496 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:58:30.276 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:58:30.276 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:58:30.276 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:58:30.276 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:58:30.276 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:58:30.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:58:29 smithi157 bash[24585]: audit 2024-09-16T09:58:29.831655+0000 mgr.a (mgr.14373) 11306 : audit [DBG] from='client.247959 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:58:30.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:58:29 smithi086 bash[24289]: audit 2024-09-16T09:58:29.831655+0000 mgr.a (mgr.14373) 11306 : audit [DBG] from='client.247959 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:58:30.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:58:29 smithi047 bash[22744]: audit 2024-09-16T09:58:29.831655+0000 mgr.a (mgr.14373) 11306 : audit [DBG] from='client.247959 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:58:31.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:58:30 smithi157 bash[24585]: cluster 2024-09-16T09:58:30.895334+0000 mgr.a (mgr.14373) 11307 : cluster [DBG] pgmap v7840: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 70 KiB/s rd, 426 B/s wr, 112 op/s 2024-09-16T09:58:31.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:58:30 smithi086 bash[24289]: cluster 2024-09-16T09:58:30.895334+0000 mgr.a (mgr.14373) 11307 : cluster [DBG] pgmap v7840: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 70 KiB/s rd, 426 B/s wr, 112 op/s 2024-09-16T09:58:31.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:58:30 smithi047 bash[22744]: cluster 2024-09-16T09:58:30.895334+0000 mgr.a (mgr.14373) 11307 : cluster [DBG] pgmap v7840: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 70 KiB/s rd, 426 B/s wr, 112 op/s 2024-09-16T09:58:33.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:58:32 smithi157 bash[24585]: cluster 2024-09-16T09:58:32.897552+0000 mgr.a (mgr.14373) 11308 : cluster [DBG] pgmap v7841: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 71 KiB/s rd, 426 B/s wr, 113 op/s 2024-09-16T09:58:33.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:58:32 smithi086 bash[24289]: cluster 2024-09-16T09:58:32.897552+0000 mgr.a (mgr.14373) 11308 : cluster [DBG] pgmap v7841: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 71 KiB/s rd, 426 B/s wr, 113 op/s 2024-09-16T09:58:33.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:58:32 smithi047 bash[22744]: cluster 2024-09-16T09:58:32.897552+0000 mgr.a (mgr.14373) 11308 : cluster [DBG] pgmap v7841: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 71 KiB/s rd, 426 B/s wr, 113 op/s 2024-09-16T09:58:35.277 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:58:35.278 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:58:35.278 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:58:35.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:58:34 smithi157 bash[24585]: cluster 2024-09-16T09:58:34.898315+0000 mgr.a (mgr.14373) 11309 : cluster [DBG] pgmap v7842: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 70 KiB/s rd, 426 B/s wr, 112 op/s 2024-09-16T09:58:35.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:58:34 smithi086 bash[24289]: cluster 2024-09-16T09:58:34.898315+0000 mgr.a (mgr.14373) 11309 : cluster [DBG] pgmap v7842: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 70 KiB/s rd, 426 B/s wr, 112 op/s 2024-09-16T09:58:35.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:58:34 smithi047 bash[22744]: cluster 2024-09-16T09:58:34.898315+0000 mgr.a (mgr.14373) 11309 : cluster [DBG] pgmap v7842: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 70 KiB/s rd, 426 B/s wr, 112 op/s 2024-09-16T09:58:36.032 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:58:36.033 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:58:36.033 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:58:36.033 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:58:36.033 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:58:36.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:58:35 smithi157 bash[24585]: audit 2024-09-16T09:58:35.603200+0000 mgr.a (mgr.14373) 11310 : audit [DBG] from='client.248037 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:58:36.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:58:35 smithi086 bash[24289]: audit 2024-09-16T09:58:35.603200+0000 mgr.a (mgr.14373) 11310 : audit [DBG] from='client.248037 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:58:36.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:58:35 smithi047 bash[22744]: audit 2024-09-16T09:58:35.603200+0000 mgr.a (mgr.14373) 11310 : audit [DBG] from='client.248037 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:58:37.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:58:36 smithi157 bash[24585]: cluster 2024-09-16T09:58:36.900669+0000 mgr.a (mgr.14373) 11311 : cluster [DBG] pgmap v7843: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 71 KiB/s rd, 426 B/s wr, 113 op/s 2024-09-16T09:58:37.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:58:36 smithi086 bash[24289]: cluster 2024-09-16T09:58:36.900669+0000 mgr.a (mgr.14373) 11311 : cluster [DBG] pgmap v7843: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 71 KiB/s rd, 426 B/s wr, 113 op/s 2024-09-16T09:58:37.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:58:36 smithi047 bash[22744]: cluster 2024-09-16T09:58:36.900669+0000 mgr.a (mgr.14373) 11311 : cluster [DBG] pgmap v7843: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 71 KiB/s rd, 426 B/s wr, 113 op/s 2024-09-16T09:58:39.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:58:38 smithi157 bash[24585]: cluster 2024-09-16T09:58:38.901459+0000 mgr.a (mgr.14373) 11312 : cluster [DBG] pgmap v7844: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:58:39.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:58:38 smithi086 bash[24289]: cluster 2024-09-16T09:58:38.901459+0000 mgr.a (mgr.14373) 11312 : cluster [DBG] pgmap v7844: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:58:39.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:58:38 smithi047 bash[22744]: cluster 2024-09-16T09:58:38.901459+0000 mgr.a (mgr.14373) 11312 : cluster [DBG] pgmap v7844: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:58:41.034 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:58:41.035 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:58:41.035 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:58:41.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:58:40 smithi157 bash[24585]: cluster 2024-09-16T09:58:40.902327+0000 mgr.a (mgr.14373) 11313 : cluster [DBG] pgmap v7845: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:58:41.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:58:40 smithi086 bash[24289]: cluster 2024-09-16T09:58:40.902327+0000 mgr.a (mgr.14373) 11313 : cluster [DBG] pgmap v7845: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:58:41.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:58:40 smithi047 bash[22744]: cluster 2024-09-16T09:58:40.902327+0000 mgr.a (mgr.14373) 11313 : cluster [DBG] pgmap v7845: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:58:41.788 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:58:41.788 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:58:41.788 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:58:41.788 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:58:41.788 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:58:42.308 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:58:41 smithi157 bash[24585]: audit 2024-09-16T09:58:41.364828+0000 mgr.a (mgr.14373) 11314 : audit [DBG] from='client.248112 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:58:42.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:58:41 smithi086 bash[24289]: audit 2024-09-16T09:58:41.364828+0000 mgr.a (mgr.14373) 11314 : audit [DBG] from='client.248112 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:58:42.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:58:41 smithi047 bash[22744]: audit 2024-09-16T09:58:41.364828+0000 mgr.a (mgr.14373) 11314 : audit [DBG] from='client.248112 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:58:43.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:58:42 smithi157 bash[24585]: cluster 2024-09-16T09:58:42.904886+0000 mgr.a (mgr.14373) 11315 : cluster [DBG] pgmap v7846: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:58:43.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:58:42 smithi086 bash[24289]: cluster 2024-09-16T09:58:42.904886+0000 mgr.a (mgr.14373) 11315 : cluster [DBG] pgmap v7846: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:58:43.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:58:42 smithi047 bash[22744]: cluster 2024-09-16T09:58:42.904886+0000 mgr.a (mgr.14373) 11315 : cluster [DBG] pgmap v7846: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:58:45.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:58:44 smithi157 bash[24585]: cluster 2024-09-16T09:58:44.905667+0000 mgr.a (mgr.14373) 11316 : cluster [DBG] pgmap v7847: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:58:45.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:58:44 smithi086 bash[24289]: cluster 2024-09-16T09:58:44.905667+0000 mgr.a (mgr.14373) 11316 : cluster [DBG] pgmap v7847: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:58:45.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:58:44 smithi047 bash[22744]: cluster 2024-09-16T09:58:44.905667+0000 mgr.a (mgr.14373) 11316 : cluster [DBG] pgmap v7847: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:58:46.789 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:58:46.790 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:58:46.790 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:58:47.311 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:58:46 smithi157 bash[24585]: cluster 2024-09-16T09:58:46.906874+0000 mgr.a (mgr.14373) 11317 : cluster [DBG] pgmap v7848: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:58:47.332 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:58:46 smithi086 bash[24289]: cluster 2024-09-16T09:58:46.906874+0000 mgr.a (mgr.14373) 11317 : cluster [DBG] pgmap v7848: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:58:47.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:58:46 smithi047 bash[22744]: cluster 2024-09-16T09:58:46.906874+0000 mgr.a (mgr.14373) 11317 : cluster [DBG] pgmap v7848: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:58:47.567 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:58:47.567 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:58:47.567 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:58:47.567 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:58:47.567 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:58:48.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:58:47 smithi157 bash[24585]: audit 2024-09-16T09:58:47.121927+0000 mgr.a (mgr.14373) 11318 : audit [DBG] from='client.248187 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:58:48.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:58:47 smithi086 bash[24289]: audit 2024-09-16T09:58:47.121927+0000 mgr.a (mgr.14373) 11318 : audit [DBG] from='client.248187 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:58:48.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:58:47 smithi047 bash[22744]: audit 2024-09-16T09:58:47.121927+0000 mgr.a (mgr.14373) 11318 : audit [DBG] from='client.248187 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:58:49.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:58:48 smithi157 bash[24585]: cluster 2024-09-16T09:58:48.907685+0000 mgr.a (mgr.14373) 11319 : cluster [DBG] pgmap v7849: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T09:58:49.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:58:48 smithi086 bash[24289]: cluster 2024-09-16T09:58:48.907685+0000 mgr.a (mgr.14373) 11319 : cluster [DBG] pgmap v7849: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T09:58:49.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:58:48 smithi047 bash[22744]: cluster 2024-09-16T09:58:48.907685+0000 mgr.a (mgr.14373) 11319 : cluster [DBG] pgmap v7849: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T09:58:51.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:58:50 smithi157 bash[24585]: cluster 2024-09-16T09:58:50.908465+0000 mgr.a (mgr.14373) 11320 : cluster [DBG] pgmap v7850: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T09:58:51.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:58:50 smithi086 bash[24289]: cluster 2024-09-16T09:58:50.908465+0000 mgr.a (mgr.14373) 11320 : cluster [DBG] pgmap v7850: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T09:58:51.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:58:50 smithi047 bash[22744]: cluster 2024-09-16T09:58:50.908465+0000 mgr.a (mgr.14373) 11320 : cluster [DBG] pgmap v7850: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T09:58:52.568 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:58:52.569 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:58:52.570 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:58:53.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:58:52 smithi157 bash[24585]: audit 2024-09-16T09:58:52.902158+0000 mgr.a (mgr.14373) 11321 : audit [DBG] from='client.248265 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:58:53.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:58:52 smithi157 bash[24585]: cluster 2024-09-16T09:58:52.924054+0000 mgr.a (mgr.14373) 11322 : cluster [DBG] pgmap v7851: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:58:53.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:58:52 smithi086 bash[24289]: audit 2024-09-16T09:58:52.902158+0000 mgr.a (mgr.14373) 11321 : audit [DBG] from='client.248265 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:58:53.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:58:52 smithi086 bash[24289]: cluster 2024-09-16T09:58:52.924054+0000 mgr.a (mgr.14373) 11322 : cluster [DBG] pgmap v7851: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:58:53.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:58:52 smithi047 bash[22744]: audit 2024-09-16T09:58:52.902158+0000 mgr.a (mgr.14373) 11321 : audit [DBG] from='client.248265 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:58:53.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:58:52 smithi047 bash[22744]: cluster 2024-09-16T09:58:52.924054+0000 mgr.a (mgr.14373) 11322 : cluster [DBG] pgmap v7851: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:58:53.357 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:58:53.358 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:58:53.358 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:58:53.358 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:58:53.358 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:58:55.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:58:54 smithi157 bash[24585]: cluster 2024-09-16T09:58:54.925028+0000 mgr.a (mgr.14373) 11323 : cluster [DBG] pgmap v7852: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:58:55.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:58:54 smithi086 bash[24289]: cluster 2024-09-16T09:58:54.925028+0000 mgr.a (mgr.14373) 11323 : cluster [DBG] pgmap v7852: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:58:55.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:58:54 smithi047 bash[22744]: cluster 2024-09-16T09:58:54.925028+0000 mgr.a (mgr.14373) 11323 : cluster [DBG] pgmap v7852: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:58:57.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:58:56 smithi157 bash[24585]: cluster 2024-09-16T09:58:56.927173+0000 mgr.a (mgr.14373) 11324 : cluster [DBG] pgmap v7853: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:58:57.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:58:56 smithi086 bash[24289]: cluster 2024-09-16T09:58:56.927173+0000 mgr.a (mgr.14373) 11324 : cluster [DBG] pgmap v7853: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:58:57.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:58:56 smithi047 bash[22744]: cluster 2024-09-16T09:58:56.927173+0000 mgr.a (mgr.14373) 11324 : cluster [DBG] pgmap v7853: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:58:58.359 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:58:58.360 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:58:58.360 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:58:59.101 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:58:59.101 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:58:59.101 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:58:59.102 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:58:59.102 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:58:59.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:58:58 smithi157 bash[24585]: audit 2024-09-16T09:58:58.692039+0000 mgr.a (mgr.14373) 11325 : audit [DBG] from='client.248340 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:58:59.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:58:58 smithi157 bash[24585]: cluster 2024-09-16T09:58:58.927818+0000 mgr.a (mgr.14373) 11326 : cluster [DBG] pgmap v7854: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:58:59.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:58:58 smithi086 bash[24289]: audit 2024-09-16T09:58:58.692039+0000 mgr.a (mgr.14373) 11325 : audit [DBG] from='client.248340 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:58:59.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:58:58 smithi086 bash[24289]: cluster 2024-09-16T09:58:58.927818+0000 mgr.a (mgr.14373) 11326 : cluster [DBG] pgmap v7854: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:58:59.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:58:58 smithi047 bash[22744]: audit 2024-09-16T09:58:58.692039+0000 mgr.a (mgr.14373) 11325 : audit [DBG] from='client.248340 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:58:59.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:58:58 smithi047 bash[22744]: cluster 2024-09-16T09:58:58.927818+0000 mgr.a (mgr.14373) 11326 : cluster [DBG] pgmap v7854: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:59:01.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:59:00 smithi157 bash[24585]: cluster 2024-09-16T09:59:00.928687+0000 mgr.a (mgr.14373) 11327 : cluster [DBG] pgmap v7855: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:59:01.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:59:00 smithi086 bash[24289]: cluster 2024-09-16T09:59:00.928687+0000 mgr.a (mgr.14373) 11327 : cluster [DBG] pgmap v7855: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:59:01.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:59:00 smithi047 bash[22744]: cluster 2024-09-16T09:59:00.928687+0000 mgr.a (mgr.14373) 11327 : cluster [DBG] pgmap v7855: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:59:04.103 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:59:04.103 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:59:04.103 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:59:04.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:59:03 smithi157 bash[24585]: cluster 2024-09-16T09:59:02.930893+0000 mgr.a (mgr.14373) 11328 : cluster [DBG] pgmap v7856: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:59:04.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:59:03 smithi086 bash[24289]: cluster 2024-09-16T09:59:02.930893+0000 mgr.a (mgr.14373) 11328 : cluster [DBG] pgmap v7856: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:59:04.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:59:03 smithi047 bash[22744]: cluster 2024-09-16T09:59:02.930893+0000 mgr.a (mgr.14373) 11328 : cluster [DBG] pgmap v7856: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:59:04.873 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:59:04.874 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:59:04.874 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:59:04.874 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:59:04.874 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:59:05.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:59:04 smithi157 bash[24585]: audit 2024-09-16T09:59:04.438888+0000 mgr.a (mgr.14373) 11329 : audit [DBG] from='client.248415 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:59:05.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:59:04 smithi086 bash[24289]: audit 2024-09-16T09:59:04.438888+0000 mgr.a (mgr.14373) 11329 : audit [DBG] from='client.248415 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:59:05.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:59:04 smithi047 bash[22744]: audit 2024-09-16T09:59:04.438888+0000 mgr.a (mgr.14373) 11329 : audit [DBG] from='client.248415 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:59:06.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:59:05 smithi157 bash[24585]: cluster 2024-09-16T09:59:04.931346+0000 mgr.a (mgr.14373) 11330 : cluster [DBG] pgmap v7857: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:59:06.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:59:05 smithi086 bash[24289]: cluster 2024-09-16T09:59:04.931346+0000 mgr.a (mgr.14373) 11330 : cluster [DBG] pgmap v7857: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:59:06.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:59:05 smithi047 bash[22744]: cluster 2024-09-16T09:59:04.931346+0000 mgr.a (mgr.14373) 11330 : cluster [DBG] pgmap v7857: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:59:08.309 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:59:08 smithi157 bash[24585]: cluster 2024-09-16T09:59:06.933416+0000 mgr.a (mgr.14373) 11331 : cluster [DBG] pgmap v7858: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:59:08.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:59:08 smithi086 bash[24289]: cluster 2024-09-16T09:59:06.933416+0000 mgr.a (mgr.14373) 11331 : cluster [DBG] pgmap v7858: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:59:08.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:59:08 smithi047 bash[22744]: cluster 2024-09-16T09:59:06.933416+0000 mgr.a (mgr.14373) 11331 : cluster [DBG] pgmap v7858: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:59:09.875 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:59:09.876 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:59:09.877 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:59:10.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:59:10 smithi157 bash[24585]: cluster 2024-09-16T09:59:08.934145+0000 mgr.a (mgr.14373) 11332 : cluster [DBG] pgmap v7859: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:59:10.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:59:10 smithi086 bash[24289]: cluster 2024-09-16T09:59:08.934145+0000 mgr.a (mgr.14373) 11332 : cluster [DBG] pgmap v7859: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:59:10.341 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:59:10 smithi047 bash[22744]: cluster 2024-09-16T09:59:08.934145+0000 mgr.a (mgr.14373) 11332 : cluster [DBG] pgmap v7859: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:59:10.632 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:59:10.632 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:59:10.633 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:59:10.633 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:59:10.633 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:59:11.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:59:11 smithi157 bash[24585]: audit 2024-09-16T09:59:10.203340+0000 mgr.a (mgr.14373) 11333 : audit [DBG] from='client.248490 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:59:11.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:59:11 smithi086 bash[24289]: audit 2024-09-16T09:59:10.203340+0000 mgr.a (mgr.14373) 11333 : audit [DBG] from='client.248490 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:59:11.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:59:11 smithi047 bash[22744]: audit 2024-09-16T09:59:10.203340+0000 mgr.a (mgr.14373) 11333 : audit [DBG] from='client.248490 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:59:12.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:59:12 smithi157 bash[24585]: cluster 2024-09-16T09:59:10.935024+0000 mgr.a (mgr.14373) 11334 : cluster [DBG] pgmap v7860: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:59:12.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:59:12 smithi086 bash[24289]: cluster 2024-09-16T09:59:10.935024+0000 mgr.a (mgr.14373) 11334 : cluster [DBG] pgmap v7860: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:59:12.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:59:12 smithi047 bash[22744]: cluster 2024-09-16T09:59:10.935024+0000 mgr.a (mgr.14373) 11334 : cluster [DBG] pgmap v7860: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:59:14.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:59:14 smithi157 bash[24585]: cluster 2024-09-16T09:59:12.937175+0000 mgr.a (mgr.14373) 11335 : cluster [DBG] pgmap v7861: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:59:14.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:59:14 smithi086 bash[24289]: cluster 2024-09-16T09:59:12.937175+0000 mgr.a (mgr.14373) 11335 : cluster [DBG] pgmap v7861: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:59:14.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:59:14 smithi047 bash[22744]: cluster 2024-09-16T09:59:12.937175+0000 mgr.a (mgr.14373) 11335 : cluster [DBG] pgmap v7861: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:59:15.634 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:59:15.634 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:59:15.635 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:59:16.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:59:16 smithi157 bash[24585]: cluster 2024-09-16T09:59:14.937961+0000 mgr.a (mgr.14373) 11336 : cluster [DBG] pgmap v7862: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:59:16.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:59:16 smithi086 bash[24289]: cluster 2024-09-16T09:59:14.937961+0000 mgr.a (mgr.14373) 11336 : cluster [DBG] pgmap v7862: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:59:16.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:59:16 smithi047 bash[22744]: cluster 2024-09-16T09:59:14.937961+0000 mgr.a (mgr.14373) 11336 : cluster [DBG] pgmap v7862: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:59:16.414 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:59:16.415 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:59:16.415 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:59:16.415 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:59:16.415 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:59:17.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:59:17 smithi157 bash[24585]: audit 2024-09-16T09:59:15.967733+0000 mgr.a (mgr.14373) 11337 : audit [DBG] from='client.248562 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:59:17.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:59:17 smithi086 bash[24289]: audit 2024-09-16T09:59:15.967733+0000 mgr.a (mgr.14373) 11337 : audit [DBG] from='client.248562 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:59:17.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:59:17 smithi047 bash[22744]: audit 2024-09-16T09:59:15.967733+0000 mgr.a (mgr.14373) 11337 : audit [DBG] from='client.248562 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:59:18.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:59:18 smithi157 bash[24585]: cluster 2024-09-16T09:59:16.940324+0000 mgr.a (mgr.14373) 11338 : cluster [DBG] pgmap v7863: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:59:18.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:59:18 smithi086 bash[24289]: cluster 2024-09-16T09:59:16.940324+0000 mgr.a (mgr.14373) 11338 : cluster [DBG] pgmap v7863: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:59:18.345 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:59:18 smithi047 bash[22744]: cluster 2024-09-16T09:59:16.940324+0000 mgr.a (mgr.14373) 11338 : cluster [DBG] pgmap v7863: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:59:20.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:59:20 smithi157 bash[24585]: cluster 2024-09-16T09:59:18.941095+0000 mgr.a (mgr.14373) 11339 : cluster [DBG] pgmap v7864: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:59:20.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:59:20 smithi086 bash[24289]: cluster 2024-09-16T09:59:18.941095+0000 mgr.a (mgr.14373) 11339 : cluster [DBG] pgmap v7864: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:59:20.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:59:20 smithi047 bash[22744]: cluster 2024-09-16T09:59:18.941095+0000 mgr.a (mgr.14373) 11339 : cluster [DBG] pgmap v7864: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:59:21.416 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:59:21.417 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:59:21.417 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:59:22.206 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:59:22.206 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:59:22.207 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:59:22.207 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:59:22.207 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:59:22.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:59:22 smithi157 bash[24585]: cluster 2024-09-16T09:59:20.941847+0000 mgr.a (mgr.14373) 11340 : cluster [DBG] pgmap v7865: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:59:22.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:59:22 smithi157 bash[24585]: audit 2024-09-16T09:59:21.756703+0000 mgr.a (mgr.14373) 11341 : audit [DBG] from='client.248637 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:59:22.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:59:22 smithi086 bash[24289]: cluster 2024-09-16T09:59:20.941847+0000 mgr.a (mgr.14373) 11340 : cluster [DBG] pgmap v7865: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:59:22.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:59:22 smithi086 bash[24289]: audit 2024-09-16T09:59:21.756703+0000 mgr.a (mgr.14373) 11341 : audit [DBG] from='client.248637 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:59:22.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:59:22 smithi047 bash[22744]: cluster 2024-09-16T09:59:20.941847+0000 mgr.a (mgr.14373) 11340 : cluster [DBG] pgmap v7865: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:59:22.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:59:22 smithi047 bash[22744]: audit 2024-09-16T09:59:21.756703+0000 mgr.a (mgr.14373) 11341 : audit [DBG] from='client.248637 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:59:24.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:59:24 smithi157 bash[24585]: cluster 2024-09-16T09:59:22.944615+0000 mgr.a (mgr.14373) 11342 : cluster [DBG] pgmap v7866: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:59:24.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:59:24 smithi086 bash[24289]: cluster 2024-09-16T09:59:22.944615+0000 mgr.a (mgr.14373) 11342 : cluster [DBG] pgmap v7866: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:59:24.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:59:24 smithi047 bash[22744]: cluster 2024-09-16T09:59:22.944615+0000 mgr.a (mgr.14373) 11342 : cluster [DBG] pgmap v7866: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:59:26.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:59:26 smithi157 bash[24585]: cluster 2024-09-16T09:59:24.945403+0000 mgr.a (mgr.14373) 11343 : cluster [DBG] pgmap v7867: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:59:26.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:59:26 smithi157 bash[24585]: audit 2024-09-16T09:59:25.254296+0000 mon.b (mon.2) 1046 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T09:59:26.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:59:26 smithi086 bash[24289]: cluster 2024-09-16T09:59:24.945403+0000 mgr.a (mgr.14373) 11343 : cluster [DBG] pgmap v7867: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:59:26.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:59:26 smithi086 bash[24289]: audit 2024-09-16T09:59:25.254296+0000 mon.b (mon.2) 1046 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T09:59:26.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:59:26 smithi047 bash[22744]: cluster 2024-09-16T09:59:24.945403+0000 mgr.a (mgr.14373) 11343 : cluster [DBG] pgmap v7867: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T09:59:26.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:59:26 smithi047 bash[22744]: audit 2024-09-16T09:59:25.254296+0000 mon.b (mon.2) 1046 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T09:59:27.208 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:59:27.209 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:59:27.209 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:59:27.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:59:27 smithi157 bash[24585]: audit 2024-09-16T09:59:26.094268+0000 mon.b (mon.2) 1047 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:59:27.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:59:27 smithi157 bash[24585]: audit 2024-09-16T09:59:26.096310+0000 mon.b (mon.2) 1048 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T09:59:27.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:59:27 smithi157 bash[24585]: audit 2024-09-16T09:59:26.107793+0000 mon.a (mon.0) 1243 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:59:27.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:59:27 smithi157 bash[24585]: audit 2024-09-16T09:59:26.112914+0000 mon.b (mon.2) 1049 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:59:27.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:59:27 smithi157 bash[24585]: audit 2024-09-16T09:59:26.115754+0000 mgr.a (mgr.14373) 11344 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:59:27.308 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:59:27 smithi157 bash[24585]: audit 2024-09-16T09:59:26.857858+0000 mgr.a (mgr.14373) 11345 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T09:59:27.308 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:59:27 smithi157 bash[24585]: cephadm 2024-09-16T09:59:26.859598+0000 mgr.a (mgr.14373) 11346 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T09:59:27.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:59:27 smithi086 bash[24289]: audit 2024-09-16T09:59:26.094268+0000 mon.b (mon.2) 1047 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:59:27.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:59:27 smithi086 bash[24289]: audit 2024-09-16T09:59:26.096310+0000 mon.b (mon.2) 1048 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T09:59:27.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:59:27 smithi086 bash[24289]: audit 2024-09-16T09:59:26.107793+0000 mon.a (mon.0) 1243 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:59:27.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:59:27 smithi086 bash[24289]: audit 2024-09-16T09:59:26.112914+0000 mon.b (mon.2) 1049 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:59:27.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:59:27 smithi086 bash[24289]: audit 2024-09-16T09:59:26.115754+0000 mgr.a (mgr.14373) 11344 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:59:27.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:59:27 smithi086 bash[24289]: audit 2024-09-16T09:59:26.857858+0000 mgr.a (mgr.14373) 11345 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T09:59:27.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:59:27 smithi086 bash[24289]: cephadm 2024-09-16T09:59:26.859598+0000 mgr.a (mgr.14373) 11346 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T09:59:27.342 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 09:59:26 smithi047 bash[22994]: debug 2024-09-16T09:59:26.851+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T09:59:27.342 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 09:59:26 smithi047 bash[22994]: debug 2024-09-16T09:59:26.855+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T09:59:27.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:59:27 smithi047 bash[22744]: audit 2024-09-16T09:59:26.094268+0000 mon.b (mon.2) 1047 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:59:27.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:59:27 smithi047 bash[22744]: audit 2024-09-16T09:59:26.096310+0000 mon.b (mon.2) 1048 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T09:59:27.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:59:27 smithi047 bash[22744]: audit 2024-09-16T09:59:26.107793+0000 mon.a (mon.0) 1243 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T09:59:27.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:59:27 smithi047 bash[22744]: audit 2024-09-16T09:59:26.112914+0000 mon.b (mon.2) 1049 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:59:27.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:59:27 smithi047 bash[22744]: audit 2024-09-16T09:59:26.115754+0000 mgr.a (mgr.14373) 11344 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T09:59:27.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:59:27 smithi047 bash[22744]: audit 2024-09-16T09:59:26.857858+0000 mgr.a (mgr.14373) 11345 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T09:59:27.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:59:27 smithi047 bash[22744]: cephadm 2024-09-16T09:59:26.859598+0000 mgr.a (mgr.14373) 11346 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T09:59:27.966 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:59:27.966 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:59:27.966 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:59:27.966 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:59:27.967 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:59:28.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:59:28 smithi157 bash[24585]: cluster 2024-09-16T09:59:26.948174+0000 mgr.a (mgr.14373) 11347 : cluster [DBG] pgmap v7868: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 3.4 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-16T09:59:28.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:59:28 smithi157 bash[24585]: audit 2024-09-16T09:59:27.529010+0000 mgr.a (mgr.14373) 11348 : audit [DBG] from='client.248817 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:59:28.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:59:28 smithi086 bash[24289]: cluster 2024-09-16T09:59:26.948174+0000 mgr.a (mgr.14373) 11347 : cluster [DBG] pgmap v7868: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 3.4 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-16T09:59:28.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:59:28 smithi086 bash[24289]: audit 2024-09-16T09:59:27.529010+0000 mgr.a (mgr.14373) 11348 : audit [DBG] from='client.248817 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:59:28.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:59:28 smithi047 bash[22744]: cluster 2024-09-16T09:59:26.948174+0000 mgr.a (mgr.14373) 11347 : cluster [DBG] pgmap v7868: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 3.4 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-16T09:59:28.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:59:28 smithi047 bash[22744]: audit 2024-09-16T09:59:27.529010+0000 mgr.a (mgr.14373) 11348 : audit [DBG] from='client.248817 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:59:30.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:59:30 smithi157 bash[24585]: cluster 2024-09-16T09:59:28.949187+0000 mgr.a (mgr.14373) 11349 : cluster [DBG] pgmap v7869: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-16T09:59:30.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:59:30 smithi086 bash[24289]: cluster 2024-09-16T09:59:28.949187+0000 mgr.a (mgr.14373) 11349 : cluster [DBG] pgmap v7869: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-16T09:59:30.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:59:30 smithi047 bash[22744]: cluster 2024-09-16T09:59:28.949187+0000 mgr.a (mgr.14373) 11349 : cluster [DBG] pgmap v7869: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-16T09:59:32.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:59:32 smithi157 bash[24585]: cluster 2024-09-16T09:59:30.949983+0000 mgr.a (mgr.14373) 11350 : cluster [DBG] pgmap v7870: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-16T09:59:32.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:59:32 smithi086 bash[24289]: cluster 2024-09-16T09:59:30.949983+0000 mgr.a (mgr.14373) 11350 : cluster [DBG] pgmap v7870: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-16T09:59:32.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:59:32 smithi047 bash[22744]: cluster 2024-09-16T09:59:30.949983+0000 mgr.a (mgr.14373) 11350 : cluster [DBG] pgmap v7870: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-16T09:59:32.968 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:59:32.968 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:59:32.969 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:59:33.725 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:59:33.726 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:59:33.726 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:59:33.726 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:59:33.726 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:59:34.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:59:34 smithi157 bash[24585]: cluster 2024-09-16T09:59:32.952203+0000 mgr.a (mgr.14373) 11351 : cluster [DBG] pgmap v7871: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:59:34.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:59:34 smithi157 bash[24585]: audit 2024-09-16T09:59:33.299429+0000 mgr.a (mgr.14373) 11352 : audit [DBG] from='client.248892 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:59:34.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:59:34 smithi086 bash[24289]: cluster 2024-09-16T09:59:32.952203+0000 mgr.a (mgr.14373) 11351 : cluster [DBG] pgmap v7871: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:59:34.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:59:34 smithi086 bash[24289]: audit 2024-09-16T09:59:33.299429+0000 mgr.a (mgr.14373) 11352 : audit [DBG] from='client.248892 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:59:34.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:59:34 smithi047 bash[22744]: cluster 2024-09-16T09:59:32.952203+0000 mgr.a (mgr.14373) 11351 : cluster [DBG] pgmap v7871: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:59:34.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:59:34 smithi047 bash[22744]: audit 2024-09-16T09:59:33.299429+0000 mgr.a (mgr.14373) 11352 : audit [DBG] from='client.248892 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:59:36.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:59:36 smithi157 bash[24585]: cluster 2024-09-16T09:59:34.953318+0000 mgr.a (mgr.14373) 11353 : cluster [DBG] pgmap v7872: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:59:36.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:59:36 smithi086 bash[24289]: cluster 2024-09-16T09:59:34.953318+0000 mgr.a (mgr.14373) 11353 : cluster [DBG] pgmap v7872: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:59:36.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:59:36 smithi047 bash[22744]: cluster 2024-09-16T09:59:34.953318+0000 mgr.a (mgr.14373) 11353 : cluster [DBG] pgmap v7872: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:59:38.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:59:38 smithi157 bash[24585]: cluster 2024-09-16T09:59:36.955666+0000 mgr.a (mgr.14373) 11354 : cluster [DBG] pgmap v7873: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:59:38.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:59:38 smithi086 bash[24289]: cluster 2024-09-16T09:59:36.955666+0000 mgr.a (mgr.14373) 11354 : cluster [DBG] pgmap v7873: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:59:38.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:59:38 smithi047 bash[22744]: cluster 2024-09-16T09:59:36.955666+0000 mgr.a (mgr.14373) 11354 : cluster [DBG] pgmap v7873: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:59:38.727 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:59:38.728 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:59:38.728 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:59:39.510 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:59:39.510 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:59:39.510 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:59:39.510 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:59:39.510 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:59:40.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:59:40 smithi157 bash[24585]: cluster 2024-09-16T09:59:38.956567+0000 mgr.a (mgr.14373) 11355 : cluster [DBG] pgmap v7874: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 5.4 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-16T09:59:40.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:59:40 smithi157 bash[24585]: audit 2024-09-16T09:59:39.063896+0000 mgr.a (mgr.14373) 11356 : audit [DBG] from='client.248964 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:59:40.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:59:40 smithi086 bash[24289]: cluster 2024-09-16T09:59:38.956567+0000 mgr.a (mgr.14373) 11355 : cluster [DBG] pgmap v7874: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 5.4 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-16T09:59:40.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:59:40 smithi086 bash[24289]: audit 2024-09-16T09:59:39.063896+0000 mgr.a (mgr.14373) 11356 : audit [DBG] from='client.248964 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:59:40.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:59:40 smithi047 bash[22744]: cluster 2024-09-16T09:59:38.956567+0000 mgr.a (mgr.14373) 11355 : cluster [DBG] pgmap v7874: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 5.4 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-16T09:59:40.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:59:40 smithi047 bash[22744]: audit 2024-09-16T09:59:39.063896+0000 mgr.a (mgr.14373) 11356 : audit [DBG] from='client.248964 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:59:42.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:59:42 smithi157 bash[24585]: cluster 2024-09-16T09:59:40.957576+0000 mgr.a (mgr.14373) 11357 : cluster [DBG] pgmap v7875: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 5.4 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-16T09:59:42.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:59:42 smithi086 bash[24289]: cluster 2024-09-16T09:59:40.957576+0000 mgr.a (mgr.14373) 11357 : cluster [DBG] pgmap v7875: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 5.4 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-16T09:59:42.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:59:42 smithi047 bash[22744]: cluster 2024-09-16T09:59:40.957576+0000 mgr.a (mgr.14373) 11357 : cluster [DBG] pgmap v7875: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 5.4 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-16T09:59:44.511 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:59:44.512 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:59:44.512 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:59:44.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:59:44 smithi157 bash[24585]: cluster 2024-09-16T09:59:42.959835+0000 mgr.a (mgr.14373) 11358 : cluster [DBG] pgmap v7876: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-16T09:59:44.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:59:44 smithi086 bash[24289]: cluster 2024-09-16T09:59:42.959835+0000 mgr.a (mgr.14373) 11358 : cluster [DBG] pgmap v7876: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-16T09:59:44.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:59:44 smithi047 bash[22744]: cluster 2024-09-16T09:59:42.959835+0000 mgr.a (mgr.14373) 11358 : cluster [DBG] pgmap v7876: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-16T09:59:45.288 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:59:45.288 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:59:45.288 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:59:45.288 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:59:45.288 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:59:45.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:59:45 smithi157 bash[24585]: audit 2024-09-16T09:59:44.846135+0000 mgr.a (mgr.14373) 11359 : audit [DBG] from='client.249042 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:59:45.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:59:45 smithi086 bash[24289]: audit 2024-09-16T09:59:44.846135+0000 mgr.a (mgr.14373) 11359 : audit [DBG] from='client.249042 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:59:45.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:59:45 smithi047 bash[22744]: audit 2024-09-16T09:59:44.846135+0000 mgr.a (mgr.14373) 11359 : audit [DBG] from='client.249042 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:59:46.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:59:46 smithi157 bash[24585]: cluster 2024-09-16T09:59:44.960571+0000 mgr.a (mgr.14373) 11360 : cluster [DBG] pgmap v7877: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:59:46.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:59:46 smithi086 bash[24289]: cluster 2024-09-16T09:59:44.960571+0000 mgr.a (mgr.14373) 11360 : cluster [DBG] pgmap v7877: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:59:46.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:59:46 smithi047 bash[22744]: cluster 2024-09-16T09:59:44.960571+0000 mgr.a (mgr.14373) 11360 : cluster [DBG] pgmap v7877: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:59:48.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:59:48 smithi157 bash[24585]: cluster 2024-09-16T09:59:46.962926+0000 mgr.a (mgr.14373) 11361 : cluster [DBG] pgmap v7878: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:59:48.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:59:48 smithi086 bash[24289]: cluster 2024-09-16T09:59:46.962926+0000 mgr.a (mgr.14373) 11361 : cluster [DBG] pgmap v7878: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:59:48.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:59:48 smithi047 bash[22744]: cluster 2024-09-16T09:59:46.962926+0000 mgr.a (mgr.14373) 11361 : cluster [DBG] pgmap v7878: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:59:50.290 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:59:50.290 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:59:50.291 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:59:50.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:59:50 smithi157 bash[24585]: cluster 2024-09-16T09:59:48.963672+0000 mgr.a (mgr.14373) 11362 : cluster [DBG] pgmap v7879: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:59:50.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:59:50 smithi086 bash[24289]: cluster 2024-09-16T09:59:48.963672+0000 mgr.a (mgr.14373) 11362 : cluster [DBG] pgmap v7879: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:59:50.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:59:50 smithi047 bash[22744]: cluster 2024-09-16T09:59:48.963672+0000 mgr.a (mgr.14373) 11362 : cluster [DBG] pgmap v7879: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:59:51.058 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:59:51.059 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:59:51.059 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:59:51.059 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:59:51.059 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:59:51.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:59:51 smithi157 bash[24585]: audit 2024-09-16T09:59:50.622655+0000 mgr.a (mgr.14373) 11363 : audit [DBG] from='client.249120 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:59:51.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:59:51 smithi086 bash[24289]: audit 2024-09-16T09:59:50.622655+0000 mgr.a (mgr.14373) 11363 : audit [DBG] from='client.249120 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:59:51.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:59:51 smithi047 bash[22744]: audit 2024-09-16T09:59:50.622655+0000 mgr.a (mgr.14373) 11363 : audit [DBG] from='client.249120 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:59:52.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:59:52 smithi157 bash[24585]: cluster 2024-09-16T09:59:50.964231+0000 mgr.a (mgr.14373) 11364 : cluster [DBG] pgmap v7880: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:59:52.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:59:52 smithi086 bash[24289]: cluster 2024-09-16T09:59:50.964231+0000 mgr.a (mgr.14373) 11364 : cluster [DBG] pgmap v7880: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:59:52.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:59:52 smithi047 bash[22744]: cluster 2024-09-16T09:59:50.964231+0000 mgr.a (mgr.14373) 11364 : cluster [DBG] pgmap v7880: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:59:54.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:59:54 smithi157 bash[24585]: cluster 2024-09-16T09:59:52.966441+0000 mgr.a (mgr.14373) 11365 : cluster [DBG] pgmap v7881: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:59:54.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:59:54 smithi086 bash[24289]: cluster 2024-09-16T09:59:52.966441+0000 mgr.a (mgr.14373) 11365 : cluster [DBG] pgmap v7881: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:59:54.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:59:54 smithi047 bash[22744]: cluster 2024-09-16T09:59:52.966441+0000 mgr.a (mgr.14373) 11365 : cluster [DBG] pgmap v7881: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T09:59:56.060 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T09:59:56.060 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T09:59:56.061 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T09:59:56.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:59:56 smithi157 bash[24585]: cluster 2024-09-16T09:59:54.967191+0000 mgr.a (mgr.14373) 11366 : cluster [DBG] pgmap v7882: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:59:56.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:59:56 smithi086 bash[24289]: cluster 2024-09-16T09:59:54.967191+0000 mgr.a (mgr.14373) 11366 : cluster [DBG] pgmap v7882: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:59:56.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:59:56 smithi047 bash[22744]: cluster 2024-09-16T09:59:54.967191+0000 mgr.a (mgr.14373) 11366 : cluster [DBG] pgmap v7882: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:59:56.833 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T09:59:56.833 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T09:59:56.833 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T09:59:56.834 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T09:59:56.834 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T09:59:57.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:59:57 smithi157 bash[24585]: audit 2024-09-16T09:59:56.395889+0000 mgr.a (mgr.14373) 11367 : audit [DBG] from='client.249195 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:59:57.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:59:57 smithi086 bash[24289]: audit 2024-09-16T09:59:56.395889+0000 mgr.a (mgr.14373) 11367 : audit [DBG] from='client.249195 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:59:57.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:59:57 smithi047 bash[22744]: audit 2024-09-16T09:59:56.395889+0000 mgr.a (mgr.14373) 11367 : audit [DBG] from='client.249195 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:59:58.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 09:59:58 smithi157 bash[24585]: cluster 2024-09-16T09:59:56.969874+0000 mgr.a (mgr.14373) 11368 : cluster [DBG] pgmap v7883: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:59:58.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 09:59:58 smithi086 bash[24289]: cluster 2024-09-16T09:59:56.969874+0000 mgr.a (mgr.14373) 11368 : cluster [DBG] pgmap v7883: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T09:59:58.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 09:59:58 smithi047 bash[22744]: cluster 2024-09-16T09:59:56.969874+0000 mgr.a (mgr.14373) 11368 : cluster [DBG] pgmap v7883: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:00:00.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:00:00 smithi157 bash[24585]: cluster 2024-09-16T09:59:58.970672+0000 mgr.a (mgr.14373) 11369 : cluster [DBG] pgmap v7884: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:00:00.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:00:00 smithi157 bash[24585]: cluster 2024-09-16T10:00:00.000164+0000 mon.a (mon.0) 1244 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-16T10:00:00.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:00:00 smithi086 bash[24289]: cluster 2024-09-16T09:59:58.970672+0000 mgr.a (mgr.14373) 11369 : cluster [DBG] pgmap v7884: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:00:00.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:00:00 smithi086 bash[24289]: cluster 2024-09-16T10:00:00.000164+0000 mon.a (mon.0) 1244 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-16T10:00:00.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:00:00 smithi047 bash[22744]: cluster 2024-09-16T09:59:58.970672+0000 mgr.a (mgr.14373) 11369 : cluster [DBG] pgmap v7884: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:00:00.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:00:00 smithi047 bash[22744]: cluster 2024-09-16T10:00:00.000164+0000 mon.a (mon.0) 1244 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-16T10:00:01.835 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:00:01.835 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:00:01.835 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:00:02.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:00:02 smithi157 bash[24585]: cluster 2024-09-16T10:00:00.971457+0000 mgr.a (mgr.14373) 11370 : cluster [DBG] pgmap v7885: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T10:00:02.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:00:02 smithi086 bash[24289]: cluster 2024-09-16T10:00:00.971457+0000 mgr.a (mgr.14373) 11370 : cluster [DBG] pgmap v7885: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T10:00:02.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:00:02 smithi047 bash[22744]: cluster 2024-09-16T10:00:00.971457+0000 mgr.a (mgr.14373) 11370 : cluster [DBG] pgmap v7885: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T10:00:02.623 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:00:02.624 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:00:02.624 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:00:02.624 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:00:02.624 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:00:03.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:00:03 smithi157 bash[24585]: audit 2024-09-16T10:00:02.174368+0000 mgr.a (mgr.14373) 11371 : audit [DBG] from='client.249273 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:00:03.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:00:03 smithi086 bash[24289]: audit 2024-09-16T10:00:02.174368+0000 mgr.a (mgr.14373) 11371 : audit [DBG] from='client.249273 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:00:03.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:00:03 smithi047 bash[22744]: audit 2024-09-16T10:00:02.174368+0000 mgr.a (mgr.14373) 11371 : audit [DBG] from='client.249273 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:00:04.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:00:04 smithi157 bash[24585]: cluster 2024-09-16T10:00:02.974278+0000 mgr.a (mgr.14373) 11372 : cluster [DBG] pgmap v7886: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:00:04.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:00:04 smithi086 bash[24289]: cluster 2024-09-16T10:00:02.974278+0000 mgr.a (mgr.14373) 11372 : cluster [DBG] pgmap v7886: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:00:04.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:00:04 smithi047 bash[22744]: cluster 2024-09-16T10:00:02.974278+0000 mgr.a (mgr.14373) 11372 : cluster [DBG] pgmap v7886: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:00:06.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:00:06 smithi157 bash[24585]: cluster 2024-09-16T10:00:04.975089+0000 mgr.a (mgr.14373) 11373 : cluster [DBG] pgmap v7887: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:00:06.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:00:06 smithi086 bash[24289]: cluster 2024-09-16T10:00:04.975089+0000 mgr.a (mgr.14373) 11373 : cluster [DBG] pgmap v7887: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:00:06.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:00:06 smithi047 bash[22744]: cluster 2024-09-16T10:00:04.975089+0000 mgr.a (mgr.14373) 11373 : cluster [DBG] pgmap v7887: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:00:07.625 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:00:07.626 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:00:07.626 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:00:08.407 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:00:08.407 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:00:08.407 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:00:08.407 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:00:08.407 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:00:08.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:00:08 smithi157 bash[24585]: cluster 2024-09-16T10:00:06.977024+0000 mgr.a (mgr.14373) 11374 : cluster [DBG] pgmap v7888: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:00:08.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:00:08 smithi086 bash[24289]: cluster 2024-09-16T10:00:06.977024+0000 mgr.a (mgr.14373) 11374 : cluster [DBG] pgmap v7888: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:00:08.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:00:08 smithi047 bash[22744]: cluster 2024-09-16T10:00:06.977024+0000 mgr.a (mgr.14373) 11374 : cluster [DBG] pgmap v7888: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:00:09.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:00:09 smithi157 bash[24585]: audit 2024-09-16T10:00:07.962755+0000 mgr.a (mgr.14373) 11375 : audit [DBG] from='client.249348 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:00:09.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:00:09 smithi086 bash[24289]: audit 2024-09-16T10:00:07.962755+0000 mgr.a (mgr.14373) 11375 : audit [DBG] from='client.249348 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:00:09.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:00:09 smithi047 bash[22744]: audit 2024-09-16T10:00:07.962755+0000 mgr.a (mgr.14373) 11375 : audit [DBG] from='client.249348 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:00:10.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:00:10 smithi157 bash[24585]: cluster 2024-09-16T10:00:08.977992+0000 mgr.a (mgr.14373) 11376 : cluster [DBG] pgmap v7889: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:00:10.832 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:00:10 smithi047 bash[22744]: cluster 2024-09-16T10:00:08.977992+0000 mgr.a (mgr.14373) 11376 : cluster [DBG] pgmap v7889: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:00:10.832 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:00:10 smithi086 bash[24289]: cluster 2024-09-16T10:00:08.977992+0000 mgr.a (mgr.14373) 11376 : cluster [DBG] pgmap v7889: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:00:12.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:00:12 smithi157 bash[24585]: cluster 2024-09-16T10:00:10.978799+0000 mgr.a (mgr.14373) 11377 : cluster [DBG] pgmap v7890: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:00:12.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:00:12 smithi086 bash[24289]: cluster 2024-09-16T10:00:10.978799+0000 mgr.a (mgr.14373) 11377 : cluster [DBG] pgmap v7890: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:00:12.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:00:12 smithi047 bash[22744]: cluster 2024-09-16T10:00:10.978799+0000 mgr.a (mgr.14373) 11377 : cluster [DBG] pgmap v7890: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:00:13.408 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:00:13.409 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:00:13.409 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:00:14.184 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:00:14.185 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:00:14.185 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:00:14.185 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:00:14.185 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:00:14.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:00:14 smithi157 bash[24585]: cluster 2024-09-16T10:00:12.981006+0000 mgr.a (mgr.14373) 11378 : cluster [DBG] pgmap v7891: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:00:14.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:00:14 smithi157 bash[24585]: audit 2024-09-16T10:00:13.743754+0000 mgr.a (mgr.14373) 11379 : audit [DBG] from='client.249426 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:00:14.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:00:14 smithi086 bash[24289]: cluster 2024-09-16T10:00:12.981006+0000 mgr.a (mgr.14373) 11378 : cluster [DBG] pgmap v7891: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:00:14.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:00:14 smithi086 bash[24289]: audit 2024-09-16T10:00:13.743754+0000 mgr.a (mgr.14373) 11379 : audit [DBG] from='client.249426 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:00:14.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:00:14 smithi047 bash[22744]: cluster 2024-09-16T10:00:12.981006+0000 mgr.a (mgr.14373) 11378 : cluster [DBG] pgmap v7891: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:00:14.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:00:14 smithi047 bash[22744]: audit 2024-09-16T10:00:13.743754+0000 mgr.a (mgr.14373) 11379 : audit [DBG] from='client.249426 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:00:16.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:00:16 smithi157 bash[24585]: cluster 2024-09-16T10:00:14.981974+0000 mgr.a (mgr.14373) 11380 : cluster [DBG] pgmap v7892: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:00:16.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:00:16 smithi086 bash[24289]: cluster 2024-09-16T10:00:14.981974+0000 mgr.a (mgr.14373) 11380 : cluster [DBG] pgmap v7892: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:00:16.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:00:16 smithi047 bash[22744]: cluster 2024-09-16T10:00:14.981974+0000 mgr.a (mgr.14373) 11380 : cluster [DBG] pgmap v7892: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:00:18.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:00:18 smithi157 bash[24585]: cluster 2024-09-16T10:00:16.984116+0000 mgr.a (mgr.14373) 11381 : cluster [DBG] pgmap v7893: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:00:18.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:00:18 smithi086 bash[24289]: cluster 2024-09-16T10:00:16.984116+0000 mgr.a (mgr.14373) 11381 : cluster [DBG] pgmap v7893: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:00:18.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:00:18 smithi047 bash[22744]: cluster 2024-09-16T10:00:16.984116+0000 mgr.a (mgr.14373) 11381 : cluster [DBG] pgmap v7893: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:00:19.186 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:00:19.187 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:00:19.187 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:00:19.970 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:00:19.971 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:00:19.971 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:00:19.971 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:00:19.971 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:00:20.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:00:20 smithi157 bash[24585]: cluster 2024-09-16T10:00:18.984859+0000 mgr.a (mgr.14373) 11382 : cluster [DBG] pgmap v7894: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:00:20.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:00:20 smithi157 bash[24585]: audit 2024-09-16T10:00:19.520668+0000 mgr.a (mgr.14373) 11383 : audit [DBG] from='client.249504 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:00:20.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:00:20 smithi086 bash[24289]: cluster 2024-09-16T10:00:18.984859+0000 mgr.a (mgr.14373) 11382 : cluster [DBG] pgmap v7894: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:00:20.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:00:20 smithi086 bash[24289]: audit 2024-09-16T10:00:19.520668+0000 mgr.a (mgr.14373) 11383 : audit [DBG] from='client.249504 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:00:20.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:00:20 smithi047 bash[22744]: cluster 2024-09-16T10:00:18.984859+0000 mgr.a (mgr.14373) 11382 : cluster [DBG] pgmap v7894: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:00:20.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:00:20 smithi047 bash[22744]: audit 2024-09-16T10:00:19.520668+0000 mgr.a (mgr.14373) 11383 : audit [DBG] from='client.249504 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:00:22.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:00:22 smithi157 bash[24585]: cluster 2024-09-16T10:00:20.985813+0000 mgr.a (mgr.14373) 11384 : cluster [DBG] pgmap v7895: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:00:22.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:00:22 smithi086 bash[24289]: cluster 2024-09-16T10:00:20.985813+0000 mgr.a (mgr.14373) 11384 : cluster [DBG] pgmap v7895: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:00:22.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:00:22 smithi047 bash[22744]: cluster 2024-09-16T10:00:20.985813+0000 mgr.a (mgr.14373) 11384 : cluster [DBG] pgmap v7895: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:00:24.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:00:24 smithi157 bash[24585]: cluster 2024-09-16T10:00:22.988085+0000 mgr.a (mgr.14373) 11385 : cluster [DBG] pgmap v7896: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:00:24.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:00:24 smithi086 bash[24289]: cluster 2024-09-16T10:00:22.988085+0000 mgr.a (mgr.14373) 11385 : cluster [DBG] pgmap v7896: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:00:24.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:00:24 smithi047 bash[22744]: cluster 2024-09-16T10:00:22.988085+0000 mgr.a (mgr.14373) 11385 : cluster [DBG] pgmap v7896: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:00:24.972 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:00:24.973 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:00:24.973 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:00:25.757 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:00:25.757 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:00:25.757 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:00:25.757 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:00:25.757 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:00:26.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:00:26 smithi157 bash[24585]: cluster 2024-09-16T10:00:24.988657+0000 mgr.a (mgr.14373) 11386 : cluster [DBG] pgmap v7897: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:00:26.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:00:26 smithi157 bash[24585]: audit 2024-09-16T10:00:25.308367+0000 mgr.a (mgr.14373) 11387 : audit [DBG] from='client.249579 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:00:26.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:00:26 smithi086 bash[24289]: cluster 2024-09-16T10:00:24.988657+0000 mgr.a (mgr.14373) 11386 : cluster [DBG] pgmap v7897: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:00:26.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:00:26 smithi086 bash[24289]: audit 2024-09-16T10:00:25.308367+0000 mgr.a (mgr.14373) 11387 : audit [DBG] from='client.249579 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:00:26.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:00:26 smithi047 bash[22744]: cluster 2024-09-16T10:00:24.988657+0000 mgr.a (mgr.14373) 11386 : cluster [DBG] pgmap v7897: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:00:26.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:00:26 smithi047 bash[22744]: audit 2024-09-16T10:00:25.308367+0000 mgr.a (mgr.14373) 11387 : audit [DBG] from='client.249579 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:00:27.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:00:27 smithi157 bash[24585]: audit 2024-09-16T10:00:26.912816+0000 mon.b (mon.2) 1050 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T10:00:27.569 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:00:27 smithi086 bash[24289]: audit 2024-09-16T10:00:26.912816+0000 mon.b (mon.2) 1050 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T10:00:27.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:00:27 smithi047 bash[22744]: audit 2024-09-16T10:00:26.912816+0000 mon.b (mon.2) 1050 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T10:00:28.540 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:00:28 smithi047 bash[22744]: cluster 2024-09-16T10:00:26.991571+0000 mgr.a (mgr.14373) 11388 : cluster [DBG] pgmap v7898: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:00:28.540 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:00:28 smithi047 bash[22744]: audit 2024-09-16T10:00:27.763960+0000 mon.b (mon.2) 1051 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T10:00:28.540 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:00:28 smithi047 bash[22744]: audit 2024-09-16T10:00:27.766214+0000 mon.b (mon.2) 1052 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T10:00:28.540 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:00:28 smithi047 bash[22744]: audit 2024-09-16T10:00:27.776081+0000 mon.a (mon.0) 1245 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:00:28.540 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:00:28 smithi047 bash[22744]: audit 2024-09-16T10:00:27.783279+0000 mon.b (mon.2) 1053 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:00:28.540 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:00:28 smithi047 bash[22744]: audit 2024-09-16T10:00:27.785126+0000 mgr.a (mgr.14373) 11389 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:00:28.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:00:28 smithi157 bash[24585]: cluster 2024-09-16T10:00:26.991571+0000 mgr.a (mgr.14373) 11388 : cluster [DBG] pgmap v7898: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:00:28.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:00:28 smithi157 bash[24585]: audit 2024-09-16T10:00:27.763960+0000 mon.b (mon.2) 1051 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T10:00:28.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:00:28 smithi157 bash[24585]: audit 2024-09-16T10:00:27.766214+0000 mon.b (mon.2) 1052 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T10:00:28.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:00:28 smithi157 bash[24585]: audit 2024-09-16T10:00:27.776081+0000 mon.a (mon.0) 1245 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:00:28.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:00:28 smithi157 bash[24585]: audit 2024-09-16T10:00:27.783279+0000 mon.b (mon.2) 1053 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:00:28.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:00:28 smithi157 bash[24585]: audit 2024-09-16T10:00:27.785126+0000 mgr.a (mgr.14373) 11389 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:00:28.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:00:28 smithi086 bash[24289]: cluster 2024-09-16T10:00:26.991571+0000 mgr.a (mgr.14373) 11388 : cluster [DBG] pgmap v7898: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:00:28.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:00:28 smithi086 bash[24289]: audit 2024-09-16T10:00:27.763960+0000 mon.b (mon.2) 1051 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T10:00:28.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:00:28 smithi086 bash[24289]: audit 2024-09-16T10:00:27.766214+0000 mon.b (mon.2) 1052 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T10:00:28.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:00:28 smithi086 bash[24289]: audit 2024-09-16T10:00:27.776081+0000 mon.a (mon.0) 1245 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:00:28.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:00:28 smithi086 bash[24289]: audit 2024-09-16T10:00:27.783279+0000 mon.b (mon.2) 1053 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:00:28.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:00:28 smithi086 bash[24289]: audit 2024-09-16T10:00:27.785126+0000 mgr.a (mgr.14373) 11389 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:00:28.842 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 10:00:28 smithi047 bash[22994]: debug 2024-09-16T10:00:28.538+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T10:00:28.842 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 10:00:28 smithi047 bash[22994]: debug 2024-09-16T10:00:28.538+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T10:00:29.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:00:29 smithi157 bash[24585]: audit 2024-09-16T10:00:28.538913+0000 mgr.a (mgr.14373) 11390 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T10:00:29.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:00:29 smithi157 bash[24585]: cephadm 2024-09-16T10:00:28.541084+0000 mgr.a (mgr.14373) 11391 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T10:00:29.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:00:29 smithi086 bash[24289]: audit 2024-09-16T10:00:28.538913+0000 mgr.a (mgr.14373) 11390 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T10:00:29.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:00:29 smithi086 bash[24289]: cephadm 2024-09-16T10:00:28.541084+0000 mgr.a (mgr.14373) 11391 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T10:00:29.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:00:29 smithi047 bash[22744]: audit 2024-09-16T10:00:28.538913+0000 mgr.a (mgr.14373) 11390 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T10:00:29.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:00:29 smithi047 bash[22744]: cephadm 2024-09-16T10:00:28.541084+0000 mgr.a (mgr.14373) 11391 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T10:00:30.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:00:30 smithi157 bash[24585]: cluster 2024-09-16T10:00:28.992529+0000 mgr.a (mgr.14373) 11392 : cluster [DBG] pgmap v7899: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:00:30.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:00:30 smithi086 bash[24289]: cluster 2024-09-16T10:00:28.992529+0000 mgr.a (mgr.14373) 11392 : cluster [DBG] pgmap v7899: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:00:30.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:00:30 smithi047 bash[22744]: cluster 2024-09-16T10:00:28.992529+0000 mgr.a (mgr.14373) 11392 : cluster [DBG] pgmap v7899: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:00:30.758 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:00:30.759 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:00:30.759 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:00:31.539 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:00:31.540 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:00:31.540 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:00:31.540 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:00:31.540 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:00:32.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:00:32 smithi157 bash[24585]: cluster 2024-09-16T10:00:30.993290+0000 mgr.a (mgr.14373) 11393 : cluster [DBG] pgmap v7900: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:00:32.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:00:32 smithi157 bash[24585]: audit 2024-09-16T10:00:31.092148+0000 mgr.a (mgr.14373) 11394 : audit [DBG] from='client.249759 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:00:32.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:00:32 smithi086 bash[24289]: cluster 2024-09-16T10:00:30.993290+0000 mgr.a (mgr.14373) 11393 : cluster [DBG] pgmap v7900: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:00:32.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:00:32 smithi086 bash[24289]: audit 2024-09-16T10:00:31.092148+0000 mgr.a (mgr.14373) 11394 : audit [DBG] from='client.249759 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:00:32.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:00:32 smithi047 bash[22744]: cluster 2024-09-16T10:00:30.993290+0000 mgr.a (mgr.14373) 11393 : cluster [DBG] pgmap v7900: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:00:32.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:00:32 smithi047 bash[22744]: audit 2024-09-16T10:00:31.092148+0000 mgr.a (mgr.14373) 11394 : audit [DBG] from='client.249759 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:00:34.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:00:34 smithi157 bash[24585]: cluster 2024-09-16T10:00:32.995708+0000 mgr.a (mgr.14373) 11395 : cluster [DBG] pgmap v7901: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:00:34.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:00:34 smithi086 bash[24289]: cluster 2024-09-16T10:00:32.995708+0000 mgr.a (mgr.14373) 11395 : cluster [DBG] pgmap v7901: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:00:34.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:00:34 smithi047 bash[22744]: cluster 2024-09-16T10:00:32.995708+0000 mgr.a (mgr.14373) 11395 : cluster [DBG] pgmap v7901: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:00:36.541 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:00:36.542 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:00:36.542 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:00:36.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:00:36 smithi157 bash[24585]: cluster 2024-09-16T10:00:34.996516+0000 mgr.a (mgr.14373) 11396 : cluster [DBG] pgmap v7902: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T10:00:36.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:00:36 smithi086 bash[24289]: cluster 2024-09-16T10:00:34.996516+0000 mgr.a (mgr.14373) 11396 : cluster [DBG] pgmap v7902: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T10:00:36.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:00:36 smithi047 bash[22744]: cluster 2024-09-16T10:00:34.996516+0000 mgr.a (mgr.14373) 11396 : cluster [DBG] pgmap v7902: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T10:00:37.303 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:00:37.304 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:00:37.304 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:00:37.304 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:00:37.304 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:00:37.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:00:37 smithi157 bash[24585]: audit 2024-09-16T10:00:36.875346+0000 mgr.a (mgr.14373) 11397 : audit [DBG] from='client.249831 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:00:37.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:00:37 smithi086 bash[24289]: audit 2024-09-16T10:00:36.875346+0000 mgr.a (mgr.14373) 11397 : audit [DBG] from='client.249831 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:00:37.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:00:37 smithi047 bash[22744]: audit 2024-09-16T10:00:36.875346+0000 mgr.a (mgr.14373) 11397 : audit [DBG] from='client.249831 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:00:38.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:00:38 smithi157 bash[24585]: cluster 2024-09-16T10:00:36.997832+0000 mgr.a (mgr.14373) 11398 : cluster [DBG] pgmap v7903: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:00:38.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:00:38 smithi086 bash[24289]: cluster 2024-09-16T10:00:36.997832+0000 mgr.a (mgr.14373) 11398 : cluster [DBG] pgmap v7903: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:00:38.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:00:38 smithi047 bash[22744]: cluster 2024-09-16T10:00:36.997832+0000 mgr.a (mgr.14373) 11398 : cluster [DBG] pgmap v7903: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:00:40.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:00:40 smithi086 bash[24289]: cluster 2024-09-16T10:00:38.998731+0000 mgr.a (mgr.14373) 11399 : cluster [DBG] pgmap v7904: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T10:00:40.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:00:40 smithi047 bash[22744]: cluster 2024-09-16T10:00:38.998731+0000 mgr.a (mgr.14373) 11399 : cluster [DBG] pgmap v7904: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T10:00:40.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:00:40 smithi157 bash[24585]: cluster 2024-09-16T10:00:38.998731+0000 mgr.a (mgr.14373) 11399 : cluster [DBG] pgmap v7904: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T10:00:42.305 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:00:42.306 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:00:42.306 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:00:42.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:00:42 smithi086 bash[24289]: cluster 2024-09-16T10:00:40.999534+0000 mgr.a (mgr.14373) 11400 : cluster [DBG] pgmap v7905: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T10:00:42.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:00:42 smithi047 bash[22744]: cluster 2024-09-16T10:00:40.999534+0000 mgr.a (mgr.14373) 11400 : cluster [DBG] pgmap v7905: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T10:00:42.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:00:42 smithi157 bash[24585]: cluster 2024-09-16T10:00:40.999534+0000 mgr.a (mgr.14373) 11400 : cluster [DBG] pgmap v7905: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T10:00:43.085 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:00:43.085 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:00:43.085 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:00:43.086 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:00:43.086 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:00:43.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:00:43 smithi047 bash[22744]: audit 2024-09-16T10:00:42.640962+0000 mgr.a (mgr.14373) 11401 : audit [DBG] from='client.249906 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:00:43.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:00:43 smithi157 bash[24585]: audit 2024-09-16T10:00:42.640962+0000 mgr.a (mgr.14373) 11401 : audit [DBG] from='client.249906 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:00:43.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:00:43 smithi086 bash[24289]: audit 2024-09-16T10:00:42.640962+0000 mgr.a (mgr.14373) 11401 : audit [DBG] from='client.249906 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:00:44.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:00:44 smithi047 bash[22744]: cluster 2024-09-16T10:00:43.000899+0000 mgr.a (mgr.14373) 11402 : cluster [DBG] pgmap v7906: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:00:44.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:00:44 smithi157 bash[24585]: cluster 2024-09-16T10:00:43.000899+0000 mgr.a (mgr.14373) 11402 : cluster [DBG] pgmap v7906: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:00:44.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:00:44 smithi086 bash[24289]: cluster 2024-09-16T10:00:43.000899+0000 mgr.a (mgr.14373) 11402 : cluster [DBG] pgmap v7906: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:00:46.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:00:46 smithi047 bash[22744]: cluster 2024-09-16T10:00:45.001648+0000 mgr.a (mgr.14373) 11403 : cluster [DBG] pgmap v7907: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-16T10:00:46.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:00:46 smithi157 bash[24585]: cluster 2024-09-16T10:00:45.001648+0000 mgr.a (mgr.14373) 11403 : cluster [DBG] pgmap v7907: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-16T10:00:46.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:00:46 smithi086 bash[24289]: cluster 2024-09-16T10:00:45.001648+0000 mgr.a (mgr.14373) 11403 : cluster [DBG] pgmap v7907: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-16T10:00:48.087 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:00:48.088 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:00:48.088 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:00:48.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:00:48 smithi047 bash[22744]: cluster 2024-09-16T10:00:47.003639+0000 mgr.a (mgr.14373) 11404 : cluster [DBG] pgmap v7908: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-16T10:00:48.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:00:48 smithi157 bash[24585]: cluster 2024-09-16T10:00:47.003639+0000 mgr.a (mgr.14373) 11404 : cluster [DBG] pgmap v7908: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-16T10:00:48.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:00:48 smithi086 bash[24289]: cluster 2024-09-16T10:00:47.003639+0000 mgr.a (mgr.14373) 11404 : cluster [DBG] pgmap v7908: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-16T10:00:48.878 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:00:48.878 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:00:48.878 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:00:48.878 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:00:48.878 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:00:49.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:00:49 smithi047 bash[22744]: audit 2024-09-16T10:00:48.427329+0000 mgr.a (mgr.14373) 11405 : audit [DBG] from='client.249981 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:00:49.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:00:49 smithi157 bash[24585]: audit 2024-09-16T10:00:48.427329+0000 mgr.a (mgr.14373) 11405 : audit [DBG] from='client.249981 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:00:49.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:00:49 smithi086 bash[24289]: audit 2024-09-16T10:00:48.427329+0000 mgr.a (mgr.14373) 11405 : audit [DBG] from='client.249981 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:00:50.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:00:50 smithi157 bash[24585]: cluster 2024-09-16T10:00:49.004488+0000 mgr.a (mgr.14373) 11406 : cluster [DBG] pgmap v7909: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:00:50.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:00:50 smithi086 bash[24289]: cluster 2024-09-16T10:00:49.004488+0000 mgr.a (mgr.14373) 11406 : cluster [DBG] pgmap v7909: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:00:50.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:00:50 smithi047 bash[22744]: cluster 2024-09-16T10:00:49.004488+0000 mgr.a (mgr.14373) 11406 : cluster [DBG] pgmap v7909: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:00:52.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:00:52 smithi157 bash[24585]: cluster 2024-09-16T10:00:51.005308+0000 mgr.a (mgr.14373) 11407 : cluster [DBG] pgmap v7910: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:00:52.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:00:52 smithi086 bash[24289]: cluster 2024-09-16T10:00:51.005308+0000 mgr.a (mgr.14373) 11407 : cluster [DBG] pgmap v7910: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:00:52.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:00:52 smithi047 bash[22744]: cluster 2024-09-16T10:00:51.005308+0000 mgr.a (mgr.14373) 11407 : cluster [DBG] pgmap v7910: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:00:53.880 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:00:53.880 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:00:53.880 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:00:54.633 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:00:54.633 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:00:54.634 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:00:54.634 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:00:54.634 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:00:54.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:00:54 smithi157 bash[24585]: cluster 2024-09-16T10:00:53.007530+0000 mgr.a (mgr.14373) 11408 : cluster [DBG] pgmap v7911: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:00:54.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:00:54 smithi086 bash[24289]: cluster 2024-09-16T10:00:53.007530+0000 mgr.a (mgr.14373) 11408 : cluster [DBG] pgmap v7911: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:00:54.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:00:54 smithi047 bash[22744]: cluster 2024-09-16T10:00:53.007530+0000 mgr.a (mgr.14373) 11408 : cluster [DBG] pgmap v7911: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:00:55.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:00:55 smithi157 bash[24585]: audit 2024-09-16T10:00:54.207464+0000 mgr.a (mgr.14373) 11409 : audit [DBG] from='client.250059 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:00:55.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:00:55 smithi086 bash[24289]: audit 2024-09-16T10:00:54.207464+0000 mgr.a (mgr.14373) 11409 : audit [DBG] from='client.250059 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:00:55.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:00:55 smithi047 bash[22744]: audit 2024-09-16T10:00:54.207464+0000 mgr.a (mgr.14373) 11409 : audit [DBG] from='client.250059 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:00:56.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:00:56 smithi157 bash[24585]: cluster 2024-09-16T10:00:55.008476+0000 mgr.a (mgr.14373) 11410 : cluster [DBG] pgmap v7912: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:00:56.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:00:56 smithi086 bash[24289]: cluster 2024-09-16T10:00:55.008476+0000 mgr.a (mgr.14373) 11410 : cluster [DBG] pgmap v7912: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:00:56.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:00:56 smithi047 bash[22744]: cluster 2024-09-16T10:00:55.008476+0000 mgr.a (mgr.14373) 11410 : cluster [DBG] pgmap v7912: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:00:58.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:00:58 smithi157 bash[24585]: cluster 2024-09-16T10:00:57.010812+0000 mgr.a (mgr.14373) 11411 : cluster [DBG] pgmap v7913: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:00:58.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:00:58 smithi086 bash[24289]: cluster 2024-09-16T10:00:57.010812+0000 mgr.a (mgr.14373) 11411 : cluster [DBG] pgmap v7913: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:00:58.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:00:58 smithi047 bash[22744]: cluster 2024-09-16T10:00:57.010812+0000 mgr.a (mgr.14373) 11411 : cluster [DBG] pgmap v7913: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:00:59.635 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:00:59.635 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:00:59.636 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:01:00.431 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:01:00.431 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:01:00.432 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:01:00.432 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:01:00.432 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:01:00.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:01:00 smithi157 bash[24585]: cluster 2024-09-16T10:00:59.011556+0000 mgr.a (mgr.14373) 11412 : cluster [DBG] pgmap v7914: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:01:00.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:01:00 smithi086 bash[24289]: cluster 2024-09-16T10:00:59.011556+0000 mgr.a (mgr.14373) 11412 : cluster [DBG] pgmap v7914: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:01:00.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:01:00 smithi047 bash[22744]: cluster 2024-09-16T10:00:59.011556+0000 mgr.a (mgr.14373) 11412 : cluster [DBG] pgmap v7914: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:01:01.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:01:01 smithi157 bash[24585]: audit 2024-09-16T10:00:59.974448+0000 mgr.a (mgr.14373) 11413 : audit [DBG] from='client.250137 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:01:01.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:01:01 smithi086 bash[24289]: audit 2024-09-16T10:00:59.974448+0000 mgr.a (mgr.14373) 11413 : audit [DBG] from='client.250137 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:01:01.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:01:01 smithi047 bash[22744]: audit 2024-09-16T10:00:59.974448+0000 mgr.a (mgr.14373) 11413 : audit [DBG] from='client.250137 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:01:02.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:01:02 smithi157 bash[24585]: cluster 2024-09-16T10:01:01.012516+0000 mgr.a (mgr.14373) 11414 : cluster [DBG] pgmap v7915: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:01:02.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:01:02 smithi086 bash[24289]: cluster 2024-09-16T10:01:01.012516+0000 mgr.a (mgr.14373) 11414 : cluster [DBG] pgmap v7915: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:01:02.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:01:02 smithi047 bash[22744]: cluster 2024-09-16T10:01:01.012516+0000 mgr.a (mgr.14373) 11414 : cluster [DBG] pgmap v7915: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:01:04.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:01:04 smithi157 bash[24585]: cluster 2024-09-16T10:01:03.014812+0000 mgr.a (mgr.14373) 11415 : cluster [DBG] pgmap v7916: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:01:04.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:01:04 smithi086 bash[24289]: cluster 2024-09-16T10:01:03.014812+0000 mgr.a (mgr.14373) 11415 : cluster [DBG] pgmap v7916: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:01:04.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:01:04 smithi047 bash[22744]: cluster 2024-09-16T10:01:03.014812+0000 mgr.a (mgr.14373) 11415 : cluster [DBG] pgmap v7916: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:01:05.433 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:01:05.433 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:01:05.433 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:01:06.188 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:01:06.189 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:01:06.189 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:01:06.189 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:01:06.189 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:01:06.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:01:06 smithi157 bash[24585]: cluster 2024-09-16T10:01:05.015588+0000 mgr.a (mgr.14373) 11416 : cluster [DBG] pgmap v7917: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:01:06.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:01:06 smithi157 bash[24585]: audit 2024-09-16T10:01:05.759716+0000 mgr.a (mgr.14373) 11417 : audit [DBG] from='client.250215 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:01:06.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:01:06 smithi086 bash[24289]: cluster 2024-09-16T10:01:05.015588+0000 mgr.a (mgr.14373) 11416 : cluster [DBG] pgmap v7917: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:01:06.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:01:06 smithi086 bash[24289]: audit 2024-09-16T10:01:05.759716+0000 mgr.a (mgr.14373) 11417 : audit [DBG] from='client.250215 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:01:06.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:01:06 smithi047 bash[22744]: cluster 2024-09-16T10:01:05.015588+0000 mgr.a (mgr.14373) 11416 : cluster [DBG] pgmap v7917: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:01:06.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:01:06 smithi047 bash[22744]: audit 2024-09-16T10:01:05.759716+0000 mgr.a (mgr.14373) 11417 : audit [DBG] from='client.250215 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:01:08.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:01:08 smithi157 bash[24585]: cluster 2024-09-16T10:01:07.017845+0000 mgr.a (mgr.14373) 11418 : cluster [DBG] pgmap v7918: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:01:08.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:01:08 smithi086 bash[24289]: cluster 2024-09-16T10:01:07.017845+0000 mgr.a (mgr.14373) 11418 : cluster [DBG] pgmap v7918: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:01:08.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:01:08 smithi047 bash[22744]: cluster 2024-09-16T10:01:07.017845+0000 mgr.a (mgr.14373) 11418 : cluster [DBG] pgmap v7918: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:01:10.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:01:10 smithi157 bash[24585]: cluster 2024-09-16T10:01:09.018651+0000 mgr.a (mgr.14373) 11419 : cluster [DBG] pgmap v7919: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:01:10.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:01:10 smithi086 bash[24289]: cluster 2024-09-16T10:01:09.018651+0000 mgr.a (mgr.14373) 11419 : cluster [DBG] pgmap v7919: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:01:10.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:01:10 smithi047 bash[22744]: cluster 2024-09-16T10:01:09.018651+0000 mgr.a (mgr.14373) 11419 : cluster [DBG] pgmap v7919: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:01:11.190 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:01:11.191 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:01:11.191 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:01:11.974 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:01:11.975 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:01:11.975 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:01:11.975 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:01:11.975 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:01:12.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:01:12 smithi157 bash[24585]: cluster 2024-09-16T10:01:11.019422+0000 mgr.a (mgr.14373) 11420 : cluster [DBG] pgmap v7920: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:01:12.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:01:12 smithi157 bash[24585]: audit 2024-09-16T10:01:11.529071+0000 mgr.a (mgr.14373) 11421 : audit [DBG] from='client.250293 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:01:12.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:01:12 smithi086 bash[24289]: cluster 2024-09-16T10:01:11.019422+0000 mgr.a (mgr.14373) 11420 : cluster [DBG] pgmap v7920: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:01:12.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:01:12 smithi086 bash[24289]: audit 2024-09-16T10:01:11.529071+0000 mgr.a (mgr.14373) 11421 : audit [DBG] from='client.250293 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:01:12.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:01:12 smithi047 bash[22744]: cluster 2024-09-16T10:01:11.019422+0000 mgr.a (mgr.14373) 11420 : cluster [DBG] pgmap v7920: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:01:12.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:01:12 smithi047 bash[22744]: audit 2024-09-16T10:01:11.529071+0000 mgr.a (mgr.14373) 11421 : audit [DBG] from='client.250293 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:01:14.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:01:14 smithi157 bash[24585]: cluster 2024-09-16T10:01:13.022379+0000 mgr.a (mgr.14373) 11422 : cluster [DBG] pgmap v7921: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:01:14.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:01:14 smithi086 bash[24289]: cluster 2024-09-16T10:01:13.022379+0000 mgr.a (mgr.14373) 11422 : cluster [DBG] pgmap v7921: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:01:14.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:01:14 smithi047 bash[22744]: cluster 2024-09-16T10:01:13.022379+0000 mgr.a (mgr.14373) 11422 : cluster [DBG] pgmap v7921: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:01:16.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:01:16 smithi157 bash[24585]: cluster 2024-09-16T10:01:15.023280+0000 mgr.a (mgr.14373) 11423 : cluster [DBG] pgmap v7922: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:01:16.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:01:16 smithi086 bash[24289]: cluster 2024-09-16T10:01:15.023280+0000 mgr.a (mgr.14373) 11423 : cluster [DBG] pgmap v7922: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:01:16.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:01:16 smithi047 bash[22744]: cluster 2024-09-16T10:01:15.023280+0000 mgr.a (mgr.14373) 11423 : cluster [DBG] pgmap v7922: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:01:16.976 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:01:16.977 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:01:16.977 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:01:17.755 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:01:17.755 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:01:17.755 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:01:17.755 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:01:17.756 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:01:18.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:01:18 smithi157 bash[24585]: cluster 2024-09-16T10:01:17.024668+0000 mgr.a (mgr.14373) 11424 : cluster [DBG] pgmap v7923: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:01:18.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:01:18 smithi157 bash[24585]: audit 2024-09-16T10:01:17.309490+0000 mgr.a (mgr.14373) 11425 : audit [DBG] from='client.250368 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:01:18.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:01:18 smithi086 bash[24289]: cluster 2024-09-16T10:01:17.024668+0000 mgr.a (mgr.14373) 11424 : cluster [DBG] pgmap v7923: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:01:18.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:01:18 smithi086 bash[24289]: audit 2024-09-16T10:01:17.309490+0000 mgr.a (mgr.14373) 11425 : audit [DBG] from='client.250368 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:01:18.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:01:18 smithi047 bash[22744]: cluster 2024-09-16T10:01:17.024668+0000 mgr.a (mgr.14373) 11424 : cluster [DBG] pgmap v7923: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:01:18.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:01:18 smithi047 bash[22744]: audit 2024-09-16T10:01:17.309490+0000 mgr.a (mgr.14373) 11425 : audit [DBG] from='client.250368 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:01:20.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:01:20 smithi157 bash[24585]: cluster 2024-09-16T10:01:19.025552+0000 mgr.a (mgr.14373) 11426 : cluster [DBG] pgmap v7924: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:01:20.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:01:20 smithi086 bash[24289]: cluster 2024-09-16T10:01:19.025552+0000 mgr.a (mgr.14373) 11426 : cluster [DBG] pgmap v7924: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:01:20.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:01:20 smithi047 bash[22744]: cluster 2024-09-16T10:01:19.025552+0000 mgr.a (mgr.14373) 11426 : cluster [DBG] pgmap v7924: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:01:22.757 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:01:22.757 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:01:22.757 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:01:22.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:01:22 smithi157 bash[24585]: cluster 2024-09-16T10:01:21.026363+0000 mgr.a (mgr.14373) 11427 : cluster [DBG] pgmap v7925: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T10:01:22.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:01:22 smithi086 bash[24289]: cluster 2024-09-16T10:01:21.026363+0000 mgr.a (mgr.14373) 11427 : cluster [DBG] pgmap v7925: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T10:01:22.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:01:22 smithi047 bash[22744]: cluster 2024-09-16T10:01:21.026363+0000 mgr.a (mgr.14373) 11427 : cluster [DBG] pgmap v7925: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T10:01:23.543 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:01:23.544 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:01:23.544 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:01:23.544 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:01:23.544 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:01:24.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:01:24 smithi157 bash[24585]: cluster 2024-09-16T10:01:23.028512+0000 mgr.a (mgr.14373) 11428 : cluster [DBG] pgmap v7926: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:01:24.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:01:24 smithi157 bash[24585]: audit 2024-09-16T10:01:23.094840+0000 mgr.a (mgr.14373) 11429 : audit [DBG] from='client.250443 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:01:24.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:01:24 smithi086 bash[24289]: cluster 2024-09-16T10:01:23.028512+0000 mgr.a (mgr.14373) 11428 : cluster [DBG] pgmap v7926: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:01:24.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:01:24 smithi086 bash[24289]: audit 2024-09-16T10:01:23.094840+0000 mgr.a (mgr.14373) 11429 : audit [DBG] from='client.250443 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:01:24.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:01:24 smithi047 bash[22744]: cluster 2024-09-16T10:01:23.028512+0000 mgr.a (mgr.14373) 11428 : cluster [DBG] pgmap v7926: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:01:24.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:01:24 smithi047 bash[22744]: audit 2024-09-16T10:01:23.094840+0000 mgr.a (mgr.14373) 11429 : audit [DBG] from='client.250443 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:01:26.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:01:26 smithi157 bash[24585]: cluster 2024-09-16T10:01:25.029426+0000 mgr.a (mgr.14373) 11430 : cluster [DBG] pgmap v7927: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:01:26.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:01:26 smithi086 bash[24289]: cluster 2024-09-16T10:01:25.029426+0000 mgr.a (mgr.14373) 11430 : cluster [DBG] pgmap v7927: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:01:26.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:01:26 smithi047 bash[22744]: cluster 2024-09-16T10:01:25.029426+0000 mgr.a (mgr.14373) 11430 : cluster [DBG] pgmap v7927: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:01:28.544 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:01:28.545 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:01:28.545 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:01:28.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:01:28 smithi157 bash[24585]: cluster 2024-09-16T10:01:27.031758+0000 mgr.a (mgr.14373) 11431 : cluster [DBG] pgmap v7928: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:01:28.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:01:28 smithi086 bash[24289]: cluster 2024-09-16T10:01:27.031758+0000 mgr.a (mgr.14373) 11431 : cluster [DBG] pgmap v7928: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:01:28.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:01:28 smithi047 bash[22744]: cluster 2024-09-16T10:01:27.031758+0000 mgr.a (mgr.14373) 11431 : cluster [DBG] pgmap v7928: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:01:29.300 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:01:29.300 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:01:29.300 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:01:29.300 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:01:29.300 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:01:29.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:01:29 smithi157 bash[24585]: audit 2024-09-16T10:01:28.595152+0000 mon.b (mon.2) 1054 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T10:01:29.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:01:29 smithi157 bash[24585]: audit 2024-09-16T10:01:28.875516+0000 mgr.a (mgr.14373) 11432 : audit [DBG] from='client.250521 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:01:29.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:01:29 smithi086 bash[24289]: audit 2024-09-16T10:01:28.595152+0000 mon.b (mon.2) 1054 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T10:01:29.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:01:29 smithi086 bash[24289]: audit 2024-09-16T10:01:28.875516+0000 mgr.a (mgr.14373) 11432 : audit [DBG] from='client.250521 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:01:29.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:01:29 smithi047 bash[22744]: audit 2024-09-16T10:01:28.595152+0000 mon.b (mon.2) 1054 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T10:01:29.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:01:29 smithi047 bash[22744]: audit 2024-09-16T10:01:28.875516+0000 mgr.a (mgr.14373) 11432 : audit [DBG] from='client.250521 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:01:30.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:01:30 smithi157 bash[24585]: cluster 2024-09-16T10:01:29.032302+0000 mgr.a (mgr.14373) 11433 : cluster [DBG] pgmap v7929: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:01:30.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:01:30 smithi086 bash[24289]: cluster 2024-09-16T10:01:29.032302+0000 mgr.a (mgr.14373) 11433 : cluster [DBG] pgmap v7929: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:01:30.844 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:01:30 smithi047 bash[22744]: cluster 2024-09-16T10:01:29.032302+0000 mgr.a (mgr.14373) 11433 : cluster [DBG] pgmap v7929: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:01:32.808 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:01:32 smithi157 bash[24585]: cluster 2024-09-16T10:01:31.033186+0000 mgr.a (mgr.14373) 11434 : cluster [DBG] pgmap v7930: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:01:32.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:01:32 smithi086 bash[24289]: cluster 2024-09-16T10:01:31.033186+0000 mgr.a (mgr.14373) 11434 : cluster [DBG] pgmap v7930: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:01:32.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:01:32 smithi047 bash[22744]: cluster 2024-09-16T10:01:31.033186+0000 mgr.a (mgr.14373) 11434 : cluster [DBG] pgmap v7930: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:01:34.301 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:01:34.302 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:01:34.302 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:01:35.041 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:01:35.041 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:01:35.042 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:01:35.042 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:01:35.042 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:01:35.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:01:34 smithi157 bash[24585]: cluster 2024-09-16T10:01:33.035456+0000 mgr.a (mgr.14373) 11435 : cluster [DBG] pgmap v7931: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:01:35.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:01:34 smithi157 bash[24585]: audit 2024-09-16T10:01:33.934323+0000 mon.a (mon.0) 1246 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:01:35.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:01:34 smithi157 bash[24585]: audit 2024-09-16T10:01:33.941689+0000 mon.a (mon.0) 1247 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:01:35.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:01:34 smithi157 bash[24585]: audit 2024-09-16T10:01:33.948671+0000 mon.a (mon.0) 1248 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:01:35.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:01:34 smithi157 bash[24585]: audit 2024-09-16T10:01:33.955551+0000 mon.a (mon.0) 1249 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:01:35.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:01:34 smithi157 bash[24585]: audit 2024-09-16T10:01:33.976228+0000 mon.a (mon.0) 1250 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:01:35.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:01:34 smithi157 bash[24585]: audit 2024-09-16T10:01:33.981190+0000 mon.a (mon.0) 1251 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:01:35.308 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:01:34 smithi157 bash[24585]: audit 2024-09-16T10:01:34.721377+0000 mon.b (mon.2) 1055 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T10:01:35.308 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:01:34 smithi157 bash[24585]: audit 2024-09-16T10:01:34.722756+0000 mon.b (mon.2) 1056 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T10:01:35.308 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:01:34 smithi157 bash[24585]: audit 2024-09-16T10:01:34.729152+0000 mon.a (mon.0) 1252 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:01:35.308 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:01:34 smithi157 bash[24585]: audit 2024-09-16T10:01:34.734202+0000 mon.b (mon.2) 1057 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:01:35.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:01:34 smithi086 bash[24289]: cluster 2024-09-16T10:01:33.035456+0000 mgr.a (mgr.14373) 11435 : cluster [DBG] pgmap v7931: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:01:35.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:01:34 smithi086 bash[24289]: audit 2024-09-16T10:01:33.934323+0000 mon.a (mon.0) 1246 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:01:35.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:01:34 smithi086 bash[24289]: audit 2024-09-16T10:01:33.941689+0000 mon.a (mon.0) 1247 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:01:35.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:01:34 smithi086 bash[24289]: audit 2024-09-16T10:01:33.948671+0000 mon.a (mon.0) 1248 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:01:35.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:01:34 smithi086 bash[24289]: audit 2024-09-16T10:01:33.955551+0000 mon.a (mon.0) 1249 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:01:35.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:01:34 smithi086 bash[24289]: audit 2024-09-16T10:01:33.976228+0000 mon.a (mon.0) 1250 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:01:35.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:01:34 smithi086 bash[24289]: audit 2024-09-16T10:01:33.981190+0000 mon.a (mon.0) 1251 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:01:35.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:01:34 smithi086 bash[24289]: audit 2024-09-16T10:01:34.721377+0000 mon.b (mon.2) 1055 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T10:01:35.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:01:34 smithi086 bash[24289]: audit 2024-09-16T10:01:34.722756+0000 mon.b (mon.2) 1056 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T10:01:35.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:01:34 smithi086 bash[24289]: audit 2024-09-16T10:01:34.729152+0000 mon.a (mon.0) 1252 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:01:35.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:01:34 smithi086 bash[24289]: audit 2024-09-16T10:01:34.734202+0000 mon.b (mon.2) 1057 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:01:35.347 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:01:34 smithi047 bash[22744]: cluster 2024-09-16T10:01:33.035456+0000 mgr.a (mgr.14373) 11435 : cluster [DBG] pgmap v7931: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:01:35.347 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:01:34 smithi047 bash[22744]: audit 2024-09-16T10:01:33.934323+0000 mon.a (mon.0) 1246 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:01:35.347 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:01:34 smithi047 bash[22744]: audit 2024-09-16T10:01:33.941689+0000 mon.a (mon.0) 1247 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:01:35.347 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:01:34 smithi047 bash[22744]: audit 2024-09-16T10:01:33.948671+0000 mon.a (mon.0) 1248 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:01:35.347 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:01:34 smithi047 bash[22744]: audit 2024-09-16T10:01:33.955551+0000 mon.a (mon.0) 1249 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:01:35.347 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:01:34 smithi047 bash[22744]: audit 2024-09-16T10:01:33.976228+0000 mon.a (mon.0) 1250 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:01:35.347 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:01:34 smithi047 bash[22744]: audit 2024-09-16T10:01:33.981190+0000 mon.a (mon.0) 1251 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:01:35.347 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:01:34 smithi047 bash[22744]: audit 2024-09-16T10:01:34.721377+0000 mon.b (mon.2) 1055 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T10:01:35.347 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:01:34 smithi047 bash[22744]: audit 2024-09-16T10:01:34.722756+0000 mon.b (mon.2) 1056 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T10:01:35.347 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:01:34 smithi047 bash[22744]: audit 2024-09-16T10:01:34.729152+0000 mon.a (mon.0) 1252 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:01:35.348 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:01:34 smithi047 bash[22744]: audit 2024-09-16T10:01:34.734202+0000 mon.b (mon.2) 1057 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:01:36.092 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 10:01:35 smithi047 bash[22994]: debug 2024-09-16T10:01:35.736+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T10:01:36.092 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 10:01:35 smithi047 bash[22994]: debug 2024-09-16T10:01:35.740+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T10:01:36.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:01:35 smithi047 bash[22744]: audit 2024-09-16T10:01:34.623624+0000 mgr.a (mgr.14373) 11436 : audit [DBG] from='client.250599 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:01:36.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:01:35 smithi047 bash[22744]: audit 2024-09-16T10:01:34.735857+0000 mgr.a (mgr.14373) 11437 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:01:36.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:01:35 smithi157 bash[24585]: audit 2024-09-16T10:01:34.623624+0000 mgr.a (mgr.14373) 11436 : audit [DBG] from='client.250599 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:01:36.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:01:35 smithi157 bash[24585]: audit 2024-09-16T10:01:34.735857+0000 mgr.a (mgr.14373) 11437 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:01:36.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:01:35 smithi086 bash[24289]: audit 2024-09-16T10:01:34.623624+0000 mgr.a (mgr.14373) 11436 : audit [DBG] from='client.250599 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:01:36.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:01:35 smithi086 bash[24289]: audit 2024-09-16T10:01:34.735857+0000 mgr.a (mgr.14373) 11437 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:01:37.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:01:36 smithi157 bash[24585]: cluster 2024-09-16T10:01:35.038620+0000 mgr.a (mgr.14373) 11438 : cluster [DBG] pgmap v7932: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:01:37.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:01:36 smithi157 bash[24585]: audit 2024-09-16T10:01:35.741829+0000 mgr.a (mgr.14373) 11439 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T10:01:37.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:01:36 smithi157 bash[24585]: cephadm 2024-09-16T10:01:35.744251+0000 mgr.a (mgr.14373) 11440 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T10:01:37.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:01:36 smithi086 bash[24289]: cluster 2024-09-16T10:01:35.038620+0000 mgr.a (mgr.14373) 11438 : cluster [DBG] pgmap v7932: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:01:37.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:01:36 smithi086 bash[24289]: audit 2024-09-16T10:01:35.741829+0000 mgr.a (mgr.14373) 11439 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T10:01:37.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:01:36 smithi086 bash[24289]: cephadm 2024-09-16T10:01:35.744251+0000 mgr.a (mgr.14373) 11440 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T10:01:37.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:01:36 smithi047 bash[22744]: cluster 2024-09-16T10:01:35.038620+0000 mgr.a (mgr.14373) 11438 : cluster [DBG] pgmap v7932: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:01:37.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:01:36 smithi047 bash[22744]: audit 2024-09-16T10:01:35.741829+0000 mgr.a (mgr.14373) 11439 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T10:01:37.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:01:36 smithi047 bash[22744]: cephadm 2024-09-16T10:01:35.744251+0000 mgr.a (mgr.14373) 11440 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T10:01:39.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:01:38 smithi157 bash[24585]: cluster 2024-09-16T10:01:37.041028+0000 mgr.a (mgr.14373) 11441 : cluster [DBG] pgmap v7933: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:01:39.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:01:38 smithi086 bash[24289]: cluster 2024-09-16T10:01:37.041028+0000 mgr.a (mgr.14373) 11441 : cluster [DBG] pgmap v7933: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:01:39.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:01:38 smithi047 bash[22744]: cluster 2024-09-16T10:01:37.041028+0000 mgr.a (mgr.14373) 11441 : cluster [DBG] pgmap v7933: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:01:40.043 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:01:40.044 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:01:40.044 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:01:40.808 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:01:40.808 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:01:40.809 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:01:40.809 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:01:40.809 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:01:41.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:01:40 smithi157 bash[24585]: cluster 2024-09-16T10:01:39.041993+0000 mgr.a (mgr.14373) 11442 : cluster [DBG] pgmap v7934: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:01:41.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:01:40 smithi086 bash[24289]: cluster 2024-09-16T10:01:39.041993+0000 mgr.a (mgr.14373) 11442 : cluster [DBG] pgmap v7934: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:01:41.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:01:40 smithi047 bash[22744]: cluster 2024-09-16T10:01:39.041993+0000 mgr.a (mgr.14373) 11442 : cluster [DBG] pgmap v7934: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:01:42.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:01:41 smithi157 bash[24585]: audit 2024-09-16T10:01:40.372752+0000 mgr.a (mgr.14373) 11443 : audit [DBG] from='client.250785 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:01:42.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:01:41 smithi086 bash[24289]: audit 2024-09-16T10:01:40.372752+0000 mgr.a (mgr.14373) 11443 : audit [DBG] from='client.250785 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:01:42.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:01:41 smithi047 bash[22744]: audit 2024-09-16T10:01:40.372752+0000 mgr.a (mgr.14373) 11443 : audit [DBG] from='client.250785 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:01:43.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:01:42 smithi157 bash[24585]: cluster 2024-09-16T10:01:41.042970+0000 mgr.a (mgr.14373) 11444 : cluster [DBG] pgmap v7935: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:01:43.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:01:42 smithi086 bash[24289]: cluster 2024-09-16T10:01:41.042970+0000 mgr.a (mgr.14373) 11444 : cluster [DBG] pgmap v7935: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:01:43.345 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:01:42 smithi047 bash[22744]: cluster 2024-09-16T10:01:41.042970+0000 mgr.a (mgr.14373) 11444 : cluster [DBG] pgmap v7935: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:01:44.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:01:43 smithi157 bash[24585]: cluster 2024-09-16T10:01:43.045203+0000 mgr.a (mgr.14373) 11445 : cluster [DBG] pgmap v7936: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:01:44.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:01:43 smithi086 bash[24289]: cluster 2024-09-16T10:01:43.045203+0000 mgr.a (mgr.14373) 11445 : cluster [DBG] pgmap v7936: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:01:44.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:01:43 smithi047 bash[22744]: cluster 2024-09-16T10:01:43.045203+0000 mgr.a (mgr.14373) 11445 : cluster [DBG] pgmap v7936: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:01:45.810 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:01:45.810 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:01:45.811 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:01:46.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:01:46 smithi157 bash[24585]: cluster 2024-09-16T10:01:45.045970+0000 mgr.a (mgr.14373) 11446 : cluster [DBG] pgmap v7937: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:01:46.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:01:46 smithi086 bash[24289]: cluster 2024-09-16T10:01:45.045970+0000 mgr.a (mgr.14373) 11446 : cluster [DBG] pgmap v7937: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:01:46.572 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:01:46.573 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:01:46.573 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:01:46.573 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:01:46.573 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:01:46.591 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:01:46 smithi047 bash[22744]: cluster 2024-09-16T10:01:45.045970+0000 mgr.a (mgr.14373) 11446 : cluster [DBG] pgmap v7937: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:01:47.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:01:47 smithi157 bash[24585]: audit 2024-09-16T10:01:46.140057+0000 mgr.a (mgr.14373) 11447 : audit [DBG] from='client.250863 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:01:47.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:01:47 smithi086 bash[24289]: audit 2024-09-16T10:01:46.140057+0000 mgr.a (mgr.14373) 11447 : audit [DBG] from='client.250863 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:01:47.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:01:47 smithi047 bash[22744]: audit 2024-09-16T10:01:46.140057+0000 mgr.a (mgr.14373) 11447 : audit [DBG] from='client.250863 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:01:48.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:01:48 smithi157 bash[24585]: cluster 2024-09-16T10:01:47.048279+0000 mgr.a (mgr.14373) 11448 : cluster [DBG] pgmap v7938: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:01:48.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:01:48 smithi086 bash[24289]: cluster 2024-09-16T10:01:47.048279+0000 mgr.a (mgr.14373) 11448 : cluster [DBG] pgmap v7938: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:01:48.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:01:48 smithi047 bash[22744]: cluster 2024-09-16T10:01:47.048279+0000 mgr.a (mgr.14373) 11448 : cluster [DBG] pgmap v7938: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:01:50.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:01:50 smithi157 bash[24585]: cluster 2024-09-16T10:01:49.049093+0000 mgr.a (mgr.14373) 11449 : cluster [DBG] pgmap v7939: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T10:01:50.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:01:50 smithi086 bash[24289]: cluster 2024-09-16T10:01:49.049093+0000 mgr.a (mgr.14373) 11449 : cluster [DBG] pgmap v7939: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T10:01:50.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:01:50 smithi047 bash[22744]: cluster 2024-09-16T10:01:49.049093+0000 mgr.a (mgr.14373) 11449 : cluster [DBG] pgmap v7939: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T10:01:51.574 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:01:51.575 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:01:51.575 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:01:52.338 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:01:52.338 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:01:52.338 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:01:52.338 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:01:52.339 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:01:52.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:01:52 smithi157 bash[24585]: cluster 2024-09-16T10:01:51.049877+0000 mgr.a (mgr.14373) 11450 : cluster [DBG] pgmap v7940: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T10:01:52.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:01:52 smithi157 bash[24585]: audit 2024-09-16T10:01:51.900817+0000 mgr.a (mgr.14373) 11451 : audit [DBG] from='client.250941 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:01:52.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:01:52 smithi086 bash[24289]: cluster 2024-09-16T10:01:51.049877+0000 mgr.a (mgr.14373) 11450 : cluster [DBG] pgmap v7940: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T10:01:52.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:01:52 smithi086 bash[24289]: audit 2024-09-16T10:01:51.900817+0000 mgr.a (mgr.14373) 11451 : audit [DBG] from='client.250941 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:01:52.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:01:52 smithi047 bash[22744]: cluster 2024-09-16T10:01:51.049877+0000 mgr.a (mgr.14373) 11450 : cluster [DBG] pgmap v7940: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T10:01:52.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:01:52 smithi047 bash[22744]: audit 2024-09-16T10:01:51.900817+0000 mgr.a (mgr.14373) 11451 : audit [DBG] from='client.250941 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:01:54.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:01:54 smithi157 bash[24585]: cluster 2024-09-16T10:01:53.052616+0000 mgr.a (mgr.14373) 11452 : cluster [DBG] pgmap v7941: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:01:54.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:01:54 smithi086 bash[24289]: cluster 2024-09-16T10:01:53.052616+0000 mgr.a (mgr.14373) 11452 : cluster [DBG] pgmap v7941: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:01:54.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:01:54 smithi047 bash[22744]: cluster 2024-09-16T10:01:53.052616+0000 mgr.a (mgr.14373) 11452 : cluster [DBG] pgmap v7941: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:01:56.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:01:56 smithi157 bash[24585]: cluster 2024-09-16T10:01:55.053412+0000 mgr.a (mgr.14373) 11453 : cluster [DBG] pgmap v7942: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:01:56.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:01:56 smithi086 bash[24289]: cluster 2024-09-16T10:01:55.053412+0000 mgr.a (mgr.14373) 11453 : cluster [DBG] pgmap v7942: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:01:56.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:01:56 smithi047 bash[22744]: cluster 2024-09-16T10:01:55.053412+0000 mgr.a (mgr.14373) 11453 : cluster [DBG] pgmap v7942: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:01:57.340 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:01:57.341 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:01:57.341 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:01:58.083 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:01:58.084 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:01:58.084 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:01:58.084 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:01:58.084 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:01:58.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:01:58 smithi157 bash[24585]: cluster 2024-09-16T10:01:57.055448+0000 mgr.a (mgr.14373) 11454 : cluster [DBG] pgmap v7943: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:01:58.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:01:58 smithi157 bash[24585]: audit 2024-09-16T10:01:57.669600+0000 mgr.a (mgr.14373) 11455 : audit [DBG] from='client.251019 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:01:58.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:01:58 smithi086 bash[24289]: cluster 2024-09-16T10:01:57.055448+0000 mgr.a (mgr.14373) 11454 : cluster [DBG] pgmap v7943: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:01:58.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:01:58 smithi086 bash[24289]: audit 2024-09-16T10:01:57.669600+0000 mgr.a (mgr.14373) 11455 : audit [DBG] from='client.251019 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:01:58.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:01:58 smithi047 bash[22744]: cluster 2024-09-16T10:01:57.055448+0000 mgr.a (mgr.14373) 11454 : cluster [DBG] pgmap v7943: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:01:58.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:01:58 smithi047 bash[22744]: audit 2024-09-16T10:01:57.669600+0000 mgr.a (mgr.14373) 11455 : audit [DBG] from='client.251019 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:02:00.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:02:00 smithi157 bash[24585]: cluster 2024-09-16T10:01:59.056337+0000 mgr.a (mgr.14373) 11456 : cluster [DBG] pgmap v7944: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-16T10:02:00.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:02:00 smithi086 bash[24289]: cluster 2024-09-16T10:01:59.056337+0000 mgr.a (mgr.14373) 11456 : cluster [DBG] pgmap v7944: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-16T10:02:00.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:02:00 smithi047 bash[22744]: cluster 2024-09-16T10:01:59.056337+0000 mgr.a (mgr.14373) 11456 : cluster [DBG] pgmap v7944: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-16T10:02:02.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:02:02 smithi157 bash[24585]: cluster 2024-09-16T10:02:01.057121+0000 mgr.a (mgr.14373) 11457 : cluster [DBG] pgmap v7945: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-16T10:02:02.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:02:02 smithi086 bash[24289]: cluster 2024-09-16T10:02:01.057121+0000 mgr.a (mgr.14373) 11457 : cluster [DBG] pgmap v7945: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-16T10:02:02.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:02:02 smithi047 bash[22744]: cluster 2024-09-16T10:02:01.057121+0000 mgr.a (mgr.14373) 11457 : cluster [DBG] pgmap v7945: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-16T10:02:03.085 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:02:03.086 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:02:03.086 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:02:03.846 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:02:03.846 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:02:03.846 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:02:03.846 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:02:03.846 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:02:04.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:02:04 smithi157 bash[24585]: cluster 2024-09-16T10:02:03.059359+0000 mgr.a (mgr.14373) 11458 : cluster [DBG] pgmap v7946: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-16T10:02:04.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:02:04 smithi157 bash[24585]: audit 2024-09-16T10:02:03.412578+0000 mgr.a (mgr.14373) 11459 : audit [DBG] from='client.251097 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:02:04.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:02:04 smithi086 bash[24289]: cluster 2024-09-16T10:02:03.059359+0000 mgr.a (mgr.14373) 11458 : cluster [DBG] pgmap v7946: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-16T10:02:04.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:02:04 smithi086 bash[24289]: audit 2024-09-16T10:02:03.412578+0000 mgr.a (mgr.14373) 11459 : audit [DBG] from='client.251097 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:02:04.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:02:04 smithi047 bash[22744]: cluster 2024-09-16T10:02:03.059359+0000 mgr.a (mgr.14373) 11458 : cluster [DBG] pgmap v7946: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-16T10:02:04.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:02:04 smithi047 bash[22744]: audit 2024-09-16T10:02:03.412578+0000 mgr.a (mgr.14373) 11459 : audit [DBG] from='client.251097 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:02:06.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:02:06 smithi157 bash[24585]: cluster 2024-09-16T10:02:05.060238+0000 mgr.a (mgr.14373) 11460 : cluster [DBG] pgmap v7947: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:02:06.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:02:06 smithi086 bash[24289]: cluster 2024-09-16T10:02:05.060238+0000 mgr.a (mgr.14373) 11460 : cluster [DBG] pgmap v7947: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:02:06.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:02:06 smithi047 bash[22744]: cluster 2024-09-16T10:02:05.060238+0000 mgr.a (mgr.14373) 11460 : cluster [DBG] pgmap v7947: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:02:08.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:02:08 smithi157 bash[24585]: cluster 2024-09-16T10:02:07.062464+0000 mgr.a (mgr.14373) 11461 : cluster [DBG] pgmap v7948: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:02:08.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:02:08 smithi086 bash[24289]: cluster 2024-09-16T10:02:07.062464+0000 mgr.a (mgr.14373) 11461 : cluster [DBG] pgmap v7948: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:02:08.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:02:08 smithi047 bash[22744]: cluster 2024-09-16T10:02:07.062464+0000 mgr.a (mgr.14373) 11461 : cluster [DBG] pgmap v7948: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:02:08.837 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:02:08.838 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:02:08.838 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:02:09.622 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:02:09.622 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:02:09.623 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:02:09.623 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:02:09.623 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:02:10.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:02:10 smithi157 bash[24585]: cluster 2024-09-16T10:02:09.063076+0000 mgr.a (mgr.14373) 11462 : cluster [DBG] pgmap v7949: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:02:10.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:02:10 smithi157 bash[24585]: audit 2024-09-16T10:02:09.173044+0000 mgr.a (mgr.14373) 11463 : audit [DBG] from='client.251175 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:02:10.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:02:10 smithi086 bash[24289]: cluster 2024-09-16T10:02:09.063076+0000 mgr.a (mgr.14373) 11462 : cluster [DBG] pgmap v7949: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:02:10.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:02:10 smithi086 bash[24289]: audit 2024-09-16T10:02:09.173044+0000 mgr.a (mgr.14373) 11463 : audit [DBG] from='client.251175 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:02:10.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:02:10 smithi047 bash[22744]: cluster 2024-09-16T10:02:09.063076+0000 mgr.a (mgr.14373) 11462 : cluster [DBG] pgmap v7949: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:02:10.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:02:10 smithi047 bash[22744]: audit 2024-09-16T10:02:09.173044+0000 mgr.a (mgr.14373) 11463 : audit [DBG] from='client.251175 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:02:12.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:02:12 smithi157 bash[24585]: cluster 2024-09-16T10:02:11.064032+0000 mgr.a (mgr.14373) 11464 : cluster [DBG] pgmap v7950: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:02:12.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:02:12 smithi086 bash[24289]: cluster 2024-09-16T10:02:11.064032+0000 mgr.a (mgr.14373) 11464 : cluster [DBG] pgmap v7950: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:02:12.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:02:12 smithi047 bash[22744]: cluster 2024-09-16T10:02:11.064032+0000 mgr.a (mgr.14373) 11464 : cluster [DBG] pgmap v7950: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:02:14.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:02:14 smithi157 bash[24585]: cluster 2024-09-16T10:02:13.066268+0000 mgr.a (mgr.14373) 11465 : cluster [DBG] pgmap v7951: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:02:14.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:02:14 smithi086 bash[24289]: cluster 2024-09-16T10:02:13.066268+0000 mgr.a (mgr.14373) 11465 : cluster [DBG] pgmap v7951: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:02:14.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:02:14 smithi047 bash[22744]: cluster 2024-09-16T10:02:13.066268+0000 mgr.a (mgr.14373) 11465 : cluster [DBG] pgmap v7951: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:02:14.624 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:02:14.624 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:02:14.625 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:02:15.394 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:02:15.394 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:02:15.394 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:02:15.394 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:02:15.394 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:02:15.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:02:15 smithi157 bash[24585]: audit 2024-09-16T10:02:14.962109+0000 mgr.a (mgr.14373) 11466 : audit [DBG] from='client.251253 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:02:15.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:02:15 smithi086 bash[24289]: audit 2024-09-16T10:02:14.962109+0000 mgr.a (mgr.14373) 11466 : audit [DBG] from='client.251253 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:02:15.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:02:15 smithi047 bash[22744]: audit 2024-09-16T10:02:14.962109+0000 mgr.a (mgr.14373) 11466 : audit [DBG] from='client.251253 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:02:16.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:02:16 smithi157 bash[24585]: cluster 2024-09-16T10:02:15.066800+0000 mgr.a (mgr.14373) 11467 : cluster [DBG] pgmap v7952: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:02:16.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:02:16 smithi086 bash[24289]: cluster 2024-09-16T10:02:15.066800+0000 mgr.a (mgr.14373) 11467 : cluster [DBG] pgmap v7952: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:02:16.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:02:16 smithi047 bash[22744]: cluster 2024-09-16T10:02:15.066800+0000 mgr.a (mgr.14373) 11467 : cluster [DBG] pgmap v7952: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:02:18.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:02:18 smithi157 bash[24585]: cluster 2024-09-16T10:02:17.069008+0000 mgr.a (mgr.14373) 11468 : cluster [DBG] pgmap v7953: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:02:18.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:02:18 smithi086 bash[24289]: cluster 2024-09-16T10:02:17.069008+0000 mgr.a (mgr.14373) 11468 : cluster [DBG] pgmap v7953: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:02:18.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:02:18 smithi047 bash[22744]: cluster 2024-09-16T10:02:17.069008+0000 mgr.a (mgr.14373) 11468 : cluster [DBG] pgmap v7953: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:02:20.395 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:02:20.396 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:02:20.396 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:02:20.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:02:20 smithi157 bash[24585]: cluster 2024-09-16T10:02:19.069746+0000 mgr.a (mgr.14373) 11469 : cluster [DBG] pgmap v7954: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:02:20.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:02:20 smithi086 bash[24289]: cluster 2024-09-16T10:02:19.069746+0000 mgr.a (mgr.14373) 11469 : cluster [DBG] pgmap v7954: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:02:20.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:02:20 smithi047 bash[22744]: cluster 2024-09-16T10:02:19.069746+0000 mgr.a (mgr.14373) 11469 : cluster [DBG] pgmap v7954: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:02:21.137 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:02:21.137 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:02:21.137 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:02:21.137 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:02:21.137 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:02:21.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:02:21 smithi157 bash[24585]: audit 2024-09-16T10:02:20.727027+0000 mgr.a (mgr.14373) 11470 : audit [DBG] from='client.251331 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:02:21.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:02:21 smithi086 bash[24289]: audit 2024-09-16T10:02:20.727027+0000 mgr.a (mgr.14373) 11470 : audit [DBG] from='client.251331 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:02:21.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:02:21 smithi047 bash[22744]: audit 2024-09-16T10:02:20.727027+0000 mgr.a (mgr.14373) 11470 : audit [DBG] from='client.251331 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:02:22.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:02:22 smithi157 bash[24585]: cluster 2024-09-16T10:02:21.070318+0000 mgr.a (mgr.14373) 11471 : cluster [DBG] pgmap v7955: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:02:22.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:02:22 smithi086 bash[24289]: cluster 2024-09-16T10:02:21.070318+0000 mgr.a (mgr.14373) 11471 : cluster [DBG] pgmap v7955: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:02:22.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:02:22 smithi047 bash[22744]: cluster 2024-09-16T10:02:21.070318+0000 mgr.a (mgr.14373) 11471 : cluster [DBG] pgmap v7955: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:02:24.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:02:24 smithi157 bash[24585]: cluster 2024-09-16T10:02:23.072619+0000 mgr.a (mgr.14373) 11472 : cluster [DBG] pgmap v7956: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:02:24.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:02:24 smithi086 bash[24289]: cluster 2024-09-16T10:02:23.072619+0000 mgr.a (mgr.14373) 11472 : cluster [DBG] pgmap v7956: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:02:24.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:02:24 smithi047 bash[22744]: cluster 2024-09-16T10:02:23.072619+0000 mgr.a (mgr.14373) 11472 : cluster [DBG] pgmap v7956: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:02:26.138 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:02:26.139 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:02:26.139 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:02:26.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:02:26 smithi157 bash[24585]: cluster 2024-09-16T10:02:25.073571+0000 mgr.a (mgr.14373) 11473 : cluster [DBG] pgmap v7957: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:02:26.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:02:26 smithi086 bash[24289]: cluster 2024-09-16T10:02:25.073571+0000 mgr.a (mgr.14373) 11473 : cluster [DBG] pgmap v7957: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:02:26.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:02:26 smithi047 bash[22744]: cluster 2024-09-16T10:02:25.073571+0000 mgr.a (mgr.14373) 11473 : cluster [DBG] pgmap v7957: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:02:26.919 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:02:26.920 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:02:26.920 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:02:26.920 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:02:26.920 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:02:27.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:02:27 smithi157 bash[24585]: audit 2024-09-16T10:02:26.476541+0000 mgr.a (mgr.14373) 11474 : audit [DBG] from='client.251406 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:02:27.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:02:27 smithi086 bash[24289]: audit 2024-09-16T10:02:26.476541+0000 mgr.a (mgr.14373) 11474 : audit [DBG] from='client.251406 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:02:27.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:02:27 smithi047 bash[22744]: audit 2024-09-16T10:02:26.476541+0000 mgr.a (mgr.14373) 11474 : audit [DBG] from='client.251406 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:02:28.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:02:28 smithi157 bash[24585]: cluster 2024-09-16T10:02:27.076253+0000 mgr.a (mgr.14373) 11475 : cluster [DBG] pgmap v7958: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:02:28.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:02:28 smithi086 bash[24289]: cluster 2024-09-16T10:02:27.076253+0000 mgr.a (mgr.14373) 11475 : cluster [DBG] pgmap v7958: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:02:28.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:02:28 smithi047 bash[22744]: cluster 2024-09-16T10:02:27.076253+0000 mgr.a (mgr.14373) 11475 : cluster [DBG] pgmap v7958: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:02:30.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:02:30 smithi157 bash[24585]: cluster 2024-09-16T10:02:29.077016+0000 mgr.a (mgr.14373) 11476 : cluster [DBG] pgmap v7959: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:02:30.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:02:30 smithi086 bash[24289]: cluster 2024-09-16T10:02:29.077016+0000 mgr.a (mgr.14373) 11476 : cluster [DBG] pgmap v7959: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:02:30.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:02:30 smithi047 bash[22744]: cluster 2024-09-16T10:02:29.077016+0000 mgr.a (mgr.14373) 11476 : cluster [DBG] pgmap v7959: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:02:31.921 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:02:31.921 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:02:31.922 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:02:32.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:02:32 smithi157 bash[24585]: cluster 2024-09-16T10:02:31.077773+0000 mgr.a (mgr.14373) 11477 : cluster [DBG] pgmap v7960: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T10:02:32.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:02:32 smithi086 bash[24289]: cluster 2024-09-16T10:02:31.077773+0000 mgr.a (mgr.14373) 11477 : cluster [DBG] pgmap v7960: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T10:02:32.591 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:02:32 smithi047 bash[22744]: cluster 2024-09-16T10:02:31.077773+0000 mgr.a (mgr.14373) 11477 : cluster [DBG] pgmap v7960: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T10:02:32.672 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:02:32.672 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:02:32.672 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:02:32.672 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:02:32.672 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:02:33.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:02:33 smithi157 bash[24585]: audit 2024-09-16T10:02:32.250843+0000 mgr.a (mgr.14373) 11478 : audit [DBG] from='client.251484 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:02:33.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:02:33 smithi086 bash[24289]: audit 2024-09-16T10:02:32.250843+0000 mgr.a (mgr.14373) 11478 : audit [DBG] from='client.251484 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:02:33.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:02:33 smithi047 bash[22744]: audit 2024-09-16T10:02:32.250843+0000 mgr.a (mgr.14373) 11478 : audit [DBG] from='client.251484 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:02:34.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:02:34 smithi157 bash[24585]: cluster 2024-09-16T10:02:33.080440+0000 mgr.a (mgr.14373) 11479 : cluster [DBG] pgmap v7961: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:02:34.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:02:34 smithi086 bash[24289]: cluster 2024-09-16T10:02:33.080440+0000 mgr.a (mgr.14373) 11479 : cluster [DBG] pgmap v7961: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:02:34.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:02:34 smithi047 bash[22744]: cluster 2024-09-16T10:02:33.080440+0000 mgr.a (mgr.14373) 11479 : cluster [DBG] pgmap v7961: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:02:36.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:02:36 smithi157 bash[24585]: cluster 2024-09-16T10:02:35.081216+0000 mgr.a (mgr.14373) 11480 : cluster [DBG] pgmap v7962: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:02:36.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:02:36 smithi157 bash[24585]: audit 2024-09-16T10:02:35.797571+0000 mon.b (mon.2) 1058 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T10:02:36.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:02:36 smithi086 bash[24289]: cluster 2024-09-16T10:02:35.081216+0000 mgr.a (mgr.14373) 11480 : cluster [DBG] pgmap v7962: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:02:36.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:02:36 smithi086 bash[24289]: audit 2024-09-16T10:02:35.797571+0000 mon.b (mon.2) 1058 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T10:02:36.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:02:36 smithi047 bash[22744]: cluster 2024-09-16T10:02:35.081216+0000 mgr.a (mgr.14373) 11480 : cluster [DBG] pgmap v7962: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:02:36.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:02:36 smithi047 bash[22744]: audit 2024-09-16T10:02:35.797571+0000 mon.b (mon.2) 1058 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T10:02:37.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:02:37 smithi157 bash[24585]: audit 2024-09-16T10:02:36.620102+0000 mon.b (mon.2) 1059 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T10:02:37.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:02:37 smithi157 bash[24585]: audit 2024-09-16T10:02:36.622029+0000 mon.b (mon.2) 1060 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T10:02:37.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:02:37 smithi157 bash[24585]: audit 2024-09-16T10:02:36.633469+0000 mon.a (mon.0) 1253 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:02:37.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:02:37 smithi157 bash[24585]: audit 2024-09-16T10:02:36.639933+0000 mon.b (mon.2) 1061 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:02:37.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:02:37 smithi157 bash[24585]: audit 2024-09-16T10:02:36.642806+0000 mgr.a (mgr.14373) 11481 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:02:37.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:02:37 smithi086 bash[24289]: audit 2024-09-16T10:02:36.620102+0000 mon.b (mon.2) 1059 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T10:02:37.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:02:37 smithi086 bash[24289]: audit 2024-09-16T10:02:36.622029+0000 mon.b (mon.2) 1060 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T10:02:37.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:02:37 smithi086 bash[24289]: audit 2024-09-16T10:02:36.633469+0000 mon.a (mon.0) 1253 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:02:37.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:02:37 smithi086 bash[24289]: audit 2024-09-16T10:02:36.639933+0000 mon.b (mon.2) 1061 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:02:37.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:02:37 smithi086 bash[24289]: audit 2024-09-16T10:02:36.642806+0000 mgr.a (mgr.14373) 11481 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:02:37.592 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 10:02:37 smithi047 bash[22994]: debug 2024-09-16T10:02:37.363+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T10:02:37.592 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 10:02:37 smithi047 bash[22994]: debug 2024-09-16T10:02:37.363+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T10:02:37.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:02:37 smithi047 bash[22744]: audit 2024-09-16T10:02:36.620102+0000 mon.b (mon.2) 1059 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T10:02:37.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:02:37 smithi047 bash[22744]: audit 2024-09-16T10:02:36.622029+0000 mon.b (mon.2) 1060 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T10:02:37.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:02:37 smithi047 bash[22744]: audit 2024-09-16T10:02:36.633469+0000 mon.a (mon.0) 1253 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:02:37.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:02:37 smithi047 bash[22744]: audit 2024-09-16T10:02:36.639933+0000 mon.b (mon.2) 1061 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:02:37.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:02:37 smithi047 bash[22744]: audit 2024-09-16T10:02:36.642806+0000 mgr.a (mgr.14373) 11481 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:02:37.673 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:02:37.674 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:02:37.674 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:02:38.420 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:02:38.420 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:02:38.420 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:02:38.420 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:02:38.420 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:02:39.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:02:38 smithi157 bash[24585]: cluster 2024-09-16T10:02:37.082602+0000 mgr.a (mgr.14373) 11482 : cluster [DBG] pgmap v7963: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:02:39.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:02:38 smithi157 bash[24585]: audit 2024-09-16T10:02:37.367446+0000 mgr.a (mgr.14373) 11483 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T10:02:39.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:02:38 smithi157 bash[24585]: cephadm 2024-09-16T10:02:37.369467+0000 mgr.a (mgr.14373) 11484 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T10:02:39.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:02:38 smithi086 bash[24289]: cluster 2024-09-16T10:02:37.082602+0000 mgr.a (mgr.14373) 11482 : cluster [DBG] pgmap v7963: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:02:39.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:02:38 smithi086 bash[24289]: audit 2024-09-16T10:02:37.367446+0000 mgr.a (mgr.14373) 11483 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T10:02:39.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:02:38 smithi086 bash[24289]: cephadm 2024-09-16T10:02:37.369467+0000 mgr.a (mgr.14373) 11484 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T10:02:39.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:02:38 smithi047 bash[22744]: cluster 2024-09-16T10:02:37.082602+0000 mgr.a (mgr.14373) 11482 : cluster [DBG] pgmap v7963: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:02:39.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:02:38 smithi047 bash[22744]: audit 2024-09-16T10:02:37.367446+0000 mgr.a (mgr.14373) 11483 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T10:02:39.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:02:38 smithi047 bash[22744]: cephadm 2024-09-16T10:02:37.369467+0000 mgr.a (mgr.14373) 11484 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T10:02:40.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:02:39 smithi157 bash[24585]: audit 2024-09-16T10:02:37.994642+0000 mgr.a (mgr.14373) 11485 : audit [DBG] from='client.251670 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:02:40.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:02:39 smithi086 bash[24289]: audit 2024-09-16T10:02:37.994642+0000 mgr.a (mgr.14373) 11485 : audit [DBG] from='client.251670 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:02:40.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:02:39 smithi047 bash[22744]: audit 2024-09-16T10:02:37.994642+0000 mgr.a (mgr.14373) 11485 : audit [DBG] from='client.251670 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:02:41.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:02:40 smithi157 bash[24585]: cluster 2024-09-16T10:02:39.083464+0000 mgr.a (mgr.14373) 11486 : cluster [DBG] pgmap v7964: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:02:41.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:02:40 smithi086 bash[24289]: cluster 2024-09-16T10:02:39.083464+0000 mgr.a (mgr.14373) 11486 : cluster [DBG] pgmap v7964: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:02:41.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:02:40 smithi047 bash[22744]: cluster 2024-09-16T10:02:39.083464+0000 mgr.a (mgr.14373) 11486 : cluster [DBG] pgmap v7964: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:02:43.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:02:42 smithi157 bash[24585]: cluster 2024-09-16T10:02:41.084263+0000 mgr.a (mgr.14373) 11487 : cluster [DBG] pgmap v7965: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:02:43.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:02:42 smithi086 bash[24289]: cluster 2024-09-16T10:02:41.084263+0000 mgr.a (mgr.14373) 11487 : cluster [DBG] pgmap v7965: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:02:43.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:02:42 smithi047 bash[22744]: cluster 2024-09-16T10:02:41.084263+0000 mgr.a (mgr.14373) 11487 : cluster [DBG] pgmap v7965: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:02:43.421 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:02:43.422 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:02:43.422 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:02:44.172 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:02:44.173 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:02:44.173 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:02:44.173 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:02:44.173 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:02:45.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:02:44 smithi157 bash[24585]: cluster 2024-09-16T10:02:43.086505+0000 mgr.a (mgr.14373) 11488 : cluster [DBG] pgmap v7966: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:02:45.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:02:44 smithi157 bash[24585]: audit 2024-09-16T10:02:43.746554+0000 mgr.a (mgr.14373) 11489 : audit [DBG] from='client.251748 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:02:45.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:02:44 smithi086 bash[24289]: cluster 2024-09-16T10:02:43.086505+0000 mgr.a (mgr.14373) 11488 : cluster [DBG] pgmap v7966: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:02:45.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:02:44 smithi086 bash[24289]: audit 2024-09-16T10:02:43.746554+0000 mgr.a (mgr.14373) 11489 : audit [DBG] from='client.251748 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:02:45.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:02:44 smithi047 bash[22744]: cluster 2024-09-16T10:02:43.086505+0000 mgr.a (mgr.14373) 11488 : cluster [DBG] pgmap v7966: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:02:45.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:02:44 smithi047 bash[22744]: audit 2024-09-16T10:02:43.746554+0000 mgr.a (mgr.14373) 11489 : audit [DBG] from='client.251748 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:02:47.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:02:46 smithi157 bash[24585]: cluster 2024-09-16T10:02:45.087501+0000 mgr.a (mgr.14373) 11490 : cluster [DBG] pgmap v7967: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:02:47.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:02:46 smithi086 bash[24289]: cluster 2024-09-16T10:02:45.087501+0000 mgr.a (mgr.14373) 11490 : cluster [DBG] pgmap v7967: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:02:47.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:02:46 smithi047 bash[22744]: cluster 2024-09-16T10:02:45.087501+0000 mgr.a (mgr.14373) 11490 : cluster [DBG] pgmap v7967: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:02:49.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:02:48 smithi157 bash[24585]: cluster 2024-09-16T10:02:47.089880+0000 mgr.a (mgr.14373) 11491 : cluster [DBG] pgmap v7968: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:02:49.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:02:48 smithi086 bash[24289]: cluster 2024-09-16T10:02:47.089880+0000 mgr.a (mgr.14373) 11491 : cluster [DBG] pgmap v7968: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:02:49.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:02:48 smithi047 bash[22744]: cluster 2024-09-16T10:02:47.089880+0000 mgr.a (mgr.14373) 11491 : cluster [DBG] pgmap v7968: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:02:49.174 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:02:49.175 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:02:49.175 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:02:49.923 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:02:49.923 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:02:49.923 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:02:49.923 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:02:49.923 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:02:51.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:02:50 smithi157 bash[24585]: cluster 2024-09-16T10:02:49.090816+0000 mgr.a (mgr.14373) 11492 : cluster [DBG] pgmap v7969: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:02:51.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:02:50 smithi157 bash[24585]: audit 2024-09-16T10:02:49.501272+0000 mgr.a (mgr.14373) 11493 : audit [DBG] from='client.251823 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:02:51.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:02:50 smithi086 bash[24289]: cluster 2024-09-16T10:02:49.090816+0000 mgr.a (mgr.14373) 11492 : cluster [DBG] pgmap v7969: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:02:51.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:02:50 smithi086 bash[24289]: audit 2024-09-16T10:02:49.501272+0000 mgr.a (mgr.14373) 11493 : audit [DBG] from='client.251823 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:02:51.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:02:50 smithi047 bash[22744]: cluster 2024-09-16T10:02:49.090816+0000 mgr.a (mgr.14373) 11492 : cluster [DBG] pgmap v7969: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:02:51.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:02:50 smithi047 bash[22744]: audit 2024-09-16T10:02:49.501272+0000 mgr.a (mgr.14373) 11493 : audit [DBG] from='client.251823 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:02:53.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:02:52 smithi157 bash[24585]: cluster 2024-09-16T10:02:51.091885+0000 mgr.a (mgr.14373) 11494 : cluster [DBG] pgmap v7970: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:02:53.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:02:52 smithi086 bash[24289]: cluster 2024-09-16T10:02:51.091885+0000 mgr.a (mgr.14373) 11494 : cluster [DBG] pgmap v7970: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:02:53.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:02:52 smithi047 bash[22744]: cluster 2024-09-16T10:02:51.091885+0000 mgr.a (mgr.14373) 11494 : cluster [DBG] pgmap v7970: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:02:54.925 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:02:54.925 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:02:54.926 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:02:55.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:02:54 smithi157 bash[24585]: cluster 2024-09-16T10:02:53.094256+0000 mgr.a (mgr.14373) 11495 : cluster [DBG] pgmap v7971: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:02:55.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:02:54 smithi086 bash[24289]: cluster 2024-09-16T10:02:53.094256+0000 mgr.a (mgr.14373) 11495 : cluster [DBG] pgmap v7971: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:02:55.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:02:54 smithi047 bash[22744]: cluster 2024-09-16T10:02:53.094256+0000 mgr.a (mgr.14373) 11495 : cluster [DBG] pgmap v7971: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:02:55.673 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:02:55.673 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:02:55.673 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:02:55.674 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:02:55.674 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:02:56.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:02:56 smithi086 bash[24289]: cluster 2024-09-16T10:02:55.095140+0000 mgr.a (mgr.14373) 11496 : cluster [DBG] pgmap v7972: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:02:56.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:02:56 smithi086 bash[24289]: audit 2024-09-16T10:02:55.253475+0000 mgr.a (mgr.14373) 11497 : audit [DBG] from='client.251898 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:02:56.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:02:56 smithi047 bash[22744]: cluster 2024-09-16T10:02:55.095140+0000 mgr.a (mgr.14373) 11496 : cluster [DBG] pgmap v7972: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:02:56.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:02:56 smithi047 bash[22744]: audit 2024-09-16T10:02:55.253475+0000 mgr.a (mgr.14373) 11497 : audit [DBG] from='client.251898 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:02:56.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:02:56 smithi157 bash[24585]: cluster 2024-09-16T10:02:55.095140+0000 mgr.a (mgr.14373) 11496 : cluster [DBG] pgmap v7972: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:02:56.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:02:56 smithi157 bash[24585]: audit 2024-09-16T10:02:55.253475+0000 mgr.a (mgr.14373) 11497 : audit [DBG] from='client.251898 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:02:58.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:02:58 smithi157 bash[24585]: cluster 2024-09-16T10:02:57.097578+0000 mgr.a (mgr.14373) 11498 : cluster [DBG] pgmap v7973: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:02:58.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:02:58 smithi086 bash[24289]: cluster 2024-09-16T10:02:57.097578+0000 mgr.a (mgr.14373) 11498 : cluster [DBG] pgmap v7973: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:02:58.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:02:58 smithi047 bash[22744]: cluster 2024-09-16T10:02:57.097578+0000 mgr.a (mgr.14373) 11498 : cluster [DBG] pgmap v7973: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:03:00.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:03:00 smithi157 bash[24585]: cluster 2024-09-16T10:02:59.098385+0000 mgr.a (mgr.14373) 11499 : cluster [DBG] pgmap v7974: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:03:00.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:03:00 smithi086 bash[24289]: cluster 2024-09-16T10:02:59.098385+0000 mgr.a (mgr.14373) 11499 : cluster [DBG] pgmap v7974: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:03:00.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:03:00 smithi047 bash[22744]: cluster 2024-09-16T10:02:59.098385+0000 mgr.a (mgr.14373) 11499 : cluster [DBG] pgmap v7974: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:03:00.675 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:03:00.676 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:03:00.676 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:03:01.458 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:03:01.458 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:03:01.459 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:03:01.459 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:03:01.459 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:03:02.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:03:02 smithi157 bash[24585]: audit 2024-09-16T10:03:01.014866+0000 mgr.a (mgr.14373) 11500 : audit [DBG] from='client.251976 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:03:02.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:03:02 smithi157 bash[24585]: cluster 2024-09-16T10:03:01.099015+0000 mgr.a (mgr.14373) 11501 : cluster [DBG] pgmap v7975: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:03:02.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:03:02 smithi086 bash[24289]: audit 2024-09-16T10:03:01.014866+0000 mgr.a (mgr.14373) 11500 : audit [DBG] from='client.251976 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:03:02.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:03:02 smithi086 bash[24289]: cluster 2024-09-16T10:03:01.099015+0000 mgr.a (mgr.14373) 11501 : cluster [DBG] pgmap v7975: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:03:02.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:03:02 smithi047 bash[22744]: audit 2024-09-16T10:03:01.014866+0000 mgr.a (mgr.14373) 11500 : audit [DBG] from='client.251976 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:03:02.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:03:02 smithi047 bash[22744]: cluster 2024-09-16T10:03:01.099015+0000 mgr.a (mgr.14373) 11501 : cluster [DBG] pgmap v7975: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:03:04.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:03:04 smithi157 bash[24585]: cluster 2024-09-16T10:03:03.101408+0000 mgr.a (mgr.14373) 11502 : cluster [DBG] pgmap v7976: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:03:04.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:03:04 smithi086 bash[24289]: cluster 2024-09-16T10:03:03.101408+0000 mgr.a (mgr.14373) 11502 : cluster [DBG] pgmap v7976: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:03:04.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:03:04 smithi047 bash[22744]: cluster 2024-09-16T10:03:03.101408+0000 mgr.a (mgr.14373) 11502 : cluster [DBG] pgmap v7976: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:03:06.460 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:03:06.460 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:03:06.461 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:03:06.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:03:06 smithi157 bash[24585]: cluster 2024-09-16T10:03:05.102182+0000 mgr.a (mgr.14373) 11503 : cluster [DBG] pgmap v7977: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:03:06.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:03:06 smithi086 bash[24289]: cluster 2024-09-16T10:03:05.102182+0000 mgr.a (mgr.14373) 11503 : cluster [DBG] pgmap v7977: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:03:06.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:03:06 smithi047 bash[22744]: cluster 2024-09-16T10:03:05.102182+0000 mgr.a (mgr.14373) 11503 : cluster [DBG] pgmap v7977: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:03:07.215 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:03:07.215 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:03:07.216 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:03:07.216 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:03:07.216 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:03:07.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:03:07 smithi157 bash[24585]: audit 2024-09-16T10:03:06.792710+0000 mgr.a (mgr.14373) 11504 : audit [DBG] from='client.252054 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:03:07.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:03:07 smithi086 bash[24289]: audit 2024-09-16T10:03:06.792710+0000 mgr.a (mgr.14373) 11504 : audit [DBG] from='client.252054 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:03:07.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:03:07 smithi047 bash[22744]: audit 2024-09-16T10:03:06.792710+0000 mgr.a (mgr.14373) 11504 : audit [DBG] from='client.252054 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:03:08.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:03:08 smithi157 bash[24585]: cluster 2024-09-16T10:03:07.103359+0000 mgr.a (mgr.14373) 11505 : cluster [DBG] pgmap v7978: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:03:08.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:03:08 smithi086 bash[24289]: cluster 2024-09-16T10:03:07.103359+0000 mgr.a (mgr.14373) 11505 : cluster [DBG] pgmap v7978: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:03:08.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:03:08 smithi047 bash[22744]: cluster 2024-09-16T10:03:07.103359+0000 mgr.a (mgr.14373) 11505 : cluster [DBG] pgmap v7978: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:03:10.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:03:10 smithi157 bash[24585]: cluster 2024-09-16T10:03:09.104196+0000 mgr.a (mgr.14373) 11506 : cluster [DBG] pgmap v7979: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T10:03:10.573 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:03:10 smithi086 bash[24289]: cluster 2024-09-16T10:03:09.104196+0000 mgr.a (mgr.14373) 11506 : cluster [DBG] pgmap v7979: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T10:03:10.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:03:10 smithi047 bash[22744]: cluster 2024-09-16T10:03:09.104196+0000 mgr.a (mgr.14373) 11506 : cluster [DBG] pgmap v7979: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T10:03:12.216 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:03:12.217 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:03:12.217 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:03:12.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:03:12 smithi157 bash[24585]: cluster 2024-09-16T10:03:11.104957+0000 mgr.a (mgr.14373) 11507 : cluster [DBG] pgmap v7980: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T10:03:12.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:03:12 smithi086 bash[24289]: cluster 2024-09-16T10:03:11.104957+0000 mgr.a (mgr.14373) 11507 : cluster [DBG] pgmap v7980: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T10:03:12.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:03:12 smithi047 bash[22744]: cluster 2024-09-16T10:03:11.104957+0000 mgr.a (mgr.14373) 11507 : cluster [DBG] pgmap v7980: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T10:03:13.003 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:03:13.004 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:03:13.004 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:03:13.004 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:03:13.004 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:03:13.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:03:13 smithi157 bash[24585]: audit 2024-09-16T10:03:12.555622+0000 mgr.a (mgr.14373) 11508 : audit [DBG] from='client.252129 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:03:13.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:03:13 smithi086 bash[24289]: audit 2024-09-16T10:03:12.555622+0000 mgr.a (mgr.14373) 11508 : audit [DBG] from='client.252129 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:03:13.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:03:13 smithi047 bash[22744]: audit 2024-09-16T10:03:12.555622+0000 mgr.a (mgr.14373) 11508 : audit [DBG] from='client.252129 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:03:14.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:03:14 smithi157 bash[24585]: cluster 2024-09-16T10:03:13.107798+0000 mgr.a (mgr.14373) 11509 : cluster [DBG] pgmap v7981: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:03:14.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:03:14 smithi086 bash[24289]: cluster 2024-09-16T10:03:13.107798+0000 mgr.a (mgr.14373) 11509 : cluster [DBG] pgmap v7981: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:03:14.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:03:14 smithi047 bash[22744]: cluster 2024-09-16T10:03:13.107798+0000 mgr.a (mgr.14373) 11509 : cluster [DBG] pgmap v7981: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:03:16.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:03:16 smithi157 bash[24585]: cluster 2024-09-16T10:03:15.108592+0000 mgr.a (mgr.14373) 11510 : cluster [DBG] pgmap v7982: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:03:16.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:03:16 smithi086 bash[24289]: cluster 2024-09-16T10:03:15.108592+0000 mgr.a (mgr.14373) 11510 : cluster [DBG] pgmap v7982: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:03:16.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:03:16 smithi047 bash[22744]: cluster 2024-09-16T10:03:15.108592+0000 mgr.a (mgr.14373) 11510 : cluster [DBG] pgmap v7982: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:03:18.005 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:03:18.005 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:03:18.006 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:03:18.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:03:18 smithi157 bash[24585]: cluster 2024-09-16T10:03:17.110579+0000 mgr.a (mgr.14373) 11511 : cluster [DBG] pgmap v7983: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:03:18.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:03:18 smithi086 bash[24289]: cluster 2024-09-16T10:03:17.110579+0000 mgr.a (mgr.14373) 11511 : cluster [DBG] pgmap v7983: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:03:18.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:03:18 smithi047 bash[22744]: cluster 2024-09-16T10:03:17.110579+0000 mgr.a (mgr.14373) 11511 : cluster [DBG] pgmap v7983: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:03:18.782 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:03:18.782 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:03:18.782 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:03:18.782 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:03:18.783 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:03:19.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:03:19 smithi157 bash[24585]: audit 2024-09-16T10:03:18.342772+0000 mgr.a (mgr.14373) 11512 : audit [DBG] from='client.252204 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:03:19.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:03:19 smithi086 bash[24289]: audit 2024-09-16T10:03:18.342772+0000 mgr.a (mgr.14373) 11512 : audit [DBG] from='client.252204 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:03:19.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:03:19 smithi047 bash[22744]: audit 2024-09-16T10:03:18.342772+0000 mgr.a (mgr.14373) 11512 : audit [DBG] from='client.252204 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:03:20.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:03:20 smithi157 bash[24585]: cluster 2024-09-16T10:03:19.111467+0000 mgr.a (mgr.14373) 11513 : cluster [DBG] pgmap v7984: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:03:20.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:03:20 smithi086 bash[24289]: cluster 2024-09-16T10:03:19.111467+0000 mgr.a (mgr.14373) 11513 : cluster [DBG] pgmap v7984: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:03:20.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:03:20 smithi047 bash[22744]: cluster 2024-09-16T10:03:19.111467+0000 mgr.a (mgr.14373) 11513 : cluster [DBG] pgmap v7984: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:03:22.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:03:22 smithi157 bash[24585]: cluster 2024-09-16T10:03:21.112264+0000 mgr.a (mgr.14373) 11514 : cluster [DBG] pgmap v7985: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:03:22.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:03:22 smithi086 bash[24289]: cluster 2024-09-16T10:03:21.112264+0000 mgr.a (mgr.14373) 11514 : cluster [DBG] pgmap v7985: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:03:22.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:03:22 smithi047 bash[22744]: cluster 2024-09-16T10:03:21.112264+0000 mgr.a (mgr.14373) 11514 : cluster [DBG] pgmap v7985: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:03:23.784 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:03:23.785 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:03:23.785 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:03:24.537 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:03:24.537 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:03:24.537 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:03:24.537 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:03:24.537 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:03:24.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:03:24 smithi157 bash[24585]: cluster 2024-09-16T10:03:23.114481+0000 mgr.a (mgr.14373) 11515 : cluster [DBG] pgmap v7986: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:03:24.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:03:24 smithi086 bash[24289]: cluster 2024-09-16T10:03:23.114481+0000 mgr.a (mgr.14373) 11515 : cluster [DBG] pgmap v7986: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:03:24.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:03:24 smithi047 bash[22744]: cluster 2024-09-16T10:03:23.114481+0000 mgr.a (mgr.14373) 11515 : cluster [DBG] pgmap v7986: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:03:25.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:03:25 smithi157 bash[24585]: audit 2024-09-16T10:03:24.116547+0000 mgr.a (mgr.14373) 11516 : audit [DBG] from='client.252282 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:03:25.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:03:25 smithi086 bash[24289]: audit 2024-09-16T10:03:24.116547+0000 mgr.a (mgr.14373) 11516 : audit [DBG] from='client.252282 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:03:25.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:03:25 smithi047 bash[22744]: audit 2024-09-16T10:03:24.116547+0000 mgr.a (mgr.14373) 11516 : audit [DBG] from='client.252282 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:03:26.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:03:26 smithi157 bash[24585]: cluster 2024-09-16T10:03:25.115439+0000 mgr.a (mgr.14373) 11517 : cluster [DBG] pgmap v7987: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:03:26.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:03:26 smithi086 bash[24289]: cluster 2024-09-16T10:03:25.115439+0000 mgr.a (mgr.14373) 11517 : cluster [DBG] pgmap v7987: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:03:26.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:03:26 smithi047 bash[22744]: cluster 2024-09-16T10:03:25.115439+0000 mgr.a (mgr.14373) 11517 : cluster [DBG] pgmap v7987: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:03:28.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:03:28 smithi157 bash[24585]: cluster 2024-09-16T10:03:27.117618+0000 mgr.a (mgr.14373) 11518 : cluster [DBG] pgmap v7988: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:03:28.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:03:28 smithi086 bash[24289]: cluster 2024-09-16T10:03:27.117618+0000 mgr.a (mgr.14373) 11518 : cluster [DBG] pgmap v7988: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:03:28.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:03:28 smithi047 bash[22744]: cluster 2024-09-16T10:03:27.117618+0000 mgr.a (mgr.14373) 11518 : cluster [DBG] pgmap v7988: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:03:29.538 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:03:29.539 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:03:29.539 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:03:30.324 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:03:30.325 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:03:30.325 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:03:30.325 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:03:30.325 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:03:30.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:03:30 smithi157 bash[24585]: cluster 2024-09-16T10:03:29.118378+0000 mgr.a (mgr.14373) 11519 : cluster [DBG] pgmap v7989: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:03:30.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:03:30 smithi157 bash[24585]: audit 2024-09-16T10:03:29.880428+0000 mgr.a (mgr.14373) 11520 : audit [DBG] from='client.252357 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:03:30.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:03:30 smithi086 bash[24289]: cluster 2024-09-16T10:03:29.118378+0000 mgr.a (mgr.14373) 11519 : cluster [DBG] pgmap v7989: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:03:30.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:03:30 smithi086 bash[24289]: audit 2024-09-16T10:03:29.880428+0000 mgr.a (mgr.14373) 11520 : audit [DBG] from='client.252357 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:03:30.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:03:30 smithi047 bash[22744]: cluster 2024-09-16T10:03:29.118378+0000 mgr.a (mgr.14373) 11519 : cluster [DBG] pgmap v7989: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:03:30.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:03:30 smithi047 bash[22744]: audit 2024-09-16T10:03:29.880428+0000 mgr.a (mgr.14373) 11520 : audit [DBG] from='client.252357 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:03:32.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:03:32 smithi157 bash[24585]: cluster 2024-09-16T10:03:31.119272+0000 mgr.a (mgr.14373) 11521 : cluster [DBG] pgmap v7990: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:03:32.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:03:32 smithi086 bash[24289]: cluster 2024-09-16T10:03:31.119272+0000 mgr.a (mgr.14373) 11521 : cluster [DBG] pgmap v7990: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:03:32.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:03:32 smithi047 bash[22744]: cluster 2024-09-16T10:03:31.119272+0000 mgr.a (mgr.14373) 11521 : cluster [DBG] pgmap v7990: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:03:34.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:03:34 smithi157 bash[24585]: cluster 2024-09-16T10:03:33.121534+0000 mgr.a (mgr.14373) 11522 : cluster [DBG] pgmap v7991: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:03:34.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:03:34 smithi086 bash[24289]: cluster 2024-09-16T10:03:33.121534+0000 mgr.a (mgr.14373) 11522 : cluster [DBG] pgmap v7991: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:03:34.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:03:34 smithi047 bash[22744]: cluster 2024-09-16T10:03:33.121534+0000 mgr.a (mgr.14373) 11522 : cluster [DBG] pgmap v7991: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:03:35.326 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:03:35.327 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:03:35.327 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:03:36.099 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:03:36.099 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:03:36.100 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:03:36.100 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:03:36.100 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:03:36.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:03:36 smithi157 bash[24585]: cluster 2024-09-16T10:03:35.122320+0000 mgr.a (mgr.14373) 11523 : cluster [DBG] pgmap v7992: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:03:36.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:03:36 smithi157 bash[24585]: audit 2024-09-16T10:03:35.661079+0000 mgr.a (mgr.14373) 11524 : audit [DBG] from='client.252432 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:03:36.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:03:36 smithi086 bash[24289]: cluster 2024-09-16T10:03:35.122320+0000 mgr.a (mgr.14373) 11523 : cluster [DBG] pgmap v7992: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:03:36.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:03:36 smithi086 bash[24289]: audit 2024-09-16T10:03:35.661079+0000 mgr.a (mgr.14373) 11524 : audit [DBG] from='client.252432 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:03:36.596 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:03:36 smithi047 bash[22744]: cluster 2024-09-16T10:03:35.122320+0000 mgr.a (mgr.14373) 11523 : cluster [DBG] pgmap v7992: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:03:36.596 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:03:36 smithi047 bash[22744]: audit 2024-09-16T10:03:35.661079+0000 mgr.a (mgr.14373) 11524 : audit [DBG] from='client.252432 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:03:38.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:03:38 smithi157 bash[24585]: cluster 2024-09-16T10:03:37.124751+0000 mgr.a (mgr.14373) 11525 : cluster [DBG] pgmap v7993: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:03:38.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:03:38 smithi157 bash[24585]: audit 2024-09-16T10:03:37.421290+0000 mon.b (mon.2) 1062 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T10:03:38.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:03:38 smithi157 bash[24585]: audit 2024-09-16T10:03:38.243892+0000 mon.b (mon.2) 1063 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T10:03:38.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:03:38 smithi157 bash[24585]: audit 2024-09-16T10:03:38.245943+0000 mon.b (mon.2) 1064 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T10:03:38.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:03:38 smithi157 bash[24585]: audit 2024-09-16T10:03:38.257822+0000 mon.a (mon.0) 1254 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:03:38.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:03:38 smithi086 bash[24289]: cluster 2024-09-16T10:03:37.124751+0000 mgr.a (mgr.14373) 11525 : cluster [DBG] pgmap v7993: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:03:38.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:03:38 smithi086 bash[24289]: audit 2024-09-16T10:03:37.421290+0000 mon.b (mon.2) 1062 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T10:03:38.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:03:38 smithi086 bash[24289]: audit 2024-09-16T10:03:38.243892+0000 mon.b (mon.2) 1063 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T10:03:38.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:03:38 smithi086 bash[24289]: audit 2024-09-16T10:03:38.245943+0000 mon.b (mon.2) 1064 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T10:03:38.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:03:38 smithi086 bash[24289]: audit 2024-09-16T10:03:38.257822+0000 mon.a (mon.0) 1254 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:03:38.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:03:38 smithi047 bash[22744]: cluster 2024-09-16T10:03:37.124751+0000 mgr.a (mgr.14373) 11525 : cluster [DBG] pgmap v7993: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:03:38.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:03:38 smithi047 bash[22744]: audit 2024-09-16T10:03:37.421290+0000 mon.b (mon.2) 1062 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T10:03:38.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:03:38 smithi047 bash[22744]: audit 2024-09-16T10:03:38.243892+0000 mon.b (mon.2) 1063 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T10:03:38.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:03:38 smithi047 bash[22744]: audit 2024-09-16T10:03:38.245943+0000 mon.b (mon.2) 1064 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T10:03:38.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:03:38 smithi047 bash[22744]: audit 2024-09-16T10:03:38.257822+0000 mon.a (mon.0) 1254 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:03:39.272 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 10:03:39 smithi047 bash[22994]: debug 2024-09-16T10:03:39.002+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T10:03:39.272 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 10:03:39 smithi047 bash[22994]: debug 2024-09-16T10:03:39.002+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T10:03:39.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:03:39 smithi157 bash[24585]: audit 2024-09-16T10:03:38.260512+0000 mon.b (mon.2) 1065 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:03:39.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:03:39 smithi157 bash[24585]: audit 2024-09-16T10:03:38.262004+0000 mgr.a (mgr.14373) 11526 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:03:39.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:03:39 smithi086 bash[24289]: audit 2024-09-16T10:03:38.260512+0000 mon.b (mon.2) 1065 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:03:39.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:03:39 smithi086 bash[24289]: audit 2024-09-16T10:03:38.262004+0000 mgr.a (mgr.14373) 11526 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:03:39.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:03:39 smithi047 bash[22744]: audit 2024-09-16T10:03:38.260512+0000 mon.b (mon.2) 1065 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:03:39.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:03:39 smithi047 bash[22744]: audit 2024-09-16T10:03:38.262004+0000 mgr.a (mgr.14373) 11526 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:03:40.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:03:40 smithi157 bash[24585]: audit 2024-09-16T10:03:39.002555+0000 mgr.a (mgr.14373) 11527 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T10:03:40.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:03:40 smithi157 bash[24585]: cephadm 2024-09-16T10:03:39.004460+0000 mgr.a (mgr.14373) 11528 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T10:03:40.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:03:40 smithi157 bash[24585]: cluster 2024-09-16T10:03:39.125737+0000 mgr.a (mgr.14373) 11529 : cluster [DBG] pgmap v7994: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:03:40.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:03:40 smithi086 bash[24289]: audit 2024-09-16T10:03:39.002555+0000 mgr.a (mgr.14373) 11527 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T10:03:40.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:03:40 smithi086 bash[24289]: cephadm 2024-09-16T10:03:39.004460+0000 mgr.a (mgr.14373) 11528 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T10:03:40.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:03:40 smithi086 bash[24289]: cluster 2024-09-16T10:03:39.125737+0000 mgr.a (mgr.14373) 11529 : cluster [DBG] pgmap v7994: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:03:40.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:03:40 smithi047 bash[22744]: audit 2024-09-16T10:03:39.002555+0000 mgr.a (mgr.14373) 11527 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T10:03:40.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:03:40 smithi047 bash[22744]: cephadm 2024-09-16T10:03:39.004460+0000 mgr.a (mgr.14373) 11528 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T10:03:40.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:03:40 smithi047 bash[22744]: cluster 2024-09-16T10:03:39.125737+0000 mgr.a (mgr.14373) 11529 : cluster [DBG] pgmap v7994: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:03:41.101 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:03:41.101 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:03:41.102 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:03:41.886 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:03:41.887 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:03:41.887 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:03:41.887 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:03:41.887 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:03:42.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:03:42 smithi157 bash[24585]: cluster 2024-09-16T10:03:41.126502+0000 mgr.a (mgr.14373) 11530 : cluster [DBG] pgmap v7995: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:03:42.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:03:42 smithi157 bash[24585]: audit 2024-09-16T10:03:41.436793+0000 mgr.a (mgr.14373) 11531 : audit [DBG] from='client.252618 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:03:42.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:03:42 smithi086 bash[24289]: cluster 2024-09-16T10:03:41.126502+0000 mgr.a (mgr.14373) 11530 : cluster [DBG] pgmap v7995: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:03:42.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:03:42 smithi086 bash[24289]: audit 2024-09-16T10:03:41.436793+0000 mgr.a (mgr.14373) 11531 : audit [DBG] from='client.252618 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:03:42.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:03:42 smithi047 bash[22744]: cluster 2024-09-16T10:03:41.126502+0000 mgr.a (mgr.14373) 11530 : cluster [DBG] pgmap v7995: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:03:42.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:03:42 smithi047 bash[22744]: audit 2024-09-16T10:03:41.436793+0000 mgr.a (mgr.14373) 11531 : audit [DBG] from='client.252618 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:03:44.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:03:44 smithi157 bash[24585]: cluster 2024-09-16T10:03:43.129195+0000 mgr.a (mgr.14373) 11532 : cluster [DBG] pgmap v7996: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:03:44.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:03:44 smithi086 bash[24289]: cluster 2024-09-16T10:03:43.129195+0000 mgr.a (mgr.14373) 11532 : cluster [DBG] pgmap v7996: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:03:44.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:03:44 smithi047 bash[22744]: cluster 2024-09-16T10:03:43.129195+0000 mgr.a (mgr.14373) 11532 : cluster [DBG] pgmap v7996: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:03:46.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:03:46 smithi157 bash[24585]: cluster 2024-09-16T10:03:45.129992+0000 mgr.a (mgr.14373) 11533 : cluster [DBG] pgmap v7997: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T10:03:46.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:03:46 smithi086 bash[24289]: cluster 2024-09-16T10:03:45.129992+0000 mgr.a (mgr.14373) 11533 : cluster [DBG] pgmap v7997: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T10:03:46.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:03:46 smithi047 bash[22744]: cluster 2024-09-16T10:03:45.129992+0000 mgr.a (mgr.14373) 11533 : cluster [DBG] pgmap v7997: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T10:03:46.888 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:03:46.889 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:03:46.889 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:03:47.670 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:03:47.671 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:03:47.671 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:03:47.671 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:03:47.671 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:03:48.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:03:48 smithi157 bash[24585]: cluster 2024-09-16T10:03:47.131253+0000 mgr.a (mgr.14373) 11534 : cluster [DBG] pgmap v7998: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:03:48.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:03:48 smithi157 bash[24585]: audit 2024-09-16T10:03:47.223222+0000 mgr.a (mgr.14373) 11535 : audit [DBG] from='client.252693 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:03:48.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:03:48 smithi086 bash[24289]: cluster 2024-09-16T10:03:47.131253+0000 mgr.a (mgr.14373) 11534 : cluster [DBG] pgmap v7998: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:03:48.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:03:48 smithi086 bash[24289]: audit 2024-09-16T10:03:47.223222+0000 mgr.a (mgr.14373) 11535 : audit [DBG] from='client.252693 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:03:48.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:03:48 smithi047 bash[22744]: cluster 2024-09-16T10:03:47.131253+0000 mgr.a (mgr.14373) 11534 : cluster [DBG] pgmap v7998: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:03:48.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:03:48 smithi047 bash[22744]: audit 2024-09-16T10:03:47.223222+0000 mgr.a (mgr.14373) 11535 : audit [DBG] from='client.252693 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:03:50.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:03:50 smithi157 bash[24585]: cluster 2024-09-16T10:03:49.132093+0000 mgr.a (mgr.14373) 11536 : cluster [DBG] pgmap v7999: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T10:03:50.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:03:50 smithi086 bash[24289]: cluster 2024-09-16T10:03:49.132093+0000 mgr.a (mgr.14373) 11536 : cluster [DBG] pgmap v7999: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T10:03:50.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:03:50 smithi047 bash[22744]: cluster 2024-09-16T10:03:49.132093+0000 mgr.a (mgr.14373) 11536 : cluster [DBG] pgmap v7999: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T10:03:52.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:03:52 smithi157 bash[24585]: cluster 2024-09-16T10:03:51.132884+0000 mgr.a (mgr.14373) 11537 : cluster [DBG] pgmap v8000: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T10:03:52.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:03:52 smithi086 bash[24289]: cluster 2024-09-16T10:03:51.132884+0000 mgr.a (mgr.14373) 11537 : cluster [DBG] pgmap v8000: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T10:03:52.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:03:52 smithi047 bash[22744]: cluster 2024-09-16T10:03:51.132884+0000 mgr.a (mgr.14373) 11537 : cluster [DBG] pgmap v8000: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T10:03:52.672 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:03:52.673 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:03:52.673 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:03:53.427 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:03:53.427 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:03:53.427 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:03:53.427 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:03:53.428 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:03:53.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:03:53 smithi086 bash[24289]: audit 2024-09-16T10:03:52.998791+0000 mgr.a (mgr.14373) 11538 : audit [DBG] from='client.252768 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:03:53.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:03:53 smithi047 bash[22744]: audit 2024-09-16T10:03:52.998791+0000 mgr.a (mgr.14373) 11538 : audit [DBG] from='client.252768 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:03:53.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:03:53 smithi157 bash[24585]: audit 2024-09-16T10:03:52.998791+0000 mgr.a (mgr.14373) 11538 : audit [DBG] from='client.252768 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:03:54.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:03:54 smithi086 bash[24289]: cluster 2024-09-16T10:03:53.135150+0000 mgr.a (mgr.14373) 11539 : cluster [DBG] pgmap v8001: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:03:54.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:03:54 smithi047 bash[22744]: cluster 2024-09-16T10:03:53.135150+0000 mgr.a (mgr.14373) 11539 : cluster [DBG] pgmap v8001: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:03:54.810 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:03:54 smithi157 bash[24585]: cluster 2024-09-16T10:03:53.135150+0000 mgr.a (mgr.14373) 11539 : cluster [DBG] pgmap v8001: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:03:56.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:03:56 smithi086 bash[24289]: cluster 2024-09-16T10:03:55.136054+0000 mgr.a (mgr.14373) 11540 : cluster [DBG] pgmap v8002: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:03:56.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:03:56 smithi047 bash[22744]: cluster 2024-09-16T10:03:55.136054+0000 mgr.a (mgr.14373) 11540 : cluster [DBG] pgmap v8002: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:03:56.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:03:56 smithi157 bash[24585]: cluster 2024-09-16T10:03:55.136054+0000 mgr.a (mgr.14373) 11540 : cluster [DBG] pgmap v8002: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:03:58.428 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:03:58.429 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:03:58.429 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:03:58.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:03:58 smithi086 bash[24289]: cluster 2024-09-16T10:03:57.138213+0000 mgr.a (mgr.14373) 11541 : cluster [DBG] pgmap v8003: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:03:58.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:03:58 smithi047 bash[22744]: cluster 2024-09-16T10:03:57.138213+0000 mgr.a (mgr.14373) 11541 : cluster [DBG] pgmap v8003: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:03:58.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:03:58 smithi157 bash[24585]: cluster 2024-09-16T10:03:57.138213+0000 mgr.a (mgr.14373) 11541 : cluster [DBG] pgmap v8003: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:03:59.173 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:03:59.173 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:03:59.174 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:03:59.174 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:03:59.174 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:03:59.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:03:59 smithi047 bash[22744]: audit 2024-09-16T10:03:58.761016+0000 mgr.a (mgr.14373) 11542 : audit [DBG] from='client.252846 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:03:59.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:03:59 smithi157 bash[24585]: audit 2024-09-16T10:03:58.761016+0000 mgr.a (mgr.14373) 11542 : audit [DBG] from='client.252846 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:03:59.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:03:59 smithi086 bash[24289]: audit 2024-09-16T10:03:58.761016+0000 mgr.a (mgr.14373) 11542 : audit [DBG] from='client.252846 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:04:00.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:04:00 smithi047 bash[22744]: cluster 2024-09-16T10:03:59.138744+0000 mgr.a (mgr.14373) 11543 : cluster [DBG] pgmap v8004: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:04:00.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:04:00 smithi157 bash[24585]: cluster 2024-09-16T10:03:59.138744+0000 mgr.a (mgr.14373) 11543 : cluster [DBG] pgmap v8004: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:04:00.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:04:00 smithi086 bash[24289]: cluster 2024-09-16T10:03:59.138744+0000 mgr.a (mgr.14373) 11543 : cluster [DBG] pgmap v8004: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:04:02.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:04:02 smithi047 bash[22744]: cluster 2024-09-16T10:04:01.139477+0000 mgr.a (mgr.14373) 11544 : cluster [DBG] pgmap v8005: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:04:02.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:04:02 smithi157 bash[24585]: cluster 2024-09-16T10:04:01.139477+0000 mgr.a (mgr.14373) 11544 : cluster [DBG] pgmap v8005: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:04:02.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:04:02 smithi086 bash[24289]: cluster 2024-09-16T10:04:01.139477+0000 mgr.a (mgr.14373) 11544 : cluster [DBG] pgmap v8005: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:04:04.175 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:04:04.176 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:04:04.176 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:04:04.591 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:04:04 smithi047 bash[22744]: cluster 2024-09-16T10:04:03.141686+0000 mgr.a (mgr.14373) 11545 : cluster [DBG] pgmap v8006: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:04:04.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:04:04 smithi157 bash[24585]: cluster 2024-09-16T10:04:03.141686+0000 mgr.a (mgr.14373) 11545 : cluster [DBG] pgmap v8006: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:04:04.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:04:04 smithi086 bash[24289]: cluster 2024-09-16T10:04:03.141686+0000 mgr.a (mgr.14373) 11545 : cluster [DBG] pgmap v8006: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:04:04.937 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:04:04.937 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:04:04.937 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:04:04.938 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:04:04.938 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:04:05.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:04:05 smithi157 bash[24585]: audit 2024-09-16T10:04:04.507079+0000 mgr.a (mgr.14373) 11546 : audit [DBG] from='client.252924 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:04:05.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:04:05 smithi086 bash[24289]: audit 2024-09-16T10:04:04.507079+0000 mgr.a (mgr.14373) 11546 : audit [DBG] from='client.252924 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:04:05.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:04:05 smithi047 bash[22744]: audit 2024-09-16T10:04:04.507079+0000 mgr.a (mgr.14373) 11546 : audit [DBG] from='client.252924 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:04:06.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:04:06 smithi157 bash[24585]: cluster 2024-09-16T10:04:05.142687+0000 mgr.a (mgr.14373) 11547 : cluster [DBG] pgmap v8007: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:04:06.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:04:06 smithi086 bash[24289]: cluster 2024-09-16T10:04:05.142687+0000 mgr.a (mgr.14373) 11547 : cluster [DBG] pgmap v8007: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:04:06.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:04:06 smithi047 bash[22744]: cluster 2024-09-16T10:04:05.142687+0000 mgr.a (mgr.14373) 11547 : cluster [DBG] pgmap v8007: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:04:08.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:04:08 smithi157 bash[24585]: cluster 2024-09-16T10:04:07.144916+0000 mgr.a (mgr.14373) 11548 : cluster [DBG] pgmap v8008: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:04:08.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:04:08 smithi086 bash[24289]: cluster 2024-09-16T10:04:07.144916+0000 mgr.a (mgr.14373) 11548 : cluster [DBG] pgmap v8008: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:04:08.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:04:08 smithi047 bash[22744]: cluster 2024-09-16T10:04:07.144916+0000 mgr.a (mgr.14373) 11548 : cluster [DBG] pgmap v8008: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:04:09.939 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:04:09.939 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:04:09.939 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:04:10.697 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:04:10.697 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:04:10.697 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:04:10.698 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:04:10.698 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:04:10.809 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:04:10 smithi157 bash[24585]: cluster 2024-09-16T10:04:09.145698+0000 mgr.a (mgr.14373) 11549 : cluster [DBG] pgmap v8009: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:04:10.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:04:10 smithi086 bash[24289]: cluster 2024-09-16T10:04:09.145698+0000 mgr.a (mgr.14373) 11549 : cluster [DBG] pgmap v8009: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:04:10.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:04:10 smithi047 bash[22744]: cluster 2024-09-16T10:04:09.145698+0000 mgr.a (mgr.14373) 11549 : cluster [DBG] pgmap v8009: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:04:11.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:04:11 smithi157 bash[24585]: audit 2024-09-16T10:04:10.260815+0000 mgr.a (mgr.14373) 11550 : audit [DBG] from='client.252999 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:04:11.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:04:11 smithi086 bash[24289]: audit 2024-09-16T10:04:10.260815+0000 mgr.a (mgr.14373) 11550 : audit [DBG] from='client.252999 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:04:11.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:04:11 smithi047 bash[22744]: audit 2024-09-16T10:04:10.260815+0000 mgr.a (mgr.14373) 11550 : audit [DBG] from='client.252999 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:04:12.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:04:12 smithi157 bash[24585]: cluster 2024-09-16T10:04:11.146636+0000 mgr.a (mgr.14373) 11551 : cluster [DBG] pgmap v8010: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:04:12.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:04:12 smithi086 bash[24289]: cluster 2024-09-16T10:04:11.146636+0000 mgr.a (mgr.14373) 11551 : cluster [DBG] pgmap v8010: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:04:12.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:04:12 smithi047 bash[22744]: cluster 2024-09-16T10:04:11.146636+0000 mgr.a (mgr.14373) 11551 : cluster [DBG] pgmap v8010: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:04:14.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:04:14 smithi157 bash[24585]: cluster 2024-09-16T10:04:13.148871+0000 mgr.a (mgr.14373) 11552 : cluster [DBG] pgmap v8011: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:04:14.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:04:14 smithi086 bash[24289]: cluster 2024-09-16T10:04:13.148871+0000 mgr.a (mgr.14373) 11552 : cluster [DBG] pgmap v8011: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:04:14.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:04:14 smithi047 bash[22744]: cluster 2024-09-16T10:04:13.148871+0000 mgr.a (mgr.14373) 11552 : cluster [DBG] pgmap v8011: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:04:15.698 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:04:15.699 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:04:15.700 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:04:16.451 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:04:16.451 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:04:16.452 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:04:16.452 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:04:16.452 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:04:16.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:04:16 smithi157 bash[24585]: cluster 2024-09-16T10:04:15.149637+0000 mgr.a (mgr.14373) 11553 : cluster [DBG] pgmap v8012: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:04:16.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:04:16 smithi086 bash[24289]: cluster 2024-09-16T10:04:15.149637+0000 mgr.a (mgr.14373) 11553 : cluster [DBG] pgmap v8012: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:04:16.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:04:16 smithi047 bash[22744]: cluster 2024-09-16T10:04:15.149637+0000 mgr.a (mgr.14373) 11553 : cluster [DBG] pgmap v8012: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:04:17.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:04:17 smithi157 bash[24585]: audit 2024-09-16T10:04:16.025760+0000 mgr.a (mgr.14373) 11554 : audit [DBG] from='client.253077 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:04:17.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:04:17 smithi086 bash[24289]: audit 2024-09-16T10:04:16.025760+0000 mgr.a (mgr.14373) 11554 : audit [DBG] from='client.253077 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:04:17.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:04:17 smithi047 bash[22744]: audit 2024-09-16T10:04:16.025760+0000 mgr.a (mgr.14373) 11554 : audit [DBG] from='client.253077 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:04:18.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:04:18 smithi157 bash[24585]: cluster 2024-09-16T10:04:17.151971+0000 mgr.a (mgr.14373) 11555 : cluster [DBG] pgmap v8013: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:04:18.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:04:18 smithi086 bash[24289]: cluster 2024-09-16T10:04:17.151971+0000 mgr.a (mgr.14373) 11555 : cluster [DBG] pgmap v8013: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:04:18.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:04:18 smithi047 bash[22744]: cluster 2024-09-16T10:04:17.151971+0000 mgr.a (mgr.14373) 11555 : cluster [DBG] pgmap v8013: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:04:20.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:04:20 smithi157 bash[24585]: cluster 2024-09-16T10:04:19.152726+0000 mgr.a (mgr.14373) 11556 : cluster [DBG] pgmap v8014: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:04:20.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:04:20 smithi086 bash[24289]: cluster 2024-09-16T10:04:19.152726+0000 mgr.a (mgr.14373) 11556 : cluster [DBG] pgmap v8014: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:04:20.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:04:20 smithi047 bash[22744]: cluster 2024-09-16T10:04:19.152726+0000 mgr.a (mgr.14373) 11556 : cluster [DBG] pgmap v8014: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:04:21.453 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:04:21.454 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:04:21.454 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:04:22.218 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:04:22.218 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:04:22.218 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:04:22.219 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:04:22.219 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:04:22.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:04:22 smithi157 bash[24585]: cluster 2024-09-16T10:04:21.153473+0000 mgr.a (mgr.14373) 11557 : cluster [DBG] pgmap v8015: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:04:22.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:04:22 smithi157 bash[24585]: audit 2024-09-16T10:04:21.781732+0000 mgr.a (mgr.14373) 11558 : audit [DBG] from='client.253155 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:04:22.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:04:22 smithi086 bash[24289]: cluster 2024-09-16T10:04:21.153473+0000 mgr.a (mgr.14373) 11557 : cluster [DBG] pgmap v8015: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:04:22.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:04:22 smithi086 bash[24289]: audit 2024-09-16T10:04:21.781732+0000 mgr.a (mgr.14373) 11558 : audit [DBG] from='client.253155 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:04:22.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:04:22 smithi047 bash[22744]: cluster 2024-09-16T10:04:21.153473+0000 mgr.a (mgr.14373) 11557 : cluster [DBG] pgmap v8015: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:04:22.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:04:22 smithi047 bash[22744]: audit 2024-09-16T10:04:21.781732+0000 mgr.a (mgr.14373) 11558 : audit [DBG] from='client.253155 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:04:24.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:04:24 smithi157 bash[24585]: cluster 2024-09-16T10:04:23.156241+0000 mgr.a (mgr.14373) 11559 : cluster [DBG] pgmap v8016: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:04:24.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:04:24 smithi086 bash[24289]: cluster 2024-09-16T10:04:23.156241+0000 mgr.a (mgr.14373) 11559 : cluster [DBG] pgmap v8016: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:04:24.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:04:24 smithi047 bash[22744]: cluster 2024-09-16T10:04:23.156241+0000 mgr.a (mgr.14373) 11559 : cluster [DBG] pgmap v8016: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:04:26.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:04:26 smithi157 bash[24585]: cluster 2024-09-16T10:04:25.157032+0000 mgr.a (mgr.14373) 11560 : cluster [DBG] pgmap v8017: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:04:26.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:04:26 smithi086 bash[24289]: cluster 2024-09-16T10:04:25.157032+0000 mgr.a (mgr.14373) 11560 : cluster [DBG] pgmap v8017: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:04:26.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:04:26 smithi047 bash[22744]: cluster 2024-09-16T10:04:25.157032+0000 mgr.a (mgr.14373) 11560 : cluster [DBG] pgmap v8017: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:04:27.219 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:04:27.220 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:04:27.221 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:04:27.978 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:04:27.978 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:04:27.978 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:04:27.978 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:04:27.978 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:04:28.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:04:28 smithi157 bash[24585]: cluster 2024-09-16T10:04:27.159007+0000 mgr.a (mgr.14373) 11561 : cluster [DBG] pgmap v8018: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:04:28.943 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:04:28 smithi157 bash[24585]: audit 2024-09-16T10:04:27.552673+0000 mgr.a (mgr.14373) 11562 : audit [DBG] from='client.253233 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:04:28.944 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:04:28 smithi047 bash[22744]: cluster 2024-09-16T10:04:27.159007+0000 mgr.a (mgr.14373) 11561 : cluster [DBG] pgmap v8018: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:04:28.944 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:04:28 smithi047 bash[22744]: audit 2024-09-16T10:04:27.552673+0000 mgr.a (mgr.14373) 11562 : audit [DBG] from='client.253233 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:04:28.944 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:04:28 smithi086 bash[24289]: cluster 2024-09-16T10:04:27.159007+0000 mgr.a (mgr.14373) 11561 : cluster [DBG] pgmap v8018: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:04:28.944 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:04:28 smithi086 bash[24289]: audit 2024-09-16T10:04:27.552673+0000 mgr.a (mgr.14373) 11562 : audit [DBG] from='client.253233 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:04:30.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:04:30 smithi157 bash[24585]: cluster 2024-09-16T10:04:29.159915+0000 mgr.a (mgr.14373) 11563 : cluster [DBG] pgmap v8019: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:04:30.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:04:30 smithi086 bash[24289]: cluster 2024-09-16T10:04:29.159915+0000 mgr.a (mgr.14373) 11563 : cluster [DBG] pgmap v8019: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:04:30.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:04:30 smithi047 bash[22744]: cluster 2024-09-16T10:04:29.159915+0000 mgr.a (mgr.14373) 11563 : cluster [DBG] pgmap v8019: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:04:32.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:04:32 smithi157 bash[24585]: cluster 2024-09-16T10:04:31.160684+0000 mgr.a (mgr.14373) 11564 : cluster [DBG] pgmap v8020: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T10:04:32.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:04:32 smithi086 bash[24289]: cluster 2024-09-16T10:04:31.160684+0000 mgr.a (mgr.14373) 11564 : cluster [DBG] pgmap v8020: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T10:04:32.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:04:32 smithi047 bash[22744]: cluster 2024-09-16T10:04:31.160684+0000 mgr.a (mgr.14373) 11564 : cluster [DBG] pgmap v8020: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T10:04:32.979 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:04:32.980 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:04:32.981 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:04:33.735 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:04:33.736 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:04:33.736 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:04:33.736 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:04:33.736 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:04:34.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:04:34 smithi157 bash[24585]: cluster 2024-09-16T10:04:33.162235+0000 mgr.a (mgr.14373) 11565 : cluster [DBG] pgmap v8021: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:04:34.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:04:34 smithi157 bash[24585]: audit 2024-09-16T10:04:33.312842+0000 mgr.a (mgr.14373) 11566 : audit [DBG] from='client.253308 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:04:34.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:04:34 smithi086 bash[24289]: cluster 2024-09-16T10:04:33.162235+0000 mgr.a (mgr.14373) 11565 : cluster [DBG] pgmap v8021: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:04:34.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:04:34 smithi086 bash[24289]: audit 2024-09-16T10:04:33.312842+0000 mgr.a (mgr.14373) 11566 : audit [DBG] from='client.253308 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:04:34.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:04:34 smithi047 bash[22744]: cluster 2024-09-16T10:04:33.162235+0000 mgr.a (mgr.14373) 11565 : cluster [DBG] pgmap v8021: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:04:34.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:04:34 smithi047 bash[22744]: audit 2024-09-16T10:04:33.312842+0000 mgr.a (mgr.14373) 11566 : audit [DBG] from='client.253308 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:04:36.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:04:36 smithi157 bash[24585]: cluster 2024-09-16T10:04:35.163155+0000 mgr.a (mgr.14373) 11567 : cluster [DBG] pgmap v8022: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:04:36.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:04:36 smithi086 bash[24289]: cluster 2024-09-16T10:04:35.163155+0000 mgr.a (mgr.14373) 11567 : cluster [DBG] pgmap v8022: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:04:36.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:04:36 smithi047 bash[22744]: cluster 2024-09-16T10:04:35.163155+0000 mgr.a (mgr.14373) 11567 : cluster [DBG] pgmap v8022: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:04:38.737 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:04:38.738 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:04:38.738 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:04:38.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:04:38 smithi157 bash[24585]: cluster 2024-09-16T10:04:37.165375+0000 mgr.a (mgr.14373) 11568 : cluster [DBG] pgmap v8023: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:04:38.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:04:38 smithi086 bash[24289]: cluster 2024-09-16T10:04:37.165375+0000 mgr.a (mgr.14373) 11568 : cluster [DBG] pgmap v8023: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:04:38.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:04:38 smithi047 bash[22744]: cluster 2024-09-16T10:04:37.165375+0000 mgr.a (mgr.14373) 11568 : cluster [DBG] pgmap v8023: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:04:39.516 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:04:39.516 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:04:39.516 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:04:39.516 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:04:39.516 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:04:39.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:04:39 smithi157 bash[24585]: audit 2024-09-16T10:04:39.055612+0000 mon.b (mon.2) 1066 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T10:04:39.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:04:39 smithi086 bash[24289]: audit 2024-09-16T10:04:39.055612+0000 mon.b (mon.2) 1066 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T10:04:39.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:04:39 smithi047 bash[22744]: audit 2024-09-16T10:04:39.055612+0000 mon.b (mon.2) 1066 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T10:04:40.689 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:04:40 smithi047 bash[22744]: audit 2024-09-16T10:04:39.070458+0000 mgr.a (mgr.14373) 11569 : audit [DBG] from='client.253383 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:04:40.690 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:04:40 smithi047 bash[22744]: cluster 2024-09-16T10:04:39.165950+0000 mgr.a (mgr.14373) 11570 : cluster [DBG] pgmap v8024: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:04:40.690 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:04:40 smithi047 bash[22744]: audit 2024-09-16T10:04:39.917638+0000 mon.b (mon.2) 1067 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T10:04:40.690 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:04:40 smithi047 bash[22744]: audit 2024-09-16T10:04:39.919764+0000 mon.b (mon.2) 1068 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T10:04:40.690 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:04:40 smithi047 bash[22744]: audit 2024-09-16T10:04:39.928307+0000 mon.a (mon.0) 1255 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:04:40.690 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:04:40 smithi047 bash[22744]: audit 2024-09-16T10:04:39.933368+0000 mon.b (mon.2) 1069 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:04:40.690 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:04:40 smithi047 bash[22744]: audit 2024-09-16T10:04:39.936656+0000 mgr.a (mgr.14373) 11571 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:04:40.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:04:40 smithi157 bash[24585]: audit 2024-09-16T10:04:39.070458+0000 mgr.a (mgr.14373) 11569 : audit [DBG] from='client.253383 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:04:40.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:04:40 smithi157 bash[24585]: cluster 2024-09-16T10:04:39.165950+0000 mgr.a (mgr.14373) 11570 : cluster [DBG] pgmap v8024: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:04:40.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:04:40 smithi157 bash[24585]: audit 2024-09-16T10:04:39.917638+0000 mon.b (mon.2) 1067 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T10:04:40.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:04:40 smithi157 bash[24585]: audit 2024-09-16T10:04:39.919764+0000 mon.b (mon.2) 1068 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T10:04:40.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:04:40 smithi157 bash[24585]: audit 2024-09-16T10:04:39.928307+0000 mon.a (mon.0) 1255 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:04:40.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:04:40 smithi157 bash[24585]: audit 2024-09-16T10:04:39.933368+0000 mon.b (mon.2) 1069 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:04:40.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:04:40 smithi157 bash[24585]: audit 2024-09-16T10:04:39.936656+0000 mgr.a (mgr.14373) 11571 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:04:40.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:04:40 smithi086 bash[24289]: audit 2024-09-16T10:04:39.070458+0000 mgr.a (mgr.14373) 11569 : audit [DBG] from='client.253383 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:04:40.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:04:40 smithi086 bash[24289]: cluster 2024-09-16T10:04:39.165950+0000 mgr.a (mgr.14373) 11570 : cluster [DBG] pgmap v8024: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:04:40.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:04:40 smithi086 bash[24289]: audit 2024-09-16T10:04:39.917638+0000 mon.b (mon.2) 1067 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T10:04:40.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:04:40 smithi086 bash[24289]: audit 2024-09-16T10:04:39.919764+0000 mon.b (mon.2) 1068 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T10:04:40.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:04:40 smithi086 bash[24289]: audit 2024-09-16T10:04:39.928307+0000 mon.a (mon.0) 1255 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:04:40.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:04:40 smithi086 bash[24289]: audit 2024-09-16T10:04:39.933368+0000 mon.b (mon.2) 1069 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:04:40.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:04:40 smithi086 bash[24289]: audit 2024-09-16T10:04:39.936656+0000 mgr.a (mgr.14373) 11571 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:04:41.092 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 10:04:40 smithi047 bash[22994]: debug 2024-09-16T10:04:40.684+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T10:04:41.092 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 10:04:40 smithi047 bash[22994]: debug 2024-09-16T10:04:40.688+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T10:04:41.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:04:41 smithi157 bash[24585]: audit 2024-09-16T10:04:40.688793+0000 mgr.a (mgr.14373) 11572 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T10:04:41.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:04:41 smithi157 bash[24585]: cephadm 2024-09-16T10:04:40.691040+0000 mgr.a (mgr.14373) 11573 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T10:04:41.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:04:41 smithi086 bash[24289]: audit 2024-09-16T10:04:40.688793+0000 mgr.a (mgr.14373) 11572 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T10:04:41.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:04:41 smithi086 bash[24289]: cephadm 2024-09-16T10:04:40.691040+0000 mgr.a (mgr.14373) 11573 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T10:04:41.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:04:41 smithi047 bash[22744]: audit 2024-09-16T10:04:40.688793+0000 mgr.a (mgr.14373) 11572 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T10:04:41.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:04:41 smithi047 bash[22744]: cephadm 2024-09-16T10:04:40.691040+0000 mgr.a (mgr.14373) 11573 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T10:04:42.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:04:42 smithi157 bash[24585]: cluster 2024-09-16T10:04:41.166883+0000 mgr.a (mgr.14373) 11574 : cluster [DBG] pgmap v8025: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:04:42.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:04:42 smithi086 bash[24289]: cluster 2024-09-16T10:04:41.166883+0000 mgr.a (mgr.14373) 11574 : cluster [DBG] pgmap v8025: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:04:42.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:04:42 smithi047 bash[22744]: cluster 2024-09-16T10:04:41.166883+0000 mgr.a (mgr.14373) 11574 : cluster [DBG] pgmap v8025: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:04:44.517 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:04:44.518 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:04:44.518 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:04:44.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:04:44 smithi157 bash[24585]: cluster 2024-09-16T10:04:43.169108+0000 mgr.a (mgr.14373) 11575 : cluster [DBG] pgmap v8026: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:04:44.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:04:44 smithi086 bash[24289]: cluster 2024-09-16T10:04:43.169108+0000 mgr.a (mgr.14373) 11575 : cluster [DBG] pgmap v8026: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:04:44.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:04:44 smithi047 bash[22744]: cluster 2024-09-16T10:04:43.169108+0000 mgr.a (mgr.14373) 11575 : cluster [DBG] pgmap v8026: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:04:45.295 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:04:45.295 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:04:45.295 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:04:45.296 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:04:45.296 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:04:45.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:04:45 smithi157 bash[24585]: audit 2024-09-16T10:04:44.853185+0000 mgr.a (mgr.14373) 11576 : audit [DBG] from='client.253569 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:04:45.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:04:45 smithi086 bash[24289]: audit 2024-09-16T10:04:44.853185+0000 mgr.a (mgr.14373) 11576 : audit [DBG] from='client.253569 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:04:45.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:04:45 smithi047 bash[22744]: audit 2024-09-16T10:04:44.853185+0000 mgr.a (mgr.14373) 11576 : audit [DBG] from='client.253569 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:04:46.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:04:46 smithi157 bash[24585]: cluster 2024-09-16T10:04:45.169669+0000 mgr.a (mgr.14373) 11577 : cluster [DBG] pgmap v8027: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:04:46.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:04:46 smithi086 bash[24289]: cluster 2024-09-16T10:04:45.169669+0000 mgr.a (mgr.14373) 11577 : cluster [DBG] pgmap v8027: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:04:46.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:04:46 smithi047 bash[22744]: cluster 2024-09-16T10:04:45.169669+0000 mgr.a (mgr.14373) 11577 : cluster [DBG] pgmap v8027: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:04:48.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:04:48 smithi157 bash[24585]: cluster 2024-09-16T10:04:47.171941+0000 mgr.a (mgr.14373) 11578 : cluster [DBG] pgmap v8028: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:04:48.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:04:48 smithi086 bash[24289]: cluster 2024-09-16T10:04:47.171941+0000 mgr.a (mgr.14373) 11578 : cluster [DBG] pgmap v8028: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:04:48.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:04:48 smithi047 bash[22744]: cluster 2024-09-16T10:04:47.171941+0000 mgr.a (mgr.14373) 11578 : cluster [DBG] pgmap v8028: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:04:50.297 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:04:50.297 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:04:50.298 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:04:50.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:04:50 smithi157 bash[24585]: cluster 2024-09-16T10:04:49.172685+0000 mgr.a (mgr.14373) 11579 : cluster [DBG] pgmap v8029: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:04:50.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:04:50 smithi086 bash[24289]: cluster 2024-09-16T10:04:49.172685+0000 mgr.a (mgr.14373) 11579 : cluster [DBG] pgmap v8029: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:04:50.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:04:50 smithi047 bash[22744]: cluster 2024-09-16T10:04:49.172685+0000 mgr.a (mgr.14373) 11579 : cluster [DBG] pgmap v8029: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:04:51.045 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:04:51.045 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:04:51.045 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:04:51.045 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:04:51.045 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:04:51.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:04:51 smithi157 bash[24585]: audit 2024-09-16T10:04:50.626669+0000 mgr.a (mgr.14373) 11580 : audit [DBG] from='client.253647 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:04:51.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:04:51 smithi086 bash[24289]: audit 2024-09-16T10:04:50.626669+0000 mgr.a (mgr.14373) 11580 : audit [DBG] from='client.253647 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:04:51.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:04:51 smithi047 bash[22744]: audit 2024-09-16T10:04:50.626669+0000 mgr.a (mgr.14373) 11580 : audit [DBG] from='client.253647 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:04:52.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:04:52 smithi157 bash[24585]: cluster 2024-09-16T10:04:51.173625+0000 mgr.a (mgr.14373) 11581 : cluster [DBG] pgmap v8030: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:04:52.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:04:52 smithi086 bash[24289]: cluster 2024-09-16T10:04:51.173625+0000 mgr.a (mgr.14373) 11581 : cluster [DBG] pgmap v8030: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:04:52.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:04:52 smithi047 bash[22744]: cluster 2024-09-16T10:04:51.173625+0000 mgr.a (mgr.14373) 11581 : cluster [DBG] pgmap v8030: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:04:54.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:04:54 smithi157 bash[24585]: cluster 2024-09-16T10:04:53.175897+0000 mgr.a (mgr.14373) 11582 : cluster [DBG] pgmap v8031: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:04:54.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:04:54 smithi086 bash[24289]: cluster 2024-09-16T10:04:53.175897+0000 mgr.a (mgr.14373) 11582 : cluster [DBG] pgmap v8031: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:04:54.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:04:54 smithi047 bash[22744]: cluster 2024-09-16T10:04:53.175897+0000 mgr.a (mgr.14373) 11582 : cluster [DBG] pgmap v8031: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:04:56.047 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:04:56.047 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:04:56.047 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:04:56.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:04:56 smithi157 bash[24585]: cluster 2024-09-16T10:04:55.176654+0000 mgr.a (mgr.14373) 11583 : cluster [DBG] pgmap v8032: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:04:56.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:04:56 smithi086 bash[24289]: cluster 2024-09-16T10:04:55.176654+0000 mgr.a (mgr.14373) 11583 : cluster [DBG] pgmap v8032: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:04:56.830 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:04:56.830 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:04:56.830 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:04:56.830 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:04:56.830 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:04:56.841 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:04:56 smithi047 bash[22744]: cluster 2024-09-16T10:04:55.176654+0000 mgr.a (mgr.14373) 11583 : cluster [DBG] pgmap v8032: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:04:57.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:04:57 smithi157 bash[24585]: audit 2024-09-16T10:04:56.385721+0000 mgr.a (mgr.14373) 11584 : audit [DBG] from='client.253725 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:04:57.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:04:57 smithi086 bash[24289]: audit 2024-09-16T10:04:56.385721+0000 mgr.a (mgr.14373) 11584 : audit [DBG] from='client.253725 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:04:57.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:04:57 smithi047 bash[22744]: audit 2024-09-16T10:04:56.385721+0000 mgr.a (mgr.14373) 11584 : audit [DBG] from='client.253725 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:04:58.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:04:58 smithi157 bash[24585]: cluster 2024-09-16T10:04:57.179474+0000 mgr.a (mgr.14373) 11585 : cluster [DBG] pgmap v8033: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:04:58.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:04:58 smithi086 bash[24289]: cluster 2024-09-16T10:04:57.179474+0000 mgr.a (mgr.14373) 11585 : cluster [DBG] pgmap v8033: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:04:58.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:04:58 smithi047 bash[22744]: cluster 2024-09-16T10:04:57.179474+0000 mgr.a (mgr.14373) 11585 : cluster [DBG] pgmap v8033: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:05:00.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:05:00 smithi157 bash[24585]: cluster 2024-09-16T10:04:59.180270+0000 mgr.a (mgr.14373) 11586 : cluster [DBG] pgmap v8034: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:05:00.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:05:00 smithi086 bash[24289]: cluster 2024-09-16T10:04:59.180270+0000 mgr.a (mgr.14373) 11586 : cluster [DBG] pgmap v8034: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:05:00.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:05:00 smithi047 bash[22744]: cluster 2024-09-16T10:04:59.180270+0000 mgr.a (mgr.14373) 11586 : cluster [DBG] pgmap v8034: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:05:01.832 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:05:01.832 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:05:01.833 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:05:02.578 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:05:02.578 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:05:02.578 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:05:02.578 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:05:02.578 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:05:02.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:05:02 smithi157 bash[24585]: cluster 2024-09-16T10:05:01.181022+0000 mgr.a (mgr.14373) 11587 : cluster [DBG] pgmap v8035: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T10:05:02.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:05:02 smithi086 bash[24289]: cluster 2024-09-16T10:05:01.181022+0000 mgr.a (mgr.14373) 11587 : cluster [DBG] pgmap v8035: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T10:05:02.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:05:02 smithi047 bash[22744]: cluster 2024-09-16T10:05:01.181022+0000 mgr.a (mgr.14373) 11587 : cluster [DBG] pgmap v8035: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T10:05:03.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:05:03 smithi157 bash[24585]: audit 2024-09-16T10:05:02.164271+0000 mgr.a (mgr.14373) 11588 : audit [DBG] from='client.253803 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:05:03.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:05:03 smithi086 bash[24289]: audit 2024-09-16T10:05:02.164271+0000 mgr.a (mgr.14373) 11588 : audit [DBG] from='client.253803 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:05:03.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:05:03 smithi047 bash[22744]: audit 2024-09-16T10:05:02.164271+0000 mgr.a (mgr.14373) 11588 : audit [DBG] from='client.253803 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:05:04.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:05:04 smithi157 bash[24585]: cluster 2024-09-16T10:05:03.183762+0000 mgr.a (mgr.14373) 11589 : cluster [DBG] pgmap v8036: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:05:04.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:05:04 smithi086 bash[24289]: cluster 2024-09-16T10:05:03.183762+0000 mgr.a (mgr.14373) 11589 : cluster [DBG] pgmap v8036: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:05:04.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:05:04 smithi047 bash[22744]: cluster 2024-09-16T10:05:03.183762+0000 mgr.a (mgr.14373) 11589 : cluster [DBG] pgmap v8036: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:05:06.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:05:06 smithi157 bash[24585]: cluster 2024-09-16T10:05:05.184534+0000 mgr.a (mgr.14373) 11590 : cluster [DBG] pgmap v8037: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:05:06.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:05:06 smithi086 bash[24289]: cluster 2024-09-16T10:05:05.184534+0000 mgr.a (mgr.14373) 11590 : cluster [DBG] pgmap v8037: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:05:06.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:05:06 smithi047 bash[22744]: cluster 2024-09-16T10:05:05.184534+0000 mgr.a (mgr.14373) 11590 : cluster [DBG] pgmap v8037: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:05:07.579 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:05:07.580 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:05:07.580 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:05:08.328 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:05:08.329 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:05:08.329 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:05:08.329 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:05:08.329 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:05:08.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:05:08 smithi157 bash[24585]: cluster 2024-09-16T10:05:07.186546+0000 mgr.a (mgr.14373) 11591 : cluster [DBG] pgmap v8038: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:05:08.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:05:08 smithi157 bash[24585]: audit 2024-09-16T10:05:07.908618+0000 mgr.a (mgr.14373) 11592 : audit [DBG] from='client.253878 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:05:08.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:05:08 smithi086 bash[24289]: cluster 2024-09-16T10:05:07.186546+0000 mgr.a (mgr.14373) 11591 : cluster [DBG] pgmap v8038: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:05:08.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:05:08 smithi086 bash[24289]: audit 2024-09-16T10:05:07.908618+0000 mgr.a (mgr.14373) 11592 : audit [DBG] from='client.253878 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:05:08.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:05:08 smithi047 bash[22744]: cluster 2024-09-16T10:05:07.186546+0000 mgr.a (mgr.14373) 11591 : cluster [DBG] pgmap v8038: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:05:08.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:05:08 smithi047 bash[22744]: audit 2024-09-16T10:05:07.908618+0000 mgr.a (mgr.14373) 11592 : audit [DBG] from='client.253878 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:05:10.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:05:10 smithi157 bash[24585]: cluster 2024-09-16T10:05:09.187563+0000 mgr.a (mgr.14373) 11593 : cluster [DBG] pgmap v8039: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:05:10.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:05:10 smithi086 bash[24289]: cluster 2024-09-16T10:05:09.187563+0000 mgr.a (mgr.14373) 11593 : cluster [DBG] pgmap v8039: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:05:10.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:05:10 smithi047 bash[22744]: cluster 2024-09-16T10:05:09.187563+0000 mgr.a (mgr.14373) 11593 : cluster [DBG] pgmap v8039: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:05:12.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:05:12 smithi157 bash[24585]: cluster 2024-09-16T10:05:11.188393+0000 mgr.a (mgr.14373) 11594 : cluster [DBG] pgmap v8040: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:05:12.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:05:12 smithi086 bash[24289]: cluster 2024-09-16T10:05:11.188393+0000 mgr.a (mgr.14373) 11594 : cluster [DBG] pgmap v8040: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:05:12.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:05:12 smithi047 bash[22744]: cluster 2024-09-16T10:05:11.188393+0000 mgr.a (mgr.14373) 11594 : cluster [DBG] pgmap v8040: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:05:13.330 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:05:13.331 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:05:13.331 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:05:14.109 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:05:14.110 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:05:14.110 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:05:14.110 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:05:14.110 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:05:14.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:05:14 smithi157 bash[24585]: cluster 2024-09-16T10:05:13.190732+0000 mgr.a (mgr.14373) 11595 : cluster [DBG] pgmap v8041: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:05:14.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:05:14 smithi157 bash[24585]: audit 2024-09-16T10:05:13.665868+0000 mgr.a (mgr.14373) 11596 : audit [DBG] from='client.253950 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:05:14.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:05:14 smithi086 bash[24289]: cluster 2024-09-16T10:05:13.190732+0000 mgr.a (mgr.14373) 11595 : cluster [DBG] pgmap v8041: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:05:14.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:05:14 smithi086 bash[24289]: audit 2024-09-16T10:05:13.665868+0000 mgr.a (mgr.14373) 11596 : audit [DBG] from='client.253950 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:05:14.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:05:14 smithi047 bash[22744]: cluster 2024-09-16T10:05:13.190732+0000 mgr.a (mgr.14373) 11595 : cluster [DBG] pgmap v8041: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:05:14.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:05:14 smithi047 bash[22744]: audit 2024-09-16T10:05:13.665868+0000 mgr.a (mgr.14373) 11596 : audit [DBG] from='client.253950 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:05:16.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:05:16 smithi157 bash[24585]: cluster 2024-09-16T10:05:15.191673+0000 mgr.a (mgr.14373) 11597 : cluster [DBG] pgmap v8042: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:05:16.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:05:16 smithi086 bash[24289]: cluster 2024-09-16T10:05:15.191673+0000 mgr.a (mgr.14373) 11597 : cluster [DBG] pgmap v8042: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:05:16.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:05:16 smithi047 bash[22744]: cluster 2024-09-16T10:05:15.191673+0000 mgr.a (mgr.14373) 11597 : cluster [DBG] pgmap v8042: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:05:18.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:05:18 smithi157 bash[24585]: cluster 2024-09-16T10:05:17.193889+0000 mgr.a (mgr.14373) 11598 : cluster [DBG] pgmap v8043: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:05:18.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:05:18 smithi086 bash[24289]: cluster 2024-09-16T10:05:17.193889+0000 mgr.a (mgr.14373) 11598 : cluster [DBG] pgmap v8043: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:05:18.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:05:18 smithi047 bash[22744]: cluster 2024-09-16T10:05:17.193889+0000 mgr.a (mgr.14373) 11598 : cluster [DBG] pgmap v8043: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:05:19.111 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:05:19.112 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:05:19.112 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:05:19.889 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:05:19.889 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:05:19.889 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:05:19.889 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:05:19.889 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:05:20.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:05:20 smithi157 bash[24585]: cluster 2024-09-16T10:05:19.194330+0000 mgr.a (mgr.14373) 11599 : cluster [DBG] pgmap v8044: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:05:20.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:05:20 smithi157 bash[24585]: audit 2024-09-16T10:05:19.447738+0000 mgr.a (mgr.14373) 11600 : audit [DBG] from='client.254025 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:05:20.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:05:20 smithi086 bash[24289]: cluster 2024-09-16T10:05:19.194330+0000 mgr.a (mgr.14373) 11599 : cluster [DBG] pgmap v8044: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:05:20.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:05:20 smithi086 bash[24289]: audit 2024-09-16T10:05:19.447738+0000 mgr.a (mgr.14373) 11600 : audit [DBG] from='client.254025 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:05:20.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:05:20 smithi047 bash[22744]: cluster 2024-09-16T10:05:19.194330+0000 mgr.a (mgr.14373) 11599 : cluster [DBG] pgmap v8044: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:05:20.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:05:20 smithi047 bash[22744]: audit 2024-09-16T10:05:19.447738+0000 mgr.a (mgr.14373) 11600 : audit [DBG] from='client.254025 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:05:22.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:05:22 smithi086 bash[24289]: cluster 2024-09-16T10:05:21.195143+0000 mgr.a (mgr.14373) 11601 : cluster [DBG] pgmap v8045: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:05:22.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:05:22 smithi047 bash[22744]: cluster 2024-09-16T10:05:21.195143+0000 mgr.a (mgr.14373) 11601 : cluster [DBG] pgmap v8045: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:05:23.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:05:22 smithi157 bash[24585]: cluster 2024-09-16T10:05:21.195143+0000 mgr.a (mgr.14373) 11601 : cluster [DBG] pgmap v8045: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:05:24.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:05:24 smithi086 bash[24289]: cluster 2024-09-16T10:05:23.197398+0000 mgr.a (mgr.14373) 11602 : cluster [DBG] pgmap v8046: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:05:24.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:05:24 smithi047 bash[22744]: cluster 2024-09-16T10:05:23.197398+0000 mgr.a (mgr.14373) 11602 : cluster [DBG] pgmap v8046: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:05:24.890 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:05:24.891 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:05:24.891 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:05:25.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:05:24 smithi157 bash[24585]: cluster 2024-09-16T10:05:23.197398+0000 mgr.a (mgr.14373) 11602 : cluster [DBG] pgmap v8046: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:05:25.634 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:05:25.634 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:05:25.634 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:05:25.634 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:05:25.634 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:05:26.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:05:26 smithi047 bash[22744]: cluster 2024-09-16T10:05:25.197916+0000 mgr.a (mgr.14373) 11603 : cluster [DBG] pgmap v8047: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:05:26.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:05:26 smithi047 bash[22744]: audit 2024-09-16T10:05:25.223051+0000 mgr.a (mgr.14373) 11604 : audit [DBG] from='client.254103 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:05:27.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:05:26 smithi157 bash[24585]: cluster 2024-09-16T10:05:25.197916+0000 mgr.a (mgr.14373) 11603 : cluster [DBG] pgmap v8047: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:05:27.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:05:26 smithi157 bash[24585]: audit 2024-09-16T10:05:25.223051+0000 mgr.a (mgr.14373) 11604 : audit [DBG] from='client.254103 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:05:27.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:05:26 smithi086 bash[24289]: cluster 2024-09-16T10:05:25.197916+0000 mgr.a (mgr.14373) 11603 : cluster [DBG] pgmap v8047: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:05:27.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:05:26 smithi086 bash[24289]: audit 2024-09-16T10:05:25.223051+0000 mgr.a (mgr.14373) 11604 : audit [DBG] from='client.254103 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:05:28.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:05:28 smithi047 bash[22744]: cluster 2024-09-16T10:05:27.200192+0000 mgr.a (mgr.14373) 11605 : cluster [DBG] pgmap v8048: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:05:29.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:05:28 smithi157 bash[24585]: cluster 2024-09-16T10:05:27.200192+0000 mgr.a (mgr.14373) 11605 : cluster [DBG] pgmap v8048: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:05:29.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:05:28 smithi086 bash[24289]: cluster 2024-09-16T10:05:27.200192+0000 mgr.a (mgr.14373) 11605 : cluster [DBG] pgmap v8048: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:05:30.635 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:05:30.636 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:05:30.636 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:05:30.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:05:30 smithi047 bash[22744]: cluster 2024-09-16T10:05:29.200955+0000 mgr.a (mgr.14373) 11606 : cluster [DBG] pgmap v8049: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:05:31.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:05:30 smithi157 bash[24585]: cluster 2024-09-16T10:05:29.200955+0000 mgr.a (mgr.14373) 11606 : cluster [DBG] pgmap v8049: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:05:31.072 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:05:30 smithi086 bash[24289]: cluster 2024-09-16T10:05:29.200955+0000 mgr.a (mgr.14373) 11606 : cluster [DBG] pgmap v8049: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:05:31.396 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:05:31.396 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:05:31.396 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:05:31.396 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:05:31.396 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:05:31.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:05:31 smithi047 bash[22744]: audit 2024-09-16T10:05:30.968406+0000 mgr.a (mgr.14373) 11607 : audit [DBG] from='client.254181 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:05:32.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:05:31 smithi157 bash[24585]: audit 2024-09-16T10:05:30.968406+0000 mgr.a (mgr.14373) 11607 : audit [DBG] from='client.254181 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:05:32.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:05:31 smithi086 bash[24289]: audit 2024-09-16T10:05:30.968406+0000 mgr.a (mgr.14373) 11607 : audit [DBG] from='client.254181 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:05:32.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:05:32 smithi047 bash[22744]: cluster 2024-09-16T10:05:31.201747+0000 mgr.a (mgr.14373) 11608 : cluster [DBG] pgmap v8050: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:05:33.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:05:32 smithi157 bash[24585]: cluster 2024-09-16T10:05:31.201747+0000 mgr.a (mgr.14373) 11608 : cluster [DBG] pgmap v8050: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:05:33.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:05:32 smithi086 bash[24289]: cluster 2024-09-16T10:05:31.201747+0000 mgr.a (mgr.14373) 11608 : cluster [DBG] pgmap v8050: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:05:35.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:05:34 smithi157 bash[24585]: cluster 2024-09-16T10:05:33.204111+0000 mgr.a (mgr.14373) 11609 : cluster [DBG] pgmap v8051: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:05:35.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:05:34 smithi086 bash[24289]: cluster 2024-09-16T10:05:33.204111+0000 mgr.a (mgr.14373) 11609 : cluster [DBG] pgmap v8051: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:05:35.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:05:34 smithi047 bash[22744]: cluster 2024-09-16T10:05:33.204111+0000 mgr.a (mgr.14373) 11609 : cluster [DBG] pgmap v8051: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:05:36.400 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:05:36.400 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:05:36.400 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:05:37.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:05:36 smithi157 bash[24585]: cluster 2024-09-16T10:05:35.204902+0000 mgr.a (mgr.14373) 11610 : cluster [DBG] pgmap v8052: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:05:37.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:05:36 smithi086 bash[24289]: cluster 2024-09-16T10:05:35.204902+0000 mgr.a (mgr.14373) 11610 : cluster [DBG] pgmap v8052: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:05:37.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:05:36 smithi047 bash[22744]: cluster 2024-09-16T10:05:35.204902+0000 mgr.a (mgr.14373) 11610 : cluster [DBG] pgmap v8052: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:05:37.186 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:05:37.186 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:05:37.186 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:05:37.186 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:05:37.186 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:05:38.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:05:37 smithi157 bash[24585]: audit 2024-09-16T10:05:36.739196+0000 mgr.a (mgr.14373) 11611 : audit [DBG] from='client.254256 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:05:38.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:05:37 smithi086 bash[24289]: audit 2024-09-16T10:05:36.739196+0000 mgr.a (mgr.14373) 11611 : audit [DBG] from='client.254256 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:05:38.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:05:37 smithi047 bash[22744]: audit 2024-09-16T10:05:36.739196+0000 mgr.a (mgr.14373) 11611 : audit [DBG] from='client.254256 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:05:39.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:05:38 smithi157 bash[24585]: cluster 2024-09-16T10:05:37.206297+0000 mgr.a (mgr.14373) 11612 : cluster [DBG] pgmap v8053: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:05:39.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:05:38 smithi086 bash[24289]: cluster 2024-09-16T10:05:37.206297+0000 mgr.a (mgr.14373) 11612 : cluster [DBG] pgmap v8053: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:05:39.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:05:38 smithi047 bash[22744]: cluster 2024-09-16T10:05:37.206297+0000 mgr.a (mgr.14373) 11612 : cluster [DBG] pgmap v8053: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:05:41.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:05:40 smithi157 bash[24585]: cluster 2024-09-16T10:05:39.207020+0000 mgr.a (mgr.14373) 11613 : cluster [DBG] pgmap v8054: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T10:05:41.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:05:40 smithi086 bash[24289]: cluster 2024-09-16T10:05:39.207020+0000 mgr.a (mgr.14373) 11613 : cluster [DBG] pgmap v8054: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T10:05:41.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:05:40 smithi047 bash[22744]: cluster 2024-09-16T10:05:39.207020+0000 mgr.a (mgr.14373) 11613 : cluster [DBG] pgmap v8054: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T10:05:42.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:05:41 smithi157 bash[24585]: audit 2024-09-16T10:05:40.745022+0000 mon.b (mon.2) 1070 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T10:05:42.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:05:41 smithi157 bash[24585]: audit 2024-09-16T10:05:41.526214+0000 mon.a (mon.0) 1256 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:05:42.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:05:41 smithi157 bash[24585]: audit 2024-09-16T10:05:41.536019+0000 mon.a (mon.0) 1257 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:05:42.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:05:41 smithi086 bash[24289]: audit 2024-09-16T10:05:40.745022+0000 mon.b (mon.2) 1070 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T10:05:42.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:05:41 smithi086 bash[24289]: audit 2024-09-16T10:05:41.526214+0000 mon.a (mon.0) 1256 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:05:42.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:05:41 smithi086 bash[24289]: audit 2024-09-16T10:05:41.536019+0000 mon.a (mon.0) 1257 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:05:42.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:05:41 smithi047 bash[22744]: audit 2024-09-16T10:05:40.745022+0000 mon.b (mon.2) 1070 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T10:05:42.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:05:41 smithi047 bash[22744]: audit 2024-09-16T10:05:41.526214+0000 mon.a (mon.0) 1256 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:05:42.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:05:41 smithi047 bash[22744]: audit 2024-09-16T10:05:41.536019+0000 mon.a (mon.0) 1257 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:05:42.187 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:05:42.188 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:05:42.188 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:05:42.951 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:05:42 smithi047 bash[22744]: cluster 2024-09-16T10:05:41.207561+0000 mgr.a (mgr.14373) 11614 : cluster [DBG] pgmap v8055: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T10:05:42.951 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:05:42 smithi047 bash[22744]: audit 2024-09-16T10:05:42.190050+0000 mon.b (mon.2) 1071 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T10:05:42.951 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:05:42 smithi047 bash[22744]: audit 2024-09-16T10:05:42.191787+0000 mon.b (mon.2) 1072 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T10:05:42.951 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:05:42 smithi047 bash[22744]: audit 2024-09-16T10:05:42.199851+0000 mon.a (mon.0) 1258 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:05:42.952 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:05:42 smithi047 bash[22744]: audit 2024-09-16T10:05:42.204146+0000 mon.b (mon.2) 1073 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:05:43.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:05:42 smithi157 bash[24585]: cluster 2024-09-16T10:05:41.207561+0000 mgr.a (mgr.14373) 11614 : cluster [DBG] pgmap v8055: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T10:05:43.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:05:42 smithi157 bash[24585]: audit 2024-09-16T10:05:42.190050+0000 mon.b (mon.2) 1071 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T10:05:43.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:05:42 smithi157 bash[24585]: audit 2024-09-16T10:05:42.191787+0000 mon.b (mon.2) 1072 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T10:05:43.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:05:42 smithi157 bash[24585]: audit 2024-09-16T10:05:42.199851+0000 mon.a (mon.0) 1258 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:05:43.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:05:42 smithi157 bash[24585]: audit 2024-09-16T10:05:42.204146+0000 mon.b (mon.2) 1073 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:05:43.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:05:42 smithi086 bash[24289]: cluster 2024-09-16T10:05:41.207561+0000 mgr.a (mgr.14373) 11614 : cluster [DBG] pgmap v8055: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T10:05:43.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:05:42 smithi086 bash[24289]: audit 2024-09-16T10:05:42.190050+0000 mon.b (mon.2) 1071 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T10:05:43.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:05:42 smithi086 bash[24289]: audit 2024-09-16T10:05:42.191787+0000 mon.b (mon.2) 1072 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T10:05:43.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:05:42 smithi086 bash[24289]: audit 2024-09-16T10:05:42.199851+0000 mon.a (mon.0) 1258 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:05:43.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:05:42 smithi086 bash[24289]: audit 2024-09-16T10:05:42.204146+0000 mon.b (mon.2) 1073 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:05:43.342 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 10:05:42 smithi047 bash[22994]: debug 2024-09-16T10:05:42.947+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T10:05:43.342 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 10:05:42 smithi047 bash[22994]: debug 2024-09-16T10:05:42.955+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T10:05:43.349 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:05:43.349 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:05:43.349 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:05:43.349 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:05:43.349 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:05:44.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:05:43 smithi157 bash[24585]: audit 2024-09-16T10:05:42.206235+0000 mgr.a (mgr.14373) 11615 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:05:44.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:05:43 smithi157 bash[24585]: audit 2024-09-16T10:05:42.538492+0000 mgr.a (mgr.14373) 11616 : audit [DBG] from='client.254337 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:05:44.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:05:43 smithi157 bash[24585]: audit 2024-09-16T10:05:42.950380+0000 mgr.a (mgr.14373) 11617 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T10:05:44.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:05:43 smithi157 bash[24585]: cephadm 2024-09-16T10:05:42.962174+0000 mgr.a (mgr.14373) 11618 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T10:05:44.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:05:43 smithi086 bash[24289]: audit 2024-09-16T10:05:42.206235+0000 mgr.a (mgr.14373) 11615 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:05:44.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:05:43 smithi086 bash[24289]: audit 2024-09-16T10:05:42.538492+0000 mgr.a (mgr.14373) 11616 : audit [DBG] from='client.254337 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:05:44.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:05:43 smithi086 bash[24289]: audit 2024-09-16T10:05:42.950380+0000 mgr.a (mgr.14373) 11617 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T10:05:44.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:05:43 smithi086 bash[24289]: cephadm 2024-09-16T10:05:42.962174+0000 mgr.a (mgr.14373) 11618 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T10:05:44.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:05:43 smithi047 bash[22744]: audit 2024-09-16T10:05:42.206235+0000 mgr.a (mgr.14373) 11615 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:05:44.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:05:43 smithi047 bash[22744]: audit 2024-09-16T10:05:42.538492+0000 mgr.a (mgr.14373) 11616 : audit [DBG] from='client.254337 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:05:44.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:05:43 smithi047 bash[22744]: audit 2024-09-16T10:05:42.950380+0000 mgr.a (mgr.14373) 11617 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T10:05:44.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:05:43 smithi047 bash[22744]: cephadm 2024-09-16T10:05:42.962174+0000 mgr.a (mgr.14373) 11618 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T10:05:45.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:05:44 smithi157 bash[24585]: cluster 2024-09-16T10:05:43.208863+0000 mgr.a (mgr.14373) 11619 : cluster [DBG] pgmap v8056: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:05:45.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:05:44 smithi086 bash[24289]: cluster 2024-09-16T10:05:43.208863+0000 mgr.a (mgr.14373) 11619 : cluster [DBG] pgmap v8056: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:05:45.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:05:44 smithi047 bash[22744]: cluster 2024-09-16T10:05:43.208863+0000 mgr.a (mgr.14373) 11619 : cluster [DBG] pgmap v8056: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:05:47.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:05:46 smithi157 bash[24585]: cluster 2024-09-16T10:05:45.209714+0000 mgr.a (mgr.14373) 11620 : cluster [DBG] pgmap v8057: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T10:05:47.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:05:46 smithi086 bash[24289]: cluster 2024-09-16T10:05:45.209714+0000 mgr.a (mgr.14373) 11620 : cluster [DBG] pgmap v8057: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T10:05:47.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:05:46 smithi047 bash[22744]: cluster 2024-09-16T10:05:45.209714+0000 mgr.a (mgr.14373) 11620 : cluster [DBG] pgmap v8057: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T10:05:48.350 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:05:48.351 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:05:48.351 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:05:49.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:05:48 smithi157 bash[24585]: cluster 2024-09-16T10:05:47.211946+0000 mgr.a (mgr.14373) 11621 : cluster [DBG] pgmap v8058: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:05:49.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:05:48 smithi086 bash[24289]: cluster 2024-09-16T10:05:47.211946+0000 mgr.a (mgr.14373) 11621 : cluster [DBG] pgmap v8058: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:05:49.091 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:05:48 smithi047 bash[22744]: cluster 2024-09-16T10:05:47.211946+0000 mgr.a (mgr.14373) 11621 : cluster [DBG] pgmap v8058: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:05:49.105 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:05:49.105 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:05:49.106 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:05:49.106 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:05:49.106 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:05:50.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:05:49 smithi157 bash[24585]: audit 2024-09-16T10:05:48.678297+0000 mgr.a (mgr.14373) 11622 : audit [DBG] from='client.254517 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:05:50.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:05:49 smithi086 bash[24289]: audit 2024-09-16T10:05:48.678297+0000 mgr.a (mgr.14373) 11622 : audit [DBG] from='client.254517 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:05:50.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:05:49 smithi047 bash[22744]: audit 2024-09-16T10:05:48.678297+0000 mgr.a (mgr.14373) 11622 : audit [DBG] from='client.254517 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:05:51.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:05:50 smithi157 bash[24585]: cluster 2024-09-16T10:05:49.212467+0000 mgr.a (mgr.14373) 11623 : cluster [DBG] pgmap v8059: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:05:51.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:05:50 smithi086 bash[24289]: cluster 2024-09-16T10:05:49.212467+0000 mgr.a (mgr.14373) 11623 : cluster [DBG] pgmap v8059: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:05:51.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:05:50 smithi047 bash[22744]: cluster 2024-09-16T10:05:49.212467+0000 mgr.a (mgr.14373) 11623 : cluster [DBG] pgmap v8059: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:05:53.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:05:52 smithi157 bash[24585]: cluster 2024-09-16T10:05:51.213204+0000 mgr.a (mgr.14373) 11624 : cluster [DBG] pgmap v8060: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:05:53.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:05:52 smithi086 bash[24289]: cluster 2024-09-16T10:05:51.213204+0000 mgr.a (mgr.14373) 11624 : cluster [DBG] pgmap v8060: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:05:53.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:05:52 smithi047 bash[22744]: cluster 2024-09-16T10:05:51.213204+0000 mgr.a (mgr.14373) 11624 : cluster [DBG] pgmap v8060: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:05:54.107 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:05:54.108 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:05:54.108 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:05:54.854 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:05:54.854 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:05:54.854 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:05:54.854 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:05:54.854 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:05:55.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:05:54 smithi157 bash[24585]: cluster 2024-09-16T10:05:53.215415+0000 mgr.a (mgr.14373) 11625 : cluster [DBG] pgmap v8061: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:05:55.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:05:54 smithi086 bash[24289]: cluster 2024-09-16T10:05:53.215415+0000 mgr.a (mgr.14373) 11625 : cluster [DBG] pgmap v8061: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:05:55.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:05:54 smithi047 bash[22744]: cluster 2024-09-16T10:05:53.215415+0000 mgr.a (mgr.14373) 11625 : cluster [DBG] pgmap v8061: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:05:56.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:05:55 smithi157 bash[24585]: audit 2024-09-16T10:05:54.436535+0000 mgr.a (mgr.14373) 11626 : audit [DBG] from='client.254589 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:05:56.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:05:55 smithi086 bash[24289]: audit 2024-09-16T10:05:54.436535+0000 mgr.a (mgr.14373) 11626 : audit [DBG] from='client.254589 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:05:56.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:05:55 smithi047 bash[22744]: audit 2024-09-16T10:05:54.436535+0000 mgr.a (mgr.14373) 11626 : audit [DBG] from='client.254589 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:05:57.058 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:05:56 smithi157 bash[24585]: cluster 2024-09-16T10:05:55.216281+0000 mgr.a (mgr.14373) 11627 : cluster [DBG] pgmap v8062: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:05:57.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:05:56 smithi086 bash[24289]: cluster 2024-09-16T10:05:55.216281+0000 mgr.a (mgr.14373) 11627 : cluster [DBG] pgmap v8062: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:05:57.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:05:56 smithi047 bash[22744]: cluster 2024-09-16T10:05:55.216281+0000 mgr.a (mgr.14373) 11627 : cluster [DBG] pgmap v8062: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:05:59.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:05:58 smithi157 bash[24585]: cluster 2024-09-16T10:05:57.218547+0000 mgr.a (mgr.14373) 11628 : cluster [DBG] pgmap v8063: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:05:59.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:05:58 smithi086 bash[24289]: cluster 2024-09-16T10:05:57.218547+0000 mgr.a (mgr.14373) 11628 : cluster [DBG] pgmap v8063: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:05:59.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:05:58 smithi047 bash[22744]: cluster 2024-09-16T10:05:57.218547+0000 mgr.a (mgr.14373) 11628 : cluster [DBG] pgmap v8063: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:05:59.855 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:05:59.856 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:05:59.856 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:06:00.644 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:06:00.645 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:06:00.645 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:06:00.645 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:06:00.645 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:06:01.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:06:00 smithi157 bash[24585]: cluster 2024-09-16T10:05:59.219289+0000 mgr.a (mgr.14373) 11629 : cluster [DBG] pgmap v8064: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:06:01.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:06:00 smithi086 bash[24289]: cluster 2024-09-16T10:05:59.219289+0000 mgr.a (mgr.14373) 11629 : cluster [DBG] pgmap v8064: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:06:01.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:06:00 smithi047 bash[22744]: cluster 2024-09-16T10:05:59.219289+0000 mgr.a (mgr.14373) 11629 : cluster [DBG] pgmap v8064: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:06:02.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:06:01 smithi157 bash[24585]: audit 2024-09-16T10:06:00.193942+0000 mgr.a (mgr.14373) 11630 : audit [DBG] from='client.254667 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:06:02.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:06:01 smithi086 bash[24289]: audit 2024-09-16T10:06:00.193942+0000 mgr.a (mgr.14373) 11630 : audit [DBG] from='client.254667 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:06:02.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:06:01 smithi047 bash[22744]: audit 2024-09-16T10:06:00.193942+0000 mgr.a (mgr.14373) 11630 : audit [DBG] from='client.254667 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:06:03.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:06:02 smithi157 bash[24585]: cluster 2024-09-16T10:06:01.220189+0000 mgr.a (mgr.14373) 11631 : cluster [DBG] pgmap v8065: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:06:03.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:06:02 smithi086 bash[24289]: cluster 2024-09-16T10:06:01.220189+0000 mgr.a (mgr.14373) 11631 : cluster [DBG] pgmap v8065: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:06:03.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:06:02 smithi047 bash[22744]: cluster 2024-09-16T10:06:01.220189+0000 mgr.a (mgr.14373) 11631 : cluster [DBG] pgmap v8065: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:06:05.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:06:04 smithi157 bash[24585]: cluster 2024-09-16T10:06:03.222626+0000 mgr.a (mgr.14373) 11632 : cluster [DBG] pgmap v8066: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:06:05.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:06:04 smithi086 bash[24289]: cluster 2024-09-16T10:06:03.222626+0000 mgr.a (mgr.14373) 11632 : cluster [DBG] pgmap v8066: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:06:05.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:06:04 smithi047 bash[22744]: cluster 2024-09-16T10:06:03.222626+0000 mgr.a (mgr.14373) 11632 : cluster [DBG] pgmap v8066: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:06:05.646 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:06:05.647 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:06:05.647 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:06:06.406 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:06:06.407 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:06:06.407 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:06:06.407 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:06:06.407 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:06:07.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:06:06 smithi157 bash[24585]: cluster 2024-09-16T10:06:05.223389+0000 mgr.a (mgr.14373) 11633 : cluster [DBG] pgmap v8067: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:06:07.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:06:06 smithi157 bash[24585]: audit 2024-09-16T10:06:05.979062+0000 mgr.a (mgr.14373) 11634 : audit [DBG] from='client.254745 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:06:07.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:06:06 smithi086 bash[24289]: cluster 2024-09-16T10:06:05.223389+0000 mgr.a (mgr.14373) 11633 : cluster [DBG] pgmap v8067: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:06:07.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:06:06 smithi086 bash[24289]: audit 2024-09-16T10:06:05.979062+0000 mgr.a (mgr.14373) 11634 : audit [DBG] from='client.254745 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:06:07.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:06:06 smithi047 bash[22744]: cluster 2024-09-16T10:06:05.223389+0000 mgr.a (mgr.14373) 11633 : cluster [DBG] pgmap v8067: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:06:07.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:06:06 smithi047 bash[22744]: audit 2024-09-16T10:06:05.979062+0000 mgr.a (mgr.14373) 11634 : audit [DBG] from='client.254745 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:06:09.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:06:08 smithi157 bash[24585]: cluster 2024-09-16T10:06:07.225757+0000 mgr.a (mgr.14373) 11635 : cluster [DBG] pgmap v8068: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:06:09.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:06:08 smithi086 bash[24289]: cluster 2024-09-16T10:06:07.225757+0000 mgr.a (mgr.14373) 11635 : cluster [DBG] pgmap v8068: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:06:09.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:06:08 smithi047 bash[22744]: cluster 2024-09-16T10:06:07.225757+0000 mgr.a (mgr.14373) 11635 : cluster [DBG] pgmap v8068: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:06:11.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:06:10 smithi157 bash[24585]: cluster 2024-09-16T10:06:09.226523+0000 mgr.a (mgr.14373) 11636 : cluster [DBG] pgmap v8069: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:06:11.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:06:10 smithi086 bash[24289]: cluster 2024-09-16T10:06:09.226523+0000 mgr.a (mgr.14373) 11636 : cluster [DBG] pgmap v8069: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:06:11.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:06:10 smithi047 bash[22744]: cluster 2024-09-16T10:06:09.226523+0000 mgr.a (mgr.14373) 11636 : cluster [DBG] pgmap v8069: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:06:11.408 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:06:11.409 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:06:11.409 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:06:12.144 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:06:12.144 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:06:12.144 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:06:12.144 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:06:12.144 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:06:13.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:06:12 smithi157 bash[24585]: cluster 2024-09-16T10:06:11.227248+0000 mgr.a (mgr.14373) 11637 : cluster [DBG] pgmap v8070: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:06:13.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:06:12 smithi157 bash[24585]: audit 2024-09-16T10:06:11.733931+0000 mgr.a (mgr.14373) 11638 : audit [DBG] from='client.254823 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:06:13.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:06:12 smithi086 bash[24289]: cluster 2024-09-16T10:06:11.227248+0000 mgr.a (mgr.14373) 11637 : cluster [DBG] pgmap v8070: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:06:13.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:06:12 smithi086 bash[24289]: audit 2024-09-16T10:06:11.733931+0000 mgr.a (mgr.14373) 11638 : audit [DBG] from='client.254823 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:06:13.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:06:12 smithi047 bash[22744]: cluster 2024-09-16T10:06:11.227248+0000 mgr.a (mgr.14373) 11637 : cluster [DBG] pgmap v8070: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:06:13.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:06:12 smithi047 bash[22744]: audit 2024-09-16T10:06:11.733931+0000 mgr.a (mgr.14373) 11638 : audit [DBG] from='client.254823 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:06:15.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:06:14 smithi157 bash[24585]: cluster 2024-09-16T10:06:13.229875+0000 mgr.a (mgr.14373) 11639 : cluster [DBG] pgmap v8071: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:06:15.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:06:14 smithi086 bash[24289]: cluster 2024-09-16T10:06:13.229875+0000 mgr.a (mgr.14373) 11639 : cluster [DBG] pgmap v8071: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:06:15.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:06:14 smithi047 bash[22744]: cluster 2024-09-16T10:06:13.229875+0000 mgr.a (mgr.14373) 11639 : cluster [DBG] pgmap v8071: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:06:17.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:06:16 smithi157 bash[24585]: cluster 2024-09-16T10:06:15.230696+0000 mgr.a (mgr.14373) 11640 : cluster [DBG] pgmap v8072: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:06:17.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:06:16 smithi086 bash[24289]: cluster 2024-09-16T10:06:15.230696+0000 mgr.a (mgr.14373) 11640 : cluster [DBG] pgmap v8072: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:06:17.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:06:16 smithi047 bash[22744]: cluster 2024-09-16T10:06:15.230696+0000 mgr.a (mgr.14373) 11640 : cluster [DBG] pgmap v8072: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:06:17.145 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:06:17.146 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:06:17.146 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:06:17.927 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:06:17.927 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:06:17.927 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:06:17.927 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:06:17.927 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:06:19.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:06:18 smithi157 bash[24585]: cluster 2024-09-16T10:06:17.232833+0000 mgr.a (mgr.14373) 11641 : cluster [DBG] pgmap v8073: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:06:19.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:06:18 smithi157 bash[24585]: audit 2024-09-16T10:06:17.481775+0000 mgr.a (mgr.14373) 11642 : audit [DBG] from='client.254901 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:06:19.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:06:18 smithi086 bash[24289]: cluster 2024-09-16T10:06:17.232833+0000 mgr.a (mgr.14373) 11641 : cluster [DBG] pgmap v8073: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:06:19.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:06:18 smithi086 bash[24289]: audit 2024-09-16T10:06:17.481775+0000 mgr.a (mgr.14373) 11642 : audit [DBG] from='client.254901 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:06:19.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:06:18 smithi047 bash[22744]: cluster 2024-09-16T10:06:17.232833+0000 mgr.a (mgr.14373) 11641 : cluster [DBG] pgmap v8073: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:06:19.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:06:18 smithi047 bash[22744]: audit 2024-09-16T10:06:17.481775+0000 mgr.a (mgr.14373) 11642 : audit [DBG] from='client.254901 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:06:21.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:06:20 smithi157 bash[24585]: cluster 2024-09-16T10:06:19.233742+0000 mgr.a (mgr.14373) 11643 : cluster [DBG] pgmap v8074: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:06:21.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:06:20 smithi086 bash[24289]: cluster 2024-09-16T10:06:19.233742+0000 mgr.a (mgr.14373) 11643 : cluster [DBG] pgmap v8074: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:06:21.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:06:20 smithi047 bash[22744]: cluster 2024-09-16T10:06:19.233742+0000 mgr.a (mgr.14373) 11643 : cluster [DBG] pgmap v8074: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:06:22.928 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:06:22.929 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:06:22.929 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:06:23.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:06:22 smithi157 bash[24585]: cluster 2024-09-16T10:06:21.234531+0000 mgr.a (mgr.14373) 11644 : cluster [DBG] pgmap v8075: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T10:06:23.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:06:22 smithi086 bash[24289]: cluster 2024-09-16T10:06:21.234531+0000 mgr.a (mgr.14373) 11644 : cluster [DBG] pgmap v8075: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T10:06:23.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:06:22 smithi047 bash[22744]: cluster 2024-09-16T10:06:21.234531+0000 mgr.a (mgr.14373) 11644 : cluster [DBG] pgmap v8075: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T10:06:23.716 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:06:23.716 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:06:23.716 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:06:23.717 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:06:23.717 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:06:25.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:06:24 smithi157 bash[24585]: cluster 2024-09-16T10:06:23.236642+0000 mgr.a (mgr.14373) 11645 : cluster [DBG] pgmap v8076: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:06:25.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:06:24 smithi157 bash[24585]: audit 2024-09-16T10:06:23.260990+0000 mgr.a (mgr.14373) 11646 : audit [DBG] from='client.254976 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:06:25.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:06:24 smithi086 bash[24289]: cluster 2024-09-16T10:06:23.236642+0000 mgr.a (mgr.14373) 11645 : cluster [DBG] pgmap v8076: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:06:25.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:06:24 smithi086 bash[24289]: audit 2024-09-16T10:06:23.260990+0000 mgr.a (mgr.14373) 11646 : audit [DBG] from='client.254976 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:06:25.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:06:24 smithi047 bash[22744]: cluster 2024-09-16T10:06:23.236642+0000 mgr.a (mgr.14373) 11645 : cluster [DBG] pgmap v8076: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:06:25.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:06:24 smithi047 bash[22744]: audit 2024-09-16T10:06:23.260990+0000 mgr.a (mgr.14373) 11646 : audit [DBG] from='client.254976 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:06:27.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:06:26 smithi157 bash[24585]: cluster 2024-09-16T10:06:25.237592+0000 mgr.a (mgr.14373) 11647 : cluster [DBG] pgmap v8077: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:06:27.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:06:26 smithi086 bash[24289]: cluster 2024-09-16T10:06:25.237592+0000 mgr.a (mgr.14373) 11647 : cluster [DBG] pgmap v8077: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:06:27.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:06:26 smithi047 bash[22744]: cluster 2024-09-16T10:06:25.237592+0000 mgr.a (mgr.14373) 11647 : cluster [DBG] pgmap v8077: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:06:28.718 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:06:28.719 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:06:28.719 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:06:29.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:06:28 smithi157 bash[24585]: cluster 2024-09-16T10:06:27.239839+0000 mgr.a (mgr.14373) 11648 : cluster [DBG] pgmap v8078: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:06:29.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:06:28 smithi086 bash[24289]: cluster 2024-09-16T10:06:27.239839+0000 mgr.a (mgr.14373) 11648 : cluster [DBG] pgmap v8078: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:06:29.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:06:28 smithi047 bash[22744]: cluster 2024-09-16T10:06:27.239839+0000 mgr.a (mgr.14373) 11648 : cluster [DBG] pgmap v8078: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:06:29.507 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:06:29.508 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:06:29.508 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:06:29.508 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:06:29.508 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:06:31.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:06:30 smithi157 bash[24585]: audit 2024-09-16T10:06:29.052039+0000 mgr.a (mgr.14373) 11649 : audit [DBG] from='client.255054 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:06:31.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:06:30 smithi157 bash[24585]: cluster 2024-09-16T10:06:29.240425+0000 mgr.a (mgr.14373) 11650 : cluster [DBG] pgmap v8079: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:06:31.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:06:30 smithi086 bash[24289]: audit 2024-09-16T10:06:29.052039+0000 mgr.a (mgr.14373) 11649 : audit [DBG] from='client.255054 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:06:31.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:06:30 smithi086 bash[24289]: cluster 2024-09-16T10:06:29.240425+0000 mgr.a (mgr.14373) 11650 : cluster [DBG] pgmap v8079: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:06:31.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:06:30 smithi047 bash[22744]: audit 2024-09-16T10:06:29.052039+0000 mgr.a (mgr.14373) 11649 : audit [DBG] from='client.255054 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:06:31.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:06:30 smithi047 bash[22744]: cluster 2024-09-16T10:06:29.240425+0000 mgr.a (mgr.14373) 11650 : cluster [DBG] pgmap v8079: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:06:33.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:06:32 smithi157 bash[24585]: cluster 2024-09-16T10:06:31.241348+0000 mgr.a (mgr.14373) 11651 : cluster [DBG] pgmap v8080: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:06:33.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:06:32 smithi086 bash[24289]: cluster 2024-09-16T10:06:31.241348+0000 mgr.a (mgr.14373) 11651 : cluster [DBG] pgmap v8080: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:06:33.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:06:32 smithi047 bash[22744]: cluster 2024-09-16T10:06:31.241348+0000 mgr.a (mgr.14373) 11651 : cluster [DBG] pgmap v8080: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:06:34.509 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:06:34.510 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:06:34.510 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:06:35.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:06:34 smithi157 bash[24585]: cluster 2024-09-16T10:06:33.243625+0000 mgr.a (mgr.14373) 11652 : cluster [DBG] pgmap v8081: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:06:35.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:06:34 smithi086 bash[24289]: cluster 2024-09-16T10:06:33.243625+0000 mgr.a (mgr.14373) 11652 : cluster [DBG] pgmap v8081: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:06:35.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:06:34 smithi047 bash[22744]: cluster 2024-09-16T10:06:33.243625+0000 mgr.a (mgr.14373) 11652 : cluster [DBG] pgmap v8081: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:06:35.273 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:06:35.273 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:06:35.273 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:06:35.274 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:06:35.274 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:06:36.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:06:35 smithi157 bash[24585]: audit 2024-09-16T10:06:34.839898+0000 mgr.a (mgr.14373) 11653 : audit [DBG] from='client.255126 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:06:36.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:06:35 smithi086 bash[24289]: audit 2024-09-16T10:06:34.839898+0000 mgr.a (mgr.14373) 11653 : audit [DBG] from='client.255126 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:06:36.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:06:35 smithi047 bash[22744]: audit 2024-09-16T10:06:34.839898+0000 mgr.a (mgr.14373) 11653 : audit [DBG] from='client.255126 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:06:37.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:06:36 smithi157 bash[24585]: cluster 2024-09-16T10:06:35.244121+0000 mgr.a (mgr.14373) 11654 : cluster [DBG] pgmap v8082: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:06:37.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:06:36 smithi086 bash[24289]: cluster 2024-09-16T10:06:35.244121+0000 mgr.a (mgr.14373) 11654 : cluster [DBG] pgmap v8082: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:06:37.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:06:36 smithi047 bash[22744]: cluster 2024-09-16T10:06:35.244121+0000 mgr.a (mgr.14373) 11654 : cluster [DBG] pgmap v8082: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:06:39.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:06:38 smithi157 bash[24585]: cluster 2024-09-16T10:06:37.246290+0000 mgr.a (mgr.14373) 11655 : cluster [DBG] pgmap v8083: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:06:39.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:06:38 smithi086 bash[24289]: cluster 2024-09-16T10:06:37.246290+0000 mgr.a (mgr.14373) 11655 : cluster [DBG] pgmap v8083: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:06:39.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:06:38 smithi047 bash[22744]: cluster 2024-09-16T10:06:37.246290+0000 mgr.a (mgr.14373) 11655 : cluster [DBG] pgmap v8083: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:06:40.275 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:06:40.275 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:06:40.275 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:06:41.022 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:06:41.022 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:06:41.022 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:06:41.022 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:06:41.023 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:06:41.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:06:40 smithi157 bash[24585]: cluster 2024-09-16T10:06:39.247116+0000 mgr.a (mgr.14373) 11656 : cluster [DBG] pgmap v8084: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:06:41.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:06:40 smithi086 bash[24289]: cluster 2024-09-16T10:06:39.247116+0000 mgr.a (mgr.14373) 11656 : cluster [DBG] pgmap v8084: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:06:41.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:06:40 smithi047 bash[22744]: cluster 2024-09-16T10:06:39.247116+0000 mgr.a (mgr.14373) 11656 : cluster [DBG] pgmap v8084: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:06:42.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:06:41 smithi157 bash[24585]: audit 2024-09-16T10:06:40.605829+0000 mgr.a (mgr.14373) 11657 : audit [DBG] from='client.255201 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:06:42.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:06:41 smithi086 bash[24289]: audit 2024-09-16T10:06:40.605829+0000 mgr.a (mgr.14373) 11657 : audit [DBG] from='client.255201 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:06:42.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:06:41 smithi047 bash[22744]: audit 2024-09-16T10:06:40.605829+0000 mgr.a (mgr.14373) 11657 : audit [DBG] from='client.255201 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:06:43.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:06:42 smithi157 bash[24585]: cluster 2024-09-16T10:06:41.248093+0000 mgr.a (mgr.14373) 11658 : cluster [DBG] pgmap v8085: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:06:43.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:06:42 smithi086 bash[24289]: cluster 2024-09-16T10:06:41.248093+0000 mgr.a (mgr.14373) 11658 : cluster [DBG] pgmap v8085: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:06:43.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:06:42 smithi047 bash[22744]: cluster 2024-09-16T10:06:41.248093+0000 mgr.a (mgr.14373) 11658 : cluster [DBG] pgmap v8085: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:06:44.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:06:43 smithi157 bash[24585]: audit 2024-09-16T10:06:43.015440+0000 mon.b (mon.2) 1074 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T10:06:44.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:06:43 smithi157 bash[24585]: audit 2024-09-16T10:06:43.629638+0000 mon.a (mon.0) 1259 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:06:44.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:06:43 smithi157 bash[24585]: audit 2024-09-16T10:06:43.632888+0000 mon.a (mon.0) 1260 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:06:44.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:06:43 smithi157 bash[24585]: audit 2024-09-16T10:06:43.637086+0000 mon.a (mon.0) 1261 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:06:44.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:06:43 smithi157 bash[24585]: audit 2024-09-16T10:06:43.640102+0000 mon.a (mon.0) 1262 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:06:44.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:06:43 smithi086 bash[24289]: audit 2024-09-16T10:06:43.015440+0000 mon.b (mon.2) 1074 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T10:06:44.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:06:43 smithi086 bash[24289]: audit 2024-09-16T10:06:43.629638+0000 mon.a (mon.0) 1259 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:06:44.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:06:43 smithi086 bash[24289]: audit 2024-09-16T10:06:43.632888+0000 mon.a (mon.0) 1260 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:06:44.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:06:43 smithi086 bash[24289]: audit 2024-09-16T10:06:43.637086+0000 mon.a (mon.0) 1261 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:06:44.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:06:43 smithi086 bash[24289]: audit 2024-09-16T10:06:43.640102+0000 mon.a (mon.0) 1262 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:06:44.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:06:43 smithi047 bash[22744]: audit 2024-09-16T10:06:43.015440+0000 mon.b (mon.2) 1074 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T10:06:44.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:06:43 smithi047 bash[22744]: audit 2024-09-16T10:06:43.629638+0000 mon.a (mon.0) 1259 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:06:44.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:06:43 smithi047 bash[22744]: audit 2024-09-16T10:06:43.632888+0000 mon.a (mon.0) 1260 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:06:44.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:06:43 smithi047 bash[22744]: audit 2024-09-16T10:06:43.637086+0000 mon.a (mon.0) 1261 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:06:44.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:06:43 smithi047 bash[22744]: audit 2024-09-16T10:06:43.640102+0000 mon.a (mon.0) 1262 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:06:45.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:06:44 smithi157 bash[24585]: cluster 2024-09-16T10:06:43.250227+0000 mgr.a (mgr.14373) 11659 : cluster [DBG] pgmap v8086: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:06:45.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:06:44 smithi157 bash[24585]: audit 2024-09-16T10:06:44.393736+0000 mon.b (mon.2) 1075 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T10:06:45.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:06:44 smithi157 bash[24585]: audit 2024-09-16T10:06:44.395205+0000 mon.b (mon.2) 1076 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T10:06:45.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:06:44 smithi157 bash[24585]: audit 2024-09-16T10:06:44.405574+0000 mon.a (mon.0) 1263 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:06:45.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:06:44 smithi157 bash[24585]: audit 2024-09-16T10:06:44.410651+0000 mon.b (mon.2) 1077 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:06:45.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:06:44 smithi086 bash[24289]: cluster 2024-09-16T10:06:43.250227+0000 mgr.a (mgr.14373) 11659 : cluster [DBG] pgmap v8086: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:06:45.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:06:44 smithi086 bash[24289]: audit 2024-09-16T10:06:44.393736+0000 mon.b (mon.2) 1075 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T10:06:45.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:06:44 smithi086 bash[24289]: audit 2024-09-16T10:06:44.395205+0000 mon.b (mon.2) 1076 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T10:06:45.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:06:44 smithi086 bash[24289]: audit 2024-09-16T10:06:44.405574+0000 mon.a (mon.0) 1263 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:06:45.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:06:44 smithi086 bash[24289]: audit 2024-09-16T10:06:44.410651+0000 mon.b (mon.2) 1077 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:06:45.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:06:44 smithi047 bash[22744]: cluster 2024-09-16T10:06:43.250227+0000 mgr.a (mgr.14373) 11659 : cluster [DBG] pgmap v8086: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:06:45.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:06:44 smithi047 bash[22744]: audit 2024-09-16T10:06:44.393736+0000 mon.b (mon.2) 1075 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T10:06:45.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:06:44 smithi047 bash[22744]: audit 2024-09-16T10:06:44.395205+0000 mon.b (mon.2) 1076 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T10:06:45.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:06:44 smithi047 bash[22744]: audit 2024-09-16T10:06:44.405574+0000 mon.a (mon.0) 1263 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:06:45.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:06:44 smithi047 bash[22744]: audit 2024-09-16T10:06:44.410651+0000 mon.b (mon.2) 1077 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:06:45.592 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 10:06:45 smithi047 bash[22994]: debug 2024-09-16T10:06:45.157+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T10:06:45.592 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 10:06:45 smithi047 bash[22994]: debug 2024-09-16T10:06:45.161+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T10:06:46.023 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:06:46.024 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:06:46.024 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:06:46.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:06:45 smithi157 bash[24585]: audit 2024-09-16T10:06:44.413458+0000 mgr.a (mgr.14373) 11660 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:06:46.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:06:45 smithi086 bash[24289]: audit 2024-09-16T10:06:44.413458+0000 mgr.a (mgr.14373) 11660 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:06:46.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:06:45 smithi047 bash[22744]: audit 2024-09-16T10:06:44.413458+0000 mgr.a (mgr.14373) 11660 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:06:46.782 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:06:46.783 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:06:46.783 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:06:46.783 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:06:46.783 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:06:47.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:06:46 smithi157 bash[24585]: audit 2024-09-16T10:06:45.160796+0000 mgr.a (mgr.14373) 11661 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T10:06:47.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:06:46 smithi157 bash[24585]: cephadm 2024-09-16T10:06:45.162591+0000 mgr.a (mgr.14373) 11662 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T10:06:47.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:06:46 smithi157 bash[24585]: cluster 2024-09-16T10:06:45.251211+0000 mgr.a (mgr.14373) 11663 : cluster [DBG] pgmap v8087: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:06:47.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:06:46 smithi086 bash[24289]: audit 2024-09-16T10:06:45.160796+0000 mgr.a (mgr.14373) 11661 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T10:06:47.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:06:46 smithi086 bash[24289]: cephadm 2024-09-16T10:06:45.162591+0000 mgr.a (mgr.14373) 11662 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T10:06:47.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:06:46 smithi086 bash[24289]: cluster 2024-09-16T10:06:45.251211+0000 mgr.a (mgr.14373) 11663 : cluster [DBG] pgmap v8087: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:06:47.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:06:46 smithi047 bash[22744]: audit 2024-09-16T10:06:45.160796+0000 mgr.a (mgr.14373) 11661 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T10:06:47.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:06:46 smithi047 bash[22744]: cephadm 2024-09-16T10:06:45.162591+0000 mgr.a (mgr.14373) 11662 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T10:06:47.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:06:46 smithi047 bash[22744]: cluster 2024-09-16T10:06:45.251211+0000 mgr.a (mgr.14373) 11663 : cluster [DBG] pgmap v8087: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:06:48.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:06:47 smithi086 bash[24289]: audit 2024-09-16T10:06:46.352305+0000 mgr.a (mgr.14373) 11664 : audit [DBG] from='client.255381 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:06:48.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:06:47 smithi047 bash[22744]: audit 2024-09-16T10:06:46.352305+0000 mgr.a (mgr.14373) 11664 : audit [DBG] from='client.255381 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:06:48.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:06:47 smithi157 bash[24585]: audit 2024-09-16T10:06:46.352305+0000 mgr.a (mgr.14373) 11664 : audit [DBG] from='client.255381 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:06:49.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:06:48 smithi086 bash[24289]: cluster 2024-09-16T10:06:47.253996+0000 mgr.a (mgr.14373) 11665 : cluster [DBG] pgmap v8088: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:06:49.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:06:48 smithi047 bash[22744]: cluster 2024-09-16T10:06:47.253996+0000 mgr.a (mgr.14373) 11665 : cluster [DBG] pgmap v8088: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:06:49.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:06:48 smithi157 bash[24585]: cluster 2024-09-16T10:06:47.253996+0000 mgr.a (mgr.14373) 11665 : cluster [DBG] pgmap v8088: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:06:51.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:06:50 smithi086 bash[24289]: cluster 2024-09-16T10:06:49.254777+0000 mgr.a (mgr.14373) 11666 : cluster [DBG] pgmap v8089: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 6.2 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T10:06:51.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:06:50 smithi047 bash[22744]: cluster 2024-09-16T10:06:49.254777+0000 mgr.a (mgr.14373) 11666 : cluster [DBG] pgmap v8089: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 6.2 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T10:06:51.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:06:50 smithi157 bash[24585]: cluster 2024-09-16T10:06:49.254777+0000 mgr.a (mgr.14373) 11666 : cluster [DBG] pgmap v8089: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 6.2 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T10:06:51.784 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:06:51.784 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:06:51.785 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:06:52.532 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:06:52.532 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:06:52.532 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:06:52.533 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:06:52.533 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:06:53.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:06:52 smithi047 bash[22744]: cluster 2024-09-16T10:06:51.255520+0000 mgr.a (mgr.14373) 11667 : cluster [DBG] pgmap v8090: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 6.2 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T10:06:53.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:06:52 smithi157 bash[24585]: cluster 2024-09-16T10:06:51.255520+0000 mgr.a (mgr.14373) 11667 : cluster [DBG] pgmap v8090: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 6.2 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T10:06:53.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:06:52 smithi086 bash[24289]: cluster 2024-09-16T10:06:51.255520+0000 mgr.a (mgr.14373) 11667 : cluster [DBG] pgmap v8090: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 6.2 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T10:06:54.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:06:53 smithi047 bash[22744]: audit 2024-09-16T10:06:52.113948+0000 mgr.a (mgr.14373) 11668 : audit [DBG] from='client.255459 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:06:54.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:06:53 smithi157 bash[24585]: audit 2024-09-16T10:06:52.113948+0000 mgr.a (mgr.14373) 11668 : audit [DBG] from='client.255459 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:06:54.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:06:53 smithi086 bash[24289]: audit 2024-09-16T10:06:52.113948+0000 mgr.a (mgr.14373) 11668 : audit [DBG] from='client.255459 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:06:55.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:06:54 smithi047 bash[22744]: cluster 2024-09-16T10:06:53.258284+0000 mgr.a (mgr.14373) 11669 : cluster [DBG] pgmap v8091: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:06:55.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:06:54 smithi157 bash[24585]: cluster 2024-09-16T10:06:53.258284+0000 mgr.a (mgr.14373) 11669 : cluster [DBG] pgmap v8091: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:06:55.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:06:54 smithi086 bash[24289]: cluster 2024-09-16T10:06:53.258284+0000 mgr.a (mgr.14373) 11669 : cluster [DBG] pgmap v8091: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:06:56.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:06:56 smithi157 bash[24585]: cluster 2024-09-16T10:06:55.259113+0000 mgr.a (mgr.14373) 11670 : cluster [DBG] pgmap v8092: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T10:06:56.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:06:56 smithi086 bash[24289]: cluster 2024-09-16T10:06:55.259113+0000 mgr.a (mgr.14373) 11670 : cluster [DBG] pgmap v8092: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T10:06:56.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:06:56 smithi047 bash[22744]: cluster 2024-09-16T10:06:55.259113+0000 mgr.a (mgr.14373) 11670 : cluster [DBG] pgmap v8092: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T10:06:57.534 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:06:57.535 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:06:57.535 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:06:58.310 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:06:58.311 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:06:58.311 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:06:58.311 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:06:58.311 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:06:58.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:06:58 smithi086 bash[24289]: cluster 2024-09-16T10:06:57.261017+0000 mgr.a (mgr.14373) 11671 : cluster [DBG] pgmap v8093: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:06:58.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:06:58 smithi086 bash[24289]: audit 2024-09-16T10:06:57.868336+0000 mgr.a (mgr.14373) 11672 : audit [DBG] from='client.255531 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:06:58.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:06:58 smithi047 bash[22744]: cluster 2024-09-16T10:06:57.261017+0000 mgr.a (mgr.14373) 11671 : cluster [DBG] pgmap v8093: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:06:58.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:06:58 smithi047 bash[22744]: audit 2024-09-16T10:06:57.868336+0000 mgr.a (mgr.14373) 11672 : audit [DBG] from='client.255531 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:06:58.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:06:58 smithi157 bash[24585]: cluster 2024-09-16T10:06:57.261017+0000 mgr.a (mgr.14373) 11671 : cluster [DBG] pgmap v8093: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:06:58.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:06:58 smithi157 bash[24585]: audit 2024-09-16T10:06:57.868336+0000 mgr.a (mgr.14373) 11672 : audit [DBG] from='client.255531 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:07:00.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:07:00 smithi047 bash[22744]: cluster 2024-09-16T10:06:59.261985+0000 mgr.a (mgr.14373) 11673 : cluster [DBG] pgmap v8094: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-16T10:07:00.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:07:00 smithi157 bash[24585]: cluster 2024-09-16T10:06:59.261985+0000 mgr.a (mgr.14373) 11673 : cluster [DBG] pgmap v8094: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-16T10:07:00.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:07:00 smithi086 bash[24289]: cluster 2024-09-16T10:06:59.261985+0000 mgr.a (mgr.14373) 11673 : cluster [DBG] pgmap v8094: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-16T10:07:02.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:07:02 smithi047 bash[22744]: cluster 2024-09-16T10:07:01.262813+0000 mgr.a (mgr.14373) 11674 : cluster [DBG] pgmap v8095: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-16T10:07:02.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:07:02 smithi157 bash[24585]: cluster 2024-09-16T10:07:01.262813+0000 mgr.a (mgr.14373) 11674 : cluster [DBG] pgmap v8095: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-16T10:07:02.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:07:02 smithi086 bash[24289]: cluster 2024-09-16T10:07:01.262813+0000 mgr.a (mgr.14373) 11674 : cluster [DBG] pgmap v8095: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-16T10:07:03.312 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:07:03.313 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:07:03.313 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:07:04.073 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:07:04.074 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:07:04.074 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:07:04.074 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:07:04.074 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:07:04.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:07:04 smithi047 bash[22744]: cluster 2024-09-16T10:07:03.264958+0000 mgr.a (mgr.14373) 11675 : cluster [DBG] pgmap v8096: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-09-16T10:07:04.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:07:04 smithi047 bash[22744]: audit 2024-09-16T10:07:03.635502+0000 mgr.a (mgr.14373) 11676 : audit [DBG] from='client.255609 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:07:04.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:07:04 smithi157 bash[24585]: cluster 2024-09-16T10:07:03.264958+0000 mgr.a (mgr.14373) 11675 : cluster [DBG] pgmap v8096: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-09-16T10:07:04.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:07:04 smithi157 bash[24585]: audit 2024-09-16T10:07:03.635502+0000 mgr.a (mgr.14373) 11676 : audit [DBG] from='client.255609 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:07:04.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:07:04 smithi086 bash[24289]: cluster 2024-09-16T10:07:03.264958+0000 mgr.a (mgr.14373) 11675 : cluster [DBG] pgmap v8096: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-09-16T10:07:04.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:07:04 smithi086 bash[24289]: audit 2024-09-16T10:07:03.635502+0000 mgr.a (mgr.14373) 11676 : audit [DBG] from='client.255609 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:07:06.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:07:06 smithi047 bash[22744]: cluster 2024-09-16T10:07:05.265921+0000 mgr.a (mgr.14373) 11677 : cluster [DBG] pgmap v8097: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:07:06.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:07:06 smithi157 bash[24585]: cluster 2024-09-16T10:07:05.265921+0000 mgr.a (mgr.14373) 11677 : cluster [DBG] pgmap v8097: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:07:06.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:07:06 smithi086 bash[24289]: cluster 2024-09-16T10:07:05.265921+0000 mgr.a (mgr.14373) 11677 : cluster [DBG] pgmap v8097: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:07:08.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:07:08 smithi047 bash[22744]: cluster 2024-09-16T10:07:07.268133+0000 mgr.a (mgr.14373) 11678 : cluster [DBG] pgmap v8098: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:07:08.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:07:08 smithi157 bash[24585]: cluster 2024-09-16T10:07:07.268133+0000 mgr.a (mgr.14373) 11678 : cluster [DBG] pgmap v8098: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:07:08.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:07:08 smithi086 bash[24289]: cluster 2024-09-16T10:07:07.268133+0000 mgr.a (mgr.14373) 11678 : cluster [DBG] pgmap v8098: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:07:09.075 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:07:09.075 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:07:09.075 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:07:09.853 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:07:09.853 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:07:09.853 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:07:09.853 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:07:09.853 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:07:10.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:07:10 smithi157 bash[24585]: cluster 2024-09-16T10:07:09.268897+0000 mgr.a (mgr.14373) 11679 : cluster [DBG] pgmap v8099: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:07:10.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:07:10 smithi157 bash[24585]: audit 2024-09-16T10:07:09.407096+0000 mgr.a (mgr.14373) 11680 : audit [DBG] from='client.255687 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:07:10.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:07:10 smithi086 bash[24289]: cluster 2024-09-16T10:07:09.268897+0000 mgr.a (mgr.14373) 11679 : cluster [DBG] pgmap v8099: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:07:10.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:07:10 smithi086 bash[24289]: audit 2024-09-16T10:07:09.407096+0000 mgr.a (mgr.14373) 11680 : audit [DBG] from='client.255687 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:07:10.845 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:07:10 smithi047 bash[22744]: cluster 2024-09-16T10:07:09.268897+0000 mgr.a (mgr.14373) 11679 : cluster [DBG] pgmap v8099: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:07:10.845 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:07:10 smithi047 bash[22744]: audit 2024-09-16T10:07:09.407096+0000 mgr.a (mgr.14373) 11680 : audit [DBG] from='client.255687 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:07:12.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:07:12 smithi157 bash[24585]: cluster 2024-09-16T10:07:11.269824+0000 mgr.a (mgr.14373) 11681 : cluster [DBG] pgmap v8100: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:07:12.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:07:12 smithi086 bash[24289]: cluster 2024-09-16T10:07:11.269824+0000 mgr.a (mgr.14373) 11681 : cluster [DBG] pgmap v8100: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:07:12.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:07:12 smithi047 bash[22744]: cluster 2024-09-16T10:07:11.269824+0000 mgr.a (mgr.14373) 11681 : cluster [DBG] pgmap v8100: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:07:14.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:07:14 smithi157 bash[24585]: cluster 2024-09-16T10:07:13.272164+0000 mgr.a (mgr.14373) 11682 : cluster [DBG] pgmap v8101: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:07:14.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:07:14 smithi086 bash[24289]: cluster 2024-09-16T10:07:13.272164+0000 mgr.a (mgr.14373) 11682 : cluster [DBG] pgmap v8101: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:07:14.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:07:14 smithi047 bash[22744]: cluster 2024-09-16T10:07:13.272164+0000 mgr.a (mgr.14373) 11682 : cluster [DBG] pgmap v8101: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:07:14.854 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:07:14.855 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:07:14.855 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:07:15.636 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:07:15.636 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:07:15.636 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:07:15.636 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:07:15.636 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:07:16.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:07:16 smithi157 bash[24585]: audit 2024-09-16T10:07:15.185340+0000 mgr.a (mgr.14373) 11683 : audit [DBG] from='client.255765 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:07:16.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:07:16 smithi157 bash[24585]: cluster 2024-09-16T10:07:15.272838+0000 mgr.a (mgr.14373) 11684 : cluster [DBG] pgmap v8102: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:07:16.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:07:16 smithi086 bash[24289]: audit 2024-09-16T10:07:15.185340+0000 mgr.a (mgr.14373) 11683 : audit [DBG] from='client.255765 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:07:16.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:07:16 smithi086 bash[24289]: cluster 2024-09-16T10:07:15.272838+0000 mgr.a (mgr.14373) 11684 : cluster [DBG] pgmap v8102: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:07:16.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:07:16 smithi047 bash[22744]: audit 2024-09-16T10:07:15.185340+0000 mgr.a (mgr.14373) 11683 : audit [DBG] from='client.255765 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:07:16.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:07:16 smithi047 bash[22744]: cluster 2024-09-16T10:07:15.272838+0000 mgr.a (mgr.14373) 11684 : cluster [DBG] pgmap v8102: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:07:18.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:07:18 smithi157 bash[24585]: cluster 2024-09-16T10:07:17.275081+0000 mgr.a (mgr.14373) 11685 : cluster [DBG] pgmap v8103: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:07:18.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:07:18 smithi086 bash[24289]: cluster 2024-09-16T10:07:17.275081+0000 mgr.a (mgr.14373) 11685 : cluster [DBG] pgmap v8103: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:07:18.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:07:18 smithi047 bash[22744]: cluster 2024-09-16T10:07:17.275081+0000 mgr.a (mgr.14373) 11685 : cluster [DBG] pgmap v8103: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:07:20.638 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:07:20.638 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:07:20.638 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:07:20.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:07:20 smithi157 bash[24585]: cluster 2024-09-16T10:07:19.275857+0000 mgr.a (mgr.14373) 11686 : cluster [DBG] pgmap v8104: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:07:20.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:07:20 smithi086 bash[24289]: cluster 2024-09-16T10:07:19.275857+0000 mgr.a (mgr.14373) 11686 : cluster [DBG] pgmap v8104: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:07:20.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:07:20 smithi047 bash[22744]: cluster 2024-09-16T10:07:19.275857+0000 mgr.a (mgr.14373) 11686 : cluster [DBG] pgmap v8104: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:07:21.416 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:07:21.416 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:07:21.417 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:07:21.417 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:07:21.417 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:07:21.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:07:21 smithi157 bash[24585]: audit 2024-09-16T10:07:20.975780+0000 mgr.a (mgr.14373) 11687 : audit [DBG] from='client.255840 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:07:21.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:07:21 smithi086 bash[24289]: audit 2024-09-16T10:07:20.975780+0000 mgr.a (mgr.14373) 11687 : audit [DBG] from='client.255840 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:07:21.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:07:21 smithi047 bash[22744]: audit 2024-09-16T10:07:20.975780+0000 mgr.a (mgr.14373) 11687 : audit [DBG] from='client.255840 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:07:22.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:07:22 smithi157 bash[24585]: cluster 2024-09-16T10:07:21.276540+0000 mgr.a (mgr.14373) 11688 : cluster [DBG] pgmap v8105: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:07:22.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:07:22 smithi086 bash[24289]: cluster 2024-09-16T10:07:21.276540+0000 mgr.a (mgr.14373) 11688 : cluster [DBG] pgmap v8105: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:07:22.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:07:22 smithi047 bash[22744]: cluster 2024-09-16T10:07:21.276540+0000 mgr.a (mgr.14373) 11688 : cluster [DBG] pgmap v8105: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:07:24.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:07:24 smithi157 bash[24585]: cluster 2024-09-16T10:07:23.278894+0000 mgr.a (mgr.14373) 11689 : cluster [DBG] pgmap v8106: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:07:24.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:07:24 smithi086 bash[24289]: cluster 2024-09-16T10:07:23.278894+0000 mgr.a (mgr.14373) 11689 : cluster [DBG] pgmap v8106: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:07:24.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:07:24 smithi047 bash[22744]: cluster 2024-09-16T10:07:23.278894+0000 mgr.a (mgr.14373) 11689 : cluster [DBG] pgmap v8106: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:07:26.418 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:07:26.418 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:07:26.419 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:07:26.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:07:26 smithi157 bash[24585]: cluster 2024-09-16T10:07:25.279660+0000 mgr.a (mgr.14373) 11690 : cluster [DBG] pgmap v8107: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:07:26.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:07:26 smithi086 bash[24289]: cluster 2024-09-16T10:07:25.279660+0000 mgr.a (mgr.14373) 11690 : cluster [DBG] pgmap v8107: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:07:26.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:07:26 smithi047 bash[22744]: cluster 2024-09-16T10:07:25.279660+0000 mgr.a (mgr.14373) 11690 : cluster [DBG] pgmap v8107: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:07:27.169 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:07:27.169 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:07:27.169 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:07:27.169 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:07:27.170 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:07:27.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:07:27 smithi157 bash[24585]: audit 2024-09-16T10:07:26.753098+0000 mgr.a (mgr.14373) 11691 : audit [DBG] from='client.255918 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:07:27.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:07:27 smithi086 bash[24289]: audit 2024-09-16T10:07:26.753098+0000 mgr.a (mgr.14373) 11691 : audit [DBG] from='client.255918 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:07:27.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:07:27 smithi047 bash[22744]: audit 2024-09-16T10:07:26.753098+0000 mgr.a (mgr.14373) 11691 : audit [DBG] from='client.255918 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:07:28.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:07:28 smithi157 bash[24585]: cluster 2024-09-16T10:07:27.282430+0000 mgr.a (mgr.14373) 11692 : cluster [DBG] pgmap v8108: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:07:28.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:07:28 smithi086 bash[24289]: cluster 2024-09-16T10:07:27.282430+0000 mgr.a (mgr.14373) 11692 : cluster [DBG] pgmap v8108: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:07:28.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:07:28 smithi047 bash[22744]: cluster 2024-09-16T10:07:27.282430+0000 mgr.a (mgr.14373) 11692 : cluster [DBG] pgmap v8108: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:07:30.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:07:30 smithi157 bash[24585]: cluster 2024-09-16T10:07:29.283213+0000 mgr.a (mgr.14373) 11693 : cluster [DBG] pgmap v8109: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:07:30.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:07:30 smithi086 bash[24289]: cluster 2024-09-16T10:07:29.283213+0000 mgr.a (mgr.14373) 11693 : cluster [DBG] pgmap v8109: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:07:30.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:07:30 smithi047 bash[22744]: cluster 2024-09-16T10:07:29.283213+0000 mgr.a (mgr.14373) 11693 : cluster [DBG] pgmap v8109: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:07:32.171 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:07:32.171 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:07:32.171 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:07:32.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:07:32 smithi157 bash[24585]: cluster 2024-09-16T10:07:31.283969+0000 mgr.a (mgr.14373) 11694 : cluster [DBG] pgmap v8110: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T10:07:32.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:07:32 smithi086 bash[24289]: cluster 2024-09-16T10:07:31.283969+0000 mgr.a (mgr.14373) 11694 : cluster [DBG] pgmap v8110: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T10:07:32.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:07:32 smithi047 bash[22744]: cluster 2024-09-16T10:07:31.283969+0000 mgr.a (mgr.14373) 11694 : cluster [DBG] pgmap v8110: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T10:07:32.943 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:07:32.943 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:07:32.943 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:07:32.943 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:07:32.944 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:07:33.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:07:33 smithi157 bash[24585]: audit 2024-09-16T10:07:32.505267+0000 mgr.a (mgr.14373) 11695 : audit [DBG] from='client.255993 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:07:33.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:07:33 smithi086 bash[24289]: audit 2024-09-16T10:07:32.505267+0000 mgr.a (mgr.14373) 11695 : audit [DBG] from='client.255993 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:07:33.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:07:33 smithi047 bash[22744]: audit 2024-09-16T10:07:32.505267+0000 mgr.a (mgr.14373) 11695 : audit [DBG] from='client.255993 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:07:34.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:07:34 smithi157 bash[24585]: cluster 2024-09-16T10:07:33.286709+0000 mgr.a (mgr.14373) 11696 : cluster [DBG] pgmap v8111: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:07:34.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:07:34 smithi086 bash[24289]: cluster 2024-09-16T10:07:33.286709+0000 mgr.a (mgr.14373) 11696 : cluster [DBG] pgmap v8111: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:07:34.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:07:34 smithi047 bash[22744]: cluster 2024-09-16T10:07:33.286709+0000 mgr.a (mgr.14373) 11696 : cluster [DBG] pgmap v8111: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:07:36.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:07:36 smithi157 bash[24585]: cluster 2024-09-16T10:07:35.287488+0000 mgr.a (mgr.14373) 11697 : cluster [DBG] pgmap v8112: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:07:36.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:07:36 smithi086 bash[24289]: cluster 2024-09-16T10:07:35.287488+0000 mgr.a (mgr.14373) 11697 : cluster [DBG] pgmap v8112: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:07:36.845 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:07:36 smithi047 bash[22744]: cluster 2024-09-16T10:07:35.287488+0000 mgr.a (mgr.14373) 11697 : cluster [DBG] pgmap v8112: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:07:37.945 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:07:37.945 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:07:37.945 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:07:38.725 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:07:38.725 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:07:38.725 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:07:38.726 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:07:38.726 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:07:38.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:07:38 smithi157 bash[24585]: cluster 2024-09-16T10:07:37.289455+0000 mgr.a (mgr.14373) 11698 : cluster [DBG] pgmap v8113: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:07:38.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:07:38 smithi086 bash[24289]: cluster 2024-09-16T10:07:37.289455+0000 mgr.a (mgr.14373) 11698 : cluster [DBG] pgmap v8113: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:07:38.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:07:38 smithi047 bash[22744]: cluster 2024-09-16T10:07:37.289455+0000 mgr.a (mgr.14373) 11698 : cluster [DBG] pgmap v8113: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:07:39.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:07:39 smithi157 bash[24585]: audit 2024-09-16T10:07:38.278582+0000 mgr.a (mgr.14373) 11699 : audit [DBG] from='client.256071 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:07:39.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:07:39 smithi086 bash[24289]: audit 2024-09-16T10:07:38.278582+0000 mgr.a (mgr.14373) 11699 : audit [DBG] from='client.256071 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:07:39.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:07:39 smithi047 bash[22744]: audit 2024-09-16T10:07:38.278582+0000 mgr.a (mgr.14373) 11699 : audit [DBG] from='client.256071 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:07:40.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:07:40 smithi157 bash[24585]: cluster 2024-09-16T10:07:39.290428+0000 mgr.a (mgr.14373) 11700 : cluster [DBG] pgmap v8114: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:07:40.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:07:40 smithi086 bash[24289]: cluster 2024-09-16T10:07:39.290428+0000 mgr.a (mgr.14373) 11700 : cluster [DBG] pgmap v8114: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:07:40.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:07:40 smithi047 bash[22744]: cluster 2024-09-16T10:07:39.290428+0000 mgr.a (mgr.14373) 11700 : cluster [DBG] pgmap v8114: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:07:42.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:07:42 smithi157 bash[24585]: cluster 2024-09-16T10:07:41.291153+0000 mgr.a (mgr.14373) 11701 : cluster [DBG] pgmap v8115: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:07:42.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:07:42 smithi086 bash[24289]: cluster 2024-09-16T10:07:41.291153+0000 mgr.a (mgr.14373) 11701 : cluster [DBG] pgmap v8115: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:07:42.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:07:42 smithi047 bash[22744]: cluster 2024-09-16T10:07:41.291153+0000 mgr.a (mgr.14373) 11701 : cluster [DBG] pgmap v8115: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:07:43.727 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:07:43.727 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:07:43.727 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:07:44.493 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:07:44.493 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:07:44.493 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:07:44.493 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:07:44.493 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:07:44.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:07:44 smithi157 bash[24585]: cluster 2024-09-16T10:07:43.293294+0000 mgr.a (mgr.14373) 11702 : cluster [DBG] pgmap v8116: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:07:44.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:07:44 smithi157 bash[24585]: audit 2024-09-16T10:07:44.059985+0000 mgr.a (mgr.14373) 11703 : audit [DBG] from='client.256149 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:07:44.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:07:44 smithi086 bash[24289]: cluster 2024-09-16T10:07:43.293294+0000 mgr.a (mgr.14373) 11702 : cluster [DBG] pgmap v8116: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:07:44.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:07:44 smithi086 bash[24289]: audit 2024-09-16T10:07:44.059985+0000 mgr.a (mgr.14373) 11703 : audit [DBG] from='client.256149 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:07:44.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:07:44 smithi047 bash[22744]: cluster 2024-09-16T10:07:43.293294+0000 mgr.a (mgr.14373) 11702 : cluster [DBG] pgmap v8116: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:07:44.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:07:44 smithi047 bash[22744]: audit 2024-09-16T10:07:44.059985+0000 mgr.a (mgr.14373) 11703 : audit [DBG] from='client.256149 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:07:45.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:07:45 smithi157 bash[24585]: audit 2024-09-16T10:07:45.217860+0000 mon.b (mon.2) 1078 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T10:07:45.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:07:45 smithi086 bash[24289]: audit 2024-09-16T10:07:45.217860+0000 mon.b (mon.2) 1078 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T10:07:45.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:07:45 smithi047 bash[22744]: audit 2024-09-16T10:07:45.217860+0000 mon.b (mon.2) 1078 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T10:07:46.804 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:07:46 smithi047 bash[22744]: cluster 2024-09-16T10:07:45.294272+0000 mgr.a (mgr.14373) 11704 : cluster [DBG] pgmap v8117: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:07:46.805 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:07:46 smithi047 bash[22744]: audit 2024-09-16T10:07:46.051931+0000 mon.b (mon.2) 1079 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T10:07:46.805 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:07:46 smithi047 bash[22744]: audit 2024-09-16T10:07:46.053791+0000 mon.b (mon.2) 1080 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T10:07:46.805 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:07:46 smithi047 bash[22744]: audit 2024-09-16T10:07:46.062945+0000 mon.a (mon.0) 1264 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:07:46.805 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:07:46 smithi047 bash[22744]: audit 2024-09-16T10:07:46.070453+0000 mon.b (mon.2) 1081 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:07:46.805 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:07:46 smithi047 bash[22744]: audit 2024-09-16T10:07:46.073466+0000 mgr.a (mgr.14373) 11705 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:07:46.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:07:46 smithi157 bash[24585]: cluster 2024-09-16T10:07:45.294272+0000 mgr.a (mgr.14373) 11704 : cluster [DBG] pgmap v8117: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:07:46.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:07:46 smithi157 bash[24585]: audit 2024-09-16T10:07:46.051931+0000 mon.b (mon.2) 1079 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T10:07:46.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:07:46 smithi157 bash[24585]: audit 2024-09-16T10:07:46.053791+0000 mon.b (mon.2) 1080 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T10:07:46.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:07:46 smithi157 bash[24585]: audit 2024-09-16T10:07:46.062945+0000 mon.a (mon.0) 1264 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:07:46.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:07:46 smithi157 bash[24585]: audit 2024-09-16T10:07:46.070453+0000 mon.b (mon.2) 1081 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:07:46.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:07:46 smithi157 bash[24585]: audit 2024-09-16T10:07:46.073466+0000 mgr.a (mgr.14373) 11705 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:07:46.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:07:46 smithi086 bash[24289]: cluster 2024-09-16T10:07:45.294272+0000 mgr.a (mgr.14373) 11704 : cluster [DBG] pgmap v8117: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:07:46.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:07:46 smithi086 bash[24289]: audit 2024-09-16T10:07:46.051931+0000 mon.b (mon.2) 1079 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T10:07:46.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:07:46 smithi086 bash[24289]: audit 2024-09-16T10:07:46.053791+0000 mon.b (mon.2) 1080 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T10:07:46.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:07:46 smithi086 bash[24289]: audit 2024-09-16T10:07:46.062945+0000 mon.a (mon.0) 1264 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:07:46.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:07:46 smithi086 bash[24289]: audit 2024-09-16T10:07:46.070453+0000 mon.b (mon.2) 1081 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:07:46.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:07:46 smithi086 bash[24289]: audit 2024-09-16T10:07:46.073466+0000 mgr.a (mgr.14373) 11705 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:07:47.092 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 10:07:46 smithi047 bash[22994]: debug 2024-09-16T10:07:46.800+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T10:07:47.092 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 10:07:46 smithi047 bash[22994]: debug 2024-09-16T10:07:46.800+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T10:07:47.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:07:47 smithi157 bash[24585]: audit 2024-09-16T10:07:46.803645+0000 mgr.a (mgr.14373) 11706 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T10:07:47.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:07:47 smithi157 bash[24585]: cephadm 2024-09-16T10:07:46.806319+0000 mgr.a (mgr.14373) 11707 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T10:07:47.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:07:47 smithi086 bash[24289]: audit 2024-09-16T10:07:46.803645+0000 mgr.a (mgr.14373) 11706 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T10:07:47.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:07:47 smithi086 bash[24289]: cephadm 2024-09-16T10:07:46.806319+0000 mgr.a (mgr.14373) 11707 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T10:07:47.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:07:47 smithi047 bash[22744]: audit 2024-09-16T10:07:46.803645+0000 mgr.a (mgr.14373) 11706 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T10:07:47.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:07:47 smithi047 bash[22744]: cephadm 2024-09-16T10:07:46.806319+0000 mgr.a (mgr.14373) 11707 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T10:07:48.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:07:48 smithi157 bash[24585]: cluster 2024-09-16T10:07:47.297155+0000 mgr.a (mgr.14373) 11708 : cluster [DBG] pgmap v8118: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 4.3 KiB/s rd, 255 B/s wr, 4 op/s 2024-09-16T10:07:48.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:07:48 smithi086 bash[24289]: cluster 2024-09-16T10:07:47.297155+0000 mgr.a (mgr.14373) 11708 : cluster [DBG] pgmap v8118: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 4.3 KiB/s rd, 255 B/s wr, 4 op/s 2024-09-16T10:07:48.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:07:48 smithi047 bash[22744]: cluster 2024-09-16T10:07:47.297155+0000 mgr.a (mgr.14373) 11708 : cluster [DBG] pgmap v8118: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 4.3 KiB/s rd, 255 B/s wr, 4 op/s 2024-09-16T10:07:49.494 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:07:49.495 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:07:49.495 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:07:50.258 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:07:50.258 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:07:50.259 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:07:50.259 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:07:50.259 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:07:50.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:07:50 smithi157 bash[24585]: cluster 2024-09-16T10:07:49.298076+0000 mgr.a (mgr.14373) 11709 : cluster [DBG] pgmap v8119: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 3.4 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-16T10:07:50.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:07:50 smithi157 bash[24585]: audit 2024-09-16T10:07:49.820955+0000 mgr.a (mgr.14373) 11710 : audit [DBG] from='client.256332 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:07:50.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:07:50 smithi086 bash[24289]: cluster 2024-09-16T10:07:49.298076+0000 mgr.a (mgr.14373) 11709 : cluster [DBG] pgmap v8119: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 3.4 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-16T10:07:50.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:07:50 smithi086 bash[24289]: audit 2024-09-16T10:07:49.820955+0000 mgr.a (mgr.14373) 11710 : audit [DBG] from='client.256332 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:07:50.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:07:50 smithi047 bash[22744]: cluster 2024-09-16T10:07:49.298076+0000 mgr.a (mgr.14373) 11709 : cluster [DBG] pgmap v8119: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 3.4 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-16T10:07:50.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:07:50 smithi047 bash[22744]: audit 2024-09-16T10:07:49.820955+0000 mgr.a (mgr.14373) 11710 : audit [DBG] from='client.256332 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:07:52.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:07:52 smithi157 bash[24585]: cluster 2024-09-16T10:07:51.299045+0000 mgr.a (mgr.14373) 11711 : cluster [DBG] pgmap v8120: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 3.4 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-16T10:07:52.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:07:52 smithi086 bash[24289]: cluster 2024-09-16T10:07:51.299045+0000 mgr.a (mgr.14373) 11711 : cluster [DBG] pgmap v8120: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 3.4 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-16T10:07:52.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:07:52 smithi047 bash[22744]: cluster 2024-09-16T10:07:51.299045+0000 mgr.a (mgr.14373) 11711 : cluster [DBG] pgmap v8120: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 3.4 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-16T10:07:54.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:07:54 smithi157 bash[24585]: cluster 2024-09-16T10:07:53.301315+0000 mgr.a (mgr.14373) 11712 : cluster [DBG] pgmap v8121: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:07:54.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:07:54 smithi086 bash[24289]: cluster 2024-09-16T10:07:53.301315+0000 mgr.a (mgr.14373) 11712 : cluster [DBG] pgmap v8121: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:07:54.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:07:54 smithi047 bash[22744]: cluster 2024-09-16T10:07:53.301315+0000 mgr.a (mgr.14373) 11712 : cluster [DBG] pgmap v8121: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:07:55.260 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:07:55.261 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:07:55.261 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:07:56.012 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:07:56.012 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:07:56.012 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:07:56.012 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:07:56.012 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:07:56.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:07:56 smithi157 bash[24585]: cluster 2024-09-16T10:07:55.302089+0000 mgr.a (mgr.14373) 11713 : cluster [DBG] pgmap v8122: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:07:56.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:07:56 smithi157 bash[24585]: audit 2024-09-16T10:07:55.591199+0000 mgr.a (mgr.14373) 11714 : audit [DBG] from='client.256407 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:07:56.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:07:56 smithi086 bash[24289]: cluster 2024-09-16T10:07:55.302089+0000 mgr.a (mgr.14373) 11713 : cluster [DBG] pgmap v8122: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:07:56.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:07:56 smithi086 bash[24289]: audit 2024-09-16T10:07:55.591199+0000 mgr.a (mgr.14373) 11714 : audit [DBG] from='client.256407 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:07:56.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:07:56 smithi047 bash[22744]: cluster 2024-09-16T10:07:55.302089+0000 mgr.a (mgr.14373) 11713 : cluster [DBG] pgmap v8122: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:07:56.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:07:56 smithi047 bash[22744]: audit 2024-09-16T10:07:55.591199+0000 mgr.a (mgr.14373) 11714 : audit [DBG] from='client.256407 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:07:58.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:07:58 smithi157 bash[24585]: cluster 2024-09-16T10:07:57.304429+0000 mgr.a (mgr.14373) 11715 : cluster [DBG] pgmap v8123: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:07:58.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:07:58 smithi086 bash[24289]: cluster 2024-09-16T10:07:57.304429+0000 mgr.a (mgr.14373) 11715 : cluster [DBG] pgmap v8123: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:07:58.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:07:58 smithi047 bash[22744]: cluster 2024-09-16T10:07:57.304429+0000 mgr.a (mgr.14373) 11715 : cluster [DBG] pgmap v8123: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:08:00.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:08:00 smithi157 bash[24585]: cluster 2024-09-16T10:07:59.305185+0000 mgr.a (mgr.14373) 11716 : cluster [DBG] pgmap v8124: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 5.4 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-16T10:08:00.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:08:00 smithi086 bash[24289]: cluster 2024-09-16T10:07:59.305185+0000 mgr.a (mgr.14373) 11716 : cluster [DBG] pgmap v8124: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 5.4 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-16T10:08:00.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:08:00 smithi047 bash[22744]: cluster 2024-09-16T10:07:59.305185+0000 mgr.a (mgr.14373) 11716 : cluster [DBG] pgmap v8124: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 5.4 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-16T10:08:01.017 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:08:01.017 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:08:01.017 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:08:01.763 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:08:01.763 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:08:01.763 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:08:01.763 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:08:01.763 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:08:02.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:08:02 smithi157 bash[24585]: cluster 2024-09-16T10:08:01.305900+0000 mgr.a (mgr.14373) 11717 : cluster [DBG] pgmap v8125: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 5.4 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-16T10:08:02.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:08:02 smithi157 bash[24585]: audit 2024-09-16T10:08:01.343176+0000 mgr.a (mgr.14373) 11718 : audit [DBG] from='client.256485 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:08:02.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:08:02 smithi086 bash[24289]: cluster 2024-09-16T10:08:01.305900+0000 mgr.a (mgr.14373) 11717 : cluster [DBG] pgmap v8125: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 5.4 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-16T10:08:02.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:08:02 smithi086 bash[24289]: audit 2024-09-16T10:08:01.343176+0000 mgr.a (mgr.14373) 11718 : audit [DBG] from='client.256485 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:08:02.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:08:02 smithi047 bash[22744]: cluster 2024-09-16T10:08:01.305900+0000 mgr.a (mgr.14373) 11717 : cluster [DBG] pgmap v8125: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 5.4 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-16T10:08:02.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:08:02 smithi047 bash[22744]: audit 2024-09-16T10:08:01.343176+0000 mgr.a (mgr.14373) 11718 : audit [DBG] from='client.256485 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:08:04.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:08:04 smithi157 bash[24585]: cluster 2024-09-16T10:08:03.308534+0000 mgr.a (mgr.14373) 11719 : cluster [DBG] pgmap v8126: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 5.5 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-16T10:08:04.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:08:04 smithi086 bash[24289]: cluster 2024-09-16T10:08:03.308534+0000 mgr.a (mgr.14373) 11719 : cluster [DBG] pgmap v8126: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 5.5 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-16T10:08:04.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:08:04 smithi047 bash[22744]: cluster 2024-09-16T10:08:03.308534+0000 mgr.a (mgr.14373) 11719 : cluster [DBG] pgmap v8126: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 5.5 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-16T10:08:06.765 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:08:06.765 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:08:06.766 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:08:06.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:08:06 smithi157 bash[24585]: cluster 2024-09-16T10:08:05.309484+0000 mgr.a (mgr.14373) 11720 : cluster [DBG] pgmap v8127: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-16T10:08:06.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:08:06 smithi086 bash[24289]: cluster 2024-09-16T10:08:05.309484+0000 mgr.a (mgr.14373) 11720 : cluster [DBG] pgmap v8127: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-16T10:08:06.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:08:06 smithi047 bash[22744]: cluster 2024-09-16T10:08:05.309484+0000 mgr.a (mgr.14373) 11720 : cluster [DBG] pgmap v8127: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-16T10:08:07.517 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:08:07.517 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:08:07.517 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:08:07.517 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:08:07.517 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:08:08.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:08:08 smithi157 bash[24585]: audit 2024-09-16T10:08:07.098144+0000 mgr.a (mgr.14373) 11721 : audit [DBG] from='client.256560 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:08:08.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:08:08 smithi157 bash[24585]: cluster 2024-09-16T10:08:07.310805+0000 mgr.a (mgr.14373) 11722 : cluster [DBG] pgmap v8128: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-16T10:08:08.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:08:08 smithi086 bash[24289]: audit 2024-09-16T10:08:07.098144+0000 mgr.a (mgr.14373) 11721 : audit [DBG] from='client.256560 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:08:08.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:08:08 smithi086 bash[24289]: cluster 2024-09-16T10:08:07.310805+0000 mgr.a (mgr.14373) 11722 : cluster [DBG] pgmap v8128: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-16T10:08:08.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:08:08 smithi047 bash[22744]: audit 2024-09-16T10:08:07.098144+0000 mgr.a (mgr.14373) 11721 : audit [DBG] from='client.256560 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:08:08.844 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:08:08 smithi047 bash[22744]: cluster 2024-09-16T10:08:07.310805+0000 mgr.a (mgr.14373) 11722 : cluster [DBG] pgmap v8128: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-16T10:08:10.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:08:10 smithi157 bash[24585]: cluster 2024-09-16T10:08:09.311682+0000 mgr.a (mgr.14373) 11723 : cluster [DBG] pgmap v8129: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 4.9 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-16T10:08:10.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:08:10 smithi086 bash[24289]: cluster 2024-09-16T10:08:09.311682+0000 mgr.a (mgr.14373) 11723 : cluster [DBG] pgmap v8129: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 4.9 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-16T10:08:10.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:08:10 smithi047 bash[22744]: cluster 2024-09-16T10:08:09.311682+0000 mgr.a (mgr.14373) 11723 : cluster [DBG] pgmap v8129: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 4.9 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-16T10:08:12.518 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:08:12.519 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:08:12.519 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:08:12.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:08:12 smithi157 bash[24585]: cluster 2024-09-16T10:08:11.312530+0000 mgr.a (mgr.14373) 11724 : cluster [DBG] pgmap v8130: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 4.9 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-16T10:08:12.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:08:12 smithi086 bash[24289]: cluster 2024-09-16T10:08:11.312530+0000 mgr.a (mgr.14373) 11724 : cluster [DBG] pgmap v8130: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 4.9 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-16T10:08:12.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:08:12 smithi047 bash[22744]: cluster 2024-09-16T10:08:11.312530+0000 mgr.a (mgr.14373) 11724 : cluster [DBG] pgmap v8130: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 4.9 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-16T10:08:13.273 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:08:13.274 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:08:13.274 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:08:13.274 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:08:13.274 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:08:13.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:08:13 smithi157 bash[24585]: audit 2024-09-16T10:08:12.853067+0000 mgr.a (mgr.14373) 11725 : audit [DBG] from='client.256635 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:08:13.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:08:13 smithi086 bash[24289]: audit 2024-09-16T10:08:12.853067+0000 mgr.a (mgr.14373) 11725 : audit [DBG] from='client.256635 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:08:13.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:08:13 smithi047 bash[22744]: audit 2024-09-16T10:08:12.853067+0000 mgr.a (mgr.14373) 11725 : audit [DBG] from='client.256635 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:08:14.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:08:14 smithi157 bash[24585]: cluster 2024-09-16T10:08:13.313890+0000 mgr.a (mgr.14373) 11726 : cluster [DBG] pgmap v8131: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-16T10:08:14.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:08:14 smithi086 bash[24289]: cluster 2024-09-16T10:08:13.313890+0000 mgr.a (mgr.14373) 11726 : cluster [DBG] pgmap v8131: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-16T10:08:14.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:08:14 smithi047 bash[22744]: cluster 2024-09-16T10:08:13.313890+0000 mgr.a (mgr.14373) 11726 : cluster [DBG] pgmap v8131: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-16T10:08:16.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:08:16 smithi157 bash[24585]: cluster 2024-09-16T10:08:15.314659+0000 mgr.a (mgr.14373) 11727 : cluster [DBG] pgmap v8132: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 5.7 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-16T10:08:16.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:08:16 smithi086 bash[24289]: cluster 2024-09-16T10:08:15.314659+0000 mgr.a (mgr.14373) 11727 : cluster [DBG] pgmap v8132: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 5.7 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-16T10:08:16.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:08:16 smithi047 bash[22744]: cluster 2024-09-16T10:08:15.314659+0000 mgr.a (mgr.14373) 11727 : cluster [DBG] pgmap v8132: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 5.7 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-16T10:08:18.275 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:08:18.275 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:08:18.276 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:08:18.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:08:18 smithi157 bash[24585]: cluster 2024-09-16T10:08:17.316620+0000 mgr.a (mgr.14373) 11728 : cluster [DBG] pgmap v8133: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-16T10:08:18.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:08:18 smithi086 bash[24289]: cluster 2024-09-16T10:08:17.316620+0000 mgr.a (mgr.14373) 11728 : cluster [DBG] pgmap v8133: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-16T10:08:18.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:08:18 smithi047 bash[22744]: cluster 2024-09-16T10:08:17.316620+0000 mgr.a (mgr.14373) 11728 : cluster [DBG] pgmap v8133: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-16T10:08:19.058 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:08:19.058 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:08:19.058 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:08:19.058 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:08:19.058 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:08:19.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:08:19 smithi157 bash[24585]: audit 2024-09-16T10:08:18.611930+0000 mgr.a (mgr.14373) 11729 : audit [DBG] from='client.256710 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:08:19.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:08:19 smithi086 bash[24289]: audit 2024-09-16T10:08:18.611930+0000 mgr.a (mgr.14373) 11729 : audit [DBG] from='client.256710 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:08:19.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:08:19 smithi047 bash[22744]: audit 2024-09-16T10:08:18.611930+0000 mgr.a (mgr.14373) 11729 : audit [DBG] from='client.256710 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:08:20.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:08:20 smithi157 bash[24585]: cluster 2024-09-16T10:08:19.317573+0000 mgr.a (mgr.14373) 11730 : cluster [DBG] pgmap v8134: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:08:20.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:08:20 smithi086 bash[24289]: cluster 2024-09-16T10:08:19.317573+0000 mgr.a (mgr.14373) 11730 : cluster [DBG] pgmap v8134: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:08:20.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:08:20 smithi047 bash[22744]: cluster 2024-09-16T10:08:19.317573+0000 mgr.a (mgr.14373) 11730 : cluster [DBG] pgmap v8134: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:08:22.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:08:22 smithi157 bash[24585]: cluster 2024-09-16T10:08:21.318339+0000 mgr.a (mgr.14373) 11731 : cluster [DBG] pgmap v8135: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:08:22.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:08:22 smithi086 bash[24289]: cluster 2024-09-16T10:08:21.318339+0000 mgr.a (mgr.14373) 11731 : cluster [DBG] pgmap v8135: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:08:22.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:08:22 smithi047 bash[22744]: cluster 2024-09-16T10:08:21.318339+0000 mgr.a (mgr.14373) 11731 : cluster [DBG] pgmap v8135: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:08:24.059 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:08:24.060 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:08:24.060 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:08:24.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:08:24 smithi157 bash[24585]: cluster 2024-09-16T10:08:23.320630+0000 mgr.a (mgr.14373) 11732 : cluster [DBG] pgmap v8136: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:08:24.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:08:24 smithi086 bash[24289]: cluster 2024-09-16T10:08:23.320630+0000 mgr.a (mgr.14373) 11732 : cluster [DBG] pgmap v8136: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:08:24.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:08:24 smithi047 bash[22744]: cluster 2024-09-16T10:08:23.320630+0000 mgr.a (mgr.14373) 11732 : cluster [DBG] pgmap v8136: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:08:24.913 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:08:24.914 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:08:24.914 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:08:24.914 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:08:24.914 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:08:25.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:08:25 smithi086 bash[24289]: audit 2024-09-16T10:08:24.439905+0000 mgr.a (mgr.14373) 11733 : audit [DBG] from='client.256788 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:08:25.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:08:25 smithi047 bash[22744]: audit 2024-09-16T10:08:24.439905+0000 mgr.a (mgr.14373) 11733 : audit [DBG] from='client.256788 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:08:26.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:08:25 smithi157 bash[24585]: audit 2024-09-16T10:08:24.439905+0000 mgr.a (mgr.14373) 11733 : audit [DBG] from='client.256788 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:08:26.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:08:26 smithi086 bash[24289]: cluster 2024-09-16T10:08:25.321626+0000 mgr.a (mgr.14373) 11734 : cluster [DBG] pgmap v8137: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:08:26.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:08:26 smithi047 bash[22744]: cluster 2024-09-16T10:08:25.321626+0000 mgr.a (mgr.14373) 11734 : cluster [DBG] pgmap v8137: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:08:27.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:08:26 smithi157 bash[24585]: cluster 2024-09-16T10:08:25.321626+0000 mgr.a (mgr.14373) 11734 : cluster [DBG] pgmap v8137: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:08:28.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:08:28 smithi086 bash[24289]: cluster 2024-09-16T10:08:27.323904+0000 mgr.a (mgr.14373) 11735 : cluster [DBG] pgmap v8138: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 66 KiB/s rd, 0 B/s wr, 108 op/s 2024-09-16T10:08:28.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:08:28 smithi047 bash[22744]: cluster 2024-09-16T10:08:27.323904+0000 mgr.a (mgr.14373) 11735 : cluster [DBG] pgmap v8138: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 66 KiB/s rd, 0 B/s wr, 108 op/s 2024-09-16T10:08:29.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:08:28 smithi157 bash[24585]: cluster 2024-09-16T10:08:27.323904+0000 mgr.a (mgr.14373) 11735 : cluster [DBG] pgmap v8138: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 66 KiB/s rd, 0 B/s wr, 108 op/s 2024-09-16T10:08:29.915 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:08:29.915 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:08:29.916 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:08:30.689 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:08:30.690 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:08:30.690 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:08:30.690 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:08:30.690 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:08:30.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:08:30 smithi086 bash[24289]: cluster 2024-09-16T10:08:29.324672+0000 mgr.a (mgr.14373) 11736 : cluster [DBG] pgmap v8139: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 65 KiB/s rd, 0 B/s wr, 107 op/s 2024-09-16T10:08:30.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:08:30 smithi047 bash[22744]: cluster 2024-09-16T10:08:29.324672+0000 mgr.a (mgr.14373) 11736 : cluster [DBG] pgmap v8139: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 65 KiB/s rd, 0 B/s wr, 107 op/s 2024-09-16T10:08:31.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:08:30 smithi157 bash[24585]: cluster 2024-09-16T10:08:29.324672+0000 mgr.a (mgr.14373) 11736 : cluster [DBG] pgmap v8139: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 65 KiB/s rd, 0 B/s wr, 107 op/s 2024-09-16T10:08:31.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:08:31 smithi047 bash[22744]: audit 2024-09-16T10:08:30.248031+0000 mgr.a (mgr.14373) 11737 : audit [DBG] from='client.256866 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:08:32.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:08:31 smithi157 bash[24585]: audit 2024-09-16T10:08:30.248031+0000 mgr.a (mgr.14373) 11737 : audit [DBG] from='client.256866 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:08:32.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:08:31 smithi086 bash[24289]: audit 2024-09-16T10:08:30.248031+0000 mgr.a (mgr.14373) 11737 : audit [DBG] from='client.256866 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:08:32.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:08:32 smithi047 bash[22744]: cluster 2024-09-16T10:08:31.325783+0000 mgr.a (mgr.14373) 11738 : cluster [DBG] pgmap v8140: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 65 KiB/s rd, 0 B/s wr, 107 op/s 2024-09-16T10:08:33.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:08:32 smithi157 bash[24585]: cluster 2024-09-16T10:08:31.325783+0000 mgr.a (mgr.14373) 11738 : cluster [DBG] pgmap v8140: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 65 KiB/s rd, 0 B/s wr, 107 op/s 2024-09-16T10:08:33.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:08:32 smithi086 bash[24289]: cluster 2024-09-16T10:08:31.325783+0000 mgr.a (mgr.14373) 11738 : cluster [DBG] pgmap v8140: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 65 KiB/s rd, 0 B/s wr, 107 op/s 2024-09-16T10:08:34.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:08:34 smithi047 bash[22744]: cluster 2024-09-16T10:08:33.328095+0000 mgr.a (mgr.14373) 11739 : cluster [DBG] pgmap v8141: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 66 KiB/s rd, 0 B/s wr, 108 op/s 2024-09-16T10:08:35.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:08:34 smithi157 bash[24585]: cluster 2024-09-16T10:08:33.328095+0000 mgr.a (mgr.14373) 11739 : cluster [DBG] pgmap v8141: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 66 KiB/s rd, 0 B/s wr, 108 op/s 2024-09-16T10:08:35.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:08:34 smithi086 bash[24289]: cluster 2024-09-16T10:08:33.328095+0000 mgr.a (mgr.14373) 11739 : cluster [DBG] pgmap v8141: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 66 KiB/s rd, 0 B/s wr, 108 op/s 2024-09-16T10:08:35.691 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:08:35.692 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:08:35.692 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:08:36.469 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:08:36.469 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:08:36.469 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:08:36.469 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:08:36.469 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:08:36.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:08:36 smithi047 bash[22744]: cluster 2024-09-16T10:08:35.328911+0000 mgr.a (mgr.14373) 11740 : cluster [DBG] pgmap v8142: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 65 KiB/s rd, 0 B/s wr, 107 op/s 2024-09-16T10:08:36.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:08:36 smithi047 bash[22744]: audit 2024-09-16T10:08:36.026315+0000 mgr.a (mgr.14373) 11741 : audit [DBG] from='client.256941 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:08:37.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:08:36 smithi157 bash[24585]: cluster 2024-09-16T10:08:35.328911+0000 mgr.a (mgr.14373) 11740 : cluster [DBG] pgmap v8142: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 65 KiB/s rd, 0 B/s wr, 107 op/s 2024-09-16T10:08:37.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:08:36 smithi157 bash[24585]: audit 2024-09-16T10:08:36.026315+0000 mgr.a (mgr.14373) 11741 : audit [DBG] from='client.256941 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:08:37.072 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:08:36 smithi086 bash[24289]: cluster 2024-09-16T10:08:35.328911+0000 mgr.a (mgr.14373) 11740 : cluster [DBG] pgmap v8142: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 65 KiB/s rd, 0 B/s wr, 107 op/s 2024-09-16T10:08:37.072 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:08:36 smithi086 bash[24289]: audit 2024-09-16T10:08:36.026315+0000 mgr.a (mgr.14373) 11741 : audit [DBG] from='client.256941 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:08:38.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:08:38 smithi047 bash[22744]: cluster 2024-09-16T10:08:37.331290+0000 mgr.a (mgr.14373) 11742 : cluster [DBG] pgmap v8143: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 66 KiB/s rd, 0 B/s wr, 107 op/s 2024-09-16T10:08:39.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:08:38 smithi157 bash[24585]: cluster 2024-09-16T10:08:37.331290+0000 mgr.a (mgr.14373) 11742 : cluster [DBG] pgmap v8143: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 66 KiB/s rd, 0 B/s wr, 107 op/s 2024-09-16T10:08:39.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:08:38 smithi086 bash[24289]: cluster 2024-09-16T10:08:37.331290+0000 mgr.a (mgr.14373) 11742 : cluster [DBG] pgmap v8143: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 66 KiB/s rd, 0 B/s wr, 107 op/s 2024-09-16T10:08:41.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:08:40 smithi157 bash[24585]: cluster 2024-09-16T10:08:39.332086+0000 mgr.a (mgr.14373) 11743 : cluster [DBG] pgmap v8144: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T10:08:41.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:08:40 smithi086 bash[24289]: cluster 2024-09-16T10:08:39.332086+0000 mgr.a (mgr.14373) 11743 : cluster [DBG] pgmap v8144: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T10:08:41.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:08:40 smithi047 bash[22744]: cluster 2024-09-16T10:08:39.332086+0000 mgr.a (mgr.14373) 11743 : cluster [DBG] pgmap v8144: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T10:08:41.471 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:08:41.471 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:08:41.471 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:08:42.229 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:08:42.229 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:08:42.229 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:08:42.229 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:08:42.229 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:08:43.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:08:42 smithi157 bash[24585]: cluster 2024-09-16T10:08:41.332844+0000 mgr.a (mgr.14373) 11744 : cluster [DBG] pgmap v8145: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T10:08:43.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:08:42 smithi157 bash[24585]: audit 2024-09-16T10:08:41.805877+0000 mgr.a (mgr.14373) 11745 : audit [DBG] from='client.257016 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:08:43.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:08:42 smithi086 bash[24289]: cluster 2024-09-16T10:08:41.332844+0000 mgr.a (mgr.14373) 11744 : cluster [DBG] pgmap v8145: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T10:08:43.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:08:42 smithi086 bash[24289]: audit 2024-09-16T10:08:41.805877+0000 mgr.a (mgr.14373) 11745 : audit [DBG] from='client.257016 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:08:43.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:08:42 smithi047 bash[22744]: cluster 2024-09-16T10:08:41.332844+0000 mgr.a (mgr.14373) 11744 : cluster [DBG] pgmap v8145: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T10:08:43.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:08:42 smithi047 bash[22744]: audit 2024-09-16T10:08:41.805877+0000 mgr.a (mgr.14373) 11745 : audit [DBG] from='client.257016 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:08:45.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:08:44 smithi157 bash[24585]: cluster 2024-09-16T10:08:43.335631+0000 mgr.a (mgr.14373) 11746 : cluster [DBG] pgmap v8146: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:08:45.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:08:44 smithi086 bash[24289]: cluster 2024-09-16T10:08:43.335631+0000 mgr.a (mgr.14373) 11746 : cluster [DBG] pgmap v8146: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:08:45.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:08:44 smithi047 bash[22744]: cluster 2024-09-16T10:08:43.335631+0000 mgr.a (mgr.14373) 11746 : cluster [DBG] pgmap v8146: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:08:47.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:08:46 smithi157 bash[24585]: cluster 2024-09-16T10:08:45.336375+0000 mgr.a (mgr.14373) 11747 : cluster [DBG] pgmap v8147: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:08:47.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:08:46 smithi086 bash[24289]: cluster 2024-09-16T10:08:45.336375+0000 mgr.a (mgr.14373) 11747 : cluster [DBG] pgmap v8147: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:08:47.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:08:46 smithi047 bash[22744]: cluster 2024-09-16T10:08:45.336375+0000 mgr.a (mgr.14373) 11747 : cluster [DBG] pgmap v8147: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:08:47.230 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:08:47.231 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:08:47.231 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:08:47.998 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:08:47.998 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:08:47.998 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:08:47.998 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:08:47.998 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:08:48.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:08:47 smithi157 bash[24585]: audit 2024-09-16T10:08:46.859113+0000 mon.b (mon.2) 1082 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T10:08:48.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:08:47 smithi086 bash[24289]: audit 2024-09-16T10:08:46.859113+0000 mon.b (mon.2) 1082 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T10:08:48.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:08:47 smithi047 bash[22744]: audit 2024-09-16T10:08:46.859113+0000 mon.b (mon.2) 1082 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T10:08:49.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:08:48 smithi157 bash[24585]: cluster 2024-09-16T10:08:47.337634+0000 mgr.a (mgr.14373) 11748 : cluster [DBG] pgmap v8148: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:08:49.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:08:48 smithi157 bash[24585]: audit 2024-09-16T10:08:47.559647+0000 mgr.a (mgr.14373) 11749 : audit [DBG] from='client.257094 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:08:49.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:08:48 smithi157 bash[24585]: audit 2024-09-16T10:08:47.739852+0000 mon.b (mon.2) 1083 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T10:08:49.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:08:48 smithi157 bash[24585]: audit 2024-09-16T10:08:47.741448+0000 mon.b (mon.2) 1084 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T10:08:49.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:08:48 smithi157 bash[24585]: audit 2024-09-16T10:08:47.748292+0000 mon.a (mon.0) 1265 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:08:49.058 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:08:48 smithi157 bash[24585]: audit 2024-09-16T10:08:47.755193+0000 mon.b (mon.2) 1085 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:08:49.058 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:08:48 smithi157 bash[24585]: audit 2024-09-16T10:08:47.756992+0000 mgr.a (mgr.14373) 11750 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:08:49.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:08:48 smithi086 bash[24289]: cluster 2024-09-16T10:08:47.337634+0000 mgr.a (mgr.14373) 11748 : cluster [DBG] pgmap v8148: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:08:49.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:08:48 smithi086 bash[24289]: audit 2024-09-16T10:08:47.559647+0000 mgr.a (mgr.14373) 11749 : audit [DBG] from='client.257094 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:08:49.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:08:48 smithi086 bash[24289]: audit 2024-09-16T10:08:47.739852+0000 mon.b (mon.2) 1083 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T10:08:49.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:08:48 smithi086 bash[24289]: audit 2024-09-16T10:08:47.741448+0000 mon.b (mon.2) 1084 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T10:08:49.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:08:48 smithi086 bash[24289]: audit 2024-09-16T10:08:47.748292+0000 mon.a (mon.0) 1265 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:08:49.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:08:48 smithi086 bash[24289]: audit 2024-09-16T10:08:47.755193+0000 mon.b (mon.2) 1085 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:08:49.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:08:48 smithi086 bash[24289]: audit 2024-09-16T10:08:47.756992+0000 mgr.a (mgr.14373) 11750 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:08:49.092 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 10:08:48 smithi047 bash[22994]: debug 2024-09-16T10:08:48.695+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T10:08:49.092 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 10:08:48 smithi047 bash[22994]: debug 2024-09-16T10:08:48.695+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T10:08:49.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:08:48 smithi047 bash[22744]: cluster 2024-09-16T10:08:47.337634+0000 mgr.a (mgr.14373) 11748 : cluster [DBG] pgmap v8148: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:08:49.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:08:48 smithi047 bash[22744]: audit 2024-09-16T10:08:47.559647+0000 mgr.a (mgr.14373) 11749 : audit [DBG] from='client.257094 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:08:49.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:08:48 smithi047 bash[22744]: audit 2024-09-16T10:08:47.739852+0000 mon.b (mon.2) 1083 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T10:08:49.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:08:48 smithi047 bash[22744]: audit 2024-09-16T10:08:47.741448+0000 mon.b (mon.2) 1084 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T10:08:49.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:08:48 smithi047 bash[22744]: audit 2024-09-16T10:08:47.748292+0000 mon.a (mon.0) 1265 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:08:49.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:08:48 smithi047 bash[22744]: audit 2024-09-16T10:08:47.755193+0000 mon.b (mon.2) 1085 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:08:49.094 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:08:48 smithi047 bash[22744]: audit 2024-09-16T10:08:47.756992+0000 mgr.a (mgr.14373) 11750 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:08:50.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:08:49 smithi157 bash[24585]: audit 2024-09-16T10:08:48.698962+0000 mgr.a (mgr.14373) 11751 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T10:08:50.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:08:49 smithi157 bash[24585]: cephadm 2024-09-16T10:08:48.700974+0000 mgr.a (mgr.14373) 11752 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T10:08:50.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:08:49 smithi086 bash[24289]: audit 2024-09-16T10:08:48.698962+0000 mgr.a (mgr.14373) 11751 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T10:08:50.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:08:49 smithi086 bash[24289]: cephadm 2024-09-16T10:08:48.700974+0000 mgr.a (mgr.14373) 11752 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T10:08:50.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:08:49 smithi047 bash[22744]: audit 2024-09-16T10:08:48.698962+0000 mgr.a (mgr.14373) 11751 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T10:08:50.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:08:49 smithi047 bash[22744]: cephadm 2024-09-16T10:08:48.700974+0000 mgr.a (mgr.14373) 11752 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T10:08:51.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:08:50 smithi157 bash[24585]: cluster 2024-09-16T10:08:49.338627+0000 mgr.a (mgr.14373) 11753 : cluster [DBG] pgmap v8149: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-16T10:08:51.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:08:50 smithi086 bash[24289]: cluster 2024-09-16T10:08:49.338627+0000 mgr.a (mgr.14373) 11753 : cluster [DBG] pgmap v8149: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-16T10:08:51.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:08:50 smithi047 bash[22744]: cluster 2024-09-16T10:08:49.338627+0000 mgr.a (mgr.14373) 11753 : cluster [DBG] pgmap v8149: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-16T10:08:53.000 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:08:53.001 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:08:53.001 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:08:53.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:08:52 smithi157 bash[24585]: cluster 2024-09-16T10:08:51.339596+0000 mgr.a (mgr.14373) 11754 : cluster [DBG] pgmap v8150: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-16T10:08:53.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:08:52 smithi086 bash[24289]: cluster 2024-09-16T10:08:51.339596+0000 mgr.a (mgr.14373) 11754 : cluster [DBG] pgmap v8150: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-16T10:08:53.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:08:52 smithi047 bash[22744]: cluster 2024-09-16T10:08:51.339596+0000 mgr.a (mgr.14373) 11754 : cluster [DBG] pgmap v8150: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-16T10:08:53.753 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:08:53.753 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:08:53.753 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:08:53.753 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:08:53.754 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:08:55.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:08:54 smithi157 bash[24585]: audit 2024-09-16T10:08:53.324421+0000 mgr.a (mgr.14373) 11755 : audit [DBG] from='client.257280 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:08:55.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:08:54 smithi157 bash[24585]: cluster 2024-09-16T10:08:53.344940+0000 mgr.a (mgr.14373) 11756 : cluster [DBG] pgmap v8151: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.4 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:08:55.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:08:54 smithi086 bash[24289]: audit 2024-09-16T10:08:53.324421+0000 mgr.a (mgr.14373) 11755 : audit [DBG] from='client.257280 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:08:55.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:08:54 smithi086 bash[24289]: cluster 2024-09-16T10:08:53.344940+0000 mgr.a (mgr.14373) 11756 : cluster [DBG] pgmap v8151: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.4 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:08:55.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:08:54 smithi047 bash[22744]: audit 2024-09-16T10:08:53.324421+0000 mgr.a (mgr.14373) 11755 : audit [DBG] from='client.257280 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:08:55.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:08:54 smithi047 bash[22744]: cluster 2024-09-16T10:08:53.344940+0000 mgr.a (mgr.14373) 11756 : cluster [DBG] pgmap v8151: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.4 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:08:57.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:08:56 smithi157 bash[24585]: cluster 2024-09-16T10:08:55.345971+0000 mgr.a (mgr.14373) 11757 : cluster [DBG] pgmap v8152: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:08:57.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:08:56 smithi086 bash[24289]: cluster 2024-09-16T10:08:55.345971+0000 mgr.a (mgr.14373) 11757 : cluster [DBG] pgmap v8152: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:08:57.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:08:56 smithi047 bash[22744]: cluster 2024-09-16T10:08:55.345971+0000 mgr.a (mgr.14373) 11757 : cluster [DBG] pgmap v8152: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:08:58.755 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:08:58.755 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:08:58.755 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:08:59.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:08:58 smithi157 bash[24585]: cluster 2024-09-16T10:08:57.348199+0000 mgr.a (mgr.14373) 11758 : cluster [DBG] pgmap v8153: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:08:59.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:08:58 smithi086 bash[24289]: cluster 2024-09-16T10:08:57.348199+0000 mgr.a (mgr.14373) 11758 : cluster [DBG] pgmap v8153: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:08:59.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:08:58 smithi047 bash[22744]: cluster 2024-09-16T10:08:57.348199+0000 mgr.a (mgr.14373) 11758 : cluster [DBG] pgmap v8153: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:08:59.505 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:08:59.505 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:08:59.506 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:08:59.506 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:08:59.506 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:09:00.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:08:59 smithi157 bash[24585]: audit 2024-09-16T10:08:59.087051+0000 mgr.a (mgr.14373) 11759 : audit [DBG] from='client.257352 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:09:00.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:08:59 smithi086 bash[24289]: audit 2024-09-16T10:08:59.087051+0000 mgr.a (mgr.14373) 11759 : audit [DBG] from='client.257352 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:09:00.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:08:59 smithi047 bash[22744]: audit 2024-09-16T10:08:59.087051+0000 mgr.a (mgr.14373) 11759 : audit [DBG] from='client.257352 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:09:01.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:09:00 smithi157 bash[24585]: cluster 2024-09-16T10:08:59.348746+0000 mgr.a (mgr.14373) 11760 : cluster [DBG] pgmap v8154: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:09:01.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:09:00 smithi086 bash[24289]: cluster 2024-09-16T10:08:59.348746+0000 mgr.a (mgr.14373) 11760 : cluster [DBG] pgmap v8154: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:09:01.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:09:00 smithi047 bash[22744]: cluster 2024-09-16T10:08:59.348746+0000 mgr.a (mgr.14373) 11760 : cluster [DBG] pgmap v8154: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:09:03.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:09:02 smithi157 bash[24585]: cluster 2024-09-16T10:09:01.349701+0000 mgr.a (mgr.14373) 11761 : cluster [DBG] pgmap v8155: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:09:03.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:09:02 smithi086 bash[24289]: cluster 2024-09-16T10:09:01.349701+0000 mgr.a (mgr.14373) 11761 : cluster [DBG] pgmap v8155: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:09:03.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:09:02 smithi047 bash[22744]: cluster 2024-09-16T10:09:01.349701+0000 mgr.a (mgr.14373) 11761 : cluster [DBG] pgmap v8155: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:09:04.507 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:09:04.507 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:09:04.508 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:09:05.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:09:04 smithi157 bash[24585]: cluster 2024-09-16T10:09:03.352001+0000 mgr.a (mgr.14373) 11762 : cluster [DBG] pgmap v8156: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:09:05.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:09:04 smithi086 bash[24289]: cluster 2024-09-16T10:09:03.352001+0000 mgr.a (mgr.14373) 11762 : cluster [DBG] pgmap v8156: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:09:05.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:09:04 smithi047 bash[22744]: cluster 2024-09-16T10:09:03.352001+0000 mgr.a (mgr.14373) 11762 : cluster [DBG] pgmap v8156: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:09:05.270 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:09:05.270 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:09:05.270 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:09:05.270 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:09:05.271 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:09:06.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:09:05 smithi157 bash[24585]: audit 2024-09-16T10:09:04.845758+0000 mgr.a (mgr.14373) 11763 : audit [DBG] from='client.257427 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:09:06.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:09:05 smithi086 bash[24289]: audit 2024-09-16T10:09:04.845758+0000 mgr.a (mgr.14373) 11763 : audit [DBG] from='client.257427 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:09:06.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:09:05 smithi047 bash[22744]: audit 2024-09-16T10:09:04.845758+0000 mgr.a (mgr.14373) 11763 : audit [DBG] from='client.257427 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:09:07.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:09:06 smithi157 bash[24585]: cluster 2024-09-16T10:09:05.352969+0000 mgr.a (mgr.14373) 11764 : cluster [DBG] pgmap v8157: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:09:07.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:09:06 smithi086 bash[24289]: cluster 2024-09-16T10:09:05.352969+0000 mgr.a (mgr.14373) 11764 : cluster [DBG] pgmap v8157: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:09:07.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:09:06 smithi047 bash[22744]: cluster 2024-09-16T10:09:05.352969+0000 mgr.a (mgr.14373) 11764 : cluster [DBG] pgmap v8157: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:09:09.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:09:08 smithi157 bash[24585]: cluster 2024-09-16T10:09:07.355218+0000 mgr.a (mgr.14373) 11765 : cluster [DBG] pgmap v8158: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:09:09.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:09:08 smithi086 bash[24289]: cluster 2024-09-16T10:09:07.355218+0000 mgr.a (mgr.14373) 11765 : cluster [DBG] pgmap v8158: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:09:09.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:09:08 smithi047 bash[22744]: cluster 2024-09-16T10:09:07.355218+0000 mgr.a (mgr.14373) 11765 : cluster [DBG] pgmap v8158: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:09:10.272 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:09:10.273 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:09:10.273 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:09:11.046 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:09:11.046 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:09:11.046 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:09:11.046 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:09:11.046 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:09:11.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:09:10 smithi157 bash[24585]: cluster 2024-09-16T10:09:09.355979+0000 mgr.a (mgr.14373) 11766 : cluster [DBG] pgmap v8159: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:09:11.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:09:10 smithi086 bash[24289]: cluster 2024-09-16T10:09:09.355979+0000 mgr.a (mgr.14373) 11766 : cluster [DBG] pgmap v8159: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:09:11.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:09:10 smithi047 bash[22744]: cluster 2024-09-16T10:09:09.355979+0000 mgr.a (mgr.14373) 11766 : cluster [DBG] pgmap v8159: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:09:12.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:09:11 smithi157 bash[24585]: audit 2024-09-16T10:09:10.602202+0000 mgr.a (mgr.14373) 11767 : audit [DBG] from='client.257499 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:09:12.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:09:11 smithi086 bash[24289]: audit 2024-09-16T10:09:10.602202+0000 mgr.a (mgr.14373) 11767 : audit [DBG] from='client.257499 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:09:12.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:09:11 smithi047 bash[22744]: audit 2024-09-16T10:09:10.602202+0000 mgr.a (mgr.14373) 11767 : audit [DBG] from='client.257499 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:09:13.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:09:12 smithi157 bash[24585]: cluster 2024-09-16T10:09:11.356859+0000 mgr.a (mgr.14373) 11768 : cluster [DBG] pgmap v8160: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:09:13.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:09:12 smithi086 bash[24289]: cluster 2024-09-16T10:09:11.356859+0000 mgr.a (mgr.14373) 11768 : cluster [DBG] pgmap v8160: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:09:13.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:09:12 smithi047 bash[22744]: cluster 2024-09-16T10:09:11.356859+0000 mgr.a (mgr.14373) 11768 : cluster [DBG] pgmap v8160: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:09:15.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:09:14 smithi157 bash[24585]: cluster 2024-09-16T10:09:13.359075+0000 mgr.a (mgr.14373) 11769 : cluster [DBG] pgmap v8161: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:09:15.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:09:14 smithi086 bash[24289]: cluster 2024-09-16T10:09:13.359075+0000 mgr.a (mgr.14373) 11769 : cluster [DBG] pgmap v8161: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:09:15.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:09:14 smithi047 bash[22744]: cluster 2024-09-16T10:09:13.359075+0000 mgr.a (mgr.14373) 11769 : cluster [DBG] pgmap v8161: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:09:16.048 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:09:16.048 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:09:16.048 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:09:16.793 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:09:16.793 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:09:16.793 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:09:16.793 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:09:16.793 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:09:17.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:09:16 smithi157 bash[24585]: cluster 2024-09-16T10:09:15.359832+0000 mgr.a (mgr.14373) 11770 : cluster [DBG] pgmap v8162: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:09:17.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:09:16 smithi086 bash[24289]: cluster 2024-09-16T10:09:15.359832+0000 mgr.a (mgr.14373) 11770 : cluster [DBG] pgmap v8162: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:09:17.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:09:16 smithi047 bash[22744]: cluster 2024-09-16T10:09:15.359832+0000 mgr.a (mgr.14373) 11770 : cluster [DBG] pgmap v8162: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:09:18.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:09:17 smithi157 bash[24585]: audit 2024-09-16T10:09:16.383087+0000 mgr.a (mgr.14373) 11771 : audit [DBG] from='client.257577 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:09:18.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:09:17 smithi086 bash[24289]: audit 2024-09-16T10:09:16.383087+0000 mgr.a (mgr.14373) 11771 : audit [DBG] from='client.257577 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:09:18.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:09:17 smithi047 bash[22744]: audit 2024-09-16T10:09:16.383087+0000 mgr.a (mgr.14373) 11771 : audit [DBG] from='client.257577 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:09:19.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:09:18 smithi157 bash[24585]: cluster 2024-09-16T10:09:17.362504+0000 mgr.a (mgr.14373) 11772 : cluster [DBG] pgmap v8163: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-16T10:09:19.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:09:18 smithi086 bash[24289]: cluster 2024-09-16T10:09:17.362504+0000 mgr.a (mgr.14373) 11772 : cluster [DBG] pgmap v8163: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-16T10:09:19.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:09:18 smithi047 bash[22744]: cluster 2024-09-16T10:09:17.362504+0000 mgr.a (mgr.14373) 11772 : cluster [DBG] pgmap v8163: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-16T10:09:21.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:09:20 smithi157 bash[24585]: cluster 2024-09-16T10:09:19.363287+0000 mgr.a (mgr.14373) 11773 : cluster [DBG] pgmap v8164: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-16T10:09:21.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:09:20 smithi086 bash[24289]: cluster 2024-09-16T10:09:19.363287+0000 mgr.a (mgr.14373) 11773 : cluster [DBG] pgmap v8164: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-16T10:09:21.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:09:20 smithi047 bash[22744]: cluster 2024-09-16T10:09:19.363287+0000 mgr.a (mgr.14373) 11773 : cluster [DBG] pgmap v8164: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-16T10:09:21.794 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:09:21.795 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:09:21.795 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:09:22.541 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:09:22.541 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:09:22.541 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:09:22.541 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:09:22.541 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:09:23.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:09:22 smithi157 bash[24585]: cluster 2024-09-16T10:09:21.364184+0000 mgr.a (mgr.14373) 11774 : cluster [DBG] pgmap v8165: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-16T10:09:23.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:09:22 smithi086 bash[24289]: cluster 2024-09-16T10:09:21.364184+0000 mgr.a (mgr.14373) 11774 : cluster [DBG] pgmap v8165: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-16T10:09:23.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:09:22 smithi047 bash[22744]: cluster 2024-09-16T10:09:21.364184+0000 mgr.a (mgr.14373) 11774 : cluster [DBG] pgmap v8165: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-16T10:09:24.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:09:23 smithi157 bash[24585]: audit 2024-09-16T10:09:22.122738+0000 mgr.a (mgr.14373) 11775 : audit [DBG] from='client.257655 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:09:24.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:09:23 smithi086 bash[24289]: audit 2024-09-16T10:09:22.122738+0000 mgr.a (mgr.14373) 11775 : audit [DBG] from='client.257655 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:09:24.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:09:23 smithi047 bash[22744]: audit 2024-09-16T10:09:22.122738+0000 mgr.a (mgr.14373) 11775 : audit [DBG] from='client.257655 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:09:25.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:09:24 smithi157 bash[24585]: cluster 2024-09-16T10:09:23.366900+0000 mgr.a (mgr.14373) 11776 : cluster [DBG] pgmap v8166: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:09:25.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:09:24 smithi086 bash[24289]: cluster 2024-09-16T10:09:23.366900+0000 mgr.a (mgr.14373) 11776 : cluster [DBG] pgmap v8166: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:09:25.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:09:24 smithi047 bash[22744]: cluster 2024-09-16T10:09:23.366900+0000 mgr.a (mgr.14373) 11776 : cluster [DBG] pgmap v8166: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:09:27.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:09:26 smithi157 bash[24585]: cluster 2024-09-16T10:09:25.367656+0000 mgr.a (mgr.14373) 11777 : cluster [DBG] pgmap v8167: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:09:27.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:09:26 smithi086 bash[24289]: cluster 2024-09-16T10:09:25.367656+0000 mgr.a (mgr.14373) 11777 : cluster [DBG] pgmap v8167: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:09:27.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:09:26 smithi047 bash[22744]: cluster 2024-09-16T10:09:25.367656+0000 mgr.a (mgr.14373) 11777 : cluster [DBG] pgmap v8167: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:09:27.542 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:09:27.543 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:09:27.543 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:09:28.316 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:09:28.316 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:09:28.316 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:09:28.316 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:09:28.316 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:09:29.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:09:28 smithi157 bash[24585]: cluster 2024-09-16T10:09:27.369661+0000 mgr.a (mgr.14373) 11778 : cluster [DBG] pgmap v8168: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:09:29.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:09:28 smithi157 bash[24585]: audit 2024-09-16T10:09:27.875496+0000 mgr.a (mgr.14373) 11779 : audit [DBG] from='client.257730 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:09:29.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:09:28 smithi086 bash[24289]: cluster 2024-09-16T10:09:27.369661+0000 mgr.a (mgr.14373) 11778 : cluster [DBG] pgmap v8168: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:09:29.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:09:28 smithi086 bash[24289]: audit 2024-09-16T10:09:27.875496+0000 mgr.a (mgr.14373) 11779 : audit [DBG] from='client.257730 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:09:29.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:09:28 smithi047 bash[22744]: cluster 2024-09-16T10:09:27.369661+0000 mgr.a (mgr.14373) 11778 : cluster [DBG] pgmap v8168: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:09:29.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:09:28 smithi047 bash[22744]: audit 2024-09-16T10:09:27.875496+0000 mgr.a (mgr.14373) 11779 : audit [DBG] from='client.257730 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:09:31.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:09:30 smithi157 bash[24585]: cluster 2024-09-16T10:09:29.370589+0000 mgr.a (mgr.14373) 11780 : cluster [DBG] pgmap v8169: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-16T10:09:31.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:09:30 smithi086 bash[24289]: cluster 2024-09-16T10:09:29.370589+0000 mgr.a (mgr.14373) 11780 : cluster [DBG] pgmap v8169: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-16T10:09:31.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:09:30 smithi047 bash[22744]: cluster 2024-09-16T10:09:29.370589+0000 mgr.a (mgr.14373) 11780 : cluster [DBG] pgmap v8169: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-16T10:09:33.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:09:32 smithi157 bash[24585]: cluster 2024-09-16T10:09:31.371352+0000 mgr.a (mgr.14373) 11781 : cluster [DBG] pgmap v8170: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-16T10:09:33.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:09:32 smithi086 bash[24289]: cluster 2024-09-16T10:09:31.371352+0000 mgr.a (mgr.14373) 11781 : cluster [DBG] pgmap v8170: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-16T10:09:33.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:09:32 smithi047 bash[22744]: cluster 2024-09-16T10:09:31.371352+0000 mgr.a (mgr.14373) 11781 : cluster [DBG] pgmap v8170: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-16T10:09:33.317 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:09:33.318 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:09:33.318 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:09:34.060 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:09:34.060 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:09:34.060 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:09:34.060 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:09:34.060 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:09:35.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:09:34 smithi157 bash[24585]: cluster 2024-09-16T10:09:33.373580+0000 mgr.a (mgr.14373) 11782 : cluster [DBG] pgmap v8171: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:09:35.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:09:34 smithi157 bash[24585]: audit 2024-09-16T10:09:33.644515+0000 mgr.a (mgr.14373) 11783 : audit [DBG] from='client.257808 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:09:35.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:09:34 smithi086 bash[24289]: cluster 2024-09-16T10:09:33.373580+0000 mgr.a (mgr.14373) 11782 : cluster [DBG] pgmap v8171: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:09:35.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:09:34 smithi086 bash[24289]: audit 2024-09-16T10:09:33.644515+0000 mgr.a (mgr.14373) 11783 : audit [DBG] from='client.257808 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:09:35.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:09:34 smithi047 bash[22744]: cluster 2024-09-16T10:09:33.373580+0000 mgr.a (mgr.14373) 11782 : cluster [DBG] pgmap v8171: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:09:35.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:09:34 smithi047 bash[22744]: audit 2024-09-16T10:09:33.644515+0000 mgr.a (mgr.14373) 11783 : audit [DBG] from='client.257808 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:09:37.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:09:36 smithi157 bash[24585]: cluster 2024-09-16T10:09:35.374511+0000 mgr.a (mgr.14373) 11784 : cluster [DBG] pgmap v8172: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:09:37.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:09:36 smithi086 bash[24289]: cluster 2024-09-16T10:09:35.374511+0000 mgr.a (mgr.14373) 11784 : cluster [DBG] pgmap v8172: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:09:37.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:09:36 smithi047 bash[22744]: cluster 2024-09-16T10:09:35.374511+0000 mgr.a (mgr.14373) 11784 : cluster [DBG] pgmap v8172: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:09:39.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:09:38 smithi157 bash[24585]: cluster 2024-09-16T10:09:37.376703+0000 mgr.a (mgr.14373) 11785 : cluster [DBG] pgmap v8173: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:09:39.061 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:09:39.062 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:09:39.062 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:09:39.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:09:38 smithi086 bash[24289]: cluster 2024-09-16T10:09:37.376703+0000 mgr.a (mgr.14373) 11785 : cluster [DBG] pgmap v8173: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:09:39.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:09:38 smithi047 bash[22744]: cluster 2024-09-16T10:09:37.376703+0000 mgr.a (mgr.14373) 11785 : cluster [DBG] pgmap v8173: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:09:39.848 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:09:39.848 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:09:39.848 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:09:39.848 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:09:39.849 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:09:41.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:09:40 smithi157 bash[24585]: cluster 2024-09-16T10:09:39.377391+0000 mgr.a (mgr.14373) 11786 : cluster [DBG] pgmap v8174: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:09:41.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:09:40 smithi157 bash[24585]: audit 2024-09-16T10:09:39.398857+0000 mgr.a (mgr.14373) 11787 : audit [DBG] from='client.257886 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:09:41.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:09:40 smithi086 bash[24289]: cluster 2024-09-16T10:09:39.377391+0000 mgr.a (mgr.14373) 11786 : cluster [DBG] pgmap v8174: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:09:41.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:09:40 smithi086 bash[24289]: audit 2024-09-16T10:09:39.398857+0000 mgr.a (mgr.14373) 11787 : audit [DBG] from='client.257886 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:09:41.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:09:40 smithi047 bash[22744]: cluster 2024-09-16T10:09:39.377391+0000 mgr.a (mgr.14373) 11786 : cluster [DBG] pgmap v8174: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:09:41.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:09:40 smithi047 bash[22744]: audit 2024-09-16T10:09:39.398857+0000 mgr.a (mgr.14373) 11787 : audit [DBG] from='client.257886 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:09:43.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:09:42 smithi157 bash[24585]: cluster 2024-09-16T10:09:41.378247+0000 mgr.a (mgr.14373) 11788 : cluster [DBG] pgmap v8175: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:09:43.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:09:42 smithi086 bash[24289]: cluster 2024-09-16T10:09:41.378247+0000 mgr.a (mgr.14373) 11788 : cluster [DBG] pgmap v8175: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:09:43.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:09:42 smithi047 bash[22744]: cluster 2024-09-16T10:09:41.378247+0000 mgr.a (mgr.14373) 11788 : cluster [DBG] pgmap v8175: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:09:44.849 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:09:44.850 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:09:44.850 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:09:45.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:09:44 smithi157 bash[24585]: cluster 2024-09-16T10:09:43.380455+0000 mgr.a (mgr.14373) 11789 : cluster [DBG] pgmap v8176: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:09:45.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:09:44 smithi086 bash[24289]: cluster 2024-09-16T10:09:43.380455+0000 mgr.a (mgr.14373) 11789 : cluster [DBG] pgmap v8176: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:09:45.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:09:44 smithi047 bash[22744]: cluster 2024-09-16T10:09:43.380455+0000 mgr.a (mgr.14373) 11789 : cluster [DBG] pgmap v8176: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:09:45.612 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:09:45.612 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:09:45.612 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:09:45.612 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:09:45.612 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:09:47.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:09:46 smithi157 bash[24585]: audit 2024-09-16T10:09:45.181621+0000 mgr.a (mgr.14373) 11790 : audit [DBG] from='client.257961 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:09:47.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:09:46 smithi157 bash[24585]: cluster 2024-09-16T10:09:45.381137+0000 mgr.a (mgr.14373) 11791 : cluster [DBG] pgmap v8177: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:09:47.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:09:46 smithi086 bash[24289]: audit 2024-09-16T10:09:45.181621+0000 mgr.a (mgr.14373) 11790 : audit [DBG] from='client.257961 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:09:47.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:09:46 smithi086 bash[24289]: cluster 2024-09-16T10:09:45.381137+0000 mgr.a (mgr.14373) 11791 : cluster [DBG] pgmap v8177: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:09:47.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:09:46 smithi047 bash[22744]: audit 2024-09-16T10:09:45.181621+0000 mgr.a (mgr.14373) 11790 : audit [DBG] from='client.257961 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:09:47.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:09:46 smithi047 bash[22744]: cluster 2024-09-16T10:09:45.381137+0000 mgr.a (mgr.14373) 11791 : cluster [DBG] pgmap v8177: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:09:49.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:09:48 smithi157 bash[24585]: cluster 2024-09-16T10:09:47.383479+0000 mgr.a (mgr.14373) 11792 : cluster [DBG] pgmap v8178: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:09:49.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:09:48 smithi157 bash[24585]: audit 2024-09-16T10:09:48.751545+0000 mon.b (mon.2) 1086 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T10:09:49.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:09:48 smithi086 bash[24289]: cluster 2024-09-16T10:09:47.383479+0000 mgr.a (mgr.14373) 11792 : cluster [DBG] pgmap v8178: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:09:49.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:09:48 smithi086 bash[24289]: audit 2024-09-16T10:09:48.751545+0000 mon.b (mon.2) 1086 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T10:09:49.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:09:48 smithi047 bash[22744]: cluster 2024-09-16T10:09:47.383479+0000 mgr.a (mgr.14373) 11792 : cluster [DBG] pgmap v8178: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:09:49.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:09:48 smithi047 bash[22744]: audit 2024-09-16T10:09:48.751545+0000 mon.b (mon.2) 1086 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T10:09:50.613 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:09:50.614 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:09:50.614 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:09:51.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:09:50 smithi157 bash[24585]: cluster 2024-09-16T10:09:49.383907+0000 mgr.a (mgr.14373) 11793 : cluster [DBG] pgmap v8179: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:09:51.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:09:50 smithi086 bash[24289]: cluster 2024-09-16T10:09:49.383907+0000 mgr.a (mgr.14373) 11793 : cluster [DBG] pgmap v8179: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:09:51.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:09:50 smithi047 bash[22744]: cluster 2024-09-16T10:09:49.383907+0000 mgr.a (mgr.14373) 11793 : cluster [DBG] pgmap v8179: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:09:51.369 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:09:51.369 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:09:51.369 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:09:51.369 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:09:51.369 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:09:52.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:09:51 smithi157 bash[24585]: audit 2024-09-16T10:09:50.950775+0000 mgr.a (mgr.14373) 11794 : audit [DBG] from='client.258039 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:09:52.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:09:51 smithi086 bash[24289]: audit 2024-09-16T10:09:50.950775+0000 mgr.a (mgr.14373) 11794 : audit [DBG] from='client.258039 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:09:52.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:09:51 smithi047 bash[22744]: audit 2024-09-16T10:09:50.950775+0000 mgr.a (mgr.14373) 11794 : audit [DBG] from='client.258039 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:09:53.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:09:52 smithi157 bash[24585]: cluster 2024-09-16T10:09:51.384422+0000 mgr.a (mgr.14373) 11795 : cluster [DBG] pgmap v8180: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:09:53.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:09:52 smithi086 bash[24289]: cluster 2024-09-16T10:09:51.384422+0000 mgr.a (mgr.14373) 11795 : cluster [DBG] pgmap v8180: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:09:53.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:09:52 smithi047 bash[22744]: cluster 2024-09-16T10:09:51.384422+0000 mgr.a (mgr.14373) 11795 : cluster [DBG] pgmap v8180: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:09:55.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:09:54 smithi086 bash[24289]: cluster 2024-09-16T10:09:53.386690+0000 mgr.a (mgr.14373) 11796 : cluster [DBG] pgmap v8181: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:09:55.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:09:54 smithi047 bash[22744]: cluster 2024-09-16T10:09:53.386690+0000 mgr.a (mgr.14373) 11796 : cluster [DBG] pgmap v8181: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:09:55.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:09:54 smithi157 bash[24585]: cluster 2024-09-16T10:09:53.386690+0000 mgr.a (mgr.14373) 11796 : cluster [DBG] pgmap v8181: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:09:56.370 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:09:56.371 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:09:56.371 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:09:57.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:09:56 smithi086 bash[24289]: cluster 2024-09-16T10:09:55.387429+0000 mgr.a (mgr.14373) 11797 : cluster [DBG] pgmap v8182: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:09:57.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:09:56 smithi047 bash[22744]: cluster 2024-09-16T10:09:55.387429+0000 mgr.a (mgr.14373) 11797 : cluster [DBG] pgmap v8182: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:09:57.136 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:09:57.136 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:09:57.137 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:09:57.137 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:09:57.137 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:09:57.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:09:56 smithi157 bash[24585]: cluster 2024-09-16T10:09:55.387429+0000 mgr.a (mgr.14373) 11797 : cluster [DBG] pgmap v8182: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:09:58.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:09:57 smithi047 bash[22744]: audit 2024-09-16T10:09:56.703045+0000 mgr.a (mgr.14373) 11798 : audit [DBG] from='client.258114 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:09:58.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:09:57 smithi157 bash[24585]: audit 2024-09-16T10:09:56.703045+0000 mgr.a (mgr.14373) 11798 : audit [DBG] from='client.258114 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:09:58.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:09:57 smithi086 bash[24289]: audit 2024-09-16T10:09:56.703045+0000 mgr.a (mgr.14373) 11798 : audit [DBG] from='client.258114 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:09:59.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:09:58 smithi047 bash[22744]: cluster 2024-09-16T10:09:57.390156+0000 mgr.a (mgr.14373) 11799 : cluster [DBG] pgmap v8183: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:09:59.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:09:58 smithi157 bash[24585]: cluster 2024-09-16T10:09:57.390156+0000 mgr.a (mgr.14373) 11799 : cluster [DBG] pgmap v8183: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:09:59.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:09:58 smithi086 bash[24289]: cluster 2024-09-16T10:09:57.390156+0000 mgr.a (mgr.14373) 11799 : cluster [DBG] pgmap v8183: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:10:00.842 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 10:10:00 smithi047 bash[22994]: debug 2024-09-16T10:10:00.401+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T10:10:00.843 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 10:10:00 smithi047 bash[22994]: debug 2024-09-16T10:10:00.405+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T10:10:00.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:10:00 smithi047 bash[22744]: cluster 2024-09-16T10:09:59.390945+0000 mgr.a (mgr.14373) 11800 : cluster [DBG] pgmap v8184: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:10:00.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:10:00 smithi047 bash[22744]: audit 2024-09-16T10:09:59.578425+0000 mon.a (mon.0) 1266 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:10:00.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:10:00 smithi047 bash[22744]: audit 2024-09-16T10:09:59.588712+0000 mon.a (mon.0) 1267 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:10:00.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:10:00 smithi047 bash[22744]: audit 2024-09-16T10:09:59.591888+0000 mon.b (mon.2) 1087 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T10:10:00.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:10:00 smithi047 bash[22744]: audit 2024-09-16T10:09:59.594409+0000 mon.b (mon.2) 1088 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T10:10:00.844 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:10:00 smithi047 bash[22744]: audit 2024-09-16T10:09:59.606458+0000 mon.a (mon.0) 1268 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:10:00.844 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:10:00 smithi047 bash[22744]: audit 2024-09-16T10:09:59.612235+0000 mon.b (mon.2) 1089 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:10:00.844 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:10:00 smithi047 bash[22744]: audit 2024-09-16T10:09:59.615118+0000 mgr.a (mgr.14373) 11801 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:10:00.844 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:10:00 smithi047 bash[22744]: cluster 2024-09-16T10:10:00.000104+0000 mon.a (mon.0) 1269 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-16T10:10:01.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:10:00 smithi157 bash[24585]: cluster 2024-09-16T10:09:59.390945+0000 mgr.a (mgr.14373) 11800 : cluster [DBG] pgmap v8184: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:10:01.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:10:00 smithi157 bash[24585]: audit 2024-09-16T10:09:59.578425+0000 mon.a (mon.0) 1266 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:10:01.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:10:00 smithi157 bash[24585]: audit 2024-09-16T10:09:59.588712+0000 mon.a (mon.0) 1267 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:10:01.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:10:00 smithi157 bash[24585]: audit 2024-09-16T10:09:59.591888+0000 mon.b (mon.2) 1087 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T10:10:01.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:10:00 smithi157 bash[24585]: audit 2024-09-16T10:09:59.594409+0000 mon.b (mon.2) 1088 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T10:10:01.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:10:00 smithi157 bash[24585]: audit 2024-09-16T10:09:59.606458+0000 mon.a (mon.0) 1268 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:10:01.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:10:00 smithi157 bash[24585]: audit 2024-09-16T10:09:59.612235+0000 mon.b (mon.2) 1089 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:10:01.058 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:10:00 smithi157 bash[24585]: audit 2024-09-16T10:09:59.615118+0000 mgr.a (mgr.14373) 11801 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:10:01.058 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:10:00 smithi157 bash[24585]: cluster 2024-09-16T10:10:00.000104+0000 mon.a (mon.0) 1269 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-16T10:10:01.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:10:00 smithi086 bash[24289]: cluster 2024-09-16T10:09:59.390945+0000 mgr.a (mgr.14373) 11800 : cluster [DBG] pgmap v8184: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:10:01.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:10:00 smithi086 bash[24289]: audit 2024-09-16T10:09:59.578425+0000 mon.a (mon.0) 1266 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:10:01.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:10:00 smithi086 bash[24289]: audit 2024-09-16T10:09:59.588712+0000 mon.a (mon.0) 1267 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:10:01.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:10:00 smithi086 bash[24289]: audit 2024-09-16T10:09:59.591888+0000 mon.b (mon.2) 1087 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T10:10:01.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:10:00 smithi086 bash[24289]: audit 2024-09-16T10:09:59.594409+0000 mon.b (mon.2) 1088 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T10:10:01.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:10:00 smithi086 bash[24289]: audit 2024-09-16T10:09:59.606458+0000 mon.a (mon.0) 1268 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:10:01.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:10:00 smithi086 bash[24289]: audit 2024-09-16T10:09:59.612235+0000 mon.b (mon.2) 1089 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:10:01.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:10:00 smithi086 bash[24289]: audit 2024-09-16T10:09:59.615118+0000 mgr.a (mgr.14373) 11801 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:10:01.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:10:00 smithi086 bash[24289]: cluster 2024-09-16T10:10:00.000104+0000 mon.a (mon.0) 1269 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-16T10:10:01.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:10:01 smithi047 bash[22744]: audit 2024-09-16T10:10:00.405842+0000 mgr.a (mgr.14373) 11802 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T10:10:01.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:10:01 smithi047 bash[22744]: cephadm 2024-09-16T10:10:00.408723+0000 mgr.a (mgr.14373) 11803 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T10:10:02.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:10:01 smithi157 bash[24585]: audit 2024-09-16T10:10:00.405842+0000 mgr.a (mgr.14373) 11802 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T10:10:02.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:10:01 smithi157 bash[24585]: cephadm 2024-09-16T10:10:00.408723+0000 mgr.a (mgr.14373) 11803 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T10:10:02.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:10:01 smithi086 bash[24289]: audit 2024-09-16T10:10:00.405842+0000 mgr.a (mgr.14373) 11802 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T10:10:02.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:10:01 smithi086 bash[24289]: cephadm 2024-09-16T10:10:00.408723+0000 mgr.a (mgr.14373) 11803 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T10:10:02.138 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:10:02.139 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:10:02.139 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:10:02.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:10:02 smithi047 bash[22744]: cluster 2024-09-16T10:10:01.391866+0000 mgr.a (mgr.14373) 11804 : cluster [DBG] pgmap v8185: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T10:10:02.900 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:10:02.901 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:10:02.901 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:10:02.901 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:10:02.901 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:10:03.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:10:02 smithi157 bash[24585]: cluster 2024-09-16T10:10:01.391866+0000 mgr.a (mgr.14373) 11804 : cluster [DBG] pgmap v8185: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T10:10:03.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:10:02 smithi086 bash[24289]: cluster 2024-09-16T10:10:01.391866+0000 mgr.a (mgr.14373) 11804 : cluster [DBG] pgmap v8185: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T10:10:04.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:10:03 smithi157 bash[24585]: audit 2024-09-16T10:10:02.471890+0000 mgr.a (mgr.14373) 11805 : audit [DBG] from='client.258297 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:10:04.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:10:03 smithi086 bash[24289]: audit 2024-09-16T10:10:02.471890+0000 mgr.a (mgr.14373) 11805 : audit [DBG] from='client.258297 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:10:04.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:10:03 smithi047 bash[22744]: audit 2024-09-16T10:10:02.471890+0000 mgr.a (mgr.14373) 11805 : audit [DBG] from='client.258297 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:10:05.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:10:04 smithi157 bash[24585]: cluster 2024-09-16T10:10:03.394677+0000 mgr.a (mgr.14373) 11806 : cluster [DBG] pgmap v8186: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:10:05.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:10:04 smithi086 bash[24289]: cluster 2024-09-16T10:10:03.394677+0000 mgr.a (mgr.14373) 11806 : cluster [DBG] pgmap v8186: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:10:05.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:10:04 smithi047 bash[22744]: cluster 2024-09-16T10:10:03.394677+0000 mgr.a (mgr.14373) 11806 : cluster [DBG] pgmap v8186: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:10:07.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:10:06 smithi157 bash[24585]: cluster 2024-09-16T10:10:05.395483+0000 mgr.a (mgr.14373) 11807 : cluster [DBG] pgmap v8187: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T10:10:07.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:10:06 smithi086 bash[24289]: cluster 2024-09-16T10:10:05.395483+0000 mgr.a (mgr.14373) 11807 : cluster [DBG] pgmap v8187: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T10:10:07.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:10:06 smithi047 bash[22744]: cluster 2024-09-16T10:10:05.395483+0000 mgr.a (mgr.14373) 11807 : cluster [DBG] pgmap v8187: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T10:10:07.902 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:10:07.903 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:10:07.903 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:10:08.683 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:10:08.683 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:10:08.683 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:10:08.683 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:10:08.683 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:10:09.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:10:08 smithi157 bash[24585]: cluster 2024-09-16T10:10:07.397490+0000 mgr.a (mgr.14373) 11808 : cluster [DBG] pgmap v8188: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:10:09.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:10:08 smithi086 bash[24289]: cluster 2024-09-16T10:10:07.397490+0000 mgr.a (mgr.14373) 11808 : cluster [DBG] pgmap v8188: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:10:09.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:10:08 smithi047 bash[22744]: cluster 2024-09-16T10:10:07.397490+0000 mgr.a (mgr.14373) 11808 : cluster [DBG] pgmap v8188: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:10:10.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:10:09 smithi157 bash[24585]: audit 2024-09-16T10:10:08.234971+0000 mgr.a (mgr.14373) 11809 : audit [DBG] from='client.258375 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:10:10.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:10:09 smithi086 bash[24289]: audit 2024-09-16T10:10:08.234971+0000 mgr.a (mgr.14373) 11809 : audit [DBG] from='client.258375 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:10:10.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:10:09 smithi047 bash[22744]: audit 2024-09-16T10:10:08.234971+0000 mgr.a (mgr.14373) 11809 : audit [DBG] from='client.258375 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:10:11.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:10:10 smithi157 bash[24585]: cluster 2024-09-16T10:10:09.398479+0000 mgr.a (mgr.14373) 11810 : cluster [DBG] pgmap v8189: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:10:11.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:10:10 smithi086 bash[24289]: cluster 2024-09-16T10:10:09.398479+0000 mgr.a (mgr.14373) 11810 : cluster [DBG] pgmap v8189: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:10:11.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:10:10 smithi047 bash[22744]: cluster 2024-09-16T10:10:09.398479+0000 mgr.a (mgr.14373) 11810 : cluster [DBG] pgmap v8189: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:10:13.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:10:12 smithi157 bash[24585]: cluster 2024-09-16T10:10:11.399270+0000 mgr.a (mgr.14373) 11811 : cluster [DBG] pgmap v8190: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:10:13.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:10:12 smithi086 bash[24289]: cluster 2024-09-16T10:10:11.399270+0000 mgr.a (mgr.14373) 11811 : cluster [DBG] pgmap v8190: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:10:13.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:10:12 smithi047 bash[22744]: cluster 2024-09-16T10:10:11.399270+0000 mgr.a (mgr.14373) 11811 : cluster [DBG] pgmap v8190: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:10:13.684 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:10:13.685 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:10:13.685 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:10:14.463 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:10:14.464 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:10:14.464 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:10:14.464 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:10:14.464 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:10:15.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:10:14 smithi157 bash[24585]: cluster 2024-09-16T10:10:13.401497+0000 mgr.a (mgr.14373) 11812 : cluster [DBG] pgmap v8191: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:10:15.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:10:14 smithi157 bash[24585]: audit 2024-09-16T10:10:14.018814+0000 mgr.a (mgr.14373) 11813 : audit [DBG] from='client.258453 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:10:15.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:10:14 smithi086 bash[24289]: cluster 2024-09-16T10:10:13.401497+0000 mgr.a (mgr.14373) 11812 : cluster [DBG] pgmap v8191: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:10:15.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:10:14 smithi086 bash[24289]: audit 2024-09-16T10:10:14.018814+0000 mgr.a (mgr.14373) 11813 : audit [DBG] from='client.258453 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:10:15.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:10:14 smithi047 bash[22744]: cluster 2024-09-16T10:10:13.401497+0000 mgr.a (mgr.14373) 11812 : cluster [DBG] pgmap v8191: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:10:15.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:10:14 smithi047 bash[22744]: audit 2024-09-16T10:10:14.018814+0000 mgr.a (mgr.14373) 11813 : audit [DBG] from='client.258453 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:10:17.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:10:16 smithi157 bash[24585]: cluster 2024-09-16T10:10:15.402513+0000 mgr.a (mgr.14373) 11814 : cluster [DBG] pgmap v8192: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:10:17.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:10:16 smithi086 bash[24289]: cluster 2024-09-16T10:10:15.402513+0000 mgr.a (mgr.14373) 11814 : cluster [DBG] pgmap v8192: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:10:17.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:10:16 smithi047 bash[22744]: cluster 2024-09-16T10:10:15.402513+0000 mgr.a (mgr.14373) 11814 : cluster [DBG] pgmap v8192: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:10:19.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:10:18 smithi157 bash[24585]: cluster 2024-09-16T10:10:17.404790+0000 mgr.a (mgr.14373) 11815 : cluster [DBG] pgmap v8193: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:10:19.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:10:18 smithi086 bash[24289]: cluster 2024-09-16T10:10:17.404790+0000 mgr.a (mgr.14373) 11815 : cluster [DBG] pgmap v8193: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:10:19.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:10:18 smithi047 bash[22744]: cluster 2024-09-16T10:10:17.404790+0000 mgr.a (mgr.14373) 11815 : cluster [DBG] pgmap v8193: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:10:19.465 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:10:19.466 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:10:19.466 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:10:20.247 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:10:20.247 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:10:20.247 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:10:20.247 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:10:20.247 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:10:21.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:10:20 smithi157 bash[24585]: cluster 2024-09-16T10:10:19.405567+0000 mgr.a (mgr.14373) 11816 : cluster [DBG] pgmap v8194: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:10:21.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:10:20 smithi157 bash[24585]: audit 2024-09-16T10:10:19.802578+0000 mgr.a (mgr.14373) 11817 : audit [DBG] from='client.258531 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:10:21.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:10:20 smithi086 bash[24289]: cluster 2024-09-16T10:10:19.405567+0000 mgr.a (mgr.14373) 11816 : cluster [DBG] pgmap v8194: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:10:21.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:10:20 smithi086 bash[24289]: audit 2024-09-16T10:10:19.802578+0000 mgr.a (mgr.14373) 11817 : audit [DBG] from='client.258531 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:10:21.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:10:20 smithi047 bash[22744]: cluster 2024-09-16T10:10:19.405567+0000 mgr.a (mgr.14373) 11816 : cluster [DBG] pgmap v8194: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:10:21.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:10:20 smithi047 bash[22744]: audit 2024-09-16T10:10:19.802578+0000 mgr.a (mgr.14373) 11817 : audit [DBG] from='client.258531 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:10:23.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:10:22 smithi157 bash[24585]: cluster 2024-09-16T10:10:21.407128+0000 mgr.a (mgr.14373) 11818 : cluster [DBG] pgmap v8195: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-16T10:10:23.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:10:22 smithi086 bash[24289]: cluster 2024-09-16T10:10:21.407128+0000 mgr.a (mgr.14373) 11818 : cluster [DBG] pgmap v8195: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-16T10:10:23.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:10:22 smithi047 bash[22744]: cluster 2024-09-16T10:10:21.407128+0000 mgr.a (mgr.14373) 11818 : cluster [DBG] pgmap v8195: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-16T10:10:25.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:10:24 smithi157 bash[24585]: cluster 2024-09-16T10:10:23.408834+0000 mgr.a (mgr.14373) 11819 : cluster [DBG] pgmap v8196: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:10:25.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:10:24 smithi086 bash[24289]: cluster 2024-09-16T10:10:23.408834+0000 mgr.a (mgr.14373) 11819 : cluster [DBG] pgmap v8196: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:10:25.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:10:24 smithi047 bash[22744]: cluster 2024-09-16T10:10:23.408834+0000 mgr.a (mgr.14373) 11819 : cluster [DBG] pgmap v8196: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:10:25.248 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:10:25.249 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:10:25.249 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:10:26.012 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:10:26.013 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:10:26.013 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:10:26.013 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:10:26.013 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:10:27.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:10:26 smithi157 bash[24585]: cluster 2024-09-16T10:10:25.409528+0000 mgr.a (mgr.14373) 11820 : cluster [DBG] pgmap v8197: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:10:27.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:10:26 smithi157 bash[24585]: audit 2024-09-16T10:10:25.578192+0000 mgr.a (mgr.14373) 11821 : audit [DBG] from='client.258609 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:10:27.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:10:26 smithi086 bash[24289]: cluster 2024-09-16T10:10:25.409528+0000 mgr.a (mgr.14373) 11820 : cluster [DBG] pgmap v8197: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:10:27.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:10:26 smithi086 bash[24289]: audit 2024-09-16T10:10:25.578192+0000 mgr.a (mgr.14373) 11821 : audit [DBG] from='client.258609 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:10:27.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:10:26 smithi047 bash[22744]: cluster 2024-09-16T10:10:25.409528+0000 mgr.a (mgr.14373) 11820 : cluster [DBG] pgmap v8197: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:10:27.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:10:26 smithi047 bash[22744]: audit 2024-09-16T10:10:25.578192+0000 mgr.a (mgr.14373) 11821 : audit [DBG] from='client.258609 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:10:29.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:10:28 smithi157 bash[24585]: cluster 2024-09-16T10:10:27.411953+0000 mgr.a (mgr.14373) 11822 : cluster [DBG] pgmap v8198: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:10:29.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:10:28 smithi086 bash[24289]: cluster 2024-09-16T10:10:27.411953+0000 mgr.a (mgr.14373) 11822 : cluster [DBG] pgmap v8198: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:10:29.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:10:28 smithi047 bash[22744]: cluster 2024-09-16T10:10:27.411953+0000 mgr.a (mgr.14373) 11822 : cluster [DBG] pgmap v8198: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:10:31.014 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:10:31.015 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:10:31.015 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:10:31.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:10:30 smithi157 bash[24585]: cluster 2024-09-16T10:10:29.412721+0000 mgr.a (mgr.14373) 11823 : cluster [DBG] pgmap v8199: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:10:31.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:10:30 smithi086 bash[24289]: cluster 2024-09-16T10:10:29.412721+0000 mgr.a (mgr.14373) 11823 : cluster [DBG] pgmap v8199: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:10:31.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:10:30 smithi047 bash[22744]: cluster 2024-09-16T10:10:29.412721+0000 mgr.a (mgr.14373) 11823 : cluster [DBG] pgmap v8199: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:10:31.797 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:10:31.797 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:10:31.797 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:10:31.798 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:10:31.798 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:10:33.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:10:32 smithi157 bash[24585]: audit 2024-09-16T10:10:31.348679+0000 mgr.a (mgr.14373) 11824 : audit [DBG] from='client.258684 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:10:33.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:10:32 smithi157 bash[24585]: cluster 2024-09-16T10:10:31.413783+0000 mgr.a (mgr.14373) 11825 : cluster [DBG] pgmap v8200: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:10:33.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:10:32 smithi086 bash[24289]: audit 2024-09-16T10:10:31.348679+0000 mgr.a (mgr.14373) 11824 : audit [DBG] from='client.258684 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:10:33.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:10:32 smithi086 bash[24289]: cluster 2024-09-16T10:10:31.413783+0000 mgr.a (mgr.14373) 11825 : cluster [DBG] pgmap v8200: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:10:33.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:10:32 smithi047 bash[22744]: audit 2024-09-16T10:10:31.348679+0000 mgr.a (mgr.14373) 11824 : audit [DBG] from='client.258684 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:10:33.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:10:32 smithi047 bash[22744]: cluster 2024-09-16T10:10:31.413783+0000 mgr.a (mgr.14373) 11825 : cluster [DBG] pgmap v8200: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:10:35.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:10:34 smithi157 bash[24585]: cluster 2024-09-16T10:10:33.416187+0000 mgr.a (mgr.14373) 11826 : cluster [DBG] pgmap v8201: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-16T10:10:35.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:10:34 smithi086 bash[24289]: cluster 2024-09-16T10:10:33.416187+0000 mgr.a (mgr.14373) 11826 : cluster [DBG] pgmap v8201: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-16T10:10:35.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:10:34 smithi047 bash[22744]: cluster 2024-09-16T10:10:33.416187+0000 mgr.a (mgr.14373) 11826 : cluster [DBG] pgmap v8201: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-16T10:10:36.799 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:10:36.799 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:10:36.800 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:10:37.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:10:36 smithi157 bash[24585]: cluster 2024-09-16T10:10:35.417139+0000 mgr.a (mgr.14373) 11827 : cluster [DBG] pgmap v8202: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-16T10:10:37.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:10:36 smithi086 bash[24289]: cluster 2024-09-16T10:10:35.417139+0000 mgr.a (mgr.14373) 11827 : cluster [DBG] pgmap v8202: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-16T10:10:37.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:10:36 smithi047 bash[22744]: cluster 2024-09-16T10:10:35.417139+0000 mgr.a (mgr.14373) 11827 : cluster [DBG] pgmap v8202: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-16T10:10:37.586 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:10:37.586 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:10:37.586 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:10:37.586 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:10:37.586 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:10:39.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:10:38 smithi157 bash[24585]: audit 2024-09-16T10:10:37.129562+0000 mgr.a (mgr.14373) 11828 : audit [DBG] from='client.258759 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:10:39.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:10:38 smithi157 bash[24585]: cluster 2024-09-16T10:10:37.418499+0000 mgr.a (mgr.14373) 11829 : cluster [DBG] pgmap v8203: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:10:39.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:10:38 smithi086 bash[24289]: audit 2024-09-16T10:10:37.129562+0000 mgr.a (mgr.14373) 11828 : audit [DBG] from='client.258759 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:10:39.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:10:38 smithi086 bash[24289]: cluster 2024-09-16T10:10:37.418499+0000 mgr.a (mgr.14373) 11829 : cluster [DBG] pgmap v8203: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:10:39.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:10:38 smithi047 bash[22744]: audit 2024-09-16T10:10:37.129562+0000 mgr.a (mgr.14373) 11828 : audit [DBG] from='client.258759 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:10:39.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:10:38 smithi047 bash[22744]: cluster 2024-09-16T10:10:37.418499+0000 mgr.a (mgr.14373) 11829 : cluster [DBG] pgmap v8203: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:10:41.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:10:40 smithi157 bash[24585]: cluster 2024-09-16T10:10:39.419352+0000 mgr.a (mgr.14373) 11830 : cluster [DBG] pgmap v8204: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:10:41.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:10:40 smithi086 bash[24289]: cluster 2024-09-16T10:10:39.419352+0000 mgr.a (mgr.14373) 11830 : cluster [DBG] pgmap v8204: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:10:41.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:10:40 smithi047 bash[22744]: cluster 2024-09-16T10:10:39.419352+0000 mgr.a (mgr.14373) 11830 : cluster [DBG] pgmap v8204: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:10:42.587 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:10:42.588 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:10:42.588 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:10:43.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:10:42 smithi157 bash[24585]: cluster 2024-09-16T10:10:41.421088+0000 mgr.a (mgr.14373) 11831 : cluster [DBG] pgmap v8205: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-16T10:10:43.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:10:42 smithi086 bash[24289]: cluster 2024-09-16T10:10:41.421088+0000 mgr.a (mgr.14373) 11831 : cluster [DBG] pgmap v8205: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-16T10:10:43.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:10:42 smithi047 bash[22744]: cluster 2024-09-16T10:10:41.421088+0000 mgr.a (mgr.14373) 11831 : cluster [DBG] pgmap v8205: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-16T10:10:43.364 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:10:43.364 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:10:43.364 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:10:43.364 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:10:43.364 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:10:44.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:10:43 smithi157 bash[24585]: audit 2024-09-16T10:10:42.922797+0000 mgr.a (mgr.14373) 11832 : audit [DBG] from='client.258831 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:10:44.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:10:43 smithi086 bash[24289]: audit 2024-09-16T10:10:42.922797+0000 mgr.a (mgr.14373) 11832 : audit [DBG] from='client.258831 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:10:44.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:10:43 smithi047 bash[22744]: audit 2024-09-16T10:10:42.922797+0000 mgr.a (mgr.14373) 11832 : audit [DBG] from='client.258831 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:10:45.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:10:44 smithi157 bash[24585]: cluster 2024-09-16T10:10:43.422146+0000 mgr.a (mgr.14373) 11833 : cluster [DBG] pgmap v8206: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:10:45.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:10:44 smithi086 bash[24289]: cluster 2024-09-16T10:10:43.422146+0000 mgr.a (mgr.14373) 11833 : cluster [DBG] pgmap v8206: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:10:45.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:10:44 smithi047 bash[22744]: cluster 2024-09-16T10:10:43.422146+0000 mgr.a (mgr.14373) 11833 : cluster [DBG] pgmap v8206: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:10:47.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:10:46 smithi157 bash[24585]: cluster 2024-09-16T10:10:45.422883+0000 mgr.a (mgr.14373) 11834 : cluster [DBG] pgmap v8207: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-16T10:10:47.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:10:46 smithi086 bash[24289]: cluster 2024-09-16T10:10:45.422883+0000 mgr.a (mgr.14373) 11834 : cluster [DBG] pgmap v8207: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-16T10:10:47.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:10:46 smithi047 bash[22744]: cluster 2024-09-16T10:10:45.422883+0000 mgr.a (mgr.14373) 11834 : cluster [DBG] pgmap v8207: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-16T10:10:48.365 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:10:48.366 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:10:48.366 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:10:49.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:10:48 smithi157 bash[24585]: cluster 2024-09-16T10:10:47.424953+0000 mgr.a (mgr.14373) 11835 : cluster [DBG] pgmap v8208: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:10:49.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:10:48 smithi086 bash[24289]: cluster 2024-09-16T10:10:47.424953+0000 mgr.a (mgr.14373) 11835 : cluster [DBG] pgmap v8208: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:10:49.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:10:48 smithi047 bash[22744]: cluster 2024-09-16T10:10:47.424953+0000 mgr.a (mgr.14373) 11835 : cluster [DBG] pgmap v8208: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:10:49.146 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:10:49.146 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:10:49.146 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:10:49.146 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:10:49.146 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:10:50.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:10:49 smithi157 bash[24585]: audit 2024-09-16T10:10:48.698104+0000 mgr.a (mgr.14373) 11836 : audit [DBG] from='client.258909 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:10:50.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:10:49 smithi086 bash[24289]: audit 2024-09-16T10:10:48.698104+0000 mgr.a (mgr.14373) 11836 : audit [DBG] from='client.258909 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:10:50.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:10:49 smithi047 bash[22744]: audit 2024-09-16T10:10:48.698104+0000 mgr.a (mgr.14373) 11836 : audit [DBG] from='client.258909 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:10:51.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:10:50 smithi157 bash[24585]: cluster 2024-09-16T10:10:49.425900+0000 mgr.a (mgr.14373) 11837 : cluster [DBG] pgmap v8209: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:10:51.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:10:50 smithi086 bash[24289]: cluster 2024-09-16T10:10:49.425900+0000 mgr.a (mgr.14373) 11837 : cluster [DBG] pgmap v8209: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:10:51.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:10:50 smithi047 bash[22744]: cluster 2024-09-16T10:10:49.425900+0000 mgr.a (mgr.14373) 11837 : cluster [DBG] pgmap v8209: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:10:53.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:10:52 smithi157 bash[24585]: cluster 2024-09-16T10:10:51.427613+0000 mgr.a (mgr.14373) 11838 : cluster [DBG] pgmap v8210: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:10:53.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:10:52 smithi086 bash[24289]: cluster 2024-09-16T10:10:51.427613+0000 mgr.a (mgr.14373) 11838 : cluster [DBG] pgmap v8210: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:10:53.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:10:52 smithi047 bash[22744]: cluster 2024-09-16T10:10:51.427613+0000 mgr.a (mgr.14373) 11838 : cluster [DBG] pgmap v8210: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:10:54.147 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:10:54.148 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:10:54.148 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:10:54.883 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:10:54.884 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:10:54.884 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:10:54.884 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:10:54.884 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:10:55.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:10:54 smithi157 bash[24585]: cluster 2024-09-16T10:10:53.428860+0000 mgr.a (mgr.14373) 11839 : cluster [DBG] pgmap v8211: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-16T10:10:55.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:10:54 smithi086 bash[24289]: cluster 2024-09-16T10:10:53.428860+0000 mgr.a (mgr.14373) 11839 : cluster [DBG] pgmap v8211: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-16T10:10:55.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:10:54 smithi047 bash[22744]: cluster 2024-09-16T10:10:53.428860+0000 mgr.a (mgr.14373) 11839 : cluster [DBG] pgmap v8211: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-16T10:10:56.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:10:55 smithi157 bash[24585]: audit 2024-09-16T10:10:54.472846+0000 mgr.a (mgr.14373) 11840 : audit [DBG] from='client.258984 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:10:56.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:10:55 smithi086 bash[24289]: audit 2024-09-16T10:10:54.472846+0000 mgr.a (mgr.14373) 11840 : audit [DBG] from='client.258984 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:10:56.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:10:55 smithi047 bash[22744]: audit 2024-09-16T10:10:54.472846+0000 mgr.a (mgr.14373) 11840 : audit [DBG] from='client.258984 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:10:57.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:10:56 smithi157 bash[24585]: cluster 2024-09-16T10:10:55.429769+0000 mgr.a (mgr.14373) 11841 : cluster [DBG] pgmap v8212: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:10:57.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:10:56 smithi086 bash[24289]: cluster 2024-09-16T10:10:55.429769+0000 mgr.a (mgr.14373) 11841 : cluster [DBG] pgmap v8212: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:10:57.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:10:56 smithi047 bash[22744]: cluster 2024-09-16T10:10:55.429769+0000 mgr.a (mgr.14373) 11841 : cluster [DBG] pgmap v8212: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:10:59.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:10:58 smithi157 bash[24585]: cluster 2024-09-16T10:10:57.432052+0000 mgr.a (mgr.14373) 11842 : cluster [DBG] pgmap v8213: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:10:59.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:10:58 smithi086 bash[24289]: cluster 2024-09-16T10:10:57.432052+0000 mgr.a (mgr.14373) 11842 : cluster [DBG] pgmap v8213: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:10:59.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:10:58 smithi047 bash[22744]: cluster 2024-09-16T10:10:57.432052+0000 mgr.a (mgr.14373) 11842 : cluster [DBG] pgmap v8213: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:10:59.885 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:10:59.886 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:10:59.886 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:11:00.643 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:11:00.643 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:11:00.643 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:11:00.643 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:11:00.643 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:11:01.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:11:00 smithi157 bash[24585]: cluster 2024-09-16T10:10:59.432809+0000 mgr.a (mgr.14373) 11843 : cluster [DBG] pgmap v8214: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:11:01.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:11:00 smithi157 bash[24585]: audit 2024-09-16T10:11:00.491902+0000 mon.b (mon.2) 1090 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T10:11:01.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:11:00 smithi086 bash[24289]: cluster 2024-09-16T10:10:59.432809+0000 mgr.a (mgr.14373) 11843 : cluster [DBG] pgmap v8214: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:11:01.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:11:00 smithi086 bash[24289]: audit 2024-09-16T10:11:00.491902+0000 mon.b (mon.2) 1090 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T10:11:01.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:11:00 smithi047 bash[22744]: cluster 2024-09-16T10:10:59.432809+0000 mgr.a (mgr.14373) 11843 : cluster [DBG] pgmap v8214: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:11:01.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:11:00 smithi047 bash[22744]: audit 2024-09-16T10:11:00.491902+0000 mon.b (mon.2) 1090 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T10:11:02.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:11:01 smithi157 bash[24585]: audit 2024-09-16T10:11:00.215866+0000 mgr.a (mgr.14373) 11844 : audit [DBG] from='client.259062 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:11:02.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:11:01 smithi086 bash[24289]: audit 2024-09-16T10:11:00.215866+0000 mgr.a (mgr.14373) 11844 : audit [DBG] from='client.259062 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:11:02.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:11:01 smithi047 bash[22744]: audit 2024-09-16T10:11:00.215866+0000 mgr.a (mgr.14373) 11844 : audit [DBG] from='client.259062 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:11:03.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:11:02 smithi157 bash[24585]: cluster 2024-09-16T10:11:01.434640+0000 mgr.a (mgr.14373) 11845 : cluster [DBG] pgmap v8215: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:11:03.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:11:02 smithi086 bash[24289]: cluster 2024-09-16T10:11:01.434640+0000 mgr.a (mgr.14373) 11845 : cluster [DBG] pgmap v8215: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:11:03.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:11:02 smithi047 bash[22744]: cluster 2024-09-16T10:11:01.434640+0000 mgr.a (mgr.14373) 11845 : cluster [DBG] pgmap v8215: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:11:05.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:11:04 smithi157 bash[24585]: cluster 2024-09-16T10:11:03.435915+0000 mgr.a (mgr.14373) 11846 : cluster [DBG] pgmap v8216: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-16T10:11:05.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:11:04 smithi086 bash[24289]: cluster 2024-09-16T10:11:03.435915+0000 mgr.a (mgr.14373) 11846 : cluster [DBG] pgmap v8216: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-16T10:11:05.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:11:04 smithi047 bash[22744]: cluster 2024-09-16T10:11:03.435915+0000 mgr.a (mgr.14373) 11846 : cluster [DBG] pgmap v8216: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-16T10:11:05.644 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:11:05.645 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:11:05.645 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:11:06.421 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:11:06.422 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:11:06.422 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:11:06.422 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:11:06.422 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:11:06.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:11:06 smithi157 bash[24585]: cluster 2024-09-16T10:11:05.436684+0000 mgr.a (mgr.14373) 11847 : cluster [DBG] pgmap v8217: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:11:06.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:11:06 smithi157 bash[24585]: audit 2024-09-16T10:11:05.975515+0000 mgr.a (mgr.14373) 11848 : audit [DBG] from='client.259137 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:11:06.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:11:06 smithi086 bash[24289]: cluster 2024-09-16T10:11:05.436684+0000 mgr.a (mgr.14373) 11847 : cluster [DBG] pgmap v8217: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:11:06.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:11:06 smithi086 bash[24289]: audit 2024-09-16T10:11:05.975515+0000 mgr.a (mgr.14373) 11848 : audit [DBG] from='client.259137 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:11:06.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:11:06 smithi047 bash[22744]: cluster 2024-09-16T10:11:05.436684+0000 mgr.a (mgr.14373) 11847 : cluster [DBG] pgmap v8217: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:11:06.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:11:06 smithi047 bash[22744]: audit 2024-09-16T10:11:05.975515+0000 mgr.a (mgr.14373) 11848 : audit [DBG] from='client.259137 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:11:08.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:11:08 smithi157 bash[24585]: cluster 2024-09-16T10:11:07.439151+0000 mgr.a (mgr.14373) 11849 : cluster [DBG] pgmap v8218: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:11:08.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:11:08 smithi086 bash[24289]: cluster 2024-09-16T10:11:07.439151+0000 mgr.a (mgr.14373) 11849 : cluster [DBG] pgmap v8218: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:11:08.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:11:08 smithi047 bash[22744]: cluster 2024-09-16T10:11:07.439151+0000 mgr.a (mgr.14373) 11849 : cluster [DBG] pgmap v8218: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:11:10.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:11:10 smithi157 bash[24585]: cluster 2024-09-16T10:11:09.439931+0000 mgr.a (mgr.14373) 11850 : cluster [DBG] pgmap v8219: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:11:10.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:11:10 smithi086 bash[24289]: cluster 2024-09-16T10:11:09.439931+0000 mgr.a (mgr.14373) 11850 : cluster [DBG] pgmap v8219: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:11:10.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:11:10 smithi047 bash[22744]: cluster 2024-09-16T10:11:09.439931+0000 mgr.a (mgr.14373) 11850 : cluster [DBG] pgmap v8219: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:11:11.422 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:11:11.423 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:11:11.423 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:11:12.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:11:11 smithi047 bash[22744]: audit 2024-09-16T10:11:10.904333+0000 mon.a (mon.0) 1270 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:11:12.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:11:11 smithi047 bash[22744]: audit 2024-09-16T10:11:10.914704+0000 mon.a (mon.0) 1271 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:11:12.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:11:11 smithi047 bash[22744]: audit 2024-09-16T10:11:10.917487+0000 mon.b (mon.2) 1091 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T10:11:12.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:11:11 smithi047 bash[22744]: audit 2024-09-16T10:11:10.919786+0000 mon.b (mon.2) 1092 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T10:11:12.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:11:11 smithi047 bash[22744]: audit 2024-09-16T10:11:10.931913+0000 mon.a (mon.0) 1272 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:11:12.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:11:11 smithi047 bash[22744]: audit 2024-09-16T10:11:10.937086+0000 mon.b (mon.2) 1093 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:11:12.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:11:11 smithi047 bash[22744]: audit 2024-09-16T10:11:10.939934+0000 mgr.a (mgr.14373) 11851 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:11:12.093 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 10:11:11 smithi047 bash[22994]: debug 2024-09-16T10:11:11.688+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T10:11:12.093 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 10:11:11 smithi047 bash[22994]: debug 2024-09-16T10:11:11.692+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T10:11:12.155 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:11:12.155 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:11:12.155 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:11:12.156 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:11:12.156 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:11:12.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:11:11 smithi157 bash[24585]: audit 2024-09-16T10:11:10.904333+0000 mon.a (mon.0) 1270 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:11:12.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:11:11 smithi157 bash[24585]: audit 2024-09-16T10:11:10.914704+0000 mon.a (mon.0) 1271 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:11:12.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:11:11 smithi157 bash[24585]: audit 2024-09-16T10:11:10.917487+0000 mon.b (mon.2) 1091 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T10:11:12.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:11:11 smithi157 bash[24585]: audit 2024-09-16T10:11:10.919786+0000 mon.b (mon.2) 1092 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T10:11:12.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:11:11 smithi157 bash[24585]: audit 2024-09-16T10:11:10.931913+0000 mon.a (mon.0) 1272 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:11:12.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:11:11 smithi157 bash[24585]: audit 2024-09-16T10:11:10.937086+0000 mon.b (mon.2) 1093 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:11:12.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:11:11 smithi157 bash[24585]: audit 2024-09-16T10:11:10.939934+0000 mgr.a (mgr.14373) 11851 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:11:12.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:11:11 smithi086 bash[24289]: audit 2024-09-16T10:11:10.904333+0000 mon.a (mon.0) 1270 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:11:12.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:11:11 smithi086 bash[24289]: audit 2024-09-16T10:11:10.914704+0000 mon.a (mon.0) 1271 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:11:12.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:11:11 smithi086 bash[24289]: audit 2024-09-16T10:11:10.917487+0000 mon.b (mon.2) 1091 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T10:11:12.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:11:11 smithi086 bash[24289]: audit 2024-09-16T10:11:10.919786+0000 mon.b (mon.2) 1092 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T10:11:12.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:11:11 smithi086 bash[24289]: audit 2024-09-16T10:11:10.931913+0000 mon.a (mon.0) 1272 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:11:12.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:11:11 smithi086 bash[24289]: audit 2024-09-16T10:11:10.937086+0000 mon.b (mon.2) 1093 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:11:12.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:11:11 smithi086 bash[24289]: audit 2024-09-16T10:11:10.939934+0000 mgr.a (mgr.14373) 11851 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:11:13.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:11:12 smithi157 bash[24585]: cluster 2024-09-16T10:11:11.440895+0000 mgr.a (mgr.14373) 11852 : cluster [DBG] pgmap v8220: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 3.2 KiB/s rd, 170 B/s wr, 3 op/s 2024-09-16T10:11:13.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:11:12 smithi157 bash[24585]: audit 2024-09-16T10:11:11.693081+0000 mgr.a (mgr.14373) 11853 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T10:11:13.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:11:12 smithi157 bash[24585]: cephadm 2024-09-16T10:11:11.694911+0000 mgr.a (mgr.14373) 11854 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T10:11:13.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:11:12 smithi157 bash[24585]: audit 2024-09-16T10:11:11.743824+0000 mgr.a (mgr.14373) 11855 : audit [DBG] from='client.259302 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:11:13.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:11:12 smithi086 bash[24289]: cluster 2024-09-16T10:11:11.440895+0000 mgr.a (mgr.14373) 11852 : cluster [DBG] pgmap v8220: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 3.2 KiB/s rd, 170 B/s wr, 3 op/s 2024-09-16T10:11:13.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:11:12 smithi086 bash[24289]: audit 2024-09-16T10:11:11.693081+0000 mgr.a (mgr.14373) 11853 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T10:11:13.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:11:12 smithi086 bash[24289]: cephadm 2024-09-16T10:11:11.694911+0000 mgr.a (mgr.14373) 11854 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T10:11:13.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:11:12 smithi086 bash[24289]: audit 2024-09-16T10:11:11.743824+0000 mgr.a (mgr.14373) 11855 : audit [DBG] from='client.259302 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:11:13.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:11:12 smithi047 bash[22744]: cluster 2024-09-16T10:11:11.440895+0000 mgr.a (mgr.14373) 11852 : cluster [DBG] pgmap v8220: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 3.2 KiB/s rd, 170 B/s wr, 3 op/s 2024-09-16T10:11:13.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:11:12 smithi047 bash[22744]: audit 2024-09-16T10:11:11.693081+0000 mgr.a (mgr.14373) 11853 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T10:11:13.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:11:12 smithi047 bash[22744]: cephadm 2024-09-16T10:11:11.694911+0000 mgr.a (mgr.14373) 11854 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T10:11:13.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:11:12 smithi047 bash[22744]: audit 2024-09-16T10:11:11.743824+0000 mgr.a (mgr.14373) 11855 : audit [DBG] from='client.259302 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:11:15.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:11:14 smithi157 bash[24585]: cluster 2024-09-16T10:11:13.442746+0000 mgr.a (mgr.14373) 11856 : cluster [DBG] pgmap v8221: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 3.2 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-16T10:11:15.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:11:14 smithi086 bash[24289]: cluster 2024-09-16T10:11:13.442746+0000 mgr.a (mgr.14373) 11856 : cluster [DBG] pgmap v8221: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 3.2 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-16T10:11:15.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:11:14 smithi047 bash[22744]: cluster 2024-09-16T10:11:13.442746+0000 mgr.a (mgr.14373) 11856 : cluster [DBG] pgmap v8221: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 3.2 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-16T10:11:17.157 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:11:17.157 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:11:17.157 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:11:17.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:11:16 smithi157 bash[24585]: cluster 2024-09-16T10:11:15.443738+0000 mgr.a (mgr.14373) 11857 : cluster [DBG] pgmap v8222: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 3.2 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-16T10:11:17.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:11:16 smithi086 bash[24289]: cluster 2024-09-16T10:11:15.443738+0000 mgr.a (mgr.14373) 11857 : cluster [DBG] pgmap v8222: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 3.2 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-16T10:11:17.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:11:16 smithi047 bash[22744]: cluster 2024-09-16T10:11:15.443738+0000 mgr.a (mgr.14373) 11857 : cluster [DBG] pgmap v8222: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 3.2 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-16T10:11:17.940 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:11:17.940 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:11:17.940 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:11:17.940 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:11:17.940 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:11:19.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:11:18 smithi157 bash[24585]: cluster 2024-09-16T10:11:17.445789+0000 mgr.a (mgr.14373) 11858 : cluster [DBG] pgmap v8223: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:11:19.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:11:18 smithi157 bash[24585]: audit 2024-09-16T10:11:17.488173+0000 mgr.a (mgr.14373) 11859 : audit [DBG] from='client.259398 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:11:19.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:11:18 smithi086 bash[24289]: cluster 2024-09-16T10:11:17.445789+0000 mgr.a (mgr.14373) 11858 : cluster [DBG] pgmap v8223: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:11:19.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:11:18 smithi086 bash[24289]: audit 2024-09-16T10:11:17.488173+0000 mgr.a (mgr.14373) 11859 : audit [DBG] from='client.259398 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:11:19.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:11:18 smithi047 bash[22744]: cluster 2024-09-16T10:11:17.445789+0000 mgr.a (mgr.14373) 11858 : cluster [DBG] pgmap v8223: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:11:19.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:11:18 smithi047 bash[22744]: audit 2024-09-16T10:11:17.488173+0000 mgr.a (mgr.14373) 11859 : audit [DBG] from='client.259398 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:11:21.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:11:20 smithi157 bash[24585]: cluster 2024-09-16T10:11:19.446713+0000 mgr.a (mgr.14373) 11860 : cluster [DBG] pgmap v8224: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T10:11:21.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:11:20 smithi086 bash[24289]: cluster 2024-09-16T10:11:19.446713+0000 mgr.a (mgr.14373) 11860 : cluster [DBG] pgmap v8224: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T10:11:21.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:11:20 smithi047 bash[22744]: cluster 2024-09-16T10:11:19.446713+0000 mgr.a (mgr.14373) 11860 : cluster [DBG] pgmap v8224: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T10:11:22.941 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:11:22.942 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:11:22.942 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:11:23.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:11:22 smithi157 bash[24585]: cluster 2024-09-16T10:11:21.448440+0000 mgr.a (mgr.14373) 11861 : cluster [DBG] pgmap v8225: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 6.9 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T10:11:23.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:11:22 smithi086 bash[24289]: cluster 2024-09-16T10:11:21.448440+0000 mgr.a (mgr.14373) 11861 : cluster [DBG] pgmap v8225: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 6.9 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T10:11:23.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:11:22 smithi047 bash[22744]: cluster 2024-09-16T10:11:21.448440+0000 mgr.a (mgr.14373) 11861 : cluster [DBG] pgmap v8225: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 6.9 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T10:11:23.725 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:11:23.725 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:11:23.725 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:11:23.725 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:11:23.725 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:11:25.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:11:24 smithi157 bash[24585]: audit 2024-09-16T10:11:23.275640+0000 mgr.a (mgr.14373) 11862 : audit [DBG] from='client.259476 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:11:25.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:11:24 smithi157 bash[24585]: cluster 2024-09-16T10:11:23.450573+0000 mgr.a (mgr.14373) 11863 : cluster [DBG] pgmap v8226: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 5.6 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-16T10:11:25.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:11:24 smithi086 bash[24289]: audit 2024-09-16T10:11:23.275640+0000 mgr.a (mgr.14373) 11862 : audit [DBG] from='client.259476 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:11:25.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:11:24 smithi086 bash[24289]: cluster 2024-09-16T10:11:23.450573+0000 mgr.a (mgr.14373) 11863 : cluster [DBG] pgmap v8226: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 5.6 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-16T10:11:25.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:11:24 smithi047 bash[22744]: audit 2024-09-16T10:11:23.275640+0000 mgr.a (mgr.14373) 11862 : audit [DBG] from='client.259476 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:11:25.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:11:24 smithi047 bash[22744]: cluster 2024-09-16T10:11:23.450573+0000 mgr.a (mgr.14373) 11863 : cluster [DBG] pgmap v8226: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 5.6 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-16T10:11:27.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:11:26 smithi157 bash[24585]: cluster 2024-09-16T10:11:25.451599+0000 mgr.a (mgr.14373) 11864 : cluster [DBG] pgmap v8227: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 4.7 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-16T10:11:27.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:11:26 smithi086 bash[24289]: cluster 2024-09-16T10:11:25.451599+0000 mgr.a (mgr.14373) 11864 : cluster [DBG] pgmap v8227: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 4.7 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-16T10:11:27.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:11:26 smithi047 bash[22744]: cluster 2024-09-16T10:11:25.451599+0000 mgr.a (mgr.14373) 11864 : cluster [DBG] pgmap v8227: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 4.7 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-16T10:11:28.726 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:11:28.727 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:11:28.727 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:11:29.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:11:28 smithi157 bash[24585]: cluster 2024-09-16T10:11:27.453853+0000 mgr.a (mgr.14373) 11865 : cluster [DBG] pgmap v8228: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 5.7 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-16T10:11:29.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:11:28 smithi086 bash[24289]: cluster 2024-09-16T10:11:27.453853+0000 mgr.a (mgr.14373) 11865 : cluster [DBG] pgmap v8228: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 5.7 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-16T10:11:29.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:11:28 smithi047 bash[22744]: cluster 2024-09-16T10:11:27.453853+0000 mgr.a (mgr.14373) 11865 : cluster [DBG] pgmap v8228: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 5.7 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-16T10:11:29.506 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:11:29.506 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:11:29.507 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:11:29.507 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:11:29.507 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:11:30.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:11:29 smithi157 bash[24585]: audit 2024-09-16T10:11:29.061397+0000 mgr.a (mgr.14373) 11866 : audit [DBG] from='client.259551 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:11:30.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:11:29 smithi086 bash[24289]: audit 2024-09-16T10:11:29.061397+0000 mgr.a (mgr.14373) 11866 : audit [DBG] from='client.259551 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:11:30.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:11:29 smithi047 bash[22744]: audit 2024-09-16T10:11:29.061397+0000 mgr.a (mgr.14373) 11866 : audit [DBG] from='client.259551 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:11:31.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:11:30 smithi157 bash[24585]: cluster 2024-09-16T10:11:29.454422+0000 mgr.a (mgr.14373) 11867 : cluster [DBG] pgmap v8229: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:11:31.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:11:30 smithi086 bash[24289]: cluster 2024-09-16T10:11:29.454422+0000 mgr.a (mgr.14373) 11867 : cluster [DBG] pgmap v8229: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:11:31.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:11:30 smithi047 bash[22744]: cluster 2024-09-16T10:11:29.454422+0000 mgr.a (mgr.14373) 11867 : cluster [DBG] pgmap v8229: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:11:33.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:11:32 smithi157 bash[24585]: cluster 2024-09-16T10:11:31.456116+0000 mgr.a (mgr.14373) 11868 : cluster [DBG] pgmap v8230: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:11:33.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:11:32 smithi086 bash[24289]: cluster 2024-09-16T10:11:31.456116+0000 mgr.a (mgr.14373) 11868 : cluster [DBG] pgmap v8230: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:11:33.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:11:32 smithi047 bash[22744]: cluster 2024-09-16T10:11:31.456116+0000 mgr.a (mgr.14373) 11868 : cluster [DBG] pgmap v8230: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:11:34.508 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:11:34.509 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:11:34.509 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:11:35.258 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:11:35.259 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:11:35.259 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:11:35.259 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:11:35.259 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:11:35.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:11:34 smithi157 bash[24585]: cluster 2024-09-16T10:11:33.457384+0000 mgr.a (mgr.14373) 11869 : cluster [DBG] pgmap v8231: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-16T10:11:35.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:11:34 smithi086 bash[24289]: cluster 2024-09-16T10:11:33.457384+0000 mgr.a (mgr.14373) 11869 : cluster [DBG] pgmap v8231: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-16T10:11:35.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:11:34 smithi047 bash[22744]: cluster 2024-09-16T10:11:33.457384+0000 mgr.a (mgr.14373) 11869 : cluster [DBG] pgmap v8231: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-16T10:11:36.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:11:35 smithi157 bash[24585]: audit 2024-09-16T10:11:34.838189+0000 mgr.a (mgr.14373) 11870 : audit [DBG] from='client.259626 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:11:36.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:11:35 smithi086 bash[24289]: audit 2024-09-16T10:11:34.838189+0000 mgr.a (mgr.14373) 11870 : audit [DBG] from='client.259626 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:11:36.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:11:35 smithi047 bash[22744]: audit 2024-09-16T10:11:34.838189+0000 mgr.a (mgr.14373) 11870 : audit [DBG] from='client.259626 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:11:37.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:11:36 smithi157 bash[24585]: cluster 2024-09-16T10:11:35.458320+0000 mgr.a (mgr.14373) 11871 : cluster [DBG] pgmap v8232: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:11:37.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:11:36 smithi086 bash[24289]: cluster 2024-09-16T10:11:35.458320+0000 mgr.a (mgr.14373) 11871 : cluster [DBG] pgmap v8232: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:11:37.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:11:36 smithi047 bash[22744]: cluster 2024-09-16T10:11:35.458320+0000 mgr.a (mgr.14373) 11871 : cluster [DBG] pgmap v8232: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:11:39.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:11:39 smithi157 bash[24585]: cluster 2024-09-16T10:11:37.460555+0000 mgr.a (mgr.14373) 11872 : cluster [DBG] pgmap v8233: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:11:39.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:11:39 smithi086 bash[24289]: cluster 2024-09-16T10:11:37.460555+0000 mgr.a (mgr.14373) 11872 : cluster [DBG] pgmap v8233: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:11:39.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:11:39 smithi047 bash[22744]: cluster 2024-09-16T10:11:37.460555+0000 mgr.a (mgr.14373) 11872 : cluster [DBG] pgmap v8233: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:11:40.260 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:11:40.260 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:11:40.261 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:11:41.016 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:11:41.016 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:11:41.017 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:11:41.017 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:11:41.017 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:11:41.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:11:41 smithi157 bash[24585]: cluster 2024-09-16T10:11:39.461306+0000 mgr.a (mgr.14373) 11873 : cluster [DBG] pgmap v8234: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:11:41.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:11:41 smithi086 bash[24289]: cluster 2024-09-16T10:11:39.461306+0000 mgr.a (mgr.14373) 11873 : cluster [DBG] pgmap v8234: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:11:41.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:11:41 smithi047 bash[22744]: cluster 2024-09-16T10:11:39.461306+0000 mgr.a (mgr.14373) 11873 : cluster [DBG] pgmap v8234: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:11:42.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:11:42 smithi157 bash[24585]: audit 2024-09-16T10:11:40.590543+0000 mgr.a (mgr.14373) 11874 : audit [DBG] from='client.259701 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:11:42.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:11:42 smithi086 bash[24289]: audit 2024-09-16T10:11:40.590543+0000 mgr.a (mgr.14373) 11874 : audit [DBG] from='client.259701 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:11:42.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:11:42 smithi047 bash[22744]: audit 2024-09-16T10:11:40.590543+0000 mgr.a (mgr.14373) 11874 : audit [DBG] from='client.259701 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:11:43.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:11:43 smithi157 bash[24585]: cluster 2024-09-16T10:11:41.463225+0000 mgr.a (mgr.14373) 11875 : cluster [DBG] pgmap v8235: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:11:43.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:11:43 smithi086 bash[24289]: cluster 2024-09-16T10:11:41.463225+0000 mgr.a (mgr.14373) 11875 : cluster [DBG] pgmap v8235: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:11:43.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:11:43 smithi047 bash[22744]: cluster 2024-09-16T10:11:41.463225+0000 mgr.a (mgr.14373) 11875 : cluster [DBG] pgmap v8235: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:11:45.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:11:45 smithi157 bash[24585]: cluster 2024-09-16T10:11:43.464641+0000 mgr.a (mgr.14373) 11876 : cluster [DBG] pgmap v8236: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-16T10:11:45.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:11:45 smithi086 bash[24289]: cluster 2024-09-16T10:11:43.464641+0000 mgr.a (mgr.14373) 11876 : cluster [DBG] pgmap v8236: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-16T10:11:45.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:11:45 smithi047 bash[22744]: cluster 2024-09-16T10:11:43.464641+0000 mgr.a (mgr.14373) 11876 : cluster [DBG] pgmap v8236: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-16T10:11:46.018 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:11:46.018 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:11:46.019 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:11:46.765 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:11:46.766 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:11:46.766 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:11:46.766 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:11:46.766 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:11:47.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:11:47 smithi157 bash[24585]: cluster 2024-09-16T10:11:45.465593+0000 mgr.a (mgr.14373) 11877 : cluster [DBG] pgmap v8237: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:11:47.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:11:47 smithi086 bash[24289]: cluster 2024-09-16T10:11:45.465593+0000 mgr.a (mgr.14373) 11877 : cluster [DBG] pgmap v8237: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:11:47.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:11:47 smithi047 bash[22744]: cluster 2024-09-16T10:11:45.465593+0000 mgr.a (mgr.14373) 11877 : cluster [DBG] pgmap v8237: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:11:48.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:11:48 smithi157 bash[24585]: audit 2024-09-16T10:11:46.349773+0000 mgr.a (mgr.14373) 11878 : audit [DBG] from='client.259779 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:11:48.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:11:48 smithi086 bash[24289]: audit 2024-09-16T10:11:46.349773+0000 mgr.a (mgr.14373) 11878 : audit [DBG] from='client.259779 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:11:48.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:11:48 smithi047 bash[22744]: audit 2024-09-16T10:11:46.349773+0000 mgr.a (mgr.14373) 11878 : audit [DBG] from='client.259779 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:11:49.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:11:49 smithi157 bash[24585]: cluster 2024-09-16T10:11:47.468414+0000 mgr.a (mgr.14373) 11879 : cluster [DBG] pgmap v8238: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-16T10:11:49.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:11:49 smithi086 bash[24289]: cluster 2024-09-16T10:11:47.468414+0000 mgr.a (mgr.14373) 11879 : cluster [DBG] pgmap v8238: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-16T10:11:49.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:11:49 smithi047 bash[22744]: cluster 2024-09-16T10:11:47.468414+0000 mgr.a (mgr.14373) 11879 : cluster [DBG] pgmap v8238: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-16T10:11:51.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:11:51 smithi157 bash[24585]: cluster 2024-09-16T10:11:49.469221+0000 mgr.a (mgr.14373) 11880 : cluster [DBG] pgmap v8239: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-16T10:11:51.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:11:51 smithi086 bash[24289]: cluster 2024-09-16T10:11:49.469221+0000 mgr.a (mgr.14373) 11880 : cluster [DBG] pgmap v8239: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-16T10:11:51.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:11:51 smithi047 bash[22744]: cluster 2024-09-16T10:11:49.469221+0000 mgr.a (mgr.14373) 11880 : cluster [DBG] pgmap v8239: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-16T10:11:51.767 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:11:51.768 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:11:51.768 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:11:52.530 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:11:52.530 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:11:52.530 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:11:52.530 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:11:52.531 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:11:53.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:11:53 smithi157 bash[24585]: cluster 2024-09-16T10:11:51.470783+0000 mgr.a (mgr.14373) 11881 : cluster [DBG] pgmap v8240: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:11:53.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:11:53 smithi157 bash[24585]: audit 2024-09-16T10:11:52.097090+0000 mgr.a (mgr.14373) 11882 : audit [DBG] from='client.259857 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:11:53.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:11:53 smithi086 bash[24289]: cluster 2024-09-16T10:11:51.470783+0000 mgr.a (mgr.14373) 11881 : cluster [DBG] pgmap v8240: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:11:53.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:11:53 smithi086 bash[24289]: audit 2024-09-16T10:11:52.097090+0000 mgr.a (mgr.14373) 11882 : audit [DBG] from='client.259857 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:11:53.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:11:53 smithi047 bash[22744]: cluster 2024-09-16T10:11:51.470783+0000 mgr.a (mgr.14373) 11881 : cluster [DBG] pgmap v8240: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:11:53.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:11:53 smithi047 bash[22744]: audit 2024-09-16T10:11:52.097090+0000 mgr.a (mgr.14373) 11882 : audit [DBG] from='client.259857 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:11:55.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:11:55 smithi157 bash[24585]: cluster 2024-09-16T10:11:53.472523+0000 mgr.a (mgr.14373) 11883 : cluster [DBG] pgmap v8241: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-16T10:11:55.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:11:55 smithi086 bash[24289]: cluster 2024-09-16T10:11:53.472523+0000 mgr.a (mgr.14373) 11883 : cluster [DBG] pgmap v8241: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-16T10:11:55.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:11:55 smithi047 bash[22744]: cluster 2024-09-16T10:11:53.472523+0000 mgr.a (mgr.14373) 11883 : cluster [DBG] pgmap v8241: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-16T10:11:57.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:11:57 smithi157 bash[24585]: cluster 2024-09-16T10:11:55.473305+0000 mgr.a (mgr.14373) 11884 : cluster [DBG] pgmap v8242: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:11:57.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:11:57 smithi086 bash[24289]: cluster 2024-09-16T10:11:55.473305+0000 mgr.a (mgr.14373) 11884 : cluster [DBG] pgmap v8242: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:11:57.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:11:57 smithi047 bash[22744]: cluster 2024-09-16T10:11:55.473305+0000 mgr.a (mgr.14373) 11884 : cluster [DBG] pgmap v8242: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:11:57.531 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:11:57.532 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:11:57.532 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:11:58.277 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:11:58.277 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:11:58.277 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:11:58.277 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:11:58.278 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:11:59.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:11:59 smithi157 bash[24585]: cluster 2024-09-16T10:11:57.475407+0000 mgr.a (mgr.14373) 11885 : cluster [DBG] pgmap v8243: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:11:59.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:11:59 smithi157 bash[24585]: audit 2024-09-16T10:11:57.862192+0000 mgr.a (mgr.14373) 11886 : audit [DBG] from='client.259935 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:11:59.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:11:59 smithi086 bash[24289]: cluster 2024-09-16T10:11:57.475407+0000 mgr.a (mgr.14373) 11885 : cluster [DBG] pgmap v8243: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:11:59.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:11:59 smithi086 bash[24289]: audit 2024-09-16T10:11:57.862192+0000 mgr.a (mgr.14373) 11886 : audit [DBG] from='client.259935 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:11:59.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:11:59 smithi047 bash[22744]: cluster 2024-09-16T10:11:57.475407+0000 mgr.a (mgr.14373) 11885 : cluster [DBG] pgmap v8243: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:11:59.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:11:59 smithi047 bash[22744]: audit 2024-09-16T10:11:57.862192+0000 mgr.a (mgr.14373) 11886 : audit [DBG] from='client.259935 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:12:01.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:12:01 smithi086 bash[24289]: cluster 2024-09-16T10:11:59.476335+0000 mgr.a (mgr.14373) 11887 : cluster [DBG] pgmap v8244: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-16T10:12:01.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:12:01 smithi047 bash[22744]: cluster 2024-09-16T10:11:59.476335+0000 mgr.a (mgr.14373) 11887 : cluster [DBG] pgmap v8244: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-16T10:12:01.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:12:01 smithi157 bash[24585]: cluster 2024-09-16T10:11:59.476335+0000 mgr.a (mgr.14373) 11887 : cluster [DBG] pgmap v8244: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-16T10:12:03.279 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:12:03.279 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:12:03.280 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:12:03.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:12:03 smithi086 bash[24289]: cluster 2024-09-16T10:12:01.478066+0000 mgr.a (mgr.14373) 11888 : cluster [DBG] pgmap v8245: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-09-16T10:12:03.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:12:03 smithi047 bash[22744]: cluster 2024-09-16T10:12:01.478066+0000 mgr.a (mgr.14373) 11888 : cluster [DBG] pgmap v8245: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-09-16T10:12:03.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:12:03 smithi157 bash[24585]: cluster 2024-09-16T10:12:01.478066+0000 mgr.a (mgr.14373) 11888 : cluster [DBG] pgmap v8245: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-09-16T10:12:04.020 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:12:04.020 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:12:04.020 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:12:04.020 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:12:04.020 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:12:05.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:12:05 smithi086 bash[24289]: cluster 2024-09-16T10:12:03.479292+0000 mgr.a (mgr.14373) 11889 : cluster [DBG] pgmap v8246: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:12:05.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:12:05 smithi086 bash[24289]: audit 2024-09-16T10:12:03.607775+0000 mgr.a (mgr.14373) 11890 : audit [DBG] from='client.260013 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:12:05.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:12:05 smithi047 bash[22744]: cluster 2024-09-16T10:12:03.479292+0000 mgr.a (mgr.14373) 11889 : cluster [DBG] pgmap v8246: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:12:05.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:12:05 smithi047 bash[22744]: audit 2024-09-16T10:12:03.607775+0000 mgr.a (mgr.14373) 11890 : audit [DBG] from='client.260013 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:12:05.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:12:05 smithi157 bash[24585]: cluster 2024-09-16T10:12:03.479292+0000 mgr.a (mgr.14373) 11889 : cluster [DBG] pgmap v8246: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:12:05.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:12:05 smithi157 bash[24585]: audit 2024-09-16T10:12:03.607775+0000 mgr.a (mgr.14373) 11890 : audit [DBG] from='client.260013 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:12:07.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:12:07 smithi047 bash[22744]: cluster 2024-09-16T10:12:05.480394+0000 mgr.a (mgr.14373) 11891 : cluster [DBG] pgmap v8247: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:12:07.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:12:07 smithi157 bash[24585]: cluster 2024-09-16T10:12:05.480394+0000 mgr.a (mgr.14373) 11891 : cluster [DBG] pgmap v8247: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:12:07.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:12:07 smithi086 bash[24289]: cluster 2024-09-16T10:12:05.480394+0000 mgr.a (mgr.14373) 11891 : cluster [DBG] pgmap v8247: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:12:09.021 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:12:09.022 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:12:09.022 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:12:09.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:12:09 smithi047 bash[22744]: cluster 2024-09-16T10:12:07.482817+0000 mgr.a (mgr.14373) 11892 : cluster [DBG] pgmap v8248: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:12:09.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:12:09 smithi157 bash[24585]: cluster 2024-09-16T10:12:07.482817+0000 mgr.a (mgr.14373) 11892 : cluster [DBG] pgmap v8248: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:12:09.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:12:09 smithi086 bash[24289]: cluster 2024-09-16T10:12:07.482817+0000 mgr.a (mgr.14373) 11892 : cluster [DBG] pgmap v8248: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:12:09.780 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:12:09.780 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:12:09.781 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:12:09.781 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:12:09.781 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:12:11.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:12:11 smithi047 bash[22744]: audit 2024-09-16T10:12:09.352205+0000 mgr.a (mgr.14373) 11893 : audit [DBG] from='client.260091 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:12:11.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:12:11 smithi047 bash[22744]: cluster 2024-09-16T10:12:09.485029+0000 mgr.a (mgr.14373) 11894 : cluster [DBG] pgmap v8249: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:12:11.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:12:11 smithi157 bash[24585]: audit 2024-09-16T10:12:09.352205+0000 mgr.a (mgr.14373) 11893 : audit [DBG] from='client.260091 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:12:11.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:12:11 smithi157 bash[24585]: cluster 2024-09-16T10:12:09.485029+0000 mgr.a (mgr.14373) 11894 : cluster [DBG] pgmap v8249: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:12:11.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:12:11 smithi086 bash[24289]: audit 2024-09-16T10:12:09.352205+0000 mgr.a (mgr.14373) 11893 : audit [DBG] from='client.260091 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:12:11.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:12:11 smithi086 bash[24289]: cluster 2024-09-16T10:12:09.485029+0000 mgr.a (mgr.14373) 11894 : cluster [DBG] pgmap v8249: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:12:12.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:12:12 smithi047 bash[22744]: audit 2024-09-16T10:12:11.778818+0000 mon.b (mon.2) 1094 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T10:12:12.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:12:12 smithi157 bash[24585]: audit 2024-09-16T10:12:11.778818+0000 mon.b (mon.2) 1094 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T10:12:12.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:12:12 smithi086 bash[24289]: audit 2024-09-16T10:12:11.778818+0000 mon.b (mon.2) 1094 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T10:12:13.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:12:13 smithi047 bash[22744]: cluster 2024-09-16T10:12:11.486910+0000 mgr.a (mgr.14373) 11895 : cluster [DBG] pgmap v8250: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:12:13.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:12:13 smithi157 bash[24585]: cluster 2024-09-16T10:12:11.486910+0000 mgr.a (mgr.14373) 11895 : cluster [DBG] pgmap v8250: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:12:13.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:12:13 smithi086 bash[24289]: cluster 2024-09-16T10:12:11.486910+0000 mgr.a (mgr.14373) 11895 : cluster [DBG] pgmap v8250: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:12:14.782 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:12:14.783 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:12:14.783 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:12:15.536 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:12:15.537 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:12:15.537 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:12:15.537 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:12:15.537 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:12:15.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:12:15 smithi157 bash[24585]: cluster 2024-09-16T10:12:13.488155+0000 mgr.a (mgr.14373) 11896 : cluster [DBG] pgmap v8251: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-16T10:12:15.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:12:15 smithi086 bash[24289]: cluster 2024-09-16T10:12:13.488155+0000 mgr.a (mgr.14373) 11896 : cluster [DBG] pgmap v8251: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-16T10:12:15.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:12:15 smithi047 bash[22744]: cluster 2024-09-16T10:12:13.488155+0000 mgr.a (mgr.14373) 11896 : cluster [DBG] pgmap v8251: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-16T10:12:16.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:12:16 smithi157 bash[24585]: audit 2024-09-16T10:12:15.099825+0000 mgr.a (mgr.14373) 11897 : audit [DBG] from='client.260169 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:12:16.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:12:16 smithi086 bash[24289]: audit 2024-09-16T10:12:15.099825+0000 mgr.a (mgr.14373) 11897 : audit [DBG] from='client.260169 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:12:16.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:12:16 smithi047 bash[22744]: audit 2024-09-16T10:12:15.099825+0000 mgr.a (mgr.14373) 11897 : audit [DBG] from='client.260169 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:12:17.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:12:17 smithi157 bash[24585]: cluster 2024-09-16T10:12:15.488884+0000 mgr.a (mgr.14373) 11898 : cluster [DBG] pgmap v8252: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:12:17.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:12:17 smithi086 bash[24289]: cluster 2024-09-16T10:12:15.488884+0000 mgr.a (mgr.14373) 11898 : cluster [DBG] pgmap v8252: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:12:17.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:12:17 smithi047 bash[22744]: cluster 2024-09-16T10:12:15.488884+0000 mgr.a (mgr.14373) 11898 : cluster [DBG] pgmap v8252: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:12:18.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:12:18 smithi157 bash[24585]: audit 2024-09-16T10:12:17.124375+0000 mon.a (mon.0) 1273 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:12:18.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:12:18 smithi157 bash[24585]: audit 2024-09-16T10:12:17.132925+0000 mon.a (mon.0) 1274 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:12:18.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:12:18 smithi157 bash[24585]: audit 2024-09-16T10:12:17.151499+0000 mon.a (mon.0) 1275 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:12:18.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:12:18 smithi157 bash[24585]: audit 2024-09-16T10:12:17.158966+0000 mon.a (mon.0) 1276 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:12:18.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:12:18 smithi157 bash[24585]: audit 2024-09-16T10:12:17.164086+0000 mon.a (mon.0) 1277 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:12:18.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:12:18 smithi157 bash[24585]: audit 2024-09-16T10:12:17.171317+0000 mon.a (mon.0) 1278 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:12:18.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:12:18 smithi086 bash[24289]: audit 2024-09-16T10:12:17.124375+0000 mon.a (mon.0) 1273 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:12:18.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:12:18 smithi086 bash[24289]: audit 2024-09-16T10:12:17.132925+0000 mon.a (mon.0) 1274 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:12:18.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:12:18 smithi086 bash[24289]: audit 2024-09-16T10:12:17.151499+0000 mon.a (mon.0) 1275 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:12:18.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:12:18 smithi086 bash[24289]: audit 2024-09-16T10:12:17.158966+0000 mon.a (mon.0) 1276 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:12:18.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:12:18 smithi086 bash[24289]: audit 2024-09-16T10:12:17.164086+0000 mon.a (mon.0) 1277 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:12:18.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:12:18 smithi086 bash[24289]: audit 2024-09-16T10:12:17.171317+0000 mon.a (mon.0) 1278 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:12:18.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:12:18 smithi047 bash[22744]: audit 2024-09-16T10:12:17.124375+0000 mon.a (mon.0) 1273 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:12:18.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:12:18 smithi047 bash[22744]: audit 2024-09-16T10:12:17.132925+0000 mon.a (mon.0) 1274 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:12:18.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:12:18 smithi047 bash[22744]: audit 2024-09-16T10:12:17.151499+0000 mon.a (mon.0) 1275 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:12:18.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:12:18 smithi047 bash[22744]: audit 2024-09-16T10:12:17.158966+0000 mon.a (mon.0) 1276 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:12:18.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:12:18 smithi047 bash[22744]: audit 2024-09-16T10:12:17.164086+0000 mon.a (mon.0) 1277 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:12:18.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:12:18 smithi047 bash[22744]: audit 2024-09-16T10:12:17.171317+0000 mon.a (mon.0) 1278 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:12:19.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:12:19 smithi157 bash[24585]: cluster 2024-09-16T10:12:17.491078+0000 mgr.a (mgr.14373) 11899 : cluster [DBG] pgmap v8253: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:12:19.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:12:19 smithi086 bash[24289]: cluster 2024-09-16T10:12:17.491078+0000 mgr.a (mgr.14373) 11899 : cluster [DBG] pgmap v8253: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:12:19.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:12:19 smithi047 bash[22744]: cluster 2024-09-16T10:12:17.491078+0000 mgr.a (mgr.14373) 11899 : cluster [DBG] pgmap v8253: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:12:20.538 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:12:20.539 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:12:20.539 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:12:21.330 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:12:21.330 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:12:21.331 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:12:21.331 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:12:21.331 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:12:21.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:12:21 smithi157 bash[24585]: cluster 2024-09-16T10:12:19.491848+0000 mgr.a (mgr.14373) 11900 : cluster [DBG] pgmap v8254: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:12:21.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:12:21 smithi086 bash[24289]: cluster 2024-09-16T10:12:19.491848+0000 mgr.a (mgr.14373) 11900 : cluster [DBG] pgmap v8254: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:12:21.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:12:21 smithi047 bash[22744]: cluster 2024-09-16T10:12:19.491848+0000 mgr.a (mgr.14373) 11900 : cluster [DBG] pgmap v8254: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:12:22.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:12:22 smithi157 bash[24585]: audit 2024-09-16T10:12:20.876866+0000 mgr.a (mgr.14373) 11901 : audit [DBG] from='client.260247 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:12:22.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:12:22 smithi086 bash[24289]: audit 2024-09-16T10:12:20.876866+0000 mgr.a (mgr.14373) 11901 : audit [DBG] from='client.260247 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:12:22.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:12:22 smithi047 bash[22744]: audit 2024-09-16T10:12:20.876866+0000 mgr.a (mgr.14373) 11901 : audit [DBG] from='client.260247 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:12:23.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:12:23 smithi157 bash[24585]: cluster 2024-09-16T10:12:21.493908+0000 mgr.a (mgr.14373) 11902 : cluster [DBG] pgmap v8255: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:12:23.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:12:23 smithi086 bash[24289]: cluster 2024-09-16T10:12:21.493908+0000 mgr.a (mgr.14373) 11902 : cluster [DBG] pgmap v8255: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:12:23.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:12:23 smithi047 bash[22744]: cluster 2024-09-16T10:12:21.493908+0000 mgr.a (mgr.14373) 11902 : cluster [DBG] pgmap v8255: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:12:25.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:12:25 smithi157 bash[24585]: cluster 2024-09-16T10:12:23.495243+0000 mgr.a (mgr.14373) 11903 : cluster [DBG] pgmap v8256: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-16T10:12:25.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:12:25 smithi086 bash[24289]: cluster 2024-09-16T10:12:23.495243+0000 mgr.a (mgr.14373) 11903 : cluster [DBG] pgmap v8256: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-16T10:12:25.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:12:25 smithi047 bash[22744]: cluster 2024-09-16T10:12:23.495243+0000 mgr.a (mgr.14373) 11903 : cluster [DBG] pgmap v8256: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-16T10:12:26.331 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:12:26.332 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:12:26.332 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:12:26.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:12:26 smithi157 bash[24585]: cluster 2024-09-16T10:12:25.496035+0000 mgr.a (mgr.14373) 11904 : cluster [DBG] pgmap v8257: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:12:26.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:12:26 smithi086 bash[24289]: cluster 2024-09-16T10:12:25.496035+0000 mgr.a (mgr.14373) 11904 : cluster [DBG] pgmap v8257: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:12:26.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:12:26 smithi047 bash[22744]: cluster 2024-09-16T10:12:25.496035+0000 mgr.a (mgr.14373) 11904 : cluster [DBG] pgmap v8257: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:12:27.118 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:12:27.118 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:12:27.118 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:12:27.118 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:12:27.118 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:12:27.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:12:27 smithi157 bash[24585]: audit 2024-09-16T10:12:26.675818+0000 mgr.a (mgr.14373) 11905 : audit [DBG] from='client.102949 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:12:27.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:12:27 smithi086 bash[24289]: audit 2024-09-16T10:12:26.675818+0000 mgr.a (mgr.14373) 11905 : audit [DBG] from='client.102949 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:12:27.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:12:27 smithi047 bash[22744]: audit 2024-09-16T10:12:26.675818+0000 mgr.a (mgr.14373) 11905 : audit [DBG] from='client.102949 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:12:28.593 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 10:12:28 smithi047 bash[22994]: debug 2024-09-16T10:12:28.302+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T10:12:28.593 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 10:12:28 smithi047 bash[22994]: debug 2024-09-16T10:12:28.306+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T10:12:28.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:12:28 smithi047 bash[22744]: cluster 2024-09-16T10:12:27.498966+0000 mgr.a (mgr.14373) 11906 : cluster [DBG] pgmap v8258: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:12:28.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:12:28 smithi047 bash[22744]: audit 2024-09-16T10:12:27.509292+0000 mon.a (mon.0) 1279 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:12:28.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:12:28 smithi047 bash[22744]: audit 2024-09-16T10:12:27.520372+0000 mon.a (mon.0) 1280 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:12:28.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:12:28 smithi047 bash[22744]: audit 2024-09-16T10:12:27.525514+0000 mon.b (mon.2) 1095 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T10:12:28.594 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:12:28 smithi047 bash[22744]: audit 2024-09-16T10:12:27.527941+0000 mon.b (mon.2) 1096 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T10:12:28.594 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:12:28 smithi047 bash[22744]: audit 2024-09-16T10:12:27.539797+0000 mon.a (mon.0) 1281 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:12:28.594 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:12:28 smithi047 bash[22744]: audit 2024-09-16T10:12:27.547135+0000 mon.b (mon.2) 1097 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:12:28.594 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:12:28 smithi047 bash[22744]: audit 2024-09-16T10:12:27.550231+0000 mgr.a (mgr.14373) 11907 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:12:28.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:12:28 smithi157 bash[24585]: cluster 2024-09-16T10:12:27.498966+0000 mgr.a (mgr.14373) 11906 : cluster [DBG] pgmap v8258: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:12:28.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:12:28 smithi157 bash[24585]: audit 2024-09-16T10:12:27.509292+0000 mon.a (mon.0) 1279 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:12:28.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:12:28 smithi157 bash[24585]: audit 2024-09-16T10:12:27.520372+0000 mon.a (mon.0) 1280 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:12:28.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:12:28 smithi157 bash[24585]: audit 2024-09-16T10:12:27.525514+0000 mon.b (mon.2) 1095 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T10:12:28.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:12:28 smithi157 bash[24585]: audit 2024-09-16T10:12:27.527941+0000 mon.b (mon.2) 1096 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T10:12:28.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:12:28 smithi157 bash[24585]: audit 2024-09-16T10:12:27.539797+0000 mon.a (mon.0) 1281 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:12:28.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:12:28 smithi157 bash[24585]: audit 2024-09-16T10:12:27.547135+0000 mon.b (mon.2) 1097 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:12:28.808 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:12:28 smithi157 bash[24585]: audit 2024-09-16T10:12:27.550231+0000 mgr.a (mgr.14373) 11907 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:12:28.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:12:28 smithi086 bash[24289]: cluster 2024-09-16T10:12:27.498966+0000 mgr.a (mgr.14373) 11906 : cluster [DBG] pgmap v8258: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:12:28.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:12:28 smithi086 bash[24289]: audit 2024-09-16T10:12:27.509292+0000 mon.a (mon.0) 1279 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:12:28.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:12:28 smithi086 bash[24289]: audit 2024-09-16T10:12:27.520372+0000 mon.a (mon.0) 1280 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:12:28.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:12:28 smithi086 bash[24289]: audit 2024-09-16T10:12:27.525514+0000 mon.b (mon.2) 1095 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T10:12:28.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:12:28 smithi086 bash[24289]: audit 2024-09-16T10:12:27.527941+0000 mon.b (mon.2) 1096 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T10:12:28.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:12:28 smithi086 bash[24289]: audit 2024-09-16T10:12:27.539797+0000 mon.a (mon.0) 1281 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:12:28.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:12:28 smithi086 bash[24289]: audit 2024-09-16T10:12:27.547135+0000 mon.b (mon.2) 1097 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:12:28.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:12:28 smithi086 bash[24289]: audit 2024-09-16T10:12:27.550231+0000 mgr.a (mgr.14373) 11907 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:12:29.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:12:29 smithi157 bash[24585]: audit 2024-09-16T10:12:28.308550+0000 mgr.a (mgr.14373) 11908 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T10:12:29.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:12:29 smithi157 bash[24585]: cephadm 2024-09-16T10:12:28.310751+0000 mgr.a (mgr.14373) 11909 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T10:12:29.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:12:29 smithi086 bash[24289]: audit 2024-09-16T10:12:28.308550+0000 mgr.a (mgr.14373) 11908 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T10:12:29.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:12:29 smithi086 bash[24289]: cephadm 2024-09-16T10:12:28.310751+0000 mgr.a (mgr.14373) 11909 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T10:12:29.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:12:29 smithi047 bash[22744]: audit 2024-09-16T10:12:28.308550+0000 mgr.a (mgr.14373) 11908 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T10:12:29.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:12:29 smithi047 bash[22744]: cephadm 2024-09-16T10:12:28.310751+0000 mgr.a (mgr.14373) 11909 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T10:12:30.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:12:30 smithi157 bash[24585]: cluster 2024-09-16T10:12:29.499853+0000 mgr.a (mgr.14373) 11910 : cluster [DBG] pgmap v8259: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:12:30.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:12:30 smithi086 bash[24289]: cluster 2024-09-16T10:12:29.499853+0000 mgr.a (mgr.14373) 11910 : cluster [DBG] pgmap v8259: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:12:30.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:12:30 smithi047 bash[22744]: cluster 2024-09-16T10:12:29.499853+0000 mgr.a (mgr.14373) 11910 : cluster [DBG] pgmap v8259: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:12:32.119 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:12:32.120 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:12:32.120 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:12:32.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:12:32 smithi157 bash[24585]: cluster 2024-09-16T10:12:31.501576+0000 mgr.a (mgr.14373) 11911 : cluster [DBG] pgmap v8260: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 5.5 KiB/s rd, 341 B/s wr, 5 op/s 2024-09-16T10:12:32.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:12:32 smithi086 bash[24289]: cluster 2024-09-16T10:12:31.501576+0000 mgr.a (mgr.14373) 11911 : cluster [DBG] pgmap v8260: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 5.5 KiB/s rd, 341 B/s wr, 5 op/s 2024-09-16T10:12:32.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:12:32 smithi047 bash[22744]: cluster 2024-09-16T10:12:31.501576+0000 mgr.a (mgr.14373) 11911 : cluster [DBG] pgmap v8260: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 5.5 KiB/s rd, 341 B/s wr, 5 op/s 2024-09-16T10:12:32.865 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:12:32.865 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:12:32.865 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:12:32.865 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:12:32.865 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:12:33.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:12:33 smithi157 bash[24585]: audit 2024-09-16T10:12:32.451129+0000 mgr.a (mgr.14373) 11912 : audit [DBG] from='client.260502 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:12:33.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:12:33 smithi086 bash[24289]: audit 2024-09-16T10:12:32.451129+0000 mgr.a (mgr.14373) 11912 : audit [DBG] from='client.260502 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:12:33.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:12:33 smithi047 bash[22744]: audit 2024-09-16T10:12:32.451129+0000 mgr.a (mgr.14373) 11912 : audit [DBG] from='client.260502 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:12:34.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:12:34 smithi157 bash[24585]: cluster 2024-09-16T10:12:33.503446+0000 mgr.a (mgr.14373) 11913 : cluster [DBG] pgmap v8261: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 6.2 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T10:12:34.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:12:34 smithi086 bash[24289]: cluster 2024-09-16T10:12:33.503446+0000 mgr.a (mgr.14373) 11913 : cluster [DBG] pgmap v8261: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 6.2 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T10:12:34.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:12:34 smithi047 bash[22744]: cluster 2024-09-16T10:12:33.503446+0000 mgr.a (mgr.14373) 11913 : cluster [DBG] pgmap v8261: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 6.2 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T10:12:36.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:12:36 smithi157 bash[24585]: cluster 2024-09-16T10:12:35.504267+0000 mgr.a (mgr.14373) 11914 : cluster [DBG] pgmap v8262: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T10:12:36.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:12:36 smithi086 bash[24289]: cluster 2024-09-16T10:12:35.504267+0000 mgr.a (mgr.14373) 11914 : cluster [DBG] pgmap v8262: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T10:12:36.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:12:36 smithi047 bash[22744]: cluster 2024-09-16T10:12:35.504267+0000 mgr.a (mgr.14373) 11914 : cluster [DBG] pgmap v8262: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T10:12:37.866 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:12:37.867 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:12:37.867 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:12:38.639 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:12:38.640 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:12:38.640 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:12:38.640 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:12:38.640 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:12:38.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:12:38 smithi157 bash[24585]: cluster 2024-09-16T10:12:37.506406+0000 mgr.a (mgr.14373) 11915 : cluster [DBG] pgmap v8263: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:12:38.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:12:38 smithi086 bash[24289]: cluster 2024-09-16T10:12:37.506406+0000 mgr.a (mgr.14373) 11915 : cluster [DBG] pgmap v8263: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:12:38.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:12:38 smithi047 bash[22744]: cluster 2024-09-16T10:12:37.506406+0000 mgr.a (mgr.14373) 11915 : cluster [DBG] pgmap v8263: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:12:39.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:12:39 smithi157 bash[24585]: audit 2024-09-16T10:12:38.199626+0000 mgr.a (mgr.14373) 11916 : audit [DBG] from='client.260574 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:12:39.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:12:39 smithi086 bash[24289]: audit 2024-09-16T10:12:38.199626+0000 mgr.a (mgr.14373) 11916 : audit [DBG] from='client.260574 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:12:39.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:12:39 smithi047 bash[22744]: audit 2024-09-16T10:12:38.199626+0000 mgr.a (mgr.14373) 11916 : audit [DBG] from='client.260574 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:12:40.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:12:40 smithi157 bash[24585]: cluster 2024-09-16T10:12:39.507479+0000 mgr.a (mgr.14373) 11917 : cluster [DBG] pgmap v8264: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:12:40.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:12:40 smithi086 bash[24289]: cluster 2024-09-16T10:12:39.507479+0000 mgr.a (mgr.14373) 11917 : cluster [DBG] pgmap v8264: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:12:40.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:12:40 smithi047 bash[22744]: cluster 2024-09-16T10:12:39.507479+0000 mgr.a (mgr.14373) 11917 : cluster [DBG] pgmap v8264: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:12:42.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:12:42 smithi157 bash[24585]: cluster 2024-09-16T10:12:41.509255+0000 mgr.a (mgr.14373) 11918 : cluster [DBG] pgmap v8265: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.8 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:12:42.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:12:42 smithi086 bash[24289]: cluster 2024-09-16T10:12:41.509255+0000 mgr.a (mgr.14373) 11918 : cluster [DBG] pgmap v8265: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.8 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:12:42.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:12:42 smithi047 bash[22744]: cluster 2024-09-16T10:12:41.509255+0000 mgr.a (mgr.14373) 11918 : cluster [DBG] pgmap v8265: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.8 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:12:43.641 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:12:43.642 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:12:43.642 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:12:44.431 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:12:44.431 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:12:44.431 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:12:44.431 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:12:44.431 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:12:44.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:12:44 smithi086 bash[24289]: cluster 2024-09-16T10:12:43.510515+0000 mgr.a (mgr.14373) 11919 : cluster [DBG] pgmap v8266: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 3.3 KiB/s rd, 85 B/s wr, 3 op/s 2024-09-16T10:12:44.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:12:44 smithi086 bash[24289]: audit 2024-09-16T10:12:43.982111+0000 mgr.a (mgr.14373) 11920 : audit [DBG] from='client.260649 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:12:44.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:12:44 smithi047 bash[22744]: cluster 2024-09-16T10:12:43.510515+0000 mgr.a (mgr.14373) 11919 : cluster [DBG] pgmap v8266: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 3.3 KiB/s rd, 85 B/s wr, 3 op/s 2024-09-16T10:12:44.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:12:44 smithi047 bash[22744]: audit 2024-09-16T10:12:43.982111+0000 mgr.a (mgr.14373) 11920 : audit [DBG] from='client.260649 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:12:45.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:12:44 smithi157 bash[24585]: cluster 2024-09-16T10:12:43.510515+0000 mgr.a (mgr.14373) 11919 : cluster [DBG] pgmap v8266: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 3.3 KiB/s rd, 85 B/s wr, 3 op/s 2024-09-16T10:12:45.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:12:44 smithi157 bash[24585]: audit 2024-09-16T10:12:43.982111+0000 mgr.a (mgr.14373) 11920 : audit [DBG] from='client.260649 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:12:46.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:12:46 smithi086 bash[24289]: cluster 2024-09-16T10:12:45.511423+0000 mgr.a (mgr.14373) 11921 : cluster [DBG] pgmap v8267: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:12:46.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:12:46 smithi047 bash[22744]: cluster 2024-09-16T10:12:45.511423+0000 mgr.a (mgr.14373) 11921 : cluster [DBG] pgmap v8267: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:12:47.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:12:46 smithi157 bash[24585]: cluster 2024-09-16T10:12:45.511423+0000 mgr.a (mgr.14373) 11921 : cluster [DBG] pgmap v8267: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:12:48.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:12:48 smithi086 bash[24289]: cluster 2024-09-16T10:12:47.513676+0000 mgr.a (mgr.14373) 11922 : cluster [DBG] pgmap v8268: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:12:48.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:12:48 smithi047 bash[22744]: cluster 2024-09-16T10:12:47.513676+0000 mgr.a (mgr.14373) 11922 : cluster [DBG] pgmap v8268: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:12:49.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:12:48 smithi157 bash[24585]: cluster 2024-09-16T10:12:47.513676+0000 mgr.a (mgr.14373) 11922 : cluster [DBG] pgmap v8268: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:12:49.432 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:12:49.433 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:12:49.433 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:12:50.205 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:12:50.206 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:12:50.206 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:12:50.206 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:12:50.206 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:12:50.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:12:50 smithi047 bash[22744]: cluster 2024-09-16T10:12:49.514112+0000 mgr.a (mgr.14373) 11923 : cluster [DBG] pgmap v8269: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:12:50.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:12:50 smithi047 bash[22744]: audit 2024-09-16T10:12:49.768255+0000 mgr.a (mgr.14373) 11924 : audit [DBG] from='client.260724 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:12:51.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:12:50 smithi157 bash[24585]: cluster 2024-09-16T10:12:49.514112+0000 mgr.a (mgr.14373) 11923 : cluster [DBG] pgmap v8269: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:12:51.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:12:50 smithi157 bash[24585]: audit 2024-09-16T10:12:49.768255+0000 mgr.a (mgr.14373) 11924 : audit [DBG] from='client.260724 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:12:51.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:12:50 smithi086 bash[24289]: cluster 2024-09-16T10:12:49.514112+0000 mgr.a (mgr.14373) 11923 : cluster [DBG] pgmap v8269: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:12:51.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:12:50 smithi086 bash[24289]: audit 2024-09-16T10:12:49.768255+0000 mgr.a (mgr.14373) 11924 : audit [DBG] from='client.260724 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:12:52.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:12:52 smithi047 bash[22744]: cluster 2024-09-16T10:12:51.515945+0000 mgr.a (mgr.14373) 11925 : cluster [DBG] pgmap v8270: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:12:53.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:12:52 smithi157 bash[24585]: cluster 2024-09-16T10:12:51.515945+0000 mgr.a (mgr.14373) 11925 : cluster [DBG] pgmap v8270: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:12:53.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:12:52 smithi086 bash[24289]: cluster 2024-09-16T10:12:51.515945+0000 mgr.a (mgr.14373) 11925 : cluster [DBG] pgmap v8270: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:12:54.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:12:54 smithi047 bash[22744]: cluster 2024-09-16T10:12:53.517202+0000 mgr.a (mgr.14373) 11926 : cluster [DBG] pgmap v8271: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-16T10:12:55.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:12:54 smithi157 bash[24585]: cluster 2024-09-16T10:12:53.517202+0000 mgr.a (mgr.14373) 11926 : cluster [DBG] pgmap v8271: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-16T10:12:55.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:12:54 smithi086 bash[24289]: cluster 2024-09-16T10:12:53.517202+0000 mgr.a (mgr.14373) 11926 : cluster [DBG] pgmap v8271: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-16T10:12:55.207 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:12:55.208 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:12:55.208 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:12:55.990 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:12:55.990 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:12:55.990 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:12:55.990 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:12:55.990 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:12:56.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:12:56 smithi047 bash[22744]: cluster 2024-09-16T10:12:55.517971+0000 mgr.a (mgr.14373) 11927 : cluster [DBG] pgmap v8272: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:12:56.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:12:56 smithi047 bash[22744]: audit 2024-09-16T10:12:55.543064+0000 mgr.a (mgr.14373) 11928 : audit [DBG] from='client.260799 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:12:57.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:12:56 smithi157 bash[24585]: cluster 2024-09-16T10:12:55.517971+0000 mgr.a (mgr.14373) 11927 : cluster [DBG] pgmap v8272: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:12:57.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:12:56 smithi157 bash[24585]: audit 2024-09-16T10:12:55.543064+0000 mgr.a (mgr.14373) 11928 : audit [DBG] from='client.260799 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:12:57.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:12:56 smithi086 bash[24289]: cluster 2024-09-16T10:12:55.517971+0000 mgr.a (mgr.14373) 11927 : cluster [DBG] pgmap v8272: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:12:57.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:12:56 smithi086 bash[24289]: audit 2024-09-16T10:12:55.543064+0000 mgr.a (mgr.14373) 11928 : audit [DBG] from='client.260799 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:12:58.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:12:58 smithi047 bash[22744]: cluster 2024-09-16T10:12:57.520323+0000 mgr.a (mgr.14373) 11929 : cluster [DBG] pgmap v8273: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:12:59.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:12:58 smithi157 bash[24585]: cluster 2024-09-16T10:12:57.520323+0000 mgr.a (mgr.14373) 11929 : cluster [DBG] pgmap v8273: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:12:59.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:12:58 smithi086 bash[24289]: cluster 2024-09-16T10:12:57.520323+0000 mgr.a (mgr.14373) 11929 : cluster [DBG] pgmap v8273: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:13:00.991 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:13:00.992 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:13:00.992 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:13:01.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:13:00 smithi157 bash[24585]: cluster 2024-09-16T10:12:59.521069+0000 mgr.a (mgr.14373) 11930 : cluster [DBG] pgmap v8274: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:13:01.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:13:00 smithi086 bash[24289]: cluster 2024-09-16T10:12:59.521069+0000 mgr.a (mgr.14373) 11930 : cluster [DBG] pgmap v8274: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:13:01.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:13:00 smithi047 bash[22744]: cluster 2024-09-16T10:12:59.521069+0000 mgr.a (mgr.14373) 11930 : cluster [DBG] pgmap v8274: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:13:01.767 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:13:01.767 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:13:01.767 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:13:01.767 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:13:01.767 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:13:03.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:13:02 smithi157 bash[24585]: audit 2024-09-16T10:13:01.325762+0000 mgr.a (mgr.14373) 11931 : audit [DBG] from='client.260874 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:13:03.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:13:02 smithi157 bash[24585]: cluster 2024-09-16T10:13:01.522270+0000 mgr.a (mgr.14373) 11932 : cluster [DBG] pgmap v8275: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:13:03.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:13:02 smithi086 bash[24289]: audit 2024-09-16T10:13:01.325762+0000 mgr.a (mgr.14373) 11931 : audit [DBG] from='client.260874 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:13:03.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:13:02 smithi086 bash[24289]: cluster 2024-09-16T10:13:01.522270+0000 mgr.a (mgr.14373) 11932 : cluster [DBG] pgmap v8275: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:13:03.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:13:02 smithi047 bash[22744]: audit 2024-09-16T10:13:01.325762+0000 mgr.a (mgr.14373) 11931 : audit [DBG] from='client.260874 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:13:03.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:13:02 smithi047 bash[22744]: cluster 2024-09-16T10:13:01.522270+0000 mgr.a (mgr.14373) 11932 : cluster [DBG] pgmap v8275: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:13:05.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:13:04 smithi157 bash[24585]: cluster 2024-09-16T10:13:03.524078+0000 mgr.a (mgr.14373) 11933 : cluster [DBG] pgmap v8276: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-16T10:13:05.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:13:04 smithi086 bash[24289]: cluster 2024-09-16T10:13:03.524078+0000 mgr.a (mgr.14373) 11933 : cluster [DBG] pgmap v8276: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-16T10:13:05.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:13:04 smithi047 bash[22744]: cluster 2024-09-16T10:13:03.524078+0000 mgr.a (mgr.14373) 11933 : cluster [DBG] pgmap v8276: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-16T10:13:06.769 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:13:06.769 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:13:06.769 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:13:07.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:13:06 smithi157 bash[24585]: cluster 2024-09-16T10:13:05.525011+0000 mgr.a (mgr.14373) 11934 : cluster [DBG] pgmap v8277: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-16T10:13:07.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:13:06 smithi086 bash[24289]: cluster 2024-09-16T10:13:05.525011+0000 mgr.a (mgr.14373) 11934 : cluster [DBG] pgmap v8277: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-16T10:13:07.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:13:06 smithi047 bash[22744]: cluster 2024-09-16T10:13:05.525011+0000 mgr.a (mgr.14373) 11934 : cluster [DBG] pgmap v8277: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-16T10:13:07.530 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:13:07.530 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:13:07.530 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:13:07.530 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:13:07.530 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:13:08.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:13:07 smithi157 bash[24585]: audit 2024-09-16T10:13:07.093895+0000 mgr.a (mgr.14373) 11935 : audit [DBG] from='client.260952 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:13:08.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:13:07 smithi086 bash[24289]: audit 2024-09-16T10:13:07.093895+0000 mgr.a (mgr.14373) 11935 : audit [DBG] from='client.260952 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:13:08.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:13:07 smithi047 bash[22744]: audit 2024-09-16T10:13:07.093895+0000 mgr.a (mgr.14373) 11935 : audit [DBG] from='client.260952 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:13:09.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:13:08 smithi157 bash[24585]: cluster 2024-09-16T10:13:07.526254+0000 mgr.a (mgr.14373) 11936 : cluster [DBG] pgmap v8278: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:13:09.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:13:08 smithi086 bash[24289]: cluster 2024-09-16T10:13:07.526254+0000 mgr.a (mgr.14373) 11936 : cluster [DBG] pgmap v8278: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:13:09.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:13:08 smithi047 bash[22744]: cluster 2024-09-16T10:13:07.526254+0000 mgr.a (mgr.14373) 11936 : cluster [DBG] pgmap v8278: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:13:11.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:13:10 smithi157 bash[24585]: cluster 2024-09-16T10:13:09.526961+0000 mgr.a (mgr.14373) 11937 : cluster [DBG] pgmap v8279: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T10:13:11.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:13:10 smithi086 bash[24289]: cluster 2024-09-16T10:13:09.526961+0000 mgr.a (mgr.14373) 11937 : cluster [DBG] pgmap v8279: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T10:13:11.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:13:10 smithi047 bash[22744]: cluster 2024-09-16T10:13:09.526961+0000 mgr.a (mgr.14373) 11937 : cluster [DBG] pgmap v8279: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T10:13:12.531 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:13:12.532 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:13:12.532 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:13:13.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:13:12 smithi157 bash[24585]: cluster 2024-09-16T10:13:11.528482+0000 mgr.a (mgr.14373) 11938 : cluster [DBG] pgmap v8280: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-16T10:13:13.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:13:12 smithi086 bash[24289]: cluster 2024-09-16T10:13:11.528482+0000 mgr.a (mgr.14373) 11938 : cluster [DBG] pgmap v8280: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-16T10:13:13.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:13:12 smithi047 bash[22744]: cluster 2024-09-16T10:13:11.528482+0000 mgr.a (mgr.14373) 11938 : cluster [DBG] pgmap v8280: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-16T10:13:13.278 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:13:13.278 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:13:13.279 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:13:13.279 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:13:13.279 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:13:14.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:13:13 smithi157 bash[24585]: audit 2024-09-16T10:13:12.861181+0000 mgr.a (mgr.14373) 11939 : audit [DBG] from='client.261027 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:13:14.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:13:13 smithi086 bash[24289]: audit 2024-09-16T10:13:12.861181+0000 mgr.a (mgr.14373) 11939 : audit [DBG] from='client.261027 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:13:14.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:13:13 smithi047 bash[22744]: audit 2024-09-16T10:13:12.861181+0000 mgr.a (mgr.14373) 11939 : audit [DBG] from='client.261027 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:13:15.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:13:14 smithi157 bash[24585]: cluster 2024-09-16T10:13:13.530171+0000 mgr.a (mgr.14373) 11940 : cluster [DBG] pgmap v8281: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:13:15.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:13:14 smithi086 bash[24289]: cluster 2024-09-16T10:13:13.530171+0000 mgr.a (mgr.14373) 11940 : cluster [DBG] pgmap v8281: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:13:15.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:13:14 smithi047 bash[22744]: cluster 2024-09-16T10:13:13.530171+0000 mgr.a (mgr.14373) 11940 : cluster [DBG] pgmap v8281: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:13:17.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:13:16 smithi157 bash[24585]: cluster 2024-09-16T10:13:15.530942+0000 mgr.a (mgr.14373) 11941 : cluster [DBG] pgmap v8282: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-16T10:13:17.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:13:16 smithi086 bash[24289]: cluster 2024-09-16T10:13:15.530942+0000 mgr.a (mgr.14373) 11941 : cluster [DBG] pgmap v8282: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-16T10:13:17.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:13:16 smithi047 bash[22744]: cluster 2024-09-16T10:13:15.530942+0000 mgr.a (mgr.14373) 11941 : cluster [DBG] pgmap v8282: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-16T10:13:18.280 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:13:18.281 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:13:18.281 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:13:19.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:13:18 smithi157 bash[24585]: cluster 2024-09-16T10:13:17.533018+0000 mgr.a (mgr.14373) 11942 : cluster [DBG] pgmap v8283: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:13:19.059 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:13:19.059 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:13:19.059 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:13:19.059 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:13:19.059 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:13:19.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:13:18 smithi086 bash[24289]: cluster 2024-09-16T10:13:17.533018+0000 mgr.a (mgr.14373) 11942 : cluster [DBG] pgmap v8283: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:13:19.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:13:18 smithi047 bash[22744]: cluster 2024-09-16T10:13:17.533018+0000 mgr.a (mgr.14373) 11942 : cluster [DBG] pgmap v8283: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:13:20.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:13:19 smithi157 bash[24585]: audit 2024-09-16T10:13:18.617684+0000 mgr.a (mgr.14373) 11943 : audit [DBG] from='client.261105 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:13:20.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:13:19 smithi086 bash[24289]: audit 2024-09-16T10:13:18.617684+0000 mgr.a (mgr.14373) 11943 : audit [DBG] from='client.261105 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:13:20.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:13:19 smithi047 bash[22744]: audit 2024-09-16T10:13:18.617684+0000 mgr.a (mgr.14373) 11943 : audit [DBG] from='client.261105 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:13:21.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:13:20 smithi157 bash[24585]: cluster 2024-09-16T10:13:19.533918+0000 mgr.a (mgr.14373) 11944 : cluster [DBG] pgmap v8284: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:13:21.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:13:20 smithi086 bash[24289]: cluster 2024-09-16T10:13:19.533918+0000 mgr.a (mgr.14373) 11944 : cluster [DBG] pgmap v8284: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:13:21.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:13:20 smithi047 bash[22744]: cluster 2024-09-16T10:13:19.533918+0000 mgr.a (mgr.14373) 11944 : cluster [DBG] pgmap v8284: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:13:23.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:13:22 smithi157 bash[24585]: cluster 2024-09-16T10:13:21.535660+0000 mgr.a (mgr.14373) 11945 : cluster [DBG] pgmap v8285: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:13:23.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:13:22 smithi086 bash[24289]: cluster 2024-09-16T10:13:21.535660+0000 mgr.a (mgr.14373) 11945 : cluster [DBG] pgmap v8285: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:13:23.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:13:22 smithi047 bash[22744]: cluster 2024-09-16T10:13:21.535660+0000 mgr.a (mgr.14373) 11945 : cluster [DBG] pgmap v8285: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:13:24.061 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:13:24.061 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:13:24.062 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:13:24.837 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:13:24.837 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:13:24.837 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:13:24.838 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:13:24.838 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:13:25.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:13:24 smithi157 bash[24585]: cluster 2024-09-16T10:13:23.536897+0000 mgr.a (mgr.14373) 11946 : cluster [DBG] pgmap v8286: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-16T10:13:25.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:13:24 smithi086 bash[24289]: cluster 2024-09-16T10:13:23.536897+0000 mgr.a (mgr.14373) 11946 : cluster [DBG] pgmap v8286: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-16T10:13:25.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:13:24 smithi047 bash[22744]: cluster 2024-09-16T10:13:23.536897+0000 mgr.a (mgr.14373) 11946 : cluster [DBG] pgmap v8286: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-16T10:13:26.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:13:25 smithi157 bash[24585]: audit 2024-09-16T10:13:24.398912+0000 mgr.a (mgr.14373) 11947 : audit [DBG] from='client.261183 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:13:26.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:13:25 smithi086 bash[24289]: audit 2024-09-16T10:13:24.398912+0000 mgr.a (mgr.14373) 11947 : audit [DBG] from='client.261183 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:13:26.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:13:25 smithi047 bash[22744]: audit 2024-09-16T10:13:24.398912+0000 mgr.a (mgr.14373) 11947 : audit [DBG] from='client.261183 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:13:27.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:13:26 smithi157 bash[24585]: cluster 2024-09-16T10:13:25.537771+0000 mgr.a (mgr.14373) 11948 : cluster [DBG] pgmap v8287: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:13:27.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:13:26 smithi086 bash[24289]: cluster 2024-09-16T10:13:25.537771+0000 mgr.a (mgr.14373) 11948 : cluster [DBG] pgmap v8287: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:13:27.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:13:26 smithi047 bash[22744]: cluster 2024-09-16T10:13:25.537771+0000 mgr.a (mgr.14373) 11948 : cluster [DBG] pgmap v8287: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:13:29.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:13:28 smithi157 bash[24585]: cluster 2024-09-16T10:13:27.540052+0000 mgr.a (mgr.14373) 11949 : cluster [DBG] pgmap v8288: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:13:29.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:13:28 smithi157 bash[24585]: audit 2024-09-16T10:13:28.367214+0000 mon.b (mon.2) 1098 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T10:13:29.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:13:28 smithi086 bash[24289]: cluster 2024-09-16T10:13:27.540052+0000 mgr.a (mgr.14373) 11949 : cluster [DBG] pgmap v8288: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:13:29.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:13:28 smithi086 bash[24289]: audit 2024-09-16T10:13:28.367214+0000 mon.b (mon.2) 1098 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T10:13:29.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:13:28 smithi047 bash[22744]: cluster 2024-09-16T10:13:27.540052+0000 mgr.a (mgr.14373) 11949 : cluster [DBG] pgmap v8288: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:13:29.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:13:28 smithi047 bash[22744]: audit 2024-09-16T10:13:28.367214+0000 mon.b (mon.2) 1098 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T10:13:29.838 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:13:29.839 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:13:29.839 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:13:30.842 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 10:13:30 smithi047 bash[22994]: debug 2024-09-16T10:13:30.496+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T10:13:30.843 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 10:13:30 smithi047 bash[22994]: debug 2024-09-16T10:13:30.508+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T10:13:30.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:13:30 smithi047 bash[22744]: cluster 2024-09-16T10:13:29.540775+0000 mgr.a (mgr.14373) 11950 : cluster [DBG] pgmap v8289: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:13:30.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:13:30 smithi047 bash[22744]: audit 2024-09-16T10:13:29.726667+0000 mon.a (mon.0) 1282 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:13:30.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:13:30 smithi047 bash[22744]: audit 2024-09-16T10:13:29.732846+0000 mon.a (mon.0) 1283 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:13:30.844 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:13:30 smithi047 bash[22744]: audit 2024-09-16T10:13:29.739617+0000 mon.a (mon.0) 1284 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:13:30.845 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:13:30 smithi047 bash[22744]: audit 2024-09-16T10:13:29.746138+0000 mon.a (mon.0) 1285 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:13:30.845 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:13:30 smithi047 bash[22744]: audit 2024-09-16T10:13:29.752940+0000 mon.a (mon.0) 1286 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:13:30.845 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:13:30 smithi047 bash[22744]: audit 2024-09-16T10:13:29.757797+0000 mon.a (mon.0) 1287 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:13:30.845 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:13:30 smithi047 bash[22744]: audit 2024-09-16T10:13:29.758790+0000 mon.b (mon.2) 1099 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T10:13:30.845 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:13:30 smithi047 bash[22744]: audit 2024-09-16T10:13:29.759723+0000 mon.b (mon.2) 1100 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T10:13:30.845 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:13:30 smithi047 bash[22744]: audit 2024-09-16T10:13:29.765653+0000 mon.a (mon.0) 1288 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:13:30.845 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:13:30 smithi047 bash[22744]: audit 2024-09-16T10:13:29.770562+0000 mon.b (mon.2) 1101 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:13:30.845 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:13:30 smithi047 bash[22744]: audit 2024-09-16T10:13:29.772160+0000 mgr.a (mgr.14373) 11951 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:13:30.904 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:13:30.905 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:13:30.905 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:13:30.905 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:13:30.905 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:13:31.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:13:30 smithi157 bash[24585]: cluster 2024-09-16T10:13:29.540775+0000 mgr.a (mgr.14373) 11950 : cluster [DBG] pgmap v8289: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:13:31.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:13:30 smithi157 bash[24585]: audit 2024-09-16T10:13:29.726667+0000 mon.a (mon.0) 1282 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:13:31.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:13:30 smithi157 bash[24585]: audit 2024-09-16T10:13:29.732846+0000 mon.a (mon.0) 1283 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:13:31.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:13:30 smithi157 bash[24585]: audit 2024-09-16T10:13:29.739617+0000 mon.a (mon.0) 1284 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:13:31.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:13:30 smithi157 bash[24585]: audit 2024-09-16T10:13:29.746138+0000 mon.a (mon.0) 1285 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:13:31.058 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:13:30 smithi157 bash[24585]: audit 2024-09-16T10:13:29.752940+0000 mon.a (mon.0) 1286 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:13:31.058 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:13:30 smithi157 bash[24585]: audit 2024-09-16T10:13:29.757797+0000 mon.a (mon.0) 1287 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:13:31.058 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:13:30 smithi157 bash[24585]: audit 2024-09-16T10:13:29.758790+0000 mon.b (mon.2) 1099 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T10:13:31.058 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:13:30 smithi157 bash[24585]: audit 2024-09-16T10:13:29.759723+0000 mon.b (mon.2) 1100 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T10:13:31.058 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:13:30 smithi157 bash[24585]: audit 2024-09-16T10:13:29.765653+0000 mon.a (mon.0) 1288 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:13:31.058 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:13:30 smithi157 bash[24585]: audit 2024-09-16T10:13:29.770562+0000 mon.b (mon.2) 1101 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:13:31.058 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:13:30 smithi157 bash[24585]: audit 2024-09-16T10:13:29.772160+0000 mgr.a (mgr.14373) 11951 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:13:31.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:13:30 smithi086 bash[24289]: cluster 2024-09-16T10:13:29.540775+0000 mgr.a (mgr.14373) 11950 : cluster [DBG] pgmap v8289: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:13:31.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:13:30 smithi086 bash[24289]: audit 2024-09-16T10:13:29.726667+0000 mon.a (mon.0) 1282 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:13:31.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:13:30 smithi086 bash[24289]: audit 2024-09-16T10:13:29.732846+0000 mon.a (mon.0) 1283 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:13:31.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:13:30 smithi086 bash[24289]: audit 2024-09-16T10:13:29.739617+0000 mon.a (mon.0) 1284 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:13:31.072 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:13:30 smithi086 bash[24289]: audit 2024-09-16T10:13:29.746138+0000 mon.a (mon.0) 1285 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:13:31.072 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:13:30 smithi086 bash[24289]: audit 2024-09-16T10:13:29.752940+0000 mon.a (mon.0) 1286 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:13:31.072 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:13:30 smithi086 bash[24289]: audit 2024-09-16T10:13:29.757797+0000 mon.a (mon.0) 1287 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:13:31.072 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:13:30 smithi086 bash[24289]: audit 2024-09-16T10:13:29.758790+0000 mon.b (mon.2) 1099 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T10:13:31.072 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:13:30 smithi086 bash[24289]: audit 2024-09-16T10:13:29.759723+0000 mon.b (mon.2) 1100 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T10:13:31.072 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:13:30 smithi086 bash[24289]: audit 2024-09-16T10:13:29.765653+0000 mon.a (mon.0) 1288 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:13:31.072 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:13:30 smithi086 bash[24289]: audit 2024-09-16T10:13:29.770562+0000 mon.b (mon.2) 1101 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:13:31.073 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:13:30 smithi086 bash[24289]: audit 2024-09-16T10:13:29.772160+0000 mgr.a (mgr.14373) 11951 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:13:32.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:13:31 smithi157 bash[24585]: audit 2024-09-16T10:13:30.193333+0000 mgr.a (mgr.14373) 11952 : audit [DBG] from='client.261276 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:13:32.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:13:31 smithi157 bash[24585]: audit 2024-09-16T10:13:30.500409+0000 mgr.a (mgr.14373) 11953 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T10:13:32.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:13:31 smithi157 bash[24585]: cephadm 2024-09-16T10:13:30.512429+0000 mgr.a (mgr.14373) 11954 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T10:13:32.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:13:31 smithi086 bash[24289]: audit 2024-09-16T10:13:30.193333+0000 mgr.a (mgr.14373) 11952 : audit [DBG] from='client.261276 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:13:32.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:13:31 smithi086 bash[24289]: audit 2024-09-16T10:13:30.500409+0000 mgr.a (mgr.14373) 11953 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T10:13:32.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:13:31 smithi086 bash[24289]: cephadm 2024-09-16T10:13:30.512429+0000 mgr.a (mgr.14373) 11954 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T10:13:32.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:13:31 smithi047 bash[22744]: audit 2024-09-16T10:13:30.193333+0000 mgr.a (mgr.14373) 11952 : audit [DBG] from='client.261276 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:13:32.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:13:31 smithi047 bash[22744]: audit 2024-09-16T10:13:30.500409+0000 mgr.a (mgr.14373) 11953 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T10:13:32.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:13:31 smithi047 bash[22744]: cephadm 2024-09-16T10:13:30.512429+0000 mgr.a (mgr.14373) 11954 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T10:13:33.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:13:32 smithi157 bash[24585]: cluster 2024-09-16T10:13:31.542666+0000 mgr.a (mgr.14373) 11955 : cluster [DBG] pgmap v8290: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 6.4 KiB/s rd, 341 B/s wr, 6 op/s 2024-09-16T10:13:33.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:13:32 smithi086 bash[24289]: cluster 2024-09-16T10:13:31.542666+0000 mgr.a (mgr.14373) 11955 : cluster [DBG] pgmap v8290: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 6.4 KiB/s rd, 341 B/s wr, 6 op/s 2024-09-16T10:13:33.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:13:32 smithi047 bash[22744]: cluster 2024-09-16T10:13:31.542666+0000 mgr.a (mgr.14373) 11955 : cluster [DBG] pgmap v8290: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 6.4 KiB/s rd, 341 B/s wr, 6 op/s 2024-09-16T10:13:35.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:13:34 smithi157 bash[24585]: cluster 2024-09-16T10:13:33.544051+0000 mgr.a (mgr.14373) 11956 : cluster [DBG] pgmap v8291: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.1 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:13:35.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:13:34 smithi086 bash[24289]: cluster 2024-09-16T10:13:33.544051+0000 mgr.a (mgr.14373) 11956 : cluster [DBG] pgmap v8291: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.1 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:13:35.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:13:34 smithi047 bash[22744]: cluster 2024-09-16T10:13:33.544051+0000 mgr.a (mgr.14373) 11956 : cluster [DBG] pgmap v8291: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.1 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:13:35.906 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:13:35.907 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:13:35.907 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:13:36.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:13:36 smithi157 bash[24585]: cluster 2024-09-16T10:13:35.545053+0000 mgr.a (mgr.14373) 11957 : cluster [DBG] pgmap v8292: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:13:36.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:13:36 smithi086 bash[24289]: cluster 2024-09-16T10:13:35.545053+0000 mgr.a (mgr.14373) 11957 : cluster [DBG] pgmap v8292: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:13:36.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:13:36 smithi047 bash[22744]: cluster 2024-09-16T10:13:35.545053+0000 mgr.a (mgr.14373) 11957 : cluster [DBG] pgmap v8292: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:13:36.651 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:13:36.651 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:13:36.651 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:13:36.651 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:13:36.651 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:13:37.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:13:37 smithi157 bash[24585]: audit 2024-09-16T10:13:36.235352+0000 mgr.a (mgr.14373) 11958 : audit [DBG] from='client.261441 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:13:37.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:13:37 smithi086 bash[24289]: audit 2024-09-16T10:13:36.235352+0000 mgr.a (mgr.14373) 11958 : audit [DBG] from='client.261441 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:13:37.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:13:37 smithi047 bash[22744]: audit 2024-09-16T10:13:36.235352+0000 mgr.a (mgr.14373) 11958 : audit [DBG] from='client.261441 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:13:38.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:13:38 smithi157 bash[24585]: cluster 2024-09-16T10:13:37.547591+0000 mgr.a (mgr.14373) 11959 : cluster [DBG] pgmap v8293: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:13:38.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:13:38 smithi086 bash[24289]: cluster 2024-09-16T10:13:37.547591+0000 mgr.a (mgr.14373) 11959 : cluster [DBG] pgmap v8293: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:13:38.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:13:38 smithi047 bash[22744]: cluster 2024-09-16T10:13:37.547591+0000 mgr.a (mgr.14373) 11959 : cluster [DBG] pgmap v8293: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:13:41.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:13:40 smithi157 bash[24585]: cluster 2024-09-16T10:13:39.548364+0000 mgr.a (mgr.14373) 11960 : cluster [DBG] pgmap v8294: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T10:13:41.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:13:40 smithi086 bash[24289]: cluster 2024-09-16T10:13:39.548364+0000 mgr.a (mgr.14373) 11960 : cluster [DBG] pgmap v8294: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T10:13:41.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:13:40 smithi047 bash[22744]: cluster 2024-09-16T10:13:39.548364+0000 mgr.a (mgr.14373) 11960 : cluster [DBG] pgmap v8294: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T10:13:41.652 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:13:41.653 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:13:41.653 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:13:42.430 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:13:42.430 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:13:42.430 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:13:42.430 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:13:42.430 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:13:43.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:13:42 smithi157 bash[24585]: cluster 2024-09-16T10:13:41.549881+0000 mgr.a (mgr.14373) 11961 : cluster [DBG] pgmap v8295: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:13:43.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:13:42 smithi157 bash[24585]: audit 2024-09-16T10:13:41.989830+0000 mgr.a (mgr.14373) 11962 : audit [DBG] from='client.261513 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:13:43.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:13:42 smithi086 bash[24289]: cluster 2024-09-16T10:13:41.549881+0000 mgr.a (mgr.14373) 11961 : cluster [DBG] pgmap v8295: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:13:43.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:13:42 smithi086 bash[24289]: audit 2024-09-16T10:13:41.989830+0000 mgr.a (mgr.14373) 11962 : audit [DBG] from='client.261513 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:13:43.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:13:42 smithi047 bash[22744]: cluster 2024-09-16T10:13:41.549881+0000 mgr.a (mgr.14373) 11961 : cluster [DBG] pgmap v8295: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:13:43.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:13:42 smithi047 bash[22744]: audit 2024-09-16T10:13:41.989830+0000 mgr.a (mgr.14373) 11962 : audit [DBG] from='client.261513 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:13:45.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:13:44 smithi157 bash[24585]: cluster 2024-09-16T10:13:43.551701+0000 mgr.a (mgr.14373) 11963 : cluster [DBG] pgmap v8296: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.4 KiB/s rd, 85 B/s wr, 2 op/s 2024-09-16T10:13:45.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:13:44 smithi086 bash[24289]: cluster 2024-09-16T10:13:43.551701+0000 mgr.a (mgr.14373) 11963 : cluster [DBG] pgmap v8296: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.4 KiB/s rd, 85 B/s wr, 2 op/s 2024-09-16T10:13:45.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:13:44 smithi047 bash[22744]: cluster 2024-09-16T10:13:43.551701+0000 mgr.a (mgr.14373) 11963 : cluster [DBG] pgmap v8296: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.4 KiB/s rd, 85 B/s wr, 2 op/s 2024-09-16T10:13:47.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:13:46 smithi157 bash[24585]: cluster 2024-09-16T10:13:45.552499+0000 mgr.a (mgr.14373) 11964 : cluster [DBG] pgmap v8297: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:13:47.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:13:46 smithi086 bash[24289]: cluster 2024-09-16T10:13:45.552499+0000 mgr.a (mgr.14373) 11964 : cluster [DBG] pgmap v8297: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:13:47.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:13:46 smithi047 bash[22744]: cluster 2024-09-16T10:13:45.552499+0000 mgr.a (mgr.14373) 11964 : cluster [DBG] pgmap v8297: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:13:47.431 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:13:47.432 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:13:47.432 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:13:48.221 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:13:48.221 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:13:48.221 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:13:48.222 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:13:48.222 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:13:49.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:13:48 smithi157 bash[24585]: cluster 2024-09-16T10:13:47.553581+0000 mgr.a (mgr.14373) 11965 : cluster [DBG] pgmap v8298: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:13:49.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:13:48 smithi157 bash[24585]: audit 2024-09-16T10:13:47.769018+0000 mgr.a (mgr.14373) 11966 : audit [DBG] from='client.261591 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:13:49.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:13:48 smithi086 bash[24289]: cluster 2024-09-16T10:13:47.553581+0000 mgr.a (mgr.14373) 11965 : cluster [DBG] pgmap v8298: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:13:49.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:13:48 smithi086 bash[24289]: audit 2024-09-16T10:13:47.769018+0000 mgr.a (mgr.14373) 11966 : audit [DBG] from='client.261591 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:13:49.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:13:48 smithi047 bash[22744]: cluster 2024-09-16T10:13:47.553581+0000 mgr.a (mgr.14373) 11965 : cluster [DBG] pgmap v8298: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:13:49.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:13:48 smithi047 bash[22744]: audit 2024-09-16T10:13:47.769018+0000 mgr.a (mgr.14373) 11966 : audit [DBG] from='client.261591 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:13:51.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:13:50 smithi157 bash[24585]: cluster 2024-09-16T10:13:49.554495+0000 mgr.a (mgr.14373) 11967 : cluster [DBG] pgmap v8299: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-16T10:13:51.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:13:50 smithi086 bash[24289]: cluster 2024-09-16T10:13:49.554495+0000 mgr.a (mgr.14373) 11967 : cluster [DBG] pgmap v8299: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-16T10:13:51.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:13:50 smithi047 bash[22744]: cluster 2024-09-16T10:13:49.554495+0000 mgr.a (mgr.14373) 11967 : cluster [DBG] pgmap v8299: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-16T10:13:53.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:13:52 smithi157 bash[24585]: cluster 2024-09-16T10:13:51.556237+0000 mgr.a (mgr.14373) 11968 : cluster [DBG] pgmap v8300: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.4 KiB/s rd, 2 op/s 2024-09-16T10:13:53.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:13:52 smithi086 bash[24289]: cluster 2024-09-16T10:13:51.556237+0000 mgr.a (mgr.14373) 11968 : cluster [DBG] pgmap v8300: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.4 KiB/s rd, 2 op/s 2024-09-16T10:13:53.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:13:52 smithi047 bash[22744]: cluster 2024-09-16T10:13:51.556237+0000 mgr.a (mgr.14373) 11968 : cluster [DBG] pgmap v8300: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.4 KiB/s rd, 2 op/s 2024-09-16T10:13:53.223 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:13:53.223 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:13:53.224 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:13:54.010 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:13:54.010 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:13:54.010 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:13:54.010 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:13:54.011 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:13:55.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:13:54 smithi157 bash[24585]: cluster 2024-09-16T10:13:53.557424+0000 mgr.a (mgr.14373) 11969 : cluster [DBG] pgmap v8301: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:13:55.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:13:54 smithi157 bash[24585]: audit 2024-09-16T10:13:53.561143+0000 mgr.a (mgr.14373) 11970 : audit [DBG] from='client.261669 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:13:55.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:13:54 smithi086 bash[24289]: cluster 2024-09-16T10:13:53.557424+0000 mgr.a (mgr.14373) 11969 : cluster [DBG] pgmap v8301: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:13:55.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:13:54 smithi086 bash[24289]: audit 2024-09-16T10:13:53.561143+0000 mgr.a (mgr.14373) 11970 : audit [DBG] from='client.261669 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:13:55.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:13:54 smithi047 bash[22744]: cluster 2024-09-16T10:13:53.557424+0000 mgr.a (mgr.14373) 11969 : cluster [DBG] pgmap v8301: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:13:55.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:13:54 smithi047 bash[22744]: audit 2024-09-16T10:13:53.561143+0000 mgr.a (mgr.14373) 11970 : audit [DBG] from='client.261669 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:13:57.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:13:56 smithi157 bash[24585]: cluster 2024-09-16T10:13:55.558587+0000 mgr.a (mgr.14373) 11971 : cluster [DBG] pgmap v8302: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:13:57.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:13:56 smithi086 bash[24289]: cluster 2024-09-16T10:13:55.558587+0000 mgr.a (mgr.14373) 11971 : cluster [DBG] pgmap v8302: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:13:57.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:13:56 smithi047 bash[22744]: cluster 2024-09-16T10:13:55.558587+0000 mgr.a (mgr.14373) 11971 : cluster [DBG] pgmap v8302: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:13:59.012 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:13:59.012 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:13:59.012 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:13:59.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:13:58 smithi157 bash[24585]: cluster 2024-09-16T10:13:57.560981+0000 mgr.a (mgr.14373) 11972 : cluster [DBG] pgmap v8303: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:13:59.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:13:58 smithi086 bash[24289]: cluster 2024-09-16T10:13:57.560981+0000 mgr.a (mgr.14373) 11972 : cluster [DBG] pgmap v8303: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:13:59.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:13:58 smithi047 bash[22744]: cluster 2024-09-16T10:13:57.560981+0000 mgr.a (mgr.14373) 11972 : cluster [DBG] pgmap v8303: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:13:59.766 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:13:59.766 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:13:59.766 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:13:59.767 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:13:59.767 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:14:01.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:14:00 smithi157 bash[24585]: audit 2024-09-16T10:13:59.342024+0000 mgr.a (mgr.14373) 11973 : audit [DBG] from='client.261747 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:14:01.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:14:00 smithi157 bash[24585]: cluster 2024-09-16T10:13:59.561500+0000 mgr.a (mgr.14373) 11974 : cluster [DBG] pgmap v8304: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:14:01.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:14:00 smithi086 bash[24289]: audit 2024-09-16T10:13:59.342024+0000 mgr.a (mgr.14373) 11973 : audit [DBG] from='client.261747 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:14:01.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:14:00 smithi086 bash[24289]: cluster 2024-09-16T10:13:59.561500+0000 mgr.a (mgr.14373) 11974 : cluster [DBG] pgmap v8304: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:14:01.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:14:00 smithi047 bash[22744]: audit 2024-09-16T10:13:59.342024+0000 mgr.a (mgr.14373) 11973 : audit [DBG] from='client.261747 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:14:01.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:14:00 smithi047 bash[22744]: cluster 2024-09-16T10:13:59.561500+0000 mgr.a (mgr.14373) 11974 : cluster [DBG] pgmap v8304: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:14:03.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:14:02 smithi157 bash[24585]: cluster 2024-09-16T10:14:01.563358+0000 mgr.a (mgr.14373) 11975 : cluster [DBG] pgmap v8305: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:14:03.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:14:02 smithi086 bash[24289]: cluster 2024-09-16T10:14:01.563358+0000 mgr.a (mgr.14373) 11975 : cluster [DBG] pgmap v8305: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:14:03.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:14:02 smithi047 bash[22744]: cluster 2024-09-16T10:14:01.563358+0000 mgr.a (mgr.14373) 11975 : cluster [DBG] pgmap v8305: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:14:04.768 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:14:04.769 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:14:04.769 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:14:05.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:14:04 smithi157 bash[24585]: cluster 2024-09-16T10:14:03.564567+0000 mgr.a (mgr.14373) 11976 : cluster [DBG] pgmap v8306: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-16T10:14:05.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:14:04 smithi086 bash[24289]: cluster 2024-09-16T10:14:03.564567+0000 mgr.a (mgr.14373) 11976 : cluster [DBG] pgmap v8306: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-16T10:14:05.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:14:04 smithi047 bash[22744]: cluster 2024-09-16T10:14:03.564567+0000 mgr.a (mgr.14373) 11976 : cluster [DBG] pgmap v8306: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-16T10:14:05.555 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:14:05.555 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:14:05.555 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:14:05.555 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:14:05.555 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:14:06.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:14:05 smithi157 bash[24585]: audit 2024-09-16T10:14:05.106811+0000 mgr.a (mgr.14373) 11977 : audit [DBG] from='client.261825 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:14:06.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:14:05 smithi086 bash[24289]: audit 2024-09-16T10:14:05.106811+0000 mgr.a (mgr.14373) 11977 : audit [DBG] from='client.261825 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:14:06.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:14:05 smithi047 bash[22744]: audit 2024-09-16T10:14:05.106811+0000 mgr.a (mgr.14373) 11977 : audit [DBG] from='client.261825 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:14:07.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:14:06 smithi157 bash[24585]: cluster 2024-09-16T10:14:05.565113+0000 mgr.a (mgr.14373) 11978 : cluster [DBG] pgmap v8307: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:14:07.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:14:06 smithi086 bash[24289]: cluster 2024-09-16T10:14:05.565113+0000 mgr.a (mgr.14373) 11978 : cluster [DBG] pgmap v8307: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:14:07.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:14:06 smithi047 bash[22744]: cluster 2024-09-16T10:14:05.565113+0000 mgr.a (mgr.14373) 11978 : cluster [DBG] pgmap v8307: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:14:09.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:14:08 smithi157 bash[24585]: cluster 2024-09-16T10:14:07.567365+0000 mgr.a (mgr.14373) 11979 : cluster [DBG] pgmap v8308: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:14:09.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:14:08 smithi086 bash[24289]: cluster 2024-09-16T10:14:07.567365+0000 mgr.a (mgr.14373) 11979 : cluster [DBG] pgmap v8308: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:14:09.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:14:08 smithi047 bash[22744]: cluster 2024-09-16T10:14:07.567365+0000 mgr.a (mgr.14373) 11979 : cluster [DBG] pgmap v8308: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:14:10.556 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:14:10.557 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:14:10.557 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:14:11.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:14:10 smithi157 bash[24585]: cluster 2024-09-16T10:14:09.568126+0000 mgr.a (mgr.14373) 11980 : cluster [DBG] pgmap v8309: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:14:11.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:14:10 smithi086 bash[24289]: cluster 2024-09-16T10:14:09.568126+0000 mgr.a (mgr.14373) 11980 : cluster [DBG] pgmap v8309: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:14:11.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:14:10 smithi047 bash[22744]: cluster 2024-09-16T10:14:09.568126+0000 mgr.a (mgr.14373) 11980 : cluster [DBG] pgmap v8309: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:14:11.306 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:14:11.306 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:14:11.306 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:14:11.307 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:14:11.307 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:14:12.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:14:11 smithi157 bash[24585]: audit 2024-09-16T10:14:10.891409+0000 mgr.a (mgr.14373) 11981 : audit [DBG] from='client.261900 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:14:12.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:14:11 smithi086 bash[24289]: audit 2024-09-16T10:14:10.891409+0000 mgr.a (mgr.14373) 11981 : audit [DBG] from='client.261900 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:14:12.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:14:11 smithi047 bash[22744]: audit 2024-09-16T10:14:10.891409+0000 mgr.a (mgr.14373) 11981 : audit [DBG] from='client.261900 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:14:13.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:14:12 smithi157 bash[24585]: cluster 2024-09-16T10:14:11.570171+0000 mgr.a (mgr.14373) 11982 : cluster [DBG] pgmap v8310: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:14:13.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:14:12 smithi086 bash[24289]: cluster 2024-09-16T10:14:11.570171+0000 mgr.a (mgr.14373) 11982 : cluster [DBG] pgmap v8310: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:14:13.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:14:12 smithi047 bash[22744]: cluster 2024-09-16T10:14:11.570171+0000 mgr.a (mgr.14373) 11982 : cluster [DBG] pgmap v8310: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:14:15.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:14:14 smithi157 bash[24585]: cluster 2024-09-16T10:14:13.571607+0000 mgr.a (mgr.14373) 11983 : cluster [DBG] pgmap v8311: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-16T10:14:15.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:14:14 smithi086 bash[24289]: cluster 2024-09-16T10:14:13.571607+0000 mgr.a (mgr.14373) 11983 : cluster [DBG] pgmap v8311: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-16T10:14:15.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:14:14 smithi047 bash[22744]: cluster 2024-09-16T10:14:13.571607+0000 mgr.a (mgr.14373) 11983 : cluster [DBG] pgmap v8311: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-16T10:14:16.308 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:14:16.308 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:14:16.308 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:14:17.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:14:16 smithi157 bash[24585]: cluster 2024-09-16T10:14:15.572560+0000 mgr.a (mgr.14373) 11984 : cluster [DBG] pgmap v8312: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:14:17.067 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:14:17.068 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:14:17.068 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:14:17.068 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:14:17.068 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:14:17.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:14:16 smithi086 bash[24289]: cluster 2024-09-16T10:14:15.572560+0000 mgr.a (mgr.14373) 11984 : cluster [DBG] pgmap v8312: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:14:17.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:14:16 smithi047 bash[22744]: cluster 2024-09-16T10:14:15.572560+0000 mgr.a (mgr.14373) 11984 : cluster [DBG] pgmap v8312: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:14:18.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:14:17 smithi157 bash[24585]: audit 2024-09-16T10:14:16.636104+0000 mgr.a (mgr.14373) 11985 : audit [DBG] from='client.261978 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:14:18.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:14:17 smithi086 bash[24289]: audit 2024-09-16T10:14:16.636104+0000 mgr.a (mgr.14373) 11985 : audit [DBG] from='client.261978 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:14:18.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:14:17 smithi047 bash[22744]: audit 2024-09-16T10:14:16.636104+0000 mgr.a (mgr.14373) 11985 : audit [DBG] from='client.261978 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:14:19.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:14:18 smithi157 bash[24585]: cluster 2024-09-16T10:14:17.575420+0000 mgr.a (mgr.14373) 11986 : cluster [DBG] pgmap v8313: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:14:19.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:14:18 smithi086 bash[24289]: cluster 2024-09-16T10:14:17.575420+0000 mgr.a (mgr.14373) 11986 : cluster [DBG] pgmap v8313: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:14:19.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:14:18 smithi047 bash[22744]: cluster 2024-09-16T10:14:17.575420+0000 mgr.a (mgr.14373) 11986 : cluster [DBG] pgmap v8313: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:14:21.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:14:20 smithi157 bash[24585]: cluster 2024-09-16T10:14:19.576204+0000 mgr.a (mgr.14373) 11987 : cluster [DBG] pgmap v8314: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:14:21.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:14:20 smithi086 bash[24289]: cluster 2024-09-16T10:14:19.576204+0000 mgr.a (mgr.14373) 11987 : cluster [DBG] pgmap v8314: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:14:21.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:14:20 smithi047 bash[22744]: cluster 2024-09-16T10:14:19.576204+0000 mgr.a (mgr.14373) 11987 : cluster [DBG] pgmap v8314: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:14:22.069 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:14:22.070 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:14:22.070 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:14:22.859 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:14:22.859 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:14:22.859 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:14:22.859 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:14:22.859 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:14:23.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:14:22 smithi157 bash[24585]: cluster 2024-09-16T10:14:21.577845+0000 mgr.a (mgr.14373) 11988 : cluster [DBG] pgmap v8315: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-16T10:14:23.072 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:14:22 smithi086 bash[24289]: cluster 2024-09-16T10:14:21.577845+0000 mgr.a (mgr.14373) 11988 : cluster [DBG] pgmap v8315: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-16T10:14:23.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:14:22 smithi047 bash[22744]: cluster 2024-09-16T10:14:21.577845+0000 mgr.a (mgr.14373) 11988 : cluster [DBG] pgmap v8315: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-16T10:14:24.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:14:23 smithi157 bash[24585]: audit 2024-09-16T10:14:22.400587+0000 mgr.a (mgr.14373) 11989 : audit [DBG] from='client.262056 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:14:24.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:14:23 smithi086 bash[24289]: audit 2024-09-16T10:14:22.400587+0000 mgr.a (mgr.14373) 11989 : audit [DBG] from='client.262056 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:14:24.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:14:23 smithi047 bash[22744]: audit 2024-09-16T10:14:22.400587+0000 mgr.a (mgr.14373) 11989 : audit [DBG] from='client.262056 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:14:25.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:14:24 smithi157 bash[24585]: cluster 2024-09-16T10:14:23.579674+0000 mgr.a (mgr.14373) 11990 : cluster [DBG] pgmap v8316: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-16T10:14:25.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:14:24 smithi086 bash[24289]: cluster 2024-09-16T10:14:23.579674+0000 mgr.a (mgr.14373) 11990 : cluster [DBG] pgmap v8316: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-16T10:14:25.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:14:24 smithi047 bash[22744]: cluster 2024-09-16T10:14:23.579674+0000 mgr.a (mgr.14373) 11990 : cluster [DBG] pgmap v8316: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-16T10:14:27.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:14:26 smithi157 bash[24585]: cluster 2024-09-16T10:14:25.580463+0000 mgr.a (mgr.14373) 11991 : cluster [DBG] pgmap v8317: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:14:27.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:14:26 smithi086 bash[24289]: cluster 2024-09-16T10:14:25.580463+0000 mgr.a (mgr.14373) 11991 : cluster [DBG] pgmap v8317: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:14:27.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:14:26 smithi047 bash[22744]: cluster 2024-09-16T10:14:25.580463+0000 mgr.a (mgr.14373) 11991 : cluster [DBG] pgmap v8317: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:14:27.860 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:14:27.861 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:14:27.861 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:14:28.625 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:14:28.626 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:14:28.626 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:14:28.626 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:14:28.626 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:14:29.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:14:28 smithi157 bash[24585]: cluster 2024-09-16T10:14:27.582573+0000 mgr.a (mgr.14373) 11992 : cluster [DBG] pgmap v8318: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:14:29.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:14:28 smithi086 bash[24289]: cluster 2024-09-16T10:14:27.582573+0000 mgr.a (mgr.14373) 11992 : cluster [DBG] pgmap v8318: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:14:29.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:14:28 smithi047 bash[22744]: cluster 2024-09-16T10:14:27.582573+0000 mgr.a (mgr.14373) 11992 : cluster [DBG] pgmap v8318: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:14:30.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:14:29 smithi157 bash[24585]: audit 2024-09-16T10:14:28.192566+0000 mgr.a (mgr.14373) 11993 : audit [DBG] from='client.262128 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:14:30.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:14:29 smithi086 bash[24289]: audit 2024-09-16T10:14:28.192566+0000 mgr.a (mgr.14373) 11993 : audit [DBG] from='client.262128 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:14:30.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:14:29 smithi047 bash[22744]: audit 2024-09-16T10:14:28.192566+0000 mgr.a (mgr.14373) 11993 : audit [DBG] from='client.262128 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:14:31.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:14:30 smithi157 bash[24585]: cluster 2024-09-16T10:14:29.583590+0000 mgr.a (mgr.14373) 11994 : cluster [DBG] pgmap v8319: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:14:31.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:14:30 smithi157 bash[24585]: audit 2024-09-16T10:14:30.569590+0000 mon.b (mon.2) 1102 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T10:14:31.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:14:30 smithi086 bash[24289]: cluster 2024-09-16T10:14:29.583590+0000 mgr.a (mgr.14373) 11994 : cluster [DBG] pgmap v8319: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:14:31.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:14:30 smithi086 bash[24289]: audit 2024-09-16T10:14:30.569590+0000 mon.b (mon.2) 1102 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T10:14:31.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:14:30 smithi047 bash[22744]: cluster 2024-09-16T10:14:29.583590+0000 mgr.a (mgr.14373) 11994 : cluster [DBG] pgmap v8319: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:14:31.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:14:30 smithi047 bash[22744]: audit 2024-09-16T10:14:30.569590+0000 mon.b (mon.2) 1102 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T10:14:32.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:14:31 smithi157 bash[24585]: audit 2024-09-16T10:14:31.411505+0000 mon.b (mon.2) 1103 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T10:14:32.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:14:31 smithi157 bash[24585]: audit 2024-09-16T10:14:31.413619+0000 mon.b (mon.2) 1104 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T10:14:32.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:14:31 smithi157 bash[24585]: audit 2024-09-16T10:14:31.425169+0000 mon.a (mon.0) 1289 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:14:32.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:14:31 smithi157 bash[24585]: audit 2024-09-16T10:14:31.430386+0000 mon.b (mon.2) 1105 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:14:32.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:14:31 smithi086 bash[24289]: audit 2024-09-16T10:14:31.411505+0000 mon.b (mon.2) 1103 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T10:14:32.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:14:31 smithi086 bash[24289]: audit 2024-09-16T10:14:31.413619+0000 mon.b (mon.2) 1104 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T10:14:32.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:14:31 smithi086 bash[24289]: audit 2024-09-16T10:14:31.425169+0000 mon.a (mon.0) 1289 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:14:32.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:14:31 smithi086 bash[24289]: audit 2024-09-16T10:14:31.430386+0000 mon.b (mon.2) 1105 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:14:32.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:14:31 smithi047 bash[22744]: audit 2024-09-16T10:14:31.411505+0000 mon.b (mon.2) 1103 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T10:14:32.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:14:31 smithi047 bash[22744]: audit 2024-09-16T10:14:31.413619+0000 mon.b (mon.2) 1104 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T10:14:32.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:14:31 smithi047 bash[22744]: audit 2024-09-16T10:14:31.425169+0000 mon.a (mon.0) 1289 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:14:32.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:14:31 smithi047 bash[22744]: audit 2024-09-16T10:14:31.430386+0000 mon.b (mon.2) 1105 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:14:32.592 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 10:14:32 smithi047 bash[22994]: debug 2024-09-16T10:14:32.175+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T10:14:32.593 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 10:14:32 smithi047 bash[22994]: debug 2024-09-16T10:14:32.175+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T10:14:33.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:14:32 smithi157 bash[24585]: audit 2024-09-16T10:14:31.433286+0000 mgr.a (mgr.14373) 11995 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:14:33.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:14:32 smithi157 bash[24585]: cluster 2024-09-16T10:14:31.585720+0000 mgr.a (mgr.14373) 11996 : cluster [DBG] pgmap v8320: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:14:33.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:14:32 smithi086 bash[24289]: audit 2024-09-16T10:14:31.433286+0000 mgr.a (mgr.14373) 11995 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:14:33.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:14:32 smithi086 bash[24289]: cluster 2024-09-16T10:14:31.585720+0000 mgr.a (mgr.14373) 11996 : cluster [DBG] pgmap v8320: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:14:33.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:14:32 smithi047 bash[22744]: audit 2024-09-16T10:14:31.433286+0000 mgr.a (mgr.14373) 11995 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:14:33.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:14:32 smithi047 bash[22744]: cluster 2024-09-16T10:14:31.585720+0000 mgr.a (mgr.14373) 11996 : cluster [DBG] pgmap v8320: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:14:33.627 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:14:33.627 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:14:33.628 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:14:34.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:14:33 smithi157 bash[24585]: audit 2024-09-16T10:14:32.179401+0000 mgr.a (mgr.14373) 11997 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T10:14:34.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:14:33 smithi157 bash[24585]: cephadm 2024-09-16T10:14:32.181281+0000 mgr.a (mgr.14373) 11998 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T10:14:34.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:14:33 smithi086 bash[24289]: audit 2024-09-16T10:14:32.179401+0000 mgr.a (mgr.14373) 11997 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T10:14:34.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:14:33 smithi086 bash[24289]: cephadm 2024-09-16T10:14:32.181281+0000 mgr.a (mgr.14373) 11998 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T10:14:34.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:14:33 smithi047 bash[22744]: audit 2024-09-16T10:14:32.179401+0000 mgr.a (mgr.14373) 11997 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T10:14:34.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:14:33 smithi047 bash[22744]: cephadm 2024-09-16T10:14:32.181281+0000 mgr.a (mgr.14373) 11998 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T10:14:34.384 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:14:34.384 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:14:34.384 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:14:34.384 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:14:34.384 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:14:35.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:14:34 smithi157 bash[24585]: cluster 2024-09-16T10:14:33.587605+0000 mgr.a (mgr.14373) 11999 : cluster [DBG] pgmap v8321: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.4 KiB/s rd, 2 op/s 2024-09-16T10:14:35.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:14:34 smithi157 bash[24585]: audit 2024-09-16T10:14:33.960587+0000 mgr.a (mgr.14373) 12000 : audit [DBG] from='client.262311 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:14:35.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:14:34 smithi086 bash[24289]: cluster 2024-09-16T10:14:33.587605+0000 mgr.a (mgr.14373) 11999 : cluster [DBG] pgmap v8321: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.4 KiB/s rd, 2 op/s 2024-09-16T10:14:35.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:14:34 smithi086 bash[24289]: audit 2024-09-16T10:14:33.960587+0000 mgr.a (mgr.14373) 12000 : audit [DBG] from='client.262311 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:14:35.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:14:34 smithi047 bash[22744]: cluster 2024-09-16T10:14:33.587605+0000 mgr.a (mgr.14373) 11999 : cluster [DBG] pgmap v8321: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.4 KiB/s rd, 2 op/s 2024-09-16T10:14:35.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:14:34 smithi047 bash[22744]: audit 2024-09-16T10:14:33.960587+0000 mgr.a (mgr.14373) 12000 : audit [DBG] from='client.262311 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:14:37.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:14:36 smithi157 bash[24585]: cluster 2024-09-16T10:14:35.588618+0000 mgr.a (mgr.14373) 12001 : cluster [DBG] pgmap v8322: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-16T10:14:37.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:14:36 smithi086 bash[24289]: cluster 2024-09-16T10:14:35.588618+0000 mgr.a (mgr.14373) 12001 : cluster [DBG] pgmap v8322: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-16T10:14:37.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:14:36 smithi047 bash[22744]: cluster 2024-09-16T10:14:35.588618+0000 mgr.a (mgr.14373) 12001 : cluster [DBG] pgmap v8322: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-16T10:14:39.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:14:38 smithi157 bash[24585]: cluster 2024-09-16T10:14:37.590887+0000 mgr.a (mgr.14373) 12002 : cluster [DBG] pgmap v8323: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 8.4 KiB/s rd, 426 B/s wr, 8 op/s 2024-09-16T10:14:39.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:14:38 smithi086 bash[24289]: cluster 2024-09-16T10:14:37.590887+0000 mgr.a (mgr.14373) 12002 : cluster [DBG] pgmap v8323: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 8.4 KiB/s rd, 426 B/s wr, 8 op/s 2024-09-16T10:14:39.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:14:38 smithi047 bash[22744]: cluster 2024-09-16T10:14:37.590887+0000 mgr.a (mgr.14373) 12002 : cluster [DBG] pgmap v8323: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 8.4 KiB/s rd, 426 B/s wr, 8 op/s 2024-09-16T10:14:39.385 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:14:39.387 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:14:39.387 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:14:40.156 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:14:40.157 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:14:40.157 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:14:40.157 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:14:40.157 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:14:41.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:14:40 smithi157 bash[24585]: cluster 2024-09-16T10:14:39.591619+0000 mgr.a (mgr.14373) 12003 : cluster [DBG] pgmap v8324: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:14:41.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:14:40 smithi157 bash[24585]: audit 2024-09-16T10:14:39.718912+0000 mgr.a (mgr.14373) 12004 : audit [DBG] from='client.262389 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:14:41.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:14:40 smithi086 bash[24289]: cluster 2024-09-16T10:14:39.591619+0000 mgr.a (mgr.14373) 12003 : cluster [DBG] pgmap v8324: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:14:41.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:14:40 smithi086 bash[24289]: audit 2024-09-16T10:14:39.718912+0000 mgr.a (mgr.14373) 12004 : audit [DBG] from='client.262389 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:14:41.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:14:40 smithi047 bash[22744]: cluster 2024-09-16T10:14:39.591619+0000 mgr.a (mgr.14373) 12003 : cluster [DBG] pgmap v8324: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:14:41.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:14:40 smithi047 bash[22744]: audit 2024-09-16T10:14:39.718912+0000 mgr.a (mgr.14373) 12004 : audit [DBG] from='client.262389 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:14:43.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:14:42 smithi157 bash[24585]: cluster 2024-09-16T10:14:41.593485+0000 mgr.a (mgr.14373) 12005 : cluster [DBG] pgmap v8325: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 8.3 KiB/s rd, 426 B/s wr, 8 op/s 2024-09-16T10:14:43.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:14:42 smithi086 bash[24289]: cluster 2024-09-16T10:14:41.593485+0000 mgr.a (mgr.14373) 12005 : cluster [DBG] pgmap v8325: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 8.3 KiB/s rd, 426 B/s wr, 8 op/s 2024-09-16T10:14:43.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:14:42 smithi047 bash[22744]: cluster 2024-09-16T10:14:41.593485+0000 mgr.a (mgr.14373) 12005 : cluster [DBG] pgmap v8325: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 8.3 KiB/s rd, 426 B/s wr, 8 op/s 2024-09-16T10:14:45.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:14:44 smithi157 bash[24585]: cluster 2024-09-16T10:14:43.594790+0000 mgr.a (mgr.14373) 12006 : cluster [DBG] pgmap v8326: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.6 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:14:45.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:14:44 smithi086 bash[24289]: cluster 2024-09-16T10:14:43.594790+0000 mgr.a (mgr.14373) 12006 : cluster [DBG] pgmap v8326: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.6 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:14:45.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:14:44 smithi047 bash[22744]: cluster 2024-09-16T10:14:43.594790+0000 mgr.a (mgr.14373) 12006 : cluster [DBG] pgmap v8326: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.6 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:14:45.158 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:14:45.159 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:14:45.159 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:14:45.938 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:14:45.939 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:14:45.939 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:14:45.939 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:14:45.939 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:14:47.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:14:46 smithi157 bash[24585]: audit 2024-09-16T10:14:45.490063+0000 mgr.a (mgr.14373) 12007 : audit [DBG] from='client.262467 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:14:47.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:14:46 smithi157 bash[24585]: cluster 2024-09-16T10:14:45.595277+0000 mgr.a (mgr.14373) 12008 : cluster [DBG] pgmap v8327: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:14:47.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:14:46 smithi086 bash[24289]: audit 2024-09-16T10:14:45.490063+0000 mgr.a (mgr.14373) 12007 : audit [DBG] from='client.262467 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:14:47.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:14:46 smithi086 bash[24289]: cluster 2024-09-16T10:14:45.595277+0000 mgr.a (mgr.14373) 12008 : cluster [DBG] pgmap v8327: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:14:47.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:14:46 smithi047 bash[22744]: audit 2024-09-16T10:14:45.490063+0000 mgr.a (mgr.14373) 12007 : audit [DBG] from='client.262467 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:14:47.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:14:46 smithi047 bash[22744]: cluster 2024-09-16T10:14:45.595277+0000 mgr.a (mgr.14373) 12008 : cluster [DBG] pgmap v8327: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:14:49.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:14:48 smithi157 bash[24585]: cluster 2024-09-16T10:14:47.597605+0000 mgr.a (mgr.14373) 12009 : cluster [DBG] pgmap v8328: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:14:49.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:14:48 smithi086 bash[24289]: cluster 2024-09-16T10:14:47.597605+0000 mgr.a (mgr.14373) 12009 : cluster [DBG] pgmap v8328: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:14:49.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:14:48 smithi047 bash[22744]: cluster 2024-09-16T10:14:47.597605+0000 mgr.a (mgr.14373) 12009 : cluster [DBG] pgmap v8328: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:14:50.940 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:14:50.941 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:14:50.941 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:14:51.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:14:50 smithi157 bash[24585]: cluster 2024-09-16T10:14:49.598380+0000 mgr.a (mgr.14373) 12010 : cluster [DBG] pgmap v8329: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:14:51.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:14:50 smithi086 bash[24289]: cluster 2024-09-16T10:14:49.598380+0000 mgr.a (mgr.14373) 12010 : cluster [DBG] pgmap v8329: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:14:51.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:14:50 smithi047 bash[22744]: cluster 2024-09-16T10:14:49.598380+0000 mgr.a (mgr.14373) 12010 : cluster [DBG] pgmap v8329: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:14:51.696 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:14:51.696 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:14:51.696 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:14:51.696 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:14:51.696 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:14:53.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:14:52 smithi157 bash[24585]: audit 2024-09-16T10:14:51.271398+0000 mgr.a (mgr.14373) 12011 : audit [DBG] from='client.262539 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:14:53.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:14:52 smithi157 bash[24585]: cluster 2024-09-16T10:14:51.599889+0000 mgr.a (mgr.14373) 12012 : cluster [DBG] pgmap v8330: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:14:53.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:14:52 smithi086 bash[24289]: audit 2024-09-16T10:14:51.271398+0000 mgr.a (mgr.14373) 12011 : audit [DBG] from='client.262539 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:14:53.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:14:52 smithi086 bash[24289]: cluster 2024-09-16T10:14:51.599889+0000 mgr.a (mgr.14373) 12012 : cluster [DBG] pgmap v8330: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:14:53.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:14:52 smithi047 bash[22744]: audit 2024-09-16T10:14:51.271398+0000 mgr.a (mgr.14373) 12011 : audit [DBG] from='client.262539 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:14:53.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:14:52 smithi047 bash[22744]: cluster 2024-09-16T10:14:51.599889+0000 mgr.a (mgr.14373) 12012 : cluster [DBG] pgmap v8330: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:14:55.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:14:54 smithi157 bash[24585]: cluster 2024-09-16T10:14:53.601119+0000 mgr.a (mgr.14373) 12013 : cluster [DBG] pgmap v8331: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-16T10:14:55.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:14:54 smithi086 bash[24289]: cluster 2024-09-16T10:14:53.601119+0000 mgr.a (mgr.14373) 12013 : cluster [DBG] pgmap v8331: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-16T10:14:55.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:14:54 smithi047 bash[22744]: cluster 2024-09-16T10:14:53.601119+0000 mgr.a (mgr.14373) 12013 : cluster [DBG] pgmap v8331: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-16T10:14:56.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:14:56 smithi157 bash[24585]: cluster 2024-09-16T10:14:55.601923+0000 mgr.a (mgr.14373) 12014 : cluster [DBG] pgmap v8332: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-16T10:14:56.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:14:56 smithi086 bash[24289]: cluster 2024-09-16T10:14:55.601923+0000 mgr.a (mgr.14373) 12014 : cluster [DBG] pgmap v8332: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-16T10:14:56.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:14:56 smithi047 bash[22744]: cluster 2024-09-16T10:14:55.601923+0000 mgr.a (mgr.14373) 12014 : cluster [DBG] pgmap v8332: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-16T10:14:56.697 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:14:56.698 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:14:56.698 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:14:57.444 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:14:57.445 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:14:57.445 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:14:57.445 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:14:57.445 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:14:57.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:14:57 smithi157 bash[24585]: audit 2024-09-16T10:14:57.024958+0000 mgr.a (mgr.14373) 12015 : audit [DBG] from='client.262614 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:14:57.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:14:57 smithi086 bash[24289]: audit 2024-09-16T10:14:57.024958+0000 mgr.a (mgr.14373) 12015 : audit [DBG] from='client.262614 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:14:57.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:14:57 smithi047 bash[22744]: audit 2024-09-16T10:14:57.024958+0000 mgr.a (mgr.14373) 12015 : audit [DBG] from='client.262614 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:14:58.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:14:58 smithi157 bash[24585]: cluster 2024-09-16T10:14:57.604618+0000 mgr.a (mgr.14373) 12016 : cluster [DBG] pgmap v8333: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:14:58.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:14:58 smithi086 bash[24289]: cluster 2024-09-16T10:14:57.604618+0000 mgr.a (mgr.14373) 12016 : cluster [DBG] pgmap v8333: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:14:58.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:14:58 smithi047 bash[22744]: cluster 2024-09-16T10:14:57.604618+0000 mgr.a (mgr.14373) 12016 : cluster [DBG] pgmap v8333: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:15:01.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:15:00 smithi157 bash[24585]: cluster 2024-09-16T10:14:59.605426+0000 mgr.a (mgr.14373) 12017 : cluster [DBG] pgmap v8334: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:15:01.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:15:00 smithi086 bash[24289]: cluster 2024-09-16T10:14:59.605426+0000 mgr.a (mgr.14373) 12017 : cluster [DBG] pgmap v8334: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:15:01.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:15:00 smithi047 bash[22744]: cluster 2024-09-16T10:14:59.605426+0000 mgr.a (mgr.14373) 12017 : cluster [DBG] pgmap v8334: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:15:02.446 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:15:02.447 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:15:02.447 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:15:03.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:15:02 smithi157 bash[24585]: cluster 2024-09-16T10:15:01.606992+0000 mgr.a (mgr.14373) 12018 : cluster [DBG] pgmap v8335: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-16T10:15:03.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:15:02 smithi086 bash[24289]: cluster 2024-09-16T10:15:01.606992+0000 mgr.a (mgr.14373) 12018 : cluster [DBG] pgmap v8335: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-16T10:15:03.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:15:02 smithi047 bash[22744]: cluster 2024-09-16T10:15:01.606992+0000 mgr.a (mgr.14373) 12018 : cluster [DBG] pgmap v8335: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-16T10:15:03.218 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:15:03.218 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:15:03.218 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:15:03.218 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:15:03.219 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:15:04.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:15:03 smithi157 bash[24585]: audit 2024-09-16T10:15:02.785030+0000 mgr.a (mgr.14373) 12019 : audit [DBG] from='client.262692 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:15:04.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:15:03 smithi086 bash[24289]: audit 2024-09-16T10:15:02.785030+0000 mgr.a (mgr.14373) 12019 : audit [DBG] from='client.262692 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:15:04.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:15:03 smithi047 bash[22744]: audit 2024-09-16T10:15:02.785030+0000 mgr.a (mgr.14373) 12019 : audit [DBG] from='client.262692 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:15:05.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:15:04 smithi157 bash[24585]: cluster 2024-09-16T10:15:03.608888+0000 mgr.a (mgr.14373) 12020 : cluster [DBG] pgmap v8336: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:15:05.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:15:04 smithi086 bash[24289]: cluster 2024-09-16T10:15:03.608888+0000 mgr.a (mgr.14373) 12020 : cluster [DBG] pgmap v8336: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:15:05.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:15:04 smithi047 bash[22744]: cluster 2024-09-16T10:15:03.608888+0000 mgr.a (mgr.14373) 12020 : cluster [DBG] pgmap v8336: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:15:07.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:15:06 smithi157 bash[24585]: cluster 2024-09-16T10:15:05.609739+0000 mgr.a (mgr.14373) 12021 : cluster [DBG] pgmap v8337: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-16T10:15:07.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:15:06 smithi086 bash[24289]: cluster 2024-09-16T10:15:05.609739+0000 mgr.a (mgr.14373) 12021 : cluster [DBG] pgmap v8337: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-16T10:15:07.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:15:06 smithi047 bash[22744]: cluster 2024-09-16T10:15:05.609739+0000 mgr.a (mgr.14373) 12021 : cluster [DBG] pgmap v8337: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-16T10:15:08.220 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:15:08.220 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:15:08.221 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:15:08.968 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:15:08.969 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:15:08.969 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:15:08.969 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:15:08.969 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:15:09.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:15:08 smithi157 bash[24585]: cluster 2024-09-16T10:15:07.611838+0000 mgr.a (mgr.14373) 12022 : cluster [DBG] pgmap v8338: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:15:09.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:15:08 smithi086 bash[24289]: cluster 2024-09-16T10:15:07.611838+0000 mgr.a (mgr.14373) 12022 : cluster [DBG] pgmap v8338: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:15:09.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:15:08 smithi047 bash[22744]: cluster 2024-09-16T10:15:07.611838+0000 mgr.a (mgr.14373) 12022 : cluster [DBG] pgmap v8338: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:15:10.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:15:09 smithi157 bash[24585]: audit 2024-09-16T10:15:08.546251+0000 mgr.a (mgr.14373) 12023 : audit [DBG] from='client.262770 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:15:10.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:15:09 smithi086 bash[24289]: audit 2024-09-16T10:15:08.546251+0000 mgr.a (mgr.14373) 12023 : audit [DBG] from='client.262770 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:15:10.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:15:09 smithi047 bash[22744]: audit 2024-09-16T10:15:08.546251+0000 mgr.a (mgr.14373) 12023 : audit [DBG] from='client.262770 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:15:11.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:15:10 smithi157 bash[24585]: cluster 2024-09-16T10:15:09.612920+0000 mgr.a (mgr.14373) 12024 : cluster [DBG] pgmap v8339: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:15:11.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:15:10 smithi086 bash[24289]: cluster 2024-09-16T10:15:09.612920+0000 mgr.a (mgr.14373) 12024 : cluster [DBG] pgmap v8339: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:15:11.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:15:10 smithi047 bash[22744]: cluster 2024-09-16T10:15:09.612920+0000 mgr.a (mgr.14373) 12024 : cluster [DBG] pgmap v8339: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:15:13.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:15:12 smithi157 bash[24585]: cluster 2024-09-16T10:15:11.614732+0000 mgr.a (mgr.14373) 12025 : cluster [DBG] pgmap v8340: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:15:13.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:15:12 smithi086 bash[24289]: cluster 2024-09-16T10:15:11.614732+0000 mgr.a (mgr.14373) 12025 : cluster [DBG] pgmap v8340: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:15:13.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:15:12 smithi047 bash[22744]: cluster 2024-09-16T10:15:11.614732+0000 mgr.a (mgr.14373) 12025 : cluster [DBG] pgmap v8340: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:15:13.970 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:15:13.971 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:15:13.971 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:15:14.719 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:15:14.719 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:15:14.719 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:15:14.720 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:15:14.720 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:15:15.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:15:14 smithi157 bash[24585]: cluster 2024-09-16T10:15:13.616122+0000 mgr.a (mgr.14373) 12026 : cluster [DBG] pgmap v8341: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-16T10:15:15.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:15:14 smithi086 bash[24289]: cluster 2024-09-16T10:15:13.616122+0000 mgr.a (mgr.14373) 12026 : cluster [DBG] pgmap v8341: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-16T10:15:15.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:15:14 smithi047 bash[22744]: cluster 2024-09-16T10:15:13.616122+0000 mgr.a (mgr.14373) 12026 : cluster [DBG] pgmap v8341: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-16T10:15:16.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:15:15 smithi157 bash[24585]: audit 2024-09-16T10:15:14.299774+0000 mgr.a (mgr.14373) 12027 : audit [DBG] from='client.262848 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:15:16.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:15:15 smithi086 bash[24289]: audit 2024-09-16T10:15:14.299774+0000 mgr.a (mgr.14373) 12027 : audit [DBG] from='client.262848 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:15:16.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:15:15 smithi047 bash[22744]: audit 2024-09-16T10:15:14.299774+0000 mgr.a (mgr.14373) 12027 : audit [DBG] from='client.262848 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:15:17.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:15:16 smithi157 bash[24585]: cluster 2024-09-16T10:15:15.617117+0000 mgr.a (mgr.14373) 12028 : cluster [DBG] pgmap v8342: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:15:17.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:15:16 smithi086 bash[24289]: cluster 2024-09-16T10:15:15.617117+0000 mgr.a (mgr.14373) 12028 : cluster [DBG] pgmap v8342: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:15:17.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:15:16 smithi047 bash[22744]: cluster 2024-09-16T10:15:15.617117+0000 mgr.a (mgr.14373) 12028 : cluster [DBG] pgmap v8342: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:15:19.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:15:18 smithi157 bash[24585]: cluster 2024-09-16T10:15:17.619507+0000 mgr.a (mgr.14373) 12029 : cluster [DBG] pgmap v8343: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:15:19.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:15:18 smithi086 bash[24289]: cluster 2024-09-16T10:15:17.619507+0000 mgr.a (mgr.14373) 12029 : cluster [DBG] pgmap v8343: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:15:19.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:15:18 smithi047 bash[22744]: cluster 2024-09-16T10:15:17.619507+0000 mgr.a (mgr.14373) 12029 : cluster [DBG] pgmap v8343: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:15:19.721 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:15:19.721 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:15:19.721 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:15:20.498 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:15:20.499 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:15:20.499 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:15:20.499 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:15:20.499 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:15:21.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:15:20 smithi157 bash[24585]: cluster 2024-09-16T10:15:19.620302+0000 mgr.a (mgr.14373) 12030 : cluster [DBG] pgmap v8344: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:15:21.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:15:20 smithi157 bash[24585]: audit 2024-09-16T10:15:20.059000+0000 mgr.a (mgr.14373) 12031 : audit [DBG] from='client.262923 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:15:21.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:15:20 smithi086 bash[24289]: cluster 2024-09-16T10:15:19.620302+0000 mgr.a (mgr.14373) 12030 : cluster [DBG] pgmap v8344: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:15:21.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:15:20 smithi086 bash[24289]: audit 2024-09-16T10:15:20.059000+0000 mgr.a (mgr.14373) 12031 : audit [DBG] from='client.262923 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:15:21.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:15:20 smithi047 bash[22744]: cluster 2024-09-16T10:15:19.620302+0000 mgr.a (mgr.14373) 12030 : cluster [DBG] pgmap v8344: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:15:21.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:15:20 smithi047 bash[22744]: audit 2024-09-16T10:15:20.059000+0000 mgr.a (mgr.14373) 12031 : audit [DBG] from='client.262923 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:15:23.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:15:22 smithi157 bash[24585]: cluster 2024-09-16T10:15:21.622172+0000 mgr.a (mgr.14373) 12032 : cluster [DBG] pgmap v8345: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:15:23.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:15:22 smithi086 bash[24289]: cluster 2024-09-16T10:15:21.622172+0000 mgr.a (mgr.14373) 12032 : cluster [DBG] pgmap v8345: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:15:23.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:15:22 smithi047 bash[22744]: cluster 2024-09-16T10:15:21.622172+0000 mgr.a (mgr.14373) 12032 : cluster [DBG] pgmap v8345: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:15:25.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:15:24 smithi157 bash[24585]: cluster 2024-09-16T10:15:23.623457+0000 mgr.a (mgr.14373) 12033 : cluster [DBG] pgmap v8346: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-16T10:15:25.104 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:15:24 smithi047 bash[22744]: cluster 2024-09-16T10:15:23.623457+0000 mgr.a (mgr.14373) 12033 : cluster [DBG] pgmap v8346: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-16T10:15:25.104 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:15:24 smithi086 bash[24289]: cluster 2024-09-16T10:15:23.623457+0000 mgr.a (mgr.14373) 12033 : cluster [DBG] pgmap v8346: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-16T10:15:25.500 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:15:25.501 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:15:25.501 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:15:26.258 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:15:26.259 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:15:26.259 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:15:26.259 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:15:26.259 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:15:27.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:15:26 smithi157 bash[24585]: cluster 2024-09-16T10:15:25.623928+0000 mgr.a (mgr.14373) 12034 : cluster [DBG] pgmap v8347: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:15:27.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:15:26 smithi157 bash[24585]: audit 2024-09-16T10:15:25.828221+0000 mgr.a (mgr.14373) 12035 : audit [DBG] from='client.263001 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:15:27.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:15:26 smithi086 bash[24289]: cluster 2024-09-16T10:15:25.623928+0000 mgr.a (mgr.14373) 12034 : cluster [DBG] pgmap v8347: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:15:27.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:15:26 smithi086 bash[24289]: audit 2024-09-16T10:15:25.828221+0000 mgr.a (mgr.14373) 12035 : audit [DBG] from='client.263001 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:15:27.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:15:26 smithi047 bash[22744]: cluster 2024-09-16T10:15:25.623928+0000 mgr.a (mgr.14373) 12034 : cluster [DBG] pgmap v8347: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:15:27.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:15:26 smithi047 bash[22744]: audit 2024-09-16T10:15:25.828221+0000 mgr.a (mgr.14373) 12035 : audit [DBG] from='client.263001 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:15:29.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:15:28 smithi157 bash[24585]: cluster 2024-09-16T10:15:27.626288+0000 mgr.a (mgr.14373) 12036 : cluster [DBG] pgmap v8348: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:15:29.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:15:28 smithi086 bash[24289]: cluster 2024-09-16T10:15:27.626288+0000 mgr.a (mgr.14373) 12036 : cluster [DBG] pgmap v8348: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:15:29.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:15:28 smithi047 bash[22744]: cluster 2024-09-16T10:15:27.626288+0000 mgr.a (mgr.14373) 12036 : cluster [DBG] pgmap v8348: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:15:31.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:15:30 smithi157 bash[24585]: cluster 2024-09-16T10:15:29.627117+0000 mgr.a (mgr.14373) 12037 : cluster [DBG] pgmap v8349: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:15:31.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:15:30 smithi086 bash[24289]: cluster 2024-09-16T10:15:29.627117+0000 mgr.a (mgr.14373) 12037 : cluster [DBG] pgmap v8349: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:15:31.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:15:30 smithi047 bash[22744]: cluster 2024-09-16T10:15:29.627117+0000 mgr.a (mgr.14373) 12037 : cluster [DBG] pgmap v8349: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:15:31.261 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:15:31.261 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:15:31.261 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:15:32.029 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:15:32.029 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:15:32.029 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:15:32.029 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:15:32.029 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:15:33.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:15:32 smithi157 bash[24585]: audit 2024-09-16T10:15:31.596418+0000 mgr.a (mgr.14373) 12038 : audit [DBG] from='client.263079 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:15:33.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:15:32 smithi157 bash[24585]: cluster 2024-09-16T10:15:31.629637+0000 mgr.a (mgr.14373) 12039 : cluster [DBG] pgmap v8350: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:15:33.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:15:32 smithi157 bash[24585]: audit 2024-09-16T10:15:32.240595+0000 mon.b (mon.2) 1106 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T10:15:33.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:15:32 smithi086 bash[24289]: audit 2024-09-16T10:15:31.596418+0000 mgr.a (mgr.14373) 12038 : audit [DBG] from='client.263079 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:15:33.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:15:32 smithi086 bash[24289]: cluster 2024-09-16T10:15:31.629637+0000 mgr.a (mgr.14373) 12039 : cluster [DBG] pgmap v8350: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:15:33.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:15:32 smithi086 bash[24289]: audit 2024-09-16T10:15:32.240595+0000 mon.b (mon.2) 1106 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T10:15:33.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:15:32 smithi047 bash[22744]: audit 2024-09-16T10:15:31.596418+0000 mgr.a (mgr.14373) 12038 : audit [DBG] from='client.263079 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:15:33.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:15:32 smithi047 bash[22744]: cluster 2024-09-16T10:15:31.629637+0000 mgr.a (mgr.14373) 12039 : cluster [DBG] pgmap v8350: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:15:33.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:15:32 smithi047 bash[22744]: audit 2024-09-16T10:15:32.240595+0000 mon.b (mon.2) 1106 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T10:15:34.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:15:33 smithi157 bash[24585]: audit 2024-09-16T10:15:33.095452+0000 mon.b (mon.2) 1107 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T10:15:34.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:15:33 smithi157 bash[24585]: audit 2024-09-16T10:15:33.097714+0000 mon.b (mon.2) 1108 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T10:15:34.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:15:33 smithi157 bash[24585]: audit 2024-09-16T10:15:33.110130+0000 mon.a (mon.0) 1290 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:15:34.058 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:15:33 smithi157 bash[24585]: audit 2024-09-16T10:15:33.117254+0000 mon.b (mon.2) 1109 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:15:34.058 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:15:33 smithi157 bash[24585]: audit 2024-09-16T10:15:33.120276+0000 mgr.a (mgr.14373) 12040 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:15:34.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:15:33 smithi086 bash[24289]: audit 2024-09-16T10:15:33.095452+0000 mon.b (mon.2) 1107 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T10:15:34.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:15:33 smithi086 bash[24289]: audit 2024-09-16T10:15:33.097714+0000 mon.b (mon.2) 1108 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T10:15:34.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:15:33 smithi086 bash[24289]: audit 2024-09-16T10:15:33.110130+0000 mon.a (mon.0) 1290 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:15:34.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:15:33 smithi086 bash[24289]: audit 2024-09-16T10:15:33.117254+0000 mon.b (mon.2) 1109 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:15:34.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:15:33 smithi086 bash[24289]: audit 2024-09-16T10:15:33.120276+0000 mgr.a (mgr.14373) 12040 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:15:34.092 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 10:15:33 smithi047 bash[22994]: debug 2024-09-16T10:15:33.854+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T10:15:34.093 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 10:15:33 smithi047 bash[22994]: debug 2024-09-16T10:15:33.854+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T10:15:34.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:15:33 smithi047 bash[22744]: audit 2024-09-16T10:15:33.095452+0000 mon.b (mon.2) 1107 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T10:15:34.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:15:33 smithi047 bash[22744]: audit 2024-09-16T10:15:33.097714+0000 mon.b (mon.2) 1108 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T10:15:34.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:15:33 smithi047 bash[22744]: audit 2024-09-16T10:15:33.110130+0000 mon.a (mon.0) 1290 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:15:34.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:15:33 smithi047 bash[22744]: audit 2024-09-16T10:15:33.117254+0000 mon.b (mon.2) 1109 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:15:34.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:15:33 smithi047 bash[22744]: audit 2024-09-16T10:15:33.120276+0000 mgr.a (mgr.14373) 12040 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:15:35.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:15:35 smithi157 bash[24585]: cluster 2024-09-16T10:15:33.630499+0000 mgr.a (mgr.14373) 12041 : cluster [DBG] pgmap v8351: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-16T10:15:35.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:15:35 smithi157 bash[24585]: audit 2024-09-16T10:15:33.855694+0000 mgr.a (mgr.14373) 12042 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T10:15:35.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:15:35 smithi157 bash[24585]: cephadm 2024-09-16T10:15:33.857827+0000 mgr.a (mgr.14373) 12043 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T10:15:35.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:15:35 smithi086 bash[24289]: cluster 2024-09-16T10:15:33.630499+0000 mgr.a (mgr.14373) 12041 : cluster [DBG] pgmap v8351: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-16T10:15:35.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:15:35 smithi086 bash[24289]: audit 2024-09-16T10:15:33.855694+0000 mgr.a (mgr.14373) 12042 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T10:15:35.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:15:35 smithi086 bash[24289]: cephadm 2024-09-16T10:15:33.857827+0000 mgr.a (mgr.14373) 12043 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T10:15:35.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:15:35 smithi047 bash[22744]: cluster 2024-09-16T10:15:33.630499+0000 mgr.a (mgr.14373) 12041 : cluster [DBG] pgmap v8351: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-16T10:15:35.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:15:35 smithi047 bash[22744]: audit 2024-09-16T10:15:33.855694+0000 mgr.a (mgr.14373) 12042 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T10:15:35.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:15:35 smithi047 bash[22744]: cephadm 2024-09-16T10:15:33.857827+0000 mgr.a (mgr.14373) 12043 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T10:15:37.030 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:15:37.031 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:15:37.031 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:15:37.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:15:37 smithi157 bash[24585]: cluster 2024-09-16T10:15:35.631317+0000 mgr.a (mgr.14373) 12044 : cluster [DBG] pgmap v8352: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T10:15:37.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:15:37 smithi086 bash[24289]: cluster 2024-09-16T10:15:35.631317+0000 mgr.a (mgr.14373) 12044 : cluster [DBG] pgmap v8352: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T10:15:37.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:15:37 smithi047 bash[22744]: cluster 2024-09-16T10:15:35.631317+0000 mgr.a (mgr.14373) 12044 : cluster [DBG] pgmap v8352: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T10:15:37.799 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:15:37.799 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:15:37.799 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:15:37.799 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:15:37.800 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:15:39.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:15:39 smithi157 bash[24585]: audit 2024-09-16T10:15:37.366905+0000 mgr.a (mgr.14373) 12045 : audit [DBG] from='client.263265 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:15:39.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:15:39 smithi157 bash[24585]: cluster 2024-09-16T10:15:37.632653+0000 mgr.a (mgr.14373) 12046 : cluster [DBG] pgmap v8353: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:15:39.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:15:39 smithi086 bash[24289]: audit 2024-09-16T10:15:37.366905+0000 mgr.a (mgr.14373) 12045 : audit [DBG] from='client.263265 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:15:39.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:15:39 smithi086 bash[24289]: cluster 2024-09-16T10:15:37.632653+0000 mgr.a (mgr.14373) 12046 : cluster [DBG] pgmap v8353: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:15:39.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:15:39 smithi047 bash[22744]: audit 2024-09-16T10:15:37.366905+0000 mgr.a (mgr.14373) 12045 : audit [DBG] from='client.263265 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:15:39.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:15:39 smithi047 bash[22744]: cluster 2024-09-16T10:15:37.632653+0000 mgr.a (mgr.14373) 12046 : cluster [DBG] pgmap v8353: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:15:41.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:15:41 smithi157 bash[24585]: cluster 2024-09-16T10:15:39.633556+0000 mgr.a (mgr.14373) 12047 : cluster [DBG] pgmap v8354: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T10:15:41.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:15:41 smithi086 bash[24289]: cluster 2024-09-16T10:15:39.633556+0000 mgr.a (mgr.14373) 12047 : cluster [DBG] pgmap v8354: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T10:15:41.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:15:41 smithi047 bash[22744]: cluster 2024-09-16T10:15:39.633556+0000 mgr.a (mgr.14373) 12047 : cluster [DBG] pgmap v8354: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T10:15:42.801 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:15:42.801 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:15:42.802 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:15:43.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:15:43 smithi157 bash[24585]: cluster 2024-09-16T10:15:41.635387+0000 mgr.a (mgr.14373) 12048 : cluster [DBG] pgmap v8355: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 6.9 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T10:15:43.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:15:43 smithi086 bash[24289]: cluster 2024-09-16T10:15:41.635387+0000 mgr.a (mgr.14373) 12048 : cluster [DBG] pgmap v8355: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 6.9 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T10:15:43.575 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:15:43.576 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:15:43.576 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:15:43.576 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:15:43.576 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:15:43.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:15:43 smithi047 bash[22744]: cluster 2024-09-16T10:15:41.635387+0000 mgr.a (mgr.14373) 12048 : cluster [DBG] pgmap v8355: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 6.9 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T10:15:44.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:15:44 smithi157 bash[24585]: audit 2024-09-16T10:15:43.132036+0000 mgr.a (mgr.14373) 12049 : audit [DBG] from='client.263343 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:15:44.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:15:44 smithi086 bash[24289]: audit 2024-09-16T10:15:43.132036+0000 mgr.a (mgr.14373) 12049 : audit [DBG] from='client.263343 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:15:44.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:15:44 smithi047 bash[22744]: audit 2024-09-16T10:15:43.132036+0000 mgr.a (mgr.14373) 12049 : audit [DBG] from='client.263343 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:15:45.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:15:45 smithi157 bash[24585]: cluster 2024-09-16T10:15:43.636470+0000 mgr.a (mgr.14373) 12050 : cluster [DBG] pgmap v8356: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:15:45.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:15:45 smithi086 bash[24289]: cluster 2024-09-16T10:15:43.636470+0000 mgr.a (mgr.14373) 12050 : cluster [DBG] pgmap v8356: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:15:45.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:15:45 smithi047 bash[22744]: cluster 2024-09-16T10:15:43.636470+0000 mgr.a (mgr.14373) 12050 : cluster [DBG] pgmap v8356: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:15:47.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:15:47 smithi157 bash[24585]: cluster 2024-09-16T10:15:45.637246+0000 mgr.a (mgr.14373) 12051 : cluster [DBG] pgmap v8357: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:15:47.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:15:47 smithi086 bash[24289]: cluster 2024-09-16T10:15:45.637246+0000 mgr.a (mgr.14373) 12051 : cluster [DBG] pgmap v8357: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:15:47.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:15:47 smithi047 bash[22744]: cluster 2024-09-16T10:15:45.637246+0000 mgr.a (mgr.14373) 12051 : cluster [DBG] pgmap v8357: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:15:48.577 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:15:48.578 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:15:48.578 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:15:49.341 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:15:49.341 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:15:49.342 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:15:49.342 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:15:49.342 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:15:49.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:15:49 smithi157 bash[24585]: cluster 2024-09-16T10:15:47.639370+0000 mgr.a (mgr.14373) 12052 : cluster [DBG] pgmap v8358: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:15:49.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:15:49 smithi086 bash[24289]: cluster 2024-09-16T10:15:47.639370+0000 mgr.a (mgr.14373) 12052 : cluster [DBG] pgmap v8358: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:15:49.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:15:49 smithi047 bash[22744]: cluster 2024-09-16T10:15:47.639370+0000 mgr.a (mgr.14373) 12052 : cluster [DBG] pgmap v8358: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:15:50.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:15:50 smithi157 bash[24585]: audit 2024-09-16T10:15:48.904418+0000 mgr.a (mgr.14373) 12053 : audit [DBG] from='client.263418 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:15:50.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:15:50 smithi086 bash[24289]: audit 2024-09-16T10:15:48.904418+0000 mgr.a (mgr.14373) 12053 : audit [DBG] from='client.263418 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:15:50.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:15:50 smithi047 bash[22744]: audit 2024-09-16T10:15:48.904418+0000 mgr.a (mgr.14373) 12053 : audit [DBG] from='client.263418 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:15:51.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:15:51 smithi157 bash[24585]: cluster 2024-09-16T10:15:49.640292+0000 mgr.a (mgr.14373) 12054 : cluster [DBG] pgmap v8359: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:15:51.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:15:51 smithi086 bash[24289]: cluster 2024-09-16T10:15:49.640292+0000 mgr.a (mgr.14373) 12054 : cluster [DBG] pgmap v8359: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:15:51.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:15:51 smithi047 bash[22744]: cluster 2024-09-16T10:15:49.640292+0000 mgr.a (mgr.14373) 12054 : cluster [DBG] pgmap v8359: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:15:53.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:15:53 smithi157 bash[24585]: cluster 2024-09-16T10:15:51.642061+0000 mgr.a (mgr.14373) 12055 : cluster [DBG] pgmap v8360: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:15:53.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:15:53 smithi086 bash[24289]: cluster 2024-09-16T10:15:51.642061+0000 mgr.a (mgr.14373) 12055 : cluster [DBG] pgmap v8360: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:15:53.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:15:53 smithi047 bash[22744]: cluster 2024-09-16T10:15:51.642061+0000 mgr.a (mgr.14373) 12055 : cluster [DBG] pgmap v8360: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:15:54.343 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:15:54.344 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:15:54.344 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:15:55.102 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:15:55.103 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:15:55.103 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:15:55.103 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:15:55.103 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:15:55.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:15:55 smithi157 bash[24585]: cluster 2024-09-16T10:15:53.643315+0000 mgr.a (mgr.14373) 12056 : cluster [DBG] pgmap v8361: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-16T10:15:55.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:15:55 smithi086 bash[24289]: cluster 2024-09-16T10:15:53.643315+0000 mgr.a (mgr.14373) 12056 : cluster [DBG] pgmap v8361: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-16T10:15:55.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:15:55 smithi047 bash[22744]: cluster 2024-09-16T10:15:53.643315+0000 mgr.a (mgr.14373) 12056 : cluster [DBG] pgmap v8361: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-16T10:15:56.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:15:56 smithi157 bash[24585]: audit 2024-09-16T10:15:54.678616+0000 mgr.a (mgr.14373) 12057 : audit [DBG] from='client.263496 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:15:56.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:15:56 smithi086 bash[24289]: audit 2024-09-16T10:15:54.678616+0000 mgr.a (mgr.14373) 12057 : audit [DBG] from='client.263496 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:15:56.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:15:56 smithi047 bash[22744]: audit 2024-09-16T10:15:54.678616+0000 mgr.a (mgr.14373) 12057 : audit [DBG] from='client.263496 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:15:57.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:15:57 smithi157 bash[24585]: cluster 2024-09-16T10:15:55.644250+0000 mgr.a (mgr.14373) 12058 : cluster [DBG] pgmap v8362: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:15:57.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:15:57 smithi086 bash[24289]: cluster 2024-09-16T10:15:55.644250+0000 mgr.a (mgr.14373) 12058 : cluster [DBG] pgmap v8362: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:15:57.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:15:57 smithi047 bash[22744]: cluster 2024-09-16T10:15:55.644250+0000 mgr.a (mgr.14373) 12058 : cluster [DBG] pgmap v8362: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:15:59.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:15:59 smithi157 bash[24585]: cluster 2024-09-16T10:15:57.646539+0000 mgr.a (mgr.14373) 12059 : cluster [DBG] pgmap v8363: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:15:59.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:15:59 smithi086 bash[24289]: cluster 2024-09-16T10:15:57.646539+0000 mgr.a (mgr.14373) 12059 : cluster [DBG] pgmap v8363: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:15:59.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:15:59 smithi047 bash[22744]: cluster 2024-09-16T10:15:57.646539+0000 mgr.a (mgr.14373) 12059 : cluster [DBG] pgmap v8363: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:16:00.104 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:16:00.105 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:16:00.105 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:16:00.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:16:00 smithi157 bash[24585]: cluster 2024-09-16T10:15:59.647318+0000 mgr.a (mgr.14373) 12060 : cluster [DBG] pgmap v8364: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:16:00.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:16:00 smithi086 bash[24289]: cluster 2024-09-16T10:15:59.647318+0000 mgr.a (mgr.14373) 12060 : cluster [DBG] pgmap v8364: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:16:00.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:16:00 smithi047 bash[22744]: cluster 2024-09-16T10:15:59.647318+0000 mgr.a (mgr.14373) 12060 : cluster [DBG] pgmap v8364: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:16:00.862 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:16:00.862 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:16:00.862 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:16:00.863 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:16:00.863 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:16:01.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:16:01 smithi157 bash[24585]: audit 2024-09-16T10:16:00.437672+0000 mgr.a (mgr.14373) 12061 : audit [DBG] from='client.263574 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:16:01.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:16:01 smithi086 bash[24289]: audit 2024-09-16T10:16:00.437672+0000 mgr.a (mgr.14373) 12061 : audit [DBG] from='client.263574 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:16:01.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:16:01 smithi047 bash[22744]: audit 2024-09-16T10:16:00.437672+0000 mgr.a (mgr.14373) 12061 : audit [DBG] from='client.263574 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:16:02.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:16:02 smithi157 bash[24585]: cluster 2024-09-16T10:16:01.649322+0000 mgr.a (mgr.14373) 12062 : cluster [DBG] pgmap v8365: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:16:02.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:16:02 smithi086 bash[24289]: cluster 2024-09-16T10:16:01.649322+0000 mgr.a (mgr.14373) 12062 : cluster [DBG] pgmap v8365: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:16:02.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:16:02 smithi047 bash[22744]: cluster 2024-09-16T10:16:01.649322+0000 mgr.a (mgr.14373) 12062 : cluster [DBG] pgmap v8365: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:16:05.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:16:04 smithi157 bash[24585]: cluster 2024-09-16T10:16:03.650781+0000 mgr.a (mgr.14373) 12063 : cluster [DBG] pgmap v8366: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-16T10:16:05.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:16:04 smithi086 bash[24289]: cluster 2024-09-16T10:16:03.650781+0000 mgr.a (mgr.14373) 12063 : cluster [DBG] pgmap v8366: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-16T10:16:05.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:16:04 smithi047 bash[22744]: cluster 2024-09-16T10:16:03.650781+0000 mgr.a (mgr.14373) 12063 : cluster [DBG] pgmap v8366: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-16T10:16:05.864 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:16:05.864 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:16:05.865 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:16:06.622 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:16:06.622 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:16:06.622 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:16:06.622 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:16:06.622 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:16:07.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:16:06 smithi157 bash[24585]: cluster 2024-09-16T10:16:05.651734+0000 mgr.a (mgr.14373) 12064 : cluster [DBG] pgmap v8367: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:16:07.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:16:06 smithi086 bash[24289]: cluster 2024-09-16T10:16:05.651734+0000 mgr.a (mgr.14373) 12064 : cluster [DBG] pgmap v8367: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:16:07.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:16:06 smithi047 bash[22744]: cluster 2024-09-16T10:16:05.651734+0000 mgr.a (mgr.14373) 12064 : cluster [DBG] pgmap v8367: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:16:08.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:16:07 smithi157 bash[24585]: audit 2024-09-16T10:16:06.193067+0000 mgr.a (mgr.14373) 12065 : audit [DBG] from='client.263646 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:16:08.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:16:07 smithi086 bash[24289]: audit 2024-09-16T10:16:06.193067+0000 mgr.a (mgr.14373) 12065 : audit [DBG] from='client.263646 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:16:08.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:16:07 smithi047 bash[22744]: audit 2024-09-16T10:16:06.193067+0000 mgr.a (mgr.14373) 12065 : audit [DBG] from='client.263646 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:16:09.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:16:08 smithi157 bash[24585]: cluster 2024-09-16T10:16:07.654136+0000 mgr.a (mgr.14373) 12066 : cluster [DBG] pgmap v8368: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-16T10:16:09.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:16:08 smithi086 bash[24289]: cluster 2024-09-16T10:16:07.654136+0000 mgr.a (mgr.14373) 12066 : cluster [DBG] pgmap v8368: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-16T10:16:09.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:16:08 smithi047 bash[22744]: cluster 2024-09-16T10:16:07.654136+0000 mgr.a (mgr.14373) 12066 : cluster [DBG] pgmap v8368: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-16T10:16:11.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:16:10 smithi157 bash[24585]: cluster 2024-09-16T10:16:09.654921+0000 mgr.a (mgr.14373) 12067 : cluster [DBG] pgmap v8369: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T10:16:11.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:16:10 smithi086 bash[24289]: cluster 2024-09-16T10:16:09.654921+0000 mgr.a (mgr.14373) 12067 : cluster [DBG] pgmap v8369: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T10:16:11.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:16:10 smithi047 bash[22744]: cluster 2024-09-16T10:16:09.654921+0000 mgr.a (mgr.14373) 12067 : cluster [DBG] pgmap v8369: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T10:16:11.623 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:16:11.624 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:16:11.624 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:16:12.413 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:16:12.413 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:16:12.413 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:16:12.413 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:16:12.414 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:16:13.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:16:12 smithi157 bash[24585]: cluster 2024-09-16T10:16:11.656523+0000 mgr.a (mgr.14373) 12068 : cluster [DBG] pgmap v8370: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:16:13.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:16:12 smithi157 bash[24585]: audit 2024-09-16T10:16:11.957741+0000 mgr.a (mgr.14373) 12069 : audit [DBG] from='client.263724 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:16:13.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:16:12 smithi086 bash[24289]: cluster 2024-09-16T10:16:11.656523+0000 mgr.a (mgr.14373) 12068 : cluster [DBG] pgmap v8370: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:16:13.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:16:12 smithi086 bash[24289]: audit 2024-09-16T10:16:11.957741+0000 mgr.a (mgr.14373) 12069 : audit [DBG] from='client.263724 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:16:13.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:16:12 smithi047 bash[22744]: cluster 2024-09-16T10:16:11.656523+0000 mgr.a (mgr.14373) 12068 : cluster [DBG] pgmap v8370: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:16:13.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:16:12 smithi047 bash[22744]: audit 2024-09-16T10:16:11.957741+0000 mgr.a (mgr.14373) 12069 : audit [DBG] from='client.263724 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:16:15.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:16:14 smithi157 bash[24585]: cluster 2024-09-16T10:16:13.658390+0000 mgr.a (mgr.14373) 12070 : cluster [DBG] pgmap v8371: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-16T10:16:15.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:16:14 smithi086 bash[24289]: cluster 2024-09-16T10:16:13.658390+0000 mgr.a (mgr.14373) 12070 : cluster [DBG] pgmap v8371: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-16T10:16:15.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:16:14 smithi047 bash[22744]: cluster 2024-09-16T10:16:13.658390+0000 mgr.a (mgr.14373) 12070 : cluster [DBG] pgmap v8371: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-16T10:16:17.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:16:16 smithi157 bash[24585]: cluster 2024-09-16T10:16:15.659176+0000 mgr.a (mgr.14373) 12071 : cluster [DBG] pgmap v8372: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:16:17.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:16:16 smithi086 bash[24289]: cluster 2024-09-16T10:16:15.659176+0000 mgr.a (mgr.14373) 12071 : cluster [DBG] pgmap v8372: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:16:17.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:16:16 smithi047 bash[22744]: cluster 2024-09-16T10:16:15.659176+0000 mgr.a (mgr.14373) 12071 : cluster [DBG] pgmap v8372: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:16:17.415 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:16:17.415 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:16:17.416 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:16:18.193 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:16:18.193 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:16:18.193 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:16:18.194 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:16:18.194 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:16:19.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:16:18 smithi157 bash[24585]: cluster 2024-09-16T10:16:17.661204+0000 mgr.a (mgr.14373) 12072 : cluster [DBG] pgmap v8373: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:16:19.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:16:18 smithi157 bash[24585]: audit 2024-09-16T10:16:17.751728+0000 mgr.a (mgr.14373) 12073 : audit [DBG] from='client.263802 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:16:19.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:16:18 smithi086 bash[24289]: cluster 2024-09-16T10:16:17.661204+0000 mgr.a (mgr.14373) 12072 : cluster [DBG] pgmap v8373: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:16:19.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:16:18 smithi086 bash[24289]: audit 2024-09-16T10:16:17.751728+0000 mgr.a (mgr.14373) 12073 : audit [DBG] from='client.263802 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:16:19.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:16:18 smithi047 bash[22744]: cluster 2024-09-16T10:16:17.661204+0000 mgr.a (mgr.14373) 12072 : cluster [DBG] pgmap v8373: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:16:19.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:16:18 smithi047 bash[22744]: audit 2024-09-16T10:16:17.751728+0000 mgr.a (mgr.14373) 12073 : audit [DBG] from='client.263802 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:16:21.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:16:20 smithi157 bash[24585]: cluster 2024-09-16T10:16:19.662107+0000 mgr.a (mgr.14373) 12074 : cluster [DBG] pgmap v8374: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-16T10:16:21.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:16:20 smithi086 bash[24289]: cluster 2024-09-16T10:16:19.662107+0000 mgr.a (mgr.14373) 12074 : cluster [DBG] pgmap v8374: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-16T10:16:21.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:16:20 smithi047 bash[22744]: cluster 2024-09-16T10:16:19.662107+0000 mgr.a (mgr.14373) 12074 : cluster [DBG] pgmap v8374: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-16T10:16:23.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:16:22 smithi157 bash[24585]: cluster 2024-09-16T10:16:21.663847+0000 mgr.a (mgr.14373) 12075 : cluster [DBG] pgmap v8375: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.4 KiB/s rd, 2 op/s 2024-09-16T10:16:23.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:16:22 smithi086 bash[24289]: cluster 2024-09-16T10:16:21.663847+0000 mgr.a (mgr.14373) 12075 : cluster [DBG] pgmap v8375: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.4 KiB/s rd, 2 op/s 2024-09-16T10:16:23.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:16:22 smithi047 bash[22744]: cluster 2024-09-16T10:16:21.663847+0000 mgr.a (mgr.14373) 12075 : cluster [DBG] pgmap v8375: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.4 KiB/s rd, 2 op/s 2024-09-16T10:16:23.195 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:16:23.195 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:16:23.195 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:16:23.978 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:16:23.979 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:16:23.979 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:16:23.979 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:16:23.979 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:16:25.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:16:24 smithi157 bash[24585]: audit 2024-09-16T10:16:23.533075+0000 mgr.a (mgr.14373) 12076 : audit [DBG] from='client.263874 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:16:25.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:16:24 smithi157 bash[24585]: cluster 2024-09-16T10:16:23.664994+0000 mgr.a (mgr.14373) 12077 : cluster [DBG] pgmap v8376: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:16:25.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:16:24 smithi086 bash[24289]: audit 2024-09-16T10:16:23.533075+0000 mgr.a (mgr.14373) 12076 : audit [DBG] from='client.263874 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:16:25.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:16:24 smithi086 bash[24289]: cluster 2024-09-16T10:16:23.664994+0000 mgr.a (mgr.14373) 12077 : cluster [DBG] pgmap v8376: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:16:25.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:16:24 smithi047 bash[22744]: audit 2024-09-16T10:16:23.533075+0000 mgr.a (mgr.14373) 12076 : audit [DBG] from='client.263874 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:16:25.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:16:24 smithi047 bash[22744]: cluster 2024-09-16T10:16:23.664994+0000 mgr.a (mgr.14373) 12077 : cluster [DBG] pgmap v8376: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:16:27.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:16:26 smithi157 bash[24585]: cluster 2024-09-16T10:16:25.665866+0000 mgr.a (mgr.14373) 12078 : cluster [DBG] pgmap v8377: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:16:27.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:16:26 smithi086 bash[24289]: cluster 2024-09-16T10:16:25.665866+0000 mgr.a (mgr.14373) 12078 : cluster [DBG] pgmap v8377: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:16:27.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:16:26 smithi047 bash[22744]: cluster 2024-09-16T10:16:25.665866+0000 mgr.a (mgr.14373) 12078 : cluster [DBG] pgmap v8377: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:16:28.979 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:16:28.980 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:16:28.980 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:16:29.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:16:28 smithi157 bash[24585]: cluster 2024-09-16T10:16:27.668118+0000 mgr.a (mgr.14373) 12079 : cluster [DBG] pgmap v8378: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:16:29.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:16:28 smithi086 bash[24289]: cluster 2024-09-16T10:16:27.668118+0000 mgr.a (mgr.14373) 12079 : cluster [DBG] pgmap v8378: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:16:29.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:16:28 smithi047 bash[22744]: cluster 2024-09-16T10:16:27.668118+0000 mgr.a (mgr.14373) 12079 : cluster [DBG] pgmap v8378: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:16:29.729 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:16:29.729 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:16:29.729 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:16:29.729 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:16:29.730 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:16:31.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:16:30 smithi157 bash[24585]: audit 2024-09-16T10:16:29.308080+0000 mgr.a (mgr.14373) 12080 : audit [DBG] from='client.263949 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:16:31.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:16:30 smithi157 bash[24585]: cluster 2024-09-16T10:16:29.668730+0000 mgr.a (mgr.14373) 12081 : cluster [DBG] pgmap v8379: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:16:31.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:16:30 smithi086 bash[24289]: audit 2024-09-16T10:16:29.308080+0000 mgr.a (mgr.14373) 12080 : audit [DBG] from='client.263949 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:16:31.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:16:30 smithi086 bash[24289]: cluster 2024-09-16T10:16:29.668730+0000 mgr.a (mgr.14373) 12081 : cluster [DBG] pgmap v8379: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:16:31.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:16:30 smithi047 bash[22744]: audit 2024-09-16T10:16:29.308080+0000 mgr.a (mgr.14373) 12080 : audit [DBG] from='client.263949 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:16:31.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:16:30 smithi047 bash[22744]: cluster 2024-09-16T10:16:29.668730+0000 mgr.a (mgr.14373) 12081 : cluster [DBG] pgmap v8379: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:16:33.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:16:32 smithi157 bash[24585]: cluster 2024-09-16T10:16:31.670475+0000 mgr.a (mgr.14373) 12082 : cluster [DBG] pgmap v8380: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:16:33.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:16:32 smithi086 bash[24289]: cluster 2024-09-16T10:16:31.670475+0000 mgr.a (mgr.14373) 12082 : cluster [DBG] pgmap v8380: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:16:33.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:16:32 smithi047 bash[22744]: cluster 2024-09-16T10:16:31.670475+0000 mgr.a (mgr.14373) 12082 : cluster [DBG] pgmap v8380: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:16:34.731 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:16:34.731 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:16:34.732 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:16:35.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:16:34 smithi157 bash[24585]: cluster 2024-09-16T10:16:33.671713+0000 mgr.a (mgr.14373) 12083 : cluster [DBG] pgmap v8381: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-16T10:16:35.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:16:34 smithi157 bash[24585]: audit 2024-09-16T10:16:33.908822+0000 mon.b (mon.2) 1110 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T10:16:35.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:16:34 smithi157 bash[24585]: audit 2024-09-16T10:16:34.536713+0000 mon.a (mon.0) 1291 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:16:35.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:16:34 smithi157 bash[24585]: audit 2024-09-16T10:16:34.540998+0000 mon.a (mon.0) 1292 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:16:35.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:16:34 smithi086 bash[24289]: cluster 2024-09-16T10:16:33.671713+0000 mgr.a (mgr.14373) 12083 : cluster [DBG] pgmap v8381: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-16T10:16:35.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:16:34 smithi086 bash[24289]: audit 2024-09-16T10:16:33.908822+0000 mon.b (mon.2) 1110 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T10:16:35.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:16:34 smithi086 bash[24289]: audit 2024-09-16T10:16:34.536713+0000 mon.a (mon.0) 1291 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:16:35.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:16:34 smithi086 bash[24289]: audit 2024-09-16T10:16:34.540998+0000 mon.a (mon.0) 1292 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:16:35.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:16:34 smithi047 bash[22744]: cluster 2024-09-16T10:16:33.671713+0000 mgr.a (mgr.14373) 12083 : cluster [DBG] pgmap v8381: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-16T10:16:35.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:16:34 smithi047 bash[22744]: audit 2024-09-16T10:16:33.908822+0000 mon.b (mon.2) 1110 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T10:16:35.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:16:34 smithi047 bash[22744]: audit 2024-09-16T10:16:34.536713+0000 mon.a (mon.0) 1291 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:16:35.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:16:34 smithi047 bash[22744]: audit 2024-09-16T10:16:34.540998+0000 mon.a (mon.0) 1292 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:16:35.479 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:16:35.479 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:16:35.479 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:16:35.479 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:16:35.479 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:16:36.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:16:35 smithi157 bash[24585]: audit 2024-09-16T10:16:35.056058+0000 mgr.a (mgr.14373) 12084 : audit [DBG] from='client.264024 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:16:36.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:16:35 smithi157 bash[24585]: audit 2024-09-16T10:16:35.323758+0000 mon.b (mon.2) 1111 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T10:16:36.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:16:35 smithi157 bash[24585]: audit 2024-09-16T10:16:35.325207+0000 mon.b (mon.2) 1112 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T10:16:36.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:16:35 smithi157 bash[24585]: audit 2024-09-16T10:16:35.331988+0000 mon.a (mon.0) 1293 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:16:36.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:16:35 smithi157 bash[24585]: audit 2024-09-16T10:16:35.337308+0000 mon.b (mon.2) 1113 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:16:36.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:16:35 smithi086 bash[24289]: audit 2024-09-16T10:16:35.056058+0000 mgr.a (mgr.14373) 12084 : audit [DBG] from='client.264024 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:16:36.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:16:35 smithi086 bash[24289]: audit 2024-09-16T10:16:35.323758+0000 mon.b (mon.2) 1111 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T10:16:36.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:16:35 smithi086 bash[24289]: audit 2024-09-16T10:16:35.325207+0000 mon.b (mon.2) 1112 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T10:16:36.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:16:35 smithi086 bash[24289]: audit 2024-09-16T10:16:35.331988+0000 mon.a (mon.0) 1293 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:16:36.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:16:35 smithi086 bash[24289]: audit 2024-09-16T10:16:35.337308+0000 mon.b (mon.2) 1113 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:16:36.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:16:35 smithi047 bash[22744]: audit 2024-09-16T10:16:35.056058+0000 mgr.a (mgr.14373) 12084 : audit [DBG] from='client.264024 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:16:36.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:16:35 smithi047 bash[22744]: audit 2024-09-16T10:16:35.323758+0000 mon.b (mon.2) 1111 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T10:16:36.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:16:35 smithi047 bash[22744]: audit 2024-09-16T10:16:35.325207+0000 mon.b (mon.2) 1112 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T10:16:36.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:16:35 smithi047 bash[22744]: audit 2024-09-16T10:16:35.331988+0000 mon.a (mon.0) 1293 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:16:36.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:16:35 smithi047 bash[22744]: audit 2024-09-16T10:16:35.337308+0000 mon.b (mon.2) 1113 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:16:36.592 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 10:16:36 smithi047 bash[22994]: debug 2024-09-16T10:16:36.164+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T10:16:36.593 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 10:16:36 smithi047 bash[22994]: debug 2024-09-16T10:16:36.168+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T10:16:37.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:16:36 smithi157 bash[24585]: audit 2024-09-16T10:16:35.338943+0000 mgr.a (mgr.14373) 12085 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:16:37.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:16:36 smithi157 bash[24585]: cluster 2024-09-16T10:16:35.672305+0000 mgr.a (mgr.14373) 12086 : cluster [DBG] pgmap v8382: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:16:37.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:16:36 smithi157 bash[24585]: audit 2024-09-16T10:16:36.170240+0000 mgr.a (mgr.14373) 12087 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T10:16:37.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:16:36 smithi157 bash[24585]: cephadm 2024-09-16T10:16:36.172195+0000 mgr.a (mgr.14373) 12088 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T10:16:37.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:16:36 smithi086 bash[24289]: audit 2024-09-16T10:16:35.338943+0000 mgr.a (mgr.14373) 12085 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:16:37.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:16:36 smithi086 bash[24289]: cluster 2024-09-16T10:16:35.672305+0000 mgr.a (mgr.14373) 12086 : cluster [DBG] pgmap v8382: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:16:37.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:16:36 smithi086 bash[24289]: audit 2024-09-16T10:16:36.170240+0000 mgr.a (mgr.14373) 12087 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T10:16:37.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:16:36 smithi086 bash[24289]: cephadm 2024-09-16T10:16:36.172195+0000 mgr.a (mgr.14373) 12088 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T10:16:37.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:16:36 smithi047 bash[22744]: audit 2024-09-16T10:16:35.338943+0000 mgr.a (mgr.14373) 12085 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:16:37.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:16:36 smithi047 bash[22744]: cluster 2024-09-16T10:16:35.672305+0000 mgr.a (mgr.14373) 12086 : cluster [DBG] pgmap v8382: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:16:37.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:16:36 smithi047 bash[22744]: audit 2024-09-16T10:16:36.170240+0000 mgr.a (mgr.14373) 12087 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T10:16:37.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:16:36 smithi047 bash[22744]: cephadm 2024-09-16T10:16:36.172195+0000 mgr.a (mgr.14373) 12088 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T10:16:39.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:16:38 smithi157 bash[24585]: cluster 2024-09-16T10:16:37.674646+0000 mgr.a (mgr.14373) 12089 : cluster [DBG] pgmap v8383: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:16:39.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:16:38 smithi086 bash[24289]: cluster 2024-09-16T10:16:37.674646+0000 mgr.a (mgr.14373) 12089 : cluster [DBG] pgmap v8383: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:16:39.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:16:38 smithi047 bash[22744]: cluster 2024-09-16T10:16:37.674646+0000 mgr.a (mgr.14373) 12089 : cluster [DBG] pgmap v8383: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:16:40.480 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:16:40.481 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:16:40.481 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:16:41.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:16:40 smithi157 bash[24585]: cluster 2024-09-16T10:16:39.675392+0000 mgr.a (mgr.14373) 12090 : cluster [DBG] pgmap v8384: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:16:41.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:16:40 smithi086 bash[24289]: cluster 2024-09-16T10:16:39.675392+0000 mgr.a (mgr.14373) 12090 : cluster [DBG] pgmap v8384: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:16:41.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:16:40 smithi047 bash[22744]: cluster 2024-09-16T10:16:39.675392+0000 mgr.a (mgr.14373) 12090 : cluster [DBG] pgmap v8384: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:16:41.245 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:16:41.246 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:16:41.246 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:16:41.246 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:16:41.246 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:16:42.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:16:41 smithi157 bash[24585]: audit 2024-09-16T10:16:40.812323+0000 mgr.a (mgr.14373) 12091 : audit [DBG] from='client.264204 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:16:42.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:16:41 smithi086 bash[24289]: audit 2024-09-16T10:16:40.812323+0000 mgr.a (mgr.14373) 12091 : audit [DBG] from='client.264204 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:16:42.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:16:41 smithi047 bash[22744]: audit 2024-09-16T10:16:40.812323+0000 mgr.a (mgr.14373) 12091 : audit [DBG] from='client.264204 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:16:43.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:16:42 smithi086 bash[24289]: cluster 2024-09-16T10:16:41.677243+0000 mgr.a (mgr.14373) 12092 : cluster [DBG] pgmap v8385: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.8 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:16:43.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:16:42 smithi047 bash[22744]: cluster 2024-09-16T10:16:41.677243+0000 mgr.a (mgr.14373) 12092 : cluster [DBG] pgmap v8385: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.8 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:16:43.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:16:42 smithi157 bash[24585]: cluster 2024-09-16T10:16:41.677243+0000 mgr.a (mgr.14373) 12092 : cluster [DBG] pgmap v8385: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.8 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:16:45.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:16:44 smithi086 bash[24289]: cluster 2024-09-16T10:16:43.678543+0000 mgr.a (mgr.14373) 12093 : cluster [DBG] pgmap v8386: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.1 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:16:45.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:16:44 smithi047 bash[22744]: cluster 2024-09-16T10:16:43.678543+0000 mgr.a (mgr.14373) 12093 : cluster [DBG] pgmap v8386: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.1 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:16:45.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:16:44 smithi157 bash[24585]: cluster 2024-09-16T10:16:43.678543+0000 mgr.a (mgr.14373) 12093 : cluster [DBG] pgmap v8386: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.1 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:16:46.247 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:16:46.248 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:16:46.248 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:16:47.033 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:16:47.034 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:16:47.034 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:16:47.034 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:16:47.034 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:16:47.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:16:46 smithi086 bash[24289]: cluster 2024-09-16T10:16:45.679265+0000 mgr.a (mgr.14373) 12094 : cluster [DBG] pgmap v8387: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:16:47.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:16:46 smithi047 bash[22744]: cluster 2024-09-16T10:16:45.679265+0000 mgr.a (mgr.14373) 12094 : cluster [DBG] pgmap v8387: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:16:47.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:16:46 smithi157 bash[24585]: cluster 2024-09-16T10:16:45.679265+0000 mgr.a (mgr.14373) 12094 : cluster [DBG] pgmap v8387: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:16:48.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:16:47 smithi047 bash[22744]: audit 2024-09-16T10:16:46.581947+0000 mgr.a (mgr.14373) 12095 : audit [DBG] from='client.264279 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:16:48.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:16:47 smithi157 bash[24585]: audit 2024-09-16T10:16:46.581947+0000 mgr.a (mgr.14373) 12095 : audit [DBG] from='client.264279 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:16:48.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:16:47 smithi086 bash[24289]: audit 2024-09-16T10:16:46.581947+0000 mgr.a (mgr.14373) 12095 : audit [DBG] from='client.264279 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:16:49.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:16:48 smithi047 bash[22744]: cluster 2024-09-16T10:16:47.681978+0000 mgr.a (mgr.14373) 12096 : cluster [DBG] pgmap v8388: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:16:49.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:16:48 smithi157 bash[24585]: cluster 2024-09-16T10:16:47.681978+0000 mgr.a (mgr.14373) 12096 : cluster [DBG] pgmap v8388: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:16:49.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:16:48 smithi086 bash[24289]: cluster 2024-09-16T10:16:47.681978+0000 mgr.a (mgr.14373) 12096 : cluster [DBG] pgmap v8388: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:16:51.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:16:50 smithi047 bash[22744]: cluster 2024-09-16T10:16:49.682774+0000 mgr.a (mgr.14373) 12097 : cluster [DBG] pgmap v8389: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:16:51.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:16:50 smithi157 bash[24585]: cluster 2024-09-16T10:16:49.682774+0000 mgr.a (mgr.14373) 12097 : cluster [DBG] pgmap v8389: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:16:51.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:16:50 smithi086 bash[24289]: cluster 2024-09-16T10:16:49.682774+0000 mgr.a (mgr.14373) 12097 : cluster [DBG] pgmap v8389: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:16:52.035 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:16:52.035 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:16:52.036 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:16:52.779 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:16:52.780 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:16:52.780 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:16:52.780 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:16:52.780 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:16:53.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:16:52 smithi047 bash[22744]: cluster 2024-09-16T10:16:51.684266+0000 mgr.a (mgr.14373) 12098 : cluster [DBG] pgmap v8390: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-16T10:16:53.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:16:52 smithi157 bash[24585]: cluster 2024-09-16T10:16:51.684266+0000 mgr.a (mgr.14373) 12098 : cluster [DBG] pgmap v8390: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-16T10:16:53.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:16:52 smithi086 bash[24289]: cluster 2024-09-16T10:16:51.684266+0000 mgr.a (mgr.14373) 12098 : cluster [DBG] pgmap v8390: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-16T10:16:54.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:16:53 smithi047 bash[22744]: audit 2024-09-16T10:16:52.366125+0000 mgr.a (mgr.14373) 12099 : audit [DBG] from='client.264354 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:16:54.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:16:53 smithi157 bash[24585]: audit 2024-09-16T10:16:52.366125+0000 mgr.a (mgr.14373) 12099 : audit [DBG] from='client.264354 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:16:54.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:16:53 smithi086 bash[24289]: audit 2024-09-16T10:16:52.366125+0000 mgr.a (mgr.14373) 12099 : audit [DBG] from='client.264354 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:16:55.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:16:54 smithi157 bash[24585]: cluster 2024-09-16T10:16:53.685946+0000 mgr.a (mgr.14373) 12100 : cluster [DBG] pgmap v8391: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-16T10:16:55.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:16:54 smithi086 bash[24289]: cluster 2024-09-16T10:16:53.685946+0000 mgr.a (mgr.14373) 12100 : cluster [DBG] pgmap v8391: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-16T10:16:55.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:16:54 smithi047 bash[22744]: cluster 2024-09-16T10:16:53.685946+0000 mgr.a (mgr.14373) 12100 : cluster [DBG] pgmap v8391: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-16T10:16:56.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:16:56 smithi157 bash[24585]: cluster 2024-09-16T10:16:55.686735+0000 mgr.a (mgr.14373) 12101 : cluster [DBG] pgmap v8392: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:16:56.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:16:56 smithi086 bash[24289]: cluster 2024-09-16T10:16:55.686735+0000 mgr.a (mgr.14373) 12101 : cluster [DBG] pgmap v8392: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:16:56.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:16:56 smithi047 bash[22744]: cluster 2024-09-16T10:16:55.686735+0000 mgr.a (mgr.14373) 12101 : cluster [DBG] pgmap v8392: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:16:57.785 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:16:57.785 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:16:57.785 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:16:58.558 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:16:58.559 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:16:58.559 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:16:58.559 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:16:58.559 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:16:59.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:16:58 smithi157 bash[24585]: cluster 2024-09-16T10:16:57.688759+0000 mgr.a (mgr.14373) 12102 : cluster [DBG] pgmap v8393: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:16:59.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:16:58 smithi157 bash[24585]: audit 2024-09-16T10:16:58.111106+0000 mgr.a (mgr.14373) 12103 : audit [DBG] from='client.264426 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:16:59.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:16:58 smithi086 bash[24289]: cluster 2024-09-16T10:16:57.688759+0000 mgr.a (mgr.14373) 12102 : cluster [DBG] pgmap v8393: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:16:59.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:16:58 smithi086 bash[24289]: audit 2024-09-16T10:16:58.111106+0000 mgr.a (mgr.14373) 12103 : audit [DBG] from='client.264426 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:16:59.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:16:58 smithi047 bash[22744]: cluster 2024-09-16T10:16:57.688759+0000 mgr.a (mgr.14373) 12102 : cluster [DBG] pgmap v8393: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:16:59.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:16:58 smithi047 bash[22744]: audit 2024-09-16T10:16:58.111106+0000 mgr.a (mgr.14373) 12103 : audit [DBG] from='client.264426 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:17:01.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:17:00 smithi157 bash[24585]: cluster 2024-09-16T10:16:59.689623+0000 mgr.a (mgr.14373) 12104 : cluster [DBG] pgmap v8394: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:17:01.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:17:00 smithi086 bash[24289]: cluster 2024-09-16T10:16:59.689623+0000 mgr.a (mgr.14373) 12104 : cluster [DBG] pgmap v8394: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:17:01.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:17:00 smithi047 bash[22744]: cluster 2024-09-16T10:16:59.689623+0000 mgr.a (mgr.14373) 12104 : cluster [DBG] pgmap v8394: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:17:03.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:17:02 smithi157 bash[24585]: cluster 2024-09-16T10:17:01.691419+0000 mgr.a (mgr.14373) 12105 : cluster [DBG] pgmap v8395: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:17:03.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:17:02 smithi086 bash[24289]: cluster 2024-09-16T10:17:01.691419+0000 mgr.a (mgr.14373) 12105 : cluster [DBG] pgmap v8395: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:17:03.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:17:02 smithi047 bash[22744]: cluster 2024-09-16T10:17:01.691419+0000 mgr.a (mgr.14373) 12105 : cluster [DBG] pgmap v8395: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:17:03.560 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:17:03.561 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:17:03.561 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:17:04.338 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:17:04.339 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:17:04.339 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:17:04.339 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:17:04.339 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:17:05.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:17:04 smithi157 bash[24585]: cluster 2024-09-16T10:17:03.692066+0000 mgr.a (mgr.14373) 12106 : cluster [DBG] pgmap v8396: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-16T10:17:05.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:17:04 smithi157 bash[24585]: audit 2024-09-16T10:17:03.894657+0000 mgr.a (mgr.14373) 12107 : audit [DBG] from='client.264504 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:17:05.072 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:17:04 smithi086 bash[24289]: cluster 2024-09-16T10:17:03.692066+0000 mgr.a (mgr.14373) 12106 : cluster [DBG] pgmap v8396: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-16T10:17:05.072 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:17:04 smithi086 bash[24289]: audit 2024-09-16T10:17:03.894657+0000 mgr.a (mgr.14373) 12107 : audit [DBG] from='client.264504 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:17:05.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:17:04 smithi047 bash[22744]: cluster 2024-09-16T10:17:03.692066+0000 mgr.a (mgr.14373) 12106 : cluster [DBG] pgmap v8396: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-16T10:17:05.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:17:04 smithi047 bash[22744]: audit 2024-09-16T10:17:03.894657+0000 mgr.a (mgr.14373) 12107 : audit [DBG] from='client.264504 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:17:07.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:17:06 smithi157 bash[24585]: cluster 2024-09-16T10:17:05.692867+0000 mgr.a (mgr.14373) 12108 : cluster [DBG] pgmap v8397: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:17:07.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:17:06 smithi086 bash[24289]: cluster 2024-09-16T10:17:05.692867+0000 mgr.a (mgr.14373) 12108 : cluster [DBG] pgmap v8397: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:17:07.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:17:06 smithi047 bash[22744]: cluster 2024-09-16T10:17:05.692867+0000 mgr.a (mgr.14373) 12108 : cluster [DBG] pgmap v8397: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:17:09.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:17:08 smithi157 bash[24585]: cluster 2024-09-16T10:17:07.695138+0000 mgr.a (mgr.14373) 12109 : cluster [DBG] pgmap v8398: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:17:09.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:17:08 smithi086 bash[24289]: cluster 2024-09-16T10:17:07.695138+0000 mgr.a (mgr.14373) 12109 : cluster [DBG] pgmap v8398: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:17:09.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:17:08 smithi047 bash[22744]: cluster 2024-09-16T10:17:07.695138+0000 mgr.a (mgr.14373) 12109 : cluster [DBG] pgmap v8398: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:17:09.340 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:17:09.341 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:17:09.341 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:17:10.108 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:17:10.108 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:17:10.108 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:17:10.108 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:17:10.108 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:17:11.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:17:10 smithi157 bash[24585]: audit 2024-09-16T10:17:09.675150+0000 mgr.a (mgr.14373) 12110 : audit [DBG] from='client.264582 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:17:11.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:17:10 smithi157 bash[24585]: cluster 2024-09-16T10:17:09.696423+0000 mgr.a (mgr.14373) 12111 : cluster [DBG] pgmap v8399: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:17:11.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:17:10 smithi086 bash[24289]: audit 2024-09-16T10:17:09.675150+0000 mgr.a (mgr.14373) 12110 : audit [DBG] from='client.264582 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:17:11.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:17:10 smithi086 bash[24289]: cluster 2024-09-16T10:17:09.696423+0000 mgr.a (mgr.14373) 12111 : cluster [DBG] pgmap v8399: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:17:11.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:17:10 smithi047 bash[22744]: audit 2024-09-16T10:17:09.675150+0000 mgr.a (mgr.14373) 12110 : audit [DBG] from='client.264582 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:17:11.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:17:10 smithi047 bash[22744]: cluster 2024-09-16T10:17:09.696423+0000 mgr.a (mgr.14373) 12111 : cluster [DBG] pgmap v8399: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:17:13.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:17:12 smithi157 bash[24585]: cluster 2024-09-16T10:17:11.698435+0000 mgr.a (mgr.14373) 12112 : cluster [DBG] pgmap v8400: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:17:13.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:17:12 smithi086 bash[24289]: cluster 2024-09-16T10:17:11.698435+0000 mgr.a (mgr.14373) 12112 : cluster [DBG] pgmap v8400: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:17:13.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:17:12 smithi047 bash[22744]: cluster 2024-09-16T10:17:11.698435+0000 mgr.a (mgr.14373) 12112 : cluster [DBG] pgmap v8400: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:17:15.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:17:14 smithi157 bash[24585]: cluster 2024-09-16T10:17:13.699729+0000 mgr.a (mgr.14373) 12113 : cluster [DBG] pgmap v8401: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-16T10:17:15.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:17:14 smithi086 bash[24289]: cluster 2024-09-16T10:17:13.699729+0000 mgr.a (mgr.14373) 12113 : cluster [DBG] pgmap v8401: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-16T10:17:15.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:17:14 smithi047 bash[22744]: cluster 2024-09-16T10:17:13.699729+0000 mgr.a (mgr.14373) 12113 : cluster [DBG] pgmap v8401: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-16T10:17:15.109 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:17:15.110 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:17:15.110 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:17:15.883 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:17:15.883 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:17:15.883 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:17:15.884 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:17:15.884 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:17:17.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:17:16 smithi157 bash[24585]: audit 2024-09-16T10:17:15.444150+0000 mgr.a (mgr.14373) 12114 : audit [DBG] from='client.264660 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:17:17.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:17:16 smithi157 bash[24585]: cluster 2024-09-16T10:17:15.700295+0000 mgr.a (mgr.14373) 12115 : cluster [DBG] pgmap v8402: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:17:17.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:17:16 smithi086 bash[24289]: audit 2024-09-16T10:17:15.444150+0000 mgr.a (mgr.14373) 12114 : audit [DBG] from='client.264660 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:17:17.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:17:16 smithi086 bash[24289]: cluster 2024-09-16T10:17:15.700295+0000 mgr.a (mgr.14373) 12115 : cluster [DBG] pgmap v8402: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:17:17.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:17:16 smithi047 bash[22744]: audit 2024-09-16T10:17:15.444150+0000 mgr.a (mgr.14373) 12114 : audit [DBG] from='client.264660 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:17:17.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:17:16 smithi047 bash[22744]: cluster 2024-09-16T10:17:15.700295+0000 mgr.a (mgr.14373) 12115 : cluster [DBG] pgmap v8402: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:17:19.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:17:18 smithi157 bash[24585]: cluster 2024-09-16T10:17:17.702681+0000 mgr.a (mgr.14373) 12116 : cluster [DBG] pgmap v8403: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:17:19.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:17:18 smithi086 bash[24289]: cluster 2024-09-16T10:17:17.702681+0000 mgr.a (mgr.14373) 12116 : cluster [DBG] pgmap v8403: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:17:19.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:17:18 smithi047 bash[22744]: cluster 2024-09-16T10:17:17.702681+0000 mgr.a (mgr.14373) 12116 : cluster [DBG] pgmap v8403: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:17:20.885 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:17:20.885 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:17:20.886 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:17:21.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:17:20 smithi157 bash[24585]: cluster 2024-09-16T10:17:19.703443+0000 mgr.a (mgr.14373) 12117 : cluster [DBG] pgmap v8404: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:17:21.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:17:20 smithi086 bash[24289]: cluster 2024-09-16T10:17:19.703443+0000 mgr.a (mgr.14373) 12117 : cluster [DBG] pgmap v8404: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:17:21.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:17:20 smithi047 bash[22744]: cluster 2024-09-16T10:17:19.703443+0000 mgr.a (mgr.14373) 12117 : cluster [DBG] pgmap v8404: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:17:21.636 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:17:21.636 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:17:21.636 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:17:21.636 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:17:21.636 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:17:23.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:17:22 smithi157 bash[24585]: audit 2024-09-16T10:17:21.212975+0000 mgr.a (mgr.14373) 12118 : audit [DBG] from='client.264738 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:17:23.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:17:22 smithi157 bash[24585]: cluster 2024-09-16T10:17:21.705680+0000 mgr.a (mgr.14373) 12119 : cluster [DBG] pgmap v8405: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-16T10:17:23.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:17:22 smithi086 bash[24289]: audit 2024-09-16T10:17:21.212975+0000 mgr.a (mgr.14373) 12118 : audit [DBG] from='client.264738 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:17:23.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:17:22 smithi086 bash[24289]: cluster 2024-09-16T10:17:21.705680+0000 mgr.a (mgr.14373) 12119 : cluster [DBG] pgmap v8405: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-16T10:17:23.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:17:22 smithi047 bash[22744]: audit 2024-09-16T10:17:21.212975+0000 mgr.a (mgr.14373) 12118 : audit [DBG] from='client.264738 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:17:23.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:17:22 smithi047 bash[22744]: cluster 2024-09-16T10:17:21.705680+0000 mgr.a (mgr.14373) 12119 : cluster [DBG] pgmap v8405: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-16T10:17:25.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:17:24 smithi157 bash[24585]: cluster 2024-09-16T10:17:23.706979+0000 mgr.a (mgr.14373) 12120 : cluster [DBG] pgmap v8406: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T10:17:25.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:17:24 smithi086 bash[24289]: cluster 2024-09-16T10:17:23.706979+0000 mgr.a (mgr.14373) 12120 : cluster [DBG] pgmap v8406: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T10:17:25.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:17:24 smithi047 bash[22744]: cluster 2024-09-16T10:17:23.706979+0000 mgr.a (mgr.14373) 12120 : cluster [DBG] pgmap v8406: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T10:17:26.637 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:17:26.638 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:17:26.638 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:17:27.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:17:26 smithi157 bash[24585]: cluster 2024-09-16T10:17:25.707734+0000 mgr.a (mgr.14373) 12121 : cluster [DBG] pgmap v8407: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T10:17:27.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:17:26 smithi086 bash[24289]: cluster 2024-09-16T10:17:25.707734+0000 mgr.a (mgr.14373) 12121 : cluster [DBG] pgmap v8407: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T10:17:27.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:17:26 smithi047 bash[22744]: cluster 2024-09-16T10:17:25.707734+0000 mgr.a (mgr.14373) 12121 : cluster [DBG] pgmap v8407: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T10:17:27.393 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:17:27.394 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:17:27.394 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:17:27.394 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:17:27.394 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:17:28.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:17:27 smithi086 bash[24289]: audit 2024-09-16T10:17:26.958203+0000 mgr.a (mgr.14373) 12122 : audit [DBG] from='client.264813 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:17:28.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:17:27 smithi047 bash[22744]: audit 2024-09-16T10:17:26.958203+0000 mgr.a (mgr.14373) 12122 : audit [DBG] from='client.264813 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:17:28.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:17:27 smithi157 bash[24585]: audit 2024-09-16T10:17:26.958203+0000 mgr.a (mgr.14373) 12122 : audit [DBG] from='client.264813 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:17:29.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:17:28 smithi086 bash[24289]: cluster 2024-09-16T10:17:27.710524+0000 mgr.a (mgr.14373) 12123 : cluster [DBG] pgmap v8408: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:17:29.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:17:28 smithi047 bash[22744]: cluster 2024-09-16T10:17:27.710524+0000 mgr.a (mgr.14373) 12123 : cluster [DBG] pgmap v8408: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:17:29.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:17:28 smithi157 bash[24585]: cluster 2024-09-16T10:17:27.710524+0000 mgr.a (mgr.14373) 12123 : cluster [DBG] pgmap v8408: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:17:31.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:17:30 smithi047 bash[22744]: cluster 2024-09-16T10:17:29.711277+0000 mgr.a (mgr.14373) 12124 : cluster [DBG] pgmap v8409: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:17:31.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:17:30 smithi157 bash[24585]: cluster 2024-09-16T10:17:29.711277+0000 mgr.a (mgr.14373) 12124 : cluster [DBG] pgmap v8409: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:17:31.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:17:30 smithi086 bash[24289]: cluster 2024-09-16T10:17:29.711277+0000 mgr.a (mgr.14373) 12124 : cluster [DBG] pgmap v8409: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:17:32.395 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:17:32.395 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:17:32.396 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:17:33.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:17:32 smithi047 bash[22744]: cluster 2024-09-16T10:17:31.713170+0000 mgr.a (mgr.14373) 12125 : cluster [DBG] pgmap v8410: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:17:33.178 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:17:33.178 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:17:33.179 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:17:33.179 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:17:33.179 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:17:33.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:17:32 smithi157 bash[24585]: cluster 2024-09-16T10:17:31.713170+0000 mgr.a (mgr.14373) 12125 : cluster [DBG] pgmap v8410: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:17:33.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:17:32 smithi086 bash[24289]: cluster 2024-09-16T10:17:31.713170+0000 mgr.a (mgr.14373) 12125 : cluster [DBG] pgmap v8410: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:17:34.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:17:33 smithi047 bash[22744]: audit 2024-09-16T10:17:32.727801+0000 mgr.a (mgr.14373) 12126 : audit [DBG] from='client.264888 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:17:34.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:17:33 smithi157 bash[24585]: audit 2024-09-16T10:17:32.727801+0000 mgr.a (mgr.14373) 12126 : audit [DBG] from='client.264888 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:17:34.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:17:33 smithi086 bash[24289]: audit 2024-09-16T10:17:32.727801+0000 mgr.a (mgr.14373) 12126 : audit [DBG] from='client.264888 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:17:35.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:17:34 smithi047 bash[22744]: cluster 2024-09-16T10:17:33.714124+0000 mgr.a (mgr.14373) 12127 : cluster [DBG] pgmap v8411: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-16T10:17:35.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:17:34 smithi157 bash[24585]: cluster 2024-09-16T10:17:33.714124+0000 mgr.a (mgr.14373) 12127 : cluster [DBG] pgmap v8411: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-16T10:17:35.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:17:34 smithi086 bash[24289]: cluster 2024-09-16T10:17:33.714124+0000 mgr.a (mgr.14373) 12127 : cluster [DBG] pgmap v8411: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-16T10:17:37.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:17:36 smithi047 bash[22744]: cluster 2024-09-16T10:17:35.714919+0000 mgr.a (mgr.14373) 12128 : cluster [DBG] pgmap v8412: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-16T10:17:37.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:17:36 smithi047 bash[22744]: audit 2024-09-16T10:17:36.227506+0000 mon.b (mon.2) 1114 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T10:17:37.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:17:36 smithi157 bash[24585]: cluster 2024-09-16T10:17:35.714919+0000 mgr.a (mgr.14373) 12128 : cluster [DBG] pgmap v8412: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-16T10:17:37.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:17:36 smithi157 bash[24585]: audit 2024-09-16T10:17:36.227506+0000 mon.b (mon.2) 1114 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T10:17:37.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:17:36 smithi086 bash[24289]: cluster 2024-09-16T10:17:35.714919+0000 mgr.a (mgr.14373) 12128 : cluster [DBG] pgmap v8412: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-16T10:17:37.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:17:36 smithi086 bash[24289]: audit 2024-09-16T10:17:36.227506+0000 mon.b (mon.2) 1114 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T10:17:38.179 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:17:38.180 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:17:38.180 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:17:38.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:17:37 smithi157 bash[24585]: audit 2024-09-16T10:17:36.846429+0000 mon.a (mon.0) 1294 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:17:38.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:17:37 smithi157 bash[24585]: audit 2024-09-16T10:17:36.849279+0000 mon.a (mon.0) 1295 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:17:38.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:17:37 smithi157 bash[24585]: audit 2024-09-16T10:17:36.853146+0000 mon.a (mon.0) 1296 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:17:38.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:17:37 smithi157 bash[24585]: audit 2024-09-16T10:17:36.856065+0000 mon.a (mon.0) 1297 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:17:38.308 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:17:37 smithi157 bash[24585]: audit 2024-09-16T10:17:37.567938+0000 mon.b (mon.2) 1115 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T10:17:38.308 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:17:37 smithi157 bash[24585]: audit 2024-09-16T10:17:37.569757+0000 mon.b (mon.2) 1116 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T10:17:38.308 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:17:37 smithi157 bash[24585]: audit 2024-09-16T10:17:37.581152+0000 mon.a (mon.0) 1298 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:17:38.308 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:17:37 smithi157 bash[24585]: audit 2024-09-16T10:17:37.586468+0000 mon.b (mon.2) 1117 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:17:38.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:17:37 smithi086 bash[24289]: audit 2024-09-16T10:17:36.846429+0000 mon.a (mon.0) 1294 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:17:38.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:17:37 smithi086 bash[24289]: audit 2024-09-16T10:17:36.849279+0000 mon.a (mon.0) 1295 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:17:38.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:17:37 smithi086 bash[24289]: audit 2024-09-16T10:17:36.853146+0000 mon.a (mon.0) 1296 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:17:38.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:17:37 smithi086 bash[24289]: audit 2024-09-16T10:17:36.856065+0000 mon.a (mon.0) 1297 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:17:38.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:17:37 smithi086 bash[24289]: audit 2024-09-16T10:17:37.567938+0000 mon.b (mon.2) 1115 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T10:17:38.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:17:37 smithi086 bash[24289]: audit 2024-09-16T10:17:37.569757+0000 mon.b (mon.2) 1116 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T10:17:38.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:17:37 smithi086 bash[24289]: audit 2024-09-16T10:17:37.581152+0000 mon.a (mon.0) 1298 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:17:38.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:17:37 smithi086 bash[24289]: audit 2024-09-16T10:17:37.586468+0000 mon.b (mon.2) 1117 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:17:38.325 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:17:37 smithi047 bash[22744]: audit 2024-09-16T10:17:36.846429+0000 mon.a (mon.0) 1294 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:17:38.326 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:17:37 smithi047 bash[22744]: audit 2024-09-16T10:17:36.849279+0000 mon.a (mon.0) 1295 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:17:38.326 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:17:37 smithi047 bash[22744]: audit 2024-09-16T10:17:36.853146+0000 mon.a (mon.0) 1296 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:17:38.326 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:17:37 smithi047 bash[22744]: audit 2024-09-16T10:17:36.856065+0000 mon.a (mon.0) 1297 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:17:38.326 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:17:37 smithi047 bash[22744]: audit 2024-09-16T10:17:37.567938+0000 mon.b (mon.2) 1115 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T10:17:38.326 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:17:37 smithi047 bash[22744]: audit 2024-09-16T10:17:37.569757+0000 mon.b (mon.2) 1116 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T10:17:38.326 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:17:37 smithi047 bash[22744]: audit 2024-09-16T10:17:37.581152+0000 mon.a (mon.0) 1298 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:17:38.326 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:17:37 smithi047 bash[22744]: audit 2024-09-16T10:17:37.586468+0000 mon.b (mon.2) 1117 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:17:38.592 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 10:17:38 smithi047 bash[22994]: debug 2024-09-16T10:17:38.319+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T10:17:38.592 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 10:17:38 smithi047 bash[22994]: debug 2024-09-16T10:17:38.319+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T10:17:38.914 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:17:38.915 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:17:38.915 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:17:38.915 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:17:38.915 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:17:39.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:17:38 smithi157 bash[24585]: audit 2024-09-16T10:17:37.589128+0000 mgr.a (mgr.14373) 12129 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:17:39.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:17:38 smithi157 bash[24585]: cluster 2024-09-16T10:17:37.716720+0000 mgr.a (mgr.14373) 12130 : cluster [DBG] pgmap v8413: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-16T10:17:39.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:17:38 smithi086 bash[24289]: audit 2024-09-16T10:17:37.589128+0000 mgr.a (mgr.14373) 12129 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:17:39.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:17:38 smithi086 bash[24289]: cluster 2024-09-16T10:17:37.716720+0000 mgr.a (mgr.14373) 12130 : cluster [DBG] pgmap v8413: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-16T10:17:39.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:17:38 smithi047 bash[22744]: audit 2024-09-16T10:17:37.589128+0000 mgr.a (mgr.14373) 12129 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:17:39.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:17:38 smithi047 bash[22744]: cluster 2024-09-16T10:17:37.716720+0000 mgr.a (mgr.14373) 12130 : cluster [DBG] pgmap v8413: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-16T10:17:40.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:17:39 smithi157 bash[24585]: audit 2024-09-16T10:17:38.324677+0000 mgr.a (mgr.14373) 12131 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T10:17:40.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:17:39 smithi157 bash[24585]: cephadm 2024-09-16T10:17:38.326250+0000 mgr.a (mgr.14373) 12132 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T10:17:40.308 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:17:39 smithi157 bash[24585]: audit 2024-09-16T10:17:38.498054+0000 mgr.a (mgr.14373) 12133 : audit [DBG] from='client.265071 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:17:40.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:17:39 smithi086 bash[24289]: audit 2024-09-16T10:17:38.324677+0000 mgr.a (mgr.14373) 12131 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T10:17:40.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:17:39 smithi086 bash[24289]: cephadm 2024-09-16T10:17:38.326250+0000 mgr.a (mgr.14373) 12132 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T10:17:40.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:17:39 smithi086 bash[24289]: audit 2024-09-16T10:17:38.498054+0000 mgr.a (mgr.14373) 12133 : audit [DBG] from='client.265071 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:17:40.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:17:39 smithi047 bash[22744]: audit 2024-09-16T10:17:38.324677+0000 mgr.a (mgr.14373) 12131 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T10:17:40.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:17:39 smithi047 bash[22744]: cephadm 2024-09-16T10:17:38.326250+0000 mgr.a (mgr.14373) 12132 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T10:17:40.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:17:39 smithi047 bash[22744]: audit 2024-09-16T10:17:38.498054+0000 mgr.a (mgr.14373) 12133 : audit [DBG] from='client.265071 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:17:41.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:17:40 smithi157 bash[24585]: cluster 2024-09-16T10:17:39.717689+0000 mgr.a (mgr.14373) 12134 : cluster [DBG] pgmap v8414: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:17:41.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:17:40 smithi086 bash[24289]: cluster 2024-09-16T10:17:39.717689+0000 mgr.a (mgr.14373) 12134 : cluster [DBG] pgmap v8414: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:17:41.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:17:40 smithi047 bash[22744]: cluster 2024-09-16T10:17:39.717689+0000 mgr.a (mgr.14373) 12134 : cluster [DBG] pgmap v8414: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:17:43.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:17:42 smithi157 bash[24585]: cluster 2024-09-16T10:17:41.719852+0000 mgr.a (mgr.14373) 12135 : cluster [DBG] pgmap v8415: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:17:43.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:17:42 smithi086 bash[24289]: cluster 2024-09-16T10:17:41.719852+0000 mgr.a (mgr.14373) 12135 : cluster [DBG] pgmap v8415: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:17:43.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:17:42 smithi047 bash[22744]: cluster 2024-09-16T10:17:41.719852+0000 mgr.a (mgr.14373) 12135 : cluster [DBG] pgmap v8415: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:17:43.916 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:17:43.917 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:17:43.917 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:17:44.686 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:17:44.686 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:17:44.686 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:17:44.686 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:17:44.687 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:17:45.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:17:44 smithi157 bash[24585]: cluster 2024-09-16T10:17:43.720613+0000 mgr.a (mgr.14373) 12136 : cluster [DBG] pgmap v8416: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:17:45.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:17:44 smithi086 bash[24289]: cluster 2024-09-16T10:17:43.720613+0000 mgr.a (mgr.14373) 12136 : cluster [DBG] pgmap v8416: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:17:45.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:17:44 smithi047 bash[22744]: cluster 2024-09-16T10:17:43.720613+0000 mgr.a (mgr.14373) 12136 : cluster [DBG] pgmap v8416: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:17:46.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:17:45 smithi157 bash[24585]: audit 2024-09-16T10:17:44.250640+0000 mgr.a (mgr.14373) 12137 : audit [DBG] from='client.265146 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:17:46.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:17:45 smithi086 bash[24289]: audit 2024-09-16T10:17:44.250640+0000 mgr.a (mgr.14373) 12137 : audit [DBG] from='client.265146 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:17:46.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:17:45 smithi047 bash[22744]: audit 2024-09-16T10:17:44.250640+0000 mgr.a (mgr.14373) 12137 : audit [DBG] from='client.265146 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:17:47.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:17:46 smithi157 bash[24585]: cluster 2024-09-16T10:17:45.721594+0000 mgr.a (mgr.14373) 12138 : cluster [DBG] pgmap v8417: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:17:47.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:17:46 smithi086 bash[24289]: cluster 2024-09-16T10:17:45.721594+0000 mgr.a (mgr.14373) 12138 : cluster [DBG] pgmap v8417: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:17:47.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:17:46 smithi047 bash[22744]: cluster 2024-09-16T10:17:45.721594+0000 mgr.a (mgr.14373) 12138 : cluster [DBG] pgmap v8417: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:17:49.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:17:48 smithi157 bash[24585]: cluster 2024-09-16T10:17:47.723844+0000 mgr.a (mgr.14373) 12139 : cluster [DBG] pgmap v8418: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:17:49.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:17:48 smithi086 bash[24289]: cluster 2024-09-16T10:17:47.723844+0000 mgr.a (mgr.14373) 12139 : cluster [DBG] pgmap v8418: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:17:49.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:17:48 smithi047 bash[22744]: cluster 2024-09-16T10:17:47.723844+0000 mgr.a (mgr.14373) 12139 : cluster [DBG] pgmap v8418: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:17:49.688 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:17:49.689 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:17:49.689 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:17:50.429 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:17:50.430 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:17:50.430 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:17:50.430 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:17:50.430 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:17:51.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:17:50 smithi157 bash[24585]: cluster 2024-09-16T10:17:49.724472+0000 mgr.a (mgr.14373) 12140 : cluster [DBG] pgmap v8419: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:17:51.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:17:50 smithi157 bash[24585]: audit 2024-09-16T10:17:50.016099+0000 mgr.a (mgr.14373) 12141 : audit [DBG] from='client.265224 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:17:51.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:17:50 smithi086 bash[24289]: cluster 2024-09-16T10:17:49.724472+0000 mgr.a (mgr.14373) 12140 : cluster [DBG] pgmap v8419: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:17:51.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:17:50 smithi086 bash[24289]: audit 2024-09-16T10:17:50.016099+0000 mgr.a (mgr.14373) 12141 : audit [DBG] from='client.265224 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:17:51.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:17:50 smithi047 bash[22744]: cluster 2024-09-16T10:17:49.724472+0000 mgr.a (mgr.14373) 12140 : cluster [DBG] pgmap v8419: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:17:51.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:17:50 smithi047 bash[22744]: audit 2024-09-16T10:17:50.016099+0000 mgr.a (mgr.14373) 12141 : audit [DBG] from='client.265224 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:17:53.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:17:52 smithi157 bash[24585]: cluster 2024-09-16T10:17:51.726945+0000 mgr.a (mgr.14373) 12142 : cluster [DBG] pgmap v8420: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:17:53.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:17:52 smithi086 bash[24289]: cluster 2024-09-16T10:17:51.726945+0000 mgr.a (mgr.14373) 12142 : cluster [DBG] pgmap v8420: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:17:53.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:17:52 smithi047 bash[22744]: cluster 2024-09-16T10:17:51.726945+0000 mgr.a (mgr.14373) 12142 : cluster [DBG] pgmap v8420: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:17:55.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:17:54 smithi157 bash[24585]: cluster 2024-09-16T10:17:53.727762+0000 mgr.a (mgr.14373) 12143 : cluster [DBG] pgmap v8421: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:17:55.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:17:54 smithi086 bash[24289]: cluster 2024-09-16T10:17:53.727762+0000 mgr.a (mgr.14373) 12143 : cluster [DBG] pgmap v8421: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:17:55.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:17:54 smithi047 bash[22744]: cluster 2024-09-16T10:17:53.727762+0000 mgr.a (mgr.14373) 12143 : cluster [DBG] pgmap v8421: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:17:55.431 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:17:55.432 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:17:55.432 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:17:56.177 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:17:56.177 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:17:56.178 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:17:56.178 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:17:56.178 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:17:57.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:17:56 smithi157 bash[24585]: cluster 2024-09-16T10:17:55.728654+0000 mgr.a (mgr.14373) 12144 : cluster [DBG] pgmap v8422: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:17:57.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:17:56 smithi157 bash[24585]: audit 2024-09-16T10:17:55.766178+0000 mgr.a (mgr.14373) 12145 : audit [DBG] from='client.265302 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:17:57.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:17:56 smithi086 bash[24289]: cluster 2024-09-16T10:17:55.728654+0000 mgr.a (mgr.14373) 12144 : cluster [DBG] pgmap v8422: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:17:57.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:17:56 smithi086 bash[24289]: audit 2024-09-16T10:17:55.766178+0000 mgr.a (mgr.14373) 12145 : audit [DBG] from='client.265302 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:17:57.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:17:56 smithi047 bash[22744]: cluster 2024-09-16T10:17:55.728654+0000 mgr.a (mgr.14373) 12144 : cluster [DBG] pgmap v8422: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:17:57.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:17:56 smithi047 bash[22744]: audit 2024-09-16T10:17:55.766178+0000 mgr.a (mgr.14373) 12145 : audit [DBG] from='client.265302 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:17:59.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:17:58 smithi157 bash[24585]: cluster 2024-09-16T10:17:57.731050+0000 mgr.a (mgr.14373) 12146 : cluster [DBG] pgmap v8423: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:17:59.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:17:58 smithi086 bash[24289]: cluster 2024-09-16T10:17:57.731050+0000 mgr.a (mgr.14373) 12146 : cluster [DBG] pgmap v8423: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:17:59.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:17:58 smithi047 bash[22744]: cluster 2024-09-16T10:17:57.731050+0000 mgr.a (mgr.14373) 12146 : cluster [DBG] pgmap v8423: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:18:01.179 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:18:01.180 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:18:01.180 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:18:01.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:18:00 smithi157 bash[24585]: cluster 2024-09-16T10:17:59.731832+0000 mgr.a (mgr.14373) 12147 : cluster [DBG] pgmap v8424: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:18:01.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:18:00 smithi086 bash[24289]: cluster 2024-09-16T10:17:59.731832+0000 mgr.a (mgr.14373) 12147 : cluster [DBG] pgmap v8424: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:18:01.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:18:00 smithi047 bash[22744]: cluster 2024-09-16T10:17:59.731832+0000 mgr.a (mgr.14373) 12147 : cluster [DBG] pgmap v8424: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:18:01.937 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:18:01.938 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:18:01.938 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:18:01.938 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:18:01.938 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:18:03.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:18:02 smithi157 bash[24585]: audit 2024-09-16T10:18:01.512690+0000 mgr.a (mgr.14373) 12148 : audit [DBG] from='client.265377 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:18:03.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:18:02 smithi157 bash[24585]: cluster 2024-09-16T10:18:01.741452+0000 mgr.a (mgr.14373) 12149 : cluster [DBG] pgmap v8425: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-16T10:18:03.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:18:02 smithi086 bash[24289]: audit 2024-09-16T10:18:01.512690+0000 mgr.a (mgr.14373) 12148 : audit [DBG] from='client.265377 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:18:03.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:18:02 smithi086 bash[24289]: cluster 2024-09-16T10:18:01.741452+0000 mgr.a (mgr.14373) 12149 : cluster [DBG] pgmap v8425: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-16T10:18:03.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:18:02 smithi047 bash[22744]: audit 2024-09-16T10:18:01.512690+0000 mgr.a (mgr.14373) 12148 : audit [DBG] from='client.265377 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:18:03.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:18:02 smithi047 bash[22744]: cluster 2024-09-16T10:18:01.741452+0000 mgr.a (mgr.14373) 12149 : cluster [DBG] pgmap v8425: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-16T10:18:05.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:18:04 smithi157 bash[24585]: cluster 2024-09-16T10:18:03.742322+0000 mgr.a (mgr.14373) 12150 : cluster [DBG] pgmap v8426: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1022 B/s rd, 0 op/s 2024-09-16T10:18:05.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:18:04 smithi086 bash[24289]: cluster 2024-09-16T10:18:03.742322+0000 mgr.a (mgr.14373) 12150 : cluster [DBG] pgmap v8426: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1022 B/s rd, 0 op/s 2024-09-16T10:18:05.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:18:04 smithi047 bash[22744]: cluster 2024-09-16T10:18:03.742322+0000 mgr.a (mgr.14373) 12150 : cluster [DBG] pgmap v8426: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1022 B/s rd, 0 op/s 2024-09-16T10:18:06.939 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:18:06.940 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:18:06.940 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:18:07.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:18:06 smithi157 bash[24585]: cluster 2024-09-16T10:18:05.743127+0000 mgr.a (mgr.14373) 12151 : cluster [DBG] pgmap v8427: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1022 B/s rd, 0 op/s 2024-09-16T10:18:07.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:18:06 smithi086 bash[24289]: cluster 2024-09-16T10:18:05.743127+0000 mgr.a (mgr.14373) 12151 : cluster [DBG] pgmap v8427: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1022 B/s rd, 0 op/s 2024-09-16T10:18:07.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:18:06 smithi047 bash[22744]: cluster 2024-09-16T10:18:05.743127+0000 mgr.a (mgr.14373) 12151 : cluster [DBG] pgmap v8427: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1022 B/s rd, 0 op/s 2024-09-16T10:18:07.714 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:18:07.715 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:18:07.715 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:18:07.715 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:18:07.715 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:18:09.308 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:18:08 smithi157 bash[24585]: audit 2024-09-16T10:18:07.272358+0000 mgr.a (mgr.14373) 12152 : audit [DBG] from='client.265455 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:18:09.309 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:18:08 smithi157 bash[24585]: cluster 2024-09-16T10:18:07.744392+0000 mgr.a (mgr.14373) 12153 : cluster [DBG] pgmap v8428: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-16T10:18:09.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:18:08 smithi086 bash[24289]: audit 2024-09-16T10:18:07.272358+0000 mgr.a (mgr.14373) 12152 : audit [DBG] from='client.265455 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:18:09.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:18:08 smithi086 bash[24289]: cluster 2024-09-16T10:18:07.744392+0000 mgr.a (mgr.14373) 12153 : cluster [DBG] pgmap v8428: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-16T10:18:09.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:18:08 smithi047 bash[22744]: audit 2024-09-16T10:18:07.272358+0000 mgr.a (mgr.14373) 12152 : audit [DBG] from='client.265455 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:18:09.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:18:08 smithi047 bash[22744]: cluster 2024-09-16T10:18:07.744392+0000 mgr.a (mgr.14373) 12153 : cluster [DBG] pgmap v8428: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-16T10:18:11.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:18:10 smithi157 bash[24585]: cluster 2024-09-16T10:18:09.745132+0000 mgr.a (mgr.14373) 12154 : cluster [DBG] pgmap v8429: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 4.9 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-16T10:18:11.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:18:10 smithi086 bash[24289]: cluster 2024-09-16T10:18:09.745132+0000 mgr.a (mgr.14373) 12154 : cluster [DBG] pgmap v8429: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 4.9 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-16T10:18:11.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:18:10 smithi047 bash[22744]: cluster 2024-09-16T10:18:09.745132+0000 mgr.a (mgr.14373) 12154 : cluster [DBG] pgmap v8429: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 4.9 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-16T10:18:12.716 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:18:12.717 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:18:12.717 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:18:13.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:18:12 smithi157 bash[24585]: cluster 2024-09-16T10:18:11.747107+0000 mgr.a (mgr.14373) 12155 : cluster [DBG] pgmap v8430: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-16T10:18:13.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:18:12 smithi086 bash[24289]: cluster 2024-09-16T10:18:11.747107+0000 mgr.a (mgr.14373) 12155 : cluster [DBG] pgmap v8430: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-16T10:18:13.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:18:12 smithi047 bash[22744]: cluster 2024-09-16T10:18:11.747107+0000 mgr.a (mgr.14373) 12155 : cluster [DBG] pgmap v8430: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-16T10:18:13.498 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:18:13.498 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:18:13.498 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:18:13.499 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:18:13.499 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:18:14.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:18:13 smithi157 bash[24585]: audit 2024-09-16T10:18:13.050435+0000 mgr.a (mgr.14373) 12156 : audit [DBG] from='client.265530 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:18:14.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:18:13 smithi086 bash[24289]: audit 2024-09-16T10:18:13.050435+0000 mgr.a (mgr.14373) 12156 : audit [DBG] from='client.265530 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:18:14.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:18:13 smithi047 bash[22744]: audit 2024-09-16T10:18:13.050435+0000 mgr.a (mgr.14373) 12156 : audit [DBG] from='client.265530 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:18:15.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:18:14 smithi157 bash[24585]: cluster 2024-09-16T10:18:13.748095+0000 mgr.a (mgr.14373) 12157 : cluster [DBG] pgmap v8431: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 5.7 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-16T10:18:15.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:18:14 smithi086 bash[24289]: cluster 2024-09-16T10:18:13.748095+0000 mgr.a (mgr.14373) 12157 : cluster [DBG] pgmap v8431: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 5.7 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-16T10:18:15.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:18:14 smithi047 bash[22744]: cluster 2024-09-16T10:18:13.748095+0000 mgr.a (mgr.14373) 12157 : cluster [DBG] pgmap v8431: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 5.7 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-16T10:18:17.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:18:16 smithi157 bash[24585]: cluster 2024-09-16T10:18:15.748904+0000 mgr.a (mgr.14373) 12158 : cluster [DBG] pgmap v8432: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 5.7 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-16T10:18:17.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:18:16 smithi086 bash[24289]: cluster 2024-09-16T10:18:15.748904+0000 mgr.a (mgr.14373) 12158 : cluster [DBG] pgmap v8432: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 5.7 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-16T10:18:17.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:18:16 smithi047 bash[22744]: cluster 2024-09-16T10:18:15.748904+0000 mgr.a (mgr.14373) 12158 : cluster [DBG] pgmap v8432: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 5.7 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-16T10:18:18.500 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:18:18.500 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:18:18.501 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:18:19.243 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:18:19.243 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:18:19.243 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:18:19.243 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:18:19.244 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:18:19.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:18:18 smithi157 bash[24585]: cluster 2024-09-16T10:18:17.751159+0000 mgr.a (mgr.14373) 12159 : cluster [DBG] pgmap v8433: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-16T10:18:19.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:18:18 smithi086 bash[24289]: cluster 2024-09-16T10:18:17.751159+0000 mgr.a (mgr.14373) 12159 : cluster [DBG] pgmap v8433: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-16T10:18:19.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:18:18 smithi047 bash[22744]: cluster 2024-09-16T10:18:17.751159+0000 mgr.a (mgr.14373) 12159 : cluster [DBG] pgmap v8433: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-16T10:18:20.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:18:19 smithi157 bash[24585]: audit 2024-09-16T10:18:18.832978+0000 mgr.a (mgr.14373) 12160 : audit [DBG] from='client.265605 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:18:20.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:18:19 smithi086 bash[24289]: audit 2024-09-16T10:18:18.832978+0000 mgr.a (mgr.14373) 12160 : audit [DBG] from='client.265605 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:18:20.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:18:19 smithi047 bash[22744]: audit 2024-09-16T10:18:18.832978+0000 mgr.a (mgr.14373) 12160 : audit [DBG] from='client.265605 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:18:21.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:18:20 smithi157 bash[24585]: cluster 2024-09-16T10:18:19.752144+0000 mgr.a (mgr.14373) 12161 : cluster [DBG] pgmap v8434: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:18:21.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:18:20 smithi086 bash[24289]: cluster 2024-09-16T10:18:19.752144+0000 mgr.a (mgr.14373) 12161 : cluster [DBG] pgmap v8434: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:18:21.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:18:20 smithi047 bash[22744]: cluster 2024-09-16T10:18:19.752144+0000 mgr.a (mgr.14373) 12161 : cluster [DBG] pgmap v8434: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:18:23.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:18:22 smithi157 bash[24585]: cluster 2024-09-16T10:18:21.754245+0000 mgr.a (mgr.14373) 12162 : cluster [DBG] pgmap v8435: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:18:23.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:18:22 smithi086 bash[24289]: cluster 2024-09-16T10:18:21.754245+0000 mgr.a (mgr.14373) 12162 : cluster [DBG] pgmap v8435: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:18:23.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:18:22 smithi047 bash[22744]: cluster 2024-09-16T10:18:21.754245+0000 mgr.a (mgr.14373) 12162 : cluster [DBG] pgmap v8435: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:18:24.245 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:18:24.246 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:18:24.246 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:18:25.048 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:18:25.048 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:18:25.048 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:18:25.048 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:18:25.048 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:18:25.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:18:24 smithi157 bash[24585]: cluster 2024-09-16T10:18:23.755073+0000 mgr.a (mgr.14373) 12163 : cluster [DBG] pgmap v8436: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:18:25.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:18:24 smithi086 bash[24289]: cluster 2024-09-16T10:18:23.755073+0000 mgr.a (mgr.14373) 12163 : cluster [DBG] pgmap v8436: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:18:25.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:18:24 smithi047 bash[22744]: cluster 2024-09-16T10:18:23.755073+0000 mgr.a (mgr.14373) 12163 : cluster [DBG] pgmap v8436: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:18:26.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:18:25 smithi157 bash[24585]: audit 2024-09-16T10:18:24.582088+0000 mgr.a (mgr.14373) 12164 : audit [DBG] from='client.265680 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:18:26.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:18:25 smithi086 bash[24289]: audit 2024-09-16T10:18:24.582088+0000 mgr.a (mgr.14373) 12164 : audit [DBG] from='client.265680 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:18:26.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:18:25 smithi047 bash[22744]: audit 2024-09-16T10:18:24.582088+0000 mgr.a (mgr.14373) 12164 : audit [DBG] from='client.265680 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:18:27.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:18:26 smithi157 bash[24585]: cluster 2024-09-16T10:18:25.756228+0000 mgr.a (mgr.14373) 12165 : cluster [DBG] pgmap v8437: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:18:27.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:18:26 smithi086 bash[24289]: cluster 2024-09-16T10:18:25.756228+0000 mgr.a (mgr.14373) 12165 : cluster [DBG] pgmap v8437: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:18:27.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:18:26 smithi047 bash[22744]: cluster 2024-09-16T10:18:25.756228+0000 mgr.a (mgr.14373) 12165 : cluster [DBG] pgmap v8437: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:18:29.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:18:28 smithi157 bash[24585]: cluster 2024-09-16T10:18:27.758675+0000 mgr.a (mgr.14373) 12166 : cluster [DBG] pgmap v8438: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 66 KiB/s rd, 0 B/s wr, 108 op/s 2024-09-16T10:18:29.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:18:28 smithi086 bash[24289]: cluster 2024-09-16T10:18:27.758675+0000 mgr.a (mgr.14373) 12166 : cluster [DBG] pgmap v8438: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 66 KiB/s rd, 0 B/s wr, 108 op/s 2024-09-16T10:18:29.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:18:28 smithi047 bash[22744]: cluster 2024-09-16T10:18:27.758675+0000 mgr.a (mgr.14373) 12166 : cluster [DBG] pgmap v8438: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 66 KiB/s rd, 0 B/s wr, 108 op/s 2024-09-16T10:18:30.049 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:18:30.050 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:18:30.050 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:18:30.789 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:18:30.789 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:18:30.789 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:18:30.789 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:18:30.789 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:18:31.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:18:30 smithi157 bash[24585]: cluster 2024-09-16T10:18:29.759625+0000 mgr.a (mgr.14373) 12167 : cluster [DBG] pgmap v8439: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 65 KiB/s rd, 0 B/s wr, 107 op/s 2024-09-16T10:18:31.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:18:30 smithi086 bash[24289]: cluster 2024-09-16T10:18:29.759625+0000 mgr.a (mgr.14373) 12167 : cluster [DBG] pgmap v8439: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 65 KiB/s rd, 0 B/s wr, 107 op/s 2024-09-16T10:18:31.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:18:30 smithi047 bash[22744]: cluster 2024-09-16T10:18:29.759625+0000 mgr.a (mgr.14373) 12167 : cluster [DBG] pgmap v8439: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 65 KiB/s rd, 0 B/s wr, 107 op/s 2024-09-16T10:18:32.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:18:31 smithi157 bash[24585]: audit 2024-09-16T10:18:30.371595+0000 mgr.a (mgr.14373) 12168 : audit [DBG] from='client.265758 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:18:32.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:18:31 smithi086 bash[24289]: audit 2024-09-16T10:18:30.371595+0000 mgr.a (mgr.14373) 12168 : audit [DBG] from='client.265758 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:18:32.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:18:31 smithi047 bash[22744]: audit 2024-09-16T10:18:30.371595+0000 mgr.a (mgr.14373) 12168 : audit [DBG] from='client.265758 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:18:33.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:18:33 smithi157 bash[24585]: cluster 2024-09-16T10:18:31.761974+0000 mgr.a (mgr.14373) 12169 : cluster [DBG] pgmap v8440: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 66 KiB/s rd, 0 B/s wr, 108 op/s 2024-09-16T10:18:33.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:18:33 smithi086 bash[24289]: cluster 2024-09-16T10:18:31.761974+0000 mgr.a (mgr.14373) 12169 : cluster [DBG] pgmap v8440: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 66 KiB/s rd, 0 B/s wr, 108 op/s 2024-09-16T10:18:33.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:18:33 smithi047 bash[22744]: cluster 2024-09-16T10:18:31.761974+0000 mgr.a (mgr.14373) 12169 : cluster [DBG] pgmap v8440: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 66 KiB/s rd, 0 B/s wr, 108 op/s 2024-09-16T10:18:35.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:18:35 smithi157 bash[24585]: cluster 2024-09-16T10:18:33.762821+0000 mgr.a (mgr.14373) 12170 : cluster [DBG] pgmap v8441: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 65 KiB/s rd, 0 B/s wr, 107 op/s 2024-09-16T10:18:35.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:18:35 smithi086 bash[24289]: cluster 2024-09-16T10:18:33.762821+0000 mgr.a (mgr.14373) 12170 : cluster [DBG] pgmap v8441: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 65 KiB/s rd, 0 B/s wr, 107 op/s 2024-09-16T10:18:35.344 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:18:35 smithi047 bash[22744]: cluster 2024-09-16T10:18:33.762821+0000 mgr.a (mgr.14373) 12170 : cluster [DBG] pgmap v8441: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 65 KiB/s rd, 0 B/s wr, 107 op/s 2024-09-16T10:18:35.791 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:18:35.791 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:18:35.792 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:18:36.582 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:18:36.582 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:18:36.582 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:18:36.583 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:18:36.583 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:18:37.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:18:37 smithi157 bash[24585]: cluster 2024-09-16T10:18:35.763722+0000 mgr.a (mgr.14373) 12171 : cluster [DBG] pgmap v8442: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 65 KiB/s rd, 0 B/s wr, 107 op/s 2024-09-16T10:18:37.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:18:37 smithi157 bash[24585]: audit 2024-09-16T10:18:36.125557+0000 mgr.a (mgr.14373) 12172 : audit [DBG] from='client.265836 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:18:37.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:18:37 smithi086 bash[24289]: cluster 2024-09-16T10:18:35.763722+0000 mgr.a (mgr.14373) 12171 : cluster [DBG] pgmap v8442: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 65 KiB/s rd, 0 B/s wr, 107 op/s 2024-09-16T10:18:37.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:18:37 smithi086 bash[24289]: audit 2024-09-16T10:18:36.125557+0000 mgr.a (mgr.14373) 12172 : audit [DBG] from='client.265836 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:18:37.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:18:37 smithi047 bash[22744]: cluster 2024-09-16T10:18:35.763722+0000 mgr.a (mgr.14373) 12171 : cluster [DBG] pgmap v8442: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 65 KiB/s rd, 0 B/s wr, 107 op/s 2024-09-16T10:18:37.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:18:37 smithi047 bash[22744]: audit 2024-09-16T10:18:36.125557+0000 mgr.a (mgr.14373) 12172 : audit [DBG] from='client.265836 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:18:39.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:18:39 smithi157 bash[24585]: cluster 2024-09-16T10:18:37.766215+0000 mgr.a (mgr.14373) 12173 : cluster [DBG] pgmap v8443: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 66 KiB/s rd, 0 B/s wr, 107 op/s 2024-09-16T10:18:39.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:18:39 smithi157 bash[24585]: audit 2024-09-16T10:18:38.374618+0000 mon.b (mon.2) 1118 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T10:18:39.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:18:39 smithi086 bash[24289]: cluster 2024-09-16T10:18:37.766215+0000 mgr.a (mgr.14373) 12173 : cluster [DBG] pgmap v8443: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 66 KiB/s rd, 0 B/s wr, 107 op/s 2024-09-16T10:18:39.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:18:39 smithi086 bash[24289]: audit 2024-09-16T10:18:38.374618+0000 mon.b (mon.2) 1118 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T10:18:39.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:18:39 smithi047 bash[22744]: cluster 2024-09-16T10:18:37.766215+0000 mgr.a (mgr.14373) 12173 : cluster [DBG] pgmap v8443: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 66 KiB/s rd, 0 B/s wr, 107 op/s 2024-09-16T10:18:39.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:18:39 smithi047 bash[22744]: audit 2024-09-16T10:18:38.374618+0000 mon.b (mon.2) 1118 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T10:18:40.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:18:40 smithi157 bash[24585]: audit 2024-09-16T10:18:39.210289+0000 mon.b (mon.2) 1119 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T10:18:40.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:18:40 smithi157 bash[24585]: audit 2024-09-16T10:18:39.212545+0000 mon.b (mon.2) 1120 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T10:18:40.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:18:40 smithi157 bash[24585]: audit 2024-09-16T10:18:39.223922+0000 mon.a (mon.0) 1299 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:18:40.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:18:40 smithi157 bash[24585]: audit 2024-09-16T10:18:39.228919+0000 mon.b (mon.2) 1121 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:18:40.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:18:40 smithi086 bash[24289]: audit 2024-09-16T10:18:39.210289+0000 mon.b (mon.2) 1119 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T10:18:40.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:18:40 smithi086 bash[24289]: audit 2024-09-16T10:18:39.212545+0000 mon.b (mon.2) 1120 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T10:18:40.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:18:40 smithi086 bash[24289]: audit 2024-09-16T10:18:39.223922+0000 mon.a (mon.0) 1299 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:18:40.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:18:40 smithi086 bash[24289]: audit 2024-09-16T10:18:39.228919+0000 mon.b (mon.2) 1121 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:18:40.342 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 10:18:39 smithi047 bash[22994]: debug 2024-09-16T10:18:39.958+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T10:18:40.343 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 10:18:39 smithi047 bash[22994]: debug 2024-09-16T10:18:39.958+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T10:18:40.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:18:40 smithi047 bash[22744]: audit 2024-09-16T10:18:39.210289+0000 mon.b (mon.2) 1119 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T10:18:40.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:18:40 smithi047 bash[22744]: audit 2024-09-16T10:18:39.212545+0000 mon.b (mon.2) 1120 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T10:18:40.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:18:40 smithi047 bash[22744]: audit 2024-09-16T10:18:39.223922+0000 mon.a (mon.0) 1299 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:18:40.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:18:40 smithi047 bash[22744]: audit 2024-09-16T10:18:39.228919+0000 mon.b (mon.2) 1121 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:18:41.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:18:41 smithi157 bash[24585]: audit 2024-09-16T10:18:39.231520+0000 mgr.a (mgr.14373) 12174 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:18:41.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:18:41 smithi157 bash[24585]: cluster 2024-09-16T10:18:39.766853+0000 mgr.a (mgr.14373) 12175 : cluster [DBG] pgmap v8444: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T10:18:41.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:18:41 smithi157 bash[24585]: audit 2024-09-16T10:18:39.959026+0000 mgr.a (mgr.14373) 12176 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T10:18:41.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:18:41 smithi157 bash[24585]: cephadm 2024-09-16T10:18:39.961211+0000 mgr.a (mgr.14373) 12177 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T10:18:41.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:18:41 smithi086 bash[24289]: audit 2024-09-16T10:18:39.231520+0000 mgr.a (mgr.14373) 12174 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:18:41.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:18:41 smithi086 bash[24289]: cluster 2024-09-16T10:18:39.766853+0000 mgr.a (mgr.14373) 12175 : cluster [DBG] pgmap v8444: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T10:18:41.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:18:41 smithi086 bash[24289]: audit 2024-09-16T10:18:39.959026+0000 mgr.a (mgr.14373) 12176 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T10:18:41.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:18:41 smithi086 bash[24289]: cephadm 2024-09-16T10:18:39.961211+0000 mgr.a (mgr.14373) 12177 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T10:18:41.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:18:41 smithi047 bash[22744]: audit 2024-09-16T10:18:39.231520+0000 mgr.a (mgr.14373) 12174 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:18:41.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:18:41 smithi047 bash[22744]: cluster 2024-09-16T10:18:39.766853+0000 mgr.a (mgr.14373) 12175 : cluster [DBG] pgmap v8444: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T10:18:41.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:18:41 smithi047 bash[22744]: audit 2024-09-16T10:18:39.959026+0000 mgr.a (mgr.14373) 12176 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T10:18:41.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:18:41 smithi047 bash[22744]: cephadm 2024-09-16T10:18:39.961211+0000 mgr.a (mgr.14373) 12177 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T10:18:41.584 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:18:41.584 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:18:41.584 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:18:42.341 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:18:42.341 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:18:42.341 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:18:42.341 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:18:42.342 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:18:43.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:18:43 smithi157 bash[24585]: cluster 2024-09-16T10:18:41.769001+0000 mgr.a (mgr.14373) 12178 : cluster [DBG] pgmap v8445: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:18:43.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:18:43 smithi157 bash[24585]: audit 2024-09-16T10:18:41.915094+0000 mgr.a (mgr.14373) 12179 : audit [DBG] from='client.266016 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:18:43.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:18:43 smithi086 bash[24289]: cluster 2024-09-16T10:18:41.769001+0000 mgr.a (mgr.14373) 12178 : cluster [DBG] pgmap v8445: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:18:43.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:18:43 smithi086 bash[24289]: audit 2024-09-16T10:18:41.915094+0000 mgr.a (mgr.14373) 12179 : audit [DBG] from='client.266016 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:18:43.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:18:43 smithi047 bash[22744]: cluster 2024-09-16T10:18:41.769001+0000 mgr.a (mgr.14373) 12178 : cluster [DBG] pgmap v8445: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:18:43.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:18:43 smithi047 bash[22744]: audit 2024-09-16T10:18:41.915094+0000 mgr.a (mgr.14373) 12179 : audit [DBG] from='client.266016 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:18:45.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:18:45 smithi157 bash[24585]: cluster 2024-09-16T10:18:43.769921+0000 mgr.a (mgr.14373) 12180 : cluster [DBG] pgmap v8446: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T10:18:45.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:18:45 smithi086 bash[24289]: cluster 2024-09-16T10:18:43.769921+0000 mgr.a (mgr.14373) 12180 : cluster [DBG] pgmap v8446: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T10:18:45.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:18:45 smithi047 bash[22744]: cluster 2024-09-16T10:18:43.769921+0000 mgr.a (mgr.14373) 12180 : cluster [DBG] pgmap v8446: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T10:18:47.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:18:47 smithi157 bash[24585]: cluster 2024-09-16T10:18:45.770746+0000 mgr.a (mgr.14373) 12181 : cluster [DBG] pgmap v8447: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T10:18:47.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:18:47 smithi086 bash[24289]: cluster 2024-09-16T10:18:45.770746+0000 mgr.a (mgr.14373) 12181 : cluster [DBG] pgmap v8447: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T10:18:47.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:18:47 smithi047 bash[22744]: cluster 2024-09-16T10:18:45.770746+0000 mgr.a (mgr.14373) 12181 : cluster [DBG] pgmap v8447: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T10:18:47.343 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:18:47.343 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:18:47.343 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:18:48.125 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:18:48.125 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:18:48.126 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:18:48.126 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:18:48.126 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:18:49.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:18:49 smithi157 bash[24585]: audit 2024-09-16T10:18:47.678930+0000 mgr.a (mgr.14373) 12182 : audit [DBG] from='client.266094 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:18:49.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:18:49 smithi157 bash[24585]: cluster 2024-09-16T10:18:47.772096+0000 mgr.a (mgr.14373) 12183 : cluster [DBG] pgmap v8448: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:18:49.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:18:49 smithi086 bash[24289]: audit 2024-09-16T10:18:47.678930+0000 mgr.a (mgr.14373) 12182 : audit [DBG] from='client.266094 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:18:49.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:18:49 smithi086 bash[24289]: cluster 2024-09-16T10:18:47.772096+0000 mgr.a (mgr.14373) 12183 : cluster [DBG] pgmap v8448: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:18:49.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:18:49 smithi047 bash[22744]: audit 2024-09-16T10:18:47.678930+0000 mgr.a (mgr.14373) 12182 : audit [DBG] from='client.266094 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:18:49.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:18:49 smithi047 bash[22744]: cluster 2024-09-16T10:18:47.772096+0000 mgr.a (mgr.14373) 12183 : cluster [DBG] pgmap v8448: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:18:51.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:18:51 smithi157 bash[24585]: cluster 2024-09-16T10:18:49.772928+0000 mgr.a (mgr.14373) 12184 : cluster [DBG] pgmap v8449: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T10:18:51.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:18:51 smithi086 bash[24289]: cluster 2024-09-16T10:18:49.772928+0000 mgr.a (mgr.14373) 12184 : cluster [DBG] pgmap v8449: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T10:18:51.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:18:51 smithi047 bash[22744]: cluster 2024-09-16T10:18:49.772928+0000 mgr.a (mgr.14373) 12184 : cluster [DBG] pgmap v8449: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T10:18:53.126 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:18:53.127 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:18:53.127 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:18:53.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:18:53 smithi157 bash[24585]: cluster 2024-09-16T10:18:51.775083+0000 mgr.a (mgr.14373) 12185 : cluster [DBG] pgmap v8450: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.4 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:18:53.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:18:53 smithi086 bash[24289]: cluster 2024-09-16T10:18:51.775083+0000 mgr.a (mgr.14373) 12185 : cluster [DBG] pgmap v8450: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.4 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:18:53.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:18:53 smithi047 bash[22744]: cluster 2024-09-16T10:18:51.775083+0000 mgr.a (mgr.14373) 12185 : cluster [DBG] pgmap v8450: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.4 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:18:53.852 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:18:53.852 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:18:53.852 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:18:53.852 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:18:53.853 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:18:55.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:18:55 smithi157 bash[24585]: audit 2024-09-16T10:18:53.445948+0000 mgr.a (mgr.14373) 12186 : audit [DBG] from='client.266169 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:18:55.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:18:55 smithi157 bash[24585]: cluster 2024-09-16T10:18:53.775598+0000 mgr.a (mgr.14373) 12187 : cluster [DBG] pgmap v8451: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:18:55.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:18:55 smithi086 bash[24289]: audit 2024-09-16T10:18:53.445948+0000 mgr.a (mgr.14373) 12186 : audit [DBG] from='client.266169 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:18:55.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:18:55 smithi086 bash[24289]: cluster 2024-09-16T10:18:53.775598+0000 mgr.a (mgr.14373) 12187 : cluster [DBG] pgmap v8451: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:18:55.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:18:55 smithi047 bash[22744]: audit 2024-09-16T10:18:53.445948+0000 mgr.a (mgr.14373) 12186 : audit [DBG] from='client.266169 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:18:55.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:18:55 smithi047 bash[22744]: cluster 2024-09-16T10:18:53.775598+0000 mgr.a (mgr.14373) 12187 : cluster [DBG] pgmap v8451: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:18:56.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:18:56 smithi157 bash[24585]: cluster 2024-09-16T10:18:55.776339+0000 mgr.a (mgr.14373) 12188 : cluster [DBG] pgmap v8452: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:18:56.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:18:56 smithi086 bash[24289]: cluster 2024-09-16T10:18:55.776339+0000 mgr.a (mgr.14373) 12188 : cluster [DBG] pgmap v8452: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:18:56.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:18:56 smithi047 bash[22744]: cluster 2024-09-16T10:18:55.776339+0000 mgr.a (mgr.14373) 12188 : cluster [DBG] pgmap v8452: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:18:58.854 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:18:58.854 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:18:58.854 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:18:59.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:18:58 smithi047 bash[22744]: cluster 2024-09-16T10:18:57.778564+0000 mgr.a (mgr.14373) 12189 : cluster [DBG] pgmap v8453: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:18:59.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:18:58 smithi157 bash[24585]: cluster 2024-09-16T10:18:57.778564+0000 mgr.a (mgr.14373) 12189 : cluster [DBG] pgmap v8453: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:18:59.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:18:58 smithi086 bash[24289]: cluster 2024-09-16T10:18:57.778564+0000 mgr.a (mgr.14373) 12189 : cluster [DBG] pgmap v8453: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:18:59.637 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:18:59.638 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:18:59.638 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:18:59.638 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:18:59.638 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:19:00.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:18:59 smithi157 bash[24585]: audit 2024-09-16T10:18:59.188435+0000 mgr.a (mgr.14373) 12190 : audit [DBG] from='client.266247 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:19:00.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:18:59 smithi086 bash[24289]: audit 2024-09-16T10:18:59.188435+0000 mgr.a (mgr.14373) 12190 : audit [DBG] from='client.266247 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:19:00.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:18:59 smithi047 bash[22744]: audit 2024-09-16T10:18:59.188435+0000 mgr.a (mgr.14373) 12190 : audit [DBG] from='client.266247 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:19:01.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:19:00 smithi157 bash[24585]: cluster 2024-09-16T10:18:59.779499+0000 mgr.a (mgr.14373) 12191 : cluster [DBG] pgmap v8454: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:19:01.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:19:00 smithi086 bash[24289]: cluster 2024-09-16T10:18:59.779499+0000 mgr.a (mgr.14373) 12191 : cluster [DBG] pgmap v8454: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:19:01.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:19:00 smithi047 bash[22744]: cluster 2024-09-16T10:18:59.779499+0000 mgr.a (mgr.14373) 12191 : cluster [DBG] pgmap v8454: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:19:03.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:19:02 smithi157 bash[24585]: cluster 2024-09-16T10:19:01.781666+0000 mgr.a (mgr.14373) 12192 : cluster [DBG] pgmap v8455: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:19:03.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:19:02 smithi086 bash[24289]: cluster 2024-09-16T10:19:01.781666+0000 mgr.a (mgr.14373) 12192 : cluster [DBG] pgmap v8455: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:19:03.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:19:02 smithi047 bash[22744]: cluster 2024-09-16T10:19:01.781666+0000 mgr.a (mgr.14373) 12192 : cluster [DBG] pgmap v8455: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:19:04.640 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:19:04.641 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:19:04.641 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:19:05.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:19:04 smithi157 bash[24585]: cluster 2024-09-16T10:19:03.782439+0000 mgr.a (mgr.14373) 12193 : cluster [DBG] pgmap v8456: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:19:05.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:19:04 smithi086 bash[24289]: cluster 2024-09-16T10:19:03.782439+0000 mgr.a (mgr.14373) 12193 : cluster [DBG] pgmap v8456: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:19:05.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:19:04 smithi047 bash[22744]: cluster 2024-09-16T10:19:03.782439+0000 mgr.a (mgr.14373) 12193 : cluster [DBG] pgmap v8456: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:19:05.412 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:19:05.413 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:19:05.413 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:19:05.413 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:19:05.413 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:19:06.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:19:05 smithi157 bash[24585]: audit 2024-09-16T10:19:04.973736+0000 mgr.a (mgr.14373) 12194 : audit [DBG] from='client.266325 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:19:06.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:19:05 smithi086 bash[24289]: audit 2024-09-16T10:19:04.973736+0000 mgr.a (mgr.14373) 12194 : audit [DBG] from='client.266325 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:19:06.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:19:05 smithi047 bash[22744]: audit 2024-09-16T10:19:04.973736+0000 mgr.a (mgr.14373) 12194 : audit [DBG] from='client.266325 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:19:07.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:19:06 smithi157 bash[24585]: cluster 2024-09-16T10:19:05.783389+0000 mgr.a (mgr.14373) 12195 : cluster [DBG] pgmap v8457: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:19:07.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:19:06 smithi086 bash[24289]: cluster 2024-09-16T10:19:05.783389+0000 mgr.a (mgr.14373) 12195 : cluster [DBG] pgmap v8457: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:19:07.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:19:06 smithi047 bash[22744]: cluster 2024-09-16T10:19:05.783389+0000 mgr.a (mgr.14373) 12195 : cluster [DBG] pgmap v8457: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:19:09.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:19:08 smithi157 bash[24585]: cluster 2024-09-16T10:19:07.785621+0000 mgr.a (mgr.14373) 12196 : cluster [DBG] pgmap v8458: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:19:09.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:19:08 smithi086 bash[24289]: cluster 2024-09-16T10:19:07.785621+0000 mgr.a (mgr.14373) 12196 : cluster [DBG] pgmap v8458: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:19:09.344 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:19:08 smithi047 bash[22744]: cluster 2024-09-16T10:19:07.785621+0000 mgr.a (mgr.14373) 12196 : cluster [DBG] pgmap v8458: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:19:10.414 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:19:10.415 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:19:10.415 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:19:11.189 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:19:11.189 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:19:11.190 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:19:11.190 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:19:11.190 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:19:11.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:19:10 smithi157 bash[24585]: cluster 2024-09-16T10:19:09.786384+0000 mgr.a (mgr.14373) 12197 : cluster [DBG] pgmap v8459: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:19:11.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:19:10 smithi086 bash[24289]: cluster 2024-09-16T10:19:09.786384+0000 mgr.a (mgr.14373) 12197 : cluster [DBG] pgmap v8459: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:19:11.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:19:10 smithi047 bash[22744]: cluster 2024-09-16T10:19:09.786384+0000 mgr.a (mgr.14373) 12197 : cluster [DBG] pgmap v8459: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:19:12.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:19:11 smithi157 bash[24585]: audit 2024-09-16T10:19:10.748284+0000 mgr.a (mgr.14373) 12198 : audit [DBG] from='client.266403 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:19:12.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:19:11 smithi086 bash[24289]: audit 2024-09-16T10:19:10.748284+0000 mgr.a (mgr.14373) 12198 : audit [DBG] from='client.266403 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:19:12.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:19:11 smithi047 bash[22744]: audit 2024-09-16T10:19:10.748284+0000 mgr.a (mgr.14373) 12198 : audit [DBG] from='client.266403 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:19:13.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:19:12 smithi157 bash[24585]: cluster 2024-09-16T10:19:11.788690+0000 mgr.a (mgr.14373) 12199 : cluster [DBG] pgmap v8460: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:19:13.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:19:12 smithi086 bash[24289]: cluster 2024-09-16T10:19:11.788690+0000 mgr.a (mgr.14373) 12199 : cluster [DBG] pgmap v8460: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:19:13.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:19:12 smithi047 bash[22744]: cluster 2024-09-16T10:19:11.788690+0000 mgr.a (mgr.14373) 12199 : cluster [DBG] pgmap v8460: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:19:15.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:19:14 smithi157 bash[24585]: cluster 2024-09-16T10:19:13.789402+0000 mgr.a (mgr.14373) 12200 : cluster [DBG] pgmap v8461: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:19:15.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:19:14 smithi086 bash[24289]: cluster 2024-09-16T10:19:13.789402+0000 mgr.a (mgr.14373) 12200 : cluster [DBG] pgmap v8461: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:19:15.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:19:14 smithi047 bash[22744]: cluster 2024-09-16T10:19:13.789402+0000 mgr.a (mgr.14373) 12200 : cluster [DBG] pgmap v8461: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:19:16.191 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:19:16.191 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:19:16.191 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:19:16.952 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:19:16.953 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:19:16.953 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:19:16.953 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:19:16.953 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:19:17.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:19:16 smithi157 bash[24585]: cluster 2024-09-16T10:19:15.790157+0000 mgr.a (mgr.14373) 12201 : cluster [DBG] pgmap v8462: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:19:17.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:19:16 smithi086 bash[24289]: cluster 2024-09-16T10:19:15.790157+0000 mgr.a (mgr.14373) 12201 : cluster [DBG] pgmap v8462: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:19:17.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:19:16 smithi047 bash[22744]: cluster 2024-09-16T10:19:15.790157+0000 mgr.a (mgr.14373) 12201 : cluster [DBG] pgmap v8462: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:19:18.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:19:17 smithi157 bash[24585]: audit 2024-09-16T10:19:16.522705+0000 mgr.a (mgr.14373) 12202 : audit [DBG] from='client.266481 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:19:18.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:19:17 smithi086 bash[24289]: audit 2024-09-16T10:19:16.522705+0000 mgr.a (mgr.14373) 12202 : audit [DBG] from='client.266481 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:19:18.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:19:17 smithi047 bash[22744]: audit 2024-09-16T10:19:16.522705+0000 mgr.a (mgr.14373) 12202 : audit [DBG] from='client.266481 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:19:19.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:19:18 smithi157 bash[24585]: cluster 2024-09-16T10:19:17.792803+0000 mgr.a (mgr.14373) 12203 : cluster [DBG] pgmap v8463: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-16T10:19:19.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:19:18 smithi086 bash[24289]: cluster 2024-09-16T10:19:17.792803+0000 mgr.a (mgr.14373) 12203 : cluster [DBG] pgmap v8463: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-16T10:19:19.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:19:18 smithi047 bash[22744]: cluster 2024-09-16T10:19:17.792803+0000 mgr.a (mgr.14373) 12203 : cluster [DBG] pgmap v8463: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-16T10:19:21.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:19:20 smithi157 bash[24585]: cluster 2024-09-16T10:19:19.793575+0000 mgr.a (mgr.14373) 12204 : cluster [DBG] pgmap v8464: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-16T10:19:21.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:19:20 smithi086 bash[24289]: cluster 2024-09-16T10:19:19.793575+0000 mgr.a (mgr.14373) 12204 : cluster [DBG] pgmap v8464: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-16T10:19:21.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:19:20 smithi047 bash[22744]: cluster 2024-09-16T10:19:19.793575+0000 mgr.a (mgr.14373) 12204 : cluster [DBG] pgmap v8464: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-16T10:19:21.954 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:19:21.955 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:19:21.955 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:19:22.694 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:19:22.695 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:19:22.695 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:19:22.695 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:19:22.695 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:19:23.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:19:22 smithi157 bash[24585]: cluster 2024-09-16T10:19:21.795457+0000 mgr.a (mgr.14373) 12205 : cluster [DBG] pgmap v8465: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:19:23.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:19:22 smithi086 bash[24289]: cluster 2024-09-16T10:19:21.795457+0000 mgr.a (mgr.14373) 12205 : cluster [DBG] pgmap v8465: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:19:23.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:19:22 smithi047 bash[22744]: cluster 2024-09-16T10:19:21.795457+0000 mgr.a (mgr.14373) 12205 : cluster [DBG] pgmap v8465: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:19:24.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:19:23 smithi157 bash[24585]: audit 2024-09-16T10:19:22.281717+0000 mgr.a (mgr.14373) 12206 : audit [DBG] from='client.266559 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:19:24.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:19:23 smithi086 bash[24289]: audit 2024-09-16T10:19:22.281717+0000 mgr.a (mgr.14373) 12206 : audit [DBG] from='client.266559 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:19:24.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:19:23 smithi047 bash[22744]: audit 2024-09-16T10:19:22.281717+0000 mgr.a (mgr.14373) 12206 : audit [DBG] from='client.266559 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:19:25.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:19:24 smithi157 bash[24585]: cluster 2024-09-16T10:19:23.796471+0000 mgr.a (mgr.14373) 12207 : cluster [DBG] pgmap v8466: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:19:25.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:19:24 smithi086 bash[24289]: cluster 2024-09-16T10:19:23.796471+0000 mgr.a (mgr.14373) 12207 : cluster [DBG] pgmap v8466: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:19:25.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:19:24 smithi047 bash[22744]: cluster 2024-09-16T10:19:23.796471+0000 mgr.a (mgr.14373) 12207 : cluster [DBG] pgmap v8466: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:19:27.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:19:26 smithi157 bash[24585]: cluster 2024-09-16T10:19:25.797268+0000 mgr.a (mgr.14373) 12208 : cluster [DBG] pgmap v8467: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T10:19:27.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:19:26 smithi086 bash[24289]: cluster 2024-09-16T10:19:25.797268+0000 mgr.a (mgr.14373) 12208 : cluster [DBG] pgmap v8467: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T10:19:27.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:19:26 smithi047 bash[22744]: cluster 2024-09-16T10:19:25.797268+0000 mgr.a (mgr.14373) 12208 : cluster [DBG] pgmap v8467: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T10:19:27.696 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:19:27.697 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:19:27.697 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:19:28.445 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:19:28.446 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:19:28.446 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:19:28.446 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:19:28.446 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:19:29.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:19:28 smithi157 bash[24585]: cluster 2024-09-16T10:19:27.798574+0000 mgr.a (mgr.14373) 12209 : cluster [DBG] pgmap v8468: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:19:29.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:19:28 smithi157 bash[24585]: audit 2024-09-16T10:19:28.023785+0000 mgr.a (mgr.14373) 12210 : audit [DBG] from='client.266637 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:19:29.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:19:28 smithi086 bash[24289]: cluster 2024-09-16T10:19:27.798574+0000 mgr.a (mgr.14373) 12209 : cluster [DBG] pgmap v8468: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:19:29.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:19:28 smithi086 bash[24289]: audit 2024-09-16T10:19:28.023785+0000 mgr.a (mgr.14373) 12210 : audit [DBG] from='client.266637 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:19:29.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:19:28 smithi047 bash[22744]: cluster 2024-09-16T10:19:27.798574+0000 mgr.a (mgr.14373) 12209 : cluster [DBG] pgmap v8468: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:19:29.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:19:28 smithi047 bash[22744]: audit 2024-09-16T10:19:28.023785+0000 mgr.a (mgr.14373) 12210 : audit [DBG] from='client.266637 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:19:31.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:19:30 smithi157 bash[24585]: cluster 2024-09-16T10:19:29.799371+0000 mgr.a (mgr.14373) 12211 : cluster [DBG] pgmap v8469: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-16T10:19:31.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:19:30 smithi086 bash[24289]: cluster 2024-09-16T10:19:29.799371+0000 mgr.a (mgr.14373) 12211 : cluster [DBG] pgmap v8469: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-16T10:19:31.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:19:30 smithi047 bash[22744]: cluster 2024-09-16T10:19:29.799371+0000 mgr.a (mgr.14373) 12211 : cluster [DBG] pgmap v8469: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-16T10:19:33.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:19:32 smithi157 bash[24585]: cluster 2024-09-16T10:19:31.801551+0000 mgr.a (mgr.14373) 12212 : cluster [DBG] pgmap v8470: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:19:33.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:19:32 smithi086 bash[24289]: cluster 2024-09-16T10:19:31.801551+0000 mgr.a (mgr.14373) 12212 : cluster [DBG] pgmap v8470: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:19:33.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:19:32 smithi047 bash[22744]: cluster 2024-09-16T10:19:31.801551+0000 mgr.a (mgr.14373) 12212 : cluster [DBG] pgmap v8470: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:19:33.447 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:19:33.448 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:19:33.448 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:19:34.193 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:19:34.193 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:19:34.193 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:19:34.193 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:19:34.193 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:19:35.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:19:34 smithi157 bash[24585]: audit 2024-09-16T10:19:33.775442+0000 mgr.a (mgr.14373) 12213 : audit [DBG] from='client.266715 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:19:35.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:19:34 smithi157 bash[24585]: cluster 2024-09-16T10:19:33.802442+0000 mgr.a (mgr.14373) 12214 : cluster [DBG] pgmap v8471: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:19:35.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:19:34 smithi086 bash[24289]: audit 2024-09-16T10:19:33.775442+0000 mgr.a (mgr.14373) 12213 : audit [DBG] from='client.266715 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:19:35.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:19:34 smithi086 bash[24289]: cluster 2024-09-16T10:19:33.802442+0000 mgr.a (mgr.14373) 12214 : cluster [DBG] pgmap v8471: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:19:35.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:19:34 smithi047 bash[22744]: audit 2024-09-16T10:19:33.775442+0000 mgr.a (mgr.14373) 12213 : audit [DBG] from='client.266715 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:19:35.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:19:34 smithi047 bash[22744]: cluster 2024-09-16T10:19:33.802442+0000 mgr.a (mgr.14373) 12214 : cluster [DBG] pgmap v8471: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:19:37.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:19:36 smithi157 bash[24585]: cluster 2024-09-16T10:19:35.803355+0000 mgr.a (mgr.14373) 12215 : cluster [DBG] pgmap v8472: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:19:37.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:19:36 smithi086 bash[24289]: cluster 2024-09-16T10:19:35.803355+0000 mgr.a (mgr.14373) 12215 : cluster [DBG] pgmap v8472: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:19:37.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:19:36 smithi047 bash[22744]: cluster 2024-09-16T10:19:35.803355+0000 mgr.a (mgr.14373) 12215 : cluster [DBG] pgmap v8472: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:19:39.195 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:19:39.196 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:19:39.196 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:19:39.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:19:38 smithi157 bash[24585]: cluster 2024-09-16T10:19:37.805602+0000 mgr.a (mgr.14373) 12216 : cluster [DBG] pgmap v8473: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:19:39.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:19:38 smithi086 bash[24289]: cluster 2024-09-16T10:19:37.805602+0000 mgr.a (mgr.14373) 12216 : cluster [DBG] pgmap v8473: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:19:39.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:19:38 smithi047 bash[22744]: cluster 2024-09-16T10:19:37.805602+0000 mgr.a (mgr.14373) 12216 : cluster [DBG] pgmap v8473: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:19:39.980 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:19:39.981 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:19:39.981 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:19:39.981 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:19:39.982 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:19:41.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:19:40 smithi157 bash[24585]: audit 2024-09-16T10:19:39.526640+0000 mgr.a (mgr.14373) 12217 : audit [DBG] from='client.266790 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:19:41.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:19:40 smithi157 bash[24585]: cluster 2024-09-16T10:19:39.806256+0000 mgr.a (mgr.14373) 12218 : cluster [DBG] pgmap v8474: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:19:41.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:19:40 smithi157 bash[24585]: audit 2024-09-16T10:19:40.012440+0000 mon.b (mon.2) 1122 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T10:19:41.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:19:40 smithi157 bash[24585]: audit 2024-09-16T10:19:40.801252+0000 mon.b (mon.2) 1123 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T10:19:41.308 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:19:40 smithi157 bash[24585]: audit 2024-09-16T10:19:40.803840+0000 mon.b (mon.2) 1124 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T10:19:41.308 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:19:40 smithi157 bash[24585]: audit 2024-09-16T10:19:40.815870+0000 mon.a (mon.0) 1300 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:19:41.308 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:19:40 smithi157 bash[24585]: audit 2024-09-16T10:19:40.819027+0000 mon.b (mon.2) 1125 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:19:41.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:19:40 smithi086 bash[24289]: audit 2024-09-16T10:19:39.526640+0000 mgr.a (mgr.14373) 12217 : audit [DBG] from='client.266790 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:19:41.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:19:40 smithi086 bash[24289]: cluster 2024-09-16T10:19:39.806256+0000 mgr.a (mgr.14373) 12218 : cluster [DBG] pgmap v8474: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:19:41.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:19:40 smithi086 bash[24289]: audit 2024-09-16T10:19:40.012440+0000 mon.b (mon.2) 1122 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T10:19:41.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:19:40 smithi086 bash[24289]: audit 2024-09-16T10:19:40.801252+0000 mon.b (mon.2) 1123 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T10:19:41.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:19:40 smithi086 bash[24289]: audit 2024-09-16T10:19:40.803840+0000 mon.b (mon.2) 1124 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T10:19:41.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:19:40 smithi086 bash[24289]: audit 2024-09-16T10:19:40.815870+0000 mon.a (mon.0) 1300 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:19:41.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:19:40 smithi086 bash[24289]: audit 2024-09-16T10:19:40.819027+0000 mon.b (mon.2) 1125 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:19:41.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:19:40 smithi047 bash[22744]: audit 2024-09-16T10:19:39.526640+0000 mgr.a (mgr.14373) 12217 : audit [DBG] from='client.266790 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:19:41.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:19:40 smithi047 bash[22744]: cluster 2024-09-16T10:19:39.806256+0000 mgr.a (mgr.14373) 12218 : cluster [DBG] pgmap v8474: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:19:41.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:19:40 smithi047 bash[22744]: audit 2024-09-16T10:19:40.012440+0000 mon.b (mon.2) 1122 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T10:19:41.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:19:40 smithi047 bash[22744]: audit 2024-09-16T10:19:40.801252+0000 mon.b (mon.2) 1123 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T10:19:41.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:19:40 smithi047 bash[22744]: audit 2024-09-16T10:19:40.803840+0000 mon.b (mon.2) 1124 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T10:19:41.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:19:40 smithi047 bash[22744]: audit 2024-09-16T10:19:40.815870+0000 mon.a (mon.0) 1300 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:19:41.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:19:40 smithi047 bash[22744]: audit 2024-09-16T10:19:40.819027+0000 mon.b (mon.2) 1125 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:19:41.842 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 10:19:41 smithi047 bash[22994]: debug 2024-09-16T10:19:41.580+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T10:19:41.843 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 10:19:41 smithi047 bash[22994]: debug 2024-09-16T10:19:41.584+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T10:19:42.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:19:41 smithi157 bash[24585]: audit 2024-09-16T10:19:40.822021+0000 mgr.a (mgr.14373) 12219 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:19:42.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:19:41 smithi086 bash[24289]: audit 2024-09-16T10:19:40.822021+0000 mgr.a (mgr.14373) 12219 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:19:42.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:19:41 smithi047 bash[22744]: audit 2024-09-16T10:19:40.822021+0000 mgr.a (mgr.14373) 12219 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:19:43.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:19:42 smithi157 bash[24585]: audit 2024-09-16T10:19:41.583893+0000 mgr.a (mgr.14373) 12220 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T10:19:43.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:19:42 smithi157 bash[24585]: cephadm 2024-09-16T10:19:41.586531+0000 mgr.a (mgr.14373) 12221 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T10:19:43.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:19:42 smithi157 bash[24585]: cluster 2024-09-16T10:19:41.808563+0000 mgr.a (mgr.14373) 12222 : cluster [DBG] pgmap v8475: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:19:43.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:19:42 smithi086 bash[24289]: audit 2024-09-16T10:19:41.583893+0000 mgr.a (mgr.14373) 12220 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T10:19:43.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:19:42 smithi086 bash[24289]: cephadm 2024-09-16T10:19:41.586531+0000 mgr.a (mgr.14373) 12221 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T10:19:43.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:19:42 smithi086 bash[24289]: cluster 2024-09-16T10:19:41.808563+0000 mgr.a (mgr.14373) 12222 : cluster [DBG] pgmap v8475: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:19:43.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:19:42 smithi047 bash[22744]: audit 2024-09-16T10:19:41.583893+0000 mgr.a (mgr.14373) 12220 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T10:19:43.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:19:42 smithi047 bash[22744]: cephadm 2024-09-16T10:19:41.586531+0000 mgr.a (mgr.14373) 12221 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T10:19:43.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:19:42 smithi047 bash[22744]: cluster 2024-09-16T10:19:41.808563+0000 mgr.a (mgr.14373) 12222 : cluster [DBG] pgmap v8475: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:19:44.982 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:19:44.982 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:19:44.983 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:19:45.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:19:44 smithi157 bash[24585]: cluster 2024-09-16T10:19:43.809344+0000 mgr.a (mgr.14373) 12223 : cluster [DBG] pgmap v8476: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:19:45.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:19:44 smithi086 bash[24289]: cluster 2024-09-16T10:19:43.809344+0000 mgr.a (mgr.14373) 12223 : cluster [DBG] pgmap v8476: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:19:45.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:19:44 smithi047 bash[22744]: cluster 2024-09-16T10:19:43.809344+0000 mgr.a (mgr.14373) 12223 : cluster [DBG] pgmap v8476: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:19:45.768 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:19:45.769 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:19:45.769 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:19:45.769 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:19:45.769 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:19:47.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:19:46 smithi157 bash[24585]: audit 2024-09-16T10:19:45.323807+0000 mgr.a (mgr.14373) 12224 : audit [DBG] from='client.266970 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:19:47.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:19:46 smithi157 bash[24585]: cluster 2024-09-16T10:19:45.809927+0000 mgr.a (mgr.14373) 12225 : cluster [DBG] pgmap v8477: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:19:47.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:19:46 smithi086 bash[24289]: audit 2024-09-16T10:19:45.323807+0000 mgr.a (mgr.14373) 12224 : audit [DBG] from='client.266970 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:19:47.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:19:46 smithi086 bash[24289]: cluster 2024-09-16T10:19:45.809927+0000 mgr.a (mgr.14373) 12225 : cluster [DBG] pgmap v8477: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:19:47.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:19:46 smithi047 bash[22744]: audit 2024-09-16T10:19:45.323807+0000 mgr.a (mgr.14373) 12224 : audit [DBG] from='client.266970 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:19:47.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:19:46 smithi047 bash[22744]: cluster 2024-09-16T10:19:45.809927+0000 mgr.a (mgr.14373) 12225 : cluster [DBG] pgmap v8477: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:19:49.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:19:48 smithi157 bash[24585]: cluster 2024-09-16T10:19:47.812128+0000 mgr.a (mgr.14373) 12226 : cluster [DBG] pgmap v8478: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:19:49.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:19:48 smithi086 bash[24289]: cluster 2024-09-16T10:19:47.812128+0000 mgr.a (mgr.14373) 12226 : cluster [DBG] pgmap v8478: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:19:49.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:19:48 smithi047 bash[22744]: cluster 2024-09-16T10:19:47.812128+0000 mgr.a (mgr.14373) 12226 : cluster [DBG] pgmap v8478: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:19:50.770 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:19:50.771 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:19:50.771 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:19:51.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:19:50 smithi157 bash[24585]: cluster 2024-09-16T10:19:49.812857+0000 mgr.a (mgr.14373) 12227 : cluster [DBG] pgmap v8479: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:19:51.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:19:50 smithi086 bash[24289]: cluster 2024-09-16T10:19:49.812857+0000 mgr.a (mgr.14373) 12227 : cluster [DBG] pgmap v8479: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:19:51.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:19:50 smithi047 bash[22744]: cluster 2024-09-16T10:19:49.812857+0000 mgr.a (mgr.14373) 12227 : cluster [DBG] pgmap v8479: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:19:51.530 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:19:51.530 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:19:51.530 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:19:51.530 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:19:51.530 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:19:52.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:19:52 smithi157 bash[24585]: audit 2024-09-16T10:19:51.100683+0000 mgr.a (mgr.14373) 12228 : audit [DBG] from='client.267045 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:19:52.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:19:52 smithi086 bash[24289]: audit 2024-09-16T10:19:51.100683+0000 mgr.a (mgr.14373) 12228 : audit [DBG] from='client.267045 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:19:52.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:19:52 smithi047 bash[22744]: audit 2024-09-16T10:19:51.100683+0000 mgr.a (mgr.14373) 12228 : audit [DBG] from='client.267045 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:19:53.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:19:53 smithi157 bash[24585]: cluster 2024-09-16T10:19:51.815252+0000 mgr.a (mgr.14373) 12229 : cluster [DBG] pgmap v8480: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:19:53.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:19:53 smithi086 bash[24289]: cluster 2024-09-16T10:19:51.815252+0000 mgr.a (mgr.14373) 12229 : cluster [DBG] pgmap v8480: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:19:53.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:19:53 smithi047 bash[22744]: cluster 2024-09-16T10:19:51.815252+0000 mgr.a (mgr.14373) 12229 : cluster [DBG] pgmap v8480: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:19:55.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:19:55 smithi157 bash[24585]: cluster 2024-09-16T10:19:53.816042+0000 mgr.a (mgr.14373) 12230 : cluster [DBG] pgmap v8481: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:19:55.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:19:55 smithi086 bash[24289]: cluster 2024-09-16T10:19:53.816042+0000 mgr.a (mgr.14373) 12230 : cluster [DBG] pgmap v8481: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:19:55.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:19:55 smithi047 bash[22744]: cluster 2024-09-16T10:19:53.816042+0000 mgr.a (mgr.14373) 12230 : cluster [DBG] pgmap v8481: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:19:56.531 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:19:56.532 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:19:56.532 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:19:57.292 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:19:57.292 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:19:57.292 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:19:57.292 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:19:57.292 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:19:57.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:19:57 smithi157 bash[24585]: cluster 2024-09-16T10:19:55.816818+0000 mgr.a (mgr.14373) 12231 : cluster [DBG] pgmap v8482: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:19:57.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:19:57 smithi086 bash[24289]: cluster 2024-09-16T10:19:55.816818+0000 mgr.a (mgr.14373) 12231 : cluster [DBG] pgmap v8482: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:19:57.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:19:57 smithi047 bash[22744]: cluster 2024-09-16T10:19:55.816818+0000 mgr.a (mgr.14373) 12231 : cluster [DBG] pgmap v8482: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:19:58.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:19:58 smithi157 bash[24585]: audit 2024-09-16T10:19:56.865980+0000 mgr.a (mgr.14373) 12232 : audit [DBG] from='client.267123 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:19:58.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:19:58 smithi086 bash[24289]: audit 2024-09-16T10:19:56.865980+0000 mgr.a (mgr.14373) 12232 : audit [DBG] from='client.267123 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:19:58.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:19:58 smithi047 bash[22744]: audit 2024-09-16T10:19:56.865980+0000 mgr.a (mgr.14373) 12232 : audit [DBG] from='client.267123 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:19:59.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:19:59 smithi157 bash[24585]: cluster 2024-09-16T10:19:57.819586+0000 mgr.a (mgr.14373) 12233 : cluster [DBG] pgmap v8483: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:19:59.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:19:59 smithi086 bash[24289]: cluster 2024-09-16T10:19:57.819586+0000 mgr.a (mgr.14373) 12233 : cluster [DBG] pgmap v8483: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:19:59.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:19:59 smithi047 bash[22744]: cluster 2024-09-16T10:19:57.819586+0000 mgr.a (mgr.14373) 12233 : cluster [DBG] pgmap v8483: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:20:00.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:20:00 smithi157 bash[24585]: cluster 2024-09-16T10:20:00.000132+0000 mon.a (mon.0) 1301 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-16T10:20:00.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:20:00 smithi086 bash[24289]: cluster 2024-09-16T10:20:00.000132+0000 mon.a (mon.0) 1301 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-16T10:20:00.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:20:00 smithi047 bash[22744]: cluster 2024-09-16T10:20:00.000132+0000 mon.a (mon.0) 1301 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-16T10:20:01.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:20:01 smithi157 bash[24585]: cluster 2024-09-16T10:19:59.820455+0000 mgr.a (mgr.14373) 12234 : cluster [DBG] pgmap v8484: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:20:01.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:20:01 smithi086 bash[24289]: cluster 2024-09-16T10:19:59.820455+0000 mgr.a (mgr.14373) 12234 : cluster [DBG] pgmap v8484: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:20:01.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:20:01 smithi047 bash[22744]: cluster 2024-09-16T10:19:59.820455+0000 mgr.a (mgr.14373) 12234 : cluster [DBG] pgmap v8484: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:20:02.293 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:20:02.294 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:20:02.294 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:20:03.081 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:20:03.081 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:20:03.082 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:20:03.082 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:20:03.082 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:20:03.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:20:03 smithi157 bash[24585]: cluster 2024-09-16T10:20:01.822641+0000 mgr.a (mgr.14373) 12235 : cluster [DBG] pgmap v8485: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:20:03.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:20:03 smithi086 bash[24289]: cluster 2024-09-16T10:20:01.822641+0000 mgr.a (mgr.14373) 12235 : cluster [DBG] pgmap v8485: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:20:03.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:20:03 smithi047 bash[22744]: cluster 2024-09-16T10:20:01.822641+0000 mgr.a (mgr.14373) 12235 : cluster [DBG] pgmap v8485: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:20:04.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:20:04 smithi157 bash[24585]: audit 2024-09-16T10:20:02.627393+0000 mgr.a (mgr.14373) 12236 : audit [DBG] from='client.267201 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:20:04.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:20:04 smithi086 bash[24289]: audit 2024-09-16T10:20:02.627393+0000 mgr.a (mgr.14373) 12236 : audit [DBG] from='client.267201 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:20:04.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:20:04 smithi047 bash[22744]: audit 2024-09-16T10:20:02.627393+0000 mgr.a (mgr.14373) 12236 : audit [DBG] from='client.267201 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:20:05.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:20:05 smithi157 bash[24585]: cluster 2024-09-16T10:20:03.823684+0000 mgr.a (mgr.14373) 12237 : cluster [DBG] pgmap v8486: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:20:05.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:20:05 smithi086 bash[24289]: cluster 2024-09-16T10:20:03.823684+0000 mgr.a (mgr.14373) 12237 : cluster [DBG] pgmap v8486: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:20:05.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:20:05 smithi047 bash[22744]: cluster 2024-09-16T10:20:03.823684+0000 mgr.a (mgr.14373) 12237 : cluster [DBG] pgmap v8486: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:20:07.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:20:07 smithi157 bash[24585]: cluster 2024-09-16T10:20:05.824616+0000 mgr.a (mgr.14373) 12238 : cluster [DBG] pgmap v8487: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T10:20:07.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:20:07 smithi086 bash[24289]: cluster 2024-09-16T10:20:05.824616+0000 mgr.a (mgr.14373) 12238 : cluster [DBG] pgmap v8487: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T10:20:07.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:20:07 smithi047 bash[22744]: cluster 2024-09-16T10:20:05.824616+0000 mgr.a (mgr.14373) 12238 : cluster [DBG] pgmap v8487: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T10:20:08.083 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:20:08.083 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:20:08.083 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:20:08.842 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:20:08.842 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:20:08.842 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:20:08.842 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:20:08.843 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:20:09.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:20:09 smithi086 bash[24289]: cluster 2024-09-16T10:20:07.827008+0000 mgr.a (mgr.14373) 12239 : cluster [DBG] pgmap v8488: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:20:09.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:20:09 smithi047 bash[22744]: cluster 2024-09-16T10:20:07.827008+0000 mgr.a (mgr.14373) 12239 : cluster [DBG] pgmap v8488: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:20:09.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:20:09 smithi157 bash[24585]: cluster 2024-09-16T10:20:07.827008+0000 mgr.a (mgr.14373) 12239 : cluster [DBG] pgmap v8488: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:20:10.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:20:10 smithi086 bash[24289]: audit 2024-09-16T10:20:08.412426+0000 mgr.a (mgr.14373) 12240 : audit [DBG] from='client.267279 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:20:10.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:20:10 smithi047 bash[22744]: audit 2024-09-16T10:20:08.412426+0000 mgr.a (mgr.14373) 12240 : audit [DBG] from='client.267279 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:20:10.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:20:10 smithi157 bash[24585]: audit 2024-09-16T10:20:08.412426+0000 mgr.a (mgr.14373) 12240 : audit [DBG] from='client.267279 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:20:11.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:20:11 smithi047 bash[22744]: cluster 2024-09-16T10:20:09.827937+0000 mgr.a (mgr.14373) 12241 : cluster [DBG] pgmap v8489: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:20:11.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:20:11 smithi157 bash[24585]: cluster 2024-09-16T10:20:09.827937+0000 mgr.a (mgr.14373) 12241 : cluster [DBG] pgmap v8489: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:20:11.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:20:11 smithi086 bash[24289]: cluster 2024-09-16T10:20:09.827937+0000 mgr.a (mgr.14373) 12241 : cluster [DBG] pgmap v8489: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:20:13.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:20:13 smithi047 bash[22744]: cluster 2024-09-16T10:20:11.830360+0000 mgr.a (mgr.14373) 12242 : cluster [DBG] pgmap v8490: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:20:13.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:20:13 smithi157 bash[24585]: cluster 2024-09-16T10:20:11.830360+0000 mgr.a (mgr.14373) 12242 : cluster [DBG] pgmap v8490: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:20:13.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:20:13 smithi086 bash[24289]: cluster 2024-09-16T10:20:11.830360+0000 mgr.a (mgr.14373) 12242 : cluster [DBG] pgmap v8490: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:20:13.844 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:20:13.844 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:20:13.844 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:20:14.627 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:20:14.627 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:20:14.628 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:20:14.628 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:20:14.628 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:20:15.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:20:15 smithi047 bash[22744]: cluster 2024-09-16T10:20:13.831123+0000 mgr.a (mgr.14373) 12243 : cluster [DBG] pgmap v8491: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:20:15.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:20:15 smithi047 bash[22744]: audit 2024-09-16T10:20:14.181039+0000 mgr.a (mgr.14373) 12244 : audit [DBG] from='client.267357 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:20:15.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:20:15 smithi157 bash[24585]: cluster 2024-09-16T10:20:13.831123+0000 mgr.a (mgr.14373) 12243 : cluster [DBG] pgmap v8491: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:20:15.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:20:15 smithi157 bash[24585]: audit 2024-09-16T10:20:14.181039+0000 mgr.a (mgr.14373) 12244 : audit [DBG] from='client.267357 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:20:15.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:20:15 smithi086 bash[24289]: cluster 2024-09-16T10:20:13.831123+0000 mgr.a (mgr.14373) 12243 : cluster [DBG] pgmap v8491: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:20:15.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:20:15 smithi086 bash[24289]: audit 2024-09-16T10:20:14.181039+0000 mgr.a (mgr.14373) 12244 : audit [DBG] from='client.267357 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:20:17.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:20:17 smithi047 bash[22744]: cluster 2024-09-16T10:20:15.832026+0000 mgr.a (mgr.14373) 12245 : cluster [DBG] pgmap v8492: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:20:17.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:20:17 smithi157 bash[24585]: cluster 2024-09-16T10:20:15.832026+0000 mgr.a (mgr.14373) 12245 : cluster [DBG] pgmap v8492: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:20:17.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:20:17 smithi086 bash[24289]: cluster 2024-09-16T10:20:15.832026+0000 mgr.a (mgr.14373) 12245 : cluster [DBG] pgmap v8492: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:20:19.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:20:19 smithi047 bash[22744]: cluster 2024-09-16T10:20:17.834264+0000 mgr.a (mgr.14373) 12246 : cluster [DBG] pgmap v8493: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:20:19.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:20:19 smithi157 bash[24585]: cluster 2024-09-16T10:20:17.834264+0000 mgr.a (mgr.14373) 12246 : cluster [DBG] pgmap v8493: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:20:19.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:20:19 smithi086 bash[24289]: cluster 2024-09-16T10:20:17.834264+0000 mgr.a (mgr.14373) 12246 : cluster [DBG] pgmap v8493: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:20:19.629 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:20:19.630 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:20:19.630 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:20:20.399 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:20:20.399 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:20:20.399 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:20:20.399 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:20:20.399 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:20:21.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:20:21 smithi047 bash[22744]: cluster 2024-09-16T10:20:19.835060+0000 mgr.a (mgr.14373) 12247 : cluster [DBG] pgmap v8494: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:20:21.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:20:21 smithi047 bash[22744]: audit 2024-09-16T10:20:19.968726+0000 mgr.a (mgr.14373) 12248 : audit [DBG] from='client.267435 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:20:21.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:20:21 smithi157 bash[24585]: cluster 2024-09-16T10:20:19.835060+0000 mgr.a (mgr.14373) 12247 : cluster [DBG] pgmap v8494: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:20:21.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:20:21 smithi157 bash[24585]: audit 2024-09-16T10:20:19.968726+0000 mgr.a (mgr.14373) 12248 : audit [DBG] from='client.267435 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:20:21.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:20:21 smithi086 bash[24289]: cluster 2024-09-16T10:20:19.835060+0000 mgr.a (mgr.14373) 12247 : cluster [DBG] pgmap v8494: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:20:21.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:20:21 smithi086 bash[24289]: audit 2024-09-16T10:20:19.968726+0000 mgr.a (mgr.14373) 12248 : audit [DBG] from='client.267435 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:20:23.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:20:23 smithi157 bash[24585]: cluster 2024-09-16T10:20:21.837598+0000 mgr.a (mgr.14373) 12249 : cluster [DBG] pgmap v8495: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:20:23.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:20:23 smithi086 bash[24289]: cluster 2024-09-16T10:20:21.837598+0000 mgr.a (mgr.14373) 12249 : cluster [DBG] pgmap v8495: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:20:23.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:20:23 smithi047 bash[22744]: cluster 2024-09-16T10:20:21.837598+0000 mgr.a (mgr.14373) 12249 : cluster [DBG] pgmap v8495: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:20:25.400 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:20:25.401 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:20:25.401 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:20:25.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:20:25 smithi157 bash[24585]: cluster 2024-09-16T10:20:23.838426+0000 mgr.a (mgr.14373) 12250 : cluster [DBG] pgmap v8496: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:20:25.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:20:25 smithi086 bash[24289]: cluster 2024-09-16T10:20:23.838426+0000 mgr.a (mgr.14373) 12250 : cluster [DBG] pgmap v8496: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:20:25.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:20:25 smithi047 bash[22744]: cluster 2024-09-16T10:20:23.838426+0000 mgr.a (mgr.14373) 12250 : cluster [DBG] pgmap v8496: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:20:26.165 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:20:26.166 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:20:26.166 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:20:26.166 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:20:26.166 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:20:27.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:20:27 smithi157 bash[24585]: audit 2024-09-16T10:20:25.727837+0000 mgr.a (mgr.14373) 12251 : audit [DBG] from='client.267513 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:20:27.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:20:27 smithi157 bash[24585]: cluster 2024-09-16T10:20:25.838923+0000 mgr.a (mgr.14373) 12252 : cluster [DBG] pgmap v8497: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:20:27.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:20:27 smithi086 bash[24289]: audit 2024-09-16T10:20:25.727837+0000 mgr.a (mgr.14373) 12251 : audit [DBG] from='client.267513 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:20:27.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:20:27 smithi086 bash[24289]: cluster 2024-09-16T10:20:25.838923+0000 mgr.a (mgr.14373) 12252 : cluster [DBG] pgmap v8497: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:20:27.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:20:27 smithi047 bash[22744]: audit 2024-09-16T10:20:25.727837+0000 mgr.a (mgr.14373) 12251 : audit [DBG] from='client.267513 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:20:27.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:20:27 smithi047 bash[22744]: cluster 2024-09-16T10:20:25.838923+0000 mgr.a (mgr.14373) 12252 : cluster [DBG] pgmap v8497: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:20:29.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:20:29 smithi157 bash[24585]: cluster 2024-09-16T10:20:27.841349+0000 mgr.a (mgr.14373) 12253 : cluster [DBG] pgmap v8498: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:20:29.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:20:29 smithi086 bash[24289]: cluster 2024-09-16T10:20:27.841349+0000 mgr.a (mgr.14373) 12253 : cluster [DBG] pgmap v8498: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:20:29.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:20:29 smithi047 bash[22744]: cluster 2024-09-16T10:20:27.841349+0000 mgr.a (mgr.14373) 12253 : cluster [DBG] pgmap v8498: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:20:31.167 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:20:31.168 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:20:31.168 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:20:31.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:20:31 smithi157 bash[24585]: cluster 2024-09-16T10:20:29.842290+0000 mgr.a (mgr.14373) 12254 : cluster [DBG] pgmap v8499: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:20:31.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:20:31 smithi086 bash[24289]: cluster 2024-09-16T10:20:29.842290+0000 mgr.a (mgr.14373) 12254 : cluster [DBG] pgmap v8499: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:20:31.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:20:31 smithi047 bash[22744]: cluster 2024-09-16T10:20:29.842290+0000 mgr.a (mgr.14373) 12254 : cluster [DBG] pgmap v8499: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:20:31.941 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:20:31.942 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:20:31.942 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:20:31.942 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:20:31.942 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:20:33.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:20:33 smithi157 bash[24585]: audit 2024-09-16T10:20:31.503218+0000 mgr.a (mgr.14373) 12255 : audit [DBG] from='client.267591 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:20:33.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:20:33 smithi157 bash[24585]: cluster 2024-09-16T10:20:31.846661+0000 mgr.a (mgr.14373) 12256 : cluster [DBG] pgmap v8500: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-16T10:20:33.572 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:20:33 smithi086 bash[24289]: audit 2024-09-16T10:20:31.503218+0000 mgr.a (mgr.14373) 12255 : audit [DBG] from='client.267591 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:20:33.573 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:20:33 smithi086 bash[24289]: cluster 2024-09-16T10:20:31.846661+0000 mgr.a (mgr.14373) 12256 : cluster [DBG] pgmap v8500: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-16T10:20:33.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:20:33 smithi047 bash[22744]: audit 2024-09-16T10:20:31.503218+0000 mgr.a (mgr.14373) 12255 : audit [DBG] from='client.267591 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:20:33.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:20:33 smithi047 bash[22744]: cluster 2024-09-16T10:20:31.846661+0000 mgr.a (mgr.14373) 12256 : cluster [DBG] pgmap v8500: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-16T10:20:35.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:20:35 smithi157 bash[24585]: cluster 2024-09-16T10:20:33.847444+0000 mgr.a (mgr.14373) 12257 : cluster [DBG] pgmap v8501: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-16T10:20:35.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:20:35 smithi086 bash[24289]: cluster 2024-09-16T10:20:33.847444+0000 mgr.a (mgr.14373) 12257 : cluster [DBG] pgmap v8501: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-16T10:20:35.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:20:35 smithi047 bash[22744]: cluster 2024-09-16T10:20:33.847444+0000 mgr.a (mgr.14373) 12257 : cluster [DBG] pgmap v8501: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-16T10:20:36.943 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:20:36.944 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:20:36.945 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:20:37.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:20:37 smithi157 bash[24585]: cluster 2024-09-16T10:20:35.848209+0000 mgr.a (mgr.14373) 12258 : cluster [DBG] pgmap v8502: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-16T10:20:37.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:20:37 smithi086 bash[24289]: cluster 2024-09-16T10:20:35.848209+0000 mgr.a (mgr.14373) 12258 : cluster [DBG] pgmap v8502: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-16T10:20:37.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:20:37 smithi047 bash[22744]: cluster 2024-09-16T10:20:35.848209+0000 mgr.a (mgr.14373) 12258 : cluster [DBG] pgmap v8502: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-16T10:20:37.724 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:20:37.724 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:20:37.724 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:20:37.724 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:20:37.724 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:20:39.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:20:39 smithi157 bash[24585]: audit 2024-09-16T10:20:37.283380+0000 mgr.a (mgr.14373) 12259 : audit [DBG] from='client.267669 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:20:39.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:20:39 smithi157 bash[24585]: cluster 2024-09-16T10:20:37.850883+0000 mgr.a (mgr.14373) 12260 : cluster [DBG] pgmap v8503: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:20:39.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:20:39 smithi086 bash[24289]: audit 2024-09-16T10:20:37.283380+0000 mgr.a (mgr.14373) 12259 : audit [DBG] from='client.267669 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:20:39.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:20:39 smithi086 bash[24289]: cluster 2024-09-16T10:20:37.850883+0000 mgr.a (mgr.14373) 12260 : cluster [DBG] pgmap v8503: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:20:39.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:20:39 smithi047 bash[22744]: audit 2024-09-16T10:20:37.283380+0000 mgr.a (mgr.14373) 12259 : audit [DBG] from='client.267669 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:20:39.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:20:39 smithi047 bash[22744]: cluster 2024-09-16T10:20:37.850883+0000 mgr.a (mgr.14373) 12260 : cluster [DBG] pgmap v8503: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:20:41.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:20:41 smithi157 bash[24585]: cluster 2024-09-16T10:20:39.851623+0000 mgr.a (mgr.14373) 12261 : cluster [DBG] pgmap v8504: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:20:41.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:20:41 smithi086 bash[24289]: cluster 2024-09-16T10:20:39.851623+0000 mgr.a (mgr.14373) 12261 : cluster [DBG] pgmap v8504: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:20:41.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:20:41 smithi047 bash[22744]: cluster 2024-09-16T10:20:39.851623+0000 mgr.a (mgr.14373) 12261 : cluster [DBG] pgmap v8504: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:20:42.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:20:42 smithi157 bash[24585]: audit 2024-09-16T10:20:41.641583+0000 mon.b (mon.2) 1126 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T10:20:42.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:20:42 smithi086 bash[24289]: audit 2024-09-16T10:20:41.641583+0000 mon.b (mon.2) 1126 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T10:20:42.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:20:42 smithi047 bash[22744]: audit 2024-09-16T10:20:41.641583+0000 mon.b (mon.2) 1126 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T10:20:42.725 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:20:42.725 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:20:42.725 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:20:43.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:20:43 smithi157 bash[24585]: cluster 2024-09-16T10:20:41.853837+0000 mgr.a (mgr.14373) 12262 : cluster [DBG] pgmap v8505: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:20:43.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:20:43 smithi157 bash[24585]: audit 2024-09-16T10:20:42.479900+0000 mon.b (mon.2) 1127 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T10:20:43.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:20:43 smithi157 bash[24585]: audit 2024-09-16T10:20:42.481865+0000 mon.b (mon.2) 1128 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T10:20:43.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:20:43 smithi157 bash[24585]: audit 2024-09-16T10:20:42.493292+0000 mon.a (mon.0) 1302 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:20:43.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:20:43 smithi157 bash[24585]: audit 2024-09-16T10:20:42.499542+0000 mon.b (mon.2) 1129 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:20:43.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:20:43 smithi086 bash[24289]: cluster 2024-09-16T10:20:41.853837+0000 mgr.a (mgr.14373) 12262 : cluster [DBG] pgmap v8505: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:20:43.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:20:43 smithi086 bash[24289]: audit 2024-09-16T10:20:42.479900+0000 mon.b (mon.2) 1127 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T10:20:43.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:20:43 smithi086 bash[24289]: audit 2024-09-16T10:20:42.481865+0000 mon.b (mon.2) 1128 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T10:20:43.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:20:43 smithi086 bash[24289]: audit 2024-09-16T10:20:42.493292+0000 mon.a (mon.0) 1302 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:20:43.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:20:43 smithi086 bash[24289]: audit 2024-09-16T10:20:42.499542+0000 mon.b (mon.2) 1129 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:20:43.592 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 10:20:43 smithi047 bash[22994]: debug 2024-09-16T10:20:43.247+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T10:20:43.593 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 10:20:43 smithi047 bash[22994]: debug 2024-09-16T10:20:43.259+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T10:20:43.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:20:43 smithi047 bash[22744]: cluster 2024-09-16T10:20:41.853837+0000 mgr.a (mgr.14373) 12262 : cluster [DBG] pgmap v8505: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:20:43.597 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:20:43 smithi047 bash[22744]: audit 2024-09-16T10:20:42.479900+0000 mon.b (mon.2) 1127 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T10:20:43.597 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:20:43 smithi047 bash[22744]: audit 2024-09-16T10:20:42.481865+0000 mon.b (mon.2) 1128 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T10:20:43.597 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:20:43 smithi047 bash[22744]: audit 2024-09-16T10:20:42.493292+0000 mon.a (mon.0) 1302 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:20:43.597 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:20:43 smithi047 bash[22744]: audit 2024-09-16T10:20:42.499542+0000 mon.b (mon.2) 1129 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:20:43.654 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:20:43.654 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:20:43.654 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:20:43.654 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:20:43.654 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:20:44.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:20:44 smithi157 bash[24585]: audit 2024-09-16T10:20:42.501981+0000 mgr.a (mgr.14373) 12263 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:20:44.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:20:44 smithi157 bash[24585]: audit 2024-09-16T10:20:43.057778+0000 mgr.a (mgr.14373) 12264 : audit [DBG] from='client.267801 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:20:44.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:20:44 smithi086 bash[24289]: audit 2024-09-16T10:20:42.501981+0000 mgr.a (mgr.14373) 12263 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:20:44.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:20:44 smithi086 bash[24289]: audit 2024-09-16T10:20:43.057778+0000 mgr.a (mgr.14373) 12264 : audit [DBG] from='client.267801 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:20:44.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:20:44 smithi047 bash[22744]: audit 2024-09-16T10:20:42.501981+0000 mgr.a (mgr.14373) 12263 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:20:44.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:20:44 smithi047 bash[22744]: audit 2024-09-16T10:20:43.057778+0000 mgr.a (mgr.14373) 12264 : audit [DBG] from='client.267801 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:20:45.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:20:45 smithi157 bash[24585]: audit 2024-09-16T10:20:43.253797+0000 mgr.a (mgr.14373) 12265 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T10:20:45.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:20:45 smithi157 bash[24585]: cephadm 2024-09-16T10:20:43.266176+0000 mgr.a (mgr.14373) 12266 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T10:20:45.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:20:45 smithi157 bash[24585]: cluster 2024-09-16T10:20:43.854779+0000 mgr.a (mgr.14373) 12267 : cluster [DBG] pgmap v8506: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-16T10:20:45.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:20:45 smithi086 bash[24289]: audit 2024-09-16T10:20:43.253797+0000 mgr.a (mgr.14373) 12265 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T10:20:45.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:20:45 smithi086 bash[24289]: cephadm 2024-09-16T10:20:43.266176+0000 mgr.a (mgr.14373) 12266 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T10:20:45.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:20:45 smithi086 bash[24289]: cluster 2024-09-16T10:20:43.854779+0000 mgr.a (mgr.14373) 12267 : cluster [DBG] pgmap v8506: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-16T10:20:45.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:20:45 smithi047 bash[22744]: audit 2024-09-16T10:20:43.253797+0000 mgr.a (mgr.14373) 12265 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T10:20:45.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:20:45 smithi047 bash[22744]: cephadm 2024-09-16T10:20:43.266176+0000 mgr.a (mgr.14373) 12266 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T10:20:45.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:20:45 smithi047 bash[22744]: cluster 2024-09-16T10:20:43.854779+0000 mgr.a (mgr.14373) 12267 : cluster [DBG] pgmap v8506: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-16T10:20:47.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:20:47 smithi157 bash[24585]: cluster 2024-09-16T10:20:45.855560+0000 mgr.a (mgr.14373) 12268 : cluster [DBG] pgmap v8507: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-16T10:20:47.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:20:47 smithi086 bash[24289]: cluster 2024-09-16T10:20:45.855560+0000 mgr.a (mgr.14373) 12268 : cluster [DBG] pgmap v8507: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-16T10:20:47.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:20:47 smithi047 bash[22744]: cluster 2024-09-16T10:20:45.855560+0000 mgr.a (mgr.14373) 12268 : cluster [DBG] pgmap v8507: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-16T10:20:48.655 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:20:48.656 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:20:48.656 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:20:49.433 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:20:49.434 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:20:49.434 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:20:49.434 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:20:49.434 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:20:49.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:20:49 smithi157 bash[24585]: cluster 2024-09-16T10:20:47.857784+0000 mgr.a (mgr.14373) 12269 : cluster [DBG] pgmap v8508: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.8 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:20:49.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:20:49 smithi086 bash[24289]: cluster 2024-09-16T10:20:47.857784+0000 mgr.a (mgr.14373) 12269 : cluster [DBG] pgmap v8508: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.8 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:20:49.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:20:49 smithi047 bash[22744]: cluster 2024-09-16T10:20:47.857784+0000 mgr.a (mgr.14373) 12269 : cluster [DBG] pgmap v8508: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.8 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:20:50.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:20:50 smithi157 bash[24585]: audit 2024-09-16T10:20:48.992057+0000 mgr.a (mgr.14373) 12270 : audit [DBG] from='client.267930 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:20:50.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:20:50 smithi086 bash[24289]: audit 2024-09-16T10:20:48.992057+0000 mgr.a (mgr.14373) 12270 : audit [DBG] from='client.267930 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:20:50.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:20:50 smithi047 bash[22744]: audit 2024-09-16T10:20:48.992057+0000 mgr.a (mgr.14373) 12270 : audit [DBG] from='client.267930 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:20:51.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:20:51 smithi157 bash[24585]: cluster 2024-09-16T10:20:49.858889+0000 mgr.a (mgr.14373) 12271 : cluster [DBG] pgmap v8509: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:20:51.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:20:51 smithi086 bash[24289]: cluster 2024-09-16T10:20:49.858889+0000 mgr.a (mgr.14373) 12271 : cluster [DBG] pgmap v8509: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:20:51.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:20:51 smithi047 bash[22744]: cluster 2024-09-16T10:20:49.858889+0000 mgr.a (mgr.14373) 12271 : cluster [DBG] pgmap v8509: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:20:53.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:20:53 smithi157 bash[24585]: cluster 2024-09-16T10:20:51.861228+0000 mgr.a (mgr.14373) 12272 : cluster [DBG] pgmap v8510: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:20:53.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:20:53 smithi086 bash[24289]: cluster 2024-09-16T10:20:51.861228+0000 mgr.a (mgr.14373) 12272 : cluster [DBG] pgmap v8510: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:20:53.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:20:53 smithi047 bash[22744]: cluster 2024-09-16T10:20:51.861228+0000 mgr.a (mgr.14373) 12272 : cluster [DBG] pgmap v8510: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:20:54.435 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:20:54.436 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:20:54.436 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:20:55.183 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:20:55.184 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:20:55.184 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:20:55.184 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:20:55.184 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:20:55.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:20:55 smithi157 bash[24585]: cluster 2024-09-16T10:20:53.862164+0000 mgr.a (mgr.14373) 12273 : cluster [DBG] pgmap v8511: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:20:55.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:20:55 smithi086 bash[24289]: cluster 2024-09-16T10:20:53.862164+0000 mgr.a (mgr.14373) 12273 : cluster [DBG] pgmap v8511: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:20:55.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:20:55 smithi047 bash[22744]: cluster 2024-09-16T10:20:53.862164+0000 mgr.a (mgr.14373) 12273 : cluster [DBG] pgmap v8511: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:20:56.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:20:56 smithi157 bash[24585]: audit 2024-09-16T10:20:54.769658+0000 mgr.a (mgr.14373) 12274 : audit [DBG] from='client.268008 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:20:56.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:20:56 smithi086 bash[24289]: audit 2024-09-16T10:20:54.769658+0000 mgr.a (mgr.14373) 12274 : audit [DBG] from='client.268008 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:20:56.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:20:56 smithi047 bash[22744]: audit 2024-09-16T10:20:54.769658+0000 mgr.a (mgr.14373) 12274 : audit [DBG] from='client.268008 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:20:57.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:20:57 smithi157 bash[24585]: cluster 2024-09-16T10:20:55.863185+0000 mgr.a (mgr.14373) 12275 : cluster [DBG] pgmap v8512: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:20:57.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:20:57 smithi086 bash[24289]: cluster 2024-09-16T10:20:55.863185+0000 mgr.a (mgr.14373) 12275 : cluster [DBG] pgmap v8512: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:20:57.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:20:57 smithi047 bash[22744]: cluster 2024-09-16T10:20:55.863185+0000 mgr.a (mgr.14373) 12275 : cluster [DBG] pgmap v8512: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:20:59.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:20:59 smithi157 bash[24585]: cluster 2024-09-16T10:20:57.865431+0000 mgr.a (mgr.14373) 12276 : cluster [DBG] pgmap v8513: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:20:59.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:20:59 smithi086 bash[24289]: cluster 2024-09-16T10:20:57.865431+0000 mgr.a (mgr.14373) 12276 : cluster [DBG] pgmap v8513: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:20:59.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:20:59 smithi047 bash[22744]: cluster 2024-09-16T10:20:57.865431+0000 mgr.a (mgr.14373) 12276 : cluster [DBG] pgmap v8513: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:21:00.185 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:21:00.185 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:21:00.185 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:21:00.937 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:21:00.937 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:21:00.937 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:21:00.937 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:21:00.938 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:21:01.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:21:01 smithi157 bash[24585]: cluster 2024-09-16T10:20:59.866192+0000 mgr.a (mgr.14373) 12277 : cluster [DBG] pgmap v8514: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:21:01.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:21:01 smithi086 bash[24289]: cluster 2024-09-16T10:20:59.866192+0000 mgr.a (mgr.14373) 12277 : cluster [DBG] pgmap v8514: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:21:01.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:21:01 smithi047 bash[22744]: cluster 2024-09-16T10:20:59.866192+0000 mgr.a (mgr.14373) 12277 : cluster [DBG] pgmap v8514: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:21:02.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:21:02 smithi157 bash[24585]: audit 2024-09-16T10:21:00.514816+0000 mgr.a (mgr.14373) 12278 : audit [DBG] from='client.268086 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:21:02.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:21:02 smithi086 bash[24289]: audit 2024-09-16T10:21:00.514816+0000 mgr.a (mgr.14373) 12278 : audit [DBG] from='client.268086 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:21:02.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:21:02 smithi047 bash[22744]: audit 2024-09-16T10:21:00.514816+0000 mgr.a (mgr.14373) 12278 : audit [DBG] from='client.268086 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:21:03.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:21:03 smithi157 bash[24585]: cluster 2024-09-16T10:21:01.868680+0000 mgr.a (mgr.14373) 12279 : cluster [DBG] pgmap v8515: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:21:03.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:21:03 smithi086 bash[24289]: cluster 2024-09-16T10:21:01.868680+0000 mgr.a (mgr.14373) 12279 : cluster [DBG] pgmap v8515: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:21:03.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:21:03 smithi047 bash[22744]: cluster 2024-09-16T10:21:01.868680+0000 mgr.a (mgr.14373) 12279 : cluster [DBG] pgmap v8515: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:21:05.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:21:05 smithi157 bash[24585]: cluster 2024-09-16T10:21:03.869654+0000 mgr.a (mgr.14373) 12280 : cluster [DBG] pgmap v8516: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:21:05.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:21:05 smithi086 bash[24289]: cluster 2024-09-16T10:21:03.869654+0000 mgr.a (mgr.14373) 12280 : cluster [DBG] pgmap v8516: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:21:05.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:21:05 smithi047 bash[22744]: cluster 2024-09-16T10:21:03.869654+0000 mgr.a (mgr.14373) 12280 : cluster [DBG] pgmap v8516: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:21:05.938 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:21:05.939 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:21:05.939 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:21:06.715 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:21:06.715 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:21:06.715 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:21:06.715 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:21:06.715 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:21:07.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:21:07 smithi157 bash[24585]: cluster 2024-09-16T10:21:05.870651+0000 mgr.a (mgr.14373) 12281 : cluster [DBG] pgmap v8517: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:21:07.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:21:07 smithi086 bash[24289]: cluster 2024-09-16T10:21:05.870651+0000 mgr.a (mgr.14373) 12281 : cluster [DBG] pgmap v8517: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:21:07.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:21:07 smithi047 bash[22744]: cluster 2024-09-16T10:21:05.870651+0000 mgr.a (mgr.14373) 12281 : cluster [DBG] pgmap v8517: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:21:08.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:21:08 smithi157 bash[24585]: audit 2024-09-16T10:21:06.273750+0000 mgr.a (mgr.14373) 12282 : audit [DBG] from='client.268161 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:21:08.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:21:08 smithi086 bash[24289]: audit 2024-09-16T10:21:06.273750+0000 mgr.a (mgr.14373) 12282 : audit [DBG] from='client.268161 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:21:08.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:21:08 smithi047 bash[22744]: audit 2024-09-16T10:21:06.273750+0000 mgr.a (mgr.14373) 12282 : audit [DBG] from='client.268161 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:21:09.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:21:09 smithi157 bash[24585]: cluster 2024-09-16T10:21:07.873109+0000 mgr.a (mgr.14373) 12283 : cluster [DBG] pgmap v8518: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-16T10:21:09.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:21:09 smithi086 bash[24289]: cluster 2024-09-16T10:21:07.873109+0000 mgr.a (mgr.14373) 12283 : cluster [DBG] pgmap v8518: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-16T10:21:09.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:21:09 smithi047 bash[22744]: cluster 2024-09-16T10:21:07.873109+0000 mgr.a (mgr.14373) 12283 : cluster [DBG] pgmap v8518: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-16T10:21:11.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:21:11 smithi157 bash[24585]: cluster 2024-09-16T10:21:09.873866+0000 mgr.a (mgr.14373) 12284 : cluster [DBG] pgmap v8519: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T10:21:11.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:21:11 smithi086 bash[24289]: cluster 2024-09-16T10:21:09.873866+0000 mgr.a (mgr.14373) 12284 : cluster [DBG] pgmap v8519: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T10:21:11.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:21:11 smithi047 bash[22744]: cluster 2024-09-16T10:21:09.873866+0000 mgr.a (mgr.14373) 12284 : cluster [DBG] pgmap v8519: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T10:21:11.716 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:21:11.717 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:21:11.717 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:21:12.473 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:21:12.473 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:21:12.474 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:21:12.474 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:21:12.474 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:21:13.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:21:13 smithi157 bash[24585]: cluster 2024-09-16T10:21:11.875760+0000 mgr.a (mgr.14373) 12285 : cluster [DBG] pgmap v8520: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:21:13.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:21:13 smithi157 bash[24585]: audit 2024-09-16T10:21:12.052854+0000 mgr.a (mgr.14373) 12286 : audit [DBG] from='client.268239 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:21:13.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:21:13 smithi086 bash[24289]: cluster 2024-09-16T10:21:11.875760+0000 mgr.a (mgr.14373) 12285 : cluster [DBG] pgmap v8520: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:21:13.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:21:13 smithi086 bash[24289]: audit 2024-09-16T10:21:12.052854+0000 mgr.a (mgr.14373) 12286 : audit [DBG] from='client.268239 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:21:13.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:21:13 smithi047 bash[22744]: cluster 2024-09-16T10:21:11.875760+0000 mgr.a (mgr.14373) 12285 : cluster [DBG] pgmap v8520: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:21:13.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:21:13 smithi047 bash[22744]: audit 2024-09-16T10:21:12.052854+0000 mgr.a (mgr.14373) 12286 : audit [DBG] from='client.268239 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:21:15.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:21:15 smithi157 bash[24585]: cluster 2024-09-16T10:21:13.876735+0000 mgr.a (mgr.14373) 12287 : cluster [DBG] pgmap v8521: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:21:15.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:21:15 smithi086 bash[24289]: cluster 2024-09-16T10:21:13.876735+0000 mgr.a (mgr.14373) 12287 : cluster [DBG] pgmap v8521: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:21:15.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:21:15 smithi047 bash[22744]: cluster 2024-09-16T10:21:13.876735+0000 mgr.a (mgr.14373) 12287 : cluster [DBG] pgmap v8521: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:21:17.475 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:21:17.476 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:21:17.476 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:21:17.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:21:17 smithi157 bash[24585]: cluster 2024-09-16T10:21:15.877511+0000 mgr.a (mgr.14373) 12288 : cluster [DBG] pgmap v8522: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T10:21:17.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:21:17 smithi086 bash[24289]: cluster 2024-09-16T10:21:15.877511+0000 mgr.a (mgr.14373) 12288 : cluster [DBG] pgmap v8522: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T10:21:17.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:21:17 smithi047 bash[22744]: cluster 2024-09-16T10:21:15.877511+0000 mgr.a (mgr.14373) 12288 : cluster [DBG] pgmap v8522: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T10:21:18.256 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:21:18.256 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:21:18.256 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:21:18.256 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:21:18.256 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:21:19.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:21:19 smithi157 bash[24585]: audit 2024-09-16T10:21:17.807433+0000 mgr.a (mgr.14373) 12289 : audit [DBG] from='client.268314 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:21:19.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:21:19 smithi157 bash[24585]: cluster 2024-09-16T10:21:17.878874+0000 mgr.a (mgr.14373) 12290 : cluster [DBG] pgmap v8523: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:21:19.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:21:19 smithi086 bash[24289]: audit 2024-09-16T10:21:17.807433+0000 mgr.a (mgr.14373) 12289 : audit [DBG] from='client.268314 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:21:19.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:21:19 smithi086 bash[24289]: cluster 2024-09-16T10:21:17.878874+0000 mgr.a (mgr.14373) 12290 : cluster [DBG] pgmap v8523: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:21:19.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:21:19 smithi047 bash[22744]: audit 2024-09-16T10:21:17.807433+0000 mgr.a (mgr.14373) 12289 : audit [DBG] from='client.268314 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:21:19.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:21:19 smithi047 bash[22744]: cluster 2024-09-16T10:21:17.878874+0000 mgr.a (mgr.14373) 12290 : cluster [DBG] pgmap v8523: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:21:20.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:21:20 smithi086 bash[24289]: cluster 2024-09-16T10:21:19.879901+0000 mgr.a (mgr.14373) 12291 : cluster [DBG] pgmap v8524: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-16T10:21:20.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:21:20 smithi047 bash[22744]: cluster 2024-09-16T10:21:19.879901+0000 mgr.a (mgr.14373) 12291 : cluster [DBG] pgmap v8524: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-16T10:21:20.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:21:20 smithi157 bash[24585]: cluster 2024-09-16T10:21:19.879901+0000 mgr.a (mgr.14373) 12291 : cluster [DBG] pgmap v8524: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-16T10:21:23.258 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:21:23.258 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:21:23.258 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:21:23.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:21:22 smithi157 bash[24585]: cluster 2024-09-16T10:21:21.882057+0000 mgr.a (mgr.14373) 12292 : cluster [DBG] pgmap v8525: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-16T10:21:23.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:21:22 smithi086 bash[24289]: cluster 2024-09-16T10:21:21.882057+0000 mgr.a (mgr.14373) 12292 : cluster [DBG] pgmap v8525: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-16T10:21:23.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:21:22 smithi047 bash[22744]: cluster 2024-09-16T10:21:21.882057+0000 mgr.a (mgr.14373) 12292 : cluster [DBG] pgmap v8525: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-16T10:21:24.008 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:21:24.009 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:21:24.009 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:21:24.009 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:21:24.009 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:21:25.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:21:24 smithi157 bash[24585]: audit 2024-09-16T10:21:23.586850+0000 mgr.a (mgr.14373) 12293 : audit [DBG] from='client.268392 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:21:25.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:21:24 smithi157 bash[24585]: cluster 2024-09-16T10:21:23.882565+0000 mgr.a (mgr.14373) 12294 : cluster [DBG] pgmap v8526: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:21:25.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:21:24 smithi086 bash[24289]: audit 2024-09-16T10:21:23.586850+0000 mgr.a (mgr.14373) 12293 : audit [DBG] from='client.268392 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:21:25.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:21:24 smithi086 bash[24289]: cluster 2024-09-16T10:21:23.882565+0000 mgr.a (mgr.14373) 12294 : cluster [DBG] pgmap v8526: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:21:25.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:21:24 smithi047 bash[22744]: audit 2024-09-16T10:21:23.586850+0000 mgr.a (mgr.14373) 12293 : audit [DBG] from='client.268392 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:21:25.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:21:24 smithi047 bash[22744]: cluster 2024-09-16T10:21:23.882565+0000 mgr.a (mgr.14373) 12294 : cluster [DBG] pgmap v8526: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:21:27.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:21:26 smithi157 bash[24585]: cluster 2024-09-16T10:21:25.883431+0000 mgr.a (mgr.14373) 12295 : cluster [DBG] pgmap v8527: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:21:27.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:21:26 smithi086 bash[24289]: cluster 2024-09-16T10:21:25.883431+0000 mgr.a (mgr.14373) 12295 : cluster [DBG] pgmap v8527: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:21:27.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:21:26 smithi047 bash[22744]: cluster 2024-09-16T10:21:25.883431+0000 mgr.a (mgr.14373) 12295 : cluster [DBG] pgmap v8527: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:21:29.010 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:21:29.010 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:21:29.011 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:21:29.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:21:28 smithi157 bash[24585]: cluster 2024-09-16T10:21:27.885672+0000 mgr.a (mgr.14373) 12296 : cluster [DBG] pgmap v8528: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:21:29.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:21:28 smithi086 bash[24289]: cluster 2024-09-16T10:21:27.885672+0000 mgr.a (mgr.14373) 12296 : cluster [DBG] pgmap v8528: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:21:29.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:21:28 smithi047 bash[22744]: cluster 2024-09-16T10:21:27.885672+0000 mgr.a (mgr.14373) 12296 : cluster [DBG] pgmap v8528: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:21:29.775 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:21:29.776 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:21:29.776 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:21:29.776 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:21:29.776 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:21:31.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:21:30 smithi157 bash[24585]: audit 2024-09-16T10:21:29.341975+0000 mgr.a (mgr.14373) 12297 : audit [DBG] from='client.268470 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:21:31.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:21:30 smithi157 bash[24585]: cluster 2024-09-16T10:21:29.886626+0000 mgr.a (mgr.14373) 12298 : cluster [DBG] pgmap v8529: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:21:31.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:21:30 smithi086 bash[24289]: audit 2024-09-16T10:21:29.341975+0000 mgr.a (mgr.14373) 12297 : audit [DBG] from='client.268470 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:21:31.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:21:30 smithi086 bash[24289]: cluster 2024-09-16T10:21:29.886626+0000 mgr.a (mgr.14373) 12298 : cluster [DBG] pgmap v8529: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:21:31.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:21:30 smithi047 bash[22744]: audit 2024-09-16T10:21:29.341975+0000 mgr.a (mgr.14373) 12297 : audit [DBG] from='client.268470 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:21:31.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:21:30 smithi047 bash[22744]: cluster 2024-09-16T10:21:29.886626+0000 mgr.a (mgr.14373) 12298 : cluster [DBG] pgmap v8529: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:21:33.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:21:32 smithi157 bash[24585]: cluster 2024-09-16T10:21:31.888814+0000 mgr.a (mgr.14373) 12299 : cluster [DBG] pgmap v8530: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:21:33.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:21:32 smithi086 bash[24289]: cluster 2024-09-16T10:21:31.888814+0000 mgr.a (mgr.14373) 12299 : cluster [DBG] pgmap v8530: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:21:33.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:21:32 smithi047 bash[22744]: cluster 2024-09-16T10:21:31.888814+0000 mgr.a (mgr.14373) 12299 : cluster [DBG] pgmap v8530: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:21:34.777 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:21:34.778 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:21:34.778 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:21:35.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:21:34 smithi157 bash[24585]: cluster 2024-09-16T10:21:33.889580+0000 mgr.a (mgr.14373) 12300 : cluster [DBG] pgmap v8531: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:21:35.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:21:34 smithi086 bash[24289]: cluster 2024-09-16T10:21:33.889580+0000 mgr.a (mgr.14373) 12300 : cluster [DBG] pgmap v8531: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:21:35.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:21:34 smithi047 bash[22744]: cluster 2024-09-16T10:21:33.889580+0000 mgr.a (mgr.14373) 12300 : cluster [DBG] pgmap v8531: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:21:35.567 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:21:35.568 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:21:35.568 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:21:35.568 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:21:35.568 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:21:36.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:21:35 smithi157 bash[24585]: audit 2024-09-16T10:21:35.113790+0000 mgr.a (mgr.14373) 12301 : audit [DBG] from='client.268548 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:21:36.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:21:35 smithi086 bash[24289]: audit 2024-09-16T10:21:35.113790+0000 mgr.a (mgr.14373) 12301 : audit [DBG] from='client.268548 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:21:36.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:21:35 smithi047 bash[22744]: audit 2024-09-16T10:21:35.113790+0000 mgr.a (mgr.14373) 12301 : audit [DBG] from='client.268548 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:21:37.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:21:36 smithi157 bash[24585]: cluster 2024-09-16T10:21:35.890584+0000 mgr.a (mgr.14373) 12302 : cluster [DBG] pgmap v8532: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:21:37.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:21:36 smithi086 bash[24289]: cluster 2024-09-16T10:21:35.890584+0000 mgr.a (mgr.14373) 12302 : cluster [DBG] pgmap v8532: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:21:37.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:21:36 smithi047 bash[22744]: cluster 2024-09-16T10:21:35.890584+0000 mgr.a (mgr.14373) 12302 : cluster [DBG] pgmap v8532: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:21:39.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:21:38 smithi157 bash[24585]: cluster 2024-09-16T10:21:37.892824+0000 mgr.a (mgr.14373) 12303 : cluster [DBG] pgmap v8533: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:21:39.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:21:38 smithi086 bash[24289]: cluster 2024-09-16T10:21:37.892824+0000 mgr.a (mgr.14373) 12303 : cluster [DBG] pgmap v8533: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:21:39.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:21:38 smithi047 bash[22744]: cluster 2024-09-16T10:21:37.892824+0000 mgr.a (mgr.14373) 12303 : cluster [DBG] pgmap v8533: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:21:40.569 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:21:40.570 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:21:40.570 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:21:41.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:21:40 smithi157 bash[24585]: cluster 2024-09-16T10:21:39.893605+0000 mgr.a (mgr.14373) 12304 : cluster [DBG] pgmap v8534: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:21:41.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:21:40 smithi086 bash[24289]: cluster 2024-09-16T10:21:39.893605+0000 mgr.a (mgr.14373) 12304 : cluster [DBG] pgmap v8534: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:21:41.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:21:40 smithi047 bash[22744]: cluster 2024-09-16T10:21:39.893605+0000 mgr.a (mgr.14373) 12304 : cluster [DBG] pgmap v8534: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:21:41.353 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:21:41.353 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:21:41.353 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:21:41.353 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:21:41.353 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:21:42.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:21:41 smithi157 bash[24585]: audit 2024-09-16T10:21:40.908547+0000 mgr.a (mgr.14373) 12305 : audit [DBG] from='client.268626 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:21:42.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:21:41 smithi086 bash[24289]: audit 2024-09-16T10:21:40.908547+0000 mgr.a (mgr.14373) 12305 : audit [DBG] from='client.268626 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:21:42.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:21:41 smithi047 bash[22744]: audit 2024-09-16T10:21:40.908547+0000 mgr.a (mgr.14373) 12305 : audit [DBG] from='client.268626 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:21:43.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:21:42 smithi157 bash[24585]: cluster 2024-09-16T10:21:41.895978+0000 mgr.a (mgr.14373) 12306 : cluster [DBG] pgmap v8535: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:21:43.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:21:42 smithi086 bash[24289]: cluster 2024-09-16T10:21:41.895978+0000 mgr.a (mgr.14373) 12306 : cluster [DBG] pgmap v8535: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:21:43.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:21:42 smithi047 bash[22744]: cluster 2024-09-16T10:21:41.895978+0000 mgr.a (mgr.14373) 12306 : cluster [DBG] pgmap v8535: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:21:44.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:21:43 smithi157 bash[24585]: audit 2024-09-16T10:21:43.320962+0000 mon.b (mon.2) 1130 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T10:21:44.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:21:43 smithi086 bash[24289]: audit 2024-09-16T10:21:43.320962+0000 mon.b (mon.2) 1130 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T10:21:44.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:21:43 smithi047 bash[22744]: audit 2024-09-16T10:21:43.320962+0000 mon.b (mon.2) 1130 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T10:21:45.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:21:45 smithi157 bash[24585]: cluster 2024-09-16T10:21:43.896513+0000 mgr.a (mgr.14373) 12307 : cluster [DBG] pgmap v8536: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:21:45.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:21:45 smithi157 bash[24585]: audit 2024-09-16T10:21:44.163026+0000 mon.b (mon.2) 1131 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T10:21:45.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:21:45 smithi157 bash[24585]: audit 2024-09-16T10:21:44.165255+0000 mon.b (mon.2) 1132 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T10:21:45.308 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:21:45 smithi157 bash[24585]: audit 2024-09-16T10:21:44.176018+0000 mon.a (mon.0) 1303 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:21:45.308 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:21:45 smithi157 bash[24585]: audit 2024-09-16T10:21:44.181661+0000 mon.b (mon.2) 1133 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:21:45.308 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:21:45 smithi157 bash[24585]: audit 2024-09-16T10:21:44.184268+0000 mgr.a (mgr.14373) 12308 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:21:45.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:21:45 smithi086 bash[24289]: cluster 2024-09-16T10:21:43.896513+0000 mgr.a (mgr.14373) 12307 : cluster [DBG] pgmap v8536: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:21:45.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:21:45 smithi086 bash[24289]: audit 2024-09-16T10:21:44.163026+0000 mon.b (mon.2) 1131 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T10:21:45.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:21:45 smithi086 bash[24289]: audit 2024-09-16T10:21:44.165255+0000 mon.b (mon.2) 1132 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T10:21:45.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:21:45 smithi086 bash[24289]: audit 2024-09-16T10:21:44.176018+0000 mon.a (mon.0) 1303 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:21:45.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:21:45 smithi086 bash[24289]: audit 2024-09-16T10:21:44.181661+0000 mon.b (mon.2) 1133 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:21:45.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:21:45 smithi086 bash[24289]: audit 2024-09-16T10:21:44.184268+0000 mgr.a (mgr.14373) 12308 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:21:45.343 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 10:21:44 smithi047 bash[22994]: debug 2024-09-16T10:21:44.954+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T10:21:45.343 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 10:21:44 smithi047 bash[22994]: debug 2024-09-16T10:21:44.958+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T10:21:45.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:21:45 smithi047 bash[22744]: cluster 2024-09-16T10:21:43.896513+0000 mgr.a (mgr.14373) 12307 : cluster [DBG] pgmap v8536: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:21:45.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:21:45 smithi047 bash[22744]: audit 2024-09-16T10:21:44.163026+0000 mon.b (mon.2) 1131 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T10:21:45.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:21:45 smithi047 bash[22744]: audit 2024-09-16T10:21:44.165255+0000 mon.b (mon.2) 1132 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T10:21:45.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:21:45 smithi047 bash[22744]: audit 2024-09-16T10:21:44.176018+0000 mon.a (mon.0) 1303 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:21:45.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:21:45 smithi047 bash[22744]: audit 2024-09-16T10:21:44.181661+0000 mon.b (mon.2) 1133 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:21:45.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:21:45 smithi047 bash[22744]: audit 2024-09-16T10:21:44.184268+0000 mgr.a (mgr.14373) 12308 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:21:46.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:21:46 smithi157 bash[24585]: audit 2024-09-16T10:21:44.956105+0000 mgr.a (mgr.14373) 12309 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T10:21:46.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:21:46 smithi157 bash[24585]: cephadm 2024-09-16T10:21:44.958370+0000 mgr.a (mgr.14373) 12310 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T10:21:46.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:21:46 smithi086 bash[24289]: audit 2024-09-16T10:21:44.956105+0000 mgr.a (mgr.14373) 12309 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T10:21:46.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:21:46 smithi086 bash[24289]: cephadm 2024-09-16T10:21:44.958370+0000 mgr.a (mgr.14373) 12310 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T10:21:46.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:21:46 smithi047 bash[22744]: audit 2024-09-16T10:21:44.956105+0000 mgr.a (mgr.14373) 12309 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T10:21:46.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:21:46 smithi047 bash[22744]: cephadm 2024-09-16T10:21:44.958370+0000 mgr.a (mgr.14373) 12310 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T10:21:46.354 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:21:46.354 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:21:46.355 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:21:47.148 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:21:47.149 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:21:47.149 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:21:47.149 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:21:47.149 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:21:47.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:21:47 smithi157 bash[24585]: cluster 2024-09-16T10:21:45.897399+0000 mgr.a (mgr.14373) 12311 : cluster [DBG] pgmap v8537: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:21:47.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:21:47 smithi086 bash[24289]: cluster 2024-09-16T10:21:45.897399+0000 mgr.a (mgr.14373) 12311 : cluster [DBG] pgmap v8537: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:21:47.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:21:47 smithi047 bash[22744]: cluster 2024-09-16T10:21:45.897399+0000 mgr.a (mgr.14373) 12311 : cluster [DBG] pgmap v8537: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:21:48.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:21:48 smithi157 bash[24585]: audit 2024-09-16T10:21:46.689865+0000 mgr.a (mgr.14373) 12312 : audit [DBG] from='client.268812 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:21:48.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:21:48 smithi086 bash[24289]: audit 2024-09-16T10:21:46.689865+0000 mgr.a (mgr.14373) 12312 : audit [DBG] from='client.268812 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:21:48.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:21:48 smithi047 bash[22744]: audit 2024-09-16T10:21:46.689865+0000 mgr.a (mgr.14373) 12312 : audit [DBG] from='client.268812 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:21:49.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:21:49 smithi157 bash[24585]: cluster 2024-09-16T10:21:47.900263+0000 mgr.a (mgr.14373) 12313 : cluster [DBG] pgmap v8538: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:21:49.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:21:49 smithi086 bash[24289]: cluster 2024-09-16T10:21:47.900263+0000 mgr.a (mgr.14373) 12313 : cluster [DBG] pgmap v8538: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:21:49.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:21:49 smithi047 bash[22744]: cluster 2024-09-16T10:21:47.900263+0000 mgr.a (mgr.14373) 12313 : cluster [DBG] pgmap v8538: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:21:51.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:21:51 smithi157 bash[24585]: cluster 2024-09-16T10:21:49.901037+0000 mgr.a (mgr.14373) 12314 : cluster [DBG] pgmap v8539: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T10:21:51.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:21:51 smithi086 bash[24289]: cluster 2024-09-16T10:21:49.901037+0000 mgr.a (mgr.14373) 12314 : cluster [DBG] pgmap v8539: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T10:21:51.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:21:51 smithi047 bash[22744]: cluster 2024-09-16T10:21:49.901037+0000 mgr.a (mgr.14373) 12314 : cluster [DBG] pgmap v8539: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T10:21:52.150 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:21:52.151 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:21:52.151 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:21:52.929 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:21:52.930 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:21:52.930 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:21:52.930 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:21:52.930 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:21:53.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:21:53 smithi157 bash[24585]: cluster 2024-09-16T10:21:51.902980+0000 mgr.a (mgr.14373) 12315 : cluster [DBG] pgmap v8540: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:21:53.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:21:53 smithi086 bash[24289]: cluster 2024-09-16T10:21:51.902980+0000 mgr.a (mgr.14373) 12315 : cluster [DBG] pgmap v8540: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:21:53.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:21:53 smithi047 bash[22744]: cluster 2024-09-16T10:21:51.902980+0000 mgr.a (mgr.14373) 12315 : cluster [DBG] pgmap v8540: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:21:54.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:21:54 smithi157 bash[24585]: audit 2024-09-16T10:21:52.481222+0000 mgr.a (mgr.14373) 12316 : audit [DBG] from='client.268887 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:21:54.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:21:54 smithi086 bash[24289]: audit 2024-09-16T10:21:52.481222+0000 mgr.a (mgr.14373) 12316 : audit [DBG] from='client.268887 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:21:54.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:21:54 smithi047 bash[22744]: audit 2024-09-16T10:21:52.481222+0000 mgr.a (mgr.14373) 12316 : audit [DBG] from='client.268887 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:21:55.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:21:55 smithi157 bash[24585]: cluster 2024-09-16T10:21:53.903942+0000 mgr.a (mgr.14373) 12317 : cluster [DBG] pgmap v8541: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T10:21:55.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:21:55 smithi086 bash[24289]: cluster 2024-09-16T10:21:53.903942+0000 mgr.a (mgr.14373) 12317 : cluster [DBG] pgmap v8541: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T10:21:55.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:21:55 smithi047 bash[22744]: cluster 2024-09-16T10:21:53.903942+0000 mgr.a (mgr.14373) 12317 : cluster [DBG] pgmap v8541: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T10:21:57.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:21:57 smithi157 bash[24585]: cluster 2024-09-16T10:21:55.904749+0000 mgr.a (mgr.14373) 12318 : cluster [DBG] pgmap v8542: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T10:21:57.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:21:57 smithi086 bash[24289]: cluster 2024-09-16T10:21:55.904749+0000 mgr.a (mgr.14373) 12318 : cluster [DBG] pgmap v8542: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T10:21:57.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:21:57 smithi047 bash[22744]: cluster 2024-09-16T10:21:55.904749+0000 mgr.a (mgr.14373) 12318 : cluster [DBG] pgmap v8542: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T10:21:57.931 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:21:57.932 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:21:57.932 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:21:58.677 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:21:58.677 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:21:58.677 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:21:58.677 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:21:58.677 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:21:59.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:21:59 smithi157 bash[24585]: cluster 2024-09-16T10:21:57.907020+0000 mgr.a (mgr.14373) 12319 : cluster [DBG] pgmap v8543: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:21:59.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:21:59 smithi157 bash[24585]: audit 2024-09-16T10:21:58.259612+0000 mgr.a (mgr.14373) 12320 : audit [DBG] from='client.268962 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:21:59.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:21:59 smithi086 bash[24289]: cluster 2024-09-16T10:21:57.907020+0000 mgr.a (mgr.14373) 12319 : cluster [DBG] pgmap v8543: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:21:59.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:21:59 smithi086 bash[24289]: audit 2024-09-16T10:21:58.259612+0000 mgr.a (mgr.14373) 12320 : audit [DBG] from='client.268962 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:21:59.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:21:59 smithi047 bash[22744]: cluster 2024-09-16T10:21:57.907020+0000 mgr.a (mgr.14373) 12319 : cluster [DBG] pgmap v8543: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:21:59.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:21:59 smithi047 bash[22744]: audit 2024-09-16T10:21:58.259612+0000 mgr.a (mgr.14373) 12320 : audit [DBG] from='client.268962 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:22:01.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:22:01 smithi086 bash[24289]: cluster 2024-09-16T10:21:59.907940+0000 mgr.a (mgr.14373) 12321 : cluster [DBG] pgmap v8544: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:22:01.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:22:01 smithi047 bash[22744]: cluster 2024-09-16T10:21:59.907940+0000 mgr.a (mgr.14373) 12321 : cluster [DBG] pgmap v8544: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:22:01.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:22:01 smithi157 bash[24585]: cluster 2024-09-16T10:21:59.907940+0000 mgr.a (mgr.14373) 12321 : cluster [DBG] pgmap v8544: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:22:03.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:22:03 smithi086 bash[24289]: cluster 2024-09-16T10:22:01.910092+0000 mgr.a (mgr.14373) 12322 : cluster [DBG] pgmap v8545: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:22:03.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:22:03 smithi047 bash[22744]: cluster 2024-09-16T10:22:01.910092+0000 mgr.a (mgr.14373) 12322 : cluster [DBG] pgmap v8545: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:22:03.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:22:03 smithi157 bash[24585]: cluster 2024-09-16T10:22:01.910092+0000 mgr.a (mgr.14373) 12322 : cluster [DBG] pgmap v8545: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:22:03.678 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:22:03.679 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:22:03.679 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:22:04.421 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:22:04.422 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:22:04.422 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:22:04.422 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:22:04.422 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:22:05.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:22:05 smithi086 bash[24289]: cluster 2024-09-16T10:22:03.910835+0000 mgr.a (mgr.14373) 12323 : cluster [DBG] pgmap v8546: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:22:05.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:22:05 smithi086 bash[24289]: audit 2024-09-16T10:22:04.009311+0000 mgr.a (mgr.14373) 12324 : audit [DBG] from='client.269040 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:22:05.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:22:05 smithi047 bash[22744]: cluster 2024-09-16T10:22:03.910835+0000 mgr.a (mgr.14373) 12323 : cluster [DBG] pgmap v8546: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:22:05.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:22:05 smithi047 bash[22744]: audit 2024-09-16T10:22:04.009311+0000 mgr.a (mgr.14373) 12324 : audit [DBG] from='client.269040 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:22:05.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:22:05 smithi157 bash[24585]: cluster 2024-09-16T10:22:03.910835+0000 mgr.a (mgr.14373) 12323 : cluster [DBG] pgmap v8546: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:22:05.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:22:05 smithi157 bash[24585]: audit 2024-09-16T10:22:04.009311+0000 mgr.a (mgr.14373) 12324 : audit [DBG] from='client.269040 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:22:06.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:22:06 smithi047 bash[22744]: cluster 2024-09-16T10:22:05.911717+0000 mgr.a (mgr.14373) 12325 : cluster [DBG] pgmap v8547: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:22:06.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:22:06 smithi157 bash[24585]: cluster 2024-09-16T10:22:05.911717+0000 mgr.a (mgr.14373) 12325 : cluster [DBG] pgmap v8547: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:22:06.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:22:06 smithi086 bash[24289]: cluster 2024-09-16T10:22:05.911717+0000 mgr.a (mgr.14373) 12325 : cluster [DBG] pgmap v8547: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:22:09.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:22:08 smithi157 bash[24585]: cluster 2024-09-16T10:22:07.913901+0000 mgr.a (mgr.14373) 12326 : cluster [DBG] pgmap v8548: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:22:09.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:22:08 smithi086 bash[24289]: cluster 2024-09-16T10:22:07.913901+0000 mgr.a (mgr.14373) 12326 : cluster [DBG] pgmap v8548: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:22:09.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:22:08 smithi047 bash[22744]: cluster 2024-09-16T10:22:07.913901+0000 mgr.a (mgr.14373) 12326 : cluster [DBG] pgmap v8548: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:22:09.423 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:22:09.424 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:22:09.424 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:22:10.213 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:22:10.213 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:22:10.214 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:22:10.214 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:22:10.214 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:22:11.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:22:10 smithi157 bash[24585]: audit 2024-09-16T10:22:09.761878+0000 mgr.a (mgr.14373) 12327 : audit [DBG] from='client.269112 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:22:11.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:22:10 smithi157 bash[24585]: cluster 2024-09-16T10:22:09.914502+0000 mgr.a (mgr.14373) 12328 : cluster [DBG] pgmap v8549: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:22:11.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:22:10 smithi086 bash[24289]: audit 2024-09-16T10:22:09.761878+0000 mgr.a (mgr.14373) 12327 : audit [DBG] from='client.269112 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:22:11.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:22:10 smithi086 bash[24289]: cluster 2024-09-16T10:22:09.914502+0000 mgr.a (mgr.14373) 12328 : cluster [DBG] pgmap v8549: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:22:11.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:22:10 smithi047 bash[22744]: audit 2024-09-16T10:22:09.761878+0000 mgr.a (mgr.14373) 12327 : audit [DBG] from='client.269112 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:22:11.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:22:10 smithi047 bash[22744]: cluster 2024-09-16T10:22:09.914502+0000 mgr.a (mgr.14373) 12328 : cluster [DBG] pgmap v8549: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:22:13.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:22:12 smithi157 bash[24585]: cluster 2024-09-16T10:22:11.916710+0000 mgr.a (mgr.14373) 12329 : cluster [DBG] pgmap v8550: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:22:13.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:22:12 smithi086 bash[24289]: cluster 2024-09-16T10:22:11.916710+0000 mgr.a (mgr.14373) 12329 : cluster [DBG] pgmap v8550: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:22:13.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:22:12 smithi047 bash[22744]: cluster 2024-09-16T10:22:11.916710+0000 mgr.a (mgr.14373) 12329 : cluster [DBG] pgmap v8550: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:22:15.214 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:22:15.215 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:22:15.215 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:22:15.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:22:14 smithi157 bash[24585]: cluster 2024-09-16T10:22:13.917490+0000 mgr.a (mgr.14373) 12330 : cluster [DBG] pgmap v8551: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:22:15.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:22:14 smithi086 bash[24289]: cluster 2024-09-16T10:22:13.917490+0000 mgr.a (mgr.14373) 12330 : cluster [DBG] pgmap v8551: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:22:15.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:22:14 smithi047 bash[22744]: cluster 2024-09-16T10:22:13.917490+0000 mgr.a (mgr.14373) 12330 : cluster [DBG] pgmap v8551: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:22:15.973 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:22:15.973 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:22:15.973 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:22:15.973 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:22:15.973 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:22:17.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:22:16 smithi157 bash[24585]: audit 2024-09-16T10:22:15.546252+0000 mgr.a (mgr.14373) 12331 : audit [DBG] from='client.269187 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:22:17.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:22:16 smithi157 bash[24585]: cluster 2024-09-16T10:22:15.918014+0000 mgr.a (mgr.14373) 12332 : cluster [DBG] pgmap v8552: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:22:17.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:22:16 smithi086 bash[24289]: audit 2024-09-16T10:22:15.546252+0000 mgr.a (mgr.14373) 12331 : audit [DBG] from='client.269187 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:22:17.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:22:16 smithi086 bash[24289]: cluster 2024-09-16T10:22:15.918014+0000 mgr.a (mgr.14373) 12332 : cluster [DBG] pgmap v8552: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:22:17.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:22:16 smithi047 bash[22744]: audit 2024-09-16T10:22:15.546252+0000 mgr.a (mgr.14373) 12331 : audit [DBG] from='client.269187 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:22:17.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:22:16 smithi047 bash[22744]: cluster 2024-09-16T10:22:15.918014+0000 mgr.a (mgr.14373) 12332 : cluster [DBG] pgmap v8552: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:22:19.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:22:18 smithi157 bash[24585]: cluster 2024-09-16T10:22:17.920264+0000 mgr.a (mgr.14373) 12333 : cluster [DBG] pgmap v8553: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:22:19.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:22:18 smithi086 bash[24289]: cluster 2024-09-16T10:22:17.920264+0000 mgr.a (mgr.14373) 12333 : cluster [DBG] pgmap v8553: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:22:19.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:22:18 smithi047 bash[22744]: cluster 2024-09-16T10:22:17.920264+0000 mgr.a (mgr.14373) 12333 : cluster [DBG] pgmap v8553: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:22:20.974 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:22:20.975 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:22:20.975 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:22:21.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:22:20 smithi157 bash[24585]: cluster 2024-09-16T10:22:19.921016+0000 mgr.a (mgr.14373) 12334 : cluster [DBG] pgmap v8554: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:22:21.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:22:20 smithi086 bash[24289]: cluster 2024-09-16T10:22:19.921016+0000 mgr.a (mgr.14373) 12334 : cluster [DBG] pgmap v8554: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:22:21.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:22:20 smithi047 bash[22744]: cluster 2024-09-16T10:22:19.921016+0000 mgr.a (mgr.14373) 12334 : cluster [DBG] pgmap v8554: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:22:21.734 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:22:21.734 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:22:21.734 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:22:21.735 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:22:21.735 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:22:23.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:22:23 smithi157 bash[24585]: audit 2024-09-16T10:22:21.305499+0000 mgr.a (mgr.14373) 12335 : audit [DBG] from='client.269265 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:22:23.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:22:23 smithi157 bash[24585]: cluster 2024-09-16T10:22:21.923426+0000 mgr.a (mgr.14373) 12336 : cluster [DBG] pgmap v8555: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-16T10:22:23.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:22:23 smithi086 bash[24289]: audit 2024-09-16T10:22:21.305499+0000 mgr.a (mgr.14373) 12335 : audit [DBG] from='client.269265 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:22:23.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:22:23 smithi086 bash[24289]: cluster 2024-09-16T10:22:21.923426+0000 mgr.a (mgr.14373) 12336 : cluster [DBG] pgmap v8555: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-16T10:22:23.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:22:22 smithi047 bash[22744]: audit 2024-09-16T10:22:21.305499+0000 mgr.a (mgr.14373) 12335 : audit [DBG] from='client.269265 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:22:23.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:22:22 smithi047 bash[22744]: cluster 2024-09-16T10:22:21.923426+0000 mgr.a (mgr.14373) 12336 : cluster [DBG] pgmap v8555: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-16T10:22:25.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:22:25 smithi157 bash[24585]: cluster 2024-09-16T10:22:23.924218+0000 mgr.a (mgr.14373) 12337 : cluster [DBG] pgmap v8556: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T10:22:25.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:22:25 smithi086 bash[24289]: cluster 2024-09-16T10:22:23.924218+0000 mgr.a (mgr.14373) 12337 : cluster [DBG] pgmap v8556: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T10:22:25.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:22:25 smithi047 bash[22744]: cluster 2024-09-16T10:22:23.924218+0000 mgr.a (mgr.14373) 12337 : cluster [DBG] pgmap v8556: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T10:22:26.735 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:22:26.736 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:22:26.736 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:22:27.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:22:27 smithi157 bash[24585]: cluster 2024-09-16T10:22:25.924979+0000 mgr.a (mgr.14373) 12338 : cluster [DBG] pgmap v8557: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T10:22:27.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:22:27 smithi086 bash[24289]: cluster 2024-09-16T10:22:25.924979+0000 mgr.a (mgr.14373) 12338 : cluster [DBG] pgmap v8557: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T10:22:27.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:22:27 smithi047 bash[22744]: cluster 2024-09-16T10:22:25.924979+0000 mgr.a (mgr.14373) 12338 : cluster [DBG] pgmap v8557: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T10:22:27.481 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:22:27.481 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:22:27.481 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:22:27.481 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:22:27.481 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:22:28.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:22:28 smithi157 bash[24585]: audit 2024-09-16T10:22:27.067672+0000 mgr.a (mgr.14373) 12339 : audit [DBG] from='client.269343 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:22:28.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:22:28 smithi086 bash[24289]: audit 2024-09-16T10:22:27.067672+0000 mgr.a (mgr.14373) 12339 : audit [DBG] from='client.269343 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:22:28.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:22:28 smithi047 bash[22744]: audit 2024-09-16T10:22:27.067672+0000 mgr.a (mgr.14373) 12339 : audit [DBG] from='client.269343 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:22:29.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:22:29 smithi157 bash[24585]: cluster 2024-09-16T10:22:27.927765+0000 mgr.a (mgr.14373) 12340 : cluster [DBG] pgmap v8558: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:22:29.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:22:29 smithi086 bash[24289]: cluster 2024-09-16T10:22:27.927765+0000 mgr.a (mgr.14373) 12340 : cluster [DBG] pgmap v8558: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:22:29.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:22:29 smithi047 bash[22744]: cluster 2024-09-16T10:22:27.927765+0000 mgr.a (mgr.14373) 12340 : cluster [DBG] pgmap v8558: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:22:31.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:22:31 smithi157 bash[24585]: cluster 2024-09-16T10:22:29.928598+0000 mgr.a (mgr.14373) 12341 : cluster [DBG] pgmap v8559: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:22:31.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:22:31 smithi086 bash[24289]: cluster 2024-09-16T10:22:29.928598+0000 mgr.a (mgr.14373) 12341 : cluster [DBG] pgmap v8559: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:22:31.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:22:31 smithi047 bash[22744]: cluster 2024-09-16T10:22:29.928598+0000 mgr.a (mgr.14373) 12341 : cluster [DBG] pgmap v8559: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:22:32.482 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:22:32.483 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:22:32.483 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:22:33.234 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:22:33.234 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:22:33.234 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:22:33.234 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:22:33.234 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:22:33.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:22:33 smithi157 bash[24585]: cluster 2024-09-16T10:22:31.930583+0000 mgr.a (mgr.14373) 12342 : cluster [DBG] pgmap v8560: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:22:33.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:22:33 smithi086 bash[24289]: cluster 2024-09-16T10:22:31.930583+0000 mgr.a (mgr.14373) 12342 : cluster [DBG] pgmap v8560: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:22:33.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:22:33 smithi047 bash[22744]: cluster 2024-09-16T10:22:31.930583+0000 mgr.a (mgr.14373) 12342 : cluster [DBG] pgmap v8560: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:22:34.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:22:34 smithi157 bash[24585]: audit 2024-09-16T10:22:32.811129+0000 mgr.a (mgr.14373) 12343 : audit [DBG] from='client.269415 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:22:34.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:22:34 smithi086 bash[24289]: audit 2024-09-16T10:22:32.811129+0000 mgr.a (mgr.14373) 12343 : audit [DBG] from='client.269415 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:22:34.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:22:34 smithi047 bash[22744]: audit 2024-09-16T10:22:32.811129+0000 mgr.a (mgr.14373) 12343 : audit [DBG] from='client.269415 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:22:35.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:22:35 smithi157 bash[24585]: cluster 2024-09-16T10:22:33.931560+0000 mgr.a (mgr.14373) 12344 : cluster [DBG] pgmap v8561: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-16T10:22:35.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:22:35 smithi086 bash[24289]: cluster 2024-09-16T10:22:33.931560+0000 mgr.a (mgr.14373) 12344 : cluster [DBG] pgmap v8561: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-16T10:22:35.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:22:35 smithi047 bash[22744]: cluster 2024-09-16T10:22:33.931560+0000 mgr.a (mgr.14373) 12344 : cluster [DBG] pgmap v8561: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-16T10:22:37.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:22:37 smithi157 bash[24585]: cluster 2024-09-16T10:22:35.932362+0000 mgr.a (mgr.14373) 12345 : cluster [DBG] pgmap v8562: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-16T10:22:37.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:22:37 smithi086 bash[24289]: cluster 2024-09-16T10:22:35.932362+0000 mgr.a (mgr.14373) 12345 : cluster [DBG] pgmap v8562: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-16T10:22:37.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:22:37 smithi047 bash[22744]: cluster 2024-09-16T10:22:35.932362+0000 mgr.a (mgr.14373) 12345 : cluster [DBG] pgmap v8562: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-16T10:22:38.235 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:22:38.236 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:22:38.236 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:22:38.974 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:22:38.974 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:22:38.974 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:22:38.974 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:22:38.975 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:22:39.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:22:39 smithi157 bash[24585]: cluster 2024-09-16T10:22:37.934612+0000 mgr.a (mgr.14373) 12346 : cluster [DBG] pgmap v8563: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-16T10:22:39.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:22:39 smithi086 bash[24289]: cluster 2024-09-16T10:22:37.934612+0000 mgr.a (mgr.14373) 12346 : cluster [DBG] pgmap v8563: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-16T10:22:39.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:22:39 smithi047 bash[22744]: cluster 2024-09-16T10:22:37.934612+0000 mgr.a (mgr.14373) 12346 : cluster [DBG] pgmap v8563: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-16T10:22:40.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:22:40 smithi157 bash[24585]: audit 2024-09-16T10:22:38.567428+0000 mgr.a (mgr.14373) 12347 : audit [DBG] from='client.269493 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:22:40.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:22:40 smithi086 bash[24289]: audit 2024-09-16T10:22:38.567428+0000 mgr.a (mgr.14373) 12347 : audit [DBG] from='client.269493 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:22:40.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:22:40 smithi047 bash[22744]: audit 2024-09-16T10:22:38.567428+0000 mgr.a (mgr.14373) 12347 : audit [DBG] from='client.269493 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:22:41.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:22:41 smithi086 bash[24289]: cluster 2024-09-16T10:22:39.935518+0000 mgr.a (mgr.14373) 12348 : cluster [DBG] pgmap v8564: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:22:41.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:22:41 smithi047 bash[22744]: cluster 2024-09-16T10:22:39.935518+0000 mgr.a (mgr.14373) 12348 : cluster [DBG] pgmap v8564: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:22:41.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:22:41 smithi157 bash[24585]: cluster 2024-09-16T10:22:39.935518+0000 mgr.a (mgr.14373) 12348 : cluster [DBG] pgmap v8564: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:22:43.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:22:43 smithi086 bash[24289]: cluster 2024-09-16T10:22:41.937634+0000 mgr.a (mgr.14373) 12349 : cluster [DBG] pgmap v8565: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:22:43.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:22:43 smithi047 bash[22744]: cluster 2024-09-16T10:22:41.937634+0000 mgr.a (mgr.14373) 12349 : cluster [DBG] pgmap v8565: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:22:43.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:22:43 smithi157 bash[24585]: cluster 2024-09-16T10:22:41.937634+0000 mgr.a (mgr.14373) 12349 : cluster [DBG] pgmap v8565: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:22:43.976 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:22:43.977 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:22:43.977 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:22:44.713 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:22:44.714 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:22:44.714 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:22:44.714 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:22:44.714 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:22:45.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:22:45 smithi086 bash[24289]: cluster 2024-09-16T10:22:43.938438+0000 mgr.a (mgr.14373) 12350 : cluster [DBG] pgmap v8566: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:22:45.335 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:22:45 smithi086 bash[24289]: audit 2024-09-16T10:22:45.017805+0000 mon.b (mon.2) 1134 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T10:22:45.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:22:45 smithi047 bash[22744]: cluster 2024-09-16T10:22:43.938438+0000 mgr.a (mgr.14373) 12350 : cluster [DBG] pgmap v8566: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:22:45.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:22:45 smithi047 bash[22744]: audit 2024-09-16T10:22:45.017805+0000 mon.b (mon.2) 1134 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T10:22:45.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:22:45 smithi157 bash[24585]: cluster 2024-09-16T10:22:43.938438+0000 mgr.a (mgr.14373) 12350 : cluster [DBG] pgmap v8566: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:22:45.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:22:45 smithi157 bash[24585]: audit 2024-09-16T10:22:45.017805+0000 mon.b (mon.2) 1134 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T10:22:46.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:22:46 smithi047 bash[22744]: audit 2024-09-16T10:22:44.294576+0000 mgr.a (mgr.14373) 12351 : audit [DBG] from='client.269571 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:22:46.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:22:46 smithi157 bash[24585]: audit 2024-09-16T10:22:44.294576+0000 mgr.a (mgr.14373) 12351 : audit [DBG] from='client.269571 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:22:46.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:22:46 smithi086 bash[24289]: audit 2024-09-16T10:22:44.294576+0000 mgr.a (mgr.14373) 12351 : audit [DBG] from='client.269571 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:22:47.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:22:47 smithi047 bash[22744]: cluster 2024-09-16T10:22:45.939297+0000 mgr.a (mgr.14373) 12352 : cluster [DBG] pgmap v8567: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:22:47.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:22:47 smithi157 bash[24585]: cluster 2024-09-16T10:22:45.939297+0000 mgr.a (mgr.14373) 12352 : cluster [DBG] pgmap v8567: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:22:47.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:22:47 smithi086 bash[24289]: cluster 2024-09-16T10:22:45.939297+0000 mgr.a (mgr.14373) 12352 : cluster [DBG] pgmap v8567: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:22:49.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:22:49 smithi047 bash[22744]: cluster 2024-09-16T10:22:47.941522+0000 mgr.a (mgr.14373) 12353 : cluster [DBG] pgmap v8568: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:22:49.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:22:49 smithi157 bash[24585]: cluster 2024-09-16T10:22:47.941522+0000 mgr.a (mgr.14373) 12353 : cluster [DBG] pgmap v8568: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:22:49.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:22:49 smithi086 bash[24289]: cluster 2024-09-16T10:22:47.941522+0000 mgr.a (mgr.14373) 12353 : cluster [DBG] pgmap v8568: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:22:49.715 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:22:49.715 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:22:49.716 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:22:50.498 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:22:50.498 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:22:50.498 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:22:50.499 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:22:50.499 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:22:51.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:22:51 smithi047 bash[22744]: cluster 2024-09-16T10:22:49.942265+0000 mgr.a (mgr.14373) 12354 : cluster [DBG] pgmap v8569: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:22:51.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:22:51 smithi047 bash[22744]: audit 2024-09-16T10:22:50.046986+0000 mgr.a (mgr.14373) 12355 : audit [DBG] from='client.269646 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:22:51.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:22:51 smithi047 bash[22744]: audit 2024-09-16T10:22:50.365721+0000 mon.a (mon.0) 1304 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:22:51.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:22:51 smithi047 bash[22744]: audit 2024-09-16T10:22:50.373278+0000 mon.a (mon.0) 1305 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:22:51.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:22:51 smithi047 bash[22744]: audit 2024-09-16T10:22:50.378711+0000 mon.a (mon.0) 1306 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:22:51.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:22:51 smithi047 bash[22744]: audit 2024-09-16T10:22:50.383819+0000 mon.a (mon.0) 1307 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:22:51.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:22:51 smithi047 bash[22744]: audit 2024-09-16T10:22:50.386633+0000 mon.a (mon.0) 1308 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:22:51.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:22:51 smithi047 bash[22744]: audit 2024-09-16T10:22:50.402683+0000 mon.a (mon.0) 1309 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:22:51.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:22:51 smithi157 bash[24585]: cluster 2024-09-16T10:22:49.942265+0000 mgr.a (mgr.14373) 12354 : cluster [DBG] pgmap v8569: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:22:51.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:22:51 smithi157 bash[24585]: audit 2024-09-16T10:22:50.046986+0000 mgr.a (mgr.14373) 12355 : audit [DBG] from='client.269646 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:22:51.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:22:51 smithi157 bash[24585]: audit 2024-09-16T10:22:50.365721+0000 mon.a (mon.0) 1304 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:22:51.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:22:51 smithi157 bash[24585]: audit 2024-09-16T10:22:50.373278+0000 mon.a (mon.0) 1305 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:22:51.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:22:51 smithi157 bash[24585]: audit 2024-09-16T10:22:50.378711+0000 mon.a (mon.0) 1306 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:22:51.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:22:51 smithi157 bash[24585]: audit 2024-09-16T10:22:50.383819+0000 mon.a (mon.0) 1307 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:22:51.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:22:51 smithi157 bash[24585]: audit 2024-09-16T10:22:50.386633+0000 mon.a (mon.0) 1308 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:22:51.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:22:51 smithi157 bash[24585]: audit 2024-09-16T10:22:50.402683+0000 mon.a (mon.0) 1309 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:22:51.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:22:51 smithi086 bash[24289]: cluster 2024-09-16T10:22:49.942265+0000 mgr.a (mgr.14373) 12354 : cluster [DBG] pgmap v8569: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:22:51.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:22:51 smithi086 bash[24289]: audit 2024-09-16T10:22:50.046986+0000 mgr.a (mgr.14373) 12355 : audit [DBG] from='client.269646 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:22:51.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:22:51 smithi086 bash[24289]: audit 2024-09-16T10:22:50.365721+0000 mon.a (mon.0) 1304 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:22:51.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:22:51 smithi086 bash[24289]: audit 2024-09-16T10:22:50.373278+0000 mon.a (mon.0) 1305 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:22:51.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:22:51 smithi086 bash[24289]: audit 2024-09-16T10:22:50.378711+0000 mon.a (mon.0) 1306 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:22:51.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:22:51 smithi086 bash[24289]: audit 2024-09-16T10:22:50.383819+0000 mon.a (mon.0) 1307 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:22:51.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:22:51 smithi086 bash[24289]: audit 2024-09-16T10:22:50.386633+0000 mon.a (mon.0) 1308 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:22:51.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:22:51 smithi086 bash[24289]: audit 2024-09-16T10:22:50.402683+0000 mon.a (mon.0) 1309 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:22:52.343 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 10:22:51 smithi047 bash[22994]: debug 2024-09-16T10:22:51.892+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T10:22:52.343 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 10:22:51 smithi047 bash[22994]: debug 2024-09-16T10:22:51.896+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T10:22:52.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:22:52 smithi047 bash[22744]: audit 2024-09-16T10:22:51.137779+0000 mon.b (mon.2) 1135 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T10:22:52.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:22:52 smithi047 bash[22744]: audit 2024-09-16T10:22:51.139669+0000 mon.b (mon.2) 1136 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T10:22:52.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:22:52 smithi047 bash[22744]: audit 2024-09-16T10:22:51.148421+0000 mon.a (mon.0) 1310 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:22:52.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:22:52 smithi047 bash[22744]: audit 2024-09-16T10:22:51.159197+0000 mon.b (mon.2) 1137 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:22:52.344 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:22:52 smithi047 bash[22744]: audit 2024-09-16T10:22:51.161920+0000 mgr.a (mgr.14373) 12356 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:22:52.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:22:52 smithi157 bash[24585]: audit 2024-09-16T10:22:51.137779+0000 mon.b (mon.2) 1135 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T10:22:52.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:22:52 smithi157 bash[24585]: audit 2024-09-16T10:22:51.139669+0000 mon.b (mon.2) 1136 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T10:22:52.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:22:52 smithi157 bash[24585]: audit 2024-09-16T10:22:51.148421+0000 mon.a (mon.0) 1310 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:22:52.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:22:52 smithi157 bash[24585]: audit 2024-09-16T10:22:51.159197+0000 mon.b (mon.2) 1137 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:22:52.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:22:52 smithi157 bash[24585]: audit 2024-09-16T10:22:51.161920+0000 mgr.a (mgr.14373) 12356 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:22:52.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:22:52 smithi086 bash[24289]: audit 2024-09-16T10:22:51.137779+0000 mon.b (mon.2) 1135 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T10:22:52.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:22:52 smithi086 bash[24289]: audit 2024-09-16T10:22:51.139669+0000 mon.b (mon.2) 1136 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T10:22:52.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:22:52 smithi086 bash[24289]: audit 2024-09-16T10:22:51.148421+0000 mon.a (mon.0) 1310 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:22:52.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:22:52 smithi086 bash[24289]: audit 2024-09-16T10:22:51.159197+0000 mon.b (mon.2) 1137 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:22:52.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:22:52 smithi086 bash[24289]: audit 2024-09-16T10:22:51.161920+0000 mgr.a (mgr.14373) 12356 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:22:53.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:22:53 smithi157 bash[24585]: audit 2024-09-16T10:22:51.895985+0000 mgr.a (mgr.14373) 12357 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T10:22:53.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:22:53 smithi157 bash[24585]: cephadm 2024-09-16T10:22:51.898375+0000 mgr.a (mgr.14373) 12358 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T10:22:53.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:22:53 smithi157 bash[24585]: cluster 2024-09-16T10:22:51.943834+0000 mgr.a (mgr.14373) 12359 : cluster [DBG] pgmap v8570: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 3.4 KiB/s rd, 3 op/s 2024-09-16T10:22:53.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:22:53 smithi086 bash[24289]: audit 2024-09-16T10:22:51.895985+0000 mgr.a (mgr.14373) 12357 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T10:22:53.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:22:53 smithi086 bash[24289]: cephadm 2024-09-16T10:22:51.898375+0000 mgr.a (mgr.14373) 12358 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T10:22:53.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:22:53 smithi086 bash[24289]: cluster 2024-09-16T10:22:51.943834+0000 mgr.a (mgr.14373) 12359 : cluster [DBG] pgmap v8570: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 3.4 KiB/s rd, 3 op/s 2024-09-16T10:22:53.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:22:53 smithi047 bash[22744]: audit 2024-09-16T10:22:51.895985+0000 mgr.a (mgr.14373) 12357 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T10:22:53.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:22:53 smithi047 bash[22744]: cephadm 2024-09-16T10:22:51.898375+0000 mgr.a (mgr.14373) 12358 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T10:22:53.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:22:53 smithi047 bash[22744]: cluster 2024-09-16T10:22:51.943834+0000 mgr.a (mgr.14373) 12359 : cluster [DBG] pgmap v8570: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 3.4 KiB/s rd, 3 op/s 2024-09-16T10:22:55.500 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:22:55.501 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:22:55.501 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:22:55.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:22:55 smithi157 bash[24585]: cluster 2024-09-16T10:22:53.944537+0000 mgr.a (mgr.14373) 12360 : cluster [DBG] pgmap v8571: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-16T10:22:55.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:22:55 smithi086 bash[24289]: cluster 2024-09-16T10:22:53.944537+0000 mgr.a (mgr.14373) 12360 : cluster [DBG] pgmap v8571: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-16T10:22:55.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:22:55 smithi047 bash[22744]: cluster 2024-09-16T10:22:53.944537+0000 mgr.a (mgr.14373) 12360 : cluster [DBG] pgmap v8571: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-16T10:22:56.288 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:22:56.288 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:22:56.288 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:22:56.288 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:22:56.289 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:22:56.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:22:56 smithi047 bash[22744]: audit 2024-09-16T10:22:55.837175+0000 mgr.a (mgr.14373) 12361 : audit [DBG] from='client.269832 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:22:56.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:22:56 smithi047 bash[22744]: cluster 2024-09-16T10:22:55.945036+0000 mgr.a (mgr.14373) 12362 : cluster [DBG] pgmap v8572: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-16T10:22:56.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:22:56 smithi157 bash[24585]: audit 2024-09-16T10:22:55.837175+0000 mgr.a (mgr.14373) 12361 : audit [DBG] from='client.269832 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:22:56.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:22:56 smithi157 bash[24585]: cluster 2024-09-16T10:22:55.945036+0000 mgr.a (mgr.14373) 12362 : cluster [DBG] pgmap v8572: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-16T10:22:56.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:22:56 smithi086 bash[24289]: audit 2024-09-16T10:22:55.837175+0000 mgr.a (mgr.14373) 12361 : audit [DBG] from='client.269832 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:22:56.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:22:56 smithi086 bash[24289]: cluster 2024-09-16T10:22:55.945036+0000 mgr.a (mgr.14373) 12362 : cluster [DBG] pgmap v8572: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-16T10:22:59.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:22:59 smithi157 bash[24585]: cluster 2024-09-16T10:22:57.947356+0000 mgr.a (mgr.14373) 12363 : cluster [DBG] pgmap v8573: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:22:59.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:22:59 smithi086 bash[24289]: cluster 2024-09-16T10:22:57.947356+0000 mgr.a (mgr.14373) 12363 : cluster [DBG] pgmap v8573: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:22:59.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:22:59 smithi047 bash[22744]: cluster 2024-09-16T10:22:57.947356+0000 mgr.a (mgr.14373) 12363 : cluster [DBG] pgmap v8573: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:23:01.290 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:23:01.290 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:23:01.290 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:23:01.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:23:01 smithi157 bash[24585]: cluster 2024-09-16T10:22:59.948133+0000 mgr.a (mgr.14373) 12364 : cluster [DBG] pgmap v8574: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:23:01.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:23:01 smithi086 bash[24289]: cluster 2024-09-16T10:22:59.948133+0000 mgr.a (mgr.14373) 12364 : cluster [DBG] pgmap v8574: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:23:01.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:23:01 smithi047 bash[22744]: cluster 2024-09-16T10:22:59.948133+0000 mgr.a (mgr.14373) 12364 : cluster [DBG] pgmap v8574: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:23:02.081 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:23:02.081 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:23:02.082 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:23:02.082 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:23:02.082 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:23:03.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:23:03 smithi157 bash[24585]: audit 2024-09-16T10:23:01.622699+0000 mgr.a (mgr.14373) 12365 : audit [DBG] from='client.269904 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:23:03.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:23:03 smithi157 bash[24585]: cluster 2024-09-16T10:23:01.949661+0000 mgr.a (mgr.14373) 12366 : cluster [DBG] pgmap v8575: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:23:03.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:23:03 smithi086 bash[24289]: audit 2024-09-16T10:23:01.622699+0000 mgr.a (mgr.14373) 12365 : audit [DBG] from='client.269904 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:23:03.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:23:03 smithi086 bash[24289]: cluster 2024-09-16T10:23:01.949661+0000 mgr.a (mgr.14373) 12366 : cluster [DBG] pgmap v8575: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:23:03.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:23:03 smithi047 bash[22744]: audit 2024-09-16T10:23:01.622699+0000 mgr.a (mgr.14373) 12365 : audit [DBG] from='client.269904 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:23:03.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:23:03 smithi047 bash[22744]: cluster 2024-09-16T10:23:01.949661+0000 mgr.a (mgr.14373) 12366 : cluster [DBG] pgmap v8575: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:23:05.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:23:05 smithi157 bash[24585]: cluster 2024-09-16T10:23:03.950545+0000 mgr.a (mgr.14373) 12367 : cluster [DBG] pgmap v8576: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 5.4 KiB/s rd, 426 B/s wr, 5 op/s 2024-09-16T10:23:05.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:23:05 smithi086 bash[24289]: cluster 2024-09-16T10:23:03.950545+0000 mgr.a (mgr.14373) 12367 : cluster [DBG] pgmap v8576: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 5.4 KiB/s rd, 426 B/s wr, 5 op/s 2024-09-16T10:23:05.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:23:05 smithi047 bash[22744]: cluster 2024-09-16T10:23:03.950545+0000 mgr.a (mgr.14373) 12367 : cluster [DBG] pgmap v8576: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 5.4 KiB/s rd, 426 B/s wr, 5 op/s 2024-09-16T10:23:07.083 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:23:07.084 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:23:07.084 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:23:07.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:23:07 smithi157 bash[24585]: cluster 2024-09-16T10:23:05.951317+0000 mgr.a (mgr.14373) 12368 : cluster [DBG] pgmap v8577: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 5.4 KiB/s rd, 426 B/s wr, 5 op/s 2024-09-16T10:23:07.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:23:07 smithi086 bash[24289]: cluster 2024-09-16T10:23:05.951317+0000 mgr.a (mgr.14373) 12368 : cluster [DBG] pgmap v8577: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 5.4 KiB/s rd, 426 B/s wr, 5 op/s 2024-09-16T10:23:07.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:23:07 smithi047 bash[22744]: cluster 2024-09-16T10:23:05.951317+0000 mgr.a (mgr.14373) 12368 : cluster [DBG] pgmap v8577: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 5.4 KiB/s rd, 426 B/s wr, 5 op/s 2024-09-16T10:23:07.826 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:23:07.826 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:23:07.826 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:23:07.826 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:23:07.826 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:23:09.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:23:09 smithi157 bash[24585]: audit 2024-09-16T10:23:07.411578+0000 mgr.a (mgr.14373) 12369 : audit [DBG] from='client.269979 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:23:09.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:23:09 smithi157 bash[24585]: cluster 2024-09-16T10:23:07.954060+0000 mgr.a (mgr.14373) 12370 : cluster [DBG] pgmap v8578: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T10:23:09.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:23:09 smithi086 bash[24289]: audit 2024-09-16T10:23:07.411578+0000 mgr.a (mgr.14373) 12369 : audit [DBG] from='client.269979 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:23:09.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:23:09 smithi086 bash[24289]: cluster 2024-09-16T10:23:07.954060+0000 mgr.a (mgr.14373) 12370 : cluster [DBG] pgmap v8578: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T10:23:09.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:23:09 smithi047 bash[22744]: audit 2024-09-16T10:23:07.411578+0000 mgr.a (mgr.14373) 12369 : audit [DBG] from='client.269979 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:23:09.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:23:09 smithi047 bash[22744]: cluster 2024-09-16T10:23:07.954060+0000 mgr.a (mgr.14373) 12370 : cluster [DBG] pgmap v8578: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T10:23:11.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:23:11 smithi157 bash[24585]: cluster 2024-09-16T10:23:09.955007+0000 mgr.a (mgr.14373) 12371 : cluster [DBG] pgmap v8579: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:23:11.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:23:11 smithi086 bash[24289]: cluster 2024-09-16T10:23:09.955007+0000 mgr.a (mgr.14373) 12371 : cluster [DBG] pgmap v8579: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:23:11.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:23:11 smithi047 bash[22744]: cluster 2024-09-16T10:23:09.955007+0000 mgr.a (mgr.14373) 12371 : cluster [DBG] pgmap v8579: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:23:12.827 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:23:12.828 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:23:12.828 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:23:13.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:23:13 smithi157 bash[24585]: cluster 2024-09-16T10:23:11.956985+0000 mgr.a (mgr.14373) 12372 : cluster [DBG] pgmap v8580: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:23:13.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:23:13 smithi086 bash[24289]: cluster 2024-09-16T10:23:11.956985+0000 mgr.a (mgr.14373) 12372 : cluster [DBG] pgmap v8580: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:23:13.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:23:13 smithi047 bash[22744]: cluster 2024-09-16T10:23:11.956985+0000 mgr.a (mgr.14373) 12372 : cluster [DBG] pgmap v8580: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:23:13.611 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:23:13.611 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:23:13.611 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:23:13.612 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:23:13.612 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:23:14.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:23:14 smithi157 bash[24585]: audit 2024-09-16T10:23:13.166437+0000 mgr.a (mgr.14373) 12373 : audit [DBG] from='client.270054 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:23:14.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:23:14 smithi086 bash[24289]: audit 2024-09-16T10:23:13.166437+0000 mgr.a (mgr.14373) 12373 : audit [DBG] from='client.270054 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:23:14.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:23:14 smithi047 bash[22744]: audit 2024-09-16T10:23:13.166437+0000 mgr.a (mgr.14373) 12373 : audit [DBG] from='client.270054 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:23:15.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:23:15 smithi157 bash[24585]: cluster 2024-09-16T10:23:13.958011+0000 mgr.a (mgr.14373) 12374 : cluster [DBG] pgmap v8581: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:23:15.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:23:15 smithi086 bash[24289]: cluster 2024-09-16T10:23:13.958011+0000 mgr.a (mgr.14373) 12374 : cluster [DBG] pgmap v8581: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:23:15.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:23:15 smithi047 bash[22744]: cluster 2024-09-16T10:23:13.958011+0000 mgr.a (mgr.14373) 12374 : cluster [DBG] pgmap v8581: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:23:17.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:23:17 smithi086 bash[24289]: cluster 2024-09-16T10:23:15.958857+0000 mgr.a (mgr.14373) 12375 : cluster [DBG] pgmap v8582: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:23:17.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:23:17 smithi047 bash[22744]: cluster 2024-09-16T10:23:15.958857+0000 mgr.a (mgr.14373) 12375 : cluster [DBG] pgmap v8582: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:23:17.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:23:17 smithi157 bash[24585]: cluster 2024-09-16T10:23:15.958857+0000 mgr.a (mgr.14373) 12375 : cluster [DBG] pgmap v8582: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:23:18.613 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:23:18.614 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:23:18.614 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:23:19.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:23:19 smithi086 bash[24289]: cluster 2024-09-16T10:23:17.961085+0000 mgr.a (mgr.14373) 12376 : cluster [DBG] pgmap v8583: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:23:19.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:23:19 smithi047 bash[22744]: cluster 2024-09-16T10:23:17.961085+0000 mgr.a (mgr.14373) 12376 : cluster [DBG] pgmap v8583: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:23:19.367 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:23:19.367 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:23:19.367 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:23:19.367 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:23:19.368 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:23:19.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:23:19 smithi157 bash[24585]: cluster 2024-09-16T10:23:17.961085+0000 mgr.a (mgr.14373) 12376 : cluster [DBG] pgmap v8583: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:23:20.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:23:20 smithi086 bash[24289]: audit 2024-09-16T10:23:18.942042+0000 mgr.a (mgr.14373) 12377 : audit [DBG] from='client.270132 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:23:20.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:23:20 smithi047 bash[22744]: audit 2024-09-16T10:23:18.942042+0000 mgr.a (mgr.14373) 12377 : audit [DBG] from='client.270132 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:23:20.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:23:20 smithi157 bash[24585]: audit 2024-09-16T10:23:18.942042+0000 mgr.a (mgr.14373) 12377 : audit [DBG] from='client.270132 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:23:21.344 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:23:21 smithi047 bash[22744]: cluster 2024-09-16T10:23:19.962068+0000 mgr.a (mgr.14373) 12378 : cluster [DBG] pgmap v8584: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:23:21.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:23:21 smithi157 bash[24585]: cluster 2024-09-16T10:23:19.962068+0000 mgr.a (mgr.14373) 12378 : cluster [DBG] pgmap v8584: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:23:21.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:23:21 smithi086 bash[24289]: cluster 2024-09-16T10:23:19.962068+0000 mgr.a (mgr.14373) 12378 : cluster [DBG] pgmap v8584: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:23:23.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:23:23 smithi047 bash[22744]: cluster 2024-09-16T10:23:21.964245+0000 mgr.a (mgr.14373) 12379 : cluster [DBG] pgmap v8585: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:23:23.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:23:23 smithi157 bash[24585]: cluster 2024-09-16T10:23:21.964245+0000 mgr.a (mgr.14373) 12379 : cluster [DBG] pgmap v8585: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:23:23.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:23:23 smithi086 bash[24289]: cluster 2024-09-16T10:23:21.964245+0000 mgr.a (mgr.14373) 12379 : cluster [DBG] pgmap v8585: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:23:24.368 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:23:24.369 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:23:24.369 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:23:25.141 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:23:25.142 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:23:25.142 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:23:25.142 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:23:25.142 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:23:25.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:23:25 smithi047 bash[22744]: cluster 2024-09-16T10:23:23.965012+0000 mgr.a (mgr.14373) 12380 : cluster [DBG] pgmap v8586: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:23:25.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:23:25 smithi157 bash[24585]: cluster 2024-09-16T10:23:23.965012+0000 mgr.a (mgr.14373) 12380 : cluster [DBG] pgmap v8586: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:23:25.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:23:25 smithi086 bash[24289]: cluster 2024-09-16T10:23:23.965012+0000 mgr.a (mgr.14373) 12380 : cluster [DBG] pgmap v8586: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:23:26.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:23:26 smithi047 bash[22744]: audit 2024-09-16T10:23:24.701777+0000 mgr.a (mgr.14373) 12381 : audit [DBG] from='client.270210 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:23:26.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:23:26 smithi157 bash[24585]: audit 2024-09-16T10:23:24.701777+0000 mgr.a (mgr.14373) 12381 : audit [DBG] from='client.270210 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:23:26.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:23:26 smithi086 bash[24289]: audit 2024-09-16T10:23:24.701777+0000 mgr.a (mgr.14373) 12381 : audit [DBG] from='client.270210 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:23:27.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:23:27 smithi157 bash[24585]: cluster 2024-09-16T10:23:25.965931+0000 mgr.a (mgr.14373) 12382 : cluster [DBG] pgmap v8587: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:23:27.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:23:27 smithi086 bash[24289]: cluster 2024-09-16T10:23:25.965931+0000 mgr.a (mgr.14373) 12382 : cluster [DBG] pgmap v8587: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:23:27.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:23:27 smithi047 bash[22744]: cluster 2024-09-16T10:23:25.965931+0000 mgr.a (mgr.14373) 12382 : cluster [DBG] pgmap v8587: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:23:29.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:23:29 smithi157 bash[24585]: cluster 2024-09-16T10:23:27.968165+0000 mgr.a (mgr.14373) 12383 : cluster [DBG] pgmap v8588: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:23:29.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:23:29 smithi086 bash[24289]: cluster 2024-09-16T10:23:27.968165+0000 mgr.a (mgr.14373) 12383 : cluster [DBG] pgmap v8588: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:23:29.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:23:29 smithi047 bash[22744]: cluster 2024-09-16T10:23:27.968165+0000 mgr.a (mgr.14373) 12383 : cluster [DBG] pgmap v8588: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:23:30.143 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:23:30.144 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:23:30.144 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:23:30.929 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:23:30.929 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:23:30.929 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:23:30.930 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:23:30.930 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:23:31.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:23:31 smithi157 bash[24585]: cluster 2024-09-16T10:23:29.968926+0000 mgr.a (mgr.14373) 12384 : cluster [DBG] pgmap v8589: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:23:31.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:23:31 smithi086 bash[24289]: cluster 2024-09-16T10:23:29.968926+0000 mgr.a (mgr.14373) 12384 : cluster [DBG] pgmap v8589: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:23:31.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:23:31 smithi047 bash[22744]: cluster 2024-09-16T10:23:29.968926+0000 mgr.a (mgr.14373) 12384 : cluster [DBG] pgmap v8589: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:23:32.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:23:32 smithi157 bash[24585]: audit 2024-09-16T10:23:30.478931+0000 mgr.a (mgr.14373) 12385 : audit [DBG] from='client.270288 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:23:32.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:23:32 smithi086 bash[24289]: audit 2024-09-16T10:23:30.478931+0000 mgr.a (mgr.14373) 12385 : audit [DBG] from='client.270288 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:23:32.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:23:32 smithi047 bash[22744]: audit 2024-09-16T10:23:30.478931+0000 mgr.a (mgr.14373) 12385 : audit [DBG] from='client.270288 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:23:33.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:23:33 smithi157 bash[24585]: cluster 2024-09-16T10:23:31.971219+0000 mgr.a (mgr.14373) 12386 : cluster [DBG] pgmap v8590: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:23:33.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:23:33 smithi086 bash[24289]: cluster 2024-09-16T10:23:31.971219+0000 mgr.a (mgr.14373) 12386 : cluster [DBG] pgmap v8590: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:23:33.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:23:33 smithi047 bash[22744]: cluster 2024-09-16T10:23:31.971219+0000 mgr.a (mgr.14373) 12386 : cluster [DBG] pgmap v8590: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:23:35.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:23:35 smithi157 bash[24585]: cluster 2024-09-16T10:23:33.971994+0000 mgr.a (mgr.14373) 12387 : cluster [DBG] pgmap v8591: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:23:35.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:23:35 smithi086 bash[24289]: cluster 2024-09-16T10:23:33.971994+0000 mgr.a (mgr.14373) 12387 : cluster [DBG] pgmap v8591: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:23:35.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:23:35 smithi047 bash[22744]: cluster 2024-09-16T10:23:33.971994+0000 mgr.a (mgr.14373) 12387 : cluster [DBG] pgmap v8591: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:23:35.931 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:23:35.931 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:23:35.931 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:23:36.714 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:23:36.715 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:23:36.715 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:23:36.715 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:23:36.715 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:23:37.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:23:37 smithi157 bash[24585]: cluster 2024-09-16T10:23:35.972770+0000 mgr.a (mgr.14373) 12388 : cluster [DBG] pgmap v8592: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:23:37.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:23:37 smithi157 bash[24585]: audit 2024-09-16T10:23:36.268317+0000 mgr.a (mgr.14373) 12389 : audit [DBG] from='client.270366 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:23:37.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:23:37 smithi086 bash[24289]: cluster 2024-09-16T10:23:35.972770+0000 mgr.a (mgr.14373) 12388 : cluster [DBG] pgmap v8592: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:23:37.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:23:37 smithi086 bash[24289]: audit 2024-09-16T10:23:36.268317+0000 mgr.a (mgr.14373) 12389 : audit [DBG] from='client.270366 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:23:37.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:23:37 smithi047 bash[22744]: cluster 2024-09-16T10:23:35.972770+0000 mgr.a (mgr.14373) 12388 : cluster [DBG] pgmap v8592: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:23:37.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:23:37 smithi047 bash[22744]: audit 2024-09-16T10:23:36.268317+0000 mgr.a (mgr.14373) 12389 : audit [DBG] from='client.270366 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:23:39.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:23:39 smithi157 bash[24585]: cluster 2024-09-16T10:23:37.975537+0000 mgr.a (mgr.14373) 12390 : cluster [DBG] pgmap v8593: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:23:39.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:23:39 smithi086 bash[24289]: cluster 2024-09-16T10:23:37.975537+0000 mgr.a (mgr.14373) 12390 : cluster [DBG] pgmap v8593: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:23:39.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:23:39 smithi047 bash[22744]: cluster 2024-09-16T10:23:37.975537+0000 mgr.a (mgr.14373) 12390 : cluster [DBG] pgmap v8593: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:23:41.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:23:41 smithi157 bash[24585]: cluster 2024-09-16T10:23:39.976280+0000 mgr.a (mgr.14373) 12391 : cluster [DBG] pgmap v8594: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:23:41.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:23:41 smithi086 bash[24289]: cluster 2024-09-16T10:23:39.976280+0000 mgr.a (mgr.14373) 12391 : cluster [DBG] pgmap v8594: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:23:41.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:23:41 smithi047 bash[22744]: cluster 2024-09-16T10:23:39.976280+0000 mgr.a (mgr.14373) 12391 : cluster [DBG] pgmap v8594: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:23:41.716 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:23:41.717 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:23:41.717 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:23:42.503 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:23:42.504 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:23:42.504 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:23:42.504 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:23:42.504 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:23:43.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:23:43 smithi157 bash[24585]: cluster 2024-09-16T10:23:41.978300+0000 mgr.a (mgr.14373) 12392 : cluster [DBG] pgmap v8595: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:23:43.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:23:43 smithi157 bash[24585]: audit 2024-09-16T10:23:42.048709+0000 mgr.a (mgr.14373) 12393 : audit [DBG] from='client.270444 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:23:43.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:23:43 smithi086 bash[24289]: cluster 2024-09-16T10:23:41.978300+0000 mgr.a (mgr.14373) 12392 : cluster [DBG] pgmap v8595: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:23:43.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:23:43 smithi086 bash[24289]: audit 2024-09-16T10:23:42.048709+0000 mgr.a (mgr.14373) 12393 : audit [DBG] from='client.270444 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:23:43.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:23:43 smithi047 bash[22744]: cluster 2024-09-16T10:23:41.978300+0000 mgr.a (mgr.14373) 12392 : cluster [DBG] pgmap v8595: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:23:43.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:23:43 smithi047 bash[22744]: audit 2024-09-16T10:23:42.048709+0000 mgr.a (mgr.14373) 12393 : audit [DBG] from='client.270444 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:23:45.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:23:45 smithi157 bash[24585]: cluster 2024-09-16T10:23:43.979212+0000 mgr.a (mgr.14373) 12394 : cluster [DBG] pgmap v8596: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:23:45.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:23:45 smithi086 bash[24289]: cluster 2024-09-16T10:23:43.979212+0000 mgr.a (mgr.14373) 12394 : cluster [DBG] pgmap v8596: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:23:45.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:23:45 smithi047 bash[22744]: cluster 2024-09-16T10:23:43.979212+0000 mgr.a (mgr.14373) 12394 : cluster [DBG] pgmap v8596: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:23:47.505 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:23:47.506 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:23:47.506 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:23:47.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:23:47 smithi157 bash[24585]: cluster 2024-09-16T10:23:45.980008+0000 mgr.a (mgr.14373) 12395 : cluster [DBG] pgmap v8597: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T10:23:47.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:23:47 smithi086 bash[24289]: cluster 2024-09-16T10:23:45.980008+0000 mgr.a (mgr.14373) 12395 : cluster [DBG] pgmap v8597: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T10:23:47.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:23:47 smithi047 bash[22744]: cluster 2024-09-16T10:23:45.980008+0000 mgr.a (mgr.14373) 12395 : cluster [DBG] pgmap v8597: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T10:23:48.298 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:23:48.299 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:23:48.299 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:23:48.299 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:23:48.299 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:23:49.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:23:49 smithi157 bash[24585]: audit 2024-09-16T10:23:47.839405+0000 mgr.a (mgr.14373) 12396 : audit [DBG] from='client.270516 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:23:49.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:23:49 smithi157 bash[24585]: cluster 2024-09-16T10:23:47.991446+0000 mgr.a (mgr.14373) 12397 : cluster [DBG] pgmap v8598: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:23:49.573 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:23:49 smithi086 bash[24289]: audit 2024-09-16T10:23:47.839405+0000 mgr.a (mgr.14373) 12396 : audit [DBG] from='client.270516 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:23:49.573 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:23:49 smithi086 bash[24289]: cluster 2024-09-16T10:23:47.991446+0000 mgr.a (mgr.14373) 12397 : cluster [DBG] pgmap v8598: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:23:49.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:23:49 smithi047 bash[22744]: audit 2024-09-16T10:23:47.839405+0000 mgr.a (mgr.14373) 12396 : audit [DBG] from='client.270516 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:23:49.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:23:49 smithi047 bash[22744]: cluster 2024-09-16T10:23:47.991446+0000 mgr.a (mgr.14373) 12397 : cluster [DBG] pgmap v8598: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:23:51.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:23:51 smithi157 bash[24585]: cluster 2024-09-16T10:23:49.992314+0000 mgr.a (mgr.14373) 12398 : cluster [DBG] pgmap v8599: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:23:51.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:23:51 smithi086 bash[24289]: cluster 2024-09-16T10:23:49.992314+0000 mgr.a (mgr.14373) 12398 : cluster [DBG] pgmap v8599: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:23:51.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:23:51 smithi047 bash[22744]: cluster 2024-09-16T10:23:49.992314+0000 mgr.a (mgr.14373) 12398 : cluster [DBG] pgmap v8599: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:23:52.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:23:52 smithi157 bash[24585]: audit 2024-09-16T10:23:51.951374+0000 mon.b (mon.2) 1138 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T10:23:52.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:23:52 smithi086 bash[24289]: audit 2024-09-16T10:23:51.951374+0000 mon.b (mon.2) 1138 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T10:23:52.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:23:52 smithi047 bash[22744]: audit 2024-09-16T10:23:51.951374+0000 mon.b (mon.2) 1138 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T10:23:53.299 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:23:53.300 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:23:53.300 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:23:53.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:23:53 smithi157 bash[24585]: cluster 2024-09-16T10:23:51.993714+0000 mgr.a (mgr.14373) 12399 : cluster [DBG] pgmap v8600: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:23:53.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:23:53 smithi157 bash[24585]: audit 2024-09-16T10:23:52.804189+0000 mon.b (mon.2) 1139 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T10:23:53.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:23:53 smithi157 bash[24585]: audit 2024-09-16T10:23:52.806420+0000 mon.b (mon.2) 1140 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T10:23:53.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:23:53 smithi157 bash[24585]: audit 2024-09-16T10:23:52.815802+0000 mon.a (mon.0) 1311 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:23:53.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:23:53 smithi157 bash[24585]: audit 2024-09-16T10:23:52.822907+0000 mon.b (mon.2) 1141 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:23:53.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:23:53 smithi086 bash[24289]: cluster 2024-09-16T10:23:51.993714+0000 mgr.a (mgr.14373) 12399 : cluster [DBG] pgmap v8600: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:23:53.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:23:53 smithi086 bash[24289]: audit 2024-09-16T10:23:52.804189+0000 mon.b (mon.2) 1139 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T10:23:53.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:23:53 smithi086 bash[24289]: audit 2024-09-16T10:23:52.806420+0000 mon.b (mon.2) 1140 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T10:23:53.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:23:53 smithi086 bash[24289]: audit 2024-09-16T10:23:52.815802+0000 mon.a (mon.0) 1311 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:23:53.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:23:53 smithi086 bash[24289]: audit 2024-09-16T10:23:52.822907+0000 mon.b (mon.2) 1141 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:23:53.574 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:23:53 smithi047 bash[22744]: cluster 2024-09-16T10:23:51.993714+0000 mgr.a (mgr.14373) 12399 : cluster [DBG] pgmap v8600: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:23:53.574 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:23:53 smithi047 bash[22744]: audit 2024-09-16T10:23:52.804189+0000 mon.b (mon.2) 1139 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T10:23:53.574 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:23:53 smithi047 bash[22744]: audit 2024-09-16T10:23:52.806420+0000 mon.b (mon.2) 1140 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T10:23:53.574 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:23:53 smithi047 bash[22744]: audit 2024-09-16T10:23:52.815802+0000 mon.a (mon.0) 1311 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:23:53.574 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:23:53 smithi047 bash[22744]: audit 2024-09-16T10:23:52.822907+0000 mon.b (mon.2) 1141 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:23:53.842 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 10:23:53 smithi047 bash[22994]: debug 2024-09-16T10:23:53.567+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T10:23:53.843 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 10:23:53 smithi047 bash[22994]: debug 2024-09-16T10:23:53.571+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T10:23:54.034 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:23:54.035 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:23:54.035 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:23:54.035 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:23:54.035 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:23:54.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:23:54 smithi157 bash[24585]: audit 2024-09-16T10:23:52.825425+0000 mgr.a (mgr.14373) 12400 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:23:54.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:23:54 smithi086 bash[24289]: audit 2024-09-16T10:23:52.825425+0000 mgr.a (mgr.14373) 12400 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:23:54.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:23:54 smithi047 bash[22744]: audit 2024-09-16T10:23:52.825425+0000 mgr.a (mgr.14373) 12400 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:23:55.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:23:55 smithi157 bash[24585]: audit 2024-09-16T10:23:53.572744+0000 mgr.a (mgr.14373) 12401 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T10:23:55.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:23:55 smithi157 bash[24585]: cephadm 2024-09-16T10:23:53.574453+0000 mgr.a (mgr.14373) 12402 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T10:23:55.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:23:55 smithi157 bash[24585]: audit 2024-09-16T10:23:53.635291+0000 mgr.a (mgr.14373) 12403 : audit [DBG] from='client.270681 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:23:55.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:23:55 smithi157 bash[24585]: cluster 2024-09-16T10:23:53.994228+0000 mgr.a (mgr.14373) 12404 : cluster [DBG] pgmap v8601: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:23:55.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:23:55 smithi086 bash[24289]: audit 2024-09-16T10:23:53.572744+0000 mgr.a (mgr.14373) 12401 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T10:23:55.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:23:55 smithi086 bash[24289]: cephadm 2024-09-16T10:23:53.574453+0000 mgr.a (mgr.14373) 12402 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T10:23:55.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:23:55 smithi086 bash[24289]: audit 2024-09-16T10:23:53.635291+0000 mgr.a (mgr.14373) 12403 : audit [DBG] from='client.270681 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:23:55.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:23:55 smithi086 bash[24289]: cluster 2024-09-16T10:23:53.994228+0000 mgr.a (mgr.14373) 12404 : cluster [DBG] pgmap v8601: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:23:55.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:23:55 smithi047 bash[22744]: audit 2024-09-16T10:23:53.572744+0000 mgr.a (mgr.14373) 12401 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T10:23:55.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:23:55 smithi047 bash[22744]: cephadm 2024-09-16T10:23:53.574453+0000 mgr.a (mgr.14373) 12402 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T10:23:55.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:23:55 smithi047 bash[22744]: audit 2024-09-16T10:23:53.635291+0000 mgr.a (mgr.14373) 12403 : audit [DBG] from='client.270681 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:23:55.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:23:55 smithi047 bash[22744]: cluster 2024-09-16T10:23:53.994228+0000 mgr.a (mgr.14373) 12404 : cluster [DBG] pgmap v8601: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:23:57.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:23:57 smithi157 bash[24585]: cluster 2024-09-16T10:23:55.994985+0000 mgr.a (mgr.14373) 12405 : cluster [DBG] pgmap v8602: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:23:57.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:23:57 smithi086 bash[24289]: cluster 2024-09-16T10:23:55.994985+0000 mgr.a (mgr.14373) 12405 : cluster [DBG] pgmap v8602: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:23:57.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:23:57 smithi047 bash[22744]: cluster 2024-09-16T10:23:55.994985+0000 mgr.a (mgr.14373) 12405 : cluster [DBG] pgmap v8602: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:23:59.036 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:23:59.037 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:23:59.037 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:23:59.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:23:59 smithi157 bash[24585]: cluster 2024-09-16T10:23:57.997196+0000 mgr.a (mgr.14373) 12406 : cluster [DBG] pgmap v8603: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:23:59.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:23:59 smithi086 bash[24289]: cluster 2024-09-16T10:23:57.997196+0000 mgr.a (mgr.14373) 12406 : cluster [DBG] pgmap v8603: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:23:59.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:23:59 smithi047 bash[22744]: cluster 2024-09-16T10:23:57.997196+0000 mgr.a (mgr.14373) 12406 : cluster [DBG] pgmap v8603: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:23:59.781 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:23:59.781 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:23:59.781 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:23:59.781 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:23:59.781 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:24:01.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:24:01 smithi157 bash[24585]: audit 2024-09-16T10:23:59.370125+0000 mgr.a (mgr.14373) 12407 : audit [DBG] from='client.270774 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:24:01.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:24:01 smithi157 bash[24585]: cluster 2024-09-16T10:23:59.997985+0000 mgr.a (mgr.14373) 12408 : cluster [DBG] pgmap v8604: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:24:01.573 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:24:01 smithi086 bash[24289]: audit 2024-09-16T10:23:59.370125+0000 mgr.a (mgr.14373) 12407 : audit [DBG] from='client.270774 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:24:01.573 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:24:01 smithi086 bash[24289]: cluster 2024-09-16T10:23:59.997985+0000 mgr.a (mgr.14373) 12408 : cluster [DBG] pgmap v8604: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:24:01.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:24:01 smithi047 bash[22744]: audit 2024-09-16T10:23:59.370125+0000 mgr.a (mgr.14373) 12407 : audit [DBG] from='client.270774 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:24:01.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:24:01 smithi047 bash[22744]: cluster 2024-09-16T10:23:59.997985+0000 mgr.a (mgr.14373) 12408 : cluster [DBG] pgmap v8604: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:24:03.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:24:03 smithi157 bash[24585]: cluster 2024-09-16T10:24:02.000129+0000 mgr.a (mgr.14373) 12409 : cluster [DBG] pgmap v8605: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:24:03.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:24:03 smithi086 bash[24289]: cluster 2024-09-16T10:24:02.000129+0000 mgr.a (mgr.14373) 12409 : cluster [DBG] pgmap v8605: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:24:03.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:24:03 smithi047 bash[22744]: cluster 2024-09-16T10:24:02.000129+0000 mgr.a (mgr.14373) 12409 : cluster [DBG] pgmap v8605: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:24:04.782 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:24:04.783 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:24:04.783 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:24:05.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:24:05 smithi157 bash[24585]: cluster 2024-09-16T10:24:04.000860+0000 mgr.a (mgr.14373) 12410 : cluster [DBG] pgmap v8606: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:24:05.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:24:05 smithi086 bash[24289]: cluster 2024-09-16T10:24:04.000860+0000 mgr.a (mgr.14373) 12410 : cluster [DBG] pgmap v8606: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:24:05.575 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:24:05.575 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:24:05.575 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:24:05.575 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:24:05.575 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:24:05.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:24:05 smithi047 bash[22744]: cluster 2024-09-16T10:24:04.000860+0000 mgr.a (mgr.14373) 12410 : cluster [DBG] pgmap v8606: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:24:06.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:24:06 smithi157 bash[24585]: audit 2024-09-16T10:24:05.119325+0000 mgr.a (mgr.14373) 12411 : audit [DBG] from='client.270852 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:24:06.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:24:06 smithi086 bash[24289]: audit 2024-09-16T10:24:05.119325+0000 mgr.a (mgr.14373) 12411 : audit [DBG] from='client.270852 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:24:06.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:24:06 smithi047 bash[22744]: audit 2024-09-16T10:24:05.119325+0000 mgr.a (mgr.14373) 12411 : audit [DBG] from='client.270852 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:24:07.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:24:07 smithi157 bash[24585]: cluster 2024-09-16T10:24:06.001750+0000 mgr.a (mgr.14373) 12412 : cluster [DBG] pgmap v8607: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:24:07.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:24:07 smithi086 bash[24289]: cluster 2024-09-16T10:24:06.001750+0000 mgr.a (mgr.14373) 12412 : cluster [DBG] pgmap v8607: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:24:07.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:24:07 smithi047 bash[22744]: cluster 2024-09-16T10:24:06.001750+0000 mgr.a (mgr.14373) 12412 : cluster [DBG] pgmap v8607: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:24:09.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:24:09 smithi157 bash[24585]: cluster 2024-09-16T10:24:08.004090+0000 mgr.a (mgr.14373) 12413 : cluster [DBG] pgmap v8608: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:24:09.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:24:09 smithi086 bash[24289]: cluster 2024-09-16T10:24:08.004090+0000 mgr.a (mgr.14373) 12413 : cluster [DBG] pgmap v8608: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:24:09.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:24:09 smithi047 bash[22744]: cluster 2024-09-16T10:24:08.004090+0000 mgr.a (mgr.14373) 12413 : cluster [DBG] pgmap v8608: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:24:10.577 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:24:10.577 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:24:10.578 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:24:11.336 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:24:11.336 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:24:11.337 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:24:11.337 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:24:11.337 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:24:11.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:24:11 smithi157 bash[24585]: cluster 2024-09-16T10:24:10.004820+0000 mgr.a (mgr.14373) 12414 : cluster [DBG] pgmap v8609: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:24:11.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:24:11 smithi086 bash[24289]: cluster 2024-09-16T10:24:10.004820+0000 mgr.a (mgr.14373) 12414 : cluster [DBG] pgmap v8609: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:24:11.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:24:11 smithi047 bash[22744]: cluster 2024-09-16T10:24:10.004820+0000 mgr.a (mgr.14373) 12414 : cluster [DBG] pgmap v8609: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:24:12.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:24:12 smithi157 bash[24585]: audit 2024-09-16T10:24:10.912898+0000 mgr.a (mgr.14373) 12415 : audit [DBG] from='client.270930 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:24:12.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:24:12 smithi086 bash[24289]: audit 2024-09-16T10:24:10.912898+0000 mgr.a (mgr.14373) 12415 : audit [DBG] from='client.270930 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:24:12.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:24:12 smithi047 bash[22744]: audit 2024-09-16T10:24:10.912898+0000 mgr.a (mgr.14373) 12415 : audit [DBG] from='client.270930 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:24:13.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:24:13 smithi157 bash[24585]: cluster 2024-09-16T10:24:12.007116+0000 mgr.a (mgr.14373) 12416 : cluster [DBG] pgmap v8610: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:24:13.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:24:13 smithi086 bash[24289]: cluster 2024-09-16T10:24:12.007116+0000 mgr.a (mgr.14373) 12416 : cluster [DBG] pgmap v8610: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:24:13.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:24:13 smithi047 bash[22744]: cluster 2024-09-16T10:24:12.007116+0000 mgr.a (mgr.14373) 12416 : cluster [DBG] pgmap v8610: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:24:15.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:24:15 smithi157 bash[24585]: cluster 2024-09-16T10:24:14.007859+0000 mgr.a (mgr.14373) 12417 : cluster [DBG] pgmap v8611: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:24:15.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:24:15 smithi086 bash[24289]: cluster 2024-09-16T10:24:14.007859+0000 mgr.a (mgr.14373) 12417 : cluster [DBG] pgmap v8611: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:24:15.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:24:15 smithi047 bash[22744]: cluster 2024-09-16T10:24:14.007859+0000 mgr.a (mgr.14373) 12417 : cluster [DBG] pgmap v8611: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:24:16.338 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:24:16.338 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:24:16.339 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:24:17.125 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:24:17.126 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:24:17.126 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:24:17.126 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:24:17.126 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:24:17.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:24:17 smithi157 bash[24585]: cluster 2024-09-16T10:24:16.008605+0000 mgr.a (mgr.14373) 12418 : cluster [DBG] pgmap v8612: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:24:17.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:24:17 smithi086 bash[24289]: cluster 2024-09-16T10:24:16.008605+0000 mgr.a (mgr.14373) 12418 : cluster [DBG] pgmap v8612: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:24:17.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:24:17 smithi047 bash[22744]: cluster 2024-09-16T10:24:16.008605+0000 mgr.a (mgr.14373) 12418 : cluster [DBG] pgmap v8612: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:24:18.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:24:18 smithi157 bash[24585]: audit 2024-09-16T10:24:16.676283+0000 mgr.a (mgr.14373) 12419 : audit [DBG] from='client.271008 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:24:18.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:24:18 smithi086 bash[24289]: audit 2024-09-16T10:24:16.676283+0000 mgr.a (mgr.14373) 12419 : audit [DBG] from='client.271008 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:24:18.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:24:18 smithi047 bash[22744]: audit 2024-09-16T10:24:16.676283+0000 mgr.a (mgr.14373) 12419 : audit [DBG] from='client.271008 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:24:19.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:24:19 smithi157 bash[24585]: cluster 2024-09-16T10:24:18.011314+0000 mgr.a (mgr.14373) 12420 : cluster [DBG] pgmap v8613: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:24:19.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:24:19 smithi086 bash[24289]: cluster 2024-09-16T10:24:18.011314+0000 mgr.a (mgr.14373) 12420 : cluster [DBG] pgmap v8613: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:24:19.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:24:19 smithi047 bash[22744]: cluster 2024-09-16T10:24:18.011314+0000 mgr.a (mgr.14373) 12420 : cluster [DBG] pgmap v8613: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:24:21.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:24:21 smithi157 bash[24585]: cluster 2024-09-16T10:24:20.012226+0000 mgr.a (mgr.14373) 12421 : cluster [DBG] pgmap v8614: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:24:21.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:24:21 smithi086 bash[24289]: cluster 2024-09-16T10:24:20.012226+0000 mgr.a (mgr.14373) 12421 : cluster [DBG] pgmap v8614: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:24:21.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:24:21 smithi047 bash[22744]: cluster 2024-09-16T10:24:20.012226+0000 mgr.a (mgr.14373) 12421 : cluster [DBG] pgmap v8614: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:24:22.127 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:24:22.127 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:24:22.128 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:24:22.873 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:24:22.874 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:24:22.874 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:24:22.874 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:24:22.874 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:24:23.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:24:23 smithi157 bash[24585]: cluster 2024-09-16T10:24:22.014259+0000 mgr.a (mgr.14373) 12422 : cluster [DBG] pgmap v8615: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:24:23.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:24:23 smithi086 bash[24289]: cluster 2024-09-16T10:24:22.014259+0000 mgr.a (mgr.14373) 12422 : cluster [DBG] pgmap v8615: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:24:23.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:24:23 smithi047 bash[22744]: cluster 2024-09-16T10:24:22.014259+0000 mgr.a (mgr.14373) 12422 : cluster [DBG] pgmap v8615: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:24:24.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:24:24 smithi157 bash[24585]: audit 2024-09-16T10:24:22.457987+0000 mgr.a (mgr.14373) 12423 : audit [DBG] from='client.271083 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:24:24.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:24:24 smithi086 bash[24289]: audit 2024-09-16T10:24:22.457987+0000 mgr.a (mgr.14373) 12423 : audit [DBG] from='client.271083 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:24:24.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:24:24 smithi047 bash[22744]: audit 2024-09-16T10:24:22.457987+0000 mgr.a (mgr.14373) 12423 : audit [DBG] from='client.271083 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:24:25.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:24:25 smithi157 bash[24585]: cluster 2024-09-16T10:24:24.015151+0000 mgr.a (mgr.14373) 12424 : cluster [DBG] pgmap v8616: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:24:25.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:24:25 smithi086 bash[24289]: cluster 2024-09-16T10:24:24.015151+0000 mgr.a (mgr.14373) 12424 : cluster [DBG] pgmap v8616: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:24:25.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:24:25 smithi047 bash[22744]: cluster 2024-09-16T10:24:24.015151+0000 mgr.a (mgr.14373) 12424 : cluster [DBG] pgmap v8616: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:24:27.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:24:27 smithi157 bash[24585]: cluster 2024-09-16T10:24:26.015963+0000 mgr.a (mgr.14373) 12425 : cluster [DBG] pgmap v8617: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T10:24:27.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:24:27 smithi086 bash[24289]: cluster 2024-09-16T10:24:26.015963+0000 mgr.a (mgr.14373) 12425 : cluster [DBG] pgmap v8617: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T10:24:27.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:24:27 smithi047 bash[22744]: cluster 2024-09-16T10:24:26.015963+0000 mgr.a (mgr.14373) 12425 : cluster [DBG] pgmap v8617: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T10:24:27.875 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:24:27.875 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:24:27.876 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:24:28.625 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:24:28.625 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:24:28.625 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:24:28.626 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:24:28.626 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:24:29.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:24:29 smithi157 bash[24585]: cluster 2024-09-16T10:24:28.018081+0000 mgr.a (mgr.14373) 12426 : cluster [DBG] pgmap v8618: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:24:29.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:24:29 smithi157 bash[24585]: audit 2024-09-16T10:24:28.204942+0000 mgr.a (mgr.14373) 12427 : audit [DBG] from='client.271158 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:24:29.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:24:29 smithi086 bash[24289]: cluster 2024-09-16T10:24:28.018081+0000 mgr.a (mgr.14373) 12426 : cluster [DBG] pgmap v8618: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:24:29.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:24:29 smithi086 bash[24289]: audit 2024-09-16T10:24:28.204942+0000 mgr.a (mgr.14373) 12427 : audit [DBG] from='client.271158 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:24:29.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:24:29 smithi047 bash[22744]: cluster 2024-09-16T10:24:28.018081+0000 mgr.a (mgr.14373) 12426 : cluster [DBG] pgmap v8618: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:24:29.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:24:29 smithi047 bash[22744]: audit 2024-09-16T10:24:28.204942+0000 mgr.a (mgr.14373) 12427 : audit [DBG] from='client.271158 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:24:31.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:24:31 smithi157 bash[24585]: cluster 2024-09-16T10:24:30.019093+0000 mgr.a (mgr.14373) 12428 : cluster [DBG] pgmap v8619: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:24:31.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:24:31 smithi086 bash[24289]: cluster 2024-09-16T10:24:30.019093+0000 mgr.a (mgr.14373) 12428 : cluster [DBG] pgmap v8619: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:24:31.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:24:31 smithi047 bash[22744]: cluster 2024-09-16T10:24:30.019093+0000 mgr.a (mgr.14373) 12428 : cluster [DBG] pgmap v8619: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:24:33.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:24:33 smithi157 bash[24585]: cluster 2024-09-16T10:24:32.021300+0000 mgr.a (mgr.14373) 12429 : cluster [DBG] pgmap v8620: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:24:33.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:24:33 smithi086 bash[24289]: cluster 2024-09-16T10:24:32.021300+0000 mgr.a (mgr.14373) 12429 : cluster [DBG] pgmap v8620: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:24:33.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:24:33 smithi047 bash[22744]: cluster 2024-09-16T10:24:32.021300+0000 mgr.a (mgr.14373) 12429 : cluster [DBG] pgmap v8620: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:24:33.627 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:24:33.627 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:24:33.627 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:24:34.394 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:24:34.395 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:24:34.395 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:24:34.395 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:24:34.395 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:24:35.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:24:35 smithi157 bash[24585]: audit 2024-09-16T10:24:33.959219+0000 mgr.a (mgr.14373) 12430 : audit [DBG] from='client.271236 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:24:35.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:24:35 smithi157 bash[24585]: cluster 2024-09-16T10:24:34.022060+0000 mgr.a (mgr.14373) 12431 : cluster [DBG] pgmap v8621: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:24:35.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:24:35 smithi086 bash[24289]: audit 2024-09-16T10:24:33.959219+0000 mgr.a (mgr.14373) 12430 : audit [DBG] from='client.271236 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:24:35.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:24:35 smithi086 bash[24289]: cluster 2024-09-16T10:24:34.022060+0000 mgr.a (mgr.14373) 12431 : cluster [DBG] pgmap v8621: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:24:35.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:24:35 smithi047 bash[22744]: audit 2024-09-16T10:24:33.959219+0000 mgr.a (mgr.14373) 12430 : audit [DBG] from='client.271236 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:24:35.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:24:35 smithi047 bash[22744]: cluster 2024-09-16T10:24:34.022060+0000 mgr.a (mgr.14373) 12431 : cluster [DBG] pgmap v8621: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:24:37.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:24:37 smithi157 bash[24585]: cluster 2024-09-16T10:24:36.022967+0000 mgr.a (mgr.14373) 12432 : cluster [DBG] pgmap v8622: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:24:37.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:24:37 smithi086 bash[24289]: cluster 2024-09-16T10:24:36.022967+0000 mgr.a (mgr.14373) 12432 : cluster [DBG] pgmap v8622: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:24:37.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:24:37 smithi047 bash[22744]: cluster 2024-09-16T10:24:36.022967+0000 mgr.a (mgr.14373) 12432 : cluster [DBG] pgmap v8622: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:24:39.396 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:24:39.397 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:24:39.397 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:24:39.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:24:39 smithi157 bash[24585]: cluster 2024-09-16T10:24:38.025213+0000 mgr.a (mgr.14373) 12433 : cluster [DBG] pgmap v8623: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:24:39.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:24:39 smithi086 bash[24289]: cluster 2024-09-16T10:24:38.025213+0000 mgr.a (mgr.14373) 12433 : cluster [DBG] pgmap v8623: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:24:39.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:24:39 smithi047 bash[22744]: cluster 2024-09-16T10:24:38.025213+0000 mgr.a (mgr.14373) 12433 : cluster [DBG] pgmap v8623: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:24:40.150 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:24:40.150 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:24:40.150 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:24:40.150 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:24:40.150 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:24:41.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:24:41 smithi157 bash[24585]: audit 2024-09-16T10:24:39.726623+0000 mgr.a (mgr.14373) 12434 : audit [DBG] from='client.271314 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:24:41.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:24:41 smithi157 bash[24585]: cluster 2024-09-16T10:24:40.025776+0000 mgr.a (mgr.14373) 12435 : cluster [DBG] pgmap v8624: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:24:41.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:24:41 smithi086 bash[24289]: audit 2024-09-16T10:24:39.726623+0000 mgr.a (mgr.14373) 12434 : audit [DBG] from='client.271314 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:24:41.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:24:41 smithi086 bash[24289]: cluster 2024-09-16T10:24:40.025776+0000 mgr.a (mgr.14373) 12435 : cluster [DBG] pgmap v8624: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:24:41.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:24:41 smithi047 bash[22744]: audit 2024-09-16T10:24:39.726623+0000 mgr.a (mgr.14373) 12434 : audit [DBG] from='client.271314 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:24:41.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:24:41 smithi047 bash[22744]: cluster 2024-09-16T10:24:40.025776+0000 mgr.a (mgr.14373) 12435 : cluster [DBG] pgmap v8624: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:24:43.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:24:43 smithi157 bash[24585]: cluster 2024-09-16T10:24:42.027964+0000 mgr.a (mgr.14373) 12436 : cluster [DBG] pgmap v8625: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:24:43.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:24:43 smithi086 bash[24289]: cluster 2024-09-16T10:24:42.027964+0000 mgr.a (mgr.14373) 12436 : cluster [DBG] pgmap v8625: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:24:43.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:24:43 smithi047 bash[22744]: cluster 2024-09-16T10:24:42.027964+0000 mgr.a (mgr.14373) 12436 : cluster [DBG] pgmap v8625: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:24:45.151 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:24:45.152 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:24:45.152 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:24:45.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:24:45 smithi157 bash[24585]: cluster 2024-09-16T10:24:44.028738+0000 mgr.a (mgr.14373) 12437 : cluster [DBG] pgmap v8626: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:24:45.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:24:45 smithi086 bash[24289]: cluster 2024-09-16T10:24:44.028738+0000 mgr.a (mgr.14373) 12437 : cluster [DBG] pgmap v8626: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:24:45.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:24:45 smithi047 bash[22744]: cluster 2024-09-16T10:24:44.028738+0000 mgr.a (mgr.14373) 12437 : cluster [DBG] pgmap v8626: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:24:45.936 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:24:45.936 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:24:45.936 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:24:45.937 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:24:45.937 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:24:47.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:24:47 smithi157 bash[24585]: audit 2024-09-16T10:24:45.490903+0000 mgr.a (mgr.14373) 12438 : audit [DBG] from='client.271392 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:24:47.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:24:47 smithi157 bash[24585]: cluster 2024-09-16T10:24:46.029651+0000 mgr.a (mgr.14373) 12439 : cluster [DBG] pgmap v8627: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:24:47.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:24:47 smithi086 bash[24289]: audit 2024-09-16T10:24:45.490903+0000 mgr.a (mgr.14373) 12438 : audit [DBG] from='client.271392 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:24:47.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:24:47 smithi086 bash[24289]: cluster 2024-09-16T10:24:46.029651+0000 mgr.a (mgr.14373) 12439 : cluster [DBG] pgmap v8627: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:24:47.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:24:47 smithi047 bash[22744]: audit 2024-09-16T10:24:45.490903+0000 mgr.a (mgr.14373) 12438 : audit [DBG] from='client.271392 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:24:47.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:24:47 smithi047 bash[22744]: cluster 2024-09-16T10:24:46.029651+0000 mgr.a (mgr.14373) 12439 : cluster [DBG] pgmap v8627: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:24:49.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:24:49 smithi086 bash[24289]: cluster 2024-09-16T10:24:48.031890+0000 mgr.a (mgr.14373) 12440 : cluster [DBG] pgmap v8628: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:24:49.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:24:49 smithi047 bash[22744]: cluster 2024-09-16T10:24:48.031890+0000 mgr.a (mgr.14373) 12440 : cluster [DBG] pgmap v8628: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:24:49.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:24:49 smithi157 bash[24585]: cluster 2024-09-16T10:24:48.031890+0000 mgr.a (mgr.14373) 12440 : cluster [DBG] pgmap v8628: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:24:50.938 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:24:50.938 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:24:50.939 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:24:51.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:24:51 smithi086 bash[24289]: cluster 2024-09-16T10:24:50.032632+0000 mgr.a (mgr.14373) 12441 : cluster [DBG] pgmap v8629: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:24:51.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:24:51 smithi047 bash[22744]: cluster 2024-09-16T10:24:50.032632+0000 mgr.a (mgr.14373) 12441 : cluster [DBG] pgmap v8629: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:24:51.715 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:24:51.715 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:24:51.715 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:24:51.716 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:24:51.716 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:24:51.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:24:51 smithi157 bash[24585]: cluster 2024-09-16T10:24:50.032632+0000 mgr.a (mgr.14373) 12441 : cluster [DBG] pgmap v8629: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:24:52.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:24:52 smithi047 bash[22744]: audit 2024-09-16T10:24:51.269914+0000 mgr.a (mgr.14373) 12442 : audit [DBG] from='client.271470 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:24:52.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:24:52 smithi157 bash[24585]: audit 2024-09-16T10:24:51.269914+0000 mgr.a (mgr.14373) 12442 : audit [DBG] from='client.271470 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:24:52.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:24:52 smithi086 bash[24289]: audit 2024-09-16T10:24:51.269914+0000 mgr.a (mgr.14373) 12442 : audit [DBG] from='client.271470 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:24:53.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:24:53 smithi047 bash[22744]: cluster 2024-09-16T10:24:52.035431+0000 mgr.a (mgr.14373) 12443 : cluster [DBG] pgmap v8630: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:24:53.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:24:53 smithi157 bash[24585]: cluster 2024-09-16T10:24:52.035431+0000 mgr.a (mgr.14373) 12443 : cluster [DBG] pgmap v8630: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:24:53.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:24:53 smithi086 bash[24289]: cluster 2024-09-16T10:24:52.035431+0000 mgr.a (mgr.14373) 12443 : cluster [DBG] pgmap v8630: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:24:54.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:24:54 smithi047 bash[22744]: audit 2024-09-16T10:24:53.624937+0000 mon.b (mon.2) 1142 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T10:24:54.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:24:54 smithi047 bash[22744]: cluster 2024-09-16T10:24:54.036182+0000 mgr.a (mgr.14373) 12444 : cluster [DBG] pgmap v8631: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:24:54.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:24:54 smithi157 bash[24585]: audit 2024-09-16T10:24:53.624937+0000 mon.b (mon.2) 1142 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T10:24:54.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:24:54 smithi157 bash[24585]: cluster 2024-09-16T10:24:54.036182+0000 mgr.a (mgr.14373) 12444 : cluster [DBG] pgmap v8631: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:24:54.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:24:54 smithi086 bash[24289]: audit 2024-09-16T10:24:53.624937+0000 mon.b (mon.2) 1142 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T10:24:54.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:24:54 smithi086 bash[24289]: cluster 2024-09-16T10:24:54.036182+0000 mgr.a (mgr.14373) 12444 : cluster [DBG] pgmap v8631: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:24:55.593 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 10:24:55 smithi047 bash[22994]: debug 2024-09-16T10:24:55.217+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T10:24:55.593 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 10:24:55 smithi047 bash[22994]: debug 2024-09-16T10:24:55.217+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T10:24:55.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:24:55 smithi047 bash[22744]: audit 2024-09-16T10:24:54.465636+0000 mon.b (mon.2) 1143 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T10:24:55.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:24:55 smithi047 bash[22744]: audit 2024-09-16T10:24:54.467866+0000 mon.b (mon.2) 1144 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T10:24:55.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:24:55 smithi047 bash[22744]: audit 2024-09-16T10:24:54.479581+0000 mon.a (mon.0) 1312 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:24:55.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:24:55 smithi047 bash[22744]: audit 2024-09-16T10:24:54.484618+0000 mon.b (mon.2) 1145 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:24:55.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:24:55 smithi047 bash[22744]: audit 2024-09-16T10:24:54.487280+0000 mgr.a (mgr.14373) 12445 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:24:55.594 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:24:55 smithi047 bash[22744]: audit 2024-09-16T10:24:55.219377+0000 mgr.a (mgr.14373) 12446 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T10:24:55.594 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:24:55 smithi047 bash[22744]: cephadm 2024-09-16T10:24:55.221444+0000 mgr.a (mgr.14373) 12447 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T10:24:55.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:24:55 smithi157 bash[24585]: audit 2024-09-16T10:24:54.465636+0000 mon.b (mon.2) 1143 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T10:24:55.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:24:55 smithi157 bash[24585]: audit 2024-09-16T10:24:54.467866+0000 mon.b (mon.2) 1144 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T10:24:55.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:24:55 smithi157 bash[24585]: audit 2024-09-16T10:24:54.479581+0000 mon.a (mon.0) 1312 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:24:55.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:24:55 smithi157 bash[24585]: audit 2024-09-16T10:24:54.484618+0000 mon.b (mon.2) 1145 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:24:55.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:24:55 smithi157 bash[24585]: audit 2024-09-16T10:24:54.487280+0000 mgr.a (mgr.14373) 12445 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:24:55.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:24:55 smithi157 bash[24585]: audit 2024-09-16T10:24:55.219377+0000 mgr.a (mgr.14373) 12446 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T10:24:55.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:24:55 smithi157 bash[24585]: cephadm 2024-09-16T10:24:55.221444+0000 mgr.a (mgr.14373) 12447 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T10:24:55.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:24:55 smithi086 bash[24289]: audit 2024-09-16T10:24:54.465636+0000 mon.b (mon.2) 1143 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T10:24:55.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:24:55 smithi086 bash[24289]: audit 2024-09-16T10:24:54.467866+0000 mon.b (mon.2) 1144 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T10:24:55.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:24:55 smithi086 bash[24289]: audit 2024-09-16T10:24:54.479581+0000 mon.a (mon.0) 1312 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:24:55.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:24:55 smithi086 bash[24289]: audit 2024-09-16T10:24:54.484618+0000 mon.b (mon.2) 1145 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:24:55.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:24:55 smithi086 bash[24289]: audit 2024-09-16T10:24:54.487280+0000 mgr.a (mgr.14373) 12445 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:24:55.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:24:55 smithi086 bash[24289]: audit 2024-09-16T10:24:55.219377+0000 mgr.a (mgr.14373) 12446 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T10:24:55.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:24:55 smithi086 bash[24289]: cephadm 2024-09-16T10:24:55.221444+0000 mgr.a (mgr.14373) 12447 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T10:24:56.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:24:56 smithi047 bash[22744]: cluster 2024-09-16T10:24:56.037125+0000 mgr.a (mgr.14373) 12448 : cluster [DBG] pgmap v8632: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T10:24:56.718 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:24:56.718 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:24:56.718 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:24:56.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:24:56 smithi157 bash[24585]: cluster 2024-09-16T10:24:56.037125+0000 mgr.a (mgr.14373) 12448 : cluster [DBG] pgmap v8632: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T10:24:56.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:24:56 smithi086 bash[24289]: cluster 2024-09-16T10:24:56.037125+0000 mgr.a (mgr.14373) 12448 : cluster [DBG] pgmap v8632: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T10:24:57.488 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:24:57.489 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:24:57.489 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:24:57.489 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:24:57.489 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:24:57.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:24:57 smithi157 bash[24585]: audit 2024-09-16T10:24:57.039654+0000 mgr.a (mgr.14373) 12449 : audit [DBG] from='client.271650 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:24:57.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:24:57 smithi086 bash[24289]: audit 2024-09-16T10:24:57.039654+0000 mgr.a (mgr.14373) 12449 : audit [DBG] from='client.271650 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:24:57.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:24:57 smithi047 bash[22744]: audit 2024-09-16T10:24:57.039654+0000 mgr.a (mgr.14373) 12449 : audit [DBG] from='client.271650 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:24:58.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:24:58 smithi157 bash[24585]: cluster 2024-09-16T10:24:58.040028+0000 mgr.a (mgr.14373) 12450 : cluster [DBG] pgmap v8633: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:24:58.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:24:58 smithi086 bash[24289]: cluster 2024-09-16T10:24:58.040028+0000 mgr.a (mgr.14373) 12450 : cluster [DBG] pgmap v8633: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:24:58.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:24:58 smithi047 bash[22744]: cluster 2024-09-16T10:24:58.040028+0000 mgr.a (mgr.14373) 12450 : cluster [DBG] pgmap v8633: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:25:01.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:25:01 smithi086 bash[24289]: cluster 2024-09-16T10:25:00.040807+0000 mgr.a (mgr.14373) 12451 : cluster [DBG] pgmap v8634: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T10:25:01.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:25:01 smithi157 bash[24585]: cluster 2024-09-16T10:25:00.040807+0000 mgr.a (mgr.14373) 12451 : cluster [DBG] pgmap v8634: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T10:25:01.574 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:25:01 smithi047 bash[22744]: cluster 2024-09-16T10:25:00.040807+0000 mgr.a (mgr.14373) 12451 : cluster [DBG] pgmap v8634: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T10:25:02.490 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:25:02.491 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:25:02.491 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:25:03.253 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:25:03.253 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:25:03.253 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:25:03.253 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:25:03.253 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:25:03.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:25:03 smithi157 bash[24585]: cluster 2024-09-16T10:25:02.043029+0000 mgr.a (mgr.14373) 12452 : cluster [DBG] pgmap v8635: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:25:03.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:25:03 smithi086 bash[24289]: cluster 2024-09-16T10:25:02.043029+0000 mgr.a (mgr.14373) 12452 : cluster [DBG] pgmap v8635: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:25:03.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:25:03 smithi047 bash[22744]: cluster 2024-09-16T10:25:02.043029+0000 mgr.a (mgr.14373) 12452 : cluster [DBG] pgmap v8635: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:25:04.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:25:04 smithi157 bash[24585]: audit 2024-09-16T10:25:02.824372+0000 mgr.a (mgr.14373) 12453 : audit [DBG] from='client.271725 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:25:04.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:25:04 smithi086 bash[24289]: audit 2024-09-16T10:25:02.824372+0000 mgr.a (mgr.14373) 12453 : audit [DBG] from='client.271725 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:25:04.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:25:04 smithi047 bash[22744]: audit 2024-09-16T10:25:02.824372+0000 mgr.a (mgr.14373) 12453 : audit [DBG] from='client.271725 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:25:05.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:25:05 smithi157 bash[24585]: cluster 2024-09-16T10:25:04.043996+0000 mgr.a (mgr.14373) 12454 : cluster [DBG] pgmap v8636: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:25:05.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:25:05 smithi086 bash[24289]: cluster 2024-09-16T10:25:04.043996+0000 mgr.a (mgr.14373) 12454 : cluster [DBG] pgmap v8636: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:25:05.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:25:05 smithi047 bash[22744]: cluster 2024-09-16T10:25:04.043996+0000 mgr.a (mgr.14373) 12454 : cluster [DBG] pgmap v8636: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:25:07.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:25:07 smithi157 bash[24585]: cluster 2024-09-16T10:25:06.044802+0000 mgr.a (mgr.14373) 12455 : cluster [DBG] pgmap v8637: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:25:07.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:25:07 smithi086 bash[24289]: cluster 2024-09-16T10:25:06.044802+0000 mgr.a (mgr.14373) 12455 : cluster [DBG] pgmap v8637: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:25:07.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:25:07 smithi047 bash[22744]: cluster 2024-09-16T10:25:06.044802+0000 mgr.a (mgr.14373) 12455 : cluster [DBG] pgmap v8637: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:25:08.255 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:25:08.255 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:25:08.255 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:25:09.032 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:25:09.032 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:25:09.032 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:25:09.032 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:25:09.033 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:25:09.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:25:09 smithi157 bash[24585]: cluster 2024-09-16T10:25:08.047068+0000 mgr.a (mgr.14373) 12456 : cluster [DBG] pgmap v8638: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:25:09.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:25:09 smithi086 bash[24289]: cluster 2024-09-16T10:25:08.047068+0000 mgr.a (mgr.14373) 12456 : cluster [DBG] pgmap v8638: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:25:09.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:25:09 smithi047 bash[22744]: cluster 2024-09-16T10:25:08.047068+0000 mgr.a (mgr.14373) 12456 : cluster [DBG] pgmap v8638: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:25:10.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:25:10 smithi157 bash[24585]: audit 2024-09-16T10:25:08.589761+0000 mgr.a (mgr.14373) 12457 : audit [DBG] from='client.271803 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:25:10.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:25:10 smithi086 bash[24289]: audit 2024-09-16T10:25:08.589761+0000 mgr.a (mgr.14373) 12457 : audit [DBG] from='client.271803 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:25:10.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:25:10 smithi047 bash[22744]: audit 2024-09-16T10:25:08.589761+0000 mgr.a (mgr.14373) 12457 : audit [DBG] from='client.271803 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:25:11.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:25:11 smithi157 bash[24585]: cluster 2024-09-16T10:25:10.048011+0000 mgr.a (mgr.14373) 12458 : cluster [DBG] pgmap v8639: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:25:11.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:25:11 smithi086 bash[24289]: cluster 2024-09-16T10:25:10.048011+0000 mgr.a (mgr.14373) 12458 : cluster [DBG] pgmap v8639: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:25:11.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:25:11 smithi047 bash[22744]: cluster 2024-09-16T10:25:10.048011+0000 mgr.a (mgr.14373) 12458 : cluster [DBG] pgmap v8639: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:25:13.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:25:13 smithi157 bash[24585]: cluster 2024-09-16T10:25:12.050283+0000 mgr.a (mgr.14373) 12459 : cluster [DBG] pgmap v8640: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:25:13.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:25:13 smithi086 bash[24289]: cluster 2024-09-16T10:25:12.050283+0000 mgr.a (mgr.14373) 12459 : cluster [DBG] pgmap v8640: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:25:13.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:25:13 smithi047 bash[22744]: cluster 2024-09-16T10:25:12.050283+0000 mgr.a (mgr.14373) 12459 : cluster [DBG] pgmap v8640: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:25:14.033 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:25:14.035 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:25:14.035 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:25:14.789 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:25:14.789 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:25:14.789 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:25:14.789 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:25:14.789 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:25:15.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:25:15 smithi157 bash[24585]: cluster 2024-09-16T10:25:14.051067+0000 mgr.a (mgr.14373) 12460 : cluster [DBG] pgmap v8641: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:25:15.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:25:15 smithi086 bash[24289]: cluster 2024-09-16T10:25:14.051067+0000 mgr.a (mgr.14373) 12460 : cluster [DBG] pgmap v8641: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:25:15.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:25:15 smithi047 bash[22744]: cluster 2024-09-16T10:25:14.051067+0000 mgr.a (mgr.14373) 12460 : cluster [DBG] pgmap v8641: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:25:16.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:25:16 smithi157 bash[24585]: audit 2024-09-16T10:25:14.361705+0000 mgr.a (mgr.14373) 12461 : audit [DBG] from='client.271881 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:25:16.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:25:16 smithi086 bash[24289]: audit 2024-09-16T10:25:14.361705+0000 mgr.a (mgr.14373) 12461 : audit [DBG] from='client.271881 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:25:16.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:25:16 smithi047 bash[22744]: audit 2024-09-16T10:25:14.361705+0000 mgr.a (mgr.14373) 12461 : audit [DBG] from='client.271881 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:25:17.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:25:17 smithi157 bash[24585]: cluster 2024-09-16T10:25:16.052027+0000 mgr.a (mgr.14373) 12462 : cluster [DBG] pgmap v8642: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:25:17.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:25:17 smithi086 bash[24289]: cluster 2024-09-16T10:25:16.052027+0000 mgr.a (mgr.14373) 12462 : cluster [DBG] pgmap v8642: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:25:17.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:25:17 smithi047 bash[22744]: cluster 2024-09-16T10:25:16.052027+0000 mgr.a (mgr.14373) 12462 : cluster [DBG] pgmap v8642: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:25:19.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:25:19 smithi157 bash[24585]: cluster 2024-09-16T10:25:18.054258+0000 mgr.a (mgr.14373) 12463 : cluster [DBG] pgmap v8643: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:25:19.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:25:19 smithi086 bash[24289]: cluster 2024-09-16T10:25:18.054258+0000 mgr.a (mgr.14373) 12463 : cluster [DBG] pgmap v8643: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:25:19.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:25:19 smithi047 bash[22744]: cluster 2024-09-16T10:25:18.054258+0000 mgr.a (mgr.14373) 12463 : cluster [DBG] pgmap v8643: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:25:19.790 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:25:19.791 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:25:19.791 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:25:20.571 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:25:20.571 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:25:20.571 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:25:20.571 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:25:20.571 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:25:21.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:25:21 smithi157 bash[24585]: cluster 2024-09-16T10:25:20.054999+0000 mgr.a (mgr.14373) 12464 : cluster [DBG] pgmap v8644: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:25:21.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:25:21 smithi157 bash[24585]: audit 2024-09-16T10:25:20.125058+0000 mgr.a (mgr.14373) 12465 : audit [DBG] from='client.271959 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:25:21.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:25:21 smithi086 bash[24289]: cluster 2024-09-16T10:25:20.054999+0000 mgr.a (mgr.14373) 12464 : cluster [DBG] pgmap v8644: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:25:21.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:25:21 smithi086 bash[24289]: audit 2024-09-16T10:25:20.125058+0000 mgr.a (mgr.14373) 12465 : audit [DBG] from='client.271959 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:25:21.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:25:21 smithi047 bash[22744]: cluster 2024-09-16T10:25:20.054999+0000 mgr.a (mgr.14373) 12464 : cluster [DBG] pgmap v8644: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:25:21.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:25:21 smithi047 bash[22744]: audit 2024-09-16T10:25:20.125058+0000 mgr.a (mgr.14373) 12465 : audit [DBG] from='client.271959 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:25:23.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:25:23 smithi157 bash[24585]: cluster 2024-09-16T10:25:22.057390+0000 mgr.a (mgr.14373) 12466 : cluster [DBG] pgmap v8645: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:25:23.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:25:23 smithi086 bash[24289]: cluster 2024-09-16T10:25:22.057390+0000 mgr.a (mgr.14373) 12466 : cluster [DBG] pgmap v8645: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:25:23.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:25:23 smithi047 bash[22744]: cluster 2024-09-16T10:25:22.057390+0000 mgr.a (mgr.14373) 12466 : cluster [DBG] pgmap v8645: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:25:25.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:25:25 smithi157 bash[24585]: cluster 2024-09-16T10:25:24.058176+0000 mgr.a (mgr.14373) 12467 : cluster [DBG] pgmap v8646: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:25:25.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:25:25 smithi086 bash[24289]: cluster 2024-09-16T10:25:24.058176+0000 mgr.a (mgr.14373) 12467 : cluster [DBG] pgmap v8646: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:25:25.572 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:25:25.573 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:25:25.573 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:25:25.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:25:25 smithi047 bash[22744]: cluster 2024-09-16T10:25:24.058176+0000 mgr.a (mgr.14373) 12467 : cluster [DBG] pgmap v8646: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:25:26.314 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:25:26.315 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:25:26.315 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:25:26.315 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:25:26.315 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:25:27.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:25:27 smithi157 bash[24585]: audit 2024-09-16T10:25:25.905387+0000 mgr.a (mgr.14373) 12468 : audit [DBG] from='client.272034 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:25:27.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:25:27 smithi157 bash[24585]: cluster 2024-09-16T10:25:26.059157+0000 mgr.a (mgr.14373) 12469 : cluster [DBG] pgmap v8647: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:25:27.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:25:27 smithi086 bash[24289]: audit 2024-09-16T10:25:25.905387+0000 mgr.a (mgr.14373) 12468 : audit [DBG] from='client.272034 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:25:27.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:25:27 smithi086 bash[24289]: cluster 2024-09-16T10:25:26.059157+0000 mgr.a (mgr.14373) 12469 : cluster [DBG] pgmap v8647: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:25:27.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:25:27 smithi047 bash[22744]: audit 2024-09-16T10:25:25.905387+0000 mgr.a (mgr.14373) 12468 : audit [DBG] from='client.272034 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:25:27.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:25:27 smithi047 bash[22744]: cluster 2024-09-16T10:25:26.059157+0000 mgr.a (mgr.14373) 12469 : cluster [DBG] pgmap v8647: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:25:29.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:25:29 smithi157 bash[24585]: cluster 2024-09-16T10:25:28.061610+0000 mgr.a (mgr.14373) 12470 : cluster [DBG] pgmap v8648: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:25:29.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:25:29 smithi086 bash[24289]: cluster 2024-09-16T10:25:28.061610+0000 mgr.a (mgr.14373) 12470 : cluster [DBG] pgmap v8648: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:25:29.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:25:29 smithi047 bash[22744]: cluster 2024-09-16T10:25:28.061610+0000 mgr.a (mgr.14373) 12470 : cluster [DBG] pgmap v8648: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:25:31.315 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:25:31.317 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:25:31.317 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:25:31.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:25:31 smithi157 bash[24585]: cluster 2024-09-16T10:25:30.062416+0000 mgr.a (mgr.14373) 12471 : cluster [DBG] pgmap v8649: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:25:31.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:25:31 smithi086 bash[24289]: cluster 2024-09-16T10:25:30.062416+0000 mgr.a (mgr.14373) 12471 : cluster [DBG] pgmap v8649: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:25:31.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:25:31 smithi047 bash[22744]: cluster 2024-09-16T10:25:30.062416+0000 mgr.a (mgr.14373) 12471 : cluster [DBG] pgmap v8649: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:25:32.087 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:25:32.088 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:25:32.088 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:25:32.088 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:25:32.088 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:25:33.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:25:33 smithi157 bash[24585]: audit 2024-09-16T10:25:31.649652+0000 mgr.a (mgr.14373) 12472 : audit [DBG] from='client.272106 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:25:33.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:25:33 smithi157 bash[24585]: cluster 2024-09-16T10:25:32.063586+0000 mgr.a (mgr.14373) 12473 : cluster [DBG] pgmap v8650: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:25:33.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:25:33 smithi086 bash[24289]: audit 2024-09-16T10:25:31.649652+0000 mgr.a (mgr.14373) 12472 : audit [DBG] from='client.272106 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:25:33.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:25:33 smithi086 bash[24289]: cluster 2024-09-16T10:25:32.063586+0000 mgr.a (mgr.14373) 12473 : cluster [DBG] pgmap v8650: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:25:33.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:25:33 smithi047 bash[22744]: audit 2024-09-16T10:25:31.649652+0000 mgr.a (mgr.14373) 12472 : audit [DBG] from='client.272106 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:25:33.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:25:33 smithi047 bash[22744]: cluster 2024-09-16T10:25:32.063586+0000 mgr.a (mgr.14373) 12473 : cluster [DBG] pgmap v8650: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:25:35.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:25:35 smithi157 bash[24585]: cluster 2024-09-16T10:25:34.064322+0000 mgr.a (mgr.14373) 12474 : cluster [DBG] pgmap v8651: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T10:25:35.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:25:35 smithi086 bash[24289]: cluster 2024-09-16T10:25:34.064322+0000 mgr.a (mgr.14373) 12474 : cluster [DBG] pgmap v8651: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T10:25:35.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:25:35 smithi047 bash[22744]: cluster 2024-09-16T10:25:34.064322+0000 mgr.a (mgr.14373) 12474 : cluster [DBG] pgmap v8651: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T10:25:37.089 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:25:37.090 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:25:37.090 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:25:37.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:25:37 smithi157 bash[24585]: cluster 2024-09-16T10:25:36.065092+0000 mgr.a (mgr.14373) 12475 : cluster [DBG] pgmap v8652: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T10:25:37.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:25:37 smithi086 bash[24289]: cluster 2024-09-16T10:25:36.065092+0000 mgr.a (mgr.14373) 12475 : cluster [DBG] pgmap v8652: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T10:25:37.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:25:37 smithi047 bash[22744]: cluster 2024-09-16T10:25:36.065092+0000 mgr.a (mgr.14373) 12475 : cluster [DBG] pgmap v8652: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T10:25:37.865 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:25:37.865 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:25:37.866 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:25:37.866 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:25:37.866 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:25:39.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:25:39 smithi157 bash[24585]: audit 2024-09-16T10:25:37.425790+0000 mgr.a (mgr.14373) 12476 : audit [DBG] from='client.272184 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:25:39.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:25:39 smithi157 bash[24585]: cluster 2024-09-16T10:25:38.068034+0000 mgr.a (mgr.14373) 12477 : cluster [DBG] pgmap v8653: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:25:39.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:25:39 smithi086 bash[24289]: audit 2024-09-16T10:25:37.425790+0000 mgr.a (mgr.14373) 12476 : audit [DBG] from='client.272184 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:25:39.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:25:39 smithi086 bash[24289]: cluster 2024-09-16T10:25:38.068034+0000 mgr.a (mgr.14373) 12477 : cluster [DBG] pgmap v8653: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:25:39.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:25:39 smithi047 bash[22744]: audit 2024-09-16T10:25:37.425790+0000 mgr.a (mgr.14373) 12476 : audit [DBG] from='client.272184 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:25:39.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:25:39 smithi047 bash[22744]: cluster 2024-09-16T10:25:38.068034+0000 mgr.a (mgr.14373) 12477 : cluster [DBG] pgmap v8653: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:25:41.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:25:41 smithi157 bash[24585]: cluster 2024-09-16T10:25:40.068998+0000 mgr.a (mgr.14373) 12478 : cluster [DBG] pgmap v8654: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:25:41.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:25:41 smithi086 bash[24289]: cluster 2024-09-16T10:25:40.068998+0000 mgr.a (mgr.14373) 12478 : cluster [DBG] pgmap v8654: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:25:41.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:25:41 smithi047 bash[22744]: cluster 2024-09-16T10:25:40.068998+0000 mgr.a (mgr.14373) 12478 : cluster [DBG] pgmap v8654: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:25:42.867 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:25:42.868 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:25:42.868 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:25:43.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:25:43 smithi157 bash[24585]: cluster 2024-09-16T10:25:42.071129+0000 mgr.a (mgr.14373) 12479 : cluster [DBG] pgmap v8655: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:25:43.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:25:43 smithi086 bash[24289]: cluster 2024-09-16T10:25:42.071129+0000 mgr.a (mgr.14373) 12479 : cluster [DBG] pgmap v8655: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:25:43.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:25:43 smithi047 bash[22744]: cluster 2024-09-16T10:25:42.071129+0000 mgr.a (mgr.14373) 12479 : cluster [DBG] pgmap v8655: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:25:43.610 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:25:43.610 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:25:43.610 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:25:43.610 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:25:43.611 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:25:44.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:25:44 smithi157 bash[24585]: audit 2024-09-16T10:25:43.200581+0000 mgr.a (mgr.14373) 12480 : audit [DBG] from='client.272262 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:25:44.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:25:44 smithi086 bash[24289]: audit 2024-09-16T10:25:43.200581+0000 mgr.a (mgr.14373) 12480 : audit [DBG] from='client.272262 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:25:44.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:25:44 smithi047 bash[22744]: audit 2024-09-16T10:25:43.200581+0000 mgr.a (mgr.14373) 12480 : audit [DBG] from='client.272262 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:25:45.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:25:45 smithi157 bash[24585]: cluster 2024-09-16T10:25:44.072107+0000 mgr.a (mgr.14373) 12481 : cluster [DBG] pgmap v8656: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:25:45.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:25:45 smithi086 bash[24289]: cluster 2024-09-16T10:25:44.072107+0000 mgr.a (mgr.14373) 12481 : cluster [DBG] pgmap v8656: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:25:45.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:25:45 smithi047 bash[22744]: cluster 2024-09-16T10:25:44.072107+0000 mgr.a (mgr.14373) 12481 : cluster [DBG] pgmap v8656: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:25:47.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:25:47 smithi157 bash[24585]: cluster 2024-09-16T10:25:46.072912+0000 mgr.a (mgr.14373) 12482 : cluster [DBG] pgmap v8657: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:25:47.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:25:47 smithi086 bash[24289]: cluster 2024-09-16T10:25:46.072912+0000 mgr.a (mgr.14373) 12482 : cluster [DBG] pgmap v8657: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:25:47.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:25:47 smithi047 bash[22744]: cluster 2024-09-16T10:25:46.072912+0000 mgr.a (mgr.14373) 12482 : cluster [DBG] pgmap v8657: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:25:48.611 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:25:48.612 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:25:48.612 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:25:49.370 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:25:49.370 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:25:49.370 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:25:49.370 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:25:49.370 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:25:49.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:25:49 smithi157 bash[24585]: cluster 2024-09-16T10:25:48.075167+0000 mgr.a (mgr.14373) 12483 : cluster [DBG] pgmap v8658: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:25:49.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:25:49 smithi086 bash[24289]: cluster 2024-09-16T10:25:48.075167+0000 mgr.a (mgr.14373) 12483 : cluster [DBG] pgmap v8658: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:25:49.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:25:49 smithi047 bash[22744]: cluster 2024-09-16T10:25:48.075167+0000 mgr.a (mgr.14373) 12483 : cluster [DBG] pgmap v8658: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:25:50.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:25:50 smithi157 bash[24585]: audit 2024-09-16T10:25:48.945376+0000 mgr.a (mgr.14373) 12484 : audit [DBG] from='client.272337 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:25:50.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:25:50 smithi086 bash[24289]: audit 2024-09-16T10:25:48.945376+0000 mgr.a (mgr.14373) 12484 : audit [DBG] from='client.272337 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:25:50.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:25:50 smithi047 bash[22744]: audit 2024-09-16T10:25:48.945376+0000 mgr.a (mgr.14373) 12484 : audit [DBG] from='client.272337 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:25:51.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:25:51 smithi157 bash[24585]: cluster 2024-09-16T10:25:50.076079+0000 mgr.a (mgr.14373) 12485 : cluster [DBG] pgmap v8659: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:25:51.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:25:51 smithi086 bash[24289]: cluster 2024-09-16T10:25:50.076079+0000 mgr.a (mgr.14373) 12485 : cluster [DBG] pgmap v8659: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:25:51.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:25:51 smithi047 bash[22744]: cluster 2024-09-16T10:25:50.076079+0000 mgr.a (mgr.14373) 12485 : cluster [DBG] pgmap v8659: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:25:53.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:25:53 smithi157 bash[24585]: cluster 2024-09-16T10:25:52.078228+0000 mgr.a (mgr.14373) 12486 : cluster [DBG] pgmap v8660: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:25:53.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:25:53 smithi086 bash[24289]: cluster 2024-09-16T10:25:52.078228+0000 mgr.a (mgr.14373) 12486 : cluster [DBG] pgmap v8660: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:25:53.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:25:53 smithi047 bash[22744]: cluster 2024-09-16T10:25:52.078228+0000 mgr.a (mgr.14373) 12486 : cluster [DBG] pgmap v8660: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:25:54.371 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:25:54.372 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:25:54.373 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:25:55.162 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:25:55.162 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:25:55.162 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:25:55.162 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:25:55.163 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:25:55.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:25:55 smithi157 bash[24585]: cluster 2024-09-16T10:25:54.078992+0000 mgr.a (mgr.14373) 12487 : cluster [DBG] pgmap v8661: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:25:55.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:25:55 smithi086 bash[24289]: cluster 2024-09-16T10:25:54.078992+0000 mgr.a (mgr.14373) 12487 : cluster [DBG] pgmap v8661: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:25:55.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:25:55 smithi047 bash[22744]: cluster 2024-09-16T10:25:54.078992+0000 mgr.a (mgr.14373) 12487 : cluster [DBG] pgmap v8661: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:25:56.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:25:56 smithi157 bash[24585]: audit 2024-09-16T10:25:54.711596+0000 mgr.a (mgr.14373) 12488 : audit [DBG] from='client.272409 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:25:56.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:25:56 smithi157 bash[24585]: audit 2024-09-16T10:25:55.276461+0000 mon.b (mon.2) 1146 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T10:25:56.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:25:56 smithi157 bash[24585]: audit 2024-09-16T10:25:56.104619+0000 mon.b (mon.2) 1147 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T10:25:56.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:25:56 smithi157 bash[24585]: audit 2024-09-16T10:25:56.106806+0000 mon.b (mon.2) 1148 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T10:25:56.558 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:25:56 smithi157 bash[24585]: audit 2024-09-16T10:25:56.117139+0000 mon.a (mon.0) 1313 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:25:56.558 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:25:56 smithi157 bash[24585]: audit 2024-09-16T10:25:56.124233+0000 mon.b (mon.2) 1149 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:25:56.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:25:56 smithi086 bash[24289]: audit 2024-09-16T10:25:54.711596+0000 mgr.a (mgr.14373) 12488 : audit [DBG] from='client.272409 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:25:56.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:25:56 smithi086 bash[24289]: audit 2024-09-16T10:25:55.276461+0000 mon.b (mon.2) 1146 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T10:25:56.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:25:56 smithi086 bash[24289]: audit 2024-09-16T10:25:56.104619+0000 mon.b (mon.2) 1147 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T10:25:56.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:25:56 smithi086 bash[24289]: audit 2024-09-16T10:25:56.106806+0000 mon.b (mon.2) 1148 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T10:25:56.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:25:56 smithi086 bash[24289]: audit 2024-09-16T10:25:56.117139+0000 mon.a (mon.0) 1313 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:25:56.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:25:56 smithi086 bash[24289]: audit 2024-09-16T10:25:56.124233+0000 mon.b (mon.2) 1149 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:25:56.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:25:56 smithi047 bash[22744]: audit 2024-09-16T10:25:54.711596+0000 mgr.a (mgr.14373) 12488 : audit [DBG] from='client.272409 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:25:56.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:25:56 smithi047 bash[22744]: audit 2024-09-16T10:25:55.276461+0000 mon.b (mon.2) 1146 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T10:25:56.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:25:56 smithi047 bash[22744]: audit 2024-09-16T10:25:56.104619+0000 mon.b (mon.2) 1147 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T10:25:56.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:25:56 smithi047 bash[22744]: audit 2024-09-16T10:25:56.106806+0000 mon.b (mon.2) 1148 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T10:25:56.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:25:56 smithi047 bash[22744]: audit 2024-09-16T10:25:56.117139+0000 mon.a (mon.0) 1313 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:25:56.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:25:56 smithi047 bash[22744]: audit 2024-09-16T10:25:56.124233+0000 mon.b (mon.2) 1149 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:25:57.264 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 10:25:56 smithi047 bash[22994]: debug 2024-09-16T10:25:56.876+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T10:25:57.264 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 10:25:56 smithi047 bash[22994]: debug 2024-09-16T10:25:56.876+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T10:25:57.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:25:57 smithi157 bash[24585]: cluster 2024-09-16T10:25:56.079898+0000 mgr.a (mgr.14373) 12489 : cluster [DBG] pgmap v8662: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:25:57.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:25:57 smithi157 bash[24585]: audit 2024-09-16T10:25:56.126296+0000 mgr.a (mgr.14373) 12490 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:25:57.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:25:57 smithi086 bash[24289]: cluster 2024-09-16T10:25:56.079898+0000 mgr.a (mgr.14373) 12489 : cluster [DBG] pgmap v8662: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:25:57.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:25:57 smithi086 bash[24289]: audit 2024-09-16T10:25:56.126296+0000 mgr.a (mgr.14373) 12490 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:25:57.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:25:57 smithi047 bash[22744]: cluster 2024-09-16T10:25:56.079898+0000 mgr.a (mgr.14373) 12489 : cluster [DBG] pgmap v8662: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:25:57.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:25:57 smithi047 bash[22744]: audit 2024-09-16T10:25:56.126296+0000 mgr.a (mgr.14373) 12490 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:25:58.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:25:58 smithi157 bash[24585]: audit 2024-09-16T10:25:56.878942+0000 mgr.a (mgr.14373) 12491 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T10:25:58.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:25:58 smithi157 bash[24585]: cephadm 2024-09-16T10:25:56.881434+0000 mgr.a (mgr.14373) 12492 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T10:25:58.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:25:58 smithi086 bash[24289]: audit 2024-09-16T10:25:56.878942+0000 mgr.a (mgr.14373) 12491 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T10:25:58.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:25:58 smithi086 bash[24289]: cephadm 2024-09-16T10:25:56.881434+0000 mgr.a (mgr.14373) 12492 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T10:25:58.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:25:58 smithi047 bash[22744]: audit 2024-09-16T10:25:56.878942+0000 mgr.a (mgr.14373) 12491 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T10:25:58.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:25:58 smithi047 bash[22744]: cephadm 2024-09-16T10:25:56.881434+0000 mgr.a (mgr.14373) 12492 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T10:25:59.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:25:59 smithi157 bash[24585]: cluster 2024-09-16T10:25:58.082670+0000 mgr.a (mgr.14373) 12493 : cluster [DBG] pgmap v8663: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 3.4 KiB/s rd, 3 op/s 2024-09-16T10:25:59.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:25:59 smithi086 bash[24289]: cluster 2024-09-16T10:25:58.082670+0000 mgr.a (mgr.14373) 12493 : cluster [DBG] pgmap v8663: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 3.4 KiB/s rd, 3 op/s 2024-09-16T10:25:59.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:25:59 smithi047 bash[22744]: cluster 2024-09-16T10:25:58.082670+0000 mgr.a (mgr.14373) 12493 : cluster [DBG] pgmap v8663: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 3.4 KiB/s rd, 3 op/s 2024-09-16T10:26:00.164 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:26:00.165 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:26:00.165 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:26:00.942 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:26:00.942 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:26:00.943 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:26:00.943 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:26:00.943 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:26:01.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:26:01 smithi157 bash[24585]: cluster 2024-09-16T10:26:00.083615+0000 mgr.a (mgr.14373) 12494 : cluster [DBG] pgmap v8664: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-16T10:26:01.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:26:01 smithi086 bash[24289]: cluster 2024-09-16T10:26:00.083615+0000 mgr.a (mgr.14373) 12494 : cluster [DBG] pgmap v8664: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-16T10:26:01.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:26:01 smithi047 bash[22744]: cluster 2024-09-16T10:26:00.083615+0000 mgr.a (mgr.14373) 12494 : cluster [DBG] pgmap v8664: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-16T10:26:02.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:26:02 smithi157 bash[24585]: audit 2024-09-16T10:26:00.493919+0000 mgr.a (mgr.14373) 12495 : audit [DBG] from='client.272589 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:26:02.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:26:02 smithi086 bash[24289]: audit 2024-09-16T10:26:00.493919+0000 mgr.a (mgr.14373) 12495 : audit [DBG] from='client.272589 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:26:02.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:26:02 smithi047 bash[22744]: audit 2024-09-16T10:26:00.493919+0000 mgr.a (mgr.14373) 12495 : audit [DBG] from='client.272589 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:26:03.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:26:03 smithi157 bash[24585]: cluster 2024-09-16T10:26:02.085912+0000 mgr.a (mgr.14373) 12496 : cluster [DBG] pgmap v8665: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:26:03.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:26:03 smithi086 bash[24289]: cluster 2024-09-16T10:26:02.085912+0000 mgr.a (mgr.14373) 12496 : cluster [DBG] pgmap v8665: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:26:03.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:26:03 smithi047 bash[22744]: cluster 2024-09-16T10:26:02.085912+0000 mgr.a (mgr.14373) 12496 : cluster [DBG] pgmap v8665: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:26:05.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:26:05 smithi157 bash[24585]: cluster 2024-09-16T10:26:04.086705+0000 mgr.a (mgr.14373) 12497 : cluster [DBG] pgmap v8666: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:26:05.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:26:05 smithi086 bash[24289]: cluster 2024-09-16T10:26:04.086705+0000 mgr.a (mgr.14373) 12497 : cluster [DBG] pgmap v8666: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:26:05.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:26:05 smithi047 bash[22744]: cluster 2024-09-16T10:26:04.086705+0000 mgr.a (mgr.14373) 12497 : cluster [DBG] pgmap v8666: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:26:05.944 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:26:05.944 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:26:05.945 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:26:06.709 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:26:06.710 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:26:06.710 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:26:06.710 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:26:06.710 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:26:07.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:26:07 smithi157 bash[24585]: cluster 2024-09-16T10:26:06.087446+0000 mgr.a (mgr.14373) 12498 : cluster [DBG] pgmap v8667: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:26:07.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:26:07 smithi157 bash[24585]: audit 2024-09-16T10:26:06.280674+0000 mgr.a (mgr.14373) 12499 : audit [DBG] from='client.272664 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:26:07.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:26:07 smithi086 bash[24289]: cluster 2024-09-16T10:26:06.087446+0000 mgr.a (mgr.14373) 12498 : cluster [DBG] pgmap v8667: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:26:07.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:26:07 smithi086 bash[24289]: audit 2024-09-16T10:26:06.280674+0000 mgr.a (mgr.14373) 12499 : audit [DBG] from='client.272664 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:26:07.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:26:07 smithi047 bash[22744]: cluster 2024-09-16T10:26:06.087446+0000 mgr.a (mgr.14373) 12498 : cluster [DBG] pgmap v8667: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:26:07.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:26:07 smithi047 bash[22744]: audit 2024-09-16T10:26:06.280674+0000 mgr.a (mgr.14373) 12499 : audit [DBG] from='client.272664 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:26:09.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:26:09 smithi157 bash[24585]: cluster 2024-09-16T10:26:08.090150+0000 mgr.a (mgr.14373) 12500 : cluster [DBG] pgmap v8668: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:26:09.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:26:09 smithi086 bash[24289]: cluster 2024-09-16T10:26:08.090150+0000 mgr.a (mgr.14373) 12500 : cluster [DBG] pgmap v8668: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:26:09.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:26:09 smithi047 bash[22744]: cluster 2024-09-16T10:26:08.090150+0000 mgr.a (mgr.14373) 12500 : cluster [DBG] pgmap v8668: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:26:11.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:26:11 smithi157 bash[24585]: cluster 2024-09-16T10:26:10.090948+0000 mgr.a (mgr.14373) 12501 : cluster [DBG] pgmap v8669: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 5.4 KiB/s rd, 426 B/s wr, 5 op/s 2024-09-16T10:26:11.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:26:11 smithi086 bash[24289]: cluster 2024-09-16T10:26:10.090948+0000 mgr.a (mgr.14373) 12501 : cluster [DBG] pgmap v8669: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 5.4 KiB/s rd, 426 B/s wr, 5 op/s 2024-09-16T10:26:11.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:26:11 smithi047 bash[22744]: cluster 2024-09-16T10:26:10.090948+0000 mgr.a (mgr.14373) 12501 : cluster [DBG] pgmap v8669: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 5.4 KiB/s rd, 426 B/s wr, 5 op/s 2024-09-16T10:26:11.711 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:26:11.712 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:26:11.712 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:26:12.495 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:26:12.495 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:26:12.495 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:26:12.495 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:26:12.495 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:26:13.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:26:13 smithi086 bash[24289]: audit 2024-09-16T10:26:12.047744+0000 mgr.a (mgr.14373) 12502 : audit [DBG] from='client.272742 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:26:13.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:26:13 smithi086 bash[24289]: cluster 2024-09-16T10:26:12.093052+0000 mgr.a (mgr.14373) 12503 : cluster [DBG] pgmap v8670: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T10:26:13.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:26:13 smithi047 bash[22744]: audit 2024-09-16T10:26:12.047744+0000 mgr.a (mgr.14373) 12502 : audit [DBG] from='client.272742 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:26:13.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:26:13 smithi047 bash[22744]: cluster 2024-09-16T10:26:12.093052+0000 mgr.a (mgr.14373) 12503 : cluster [DBG] pgmap v8670: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T10:26:13.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:26:13 smithi157 bash[24585]: audit 2024-09-16T10:26:12.047744+0000 mgr.a (mgr.14373) 12502 : audit [DBG] from='client.272742 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:26:13.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:26:13 smithi157 bash[24585]: cluster 2024-09-16T10:26:12.093052+0000 mgr.a (mgr.14373) 12503 : cluster [DBG] pgmap v8670: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T10:26:15.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:26:15 smithi086 bash[24289]: cluster 2024-09-16T10:26:14.093928+0000 mgr.a (mgr.14373) 12504 : cluster [DBG] pgmap v8671: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:26:15.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:26:15 smithi047 bash[22744]: cluster 2024-09-16T10:26:14.093928+0000 mgr.a (mgr.14373) 12504 : cluster [DBG] pgmap v8671: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:26:15.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:26:15 smithi157 bash[24585]: cluster 2024-09-16T10:26:14.093928+0000 mgr.a (mgr.14373) 12504 : cluster [DBG] pgmap v8671: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:26:17.496 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:26:17.497 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:26:17.497 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:26:17.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:26:17 smithi086 bash[24289]: cluster 2024-09-16T10:26:16.094736+0000 mgr.a (mgr.14373) 12505 : cluster [DBG] pgmap v8672: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T10:26:17.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:26:17 smithi047 bash[22744]: cluster 2024-09-16T10:26:16.094736+0000 mgr.a (mgr.14373) 12505 : cluster [DBG] pgmap v8672: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T10:26:17.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:26:17 smithi157 bash[24585]: cluster 2024-09-16T10:26:16.094736+0000 mgr.a (mgr.14373) 12505 : cluster [DBG] pgmap v8672: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T10:26:18.253 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:26:18.253 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:26:18.253 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:26:18.253 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:26:18.254 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:26:19.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:26:19 smithi047 bash[22744]: audit 2024-09-16T10:26:17.825993+0000 mgr.a (mgr.14373) 12506 : audit [DBG] from='client.272820 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:26:19.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:26:19 smithi047 bash[22744]: cluster 2024-09-16T10:26:18.096044+0000 mgr.a (mgr.14373) 12507 : cluster [DBG] pgmap v8673: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:26:19.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:26:19 smithi157 bash[24585]: audit 2024-09-16T10:26:17.825993+0000 mgr.a (mgr.14373) 12506 : audit [DBG] from='client.272820 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:26:19.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:26:19 smithi157 bash[24585]: cluster 2024-09-16T10:26:18.096044+0000 mgr.a (mgr.14373) 12507 : cluster [DBG] pgmap v8673: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:26:19.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:26:19 smithi086 bash[24289]: audit 2024-09-16T10:26:17.825993+0000 mgr.a (mgr.14373) 12506 : audit [DBG] from='client.272820 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:26:19.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:26:19 smithi086 bash[24289]: cluster 2024-09-16T10:26:18.096044+0000 mgr.a (mgr.14373) 12507 : cluster [DBG] pgmap v8673: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:26:21.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:26:21 smithi047 bash[22744]: cluster 2024-09-16T10:26:20.096925+0000 mgr.a (mgr.14373) 12508 : cluster [DBG] pgmap v8674: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:26:21.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:26:21 smithi157 bash[24585]: cluster 2024-09-16T10:26:20.096925+0000 mgr.a (mgr.14373) 12508 : cluster [DBG] pgmap v8674: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:26:21.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:26:21 smithi086 bash[24289]: cluster 2024-09-16T10:26:20.096925+0000 mgr.a (mgr.14373) 12508 : cluster [DBG] pgmap v8674: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:26:23.254 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:26:23.255 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:26:23.255 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:26:23.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:26:23 smithi047 bash[22744]: cluster 2024-09-16T10:26:22.099077+0000 mgr.a (mgr.14373) 12509 : cluster [DBG] pgmap v8675: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:26:23.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:26:23 smithi157 bash[24585]: cluster 2024-09-16T10:26:22.099077+0000 mgr.a (mgr.14373) 12509 : cluster [DBG] pgmap v8675: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:26:23.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:26:23 smithi086 bash[24289]: cluster 2024-09-16T10:26:22.099077+0000 mgr.a (mgr.14373) 12509 : cluster [DBG] pgmap v8675: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:26:24.039 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:26:24.039 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:26:24.040 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:26:24.040 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:26:24.040 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:26:25.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:26:25 smithi047 bash[22744]: audit 2024-09-16T10:26:23.587495+0000 mgr.a (mgr.14373) 12510 : audit [DBG] from='client.272895 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:26:25.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:26:25 smithi047 bash[22744]: cluster 2024-09-16T10:26:24.099759+0000 mgr.a (mgr.14373) 12511 : cluster [DBG] pgmap v8676: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:26:25.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:26:25 smithi157 bash[24585]: audit 2024-09-16T10:26:23.587495+0000 mgr.a (mgr.14373) 12510 : audit [DBG] from='client.272895 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:26:25.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:26:25 smithi157 bash[24585]: cluster 2024-09-16T10:26:24.099759+0000 mgr.a (mgr.14373) 12511 : cluster [DBG] pgmap v8676: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:26:25.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:26:25 smithi086 bash[24289]: audit 2024-09-16T10:26:23.587495+0000 mgr.a (mgr.14373) 12510 : audit [DBG] from='client.272895 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:26:25.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:26:25 smithi086 bash[24289]: cluster 2024-09-16T10:26:24.099759+0000 mgr.a (mgr.14373) 12511 : cluster [DBG] pgmap v8676: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:26:26.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:26:26 smithi157 bash[24585]: cluster 2024-09-16T10:26:26.100508+0000 mgr.a (mgr.14373) 12512 : cluster [DBG] pgmap v8677: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:26:26.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:26:26 smithi086 bash[24289]: cluster 2024-09-16T10:26:26.100508+0000 mgr.a (mgr.14373) 12512 : cluster [DBG] pgmap v8677: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:26:26.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:26:26 smithi047 bash[22744]: cluster 2024-09-16T10:26:26.100508+0000 mgr.a (mgr.14373) 12512 : cluster [DBG] pgmap v8677: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:26:29.041 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:26:29.042 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:26:29.042 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:26:29.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:26:29 smithi157 bash[24585]: cluster 2024-09-16T10:26:28.102756+0000 mgr.a (mgr.14373) 12513 : cluster [DBG] pgmap v8678: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:26:29.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:26:29 smithi086 bash[24289]: cluster 2024-09-16T10:26:28.102756+0000 mgr.a (mgr.14373) 12513 : cluster [DBG] pgmap v8678: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:26:29.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:26:29 smithi047 bash[22744]: cluster 2024-09-16T10:26:28.102756+0000 mgr.a (mgr.14373) 12513 : cluster [DBG] pgmap v8678: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:26:29.793 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:26:29.793 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:26:29.793 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:26:29.793 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:26:29.793 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:26:31.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:26:31 smithi157 bash[24585]: audit 2024-09-16T10:26:29.369441+0000 mgr.a (mgr.14373) 12514 : audit [DBG] from='client.272970 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:26:31.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:26:31 smithi157 bash[24585]: cluster 2024-09-16T10:26:30.103725+0000 mgr.a (mgr.14373) 12515 : cluster [DBG] pgmap v8679: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:26:31.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:26:31 smithi086 bash[24289]: audit 2024-09-16T10:26:29.369441+0000 mgr.a (mgr.14373) 12514 : audit [DBG] from='client.272970 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:26:31.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:26:31 smithi086 bash[24289]: cluster 2024-09-16T10:26:30.103725+0000 mgr.a (mgr.14373) 12515 : cluster [DBG] pgmap v8679: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:26:31.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:26:31 smithi047 bash[22744]: audit 2024-09-16T10:26:29.369441+0000 mgr.a (mgr.14373) 12514 : audit [DBG] from='client.272970 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:26:31.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:26:31 smithi047 bash[22744]: cluster 2024-09-16T10:26:30.103725+0000 mgr.a (mgr.14373) 12515 : cluster [DBG] pgmap v8679: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:26:33.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:26:33 smithi157 bash[24585]: cluster 2024-09-16T10:26:32.105912+0000 mgr.a (mgr.14373) 12516 : cluster [DBG] pgmap v8680: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:26:33.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:26:33 smithi086 bash[24289]: cluster 2024-09-16T10:26:32.105912+0000 mgr.a (mgr.14373) 12516 : cluster [DBG] pgmap v8680: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:26:33.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:26:33 smithi047 bash[22744]: cluster 2024-09-16T10:26:32.105912+0000 mgr.a (mgr.14373) 12516 : cluster [DBG] pgmap v8680: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:26:34.794 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:26:34.795 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:26:34.795 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:26:35.550 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:26:35.551 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:26:35.551 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:26:35.551 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:26:35.551 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:26:35.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:26:35 smithi157 bash[24585]: cluster 2024-09-16T10:26:34.106675+0000 mgr.a (mgr.14373) 12517 : cluster [DBG] pgmap v8681: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:26:35.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:26:35 smithi086 bash[24289]: cluster 2024-09-16T10:26:34.106675+0000 mgr.a (mgr.14373) 12517 : cluster [DBG] pgmap v8681: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:26:35.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:26:35 smithi047 bash[22744]: cluster 2024-09-16T10:26:34.106675+0000 mgr.a (mgr.14373) 12517 : cluster [DBG] pgmap v8681: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:26:36.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:26:36 smithi157 bash[24585]: audit 2024-09-16T10:26:35.121601+0000 mgr.a (mgr.14373) 12518 : audit [DBG] from='client.273048 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:26:36.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:26:36 smithi086 bash[24289]: audit 2024-09-16T10:26:35.121601+0000 mgr.a (mgr.14373) 12518 : audit [DBG] from='client.273048 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:26:36.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:26:36 smithi047 bash[22744]: audit 2024-09-16T10:26:35.121601+0000 mgr.a (mgr.14373) 12518 : audit [DBG] from='client.273048 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:26:37.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:26:37 smithi157 bash[24585]: cluster 2024-09-16T10:26:36.107621+0000 mgr.a (mgr.14373) 12519 : cluster [DBG] pgmap v8682: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:26:37.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:26:37 smithi086 bash[24289]: cluster 2024-09-16T10:26:36.107621+0000 mgr.a (mgr.14373) 12519 : cluster [DBG] pgmap v8682: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:26:37.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:26:37 smithi047 bash[22744]: cluster 2024-09-16T10:26:36.107621+0000 mgr.a (mgr.14373) 12519 : cluster [DBG] pgmap v8682: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:26:39.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:26:39 smithi157 bash[24585]: cluster 2024-09-16T10:26:38.109862+0000 mgr.a (mgr.14373) 12520 : cluster [DBG] pgmap v8683: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:26:39.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:26:39 smithi086 bash[24289]: cluster 2024-09-16T10:26:38.109862+0000 mgr.a (mgr.14373) 12520 : cluster [DBG] pgmap v8683: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:26:39.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:26:39 smithi047 bash[22744]: cluster 2024-09-16T10:26:38.109862+0000 mgr.a (mgr.14373) 12520 : cluster [DBG] pgmap v8683: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:26:40.552 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:26:40.553 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:26:40.553 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:26:41.309 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:26:41.310 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:26:41.310 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:26:41.310 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:26:41.310 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:26:41.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:26:41 smithi157 bash[24585]: cluster 2024-09-16T10:26:40.110651+0000 mgr.a (mgr.14373) 12521 : cluster [DBG] pgmap v8684: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:26:41.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:26:41 smithi086 bash[24289]: cluster 2024-09-16T10:26:40.110651+0000 mgr.a (mgr.14373) 12521 : cluster [DBG] pgmap v8684: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:26:41.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:26:41 smithi047 bash[22744]: cluster 2024-09-16T10:26:40.110651+0000 mgr.a (mgr.14373) 12521 : cluster [DBG] pgmap v8684: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:26:42.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:26:42 smithi157 bash[24585]: audit 2024-09-16T10:26:40.885629+0000 mgr.a (mgr.14373) 12522 : audit [DBG] from='client.273120 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:26:42.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:26:42 smithi086 bash[24289]: audit 2024-09-16T10:26:40.885629+0000 mgr.a (mgr.14373) 12522 : audit [DBG] from='client.273120 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:26:42.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:26:42 smithi047 bash[22744]: audit 2024-09-16T10:26:40.885629+0000 mgr.a (mgr.14373) 12522 : audit [DBG] from='client.273120 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:26:43.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:26:43 smithi157 bash[24585]: cluster 2024-09-16T10:26:42.112877+0000 mgr.a (mgr.14373) 12523 : cluster [DBG] pgmap v8685: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:26:43.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:26:43 smithi086 bash[24289]: cluster 2024-09-16T10:26:42.112877+0000 mgr.a (mgr.14373) 12523 : cluster [DBG] pgmap v8685: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:26:43.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:26:43 smithi047 bash[22744]: cluster 2024-09-16T10:26:42.112877+0000 mgr.a (mgr.14373) 12523 : cluster [DBG] pgmap v8685: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:26:45.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:26:45 smithi157 bash[24585]: cluster 2024-09-16T10:26:44.113649+0000 mgr.a (mgr.14373) 12524 : cluster [DBG] pgmap v8686: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:26:45.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:26:45 smithi086 bash[24289]: cluster 2024-09-16T10:26:44.113649+0000 mgr.a (mgr.14373) 12524 : cluster [DBG] pgmap v8686: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:26:45.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:26:45 smithi047 bash[22744]: cluster 2024-09-16T10:26:44.113649+0000 mgr.a (mgr.14373) 12524 : cluster [DBG] pgmap v8686: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:26:46.311 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:26:46.312 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:26:46.312 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:26:47.099 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:26:47.100 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:26:47.100 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:26:47.100 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:26:47.100 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:26:47.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:26:47 smithi157 bash[24585]: cluster 2024-09-16T10:26:46.114442+0000 mgr.a (mgr.14373) 12525 : cluster [DBG] pgmap v8687: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:26:47.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:26:47 smithi086 bash[24289]: cluster 2024-09-16T10:26:46.114442+0000 mgr.a (mgr.14373) 12525 : cluster [DBG] pgmap v8687: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:26:47.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:26:47 smithi047 bash[22744]: cluster 2024-09-16T10:26:46.114442+0000 mgr.a (mgr.14373) 12525 : cluster [DBG] pgmap v8687: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:26:48.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:26:48 smithi157 bash[24585]: audit 2024-09-16T10:26:46.649943+0000 mgr.a (mgr.14373) 12526 : audit [DBG] from='client.273198 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:26:48.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:26:48 smithi086 bash[24289]: audit 2024-09-16T10:26:46.649943+0000 mgr.a (mgr.14373) 12526 : audit [DBG] from='client.273198 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:26:48.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:26:48 smithi047 bash[22744]: audit 2024-09-16T10:26:46.649943+0000 mgr.a (mgr.14373) 12526 : audit [DBG] from='client.273198 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:26:49.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:26:49 smithi157 bash[24585]: cluster 2024-09-16T10:26:48.117129+0000 mgr.a (mgr.14373) 12527 : cluster [DBG] pgmap v8688: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:26:49.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:26:49 smithi086 bash[24289]: cluster 2024-09-16T10:26:48.117129+0000 mgr.a (mgr.14373) 12527 : cluster [DBG] pgmap v8688: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:26:49.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:26:49 smithi047 bash[22744]: cluster 2024-09-16T10:26:48.117129+0000 mgr.a (mgr.14373) 12527 : cluster [DBG] pgmap v8688: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:26:51.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:26:51 smithi157 bash[24585]: cluster 2024-09-16T10:26:50.118068+0000 mgr.a (mgr.14373) 12528 : cluster [DBG] pgmap v8689: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:26:51.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:26:51 smithi086 bash[24289]: cluster 2024-09-16T10:26:50.118068+0000 mgr.a (mgr.14373) 12528 : cluster [DBG] pgmap v8689: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:26:51.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:26:51 smithi047 bash[22744]: cluster 2024-09-16T10:26:50.118068+0000 mgr.a (mgr.14373) 12528 : cluster [DBG] pgmap v8689: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:26:52.101 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:26:52.102 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:26:52.102 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:26:52.887 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:26:52.887 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:26:52.888 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:26:52.888 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:26:52.888 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:26:53.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:26:53 smithi157 bash[24585]: cluster 2024-09-16T10:26:52.119734+0000 mgr.a (mgr.14373) 12529 : cluster [DBG] pgmap v8690: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:26:53.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:26:53 smithi086 bash[24289]: cluster 2024-09-16T10:26:52.119734+0000 mgr.a (mgr.14373) 12529 : cluster [DBG] pgmap v8690: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:26:53.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:26:53 smithi047 bash[22744]: cluster 2024-09-16T10:26:52.119734+0000 mgr.a (mgr.14373) 12529 : cluster [DBG] pgmap v8690: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:26:54.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:26:54 smithi157 bash[24585]: audit 2024-09-16T10:26:52.442931+0000 mgr.a (mgr.14373) 12530 : audit [DBG] from='client.273273 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:26:54.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:26:54 smithi086 bash[24289]: audit 2024-09-16T10:26:52.442931+0000 mgr.a (mgr.14373) 12530 : audit [DBG] from='client.273273 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:26:54.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:26:54 smithi047 bash[22744]: audit 2024-09-16T10:26:52.442931+0000 mgr.a (mgr.14373) 12530 : audit [DBG] from='client.273273 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:26:55.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:26:55 smithi157 bash[24585]: cluster 2024-09-16T10:26:54.120635+0000 mgr.a (mgr.14373) 12531 : cluster [DBG] pgmap v8691: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:26:55.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:26:55 smithi086 bash[24289]: cluster 2024-09-16T10:26:54.120635+0000 mgr.a (mgr.14373) 12531 : cluster [DBG] pgmap v8691: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:26:55.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:26:55 smithi047 bash[22744]: cluster 2024-09-16T10:26:54.120635+0000 mgr.a (mgr.14373) 12531 : cluster [DBG] pgmap v8691: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:26:56.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:26:56 smithi157 bash[24585]: cluster 2024-09-16T10:26:56.121421+0000 mgr.a (mgr.14373) 12532 : cluster [DBG] pgmap v8692: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T10:26:56.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:26:56 smithi086 bash[24289]: cluster 2024-09-16T10:26:56.121421+0000 mgr.a (mgr.14373) 12532 : cluster [DBG] pgmap v8692: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T10:26:56.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:26:56 smithi047 bash[22744]: cluster 2024-09-16T10:26:56.121421+0000 mgr.a (mgr.14373) 12532 : cluster [DBG] pgmap v8692: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T10:26:57.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:26:57 smithi157 bash[24585]: audit 2024-09-16T10:26:56.934121+0000 mon.b (mon.2) 1150 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T10:26:57.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:26:57 smithi086 bash[24289]: audit 2024-09-16T10:26:56.934121+0000 mon.b (mon.2) 1150 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T10:26:57.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:26:57 smithi047 bash[22744]: audit 2024-09-16T10:26:56.934121+0000 mon.b (mon.2) 1150 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T10:26:57.889 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:26:57.889 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:26:57.889 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:26:58.639 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:26:58.640 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:26:58.640 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:26:58.640 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:26:58.640 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:26:58.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:26:58 smithi047 bash[22744]: audit 2024-09-16T10:26:57.573298+0000 mon.a (mon.0) 1314 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:26:58.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:26:58 smithi047 bash[22744]: audit 2024-09-16T10:26:57.606997+0000 mon.a (mon.0) 1315 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:26:58.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:26:58 smithi047 bash[22744]: cluster 2024-09-16T10:26:58.123553+0000 mgr.a (mgr.14373) 12533 : cluster [DBG] pgmap v8693: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:26:58.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:26:58 smithi047 bash[22744]: audit 2024-09-16T10:26:58.207882+0000 mgr.a (mgr.14373) 12534 : audit [DBG] from='client.273348 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:26:58.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:26:58 smithi047 bash[22744]: audit 2024-09-16T10:26:58.358311+0000 mon.b (mon.2) 1151 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T10:26:58.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:26:58 smithi047 bash[22744]: audit 2024-09-16T10:26:58.360132+0000 mon.b (mon.2) 1152 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T10:26:58.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:26:58 smithi047 bash[22744]: audit 2024-09-16T10:26:58.366768+0000 mon.a (mon.0) 1316 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:26:58.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:26:58 smithi047 bash[22744]: audit 2024-09-16T10:26:58.375132+0000 mon.b (mon.2) 1153 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:26:59.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:26:58 smithi157 bash[24585]: audit 2024-09-16T10:26:57.573298+0000 mon.a (mon.0) 1314 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:26:59.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:26:58 smithi157 bash[24585]: audit 2024-09-16T10:26:57.606997+0000 mon.a (mon.0) 1315 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:26:59.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:26:58 smithi157 bash[24585]: cluster 2024-09-16T10:26:58.123553+0000 mgr.a (mgr.14373) 12533 : cluster [DBG] pgmap v8693: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:26:59.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:26:58 smithi157 bash[24585]: audit 2024-09-16T10:26:58.207882+0000 mgr.a (mgr.14373) 12534 : audit [DBG] from='client.273348 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:26:59.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:26:58 smithi157 bash[24585]: audit 2024-09-16T10:26:58.358311+0000 mon.b (mon.2) 1151 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T10:26:59.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:26:58 smithi157 bash[24585]: audit 2024-09-16T10:26:58.360132+0000 mon.b (mon.2) 1152 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T10:26:59.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:26:58 smithi157 bash[24585]: audit 2024-09-16T10:26:58.366768+0000 mon.a (mon.0) 1316 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:26:59.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:26:58 smithi157 bash[24585]: audit 2024-09-16T10:26:58.375132+0000 mon.b (mon.2) 1153 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:26:59.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:26:58 smithi086 bash[24289]: audit 2024-09-16T10:26:57.573298+0000 mon.a (mon.0) 1314 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:26:59.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:26:58 smithi086 bash[24289]: audit 2024-09-16T10:26:57.606997+0000 mon.a (mon.0) 1315 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:26:59.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:26:58 smithi086 bash[24289]: cluster 2024-09-16T10:26:58.123553+0000 mgr.a (mgr.14373) 12533 : cluster [DBG] pgmap v8693: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:26:59.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:26:58 smithi086 bash[24289]: audit 2024-09-16T10:26:58.207882+0000 mgr.a (mgr.14373) 12534 : audit [DBG] from='client.273348 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:26:59.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:26:58 smithi086 bash[24289]: audit 2024-09-16T10:26:58.358311+0000 mon.b (mon.2) 1151 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T10:26:59.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:26:58 smithi086 bash[24289]: audit 2024-09-16T10:26:58.360132+0000 mon.b (mon.2) 1152 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T10:26:59.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:26:58 smithi086 bash[24289]: audit 2024-09-16T10:26:58.366768+0000 mon.a (mon.0) 1316 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:26:59.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:26:58 smithi086 bash[24289]: audit 2024-09-16T10:26:58.375132+0000 mon.b (mon.2) 1153 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:26:59.593 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 10:26:59 smithi047 bash[22994]: debug 2024-09-16T10:26:59.323+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T10:26:59.593 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 10:26:59 smithi047 bash[22994]: debug 2024-09-16T10:26:59.327+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T10:27:00.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:26:59 smithi157 bash[24585]: audit 2024-09-16T10:26:58.377326+0000 mgr.a (mgr.14373) 12535 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:27:00.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:26:59 smithi157 bash[24585]: audit 2024-09-16T10:26:59.329599+0000 mgr.a (mgr.14373) 12536 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T10:27:00.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:26:59 smithi157 bash[24585]: cephadm 2024-09-16T10:26:59.331481+0000 mgr.a (mgr.14373) 12537 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T10:27:00.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:26:59 smithi086 bash[24289]: audit 2024-09-16T10:26:58.377326+0000 mgr.a (mgr.14373) 12535 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:27:00.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:26:59 smithi086 bash[24289]: audit 2024-09-16T10:26:59.329599+0000 mgr.a (mgr.14373) 12536 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T10:27:00.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:26:59 smithi086 bash[24289]: cephadm 2024-09-16T10:26:59.331481+0000 mgr.a (mgr.14373) 12537 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T10:27:00.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:26:59 smithi047 bash[22744]: audit 2024-09-16T10:26:58.377326+0000 mgr.a (mgr.14373) 12535 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:27:00.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:26:59 smithi047 bash[22744]: audit 2024-09-16T10:26:59.329599+0000 mgr.a (mgr.14373) 12536 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T10:27:00.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:26:59 smithi047 bash[22744]: cephadm 2024-09-16T10:26:59.331481+0000 mgr.a (mgr.14373) 12537 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T10:27:01.058 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:27:00 smithi157 bash[24585]: cluster 2024-09-16T10:27:00.124418+0000 mgr.a (mgr.14373) 12538 : cluster [DBG] pgmap v8694: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:27:01.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:27:00 smithi086 bash[24289]: cluster 2024-09-16T10:27:00.124418+0000 mgr.a (mgr.14373) 12538 : cluster [DBG] pgmap v8694: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:27:01.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:27:00 smithi047 bash[22744]: cluster 2024-09-16T10:27:00.124418+0000 mgr.a (mgr.14373) 12538 : cluster [DBG] pgmap v8694: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:27:03.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:27:03 smithi157 bash[24585]: cluster 2024-09-16T10:27:02.126607+0000 mgr.a (mgr.14373) 12539 : cluster [DBG] pgmap v8695: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:27:03.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:27:03 smithi086 bash[24289]: cluster 2024-09-16T10:27:02.126607+0000 mgr.a (mgr.14373) 12539 : cluster [DBG] pgmap v8695: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:27:03.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:27:03 smithi047 bash[22744]: cluster 2024-09-16T10:27:02.126607+0000 mgr.a (mgr.14373) 12539 : cluster [DBG] pgmap v8695: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:27:03.641 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:27:03.642 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:27:03.642 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:27:04.433 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:27:04.433 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:27:04.433 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:27:04.433 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:27:04.434 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:27:05.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:27:05 smithi157 bash[24585]: audit 2024-09-16T10:27:03.977872+0000 mgr.a (mgr.14373) 12540 : audit [DBG] from='client.273534 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:27:05.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:27:05 smithi157 bash[24585]: cluster 2024-09-16T10:27:04.127278+0000 mgr.a (mgr.14373) 12541 : cluster [DBG] pgmap v8696: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:27:05.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:27:05 smithi086 bash[24289]: audit 2024-09-16T10:27:03.977872+0000 mgr.a (mgr.14373) 12540 : audit [DBG] from='client.273534 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:27:05.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:27:05 smithi086 bash[24289]: cluster 2024-09-16T10:27:04.127278+0000 mgr.a (mgr.14373) 12541 : cluster [DBG] pgmap v8696: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:27:05.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:27:05 smithi047 bash[22744]: audit 2024-09-16T10:27:03.977872+0000 mgr.a (mgr.14373) 12540 : audit [DBG] from='client.273534 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:27:05.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:27:05 smithi047 bash[22744]: cluster 2024-09-16T10:27:04.127278+0000 mgr.a (mgr.14373) 12541 : cluster [DBG] pgmap v8696: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:27:07.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:27:07 smithi157 bash[24585]: cluster 2024-09-16T10:27:06.128160+0000 mgr.a (mgr.14373) 12542 : cluster [DBG] pgmap v8697: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:27:07.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:27:07 smithi086 bash[24289]: cluster 2024-09-16T10:27:06.128160+0000 mgr.a (mgr.14373) 12542 : cluster [DBG] pgmap v8697: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:27:07.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:27:07 smithi047 bash[22744]: cluster 2024-09-16T10:27:06.128160+0000 mgr.a (mgr.14373) 12542 : cluster [DBG] pgmap v8697: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:27:09.434 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:27:09.435 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:27:09.435 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:27:09.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:27:09 smithi157 bash[24585]: cluster 2024-09-16T10:27:08.130415+0000 mgr.a (mgr.14373) 12543 : cluster [DBG] pgmap v8698: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:27:09.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:27:09 smithi086 bash[24289]: cluster 2024-09-16T10:27:08.130415+0000 mgr.a (mgr.14373) 12543 : cluster [DBG] pgmap v8698: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:27:09.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:27:09 smithi047 bash[22744]: cluster 2024-09-16T10:27:08.130415+0000 mgr.a (mgr.14373) 12543 : cluster [DBG] pgmap v8698: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:27:10.229 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:27:10.229 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:27:10.229 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:27:10.229 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:27:10.230 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:27:11.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:27:11 smithi157 bash[24585]: audit 2024-09-16T10:27:09.771532+0000 mgr.a (mgr.14373) 12544 : audit [DBG] from='client.273609 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:27:11.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:27:11 smithi157 bash[24585]: cluster 2024-09-16T10:27:10.130968+0000 mgr.a (mgr.14373) 12545 : cluster [DBG] pgmap v8699: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:27:11.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:27:11 smithi086 bash[24289]: audit 2024-09-16T10:27:09.771532+0000 mgr.a (mgr.14373) 12544 : audit [DBG] from='client.273609 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:27:11.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:27:11 smithi086 bash[24289]: cluster 2024-09-16T10:27:10.130968+0000 mgr.a (mgr.14373) 12545 : cluster [DBG] pgmap v8699: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:27:11.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:27:11 smithi047 bash[22744]: audit 2024-09-16T10:27:09.771532+0000 mgr.a (mgr.14373) 12544 : audit [DBG] from='client.273609 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:27:11.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:27:11 smithi047 bash[22744]: cluster 2024-09-16T10:27:10.130968+0000 mgr.a (mgr.14373) 12545 : cluster [DBG] pgmap v8699: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:27:13.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:27:13 smithi157 bash[24585]: cluster 2024-09-16T10:27:12.133101+0000 mgr.a (mgr.14373) 12546 : cluster [DBG] pgmap v8700: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:27:13.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:27:13 smithi086 bash[24289]: cluster 2024-09-16T10:27:12.133101+0000 mgr.a (mgr.14373) 12546 : cluster [DBG] pgmap v8700: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:27:13.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:27:13 smithi047 bash[22744]: cluster 2024-09-16T10:27:12.133101+0000 mgr.a (mgr.14373) 12546 : cluster [DBG] pgmap v8700: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:27:15.231 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:27:15.232 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:27:15.232 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:27:15.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:27:15 smithi157 bash[24585]: cluster 2024-09-16T10:27:14.133825+0000 mgr.a (mgr.14373) 12547 : cluster [DBG] pgmap v8701: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:27:15.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:27:15 smithi086 bash[24289]: cluster 2024-09-16T10:27:14.133825+0000 mgr.a (mgr.14373) 12547 : cluster [DBG] pgmap v8701: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:27:15.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:27:15 smithi047 bash[22744]: cluster 2024-09-16T10:27:14.133825+0000 mgr.a (mgr.14373) 12547 : cluster [DBG] pgmap v8701: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:27:15.981 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:27:15.981 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:27:15.982 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:27:15.982 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:27:15.982 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:27:17.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:27:17 smithi157 bash[24585]: audit 2024-09-16T10:27:15.565560+0000 mgr.a (mgr.14373) 12548 : audit [DBG] from='client.273684 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:27:17.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:27:17 smithi157 bash[24585]: cluster 2024-09-16T10:27:16.134789+0000 mgr.a (mgr.14373) 12549 : cluster [DBG] pgmap v8702: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:27:17.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:27:17 smithi086 bash[24289]: audit 2024-09-16T10:27:15.565560+0000 mgr.a (mgr.14373) 12548 : audit [DBG] from='client.273684 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:27:17.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:27:17 smithi086 bash[24289]: cluster 2024-09-16T10:27:16.134789+0000 mgr.a (mgr.14373) 12549 : cluster [DBG] pgmap v8702: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:27:17.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:27:17 smithi047 bash[22744]: audit 2024-09-16T10:27:15.565560+0000 mgr.a (mgr.14373) 12548 : audit [DBG] from='client.273684 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:27:17.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:27:17 smithi047 bash[22744]: cluster 2024-09-16T10:27:16.134789+0000 mgr.a (mgr.14373) 12549 : cluster [DBG] pgmap v8702: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:27:19.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:27:19 smithi157 bash[24585]: cluster 2024-09-16T10:27:18.136995+0000 mgr.a (mgr.14373) 12550 : cluster [DBG] pgmap v8703: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:27:19.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:27:19 smithi086 bash[24289]: cluster 2024-09-16T10:27:18.136995+0000 mgr.a (mgr.14373) 12550 : cluster [DBG] pgmap v8703: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:27:19.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:27:19 smithi047 bash[22744]: cluster 2024-09-16T10:27:18.136995+0000 mgr.a (mgr.14373) 12550 : cluster [DBG] pgmap v8703: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:27:20.982 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:27:20.983 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:27:20.983 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:27:21.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:27:21 smithi157 bash[24585]: cluster 2024-09-16T10:27:20.137783+0000 mgr.a (mgr.14373) 12551 : cluster [DBG] pgmap v8704: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:27:21.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:27:21 smithi086 bash[24289]: cluster 2024-09-16T10:27:20.137783+0000 mgr.a (mgr.14373) 12551 : cluster [DBG] pgmap v8704: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:27:21.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:27:21 smithi047 bash[22744]: cluster 2024-09-16T10:27:20.137783+0000 mgr.a (mgr.14373) 12551 : cluster [DBG] pgmap v8704: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:27:21.760 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:27:21.760 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:27:21.760 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:27:21.760 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:27:21.761 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:27:22.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:27:22 smithi157 bash[24585]: audit 2024-09-16T10:27:21.315513+0000 mgr.a (mgr.14373) 12552 : audit [DBG] from='client.273762 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:27:22.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:27:22 smithi086 bash[24289]: audit 2024-09-16T10:27:21.315513+0000 mgr.a (mgr.14373) 12552 : audit [DBG] from='client.273762 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:27:22.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:27:22 smithi047 bash[22744]: audit 2024-09-16T10:27:21.315513+0000 mgr.a (mgr.14373) 12552 : audit [DBG] from='client.273762 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:27:23.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:27:23 smithi157 bash[24585]: cluster 2024-09-16T10:27:22.140523+0000 mgr.a (mgr.14373) 12553 : cluster [DBG] pgmap v8705: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:27:23.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:27:23 smithi086 bash[24289]: cluster 2024-09-16T10:27:22.140523+0000 mgr.a (mgr.14373) 12553 : cluster [DBG] pgmap v8705: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:27:23.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:27:23 smithi047 bash[22744]: cluster 2024-09-16T10:27:22.140523+0000 mgr.a (mgr.14373) 12553 : cluster [DBG] pgmap v8705: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:27:25.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:27:25 smithi157 bash[24585]: cluster 2024-09-16T10:27:24.141299+0000 mgr.a (mgr.14373) 12554 : cluster [DBG] pgmap v8706: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:27:25.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:27:25 smithi086 bash[24289]: cluster 2024-09-16T10:27:24.141299+0000 mgr.a (mgr.14373) 12554 : cluster [DBG] pgmap v8706: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:27:25.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:27:25 smithi047 bash[22744]: cluster 2024-09-16T10:27:24.141299+0000 mgr.a (mgr.14373) 12554 : cluster [DBG] pgmap v8706: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:27:26.762 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:27:26.763 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:27:26.763 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:27:26.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:27:26 smithi157 bash[24585]: cluster 2024-09-16T10:27:26.142061+0000 mgr.a (mgr.14373) 12555 : cluster [DBG] pgmap v8707: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T10:27:26.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:27:26 smithi086 bash[24289]: cluster 2024-09-16T10:27:26.142061+0000 mgr.a (mgr.14373) 12555 : cluster [DBG] pgmap v8707: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T10:27:26.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:27:26 smithi047 bash[22744]: cluster 2024-09-16T10:27:26.142061+0000 mgr.a (mgr.14373) 12555 : cluster [DBG] pgmap v8707: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T10:27:27.523 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:27:27.524 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:27:27.524 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:27:27.524 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:27:27.524 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:27:27.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:27:27 smithi157 bash[24585]: audit 2024-09-16T10:27:27.091723+0000 mgr.a (mgr.14373) 12556 : audit [DBG] from='client.273837 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:27:27.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:27:27 smithi086 bash[24289]: audit 2024-09-16T10:27:27.091723+0000 mgr.a (mgr.14373) 12556 : audit [DBG] from='client.273837 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:27:27.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:27:27 smithi047 bash[22744]: audit 2024-09-16T10:27:27.091723+0000 mgr.a (mgr.14373) 12556 : audit [DBG] from='client.273837 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:27:28.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:27:28 smithi157 bash[24585]: cluster 2024-09-16T10:27:28.144738+0000 mgr.a (mgr.14373) 12557 : cluster [DBG] pgmap v8708: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:27:28.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:27:28 smithi086 bash[24289]: cluster 2024-09-16T10:27:28.144738+0000 mgr.a (mgr.14373) 12557 : cluster [DBG] pgmap v8708: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:27:28.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:27:28 smithi047 bash[22744]: cluster 2024-09-16T10:27:28.144738+0000 mgr.a (mgr.14373) 12557 : cluster [DBG] pgmap v8708: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:27:31.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:27:31 smithi157 bash[24585]: cluster 2024-09-16T10:27:30.145525+0000 mgr.a (mgr.14373) 12558 : cluster [DBG] pgmap v8709: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:27:31.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:27:31 smithi086 bash[24289]: cluster 2024-09-16T10:27:30.145525+0000 mgr.a (mgr.14373) 12558 : cluster [DBG] pgmap v8709: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:27:31.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:27:31 smithi047 bash[22744]: cluster 2024-09-16T10:27:30.145525+0000 mgr.a (mgr.14373) 12558 : cluster [DBG] pgmap v8709: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:27:32.525 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:27:32.526 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:27:32.526 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:27:33.291 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:27:33.292 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:27:33.292 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:27:33.292 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:27:33.292 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:27:33.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:27:33 smithi157 bash[24585]: cluster 2024-09-16T10:27:32.147489+0000 mgr.a (mgr.14373) 12559 : cluster [DBG] pgmap v8710: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:27:33.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:27:33 smithi086 bash[24289]: cluster 2024-09-16T10:27:32.147489+0000 mgr.a (mgr.14373) 12559 : cluster [DBG] pgmap v8710: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:27:33.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:27:33 smithi047 bash[22744]: cluster 2024-09-16T10:27:32.147489+0000 mgr.a (mgr.14373) 12559 : cluster [DBG] pgmap v8710: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:27:34.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:27:34 smithi157 bash[24585]: audit 2024-09-16T10:27:32.858710+0000 mgr.a (mgr.14373) 12560 : audit [DBG] from='client.273912 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:27:34.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:27:34 smithi086 bash[24289]: audit 2024-09-16T10:27:32.858710+0000 mgr.a (mgr.14373) 12560 : audit [DBG] from='client.273912 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:27:34.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:27:34 smithi047 bash[22744]: audit 2024-09-16T10:27:32.858710+0000 mgr.a (mgr.14373) 12560 : audit [DBG] from='client.273912 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:27:35.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:27:35 smithi157 bash[24585]: cluster 2024-09-16T10:27:34.148387+0000 mgr.a (mgr.14373) 12561 : cluster [DBG] pgmap v8711: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:27:35.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:27:35 smithi086 bash[24289]: cluster 2024-09-16T10:27:34.148387+0000 mgr.a (mgr.14373) 12561 : cluster [DBG] pgmap v8711: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:27:35.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:27:35 smithi047 bash[22744]: cluster 2024-09-16T10:27:34.148387+0000 mgr.a (mgr.14373) 12561 : cluster [DBG] pgmap v8711: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:27:37.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:27:37 smithi157 bash[24585]: cluster 2024-09-16T10:27:36.149158+0000 mgr.a (mgr.14373) 12562 : cluster [DBG] pgmap v8712: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:27:37.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:27:37 smithi086 bash[24289]: cluster 2024-09-16T10:27:36.149158+0000 mgr.a (mgr.14373) 12562 : cluster [DBG] pgmap v8712: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:27:37.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:27:37 smithi047 bash[22744]: cluster 2024-09-16T10:27:36.149158+0000 mgr.a (mgr.14373) 12562 : cluster [DBG] pgmap v8712: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:27:38.292 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:27:38.294 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:27:38.294 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:27:39.073 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:27:39.073 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:27:39.074 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:27:39.074 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:27:39.074 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:27:39.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:27:39 smithi157 bash[24585]: cluster 2024-09-16T10:27:38.151384+0000 mgr.a (mgr.14373) 12563 : cluster [DBG] pgmap v8713: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:27:39.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:27:39 smithi086 bash[24289]: cluster 2024-09-16T10:27:38.151384+0000 mgr.a (mgr.14373) 12563 : cluster [DBG] pgmap v8713: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:27:39.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:27:39 smithi047 bash[22744]: cluster 2024-09-16T10:27:38.151384+0000 mgr.a (mgr.14373) 12563 : cluster [DBG] pgmap v8713: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:27:40.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:27:40 smithi157 bash[24585]: audit 2024-09-16T10:27:38.625013+0000 mgr.a (mgr.14373) 12564 : audit [DBG] from='client.273990 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:27:40.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:27:40 smithi086 bash[24289]: audit 2024-09-16T10:27:38.625013+0000 mgr.a (mgr.14373) 12564 : audit [DBG] from='client.273990 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:27:40.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:27:40 smithi047 bash[22744]: audit 2024-09-16T10:27:38.625013+0000 mgr.a (mgr.14373) 12564 : audit [DBG] from='client.273990 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:27:41.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:27:41 smithi157 bash[24585]: cluster 2024-09-16T10:27:40.152291+0000 mgr.a (mgr.14373) 12565 : cluster [DBG] pgmap v8714: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:27:41.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:27:41 smithi086 bash[24289]: cluster 2024-09-16T10:27:40.152291+0000 mgr.a (mgr.14373) 12565 : cluster [DBG] pgmap v8714: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:27:41.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:27:41 smithi047 bash[22744]: cluster 2024-09-16T10:27:40.152291+0000 mgr.a (mgr.14373) 12565 : cluster [DBG] pgmap v8714: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:27:43.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:27:43 smithi157 bash[24585]: cluster 2024-09-16T10:27:42.154505+0000 mgr.a (mgr.14373) 12566 : cluster [DBG] pgmap v8715: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:27:43.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:27:43 smithi086 bash[24289]: cluster 2024-09-16T10:27:42.154505+0000 mgr.a (mgr.14373) 12566 : cluster [DBG] pgmap v8715: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:27:43.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:27:43 smithi047 bash[22744]: cluster 2024-09-16T10:27:42.154505+0000 mgr.a (mgr.14373) 12566 : cluster [DBG] pgmap v8715: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:27:44.075 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:27:44.075 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:27:44.076 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:27:44.860 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:27:44.860 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:27:44.860 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:27:44.860 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:27:44.860 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:27:45.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:27:45 smithi157 bash[24585]: cluster 2024-09-16T10:27:44.155075+0000 mgr.a (mgr.14373) 12567 : cluster [DBG] pgmap v8716: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:27:45.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:27:45 smithi086 bash[24289]: cluster 2024-09-16T10:27:44.155075+0000 mgr.a (mgr.14373) 12567 : cluster [DBG] pgmap v8716: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:27:45.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:27:45 smithi047 bash[22744]: cluster 2024-09-16T10:27:44.155075+0000 mgr.a (mgr.14373) 12567 : cluster [DBG] pgmap v8716: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:27:46.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:27:46 smithi157 bash[24585]: audit 2024-09-16T10:27:44.413277+0000 mgr.a (mgr.14373) 12568 : audit [DBG] from='client.274068 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:27:46.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:27:46 smithi086 bash[24289]: audit 2024-09-16T10:27:44.413277+0000 mgr.a (mgr.14373) 12568 : audit [DBG] from='client.274068 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:27:46.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:27:46 smithi047 bash[22744]: audit 2024-09-16T10:27:44.413277+0000 mgr.a (mgr.14373) 12568 : audit [DBG] from='client.274068 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:27:47.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:27:47 smithi157 bash[24585]: cluster 2024-09-16T10:27:46.155938+0000 mgr.a (mgr.14373) 12569 : cluster [DBG] pgmap v8717: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:27:47.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:27:47 smithi086 bash[24289]: cluster 2024-09-16T10:27:46.155938+0000 mgr.a (mgr.14373) 12569 : cluster [DBG] pgmap v8717: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:27:47.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:27:47 smithi047 bash[22744]: cluster 2024-09-16T10:27:46.155938+0000 mgr.a (mgr.14373) 12569 : cluster [DBG] pgmap v8717: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:27:49.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:27:49 smithi157 bash[24585]: cluster 2024-09-16T10:27:48.158149+0000 mgr.a (mgr.14373) 12570 : cluster [DBG] pgmap v8718: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:27:49.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:27:49 smithi086 bash[24289]: cluster 2024-09-16T10:27:48.158149+0000 mgr.a (mgr.14373) 12570 : cluster [DBG] pgmap v8718: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:27:49.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:27:49 smithi047 bash[22744]: cluster 2024-09-16T10:27:48.158149+0000 mgr.a (mgr.14373) 12570 : cluster [DBG] pgmap v8718: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:27:49.861 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:27:49.862 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:27:49.862 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:27:50.612 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:27:50.612 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:27:50.612 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:27:50.612 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:27:50.613 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:27:51.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:27:51 smithi157 bash[24585]: cluster 2024-09-16T10:27:50.158860+0000 mgr.a (mgr.14373) 12571 : cluster [DBG] pgmap v8719: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:27:51.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:27:51 smithi157 bash[24585]: audit 2024-09-16T10:27:50.190317+0000 mgr.a (mgr.14373) 12572 : audit [DBG] from='client.274146 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:27:51.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:27:51 smithi086 bash[24289]: cluster 2024-09-16T10:27:50.158860+0000 mgr.a (mgr.14373) 12571 : cluster [DBG] pgmap v8719: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:27:51.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:27:51 smithi086 bash[24289]: audit 2024-09-16T10:27:50.190317+0000 mgr.a (mgr.14373) 12572 : audit [DBG] from='client.274146 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:27:51.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:27:51 smithi047 bash[22744]: cluster 2024-09-16T10:27:50.158860+0000 mgr.a (mgr.14373) 12571 : cluster [DBG] pgmap v8719: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:27:51.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:27:51 smithi047 bash[22744]: audit 2024-09-16T10:27:50.190317+0000 mgr.a (mgr.14373) 12572 : audit [DBG] from='client.274146 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:27:53.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:27:53 smithi157 bash[24585]: cluster 2024-09-16T10:27:52.161109+0000 mgr.a (mgr.14373) 12573 : cluster [DBG] pgmap v8720: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:27:53.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:27:53 smithi086 bash[24289]: cluster 2024-09-16T10:27:52.161109+0000 mgr.a (mgr.14373) 12573 : cluster [DBG] pgmap v8720: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:27:53.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:27:53 smithi047 bash[22744]: cluster 2024-09-16T10:27:52.161109+0000 mgr.a (mgr.14373) 12573 : cluster [DBG] pgmap v8720: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:27:55.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:27:55 smithi157 bash[24585]: cluster 2024-09-16T10:27:54.161843+0000 mgr.a (mgr.14373) 12574 : cluster [DBG] pgmap v8721: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:27:55.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:27:55 smithi086 bash[24289]: cluster 2024-09-16T10:27:54.161843+0000 mgr.a (mgr.14373) 12574 : cluster [DBG] pgmap v8721: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:27:55.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:27:55 smithi047 bash[22744]: cluster 2024-09-16T10:27:54.161843+0000 mgr.a (mgr.14373) 12574 : cluster [DBG] pgmap v8721: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:27:55.613 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:27:55.614 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:27:55.615 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:27:56.391 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:27:56.391 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:27:56.391 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:27:56.392 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:27:56.392 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:27:56.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:27:56 smithi157 bash[24585]: audit 2024-09-16T10:27:55.946103+0000 mgr.a (mgr.14373) 12575 : audit [DBG] from='client.274224 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:27:56.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:27:56 smithi157 bash[24585]: cluster 2024-09-16T10:27:56.162278+0000 mgr.a (mgr.14373) 12576 : cluster [DBG] pgmap v8722: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:27:56.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:27:56 smithi086 bash[24289]: audit 2024-09-16T10:27:55.946103+0000 mgr.a (mgr.14373) 12575 : audit [DBG] from='client.274224 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:27:56.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:27:56 smithi086 bash[24289]: cluster 2024-09-16T10:27:56.162278+0000 mgr.a (mgr.14373) 12576 : cluster [DBG] pgmap v8722: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:27:56.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:27:56 smithi047 bash[22744]: audit 2024-09-16T10:27:55.946103+0000 mgr.a (mgr.14373) 12575 : audit [DBG] from='client.274224 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:27:56.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:27:56 smithi047 bash[22744]: cluster 2024-09-16T10:27:56.162278+0000 mgr.a (mgr.14373) 12576 : cluster [DBG] pgmap v8722: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:27:59.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:27:59 smithi157 bash[24585]: cluster 2024-09-16T10:27:58.164634+0000 mgr.a (mgr.14373) 12577 : cluster [DBG] pgmap v8723: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:27:59.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:27:59 smithi086 bash[24289]: cluster 2024-09-16T10:27:58.164634+0000 mgr.a (mgr.14373) 12577 : cluster [DBG] pgmap v8723: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:27:59.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:27:59 smithi047 bash[22744]: cluster 2024-09-16T10:27:58.164634+0000 mgr.a (mgr.14373) 12577 : cluster [DBG] pgmap v8723: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:28:00.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:28:00 smithi157 bash[24585]: audit 2024-09-16T10:27:59.403082+0000 mon.b (mon.2) 1154 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T10:28:00.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:28:00 smithi157 bash[24585]: audit 2024-09-16T10:28:00.017170+0000 mon.a (mon.0) 1317 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:28:00.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:28:00 smithi157 bash[24585]: audit 2024-09-16T10:28:00.020594+0000 mon.a (mon.0) 1318 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:28:00.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:28:00 smithi157 bash[24585]: audit 2024-09-16T10:28:00.026277+0000 mon.a (mon.0) 1319 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:28:00.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:28:00 smithi157 bash[24585]: audit 2024-09-16T10:28:00.031404+0000 mon.a (mon.0) 1320 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:28:00.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:28:00 smithi086 bash[24289]: audit 2024-09-16T10:27:59.403082+0000 mon.b (mon.2) 1154 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T10:28:00.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:28:00 smithi086 bash[24289]: audit 2024-09-16T10:28:00.017170+0000 mon.a (mon.0) 1317 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:28:00.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:28:00 smithi086 bash[24289]: audit 2024-09-16T10:28:00.020594+0000 mon.a (mon.0) 1318 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:28:00.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:28:00 smithi086 bash[24289]: audit 2024-09-16T10:28:00.026277+0000 mon.a (mon.0) 1319 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:28:00.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:28:00 smithi086 bash[24289]: audit 2024-09-16T10:28:00.031404+0000 mon.a (mon.0) 1320 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:28:00.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:28:00 smithi047 bash[22744]: audit 2024-09-16T10:27:59.403082+0000 mon.b (mon.2) 1154 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T10:28:00.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:28:00 smithi047 bash[22744]: audit 2024-09-16T10:28:00.017170+0000 mon.a (mon.0) 1317 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:28:00.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:28:00 smithi047 bash[22744]: audit 2024-09-16T10:28:00.020594+0000 mon.a (mon.0) 1318 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:28:00.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:28:00 smithi047 bash[22744]: audit 2024-09-16T10:28:00.026277+0000 mon.a (mon.0) 1319 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:28:00.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:28:00 smithi047 bash[22744]: audit 2024-09-16T10:28:00.031404+0000 mon.a (mon.0) 1320 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:28:01.392 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:28:01.393 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:28:01.393 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:28:01.531 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:28:01 smithi047 bash[22744]: cluster 2024-09-16T10:28:00.165383+0000 mgr.a (mgr.14373) 12578 : cluster [DBG] pgmap v8724: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:28:01.531 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:28:01 smithi047 bash[22744]: audit 2024-09-16T10:28:00.781466+0000 mon.b (mon.2) 1155 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T10:28:01.531 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:28:01 smithi047 bash[22744]: audit 2024-09-16T10:28:00.783265+0000 mon.b (mon.2) 1156 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T10:28:01.531 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:28:01 smithi047 bash[22744]: audit 2024-09-16T10:28:00.794595+0000 mon.a (mon.0) 1321 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:28:01.531 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:28:01 smithi047 bash[22744]: audit 2024-09-16T10:28:00.799828+0000 mon.b (mon.2) 1157 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:28:01.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:28:01 smithi157 bash[24585]: cluster 2024-09-16T10:28:00.165383+0000 mgr.a (mgr.14373) 12578 : cluster [DBG] pgmap v8724: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:28:01.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:28:01 smithi157 bash[24585]: audit 2024-09-16T10:28:00.781466+0000 mon.b (mon.2) 1155 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T10:28:01.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:28:01 smithi157 bash[24585]: audit 2024-09-16T10:28:00.783265+0000 mon.b (mon.2) 1156 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T10:28:01.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:28:01 smithi157 bash[24585]: audit 2024-09-16T10:28:00.794595+0000 mon.a (mon.0) 1321 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:28:01.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:28:01 smithi157 bash[24585]: audit 2024-09-16T10:28:00.799828+0000 mon.b (mon.2) 1157 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:28:01.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:28:01 smithi086 bash[24289]: cluster 2024-09-16T10:28:00.165383+0000 mgr.a (mgr.14373) 12578 : cluster [DBG] pgmap v8724: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:28:01.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:28:01 smithi086 bash[24289]: audit 2024-09-16T10:28:00.781466+0000 mon.b (mon.2) 1155 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T10:28:01.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:28:01 smithi086 bash[24289]: audit 2024-09-16T10:28:00.783265+0000 mon.b (mon.2) 1156 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T10:28:01.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:28:01 smithi086 bash[24289]: audit 2024-09-16T10:28:00.794595+0000 mon.a (mon.0) 1321 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:28:01.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:28:01 smithi086 bash[24289]: audit 2024-09-16T10:28:00.799828+0000 mon.b (mon.2) 1157 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:28:01.842 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 10:28:01 smithi047 bash[22994]: debug 2024-09-16T10:28:01.525+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T10:28:01.842 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 10:28:01 smithi047 bash[22994]: debug 2024-09-16T10:28:01.529+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T10:28:02.123 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:28:02.123 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:28:02.123 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:28:02.123 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:28:02.123 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:28:02.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:28:02 smithi157 bash[24585]: audit 2024-09-16T10:28:00.802382+0000 mgr.a (mgr.14373) 12579 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:28:02.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:28:02 smithi086 bash[24289]: audit 2024-09-16T10:28:00.802382+0000 mgr.a (mgr.14373) 12579 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:28:02.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:28:02 smithi047 bash[22744]: audit 2024-09-16T10:28:00.802382+0000 mgr.a (mgr.14373) 12579 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:28:03.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:28:03 smithi157 bash[24585]: audit 2024-09-16T10:28:01.529740+0000 mgr.a (mgr.14373) 12580 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T10:28:03.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:28:03 smithi157 bash[24585]: cephadm 2024-09-16T10:28:01.531384+0000 mgr.a (mgr.14373) 12581 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T10:28:03.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:28:03 smithi157 bash[24585]: audit 2024-09-16T10:28:01.711577+0000 mgr.a (mgr.14373) 12582 : audit [DBG] from='client.274401 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:28:03.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:28:03 smithi157 bash[24585]: cluster 2024-09-16T10:28:02.166668+0000 mgr.a (mgr.14373) 12583 : cluster [DBG] pgmap v8725: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 5.5 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-16T10:28:03.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:28:03 smithi086 bash[24289]: audit 2024-09-16T10:28:01.529740+0000 mgr.a (mgr.14373) 12580 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T10:28:03.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:28:03 smithi086 bash[24289]: cephadm 2024-09-16T10:28:01.531384+0000 mgr.a (mgr.14373) 12581 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T10:28:03.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:28:03 smithi086 bash[24289]: audit 2024-09-16T10:28:01.711577+0000 mgr.a (mgr.14373) 12582 : audit [DBG] from='client.274401 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:28:03.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:28:03 smithi086 bash[24289]: cluster 2024-09-16T10:28:02.166668+0000 mgr.a (mgr.14373) 12583 : cluster [DBG] pgmap v8725: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 5.5 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-16T10:28:03.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:28:03 smithi047 bash[22744]: audit 2024-09-16T10:28:01.529740+0000 mgr.a (mgr.14373) 12580 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T10:28:03.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:28:03 smithi047 bash[22744]: cephadm 2024-09-16T10:28:01.531384+0000 mgr.a (mgr.14373) 12581 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T10:28:03.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:28:03 smithi047 bash[22744]: audit 2024-09-16T10:28:01.711577+0000 mgr.a (mgr.14373) 12582 : audit [DBG] from='client.274401 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:28:03.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:28:03 smithi047 bash[22744]: cluster 2024-09-16T10:28:02.166668+0000 mgr.a (mgr.14373) 12583 : cluster [DBG] pgmap v8725: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 5.5 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-16T10:28:05.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:28:05 smithi157 bash[24585]: cluster 2024-09-16T10:28:04.167554+0000 mgr.a (mgr.14373) 12584 : cluster [DBG] pgmap v8726: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 4.6 KiB/s rd, 255 B/s wr, 4 op/s 2024-09-16T10:28:05.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:28:05 smithi086 bash[24289]: cluster 2024-09-16T10:28:04.167554+0000 mgr.a (mgr.14373) 12584 : cluster [DBG] pgmap v8726: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 4.6 KiB/s rd, 255 B/s wr, 4 op/s 2024-09-16T10:28:05.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:28:05 smithi047 bash[22744]: cluster 2024-09-16T10:28:04.167554+0000 mgr.a (mgr.14373) 12584 : cluster [DBG] pgmap v8726: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 4.6 KiB/s rd, 255 B/s wr, 4 op/s 2024-09-16T10:28:07.124 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:28:07.125 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:28:07.125 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:28:07.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:28:07 smithi157 bash[24585]: cluster 2024-09-16T10:28:06.168477+0000 mgr.a (mgr.14373) 12585 : cluster [DBG] pgmap v8727: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 4.6 KiB/s rd, 255 B/s wr, 4 op/s 2024-09-16T10:28:07.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:28:07 smithi086 bash[24289]: cluster 2024-09-16T10:28:06.168477+0000 mgr.a (mgr.14373) 12585 : cluster [DBG] pgmap v8727: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 4.6 KiB/s rd, 255 B/s wr, 4 op/s 2024-09-16T10:28:07.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:28:07 smithi047 bash[22744]: cluster 2024-09-16T10:28:06.168477+0000 mgr.a (mgr.14373) 12585 : cluster [DBG] pgmap v8727: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 4.6 KiB/s rd, 255 B/s wr, 4 op/s 2024-09-16T10:28:07.904 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:28:07.905 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:28:07.905 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:28:07.905 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:28:07.905 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:28:09.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:28:09 smithi157 bash[24585]: audit 2024-09-16T10:28:07.464725+0000 mgr.a (mgr.14373) 12586 : audit [DBG] from='client.274476 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:28:09.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:28:09 smithi157 bash[24585]: cluster 2024-09-16T10:28:08.171247+0000 mgr.a (mgr.14373) 12587 : cluster [DBG] pgmap v8728: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 11 KiB/s rd, 426 B/s wr, 13 op/s 2024-09-16T10:28:09.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:28:09 smithi086 bash[24289]: audit 2024-09-16T10:28:07.464725+0000 mgr.a (mgr.14373) 12586 : audit [DBG] from='client.274476 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:28:09.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:28:09 smithi086 bash[24289]: cluster 2024-09-16T10:28:08.171247+0000 mgr.a (mgr.14373) 12587 : cluster [DBG] pgmap v8728: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 11 KiB/s rd, 426 B/s wr, 13 op/s 2024-09-16T10:28:09.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:28:09 smithi047 bash[22744]: audit 2024-09-16T10:28:07.464725+0000 mgr.a (mgr.14373) 12586 : audit [DBG] from='client.274476 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:28:09.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:28:09 smithi047 bash[22744]: cluster 2024-09-16T10:28:08.171247+0000 mgr.a (mgr.14373) 12587 : cluster [DBG] pgmap v8728: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 11 KiB/s rd, 426 B/s wr, 13 op/s 2024-09-16T10:28:11.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:28:11 smithi157 bash[24585]: cluster 2024-09-16T10:28:10.172064+0000 mgr.a (mgr.14373) 12588 : cluster [DBG] pgmap v8729: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 10 KiB/s rd, 426 B/s wr, 12 op/s 2024-09-16T10:28:11.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:28:11 smithi086 bash[24289]: cluster 2024-09-16T10:28:10.172064+0000 mgr.a (mgr.14373) 12588 : cluster [DBG] pgmap v8729: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 10 KiB/s rd, 426 B/s wr, 12 op/s 2024-09-16T10:28:11.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:28:11 smithi047 bash[22744]: cluster 2024-09-16T10:28:10.172064+0000 mgr.a (mgr.14373) 12588 : cluster [DBG] pgmap v8729: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 10 KiB/s rd, 426 B/s wr, 12 op/s 2024-09-16T10:28:12.906 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:28:12.907 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:28:12.907 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:28:13.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:28:13 smithi157 bash[24585]: cluster 2024-09-16T10:28:12.174010+0000 mgr.a (mgr.14373) 12589 : cluster [DBG] pgmap v8730: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 11 KiB/s rd, 426 B/s wr, 13 op/s 2024-09-16T10:28:13.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:28:13 smithi086 bash[24289]: cluster 2024-09-16T10:28:12.174010+0000 mgr.a (mgr.14373) 12589 : cluster [DBG] pgmap v8730: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 11 KiB/s rd, 426 B/s wr, 13 op/s 2024-09-16T10:28:13.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:28:13 smithi047 bash[22744]: cluster 2024-09-16T10:28:12.174010+0000 mgr.a (mgr.14373) 12589 : cluster [DBG] pgmap v8730: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 11 KiB/s rd, 426 B/s wr, 13 op/s 2024-09-16T10:28:13.653 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:28:13.653 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:28:13.653 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:28:13.653 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:28:13.653 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:28:14.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:28:14 smithi157 bash[24585]: audit 2024-09-16T10:28:13.233587+0000 mgr.a (mgr.14373) 12590 : audit [DBG] from='client.274554 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:28:14.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:28:14 smithi086 bash[24289]: audit 2024-09-16T10:28:13.233587+0000 mgr.a (mgr.14373) 12590 : audit [DBG] from='client.274554 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:28:14.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:28:14 smithi047 bash[22744]: audit 2024-09-16T10:28:13.233587+0000 mgr.a (mgr.14373) 12590 : audit [DBG] from='client.274554 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:28:15.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:28:15 smithi157 bash[24585]: cluster 2024-09-16T10:28:14.175136+0000 mgr.a (mgr.14373) 12591 : cluster [DBG] pgmap v8731: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.3 KiB/s rd, 170 B/s wr, 9 op/s 2024-09-16T10:28:15.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:28:15 smithi086 bash[24289]: cluster 2024-09-16T10:28:14.175136+0000 mgr.a (mgr.14373) 12591 : cluster [DBG] pgmap v8731: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.3 KiB/s rd, 170 B/s wr, 9 op/s 2024-09-16T10:28:15.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:28:15 smithi047 bash[22744]: cluster 2024-09-16T10:28:14.175136+0000 mgr.a (mgr.14373) 12591 : cluster [DBG] pgmap v8731: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.3 KiB/s rd, 170 B/s wr, 9 op/s 2024-09-16T10:28:17.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:28:17 smithi157 bash[24585]: cluster 2024-09-16T10:28:16.176136+0000 mgr.a (mgr.14373) 12592 : cluster [DBG] pgmap v8732: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.3 KiB/s rd, 170 B/s wr, 9 op/s 2024-09-16T10:28:17.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:28:17 smithi086 bash[24289]: cluster 2024-09-16T10:28:16.176136+0000 mgr.a (mgr.14373) 12592 : cluster [DBG] pgmap v8732: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.3 KiB/s rd, 170 B/s wr, 9 op/s 2024-09-16T10:28:17.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:28:17 smithi047 bash[22744]: cluster 2024-09-16T10:28:16.176136+0000 mgr.a (mgr.14373) 12592 : cluster [DBG] pgmap v8732: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.3 KiB/s rd, 170 B/s wr, 9 op/s 2024-09-16T10:28:18.654 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:28:18.655 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:28:18.655 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:28:19.440 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:28:19.440 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:28:19.441 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:28:19.441 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:28:19.441 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:28:19.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:28:19 smithi157 bash[24585]: cluster 2024-09-16T10:28:18.178488+0000 mgr.a (mgr.14373) 12593 : cluster [DBG] pgmap v8733: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 8.2 KiB/s rd, 170 B/s wr, 10 op/s 2024-09-16T10:28:19.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:28:19 smithi086 bash[24289]: cluster 2024-09-16T10:28:18.178488+0000 mgr.a (mgr.14373) 12593 : cluster [DBG] pgmap v8733: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 8.2 KiB/s rd, 170 B/s wr, 10 op/s 2024-09-16T10:28:19.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:28:19 smithi047 bash[22744]: cluster 2024-09-16T10:28:18.178488+0000 mgr.a (mgr.14373) 12593 : cluster [DBG] pgmap v8733: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 8.2 KiB/s rd, 170 B/s wr, 10 op/s 2024-09-16T10:28:20.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:28:20 smithi157 bash[24585]: audit 2024-09-16T10:28:18.994084+0000 mgr.a (mgr.14373) 12594 : audit [DBG] from='client.274626 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:28:20.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:28:20 smithi086 bash[24289]: audit 2024-09-16T10:28:18.994084+0000 mgr.a (mgr.14373) 12594 : audit [DBG] from='client.274626 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:28:20.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:28:20 smithi047 bash[22744]: audit 2024-09-16T10:28:18.994084+0000 mgr.a (mgr.14373) 12594 : audit [DBG] from='client.274626 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:28:21.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:28:21 smithi157 bash[24585]: cluster 2024-09-16T10:28:20.179429+0000 mgr.a (mgr.14373) 12595 : cluster [DBG] pgmap v8734: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:28:21.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:28:21 smithi086 bash[24289]: cluster 2024-09-16T10:28:20.179429+0000 mgr.a (mgr.14373) 12595 : cluster [DBG] pgmap v8734: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:28:21.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:28:21 smithi047 bash[22744]: cluster 2024-09-16T10:28:20.179429+0000 mgr.a (mgr.14373) 12595 : cluster [DBG] pgmap v8734: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:28:23.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:28:23 smithi157 bash[24585]: cluster 2024-09-16T10:28:22.181606+0000 mgr.a (mgr.14373) 12596 : cluster [DBG] pgmap v8735: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:28:23.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:28:23 smithi086 bash[24289]: cluster 2024-09-16T10:28:22.181606+0000 mgr.a (mgr.14373) 12596 : cluster [DBG] pgmap v8735: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:28:23.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:28:23 smithi047 bash[22744]: cluster 2024-09-16T10:28:22.181606+0000 mgr.a (mgr.14373) 12596 : cluster [DBG] pgmap v8735: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:28:24.442 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:28:24.442 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:28:24.442 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:28:25.206 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:28:25.206 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:28:25.206 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:28:25.206 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:28:25.206 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:28:25.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:28:25 smithi157 bash[24585]: cluster 2024-09-16T10:28:24.182410+0000 mgr.a (mgr.14373) 12597 : cluster [DBG] pgmap v8736: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:28:25.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:28:25 smithi086 bash[24289]: cluster 2024-09-16T10:28:24.182410+0000 mgr.a (mgr.14373) 12597 : cluster [DBG] pgmap v8736: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:28:25.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:28:25 smithi047 bash[22744]: cluster 2024-09-16T10:28:24.182410+0000 mgr.a (mgr.14373) 12597 : cluster [DBG] pgmap v8736: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:28:26.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:28:26 smithi157 bash[24585]: audit 2024-09-16T10:28:24.771871+0000 mgr.a (mgr.14373) 12598 : audit [DBG] from='client.274701 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:28:26.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:28:26 smithi086 bash[24289]: audit 2024-09-16T10:28:24.771871+0000 mgr.a (mgr.14373) 12598 : audit [DBG] from='client.274701 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:28:26.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:28:26 smithi047 bash[22744]: audit 2024-09-16T10:28:24.771871+0000 mgr.a (mgr.14373) 12598 : audit [DBG] from='client.274701 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:28:27.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:28:27 smithi086 bash[24289]: cluster 2024-09-16T10:28:26.183373+0000 mgr.a (mgr.14373) 12599 : cluster [DBG] pgmap v8737: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:28:27.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:28:27 smithi047 bash[22744]: cluster 2024-09-16T10:28:26.183373+0000 mgr.a (mgr.14373) 12599 : cluster [DBG] pgmap v8737: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:28:27.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:28:27 smithi157 bash[24585]: cluster 2024-09-16T10:28:26.183373+0000 mgr.a (mgr.14373) 12599 : cluster [DBG] pgmap v8737: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:28:29.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:28:29 smithi086 bash[24289]: cluster 2024-09-16T10:28:28.185623+0000 mgr.a (mgr.14373) 12600 : cluster [DBG] pgmap v8738: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 62 KiB/s rd, 0 B/s wr, 101 op/s 2024-09-16T10:28:29.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:28:29 smithi047 bash[22744]: cluster 2024-09-16T10:28:28.185623+0000 mgr.a (mgr.14373) 12600 : cluster [DBG] pgmap v8738: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 62 KiB/s rd, 0 B/s wr, 101 op/s 2024-09-16T10:28:29.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:28:29 smithi157 bash[24585]: cluster 2024-09-16T10:28:28.185623+0000 mgr.a (mgr.14373) 12600 : cluster [DBG] pgmap v8738: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 62 KiB/s rd, 0 B/s wr, 101 op/s 2024-09-16T10:28:30.207 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:28:30.208 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:28:30.208 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:28:30.953 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:28:30.953 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:28:30.953 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:28:30.953 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:28:30.953 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:28:31.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:28:31 smithi047 bash[22744]: cluster 2024-09-16T10:28:30.186421+0000 mgr.a (mgr.14373) 12601 : cluster [DBG] pgmap v8739: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 61 KiB/s rd, 0 B/s wr, 100 op/s 2024-09-16T10:28:31.809 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:28:31 smithi157 bash[24585]: cluster 2024-09-16T10:28:30.186421+0000 mgr.a (mgr.14373) 12601 : cluster [DBG] pgmap v8739: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 61 KiB/s rd, 0 B/s wr, 100 op/s 2024-09-16T10:28:31.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:28:31 smithi086 bash[24289]: cluster 2024-09-16T10:28:30.186421+0000 mgr.a (mgr.14373) 12601 : cluster [DBG] pgmap v8739: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 61 KiB/s rd, 0 B/s wr, 100 op/s 2024-09-16T10:28:32.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:28:32 smithi047 bash[22744]: audit 2024-09-16T10:28:30.536701+0000 mgr.a (mgr.14373) 12602 : audit [DBG] from='client.274776 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:28:32.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:28:32 smithi157 bash[24585]: audit 2024-09-16T10:28:30.536701+0000 mgr.a (mgr.14373) 12602 : audit [DBG] from='client.274776 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:28:32.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:28:32 smithi086 bash[24289]: audit 2024-09-16T10:28:30.536701+0000 mgr.a (mgr.14373) 12602 : audit [DBG] from='client.274776 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:28:33.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:28:33 smithi047 bash[22744]: cluster 2024-09-16T10:28:32.188799+0000 mgr.a (mgr.14373) 12603 : cluster [DBG] pgmap v8740: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 66 KiB/s rd, 0 B/s wr, 108 op/s 2024-09-16T10:28:33.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:28:33 smithi157 bash[24585]: cluster 2024-09-16T10:28:32.188799+0000 mgr.a (mgr.14373) 12603 : cluster [DBG] pgmap v8740: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 66 KiB/s rd, 0 B/s wr, 108 op/s 2024-09-16T10:28:33.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:28:33 smithi086 bash[24289]: cluster 2024-09-16T10:28:32.188799+0000 mgr.a (mgr.14373) 12603 : cluster [DBG] pgmap v8740: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 66 KiB/s rd, 0 B/s wr, 108 op/s 2024-09-16T10:28:35.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:28:35 smithi047 bash[22744]: cluster 2024-09-16T10:28:34.189588+0000 mgr.a (mgr.14373) 12604 : cluster [DBG] pgmap v8741: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 65 KiB/s rd, 0 B/s wr, 107 op/s 2024-09-16T10:28:35.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:28:35 smithi157 bash[24585]: cluster 2024-09-16T10:28:34.189588+0000 mgr.a (mgr.14373) 12604 : cluster [DBG] pgmap v8741: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 65 KiB/s rd, 0 B/s wr, 107 op/s 2024-09-16T10:28:35.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:28:35 smithi086 bash[24289]: cluster 2024-09-16T10:28:34.189588+0000 mgr.a (mgr.14373) 12604 : cluster [DBG] pgmap v8741: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 65 KiB/s rd, 0 B/s wr, 107 op/s 2024-09-16T10:28:35.954 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:28:35.955 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:28:35.955 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:28:36.716 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:28:36.716 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:28:36.716 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:28:36.716 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:28:36.717 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:28:37.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:28:37 smithi047 bash[22744]: cluster 2024-09-16T10:28:36.190144+0000 mgr.a (mgr.14373) 12605 : cluster [DBG] pgmap v8742: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 65 KiB/s rd, 0 B/s wr, 107 op/s 2024-09-16T10:28:37.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:28:37 smithi047 bash[22744]: audit 2024-09-16T10:28:36.286308+0000 mgr.a (mgr.14373) 12606 : audit [DBG] from='client.274854 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:28:37.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:28:37 smithi157 bash[24585]: cluster 2024-09-16T10:28:36.190144+0000 mgr.a (mgr.14373) 12605 : cluster [DBG] pgmap v8742: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 65 KiB/s rd, 0 B/s wr, 107 op/s 2024-09-16T10:28:37.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:28:37 smithi157 bash[24585]: audit 2024-09-16T10:28:36.286308+0000 mgr.a (mgr.14373) 12606 : audit [DBG] from='client.274854 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:28:37.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:28:37 smithi086 bash[24289]: cluster 2024-09-16T10:28:36.190144+0000 mgr.a (mgr.14373) 12605 : cluster [DBG] pgmap v8742: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 65 KiB/s rd, 0 B/s wr, 107 op/s 2024-09-16T10:28:37.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:28:37 smithi086 bash[24289]: audit 2024-09-16T10:28:36.286308+0000 mgr.a (mgr.14373) 12606 : audit [DBG] from='client.274854 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:28:39.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:28:39 smithi157 bash[24585]: cluster 2024-09-16T10:28:38.192944+0000 mgr.a (mgr.14373) 12607 : cluster [DBG] pgmap v8743: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 65 KiB/s rd, 0 B/s wr, 107 op/s 2024-09-16T10:28:39.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:28:39 smithi086 bash[24289]: cluster 2024-09-16T10:28:38.192944+0000 mgr.a (mgr.14373) 12607 : cluster [DBG] pgmap v8743: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 65 KiB/s rd, 0 B/s wr, 107 op/s 2024-09-16T10:28:39.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:28:39 smithi047 bash[22744]: cluster 2024-09-16T10:28:38.192944+0000 mgr.a (mgr.14373) 12607 : cluster [DBG] pgmap v8743: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 65 KiB/s rd, 0 B/s wr, 107 op/s 2024-09-16T10:28:41.717 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:28:41.718 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:28:41.718 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:28:41.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:28:41 smithi157 bash[24585]: cluster 2024-09-16T10:28:40.193745+0000 mgr.a (mgr.14373) 12608 : cluster [DBG] pgmap v8744: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 4.8 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-16T10:28:41.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:28:41 smithi086 bash[24289]: cluster 2024-09-16T10:28:40.193745+0000 mgr.a (mgr.14373) 12608 : cluster [DBG] pgmap v8744: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 4.8 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-16T10:28:41.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:28:41 smithi047 bash[22744]: cluster 2024-09-16T10:28:40.193745+0000 mgr.a (mgr.14373) 12608 : cluster [DBG] pgmap v8744: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 4.8 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-16T10:28:42.482 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:28:42.482 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:28:42.482 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:28:42.483 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:28:42.483 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:28:43.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:28:43 smithi157 bash[24585]: audit 2024-09-16T10:28:42.049477+0000 mgr.a (mgr.14373) 12609 : audit [DBG] from='client.274929 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:28:43.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:28:43 smithi157 bash[24585]: cluster 2024-09-16T10:28:42.195107+0000 mgr.a (mgr.14373) 12610 : cluster [DBG] pgmap v8745: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 5.7 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-16T10:28:43.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:28:43 smithi086 bash[24289]: audit 2024-09-16T10:28:42.049477+0000 mgr.a (mgr.14373) 12609 : audit [DBG] from='client.274929 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:28:43.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:28:43 smithi086 bash[24289]: cluster 2024-09-16T10:28:42.195107+0000 mgr.a (mgr.14373) 12610 : cluster [DBG] pgmap v8745: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 5.7 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-16T10:28:43.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:28:43 smithi047 bash[22744]: audit 2024-09-16T10:28:42.049477+0000 mgr.a (mgr.14373) 12609 : audit [DBG] from='client.274929 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:28:43.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:28:43 smithi047 bash[22744]: cluster 2024-09-16T10:28:42.195107+0000 mgr.a (mgr.14373) 12610 : cluster [DBG] pgmap v8745: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 5.7 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-16T10:28:45.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:28:45 smithi157 bash[24585]: cluster 2024-09-16T10:28:44.196090+0000 mgr.a (mgr.14373) 12611 : cluster [DBG] pgmap v8746: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:28:45.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:28:45 smithi086 bash[24289]: cluster 2024-09-16T10:28:44.196090+0000 mgr.a (mgr.14373) 12611 : cluster [DBG] pgmap v8746: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:28:45.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:28:45 smithi047 bash[22744]: cluster 2024-09-16T10:28:44.196090+0000 mgr.a (mgr.14373) 12611 : cluster [DBG] pgmap v8746: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:28:47.484 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:28:47.484 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:28:47.485 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:28:47.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:28:47 smithi157 bash[24585]: cluster 2024-09-16T10:28:46.197080+0000 mgr.a (mgr.14373) 12612 : cluster [DBG] pgmap v8747: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T10:28:47.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:28:47 smithi086 bash[24289]: cluster 2024-09-16T10:28:46.197080+0000 mgr.a (mgr.14373) 12612 : cluster [DBG] pgmap v8747: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T10:28:47.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:28:47 smithi047 bash[22744]: cluster 2024-09-16T10:28:46.197080+0000 mgr.a (mgr.14373) 12612 : cluster [DBG] pgmap v8747: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T10:28:48.243 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:28:48.244 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:28:48.244 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:28:48.244 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:28:48.244 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:28:49.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:28:49 smithi157 bash[24585]: audit 2024-09-16T10:28:47.819801+0000 mgr.a (mgr.14373) 12613 : audit [DBG] from='client.275004 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:28:49.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:28:49 smithi157 bash[24585]: cluster 2024-09-16T10:28:48.198459+0000 mgr.a (mgr.14373) 12614 : cluster [DBG] pgmap v8748: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:28:49.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:28:49 smithi086 bash[24289]: audit 2024-09-16T10:28:47.819801+0000 mgr.a (mgr.14373) 12613 : audit [DBG] from='client.275004 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:28:49.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:28:49 smithi086 bash[24289]: cluster 2024-09-16T10:28:48.198459+0000 mgr.a (mgr.14373) 12614 : cluster [DBG] pgmap v8748: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:28:49.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:28:49 smithi047 bash[22744]: audit 2024-09-16T10:28:47.819801+0000 mgr.a (mgr.14373) 12613 : audit [DBG] from='client.275004 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:28:49.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:28:49 smithi047 bash[22744]: cluster 2024-09-16T10:28:48.198459+0000 mgr.a (mgr.14373) 12614 : cluster [DBG] pgmap v8748: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:28:50.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:28:50 smithi157 bash[24585]: cluster 2024-09-16T10:28:50.199195+0000 mgr.a (mgr.14373) 12615 : cluster [DBG] pgmap v8749: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:28:50.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:28:50 smithi086 bash[24289]: cluster 2024-09-16T10:28:50.199195+0000 mgr.a (mgr.14373) 12615 : cluster [DBG] pgmap v8749: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:28:50.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:28:50 smithi047 bash[22744]: cluster 2024-09-16T10:28:50.199195+0000 mgr.a (mgr.14373) 12615 : cluster [DBG] pgmap v8749: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:28:53.245 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:28:53.245 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:28:53.246 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:28:53.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:28:53 smithi157 bash[24585]: cluster 2024-09-16T10:28:52.201139+0000 mgr.a (mgr.14373) 12616 : cluster [DBG] pgmap v8750: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:28:53.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:28:53 smithi086 bash[24289]: cluster 2024-09-16T10:28:52.201139+0000 mgr.a (mgr.14373) 12616 : cluster [DBG] pgmap v8750: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:28:53.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:28:53 smithi047 bash[22744]: cluster 2024-09-16T10:28:52.201139+0000 mgr.a (mgr.14373) 12616 : cluster [DBG] pgmap v8750: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:28:53.986 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:28:53.987 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:28:53.987 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:28:53.987 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:28:53.987 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:28:55.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:28:55 smithi157 bash[24585]: audit 2024-09-16T10:28:53.571970+0000 mgr.a (mgr.14373) 12617 : audit [DBG] from='client.275082 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:28:55.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:28:55 smithi157 bash[24585]: cluster 2024-09-16T10:28:54.202104+0000 mgr.a (mgr.14373) 12618 : cluster [DBG] pgmap v8751: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:28:55.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:28:55 smithi086 bash[24289]: audit 2024-09-16T10:28:53.571970+0000 mgr.a (mgr.14373) 12617 : audit [DBG] from='client.275082 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:28:55.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:28:55 smithi086 bash[24289]: cluster 2024-09-16T10:28:54.202104+0000 mgr.a (mgr.14373) 12618 : cluster [DBG] pgmap v8751: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:28:55.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:28:55 smithi047 bash[22744]: audit 2024-09-16T10:28:53.571970+0000 mgr.a (mgr.14373) 12617 : audit [DBG] from='client.275082 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:28:55.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:28:55 smithi047 bash[22744]: cluster 2024-09-16T10:28:54.202104+0000 mgr.a (mgr.14373) 12618 : cluster [DBG] pgmap v8751: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:28:57.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:28:57 smithi157 bash[24585]: cluster 2024-09-16T10:28:56.202909+0000 mgr.a (mgr.14373) 12619 : cluster [DBG] pgmap v8752: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:28:57.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:28:57 smithi086 bash[24289]: cluster 2024-09-16T10:28:56.202909+0000 mgr.a (mgr.14373) 12619 : cluster [DBG] pgmap v8752: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:28:57.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:28:57 smithi047 bash[22744]: cluster 2024-09-16T10:28:56.202909+0000 mgr.a (mgr.14373) 12619 : cluster [DBG] pgmap v8752: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:28:58.988 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:28:58.989 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:28:58.989 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:28:59.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:28:59 smithi157 bash[24585]: cluster 2024-09-16T10:28:58.205086+0000 mgr.a (mgr.14373) 12620 : cluster [DBG] pgmap v8753: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:28:59.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:28:59 smithi086 bash[24289]: cluster 2024-09-16T10:28:58.205086+0000 mgr.a (mgr.14373) 12620 : cluster [DBG] pgmap v8753: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:28:59.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:28:59 smithi047 bash[22744]: cluster 2024-09-16T10:28:58.205086+0000 mgr.a (mgr.14373) 12620 : cluster [DBG] pgmap v8753: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:28:59.741 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:28:59.742 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:28:59.742 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:28:59.742 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:28:59.742 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:29:00.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:29:00 smithi157 bash[24585]: audit 2024-09-16T10:28:59.317103+0000 mgr.a (mgr.14373) 12621 : audit [DBG] from='client.275160 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:29:00.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:29:00 smithi086 bash[24289]: audit 2024-09-16T10:28:59.317103+0000 mgr.a (mgr.14373) 12621 : audit [DBG] from='client.275160 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:29:00.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:29:00 smithi047 bash[22744]: audit 2024-09-16T10:28:59.317103+0000 mgr.a (mgr.14373) 12621 : audit [DBG] from='client.275160 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:29:01.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:29:01 smithi157 bash[24585]: cluster 2024-09-16T10:29:00.206091+0000 mgr.a (mgr.14373) 12622 : cluster [DBG] pgmap v8754: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:29:01.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:29:01 smithi086 bash[24289]: cluster 2024-09-16T10:29:00.206091+0000 mgr.a (mgr.14373) 12622 : cluster [DBG] pgmap v8754: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:29:01.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:29:01 smithi047 bash[22744]: cluster 2024-09-16T10:29:00.206091+0000 mgr.a (mgr.14373) 12622 : cluster [DBG] pgmap v8754: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:29:02.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:29:02 smithi157 bash[24585]: audit 2024-09-16T10:29:01.580512+0000 mon.b (mon.2) 1158 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T10:29:02.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:29:02 smithi086 bash[24289]: audit 2024-09-16T10:29:01.580512+0000 mon.b (mon.2) 1158 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T10:29:02.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:29:02 smithi047 bash[22744]: audit 2024-09-16T10:29:01.580512+0000 mon.b (mon.2) 1158 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T10:29:03.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:29:03 smithi157 bash[24585]: cluster 2024-09-16T10:29:02.207688+0000 mgr.a (mgr.14373) 12623 : cluster [DBG] pgmap v8755: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:29:03.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:29:03 smithi157 bash[24585]: audit 2024-09-16T10:29:02.408112+0000 mon.b (mon.2) 1159 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T10:29:03.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:29:03 smithi157 bash[24585]: audit 2024-09-16T10:29:02.410356+0000 mon.b (mon.2) 1160 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T10:29:03.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:29:03 smithi157 bash[24585]: audit 2024-09-16T10:29:02.421566+0000 mon.a (mon.0) 1322 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:29:03.558 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:29:03 smithi157 bash[24585]: audit 2024-09-16T10:29:02.425745+0000 mon.b (mon.2) 1161 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:29:03.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:29:03 smithi086 bash[24289]: cluster 2024-09-16T10:29:02.207688+0000 mgr.a (mgr.14373) 12623 : cluster [DBG] pgmap v8755: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:29:03.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:29:03 smithi086 bash[24289]: audit 2024-09-16T10:29:02.408112+0000 mon.b (mon.2) 1159 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T10:29:03.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:29:03 smithi086 bash[24289]: audit 2024-09-16T10:29:02.410356+0000 mon.b (mon.2) 1160 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T10:29:03.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:29:03 smithi086 bash[24289]: audit 2024-09-16T10:29:02.421566+0000 mon.a (mon.0) 1322 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:29:03.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:29:03 smithi086 bash[24289]: audit 2024-09-16T10:29:02.425745+0000 mon.b (mon.2) 1161 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:29:03.593 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 10:29:03 smithi047 bash[22994]: debug 2024-09-16T10:29:03.180+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T10:29:03.593 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 10:29:03 smithi047 bash[22994]: debug 2024-09-16T10:29:03.184+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T10:29:03.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:29:03 smithi047 bash[22744]: cluster 2024-09-16T10:29:02.207688+0000 mgr.a (mgr.14373) 12623 : cluster [DBG] pgmap v8755: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:29:03.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:29:03 smithi047 bash[22744]: audit 2024-09-16T10:29:02.408112+0000 mon.b (mon.2) 1159 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T10:29:03.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:29:03 smithi047 bash[22744]: audit 2024-09-16T10:29:02.410356+0000 mon.b (mon.2) 1160 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T10:29:03.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:29:03 smithi047 bash[22744]: audit 2024-09-16T10:29:02.421566+0000 mon.a (mon.0) 1322 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:29:03.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:29:03 smithi047 bash[22744]: audit 2024-09-16T10:29:02.425745+0000 mon.b (mon.2) 1161 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:29:04.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:29:04 smithi157 bash[24585]: audit 2024-09-16T10:29:02.428423+0000 mgr.a (mgr.14373) 12624 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:29:04.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:29:04 smithi157 bash[24585]: audit 2024-09-16T10:29:03.186303+0000 mgr.a (mgr.14373) 12625 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T10:29:04.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:29:04 smithi157 bash[24585]: cephadm 2024-09-16T10:29:03.188696+0000 mgr.a (mgr.14373) 12626 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T10:29:04.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:29:04 smithi086 bash[24289]: audit 2024-09-16T10:29:02.428423+0000 mgr.a (mgr.14373) 12624 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:29:04.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:29:04 smithi086 bash[24289]: audit 2024-09-16T10:29:03.186303+0000 mgr.a (mgr.14373) 12625 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T10:29:04.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:29:04 smithi086 bash[24289]: cephadm 2024-09-16T10:29:03.188696+0000 mgr.a (mgr.14373) 12626 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T10:29:04.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:29:04 smithi047 bash[22744]: audit 2024-09-16T10:29:02.428423+0000 mgr.a (mgr.14373) 12624 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:29:04.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:29:04 smithi047 bash[22744]: audit 2024-09-16T10:29:03.186303+0000 mgr.a (mgr.14373) 12625 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T10:29:04.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:29:04 smithi047 bash[22744]: cephadm 2024-09-16T10:29:03.188696+0000 mgr.a (mgr.14373) 12626 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T10:29:04.743 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:29:04.744 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:29:04.744 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:29:05.503 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:29:05.503 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:29:05.503 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:29:05.503 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:29:05.503 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:29:05.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:29:05 smithi157 bash[24585]: cluster 2024-09-16T10:29:04.208602+0000 mgr.a (mgr.14373) 12627 : cluster [DBG] pgmap v8756: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:29:05.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:29:05 smithi086 bash[24289]: cluster 2024-09-16T10:29:04.208602+0000 mgr.a (mgr.14373) 12627 : cluster [DBG] pgmap v8756: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:29:05.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:29:05 smithi047 bash[22744]: cluster 2024-09-16T10:29:04.208602+0000 mgr.a (mgr.14373) 12627 : cluster [DBG] pgmap v8756: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:29:06.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:29:06 smithi157 bash[24585]: audit 2024-09-16T10:29:05.073997+0000 mgr.a (mgr.14373) 12628 : audit [DBG] from='client.275337 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:29:06.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:29:06 smithi086 bash[24289]: audit 2024-09-16T10:29:05.073997+0000 mgr.a (mgr.14373) 12628 : audit [DBG] from='client.275337 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:29:06.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:29:06 smithi047 bash[22744]: audit 2024-09-16T10:29:05.073997+0000 mgr.a (mgr.14373) 12628 : audit [DBG] from='client.275337 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:29:07.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:29:07 smithi086 bash[24289]: cluster 2024-09-16T10:29:06.209560+0000 mgr.a (mgr.14373) 12629 : cluster [DBG] pgmap v8757: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:29:07.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:29:07 smithi047 bash[22744]: cluster 2024-09-16T10:29:06.209560+0000 mgr.a (mgr.14373) 12629 : cluster [DBG] pgmap v8757: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:29:07.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:29:07 smithi157 bash[24585]: cluster 2024-09-16T10:29:06.209560+0000 mgr.a (mgr.14373) 12629 : cluster [DBG] pgmap v8757: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:29:09.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:29:09 smithi086 bash[24289]: cluster 2024-09-16T10:29:08.211838+0000 mgr.a (mgr.14373) 12630 : cluster [DBG] pgmap v8758: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:29:09.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:29:09 smithi047 bash[22744]: cluster 2024-09-16T10:29:08.211838+0000 mgr.a (mgr.14373) 12630 : cluster [DBG] pgmap v8758: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:29:09.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:29:09 smithi157 bash[24585]: cluster 2024-09-16T10:29:08.211838+0000 mgr.a (mgr.14373) 12630 : cluster [DBG] pgmap v8758: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:29:10.504 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:29:10.505 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:29:10.505 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:29:11.278 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:29:11.278 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:29:11.278 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:29:11.278 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:29:11.278 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:29:11.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:29:11 smithi047 bash[22744]: cluster 2024-09-16T10:29:10.212602+0000 mgr.a (mgr.14373) 12631 : cluster [DBG] pgmap v8759: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:29:11.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:29:11 smithi157 bash[24585]: cluster 2024-09-16T10:29:10.212602+0000 mgr.a (mgr.14373) 12631 : cluster [DBG] pgmap v8759: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:29:11.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:29:11 smithi086 bash[24289]: cluster 2024-09-16T10:29:10.212602+0000 mgr.a (mgr.14373) 12631 : cluster [DBG] pgmap v8759: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:29:12.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:29:12 smithi047 bash[22744]: audit 2024-09-16T10:29:10.842921+0000 mgr.a (mgr.14373) 12632 : audit [DBG] from='client.275415 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:29:12.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:29:12 smithi157 bash[24585]: audit 2024-09-16T10:29:10.842921+0000 mgr.a (mgr.14373) 12632 : audit [DBG] from='client.275415 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:29:12.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:29:12 smithi086 bash[24289]: audit 2024-09-16T10:29:10.842921+0000 mgr.a (mgr.14373) 12632 : audit [DBG] from='client.275415 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:29:13.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:29:13 smithi047 bash[22744]: cluster 2024-09-16T10:29:12.214934+0000 mgr.a (mgr.14373) 12633 : cluster [DBG] pgmap v8760: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:29:13.808 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:29:13 smithi157 bash[24585]: cluster 2024-09-16T10:29:12.214934+0000 mgr.a (mgr.14373) 12633 : cluster [DBG] pgmap v8760: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:29:13.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:29:13 smithi086 bash[24289]: cluster 2024-09-16T10:29:12.214934+0000 mgr.a (mgr.14373) 12633 : cluster [DBG] pgmap v8760: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:29:15.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:29:15 smithi047 bash[22744]: cluster 2024-09-16T10:29:14.215702+0000 mgr.a (mgr.14373) 12634 : cluster [DBG] pgmap v8761: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:29:15.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:29:15 smithi157 bash[24585]: cluster 2024-09-16T10:29:14.215702+0000 mgr.a (mgr.14373) 12634 : cluster [DBG] pgmap v8761: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:29:15.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:29:15 smithi086 bash[24289]: cluster 2024-09-16T10:29:14.215702+0000 mgr.a (mgr.14373) 12634 : cluster [DBG] pgmap v8761: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:29:16.280 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:29:16.280 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:29:16.281 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:29:17.059 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:29:17.059 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:29:17.059 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:29:17.059 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:29:17.059 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:29:17.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:29:17 smithi157 bash[24585]: cluster 2024-09-16T10:29:16.216617+0000 mgr.a (mgr.14373) 12635 : cluster [DBG] pgmap v8762: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:29:17.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:29:17 smithi086 bash[24289]: cluster 2024-09-16T10:29:16.216617+0000 mgr.a (mgr.14373) 12635 : cluster [DBG] pgmap v8762: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:29:17.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:29:17 smithi047 bash[22744]: cluster 2024-09-16T10:29:16.216617+0000 mgr.a (mgr.14373) 12635 : cluster [DBG] pgmap v8762: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:29:18.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:29:18 smithi157 bash[24585]: audit 2024-09-16T10:29:16.614497+0000 mgr.a (mgr.14373) 12636 : audit [DBG] from='client.275490 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:29:18.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:29:18 smithi086 bash[24289]: audit 2024-09-16T10:29:16.614497+0000 mgr.a (mgr.14373) 12636 : audit [DBG] from='client.275490 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:29:18.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:29:18 smithi047 bash[22744]: audit 2024-09-16T10:29:16.614497+0000 mgr.a (mgr.14373) 12636 : audit [DBG] from='client.275490 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:29:19.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:29:19 smithi157 bash[24585]: cluster 2024-09-16T10:29:18.219391+0000 mgr.a (mgr.14373) 12637 : cluster [DBG] pgmap v8763: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:29:19.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:29:19 smithi086 bash[24289]: cluster 2024-09-16T10:29:18.219391+0000 mgr.a (mgr.14373) 12637 : cluster [DBG] pgmap v8763: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:29:19.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:29:19 smithi047 bash[22744]: cluster 2024-09-16T10:29:18.219391+0000 mgr.a (mgr.14373) 12637 : cluster [DBG] pgmap v8763: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:29:21.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:29:21 smithi157 bash[24585]: cluster 2024-09-16T10:29:20.220211+0000 mgr.a (mgr.14373) 12638 : cluster [DBG] pgmap v8764: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:29:21.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:29:21 smithi086 bash[24289]: cluster 2024-09-16T10:29:20.220211+0000 mgr.a (mgr.14373) 12638 : cluster [DBG] pgmap v8764: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:29:21.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:29:21 smithi047 bash[22744]: cluster 2024-09-16T10:29:20.220211+0000 mgr.a (mgr.14373) 12638 : cluster [DBG] pgmap v8764: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:29:22.061 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:29:22.062 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:29:22.062 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:29:22.845 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:29:22.846 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:29:22.846 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:29:22.846 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:29:22.846 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:29:23.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:29:23 smithi157 bash[24585]: cluster 2024-09-16T10:29:22.222197+0000 mgr.a (mgr.14373) 12639 : cluster [DBG] pgmap v8765: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:29:23.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:29:23 smithi086 bash[24289]: cluster 2024-09-16T10:29:22.222197+0000 mgr.a (mgr.14373) 12639 : cluster [DBG] pgmap v8765: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:29:23.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:29:23 smithi047 bash[22744]: cluster 2024-09-16T10:29:22.222197+0000 mgr.a (mgr.14373) 12639 : cluster [DBG] pgmap v8765: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:29:24.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:29:24 smithi157 bash[24585]: audit 2024-09-16T10:29:22.397605+0000 mgr.a (mgr.14373) 12640 : audit [DBG] from='client.275568 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:29:24.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:29:24 smithi086 bash[24289]: audit 2024-09-16T10:29:22.397605+0000 mgr.a (mgr.14373) 12640 : audit [DBG] from='client.275568 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:29:24.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:29:24 smithi047 bash[22744]: audit 2024-09-16T10:29:22.397605+0000 mgr.a (mgr.14373) 12640 : audit [DBG] from='client.275568 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:29:25.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:29:25 smithi157 bash[24585]: cluster 2024-09-16T10:29:24.223108+0000 mgr.a (mgr.14373) 12641 : cluster [DBG] pgmap v8766: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:29:25.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:29:25 smithi086 bash[24289]: cluster 2024-09-16T10:29:24.223108+0000 mgr.a (mgr.14373) 12641 : cluster [DBG] pgmap v8766: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:29:25.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:29:25 smithi047 bash[22744]: cluster 2024-09-16T10:29:24.223108+0000 mgr.a (mgr.14373) 12641 : cluster [DBG] pgmap v8766: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:29:26.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:29:26 smithi157 bash[24585]: cluster 2024-09-16T10:29:26.223866+0000 mgr.a (mgr.14373) 12642 : cluster [DBG] pgmap v8767: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T10:29:26.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:29:26 smithi086 bash[24289]: cluster 2024-09-16T10:29:26.223866+0000 mgr.a (mgr.14373) 12642 : cluster [DBG] pgmap v8767: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T10:29:26.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:29:26 smithi047 bash[22744]: cluster 2024-09-16T10:29:26.223866+0000 mgr.a (mgr.14373) 12642 : cluster [DBG] pgmap v8767: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T10:29:27.847 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:29:27.848 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:29:27.848 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:29:28.592 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:29:28.592 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:29:28.592 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:29:28.592 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:29:28.592 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:29:29.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:29:29 smithi157 bash[24585]: audit 2024-09-16T10:29:28.168585+0000 mgr.a (mgr.14373) 12643 : audit [DBG] from='client.275646 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:29:29.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:29:29 smithi157 bash[24585]: cluster 2024-09-16T10:29:28.226895+0000 mgr.a (mgr.14373) 12644 : cluster [DBG] pgmap v8768: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:29:29.572 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:29:29 smithi086 bash[24289]: audit 2024-09-16T10:29:28.168585+0000 mgr.a (mgr.14373) 12643 : audit [DBG] from='client.275646 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:29:29.572 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:29:29 smithi086 bash[24289]: cluster 2024-09-16T10:29:28.226895+0000 mgr.a (mgr.14373) 12644 : cluster [DBG] pgmap v8768: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:29:29.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:29:29 smithi047 bash[22744]: audit 2024-09-16T10:29:28.168585+0000 mgr.a (mgr.14373) 12643 : audit [DBG] from='client.275646 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:29:29.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:29:29 smithi047 bash[22744]: cluster 2024-09-16T10:29:28.226895+0000 mgr.a (mgr.14373) 12644 : cluster [DBG] pgmap v8768: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:29:31.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:29:31 smithi157 bash[24585]: cluster 2024-09-16T10:29:30.227975+0000 mgr.a (mgr.14373) 12645 : cluster [DBG] pgmap v8769: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:29:31.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:29:31 smithi086 bash[24289]: cluster 2024-09-16T10:29:30.227975+0000 mgr.a (mgr.14373) 12645 : cluster [DBG] pgmap v8769: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:29:31.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:29:31 smithi047 bash[22744]: cluster 2024-09-16T10:29:30.227975+0000 mgr.a (mgr.14373) 12645 : cluster [DBG] pgmap v8769: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:29:33.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:29:33 smithi157 bash[24585]: cluster 2024-09-16T10:29:32.230339+0000 mgr.a (mgr.14373) 12646 : cluster [DBG] pgmap v8770: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:29:33.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:29:33 smithi086 bash[24289]: cluster 2024-09-16T10:29:32.230339+0000 mgr.a (mgr.14373) 12646 : cluster [DBG] pgmap v8770: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:29:33.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:29:33 smithi047 bash[22744]: cluster 2024-09-16T10:29:32.230339+0000 mgr.a (mgr.14373) 12646 : cluster [DBG] pgmap v8770: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:29:33.593 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:29:33.594 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:29:33.594 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:29:34.361 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:29:34.362 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:29:34.362 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:29:34.362 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:29:34.362 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:29:35.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:29:35 smithi157 bash[24585]: audit 2024-09-16T10:29:33.926700+0000 mgr.a (mgr.14373) 12647 : audit [DBG] from='client.275724 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:29:35.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:29:35 smithi157 bash[24585]: cluster 2024-09-16T10:29:34.230888+0000 mgr.a (mgr.14373) 12648 : cluster [DBG] pgmap v8771: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:29:35.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:29:35 smithi086 bash[24289]: audit 2024-09-16T10:29:33.926700+0000 mgr.a (mgr.14373) 12647 : audit [DBG] from='client.275724 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:29:35.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:29:35 smithi086 bash[24289]: cluster 2024-09-16T10:29:34.230888+0000 mgr.a (mgr.14373) 12648 : cluster [DBG] pgmap v8771: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:29:35.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:29:35 smithi047 bash[22744]: audit 2024-09-16T10:29:33.926700+0000 mgr.a (mgr.14373) 12647 : audit [DBG] from='client.275724 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:29:35.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:29:35 smithi047 bash[22744]: cluster 2024-09-16T10:29:34.230888+0000 mgr.a (mgr.14373) 12648 : cluster [DBG] pgmap v8771: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:29:37.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:29:37 smithi157 bash[24585]: cluster 2024-09-16T10:29:36.231762+0000 mgr.a (mgr.14373) 12649 : cluster [DBG] pgmap v8772: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:29:37.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:29:37 smithi086 bash[24289]: cluster 2024-09-16T10:29:36.231762+0000 mgr.a (mgr.14373) 12649 : cluster [DBG] pgmap v8772: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:29:37.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:29:37 smithi047 bash[22744]: cluster 2024-09-16T10:29:36.231762+0000 mgr.a (mgr.14373) 12649 : cluster [DBG] pgmap v8772: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:29:39.363 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:29:39.363 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:29:39.364 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:29:39.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:29:39 smithi157 bash[24585]: cluster 2024-09-16T10:29:38.233992+0000 mgr.a (mgr.14373) 12650 : cluster [DBG] pgmap v8773: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:29:39.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:29:39 smithi086 bash[24289]: cluster 2024-09-16T10:29:38.233992+0000 mgr.a (mgr.14373) 12650 : cluster [DBG] pgmap v8773: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:29:39.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:29:39 smithi047 bash[22744]: cluster 2024-09-16T10:29:38.233992+0000 mgr.a (mgr.14373) 12650 : cluster [DBG] pgmap v8773: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:29:40.146 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:29:40.146 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:29:40.146 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:29:40.146 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:29:40.146 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:29:41.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:29:41 smithi086 bash[24289]: audit 2024-09-16T10:29:39.695450+0000 mgr.a (mgr.14373) 12651 : audit [DBG] from='client.275799 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:29:41.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:29:41 smithi086 bash[24289]: cluster 2024-09-16T10:29:40.234968+0000 mgr.a (mgr.14373) 12652 : cluster [DBG] pgmap v8774: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:29:41.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:29:41 smithi047 bash[22744]: audit 2024-09-16T10:29:39.695450+0000 mgr.a (mgr.14373) 12651 : audit [DBG] from='client.275799 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:29:41.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:29:41 smithi047 bash[22744]: cluster 2024-09-16T10:29:40.234968+0000 mgr.a (mgr.14373) 12652 : cluster [DBG] pgmap v8774: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:29:41.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:29:41 smithi157 bash[24585]: audit 2024-09-16T10:29:39.695450+0000 mgr.a (mgr.14373) 12651 : audit [DBG] from='client.275799 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:29:41.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:29:41 smithi157 bash[24585]: cluster 2024-09-16T10:29:40.234968+0000 mgr.a (mgr.14373) 12652 : cluster [DBG] pgmap v8774: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:29:43.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:29:43 smithi086 bash[24289]: cluster 2024-09-16T10:29:42.237127+0000 mgr.a (mgr.14373) 12653 : cluster [DBG] pgmap v8775: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:29:43.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:29:43 smithi047 bash[22744]: cluster 2024-09-16T10:29:42.237127+0000 mgr.a (mgr.14373) 12653 : cluster [DBG] pgmap v8775: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:29:43.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:29:43 smithi157 bash[24585]: cluster 2024-09-16T10:29:42.237127+0000 mgr.a (mgr.14373) 12653 : cluster [DBG] pgmap v8775: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:29:45.148 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:29:45.148 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:29:45.148 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:29:45.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:29:45 smithi086 bash[24289]: cluster 2024-09-16T10:29:44.237917+0000 mgr.a (mgr.14373) 12654 : cluster [DBG] pgmap v8776: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:29:45.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:29:45 smithi047 bash[22744]: cluster 2024-09-16T10:29:44.237917+0000 mgr.a (mgr.14373) 12654 : cluster [DBG] pgmap v8776: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:29:45.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:29:45 smithi157 bash[24585]: cluster 2024-09-16T10:29:44.237917+0000 mgr.a (mgr.14373) 12654 : cluster [DBG] pgmap v8776: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:29:45.932 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:29:45.932 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:29:45.932 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:29:45.932 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:29:45.933 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:29:47.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:29:47 smithi047 bash[22744]: audit 2024-09-16T10:29:45.486402+0000 mgr.a (mgr.14373) 12655 : audit [DBG] from='client.275877 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:29:47.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:29:47 smithi047 bash[22744]: cluster 2024-09-16T10:29:46.238900+0000 mgr.a (mgr.14373) 12656 : cluster [DBG] pgmap v8777: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:29:47.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:29:47 smithi157 bash[24585]: audit 2024-09-16T10:29:45.486402+0000 mgr.a (mgr.14373) 12655 : audit [DBG] from='client.275877 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:29:47.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:29:47 smithi157 bash[24585]: cluster 2024-09-16T10:29:46.238900+0000 mgr.a (mgr.14373) 12656 : cluster [DBG] pgmap v8777: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:29:47.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:29:47 smithi086 bash[24289]: audit 2024-09-16T10:29:45.486402+0000 mgr.a (mgr.14373) 12655 : audit [DBG] from='client.275877 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:29:47.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:29:47 smithi086 bash[24289]: cluster 2024-09-16T10:29:46.238900+0000 mgr.a (mgr.14373) 12656 : cluster [DBG] pgmap v8777: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:29:49.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:29:49 smithi047 bash[22744]: cluster 2024-09-16T10:29:48.241138+0000 mgr.a (mgr.14373) 12657 : cluster [DBG] pgmap v8778: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:29:49.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:29:49 smithi157 bash[24585]: cluster 2024-09-16T10:29:48.241138+0000 mgr.a (mgr.14373) 12657 : cluster [DBG] pgmap v8778: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:29:49.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:29:49 smithi086 bash[24289]: cluster 2024-09-16T10:29:48.241138+0000 mgr.a (mgr.14373) 12657 : cluster [DBG] pgmap v8778: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:29:50.933 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:29:50.934 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:29:50.934 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:29:51.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:29:51 smithi047 bash[22744]: cluster 2024-09-16T10:29:50.241893+0000 mgr.a (mgr.14373) 12658 : cluster [DBG] pgmap v8779: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:29:51.693 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:29:51.693 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:29:51.693 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:29:51.693 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:29:51.693 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:29:51.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:29:51 smithi157 bash[24585]: cluster 2024-09-16T10:29:50.241893+0000 mgr.a (mgr.14373) 12658 : cluster [DBG] pgmap v8779: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:29:51.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:29:51 smithi086 bash[24289]: cluster 2024-09-16T10:29:50.241893+0000 mgr.a (mgr.14373) 12658 : cluster [DBG] pgmap v8779: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:29:52.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:29:52 smithi047 bash[22744]: audit 2024-09-16T10:29:51.265481+0000 mgr.a (mgr.14373) 12659 : audit [DBG] from='client.275955 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:29:52.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:29:52 smithi157 bash[24585]: audit 2024-09-16T10:29:51.265481+0000 mgr.a (mgr.14373) 12659 : audit [DBG] from='client.275955 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:29:52.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:29:52 smithi086 bash[24289]: audit 2024-09-16T10:29:51.265481+0000 mgr.a (mgr.14373) 12659 : audit [DBG] from='client.275955 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:29:53.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:29:53 smithi047 bash[22744]: cluster 2024-09-16T10:29:52.244753+0000 mgr.a (mgr.14373) 12660 : cluster [DBG] pgmap v8780: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-16T10:29:53.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:29:53 smithi157 bash[24585]: cluster 2024-09-16T10:29:52.244753+0000 mgr.a (mgr.14373) 12660 : cluster [DBG] pgmap v8780: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-16T10:29:53.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:29:53 smithi086 bash[24289]: cluster 2024-09-16T10:29:52.244753+0000 mgr.a (mgr.14373) 12660 : cluster [DBG] pgmap v8780: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-16T10:29:55.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:29:55 smithi157 bash[24585]: cluster 2024-09-16T10:29:54.245598+0000 mgr.a (mgr.14373) 12661 : cluster [DBG] pgmap v8781: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-16T10:29:55.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:29:55 smithi086 bash[24289]: cluster 2024-09-16T10:29:54.245598+0000 mgr.a (mgr.14373) 12661 : cluster [DBG] pgmap v8781: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-16T10:29:55.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:29:55 smithi047 bash[22744]: cluster 2024-09-16T10:29:54.245598+0000 mgr.a (mgr.14373) 12661 : cluster [DBG] pgmap v8781: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-16T10:29:56.694 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:29:56.695 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:29:56.695 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:29:57.452 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:29:57.453 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:29:57.453 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:29:57.453 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:29:57.453 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:29:57.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:29:57 smithi157 bash[24585]: cluster 2024-09-16T10:29:56.246320+0000 mgr.a (mgr.14373) 12662 : cluster [DBG] pgmap v8782: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-16T10:29:57.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:29:57 smithi086 bash[24289]: cluster 2024-09-16T10:29:56.246320+0000 mgr.a (mgr.14373) 12662 : cluster [DBG] pgmap v8782: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-16T10:29:57.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:29:57 smithi047 bash[22744]: cluster 2024-09-16T10:29:56.246320+0000 mgr.a (mgr.14373) 12662 : cluster [DBG] pgmap v8782: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-16T10:29:58.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:29:58 smithi157 bash[24585]: audit 2024-09-16T10:29:57.023590+0000 mgr.a (mgr.14373) 12663 : audit [DBG] from='client.276033 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:29:58.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:29:58 smithi086 bash[24289]: audit 2024-09-16T10:29:57.023590+0000 mgr.a (mgr.14373) 12663 : audit [DBG] from='client.276033 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:29:58.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:29:58 smithi047 bash[22744]: audit 2024-09-16T10:29:57.023590+0000 mgr.a (mgr.14373) 12663 : audit [DBG] from='client.276033 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:29:59.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:29:59 smithi157 bash[24585]: cluster 2024-09-16T10:29:58.249038+0000 mgr.a (mgr.14373) 12664 : cluster [DBG] pgmap v8783: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:29:59.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:29:59 smithi086 bash[24289]: cluster 2024-09-16T10:29:58.249038+0000 mgr.a (mgr.14373) 12664 : cluster [DBG] pgmap v8783: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:29:59.844 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:29:59 smithi047 bash[22744]: cluster 2024-09-16T10:29:58.249038+0000 mgr.a (mgr.14373) 12664 : cluster [DBG] pgmap v8783: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:30:00.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:30:00 smithi157 bash[24585]: cluster 2024-09-16T10:30:00.000151+0000 mon.a (mon.0) 1323 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-16T10:30:00.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:30:00 smithi086 bash[24289]: cluster 2024-09-16T10:30:00.000151+0000 mon.a (mon.0) 1323 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-16T10:30:00.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:30:00 smithi047 bash[22744]: cluster 2024-09-16T10:30:00.000151+0000 mon.a (mon.0) 1323 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-16T10:30:01.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:30:01 smithi157 bash[24585]: cluster 2024-09-16T10:30:00.249986+0000 mgr.a (mgr.14373) 12665 : cluster [DBG] pgmap v8784: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:30:01.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:30:01 smithi086 bash[24289]: cluster 2024-09-16T10:30:00.249986+0000 mgr.a (mgr.14373) 12665 : cluster [DBG] pgmap v8784: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:30:01.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:30:01 smithi047 bash[22744]: cluster 2024-09-16T10:30:00.249986+0000 mgr.a (mgr.14373) 12665 : cluster [DBG] pgmap v8784: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:30:02.454 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:30:02.455 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:30:02.455 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:30:03.247 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:30:03.247 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:30:03.248 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:30:03.248 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:30:03.248 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:30:03.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:30:03 smithi157 bash[24585]: cluster 2024-09-16T10:30:02.252118+0000 mgr.a (mgr.14373) 12666 : cluster [DBG] pgmap v8785: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:30:03.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:30:03 smithi157 bash[24585]: audit 2024-09-16T10:30:03.241850+0000 mon.b (mon.2) 1162 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T10:30:03.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:30:03 smithi086 bash[24289]: cluster 2024-09-16T10:30:02.252118+0000 mgr.a (mgr.14373) 12666 : cluster [DBG] pgmap v8785: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:30:03.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:30:03 smithi086 bash[24289]: audit 2024-09-16T10:30:03.241850+0000 mon.b (mon.2) 1162 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T10:30:03.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:30:03 smithi047 bash[22744]: cluster 2024-09-16T10:30:02.252118+0000 mgr.a (mgr.14373) 12666 : cluster [DBG] pgmap v8785: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:30:03.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:30:03 smithi047 bash[22744]: audit 2024-09-16T10:30:03.241850+0000 mon.b (mon.2) 1162 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T10:30:04.771 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:30:04 smithi047 bash[22744]: audit 2024-09-16T10:30:02.791959+0000 mgr.a (mgr.14373) 12667 : audit [DBG] from='client.276108 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:30:04.771 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:30:04 smithi047 bash[22744]: audit 2024-09-16T10:30:04.005644+0000 mon.b (mon.2) 1163 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T10:30:04.771 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:30:04 smithi047 bash[22744]: audit 2024-09-16T10:30:04.007775+0000 mon.b (mon.2) 1164 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T10:30:04.771 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:30:04 smithi047 bash[22744]: audit 2024-09-16T10:30:04.019439+0000 mon.a (mon.0) 1324 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:30:04.771 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:30:04 smithi047 bash[22744]: audit 2024-09-16T10:30:04.024800+0000 mon.b (mon.2) 1165 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:30:04.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:30:04 smithi157 bash[24585]: audit 2024-09-16T10:30:02.791959+0000 mgr.a (mgr.14373) 12667 : audit [DBG] from='client.276108 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:30:04.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:30:04 smithi157 bash[24585]: audit 2024-09-16T10:30:04.005644+0000 mon.b (mon.2) 1163 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T10:30:04.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:30:04 smithi157 bash[24585]: audit 2024-09-16T10:30:04.007775+0000 mon.b (mon.2) 1164 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T10:30:04.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:30:04 smithi157 bash[24585]: audit 2024-09-16T10:30:04.019439+0000 mon.a (mon.0) 1324 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:30:04.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:30:04 smithi157 bash[24585]: audit 2024-09-16T10:30:04.024800+0000 mon.b (mon.2) 1165 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:30:04.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:30:04 smithi086 bash[24289]: audit 2024-09-16T10:30:02.791959+0000 mgr.a (mgr.14373) 12667 : audit [DBG] from='client.276108 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:30:04.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:30:04 smithi086 bash[24289]: audit 2024-09-16T10:30:04.005644+0000 mon.b (mon.2) 1163 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T10:30:04.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:30:04 smithi086 bash[24289]: audit 2024-09-16T10:30:04.007775+0000 mon.b (mon.2) 1164 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T10:30:04.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:30:04 smithi086 bash[24289]: audit 2024-09-16T10:30:04.019439+0000 mon.a (mon.0) 1324 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:30:04.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:30:04 smithi086 bash[24289]: audit 2024-09-16T10:30:04.024800+0000 mon.b (mon.2) 1165 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:30:05.093 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 10:30:04 smithi047 bash[22994]: debug 2024-09-16T10:30:04.763+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T10:30:05.093 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 10:30:04 smithi047 bash[22994]: debug 2024-09-16T10:30:04.767+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T10:30:05.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:30:05 smithi157 bash[24585]: audit 2024-09-16T10:30:04.027677+0000 mgr.a (mgr.14373) 12668 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:30:05.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:30:05 smithi157 bash[24585]: cluster 2024-09-16T10:30:04.252940+0000 mgr.a (mgr.14373) 12669 : cluster [DBG] pgmap v8786: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-16T10:30:05.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:30:05 smithi086 bash[24289]: audit 2024-09-16T10:30:04.027677+0000 mgr.a (mgr.14373) 12668 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:30:05.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:30:05 smithi086 bash[24289]: cluster 2024-09-16T10:30:04.252940+0000 mgr.a (mgr.14373) 12669 : cluster [DBG] pgmap v8786: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-16T10:30:05.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:30:05 smithi047 bash[22744]: audit 2024-09-16T10:30:04.027677+0000 mgr.a (mgr.14373) 12668 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:30:05.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:30:05 smithi047 bash[22744]: cluster 2024-09-16T10:30:04.252940+0000 mgr.a (mgr.14373) 12669 : cluster [DBG] pgmap v8786: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-16T10:30:06.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:30:06 smithi157 bash[24585]: audit 2024-09-16T10:30:04.769649+0000 mgr.a (mgr.14373) 12670 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T10:30:06.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:30:06 smithi157 bash[24585]: cephadm 2024-09-16T10:30:04.771763+0000 mgr.a (mgr.14373) 12671 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T10:30:06.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:30:06 smithi086 bash[24289]: audit 2024-09-16T10:30:04.769649+0000 mgr.a (mgr.14373) 12670 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T10:30:06.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:30:06 smithi086 bash[24289]: cephadm 2024-09-16T10:30:04.771763+0000 mgr.a (mgr.14373) 12671 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T10:30:06.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:30:06 smithi047 bash[22744]: audit 2024-09-16T10:30:04.769649+0000 mgr.a (mgr.14373) 12670 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T10:30:06.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:30:06 smithi047 bash[22744]: cephadm 2024-09-16T10:30:04.771763+0000 mgr.a (mgr.14373) 12671 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T10:30:07.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:30:07 smithi157 bash[24585]: cluster 2024-09-16T10:30:06.253837+0000 mgr.a (mgr.14373) 12672 : cluster [DBG] pgmap v8787: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-16T10:30:07.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:30:07 smithi086 bash[24289]: cluster 2024-09-16T10:30:06.253837+0000 mgr.a (mgr.14373) 12672 : cluster [DBG] pgmap v8787: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-16T10:30:07.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:30:07 smithi047 bash[22744]: cluster 2024-09-16T10:30:06.253837+0000 mgr.a (mgr.14373) 12672 : cluster [DBG] pgmap v8787: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-16T10:30:08.249 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:30:08.250 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:30:08.250 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:30:08.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:30:08 smithi157 bash[24585]: cluster 2024-09-16T10:30:08.255472+0000 mgr.a (mgr.14373) 12673 : cluster [DBG] pgmap v8788: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:30:08.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:30:08 smithi086 bash[24289]: cluster 2024-09-16T10:30:08.255472+0000 mgr.a (mgr.14373) 12673 : cluster [DBG] pgmap v8788: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:30:08.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:30:08 smithi047 bash[22744]: cluster 2024-09-16T10:30:08.255472+0000 mgr.a (mgr.14373) 12673 : cluster [DBG] pgmap v8788: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:30:09.041 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:30:09.041 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:30:09.041 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:30:09.041 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:30:09.041 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:30:09.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:30:09 smithi157 bash[24585]: audit 2024-09-16T10:30:08.589492+0000 mgr.a (mgr.14373) 12674 : audit [DBG] from='client.276288 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:30:09.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:30:09 smithi086 bash[24289]: audit 2024-09-16T10:30:08.589492+0000 mgr.a (mgr.14373) 12674 : audit [DBG] from='client.276288 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:30:09.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:30:09 smithi047 bash[22744]: audit 2024-09-16T10:30:08.589492+0000 mgr.a (mgr.14373) 12674 : audit [DBG] from='client.276288 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:30:10.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:30:10 smithi157 bash[24585]: cluster 2024-09-16T10:30:10.256377+0000 mgr.a (mgr.14373) 12675 : cluster [DBG] pgmap v8789: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:30:10.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:30:10 smithi086 bash[24289]: cluster 2024-09-16T10:30:10.256377+0000 mgr.a (mgr.14373) 12675 : cluster [DBG] pgmap v8789: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:30:10.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:30:10 smithi047 bash[22744]: cluster 2024-09-16T10:30:10.256377+0000 mgr.a (mgr.14373) 12675 : cluster [DBG] pgmap v8789: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:30:13.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:30:13 smithi086 bash[24289]: cluster 2024-09-16T10:30:12.258566+0000 mgr.a (mgr.14373) 12676 : cluster [DBG] pgmap v8790: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:30:13.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:30:13 smithi047 bash[22744]: cluster 2024-09-16T10:30:12.258566+0000 mgr.a (mgr.14373) 12676 : cluster [DBG] pgmap v8790: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:30:13.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:30:13 smithi157 bash[24585]: cluster 2024-09-16T10:30:12.258566+0000 mgr.a (mgr.14373) 12676 : cluster [DBG] pgmap v8790: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:30:14.042 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:30:14.042 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:30:14.042 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:30:14.821 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:30:14.822 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:30:14.822 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:30:14.822 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:30:14.822 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:30:15.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:30:15 smithi047 bash[22744]: cluster 2024-09-16T10:30:14.259316+0000 mgr.a (mgr.14373) 12677 : cluster [DBG] pgmap v8791: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:30:15.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:30:15 smithi047 bash[22744]: audit 2024-09-16T10:30:14.378191+0000 mgr.a (mgr.14373) 12678 : audit [DBG] from='client.276366 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:30:15.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:30:15 smithi157 bash[24585]: cluster 2024-09-16T10:30:14.259316+0000 mgr.a (mgr.14373) 12677 : cluster [DBG] pgmap v8791: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:30:15.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:30:15 smithi157 bash[24585]: audit 2024-09-16T10:30:14.378191+0000 mgr.a (mgr.14373) 12678 : audit [DBG] from='client.276366 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:30:15.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:30:15 smithi086 bash[24289]: cluster 2024-09-16T10:30:14.259316+0000 mgr.a (mgr.14373) 12677 : cluster [DBG] pgmap v8791: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:30:15.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:30:15 smithi086 bash[24289]: audit 2024-09-16T10:30:14.378191+0000 mgr.a (mgr.14373) 12678 : audit [DBG] from='client.276366 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:30:17.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:30:17 smithi047 bash[22744]: cluster 2024-09-16T10:30:16.260229+0000 mgr.a (mgr.14373) 12679 : cluster [DBG] pgmap v8792: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:30:17.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:30:17 smithi157 bash[24585]: cluster 2024-09-16T10:30:16.260229+0000 mgr.a (mgr.14373) 12679 : cluster [DBG] pgmap v8792: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:30:17.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:30:17 smithi086 bash[24289]: cluster 2024-09-16T10:30:16.260229+0000 mgr.a (mgr.14373) 12679 : cluster [DBG] pgmap v8792: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:30:19.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:30:19 smithi047 bash[22744]: cluster 2024-09-16T10:30:18.262454+0000 mgr.a (mgr.14373) 12680 : cluster [DBG] pgmap v8793: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:30:19.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:30:19 smithi157 bash[24585]: cluster 2024-09-16T10:30:18.262454+0000 mgr.a (mgr.14373) 12680 : cluster [DBG] pgmap v8793: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:30:19.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:30:19 smithi086 bash[24289]: cluster 2024-09-16T10:30:18.262454+0000 mgr.a (mgr.14373) 12680 : cluster [DBG] pgmap v8793: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:30:19.823 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:30:19.824 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:30:19.824 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:30:20.615 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:30:20.615 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:30:20.615 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:30:20.616 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:30:20.616 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:30:21.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:30:21 smithi047 bash[22744]: audit 2024-09-16T10:30:20.156598+0000 mgr.a (mgr.14373) 12681 : audit [DBG] from='client.276441 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:30:21.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:30:21 smithi047 bash[22744]: cluster 2024-09-16T10:30:20.262957+0000 mgr.a (mgr.14373) 12682 : cluster [DBG] pgmap v8794: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:30:21.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:30:21 smithi157 bash[24585]: audit 2024-09-16T10:30:20.156598+0000 mgr.a (mgr.14373) 12681 : audit [DBG] from='client.276441 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:30:21.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:30:21 smithi157 bash[24585]: cluster 2024-09-16T10:30:20.262957+0000 mgr.a (mgr.14373) 12682 : cluster [DBG] pgmap v8794: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:30:21.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:30:21 smithi086 bash[24289]: audit 2024-09-16T10:30:20.156598+0000 mgr.a (mgr.14373) 12681 : audit [DBG] from='client.276441 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:30:21.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:30:21 smithi086 bash[24289]: cluster 2024-09-16T10:30:20.262957+0000 mgr.a (mgr.14373) 12682 : cluster [DBG] pgmap v8794: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:30:23.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:30:23 smithi157 bash[24585]: cluster 2024-09-16T10:30:22.265213+0000 mgr.a (mgr.14373) 12683 : cluster [DBG] pgmap v8795: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:30:23.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:30:23 smithi086 bash[24289]: cluster 2024-09-16T10:30:22.265213+0000 mgr.a (mgr.14373) 12683 : cluster [DBG] pgmap v8795: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:30:23.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:30:23 smithi047 bash[22744]: cluster 2024-09-16T10:30:22.265213+0000 mgr.a (mgr.14373) 12683 : cluster [DBG] pgmap v8795: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:30:25.617 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:30:25.617 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:30:25.618 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:30:25.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:30:25 smithi157 bash[24585]: cluster 2024-09-16T10:30:24.265987+0000 mgr.a (mgr.14373) 12684 : cluster [DBG] pgmap v8796: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:30:25.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:30:25 smithi086 bash[24289]: cluster 2024-09-16T10:30:24.265987+0000 mgr.a (mgr.14373) 12684 : cluster [DBG] pgmap v8796: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:30:25.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:30:25 smithi047 bash[22744]: cluster 2024-09-16T10:30:24.265987+0000 mgr.a (mgr.14373) 12684 : cluster [DBG] pgmap v8796: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:30:26.389 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:30:26.389 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:30:26.389 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:30:26.389 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:30:26.389 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:30:27.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:30:27 smithi157 bash[24585]: audit 2024-09-16T10:30:25.947977+0000 mgr.a (mgr.14373) 12685 : audit [DBG] from='client.276510 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:30:27.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:30:27 smithi157 bash[24585]: cluster 2024-09-16T10:30:26.266480+0000 mgr.a (mgr.14373) 12686 : cluster [DBG] pgmap v8797: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:30:27.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:30:27 smithi086 bash[24289]: audit 2024-09-16T10:30:25.947977+0000 mgr.a (mgr.14373) 12685 : audit [DBG] from='client.276510 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:30:27.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:30:27 smithi086 bash[24289]: cluster 2024-09-16T10:30:26.266480+0000 mgr.a (mgr.14373) 12686 : cluster [DBG] pgmap v8797: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:30:27.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:30:27 smithi047 bash[22744]: audit 2024-09-16T10:30:25.947977+0000 mgr.a (mgr.14373) 12685 : audit [DBG] from='client.276510 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:30:27.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:30:27 smithi047 bash[22744]: cluster 2024-09-16T10:30:26.266480+0000 mgr.a (mgr.14373) 12686 : cluster [DBG] pgmap v8797: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:30:29.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:30:29 smithi157 bash[24585]: cluster 2024-09-16T10:30:28.268761+0000 mgr.a (mgr.14373) 12687 : cluster [DBG] pgmap v8798: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:30:29.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:30:29 smithi086 bash[24289]: cluster 2024-09-16T10:30:28.268761+0000 mgr.a (mgr.14373) 12687 : cluster [DBG] pgmap v8798: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:30:29.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:30:29 smithi047 bash[22744]: cluster 2024-09-16T10:30:28.268761+0000 mgr.a (mgr.14373) 12687 : cluster [DBG] pgmap v8798: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:30:31.390 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:30:31.391 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:30:31.391 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:30:31.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:30:31 smithi157 bash[24585]: cluster 2024-09-16T10:30:30.269525+0000 mgr.a (mgr.14373) 12688 : cluster [DBG] pgmap v8799: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:30:31.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:30:31 smithi086 bash[24289]: cluster 2024-09-16T10:30:30.269525+0000 mgr.a (mgr.14373) 12688 : cluster [DBG] pgmap v8799: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:30:31.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:30:31 smithi047 bash[22744]: cluster 2024-09-16T10:30:30.269525+0000 mgr.a (mgr.14373) 12688 : cluster [DBG] pgmap v8799: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:30:32.180 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:30:32.181 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:30:32.181 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:30:32.181 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:30:32.181 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:30:33.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:30:33 smithi157 bash[24585]: audit 2024-09-16T10:30:31.727440+0000 mgr.a (mgr.14373) 12689 : audit [DBG] from='client.276588 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:30:33.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:30:33 smithi157 bash[24585]: cluster 2024-09-16T10:30:32.270899+0000 mgr.a (mgr.14373) 12690 : cluster [DBG] pgmap v8800: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:30:33.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:30:33 smithi086 bash[24289]: audit 2024-09-16T10:30:31.727440+0000 mgr.a (mgr.14373) 12689 : audit [DBG] from='client.276588 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:30:33.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:30:33 smithi086 bash[24289]: cluster 2024-09-16T10:30:32.270899+0000 mgr.a (mgr.14373) 12690 : cluster [DBG] pgmap v8800: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:30:33.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:30:33 smithi047 bash[22744]: audit 2024-09-16T10:30:31.727440+0000 mgr.a (mgr.14373) 12689 : audit [DBG] from='client.276588 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:30:33.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:30:33 smithi047 bash[22744]: cluster 2024-09-16T10:30:32.270899+0000 mgr.a (mgr.14373) 12690 : cluster [DBG] pgmap v8800: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:30:35.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:30:35 smithi157 bash[24585]: cluster 2024-09-16T10:30:34.271615+0000 mgr.a (mgr.14373) 12691 : cluster [DBG] pgmap v8801: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T10:30:35.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:30:35 smithi086 bash[24289]: cluster 2024-09-16T10:30:34.271615+0000 mgr.a (mgr.14373) 12691 : cluster [DBG] pgmap v8801: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T10:30:35.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:30:35 smithi047 bash[22744]: cluster 2024-09-16T10:30:34.271615+0000 mgr.a (mgr.14373) 12691 : cluster [DBG] pgmap v8801: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T10:30:37.182 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:30:37.183 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:30:37.183 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:30:37.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:30:37 smithi157 bash[24585]: cluster 2024-09-16T10:30:36.272360+0000 mgr.a (mgr.14373) 12692 : cluster [DBG] pgmap v8802: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T10:30:37.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:30:37 smithi086 bash[24289]: cluster 2024-09-16T10:30:36.272360+0000 mgr.a (mgr.14373) 12692 : cluster [DBG] pgmap v8802: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T10:30:37.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:30:37 smithi047 bash[22744]: cluster 2024-09-16T10:30:36.272360+0000 mgr.a (mgr.14373) 12692 : cluster [DBG] pgmap v8802: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T10:30:37.937 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:30:37.937 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:30:37.937 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:30:37.937 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:30:37.937 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:30:39.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:30:39 smithi157 bash[24585]: audit 2024-09-16T10:30:37.504325+0000 mgr.a (mgr.14373) 12693 : audit [DBG] from='client.276666 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:30:39.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:30:39 smithi157 bash[24585]: cluster 2024-09-16T10:30:38.275262+0000 mgr.a (mgr.14373) 12694 : cluster [DBG] pgmap v8803: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:30:39.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:30:39 smithi086 bash[24289]: audit 2024-09-16T10:30:37.504325+0000 mgr.a (mgr.14373) 12693 : audit [DBG] from='client.276666 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:30:39.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:30:39 smithi086 bash[24289]: cluster 2024-09-16T10:30:38.275262+0000 mgr.a (mgr.14373) 12694 : cluster [DBG] pgmap v8803: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:30:39.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:30:39 smithi047 bash[22744]: audit 2024-09-16T10:30:37.504325+0000 mgr.a (mgr.14373) 12693 : audit [DBG] from='client.276666 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:30:39.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:30:39 smithi047 bash[22744]: cluster 2024-09-16T10:30:38.275262+0000 mgr.a (mgr.14373) 12694 : cluster [DBG] pgmap v8803: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:30:41.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:30:41 smithi157 bash[24585]: cluster 2024-09-16T10:30:40.276228+0000 mgr.a (mgr.14373) 12695 : cluster [DBG] pgmap v8804: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:30:41.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:30:41 smithi086 bash[24289]: cluster 2024-09-16T10:30:40.276228+0000 mgr.a (mgr.14373) 12695 : cluster [DBG] pgmap v8804: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:30:41.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:30:41 smithi047 bash[22744]: cluster 2024-09-16T10:30:40.276228+0000 mgr.a (mgr.14373) 12695 : cluster [DBG] pgmap v8804: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:30:42.938 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:30:42.939 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:30:42.939 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:30:43.693 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:30:43.694 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:30:43.694 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:30:43.694 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:30:43.694 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:30:43.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:30:43 smithi157 bash[24585]: cluster 2024-09-16T10:30:42.278328+0000 mgr.a (mgr.14373) 12696 : cluster [DBG] pgmap v8805: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:30:43.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:30:43 smithi086 bash[24289]: cluster 2024-09-16T10:30:42.278328+0000 mgr.a (mgr.14373) 12696 : cluster [DBG] pgmap v8805: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:30:43.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:30:43 smithi047 bash[22744]: cluster 2024-09-16T10:30:42.278328+0000 mgr.a (mgr.14373) 12696 : cluster [DBG] pgmap v8805: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:30:44.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:30:44 smithi157 bash[24585]: audit 2024-09-16T10:30:43.265023+0000 mgr.a (mgr.14373) 12697 : audit [DBG] from='client.276744 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:30:44.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:30:44 smithi086 bash[24289]: audit 2024-09-16T10:30:43.265023+0000 mgr.a (mgr.14373) 12697 : audit [DBG] from='client.276744 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:30:44.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:30:44 smithi047 bash[22744]: audit 2024-09-16T10:30:43.265023+0000 mgr.a (mgr.14373) 12697 : audit [DBG] from='client.276744 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:30:45.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:30:45 smithi157 bash[24585]: cluster 2024-09-16T10:30:44.279268+0000 mgr.a (mgr.14373) 12698 : cluster [DBG] pgmap v8806: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:30:45.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:30:45 smithi086 bash[24289]: cluster 2024-09-16T10:30:44.279268+0000 mgr.a (mgr.14373) 12698 : cluster [DBG] pgmap v8806: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:30:45.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:30:45 smithi047 bash[22744]: cluster 2024-09-16T10:30:44.279268+0000 mgr.a (mgr.14373) 12698 : cluster [DBG] pgmap v8806: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:30:47.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:30:47 smithi157 bash[24585]: cluster 2024-09-16T10:30:46.280037+0000 mgr.a (mgr.14373) 12699 : cluster [DBG] pgmap v8807: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:30:47.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:30:47 smithi086 bash[24289]: cluster 2024-09-16T10:30:46.280037+0000 mgr.a (mgr.14373) 12699 : cluster [DBG] pgmap v8807: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:30:47.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:30:47 smithi047 bash[22744]: cluster 2024-09-16T10:30:46.280037+0000 mgr.a (mgr.14373) 12699 : cluster [DBG] pgmap v8807: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:30:48.695 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:30:48.696 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:30:48.696 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:30:48.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:30:48 smithi157 bash[24585]: cluster 2024-09-16T10:30:48.282239+0000 mgr.a (mgr.14373) 12700 : cluster [DBG] pgmap v8808: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:30:48.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:30:48 smithi086 bash[24289]: cluster 2024-09-16T10:30:48.282239+0000 mgr.a (mgr.14373) 12700 : cluster [DBG] pgmap v8808: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:30:48.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:30:48 smithi047 bash[22744]: cluster 2024-09-16T10:30:48.282239+0000 mgr.a (mgr.14373) 12700 : cluster [DBG] pgmap v8808: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:30:49.453 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:30:49.454 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:30:49.454 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:30:49.454 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:30:49.454 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:30:49.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:30:49 smithi157 bash[24585]: audit 2024-09-16T10:30:49.026793+0000 mgr.a (mgr.14373) 12701 : audit [DBG] from='client.276819 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:30:49.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:30:49 smithi086 bash[24289]: audit 2024-09-16T10:30:49.026793+0000 mgr.a (mgr.14373) 12701 : audit [DBG] from='client.276819 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:30:49.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:30:49 smithi047 bash[22744]: audit 2024-09-16T10:30:49.026793+0000 mgr.a (mgr.14373) 12701 : audit [DBG] from='client.276819 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:30:50.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:30:50 smithi157 bash[24585]: cluster 2024-09-16T10:30:50.283272+0000 mgr.a (mgr.14373) 12702 : cluster [DBG] pgmap v8809: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:30:50.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:30:50 smithi086 bash[24289]: cluster 2024-09-16T10:30:50.283272+0000 mgr.a (mgr.14373) 12702 : cluster [DBG] pgmap v8809: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:30:50.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:30:50 smithi047 bash[22744]: cluster 2024-09-16T10:30:50.283272+0000 mgr.a (mgr.14373) 12702 : cluster [DBG] pgmap v8809: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:30:53.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:30:53 smithi157 bash[24585]: cluster 2024-09-16T10:30:52.285580+0000 mgr.a (mgr.14373) 12703 : cluster [DBG] pgmap v8810: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:30:53.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:30:53 smithi086 bash[24289]: cluster 2024-09-16T10:30:52.285580+0000 mgr.a (mgr.14373) 12703 : cluster [DBG] pgmap v8810: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:30:53.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:30:53 smithi047 bash[22744]: cluster 2024-09-16T10:30:52.285580+0000 mgr.a (mgr.14373) 12703 : cluster [DBG] pgmap v8810: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:30:54.454 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:30:54.455 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:30:54.455 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:30:55.194 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:30:55.194 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:30:55.194 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:30:55.194 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:30:55.194 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:30:55.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:30:55 smithi157 bash[24585]: cluster 2024-09-16T10:30:54.286563+0000 mgr.a (mgr.14373) 12704 : cluster [DBG] pgmap v8811: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:30:55.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:30:55 smithi086 bash[24289]: cluster 2024-09-16T10:30:54.286563+0000 mgr.a (mgr.14373) 12704 : cluster [DBG] pgmap v8811: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:30:55.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:30:55 smithi047 bash[22744]: cluster 2024-09-16T10:30:54.286563+0000 mgr.a (mgr.14373) 12704 : cluster [DBG] pgmap v8811: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:30:56.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:30:56 smithi157 bash[24585]: audit 2024-09-16T10:30:54.779753+0000 mgr.a (mgr.14373) 12705 : audit [DBG] from='client.276891 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:30:56.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:30:56 smithi086 bash[24289]: audit 2024-09-16T10:30:54.779753+0000 mgr.a (mgr.14373) 12705 : audit [DBG] from='client.276891 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:30:56.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:30:56 smithi047 bash[22744]: audit 2024-09-16T10:30:54.779753+0000 mgr.a (mgr.14373) 12705 : audit [DBG] from='client.276891 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:30:57.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:30:57 smithi157 bash[24585]: cluster 2024-09-16T10:30:56.287599+0000 mgr.a (mgr.14373) 12706 : cluster [DBG] pgmap v8812: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:30:57.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:30:57 smithi086 bash[24289]: cluster 2024-09-16T10:30:56.287599+0000 mgr.a (mgr.14373) 12706 : cluster [DBG] pgmap v8812: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:30:57.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:30:57 smithi047 bash[22744]: cluster 2024-09-16T10:30:56.287599+0000 mgr.a (mgr.14373) 12706 : cluster [DBG] pgmap v8812: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:30:59.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:30:59 smithi157 bash[24585]: cluster 2024-09-16T10:30:58.289986+0000 mgr.a (mgr.14373) 12707 : cluster [DBG] pgmap v8813: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:30:59.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:30:59 smithi086 bash[24289]: cluster 2024-09-16T10:30:58.289986+0000 mgr.a (mgr.14373) 12707 : cluster [DBG] pgmap v8813: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:30:59.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:30:59 smithi047 bash[22744]: cluster 2024-09-16T10:30:58.289986+0000 mgr.a (mgr.14373) 12707 : cluster [DBG] pgmap v8813: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:31:00.195 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:31:00.196 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:31:00.196 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:31:00.949 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:31:00.950 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:31:00.950 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:31:00.950 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:31:00.950 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:31:01.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:31:01 smithi157 bash[24585]: cluster 2024-09-16T10:31:00.290626+0000 mgr.a (mgr.14373) 12708 : cluster [DBG] pgmap v8814: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:31:01.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:31:01 smithi086 bash[24289]: cluster 2024-09-16T10:31:00.290626+0000 mgr.a (mgr.14373) 12708 : cluster [DBG] pgmap v8814: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:31:01.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:31:01 smithi047 bash[22744]: cluster 2024-09-16T10:31:00.290626+0000 mgr.a (mgr.14373) 12708 : cluster [DBG] pgmap v8814: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:31:02.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:31:02 smithi157 bash[24585]: audit 2024-09-16T10:31:00.524127+0000 mgr.a (mgr.14373) 12709 : audit [DBG] from='client.276969 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:31:02.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:31:02 smithi086 bash[24289]: audit 2024-09-16T10:31:00.524127+0000 mgr.a (mgr.14373) 12709 : audit [DBG] from='client.276969 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:31:02.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:31:02 smithi047 bash[22744]: audit 2024-09-16T10:31:00.524127+0000 mgr.a (mgr.14373) 12709 : audit [DBG] from='client.276969 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:31:03.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:31:03 smithi157 bash[24585]: cluster 2024-09-16T10:31:02.292825+0000 mgr.a (mgr.14373) 12710 : cluster [DBG] pgmap v8815: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:31:03.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:31:03 smithi086 bash[24289]: cluster 2024-09-16T10:31:02.292825+0000 mgr.a (mgr.14373) 12710 : cluster [DBG] pgmap v8815: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:31:03.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:31:03 smithi047 bash[22744]: cluster 2024-09-16T10:31:02.292825+0000 mgr.a (mgr.14373) 12710 : cluster [DBG] pgmap v8815: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:31:05.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:31:05 smithi157 bash[24585]: cluster 2024-09-16T10:31:04.293731+0000 mgr.a (mgr.14373) 12711 : cluster [DBG] pgmap v8816: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:31:05.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:31:05 smithi157 bash[24585]: audit 2024-09-16T10:31:04.832315+0000 mon.b (mon.2) 1166 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T10:31:05.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:31:05 smithi086 bash[24289]: cluster 2024-09-16T10:31:04.293731+0000 mgr.a (mgr.14373) 12711 : cluster [DBG] pgmap v8816: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:31:05.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:31:05 smithi086 bash[24289]: audit 2024-09-16T10:31:04.832315+0000 mon.b (mon.2) 1166 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T10:31:05.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:31:05 smithi047 bash[22744]: cluster 2024-09-16T10:31:04.293731+0000 mgr.a (mgr.14373) 12711 : cluster [DBG] pgmap v8816: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:31:05.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:31:05 smithi047 bash[22744]: audit 2024-09-16T10:31:04.832315+0000 mon.b (mon.2) 1166 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T10:31:05.951 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:31:05.951 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:31:05.951 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:31:06.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:31:06 smithi157 bash[24585]: audit 2024-09-16T10:31:05.658888+0000 mon.b (mon.2) 1167 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T10:31:06.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:31:06 smithi157 bash[24585]: audit 2024-09-16T10:31:05.660903+0000 mon.b (mon.2) 1168 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T10:31:06.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:31:06 smithi157 bash[24585]: audit 2024-09-16T10:31:05.672995+0000 mon.a (mon.0) 1325 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:31:06.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:31:06 smithi157 bash[24585]: audit 2024-09-16T10:31:05.680063+0000 mon.b (mon.2) 1169 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:31:06.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:31:06 smithi086 bash[24289]: audit 2024-09-16T10:31:05.658888+0000 mon.b (mon.2) 1167 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T10:31:06.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:31:06 smithi086 bash[24289]: audit 2024-09-16T10:31:05.660903+0000 mon.b (mon.2) 1168 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T10:31:06.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:31:06 smithi086 bash[24289]: audit 2024-09-16T10:31:05.672995+0000 mon.a (mon.0) 1325 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:31:06.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:31:06 smithi086 bash[24289]: audit 2024-09-16T10:31:05.680063+0000 mon.b (mon.2) 1169 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:31:06.836 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:31:06.836 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:31:06.836 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:31:06.836 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:31:06.837 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:31:06.842 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 10:31:06 smithi047 bash[22994]: debug 2024-09-16T10:31:06.421+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T10:31:06.842 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 10:31:06 smithi047 bash[22994]: debug 2024-09-16T10:31:06.433+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T10:31:06.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:31:06 smithi047 bash[22744]: audit 2024-09-16T10:31:05.658888+0000 mon.b (mon.2) 1167 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T10:31:06.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:31:06 smithi047 bash[22744]: audit 2024-09-16T10:31:05.660903+0000 mon.b (mon.2) 1168 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T10:31:06.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:31:06 smithi047 bash[22744]: audit 2024-09-16T10:31:05.672995+0000 mon.a (mon.0) 1325 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:31:06.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:31:06 smithi047 bash[22744]: audit 2024-09-16T10:31:05.680063+0000 mon.b (mon.2) 1169 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:31:07.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:31:07 smithi157 bash[24585]: audit 2024-09-16T10:31:05.681525+0000 mgr.a (mgr.14373) 12712 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:31:07.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:31:07 smithi157 bash[24585]: audit 2024-09-16T10:31:06.289148+0000 mgr.a (mgr.14373) 12713 : audit [DBG] from='client.277101 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:31:07.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:31:07 smithi157 bash[24585]: cluster 2024-09-16T10:31:06.294208+0000 mgr.a (mgr.14373) 12714 : cluster [DBG] pgmap v8817: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:31:07.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:31:07 smithi086 bash[24289]: audit 2024-09-16T10:31:05.681525+0000 mgr.a (mgr.14373) 12712 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:31:07.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:31:07 smithi086 bash[24289]: audit 2024-09-16T10:31:06.289148+0000 mgr.a (mgr.14373) 12713 : audit [DBG] from='client.277101 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:31:07.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:31:07 smithi086 bash[24289]: cluster 2024-09-16T10:31:06.294208+0000 mgr.a (mgr.14373) 12714 : cluster [DBG] pgmap v8817: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:31:07.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:31:07 smithi047 bash[22744]: audit 2024-09-16T10:31:05.681525+0000 mgr.a (mgr.14373) 12712 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:31:07.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:31:07 smithi047 bash[22744]: audit 2024-09-16T10:31:06.289148+0000 mgr.a (mgr.14373) 12713 : audit [DBG] from='client.277101 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:31:07.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:31:07 smithi047 bash[22744]: cluster 2024-09-16T10:31:06.294208+0000 mgr.a (mgr.14373) 12714 : cluster [DBG] pgmap v8817: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:31:08.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:31:08 smithi157 bash[24585]: audit 2024-09-16T10:31:06.426180+0000 mgr.a (mgr.14373) 12715 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T10:31:08.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:31:08 smithi157 bash[24585]: cephadm 2024-09-16T10:31:06.437371+0000 mgr.a (mgr.14373) 12716 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T10:31:08.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:31:08 smithi086 bash[24289]: audit 2024-09-16T10:31:06.426180+0000 mgr.a (mgr.14373) 12715 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T10:31:08.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:31:08 smithi086 bash[24289]: cephadm 2024-09-16T10:31:06.437371+0000 mgr.a (mgr.14373) 12716 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T10:31:08.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:31:08 smithi047 bash[22744]: audit 2024-09-16T10:31:06.426180+0000 mgr.a (mgr.14373) 12715 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T10:31:08.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:31:08 smithi047 bash[22744]: cephadm 2024-09-16T10:31:06.437371+0000 mgr.a (mgr.14373) 12716 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T10:31:09.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:31:09 smithi157 bash[24585]: cluster 2024-09-16T10:31:08.296822+0000 mgr.a (mgr.14373) 12717 : cluster [DBG] pgmap v8818: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:31:09.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:31:09 smithi086 bash[24289]: cluster 2024-09-16T10:31:08.296822+0000 mgr.a (mgr.14373) 12717 : cluster [DBG] pgmap v8818: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:31:09.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:31:09 smithi047 bash[22744]: cluster 2024-09-16T10:31:08.296822+0000 mgr.a (mgr.14373) 12717 : cluster [DBG] pgmap v8818: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:31:11.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:31:11 smithi157 bash[24585]: cluster 2024-09-16T10:31:10.297574+0000 mgr.a (mgr.14373) 12718 : cluster [DBG] pgmap v8819: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T10:31:11.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:31:11 smithi086 bash[24289]: cluster 2024-09-16T10:31:10.297574+0000 mgr.a (mgr.14373) 12718 : cluster [DBG] pgmap v8819: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T10:31:11.837 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:31:11.838 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:31:11.838 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:31:11.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:31:11 smithi047 bash[22744]: cluster 2024-09-16T10:31:10.297574+0000 mgr.a (mgr.14373) 12718 : cluster [DBG] pgmap v8819: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T10:31:12.625 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:31:12.625 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:31:12.625 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:31:12.625 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:31:12.625 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:31:13.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:31:13 smithi157 bash[24585]: audit 2024-09-16T10:31:12.172744+0000 mgr.a (mgr.14373) 12719 : audit [DBG] from='client.277230 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:31:13.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:31:13 smithi157 bash[24585]: cluster 2024-09-16T10:31:12.299144+0000 mgr.a (mgr.14373) 12720 : cluster [DBG] pgmap v8820: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:31:13.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:31:13 smithi086 bash[24289]: audit 2024-09-16T10:31:12.172744+0000 mgr.a (mgr.14373) 12719 : audit [DBG] from='client.277230 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:31:13.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:31:13 smithi086 bash[24289]: cluster 2024-09-16T10:31:12.299144+0000 mgr.a (mgr.14373) 12720 : cluster [DBG] pgmap v8820: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:31:13.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:31:13 smithi047 bash[22744]: audit 2024-09-16T10:31:12.172744+0000 mgr.a (mgr.14373) 12719 : audit [DBG] from='client.277230 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:31:13.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:31:13 smithi047 bash[22744]: cluster 2024-09-16T10:31:12.299144+0000 mgr.a (mgr.14373) 12720 : cluster [DBG] pgmap v8820: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:31:15.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:31:15 smithi157 bash[24585]: cluster 2024-09-16T10:31:14.300031+0000 mgr.a (mgr.14373) 12721 : cluster [DBG] pgmap v8821: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T10:31:15.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:31:15 smithi086 bash[24289]: cluster 2024-09-16T10:31:14.300031+0000 mgr.a (mgr.14373) 12721 : cluster [DBG] pgmap v8821: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T10:31:15.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:31:15 smithi047 bash[22744]: cluster 2024-09-16T10:31:14.300031+0000 mgr.a (mgr.14373) 12721 : cluster [DBG] pgmap v8821: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T10:31:17.626 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:31:17.627 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:31:17.627 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:31:17.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:31:17 smithi157 bash[24585]: cluster 2024-09-16T10:31:16.300801+0000 mgr.a (mgr.14373) 12722 : cluster [DBG] pgmap v8822: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T10:31:17.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:31:17 smithi086 bash[24289]: cluster 2024-09-16T10:31:16.300801+0000 mgr.a (mgr.14373) 12722 : cluster [DBG] pgmap v8822: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T10:31:17.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:31:17 smithi047 bash[22744]: cluster 2024-09-16T10:31:16.300801+0000 mgr.a (mgr.14373) 12722 : cluster [DBG] pgmap v8822: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T10:31:18.403 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:31:18.404 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:31:18.404 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:31:18.404 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:31:18.404 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:31:19.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:31:19 smithi157 bash[24585]: audit 2024-09-16T10:31:17.962264+0000 mgr.a (mgr.14373) 12723 : audit [DBG] from='client.277299 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:31:19.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:31:19 smithi157 bash[24585]: cluster 2024-09-16T10:31:18.302915+0000 mgr.a (mgr.14373) 12724 : cluster [DBG] pgmap v8823: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:31:19.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:31:19 smithi086 bash[24289]: audit 2024-09-16T10:31:17.962264+0000 mgr.a (mgr.14373) 12723 : audit [DBG] from='client.277299 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:31:19.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:31:19 smithi086 bash[24289]: cluster 2024-09-16T10:31:18.302915+0000 mgr.a (mgr.14373) 12724 : cluster [DBG] pgmap v8823: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:31:19.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:31:19 smithi047 bash[22744]: audit 2024-09-16T10:31:17.962264+0000 mgr.a (mgr.14373) 12723 : audit [DBG] from='client.277299 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:31:19.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:31:19 smithi047 bash[22744]: cluster 2024-09-16T10:31:18.302915+0000 mgr.a (mgr.14373) 12724 : cluster [DBG] pgmap v8823: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:31:20.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:31:20 smithi157 bash[24585]: cluster 2024-09-16T10:31:20.303656+0000 mgr.a (mgr.14373) 12725 : cluster [DBG] pgmap v8824: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:31:20.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:31:20 smithi086 bash[24289]: cluster 2024-09-16T10:31:20.303656+0000 mgr.a (mgr.14373) 12725 : cluster [DBG] pgmap v8824: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:31:20.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:31:20 smithi047 bash[22744]: cluster 2024-09-16T10:31:20.303656+0000 mgr.a (mgr.14373) 12725 : cluster [DBG] pgmap v8824: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:31:23.405 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:31:23.406 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:31:23.406 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:31:23.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:31:23 smithi157 bash[24585]: cluster 2024-09-16T10:31:22.305601+0000 mgr.a (mgr.14373) 12726 : cluster [DBG] pgmap v8825: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:31:23.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:31:23 smithi086 bash[24289]: cluster 2024-09-16T10:31:22.305601+0000 mgr.a (mgr.14373) 12726 : cluster [DBG] pgmap v8825: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:31:23.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:31:23 smithi047 bash[22744]: cluster 2024-09-16T10:31:22.305601+0000 mgr.a (mgr.14373) 12726 : cluster [DBG] pgmap v8825: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:31:24.155 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:31:24.156 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:31:24.156 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:31:24.156 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:31:24.156 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:31:25.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:31:25 smithi157 bash[24585]: audit 2024-09-16T10:31:23.732959+0000 mgr.a (mgr.14373) 12727 : audit [DBG] from='client.277377 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:31:25.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:31:25 smithi157 bash[24585]: cluster 2024-09-16T10:31:24.306448+0000 mgr.a (mgr.14373) 12728 : cluster [DBG] pgmap v8826: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:31:25.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:31:25 smithi086 bash[24289]: audit 2024-09-16T10:31:23.732959+0000 mgr.a (mgr.14373) 12727 : audit [DBG] from='client.277377 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:31:25.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:31:25 smithi086 bash[24289]: cluster 2024-09-16T10:31:24.306448+0000 mgr.a (mgr.14373) 12728 : cluster [DBG] pgmap v8826: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:31:25.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:31:25 smithi047 bash[22744]: audit 2024-09-16T10:31:23.732959+0000 mgr.a (mgr.14373) 12727 : audit [DBG] from='client.277377 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:31:25.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:31:25 smithi047 bash[22744]: cluster 2024-09-16T10:31:24.306448+0000 mgr.a (mgr.14373) 12728 : cluster [DBG] pgmap v8826: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:31:27.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:31:27 smithi157 bash[24585]: cluster 2024-09-16T10:31:26.307160+0000 mgr.a (mgr.14373) 12729 : cluster [DBG] pgmap v8827: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:31:27.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:31:27 smithi086 bash[24289]: cluster 2024-09-16T10:31:26.307160+0000 mgr.a (mgr.14373) 12729 : cluster [DBG] pgmap v8827: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:31:27.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:31:27 smithi047 bash[22744]: cluster 2024-09-16T10:31:26.307160+0000 mgr.a (mgr.14373) 12729 : cluster [DBG] pgmap v8827: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:31:29.157 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:31:29.158 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:31:29.158 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:31:29.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:31:29 smithi157 bash[24585]: cluster 2024-09-16T10:31:28.309552+0000 mgr.a (mgr.14373) 12730 : cluster [DBG] pgmap v8828: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:31:29.822 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:31:29 smithi086 bash[24289]: cluster 2024-09-16T10:31:28.309552+0000 mgr.a (mgr.14373) 12730 : cluster [DBG] pgmap v8828: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:31:29.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:31:29 smithi047 bash[22744]: cluster 2024-09-16T10:31:28.309552+0000 mgr.a (mgr.14373) 12730 : cluster [DBG] pgmap v8828: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:31:29.931 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:31:29.931 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:31:29.931 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:31:29.931 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:31:29.931 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:31:31.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:31:31 smithi157 bash[24585]: audit 2024-09-16T10:31:29.491493+0000 mgr.a (mgr.14373) 12731 : audit [DBG] from='client.277452 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:31:31.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:31:31 smithi157 bash[24585]: cluster 2024-09-16T10:31:30.310446+0000 mgr.a (mgr.14373) 12732 : cluster [DBG] pgmap v8829: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:31:31.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:31:31 smithi086 bash[24289]: audit 2024-09-16T10:31:29.491493+0000 mgr.a (mgr.14373) 12731 : audit [DBG] from='client.277452 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:31:31.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:31:31 smithi086 bash[24289]: cluster 2024-09-16T10:31:30.310446+0000 mgr.a (mgr.14373) 12732 : cluster [DBG] pgmap v8829: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:31:31.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:31:31 smithi047 bash[22744]: audit 2024-09-16T10:31:29.491493+0000 mgr.a (mgr.14373) 12731 : audit [DBG] from='client.277452 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:31:31.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:31:31 smithi047 bash[22744]: cluster 2024-09-16T10:31:30.310446+0000 mgr.a (mgr.14373) 12732 : cluster [DBG] pgmap v8829: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:31:33.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:31:33 smithi157 bash[24585]: cluster 2024-09-16T10:31:32.312630+0000 mgr.a (mgr.14373) 12733 : cluster [DBG] pgmap v8830: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:31:33.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:31:33 smithi086 bash[24289]: cluster 2024-09-16T10:31:32.312630+0000 mgr.a (mgr.14373) 12733 : cluster [DBG] pgmap v8830: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:31:33.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:31:33 smithi047 bash[22744]: cluster 2024-09-16T10:31:32.312630+0000 mgr.a (mgr.14373) 12733 : cluster [DBG] pgmap v8830: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:31:34.932 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:31:34.933 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:31:34.933 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:31:35.706 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:31:35.707 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:31:35.707 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:31:35.707 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:31:35.707 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:31:35.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:31:35 smithi157 bash[24585]: cluster 2024-09-16T10:31:34.313422+0000 mgr.a (mgr.14373) 12734 : cluster [DBG] pgmap v8831: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:31:35.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:31:35 smithi086 bash[24289]: cluster 2024-09-16T10:31:34.313422+0000 mgr.a (mgr.14373) 12734 : cluster [DBG] pgmap v8831: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:31:35.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:31:35 smithi047 bash[22744]: cluster 2024-09-16T10:31:34.313422+0000 mgr.a (mgr.14373) 12734 : cluster [DBG] pgmap v8831: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:31:36.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:31:36 smithi157 bash[24585]: audit 2024-09-16T10:31:35.267683+0000 mgr.a (mgr.14373) 12735 : audit [DBG] from='client.277530 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:31:36.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:31:36 smithi086 bash[24289]: audit 2024-09-16T10:31:35.267683+0000 mgr.a (mgr.14373) 12735 : audit [DBG] from='client.277530 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:31:36.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:31:36 smithi047 bash[22744]: audit 2024-09-16T10:31:35.267683+0000 mgr.a (mgr.14373) 12735 : audit [DBG] from='client.277530 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:31:37.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:31:37 smithi157 bash[24585]: cluster 2024-09-16T10:31:36.314407+0000 mgr.a (mgr.14373) 12736 : cluster [DBG] pgmap v8832: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:31:37.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:31:37 smithi086 bash[24289]: cluster 2024-09-16T10:31:36.314407+0000 mgr.a (mgr.14373) 12736 : cluster [DBG] pgmap v8832: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:31:37.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:31:37 smithi047 bash[22744]: cluster 2024-09-16T10:31:36.314407+0000 mgr.a (mgr.14373) 12736 : cluster [DBG] pgmap v8832: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:31:39.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:31:39 smithi157 bash[24585]: cluster 2024-09-16T10:31:38.316598+0000 mgr.a (mgr.14373) 12737 : cluster [DBG] pgmap v8833: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:31:39.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:31:39 smithi086 bash[24289]: cluster 2024-09-16T10:31:38.316598+0000 mgr.a (mgr.14373) 12737 : cluster [DBG] pgmap v8833: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:31:39.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:31:39 smithi047 bash[22744]: cluster 2024-09-16T10:31:38.316598+0000 mgr.a (mgr.14373) 12737 : cluster [DBG] pgmap v8833: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:31:40.708 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:31:40.709 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:31:40.709 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:31:41.481 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:31:41.482 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:31:41.482 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:31:41.482 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:31:41.482 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:31:41.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:31:41 smithi157 bash[24585]: cluster 2024-09-16T10:31:40.317382+0000 mgr.a (mgr.14373) 12738 : cluster [DBG] pgmap v8834: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:31:41.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:31:41 smithi086 bash[24289]: cluster 2024-09-16T10:31:40.317382+0000 mgr.a (mgr.14373) 12738 : cluster [DBG] pgmap v8834: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:31:41.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:31:41 smithi047 bash[22744]: cluster 2024-09-16T10:31:40.317382+0000 mgr.a (mgr.14373) 12738 : cluster [DBG] pgmap v8834: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:31:42.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:31:42 smithi157 bash[24585]: audit 2024-09-16T10:31:41.044126+0000 mgr.a (mgr.14373) 12739 : audit [DBG] from='client.277602 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:31:42.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:31:42 smithi086 bash[24289]: audit 2024-09-16T10:31:41.044126+0000 mgr.a (mgr.14373) 12739 : audit [DBG] from='client.277602 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:31:42.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:31:42 smithi047 bash[22744]: audit 2024-09-16T10:31:41.044126+0000 mgr.a (mgr.14373) 12739 : audit [DBG] from='client.277602 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:31:43.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:31:43 smithi157 bash[24585]: cluster 2024-09-16T10:31:42.319819+0000 mgr.a (mgr.14373) 12740 : cluster [DBG] pgmap v8835: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:31:43.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:31:43 smithi086 bash[24289]: cluster 2024-09-16T10:31:42.319819+0000 mgr.a (mgr.14373) 12740 : cluster [DBG] pgmap v8835: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:31:43.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:31:43 smithi047 bash[22744]: cluster 2024-09-16T10:31:42.319819+0000 mgr.a (mgr.14373) 12740 : cluster [DBG] pgmap v8835: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:31:44.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:31:44 smithi157 bash[24585]: cluster 2024-09-16T10:31:44.320619+0000 mgr.a (mgr.14373) 12741 : cluster [DBG] pgmap v8836: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:31:44.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:31:44 smithi086 bash[24289]: cluster 2024-09-16T10:31:44.320619+0000 mgr.a (mgr.14373) 12741 : cluster [DBG] pgmap v8836: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:31:44.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:31:44 smithi047 bash[22744]: cluster 2024-09-16T10:31:44.320619+0000 mgr.a (mgr.14373) 12741 : cluster [DBG] pgmap v8836: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:31:46.483 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:31:46.484 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:31:46.484 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:31:47.275 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:31:47.275 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:31:47.275 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:31:47.275 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:31:47.275 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:31:47.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:31:47 smithi157 bash[24585]: cluster 2024-09-16T10:31:46.321414+0000 mgr.a (mgr.14373) 12742 : cluster [DBG] pgmap v8837: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:31:47.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:31:47 smithi086 bash[24289]: cluster 2024-09-16T10:31:46.321414+0000 mgr.a (mgr.14373) 12742 : cluster [DBG] pgmap v8837: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:31:47.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:31:47 smithi047 bash[22744]: cluster 2024-09-16T10:31:46.321414+0000 mgr.a (mgr.14373) 12742 : cluster [DBG] pgmap v8837: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:31:48.809 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:31:48 smithi157 bash[24585]: audit 2024-09-16T10:31:46.821804+0000 mgr.a (mgr.14373) 12743 : audit [DBG] from='client.277680 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:31:48.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:31:48 smithi086 bash[24289]: audit 2024-09-16T10:31:46.821804+0000 mgr.a (mgr.14373) 12743 : audit [DBG] from='client.277680 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:31:48.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:31:48 smithi047 bash[22744]: audit 2024-09-16T10:31:46.821804+0000 mgr.a (mgr.14373) 12743 : audit [DBG] from='client.277680 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:31:49.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:31:49 smithi157 bash[24585]: cluster 2024-09-16T10:31:48.324362+0000 mgr.a (mgr.14373) 12744 : cluster [DBG] pgmap v8838: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:31:49.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:31:49 smithi086 bash[24289]: cluster 2024-09-16T10:31:48.324362+0000 mgr.a (mgr.14373) 12744 : cluster [DBG] pgmap v8838: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:31:49.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:31:49 smithi047 bash[22744]: cluster 2024-09-16T10:31:48.324362+0000 mgr.a (mgr.14373) 12744 : cluster [DBG] pgmap v8838: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:31:51.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:31:51 smithi157 bash[24585]: cluster 2024-09-16T10:31:50.325299+0000 mgr.a (mgr.14373) 12745 : cluster [DBG] pgmap v8839: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:31:51.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:31:51 smithi086 bash[24289]: cluster 2024-09-16T10:31:50.325299+0000 mgr.a (mgr.14373) 12745 : cluster [DBG] pgmap v8839: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:31:51.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:31:51 smithi047 bash[22744]: cluster 2024-09-16T10:31:50.325299+0000 mgr.a (mgr.14373) 12745 : cluster [DBG] pgmap v8839: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:31:52.277 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:31:52.277 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:31:52.278 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:31:53.040 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:31:53.040 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:31:53.040 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:31:53.040 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:31:53.040 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:31:53.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:31:53 smithi157 bash[24585]: cluster 2024-09-16T10:31:52.326714+0000 mgr.a (mgr.14373) 12746 : cluster [DBG] pgmap v8840: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:31:53.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:31:53 smithi086 bash[24289]: cluster 2024-09-16T10:31:52.326714+0000 mgr.a (mgr.14373) 12746 : cluster [DBG] pgmap v8840: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:31:53.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:31:53 smithi047 bash[22744]: cluster 2024-09-16T10:31:52.326714+0000 mgr.a (mgr.14373) 12746 : cluster [DBG] pgmap v8840: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:31:54.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:31:54 smithi157 bash[24585]: audit 2024-09-16T10:31:52.607885+0000 mgr.a (mgr.14373) 12747 : audit [DBG] from='client.277758 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:31:54.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:31:54 smithi086 bash[24289]: audit 2024-09-16T10:31:52.607885+0000 mgr.a (mgr.14373) 12747 : audit [DBG] from='client.277758 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:31:54.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:31:54 smithi047 bash[22744]: audit 2024-09-16T10:31:52.607885+0000 mgr.a (mgr.14373) 12747 : audit [DBG] from='client.277758 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:31:55.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:31:55 smithi157 bash[24585]: cluster 2024-09-16T10:31:54.327669+0000 mgr.a (mgr.14373) 12748 : cluster [DBG] pgmap v8841: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:31:55.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:31:55 smithi086 bash[24289]: cluster 2024-09-16T10:31:54.327669+0000 mgr.a (mgr.14373) 12748 : cluster [DBG] pgmap v8841: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:31:55.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:31:55 smithi047 bash[22744]: cluster 2024-09-16T10:31:54.327669+0000 mgr.a (mgr.14373) 12748 : cluster [DBG] pgmap v8841: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:31:57.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:31:57 smithi157 bash[24585]: cluster 2024-09-16T10:31:56.328576+0000 mgr.a (mgr.14373) 12749 : cluster [DBG] pgmap v8842: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T10:31:57.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:31:57 smithi086 bash[24289]: cluster 2024-09-16T10:31:56.328576+0000 mgr.a (mgr.14373) 12749 : cluster [DBG] pgmap v8842: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T10:31:57.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:31:57 smithi047 bash[22744]: cluster 2024-09-16T10:31:56.328576+0000 mgr.a (mgr.14373) 12749 : cluster [DBG] pgmap v8842: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T10:31:58.042 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:31:58.042 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:31:58.042 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:31:58.790 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:31:58.791 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:31:58.791 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:31:58.791 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:31:58.791 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:31:59.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:31:59 smithi157 bash[24585]: cluster 2024-09-16T10:31:58.330725+0000 mgr.a (mgr.14373) 12750 : cluster [DBG] pgmap v8843: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:31:59.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:31:59 smithi157 bash[24585]: audit 2024-09-16T10:31:58.366667+0000 mgr.a (mgr.14373) 12751 : audit [DBG] from='client.277830 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:31:59.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:31:59 smithi086 bash[24289]: cluster 2024-09-16T10:31:58.330725+0000 mgr.a (mgr.14373) 12750 : cluster [DBG] pgmap v8843: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:31:59.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:31:59 smithi086 bash[24289]: audit 2024-09-16T10:31:58.366667+0000 mgr.a (mgr.14373) 12751 : audit [DBG] from='client.277830 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:31:59.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:31:59 smithi047 bash[22744]: cluster 2024-09-16T10:31:58.330725+0000 mgr.a (mgr.14373) 12750 : cluster [DBG] pgmap v8843: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:31:59.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:31:59 smithi047 bash[22744]: audit 2024-09-16T10:31:58.366667+0000 mgr.a (mgr.14373) 12751 : audit [DBG] from='client.277830 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:32:00.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:32:00 smithi157 bash[24585]: cluster 2024-09-16T10:32:00.331657+0000 mgr.a (mgr.14373) 12752 : cluster [DBG] pgmap v8844: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:32:00.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:32:00 smithi086 bash[24289]: cluster 2024-09-16T10:32:00.331657+0000 mgr.a (mgr.14373) 12752 : cluster [DBG] pgmap v8844: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:32:00.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:32:00 smithi047 bash[22744]: cluster 2024-09-16T10:32:00.331657+0000 mgr.a (mgr.14373) 12752 : cluster [DBG] pgmap v8844: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:32:03.792 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:32:03.792 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:32:03.792 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:32:03.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:32:03 smithi157 bash[24585]: cluster 2024-09-16T10:32:02.333812+0000 mgr.a (mgr.14373) 12753 : cluster [DBG] pgmap v8845: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:32:03.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:32:03 smithi086 bash[24289]: cluster 2024-09-16T10:32:02.333812+0000 mgr.a (mgr.14373) 12753 : cluster [DBG] pgmap v8845: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:32:03.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:32:03 smithi047 bash[22744]: cluster 2024-09-16T10:32:02.333812+0000 mgr.a (mgr.14373) 12753 : cluster [DBG] pgmap v8845: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:32:04.577 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:32:04.578 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:32:04.578 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:32:04.578 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:32:04.578 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:32:05.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:32:05 smithi157 bash[24585]: audit 2024-09-16T10:32:04.128609+0000 mgr.a (mgr.14373) 12754 : audit [DBG] from='client.277908 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:32:05.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:32:05 smithi157 bash[24585]: cluster 2024-09-16T10:32:04.334455+0000 mgr.a (mgr.14373) 12755 : cluster [DBG] pgmap v8846: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:32:05.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:32:05 smithi086 bash[24289]: audit 2024-09-16T10:32:04.128609+0000 mgr.a (mgr.14373) 12754 : audit [DBG] from='client.277908 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:32:05.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:32:05 smithi086 bash[24289]: cluster 2024-09-16T10:32:04.334455+0000 mgr.a (mgr.14373) 12755 : cluster [DBG] pgmap v8846: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:32:05.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:32:05 smithi047 bash[22744]: audit 2024-09-16T10:32:04.128609+0000 mgr.a (mgr.14373) 12754 : audit [DBG] from='client.277908 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:32:05.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:32:05 smithi047 bash[22744]: cluster 2024-09-16T10:32:04.334455+0000 mgr.a (mgr.14373) 12755 : cluster [DBG] pgmap v8846: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:32:07.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:32:07 smithi157 bash[24585]: cluster 2024-09-16T10:32:06.335447+0000 mgr.a (mgr.14373) 12756 : cluster [DBG] pgmap v8847: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:32:07.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:32:07 smithi157 bash[24585]: audit 2024-09-16T10:32:06.493188+0000 mon.b (mon.2) 1170 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T10:32:07.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:32:07 smithi157 bash[24585]: audit 2024-09-16T10:32:07.322355+0000 mon.b (mon.2) 1171 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T10:32:07.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:32:07 smithi157 bash[24585]: audit 2024-09-16T10:32:07.324393+0000 mon.b (mon.2) 1172 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T10:32:07.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:32:07 smithi157 bash[24585]: audit 2024-09-16T10:32:07.336103+0000 mon.a (mon.0) 1326 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:32:07.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:32:07 smithi157 bash[24585]: audit 2024-09-16T10:32:07.341129+0000 mon.b (mon.2) 1173 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:32:07.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:32:07 smithi086 bash[24289]: cluster 2024-09-16T10:32:06.335447+0000 mgr.a (mgr.14373) 12756 : cluster [DBG] pgmap v8847: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:32:07.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:32:07 smithi086 bash[24289]: audit 2024-09-16T10:32:06.493188+0000 mon.b (mon.2) 1170 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T10:32:07.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:32:07 smithi086 bash[24289]: audit 2024-09-16T10:32:07.322355+0000 mon.b (mon.2) 1171 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T10:32:07.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:32:07 smithi086 bash[24289]: audit 2024-09-16T10:32:07.324393+0000 mon.b (mon.2) 1172 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T10:32:07.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:32:07 smithi086 bash[24289]: audit 2024-09-16T10:32:07.336103+0000 mon.a (mon.0) 1326 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:32:07.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:32:07 smithi086 bash[24289]: audit 2024-09-16T10:32:07.341129+0000 mon.b (mon.2) 1173 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:32:07.844 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:32:07 smithi047 bash[22744]: cluster 2024-09-16T10:32:06.335447+0000 mgr.a (mgr.14373) 12756 : cluster [DBG] pgmap v8847: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:32:07.844 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:32:07 smithi047 bash[22744]: audit 2024-09-16T10:32:06.493188+0000 mon.b (mon.2) 1170 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T10:32:07.844 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:32:07 smithi047 bash[22744]: audit 2024-09-16T10:32:07.322355+0000 mon.b (mon.2) 1171 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T10:32:07.844 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:32:07 smithi047 bash[22744]: audit 2024-09-16T10:32:07.324393+0000 mon.b (mon.2) 1172 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T10:32:07.844 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:32:07 smithi047 bash[22744]: audit 2024-09-16T10:32:07.336103+0000 mon.a (mon.0) 1326 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:32:07.845 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:32:07 smithi047 bash[22744]: audit 2024-09-16T10:32:07.341129+0000 mon.b (mon.2) 1173 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:32:08.409 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 10:32:08 smithi047 bash[22994]: debug 2024-09-16T10:32:08.108+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T10:32:08.409 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 10:32:08 smithi047 bash[22994]: debug 2024-09-16T10:32:08.108+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T10:32:08.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:32:08 smithi157 bash[24585]: audit 2024-09-16T10:32:07.343729+0000 mgr.a (mgr.14373) 12757 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:32:08.828 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:32:08 smithi086 bash[24289]: audit 2024-09-16T10:32:07.343729+0000 mgr.a (mgr.14373) 12757 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:32:08.852 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:32:08 smithi047 bash[22744]: audit 2024-09-16T10:32:07.343729+0000 mgr.a (mgr.14373) 12757 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:32:09.579 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:32:09.580 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:32:09.580 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:32:09.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:32:09 smithi157 bash[24585]: audit 2024-09-16T10:32:08.111116+0000 mgr.a (mgr.14373) 12758 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T10:32:09.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:32:09 smithi157 bash[24585]: cephadm 2024-09-16T10:32:08.113239+0000 mgr.a (mgr.14373) 12759 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T10:32:09.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:32:09 smithi157 bash[24585]: cluster 2024-09-16T10:32:08.338273+0000 mgr.a (mgr.14373) 12760 : cluster [DBG] pgmap v8848: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:32:09.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:32:09 smithi086 bash[24289]: audit 2024-09-16T10:32:08.111116+0000 mgr.a (mgr.14373) 12758 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T10:32:09.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:32:09 smithi086 bash[24289]: cephadm 2024-09-16T10:32:08.113239+0000 mgr.a (mgr.14373) 12759 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T10:32:09.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:32:09 smithi086 bash[24289]: cluster 2024-09-16T10:32:08.338273+0000 mgr.a (mgr.14373) 12760 : cluster [DBG] pgmap v8848: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:32:09.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:32:09 smithi047 bash[22744]: audit 2024-09-16T10:32:08.111116+0000 mgr.a (mgr.14373) 12758 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T10:32:09.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:32:09 smithi047 bash[22744]: cephadm 2024-09-16T10:32:08.113239+0000 mgr.a (mgr.14373) 12759 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T10:32:09.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:32:09 smithi047 bash[22744]: cluster 2024-09-16T10:32:08.338273+0000 mgr.a (mgr.14373) 12760 : cluster [DBG] pgmap v8848: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:32:10.337 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:32:10.337 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:32:10.337 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:32:10.337 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:32:10.338 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:32:11.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:32:11 smithi157 bash[24585]: audit 2024-09-16T10:32:09.913238+0000 mgr.a (mgr.14373) 12761 : audit [DBG] from='client.278091 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:32:11.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:32:11 smithi157 bash[24585]: cluster 2024-09-16T10:32:10.338795+0000 mgr.a (mgr.14373) 12762 : cluster [DBG] pgmap v8849: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:32:11.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:32:11 smithi086 bash[24289]: audit 2024-09-16T10:32:09.913238+0000 mgr.a (mgr.14373) 12761 : audit [DBG] from='client.278091 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:32:11.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:32:11 smithi086 bash[24289]: cluster 2024-09-16T10:32:10.338795+0000 mgr.a (mgr.14373) 12762 : cluster [DBG] pgmap v8849: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:32:11.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:32:11 smithi047 bash[22744]: audit 2024-09-16T10:32:09.913238+0000 mgr.a (mgr.14373) 12761 : audit [DBG] from='client.278091 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:32:11.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:32:11 smithi047 bash[22744]: cluster 2024-09-16T10:32:10.338795+0000 mgr.a (mgr.14373) 12762 : cluster [DBG] pgmap v8849: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:32:13.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:32:13 smithi157 bash[24585]: cluster 2024-09-16T10:32:12.340942+0000 mgr.a (mgr.14373) 12763 : cluster [DBG] pgmap v8850: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:32:13.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:32:13 smithi086 bash[24289]: cluster 2024-09-16T10:32:12.340942+0000 mgr.a (mgr.14373) 12763 : cluster [DBG] pgmap v8850: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:32:13.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:32:13 smithi047 bash[22744]: cluster 2024-09-16T10:32:12.340942+0000 mgr.a (mgr.14373) 12763 : cluster [DBG] pgmap v8850: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:32:14.808 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:32:14 smithi157 bash[24585]: cluster 2024-09-16T10:32:14.341697+0000 mgr.a (mgr.14373) 12764 : cluster [DBG] pgmap v8851: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:32:14.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:32:14 smithi086 bash[24289]: cluster 2024-09-16T10:32:14.341697+0000 mgr.a (mgr.14373) 12764 : cluster [DBG] pgmap v8851: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:32:14.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:32:14 smithi047 bash[22744]: cluster 2024-09-16T10:32:14.341697+0000 mgr.a (mgr.14373) 12764 : cluster [DBG] pgmap v8851: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:32:15.338 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:32:15.339 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:32:15.340 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:32:16.107 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:32:16.107 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:32:16.107 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:32:16.107 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:32:16.107 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:32:17.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:32:17 smithi157 bash[24585]: audit 2024-09-16T10:32:15.673856+0000 mgr.a (mgr.14373) 12765 : audit [DBG] from='client.278169 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:32:17.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:32:17 smithi157 bash[24585]: cluster 2024-09-16T10:32:16.342670+0000 mgr.a (mgr.14373) 12766 : cluster [DBG] pgmap v8852: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:32:17.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:32:17 smithi086 bash[24289]: audit 2024-09-16T10:32:15.673856+0000 mgr.a (mgr.14373) 12765 : audit [DBG] from='client.278169 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:32:17.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:32:17 smithi086 bash[24289]: cluster 2024-09-16T10:32:16.342670+0000 mgr.a (mgr.14373) 12766 : cluster [DBG] pgmap v8852: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:32:17.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:32:17 smithi047 bash[22744]: audit 2024-09-16T10:32:15.673856+0000 mgr.a (mgr.14373) 12765 : audit [DBG] from='client.278169 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:32:17.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:32:17 smithi047 bash[22744]: cluster 2024-09-16T10:32:16.342670+0000 mgr.a (mgr.14373) 12766 : cluster [DBG] pgmap v8852: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:32:19.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:32:19 smithi157 bash[24585]: cluster 2024-09-16T10:32:18.345023+0000 mgr.a (mgr.14373) 12767 : cluster [DBG] pgmap v8853: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:32:19.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:32:19 smithi086 bash[24289]: cluster 2024-09-16T10:32:18.345023+0000 mgr.a (mgr.14373) 12767 : cluster [DBG] pgmap v8853: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:32:19.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:32:19 smithi047 bash[22744]: cluster 2024-09-16T10:32:18.345023+0000 mgr.a (mgr.14373) 12767 : cluster [DBG] pgmap v8853: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:32:21.109 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:32:21.109 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:32:21.109 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:32:21.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:32:21 smithi157 bash[24585]: cluster 2024-09-16T10:32:20.345976+0000 mgr.a (mgr.14373) 12768 : cluster [DBG] pgmap v8854: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:32:21.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:32:21 smithi086 bash[24289]: cluster 2024-09-16T10:32:20.345976+0000 mgr.a (mgr.14373) 12768 : cluster [DBG] pgmap v8854: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:32:21.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:32:21 smithi047 bash[22744]: cluster 2024-09-16T10:32:20.345976+0000 mgr.a (mgr.14373) 12768 : cluster [DBG] pgmap v8854: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:32:21.852 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:32:21.853 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:32:21.853 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:32:21.853 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:32:21.853 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:32:23.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:32:23 smithi157 bash[24585]: audit 2024-09-16T10:32:21.440425+0000 mgr.a (mgr.14373) 12769 : audit [DBG] from='client.278247 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:32:23.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:32:23 smithi157 bash[24585]: cluster 2024-09-16T10:32:22.348852+0000 mgr.a (mgr.14373) 12770 : cluster [DBG] pgmap v8855: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:32:23.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:32:23 smithi086 bash[24289]: audit 2024-09-16T10:32:21.440425+0000 mgr.a (mgr.14373) 12769 : audit [DBG] from='client.278247 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:32:23.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:32:23 smithi086 bash[24289]: cluster 2024-09-16T10:32:22.348852+0000 mgr.a (mgr.14373) 12770 : cluster [DBG] pgmap v8855: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:32:23.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:32:23 smithi047 bash[22744]: audit 2024-09-16T10:32:21.440425+0000 mgr.a (mgr.14373) 12769 : audit [DBG] from='client.278247 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:32:23.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:32:23 smithi047 bash[22744]: cluster 2024-09-16T10:32:22.348852+0000 mgr.a (mgr.14373) 12770 : cluster [DBG] pgmap v8855: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:32:25.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:32:25 smithi157 bash[24585]: cluster 2024-09-16T10:32:24.349649+0000 mgr.a (mgr.14373) 12771 : cluster [DBG] pgmap v8856: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:32:25.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:32:25 smithi086 bash[24289]: cluster 2024-09-16T10:32:24.349649+0000 mgr.a (mgr.14373) 12771 : cluster [DBG] pgmap v8856: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:32:25.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:32:25 smithi047 bash[22744]: cluster 2024-09-16T10:32:24.349649+0000 mgr.a (mgr.14373) 12771 : cluster [DBG] pgmap v8856: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:32:26.854 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:32:26.855 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:32:26.855 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:32:27.609 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:32:27.610 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:32:27.610 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:32:27.610 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:32:27.610 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:32:27.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:32:27 smithi157 bash[24585]: cluster 2024-09-16T10:32:26.350457+0000 mgr.a (mgr.14373) 12772 : cluster [DBG] pgmap v8857: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:32:27.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:32:27 smithi086 bash[24289]: cluster 2024-09-16T10:32:26.350457+0000 mgr.a (mgr.14373) 12772 : cluster [DBG] pgmap v8857: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:32:27.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:32:27 smithi047 bash[22744]: cluster 2024-09-16T10:32:26.350457+0000 mgr.a (mgr.14373) 12772 : cluster [DBG] pgmap v8857: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:32:28.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:32:28 smithi157 bash[24585]: audit 2024-09-16T10:32:27.186450+0000 mgr.a (mgr.14373) 12773 : audit [DBG] from='client.278325 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:32:28.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:32:28 smithi086 bash[24289]: audit 2024-09-16T10:32:27.186450+0000 mgr.a (mgr.14373) 12773 : audit [DBG] from='client.278325 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:32:28.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:32:28 smithi047 bash[22744]: audit 2024-09-16T10:32:27.186450+0000 mgr.a (mgr.14373) 12773 : audit [DBG] from='client.278325 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:32:29.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:32:29 smithi157 bash[24585]: cluster 2024-09-16T10:32:28.353224+0000 mgr.a (mgr.14373) 12774 : cluster [DBG] pgmap v8858: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:32:29.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:32:29 smithi086 bash[24289]: cluster 2024-09-16T10:32:28.353224+0000 mgr.a (mgr.14373) 12774 : cluster [DBG] pgmap v8858: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:32:29.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:32:29 smithi047 bash[22744]: cluster 2024-09-16T10:32:28.353224+0000 mgr.a (mgr.14373) 12774 : cluster [DBG] pgmap v8858: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:32:30.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:32:30 smithi157 bash[24585]: cluster 2024-09-16T10:32:30.354008+0000 mgr.a (mgr.14373) 12775 : cluster [DBG] pgmap v8859: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:32:30.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:32:30 smithi086 bash[24289]: cluster 2024-09-16T10:32:30.354008+0000 mgr.a (mgr.14373) 12775 : cluster [DBG] pgmap v8859: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:32:30.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:32:30 smithi047 bash[22744]: cluster 2024-09-16T10:32:30.354008+0000 mgr.a (mgr.14373) 12775 : cluster [DBG] pgmap v8859: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:32:32.611 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:32:32.612 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:32:32.612 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:32:33.360 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:32:33.360 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:32:33.360 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:32:33.360 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:32:33.360 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:32:33.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:32:33 smithi157 bash[24585]: cluster 2024-09-16T10:32:32.355930+0000 mgr.a (mgr.14373) 12776 : cluster [DBG] pgmap v8860: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:32:33.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:32:33 smithi086 bash[24289]: cluster 2024-09-16T10:32:32.355930+0000 mgr.a (mgr.14373) 12776 : cluster [DBG] pgmap v8860: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:32:33.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:32:33 smithi047 bash[22744]: cluster 2024-09-16T10:32:32.355930+0000 mgr.a (mgr.14373) 12776 : cluster [DBG] pgmap v8860: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:32:34.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:32:34 smithi157 bash[24585]: audit 2024-09-16T10:32:32.941335+0000 mgr.a (mgr.14373) 12777 : audit [DBG] from='client.278400 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:32:34.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:32:34 smithi086 bash[24289]: audit 2024-09-16T10:32:32.941335+0000 mgr.a (mgr.14373) 12777 : audit [DBG] from='client.278400 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:32:34.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:32:34 smithi047 bash[22744]: audit 2024-09-16T10:32:32.941335+0000 mgr.a (mgr.14373) 12777 : audit [DBG] from='client.278400 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:32:35.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:32:35 smithi157 bash[24585]: cluster 2024-09-16T10:32:34.356865+0000 mgr.a (mgr.14373) 12778 : cluster [DBG] pgmap v8861: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:32:35.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:32:35 smithi086 bash[24289]: cluster 2024-09-16T10:32:34.356865+0000 mgr.a (mgr.14373) 12778 : cluster [DBG] pgmap v8861: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:32:35.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:32:35 smithi047 bash[22744]: cluster 2024-09-16T10:32:34.356865+0000 mgr.a (mgr.14373) 12778 : cluster [DBG] pgmap v8861: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:32:36.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:32:36 smithi157 bash[24585]: cluster 2024-09-16T10:32:36.357625+0000 mgr.a (mgr.14373) 12779 : cluster [DBG] pgmap v8862: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:32:36.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:32:36 smithi086 bash[24289]: cluster 2024-09-16T10:32:36.357625+0000 mgr.a (mgr.14373) 12779 : cluster [DBG] pgmap v8862: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:32:36.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:32:36 smithi047 bash[22744]: cluster 2024-09-16T10:32:36.357625+0000 mgr.a (mgr.14373) 12779 : cluster [DBG] pgmap v8862: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:32:38.361 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:32:38.362 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:32:38.362 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:32:39.131 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:32:39.132 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:32:39.132 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:32:39.132 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:32:39.132 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:32:39.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:32:39 smithi157 bash[24585]: cluster 2024-09-16T10:32:38.359849+0000 mgr.a (mgr.14373) 12780 : cluster [DBG] pgmap v8863: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:32:39.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:32:39 smithi086 bash[24289]: cluster 2024-09-16T10:32:38.359849+0000 mgr.a (mgr.14373) 12780 : cluster [DBG] pgmap v8863: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:32:39.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:32:39 smithi047 bash[22744]: cluster 2024-09-16T10:32:38.359849+0000 mgr.a (mgr.14373) 12780 : cluster [DBG] pgmap v8863: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:32:40.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:32:40 smithi157 bash[24585]: audit 2024-09-16T10:32:38.693930+0000 mgr.a (mgr.14373) 12781 : audit [DBG] from='client.278475 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:32:40.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:32:40 smithi086 bash[24289]: audit 2024-09-16T10:32:38.693930+0000 mgr.a (mgr.14373) 12781 : audit [DBG] from='client.278475 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:32:40.844 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:32:40 smithi047 bash[22744]: audit 2024-09-16T10:32:38.693930+0000 mgr.a (mgr.14373) 12781 : audit [DBG] from='client.278475 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:32:41.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:32:41 smithi157 bash[24585]: cluster 2024-09-16T10:32:40.360849+0000 mgr.a (mgr.14373) 12782 : cluster [DBG] pgmap v8864: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:32:41.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:32:41 smithi086 bash[24289]: cluster 2024-09-16T10:32:40.360849+0000 mgr.a (mgr.14373) 12782 : cluster [DBG] pgmap v8864: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:32:41.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:32:41 smithi047 bash[22744]: cluster 2024-09-16T10:32:40.360849+0000 mgr.a (mgr.14373) 12782 : cluster [DBG] pgmap v8864: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:32:42.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:32:42 smithi157 bash[24585]: cluster 2024-09-16T10:32:42.363038+0000 mgr.a (mgr.14373) 12783 : cluster [DBG] pgmap v8865: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:32:42.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:32:42 smithi086 bash[24289]: cluster 2024-09-16T10:32:42.363038+0000 mgr.a (mgr.14373) 12783 : cluster [DBG] pgmap v8865: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:32:42.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:32:42 smithi047 bash[22744]: cluster 2024-09-16T10:32:42.363038+0000 mgr.a (mgr.14373) 12783 : cluster [DBG] pgmap v8865: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:32:44.133 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:32:44.133 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:32:44.134 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:32:44.911 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:32:44.911 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:32:44.911 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:32:44.911 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:32:44.911 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:32:45.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:32:45 smithi157 bash[24585]: cluster 2024-09-16T10:32:44.363771+0000 mgr.a (mgr.14373) 12784 : cluster [DBG] pgmap v8866: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:32:45.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:32:45 smithi086 bash[24289]: cluster 2024-09-16T10:32:44.363771+0000 mgr.a (mgr.14373) 12784 : cluster [DBG] pgmap v8866: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:32:45.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:32:45 smithi047 bash[22744]: cluster 2024-09-16T10:32:44.363771+0000 mgr.a (mgr.14373) 12784 : cluster [DBG] pgmap v8866: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:32:46.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:32:46 smithi157 bash[24585]: audit 2024-09-16T10:32:44.468107+0000 mgr.a (mgr.14373) 12785 : audit [DBG] from='client.278553 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:32:46.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:32:46 smithi086 bash[24289]: audit 2024-09-16T10:32:44.468107+0000 mgr.a (mgr.14373) 12785 : audit [DBG] from='client.278553 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:32:46.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:32:46 smithi047 bash[22744]: audit 2024-09-16T10:32:44.468107+0000 mgr.a (mgr.14373) 12785 : audit [DBG] from='client.278553 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:32:47.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:32:47 smithi157 bash[24585]: cluster 2024-09-16T10:32:46.364641+0000 mgr.a (mgr.14373) 12786 : cluster [DBG] pgmap v8867: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:32:47.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:32:47 smithi086 bash[24289]: cluster 2024-09-16T10:32:46.364641+0000 mgr.a (mgr.14373) 12786 : cluster [DBG] pgmap v8867: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:32:47.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:32:47 smithi047 bash[22744]: cluster 2024-09-16T10:32:46.364641+0000 mgr.a (mgr.14373) 12786 : cluster [DBG] pgmap v8867: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:32:48.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:32:48 smithi157 bash[24585]: cluster 2024-09-16T10:32:48.366901+0000 mgr.a (mgr.14373) 12787 : cluster [DBG] pgmap v8868: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:32:48.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:32:48 smithi086 bash[24289]: cluster 2024-09-16T10:32:48.366901+0000 mgr.a (mgr.14373) 12787 : cluster [DBG] pgmap v8868: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:32:48.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:32:48 smithi047 bash[22744]: cluster 2024-09-16T10:32:48.366901+0000 mgr.a (mgr.14373) 12787 : cluster [DBG] pgmap v8868: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:32:49.912 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:32:49.913 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:32:49.913 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:32:50.681 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:32:50.681 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:32:50.681 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:32:50.681 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:32:50.681 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:32:51.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:32:51 smithi157 bash[24585]: audit 2024-09-16T10:32:50.248594+0000 mgr.a (mgr.14373) 12788 : audit [DBG] from='client.278628 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:32:51.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:32:51 smithi157 bash[24585]: cluster 2024-09-16T10:32:50.367490+0000 mgr.a (mgr.14373) 12789 : cluster [DBG] pgmap v8869: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:32:51.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:32:51 smithi086 bash[24289]: audit 2024-09-16T10:32:50.248594+0000 mgr.a (mgr.14373) 12788 : audit [DBG] from='client.278628 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:32:51.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:32:51 smithi086 bash[24289]: cluster 2024-09-16T10:32:50.367490+0000 mgr.a (mgr.14373) 12789 : cluster [DBG] pgmap v8869: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:32:51.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:32:51 smithi047 bash[22744]: audit 2024-09-16T10:32:50.248594+0000 mgr.a (mgr.14373) 12788 : audit [DBG] from='client.278628 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:32:51.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:32:51 smithi047 bash[22744]: cluster 2024-09-16T10:32:50.367490+0000 mgr.a (mgr.14373) 12789 : cluster [DBG] pgmap v8869: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:32:53.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:32:53 smithi157 bash[24585]: cluster 2024-09-16T10:32:52.369830+0000 mgr.a (mgr.14373) 12790 : cluster [DBG] pgmap v8870: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:32:53.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:32:53 smithi086 bash[24289]: cluster 2024-09-16T10:32:52.369830+0000 mgr.a (mgr.14373) 12790 : cluster [DBG] pgmap v8870: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:32:53.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:32:53 smithi047 bash[22744]: cluster 2024-09-16T10:32:52.369830+0000 mgr.a (mgr.14373) 12790 : cluster [DBG] pgmap v8870: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:32:54.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:32:54 smithi157 bash[24585]: cluster 2024-09-16T10:32:54.370651+0000 mgr.a (mgr.14373) 12791 : cluster [DBG] pgmap v8871: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:32:54.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:32:54 smithi086 bash[24289]: cluster 2024-09-16T10:32:54.370651+0000 mgr.a (mgr.14373) 12791 : cluster [DBG] pgmap v8871: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:32:54.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:32:54 smithi047 bash[22744]: cluster 2024-09-16T10:32:54.370651+0000 mgr.a (mgr.14373) 12791 : cluster [DBG] pgmap v8871: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:32:55.682 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:32:55.683 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:32:55.683 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:32:56.437 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:32:56.438 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:32:56.438 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:32:56.438 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:32:56.438 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:32:57.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:32:57 smithi157 bash[24585]: audit 2024-09-16T10:32:56.013643+0000 mgr.a (mgr.14373) 12792 : audit [DBG] from='client.278706 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:32:57.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:32:57 smithi157 bash[24585]: cluster 2024-09-16T10:32:56.371213+0000 mgr.a (mgr.14373) 12793 : cluster [DBG] pgmap v8872: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:32:57.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:32:57 smithi086 bash[24289]: audit 2024-09-16T10:32:56.013643+0000 mgr.a (mgr.14373) 12792 : audit [DBG] from='client.278706 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:32:57.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:32:57 smithi086 bash[24289]: cluster 2024-09-16T10:32:56.371213+0000 mgr.a (mgr.14373) 12793 : cluster [DBG] pgmap v8872: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:32:57.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:32:57 smithi047 bash[22744]: audit 2024-09-16T10:32:56.013643+0000 mgr.a (mgr.14373) 12792 : audit [DBG] from='client.278706 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:32:57.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:32:57 smithi047 bash[22744]: cluster 2024-09-16T10:32:56.371213+0000 mgr.a (mgr.14373) 12793 : cluster [DBG] pgmap v8872: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:32:58.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:32:58 smithi157 bash[24585]: cluster 2024-09-16T10:32:58.373428+0000 mgr.a (mgr.14373) 12794 : cluster [DBG] pgmap v8873: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:32:58.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:32:58 smithi086 bash[24289]: cluster 2024-09-16T10:32:58.373428+0000 mgr.a (mgr.14373) 12794 : cluster [DBG] pgmap v8873: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:32:58.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:32:58 smithi047 bash[22744]: cluster 2024-09-16T10:32:58.373428+0000 mgr.a (mgr.14373) 12794 : cluster [DBG] pgmap v8873: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:33:00.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:33:00 smithi157 bash[24585]: cluster 2024-09-16T10:33:00.374224+0000 mgr.a (mgr.14373) 12795 : cluster [DBG] pgmap v8874: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:33:00.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:33:00 smithi086 bash[24289]: cluster 2024-09-16T10:33:00.374224+0000 mgr.a (mgr.14373) 12795 : cluster [DBG] pgmap v8874: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:33:00.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:33:00 smithi047 bash[22744]: cluster 2024-09-16T10:33:00.374224+0000 mgr.a (mgr.14373) 12795 : cluster [DBG] pgmap v8874: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:33:01.439 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:33:01.440 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:33:01.440 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:33:02.188 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:33:02.188 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:33:02.188 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:33:02.188 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:33:02.189 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:33:02.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:33:02 smithi157 bash[24585]: audit 2024-09-16T10:33:01.769801+0000 mgr.a (mgr.14373) 12796 : audit [DBG] from='client.278781 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:33:02.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:33:02 smithi157 bash[24585]: cluster 2024-09-16T10:33:02.377083+0000 mgr.a (mgr.14373) 12797 : cluster [DBG] pgmap v8875: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:33:02.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:33:02 smithi086 bash[24289]: audit 2024-09-16T10:33:01.769801+0000 mgr.a (mgr.14373) 12796 : audit [DBG] from='client.278781 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:33:02.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:33:02 smithi086 bash[24289]: cluster 2024-09-16T10:33:02.377083+0000 mgr.a (mgr.14373) 12797 : cluster [DBG] pgmap v8875: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:33:02.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:33:02 smithi047 bash[22744]: audit 2024-09-16T10:33:01.769801+0000 mgr.a (mgr.14373) 12796 : audit [DBG] from='client.278781 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:33:02.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:33:02 smithi047 bash[22744]: cluster 2024-09-16T10:33:02.377083+0000 mgr.a (mgr.14373) 12797 : cluster [DBG] pgmap v8875: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:33:04.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:33:04 smithi157 bash[24585]: cluster 2024-09-16T10:33:04.378087+0000 mgr.a (mgr.14373) 12798 : cluster [DBG] pgmap v8876: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:33:04.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:33:04 smithi086 bash[24289]: cluster 2024-09-16T10:33:04.378087+0000 mgr.a (mgr.14373) 12798 : cluster [DBG] pgmap v8876: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:33:04.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:33:04 smithi047 bash[22744]: cluster 2024-09-16T10:33:04.378087+0000 mgr.a (mgr.14373) 12798 : cluster [DBG] pgmap v8876: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:33:06.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:33:06 smithi157 bash[24585]: cluster 2024-09-16T10:33:06.379029+0000 mgr.a (mgr.14373) 12799 : cluster [DBG] pgmap v8877: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T10:33:06.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:33:06 smithi086 bash[24289]: cluster 2024-09-16T10:33:06.379029+0000 mgr.a (mgr.14373) 12799 : cluster [DBG] pgmap v8877: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T10:33:06.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:33:06 smithi047 bash[22744]: cluster 2024-09-16T10:33:06.379029+0000 mgr.a (mgr.14373) 12799 : cluster [DBG] pgmap v8877: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T10:33:07.190 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:33:07.191 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:33:07.191 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:33:07.974 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:33:07.974 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:33:07.975 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:33:07.975 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:33:07.975 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:33:08.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:33:08 smithi157 bash[24585]: audit 2024-09-16T10:33:08.169833+0000 mon.b (mon.2) 1174 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T10:33:08.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:33:08 smithi086 bash[24289]: audit 2024-09-16T10:33:08.169833+0000 mon.b (mon.2) 1174 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T10:33:08.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:33:08 smithi047 bash[22744]: audit 2024-09-16T10:33:08.169833+0000 mon.b (mon.2) 1174 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T10:33:09.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:33:09 smithi157 bash[24585]: audit 2024-09-16T10:33:07.525845+0000 mgr.a (mgr.14373) 12800 : audit [DBG] from='client.278859 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:33:09.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:33:09 smithi157 bash[24585]: cluster 2024-09-16T10:33:08.381736+0000 mgr.a (mgr.14373) 12801 : cluster [DBG] pgmap v8878: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:33:09.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:33:09 smithi086 bash[24289]: audit 2024-09-16T10:33:07.525845+0000 mgr.a (mgr.14373) 12800 : audit [DBG] from='client.278859 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:33:09.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:33:09 smithi086 bash[24289]: cluster 2024-09-16T10:33:08.381736+0000 mgr.a (mgr.14373) 12801 : cluster [DBG] pgmap v8878: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:33:09.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:33:09 smithi047 bash[22744]: audit 2024-09-16T10:33:07.525845+0000 mgr.a (mgr.14373) 12800 : audit [DBG] from='client.278859 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:33:09.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:33:09 smithi047 bash[22744]: cluster 2024-09-16T10:33:08.381736+0000 mgr.a (mgr.14373) 12801 : cluster [DBG] pgmap v8878: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:33:10.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:33:10 smithi157 bash[24585]: cluster 2024-09-16T10:33:10.382575+0000 mgr.a (mgr.14373) 12802 : cluster [DBG] pgmap v8879: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:33:10.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:33:10 smithi086 bash[24289]: cluster 2024-09-16T10:33:10.382575+0000 mgr.a (mgr.14373) 12802 : cluster [DBG] pgmap v8879: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:33:10.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:33:10 smithi047 bash[22744]: cluster 2024-09-16T10:33:10.382575+0000 mgr.a (mgr.14373) 12802 : cluster [DBG] pgmap v8879: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:33:12.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:33:12 smithi157 bash[24585]: cluster 2024-09-16T10:33:12.384532+0000 mgr.a (mgr.14373) 12803 : cluster [DBG] pgmap v8880: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:33:12.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:33:12 smithi086 bash[24289]: cluster 2024-09-16T10:33:12.384532+0000 mgr.a (mgr.14373) 12803 : cluster [DBG] pgmap v8880: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:33:12.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:33:12 smithi047 bash[22744]: cluster 2024-09-16T10:33:12.384532+0000 mgr.a (mgr.14373) 12803 : cluster [DBG] pgmap v8880: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:33:12.976 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:33:12.977 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:33:12.977 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:33:13.752 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:33:13.752 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:33:13.753 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:33:13.753 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:33:13.753 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:33:13.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:33:13 smithi157 bash[24585]: audit 2024-09-16T10:33:13.305831+0000 mgr.a (mgr.14373) 12804 : audit [DBG] from='client.278931 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:33:13.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:33:13 smithi086 bash[24289]: audit 2024-09-16T10:33:13.305831+0000 mgr.a (mgr.14373) 12804 : audit [DBG] from='client.278931 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:33:13.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:33:13 smithi047 bash[22744]: audit 2024-09-16T10:33:13.305831+0000 mgr.a (mgr.14373) 12804 : audit [DBG] from='client.278931 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:33:14.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:33:14 smithi157 bash[24585]: audit 2024-09-16T10:33:13.515133+0000 mon.a (mon.0) 1327 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:33:14.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:33:14 smithi157 bash[24585]: audit 2024-09-16T10:33:13.521279+0000 mon.a (mon.0) 1328 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:33:14.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:33:14 smithi157 bash[24585]: audit 2024-09-16T10:33:13.554520+0000 mon.a (mon.0) 1329 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:33:14.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:33:14 smithi157 bash[24585]: audit 2024-09-16T10:33:13.558585+0000 mon.a (mon.0) 1330 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:33:14.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:33:14 smithi157 bash[24585]: audit 2024-09-16T10:33:13.563410+0000 mon.a (mon.0) 1331 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:33:14.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:33:14 smithi157 bash[24585]: audit 2024-09-16T10:33:13.568054+0000 mon.a (mon.0) 1332 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:33:14.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:33:14 smithi157 bash[24585]: audit 2024-09-16T10:33:14.266301+0000 mon.b (mon.2) 1175 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T10:33:14.808 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:33:14 smithi157 bash[24585]: audit 2024-09-16T10:33:14.268360+0000 mon.b (mon.2) 1176 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T10:33:14.808 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:33:14 smithi157 bash[24585]: audit 2024-09-16T10:33:14.277943+0000 mon.a (mon.0) 1333 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:33:14.808 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:33:14 smithi157 bash[24585]: audit 2024-09-16T10:33:14.283129+0000 mon.b (mon.2) 1177 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:33:14.808 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:33:14 smithi157 bash[24585]: audit 2024-09-16T10:33:14.286118+0000 mgr.a (mgr.14373) 12805 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:33:14.808 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:33:14 smithi157 bash[24585]: cluster 2024-09-16T10:33:14.385065+0000 mgr.a (mgr.14373) 12806 : cluster [DBG] pgmap v8881: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:33:14.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:33:14 smithi086 bash[24289]: audit 2024-09-16T10:33:13.515133+0000 mon.a (mon.0) 1327 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:33:14.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:33:14 smithi086 bash[24289]: audit 2024-09-16T10:33:13.521279+0000 mon.a (mon.0) 1328 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:33:14.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:33:14 smithi086 bash[24289]: audit 2024-09-16T10:33:13.554520+0000 mon.a (mon.0) 1329 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:33:14.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:33:14 smithi086 bash[24289]: audit 2024-09-16T10:33:13.558585+0000 mon.a (mon.0) 1330 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:33:14.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:33:14 smithi086 bash[24289]: audit 2024-09-16T10:33:13.563410+0000 mon.a (mon.0) 1331 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:33:14.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:33:14 smithi086 bash[24289]: audit 2024-09-16T10:33:13.568054+0000 mon.a (mon.0) 1332 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:33:14.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:33:14 smithi086 bash[24289]: audit 2024-09-16T10:33:14.266301+0000 mon.b (mon.2) 1175 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T10:33:14.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:33:14 smithi086 bash[24289]: audit 2024-09-16T10:33:14.268360+0000 mon.b (mon.2) 1176 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T10:33:14.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:33:14 smithi086 bash[24289]: audit 2024-09-16T10:33:14.277943+0000 mon.a (mon.0) 1333 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:33:14.822 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:33:14 smithi086 bash[24289]: audit 2024-09-16T10:33:14.283129+0000 mon.b (mon.2) 1177 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:33:14.822 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:33:14 smithi086 bash[24289]: audit 2024-09-16T10:33:14.286118+0000 mgr.a (mgr.14373) 12805 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:33:14.822 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:33:14 smithi086 bash[24289]: cluster 2024-09-16T10:33:14.385065+0000 mgr.a (mgr.14373) 12806 : cluster [DBG] pgmap v8881: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:33:14.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:33:14 smithi047 bash[22744]: audit 2024-09-16T10:33:13.515133+0000 mon.a (mon.0) 1327 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:33:14.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:33:14 smithi047 bash[22744]: audit 2024-09-16T10:33:13.521279+0000 mon.a (mon.0) 1328 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:33:14.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:33:14 smithi047 bash[22744]: audit 2024-09-16T10:33:13.554520+0000 mon.a (mon.0) 1329 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:33:14.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:33:14 smithi047 bash[22744]: audit 2024-09-16T10:33:13.558585+0000 mon.a (mon.0) 1330 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:33:14.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:33:14 smithi047 bash[22744]: audit 2024-09-16T10:33:13.563410+0000 mon.a (mon.0) 1331 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:33:14.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:33:14 smithi047 bash[22744]: audit 2024-09-16T10:33:13.568054+0000 mon.a (mon.0) 1332 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:33:14.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:33:14 smithi047 bash[22744]: audit 2024-09-16T10:33:14.266301+0000 mon.b (mon.2) 1175 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T10:33:14.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:33:14 smithi047 bash[22744]: audit 2024-09-16T10:33:14.268360+0000 mon.b (mon.2) 1176 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T10:33:14.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:33:14 smithi047 bash[22744]: audit 2024-09-16T10:33:14.277943+0000 mon.a (mon.0) 1333 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:33:14.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:33:14 smithi047 bash[22744]: audit 2024-09-16T10:33:14.283129+0000 mon.b (mon.2) 1177 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:33:14.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:33:14 smithi047 bash[22744]: audit 2024-09-16T10:33:14.286118+0000 mgr.a (mgr.14373) 12805 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:33:14.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:33:14 smithi047 bash[22744]: cluster 2024-09-16T10:33:14.385065+0000 mgr.a (mgr.14373) 12806 : cluster [DBG] pgmap v8881: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:33:15.342 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 10:33:14 smithi047 bash[22994]: debug 2024-09-16T10:33:14.995+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T10:33:15.343 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 10:33:15 smithi047 bash[22994]: debug 2024-09-16T10:33:14.995+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T10:33:16.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:33:16 smithi157 bash[24585]: audit 2024-09-16T10:33:14.999514+0000 mgr.a (mgr.14373) 12807 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T10:33:16.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:33:16 smithi157 bash[24585]: cephadm 2024-09-16T10:33:15.001396+0000 mgr.a (mgr.14373) 12808 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T10:33:16.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:33:16 smithi086 bash[24289]: audit 2024-09-16T10:33:14.999514+0000 mgr.a (mgr.14373) 12807 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T10:33:16.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:33:16 smithi086 bash[24289]: cephadm 2024-09-16T10:33:15.001396+0000 mgr.a (mgr.14373) 12808 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T10:33:16.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:33:16 smithi047 bash[22744]: audit 2024-09-16T10:33:14.999514+0000 mgr.a (mgr.14373) 12807 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T10:33:16.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:33:16 smithi047 bash[22744]: cephadm 2024-09-16T10:33:15.001396+0000 mgr.a (mgr.14373) 12808 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T10:33:17.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:33:17 smithi157 bash[24585]: cluster 2024-09-16T10:33:16.385941+0000 mgr.a (mgr.14373) 12809 : cluster [DBG] pgmap v8882: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:33:17.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:33:17 smithi086 bash[24289]: cluster 2024-09-16T10:33:16.385941+0000 mgr.a (mgr.14373) 12809 : cluster [DBG] pgmap v8882: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:33:17.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:33:17 smithi047 bash[22744]: cluster 2024-09-16T10:33:16.385941+0000 mgr.a (mgr.14373) 12809 : cluster [DBG] pgmap v8882: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:33:18.754 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:33:18.755 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:33:18.755 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:33:18.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:33:18 smithi157 bash[24585]: cluster 2024-09-16T10:33:18.388167+0000 mgr.a (mgr.14373) 12810 : cluster [DBG] pgmap v8883: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:33:18.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:33:18 smithi086 bash[24289]: cluster 2024-09-16T10:33:18.388167+0000 mgr.a (mgr.14373) 12810 : cluster [DBG] pgmap v8883: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:33:18.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:33:18 smithi047 bash[22744]: cluster 2024-09-16T10:33:18.388167+0000 mgr.a (mgr.14373) 12810 : cluster [DBG] pgmap v8883: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:33:19.532 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:33:19.532 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:33:19.532 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:33:19.533 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:33:19.533 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:33:19.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:33:19 smithi157 bash[24585]: audit 2024-09-16T10:33:19.090618+0000 mgr.a (mgr.14373) 12811 : audit [DBG] from='client.279114 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:33:19.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:33:19 smithi086 bash[24289]: audit 2024-09-16T10:33:19.090618+0000 mgr.a (mgr.14373) 12811 : audit [DBG] from='client.279114 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:33:19.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:33:19 smithi047 bash[22744]: audit 2024-09-16T10:33:19.090618+0000 mgr.a (mgr.14373) 12811 : audit [DBG] from='client.279114 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:33:20.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:33:20 smithi157 bash[24585]: cluster 2024-09-16T10:33:20.389093+0000 mgr.a (mgr.14373) 12812 : cluster [DBG] pgmap v8884: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:33:20.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:33:20 smithi086 bash[24289]: cluster 2024-09-16T10:33:20.389093+0000 mgr.a (mgr.14373) 12812 : cluster [DBG] pgmap v8884: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:33:20.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:33:20 smithi047 bash[22744]: cluster 2024-09-16T10:33:20.389093+0000 mgr.a (mgr.14373) 12812 : cluster [DBG] pgmap v8884: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:33:22.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:33:22 smithi157 bash[24585]: cluster 2024-09-16T10:33:22.391292+0000 mgr.a (mgr.14373) 12813 : cluster [DBG] pgmap v8885: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:33:22.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:33:22 smithi086 bash[24289]: cluster 2024-09-16T10:33:22.391292+0000 mgr.a (mgr.14373) 12813 : cluster [DBG] pgmap v8885: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:33:22.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:33:22 smithi047 bash[22744]: cluster 2024-09-16T10:33:22.391292+0000 mgr.a (mgr.14373) 12813 : cluster [DBG] pgmap v8885: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:33:24.533 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:33:24.534 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:33:24.534 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:33:24.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:33:24 smithi157 bash[24585]: cluster 2024-09-16T10:33:24.392046+0000 mgr.a (mgr.14373) 12814 : cluster [DBG] pgmap v8886: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:33:24.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:33:24 smithi086 bash[24289]: cluster 2024-09-16T10:33:24.392046+0000 mgr.a (mgr.14373) 12814 : cluster [DBG] pgmap v8886: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:33:24.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:33:24 smithi047 bash[22744]: cluster 2024-09-16T10:33:24.392046+0000 mgr.a (mgr.14373) 12814 : cluster [DBG] pgmap v8886: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:33:25.284 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:33:25.285 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:33:25.285 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:33:25.285 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:33:25.285 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:33:25.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:33:25 smithi157 bash[24585]: audit 2024-09-16T10:33:24.861049+0000 mgr.a (mgr.14373) 12815 : audit [DBG] from='client.279192 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:33:25.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:33:25 smithi086 bash[24289]: audit 2024-09-16T10:33:24.861049+0000 mgr.a (mgr.14373) 12815 : audit [DBG] from='client.279192 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:33:25.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:33:25 smithi047 bash[22744]: audit 2024-09-16T10:33:24.861049+0000 mgr.a (mgr.14373) 12815 : audit [DBG] from='client.279192 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:33:26.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:33:26 smithi157 bash[24585]: cluster 2024-09-16T10:33:26.393028+0000 mgr.a (mgr.14373) 12816 : cluster [DBG] pgmap v8887: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:33:26.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:33:26 smithi086 bash[24289]: cluster 2024-09-16T10:33:26.393028+0000 mgr.a (mgr.14373) 12816 : cluster [DBG] pgmap v8887: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:33:26.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:33:26 smithi047 bash[22744]: cluster 2024-09-16T10:33:26.393028+0000 mgr.a (mgr.14373) 12816 : cluster [DBG] pgmap v8887: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:33:28.808 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:33:28 smithi157 bash[24585]: cluster 2024-09-16T10:33:28.395882+0000 mgr.a (mgr.14373) 12817 : cluster [DBG] pgmap v8888: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:33:28.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:33:28 smithi086 bash[24289]: cluster 2024-09-16T10:33:28.395882+0000 mgr.a (mgr.14373) 12817 : cluster [DBG] pgmap v8888: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:33:28.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:33:28 smithi047 bash[22744]: cluster 2024-09-16T10:33:28.395882+0000 mgr.a (mgr.14373) 12817 : cluster [DBG] pgmap v8888: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:33:30.286 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:33:30.287 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:33:30.287 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:33:30.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:33:30 smithi157 bash[24585]: cluster 2024-09-16T10:33:30.396380+0000 mgr.a (mgr.14373) 12818 : cluster [DBG] pgmap v8889: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:33:30.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:33:30 smithi086 bash[24289]: cluster 2024-09-16T10:33:30.396380+0000 mgr.a (mgr.14373) 12818 : cluster [DBG] pgmap v8889: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:33:30.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:33:30 smithi047 bash[22744]: cluster 2024-09-16T10:33:30.396380+0000 mgr.a (mgr.14373) 12818 : cluster [DBG] pgmap v8889: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:33:31.070 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:33:31.071 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:33:31.071 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:33:31.071 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:33:31.071 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:33:31.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:33:31 smithi157 bash[24585]: audit 2024-09-16T10:33:30.618750+0000 mgr.a (mgr.14373) 12819 : audit [DBG] from='client.279264 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:33:31.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:33:31 smithi086 bash[24289]: audit 2024-09-16T10:33:30.618750+0000 mgr.a (mgr.14373) 12819 : audit [DBG] from='client.279264 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:33:31.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:33:31 smithi047 bash[22744]: audit 2024-09-16T10:33:30.618750+0000 mgr.a (mgr.14373) 12819 : audit [DBG] from='client.279264 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:33:32.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:33:32 smithi157 bash[24585]: cluster 2024-09-16T10:33:32.398702+0000 mgr.a (mgr.14373) 12820 : cluster [DBG] pgmap v8890: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:33:32.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:33:32 smithi086 bash[24289]: cluster 2024-09-16T10:33:32.398702+0000 mgr.a (mgr.14373) 12820 : cluster [DBG] pgmap v8890: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:33:32.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:33:32 smithi047 bash[22744]: cluster 2024-09-16T10:33:32.398702+0000 mgr.a (mgr.14373) 12820 : cluster [DBG] pgmap v8890: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:33:34.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:33:34 smithi157 bash[24585]: cluster 2024-09-16T10:33:34.399439+0000 mgr.a (mgr.14373) 12821 : cluster [DBG] pgmap v8891: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:33:34.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:33:34 smithi086 bash[24289]: cluster 2024-09-16T10:33:34.399439+0000 mgr.a (mgr.14373) 12821 : cluster [DBG] pgmap v8891: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:33:34.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:33:34 smithi047 bash[22744]: cluster 2024-09-16T10:33:34.399439+0000 mgr.a (mgr.14373) 12821 : cluster [DBG] pgmap v8891: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:33:36.072 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:33:36.073 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:33:36.073 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:33:36.809 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:33:36 smithi157 bash[24585]: cluster 2024-09-16T10:33:36.400118+0000 mgr.a (mgr.14373) 12822 : cluster [DBG] pgmap v8892: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:33:36.809 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:33:36 smithi157 bash[24585]: audit 2024-09-16T10:33:36.412808+0000 mgr.a (mgr.14373) 12823 : audit [DBG] from='client.279339 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:33:36.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:33:36 smithi086 bash[24289]: cluster 2024-09-16T10:33:36.400118+0000 mgr.a (mgr.14373) 12822 : cluster [DBG] pgmap v8892: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:33:36.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:33:36 smithi086 bash[24289]: audit 2024-09-16T10:33:36.412808+0000 mgr.a (mgr.14373) 12823 : audit [DBG] from='client.279339 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:33:36.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:33:36 smithi047 bash[22744]: cluster 2024-09-16T10:33:36.400118+0000 mgr.a (mgr.14373) 12822 : cluster [DBG] pgmap v8892: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:33:36.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:33:36 smithi047 bash[22744]: audit 2024-09-16T10:33:36.412808+0000 mgr.a (mgr.14373) 12823 : audit [DBG] from='client.279339 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:33:36.867 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:33:36.868 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:33:36.868 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:33:36.868 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:33:36.868 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:33:38.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:33:38 smithi157 bash[24585]: cluster 2024-09-16T10:33:38.402891+0000 mgr.a (mgr.14373) 12824 : cluster [DBG] pgmap v8893: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:33:38.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:33:38 smithi086 bash[24289]: cluster 2024-09-16T10:33:38.402891+0000 mgr.a (mgr.14373) 12824 : cluster [DBG] pgmap v8893: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:33:38.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:33:38 smithi047 bash[22744]: cluster 2024-09-16T10:33:38.402891+0000 mgr.a (mgr.14373) 12824 : cluster [DBG] pgmap v8893: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:33:40.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:33:40 smithi157 bash[24585]: cluster 2024-09-16T10:33:40.403850+0000 mgr.a (mgr.14373) 12825 : cluster [DBG] pgmap v8894: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:33:40.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:33:40 smithi086 bash[24289]: cluster 2024-09-16T10:33:40.403850+0000 mgr.a (mgr.14373) 12825 : cluster [DBG] pgmap v8894: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:33:40.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:33:40 smithi047 bash[22744]: cluster 2024-09-16T10:33:40.403850+0000 mgr.a (mgr.14373) 12825 : cluster [DBG] pgmap v8894: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:33:41.869 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:33:41.870 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:33:41.870 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:33:42.648 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:33:42.648 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:33:42.648 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:33:42.648 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:33:42.648 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:33:42.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:33:42 smithi157 bash[24585]: audit 2024-09-16T10:33:42.203604+0000 mgr.a (mgr.14373) 12826 : audit [DBG] from='client.279417 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:33:42.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:33:42 smithi157 bash[24585]: cluster 2024-09-16T10:33:42.405569+0000 mgr.a (mgr.14373) 12827 : cluster [DBG] pgmap v8895: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:33:42.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:33:42 smithi086 bash[24289]: audit 2024-09-16T10:33:42.203604+0000 mgr.a (mgr.14373) 12826 : audit [DBG] from='client.279417 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:33:42.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:33:42 smithi086 bash[24289]: cluster 2024-09-16T10:33:42.405569+0000 mgr.a (mgr.14373) 12827 : cluster [DBG] pgmap v8895: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:33:42.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:33:42 smithi047 bash[22744]: audit 2024-09-16T10:33:42.203604+0000 mgr.a (mgr.14373) 12826 : audit [DBG] from='client.279417 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:33:42.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:33:42 smithi047 bash[22744]: cluster 2024-09-16T10:33:42.405569+0000 mgr.a (mgr.14373) 12827 : cluster [DBG] pgmap v8895: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:33:44.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:33:44 smithi157 bash[24585]: cluster 2024-09-16T10:33:44.406469+0000 mgr.a (mgr.14373) 12828 : cluster [DBG] pgmap v8896: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:33:44.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:33:44 smithi086 bash[24289]: cluster 2024-09-16T10:33:44.406469+0000 mgr.a (mgr.14373) 12828 : cluster [DBG] pgmap v8896: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:33:44.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:33:44 smithi047 bash[22744]: cluster 2024-09-16T10:33:44.406469+0000 mgr.a (mgr.14373) 12828 : cluster [DBG] pgmap v8896: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:33:46.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:33:46 smithi157 bash[24585]: cluster 2024-09-16T10:33:46.407183+0000 mgr.a (mgr.14373) 12829 : cluster [DBG] pgmap v8897: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T10:33:46.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:33:46 smithi086 bash[24289]: cluster 2024-09-16T10:33:46.407183+0000 mgr.a (mgr.14373) 12829 : cluster [DBG] pgmap v8897: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T10:33:46.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:33:46 smithi047 bash[22744]: cluster 2024-09-16T10:33:46.407183+0000 mgr.a (mgr.14373) 12829 : cluster [DBG] pgmap v8897: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T10:33:47.652 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:33:47.653 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:33:47.653 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:33:48.421 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:33:48.421 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:33:48.422 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:33:48.422 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:33:48.422 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:33:48.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:33:48 smithi157 bash[24585]: audit 2024-09-16T10:33:47.985182+0000 mgr.a (mgr.14373) 12830 : audit [DBG] from='client.279495 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:33:48.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:33:48 smithi157 bash[24585]: cluster 2024-09-16T10:33:48.408442+0000 mgr.a (mgr.14373) 12831 : cluster [DBG] pgmap v8898: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:33:48.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:33:48 smithi086 bash[24289]: audit 2024-09-16T10:33:47.985182+0000 mgr.a (mgr.14373) 12830 : audit [DBG] from='client.279495 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:33:48.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:33:48 smithi086 bash[24289]: cluster 2024-09-16T10:33:48.408442+0000 mgr.a (mgr.14373) 12831 : cluster [DBG] pgmap v8898: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:33:48.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:33:48 smithi047 bash[22744]: audit 2024-09-16T10:33:47.985182+0000 mgr.a (mgr.14373) 12830 : audit [DBG] from='client.279495 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:33:48.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:33:48 smithi047 bash[22744]: cluster 2024-09-16T10:33:48.408442+0000 mgr.a (mgr.14373) 12831 : cluster [DBG] pgmap v8898: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:33:50.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:33:50 smithi157 bash[24585]: cluster 2024-09-16T10:33:50.409143+0000 mgr.a (mgr.14373) 12832 : cluster [DBG] pgmap v8899: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:33:50.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:33:50 smithi086 bash[24289]: cluster 2024-09-16T10:33:50.409143+0000 mgr.a (mgr.14373) 12832 : cluster [DBG] pgmap v8899: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:33:50.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:33:50 smithi047 bash[22744]: cluster 2024-09-16T10:33:50.409143+0000 mgr.a (mgr.14373) 12832 : cluster [DBG] pgmap v8899: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:33:52.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:33:52 smithi157 bash[24585]: cluster 2024-09-16T10:33:52.411138+0000 mgr.a (mgr.14373) 12833 : cluster [DBG] pgmap v8900: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:33:52.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:33:52 smithi086 bash[24289]: cluster 2024-09-16T10:33:52.411138+0000 mgr.a (mgr.14373) 12833 : cluster [DBG] pgmap v8900: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:33:52.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:33:52 smithi047 bash[22744]: cluster 2024-09-16T10:33:52.411138+0000 mgr.a (mgr.14373) 12833 : cluster [DBG] pgmap v8900: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:33:53.423 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:33:53.424 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:33:53.424 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:33:54.194 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:33:54.195 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:33:54.195 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:33:54.195 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:33:54.195 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:33:54.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:33:54 smithi157 bash[24585]: audit 2024-09-16T10:33:53.759467+0000 mgr.a (mgr.14373) 12834 : audit [DBG] from='client.279573 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:33:54.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:33:54 smithi157 bash[24585]: cluster 2024-09-16T10:33:54.412126+0000 mgr.a (mgr.14373) 12835 : cluster [DBG] pgmap v8901: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:33:54.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:33:54 smithi086 bash[24289]: audit 2024-09-16T10:33:53.759467+0000 mgr.a (mgr.14373) 12834 : audit [DBG] from='client.279573 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:33:54.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:33:54 smithi086 bash[24289]: cluster 2024-09-16T10:33:54.412126+0000 mgr.a (mgr.14373) 12835 : cluster [DBG] pgmap v8901: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:33:54.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:33:54 smithi047 bash[22744]: audit 2024-09-16T10:33:53.759467+0000 mgr.a (mgr.14373) 12834 : audit [DBG] from='client.279573 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:33:54.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:33:54 smithi047 bash[22744]: cluster 2024-09-16T10:33:54.412126+0000 mgr.a (mgr.14373) 12835 : cluster [DBG] pgmap v8901: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:33:56.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:33:56 smithi157 bash[24585]: cluster 2024-09-16T10:33:56.412931+0000 mgr.a (mgr.14373) 12836 : cluster [DBG] pgmap v8902: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:33:56.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:33:56 smithi086 bash[24289]: cluster 2024-09-16T10:33:56.412931+0000 mgr.a (mgr.14373) 12836 : cluster [DBG] pgmap v8902: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:33:56.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:33:56 smithi047 bash[22744]: cluster 2024-09-16T10:33:56.412931+0000 mgr.a (mgr.14373) 12836 : cluster [DBG] pgmap v8902: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:33:58.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:33:58 smithi157 bash[24585]: cluster 2024-09-16T10:33:58.415157+0000 mgr.a (mgr.14373) 12837 : cluster [DBG] pgmap v8903: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:33:58.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:33:58 smithi086 bash[24289]: cluster 2024-09-16T10:33:58.415157+0000 mgr.a (mgr.14373) 12837 : cluster [DBG] pgmap v8903: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:33:58.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:33:58 smithi047 bash[22744]: cluster 2024-09-16T10:33:58.415157+0000 mgr.a (mgr.14373) 12837 : cluster [DBG] pgmap v8903: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:33:59.196 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:33:59.197 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:33:59.197 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:33:59.980 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:33:59.981 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:33:59.981 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:33:59.981 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:33:59.981 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:34:00.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:34:00 smithi157 bash[24585]: audit 2024-09-16T10:33:59.529953+0000 mgr.a (mgr.14373) 12838 : audit [DBG] from='client.279651 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:34:00.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:34:00 smithi157 bash[24585]: cluster 2024-09-16T10:34:00.416155+0000 mgr.a (mgr.14373) 12839 : cluster [DBG] pgmap v8904: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:34:00.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:34:00 smithi086 bash[24289]: audit 2024-09-16T10:33:59.529953+0000 mgr.a (mgr.14373) 12838 : audit [DBG] from='client.279651 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:34:00.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:34:00 smithi086 bash[24289]: cluster 2024-09-16T10:34:00.416155+0000 mgr.a (mgr.14373) 12839 : cluster [DBG] pgmap v8904: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:34:00.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:34:00 smithi047 bash[22744]: audit 2024-09-16T10:33:59.529953+0000 mgr.a (mgr.14373) 12838 : audit [DBG] from='client.279651 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:34:00.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:34:00 smithi047 bash[22744]: cluster 2024-09-16T10:34:00.416155+0000 mgr.a (mgr.14373) 12839 : cluster [DBG] pgmap v8904: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:34:02.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:34:02 smithi157 bash[24585]: cluster 2024-09-16T10:34:02.418326+0000 mgr.a (mgr.14373) 12840 : cluster [DBG] pgmap v8905: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:34:02.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:34:02 smithi086 bash[24289]: cluster 2024-09-16T10:34:02.418326+0000 mgr.a (mgr.14373) 12840 : cluster [DBG] pgmap v8905: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:34:02.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:34:02 smithi047 bash[22744]: cluster 2024-09-16T10:34:02.418326+0000 mgr.a (mgr.14373) 12840 : cluster [DBG] pgmap v8905: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:34:04.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:34:04 smithi157 bash[24585]: cluster 2024-09-16T10:34:04.419107+0000 mgr.a (mgr.14373) 12841 : cluster [DBG] pgmap v8906: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:34:04.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:34:04 smithi086 bash[24289]: cluster 2024-09-16T10:34:04.419107+0000 mgr.a (mgr.14373) 12841 : cluster [DBG] pgmap v8906: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:34:04.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:34:04 smithi047 bash[22744]: cluster 2024-09-16T10:34:04.419107+0000 mgr.a (mgr.14373) 12841 : cluster [DBG] pgmap v8906: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:34:04.982 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:34:04.983 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:34:04.983 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:34:05.731 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:34:05.732 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:34:05.732 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:34:05.732 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:34:05.732 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:34:05.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:34:05 smithi157 bash[24585]: audit 2024-09-16T10:34:05.306612+0000 mgr.a (mgr.14373) 12842 : audit [DBG] from='client.279723 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:34:05.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:34:05 smithi086 bash[24289]: audit 2024-09-16T10:34:05.306612+0000 mgr.a (mgr.14373) 12842 : audit [DBG] from='client.279723 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:34:05.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:34:05 smithi047 bash[22744]: audit 2024-09-16T10:34:05.306612+0000 mgr.a (mgr.14373) 12842 : audit [DBG] from='client.279723 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:34:06.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:34:06 smithi157 bash[24585]: cluster 2024-09-16T10:34:06.420023+0000 mgr.a (mgr.14373) 12843 : cluster [DBG] pgmap v8907: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:34:06.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:34:06 smithi086 bash[24289]: cluster 2024-09-16T10:34:06.420023+0000 mgr.a (mgr.14373) 12843 : cluster [DBG] pgmap v8907: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:34:06.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:34:06 smithi047 bash[22744]: cluster 2024-09-16T10:34:06.420023+0000 mgr.a (mgr.14373) 12843 : cluster [DBG] pgmap v8907: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:34:08.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:34:08 smithi157 bash[24585]: cluster 2024-09-16T10:34:08.422204+0000 mgr.a (mgr.14373) 12844 : cluster [DBG] pgmap v8908: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:34:08.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:34:08 smithi086 bash[24289]: cluster 2024-09-16T10:34:08.422204+0000 mgr.a (mgr.14373) 12844 : cluster [DBG] pgmap v8908: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:34:08.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:34:08 smithi047 bash[22744]: cluster 2024-09-16T10:34:08.422204+0000 mgr.a (mgr.14373) 12844 : cluster [DBG] pgmap v8908: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:34:10.733 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:34:10.734 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:34:10.734 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:34:10.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:34:10 smithi157 bash[24585]: cluster 2024-09-16T10:34:10.422959+0000 mgr.a (mgr.14373) 12845 : cluster [DBG] pgmap v8909: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:34:10.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:34:10 smithi086 bash[24289]: cluster 2024-09-16T10:34:10.422959+0000 mgr.a (mgr.14373) 12845 : cluster [DBG] pgmap v8909: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:34:10.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:34:10 smithi047 bash[22744]: cluster 2024-09-16T10:34:10.422959+0000 mgr.a (mgr.14373) 12845 : cluster [DBG] pgmap v8909: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:34:11.482 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:34:11.482 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:34:11.482 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:34:11.483 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:34:11.483 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:34:11.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:34:11 smithi157 bash[24585]: audit 2024-09-16T10:34:11.063638+0000 mgr.a (mgr.14373) 12846 : audit [DBG] from='client.279801 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:34:11.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:34:11 smithi086 bash[24289]: audit 2024-09-16T10:34:11.063638+0000 mgr.a (mgr.14373) 12846 : audit [DBG] from='client.279801 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:34:11.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:34:11 smithi047 bash[22744]: audit 2024-09-16T10:34:11.063638+0000 mgr.a (mgr.14373) 12846 : audit [DBG] from='client.279801 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:34:12.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:34:12 smithi157 bash[24585]: cluster 2024-09-16T10:34:12.425231+0000 mgr.a (mgr.14373) 12847 : cluster [DBG] pgmap v8910: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:34:12.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:34:12 smithi086 bash[24289]: cluster 2024-09-16T10:34:12.425231+0000 mgr.a (mgr.14373) 12847 : cluster [DBG] pgmap v8910: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:34:12.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:34:12 smithi047 bash[22744]: cluster 2024-09-16T10:34:12.425231+0000 mgr.a (mgr.14373) 12847 : cluster [DBG] pgmap v8910: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:34:14.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:34:14 smithi157 bash[24585]: cluster 2024-09-16T10:34:14.425982+0000 mgr.a (mgr.14373) 12848 : cluster [DBG] pgmap v8911: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:34:14.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:34:14 smithi086 bash[24289]: cluster 2024-09-16T10:34:14.425982+0000 mgr.a (mgr.14373) 12848 : cluster [DBG] pgmap v8911: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:34:14.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:34:14 smithi047 bash[22744]: cluster 2024-09-16T10:34:14.425982+0000 mgr.a (mgr.14373) 12848 : cluster [DBG] pgmap v8911: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:34:15.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:34:15 smithi157 bash[24585]: audit 2024-09-16T10:34:15.052947+0000 mon.b (mon.2) 1178 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T10:34:15.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:34:15 smithi086 bash[24289]: audit 2024-09-16T10:34:15.052947+0000 mon.b (mon.2) 1178 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T10:34:15.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:34:15 smithi047 bash[22744]: audit 2024-09-16T10:34:15.052947+0000 mon.b (mon.2) 1178 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T10:34:16.483 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:34:16.483 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:34:16.483 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:34:16.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:34:16 smithi157 bash[24585]: audit 2024-09-16T10:34:15.901225+0000 mon.b (mon.2) 1179 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T10:34:16.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:34:16 smithi157 bash[24585]: audit 2024-09-16T10:34:15.903457+0000 mon.b (mon.2) 1180 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T10:34:16.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:34:16 smithi157 bash[24585]: audit 2024-09-16T10:34:15.915351+0000 mon.a (mon.0) 1334 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:34:16.808 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:34:16 smithi157 bash[24585]: audit 2024-09-16T10:34:15.920674+0000 mon.b (mon.2) 1181 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:34:16.808 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:34:16 smithi157 bash[24585]: audit 2024-09-16T10:34:15.923338+0000 mgr.a (mgr.14373) 12849 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:34:16.808 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:34:16 smithi157 bash[24585]: cluster 2024-09-16T10:34:16.426564+0000 mgr.a (mgr.14373) 12850 : cluster [DBG] pgmap v8912: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:34:16.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:34:16 smithi086 bash[24289]: audit 2024-09-16T10:34:15.901225+0000 mon.b (mon.2) 1179 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T10:34:16.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:34:16 smithi086 bash[24289]: audit 2024-09-16T10:34:15.903457+0000 mon.b (mon.2) 1180 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T10:34:16.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:34:16 smithi086 bash[24289]: audit 2024-09-16T10:34:15.915351+0000 mon.a (mon.0) 1334 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:34:16.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:34:16 smithi086 bash[24289]: audit 2024-09-16T10:34:15.920674+0000 mon.b (mon.2) 1181 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:34:16.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:34:16 smithi086 bash[24289]: audit 2024-09-16T10:34:15.923338+0000 mgr.a (mgr.14373) 12849 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:34:16.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:34:16 smithi086 bash[24289]: cluster 2024-09-16T10:34:16.426564+0000 mgr.a (mgr.14373) 12850 : cluster [DBG] pgmap v8912: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:34:16.842 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 10:34:16 smithi047 bash[22994]: debug 2024-09-16T10:34:16.677+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T10:34:16.842 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 10:34:16 smithi047 bash[22994]: debug 2024-09-16T10:34:16.681+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T10:34:16.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:34:16 smithi047 bash[22744]: audit 2024-09-16T10:34:15.901225+0000 mon.b (mon.2) 1179 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T10:34:16.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:34:16 smithi047 bash[22744]: audit 2024-09-16T10:34:15.903457+0000 mon.b (mon.2) 1180 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T10:34:16.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:34:16 smithi047 bash[22744]: audit 2024-09-16T10:34:15.915351+0000 mon.a (mon.0) 1334 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:34:16.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:34:16 smithi047 bash[22744]: audit 2024-09-16T10:34:15.920674+0000 mon.b (mon.2) 1181 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:34:16.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:34:16 smithi047 bash[22744]: audit 2024-09-16T10:34:15.923338+0000 mgr.a (mgr.14373) 12849 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:34:16.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:34:16 smithi047 bash[22744]: cluster 2024-09-16T10:34:16.426564+0000 mgr.a (mgr.14373) 12850 : cluster [DBG] pgmap v8912: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:34:17.226 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:34:17.226 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:34:17.226 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:34:17.226 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:34:17.226 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:34:18.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:34:17 smithi157 bash[24585]: audit 2024-09-16T10:34:16.681127+0000 mgr.a (mgr.14373) 12851 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T10:34:18.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:34:17 smithi157 bash[24585]: cephadm 2024-09-16T10:34:16.682995+0000 mgr.a (mgr.14373) 12852 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T10:34:18.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:34:17 smithi157 bash[24585]: audit 2024-09-16T10:34:16.801055+0000 mgr.a (mgr.14373) 12853 : audit [DBG] from='client.279987 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:34:18.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:34:17 smithi086 bash[24289]: audit 2024-09-16T10:34:16.681127+0000 mgr.a (mgr.14373) 12851 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T10:34:18.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:34:17 smithi086 bash[24289]: cephadm 2024-09-16T10:34:16.682995+0000 mgr.a (mgr.14373) 12852 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T10:34:18.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:34:17 smithi086 bash[24289]: audit 2024-09-16T10:34:16.801055+0000 mgr.a (mgr.14373) 12853 : audit [DBG] from='client.279987 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:34:18.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:34:17 smithi047 bash[22744]: audit 2024-09-16T10:34:16.681127+0000 mgr.a (mgr.14373) 12851 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T10:34:18.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:34:17 smithi047 bash[22744]: cephadm 2024-09-16T10:34:16.682995+0000 mgr.a (mgr.14373) 12852 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T10:34:18.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:34:17 smithi047 bash[22744]: audit 2024-09-16T10:34:16.801055+0000 mgr.a (mgr.14373) 12853 : audit [DBG] from='client.279987 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:34:19.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:34:18 smithi157 bash[24585]: cluster 2024-09-16T10:34:18.429193+0000 mgr.a (mgr.14373) 12854 : cluster [DBG] pgmap v8913: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 4.2 KiB/s rd, 255 B/s wr, 4 op/s 2024-09-16T10:34:19.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:34:18 smithi086 bash[24289]: cluster 2024-09-16T10:34:18.429193+0000 mgr.a (mgr.14373) 12854 : cluster [DBG] pgmap v8913: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 4.2 KiB/s rd, 255 B/s wr, 4 op/s 2024-09-16T10:34:19.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:34:18 smithi047 bash[22744]: cluster 2024-09-16T10:34:18.429193+0000 mgr.a (mgr.14373) 12854 : cluster [DBG] pgmap v8913: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 4.2 KiB/s rd, 255 B/s wr, 4 op/s 2024-09-16T10:34:20.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:34:20 smithi157 bash[24585]: cluster 2024-09-16T10:34:20.429937+0000 mgr.a (mgr.14373) 12855 : cluster [DBG] pgmap v8914: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 3.3 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-16T10:34:20.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:34:20 smithi086 bash[24289]: cluster 2024-09-16T10:34:20.429937+0000 mgr.a (mgr.14373) 12855 : cluster [DBG] pgmap v8914: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 3.3 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-16T10:34:20.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:34:20 smithi047 bash[22744]: cluster 2024-09-16T10:34:20.429937+0000 mgr.a (mgr.14373) 12855 : cluster [DBG] pgmap v8914: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 3.3 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-16T10:34:22.227 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:34:22.228 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:34:22.228 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:34:22.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:34:22 smithi157 bash[24585]: cluster 2024-09-16T10:34:22.431894+0000 mgr.a (mgr.14373) 12856 : cluster [DBG] pgmap v8915: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:34:22.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:34:22 smithi086 bash[24289]: cluster 2024-09-16T10:34:22.431894+0000 mgr.a (mgr.14373) 12856 : cluster [DBG] pgmap v8915: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:34:22.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:34:22 smithi047 bash[22744]: cluster 2024-09-16T10:34:22.431894+0000 mgr.a (mgr.14373) 12856 : cluster [DBG] pgmap v8915: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:34:22.981 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:34:22.981 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:34:22.981 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:34:22.982 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:34:22.982 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:34:23.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:34:23 smithi157 bash[24585]: audit 2024-09-16T10:34:22.558706+0000 mgr.a (mgr.14373) 12857 : audit [DBG] from='client.280065 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:34:23.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:34:23 smithi086 bash[24289]: audit 2024-09-16T10:34:22.558706+0000 mgr.a (mgr.14373) 12857 : audit [DBG] from='client.280065 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:34:23.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:34:23 smithi047 bash[22744]: audit 2024-09-16T10:34:22.558706+0000 mgr.a (mgr.14373) 12857 : audit [DBG] from='client.280065 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:34:24.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:34:24 smithi157 bash[24585]: cluster 2024-09-16T10:34:24.432797+0000 mgr.a (mgr.14373) 12858 : cluster [DBG] pgmap v8916: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T10:34:24.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:34:24 smithi086 bash[24289]: cluster 2024-09-16T10:34:24.432797+0000 mgr.a (mgr.14373) 12858 : cluster [DBG] pgmap v8916: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T10:34:24.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:34:24 smithi047 bash[22744]: cluster 2024-09-16T10:34:24.432797+0000 mgr.a (mgr.14373) 12858 : cluster [DBG] pgmap v8916: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T10:34:26.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:34:26 smithi157 bash[24585]: cluster 2024-09-16T10:34:26.433751+0000 mgr.a (mgr.14373) 12859 : cluster [DBG] pgmap v8917: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T10:34:26.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:34:26 smithi086 bash[24289]: cluster 2024-09-16T10:34:26.433751+0000 mgr.a (mgr.14373) 12859 : cluster [DBG] pgmap v8917: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T10:34:26.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:34:26 smithi047 bash[22744]: cluster 2024-09-16T10:34:26.433751+0000 mgr.a (mgr.14373) 12859 : cluster [DBG] pgmap v8917: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T10:34:27.983 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:34:27.984 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:34:27.984 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:34:28.772 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:34:28.773 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:34:28.773 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:34:28.773 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:34:28.773 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:34:28.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:34:28 smithi157 bash[24585]: audit 2024-09-16T10:34:28.324460+0000 mgr.a (mgr.14373) 12860 : audit [DBG] from='client.280140 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:34:28.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:34:28 smithi157 bash[24585]: cluster 2024-09-16T10:34:28.435095+0000 mgr.a (mgr.14373) 12861 : cluster [DBG] pgmap v8918: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:34:28.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:34:28 smithi086 bash[24289]: audit 2024-09-16T10:34:28.324460+0000 mgr.a (mgr.14373) 12860 : audit [DBG] from='client.280140 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:34:28.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:34:28 smithi086 bash[24289]: cluster 2024-09-16T10:34:28.435095+0000 mgr.a (mgr.14373) 12861 : cluster [DBG] pgmap v8918: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:34:28.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:34:28 smithi047 bash[22744]: audit 2024-09-16T10:34:28.324460+0000 mgr.a (mgr.14373) 12860 : audit [DBG] from='client.280140 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:34:28.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:34:28 smithi047 bash[22744]: cluster 2024-09-16T10:34:28.435095+0000 mgr.a (mgr.14373) 12861 : cluster [DBG] pgmap v8918: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:34:30.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:34:30 smithi157 bash[24585]: cluster 2024-09-16T10:34:30.435939+0000 mgr.a (mgr.14373) 12862 : cluster [DBG] pgmap v8919: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 4.6 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-16T10:34:30.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:34:30 smithi086 bash[24289]: cluster 2024-09-16T10:34:30.435939+0000 mgr.a (mgr.14373) 12862 : cluster [DBG] pgmap v8919: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 4.6 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-16T10:34:30.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:34:30 smithi047 bash[22744]: cluster 2024-09-16T10:34:30.435939+0000 mgr.a (mgr.14373) 12862 : cluster [DBG] pgmap v8919: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 4.6 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-16T10:34:32.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:34:32 smithi157 bash[24585]: cluster 2024-09-16T10:34:32.438102+0000 mgr.a (mgr.14373) 12863 : cluster [DBG] pgmap v8920: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 5.5 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-16T10:34:32.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:34:32 smithi086 bash[24289]: cluster 2024-09-16T10:34:32.438102+0000 mgr.a (mgr.14373) 12863 : cluster [DBG] pgmap v8920: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 5.5 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-16T10:34:32.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:34:32 smithi047 bash[22744]: cluster 2024-09-16T10:34:32.438102+0000 mgr.a (mgr.14373) 12863 : cluster [DBG] pgmap v8920: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 5.5 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-16T10:34:33.774 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:34:33.775 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:34:33.775 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:34:34.563 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:34:34.564 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:34:34.564 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:34:34.564 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:34:34.564 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:34:34.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:34:34 smithi157 bash[24585]: audit 2024-09-16T10:34:34.108775+0000 mgr.a (mgr.14373) 12864 : audit [DBG] from='client.280218 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:34:34.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:34:34 smithi157 bash[24585]: cluster 2024-09-16T10:34:34.438708+0000 mgr.a (mgr.14373) 12865 : cluster [DBG] pgmap v8921: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:34:34.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:34:34 smithi086 bash[24289]: audit 2024-09-16T10:34:34.108775+0000 mgr.a (mgr.14373) 12864 : audit [DBG] from='client.280218 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:34:34.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:34:34 smithi086 bash[24289]: cluster 2024-09-16T10:34:34.438708+0000 mgr.a (mgr.14373) 12865 : cluster [DBG] pgmap v8921: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:34:34.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:34:34 smithi047 bash[22744]: audit 2024-09-16T10:34:34.108775+0000 mgr.a (mgr.14373) 12864 : audit [DBG] from='client.280218 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:34:34.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:34:34 smithi047 bash[22744]: cluster 2024-09-16T10:34:34.438708+0000 mgr.a (mgr.14373) 12865 : cluster [DBG] pgmap v8921: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:34:36.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:34:36 smithi157 bash[24585]: cluster 2024-09-16T10:34:36.439574+0000 mgr.a (mgr.14373) 12866 : cluster [DBG] pgmap v8922: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:34:36.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:34:36 smithi086 bash[24289]: cluster 2024-09-16T10:34:36.439574+0000 mgr.a (mgr.14373) 12866 : cluster [DBG] pgmap v8922: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:34:36.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:34:36 smithi047 bash[22744]: cluster 2024-09-16T10:34:36.439574+0000 mgr.a (mgr.14373) 12866 : cluster [DBG] pgmap v8922: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:34:38.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:34:38 smithi157 bash[24585]: cluster 2024-09-16T10:34:38.441835+0000 mgr.a (mgr.14373) 12867 : cluster [DBG] pgmap v8923: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:34:38.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:34:38 smithi086 bash[24289]: cluster 2024-09-16T10:34:38.441835+0000 mgr.a (mgr.14373) 12867 : cluster [DBG] pgmap v8923: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:34:38.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:34:38 smithi047 bash[22744]: cluster 2024-09-16T10:34:38.441835+0000 mgr.a (mgr.14373) 12867 : cluster [DBG] pgmap v8923: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:34:39.565 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:34:39.566 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:34:39.566 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:34:40.322 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:34:40.322 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:34:40.323 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:34:40.323 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:34:40.323 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:34:40.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:34:40 smithi157 bash[24585]: audit 2024-09-16T10:34:39.890905+0000 mgr.a (mgr.14373) 12868 : audit [DBG] from='client.280296 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:34:40.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:34:40 smithi157 bash[24585]: cluster 2024-09-16T10:34:40.442760+0000 mgr.a (mgr.14373) 12869 : cluster [DBG] pgmap v8924: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:34:40.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:34:40 smithi086 bash[24289]: audit 2024-09-16T10:34:39.890905+0000 mgr.a (mgr.14373) 12868 : audit [DBG] from='client.280296 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:34:40.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:34:40 smithi086 bash[24289]: cluster 2024-09-16T10:34:40.442760+0000 mgr.a (mgr.14373) 12869 : cluster [DBG] pgmap v8924: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:34:40.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:34:40 smithi047 bash[22744]: audit 2024-09-16T10:34:39.890905+0000 mgr.a (mgr.14373) 12868 : audit [DBG] from='client.280296 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:34:40.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:34:40 smithi047 bash[22744]: cluster 2024-09-16T10:34:40.442760+0000 mgr.a (mgr.14373) 12869 : cluster [DBG] pgmap v8924: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:34:42.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:34:42 smithi157 bash[24585]: cluster 2024-09-16T10:34:42.444894+0000 mgr.a (mgr.14373) 12870 : cluster [DBG] pgmap v8925: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:34:42.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:34:42 smithi086 bash[24289]: cluster 2024-09-16T10:34:42.444894+0000 mgr.a (mgr.14373) 12870 : cluster [DBG] pgmap v8925: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:34:42.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:34:42 smithi047 bash[22744]: cluster 2024-09-16T10:34:42.444894+0000 mgr.a (mgr.14373) 12870 : cluster [DBG] pgmap v8925: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:34:44.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:34:44 smithi157 bash[24585]: cluster 2024-09-16T10:34:44.445632+0000 mgr.a (mgr.14373) 12871 : cluster [DBG] pgmap v8926: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:34:44.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:34:44 smithi086 bash[24289]: cluster 2024-09-16T10:34:44.445632+0000 mgr.a (mgr.14373) 12871 : cluster [DBG] pgmap v8926: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:34:44.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:34:44 smithi047 bash[22744]: cluster 2024-09-16T10:34:44.445632+0000 mgr.a (mgr.14373) 12871 : cluster [DBG] pgmap v8926: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:34:45.324 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:34:45.325 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:34:45.325 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:34:46.103 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:34:46.103 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:34:46.104 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:34:46.104 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:34:46.104 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:34:46.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:34:46 smithi157 bash[24585]: audit 2024-09-16T10:34:45.663850+0000 mgr.a (mgr.14373) 12872 : audit [DBG] from='client.280371 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:34:46.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:34:46 smithi157 bash[24585]: cluster 2024-09-16T10:34:46.446540+0000 mgr.a (mgr.14373) 12873 : cluster [DBG] pgmap v8927: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:34:46.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:34:46 smithi086 bash[24289]: audit 2024-09-16T10:34:45.663850+0000 mgr.a (mgr.14373) 12872 : audit [DBG] from='client.280371 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:34:46.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:34:46 smithi086 bash[24289]: cluster 2024-09-16T10:34:46.446540+0000 mgr.a (mgr.14373) 12873 : cluster [DBG] pgmap v8927: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:34:46.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:34:46 smithi047 bash[22744]: audit 2024-09-16T10:34:45.663850+0000 mgr.a (mgr.14373) 12872 : audit [DBG] from='client.280371 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:34:46.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:34:46 smithi047 bash[22744]: cluster 2024-09-16T10:34:46.446540+0000 mgr.a (mgr.14373) 12873 : cluster [DBG] pgmap v8927: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:34:48.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:34:48 smithi157 bash[24585]: cluster 2024-09-16T10:34:48.448776+0000 mgr.a (mgr.14373) 12874 : cluster [DBG] pgmap v8928: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:34:48.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:34:48 smithi086 bash[24289]: cluster 2024-09-16T10:34:48.448776+0000 mgr.a (mgr.14373) 12874 : cluster [DBG] pgmap v8928: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:34:48.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:34:48 smithi047 bash[22744]: cluster 2024-09-16T10:34:48.448776+0000 mgr.a (mgr.14373) 12874 : cluster [DBG] pgmap v8928: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:34:50.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:34:50 smithi157 bash[24585]: cluster 2024-09-16T10:34:50.449537+0000 mgr.a (mgr.14373) 12875 : cluster [DBG] pgmap v8929: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:34:50.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:34:50 smithi086 bash[24289]: cluster 2024-09-16T10:34:50.449537+0000 mgr.a (mgr.14373) 12875 : cluster [DBG] pgmap v8929: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:34:50.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:34:50 smithi047 bash[22744]: cluster 2024-09-16T10:34:50.449537+0000 mgr.a (mgr.14373) 12875 : cluster [DBG] pgmap v8929: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:34:51.105 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:34:51.106 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:34:51.106 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:34:51.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:34:51 smithi157 bash[24585]: audit 2024-09-16T10:34:51.436926+0000 mgr.a (mgr.14373) 12876 : audit [DBG] from='client.280449 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:34:51.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:34:51 smithi086 bash[24289]: audit 2024-09-16T10:34:51.436926+0000 mgr.a (mgr.14373) 12876 : audit [DBG] from='client.280449 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:34:51.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:34:51 smithi047 bash[22744]: audit 2024-09-16T10:34:51.436926+0000 mgr.a (mgr.14373) 12876 : audit [DBG] from='client.280449 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:34:51.849 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:34:51.850 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:34:51.850 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:34:51.850 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:34:51.850 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:34:52.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:34:52 smithi157 bash[24585]: cluster 2024-09-16T10:34:52.452426+0000 mgr.a (mgr.14373) 12877 : cluster [DBG] pgmap v8930: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:34:52.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:34:52 smithi086 bash[24289]: cluster 2024-09-16T10:34:52.452426+0000 mgr.a (mgr.14373) 12877 : cluster [DBG] pgmap v8930: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:34:52.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:34:52 smithi047 bash[22744]: cluster 2024-09-16T10:34:52.452426+0000 mgr.a (mgr.14373) 12877 : cluster [DBG] pgmap v8930: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:34:54.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:34:54 smithi157 bash[24585]: cluster 2024-09-16T10:34:54.453234+0000 mgr.a (mgr.14373) 12878 : cluster [DBG] pgmap v8931: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:34:54.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:34:54 smithi086 bash[24289]: cluster 2024-09-16T10:34:54.453234+0000 mgr.a (mgr.14373) 12878 : cluster [DBG] pgmap v8931: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:34:54.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:34:54 smithi047 bash[22744]: cluster 2024-09-16T10:34:54.453234+0000 mgr.a (mgr.14373) 12878 : cluster [DBG] pgmap v8931: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:34:56.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:34:56 smithi157 bash[24585]: cluster 2024-09-16T10:34:56.454012+0000 mgr.a (mgr.14373) 12879 : cluster [DBG] pgmap v8932: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T10:34:56.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:34:56 smithi086 bash[24289]: cluster 2024-09-16T10:34:56.454012+0000 mgr.a (mgr.14373) 12879 : cluster [DBG] pgmap v8932: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T10:34:56.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:34:56 smithi047 bash[22744]: cluster 2024-09-16T10:34:56.454012+0000 mgr.a (mgr.14373) 12879 : cluster [DBG] pgmap v8932: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T10:34:56.851 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:34:56.852 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:34:56.852 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:34:57.614 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:34:57.615 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:34:57.615 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:34:57.615 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:34:57.615 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:34:57.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:34:57 smithi157 bash[24585]: audit 2024-09-16T10:34:57.183160+0000 mgr.a (mgr.14373) 12880 : audit [DBG] from='client.280527 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:34:57.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:34:57 smithi086 bash[24289]: audit 2024-09-16T10:34:57.183160+0000 mgr.a (mgr.14373) 12880 : audit [DBG] from='client.280527 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:34:57.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:34:57 smithi047 bash[22744]: audit 2024-09-16T10:34:57.183160+0000 mgr.a (mgr.14373) 12880 : audit [DBG] from='client.280527 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:34:58.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:34:58 smithi157 bash[24585]: cluster 2024-09-16T10:34:58.456890+0000 mgr.a (mgr.14373) 12881 : cluster [DBG] pgmap v8933: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:34:58.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:34:58 smithi086 bash[24289]: cluster 2024-09-16T10:34:58.456890+0000 mgr.a (mgr.14373) 12881 : cluster [DBG] pgmap v8933: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:34:58.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:34:58 smithi047 bash[22744]: cluster 2024-09-16T10:34:58.456890+0000 mgr.a (mgr.14373) 12881 : cluster [DBG] pgmap v8933: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:35:00.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:35:00 smithi157 bash[24585]: cluster 2024-09-16T10:35:00.457701+0000 mgr.a (mgr.14373) 12882 : cluster [DBG] pgmap v8934: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:35:00.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:35:00 smithi086 bash[24289]: cluster 2024-09-16T10:35:00.457701+0000 mgr.a (mgr.14373) 12882 : cluster [DBG] pgmap v8934: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:35:00.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:35:00 smithi047 bash[22744]: cluster 2024-09-16T10:35:00.457701+0000 mgr.a (mgr.14373) 12882 : cluster [DBG] pgmap v8934: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:35:02.616 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:35:02.617 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:35:02.617 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:35:02.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:35:02 smithi157 bash[24585]: cluster 2024-09-16T10:35:02.459682+0000 mgr.a (mgr.14373) 12883 : cluster [DBG] pgmap v8935: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:35:02.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:35:02 smithi086 bash[24289]: cluster 2024-09-16T10:35:02.459682+0000 mgr.a (mgr.14373) 12883 : cluster [DBG] pgmap v8935: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:35:02.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:35:02 smithi047 bash[22744]: cluster 2024-09-16T10:35:02.459682+0000 mgr.a (mgr.14373) 12883 : cluster [DBG] pgmap v8935: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:35:03.365 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:35:03.365 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:35:03.365 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:35:03.365 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:35:03.365 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:35:03.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:35:03 smithi157 bash[24585]: audit 2024-09-16T10:35:02.947440+0000 mgr.a (mgr.14373) 12884 : audit [DBG] from='client.280602 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:35:03.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:35:03 smithi086 bash[24289]: audit 2024-09-16T10:35:02.947440+0000 mgr.a (mgr.14373) 12884 : audit [DBG] from='client.280602 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:35:03.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:35:03 smithi047 bash[22744]: audit 2024-09-16T10:35:02.947440+0000 mgr.a (mgr.14373) 12884 : audit [DBG] from='client.280602 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:35:04.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:35:04 smithi157 bash[24585]: cluster 2024-09-16T10:35:04.460836+0000 mgr.a (mgr.14373) 12885 : cluster [DBG] pgmap v8936: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:35:04.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:35:04 smithi086 bash[24289]: cluster 2024-09-16T10:35:04.460836+0000 mgr.a (mgr.14373) 12885 : cluster [DBG] pgmap v8936: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:35:04.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:35:04 smithi047 bash[22744]: cluster 2024-09-16T10:35:04.460836+0000 mgr.a (mgr.14373) 12885 : cluster [DBG] pgmap v8936: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:35:06.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:35:06 smithi157 bash[24585]: cluster 2024-09-16T10:35:06.461819+0000 mgr.a (mgr.14373) 12886 : cluster [DBG] pgmap v8937: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:35:06.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:35:06 smithi086 bash[24289]: cluster 2024-09-16T10:35:06.461819+0000 mgr.a (mgr.14373) 12886 : cluster [DBG] pgmap v8937: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:35:06.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:35:06 smithi047 bash[22744]: cluster 2024-09-16T10:35:06.461819+0000 mgr.a (mgr.14373) 12886 : cluster [DBG] pgmap v8937: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:35:08.366 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:35:08.367 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:35:08.367 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:35:09.149 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:35:09.149 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:35:09.149 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:35:09.149 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:35:09.149 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:35:09.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:35:09 smithi157 bash[24585]: cluster 2024-09-16T10:35:08.463244+0000 mgr.a (mgr.14373) 12887 : cluster [DBG] pgmap v8938: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:35:09.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:35:09 smithi157 bash[24585]: audit 2024-09-16T10:35:08.701318+0000 mgr.a (mgr.14373) 12888 : audit [DBG] from='client.280680 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:35:09.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:35:09 smithi086 bash[24289]: cluster 2024-09-16T10:35:08.463244+0000 mgr.a (mgr.14373) 12887 : cluster [DBG] pgmap v8938: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:35:09.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:35:09 smithi086 bash[24289]: audit 2024-09-16T10:35:08.701318+0000 mgr.a (mgr.14373) 12888 : audit [DBG] from='client.280680 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:35:09.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:35:09 smithi047 bash[22744]: cluster 2024-09-16T10:35:08.463244+0000 mgr.a (mgr.14373) 12887 : cluster [DBG] pgmap v8938: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:35:09.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:35:09 smithi047 bash[22744]: audit 2024-09-16T10:35:08.701318+0000 mgr.a (mgr.14373) 12888 : audit [DBG] from='client.280680 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:35:11.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:35:11 smithi157 bash[24585]: cluster 2024-09-16T10:35:10.464197+0000 mgr.a (mgr.14373) 12889 : cluster [DBG] pgmap v8939: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:35:11.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:35:11 smithi086 bash[24289]: cluster 2024-09-16T10:35:10.464197+0000 mgr.a (mgr.14373) 12889 : cluster [DBG] pgmap v8939: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:35:11.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:35:11 smithi047 bash[22744]: cluster 2024-09-16T10:35:10.464197+0000 mgr.a (mgr.14373) 12889 : cluster [DBG] pgmap v8939: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:35:13.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:35:13 smithi157 bash[24585]: cluster 2024-09-16T10:35:12.466413+0000 mgr.a (mgr.14373) 12890 : cluster [DBG] pgmap v8940: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:35:13.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:35:13 smithi086 bash[24289]: cluster 2024-09-16T10:35:12.466413+0000 mgr.a (mgr.14373) 12890 : cluster [DBG] pgmap v8940: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:35:13.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:35:13 smithi047 bash[22744]: cluster 2024-09-16T10:35:12.466413+0000 mgr.a (mgr.14373) 12890 : cluster [DBG] pgmap v8940: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:35:14.150 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:35:14.151 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:35:14.151 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:35:14.912 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:35:14.912 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:35:14.912 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:35:14.912 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:35:14.912 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:35:15.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:35:15 smithi157 bash[24585]: cluster 2024-09-16T10:35:14.467138+0000 mgr.a (mgr.14373) 12891 : cluster [DBG] pgmap v8941: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:35:15.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:35:15 smithi157 bash[24585]: audit 2024-09-16T10:35:14.482104+0000 mgr.a (mgr.14373) 12892 : audit [DBG] from='client.280758 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:35:15.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:35:15 smithi086 bash[24289]: cluster 2024-09-16T10:35:14.467138+0000 mgr.a (mgr.14373) 12891 : cluster [DBG] pgmap v8941: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:35:15.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:35:15 smithi086 bash[24289]: audit 2024-09-16T10:35:14.482104+0000 mgr.a (mgr.14373) 12892 : audit [DBG] from='client.280758 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:35:15.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:35:15 smithi047 bash[22744]: cluster 2024-09-16T10:35:14.467138+0000 mgr.a (mgr.14373) 12891 : cluster [DBG] pgmap v8941: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:35:15.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:35:15 smithi047 bash[22744]: audit 2024-09-16T10:35:14.482104+0000 mgr.a (mgr.14373) 12892 : audit [DBG] from='client.280758 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:35:17.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:35:17 smithi157 bash[24585]: cluster 2024-09-16T10:35:16.468087+0000 mgr.a (mgr.14373) 12893 : cluster [DBG] pgmap v8942: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:35:17.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:35:17 smithi157 bash[24585]: audit 2024-09-16T10:35:16.733111+0000 mon.b (mon.2) 1182 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T10:35:17.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:35:17 smithi086 bash[24289]: cluster 2024-09-16T10:35:16.468087+0000 mgr.a (mgr.14373) 12893 : cluster [DBG] pgmap v8942: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:35:17.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:35:17 smithi086 bash[24289]: audit 2024-09-16T10:35:16.733111+0000 mon.b (mon.2) 1182 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T10:35:17.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:35:17 smithi047 bash[22744]: cluster 2024-09-16T10:35:16.468087+0000 mgr.a (mgr.14373) 12893 : cluster [DBG] pgmap v8942: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:35:17.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:35:17 smithi047 bash[22744]: audit 2024-09-16T10:35:16.733111+0000 mon.b (mon.2) 1182 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T10:35:18.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:35:18 smithi157 bash[24585]: audit 2024-09-16T10:35:17.580090+0000 mon.b (mon.2) 1183 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T10:35:18.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:35:18 smithi157 bash[24585]: audit 2024-09-16T10:35:17.582252+0000 mon.b (mon.2) 1184 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T10:35:18.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:35:18 smithi157 bash[24585]: audit 2024-09-16T10:35:17.591663+0000 mon.a (mon.0) 1335 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:35:18.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:35:18 smithi157 bash[24585]: audit 2024-09-16T10:35:17.596450+0000 mon.b (mon.2) 1185 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:35:18.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:35:18 smithi157 bash[24585]: audit 2024-09-16T10:35:17.599182+0000 mgr.a (mgr.14373) 12894 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:35:18.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:35:18 smithi157 bash[24585]: audit 2024-09-16T10:35:18.350977+0000 mgr.a (mgr.14373) 12895 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T10:35:18.808 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:35:18 smithi157 bash[24585]: cephadm 2024-09-16T10:35:18.352995+0000 mgr.a (mgr.14373) 12896 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T10:35:18.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:35:18 smithi086 bash[24289]: audit 2024-09-16T10:35:17.580090+0000 mon.b (mon.2) 1183 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T10:35:18.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:35:18 smithi086 bash[24289]: audit 2024-09-16T10:35:17.582252+0000 mon.b (mon.2) 1184 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T10:35:18.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:35:18 smithi086 bash[24289]: audit 2024-09-16T10:35:17.591663+0000 mon.a (mon.0) 1335 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:35:18.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:35:18 smithi086 bash[24289]: audit 2024-09-16T10:35:17.596450+0000 mon.b (mon.2) 1185 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:35:18.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:35:18 smithi086 bash[24289]: audit 2024-09-16T10:35:17.599182+0000 mgr.a (mgr.14373) 12894 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:35:18.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:35:18 smithi086 bash[24289]: audit 2024-09-16T10:35:18.350977+0000 mgr.a (mgr.14373) 12895 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T10:35:18.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:35:18 smithi086 bash[24289]: cephadm 2024-09-16T10:35:18.352995+0000 mgr.a (mgr.14373) 12896 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T10:35:18.842 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 10:35:18 smithi047 bash[22994]: debug 2024-09-16T10:35:18.348+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T10:35:18.843 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 10:35:18 smithi047 bash[22994]: debug 2024-09-16T10:35:18.348+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T10:35:18.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:35:18 smithi047 bash[22744]: audit 2024-09-16T10:35:17.580090+0000 mon.b (mon.2) 1183 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T10:35:18.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:35:18 smithi047 bash[22744]: audit 2024-09-16T10:35:17.582252+0000 mon.b (mon.2) 1184 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T10:35:18.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:35:18 smithi047 bash[22744]: audit 2024-09-16T10:35:17.591663+0000 mon.a (mon.0) 1335 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:35:18.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:35:18 smithi047 bash[22744]: audit 2024-09-16T10:35:17.596450+0000 mon.b (mon.2) 1185 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:35:18.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:35:18 smithi047 bash[22744]: audit 2024-09-16T10:35:17.599182+0000 mgr.a (mgr.14373) 12894 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:35:18.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:35:18 smithi047 bash[22744]: audit 2024-09-16T10:35:18.350977+0000 mgr.a (mgr.14373) 12895 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T10:35:18.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:35:18 smithi047 bash[22744]: cephadm 2024-09-16T10:35:18.352995+0000 mgr.a (mgr.14373) 12896 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T10:35:19.913 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:35:19.914 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:35:19.914 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:35:20.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:35:19 smithi157 bash[24585]: cluster 2024-09-16T10:35:18.470785+0000 mgr.a (mgr.14373) 12897 : cluster [DBG] pgmap v8943: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:35:20.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:35:19 smithi086 bash[24289]: cluster 2024-09-16T10:35:18.470785+0000 mgr.a (mgr.14373) 12897 : cluster [DBG] pgmap v8943: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:35:20.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:35:19 smithi047 bash[22744]: cluster 2024-09-16T10:35:18.470785+0000 mgr.a (mgr.14373) 12897 : cluster [DBG] pgmap v8943: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:35:20.663 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:35:20.664 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:35:20.664 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:35:20.664 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:35:20.664 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:35:21.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:35:20 smithi157 bash[24585]: audit 2024-09-16T10:35:20.239907+0000 mgr.a (mgr.14373) 12898 : audit [DBG] from='client.280935 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:35:21.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:35:20 smithi086 bash[24289]: audit 2024-09-16T10:35:20.239907+0000 mgr.a (mgr.14373) 12898 : audit [DBG] from='client.280935 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:35:21.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:35:20 smithi047 bash[22744]: audit 2024-09-16T10:35:20.239907+0000 mgr.a (mgr.14373) 12898 : audit [DBG] from='client.280935 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:35:22.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:35:21 smithi157 bash[24585]: cluster 2024-09-16T10:35:20.471483+0000 mgr.a (mgr.14373) 12899 : cluster [DBG] pgmap v8944: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:35:22.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:35:21 smithi086 bash[24289]: cluster 2024-09-16T10:35:20.471483+0000 mgr.a (mgr.14373) 12899 : cluster [DBG] pgmap v8944: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:35:22.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:35:21 smithi047 bash[22744]: cluster 2024-09-16T10:35:20.471483+0000 mgr.a (mgr.14373) 12899 : cluster [DBG] pgmap v8944: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:35:24.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:35:23 smithi157 bash[24585]: cluster 2024-09-16T10:35:22.473811+0000 mgr.a (mgr.14373) 12900 : cluster [DBG] pgmap v8945: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:35:24.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:35:23 smithi086 bash[24289]: cluster 2024-09-16T10:35:22.473811+0000 mgr.a (mgr.14373) 12900 : cluster [DBG] pgmap v8945: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:35:24.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:35:23 smithi047 bash[22744]: cluster 2024-09-16T10:35:22.473811+0000 mgr.a (mgr.14373) 12900 : cluster [DBG] pgmap v8945: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:35:25.665 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:35:25.666 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:35:25.666 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:35:26.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:35:25 smithi157 bash[24585]: cluster 2024-09-16T10:35:24.474638+0000 mgr.a (mgr.14373) 12901 : cluster [DBG] pgmap v8946: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:35:26.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:35:25 smithi086 bash[24289]: cluster 2024-09-16T10:35:24.474638+0000 mgr.a (mgr.14373) 12901 : cluster [DBG] pgmap v8946: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:35:26.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:35:25 smithi047 bash[22744]: cluster 2024-09-16T10:35:24.474638+0000 mgr.a (mgr.14373) 12901 : cluster [DBG] pgmap v8946: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:35:26.421 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:35:26.422 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:35:26.422 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:35:26.422 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:35:26.422 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:35:27.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:35:26 smithi157 bash[24585]: audit 2024-09-16T10:35:25.994759+0000 mgr.a (mgr.14373) 12902 : audit [DBG] from='client.281013 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:35:27.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:35:26 smithi086 bash[24289]: audit 2024-09-16T10:35:25.994759+0000 mgr.a (mgr.14373) 12902 : audit [DBG] from='client.281013 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:35:27.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:35:26 smithi047 bash[22744]: audit 2024-09-16T10:35:25.994759+0000 mgr.a (mgr.14373) 12902 : audit [DBG] from='client.281013 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:35:28.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:35:27 smithi157 bash[24585]: cluster 2024-09-16T10:35:26.475301+0000 mgr.a (mgr.14373) 12903 : cluster [DBG] pgmap v8947: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:35:28.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:35:27 smithi086 bash[24289]: cluster 2024-09-16T10:35:26.475301+0000 mgr.a (mgr.14373) 12903 : cluster [DBG] pgmap v8947: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:35:28.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:35:27 smithi047 bash[22744]: cluster 2024-09-16T10:35:26.475301+0000 mgr.a (mgr.14373) 12903 : cluster [DBG] pgmap v8947: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:35:30.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:35:29 smithi157 bash[24585]: cluster 2024-09-16T10:35:28.477487+0000 mgr.a (mgr.14373) 12904 : cluster [DBG] pgmap v8948: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:35:30.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:35:29 smithi086 bash[24289]: cluster 2024-09-16T10:35:28.477487+0000 mgr.a (mgr.14373) 12904 : cluster [DBG] pgmap v8948: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:35:30.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:35:29 smithi047 bash[22744]: cluster 2024-09-16T10:35:28.477487+0000 mgr.a (mgr.14373) 12904 : cluster [DBG] pgmap v8948: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:35:31.423 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:35:31.424 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:35:31.424 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:35:32.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:35:31 smithi157 bash[24585]: cluster 2024-09-16T10:35:30.478298+0000 mgr.a (mgr.14373) 12905 : cluster [DBG] pgmap v8949: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:35:32.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:35:31 smithi086 bash[24289]: cluster 2024-09-16T10:35:30.478298+0000 mgr.a (mgr.14373) 12905 : cluster [DBG] pgmap v8949: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:35:32.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:35:31 smithi047 bash[22744]: cluster 2024-09-16T10:35:30.478298+0000 mgr.a (mgr.14373) 12905 : cluster [DBG] pgmap v8949: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:35:32.191 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:35:32.191 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:35:32.191 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:35:32.191 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:35:32.191 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:35:33.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:35:32 smithi157 bash[24585]: audit 2024-09-16T10:35:31.759906+0000 mgr.a (mgr.14373) 12906 : audit [DBG] from='client.281088 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:35:33.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:35:32 smithi086 bash[24289]: audit 2024-09-16T10:35:31.759906+0000 mgr.a (mgr.14373) 12906 : audit [DBG] from='client.281088 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:35:33.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:35:32 smithi047 bash[22744]: audit 2024-09-16T10:35:31.759906+0000 mgr.a (mgr.14373) 12906 : audit [DBG] from='client.281088 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:35:34.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:35:33 smithi157 bash[24585]: cluster 2024-09-16T10:35:32.481073+0000 mgr.a (mgr.14373) 12907 : cluster [DBG] pgmap v8950: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:35:34.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:35:33 smithi086 bash[24289]: cluster 2024-09-16T10:35:32.481073+0000 mgr.a (mgr.14373) 12907 : cluster [DBG] pgmap v8950: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:35:34.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:35:33 smithi047 bash[22744]: cluster 2024-09-16T10:35:32.481073+0000 mgr.a (mgr.14373) 12907 : cluster [DBG] pgmap v8950: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:35:36.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:35:35 smithi157 bash[24585]: cluster 2024-09-16T10:35:34.481836+0000 mgr.a (mgr.14373) 12908 : cluster [DBG] pgmap v8951: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:35:36.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:35:35 smithi086 bash[24289]: cluster 2024-09-16T10:35:34.481836+0000 mgr.a (mgr.14373) 12908 : cluster [DBG] pgmap v8951: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:35:36.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:35:35 smithi047 bash[22744]: cluster 2024-09-16T10:35:34.481836+0000 mgr.a (mgr.14373) 12908 : cluster [DBG] pgmap v8951: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:35:37.192 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:35:37.193 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:35:37.193 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:35:37.948 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:35:37.949 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:35:37.949 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:35:37.949 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:35:37.949 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:35:38.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:35:37 smithi157 bash[24585]: cluster 2024-09-16T10:35:36.482613+0000 mgr.a (mgr.14373) 12909 : cluster [DBG] pgmap v8952: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T10:35:38.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:35:37 smithi086 bash[24289]: cluster 2024-09-16T10:35:36.482613+0000 mgr.a (mgr.14373) 12909 : cluster [DBG] pgmap v8952: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T10:35:38.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:35:37 smithi047 bash[22744]: cluster 2024-09-16T10:35:36.482613+0000 mgr.a (mgr.14373) 12909 : cluster [DBG] pgmap v8952: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T10:35:39.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:35:38 smithi157 bash[24585]: audit 2024-09-16T10:35:37.523225+0000 mgr.a (mgr.14373) 12910 : audit [DBG] from='client.281166 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:35:39.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:35:38 smithi086 bash[24289]: audit 2024-09-16T10:35:37.523225+0000 mgr.a (mgr.14373) 12910 : audit [DBG] from='client.281166 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:35:39.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:35:38 smithi047 bash[22744]: audit 2024-09-16T10:35:37.523225+0000 mgr.a (mgr.14373) 12910 : audit [DBG] from='client.281166 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:35:40.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:35:39 smithi157 bash[24585]: cluster 2024-09-16T10:35:38.485359+0000 mgr.a (mgr.14373) 12911 : cluster [DBG] pgmap v8953: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:35:40.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:35:39 smithi086 bash[24289]: cluster 2024-09-16T10:35:38.485359+0000 mgr.a (mgr.14373) 12911 : cluster [DBG] pgmap v8953: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:35:40.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:35:39 smithi047 bash[22744]: cluster 2024-09-16T10:35:38.485359+0000 mgr.a (mgr.14373) 12911 : cluster [DBG] pgmap v8953: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:35:42.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:35:41 smithi157 bash[24585]: cluster 2024-09-16T10:35:40.486178+0000 mgr.a (mgr.14373) 12912 : cluster [DBG] pgmap v8954: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:35:42.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:35:41 smithi086 bash[24289]: cluster 2024-09-16T10:35:40.486178+0000 mgr.a (mgr.14373) 12912 : cluster [DBG] pgmap v8954: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:35:42.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:35:41 smithi047 bash[22744]: cluster 2024-09-16T10:35:40.486178+0000 mgr.a (mgr.14373) 12912 : cluster [DBG] pgmap v8954: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:35:42.950 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:35:42.951 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:35:42.951 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:35:43.733 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:35:43.734 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:35:43.734 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:35:43.734 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:35:43.734 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:35:44.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:35:43 smithi157 bash[24585]: cluster 2024-09-16T10:35:42.488200+0000 mgr.a (mgr.14373) 12913 : cluster [DBG] pgmap v8955: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:35:44.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:35:43 smithi157 bash[24585]: audit 2024-09-16T10:35:43.289083+0000 mgr.a (mgr.14373) 12914 : audit [DBG] from='client.281235 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:35:44.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:35:43 smithi086 bash[24289]: cluster 2024-09-16T10:35:42.488200+0000 mgr.a (mgr.14373) 12913 : cluster [DBG] pgmap v8955: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:35:44.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:35:43 smithi086 bash[24289]: audit 2024-09-16T10:35:43.289083+0000 mgr.a (mgr.14373) 12914 : audit [DBG] from='client.281235 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:35:44.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:35:43 smithi047 bash[22744]: cluster 2024-09-16T10:35:42.488200+0000 mgr.a (mgr.14373) 12913 : cluster [DBG] pgmap v8955: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:35:44.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:35:43 smithi047 bash[22744]: audit 2024-09-16T10:35:43.289083+0000 mgr.a (mgr.14373) 12914 : audit [DBG] from='client.281235 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:35:46.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:35:45 smithi157 bash[24585]: cluster 2024-09-16T10:35:44.489197+0000 mgr.a (mgr.14373) 12915 : cluster [DBG] pgmap v8956: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:35:46.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:35:45 smithi086 bash[24289]: cluster 2024-09-16T10:35:44.489197+0000 mgr.a (mgr.14373) 12915 : cluster [DBG] pgmap v8956: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:35:46.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:35:45 smithi047 bash[22744]: cluster 2024-09-16T10:35:44.489197+0000 mgr.a (mgr.14373) 12915 : cluster [DBG] pgmap v8956: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:35:48.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:35:47 smithi157 bash[24585]: cluster 2024-09-16T10:35:46.489987+0000 mgr.a (mgr.14373) 12916 : cluster [DBG] pgmap v8957: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:35:48.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:35:47 smithi086 bash[24289]: cluster 2024-09-16T10:35:46.489987+0000 mgr.a (mgr.14373) 12916 : cluster [DBG] pgmap v8957: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:35:48.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:35:47 smithi047 bash[22744]: cluster 2024-09-16T10:35:46.489987+0000 mgr.a (mgr.14373) 12916 : cluster [DBG] pgmap v8957: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:35:48.735 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:35:48.736 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:35:48.736 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:35:49.517 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:35:49.518 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:35:49.518 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:35:49.518 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:35:49.518 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:35:50.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:35:49 smithi157 bash[24585]: cluster 2024-09-16T10:35:48.492224+0000 mgr.a (mgr.14373) 12917 : cluster [DBG] pgmap v8958: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:35:50.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:35:49 smithi157 bash[24585]: audit 2024-09-16T10:35:49.072271+0000 mgr.a (mgr.14373) 12918 : audit [DBG] from='client.281313 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:35:50.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:35:49 smithi086 bash[24289]: cluster 2024-09-16T10:35:48.492224+0000 mgr.a (mgr.14373) 12917 : cluster [DBG] pgmap v8958: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:35:50.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:35:49 smithi086 bash[24289]: audit 2024-09-16T10:35:49.072271+0000 mgr.a (mgr.14373) 12918 : audit [DBG] from='client.281313 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:35:50.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:35:49 smithi047 bash[22744]: cluster 2024-09-16T10:35:48.492224+0000 mgr.a (mgr.14373) 12917 : cluster [DBG] pgmap v8958: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:35:50.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:35:49 smithi047 bash[22744]: audit 2024-09-16T10:35:49.072271+0000 mgr.a (mgr.14373) 12918 : audit [DBG] from='client.281313 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:35:52.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:35:51 smithi157 bash[24585]: cluster 2024-09-16T10:35:50.493339+0000 mgr.a (mgr.14373) 12919 : cluster [DBG] pgmap v8959: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:35:52.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:35:51 smithi086 bash[24289]: cluster 2024-09-16T10:35:50.493339+0000 mgr.a (mgr.14373) 12919 : cluster [DBG] pgmap v8959: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:35:52.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:35:51 smithi047 bash[22744]: cluster 2024-09-16T10:35:50.493339+0000 mgr.a (mgr.14373) 12919 : cluster [DBG] pgmap v8959: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:35:54.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:35:53 smithi157 bash[24585]: cluster 2024-09-16T10:35:52.495768+0000 mgr.a (mgr.14373) 12920 : cluster [DBG] pgmap v8960: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:35:54.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:35:53 smithi086 bash[24289]: cluster 2024-09-16T10:35:52.495768+0000 mgr.a (mgr.14373) 12920 : cluster [DBG] pgmap v8960: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:35:54.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:35:53 smithi047 bash[22744]: cluster 2024-09-16T10:35:52.495768+0000 mgr.a (mgr.14373) 12920 : cluster [DBG] pgmap v8960: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:35:54.519 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:35:54.520 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:35:54.520 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:35:55.262 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:35:55.262 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:35:55.262 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:35:55.262 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:35:55.262 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:35:56.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:35:55 smithi157 bash[24585]: cluster 2024-09-16T10:35:54.496697+0000 mgr.a (mgr.14373) 12921 : cluster [DBG] pgmap v8961: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:35:56.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:35:55 smithi157 bash[24585]: audit 2024-09-16T10:35:54.849882+0000 mgr.a (mgr.14373) 12922 : audit [DBG] from='client.281388 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:35:56.072 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:35:55 smithi086 bash[24289]: cluster 2024-09-16T10:35:54.496697+0000 mgr.a (mgr.14373) 12921 : cluster [DBG] pgmap v8961: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:35:56.072 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:35:55 smithi086 bash[24289]: audit 2024-09-16T10:35:54.849882+0000 mgr.a (mgr.14373) 12922 : audit [DBG] from='client.281388 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:35:56.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:35:55 smithi047 bash[22744]: cluster 2024-09-16T10:35:54.496697+0000 mgr.a (mgr.14373) 12921 : cluster [DBG] pgmap v8961: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:35:56.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:35:55 smithi047 bash[22744]: audit 2024-09-16T10:35:54.849882+0000 mgr.a (mgr.14373) 12922 : audit [DBG] from='client.281388 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:35:58.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:35:57 smithi157 bash[24585]: cluster 2024-09-16T10:35:56.497700+0000 mgr.a (mgr.14373) 12923 : cluster [DBG] pgmap v8962: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:35:58.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:35:57 smithi086 bash[24289]: cluster 2024-09-16T10:35:56.497700+0000 mgr.a (mgr.14373) 12923 : cluster [DBG] pgmap v8962: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:35:58.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:35:57 smithi047 bash[22744]: cluster 2024-09-16T10:35:56.497700+0000 mgr.a (mgr.14373) 12923 : cluster [DBG] pgmap v8962: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:36:00.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:35:59 smithi157 bash[24585]: cluster 2024-09-16T10:35:58.500059+0000 mgr.a (mgr.14373) 12924 : cluster [DBG] pgmap v8963: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:36:00.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:35:59 smithi086 bash[24289]: cluster 2024-09-16T10:35:58.500059+0000 mgr.a (mgr.14373) 12924 : cluster [DBG] pgmap v8963: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:36:00.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:35:59 smithi047 bash[22744]: cluster 2024-09-16T10:35:58.500059+0000 mgr.a (mgr.14373) 12924 : cluster [DBG] pgmap v8963: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:36:00.263 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:36:00.264 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:36:00.264 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:36:01.021 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:36:01.021 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:36:01.021 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:36:01.021 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:36:01.021 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:36:02.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:36:01 smithi157 bash[24585]: cluster 2024-09-16T10:36:00.500942+0000 mgr.a (mgr.14373) 12925 : cluster [DBG] pgmap v8964: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:36:02.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:36:01 smithi157 bash[24585]: audit 2024-09-16T10:36:00.596083+0000 mgr.a (mgr.14373) 12926 : audit [DBG] from='client.281463 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:36:02.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:36:01 smithi086 bash[24289]: cluster 2024-09-16T10:36:00.500942+0000 mgr.a (mgr.14373) 12925 : cluster [DBG] pgmap v8964: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:36:02.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:36:01 smithi086 bash[24289]: audit 2024-09-16T10:36:00.596083+0000 mgr.a (mgr.14373) 12926 : audit [DBG] from='client.281463 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:36:02.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:36:01 smithi047 bash[22744]: cluster 2024-09-16T10:36:00.500942+0000 mgr.a (mgr.14373) 12925 : cluster [DBG] pgmap v8964: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:36:02.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:36:01 smithi047 bash[22744]: audit 2024-09-16T10:36:00.596083+0000 mgr.a (mgr.14373) 12926 : audit [DBG] from='client.281463 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:36:04.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:36:03 smithi157 bash[24585]: cluster 2024-09-16T10:36:02.503365+0000 mgr.a (mgr.14373) 12927 : cluster [DBG] pgmap v8965: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:36:04.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:36:03 smithi086 bash[24289]: cluster 2024-09-16T10:36:02.503365+0000 mgr.a (mgr.14373) 12927 : cluster [DBG] pgmap v8965: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:36:04.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:36:03 smithi047 bash[22744]: cluster 2024-09-16T10:36:02.503365+0000 mgr.a (mgr.14373) 12927 : cluster [DBG] pgmap v8965: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:36:06.022 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:36:06.023 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:36:06.023 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:36:06.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:36:05 smithi157 bash[24585]: cluster 2024-09-16T10:36:04.504138+0000 mgr.a (mgr.14373) 12928 : cluster [DBG] pgmap v8966: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:36:06.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:36:05 smithi086 bash[24289]: cluster 2024-09-16T10:36:04.504138+0000 mgr.a (mgr.14373) 12928 : cluster [DBG] pgmap v8966: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:36:06.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:36:05 smithi047 bash[22744]: cluster 2024-09-16T10:36:04.504138+0000 mgr.a (mgr.14373) 12928 : cluster [DBG] pgmap v8966: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:36:06.769 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:36:06.770 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:36:06.770 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:36:06.770 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:36:06.770 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:36:07.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:36:06 smithi157 bash[24585]: audit 2024-09-16T10:36:06.350813+0000 mgr.a (mgr.14373) 12929 : audit [DBG] from='client.281535 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:36:07.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:36:06 smithi086 bash[24289]: audit 2024-09-16T10:36:06.350813+0000 mgr.a (mgr.14373) 12929 : audit [DBG] from='client.281535 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:36:07.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:36:06 smithi047 bash[22744]: audit 2024-09-16T10:36:06.350813+0000 mgr.a (mgr.14373) 12929 : audit [DBG] from='client.281535 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:36:08.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:36:07 smithi157 bash[24585]: cluster 2024-09-16T10:36:06.504660+0000 mgr.a (mgr.14373) 12930 : cluster [DBG] pgmap v8967: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:36:08.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:36:07 smithi086 bash[24289]: cluster 2024-09-16T10:36:06.504660+0000 mgr.a (mgr.14373) 12930 : cluster [DBG] pgmap v8967: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:36:08.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:36:07 smithi047 bash[22744]: cluster 2024-09-16T10:36:06.504660+0000 mgr.a (mgr.14373) 12930 : cluster [DBG] pgmap v8967: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:36:10.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:36:09 smithi157 bash[24585]: cluster 2024-09-16T10:36:08.507463+0000 mgr.a (mgr.14373) 12931 : cluster [DBG] pgmap v8968: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-16T10:36:10.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:36:09 smithi086 bash[24289]: cluster 2024-09-16T10:36:08.507463+0000 mgr.a (mgr.14373) 12931 : cluster [DBG] pgmap v8968: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-16T10:36:10.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:36:09 smithi047 bash[22744]: cluster 2024-09-16T10:36:08.507463+0000 mgr.a (mgr.14373) 12931 : cluster [DBG] pgmap v8968: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-16T10:36:11.771 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:36:11.772 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:36:11.772 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:36:12.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:36:11 smithi157 bash[24585]: cluster 2024-09-16T10:36:10.508301+0000 mgr.a (mgr.14373) 12932 : cluster [DBG] pgmap v8969: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-16T10:36:12.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:36:11 smithi086 bash[24289]: cluster 2024-09-16T10:36:10.508301+0000 mgr.a (mgr.14373) 12932 : cluster [DBG] pgmap v8969: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-16T10:36:12.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:36:11 smithi047 bash[22744]: cluster 2024-09-16T10:36:10.508301+0000 mgr.a (mgr.14373) 12932 : cluster [DBG] pgmap v8969: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-16T10:36:12.553 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:36:12.553 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:36:12.553 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:36:12.553 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:36:12.553 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:36:13.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:36:12 smithi157 bash[24585]: audit 2024-09-16T10:36:12.103816+0000 mgr.a (mgr.14373) 12933 : audit [DBG] from='client.281610 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:36:13.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:36:12 smithi086 bash[24289]: audit 2024-09-16T10:36:12.103816+0000 mgr.a (mgr.14373) 12933 : audit [DBG] from='client.281610 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:36:13.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:36:12 smithi047 bash[22744]: audit 2024-09-16T10:36:12.103816+0000 mgr.a (mgr.14373) 12933 : audit [DBG] from='client.281610 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:36:14.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:36:13 smithi157 bash[24585]: cluster 2024-09-16T10:36:12.509958+0000 mgr.a (mgr.14373) 12934 : cluster [DBG] pgmap v8970: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:36:14.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:36:13 smithi086 bash[24289]: cluster 2024-09-16T10:36:12.509958+0000 mgr.a (mgr.14373) 12934 : cluster [DBG] pgmap v8970: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:36:14.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:36:13 smithi047 bash[22744]: cluster 2024-09-16T10:36:12.509958+0000 mgr.a (mgr.14373) 12934 : cluster [DBG] pgmap v8970: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:36:16.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:36:15 smithi157 bash[24585]: cluster 2024-09-16T10:36:14.510717+0000 mgr.a (mgr.14373) 12935 : cluster [DBG] pgmap v8971: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:36:16.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:36:15 smithi086 bash[24289]: cluster 2024-09-16T10:36:14.510717+0000 mgr.a (mgr.14373) 12935 : cluster [DBG] pgmap v8971: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:36:16.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:36:15 smithi047 bash[22744]: cluster 2024-09-16T10:36:14.510717+0000 mgr.a (mgr.14373) 12935 : cluster [DBG] pgmap v8971: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:36:17.554 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:36:17.555 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:36:17.555 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:36:18.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:36:17 smithi157 bash[24585]: cluster 2024-09-16T10:36:16.511508+0000 mgr.a (mgr.14373) 12936 : cluster [DBG] pgmap v8972: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T10:36:18.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:36:17 smithi086 bash[24289]: cluster 2024-09-16T10:36:16.511508+0000 mgr.a (mgr.14373) 12936 : cluster [DBG] pgmap v8972: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T10:36:18.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:36:17 smithi047 bash[22744]: cluster 2024-09-16T10:36:16.511508+0000 mgr.a (mgr.14373) 12936 : cluster [DBG] pgmap v8972: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T10:36:18.332 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:36:18.333 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:36:18.333 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:36:18.333 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:36:18.333 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:36:19.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:36:18 smithi157 bash[24585]: audit 2024-09-16T10:36:17.892368+0000 mgr.a (mgr.14373) 12937 : audit [DBG] from='client.281688 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:36:19.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:36:18 smithi157 bash[24585]: audit 2024-09-16T10:36:18.404448+0000 mon.b (mon.2) 1186 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T10:36:19.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:36:18 smithi086 bash[24289]: audit 2024-09-16T10:36:17.892368+0000 mgr.a (mgr.14373) 12937 : audit [DBG] from='client.281688 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:36:19.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:36:18 smithi086 bash[24289]: audit 2024-09-16T10:36:18.404448+0000 mon.b (mon.2) 1186 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T10:36:19.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:36:18 smithi047 bash[22744]: audit 2024-09-16T10:36:17.892368+0000 mgr.a (mgr.14373) 12937 : audit [DBG] from='client.281688 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:36:19.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:36:18 smithi047 bash[22744]: audit 2024-09-16T10:36:18.404448+0000 mon.b (mon.2) 1186 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T10:36:20.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:36:19 smithi157 bash[24585]: cluster 2024-09-16T10:36:18.513157+0000 mgr.a (mgr.14373) 12938 : cluster [DBG] pgmap v8973: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:36:20.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:36:19 smithi157 bash[24585]: audit 2024-09-16T10:36:19.231720+0000 mon.b (mon.2) 1187 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T10:36:20.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:36:19 smithi157 bash[24585]: audit 2024-09-16T10:36:19.233352+0000 mon.b (mon.2) 1188 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T10:36:20.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:36:19 smithi157 bash[24585]: audit 2024-09-16T10:36:19.243003+0000 mon.a (mon.0) 1336 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:36:20.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:36:19 smithi157 bash[24585]: audit 2024-09-16T10:36:19.248090+0000 mon.b (mon.2) 1189 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:36:20.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:36:19 smithi157 bash[24585]: audit 2024-09-16T10:36:19.250744+0000 mgr.a (mgr.14373) 12939 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:36:20.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:36:19 smithi086 bash[24289]: cluster 2024-09-16T10:36:18.513157+0000 mgr.a (mgr.14373) 12938 : cluster [DBG] pgmap v8973: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:36:20.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:36:19 smithi086 bash[24289]: audit 2024-09-16T10:36:19.231720+0000 mon.b (mon.2) 1187 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T10:36:20.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:36:19 smithi086 bash[24289]: audit 2024-09-16T10:36:19.233352+0000 mon.b (mon.2) 1188 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T10:36:20.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:36:19 smithi086 bash[24289]: audit 2024-09-16T10:36:19.243003+0000 mon.a (mon.0) 1336 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:36:20.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:36:19 smithi086 bash[24289]: audit 2024-09-16T10:36:19.248090+0000 mon.b (mon.2) 1189 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:36:20.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:36:19 smithi086 bash[24289]: audit 2024-09-16T10:36:19.250744+0000 mgr.a (mgr.14373) 12939 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:36:20.092 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 10:36:19 smithi047 bash[22994]: debug 2024-09-16T10:36:19.983+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T10:36:20.093 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 10:36:19 smithi047 bash[22994]: debug 2024-09-16T10:36:19.983+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T10:36:20.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:36:19 smithi047 bash[22744]: cluster 2024-09-16T10:36:18.513157+0000 mgr.a (mgr.14373) 12938 : cluster [DBG] pgmap v8973: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:36:20.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:36:19 smithi047 bash[22744]: audit 2024-09-16T10:36:19.231720+0000 mon.b (mon.2) 1187 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T10:36:20.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:36:19 smithi047 bash[22744]: audit 2024-09-16T10:36:19.233352+0000 mon.b (mon.2) 1188 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T10:36:20.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:36:19 smithi047 bash[22744]: audit 2024-09-16T10:36:19.243003+0000 mon.a (mon.0) 1336 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:36:20.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:36:19 smithi047 bash[22744]: audit 2024-09-16T10:36:19.248090+0000 mon.b (mon.2) 1189 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:36:20.094 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:36:19 smithi047 bash[22744]: audit 2024-09-16T10:36:19.250744+0000 mgr.a (mgr.14373) 12939 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:36:21.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:36:20 smithi157 bash[24585]: audit 2024-09-16T10:36:19.987397+0000 mgr.a (mgr.14373) 12940 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T10:36:21.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:36:20 smithi157 bash[24585]: cephadm 2024-09-16T10:36:19.989294+0000 mgr.a (mgr.14373) 12941 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T10:36:21.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:36:20 smithi086 bash[24289]: audit 2024-09-16T10:36:19.987397+0000 mgr.a (mgr.14373) 12940 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T10:36:21.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:36:20 smithi086 bash[24289]: cephadm 2024-09-16T10:36:19.989294+0000 mgr.a (mgr.14373) 12941 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T10:36:21.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:36:20 smithi047 bash[22744]: audit 2024-09-16T10:36:19.987397+0000 mgr.a (mgr.14373) 12940 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T10:36:21.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:36:20 smithi047 bash[22744]: cephadm 2024-09-16T10:36:19.989294+0000 mgr.a (mgr.14373) 12941 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T10:36:22.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:36:21 smithi157 bash[24585]: cluster 2024-09-16T10:36:20.514117+0000 mgr.a (mgr.14373) 12942 : cluster [DBG] pgmap v8974: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-16T10:36:22.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:36:21 smithi086 bash[24289]: cluster 2024-09-16T10:36:20.514117+0000 mgr.a (mgr.14373) 12942 : cluster [DBG] pgmap v8974: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-16T10:36:22.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:36:21 smithi047 bash[22744]: cluster 2024-09-16T10:36:20.514117+0000 mgr.a (mgr.14373) 12942 : cluster [DBG] pgmap v8974: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-16T10:36:23.334 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:36:23.335 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:36:23.335 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:36:24.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:36:23 smithi157 bash[24585]: cluster 2024-09-16T10:36:22.516357+0000 mgr.a (mgr.14373) 12943 : cluster [DBG] pgmap v8975: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:36:24.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:36:23 smithi086 bash[24289]: cluster 2024-09-16T10:36:22.516357+0000 mgr.a (mgr.14373) 12943 : cluster [DBG] pgmap v8975: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:36:24.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:36:23 smithi047 bash[22744]: cluster 2024-09-16T10:36:22.516357+0000 mgr.a (mgr.14373) 12943 : cluster [DBG] pgmap v8975: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:36:24.111 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:36:24.111 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:36:24.111 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:36:24.111 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:36:24.111 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:36:25.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:36:24 smithi157 bash[24585]: audit 2024-09-16T10:36:23.673032+0000 mgr.a (mgr.14373) 12944 : audit [DBG] from='client.281874 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:36:25.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:36:24 smithi086 bash[24289]: audit 2024-09-16T10:36:23.673032+0000 mgr.a (mgr.14373) 12944 : audit [DBG] from='client.281874 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:36:25.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:36:24 smithi047 bash[22744]: audit 2024-09-16T10:36:23.673032+0000 mgr.a (mgr.14373) 12944 : audit [DBG] from='client.281874 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:36:26.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:36:25 smithi157 bash[24585]: cluster 2024-09-16T10:36:24.517350+0000 mgr.a (mgr.14373) 12945 : cluster [DBG] pgmap v8976: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:36:26.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:36:25 smithi086 bash[24289]: cluster 2024-09-16T10:36:24.517350+0000 mgr.a (mgr.14373) 12945 : cluster [DBG] pgmap v8976: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:36:26.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:36:25 smithi047 bash[22744]: cluster 2024-09-16T10:36:24.517350+0000 mgr.a (mgr.14373) 12945 : cluster [DBG] pgmap v8976: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:36:28.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:36:27 smithi157 bash[24585]: cluster 2024-09-16T10:36:26.518150+0000 mgr.a (mgr.14373) 12946 : cluster [DBG] pgmap v8977: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:36:28.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:36:27 smithi086 bash[24289]: cluster 2024-09-16T10:36:26.518150+0000 mgr.a (mgr.14373) 12946 : cluster [DBG] pgmap v8977: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:36:28.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:36:27 smithi047 bash[22744]: cluster 2024-09-16T10:36:26.518150+0000 mgr.a (mgr.14373) 12946 : cluster [DBG] pgmap v8977: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:36:29.113 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:36:29.114 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:36:29.114 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:36:29.884 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:36:29.884 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:36:29.884 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:36:29.884 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:36:29.885 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:36:30.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:36:29 smithi157 bash[24585]: cluster 2024-09-16T10:36:28.520463+0000 mgr.a (mgr.14373) 12947 : cluster [DBG] pgmap v8978: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:36:30.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:36:29 smithi157 bash[24585]: audit 2024-09-16T10:36:29.447410+0000 mgr.a (mgr.14373) 12948 : audit [DBG] from='client.281952 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:36:30.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:36:29 smithi086 bash[24289]: cluster 2024-09-16T10:36:28.520463+0000 mgr.a (mgr.14373) 12947 : cluster [DBG] pgmap v8978: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:36:30.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:36:29 smithi086 bash[24289]: audit 2024-09-16T10:36:29.447410+0000 mgr.a (mgr.14373) 12948 : audit [DBG] from='client.281952 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:36:30.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:36:29 smithi047 bash[22744]: cluster 2024-09-16T10:36:28.520463+0000 mgr.a (mgr.14373) 12947 : cluster [DBG] pgmap v8978: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:36:30.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:36:29 smithi047 bash[22744]: audit 2024-09-16T10:36:29.447410+0000 mgr.a (mgr.14373) 12948 : audit [DBG] from='client.281952 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:36:32.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:36:31 smithi157 bash[24585]: cluster 2024-09-16T10:36:30.521497+0000 mgr.a (mgr.14373) 12949 : cluster [DBG] pgmap v8979: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:36:32.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:36:31 smithi086 bash[24289]: cluster 2024-09-16T10:36:30.521497+0000 mgr.a (mgr.14373) 12949 : cluster [DBG] pgmap v8979: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:36:32.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:36:31 smithi047 bash[22744]: cluster 2024-09-16T10:36:30.521497+0000 mgr.a (mgr.14373) 12949 : cluster [DBG] pgmap v8979: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:36:34.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:36:33 smithi086 bash[24289]: cluster 2024-09-16T10:36:32.523799+0000 mgr.a (mgr.14373) 12950 : cluster [DBG] pgmap v8980: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:36:34.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:36:33 smithi047 bash[22744]: cluster 2024-09-16T10:36:32.523799+0000 mgr.a (mgr.14373) 12950 : cluster [DBG] pgmap v8980: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:36:34.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:36:33 smithi157 bash[24585]: cluster 2024-09-16T10:36:32.523799+0000 mgr.a (mgr.14373) 12950 : cluster [DBG] pgmap v8980: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:36:34.885 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:36:34.886 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:36:34.886 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:36:35.645 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:36:35.645 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:36:35.645 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:36:35.645 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:36:35.645 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:36:36.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:36:35 smithi086 bash[24289]: cluster 2024-09-16T10:36:34.524591+0000 mgr.a (mgr.14373) 12951 : cluster [DBG] pgmap v8981: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:36:36.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:36:35 smithi086 bash[24289]: audit 2024-09-16T10:36:35.216518+0000 mgr.a (mgr.14373) 12952 : audit [DBG] from='client.282027 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:36:36.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:36:35 smithi047 bash[22744]: cluster 2024-09-16T10:36:34.524591+0000 mgr.a (mgr.14373) 12951 : cluster [DBG] pgmap v8981: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:36:36.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:36:35 smithi047 bash[22744]: audit 2024-09-16T10:36:35.216518+0000 mgr.a (mgr.14373) 12952 : audit [DBG] from='client.282027 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:36:36.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:36:35 smithi157 bash[24585]: cluster 2024-09-16T10:36:34.524591+0000 mgr.a (mgr.14373) 12951 : cluster [DBG] pgmap v8981: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:36:36.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:36:35 smithi157 bash[24585]: audit 2024-09-16T10:36:35.216518+0000 mgr.a (mgr.14373) 12952 : audit [DBG] from='client.282027 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:36:38.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:36:37 smithi086 bash[24289]: cluster 2024-09-16T10:36:36.525563+0000 mgr.a (mgr.14373) 12953 : cluster [DBG] pgmap v8982: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:36:38.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:36:37 smithi047 bash[22744]: cluster 2024-09-16T10:36:36.525563+0000 mgr.a (mgr.14373) 12953 : cluster [DBG] pgmap v8982: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:36:38.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:36:37 smithi157 bash[24585]: cluster 2024-09-16T10:36:36.525563+0000 mgr.a (mgr.14373) 12953 : cluster [DBG] pgmap v8982: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:36:40.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:36:39 smithi047 bash[22744]: cluster 2024-09-16T10:36:38.527824+0000 mgr.a (mgr.14373) 12954 : cluster [DBG] pgmap v8983: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:36:40.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:36:39 smithi157 bash[24585]: cluster 2024-09-16T10:36:38.527824+0000 mgr.a (mgr.14373) 12954 : cluster [DBG] pgmap v8983: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:36:40.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:36:39 smithi086 bash[24289]: cluster 2024-09-16T10:36:38.527824+0000 mgr.a (mgr.14373) 12954 : cluster [DBG] pgmap v8983: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:36:40.646 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:36:40.647 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:36:40.648 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:36:41.403 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:36:41.404 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:36:41.404 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:36:41.404 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:36:41.404 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:36:42.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:36:41 smithi047 bash[22744]: cluster 2024-09-16T10:36:40.528650+0000 mgr.a (mgr.14373) 12955 : cluster [DBG] pgmap v8984: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:36:42.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:36:41 smithi047 bash[22744]: audit 2024-09-16T10:36:40.978356+0000 mgr.a (mgr.14373) 12956 : audit [DBG] from='client.282105 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:36:42.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:36:41 smithi157 bash[24585]: cluster 2024-09-16T10:36:40.528650+0000 mgr.a (mgr.14373) 12955 : cluster [DBG] pgmap v8984: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:36:42.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:36:41 smithi157 bash[24585]: audit 2024-09-16T10:36:40.978356+0000 mgr.a (mgr.14373) 12956 : audit [DBG] from='client.282105 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:36:42.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:36:41 smithi086 bash[24289]: cluster 2024-09-16T10:36:40.528650+0000 mgr.a (mgr.14373) 12955 : cluster [DBG] pgmap v8984: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:36:42.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:36:41 smithi086 bash[24289]: audit 2024-09-16T10:36:40.978356+0000 mgr.a (mgr.14373) 12956 : audit [DBG] from='client.282105 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:36:44.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:36:43 smithi047 bash[22744]: cluster 2024-09-16T10:36:42.530983+0000 mgr.a (mgr.14373) 12957 : cluster [DBG] pgmap v8985: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:36:44.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:36:43 smithi157 bash[24585]: cluster 2024-09-16T10:36:42.530983+0000 mgr.a (mgr.14373) 12957 : cluster [DBG] pgmap v8985: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:36:44.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:36:43 smithi086 bash[24289]: cluster 2024-09-16T10:36:42.530983+0000 mgr.a (mgr.14373) 12957 : cluster [DBG] pgmap v8985: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:36:46.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:36:45 smithi047 bash[22744]: cluster 2024-09-16T10:36:44.531763+0000 mgr.a (mgr.14373) 12958 : cluster [DBG] pgmap v8986: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:36:46.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:36:45 smithi157 bash[24585]: cluster 2024-09-16T10:36:44.531763+0000 mgr.a (mgr.14373) 12958 : cluster [DBG] pgmap v8986: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:36:46.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:36:45 smithi086 bash[24289]: cluster 2024-09-16T10:36:44.531763+0000 mgr.a (mgr.14373) 12958 : cluster [DBG] pgmap v8986: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:36:46.405 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:36:46.406 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:36:46.406 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:36:47.192 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:36:47.193 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:36:47.193 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:36:47.193 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:36:47.193 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:36:48.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:36:47 smithi047 bash[22744]: cluster 2024-09-16T10:36:46.532207+0000 mgr.a (mgr.14373) 12959 : cluster [DBG] pgmap v8987: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:36:48.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:36:47 smithi047 bash[22744]: audit 2024-09-16T10:36:46.741755+0000 mgr.a (mgr.14373) 12960 : audit [DBG] from='client.282183 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:36:48.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:36:47 smithi157 bash[24585]: cluster 2024-09-16T10:36:46.532207+0000 mgr.a (mgr.14373) 12959 : cluster [DBG] pgmap v8987: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:36:48.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:36:47 smithi157 bash[24585]: audit 2024-09-16T10:36:46.741755+0000 mgr.a (mgr.14373) 12960 : audit [DBG] from='client.282183 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:36:48.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:36:47 smithi086 bash[24289]: cluster 2024-09-16T10:36:46.532207+0000 mgr.a (mgr.14373) 12959 : cluster [DBG] pgmap v8987: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:36:48.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:36:47 smithi086 bash[24289]: audit 2024-09-16T10:36:46.741755+0000 mgr.a (mgr.14373) 12960 : audit [DBG] from='client.282183 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:36:50.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:36:49 smithi047 bash[22744]: cluster 2024-09-16T10:36:48.534946+0000 mgr.a (mgr.14373) 12961 : cluster [DBG] pgmap v8988: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:36:50.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:36:49 smithi157 bash[24585]: cluster 2024-09-16T10:36:48.534946+0000 mgr.a (mgr.14373) 12961 : cluster [DBG] pgmap v8988: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:36:50.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:36:49 smithi086 bash[24289]: cluster 2024-09-16T10:36:48.534946+0000 mgr.a (mgr.14373) 12961 : cluster [DBG] pgmap v8988: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:36:52.194 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:36:52.194 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:36:52.195 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:36:52.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:36:51 smithi157 bash[24585]: cluster 2024-09-16T10:36:50.535716+0000 mgr.a (mgr.14373) 12962 : cluster [DBG] pgmap v8989: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:36:52.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:36:51 smithi086 bash[24289]: cluster 2024-09-16T10:36:50.535716+0000 mgr.a (mgr.14373) 12962 : cluster [DBG] pgmap v8989: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:36:52.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:36:51 smithi047 bash[22744]: cluster 2024-09-16T10:36:50.535716+0000 mgr.a (mgr.14373) 12962 : cluster [DBG] pgmap v8989: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:36:52.968 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:36:52.968 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:36:52.968 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:36:52.968 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:36:52.968 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:36:54.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:36:53 smithi157 bash[24585]: audit 2024-09-16T10:36:52.528677+0000 mgr.a (mgr.14373) 12963 : audit [DBG] from='client.282261 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:36:54.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:36:53 smithi157 bash[24585]: cluster 2024-09-16T10:36:52.544376+0000 mgr.a (mgr.14373) 12964 : cluster [DBG] pgmap v8990: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:36:54.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:36:53 smithi086 bash[24289]: audit 2024-09-16T10:36:52.528677+0000 mgr.a (mgr.14373) 12963 : audit [DBG] from='client.282261 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:36:54.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:36:53 smithi086 bash[24289]: cluster 2024-09-16T10:36:52.544376+0000 mgr.a (mgr.14373) 12964 : cluster [DBG] pgmap v8990: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:36:54.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:36:53 smithi047 bash[22744]: audit 2024-09-16T10:36:52.528677+0000 mgr.a (mgr.14373) 12963 : audit [DBG] from='client.282261 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:36:54.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:36:53 smithi047 bash[22744]: cluster 2024-09-16T10:36:52.544376+0000 mgr.a (mgr.14373) 12964 : cluster [DBG] pgmap v8990: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:36:56.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:36:55 smithi157 bash[24585]: cluster 2024-09-16T10:36:54.545290+0000 mgr.a (mgr.14373) 12965 : cluster [DBG] pgmap v8991: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:36:56.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:36:55 smithi086 bash[24289]: cluster 2024-09-16T10:36:54.545290+0000 mgr.a (mgr.14373) 12965 : cluster [DBG] pgmap v8991: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:36:56.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:36:55 smithi047 bash[22744]: cluster 2024-09-16T10:36:54.545290+0000 mgr.a (mgr.14373) 12965 : cluster [DBG] pgmap v8991: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:36:57.969 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:36:57.970 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:36:57.970 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:36:58.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:36:57 smithi157 bash[24585]: cluster 2024-09-16T10:36:56.546148+0000 mgr.a (mgr.14373) 12966 : cluster [DBG] pgmap v8992: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:36:58.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:36:57 smithi086 bash[24289]: cluster 2024-09-16T10:36:56.546148+0000 mgr.a (mgr.14373) 12966 : cluster [DBG] pgmap v8992: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:36:58.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:36:57 smithi047 bash[22744]: cluster 2024-09-16T10:36:56.546148+0000 mgr.a (mgr.14373) 12966 : cluster [DBG] pgmap v8992: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:36:58.732 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:36:58.732 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:36:58.733 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:36:58.733 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:36:58.733 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:36:59.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:36:58 smithi157 bash[24585]: audit 2024-09-16T10:36:58.300421+0000 mgr.a (mgr.14373) 12967 : audit [DBG] from='client.282336 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:36:59.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:36:58 smithi086 bash[24289]: audit 2024-09-16T10:36:58.300421+0000 mgr.a (mgr.14373) 12967 : audit [DBG] from='client.282336 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:36:59.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:36:58 smithi047 bash[22744]: audit 2024-09-16T10:36:58.300421+0000 mgr.a (mgr.14373) 12967 : audit [DBG] from='client.282336 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:37:00.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:36:59 smithi157 bash[24585]: cluster 2024-09-16T10:36:58.547501+0000 mgr.a (mgr.14373) 12968 : cluster [DBG] pgmap v8993: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:37:00.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:36:59 smithi086 bash[24289]: cluster 2024-09-16T10:36:58.547501+0000 mgr.a (mgr.14373) 12968 : cluster [DBG] pgmap v8993: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:37:00.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:36:59 smithi047 bash[22744]: cluster 2024-09-16T10:36:58.547501+0000 mgr.a (mgr.14373) 12968 : cluster [DBG] pgmap v8993: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:37:02.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:37:01 smithi157 bash[24585]: cluster 2024-09-16T10:37:00.548376+0000 mgr.a (mgr.14373) 12969 : cluster [DBG] pgmap v8994: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:37:02.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:37:01 smithi086 bash[24289]: cluster 2024-09-16T10:37:00.548376+0000 mgr.a (mgr.14373) 12969 : cluster [DBG] pgmap v8994: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:37:02.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:37:01 smithi047 bash[22744]: cluster 2024-09-16T10:37:00.548376+0000 mgr.a (mgr.14373) 12969 : cluster [DBG] pgmap v8994: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:37:03.734 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:37:03.734 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:37:03.735 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:37:04.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:37:03 smithi157 bash[24585]: cluster 2024-09-16T10:37:02.550635+0000 mgr.a (mgr.14373) 12970 : cluster [DBG] pgmap v8995: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:37:04.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:37:03 smithi086 bash[24289]: cluster 2024-09-16T10:37:02.550635+0000 mgr.a (mgr.14373) 12970 : cluster [DBG] pgmap v8995: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:37:04.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:37:03 smithi047 bash[22744]: cluster 2024-09-16T10:37:02.550635+0000 mgr.a (mgr.14373) 12970 : cluster [DBG] pgmap v8995: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:37:04.489 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:37:04.490 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:37:04.490 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:37:04.490 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:37:04.490 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:37:05.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:37:04 smithi157 bash[24585]: audit 2024-09-16T10:37:04.065195+0000 mgr.a (mgr.14373) 12971 : audit [DBG] from='client.282408 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:37:05.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:37:04 smithi086 bash[24289]: audit 2024-09-16T10:37:04.065195+0000 mgr.a (mgr.14373) 12971 : audit [DBG] from='client.282408 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:37:05.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:37:04 smithi047 bash[22744]: audit 2024-09-16T10:37:04.065195+0000 mgr.a (mgr.14373) 12971 : audit [DBG] from='client.282408 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:37:06.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:37:05 smithi157 bash[24585]: cluster 2024-09-16T10:37:04.551173+0000 mgr.a (mgr.14373) 12972 : cluster [DBG] pgmap v8996: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:37:06.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:37:05 smithi086 bash[24289]: cluster 2024-09-16T10:37:04.551173+0000 mgr.a (mgr.14373) 12972 : cluster [DBG] pgmap v8996: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:37:06.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:37:05 smithi047 bash[22744]: cluster 2024-09-16T10:37:04.551173+0000 mgr.a (mgr.14373) 12972 : cluster [DBG] pgmap v8996: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:37:08.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:37:07 smithi157 bash[24585]: cluster 2024-09-16T10:37:06.551909+0000 mgr.a (mgr.14373) 12973 : cluster [DBG] pgmap v8997: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:37:08.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:37:07 smithi086 bash[24289]: cluster 2024-09-16T10:37:06.551909+0000 mgr.a (mgr.14373) 12973 : cluster [DBG] pgmap v8997: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:37:08.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:37:07 smithi047 bash[22744]: cluster 2024-09-16T10:37:06.551909+0000 mgr.a (mgr.14373) 12973 : cluster [DBG] pgmap v8997: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:37:09.491 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:37:09.492 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:37:09.492 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:37:10.274 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:37:10.275 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:37:10.275 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:37:10.275 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:37:10.275 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:37:10.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:37:09 smithi157 bash[24585]: cluster 2024-09-16T10:37:08.554231+0000 mgr.a (mgr.14373) 12974 : cluster [DBG] pgmap v8998: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:37:10.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:37:09 smithi086 bash[24289]: cluster 2024-09-16T10:37:08.554231+0000 mgr.a (mgr.14373) 12974 : cluster [DBG] pgmap v8998: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:37:10.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:37:09 smithi047 bash[22744]: cluster 2024-09-16T10:37:08.554231+0000 mgr.a (mgr.14373) 12974 : cluster [DBG] pgmap v8998: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:37:11.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:37:10 smithi157 bash[24585]: audit 2024-09-16T10:37:09.829862+0000 mgr.a (mgr.14373) 12975 : audit [DBG] from='client.282477 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:37:11.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:37:10 smithi086 bash[24289]: audit 2024-09-16T10:37:09.829862+0000 mgr.a (mgr.14373) 12975 : audit [DBG] from='client.282477 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:37:11.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:37:10 smithi047 bash[22744]: audit 2024-09-16T10:37:09.829862+0000 mgr.a (mgr.14373) 12975 : audit [DBG] from='client.282477 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:37:12.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:37:11 smithi157 bash[24585]: cluster 2024-09-16T10:37:10.555408+0000 mgr.a (mgr.14373) 12976 : cluster [DBG] pgmap v8999: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:37:12.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:37:11 smithi086 bash[24289]: cluster 2024-09-16T10:37:10.555408+0000 mgr.a (mgr.14373) 12976 : cluster [DBG] pgmap v8999: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:37:12.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:37:11 smithi047 bash[22744]: cluster 2024-09-16T10:37:10.555408+0000 mgr.a (mgr.14373) 12976 : cluster [DBG] pgmap v8999: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:37:14.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:37:13 smithi157 bash[24585]: cluster 2024-09-16T10:37:12.557603+0000 mgr.a (mgr.14373) 12977 : cluster [DBG] pgmap v9000: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:37:14.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:37:13 smithi086 bash[24289]: cluster 2024-09-16T10:37:12.557603+0000 mgr.a (mgr.14373) 12977 : cluster [DBG] pgmap v9000: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:37:14.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:37:13 smithi047 bash[22744]: cluster 2024-09-16T10:37:12.557603+0000 mgr.a (mgr.14373) 12977 : cluster [DBG] pgmap v9000: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:37:15.276 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:37:15.277 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:37:15.277 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:37:16.072 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:37:16.072 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:37:16.072 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:37:16.072 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:37:16.072 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:37:16.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:37:15 smithi157 bash[24585]: cluster 2024-09-16T10:37:14.558368+0000 mgr.a (mgr.14373) 12978 : cluster [DBG] pgmap v9001: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:37:16.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:37:15 smithi086 bash[24289]: cluster 2024-09-16T10:37:14.558368+0000 mgr.a (mgr.14373) 12978 : cluster [DBG] pgmap v9001: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:37:16.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:37:15 smithi047 bash[22744]: cluster 2024-09-16T10:37:14.558368+0000 mgr.a (mgr.14373) 12978 : cluster [DBG] pgmap v9001: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:37:17.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:37:16 smithi157 bash[24585]: audit 2024-09-16T10:37:15.618096+0000 mgr.a (mgr.14373) 12979 : audit [DBG] from='client.282549 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:37:17.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:37:16 smithi086 bash[24289]: audit 2024-09-16T10:37:15.618096+0000 mgr.a (mgr.14373) 12979 : audit [DBG] from='client.282549 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:37:17.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:37:16 smithi047 bash[22744]: audit 2024-09-16T10:37:15.618096+0000 mgr.a (mgr.14373) 12979 : audit [DBG] from='client.282549 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:37:18.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:37:17 smithi157 bash[24585]: cluster 2024-09-16T10:37:16.559428+0000 mgr.a (mgr.14373) 12980 : cluster [DBG] pgmap v9002: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:37:18.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:37:17 smithi086 bash[24289]: cluster 2024-09-16T10:37:16.559428+0000 mgr.a (mgr.14373) 12980 : cluster [DBG] pgmap v9002: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:37:18.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:37:17 smithi047 bash[22744]: cluster 2024-09-16T10:37:16.559428+0000 mgr.a (mgr.14373) 12980 : cluster [DBG] pgmap v9002: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:37:20.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:37:19 smithi157 bash[24585]: cluster 2024-09-16T10:37:18.562070+0000 mgr.a (mgr.14373) 12981 : cluster [DBG] pgmap v9003: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:37:20.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:37:19 smithi086 bash[24289]: cluster 2024-09-16T10:37:18.562070+0000 mgr.a (mgr.14373) 12981 : cluster [DBG] pgmap v9003: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:37:20.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:37:19 smithi047 bash[22744]: cluster 2024-09-16T10:37:18.562070+0000 mgr.a (mgr.14373) 12981 : cluster [DBG] pgmap v9003: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:37:21.073 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:37:21.074 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:37:21.074 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:37:21.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:37:20 smithi157 bash[24585]: audit 2024-09-16T10:37:20.040198+0000 mon.b (mon.2) 1190 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T10:37:21.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:37:20 smithi157 bash[24585]: audit 2024-09-16T10:37:20.667102+0000 mon.a (mon.0) 1337 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:37:21.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:37:20 smithi157 bash[24585]: audit 2024-09-16T10:37:20.671813+0000 mon.a (mon.0) 1338 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:37:21.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:37:20 smithi086 bash[24289]: audit 2024-09-16T10:37:20.040198+0000 mon.b (mon.2) 1190 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T10:37:21.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:37:20 smithi086 bash[24289]: audit 2024-09-16T10:37:20.667102+0000 mon.a (mon.0) 1337 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:37:21.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:37:20 smithi086 bash[24289]: audit 2024-09-16T10:37:20.671813+0000 mon.a (mon.0) 1338 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:37:21.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:37:20 smithi047 bash[22744]: audit 2024-09-16T10:37:20.040198+0000 mon.b (mon.2) 1190 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T10:37:21.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:37:20 smithi047 bash[22744]: audit 2024-09-16T10:37:20.667102+0000 mon.a (mon.0) 1337 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:37:21.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:37:20 smithi047 bash[22744]: audit 2024-09-16T10:37:20.671813+0000 mon.a (mon.0) 1338 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:37:21.830 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:37:21.830 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:37:21.830 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:37:21.830 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:37:21.831 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:37:22.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:37:21 smithi157 bash[24585]: cluster 2024-09-16T10:37:20.562866+0000 mgr.a (mgr.14373) 12982 : cluster [DBG] pgmap v9004: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:37:22.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:37:21 smithi157 bash[24585]: audit 2024-09-16T10:37:21.400773+0000 mgr.a (mgr.14373) 12983 : audit [DBG] from='client.282627 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:37:22.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:37:21 smithi157 bash[24585]: audit 2024-09-16T10:37:21.475766+0000 mon.b (mon.2) 1191 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T10:37:22.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:37:21 smithi157 bash[24585]: audit 2024-09-16T10:37:21.477462+0000 mon.b (mon.2) 1192 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T10:37:22.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:37:21 smithi157 bash[24585]: audit 2024-09-16T10:37:21.484223+0000 mon.a (mon.0) 1339 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:37:22.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:37:21 smithi157 bash[24585]: audit 2024-09-16T10:37:21.489072+0000 mon.b (mon.2) 1193 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:37:22.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:37:21 smithi157 bash[24585]: audit 2024-09-16T10:37:21.490661+0000 mgr.a (mgr.14373) 12984 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:37:22.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:37:21 smithi086 bash[24289]: cluster 2024-09-16T10:37:20.562866+0000 mgr.a (mgr.14373) 12982 : cluster [DBG] pgmap v9004: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:37:22.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:37:21 smithi086 bash[24289]: audit 2024-09-16T10:37:21.400773+0000 mgr.a (mgr.14373) 12983 : audit [DBG] from='client.282627 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:37:22.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:37:21 smithi086 bash[24289]: audit 2024-09-16T10:37:21.475766+0000 mon.b (mon.2) 1191 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T10:37:22.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:37:21 smithi086 bash[24289]: audit 2024-09-16T10:37:21.477462+0000 mon.b (mon.2) 1192 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T10:37:22.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:37:21 smithi086 bash[24289]: audit 2024-09-16T10:37:21.484223+0000 mon.a (mon.0) 1339 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:37:22.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:37:21 smithi086 bash[24289]: audit 2024-09-16T10:37:21.489072+0000 mon.b (mon.2) 1193 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:37:22.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:37:21 smithi086 bash[24289]: audit 2024-09-16T10:37:21.490661+0000 mgr.a (mgr.14373) 12984 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:37:22.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:37:21 smithi047 bash[22744]: cluster 2024-09-16T10:37:20.562866+0000 mgr.a (mgr.14373) 12982 : cluster [DBG] pgmap v9004: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:37:22.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:37:21 smithi047 bash[22744]: audit 2024-09-16T10:37:21.400773+0000 mgr.a (mgr.14373) 12983 : audit [DBG] from='client.282627 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:37:22.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:37:21 smithi047 bash[22744]: audit 2024-09-16T10:37:21.475766+0000 mon.b (mon.2) 1191 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T10:37:22.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:37:21 smithi047 bash[22744]: audit 2024-09-16T10:37:21.477462+0000 mon.b (mon.2) 1192 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T10:37:22.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:37:21 smithi047 bash[22744]: audit 2024-09-16T10:37:21.484223+0000 mon.a (mon.0) 1339 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:37:22.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:37:21 smithi047 bash[22744]: audit 2024-09-16T10:37:21.489072+0000 mon.b (mon.2) 1193 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:37:22.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:37:21 smithi047 bash[22744]: audit 2024-09-16T10:37:21.490661+0000 mgr.a (mgr.14373) 12984 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:37:22.842 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 10:37:22 smithi047 bash[22994]: debug 2024-09-16T10:37:22.521+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T10:37:22.843 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 10:37:22 smithi047 bash[22994]: debug 2024-09-16T10:37:22.521+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T10:37:24.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:37:23 smithi157 bash[24585]: audit 2024-09-16T10:37:22.523884+0000 mgr.a (mgr.14373) 12985 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T10:37:24.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:37:23 smithi157 bash[24585]: cephadm 2024-09-16T10:37:22.526078+0000 mgr.a (mgr.14373) 12986 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T10:37:24.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:37:23 smithi157 bash[24585]: cluster 2024-09-16T10:37:22.564486+0000 mgr.a (mgr.14373) 12987 : cluster [DBG] pgmap v9005: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:37:24.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:37:23 smithi086 bash[24289]: audit 2024-09-16T10:37:22.523884+0000 mgr.a (mgr.14373) 12985 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T10:37:24.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:37:23 smithi086 bash[24289]: cephadm 2024-09-16T10:37:22.526078+0000 mgr.a (mgr.14373) 12986 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T10:37:24.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:37:23 smithi086 bash[24289]: cluster 2024-09-16T10:37:22.564486+0000 mgr.a (mgr.14373) 12987 : cluster [DBG] pgmap v9005: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:37:24.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:37:23 smithi047 bash[22744]: audit 2024-09-16T10:37:22.523884+0000 mgr.a (mgr.14373) 12985 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T10:37:24.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:37:23 smithi047 bash[22744]: cephadm 2024-09-16T10:37:22.526078+0000 mgr.a (mgr.14373) 12986 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T10:37:24.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:37:23 smithi047 bash[22744]: cluster 2024-09-16T10:37:22.564486+0000 mgr.a (mgr.14373) 12987 : cluster [DBG] pgmap v9005: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:37:26.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:37:25 smithi157 bash[24585]: cluster 2024-09-16T10:37:24.565201+0000 mgr.a (mgr.14373) 12988 : cluster [DBG] pgmap v9006: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:37:26.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:37:25 smithi086 bash[24289]: cluster 2024-09-16T10:37:24.565201+0000 mgr.a (mgr.14373) 12988 : cluster [DBG] pgmap v9006: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:37:26.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:37:25 smithi047 bash[22744]: cluster 2024-09-16T10:37:24.565201+0000 mgr.a (mgr.14373) 12988 : cluster [DBG] pgmap v9006: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:37:26.831 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:37:26.832 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:37:26.833 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:37:27.577 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:37:27.577 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:37:27.577 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:37:27.577 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:37:27.577 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:37:28.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:37:27 smithi157 bash[24585]: cluster 2024-09-16T10:37:26.566406+0000 mgr.a (mgr.14373) 12989 : cluster [DBG] pgmap v9007: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.4 KiB/s rd, 85 B/s wr, 2 op/s 2024-09-16T10:37:28.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:37:27 smithi157 bash[24585]: audit 2024-09-16T10:37:27.163665+0000 mgr.a (mgr.14373) 12990 : audit [DBG] from='client.282798 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:37:28.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:37:27 smithi086 bash[24289]: cluster 2024-09-16T10:37:26.566406+0000 mgr.a (mgr.14373) 12989 : cluster [DBG] pgmap v9007: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.4 KiB/s rd, 85 B/s wr, 2 op/s 2024-09-16T10:37:28.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:37:27 smithi086 bash[24289]: audit 2024-09-16T10:37:27.163665+0000 mgr.a (mgr.14373) 12990 : audit [DBG] from='client.282798 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:37:28.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:37:27 smithi047 bash[22744]: cluster 2024-09-16T10:37:26.566406+0000 mgr.a (mgr.14373) 12989 : cluster [DBG] pgmap v9007: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.4 KiB/s rd, 85 B/s wr, 2 op/s 2024-09-16T10:37:28.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:37:27 smithi047 bash[22744]: audit 2024-09-16T10:37:27.163665+0000 mgr.a (mgr.14373) 12990 : audit [DBG] from='client.282798 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:37:30.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:37:29 smithi157 bash[24585]: cluster 2024-09-16T10:37:28.568628+0000 mgr.a (mgr.14373) 12991 : cluster [DBG] pgmap v9008: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:37:30.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:37:29 smithi086 bash[24289]: cluster 2024-09-16T10:37:28.568628+0000 mgr.a (mgr.14373) 12991 : cluster [DBG] pgmap v9008: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:37:30.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:37:29 smithi047 bash[22744]: cluster 2024-09-16T10:37:28.568628+0000 mgr.a (mgr.14373) 12991 : cluster [DBG] pgmap v9008: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:37:32.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:37:31 smithi157 bash[24585]: cluster 2024-09-16T10:37:30.569488+0000 mgr.a (mgr.14373) 12992 : cluster [DBG] pgmap v9009: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T10:37:32.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:37:31 smithi086 bash[24289]: cluster 2024-09-16T10:37:30.569488+0000 mgr.a (mgr.14373) 12992 : cluster [DBG] pgmap v9009: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T10:37:32.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:37:31 smithi047 bash[22744]: cluster 2024-09-16T10:37:30.569488+0000 mgr.a (mgr.14373) 12992 : cluster [DBG] pgmap v9009: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T10:37:32.578 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:37:32.579 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:37:32.579 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:37:33.322 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:37:33.322 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:37:33.322 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:37:33.322 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:37:33.322 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:37:34.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:37:33 smithi157 bash[24585]: cluster 2024-09-16T10:37:32.571737+0000 mgr.a (mgr.14373) 12993 : cluster [DBG] pgmap v9010: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:37:34.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:37:33 smithi157 bash[24585]: audit 2024-09-16T10:37:32.907031+0000 mgr.a (mgr.14373) 12994 : audit [DBG] from='client.282876 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:37:34.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:37:33 smithi086 bash[24289]: cluster 2024-09-16T10:37:32.571737+0000 mgr.a (mgr.14373) 12993 : cluster [DBG] pgmap v9010: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:37:34.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:37:33 smithi086 bash[24289]: audit 2024-09-16T10:37:32.907031+0000 mgr.a (mgr.14373) 12994 : audit [DBG] from='client.282876 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:37:34.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:37:33 smithi047 bash[22744]: cluster 2024-09-16T10:37:32.571737+0000 mgr.a (mgr.14373) 12993 : cluster [DBG] pgmap v9010: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:37:34.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:37:33 smithi047 bash[22744]: audit 2024-09-16T10:37:32.907031+0000 mgr.a (mgr.14373) 12994 : audit [DBG] from='client.282876 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:37:36.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:37:35 smithi157 bash[24585]: cluster 2024-09-16T10:37:34.572687+0000 mgr.a (mgr.14373) 12995 : cluster [DBG] pgmap v9011: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:37:36.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:37:35 smithi086 bash[24289]: cluster 2024-09-16T10:37:34.572687+0000 mgr.a (mgr.14373) 12995 : cluster [DBG] pgmap v9011: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:37:36.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:37:35 smithi047 bash[22744]: cluster 2024-09-16T10:37:34.572687+0000 mgr.a (mgr.14373) 12995 : cluster [DBG] pgmap v9011: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:37:38.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:37:37 smithi157 bash[24585]: cluster 2024-09-16T10:37:36.574055+0000 mgr.a (mgr.14373) 12996 : cluster [DBG] pgmap v9012: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.1 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:37:38.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:37:37 smithi086 bash[24289]: cluster 2024-09-16T10:37:36.574055+0000 mgr.a (mgr.14373) 12996 : cluster [DBG] pgmap v9012: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.1 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:37:38.323 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:37:38.324 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:37:38.324 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:37:38.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:37:37 smithi047 bash[22744]: cluster 2024-09-16T10:37:36.574055+0000 mgr.a (mgr.14373) 12996 : cluster [DBG] pgmap v9012: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.1 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:37:39.069 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:37:39.069 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:37:39.069 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:37:39.069 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:37:39.070 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:37:40.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:37:39 smithi157 bash[24585]: cluster 2024-09-16T10:37:38.575145+0000 mgr.a (mgr.14373) 12997 : cluster [DBG] pgmap v9013: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 6.4 KiB/s rd, 341 B/s wr, 6 op/s 2024-09-16T10:37:40.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:37:39 smithi157 bash[24585]: audit 2024-09-16T10:37:38.647568+0000 mgr.a (mgr.14373) 12998 : audit [DBG] from='client.282954 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:37:40.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:37:39 smithi086 bash[24289]: cluster 2024-09-16T10:37:38.575145+0000 mgr.a (mgr.14373) 12997 : cluster [DBG] pgmap v9013: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 6.4 KiB/s rd, 341 B/s wr, 6 op/s 2024-09-16T10:37:40.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:37:39 smithi086 bash[24289]: audit 2024-09-16T10:37:38.647568+0000 mgr.a (mgr.14373) 12998 : audit [DBG] from='client.282954 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:37:40.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:37:39 smithi047 bash[22744]: cluster 2024-09-16T10:37:38.575145+0000 mgr.a (mgr.14373) 12997 : cluster [DBG] pgmap v9013: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 6.4 KiB/s rd, 341 B/s wr, 6 op/s 2024-09-16T10:37:40.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:37:39 smithi047 bash[22744]: audit 2024-09-16T10:37:38.647568+0000 mgr.a (mgr.14373) 12998 : audit [DBG] from='client.282954 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:37:42.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:37:41 smithi157 bash[24585]: cluster 2024-09-16T10:37:40.575981+0000 mgr.a (mgr.14373) 12999 : cluster [DBG] pgmap v9014: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:37:42.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:37:41 smithi086 bash[24289]: cluster 2024-09-16T10:37:40.575981+0000 mgr.a (mgr.14373) 12999 : cluster [DBG] pgmap v9014: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:37:42.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:37:41 smithi047 bash[22744]: cluster 2024-09-16T10:37:40.575981+0000 mgr.a (mgr.14373) 12999 : cluster [DBG] pgmap v9014: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:37:44.071 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:37:44.072 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:37:44.072 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:37:44.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:37:43 smithi157 bash[24585]: cluster 2024-09-16T10:37:42.578780+0000 mgr.a (mgr.14373) 13000 : cluster [DBG] pgmap v9015: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:37:44.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:37:43 smithi086 bash[24289]: cluster 2024-09-16T10:37:42.578780+0000 mgr.a (mgr.14373) 13000 : cluster [DBG] pgmap v9015: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:37:44.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:37:43 smithi047 bash[22744]: cluster 2024-09-16T10:37:42.578780+0000 mgr.a (mgr.14373) 13000 : cluster [DBG] pgmap v9015: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:37:44.826 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:37:44.826 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:37:44.826 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:37:44.826 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:37:44.826 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:37:45.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:37:45 smithi157 bash[24585]: audit 2024-09-16T10:37:44.405720+0000 mgr.a (mgr.14373) 13001 : audit [DBG] from='client.283029 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:37:45.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:37:45 smithi086 bash[24289]: audit 2024-09-16T10:37:44.405720+0000 mgr.a (mgr.14373) 13001 : audit [DBG] from='client.283029 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:37:45.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:37:45 smithi047 bash[22744]: audit 2024-09-16T10:37:44.405720+0000 mgr.a (mgr.14373) 13001 : audit [DBG] from='client.283029 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:37:46.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:37:46 smithi157 bash[24585]: cluster 2024-09-16T10:37:44.579429+0000 mgr.a (mgr.14373) 13002 : cluster [DBG] pgmap v9016: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:37:46.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:37:46 smithi086 bash[24289]: cluster 2024-09-16T10:37:44.579429+0000 mgr.a (mgr.14373) 13002 : cluster [DBG] pgmap v9016: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:37:46.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:37:46 smithi047 bash[22744]: cluster 2024-09-16T10:37:44.579429+0000 mgr.a (mgr.14373) 13002 : cluster [DBG] pgmap v9016: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:37:48.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:37:48 smithi157 bash[24585]: cluster 2024-09-16T10:37:46.581431+0000 mgr.a (mgr.14373) 13003 : cluster [DBG] pgmap v9017: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-16T10:37:48.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:37:48 smithi086 bash[24289]: cluster 2024-09-16T10:37:46.581431+0000 mgr.a (mgr.14373) 13003 : cluster [DBG] pgmap v9017: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-16T10:37:48.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:37:48 smithi047 bash[22744]: cluster 2024-09-16T10:37:46.581431+0000 mgr.a (mgr.14373) 13003 : cluster [DBG] pgmap v9017: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-16T10:37:49.827 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:37:49.828 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:37:49.828 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:37:50.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:37:50 smithi157 bash[24585]: cluster 2024-09-16T10:37:48.582852+0000 mgr.a (mgr.14373) 13004 : cluster [DBG] pgmap v9018: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:37:50.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:37:50 smithi086 bash[24289]: cluster 2024-09-16T10:37:48.582852+0000 mgr.a (mgr.14373) 13004 : cluster [DBG] pgmap v9018: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:37:50.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:37:50 smithi047 bash[22744]: cluster 2024-09-16T10:37:48.582852+0000 mgr.a (mgr.14373) 13004 : cluster [DBG] pgmap v9018: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:37:50.611 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:37:50.611 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:37:50.611 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:37:50.611 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:37:50.611 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:37:51.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:37:51 smithi157 bash[24585]: audit 2024-09-16T10:37:50.161339+0000 mgr.a (mgr.14373) 13005 : audit [DBG] from='client.283104 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:37:51.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:37:51 smithi086 bash[24289]: audit 2024-09-16T10:37:50.161339+0000 mgr.a (mgr.14373) 13005 : audit [DBG] from='client.283104 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:37:51.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:37:51 smithi047 bash[22744]: audit 2024-09-16T10:37:50.161339+0000 mgr.a (mgr.14373) 13005 : audit [DBG] from='client.283104 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:37:52.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:37:52 smithi157 bash[24585]: cluster 2024-09-16T10:37:50.583430+0000 mgr.a (mgr.14373) 13006 : cluster [DBG] pgmap v9019: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:37:52.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:37:52 smithi086 bash[24289]: cluster 2024-09-16T10:37:50.583430+0000 mgr.a (mgr.14373) 13006 : cluster [DBG] pgmap v9019: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:37:52.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:37:52 smithi047 bash[22744]: cluster 2024-09-16T10:37:50.583430+0000 mgr.a (mgr.14373) 13006 : cluster [DBG] pgmap v9019: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:37:54.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:37:54 smithi157 bash[24585]: cluster 2024-09-16T10:37:52.585799+0000 mgr.a (mgr.14373) 13007 : cluster [DBG] pgmap v9020: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:37:54.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:37:54 smithi086 bash[24289]: cluster 2024-09-16T10:37:52.585799+0000 mgr.a (mgr.14373) 13007 : cluster [DBG] pgmap v9020: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:37:54.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:37:54 smithi047 bash[22744]: cluster 2024-09-16T10:37:52.585799+0000 mgr.a (mgr.14373) 13007 : cluster [DBG] pgmap v9020: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:37:55.612 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:37:55.613 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:37:55.613 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:37:56.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:37:56 smithi157 bash[24585]: cluster 2024-09-16T10:37:54.586758+0000 mgr.a (mgr.14373) 13008 : cluster [DBG] pgmap v9021: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:37:56.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:37:56 smithi086 bash[24289]: cluster 2024-09-16T10:37:54.586758+0000 mgr.a (mgr.14373) 13008 : cluster [DBG] pgmap v9021: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:37:56.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:37:56 smithi047 bash[22744]: cluster 2024-09-16T10:37:54.586758+0000 mgr.a (mgr.14373) 13008 : cluster [DBG] pgmap v9021: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:37:56.380 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:37:56.380 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:37:56.380 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:37:56.381 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:37:56.381 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:37:57.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:37:57 smithi157 bash[24585]: audit 2024-09-16T10:37:55.953294+0000 mgr.a (mgr.14373) 13009 : audit [DBG] from='client.283173 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:37:57.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:37:57 smithi086 bash[24289]: audit 2024-09-16T10:37:55.953294+0000 mgr.a (mgr.14373) 13009 : audit [DBG] from='client.283173 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:37:57.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:37:57 smithi047 bash[22744]: audit 2024-09-16T10:37:55.953294+0000 mgr.a (mgr.14373) 13009 : audit [DBG] from='client.283173 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:37:58.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:37:58 smithi157 bash[24585]: cluster 2024-09-16T10:37:56.588700+0000 mgr.a (mgr.14373) 13010 : cluster [DBG] pgmap v9022: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-16T10:37:58.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:37:58 smithi086 bash[24289]: cluster 2024-09-16T10:37:56.588700+0000 mgr.a (mgr.14373) 13010 : cluster [DBG] pgmap v9022: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-16T10:37:58.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:37:58 smithi047 bash[22744]: cluster 2024-09-16T10:37:56.588700+0000 mgr.a (mgr.14373) 13010 : cluster [DBG] pgmap v9022: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-16T10:38:00.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:38:00 smithi157 bash[24585]: cluster 2024-09-16T10:37:58.589939+0000 mgr.a (mgr.14373) 13011 : cluster [DBG] pgmap v9023: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-16T10:38:00.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:38:00 smithi086 bash[24289]: cluster 2024-09-16T10:37:58.589939+0000 mgr.a (mgr.14373) 13011 : cluster [DBG] pgmap v9023: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-16T10:38:00.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:38:00 smithi047 bash[22744]: cluster 2024-09-16T10:37:58.589939+0000 mgr.a (mgr.14373) 13011 : cluster [DBG] pgmap v9023: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-16T10:38:01.382 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:38:01.382 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:38:01.382 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:38:02.175 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:38:02.176 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:38:02.176 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:38:02.176 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:38:02.176 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:38:02.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:38:02 smithi157 bash[24585]: cluster 2024-09-16T10:38:00.590742+0000 mgr.a (mgr.14373) 13012 : cluster [DBG] pgmap v9024: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:38:02.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:38:02 smithi086 bash[24289]: cluster 2024-09-16T10:38:00.590742+0000 mgr.a (mgr.14373) 13012 : cluster [DBG] pgmap v9024: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:38:02.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:38:02 smithi047 bash[22744]: cluster 2024-09-16T10:38:00.590742+0000 mgr.a (mgr.14373) 13012 : cluster [DBG] pgmap v9024: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:38:03.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:38:03 smithi086 bash[24289]: audit 2024-09-16T10:38:01.719731+0000 mgr.a (mgr.14373) 13013 : audit [DBG] from='client.283248 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:38:03.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:38:03 smithi047 bash[22744]: audit 2024-09-16T10:38:01.719731+0000 mgr.a (mgr.14373) 13013 : audit [DBG] from='client.283248 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:38:03.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:38:03 smithi157 bash[24585]: audit 2024-09-16T10:38:01.719731+0000 mgr.a (mgr.14373) 13013 : audit [DBG] from='client.283248 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:38:04.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:38:04 smithi086 bash[24289]: cluster 2024-09-16T10:38:02.593432+0000 mgr.a (mgr.14373) 13014 : cluster [DBG] pgmap v9025: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:38:04.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:38:04 smithi047 bash[22744]: cluster 2024-09-16T10:38:02.593432+0000 mgr.a (mgr.14373) 13014 : cluster [DBG] pgmap v9025: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:38:04.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:38:04 smithi157 bash[24585]: cluster 2024-09-16T10:38:02.593432+0000 mgr.a (mgr.14373) 13014 : cluster [DBG] pgmap v9025: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:38:06.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:38:06 smithi086 bash[24289]: cluster 2024-09-16T10:38:04.594213+0000 mgr.a (mgr.14373) 13015 : cluster [DBG] pgmap v9026: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:38:06.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:38:06 smithi047 bash[22744]: cluster 2024-09-16T10:38:04.594213+0000 mgr.a (mgr.14373) 13015 : cluster [DBG] pgmap v9026: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:38:06.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:38:06 smithi157 bash[24585]: cluster 2024-09-16T10:38:04.594213+0000 mgr.a (mgr.14373) 13015 : cluster [DBG] pgmap v9026: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:38:07.177 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:38:07.205 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:38:07.205 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:38:07.962 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:38:07.962 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:38:07.962 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:38:07.962 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:38:07.962 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:38:08.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:38:08 smithi047 bash[22744]: cluster 2024-09-16T10:38:06.595758+0000 mgr.a (mgr.14373) 13016 : cluster [DBG] pgmap v9027: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 8.8 KiB/s rd, 0 B/s wr, 13 op/s 2024-09-16T10:38:08.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:38:08 smithi157 bash[24585]: cluster 2024-09-16T10:38:06.595758+0000 mgr.a (mgr.14373) 13016 : cluster [DBG] pgmap v9027: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 8.8 KiB/s rd, 0 B/s wr, 13 op/s 2024-09-16T10:38:08.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:38:08 smithi086 bash[24289]: cluster 2024-09-16T10:38:06.595758+0000 mgr.a (mgr.14373) 13016 : cluster [DBG] pgmap v9027: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 8.8 KiB/s rd, 0 B/s wr, 13 op/s 2024-09-16T10:38:09.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:38:09 smithi047 bash[22744]: audit 2024-09-16T10:38:07.509719+0000 mgr.a (mgr.14373) 13017 : audit [DBG] from='client.283326 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:38:09.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:38:09 smithi157 bash[24585]: audit 2024-09-16T10:38:07.509719+0000 mgr.a (mgr.14373) 13017 : audit [DBG] from='client.283326 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:38:09.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:38:09 smithi086 bash[24289]: audit 2024-09-16T10:38:07.509719+0000 mgr.a (mgr.14373) 13017 : audit [DBG] from='client.283326 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:38:10.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:38:10 smithi047 bash[22744]: cluster 2024-09-16T10:38:08.597621+0000 mgr.a (mgr.14373) 13018 : cluster [DBG] pgmap v9028: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 13 KiB/s rd, 0 B/s wr, 21 op/s 2024-09-16T10:38:10.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:38:10 smithi157 bash[24585]: cluster 2024-09-16T10:38:08.597621+0000 mgr.a (mgr.14373) 13018 : cluster [DBG] pgmap v9028: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 13 KiB/s rd, 0 B/s wr, 21 op/s 2024-09-16T10:38:10.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:38:10 smithi086 bash[24289]: cluster 2024-09-16T10:38:08.597621+0000 mgr.a (mgr.14373) 13018 : cluster [DBG] pgmap v9028: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 13 KiB/s rd, 0 B/s wr, 21 op/s 2024-09-16T10:38:12.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:38:12 smithi047 bash[22744]: cluster 2024-09-16T10:38:10.598586+0000 mgr.a (mgr.14373) 13019 : cluster [DBG] pgmap v9029: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 13 KiB/s rd, 0 B/s wr, 21 op/s 2024-09-16T10:38:12.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:38:12 smithi157 bash[24585]: cluster 2024-09-16T10:38:10.598586+0000 mgr.a (mgr.14373) 13019 : cluster [DBG] pgmap v9029: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 13 KiB/s rd, 0 B/s wr, 21 op/s 2024-09-16T10:38:12.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:38:12 smithi086 bash[24289]: cluster 2024-09-16T10:38:10.598586+0000 mgr.a (mgr.14373) 13019 : cluster [DBG] pgmap v9029: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 13 KiB/s rd, 0 B/s wr, 21 op/s 2024-09-16T10:38:12.963 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:38:12.964 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:38:12.964 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:38:13.730 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:38:13.730 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:38:13.730 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:38:13.730 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:38:13.730 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:38:14.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:38:14 smithi047 bash[22744]: cluster 2024-09-16T10:38:12.600829+0000 mgr.a (mgr.14373) 13020 : cluster [DBG] pgmap v9030: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 14 KiB/s rd, 0 B/s wr, 22 op/s 2024-09-16T10:38:14.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:38:14 smithi047 bash[22744]: audit 2024-09-16T10:38:13.297179+0000 mgr.a (mgr.14373) 13021 : audit [DBG] from='client.283401 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:38:14.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:38:14 smithi157 bash[24585]: cluster 2024-09-16T10:38:12.600829+0000 mgr.a (mgr.14373) 13020 : cluster [DBG] pgmap v9030: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 14 KiB/s rd, 0 B/s wr, 22 op/s 2024-09-16T10:38:14.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:38:14 smithi157 bash[24585]: audit 2024-09-16T10:38:13.297179+0000 mgr.a (mgr.14373) 13021 : audit [DBG] from='client.283401 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:38:14.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:38:14 smithi086 bash[24289]: cluster 2024-09-16T10:38:12.600829+0000 mgr.a (mgr.14373) 13020 : cluster [DBG] pgmap v9030: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 14 KiB/s rd, 0 B/s wr, 22 op/s 2024-09-16T10:38:14.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:38:14 smithi086 bash[24289]: audit 2024-09-16T10:38:13.297179+0000 mgr.a (mgr.14373) 13021 : audit [DBG] from='client.283401 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:38:16.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:38:16 smithi157 bash[24585]: cluster 2024-09-16T10:38:14.601787+0000 mgr.a (mgr.14373) 13022 : cluster [DBG] pgmap v9031: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 14 KiB/s rd, 0 B/s wr, 22 op/s 2024-09-16T10:38:16.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:38:16 smithi086 bash[24289]: cluster 2024-09-16T10:38:14.601787+0000 mgr.a (mgr.14373) 13022 : cluster [DBG] pgmap v9031: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 14 KiB/s rd, 0 B/s wr, 22 op/s 2024-09-16T10:38:16.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:38:16 smithi047 bash[22744]: cluster 2024-09-16T10:38:14.601787+0000 mgr.a (mgr.14373) 13022 : cluster [DBG] pgmap v9031: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 14 KiB/s rd, 0 B/s wr, 22 op/s 2024-09-16T10:38:18.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:38:18 smithi157 bash[24585]: cluster 2024-09-16T10:38:16.603956+0000 mgr.a (mgr.14373) 13023 : cluster [DBG] pgmap v9032: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 15 KiB/s rd, 0 B/s wr, 22 op/s 2024-09-16T10:38:18.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:38:18 smithi086 bash[24289]: cluster 2024-09-16T10:38:16.603956+0000 mgr.a (mgr.14373) 13023 : cluster [DBG] pgmap v9032: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 15 KiB/s rd, 0 B/s wr, 22 op/s 2024-09-16T10:38:18.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:38:18 smithi047 bash[22744]: cluster 2024-09-16T10:38:16.603956+0000 mgr.a (mgr.14373) 13023 : cluster [DBG] pgmap v9032: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 15 KiB/s rd, 0 B/s wr, 22 op/s 2024-09-16T10:38:18.731 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:38:18.732 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:38:18.732 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:38:19.517 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:38:19.518 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:38:19.518 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:38:19.518 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:38:19.518 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:38:20.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:38:20 smithi157 bash[24585]: cluster 2024-09-16T10:38:18.604719+0000 mgr.a (mgr.14373) 13024 : cluster [DBG] pgmap v9033: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.1 KiB/s rd, 0 B/s wr, 10 op/s 2024-09-16T10:38:20.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:38:20 smithi157 bash[24585]: audit 2024-09-16T10:38:19.060270+0000 mgr.a (mgr.14373) 13025 : audit [DBG] from='client.283479 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:38:20.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:38:20 smithi086 bash[24289]: cluster 2024-09-16T10:38:18.604719+0000 mgr.a (mgr.14373) 13024 : cluster [DBG] pgmap v9033: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.1 KiB/s rd, 0 B/s wr, 10 op/s 2024-09-16T10:38:20.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:38:20 smithi086 bash[24289]: audit 2024-09-16T10:38:19.060270+0000 mgr.a (mgr.14373) 13025 : audit [DBG] from='client.283479 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:38:20.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:38:20 smithi047 bash[22744]: cluster 2024-09-16T10:38:18.604719+0000 mgr.a (mgr.14373) 13024 : cluster [DBG] pgmap v9033: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.1 KiB/s rd, 0 B/s wr, 10 op/s 2024-09-16T10:38:20.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:38:20 smithi047 bash[22744]: audit 2024-09-16T10:38:19.060270+0000 mgr.a (mgr.14373) 13025 : audit [DBG] from='client.283479 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:38:22.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:38:22 smithi157 bash[24585]: cluster 2024-09-16T10:38:20.605621+0000 mgr.a (mgr.14373) 13026 : cluster [DBG] pgmap v9034: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:38:22.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:38:22 smithi086 bash[24289]: cluster 2024-09-16T10:38:20.605621+0000 mgr.a (mgr.14373) 13026 : cluster [DBG] pgmap v9034: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:38:22.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:38:22 smithi047 bash[22744]: cluster 2024-09-16T10:38:20.605621+0000 mgr.a (mgr.14373) 13026 : cluster [DBG] pgmap v9034: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:38:23.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:38:23 smithi157 bash[24585]: audit 2024-09-16T10:38:22.581909+0000 mon.b (mon.2) 1194 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T10:38:23.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:38:23 smithi086 bash[24289]: audit 2024-09-16T10:38:22.581909+0000 mon.b (mon.2) 1194 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T10:38:23.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:38:23 smithi047 bash[22744]: audit 2024-09-16T10:38:22.581909+0000 mon.b (mon.2) 1194 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T10:38:24.519 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:38:24.519 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:38:24.519 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:38:24.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:38:24 smithi157 bash[24585]: cluster 2024-09-16T10:38:22.607887+0000 mgr.a (mgr.14373) 13027 : cluster [DBG] pgmap v9035: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:38:24.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:38:24 smithi157 bash[24585]: audit 2024-09-16T10:38:23.199721+0000 mon.a (mon.0) 1340 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:38:24.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:38:24 smithi157 bash[24585]: audit 2024-09-16T10:38:23.208682+0000 mon.a (mon.0) 1341 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:38:24.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:38:24 smithi157 bash[24585]: audit 2024-09-16T10:38:23.215319+0000 mon.a (mon.0) 1342 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:38:24.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:38:24 smithi157 bash[24585]: audit 2024-09-16T10:38:23.225683+0000 mon.a (mon.0) 1343 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:38:24.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:38:24 smithi157 bash[24585]: audit 2024-09-16T10:38:24.064994+0000 mon.b (mon.2) 1195 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T10:38:24.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:38:24 smithi157 bash[24585]: audit 2024-09-16T10:38:24.066828+0000 mon.b (mon.2) 1196 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T10:38:24.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:38:24 smithi157 bash[24585]: audit 2024-09-16T10:38:24.077591+0000 mon.a (mon.0) 1344 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:38:24.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:38:24 smithi157 bash[24585]: audit 2024-09-16T10:38:24.082798+0000 mon.b (mon.2) 1197 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:38:24.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:38:24 smithi086 bash[24289]: cluster 2024-09-16T10:38:22.607887+0000 mgr.a (mgr.14373) 13027 : cluster [DBG] pgmap v9035: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:38:24.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:38:24 smithi086 bash[24289]: audit 2024-09-16T10:38:23.199721+0000 mon.a (mon.0) 1340 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:38:24.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:38:24 smithi086 bash[24289]: audit 2024-09-16T10:38:23.208682+0000 mon.a (mon.0) 1341 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:38:24.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:38:24 smithi086 bash[24289]: audit 2024-09-16T10:38:23.215319+0000 mon.a (mon.0) 1342 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:38:24.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:38:24 smithi086 bash[24289]: audit 2024-09-16T10:38:23.225683+0000 mon.a (mon.0) 1343 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:38:24.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:38:24 smithi086 bash[24289]: audit 2024-09-16T10:38:24.064994+0000 mon.b (mon.2) 1195 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T10:38:24.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:38:24 smithi086 bash[24289]: audit 2024-09-16T10:38:24.066828+0000 mon.b (mon.2) 1196 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T10:38:24.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:38:24 smithi086 bash[24289]: audit 2024-09-16T10:38:24.077591+0000 mon.a (mon.0) 1344 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:38:24.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:38:24 smithi086 bash[24289]: audit 2024-09-16T10:38:24.082798+0000 mon.b (mon.2) 1197 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:38:24.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:38:24 smithi047 bash[22744]: cluster 2024-09-16T10:38:22.607887+0000 mgr.a (mgr.14373) 13027 : cluster [DBG] pgmap v9035: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:38:24.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:38:24 smithi047 bash[22744]: audit 2024-09-16T10:38:23.199721+0000 mon.a (mon.0) 1340 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:38:24.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:38:24 smithi047 bash[22744]: audit 2024-09-16T10:38:23.208682+0000 mon.a (mon.0) 1341 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:38:24.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:38:24 smithi047 bash[22744]: audit 2024-09-16T10:38:23.215319+0000 mon.a (mon.0) 1342 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:38:24.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:38:24 smithi047 bash[22744]: audit 2024-09-16T10:38:23.225683+0000 mon.a (mon.0) 1343 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:38:24.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:38:24 smithi047 bash[22744]: audit 2024-09-16T10:38:24.064994+0000 mon.b (mon.2) 1195 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T10:38:24.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:38:24 smithi047 bash[22744]: audit 2024-09-16T10:38:24.066828+0000 mon.b (mon.2) 1196 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T10:38:24.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:38:24 smithi047 bash[22744]: audit 2024-09-16T10:38:24.077591+0000 mon.a (mon.0) 1344 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:38:24.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:38:24 smithi047 bash[22744]: audit 2024-09-16T10:38:24.082798+0000 mon.b (mon.2) 1197 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:38:25.092 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 10:38:24 smithi047 bash[22994]: debug 2024-09-16T10:38:24.816+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T10:38:25.092 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 10:38:24 smithi047 bash[22994]: debug 2024-09-16T10:38:24.820+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T10:38:25.251 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:38:25.251 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:38:25.251 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:38:25.251 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:38:25.251 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:38:25.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:38:25 smithi157 bash[24585]: audit 2024-09-16T10:38:24.085485+0000 mgr.a (mgr.14373) 13028 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:38:25.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:38:25 smithi086 bash[24289]: audit 2024-09-16T10:38:24.085485+0000 mgr.a (mgr.14373) 13028 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:38:25.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:38:25 smithi047 bash[22744]: audit 2024-09-16T10:38:24.085485+0000 mgr.a (mgr.14373) 13028 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:38:26.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:38:26 smithi157 bash[24585]: cluster 2024-09-16T10:38:24.608632+0000 mgr.a (mgr.14373) 13029 : cluster [DBG] pgmap v9036: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:38:26.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:38:26 smithi157 bash[24585]: audit 2024-09-16T10:38:24.821563+0000 mgr.a (mgr.14373) 13030 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T10:38:26.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:38:26 smithi157 bash[24585]: cephadm 2024-09-16T10:38:24.823622+0000 mgr.a (mgr.14373) 13031 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T10:38:26.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:38:26 smithi157 bash[24585]: audit 2024-09-16T10:38:24.850667+0000 mgr.a (mgr.14373) 13032 : audit [DBG] from='client.283644 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:38:26.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:38:26 smithi086 bash[24289]: cluster 2024-09-16T10:38:24.608632+0000 mgr.a (mgr.14373) 13029 : cluster [DBG] pgmap v9036: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:38:26.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:38:26 smithi086 bash[24289]: audit 2024-09-16T10:38:24.821563+0000 mgr.a (mgr.14373) 13030 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T10:38:26.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:38:26 smithi086 bash[24289]: cephadm 2024-09-16T10:38:24.823622+0000 mgr.a (mgr.14373) 13031 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T10:38:26.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:38:26 smithi086 bash[24289]: audit 2024-09-16T10:38:24.850667+0000 mgr.a (mgr.14373) 13032 : audit [DBG] from='client.283644 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:38:26.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:38:26 smithi047 bash[22744]: cluster 2024-09-16T10:38:24.608632+0000 mgr.a (mgr.14373) 13029 : cluster [DBG] pgmap v9036: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:38:26.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:38:26 smithi047 bash[22744]: audit 2024-09-16T10:38:24.821563+0000 mgr.a (mgr.14373) 13030 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T10:38:26.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:38:26 smithi047 bash[22744]: cephadm 2024-09-16T10:38:24.823622+0000 mgr.a (mgr.14373) 13031 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T10:38:26.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:38:26 smithi047 bash[22744]: audit 2024-09-16T10:38:24.850667+0000 mgr.a (mgr.14373) 13032 : audit [DBG] from='client.283644 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:38:28.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:38:28 smithi157 bash[24585]: cluster 2024-09-16T10:38:26.611273+0000 mgr.a (mgr.14373) 13033 : cluster [DBG] pgmap v9037: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 14 KiB/s rd, 426 B/s wr, 18 op/s 2024-09-16T10:38:28.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:38:28 smithi086 bash[24289]: cluster 2024-09-16T10:38:26.611273+0000 mgr.a (mgr.14373) 13033 : cluster [DBG] pgmap v9037: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 14 KiB/s rd, 426 B/s wr, 18 op/s 2024-09-16T10:38:28.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:38:28 smithi047 bash[22744]: cluster 2024-09-16T10:38:26.611273+0000 mgr.a (mgr.14373) 13033 : cluster [DBG] pgmap v9037: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 14 KiB/s rd, 426 B/s wr, 18 op/s 2024-09-16T10:38:30.253 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:38:30.253 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:38:30.253 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:38:30.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:38:30 smithi157 bash[24585]: cluster 2024-09-16T10:38:28.612090+0000 mgr.a (mgr.14373) 13034 : cluster [DBG] pgmap v9038: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 13 KiB/s rd, 426 B/s wr, 17 op/s 2024-09-16T10:38:30.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:38:30 smithi086 bash[24289]: cluster 2024-09-16T10:38:28.612090+0000 mgr.a (mgr.14373) 13034 : cluster [DBG] pgmap v9038: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 13 KiB/s rd, 426 B/s wr, 17 op/s 2024-09-16T10:38:30.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:38:30 smithi047 bash[22744]: cluster 2024-09-16T10:38:28.612090+0000 mgr.a (mgr.14373) 13034 : cluster [DBG] pgmap v9038: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 13 KiB/s rd, 426 B/s wr, 17 op/s 2024-09-16T10:38:31.005 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:38:31.005 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:38:31.005 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:38:31.005 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:38:31.006 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:38:32.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:38:32 smithi157 bash[24585]: audit 2024-09-16T10:38:30.580686+0000 mgr.a (mgr.14373) 13035 : audit [DBG] from='client.283740 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:38:32.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:38:32 smithi157 bash[24585]: cluster 2024-09-16T10:38:30.613249+0000 mgr.a (mgr.14373) 13036 : cluster [DBG] pgmap v9039: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 13 KiB/s rd, 426 B/s wr, 17 op/s 2024-09-16T10:38:32.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:38:32 smithi086 bash[24289]: audit 2024-09-16T10:38:30.580686+0000 mgr.a (mgr.14373) 13035 : audit [DBG] from='client.283740 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:38:32.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:38:32 smithi086 bash[24289]: cluster 2024-09-16T10:38:30.613249+0000 mgr.a (mgr.14373) 13036 : cluster [DBG] pgmap v9039: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 13 KiB/s rd, 426 B/s wr, 17 op/s 2024-09-16T10:38:32.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:38:32 smithi047 bash[22744]: audit 2024-09-16T10:38:30.580686+0000 mgr.a (mgr.14373) 13035 : audit [DBG] from='client.283740 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:38:32.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:38:32 smithi047 bash[22744]: cluster 2024-09-16T10:38:30.613249+0000 mgr.a (mgr.14373) 13036 : cluster [DBG] pgmap v9039: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 13 KiB/s rd, 426 B/s wr, 17 op/s 2024-09-16T10:38:34.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:38:34 smithi157 bash[24585]: cluster 2024-09-16T10:38:32.615709+0000 mgr.a (mgr.14373) 13037 : cluster [DBG] pgmap v9040: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 71 KiB/s rd, 426 B/s wr, 113 op/s 2024-09-16T10:38:34.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:38:34 smithi086 bash[24289]: cluster 2024-09-16T10:38:32.615709+0000 mgr.a (mgr.14373) 13037 : cluster [DBG] pgmap v9040: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 71 KiB/s rd, 426 B/s wr, 113 op/s 2024-09-16T10:38:34.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:38:34 smithi047 bash[22744]: cluster 2024-09-16T10:38:32.615709+0000 mgr.a (mgr.14373) 13037 : cluster [DBG] pgmap v9040: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 71 KiB/s rd, 426 B/s wr, 113 op/s 2024-09-16T10:38:36.007 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:38:36.007 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:38:36.007 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:38:36.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:38:36 smithi157 bash[24585]: cluster 2024-09-16T10:38:34.616485+0000 mgr.a (mgr.14373) 13038 : cluster [DBG] pgmap v9041: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 70 KiB/s rd, 426 B/s wr, 112 op/s 2024-09-16T10:38:36.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:38:36 smithi086 bash[24289]: cluster 2024-09-16T10:38:34.616485+0000 mgr.a (mgr.14373) 13038 : cluster [DBG] pgmap v9041: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 70 KiB/s rd, 426 B/s wr, 112 op/s 2024-09-16T10:38:36.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:38:36 smithi047 bash[22744]: cluster 2024-09-16T10:38:34.616485+0000 mgr.a (mgr.14373) 13038 : cluster [DBG] pgmap v9041: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 70 KiB/s rd, 426 B/s wr, 112 op/s 2024-09-16T10:38:36.769 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:38:36.769 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:38:36.770 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:38:36.770 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:38:36.770 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:38:37.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:38:37 smithi157 bash[24585]: audit 2024-09-16T10:38:36.340199+0000 mgr.a (mgr.14373) 13039 : audit [DBG] from='client.283818 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:38:37.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:38:37 smithi086 bash[24289]: audit 2024-09-16T10:38:36.340199+0000 mgr.a (mgr.14373) 13039 : audit [DBG] from='client.283818 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:38:37.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:38:37 smithi047 bash[22744]: audit 2024-09-16T10:38:36.340199+0000 mgr.a (mgr.14373) 13039 : audit [DBG] from='client.283818 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:38:38.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:38:38 smithi157 bash[24585]: cluster 2024-09-16T10:38:36.617626+0000 mgr.a (mgr.14373) 13040 : cluster [DBG] pgmap v9042: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 71 KiB/s rd, 426 B/s wr, 112 op/s 2024-09-16T10:38:38.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:38:38 smithi086 bash[24289]: cluster 2024-09-16T10:38:36.617626+0000 mgr.a (mgr.14373) 13040 : cluster [DBG] pgmap v9042: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 71 KiB/s rd, 426 B/s wr, 112 op/s 2024-09-16T10:38:38.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:38:38 smithi047 bash[22744]: cluster 2024-09-16T10:38:36.617626+0000 mgr.a (mgr.14373) 13040 : cluster [DBG] pgmap v9042: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 71 KiB/s rd, 426 B/s wr, 112 op/s 2024-09-16T10:38:40.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:38:40 smithi157 bash[24585]: cluster 2024-09-16T10:38:38.618515+0000 mgr.a (mgr.14373) 13041 : cluster [DBG] pgmap v9043: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 58 KiB/s rd, 0 B/s wr, 96 op/s 2024-09-16T10:38:40.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:38:40 smithi086 bash[24289]: cluster 2024-09-16T10:38:38.618515+0000 mgr.a (mgr.14373) 13041 : cluster [DBG] pgmap v9043: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 58 KiB/s rd, 0 B/s wr, 96 op/s 2024-09-16T10:38:40.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:38:40 smithi047 bash[22744]: cluster 2024-09-16T10:38:38.618515+0000 mgr.a (mgr.14373) 13041 : cluster [DBG] pgmap v9043: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 58 KiB/s rd, 0 B/s wr, 96 op/s 2024-09-16T10:38:41.771 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:38:41.771 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:38:41.771 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:38:42.549 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:38:42.549 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:38:42.549 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:38:42.550 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:38:42.550 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:38:42.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:38:42 smithi157 bash[24585]: cluster 2024-09-16T10:38:40.619280+0000 mgr.a (mgr.14373) 13042 : cluster [DBG] pgmap v9044: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 58 KiB/s rd, 0 B/s wr, 96 op/s 2024-09-16T10:38:42.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:38:42 smithi086 bash[24289]: cluster 2024-09-16T10:38:40.619280+0000 mgr.a (mgr.14373) 13042 : cluster [DBG] pgmap v9044: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 58 KiB/s rd, 0 B/s wr, 96 op/s 2024-09-16T10:38:42.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:38:42 smithi047 bash[22744]: cluster 2024-09-16T10:38:40.619280+0000 mgr.a (mgr.14373) 13042 : cluster [DBG] pgmap v9044: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 58 KiB/s rd, 0 B/s wr, 96 op/s 2024-09-16T10:38:43.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:38:43 smithi157 bash[24585]: audit 2024-09-16T10:38:42.108155+0000 mgr.a (mgr.14373) 13043 : audit [DBG] from='client.283896 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:38:43.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:38:43 smithi086 bash[24289]: audit 2024-09-16T10:38:42.108155+0000 mgr.a (mgr.14373) 13043 : audit [DBG] from='client.283896 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:38:43.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:38:43 smithi047 bash[22744]: audit 2024-09-16T10:38:42.108155+0000 mgr.a (mgr.14373) 13043 : audit [DBG] from='client.283896 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:38:44.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:38:44 smithi157 bash[24585]: cluster 2024-09-16T10:38:42.621551+0000 mgr.a (mgr.14373) 13044 : cluster [DBG] pgmap v9045: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 59 KiB/s rd, 0 B/s wr, 97 op/s 2024-09-16T10:38:44.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:38:44 smithi086 bash[24289]: cluster 2024-09-16T10:38:42.621551+0000 mgr.a (mgr.14373) 13044 : cluster [DBG] pgmap v9045: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 59 KiB/s rd, 0 B/s wr, 97 op/s 2024-09-16T10:38:44.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:38:44 smithi047 bash[22744]: cluster 2024-09-16T10:38:42.621551+0000 mgr.a (mgr.14373) 13044 : cluster [DBG] pgmap v9045: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 59 KiB/s rd, 0 B/s wr, 97 op/s 2024-09-16T10:38:46.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:38:46 smithi157 bash[24585]: cluster 2024-09-16T10:38:44.622325+0000 mgr.a (mgr.14373) 13045 : cluster [DBG] pgmap v9046: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T10:38:46.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:38:46 smithi086 bash[24289]: cluster 2024-09-16T10:38:44.622325+0000 mgr.a (mgr.14373) 13045 : cluster [DBG] pgmap v9046: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T10:38:46.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:38:46 smithi047 bash[22744]: cluster 2024-09-16T10:38:44.622325+0000 mgr.a (mgr.14373) 13045 : cluster [DBG] pgmap v9046: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T10:38:47.551 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:38:47.551 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:38:47.551 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:38:48.333 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:38:48.333 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:38:48.333 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:38:48.333 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:38:48.333 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:38:48.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:38:48 smithi157 bash[24585]: cluster 2024-09-16T10:38:46.624305+0000 mgr.a (mgr.14373) 13046 : cluster [DBG] pgmap v9047: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:38:48.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:38:48 smithi086 bash[24289]: cluster 2024-09-16T10:38:46.624305+0000 mgr.a (mgr.14373) 13046 : cluster [DBG] pgmap v9047: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:38:48.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:38:48 smithi047 bash[22744]: cluster 2024-09-16T10:38:46.624305+0000 mgr.a (mgr.14373) 13046 : cluster [DBG] pgmap v9047: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:38:49.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:38:49 smithi157 bash[24585]: audit 2024-09-16T10:38:47.890566+0000 mgr.a (mgr.14373) 13047 : audit [DBG] from='client.283971 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:38:49.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:38:49 smithi086 bash[24289]: audit 2024-09-16T10:38:47.890566+0000 mgr.a (mgr.14373) 13047 : audit [DBG] from='client.283971 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:38:49.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:38:49 smithi047 bash[22744]: audit 2024-09-16T10:38:47.890566+0000 mgr.a (mgr.14373) 13047 : audit [DBG] from='client.283971 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:38:50.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:38:50 smithi157 bash[24585]: cluster 2024-09-16T10:38:48.625237+0000 mgr.a (mgr.14373) 13048 : cluster [DBG] pgmap v9048: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-16T10:38:50.572 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:38:50 smithi086 bash[24289]: cluster 2024-09-16T10:38:48.625237+0000 mgr.a (mgr.14373) 13048 : cluster [DBG] pgmap v9048: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-16T10:38:50.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:38:50 smithi047 bash[22744]: cluster 2024-09-16T10:38:48.625237+0000 mgr.a (mgr.14373) 13048 : cluster [DBG] pgmap v9048: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-16T10:38:52.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:38:52 smithi157 bash[24585]: cluster 2024-09-16T10:38:50.626007+0000 mgr.a (mgr.14373) 13049 : cluster [DBG] pgmap v9049: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-16T10:38:52.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:38:52 smithi086 bash[24289]: cluster 2024-09-16T10:38:50.626007+0000 mgr.a (mgr.14373) 13049 : cluster [DBG] pgmap v9049: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-16T10:38:52.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:38:52 smithi047 bash[22744]: cluster 2024-09-16T10:38:50.626007+0000 mgr.a (mgr.14373) 13049 : cluster [DBG] pgmap v9049: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-16T10:38:53.335 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:38:53.335 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:38:53.335 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:38:54.105 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:38:54.106 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:38:54.106 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:38:54.106 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:38:54.106 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:38:54.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:38:54 smithi157 bash[24585]: cluster 2024-09-16T10:38:52.628218+0000 mgr.a (mgr.14373) 13050 : cluster [DBG] pgmap v9050: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:38:54.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:38:54 smithi086 bash[24289]: cluster 2024-09-16T10:38:52.628218+0000 mgr.a (mgr.14373) 13050 : cluster [DBG] pgmap v9050: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:38:54.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:38:54 smithi047 bash[22744]: cluster 2024-09-16T10:38:52.628218+0000 mgr.a (mgr.14373) 13050 : cluster [DBG] pgmap v9050: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:38:55.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:38:55 smithi086 bash[24289]: audit 2024-09-16T10:38:53.673949+0000 mgr.a (mgr.14373) 13051 : audit [DBG] from='client.284049 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:38:55.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:38:55 smithi047 bash[22744]: audit 2024-09-16T10:38:53.673949+0000 mgr.a (mgr.14373) 13051 : audit [DBG] from='client.284049 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:38:55.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:38:55 smithi157 bash[24585]: audit 2024-09-16T10:38:53.673949+0000 mgr.a (mgr.14373) 13051 : audit [DBG] from='client.284049 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:38:56.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:38:56 smithi157 bash[24585]: cluster 2024-09-16T10:38:54.629324+0000 mgr.a (mgr.14373) 13052 : cluster [DBG] pgmap v9051: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:38:56.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:38:56 smithi086 bash[24289]: cluster 2024-09-16T10:38:54.629324+0000 mgr.a (mgr.14373) 13052 : cluster [DBG] pgmap v9051: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:38:56.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:38:56 smithi047 bash[22744]: cluster 2024-09-16T10:38:54.629324+0000 mgr.a (mgr.14373) 13052 : cluster [DBG] pgmap v9051: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:38:58.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:38:58 smithi157 bash[24585]: cluster 2024-09-16T10:38:56.631547+0000 mgr.a (mgr.14373) 13053 : cluster [DBG] pgmap v9052: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:38:58.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:38:58 smithi086 bash[24289]: cluster 2024-09-16T10:38:56.631547+0000 mgr.a (mgr.14373) 13053 : cluster [DBG] pgmap v9052: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:38:58.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:38:58 smithi047 bash[22744]: cluster 2024-09-16T10:38:56.631547+0000 mgr.a (mgr.14373) 13053 : cluster [DBG] pgmap v9052: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:38:59.107 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:38:59.108 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:38:59.108 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:38:59.853 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:38:59.853 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:38:59.853 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:38:59.853 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:38:59.854 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:39:00.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:39:00 smithi086 bash[24289]: cluster 2024-09-16T10:38:58.632352+0000 mgr.a (mgr.14373) 13054 : cluster [DBG] pgmap v9053: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:39:00.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:39:00 smithi086 bash[24289]: audit 2024-09-16T10:38:59.431265+0000 mgr.a (mgr.14373) 13055 : audit [DBG] from='client.284127 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:39:00.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:39:00 smithi047 bash[22744]: cluster 2024-09-16T10:38:58.632352+0000 mgr.a (mgr.14373) 13054 : cluster [DBG] pgmap v9053: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:39:00.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:39:00 smithi047 bash[22744]: audit 2024-09-16T10:38:59.431265+0000 mgr.a (mgr.14373) 13055 : audit [DBG] from='client.284127 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:39:00.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:39:00 smithi157 bash[24585]: cluster 2024-09-16T10:38:58.632352+0000 mgr.a (mgr.14373) 13054 : cluster [DBG] pgmap v9053: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:39:00.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:39:00 smithi157 bash[24585]: audit 2024-09-16T10:38:59.431265+0000 mgr.a (mgr.14373) 13055 : audit [DBG] from='client.284127 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:39:02.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:39:02 smithi086 bash[24289]: cluster 2024-09-16T10:39:00.633375+0000 mgr.a (mgr.14373) 13056 : cluster [DBG] pgmap v9054: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:39:02.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:39:02 smithi047 bash[22744]: cluster 2024-09-16T10:39:00.633375+0000 mgr.a (mgr.14373) 13056 : cluster [DBG] pgmap v9054: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:39:02.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:39:02 smithi157 bash[24585]: cluster 2024-09-16T10:39:00.633375+0000 mgr.a (mgr.14373) 13056 : cluster [DBG] pgmap v9054: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:39:04.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:39:04 smithi086 bash[24289]: cluster 2024-09-16T10:39:02.635722+0000 mgr.a (mgr.14373) 13057 : cluster [DBG] pgmap v9055: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:39:04.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:39:04 smithi047 bash[22744]: cluster 2024-09-16T10:39:02.635722+0000 mgr.a (mgr.14373) 13057 : cluster [DBG] pgmap v9055: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:39:04.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:39:04 smithi157 bash[24585]: cluster 2024-09-16T10:39:02.635722+0000 mgr.a (mgr.14373) 13057 : cluster [DBG] pgmap v9055: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:39:04.855 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:39:04.856 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:39:04.856 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:39:05.601 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:39:05.601 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:39:05.601 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:39:05.601 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:39:05.602 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:39:06.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:39:06 smithi047 bash[22744]: cluster 2024-09-16T10:39:04.636531+0000 mgr.a (mgr.14373) 13058 : cluster [DBG] pgmap v9056: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:39:06.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:39:06 smithi047 bash[22744]: audit 2024-09-16T10:39:05.184803+0000 mgr.a (mgr.14373) 13059 : audit [DBG] from='client.284205 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:39:06.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:39:06 smithi157 bash[24585]: cluster 2024-09-16T10:39:04.636531+0000 mgr.a (mgr.14373) 13058 : cluster [DBG] pgmap v9056: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:39:06.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:39:06 smithi157 bash[24585]: audit 2024-09-16T10:39:05.184803+0000 mgr.a (mgr.14373) 13059 : audit [DBG] from='client.284205 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:39:06.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:39:06 smithi086 bash[24289]: cluster 2024-09-16T10:39:04.636531+0000 mgr.a (mgr.14373) 13058 : cluster [DBG] pgmap v9056: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:39:06.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:39:06 smithi086 bash[24289]: audit 2024-09-16T10:39:05.184803+0000 mgr.a (mgr.14373) 13059 : audit [DBG] from='client.284205 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:39:08.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:39:08 smithi047 bash[22744]: cluster 2024-09-16T10:39:06.638902+0000 mgr.a (mgr.14373) 13060 : cluster [DBG] pgmap v9057: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:39:08.808 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:39:08 smithi157 bash[24585]: cluster 2024-09-16T10:39:06.638902+0000 mgr.a (mgr.14373) 13060 : cluster [DBG] pgmap v9057: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:39:08.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:39:08 smithi086 bash[24289]: cluster 2024-09-16T10:39:06.638902+0000 mgr.a (mgr.14373) 13060 : cluster [DBG] pgmap v9057: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:39:10.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:39:10 smithi047 bash[22744]: cluster 2024-09-16T10:39:08.639699+0000 mgr.a (mgr.14373) 13061 : cluster [DBG] pgmap v9058: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:39:10.602 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:39:10.603 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:39:10.603 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:39:10.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:39:10 smithi157 bash[24585]: cluster 2024-09-16T10:39:08.639699+0000 mgr.a (mgr.14373) 13061 : cluster [DBG] pgmap v9058: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:39:10.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:39:10 smithi086 bash[24289]: cluster 2024-09-16T10:39:08.639699+0000 mgr.a (mgr.14373) 13061 : cluster [DBG] pgmap v9058: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:39:11.383 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:39:11.384 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:39:11.384 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:39:11.384 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:39:11.384 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:39:12.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:39:12 smithi047 bash[22744]: cluster 2024-09-16T10:39:10.640361+0000 mgr.a (mgr.14373) 13062 : cluster [DBG] pgmap v9059: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:39:12.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:39:12 smithi047 bash[22744]: audit 2024-09-16T10:39:10.938888+0000 mgr.a (mgr.14373) 13063 : audit [DBG] from='client.284283 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:39:12.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:39:12 smithi157 bash[24585]: cluster 2024-09-16T10:39:10.640361+0000 mgr.a (mgr.14373) 13062 : cluster [DBG] pgmap v9059: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:39:12.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:39:12 smithi157 bash[24585]: audit 2024-09-16T10:39:10.938888+0000 mgr.a (mgr.14373) 13063 : audit [DBG] from='client.284283 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:39:12.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:39:12 smithi086 bash[24289]: cluster 2024-09-16T10:39:10.640361+0000 mgr.a (mgr.14373) 13062 : cluster [DBG] pgmap v9059: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:39:12.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:39:12 smithi086 bash[24289]: audit 2024-09-16T10:39:10.938888+0000 mgr.a (mgr.14373) 13063 : audit [DBG] from='client.284283 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:39:14.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:39:14 smithi047 bash[22744]: cluster 2024-09-16T10:39:12.642829+0000 mgr.a (mgr.14373) 13064 : cluster [DBG] pgmap v9060: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:39:14.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:39:14 smithi157 bash[24585]: cluster 2024-09-16T10:39:12.642829+0000 mgr.a (mgr.14373) 13064 : cluster [DBG] pgmap v9060: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:39:14.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:39:14 smithi086 bash[24289]: cluster 2024-09-16T10:39:12.642829+0000 mgr.a (mgr.14373) 13064 : cluster [DBG] pgmap v9060: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:39:16.385 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:39:16.386 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:39:16.386 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:39:16.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:39:16 smithi047 bash[22744]: cluster 2024-09-16T10:39:14.643606+0000 mgr.a (mgr.14373) 13065 : cluster [DBG] pgmap v9061: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:39:16.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:39:16 smithi157 bash[24585]: cluster 2024-09-16T10:39:14.643606+0000 mgr.a (mgr.14373) 13065 : cluster [DBG] pgmap v9061: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:39:16.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:39:16 smithi086 bash[24289]: cluster 2024-09-16T10:39:14.643606+0000 mgr.a (mgr.14373) 13065 : cluster [DBG] pgmap v9061: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:39:17.171 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:39:17.171 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:39:17.171 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:39:17.171 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:39:17.172 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:39:18.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:39:18 smithi157 bash[24585]: cluster 2024-09-16T10:39:16.645486+0000 mgr.a (mgr.14373) 13066 : cluster [DBG] pgmap v9062: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:39:18.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:39:18 smithi157 bash[24585]: audit 2024-09-16T10:39:16.724294+0000 mgr.a (mgr.14373) 13067 : audit [DBG] from='client.284361 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:39:18.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:39:18 smithi086 bash[24289]: cluster 2024-09-16T10:39:16.645486+0000 mgr.a (mgr.14373) 13066 : cluster [DBG] pgmap v9062: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:39:18.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:39:18 smithi086 bash[24289]: audit 2024-09-16T10:39:16.724294+0000 mgr.a (mgr.14373) 13067 : audit [DBG] from='client.284361 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:39:18.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:39:18 smithi047 bash[22744]: cluster 2024-09-16T10:39:16.645486+0000 mgr.a (mgr.14373) 13066 : cluster [DBG] pgmap v9062: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:39:18.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:39:18 smithi047 bash[22744]: audit 2024-09-16T10:39:16.724294+0000 mgr.a (mgr.14373) 13067 : audit [DBG] from='client.284361 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:39:20.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:39:20 smithi157 bash[24585]: cluster 2024-09-16T10:39:18.646487+0000 mgr.a (mgr.14373) 13068 : cluster [DBG] pgmap v9063: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:39:20.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:39:20 smithi086 bash[24289]: cluster 2024-09-16T10:39:18.646487+0000 mgr.a (mgr.14373) 13068 : cluster [DBG] pgmap v9063: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:39:20.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:39:20 smithi047 bash[22744]: cluster 2024-09-16T10:39:18.646487+0000 mgr.a (mgr.14373) 13068 : cluster [DBG] pgmap v9063: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:39:22.173 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:39:22.174 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:39:22.174 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:39:22.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:39:22 smithi157 bash[24585]: cluster 2024-09-16T10:39:20.647249+0000 mgr.a (mgr.14373) 13069 : cluster [DBG] pgmap v9064: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T10:39:22.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:39:22 smithi086 bash[24289]: cluster 2024-09-16T10:39:20.647249+0000 mgr.a (mgr.14373) 13069 : cluster [DBG] pgmap v9064: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T10:39:22.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:39:22 smithi047 bash[22744]: cluster 2024-09-16T10:39:20.647249+0000 mgr.a (mgr.14373) 13069 : cluster [DBG] pgmap v9064: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T10:39:22.932 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:39:22.932 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:39:22.932 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:39:22.932 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:39:22.933 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:39:23.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:39:23 smithi157 bash[24585]: audit 2024-09-16T10:39:22.501044+0000 mgr.a (mgr.14373) 13070 : audit [DBG] from='client.284436 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:39:23.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:39:23 smithi086 bash[24289]: audit 2024-09-16T10:39:22.501044+0000 mgr.a (mgr.14373) 13070 : audit [DBG] from='client.284436 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:39:23.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:39:23 smithi047 bash[22744]: audit 2024-09-16T10:39:22.501044+0000 mgr.a (mgr.14373) 13070 : audit [DBG] from='client.284436 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:39:24.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:39:24 smithi157 bash[24585]: cluster 2024-09-16T10:39:22.648573+0000 mgr.a (mgr.14373) 13071 : cluster [DBG] pgmap v9065: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:39:24.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:39:24 smithi086 bash[24289]: cluster 2024-09-16T10:39:22.648573+0000 mgr.a (mgr.14373) 13071 : cluster [DBG] pgmap v9065: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:39:24.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:39:24 smithi047 bash[22744]: cluster 2024-09-16T10:39:22.648573+0000 mgr.a (mgr.14373) 13071 : cluster [DBG] pgmap v9065: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:39:25.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:39:25 smithi157 bash[24585]: audit 2024-09-16T10:39:24.885225+0000 mon.b (mon.2) 1198 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T10:39:25.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:39:25 smithi086 bash[24289]: audit 2024-09-16T10:39:24.885225+0000 mon.b (mon.2) 1198 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T10:39:25.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:39:25 smithi047 bash[22744]: audit 2024-09-16T10:39:24.885225+0000 mon.b (mon.2) 1198 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T10:39:26.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:39:26 smithi157 bash[24585]: cluster 2024-09-16T10:39:24.649451+0000 mgr.a (mgr.14373) 13072 : cluster [DBG] pgmap v9066: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T10:39:26.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:39:26 smithi157 bash[24585]: audit 2024-09-16T10:39:25.719833+0000 mon.b (mon.2) 1199 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T10:39:26.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:39:26 smithi157 bash[24585]: audit 2024-09-16T10:39:25.722000+0000 mon.b (mon.2) 1200 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T10:39:26.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:39:26 smithi157 bash[24585]: audit 2024-09-16T10:39:25.734361+0000 mon.a (mon.0) 1345 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:39:26.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:39:26 smithi157 bash[24585]: audit 2024-09-16T10:39:25.739852+0000 mon.b (mon.2) 1201 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:39:26.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:39:26 smithi086 bash[24289]: cluster 2024-09-16T10:39:24.649451+0000 mgr.a (mgr.14373) 13072 : cluster [DBG] pgmap v9066: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T10:39:26.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:39:26 smithi086 bash[24289]: audit 2024-09-16T10:39:25.719833+0000 mon.b (mon.2) 1199 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T10:39:26.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:39:26 smithi086 bash[24289]: audit 2024-09-16T10:39:25.722000+0000 mon.b (mon.2) 1200 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T10:39:26.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:39:26 smithi086 bash[24289]: audit 2024-09-16T10:39:25.734361+0000 mon.a (mon.0) 1345 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:39:26.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:39:26 smithi086 bash[24289]: audit 2024-09-16T10:39:25.739852+0000 mon.b (mon.2) 1201 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:39:26.842 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 10:39:26 smithi047 bash[22994]: debug 2024-09-16T10:39:26.466+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T10:39:26.843 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 10:39:26 smithi047 bash[22994]: debug 2024-09-16T10:39:26.470+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T10:39:26.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:39:26 smithi047 bash[22744]: cluster 2024-09-16T10:39:24.649451+0000 mgr.a (mgr.14373) 13072 : cluster [DBG] pgmap v9066: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T10:39:26.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:39:26 smithi047 bash[22744]: audit 2024-09-16T10:39:25.719833+0000 mon.b (mon.2) 1199 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T10:39:26.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:39:26 smithi047 bash[22744]: audit 2024-09-16T10:39:25.722000+0000 mon.b (mon.2) 1200 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T10:39:26.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:39:26 smithi047 bash[22744]: audit 2024-09-16T10:39:25.734361+0000 mon.a (mon.0) 1345 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:39:26.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:39:26 smithi047 bash[22744]: audit 2024-09-16T10:39:25.739852+0000 mon.b (mon.2) 1201 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:39:27.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:39:27 smithi157 bash[24585]: audit 2024-09-16T10:39:25.742843+0000 mgr.a (mgr.14373) 13073 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:39:27.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:39:27 smithi157 bash[24585]: audit 2024-09-16T10:39:26.474111+0000 mgr.a (mgr.14373) 13074 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T10:39:27.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:39:27 smithi157 bash[24585]: cephadm 2024-09-16T10:39:26.476432+0000 mgr.a (mgr.14373) 13075 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T10:39:27.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:39:27 smithi086 bash[24289]: audit 2024-09-16T10:39:25.742843+0000 mgr.a (mgr.14373) 13073 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:39:27.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:39:27 smithi086 bash[24289]: audit 2024-09-16T10:39:26.474111+0000 mgr.a (mgr.14373) 13074 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T10:39:27.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:39:27 smithi086 bash[24289]: cephadm 2024-09-16T10:39:26.476432+0000 mgr.a (mgr.14373) 13075 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T10:39:27.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:39:27 smithi047 bash[22744]: audit 2024-09-16T10:39:25.742843+0000 mgr.a (mgr.14373) 13073 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:39:27.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:39:27 smithi047 bash[22744]: audit 2024-09-16T10:39:26.474111+0000 mgr.a (mgr.14373) 13074 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T10:39:27.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:39:27 smithi047 bash[22744]: cephadm 2024-09-16T10:39:26.476432+0000 mgr.a (mgr.14373) 13075 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T10:39:27.933 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:39:27.934 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:39:27.935 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:39:28.684 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:39:28.684 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:39:28.684 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:39:28.684 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:39:28.684 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:39:28.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:39:28 smithi157 bash[24585]: cluster 2024-09-16T10:39:26.651732+0000 mgr.a (mgr.14373) 13076 : cluster [DBG] pgmap v9067: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-16T10:39:28.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:39:28 smithi086 bash[24289]: cluster 2024-09-16T10:39:26.651732+0000 mgr.a (mgr.14373) 13076 : cluster [DBG] pgmap v9067: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-16T10:39:28.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:39:28 smithi047 bash[22744]: cluster 2024-09-16T10:39:26.651732+0000 mgr.a (mgr.14373) 13076 : cluster [DBG] pgmap v9067: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-16T10:39:29.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:39:29 smithi157 bash[24585]: audit 2024-09-16T10:39:28.265834+0000 mgr.a (mgr.14373) 13077 : audit [DBG] from='client.284619 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:39:29.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:39:29 smithi086 bash[24289]: audit 2024-09-16T10:39:28.265834+0000 mgr.a (mgr.14373) 13077 : audit [DBG] from='client.284619 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:39:29.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:39:29 smithi047 bash[22744]: audit 2024-09-16T10:39:28.265834+0000 mgr.a (mgr.14373) 13077 : audit [DBG] from='client.284619 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:39:30.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:39:30 smithi157 bash[24585]: cluster 2024-09-16T10:39:28.652330+0000 mgr.a (mgr.14373) 13078 : cluster [DBG] pgmap v9068: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-16T10:39:30.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:39:30 smithi086 bash[24289]: cluster 2024-09-16T10:39:28.652330+0000 mgr.a (mgr.14373) 13078 : cluster [DBG] pgmap v9068: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-16T10:39:30.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:39:30 smithi047 bash[22744]: cluster 2024-09-16T10:39:28.652330+0000 mgr.a (mgr.14373) 13078 : cluster [DBG] pgmap v9068: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-16T10:39:32.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:39:32 smithi157 bash[24585]: cluster 2024-09-16T10:39:30.653071+0000 mgr.a (mgr.14373) 13079 : cluster [DBG] pgmap v9069: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-16T10:39:32.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:39:32 smithi086 bash[24289]: cluster 2024-09-16T10:39:30.653071+0000 mgr.a (mgr.14373) 13079 : cluster [DBG] pgmap v9069: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-16T10:39:32.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:39:32 smithi047 bash[22744]: cluster 2024-09-16T10:39:30.653071+0000 mgr.a (mgr.14373) 13079 : cluster [DBG] pgmap v9069: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-16T10:39:33.685 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:39:33.686 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:39:33.686 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:39:34.448 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:39:34.448 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:39:34.448 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:39:34.449 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:39:34.449 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:39:34.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:39:34 smithi157 bash[24585]: cluster 2024-09-16T10:39:32.655333+0000 mgr.a (mgr.14373) 13080 : cluster [DBG] pgmap v9070: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:39:34.822 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:39:34 smithi086 bash[24289]: cluster 2024-09-16T10:39:32.655333+0000 mgr.a (mgr.14373) 13080 : cluster [DBG] pgmap v9070: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:39:34.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:39:34 smithi047 bash[22744]: cluster 2024-09-16T10:39:32.655333+0000 mgr.a (mgr.14373) 13080 : cluster [DBG] pgmap v9070: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:39:35.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:39:35 smithi157 bash[24585]: audit 2024-09-16T10:39:34.014280+0000 mgr.a (mgr.14373) 13081 : audit [DBG] from='client.284697 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:39:35.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:39:35 smithi086 bash[24289]: audit 2024-09-16T10:39:34.014280+0000 mgr.a (mgr.14373) 13081 : audit [DBG] from='client.284697 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:39:35.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:39:35 smithi047 bash[22744]: audit 2024-09-16T10:39:34.014280+0000 mgr.a (mgr.14373) 13081 : audit [DBG] from='client.284697 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:39:36.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:39:36 smithi157 bash[24585]: cluster 2024-09-16T10:39:34.656285+0000 mgr.a (mgr.14373) 13082 : cluster [DBG] pgmap v9071: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:39:36.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:39:36 smithi086 bash[24289]: cluster 2024-09-16T10:39:34.656285+0000 mgr.a (mgr.14373) 13082 : cluster [DBG] pgmap v9071: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:39:36.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:39:36 smithi047 bash[22744]: cluster 2024-09-16T10:39:34.656285+0000 mgr.a (mgr.14373) 13082 : cluster [DBG] pgmap v9071: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:39:38.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:39:38 smithi157 bash[24585]: cluster 2024-09-16T10:39:36.658475+0000 mgr.a (mgr.14373) 13083 : cluster [DBG] pgmap v9072: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:39:38.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:39:38 smithi086 bash[24289]: cluster 2024-09-16T10:39:36.658475+0000 mgr.a (mgr.14373) 13083 : cluster [DBG] pgmap v9072: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:39:38.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:39:38 smithi047 bash[22744]: cluster 2024-09-16T10:39:36.658475+0000 mgr.a (mgr.14373) 13083 : cluster [DBG] pgmap v9072: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:39:39.449 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:39:39.450 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:39:39.450 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:39:40.233 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:39:40.234 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:39:40.234 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:39:40.234 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:39:40.234 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:39:40.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:39:40 smithi157 bash[24585]: cluster 2024-09-16T10:39:38.659228+0000 mgr.a (mgr.14373) 13084 : cluster [DBG] pgmap v9073: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 170 B/s wr, 2 op/s 2024-09-16T10:39:40.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:39:40 smithi086 bash[24289]: cluster 2024-09-16T10:39:38.659228+0000 mgr.a (mgr.14373) 13084 : cluster [DBG] pgmap v9073: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 170 B/s wr, 2 op/s 2024-09-16T10:39:40.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:39:40 smithi047 bash[22744]: cluster 2024-09-16T10:39:38.659228+0000 mgr.a (mgr.14373) 13084 : cluster [DBG] pgmap v9073: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 170 B/s wr, 2 op/s 2024-09-16T10:39:41.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:39:41 smithi157 bash[24585]: audit 2024-09-16T10:39:39.785287+0000 mgr.a (mgr.14373) 13085 : audit [DBG] from='client.284769 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:39:41.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:39:41 smithi086 bash[24289]: audit 2024-09-16T10:39:39.785287+0000 mgr.a (mgr.14373) 13085 : audit [DBG] from='client.284769 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:39:41.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:39:41 smithi047 bash[22744]: audit 2024-09-16T10:39:39.785287+0000 mgr.a (mgr.14373) 13085 : audit [DBG] from='client.284769 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:39:42.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:39:42 smithi157 bash[24585]: cluster 2024-09-16T10:39:40.660209+0000 mgr.a (mgr.14373) 13086 : cluster [DBG] pgmap v9074: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 170 B/s wr, 2 op/s 2024-09-16T10:39:42.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:39:42 smithi086 bash[24289]: cluster 2024-09-16T10:39:40.660209+0000 mgr.a (mgr.14373) 13086 : cluster [DBG] pgmap v9074: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 170 B/s wr, 2 op/s 2024-09-16T10:39:42.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:39:42 smithi047 bash[22744]: cluster 2024-09-16T10:39:40.660209+0000 mgr.a (mgr.14373) 13086 : cluster [DBG] pgmap v9074: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 170 B/s wr, 2 op/s 2024-09-16T10:39:44.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:39:44 smithi157 bash[24585]: cluster 2024-09-16T10:39:42.662568+0000 mgr.a (mgr.14373) 13087 : cluster [DBG] pgmap v9075: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 3.1 KiB/s rd, 170 B/s wr, 2 op/s 2024-09-16T10:39:44.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:39:44 smithi086 bash[24289]: cluster 2024-09-16T10:39:42.662568+0000 mgr.a (mgr.14373) 13087 : cluster [DBG] pgmap v9075: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 3.1 KiB/s rd, 170 B/s wr, 2 op/s 2024-09-16T10:39:44.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:39:44 smithi047 bash[22744]: cluster 2024-09-16T10:39:42.662568+0000 mgr.a (mgr.14373) 13087 : cluster [DBG] pgmap v9075: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 3.1 KiB/s rd, 170 B/s wr, 2 op/s 2024-09-16T10:39:45.235 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:39:45.235 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:39:45.235 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:39:46.017 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:39:46.017 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:39:46.017 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:39:46.017 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:39:46.018 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:39:46.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:39:46 smithi157 bash[24585]: cluster 2024-09-16T10:39:44.663338+0000 mgr.a (mgr.14373) 13088 : cluster [DBG] pgmap v9076: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:39:46.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:39:46 smithi086 bash[24289]: cluster 2024-09-16T10:39:44.663338+0000 mgr.a (mgr.14373) 13088 : cluster [DBG] pgmap v9076: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:39:46.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:39:46 smithi047 bash[22744]: cluster 2024-09-16T10:39:44.663338+0000 mgr.a (mgr.14373) 13088 : cluster [DBG] pgmap v9076: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:39:47.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:39:47 smithi157 bash[24585]: audit 2024-09-16T10:39:45.576483+0000 mgr.a (mgr.14373) 13089 : audit [DBG] from='client.284847 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:39:47.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:39:47 smithi086 bash[24289]: audit 2024-09-16T10:39:45.576483+0000 mgr.a (mgr.14373) 13089 : audit [DBG] from='client.284847 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:39:47.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:39:47 smithi047 bash[22744]: audit 2024-09-16T10:39:45.576483+0000 mgr.a (mgr.14373) 13089 : audit [DBG] from='client.284847 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:39:48.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:39:48 smithi157 bash[24585]: cluster 2024-09-16T10:39:46.665651+0000 mgr.a (mgr.14373) 13090 : cluster [DBG] pgmap v9077: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:39:48.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:39:48 smithi086 bash[24289]: cluster 2024-09-16T10:39:46.665651+0000 mgr.a (mgr.14373) 13090 : cluster [DBG] pgmap v9077: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:39:48.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:39:48 smithi047 bash[22744]: cluster 2024-09-16T10:39:46.665651+0000 mgr.a (mgr.14373) 13090 : cluster [DBG] pgmap v9077: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:39:50.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:39:50 smithi157 bash[24585]: cluster 2024-09-16T10:39:48.666462+0000 mgr.a (mgr.14373) 13091 : cluster [DBG] pgmap v9078: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:39:50.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:39:50 smithi086 bash[24289]: cluster 2024-09-16T10:39:48.666462+0000 mgr.a (mgr.14373) 13091 : cluster [DBG] pgmap v9078: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:39:50.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:39:50 smithi047 bash[22744]: cluster 2024-09-16T10:39:48.666462+0000 mgr.a (mgr.14373) 13091 : cluster [DBG] pgmap v9078: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:39:51.019 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:39:51.019 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:39:51.019 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:39:51.771 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:39:51.771 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:39:51.771 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:39:51.771 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:39:51.771 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:39:52.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:39:52 smithi157 bash[24585]: cluster 2024-09-16T10:39:50.667163+0000 mgr.a (mgr.14373) 13092 : cluster [DBG] pgmap v9079: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:39:52.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:39:52 smithi157 bash[24585]: audit 2024-09-16T10:39:51.354707+0000 mgr.a (mgr.14373) 13093 : audit [DBG] from='client.284922 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:39:52.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:39:52 smithi086 bash[24289]: cluster 2024-09-16T10:39:50.667163+0000 mgr.a (mgr.14373) 13092 : cluster [DBG] pgmap v9079: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:39:52.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:39:52 smithi086 bash[24289]: audit 2024-09-16T10:39:51.354707+0000 mgr.a (mgr.14373) 13093 : audit [DBG] from='client.284922 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:39:52.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:39:52 smithi047 bash[22744]: cluster 2024-09-16T10:39:50.667163+0000 mgr.a (mgr.14373) 13092 : cluster [DBG] pgmap v9079: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:39:52.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:39:52 smithi047 bash[22744]: audit 2024-09-16T10:39:51.354707+0000 mgr.a (mgr.14373) 13093 : audit [DBG] from='client.284922 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:39:54.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:39:54 smithi157 bash[24585]: cluster 2024-09-16T10:39:52.669914+0000 mgr.a (mgr.14373) 13094 : cluster [DBG] pgmap v9080: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-16T10:39:54.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:39:54 smithi086 bash[24289]: cluster 2024-09-16T10:39:52.669914+0000 mgr.a (mgr.14373) 13094 : cluster [DBG] pgmap v9080: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-16T10:39:54.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:39:54 smithi047 bash[22744]: cluster 2024-09-16T10:39:52.669914+0000 mgr.a (mgr.14373) 13094 : cluster [DBG] pgmap v9080: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-16T10:39:56.772 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:39:56.773 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:39:56.773 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:39:56.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:39:56 smithi157 bash[24585]: cluster 2024-09-16T10:39:54.670707+0000 mgr.a (mgr.14373) 13095 : cluster [DBG] pgmap v9081: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-16T10:39:56.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:39:56 smithi086 bash[24289]: cluster 2024-09-16T10:39:54.670707+0000 mgr.a (mgr.14373) 13095 : cluster [DBG] pgmap v9081: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-16T10:39:56.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:39:56 smithi047 bash[22744]: cluster 2024-09-16T10:39:54.670707+0000 mgr.a (mgr.14373) 13095 : cluster [DBG] pgmap v9081: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-16T10:39:57.529 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:39:57.530 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:39:57.530 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:39:57.530 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:39:57.530 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:39:58.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:39:58 smithi157 bash[24585]: cluster 2024-09-16T10:39:56.672630+0000 mgr.a (mgr.14373) 13096 : cluster [DBG] pgmap v9082: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:39:58.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:39:58 smithi157 bash[24585]: audit 2024-09-16T10:39:57.104039+0000 mgr.a (mgr.14373) 13097 : audit [DBG] from='client.285000 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:39:58.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:39:58 smithi086 bash[24289]: cluster 2024-09-16T10:39:56.672630+0000 mgr.a (mgr.14373) 13096 : cluster [DBG] pgmap v9082: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:39:58.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:39:58 smithi086 bash[24289]: audit 2024-09-16T10:39:57.104039+0000 mgr.a (mgr.14373) 13097 : audit [DBG] from='client.285000 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:39:58.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:39:58 smithi047 bash[22744]: cluster 2024-09-16T10:39:56.672630+0000 mgr.a (mgr.14373) 13096 : cluster [DBG] pgmap v9082: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:39:58.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:39:58 smithi047 bash[22744]: audit 2024-09-16T10:39:57.104039+0000 mgr.a (mgr.14373) 13097 : audit [DBG] from='client.285000 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:40:00.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:40:00 smithi157 bash[24585]: cluster 2024-09-16T10:39:58.673586+0000 mgr.a (mgr.14373) 13098 : cluster [DBG] pgmap v9083: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:40:00.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:40:00 smithi157 bash[24585]: cluster 2024-09-16T10:40:00.000148+0000 mon.a (mon.0) 1346 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-16T10:40:00.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:40:00 smithi086 bash[24289]: cluster 2024-09-16T10:39:58.673586+0000 mgr.a (mgr.14373) 13098 : cluster [DBG] pgmap v9083: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:40:00.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:40:00 smithi086 bash[24289]: cluster 2024-09-16T10:40:00.000148+0000 mon.a (mon.0) 1346 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-16T10:40:00.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:40:00 smithi047 bash[22744]: cluster 2024-09-16T10:39:58.673586+0000 mgr.a (mgr.14373) 13098 : cluster [DBG] pgmap v9083: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:40:00.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:40:00 smithi047 bash[22744]: cluster 2024-09-16T10:40:00.000148+0000 mon.a (mon.0) 1346 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-16T10:40:02.531 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:40:02.531 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:40:02.531 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:40:02.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:40:02 smithi157 bash[24585]: cluster 2024-09-16T10:40:00.674554+0000 mgr.a (mgr.14373) 13099 : cluster [DBG] pgmap v9084: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T10:40:02.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:40:02 smithi086 bash[24289]: cluster 2024-09-16T10:40:00.674554+0000 mgr.a (mgr.14373) 13099 : cluster [DBG] pgmap v9084: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T10:40:02.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:40:02 smithi047 bash[22744]: cluster 2024-09-16T10:40:00.674554+0000 mgr.a (mgr.14373) 13099 : cluster [DBG] pgmap v9084: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T10:40:03.313 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:40:03.314 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:40:03.314 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:40:03.314 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:40:03.314 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:40:04.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:40:04 smithi157 bash[24585]: cluster 2024-09-16T10:40:02.676194+0000 mgr.a (mgr.14373) 13100 : cluster [DBG] pgmap v9085: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:40:04.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:40:04 smithi157 bash[24585]: audit 2024-09-16T10:40:02.865914+0000 mgr.a (mgr.14373) 13101 : audit [DBG] from='client.285078 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:40:04.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:40:04 smithi086 bash[24289]: cluster 2024-09-16T10:40:02.676194+0000 mgr.a (mgr.14373) 13100 : cluster [DBG] pgmap v9085: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:40:04.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:40:04 smithi086 bash[24289]: audit 2024-09-16T10:40:02.865914+0000 mgr.a (mgr.14373) 13101 : audit [DBG] from='client.285078 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:40:04.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:40:04 smithi047 bash[22744]: cluster 2024-09-16T10:40:02.676194+0000 mgr.a (mgr.14373) 13100 : cluster [DBG] pgmap v9085: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:40:04.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:40:04 smithi047 bash[22744]: audit 2024-09-16T10:40:02.865914+0000 mgr.a (mgr.14373) 13101 : audit [DBG] from='client.285078 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:40:06.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:40:06 smithi157 bash[24585]: cluster 2024-09-16T10:40:04.677117+0000 mgr.a (mgr.14373) 13102 : cluster [DBG] pgmap v9086: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-16T10:40:06.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:40:06 smithi086 bash[24289]: cluster 2024-09-16T10:40:04.677117+0000 mgr.a (mgr.14373) 13102 : cluster [DBG] pgmap v9086: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-16T10:40:06.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:40:06 smithi047 bash[22744]: cluster 2024-09-16T10:40:04.677117+0000 mgr.a (mgr.14373) 13102 : cluster [DBG] pgmap v9086: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-16T10:40:08.315 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:40:08.316 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:40:08.316 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:40:08.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:40:08 smithi157 bash[24585]: cluster 2024-09-16T10:40:06.679311+0000 mgr.a (mgr.14373) 13103 : cluster [DBG] pgmap v9087: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:40:08.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:40:08 smithi086 bash[24289]: cluster 2024-09-16T10:40:06.679311+0000 mgr.a (mgr.14373) 13103 : cluster [DBG] pgmap v9087: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:40:08.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:40:08 smithi047 bash[22744]: cluster 2024-09-16T10:40:06.679311+0000 mgr.a (mgr.14373) 13103 : cluster [DBG] pgmap v9087: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:40:09.087 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:40:09.088 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:40:09.088 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:40:09.088 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:40:09.088 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:40:10.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:40:10 smithi157 bash[24585]: audit 2024-09-16T10:40:08.648753+0000 mgr.a (mgr.14373) 13104 : audit [DBG] from='client.285153 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:40:10.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:40:10 smithi157 bash[24585]: cluster 2024-09-16T10:40:08.680306+0000 mgr.a (mgr.14373) 13105 : cluster [DBG] pgmap v9088: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:40:10.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:40:10 smithi086 bash[24289]: audit 2024-09-16T10:40:08.648753+0000 mgr.a (mgr.14373) 13104 : audit [DBG] from='client.285153 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:40:10.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:40:10 smithi086 bash[24289]: cluster 2024-09-16T10:40:08.680306+0000 mgr.a (mgr.14373) 13105 : cluster [DBG] pgmap v9088: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:40:10.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:40:10 smithi047 bash[22744]: audit 2024-09-16T10:40:08.648753+0000 mgr.a (mgr.14373) 13104 : audit [DBG] from='client.285153 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:40:10.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:40:10 smithi047 bash[22744]: cluster 2024-09-16T10:40:08.680306+0000 mgr.a (mgr.14373) 13105 : cluster [DBG] pgmap v9088: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:40:12.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:40:12 smithi157 bash[24585]: cluster 2024-09-16T10:40:10.681277+0000 mgr.a (mgr.14373) 13106 : cluster [DBG] pgmap v9089: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:40:12.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:40:12 smithi086 bash[24289]: cluster 2024-09-16T10:40:10.681277+0000 mgr.a (mgr.14373) 13106 : cluster [DBG] pgmap v9089: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:40:12.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:40:12 smithi047 bash[22744]: cluster 2024-09-16T10:40:10.681277+0000 mgr.a (mgr.14373) 13106 : cluster [DBG] pgmap v9089: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:40:14.089 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:40:14.090 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:40:14.090 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:40:14.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:40:14 smithi157 bash[24585]: cluster 2024-09-16T10:40:12.683562+0000 mgr.a (mgr.14373) 13107 : cluster [DBG] pgmap v9090: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:40:14.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:40:14 smithi086 bash[24289]: cluster 2024-09-16T10:40:12.683562+0000 mgr.a (mgr.14373) 13107 : cluster [DBG] pgmap v9090: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:40:14.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:40:14 smithi047 bash[22744]: cluster 2024-09-16T10:40:12.683562+0000 mgr.a (mgr.14373) 13107 : cluster [DBG] pgmap v9090: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:40:14.848 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:40:14.848 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:40:14.848 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:40:14.848 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:40:14.848 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:40:15.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:40:15 smithi157 bash[24585]: audit 2024-09-16T10:40:14.416910+0000 mgr.a (mgr.14373) 13108 : audit [DBG] from='client.285225 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:40:15.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:40:15 smithi086 bash[24289]: audit 2024-09-16T10:40:14.416910+0000 mgr.a (mgr.14373) 13108 : audit [DBG] from='client.285225 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:40:15.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:40:15 smithi047 bash[22744]: audit 2024-09-16T10:40:14.416910+0000 mgr.a (mgr.14373) 13108 : audit [DBG] from='client.285225 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:40:16.809 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:40:16 smithi157 bash[24585]: cluster 2024-09-16T10:40:14.684116+0000 mgr.a (mgr.14373) 13109 : cluster [DBG] pgmap v9091: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:40:16.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:40:16 smithi086 bash[24289]: cluster 2024-09-16T10:40:14.684116+0000 mgr.a (mgr.14373) 13109 : cluster [DBG] pgmap v9091: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:40:16.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:40:16 smithi047 bash[22744]: cluster 2024-09-16T10:40:14.684116+0000 mgr.a (mgr.14373) 13109 : cluster [DBG] pgmap v9091: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:40:18.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:40:18 smithi157 bash[24585]: cluster 2024-09-16T10:40:16.686402+0000 mgr.a (mgr.14373) 13110 : cluster [DBG] pgmap v9092: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:40:18.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:40:18 smithi086 bash[24289]: cluster 2024-09-16T10:40:16.686402+0000 mgr.a (mgr.14373) 13110 : cluster [DBG] pgmap v9092: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:40:18.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:40:18 smithi047 bash[22744]: cluster 2024-09-16T10:40:16.686402+0000 mgr.a (mgr.14373) 13110 : cluster [DBG] pgmap v9092: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:40:19.849 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:40:19.850 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:40:19.850 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:40:20.599 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:40:20.600 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:40:20.600 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:40:20.600 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:40:20.600 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:40:20.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:40:20 smithi157 bash[24585]: cluster 2024-09-16T10:40:18.687160+0000 mgr.a (mgr.14373) 13111 : cluster [DBG] pgmap v9093: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:40:20.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:40:20 smithi086 bash[24289]: cluster 2024-09-16T10:40:18.687160+0000 mgr.a (mgr.14373) 13111 : cluster [DBG] pgmap v9093: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:40:20.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:40:20 smithi047 bash[22744]: cluster 2024-09-16T10:40:18.687160+0000 mgr.a (mgr.14373) 13111 : cluster [DBG] pgmap v9093: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:40:21.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:40:21 smithi157 bash[24585]: audit 2024-09-16T10:40:20.176410+0000 mgr.a (mgr.14373) 13112 : audit [DBG] from='client.285300 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:40:21.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:40:21 smithi086 bash[24289]: audit 2024-09-16T10:40:20.176410+0000 mgr.a (mgr.14373) 13112 : audit [DBG] from='client.285300 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:40:21.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:40:21 smithi047 bash[22744]: audit 2024-09-16T10:40:20.176410+0000 mgr.a (mgr.14373) 13112 : audit [DBG] from='client.285300 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:40:22.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:40:22 smithi157 bash[24585]: cluster 2024-09-16T10:40:20.688088+0000 mgr.a (mgr.14373) 13113 : cluster [DBG] pgmap v9094: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:40:22.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:40:22 smithi086 bash[24289]: cluster 2024-09-16T10:40:20.688088+0000 mgr.a (mgr.14373) 13113 : cluster [DBG] pgmap v9094: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:40:22.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:40:22 smithi047 bash[22744]: cluster 2024-09-16T10:40:20.688088+0000 mgr.a (mgr.14373) 13113 : cluster [DBG] pgmap v9094: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:40:23.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:40:23 smithi157 bash[24585]: cluster 2024-09-16T10:40:22.690331+0000 mgr.a (mgr.14373) 13114 : cluster [DBG] pgmap v9095: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:40:23.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:40:23 smithi086 bash[24289]: cluster 2024-09-16T10:40:22.690331+0000 mgr.a (mgr.14373) 13114 : cluster [DBG] pgmap v9095: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:40:23.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:40:23 smithi047 bash[22744]: cluster 2024-09-16T10:40:22.690331+0000 mgr.a (mgr.14373) 13114 : cluster [DBG] pgmap v9095: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:40:25.601 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:40:25.601 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:40:25.602 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:40:26.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:40:25 smithi157 bash[24585]: cluster 2024-09-16T10:40:24.691119+0000 mgr.a (mgr.14373) 13115 : cluster [DBG] pgmap v9096: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:40:26.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:40:25 smithi086 bash[24289]: cluster 2024-09-16T10:40:24.691119+0000 mgr.a (mgr.14373) 13115 : cluster [DBG] pgmap v9096: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:40:26.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:40:25 smithi047 bash[22744]: cluster 2024-09-16T10:40:24.691119+0000 mgr.a (mgr.14373) 13115 : cluster [DBG] pgmap v9096: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:40:26.369 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:40:26.370 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:40:26.370 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:40:26.370 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:40:26.370 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:40:27.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:40:26 smithi157 bash[24585]: audit 2024-09-16T10:40:25.934722+0000 mgr.a (mgr.14373) 13116 : audit [DBG] from='client.285378 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:40:27.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:40:26 smithi157 bash[24585]: audit 2024-09-16T10:40:26.527559+0000 mon.b (mon.2) 1202 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T10:40:27.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:40:26 smithi086 bash[24289]: audit 2024-09-16T10:40:25.934722+0000 mgr.a (mgr.14373) 13116 : audit [DBG] from='client.285378 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:40:27.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:40:26 smithi086 bash[24289]: audit 2024-09-16T10:40:26.527559+0000 mon.b (mon.2) 1202 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T10:40:27.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:40:26 smithi047 bash[22744]: audit 2024-09-16T10:40:25.934722+0000 mgr.a (mgr.14373) 13116 : audit [DBG] from='client.285378 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:40:27.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:40:26 smithi047 bash[22744]: audit 2024-09-16T10:40:26.527559+0000 mon.b (mon.2) 1202 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T10:40:28.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:40:27 smithi157 bash[24585]: cluster 2024-09-16T10:40:26.693400+0000 mgr.a (mgr.14373) 13117 : cluster [DBG] pgmap v9097: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:40:28.072 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:40:27 smithi086 bash[24289]: cluster 2024-09-16T10:40:26.693400+0000 mgr.a (mgr.14373) 13117 : cluster [DBG] pgmap v9097: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:40:28.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:40:27 smithi047 bash[22744]: cluster 2024-09-16T10:40:26.693400+0000 mgr.a (mgr.14373) 13117 : cluster [DBG] pgmap v9097: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:40:30.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:40:29 smithi157 bash[24585]: cluster 2024-09-16T10:40:28.694195+0000 mgr.a (mgr.14373) 13118 : cluster [DBG] pgmap v9098: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:40:30.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:40:29 smithi086 bash[24289]: cluster 2024-09-16T10:40:28.694195+0000 mgr.a (mgr.14373) 13118 : cluster [DBG] pgmap v9098: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:40:30.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:40:29 smithi047 bash[22744]: cluster 2024-09-16T10:40:28.694195+0000 mgr.a (mgr.14373) 13118 : cluster [DBG] pgmap v9098: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:40:31.370 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:40:31.371 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:40:31.371 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:40:32.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:40:31 smithi157 bash[24585]: cluster 2024-09-16T10:40:30.695022+0000 mgr.a (mgr.14373) 13119 : cluster [DBG] pgmap v9099: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:40:32.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:40:31 smithi086 bash[24289]: cluster 2024-09-16T10:40:30.695022+0000 mgr.a (mgr.14373) 13119 : cluster [DBG] pgmap v9099: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:40:32.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:40:31 smithi047 bash[22744]: cluster 2024-09-16T10:40:30.695022+0000 mgr.a (mgr.14373) 13119 : cluster [DBG] pgmap v9099: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:40:32.119 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:40:32.119 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:40:32.119 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:40:32.119 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:40:32.119 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:40:33.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:40:32 smithi157 bash[24585]: audit 2024-09-16T10:40:31.703148+0000 mgr.a (mgr.14373) 13120 : audit [DBG] from='client.285456 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:40:33.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:40:32 smithi086 bash[24289]: audit 2024-09-16T10:40:31.703148+0000 mgr.a (mgr.14373) 13120 : audit [DBG] from='client.285456 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:40:33.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:40:32 smithi047 bash[22744]: audit 2024-09-16T10:40:31.703148+0000 mgr.a (mgr.14373) 13120 : audit [DBG] from='client.285456 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:40:33.980 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:40:33 smithi047 bash[22744]: cluster 2024-09-16T10:40:32.697783+0000 mgr.a (mgr.14373) 13121 : cluster [DBG] pgmap v9100: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:40:34.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:40:33 smithi157 bash[24585]: cluster 2024-09-16T10:40:32.697783+0000 mgr.a (mgr.14373) 13121 : cluster [DBG] pgmap v9100: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:40:34.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:40:33 smithi086 bash[24289]: cluster 2024-09-16T10:40:32.697783+0000 mgr.a (mgr.14373) 13121 : cluster [DBG] pgmap v9100: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:40:36.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:40:35 smithi157 bash[24585]: cluster 2024-09-16T10:40:34.698601+0000 mgr.a (mgr.14373) 13122 : cluster [DBG] pgmap v9101: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:40:36.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:40:35 smithi086 bash[24289]: cluster 2024-09-16T10:40:34.698601+0000 mgr.a (mgr.14373) 13122 : cluster [DBG] pgmap v9101: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:40:36.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:40:35 smithi047 bash[22744]: cluster 2024-09-16T10:40:34.698601+0000 mgr.a (mgr.14373) 13122 : cluster [DBG] pgmap v9101: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:40:37.120 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:40:37.121 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:40:37.121 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:40:38.342 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 10:40:37 smithi047 bash[22994]: debug 2024-09-16T10:40:37.961+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T10:40:38.343 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 10:40:37 smithi047 bash[22994]: debug 2024-09-16T10:40:37.973+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T10:40:38.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:40:38 smithi047 bash[22744]: cluster 2024-09-16T10:40:36.700663+0000 mgr.a (mgr.14373) 13123 : cluster [DBG] pgmap v9102: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:40:38.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:40:38 smithi047 bash[22744]: audit 2024-09-16T10:40:37.170643+0000 mon.a (mon.0) 1347 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:40:38.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:40:38 smithi047 bash[22744]: audit 2024-09-16T10:40:37.180598+0000 mon.a (mon.0) 1348 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:40:38.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:40:38 smithi047 bash[22744]: audit 2024-09-16T10:40:37.184012+0000 mon.b (mon.2) 1203 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T10:40:38.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:40:38 smithi047 bash[22744]: audit 2024-09-16T10:40:37.186235+0000 mon.b (mon.2) 1204 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T10:40:38.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:40:38 smithi047 bash[22744]: audit 2024-09-16T10:40:37.196278+0000 mon.a (mon.0) 1349 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:40:38.344 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:40:38 smithi047 bash[22744]: audit 2024-09-16T10:40:37.202301+0000 mon.b (mon.2) 1205 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:40:38.344 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:40:38 smithi047 bash[22744]: audit 2024-09-16T10:40:37.205013+0000 mgr.a (mgr.14373) 13124 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:40:38.344 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:40:38 smithi047 bash[22744]: audit 2024-09-16T10:40:37.478289+0000 mgr.a (mgr.14373) 13125 : audit [DBG] from='client.285534 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:40:38.373 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:40:38.373 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:40:38.373 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:40:38.373 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:40:38.373 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:40:38.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:40:38 smithi157 bash[24585]: cluster 2024-09-16T10:40:36.700663+0000 mgr.a (mgr.14373) 13123 : cluster [DBG] pgmap v9102: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:40:38.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:40:38 smithi157 bash[24585]: audit 2024-09-16T10:40:37.170643+0000 mon.a (mon.0) 1347 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:40:38.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:40:38 smithi157 bash[24585]: audit 2024-09-16T10:40:37.180598+0000 mon.a (mon.0) 1348 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:40:38.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:40:38 smithi157 bash[24585]: audit 2024-09-16T10:40:37.184012+0000 mon.b (mon.2) 1203 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T10:40:38.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:40:38 smithi157 bash[24585]: audit 2024-09-16T10:40:37.186235+0000 mon.b (mon.2) 1204 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T10:40:38.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:40:38 smithi157 bash[24585]: audit 2024-09-16T10:40:37.196278+0000 mon.a (mon.0) 1349 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:40:38.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:40:38 smithi157 bash[24585]: audit 2024-09-16T10:40:37.202301+0000 mon.b (mon.2) 1205 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:40:38.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:40:38 smithi157 bash[24585]: audit 2024-09-16T10:40:37.205013+0000 mgr.a (mgr.14373) 13124 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:40:38.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:40:38 smithi157 bash[24585]: audit 2024-09-16T10:40:37.478289+0000 mgr.a (mgr.14373) 13125 : audit [DBG] from='client.285534 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:40:38.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:40:38 smithi086 bash[24289]: cluster 2024-09-16T10:40:36.700663+0000 mgr.a (mgr.14373) 13123 : cluster [DBG] pgmap v9102: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:40:38.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:40:38 smithi086 bash[24289]: audit 2024-09-16T10:40:37.170643+0000 mon.a (mon.0) 1347 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:40:38.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:40:38 smithi086 bash[24289]: audit 2024-09-16T10:40:37.180598+0000 mon.a (mon.0) 1348 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:40:38.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:40:38 smithi086 bash[24289]: audit 2024-09-16T10:40:37.184012+0000 mon.b (mon.2) 1203 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T10:40:38.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:40:38 smithi086 bash[24289]: audit 2024-09-16T10:40:37.186235+0000 mon.b (mon.2) 1204 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T10:40:38.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:40:38 smithi086 bash[24289]: audit 2024-09-16T10:40:37.196278+0000 mon.a (mon.0) 1349 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:40:38.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:40:38 smithi086 bash[24289]: audit 2024-09-16T10:40:37.202301+0000 mon.b (mon.2) 1205 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:40:38.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:40:38 smithi086 bash[24289]: audit 2024-09-16T10:40:37.205013+0000 mgr.a (mgr.14373) 13124 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:40:38.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:40:38 smithi086 bash[24289]: audit 2024-09-16T10:40:37.478289+0000 mgr.a (mgr.14373) 13125 : audit [DBG] from='client.285534 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:40:39.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:40:39 smithi157 bash[24585]: audit 2024-09-16T10:40:37.962910+0000 mgr.a (mgr.14373) 13126 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T10:40:39.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:40:39 smithi157 bash[24585]: cephadm 2024-09-16T10:40:37.974581+0000 mgr.a (mgr.14373) 13127 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T10:40:39.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:40:39 smithi086 bash[24289]: audit 2024-09-16T10:40:37.962910+0000 mgr.a (mgr.14373) 13126 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T10:40:39.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:40:39 smithi086 bash[24289]: cephadm 2024-09-16T10:40:37.974581+0000 mgr.a (mgr.14373) 13127 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T10:40:39.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:40:39 smithi047 bash[22744]: audit 2024-09-16T10:40:37.962910+0000 mgr.a (mgr.14373) 13126 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T10:40:39.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:40:39 smithi047 bash[22744]: cephadm 2024-09-16T10:40:37.974581+0000 mgr.a (mgr.14373) 13127 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T10:40:40.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:40:40 smithi157 bash[24585]: cluster 2024-09-16T10:40:38.701622+0000 mgr.a (mgr.14373) 13128 : cluster [DBG] pgmap v9103: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:40:40.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:40:40 smithi086 bash[24289]: cluster 2024-09-16T10:40:38.701622+0000 mgr.a (mgr.14373) 13128 : cluster [DBG] pgmap v9103: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:40:40.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:40:40 smithi047 bash[22744]: cluster 2024-09-16T10:40:38.701622+0000 mgr.a (mgr.14373) 13128 : cluster [DBG] pgmap v9103: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:40:42.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:40:42 smithi157 bash[24585]: cluster 2024-09-16T10:40:40.702405+0000 mgr.a (mgr.14373) 13129 : cluster [DBG] pgmap v9104: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T10:40:42.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:40:42 smithi086 bash[24289]: cluster 2024-09-16T10:40:40.702405+0000 mgr.a (mgr.14373) 13129 : cluster [DBG] pgmap v9104: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T10:40:42.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:40:42 smithi047 bash[22744]: cluster 2024-09-16T10:40:40.702405+0000 mgr.a (mgr.14373) 13129 : cluster [DBG] pgmap v9104: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T10:40:43.374 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:40:43.375 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:40:43.375 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:40:44.162 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:40:44.162 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:40:44.163 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:40:44.163 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:40:44.163 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:40:44.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:40:44 smithi157 bash[24585]: cluster 2024-09-16T10:40:42.704685+0000 mgr.a (mgr.14373) 13130 : cluster [DBG] pgmap v9105: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:40:44.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:40:44 smithi086 bash[24289]: cluster 2024-09-16T10:40:42.704685+0000 mgr.a (mgr.14373) 13130 : cluster [DBG] pgmap v9105: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:40:44.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:40:44 smithi047 bash[22744]: cluster 2024-09-16T10:40:42.704685+0000 mgr.a (mgr.14373) 13130 : cluster [DBG] pgmap v9105: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:40:45.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:40:45 smithi157 bash[24585]: audit 2024-09-16T10:40:43.707409+0000 mgr.a (mgr.14373) 13131 : audit [DBG] from='client.285720 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:40:45.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:40:45 smithi086 bash[24289]: audit 2024-09-16T10:40:43.707409+0000 mgr.a (mgr.14373) 13131 : audit [DBG] from='client.285720 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:40:45.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:40:45 smithi047 bash[22744]: audit 2024-09-16T10:40:43.707409+0000 mgr.a (mgr.14373) 13131 : audit [DBG] from='client.285720 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:40:46.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:40:46 smithi157 bash[24585]: cluster 2024-09-16T10:40:44.705693+0000 mgr.a (mgr.14373) 13132 : cluster [DBG] pgmap v9106: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:40:46.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:40:46 smithi086 bash[24289]: cluster 2024-09-16T10:40:44.705693+0000 mgr.a (mgr.14373) 13132 : cluster [DBG] pgmap v9106: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:40:46.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:40:46 smithi047 bash[22744]: cluster 2024-09-16T10:40:44.705693+0000 mgr.a (mgr.14373) 13132 : cluster [DBG] pgmap v9106: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:40:48.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:40:48 smithi157 bash[24585]: cluster 2024-09-16T10:40:46.707861+0000 mgr.a (mgr.14373) 13133 : cluster [DBG] pgmap v9107: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:40:48.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:40:48 smithi086 bash[24289]: cluster 2024-09-16T10:40:46.707861+0000 mgr.a (mgr.14373) 13133 : cluster [DBG] pgmap v9107: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:40:48.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:40:48 smithi047 bash[22744]: cluster 2024-09-16T10:40:46.707861+0000 mgr.a (mgr.14373) 13133 : cluster [DBG] pgmap v9107: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:40:49.164 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:40:49.165 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:40:49.165 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:40:49.915 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:40:49.916 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:40:49.916 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:40:49.916 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:40:49.916 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:40:50.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:40:50 smithi157 bash[24585]: cluster 2024-09-16T10:40:48.708629+0000 mgr.a (mgr.14373) 13134 : cluster [DBG] pgmap v9108: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:40:50.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:40:50 smithi157 bash[24585]: audit 2024-09-16T10:40:49.493113+0000 mgr.a (mgr.14373) 13135 : audit [DBG] from='client.285795 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:40:50.572 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:40:50 smithi086 bash[24289]: cluster 2024-09-16T10:40:48.708629+0000 mgr.a (mgr.14373) 13134 : cluster [DBG] pgmap v9108: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:40:50.572 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:40:50 smithi086 bash[24289]: audit 2024-09-16T10:40:49.493113+0000 mgr.a (mgr.14373) 13135 : audit [DBG] from='client.285795 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:40:50.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:40:50 smithi047 bash[22744]: cluster 2024-09-16T10:40:48.708629+0000 mgr.a (mgr.14373) 13134 : cluster [DBG] pgmap v9108: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:40:50.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:40:50 smithi047 bash[22744]: audit 2024-09-16T10:40:49.493113+0000 mgr.a (mgr.14373) 13135 : audit [DBG] from='client.285795 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:40:52.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:40:52 smithi157 bash[24585]: cluster 2024-09-16T10:40:50.709558+0000 mgr.a (mgr.14373) 13136 : cluster [DBG] pgmap v9109: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:40:52.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:40:52 smithi086 bash[24289]: cluster 2024-09-16T10:40:50.709558+0000 mgr.a (mgr.14373) 13136 : cluster [DBG] pgmap v9109: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:40:52.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:40:52 smithi047 bash[22744]: cluster 2024-09-16T10:40:50.709558+0000 mgr.a (mgr.14373) 13136 : cluster [DBG] pgmap v9109: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:40:54.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:40:54 smithi157 bash[24585]: cluster 2024-09-16T10:40:52.711978+0000 mgr.a (mgr.14373) 13137 : cluster [DBG] pgmap v9110: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:40:54.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:40:54 smithi086 bash[24289]: cluster 2024-09-16T10:40:52.711978+0000 mgr.a (mgr.14373) 13137 : cluster [DBG] pgmap v9110: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:40:54.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:40:54 smithi047 bash[22744]: cluster 2024-09-16T10:40:52.711978+0000 mgr.a (mgr.14373) 13137 : cluster [DBG] pgmap v9110: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:40:54.917 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:40:54.917 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:40:54.917 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:40:55.667 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:40:55.668 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:40:55.668 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:40:55.668 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:40:55.668 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:40:56.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:40:56 smithi157 bash[24585]: cluster 2024-09-16T10:40:54.712922+0000 mgr.a (mgr.14373) 13138 : cluster [DBG] pgmap v9111: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:40:56.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:40:56 smithi157 bash[24585]: audit 2024-09-16T10:40:55.253813+0000 mgr.a (mgr.14373) 13139 : audit [DBG] from='client.285870 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:40:56.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:40:56 smithi086 bash[24289]: cluster 2024-09-16T10:40:54.712922+0000 mgr.a (mgr.14373) 13138 : cluster [DBG] pgmap v9111: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:40:56.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:40:56 smithi086 bash[24289]: audit 2024-09-16T10:40:55.253813+0000 mgr.a (mgr.14373) 13139 : audit [DBG] from='client.285870 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:40:56.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:40:56 smithi047 bash[22744]: cluster 2024-09-16T10:40:54.712922+0000 mgr.a (mgr.14373) 13138 : cluster [DBG] pgmap v9111: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:40:56.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:40:56 smithi047 bash[22744]: audit 2024-09-16T10:40:55.253813+0000 mgr.a (mgr.14373) 13139 : audit [DBG] from='client.285870 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:40:58.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:40:58 smithi157 bash[24585]: cluster 2024-09-16T10:40:56.715238+0000 mgr.a (mgr.14373) 13140 : cluster [DBG] pgmap v9112: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:40:58.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:40:58 smithi086 bash[24289]: cluster 2024-09-16T10:40:56.715238+0000 mgr.a (mgr.14373) 13140 : cluster [DBG] pgmap v9112: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:40:58.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:40:58 smithi047 bash[22744]: cluster 2024-09-16T10:40:56.715238+0000 mgr.a (mgr.14373) 13140 : cluster [DBG] pgmap v9112: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:41:00.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:41:00 smithi157 bash[24585]: cluster 2024-09-16T10:40:58.715976+0000 mgr.a (mgr.14373) 13141 : cluster [DBG] pgmap v9113: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:41:00.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:41:00 smithi086 bash[24289]: cluster 2024-09-16T10:40:58.715976+0000 mgr.a (mgr.14373) 13141 : cluster [DBG] pgmap v9113: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:41:00.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:41:00 smithi047 bash[22744]: cluster 2024-09-16T10:40:58.715976+0000 mgr.a (mgr.14373) 13141 : cluster [DBG] pgmap v9113: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:41:00.668 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:41:00.668 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:41:00.669 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:41:01.449 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:41:01.450 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:41:01.450 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:41:01.450 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:41:01.450 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:41:02.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:41:02 smithi157 bash[24585]: cluster 2024-09-16T10:41:00.716556+0000 mgr.a (mgr.14373) 13142 : cluster [DBG] pgmap v9114: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:41:02.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:41:02 smithi157 bash[24585]: audit 2024-09-16T10:41:01.008261+0000 mgr.a (mgr.14373) 13143 : audit [DBG] from='client.285948 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:41:02.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:41:02 smithi086 bash[24289]: cluster 2024-09-16T10:41:00.716556+0000 mgr.a (mgr.14373) 13142 : cluster [DBG] pgmap v9114: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:41:02.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:41:02 smithi086 bash[24289]: audit 2024-09-16T10:41:01.008261+0000 mgr.a (mgr.14373) 13143 : audit [DBG] from='client.285948 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:41:02.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:41:02 smithi047 bash[22744]: cluster 2024-09-16T10:41:00.716556+0000 mgr.a (mgr.14373) 13142 : cluster [DBG] pgmap v9114: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:41:02.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:41:02 smithi047 bash[22744]: audit 2024-09-16T10:41:01.008261+0000 mgr.a (mgr.14373) 13143 : audit [DBG] from='client.285948 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:41:04.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:41:04 smithi157 bash[24585]: cluster 2024-09-16T10:41:02.718920+0000 mgr.a (mgr.14373) 13144 : cluster [DBG] pgmap v9115: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:41:04.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:41:04 smithi086 bash[24289]: cluster 2024-09-16T10:41:02.718920+0000 mgr.a (mgr.14373) 13144 : cluster [DBG] pgmap v9115: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:41:04.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:41:04 smithi047 bash[22744]: cluster 2024-09-16T10:41:02.718920+0000 mgr.a (mgr.14373) 13144 : cluster [DBG] pgmap v9115: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:41:06.451 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:41:06.452 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:41:06.452 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:41:06.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:41:06 smithi157 bash[24585]: cluster 2024-09-16T10:41:04.719698+0000 mgr.a (mgr.14373) 13145 : cluster [DBG] pgmap v9116: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:41:06.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:41:06 smithi086 bash[24289]: cluster 2024-09-16T10:41:04.719698+0000 mgr.a (mgr.14373) 13145 : cluster [DBG] pgmap v9116: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:41:06.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:41:06 smithi047 bash[22744]: cluster 2024-09-16T10:41:04.719698+0000 mgr.a (mgr.14373) 13145 : cluster [DBG] pgmap v9116: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:41:07.239 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:41:07.239 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:41:07.239 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:41:07.239 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:41:07.240 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:41:08.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:41:08 smithi157 bash[24585]: cluster 2024-09-16T10:41:06.721607+0000 mgr.a (mgr.14373) 13146 : cluster [DBG] pgmap v9117: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:41:08.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:41:08 smithi157 bash[24585]: audit 2024-09-16T10:41:06.788442+0000 mgr.a (mgr.14373) 13147 : audit [DBG] from='client.286026 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:41:08.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:41:08 smithi086 bash[24289]: cluster 2024-09-16T10:41:06.721607+0000 mgr.a (mgr.14373) 13146 : cluster [DBG] pgmap v9117: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:41:08.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:41:08 smithi086 bash[24289]: audit 2024-09-16T10:41:06.788442+0000 mgr.a (mgr.14373) 13147 : audit [DBG] from='client.286026 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:41:08.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:41:08 smithi047 bash[22744]: cluster 2024-09-16T10:41:06.721607+0000 mgr.a (mgr.14373) 13146 : cluster [DBG] pgmap v9117: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:41:08.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:41:08 smithi047 bash[22744]: audit 2024-09-16T10:41:06.788442+0000 mgr.a (mgr.14373) 13147 : audit [DBG] from='client.286026 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:41:10.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:41:10 smithi157 bash[24585]: cluster 2024-09-16T10:41:08.722495+0000 mgr.a (mgr.14373) 13148 : cluster [DBG] pgmap v9118: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:41:10.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:41:10 smithi086 bash[24289]: cluster 2024-09-16T10:41:08.722495+0000 mgr.a (mgr.14373) 13148 : cluster [DBG] pgmap v9118: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:41:10.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:41:10 smithi047 bash[22744]: cluster 2024-09-16T10:41:08.722495+0000 mgr.a (mgr.14373) 13148 : cluster [DBG] pgmap v9118: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:41:12.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:41:11 smithi157 bash[24585]: cluster 2024-09-16T10:41:10.723454+0000 mgr.a (mgr.14373) 13149 : cluster [DBG] pgmap v9119: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T10:41:12.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:41:11 smithi086 bash[24289]: cluster 2024-09-16T10:41:10.723454+0000 mgr.a (mgr.14373) 13149 : cluster [DBG] pgmap v9119: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T10:41:12.094 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:41:11 smithi047 bash[22744]: cluster 2024-09-16T10:41:10.723454+0000 mgr.a (mgr.14373) 13149 : cluster [DBG] pgmap v9119: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T10:41:12.240 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:41:12.241 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:41:12.241 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:41:13.023 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:41:13.023 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:41:13.023 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:41:13.023 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:41:13.024 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:41:14.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:41:13 smithi157 bash[24585]: audit 2024-09-16T10:41:12.578654+0000 mgr.a (mgr.14373) 13150 : audit [DBG] from='client.286104 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:41:14.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:41:13 smithi157 bash[24585]: cluster 2024-09-16T10:41:12.724924+0000 mgr.a (mgr.14373) 13151 : cluster [DBG] pgmap v9120: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:41:14.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:41:13 smithi086 bash[24289]: audit 2024-09-16T10:41:12.578654+0000 mgr.a (mgr.14373) 13150 : audit [DBG] from='client.286104 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:41:14.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:41:13 smithi086 bash[24289]: cluster 2024-09-16T10:41:12.724924+0000 mgr.a (mgr.14373) 13151 : cluster [DBG] pgmap v9120: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:41:14.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:41:13 smithi047 bash[22744]: audit 2024-09-16T10:41:12.578654+0000 mgr.a (mgr.14373) 13150 : audit [DBG] from='client.286104 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:41:14.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:41:13 smithi047 bash[22744]: cluster 2024-09-16T10:41:12.724924+0000 mgr.a (mgr.14373) 13151 : cluster [DBG] pgmap v9120: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:41:16.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:41:15 smithi157 bash[24585]: cluster 2024-09-16T10:41:14.725784+0000 mgr.a (mgr.14373) 13152 : cluster [DBG] pgmap v9121: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T10:41:16.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:41:15 smithi086 bash[24289]: cluster 2024-09-16T10:41:14.725784+0000 mgr.a (mgr.14373) 13152 : cluster [DBG] pgmap v9121: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T10:41:16.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:41:15 smithi047 bash[22744]: cluster 2024-09-16T10:41:14.725784+0000 mgr.a (mgr.14373) 13152 : cluster [DBG] pgmap v9121: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T10:41:18.025 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:41:18.025 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:41:18.026 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:41:18.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:41:17 smithi157 bash[24585]: cluster 2024-09-16T10:41:16.727919+0000 mgr.a (mgr.14373) 13153 : cluster [DBG] pgmap v9122: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:41:18.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:41:17 smithi086 bash[24289]: cluster 2024-09-16T10:41:16.727919+0000 mgr.a (mgr.14373) 13153 : cluster [DBG] pgmap v9122: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:41:18.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:41:17 smithi047 bash[22744]: cluster 2024-09-16T10:41:16.727919+0000 mgr.a (mgr.14373) 13153 : cluster [DBG] pgmap v9122: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:41:18.779 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:41:18.779 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:41:18.779 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:41:18.779 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:41:18.779 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:41:19.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:41:18 smithi157 bash[24585]: audit 2024-09-16T10:41:18.356962+0000 mgr.a (mgr.14373) 13154 : audit [DBG] from='client.286182 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:41:19.074 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:41:18 smithi086 bash[24289]: audit 2024-09-16T10:41:18.356962+0000 mgr.a (mgr.14373) 13154 : audit [DBG] from='client.286182 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:41:19.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:41:18 smithi047 bash[22744]: audit 2024-09-16T10:41:18.356962+0000 mgr.a (mgr.14373) 13154 : audit [DBG] from='client.286182 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:41:20.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:41:19 smithi086 bash[24289]: cluster 2024-09-16T10:41:18.728601+0000 mgr.a (mgr.14373) 13155 : cluster [DBG] pgmap v9123: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:41:20.094 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:41:19 smithi047 bash[22744]: cluster 2024-09-16T10:41:18.728601+0000 mgr.a (mgr.14373) 13155 : cluster [DBG] pgmap v9123: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:41:20.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:41:19 smithi157 bash[24585]: cluster 2024-09-16T10:41:18.728601+0000 mgr.a (mgr.14373) 13155 : cluster [DBG] pgmap v9123: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:41:22.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:41:21 smithi086 bash[24289]: cluster 2024-09-16T10:41:20.729380+0000 mgr.a (mgr.14373) 13156 : cluster [DBG] pgmap v9124: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:41:22.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:41:21 smithi047 bash[22744]: cluster 2024-09-16T10:41:20.729380+0000 mgr.a (mgr.14373) 13156 : cluster [DBG] pgmap v9124: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:41:22.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:41:21 smithi157 bash[24585]: cluster 2024-09-16T10:41:20.729380+0000 mgr.a (mgr.14373) 13156 : cluster [DBG] pgmap v9124: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:41:23.780 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:41:23.781 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:41:23.781 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:41:24.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:41:23 smithi086 bash[24289]: cluster 2024-09-16T10:41:22.731623+0000 mgr.a (mgr.14373) 13157 : cluster [DBG] pgmap v9125: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:41:24.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:41:23 smithi047 bash[22744]: cluster 2024-09-16T10:41:22.731623+0000 mgr.a (mgr.14373) 13157 : cluster [DBG] pgmap v9125: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:41:24.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:41:23 smithi157 bash[24585]: cluster 2024-09-16T10:41:22.731623+0000 mgr.a (mgr.14373) 13157 : cluster [DBG] pgmap v9125: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:41:24.527 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:41:24.528 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:41:24.528 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:41:24.528 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:41:24.528 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:41:25.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:41:24 smithi086 bash[24289]: audit 2024-09-16T10:41:24.111887+0000 mgr.a (mgr.14373) 13158 : audit [DBG] from='client.286260 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:41:25.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:41:24 smithi047 bash[22744]: audit 2024-09-16T10:41:24.111887+0000 mgr.a (mgr.14373) 13158 : audit [DBG] from='client.286260 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:41:25.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:41:24 smithi157 bash[24585]: audit 2024-09-16T10:41:24.111887+0000 mgr.a (mgr.14373) 13158 : audit [DBG] from='client.286260 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:41:26.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:41:25 smithi047 bash[22744]: cluster 2024-09-16T10:41:24.732590+0000 mgr.a (mgr.14373) 13159 : cluster [DBG] pgmap v9126: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:41:26.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:41:25 smithi157 bash[24585]: cluster 2024-09-16T10:41:24.732590+0000 mgr.a (mgr.14373) 13159 : cluster [DBG] pgmap v9126: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:41:26.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:41:25 smithi086 bash[24289]: cluster 2024-09-16T10:41:24.732590+0000 mgr.a (mgr.14373) 13159 : cluster [DBG] pgmap v9126: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:41:28.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:41:27 smithi047 bash[22744]: cluster 2024-09-16T10:41:26.734726+0000 mgr.a (mgr.14373) 13160 : cluster [DBG] pgmap v9127: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:41:28.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:41:27 smithi157 bash[24585]: cluster 2024-09-16T10:41:26.734726+0000 mgr.a (mgr.14373) 13160 : cluster [DBG] pgmap v9127: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:41:28.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:41:27 smithi086 bash[24289]: cluster 2024-09-16T10:41:26.734726+0000 mgr.a (mgr.14373) 13160 : cluster [DBG] pgmap v9127: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:41:29.529 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:41:29.530 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:41:29.530 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:41:30.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:41:29 smithi047 bash[22744]: cluster 2024-09-16T10:41:28.735480+0000 mgr.a (mgr.14373) 13161 : cluster [DBG] pgmap v9128: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:41:30.298 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:41:30.298 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:41:30.298 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:41:30.299 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:41:30.299 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:41:30.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:41:29 smithi157 bash[24585]: cluster 2024-09-16T10:41:28.735480+0000 mgr.a (mgr.14373) 13161 : cluster [DBG] pgmap v9128: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:41:30.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:41:29 smithi086 bash[24289]: cluster 2024-09-16T10:41:28.735480+0000 mgr.a (mgr.14373) 13161 : cluster [DBG] pgmap v9128: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:41:31.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:41:30 smithi047 bash[22744]: audit 2024-09-16T10:41:29.862426+0000 mgr.a (mgr.14373) 13162 : audit [DBG] from='client.286335 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:41:31.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:41:30 smithi157 bash[24585]: audit 2024-09-16T10:41:29.862426+0000 mgr.a (mgr.14373) 13162 : audit [DBG] from='client.286335 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:41:31.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:41:30 smithi086 bash[24289]: audit 2024-09-16T10:41:29.862426+0000 mgr.a (mgr.14373) 13162 : audit [DBG] from='client.286335 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:41:32.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:41:31 smithi157 bash[24585]: cluster 2024-09-16T10:41:30.736321+0000 mgr.a (mgr.14373) 13163 : cluster [DBG] pgmap v9129: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:41:32.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:41:31 smithi086 bash[24289]: cluster 2024-09-16T10:41:30.736321+0000 mgr.a (mgr.14373) 13163 : cluster [DBG] pgmap v9129: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:41:32.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:41:31 smithi047 bash[22744]: cluster 2024-09-16T10:41:30.736321+0000 mgr.a (mgr.14373) 13163 : cluster [DBG] pgmap v9129: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:41:34.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:41:33 smithi157 bash[24585]: cluster 2024-09-16T10:41:32.738502+0000 mgr.a (mgr.14373) 13164 : cluster [DBG] pgmap v9130: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:41:34.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:41:33 smithi086 bash[24289]: cluster 2024-09-16T10:41:32.738502+0000 mgr.a (mgr.14373) 13164 : cluster [DBG] pgmap v9130: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:41:34.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:41:33 smithi047 bash[22744]: cluster 2024-09-16T10:41:32.738502+0000 mgr.a (mgr.14373) 13164 : cluster [DBG] pgmap v9130: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:41:35.299 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:41:35.300 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:41:35.300 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:41:36.046 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:41:36.046 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:41:36.046 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:41:36.046 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:41:36.046 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:41:36.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:41:35 smithi157 bash[24585]: cluster 2024-09-16T10:41:34.739254+0000 mgr.a (mgr.14373) 13165 : cluster [DBG] pgmap v9131: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:41:36.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:41:35 smithi086 bash[24289]: cluster 2024-09-16T10:41:34.739254+0000 mgr.a (mgr.14373) 13165 : cluster [DBG] pgmap v9131: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:41:36.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:41:35 smithi047 bash[22744]: cluster 2024-09-16T10:41:34.739254+0000 mgr.a (mgr.14373) 13165 : cluster [DBG] pgmap v9131: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:41:37.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:41:36 smithi157 bash[24585]: audit 2024-09-16T10:41:35.632678+0000 mgr.a (mgr.14373) 13166 : audit [DBG] from='client.286413 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:41:37.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:41:36 smithi086 bash[24289]: audit 2024-09-16T10:41:35.632678+0000 mgr.a (mgr.14373) 13166 : audit [DBG] from='client.286413 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:41:37.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:41:36 smithi047 bash[22744]: audit 2024-09-16T10:41:35.632678+0000 mgr.a (mgr.14373) 13166 : audit [DBG] from='client.286413 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:41:38.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:41:37 smithi157 bash[24585]: cluster 2024-09-16T10:41:36.741506+0000 mgr.a (mgr.14373) 13167 : cluster [DBG] pgmap v9132: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:41:38.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:41:37 smithi086 bash[24289]: cluster 2024-09-16T10:41:36.741506+0000 mgr.a (mgr.14373) 13167 : cluster [DBG] pgmap v9132: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:41:38.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:41:37 smithi047 bash[22744]: cluster 2024-09-16T10:41:36.741506+0000 mgr.a (mgr.14373) 13167 : cluster [DBG] pgmap v9132: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:41:39.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:41:38 smithi157 bash[24585]: audit 2024-09-16T10:41:38.028045+0000 mon.b (mon.2) 1206 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T10:41:39.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:41:38 smithi086 bash[24289]: audit 2024-09-16T10:41:38.028045+0000 mon.b (mon.2) 1206 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T10:41:39.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:41:38 smithi047 bash[22744]: audit 2024-09-16T10:41:38.028045+0000 mon.b (mon.2) 1206 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T10:41:40.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:41:39 smithi157 bash[24585]: cluster 2024-09-16T10:41:38.742276+0000 mgr.a (mgr.14373) 13168 : cluster [DBG] pgmap v9133: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:41:40.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:41:39 smithi086 bash[24289]: cluster 2024-09-16T10:41:38.742276+0000 mgr.a (mgr.14373) 13168 : cluster [DBG] pgmap v9133: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:41:40.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:41:39 smithi047 bash[22744]: cluster 2024-09-16T10:41:38.742276+0000 mgr.a (mgr.14373) 13168 : cluster [DBG] pgmap v9133: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:41:41.047 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:41:41.048 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:41:41.048 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:41:41.802 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:41:41.802 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:41:41.802 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:41:41.802 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:41:41.803 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:41:42.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:41:41 smithi157 bash[24585]: cluster 2024-09-16T10:41:40.743096+0000 mgr.a (mgr.14373) 13169 : cluster [DBG] pgmap v9134: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:41:42.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:41:41 smithi157 bash[24585]: audit 2024-09-16T10:41:41.381249+0000 mgr.a (mgr.14373) 13170 : audit [DBG] from='client.286491 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:41:42.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:41:41 smithi086 bash[24289]: cluster 2024-09-16T10:41:40.743096+0000 mgr.a (mgr.14373) 13169 : cluster [DBG] pgmap v9134: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:41:42.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:41:41 smithi086 bash[24289]: audit 2024-09-16T10:41:41.381249+0000 mgr.a (mgr.14373) 13170 : audit [DBG] from='client.286491 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:41:42.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:41:41 smithi047 bash[22744]: cluster 2024-09-16T10:41:40.743096+0000 mgr.a (mgr.14373) 13169 : cluster [DBG] pgmap v9134: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:41:42.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:41:41 smithi047 bash[22744]: audit 2024-09-16T10:41:41.381249+0000 mgr.a (mgr.14373) 13170 : audit [DBG] from='client.286491 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:41:44.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:41:43 smithi157 bash[24585]: cluster 2024-09-16T10:41:42.745765+0000 mgr.a (mgr.14373) 13171 : cluster [DBG] pgmap v9135: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-16T10:41:44.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:41:43 smithi086 bash[24289]: cluster 2024-09-16T10:41:42.745765+0000 mgr.a (mgr.14373) 13171 : cluster [DBG] pgmap v9135: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-16T10:41:44.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:41:43 smithi047 bash[22744]: cluster 2024-09-16T10:41:42.745765+0000 mgr.a (mgr.14373) 13171 : cluster [DBG] pgmap v9135: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-16T10:41:46.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:41:45 smithi086 bash[24289]: cluster 2024-09-16T10:41:44.746621+0000 mgr.a (mgr.14373) 13172 : cluster [DBG] pgmap v9136: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-16T10:41:46.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:41:45 smithi157 bash[24585]: cluster 2024-09-16T10:41:44.746621+0000 mgr.a (mgr.14373) 13172 : cluster [DBG] pgmap v9136: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-16T10:41:46.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:41:45 smithi047 bash[22744]: cluster 2024-09-16T10:41:44.746621+0000 mgr.a (mgr.14373) 13172 : cluster [DBG] pgmap v9136: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-16T10:41:46.804 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:41:46.804 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:41:46.805 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:41:47.577 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:41:47.577 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:41:47.577 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:41:47.577 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:41:47.577 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:41:48.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:41:47 smithi086 bash[24289]: cluster 2024-09-16T10:41:46.748625+0000 mgr.a (mgr.14373) 13173 : cluster [DBG] pgmap v9137: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:41:48.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:41:47 smithi086 bash[24289]: audit 2024-09-16T10:41:47.143230+0000 mgr.a (mgr.14373) 13174 : audit [DBG] from='client.286569 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:41:48.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:41:47 smithi157 bash[24585]: cluster 2024-09-16T10:41:46.748625+0000 mgr.a (mgr.14373) 13173 : cluster [DBG] pgmap v9137: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:41:48.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:41:47 smithi157 bash[24585]: audit 2024-09-16T10:41:47.143230+0000 mgr.a (mgr.14373) 13174 : audit [DBG] from='client.286569 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:41:48.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:41:47 smithi047 bash[22744]: cluster 2024-09-16T10:41:46.748625+0000 mgr.a (mgr.14373) 13173 : cluster [DBG] pgmap v9137: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:41:48.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:41:47 smithi047 bash[22744]: audit 2024-09-16T10:41:47.143230+0000 mgr.a (mgr.14373) 13174 : audit [DBG] from='client.286569 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:41:49.592 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 10:41:49 smithi047 bash[22994]: debug 2024-09-16T10:41:49.227+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T10:41:49.593 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 10:41:49 smithi047 bash[22994]: debug 2024-09-16T10:41:49.227+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T10:41:49.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:41:49 smithi047 bash[22744]: audit 2024-09-16T10:41:48.449013+0000 mon.a (mon.0) 1350 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:41:49.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:41:49 smithi047 bash[22744]: audit 2024-09-16T10:41:48.459358+0000 mon.a (mon.0) 1351 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:41:49.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:41:49 smithi047 bash[22744]: audit 2024-09-16T10:41:48.462161+0000 mon.b (mon.2) 1207 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T10:41:49.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:41:49 smithi047 bash[22744]: audit 2024-09-16T10:41:48.464561+0000 mon.b (mon.2) 1208 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T10:41:49.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:41:49 smithi047 bash[22744]: audit 2024-09-16T10:41:48.476581+0000 mon.a (mon.0) 1352 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:41:49.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:41:49 smithi047 bash[22744]: audit 2024-09-16T10:41:48.481816+0000 mon.b (mon.2) 1209 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:41:49.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:41:49 smithi047 bash[22744]: audit 2024-09-16T10:41:48.485021+0000 mgr.a (mgr.14373) 13175 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:41:49.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:41:49 smithi157 bash[24585]: audit 2024-09-16T10:41:48.449013+0000 mon.a (mon.0) 1350 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:41:49.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:41:49 smithi157 bash[24585]: audit 2024-09-16T10:41:48.459358+0000 mon.a (mon.0) 1351 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:41:49.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:41:49 smithi157 bash[24585]: audit 2024-09-16T10:41:48.462161+0000 mon.b (mon.2) 1207 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T10:41:49.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:41:49 smithi157 bash[24585]: audit 2024-09-16T10:41:48.464561+0000 mon.b (mon.2) 1208 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T10:41:49.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:41:49 smithi157 bash[24585]: audit 2024-09-16T10:41:48.476581+0000 mon.a (mon.0) 1352 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:41:49.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:41:49 smithi157 bash[24585]: audit 2024-09-16T10:41:48.481816+0000 mon.b (mon.2) 1209 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:41:49.808 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:41:49 smithi157 bash[24585]: audit 2024-09-16T10:41:48.485021+0000 mgr.a (mgr.14373) 13175 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:41:49.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:41:49 smithi086 bash[24289]: audit 2024-09-16T10:41:48.449013+0000 mon.a (mon.0) 1350 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:41:49.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:41:49 smithi086 bash[24289]: audit 2024-09-16T10:41:48.459358+0000 mon.a (mon.0) 1351 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:41:49.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:41:49 smithi086 bash[24289]: audit 2024-09-16T10:41:48.462161+0000 mon.b (mon.2) 1207 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T10:41:49.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:41:49 smithi086 bash[24289]: audit 2024-09-16T10:41:48.464561+0000 mon.b (mon.2) 1208 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T10:41:49.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:41:49 smithi086 bash[24289]: audit 2024-09-16T10:41:48.476581+0000 mon.a (mon.0) 1352 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:41:49.822 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:41:49 smithi086 bash[24289]: audit 2024-09-16T10:41:48.481816+0000 mon.b (mon.2) 1209 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:41:49.822 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:41:49 smithi086 bash[24289]: audit 2024-09-16T10:41:48.485021+0000 mgr.a (mgr.14373) 13175 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:41:50.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:41:50 smithi157 bash[24585]: cluster 2024-09-16T10:41:48.749660+0000 mgr.a (mgr.14373) 13176 : cluster [DBG] pgmap v9138: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:41:50.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:41:50 smithi157 bash[24585]: audit 2024-09-16T10:41:49.230912+0000 mgr.a (mgr.14373) 13177 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T10:41:50.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:41:50 smithi157 bash[24585]: cephadm 2024-09-16T10:41:49.233099+0000 mgr.a (mgr.14373) 13178 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T10:41:50.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:41:50 smithi086 bash[24289]: cluster 2024-09-16T10:41:48.749660+0000 mgr.a (mgr.14373) 13176 : cluster [DBG] pgmap v9138: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:41:50.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:41:50 smithi086 bash[24289]: audit 2024-09-16T10:41:49.230912+0000 mgr.a (mgr.14373) 13177 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T10:41:50.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:41:50 smithi086 bash[24289]: cephadm 2024-09-16T10:41:49.233099+0000 mgr.a (mgr.14373) 13178 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T10:41:50.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:41:50 smithi047 bash[22744]: cluster 2024-09-16T10:41:48.749660+0000 mgr.a (mgr.14373) 13176 : cluster [DBG] pgmap v9138: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:41:50.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:41:50 smithi047 bash[22744]: audit 2024-09-16T10:41:49.230912+0000 mgr.a (mgr.14373) 13177 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T10:41:50.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:41:50 smithi047 bash[22744]: cephadm 2024-09-16T10:41:49.233099+0000 mgr.a (mgr.14373) 13178 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T10:41:52.578 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:41:52.578 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:41:52.579 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:41:52.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:41:52 smithi157 bash[24585]: cluster 2024-09-16T10:41:50.750731+0000 mgr.a (mgr.14373) 13179 : cluster [DBG] pgmap v9139: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T10:41:52.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:41:52 smithi086 bash[24289]: cluster 2024-09-16T10:41:50.750731+0000 mgr.a (mgr.14373) 13179 : cluster [DBG] pgmap v9139: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T10:41:52.846 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:41:52 smithi047 bash[22744]: cluster 2024-09-16T10:41:50.750731+0000 mgr.a (mgr.14373) 13179 : cluster [DBG] pgmap v9139: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T10:41:53.349 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:41:53.350 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:41:53.350 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:41:53.350 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:41:53.350 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:41:54.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:41:54 smithi157 bash[24585]: cluster 2024-09-16T10:41:52.752348+0000 mgr.a (mgr.14373) 13180 : cluster [DBG] pgmap v9140: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:41:54.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:41:54 smithi157 bash[24585]: audit 2024-09-16T10:41:52.911630+0000 mgr.a (mgr.14373) 13181 : audit [DBG] from='client.286752 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:41:54.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:41:54 smithi086 bash[24289]: cluster 2024-09-16T10:41:52.752348+0000 mgr.a (mgr.14373) 13180 : cluster [DBG] pgmap v9140: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:41:54.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:41:54 smithi086 bash[24289]: audit 2024-09-16T10:41:52.911630+0000 mgr.a (mgr.14373) 13181 : audit [DBG] from='client.286752 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:41:54.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:41:54 smithi047 bash[22744]: cluster 2024-09-16T10:41:52.752348+0000 mgr.a (mgr.14373) 13180 : cluster [DBG] pgmap v9140: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:41:54.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:41:54 smithi047 bash[22744]: audit 2024-09-16T10:41:52.911630+0000 mgr.a (mgr.14373) 13181 : audit [DBG] from='client.286752 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:41:56.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:41:56 smithi157 bash[24585]: cluster 2024-09-16T10:41:54.753234+0000 mgr.a (mgr.14373) 13182 : cluster [DBG] pgmap v9141: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.9 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T10:41:56.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:41:56 smithi086 bash[24289]: cluster 2024-09-16T10:41:54.753234+0000 mgr.a (mgr.14373) 13182 : cluster [DBG] pgmap v9141: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.9 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T10:41:56.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:41:56 smithi047 bash[22744]: cluster 2024-09-16T10:41:54.753234+0000 mgr.a (mgr.14373) 13182 : cluster [DBG] pgmap v9141: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.9 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T10:41:58.351 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:41:58.352 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:41:58.352 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:41:58.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:41:58 smithi157 bash[24585]: cluster 2024-09-16T10:41:56.755548+0000 mgr.a (mgr.14373) 13183 : cluster [DBG] pgmap v9142: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.8 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:41:58.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:41:58 smithi086 bash[24289]: cluster 2024-09-16T10:41:56.755548+0000 mgr.a (mgr.14373) 13183 : cluster [DBG] pgmap v9142: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.8 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:41:58.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:41:58 smithi047 bash[22744]: cluster 2024-09-16T10:41:56.755548+0000 mgr.a (mgr.14373) 13183 : cluster [DBG] pgmap v9142: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.8 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:41:59.105 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:41:59.105 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:41:59.105 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:41:59.105 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:41:59.105 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:42:00.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:42:00 smithi157 bash[24585]: audit 2024-09-16T10:41:58.685549+0000 mgr.a (mgr.14373) 13184 : audit [DBG] from='client.286827 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:42:00.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:42:00 smithi157 bash[24585]: cluster 2024-09-16T10:41:58.756108+0000 mgr.a (mgr.14373) 13185 : cluster [DBG] pgmap v9143: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:42:00.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:42:00 smithi086 bash[24289]: audit 2024-09-16T10:41:58.685549+0000 mgr.a (mgr.14373) 13184 : audit [DBG] from='client.286827 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:42:00.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:42:00 smithi086 bash[24289]: cluster 2024-09-16T10:41:58.756108+0000 mgr.a (mgr.14373) 13185 : cluster [DBG] pgmap v9143: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:42:00.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:42:00 smithi047 bash[22744]: audit 2024-09-16T10:41:58.685549+0000 mgr.a (mgr.14373) 13184 : audit [DBG] from='client.286827 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:42:00.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:42:00 smithi047 bash[22744]: cluster 2024-09-16T10:41:58.756108+0000 mgr.a (mgr.14373) 13185 : cluster [DBG] pgmap v9143: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:42:02.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:42:02 smithi157 bash[24585]: cluster 2024-09-16T10:42:00.757119+0000 mgr.a (mgr.14373) 13186 : cluster [DBG] pgmap v9144: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:42:02.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:42:02 smithi086 bash[24289]: cluster 2024-09-16T10:42:00.757119+0000 mgr.a (mgr.14373) 13186 : cluster [DBG] pgmap v9144: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:42:02.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:42:02 smithi047 bash[22744]: cluster 2024-09-16T10:42:00.757119+0000 mgr.a (mgr.14373) 13186 : cluster [DBG] pgmap v9144: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:42:04.106 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:42:04.107 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:42:04.107 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:42:04.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:42:04 smithi157 bash[24585]: cluster 2024-09-16T10:42:02.759554+0000 mgr.a (mgr.14373) 13187 : cluster [DBG] pgmap v9145: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:42:04.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:42:04 smithi086 bash[24289]: cluster 2024-09-16T10:42:02.759554+0000 mgr.a (mgr.14373) 13187 : cluster [DBG] pgmap v9145: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:42:04.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:42:04 smithi047 bash[22744]: cluster 2024-09-16T10:42:02.759554+0000 mgr.a (mgr.14373) 13187 : cluster [DBG] pgmap v9145: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:42:04.884 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:42:04.884 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:42:04.884 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:42:04.884 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:42:04.884 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:42:05.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:42:05 smithi157 bash[24585]: audit 2024-09-16T10:42:04.447226+0000 mgr.a (mgr.14373) 13188 : audit [DBG] from='client.286905 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:42:05.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:42:05 smithi086 bash[24289]: audit 2024-09-16T10:42:04.447226+0000 mgr.a (mgr.14373) 13188 : audit [DBG] from='client.286905 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:42:05.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:42:05 smithi047 bash[22744]: audit 2024-09-16T10:42:04.447226+0000 mgr.a (mgr.14373) 13188 : audit [DBG] from='client.286905 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:42:06.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:42:06 smithi157 bash[24585]: cluster 2024-09-16T10:42:04.760041+0000 mgr.a (mgr.14373) 13189 : cluster [DBG] pgmap v9146: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:42:06.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:42:06 smithi086 bash[24289]: cluster 2024-09-16T10:42:04.760041+0000 mgr.a (mgr.14373) 13189 : cluster [DBG] pgmap v9146: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:42:06.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:42:06 smithi047 bash[22744]: cluster 2024-09-16T10:42:04.760041+0000 mgr.a (mgr.14373) 13189 : cluster [DBG] pgmap v9146: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:42:08.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:42:08 smithi157 bash[24585]: cluster 2024-09-16T10:42:06.762230+0000 mgr.a (mgr.14373) 13190 : cluster [DBG] pgmap v9147: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:42:08.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:42:08 smithi086 bash[24289]: cluster 2024-09-16T10:42:06.762230+0000 mgr.a (mgr.14373) 13190 : cluster [DBG] pgmap v9147: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:42:08.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:42:08 smithi047 bash[22744]: cluster 2024-09-16T10:42:06.762230+0000 mgr.a (mgr.14373) 13190 : cluster [DBG] pgmap v9147: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:42:09.885 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:42:09.886 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:42:09.886 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:42:10.635 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:42:10.636 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:42:10.636 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:42:10.636 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:42:10.636 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:42:10.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:42:10 smithi157 bash[24585]: cluster 2024-09-16T10:42:08.763152+0000 mgr.a (mgr.14373) 13191 : cluster [DBG] pgmap v9148: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:42:10.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:42:10 smithi086 bash[24289]: cluster 2024-09-16T10:42:08.763152+0000 mgr.a (mgr.14373) 13191 : cluster [DBG] pgmap v9148: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:42:10.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:42:10 smithi047 bash[22744]: cluster 2024-09-16T10:42:08.763152+0000 mgr.a (mgr.14373) 13191 : cluster [DBG] pgmap v9148: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:42:11.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:42:11 smithi157 bash[24585]: audit 2024-09-16T10:42:10.212832+0000 mgr.a (mgr.14373) 13192 : audit [DBG] from='client.286980 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:42:11.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:42:11 smithi086 bash[24289]: audit 2024-09-16T10:42:10.212832+0000 mgr.a (mgr.14373) 13192 : audit [DBG] from='client.286980 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:42:11.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:42:11 smithi047 bash[22744]: audit 2024-09-16T10:42:10.212832+0000 mgr.a (mgr.14373) 13192 : audit [DBG] from='client.286980 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:42:12.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:42:12 smithi157 bash[24585]: cluster 2024-09-16T10:42:10.764014+0000 mgr.a (mgr.14373) 13193 : cluster [DBG] pgmap v9149: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:42:12.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:42:12 smithi086 bash[24289]: cluster 2024-09-16T10:42:10.764014+0000 mgr.a (mgr.14373) 13193 : cluster [DBG] pgmap v9149: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:42:12.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:42:12 smithi047 bash[22744]: cluster 2024-09-16T10:42:10.764014+0000 mgr.a (mgr.14373) 13193 : cluster [DBG] pgmap v9149: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:42:14.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:42:14 smithi157 bash[24585]: cluster 2024-09-16T10:42:12.766209+0000 mgr.a (mgr.14373) 13194 : cluster [DBG] pgmap v9150: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:42:14.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:42:14 smithi086 bash[24289]: cluster 2024-09-16T10:42:12.766209+0000 mgr.a (mgr.14373) 13194 : cluster [DBG] pgmap v9150: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:42:14.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:42:14 smithi047 bash[22744]: cluster 2024-09-16T10:42:12.766209+0000 mgr.a (mgr.14373) 13194 : cluster [DBG] pgmap v9150: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:42:15.637 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:42:15.637 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:42:15.638 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:42:16.370 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:42:16.371 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:42:16.371 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:42:16.371 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:42:16.371 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:42:16.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:42:16 smithi157 bash[24585]: cluster 2024-09-16T10:42:14.767285+0000 mgr.a (mgr.14373) 13195 : cluster [DBG] pgmap v9151: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:42:16.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:42:16 smithi086 bash[24289]: cluster 2024-09-16T10:42:14.767285+0000 mgr.a (mgr.14373) 13195 : cluster [DBG] pgmap v9151: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:42:16.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:42:16 smithi047 bash[22744]: cluster 2024-09-16T10:42:14.767285+0000 mgr.a (mgr.14373) 13195 : cluster [DBG] pgmap v9151: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:42:17.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:42:17 smithi157 bash[24585]: audit 2024-09-16T10:42:15.960134+0000 mgr.a (mgr.14373) 13196 : audit [DBG] from='client.287058 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:42:17.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:42:17 smithi086 bash[24289]: audit 2024-09-16T10:42:15.960134+0000 mgr.a (mgr.14373) 13196 : audit [DBG] from='client.287058 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:42:17.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:42:17 smithi047 bash[22744]: audit 2024-09-16T10:42:15.960134+0000 mgr.a (mgr.14373) 13196 : audit [DBG] from='client.287058 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:42:18.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:42:18 smithi086 bash[24289]: cluster 2024-09-16T10:42:16.769638+0000 mgr.a (mgr.14373) 13197 : cluster [DBG] pgmap v9152: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:42:18.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:42:18 smithi047 bash[22744]: cluster 2024-09-16T10:42:16.769638+0000 mgr.a (mgr.14373) 13197 : cluster [DBG] pgmap v9152: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:42:19.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:42:18 smithi157 bash[24585]: cluster 2024-09-16T10:42:16.769638+0000 mgr.a (mgr.14373) 13197 : cluster [DBG] pgmap v9152: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:42:20.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:42:20 smithi086 bash[24289]: cluster 2024-09-16T10:42:18.770424+0000 mgr.a (mgr.14373) 13198 : cluster [DBG] pgmap v9153: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:42:20.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:42:20 smithi047 bash[22744]: cluster 2024-09-16T10:42:18.770424+0000 mgr.a (mgr.14373) 13198 : cluster [DBG] pgmap v9153: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:42:21.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:42:20 smithi157 bash[24585]: cluster 2024-09-16T10:42:18.770424+0000 mgr.a (mgr.14373) 13198 : cluster [DBG] pgmap v9153: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:42:21.372 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:42:21.373 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:42:21.373 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:42:22.119 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:42:22.119 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:42:22.119 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:42:22.119 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:42:22.119 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:42:22.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:42:22 smithi086 bash[24289]: cluster 2024-09-16T10:42:20.771162+0000 mgr.a (mgr.14373) 13199 : cluster [DBG] pgmap v9154: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:42:22.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:42:22 smithi047 bash[22744]: cluster 2024-09-16T10:42:20.771162+0000 mgr.a (mgr.14373) 13199 : cluster [DBG] pgmap v9154: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:42:23.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:42:22 smithi157 bash[24585]: cluster 2024-09-16T10:42:20.771162+0000 mgr.a (mgr.14373) 13199 : cluster [DBG] pgmap v9154: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:42:23.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:42:23 smithi047 bash[22744]: audit 2024-09-16T10:42:21.702279+0000 mgr.a (mgr.14373) 13200 : audit [DBG] from='client.287136 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:42:24.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:42:23 smithi157 bash[24585]: audit 2024-09-16T10:42:21.702279+0000 mgr.a (mgr.14373) 13200 : audit [DBG] from='client.287136 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:42:24.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:42:23 smithi086 bash[24289]: audit 2024-09-16T10:42:21.702279+0000 mgr.a (mgr.14373) 13200 : audit [DBG] from='client.287136 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:42:24.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:42:24 smithi047 bash[22744]: cluster 2024-09-16T10:42:22.773839+0000 mgr.a (mgr.14373) 13201 : cluster [DBG] pgmap v9155: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:42:25.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:42:24 smithi157 bash[24585]: cluster 2024-09-16T10:42:22.773839+0000 mgr.a (mgr.14373) 13201 : cluster [DBG] pgmap v9155: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:42:25.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:42:24 smithi086 bash[24289]: cluster 2024-09-16T10:42:22.773839+0000 mgr.a (mgr.14373) 13201 : cluster [DBG] pgmap v9155: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:42:25.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:42:25 smithi047 bash[22744]: cluster 2024-09-16T10:42:24.774654+0000 mgr.a (mgr.14373) 13202 : cluster [DBG] pgmap v9156: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:42:26.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:42:25 smithi157 bash[24585]: cluster 2024-09-16T10:42:24.774654+0000 mgr.a (mgr.14373) 13202 : cluster [DBG] pgmap v9156: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:42:26.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:42:25 smithi086 bash[24289]: cluster 2024-09-16T10:42:24.774654+0000 mgr.a (mgr.14373) 13202 : cluster [DBG] pgmap v9156: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:42:27.120 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:42:27.121 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:42:27.121 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:42:27.900 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:42:27.900 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:42:27.900 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:42:27.900 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:42:27.900 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:42:28.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:42:27 smithi047 bash[22744]: cluster 2024-09-16T10:42:26.776591+0000 mgr.a (mgr.14373) 13203 : cluster [DBG] pgmap v9157: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:42:28.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:42:27 smithi047 bash[22744]: audit 2024-09-16T10:42:27.451517+0000 mgr.a (mgr.14373) 13204 : audit [DBG] from='client.287208 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:42:28.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:42:27 smithi157 bash[24585]: cluster 2024-09-16T10:42:26.776591+0000 mgr.a (mgr.14373) 13203 : cluster [DBG] pgmap v9157: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:42:28.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:42:27 smithi157 bash[24585]: audit 2024-09-16T10:42:27.451517+0000 mgr.a (mgr.14373) 13204 : audit [DBG] from='client.287208 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:42:28.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:42:27 smithi086 bash[24289]: cluster 2024-09-16T10:42:26.776591+0000 mgr.a (mgr.14373) 13203 : cluster [DBG] pgmap v9157: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:42:28.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:42:27 smithi086 bash[24289]: audit 2024-09-16T10:42:27.451517+0000 mgr.a (mgr.14373) 13204 : audit [DBG] from='client.287208 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:42:30.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:42:29 smithi047 bash[22744]: cluster 2024-09-16T10:42:28.777552+0000 mgr.a (mgr.14373) 13205 : cluster [DBG] pgmap v9158: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:42:30.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:42:29 smithi157 bash[24585]: cluster 2024-09-16T10:42:28.777552+0000 mgr.a (mgr.14373) 13205 : cluster [DBG] pgmap v9158: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:42:30.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:42:29 smithi086 bash[24289]: cluster 2024-09-16T10:42:28.777552+0000 mgr.a (mgr.14373) 13205 : cluster [DBG] pgmap v9158: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:42:32.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:42:31 smithi157 bash[24585]: cluster 2024-09-16T10:42:30.778315+0000 mgr.a (mgr.14373) 13206 : cluster [DBG] pgmap v9159: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T10:42:32.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:42:31 smithi086 bash[24289]: cluster 2024-09-16T10:42:30.778315+0000 mgr.a (mgr.14373) 13206 : cluster [DBG] pgmap v9159: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T10:42:32.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:42:31 smithi047 bash[22744]: cluster 2024-09-16T10:42:30.778315+0000 mgr.a (mgr.14373) 13206 : cluster [DBG] pgmap v9159: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T10:42:32.901 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:42:32.902 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:42:32.902 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:42:33.671 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:42:33.672 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:42:33.672 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:42:33.672 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:42:33.672 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:42:34.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:42:33 smithi157 bash[24585]: cluster 2024-09-16T10:42:32.780554+0000 mgr.a (mgr.14373) 13207 : cluster [DBG] pgmap v9160: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:42:34.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:42:33 smithi157 bash[24585]: audit 2024-09-16T10:42:33.235183+0000 mgr.a (mgr.14373) 13208 : audit [DBG] from='client.287283 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:42:34.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:42:33 smithi086 bash[24289]: cluster 2024-09-16T10:42:32.780554+0000 mgr.a (mgr.14373) 13207 : cluster [DBG] pgmap v9160: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:42:34.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:42:33 smithi086 bash[24289]: audit 2024-09-16T10:42:33.235183+0000 mgr.a (mgr.14373) 13208 : audit [DBG] from='client.287283 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:42:34.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:42:33 smithi047 bash[22744]: cluster 2024-09-16T10:42:32.780554+0000 mgr.a (mgr.14373) 13207 : cluster [DBG] pgmap v9160: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:42:34.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:42:33 smithi047 bash[22744]: audit 2024-09-16T10:42:33.235183+0000 mgr.a (mgr.14373) 13208 : audit [DBG] from='client.287283 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:42:36.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:42:35 smithi157 bash[24585]: cluster 2024-09-16T10:42:34.781536+0000 mgr.a (mgr.14373) 13209 : cluster [DBG] pgmap v9161: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:42:36.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:42:35 smithi086 bash[24289]: cluster 2024-09-16T10:42:34.781536+0000 mgr.a (mgr.14373) 13209 : cluster [DBG] pgmap v9161: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:42:36.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:42:35 smithi047 bash[22744]: cluster 2024-09-16T10:42:34.781536+0000 mgr.a (mgr.14373) 13209 : cluster [DBG] pgmap v9161: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:42:38.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:42:37 smithi157 bash[24585]: cluster 2024-09-16T10:42:36.783688+0000 mgr.a (mgr.14373) 13210 : cluster [DBG] pgmap v9162: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:42:38.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:42:37 smithi086 bash[24289]: cluster 2024-09-16T10:42:36.783688+0000 mgr.a (mgr.14373) 13210 : cluster [DBG] pgmap v9162: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:42:38.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:42:37 smithi047 bash[22744]: cluster 2024-09-16T10:42:36.783688+0000 mgr.a (mgr.14373) 13210 : cluster [DBG] pgmap v9162: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:42:38.673 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:42:38.674 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:42:38.674 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:42:39.463 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:42:39.463 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:42:39.464 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:42:39.464 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:42:39.464 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:42:40.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:42:39 smithi157 bash[24585]: cluster 2024-09-16T10:42:38.784143+0000 mgr.a (mgr.14373) 13211 : cluster [DBG] pgmap v9163: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:42:40.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:42:39 smithi157 bash[24585]: audit 2024-09-16T10:42:39.011376+0000 mgr.a (mgr.14373) 13212 : audit [DBG] from='client.287361 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:42:40.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:42:39 smithi086 bash[24289]: cluster 2024-09-16T10:42:38.784143+0000 mgr.a (mgr.14373) 13211 : cluster [DBG] pgmap v9163: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:42:40.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:42:39 smithi086 bash[24289]: audit 2024-09-16T10:42:39.011376+0000 mgr.a (mgr.14373) 13212 : audit [DBG] from='client.287361 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:42:40.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:42:39 smithi047 bash[22744]: cluster 2024-09-16T10:42:38.784143+0000 mgr.a (mgr.14373) 13211 : cluster [DBG] pgmap v9163: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:42:40.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:42:39 smithi047 bash[22744]: audit 2024-09-16T10:42:39.011376+0000 mgr.a (mgr.14373) 13212 : audit [DBG] from='client.287361 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:42:42.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:42:41 smithi157 bash[24585]: cluster 2024-09-16T10:42:40.785083+0000 mgr.a (mgr.14373) 13213 : cluster [DBG] pgmap v9164: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:42:42.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:42:41 smithi086 bash[24289]: cluster 2024-09-16T10:42:40.785083+0000 mgr.a (mgr.14373) 13213 : cluster [DBG] pgmap v9164: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:42:42.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:42:41 smithi047 bash[22744]: cluster 2024-09-16T10:42:40.785083+0000 mgr.a (mgr.14373) 13213 : cluster [DBG] pgmap v9164: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:42:44.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:42:43 smithi157 bash[24585]: cluster 2024-09-16T10:42:42.787389+0000 mgr.a (mgr.14373) 13214 : cluster [DBG] pgmap v9165: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:42:44.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:42:43 smithi086 bash[24289]: cluster 2024-09-16T10:42:42.787389+0000 mgr.a (mgr.14373) 13214 : cluster [DBG] pgmap v9165: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:42:44.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:42:43 smithi047 bash[22744]: cluster 2024-09-16T10:42:42.787389+0000 mgr.a (mgr.14373) 13214 : cluster [DBG] pgmap v9165: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:42:44.465 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:42:44.466 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:42:44.466 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:42:45.228 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:42:45.228 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:42:45.228 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:42:45.229 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:42:45.229 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:42:46.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:42:45 smithi157 bash[24585]: cluster 2024-09-16T10:42:44.788136+0000 mgr.a (mgr.14373) 13215 : cluster [DBG] pgmap v9166: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:42:46.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:42:45 smithi157 bash[24585]: audit 2024-09-16T10:42:44.791568+0000 mgr.a (mgr.14373) 13216 : audit [DBG] from='client.287436 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:42:46.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:42:45 smithi086 bash[24289]: cluster 2024-09-16T10:42:44.788136+0000 mgr.a (mgr.14373) 13215 : cluster [DBG] pgmap v9166: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:42:46.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:42:45 smithi086 bash[24289]: audit 2024-09-16T10:42:44.791568+0000 mgr.a (mgr.14373) 13216 : audit [DBG] from='client.287436 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:42:46.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:42:45 smithi047 bash[22744]: cluster 2024-09-16T10:42:44.788136+0000 mgr.a (mgr.14373) 13215 : cluster [DBG] pgmap v9166: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:42:46.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:42:45 smithi047 bash[22744]: audit 2024-09-16T10:42:44.791568+0000 mgr.a (mgr.14373) 13216 : audit [DBG] from='client.287436 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:42:48.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:42:47 smithi157 bash[24585]: cluster 2024-09-16T10:42:46.790539+0000 mgr.a (mgr.14373) 13217 : cluster [DBG] pgmap v9167: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:42:48.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:42:47 smithi086 bash[24289]: cluster 2024-09-16T10:42:46.790539+0000 mgr.a (mgr.14373) 13217 : cluster [DBG] pgmap v9167: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:42:48.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:42:47 smithi047 bash[22744]: cluster 2024-09-16T10:42:46.790539+0000 mgr.a (mgr.14373) 13217 : cluster [DBG] pgmap v9167: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:42:50.229 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:42:50.230 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:42:50.230 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:42:50.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:42:49 smithi157 bash[24585]: cluster 2024-09-16T10:42:48.791357+0000 mgr.a (mgr.14373) 13218 : cluster [DBG] pgmap v9168: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:42:50.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:42:49 smithi157 bash[24585]: audit 2024-09-16T10:42:49.301368+0000 mon.b (mon.2) 1210 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T10:42:50.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:42:49 smithi086 bash[24289]: cluster 2024-09-16T10:42:48.791357+0000 mgr.a (mgr.14373) 13218 : cluster [DBG] pgmap v9168: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:42:50.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:42:49 smithi086 bash[24289]: audit 2024-09-16T10:42:49.301368+0000 mon.b (mon.2) 1210 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T10:42:50.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:42:49 smithi047 bash[22744]: cluster 2024-09-16T10:42:48.791357+0000 mgr.a (mgr.14373) 13218 : cluster [DBG] pgmap v9168: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:42:50.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:42:49 smithi047 bash[22744]: audit 2024-09-16T10:42:49.301368+0000 mon.b (mon.2) 1210 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T10:42:50.988 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:42:50.988 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:42:50.988 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:42:50.988 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:42:50.988 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:42:51.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:42:50 smithi157 bash[24585]: audit 2024-09-16T10:42:50.557193+0000 mgr.a (mgr.14373) 13219 : audit [DBG] from='client.287514 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:42:51.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:42:50 smithi086 bash[24289]: audit 2024-09-16T10:42:50.557193+0000 mgr.a (mgr.14373) 13219 : audit [DBG] from='client.287514 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:42:51.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:42:50 smithi047 bash[22744]: audit 2024-09-16T10:42:50.557193+0000 mgr.a (mgr.14373) 13219 : audit [DBG] from='client.287514 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:42:52.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:42:51 smithi157 bash[24585]: cluster 2024-09-16T10:42:50.793291+0000 mgr.a (mgr.14373) 13220 : cluster [DBG] pgmap v9169: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:42:52.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:42:51 smithi086 bash[24289]: cluster 2024-09-16T10:42:50.793291+0000 mgr.a (mgr.14373) 13220 : cluster [DBG] pgmap v9169: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:42:52.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:42:51 smithi047 bash[22744]: cluster 2024-09-16T10:42:50.793291+0000 mgr.a (mgr.14373) 13220 : cluster [DBG] pgmap v9169: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:42:54.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:42:53 smithi157 bash[24585]: cluster 2024-09-16T10:42:52.795677+0000 mgr.a (mgr.14373) 13221 : cluster [DBG] pgmap v9170: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:42:54.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:42:53 smithi086 bash[24289]: cluster 2024-09-16T10:42:52.795677+0000 mgr.a (mgr.14373) 13221 : cluster [DBG] pgmap v9170: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:42:54.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:42:53 smithi047 bash[22744]: cluster 2024-09-16T10:42:52.795677+0000 mgr.a (mgr.14373) 13221 : cluster [DBG] pgmap v9170: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:42:55.993 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:42:55.993 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:42:55.993 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:42:56.260 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:42:55 smithi157 bash[24585]: cluster 2024-09-16T10:42:54.796473+0000 mgr.a (mgr.14373) 13222 : cluster [DBG] pgmap v9171: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:42:56.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:42:55 smithi086 bash[24289]: cluster 2024-09-16T10:42:54.796473+0000 mgr.a (mgr.14373) 13222 : cluster [DBG] pgmap v9171: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:42:56.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:42:55 smithi047 bash[22744]: cluster 2024-09-16T10:42:54.796473+0000 mgr.a (mgr.14373) 13222 : cluster [DBG] pgmap v9171: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:42:56.738 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:42:56.739 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:42:56.739 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:42:56.739 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:42:56.739 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:42:57.200 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:42:56 smithi157 bash[24585]: audit 2024-09-16T10:42:56.318737+0000 mgr.a (mgr.14373) 13223 : audit [DBG] from='client.287592 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:42:57.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:42:56 smithi086 bash[24289]: audit 2024-09-16T10:42:56.318737+0000 mgr.a (mgr.14373) 13223 : audit [DBG] from='client.287592 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:42:57.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:42:56 smithi047 bash[22744]: audit 2024-09-16T10:42:56.318737+0000 mgr.a (mgr.14373) 13223 : audit [DBG] from='client.287592 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:42:58.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:42:57 smithi157 bash[24585]: cluster 2024-09-16T10:42:56.799038+0000 mgr.a (mgr.14373) 13224 : cluster [DBG] pgmap v9172: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-16T10:42:58.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:42:57 smithi086 bash[24289]: cluster 2024-09-16T10:42:56.799038+0000 mgr.a (mgr.14373) 13224 : cluster [DBG] pgmap v9172: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-16T10:42:58.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:42:57 smithi047 bash[22744]: cluster 2024-09-16T10:42:56.799038+0000 mgr.a (mgr.14373) 13224 : cluster [DBG] pgmap v9172: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-16T10:43:00.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:42:59 smithi157 bash[24585]: cluster 2024-09-16T10:42:58.799862+0000 mgr.a (mgr.14373) 13225 : cluster [DBG] pgmap v9173: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T10:43:00.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:42:59 smithi157 bash[24585]: audit 2024-09-16T10:42:59.711276+0000 mon.a (mon.0) 1353 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:43:00.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:42:59 smithi157 bash[24585]: audit 2024-09-16T10:42:59.721362+0000 mon.a (mon.0) 1354 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:43:00.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:42:59 smithi157 bash[24585]: audit 2024-09-16T10:42:59.724042+0000 mon.b (mon.2) 1211 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T10:43:00.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:42:59 smithi157 bash[24585]: audit 2024-09-16T10:42:59.726705+0000 mon.b (mon.2) 1212 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T10:43:00.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:42:59 smithi157 bash[24585]: audit 2024-09-16T10:42:59.738975+0000 mon.a (mon.0) 1355 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:43:00.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:42:59 smithi157 bash[24585]: audit 2024-09-16T10:42:59.744289+0000 mon.b (mon.2) 1213 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:43:00.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:42:59 smithi086 bash[24289]: cluster 2024-09-16T10:42:58.799862+0000 mgr.a (mgr.14373) 13225 : cluster [DBG] pgmap v9173: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T10:43:00.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:42:59 smithi086 bash[24289]: audit 2024-09-16T10:42:59.711276+0000 mon.a (mon.0) 1353 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:43:00.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:42:59 smithi086 bash[24289]: audit 2024-09-16T10:42:59.721362+0000 mon.a (mon.0) 1354 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:43:00.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:42:59 smithi086 bash[24289]: audit 2024-09-16T10:42:59.724042+0000 mon.b (mon.2) 1211 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T10:43:00.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:42:59 smithi086 bash[24289]: audit 2024-09-16T10:42:59.726705+0000 mon.b (mon.2) 1212 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T10:43:00.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:42:59 smithi086 bash[24289]: audit 2024-09-16T10:42:59.738975+0000 mon.a (mon.0) 1355 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:43:00.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:42:59 smithi086 bash[24289]: audit 2024-09-16T10:42:59.744289+0000 mon.b (mon.2) 1213 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:43:00.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:42:59 smithi047 bash[22744]: cluster 2024-09-16T10:42:58.799862+0000 mgr.a (mgr.14373) 13225 : cluster [DBG] pgmap v9173: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T10:43:00.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:42:59 smithi047 bash[22744]: audit 2024-09-16T10:42:59.711276+0000 mon.a (mon.0) 1353 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:43:00.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:42:59 smithi047 bash[22744]: audit 2024-09-16T10:42:59.721362+0000 mon.a (mon.0) 1354 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:43:00.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:42:59 smithi047 bash[22744]: audit 2024-09-16T10:42:59.724042+0000 mon.b (mon.2) 1211 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T10:43:00.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:42:59 smithi047 bash[22744]: audit 2024-09-16T10:42:59.726705+0000 mon.b (mon.2) 1212 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T10:43:00.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:42:59 smithi047 bash[22744]: audit 2024-09-16T10:42:59.738975+0000 mon.a (mon.0) 1355 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:43:00.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:42:59 smithi047 bash[22744]: audit 2024-09-16T10:42:59.744289+0000 mon.b (mon.2) 1213 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:43:00.842 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 10:43:00 smithi047 bash[22994]: debug 2024-09-16T10:43:00.538+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T10:43:00.842 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 10:43:00 smithi047 bash[22994]: debug 2024-09-16T10:43:00.542+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T10:43:01.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:43:00 smithi157 bash[24585]: audit 2024-09-16T10:42:59.747068+0000 mgr.a (mgr.14373) 13226 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:43:01.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:43:00 smithi157 bash[24585]: audit 2024-09-16T10:43:00.541504+0000 mgr.a (mgr.14373) 13227 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T10:43:01.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:43:00 smithi157 bash[24585]: cephadm 2024-09-16T10:43:00.543635+0000 mgr.a (mgr.14373) 13228 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T10:43:01.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:43:00 smithi086 bash[24289]: audit 2024-09-16T10:42:59.747068+0000 mgr.a (mgr.14373) 13226 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:43:01.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:43:00 smithi086 bash[24289]: audit 2024-09-16T10:43:00.541504+0000 mgr.a (mgr.14373) 13227 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T10:43:01.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:43:00 smithi086 bash[24289]: cephadm 2024-09-16T10:43:00.543635+0000 mgr.a (mgr.14373) 13228 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T10:43:01.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:43:00 smithi047 bash[22744]: audit 2024-09-16T10:42:59.747068+0000 mgr.a (mgr.14373) 13226 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:43:01.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:43:00 smithi047 bash[22744]: audit 2024-09-16T10:43:00.541504+0000 mgr.a (mgr.14373) 13227 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T10:43:01.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:43:00 smithi047 bash[22744]: cephadm 2024-09-16T10:43:00.543635+0000 mgr.a (mgr.14373) 13228 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T10:43:01.740 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:43:01.741 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:43:01.741 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:43:02.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:43:01 smithi157 bash[24585]: cluster 2024-09-16T10:43:00.800814+0000 mgr.a (mgr.14373) 13229 : cluster [DBG] pgmap v9174: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T10:43:02.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:43:01 smithi086 bash[24289]: cluster 2024-09-16T10:43:00.800814+0000 mgr.a (mgr.14373) 13229 : cluster [DBG] pgmap v9174: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T10:43:02.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:43:01 smithi047 bash[22744]: cluster 2024-09-16T10:43:00.800814+0000 mgr.a (mgr.14373) 13229 : cluster [DBG] pgmap v9174: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T10:43:02.502 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:43:02.502 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:43:02.502 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:43:02.502 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:43:02.502 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:43:03.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:43:02 smithi157 bash[24585]: audit 2024-09-16T10:43:02.074252+0000 mgr.a (mgr.14373) 13230 : audit [DBG] from='client.287775 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:43:03.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:43:02 smithi086 bash[24289]: audit 2024-09-16T10:43:02.074252+0000 mgr.a (mgr.14373) 13230 : audit [DBG] from='client.287775 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:43:03.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:43:02 smithi047 bash[22744]: audit 2024-09-16T10:43:02.074252+0000 mgr.a (mgr.14373) 13230 : audit [DBG] from='client.287775 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:43:04.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:43:03 smithi157 bash[24585]: cluster 2024-09-16T10:43:02.803600+0000 mgr.a (mgr.14373) 13231 : cluster [DBG] pgmap v9175: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:43:04.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:43:03 smithi086 bash[24289]: cluster 2024-09-16T10:43:02.803600+0000 mgr.a (mgr.14373) 13231 : cluster [DBG] pgmap v9175: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:43:04.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:43:03 smithi047 bash[22744]: cluster 2024-09-16T10:43:02.803600+0000 mgr.a (mgr.14373) 13231 : cluster [DBG] pgmap v9175: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:43:06.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:43:05 smithi157 bash[24585]: cluster 2024-09-16T10:43:04.804440+0000 mgr.a (mgr.14373) 13232 : cluster [DBG] pgmap v9176: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T10:43:06.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:43:05 smithi086 bash[24289]: cluster 2024-09-16T10:43:04.804440+0000 mgr.a (mgr.14373) 13232 : cluster [DBG] pgmap v9176: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T10:43:06.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:43:05 smithi047 bash[22744]: cluster 2024-09-16T10:43:04.804440+0000 mgr.a (mgr.14373) 13232 : cluster [DBG] pgmap v9176: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T10:43:07.504 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:43:07.505 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:43:07.505 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:43:08.264 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:43:08.264 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:43:08.264 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:43:08.264 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:43:08.264 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:43:08.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:43:07 smithi157 bash[24585]: cluster 2024-09-16T10:43:06.806460+0000 mgr.a (mgr.14373) 13233 : cluster [DBG] pgmap v9177: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:43:08.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:43:07 smithi086 bash[24289]: cluster 2024-09-16T10:43:06.806460+0000 mgr.a (mgr.14373) 13233 : cluster [DBG] pgmap v9177: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:43:08.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:43:07 smithi047 bash[22744]: cluster 2024-09-16T10:43:06.806460+0000 mgr.a (mgr.14373) 13233 : cluster [DBG] pgmap v9177: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:43:09.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:43:08 smithi157 bash[24585]: audit 2024-09-16T10:43:07.837762+0000 mgr.a (mgr.14373) 13234 : audit [DBG] from='client.287853 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:43:09.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:43:08 smithi086 bash[24289]: audit 2024-09-16T10:43:07.837762+0000 mgr.a (mgr.14373) 13234 : audit [DBG] from='client.287853 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:43:09.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:43:08 smithi047 bash[22744]: audit 2024-09-16T10:43:07.837762+0000 mgr.a (mgr.14373) 13234 : audit [DBG] from='client.287853 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:43:10.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:43:09 smithi157 bash[24585]: cluster 2024-09-16T10:43:08.807423+0000 mgr.a (mgr.14373) 13235 : cluster [DBG] pgmap v9178: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T10:43:10.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:43:09 smithi086 bash[24289]: cluster 2024-09-16T10:43:08.807423+0000 mgr.a (mgr.14373) 13235 : cluster [DBG] pgmap v9178: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T10:43:10.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:43:09 smithi047 bash[22744]: cluster 2024-09-16T10:43:08.807423+0000 mgr.a (mgr.14373) 13235 : cluster [DBG] pgmap v9178: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T10:43:12.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:43:11 smithi157 bash[24585]: cluster 2024-09-16T10:43:10.808357+0000 mgr.a (mgr.14373) 13236 : cluster [DBG] pgmap v9179: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T10:43:12.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:43:11 smithi086 bash[24289]: cluster 2024-09-16T10:43:10.808357+0000 mgr.a (mgr.14373) 13236 : cluster [DBG] pgmap v9179: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T10:43:12.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:43:11 smithi047 bash[22744]: cluster 2024-09-16T10:43:10.808357+0000 mgr.a (mgr.14373) 13236 : cluster [DBG] pgmap v9179: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T10:43:13.265 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:43:13.266 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:43:13.266 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:43:14.036 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:43:14.036 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:43:14.037 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:43:14.037 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:43:14.037 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:43:14.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:43:13 smithi157 bash[24585]: cluster 2024-09-16T10:43:12.810799+0000 mgr.a (mgr.14373) 13237 : cluster [DBG] pgmap v9180: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:43:14.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:43:13 smithi086 bash[24289]: cluster 2024-09-16T10:43:12.810799+0000 mgr.a (mgr.14373) 13237 : cluster [DBG] pgmap v9180: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:43:14.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:43:13 smithi047 bash[22744]: cluster 2024-09-16T10:43:12.810799+0000 mgr.a (mgr.14373) 13237 : cluster [DBG] pgmap v9180: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:43:15.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:43:14 smithi157 bash[24585]: audit 2024-09-16T10:43:13.604062+0000 mgr.a (mgr.14373) 13238 : audit [DBG] from='client.287928 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:43:15.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:43:14 smithi086 bash[24289]: audit 2024-09-16T10:43:13.604062+0000 mgr.a (mgr.14373) 13238 : audit [DBG] from='client.287928 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:43:15.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:43:14 smithi047 bash[22744]: audit 2024-09-16T10:43:13.604062+0000 mgr.a (mgr.14373) 13238 : audit [DBG] from='client.287928 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:43:16.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:43:15 smithi157 bash[24585]: cluster 2024-09-16T10:43:14.811964+0000 mgr.a (mgr.14373) 13239 : cluster [DBG] pgmap v9181: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:43:16.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:43:15 smithi086 bash[24289]: cluster 2024-09-16T10:43:14.811964+0000 mgr.a (mgr.14373) 13239 : cluster [DBG] pgmap v9181: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:43:16.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:43:15 smithi047 bash[22744]: cluster 2024-09-16T10:43:14.811964+0000 mgr.a (mgr.14373) 13239 : cluster [DBG] pgmap v9181: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:43:18.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:43:17 smithi157 bash[24585]: cluster 2024-09-16T10:43:16.814320+0000 mgr.a (mgr.14373) 13240 : cluster [DBG] pgmap v9182: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:43:18.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:43:17 smithi086 bash[24289]: cluster 2024-09-16T10:43:16.814320+0000 mgr.a (mgr.14373) 13240 : cluster [DBG] pgmap v9182: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:43:18.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:43:17 smithi047 bash[22744]: cluster 2024-09-16T10:43:16.814320+0000 mgr.a (mgr.14373) 13240 : cluster [DBG] pgmap v9182: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:43:19.038 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:43:19.039 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:43:19.039 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:43:19.827 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:43:19.827 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:43:19.827 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:43:19.828 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:43:19.828 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:43:20.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:43:19 smithi157 bash[24585]: cluster 2024-09-16T10:43:18.815256+0000 mgr.a (mgr.14373) 13241 : cluster [DBG] pgmap v9183: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:43:20.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:43:19 smithi157 bash[24585]: audit 2024-09-16T10:43:19.373053+0000 mgr.a (mgr.14373) 13242 : audit [DBG] from='client.288006 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:43:20.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:43:19 smithi086 bash[24289]: cluster 2024-09-16T10:43:18.815256+0000 mgr.a (mgr.14373) 13241 : cluster [DBG] pgmap v9183: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:43:20.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:43:19 smithi086 bash[24289]: audit 2024-09-16T10:43:19.373053+0000 mgr.a (mgr.14373) 13242 : audit [DBG] from='client.288006 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:43:20.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:43:19 smithi047 bash[22744]: cluster 2024-09-16T10:43:18.815256+0000 mgr.a (mgr.14373) 13241 : cluster [DBG] pgmap v9183: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:43:20.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:43:19 smithi047 bash[22744]: audit 2024-09-16T10:43:19.373053+0000 mgr.a (mgr.14373) 13242 : audit [DBG] from='client.288006 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:43:22.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:43:21 smithi157 bash[24585]: cluster 2024-09-16T10:43:20.816420+0000 mgr.a (mgr.14373) 13243 : cluster [DBG] pgmap v9184: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:43:22.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:43:21 smithi086 bash[24289]: cluster 2024-09-16T10:43:20.816420+0000 mgr.a (mgr.14373) 13243 : cluster [DBG] pgmap v9184: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:43:22.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:43:21 smithi047 bash[22744]: cluster 2024-09-16T10:43:20.816420+0000 mgr.a (mgr.14373) 13243 : cluster [DBG] pgmap v9184: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:43:24.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:43:23 smithi157 bash[24585]: cluster 2024-09-16T10:43:22.818858+0000 mgr.a (mgr.14373) 13244 : cluster [DBG] pgmap v9185: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:43:24.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:43:23 smithi086 bash[24289]: cluster 2024-09-16T10:43:22.818858+0000 mgr.a (mgr.14373) 13244 : cluster [DBG] pgmap v9185: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:43:24.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:43:23 smithi047 bash[22744]: cluster 2024-09-16T10:43:22.818858+0000 mgr.a (mgr.14373) 13244 : cluster [DBG] pgmap v9185: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:43:24.829 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:43:24.829 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:43:24.829 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:43:25.609 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:43:25.610 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:43:25.610 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:43:25.610 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:43:25.610 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:43:26.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:43:25 smithi157 bash[24585]: cluster 2024-09-16T10:43:24.819797+0000 mgr.a (mgr.14373) 13245 : cluster [DBG] pgmap v9186: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:43:26.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:43:25 smithi157 bash[24585]: audit 2024-09-16T10:43:25.165012+0000 mgr.a (mgr.14373) 13246 : audit [DBG] from='client.288084 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:43:26.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:43:25 smithi086 bash[24289]: cluster 2024-09-16T10:43:24.819797+0000 mgr.a (mgr.14373) 13245 : cluster [DBG] pgmap v9186: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:43:26.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:43:25 smithi086 bash[24289]: audit 2024-09-16T10:43:25.165012+0000 mgr.a (mgr.14373) 13246 : audit [DBG] from='client.288084 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:43:26.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:43:25 smithi047 bash[22744]: cluster 2024-09-16T10:43:24.819797+0000 mgr.a (mgr.14373) 13245 : cluster [DBG] pgmap v9186: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:43:26.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:43:25 smithi047 bash[22744]: audit 2024-09-16T10:43:25.165012+0000 mgr.a (mgr.14373) 13246 : audit [DBG] from='client.288084 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:43:28.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:43:28 smithi157 bash[24585]: cluster 2024-09-16T10:43:26.822072+0000 mgr.a (mgr.14373) 13247 : cluster [DBG] pgmap v9187: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:43:28.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:43:28 smithi086 bash[24289]: cluster 2024-09-16T10:43:26.822072+0000 mgr.a (mgr.14373) 13247 : cluster [DBG] pgmap v9187: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:43:28.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:43:28 smithi047 bash[22744]: cluster 2024-09-16T10:43:26.822072+0000 mgr.a (mgr.14373) 13247 : cluster [DBG] pgmap v9187: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:43:30.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:43:30 smithi157 bash[24585]: cluster 2024-09-16T10:43:28.822900+0000 mgr.a (mgr.14373) 13248 : cluster [DBG] pgmap v9188: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:43:30.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:43:30 smithi086 bash[24289]: cluster 2024-09-16T10:43:28.822900+0000 mgr.a (mgr.14373) 13248 : cluster [DBG] pgmap v9188: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:43:30.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:43:30 smithi047 bash[22744]: cluster 2024-09-16T10:43:28.822900+0000 mgr.a (mgr.14373) 13248 : cluster [DBG] pgmap v9188: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:43:30.611 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:43:30.612 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:43:30.612 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:43:31.354 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:43:31.355 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:43:31.355 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:43:31.355 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:43:31.355 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:43:32.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:43:32 smithi157 bash[24585]: cluster 2024-09-16T10:43:30.823784+0000 mgr.a (mgr.14373) 13249 : cluster [DBG] pgmap v9189: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:43:32.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:43:32 smithi157 bash[24585]: audit 2024-09-16T10:43:30.943337+0000 mgr.a (mgr.14373) 13250 : audit [DBG] from='client.288162 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:43:32.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:43:32 smithi086 bash[24289]: cluster 2024-09-16T10:43:30.823784+0000 mgr.a (mgr.14373) 13249 : cluster [DBG] pgmap v9189: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:43:32.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:43:32 smithi086 bash[24289]: audit 2024-09-16T10:43:30.943337+0000 mgr.a (mgr.14373) 13250 : audit [DBG] from='client.288162 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:43:32.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:43:32 smithi047 bash[22744]: cluster 2024-09-16T10:43:30.823784+0000 mgr.a (mgr.14373) 13249 : cluster [DBG] pgmap v9189: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:43:32.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:43:32 smithi047 bash[22744]: audit 2024-09-16T10:43:30.943337+0000 mgr.a (mgr.14373) 13250 : audit [DBG] from='client.288162 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:43:34.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:43:34 smithi157 bash[24585]: cluster 2024-09-16T10:43:32.826219+0000 mgr.a (mgr.14373) 13251 : cluster [DBG] pgmap v9190: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:43:34.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:43:34 smithi086 bash[24289]: cluster 2024-09-16T10:43:32.826219+0000 mgr.a (mgr.14373) 13251 : cluster [DBG] pgmap v9190: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:43:34.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:43:34 smithi047 bash[22744]: cluster 2024-09-16T10:43:32.826219+0000 mgr.a (mgr.14373) 13251 : cluster [DBG] pgmap v9190: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:43:36.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:43:36 smithi157 bash[24585]: cluster 2024-09-16T10:43:34.826942+0000 mgr.a (mgr.14373) 13252 : cluster [DBG] pgmap v9191: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:43:36.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:43:36 smithi086 bash[24289]: cluster 2024-09-16T10:43:34.826942+0000 mgr.a (mgr.14373) 13252 : cluster [DBG] pgmap v9191: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:43:36.345 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:43:36 smithi047 bash[22744]: cluster 2024-09-16T10:43:34.826942+0000 mgr.a (mgr.14373) 13252 : cluster [DBG] pgmap v9191: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:43:36.356 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:43:36.357 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:43:36.357 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:43:37.113 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:43:37.113 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:43:37.113 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:43:37.113 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:43:37.113 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:43:38.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:43:38 smithi157 bash[24585]: audit 2024-09-16T10:43:36.689271+0000 mgr.a (mgr.14373) 13253 : audit [DBG] from='client.288237 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:43:38.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:43:38 smithi157 bash[24585]: cluster 2024-09-16T10:43:36.831819+0000 mgr.a (mgr.14373) 13254 : cluster [DBG] pgmap v9192: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:43:38.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:43:38 smithi086 bash[24289]: audit 2024-09-16T10:43:36.689271+0000 mgr.a (mgr.14373) 13253 : audit [DBG] from='client.288237 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:43:38.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:43:38 smithi086 bash[24289]: cluster 2024-09-16T10:43:36.831819+0000 mgr.a (mgr.14373) 13254 : cluster [DBG] pgmap v9192: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:43:38.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:43:38 smithi047 bash[22744]: audit 2024-09-16T10:43:36.689271+0000 mgr.a (mgr.14373) 13253 : audit [DBG] from='client.288237 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:43:38.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:43:38 smithi047 bash[22744]: cluster 2024-09-16T10:43:36.831819+0000 mgr.a (mgr.14373) 13254 : cluster [DBG] pgmap v9192: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:43:40.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:43:40 smithi157 bash[24585]: cluster 2024-09-16T10:43:38.832732+0000 mgr.a (mgr.14373) 13255 : cluster [DBG] pgmap v9193: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:43:40.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:43:40 smithi086 bash[24289]: cluster 2024-09-16T10:43:38.832732+0000 mgr.a (mgr.14373) 13255 : cluster [DBG] pgmap v9193: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:43:40.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:43:40 smithi047 bash[22744]: cluster 2024-09-16T10:43:38.832732+0000 mgr.a (mgr.14373) 13255 : cluster [DBG] pgmap v9193: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:43:42.114 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:43:42.114 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:43:42.115 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:43:42.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:43:42 smithi157 bash[24585]: cluster 2024-09-16T10:43:40.833551+0000 mgr.a (mgr.14373) 13256 : cluster [DBG] pgmap v9194: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:43:42.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:43:42 smithi086 bash[24289]: cluster 2024-09-16T10:43:40.833551+0000 mgr.a (mgr.14373) 13256 : cluster [DBG] pgmap v9194: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:43:42.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:43:42 smithi047 bash[22744]: cluster 2024-09-16T10:43:40.833551+0000 mgr.a (mgr.14373) 13256 : cluster [DBG] pgmap v9194: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:43:42.905 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:43:42.906 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:43:42.906 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:43:42.906 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:43:42.906 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:43:43.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:43:43 smithi157 bash[24585]: audit 2024-09-16T10:43:42.449580+0000 mgr.a (mgr.14373) 13257 : audit [DBG] from='client.288315 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:43:43.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:43:43 smithi086 bash[24289]: audit 2024-09-16T10:43:42.449580+0000 mgr.a (mgr.14373) 13257 : audit [DBG] from='client.288315 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:43:43.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:43:43 smithi047 bash[22744]: audit 2024-09-16T10:43:42.449580+0000 mgr.a (mgr.14373) 13257 : audit [DBG] from='client.288315 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:43:44.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:43:44 smithi157 bash[24585]: cluster 2024-09-16T10:43:42.834976+0000 mgr.a (mgr.14373) 13258 : cluster [DBG] pgmap v9195: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:43:44.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:43:44 smithi086 bash[24289]: cluster 2024-09-16T10:43:42.834976+0000 mgr.a (mgr.14373) 13258 : cluster [DBG] pgmap v9195: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:43:44.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:43:44 smithi047 bash[22744]: cluster 2024-09-16T10:43:42.834976+0000 mgr.a (mgr.14373) 13258 : cluster [DBG] pgmap v9195: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:43:46.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:43:46 smithi157 bash[24585]: cluster 2024-09-16T10:43:44.835727+0000 mgr.a (mgr.14373) 13259 : cluster [DBG] pgmap v9196: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:43:46.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:43:46 smithi086 bash[24289]: cluster 2024-09-16T10:43:44.835727+0000 mgr.a (mgr.14373) 13259 : cluster [DBG] pgmap v9196: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:43:46.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:43:46 smithi047 bash[22744]: cluster 2024-09-16T10:43:44.835727+0000 mgr.a (mgr.14373) 13259 : cluster [DBG] pgmap v9196: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:43:47.907 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:43:47.908 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:43:47.908 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:43:48.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:43:48 smithi157 bash[24585]: cluster 2024-09-16T10:43:46.837664+0000 mgr.a (mgr.14373) 13260 : cluster [DBG] pgmap v9197: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:43:48.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:43:48 smithi086 bash[24289]: cluster 2024-09-16T10:43:46.837664+0000 mgr.a (mgr.14373) 13260 : cluster [DBG] pgmap v9197: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:43:48.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:43:48 smithi047 bash[22744]: cluster 2024-09-16T10:43:46.837664+0000 mgr.a (mgr.14373) 13260 : cluster [DBG] pgmap v9197: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:43:48.682 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:43:48.682 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:43:48.682 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:43:48.682 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:43:48.682 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:43:49.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:43:49 smithi157 bash[24585]: audit 2024-09-16T10:43:48.241509+0000 mgr.a (mgr.14373) 13261 : audit [DBG] from='client.288393 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:43:49.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:43:49 smithi086 bash[24289]: audit 2024-09-16T10:43:48.241509+0000 mgr.a (mgr.14373) 13261 : audit [DBG] from='client.288393 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:43:49.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:43:49 smithi047 bash[22744]: audit 2024-09-16T10:43:48.241509+0000 mgr.a (mgr.14373) 13261 : audit [DBG] from='client.288393 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:43:50.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:43:50 smithi086 bash[24289]: cluster 2024-09-16T10:43:48.838913+0000 mgr.a (mgr.14373) 13262 : cluster [DBG] pgmap v9198: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:43:50.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:43:50 smithi047 bash[22744]: cluster 2024-09-16T10:43:48.838913+0000 mgr.a (mgr.14373) 13262 : cluster [DBG] pgmap v9198: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:43:50.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:43:50 smithi157 bash[24585]: cluster 2024-09-16T10:43:48.838913+0000 mgr.a (mgr.14373) 13262 : cluster [DBG] pgmap v9198: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:43:52.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:43:52 smithi086 bash[24289]: cluster 2024-09-16T10:43:50.839898+0000 mgr.a (mgr.14373) 13263 : cluster [DBG] pgmap v9199: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:43:52.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:43:52 smithi047 bash[22744]: cluster 2024-09-16T10:43:50.839898+0000 mgr.a (mgr.14373) 13263 : cluster [DBG] pgmap v9199: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:43:52.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:43:52 smithi157 bash[24585]: cluster 2024-09-16T10:43:50.839898+0000 mgr.a (mgr.14373) 13263 : cluster [DBG] pgmap v9199: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:43:53.683 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:43:53.684 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:43:53.684 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:43:54.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:43:54 smithi047 bash[22744]: cluster 2024-09-16T10:43:52.842260+0000 mgr.a (mgr.14373) 13264 : cluster [DBG] pgmap v9200: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:43:54.465 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:43:54.465 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:43:54.465 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:43:54.465 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:43:54.465 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:43:54.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:43:54 smithi157 bash[24585]: cluster 2024-09-16T10:43:52.842260+0000 mgr.a (mgr.14373) 13264 : cluster [DBG] pgmap v9200: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:43:54.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:43:54 smithi086 bash[24289]: cluster 2024-09-16T10:43:52.842260+0000 mgr.a (mgr.14373) 13264 : cluster [DBG] pgmap v9200: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:43:55.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:43:55 smithi047 bash[22744]: audit 2024-09-16T10:43:54.018205+0000 mgr.a (mgr.14373) 13265 : audit [DBG] from='client.288471 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:43:55.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:43:55 smithi157 bash[24585]: audit 2024-09-16T10:43:54.018205+0000 mgr.a (mgr.14373) 13265 : audit [DBG] from='client.288471 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:43:55.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:43:55 smithi086 bash[24289]: audit 2024-09-16T10:43:54.018205+0000 mgr.a (mgr.14373) 13265 : audit [DBG] from='client.288471 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:43:56.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:43:56 smithi047 bash[22744]: cluster 2024-09-16T10:43:54.843337+0000 mgr.a (mgr.14373) 13266 : cluster [DBG] pgmap v9201: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:43:56.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:43:56 smithi157 bash[24585]: cluster 2024-09-16T10:43:54.843337+0000 mgr.a (mgr.14373) 13266 : cluster [DBG] pgmap v9201: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:43:56.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:43:56 smithi086 bash[24289]: cluster 2024-09-16T10:43:54.843337+0000 mgr.a (mgr.14373) 13266 : cluster [DBG] pgmap v9201: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:43:58.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:43:58 smithi047 bash[22744]: cluster 2024-09-16T10:43:56.845611+0000 mgr.a (mgr.14373) 13267 : cluster [DBG] pgmap v9202: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:43:58.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:43:58 smithi157 bash[24585]: cluster 2024-09-16T10:43:56.845611+0000 mgr.a (mgr.14373) 13267 : cluster [DBG] pgmap v9202: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:43:58.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:43:58 smithi086 bash[24289]: cluster 2024-09-16T10:43:56.845611+0000 mgr.a (mgr.14373) 13267 : cluster [DBG] pgmap v9202: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:43:59.468 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:43:59.468 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:43:59.468 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:44:00.206 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:44:00.207 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:44:00.207 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:44:00.207 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:44:00.207 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:44:00.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:44:00 smithi047 bash[22744]: cluster 2024-09-16T10:43:58.846572+0000 mgr.a (mgr.14373) 13268 : cluster [DBG] pgmap v9203: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:44:00.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:44:00 smithi157 bash[24585]: cluster 2024-09-16T10:43:58.846572+0000 mgr.a (mgr.14373) 13268 : cluster [DBG] pgmap v9203: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:44:00.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:44:00 smithi086 bash[24289]: cluster 2024-09-16T10:43:58.846572+0000 mgr.a (mgr.14373) 13268 : cluster [DBG] pgmap v9203: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:44:01.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:44:01 smithi157 bash[24585]: audit 2024-09-16T10:43:59.794060+0000 mgr.a (mgr.14373) 13269 : audit [DBG] from='client.288546 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:44:01.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:44:01 smithi157 bash[24585]: audit 2024-09-16T10:44:00.617167+0000 mon.b (mon.2) 1214 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T10:44:01.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:44:01 smithi086 bash[24289]: audit 2024-09-16T10:43:59.794060+0000 mgr.a (mgr.14373) 13269 : audit [DBG] from='client.288546 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:44:01.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:44:01 smithi086 bash[24289]: audit 2024-09-16T10:44:00.617167+0000 mon.b (mon.2) 1214 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T10:44:01.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:44:01 smithi047 bash[22744]: audit 2024-09-16T10:43:59.794060+0000 mgr.a (mgr.14373) 13269 : audit [DBG] from='client.288546 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:44:01.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:44:01 smithi047 bash[22744]: audit 2024-09-16T10:44:00.617167+0000 mon.b (mon.2) 1214 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T10:44:02.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:44:02 smithi157 bash[24585]: cluster 2024-09-16T10:44:00.847507+0000 mgr.a (mgr.14373) 13270 : cluster [DBG] pgmap v9204: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:44:02.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:44:02 smithi086 bash[24289]: cluster 2024-09-16T10:44:00.847507+0000 mgr.a (mgr.14373) 13270 : cluster [DBG] pgmap v9204: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:44:02.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:44:02 smithi047 bash[22744]: cluster 2024-09-16T10:44:00.847507+0000 mgr.a (mgr.14373) 13270 : cluster [DBG] pgmap v9204: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:44:04.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:44:04 smithi157 bash[24585]: cluster 2024-09-16T10:44:02.849879+0000 mgr.a (mgr.14373) 13271 : cluster [DBG] pgmap v9205: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:44:04.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:44:04 smithi086 bash[24289]: cluster 2024-09-16T10:44:02.849879+0000 mgr.a (mgr.14373) 13271 : cluster [DBG] pgmap v9205: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:44:04.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:44:04 smithi047 bash[22744]: cluster 2024-09-16T10:44:02.849879+0000 mgr.a (mgr.14373) 13271 : cluster [DBG] pgmap v9205: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:44:05.208 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:44:05.209 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:44:05.209 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:44:05.985 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:44:05.985 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:44:05.985 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:44:05.985 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:44:05.985 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:44:06.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:44:06 smithi157 bash[24585]: cluster 2024-09-16T10:44:04.850821+0000 mgr.a (mgr.14373) 13272 : cluster [DBG] pgmap v9206: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:44:06.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:44:06 smithi157 bash[24585]: audit 2024-09-16T10:44:05.537634+0000 mgr.a (mgr.14373) 13273 : audit [DBG] from='client.288624 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:44:06.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:44:06 smithi157 bash[24585]: audit 2024-09-16T10:44:05.955741+0000 mon.a (mon.0) 1356 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:44:06.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:44:06 smithi157 bash[24585]: audit 2024-09-16T10:44:05.959928+0000 mon.a (mon.0) 1357 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:44:06.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:44:06 smithi157 bash[24585]: audit 2024-09-16T10:44:05.963707+0000 mon.a (mon.0) 1358 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:44:06.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:44:06 smithi157 bash[24585]: audit 2024-09-16T10:44:05.967957+0000 mon.a (mon.0) 1359 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:44:06.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:44:06 smithi157 bash[24585]: audit 2024-09-16T10:44:06.002452+0000 mon.a (mon.0) 1360 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:44:06.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:44:06 smithi157 bash[24585]: audit 2024-09-16T10:44:06.007511+0000 mon.a (mon.0) 1361 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:44:06.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:44:06 smithi086 bash[24289]: cluster 2024-09-16T10:44:04.850821+0000 mgr.a (mgr.14373) 13272 : cluster [DBG] pgmap v9206: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:44:06.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:44:06 smithi086 bash[24289]: audit 2024-09-16T10:44:05.537634+0000 mgr.a (mgr.14373) 13273 : audit [DBG] from='client.288624 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:44:06.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:44:06 smithi086 bash[24289]: audit 2024-09-16T10:44:05.955741+0000 mon.a (mon.0) 1356 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:44:06.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:44:06 smithi086 bash[24289]: audit 2024-09-16T10:44:05.959928+0000 mon.a (mon.0) 1357 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:44:06.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:44:06 smithi086 bash[24289]: audit 2024-09-16T10:44:05.963707+0000 mon.a (mon.0) 1358 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:44:06.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:44:06 smithi086 bash[24289]: audit 2024-09-16T10:44:05.967957+0000 mon.a (mon.0) 1359 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:44:06.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:44:06 smithi086 bash[24289]: audit 2024-09-16T10:44:06.002452+0000 mon.a (mon.0) 1360 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:44:06.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:44:06 smithi086 bash[24289]: audit 2024-09-16T10:44:06.007511+0000 mon.a (mon.0) 1361 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:44:06.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:44:06 smithi047 bash[22744]: cluster 2024-09-16T10:44:04.850821+0000 mgr.a (mgr.14373) 13272 : cluster [DBG] pgmap v9206: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:44:06.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:44:06 smithi047 bash[22744]: audit 2024-09-16T10:44:05.537634+0000 mgr.a (mgr.14373) 13273 : audit [DBG] from='client.288624 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:44:06.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:44:06 smithi047 bash[22744]: audit 2024-09-16T10:44:05.955741+0000 mon.a (mon.0) 1356 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:44:06.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:44:06 smithi047 bash[22744]: audit 2024-09-16T10:44:05.959928+0000 mon.a (mon.0) 1357 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:44:06.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:44:06 smithi047 bash[22744]: audit 2024-09-16T10:44:05.963707+0000 mon.a (mon.0) 1358 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:44:06.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:44:06 smithi047 bash[22744]: audit 2024-09-16T10:44:05.967957+0000 mon.a (mon.0) 1359 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:44:06.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:44:06 smithi047 bash[22744]: audit 2024-09-16T10:44:06.002452+0000 mon.a (mon.0) 1360 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:44:06.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:44:06 smithi047 bash[22744]: audit 2024-09-16T10:44:06.007511+0000 mon.a (mon.0) 1361 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:44:08.342 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 10:44:08 smithi047 bash[22994]: debug 2024-09-16T10:44:08.000+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T10:44:08.343 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 10:44:08 smithi047 bash[22994]: debug 2024-09-16T10:44:08.004+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T10:44:08.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:44:08 smithi047 bash[22744]: cluster 2024-09-16T10:44:06.853119+0000 mgr.a (mgr.14373) 13274 : cluster [DBG] pgmap v9207: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:44:08.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:44:08 smithi047 bash[22744]: audit 2024-09-16T10:44:07.210681+0000 mon.a (mon.0) 1362 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:44:08.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:44:08 smithi047 bash[22744]: audit 2024-09-16T10:44:07.217156+0000 mon.a (mon.0) 1363 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:44:08.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:44:08 smithi047 bash[22744]: audit 2024-09-16T10:44:07.221696+0000 mon.a (mon.0) 1364 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:44:08.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:44:08 smithi047 bash[22744]: audit 2024-09-16T10:44:07.226701+0000 mon.a (mon.0) 1365 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:44:08.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:44:08 smithi047 bash[22744]: audit 2024-09-16T10:44:07.256758+0000 mon.a (mon.0) 1366 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:44:08.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:44:08 smithi047 bash[22744]: audit 2024-09-16T10:44:07.261581+0000 mon.a (mon.0) 1367 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:44:08.344 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:44:08 smithi047 bash[22744]: audit 2024-09-16T10:44:07.263631+0000 mon.b (mon.2) 1215 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T10:44:08.344 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:44:08 smithi047 bash[22744]: audit 2024-09-16T10:44:07.264510+0000 mon.b (mon.2) 1216 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T10:44:08.344 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:44:08 smithi047 bash[22744]: audit 2024-09-16T10:44:07.270499+0000 mon.a (mon.0) 1368 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:44:08.344 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:44:08 smithi047 bash[22744]: audit 2024-09-16T10:44:07.274639+0000 mon.b (mon.2) 1217 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:44:08.344 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:44:08 smithi047 bash[22744]: audit 2024-09-16T10:44:07.277232+0000 mgr.a (mgr.14373) 13275 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:44:08.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:44:08 smithi157 bash[24585]: cluster 2024-09-16T10:44:06.853119+0000 mgr.a (mgr.14373) 13274 : cluster [DBG] pgmap v9207: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:44:08.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:44:08 smithi157 bash[24585]: audit 2024-09-16T10:44:07.210681+0000 mon.a (mon.0) 1362 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:44:08.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:44:08 smithi157 bash[24585]: audit 2024-09-16T10:44:07.217156+0000 mon.a (mon.0) 1363 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:44:08.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:44:08 smithi157 bash[24585]: audit 2024-09-16T10:44:07.221696+0000 mon.a (mon.0) 1364 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:44:08.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:44:08 smithi157 bash[24585]: audit 2024-09-16T10:44:07.226701+0000 mon.a (mon.0) 1365 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:44:08.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:44:08 smithi157 bash[24585]: audit 2024-09-16T10:44:07.256758+0000 mon.a (mon.0) 1366 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:44:08.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:44:08 smithi157 bash[24585]: audit 2024-09-16T10:44:07.261581+0000 mon.a (mon.0) 1367 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:44:08.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:44:08 smithi157 bash[24585]: audit 2024-09-16T10:44:07.263631+0000 mon.b (mon.2) 1215 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T10:44:08.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:44:08 smithi157 bash[24585]: audit 2024-09-16T10:44:07.264510+0000 mon.b (mon.2) 1216 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T10:44:08.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:44:08 smithi157 bash[24585]: audit 2024-09-16T10:44:07.270499+0000 mon.a (mon.0) 1368 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:44:08.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:44:08 smithi157 bash[24585]: audit 2024-09-16T10:44:07.274639+0000 mon.b (mon.2) 1217 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:44:08.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:44:08 smithi157 bash[24585]: audit 2024-09-16T10:44:07.277232+0000 mgr.a (mgr.14373) 13275 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:44:08.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:44:08 smithi086 bash[24289]: cluster 2024-09-16T10:44:06.853119+0000 mgr.a (mgr.14373) 13274 : cluster [DBG] pgmap v9207: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:44:08.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:44:08 smithi086 bash[24289]: audit 2024-09-16T10:44:07.210681+0000 mon.a (mon.0) 1362 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:44:08.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:44:08 smithi086 bash[24289]: audit 2024-09-16T10:44:07.217156+0000 mon.a (mon.0) 1363 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:44:08.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:44:08 smithi086 bash[24289]: audit 2024-09-16T10:44:07.221696+0000 mon.a (mon.0) 1364 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:44:08.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:44:08 smithi086 bash[24289]: audit 2024-09-16T10:44:07.226701+0000 mon.a (mon.0) 1365 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:44:08.572 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:44:08 smithi086 bash[24289]: audit 2024-09-16T10:44:07.256758+0000 mon.a (mon.0) 1366 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:44:08.572 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:44:08 smithi086 bash[24289]: audit 2024-09-16T10:44:07.261581+0000 mon.a (mon.0) 1367 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:44:08.572 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:44:08 smithi086 bash[24289]: audit 2024-09-16T10:44:07.263631+0000 mon.b (mon.2) 1215 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T10:44:08.572 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:44:08 smithi086 bash[24289]: audit 2024-09-16T10:44:07.264510+0000 mon.b (mon.2) 1216 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T10:44:08.572 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:44:08 smithi086 bash[24289]: audit 2024-09-16T10:44:07.270499+0000 mon.a (mon.0) 1368 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:44:08.572 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:44:08 smithi086 bash[24289]: audit 2024-09-16T10:44:07.274639+0000 mon.b (mon.2) 1217 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:44:08.572 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:44:08 smithi086 bash[24289]: audit 2024-09-16T10:44:07.277232+0000 mgr.a (mgr.14373) 13275 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:44:09.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:44:09 smithi157 bash[24585]: audit 2024-09-16T10:44:08.004530+0000 mgr.a (mgr.14373) 13276 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T10:44:09.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:44:09 smithi157 bash[24585]: cephadm 2024-09-16T10:44:08.006714+0000 mgr.a (mgr.14373) 13277 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T10:44:09.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:44:09 smithi086 bash[24289]: audit 2024-09-16T10:44:08.004530+0000 mgr.a (mgr.14373) 13276 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T10:44:09.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:44:09 smithi086 bash[24289]: cephadm 2024-09-16T10:44:08.006714+0000 mgr.a (mgr.14373) 13277 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T10:44:09.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:44:09 smithi047 bash[22744]: audit 2024-09-16T10:44:08.004530+0000 mgr.a (mgr.14373) 13276 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T10:44:09.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:44:09 smithi047 bash[22744]: cephadm 2024-09-16T10:44:08.006714+0000 mgr.a (mgr.14373) 13277 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T10:44:10.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:44:10 smithi157 bash[24585]: cluster 2024-09-16T10:44:08.853995+0000 mgr.a (mgr.14373) 13278 : cluster [DBG] pgmap v9208: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:44:10.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:44:10 smithi086 bash[24289]: cluster 2024-09-16T10:44:08.853995+0000 mgr.a (mgr.14373) 13278 : cluster [DBG] pgmap v9208: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:44:10.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:44:10 smithi047 bash[22744]: cluster 2024-09-16T10:44:08.853995+0000 mgr.a (mgr.14373) 13278 : cluster [DBG] pgmap v9208: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:44:10.986 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:44:10.987 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:44:10.987 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:44:11.774 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:44:11.774 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:44:11.774 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:44:11.775 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:44:11.775 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:44:12.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:44:12 smithi157 bash[24585]: cluster 2024-09-16T10:44:10.854790+0000 mgr.a (mgr.14373) 13279 : cluster [DBG] pgmap v9209: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:44:12.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:44:12 smithi157 bash[24585]: audit 2024-09-16T10:44:11.321871+0000 mgr.a (mgr.14373) 13280 : audit [DBG] from='client.288807 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:44:12.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:44:12 smithi086 bash[24289]: cluster 2024-09-16T10:44:10.854790+0000 mgr.a (mgr.14373) 13279 : cluster [DBG] pgmap v9209: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:44:12.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:44:12 smithi086 bash[24289]: audit 2024-09-16T10:44:11.321871+0000 mgr.a (mgr.14373) 13280 : audit [DBG] from='client.288807 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:44:12.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:44:12 smithi047 bash[22744]: cluster 2024-09-16T10:44:10.854790+0000 mgr.a (mgr.14373) 13279 : cluster [DBG] pgmap v9209: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:44:12.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:44:12 smithi047 bash[22744]: audit 2024-09-16T10:44:11.321871+0000 mgr.a (mgr.14373) 13280 : audit [DBG] from='client.288807 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:44:14.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:44:14 smithi157 bash[24585]: cluster 2024-09-16T10:44:12.857176+0000 mgr.a (mgr.14373) 13281 : cluster [DBG] pgmap v9210: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:44:14.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:44:14 smithi086 bash[24289]: cluster 2024-09-16T10:44:12.857176+0000 mgr.a (mgr.14373) 13281 : cluster [DBG] pgmap v9210: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:44:14.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:44:14 smithi047 bash[22744]: cluster 2024-09-16T10:44:12.857176+0000 mgr.a (mgr.14373) 13281 : cluster [DBG] pgmap v9210: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:44:16.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:44:16 smithi157 bash[24585]: cluster 2024-09-16T10:44:14.857979+0000 mgr.a (mgr.14373) 13282 : cluster [DBG] pgmap v9211: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T10:44:16.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:44:16 smithi086 bash[24289]: cluster 2024-09-16T10:44:14.857979+0000 mgr.a (mgr.14373) 13282 : cluster [DBG] pgmap v9211: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T10:44:16.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:44:16 smithi047 bash[22744]: cluster 2024-09-16T10:44:14.857979+0000 mgr.a (mgr.14373) 13282 : cluster [DBG] pgmap v9211: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T10:44:16.776 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:44:16.777 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:44:16.777 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:44:17.533 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:44:17.533 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:44:17.533 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:44:17.533 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:44:17.533 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:44:18.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:44:18 smithi157 bash[24585]: cluster 2024-09-16T10:44:16.859738+0000 mgr.a (mgr.14373) 13283 : cluster [DBG] pgmap v9212: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:44:18.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:44:18 smithi157 bash[24585]: audit 2024-09-16T10:44:17.107333+0000 mgr.a (mgr.14373) 13284 : audit [DBG] from='client.288885 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:44:18.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:44:18 smithi086 bash[24289]: cluster 2024-09-16T10:44:16.859738+0000 mgr.a (mgr.14373) 13283 : cluster [DBG] pgmap v9212: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:44:18.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:44:18 smithi086 bash[24289]: audit 2024-09-16T10:44:17.107333+0000 mgr.a (mgr.14373) 13284 : audit [DBG] from='client.288885 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:44:18.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:44:18 smithi047 bash[22744]: cluster 2024-09-16T10:44:16.859738+0000 mgr.a (mgr.14373) 13283 : cluster [DBG] pgmap v9212: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:44:18.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:44:18 smithi047 bash[22744]: audit 2024-09-16T10:44:17.107333+0000 mgr.a (mgr.14373) 13284 : audit [DBG] from='client.288885 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:44:20.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:44:20 smithi157 bash[24585]: cluster 2024-09-16T10:44:18.860696+0000 mgr.a (mgr.14373) 13285 : cluster [DBG] pgmap v9213: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T10:44:20.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:44:20 smithi086 bash[24289]: cluster 2024-09-16T10:44:18.860696+0000 mgr.a (mgr.14373) 13285 : cluster [DBG] pgmap v9213: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T10:44:20.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:44:20 smithi047 bash[22744]: cluster 2024-09-16T10:44:18.860696+0000 mgr.a (mgr.14373) 13285 : cluster [DBG] pgmap v9213: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T10:44:22.534 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:44:22.535 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:44:22.535 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:44:22.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:44:22 smithi157 bash[24585]: cluster 2024-09-16T10:44:20.861496+0000 mgr.a (mgr.14373) 13286 : cluster [DBG] pgmap v9214: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T10:44:22.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:44:22 smithi086 bash[24289]: cluster 2024-09-16T10:44:20.861496+0000 mgr.a (mgr.14373) 13286 : cluster [DBG] pgmap v9214: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T10:44:22.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:44:22 smithi047 bash[22744]: cluster 2024-09-16T10:44:20.861496+0000 mgr.a (mgr.14373) 13286 : cluster [DBG] pgmap v9214: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T10:44:23.315 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:44:23.315 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:44:23.315 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:44:23.315 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:44:23.315 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:44:24.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:44:24 smithi157 bash[24585]: cluster 2024-09-16T10:44:22.863655+0000 mgr.a (mgr.14373) 13287 : cluster [DBG] pgmap v9215: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:44:24.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:44:24 smithi157 bash[24585]: audit 2024-09-16T10:44:22.869672+0000 mgr.a (mgr.14373) 13288 : audit [DBG] from='client.288960 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:44:24.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:44:24 smithi086 bash[24289]: cluster 2024-09-16T10:44:22.863655+0000 mgr.a (mgr.14373) 13287 : cluster [DBG] pgmap v9215: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:44:24.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:44:24 smithi086 bash[24289]: audit 2024-09-16T10:44:22.869672+0000 mgr.a (mgr.14373) 13288 : audit [DBG] from='client.288960 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:44:24.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:44:24 smithi047 bash[22744]: cluster 2024-09-16T10:44:22.863655+0000 mgr.a (mgr.14373) 13287 : cluster [DBG] pgmap v9215: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:44:24.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:44:24 smithi047 bash[22744]: audit 2024-09-16T10:44:22.869672+0000 mgr.a (mgr.14373) 13288 : audit [DBG] from='client.288960 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:44:26.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:44:26 smithi157 bash[24585]: cluster 2024-09-16T10:44:24.864571+0000 mgr.a (mgr.14373) 13289 : cluster [DBG] pgmap v9216: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-16T10:44:26.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:44:26 smithi086 bash[24289]: cluster 2024-09-16T10:44:24.864571+0000 mgr.a (mgr.14373) 13289 : cluster [DBG] pgmap v9216: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-16T10:44:26.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:44:26 smithi047 bash[22744]: cluster 2024-09-16T10:44:24.864571+0000 mgr.a (mgr.14373) 13289 : cluster [DBG] pgmap v9216: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-16T10:44:28.317 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:44:28.317 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:44:28.318 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:44:28.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:44:28 smithi157 bash[24585]: cluster 2024-09-16T10:44:26.866762+0000 mgr.a (mgr.14373) 13290 : cluster [DBG] pgmap v9217: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-16T10:44:28.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:44:28 smithi086 bash[24289]: cluster 2024-09-16T10:44:26.866762+0000 mgr.a (mgr.14373) 13290 : cluster [DBG] pgmap v9217: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-16T10:44:28.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:44:28 smithi047 bash[22744]: cluster 2024-09-16T10:44:26.866762+0000 mgr.a (mgr.14373) 13290 : cluster [DBG] pgmap v9217: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-16T10:44:29.068 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:44:29.068 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:44:29.068 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:44:29.068 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:44:29.068 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:44:30.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:44:30 smithi157 bash[24585]: audit 2024-09-16T10:44:28.644214+0000 mgr.a (mgr.14373) 13291 : audit [DBG] from='client.289035 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:44:30.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:44:30 smithi157 bash[24585]: cluster 2024-09-16T10:44:28.874690+0000 mgr.a (mgr.14373) 13292 : cluster [DBG] pgmap v9218: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:44:30.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:44:30 smithi086 bash[24289]: audit 2024-09-16T10:44:28.644214+0000 mgr.a (mgr.14373) 13291 : audit [DBG] from='client.289035 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:44:30.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:44:30 smithi086 bash[24289]: cluster 2024-09-16T10:44:28.874690+0000 mgr.a (mgr.14373) 13292 : cluster [DBG] pgmap v9218: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:44:30.594 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:44:30 smithi047 bash[22744]: audit 2024-09-16T10:44:28.644214+0000 mgr.a (mgr.14373) 13291 : audit [DBG] from='client.289035 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:44:30.594 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:44:30 smithi047 bash[22744]: cluster 2024-09-16T10:44:28.874690+0000 mgr.a (mgr.14373) 13292 : cluster [DBG] pgmap v9218: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:44:32.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:44:31 smithi157 bash[24585]: cluster 2024-09-16T10:44:30.875616+0000 mgr.a (mgr.14373) 13293 : cluster [DBG] pgmap v9219: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:44:32.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:44:31 smithi086 bash[24289]: cluster 2024-09-16T10:44:30.875616+0000 mgr.a (mgr.14373) 13293 : cluster [DBG] pgmap v9219: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:44:32.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:44:31 smithi047 bash[22744]: cluster 2024-09-16T10:44:30.875616+0000 mgr.a (mgr.14373) 13293 : cluster [DBG] pgmap v9219: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:44:34.073 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:44:34.073 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:44:34.073 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:44:34.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:44:33 smithi157 bash[24585]: cluster 2024-09-16T10:44:32.877852+0000 mgr.a (mgr.14373) 13294 : cluster [DBG] pgmap v9220: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:44:34.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:44:33 smithi086 bash[24289]: cluster 2024-09-16T10:44:32.877852+0000 mgr.a (mgr.14373) 13294 : cluster [DBG] pgmap v9220: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:44:34.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:44:33 smithi047 bash[22744]: cluster 2024-09-16T10:44:32.877852+0000 mgr.a (mgr.14373) 13294 : cluster [DBG] pgmap v9220: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:44:34.838 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:44:34.838 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:44:34.838 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:44:34.838 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:44:34.838 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:44:35.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:44:34 smithi157 bash[24585]: audit 2024-09-16T10:44:34.402739+0000 mgr.a (mgr.14373) 13295 : audit [DBG] from='client.289113 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:44:35.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:44:34 smithi086 bash[24289]: audit 2024-09-16T10:44:34.402739+0000 mgr.a (mgr.14373) 13295 : audit [DBG] from='client.289113 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:44:35.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:44:34 smithi047 bash[22744]: audit 2024-09-16T10:44:34.402739+0000 mgr.a (mgr.14373) 13295 : audit [DBG] from='client.289113 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:44:36.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:44:35 smithi157 bash[24585]: cluster 2024-09-16T10:44:34.878712+0000 mgr.a (mgr.14373) 13296 : cluster [DBG] pgmap v9221: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:44:36.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:44:35 smithi086 bash[24289]: cluster 2024-09-16T10:44:34.878712+0000 mgr.a (mgr.14373) 13296 : cluster [DBG] pgmap v9221: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:44:36.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:44:35 smithi047 bash[22744]: cluster 2024-09-16T10:44:34.878712+0000 mgr.a (mgr.14373) 13296 : cluster [DBG] pgmap v9221: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:44:38.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:44:37 smithi157 bash[24585]: cluster 2024-09-16T10:44:36.880846+0000 mgr.a (mgr.14373) 13297 : cluster [DBG] pgmap v9222: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:44:38.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:44:37 smithi086 bash[24289]: cluster 2024-09-16T10:44:36.880846+0000 mgr.a (mgr.14373) 13297 : cluster [DBG] pgmap v9222: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:44:38.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:44:37 smithi047 bash[22744]: cluster 2024-09-16T10:44:36.880846+0000 mgr.a (mgr.14373) 13297 : cluster [DBG] pgmap v9222: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:44:39.839 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:44:39.840 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:44:39.840 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:44:40.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:44:39 smithi157 bash[24585]: cluster 2024-09-16T10:44:38.881608+0000 mgr.a (mgr.14373) 13298 : cluster [DBG] pgmap v9223: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:44:40.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:44:39 smithi086 bash[24289]: cluster 2024-09-16T10:44:38.881608+0000 mgr.a (mgr.14373) 13298 : cluster [DBG] pgmap v9223: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:44:40.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:44:39 smithi047 bash[22744]: cluster 2024-09-16T10:44:38.881608+0000 mgr.a (mgr.14373) 13298 : cluster [DBG] pgmap v9223: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:44:40.582 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:44:40.583 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:44:40.583 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:44:40.583 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:44:40.583 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:44:41.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:44:40 smithi157 bash[24585]: audit 2024-09-16T10:44:40.159056+0000 mgr.a (mgr.14373) 13299 : audit [DBG] from='client.289191 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:44:41.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:44:40 smithi086 bash[24289]: audit 2024-09-16T10:44:40.159056+0000 mgr.a (mgr.14373) 13299 : audit [DBG] from='client.289191 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:44:41.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:44:40 smithi047 bash[22744]: audit 2024-09-16T10:44:40.159056+0000 mgr.a (mgr.14373) 13299 : audit [DBG] from='client.289191 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:44:42.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:44:41 smithi157 bash[24585]: cluster 2024-09-16T10:44:40.882718+0000 mgr.a (mgr.14373) 13300 : cluster [DBG] pgmap v9224: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:44:42.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:44:41 smithi086 bash[24289]: cluster 2024-09-16T10:44:40.882718+0000 mgr.a (mgr.14373) 13300 : cluster [DBG] pgmap v9224: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:44:42.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:44:41 smithi047 bash[22744]: cluster 2024-09-16T10:44:40.882718+0000 mgr.a (mgr.14373) 13300 : cluster [DBG] pgmap v9224: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:44:44.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:44:43 smithi157 bash[24585]: cluster 2024-09-16T10:44:42.884972+0000 mgr.a (mgr.14373) 13301 : cluster [DBG] pgmap v9225: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:44:44.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:44:43 smithi086 bash[24289]: cluster 2024-09-16T10:44:42.884972+0000 mgr.a (mgr.14373) 13301 : cluster [DBG] pgmap v9225: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:44:44.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:44:43 smithi047 bash[22744]: cluster 2024-09-16T10:44:42.884972+0000 mgr.a (mgr.14373) 13301 : cluster [DBG] pgmap v9225: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:44:45.584 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:44:45.585 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:44:45.585 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:44:46.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:44:45 smithi157 bash[24585]: cluster 2024-09-16T10:44:44.885735+0000 mgr.a (mgr.14373) 13302 : cluster [DBG] pgmap v9226: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:44:46.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:44:45 smithi086 bash[24289]: cluster 2024-09-16T10:44:44.885735+0000 mgr.a (mgr.14373) 13302 : cluster [DBG] pgmap v9226: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:44:46.328 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:44:46.328 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:44:46.328 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:44:46.328 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:44:46.329 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:44:46.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:44:45 smithi047 bash[22744]: cluster 2024-09-16T10:44:44.885735+0000 mgr.a (mgr.14373) 13302 : cluster [DBG] pgmap v9226: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:44:47.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:44:46 smithi157 bash[24585]: audit 2024-09-16T10:44:45.905979+0000 mgr.a (mgr.14373) 13303 : audit [DBG] from='client.289269 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:44:47.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:44:46 smithi086 bash[24289]: audit 2024-09-16T10:44:45.905979+0000 mgr.a (mgr.14373) 13303 : audit [DBG] from='client.289269 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:44:47.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:44:46 smithi047 bash[22744]: audit 2024-09-16T10:44:45.905979+0000 mgr.a (mgr.14373) 13303 : audit [DBG] from='client.289269 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:44:48.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:44:47 smithi157 bash[24585]: cluster 2024-09-16T10:44:46.888054+0000 mgr.a (mgr.14373) 13304 : cluster [DBG] pgmap v9227: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:44:48.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:44:47 smithi086 bash[24289]: cluster 2024-09-16T10:44:46.888054+0000 mgr.a (mgr.14373) 13304 : cluster [DBG] pgmap v9227: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:44:48.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:44:47 smithi047 bash[22744]: cluster 2024-09-16T10:44:46.888054+0000 mgr.a (mgr.14373) 13304 : cluster [DBG] pgmap v9227: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:44:50.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:44:49 smithi157 bash[24585]: cluster 2024-09-16T10:44:48.888812+0000 mgr.a (mgr.14373) 13305 : cluster [DBG] pgmap v9228: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:44:50.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:44:49 smithi086 bash[24289]: cluster 2024-09-16T10:44:48.888812+0000 mgr.a (mgr.14373) 13305 : cluster [DBG] pgmap v9228: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:44:50.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:44:49 smithi047 bash[22744]: cluster 2024-09-16T10:44:48.888812+0000 mgr.a (mgr.14373) 13305 : cluster [DBG] pgmap v9228: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:44:51.330 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:44:51.330 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:44:51.331 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:44:52.104 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:44:52.104 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:44:52.105 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:44:52.105 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:44:52.105 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:44:52.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:44:51 smithi157 bash[24585]: cluster 2024-09-16T10:44:50.889574+0000 mgr.a (mgr.14373) 13306 : cluster [DBG] pgmap v9229: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:44:52.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:44:51 smithi086 bash[24289]: cluster 2024-09-16T10:44:50.889574+0000 mgr.a (mgr.14373) 13306 : cluster [DBG] pgmap v9229: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:44:52.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:44:51 smithi047 bash[22744]: cluster 2024-09-16T10:44:50.889574+0000 mgr.a (mgr.14373) 13306 : cluster [DBG] pgmap v9229: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:44:53.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:44:53 smithi157 bash[24585]: audit 2024-09-16T10:44:51.664870+0000 mgr.a (mgr.14373) 13307 : audit [DBG] from='client.289347 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:44:53.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:44:53 smithi086 bash[24289]: audit 2024-09-16T10:44:51.664870+0000 mgr.a (mgr.14373) 13307 : audit [DBG] from='client.289347 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:44:53.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:44:53 smithi047 bash[22744]: audit 2024-09-16T10:44:51.664870+0000 mgr.a (mgr.14373) 13307 : audit [DBG] from='client.289347 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:44:54.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:44:54 smithi157 bash[24585]: cluster 2024-09-16T10:44:52.892358+0000 mgr.a (mgr.14373) 13308 : cluster [DBG] pgmap v9230: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:44:54.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:44:54 smithi086 bash[24289]: cluster 2024-09-16T10:44:52.892358+0000 mgr.a (mgr.14373) 13308 : cluster [DBG] pgmap v9230: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:44:54.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:44:54 smithi047 bash[22744]: cluster 2024-09-16T10:44:52.892358+0000 mgr.a (mgr.14373) 13308 : cluster [DBG] pgmap v9230: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:44:56.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:44:56 smithi157 bash[24585]: cluster 2024-09-16T10:44:54.893332+0000 mgr.a (mgr.14373) 13309 : cluster [DBG] pgmap v9231: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:44:56.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:44:56 smithi086 bash[24289]: cluster 2024-09-16T10:44:54.893332+0000 mgr.a (mgr.14373) 13309 : cluster [DBG] pgmap v9231: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:44:56.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:44:56 smithi047 bash[22744]: cluster 2024-09-16T10:44:54.893332+0000 mgr.a (mgr.14373) 13309 : cluster [DBG] pgmap v9231: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:44:57.106 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:44:57.106 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:44:57.107 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:44:57.887 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:44:57.888 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:44:57.888 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:44:57.888 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:44:57.888 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:44:58.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:44:58 smithi157 bash[24585]: cluster 2024-09-16T10:44:56.895500+0000 mgr.a (mgr.14373) 13310 : cluster [DBG] pgmap v9232: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:44:58.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:44:58 smithi157 bash[24585]: audit 2024-09-16T10:44:57.441144+0000 mgr.a (mgr.14373) 13311 : audit [DBG] from='client.289425 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:44:58.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:44:58 smithi086 bash[24289]: cluster 2024-09-16T10:44:56.895500+0000 mgr.a (mgr.14373) 13310 : cluster [DBG] pgmap v9232: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:44:58.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:44:58 smithi086 bash[24289]: audit 2024-09-16T10:44:57.441144+0000 mgr.a (mgr.14373) 13311 : audit [DBG] from='client.289425 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:44:58.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:44:58 smithi047 bash[22744]: cluster 2024-09-16T10:44:56.895500+0000 mgr.a (mgr.14373) 13310 : cluster [DBG] pgmap v9232: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:44:58.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:44:58 smithi047 bash[22744]: audit 2024-09-16T10:44:57.441144+0000 mgr.a (mgr.14373) 13311 : audit [DBG] from='client.289425 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:45:00.308 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:45:00 smithi157 bash[24585]: cluster 2024-09-16T10:44:58.896429+0000 mgr.a (mgr.14373) 13312 : cluster [DBG] pgmap v9233: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:45:00.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:45:00 smithi086 bash[24289]: cluster 2024-09-16T10:44:58.896429+0000 mgr.a (mgr.14373) 13312 : cluster [DBG] pgmap v9233: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:45:00.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:45:00 smithi047 bash[22744]: cluster 2024-09-16T10:44:58.896429+0000 mgr.a (mgr.14373) 13312 : cluster [DBG] pgmap v9233: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:45:02.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:45:02 smithi157 bash[24585]: cluster 2024-09-16T10:45:00.897212+0000 mgr.a (mgr.14373) 13313 : cluster [DBG] pgmap v9234: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T10:45:02.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:45:02 smithi086 bash[24289]: cluster 2024-09-16T10:45:00.897212+0000 mgr.a (mgr.14373) 13313 : cluster [DBG] pgmap v9234: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T10:45:02.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:45:02 smithi047 bash[22744]: cluster 2024-09-16T10:45:00.897212+0000 mgr.a (mgr.14373) 13313 : cluster [DBG] pgmap v9234: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T10:45:02.889 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:45:02.890 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:45:02.890 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:45:03.657 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:45:03.658 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:45:03.658 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:45:03.658 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:45:03.658 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:45:04.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:45:04 smithi157 bash[24585]: cluster 2024-09-16T10:45:02.898624+0000 mgr.a (mgr.14373) 13314 : cluster [DBG] pgmap v9235: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:45:04.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:45:04 smithi157 bash[24585]: audit 2024-09-16T10:45:03.227667+0000 mgr.a (mgr.14373) 13315 : audit [DBG] from='client.289500 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:45:04.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:45:04 smithi086 bash[24289]: cluster 2024-09-16T10:45:02.898624+0000 mgr.a (mgr.14373) 13314 : cluster [DBG] pgmap v9235: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:45:04.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:45:04 smithi086 bash[24289]: audit 2024-09-16T10:45:03.227667+0000 mgr.a (mgr.14373) 13315 : audit [DBG] from='client.289500 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:45:04.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:45:04 smithi047 bash[22744]: cluster 2024-09-16T10:45:02.898624+0000 mgr.a (mgr.14373) 13314 : cluster [DBG] pgmap v9235: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:45:04.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:45:04 smithi047 bash[22744]: audit 2024-09-16T10:45:03.227667+0000 mgr.a (mgr.14373) 13315 : audit [DBG] from='client.289500 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:45:06.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:45:06 smithi157 bash[24585]: cluster 2024-09-16T10:45:04.899497+0000 mgr.a (mgr.14373) 13316 : cluster [DBG] pgmap v9236: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:45:06.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:45:06 smithi086 bash[24289]: cluster 2024-09-16T10:45:04.899497+0000 mgr.a (mgr.14373) 13316 : cluster [DBG] pgmap v9236: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:45:06.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:45:06 smithi047 bash[22744]: cluster 2024-09-16T10:45:04.899497+0000 mgr.a (mgr.14373) 13316 : cluster [DBG] pgmap v9236: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:45:08.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:45:08 smithi157 bash[24585]: cluster 2024-09-16T10:45:06.901661+0000 mgr.a (mgr.14373) 13317 : cluster [DBG] pgmap v9237: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:45:08.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:45:08 smithi086 bash[24289]: cluster 2024-09-16T10:45:06.901661+0000 mgr.a (mgr.14373) 13317 : cluster [DBG] pgmap v9237: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:45:08.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:45:08 smithi047 bash[22744]: cluster 2024-09-16T10:45:06.901661+0000 mgr.a (mgr.14373) 13317 : cluster [DBG] pgmap v9237: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:45:08.659 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:45:08.659 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:45:08.660 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:45:09.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:45:09 smithi157 bash[24585]: audit 2024-09-16T10:45:08.059625+0000 mon.b (mon.2) 1218 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T10:45:09.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:45:09 smithi157 bash[24585]: audit 2024-09-16T10:45:08.878026+0000 mon.b (mon.2) 1219 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T10:45:09.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:45:09 smithi157 bash[24585]: audit 2024-09-16T10:45:08.879354+0000 mon.b (mon.2) 1220 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T10:45:09.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:45:09 smithi157 bash[24585]: audit 2024-09-16T10:45:08.890566+0000 mon.a (mon.0) 1369 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:45:09.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:45:09 smithi157 bash[24585]: audit 2024-09-16T10:45:08.895986+0000 mon.b (mon.2) 1221 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:45:09.324 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:45:09 smithi086 bash[24289]: audit 2024-09-16T10:45:08.059625+0000 mon.b (mon.2) 1218 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T10:45:09.324 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:45:09 smithi086 bash[24289]: audit 2024-09-16T10:45:08.878026+0000 mon.b (mon.2) 1219 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T10:45:09.325 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:45:09 smithi086 bash[24289]: audit 2024-09-16T10:45:08.879354+0000 mon.b (mon.2) 1220 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T10:45:09.325 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:45:09 smithi086 bash[24289]: audit 2024-09-16T10:45:08.890566+0000 mon.a (mon.0) 1369 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:45:09.325 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:45:09 smithi086 bash[24289]: audit 2024-09-16T10:45:08.895986+0000 mon.b (mon.2) 1221 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:45:09.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:45:09 smithi047 bash[22744]: audit 2024-09-16T10:45:08.059625+0000 mon.b (mon.2) 1218 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T10:45:09.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:45:09 smithi047 bash[22744]: audit 2024-09-16T10:45:08.878026+0000 mon.b (mon.2) 1219 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T10:45:09.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:45:09 smithi047 bash[22744]: audit 2024-09-16T10:45:08.879354+0000 mon.b (mon.2) 1220 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T10:45:09.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:45:09 smithi047 bash[22744]: audit 2024-09-16T10:45:08.890566+0000 mon.a (mon.0) 1369 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:45:09.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:45:09 smithi047 bash[22744]: audit 2024-09-16T10:45:08.895986+0000 mon.b (mon.2) 1221 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:45:10.036 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:45:10.036 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:45:10.036 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:45:10.036 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:45:10.036 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:45:10.042 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 10:45:09 smithi047 bash[22994]: debug 2024-09-16T10:45:09.623+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T10:45:10.042 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 10:45:09 smithi047 bash[22994]: debug 2024-09-16T10:45:09.635+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T10:45:10.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:45:10 smithi157 bash[24585]: audit 2024-09-16T10:45:08.898700+0000 mgr.a (mgr.14373) 13318 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:45:10.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:45:10 smithi157 bash[24585]: cluster 2024-09-16T10:45:08.915039+0000 mgr.a (mgr.14373) 13319 : cluster [DBG] pgmap v9238: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:45:10.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:45:10 smithi157 bash[24585]: audit 2024-09-16T10:45:08.983919+0000 mgr.a (mgr.14373) 13320 : audit [DBG] from='client.289578 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:45:10.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:45:10 smithi086 bash[24289]: audit 2024-09-16T10:45:08.898700+0000 mgr.a (mgr.14373) 13318 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:45:10.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:45:10 smithi086 bash[24289]: cluster 2024-09-16T10:45:08.915039+0000 mgr.a (mgr.14373) 13319 : cluster [DBG] pgmap v9238: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:45:10.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:45:10 smithi086 bash[24289]: audit 2024-09-16T10:45:08.983919+0000 mgr.a (mgr.14373) 13320 : audit [DBG] from='client.289578 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:45:10.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:45:10 smithi047 bash[22744]: audit 2024-09-16T10:45:08.898700+0000 mgr.a (mgr.14373) 13318 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:45:10.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:45:10 smithi047 bash[22744]: cluster 2024-09-16T10:45:08.915039+0000 mgr.a (mgr.14373) 13319 : cluster [DBG] pgmap v9238: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:45:10.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:45:10 smithi047 bash[22744]: audit 2024-09-16T10:45:08.983919+0000 mgr.a (mgr.14373) 13320 : audit [DBG] from='client.289578 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:45:11.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:45:11 smithi157 bash[24585]: audit 2024-09-16T10:45:09.626618+0000 mgr.a (mgr.14373) 13321 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T10:45:11.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:45:11 smithi157 bash[24585]: cephadm 2024-09-16T10:45:09.639406+0000 mgr.a (mgr.14373) 13322 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T10:45:11.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:45:11 smithi086 bash[24289]: audit 2024-09-16T10:45:09.626618+0000 mgr.a (mgr.14373) 13321 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T10:45:11.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:45:11 smithi086 bash[24289]: cephadm 2024-09-16T10:45:09.639406+0000 mgr.a (mgr.14373) 13322 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T10:45:11.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:45:11 smithi047 bash[22744]: audit 2024-09-16T10:45:09.626618+0000 mgr.a (mgr.14373) 13321 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T10:45:11.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:45:11 smithi047 bash[22744]: cephadm 2024-09-16T10:45:09.639406+0000 mgr.a (mgr.14373) 13322 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T10:45:12.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:45:12 smithi157 bash[24585]: cluster 2024-09-16T10:45:10.916042+0000 mgr.a (mgr.14373) 13323 : cluster [DBG] pgmap v9239: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:45:12.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:45:12 smithi086 bash[24289]: cluster 2024-09-16T10:45:10.916042+0000 mgr.a (mgr.14373) 13323 : cluster [DBG] pgmap v9239: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:45:12.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:45:12 smithi047 bash[22744]: cluster 2024-09-16T10:45:10.916042+0000 mgr.a (mgr.14373) 13323 : cluster [DBG] pgmap v9239: 225 pgs: 225 active+clean; 589 KiB data, 182 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:45:14.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:45:14 smithi086 bash[24289]: cluster 2024-09-16T10:45:12.918295+0000 mgr.a (mgr.14373) 13324 : cluster [DBG] pgmap v9240: 225 pgs: 225 active+clean; 589 KiB data, 199 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 425 B/s wr, 7 op/s 2024-09-16T10:45:14.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:45:14 smithi047 bash[22744]: cluster 2024-09-16T10:45:12.918295+0000 mgr.a (mgr.14373) 13324 : cluster [DBG] pgmap v9240: 225 pgs: 225 active+clean; 589 KiB data, 199 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 425 B/s wr, 7 op/s 2024-09-16T10:45:14.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:45:14 smithi157 bash[24585]: cluster 2024-09-16T10:45:12.918295+0000 mgr.a (mgr.14373) 13324 : cluster [DBG] pgmap v9240: 225 pgs: 225 active+clean; 589 KiB data, 199 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 425 B/s wr, 7 op/s 2024-09-16T10:45:15.037 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:45:15.038 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:45:15.038 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:45:15.829 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:45:15.829 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:45:15.829 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:45:15.829 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:45:15.829 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:45:16.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:45:16 smithi086 bash[24289]: cluster 2024-09-16T10:45:14.919113+0000 mgr.a (mgr.14373) 13325 : cluster [DBG] pgmap v9241: 225 pgs: 225 active+clean; 589 KiB data, 199 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 425 B/s wr, 7 op/s 2024-09-16T10:45:16.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:45:16 smithi086 bash[24289]: audit 2024-09-16T10:45:15.371687+0000 mgr.a (mgr.14373) 13326 : audit [DBG] from='client.289761 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:45:16.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:45:16 smithi047 bash[22744]: cluster 2024-09-16T10:45:14.919113+0000 mgr.a (mgr.14373) 13325 : cluster [DBG] pgmap v9241: 225 pgs: 225 active+clean; 589 KiB data, 199 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 425 B/s wr, 7 op/s 2024-09-16T10:45:16.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:45:16 smithi047 bash[22744]: audit 2024-09-16T10:45:15.371687+0000 mgr.a (mgr.14373) 13326 : audit [DBG] from='client.289761 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:45:16.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:45:16 smithi157 bash[24585]: cluster 2024-09-16T10:45:14.919113+0000 mgr.a (mgr.14373) 13325 : cluster [DBG] pgmap v9241: 225 pgs: 225 active+clean; 589 KiB data, 199 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 425 B/s wr, 7 op/s 2024-09-16T10:45:16.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:45:16 smithi157 bash[24585]: audit 2024-09-16T10:45:15.371687+0000 mgr.a (mgr.14373) 13326 : audit [DBG] from='client.289761 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:45:18.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:45:18 smithi086 bash[24289]: cluster 2024-09-16T10:45:16.921431+0000 mgr.a (mgr.14373) 13327 : cluster [DBG] pgmap v9242: 225 pgs: 225 active+clean; 589 KiB data, 199 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 425 B/s wr, 7 op/s 2024-09-16T10:45:18.345 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:45:18 smithi047 bash[22744]: cluster 2024-09-16T10:45:16.921431+0000 mgr.a (mgr.14373) 13327 : cluster [DBG] pgmap v9242: 225 pgs: 225 active+clean; 589 KiB data, 199 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 425 B/s wr, 7 op/s 2024-09-16T10:45:18.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:45:18 smithi157 bash[24585]: cluster 2024-09-16T10:45:16.921431+0000 mgr.a (mgr.14373) 13327 : cluster [DBG] pgmap v9242: 225 pgs: 225 active+clean; 589 KiB data, 199 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 425 B/s wr, 7 op/s 2024-09-16T10:45:20.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:45:20 smithi047 bash[22744]: cluster 2024-09-16T10:45:18.922182+0000 mgr.a (mgr.14373) 13328 : cluster [DBG] pgmap v9243: 225 pgs: 225 active+clean; 589 KiB data, 199 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 425 B/s wr, 7 op/s 2024-09-16T10:45:20.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:45:20 smithi157 bash[24585]: cluster 2024-09-16T10:45:18.922182+0000 mgr.a (mgr.14373) 13328 : cluster [DBG] pgmap v9243: 225 pgs: 225 active+clean; 589 KiB data, 199 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 425 B/s wr, 7 op/s 2024-09-16T10:45:20.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:45:20 smithi086 bash[24289]: cluster 2024-09-16T10:45:18.922182+0000 mgr.a (mgr.14373) 13328 : cluster [DBG] pgmap v9243: 225 pgs: 225 active+clean; 589 KiB data, 199 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 425 B/s wr, 7 op/s 2024-09-16T10:45:20.830 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:45:20.831 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:45:20.832 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:45:21.583 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:45:21.583 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:45:21.584 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:45:21.584 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:45:21.584 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:45:22.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:45:22 smithi047 bash[22744]: cluster 2024-09-16T10:45:20.922811+0000 mgr.a (mgr.14373) 13329 : cluster [DBG] pgmap v9244: 225 pgs: 225 active+clean; 589 KiB data, 199 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:45:22.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:45:22 smithi047 bash[22744]: audit 2024-09-16T10:45:21.159895+0000 mgr.a (mgr.14373) 13330 : audit [DBG] from='client.289836 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:45:22.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:45:22 smithi157 bash[24585]: cluster 2024-09-16T10:45:20.922811+0000 mgr.a (mgr.14373) 13329 : cluster [DBG] pgmap v9244: 225 pgs: 225 active+clean; 589 KiB data, 199 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:45:22.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:45:22 smithi157 bash[24585]: audit 2024-09-16T10:45:21.159895+0000 mgr.a (mgr.14373) 13330 : audit [DBG] from='client.289836 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:45:22.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:45:22 smithi086 bash[24289]: cluster 2024-09-16T10:45:20.922811+0000 mgr.a (mgr.14373) 13329 : cluster [DBG] pgmap v9244: 225 pgs: 225 active+clean; 589 KiB data, 199 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:45:22.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:45:22 smithi086 bash[24289]: audit 2024-09-16T10:45:21.159895+0000 mgr.a (mgr.14373) 13330 : audit [DBG] from='client.289836 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:45:24.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:45:24 smithi047 bash[22744]: cluster 2024-09-16T10:45:22.925138+0000 mgr.a (mgr.14373) 13331 : cluster [DBG] pgmap v9245: 225 pgs: 225 active+clean; 589 KiB data, 199 MiB used, 268 GiB / 268 GiB avail; 7.6 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:45:24.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:45:24 smithi157 bash[24585]: cluster 2024-09-16T10:45:22.925138+0000 mgr.a (mgr.14373) 13331 : cluster [DBG] pgmap v9245: 225 pgs: 225 active+clean; 589 KiB data, 199 MiB used, 268 GiB / 268 GiB avail; 7.6 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:45:24.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:45:24 smithi086 bash[24289]: cluster 2024-09-16T10:45:22.925138+0000 mgr.a (mgr.14373) 13331 : cluster [DBG] pgmap v9245: 225 pgs: 225 active+clean; 589 KiB data, 199 MiB used, 268 GiB / 268 GiB avail; 7.6 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:45:26.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:45:26 smithi047 bash[22744]: cluster 2024-09-16T10:45:24.925905+0000 mgr.a (mgr.14373) 13332 : cluster [DBG] pgmap v9246: 225 pgs: 225 active+clean; 589 KiB data, 199 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-09-16T10:45:26.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:45:26 smithi157 bash[24585]: cluster 2024-09-16T10:45:24.925905+0000 mgr.a (mgr.14373) 13332 : cluster [DBG] pgmap v9246: 225 pgs: 225 active+clean; 589 KiB data, 199 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-09-16T10:45:26.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:45:26 smithi086 bash[24289]: cluster 2024-09-16T10:45:24.925905+0000 mgr.a (mgr.14373) 13332 : cluster [DBG] pgmap v9246: 225 pgs: 225 active+clean; 589 KiB data, 199 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-09-16T10:45:26.585 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:45:26.585 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:45:26.585 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:45:27.346 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:45:27.346 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:45:27.346 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:45:27.347 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:45:27.347 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:45:28.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:45:28 smithi047 bash[22744]: audit 2024-09-16T10:45:26.918715+0000 mgr.a (mgr.14373) 13333 : audit [DBG] from='client.289914 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:45:28.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:45:28 smithi047 bash[22744]: cluster 2024-09-16T10:45:26.938485+0000 mgr.a (mgr.14373) 13334 : cluster [DBG] pgmap v9247: 225 pgs: 225 active+clean; 589 KiB data, 199 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:45:28.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:45:28 smithi157 bash[24585]: audit 2024-09-16T10:45:26.918715+0000 mgr.a (mgr.14373) 13333 : audit [DBG] from='client.289914 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:45:28.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:45:28 smithi157 bash[24585]: cluster 2024-09-16T10:45:26.938485+0000 mgr.a (mgr.14373) 13334 : cluster [DBG] pgmap v9247: 225 pgs: 225 active+clean; 589 KiB data, 199 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:45:28.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:45:28 smithi086 bash[24289]: audit 2024-09-16T10:45:26.918715+0000 mgr.a (mgr.14373) 13333 : audit [DBG] from='client.289914 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:45:28.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:45:28 smithi086 bash[24289]: cluster 2024-09-16T10:45:26.938485+0000 mgr.a (mgr.14373) 13334 : cluster [DBG] pgmap v9247: 225 pgs: 225 active+clean; 589 KiB data, 199 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:45:30.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:45:30 smithi047 bash[22744]: cluster 2024-09-16T10:45:28.939447+0000 mgr.a (mgr.14373) 13335 : cluster [DBG] pgmap v9248: 225 pgs: 225 active+clean; 589 KiB data, 199 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:45:30.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:45:30 smithi157 bash[24585]: cluster 2024-09-16T10:45:28.939447+0000 mgr.a (mgr.14373) 13335 : cluster [DBG] pgmap v9248: 225 pgs: 225 active+clean; 589 KiB data, 199 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:45:30.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:45:30 smithi086 bash[24289]: cluster 2024-09-16T10:45:28.939447+0000 mgr.a (mgr.14373) 13335 : cluster [DBG] pgmap v9248: 225 pgs: 225 active+clean; 589 KiB data, 199 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:45:32.348 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:45:32.348 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:45:32.348 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:45:32.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:45:32 smithi157 bash[24585]: cluster 2024-09-16T10:45:30.940221+0000 mgr.a (mgr.14373) 13336 : cluster [DBG] pgmap v9249: 225 pgs: 225 active+clean; 589 KiB data, 199 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:45:32.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:45:32 smithi086 bash[24289]: cluster 2024-09-16T10:45:30.940221+0000 mgr.a (mgr.14373) 13336 : cluster [DBG] pgmap v9249: 225 pgs: 225 active+clean; 589 KiB data, 199 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:45:32.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:45:32 smithi047 bash[22744]: cluster 2024-09-16T10:45:30.940221+0000 mgr.a (mgr.14373) 13336 : cluster [DBG] pgmap v9249: 225 pgs: 225 active+clean; 589 KiB data, 199 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:45:33.134 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:45:33.134 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:45:33.135 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:45:33.135 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:45:33.135 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:45:34.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:45:34 smithi157 bash[24585]: audit 2024-09-16T10:45:32.684670+0000 mgr.a (mgr.14373) 13337 : audit [DBG] from='client.289992 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:45:34.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:45:34 smithi157 bash[24585]: cluster 2024-09-16T10:45:32.942048+0000 mgr.a (mgr.14373) 13338 : cluster [DBG] pgmap v9250: 225 pgs: 225 active+clean; 589 KiB data, 199 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:45:34.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:45:34 smithi086 bash[24289]: audit 2024-09-16T10:45:32.684670+0000 mgr.a (mgr.14373) 13337 : audit [DBG] from='client.289992 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:45:34.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:45:34 smithi086 bash[24289]: cluster 2024-09-16T10:45:32.942048+0000 mgr.a (mgr.14373) 13338 : cluster [DBG] pgmap v9250: 225 pgs: 225 active+clean; 589 KiB data, 199 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:45:34.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:45:34 smithi047 bash[22744]: audit 2024-09-16T10:45:32.684670+0000 mgr.a (mgr.14373) 13337 : audit [DBG] from='client.289992 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:45:34.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:45:34 smithi047 bash[22744]: cluster 2024-09-16T10:45:32.942048+0000 mgr.a (mgr.14373) 13338 : cluster [DBG] pgmap v9250: 225 pgs: 225 active+clean; 589 KiB data, 199 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:45:36.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:45:36 smithi157 bash[24585]: cluster 2024-09-16T10:45:34.942966+0000 mgr.a (mgr.14373) 13339 : cluster [DBG] pgmap v9251: 225 pgs: 225 active+clean; 589 KiB data, 199 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T10:45:36.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:45:36 smithi086 bash[24289]: cluster 2024-09-16T10:45:34.942966+0000 mgr.a (mgr.14373) 13339 : cluster [DBG] pgmap v9251: 225 pgs: 225 active+clean; 589 KiB data, 199 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T10:45:36.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:45:36 smithi047 bash[22744]: cluster 2024-09-16T10:45:34.942966+0000 mgr.a (mgr.14373) 13339 : cluster [DBG] pgmap v9251: 225 pgs: 225 active+clean; 589 KiB data, 199 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T10:45:38.136 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:45:38.355 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:45:38.355 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:45:38.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:45:38 smithi157 bash[24585]: cluster 2024-09-16T10:45:36.945102+0000 mgr.a (mgr.14373) 13340 : cluster [DBG] pgmap v9252: 225 pgs: 225 active+clean; 589 KiB data, 199 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-16T10:45:38.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:45:38 smithi086 bash[24289]: cluster 2024-09-16T10:45:36.945102+0000 mgr.a (mgr.14373) 13340 : cluster [DBG] pgmap v9252: 225 pgs: 225 active+clean; 589 KiB data, 199 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-16T10:45:38.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:45:38 smithi047 bash[22744]: cluster 2024-09-16T10:45:36.945102+0000 mgr.a (mgr.14373) 13340 : cluster [DBG] pgmap v9252: 225 pgs: 225 active+clean; 589 KiB data, 199 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-16T10:45:38.886 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:45:38.886 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:45:38.886 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:45:38.886 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:45:38.886 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:45:39.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:45:39 smithi157 bash[24585]: audit 2024-09-16T10:45:38.456399+0000 mgr.a (mgr.14373) 13341 : audit [DBG] from='client.290067 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:45:39.572 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:45:39 smithi086 bash[24289]: audit 2024-09-16T10:45:38.456399+0000 mgr.a (mgr.14373) 13341 : audit [DBG] from='client.290067 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:45:39.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:45:39 smithi047 bash[22744]: audit 2024-09-16T10:45:38.456399+0000 mgr.a (mgr.14373) 13341 : audit [DBG] from='client.290067 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:45:40.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:45:40 smithi157 bash[24585]: cluster 2024-09-16T10:45:38.945655+0000 mgr.a (mgr.14373) 13342 : cluster [DBG] pgmap v9253: 225 pgs: 225 active+clean; 589 KiB data, 199 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:45:40.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:45:40 smithi086 bash[24289]: cluster 2024-09-16T10:45:38.945655+0000 mgr.a (mgr.14373) 13342 : cluster [DBG] pgmap v9253: 225 pgs: 225 active+clean; 589 KiB data, 199 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:45:40.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:45:40 smithi047 bash[22744]: cluster 2024-09-16T10:45:38.945655+0000 mgr.a (mgr.14373) 13342 : cluster [DBG] pgmap v9253: 225 pgs: 225 active+clean; 589 KiB data, 199 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:45:42.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:45:42 smithi157 bash[24585]: cluster 2024-09-16T10:45:40.946582+0000 mgr.a (mgr.14373) 13343 : cluster [DBG] pgmap v9254: 225 pgs: 225 active+clean; 589 KiB data, 199 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:45:42.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:45:42 smithi086 bash[24289]: cluster 2024-09-16T10:45:40.946582+0000 mgr.a (mgr.14373) 13343 : cluster [DBG] pgmap v9254: 225 pgs: 225 active+clean; 589 KiB data, 199 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:45:42.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:45:42 smithi047 bash[22744]: cluster 2024-09-16T10:45:40.946582+0000 mgr.a (mgr.14373) 13343 : cluster [DBG] pgmap v9254: 225 pgs: 225 active+clean; 589 KiB data, 199 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:45:43.887 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:45:43.888 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:45:43.888 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:45:44.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:45:44 smithi157 bash[24585]: cluster 2024-09-16T10:45:42.948918+0000 mgr.a (mgr.14373) 13344 : cluster [DBG] pgmap v9255: 225 pgs: 225 active+clean; 589 KiB data, 199 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:45:44.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:45:44 smithi086 bash[24289]: cluster 2024-09-16T10:45:42.948918+0000 mgr.a (mgr.14373) 13344 : cluster [DBG] pgmap v9255: 225 pgs: 225 active+clean; 589 KiB data, 199 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:45:44.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:45:44 smithi047 bash[22744]: cluster 2024-09-16T10:45:42.948918+0000 mgr.a (mgr.14373) 13344 : cluster [DBG] pgmap v9255: 225 pgs: 225 active+clean; 589 KiB data, 199 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:45:44.641 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:45:44.641 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:45:44.642 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:45:44.642 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:45:44.642 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:45:45.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:45:45 smithi157 bash[24585]: audit 2024-09-16T10:45:44.217462+0000 mgr.a (mgr.14373) 13345 : audit [DBG] from='client.290139 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:45:45.572 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:45:45 smithi086 bash[24289]: audit 2024-09-16T10:45:44.217462+0000 mgr.a (mgr.14373) 13345 : audit [DBG] from='client.290139 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:45:45.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:45:45 smithi047 bash[22744]: audit 2024-09-16T10:45:44.217462+0000 mgr.a (mgr.14373) 13345 : audit [DBG] from='client.290139 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:45:46.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:45:46 smithi157 bash[24585]: cluster 2024-09-16T10:45:44.949829+0000 mgr.a (mgr.14373) 13346 : cluster [DBG] pgmap v9256: 225 pgs: 225 active+clean; 589 KiB data, 199 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:45:46.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:45:46 smithi086 bash[24289]: cluster 2024-09-16T10:45:44.949829+0000 mgr.a (mgr.14373) 13346 : cluster [DBG] pgmap v9256: 225 pgs: 225 active+clean; 589 KiB data, 199 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:45:46.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:45:46 smithi047 bash[22744]: cluster 2024-09-16T10:45:44.949829+0000 mgr.a (mgr.14373) 13346 : cluster [DBG] pgmap v9256: 225 pgs: 225 active+clean; 589 KiB data, 199 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:45:48.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:45:48 smithi157 bash[24585]: cluster 2024-09-16T10:45:46.952020+0000 mgr.a (mgr.14373) 13347 : cluster [DBG] pgmap v9257: 225 pgs: 225 active+clean; 589 KiB data, 199 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:45:48.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:45:48 smithi086 bash[24289]: cluster 2024-09-16T10:45:46.952020+0000 mgr.a (mgr.14373) 13347 : cluster [DBG] pgmap v9257: 225 pgs: 225 active+clean; 589 KiB data, 199 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:45:48.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:45:48 smithi047 bash[22744]: cluster 2024-09-16T10:45:46.952020+0000 mgr.a (mgr.14373) 13347 : cluster [DBG] pgmap v9257: 225 pgs: 225 active+clean; 589 KiB data, 199 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:45:49.643 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:45:49.644 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:45:49.644 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:45:50.409 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:45:50.410 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:45:50.410 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:45:50.410 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:45:50.410 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:45:50.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:45:50 smithi157 bash[24585]: cluster 2024-09-16T10:45:48.952771+0000 mgr.a (mgr.14373) 13348 : cluster [DBG] pgmap v9258: 225 pgs: 225 active+clean; 589 KiB data, 199 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:45:50.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:45:50 smithi086 bash[24289]: cluster 2024-09-16T10:45:48.952771+0000 mgr.a (mgr.14373) 13348 : cluster [DBG] pgmap v9258: 225 pgs: 225 active+clean; 589 KiB data, 199 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:45:50.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:45:50 smithi047 bash[22744]: cluster 2024-09-16T10:45:48.952771+0000 mgr.a (mgr.14373) 13348 : cluster [DBG] pgmap v9258: 225 pgs: 225 active+clean; 589 KiB data, 199 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:45:51.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:45:51 smithi157 bash[24585]: audit 2024-09-16T10:45:49.973009+0000 mgr.a (mgr.14373) 13349 : audit [DBG] from='client.290214 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:45:51.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:45:51 smithi086 bash[24289]: audit 2024-09-16T10:45:49.973009+0000 mgr.a (mgr.14373) 13349 : audit [DBG] from='client.290214 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:45:51.597 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:45:51 smithi047 bash[22744]: audit 2024-09-16T10:45:49.973009+0000 mgr.a (mgr.14373) 13349 : audit [DBG] from='client.290214 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:45:52.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:45:52 smithi157 bash[24585]: cluster 2024-09-16T10:45:50.953636+0000 mgr.a (mgr.14373) 13350 : cluster [DBG] pgmap v9259: 225 pgs: 225 active+clean; 589 KiB data, 199 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:45:52.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:45:52 smithi086 bash[24289]: cluster 2024-09-16T10:45:50.953636+0000 mgr.a (mgr.14373) 13350 : cluster [DBG] pgmap v9259: 225 pgs: 225 active+clean; 589 KiB data, 199 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:45:52.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:45:52 smithi047 bash[22744]: cluster 2024-09-16T10:45:50.953636+0000 mgr.a (mgr.14373) 13350 : cluster [DBG] pgmap v9259: 225 pgs: 225 active+clean; 589 KiB data, 199 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:45:54.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:45:54 smithi157 bash[24585]: cluster 2024-09-16T10:45:52.955905+0000 mgr.a (mgr.14373) 13351 : cluster [DBG] pgmap v9260: 225 pgs: 225 active+clean; 589 KiB data, 199 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:45:54.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:45:54 smithi086 bash[24289]: cluster 2024-09-16T10:45:52.955905+0000 mgr.a (mgr.14373) 13351 : cluster [DBG] pgmap v9260: 225 pgs: 225 active+clean; 589 KiB data, 199 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:45:54.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:45:54 smithi047 bash[22744]: cluster 2024-09-16T10:45:52.955905+0000 mgr.a (mgr.14373) 13351 : cluster [DBG] pgmap v9260: 225 pgs: 225 active+clean; 589 KiB data, 199 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:45:55.410 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:45:55.411 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:45:55.411 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:45:56.199 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:45:56.200 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:45:56.200 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:45:56.200 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:45:56.200 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:45:56.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:45:56 smithi157 bash[24585]: cluster 2024-09-16T10:45:54.956675+0000 mgr.a (mgr.14373) 13352 : cluster [DBG] pgmap v9261: 225 pgs: 225 active+clean; 589 KiB data, 199 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:45:56.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:45:56 smithi086 bash[24289]: cluster 2024-09-16T10:45:54.956675+0000 mgr.a (mgr.14373) 13352 : cluster [DBG] pgmap v9261: 225 pgs: 225 active+clean; 589 KiB data, 199 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:45:56.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:45:56 smithi047 bash[22744]: cluster 2024-09-16T10:45:54.956675+0000 mgr.a (mgr.14373) 13352 : cluster [DBG] pgmap v9261: 225 pgs: 225 active+clean; 589 KiB data, 199 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:45:57.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:45:57 smithi157 bash[24585]: audit 2024-09-16T10:45:55.747189+0000 mgr.a (mgr.14373) 13353 : audit [DBG] from='client.290292 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:45:57.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:45:57 smithi086 bash[24289]: audit 2024-09-16T10:45:55.747189+0000 mgr.a (mgr.14373) 13353 : audit [DBG] from='client.290292 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:45:57.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:45:57 smithi047 bash[22744]: audit 2024-09-16T10:45:55.747189+0000 mgr.a (mgr.14373) 13353 : audit [DBG] from='client.290292 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:45:58.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:45:58 smithi157 bash[24585]: cluster 2024-09-16T10:45:56.959018+0000 mgr.a (mgr.14373) 13354 : cluster [DBG] pgmap v9262: 225 pgs: 225 active+clean; 589 KiB data, 199 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:45:58.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:45:58 smithi086 bash[24289]: cluster 2024-09-16T10:45:56.959018+0000 mgr.a (mgr.14373) 13354 : cluster [DBG] pgmap v9262: 225 pgs: 225 active+clean; 589 KiB data, 199 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:45:58.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:45:58 smithi047 bash[22744]: cluster 2024-09-16T10:45:56.959018+0000 mgr.a (mgr.14373) 13354 : cluster [DBG] pgmap v9262: 225 pgs: 225 active+clean; 589 KiB data, 199 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:46:00.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:46:00 smithi157 bash[24585]: cluster 2024-09-16T10:45:58.959790+0000 mgr.a (mgr.14373) 13355 : cluster [DBG] pgmap v9263: 225 pgs: 225 active+clean; 589 KiB data, 199 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:46:00.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:46:00 smithi086 bash[24289]: cluster 2024-09-16T10:45:58.959790+0000 mgr.a (mgr.14373) 13355 : cluster [DBG] pgmap v9263: 225 pgs: 225 active+clean; 589 KiB data, 199 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:46:00.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:46:00 smithi047 bash[22744]: cluster 2024-09-16T10:45:58.959790+0000 mgr.a (mgr.14373) 13355 : cluster [DBG] pgmap v9263: 225 pgs: 225 active+clean; 589 KiB data, 199 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:46:01.201 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:46:01.202 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:46:01.202 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:46:01.991 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:46:01.991 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:46:01.991 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:46:01.991 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:46:01.991 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:46:02.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:46:02 smithi157 bash[24585]: cluster 2024-09-16T10:46:00.960583+0000 mgr.a (mgr.14373) 13356 : cluster [DBG] pgmap v9264: 225 pgs: 225 active+clean; 589 KiB data, 199 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:46:02.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:46:02 smithi157 bash[24585]: audit 2024-09-16T10:46:01.537832+0000 mgr.a (mgr.14373) 13357 : audit [DBG] from='client.290367 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:46:02.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:46:02 smithi086 bash[24289]: cluster 2024-09-16T10:46:00.960583+0000 mgr.a (mgr.14373) 13356 : cluster [DBG] pgmap v9264: 225 pgs: 225 active+clean; 589 KiB data, 199 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:46:02.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:46:02 smithi086 bash[24289]: audit 2024-09-16T10:46:01.537832+0000 mgr.a (mgr.14373) 13357 : audit [DBG] from='client.290367 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:46:02.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:46:02 smithi047 bash[22744]: cluster 2024-09-16T10:46:00.960583+0000 mgr.a (mgr.14373) 13356 : cluster [DBG] pgmap v9264: 225 pgs: 225 active+clean; 589 KiB data, 199 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:46:02.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:46:02 smithi047 bash[22744]: audit 2024-09-16T10:46:01.537832+0000 mgr.a (mgr.14373) 13357 : audit [DBG] from='client.290367 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:46:04.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:46:04 smithi157 bash[24585]: cluster 2024-09-16T10:46:02.963413+0000 mgr.a (mgr.14373) 13358 : cluster [DBG] pgmap v9265: 225 pgs: 225 active+clean; 589 KiB data, 199 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:46:04.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:46:04 smithi086 bash[24289]: cluster 2024-09-16T10:46:02.963413+0000 mgr.a (mgr.14373) 13358 : cluster [DBG] pgmap v9265: 225 pgs: 225 active+clean; 589 KiB data, 199 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:46:04.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:46:04 smithi047 bash[22744]: cluster 2024-09-16T10:46:02.963413+0000 mgr.a (mgr.14373) 13358 : cluster [DBG] pgmap v9265: 225 pgs: 225 active+clean; 589 KiB data, 199 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:46:06.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:46:06 smithi157 bash[24585]: cluster 2024-09-16T10:46:04.964199+0000 mgr.a (mgr.14373) 13359 : cluster [DBG] pgmap v9266: 225 pgs: 225 active+clean; 589 KiB data, 199 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:46:06.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:46:06 smithi086 bash[24289]: cluster 2024-09-16T10:46:04.964199+0000 mgr.a (mgr.14373) 13359 : cluster [DBG] pgmap v9266: 225 pgs: 225 active+clean; 589 KiB data, 199 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:46:06.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:46:06 smithi047 bash[22744]: cluster 2024-09-16T10:46:04.964199+0000 mgr.a (mgr.14373) 13359 : cluster [DBG] pgmap v9266: 225 pgs: 225 active+clean; 589 KiB data, 199 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:46:06.992 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:46:06.994 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:46:06.994 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:46:07.769 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:46:07.769 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:46:07.769 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:46:07.769 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:46:07.769 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:46:08.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:46:08 smithi157 bash[24585]: cluster 2024-09-16T10:46:06.966137+0000 mgr.a (mgr.14373) 13360 : cluster [DBG] pgmap v9267: 225 pgs: 225 active+clean; 589 KiB data, 199 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:46:08.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:46:08 smithi157 bash[24585]: audit 2024-09-16T10:46:07.322537+0000 mgr.a (mgr.14373) 13361 : audit [DBG] from='client.290445 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:46:08.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:46:08 smithi086 bash[24289]: cluster 2024-09-16T10:46:06.966137+0000 mgr.a (mgr.14373) 13360 : cluster [DBG] pgmap v9267: 225 pgs: 225 active+clean; 589 KiB data, 199 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:46:08.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:46:08 smithi086 bash[24289]: audit 2024-09-16T10:46:07.322537+0000 mgr.a (mgr.14373) 13361 : audit [DBG] from='client.290445 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:46:08.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:46:08 smithi047 bash[22744]: cluster 2024-09-16T10:46:06.966137+0000 mgr.a (mgr.14373) 13360 : cluster [DBG] pgmap v9267: 225 pgs: 225 active+clean; 589 KiB data, 199 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:46:08.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:46:08 smithi047 bash[22744]: audit 2024-09-16T10:46:07.322537+0000 mgr.a (mgr.14373) 13361 : audit [DBG] from='client.290445 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:46:10.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:46:10 smithi157 bash[24585]: cluster 2024-09-16T10:46:08.967111+0000 mgr.a (mgr.14373) 13362 : cluster [DBG] pgmap v9268: 225 pgs: 225 active+clean; 589 KiB data, 199 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:46:10.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:46:10 smithi157 bash[24585]: audit 2024-09-16T10:46:09.692097+0000 mon.b (mon.2) 1222 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T10:46:10.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:46:10 smithi086 bash[24289]: cluster 2024-09-16T10:46:08.967111+0000 mgr.a (mgr.14373) 13362 : cluster [DBG] pgmap v9268: 225 pgs: 225 active+clean; 589 KiB data, 199 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:46:10.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:46:10 smithi086 bash[24289]: audit 2024-09-16T10:46:09.692097+0000 mon.b (mon.2) 1222 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T10:46:10.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:46:10 smithi047 bash[22744]: cluster 2024-09-16T10:46:08.967111+0000 mgr.a (mgr.14373) 13362 : cluster [DBG] pgmap v9268: 225 pgs: 225 active+clean; 589 KiB data, 199 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:46:10.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:46:10 smithi047 bash[22744]: audit 2024-09-16T10:46:09.692097+0000 mon.b (mon.2) 1222 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T10:46:11.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:46:11 smithi157 bash[24585]: audit 2024-09-16T10:46:10.528204+0000 mon.b (mon.2) 1223 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T10:46:11.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:46:11 smithi157 bash[24585]: audit 2024-09-16T10:46:10.530448+0000 mon.b (mon.2) 1224 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T10:46:11.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:46:11 smithi157 bash[24585]: audit 2024-09-16T10:46:10.540743+0000 mon.a (mon.0) 1370 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:46:11.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:46:11 smithi157 bash[24585]: audit 2024-09-16T10:46:10.547846+0000 mon.b (mon.2) 1225 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:46:11.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:46:11 smithi157 bash[24585]: audit 2024-09-16T10:46:10.550626+0000 mgr.a (mgr.14373) 13363 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:46:11.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:46:11 smithi086 bash[24289]: audit 2024-09-16T10:46:10.528204+0000 mon.b (mon.2) 1223 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T10:46:11.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:46:11 smithi086 bash[24289]: audit 2024-09-16T10:46:10.530448+0000 mon.b (mon.2) 1224 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T10:46:11.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:46:11 smithi086 bash[24289]: audit 2024-09-16T10:46:10.540743+0000 mon.a (mon.0) 1370 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:46:11.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:46:11 smithi086 bash[24289]: audit 2024-09-16T10:46:10.547846+0000 mon.b (mon.2) 1225 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:46:11.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:46:11 smithi086 bash[24289]: audit 2024-09-16T10:46:10.550626+0000 mgr.a (mgr.14373) 13363 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:46:11.592 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 10:46:11 smithi047 bash[22994]: debug 2024-09-16T10:46:11.294+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T10:46:11.593 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 10:46:11 smithi047 bash[22994]: debug 2024-09-16T10:46:11.298+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T10:46:11.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:46:11 smithi047 bash[22744]: audit 2024-09-16T10:46:10.528204+0000 mon.b (mon.2) 1223 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T10:46:11.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:46:11 smithi047 bash[22744]: audit 2024-09-16T10:46:10.530448+0000 mon.b (mon.2) 1224 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T10:46:11.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:46:11 smithi047 bash[22744]: audit 2024-09-16T10:46:10.540743+0000 mon.a (mon.0) 1370 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:46:11.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:46:11 smithi047 bash[22744]: audit 2024-09-16T10:46:10.547846+0000 mon.b (mon.2) 1225 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:46:11.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:46:11 smithi047 bash[22744]: audit 2024-09-16T10:46:10.550626+0000 mgr.a (mgr.14373) 13363 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:46:12.770 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:46:12.771 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:46:12.771 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:46:12.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:46:12 smithi157 bash[24585]: cluster 2024-09-16T10:46:10.967603+0000 mgr.a (mgr.14373) 13364 : cluster [DBG] pgmap v9269: 225 pgs: 225 active+clean; 589 KiB data, 199 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T10:46:12.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:46:12 smithi157 bash[24585]: audit 2024-09-16T10:46:11.296960+0000 mgr.a (mgr.14373) 13365 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T10:46:12.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:46:12 smithi157 bash[24585]: cephadm 2024-09-16T10:46:11.298753+0000 mgr.a (mgr.14373) 13366 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T10:46:12.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:46:12 smithi086 bash[24289]: cluster 2024-09-16T10:46:10.967603+0000 mgr.a (mgr.14373) 13364 : cluster [DBG] pgmap v9269: 225 pgs: 225 active+clean; 589 KiB data, 199 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T10:46:12.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:46:12 smithi086 bash[24289]: audit 2024-09-16T10:46:11.296960+0000 mgr.a (mgr.14373) 13365 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T10:46:12.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:46:12 smithi086 bash[24289]: cephadm 2024-09-16T10:46:11.298753+0000 mgr.a (mgr.14373) 13366 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T10:46:12.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:46:12 smithi047 bash[22744]: cluster 2024-09-16T10:46:10.967603+0000 mgr.a (mgr.14373) 13364 : cluster [DBG] pgmap v9269: 225 pgs: 225 active+clean; 589 KiB data, 199 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T10:46:12.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:46:12 smithi047 bash[22744]: audit 2024-09-16T10:46:11.296960+0000 mgr.a (mgr.14373) 13365 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T10:46:12.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:46:12 smithi047 bash[22744]: cephadm 2024-09-16T10:46:11.298753+0000 mgr.a (mgr.14373) 13366 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T10:46:13.557 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:46:13.557 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:46:13.557 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:46:13.557 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:46:13.557 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:46:14.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:46:14 smithi157 bash[24585]: cluster 2024-09-16T10:46:12.968997+0000 mgr.a (mgr.14373) 13367 : cluster [DBG] pgmap v9270: 225 pgs: 225 active+clean; 589 KiB data, 199 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:46:14.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:46:14 smithi157 bash[24585]: audit 2024-09-16T10:46:13.110409+0000 mgr.a (mgr.14373) 13368 : audit [DBG] from='client.290628 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:46:14.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:46:14 smithi086 bash[24289]: cluster 2024-09-16T10:46:12.968997+0000 mgr.a (mgr.14373) 13367 : cluster [DBG] pgmap v9270: 225 pgs: 225 active+clean; 589 KiB data, 199 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:46:14.822 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:46:14 smithi086 bash[24289]: audit 2024-09-16T10:46:13.110409+0000 mgr.a (mgr.14373) 13368 : audit [DBG] from='client.290628 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:46:14.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:46:14 smithi047 bash[22744]: cluster 2024-09-16T10:46:12.968997+0000 mgr.a (mgr.14373) 13367 : cluster [DBG] pgmap v9270: 225 pgs: 225 active+clean; 589 KiB data, 199 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:46:14.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:46:14 smithi047 bash[22744]: audit 2024-09-16T10:46:13.110409+0000 mgr.a (mgr.14373) 13368 : audit [DBG] from='client.290628 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:46:16.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:46:16 smithi157 bash[24585]: cluster 2024-09-16T10:46:14.969944+0000 mgr.a (mgr.14373) 13369 : cluster [DBG] pgmap v9271: 225 pgs: 225 active+clean; 589 KiB data, 199 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:46:16.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:46:16 smithi086 bash[24289]: cluster 2024-09-16T10:46:14.969944+0000 mgr.a (mgr.14373) 13369 : cluster [DBG] pgmap v9271: 225 pgs: 225 active+clean; 589 KiB data, 199 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:46:16.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:46:16 smithi047 bash[22744]: cluster 2024-09-16T10:46:14.969944+0000 mgr.a (mgr.14373) 13369 : cluster [DBG] pgmap v9271: 225 pgs: 225 active+clean; 589 KiB data, 199 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:46:18.558 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:46:18.559 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:46:18.559 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:46:18.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:46:18 smithi086 bash[24289]: cluster 2024-09-16T10:46:16.972152+0000 mgr.a (mgr.14373) 13370 : cluster [DBG] pgmap v9272: 225 pgs: 225 active+clean; 589 KiB data, 199 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:46:18.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:46:18 smithi047 bash[22744]: cluster 2024-09-16T10:46:16.972152+0000 mgr.a (mgr.14373) 13370 : cluster [DBG] pgmap v9272: 225 pgs: 225 active+clean; 589 KiB data, 199 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:46:19.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:46:18 smithi157 bash[24585]: cluster 2024-09-16T10:46:16.972152+0000 mgr.a (mgr.14373) 13370 : cluster [DBG] pgmap v9272: 225 pgs: 225 active+clean; 589 KiB data, 199 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:46:19.337 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:46:19.337 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:46:19.338 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:46:19.338 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:46:19.338 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:46:20.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:46:20 smithi086 bash[24289]: audit 2024-09-16T10:46:18.896848+0000 mgr.a (mgr.14373) 13371 : audit [DBG] from='client.290706 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:46:20.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:46:20 smithi086 bash[24289]: cluster 2024-09-16T10:46:18.972803+0000 mgr.a (mgr.14373) 13372 : cluster [DBG] pgmap v9273: 225 pgs: 225 active+clean; 589 KiB data, 199 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:46:20.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:46:20 smithi047 bash[22744]: audit 2024-09-16T10:46:18.896848+0000 mgr.a (mgr.14373) 13371 : audit [DBG] from='client.290706 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:46:20.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:46:20 smithi047 bash[22744]: cluster 2024-09-16T10:46:18.972803+0000 mgr.a (mgr.14373) 13372 : cluster [DBG] pgmap v9273: 225 pgs: 225 active+clean; 589 KiB data, 199 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:46:21.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:46:20 smithi157 bash[24585]: audit 2024-09-16T10:46:18.896848+0000 mgr.a (mgr.14373) 13371 : audit [DBG] from='client.290706 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:46:21.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:46:20 smithi157 bash[24585]: cluster 2024-09-16T10:46:18.972803+0000 mgr.a (mgr.14373) 13372 : cluster [DBG] pgmap v9273: 225 pgs: 225 active+clean; 589 KiB data, 199 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:46:22.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:46:22 smithi086 bash[24289]: cluster 2024-09-16T10:46:20.973862+0000 mgr.a (mgr.14373) 13373 : cluster [DBG] pgmap v9274: 225 pgs: 225 active+clean; 589 KiB data, 199 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:46:22.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:46:22 smithi047 bash[22744]: cluster 2024-09-16T10:46:20.973862+0000 mgr.a (mgr.14373) 13373 : cluster [DBG] pgmap v9274: 225 pgs: 225 active+clean; 589 KiB data, 199 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:46:23.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:46:22 smithi157 bash[24585]: cluster 2024-09-16T10:46:20.973862+0000 mgr.a (mgr.14373) 13373 : cluster [DBG] pgmap v9274: 225 pgs: 225 active+clean; 589 KiB data, 199 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:46:24.338 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:46:24.338 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:46:24.339 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:46:24.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:46:24 smithi086 bash[24289]: cluster 2024-09-16T10:46:22.976245+0000 mgr.a (mgr.14373) 13374 : cluster [DBG] pgmap v9275: 225 pgs: 225 active+clean; 589 KiB data, 199 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:46:24.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:46:24 smithi047 bash[22744]: cluster 2024-09-16T10:46:22.976245+0000 mgr.a (mgr.14373) 13374 : cluster [DBG] pgmap v9275: 225 pgs: 225 active+clean; 589 KiB data, 199 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:46:25.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:46:24 smithi157 bash[24585]: cluster 2024-09-16T10:46:22.976245+0000 mgr.a (mgr.14373) 13374 : cluster [DBG] pgmap v9275: 225 pgs: 225 active+clean; 589 KiB data, 199 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:46:25.083 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:46:25.084 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:46:25.084 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:46:25.084 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:46:25.084 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:46:26.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:46:26 smithi047 bash[22744]: audit 2024-09-16T10:46:24.669853+0000 mgr.a (mgr.14373) 13375 : audit [DBG] from='client.290784 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:46:26.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:46:26 smithi047 bash[22744]: cluster 2024-09-16T10:46:24.984181+0000 mgr.a (mgr.14373) 13376 : cluster [DBG] pgmap v9276: 225 pgs: 225 active+clean; 589 KiB data, 199 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:46:27.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:46:26 smithi157 bash[24585]: audit 2024-09-16T10:46:24.669853+0000 mgr.a (mgr.14373) 13375 : audit [DBG] from='client.290784 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:46:27.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:46:26 smithi157 bash[24585]: cluster 2024-09-16T10:46:24.984181+0000 mgr.a (mgr.14373) 13376 : cluster [DBG] pgmap v9276: 225 pgs: 225 active+clean; 589 KiB data, 199 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:46:27.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:46:26 smithi086 bash[24289]: audit 2024-09-16T10:46:24.669853+0000 mgr.a (mgr.14373) 13375 : audit [DBG] from='client.290784 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:46:27.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:46:26 smithi086 bash[24289]: cluster 2024-09-16T10:46:24.984181+0000 mgr.a (mgr.14373) 13376 : cluster [DBG] pgmap v9276: 225 pgs: 225 active+clean; 589 KiB data, 199 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:46:28.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:46:28 smithi047 bash[22744]: cluster 2024-09-16T10:46:26.986500+0000 mgr.a (mgr.14373) 13377 : cluster [DBG] pgmap v9277: 225 pgs: 225 active+clean; 589 KiB data, 199 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:46:29.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:46:28 smithi157 bash[24585]: cluster 2024-09-16T10:46:26.986500+0000 mgr.a (mgr.14373) 13377 : cluster [DBG] pgmap v9277: 225 pgs: 225 active+clean; 589 KiB data, 199 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:46:29.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:46:28 smithi086 bash[24289]: cluster 2024-09-16T10:46:26.986500+0000 mgr.a (mgr.14373) 13377 : cluster [DBG] pgmap v9277: 225 pgs: 225 active+clean; 589 KiB data, 199 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:46:30.085 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:46:30.086 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:46:30.087 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:46:30.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:46:30 smithi047 bash[22744]: cluster 2024-09-16T10:46:28.987431+0000 mgr.a (mgr.14373) 13378 : cluster [DBG] pgmap v9278: 225 pgs: 225 active+clean; 589 KiB data, 199 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:46:30.866 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:46:30.866 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:46:30.866 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:46:30.866 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:46:30.866 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:46:31.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:46:30 smithi157 bash[24585]: cluster 2024-09-16T10:46:28.987431+0000 mgr.a (mgr.14373) 13378 : cluster [DBG] pgmap v9278: 225 pgs: 225 active+clean; 589 KiB data, 199 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:46:31.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:46:30 smithi086 bash[24289]: cluster 2024-09-16T10:46:28.987431+0000 mgr.a (mgr.14373) 13378 : cluster [DBG] pgmap v9278: 225 pgs: 225 active+clean; 589 KiB data, 199 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:46:31.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:46:31 smithi047 bash[22744]: audit 2024-09-16T10:46:30.419581+0000 mgr.a (mgr.14373) 13379 : audit [DBG] from='client.290859 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:46:32.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:46:31 smithi157 bash[24585]: audit 2024-09-16T10:46:30.419581+0000 mgr.a (mgr.14373) 13379 : audit [DBG] from='client.290859 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:46:32.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:46:31 smithi086 bash[24289]: audit 2024-09-16T10:46:30.419581+0000 mgr.a (mgr.14373) 13379 : audit [DBG] from='client.290859 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:46:33.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:46:32 smithi157 bash[24585]: cluster 2024-09-16T10:46:30.988429+0000 mgr.a (mgr.14373) 13380 : cluster [DBG] pgmap v9279: 225 pgs: 225 active+clean; 589 KiB data, 199 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:46:33.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:46:32 smithi086 bash[24289]: cluster 2024-09-16T10:46:30.988429+0000 mgr.a (mgr.14373) 13380 : cluster [DBG] pgmap v9279: 225 pgs: 225 active+clean; 589 KiB data, 199 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:46:33.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:46:32 smithi047 bash[22744]: cluster 2024-09-16T10:46:30.988429+0000 mgr.a (mgr.14373) 13380 : cluster [DBG] pgmap v9279: 225 pgs: 225 active+clean; 589 KiB data, 199 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:46:35.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:46:34 smithi157 bash[24585]: cluster 2024-09-16T10:46:32.990703+0000 mgr.a (mgr.14373) 13381 : cluster [DBG] pgmap v9280: 225 pgs: 225 active+clean; 589 KiB data, 199 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:46:35.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:46:34 smithi086 bash[24289]: cluster 2024-09-16T10:46:32.990703+0000 mgr.a (mgr.14373) 13381 : cluster [DBG] pgmap v9280: 225 pgs: 225 active+clean; 589 KiB data, 199 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:46:35.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:46:34 smithi047 bash[22744]: cluster 2024-09-16T10:46:32.990703+0000 mgr.a (mgr.14373) 13381 : cluster [DBG] pgmap v9280: 225 pgs: 225 active+clean; 589 KiB data, 199 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:46:35.868 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:46:35.868 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:46:35.869 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:46:36.617 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:46:36.617 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:46:36.617 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:46:36.617 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:46:36.618 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:46:37.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:46:36 smithi157 bash[24585]: cluster 2024-09-16T10:46:34.991476+0000 mgr.a (mgr.14373) 13382 : cluster [DBG] pgmap v9281: 225 pgs: 225 active+clean; 589 KiB data, 199 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:46:37.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:46:36 smithi086 bash[24289]: cluster 2024-09-16T10:46:34.991476+0000 mgr.a (mgr.14373) 13382 : cluster [DBG] pgmap v9281: 225 pgs: 225 active+clean; 589 KiB data, 199 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:46:37.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:46:36 smithi047 bash[22744]: cluster 2024-09-16T10:46:34.991476+0000 mgr.a (mgr.14373) 13382 : cluster [DBG] pgmap v9281: 225 pgs: 225 active+clean; 589 KiB data, 199 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:46:38.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:46:37 smithi157 bash[24585]: audit 2024-09-16T10:46:36.196522+0000 mgr.a (mgr.14373) 13383 : audit [DBG] from='client.290937 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:46:38.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:46:37 smithi086 bash[24289]: audit 2024-09-16T10:46:36.196522+0000 mgr.a (mgr.14373) 13383 : audit [DBG] from='client.290937 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:46:38.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:46:37 smithi047 bash[22744]: audit 2024-09-16T10:46:36.196522+0000 mgr.a (mgr.14373) 13383 : audit [DBG] from='client.290937 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:46:39.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:46:38 smithi157 bash[24585]: cluster 2024-09-16T10:46:36.993817+0000 mgr.a (mgr.14373) 13384 : cluster [DBG] pgmap v9282: 225 pgs: 225 active+clean; 589 KiB data, 199 MiB used, 268 GiB / 268 GiB avail; 2.4 KiB/s rd, 2 op/s 2024-09-16T10:46:39.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:46:38 smithi086 bash[24289]: cluster 2024-09-16T10:46:36.993817+0000 mgr.a (mgr.14373) 13384 : cluster [DBG] pgmap v9282: 225 pgs: 225 active+clean; 589 KiB data, 199 MiB used, 268 GiB / 268 GiB avail; 2.4 KiB/s rd, 2 op/s 2024-09-16T10:46:39.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:46:38 smithi047 bash[22744]: cluster 2024-09-16T10:46:36.993817+0000 mgr.a (mgr.14373) 13384 : cluster [DBG] pgmap v9282: 225 pgs: 225 active+clean; 589 KiB data, 199 MiB used, 268 GiB / 268 GiB avail; 2.4 KiB/s rd, 2 op/s 2024-09-16T10:46:41.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:46:40 smithi157 bash[24585]: cluster 2024-09-16T10:46:38.994612+0000 mgr.a (mgr.14373) 13385 : cluster [DBG] pgmap v9283: 225 pgs: 225 active+clean; 589 KiB data, 199 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-09-16T10:46:41.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:46:40 smithi086 bash[24289]: cluster 2024-09-16T10:46:38.994612+0000 mgr.a (mgr.14373) 13385 : cluster [DBG] pgmap v9283: 225 pgs: 225 active+clean; 589 KiB data, 199 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-09-16T10:46:41.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:46:40 smithi047 bash[22744]: cluster 2024-09-16T10:46:38.994612+0000 mgr.a (mgr.14373) 13385 : cluster [DBG] pgmap v9283: 225 pgs: 225 active+clean; 589 KiB data, 199 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-09-16T10:46:41.618 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:46:41.619 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:46:41.619 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:46:42.404 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:46:42.404 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:46:42.404 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:46:42.404 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:46:42.404 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:46:43.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:46:42 smithi157 bash[24585]: cluster 2024-09-16T10:46:40.995366+0000 mgr.a (mgr.14373) 13386 : cluster [DBG] pgmap v9284: 225 pgs: 225 active+clean; 589 KiB data, 199 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-09-16T10:46:43.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:46:42 smithi086 bash[24289]: cluster 2024-09-16T10:46:40.995366+0000 mgr.a (mgr.14373) 13386 : cluster [DBG] pgmap v9284: 225 pgs: 225 active+clean; 589 KiB data, 199 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-09-16T10:46:43.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:46:42 smithi047 bash[22744]: cluster 2024-09-16T10:46:40.995366+0000 mgr.a (mgr.14373) 13386 : cluster [DBG] pgmap v9284: 225 pgs: 225 active+clean; 589 KiB data, 199 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-09-16T10:46:44.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:46:43 smithi157 bash[24585]: audit 2024-09-16T10:46:41.954365+0000 mgr.a (mgr.14373) 13387 : audit [DBG] from='client.291015 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:46:44.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:46:43 smithi086 bash[24289]: audit 2024-09-16T10:46:41.954365+0000 mgr.a (mgr.14373) 13387 : audit [DBG] from='client.291015 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:46:44.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:46:43 smithi047 bash[22744]: audit 2024-09-16T10:46:41.954365+0000 mgr.a (mgr.14373) 13387 : audit [DBG] from='client.291015 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:46:45.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:46:44 smithi157 bash[24585]: cluster 2024-09-16T10:46:42.998258+0000 mgr.a (mgr.14373) 13388 : cluster [DBG] pgmap v9285: 225 pgs: 225 active+clean; 589 KiB data, 199 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:46:45.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:46:44 smithi086 bash[24289]: cluster 2024-09-16T10:46:42.998258+0000 mgr.a (mgr.14373) 13388 : cluster [DBG] pgmap v9285: 225 pgs: 225 active+clean; 589 KiB data, 199 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:46:45.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:46:44 smithi047 bash[22744]: cluster 2024-09-16T10:46:42.998258+0000 mgr.a (mgr.14373) 13388 : cluster [DBG] pgmap v9285: 225 pgs: 225 active+clean; 589 KiB data, 199 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:46:46.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:46:45 smithi157 bash[24585]: cluster 2024-09-16T10:46:44.999129+0000 mgr.a (mgr.14373) 13389 : cluster [DBG] pgmap v9286: 225 pgs: 225 active+clean; 589 KiB data, 199 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:46:46.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:46:45 smithi086 bash[24289]: cluster 2024-09-16T10:46:44.999129+0000 mgr.a (mgr.14373) 13389 : cluster [DBG] pgmap v9286: 225 pgs: 225 active+clean; 589 KiB data, 199 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:46:46.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:46:45 smithi047 bash[22744]: cluster 2024-09-16T10:46:44.999129+0000 mgr.a (mgr.14373) 13389 : cluster [DBG] pgmap v9286: 225 pgs: 225 active+clean; 589 KiB data, 199 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:46:47.406 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:46:47.406 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:46:47.406 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:46:48.153 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:46:48.153 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:46:48.153 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:46:48.153 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:46:48.154 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:46:48.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:46:48 smithi086 bash[24289]: cluster 2024-09-16T10:46:47.001082+0000 mgr.a (mgr.14373) 13390 : cluster [DBG] pgmap v9287: 225 pgs: 225 active+clean; 589 KiB data, 199 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:46:48.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:46:48 smithi047 bash[22744]: cluster 2024-09-16T10:46:47.001082+0000 mgr.a (mgr.14373) 13390 : cluster [DBG] pgmap v9287: 225 pgs: 225 active+clean; 589 KiB data, 199 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:46:48.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:46:48 smithi157 bash[24585]: cluster 2024-09-16T10:46:47.001082+0000 mgr.a (mgr.14373) 13390 : cluster [DBG] pgmap v9287: 225 pgs: 225 active+clean; 589 KiB data, 199 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:46:49.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:46:49 smithi086 bash[24289]: audit 2024-09-16T10:46:47.736846+0000 mgr.a (mgr.14373) 13391 : audit [DBG] from='client.291087 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:46:49.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:46:49 smithi047 bash[22744]: audit 2024-09-16T10:46:47.736846+0000 mgr.a (mgr.14373) 13391 : audit [DBG] from='client.291087 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:46:49.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:46:49 smithi157 bash[24585]: audit 2024-09-16T10:46:47.736846+0000 mgr.a (mgr.14373) 13391 : audit [DBG] from='client.291087 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:46:50.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:46:50 smithi086 bash[24289]: cluster 2024-09-16T10:46:49.002054+0000 mgr.a (mgr.14373) 13392 : cluster [DBG] pgmap v9288: 225 pgs: 225 active+clean; 589 KiB data, 199 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T10:46:50.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:46:50 smithi047 bash[22744]: cluster 2024-09-16T10:46:49.002054+0000 mgr.a (mgr.14373) 13392 : cluster [DBG] pgmap v9288: 225 pgs: 225 active+clean; 589 KiB data, 199 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T10:46:50.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:46:50 smithi157 bash[24585]: cluster 2024-09-16T10:46:49.002054+0000 mgr.a (mgr.14373) 13392 : cluster [DBG] pgmap v9288: 225 pgs: 225 active+clean; 589 KiB data, 199 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T10:46:52.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:46:52 smithi047 bash[22744]: cluster 2024-09-16T10:46:51.002858+0000 mgr.a (mgr.14373) 13393 : cluster [DBG] pgmap v9289: 225 pgs: 225 active+clean; 589 KiB data, 199 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T10:46:52.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:46:52 smithi157 bash[24585]: cluster 2024-09-16T10:46:51.002858+0000 mgr.a (mgr.14373) 13393 : cluster [DBG] pgmap v9289: 225 pgs: 225 active+clean; 589 KiB data, 199 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T10:46:52.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:46:52 smithi086 bash[24289]: cluster 2024-09-16T10:46:51.002858+0000 mgr.a (mgr.14373) 13393 : cluster [DBG] pgmap v9289: 225 pgs: 225 active+clean; 589 KiB data, 199 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T10:46:53.154 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:46:53.155 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:46:53.156 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:46:53.930 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:46:53.931 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:46:53.931 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:46:53.931 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:46:53.931 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:46:54.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:46:54 smithi047 bash[22744]: cluster 2024-09-16T10:46:53.005076+0000 mgr.a (mgr.14373) 13394 : cluster [DBG] pgmap v9290: 225 pgs: 225 active+clean; 589 KiB data, 199 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-16T10:46:54.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:46:54 smithi047 bash[22744]: audit 2024-09-16T10:46:53.485701+0000 mgr.a (mgr.14373) 13395 : audit [DBG] from='client.291165 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:46:54.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:46:54 smithi157 bash[24585]: cluster 2024-09-16T10:46:53.005076+0000 mgr.a (mgr.14373) 13394 : cluster [DBG] pgmap v9290: 225 pgs: 225 active+clean; 589 KiB data, 199 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-16T10:46:54.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:46:54 smithi157 bash[24585]: audit 2024-09-16T10:46:53.485701+0000 mgr.a (mgr.14373) 13395 : audit [DBG] from='client.291165 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:46:54.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:46:54 smithi086 bash[24289]: cluster 2024-09-16T10:46:53.005076+0000 mgr.a (mgr.14373) 13394 : cluster [DBG] pgmap v9290: 225 pgs: 225 active+clean; 589 KiB data, 199 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-16T10:46:54.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:46:54 smithi086 bash[24289]: audit 2024-09-16T10:46:53.485701+0000 mgr.a (mgr.14373) 13395 : audit [DBG] from='client.291165 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:46:56.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:46:56 smithi047 bash[22744]: cluster 2024-09-16T10:46:55.006060+0000 mgr.a (mgr.14373) 13396 : cluster [DBG] pgmap v9291: 225 pgs: 225 active+clean; 589 KiB data, 199 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:46:56.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:46:56 smithi157 bash[24585]: cluster 2024-09-16T10:46:55.006060+0000 mgr.a (mgr.14373) 13396 : cluster [DBG] pgmap v9291: 225 pgs: 225 active+clean; 589 KiB data, 199 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:46:56.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:46:56 smithi086 bash[24289]: cluster 2024-09-16T10:46:55.006060+0000 mgr.a (mgr.14373) 13396 : cluster [DBG] pgmap v9291: 225 pgs: 225 active+clean; 589 KiB data, 199 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:46:58.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:46:58 smithi047 bash[22744]: cluster 2024-09-16T10:46:57.008282+0000 mgr.a (mgr.14373) 13397 : cluster [DBG] pgmap v9292: 225 pgs: 225 active+clean; 589 KiB data, 199 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:46:58.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:46:58 smithi157 bash[24585]: cluster 2024-09-16T10:46:57.008282+0000 mgr.a (mgr.14373) 13397 : cluster [DBG] pgmap v9292: 225 pgs: 225 active+clean; 589 KiB data, 199 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:46:58.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:46:58 smithi086 bash[24289]: cluster 2024-09-16T10:46:57.008282+0000 mgr.a (mgr.14373) 13397 : cluster [DBG] pgmap v9292: 225 pgs: 225 active+clean; 589 KiB data, 199 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:46:58.932 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:46:58.933 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:46:58.933 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:46:59.717 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:46:59.718 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:46:59.718 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:46:59.718 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:46:59.718 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:47:00.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:47:00 smithi047 bash[22744]: cluster 2024-09-16T10:46:59.009063+0000 mgr.a (mgr.14373) 13398 : cluster [DBG] pgmap v9293: 225 pgs: 225 active+clean; 589 KiB data, 199 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:47:00.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:47:00 smithi047 bash[22744]: audit 2024-09-16T10:46:59.271618+0000 mgr.a (mgr.14373) 13399 : audit [DBG] from='client.291240 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:47:00.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:47:00 smithi157 bash[24585]: cluster 2024-09-16T10:46:59.009063+0000 mgr.a (mgr.14373) 13398 : cluster [DBG] pgmap v9293: 225 pgs: 225 active+clean; 589 KiB data, 199 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:47:00.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:47:00 smithi157 bash[24585]: audit 2024-09-16T10:46:59.271618+0000 mgr.a (mgr.14373) 13399 : audit [DBG] from='client.291240 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:47:00.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:47:00 smithi086 bash[24289]: cluster 2024-09-16T10:46:59.009063+0000 mgr.a (mgr.14373) 13398 : cluster [DBG] pgmap v9293: 225 pgs: 225 active+clean; 589 KiB data, 199 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:47:00.572 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:47:00 smithi086 bash[24289]: audit 2024-09-16T10:46:59.271618+0000 mgr.a (mgr.14373) 13399 : audit [DBG] from='client.291240 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:47:02.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:47:02 smithi157 bash[24585]: cluster 2024-09-16T10:47:01.009984+0000 mgr.a (mgr.14373) 13400 : cluster [DBG] pgmap v9294: 225 pgs: 225 active+clean; 589 KiB data, 199 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:47:02.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:47:02 smithi086 bash[24289]: cluster 2024-09-16T10:47:01.009984+0000 mgr.a (mgr.14373) 13400 : cluster [DBG] pgmap v9294: 225 pgs: 225 active+clean; 589 KiB data, 199 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:47:02.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:47:02 smithi047 bash[22744]: cluster 2024-09-16T10:47:01.009984+0000 mgr.a (mgr.14373) 13400 : cluster [DBG] pgmap v9294: 225 pgs: 225 active+clean; 589 KiB data, 199 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:47:04.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:47:04 smithi157 bash[24585]: cluster 2024-09-16T10:47:03.012398+0000 mgr.a (mgr.14373) 13401 : cluster [DBG] pgmap v9295: 225 pgs: 225 active+clean; 589 KiB data, 199 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:47:04.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:47:04 smithi086 bash[24289]: cluster 2024-09-16T10:47:03.012398+0000 mgr.a (mgr.14373) 13401 : cluster [DBG] pgmap v9295: 225 pgs: 225 active+clean; 589 KiB data, 199 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:47:04.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:47:04 smithi047 bash[22744]: cluster 2024-09-16T10:47:03.012398+0000 mgr.a (mgr.14373) 13401 : cluster [DBG] pgmap v9295: 225 pgs: 225 active+clean; 589 KiB data, 199 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:47:04.719 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:47:04.720 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:47:04.720 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:47:05.497 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:47:05.498 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:47:05.498 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:47:05.498 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:47:05.498 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:47:06.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:47:06 smithi157 bash[24585]: cluster 2024-09-16T10:47:05.013185+0000 mgr.a (mgr.14373) 13402 : cluster [DBG] pgmap v9296: 225 pgs: 225 active+clean; 589 KiB data, 199 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:47:06.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:47:06 smithi157 bash[24585]: audit 2024-09-16T10:47:05.055800+0000 mgr.a (mgr.14373) 13403 : audit [DBG] from='client.291312 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:47:06.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:47:06 smithi086 bash[24289]: cluster 2024-09-16T10:47:05.013185+0000 mgr.a (mgr.14373) 13402 : cluster [DBG] pgmap v9296: 225 pgs: 225 active+clean; 589 KiB data, 199 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:47:06.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:47:06 smithi086 bash[24289]: audit 2024-09-16T10:47:05.055800+0000 mgr.a (mgr.14373) 13403 : audit [DBG] from='client.291312 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:47:06.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:47:06 smithi047 bash[22744]: cluster 2024-09-16T10:47:05.013185+0000 mgr.a (mgr.14373) 13402 : cluster [DBG] pgmap v9296: 225 pgs: 225 active+clean; 589 KiB data, 199 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:47:06.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:47:06 smithi047 bash[22744]: audit 2024-09-16T10:47:05.055800+0000 mgr.a (mgr.14373) 13403 : audit [DBG] from='client.291312 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:47:08.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:47:08 smithi157 bash[24585]: cluster 2024-09-16T10:47:07.015501+0000 mgr.a (mgr.14373) 13404 : cluster [DBG] pgmap v9297: 225 pgs: 225 active+clean; 589 KiB data, 199 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:47:08.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:47:08 smithi086 bash[24289]: cluster 2024-09-16T10:47:07.015501+0000 mgr.a (mgr.14373) 13404 : cluster [DBG] pgmap v9297: 225 pgs: 225 active+clean; 589 KiB data, 199 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:47:08.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:47:08 smithi047 bash[22744]: cluster 2024-09-16T10:47:07.015501+0000 mgr.a (mgr.14373) 13404 : cluster [DBG] pgmap v9297: 225 pgs: 225 active+clean; 589 KiB data, 199 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:47:10.499 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:47:10.500 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:47:10.500 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:47:10.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:47:10 smithi157 bash[24585]: cluster 2024-09-16T10:47:09.016286+0000 mgr.a (mgr.14373) 13405 : cluster [DBG] pgmap v9298: 225 pgs: 225 active+clean; 589 KiB data, 199 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:47:10.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:47:10 smithi086 bash[24289]: cluster 2024-09-16T10:47:09.016286+0000 mgr.a (mgr.14373) 13405 : cluster [DBG] pgmap v9298: 225 pgs: 225 active+clean; 589 KiB data, 199 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:47:10.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:47:10 smithi047 bash[22744]: cluster 2024-09-16T10:47:09.016286+0000 mgr.a (mgr.14373) 13405 : cluster [DBG] pgmap v9298: 225 pgs: 225 active+clean; 589 KiB data, 199 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:47:11.304 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:47:11.304 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:47:11.304 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:47:11.304 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:47:11.304 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:47:12.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:47:12 smithi157 bash[24585]: audit 2024-09-16T10:47:10.843286+0000 mgr.a (mgr.14373) 13406 : audit [DBG] from='client.291390 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:47:12.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:47:12 smithi157 bash[24585]: cluster 2024-09-16T10:47:11.016885+0000 mgr.a (mgr.14373) 13407 : cluster [DBG] pgmap v9299: 225 pgs: 225 active+clean; 589 KiB data, 199 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:47:12.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:47:12 smithi157 bash[24585]: audit 2024-09-16T10:47:11.348422+0000 mon.b (mon.2) 1226 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T10:47:12.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:47:12 smithi157 bash[24585]: audit 2024-09-16T10:47:12.105271+0000 mon.b (mon.2) 1227 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T10:47:12.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:47:12 smithi157 bash[24585]: audit 2024-09-16T10:47:12.107261+0000 mon.b (mon.2) 1228 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T10:47:12.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:47:12 smithi086 bash[24289]: audit 2024-09-16T10:47:10.843286+0000 mgr.a (mgr.14373) 13406 : audit [DBG] from='client.291390 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:47:12.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:47:12 smithi086 bash[24289]: cluster 2024-09-16T10:47:11.016885+0000 mgr.a (mgr.14373) 13407 : cluster [DBG] pgmap v9299: 225 pgs: 225 active+clean; 589 KiB data, 199 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:47:12.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:47:12 smithi086 bash[24289]: audit 2024-09-16T10:47:11.348422+0000 mon.b (mon.2) 1226 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T10:47:12.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:47:12 smithi086 bash[24289]: audit 2024-09-16T10:47:12.105271+0000 mon.b (mon.2) 1227 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T10:47:12.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:47:12 smithi086 bash[24289]: audit 2024-09-16T10:47:12.107261+0000 mon.b (mon.2) 1228 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T10:47:12.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:47:12 smithi047 bash[22744]: audit 2024-09-16T10:47:10.843286+0000 mgr.a (mgr.14373) 13406 : audit [DBG] from='client.291390 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:47:12.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:47:12 smithi047 bash[22744]: cluster 2024-09-16T10:47:11.016885+0000 mgr.a (mgr.14373) 13407 : cluster [DBG] pgmap v9299: 225 pgs: 225 active+clean; 589 KiB data, 199 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:47:12.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:47:12 smithi047 bash[22744]: audit 2024-09-16T10:47:11.348422+0000 mon.b (mon.2) 1226 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T10:47:12.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:47:12 smithi047 bash[22744]: audit 2024-09-16T10:47:12.105271+0000 mon.b (mon.2) 1227 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T10:47:12.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:47:12 smithi047 bash[22744]: audit 2024-09-16T10:47:12.107261+0000 mon.b (mon.2) 1228 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T10:47:13.342 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 10:47:12 smithi047 bash[22994]: debug 2024-09-16T10:47:12.892+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T10:47:13.343 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 10:47:12 smithi047 bash[22994]: debug 2024-09-16T10:47:12.896+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T10:47:13.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:47:13 smithi047 bash[22744]: audit 2024-09-16T10:47:12.122024+0000 mon.a (mon.0) 1371 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:47:13.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:47:13 smithi047 bash[22744]: audit 2024-09-16T10:47:12.129003+0000 mon.b (mon.2) 1229 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:47:13.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:47:13 smithi047 bash[22744]: audit 2024-09-16T10:47:12.131878+0000 mgr.a (mgr.14373) 13408 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:47:13.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:47:13 smithi157 bash[24585]: audit 2024-09-16T10:47:12.122024+0000 mon.a (mon.0) 1371 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:47:13.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:47:13 smithi157 bash[24585]: audit 2024-09-16T10:47:12.129003+0000 mon.b (mon.2) 1229 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:47:13.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:47:13 smithi157 bash[24585]: audit 2024-09-16T10:47:12.131878+0000 mgr.a (mgr.14373) 13408 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:47:13.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:47:13 smithi086 bash[24289]: audit 2024-09-16T10:47:12.122024+0000 mon.a (mon.0) 1371 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:47:13.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:47:13 smithi086 bash[24289]: audit 2024-09-16T10:47:12.129003+0000 mon.b (mon.2) 1229 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:47:13.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:47:13 smithi086 bash[24289]: audit 2024-09-16T10:47:12.131878+0000 mgr.a (mgr.14373) 13408 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:47:14.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:47:14 smithi157 bash[24585]: audit 2024-09-16T10:47:12.896521+0000 mgr.a (mgr.14373) 13409 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T10:47:14.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:47:14 smithi157 bash[24585]: cephadm 2024-09-16T10:47:12.898924+0000 mgr.a (mgr.14373) 13410 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T10:47:14.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:47:14 smithi157 bash[24585]: cluster 2024-09-16T10:47:13.019655+0000 mgr.a (mgr.14373) 13411 : cluster [DBG] pgmap v9300: 225 pgs: 225 active+clean; 589 KiB data, 199 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:47:14.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:47:14 smithi086 bash[24289]: audit 2024-09-16T10:47:12.896521+0000 mgr.a (mgr.14373) 13409 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T10:47:14.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:47:14 smithi086 bash[24289]: cephadm 2024-09-16T10:47:12.898924+0000 mgr.a (mgr.14373) 13410 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T10:47:14.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:47:14 smithi086 bash[24289]: cluster 2024-09-16T10:47:13.019655+0000 mgr.a (mgr.14373) 13411 : cluster [DBG] pgmap v9300: 225 pgs: 225 active+clean; 589 KiB data, 199 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:47:14.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:47:14 smithi047 bash[22744]: audit 2024-09-16T10:47:12.896521+0000 mgr.a (mgr.14373) 13409 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T10:47:14.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:47:14 smithi047 bash[22744]: cephadm 2024-09-16T10:47:12.898924+0000 mgr.a (mgr.14373) 13410 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T10:47:14.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:47:14 smithi047 bash[22744]: cluster 2024-09-16T10:47:13.019655+0000 mgr.a (mgr.14373) 13411 : cluster [DBG] pgmap v9300: 225 pgs: 225 active+clean; 589 KiB data, 199 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:47:16.306 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:47:16.306 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:47:16.306 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:47:16.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:47:16 smithi157 bash[24585]: cluster 2024-09-16T10:47:15.020468+0000 mgr.a (mgr.14373) 13412 : cluster [DBG] pgmap v9301: 225 pgs: 225 active+clean; 589 KiB data, 199 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:47:16.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:47:16 smithi086 bash[24289]: cluster 2024-09-16T10:47:15.020468+0000 mgr.a (mgr.14373) 13412 : cluster [DBG] pgmap v9301: 225 pgs: 225 active+clean; 589 KiB data, 199 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:47:16.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:47:16 smithi047 bash[22744]: cluster 2024-09-16T10:47:15.020468+0000 mgr.a (mgr.14373) 13412 : cluster [DBG] pgmap v9301: 225 pgs: 225 active+clean; 589 KiB data, 199 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:47:17.091 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:47:17.091 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:47:17.092 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:47:17.092 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:47:17.092 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:47:18.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:47:18 smithi157 bash[24585]: audit 2024-09-16T10:47:16.646015+0000 mgr.a (mgr.14373) 13413 : audit [DBG] from='client.291570 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:47:18.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:47:18 smithi157 bash[24585]: cluster 2024-09-16T10:47:17.021843+0000 mgr.a (mgr.14373) 13414 : cluster [DBG] pgmap v9302: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:47:18.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:47:18 smithi086 bash[24289]: audit 2024-09-16T10:47:16.646015+0000 mgr.a (mgr.14373) 13413 : audit [DBG] from='client.291570 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:47:18.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:47:18 smithi086 bash[24289]: cluster 2024-09-16T10:47:17.021843+0000 mgr.a (mgr.14373) 13414 : cluster [DBG] pgmap v9302: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:47:18.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:47:18 smithi047 bash[22744]: audit 2024-09-16T10:47:16.646015+0000 mgr.a (mgr.14373) 13413 : audit [DBG] from='client.291570 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:47:18.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:47:18 smithi047 bash[22744]: cluster 2024-09-16T10:47:17.021843+0000 mgr.a (mgr.14373) 13414 : cluster [DBG] pgmap v9302: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:47:20.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:47:20 smithi157 bash[24585]: cluster 2024-09-16T10:47:19.022621+0000 mgr.a (mgr.14373) 13415 : cluster [DBG] pgmap v9303: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T10:47:20.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:47:20 smithi086 bash[24289]: cluster 2024-09-16T10:47:19.022621+0000 mgr.a (mgr.14373) 13415 : cluster [DBG] pgmap v9303: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T10:47:20.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:47:20 smithi047 bash[22744]: cluster 2024-09-16T10:47:19.022621+0000 mgr.a (mgr.14373) 13415 : cluster [DBG] pgmap v9303: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T10:47:22.093 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:47:22.094 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:47:22.094 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:47:22.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:47:22 smithi157 bash[24585]: cluster 2024-09-16T10:47:21.023404+0000 mgr.a (mgr.14373) 13416 : cluster [DBG] pgmap v9304: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T10:47:22.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:47:22 smithi086 bash[24289]: cluster 2024-09-16T10:47:21.023404+0000 mgr.a (mgr.14373) 13416 : cluster [DBG] pgmap v9304: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T10:47:22.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:47:22 smithi047 bash[22744]: cluster 2024-09-16T10:47:21.023404+0000 mgr.a (mgr.14373) 13416 : cluster [DBG] pgmap v9304: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T10:47:22.874 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:47:22.874 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:47:22.875 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:47:22.875 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:47:22.875 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:47:23.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:47:23 smithi157 bash[24585]: audit 2024-09-16T10:47:22.426269+0000 mgr.a (mgr.14373) 13417 : audit [DBG] from='client.291645 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:47:23.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:47:23 smithi086 bash[24289]: audit 2024-09-16T10:47:22.426269+0000 mgr.a (mgr.14373) 13417 : audit [DBG] from='client.291645 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:47:23.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:47:23 smithi047 bash[22744]: audit 2024-09-16T10:47:22.426269+0000 mgr.a (mgr.14373) 13417 : audit [DBG] from='client.291645 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:47:24.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:47:24 smithi157 bash[24585]: cluster 2024-09-16T10:47:23.026178+0000 mgr.a (mgr.14373) 13418 : cluster [DBG] pgmap v9305: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:47:24.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:47:24 smithi086 bash[24289]: cluster 2024-09-16T10:47:23.026178+0000 mgr.a (mgr.14373) 13418 : cluster [DBG] pgmap v9305: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:47:24.594 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:47:24 smithi047 bash[22744]: cluster 2024-09-16T10:47:23.026178+0000 mgr.a (mgr.14373) 13418 : cluster [DBG] pgmap v9305: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:47:26.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:47:26 smithi157 bash[24585]: cluster 2024-09-16T10:47:25.026962+0000 mgr.a (mgr.14373) 13419 : cluster [DBG] pgmap v9306: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T10:47:26.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:47:26 smithi086 bash[24289]: cluster 2024-09-16T10:47:25.026962+0000 mgr.a (mgr.14373) 13419 : cluster [DBG] pgmap v9306: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T10:47:26.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:47:26 smithi047 bash[22744]: cluster 2024-09-16T10:47:25.026962+0000 mgr.a (mgr.14373) 13419 : cluster [DBG] pgmap v9306: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T10:47:27.876 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:47:27.877 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:47:27.877 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:47:28.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:47:28 smithi157 bash[24585]: cluster 2024-09-16T10:47:27.028889+0000 mgr.a (mgr.14373) 13420 : cluster [DBG] pgmap v9307: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:47:28.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:47:28 smithi086 bash[24289]: cluster 2024-09-16T10:47:27.028889+0000 mgr.a (mgr.14373) 13420 : cluster [DBG] pgmap v9307: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:47:28.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:47:28 smithi047 bash[22744]: cluster 2024-09-16T10:47:27.028889+0000 mgr.a (mgr.14373) 13420 : cluster [DBG] pgmap v9307: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:47:28.664 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:47:28.664 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:47:28.664 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:47:28.664 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:47:28.664 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:47:29.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:47:29 smithi157 bash[24585]: audit 2024-09-16T10:47:28.207284+0000 mgr.a (mgr.14373) 13421 : audit [DBG] from='client.291723 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:47:29.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:47:29 smithi086 bash[24289]: audit 2024-09-16T10:47:28.207284+0000 mgr.a (mgr.14373) 13421 : audit [DBG] from='client.291723 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:47:29.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:47:29 smithi047 bash[22744]: audit 2024-09-16T10:47:28.207284+0000 mgr.a (mgr.14373) 13421 : audit [DBG] from='client.291723 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:47:30.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:47:30 smithi157 bash[24585]: cluster 2024-09-16T10:47:29.029870+0000 mgr.a (mgr.14373) 13422 : cluster [DBG] pgmap v9308: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:47:30.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:47:30 smithi086 bash[24289]: cluster 2024-09-16T10:47:29.029870+0000 mgr.a (mgr.14373) 13422 : cluster [DBG] pgmap v9308: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:47:30.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:47:30 smithi047 bash[22744]: cluster 2024-09-16T10:47:29.029870+0000 mgr.a (mgr.14373) 13422 : cluster [DBG] pgmap v9308: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:47:32.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:47:32 smithi157 bash[24585]: cluster 2024-09-16T10:47:31.030694+0000 mgr.a (mgr.14373) 13423 : cluster [DBG] pgmap v9309: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:47:32.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:47:32 smithi086 bash[24289]: cluster 2024-09-16T10:47:31.030694+0000 mgr.a (mgr.14373) 13423 : cluster [DBG] pgmap v9309: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:47:32.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:47:32 smithi047 bash[22744]: cluster 2024-09-16T10:47:31.030694+0000 mgr.a (mgr.14373) 13423 : cluster [DBG] pgmap v9309: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:47:33.665 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:47:33.666 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:47:33.666 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:47:34.401 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:47:34.401 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:47:34.401 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:47:34.401 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:47:34.401 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:47:34.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:47:34 smithi157 bash[24585]: cluster 2024-09-16T10:47:33.032914+0000 mgr.a (mgr.14373) 13424 : cluster [DBG] pgmap v9310: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:47:34.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:47:34 smithi086 bash[24289]: cluster 2024-09-16T10:47:33.032914+0000 mgr.a (mgr.14373) 13424 : cluster [DBG] pgmap v9310: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:47:34.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:47:34 smithi047 bash[22744]: cluster 2024-09-16T10:47:33.032914+0000 mgr.a (mgr.14373) 13424 : cluster [DBG] pgmap v9310: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:47:35.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:47:35 smithi157 bash[24585]: audit 2024-09-16T10:47:33.988264+0000 mgr.a (mgr.14373) 13425 : audit [DBG] from='client.291801 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:47:35.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:47:35 smithi086 bash[24289]: audit 2024-09-16T10:47:33.988264+0000 mgr.a (mgr.14373) 13425 : audit [DBG] from='client.291801 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:47:35.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:47:35 smithi047 bash[22744]: audit 2024-09-16T10:47:33.988264+0000 mgr.a (mgr.14373) 13425 : audit [DBG] from='client.291801 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:47:36.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:47:36 smithi157 bash[24585]: cluster 2024-09-16T10:47:35.033907+0000 mgr.a (mgr.14373) 13426 : cluster [DBG] pgmap v9311: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:47:36.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:47:36 smithi086 bash[24289]: cluster 2024-09-16T10:47:35.033907+0000 mgr.a (mgr.14373) 13426 : cluster [DBG] pgmap v9311: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:47:36.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:47:36 smithi047 bash[22744]: cluster 2024-09-16T10:47:35.033907+0000 mgr.a (mgr.14373) 13426 : cluster [DBG] pgmap v9311: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:47:38.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:47:38 smithi157 bash[24585]: cluster 2024-09-16T10:47:37.036089+0000 mgr.a (mgr.14373) 13427 : cluster [DBG] pgmap v9312: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:47:38.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:47:38 smithi086 bash[24289]: cluster 2024-09-16T10:47:37.036089+0000 mgr.a (mgr.14373) 13427 : cluster [DBG] pgmap v9312: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:47:38.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:47:38 smithi047 bash[22744]: cluster 2024-09-16T10:47:37.036089+0000 mgr.a (mgr.14373) 13427 : cluster [DBG] pgmap v9312: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:47:39.402 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:47:39.403 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:47:39.403 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:47:40.154 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:47:40.154 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:47:40.155 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:47:40.155 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:47:40.155 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:47:40.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:47:40 smithi157 bash[24585]: cluster 2024-09-16T10:47:39.036844+0000 mgr.a (mgr.14373) 13428 : cluster [DBG] pgmap v9313: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:47:40.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:47:40 smithi086 bash[24289]: cluster 2024-09-16T10:47:39.036844+0000 mgr.a (mgr.14373) 13428 : cluster [DBG] pgmap v9313: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:47:40.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:47:40 smithi047 bash[22744]: cluster 2024-09-16T10:47:39.036844+0000 mgr.a (mgr.14373) 13428 : cluster [DBG] pgmap v9313: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:47:41.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:47:41 smithi157 bash[24585]: audit 2024-09-16T10:47:39.726040+0000 mgr.a (mgr.14373) 13429 : audit [DBG] from='client.291876 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:47:41.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:47:41 smithi086 bash[24289]: audit 2024-09-16T10:47:39.726040+0000 mgr.a (mgr.14373) 13429 : audit [DBG] from='client.291876 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:47:41.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:47:41 smithi047 bash[22744]: audit 2024-09-16T10:47:39.726040+0000 mgr.a (mgr.14373) 13429 : audit [DBG] from='client.291876 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:47:42.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:47:42 smithi157 bash[24585]: cluster 2024-09-16T10:47:41.037789+0000 mgr.a (mgr.14373) 13430 : cluster [DBG] pgmap v9314: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:47:42.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:47:42 smithi086 bash[24289]: cluster 2024-09-16T10:47:41.037789+0000 mgr.a (mgr.14373) 13430 : cluster [DBG] pgmap v9314: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:47:42.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:47:42 smithi047 bash[22744]: cluster 2024-09-16T10:47:41.037789+0000 mgr.a (mgr.14373) 13430 : cluster [DBG] pgmap v9314: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:47:44.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:47:44 smithi157 bash[24585]: cluster 2024-09-16T10:47:43.040028+0000 mgr.a (mgr.14373) 13431 : cluster [DBG] pgmap v9315: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:47:44.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:47:44 smithi086 bash[24289]: cluster 2024-09-16T10:47:43.040028+0000 mgr.a (mgr.14373) 13431 : cluster [DBG] pgmap v9315: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:47:44.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:47:44 smithi047 bash[22744]: cluster 2024-09-16T10:47:43.040028+0000 mgr.a (mgr.14373) 13431 : cluster [DBG] pgmap v9315: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:47:45.156 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:47:45.156 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:47:45.156 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:47:45.904 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:47:45.904 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:47:45.905 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:47:45.905 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:47:45.905 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:47:46.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:47:46 smithi157 bash[24585]: cluster 2024-09-16T10:47:45.040809+0000 mgr.a (mgr.14373) 13432 : cluster [DBG] pgmap v9316: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:47:46.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:47:46 smithi157 bash[24585]: audit 2024-09-16T10:47:45.485169+0000 mgr.a (mgr.14373) 13433 : audit [DBG] from='client.291954 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:47:46.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:47:46 smithi086 bash[24289]: cluster 2024-09-16T10:47:45.040809+0000 mgr.a (mgr.14373) 13432 : cluster [DBG] pgmap v9316: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:47:46.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:47:46 smithi086 bash[24289]: audit 2024-09-16T10:47:45.485169+0000 mgr.a (mgr.14373) 13433 : audit [DBG] from='client.291954 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:47:46.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:47:46 smithi047 bash[22744]: cluster 2024-09-16T10:47:45.040809+0000 mgr.a (mgr.14373) 13432 : cluster [DBG] pgmap v9316: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:47:46.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:47:46 smithi047 bash[22744]: audit 2024-09-16T10:47:45.485169+0000 mgr.a (mgr.14373) 13433 : audit [DBG] from='client.291954 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:47:48.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:47:48 smithi157 bash[24585]: cluster 2024-09-16T10:47:47.043097+0000 mgr.a (mgr.14373) 13434 : cluster [DBG] pgmap v9317: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:47:48.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:47:48 smithi086 bash[24289]: cluster 2024-09-16T10:47:47.043097+0000 mgr.a (mgr.14373) 13434 : cluster [DBG] pgmap v9317: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:47:48.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:47:48 smithi047 bash[22744]: cluster 2024-09-16T10:47:47.043097+0000 mgr.a (mgr.14373) 13434 : cluster [DBG] pgmap v9317: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:47:50.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:47:50 smithi157 bash[24585]: cluster 2024-09-16T10:47:49.043862+0000 mgr.a (mgr.14373) 13435 : cluster [DBG] pgmap v9318: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:47:50.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:47:50 smithi086 bash[24289]: cluster 2024-09-16T10:47:49.043862+0000 mgr.a (mgr.14373) 13435 : cluster [DBG] pgmap v9318: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:47:50.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:47:50 smithi047 bash[22744]: cluster 2024-09-16T10:47:49.043862+0000 mgr.a (mgr.14373) 13435 : cluster [DBG] pgmap v9318: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:47:50.906 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:47:50.906 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:47:50.907 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:47:51.685 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:47:51.686 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:47:51.686 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:47:51.686 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:47:51.686 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:47:52.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:47:52 smithi157 bash[24585]: cluster 2024-09-16T10:47:51.044592+0000 mgr.a (mgr.14373) 13436 : cluster [DBG] pgmap v9319: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:47:52.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:47:52 smithi157 bash[24585]: audit 2024-09-16T10:47:51.243186+0000 mgr.a (mgr.14373) 13437 : audit [DBG] from='client.292026 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:47:52.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:47:52 smithi086 bash[24289]: cluster 2024-09-16T10:47:51.044592+0000 mgr.a (mgr.14373) 13436 : cluster [DBG] pgmap v9319: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:47:52.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:47:52 smithi086 bash[24289]: audit 2024-09-16T10:47:51.243186+0000 mgr.a (mgr.14373) 13437 : audit [DBG] from='client.292026 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:47:52.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:47:52 smithi047 bash[22744]: cluster 2024-09-16T10:47:51.044592+0000 mgr.a (mgr.14373) 13436 : cluster [DBG] pgmap v9319: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:47:52.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:47:52 smithi047 bash[22744]: audit 2024-09-16T10:47:51.243186+0000 mgr.a (mgr.14373) 13437 : audit [DBG] from='client.292026 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:47:54.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:47:54 smithi157 bash[24585]: cluster 2024-09-16T10:47:53.047017+0000 mgr.a (mgr.14373) 13438 : cluster [DBG] pgmap v9320: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-16T10:47:54.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:47:54 smithi086 bash[24289]: cluster 2024-09-16T10:47:53.047017+0000 mgr.a (mgr.14373) 13438 : cluster [DBG] pgmap v9320: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-16T10:47:54.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:47:54 smithi047 bash[22744]: cluster 2024-09-16T10:47:53.047017+0000 mgr.a (mgr.14373) 13438 : cluster [DBG] pgmap v9320: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-16T10:47:56.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:47:56 smithi157 bash[24585]: cluster 2024-09-16T10:47:55.047823+0000 mgr.a (mgr.14373) 13439 : cluster [DBG] pgmap v9321: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T10:47:56.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:47:56 smithi086 bash[24289]: cluster 2024-09-16T10:47:55.047823+0000 mgr.a (mgr.14373) 13439 : cluster [DBG] pgmap v9321: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T10:47:56.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:47:56 smithi047 bash[22744]: cluster 2024-09-16T10:47:55.047823+0000 mgr.a (mgr.14373) 13439 : cluster [DBG] pgmap v9321: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T10:47:56.687 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:47:56.688 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:47:56.688 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:47:57.466 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:47:57.466 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:47:57.466 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:47:57.466 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:47:57.466 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:47:58.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:47:58 smithi157 bash[24585]: audit 2024-09-16T10:47:57.024701+0000 mgr.a (mgr.14373) 13440 : audit [DBG] from='client.292104 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:47:58.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:47:58 smithi157 bash[24585]: cluster 2024-09-16T10:47:57.050804+0000 mgr.a (mgr.14373) 13441 : cluster [DBG] pgmap v9322: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:47:58.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:47:58 smithi086 bash[24289]: audit 2024-09-16T10:47:57.024701+0000 mgr.a (mgr.14373) 13440 : audit [DBG] from='client.292104 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:47:58.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:47:58 smithi086 bash[24289]: cluster 2024-09-16T10:47:57.050804+0000 mgr.a (mgr.14373) 13441 : cluster [DBG] pgmap v9322: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:47:58.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:47:58 smithi047 bash[22744]: audit 2024-09-16T10:47:57.024701+0000 mgr.a (mgr.14373) 13440 : audit [DBG] from='client.292104 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:47:58.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:47:58 smithi047 bash[22744]: cluster 2024-09-16T10:47:57.050804+0000 mgr.a (mgr.14373) 13441 : cluster [DBG] pgmap v9322: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:48:00.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:48:00 smithi157 bash[24585]: cluster 2024-09-16T10:47:59.051746+0000 mgr.a (mgr.14373) 13442 : cluster [DBG] pgmap v9323: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:48:00.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:48:00 smithi086 bash[24289]: cluster 2024-09-16T10:47:59.051746+0000 mgr.a (mgr.14373) 13442 : cluster [DBG] pgmap v9323: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:48:00.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:48:00 smithi047 bash[22744]: cluster 2024-09-16T10:47:59.051746+0000 mgr.a (mgr.14373) 13442 : cluster [DBG] pgmap v9323: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:48:02.467 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:48:02.468 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:48:02.468 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:48:02.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:48:02 smithi157 bash[24585]: cluster 2024-09-16T10:48:01.052576+0000 mgr.a (mgr.14373) 13443 : cluster [DBG] pgmap v9324: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:48:02.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:48:02 smithi086 bash[24289]: cluster 2024-09-16T10:48:01.052576+0000 mgr.a (mgr.14373) 13443 : cluster [DBG] pgmap v9324: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:48:02.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:48:02 smithi047 bash[22744]: cluster 2024-09-16T10:48:01.052576+0000 mgr.a (mgr.14373) 13443 : cluster [DBG] pgmap v9324: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:48:03.238 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:48:03.239 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:48:03.239 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:48:03.239 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:48:03.239 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:48:04.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:48:04 smithi157 bash[24585]: audit 2024-09-16T10:48:02.803619+0000 mgr.a (mgr.14373) 13444 : audit [DBG] from='client.292182 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:48:04.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:48:04 smithi157 bash[24585]: cluster 2024-09-16T10:48:03.053982+0000 mgr.a (mgr.14373) 13445 : cluster [DBG] pgmap v9325: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:48:04.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:48:04 smithi086 bash[24289]: audit 2024-09-16T10:48:02.803619+0000 mgr.a (mgr.14373) 13444 : audit [DBG] from='client.292182 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:48:04.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:48:04 smithi086 bash[24289]: cluster 2024-09-16T10:48:03.053982+0000 mgr.a (mgr.14373) 13445 : cluster [DBG] pgmap v9325: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:48:04.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:48:04 smithi047 bash[22744]: audit 2024-09-16T10:48:02.803619+0000 mgr.a (mgr.14373) 13444 : audit [DBG] from='client.292182 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:48:04.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:48:04 smithi047 bash[22744]: cluster 2024-09-16T10:48:03.053982+0000 mgr.a (mgr.14373) 13445 : cluster [DBG] pgmap v9325: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:48:06.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:48:06 smithi157 bash[24585]: cluster 2024-09-16T10:48:05.054873+0000 mgr.a (mgr.14373) 13446 : cluster [DBG] pgmap v9326: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-16T10:48:06.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:48:06 smithi086 bash[24289]: cluster 2024-09-16T10:48:05.054873+0000 mgr.a (mgr.14373) 13446 : cluster [DBG] pgmap v9326: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-16T10:48:06.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:48:06 smithi047 bash[22744]: cluster 2024-09-16T10:48:05.054873+0000 mgr.a (mgr.14373) 13446 : cluster [DBG] pgmap v9326: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-16T10:48:08.240 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:48:08.241 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:48:08.241 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:48:08.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:48:08 smithi157 bash[24585]: cluster 2024-09-16T10:48:07.057073+0000 mgr.a (mgr.14373) 13447 : cluster [DBG] pgmap v9327: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 6.2 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-16T10:48:08.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:48:08 smithi086 bash[24289]: cluster 2024-09-16T10:48:07.057073+0000 mgr.a (mgr.14373) 13447 : cluster [DBG] pgmap v9327: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 6.2 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-16T10:48:08.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:48:08 smithi047 bash[22744]: cluster 2024-09-16T10:48:07.057073+0000 mgr.a (mgr.14373) 13447 : cluster [DBG] pgmap v9327: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 6.2 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-16T10:48:08.986 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:48:08.987 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:48:08.987 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:48:08.987 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:48:08.987 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:48:09.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:48:09 smithi157 bash[24585]: audit 2024-09-16T10:48:08.572752+0000 mgr.a (mgr.14373) 13448 : audit [DBG] from='client.292260 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:48:09.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:48:09 smithi086 bash[24289]: audit 2024-09-16T10:48:08.572752+0000 mgr.a (mgr.14373) 13448 : audit [DBG] from='client.292260 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:48:09.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:48:09 smithi047 bash[22744]: audit 2024-09-16T10:48:08.572752+0000 mgr.a (mgr.14373) 13448 : audit [DBG] from='client.292260 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:48:10.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:48:10 smithi157 bash[24585]: cluster 2024-09-16T10:48:09.058065+0000 mgr.a (mgr.14373) 13449 : cluster [DBG] pgmap v9328: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-16T10:48:10.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:48:10 smithi086 bash[24289]: cluster 2024-09-16T10:48:09.058065+0000 mgr.a (mgr.14373) 13449 : cluster [DBG] pgmap v9328: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-16T10:48:10.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:48:10 smithi047 bash[22744]: cluster 2024-09-16T10:48:09.058065+0000 mgr.a (mgr.14373) 13449 : cluster [DBG] pgmap v9328: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-16T10:48:12.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:48:11 smithi157 bash[24585]: cluster 2024-09-16T10:48:11.058888+0000 mgr.a (mgr.14373) 13450 : cluster [DBG] pgmap v9329: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-16T10:48:12.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:48:11 smithi086 bash[24289]: cluster 2024-09-16T10:48:11.058888+0000 mgr.a (mgr.14373) 13450 : cluster [DBG] pgmap v9329: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-16T10:48:12.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:48:11 smithi047 bash[22744]: cluster 2024-09-16T10:48:11.058888+0000 mgr.a (mgr.14373) 13450 : cluster [DBG] pgmap v9329: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-16T10:48:13.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:48:13 smithi157 bash[24585]: audit 2024-09-16T10:48:12.951883+0000 mon.b (mon.2) 1230 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T10:48:13.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:48:13 smithi086 bash[24289]: audit 2024-09-16T10:48:12.951883+0000 mon.b (mon.2) 1230 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T10:48:13.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:48:13 smithi047 bash[22744]: audit 2024-09-16T10:48:12.951883+0000 mon.b (mon.2) 1230 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T10:48:13.988 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:48:13.989 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:48:13.989 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:48:14.719 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:48:14.719 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:48:14.719 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:48:14.720 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:48:14.720 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:48:14.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:48:14 smithi047 bash[22744]: cluster 2024-09-16T10:48:13.060139+0000 mgr.a (mgr.14373) 13451 : cluster [DBG] pgmap v9330: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-16T10:48:14.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:48:14 smithi047 bash[22744]: audit 2024-09-16T10:48:13.578442+0000 mon.a (mon.0) 1372 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:48:14.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:48:14 smithi047 bash[22744]: audit 2024-09-16T10:48:13.584601+0000 mon.a (mon.0) 1373 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:48:14.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:48:14 smithi047 bash[22744]: audit 2024-09-16T10:48:14.400169+0000 mon.b (mon.2) 1231 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T10:48:14.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:48:14 smithi047 bash[22744]: audit 2024-09-16T10:48:14.401446+0000 mon.b (mon.2) 1232 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T10:48:14.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:48:14 smithi047 bash[22744]: audit 2024-09-16T10:48:14.408148+0000 mon.a (mon.0) 1374 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:48:14.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:48:14 smithi047 bash[22744]: audit 2024-09-16T10:48:14.415182+0000 mon.b (mon.2) 1233 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:48:15.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:48:14 smithi157 bash[24585]: cluster 2024-09-16T10:48:13.060139+0000 mgr.a (mgr.14373) 13451 : cluster [DBG] pgmap v9330: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-16T10:48:15.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:48:14 smithi157 bash[24585]: audit 2024-09-16T10:48:13.578442+0000 mon.a (mon.0) 1372 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:48:15.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:48:14 smithi157 bash[24585]: audit 2024-09-16T10:48:13.584601+0000 mon.a (mon.0) 1373 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:48:15.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:48:14 smithi157 bash[24585]: audit 2024-09-16T10:48:14.400169+0000 mon.b (mon.2) 1231 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T10:48:15.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:48:14 smithi157 bash[24585]: audit 2024-09-16T10:48:14.401446+0000 mon.b (mon.2) 1232 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T10:48:15.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:48:14 smithi157 bash[24585]: audit 2024-09-16T10:48:14.408148+0000 mon.a (mon.0) 1374 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:48:15.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:48:14 smithi157 bash[24585]: audit 2024-09-16T10:48:14.415182+0000 mon.b (mon.2) 1233 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:48:15.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:48:14 smithi086 bash[24289]: cluster 2024-09-16T10:48:13.060139+0000 mgr.a (mgr.14373) 13451 : cluster [DBG] pgmap v9330: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-16T10:48:15.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:48:14 smithi086 bash[24289]: audit 2024-09-16T10:48:13.578442+0000 mon.a (mon.0) 1372 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:48:15.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:48:14 smithi086 bash[24289]: audit 2024-09-16T10:48:13.584601+0000 mon.a (mon.0) 1373 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:48:15.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:48:14 smithi086 bash[24289]: audit 2024-09-16T10:48:14.400169+0000 mon.b (mon.2) 1231 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T10:48:15.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:48:14 smithi086 bash[24289]: audit 2024-09-16T10:48:14.401446+0000 mon.b (mon.2) 1232 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T10:48:15.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:48:14 smithi086 bash[24289]: audit 2024-09-16T10:48:14.408148+0000 mon.a (mon.0) 1374 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:48:15.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:48:14 smithi086 bash[24289]: audit 2024-09-16T10:48:14.415182+0000 mon.b (mon.2) 1233 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:48:15.842 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 10:48:15 smithi047 bash[22994]: debug 2024-09-16T10:48:15.415+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T10:48:15.843 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 10:48:15 smithi047 bash[22994]: debug 2024-09-16T10:48:15.415+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T10:48:15.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:48:15 smithi047 bash[22744]: audit 2024-09-16T10:48:14.311474+0000 mgr.a (mgr.14373) 13452 : audit [DBG] from='client.292332 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:48:15.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:48:15 smithi047 bash[22744]: audit 2024-09-16T10:48:14.416740+0000 mgr.a (mgr.14373) 13453 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:48:16.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:48:15 smithi157 bash[24585]: audit 2024-09-16T10:48:14.311474+0000 mgr.a (mgr.14373) 13452 : audit [DBG] from='client.292332 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:48:16.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:48:15 smithi157 bash[24585]: audit 2024-09-16T10:48:14.416740+0000 mgr.a (mgr.14373) 13453 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:48:16.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:48:15 smithi086 bash[24289]: audit 2024-09-16T10:48:14.311474+0000 mgr.a (mgr.14373) 13452 : audit [DBG] from='client.292332 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:48:16.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:48:15 smithi086 bash[24289]: audit 2024-09-16T10:48:14.416740+0000 mgr.a (mgr.14373) 13453 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:48:16.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:48:16 smithi047 bash[22744]: cluster 2024-09-16T10:48:15.060921+0000 mgr.a (mgr.14373) 13454 : cluster [DBG] pgmap v9331: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-16T10:48:16.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:48:16 smithi047 bash[22744]: audit 2024-09-16T10:48:15.419046+0000 mgr.a (mgr.14373) 13455 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T10:48:16.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:48:16 smithi047 bash[22744]: cephadm 2024-09-16T10:48:15.421578+0000 mgr.a (mgr.14373) 13456 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T10:48:17.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:48:16 smithi157 bash[24585]: cluster 2024-09-16T10:48:15.060921+0000 mgr.a (mgr.14373) 13454 : cluster [DBG] pgmap v9331: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-16T10:48:17.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:48:16 smithi157 bash[24585]: audit 2024-09-16T10:48:15.419046+0000 mgr.a (mgr.14373) 13455 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T10:48:17.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:48:16 smithi157 bash[24585]: cephadm 2024-09-16T10:48:15.421578+0000 mgr.a (mgr.14373) 13456 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T10:48:17.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:48:16 smithi086 bash[24289]: cluster 2024-09-16T10:48:15.060921+0000 mgr.a (mgr.14373) 13454 : cluster [DBG] pgmap v9331: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-16T10:48:17.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:48:16 smithi086 bash[24289]: audit 2024-09-16T10:48:15.419046+0000 mgr.a (mgr.14373) 13455 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T10:48:17.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:48:16 smithi086 bash[24289]: cephadm 2024-09-16T10:48:15.421578+0000 mgr.a (mgr.14373) 13456 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T10:48:19.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:48:18 smithi157 bash[24585]: cluster 2024-09-16T10:48:17.063234+0000 mgr.a (mgr.14373) 13457 : cluster [DBG] pgmap v9332: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 12 KiB/s rd, 426 B/s wr, 14 op/s 2024-09-16T10:48:19.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:48:18 smithi086 bash[24289]: cluster 2024-09-16T10:48:17.063234+0000 mgr.a (mgr.14373) 13457 : cluster [DBG] pgmap v9332: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 12 KiB/s rd, 426 B/s wr, 14 op/s 2024-09-16T10:48:19.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:48:18 smithi047 bash[22744]: cluster 2024-09-16T10:48:17.063234+0000 mgr.a (mgr.14373) 13457 : cluster [DBG] pgmap v9332: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 12 KiB/s rd, 426 B/s wr, 14 op/s 2024-09-16T10:48:19.721 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:48:19.721 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:48:19.722 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:48:20.482 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:48:20.482 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:48:20.483 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:48:20.483 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:48:20.483 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:48:21.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:48:20 smithi157 bash[24585]: cluster 2024-09-16T10:48:19.064041+0000 mgr.a (mgr.14373) 13458 : cluster [DBG] pgmap v9333: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:48:21.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:48:20 smithi086 bash[24289]: cluster 2024-09-16T10:48:19.064041+0000 mgr.a (mgr.14373) 13458 : cluster [DBG] pgmap v9333: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:48:21.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:48:20 smithi047 bash[22744]: cluster 2024-09-16T10:48:19.064041+0000 mgr.a (mgr.14373) 13458 : cluster [DBG] pgmap v9333: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:48:22.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:48:21 smithi157 bash[24585]: audit 2024-09-16T10:48:20.060612+0000 mgr.a (mgr.14373) 13459 : audit [DBG] from='client.292512 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:48:22.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:48:21 smithi086 bash[24289]: audit 2024-09-16T10:48:20.060612+0000 mgr.a (mgr.14373) 13459 : audit [DBG] from='client.292512 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:48:22.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:48:21 smithi047 bash[22744]: audit 2024-09-16T10:48:20.060612+0000 mgr.a (mgr.14373) 13459 : audit [DBG] from='client.292512 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:48:23.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:48:22 smithi157 bash[24585]: cluster 2024-09-16T10:48:21.064962+0000 mgr.a (mgr.14373) 13460 : cluster [DBG] pgmap v9334: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:48:23.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:48:22 smithi086 bash[24289]: cluster 2024-09-16T10:48:21.064962+0000 mgr.a (mgr.14373) 13460 : cluster [DBG] pgmap v9334: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:48:23.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:48:22 smithi047 bash[22744]: cluster 2024-09-16T10:48:21.064962+0000 mgr.a (mgr.14373) 13460 : cluster [DBG] pgmap v9334: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:48:25.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:48:24 smithi157 bash[24585]: cluster 2024-09-16T10:48:23.067271+0000 mgr.a (mgr.14373) 13461 : cluster [DBG] pgmap v9335: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:48:25.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:48:24 smithi086 bash[24289]: cluster 2024-09-16T10:48:23.067271+0000 mgr.a (mgr.14373) 13461 : cluster [DBG] pgmap v9335: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:48:25.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:48:24 smithi047 bash[22744]: cluster 2024-09-16T10:48:23.067271+0000 mgr.a (mgr.14373) 13461 : cluster [DBG] pgmap v9335: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:48:25.484 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:48:25.485 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:48:25.485 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:48:26.271 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:48:26.271 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:48:26.271 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:48:26.271 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:48:26.271 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:48:27.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:48:26 smithi157 bash[24585]: cluster 2024-09-16T10:48:25.068054+0000 mgr.a (mgr.14373) 13462 : cluster [DBG] pgmap v9336: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:48:27.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:48:26 smithi086 bash[24289]: cluster 2024-09-16T10:48:25.068054+0000 mgr.a (mgr.14373) 13462 : cluster [DBG] pgmap v9336: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:48:27.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:48:26 smithi047 bash[22744]: cluster 2024-09-16T10:48:25.068054+0000 mgr.a (mgr.14373) 13462 : cluster [DBG] pgmap v9336: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:48:28.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:48:27 smithi157 bash[24585]: audit 2024-09-16T10:48:25.824658+0000 mgr.a (mgr.14373) 13463 : audit [DBG] from='client.292587 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:48:28.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:48:27 smithi086 bash[24289]: audit 2024-09-16T10:48:25.824658+0000 mgr.a (mgr.14373) 13463 : audit [DBG] from='client.292587 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:48:28.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:48:27 smithi047 bash[22744]: audit 2024-09-16T10:48:25.824658+0000 mgr.a (mgr.14373) 13463 : audit [DBG] from='client.292587 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:48:29.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:48:28 smithi157 bash[24585]: cluster 2024-09-16T10:48:27.070485+0000 mgr.a (mgr.14373) 13464 : cluster [DBG] pgmap v9337: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:48:29.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:48:28 smithi086 bash[24289]: cluster 2024-09-16T10:48:27.070485+0000 mgr.a (mgr.14373) 13464 : cluster [DBG] pgmap v9337: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:48:29.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:48:28 smithi047 bash[22744]: cluster 2024-09-16T10:48:27.070485+0000 mgr.a (mgr.14373) 13464 : cluster [DBG] pgmap v9337: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:48:31.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:48:30 smithi157 bash[24585]: cluster 2024-09-16T10:48:29.071427+0000 mgr.a (mgr.14373) 13465 : cluster [DBG] pgmap v9338: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:48:31.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:48:30 smithi086 bash[24289]: cluster 2024-09-16T10:48:29.071427+0000 mgr.a (mgr.14373) 13465 : cluster [DBG] pgmap v9338: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:48:31.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:48:30 smithi047 bash[22744]: cluster 2024-09-16T10:48:29.071427+0000 mgr.a (mgr.14373) 13465 : cluster [DBG] pgmap v9338: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:48:31.272 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:48:31.273 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:48:31.273 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:48:32.040 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:48:32.040 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:48:32.040 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:48:32.040 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:48:32.040 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:48:33.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:48:32 smithi157 bash[24585]: cluster 2024-09-16T10:48:31.072393+0000 mgr.a (mgr.14373) 13466 : cluster [DBG] pgmap v9339: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:48:33.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:48:32 smithi157 bash[24585]: audit 2024-09-16T10:48:31.606290+0000 mgr.a (mgr.14373) 13467 : audit [DBG] from='client.292665 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:48:33.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:48:32 smithi086 bash[24289]: cluster 2024-09-16T10:48:31.072393+0000 mgr.a (mgr.14373) 13466 : cluster [DBG] pgmap v9339: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:48:33.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:48:32 smithi086 bash[24289]: audit 2024-09-16T10:48:31.606290+0000 mgr.a (mgr.14373) 13467 : audit [DBG] from='client.292665 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:48:33.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:48:32 smithi047 bash[22744]: cluster 2024-09-16T10:48:31.072393+0000 mgr.a (mgr.14373) 13466 : cluster [DBG] pgmap v9339: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:48:33.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:48:32 smithi047 bash[22744]: audit 2024-09-16T10:48:31.606290+0000 mgr.a (mgr.14373) 13467 : audit [DBG] from='client.292665 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:48:35.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:48:34 smithi157 bash[24585]: cluster 2024-09-16T10:48:33.075271+0000 mgr.a (mgr.14373) 13468 : cluster [DBG] pgmap v9340: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 65 KiB/s rd, 0 B/s wr, 107 op/s 2024-09-16T10:48:35.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:48:34 smithi086 bash[24289]: cluster 2024-09-16T10:48:33.075271+0000 mgr.a (mgr.14373) 13468 : cluster [DBG] pgmap v9340: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 65 KiB/s rd, 0 B/s wr, 107 op/s 2024-09-16T10:48:35.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:48:34 smithi047 bash[22744]: cluster 2024-09-16T10:48:33.075271+0000 mgr.a (mgr.14373) 13468 : cluster [DBG] pgmap v9340: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 65 KiB/s rd, 0 B/s wr, 107 op/s 2024-09-16T10:48:37.041 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:48:37.042 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:48:37.042 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:48:37.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:48:36 smithi157 bash[24585]: cluster 2024-09-16T10:48:35.076265+0000 mgr.a (mgr.14373) 13469 : cluster [DBG] pgmap v9341: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 64 KiB/s rd, 0 B/s wr, 106 op/s 2024-09-16T10:48:37.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:48:36 smithi086 bash[24289]: cluster 2024-09-16T10:48:35.076265+0000 mgr.a (mgr.14373) 13469 : cluster [DBG] pgmap v9341: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 64 KiB/s rd, 0 B/s wr, 106 op/s 2024-09-16T10:48:37.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:48:36 smithi047 bash[22744]: cluster 2024-09-16T10:48:35.076265+0000 mgr.a (mgr.14373) 13469 : cluster [DBG] pgmap v9341: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 64 KiB/s rd, 0 B/s wr, 106 op/s 2024-09-16T10:48:37.835 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:48:37.835 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:48:37.835 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:48:37.835 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:48:37.835 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:48:39.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:48:38 smithi157 bash[24585]: cluster 2024-09-16T10:48:37.077701+0000 mgr.a (mgr.14373) 13470 : cluster [DBG] pgmap v9342: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 65 KiB/s rd, 0 B/s wr, 107 op/s 2024-09-16T10:48:39.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:48:38 smithi157 bash[24585]: audit 2024-09-16T10:48:37.378228+0000 mgr.a (mgr.14373) 13471 : audit [DBG] from='client.292743 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:48:39.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:48:38 smithi086 bash[24289]: cluster 2024-09-16T10:48:37.077701+0000 mgr.a (mgr.14373) 13470 : cluster [DBG] pgmap v9342: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 65 KiB/s rd, 0 B/s wr, 107 op/s 2024-09-16T10:48:39.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:48:38 smithi086 bash[24289]: audit 2024-09-16T10:48:37.378228+0000 mgr.a (mgr.14373) 13471 : audit [DBG] from='client.292743 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:48:39.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:48:38 smithi047 bash[22744]: cluster 2024-09-16T10:48:37.077701+0000 mgr.a (mgr.14373) 13470 : cluster [DBG] pgmap v9342: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 65 KiB/s rd, 0 B/s wr, 107 op/s 2024-09-16T10:48:39.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:48:38 smithi047 bash[22744]: audit 2024-09-16T10:48:37.378228+0000 mgr.a (mgr.14373) 13471 : audit [DBG] from='client.292743 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:48:40.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:48:39 smithi157 bash[24585]: cluster 2024-09-16T10:48:39.078618+0000 mgr.a (mgr.14373) 13472 : cluster [DBG] pgmap v9343: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 64 KiB/s rd, 0 B/s wr, 106 op/s 2024-09-16T10:48:40.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:48:39 smithi086 bash[24289]: cluster 2024-09-16T10:48:39.078618+0000 mgr.a (mgr.14373) 13472 : cluster [DBG] pgmap v9343: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 64 KiB/s rd, 0 B/s wr, 106 op/s 2024-09-16T10:48:40.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:48:39 smithi047 bash[22744]: cluster 2024-09-16T10:48:39.078618+0000 mgr.a (mgr.14373) 13472 : cluster [DBG] pgmap v9343: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 64 KiB/s rd, 0 B/s wr, 106 op/s 2024-09-16T10:48:42.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:48:42 smithi157 bash[24585]: cluster 2024-09-16T10:48:41.079396+0000 mgr.a (mgr.14373) 13473 : cluster [DBG] pgmap v9344: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 64 KiB/s rd, 0 B/s wr, 106 op/s 2024-09-16T10:48:42.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:48:42 smithi086 bash[24289]: cluster 2024-09-16T10:48:41.079396+0000 mgr.a (mgr.14373) 13473 : cluster [DBG] pgmap v9344: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 64 KiB/s rd, 0 B/s wr, 106 op/s 2024-09-16T10:48:42.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:48:42 smithi047 bash[22744]: cluster 2024-09-16T10:48:41.079396+0000 mgr.a (mgr.14373) 13473 : cluster [DBG] pgmap v9344: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 64 KiB/s rd, 0 B/s wr, 106 op/s 2024-09-16T10:48:42.836 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:48:42.837 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:48:42.837 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:48:43.617 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:48:43.617 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:48:43.618 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:48:43.618 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:48:43.618 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:48:44.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:48:44 smithi157 bash[24585]: cluster 2024-09-16T10:48:43.080757+0000 mgr.a (mgr.14373) 13474 : cluster [DBG] pgmap v9345: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 65 KiB/s rd, 0 B/s wr, 107 op/s 2024-09-16T10:48:44.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:48:44 smithi157 bash[24585]: audit 2024-09-16T10:48:43.171511+0000 mgr.a (mgr.14373) 13475 : audit [DBG] from='client.292821 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:48:44.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:48:44 smithi086 bash[24289]: cluster 2024-09-16T10:48:43.080757+0000 mgr.a (mgr.14373) 13474 : cluster [DBG] pgmap v9345: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 65 KiB/s rd, 0 B/s wr, 107 op/s 2024-09-16T10:48:44.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:48:44 smithi086 bash[24289]: audit 2024-09-16T10:48:43.171511+0000 mgr.a (mgr.14373) 13475 : audit [DBG] from='client.292821 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:48:44.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:48:44 smithi047 bash[22744]: cluster 2024-09-16T10:48:43.080757+0000 mgr.a (mgr.14373) 13474 : cluster [DBG] pgmap v9345: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 65 KiB/s rd, 0 B/s wr, 107 op/s 2024-09-16T10:48:44.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:48:44 smithi047 bash[22744]: audit 2024-09-16T10:48:43.171511+0000 mgr.a (mgr.14373) 13475 : audit [DBG] from='client.292821 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:48:46.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:48:46 smithi157 bash[24585]: cluster 2024-09-16T10:48:45.081616+0000 mgr.a (mgr.14373) 13476 : cluster [DBG] pgmap v9346: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:48:46.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:48:46 smithi086 bash[24289]: cluster 2024-09-16T10:48:45.081616+0000 mgr.a (mgr.14373) 13476 : cluster [DBG] pgmap v9346: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:48:46.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:48:46 smithi047 bash[22744]: cluster 2024-09-16T10:48:45.081616+0000 mgr.a (mgr.14373) 13476 : cluster [DBG] pgmap v9346: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:48:48.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:48:48 smithi157 bash[24585]: cluster 2024-09-16T10:48:47.083820+0000 mgr.a (mgr.14373) 13477 : cluster [DBG] pgmap v9347: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:48:48.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:48:48 smithi086 bash[24289]: cluster 2024-09-16T10:48:47.083820+0000 mgr.a (mgr.14373) 13477 : cluster [DBG] pgmap v9347: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:48:48.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:48:48 smithi047 bash[22744]: cluster 2024-09-16T10:48:47.083820+0000 mgr.a (mgr.14373) 13477 : cluster [DBG] pgmap v9347: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:48:48.619 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:48:48.619 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:48:48.619 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:48:49.414 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:48:49.414 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:48:49.414 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:48:49.414 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:48:49.414 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:48:50.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:48:50 smithi157 bash[24585]: audit 2024-09-16T10:48:48.957901+0000 mgr.a (mgr.14373) 13478 : audit [DBG] from='client.292896 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:48:50.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:48:50 smithi157 bash[24585]: cluster 2024-09-16T10:48:49.084414+0000 mgr.a (mgr.14373) 13479 : cluster [DBG] pgmap v9348: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:48:50.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:48:50 smithi086 bash[24289]: audit 2024-09-16T10:48:48.957901+0000 mgr.a (mgr.14373) 13478 : audit [DBG] from='client.292896 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:48:50.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:48:50 smithi086 bash[24289]: cluster 2024-09-16T10:48:49.084414+0000 mgr.a (mgr.14373) 13479 : cluster [DBG] pgmap v9348: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:48:50.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:48:50 smithi047 bash[22744]: audit 2024-09-16T10:48:48.957901+0000 mgr.a (mgr.14373) 13478 : audit [DBG] from='client.292896 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:48:50.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:48:50 smithi047 bash[22744]: cluster 2024-09-16T10:48:49.084414+0000 mgr.a (mgr.14373) 13479 : cluster [DBG] pgmap v9348: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:48:52.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:48:52 smithi157 bash[24585]: cluster 2024-09-16T10:48:51.085280+0000 mgr.a (mgr.14373) 13480 : cluster [DBG] pgmap v9349: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:48:52.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:48:52 smithi086 bash[24289]: cluster 2024-09-16T10:48:51.085280+0000 mgr.a (mgr.14373) 13480 : cluster [DBG] pgmap v9349: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:48:52.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:48:52 smithi047 bash[22744]: cluster 2024-09-16T10:48:51.085280+0000 mgr.a (mgr.14373) 13480 : cluster [DBG] pgmap v9349: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:48:54.415 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:48:54.416 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:48:54.416 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:48:54.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:48:54 smithi157 bash[24585]: cluster 2024-09-16T10:48:53.087528+0000 mgr.a (mgr.14373) 13481 : cluster [DBG] pgmap v9350: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:48:54.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:48:54 smithi086 bash[24289]: cluster 2024-09-16T10:48:53.087528+0000 mgr.a (mgr.14373) 13481 : cluster [DBG] pgmap v9350: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:48:54.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:48:54 smithi047 bash[22744]: cluster 2024-09-16T10:48:53.087528+0000 mgr.a (mgr.14373) 13481 : cluster [DBG] pgmap v9350: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:48:55.172 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:48:55.173 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:48:55.173 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:48:55.173 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:48:55.173 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:48:56.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:48:56 smithi157 bash[24585]: audit 2024-09-16T10:48:54.742890+0000 mgr.a (mgr.14373) 13482 : audit [DBG] from='client.292974 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:48:56.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:48:56 smithi157 bash[24585]: cluster 2024-09-16T10:48:55.088425+0000 mgr.a (mgr.14373) 13483 : cluster [DBG] pgmap v9351: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:48:56.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:48:56 smithi086 bash[24289]: audit 2024-09-16T10:48:54.742890+0000 mgr.a (mgr.14373) 13482 : audit [DBG] from='client.292974 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:48:56.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:48:56 smithi086 bash[24289]: cluster 2024-09-16T10:48:55.088425+0000 mgr.a (mgr.14373) 13483 : cluster [DBG] pgmap v9351: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:48:56.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:48:56 smithi047 bash[22744]: audit 2024-09-16T10:48:54.742890+0000 mgr.a (mgr.14373) 13482 : audit [DBG] from='client.292974 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:48:56.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:48:56 smithi047 bash[22744]: cluster 2024-09-16T10:48:55.088425+0000 mgr.a (mgr.14373) 13483 : cluster [DBG] pgmap v9351: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:48:58.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:48:58 smithi157 bash[24585]: cluster 2024-09-16T10:48:57.090645+0000 mgr.a (mgr.14373) 13484 : cluster [DBG] pgmap v9352: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:48:58.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:48:58 smithi086 bash[24289]: cluster 2024-09-16T10:48:57.090645+0000 mgr.a (mgr.14373) 13484 : cluster [DBG] pgmap v9352: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:48:58.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:48:58 smithi047 bash[22744]: cluster 2024-09-16T10:48:57.090645+0000 mgr.a (mgr.14373) 13484 : cluster [DBG] pgmap v9352: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:49:00.174 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:49:00.175 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:49:00.175 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:49:00.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:49:00 smithi157 bash[24585]: cluster 2024-09-16T10:48:59.091399+0000 mgr.a (mgr.14373) 13485 : cluster [DBG] pgmap v9353: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:49:00.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:49:00 smithi086 bash[24289]: cluster 2024-09-16T10:48:59.091399+0000 mgr.a (mgr.14373) 13485 : cluster [DBG] pgmap v9353: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:49:00.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:49:00 smithi047 bash[22744]: cluster 2024-09-16T10:48:59.091399+0000 mgr.a (mgr.14373) 13485 : cluster [DBG] pgmap v9353: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:49:00.920 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:49:00.921 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:49:00.921 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:49:00.921 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:49:00.921 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:49:01.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:49:01 smithi157 bash[24585]: audit 2024-09-16T10:49:00.500781+0000 mgr.a (mgr.14373) 13486 : audit [DBG] from='client.293049 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:49:01.572 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:49:01 smithi086 bash[24289]: audit 2024-09-16T10:49:00.500781+0000 mgr.a (mgr.14373) 13486 : audit [DBG] from='client.293049 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:49:01.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:49:01 smithi047 bash[22744]: audit 2024-09-16T10:49:00.500781+0000 mgr.a (mgr.14373) 13486 : audit [DBG] from='client.293049 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:49:02.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:49:02 smithi157 bash[24585]: cluster 2024-09-16T10:49:01.092283+0000 mgr.a (mgr.14373) 13487 : cluster [DBG] pgmap v9354: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:49:02.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:49:02 smithi086 bash[24289]: cluster 2024-09-16T10:49:01.092283+0000 mgr.a (mgr.14373) 13487 : cluster [DBG] pgmap v9354: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:49:02.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:49:02 smithi047 bash[22744]: cluster 2024-09-16T10:49:01.092283+0000 mgr.a (mgr.14373) 13487 : cluster [DBG] pgmap v9354: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:49:04.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:49:04 smithi157 bash[24585]: cluster 2024-09-16T10:49:03.094542+0000 mgr.a (mgr.14373) 13488 : cluster [DBG] pgmap v9355: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:49:04.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:49:04 smithi086 bash[24289]: cluster 2024-09-16T10:49:03.094542+0000 mgr.a (mgr.14373) 13488 : cluster [DBG] pgmap v9355: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:49:04.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:49:04 smithi047 bash[22744]: cluster 2024-09-16T10:49:03.094542+0000 mgr.a (mgr.14373) 13488 : cluster [DBG] pgmap v9355: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:49:05.922 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:49:05.923 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:49:05.923 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:49:06.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:49:06 smithi157 bash[24585]: cluster 2024-09-16T10:49:05.095286+0000 mgr.a (mgr.14373) 13489 : cluster [DBG] pgmap v9356: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:49:06.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:49:06 smithi086 bash[24289]: cluster 2024-09-16T10:49:05.095286+0000 mgr.a (mgr.14373) 13489 : cluster [DBG] pgmap v9356: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:49:06.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:49:06 smithi047 bash[22744]: cluster 2024-09-16T10:49:05.095286+0000 mgr.a (mgr.14373) 13489 : cluster [DBG] pgmap v9356: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:49:06.680 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:49:06.680 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:49:06.680 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:49:06.681 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:49:06.681 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:49:07.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:49:07 smithi157 bash[24585]: audit 2024-09-16T10:49:06.254792+0000 mgr.a (mgr.14373) 13490 : audit [DBG] from='client.293118 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:49:07.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:49:07 smithi086 bash[24289]: audit 2024-09-16T10:49:06.254792+0000 mgr.a (mgr.14373) 13490 : audit [DBG] from='client.293118 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:49:07.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:49:07 smithi047 bash[22744]: audit 2024-09-16T10:49:06.254792+0000 mgr.a (mgr.14373) 13490 : audit [DBG] from='client.293118 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:49:08.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:49:08 smithi157 bash[24585]: cluster 2024-09-16T10:49:07.097576+0000 mgr.a (mgr.14373) 13491 : cluster [DBG] pgmap v9357: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-16T10:49:08.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:49:08 smithi086 bash[24289]: cluster 2024-09-16T10:49:07.097576+0000 mgr.a (mgr.14373) 13491 : cluster [DBG] pgmap v9357: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-16T10:49:08.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:49:08 smithi047 bash[22744]: cluster 2024-09-16T10:49:07.097576+0000 mgr.a (mgr.14373) 13491 : cluster [DBG] pgmap v9357: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-16T10:49:10.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:49:10 smithi157 bash[24585]: cluster 2024-09-16T10:49:09.098340+0000 mgr.a (mgr.14373) 13492 : cluster [DBG] pgmap v9358: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T10:49:10.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:49:10 smithi086 bash[24289]: cluster 2024-09-16T10:49:09.098340+0000 mgr.a (mgr.14373) 13492 : cluster [DBG] pgmap v9358: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T10:49:10.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:49:10 smithi047 bash[22744]: cluster 2024-09-16T10:49:09.098340+0000 mgr.a (mgr.14373) 13492 : cluster [DBG] pgmap v9358: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T10:49:11.682 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:49:11.682 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:49:11.683 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:49:12.445 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:49:12.446 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:49:12.446 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:49:12.446 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:49:12.446 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:49:12.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:49:12 smithi157 bash[24585]: cluster 2024-09-16T10:49:11.099117+0000 mgr.a (mgr.14373) 13493 : cluster [DBG] pgmap v9359: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T10:49:12.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:49:12 smithi086 bash[24289]: cluster 2024-09-16T10:49:11.099117+0000 mgr.a (mgr.14373) 13493 : cluster [DBG] pgmap v9359: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T10:49:12.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:49:12 smithi047 bash[22744]: cluster 2024-09-16T10:49:11.099117+0000 mgr.a (mgr.14373) 13493 : cluster [DBG] pgmap v9359: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T10:49:13.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:49:13 smithi157 bash[24585]: audit 2024-09-16T10:49:12.015008+0000 mgr.a (mgr.14373) 13494 : audit [DBG] from='client.293193 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:49:13.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:49:13 smithi086 bash[24289]: audit 2024-09-16T10:49:12.015008+0000 mgr.a (mgr.14373) 13494 : audit [DBG] from='client.293193 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:49:13.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:49:13 smithi047 bash[22744]: audit 2024-09-16T10:49:12.015008+0000 mgr.a (mgr.14373) 13494 : audit [DBG] from='client.293193 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:49:14.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:49:14 smithi157 bash[24585]: cluster 2024-09-16T10:49:13.101789+0000 mgr.a (mgr.14373) 13495 : cluster [DBG] pgmap v9360: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:49:14.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:49:14 smithi086 bash[24289]: cluster 2024-09-16T10:49:13.101789+0000 mgr.a (mgr.14373) 13495 : cluster [DBG] pgmap v9360: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:49:14.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:49:14 smithi047 bash[22744]: cluster 2024-09-16T10:49:13.101789+0000 mgr.a (mgr.14373) 13495 : cluster [DBG] pgmap v9360: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:49:16.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:49:16 smithi157 bash[24585]: cluster 2024-09-16T10:49:15.102577+0000 mgr.a (mgr.14373) 13496 : cluster [DBG] pgmap v9361: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:49:16.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:49:16 smithi157 bash[24585]: audit 2024-09-16T10:49:15.484989+0000 mon.b (mon.2) 1234 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T10:49:16.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:49:16 smithi157 bash[24585]: audit 2024-09-16T10:49:16.099895+0000 mon.a (mon.0) 1375 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:49:16.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:49:16 smithi157 bash[24585]: audit 2024-09-16T10:49:16.102547+0000 mon.a (mon.0) 1376 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:49:16.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:49:16 smithi157 bash[24585]: audit 2024-09-16T10:49:16.106624+0000 mon.a (mon.0) 1377 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:49:16.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:49:16 smithi157 bash[24585]: audit 2024-09-16T10:49:16.110258+0000 mon.a (mon.0) 1378 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:49:16.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:49:16 smithi086 bash[24289]: cluster 2024-09-16T10:49:15.102577+0000 mgr.a (mgr.14373) 13496 : cluster [DBG] pgmap v9361: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:49:16.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:49:16 smithi086 bash[24289]: audit 2024-09-16T10:49:15.484989+0000 mon.b (mon.2) 1234 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T10:49:16.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:49:16 smithi086 bash[24289]: audit 2024-09-16T10:49:16.099895+0000 mon.a (mon.0) 1375 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:49:16.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:49:16 smithi086 bash[24289]: audit 2024-09-16T10:49:16.102547+0000 mon.a (mon.0) 1376 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:49:16.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:49:16 smithi086 bash[24289]: audit 2024-09-16T10:49:16.106624+0000 mon.a (mon.0) 1377 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:49:16.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:49:16 smithi086 bash[24289]: audit 2024-09-16T10:49:16.110258+0000 mon.a (mon.0) 1378 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:49:16.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:49:16 smithi047 bash[22744]: cluster 2024-09-16T10:49:15.102577+0000 mgr.a (mgr.14373) 13496 : cluster [DBG] pgmap v9361: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:49:16.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:49:16 smithi047 bash[22744]: audit 2024-09-16T10:49:15.484989+0000 mon.b (mon.2) 1234 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T10:49:16.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:49:16 smithi047 bash[22744]: audit 2024-09-16T10:49:16.099895+0000 mon.a (mon.0) 1375 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:49:16.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:49:16 smithi047 bash[22744]: audit 2024-09-16T10:49:16.102547+0000 mon.a (mon.0) 1376 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:49:16.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:49:16 smithi047 bash[22744]: audit 2024-09-16T10:49:16.106624+0000 mon.a (mon.0) 1377 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:49:16.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:49:16 smithi047 bash[22744]: audit 2024-09-16T10:49:16.110258+0000 mon.a (mon.0) 1378 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:49:17.447 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:49:17.447 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:49:17.447 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:49:17.518 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:49:17 smithi047 bash[22744]: audit 2024-09-16T10:49:16.768930+0000 mon.b (mon.2) 1235 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T10:49:17.518 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:49:17 smithi047 bash[22744]: audit 2024-09-16T10:49:16.771141+0000 mon.b (mon.2) 1236 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T10:49:17.519 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:49:17 smithi047 bash[22744]: audit 2024-09-16T10:49:16.783437+0000 mon.a (mon.0) 1379 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:49:17.519 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:49:17 smithi047 bash[22744]: audit 2024-09-16T10:49:16.788841+0000 mon.b (mon.2) 1237 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:49:17.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:49:17 smithi157 bash[24585]: audit 2024-09-16T10:49:16.768930+0000 mon.b (mon.2) 1235 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T10:49:17.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:49:17 smithi157 bash[24585]: audit 2024-09-16T10:49:16.771141+0000 mon.b (mon.2) 1236 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T10:49:17.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:49:17 smithi157 bash[24585]: audit 2024-09-16T10:49:16.783437+0000 mon.a (mon.0) 1379 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:49:17.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:49:17 smithi157 bash[24585]: audit 2024-09-16T10:49:16.788841+0000 mon.b (mon.2) 1237 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:49:17.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:49:17 smithi086 bash[24289]: audit 2024-09-16T10:49:16.768930+0000 mon.b (mon.2) 1235 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T10:49:17.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:49:17 smithi086 bash[24289]: audit 2024-09-16T10:49:16.771141+0000 mon.b (mon.2) 1236 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T10:49:17.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:49:17 smithi086 bash[24289]: audit 2024-09-16T10:49:16.783437+0000 mon.a (mon.0) 1379 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:49:17.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:49:17 smithi086 bash[24289]: audit 2024-09-16T10:49:16.788841+0000 mon.b (mon.2) 1237 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:49:17.842 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 10:49:17 smithi047 bash[22994]: debug 2024-09-16T10:49:17.514+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T10:49:17.842 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 10:49:17 smithi047 bash[22994]: debug 2024-09-16T10:49:17.518+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T10:49:18.164 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:49:18.164 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:49:18.164 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:49:18.164 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:49:18.164 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:49:18.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:49:18 smithi157 bash[24585]: audit 2024-09-16T10:49:16.791515+0000 mgr.a (mgr.14373) 13497 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:49:18.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:49:18 smithi157 bash[24585]: cluster 2024-09-16T10:49:17.103872+0000 mgr.a (mgr.14373) 13498 : cluster [DBG] pgmap v9362: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:49:18.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:49:18 smithi157 bash[24585]: audit 2024-09-16T10:49:17.517412+0000 mgr.a (mgr.14373) 13499 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T10:49:18.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:49:18 smithi157 bash[24585]: cephadm 2024-09-16T10:49:17.519220+0000 mgr.a (mgr.14373) 13500 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T10:49:18.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:49:18 smithi086 bash[24289]: audit 2024-09-16T10:49:16.791515+0000 mgr.a (mgr.14373) 13497 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:49:18.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:49:18 smithi086 bash[24289]: cluster 2024-09-16T10:49:17.103872+0000 mgr.a (mgr.14373) 13498 : cluster [DBG] pgmap v9362: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:49:18.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:49:18 smithi086 bash[24289]: audit 2024-09-16T10:49:17.517412+0000 mgr.a (mgr.14373) 13499 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T10:49:18.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:49:18 smithi086 bash[24289]: cephadm 2024-09-16T10:49:17.519220+0000 mgr.a (mgr.14373) 13500 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T10:49:18.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:49:18 smithi047 bash[22744]: audit 2024-09-16T10:49:16.791515+0000 mgr.a (mgr.14373) 13497 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:49:18.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:49:18 smithi047 bash[22744]: cluster 2024-09-16T10:49:17.103872+0000 mgr.a (mgr.14373) 13498 : cluster [DBG] pgmap v9362: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:49:18.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:49:18 smithi047 bash[22744]: audit 2024-09-16T10:49:17.517412+0000 mgr.a (mgr.14373) 13499 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T10:49:18.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:49:18 smithi047 bash[22744]: cephadm 2024-09-16T10:49:17.519220+0000 mgr.a (mgr.14373) 13500 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T10:49:19.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:49:19 smithi157 bash[24585]: audit 2024-09-16T10:49:17.753915+0000 mgr.a (mgr.14373) 13501 : audit [DBG] from='client.293379 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:49:19.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:49:19 smithi086 bash[24289]: audit 2024-09-16T10:49:17.753915+0000 mgr.a (mgr.14373) 13501 : audit [DBG] from='client.293379 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:49:19.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:49:19 smithi047 bash[22744]: audit 2024-09-16T10:49:17.753915+0000 mgr.a (mgr.14373) 13501 : audit [DBG] from='client.293379 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:49:20.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:49:20 smithi157 bash[24585]: cluster 2024-09-16T10:49:19.104695+0000 mgr.a (mgr.14373) 13502 : cluster [DBG] pgmap v9363: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-16T10:49:20.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:49:20 smithi086 bash[24289]: cluster 2024-09-16T10:49:19.104695+0000 mgr.a (mgr.14373) 13502 : cluster [DBG] pgmap v9363: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-16T10:49:20.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:49:20 smithi047 bash[22744]: cluster 2024-09-16T10:49:19.104695+0000 mgr.a (mgr.14373) 13502 : cluster [DBG] pgmap v9363: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-16T10:49:22.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:49:22 smithi157 bash[24585]: cluster 2024-09-16T10:49:21.105464+0000 mgr.a (mgr.14373) 13503 : cluster [DBG] pgmap v9364: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-16T10:49:22.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:49:22 smithi086 bash[24289]: cluster 2024-09-16T10:49:21.105464+0000 mgr.a (mgr.14373) 13503 : cluster [DBG] pgmap v9364: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-16T10:49:22.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:49:22 smithi047 bash[22744]: cluster 2024-09-16T10:49:21.105464+0000 mgr.a (mgr.14373) 13503 : cluster [DBG] pgmap v9364: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-16T10:49:23.165 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:49:23.166 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:49:23.166 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:49:23.949 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:49:23.950 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:49:23.950 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:49:23.950 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:49:23.950 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:49:24.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:49:24 smithi157 bash[24585]: cluster 2024-09-16T10:49:23.107652+0000 mgr.a (mgr.14373) 13504 : cluster [DBG] pgmap v9365: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 7.4 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:49:24.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:49:24 smithi157 bash[24585]: audit 2024-09-16T10:49:23.495657+0000 mgr.a (mgr.14373) 13505 : audit [DBG] from='client.293457 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:49:24.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:49:24 smithi086 bash[24289]: cluster 2024-09-16T10:49:23.107652+0000 mgr.a (mgr.14373) 13504 : cluster [DBG] pgmap v9365: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 7.4 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:49:24.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:49:24 smithi086 bash[24289]: audit 2024-09-16T10:49:23.495657+0000 mgr.a (mgr.14373) 13505 : audit [DBG] from='client.293457 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:49:24.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:49:24 smithi047 bash[22744]: cluster 2024-09-16T10:49:23.107652+0000 mgr.a (mgr.14373) 13504 : cluster [DBG] pgmap v9365: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 7.4 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:49:24.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:49:24 smithi047 bash[22744]: audit 2024-09-16T10:49:23.495657+0000 mgr.a (mgr.14373) 13505 : audit [DBG] from='client.293457 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:49:26.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:49:26 smithi157 bash[24585]: cluster 2024-09-16T10:49:25.108545+0000 mgr.a (mgr.14373) 13506 : cluster [DBG] pgmap v9366: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:49:26.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:49:26 smithi086 bash[24289]: cluster 2024-09-16T10:49:25.108545+0000 mgr.a (mgr.14373) 13506 : cluster [DBG] pgmap v9366: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:49:26.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:49:26 smithi047 bash[22744]: cluster 2024-09-16T10:49:25.108545+0000 mgr.a (mgr.14373) 13506 : cluster [DBG] pgmap v9366: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:49:28.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:49:28 smithi157 bash[24585]: cluster 2024-09-16T10:49:27.110749+0000 mgr.a (mgr.14373) 13507 : cluster [DBG] pgmap v9367: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:49:28.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:49:28 smithi086 bash[24289]: cluster 2024-09-16T10:49:27.110749+0000 mgr.a (mgr.14373) 13507 : cluster [DBG] pgmap v9367: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:49:28.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:49:28 smithi047 bash[22744]: cluster 2024-09-16T10:49:27.110749+0000 mgr.a (mgr.14373) 13507 : cluster [DBG] pgmap v9367: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:49:28.951 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:49:28.951 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:49:28.951 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:49:29.716 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:49:29.716 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:49:29.716 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:49:29.716 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:49:29.716 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:49:30.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:49:30 smithi157 bash[24585]: cluster 2024-09-16T10:49:29.111496+0000 mgr.a (mgr.14373) 13508 : cluster [DBG] pgmap v9368: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:49:30.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:49:30 smithi157 bash[24585]: audit 2024-09-16T10:49:29.281916+0000 mgr.a (mgr.14373) 13509 : audit [DBG] from='client.293535 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:49:30.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:49:30 smithi086 bash[24289]: cluster 2024-09-16T10:49:29.111496+0000 mgr.a (mgr.14373) 13508 : cluster [DBG] pgmap v9368: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:49:30.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:49:30 smithi086 bash[24289]: audit 2024-09-16T10:49:29.281916+0000 mgr.a (mgr.14373) 13509 : audit [DBG] from='client.293535 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:49:30.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:49:30 smithi047 bash[22744]: cluster 2024-09-16T10:49:29.111496+0000 mgr.a (mgr.14373) 13508 : cluster [DBG] pgmap v9368: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:49:30.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:49:30 smithi047 bash[22744]: audit 2024-09-16T10:49:29.281916+0000 mgr.a (mgr.14373) 13509 : audit [DBG] from='client.293535 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:49:32.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:49:32 smithi157 bash[24585]: cluster 2024-09-16T10:49:31.112611+0000 mgr.a (mgr.14373) 13510 : cluster [DBG] pgmap v9369: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:49:32.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:49:32 smithi086 bash[24289]: cluster 2024-09-16T10:49:31.112611+0000 mgr.a (mgr.14373) 13510 : cluster [DBG] pgmap v9369: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:49:32.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:49:32 smithi047 bash[22744]: cluster 2024-09-16T10:49:31.112611+0000 mgr.a (mgr.14373) 13510 : cluster [DBG] pgmap v9369: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:49:34.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:49:34 smithi157 bash[24585]: cluster 2024-09-16T10:49:33.115038+0000 mgr.a (mgr.14373) 13511 : cluster [DBG] pgmap v9370: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:49:34.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:49:34 smithi086 bash[24289]: cluster 2024-09-16T10:49:33.115038+0000 mgr.a (mgr.14373) 13511 : cluster [DBG] pgmap v9370: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:49:34.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:49:34 smithi047 bash[22744]: cluster 2024-09-16T10:49:33.115038+0000 mgr.a (mgr.14373) 13511 : cluster [DBG] pgmap v9370: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:49:34.716 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:49:34.717 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:49:34.717 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:49:35.501 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:49:35.502 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:49:35.502 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:49:35.502 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:49:35.502 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:49:36.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:49:36 smithi157 bash[24585]: audit 2024-09-16T10:49:35.048340+0000 mgr.a (mgr.14373) 13512 : audit [DBG] from='client.293607 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:49:36.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:49:36 smithi157 bash[24585]: cluster 2024-09-16T10:49:35.115622+0000 mgr.a (mgr.14373) 13513 : cluster [DBG] pgmap v9371: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:49:36.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:49:36 smithi086 bash[24289]: audit 2024-09-16T10:49:35.048340+0000 mgr.a (mgr.14373) 13512 : audit [DBG] from='client.293607 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:49:36.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:49:36 smithi086 bash[24289]: cluster 2024-09-16T10:49:35.115622+0000 mgr.a (mgr.14373) 13513 : cluster [DBG] pgmap v9371: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:49:36.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:49:36 smithi047 bash[22744]: audit 2024-09-16T10:49:35.048340+0000 mgr.a (mgr.14373) 13512 : audit [DBG] from='client.293607 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:49:36.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:49:36 smithi047 bash[22744]: cluster 2024-09-16T10:49:35.115622+0000 mgr.a (mgr.14373) 13513 : cluster [DBG] pgmap v9371: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:49:38.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:49:38 smithi157 bash[24585]: cluster 2024-09-16T10:49:37.117937+0000 mgr.a (mgr.14373) 13514 : cluster [DBG] pgmap v9372: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:49:38.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:49:38 smithi086 bash[24289]: cluster 2024-09-16T10:49:37.117937+0000 mgr.a (mgr.14373) 13514 : cluster [DBG] pgmap v9372: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:49:38.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:49:38 smithi047 bash[22744]: cluster 2024-09-16T10:49:37.117937+0000 mgr.a (mgr.14373) 13514 : cluster [DBG] pgmap v9372: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:49:40.503 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:49:40.504 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:49:40.504 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:49:40.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:49:40 smithi157 bash[24585]: cluster 2024-09-16T10:49:39.118727+0000 mgr.a (mgr.14373) 13515 : cluster [DBG] pgmap v9373: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:49:40.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:49:40 smithi086 bash[24289]: cluster 2024-09-16T10:49:39.118727+0000 mgr.a (mgr.14373) 13515 : cluster [DBG] pgmap v9373: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:49:40.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:49:40 smithi047 bash[22744]: cluster 2024-09-16T10:49:39.118727+0000 mgr.a (mgr.14373) 13515 : cluster [DBG] pgmap v9373: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:49:41.271 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:49:41.271 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:49:41.271 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:49:41.271 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:49:41.271 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:49:42.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:49:42 smithi157 bash[24585]: audit 2024-09-16T10:49:40.835479+0000 mgr.a (mgr.14373) 13516 : audit [DBG] from='client.293682 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:49:42.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:49:42 smithi157 bash[24585]: cluster 2024-09-16T10:49:41.119463+0000 mgr.a (mgr.14373) 13517 : cluster [DBG] pgmap v9374: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:49:42.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:49:42 smithi086 bash[24289]: audit 2024-09-16T10:49:40.835479+0000 mgr.a (mgr.14373) 13516 : audit [DBG] from='client.293682 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:49:42.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:49:42 smithi086 bash[24289]: cluster 2024-09-16T10:49:41.119463+0000 mgr.a (mgr.14373) 13517 : cluster [DBG] pgmap v9374: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:49:42.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:49:42 smithi047 bash[22744]: audit 2024-09-16T10:49:40.835479+0000 mgr.a (mgr.14373) 13516 : audit [DBG] from='client.293682 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:49:42.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:49:42 smithi047 bash[22744]: cluster 2024-09-16T10:49:41.119463+0000 mgr.a (mgr.14373) 13517 : cluster [DBG] pgmap v9374: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:49:44.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:49:44 smithi157 bash[24585]: cluster 2024-09-16T10:49:43.121799+0000 mgr.a (mgr.14373) 13518 : cluster [DBG] pgmap v9375: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:49:44.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:49:44 smithi086 bash[24289]: cluster 2024-09-16T10:49:43.121799+0000 mgr.a (mgr.14373) 13518 : cluster [DBG] pgmap v9375: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:49:44.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:49:44 smithi047 bash[22744]: cluster 2024-09-16T10:49:43.121799+0000 mgr.a (mgr.14373) 13518 : cluster [DBG] pgmap v9375: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:49:46.273 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:49:46.274 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:49:46.274 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:49:46.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:49:46 smithi157 bash[24585]: cluster 2024-09-16T10:49:45.122604+0000 mgr.a (mgr.14373) 13519 : cluster [DBG] pgmap v9376: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:49:46.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:49:46 smithi086 bash[24289]: cluster 2024-09-16T10:49:45.122604+0000 mgr.a (mgr.14373) 13519 : cluster [DBG] pgmap v9376: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:49:46.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:49:46 smithi047 bash[22744]: cluster 2024-09-16T10:49:45.122604+0000 mgr.a (mgr.14373) 13519 : cluster [DBG] pgmap v9376: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:49:47.029 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:49:47.029 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:49:47.029 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:49:47.030 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:49:47.030 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:49:47.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:49:47 smithi157 bash[24585]: audit 2024-09-16T10:49:46.603328+0000 mgr.a (mgr.14373) 13520 : audit [DBG] from='client.293760 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:49:47.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:49:47 smithi086 bash[24289]: audit 2024-09-16T10:49:46.603328+0000 mgr.a (mgr.14373) 13520 : audit [DBG] from='client.293760 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:49:47.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:49:47 smithi047 bash[22744]: audit 2024-09-16T10:49:46.603328+0000 mgr.a (mgr.14373) 13520 : audit [DBG] from='client.293760 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:49:48.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:49:48 smithi157 bash[24585]: cluster 2024-09-16T10:49:47.125361+0000 mgr.a (mgr.14373) 13521 : cluster [DBG] pgmap v9377: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:49:48.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:49:48 smithi086 bash[24289]: cluster 2024-09-16T10:49:47.125361+0000 mgr.a (mgr.14373) 13521 : cluster [DBG] pgmap v9377: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:49:48.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:49:48 smithi047 bash[22744]: cluster 2024-09-16T10:49:47.125361+0000 mgr.a (mgr.14373) 13521 : cluster [DBG] pgmap v9377: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:49:50.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:49:50 smithi086 bash[24289]: cluster 2024-09-16T10:49:49.126147+0000 mgr.a (mgr.14373) 13522 : cluster [DBG] pgmap v9378: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:49:50.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:49:50 smithi047 bash[22744]: cluster 2024-09-16T10:49:49.126147+0000 mgr.a (mgr.14373) 13522 : cluster [DBG] pgmap v9378: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:49:50.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:49:50 smithi157 bash[24585]: cluster 2024-09-16T10:49:49.126147+0000 mgr.a (mgr.14373) 13522 : cluster [DBG] pgmap v9378: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:49:52.031 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:49:52.031 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:49:52.031 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:49:52.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:49:52 smithi086 bash[24289]: cluster 2024-09-16T10:49:51.127057+0000 mgr.a (mgr.14373) 13523 : cluster [DBG] pgmap v9379: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T10:49:52.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:49:52 smithi047 bash[22744]: cluster 2024-09-16T10:49:51.127057+0000 mgr.a (mgr.14373) 13523 : cluster [DBG] pgmap v9379: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T10:49:52.777 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:49:52.777 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:49:52.778 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:49:52.778 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:49:52.778 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:49:52.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:49:52 smithi157 bash[24585]: cluster 2024-09-16T10:49:51.127057+0000 mgr.a (mgr.14373) 13523 : cluster [DBG] pgmap v9379: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T10:49:53.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:49:53 smithi047 bash[22744]: audit 2024-09-16T10:49:52.363210+0000 mgr.a (mgr.14373) 13524 : audit [DBG] from='client.293838 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:49:53.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:49:53 smithi157 bash[24585]: audit 2024-09-16T10:49:52.363210+0000 mgr.a (mgr.14373) 13524 : audit [DBG] from='client.293838 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:49:53.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:49:53 smithi086 bash[24289]: audit 2024-09-16T10:49:52.363210+0000 mgr.a (mgr.14373) 13524 : audit [DBG] from='client.293838 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:49:54.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:49:54 smithi047 bash[22744]: cluster 2024-09-16T10:49:53.129861+0000 mgr.a (mgr.14373) 13525 : cluster [DBG] pgmap v9380: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:49:54.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:49:54 smithi157 bash[24585]: cluster 2024-09-16T10:49:53.129861+0000 mgr.a (mgr.14373) 13525 : cluster [DBG] pgmap v9380: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:49:54.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:49:54 smithi086 bash[24289]: cluster 2024-09-16T10:49:53.129861+0000 mgr.a (mgr.14373) 13525 : cluster [DBG] pgmap v9380: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:49:56.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:49:56 smithi047 bash[22744]: cluster 2024-09-16T10:49:55.130658+0000 mgr.a (mgr.14373) 13526 : cluster [DBG] pgmap v9381: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:49:56.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:49:56 smithi157 bash[24585]: cluster 2024-09-16T10:49:55.130658+0000 mgr.a (mgr.14373) 13526 : cluster [DBG] pgmap v9381: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:49:56.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:49:56 smithi086 bash[24289]: cluster 2024-09-16T10:49:55.130658+0000 mgr.a (mgr.14373) 13526 : cluster [DBG] pgmap v9381: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:49:57.779 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:49:57.780 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:49:57.780 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:49:58.560 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:49:58.560 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:49:58.561 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:49:58.561 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:49:58.561 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:49:58.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:49:58 smithi047 bash[22744]: cluster 2024-09-16T10:49:57.132762+0000 mgr.a (mgr.14373) 13527 : cluster [DBG] pgmap v9382: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:49:58.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:49:58 smithi157 bash[24585]: cluster 2024-09-16T10:49:57.132762+0000 mgr.a (mgr.14373) 13527 : cluster [DBG] pgmap v9382: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:49:58.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:49:58 smithi086 bash[24289]: cluster 2024-09-16T10:49:57.132762+0000 mgr.a (mgr.14373) 13527 : cluster [DBG] pgmap v9382: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:49:59.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:49:59 smithi047 bash[22744]: audit 2024-09-16T10:49:58.113573+0000 mgr.a (mgr.14373) 13528 : audit [DBG] from='client.293916 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:49:59.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:49:59 smithi157 bash[24585]: audit 2024-09-16T10:49:58.113573+0000 mgr.a (mgr.14373) 13528 : audit [DBG] from='client.293916 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:49:59.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:49:59 smithi086 bash[24289]: audit 2024-09-16T10:49:58.113573+0000 mgr.a (mgr.14373) 13528 : audit [DBG] from='client.293916 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:50:00.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:50:00 smithi157 bash[24585]: cluster 2024-09-16T10:49:59.133774+0000 mgr.a (mgr.14373) 13529 : cluster [DBG] pgmap v9383: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:50:00.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:50:00 smithi157 bash[24585]: cluster 2024-09-16T10:50:00.000153+0000 mon.a (mon.0) 1380 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-16T10:50:00.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:50:00 smithi086 bash[24289]: cluster 2024-09-16T10:49:59.133774+0000 mgr.a (mgr.14373) 13529 : cluster [DBG] pgmap v9383: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:50:00.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:50:00 smithi086 bash[24289]: cluster 2024-09-16T10:50:00.000153+0000 mon.a (mon.0) 1380 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-16T10:50:00.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:50:00 smithi047 bash[22744]: cluster 2024-09-16T10:49:59.133774+0000 mgr.a (mgr.14373) 13529 : cluster [DBG] pgmap v9383: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:50:00.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:50:00 smithi047 bash[22744]: cluster 2024-09-16T10:50:00.000153+0000 mon.a (mon.0) 1380 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-16T10:50:02.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:50:02 smithi157 bash[24585]: cluster 2024-09-16T10:50:01.134588+0000 mgr.a (mgr.14373) 13530 : cluster [DBG] pgmap v9384: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:50:02.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:50:02 smithi086 bash[24289]: cluster 2024-09-16T10:50:01.134588+0000 mgr.a (mgr.14373) 13530 : cluster [DBG] pgmap v9384: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:50:02.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:50:02 smithi047 bash[22744]: cluster 2024-09-16T10:50:01.134588+0000 mgr.a (mgr.14373) 13530 : cluster [DBG] pgmap v9384: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:50:03.562 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:50:03.563 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:50:03.563 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:50:04.343 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:50:04.344 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:50:04.344 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:50:04.344 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:50:04.344 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:50:04.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:50:04 smithi157 bash[24585]: cluster 2024-09-16T10:50:03.136858+0000 mgr.a (mgr.14373) 13531 : cluster [DBG] pgmap v9385: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:50:04.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:50:04 smithi086 bash[24289]: cluster 2024-09-16T10:50:03.136858+0000 mgr.a (mgr.14373) 13531 : cluster [DBG] pgmap v9385: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:50:04.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:50:04 smithi047 bash[22744]: cluster 2024-09-16T10:50:03.136858+0000 mgr.a (mgr.14373) 13531 : cluster [DBG] pgmap v9385: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:50:05.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:50:05 smithi157 bash[24585]: audit 2024-09-16T10:50:03.894056+0000 mgr.a (mgr.14373) 13532 : audit [DBG] from='client.293988 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:50:05.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:50:05 smithi086 bash[24289]: audit 2024-09-16T10:50:03.894056+0000 mgr.a (mgr.14373) 13532 : audit [DBG] from='client.293988 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:50:05.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:50:05 smithi047 bash[22744]: audit 2024-09-16T10:50:03.894056+0000 mgr.a (mgr.14373) 13532 : audit [DBG] from='client.293988 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:50:06.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:50:06 smithi157 bash[24585]: cluster 2024-09-16T10:50:05.137819+0000 mgr.a (mgr.14373) 13533 : cluster [DBG] pgmap v9386: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:50:06.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:50:06 smithi086 bash[24289]: cluster 2024-09-16T10:50:05.137819+0000 mgr.a (mgr.14373) 13533 : cluster [DBG] pgmap v9386: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:50:06.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:50:06 smithi047 bash[22744]: cluster 2024-09-16T10:50:05.137819+0000 mgr.a (mgr.14373) 13533 : cluster [DBG] pgmap v9386: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:50:08.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:50:08 smithi157 bash[24585]: cluster 2024-09-16T10:50:07.140051+0000 mgr.a (mgr.14373) 13534 : cluster [DBG] pgmap v9387: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:50:08.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:50:08 smithi086 bash[24289]: cluster 2024-09-16T10:50:07.140051+0000 mgr.a (mgr.14373) 13534 : cluster [DBG] pgmap v9387: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:50:08.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:50:08 smithi047 bash[22744]: cluster 2024-09-16T10:50:07.140051+0000 mgr.a (mgr.14373) 13534 : cluster [DBG] pgmap v9387: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:50:09.345 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:50:09.346 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:50:09.346 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:50:10.125 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:50:10.125 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:50:10.125 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:50:10.125 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:50:10.125 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:50:10.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:50:10 smithi157 bash[24585]: cluster 2024-09-16T10:50:09.140842+0000 mgr.a (mgr.14373) 13535 : cluster [DBG] pgmap v9388: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:50:10.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:50:10 smithi086 bash[24289]: cluster 2024-09-16T10:50:09.140842+0000 mgr.a (mgr.14373) 13535 : cluster [DBG] pgmap v9388: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:50:10.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:50:10 smithi047 bash[22744]: cluster 2024-09-16T10:50:09.140842+0000 mgr.a (mgr.14373) 13535 : cluster [DBG] pgmap v9388: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:50:11.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:50:11 smithi157 bash[24585]: audit 2024-09-16T10:50:09.683248+0000 mgr.a (mgr.14373) 13536 : audit [DBG] from='client.294063 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:50:11.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:50:11 smithi086 bash[24289]: audit 2024-09-16T10:50:09.683248+0000 mgr.a (mgr.14373) 13536 : audit [DBG] from='client.294063 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:50:11.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:50:11 smithi047 bash[22744]: audit 2024-09-16T10:50:09.683248+0000 mgr.a (mgr.14373) 13536 : audit [DBG] from='client.294063 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:50:12.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:50:12 smithi157 bash[24585]: cluster 2024-09-16T10:50:11.141785+0000 mgr.a (mgr.14373) 13537 : cluster [DBG] pgmap v9389: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:50:12.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:50:12 smithi086 bash[24289]: cluster 2024-09-16T10:50:11.141785+0000 mgr.a (mgr.14373) 13537 : cluster [DBG] pgmap v9389: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:50:12.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:50:12 smithi047 bash[22744]: cluster 2024-09-16T10:50:11.141785+0000 mgr.a (mgr.14373) 13537 : cluster [DBG] pgmap v9389: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:50:14.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:50:14 smithi157 bash[24585]: cluster 2024-09-16T10:50:13.144120+0000 mgr.a (mgr.14373) 13538 : cluster [DBG] pgmap v9390: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:50:14.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:50:14 smithi086 bash[24289]: cluster 2024-09-16T10:50:13.144120+0000 mgr.a (mgr.14373) 13538 : cluster [DBG] pgmap v9390: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:50:14.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:50:14 smithi047 bash[22744]: cluster 2024-09-16T10:50:13.144120+0000 mgr.a (mgr.14373) 13538 : cluster [DBG] pgmap v9390: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:50:15.126 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:50:15.127 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:50:15.127 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:50:15.913 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:50:15.914 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:50:15.914 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:50:15.914 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:50:15.914 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:50:16.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:50:16 smithi157 bash[24585]: cluster 2024-09-16T10:50:15.144686+0000 mgr.a (mgr.14373) 13539 : cluster [DBG] pgmap v9391: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:50:16.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:50:16 smithi157 bash[24585]: audit 2024-09-16T10:50:15.465429+0000 mgr.a (mgr.14373) 13540 : audit [DBG] from='client.294138 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:50:16.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:50:16 smithi086 bash[24289]: cluster 2024-09-16T10:50:15.144686+0000 mgr.a (mgr.14373) 13539 : cluster [DBG] pgmap v9391: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:50:16.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:50:16 smithi086 bash[24289]: audit 2024-09-16T10:50:15.465429+0000 mgr.a (mgr.14373) 13540 : audit [DBG] from='client.294138 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:50:16.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:50:16 smithi047 bash[22744]: cluster 2024-09-16T10:50:15.144686+0000 mgr.a (mgr.14373) 13539 : cluster [DBG] pgmap v9391: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:50:16.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:50:16 smithi047 bash[22744]: audit 2024-09-16T10:50:15.465429+0000 mgr.a (mgr.14373) 13540 : audit [DBG] from='client.294138 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:50:18.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:50:18 smithi157 bash[24585]: cluster 2024-09-16T10:50:17.147076+0000 mgr.a (mgr.14373) 13541 : cluster [DBG] pgmap v9392: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:50:18.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:50:18 smithi157 bash[24585]: audit 2024-09-16T10:50:17.568930+0000 mon.b (mon.2) 1238 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T10:50:18.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:50:18 smithi086 bash[24289]: cluster 2024-09-16T10:50:17.147076+0000 mgr.a (mgr.14373) 13541 : cluster [DBG] pgmap v9392: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:50:18.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:50:18 smithi086 bash[24289]: audit 2024-09-16T10:50:17.568930+0000 mon.b (mon.2) 1238 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T10:50:18.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:50:18 smithi047 bash[22744]: cluster 2024-09-16T10:50:17.147076+0000 mgr.a (mgr.14373) 13541 : cluster [DBG] pgmap v9392: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:50:18.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:50:18 smithi047 bash[22744]: audit 2024-09-16T10:50:17.568930+0000 mon.b (mon.2) 1238 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T10:50:19.593 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 10:50:19 smithi047 bash[22994]: debug 2024-09-16T10:50:19.184+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T10:50:19.593 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 10:50:19 smithi047 bash[22994]: debug 2024-09-16T10:50:19.184+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T10:50:19.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:50:19 smithi047 bash[22744]: audit 2024-09-16T10:50:18.415199+0000 mon.b (mon.2) 1239 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T10:50:19.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:50:19 smithi047 bash[22744]: audit 2024-09-16T10:50:18.417245+0000 mon.b (mon.2) 1240 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T10:50:19.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:50:19 smithi047 bash[22744]: audit 2024-09-16T10:50:18.428602+0000 mon.a (mon.0) 1381 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:50:19.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:50:19 smithi047 bash[22744]: audit 2024-09-16T10:50:18.433607+0000 mon.b (mon.2) 1241 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:50:19.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:50:19 smithi047 bash[22744]: audit 2024-09-16T10:50:18.436501+0000 mgr.a (mgr.14373) 13542 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:50:19.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:50:19 smithi157 bash[24585]: audit 2024-09-16T10:50:18.415199+0000 mon.b (mon.2) 1239 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T10:50:19.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:50:19 smithi157 bash[24585]: audit 2024-09-16T10:50:18.417245+0000 mon.b (mon.2) 1240 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T10:50:19.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:50:19 smithi157 bash[24585]: audit 2024-09-16T10:50:18.428602+0000 mon.a (mon.0) 1381 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:50:19.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:50:19 smithi157 bash[24585]: audit 2024-09-16T10:50:18.433607+0000 mon.b (mon.2) 1241 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:50:19.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:50:19 smithi157 bash[24585]: audit 2024-09-16T10:50:18.436501+0000 mgr.a (mgr.14373) 13542 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:50:19.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:50:19 smithi086 bash[24289]: audit 2024-09-16T10:50:18.415199+0000 mon.b (mon.2) 1239 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T10:50:19.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:50:19 smithi086 bash[24289]: audit 2024-09-16T10:50:18.417245+0000 mon.b (mon.2) 1240 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T10:50:19.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:50:19 smithi086 bash[24289]: audit 2024-09-16T10:50:18.428602+0000 mon.a (mon.0) 1381 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:50:19.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:50:19 smithi086 bash[24289]: audit 2024-09-16T10:50:18.433607+0000 mon.b (mon.2) 1241 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:50:19.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:50:19 smithi086 bash[24289]: audit 2024-09-16T10:50:18.436501+0000 mgr.a (mgr.14373) 13542 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:50:20.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:50:20 smithi157 bash[24585]: cluster 2024-09-16T10:50:19.147570+0000 mgr.a (mgr.14373) 13543 : cluster [DBG] pgmap v9393: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:50:20.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:50:20 smithi157 bash[24585]: audit 2024-09-16T10:50:19.186892+0000 mgr.a (mgr.14373) 13544 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T10:50:20.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:50:20 smithi157 bash[24585]: cephadm 2024-09-16T10:50:19.188657+0000 mgr.a (mgr.14373) 13545 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T10:50:20.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:50:20 smithi086 bash[24289]: cluster 2024-09-16T10:50:19.147570+0000 mgr.a (mgr.14373) 13543 : cluster [DBG] pgmap v9393: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:50:20.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:50:20 smithi086 bash[24289]: audit 2024-09-16T10:50:19.186892+0000 mgr.a (mgr.14373) 13544 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T10:50:20.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:50:20 smithi086 bash[24289]: cephadm 2024-09-16T10:50:19.188657+0000 mgr.a (mgr.14373) 13545 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T10:50:20.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:50:20 smithi047 bash[22744]: cluster 2024-09-16T10:50:19.147570+0000 mgr.a (mgr.14373) 13543 : cluster [DBG] pgmap v9393: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:50:20.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:50:20 smithi047 bash[22744]: audit 2024-09-16T10:50:19.186892+0000 mgr.a (mgr.14373) 13544 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T10:50:20.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:50:20 smithi047 bash[22744]: cephadm 2024-09-16T10:50:19.188657+0000 mgr.a (mgr.14373) 13545 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T10:50:20.915 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:50:20.950 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:50:20.950 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:50:21.703 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:50:21.703 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:50:21.703 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:50:21.703 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:50:21.704 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:50:22.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:50:22 smithi157 bash[24585]: cluster 2024-09-16T10:50:21.148287+0000 mgr.a (mgr.14373) 13546 : cluster [DBG] pgmap v9394: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:50:22.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:50:22 smithi157 bash[24585]: audit 2024-09-16T10:50:21.251669+0000 mgr.a (mgr.14373) 13547 : audit [DBG] from='client.294324 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:50:22.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:50:22 smithi086 bash[24289]: cluster 2024-09-16T10:50:21.148287+0000 mgr.a (mgr.14373) 13546 : cluster [DBG] pgmap v9394: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:50:22.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:50:22 smithi086 bash[24289]: audit 2024-09-16T10:50:21.251669+0000 mgr.a (mgr.14373) 13547 : audit [DBG] from='client.294324 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:50:22.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:50:22 smithi047 bash[22744]: cluster 2024-09-16T10:50:21.148287+0000 mgr.a (mgr.14373) 13546 : cluster [DBG] pgmap v9394: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:50:22.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:50:22 smithi047 bash[22744]: audit 2024-09-16T10:50:21.251669+0000 mgr.a (mgr.14373) 13547 : audit [DBG] from='client.294324 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:50:24.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:50:24 smithi157 bash[24585]: cluster 2024-09-16T10:50:23.150667+0000 mgr.a (mgr.14373) 13548 : cluster [DBG] pgmap v9395: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:50:24.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:50:24 smithi086 bash[24289]: cluster 2024-09-16T10:50:23.150667+0000 mgr.a (mgr.14373) 13548 : cluster [DBG] pgmap v9395: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:50:24.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:50:24 smithi047 bash[22744]: cluster 2024-09-16T10:50:23.150667+0000 mgr.a (mgr.14373) 13548 : cluster [DBG] pgmap v9395: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:50:26.705 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:50:26.706 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:50:26.706 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:50:26.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:50:26 smithi157 bash[24585]: cluster 2024-09-16T10:50:25.151454+0000 mgr.a (mgr.14373) 13549 : cluster [DBG] pgmap v9396: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T10:50:26.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:50:26 smithi086 bash[24289]: cluster 2024-09-16T10:50:25.151454+0000 mgr.a (mgr.14373) 13549 : cluster [DBG] pgmap v9396: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T10:50:26.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:50:26 smithi047 bash[22744]: cluster 2024-09-16T10:50:25.151454+0000 mgr.a (mgr.14373) 13549 : cluster [DBG] pgmap v9396: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T10:50:27.496 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:50:27.496 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:50:27.496 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:50:27.496 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:50:27.496 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:50:28.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:50:28 smithi157 bash[24585]: audit 2024-09-16T10:50:27.040897+0000 mgr.a (mgr.14373) 13550 : audit [DBG] from='client.294402 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:50:28.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:50:28 smithi157 bash[24585]: cluster 2024-09-16T10:50:27.152731+0000 mgr.a (mgr.14373) 13551 : cluster [DBG] pgmap v9397: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:50:28.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:50:28 smithi086 bash[24289]: audit 2024-09-16T10:50:27.040897+0000 mgr.a (mgr.14373) 13550 : audit [DBG] from='client.294402 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:50:28.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:50:28 smithi086 bash[24289]: cluster 2024-09-16T10:50:27.152731+0000 mgr.a (mgr.14373) 13551 : cluster [DBG] pgmap v9397: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:50:28.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:50:28 smithi047 bash[22744]: audit 2024-09-16T10:50:27.040897+0000 mgr.a (mgr.14373) 13550 : audit [DBG] from='client.294402 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:50:28.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:50:28 smithi047 bash[22744]: cluster 2024-09-16T10:50:27.152731+0000 mgr.a (mgr.14373) 13551 : cluster [DBG] pgmap v9397: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:50:30.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:50:30 smithi157 bash[24585]: cluster 2024-09-16T10:50:29.153603+0000 mgr.a (mgr.14373) 13552 : cluster [DBG] pgmap v9398: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T10:50:30.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:50:30 smithi086 bash[24289]: cluster 2024-09-16T10:50:29.153603+0000 mgr.a (mgr.14373) 13552 : cluster [DBG] pgmap v9398: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T10:50:30.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:50:30 smithi047 bash[22744]: cluster 2024-09-16T10:50:29.153603+0000 mgr.a (mgr.14373) 13552 : cluster [DBG] pgmap v9398: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T10:50:32.497 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:50:32.497 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:50:32.498 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:50:32.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:50:32 smithi157 bash[24585]: cluster 2024-09-16T10:50:31.154408+0000 mgr.a (mgr.14373) 13553 : cluster [DBG] pgmap v9399: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T10:50:32.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:50:32 smithi086 bash[24289]: cluster 2024-09-16T10:50:31.154408+0000 mgr.a (mgr.14373) 13553 : cluster [DBG] pgmap v9399: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T10:50:32.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:50:32 smithi047 bash[22744]: cluster 2024-09-16T10:50:31.154408+0000 mgr.a (mgr.14373) 13553 : cluster [DBG] pgmap v9399: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T10:50:33.284 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:50:33.284 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:50:33.285 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:50:33.285 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:50:33.285 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:50:34.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:50:34 smithi157 bash[24585]: audit 2024-09-16T10:50:32.833663+0000 mgr.a (mgr.14373) 13554 : audit [DBG] from='client.294480 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:50:34.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:50:34 smithi157 bash[24585]: cluster 2024-09-16T10:50:33.155782+0000 mgr.a (mgr.14373) 13555 : cluster [DBG] pgmap v9400: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:50:34.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:50:34 smithi086 bash[24289]: audit 2024-09-16T10:50:32.833663+0000 mgr.a (mgr.14373) 13554 : audit [DBG] from='client.294480 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:50:34.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:50:34 smithi086 bash[24289]: cluster 2024-09-16T10:50:33.155782+0000 mgr.a (mgr.14373) 13555 : cluster [DBG] pgmap v9400: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:50:34.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:50:34 smithi047 bash[22744]: audit 2024-09-16T10:50:32.833663+0000 mgr.a (mgr.14373) 13554 : audit [DBG] from='client.294480 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:50:34.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:50:34 smithi047 bash[22744]: cluster 2024-09-16T10:50:33.155782+0000 mgr.a (mgr.14373) 13555 : cluster [DBG] pgmap v9400: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:50:36.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:50:36 smithi157 bash[24585]: cluster 2024-09-16T10:50:35.156682+0000 mgr.a (mgr.14373) 13556 : cluster [DBG] pgmap v9401: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-16T10:50:36.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:50:36 smithi086 bash[24289]: cluster 2024-09-16T10:50:35.156682+0000 mgr.a (mgr.14373) 13556 : cluster [DBG] pgmap v9401: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-16T10:50:36.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:50:36 smithi047 bash[22744]: cluster 2024-09-16T10:50:35.156682+0000 mgr.a (mgr.14373) 13556 : cluster [DBG] pgmap v9401: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-16T10:50:38.286 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:50:38.287 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:50:38.287 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:50:38.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:50:38 smithi157 bash[24585]: cluster 2024-09-16T10:50:37.158862+0000 mgr.a (mgr.14373) 13557 : cluster [DBG] pgmap v9402: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-16T10:50:38.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:50:38 smithi086 bash[24289]: cluster 2024-09-16T10:50:37.158862+0000 mgr.a (mgr.14373) 13557 : cluster [DBG] pgmap v9402: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-16T10:50:38.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:50:38 smithi047 bash[22744]: cluster 2024-09-16T10:50:37.158862+0000 mgr.a (mgr.14373) 13557 : cluster [DBG] pgmap v9402: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-16T10:50:39.061 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:50:39.061 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:50:39.061 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:50:39.061 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:50:39.061 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:50:39.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:50:39 smithi157 bash[24585]: audit 2024-09-16T10:50:38.621817+0000 mgr.a (mgr.14373) 13558 : audit [DBG] from='client.294558 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:50:39.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:50:39 smithi086 bash[24289]: audit 2024-09-16T10:50:38.621817+0000 mgr.a (mgr.14373) 13558 : audit [DBG] from='client.294558 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:50:39.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:50:39 smithi047 bash[22744]: audit 2024-09-16T10:50:38.621817+0000 mgr.a (mgr.14373) 13558 : audit [DBG] from='client.294558 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:50:40.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:50:40 smithi157 bash[24585]: cluster 2024-09-16T10:50:39.159822+0000 mgr.a (mgr.14373) 13559 : cluster [DBG] pgmap v9403: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:50:40.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:50:40 smithi086 bash[24289]: cluster 2024-09-16T10:50:39.159822+0000 mgr.a (mgr.14373) 13559 : cluster [DBG] pgmap v9403: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:50:40.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:50:40 smithi047 bash[22744]: cluster 2024-09-16T10:50:39.159822+0000 mgr.a (mgr.14373) 13559 : cluster [DBG] pgmap v9403: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:50:42.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:50:42 smithi157 bash[24585]: cluster 2024-09-16T10:50:41.160682+0000 mgr.a (mgr.14373) 13560 : cluster [DBG] pgmap v9404: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:50:42.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:50:42 smithi086 bash[24289]: cluster 2024-09-16T10:50:41.160682+0000 mgr.a (mgr.14373) 13560 : cluster [DBG] pgmap v9404: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:50:42.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:50:42 smithi047 bash[22744]: cluster 2024-09-16T10:50:41.160682+0000 mgr.a (mgr.14373) 13560 : cluster [DBG] pgmap v9404: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:50:44.062 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:50:44.063 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:50:44.063 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:50:44.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:50:44 smithi157 bash[24585]: cluster 2024-09-16T10:50:43.162942+0000 mgr.a (mgr.14373) 13561 : cluster [DBG] pgmap v9405: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:50:44.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:50:44 smithi086 bash[24289]: cluster 2024-09-16T10:50:43.162942+0000 mgr.a (mgr.14373) 13561 : cluster [DBG] pgmap v9405: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:50:44.838 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:50:44.838 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:50:44.838 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:50:44.838 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:50:44.838 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:50:44.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:50:44 smithi047 bash[22744]: cluster 2024-09-16T10:50:43.162942+0000 mgr.a (mgr.14373) 13561 : cluster [DBG] pgmap v9405: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:50:45.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:50:45 smithi157 bash[24585]: audit 2024-09-16T10:50:44.392524+0000 mgr.a (mgr.14373) 13562 : audit [DBG] from='client.294636 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:50:45.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:50:45 smithi086 bash[24289]: audit 2024-09-16T10:50:44.392524+0000 mgr.a (mgr.14373) 13562 : audit [DBG] from='client.294636 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:50:45.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:50:45 smithi047 bash[22744]: audit 2024-09-16T10:50:44.392524+0000 mgr.a (mgr.14373) 13562 : audit [DBG] from='client.294636 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:50:46.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:50:46 smithi157 bash[24585]: cluster 2024-09-16T10:50:45.163929+0000 mgr.a (mgr.14373) 13563 : cluster [DBG] pgmap v9406: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:50:46.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:50:46 smithi086 bash[24289]: cluster 2024-09-16T10:50:45.163929+0000 mgr.a (mgr.14373) 13563 : cluster [DBG] pgmap v9406: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:50:46.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:50:46 smithi047 bash[22744]: cluster 2024-09-16T10:50:45.163929+0000 mgr.a (mgr.14373) 13563 : cluster [DBG] pgmap v9406: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:50:48.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:50:48 smithi157 bash[24585]: cluster 2024-09-16T10:50:47.166138+0000 mgr.a (mgr.14373) 13564 : cluster [DBG] pgmap v9407: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:50:48.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:50:48 smithi086 bash[24289]: cluster 2024-09-16T10:50:47.166138+0000 mgr.a (mgr.14373) 13564 : cluster [DBG] pgmap v9407: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:50:48.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:50:48 smithi047 bash[22744]: cluster 2024-09-16T10:50:47.166138+0000 mgr.a (mgr.14373) 13564 : cluster [DBG] pgmap v9407: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:50:49.840 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:50:49.840 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:50:49.840 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:50:50.594 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:50:50.594 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:50:50.594 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:50:50.594 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:50:50.594 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:50:50.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:50:50 smithi157 bash[24585]: cluster 2024-09-16T10:50:49.166922+0000 mgr.a (mgr.14373) 13565 : cluster [DBG] pgmap v9408: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:50:50.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:50:50 smithi086 bash[24289]: cluster 2024-09-16T10:50:49.166922+0000 mgr.a (mgr.14373) 13565 : cluster [DBG] pgmap v9408: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:50:50.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:50:50 smithi047 bash[22744]: cluster 2024-09-16T10:50:49.166922+0000 mgr.a (mgr.14373) 13565 : cluster [DBG] pgmap v9408: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:50:51.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:50:51 smithi157 bash[24585]: audit 2024-09-16T10:50:50.169956+0000 mgr.a (mgr.14373) 13566 : audit [DBG] from='client.294714 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:50:51.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:50:51 smithi086 bash[24289]: audit 2024-09-16T10:50:50.169956+0000 mgr.a (mgr.14373) 13566 : audit [DBG] from='client.294714 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:50:51.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:50:51 smithi047 bash[22744]: audit 2024-09-16T10:50:50.169956+0000 mgr.a (mgr.14373) 13566 : audit [DBG] from='client.294714 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:50:52.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:50:52 smithi157 bash[24585]: cluster 2024-09-16T10:50:51.167894+0000 mgr.a (mgr.14373) 13567 : cluster [DBG] pgmap v9409: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:50:52.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:50:52 smithi086 bash[24289]: cluster 2024-09-16T10:50:51.167894+0000 mgr.a (mgr.14373) 13567 : cluster [DBG] pgmap v9409: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:50:52.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:50:52 smithi047 bash[22744]: cluster 2024-09-16T10:50:51.167894+0000 mgr.a (mgr.14373) 13567 : cluster [DBG] pgmap v9409: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:50:54.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:50:54 smithi157 bash[24585]: cluster 2024-09-16T10:50:53.170151+0000 mgr.a (mgr.14373) 13568 : cluster [DBG] pgmap v9410: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:50:54.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:50:54 smithi086 bash[24289]: cluster 2024-09-16T10:50:53.170151+0000 mgr.a (mgr.14373) 13568 : cluster [DBG] pgmap v9410: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:50:54.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:50:54 smithi047 bash[22744]: cluster 2024-09-16T10:50:53.170151+0000 mgr.a (mgr.14373) 13568 : cluster [DBG] pgmap v9410: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:50:55.595 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:50:55.596 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:50:55.596 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:50:56.351 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:50:56.352 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:50:56.352 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:50:56.352 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:50:56.352 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:50:56.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:50:56 smithi157 bash[24585]: cluster 2024-09-16T10:50:55.170938+0000 mgr.a (mgr.14373) 13569 : cluster [DBG] pgmap v9411: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:50:56.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:50:56 smithi086 bash[24289]: cluster 2024-09-16T10:50:55.170938+0000 mgr.a (mgr.14373) 13569 : cluster [DBG] pgmap v9411: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:50:56.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:50:56 smithi047 bash[22744]: cluster 2024-09-16T10:50:55.170938+0000 mgr.a (mgr.14373) 13569 : cluster [DBG] pgmap v9411: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:50:57.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:50:57 smithi157 bash[24585]: audit 2024-09-16T10:50:55.925248+0000 mgr.a (mgr.14373) 13570 : audit [DBG] from='client.294792 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:50:57.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:50:57 smithi086 bash[24289]: audit 2024-09-16T10:50:55.925248+0000 mgr.a (mgr.14373) 13570 : audit [DBG] from='client.294792 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:50:57.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:50:57 smithi047 bash[22744]: audit 2024-09-16T10:50:55.925248+0000 mgr.a (mgr.14373) 13570 : audit [DBG] from='client.294792 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:50:58.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:50:58 smithi157 bash[24585]: cluster 2024-09-16T10:50:57.173268+0000 mgr.a (mgr.14373) 13571 : cluster [DBG] pgmap v9412: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:50:58.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:50:58 smithi086 bash[24289]: cluster 2024-09-16T10:50:57.173268+0000 mgr.a (mgr.14373) 13571 : cluster [DBG] pgmap v9412: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:50:58.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:50:58 smithi047 bash[22744]: cluster 2024-09-16T10:50:57.173268+0000 mgr.a (mgr.14373) 13571 : cluster [DBG] pgmap v9412: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:51:00.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:51:00 smithi157 bash[24585]: cluster 2024-09-16T10:50:59.174042+0000 mgr.a (mgr.14373) 13572 : cluster [DBG] pgmap v9413: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:51:00.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:51:00 smithi086 bash[24289]: cluster 2024-09-16T10:50:59.174042+0000 mgr.a (mgr.14373) 13572 : cluster [DBG] pgmap v9413: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:51:00.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:51:00 smithi047 bash[22744]: cluster 2024-09-16T10:50:59.174042+0000 mgr.a (mgr.14373) 13572 : cluster [DBG] pgmap v9413: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:51:01.353 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:51:01.354 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:51:01.354 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:51:02.104 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:51:02.104 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:51:02.105 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:51:02.105 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:51:02.105 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:51:02.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:51:02 smithi157 bash[24585]: cluster 2024-09-16T10:51:01.174846+0000 mgr.a (mgr.14373) 13573 : cluster [DBG] pgmap v9414: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:51:02.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:51:02 smithi157 bash[24585]: audit 2024-09-16T10:51:01.681802+0000 mgr.a (mgr.14373) 13574 : audit [DBG] from='client.294867 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:51:02.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:51:02 smithi086 bash[24289]: cluster 2024-09-16T10:51:01.174846+0000 mgr.a (mgr.14373) 13573 : cluster [DBG] pgmap v9414: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:51:02.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:51:02 smithi086 bash[24289]: audit 2024-09-16T10:51:01.681802+0000 mgr.a (mgr.14373) 13574 : audit [DBG] from='client.294867 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:51:02.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:51:02 smithi047 bash[22744]: cluster 2024-09-16T10:51:01.174846+0000 mgr.a (mgr.14373) 13573 : cluster [DBG] pgmap v9414: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:51:02.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:51:02 smithi047 bash[22744]: audit 2024-09-16T10:51:01.681802+0000 mgr.a (mgr.14373) 13574 : audit [DBG] from='client.294867 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:51:04.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:51:04 smithi157 bash[24585]: cluster 2024-09-16T10:51:03.177671+0000 mgr.a (mgr.14373) 13575 : cluster [DBG] pgmap v9415: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:51:04.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:51:04 smithi086 bash[24289]: cluster 2024-09-16T10:51:03.177671+0000 mgr.a (mgr.14373) 13575 : cluster [DBG] pgmap v9415: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:51:04.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:51:04 smithi047 bash[22744]: cluster 2024-09-16T10:51:03.177671+0000 mgr.a (mgr.14373) 13575 : cluster [DBG] pgmap v9415: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:51:06.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:51:06 smithi157 bash[24585]: cluster 2024-09-16T10:51:05.178666+0000 mgr.a (mgr.14373) 13576 : cluster [DBG] pgmap v9416: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:51:06.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:51:06 smithi086 bash[24289]: cluster 2024-09-16T10:51:05.178666+0000 mgr.a (mgr.14373) 13576 : cluster [DBG] pgmap v9416: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:51:06.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:51:06 smithi047 bash[22744]: cluster 2024-09-16T10:51:05.178666+0000 mgr.a (mgr.14373) 13576 : cluster [DBG] pgmap v9416: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:51:07.106 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:51:07.106 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:51:07.107 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:51:07.893 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:51:07.893 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:51:07.894 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:51:07.894 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:51:07.894 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:51:08.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:51:08 smithi086 bash[24289]: cluster 2024-09-16T10:51:07.180840+0000 mgr.a (mgr.14373) 13577 : cluster [DBG] pgmap v9417: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:51:08.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:51:08 smithi086 bash[24289]: audit 2024-09-16T10:51:07.442979+0000 mgr.a (mgr.14373) 13578 : audit [DBG] from='client.294945 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:51:08.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:51:08 smithi047 bash[22744]: cluster 2024-09-16T10:51:07.180840+0000 mgr.a (mgr.14373) 13577 : cluster [DBG] pgmap v9417: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:51:08.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:51:08 smithi047 bash[22744]: audit 2024-09-16T10:51:07.442979+0000 mgr.a (mgr.14373) 13578 : audit [DBG] from='client.294945 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:51:09.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:51:08 smithi157 bash[24585]: cluster 2024-09-16T10:51:07.180840+0000 mgr.a (mgr.14373) 13577 : cluster [DBG] pgmap v9417: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:51:09.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:51:08 smithi157 bash[24585]: audit 2024-09-16T10:51:07.442979+0000 mgr.a (mgr.14373) 13578 : audit [DBG] from='client.294945 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:51:10.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:51:10 smithi086 bash[24289]: cluster 2024-09-16T10:51:09.181786+0000 mgr.a (mgr.14373) 13579 : cluster [DBG] pgmap v9418: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:51:10.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:51:10 smithi047 bash[22744]: cluster 2024-09-16T10:51:09.181786+0000 mgr.a (mgr.14373) 13579 : cluster [DBG] pgmap v9418: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:51:11.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:51:10 smithi157 bash[24585]: cluster 2024-09-16T10:51:09.181786+0000 mgr.a (mgr.14373) 13579 : cluster [DBG] pgmap v9418: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:51:12.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:51:12 smithi086 bash[24289]: cluster 2024-09-16T10:51:11.182643+0000 mgr.a (mgr.14373) 13580 : cluster [DBG] pgmap v9419: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:51:12.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:51:12 smithi047 bash[22744]: cluster 2024-09-16T10:51:11.182643+0000 mgr.a (mgr.14373) 13580 : cluster [DBG] pgmap v9419: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:51:12.894 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:51:12.895 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:51:12.895 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:51:13.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:51:12 smithi157 bash[24585]: cluster 2024-09-16T10:51:11.182643+0000 mgr.a (mgr.14373) 13580 : cluster [DBG] pgmap v9419: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:51:13.658 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:51:13.658 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:51:13.658 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:51:13.658 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:51:13.658 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:51:14.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:51:14 smithi086 bash[24289]: cluster 2024-09-16T10:51:13.184778+0000 mgr.a (mgr.14373) 13581 : cluster [DBG] pgmap v9420: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:51:14.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:51:14 smithi086 bash[24289]: audit 2024-09-16T10:51:13.227280+0000 mgr.a (mgr.14373) 13582 : audit [DBG] from='client.295023 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:51:14.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:51:14 smithi047 bash[22744]: cluster 2024-09-16T10:51:13.184778+0000 mgr.a (mgr.14373) 13581 : cluster [DBG] pgmap v9420: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:51:14.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:51:14 smithi047 bash[22744]: audit 2024-09-16T10:51:13.227280+0000 mgr.a (mgr.14373) 13582 : audit [DBG] from='client.295023 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:51:15.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:51:14 smithi157 bash[24585]: cluster 2024-09-16T10:51:13.184778+0000 mgr.a (mgr.14373) 13581 : cluster [DBG] pgmap v9420: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:51:15.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:51:14 smithi157 bash[24585]: audit 2024-09-16T10:51:13.227280+0000 mgr.a (mgr.14373) 13582 : audit [DBG] from='client.295023 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:51:16.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:51:16 smithi047 bash[22744]: cluster 2024-09-16T10:51:15.185701+0000 mgr.a (mgr.14373) 13583 : cluster [DBG] pgmap v9421: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:51:17.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:51:16 smithi157 bash[24585]: cluster 2024-09-16T10:51:15.185701+0000 mgr.a (mgr.14373) 13583 : cluster [DBG] pgmap v9421: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:51:17.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:51:16 smithi086 bash[24289]: cluster 2024-09-16T10:51:15.185701+0000 mgr.a (mgr.14373) 13583 : cluster [DBG] pgmap v9421: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:51:18.659 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:51:18.660 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:51:18.660 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:51:18.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:51:18 smithi047 bash[22744]: cluster 2024-09-16T10:51:17.187903+0000 mgr.a (mgr.14373) 13584 : cluster [DBG] pgmap v9422: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:51:19.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:51:18 smithi157 bash[24585]: cluster 2024-09-16T10:51:17.187903+0000 mgr.a (mgr.14373) 13584 : cluster [DBG] pgmap v9422: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:51:19.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:51:18 smithi086 bash[24289]: cluster 2024-09-16T10:51:17.187903+0000 mgr.a (mgr.14373) 13584 : cluster [DBG] pgmap v9422: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:51:19.444 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:51:19.444 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:51:19.444 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:51:19.444 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:51:19.444 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:51:19.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:51:19 smithi047 bash[22744]: audit 2024-09-16T10:51:19.239855+0000 mon.b (mon.2) 1242 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T10:51:20.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:51:19 smithi157 bash[24585]: audit 2024-09-16T10:51:19.239855+0000 mon.b (mon.2) 1242 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T10:51:20.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:51:19 smithi086 bash[24289]: audit 2024-09-16T10:51:19.239855+0000 mon.b (mon.2) 1242 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T10:51:20.842 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 10:51:20 smithi047 bash[22994]: debug 2024-09-16T10:51:20.783+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T10:51:20.843 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 10:51:20 smithi047 bash[22994]: debug 2024-09-16T10:51:20.783+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T10:51:20.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:51:20 smithi047 bash[22744]: audit 2024-09-16T10:51:18.992943+0000 mgr.a (mgr.14373) 13585 : audit [DBG] from='client.295101 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:51:20.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:51:20 smithi047 bash[22744]: cluster 2024-09-16T10:51:19.188931+0000 mgr.a (mgr.14373) 13586 : cluster [DBG] pgmap v9423: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:51:20.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:51:20 smithi047 bash[22744]: audit 2024-09-16T10:51:20.033429+0000 mon.b (mon.2) 1243 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T10:51:20.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:51:20 smithi047 bash[22744]: audit 2024-09-16T10:51:20.035839+0000 mon.b (mon.2) 1244 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T10:51:20.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:51:20 smithi047 bash[22744]: audit 2024-09-16T10:51:20.047821+0000 mon.a (mon.0) 1382 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:51:20.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:51:20 smithi047 bash[22744]: audit 2024-09-16T10:51:20.053253+0000 mon.b (mon.2) 1245 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:51:21.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:51:20 smithi157 bash[24585]: audit 2024-09-16T10:51:18.992943+0000 mgr.a (mgr.14373) 13585 : audit [DBG] from='client.295101 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:51:21.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:51:20 smithi157 bash[24585]: cluster 2024-09-16T10:51:19.188931+0000 mgr.a (mgr.14373) 13586 : cluster [DBG] pgmap v9423: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:51:21.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:51:20 smithi157 bash[24585]: audit 2024-09-16T10:51:20.033429+0000 mon.b (mon.2) 1243 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T10:51:21.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:51:20 smithi157 bash[24585]: audit 2024-09-16T10:51:20.035839+0000 mon.b (mon.2) 1244 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T10:51:21.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:51:20 smithi157 bash[24585]: audit 2024-09-16T10:51:20.047821+0000 mon.a (mon.0) 1382 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:51:21.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:51:20 smithi157 bash[24585]: audit 2024-09-16T10:51:20.053253+0000 mon.b (mon.2) 1245 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:51:21.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:51:20 smithi086 bash[24289]: audit 2024-09-16T10:51:18.992943+0000 mgr.a (mgr.14373) 13585 : audit [DBG] from='client.295101 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:51:21.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:51:20 smithi086 bash[24289]: cluster 2024-09-16T10:51:19.188931+0000 mgr.a (mgr.14373) 13586 : cluster [DBG] pgmap v9423: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:51:21.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:51:20 smithi086 bash[24289]: audit 2024-09-16T10:51:20.033429+0000 mon.b (mon.2) 1243 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T10:51:21.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:51:20 smithi086 bash[24289]: audit 2024-09-16T10:51:20.035839+0000 mon.b (mon.2) 1244 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T10:51:21.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:51:20 smithi086 bash[24289]: audit 2024-09-16T10:51:20.047821+0000 mon.a (mon.0) 1382 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:51:21.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:51:20 smithi086 bash[24289]: audit 2024-09-16T10:51:20.053253+0000 mon.b (mon.2) 1245 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:51:21.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:51:21 smithi047 bash[22744]: audit 2024-09-16T10:51:20.056474+0000 mgr.a (mgr.14373) 13587 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:51:22.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:51:21 smithi157 bash[24585]: audit 2024-09-16T10:51:20.056474+0000 mgr.a (mgr.14373) 13587 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:51:22.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:51:21 smithi086 bash[24289]: audit 2024-09-16T10:51:20.056474+0000 mgr.a (mgr.14373) 13587 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:51:23.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:51:22 smithi157 bash[24585]: audit 2024-09-16T10:51:20.787975+0000 mgr.a (mgr.14373) 13588 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T10:51:23.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:51:22 smithi157 bash[24585]: cephadm 2024-09-16T10:51:20.789897+0000 mgr.a (mgr.14373) 13589 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T10:51:23.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:51:22 smithi157 bash[24585]: cluster 2024-09-16T10:51:21.189945+0000 mgr.a (mgr.14373) 13590 : cluster [DBG] pgmap v9424: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:51:23.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:51:22 smithi086 bash[24289]: audit 2024-09-16T10:51:20.787975+0000 mgr.a (mgr.14373) 13588 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T10:51:23.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:51:22 smithi086 bash[24289]: cephadm 2024-09-16T10:51:20.789897+0000 mgr.a (mgr.14373) 13589 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T10:51:23.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:51:22 smithi086 bash[24289]: cluster 2024-09-16T10:51:21.189945+0000 mgr.a (mgr.14373) 13590 : cluster [DBG] pgmap v9424: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:51:23.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:51:22 smithi047 bash[22744]: audit 2024-09-16T10:51:20.787975+0000 mgr.a (mgr.14373) 13588 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T10:51:23.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:51:22 smithi047 bash[22744]: cephadm 2024-09-16T10:51:20.789897+0000 mgr.a (mgr.14373) 13589 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T10:51:23.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:51:22 smithi047 bash[22744]: cluster 2024-09-16T10:51:21.189945+0000 mgr.a (mgr.14373) 13590 : cluster [DBG] pgmap v9424: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:51:24.446 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:51:24.446 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:51:24.446 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:51:25.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:51:24 smithi157 bash[24585]: cluster 2024-09-16T10:51:23.192227+0000 mgr.a (mgr.14373) 13591 : cluster [DBG] pgmap v9425: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:51:25.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:51:24 smithi086 bash[24289]: cluster 2024-09-16T10:51:23.192227+0000 mgr.a (mgr.14373) 13591 : cluster [DBG] pgmap v9425: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:51:25.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:51:24 smithi047 bash[22744]: cluster 2024-09-16T10:51:23.192227+0000 mgr.a (mgr.14373) 13591 : cluster [DBG] pgmap v9425: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:51:25.218 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:51:25.219 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:51:25.219 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:51:25.219 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:51:25.219 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:51:27.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:51:26 smithi157 bash[24585]: audit 2024-09-16T10:51:24.781187+0000 mgr.a (mgr.14373) 13592 : audit [DBG] from='client.295284 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:51:27.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:51:26 smithi157 bash[24585]: cluster 2024-09-16T10:51:25.192701+0000 mgr.a (mgr.14373) 13593 : cluster [DBG] pgmap v9426: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:51:27.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:51:26 smithi086 bash[24289]: audit 2024-09-16T10:51:24.781187+0000 mgr.a (mgr.14373) 13592 : audit [DBG] from='client.295284 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:51:27.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:51:26 smithi086 bash[24289]: cluster 2024-09-16T10:51:25.192701+0000 mgr.a (mgr.14373) 13593 : cluster [DBG] pgmap v9426: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:51:27.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:51:26 smithi047 bash[22744]: audit 2024-09-16T10:51:24.781187+0000 mgr.a (mgr.14373) 13592 : audit [DBG] from='client.295284 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:51:27.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:51:26 smithi047 bash[22744]: cluster 2024-09-16T10:51:25.192701+0000 mgr.a (mgr.14373) 13593 : cluster [DBG] pgmap v9426: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:51:29.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:51:28 smithi157 bash[24585]: cluster 2024-09-16T10:51:27.194816+0000 mgr.a (mgr.14373) 13594 : cluster [DBG] pgmap v9427: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:51:29.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:51:28 smithi086 bash[24289]: cluster 2024-09-16T10:51:27.194816+0000 mgr.a (mgr.14373) 13594 : cluster [DBG] pgmap v9427: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:51:29.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:51:28 smithi047 bash[22744]: cluster 2024-09-16T10:51:27.194816+0000 mgr.a (mgr.14373) 13594 : cluster [DBG] pgmap v9427: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:51:30.220 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:51:30.221 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:51:30.221 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:51:30.992 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:51:30.993 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:51:30.993 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:51:30.993 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:51:30.993 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:51:31.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:51:30 smithi157 bash[24585]: cluster 2024-09-16T10:51:29.195790+0000 mgr.a (mgr.14373) 13595 : cluster [DBG] pgmap v9428: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:51:31.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:51:30 smithi086 bash[24289]: cluster 2024-09-16T10:51:29.195790+0000 mgr.a (mgr.14373) 13595 : cluster [DBG] pgmap v9428: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:51:31.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:51:30 smithi047 bash[22744]: cluster 2024-09-16T10:51:29.195790+0000 mgr.a (mgr.14373) 13595 : cluster [DBG] pgmap v9428: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:51:32.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:51:31 smithi157 bash[24585]: audit 2024-09-16T10:51:30.556512+0000 mgr.a (mgr.14373) 13596 : audit [DBG] from='client.295362 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:51:32.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:51:31 smithi086 bash[24289]: audit 2024-09-16T10:51:30.556512+0000 mgr.a (mgr.14373) 13596 : audit [DBG] from='client.295362 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:51:32.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:51:31 smithi047 bash[22744]: audit 2024-09-16T10:51:30.556512+0000 mgr.a (mgr.14373) 13596 : audit [DBG] from='client.295362 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:51:33.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:51:32 smithi157 bash[24585]: cluster 2024-09-16T10:51:31.196794+0000 mgr.a (mgr.14373) 13597 : cluster [DBG] pgmap v9429: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:51:33.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:51:32 smithi086 bash[24289]: cluster 2024-09-16T10:51:31.196794+0000 mgr.a (mgr.14373) 13597 : cluster [DBG] pgmap v9429: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:51:33.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:51:32 smithi047 bash[22744]: cluster 2024-09-16T10:51:31.196794+0000 mgr.a (mgr.14373) 13597 : cluster [DBG] pgmap v9429: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:51:35.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:51:34 smithi157 bash[24585]: cluster 2024-09-16T10:51:33.199095+0000 mgr.a (mgr.14373) 13598 : cluster [DBG] pgmap v9430: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:51:35.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:51:34 smithi086 bash[24289]: cluster 2024-09-16T10:51:33.199095+0000 mgr.a (mgr.14373) 13598 : cluster [DBG] pgmap v9430: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:51:35.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:51:34 smithi047 bash[22744]: cluster 2024-09-16T10:51:33.199095+0000 mgr.a (mgr.14373) 13598 : cluster [DBG] pgmap v9430: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:51:35.994 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:51:35.995 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:51:35.995 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:51:36.766 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:51:36.766 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:51:36.766 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:51:36.766 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:51:36.766 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:51:37.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:51:36 smithi157 bash[24585]: cluster 2024-09-16T10:51:35.199876+0000 mgr.a (mgr.14373) 13599 : cluster [DBG] pgmap v9431: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:51:37.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:51:36 smithi086 bash[24289]: cluster 2024-09-16T10:51:35.199876+0000 mgr.a (mgr.14373) 13599 : cluster [DBG] pgmap v9431: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:51:37.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:51:36 smithi047 bash[22744]: cluster 2024-09-16T10:51:35.199876+0000 mgr.a (mgr.14373) 13599 : cluster [DBG] pgmap v9431: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:51:38.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:51:37 smithi157 bash[24585]: audit 2024-09-16T10:51:36.323932+0000 mgr.a (mgr.14373) 13600 : audit [DBG] from='client.295437 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:51:38.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:51:37 smithi086 bash[24289]: audit 2024-09-16T10:51:36.323932+0000 mgr.a (mgr.14373) 13600 : audit [DBG] from='client.295437 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:51:38.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:51:37 smithi047 bash[22744]: audit 2024-09-16T10:51:36.323932+0000 mgr.a (mgr.14373) 13600 : audit [DBG] from='client.295437 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:51:39.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:51:38 smithi157 bash[24585]: cluster 2024-09-16T10:51:37.202321+0000 mgr.a (mgr.14373) 13601 : cluster [DBG] pgmap v9432: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-16T10:51:39.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:51:38 smithi086 bash[24289]: cluster 2024-09-16T10:51:37.202321+0000 mgr.a (mgr.14373) 13601 : cluster [DBG] pgmap v9432: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-16T10:51:39.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:51:38 smithi047 bash[22744]: cluster 2024-09-16T10:51:37.202321+0000 mgr.a (mgr.14373) 13601 : cluster [DBG] pgmap v9432: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-16T10:51:41.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:51:40 smithi157 bash[24585]: cluster 2024-09-16T10:51:39.203125+0000 mgr.a (mgr.14373) 13602 : cluster [DBG] pgmap v9433: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T10:51:41.072 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:51:40 smithi086 bash[24289]: cluster 2024-09-16T10:51:39.203125+0000 mgr.a (mgr.14373) 13602 : cluster [DBG] pgmap v9433: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T10:51:41.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:51:40 smithi047 bash[22744]: cluster 2024-09-16T10:51:39.203125+0000 mgr.a (mgr.14373) 13602 : cluster [DBG] pgmap v9433: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T10:51:41.767 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:51:41.768 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:51:41.768 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:51:42.554 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:51:42.554 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:51:42.554 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:51:42.554 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:51:42.554 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:51:43.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:51:42 smithi157 bash[24585]: cluster 2024-09-16T10:51:41.203908+0000 mgr.a (mgr.14373) 13603 : cluster [DBG] pgmap v9434: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T10:51:43.542 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:51:42 smithi047 bash[22744]: cluster 2024-09-16T10:51:41.203908+0000 mgr.a (mgr.14373) 13603 : cluster [DBG] pgmap v9434: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T10:51:43.542 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:51:42 smithi086 bash[24289]: cluster 2024-09-16T10:51:41.203908+0000 mgr.a (mgr.14373) 13603 : cluster [DBG] pgmap v9434: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T10:51:44.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:51:43 smithi157 bash[24585]: audit 2024-09-16T10:51:42.110509+0000 mgr.a (mgr.14373) 13604 : audit [DBG] from='client.295512 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:51:44.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:51:43 smithi086 bash[24289]: audit 2024-09-16T10:51:42.110509+0000 mgr.a (mgr.14373) 13604 : audit [DBG] from='client.295512 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:51:44.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:51:43 smithi047 bash[22744]: audit 2024-09-16T10:51:42.110509+0000 mgr.a (mgr.14373) 13604 : audit [DBG] from='client.295512 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:51:45.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:51:44 smithi157 bash[24585]: cluster 2024-09-16T10:51:43.206693+0000 mgr.a (mgr.14373) 13605 : cluster [DBG] pgmap v9435: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:51:45.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:51:44 smithi086 bash[24289]: cluster 2024-09-16T10:51:43.206693+0000 mgr.a (mgr.14373) 13605 : cluster [DBG] pgmap v9435: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:51:45.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:51:44 smithi047 bash[22744]: cluster 2024-09-16T10:51:43.206693+0000 mgr.a (mgr.14373) 13605 : cluster [DBG] pgmap v9435: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:51:47.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:51:46 smithi157 bash[24585]: cluster 2024-09-16T10:51:45.207496+0000 mgr.a (mgr.14373) 13606 : cluster [DBG] pgmap v9436: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:51:47.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:51:46 smithi086 bash[24289]: cluster 2024-09-16T10:51:45.207496+0000 mgr.a (mgr.14373) 13606 : cluster [DBG] pgmap v9436: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:51:47.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:51:46 smithi047 bash[22744]: cluster 2024-09-16T10:51:45.207496+0000 mgr.a (mgr.14373) 13606 : cluster [DBG] pgmap v9436: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:51:47.556 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:51:47.556 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:51:47.556 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:51:48.310 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:51:48.311 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:51:48.311 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:51:48.311 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:51:48.311 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:51:49.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:51:48 smithi157 bash[24585]: cluster 2024-09-16T10:51:47.209445+0000 mgr.a (mgr.14373) 13607 : cluster [DBG] pgmap v9437: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:51:49.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:51:48 smithi086 bash[24289]: cluster 2024-09-16T10:51:47.209445+0000 mgr.a (mgr.14373) 13607 : cluster [DBG] pgmap v9437: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:51:49.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:51:48 smithi047 bash[22744]: cluster 2024-09-16T10:51:47.209445+0000 mgr.a (mgr.14373) 13607 : cluster [DBG] pgmap v9437: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:51:50.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:51:49 smithi157 bash[24585]: audit 2024-09-16T10:51:47.889182+0000 mgr.a (mgr.14373) 13608 : audit [DBG] from='client.295587 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:51:50.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:51:49 smithi086 bash[24289]: audit 2024-09-16T10:51:47.889182+0000 mgr.a (mgr.14373) 13608 : audit [DBG] from='client.295587 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:51:50.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:51:49 smithi047 bash[22744]: audit 2024-09-16T10:51:47.889182+0000 mgr.a (mgr.14373) 13608 : audit [DBG] from='client.295587 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:51:51.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:51:50 smithi157 bash[24585]: cluster 2024-09-16T10:51:49.210326+0000 mgr.a (mgr.14373) 13609 : cluster [DBG] pgmap v9438: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-16T10:51:51.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:51:50 smithi086 bash[24289]: cluster 2024-09-16T10:51:49.210326+0000 mgr.a (mgr.14373) 13609 : cluster [DBG] pgmap v9438: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-16T10:51:51.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:51:50 smithi047 bash[22744]: cluster 2024-09-16T10:51:49.210326+0000 mgr.a (mgr.14373) 13609 : cluster [DBG] pgmap v9438: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-16T10:51:53.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:51:52 smithi157 bash[24585]: cluster 2024-09-16T10:51:51.211131+0000 mgr.a (mgr.14373) 13610 : cluster [DBG] pgmap v9439: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-16T10:51:53.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:51:52 smithi086 bash[24289]: cluster 2024-09-16T10:51:51.211131+0000 mgr.a (mgr.14373) 13610 : cluster [DBG] pgmap v9439: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-16T10:51:53.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:51:52 smithi047 bash[22744]: cluster 2024-09-16T10:51:51.211131+0000 mgr.a (mgr.14373) 13610 : cluster [DBG] pgmap v9439: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-16T10:51:53.312 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:51:53.313 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:51:53.313 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:51:54.089 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:51:54.090 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:51:54.090 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:51:54.090 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:51:54.090 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:51:55.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:51:54 smithi157 bash[24585]: cluster 2024-09-16T10:51:53.213340+0000 mgr.a (mgr.14373) 13611 : cluster [DBG] pgmap v9440: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-16T10:51:55.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:51:54 smithi157 bash[24585]: audit 2024-09-16T10:51:53.647347+0000 mgr.a (mgr.14373) 13612 : audit [DBG] from='client.295665 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:51:55.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:51:54 smithi086 bash[24289]: cluster 2024-09-16T10:51:53.213340+0000 mgr.a (mgr.14373) 13611 : cluster [DBG] pgmap v9440: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-16T10:51:55.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:51:54 smithi086 bash[24289]: audit 2024-09-16T10:51:53.647347+0000 mgr.a (mgr.14373) 13612 : audit [DBG] from='client.295665 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:51:55.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:51:54 smithi047 bash[22744]: cluster 2024-09-16T10:51:53.213340+0000 mgr.a (mgr.14373) 13611 : cluster [DBG] pgmap v9440: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-16T10:51:55.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:51:54 smithi047 bash[22744]: audit 2024-09-16T10:51:53.647347+0000 mgr.a (mgr.14373) 13612 : audit [DBG] from='client.295665 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:51:57.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:51:56 smithi157 bash[24585]: cluster 2024-09-16T10:51:55.214230+0000 mgr.a (mgr.14373) 13613 : cluster [DBG] pgmap v9441: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:51:57.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:51:56 smithi086 bash[24289]: cluster 2024-09-16T10:51:55.214230+0000 mgr.a (mgr.14373) 13613 : cluster [DBG] pgmap v9441: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:51:57.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:51:56 smithi047 bash[22744]: cluster 2024-09-16T10:51:55.214230+0000 mgr.a (mgr.14373) 13613 : cluster [DBG] pgmap v9441: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:51:59.071 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:51:58 smithi157 bash[24585]: cluster 2024-09-16T10:51:57.216419+0000 mgr.a (mgr.14373) 13614 : cluster [DBG] pgmap v9442: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:51:59.075 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:51:58 smithi086 bash[24289]: cluster 2024-09-16T10:51:57.216419+0000 mgr.a (mgr.14373) 13614 : cluster [DBG] pgmap v9442: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:51:59.100 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:51:59.101 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:51:59.101 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:51:59.101 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:51:58 smithi047 bash[22744]: cluster 2024-09-16T10:51:57.216419+0000 mgr.a (mgr.14373) 13614 : cluster [DBG] pgmap v9442: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:51:59.869 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:51:59.869 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:51:59.869 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:51:59.870 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:51:59.870 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:52:01.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:52:00 smithi157 bash[24585]: cluster 2024-09-16T10:51:59.217225+0000 mgr.a (mgr.14373) 13615 : cluster [DBG] pgmap v9443: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:52:01.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:52:00 smithi157 bash[24585]: audit 2024-09-16T10:51:59.428492+0000 mgr.a (mgr.14373) 13616 : audit [DBG] from='client.295740 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:52:01.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:52:00 smithi086 bash[24289]: cluster 2024-09-16T10:51:59.217225+0000 mgr.a (mgr.14373) 13615 : cluster [DBG] pgmap v9443: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:52:01.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:52:00 smithi086 bash[24289]: audit 2024-09-16T10:51:59.428492+0000 mgr.a (mgr.14373) 13616 : audit [DBG] from='client.295740 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:52:01.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:52:00 smithi047 bash[22744]: cluster 2024-09-16T10:51:59.217225+0000 mgr.a (mgr.14373) 13615 : cluster [DBG] pgmap v9443: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:52:01.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:52:00 smithi047 bash[22744]: audit 2024-09-16T10:51:59.428492+0000 mgr.a (mgr.14373) 13616 : audit [DBG] from='client.295740 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:52:02.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:52:01 smithi157 bash[24585]: cluster 2024-09-16T10:52:01.218155+0000 mgr.a (mgr.14373) 13617 : cluster [DBG] pgmap v9444: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:52:02.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:52:01 smithi086 bash[24289]: cluster 2024-09-16T10:52:01.218155+0000 mgr.a (mgr.14373) 13617 : cluster [DBG] pgmap v9444: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:52:02.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:52:01 smithi047 bash[22744]: cluster 2024-09-16T10:52:01.218155+0000 mgr.a (mgr.14373) 13617 : cluster [DBG] pgmap v9444: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:52:04.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:52:04 smithi157 bash[24585]: cluster 2024-09-16T10:52:03.220369+0000 mgr.a (mgr.14373) 13618 : cluster [DBG] pgmap v9445: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:52:04.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:52:04 smithi086 bash[24289]: cluster 2024-09-16T10:52:03.220369+0000 mgr.a (mgr.14373) 13618 : cluster [DBG] pgmap v9445: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:52:04.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:52:04 smithi047 bash[22744]: cluster 2024-09-16T10:52:03.220369+0000 mgr.a (mgr.14373) 13618 : cluster [DBG] pgmap v9445: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:52:04.871 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:52:04.872 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:52:04.872 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:52:05.618 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:52:05.618 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:52:05.618 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:52:05.619 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:52:05.619 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:52:06.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:52:06 smithi157 bash[24585]: audit 2024-09-16T10:52:05.196792+0000 mgr.a (mgr.14373) 13619 : audit [DBG] from='client.295818 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:52:06.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:52:06 smithi157 bash[24585]: cluster 2024-09-16T10:52:05.221358+0000 mgr.a (mgr.14373) 13620 : cluster [DBG] pgmap v9446: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:52:06.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:52:06 smithi086 bash[24289]: audit 2024-09-16T10:52:05.196792+0000 mgr.a (mgr.14373) 13619 : audit [DBG] from='client.295818 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:52:06.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:52:06 smithi086 bash[24289]: cluster 2024-09-16T10:52:05.221358+0000 mgr.a (mgr.14373) 13620 : cluster [DBG] pgmap v9446: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:52:06.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:52:06 smithi047 bash[22744]: audit 2024-09-16T10:52:05.196792+0000 mgr.a (mgr.14373) 13619 : audit [DBG] from='client.295818 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:52:06.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:52:06 smithi047 bash[22744]: cluster 2024-09-16T10:52:05.221358+0000 mgr.a (mgr.14373) 13620 : cluster [DBG] pgmap v9446: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:52:08.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:52:08 smithi157 bash[24585]: cluster 2024-09-16T10:52:07.223686+0000 mgr.a (mgr.14373) 13621 : cluster [DBG] pgmap v9447: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:52:08.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:52:08 smithi086 bash[24289]: cluster 2024-09-16T10:52:07.223686+0000 mgr.a (mgr.14373) 13621 : cluster [DBG] pgmap v9447: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:52:08.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:52:08 smithi047 bash[22744]: cluster 2024-09-16T10:52:07.223686+0000 mgr.a (mgr.14373) 13621 : cluster [DBG] pgmap v9447: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:52:10.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:52:10 smithi157 bash[24585]: cluster 2024-09-16T10:52:09.224468+0000 mgr.a (mgr.14373) 13622 : cluster [DBG] pgmap v9448: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:52:10.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:52:10 smithi086 bash[24289]: cluster 2024-09-16T10:52:09.224468+0000 mgr.a (mgr.14373) 13622 : cluster [DBG] pgmap v9448: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:52:10.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:52:10 smithi047 bash[22744]: cluster 2024-09-16T10:52:09.224468+0000 mgr.a (mgr.14373) 13622 : cluster [DBG] pgmap v9448: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:52:10.619 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:52:10.620 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:52:10.621 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:52:11.389 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:52:11.390 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:52:11.390 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:52:11.390 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:52:11.390 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:52:12.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:52:12 smithi157 bash[24585]: audit 2024-09-16T10:52:10.954796+0000 mgr.a (mgr.14373) 13623 : audit [DBG] from='client.295896 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:52:12.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:52:12 smithi157 bash[24585]: cluster 2024-09-16T10:52:11.225087+0000 mgr.a (mgr.14373) 13624 : cluster [DBG] pgmap v9449: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:52:12.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:52:12 smithi086 bash[24289]: audit 2024-09-16T10:52:10.954796+0000 mgr.a (mgr.14373) 13623 : audit [DBG] from='client.295896 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:52:12.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:52:12 smithi086 bash[24289]: cluster 2024-09-16T10:52:11.225087+0000 mgr.a (mgr.14373) 13624 : cluster [DBG] pgmap v9449: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:52:12.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:52:12 smithi047 bash[22744]: audit 2024-09-16T10:52:10.954796+0000 mgr.a (mgr.14373) 13623 : audit [DBG] from='client.295896 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:52:12.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:52:12 smithi047 bash[22744]: cluster 2024-09-16T10:52:11.225087+0000 mgr.a (mgr.14373) 13624 : cluster [DBG] pgmap v9449: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:52:14.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:52:14 smithi157 bash[24585]: cluster 2024-09-16T10:52:13.227449+0000 mgr.a (mgr.14373) 13625 : cluster [DBG] pgmap v9450: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:52:14.681 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:52:14 smithi047 bash[22744]: cluster 2024-09-16T10:52:13.227449+0000 mgr.a (mgr.14373) 13625 : cluster [DBG] pgmap v9450: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:52:14.681 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:52:14 smithi086 bash[24289]: cluster 2024-09-16T10:52:13.227449+0000 mgr.a (mgr.14373) 13625 : cluster [DBG] pgmap v9450: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:52:16.391 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:52:16.392 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:52:16.392 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:52:16.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:52:16 smithi157 bash[24585]: cluster 2024-09-16T10:52:15.228188+0000 mgr.a (mgr.14373) 13626 : cluster [DBG] pgmap v9451: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:52:16.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:52:16 smithi086 bash[24289]: cluster 2024-09-16T10:52:15.228188+0000 mgr.a (mgr.14373) 13626 : cluster [DBG] pgmap v9451: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:52:16.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:52:16 smithi047 bash[22744]: cluster 2024-09-16T10:52:15.228188+0000 mgr.a (mgr.14373) 13626 : cluster [DBG] pgmap v9451: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:52:17.146 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:52:17.146 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:52:17.146 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:52:17.146 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:52:17.146 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:52:18.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:52:18 smithi086 bash[24289]: audit 2024-09-16T10:52:16.723629+0000 mgr.a (mgr.14373) 13627 : audit [DBG] from='client.295968 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:52:18.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:52:18 smithi086 bash[24289]: cluster 2024-09-16T10:52:17.231105+0000 mgr.a (mgr.14373) 13628 : cluster [DBG] pgmap v9452: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:52:18.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:52:18 smithi047 bash[22744]: audit 2024-09-16T10:52:16.723629+0000 mgr.a (mgr.14373) 13627 : audit [DBG] from='client.295968 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:52:18.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:52:18 smithi047 bash[22744]: cluster 2024-09-16T10:52:17.231105+0000 mgr.a (mgr.14373) 13628 : cluster [DBG] pgmap v9452: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:52:18.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:52:18 smithi157 bash[24585]: audit 2024-09-16T10:52:16.723629+0000 mgr.a (mgr.14373) 13627 : audit [DBG] from='client.295968 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:52:18.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:52:18 smithi157 bash[24585]: cluster 2024-09-16T10:52:17.231105+0000 mgr.a (mgr.14373) 13628 : cluster [DBG] pgmap v9452: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:52:20.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:52:20 smithi086 bash[24289]: cluster 2024-09-16T10:52:19.232092+0000 mgr.a (mgr.14373) 13629 : cluster [DBG] pgmap v9453: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:52:20.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:52:20 smithi047 bash[22744]: cluster 2024-09-16T10:52:19.232092+0000 mgr.a (mgr.14373) 13629 : cluster [DBG] pgmap v9453: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:52:20.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:52:20 smithi157 bash[24585]: cluster 2024-09-16T10:52:19.232092+0000 mgr.a (mgr.14373) 13629 : cluster [DBG] pgmap v9453: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:52:21.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:52:21 smithi047 bash[22744]: audit 2024-09-16T10:52:20.843277+0000 mon.b (mon.2) 1246 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T10:52:21.808 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:52:21 smithi157 bash[24585]: audit 2024-09-16T10:52:20.843277+0000 mon.b (mon.2) 1246 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T10:52:21.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:52:21 smithi086 bash[24289]: audit 2024-09-16T10:52:20.843277+0000 mon.b (mon.2) 1246 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T10:52:22.147 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:52:22.147 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:52:22.147 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:52:22.592 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 10:52:22 smithi047 bash[22994]: debug 2024-09-16T10:52:22.438+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T10:52:22.592 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 10:52:22 smithi047 bash[22994]: debug 2024-09-16T10:52:22.438+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T10:52:22.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:52:22 smithi047 bash[22744]: cluster 2024-09-16T10:52:21.232670+0000 mgr.a (mgr.14373) 13630 : cluster [DBG] pgmap v9454: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T10:52:22.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:52:22 smithi047 bash[22744]: audit 2024-09-16T10:52:21.685536+0000 mon.b (mon.2) 1247 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T10:52:22.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:52:22 smithi047 bash[22744]: audit 2024-09-16T10:52:21.687236+0000 mon.b (mon.2) 1248 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T10:52:22.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:52:22 smithi047 bash[22744]: audit 2024-09-16T10:52:21.697460+0000 mon.a (mon.0) 1383 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:52:22.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:52:22 smithi047 bash[22744]: audit 2024-09-16T10:52:21.701822+0000 mon.b (mon.2) 1249 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:52:22.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:52:22 smithi047 bash[22744]: audit 2024-09-16T10:52:21.704649+0000 mgr.a (mgr.14373) 13631 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:52:22.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:52:22 smithi157 bash[24585]: cluster 2024-09-16T10:52:21.232670+0000 mgr.a (mgr.14373) 13630 : cluster [DBG] pgmap v9454: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T10:52:22.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:52:22 smithi157 bash[24585]: audit 2024-09-16T10:52:21.685536+0000 mon.b (mon.2) 1247 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T10:52:22.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:52:22 smithi157 bash[24585]: audit 2024-09-16T10:52:21.687236+0000 mon.b (mon.2) 1248 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T10:52:22.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:52:22 smithi157 bash[24585]: audit 2024-09-16T10:52:21.697460+0000 mon.a (mon.0) 1383 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:52:22.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:52:22 smithi157 bash[24585]: audit 2024-09-16T10:52:21.701822+0000 mon.b (mon.2) 1249 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:52:22.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:52:22 smithi157 bash[24585]: audit 2024-09-16T10:52:21.704649+0000 mgr.a (mgr.14373) 13631 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:52:22.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:52:22 smithi086 bash[24289]: cluster 2024-09-16T10:52:21.232670+0000 mgr.a (mgr.14373) 13630 : cluster [DBG] pgmap v9454: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T10:52:22.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:52:22 smithi086 bash[24289]: audit 2024-09-16T10:52:21.685536+0000 mon.b (mon.2) 1247 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T10:52:22.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:52:22 smithi086 bash[24289]: audit 2024-09-16T10:52:21.687236+0000 mon.b (mon.2) 1248 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T10:52:22.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:52:22 smithi086 bash[24289]: audit 2024-09-16T10:52:21.697460+0000 mon.a (mon.0) 1383 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:52:22.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:52:22 smithi086 bash[24289]: audit 2024-09-16T10:52:21.701822+0000 mon.b (mon.2) 1249 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:52:22.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:52:22 smithi086 bash[24289]: audit 2024-09-16T10:52:21.704649+0000 mgr.a (mgr.14373) 13631 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:52:22.872 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:52:22.872 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:52:22.873 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:52:22.873 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:52:22.873 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:52:23.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:52:23 smithi047 bash[22744]: audit 2024-09-16T10:52:22.439392+0000 mgr.a (mgr.14373) 13632 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T10:52:23.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:52:23 smithi047 bash[22744]: cephadm 2024-09-16T10:52:22.441095+0000 mgr.a (mgr.14373) 13633 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T10:52:23.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:52:23 smithi047 bash[22744]: audit 2024-09-16T10:52:22.472054+0000 mgr.a (mgr.14373) 13634 : audit [DBG] from='client.296133 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:52:23.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:52:23 smithi157 bash[24585]: audit 2024-09-16T10:52:22.439392+0000 mgr.a (mgr.14373) 13632 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T10:52:23.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:52:23 smithi157 bash[24585]: cephadm 2024-09-16T10:52:22.441095+0000 mgr.a (mgr.14373) 13633 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T10:52:23.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:52:23 smithi157 bash[24585]: audit 2024-09-16T10:52:22.472054+0000 mgr.a (mgr.14373) 13634 : audit [DBG] from='client.296133 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:52:23.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:52:23 smithi086 bash[24289]: audit 2024-09-16T10:52:22.439392+0000 mgr.a (mgr.14373) 13632 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T10:52:23.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:52:23 smithi086 bash[24289]: cephadm 2024-09-16T10:52:22.441095+0000 mgr.a (mgr.14373) 13633 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T10:52:23.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:52:23 smithi086 bash[24289]: audit 2024-09-16T10:52:22.472054+0000 mgr.a (mgr.14373) 13634 : audit [DBG] from='client.296133 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:52:24.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:52:24 smithi047 bash[22744]: cluster 2024-09-16T10:52:23.235283+0000 mgr.a (mgr.14373) 13635 : cluster [DBG] pgmap v9455: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-16T10:52:24.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:52:24 smithi157 bash[24585]: cluster 2024-09-16T10:52:23.235283+0000 mgr.a (mgr.14373) 13635 : cluster [DBG] pgmap v9455: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-16T10:52:24.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:52:24 smithi086 bash[24289]: cluster 2024-09-16T10:52:23.235283+0000 mgr.a (mgr.14373) 13635 : cluster [DBG] pgmap v9455: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-16T10:52:26.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:52:26 smithi047 bash[22744]: cluster 2024-09-16T10:52:25.236034+0000 mgr.a (mgr.14373) 13636 : cluster [DBG] pgmap v9456: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-16T10:52:26.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:52:26 smithi157 bash[24585]: cluster 2024-09-16T10:52:25.236034+0000 mgr.a (mgr.14373) 13636 : cluster [DBG] pgmap v9456: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-16T10:52:26.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:52:26 smithi086 bash[24289]: cluster 2024-09-16T10:52:25.236034+0000 mgr.a (mgr.14373) 13636 : cluster [DBG] pgmap v9456: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-16T10:52:27.874 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:52:27.874 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:52:27.875 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:52:28.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:52:28 smithi047 bash[22744]: cluster 2024-09-16T10:52:27.237975+0000 mgr.a (mgr.14373) 13637 : cluster [DBG] pgmap v9457: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:52:28.628 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:52:28.628 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:52:28.628 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:52:28.629 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:52:28.629 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:52:28.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:52:28 smithi157 bash[24585]: cluster 2024-09-16T10:52:27.237975+0000 mgr.a (mgr.14373) 13637 : cluster [DBG] pgmap v9457: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:52:28.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:52:28 smithi086 bash[24289]: cluster 2024-09-16T10:52:27.237975+0000 mgr.a (mgr.14373) 13637 : cluster [DBG] pgmap v9457: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:52:29.808 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:52:29 smithi157 bash[24585]: audit 2024-09-16T10:52:28.201553+0000 mgr.a (mgr.14373) 13638 : audit [DBG] from='client.296226 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:52:29.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:52:29 smithi086 bash[24289]: audit 2024-09-16T10:52:28.201553+0000 mgr.a (mgr.14373) 13638 : audit [DBG] from='client.296226 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:52:29.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:52:29 smithi047 bash[22744]: audit 2024-09-16T10:52:28.201553+0000 mgr.a (mgr.14373) 13638 : audit [DBG] from='client.296226 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:52:30.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:52:30 smithi157 bash[24585]: cluster 2024-09-16T10:52:29.238878+0000 mgr.a (mgr.14373) 13639 : cluster [DBG] pgmap v9458: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:52:30.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:52:30 smithi086 bash[24289]: cluster 2024-09-16T10:52:29.238878+0000 mgr.a (mgr.14373) 13639 : cluster [DBG] pgmap v9458: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:52:30.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:52:30 smithi047 bash[22744]: cluster 2024-09-16T10:52:29.238878+0000 mgr.a (mgr.14373) 13639 : cluster [DBG] pgmap v9458: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:52:32.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:52:32 smithi157 bash[24585]: cluster 2024-09-16T10:52:31.239783+0000 mgr.a (mgr.14373) 13640 : cluster [DBG] pgmap v9459: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:52:32.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:52:32 smithi086 bash[24289]: cluster 2024-09-16T10:52:31.239783+0000 mgr.a (mgr.14373) 13640 : cluster [DBG] pgmap v9459: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:52:32.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:52:32 smithi047 bash[22744]: cluster 2024-09-16T10:52:31.239783+0000 mgr.a (mgr.14373) 13640 : cluster [DBG] pgmap v9459: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:52:33.630 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:52:33.631 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:52:33.631 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:52:34.401 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:52:34.401 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:52:34.401 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:52:34.401 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:52:34.402 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:52:34.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:52:34 smithi157 bash[24585]: cluster 2024-09-16T10:52:33.242180+0000 mgr.a (mgr.14373) 13641 : cluster [DBG] pgmap v9460: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:52:34.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:52:34 smithi086 bash[24289]: cluster 2024-09-16T10:52:33.242180+0000 mgr.a (mgr.14373) 13641 : cluster [DBG] pgmap v9460: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:52:34.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:52:34 smithi047 bash[22744]: cluster 2024-09-16T10:52:33.242180+0000 mgr.a (mgr.14373) 13641 : cluster [DBG] pgmap v9460: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:52:35.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:52:35 smithi157 bash[24585]: audit 2024-09-16T10:52:33.961650+0000 mgr.a (mgr.14373) 13642 : audit [DBG] from='client.296298 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:52:35.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:52:35 smithi086 bash[24289]: audit 2024-09-16T10:52:33.961650+0000 mgr.a (mgr.14373) 13642 : audit [DBG] from='client.296298 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:52:35.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:52:35 smithi047 bash[22744]: audit 2024-09-16T10:52:33.961650+0000 mgr.a (mgr.14373) 13642 : audit [DBG] from='client.296298 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:52:36.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:52:36 smithi157 bash[24585]: cluster 2024-09-16T10:52:35.243110+0000 mgr.a (mgr.14373) 13643 : cluster [DBG] pgmap v9461: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 6.9 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T10:52:36.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:52:36 smithi086 bash[24289]: cluster 2024-09-16T10:52:35.243110+0000 mgr.a (mgr.14373) 13643 : cluster [DBG] pgmap v9461: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 6.9 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T10:52:36.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:52:36 smithi047 bash[22744]: cluster 2024-09-16T10:52:35.243110+0000 mgr.a (mgr.14373) 13643 : cluster [DBG] pgmap v9461: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 6.9 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T10:52:38.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:52:38 smithi157 bash[24585]: cluster 2024-09-16T10:52:37.245281+0000 mgr.a (mgr.14373) 13644 : cluster [DBG] pgmap v9462: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 7.8 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:52:38.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:52:38 smithi086 bash[24289]: cluster 2024-09-16T10:52:37.245281+0000 mgr.a (mgr.14373) 13644 : cluster [DBG] pgmap v9462: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 7.8 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:52:38.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:52:38 smithi047 bash[22744]: cluster 2024-09-16T10:52:37.245281+0000 mgr.a (mgr.14373) 13644 : cluster [DBG] pgmap v9462: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 7.8 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:52:39.403 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:52:39.403 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:52:39.404 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:52:40.144 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:52:40.144 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:52:40.145 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:52:40.145 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:52:40.145 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:52:40.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:52:40 smithi157 bash[24585]: cluster 2024-09-16T10:52:39.246042+0000 mgr.a (mgr.14373) 13645 : cluster [DBG] pgmap v9463: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:52:40.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:52:40 smithi086 bash[24289]: cluster 2024-09-16T10:52:39.246042+0000 mgr.a (mgr.14373) 13645 : cluster [DBG] pgmap v9463: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:52:40.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:52:40 smithi047 bash[22744]: cluster 2024-09-16T10:52:39.246042+0000 mgr.a (mgr.14373) 13645 : cluster [DBG] pgmap v9463: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:52:41.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:52:41 smithi157 bash[24585]: audit 2024-09-16T10:52:39.735260+0000 mgr.a (mgr.14373) 13646 : audit [DBG] from='client.296376 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:52:41.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:52:41 smithi086 bash[24289]: audit 2024-09-16T10:52:39.735260+0000 mgr.a (mgr.14373) 13646 : audit [DBG] from='client.296376 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:52:41.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:52:41 smithi047 bash[22744]: audit 2024-09-16T10:52:39.735260+0000 mgr.a (mgr.14373) 13646 : audit [DBG] from='client.296376 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:52:42.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:52:42 smithi157 bash[24585]: cluster 2024-09-16T10:52:41.247006+0000 mgr.a (mgr.14373) 13647 : cluster [DBG] pgmap v9464: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:52:42.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:52:42 smithi086 bash[24289]: cluster 2024-09-16T10:52:41.247006+0000 mgr.a (mgr.14373) 13647 : cluster [DBG] pgmap v9464: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:52:42.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:52:42 smithi047 bash[22744]: cluster 2024-09-16T10:52:41.247006+0000 mgr.a (mgr.14373) 13647 : cluster [DBG] pgmap v9464: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:52:44.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:52:44 smithi157 bash[24585]: cluster 2024-09-16T10:52:43.249207+0000 mgr.a (mgr.14373) 13648 : cluster [DBG] pgmap v9465: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:52:44.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:52:44 smithi086 bash[24289]: cluster 2024-09-16T10:52:43.249207+0000 mgr.a (mgr.14373) 13648 : cluster [DBG] pgmap v9465: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:52:44.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:52:44 smithi047 bash[22744]: cluster 2024-09-16T10:52:43.249207+0000 mgr.a (mgr.14373) 13648 : cluster [DBG] pgmap v9465: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:52:45.145 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:52:45.146 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:52:45.147 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:52:45.929 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:52:45.929 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:52:45.929 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:52:45.929 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:52:45.929 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:52:46.809 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:52:46 smithi157 bash[24585]: cluster 2024-09-16T10:52:45.249642+0000 mgr.a (mgr.14373) 13649 : cluster [DBG] pgmap v9466: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:52:46.809 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:52:46 smithi157 bash[24585]: audit 2024-09-16T10:52:45.484146+0000 mgr.a (mgr.14373) 13650 : audit [DBG] from='client.296451 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:52:46.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:52:46 smithi086 bash[24289]: cluster 2024-09-16T10:52:45.249642+0000 mgr.a (mgr.14373) 13649 : cluster [DBG] pgmap v9466: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:52:46.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:52:46 smithi086 bash[24289]: audit 2024-09-16T10:52:45.484146+0000 mgr.a (mgr.14373) 13650 : audit [DBG] from='client.296451 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:52:46.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:52:46 smithi047 bash[22744]: cluster 2024-09-16T10:52:45.249642+0000 mgr.a (mgr.14373) 13649 : cluster [DBG] pgmap v9466: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:52:46.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:52:46 smithi047 bash[22744]: audit 2024-09-16T10:52:45.484146+0000 mgr.a (mgr.14373) 13650 : audit [DBG] from='client.296451 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:52:48.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:52:48 smithi157 bash[24585]: cluster 2024-09-16T10:52:47.251976+0000 mgr.a (mgr.14373) 13651 : cluster [DBG] pgmap v9467: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:52:48.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:52:48 smithi086 bash[24289]: cluster 2024-09-16T10:52:47.251976+0000 mgr.a (mgr.14373) 13651 : cluster [DBG] pgmap v9467: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:52:48.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:52:48 smithi047 bash[22744]: cluster 2024-09-16T10:52:47.251976+0000 mgr.a (mgr.14373) 13651 : cluster [DBG] pgmap v9467: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:52:50.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:52:50 smithi157 bash[24585]: cluster 2024-09-16T10:52:49.252922+0000 mgr.a (mgr.14373) 13652 : cluster [DBG] pgmap v9468: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:52:50.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:52:50 smithi086 bash[24289]: cluster 2024-09-16T10:52:49.252922+0000 mgr.a (mgr.14373) 13652 : cluster [DBG] pgmap v9468: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:52:50.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:52:50 smithi047 bash[22744]: cluster 2024-09-16T10:52:49.252922+0000 mgr.a (mgr.14373) 13652 : cluster [DBG] pgmap v9468: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:52:50.930 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:52:50.931 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:52:50.931 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:52:51.697 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:52:51.698 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:52:51.698 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:52:51.698 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:52:51.698 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:52:52.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:52:52 smithi157 bash[24585]: cluster 2024-09-16T10:52:51.253679+0000 mgr.a (mgr.14373) 13653 : cluster [DBG] pgmap v9469: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:52:52.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:52:52 smithi157 bash[24585]: audit 2024-09-16T10:52:51.265385+0000 mgr.a (mgr.14373) 13654 : audit [DBG] from='client.296526 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:52:52.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:52:52 smithi086 bash[24289]: cluster 2024-09-16T10:52:51.253679+0000 mgr.a (mgr.14373) 13653 : cluster [DBG] pgmap v9469: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:52:52.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:52:52 smithi086 bash[24289]: audit 2024-09-16T10:52:51.265385+0000 mgr.a (mgr.14373) 13654 : audit [DBG] from='client.296526 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:52:52.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:52:52 smithi047 bash[22744]: cluster 2024-09-16T10:52:51.253679+0000 mgr.a (mgr.14373) 13653 : cluster [DBG] pgmap v9469: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:52:52.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:52:52 smithi047 bash[22744]: audit 2024-09-16T10:52:51.265385+0000 mgr.a (mgr.14373) 13654 : audit [DBG] from='client.296526 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:52:54.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:52:54 smithi157 bash[24585]: cluster 2024-09-16T10:52:53.256388+0000 mgr.a (mgr.14373) 13655 : cluster [DBG] pgmap v9470: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:52:54.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:52:54 smithi086 bash[24289]: cluster 2024-09-16T10:52:53.256388+0000 mgr.a (mgr.14373) 13655 : cluster [DBG] pgmap v9470: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:52:54.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:52:54 smithi047 bash[22744]: cluster 2024-09-16T10:52:53.256388+0000 mgr.a (mgr.14373) 13655 : cluster [DBG] pgmap v9470: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:52:56.699 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:52:56.700 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:52:56.700 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:52:56.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:52:56 smithi157 bash[24585]: cluster 2024-09-16T10:52:55.257145+0000 mgr.a (mgr.14373) 13656 : cluster [DBG] pgmap v9471: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:52:56.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:52:56 smithi086 bash[24289]: cluster 2024-09-16T10:52:55.257145+0000 mgr.a (mgr.14373) 13656 : cluster [DBG] pgmap v9471: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:52:56.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:52:56 smithi047 bash[22744]: cluster 2024-09-16T10:52:55.257145+0000 mgr.a (mgr.14373) 13656 : cluster [DBG] pgmap v9471: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:52:57.460 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:52:57.461 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:52:57.461 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:52:57.461 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:52:57.461 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:52:58.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:52:58 smithi157 bash[24585]: audit 2024-09-16T10:52:57.032923+0000 mgr.a (mgr.14373) 13657 : audit [DBG] from='client.296604 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:52:58.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:52:58 smithi157 bash[24585]: cluster 2024-09-16T10:52:57.267421+0000 mgr.a (mgr.14373) 13658 : cluster [DBG] pgmap v9472: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:52:58.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:52:58 smithi086 bash[24289]: audit 2024-09-16T10:52:57.032923+0000 mgr.a (mgr.14373) 13657 : audit [DBG] from='client.296604 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:52:58.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:52:58 smithi086 bash[24289]: cluster 2024-09-16T10:52:57.267421+0000 mgr.a (mgr.14373) 13658 : cluster [DBG] pgmap v9472: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:52:58.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:52:58 smithi047 bash[22744]: audit 2024-09-16T10:52:57.032923+0000 mgr.a (mgr.14373) 13657 : audit [DBG] from='client.296604 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:52:58.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:52:58 smithi047 bash[22744]: cluster 2024-09-16T10:52:57.267421+0000 mgr.a (mgr.14373) 13658 : cluster [DBG] pgmap v9472: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:53:00.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:53:00 smithi157 bash[24585]: cluster 2024-09-16T10:52:59.268322+0000 mgr.a (mgr.14373) 13659 : cluster [DBG] pgmap v9473: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:53:00.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:53:00 smithi086 bash[24289]: cluster 2024-09-16T10:52:59.268322+0000 mgr.a (mgr.14373) 13659 : cluster [DBG] pgmap v9473: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:53:00.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:53:00 smithi047 bash[22744]: cluster 2024-09-16T10:52:59.268322+0000 mgr.a (mgr.14373) 13659 : cluster [DBG] pgmap v9473: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:53:02.462 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:53:02.463 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:53:02.463 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:53:02.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:53:02 smithi157 bash[24585]: cluster 2024-09-16T10:53:01.269094+0000 mgr.a (mgr.14373) 13660 : cluster [DBG] pgmap v9474: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:53:02.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:53:02 smithi086 bash[24289]: cluster 2024-09-16T10:53:01.269094+0000 mgr.a (mgr.14373) 13660 : cluster [DBG] pgmap v9474: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:53:02.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:53:02 smithi047 bash[22744]: cluster 2024-09-16T10:53:01.269094+0000 mgr.a (mgr.14373) 13660 : cluster [DBG] pgmap v9474: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:53:03.238 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:53:03.238 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:53:03.238 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:53:03.238 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:53:03.238 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:53:04.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:53:04 smithi157 bash[24585]: audit 2024-09-16T10:53:02.801698+0000 mgr.a (mgr.14373) 13661 : audit [DBG] from='client.296679 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:53:04.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:53:04 smithi157 bash[24585]: cluster 2024-09-16T10:53:03.270588+0000 mgr.a (mgr.14373) 13662 : cluster [DBG] pgmap v9475: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:53:04.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:53:04 smithi086 bash[24289]: audit 2024-09-16T10:53:02.801698+0000 mgr.a (mgr.14373) 13661 : audit [DBG] from='client.296679 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:53:04.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:53:04 smithi086 bash[24289]: cluster 2024-09-16T10:53:03.270588+0000 mgr.a (mgr.14373) 13662 : cluster [DBG] pgmap v9475: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:53:04.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:53:04 smithi047 bash[22744]: audit 2024-09-16T10:53:02.801698+0000 mgr.a (mgr.14373) 13661 : audit [DBG] from='client.296679 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:53:04.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:53:04 smithi047 bash[22744]: cluster 2024-09-16T10:53:03.270588+0000 mgr.a (mgr.14373) 13662 : cluster [DBG] pgmap v9475: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:53:06.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:53:06 smithi157 bash[24585]: cluster 2024-09-16T10:53:05.271342+0000 mgr.a (mgr.14373) 13663 : cluster [DBG] pgmap v9476: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:53:06.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:53:06 smithi086 bash[24289]: cluster 2024-09-16T10:53:05.271342+0000 mgr.a (mgr.14373) 13663 : cluster [DBG] pgmap v9476: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:53:06.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:53:06 smithi047 bash[22744]: cluster 2024-09-16T10:53:05.271342+0000 mgr.a (mgr.14373) 13663 : cluster [DBG] pgmap v9476: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:53:08.239 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:53:08.240 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:53:08.240 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:53:08.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:53:08 smithi157 bash[24585]: cluster 2024-09-16T10:53:07.273393+0000 mgr.a (mgr.14373) 13664 : cluster [DBG] pgmap v9477: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:53:08.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:53:08 smithi086 bash[24289]: cluster 2024-09-16T10:53:07.273393+0000 mgr.a (mgr.14373) 13664 : cluster [DBG] pgmap v9477: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:53:08.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:53:08 smithi047 bash[22744]: cluster 2024-09-16T10:53:07.273393+0000 mgr.a (mgr.14373) 13664 : cluster [DBG] pgmap v9477: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:53:08.993 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:53:08.993 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:53:08.993 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:53:08.993 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:53:08.993 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:53:09.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:53:09 smithi157 bash[24585]: audit 2024-09-16T10:53:08.571643+0000 mgr.a (mgr.14373) 13665 : audit [DBG] from='client.296754 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:53:09.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:53:09 smithi086 bash[24289]: audit 2024-09-16T10:53:08.571643+0000 mgr.a (mgr.14373) 13665 : audit [DBG] from='client.296754 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:53:09.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:53:09 smithi047 bash[22744]: audit 2024-09-16T10:53:08.571643+0000 mgr.a (mgr.14373) 13665 : audit [DBG] from='client.296754 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:53:10.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:53:10 smithi157 bash[24585]: cluster 2024-09-16T10:53:09.274528+0000 mgr.a (mgr.14373) 13666 : cluster [DBG] pgmap v9478: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:53:10.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:53:10 smithi086 bash[24289]: cluster 2024-09-16T10:53:09.274528+0000 mgr.a (mgr.14373) 13666 : cluster [DBG] pgmap v9478: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:53:10.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:53:10 smithi047 bash[22744]: cluster 2024-09-16T10:53:09.274528+0000 mgr.a (mgr.14373) 13666 : cluster [DBG] pgmap v9478: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:53:12.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:53:12 smithi157 bash[24585]: cluster 2024-09-16T10:53:11.275320+0000 mgr.a (mgr.14373) 13667 : cluster [DBG] pgmap v9479: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:53:12.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:53:12 smithi086 bash[24289]: cluster 2024-09-16T10:53:11.275320+0000 mgr.a (mgr.14373) 13667 : cluster [DBG] pgmap v9479: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:53:12.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:53:12 smithi047 bash[22744]: cluster 2024-09-16T10:53:11.275320+0000 mgr.a (mgr.14373) 13667 : cluster [DBG] pgmap v9479: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:53:13.994 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:53:13.995 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:53:13.995 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:53:14.788 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:53:14.788 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:53:14.788 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:53:14.788 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:53:14.788 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:53:14.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:53:14 smithi157 bash[24585]: cluster 2024-09-16T10:53:13.277640+0000 mgr.a (mgr.14373) 13668 : cluster [DBG] pgmap v9480: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:53:14.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:53:14 smithi086 bash[24289]: cluster 2024-09-16T10:53:13.277640+0000 mgr.a (mgr.14373) 13668 : cluster [DBG] pgmap v9480: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:53:14.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:53:14 smithi047 bash[22744]: cluster 2024-09-16T10:53:13.277640+0000 mgr.a (mgr.14373) 13668 : cluster [DBG] pgmap v9480: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:53:15.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:53:15 smithi157 bash[24585]: audit 2024-09-16T10:53:14.331327+0000 mgr.a (mgr.14373) 13669 : audit [DBG] from='client.296829 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:53:15.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:53:15 smithi086 bash[24289]: audit 2024-09-16T10:53:14.331327+0000 mgr.a (mgr.14373) 13669 : audit [DBG] from='client.296829 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:53:15.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:53:15 smithi047 bash[22744]: audit 2024-09-16T10:53:14.331327+0000 mgr.a (mgr.14373) 13669 : audit [DBG] from='client.296829 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:53:16.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:53:16 smithi157 bash[24585]: cluster 2024-09-16T10:53:15.278710+0000 mgr.a (mgr.14373) 13670 : cluster [DBG] pgmap v9481: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:53:16.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:53:16 smithi086 bash[24289]: cluster 2024-09-16T10:53:15.278710+0000 mgr.a (mgr.14373) 13670 : cluster [DBG] pgmap v9481: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:53:16.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:53:16 smithi047 bash[22744]: cluster 2024-09-16T10:53:15.278710+0000 mgr.a (mgr.14373) 13670 : cluster [DBG] pgmap v9481: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:53:18.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:53:18 smithi157 bash[24585]: cluster 2024-09-16T10:53:17.280976+0000 mgr.a (mgr.14373) 13671 : cluster [DBG] pgmap v9482: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:53:18.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:53:18 smithi086 bash[24289]: cluster 2024-09-16T10:53:17.280976+0000 mgr.a (mgr.14373) 13671 : cluster [DBG] pgmap v9482: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:53:18.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:53:18 smithi047 bash[22744]: cluster 2024-09-16T10:53:17.280976+0000 mgr.a (mgr.14373) 13671 : cluster [DBG] pgmap v9482: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:53:19.790 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:53:19.790 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:53:19.791 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:53:20.533 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:53:20.533 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:53:20.534 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:53:20.534 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:53:20.534 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:53:20.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:53:20 smithi157 bash[24585]: cluster 2024-09-16T10:53:19.281764+0000 mgr.a (mgr.14373) 13672 : cluster [DBG] pgmap v9483: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:53:20.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:53:20 smithi086 bash[24289]: cluster 2024-09-16T10:53:19.281764+0000 mgr.a (mgr.14373) 13672 : cluster [DBG] pgmap v9483: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:53:20.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:53:20 smithi047 bash[22744]: cluster 2024-09-16T10:53:19.281764+0000 mgr.a (mgr.14373) 13672 : cluster [DBG] pgmap v9483: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:53:21.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:53:21 smithi157 bash[24585]: audit 2024-09-16T10:53:20.115484+0000 mgr.a (mgr.14373) 13673 : audit [DBG] from='client.296901 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:53:21.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:53:21 smithi086 bash[24289]: audit 2024-09-16T10:53:20.115484+0000 mgr.a (mgr.14373) 13673 : audit [DBG] from='client.296901 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:53:21.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:53:21 smithi047 bash[22744]: audit 2024-09-16T10:53:20.115484+0000 mgr.a (mgr.14373) 13673 : audit [DBG] from='client.296901 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:53:22.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:53:22 smithi157 bash[24585]: cluster 2024-09-16T10:53:21.282774+0000 mgr.a (mgr.14373) 13674 : cluster [DBG] pgmap v9484: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:53:22.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:53:22 smithi086 bash[24289]: cluster 2024-09-16T10:53:21.282774+0000 mgr.a (mgr.14373) 13674 : cluster [DBG] pgmap v9484: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:53:22.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:53:22 smithi047 bash[22744]: cluster 2024-09-16T10:53:21.282774+0000 mgr.a (mgr.14373) 13674 : cluster [DBG] pgmap v9484: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:53:23.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:53:23 smithi157 bash[24585]: audit 2024-09-16T10:53:22.508528+0000 mon.b (mon.2) 1250 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T10:53:23.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:53:23 smithi157 bash[24585]: audit 2024-09-16T10:53:23.356996+0000 mon.b (mon.2) 1251 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T10:53:23.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:53:23 smithi157 bash[24585]: audit 2024-09-16T10:53:23.359129+0000 mon.b (mon.2) 1252 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T10:53:23.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:53:23 smithi157 bash[24585]: audit 2024-09-16T10:53:23.368603+0000 mon.a (mon.0) 1384 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:53:23.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:53:23 smithi157 bash[24585]: audit 2024-09-16T10:53:23.375654+0000 mon.b (mon.2) 1253 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:53:23.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:53:23 smithi086 bash[24289]: audit 2024-09-16T10:53:22.508528+0000 mon.b (mon.2) 1250 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T10:53:23.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:53:23 smithi086 bash[24289]: audit 2024-09-16T10:53:23.356996+0000 mon.b (mon.2) 1251 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T10:53:23.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:53:23 smithi086 bash[24289]: audit 2024-09-16T10:53:23.359129+0000 mon.b (mon.2) 1252 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T10:53:23.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:53:23 smithi086 bash[24289]: audit 2024-09-16T10:53:23.368603+0000 mon.a (mon.0) 1384 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:53:23.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:53:23 smithi086 bash[24289]: audit 2024-09-16T10:53:23.375654+0000 mon.b (mon.2) 1253 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:53:23.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:53:23 smithi047 bash[22744]: audit 2024-09-16T10:53:22.508528+0000 mon.b (mon.2) 1250 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T10:53:23.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:53:23 smithi047 bash[22744]: audit 2024-09-16T10:53:23.356996+0000 mon.b (mon.2) 1251 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T10:53:23.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:53:23 smithi047 bash[22744]: audit 2024-09-16T10:53:23.359129+0000 mon.b (mon.2) 1252 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T10:53:23.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:53:23 smithi047 bash[22744]: audit 2024-09-16T10:53:23.368603+0000 mon.a (mon.0) 1384 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:53:23.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:53:23 smithi047 bash[22744]: audit 2024-09-16T10:53:23.375654+0000 mon.b (mon.2) 1253 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:53:24.504 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 10:53:24 smithi047 bash[22994]: debug 2024-09-16T10:53:24.112+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T10:53:24.504 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 10:53:24 smithi047 bash[22994]: debug 2024-09-16T10:53:24.112+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T10:53:24.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:53:24 smithi157 bash[24585]: cluster 2024-09-16T10:53:23.284946+0000 mgr.a (mgr.14373) 13675 : cluster [DBG] pgmap v9485: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:53:24.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:53:24 smithi157 bash[24585]: audit 2024-09-16T10:53:23.378475+0000 mgr.a (mgr.14373) 13676 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:53:24.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:53:24 smithi086 bash[24289]: cluster 2024-09-16T10:53:23.284946+0000 mgr.a (mgr.14373) 13675 : cluster [DBG] pgmap v9485: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:53:24.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:53:24 smithi086 bash[24289]: audit 2024-09-16T10:53:23.378475+0000 mgr.a (mgr.14373) 13676 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:53:24.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:53:24 smithi047 bash[22744]: cluster 2024-09-16T10:53:23.284946+0000 mgr.a (mgr.14373) 13675 : cluster [DBG] pgmap v9485: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:53:24.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:53:24 smithi047 bash[22744]: audit 2024-09-16T10:53:23.378475+0000 mgr.a (mgr.14373) 13676 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:53:25.535 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:53:25.536 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:53:25.536 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:53:25.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:53:25 smithi157 bash[24585]: audit 2024-09-16T10:53:24.115136+0000 mgr.a (mgr.14373) 13677 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T10:53:25.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:53:25 smithi157 bash[24585]: cephadm 2024-09-16T10:53:24.117146+0000 mgr.a (mgr.14373) 13678 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T10:53:25.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:53:25 smithi086 bash[24289]: audit 2024-09-16T10:53:24.115136+0000 mgr.a (mgr.14373) 13677 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T10:53:25.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:53:25 smithi086 bash[24289]: cephadm 2024-09-16T10:53:24.117146+0000 mgr.a (mgr.14373) 13678 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T10:53:25.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:53:25 smithi047 bash[22744]: audit 2024-09-16T10:53:24.115136+0000 mgr.a (mgr.14373) 13677 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T10:53:25.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:53:25 smithi047 bash[22744]: cephadm 2024-09-16T10:53:24.117146+0000 mgr.a (mgr.14373) 13678 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T10:53:26.281 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:53:26.282 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:53:26.282 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:53:26.282 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:53:26.282 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:53:26.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:53:26 smithi157 bash[24585]: cluster 2024-09-16T10:53:25.285900+0000 mgr.a (mgr.14373) 13679 : cluster [DBG] pgmap v9486: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:53:26.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:53:26 smithi086 bash[24289]: cluster 2024-09-16T10:53:25.285900+0000 mgr.a (mgr.14373) 13679 : cluster [DBG] pgmap v9486: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:53:26.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:53:26 smithi047 bash[22744]: cluster 2024-09-16T10:53:25.285900+0000 mgr.a (mgr.14373) 13679 : cluster [DBG] pgmap v9486: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:53:27.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:53:27 smithi157 bash[24585]: audit 2024-09-16T10:53:25.861000+0000 mgr.a (mgr.14373) 13680 : audit [DBG] from='client.297087 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:53:27.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:53:27 smithi086 bash[24289]: audit 2024-09-16T10:53:25.861000+0000 mgr.a (mgr.14373) 13680 : audit [DBG] from='client.297087 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:53:27.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:53:27 smithi047 bash[22744]: audit 2024-09-16T10:53:25.861000+0000 mgr.a (mgr.14373) 13680 : audit [DBG] from='client.297087 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:53:28.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:53:28 smithi157 bash[24585]: cluster 2024-09-16T10:53:27.288493+0000 mgr.a (mgr.14373) 13681 : cluster [DBG] pgmap v9487: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:53:28.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:53:28 smithi086 bash[24289]: cluster 2024-09-16T10:53:27.288493+0000 mgr.a (mgr.14373) 13681 : cluster [DBG] pgmap v9487: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:53:28.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:53:28 smithi047 bash[22744]: cluster 2024-09-16T10:53:27.288493+0000 mgr.a (mgr.14373) 13681 : cluster [DBG] pgmap v9487: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:53:30.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:53:30 smithi157 bash[24585]: cluster 2024-09-16T10:53:29.289462+0000 mgr.a (mgr.14373) 13682 : cluster [DBG] pgmap v9488: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:53:30.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:53:30 smithi086 bash[24289]: cluster 2024-09-16T10:53:29.289462+0000 mgr.a (mgr.14373) 13682 : cluster [DBG] pgmap v9488: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:53:30.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:53:30 smithi047 bash[22744]: cluster 2024-09-16T10:53:29.289462+0000 mgr.a (mgr.14373) 13682 : cluster [DBG] pgmap v9488: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:53:31.283 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:53:31.284 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:53:31.284 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:53:32.022 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:53:32.022 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:53:32.022 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:53:32.023 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:53:32.023 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:53:32.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:53:32 smithi157 bash[24585]: cluster 2024-09-16T10:53:31.290189+0000 mgr.a (mgr.14373) 13683 : cluster [DBG] pgmap v9489: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:53:32.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:53:32 smithi157 bash[24585]: audit 2024-09-16T10:53:31.613675+0000 mgr.a (mgr.14373) 13684 : audit [DBG] from='client.297162 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:53:32.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:53:32 smithi086 bash[24289]: cluster 2024-09-16T10:53:31.290189+0000 mgr.a (mgr.14373) 13683 : cluster [DBG] pgmap v9489: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:53:32.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:53:32 smithi086 bash[24289]: audit 2024-09-16T10:53:31.613675+0000 mgr.a (mgr.14373) 13684 : audit [DBG] from='client.297162 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:53:32.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:53:32 smithi047 bash[22744]: cluster 2024-09-16T10:53:31.290189+0000 mgr.a (mgr.14373) 13683 : cluster [DBG] pgmap v9489: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:53:32.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:53:32 smithi047 bash[22744]: audit 2024-09-16T10:53:31.613675+0000 mgr.a (mgr.14373) 13684 : audit [DBG] from='client.297162 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:53:34.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:53:34 smithi157 bash[24585]: cluster 2024-09-16T10:53:33.292992+0000 mgr.a (mgr.14373) 13685 : cluster [DBG] pgmap v9490: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:53:34.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:53:34 smithi086 bash[24289]: cluster 2024-09-16T10:53:33.292992+0000 mgr.a (mgr.14373) 13685 : cluster [DBG] pgmap v9490: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:53:34.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:53:34 smithi047 bash[22744]: cluster 2024-09-16T10:53:33.292992+0000 mgr.a (mgr.14373) 13685 : cluster [DBG] pgmap v9490: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:53:36.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:53:36 smithi157 bash[24585]: cluster 2024-09-16T10:53:35.293829+0000 mgr.a (mgr.14373) 13686 : cluster [DBG] pgmap v9491: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T10:53:36.824 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:53:36 smithi086 bash[24289]: cluster 2024-09-16T10:53:35.293829+0000 mgr.a (mgr.14373) 13686 : cluster [DBG] pgmap v9491: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T10:53:36.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:53:36 smithi047 bash[22744]: cluster 2024-09-16T10:53:35.293829+0000 mgr.a (mgr.14373) 13686 : cluster [DBG] pgmap v9491: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T10:53:37.024 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:53:37.024 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:53:37.024 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:53:37.776 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:53:37.776 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:53:37.776 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:53:37.776 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:53:37.776 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:53:38.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:53:38 smithi157 bash[24585]: cluster 2024-09-16T10:53:37.295821+0000 mgr.a (mgr.14373) 13687 : cluster [DBG] pgmap v9492: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:53:38.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:53:38 smithi157 bash[24585]: audit 2024-09-16T10:53:37.357481+0000 mgr.a (mgr.14373) 13688 : audit [DBG] from='client.297237 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:53:38.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:53:38 smithi086 bash[24289]: cluster 2024-09-16T10:53:37.295821+0000 mgr.a (mgr.14373) 13687 : cluster [DBG] pgmap v9492: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:53:38.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:53:38 smithi086 bash[24289]: audit 2024-09-16T10:53:37.357481+0000 mgr.a (mgr.14373) 13688 : audit [DBG] from='client.297237 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:53:38.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:53:38 smithi047 bash[22744]: cluster 2024-09-16T10:53:37.295821+0000 mgr.a (mgr.14373) 13687 : cluster [DBG] pgmap v9492: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:53:38.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:53:38 smithi047 bash[22744]: audit 2024-09-16T10:53:37.357481+0000 mgr.a (mgr.14373) 13688 : audit [DBG] from='client.297237 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:53:40.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:53:40 smithi157 bash[24585]: cluster 2024-09-16T10:53:39.296802+0000 mgr.a (mgr.14373) 13689 : cluster [DBG] pgmap v9493: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:53:40.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:53:40 smithi086 bash[24289]: cluster 2024-09-16T10:53:39.296802+0000 mgr.a (mgr.14373) 13689 : cluster [DBG] pgmap v9493: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:53:40.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:53:40 smithi047 bash[22744]: cluster 2024-09-16T10:53:39.296802+0000 mgr.a (mgr.14373) 13689 : cluster [DBG] pgmap v9493: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:53:42.777 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:53:42.778 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:53:42.778 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:53:42.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:53:42 smithi086 bash[24289]: cluster 2024-09-16T10:53:41.297756+0000 mgr.a (mgr.14373) 13690 : cluster [DBG] pgmap v9494: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T10:53:42.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:53:42 smithi047 bash[22744]: cluster 2024-09-16T10:53:41.297756+0000 mgr.a (mgr.14373) 13690 : cluster [DBG] pgmap v9494: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T10:53:43.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:53:42 smithi157 bash[24585]: cluster 2024-09-16T10:53:41.297756+0000 mgr.a (mgr.14373) 13690 : cluster [DBG] pgmap v9494: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T10:53:43.566 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:53:43.567 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:53:43.567 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:53:43.567 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:53:43.567 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:53:44.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:53:44 smithi086 bash[24289]: audit 2024-09-16T10:53:43.113173+0000 mgr.a (mgr.14373) 13691 : audit [DBG] from='client.297315 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:53:44.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:53:44 smithi086 bash[24289]: cluster 2024-09-16T10:53:43.299346+0000 mgr.a (mgr.14373) 13692 : cluster [DBG] pgmap v9495: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:53:44.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:53:44 smithi047 bash[22744]: audit 2024-09-16T10:53:43.113173+0000 mgr.a (mgr.14373) 13691 : audit [DBG] from='client.297315 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:53:44.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:53:44 smithi047 bash[22744]: cluster 2024-09-16T10:53:43.299346+0000 mgr.a (mgr.14373) 13692 : cluster [DBG] pgmap v9495: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:53:45.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:53:44 smithi157 bash[24585]: audit 2024-09-16T10:53:43.113173+0000 mgr.a (mgr.14373) 13691 : audit [DBG] from='client.297315 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:53:45.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:53:44 smithi157 bash[24585]: cluster 2024-09-16T10:53:43.299346+0000 mgr.a (mgr.14373) 13692 : cluster [DBG] pgmap v9495: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:53:46.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:53:46 smithi086 bash[24289]: cluster 2024-09-16T10:53:45.300245+0000 mgr.a (mgr.14373) 13693 : cluster [DBG] pgmap v9496: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:53:46.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:53:46 smithi047 bash[22744]: cluster 2024-09-16T10:53:45.300245+0000 mgr.a (mgr.14373) 13693 : cluster [DBG] pgmap v9496: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:53:47.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:53:46 smithi157 bash[24585]: cluster 2024-09-16T10:53:45.300245+0000 mgr.a (mgr.14373) 13693 : cluster [DBG] pgmap v9496: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:53:48.568 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:53:48.569 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:53:48.569 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:53:48.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:53:48 smithi086 bash[24289]: cluster 2024-09-16T10:53:47.302651+0000 mgr.a (mgr.14373) 13694 : cluster [DBG] pgmap v9497: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:53:48.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:53:48 smithi047 bash[22744]: cluster 2024-09-16T10:53:47.302651+0000 mgr.a (mgr.14373) 13694 : cluster [DBG] pgmap v9497: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:53:49.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:53:48 smithi157 bash[24585]: cluster 2024-09-16T10:53:47.302651+0000 mgr.a (mgr.14373) 13694 : cluster [DBG] pgmap v9497: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:53:49.356 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:53:49.356 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:53:49.356 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:53:49.356 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:53:49.357 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:53:50.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:53:50 smithi047 bash[22744]: audit 2024-09-16T10:53:48.908796+0000 mgr.a (mgr.14373) 13695 : audit [DBG] from='client.297393 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:53:50.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:53:50 smithi047 bash[22744]: cluster 2024-09-16T10:53:49.303284+0000 mgr.a (mgr.14373) 13696 : cluster [DBG] pgmap v9498: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:53:51.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:53:50 smithi157 bash[24585]: audit 2024-09-16T10:53:48.908796+0000 mgr.a (mgr.14373) 13695 : audit [DBG] from='client.297393 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:53:51.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:53:50 smithi157 bash[24585]: cluster 2024-09-16T10:53:49.303284+0000 mgr.a (mgr.14373) 13696 : cluster [DBG] pgmap v9498: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:53:51.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:53:50 smithi086 bash[24289]: audit 2024-09-16T10:53:48.908796+0000 mgr.a (mgr.14373) 13695 : audit [DBG] from='client.297393 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:53:51.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:53:50 smithi086 bash[24289]: cluster 2024-09-16T10:53:49.303284+0000 mgr.a (mgr.14373) 13696 : cluster [DBG] pgmap v9498: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:53:52.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:53:52 smithi047 bash[22744]: cluster 2024-09-16T10:53:51.304031+0000 mgr.a (mgr.14373) 13697 : cluster [DBG] pgmap v9499: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:53:53.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:53:52 smithi157 bash[24585]: cluster 2024-09-16T10:53:51.304031+0000 mgr.a (mgr.14373) 13697 : cluster [DBG] pgmap v9499: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:53:53.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:53:52 smithi086 bash[24289]: cluster 2024-09-16T10:53:51.304031+0000 mgr.a (mgr.14373) 13697 : cluster [DBG] pgmap v9499: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:53:54.358 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:53:54.358 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:53:54.358 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:53:54.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:53:54 smithi047 bash[22744]: cluster 2024-09-16T10:53:53.306298+0000 mgr.a (mgr.14373) 13698 : cluster [DBG] pgmap v9500: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:53:55.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:53:54 smithi157 bash[24585]: cluster 2024-09-16T10:53:53.306298+0000 mgr.a (mgr.14373) 13698 : cluster [DBG] pgmap v9500: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:53:55.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:53:54 smithi086 bash[24289]: cluster 2024-09-16T10:53:53.306298+0000 mgr.a (mgr.14373) 13698 : cluster [DBG] pgmap v9500: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:53:55.108 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:53:55.109 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:53:55.109 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:53:55.109 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:53:55.109 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:53:55.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:53:55 smithi047 bash[22744]: audit 2024-09-16T10:53:54.688018+0000 mgr.a (mgr.14373) 13699 : audit [DBG] from='client.297471 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:53:56.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:53:55 smithi157 bash[24585]: audit 2024-09-16T10:53:54.688018+0000 mgr.a (mgr.14373) 13699 : audit [DBG] from='client.297471 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:53:56.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:53:55 smithi086 bash[24289]: audit 2024-09-16T10:53:54.688018+0000 mgr.a (mgr.14373) 13699 : audit [DBG] from='client.297471 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:53:56.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:53:56 smithi047 bash[22744]: cluster 2024-09-16T10:53:55.307261+0000 mgr.a (mgr.14373) 13700 : cluster [DBG] pgmap v9501: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:53:57.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:53:56 smithi157 bash[24585]: cluster 2024-09-16T10:53:55.307261+0000 mgr.a (mgr.14373) 13700 : cluster [DBG] pgmap v9501: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:53:57.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:53:56 smithi086 bash[24289]: cluster 2024-09-16T10:53:55.307261+0000 mgr.a (mgr.14373) 13700 : cluster [DBG] pgmap v9501: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:53:59.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:53:58 smithi157 bash[24585]: cluster 2024-09-16T10:53:57.309513+0000 mgr.a (mgr.14373) 13701 : cluster [DBG] pgmap v9502: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:53:59.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:53:58 smithi086 bash[24289]: cluster 2024-09-16T10:53:57.309513+0000 mgr.a (mgr.14373) 13701 : cluster [DBG] pgmap v9502: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:53:59.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:53:58 smithi047 bash[22744]: cluster 2024-09-16T10:53:57.309513+0000 mgr.a (mgr.14373) 13701 : cluster [DBG] pgmap v9502: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:54:00.110 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:54:00.111 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:54:00.111 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:54:00.888 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:54:00.888 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:54:00.889 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:54:00.889 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:54:00.889 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:54:01.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:54:00 smithi157 bash[24585]: cluster 2024-09-16T10:53:59.310278+0000 mgr.a (mgr.14373) 13702 : cluster [DBG] pgmap v9503: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:54:01.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:54:00 smithi086 bash[24289]: cluster 2024-09-16T10:53:59.310278+0000 mgr.a (mgr.14373) 13702 : cluster [DBG] pgmap v9503: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:54:01.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:54:00 smithi047 bash[22744]: cluster 2024-09-16T10:53:59.310278+0000 mgr.a (mgr.14373) 13702 : cluster [DBG] pgmap v9503: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:54:02.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:54:01 smithi157 bash[24585]: audit 2024-09-16T10:54:00.437832+0000 mgr.a (mgr.14373) 13703 : audit [DBG] from='client.297549 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:54:02.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:54:01 smithi086 bash[24289]: audit 2024-09-16T10:54:00.437832+0000 mgr.a (mgr.14373) 13703 : audit [DBG] from='client.297549 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:54:02.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:54:01 smithi047 bash[22744]: audit 2024-09-16T10:54:00.437832+0000 mgr.a (mgr.14373) 13703 : audit [DBG] from='client.297549 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:54:03.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:54:02 smithi157 bash[24585]: cluster 2024-09-16T10:54:01.311266+0000 mgr.a (mgr.14373) 13704 : cluster [DBG] pgmap v9504: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:54:03.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:54:02 smithi086 bash[24289]: cluster 2024-09-16T10:54:01.311266+0000 mgr.a (mgr.14373) 13704 : cluster [DBG] pgmap v9504: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:54:03.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:54:02 smithi047 bash[22744]: cluster 2024-09-16T10:54:01.311266+0000 mgr.a (mgr.14373) 13704 : cluster [DBG] pgmap v9504: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:54:05.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:54:04 smithi157 bash[24585]: cluster 2024-09-16T10:54:03.313569+0000 mgr.a (mgr.14373) 13705 : cluster [DBG] pgmap v9505: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:54:05.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:54:04 smithi086 bash[24289]: cluster 2024-09-16T10:54:03.313569+0000 mgr.a (mgr.14373) 13705 : cluster [DBG] pgmap v9505: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:54:05.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:54:04 smithi047 bash[22744]: cluster 2024-09-16T10:54:03.313569+0000 mgr.a (mgr.14373) 13705 : cluster [DBG] pgmap v9505: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:54:05.889 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:54:05.890 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:54:05.890 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:54:06.686 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:54:06.686 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:54:06.686 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:54:06.687 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:54:06.687 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:54:07.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:54:06 smithi157 bash[24585]: cluster 2024-09-16T10:54:05.314373+0000 mgr.a (mgr.14373) 13706 : cluster [DBG] pgmap v9506: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:54:07.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:54:06 smithi086 bash[24289]: cluster 2024-09-16T10:54:05.314373+0000 mgr.a (mgr.14373) 13706 : cluster [DBG] pgmap v9506: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:54:07.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:54:06 smithi047 bash[22744]: cluster 2024-09-16T10:54:05.314373+0000 mgr.a (mgr.14373) 13706 : cluster [DBG] pgmap v9506: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:54:08.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:54:07 smithi157 bash[24585]: audit 2024-09-16T10:54:06.224196+0000 mgr.a (mgr.14373) 13707 : audit [DBG] from='client.297624 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:54:08.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:54:07 smithi086 bash[24289]: audit 2024-09-16T10:54:06.224196+0000 mgr.a (mgr.14373) 13707 : audit [DBG] from='client.297624 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:54:08.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:54:07 smithi047 bash[22744]: audit 2024-09-16T10:54:06.224196+0000 mgr.a (mgr.14373) 13707 : audit [DBG] from='client.297624 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:54:09.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:54:08 smithi157 bash[24585]: cluster 2024-09-16T10:54:07.317255+0000 mgr.a (mgr.14373) 13708 : cluster [DBG] pgmap v9507: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:54:09.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:54:08 smithi086 bash[24289]: cluster 2024-09-16T10:54:07.317255+0000 mgr.a (mgr.14373) 13708 : cluster [DBG] pgmap v9507: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:54:09.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:54:08 smithi047 bash[22744]: cluster 2024-09-16T10:54:07.317255+0000 mgr.a (mgr.14373) 13708 : cluster [DBG] pgmap v9507: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:54:11.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:54:10 smithi157 bash[24585]: cluster 2024-09-16T10:54:09.318060+0000 mgr.a (mgr.14373) 13709 : cluster [DBG] pgmap v9508: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:54:11.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:54:10 smithi086 bash[24289]: cluster 2024-09-16T10:54:09.318060+0000 mgr.a (mgr.14373) 13709 : cluster [DBG] pgmap v9508: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:54:11.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:54:10 smithi047 bash[22744]: cluster 2024-09-16T10:54:09.318060+0000 mgr.a (mgr.14373) 13709 : cluster [DBG] pgmap v9508: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:54:11.688 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:54:11.689 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:54:11.689 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:54:12.467 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:54:12.468 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:54:12.468 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:54:12.468 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:54:12.468 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:54:13.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:54:12 smithi157 bash[24585]: cluster 2024-09-16T10:54:11.318877+0000 mgr.a (mgr.14373) 13710 : cluster [DBG] pgmap v9509: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:54:13.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:54:12 smithi086 bash[24289]: cluster 2024-09-16T10:54:11.318877+0000 mgr.a (mgr.14373) 13710 : cluster [DBG] pgmap v9509: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:54:13.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:54:12 smithi047 bash[22744]: cluster 2024-09-16T10:54:11.318877+0000 mgr.a (mgr.14373) 13710 : cluster [DBG] pgmap v9509: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:54:14.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:54:13 smithi157 bash[24585]: audit 2024-09-16T10:54:12.020608+0000 mgr.a (mgr.14373) 13711 : audit [DBG] from='client.297699 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:54:14.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:54:13 smithi086 bash[24289]: audit 2024-09-16T10:54:12.020608+0000 mgr.a (mgr.14373) 13711 : audit [DBG] from='client.297699 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:54:14.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:54:13 smithi047 bash[22744]: audit 2024-09-16T10:54:12.020608+0000 mgr.a (mgr.14373) 13711 : audit [DBG] from='client.297699 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:54:15.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:54:14 smithi157 bash[24585]: cluster 2024-09-16T10:54:13.321707+0000 mgr.a (mgr.14373) 13712 : cluster [DBG] pgmap v9510: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:54:15.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:54:14 smithi086 bash[24289]: cluster 2024-09-16T10:54:13.321707+0000 mgr.a (mgr.14373) 13712 : cluster [DBG] pgmap v9510: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:54:15.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:54:14 smithi047 bash[22744]: cluster 2024-09-16T10:54:13.321707+0000 mgr.a (mgr.14373) 13712 : cluster [DBG] pgmap v9510: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:54:17.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:54:16 smithi157 bash[24585]: cluster 2024-09-16T10:54:15.322527+0000 mgr.a (mgr.14373) 13713 : cluster [DBG] pgmap v9511: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:54:17.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:54:16 smithi086 bash[24289]: cluster 2024-09-16T10:54:15.322527+0000 mgr.a (mgr.14373) 13713 : cluster [DBG] pgmap v9511: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:54:17.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:54:16 smithi047 bash[22744]: cluster 2024-09-16T10:54:15.322527+0000 mgr.a (mgr.14373) 13713 : cluster [DBG] pgmap v9511: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:54:17.469 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:54:17.470 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:54:17.470 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:54:18.252 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:54:18.253 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:54:18.253 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:54:18.253 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:54:18.253 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:54:19.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:54:18 smithi157 bash[24585]: cluster 2024-09-16T10:54:17.324559+0000 mgr.a (mgr.14373) 13714 : cluster [DBG] pgmap v9512: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:54:19.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:54:18 smithi086 bash[24289]: cluster 2024-09-16T10:54:17.324559+0000 mgr.a (mgr.14373) 13714 : cluster [DBG] pgmap v9512: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:54:19.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:54:18 smithi047 bash[22744]: cluster 2024-09-16T10:54:17.324559+0000 mgr.a (mgr.14373) 13714 : cluster [DBG] pgmap v9512: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:54:20.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:54:19 smithi157 bash[24585]: audit 2024-09-16T10:54:17.800798+0000 mgr.a (mgr.14373) 13715 : audit [DBG] from='client.297774 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:54:20.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:54:19 smithi086 bash[24289]: audit 2024-09-16T10:54:17.800798+0000 mgr.a (mgr.14373) 13715 : audit [DBG] from='client.297774 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:54:20.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:54:19 smithi047 bash[22744]: audit 2024-09-16T10:54:17.800798+0000 mgr.a (mgr.14373) 13715 : audit [DBG] from='client.297774 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:54:21.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:54:20 smithi157 bash[24585]: cluster 2024-09-16T10:54:19.325535+0000 mgr.a (mgr.14373) 13716 : cluster [DBG] pgmap v9513: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:54:21.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:54:20 smithi086 bash[24289]: cluster 2024-09-16T10:54:19.325535+0000 mgr.a (mgr.14373) 13716 : cluster [DBG] pgmap v9513: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:54:21.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:54:20 smithi047 bash[22744]: cluster 2024-09-16T10:54:19.325535+0000 mgr.a (mgr.14373) 13716 : cluster [DBG] pgmap v9513: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:54:23.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:54:22 smithi157 bash[24585]: cluster 2024-09-16T10:54:21.326335+0000 mgr.a (mgr.14373) 13717 : cluster [DBG] pgmap v9514: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:54:23.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:54:22 smithi086 bash[24289]: cluster 2024-09-16T10:54:21.326335+0000 mgr.a (mgr.14373) 13717 : cluster [DBG] pgmap v9514: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:54:23.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:54:22 smithi047 bash[22744]: cluster 2024-09-16T10:54:21.326335+0000 mgr.a (mgr.14373) 13717 : cluster [DBG] pgmap v9514: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:54:23.254 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:54:23.255 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:54:23.255 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:54:24.034 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:54:24.034 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:54:24.034 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:54:24.034 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:54:24.034 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:54:25.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:54:24 smithi157 bash[24585]: cluster 2024-09-16T10:54:23.328588+0000 mgr.a (mgr.14373) 13718 : cluster [DBG] pgmap v9515: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:54:25.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:54:24 smithi157 bash[24585]: audit 2024-09-16T10:54:23.591973+0000 mgr.a (mgr.14373) 13719 : audit [DBG] from='client.297852 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:54:25.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:54:24 smithi157 bash[24585]: audit 2024-09-16T10:54:24.170512+0000 mon.b (mon.2) 1254 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T10:54:25.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:54:24 smithi086 bash[24289]: cluster 2024-09-16T10:54:23.328588+0000 mgr.a (mgr.14373) 13718 : cluster [DBG] pgmap v9515: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:54:25.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:54:24 smithi086 bash[24289]: audit 2024-09-16T10:54:23.591973+0000 mgr.a (mgr.14373) 13719 : audit [DBG] from='client.297852 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:54:25.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:54:24 smithi086 bash[24289]: audit 2024-09-16T10:54:24.170512+0000 mon.b (mon.2) 1254 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T10:54:25.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:54:24 smithi047 bash[22744]: cluster 2024-09-16T10:54:23.328588+0000 mgr.a (mgr.14373) 13718 : cluster [DBG] pgmap v9515: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:54:25.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:54:24 smithi047 bash[22744]: audit 2024-09-16T10:54:23.591973+0000 mgr.a (mgr.14373) 13719 : audit [DBG] from='client.297852 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:54:25.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:54:24 smithi047 bash[22744]: audit 2024-09-16T10:54:24.170512+0000 mon.b (mon.2) 1254 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T10:54:27.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:54:26 smithi157 bash[24585]: cluster 2024-09-16T10:54:25.329508+0000 mgr.a (mgr.14373) 13720 : cluster [DBG] pgmap v9516: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:54:27.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:54:26 smithi086 bash[24289]: cluster 2024-09-16T10:54:25.329508+0000 mgr.a (mgr.14373) 13720 : cluster [DBG] pgmap v9516: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:54:27.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:54:26 smithi047 bash[22744]: cluster 2024-09-16T10:54:25.329508+0000 mgr.a (mgr.14373) 13720 : cluster [DBG] pgmap v9516: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:54:29.036 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:54:29.037 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:54:29.037 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:54:29.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:54:28 smithi157 bash[24585]: cluster 2024-09-16T10:54:27.331817+0000 mgr.a (mgr.14373) 13721 : cluster [DBG] pgmap v9517: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:54:29.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:54:28 smithi086 bash[24289]: cluster 2024-09-16T10:54:27.331817+0000 mgr.a (mgr.14373) 13721 : cluster [DBG] pgmap v9517: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:54:29.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:54:28 smithi047 bash[22744]: cluster 2024-09-16T10:54:27.331817+0000 mgr.a (mgr.14373) 13721 : cluster [DBG] pgmap v9517: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:54:29.795 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:54:29.795 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:54:29.795 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:54:29.795 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:54:29.795 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:54:30.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:54:30 smithi157 bash[24585]: cluster 2024-09-16T10:54:29.332378+0000 mgr.a (mgr.14373) 13722 : cluster [DBG] pgmap v9518: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:54:30.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:54:30 smithi157 bash[24585]: audit 2024-09-16T10:54:29.372228+0000 mgr.a (mgr.14373) 13723 : audit [DBG] from='client.297930 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:54:30.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:54:30 smithi157 bash[24585]: audit 2024-09-16T10:54:29.523738+0000 mon.a (mon.0) 1385 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:54:30.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:54:30 smithi157 bash[24585]: audit 2024-09-16T10:54:29.530145+0000 mon.a (mon.0) 1386 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:54:30.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:54:30 smithi157 bash[24585]: audit 2024-09-16T10:54:29.534367+0000 mon.a (mon.0) 1387 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:54:30.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:54:30 smithi157 bash[24585]: audit 2024-09-16T10:54:29.539689+0000 mon.a (mon.0) 1388 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:54:30.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:54:30 smithi157 bash[24585]: audit 2024-09-16T10:54:29.558562+0000 mon.a (mon.0) 1389 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:54:30.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:54:30 smithi157 bash[24585]: audit 2024-09-16T10:54:29.565035+0000 mon.a (mon.0) 1390 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:54:30.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:54:30 smithi157 bash[24585]: audit 2024-09-16T10:54:30.283877+0000 mon.b (mon.2) 1255 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T10:54:30.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:54:30 smithi157 bash[24585]: audit 2024-09-16T10:54:30.286120+0000 mon.b (mon.2) 1256 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T10:54:30.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:54:30 smithi157 bash[24585]: audit 2024-09-16T10:54:30.295601+0000 mon.a (mon.0) 1391 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:54:30.808 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:54:30 smithi157 bash[24585]: audit 2024-09-16T10:54:30.302641+0000 mon.b (mon.2) 1257 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:54:30.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:54:30 smithi086 bash[24289]: cluster 2024-09-16T10:54:29.332378+0000 mgr.a (mgr.14373) 13722 : cluster [DBG] pgmap v9518: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:54:30.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:54:30 smithi086 bash[24289]: audit 2024-09-16T10:54:29.372228+0000 mgr.a (mgr.14373) 13723 : audit [DBG] from='client.297930 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:54:30.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:54:30 smithi086 bash[24289]: audit 2024-09-16T10:54:29.523738+0000 mon.a (mon.0) 1385 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:54:30.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:54:30 smithi086 bash[24289]: audit 2024-09-16T10:54:29.530145+0000 mon.a (mon.0) 1386 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:54:30.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:54:30 smithi086 bash[24289]: audit 2024-09-16T10:54:29.534367+0000 mon.a (mon.0) 1387 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:54:30.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:54:30 smithi086 bash[24289]: audit 2024-09-16T10:54:29.539689+0000 mon.a (mon.0) 1388 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:54:30.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:54:30 smithi086 bash[24289]: audit 2024-09-16T10:54:29.558562+0000 mon.a (mon.0) 1389 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:54:30.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:54:30 smithi086 bash[24289]: audit 2024-09-16T10:54:29.565035+0000 mon.a (mon.0) 1390 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:54:30.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:54:30 smithi086 bash[24289]: audit 2024-09-16T10:54:30.283877+0000 mon.b (mon.2) 1255 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T10:54:30.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:54:30 smithi086 bash[24289]: audit 2024-09-16T10:54:30.286120+0000 mon.b (mon.2) 1256 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T10:54:30.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:54:30 smithi086 bash[24289]: audit 2024-09-16T10:54:30.295601+0000 mon.a (mon.0) 1391 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:54:30.822 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:54:30 smithi086 bash[24289]: audit 2024-09-16T10:54:30.302641+0000 mon.b (mon.2) 1257 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:54:30.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:54:30 smithi047 bash[22744]: cluster 2024-09-16T10:54:29.332378+0000 mgr.a (mgr.14373) 13722 : cluster [DBG] pgmap v9518: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:54:30.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:54:30 smithi047 bash[22744]: audit 2024-09-16T10:54:29.372228+0000 mgr.a (mgr.14373) 13723 : audit [DBG] from='client.297930 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:54:30.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:54:30 smithi047 bash[22744]: audit 2024-09-16T10:54:29.523738+0000 mon.a (mon.0) 1385 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:54:30.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:54:30 smithi047 bash[22744]: audit 2024-09-16T10:54:29.530145+0000 mon.a (mon.0) 1386 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:54:30.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:54:30 smithi047 bash[22744]: audit 2024-09-16T10:54:29.534367+0000 mon.a (mon.0) 1387 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:54:30.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:54:30 smithi047 bash[22744]: audit 2024-09-16T10:54:29.539689+0000 mon.a (mon.0) 1388 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:54:30.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:54:30 smithi047 bash[22744]: audit 2024-09-16T10:54:29.558562+0000 mon.a (mon.0) 1389 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:54:30.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:54:30 smithi047 bash[22744]: audit 2024-09-16T10:54:29.565035+0000 mon.a (mon.0) 1390 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:54:30.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:54:30 smithi047 bash[22744]: audit 2024-09-16T10:54:30.283877+0000 mon.b (mon.2) 1255 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T10:54:30.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:54:30 smithi047 bash[22744]: audit 2024-09-16T10:54:30.286120+0000 mon.b (mon.2) 1256 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T10:54:30.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:54:30 smithi047 bash[22744]: audit 2024-09-16T10:54:30.295601+0000 mon.a (mon.0) 1391 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:54:30.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:54:30 smithi047 bash[22744]: audit 2024-09-16T10:54:30.302641+0000 mon.b (mon.2) 1257 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:54:31.342 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 10:54:31 smithi047 bash[22994]: debug 2024-09-16T10:54:31.035+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T10:54:31.343 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 10:54:31 smithi047 bash[22994]: debug 2024-09-16T10:54:31.039+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T10:54:31.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:54:31 smithi157 bash[24585]: audit 2024-09-16T10:54:30.305519+0000 mgr.a (mgr.14373) 13724 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:54:31.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:54:31 smithi086 bash[24289]: audit 2024-09-16T10:54:30.305519+0000 mgr.a (mgr.14373) 13724 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:54:31.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:54:31 smithi047 bash[22744]: audit 2024-09-16T10:54:30.305519+0000 mgr.a (mgr.14373) 13724 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:54:32.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:54:32 smithi157 bash[24585]: audit 2024-09-16T10:54:31.041333+0000 mgr.a (mgr.14373) 13725 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T10:54:32.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:54:32 smithi157 bash[24585]: cephadm 2024-09-16T10:54:31.043901+0000 mgr.a (mgr.14373) 13726 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T10:54:32.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:54:32 smithi157 bash[24585]: cluster 2024-09-16T10:54:31.333414+0000 mgr.a (mgr.14373) 13727 : cluster [DBG] pgmap v9519: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:54:32.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:54:32 smithi086 bash[24289]: audit 2024-09-16T10:54:31.041333+0000 mgr.a (mgr.14373) 13725 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T10:54:32.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:54:32 smithi086 bash[24289]: cephadm 2024-09-16T10:54:31.043901+0000 mgr.a (mgr.14373) 13726 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T10:54:32.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:54:32 smithi086 bash[24289]: cluster 2024-09-16T10:54:31.333414+0000 mgr.a (mgr.14373) 13727 : cluster [DBG] pgmap v9519: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:54:32.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:54:32 smithi047 bash[22744]: audit 2024-09-16T10:54:31.041333+0000 mgr.a (mgr.14373) 13725 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T10:54:32.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:54:32 smithi047 bash[22744]: cephadm 2024-09-16T10:54:31.043901+0000 mgr.a (mgr.14373) 13726 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T10:54:32.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:54:32 smithi047 bash[22744]: cluster 2024-09-16T10:54:31.333414+0000 mgr.a (mgr.14373) 13727 : cluster [DBG] pgmap v9519: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:54:34.796 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:54:34.797 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:54:34.797 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:54:34.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:54:34 smithi157 bash[24585]: cluster 2024-09-16T10:54:33.335945+0000 mgr.a (mgr.14373) 13728 : cluster [DBG] pgmap v9520: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:54:34.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:54:34 smithi086 bash[24289]: cluster 2024-09-16T10:54:33.335945+0000 mgr.a (mgr.14373) 13728 : cluster [DBG] pgmap v9520: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:54:34.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:54:34 smithi047 bash[22744]: cluster 2024-09-16T10:54:33.335945+0000 mgr.a (mgr.14373) 13728 : cluster [DBG] pgmap v9520: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:54:35.571 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:54:35.572 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:54:35.572 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:54:35.572 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:54:35.572 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:54:36.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:54:36 smithi157 bash[24585]: audit 2024-09-16T10:54:35.131541+0000 mgr.a (mgr.14373) 13729 : audit [DBG] from='client.298110 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:54:36.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:54:36 smithi157 bash[24585]: cluster 2024-09-16T10:54:35.336553+0000 mgr.a (mgr.14373) 13730 : cluster [DBG] pgmap v9521: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:54:36.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:54:36 smithi086 bash[24289]: audit 2024-09-16T10:54:35.131541+0000 mgr.a (mgr.14373) 13729 : audit [DBG] from='client.298110 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:54:36.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:54:36 smithi086 bash[24289]: cluster 2024-09-16T10:54:35.336553+0000 mgr.a (mgr.14373) 13730 : cluster [DBG] pgmap v9521: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:54:36.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:54:36 smithi047 bash[22744]: audit 2024-09-16T10:54:35.131541+0000 mgr.a (mgr.14373) 13729 : audit [DBG] from='client.298110 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:54:36.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:54:36 smithi047 bash[22744]: cluster 2024-09-16T10:54:35.336553+0000 mgr.a (mgr.14373) 13730 : cluster [DBG] pgmap v9521: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:54:38.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:54:38 smithi157 bash[24585]: cluster 2024-09-16T10:54:37.339006+0000 mgr.a (mgr.14373) 13731 : cluster [DBG] pgmap v9522: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:54:38.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:54:38 smithi086 bash[24289]: cluster 2024-09-16T10:54:37.339006+0000 mgr.a (mgr.14373) 13731 : cluster [DBG] pgmap v9522: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:54:38.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:54:38 smithi047 bash[22744]: cluster 2024-09-16T10:54:37.339006+0000 mgr.a (mgr.14373) 13731 : cluster [DBG] pgmap v9522: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:54:40.573 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:54:40.574 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:54:40.574 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:54:40.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:54:40 smithi157 bash[24585]: cluster 2024-09-16T10:54:39.339769+0000 mgr.a (mgr.14373) 13732 : cluster [DBG] pgmap v9523: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:54:40.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:54:40 smithi086 bash[24289]: cluster 2024-09-16T10:54:39.339769+0000 mgr.a (mgr.14373) 13732 : cluster [DBG] pgmap v9523: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:54:40.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:54:40 smithi047 bash[22744]: cluster 2024-09-16T10:54:39.339769+0000 mgr.a (mgr.14373) 13732 : cluster [DBG] pgmap v9523: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:54:41.345 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:54:41.345 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:54:41.345 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:54:41.346 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:54:41.346 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:54:42.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:54:42 smithi086 bash[24289]: audit 2024-09-16T10:54:40.906054+0000 mgr.a (mgr.14373) 13733 : audit [DBG] from='client.298185 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:54:42.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:54:42 smithi086 bash[24289]: cluster 2024-09-16T10:54:41.340332+0000 mgr.a (mgr.14373) 13734 : cluster [DBG] pgmap v9524: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:54:42.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:54:42 smithi047 bash[22744]: audit 2024-09-16T10:54:40.906054+0000 mgr.a (mgr.14373) 13733 : audit [DBG] from='client.298185 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:54:42.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:54:42 smithi047 bash[22744]: cluster 2024-09-16T10:54:41.340332+0000 mgr.a (mgr.14373) 13734 : cluster [DBG] pgmap v9524: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:54:43.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:54:42 smithi157 bash[24585]: audit 2024-09-16T10:54:40.906054+0000 mgr.a (mgr.14373) 13733 : audit [DBG] from='client.298185 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:54:43.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:54:42 smithi157 bash[24585]: cluster 2024-09-16T10:54:41.340332+0000 mgr.a (mgr.14373) 13734 : cluster [DBG] pgmap v9524: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:54:44.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:54:44 smithi086 bash[24289]: cluster 2024-09-16T10:54:43.342560+0000 mgr.a (mgr.14373) 13735 : cluster [DBG] pgmap v9525: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:54:44.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:54:44 smithi047 bash[22744]: cluster 2024-09-16T10:54:43.342560+0000 mgr.a (mgr.14373) 13735 : cluster [DBG] pgmap v9525: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:54:45.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:54:44 smithi157 bash[24585]: cluster 2024-09-16T10:54:43.342560+0000 mgr.a (mgr.14373) 13735 : cluster [DBG] pgmap v9525: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:54:46.347 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:54:46.348 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:54:46.348 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:54:46.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:54:46 smithi086 bash[24289]: cluster 2024-09-16T10:54:45.343347+0000 mgr.a (mgr.14373) 13736 : cluster [DBG] pgmap v9526: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:54:46.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:54:46 smithi047 bash[22744]: cluster 2024-09-16T10:54:45.343347+0000 mgr.a (mgr.14373) 13736 : cluster [DBG] pgmap v9526: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:54:47.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:54:46 smithi157 bash[24585]: cluster 2024-09-16T10:54:45.343347+0000 mgr.a (mgr.14373) 13736 : cluster [DBG] pgmap v9526: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:54:47.098 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:54:47.098 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:54:47.098 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:54:47.098 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:54:47.098 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:54:47.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:54:47 smithi047 bash[22744]: audit 2024-09-16T10:54:46.678008+0000 mgr.a (mgr.14373) 13737 : audit [DBG] from='client.298257 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:54:48.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:54:47 smithi157 bash[24585]: audit 2024-09-16T10:54:46.678008+0000 mgr.a (mgr.14373) 13737 : audit [DBG] from='client.298257 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:54:48.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:54:47 smithi086 bash[24289]: audit 2024-09-16T10:54:46.678008+0000 mgr.a (mgr.14373) 13737 : audit [DBG] from='client.298257 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:54:48.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:54:48 smithi047 bash[22744]: cluster 2024-09-16T10:54:47.346152+0000 mgr.a (mgr.14373) 13738 : cluster [DBG] pgmap v9527: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:54:49.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:54:48 smithi157 bash[24585]: cluster 2024-09-16T10:54:47.346152+0000 mgr.a (mgr.14373) 13738 : cluster [DBG] pgmap v9527: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:54:49.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:54:48 smithi086 bash[24289]: cluster 2024-09-16T10:54:47.346152+0000 mgr.a (mgr.14373) 13738 : cluster [DBG] pgmap v9527: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:54:50.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:54:50 smithi047 bash[22744]: cluster 2024-09-16T10:54:49.346942+0000 mgr.a (mgr.14373) 13739 : cluster [DBG] pgmap v9528: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:54:51.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:54:50 smithi157 bash[24585]: cluster 2024-09-16T10:54:49.346942+0000 mgr.a (mgr.14373) 13739 : cluster [DBG] pgmap v9528: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:54:51.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:54:50 smithi086 bash[24289]: cluster 2024-09-16T10:54:49.346942+0000 mgr.a (mgr.14373) 13739 : cluster [DBG] pgmap v9528: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:54:52.100 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:54:52.100 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:54:52.100 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:54:52.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:54:52 smithi047 bash[22744]: cluster 2024-09-16T10:54:51.347704+0000 mgr.a (mgr.14373) 13740 : cluster [DBG] pgmap v9529: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T10:54:52.900 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:54:52.900 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:54:52.900 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:54:52.900 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:54:52.901 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:54:53.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:54:52 smithi157 bash[24585]: cluster 2024-09-16T10:54:51.347704+0000 mgr.a (mgr.14373) 13740 : cluster [DBG] pgmap v9529: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T10:54:53.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:54:52 smithi086 bash[24289]: cluster 2024-09-16T10:54:51.347704+0000 mgr.a (mgr.14373) 13740 : cluster [DBG] pgmap v9529: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T10:54:53.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:54:53 smithi047 bash[22744]: audit 2024-09-16T10:54:52.440358+0000 mgr.a (mgr.14373) 13741 : audit [DBG] from='client.298335 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:54:54.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:54:53 smithi157 bash[24585]: audit 2024-09-16T10:54:52.440358+0000 mgr.a (mgr.14373) 13741 : audit [DBG] from='client.298335 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:54:54.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:54:53 smithi086 bash[24289]: audit 2024-09-16T10:54:52.440358+0000 mgr.a (mgr.14373) 13741 : audit [DBG] from='client.298335 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:54:55.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:54:54 smithi157 bash[24585]: cluster 2024-09-16T10:54:53.350575+0000 mgr.a (mgr.14373) 13742 : cluster [DBG] pgmap v9530: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:54:55.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:54:54 smithi086 bash[24289]: cluster 2024-09-16T10:54:53.350575+0000 mgr.a (mgr.14373) 13742 : cluster [DBG] pgmap v9530: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:54:55.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:54:54 smithi047 bash[22744]: cluster 2024-09-16T10:54:53.350575+0000 mgr.a (mgr.14373) 13742 : cluster [DBG] pgmap v9530: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:54:57.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:54:56 smithi157 bash[24585]: cluster 2024-09-16T10:54:55.351384+0000 mgr.a (mgr.14373) 13743 : cluster [DBG] pgmap v9531: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:54:57.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:54:56 smithi086 bash[24289]: cluster 2024-09-16T10:54:55.351384+0000 mgr.a (mgr.14373) 13743 : cluster [DBG] pgmap v9531: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:54:57.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:54:56 smithi047 bash[22744]: cluster 2024-09-16T10:54:55.351384+0000 mgr.a (mgr.14373) 13743 : cluster [DBG] pgmap v9531: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:54:57.902 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:54:57.902 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:54:57.903 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:54:58.665 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:54:58.665 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:54:58.665 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:54:58.665 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:54:58.665 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:54:59.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:54:58 smithi157 bash[24585]: cluster 2024-09-16T10:54:57.353442+0000 mgr.a (mgr.14373) 13744 : cluster [DBG] pgmap v9532: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:54:59.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:54:58 smithi086 bash[24289]: cluster 2024-09-16T10:54:57.353442+0000 mgr.a (mgr.14373) 13744 : cluster [DBG] pgmap v9532: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:54:59.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:54:58 smithi047 bash[22744]: cluster 2024-09-16T10:54:57.353442+0000 mgr.a (mgr.14373) 13744 : cluster [DBG] pgmap v9532: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:55:00.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:54:59 smithi157 bash[24585]: audit 2024-09-16T10:54:58.228568+0000 mgr.a (mgr.14373) 13745 : audit [DBG] from='client.298407 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:55:00.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:54:59 smithi086 bash[24289]: audit 2024-09-16T10:54:58.228568+0000 mgr.a (mgr.14373) 13745 : audit [DBG] from='client.298407 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:55:00.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:54:59 smithi047 bash[22744]: audit 2024-09-16T10:54:58.228568+0000 mgr.a (mgr.14373) 13745 : audit [DBG] from='client.298407 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:55:01.046 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:55:00 smithi086 bash[24289]: cluster 2024-09-16T10:54:59.354449+0000 mgr.a (mgr.14373) 13746 : cluster [DBG] pgmap v9533: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:55:01.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:55:00 smithi157 bash[24585]: cluster 2024-09-16T10:54:59.354449+0000 mgr.a (mgr.14373) 13746 : cluster [DBG] pgmap v9533: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:55:01.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:55:00 smithi047 bash[22744]: cluster 2024-09-16T10:54:59.354449+0000 mgr.a (mgr.14373) 13746 : cluster [DBG] pgmap v9533: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:55:02.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:55:01 smithi086 bash[24289]: cluster 2024-09-16T10:55:01.355363+0000 mgr.a (mgr.14373) 13747 : cluster [DBG] pgmap v9534: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:55:02.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:55:01 smithi047 bash[22744]: cluster 2024-09-16T10:55:01.355363+0000 mgr.a (mgr.14373) 13747 : cluster [DBG] pgmap v9534: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:55:02.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:55:01 smithi157 bash[24585]: cluster 2024-09-16T10:55:01.355363+0000 mgr.a (mgr.14373) 13747 : cluster [DBG] pgmap v9534: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:55:03.666 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:55:03.667 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:55:03.667 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:55:04.444 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:55:04.445 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:55:04.445 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:55:04.445 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:55:04.445 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:55:04.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:55:04 smithi157 bash[24585]: cluster 2024-09-16T10:55:03.357598+0000 mgr.a (mgr.14373) 13748 : cluster [DBG] pgmap v9535: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:55:04.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:55:04 smithi086 bash[24289]: cluster 2024-09-16T10:55:03.357598+0000 mgr.a (mgr.14373) 13748 : cluster [DBG] pgmap v9535: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:55:04.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:55:04 smithi047 bash[22744]: cluster 2024-09-16T10:55:03.357598+0000 mgr.a (mgr.14373) 13748 : cluster [DBG] pgmap v9535: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:55:05.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:55:05 smithi157 bash[24585]: audit 2024-09-16T10:55:04.001705+0000 mgr.a (mgr.14373) 13749 : audit [DBG] from='client.298485 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:55:05.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:55:05 smithi086 bash[24289]: audit 2024-09-16T10:55:04.001705+0000 mgr.a (mgr.14373) 13749 : audit [DBG] from='client.298485 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:55:05.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:55:05 smithi047 bash[22744]: audit 2024-09-16T10:55:04.001705+0000 mgr.a (mgr.14373) 13749 : audit [DBG] from='client.298485 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:55:06.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:55:06 smithi157 bash[24585]: cluster 2024-09-16T10:55:05.358546+0000 mgr.a (mgr.14373) 13750 : cluster [DBG] pgmap v9536: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:55:06.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:55:06 smithi086 bash[24289]: cluster 2024-09-16T10:55:05.358546+0000 mgr.a (mgr.14373) 13750 : cluster [DBG] pgmap v9536: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:55:06.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:55:06 smithi047 bash[22744]: cluster 2024-09-16T10:55:05.358546+0000 mgr.a (mgr.14373) 13750 : cluster [DBG] pgmap v9536: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:55:08.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:55:08 smithi157 bash[24585]: cluster 2024-09-16T10:55:07.360821+0000 mgr.a (mgr.14373) 13751 : cluster [DBG] pgmap v9537: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:55:08.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:55:08 smithi086 bash[24289]: cluster 2024-09-16T10:55:07.360821+0000 mgr.a (mgr.14373) 13751 : cluster [DBG] pgmap v9537: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:55:08.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:55:08 smithi047 bash[22744]: cluster 2024-09-16T10:55:07.360821+0000 mgr.a (mgr.14373) 13751 : cluster [DBG] pgmap v9537: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:55:09.446 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:55:09.446 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:55:09.446 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:55:10.221 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:55:10.222 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:55:10.222 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:55:10.222 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:55:10.222 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:55:10.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:55:10 smithi157 bash[24585]: cluster 2024-09-16T10:55:09.361589+0000 mgr.a (mgr.14373) 13752 : cluster [DBG] pgmap v9538: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:55:10.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:55:10 smithi086 bash[24289]: cluster 2024-09-16T10:55:09.361589+0000 mgr.a (mgr.14373) 13752 : cluster [DBG] pgmap v9538: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:55:10.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:55:10 smithi047 bash[22744]: cluster 2024-09-16T10:55:09.361589+0000 mgr.a (mgr.14373) 13752 : cluster [DBG] pgmap v9538: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:55:11.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:55:11 smithi157 bash[24585]: audit 2024-09-16T10:55:09.781422+0000 mgr.a (mgr.14373) 13753 : audit [DBG] from='client.298560 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:55:11.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:55:11 smithi086 bash[24289]: audit 2024-09-16T10:55:09.781422+0000 mgr.a (mgr.14373) 13753 : audit [DBG] from='client.298560 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:55:11.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:55:11 smithi047 bash[22744]: audit 2024-09-16T10:55:09.781422+0000 mgr.a (mgr.14373) 13753 : audit [DBG] from='client.298560 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:55:12.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:55:12 smithi157 bash[24585]: cluster 2024-09-16T10:55:11.362503+0000 mgr.a (mgr.14373) 13754 : cluster [DBG] pgmap v9539: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:55:12.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:55:12 smithi086 bash[24289]: cluster 2024-09-16T10:55:11.362503+0000 mgr.a (mgr.14373) 13754 : cluster [DBG] pgmap v9539: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:55:12.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:55:12 smithi047 bash[22744]: cluster 2024-09-16T10:55:11.362503+0000 mgr.a (mgr.14373) 13754 : cluster [DBG] pgmap v9539: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:55:14.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:55:14 smithi157 bash[24585]: cluster 2024-09-16T10:55:13.364688+0000 mgr.a (mgr.14373) 13755 : cluster [DBG] pgmap v9540: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:55:14.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:55:14 smithi086 bash[24289]: cluster 2024-09-16T10:55:13.364688+0000 mgr.a (mgr.14373) 13755 : cluster [DBG] pgmap v9540: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:55:14.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:55:14 smithi047 bash[22744]: cluster 2024-09-16T10:55:13.364688+0000 mgr.a (mgr.14373) 13755 : cluster [DBG] pgmap v9540: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:55:15.223 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:55:15.223 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:55:15.224 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:55:15.985 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:55:15.985 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:55:15.986 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:55:15.986 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:55:15.986 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:55:16.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:55:16 smithi157 bash[24585]: cluster 2024-09-16T10:55:15.365227+0000 mgr.a (mgr.14373) 13756 : cluster [DBG] pgmap v9541: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:55:16.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:55:16 smithi157 bash[24585]: audit 2024-09-16T10:55:15.557156+0000 mgr.a (mgr.14373) 13757 : audit [DBG] from='client.298638 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:55:16.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:55:16 smithi086 bash[24289]: cluster 2024-09-16T10:55:15.365227+0000 mgr.a (mgr.14373) 13756 : cluster [DBG] pgmap v9541: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:55:16.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:55:16 smithi086 bash[24289]: audit 2024-09-16T10:55:15.557156+0000 mgr.a (mgr.14373) 13757 : audit [DBG] from='client.298638 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:55:16.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:55:16 smithi047 bash[22744]: cluster 2024-09-16T10:55:15.365227+0000 mgr.a (mgr.14373) 13756 : cluster [DBG] pgmap v9541: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:55:16.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:55:16 smithi047 bash[22744]: audit 2024-09-16T10:55:15.557156+0000 mgr.a (mgr.14373) 13757 : audit [DBG] from='client.298638 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:55:18.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:55:18 smithi157 bash[24585]: cluster 2024-09-16T10:55:17.367575+0000 mgr.a (mgr.14373) 13758 : cluster [DBG] pgmap v9542: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:55:18.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:55:18 smithi086 bash[24289]: cluster 2024-09-16T10:55:17.367575+0000 mgr.a (mgr.14373) 13758 : cluster [DBG] pgmap v9542: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:55:18.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:55:18 smithi047 bash[22744]: cluster 2024-09-16T10:55:17.367575+0000 mgr.a (mgr.14373) 13758 : cluster [DBG] pgmap v9542: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:55:20.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:55:20 smithi157 bash[24585]: cluster 2024-09-16T10:55:19.368346+0000 mgr.a (mgr.14373) 13759 : cluster [DBG] pgmap v9543: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:55:20.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:55:20 smithi086 bash[24289]: cluster 2024-09-16T10:55:19.368346+0000 mgr.a (mgr.14373) 13759 : cluster [DBG] pgmap v9543: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:55:20.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:55:20 smithi047 bash[22744]: cluster 2024-09-16T10:55:19.368346+0000 mgr.a (mgr.14373) 13759 : cluster [DBG] pgmap v9543: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:55:20.987 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:55:20.987 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:55:20.987 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:55:21.737 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:55:21.737 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:55:21.737 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:55:21.737 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:55:21.737 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:55:22.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:55:22 smithi157 bash[24585]: audit 2024-09-16T10:55:21.316559+0000 mgr.a (mgr.14373) 13760 : audit [DBG] from='client.298716 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:55:22.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:55:22 smithi157 bash[24585]: cluster 2024-09-16T10:55:21.369449+0000 mgr.a (mgr.14373) 13761 : cluster [DBG] pgmap v9544: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:55:22.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:55:22 smithi086 bash[24289]: audit 2024-09-16T10:55:21.316559+0000 mgr.a (mgr.14373) 13760 : audit [DBG] from='client.298716 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:55:22.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:55:22 smithi086 bash[24289]: cluster 2024-09-16T10:55:21.369449+0000 mgr.a (mgr.14373) 13761 : cluster [DBG] pgmap v9544: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:55:22.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:55:22 smithi047 bash[22744]: audit 2024-09-16T10:55:21.316559+0000 mgr.a (mgr.14373) 13760 : audit [DBG] from='client.298716 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:55:22.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:55:22 smithi047 bash[22744]: cluster 2024-09-16T10:55:21.369449+0000 mgr.a (mgr.14373) 13761 : cluster [DBG] pgmap v9544: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:55:24.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:55:24 smithi157 bash[24585]: cluster 2024-09-16T10:55:23.372228+0000 mgr.a (mgr.14373) 13762 : cluster [DBG] pgmap v9545: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:55:24.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:55:24 smithi086 bash[24289]: cluster 2024-09-16T10:55:23.372228+0000 mgr.a (mgr.14373) 13762 : cluster [DBG] pgmap v9545: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:55:24.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:55:24 smithi047 bash[22744]: cluster 2024-09-16T10:55:23.372228+0000 mgr.a (mgr.14373) 13762 : cluster [DBG] pgmap v9545: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:55:26.738 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:55:26.739 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:55:26.739 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:55:26.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:55:26 smithi157 bash[24585]: cluster 2024-09-16T10:55:25.373150+0000 mgr.a (mgr.14373) 13763 : cluster [DBG] pgmap v9546: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:55:26.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:55:26 smithi086 bash[24289]: cluster 2024-09-16T10:55:25.373150+0000 mgr.a (mgr.14373) 13763 : cluster [DBG] pgmap v9546: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:55:26.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:55:26 smithi047 bash[22744]: cluster 2024-09-16T10:55:25.373150+0000 mgr.a (mgr.14373) 13763 : cluster [DBG] pgmap v9546: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:55:27.521 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:55:27.521 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:55:27.521 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:55:27.522 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:55:27.522 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:55:28.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:55:28 smithi157 bash[24585]: audit 2024-09-16T10:55:27.074100+0000 mgr.a (mgr.14373) 13764 : audit [DBG] from='client.298794 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:55:28.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:55:28 smithi157 bash[24585]: cluster 2024-09-16T10:55:27.375231+0000 mgr.a (mgr.14373) 13765 : cluster [DBG] pgmap v9547: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:55:28.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:55:28 smithi086 bash[24289]: audit 2024-09-16T10:55:27.074100+0000 mgr.a (mgr.14373) 13764 : audit [DBG] from='client.298794 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:55:28.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:55:28 smithi086 bash[24289]: cluster 2024-09-16T10:55:27.375231+0000 mgr.a (mgr.14373) 13765 : cluster [DBG] pgmap v9547: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:55:28.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:55:28 smithi047 bash[22744]: audit 2024-09-16T10:55:27.074100+0000 mgr.a (mgr.14373) 13764 : audit [DBG] from='client.298794 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:55:28.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:55:28 smithi047 bash[22744]: cluster 2024-09-16T10:55:27.375231+0000 mgr.a (mgr.14373) 13765 : cluster [DBG] pgmap v9547: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:55:30.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:55:30 smithi157 bash[24585]: cluster 2024-09-16T10:55:29.376106+0000 mgr.a (mgr.14373) 13766 : cluster [DBG] pgmap v9548: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:55:30.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:55:30 smithi086 bash[24289]: cluster 2024-09-16T10:55:29.376106+0000 mgr.a (mgr.14373) 13766 : cluster [DBG] pgmap v9548: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:55:30.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:55:30 smithi047 bash[22744]: cluster 2024-09-16T10:55:29.376106+0000 mgr.a (mgr.14373) 13766 : cluster [DBG] pgmap v9548: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:55:31.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:55:31 smithi157 bash[24585]: audit 2024-09-16T10:55:31.095519+0000 mon.b (mon.2) 1258 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T10:55:31.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:55:31 smithi086 bash[24289]: audit 2024-09-16T10:55:31.095519+0000 mon.b (mon.2) 1258 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T10:55:31.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:55:31 smithi047 bash[22744]: audit 2024-09-16T10:55:31.095519+0000 mon.b (mon.2) 1258 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T10:55:32.523 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:55:32.523 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:55:32.523 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:55:32.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:55:32 smithi157 bash[24585]: cluster 2024-09-16T10:55:31.376838+0000 mgr.a (mgr.14373) 13767 : cluster [DBG] pgmap v9549: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T10:55:32.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:55:32 smithi157 bash[24585]: audit 2024-09-16T10:55:31.958133+0000 mon.b (mon.2) 1259 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T10:55:32.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:55:32 smithi157 bash[24585]: audit 2024-09-16T10:55:31.960319+0000 mon.b (mon.2) 1260 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T10:55:32.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:55:32 smithi157 bash[24585]: audit 2024-09-16T10:55:31.972268+0000 mon.a (mon.0) 1392 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:55:32.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:55:32 smithi157 bash[24585]: audit 2024-09-16T10:55:31.983534+0000 mon.b (mon.2) 1261 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:55:32.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:55:32 smithi086 bash[24289]: cluster 2024-09-16T10:55:31.376838+0000 mgr.a (mgr.14373) 13767 : cluster [DBG] pgmap v9549: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T10:55:32.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:55:32 smithi086 bash[24289]: audit 2024-09-16T10:55:31.958133+0000 mon.b (mon.2) 1259 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T10:55:32.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:55:32 smithi086 bash[24289]: audit 2024-09-16T10:55:31.960319+0000 mon.b (mon.2) 1260 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T10:55:32.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:55:32 smithi086 bash[24289]: audit 2024-09-16T10:55:31.972268+0000 mon.a (mon.0) 1392 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:55:32.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:55:32 smithi086 bash[24289]: audit 2024-09-16T10:55:31.983534+0000 mon.b (mon.2) 1261 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:55:32.842 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 10:55:32 smithi047 bash[22994]: debug 2024-09-16T10:55:32.725+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T10:55:32.842 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 10:55:32 smithi047 bash[22994]: debug 2024-09-16T10:55:32.729+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T10:55:32.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:55:32 smithi047 bash[22744]: cluster 2024-09-16T10:55:31.376838+0000 mgr.a (mgr.14373) 13767 : cluster [DBG] pgmap v9549: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T10:55:32.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:55:32 smithi047 bash[22744]: audit 2024-09-16T10:55:31.958133+0000 mon.b (mon.2) 1259 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T10:55:32.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:55:32 smithi047 bash[22744]: audit 2024-09-16T10:55:31.960319+0000 mon.b (mon.2) 1260 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T10:55:32.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:55:32 smithi047 bash[22744]: audit 2024-09-16T10:55:31.972268+0000 mon.a (mon.0) 1392 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:55:32.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:55:32 smithi047 bash[22744]: audit 2024-09-16T10:55:31.983534+0000 mon.b (mon.2) 1261 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:55:33.260 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:55:33.261 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:55:33.261 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:55:33.261 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:55:33.261 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:55:33.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:55:33 smithi157 bash[24585]: audit 2024-09-16T10:55:31.986578+0000 mgr.a (mgr.14373) 13768 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:55:33.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:55:33 smithi157 bash[24585]: audit 2024-09-16T10:55:32.728492+0000 mgr.a (mgr.14373) 13769 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T10:55:33.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:55:33 smithi157 bash[24585]: cephadm 2024-09-16T10:55:32.730401+0000 mgr.a (mgr.14373) 13770 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T10:55:33.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:55:33 smithi086 bash[24289]: audit 2024-09-16T10:55:31.986578+0000 mgr.a (mgr.14373) 13768 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:55:33.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:55:33 smithi086 bash[24289]: audit 2024-09-16T10:55:32.728492+0000 mgr.a (mgr.14373) 13769 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T10:55:33.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:55:33 smithi086 bash[24289]: cephadm 2024-09-16T10:55:32.730401+0000 mgr.a (mgr.14373) 13770 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T10:55:33.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:55:33 smithi047 bash[22744]: audit 2024-09-16T10:55:31.986578+0000 mgr.a (mgr.14373) 13768 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:55:33.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:55:33 smithi047 bash[22744]: audit 2024-09-16T10:55:32.728492+0000 mgr.a (mgr.14373) 13769 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T10:55:33.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:55:33 smithi047 bash[22744]: cephadm 2024-09-16T10:55:32.730401+0000 mgr.a (mgr.14373) 13770 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T10:55:34.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:55:34 smithi157 bash[24585]: audit 2024-09-16T10:55:32.840862+0000 mgr.a (mgr.14373) 13771 : audit [DBG] from='client.298977 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:55:34.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:55:34 smithi157 bash[24585]: cluster 2024-09-16T10:55:33.379666+0000 mgr.a (mgr.14373) 13772 : cluster [DBG] pgmap v9550: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:55:34.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:55:34 smithi086 bash[24289]: audit 2024-09-16T10:55:32.840862+0000 mgr.a (mgr.14373) 13771 : audit [DBG] from='client.298977 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:55:34.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:55:34 smithi086 bash[24289]: cluster 2024-09-16T10:55:33.379666+0000 mgr.a (mgr.14373) 13772 : cluster [DBG] pgmap v9550: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:55:34.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:55:34 smithi047 bash[22744]: audit 2024-09-16T10:55:32.840862+0000 mgr.a (mgr.14373) 13771 : audit [DBG] from='client.298977 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:55:34.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:55:34 smithi047 bash[22744]: cluster 2024-09-16T10:55:33.379666+0000 mgr.a (mgr.14373) 13772 : cluster [DBG] pgmap v9550: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:55:36.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:55:36 smithi157 bash[24585]: cluster 2024-09-16T10:55:35.380467+0000 mgr.a (mgr.14373) 13773 : cluster [DBG] pgmap v9551: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:55:36.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:55:36 smithi086 bash[24289]: cluster 2024-09-16T10:55:35.380467+0000 mgr.a (mgr.14373) 13773 : cluster [DBG] pgmap v9551: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:55:36.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:55:36 smithi047 bash[22744]: cluster 2024-09-16T10:55:35.380467+0000 mgr.a (mgr.14373) 13773 : cluster [DBG] pgmap v9551: 225 pgs: 225 active+clean; 589 KiB data, 187 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:55:38.263 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:55:38.263 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:55:38.263 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:55:38.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:55:38 smithi157 bash[24585]: cluster 2024-09-16T10:55:37.382560+0000 mgr.a (mgr.14373) 13774 : cluster [DBG] pgmap v9552: 225 pgs: 225 active+clean; 589 KiB data, 191 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:55:38.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:55:38 smithi086 bash[24289]: cluster 2024-09-16T10:55:37.382560+0000 mgr.a (mgr.14373) 13774 : cluster [DBG] pgmap v9552: 225 pgs: 225 active+clean; 589 KiB data, 191 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:55:38.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:55:38 smithi047 bash[22744]: cluster 2024-09-16T10:55:37.382560+0000 mgr.a (mgr.14373) 13774 : cluster [DBG] pgmap v9552: 225 pgs: 225 active+clean; 589 KiB data, 191 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:55:39.038 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:55:39.039 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:55:39.039 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:55:39.039 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:55:39.039 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:55:39.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:55:39 smithi157 bash[24585]: audit 2024-09-16T10:55:38.595843+0000 mgr.a (mgr.14373) 13775 : audit [DBG] from='client.299055 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:55:39.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:55:39 smithi086 bash[24289]: audit 2024-09-16T10:55:38.595843+0000 mgr.a (mgr.14373) 13775 : audit [DBG] from='client.299055 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:55:39.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:55:39 smithi047 bash[22744]: audit 2024-09-16T10:55:38.595843+0000 mgr.a (mgr.14373) 13775 : audit [DBG] from='client.299055 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:55:40.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:55:40 smithi157 bash[24585]: cluster 2024-09-16T10:55:39.383552+0000 mgr.a (mgr.14373) 13776 : cluster [DBG] pgmap v9553: 225 pgs: 225 active+clean; 589 KiB data, 191 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:55:40.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:55:40 smithi086 bash[24289]: cluster 2024-09-16T10:55:39.383552+0000 mgr.a (mgr.14373) 13776 : cluster [DBG] pgmap v9553: 225 pgs: 225 active+clean; 589 KiB data, 191 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:55:40.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:55:40 smithi047 bash[22744]: cluster 2024-09-16T10:55:39.383552+0000 mgr.a (mgr.14373) 13776 : cluster [DBG] pgmap v9553: 225 pgs: 225 active+clean; 589 KiB data, 191 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:55:42.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:55:41 smithi086 bash[24289]: cluster 2024-09-16T10:55:41.384323+0000 mgr.a (mgr.14373) 13777 : cluster [DBG] pgmap v9554: 225 pgs: 225 active+clean; 589 KiB data, 191 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:55:42.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:55:41 smithi047 bash[22744]: cluster 2024-09-16T10:55:41.384323+0000 mgr.a (mgr.14373) 13777 : cluster [DBG] pgmap v9554: 225 pgs: 225 active+clean; 589 KiB data, 191 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:55:42.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:55:41 smithi157 bash[24585]: cluster 2024-09-16T10:55:41.384323+0000 mgr.a (mgr.14373) 13777 : cluster [DBG] pgmap v9554: 225 pgs: 225 active+clean; 589 KiB data, 191 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:55:44.040 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:55:44.041 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:55:44.041 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:55:44.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:55:44 smithi157 bash[24585]: cluster 2024-09-16T10:55:43.386563+0000 mgr.a (mgr.14373) 13778 : cluster [DBG] pgmap v9555: 225 pgs: 225 active+clean; 589 KiB data, 191 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:55:44.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:55:44 smithi086 bash[24289]: cluster 2024-09-16T10:55:43.386563+0000 mgr.a (mgr.14373) 13778 : cluster [DBG] pgmap v9555: 225 pgs: 225 active+clean; 589 KiB data, 191 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:55:44.822 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:55:44.822 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:55:44.822 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:55:44.822 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:55:44.822 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:55:44.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:55:44 smithi047 bash[22744]: cluster 2024-09-16T10:55:43.386563+0000 mgr.a (mgr.14373) 13778 : cluster [DBG] pgmap v9555: 225 pgs: 225 active+clean; 589 KiB data, 191 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:55:45.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:55:45 smithi157 bash[24585]: audit 2024-09-16T10:55:44.374389+0000 mgr.a (mgr.14373) 13779 : audit [DBG] from='client.299133 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:55:45.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:55:45 smithi086 bash[24289]: audit 2024-09-16T10:55:44.374389+0000 mgr.a (mgr.14373) 13779 : audit [DBG] from='client.299133 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:55:45.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:55:45 smithi047 bash[22744]: audit 2024-09-16T10:55:44.374389+0000 mgr.a (mgr.14373) 13779 : audit [DBG] from='client.299133 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:55:46.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:55:46 smithi157 bash[24585]: cluster 2024-09-16T10:55:45.387456+0000 mgr.a (mgr.14373) 13780 : cluster [DBG] pgmap v9556: 225 pgs: 225 active+clean; 589 KiB data, 191 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:55:46.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:55:46 smithi086 bash[24289]: cluster 2024-09-16T10:55:45.387456+0000 mgr.a (mgr.14373) 13780 : cluster [DBG] pgmap v9556: 225 pgs: 225 active+clean; 589 KiB data, 191 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:55:46.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:55:46 smithi047 bash[22744]: cluster 2024-09-16T10:55:45.387456+0000 mgr.a (mgr.14373) 13780 : cluster [DBG] pgmap v9556: 225 pgs: 225 active+clean; 589 KiB data, 191 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:55:48.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:55:48 smithi157 bash[24585]: cluster 2024-09-16T10:55:47.389725+0000 mgr.a (mgr.14373) 13781 : cluster [DBG] pgmap v9557: 225 pgs: 225 active+clean; 589 KiB data, 191 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:55:48.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:55:48 smithi086 bash[24289]: cluster 2024-09-16T10:55:47.389725+0000 mgr.a (mgr.14373) 13781 : cluster [DBG] pgmap v9557: 225 pgs: 225 active+clean; 589 KiB data, 191 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:55:48.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:55:48 smithi047 bash[22744]: cluster 2024-09-16T10:55:47.389725+0000 mgr.a (mgr.14373) 13781 : cluster [DBG] pgmap v9557: 225 pgs: 225 active+clean; 589 KiB data, 191 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:55:49.824 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:55:49.824 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:55:49.825 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:55:50.581 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:55:50.582 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:55:50.582 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:55:50.582 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:55:50.582 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:55:50.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:55:50 smithi157 bash[24585]: cluster 2024-09-16T10:55:49.390490+0000 mgr.a (mgr.14373) 13782 : cluster [DBG] pgmap v9558: 225 pgs: 225 active+clean; 589 KiB data, 191 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:55:50.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:55:50 smithi086 bash[24289]: cluster 2024-09-16T10:55:49.390490+0000 mgr.a (mgr.14373) 13782 : cluster [DBG] pgmap v9558: 225 pgs: 225 active+clean; 589 KiB data, 191 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:55:50.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:55:50 smithi047 bash[22744]: cluster 2024-09-16T10:55:49.390490+0000 mgr.a (mgr.14373) 13782 : cluster [DBG] pgmap v9558: 225 pgs: 225 active+clean; 589 KiB data, 191 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:55:51.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:55:51 smithi157 bash[24585]: audit 2024-09-16T10:55:50.155851+0000 mgr.a (mgr.14373) 13783 : audit [DBG] from='client.299211 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:55:51.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:55:51 smithi086 bash[24289]: audit 2024-09-16T10:55:50.155851+0000 mgr.a (mgr.14373) 13783 : audit [DBG] from='client.299211 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:55:51.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:55:51 smithi047 bash[22744]: audit 2024-09-16T10:55:50.155851+0000 mgr.a (mgr.14373) 13783 : audit [DBG] from='client.299211 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:55:52.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:55:52 smithi157 bash[24585]: cluster 2024-09-16T10:55:51.391296+0000 mgr.a (mgr.14373) 13784 : cluster [DBG] pgmap v9559: 225 pgs: 225 active+clean; 589 KiB data, 191 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:55:52.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:55:52 smithi086 bash[24289]: cluster 2024-09-16T10:55:51.391296+0000 mgr.a (mgr.14373) 13784 : cluster [DBG] pgmap v9559: 225 pgs: 225 active+clean; 589 KiB data, 191 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:55:52.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:55:52 smithi047 bash[22744]: cluster 2024-09-16T10:55:51.391296+0000 mgr.a (mgr.14373) 13784 : cluster [DBG] pgmap v9559: 225 pgs: 225 active+clean; 589 KiB data, 191 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:55:54.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:55:54 smithi157 bash[24585]: cluster 2024-09-16T10:55:53.393879+0000 mgr.a (mgr.14373) 13785 : cluster [DBG] pgmap v9560: 225 pgs: 225 active+clean; 589 KiB data, 191 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:55:54.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:55:54 smithi086 bash[24289]: cluster 2024-09-16T10:55:53.393879+0000 mgr.a (mgr.14373) 13785 : cluster [DBG] pgmap v9560: 225 pgs: 225 active+clean; 589 KiB data, 191 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:55:54.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:55:54 smithi047 bash[22744]: cluster 2024-09-16T10:55:53.393879+0000 mgr.a (mgr.14373) 13785 : cluster [DBG] pgmap v9560: 225 pgs: 225 active+clean; 589 KiB data, 191 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:55:55.583 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:55:55.584 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:55:55.584 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:55:56.366 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:55:56.367 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:55:56.367 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:55:56.367 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:55:56.367 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:55:56.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:55:56 smithi157 bash[24585]: cluster 2024-09-16T10:55:55.394648+0000 mgr.a (mgr.14373) 13786 : cluster [DBG] pgmap v9561: 225 pgs: 225 active+clean; 589 KiB data, 191 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:55:56.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:55:56 smithi086 bash[24289]: cluster 2024-09-16T10:55:55.394648+0000 mgr.a (mgr.14373) 13786 : cluster [DBG] pgmap v9561: 225 pgs: 225 active+clean; 589 KiB data, 191 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:55:56.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:55:56 smithi047 bash[22744]: cluster 2024-09-16T10:55:55.394648+0000 mgr.a (mgr.14373) 13786 : cluster [DBG] pgmap v9561: 225 pgs: 225 active+clean; 589 KiB data, 191 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:55:57.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:55:57 smithi157 bash[24585]: audit 2024-09-16T10:55:55.915118+0000 mgr.a (mgr.14373) 13787 : audit [DBG] from='client.299286 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:55:57.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:55:57 smithi086 bash[24289]: audit 2024-09-16T10:55:55.915118+0000 mgr.a (mgr.14373) 13787 : audit [DBG] from='client.299286 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:55:57.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:55:57 smithi047 bash[22744]: audit 2024-09-16T10:55:55.915118+0000 mgr.a (mgr.14373) 13787 : audit [DBG] from='client.299286 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:55:58.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:55:58 smithi157 bash[24585]: cluster 2024-09-16T10:55:57.397010+0000 mgr.a (mgr.14373) 13788 : cluster [DBG] pgmap v9562: 225 pgs: 225 active+clean; 589 KiB data, 191 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:55:58.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:55:58 smithi086 bash[24289]: cluster 2024-09-16T10:55:57.397010+0000 mgr.a (mgr.14373) 13788 : cluster [DBG] pgmap v9562: 225 pgs: 225 active+clean; 589 KiB data, 191 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:55:58.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:55:58 smithi047 bash[22744]: cluster 2024-09-16T10:55:57.397010+0000 mgr.a (mgr.14373) 13788 : cluster [DBG] pgmap v9562: 225 pgs: 225 active+clean; 589 KiB data, 191 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:56:00.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:56:00 smithi157 bash[24585]: cluster 2024-09-16T10:55:59.397824+0000 mgr.a (mgr.14373) 13789 : cluster [DBG] pgmap v9563: 225 pgs: 225 active+clean; 589 KiB data, 191 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:56:00.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:56:00 smithi086 bash[24289]: cluster 2024-09-16T10:55:59.397824+0000 mgr.a (mgr.14373) 13789 : cluster [DBG] pgmap v9563: 225 pgs: 225 active+clean; 589 KiB data, 191 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:56:00.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:56:00 smithi047 bash[22744]: cluster 2024-09-16T10:55:59.397824+0000 mgr.a (mgr.14373) 13789 : cluster [DBG] pgmap v9563: 225 pgs: 225 active+clean; 589 KiB data, 191 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:56:01.368 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:56:01.369 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:56:01.369 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:56:02.142 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:56:02.142 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:56:02.143 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:56:02.143 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:56:02.143 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:56:02.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:56:02 smithi157 bash[24585]: cluster 2024-09-16T10:56:01.398904+0000 mgr.a (mgr.14373) 13790 : cluster [DBG] pgmap v9564: 225 pgs: 225 active+clean; 589 KiB data, 191 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:56:02.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:56:02 smithi157 bash[24585]: audit 2024-09-16T10:56:01.704003+0000 mgr.a (mgr.14373) 13791 : audit [DBG] from='client.299358 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:56:02.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:56:02 smithi086 bash[24289]: cluster 2024-09-16T10:56:01.398904+0000 mgr.a (mgr.14373) 13790 : cluster [DBG] pgmap v9564: 225 pgs: 225 active+clean; 589 KiB data, 191 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:56:02.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:56:02 smithi086 bash[24289]: audit 2024-09-16T10:56:01.704003+0000 mgr.a (mgr.14373) 13791 : audit [DBG] from='client.299358 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:56:02.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:56:02 smithi047 bash[22744]: cluster 2024-09-16T10:56:01.398904+0000 mgr.a (mgr.14373) 13790 : cluster [DBG] pgmap v9564: 225 pgs: 225 active+clean; 589 KiB data, 191 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:56:02.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:56:02 smithi047 bash[22744]: audit 2024-09-16T10:56:01.704003+0000 mgr.a (mgr.14373) 13791 : audit [DBG] from='client.299358 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:56:04.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:56:04 smithi157 bash[24585]: cluster 2024-09-16T10:56:03.401108+0000 mgr.a (mgr.14373) 13792 : cluster [DBG] pgmap v9565: 225 pgs: 225 active+clean; 589 KiB data, 191 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:56:04.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:56:04 smithi086 bash[24289]: cluster 2024-09-16T10:56:03.401108+0000 mgr.a (mgr.14373) 13792 : cluster [DBG] pgmap v9565: 225 pgs: 225 active+clean; 589 KiB data, 191 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:56:04.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:56:04 smithi047 bash[22744]: cluster 2024-09-16T10:56:03.401108+0000 mgr.a (mgr.14373) 13792 : cluster [DBG] pgmap v9565: 225 pgs: 225 active+clean; 589 KiB data, 191 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:56:06.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:56:06 smithi157 bash[24585]: cluster 2024-09-16T10:56:05.401867+0000 mgr.a (mgr.14373) 13793 : cluster [DBG] pgmap v9566: 225 pgs: 225 active+clean; 589 KiB data, 191 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:56:06.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:56:06 smithi086 bash[24289]: cluster 2024-09-16T10:56:05.401867+0000 mgr.a (mgr.14373) 13793 : cluster [DBG] pgmap v9566: 225 pgs: 225 active+clean; 589 KiB data, 191 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:56:06.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:56:06 smithi047 bash[22744]: cluster 2024-09-16T10:56:05.401867+0000 mgr.a (mgr.14373) 13793 : cluster [DBG] pgmap v9566: 225 pgs: 225 active+clean; 589 KiB data, 191 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:56:07.143 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:56:07.144 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:56:07.144 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:56:07.934 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:56:07.934 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:56:07.934 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:56:07.935 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:56:07.935 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:56:08.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:56:08 smithi157 bash[24585]: cluster 2024-09-16T10:56:07.403158+0000 mgr.a (mgr.14373) 13794 : cluster [DBG] pgmap v9567: 225 pgs: 225 active+clean; 589 KiB data, 191 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:56:08.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:56:08 smithi157 bash[24585]: audit 2024-09-16T10:56:07.480765+0000 mgr.a (mgr.14373) 13795 : audit [DBG] from='client.299436 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:56:08.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:56:08 smithi086 bash[24289]: cluster 2024-09-16T10:56:07.403158+0000 mgr.a (mgr.14373) 13794 : cluster [DBG] pgmap v9567: 225 pgs: 225 active+clean; 589 KiB data, 191 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:56:08.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:56:08 smithi086 bash[24289]: audit 2024-09-16T10:56:07.480765+0000 mgr.a (mgr.14373) 13795 : audit [DBG] from='client.299436 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:56:08.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:56:08 smithi047 bash[22744]: cluster 2024-09-16T10:56:07.403158+0000 mgr.a (mgr.14373) 13794 : cluster [DBG] pgmap v9567: 225 pgs: 225 active+clean; 589 KiB data, 191 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:56:08.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:56:08 smithi047 bash[22744]: audit 2024-09-16T10:56:07.480765+0000 mgr.a (mgr.14373) 13795 : audit [DBG] from='client.299436 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:56:10.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:56:10 smithi157 bash[24585]: cluster 2024-09-16T10:56:09.404171+0000 mgr.a (mgr.14373) 13796 : cluster [DBG] pgmap v9568: 225 pgs: 225 active+clean; 589 KiB data, 191 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T10:56:10.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:56:10 smithi086 bash[24289]: cluster 2024-09-16T10:56:09.404171+0000 mgr.a (mgr.14373) 13796 : cluster [DBG] pgmap v9568: 225 pgs: 225 active+clean; 589 KiB data, 191 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T10:56:10.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:56:10 smithi047 bash[22744]: cluster 2024-09-16T10:56:09.404171+0000 mgr.a (mgr.14373) 13796 : cluster [DBG] pgmap v9568: 225 pgs: 225 active+clean; 589 KiB data, 191 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T10:56:12.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:56:12 smithi157 bash[24585]: cluster 2024-09-16T10:56:11.405803+0000 mgr.a (mgr.14373) 13797 : cluster [DBG] pgmap v9569: 225 pgs: 225 active+clean; 589 KiB data, 191 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-16T10:56:12.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:56:12 smithi086 bash[24289]: cluster 2024-09-16T10:56:11.405803+0000 mgr.a (mgr.14373) 13797 : cluster [DBG] pgmap v9569: 225 pgs: 225 active+clean; 589 KiB data, 191 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-16T10:56:12.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:56:12 smithi047 bash[22744]: cluster 2024-09-16T10:56:11.405803+0000 mgr.a (mgr.14373) 13797 : cluster [DBG] pgmap v9569: 225 pgs: 225 active+clean; 589 KiB data, 191 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-16T10:56:12.935 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:56:12.936 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:56:12.936 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:56:13.681 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:56:13.681 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:56:13.681 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:56:13.681 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:56:13.681 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:56:14.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:56:14 smithi157 bash[24585]: audit 2024-09-16T10:56:13.267769+0000 mgr.a (mgr.14373) 13798 : audit [DBG] from='client.299511 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:56:14.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:56:14 smithi157 bash[24585]: cluster 2024-09-16T10:56:13.406957+0000 mgr.a (mgr.14373) 13799 : cluster [DBG] pgmap v9570: 225 pgs: 225 active+clean; 589 KiB data, 191 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:56:14.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:56:14 smithi086 bash[24289]: audit 2024-09-16T10:56:13.267769+0000 mgr.a (mgr.14373) 13798 : audit [DBG] from='client.299511 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:56:14.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:56:14 smithi086 bash[24289]: cluster 2024-09-16T10:56:13.406957+0000 mgr.a (mgr.14373) 13799 : cluster [DBG] pgmap v9570: 225 pgs: 225 active+clean; 589 KiB data, 191 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:56:14.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:56:14 smithi047 bash[22744]: audit 2024-09-16T10:56:13.267769+0000 mgr.a (mgr.14373) 13798 : audit [DBG] from='client.299511 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:56:14.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:56:14 smithi047 bash[22744]: cluster 2024-09-16T10:56:13.406957+0000 mgr.a (mgr.14373) 13799 : cluster [DBG] pgmap v9570: 225 pgs: 225 active+clean; 589 KiB data, 191 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:56:16.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:56:16 smithi157 bash[24585]: cluster 2024-09-16T10:56:15.407946+0000 mgr.a (mgr.14373) 13800 : cluster [DBG] pgmap v9571: 225 pgs: 225 active+clean; 589 KiB data, 191 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:56:16.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:56:16 smithi086 bash[24289]: cluster 2024-09-16T10:56:15.407946+0000 mgr.a (mgr.14373) 13800 : cluster [DBG] pgmap v9571: 225 pgs: 225 active+clean; 589 KiB data, 191 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:56:16.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:56:16 smithi047 bash[22744]: cluster 2024-09-16T10:56:15.407946+0000 mgr.a (mgr.14373) 13800 : cluster [DBG] pgmap v9571: 225 pgs: 225 active+clean; 589 KiB data, 191 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:56:18.683 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:56:18.683 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:56:18.683 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:56:18.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:56:18 smithi157 bash[24585]: cluster 2024-09-16T10:56:17.410381+0000 mgr.a (mgr.14373) 13801 : cluster [DBG] pgmap v9572: 225 pgs: 225 active+clean; 589 KiB data, 191 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:56:18.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:56:18 smithi086 bash[24289]: cluster 2024-09-16T10:56:17.410381+0000 mgr.a (mgr.14373) 13801 : cluster [DBG] pgmap v9572: 225 pgs: 225 active+clean; 589 KiB data, 191 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:56:18.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:56:18 smithi047 bash[22744]: cluster 2024-09-16T10:56:17.410381+0000 mgr.a (mgr.14373) 13801 : cluster [DBG] pgmap v9572: 225 pgs: 225 active+clean; 589 KiB data, 191 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:56:19.457 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:56:19.458 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:56:19.458 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:56:19.458 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:56:19.458 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:56:20.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:56:20 smithi157 bash[24585]: audit 2024-09-16T10:56:19.016897+0000 mgr.a (mgr.14373) 13802 : audit [DBG] from='client.299586 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:56:20.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:56:20 smithi157 bash[24585]: cluster 2024-09-16T10:56:19.410928+0000 mgr.a (mgr.14373) 13803 : cluster [DBG] pgmap v9573: 225 pgs: 225 active+clean; 589 KiB data, 191 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:56:20.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:56:20 smithi086 bash[24289]: audit 2024-09-16T10:56:19.016897+0000 mgr.a (mgr.14373) 13802 : audit [DBG] from='client.299586 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:56:20.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:56:20 smithi086 bash[24289]: cluster 2024-09-16T10:56:19.410928+0000 mgr.a (mgr.14373) 13803 : cluster [DBG] pgmap v9573: 225 pgs: 225 active+clean; 589 KiB data, 191 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:56:20.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:56:20 smithi047 bash[22744]: audit 2024-09-16T10:56:19.016897+0000 mgr.a (mgr.14373) 13802 : audit [DBG] from='client.299586 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:56:20.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:56:20 smithi047 bash[22744]: cluster 2024-09-16T10:56:19.410928+0000 mgr.a (mgr.14373) 13803 : cluster [DBG] pgmap v9573: 225 pgs: 225 active+clean; 589 KiB data, 191 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:56:22.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:56:22 smithi157 bash[24585]: cluster 2024-09-16T10:56:21.412237+0000 mgr.a (mgr.14373) 13804 : cluster [DBG] pgmap v9574: 225 pgs: 225 active+clean; 589 KiB data, 191 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-16T10:56:22.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:56:22 smithi086 bash[24289]: cluster 2024-09-16T10:56:21.412237+0000 mgr.a (mgr.14373) 13804 : cluster [DBG] pgmap v9574: 225 pgs: 225 active+clean; 589 KiB data, 191 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-16T10:56:22.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:56:22 smithi047 bash[22744]: cluster 2024-09-16T10:56:21.412237+0000 mgr.a (mgr.14373) 13804 : cluster [DBG] pgmap v9574: 225 pgs: 225 active+clean; 589 KiB data, 191 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-16T10:56:24.459 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:56:24.460 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:56:24.460 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:56:24.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:56:24 smithi157 bash[24585]: cluster 2024-09-16T10:56:23.413878+0000 mgr.a (mgr.14373) 13805 : cluster [DBG] pgmap v9575: 225 pgs: 225 active+clean; 589 KiB data, 191 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:56:24.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:56:24 smithi086 bash[24289]: cluster 2024-09-16T10:56:23.413878+0000 mgr.a (mgr.14373) 13805 : cluster [DBG] pgmap v9575: 225 pgs: 225 active+clean; 589 KiB data, 191 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:56:24.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:56:24 smithi047 bash[22744]: cluster 2024-09-16T10:56:23.413878+0000 mgr.a (mgr.14373) 13805 : cluster [DBG] pgmap v9575: 225 pgs: 225 active+clean; 589 KiB data, 191 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:56:25.250 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:56:25.251 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:56:25.251 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:56:25.251 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:56:25.251 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:56:26.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:56:26 smithi157 bash[24585]: audit 2024-09-16T10:56:24.799867+0000 mgr.a (mgr.14373) 13806 : audit [DBG] from='client.299664 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:56:26.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:56:26 smithi157 bash[24585]: cluster 2024-09-16T10:56:25.414854+0000 mgr.a (mgr.14373) 13807 : cluster [DBG] pgmap v9576: 225 pgs: 225 active+clean; 589 KiB data, 191 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:56:26.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:56:26 smithi086 bash[24289]: audit 2024-09-16T10:56:24.799867+0000 mgr.a (mgr.14373) 13806 : audit [DBG] from='client.299664 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:56:26.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:56:26 smithi086 bash[24289]: cluster 2024-09-16T10:56:25.414854+0000 mgr.a (mgr.14373) 13807 : cluster [DBG] pgmap v9576: 225 pgs: 225 active+clean; 589 KiB data, 191 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:56:26.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:56:26 smithi047 bash[22744]: audit 2024-09-16T10:56:24.799867+0000 mgr.a (mgr.14373) 13806 : audit [DBG] from='client.299664 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:56:26.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:56:26 smithi047 bash[22744]: cluster 2024-09-16T10:56:25.414854+0000 mgr.a (mgr.14373) 13807 : cluster [DBG] pgmap v9576: 225 pgs: 225 active+clean; 589 KiB data, 191 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:56:28.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:56:28 smithi086 bash[24289]: cluster 2024-09-16T10:56:27.417078+0000 mgr.a (mgr.14373) 13808 : cluster [DBG] pgmap v9577: 225 pgs: 225 active+clean; 589 KiB data, 191 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:56:28.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:56:28 smithi047 bash[22744]: cluster 2024-09-16T10:56:27.417078+0000 mgr.a (mgr.14373) 13808 : cluster [DBG] pgmap v9577: 225 pgs: 225 active+clean; 589 KiB data, 191 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:56:29.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:56:28 smithi157 bash[24585]: cluster 2024-09-16T10:56:27.417078+0000 mgr.a (mgr.14373) 13808 : cluster [DBG] pgmap v9577: 225 pgs: 225 active+clean; 589 KiB data, 191 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:56:30.252 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:56:30.253 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:56:30.253 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:56:30.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:56:30 smithi086 bash[24289]: cluster 2024-09-16T10:56:29.417835+0000 mgr.a (mgr.14373) 13809 : cluster [DBG] pgmap v9578: 225 pgs: 225 active+clean; 589 KiB data, 191 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:56:30.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:56:30 smithi047 bash[22744]: cluster 2024-09-16T10:56:29.417835+0000 mgr.a (mgr.14373) 13809 : cluster [DBG] pgmap v9578: 225 pgs: 225 active+clean; 589 KiB data, 191 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:56:31.016 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:56:31.016 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:56:31.016 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:56:31.016 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:56:31.016 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:56:31.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:56:30 smithi157 bash[24585]: cluster 2024-09-16T10:56:29.417835+0000 mgr.a (mgr.14373) 13809 : cluster [DBG] pgmap v9578: 225 pgs: 225 active+clean; 589 KiB data, 191 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:56:31.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:56:31 smithi086 bash[24289]: audit 2024-09-16T10:56:30.581972+0000 mgr.a (mgr.14373) 13810 : audit [DBG] from='client.299739 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:56:31.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:56:31 smithi047 bash[22744]: audit 2024-09-16T10:56:30.581972+0000 mgr.a (mgr.14373) 13810 : audit [DBG] from='client.299739 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:56:32.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:56:31 smithi157 bash[24585]: audit 2024-09-16T10:56:30.581972+0000 mgr.a (mgr.14373) 13810 : audit [DBG] from='client.299739 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:56:32.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:56:32 smithi047 bash[22744]: cluster 2024-09-16T10:56:31.419321+0000 mgr.a (mgr.14373) 13811 : cluster [DBG] pgmap v9579: 225 pgs: 225 active+clean; 589 KiB data, 191 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-16T10:56:33.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:56:32 smithi157 bash[24585]: cluster 2024-09-16T10:56:31.419321+0000 mgr.a (mgr.14373) 13811 : cluster [DBG] pgmap v9579: 225 pgs: 225 active+clean; 589 KiB data, 191 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-16T10:56:33.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:56:32 smithi086 bash[24289]: cluster 2024-09-16T10:56:31.419321+0000 mgr.a (mgr.14373) 13811 : cluster [DBG] pgmap v9579: 225 pgs: 225 active+clean; 589 KiB data, 191 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-16T10:56:33.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:56:33 smithi047 bash[22744]: audit 2024-09-16T10:56:32.783807+0000 mon.b (mon.2) 1262 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T10:56:34.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:56:33 smithi157 bash[24585]: audit 2024-09-16T10:56:32.783807+0000 mon.b (mon.2) 1262 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T10:56:34.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:56:33 smithi086 bash[24289]: audit 2024-09-16T10:56:32.783807+0000 mon.b (mon.2) 1262 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T10:56:34.843 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 10:56:34 smithi047 bash[22994]: debug 2024-09-16T10:56:34.392+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T10:56:34.843 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 10:56:34 smithi047 bash[22994]: debug 2024-09-16T10:56:34.392+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T10:56:34.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:56:34 smithi047 bash[22744]: cluster 2024-09-16T10:56:33.420281+0000 mgr.a (mgr.14373) 13812 : cluster [DBG] pgmap v9580: 225 pgs: 225 active+clean; 589 KiB data, 191 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:56:34.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:56:34 smithi047 bash[22744]: audit 2024-09-16T10:56:33.622330+0000 mon.b (mon.2) 1263 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T10:56:34.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:56:34 smithi047 bash[22744]: audit 2024-09-16T10:56:33.624406+0000 mon.b (mon.2) 1264 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T10:56:34.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:56:34 smithi047 bash[22744]: audit 2024-09-16T10:56:33.636503+0000 mon.a (mon.0) 1393 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:56:34.844 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:56:34 smithi047 bash[22744]: audit 2024-09-16T10:56:33.641686+0000 mon.b (mon.2) 1265 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:56:34.844 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:56:34 smithi047 bash[22744]: audit 2024-09-16T10:56:33.644441+0000 mgr.a (mgr.14373) 13813 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:56:35.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:56:34 smithi157 bash[24585]: cluster 2024-09-16T10:56:33.420281+0000 mgr.a (mgr.14373) 13812 : cluster [DBG] pgmap v9580: 225 pgs: 225 active+clean; 589 KiB data, 191 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:56:35.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:56:34 smithi157 bash[24585]: audit 2024-09-16T10:56:33.622330+0000 mon.b (mon.2) 1263 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T10:56:35.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:56:34 smithi157 bash[24585]: audit 2024-09-16T10:56:33.624406+0000 mon.b (mon.2) 1264 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T10:56:35.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:56:34 smithi157 bash[24585]: audit 2024-09-16T10:56:33.636503+0000 mon.a (mon.0) 1393 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:56:35.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:56:34 smithi157 bash[24585]: audit 2024-09-16T10:56:33.641686+0000 mon.b (mon.2) 1265 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:56:35.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:56:34 smithi157 bash[24585]: audit 2024-09-16T10:56:33.644441+0000 mgr.a (mgr.14373) 13813 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:56:35.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:56:34 smithi086 bash[24289]: cluster 2024-09-16T10:56:33.420281+0000 mgr.a (mgr.14373) 13812 : cluster [DBG] pgmap v9580: 225 pgs: 225 active+clean; 589 KiB data, 191 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:56:35.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:56:34 smithi086 bash[24289]: audit 2024-09-16T10:56:33.622330+0000 mon.b (mon.2) 1263 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T10:56:35.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:56:34 smithi086 bash[24289]: audit 2024-09-16T10:56:33.624406+0000 mon.b (mon.2) 1264 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T10:56:35.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:56:34 smithi086 bash[24289]: audit 2024-09-16T10:56:33.636503+0000 mon.a (mon.0) 1393 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:56:35.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:56:34 smithi086 bash[24289]: audit 2024-09-16T10:56:33.641686+0000 mon.b (mon.2) 1265 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:56:35.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:56:34 smithi086 bash[24289]: audit 2024-09-16T10:56:33.644441+0000 mgr.a (mgr.14373) 13813 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:56:36.018 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:56:36.018 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:56:36.018 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:56:36.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:56:35 smithi157 bash[24585]: audit 2024-09-16T10:56:34.395819+0000 mgr.a (mgr.14373) 13814 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T10:56:36.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:56:35 smithi157 bash[24585]: cephadm 2024-09-16T10:56:34.398048+0000 mgr.a (mgr.14373) 13815 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T10:56:36.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:56:35 smithi086 bash[24289]: audit 2024-09-16T10:56:34.395819+0000 mgr.a (mgr.14373) 13814 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T10:56:36.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:56:35 smithi086 bash[24289]: cephadm 2024-09-16T10:56:34.398048+0000 mgr.a (mgr.14373) 13815 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T10:56:36.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:56:35 smithi047 bash[22744]: audit 2024-09-16T10:56:34.395819+0000 mgr.a (mgr.14373) 13814 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T10:56:36.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:56:35 smithi047 bash[22744]: cephadm 2024-09-16T10:56:34.398048+0000 mgr.a (mgr.14373) 13815 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T10:56:36.786 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:56:36.786 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:56:36.787 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:56:36.787 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:56:36.787 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:56:37.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:56:36 smithi157 bash[24585]: cluster 2024-09-16T10:56:35.421150+0000 mgr.a (mgr.14373) 13816 : cluster [DBG] pgmap v9581: 225 pgs: 225 active+clean; 589 KiB data, 191 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:56:37.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:56:36 smithi086 bash[24289]: cluster 2024-09-16T10:56:35.421150+0000 mgr.a (mgr.14373) 13816 : cluster [DBG] pgmap v9581: 225 pgs: 225 active+clean; 589 KiB data, 191 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:56:37.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:56:36 smithi047 bash[22744]: cluster 2024-09-16T10:56:35.421150+0000 mgr.a (mgr.14373) 13816 : cluster [DBG] pgmap v9581: 225 pgs: 225 active+clean; 589 KiB data, 191 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:56:38.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:56:37 smithi157 bash[24585]: audit 2024-09-16T10:56:36.351637+0000 mgr.a (mgr.14373) 13817 : audit [DBG] from='client.299925 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:56:38.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:56:37 smithi086 bash[24289]: audit 2024-09-16T10:56:36.351637+0000 mgr.a (mgr.14373) 13817 : audit [DBG] from='client.299925 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:56:38.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:56:37 smithi047 bash[22744]: audit 2024-09-16T10:56:36.351637+0000 mgr.a (mgr.14373) 13817 : audit [DBG] from='client.299925 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:56:39.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:56:38 smithi157 bash[24585]: cluster 2024-09-16T10:56:37.423927+0000 mgr.a (mgr.14373) 13818 : cluster [DBG] pgmap v9582: 225 pgs: 225 active+clean; 589 KiB data, 191 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:56:39.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:56:38 smithi086 bash[24289]: cluster 2024-09-16T10:56:37.423927+0000 mgr.a (mgr.14373) 13818 : cluster [DBG] pgmap v9582: 225 pgs: 225 active+clean; 589 KiB data, 191 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:56:39.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:56:38 smithi047 bash[22744]: cluster 2024-09-16T10:56:37.423927+0000 mgr.a (mgr.14373) 13818 : cluster [DBG] pgmap v9582: 225 pgs: 225 active+clean; 589 KiB data, 191 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:56:41.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:56:40 smithi157 bash[24585]: cluster 2024-09-16T10:56:39.424700+0000 mgr.a (mgr.14373) 13819 : cluster [DBG] pgmap v9583: 225 pgs: 225 active+clean; 589 KiB data, 191 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T10:56:41.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:56:40 smithi086 bash[24289]: cluster 2024-09-16T10:56:39.424700+0000 mgr.a (mgr.14373) 13819 : cluster [DBG] pgmap v9583: 225 pgs: 225 active+clean; 589 KiB data, 191 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T10:56:41.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:56:40 smithi047 bash[22744]: cluster 2024-09-16T10:56:39.424700+0000 mgr.a (mgr.14373) 13819 : cluster [DBG] pgmap v9583: 225 pgs: 225 active+clean; 589 KiB data, 191 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T10:56:41.788 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:56:41.789 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:56:41.789 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:56:42.573 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:56:42.574 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:56:42.574 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:56:42.574 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:56:42.574 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:56:43.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:56:42 smithi157 bash[24585]: cluster 2024-09-16T10:56:41.426372+0000 mgr.a (mgr.14373) 13820 : cluster [DBG] pgmap v9584: 225 pgs: 225 active+clean; 589 KiB data, 191 MiB used, 268 GiB / 268 GiB avail; 6.4 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T10:56:43.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:56:42 smithi086 bash[24289]: cluster 2024-09-16T10:56:41.426372+0000 mgr.a (mgr.14373) 13820 : cluster [DBG] pgmap v9584: 225 pgs: 225 active+clean; 589 KiB data, 191 MiB used, 268 GiB / 268 GiB avail; 6.4 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T10:56:43.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:56:42 smithi047 bash[22744]: cluster 2024-09-16T10:56:41.426372+0000 mgr.a (mgr.14373) 13820 : cluster [DBG] pgmap v9584: 225 pgs: 225 active+clean; 589 KiB data, 191 MiB used, 268 GiB / 268 GiB avail; 6.4 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T10:56:44.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:56:43 smithi157 bash[24585]: audit 2024-09-16T10:56:42.125944+0000 mgr.a (mgr.14373) 13821 : audit [DBG] from='client.300003 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:56:44.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:56:43 smithi086 bash[24289]: audit 2024-09-16T10:56:42.125944+0000 mgr.a (mgr.14373) 13821 : audit [DBG] from='client.300003 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:56:44.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:56:43 smithi047 bash[22744]: audit 2024-09-16T10:56:42.125944+0000 mgr.a (mgr.14373) 13821 : audit [DBG] from='client.300003 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:56:45.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:56:44 smithi157 bash[24585]: cluster 2024-09-16T10:56:43.428157+0000 mgr.a (mgr.14373) 13822 : cluster [DBG] pgmap v9585: 225 pgs: 225 active+clean; 589 KiB data, 191 MiB used, 268 GiB / 268 GiB avail; 6.9 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T10:56:45.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:56:44 smithi086 bash[24289]: cluster 2024-09-16T10:56:43.428157+0000 mgr.a (mgr.14373) 13822 : cluster [DBG] pgmap v9585: 225 pgs: 225 active+clean; 589 KiB data, 191 MiB used, 268 GiB / 268 GiB avail; 6.9 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T10:56:45.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:56:44 smithi047 bash[22744]: cluster 2024-09-16T10:56:43.428157+0000 mgr.a (mgr.14373) 13822 : cluster [DBG] pgmap v9585: 225 pgs: 225 active+clean; 589 KiB data, 191 MiB used, 268 GiB / 268 GiB avail; 6.9 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T10:56:47.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:56:46 smithi157 bash[24585]: cluster 2024-09-16T10:56:45.428949+0000 mgr.a (mgr.14373) 13823 : cluster [DBG] pgmap v9586: 225 pgs: 225 active+clean; 589 KiB data, 191 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T10:56:47.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:56:46 smithi086 bash[24289]: cluster 2024-09-16T10:56:45.428949+0000 mgr.a (mgr.14373) 13823 : cluster [DBG] pgmap v9586: 225 pgs: 225 active+clean; 589 KiB data, 191 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T10:56:47.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:56:46 smithi047 bash[22744]: cluster 2024-09-16T10:56:45.428949+0000 mgr.a (mgr.14373) 13823 : cluster [DBG] pgmap v9586: 225 pgs: 225 active+clean; 589 KiB data, 191 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T10:56:47.575 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:56:47.576 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:56:47.576 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:56:48.367 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:56:48.367 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:56:48.367 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:56:48.367 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:56:48.367 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:56:49.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:56:48 smithi157 bash[24585]: cluster 2024-09-16T10:56:47.431038+0000 mgr.a (mgr.14373) 13824 : cluster [DBG] pgmap v9587: 225 pgs: 225 active+clean; 589 KiB data, 191 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:56:49.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:56:48 smithi086 bash[24289]: cluster 2024-09-16T10:56:47.431038+0000 mgr.a (mgr.14373) 13824 : cluster [DBG] pgmap v9587: 225 pgs: 225 active+clean; 589 KiB data, 191 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:56:49.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:56:48 smithi047 bash[22744]: cluster 2024-09-16T10:56:47.431038+0000 mgr.a (mgr.14373) 13824 : cluster [DBG] pgmap v9587: 225 pgs: 225 active+clean; 589 KiB data, 191 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:56:50.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:56:49 smithi157 bash[24585]: audit 2024-09-16T10:56:47.912642+0000 mgr.a (mgr.14373) 13825 : audit [DBG] from='client.300081 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:56:50.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:56:49 smithi086 bash[24289]: audit 2024-09-16T10:56:47.912642+0000 mgr.a (mgr.14373) 13825 : audit [DBG] from='client.300081 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:56:50.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:56:49 smithi047 bash[22744]: audit 2024-09-16T10:56:47.912642+0000 mgr.a (mgr.14373) 13825 : audit [DBG] from='client.300081 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:56:51.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:56:50 smithi157 bash[24585]: cluster 2024-09-16T10:56:49.431993+0000 mgr.a (mgr.14373) 13826 : cluster [DBG] pgmap v9588: 225 pgs: 225 active+clean; 589 KiB data, 191 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:56:51.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:56:50 smithi086 bash[24289]: cluster 2024-09-16T10:56:49.431993+0000 mgr.a (mgr.14373) 13826 : cluster [DBG] pgmap v9588: 225 pgs: 225 active+clean; 589 KiB data, 191 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:56:51.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:56:50 smithi047 bash[22744]: cluster 2024-09-16T10:56:49.431993+0000 mgr.a (mgr.14373) 13826 : cluster [DBG] pgmap v9588: 225 pgs: 225 active+clean; 589 KiB data, 191 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:56:53.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:56:52 smithi157 bash[24585]: cluster 2024-09-16T10:56:51.433780+0000 mgr.a (mgr.14373) 13827 : cluster [DBG] pgmap v9589: 225 pgs: 225 active+clean; 589 KiB data, 191 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-16T10:56:53.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:56:52 smithi086 bash[24289]: cluster 2024-09-16T10:56:51.433780+0000 mgr.a (mgr.14373) 13827 : cluster [DBG] pgmap v9589: 225 pgs: 225 active+clean; 589 KiB data, 191 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-16T10:56:53.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:56:52 smithi047 bash[22744]: cluster 2024-09-16T10:56:51.433780+0000 mgr.a (mgr.14373) 13827 : cluster [DBG] pgmap v9589: 225 pgs: 225 active+clean; 589 KiB data, 191 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-16T10:56:53.368 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:56:53.369 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:56:53.369 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:56:54.158 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:56:54.159 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:56:54.159 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:56:54.159 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:56:54.159 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:56:55.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:56:54 smithi157 bash[24585]: cluster 2024-09-16T10:56:53.434843+0000 mgr.a (mgr.14373) 13828 : cluster [DBG] pgmap v9590: 225 pgs: 225 active+clean; 589 KiB data, 191 MiB used, 268 GiB / 268 GiB avail; 2.4 KiB/s rd, 2 op/s 2024-09-16T10:56:55.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:56:54 smithi157 bash[24585]: audit 2024-09-16T10:56:53.704304+0000 mgr.a (mgr.14373) 13829 : audit [DBG] from='client.300159 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:56:55.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:56:54 smithi086 bash[24289]: cluster 2024-09-16T10:56:53.434843+0000 mgr.a (mgr.14373) 13828 : cluster [DBG] pgmap v9590: 225 pgs: 225 active+clean; 589 KiB data, 191 MiB used, 268 GiB / 268 GiB avail; 2.4 KiB/s rd, 2 op/s 2024-09-16T10:56:55.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:56:54 smithi086 bash[24289]: audit 2024-09-16T10:56:53.704304+0000 mgr.a (mgr.14373) 13829 : audit [DBG] from='client.300159 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:56:55.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:56:54 smithi047 bash[22744]: cluster 2024-09-16T10:56:53.434843+0000 mgr.a (mgr.14373) 13828 : cluster [DBG] pgmap v9590: 225 pgs: 225 active+clean; 589 KiB data, 191 MiB used, 268 GiB / 268 GiB avail; 2.4 KiB/s rd, 2 op/s 2024-09-16T10:56:55.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:56:54 smithi047 bash[22744]: audit 2024-09-16T10:56:53.704304+0000 mgr.a (mgr.14373) 13829 : audit [DBG] from='client.300159 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:56:57.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:56:56 smithi157 bash[24585]: cluster 2024-09-16T10:56:55.435858+0000 mgr.a (mgr.14373) 13830 : cluster [DBG] pgmap v9591: 225 pgs: 225 active+clean; 589 KiB data, 191 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:56:57.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:56:56 smithi086 bash[24289]: cluster 2024-09-16T10:56:55.435858+0000 mgr.a (mgr.14373) 13830 : cluster [DBG] pgmap v9591: 225 pgs: 225 active+clean; 589 KiB data, 191 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:56:57.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:56:56 smithi047 bash[22744]: cluster 2024-09-16T10:56:55.435858+0000 mgr.a (mgr.14373) 13830 : cluster [DBG] pgmap v9591: 225 pgs: 225 active+clean; 589 KiB data, 191 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:56:59.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:56:58 smithi157 bash[24585]: cluster 2024-09-16T10:56:57.438131+0000 mgr.a (mgr.14373) 13831 : cluster [DBG] pgmap v9592: 225 pgs: 225 active+clean; 589 KiB data, 191 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:56:59.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:56:58 smithi086 bash[24289]: cluster 2024-09-16T10:56:57.438131+0000 mgr.a (mgr.14373) 13831 : cluster [DBG] pgmap v9592: 225 pgs: 225 active+clean; 589 KiB data, 191 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:56:59.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:56:58 smithi047 bash[22744]: cluster 2024-09-16T10:56:57.438131+0000 mgr.a (mgr.14373) 13831 : cluster [DBG] pgmap v9592: 225 pgs: 225 active+clean; 589 KiB data, 191 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:56:59.160 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:56:59.161 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:56:59.161 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:56:59.946 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:56:59.946 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:56:59.946 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:56:59.946 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:56:59.946 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:57:01.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:57:00 smithi157 bash[24585]: cluster 2024-09-16T10:56:59.438673+0000 mgr.a (mgr.14373) 13832 : cluster [DBG] pgmap v9593: 225 pgs: 225 active+clean; 589 KiB data, 191 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:57:01.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:57:00 smithi157 bash[24585]: audit 2024-09-16T10:56:59.494227+0000 mgr.a (mgr.14373) 13833 : audit [DBG] from='client.300237 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:57:01.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:57:00 smithi086 bash[24289]: cluster 2024-09-16T10:56:59.438673+0000 mgr.a (mgr.14373) 13832 : cluster [DBG] pgmap v9593: 225 pgs: 225 active+clean; 589 KiB data, 191 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:57:01.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:57:00 smithi086 bash[24289]: audit 2024-09-16T10:56:59.494227+0000 mgr.a (mgr.14373) 13833 : audit [DBG] from='client.300237 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:57:01.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:57:00 smithi047 bash[22744]: cluster 2024-09-16T10:56:59.438673+0000 mgr.a (mgr.14373) 13832 : cluster [DBG] pgmap v9593: 225 pgs: 225 active+clean; 589 KiB data, 191 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:57:01.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:57:00 smithi047 bash[22744]: audit 2024-09-16T10:56:59.494227+0000 mgr.a (mgr.14373) 13833 : audit [DBG] from='client.300237 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:57:03.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:57:02 smithi157 bash[24585]: cluster 2024-09-16T10:57:01.440784+0000 mgr.a (mgr.14373) 13834 : cluster [DBG] pgmap v9594: 225 pgs: 225 active+clean; 589 KiB data, 191 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-16T10:57:03.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:57:02 smithi086 bash[24289]: cluster 2024-09-16T10:57:01.440784+0000 mgr.a (mgr.14373) 13834 : cluster [DBG] pgmap v9594: 225 pgs: 225 active+clean; 589 KiB data, 191 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-16T10:57:03.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:57:02 smithi047 bash[22744]: cluster 2024-09-16T10:57:01.440784+0000 mgr.a (mgr.14373) 13834 : cluster [DBG] pgmap v9594: 225 pgs: 225 active+clean; 589 KiB data, 191 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-16T10:57:04.948 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:57:04.949 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:57:04.949 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:57:05.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:57:04 smithi157 bash[24585]: cluster 2024-09-16T10:57:03.442208+0000 mgr.a (mgr.14373) 13835 : cluster [DBG] pgmap v9595: 225 pgs: 225 active+clean; 589 KiB data, 191 MiB used, 268 GiB / 268 GiB avail; 2.4 KiB/s rd, 2 op/s 2024-09-16T10:57:05.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:57:04 smithi086 bash[24289]: cluster 2024-09-16T10:57:03.442208+0000 mgr.a (mgr.14373) 13835 : cluster [DBG] pgmap v9595: 225 pgs: 225 active+clean; 589 KiB data, 191 MiB used, 268 GiB / 268 GiB avail; 2.4 KiB/s rd, 2 op/s 2024-09-16T10:57:05.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:57:04 smithi047 bash[22744]: cluster 2024-09-16T10:57:03.442208+0000 mgr.a (mgr.14373) 13835 : cluster [DBG] pgmap v9595: 225 pgs: 225 active+clean; 589 KiB data, 191 MiB used, 268 GiB / 268 GiB avail; 2.4 KiB/s rd, 2 op/s 2024-09-16T10:57:05.704 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:57:05.704 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:57:05.704 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:57:05.704 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:57:05.704 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:57:07.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:57:06 smithi157 bash[24585]: audit 2024-09-16T10:57:05.281353+0000 mgr.a (mgr.14373) 13836 : audit [DBG] from='client.300309 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:57:07.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:57:06 smithi157 bash[24585]: cluster 2024-09-16T10:57:05.442862+0000 mgr.a (mgr.14373) 13837 : cluster [DBG] pgmap v9596: 225 pgs: 225 active+clean; 589 KiB data, 191 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:57:07.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:57:06 smithi086 bash[24289]: audit 2024-09-16T10:57:05.281353+0000 mgr.a (mgr.14373) 13836 : audit [DBG] from='client.300309 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:57:07.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:57:06 smithi086 bash[24289]: cluster 2024-09-16T10:57:05.442862+0000 mgr.a (mgr.14373) 13837 : cluster [DBG] pgmap v9596: 225 pgs: 225 active+clean; 589 KiB data, 191 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:57:07.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:57:06 smithi047 bash[22744]: audit 2024-09-16T10:57:05.281353+0000 mgr.a (mgr.14373) 13836 : audit [DBG] from='client.300309 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:57:07.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:57:06 smithi047 bash[22744]: cluster 2024-09-16T10:57:05.442862+0000 mgr.a (mgr.14373) 13837 : cluster [DBG] pgmap v9596: 225 pgs: 225 active+clean; 589 KiB data, 191 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:57:09.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:57:08 smithi157 bash[24585]: cluster 2024-09-16T10:57:07.445179+0000 mgr.a (mgr.14373) 13838 : cluster [DBG] pgmap v9597: 225 pgs: 225 active+clean; 589 KiB data, 191 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:57:09.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:57:08 smithi086 bash[24289]: cluster 2024-09-16T10:57:07.445179+0000 mgr.a (mgr.14373) 13838 : cluster [DBG] pgmap v9597: 225 pgs: 225 active+clean; 589 KiB data, 191 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:57:09.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:57:08 smithi047 bash[22744]: cluster 2024-09-16T10:57:07.445179+0000 mgr.a (mgr.14373) 13838 : cluster [DBG] pgmap v9597: 225 pgs: 225 active+clean; 589 KiB data, 191 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:57:10.705 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:57:10.706 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:57:10.706 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:57:11.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:57:10 smithi157 bash[24585]: cluster 2024-09-16T10:57:09.445935+0000 mgr.a (mgr.14373) 13839 : cluster [DBG] pgmap v9598: 225 pgs: 225 active+clean; 589 KiB data, 191 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:57:11.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:57:10 smithi086 bash[24289]: cluster 2024-09-16T10:57:09.445935+0000 mgr.a (mgr.14373) 13839 : cluster [DBG] pgmap v9598: 225 pgs: 225 active+clean; 589 KiB data, 191 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:57:11.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:57:10 smithi047 bash[22744]: cluster 2024-09-16T10:57:09.445935+0000 mgr.a (mgr.14373) 13839 : cluster [DBG] pgmap v9598: 225 pgs: 225 active+clean; 589 KiB data, 191 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:57:11.483 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:57:11.483 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:57:11.483 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:57:11.483 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:57:11.483 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:57:13.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:57:12 smithi157 bash[24585]: audit 2024-09-16T10:57:11.042018+0000 mgr.a (mgr.14373) 13840 : audit [DBG] from='client.300387 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:57:13.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:57:12 smithi157 bash[24585]: cluster 2024-09-16T10:57:11.447110+0000 mgr.a (mgr.14373) 13841 : cluster [DBG] pgmap v9599: 225 pgs: 225 active+clean; 589 KiB data, 191 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-16T10:57:13.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:57:12 smithi086 bash[24289]: audit 2024-09-16T10:57:11.042018+0000 mgr.a (mgr.14373) 13840 : audit [DBG] from='client.300387 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:57:13.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:57:12 smithi086 bash[24289]: cluster 2024-09-16T10:57:11.447110+0000 mgr.a (mgr.14373) 13841 : cluster [DBG] pgmap v9599: 225 pgs: 225 active+clean; 589 KiB data, 191 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-16T10:57:13.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:57:12 smithi047 bash[22744]: audit 2024-09-16T10:57:11.042018+0000 mgr.a (mgr.14373) 13840 : audit [DBG] from='client.300387 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:57:13.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:57:12 smithi047 bash[22744]: cluster 2024-09-16T10:57:11.447110+0000 mgr.a (mgr.14373) 13841 : cluster [DBG] pgmap v9599: 225 pgs: 225 active+clean; 589 KiB data, 191 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-16T10:57:15.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:57:14 smithi157 bash[24585]: cluster 2024-09-16T10:57:13.447836+0000 mgr.a (mgr.14373) 13842 : cluster [DBG] pgmap v9600: 225 pgs: 225 active+clean; 589 KiB data, 191 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-16T10:57:15.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:57:14 smithi086 bash[24289]: cluster 2024-09-16T10:57:13.447836+0000 mgr.a (mgr.14373) 13842 : cluster [DBG] pgmap v9600: 225 pgs: 225 active+clean; 589 KiB data, 191 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-16T10:57:15.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:57:14 smithi047 bash[22744]: cluster 2024-09-16T10:57:13.447836+0000 mgr.a (mgr.14373) 13842 : cluster [DBG] pgmap v9600: 225 pgs: 225 active+clean; 589 KiB data, 191 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-16T10:57:16.484 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:57:16.485 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:57:16.485 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:57:17.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:57:16 smithi157 bash[24585]: cluster 2024-09-16T10:57:15.448615+0000 mgr.a (mgr.14373) 13843 : cluster [DBG] pgmap v9601: 225 pgs: 225 active+clean; 589 KiB data, 191 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T10:57:17.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:57:16 smithi086 bash[24289]: cluster 2024-09-16T10:57:15.448615+0000 mgr.a (mgr.14373) 13843 : cluster [DBG] pgmap v9601: 225 pgs: 225 active+clean; 589 KiB data, 191 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T10:57:17.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:57:16 smithi047 bash[22744]: cluster 2024-09-16T10:57:15.448615+0000 mgr.a (mgr.14373) 13843 : cluster [DBG] pgmap v9601: 225 pgs: 225 active+clean; 589 KiB data, 191 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T10:57:17.263 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:57:17.263 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:57:17.263 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:57:17.263 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:57:17.263 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:57:19.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:57:18 smithi157 bash[24585]: audit 2024-09-16T10:57:16.817669+0000 mgr.a (mgr.14373) 13844 : audit [DBG] from='client.300465 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:57:19.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:57:18 smithi157 bash[24585]: cluster 2024-09-16T10:57:17.451423+0000 mgr.a (mgr.14373) 13845 : cluster [DBG] pgmap v9602: 225 pgs: 225 active+clean; 589 KiB data, 191 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:57:19.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:57:18 smithi086 bash[24289]: audit 2024-09-16T10:57:16.817669+0000 mgr.a (mgr.14373) 13844 : audit [DBG] from='client.300465 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:57:19.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:57:18 smithi086 bash[24289]: cluster 2024-09-16T10:57:17.451423+0000 mgr.a (mgr.14373) 13845 : cluster [DBG] pgmap v9602: 225 pgs: 225 active+clean; 589 KiB data, 191 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:57:19.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:57:18 smithi047 bash[22744]: audit 2024-09-16T10:57:16.817669+0000 mgr.a (mgr.14373) 13844 : audit [DBG] from='client.300465 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:57:19.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:57:18 smithi047 bash[22744]: cluster 2024-09-16T10:57:17.451423+0000 mgr.a (mgr.14373) 13845 : cluster [DBG] pgmap v9602: 225 pgs: 225 active+clean; 589 KiB data, 191 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:57:21.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:57:20 smithi157 bash[24585]: cluster 2024-09-16T10:57:19.452209+0000 mgr.a (mgr.14373) 13846 : cluster [DBG] pgmap v9603: 225 pgs: 225 active+clean; 589 KiB data, 191 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:57:21.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:57:20 smithi086 bash[24289]: cluster 2024-09-16T10:57:19.452209+0000 mgr.a (mgr.14373) 13846 : cluster [DBG] pgmap v9603: 225 pgs: 225 active+clean; 589 KiB data, 191 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:57:21.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:57:20 smithi047 bash[22744]: cluster 2024-09-16T10:57:19.452209+0000 mgr.a (mgr.14373) 13846 : cluster [DBG] pgmap v9603: 225 pgs: 225 active+clean; 589 KiB data, 191 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:57:22.265 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:57:22.265 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:57:22.265 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:57:23.019 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:57:23.020 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:57:23.020 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:57:23.020 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:57:23.020 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:57:23.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:57:22 smithi157 bash[24585]: cluster 2024-09-16T10:57:21.454117+0000 mgr.a (mgr.14373) 13847 : cluster [DBG] pgmap v9604: 225 pgs: 225 active+clean; 589 KiB data, 191 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:57:23.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:57:22 smithi086 bash[24289]: cluster 2024-09-16T10:57:21.454117+0000 mgr.a (mgr.14373) 13847 : cluster [DBG] pgmap v9604: 225 pgs: 225 active+clean; 589 KiB data, 191 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:57:23.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:57:22 smithi047 bash[22744]: cluster 2024-09-16T10:57:21.454117+0000 mgr.a (mgr.14373) 13847 : cluster [DBG] pgmap v9604: 225 pgs: 225 active+clean; 589 KiB data, 191 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:57:24.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:57:23 smithi157 bash[24585]: audit 2024-09-16T10:57:22.597879+0000 mgr.a (mgr.14373) 13848 : audit [DBG] from='client.300540 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:57:24.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:57:23 smithi086 bash[24289]: audit 2024-09-16T10:57:22.597879+0000 mgr.a (mgr.14373) 13848 : audit [DBG] from='client.300540 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:57:24.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:57:23 smithi047 bash[22744]: audit 2024-09-16T10:57:22.597879+0000 mgr.a (mgr.14373) 13848 : audit [DBG] from='client.300540 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:57:25.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:57:24 smithi157 bash[24585]: cluster 2024-09-16T10:57:23.455226+0000 mgr.a (mgr.14373) 13849 : cluster [DBG] pgmap v9605: 225 pgs: 225 active+clean; 589 KiB data, 191 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-16T10:57:25.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:57:24 smithi086 bash[24289]: cluster 2024-09-16T10:57:23.455226+0000 mgr.a (mgr.14373) 13849 : cluster [DBG] pgmap v9605: 225 pgs: 225 active+clean; 589 KiB data, 191 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-16T10:57:25.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:57:24 smithi047 bash[22744]: cluster 2024-09-16T10:57:23.455226+0000 mgr.a (mgr.14373) 13849 : cluster [DBG] pgmap v9605: 225 pgs: 225 active+clean; 589 KiB data, 191 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-16T10:57:27.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:57:26 smithi157 bash[24585]: cluster 2024-09-16T10:57:25.456205+0000 mgr.a (mgr.14373) 13850 : cluster [DBG] pgmap v9606: 225 pgs: 225 active+clean; 589 KiB data, 191 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-16T10:57:27.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:57:26 smithi086 bash[24289]: cluster 2024-09-16T10:57:25.456205+0000 mgr.a (mgr.14373) 13850 : cluster [DBG] pgmap v9606: 225 pgs: 225 active+clean; 589 KiB data, 191 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-16T10:57:27.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:57:26 smithi047 bash[22744]: cluster 2024-09-16T10:57:25.456205+0000 mgr.a (mgr.14373) 13850 : cluster [DBG] pgmap v9606: 225 pgs: 225 active+clean; 589 KiB data, 191 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-16T10:57:28.021 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:57:28.022 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:57:28.022 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:57:28.781 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:57:28.782 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:57:28.782 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:57:28.782 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:57:28.782 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:57:29.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:57:28 smithi157 bash[24585]: cluster 2024-09-16T10:57:27.458590+0000 mgr.a (mgr.14373) 13851 : cluster [DBG] pgmap v9607: 225 pgs: 225 active+clean; 589 KiB data, 191 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-16T10:57:29.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:57:28 smithi086 bash[24289]: cluster 2024-09-16T10:57:27.458590+0000 mgr.a (mgr.14373) 13851 : cluster [DBG] pgmap v9607: 225 pgs: 225 active+clean; 589 KiB data, 191 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-16T10:57:29.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:57:28 smithi047 bash[22744]: cluster 2024-09-16T10:57:27.458590+0000 mgr.a (mgr.14373) 13851 : cluster [DBG] pgmap v9607: 225 pgs: 225 active+clean; 589 KiB data, 191 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-16T10:57:30.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:57:29 smithi157 bash[24585]: audit 2024-09-16T10:57:28.350864+0000 mgr.a (mgr.14373) 13852 : audit [DBG] from='client.300615 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:57:30.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:57:29 smithi086 bash[24289]: audit 2024-09-16T10:57:28.350864+0000 mgr.a (mgr.14373) 13852 : audit [DBG] from='client.300615 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:57:30.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:57:29 smithi047 bash[22744]: audit 2024-09-16T10:57:28.350864+0000 mgr.a (mgr.14373) 13852 : audit [DBG] from='client.300615 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:57:31.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:57:30 smithi157 bash[24585]: cluster 2024-09-16T10:57:29.459582+0000 mgr.a (mgr.14373) 13853 : cluster [DBG] pgmap v9608: 225 pgs: 225 active+clean; 589 KiB data, 191 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:57:31.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:57:30 smithi086 bash[24289]: cluster 2024-09-16T10:57:29.459582+0000 mgr.a (mgr.14373) 13853 : cluster [DBG] pgmap v9608: 225 pgs: 225 active+clean; 589 KiB data, 191 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:57:31.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:57:30 smithi047 bash[22744]: cluster 2024-09-16T10:57:29.459582+0000 mgr.a (mgr.14373) 13853 : cluster [DBG] pgmap v9608: 225 pgs: 225 active+clean; 589 KiB data, 191 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:57:33.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:57:32 smithi157 bash[24585]: cluster 2024-09-16T10:57:31.461735+0000 mgr.a (mgr.14373) 13854 : cluster [DBG] pgmap v9609: 225 pgs: 225 active+clean; 589 KiB data, 191 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:57:33.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:57:32 smithi086 bash[24289]: cluster 2024-09-16T10:57:31.461735+0000 mgr.a (mgr.14373) 13854 : cluster [DBG] pgmap v9609: 225 pgs: 225 active+clean; 589 KiB data, 191 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:57:33.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:57:32 smithi047 bash[22744]: cluster 2024-09-16T10:57:31.461735+0000 mgr.a (mgr.14373) 13854 : cluster [DBG] pgmap v9609: 225 pgs: 225 active+clean; 589 KiB data, 191 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:57:33.783 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:57:33.784 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:57:33.784 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:57:34.560 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:57:34.561 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:57:34.561 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:57:34.561 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:57:34.561 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:57:35.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:57:34 smithi157 bash[24585]: cluster 2024-09-16T10:57:33.462529+0000 mgr.a (mgr.14373) 13855 : cluster [DBG] pgmap v9610: 225 pgs: 225 active+clean; 589 KiB data, 191 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:57:35.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:57:34 smithi157 bash[24585]: audit 2024-09-16T10:57:34.457971+0000 mon.b (mon.2) 1266 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T10:57:35.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:57:34 smithi086 bash[24289]: cluster 2024-09-16T10:57:33.462529+0000 mgr.a (mgr.14373) 13855 : cluster [DBG] pgmap v9610: 225 pgs: 225 active+clean; 589 KiB data, 191 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:57:35.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:57:34 smithi086 bash[24289]: audit 2024-09-16T10:57:34.457971+0000 mon.b (mon.2) 1266 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T10:57:35.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:57:34 smithi047 bash[22744]: cluster 2024-09-16T10:57:33.462529+0000 mgr.a (mgr.14373) 13855 : cluster [DBG] pgmap v9610: 225 pgs: 225 active+clean; 589 KiB data, 191 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:57:35.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:57:34 smithi047 bash[22744]: audit 2024-09-16T10:57:34.457971+0000 mon.b (mon.2) 1266 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T10:57:36.025 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:57:35 smithi047 bash[22744]: audit 2024-09-16T10:57:34.118407+0000 mgr.a (mgr.14373) 13856 : audit [DBG] from='client.300687 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:57:36.025 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:57:35 smithi047 bash[22744]: audit 2024-09-16T10:57:35.241074+0000 mon.b (mon.2) 1267 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T10:57:36.025 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:57:35 smithi047 bash[22744]: audit 2024-09-16T10:57:35.242842+0000 mon.b (mon.2) 1268 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T10:57:36.026 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:57:35 smithi047 bash[22744]: audit 2024-09-16T10:57:35.251059+0000 mon.a (mon.0) 1394 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:57:36.026 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:57:35 smithi047 bash[22744]: audit 2024-09-16T10:57:35.258106+0000 mon.b (mon.2) 1269 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:57:36.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:57:35 smithi157 bash[24585]: audit 2024-09-16T10:57:34.118407+0000 mgr.a (mgr.14373) 13856 : audit [DBG] from='client.300687 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:57:36.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:57:35 smithi157 bash[24585]: audit 2024-09-16T10:57:35.241074+0000 mon.b (mon.2) 1267 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T10:57:36.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:57:35 smithi157 bash[24585]: audit 2024-09-16T10:57:35.242842+0000 mon.b (mon.2) 1268 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T10:57:36.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:57:35 smithi157 bash[24585]: audit 2024-09-16T10:57:35.251059+0000 mon.a (mon.0) 1394 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:57:36.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:57:35 smithi157 bash[24585]: audit 2024-09-16T10:57:35.258106+0000 mon.b (mon.2) 1269 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:57:36.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:57:35 smithi086 bash[24289]: audit 2024-09-16T10:57:34.118407+0000 mgr.a (mgr.14373) 13856 : audit [DBG] from='client.300687 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:57:36.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:57:35 smithi086 bash[24289]: audit 2024-09-16T10:57:35.241074+0000 mon.b (mon.2) 1267 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T10:57:36.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:57:35 smithi086 bash[24289]: audit 2024-09-16T10:57:35.242842+0000 mon.b (mon.2) 1268 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T10:57:36.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:57:35 smithi086 bash[24289]: audit 2024-09-16T10:57:35.251059+0000 mon.a (mon.0) 1394 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:57:36.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:57:35 smithi086 bash[24289]: audit 2024-09-16T10:57:35.258106+0000 mon.b (mon.2) 1269 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:57:36.342 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 10:57:36 smithi047 bash[22994]: debug 2024-09-16T10:57:36.019+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T10:57:36.343 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 10:57:36 smithi047 bash[22994]: debug 2024-09-16T10:57:36.019+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T10:57:37.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:57:36 smithi157 bash[24585]: audit 2024-09-16T10:57:35.259835+0000 mgr.a (mgr.14373) 13857 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:57:37.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:57:36 smithi157 bash[24585]: cluster 2024-09-16T10:57:35.463358+0000 mgr.a (mgr.14373) 13858 : cluster [DBG] pgmap v9611: 225 pgs: 225 active+clean; 589 KiB data, 191 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:57:37.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:57:36 smithi086 bash[24289]: audit 2024-09-16T10:57:35.259835+0000 mgr.a (mgr.14373) 13857 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:57:37.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:57:36 smithi086 bash[24289]: cluster 2024-09-16T10:57:35.463358+0000 mgr.a (mgr.14373) 13858 : cluster [DBG] pgmap v9611: 225 pgs: 225 active+clean; 589 KiB data, 191 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:57:37.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:57:36 smithi047 bash[22744]: audit 2024-09-16T10:57:35.259835+0000 mgr.a (mgr.14373) 13857 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:57:37.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:57:36 smithi047 bash[22744]: cluster 2024-09-16T10:57:35.463358+0000 mgr.a (mgr.14373) 13858 : cluster [DBG] pgmap v9611: 225 pgs: 225 active+clean; 589 KiB data, 191 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:57:38.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:57:37 smithi157 bash[24585]: audit 2024-09-16T10:57:36.024040+0000 mgr.a (mgr.14373) 13859 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T10:57:38.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:57:37 smithi157 bash[24585]: cephadm 2024-09-16T10:57:36.026191+0000 mgr.a (mgr.14373) 13860 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T10:57:38.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:57:37 smithi086 bash[24289]: audit 2024-09-16T10:57:36.024040+0000 mgr.a (mgr.14373) 13859 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T10:57:38.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:57:37 smithi086 bash[24289]: cephadm 2024-09-16T10:57:36.026191+0000 mgr.a (mgr.14373) 13860 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T10:57:38.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:57:37 smithi047 bash[22744]: audit 2024-09-16T10:57:36.024040+0000 mgr.a (mgr.14373) 13859 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T10:57:38.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:57:37 smithi047 bash[22744]: cephadm 2024-09-16T10:57:36.026191+0000 mgr.a (mgr.14373) 13860 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T10:57:39.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:57:38 smithi157 bash[24585]: cluster 2024-09-16T10:57:37.465697+0000 mgr.a (mgr.14373) 13861 : cluster [DBG] pgmap v9612: 225 pgs: 225 active+clean; 589 KiB data, 191 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:57:39.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:57:38 smithi086 bash[24289]: cluster 2024-09-16T10:57:37.465697+0000 mgr.a (mgr.14373) 13861 : cluster [DBG] pgmap v9612: 225 pgs: 225 active+clean; 589 KiB data, 191 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:57:39.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:57:38 smithi047 bash[22744]: cluster 2024-09-16T10:57:37.465697+0000 mgr.a (mgr.14373) 13861 : cluster [DBG] pgmap v9612: 225 pgs: 225 active+clean; 589 KiB data, 191 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:57:39.562 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:57:39.562 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:57:39.562 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:57:40.333 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:57:40.333 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:57:40.333 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:57:40.334 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:57:40.334 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:57:41.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:57:40 smithi157 bash[24585]: cluster 2024-09-16T10:57:39.466468+0000 mgr.a (mgr.14373) 13862 : cluster [DBG] pgmap v9613: 225 pgs: 225 active+clean; 589 KiB data, 191 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:57:41.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:57:40 smithi086 bash[24289]: cluster 2024-09-16T10:57:39.466468+0000 mgr.a (mgr.14373) 13862 : cluster [DBG] pgmap v9613: 225 pgs: 225 active+clean; 589 KiB data, 191 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:57:41.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:57:40 smithi047 bash[22744]: cluster 2024-09-16T10:57:39.466468+0000 mgr.a (mgr.14373) 13862 : cluster [DBG] pgmap v9613: 225 pgs: 225 active+clean; 589 KiB data, 191 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:57:42.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:57:41 smithi157 bash[24585]: audit 2024-09-16T10:57:39.892716+0000 mgr.a (mgr.14373) 13863 : audit [DBG] from='client.300867 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:57:42.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:57:41 smithi086 bash[24289]: audit 2024-09-16T10:57:39.892716+0000 mgr.a (mgr.14373) 13863 : audit [DBG] from='client.300867 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:57:42.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:57:41 smithi047 bash[22744]: audit 2024-09-16T10:57:39.892716+0000 mgr.a (mgr.14373) 13863 : audit [DBG] from='client.300867 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:57:43.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:57:42 smithi157 bash[24585]: cluster 2024-09-16T10:57:41.468792+0000 mgr.a (mgr.14373) 13864 : cluster [DBG] pgmap v9614: 225 pgs: 225 active+clean; 589 KiB data, 191 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:57:43.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:57:42 smithi086 bash[24289]: cluster 2024-09-16T10:57:41.468792+0000 mgr.a (mgr.14373) 13864 : cluster [DBG] pgmap v9614: 225 pgs: 225 active+clean; 589 KiB data, 191 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:57:43.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:57:42 smithi047 bash[22744]: cluster 2024-09-16T10:57:41.468792+0000 mgr.a (mgr.14373) 13864 : cluster [DBG] pgmap v9614: 225 pgs: 225 active+clean; 589 KiB data, 191 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:57:45.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:57:44 smithi157 bash[24585]: cluster 2024-09-16T10:57:43.469544+0000 mgr.a (mgr.14373) 13865 : cluster [DBG] pgmap v9615: 225 pgs: 225 active+clean; 589 KiB data, 191 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:57:45.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:57:44 smithi086 bash[24289]: cluster 2024-09-16T10:57:43.469544+0000 mgr.a (mgr.14373) 13865 : cluster [DBG] pgmap v9615: 225 pgs: 225 active+clean; 589 KiB data, 191 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:57:45.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:57:44 smithi047 bash[22744]: cluster 2024-09-16T10:57:43.469544+0000 mgr.a (mgr.14373) 13865 : cluster [DBG] pgmap v9615: 225 pgs: 225 active+clean; 589 KiB data, 191 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:57:45.335 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:57:45.336 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:57:45.336 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:57:46.108 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:57:46.108 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:57:46.108 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:57:46.108 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:57:46.108 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:57:47.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:57:46 smithi157 bash[24585]: cluster 2024-09-16T10:57:45.469994+0000 mgr.a (mgr.14373) 13866 : cluster [DBG] pgmap v9616: 225 pgs: 225 active+clean; 589 KiB data, 191 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:57:47.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:57:46 smithi157 bash[24585]: audit 2024-09-16T10:57:45.668681+0000 mgr.a (mgr.14373) 13867 : audit [DBG] from='client.300945 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:57:47.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:57:46 smithi086 bash[24289]: cluster 2024-09-16T10:57:45.469994+0000 mgr.a (mgr.14373) 13866 : cluster [DBG] pgmap v9616: 225 pgs: 225 active+clean; 589 KiB data, 191 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:57:47.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:57:46 smithi086 bash[24289]: audit 2024-09-16T10:57:45.668681+0000 mgr.a (mgr.14373) 13867 : audit [DBG] from='client.300945 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:57:47.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:57:46 smithi047 bash[22744]: cluster 2024-09-16T10:57:45.469994+0000 mgr.a (mgr.14373) 13866 : cluster [DBG] pgmap v9616: 225 pgs: 225 active+clean; 589 KiB data, 191 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:57:47.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:57:46 smithi047 bash[22744]: audit 2024-09-16T10:57:45.668681+0000 mgr.a (mgr.14373) 13867 : audit [DBG] from='client.300945 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:57:49.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:57:48 smithi157 bash[24585]: cluster 2024-09-16T10:57:47.472434+0000 mgr.a (mgr.14373) 13868 : cluster [DBG] pgmap v9617: 225 pgs: 225 active+clean; 589 KiB data, 191 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:57:49.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:57:48 smithi086 bash[24289]: cluster 2024-09-16T10:57:47.472434+0000 mgr.a (mgr.14373) 13868 : cluster [DBG] pgmap v9617: 225 pgs: 225 active+clean; 589 KiB data, 191 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:57:49.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:57:48 smithi047 bash[22744]: cluster 2024-09-16T10:57:47.472434+0000 mgr.a (mgr.14373) 13868 : cluster [DBG] pgmap v9617: 225 pgs: 225 active+clean; 589 KiB data, 191 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:57:50.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:57:49 smithi157 bash[24585]: cluster 2024-09-16T10:57:49.473359+0000 mgr.a (mgr.14373) 13869 : cluster [DBG] pgmap v9618: 225 pgs: 225 active+clean; 589 KiB data, 191 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:57:50.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:57:49 smithi086 bash[24289]: cluster 2024-09-16T10:57:49.473359+0000 mgr.a (mgr.14373) 13869 : cluster [DBG] pgmap v9618: 225 pgs: 225 active+clean; 589 KiB data, 191 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:57:50.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:57:49 smithi047 bash[22744]: cluster 2024-09-16T10:57:49.473359+0000 mgr.a (mgr.14373) 13869 : cluster [DBG] pgmap v9618: 225 pgs: 225 active+clean; 589 KiB data, 191 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:57:51.109 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:57:51.110 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:57:51.110 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:57:51.877 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:57:51.877 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:57:51.877 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:57:51.878 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:57:51.878 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:57:52.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:57:52 smithi157 bash[24585]: audit 2024-09-16T10:57:51.440463+0000 mgr.a (mgr.14373) 13870 : audit [DBG] from='client.301017 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:57:52.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:57:52 smithi157 bash[24585]: cluster 2024-09-16T10:57:51.475933+0000 mgr.a (mgr.14373) 13871 : cluster [DBG] pgmap v9619: 225 pgs: 225 active+clean; 589 KiB data, 191 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:57:52.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:57:52 smithi086 bash[24289]: audit 2024-09-16T10:57:51.440463+0000 mgr.a (mgr.14373) 13870 : audit [DBG] from='client.301017 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:57:52.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:57:52 smithi086 bash[24289]: cluster 2024-09-16T10:57:51.475933+0000 mgr.a (mgr.14373) 13871 : cluster [DBG] pgmap v9619: 225 pgs: 225 active+clean; 589 KiB data, 191 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:57:52.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:57:52 smithi047 bash[22744]: audit 2024-09-16T10:57:51.440463+0000 mgr.a (mgr.14373) 13870 : audit [DBG] from='client.301017 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:57:52.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:57:52 smithi047 bash[22744]: cluster 2024-09-16T10:57:51.475933+0000 mgr.a (mgr.14373) 13871 : cluster [DBG] pgmap v9619: 225 pgs: 225 active+clean; 589 KiB data, 191 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:57:54.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:57:54 smithi157 bash[24585]: cluster 2024-09-16T10:57:53.476833+0000 mgr.a (mgr.14373) 13872 : cluster [DBG] pgmap v9620: 225 pgs: 225 active+clean; 589 KiB data, 191 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:57:54.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:57:54 smithi086 bash[24289]: cluster 2024-09-16T10:57:53.476833+0000 mgr.a (mgr.14373) 13872 : cluster [DBG] pgmap v9620: 225 pgs: 225 active+clean; 589 KiB data, 191 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:57:54.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:57:54 smithi047 bash[22744]: cluster 2024-09-16T10:57:53.476833+0000 mgr.a (mgr.14373) 13872 : cluster [DBG] pgmap v9620: 225 pgs: 225 active+clean; 589 KiB data, 191 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:57:56.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:57:56 smithi157 bash[24585]: cluster 2024-09-16T10:57:55.477614+0000 mgr.a (mgr.14373) 13873 : cluster [DBG] pgmap v9621: 225 pgs: 225 active+clean; 589 KiB data, 191 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T10:57:56.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:57:56 smithi086 bash[24289]: cluster 2024-09-16T10:57:55.477614+0000 mgr.a (mgr.14373) 13873 : cluster [DBG] pgmap v9621: 225 pgs: 225 active+clean; 589 KiB data, 191 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T10:57:56.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:57:56 smithi047 bash[22744]: cluster 2024-09-16T10:57:55.477614+0000 mgr.a (mgr.14373) 13873 : cluster [DBG] pgmap v9621: 225 pgs: 225 active+clean; 589 KiB data, 191 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T10:57:56.880 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:57:56.880 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:57:56.880 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:57:57.634 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:57:57.634 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:57:57.634 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:57:57.634 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:57:57.634 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:57:58.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:57:58 smithi157 bash[24585]: audit 2024-09-16T10:57:57.208466+0000 mgr.a (mgr.14373) 13874 : audit [DBG] from='client.301095 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:57:58.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:57:58 smithi157 bash[24585]: cluster 2024-09-16T10:57:57.478998+0000 mgr.a (mgr.14373) 13875 : cluster [DBG] pgmap v9622: 225 pgs: 225 active+clean; 589 KiB data, 191 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:57:58.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:57:58 smithi086 bash[24289]: audit 2024-09-16T10:57:57.208466+0000 mgr.a (mgr.14373) 13874 : audit [DBG] from='client.301095 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:57:58.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:57:58 smithi086 bash[24289]: cluster 2024-09-16T10:57:57.478998+0000 mgr.a (mgr.14373) 13875 : cluster [DBG] pgmap v9622: 225 pgs: 225 active+clean; 589 KiB data, 191 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:57:58.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:57:58 smithi047 bash[22744]: audit 2024-09-16T10:57:57.208466+0000 mgr.a (mgr.14373) 13874 : audit [DBG] from='client.301095 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:57:58.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:57:58 smithi047 bash[22744]: cluster 2024-09-16T10:57:57.478998+0000 mgr.a (mgr.14373) 13875 : cluster [DBG] pgmap v9622: 225 pgs: 225 active+clean; 589 KiB data, 191 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:58:00.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:58:00 smithi157 bash[24585]: cluster 2024-09-16T10:57:59.479843+0000 mgr.a (mgr.14373) 13876 : cluster [DBG] pgmap v9623: 225 pgs: 225 active+clean; 589 KiB data, 191 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:58:00.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:58:00 smithi086 bash[24289]: cluster 2024-09-16T10:57:59.479843+0000 mgr.a (mgr.14373) 13876 : cluster [DBG] pgmap v9623: 225 pgs: 225 active+clean; 589 KiB data, 191 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:58:00.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:58:00 smithi047 bash[22744]: cluster 2024-09-16T10:57:59.479843+0000 mgr.a (mgr.14373) 13876 : cluster [DBG] pgmap v9623: 225 pgs: 225 active+clean; 589 KiB data, 191 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T10:58:02.635 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:58:02.636 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:58:02.636 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:58:02.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:58:02 smithi157 bash[24585]: cluster 2024-09-16T10:58:01.481951+0000 mgr.a (mgr.14373) 13877 : cluster [DBG] pgmap v9624: 225 pgs: 225 active+clean; 589 KiB data, 191 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:58:02.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:58:02 smithi086 bash[24289]: cluster 2024-09-16T10:58:01.481951+0000 mgr.a (mgr.14373) 13877 : cluster [DBG] pgmap v9624: 225 pgs: 225 active+clean; 589 KiB data, 191 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:58:02.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:58:02 smithi047 bash[22744]: cluster 2024-09-16T10:58:01.481951+0000 mgr.a (mgr.14373) 13877 : cluster [DBG] pgmap v9624: 225 pgs: 225 active+clean; 589 KiB data, 191 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:58:03.386 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:58:03.386 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:58:03.386 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:58:03.386 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:58:03.386 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:58:04.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:58:04 smithi086 bash[24289]: audit 2024-09-16T10:58:02.971909+0000 mgr.a (mgr.14373) 13878 : audit [DBG] from='client.301173 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:58:04.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:58:04 smithi086 bash[24289]: cluster 2024-09-16T10:58:03.483083+0000 mgr.a (mgr.14373) 13879 : cluster [DBG] pgmap v9625: 225 pgs: 225 active+clean; 589 KiB data, 191 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:58:04.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:58:04 smithi047 bash[22744]: audit 2024-09-16T10:58:02.971909+0000 mgr.a (mgr.14373) 13878 : audit [DBG] from='client.301173 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:58:04.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:58:04 smithi047 bash[22744]: cluster 2024-09-16T10:58:03.483083+0000 mgr.a (mgr.14373) 13879 : cluster [DBG] pgmap v9625: 225 pgs: 225 active+clean; 589 KiB data, 191 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:58:05.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:58:04 smithi157 bash[24585]: audit 2024-09-16T10:58:02.971909+0000 mgr.a (mgr.14373) 13878 : audit [DBG] from='client.301173 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:58:05.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:58:04 smithi157 bash[24585]: cluster 2024-09-16T10:58:03.483083+0000 mgr.a (mgr.14373) 13879 : cluster [DBG] pgmap v9625: 225 pgs: 225 active+clean; 589 KiB data, 191 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:58:06.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:58:06 smithi086 bash[24289]: cluster 2024-09-16T10:58:05.484063+0000 mgr.a (mgr.14373) 13880 : cluster [DBG] pgmap v9626: 225 pgs: 225 active+clean; 589 KiB data, 191 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:58:06.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:58:06 smithi047 bash[22744]: cluster 2024-09-16T10:58:05.484063+0000 mgr.a (mgr.14373) 13880 : cluster [DBG] pgmap v9626: 225 pgs: 225 active+clean; 589 KiB data, 191 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:58:07.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:58:06 smithi157 bash[24585]: cluster 2024-09-16T10:58:05.484063+0000 mgr.a (mgr.14373) 13880 : cluster [DBG] pgmap v9626: 225 pgs: 225 active+clean; 589 KiB data, 191 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:58:08.387 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:58:08.388 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:58:08.388 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:58:08.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:58:08 smithi086 bash[24289]: cluster 2024-09-16T10:58:07.486461+0000 mgr.a (mgr.14373) 13881 : cluster [DBG] pgmap v9627: 225 pgs: 225 active+clean; 589 KiB data, 195 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-16T10:58:08.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:58:08 smithi047 bash[22744]: cluster 2024-09-16T10:58:07.486461+0000 mgr.a (mgr.14373) 13881 : cluster [DBG] pgmap v9627: 225 pgs: 225 active+clean; 589 KiB data, 195 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-16T10:58:09.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:58:08 smithi157 bash[24585]: cluster 2024-09-16T10:58:07.486461+0000 mgr.a (mgr.14373) 13881 : cluster [DBG] pgmap v9627: 225 pgs: 225 active+clean; 589 KiB data, 195 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-16T10:58:09.179 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:58:09.180 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:58:09.180 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:58:09.180 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:58:09.181 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:58:09.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:58:09 smithi086 bash[24289]: audit 2024-09-16T10:58:08.729209+0000 mgr.a (mgr.14373) 13882 : audit [DBG] from='client.301251 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:58:09.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:58:09 smithi047 bash[22744]: audit 2024-09-16T10:58:08.729209+0000 mgr.a (mgr.14373) 13882 : audit [DBG] from='client.301251 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:58:10.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:58:09 smithi157 bash[24585]: audit 2024-09-16T10:58:08.729209+0000 mgr.a (mgr.14373) 13882 : audit [DBG] from='client.301251 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:58:10.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:58:10 smithi047 bash[22744]: cluster 2024-09-16T10:58:09.487601+0000 mgr.a (mgr.14373) 13883 : cluster [DBG] pgmap v9628: 225 pgs: 225 active+clean; 589 KiB data, 195 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-16T10:58:11.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:58:10 smithi157 bash[24585]: cluster 2024-09-16T10:58:09.487601+0000 mgr.a (mgr.14373) 13883 : cluster [DBG] pgmap v9628: 225 pgs: 225 active+clean; 589 KiB data, 195 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-16T10:58:11.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:58:10 smithi086 bash[24289]: cluster 2024-09-16T10:58:09.487601+0000 mgr.a (mgr.14373) 13883 : cluster [DBG] pgmap v9628: 225 pgs: 225 active+clean; 589 KiB data, 195 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-16T10:58:12.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:58:12 smithi047 bash[22744]: cluster 2024-09-16T10:58:11.489960+0000 mgr.a (mgr.14373) 13884 : cluster [DBG] pgmap v9629: 225 pgs: 225 active+clean; 589 KiB data, 195 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-16T10:58:13.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:58:12 smithi157 bash[24585]: cluster 2024-09-16T10:58:11.489960+0000 mgr.a (mgr.14373) 13884 : cluster [DBG] pgmap v9629: 225 pgs: 225 active+clean; 589 KiB data, 195 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-16T10:58:13.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:58:12 smithi086 bash[24289]: cluster 2024-09-16T10:58:11.489960+0000 mgr.a (mgr.14373) 13884 : cluster [DBG] pgmap v9629: 225 pgs: 225 active+clean; 589 KiB data, 195 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-16T10:58:14.181 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:58:14.182 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:58:14.182 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:58:14.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:58:14 smithi047 bash[22744]: cluster 2024-09-16T10:58:13.490925+0000 mgr.a (mgr.14373) 13885 : cluster [DBG] pgmap v9630: 225 pgs: 225 active+clean; 589 KiB data, 195 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-16T10:58:14.933 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:58:14.933 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:58:14.933 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:58:14.933 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:58:14.933 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:58:15.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:58:14 smithi157 bash[24585]: cluster 2024-09-16T10:58:13.490925+0000 mgr.a (mgr.14373) 13885 : cluster [DBG] pgmap v9630: 225 pgs: 225 active+clean; 589 KiB data, 195 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-16T10:58:15.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:58:14 smithi086 bash[24289]: cluster 2024-09-16T10:58:13.490925+0000 mgr.a (mgr.14373) 13885 : cluster [DBG] pgmap v9630: 225 pgs: 225 active+clean; 589 KiB data, 195 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-16T10:58:16.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:58:15 smithi157 bash[24585]: audit 2024-09-16T10:58:14.506227+0000 mgr.a (mgr.14373) 13886 : audit [DBG] from='client.301329 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:58:16.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:58:15 smithi086 bash[24289]: audit 2024-09-16T10:58:14.506227+0000 mgr.a (mgr.14373) 13886 : audit [DBG] from='client.301329 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:58:16.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:58:15 smithi047 bash[22744]: audit 2024-09-16T10:58:14.506227+0000 mgr.a (mgr.14373) 13886 : audit [DBG] from='client.301329 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:58:17.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:58:16 smithi157 bash[24585]: cluster 2024-09-16T10:58:15.491965+0000 mgr.a (mgr.14373) 13887 : cluster [DBG] pgmap v9631: 225 pgs: 225 active+clean; 589 KiB data, 195 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-16T10:58:17.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:58:16 smithi086 bash[24289]: cluster 2024-09-16T10:58:15.491965+0000 mgr.a (mgr.14373) 13887 : cluster [DBG] pgmap v9631: 225 pgs: 225 active+clean; 589 KiB data, 195 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-16T10:58:17.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:58:16 smithi047 bash[22744]: cluster 2024-09-16T10:58:15.491965+0000 mgr.a (mgr.14373) 13887 : cluster [DBG] pgmap v9631: 225 pgs: 225 active+clean; 589 KiB data, 195 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-16T10:58:19.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:58:18 smithi157 bash[24585]: cluster 2024-09-16T10:58:17.494211+0000 mgr.a (mgr.14373) 13888 : cluster [DBG] pgmap v9632: 225 pgs: 225 active+clean; 589 KiB data, 195 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-16T10:58:19.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:58:18 smithi086 bash[24289]: cluster 2024-09-16T10:58:17.494211+0000 mgr.a (mgr.14373) 13888 : cluster [DBG] pgmap v9632: 225 pgs: 225 active+clean; 589 KiB data, 195 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-16T10:58:19.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:58:18 smithi047 bash[22744]: cluster 2024-09-16T10:58:17.494211+0000 mgr.a (mgr.14373) 13888 : cluster [DBG] pgmap v9632: 225 pgs: 225 active+clean; 589 KiB data, 195 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-16T10:58:19.934 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:58:19.935 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:58:19.935 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:58:20.712 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:58:20.712 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:58:20.712 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:58:20.713 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:58:20.713 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:58:21.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:58:20 smithi157 bash[24585]: cluster 2024-09-16T10:58:19.494988+0000 mgr.a (mgr.14373) 13889 : cluster [DBG] pgmap v9633: 225 pgs: 225 active+clean; 589 KiB data, 195 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:58:21.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:58:20 smithi086 bash[24289]: cluster 2024-09-16T10:58:19.494988+0000 mgr.a (mgr.14373) 13889 : cluster [DBG] pgmap v9633: 225 pgs: 225 active+clean; 589 KiB data, 195 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:58:21.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:58:20 smithi047 bash[22744]: cluster 2024-09-16T10:58:19.494988+0000 mgr.a (mgr.14373) 13889 : cluster [DBG] pgmap v9633: 225 pgs: 225 active+clean; 589 KiB data, 195 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:58:22.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:58:21 smithi157 bash[24585]: audit 2024-09-16T10:58:20.263016+0000 mgr.a (mgr.14373) 13890 : audit [DBG] from='client.301407 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:58:22.072 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:58:21 smithi086 bash[24289]: audit 2024-09-16T10:58:20.263016+0000 mgr.a (mgr.14373) 13890 : audit [DBG] from='client.301407 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:58:22.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:58:21 smithi047 bash[22744]: audit 2024-09-16T10:58:20.263016+0000 mgr.a (mgr.14373) 13890 : audit [DBG] from='client.301407 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:58:23.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:58:22 smithi157 bash[24585]: cluster 2024-09-16T10:58:21.497336+0000 mgr.a (mgr.14373) 13891 : cluster [DBG] pgmap v9634: 225 pgs: 225 active+clean; 589 KiB data, 195 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:58:23.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:58:22 smithi086 bash[24289]: cluster 2024-09-16T10:58:21.497336+0000 mgr.a (mgr.14373) 13891 : cluster [DBG] pgmap v9634: 225 pgs: 225 active+clean; 589 KiB data, 195 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:58:23.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:58:22 smithi047 bash[22744]: cluster 2024-09-16T10:58:21.497336+0000 mgr.a (mgr.14373) 13891 : cluster [DBG] pgmap v9634: 225 pgs: 225 active+clean; 589 KiB data, 195 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:58:25.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:58:24 smithi157 bash[24585]: cluster 2024-09-16T10:58:23.498123+0000 mgr.a (mgr.14373) 13892 : cluster [DBG] pgmap v9635: 225 pgs: 225 active+clean; 589 KiB data, 195 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:58:25.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:58:24 smithi086 bash[24289]: cluster 2024-09-16T10:58:23.498123+0000 mgr.a (mgr.14373) 13892 : cluster [DBG] pgmap v9635: 225 pgs: 225 active+clean; 589 KiB data, 195 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:58:25.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:58:24 smithi047 bash[22744]: cluster 2024-09-16T10:58:23.498123+0000 mgr.a (mgr.14373) 13892 : cluster [DBG] pgmap v9635: 225 pgs: 225 active+clean; 589 KiB data, 195 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:58:25.714 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:58:25.714 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:58:25.714 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:58:26.493 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:58:26.493 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:58:26.493 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:58:26.493 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:58:26.493 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:58:27.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:58:26 smithi157 bash[24585]: cluster 2024-09-16T10:58:25.498919+0000 mgr.a (mgr.14373) 13893 : cluster [DBG] pgmap v9636: 225 pgs: 225 active+clean; 589 KiB data, 195 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:58:27.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:58:26 smithi086 bash[24289]: cluster 2024-09-16T10:58:25.498919+0000 mgr.a (mgr.14373) 13893 : cluster [DBG] pgmap v9636: 225 pgs: 225 active+clean; 589 KiB data, 195 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:58:27.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:58:26 smithi047 bash[22744]: cluster 2024-09-16T10:58:25.498919+0000 mgr.a (mgr.14373) 13893 : cluster [DBG] pgmap v9636: 225 pgs: 225 active+clean; 589 KiB data, 195 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:58:28.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:58:27 smithi157 bash[24585]: audit 2024-09-16T10:58:26.051116+0000 mgr.a (mgr.14373) 13894 : audit [DBG] from='client.301485 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:58:28.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:58:27 smithi086 bash[24289]: audit 2024-09-16T10:58:26.051116+0000 mgr.a (mgr.14373) 13894 : audit [DBG] from='client.301485 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:58:28.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:58:27 smithi047 bash[22744]: audit 2024-09-16T10:58:26.051116+0000 mgr.a (mgr.14373) 13894 : audit [DBG] from='client.301485 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:58:29.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:58:28 smithi157 bash[24585]: cluster 2024-09-16T10:58:27.501304+0000 mgr.a (mgr.14373) 13895 : cluster [DBG] pgmap v9637: 225 pgs: 225 active+clean; 589 KiB data, 195 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-16T10:58:29.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:58:28 smithi086 bash[24289]: cluster 2024-09-16T10:58:27.501304+0000 mgr.a (mgr.14373) 13895 : cluster [DBG] pgmap v9637: 225 pgs: 225 active+clean; 589 KiB data, 195 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-16T10:58:29.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:58:28 smithi047 bash[22744]: cluster 2024-09-16T10:58:27.501304+0000 mgr.a (mgr.14373) 13895 : cluster [DBG] pgmap v9637: 225 pgs: 225 active+clean; 589 KiB data, 195 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-16T10:58:31.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:58:30 smithi157 bash[24585]: cluster 2024-09-16T10:58:29.502074+0000 mgr.a (mgr.14373) 13896 : cluster [DBG] pgmap v9638: 225 pgs: 225 active+clean; 589 KiB data, 195 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T10:58:31.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:58:30 smithi086 bash[24289]: cluster 2024-09-16T10:58:29.502074+0000 mgr.a (mgr.14373) 13896 : cluster [DBG] pgmap v9638: 225 pgs: 225 active+clean; 589 KiB data, 195 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T10:58:31.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:58:30 smithi047 bash[22744]: cluster 2024-09-16T10:58:29.502074+0000 mgr.a (mgr.14373) 13896 : cluster [DBG] pgmap v9638: 225 pgs: 225 active+clean; 589 KiB data, 195 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T10:58:31.495 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:58:31.495 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:58:31.495 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:58:32.254 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:58:32.254 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:58:32.254 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:58:32.254 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:58:32.255 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:58:33.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:58:32 smithi157 bash[24585]: cluster 2024-09-16T10:58:31.503435+0000 mgr.a (mgr.14373) 13897 : cluster [DBG] pgmap v9639: 225 pgs: 225 active+clean; 589 KiB data, 179 MiB used, 268 GiB / 268 GiB avail; 65 KiB/s rd, 0 B/s wr, 107 op/s 2024-09-16T10:58:33.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:58:32 smithi086 bash[24289]: cluster 2024-09-16T10:58:31.503435+0000 mgr.a (mgr.14373) 13897 : cluster [DBG] pgmap v9639: 225 pgs: 225 active+clean; 589 KiB data, 179 MiB used, 268 GiB / 268 GiB avail; 65 KiB/s rd, 0 B/s wr, 107 op/s 2024-09-16T10:58:33.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:58:32 smithi047 bash[22744]: cluster 2024-09-16T10:58:31.503435+0000 mgr.a (mgr.14373) 13897 : cluster [DBG] pgmap v9639: 225 pgs: 225 active+clean; 589 KiB data, 179 MiB used, 268 GiB / 268 GiB avail; 65 KiB/s rd, 0 B/s wr, 107 op/s 2024-09-16T10:58:34.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:58:33 smithi157 bash[24585]: audit 2024-09-16T10:58:31.826235+0000 mgr.a (mgr.14373) 13898 : audit [DBG] from='client.301560 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:58:34.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:58:33 smithi086 bash[24289]: audit 2024-09-16T10:58:31.826235+0000 mgr.a (mgr.14373) 13898 : audit [DBG] from='client.301560 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:58:34.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:58:33 smithi047 bash[22744]: audit 2024-09-16T10:58:31.826235+0000 mgr.a (mgr.14373) 13898 : audit [DBG] from='client.301560 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:58:35.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:58:34 smithi157 bash[24585]: cluster 2024-09-16T10:58:33.504321+0000 mgr.a (mgr.14373) 13899 : cluster [DBG] pgmap v9640: 225 pgs: 225 active+clean; 589 KiB data, 179 MiB used, 268 GiB / 268 GiB avail; 64 KiB/s rd, 0 B/s wr, 106 op/s 2024-09-16T10:58:35.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:58:34 smithi086 bash[24289]: cluster 2024-09-16T10:58:33.504321+0000 mgr.a (mgr.14373) 13899 : cluster [DBG] pgmap v9640: 225 pgs: 225 active+clean; 589 KiB data, 179 MiB used, 268 GiB / 268 GiB avail; 64 KiB/s rd, 0 B/s wr, 106 op/s 2024-09-16T10:58:35.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:58:34 smithi047 bash[22744]: cluster 2024-09-16T10:58:33.504321+0000 mgr.a (mgr.14373) 13899 : cluster [DBG] pgmap v9640: 225 pgs: 225 active+clean; 589 KiB data, 179 MiB used, 268 GiB / 268 GiB avail; 64 KiB/s rd, 0 B/s wr, 106 op/s 2024-09-16T10:58:37.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:58:36 smithi157 bash[24585]: cluster 2024-09-16T10:58:35.505113+0000 mgr.a (mgr.14373) 13900 : cluster [DBG] pgmap v9641: 225 pgs: 225 active+clean; 589 KiB data, 179 MiB used, 268 GiB / 268 GiB avail; 64 KiB/s rd, 0 B/s wr, 106 op/s 2024-09-16T10:58:37.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:58:36 smithi157 bash[24585]: audit 2024-09-16T10:58:36.083030+0000 mon.b (mon.2) 1270 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T10:58:37.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:58:36 smithi086 bash[24289]: cluster 2024-09-16T10:58:35.505113+0000 mgr.a (mgr.14373) 13900 : cluster [DBG] pgmap v9641: 225 pgs: 225 active+clean; 589 KiB data, 179 MiB used, 268 GiB / 268 GiB avail; 64 KiB/s rd, 0 B/s wr, 106 op/s 2024-09-16T10:58:37.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:58:36 smithi086 bash[24289]: audit 2024-09-16T10:58:36.083030+0000 mon.b (mon.2) 1270 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T10:58:37.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:58:36 smithi047 bash[22744]: cluster 2024-09-16T10:58:35.505113+0000 mgr.a (mgr.14373) 13900 : cluster [DBG] pgmap v9641: 225 pgs: 225 active+clean; 589 KiB data, 179 MiB used, 268 GiB / 268 GiB avail; 64 KiB/s rd, 0 B/s wr, 106 op/s 2024-09-16T10:58:37.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:58:36 smithi047 bash[22744]: audit 2024-09-16T10:58:36.083030+0000 mon.b (mon.2) 1270 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T10:58:37.256 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:58:37.256 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:58:37.257 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:58:38.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:58:37 smithi157 bash[24585]: audit 2024-09-16T10:58:36.700924+0000 mon.a (mon.0) 1395 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:58:38.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:58:37 smithi157 bash[24585]: audit 2024-09-16T10:58:36.705224+0000 mon.a (mon.0) 1396 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:58:38.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:58:37 smithi157 bash[24585]: audit 2024-09-16T10:58:37.498144+0000 mon.b (mon.2) 1271 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T10:58:38.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:58:37 smithi157 bash[24585]: audit 2024-09-16T10:58:37.500001+0000 mon.b (mon.2) 1272 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T10:58:38.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:58:37 smithi157 bash[24585]: audit 2024-09-16T10:58:37.509809+0000 mon.a (mon.0) 1397 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:58:38.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:58:37 smithi157 bash[24585]: audit 2024-09-16T10:58:37.513118+0000 mon.b (mon.2) 1273 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:58:38.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:58:37 smithi086 bash[24289]: audit 2024-09-16T10:58:36.700924+0000 mon.a (mon.0) 1395 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:58:38.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:58:37 smithi086 bash[24289]: audit 2024-09-16T10:58:36.705224+0000 mon.a (mon.0) 1396 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:58:38.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:58:37 smithi086 bash[24289]: audit 2024-09-16T10:58:37.498144+0000 mon.b (mon.2) 1271 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T10:58:38.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:58:37 smithi086 bash[24289]: audit 2024-09-16T10:58:37.500001+0000 mon.b (mon.2) 1272 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T10:58:38.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:58:37 smithi086 bash[24289]: audit 2024-09-16T10:58:37.509809+0000 mon.a (mon.0) 1397 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:58:38.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:58:37 smithi086 bash[24289]: audit 2024-09-16T10:58:37.513118+0000 mon.b (mon.2) 1273 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:58:38.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:58:37 smithi047 bash[22744]: audit 2024-09-16T10:58:36.700924+0000 mon.a (mon.0) 1395 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:58:38.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:58:37 smithi047 bash[22744]: audit 2024-09-16T10:58:36.705224+0000 mon.a (mon.0) 1396 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:58:38.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:58:37 smithi047 bash[22744]: audit 2024-09-16T10:58:37.498144+0000 mon.b (mon.2) 1271 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T10:58:38.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:58:37 smithi047 bash[22744]: audit 2024-09-16T10:58:37.500001+0000 mon.b (mon.2) 1272 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T10:58:38.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:58:37 smithi047 bash[22744]: audit 2024-09-16T10:58:37.509809+0000 mon.a (mon.0) 1397 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:58:38.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:58:37 smithi047 bash[22744]: audit 2024-09-16T10:58:37.513118+0000 mon.b (mon.2) 1273 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:58:38.592 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 10:58:38 smithi047 bash[22994]: debug 2024-09-16T10:58:38.249+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T10:58:38.592 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 10:58:38 smithi047 bash[22994]: debug 2024-09-16T10:58:38.265+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T10:58:38.670 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:58:38.670 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:58:38.670 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:58:38.670 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:58:38.670 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:58:39.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:58:38 smithi157 bash[24585]: cluster 2024-09-16T10:58:37.506071+0000 mgr.a (mgr.14373) 13901 : cluster [DBG] pgmap v9642: 225 pgs: 225 active+clean; 589 KiB data, 179 MiB used, 268 GiB / 268 GiB avail; 65 KiB/s rd, 0 B/s wr, 107 op/s 2024-09-16T10:58:39.117 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:58:38 smithi157 bash[24585]: audit 2024-09-16T10:58:37.515712+0000 mgr.a (mgr.14373) 13902 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:58:39.117 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:58:38 smithi157 bash[24585]: audit 2024-09-16T10:58:37.574941+0000 mgr.a (mgr.14373) 13903 : audit [DBG] from='client.301635 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:58:39.118 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:58:38 smithi047 bash[22744]: cluster 2024-09-16T10:58:37.506071+0000 mgr.a (mgr.14373) 13901 : cluster [DBG] pgmap v9642: 225 pgs: 225 active+clean; 589 KiB data, 179 MiB used, 268 GiB / 268 GiB avail; 65 KiB/s rd, 0 B/s wr, 107 op/s 2024-09-16T10:58:39.118 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:58:38 smithi047 bash[22744]: audit 2024-09-16T10:58:37.515712+0000 mgr.a (mgr.14373) 13902 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:58:39.118 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:58:38 smithi047 bash[22744]: audit 2024-09-16T10:58:37.574941+0000 mgr.a (mgr.14373) 13903 : audit [DBG] from='client.301635 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:58:39.118 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:58:38 smithi086 bash[24289]: cluster 2024-09-16T10:58:37.506071+0000 mgr.a (mgr.14373) 13901 : cluster [DBG] pgmap v9642: 225 pgs: 225 active+clean; 589 KiB data, 179 MiB used, 268 GiB / 268 GiB avail; 65 KiB/s rd, 0 B/s wr, 107 op/s 2024-09-16T10:58:39.118 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:58:38 smithi086 bash[24289]: audit 2024-09-16T10:58:37.515712+0000 mgr.a (mgr.14373) 13902 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:58:39.119 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:58:38 smithi086 bash[24289]: audit 2024-09-16T10:58:37.574941+0000 mgr.a (mgr.14373) 13903 : audit [DBG] from='client.301635 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:58:40.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:58:39 smithi157 bash[24585]: audit 2024-09-16T10:58:38.250714+0000 mgr.a (mgr.14373) 13904 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T10:58:40.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:58:39 smithi157 bash[24585]: cephadm 2024-09-16T10:58:38.268522+0000 mgr.a (mgr.14373) 13905 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T10:58:40.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:58:39 smithi086 bash[24289]: audit 2024-09-16T10:58:38.250714+0000 mgr.a (mgr.14373) 13904 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T10:58:40.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:58:39 smithi086 bash[24289]: cephadm 2024-09-16T10:58:38.268522+0000 mgr.a (mgr.14373) 13905 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T10:58:40.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:58:39 smithi047 bash[22744]: audit 2024-09-16T10:58:38.250714+0000 mgr.a (mgr.14373) 13904 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T10:58:40.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:58:39 smithi047 bash[22744]: cephadm 2024-09-16T10:58:38.268522+0000 mgr.a (mgr.14373) 13905 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T10:58:41.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:58:40 smithi157 bash[24585]: cluster 2024-09-16T10:58:39.506951+0000 mgr.a (mgr.14373) 13906 : cluster [DBG] pgmap v9643: 225 pgs: 225 active+clean; 589 KiB data, 179 MiB used, 268 GiB / 268 GiB avail; 65 KiB/s rd, 0 B/s wr, 106 op/s 2024-09-16T10:58:41.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:58:40 smithi086 bash[24289]: cluster 2024-09-16T10:58:39.506951+0000 mgr.a (mgr.14373) 13906 : cluster [DBG] pgmap v9643: 225 pgs: 225 active+clean; 589 KiB data, 179 MiB used, 268 GiB / 268 GiB avail; 65 KiB/s rd, 0 B/s wr, 106 op/s 2024-09-16T10:58:41.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:58:40 smithi047 bash[22744]: cluster 2024-09-16T10:58:39.506951+0000 mgr.a (mgr.14373) 13906 : cluster [DBG] pgmap v9643: 225 pgs: 225 active+clean; 589 KiB data, 179 MiB used, 268 GiB / 268 GiB avail; 65 KiB/s rd, 0 B/s wr, 106 op/s 2024-09-16T10:58:43.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:58:42 smithi157 bash[24585]: cluster 2024-09-16T10:58:41.509076+0000 mgr.a (mgr.14373) 13907 : cluster [DBG] pgmap v9644: 225 pgs: 225 active+clean; 589 KiB data, 179 MiB used, 268 GiB / 268 GiB avail; 71 KiB/s rd, 426 B/s wr, 113 op/s 2024-09-16T10:58:43.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:58:42 smithi086 bash[24289]: cluster 2024-09-16T10:58:41.509076+0000 mgr.a (mgr.14373) 13907 : cluster [DBG] pgmap v9644: 225 pgs: 225 active+clean; 589 KiB data, 179 MiB used, 268 GiB / 268 GiB avail; 71 KiB/s rd, 426 B/s wr, 113 op/s 2024-09-16T10:58:43.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:58:42 smithi047 bash[22744]: cluster 2024-09-16T10:58:41.509076+0000 mgr.a (mgr.14373) 13907 : cluster [DBG] pgmap v9644: 225 pgs: 225 active+clean; 589 KiB data, 179 MiB used, 268 GiB / 268 GiB avail; 71 KiB/s rd, 426 B/s wr, 113 op/s 2024-09-16T10:58:43.671 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:58:43.672 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:58:43.672 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:58:44.464 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:58:44.464 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:58:44.464 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:58:44.464 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:58:44.464 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:58:45.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:58:44 smithi157 bash[24585]: cluster 2024-09-16T10:58:43.509838+0000 mgr.a (mgr.14373) 13908 : cluster [DBG] pgmap v9645: 225 pgs: 225 active+clean; 589 KiB data, 179 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:58:45.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:58:44 smithi086 bash[24289]: cluster 2024-09-16T10:58:43.509838+0000 mgr.a (mgr.14373) 13908 : cluster [DBG] pgmap v9645: 225 pgs: 225 active+clean; 589 KiB data, 179 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:58:45.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:58:44 smithi047 bash[22744]: cluster 2024-09-16T10:58:43.509838+0000 mgr.a (mgr.14373) 13908 : cluster [DBG] pgmap v9645: 225 pgs: 225 active+clean; 589 KiB data, 179 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:58:46.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:58:45 smithi157 bash[24585]: audit 2024-09-16T10:58:44.008890+0000 mgr.a (mgr.14373) 13909 : audit [DBG] from='client.301821 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:58:46.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:58:45 smithi086 bash[24289]: audit 2024-09-16T10:58:44.008890+0000 mgr.a (mgr.14373) 13909 : audit [DBG] from='client.301821 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:58:46.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:58:45 smithi047 bash[22744]: audit 2024-09-16T10:58:44.008890+0000 mgr.a (mgr.14373) 13909 : audit [DBG] from='client.301821 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:58:47.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:58:46 smithi157 bash[24585]: cluster 2024-09-16T10:58:45.510771+0000 mgr.a (mgr.14373) 13910 : cluster [DBG] pgmap v9646: 225 pgs: 225 active+clean; 589 KiB data, 179 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:58:47.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:58:46 smithi086 bash[24289]: cluster 2024-09-16T10:58:45.510771+0000 mgr.a (mgr.14373) 13910 : cluster [DBG] pgmap v9646: 225 pgs: 225 active+clean; 589 KiB data, 179 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:58:47.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:58:46 smithi047 bash[22744]: cluster 2024-09-16T10:58:45.510771+0000 mgr.a (mgr.14373) 13910 : cluster [DBG] pgmap v9646: 225 pgs: 225 active+clean; 589 KiB data, 179 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:58:49.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:58:48 smithi157 bash[24585]: cluster 2024-09-16T10:58:47.513048+0000 mgr.a (mgr.14373) 13911 : cluster [DBG] pgmap v9647: 225 pgs: 225 active+clean; 589 KiB data, 179 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:58:49.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:58:48 smithi086 bash[24289]: cluster 2024-09-16T10:58:47.513048+0000 mgr.a (mgr.14373) 13911 : cluster [DBG] pgmap v9647: 225 pgs: 225 active+clean; 589 KiB data, 179 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:58:49.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:58:48 smithi047 bash[22744]: cluster 2024-09-16T10:58:47.513048+0000 mgr.a (mgr.14373) 13911 : cluster [DBG] pgmap v9647: 225 pgs: 225 active+clean; 589 KiB data, 179 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:58:49.465 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:58:49.466 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:58:49.466 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:58:50.202 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:58:50.202 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:58:50.202 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:58:50.202 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:58:50.202 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:58:51.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:58:50 smithi157 bash[24585]: cluster 2024-09-16T10:58:49.513815+0000 mgr.a (mgr.14373) 13912 : cluster [DBG] pgmap v9648: 225 pgs: 225 active+clean; 589 KiB data, 179 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:58:51.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:58:50 smithi157 bash[24585]: audit 2024-09-16T10:58:49.793682+0000 mgr.a (mgr.14373) 13913 : audit [DBG] from='client.301896 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:58:51.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:58:50 smithi086 bash[24289]: cluster 2024-09-16T10:58:49.513815+0000 mgr.a (mgr.14373) 13912 : cluster [DBG] pgmap v9648: 225 pgs: 225 active+clean; 589 KiB data, 179 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:58:51.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:58:50 smithi086 bash[24289]: audit 2024-09-16T10:58:49.793682+0000 mgr.a (mgr.14373) 13913 : audit [DBG] from='client.301896 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:58:51.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:58:50 smithi047 bash[22744]: cluster 2024-09-16T10:58:49.513815+0000 mgr.a (mgr.14373) 13912 : cluster [DBG] pgmap v9648: 225 pgs: 225 active+clean; 589 KiB data, 179 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:58:51.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:58:50 smithi047 bash[22744]: audit 2024-09-16T10:58:49.793682+0000 mgr.a (mgr.14373) 13913 : audit [DBG] from='client.301896 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:58:53.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:58:52 smithi157 bash[24585]: cluster 2024-09-16T10:58:51.516078+0000 mgr.a (mgr.14373) 13914 : cluster [DBG] pgmap v9649: 225 pgs: 225 active+clean; 589 KiB data, 179 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:58:53.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:58:52 smithi086 bash[24289]: cluster 2024-09-16T10:58:51.516078+0000 mgr.a (mgr.14373) 13914 : cluster [DBG] pgmap v9649: 225 pgs: 225 active+clean; 589 KiB data, 179 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:58:53.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:58:52 smithi047 bash[22744]: cluster 2024-09-16T10:58:51.516078+0000 mgr.a (mgr.14373) 13914 : cluster [DBG] pgmap v9649: 225 pgs: 225 active+clean; 589 KiB data, 179 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:58:55.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:58:54 smithi157 bash[24585]: cluster 2024-09-16T10:58:53.516865+0000 mgr.a (mgr.14373) 13915 : cluster [DBG] pgmap v9650: 225 pgs: 225 active+clean; 589 KiB data, 179 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:58:55.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:58:54 smithi086 bash[24289]: cluster 2024-09-16T10:58:53.516865+0000 mgr.a (mgr.14373) 13915 : cluster [DBG] pgmap v9650: 225 pgs: 225 active+clean; 589 KiB data, 179 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:58:55.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:58:54 smithi047 bash[22744]: cluster 2024-09-16T10:58:53.516865+0000 mgr.a (mgr.14373) 13915 : cluster [DBG] pgmap v9650: 225 pgs: 225 active+clean; 589 KiB data, 179 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:58:55.203 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:58:55.204 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:58:55.204 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:58:55.982 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:58:55.982 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:58:55.982 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:58:55.982 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:58:55.982 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:58:57.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:58:56 smithi157 bash[24585]: cluster 2024-09-16T10:58:55.517618+0000 mgr.a (mgr.14373) 13916 : cluster [DBG] pgmap v9651: 225 pgs: 225 active+clean; 589 KiB data, 179 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:58:57.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:58:56 smithi157 bash[24585]: audit 2024-09-16T10:58:55.540937+0000 mgr.a (mgr.14373) 13917 : audit [DBG] from='client.301974 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:58:57.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:58:56 smithi086 bash[24289]: cluster 2024-09-16T10:58:55.517618+0000 mgr.a (mgr.14373) 13916 : cluster [DBG] pgmap v9651: 225 pgs: 225 active+clean; 589 KiB data, 179 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:58:57.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:58:56 smithi086 bash[24289]: audit 2024-09-16T10:58:55.540937+0000 mgr.a (mgr.14373) 13917 : audit [DBG] from='client.301974 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:58:57.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:58:56 smithi047 bash[22744]: cluster 2024-09-16T10:58:55.517618+0000 mgr.a (mgr.14373) 13916 : cluster [DBG] pgmap v9651: 225 pgs: 225 active+clean; 589 KiB data, 179 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:58:57.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:58:56 smithi047 bash[22744]: audit 2024-09-16T10:58:55.540937+0000 mgr.a (mgr.14373) 13917 : audit [DBG] from='client.301974 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:58:59.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:58:58 smithi157 bash[24585]: cluster 2024-09-16T10:58:57.519993+0000 mgr.a (mgr.14373) 13918 : cluster [DBG] pgmap v9652: 225 pgs: 225 active+clean; 589 KiB data, 179 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:58:59.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:58:58 smithi086 bash[24289]: cluster 2024-09-16T10:58:57.519993+0000 mgr.a (mgr.14373) 13918 : cluster [DBG] pgmap v9652: 225 pgs: 225 active+clean; 589 KiB data, 179 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:58:59.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:58:58 smithi047 bash[22744]: cluster 2024-09-16T10:58:57.519993+0000 mgr.a (mgr.14373) 13918 : cluster [DBG] pgmap v9652: 225 pgs: 225 active+clean; 589 KiB data, 179 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:59:00.983 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:59:00.984 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:59:00.984 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:59:01.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:59:00 smithi157 bash[24585]: cluster 2024-09-16T10:58:59.520770+0000 mgr.a (mgr.14373) 13919 : cluster [DBG] pgmap v9653: 225 pgs: 225 active+clean; 589 KiB data, 179 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:59:01.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:59:00 smithi086 bash[24289]: cluster 2024-09-16T10:58:59.520770+0000 mgr.a (mgr.14373) 13919 : cluster [DBG] pgmap v9653: 225 pgs: 225 active+clean; 589 KiB data, 179 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:59:01.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:59:00 smithi047 bash[22744]: cluster 2024-09-16T10:58:59.520770+0000 mgr.a (mgr.14373) 13919 : cluster [DBG] pgmap v9653: 225 pgs: 225 active+clean; 589 KiB data, 179 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:59:01.771 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:59:01.771 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:59:01.771 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:59:01.771 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:59:01.772 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:59:03.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:59:02 smithi157 bash[24585]: audit 2024-09-16T10:59:01.315926+0000 mgr.a (mgr.14373) 13920 : audit [DBG] from='client.302049 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:59:03.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:59:02 smithi157 bash[24585]: cluster 2024-09-16T10:59:01.522091+0000 mgr.a (mgr.14373) 13921 : cluster [DBG] pgmap v9654: 225 pgs: 225 active+clean; 589 KiB data, 179 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:59:03.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:59:02 smithi086 bash[24289]: audit 2024-09-16T10:59:01.315926+0000 mgr.a (mgr.14373) 13920 : audit [DBG] from='client.302049 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:59:03.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:59:02 smithi086 bash[24289]: cluster 2024-09-16T10:59:01.522091+0000 mgr.a (mgr.14373) 13921 : cluster [DBG] pgmap v9654: 225 pgs: 225 active+clean; 589 KiB data, 179 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:59:03.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:59:02 smithi047 bash[22744]: audit 2024-09-16T10:59:01.315926+0000 mgr.a (mgr.14373) 13920 : audit [DBG] from='client.302049 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:59:03.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:59:02 smithi047 bash[22744]: cluster 2024-09-16T10:59:01.522091+0000 mgr.a (mgr.14373) 13921 : cluster [DBG] pgmap v9654: 225 pgs: 225 active+clean; 589 KiB data, 179 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:59:05.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:59:04 smithi157 bash[24585]: cluster 2024-09-16T10:59:03.523006+0000 mgr.a (mgr.14373) 13922 : cluster [DBG] pgmap v9655: 225 pgs: 225 active+clean; 589 KiB data, 179 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T10:59:05.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:59:04 smithi086 bash[24289]: cluster 2024-09-16T10:59:03.523006+0000 mgr.a (mgr.14373) 13922 : cluster [DBG] pgmap v9655: 225 pgs: 225 active+clean; 589 KiB data, 179 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T10:59:05.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:59:04 smithi047 bash[22744]: cluster 2024-09-16T10:59:03.523006+0000 mgr.a (mgr.14373) 13922 : cluster [DBG] pgmap v9655: 225 pgs: 225 active+clean; 589 KiB data, 179 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T10:59:06.772 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:59:06.773 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:59:06.774 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:59:07.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:59:06 smithi157 bash[24585]: cluster 2024-09-16T10:59:05.523755+0000 mgr.a (mgr.14373) 13923 : cluster [DBG] pgmap v9656: 225 pgs: 225 active+clean; 589 KiB data, 179 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T10:59:07.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:59:06 smithi086 bash[24289]: cluster 2024-09-16T10:59:05.523755+0000 mgr.a (mgr.14373) 13923 : cluster [DBG] pgmap v9656: 225 pgs: 225 active+clean; 589 KiB data, 179 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T10:59:07.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:59:06 smithi047 bash[22744]: cluster 2024-09-16T10:59:05.523755+0000 mgr.a (mgr.14373) 13923 : cluster [DBG] pgmap v9656: 225 pgs: 225 active+clean; 589 KiB data, 179 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T10:59:07.541 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:59:07.541 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:59:07.542 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:59:07.542 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:59:07.542 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:59:09.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:59:08 smithi157 bash[24585]: audit 2024-09-16T10:59:07.102690+0000 mgr.a (mgr.14373) 13924 : audit [DBG] from='client.302121 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:59:09.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:59:08 smithi157 bash[24585]: cluster 2024-09-16T10:59:07.524978+0000 mgr.a (mgr.14373) 13925 : cluster [DBG] pgmap v9657: 225 pgs: 225 active+clean; 589 KiB data, 179 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:59:09.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:59:08 smithi086 bash[24289]: audit 2024-09-16T10:59:07.102690+0000 mgr.a (mgr.14373) 13924 : audit [DBG] from='client.302121 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:59:09.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:59:08 smithi086 bash[24289]: cluster 2024-09-16T10:59:07.524978+0000 mgr.a (mgr.14373) 13925 : cluster [DBG] pgmap v9657: 225 pgs: 225 active+clean; 589 KiB data, 179 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:59:09.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:59:08 smithi047 bash[22744]: audit 2024-09-16T10:59:07.102690+0000 mgr.a (mgr.14373) 13924 : audit [DBG] from='client.302121 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:59:09.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:59:08 smithi047 bash[22744]: cluster 2024-09-16T10:59:07.524978+0000 mgr.a (mgr.14373) 13925 : cluster [DBG] pgmap v9657: 225 pgs: 225 active+clean; 589 KiB data, 179 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:59:11.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:59:10 smithi157 bash[24585]: cluster 2024-09-16T10:59:09.525714+0000 mgr.a (mgr.14373) 13926 : cluster [DBG] pgmap v9658: 225 pgs: 225 active+clean; 589 KiB data, 179 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T10:59:11.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:59:10 smithi086 bash[24289]: cluster 2024-09-16T10:59:09.525714+0000 mgr.a (mgr.14373) 13926 : cluster [DBG] pgmap v9658: 225 pgs: 225 active+clean; 589 KiB data, 179 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T10:59:11.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:59:10 smithi047 bash[22744]: cluster 2024-09-16T10:59:09.525714+0000 mgr.a (mgr.14373) 13926 : cluster [DBG] pgmap v9658: 225 pgs: 225 active+clean; 589 KiB data, 179 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T10:59:12.543 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:59:12.544 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:59:12.544 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:59:13.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:59:12 smithi157 bash[24585]: cluster 2024-09-16T10:59:11.527668+0000 mgr.a (mgr.14373) 13927 : cluster [DBG] pgmap v9659: 225 pgs: 225 active+clean; 589 KiB data, 179 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:59:13.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:59:12 smithi086 bash[24289]: cluster 2024-09-16T10:59:11.527668+0000 mgr.a (mgr.14373) 13927 : cluster [DBG] pgmap v9659: 225 pgs: 225 active+clean; 589 KiB data, 179 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:59:13.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:59:12 smithi047 bash[22744]: cluster 2024-09-16T10:59:11.527668+0000 mgr.a (mgr.14373) 13927 : cluster [DBG] pgmap v9659: 225 pgs: 225 active+clean; 589 KiB data, 179 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:59:13.288 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:59:13.288 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:59:13.288 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:59:13.288 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:59:13.288 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:59:15.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:59:14 smithi157 bash[24585]: audit 2024-09-16T10:59:12.873807+0000 mgr.a (mgr.14373) 13928 : audit [DBG] from='client.302199 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:59:15.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:59:14 smithi157 bash[24585]: cluster 2024-09-16T10:59:13.528595+0000 mgr.a (mgr.14373) 13929 : cluster [DBG] pgmap v9660: 225 pgs: 225 active+clean; 589 KiB data, 179 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:59:15.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:59:14 smithi086 bash[24289]: audit 2024-09-16T10:59:12.873807+0000 mgr.a (mgr.14373) 13928 : audit [DBG] from='client.302199 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:59:15.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:59:14 smithi086 bash[24289]: cluster 2024-09-16T10:59:13.528595+0000 mgr.a (mgr.14373) 13929 : cluster [DBG] pgmap v9660: 225 pgs: 225 active+clean; 589 KiB data, 179 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:59:15.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:59:14 smithi047 bash[22744]: audit 2024-09-16T10:59:12.873807+0000 mgr.a (mgr.14373) 13928 : audit [DBG] from='client.302199 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:59:15.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:59:14 smithi047 bash[22744]: cluster 2024-09-16T10:59:13.528595+0000 mgr.a (mgr.14373) 13929 : cluster [DBG] pgmap v9660: 225 pgs: 225 active+clean; 589 KiB data, 179 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:59:17.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:59:16 smithi157 bash[24585]: cluster 2024-09-16T10:59:15.529400+0000 mgr.a (mgr.14373) 13930 : cluster [DBG] pgmap v9661: 225 pgs: 225 active+clean; 589 KiB data, 179 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:59:17.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:59:16 smithi086 bash[24289]: cluster 2024-09-16T10:59:15.529400+0000 mgr.a (mgr.14373) 13930 : cluster [DBG] pgmap v9661: 225 pgs: 225 active+clean; 589 KiB data, 179 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:59:17.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:59:16 smithi047 bash[22744]: cluster 2024-09-16T10:59:15.529400+0000 mgr.a (mgr.14373) 13930 : cluster [DBG] pgmap v9661: 225 pgs: 225 active+clean; 589 KiB data, 179 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:59:18.289 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:59:18.290 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:59:18.291 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:59:19.045 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:59:19.045 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:59:19.045 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:59:19.045 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:59:19.045 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:59:19.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:59:18 smithi086 bash[24289]: cluster 2024-09-16T10:59:17.531764+0000 mgr.a (mgr.14373) 13931 : cluster [DBG] pgmap v9662: 225 pgs: 225 active+clean; 589 KiB data, 179 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:59:19.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:59:18 smithi047 bash[22744]: cluster 2024-09-16T10:59:17.531764+0000 mgr.a (mgr.14373) 13931 : cluster [DBG] pgmap v9662: 225 pgs: 225 active+clean; 589 KiB data, 179 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:59:19.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:59:18 smithi157 bash[24585]: cluster 2024-09-16T10:59:17.531764+0000 mgr.a (mgr.14373) 13931 : cluster [DBG] pgmap v9662: 225 pgs: 225 active+clean; 589 KiB data, 179 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:59:20.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:59:19 smithi086 bash[24289]: audit 2024-09-16T10:59:18.619051+0000 mgr.a (mgr.14373) 13932 : audit [DBG] from='client.302274 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:59:20.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:59:19 smithi047 bash[22744]: audit 2024-09-16T10:59:18.619051+0000 mgr.a (mgr.14373) 13932 : audit [DBG] from='client.302274 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:59:20.308 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:59:19 smithi157 bash[24585]: audit 2024-09-16T10:59:18.619051+0000 mgr.a (mgr.14373) 13932 : audit [DBG] from='client.302274 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:59:21.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:59:20 smithi047 bash[22744]: cluster 2024-09-16T10:59:19.532832+0000 mgr.a (mgr.14373) 13933 : cluster [DBG] pgmap v9663: 225 pgs: 225 active+clean; 589 KiB data, 179 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:59:21.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:59:20 smithi157 bash[24585]: cluster 2024-09-16T10:59:19.532832+0000 mgr.a (mgr.14373) 13933 : cluster [DBG] pgmap v9663: 225 pgs: 225 active+clean; 589 KiB data, 179 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:59:21.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:59:20 smithi086 bash[24289]: cluster 2024-09-16T10:59:19.532832+0000 mgr.a (mgr.14373) 13933 : cluster [DBG] pgmap v9663: 225 pgs: 225 active+clean; 589 KiB data, 179 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:59:22.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:59:21 smithi047 bash[22744]: cluster 2024-09-16T10:59:21.535190+0000 mgr.a (mgr.14373) 13934 : cluster [DBG] pgmap v9664: 225 pgs: 225 active+clean; 589 KiB data, 179 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:59:22.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:59:21 smithi157 bash[24585]: cluster 2024-09-16T10:59:21.535190+0000 mgr.a (mgr.14373) 13934 : cluster [DBG] pgmap v9664: 225 pgs: 225 active+clean; 589 KiB data, 179 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:59:22.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:59:21 smithi086 bash[24289]: cluster 2024-09-16T10:59:21.535190+0000 mgr.a (mgr.14373) 13934 : cluster [DBG] pgmap v9664: 225 pgs: 225 active+clean; 589 KiB data, 179 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:59:24.046 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:59:24.047 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:59:24.048 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:59:24.804 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:59:24.805 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:59:24.805 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:59:24.805 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:59:24.805 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:59:25.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:59:24 smithi157 bash[24585]: cluster 2024-09-16T10:59:23.535977+0000 mgr.a (mgr.14373) 13935 : cluster [DBG] pgmap v9665: 225 pgs: 225 active+clean; 589 KiB data, 179 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:59:25.072 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:59:24 smithi086 bash[24289]: cluster 2024-09-16T10:59:23.535977+0000 mgr.a (mgr.14373) 13935 : cluster [DBG] pgmap v9665: 225 pgs: 225 active+clean; 589 KiB data, 179 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:59:25.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:59:24 smithi047 bash[22744]: cluster 2024-09-16T10:59:23.535977+0000 mgr.a (mgr.14373) 13935 : cluster [DBG] pgmap v9665: 225 pgs: 225 active+clean; 589 KiB data, 179 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:59:26.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:59:25 smithi157 bash[24585]: audit 2024-09-16T10:59:24.373583+0000 mgr.a (mgr.14373) 13936 : audit [DBG] from='client.302352 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:59:26.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:59:25 smithi086 bash[24289]: audit 2024-09-16T10:59:24.373583+0000 mgr.a (mgr.14373) 13936 : audit [DBG] from='client.302352 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:59:26.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:59:25 smithi047 bash[22744]: audit 2024-09-16T10:59:24.373583+0000 mgr.a (mgr.14373) 13936 : audit [DBG] from='client.302352 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:59:27.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:59:26 smithi157 bash[24585]: cluster 2024-09-16T10:59:25.536879+0000 mgr.a (mgr.14373) 13937 : cluster [DBG] pgmap v9666: 225 pgs: 225 active+clean; 589 KiB data, 179 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:59:27.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:59:26 smithi086 bash[24289]: cluster 2024-09-16T10:59:25.536879+0000 mgr.a (mgr.14373) 13937 : cluster [DBG] pgmap v9666: 225 pgs: 225 active+clean; 589 KiB data, 179 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:59:27.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:59:26 smithi047 bash[22744]: cluster 2024-09-16T10:59:25.536879+0000 mgr.a (mgr.14373) 13937 : cluster [DBG] pgmap v9666: 225 pgs: 225 active+clean; 589 KiB data, 179 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:59:29.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:59:28 smithi157 bash[24585]: cluster 2024-09-16T10:59:27.539167+0000 mgr.a (mgr.14373) 13938 : cluster [DBG] pgmap v9667: 225 pgs: 225 active+clean; 589 KiB data, 179 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:59:29.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:59:28 smithi086 bash[24289]: cluster 2024-09-16T10:59:27.539167+0000 mgr.a (mgr.14373) 13938 : cluster [DBG] pgmap v9667: 225 pgs: 225 active+clean; 589 KiB data, 179 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:59:29.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:59:28 smithi047 bash[22744]: cluster 2024-09-16T10:59:27.539167+0000 mgr.a (mgr.14373) 13938 : cluster [DBG] pgmap v9667: 225 pgs: 225 active+clean; 589 KiB data, 179 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:59:29.806 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:59:29.807 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:59:29.807 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:59:30.577 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:59:30.577 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:59:30.577 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:59:30.577 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:59:30.577 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:59:31.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:59:30 smithi157 bash[24585]: cluster 2024-09-16T10:59:29.539945+0000 mgr.a (mgr.14373) 13939 : cluster [DBG] pgmap v9668: 225 pgs: 225 active+clean; 589 KiB data, 179 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:59:31.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:59:30 smithi086 bash[24289]: cluster 2024-09-16T10:59:29.539945+0000 mgr.a (mgr.14373) 13939 : cluster [DBG] pgmap v9668: 225 pgs: 225 active+clean; 589 KiB data, 179 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:59:31.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:59:30 smithi047 bash[22744]: cluster 2024-09-16T10:59:29.539945+0000 mgr.a (mgr.14373) 13939 : cluster [DBG] pgmap v9668: 225 pgs: 225 active+clean; 589 KiB data, 179 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:59:32.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:59:31 smithi157 bash[24585]: audit 2024-09-16T10:59:30.134581+0000 mgr.a (mgr.14373) 13940 : audit [DBG] from='client.302430 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:59:32.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:59:31 smithi086 bash[24289]: audit 2024-09-16T10:59:30.134581+0000 mgr.a (mgr.14373) 13940 : audit [DBG] from='client.302430 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:59:32.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:59:31 smithi047 bash[22744]: audit 2024-09-16T10:59:30.134581+0000 mgr.a (mgr.14373) 13940 : audit [DBG] from='client.302430 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:59:33.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:59:32 smithi157 bash[24585]: cluster 2024-09-16T10:59:31.542241+0000 mgr.a (mgr.14373) 13941 : cluster [DBG] pgmap v9669: 225 pgs: 225 active+clean; 589 KiB data, 179 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:59:33.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:59:32 smithi086 bash[24289]: cluster 2024-09-16T10:59:31.542241+0000 mgr.a (mgr.14373) 13941 : cluster [DBG] pgmap v9669: 225 pgs: 225 active+clean; 589 KiB data, 179 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:59:33.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:59:32 smithi047 bash[22744]: cluster 2024-09-16T10:59:31.542241+0000 mgr.a (mgr.14373) 13941 : cluster [DBG] pgmap v9669: 225 pgs: 225 active+clean; 589 KiB data, 179 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:59:35.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:59:34 smithi157 bash[24585]: cluster 2024-09-16T10:59:33.542980+0000 mgr.a (mgr.14373) 13942 : cluster [DBG] pgmap v9670: 225 pgs: 225 active+clean; 589 KiB data, 179 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:59:35.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:59:34 smithi086 bash[24289]: cluster 2024-09-16T10:59:33.542980+0000 mgr.a (mgr.14373) 13942 : cluster [DBG] pgmap v9670: 225 pgs: 225 active+clean; 589 KiB data, 179 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:59:35.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:59:34 smithi047 bash[22744]: cluster 2024-09-16T10:59:33.542980+0000 mgr.a (mgr.14373) 13942 : cluster [DBG] pgmap v9670: 225 pgs: 225 active+clean; 589 KiB data, 179 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:59:35.579 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:59:35.580 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:59:35.580 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:59:36.340 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:59:36.341 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:59:36.341 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:59:36.341 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:59:36.341 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:59:37.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:59:36 smithi157 bash[24585]: cluster 2024-09-16T10:59:35.543745+0000 mgr.a (mgr.14373) 13943 : cluster [DBG] pgmap v9671: 225 pgs: 225 active+clean; 589 KiB data, 179 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:59:37.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:59:36 smithi086 bash[24289]: cluster 2024-09-16T10:59:35.543745+0000 mgr.a (mgr.14373) 13943 : cluster [DBG] pgmap v9671: 225 pgs: 225 active+clean; 589 KiB data, 179 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:59:37.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:59:36 smithi047 bash[22744]: cluster 2024-09-16T10:59:35.543745+0000 mgr.a (mgr.14373) 13943 : cluster [DBG] pgmap v9671: 225 pgs: 225 active+clean; 589 KiB data, 179 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:59:38.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:59:37 smithi157 bash[24585]: audit 2024-09-16T10:59:35.914520+0000 mgr.a (mgr.14373) 13944 : audit [DBG] from='client.302502 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:59:38.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:59:37 smithi086 bash[24289]: audit 2024-09-16T10:59:35.914520+0000 mgr.a (mgr.14373) 13944 : audit [DBG] from='client.302502 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:59:38.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:59:37 smithi047 bash[22744]: audit 2024-09-16T10:59:35.914520+0000 mgr.a (mgr.14373) 13944 : audit [DBG] from='client.302502 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:59:39.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:59:38 smithi157 bash[24585]: cluster 2024-09-16T10:59:37.546227+0000 mgr.a (mgr.14373) 13945 : cluster [DBG] pgmap v9672: 225 pgs: 225 active+clean; 589 KiB data, 179 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:59:39.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:59:38 smithi157 bash[24585]: audit 2024-09-16T10:59:38.330427+0000 mon.b (mon.2) 1274 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T10:59:39.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:59:38 smithi086 bash[24289]: cluster 2024-09-16T10:59:37.546227+0000 mgr.a (mgr.14373) 13945 : cluster [DBG] pgmap v9672: 225 pgs: 225 active+clean; 589 KiB data, 179 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:59:39.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:59:38 smithi086 bash[24289]: audit 2024-09-16T10:59:38.330427+0000 mon.b (mon.2) 1274 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T10:59:39.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:59:38 smithi047 bash[22744]: cluster 2024-09-16T10:59:37.546227+0000 mgr.a (mgr.14373) 13945 : cluster [DBG] pgmap v9672: 225 pgs: 225 active+clean; 589 KiB data, 179 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:59:39.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:59:38 smithi047 bash[22744]: audit 2024-09-16T10:59:38.330427+0000 mon.b (mon.2) 1274 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T10:59:40.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:59:39 smithi157 bash[24585]: audit 2024-09-16T10:59:38.949486+0000 mon.a (mon.0) 1398 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:59:40.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:59:39 smithi157 bash[24585]: audit 2024-09-16T10:59:38.955666+0000 mon.a (mon.0) 1399 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:59:40.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:59:39 smithi157 bash[24585]: audit 2024-09-16T10:59:38.958681+0000 mon.a (mon.0) 1400 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:59:40.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:59:39 smithi157 bash[24585]: audit 2024-09-16T10:59:38.964254+0000 mon.a (mon.0) 1401 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:59:40.308 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:59:39 smithi157 bash[24585]: cluster 2024-09-16T10:59:39.547016+0000 mgr.a (mgr.14373) 13946 : cluster [DBG] pgmap v9673: 225 pgs: 225 active+clean; 589 KiB data, 179 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:59:40.308 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:59:39 smithi157 bash[24585]: audit 2024-09-16T10:59:39.604077+0000 mon.b (mon.2) 1275 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T10:59:40.308 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:59:39 smithi157 bash[24585]: audit 2024-09-16T10:59:39.606006+0000 mon.b (mon.2) 1276 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T10:59:40.308 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:59:39 smithi157 bash[24585]: audit 2024-09-16T10:59:39.617412+0000 mon.a (mon.0) 1402 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:59:40.308 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:59:39 smithi157 bash[24585]: audit 2024-09-16T10:59:39.622350+0000 mon.b (mon.2) 1277 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:59:40.309 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:59:39 smithi157 bash[24585]: audit 2024-09-16T10:59:39.625046+0000 mgr.a (mgr.14373) 13947 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:59:40.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:59:39 smithi086 bash[24289]: audit 2024-09-16T10:59:38.949486+0000 mon.a (mon.0) 1398 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:59:40.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:59:39 smithi086 bash[24289]: audit 2024-09-16T10:59:38.955666+0000 mon.a (mon.0) 1399 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:59:40.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:59:39 smithi086 bash[24289]: audit 2024-09-16T10:59:38.958681+0000 mon.a (mon.0) 1400 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:59:40.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:59:39 smithi086 bash[24289]: audit 2024-09-16T10:59:38.964254+0000 mon.a (mon.0) 1401 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:59:40.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:59:39 smithi086 bash[24289]: cluster 2024-09-16T10:59:39.547016+0000 mgr.a (mgr.14373) 13946 : cluster [DBG] pgmap v9673: 225 pgs: 225 active+clean; 589 KiB data, 179 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:59:40.322 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:59:39 smithi086 bash[24289]: audit 2024-09-16T10:59:39.604077+0000 mon.b (mon.2) 1275 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T10:59:40.322 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:59:39 smithi086 bash[24289]: audit 2024-09-16T10:59:39.606006+0000 mon.b (mon.2) 1276 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T10:59:40.322 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:59:39 smithi086 bash[24289]: audit 2024-09-16T10:59:39.617412+0000 mon.a (mon.0) 1402 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:59:40.322 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:59:39 smithi086 bash[24289]: audit 2024-09-16T10:59:39.622350+0000 mon.b (mon.2) 1277 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:59:40.322 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:59:39 smithi086 bash[24289]: audit 2024-09-16T10:59:39.625046+0000 mgr.a (mgr.14373) 13947 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:59:40.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:59:39 smithi047 bash[22744]: audit 2024-09-16T10:59:38.949486+0000 mon.a (mon.0) 1398 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:59:40.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:59:39 smithi047 bash[22744]: audit 2024-09-16T10:59:38.955666+0000 mon.a (mon.0) 1399 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:59:40.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:59:39 smithi047 bash[22744]: audit 2024-09-16T10:59:38.958681+0000 mon.a (mon.0) 1400 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:59:40.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:59:39 smithi047 bash[22744]: audit 2024-09-16T10:59:38.964254+0000 mon.a (mon.0) 1401 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:59:40.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:59:39 smithi047 bash[22744]: cluster 2024-09-16T10:59:39.547016+0000 mgr.a (mgr.14373) 13946 : cluster [DBG] pgmap v9673: 225 pgs: 225 active+clean; 589 KiB data, 179 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:59:40.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:59:39 smithi047 bash[22744]: audit 2024-09-16T10:59:39.604077+0000 mon.b (mon.2) 1275 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T10:59:40.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:59:39 smithi047 bash[22744]: audit 2024-09-16T10:59:39.606006+0000 mon.b (mon.2) 1276 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T10:59:40.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:59:39 smithi047 bash[22744]: audit 2024-09-16T10:59:39.617412+0000 mon.a (mon.0) 1402 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T10:59:40.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:59:39 smithi047 bash[22744]: audit 2024-09-16T10:59:39.622350+0000 mon.b (mon.2) 1277 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:59:40.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:59:39 smithi047 bash[22744]: audit 2024-09-16T10:59:39.625046+0000 mgr.a (mgr.14373) 13947 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T10:59:40.842 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 10:59:40 smithi047 bash[22994]: debug 2024-09-16T10:59:40.360+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T10:59:40.843 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 10:59:40 smithi047 bash[22994]: debug 2024-09-16T10:59:40.364+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T10:59:41.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:59:40 smithi157 bash[24585]: audit 2024-09-16T10:59:40.365762+0000 mgr.a (mgr.14373) 13948 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T10:59:41.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:59:40 smithi157 bash[24585]: cephadm 2024-09-16T10:59:40.368430+0000 mgr.a (mgr.14373) 13949 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T10:59:41.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:59:40 smithi086 bash[24289]: audit 2024-09-16T10:59:40.365762+0000 mgr.a (mgr.14373) 13948 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T10:59:41.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:59:40 smithi086 bash[24289]: cephadm 2024-09-16T10:59:40.368430+0000 mgr.a (mgr.14373) 13949 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T10:59:41.339 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:59:41.339 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:59:41.340 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:59:41.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:59:40 smithi047 bash[22744]: audit 2024-09-16T10:59:40.365762+0000 mgr.a (mgr.14373) 13948 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T10:59:41.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:59:40 smithi047 bash[22744]: cephadm 2024-09-16T10:59:40.368430+0000 mgr.a (mgr.14373) 13949 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T10:59:42.110 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:59:42.111 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:59:42.111 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:59:42.111 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:59:42.111 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:59:42.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:59:41 smithi157 bash[24585]: cluster 2024-09-16T10:59:41.549209+0000 mgr.a (mgr.14373) 13950 : cluster [DBG] pgmap v9674: 225 pgs: 225 active+clean; 589 KiB data, 179 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:59:42.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:59:41 smithi157 bash[24585]: audit 2024-09-16T10:59:41.673066+0000 mgr.a (mgr.14373) 13951 : audit [DBG] from='client.302688 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:59:42.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:59:41 smithi086 bash[24289]: cluster 2024-09-16T10:59:41.549209+0000 mgr.a (mgr.14373) 13950 : cluster [DBG] pgmap v9674: 225 pgs: 225 active+clean; 589 KiB data, 179 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:59:42.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:59:41 smithi086 bash[24289]: audit 2024-09-16T10:59:41.673066+0000 mgr.a (mgr.14373) 13951 : audit [DBG] from='client.302688 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:59:42.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:59:41 smithi047 bash[22744]: cluster 2024-09-16T10:59:41.549209+0000 mgr.a (mgr.14373) 13950 : cluster [DBG] pgmap v9674: 225 pgs: 225 active+clean; 589 KiB data, 179 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:59:42.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:59:41 smithi047 bash[22744]: audit 2024-09-16T10:59:41.673066+0000 mgr.a (mgr.14373) 13951 : audit [DBG] from='client.302688 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:59:45.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:59:44 smithi157 bash[24585]: cluster 2024-09-16T10:59:43.550069+0000 mgr.a (mgr.14373) 13952 : cluster [DBG] pgmap v9675: 225 pgs: 225 active+clean; 589 KiB data, 179 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T10:59:45.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:59:44 smithi086 bash[24289]: cluster 2024-09-16T10:59:43.550069+0000 mgr.a (mgr.14373) 13952 : cluster [DBG] pgmap v9675: 225 pgs: 225 active+clean; 589 KiB data, 179 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T10:59:45.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:59:44 smithi047 bash[22744]: cluster 2024-09-16T10:59:43.550069+0000 mgr.a (mgr.14373) 13952 : cluster [DBG] pgmap v9675: 225 pgs: 225 active+clean; 589 KiB data, 179 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T10:59:47.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:59:46 smithi157 bash[24585]: cluster 2024-09-16T10:59:45.550866+0000 mgr.a (mgr.14373) 13953 : cluster [DBG] pgmap v9676: 225 pgs: 225 active+clean; 589 KiB data, 179 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T10:59:47.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:59:46 smithi086 bash[24289]: cluster 2024-09-16T10:59:45.550866+0000 mgr.a (mgr.14373) 13953 : cluster [DBG] pgmap v9676: 225 pgs: 225 active+clean; 589 KiB data, 179 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T10:59:47.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:59:46 smithi047 bash[22744]: cluster 2024-09-16T10:59:45.550866+0000 mgr.a (mgr.14373) 13953 : cluster [DBG] pgmap v9676: 225 pgs: 225 active+clean; 589 KiB data, 179 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T10:59:47.112 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:59:47.113 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:59:47.113 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:59:47.882 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:59:47.883 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:59:47.883 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:59:47.883 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:59:47.883 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:59:49.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:59:48 smithi157 bash[24585]: audit 2024-09-16T10:59:47.445005+0000 mgr.a (mgr.14373) 13954 : audit [DBG] from='client.302763 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:59:49.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:59:48 smithi157 bash[24585]: cluster 2024-09-16T10:59:47.552145+0000 mgr.a (mgr.14373) 13955 : cluster [DBG] pgmap v9677: 225 pgs: 225 active+clean; 589 KiB data, 179 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:59:49.073 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:59:48 smithi086 bash[24289]: audit 2024-09-16T10:59:47.445005+0000 mgr.a (mgr.14373) 13954 : audit [DBG] from='client.302763 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:59:49.073 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:59:48 smithi086 bash[24289]: cluster 2024-09-16T10:59:47.552145+0000 mgr.a (mgr.14373) 13955 : cluster [DBG] pgmap v9677: 225 pgs: 225 active+clean; 589 KiB data, 179 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:59:49.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:59:48 smithi047 bash[22744]: audit 2024-09-16T10:59:47.445005+0000 mgr.a (mgr.14373) 13954 : audit [DBG] from='client.302763 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:59:49.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:59:48 smithi047 bash[22744]: cluster 2024-09-16T10:59:47.552145+0000 mgr.a (mgr.14373) 13955 : cluster [DBG] pgmap v9677: 225 pgs: 225 active+clean; 589 KiB data, 179 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:59:51.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:59:50 smithi157 bash[24585]: cluster 2024-09-16T10:59:49.553032+0000 mgr.a (mgr.14373) 13956 : cluster [DBG] pgmap v9678: 225 pgs: 225 active+clean; 589 KiB data, 179 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T10:59:51.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:59:50 smithi086 bash[24289]: cluster 2024-09-16T10:59:49.553032+0000 mgr.a (mgr.14373) 13956 : cluster [DBG] pgmap v9678: 225 pgs: 225 active+clean; 589 KiB data, 179 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T10:59:51.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:59:50 smithi047 bash[22744]: cluster 2024-09-16T10:59:49.553032+0000 mgr.a (mgr.14373) 13956 : cluster [DBG] pgmap v9678: 225 pgs: 225 active+clean; 589 KiB data, 179 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T10:59:52.884 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:59:52.885 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:59:52.885 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:59:53.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:59:52 smithi157 bash[24585]: cluster 2024-09-16T10:59:51.555156+0000 mgr.a (mgr.14373) 13957 : cluster [DBG] pgmap v9679: 225 pgs: 225 active+clean; 589 KiB data, 179 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:59:53.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:59:52 smithi086 bash[24289]: cluster 2024-09-16T10:59:51.555156+0000 mgr.a (mgr.14373) 13957 : cluster [DBG] pgmap v9679: 225 pgs: 225 active+clean; 589 KiB data, 179 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:59:53.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:59:52 smithi047 bash[22744]: cluster 2024-09-16T10:59:51.555156+0000 mgr.a (mgr.14373) 13957 : cluster [DBG] pgmap v9679: 225 pgs: 225 active+clean; 589 KiB data, 179 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T10:59:53.673 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:59:53.673 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:59:53.673 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:59:53.674 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:59:53.674 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T10:59:55.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:59:54 smithi157 bash[24585]: audit 2024-09-16T10:59:53.218020+0000 mgr.a (mgr.14373) 13958 : audit [DBG] from='client.302838 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:59:55.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:59:54 smithi157 bash[24585]: cluster 2024-09-16T10:59:53.564725+0000 mgr.a (mgr.14373) 13959 : cluster [DBG] pgmap v9680: 225 pgs: 225 active+clean; 589 KiB data, 179 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:59:55.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:59:54 smithi086 bash[24289]: audit 2024-09-16T10:59:53.218020+0000 mgr.a (mgr.14373) 13958 : audit [DBG] from='client.302838 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:59:55.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:59:54 smithi086 bash[24289]: cluster 2024-09-16T10:59:53.564725+0000 mgr.a (mgr.14373) 13959 : cluster [DBG] pgmap v9680: 225 pgs: 225 active+clean; 589 KiB data, 179 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:59:55.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:59:54 smithi047 bash[22744]: audit 2024-09-16T10:59:53.218020+0000 mgr.a (mgr.14373) 13958 : audit [DBG] from='client.302838 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T10:59:55.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:59:54 smithi047 bash[22744]: cluster 2024-09-16T10:59:53.564725+0000 mgr.a (mgr.14373) 13959 : cluster [DBG] pgmap v9680: 225 pgs: 225 active+clean; 589 KiB data, 179 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:59:57.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:59:56 smithi157 bash[24585]: cluster 2024-09-16T10:59:55.565587+0000 mgr.a (mgr.14373) 13960 : cluster [DBG] pgmap v9681: 225 pgs: 225 active+clean; 589 KiB data, 179 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:59:57.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:59:56 smithi086 bash[24289]: cluster 2024-09-16T10:59:55.565587+0000 mgr.a (mgr.14373) 13960 : cluster [DBG] pgmap v9681: 225 pgs: 225 active+clean; 589 KiB data, 179 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:59:57.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:59:56 smithi047 bash[22744]: cluster 2024-09-16T10:59:55.565587+0000 mgr.a (mgr.14373) 13960 : cluster [DBG] pgmap v9681: 225 pgs: 225 active+clean; 589 KiB data, 179 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T10:59:58.675 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T10:59:58.675 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T10:59:58.676 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T10:59:59.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 10:59:58 smithi157 bash[24585]: cluster 2024-09-16T10:59:57.567811+0000 mgr.a (mgr.14373) 13961 : cluster [DBG] pgmap v9682: 225 pgs: 225 active+clean; 589 KiB data, 179 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:59:59.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 10:59:58 smithi086 bash[24289]: cluster 2024-09-16T10:59:57.567811+0000 mgr.a (mgr.14373) 13961 : cluster [DBG] pgmap v9682: 225 pgs: 225 active+clean; 589 KiB data, 179 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:59:59.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 10:59:58 smithi047 bash[22744]: cluster 2024-09-16T10:59:57.567811+0000 mgr.a (mgr.14373) 13961 : cluster [DBG] pgmap v9682: 225 pgs: 225 active+clean; 589 KiB data, 179 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T10:59:59.432 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T10:59:59.433 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T10:59:59.433 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T10:59:59.433 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T10:59:59.433 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:00:01.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:00:00 smithi157 bash[24585]: audit 2024-09-16T10:59:59.004479+0000 mgr.a (mgr.14373) 13962 : audit [DBG] from='client.302913 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:00:01.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:00:00 smithi157 bash[24585]: cluster 2024-09-16T10:59:59.568665+0000 mgr.a (mgr.14373) 13963 : cluster [DBG] pgmap v9683: 225 pgs: 225 active+clean; 589 KiB data, 179 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:00:01.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:00:00 smithi157 bash[24585]: cluster 2024-09-16T11:00:00.000145+0000 mon.a (mon.0) 1403 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-16T11:00:01.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:00:00 smithi086 bash[24289]: audit 2024-09-16T10:59:59.004479+0000 mgr.a (mgr.14373) 13962 : audit [DBG] from='client.302913 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:00:01.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:00:00 smithi086 bash[24289]: cluster 2024-09-16T10:59:59.568665+0000 mgr.a (mgr.14373) 13963 : cluster [DBG] pgmap v9683: 225 pgs: 225 active+clean; 589 KiB data, 179 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:00:01.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:00:00 smithi086 bash[24289]: cluster 2024-09-16T11:00:00.000145+0000 mon.a (mon.0) 1403 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-16T11:00:01.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:00:00 smithi047 bash[22744]: audit 2024-09-16T10:59:59.004479+0000 mgr.a (mgr.14373) 13962 : audit [DBG] from='client.302913 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:00:01.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:00:00 smithi047 bash[22744]: cluster 2024-09-16T10:59:59.568665+0000 mgr.a (mgr.14373) 13963 : cluster [DBG] pgmap v9683: 225 pgs: 225 active+clean; 589 KiB data, 179 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:00:01.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:00:00 smithi047 bash[22744]: cluster 2024-09-16T11:00:00.000145+0000 mon.a (mon.0) 1403 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-16T11:00:03.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:00:02 smithi157 bash[24585]: cluster 2024-09-16T11:00:01.570815+0000 mgr.a (mgr.14373) 13964 : cluster [DBG] pgmap v9684: 225 pgs: 225 active+clean; 589 KiB data, 179 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:00:03.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:00:02 smithi086 bash[24289]: cluster 2024-09-16T11:00:01.570815+0000 mgr.a (mgr.14373) 13964 : cluster [DBG] pgmap v9684: 225 pgs: 225 active+clean; 589 KiB data, 179 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:00:03.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:00:02 smithi047 bash[22744]: cluster 2024-09-16T11:00:01.570815+0000 mgr.a (mgr.14373) 13964 : cluster [DBG] pgmap v9684: 225 pgs: 225 active+clean; 589 KiB data, 179 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:00:04.434 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:00:04.435 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:00:04.435 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:00:05.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:00:04 smithi157 bash[24585]: cluster 2024-09-16T11:00:03.571578+0000 mgr.a (mgr.14373) 13965 : cluster [DBG] pgmap v9685: 225 pgs: 225 active+clean; 589 KiB data, 179 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:00:05.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:00:04 smithi086 bash[24289]: cluster 2024-09-16T11:00:03.571578+0000 mgr.a (mgr.14373) 13965 : cluster [DBG] pgmap v9685: 225 pgs: 225 active+clean; 589 KiB data, 179 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:00:05.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:00:04 smithi047 bash[22744]: cluster 2024-09-16T11:00:03.571578+0000 mgr.a (mgr.14373) 13965 : cluster [DBG] pgmap v9685: 225 pgs: 225 active+clean; 589 KiB data, 179 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:00:05.216 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:00:05.216 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:00:05.216 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:00:05.216 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:00:05.216 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:00:06.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:00:05 smithi157 bash[24585]: audit 2024-09-16T11:00:04.767602+0000 mgr.a (mgr.14373) 13966 : audit [DBG] from='client.302991 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:00:06.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:00:05 smithi086 bash[24289]: audit 2024-09-16T11:00:04.767602+0000 mgr.a (mgr.14373) 13966 : audit [DBG] from='client.302991 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:00:06.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:00:05 smithi047 bash[22744]: audit 2024-09-16T11:00:04.767602+0000 mgr.a (mgr.14373) 13966 : audit [DBG] from='client.302991 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:00:07.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:00:06 smithi157 bash[24585]: cluster 2024-09-16T11:00:05.572493+0000 mgr.a (mgr.14373) 13967 : cluster [DBG] pgmap v9686: 225 pgs: 225 active+clean; 589 KiB data, 179 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:00:07.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:00:06 smithi086 bash[24289]: cluster 2024-09-16T11:00:05.572493+0000 mgr.a (mgr.14373) 13967 : cluster [DBG] pgmap v9686: 225 pgs: 225 active+clean; 589 KiB data, 179 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:00:07.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:00:06 smithi047 bash[22744]: cluster 2024-09-16T11:00:05.572493+0000 mgr.a (mgr.14373) 13967 : cluster [DBG] pgmap v9686: 225 pgs: 225 active+clean; 589 KiB data, 179 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:00:09.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:00:08 smithi157 bash[24585]: cluster 2024-09-16T11:00:07.574753+0000 mgr.a (mgr.14373) 13968 : cluster [DBG] pgmap v9687: 225 pgs: 225 active+clean; 589 KiB data, 179 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:00:09.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:00:08 smithi086 bash[24289]: cluster 2024-09-16T11:00:07.574753+0000 mgr.a (mgr.14373) 13968 : cluster [DBG] pgmap v9687: 225 pgs: 225 active+clean; 589 KiB data, 179 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:00:09.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:00:08 smithi047 bash[22744]: cluster 2024-09-16T11:00:07.574753+0000 mgr.a (mgr.14373) 13968 : cluster [DBG] pgmap v9687: 225 pgs: 225 active+clean; 589 KiB data, 179 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:00:10.218 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:00:10.218 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:00:10.218 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:00:10.990 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:00:10.991 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:00:10.991 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:00:10.991 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:00:10.991 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:00:11.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:00:10 smithi157 bash[24585]: cluster 2024-09-16T11:00:09.575498+0000 mgr.a (mgr.14373) 13969 : cluster [DBG] pgmap v9688: 225 pgs: 225 active+clean; 589 KiB data, 179 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:00:11.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:00:10 smithi086 bash[24289]: cluster 2024-09-16T11:00:09.575498+0000 mgr.a (mgr.14373) 13969 : cluster [DBG] pgmap v9688: 225 pgs: 225 active+clean; 589 KiB data, 179 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:00:11.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:00:10 smithi047 bash[22744]: cluster 2024-09-16T11:00:09.575498+0000 mgr.a (mgr.14373) 13969 : cluster [DBG] pgmap v9688: 225 pgs: 225 active+clean; 589 KiB data, 179 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:00:12.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:00:11 smithi157 bash[24585]: audit 2024-09-16T11:00:10.551865+0000 mgr.a (mgr.14373) 13970 : audit [DBG] from='client.303069 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:00:12.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:00:11 smithi086 bash[24289]: audit 2024-09-16T11:00:10.551865+0000 mgr.a (mgr.14373) 13970 : audit [DBG] from='client.303069 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:00:12.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:00:11 smithi047 bash[22744]: audit 2024-09-16T11:00:10.551865+0000 mgr.a (mgr.14373) 13970 : audit [DBG] from='client.303069 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:00:13.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:00:12 smithi157 bash[24585]: cluster 2024-09-16T11:00:11.577780+0000 mgr.a (mgr.14373) 13971 : cluster [DBG] pgmap v9689: 225 pgs: 225 active+clean; 589 KiB data, 179 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:00:13.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:00:12 smithi086 bash[24289]: cluster 2024-09-16T11:00:11.577780+0000 mgr.a (mgr.14373) 13971 : cluster [DBG] pgmap v9689: 225 pgs: 225 active+clean; 589 KiB data, 179 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:00:13.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:00:12 smithi047 bash[22744]: cluster 2024-09-16T11:00:11.577780+0000 mgr.a (mgr.14373) 13971 : cluster [DBG] pgmap v9689: 225 pgs: 225 active+clean; 589 KiB data, 179 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:00:15.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:00:14 smithi157 bash[24585]: cluster 2024-09-16T11:00:13.578585+0000 mgr.a (mgr.14373) 13972 : cluster [DBG] pgmap v9690: 225 pgs: 225 active+clean; 589 KiB data, 179 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:00:15.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:00:14 smithi086 bash[24289]: cluster 2024-09-16T11:00:13.578585+0000 mgr.a (mgr.14373) 13972 : cluster [DBG] pgmap v9690: 225 pgs: 225 active+clean; 589 KiB data, 179 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:00:15.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:00:14 smithi047 bash[22744]: cluster 2024-09-16T11:00:13.578585+0000 mgr.a (mgr.14373) 13972 : cluster [DBG] pgmap v9690: 225 pgs: 225 active+clean; 589 KiB data, 179 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:00:15.992 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:00:15.993 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:00:15.993 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:00:16.744 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:00:16.745 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:00:16.745 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:00:16.745 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:00:16.745 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:00:17.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:00:16 smithi157 bash[24585]: cluster 2024-09-16T11:00:15.579307+0000 mgr.a (mgr.14373) 13973 : cluster [DBG] pgmap v9691: 225 pgs: 225 active+clean; 589 KiB data, 179 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:00:17.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:00:16 smithi086 bash[24289]: cluster 2024-09-16T11:00:15.579307+0000 mgr.a (mgr.14373) 13973 : cluster [DBG] pgmap v9691: 225 pgs: 225 active+clean; 589 KiB data, 179 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:00:17.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:00:16 smithi047 bash[22744]: cluster 2024-09-16T11:00:15.579307+0000 mgr.a (mgr.14373) 13973 : cluster [DBG] pgmap v9691: 225 pgs: 225 active+clean; 589 KiB data, 179 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:00:18.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:00:17 smithi157 bash[24585]: audit 2024-09-16T11:00:16.322119+0000 mgr.a (mgr.14373) 13974 : audit [DBG] from='client.303144 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:00:18.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:00:17 smithi086 bash[24289]: audit 2024-09-16T11:00:16.322119+0000 mgr.a (mgr.14373) 13974 : audit [DBG] from='client.303144 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:00:18.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:00:17 smithi047 bash[22744]: audit 2024-09-16T11:00:16.322119+0000 mgr.a (mgr.14373) 13974 : audit [DBG] from='client.303144 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:00:19.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:00:18 smithi157 bash[24585]: cluster 2024-09-16T11:00:17.582110+0000 mgr.a (mgr.14373) 13975 : cluster [DBG] pgmap v9692: 225 pgs: 225 active+clean; 589 KiB data, 179 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:00:19.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:00:18 smithi086 bash[24289]: cluster 2024-09-16T11:00:17.582110+0000 mgr.a (mgr.14373) 13975 : cluster [DBG] pgmap v9692: 225 pgs: 225 active+clean; 589 KiB data, 179 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:00:19.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:00:18 smithi047 bash[22744]: cluster 2024-09-16T11:00:17.582110+0000 mgr.a (mgr.14373) 13975 : cluster [DBG] pgmap v9692: 225 pgs: 225 active+clean; 589 KiB data, 179 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:00:21.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:00:20 smithi157 bash[24585]: cluster 2024-09-16T11:00:19.582910+0000 mgr.a (mgr.14373) 13976 : cluster [DBG] pgmap v9693: 225 pgs: 225 active+clean; 589 KiB data, 179 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:00:21.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:00:20 smithi086 bash[24289]: cluster 2024-09-16T11:00:19.582910+0000 mgr.a (mgr.14373) 13976 : cluster [DBG] pgmap v9693: 225 pgs: 225 active+clean; 589 KiB data, 179 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:00:21.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:00:20 smithi047 bash[22744]: cluster 2024-09-16T11:00:19.582910+0000 mgr.a (mgr.14373) 13976 : cluster [DBG] pgmap v9693: 225 pgs: 225 active+clean; 589 KiB data, 179 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:00:21.746 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:00:21.747 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:00:21.747 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:00:22.505 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:00:22.505 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:00:22.505 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:00:22.505 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:00:22.505 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:00:23.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:00:22 smithi157 bash[24585]: cluster 2024-09-16T11:00:21.584876+0000 mgr.a (mgr.14373) 13977 : cluster [DBG] pgmap v9694: 225 pgs: 225 active+clean; 589 KiB data, 179 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:00:23.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:00:22 smithi086 bash[24289]: cluster 2024-09-16T11:00:21.584876+0000 mgr.a (mgr.14373) 13977 : cluster [DBG] pgmap v9694: 225 pgs: 225 active+clean; 589 KiB data, 179 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:00:23.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:00:22 smithi047 bash[22744]: cluster 2024-09-16T11:00:21.584876+0000 mgr.a (mgr.14373) 13977 : cluster [DBG] pgmap v9694: 225 pgs: 225 active+clean; 589 KiB data, 179 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:00:24.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:00:23 smithi157 bash[24585]: audit 2024-09-16T11:00:22.075255+0000 mgr.a (mgr.14373) 13978 : audit [DBG] from='client.303222 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:00:24.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:00:23 smithi086 bash[24289]: audit 2024-09-16T11:00:22.075255+0000 mgr.a (mgr.14373) 13978 : audit [DBG] from='client.303222 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:00:24.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:00:23 smithi047 bash[22744]: audit 2024-09-16T11:00:22.075255+0000 mgr.a (mgr.14373) 13978 : audit [DBG] from='client.303222 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:00:25.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:00:24 smithi157 bash[24585]: cluster 2024-09-16T11:00:23.585832+0000 mgr.a (mgr.14373) 13979 : cluster [DBG] pgmap v9695: 225 pgs: 225 active+clean; 589 KiB data, 179 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:00:25.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:00:24 smithi086 bash[24289]: cluster 2024-09-16T11:00:23.585832+0000 mgr.a (mgr.14373) 13979 : cluster [DBG] pgmap v9695: 225 pgs: 225 active+clean; 589 KiB data, 179 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:00:25.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:00:24 smithi047 bash[22744]: cluster 2024-09-16T11:00:23.585832+0000 mgr.a (mgr.14373) 13979 : cluster [DBG] pgmap v9695: 225 pgs: 225 active+clean; 589 KiB data, 179 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:00:27.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:00:26 smithi157 bash[24585]: cluster 2024-09-16T11:00:25.586637+0000 mgr.a (mgr.14373) 13980 : cluster [DBG] pgmap v9696: 225 pgs: 225 active+clean; 589 KiB data, 179 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T11:00:27.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:00:26 smithi086 bash[24289]: cluster 2024-09-16T11:00:25.586637+0000 mgr.a (mgr.14373) 13980 : cluster [DBG] pgmap v9696: 225 pgs: 225 active+clean; 589 KiB data, 179 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T11:00:27.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:00:26 smithi047 bash[22744]: cluster 2024-09-16T11:00:25.586637+0000 mgr.a (mgr.14373) 13980 : cluster [DBG] pgmap v9696: 225 pgs: 225 active+clean; 589 KiB data, 179 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T11:00:27.506 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:00:27.507 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:00:27.507 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:00:28.273 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:00:28.273 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:00:28.273 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:00:28.273 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:00:28.273 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:00:29.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:00:28 smithi157 bash[24585]: cluster 2024-09-16T11:00:27.588501+0000 mgr.a (mgr.14373) 13981 : cluster [DBG] pgmap v9697: 225 pgs: 225 active+clean; 589 KiB data, 179 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:00:29.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:00:28 smithi086 bash[24289]: cluster 2024-09-16T11:00:27.588501+0000 mgr.a (mgr.14373) 13981 : cluster [DBG] pgmap v9697: 225 pgs: 225 active+clean; 589 KiB data, 179 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:00:29.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:00:28 smithi047 bash[22744]: cluster 2024-09-16T11:00:27.588501+0000 mgr.a (mgr.14373) 13981 : cluster [DBG] pgmap v9697: 225 pgs: 225 active+clean; 589 KiB data, 179 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:00:30.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:00:29 smithi157 bash[24585]: audit 2024-09-16T11:00:27.841876+0000 mgr.a (mgr.14373) 13982 : audit [DBG] from='client.303300 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:00:30.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:00:29 smithi086 bash[24289]: audit 2024-09-16T11:00:27.841876+0000 mgr.a (mgr.14373) 13982 : audit [DBG] from='client.303300 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:00:30.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:00:29 smithi047 bash[22744]: audit 2024-09-16T11:00:27.841876+0000 mgr.a (mgr.14373) 13982 : audit [DBG] from='client.303300 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:00:31.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:00:30 smithi157 bash[24585]: cluster 2024-09-16T11:00:29.589482+0000 mgr.a (mgr.14373) 13983 : cluster [DBG] pgmap v9698: 225 pgs: 225 active+clean; 589 KiB data, 179 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:00:31.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:00:30 smithi086 bash[24289]: cluster 2024-09-16T11:00:29.589482+0000 mgr.a (mgr.14373) 13983 : cluster [DBG] pgmap v9698: 225 pgs: 225 active+clean; 589 KiB data, 179 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:00:31.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:00:30 smithi047 bash[22744]: cluster 2024-09-16T11:00:29.589482+0000 mgr.a (mgr.14373) 13983 : cluster [DBG] pgmap v9698: 225 pgs: 225 active+clean; 589 KiB data, 179 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:00:33.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:00:32 smithi157 bash[24585]: cluster 2024-09-16T11:00:31.591635+0000 mgr.a (mgr.14373) 13984 : cluster [DBG] pgmap v9699: 225 pgs: 225 active+clean; 589 KiB data, 179 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:00:33.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:00:32 smithi086 bash[24289]: cluster 2024-09-16T11:00:31.591635+0000 mgr.a (mgr.14373) 13984 : cluster [DBG] pgmap v9699: 225 pgs: 225 active+clean; 589 KiB data, 179 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:00:33.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:00:32 smithi047 bash[22744]: cluster 2024-09-16T11:00:31.591635+0000 mgr.a (mgr.14373) 13984 : cluster [DBG] pgmap v9699: 225 pgs: 225 active+clean; 589 KiB data, 179 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:00:33.274 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:00:33.275 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:00:33.275 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:00:34.024 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:00:34.024 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:00:34.025 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:00:34.025 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:00:34.025 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:00:35.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:00:34 smithi157 bash[24585]: cluster 2024-09-16T11:00:33.592350+0000 mgr.a (mgr.14373) 13985 : cluster [DBG] pgmap v9700: 225 pgs: 225 active+clean; 589 KiB data, 179 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:00:35.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:00:34 smithi157 bash[24585]: audit 2024-09-16T11:00:33.604063+0000 mgr.a (mgr.14373) 13986 : audit [DBG] from='client.303378 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:00:35.072 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:00:34 smithi086 bash[24289]: cluster 2024-09-16T11:00:33.592350+0000 mgr.a (mgr.14373) 13985 : cluster [DBG] pgmap v9700: 225 pgs: 225 active+clean; 589 KiB data, 179 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:00:35.072 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:00:34 smithi086 bash[24289]: audit 2024-09-16T11:00:33.604063+0000 mgr.a (mgr.14373) 13986 : audit [DBG] from='client.303378 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:00:35.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:00:34 smithi047 bash[22744]: cluster 2024-09-16T11:00:33.592350+0000 mgr.a (mgr.14373) 13985 : cluster [DBG] pgmap v9700: 225 pgs: 225 active+clean; 589 KiB data, 179 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:00:35.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:00:34 smithi047 bash[22744]: audit 2024-09-16T11:00:33.604063+0000 mgr.a (mgr.14373) 13986 : audit [DBG] from='client.303378 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:00:37.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:00:36 smithi157 bash[24585]: cluster 2024-09-16T11:00:35.593318+0000 mgr.a (mgr.14373) 13987 : cluster [DBG] pgmap v9701: 225 pgs: 225 active+clean; 589 KiB data, 179 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:00:37.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:00:36 smithi086 bash[24289]: cluster 2024-09-16T11:00:35.593318+0000 mgr.a (mgr.14373) 13987 : cluster [DBG] pgmap v9701: 225 pgs: 225 active+clean; 589 KiB data, 179 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:00:37.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:00:36 smithi047 bash[22744]: cluster 2024-09-16T11:00:35.593318+0000 mgr.a (mgr.14373) 13987 : cluster [DBG] pgmap v9701: 225 pgs: 225 active+clean; 589 KiB data, 179 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:00:39.025 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:00:39.026 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:00:39.027 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:00:39.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:00:38 smithi157 bash[24585]: cluster 2024-09-16T11:00:37.595594+0000 mgr.a (mgr.14373) 13988 : cluster [DBG] pgmap v9702: 225 pgs: 225 active+clean; 589 KiB data, 179 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:00:39.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:00:38 smithi086 bash[24289]: cluster 2024-09-16T11:00:37.595594+0000 mgr.a (mgr.14373) 13988 : cluster [DBG] pgmap v9702: 225 pgs: 225 active+clean; 589 KiB data, 179 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:00:39.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:00:38 smithi047 bash[22744]: cluster 2024-09-16T11:00:37.595594+0000 mgr.a (mgr.14373) 13988 : cluster [DBG] pgmap v9702: 225 pgs: 225 active+clean; 589 KiB data, 179 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:00:39.782 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:00:39.783 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:00:39.783 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:00:39.783 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:00:39.783 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:00:41.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:00:40 smithi157 bash[24585]: audit 2024-09-16T11:00:39.355153+0000 mgr.a (mgr.14373) 13989 : audit [DBG] from='client.303456 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:00:41.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:00:40 smithi157 bash[24585]: cluster 2024-09-16T11:00:39.596292+0000 mgr.a (mgr.14373) 13990 : cluster [DBG] pgmap v9703: 225 pgs: 225 active+clean; 589 KiB data, 179 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:00:41.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:00:40 smithi157 bash[24585]: audit 2024-09-16T11:00:40.423497+0000 mon.b (mon.2) 1278 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T11:00:41.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:00:40 smithi086 bash[24289]: audit 2024-09-16T11:00:39.355153+0000 mgr.a (mgr.14373) 13989 : audit [DBG] from='client.303456 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:00:41.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:00:40 smithi086 bash[24289]: cluster 2024-09-16T11:00:39.596292+0000 mgr.a (mgr.14373) 13990 : cluster [DBG] pgmap v9703: 225 pgs: 225 active+clean; 589 KiB data, 179 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:00:41.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:00:40 smithi086 bash[24289]: audit 2024-09-16T11:00:40.423497+0000 mon.b (mon.2) 1278 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T11:00:41.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:00:40 smithi047 bash[22744]: audit 2024-09-16T11:00:39.355153+0000 mgr.a (mgr.14373) 13989 : audit [DBG] from='client.303456 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:00:41.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:00:40 smithi047 bash[22744]: cluster 2024-09-16T11:00:39.596292+0000 mgr.a (mgr.14373) 13990 : cluster [DBG] pgmap v9703: 225 pgs: 225 active+clean; 589 KiB data, 179 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:00:41.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:00:40 smithi047 bash[22744]: audit 2024-09-16T11:00:40.423497+0000 mon.b (mon.2) 1278 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T11:00:42.034 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:00:41 smithi047 bash[22744]: audit 2024-09-16T11:00:41.270642+0000 mon.b (mon.2) 1279 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T11:00:42.034 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:00:41 smithi047 bash[22744]: audit 2024-09-16T11:00:41.272530+0000 mon.b (mon.2) 1280 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T11:00:42.035 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:00:41 smithi047 bash[22744]: audit 2024-09-16T11:00:41.283826+0000 mon.a (mon.0) 1404 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:00:42.035 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:00:41 smithi047 bash[22744]: audit 2024-09-16T11:00:41.289161+0000 mon.b (mon.2) 1281 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:00:42.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:00:41 smithi157 bash[24585]: audit 2024-09-16T11:00:41.270642+0000 mon.b (mon.2) 1279 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T11:00:42.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:00:41 smithi157 bash[24585]: audit 2024-09-16T11:00:41.272530+0000 mon.b (mon.2) 1280 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T11:00:42.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:00:41 smithi157 bash[24585]: audit 2024-09-16T11:00:41.283826+0000 mon.a (mon.0) 1404 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:00:42.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:00:41 smithi157 bash[24585]: audit 2024-09-16T11:00:41.289161+0000 mon.b (mon.2) 1281 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:00:42.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:00:41 smithi086 bash[24289]: audit 2024-09-16T11:00:41.270642+0000 mon.b (mon.2) 1279 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T11:00:42.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:00:41 smithi086 bash[24289]: audit 2024-09-16T11:00:41.272530+0000 mon.b (mon.2) 1280 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T11:00:42.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:00:41 smithi086 bash[24289]: audit 2024-09-16T11:00:41.283826+0000 mon.a (mon.0) 1404 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:00:42.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:00:41 smithi086 bash[24289]: audit 2024-09-16T11:00:41.289161+0000 mon.b (mon.2) 1281 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:00:42.342 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 11:00:42 smithi047 bash[22994]: debug 2024-09-16T11:00:42.027+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T11:00:42.343 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 11:00:42 smithi047 bash[22994]: debug 2024-09-16T11:00:42.031+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T11:00:43.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:00:42 smithi157 bash[24585]: audit 2024-09-16T11:00:41.290909+0000 mgr.a (mgr.14373) 13991 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:00:43.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:00:42 smithi157 bash[24585]: cluster 2024-09-16T11:00:41.597478+0000 mgr.a (mgr.14373) 13992 : cluster [DBG] pgmap v9704: 225 pgs: 225 active+clean; 589 KiB data, 179 MiB used, 268 GiB / 268 GiB avail; 3.2 KiB/s rd, 2 op/s 2024-09-16T11:00:43.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:00:42 smithi086 bash[24289]: audit 2024-09-16T11:00:41.290909+0000 mgr.a (mgr.14373) 13991 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:00:43.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:00:42 smithi086 bash[24289]: cluster 2024-09-16T11:00:41.597478+0000 mgr.a (mgr.14373) 13992 : cluster [DBG] pgmap v9704: 225 pgs: 225 active+clean; 589 KiB data, 179 MiB used, 268 GiB / 268 GiB avail; 3.2 KiB/s rd, 2 op/s 2024-09-16T11:00:43.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:00:42 smithi047 bash[22744]: audit 2024-09-16T11:00:41.290909+0000 mgr.a (mgr.14373) 13991 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:00:43.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:00:42 smithi047 bash[22744]: cluster 2024-09-16T11:00:41.597478+0000 mgr.a (mgr.14373) 13992 : cluster [DBG] pgmap v9704: 225 pgs: 225 active+clean; 589 KiB data, 179 MiB used, 268 GiB / 268 GiB avail; 3.2 KiB/s rd, 2 op/s 2024-09-16T11:00:44.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:00:43 smithi157 bash[24585]: audit 2024-09-16T11:00:42.032894+0000 mgr.a (mgr.14373) 13993 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T11:00:44.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:00:43 smithi157 bash[24585]: cephadm 2024-09-16T11:00:42.034812+0000 mgr.a (mgr.14373) 13994 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T11:00:44.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:00:43 smithi086 bash[24289]: audit 2024-09-16T11:00:42.032894+0000 mgr.a (mgr.14373) 13993 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T11:00:44.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:00:43 smithi086 bash[24289]: cephadm 2024-09-16T11:00:42.034812+0000 mgr.a (mgr.14373) 13994 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T11:00:44.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:00:43 smithi047 bash[22744]: audit 2024-09-16T11:00:42.032894+0000 mgr.a (mgr.14373) 13993 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T11:00:44.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:00:43 smithi047 bash[22744]: cephadm 2024-09-16T11:00:42.034812+0000 mgr.a (mgr.14373) 13994 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T11:00:44.785 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:00:44.785 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:00:44.785 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:00:45.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:00:44 smithi157 bash[24585]: cluster 2024-09-16T11:00:43.598296+0000 mgr.a (mgr.14373) 13995 : cluster [DBG] pgmap v9705: 225 pgs: 225 active+clean; 589 KiB data, 179 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-16T11:00:45.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:00:44 smithi086 bash[24289]: cluster 2024-09-16T11:00:43.598296+0000 mgr.a (mgr.14373) 13995 : cluster [DBG] pgmap v9705: 225 pgs: 225 active+clean; 589 KiB data, 179 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-16T11:00:45.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:00:44 smithi047 bash[22744]: cluster 2024-09-16T11:00:43.598296+0000 mgr.a (mgr.14373) 13995 : cluster [DBG] pgmap v9705: 225 pgs: 225 active+clean; 589 KiB data, 179 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-16T11:00:45.540 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:00:45.540 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:00:45.540 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:00:45.540 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:00:45.540 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:00:47.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:00:46 smithi157 bash[24585]: audit 2024-09-16T11:00:45.115142+0000 mgr.a (mgr.14373) 13996 : audit [DBG] from='client.303636 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:00:47.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:00:46 smithi157 bash[24585]: cluster 2024-09-16T11:00:45.599035+0000 mgr.a (mgr.14373) 13997 : cluster [DBG] pgmap v9706: 225 pgs: 225 active+clean; 589 KiB data, 179 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-16T11:00:47.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:00:46 smithi086 bash[24289]: audit 2024-09-16T11:00:45.115142+0000 mgr.a (mgr.14373) 13996 : audit [DBG] from='client.303636 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:00:47.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:00:46 smithi086 bash[24289]: cluster 2024-09-16T11:00:45.599035+0000 mgr.a (mgr.14373) 13997 : cluster [DBG] pgmap v9706: 225 pgs: 225 active+clean; 589 KiB data, 179 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-16T11:00:47.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:00:46 smithi047 bash[22744]: audit 2024-09-16T11:00:45.115142+0000 mgr.a (mgr.14373) 13996 : audit [DBG] from='client.303636 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:00:47.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:00:46 smithi047 bash[22744]: cluster 2024-09-16T11:00:45.599035+0000 mgr.a (mgr.14373) 13997 : cluster [DBG] pgmap v9706: 225 pgs: 225 active+clean; 589 KiB data, 179 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-16T11:00:49.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:00:48 smithi157 bash[24585]: cluster 2024-09-16T11:00:47.601183+0000 mgr.a (mgr.14373) 13998 : cluster [DBG] pgmap v9707: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:00:49.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:00:48 smithi086 bash[24289]: cluster 2024-09-16T11:00:47.601183+0000 mgr.a (mgr.14373) 13998 : cluster [DBG] pgmap v9707: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:00:49.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:00:48 smithi047 bash[22744]: cluster 2024-09-16T11:00:47.601183+0000 mgr.a (mgr.14373) 13998 : cluster [DBG] pgmap v9707: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:00:50.541 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:00:50.542 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:00:50.542 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:00:51.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:00:50 smithi157 bash[24585]: cluster 2024-09-16T11:00:49.601937+0000 mgr.a (mgr.14373) 13999 : cluster [DBG] pgmap v9708: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:00:51.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:00:50 smithi086 bash[24289]: cluster 2024-09-16T11:00:49.601937+0000 mgr.a (mgr.14373) 13999 : cluster [DBG] pgmap v9708: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:00:51.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:00:50 smithi047 bash[22744]: cluster 2024-09-16T11:00:49.601937+0000 mgr.a (mgr.14373) 13999 : cluster [DBG] pgmap v9708: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:00:51.291 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:00:51.291 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:00:51.291 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:00:51.292 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:00:51.292 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:00:53.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:00:52 smithi157 bash[24585]: audit 2024-09-16T11:00:50.875645+0000 mgr.a (mgr.14373) 14000 : audit [DBG] from='client.303711 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:00:53.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:00:52 smithi157 bash[24585]: cluster 2024-09-16T11:00:51.604139+0000 mgr.a (mgr.14373) 14001 : cluster [DBG] pgmap v9709: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:00:53.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:00:52 smithi086 bash[24289]: audit 2024-09-16T11:00:50.875645+0000 mgr.a (mgr.14373) 14000 : audit [DBG] from='client.303711 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:00:53.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:00:52 smithi086 bash[24289]: cluster 2024-09-16T11:00:51.604139+0000 mgr.a (mgr.14373) 14001 : cluster [DBG] pgmap v9709: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:00:53.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:00:52 smithi047 bash[22744]: audit 2024-09-16T11:00:50.875645+0000 mgr.a (mgr.14373) 14000 : audit [DBG] from='client.303711 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:00:53.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:00:52 smithi047 bash[22744]: cluster 2024-09-16T11:00:51.604139+0000 mgr.a (mgr.14373) 14001 : cluster [DBG] pgmap v9709: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:00:55.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:00:54 smithi157 bash[24585]: cluster 2024-09-16T11:00:53.604925+0000 mgr.a (mgr.14373) 14002 : cluster [DBG] pgmap v9710: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T11:00:55.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:00:54 smithi086 bash[24289]: cluster 2024-09-16T11:00:53.604925+0000 mgr.a (mgr.14373) 14002 : cluster [DBG] pgmap v9710: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T11:00:55.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:00:54 smithi047 bash[22744]: cluster 2024-09-16T11:00:53.604925+0000 mgr.a (mgr.14373) 14002 : cluster [DBG] pgmap v9710: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T11:00:56.292 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:00:56.293 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:00:56.294 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:00:57.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:00:56 smithi157 bash[24585]: cluster 2024-09-16T11:00:55.605678+0000 mgr.a (mgr.14373) 14003 : cluster [DBG] pgmap v9711: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T11:00:57.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:00:56 smithi086 bash[24289]: cluster 2024-09-16T11:00:55.605678+0000 mgr.a (mgr.14373) 14003 : cluster [DBG] pgmap v9711: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T11:00:57.071 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:00:57.071 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:00:57.071 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:00:57.071 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:00:57.071 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:00:57.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:00:56 smithi047 bash[22744]: cluster 2024-09-16T11:00:55.605678+0000 mgr.a (mgr.14373) 14003 : cluster [DBG] pgmap v9711: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T11:00:58.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:00:57 smithi157 bash[24585]: audit 2024-09-16T11:00:56.628907+0000 mgr.a (mgr.14373) 14004 : audit [DBG] from='client.303789 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:00:58.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:00:57 smithi086 bash[24289]: audit 2024-09-16T11:00:56.628907+0000 mgr.a (mgr.14373) 14004 : audit [DBG] from='client.303789 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:00:58.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:00:57 smithi047 bash[22744]: audit 2024-09-16T11:00:56.628907+0000 mgr.a (mgr.14373) 14004 : audit [DBG] from='client.303789 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:00:59.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:00:58 smithi086 bash[24289]: cluster 2024-09-16T11:00:57.608588+0000 mgr.a (mgr.14373) 14005 : cluster [DBG] pgmap v9712: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T11:00:59.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:00:58 smithi047 bash[22744]: cluster 2024-09-16T11:00:57.608588+0000 mgr.a (mgr.14373) 14005 : cluster [DBG] pgmap v9712: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T11:00:59.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:00:58 smithi157 bash[24585]: cluster 2024-09-16T11:00:57.608588+0000 mgr.a (mgr.14373) 14005 : cluster [DBG] pgmap v9712: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T11:01:01.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:01:00 smithi086 bash[24289]: cluster 2024-09-16T11:00:59.609374+0000 mgr.a (mgr.14373) 14006 : cluster [DBG] pgmap v9713: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:01:01.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:01:00 smithi047 bash[22744]: cluster 2024-09-16T11:00:59.609374+0000 mgr.a (mgr.14373) 14006 : cluster [DBG] pgmap v9713: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:01:01.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:01:00 smithi157 bash[24585]: cluster 2024-09-16T11:00:59.609374+0000 mgr.a (mgr.14373) 14006 : cluster [DBG] pgmap v9713: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:01:02.072 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:01:02.073 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:01:02.073 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:01:02.854 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:01:02.854 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:01:02.854 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:01:02.854 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:01:02.854 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:01:03.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:01:02 smithi047 bash[22744]: cluster 2024-09-16T11:01:01.611363+0000 mgr.a (mgr.14373) 14007 : cluster [DBG] pgmap v9714: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:01:03.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:01:02 smithi157 bash[24585]: cluster 2024-09-16T11:01:01.611363+0000 mgr.a (mgr.14373) 14007 : cluster [DBG] pgmap v9714: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:01:03.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:01:02 smithi086 bash[24289]: cluster 2024-09-16T11:01:01.611363+0000 mgr.a (mgr.14373) 14007 : cluster [DBG] pgmap v9714: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:01:04.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:01:03 smithi086 bash[24289]: audit 2024-09-16T11:01:02.405190+0000 mgr.a (mgr.14373) 14008 : audit [DBG] from='client.303864 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:01:04.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:01:03 smithi047 bash[22744]: audit 2024-09-16T11:01:02.405190+0000 mgr.a (mgr.14373) 14008 : audit [DBG] from='client.303864 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:01:04.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:01:03 smithi157 bash[24585]: audit 2024-09-16T11:01:02.405190+0000 mgr.a (mgr.14373) 14008 : audit [DBG] from='client.303864 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:01:05.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:01:04 smithi047 bash[22744]: cluster 2024-09-16T11:01:03.612312+0000 mgr.a (mgr.14373) 14009 : cluster [DBG] pgmap v9715: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:01:05.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:01:04 smithi157 bash[24585]: cluster 2024-09-16T11:01:03.612312+0000 mgr.a (mgr.14373) 14009 : cluster [DBG] pgmap v9715: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:01:05.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:01:04 smithi086 bash[24289]: cluster 2024-09-16T11:01:03.612312+0000 mgr.a (mgr.14373) 14009 : cluster [DBG] pgmap v9715: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:01:07.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:01:06 smithi047 bash[22744]: cluster 2024-09-16T11:01:05.613089+0000 mgr.a (mgr.14373) 14010 : cluster [DBG] pgmap v9716: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T11:01:07.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:01:06 smithi157 bash[24585]: cluster 2024-09-16T11:01:05.613089+0000 mgr.a (mgr.14373) 14010 : cluster [DBG] pgmap v9716: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T11:01:07.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:01:06 smithi086 bash[24289]: cluster 2024-09-16T11:01:05.613089+0000 mgr.a (mgr.14373) 14010 : cluster [DBG] pgmap v9716: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T11:01:07.855 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:01:07.856 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:01:07.856 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:01:08.606 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:01:08.606 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:01:08.606 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:01:08.606 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:01:08.607 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:01:09.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:01:08 smithi047 bash[22744]: cluster 2024-09-16T11:01:07.615319+0000 mgr.a (mgr.14373) 14011 : cluster [DBG] pgmap v9717: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:01:09.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:01:08 smithi157 bash[24585]: cluster 2024-09-16T11:01:07.615319+0000 mgr.a (mgr.14373) 14011 : cluster [DBG] pgmap v9717: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:01:09.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:01:08 smithi086 bash[24289]: cluster 2024-09-16T11:01:07.615319+0000 mgr.a (mgr.14373) 14011 : cluster [DBG] pgmap v9717: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:01:10.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:01:09 smithi157 bash[24585]: audit 2024-09-16T11:01:08.186806+0000 mgr.a (mgr.14373) 14012 : audit [DBG] from='client.303939 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:01:10.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:01:09 smithi086 bash[24289]: audit 2024-09-16T11:01:08.186806+0000 mgr.a (mgr.14373) 14012 : audit [DBG] from='client.303939 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:01:10.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:01:09 smithi047 bash[22744]: audit 2024-09-16T11:01:08.186806+0000 mgr.a (mgr.14373) 14012 : audit [DBG] from='client.303939 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:01:11.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:01:10 smithi157 bash[24585]: cluster 2024-09-16T11:01:09.616276+0000 mgr.a (mgr.14373) 14013 : cluster [DBG] pgmap v9718: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:01:11.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:01:10 smithi086 bash[24289]: cluster 2024-09-16T11:01:09.616276+0000 mgr.a (mgr.14373) 14013 : cluster [DBG] pgmap v9718: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:01:11.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:01:10 smithi047 bash[22744]: cluster 2024-09-16T11:01:09.616276+0000 mgr.a (mgr.14373) 14013 : cluster [DBG] pgmap v9718: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:01:12.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:01:11 smithi157 bash[24585]: cluster 2024-09-16T11:01:11.618451+0000 mgr.a (mgr.14373) 14014 : cluster [DBG] pgmap v9719: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:01:12.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:01:11 smithi086 bash[24289]: cluster 2024-09-16T11:01:11.618451+0000 mgr.a (mgr.14373) 14014 : cluster [DBG] pgmap v9719: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:01:12.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:01:11 smithi047 bash[22744]: cluster 2024-09-16T11:01:11.618451+0000 mgr.a (mgr.14373) 14014 : cluster [DBG] pgmap v9719: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:01:13.608 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:01:13.609 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:01:13.609 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:01:14.393 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:01:14.393 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:01:14.393 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:01:14.393 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:01:14.393 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:01:15.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:01:14 smithi157 bash[24585]: cluster 2024-09-16T11:01:13.619179+0000 mgr.a (mgr.14373) 14015 : cluster [DBG] pgmap v9720: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:01:15.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:01:14 smithi086 bash[24289]: cluster 2024-09-16T11:01:13.619179+0000 mgr.a (mgr.14373) 14015 : cluster [DBG] pgmap v9720: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:01:15.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:01:14 smithi047 bash[22744]: cluster 2024-09-16T11:01:13.619179+0000 mgr.a (mgr.14373) 14015 : cluster [DBG] pgmap v9720: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:01:16.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:01:15 smithi157 bash[24585]: audit 2024-09-16T11:01:13.948737+0000 mgr.a (mgr.14373) 14016 : audit [DBG] from='client.304017 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:01:16.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:01:15 smithi086 bash[24289]: audit 2024-09-16T11:01:13.948737+0000 mgr.a (mgr.14373) 14016 : audit [DBG] from='client.304017 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:01:16.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:01:15 smithi047 bash[22744]: audit 2024-09-16T11:01:13.948737+0000 mgr.a (mgr.14373) 14016 : audit [DBG] from='client.304017 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:01:17.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:01:16 smithi157 bash[24585]: cluster 2024-09-16T11:01:15.620173+0000 mgr.a (mgr.14373) 14017 : cluster [DBG] pgmap v9721: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:01:17.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:01:16 smithi086 bash[24289]: cluster 2024-09-16T11:01:15.620173+0000 mgr.a (mgr.14373) 14017 : cluster [DBG] pgmap v9721: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:01:17.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:01:16 smithi047 bash[22744]: cluster 2024-09-16T11:01:15.620173+0000 mgr.a (mgr.14373) 14017 : cluster [DBG] pgmap v9721: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:01:19.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:01:18 smithi157 bash[24585]: cluster 2024-09-16T11:01:17.622439+0000 mgr.a (mgr.14373) 14018 : cluster [DBG] pgmap v9722: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:01:19.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:01:18 smithi086 bash[24289]: cluster 2024-09-16T11:01:17.622439+0000 mgr.a (mgr.14373) 14018 : cluster [DBG] pgmap v9722: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:01:19.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:01:18 smithi047 bash[22744]: cluster 2024-09-16T11:01:17.622439+0000 mgr.a (mgr.14373) 14018 : cluster [DBG] pgmap v9722: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:01:19.394 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:01:19.395 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:01:19.395 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:01:20.140 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:01:20.140 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:01:20.141 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:01:20.141 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:01:20.141 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:01:21.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:01:20 smithi157 bash[24585]: cluster 2024-09-16T11:01:19.623138+0000 mgr.a (mgr.14373) 14019 : cluster [DBG] pgmap v9723: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:01:21.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:01:20 smithi157 bash[24585]: audit 2024-09-16T11:01:19.726936+0000 mgr.a (mgr.14373) 14020 : audit [DBG] from='client.304095 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:01:21.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:01:20 smithi086 bash[24289]: cluster 2024-09-16T11:01:19.623138+0000 mgr.a (mgr.14373) 14019 : cluster [DBG] pgmap v9723: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:01:21.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:01:20 smithi086 bash[24289]: audit 2024-09-16T11:01:19.726936+0000 mgr.a (mgr.14373) 14020 : audit [DBG] from='client.304095 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:01:21.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:01:20 smithi047 bash[22744]: cluster 2024-09-16T11:01:19.623138+0000 mgr.a (mgr.14373) 14019 : cluster [DBG] pgmap v9723: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:01:21.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:01:20 smithi047 bash[22744]: audit 2024-09-16T11:01:19.726936+0000 mgr.a (mgr.14373) 14020 : audit [DBG] from='client.304095 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:01:23.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:01:22 smithi157 bash[24585]: cluster 2024-09-16T11:01:21.625368+0000 mgr.a (mgr.14373) 14021 : cluster [DBG] pgmap v9724: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:01:23.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:01:22 smithi086 bash[24289]: cluster 2024-09-16T11:01:21.625368+0000 mgr.a (mgr.14373) 14021 : cluster [DBG] pgmap v9724: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:01:23.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:01:22 smithi047 bash[22744]: cluster 2024-09-16T11:01:21.625368+0000 mgr.a (mgr.14373) 14021 : cluster [DBG] pgmap v9724: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:01:25.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:01:24 smithi157 bash[24585]: cluster 2024-09-16T11:01:23.626162+0000 mgr.a (mgr.14373) 14022 : cluster [DBG] pgmap v9725: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:01:25.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:01:24 smithi086 bash[24289]: cluster 2024-09-16T11:01:23.626162+0000 mgr.a (mgr.14373) 14022 : cluster [DBG] pgmap v9725: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:01:25.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:01:24 smithi047 bash[22744]: cluster 2024-09-16T11:01:23.626162+0000 mgr.a (mgr.14373) 14022 : cluster [DBG] pgmap v9725: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:01:25.142 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:01:25.142 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:01:25.142 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:01:25.890 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:01:25.890 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:01:25.890 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:01:25.890 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:01:25.890 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:01:27.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:01:26 smithi157 bash[24585]: audit 2024-09-16T11:01:25.470983+0000 mgr.a (mgr.14373) 14023 : audit [DBG] from='client.304170 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:01:27.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:01:26 smithi157 bash[24585]: cluster 2024-09-16T11:01:25.626777+0000 mgr.a (mgr.14373) 14024 : cluster [DBG] pgmap v9726: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:01:27.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:01:26 smithi086 bash[24289]: audit 2024-09-16T11:01:25.470983+0000 mgr.a (mgr.14373) 14023 : audit [DBG] from='client.304170 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:01:27.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:01:26 smithi086 bash[24289]: cluster 2024-09-16T11:01:25.626777+0000 mgr.a (mgr.14373) 14024 : cluster [DBG] pgmap v9726: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:01:27.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:01:26 smithi047 bash[22744]: audit 2024-09-16T11:01:25.470983+0000 mgr.a (mgr.14373) 14023 : audit [DBG] from='client.304170 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:01:27.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:01:26 smithi047 bash[22744]: cluster 2024-09-16T11:01:25.626777+0000 mgr.a (mgr.14373) 14024 : cluster [DBG] pgmap v9726: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:01:29.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:01:28 smithi157 bash[24585]: cluster 2024-09-16T11:01:27.629095+0000 mgr.a (mgr.14373) 14025 : cluster [DBG] pgmap v9727: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:01:29.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:01:28 smithi086 bash[24289]: cluster 2024-09-16T11:01:27.629095+0000 mgr.a (mgr.14373) 14025 : cluster [DBG] pgmap v9727: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:01:29.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:01:28 smithi047 bash[22744]: cluster 2024-09-16T11:01:27.629095+0000 mgr.a (mgr.14373) 14025 : cluster [DBG] pgmap v9727: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:01:30.891 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:01:30.892 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:01:30.892 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:01:31.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:01:30 smithi157 bash[24585]: cluster 2024-09-16T11:01:29.629884+0000 mgr.a (mgr.14373) 14026 : cluster [DBG] pgmap v9728: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:01:31.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:01:30 smithi086 bash[24289]: cluster 2024-09-16T11:01:29.629884+0000 mgr.a (mgr.14373) 14026 : cluster [DBG] pgmap v9728: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:01:31.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:01:30 smithi047 bash[22744]: cluster 2024-09-16T11:01:29.629884+0000 mgr.a (mgr.14373) 14026 : cluster [DBG] pgmap v9728: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:01:31.632 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:01:31.633 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:01:31.633 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:01:31.633 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:01:31.633 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:01:33.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:01:32 smithi157 bash[24585]: audit 2024-09-16T11:01:31.222469+0000 mgr.a (mgr.14373) 14027 : audit [DBG] from='client.304245 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:01:33.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:01:32 smithi157 bash[24585]: cluster 2024-09-16T11:01:31.631250+0000 mgr.a (mgr.14373) 14028 : cluster [DBG] pgmap v9729: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-16T11:01:33.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:01:32 smithi086 bash[24289]: audit 2024-09-16T11:01:31.222469+0000 mgr.a (mgr.14373) 14027 : audit [DBG] from='client.304245 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:01:33.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:01:32 smithi086 bash[24289]: cluster 2024-09-16T11:01:31.631250+0000 mgr.a (mgr.14373) 14028 : cluster [DBG] pgmap v9729: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-16T11:01:33.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:01:32 smithi047 bash[22744]: audit 2024-09-16T11:01:31.222469+0000 mgr.a (mgr.14373) 14027 : audit [DBG] from='client.304245 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:01:33.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:01:32 smithi047 bash[22744]: cluster 2024-09-16T11:01:31.631250+0000 mgr.a (mgr.14373) 14028 : cluster [DBG] pgmap v9729: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-16T11:01:35.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:01:34 smithi157 bash[24585]: cluster 2024-09-16T11:01:33.631964+0000 mgr.a (mgr.14373) 14029 : cluster [DBG] pgmap v9730: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T11:01:35.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:01:34 smithi086 bash[24289]: cluster 2024-09-16T11:01:33.631964+0000 mgr.a (mgr.14373) 14029 : cluster [DBG] pgmap v9730: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T11:01:35.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:01:34 smithi047 bash[22744]: cluster 2024-09-16T11:01:33.631964+0000 mgr.a (mgr.14373) 14029 : cluster [DBG] pgmap v9730: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T11:01:36.634 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:01:36.635 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:01:36.635 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:01:37.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:01:36 smithi157 bash[24585]: cluster 2024-09-16T11:01:35.632729+0000 mgr.a (mgr.14373) 14030 : cluster [DBG] pgmap v9731: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T11:01:37.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:01:36 smithi086 bash[24289]: cluster 2024-09-16T11:01:35.632729+0000 mgr.a (mgr.14373) 14030 : cluster [DBG] pgmap v9731: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T11:01:37.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:01:36 smithi047 bash[22744]: cluster 2024-09-16T11:01:35.632729+0000 mgr.a (mgr.14373) 14030 : cluster [DBG] pgmap v9731: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T11:01:37.394 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:01:37.395 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:01:37.395 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:01:37.395 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:01:37.395 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:01:39.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:01:38 smithi157 bash[24585]: audit 2024-09-16T11:01:36.962405+0000 mgr.a (mgr.14373) 14031 : audit [DBG] from='client.304323 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:01:39.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:01:38 smithi157 bash[24585]: cluster 2024-09-16T11:01:37.635481+0000 mgr.a (mgr.14373) 14032 : cluster [DBG] pgmap v9732: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:01:39.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:01:38 smithi086 bash[24289]: audit 2024-09-16T11:01:36.962405+0000 mgr.a (mgr.14373) 14031 : audit [DBG] from='client.304323 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:01:39.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:01:38 smithi086 bash[24289]: cluster 2024-09-16T11:01:37.635481+0000 mgr.a (mgr.14373) 14032 : cluster [DBG] pgmap v9732: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:01:39.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:01:38 smithi047 bash[22744]: audit 2024-09-16T11:01:36.962405+0000 mgr.a (mgr.14373) 14031 : audit [DBG] from='client.304323 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:01:39.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:01:38 smithi047 bash[22744]: cluster 2024-09-16T11:01:37.635481+0000 mgr.a (mgr.14373) 14032 : cluster [DBG] pgmap v9732: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:01:41.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:01:40 smithi157 bash[24585]: cluster 2024-09-16T11:01:39.636284+0000 mgr.a (mgr.14373) 14033 : cluster [DBG] pgmap v9733: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:01:41.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:01:40 smithi086 bash[24289]: cluster 2024-09-16T11:01:39.636284+0000 mgr.a (mgr.14373) 14033 : cluster [DBG] pgmap v9733: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:01:41.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:01:40 smithi047 bash[22744]: cluster 2024-09-16T11:01:39.636284+0000 mgr.a (mgr.14373) 14033 : cluster [DBG] pgmap v9733: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:01:42.396 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:01:42.397 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:01:42.397 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:01:43.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:01:42 smithi157 bash[24585]: cluster 2024-09-16T11:01:41.638204+0000 mgr.a (mgr.14373) 14034 : cluster [DBG] pgmap v9734: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:01:43.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:01:42 smithi157 bash[24585]: audit 2024-09-16T11:01:42.084886+0000 mon.b (mon.2) 1282 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T11:01:43.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:01:42 smithi086 bash[24289]: cluster 2024-09-16T11:01:41.638204+0000 mgr.a (mgr.14373) 14034 : cluster [DBG] pgmap v9734: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:01:43.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:01:42 smithi086 bash[24289]: audit 2024-09-16T11:01:42.084886+0000 mon.b (mon.2) 1282 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T11:01:43.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:01:42 smithi047 bash[22744]: cluster 2024-09-16T11:01:41.638204+0000 mgr.a (mgr.14373) 14034 : cluster [DBG] pgmap v9734: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:01:43.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:01:42 smithi047 bash[22744]: audit 2024-09-16T11:01:42.084886+0000 mon.b (mon.2) 1282 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T11:01:43.152 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:01:43.152 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:01:43.153 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:01:43.153 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:01:43.153 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:01:44.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:01:43 smithi157 bash[24585]: audit 2024-09-16T11:01:42.722773+0000 mgr.a (mgr.14373) 14035 : audit [DBG] from='client.304401 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:01:44.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:01:43 smithi157 bash[24585]: audit 2024-09-16T11:01:42.967462+0000 mon.b (mon.2) 1283 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T11:01:44.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:01:43 smithi157 bash[24585]: audit 2024-09-16T11:01:42.969230+0000 mon.b (mon.2) 1284 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T11:01:44.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:01:43 smithi157 bash[24585]: audit 2024-09-16T11:01:42.977517+0000 mon.a (mon.0) 1405 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:01:44.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:01:43 smithi157 bash[24585]: audit 2024-09-16T11:01:42.982813+0000 mon.b (mon.2) 1285 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:01:44.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:01:43 smithi086 bash[24289]: audit 2024-09-16T11:01:42.722773+0000 mgr.a (mgr.14373) 14035 : audit [DBG] from='client.304401 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:01:44.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:01:43 smithi086 bash[24289]: audit 2024-09-16T11:01:42.967462+0000 mon.b (mon.2) 1283 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T11:01:44.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:01:43 smithi086 bash[24289]: audit 2024-09-16T11:01:42.969230+0000 mon.b (mon.2) 1284 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T11:01:44.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:01:43 smithi086 bash[24289]: audit 2024-09-16T11:01:42.977517+0000 mon.a (mon.0) 1405 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:01:44.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:01:43 smithi086 bash[24289]: audit 2024-09-16T11:01:42.982813+0000 mon.b (mon.2) 1285 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:01:44.092 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 11:01:43 smithi047 bash[22994]: debug 2024-09-16T11:01:43.837+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T11:01:44.092 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 11:01:43 smithi047 bash[22994]: debug 2024-09-16T11:01:43.841+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T11:01:44.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:01:43 smithi047 bash[22744]: audit 2024-09-16T11:01:42.722773+0000 mgr.a (mgr.14373) 14035 : audit [DBG] from='client.304401 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:01:44.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:01:43 smithi047 bash[22744]: audit 2024-09-16T11:01:42.967462+0000 mon.b (mon.2) 1283 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T11:01:44.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:01:43 smithi047 bash[22744]: audit 2024-09-16T11:01:42.969230+0000 mon.b (mon.2) 1284 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T11:01:44.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:01:43 smithi047 bash[22744]: audit 2024-09-16T11:01:42.977517+0000 mon.a (mon.0) 1405 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:01:44.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:01:43 smithi047 bash[22744]: audit 2024-09-16T11:01:42.982813+0000 mon.b (mon.2) 1285 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:01:45.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:01:44 smithi157 bash[24585]: audit 2024-09-16T11:01:42.984500+0000 mgr.a (mgr.14373) 14036 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:01:45.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:01:44 smithi157 bash[24585]: cluster 2024-09-16T11:01:43.638718+0000 mgr.a (mgr.14373) 14037 : cluster [DBG] pgmap v9735: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-16T11:01:45.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:01:44 smithi157 bash[24585]: audit 2024-09-16T11:01:43.840980+0000 mgr.a (mgr.14373) 14038 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T11:01:45.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:01:44 smithi157 bash[24585]: cephadm 2024-09-16T11:01:43.842992+0000 mgr.a (mgr.14373) 14039 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T11:01:45.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:01:44 smithi086 bash[24289]: audit 2024-09-16T11:01:42.984500+0000 mgr.a (mgr.14373) 14036 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:01:45.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:01:44 smithi086 bash[24289]: cluster 2024-09-16T11:01:43.638718+0000 mgr.a (mgr.14373) 14037 : cluster [DBG] pgmap v9735: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-16T11:01:45.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:01:44 smithi086 bash[24289]: audit 2024-09-16T11:01:43.840980+0000 mgr.a (mgr.14373) 14038 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T11:01:45.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:01:44 smithi086 bash[24289]: cephadm 2024-09-16T11:01:43.842992+0000 mgr.a (mgr.14373) 14039 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T11:01:45.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:01:44 smithi047 bash[22744]: audit 2024-09-16T11:01:42.984500+0000 mgr.a (mgr.14373) 14036 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:01:45.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:01:44 smithi047 bash[22744]: cluster 2024-09-16T11:01:43.638718+0000 mgr.a (mgr.14373) 14037 : cluster [DBG] pgmap v9735: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-16T11:01:45.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:01:44 smithi047 bash[22744]: audit 2024-09-16T11:01:43.840980+0000 mgr.a (mgr.14373) 14038 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T11:01:45.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:01:44 smithi047 bash[22744]: cephadm 2024-09-16T11:01:43.842992+0000 mgr.a (mgr.14373) 14039 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T11:01:47.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:01:46 smithi157 bash[24585]: cluster 2024-09-16T11:01:45.639431+0000 mgr.a (mgr.14373) 14040 : cluster [DBG] pgmap v9736: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-16T11:01:47.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:01:46 smithi086 bash[24289]: cluster 2024-09-16T11:01:45.639431+0000 mgr.a (mgr.14373) 14040 : cluster [DBG] pgmap v9736: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-16T11:01:47.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:01:46 smithi047 bash[22744]: cluster 2024-09-16T11:01:45.639431+0000 mgr.a (mgr.14373) 14040 : cluster [DBG] pgmap v9736: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-16T11:01:48.154 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:01:48.154 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:01:48.154 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:01:48.923 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:01:48.923 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:01:48.923 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:01:48.923 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:01:48.923 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:01:49.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:01:48 smithi157 bash[24585]: cluster 2024-09-16T11:01:47.641636+0000 mgr.a (mgr.14373) 14041 : cluster [DBG] pgmap v9737: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:01:49.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:01:48 smithi086 bash[24289]: cluster 2024-09-16T11:01:47.641636+0000 mgr.a (mgr.14373) 14041 : cluster [DBG] pgmap v9737: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:01:49.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:01:48 smithi047 bash[22744]: cluster 2024-09-16T11:01:47.641636+0000 mgr.a (mgr.14373) 14041 : cluster [DBG] pgmap v9737: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:01:50.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:01:49 smithi157 bash[24585]: audit 2024-09-16T11:01:48.485908+0000 mgr.a (mgr.14373) 14042 : audit [DBG] from='client.304587 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:01:50.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:01:49 smithi086 bash[24289]: audit 2024-09-16T11:01:48.485908+0000 mgr.a (mgr.14373) 14042 : audit [DBG] from='client.304587 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:01:50.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:01:49 smithi047 bash[22744]: audit 2024-09-16T11:01:48.485908+0000 mgr.a (mgr.14373) 14042 : audit [DBG] from='client.304587 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:01:51.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:01:50 smithi157 bash[24585]: cluster 2024-09-16T11:01:49.642644+0000 mgr.a (mgr.14373) 14043 : cluster [DBG] pgmap v9738: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:01:51.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:01:50 smithi086 bash[24289]: cluster 2024-09-16T11:01:49.642644+0000 mgr.a (mgr.14373) 14043 : cluster [DBG] pgmap v9738: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:01:51.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:01:50 smithi047 bash[22744]: cluster 2024-09-16T11:01:49.642644+0000 mgr.a (mgr.14373) 14043 : cluster [DBG] pgmap v9738: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:01:52.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:01:51 smithi157 bash[24585]: cluster 2024-09-16T11:01:51.644792+0000 mgr.a (mgr.14373) 14044 : cluster [DBG] pgmap v9739: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:01:52.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:01:51 smithi086 bash[24289]: cluster 2024-09-16T11:01:51.644792+0000 mgr.a (mgr.14373) 14044 : cluster [DBG] pgmap v9739: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:01:52.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:01:51 smithi047 bash[22744]: cluster 2024-09-16T11:01:51.644792+0000 mgr.a (mgr.14373) 14044 : cluster [DBG] pgmap v9739: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:01:53.925 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:01:53.925 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:01:53.925 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:01:54.675 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:01:54.675 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:01:54.675 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:01:54.676 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:01:54.676 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:01:55.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:01:54 smithi157 bash[24585]: cluster 2024-09-16T11:01:53.645544+0000 mgr.a (mgr.14373) 14045 : cluster [DBG] pgmap v9740: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:01:55.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:01:54 smithi086 bash[24289]: cluster 2024-09-16T11:01:53.645544+0000 mgr.a (mgr.14373) 14045 : cluster [DBG] pgmap v9740: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:01:55.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:01:54 smithi047 bash[22744]: cluster 2024-09-16T11:01:53.645544+0000 mgr.a (mgr.14373) 14045 : cluster [DBG] pgmap v9740: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:01:56.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:01:55 smithi157 bash[24585]: audit 2024-09-16T11:01:54.251590+0000 mgr.a (mgr.14373) 14046 : audit [DBG] from='client.304662 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:01:56.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:01:55 smithi086 bash[24289]: audit 2024-09-16T11:01:54.251590+0000 mgr.a (mgr.14373) 14046 : audit [DBG] from='client.304662 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:01:56.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:01:55 smithi047 bash[22744]: audit 2024-09-16T11:01:54.251590+0000 mgr.a (mgr.14373) 14046 : audit [DBG] from='client.304662 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:01:57.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:01:56 smithi157 bash[24585]: cluster 2024-09-16T11:01:55.646480+0000 mgr.a (mgr.14373) 14047 : cluster [DBG] pgmap v9741: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:01:57.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:01:56 smithi086 bash[24289]: cluster 2024-09-16T11:01:55.646480+0000 mgr.a (mgr.14373) 14047 : cluster [DBG] pgmap v9741: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:01:57.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:01:56 smithi047 bash[22744]: cluster 2024-09-16T11:01:55.646480+0000 mgr.a (mgr.14373) 14047 : cluster [DBG] pgmap v9741: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:01:59.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:01:58 smithi157 bash[24585]: cluster 2024-09-16T11:01:57.648719+0000 mgr.a (mgr.14373) 14048 : cluster [DBG] pgmap v9742: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:01:59.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:01:58 smithi086 bash[24289]: cluster 2024-09-16T11:01:57.648719+0000 mgr.a (mgr.14373) 14048 : cluster [DBG] pgmap v9742: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:01:59.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:01:58 smithi047 bash[22744]: cluster 2024-09-16T11:01:57.648719+0000 mgr.a (mgr.14373) 14048 : cluster [DBG] pgmap v9742: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:01:59.677 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:01:59.677 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:01:59.677 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:02:00.468 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:02:00.468 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:02:00.468 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:02:00.468 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:02:00.468 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:02:01.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:02:00 smithi157 bash[24585]: cluster 2024-09-16T11:01:59.649483+0000 mgr.a (mgr.14373) 14049 : cluster [DBG] pgmap v9743: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:02:01.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:02:00 smithi086 bash[24289]: cluster 2024-09-16T11:01:59.649483+0000 mgr.a (mgr.14373) 14049 : cluster [DBG] pgmap v9743: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:02:01.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:02:00 smithi047 bash[22744]: cluster 2024-09-16T11:01:59.649483+0000 mgr.a (mgr.14373) 14049 : cluster [DBG] pgmap v9743: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:02:02.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:02:01 smithi157 bash[24585]: audit 2024-09-16T11:02:00.010891+0000 mgr.a (mgr.14373) 14050 : audit [DBG] from='client.304740 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:02:02.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:02:01 smithi086 bash[24289]: audit 2024-09-16T11:02:00.010891+0000 mgr.a (mgr.14373) 14050 : audit [DBG] from='client.304740 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:02:02.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:02:01 smithi047 bash[22744]: audit 2024-09-16T11:02:00.010891+0000 mgr.a (mgr.14373) 14050 : audit [DBG] from='client.304740 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:02:03.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:02:02 smithi157 bash[24585]: cluster 2024-09-16T11:02:01.651884+0000 mgr.a (mgr.14373) 14051 : cluster [DBG] pgmap v9744: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:02:03.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:02:02 smithi086 bash[24289]: cluster 2024-09-16T11:02:01.651884+0000 mgr.a (mgr.14373) 14051 : cluster [DBG] pgmap v9744: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:02:03.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:02:02 smithi047 bash[22744]: cluster 2024-09-16T11:02:01.651884+0000 mgr.a (mgr.14373) 14051 : cluster [DBG] pgmap v9744: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:02:05.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:02:04 smithi157 bash[24585]: cluster 2024-09-16T11:02:03.652700+0000 mgr.a (mgr.14373) 14052 : cluster [DBG] pgmap v9745: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:02:05.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:02:04 smithi086 bash[24289]: cluster 2024-09-16T11:02:03.652700+0000 mgr.a (mgr.14373) 14052 : cluster [DBG] pgmap v9745: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:02:05.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:02:04 smithi047 bash[22744]: cluster 2024-09-16T11:02:03.652700+0000 mgr.a (mgr.14373) 14052 : cluster [DBG] pgmap v9745: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:02:05.469 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:02:05.470 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:02:05.470 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:02:06.242 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:02:06.242 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:02:06.242 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:02:06.243 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:02:06.243 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:02:07.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:02:06 smithi157 bash[24585]: cluster 2024-09-16T11:02:05.653253+0000 mgr.a (mgr.14373) 14053 : cluster [DBG] pgmap v9746: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:02:07.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:02:06 smithi157 bash[24585]: audit 2024-09-16T11:02:05.806817+0000 mgr.a (mgr.14373) 14054 : audit [DBG] from='client.304818 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:02:07.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:02:06 smithi086 bash[24289]: cluster 2024-09-16T11:02:05.653253+0000 mgr.a (mgr.14373) 14053 : cluster [DBG] pgmap v9746: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:02:07.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:02:06 smithi086 bash[24289]: audit 2024-09-16T11:02:05.806817+0000 mgr.a (mgr.14373) 14054 : audit [DBG] from='client.304818 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:02:07.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:02:06 smithi047 bash[22744]: cluster 2024-09-16T11:02:05.653253+0000 mgr.a (mgr.14373) 14053 : cluster [DBG] pgmap v9746: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:02:07.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:02:06 smithi047 bash[22744]: audit 2024-09-16T11:02:05.806817+0000 mgr.a (mgr.14373) 14054 : audit [DBG] from='client.304818 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:02:09.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:02:08 smithi157 bash[24585]: cluster 2024-09-16T11:02:07.655578+0000 mgr.a (mgr.14373) 14055 : cluster [DBG] pgmap v9747: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:02:09.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:02:08 smithi086 bash[24289]: cluster 2024-09-16T11:02:07.655578+0000 mgr.a (mgr.14373) 14055 : cluster [DBG] pgmap v9747: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:02:09.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:02:08 smithi047 bash[22744]: cluster 2024-09-16T11:02:07.655578+0000 mgr.a (mgr.14373) 14055 : cluster [DBG] pgmap v9747: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:02:11.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:02:10 smithi157 bash[24585]: cluster 2024-09-16T11:02:09.656356+0000 mgr.a (mgr.14373) 14056 : cluster [DBG] pgmap v9748: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:02:11.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:02:10 smithi086 bash[24289]: cluster 2024-09-16T11:02:09.656356+0000 mgr.a (mgr.14373) 14056 : cluster [DBG] pgmap v9748: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:02:11.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:02:10 smithi047 bash[22744]: cluster 2024-09-16T11:02:09.656356+0000 mgr.a (mgr.14373) 14056 : cluster [DBG] pgmap v9748: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:02:11.244 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:02:11.244 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:02:11.244 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:02:12.003 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:02:12.003 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:02:12.004 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:02:12.004 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:02:12.004 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:02:13.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:02:12 smithi157 bash[24585]: audit 2024-09-16T11:02:11.574777+0000 mgr.a (mgr.14373) 14057 : audit [DBG] from='client.304896 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:02:13.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:02:12 smithi157 bash[24585]: cluster 2024-09-16T11:02:11.657872+0000 mgr.a (mgr.14373) 14058 : cluster [DBG] pgmap v9749: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:02:13.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:02:12 smithi086 bash[24289]: audit 2024-09-16T11:02:11.574777+0000 mgr.a (mgr.14373) 14057 : audit [DBG] from='client.304896 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:02:13.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:02:12 smithi086 bash[24289]: cluster 2024-09-16T11:02:11.657872+0000 mgr.a (mgr.14373) 14058 : cluster [DBG] pgmap v9749: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:02:13.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:02:12 smithi047 bash[22744]: audit 2024-09-16T11:02:11.574777+0000 mgr.a (mgr.14373) 14057 : audit [DBG] from='client.304896 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:02:13.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:02:12 smithi047 bash[22744]: cluster 2024-09-16T11:02:11.657872+0000 mgr.a (mgr.14373) 14058 : cluster [DBG] pgmap v9749: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:02:15.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:02:14 smithi157 bash[24585]: cluster 2024-09-16T11:02:13.658898+0000 mgr.a (mgr.14373) 14059 : cluster [DBG] pgmap v9750: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T11:02:15.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:02:14 smithi086 bash[24289]: cluster 2024-09-16T11:02:13.658898+0000 mgr.a (mgr.14373) 14059 : cluster [DBG] pgmap v9750: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T11:02:15.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:02:14 smithi047 bash[22744]: cluster 2024-09-16T11:02:13.658898+0000 mgr.a (mgr.14373) 14059 : cluster [DBG] pgmap v9750: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T11:02:17.005 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:02:17.006 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:02:17.006 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:02:17.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:02:16 smithi157 bash[24585]: cluster 2024-09-16T11:02:15.659864+0000 mgr.a (mgr.14373) 14060 : cluster [DBG] pgmap v9751: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T11:02:17.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:02:16 smithi086 bash[24289]: cluster 2024-09-16T11:02:15.659864+0000 mgr.a (mgr.14373) 14060 : cluster [DBG] pgmap v9751: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T11:02:17.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:02:16 smithi047 bash[22744]: cluster 2024-09-16T11:02:15.659864+0000 mgr.a (mgr.14373) 14060 : cluster [DBG] pgmap v9751: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T11:02:17.789 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:02:17.789 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:02:17.789 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:02:17.789 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:02:17.789 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:02:19.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:02:18 smithi157 bash[24585]: audit 2024-09-16T11:02:17.341727+0000 mgr.a (mgr.14373) 14061 : audit [DBG] from='client.304968 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:02:19.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:02:18 smithi157 bash[24585]: cluster 2024-09-16T11:02:17.661279+0000 mgr.a (mgr.14373) 14062 : cluster [DBG] pgmap v9752: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:02:19.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:02:18 smithi086 bash[24289]: audit 2024-09-16T11:02:17.341727+0000 mgr.a (mgr.14373) 14061 : audit [DBG] from='client.304968 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:02:19.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:02:18 smithi086 bash[24289]: cluster 2024-09-16T11:02:17.661279+0000 mgr.a (mgr.14373) 14062 : cluster [DBG] pgmap v9752: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:02:19.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:02:18 smithi047 bash[22744]: audit 2024-09-16T11:02:17.341727+0000 mgr.a (mgr.14373) 14061 : audit [DBG] from='client.304968 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:02:19.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:02:18 smithi047 bash[22744]: cluster 2024-09-16T11:02:17.661279+0000 mgr.a (mgr.14373) 14062 : cluster [DBG] pgmap v9752: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:02:21.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:02:20 smithi157 bash[24585]: cluster 2024-09-16T11:02:19.662164+0000 mgr.a (mgr.14373) 14063 : cluster [DBG] pgmap v9753: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T11:02:21.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:02:20 smithi086 bash[24289]: cluster 2024-09-16T11:02:19.662164+0000 mgr.a (mgr.14373) 14063 : cluster [DBG] pgmap v9753: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T11:02:21.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:02:20 smithi047 bash[22744]: cluster 2024-09-16T11:02:19.662164+0000 mgr.a (mgr.14373) 14063 : cluster [DBG] pgmap v9753: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T11:02:22.790 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:02:22.791 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:02:22.791 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:02:23.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:02:22 smithi157 bash[24585]: cluster 2024-09-16T11:02:21.664310+0000 mgr.a (mgr.14373) 14064 : cluster [DBG] pgmap v9754: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:02:23.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:02:22 smithi086 bash[24289]: cluster 2024-09-16T11:02:21.664310+0000 mgr.a (mgr.14373) 14064 : cluster [DBG] pgmap v9754: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:02:23.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:02:22 smithi047 bash[22744]: cluster 2024-09-16T11:02:21.664310+0000 mgr.a (mgr.14373) 14064 : cluster [DBG] pgmap v9754: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:02:23.548 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:02:23.549 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:02:23.549 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:02:23.549 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:02:23.549 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:02:25.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:02:24 smithi157 bash[24585]: audit 2024-09-16T11:02:23.122997+0000 mgr.a (mgr.14373) 14065 : audit [DBG] from='client.305046 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:02:25.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:02:24 smithi157 bash[24585]: cluster 2024-09-16T11:02:23.665226+0000 mgr.a (mgr.14373) 14066 : cluster [DBG] pgmap v9755: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:02:25.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:02:24 smithi086 bash[24289]: audit 2024-09-16T11:02:23.122997+0000 mgr.a (mgr.14373) 14065 : audit [DBG] from='client.305046 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:02:25.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:02:24 smithi086 bash[24289]: cluster 2024-09-16T11:02:23.665226+0000 mgr.a (mgr.14373) 14066 : cluster [DBG] pgmap v9755: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:02:25.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:02:24 smithi047 bash[22744]: audit 2024-09-16T11:02:23.122997+0000 mgr.a (mgr.14373) 14065 : audit [DBG] from='client.305046 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:02:25.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:02:24 smithi047 bash[22744]: cluster 2024-09-16T11:02:23.665226+0000 mgr.a (mgr.14373) 14066 : cluster [DBG] pgmap v9755: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:02:27.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:02:26 smithi157 bash[24585]: cluster 2024-09-16T11:02:25.666012+0000 mgr.a (mgr.14373) 14067 : cluster [DBG] pgmap v9756: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:02:27.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:02:26 smithi086 bash[24289]: cluster 2024-09-16T11:02:25.666012+0000 mgr.a (mgr.14373) 14067 : cluster [DBG] pgmap v9756: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:02:27.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:02:26 smithi047 bash[22744]: cluster 2024-09-16T11:02:25.666012+0000 mgr.a (mgr.14373) 14067 : cluster [DBG] pgmap v9756: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:02:28.550 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:02:28.551 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:02:28.551 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:02:29.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:02:28 smithi157 bash[24585]: cluster 2024-09-16T11:02:27.668217+0000 mgr.a (mgr.14373) 14068 : cluster [DBG] pgmap v9757: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:02:29.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:02:28 smithi086 bash[24289]: cluster 2024-09-16T11:02:27.668217+0000 mgr.a (mgr.14373) 14068 : cluster [DBG] pgmap v9757: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:02:29.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:02:28 smithi047 bash[22744]: cluster 2024-09-16T11:02:27.668217+0000 mgr.a (mgr.14373) 14068 : cluster [DBG] pgmap v9757: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:02:29.329 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:02:29.329 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:02:29.329 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:02:29.329 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:02:29.329 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:02:31.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:02:30 smithi157 bash[24585]: audit 2024-09-16T11:02:28.888384+0000 mgr.a (mgr.14373) 14069 : audit [DBG] from='client.305121 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:02:31.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:02:30 smithi157 bash[24585]: cluster 2024-09-16T11:02:29.669144+0000 mgr.a (mgr.14373) 14070 : cluster [DBG] pgmap v9758: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:02:31.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:02:30 smithi086 bash[24289]: audit 2024-09-16T11:02:28.888384+0000 mgr.a (mgr.14373) 14069 : audit [DBG] from='client.305121 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:02:31.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:02:30 smithi086 bash[24289]: cluster 2024-09-16T11:02:29.669144+0000 mgr.a (mgr.14373) 14070 : cluster [DBG] pgmap v9758: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:02:31.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:02:30 smithi047 bash[22744]: audit 2024-09-16T11:02:28.888384+0000 mgr.a (mgr.14373) 14069 : audit [DBG] from='client.305121 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:02:31.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:02:30 smithi047 bash[22744]: cluster 2024-09-16T11:02:29.669144+0000 mgr.a (mgr.14373) 14070 : cluster [DBG] pgmap v9758: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:02:33.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:02:32 smithi157 bash[24585]: cluster 2024-09-16T11:02:31.671309+0000 mgr.a (mgr.14373) 14071 : cluster [DBG] pgmap v9759: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:02:33.072 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:02:32 smithi086 bash[24289]: cluster 2024-09-16T11:02:31.671309+0000 mgr.a (mgr.14373) 14071 : cluster [DBG] pgmap v9759: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:02:33.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:02:32 smithi047 bash[22744]: cluster 2024-09-16T11:02:31.671309+0000 mgr.a (mgr.14373) 14071 : cluster [DBG] pgmap v9759: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:02:34.330 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:02:34.331 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:02:34.331 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:02:35.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:02:34 smithi157 bash[24585]: cluster 2024-09-16T11:02:33.672059+0000 mgr.a (mgr.14373) 14072 : cluster [DBG] pgmap v9760: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:02:35.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:02:34 smithi086 bash[24289]: cluster 2024-09-16T11:02:33.672059+0000 mgr.a (mgr.14373) 14072 : cluster [DBG] pgmap v9760: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:02:35.080 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:02:35.080 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:02:35.080 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:02:35.080 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:02:35.080 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:02:35.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:02:34 smithi047 bash[22744]: cluster 2024-09-16T11:02:33.672059+0000 mgr.a (mgr.14373) 14072 : cluster [DBG] pgmap v9760: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:02:36.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:02:35 smithi157 bash[24585]: audit 2024-09-16T11:02:34.659091+0000 mgr.a (mgr.14373) 14073 : audit [DBG] from='client.305196 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:02:36.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:02:35 smithi086 bash[24289]: audit 2024-09-16T11:02:34.659091+0000 mgr.a (mgr.14373) 14073 : audit [DBG] from='client.305196 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:02:36.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:02:35 smithi047 bash[22744]: audit 2024-09-16T11:02:34.659091+0000 mgr.a (mgr.14373) 14073 : audit [DBG] from='client.305196 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:02:37.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:02:36 smithi086 bash[24289]: cluster 2024-09-16T11:02:35.672969+0000 mgr.a (mgr.14373) 14074 : cluster [DBG] pgmap v9761: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:02:37.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:02:36 smithi047 bash[22744]: cluster 2024-09-16T11:02:35.672969+0000 mgr.a (mgr.14373) 14074 : cluster [DBG] pgmap v9761: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:02:37.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:02:36 smithi157 bash[24585]: cluster 2024-09-16T11:02:35.672969+0000 mgr.a (mgr.14373) 14074 : cluster [DBG] pgmap v9761: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:02:39.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:02:38 smithi086 bash[24289]: cluster 2024-09-16T11:02:37.675227+0000 mgr.a (mgr.14373) 14075 : cluster [DBG] pgmap v9762: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:02:39.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:02:38 smithi047 bash[22744]: cluster 2024-09-16T11:02:37.675227+0000 mgr.a (mgr.14373) 14075 : cluster [DBG] pgmap v9762: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:02:39.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:02:38 smithi157 bash[24585]: cluster 2024-09-16T11:02:37.675227+0000 mgr.a (mgr.14373) 14075 : cluster [DBG] pgmap v9762: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:02:40.081 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:02:40.082 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:02:40.082 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:02:40.831 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:02:40.831 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:02:40.831 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:02:40.831 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:02:40.831 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:02:41.073 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:02:40 smithi086 bash[24289]: cluster 2024-09-16T11:02:39.675991+0000 mgr.a (mgr.14373) 14076 : cluster [DBG] pgmap v9763: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:02:41.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:02:40 smithi047 bash[22744]: cluster 2024-09-16T11:02:39.675991+0000 mgr.a (mgr.14373) 14076 : cluster [DBG] pgmap v9763: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:02:41.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:02:40 smithi157 bash[24585]: cluster 2024-09-16T11:02:39.675991+0000 mgr.a (mgr.14373) 14076 : cluster [DBG] pgmap v9763: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:02:42.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:02:41 smithi047 bash[22744]: audit 2024-09-16T11:02:40.410941+0000 mgr.a (mgr.14373) 14077 : audit [DBG] from='client.305274 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:02:42.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:02:41 smithi157 bash[24585]: audit 2024-09-16T11:02:40.410941+0000 mgr.a (mgr.14373) 14077 : audit [DBG] from='client.305274 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:02:42.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:02:41 smithi086 bash[24289]: audit 2024-09-16T11:02:40.410941+0000 mgr.a (mgr.14373) 14077 : audit [DBG] from='client.305274 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:02:43.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:02:42 smithi047 bash[22744]: cluster 2024-09-16T11:02:41.678226+0000 mgr.a (mgr.14373) 14078 : cluster [DBG] pgmap v9764: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:02:43.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:02:42 smithi157 bash[24585]: cluster 2024-09-16T11:02:41.678226+0000 mgr.a (mgr.14373) 14078 : cluster [DBG] pgmap v9764: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:02:43.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:02:42 smithi086 bash[24289]: cluster 2024-09-16T11:02:41.678226+0000 mgr.a (mgr.14373) 14078 : cluster [DBG] pgmap v9764: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:02:45.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:02:44 smithi047 bash[22744]: cluster 2024-09-16T11:02:43.678957+0000 mgr.a (mgr.14373) 14079 : cluster [DBG] pgmap v9765: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:02:45.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:02:44 smithi047 bash[22744]: audit 2024-09-16T11:02:43.893872+0000 mon.b (mon.2) 1286 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T11:02:45.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:02:44 smithi047 bash[22744]: audit 2024-09-16T11:02:44.730205+0000 mon.b (mon.2) 1287 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T11:02:45.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:02:44 smithi047 bash[22744]: audit 2024-09-16T11:02:44.732466+0000 mon.b (mon.2) 1288 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T11:02:45.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:02:44 smithi047 bash[22744]: audit 2024-09-16T11:02:44.742836+0000 mon.a (mon.0) 1406 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:02:45.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:02:44 smithi047 bash[22744]: audit 2024-09-16T11:02:44.745879+0000 mon.b (mon.2) 1289 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:02:45.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:02:44 smithi157 bash[24585]: cluster 2024-09-16T11:02:43.678957+0000 mgr.a (mgr.14373) 14079 : cluster [DBG] pgmap v9765: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:02:45.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:02:44 smithi157 bash[24585]: audit 2024-09-16T11:02:43.893872+0000 mon.b (mon.2) 1286 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T11:02:45.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:02:44 smithi157 bash[24585]: audit 2024-09-16T11:02:44.730205+0000 mon.b (mon.2) 1287 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T11:02:45.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:02:44 smithi157 bash[24585]: audit 2024-09-16T11:02:44.732466+0000 mon.b (mon.2) 1288 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T11:02:45.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:02:44 smithi157 bash[24585]: audit 2024-09-16T11:02:44.742836+0000 mon.a (mon.0) 1406 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:02:45.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:02:44 smithi157 bash[24585]: audit 2024-09-16T11:02:44.745879+0000 mon.b (mon.2) 1289 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:02:45.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:02:44 smithi086 bash[24289]: cluster 2024-09-16T11:02:43.678957+0000 mgr.a (mgr.14373) 14079 : cluster [DBG] pgmap v9765: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:02:45.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:02:44 smithi086 bash[24289]: audit 2024-09-16T11:02:43.893872+0000 mon.b (mon.2) 1286 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T11:02:45.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:02:44 smithi086 bash[24289]: audit 2024-09-16T11:02:44.730205+0000 mon.b (mon.2) 1287 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T11:02:45.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:02:44 smithi086 bash[24289]: audit 2024-09-16T11:02:44.732466+0000 mon.b (mon.2) 1288 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T11:02:45.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:02:44 smithi086 bash[24289]: audit 2024-09-16T11:02:44.742836+0000 mon.a (mon.0) 1406 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:02:45.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:02:44 smithi086 bash[24289]: audit 2024-09-16T11:02:44.745879+0000 mon.b (mon.2) 1289 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:02:45.832 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:02:45.833 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:02:45.833 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:02:45.835 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 11:02:45 smithi047 bash[22994]: debug 2024-09-16T11:02:45.504+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T11:02:45.835 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 11:02:45 smithi047 bash[22994]: debug 2024-09-16T11:02:45.504+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T11:02:46.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:02:45 smithi047 bash[22744]: audit 2024-09-16T11:02:44.747374+0000 mgr.a (mgr.14373) 14080 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:02:46.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:02:45 smithi157 bash[24585]: audit 2024-09-16T11:02:44.747374+0000 mgr.a (mgr.14373) 14080 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:02:46.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:02:45 smithi086 bash[24289]: audit 2024-09-16T11:02:44.747374+0000 mgr.a (mgr.14373) 14080 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:02:46.590 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:02:46.590 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:02:46.590 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:02:46.590 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:02:46.590 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:02:47.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:02:46 smithi157 bash[24585]: audit 2024-09-16T11:02:45.506843+0000 mgr.a (mgr.14373) 14081 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T11:02:47.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:02:46 smithi157 bash[24585]: cephadm 2024-09-16T11:02:45.509231+0000 mgr.a (mgr.14373) 14082 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T11:02:47.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:02:46 smithi157 bash[24585]: cluster 2024-09-16T11:02:45.680041+0000 mgr.a (mgr.14373) 14083 : cluster [DBG] pgmap v9766: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:02:47.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:02:46 smithi086 bash[24289]: audit 2024-09-16T11:02:45.506843+0000 mgr.a (mgr.14373) 14081 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T11:02:47.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:02:46 smithi086 bash[24289]: cephadm 2024-09-16T11:02:45.509231+0000 mgr.a (mgr.14373) 14082 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T11:02:47.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:02:46 smithi086 bash[24289]: cluster 2024-09-16T11:02:45.680041+0000 mgr.a (mgr.14373) 14083 : cluster [DBG] pgmap v9766: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:02:47.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:02:46 smithi047 bash[22744]: audit 2024-09-16T11:02:45.506843+0000 mgr.a (mgr.14373) 14081 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T11:02:47.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:02:46 smithi047 bash[22744]: cephadm 2024-09-16T11:02:45.509231+0000 mgr.a (mgr.14373) 14082 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T11:02:47.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:02:46 smithi047 bash[22744]: cluster 2024-09-16T11:02:45.680041+0000 mgr.a (mgr.14373) 14083 : cluster [DBG] pgmap v9766: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:02:48.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:02:47 smithi157 bash[24585]: audit 2024-09-16T11:02:46.167790+0000 mgr.a (mgr.14373) 14084 : audit [DBG] from='client.305454 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:02:48.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:02:47 smithi086 bash[24289]: audit 2024-09-16T11:02:46.167790+0000 mgr.a (mgr.14373) 14084 : audit [DBG] from='client.305454 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:02:48.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:02:47 smithi047 bash[22744]: audit 2024-09-16T11:02:46.167790+0000 mgr.a (mgr.14373) 14084 : audit [DBG] from='client.305454 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:02:49.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:02:48 smithi157 bash[24585]: cluster 2024-09-16T11:02:47.682553+0000 mgr.a (mgr.14373) 14085 : cluster [DBG] pgmap v9767: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:02:49.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:02:48 smithi086 bash[24289]: cluster 2024-09-16T11:02:47.682553+0000 mgr.a (mgr.14373) 14085 : cluster [DBG] pgmap v9767: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:02:49.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:02:48 smithi047 bash[22744]: cluster 2024-09-16T11:02:47.682553+0000 mgr.a (mgr.14373) 14085 : cluster [DBG] pgmap v9767: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:02:51.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:02:50 smithi157 bash[24585]: cluster 2024-09-16T11:02:49.683342+0000 mgr.a (mgr.14373) 14086 : cluster [DBG] pgmap v9768: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T11:02:51.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:02:50 smithi086 bash[24289]: cluster 2024-09-16T11:02:49.683342+0000 mgr.a (mgr.14373) 14086 : cluster [DBG] pgmap v9768: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T11:02:51.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:02:50 smithi047 bash[22744]: cluster 2024-09-16T11:02:49.683342+0000 mgr.a (mgr.14373) 14086 : cluster [DBG] pgmap v9768: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T11:02:51.591 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:02:51.591 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:02:51.592 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:02:52.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:02:51 smithi157 bash[24585]: cluster 2024-09-16T11:02:51.684937+0000 mgr.a (mgr.14373) 14087 : cluster [DBG] pgmap v9769: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:02:52.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:02:51 smithi086 bash[24289]: cluster 2024-09-16T11:02:51.684937+0000 mgr.a (mgr.14373) 14087 : cluster [DBG] pgmap v9769: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:02:52.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:02:51 smithi047 bash[22744]: cluster 2024-09-16T11:02:51.684937+0000 mgr.a (mgr.14373) 14087 : cluster [DBG] pgmap v9769: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:02:52.380 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:02:52.380 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:02:52.380 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:02:52.380 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:02:52.380 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:02:53.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:02:52 smithi157 bash[24585]: audit 2024-09-16T11:02:51.928018+0000 mgr.a (mgr.14373) 14088 : audit [DBG] from='client.305532 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:02:53.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:02:52 smithi086 bash[24289]: audit 2024-09-16T11:02:51.928018+0000 mgr.a (mgr.14373) 14088 : audit [DBG] from='client.305532 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:02:53.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:02:52 smithi047 bash[22744]: audit 2024-09-16T11:02:51.928018+0000 mgr.a (mgr.14373) 14088 : audit [DBG] from='client.305532 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:02:54.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:02:53 smithi157 bash[24585]: cluster 2024-09-16T11:02:53.685956+0000 mgr.a (mgr.14373) 14089 : cluster [DBG] pgmap v9770: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T11:02:54.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:02:53 smithi086 bash[24289]: cluster 2024-09-16T11:02:53.685956+0000 mgr.a (mgr.14373) 14089 : cluster [DBG] pgmap v9770: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T11:02:54.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:02:53 smithi047 bash[22744]: cluster 2024-09-16T11:02:53.685956+0000 mgr.a (mgr.14373) 14089 : cluster [DBG] pgmap v9770: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T11:02:57.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:02:56 smithi157 bash[24585]: cluster 2024-09-16T11:02:55.686936+0000 mgr.a (mgr.14373) 14090 : cluster [DBG] pgmap v9771: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T11:02:57.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:02:56 smithi086 bash[24289]: cluster 2024-09-16T11:02:55.686936+0000 mgr.a (mgr.14373) 14090 : cluster [DBG] pgmap v9771: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T11:02:57.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:02:56 smithi047 bash[22744]: cluster 2024-09-16T11:02:55.686936+0000 mgr.a (mgr.14373) 14090 : cluster [DBG] pgmap v9771: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T11:02:57.382 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:02:57.382 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:02:57.383 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:02:58.164 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:02:58.164 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:02:58.164 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:02:58.164 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:02:58.164 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:02:59.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:02:58 smithi157 bash[24585]: cluster 2024-09-16T11:02:57.688319+0000 mgr.a (mgr.14373) 14091 : cluster [DBG] pgmap v9772: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:02:59.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:02:58 smithi157 bash[24585]: audit 2024-09-16T11:02:57.721319+0000 mgr.a (mgr.14373) 14092 : audit [DBG] from='client.305610 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:02:59.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:02:58 smithi086 bash[24289]: cluster 2024-09-16T11:02:57.688319+0000 mgr.a (mgr.14373) 14091 : cluster [DBG] pgmap v9772: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:02:59.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:02:58 smithi086 bash[24289]: audit 2024-09-16T11:02:57.721319+0000 mgr.a (mgr.14373) 14092 : audit [DBG] from='client.305610 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:02:59.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:02:58 smithi047 bash[22744]: cluster 2024-09-16T11:02:57.688319+0000 mgr.a (mgr.14373) 14091 : cluster [DBG] pgmap v9772: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:02:59.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:02:58 smithi047 bash[22744]: audit 2024-09-16T11:02:57.721319+0000 mgr.a (mgr.14373) 14092 : audit [DBG] from='client.305610 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:03:01.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:03:00 smithi157 bash[24585]: cluster 2024-09-16T11:02:59.689315+0000 mgr.a (mgr.14373) 14093 : cluster [DBG] pgmap v9773: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-16T11:03:01.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:03:00 smithi086 bash[24289]: cluster 2024-09-16T11:02:59.689315+0000 mgr.a (mgr.14373) 14093 : cluster [DBG] pgmap v9773: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-16T11:03:01.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:03:00 smithi047 bash[22744]: cluster 2024-09-16T11:02:59.689315+0000 mgr.a (mgr.14373) 14093 : cluster [DBG] pgmap v9773: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-16T11:03:03.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:03:02 smithi157 bash[24585]: cluster 2024-09-16T11:03:01.691536+0000 mgr.a (mgr.14373) 14094 : cluster [DBG] pgmap v9774: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-16T11:03:03.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:03:02 smithi086 bash[24289]: cluster 2024-09-16T11:03:01.691536+0000 mgr.a (mgr.14373) 14094 : cluster [DBG] pgmap v9774: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-16T11:03:03.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:03:02 smithi047 bash[22744]: cluster 2024-09-16T11:03:01.691536+0000 mgr.a (mgr.14373) 14094 : cluster [DBG] pgmap v9774: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-16T11:03:03.165 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:03:03.166 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:03:03.166 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:03:03.922 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:03:03.922 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:03:03.922 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:03:03.922 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:03:03.922 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:03:05.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:03:04 smithi157 bash[24585]: audit 2024-09-16T11:03:03.495420+0000 mgr.a (mgr.14373) 14095 : audit [DBG] from='client.305685 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:03:05.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:03:04 smithi157 bash[24585]: cluster 2024-09-16T11:03:03.692120+0000 mgr.a (mgr.14373) 14096 : cluster [DBG] pgmap v9775: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:03:05.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:03:04 smithi086 bash[24289]: audit 2024-09-16T11:03:03.495420+0000 mgr.a (mgr.14373) 14095 : audit [DBG] from='client.305685 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:03:05.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:03:04 smithi086 bash[24289]: cluster 2024-09-16T11:03:03.692120+0000 mgr.a (mgr.14373) 14096 : cluster [DBG] pgmap v9775: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:03:05.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:03:04 smithi047 bash[22744]: audit 2024-09-16T11:03:03.495420+0000 mgr.a (mgr.14373) 14095 : audit [DBG] from='client.305685 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:03:05.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:03:04 smithi047 bash[22744]: cluster 2024-09-16T11:03:03.692120+0000 mgr.a (mgr.14373) 14096 : cluster [DBG] pgmap v9775: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:03:07.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:03:06 smithi157 bash[24585]: cluster 2024-09-16T11:03:05.692995+0000 mgr.a (mgr.14373) 14097 : cluster [DBG] pgmap v9776: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:03:07.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:03:06 smithi086 bash[24289]: cluster 2024-09-16T11:03:05.692995+0000 mgr.a (mgr.14373) 14097 : cluster [DBG] pgmap v9776: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:03:07.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:03:06 smithi047 bash[22744]: cluster 2024-09-16T11:03:05.692995+0000 mgr.a (mgr.14373) 14097 : cluster [DBG] pgmap v9776: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:03:08.924 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:03:08.924 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:03:08.924 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:03:09.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:03:08 smithi157 bash[24585]: cluster 2024-09-16T11:03:07.695274+0000 mgr.a (mgr.14373) 14098 : cluster [DBG] pgmap v9777: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:03:09.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:03:08 smithi086 bash[24289]: cluster 2024-09-16T11:03:07.695274+0000 mgr.a (mgr.14373) 14098 : cluster [DBG] pgmap v9777: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:03:09.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:03:08 smithi047 bash[22744]: cluster 2024-09-16T11:03:07.695274+0000 mgr.a (mgr.14373) 14098 : cluster [DBG] pgmap v9777: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:03:09.704 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:03:09.704 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:03:09.705 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:03:09.705 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:03:09.705 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:03:11.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:03:10 smithi157 bash[24585]: audit 2024-09-16T11:03:09.260871+0000 mgr.a (mgr.14373) 14099 : audit [DBG] from='client.305763 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:03:11.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:03:10 smithi157 bash[24585]: cluster 2024-09-16T11:03:09.695757+0000 mgr.a (mgr.14373) 14100 : cluster [DBG] pgmap v9778: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:03:11.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:03:10 smithi086 bash[24289]: audit 2024-09-16T11:03:09.260871+0000 mgr.a (mgr.14373) 14099 : audit [DBG] from='client.305763 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:03:11.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:03:10 smithi086 bash[24289]: cluster 2024-09-16T11:03:09.695757+0000 mgr.a (mgr.14373) 14100 : cluster [DBG] pgmap v9778: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:03:11.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:03:10 smithi047 bash[22744]: audit 2024-09-16T11:03:09.260871+0000 mgr.a (mgr.14373) 14099 : audit [DBG] from='client.305763 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:03:11.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:03:10 smithi047 bash[22744]: cluster 2024-09-16T11:03:09.695757+0000 mgr.a (mgr.14373) 14100 : cluster [DBG] pgmap v9778: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:03:13.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:03:12 smithi157 bash[24585]: cluster 2024-09-16T11:03:11.697839+0000 mgr.a (mgr.14373) 14101 : cluster [DBG] pgmap v9779: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:03:13.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:03:12 smithi086 bash[24289]: cluster 2024-09-16T11:03:11.697839+0000 mgr.a (mgr.14373) 14101 : cluster [DBG] pgmap v9779: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:03:13.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:03:12 smithi047 bash[22744]: cluster 2024-09-16T11:03:11.697839+0000 mgr.a (mgr.14373) 14101 : cluster [DBG] pgmap v9779: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:03:14.706 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:03:14.706 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:03:14.707 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:03:15.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:03:14 smithi157 bash[24585]: cluster 2024-09-16T11:03:13.698624+0000 mgr.a (mgr.14373) 14102 : cluster [DBG] pgmap v9780: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:03:15.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:03:14 smithi086 bash[24289]: cluster 2024-09-16T11:03:13.698624+0000 mgr.a (mgr.14373) 14102 : cluster [DBG] pgmap v9780: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:03:15.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:03:14 smithi047 bash[22744]: cluster 2024-09-16T11:03:13.698624+0000 mgr.a (mgr.14373) 14102 : cluster [DBG] pgmap v9780: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:03:15.468 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:03:15.469 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:03:15.469 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:03:15.469 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:03:15.469 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:03:17.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:03:16 smithi157 bash[24585]: audit 2024-09-16T11:03:15.042865+0000 mgr.a (mgr.14373) 14103 : audit [DBG] from='client.305841 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:03:17.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:03:16 smithi157 bash[24585]: cluster 2024-09-16T11:03:15.699483+0000 mgr.a (mgr.14373) 14104 : cluster [DBG] pgmap v9781: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:03:17.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:03:16 smithi086 bash[24289]: audit 2024-09-16T11:03:15.042865+0000 mgr.a (mgr.14373) 14103 : audit [DBG] from='client.305841 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:03:17.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:03:16 smithi086 bash[24289]: cluster 2024-09-16T11:03:15.699483+0000 mgr.a (mgr.14373) 14104 : cluster [DBG] pgmap v9781: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:03:17.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:03:16 smithi047 bash[22744]: audit 2024-09-16T11:03:15.042865+0000 mgr.a (mgr.14373) 14103 : audit [DBG] from='client.305841 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:03:17.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:03:16 smithi047 bash[22744]: cluster 2024-09-16T11:03:15.699483+0000 mgr.a (mgr.14373) 14104 : cluster [DBG] pgmap v9781: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:03:19.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:03:18 smithi157 bash[24585]: cluster 2024-09-16T11:03:17.701684+0000 mgr.a (mgr.14373) 14105 : cluster [DBG] pgmap v9782: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:03:19.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:03:18 smithi086 bash[24289]: cluster 2024-09-16T11:03:17.701684+0000 mgr.a (mgr.14373) 14105 : cluster [DBG] pgmap v9782: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:03:19.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:03:18 smithi047 bash[22744]: cluster 2024-09-16T11:03:17.701684+0000 mgr.a (mgr.14373) 14105 : cluster [DBG] pgmap v9782: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:03:20.470 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:03:20.471 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:03:20.471 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:03:21.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:03:20 smithi157 bash[24585]: cluster 2024-09-16T11:03:19.702468+0000 mgr.a (mgr.14373) 14106 : cluster [DBG] pgmap v9783: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:03:21.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:03:20 smithi086 bash[24289]: cluster 2024-09-16T11:03:19.702468+0000 mgr.a (mgr.14373) 14106 : cluster [DBG] pgmap v9783: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:03:21.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:03:20 smithi047 bash[22744]: cluster 2024-09-16T11:03:19.702468+0000 mgr.a (mgr.14373) 14106 : cluster [DBG] pgmap v9783: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:03:21.253 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:03:21.253 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:03:21.253 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:03:21.254 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:03:21.254 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:03:22.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:03:21 smithi157 bash[24585]: audit 2024-09-16T11:03:20.807074+0000 mgr.a (mgr.14373) 14107 : audit [DBG] from='client.305919 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:03:22.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:03:21 smithi086 bash[24289]: audit 2024-09-16T11:03:20.807074+0000 mgr.a (mgr.14373) 14107 : audit [DBG] from='client.305919 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:03:22.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:03:21 smithi047 bash[22744]: audit 2024-09-16T11:03:20.807074+0000 mgr.a (mgr.14373) 14107 : audit [DBG] from='client.305919 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:03:23.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:03:22 smithi086 bash[24289]: cluster 2024-09-16T11:03:21.704715+0000 mgr.a (mgr.14373) 14108 : cluster [DBG] pgmap v9784: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:03:23.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:03:22 smithi047 bash[22744]: cluster 2024-09-16T11:03:21.704715+0000 mgr.a (mgr.14373) 14108 : cluster [DBG] pgmap v9784: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:03:23.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:03:22 smithi157 bash[24585]: cluster 2024-09-16T11:03:21.704715+0000 mgr.a (mgr.14373) 14108 : cluster [DBG] pgmap v9784: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:03:25.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:03:24 smithi086 bash[24289]: cluster 2024-09-16T11:03:23.705478+0000 mgr.a (mgr.14373) 14109 : cluster [DBG] pgmap v9785: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:03:25.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:03:24 smithi047 bash[22744]: cluster 2024-09-16T11:03:23.705478+0000 mgr.a (mgr.14373) 14109 : cluster [DBG] pgmap v9785: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:03:25.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:03:24 smithi157 bash[24585]: cluster 2024-09-16T11:03:23.705478+0000 mgr.a (mgr.14373) 14109 : cluster [DBG] pgmap v9785: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:03:26.255 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:03:26.256 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:03:26.256 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:03:27.013 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:03:27.013 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:03:27.013 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:03:27.013 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:03:27.013 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:03:27.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:03:26 smithi086 bash[24289]: cluster 2024-09-16T11:03:25.706214+0000 mgr.a (mgr.14373) 14110 : cluster [DBG] pgmap v9786: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:03:27.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:03:26 smithi047 bash[22744]: cluster 2024-09-16T11:03:25.706214+0000 mgr.a (mgr.14373) 14110 : cluster [DBG] pgmap v9786: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:03:27.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:03:26 smithi157 bash[24585]: cluster 2024-09-16T11:03:25.706214+0000 mgr.a (mgr.14373) 14110 : cluster [DBG] pgmap v9786: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:03:28.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:03:27 smithi086 bash[24289]: audit 2024-09-16T11:03:26.584468+0000 mgr.a (mgr.14373) 14111 : audit [DBG] from='client.305997 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:03:28.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:03:27 smithi047 bash[22744]: audit 2024-09-16T11:03:26.584468+0000 mgr.a (mgr.14373) 14111 : audit [DBG] from='client.305997 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:03:28.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:03:27 smithi157 bash[24585]: audit 2024-09-16T11:03:26.584468+0000 mgr.a (mgr.14373) 14111 : audit [DBG] from='client.305997 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:03:29.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:03:28 smithi047 bash[22744]: cluster 2024-09-16T11:03:27.708899+0000 mgr.a (mgr.14373) 14112 : cluster [DBG] pgmap v9787: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:03:29.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:03:28 smithi157 bash[24585]: cluster 2024-09-16T11:03:27.708899+0000 mgr.a (mgr.14373) 14112 : cluster [DBG] pgmap v9787: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:03:29.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:03:28 smithi086 bash[24289]: cluster 2024-09-16T11:03:27.708899+0000 mgr.a (mgr.14373) 14112 : cluster [DBG] pgmap v9787: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:03:31.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:03:30 smithi047 bash[22744]: cluster 2024-09-16T11:03:29.709647+0000 mgr.a (mgr.14373) 14113 : cluster [DBG] pgmap v9788: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:03:31.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:03:30 smithi157 bash[24585]: cluster 2024-09-16T11:03:29.709647+0000 mgr.a (mgr.14373) 14113 : cluster [DBG] pgmap v9788: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:03:31.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:03:30 smithi086 bash[24289]: cluster 2024-09-16T11:03:29.709647+0000 mgr.a (mgr.14373) 14113 : cluster [DBG] pgmap v9788: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:03:32.014 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:03:32.015 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:03:32.015 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:03:32.791 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:03:32.792 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:03:32.792 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:03:32.792 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:03:32.792 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:03:33.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:03:32 smithi047 bash[22744]: cluster 2024-09-16T11:03:31.711755+0000 mgr.a (mgr.14373) 14114 : cluster [DBG] pgmap v9789: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:03:33.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:03:32 smithi157 bash[24585]: cluster 2024-09-16T11:03:31.711755+0000 mgr.a (mgr.14373) 14114 : cluster [DBG] pgmap v9789: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:03:33.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:03:32 smithi086 bash[24289]: cluster 2024-09-16T11:03:31.711755+0000 mgr.a (mgr.14373) 14114 : cluster [DBG] pgmap v9789: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:03:34.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:03:33 smithi157 bash[24585]: audit 2024-09-16T11:03:32.345186+0000 mgr.a (mgr.14373) 14115 : audit [DBG] from='client.306075 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:03:34.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:03:33 smithi086 bash[24289]: audit 2024-09-16T11:03:32.345186+0000 mgr.a (mgr.14373) 14115 : audit [DBG] from='client.306075 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:03:34.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:03:33 smithi047 bash[22744]: audit 2024-09-16T11:03:32.345186+0000 mgr.a (mgr.14373) 14115 : audit [DBG] from='client.306075 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:03:35.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:03:34 smithi157 bash[24585]: cluster 2024-09-16T11:03:33.712650+0000 mgr.a (mgr.14373) 14116 : cluster [DBG] pgmap v9790: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:03:35.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:03:34 smithi086 bash[24289]: cluster 2024-09-16T11:03:33.712650+0000 mgr.a (mgr.14373) 14116 : cluster [DBG] pgmap v9790: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:03:35.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:03:34 smithi047 bash[22744]: cluster 2024-09-16T11:03:33.712650+0000 mgr.a (mgr.14373) 14116 : cluster [DBG] pgmap v9790: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:03:37.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:03:36 smithi157 bash[24585]: cluster 2024-09-16T11:03:35.713395+0000 mgr.a (mgr.14373) 14117 : cluster [DBG] pgmap v9791: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T11:03:37.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:03:36 smithi086 bash[24289]: cluster 2024-09-16T11:03:35.713395+0000 mgr.a (mgr.14373) 14117 : cluster [DBG] pgmap v9791: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T11:03:37.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:03:36 smithi047 bash[22744]: cluster 2024-09-16T11:03:35.713395+0000 mgr.a (mgr.14373) 14117 : cluster [DBG] pgmap v9791: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T11:03:37.793 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:03:37.794 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:03:37.794 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:03:38.574 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:03:38.574 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:03:38.575 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:03:38.575 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:03:38.575 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:03:39.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:03:38 smithi157 bash[24585]: cluster 2024-09-16T11:03:37.715603+0000 mgr.a (mgr.14373) 14118 : cluster [DBG] pgmap v9792: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:03:39.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:03:38 smithi086 bash[24289]: cluster 2024-09-16T11:03:37.715603+0000 mgr.a (mgr.14373) 14118 : cluster [DBG] pgmap v9792: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:03:39.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:03:38 smithi047 bash[22744]: cluster 2024-09-16T11:03:37.715603+0000 mgr.a (mgr.14373) 14118 : cluster [DBG] pgmap v9792: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:03:40.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:03:39 smithi157 bash[24585]: audit 2024-09-16T11:03:38.130776+0000 mgr.a (mgr.14373) 14119 : audit [DBG] from='client.306153 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:03:40.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:03:39 smithi086 bash[24289]: audit 2024-09-16T11:03:38.130776+0000 mgr.a (mgr.14373) 14119 : audit [DBG] from='client.306153 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:03:40.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:03:39 smithi047 bash[22744]: audit 2024-09-16T11:03:38.130776+0000 mgr.a (mgr.14373) 14119 : audit [DBG] from='client.306153 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:03:41.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:03:40 smithi157 bash[24585]: cluster 2024-09-16T11:03:39.716480+0000 mgr.a (mgr.14373) 14120 : cluster [DBG] pgmap v9793: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:03:41.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:03:40 smithi086 bash[24289]: cluster 2024-09-16T11:03:39.716480+0000 mgr.a (mgr.14373) 14120 : cluster [DBG] pgmap v9793: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:03:41.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:03:40 smithi047 bash[22744]: cluster 2024-09-16T11:03:39.716480+0000 mgr.a (mgr.14373) 14120 : cluster [DBG] pgmap v9793: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:03:43.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:03:42 smithi157 bash[24585]: cluster 2024-09-16T11:03:41.718677+0000 mgr.a (mgr.14373) 14121 : cluster [DBG] pgmap v9794: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:03:43.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:03:42 smithi086 bash[24289]: cluster 2024-09-16T11:03:41.718677+0000 mgr.a (mgr.14373) 14121 : cluster [DBG] pgmap v9794: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:03:43.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:03:42 smithi047 bash[22744]: cluster 2024-09-16T11:03:41.718677+0000 mgr.a (mgr.14373) 14121 : cluster [DBG] pgmap v9794: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:03:43.576 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:03:43.576 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:03:43.577 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:03:44.359 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:03:44.359 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:03:44.360 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:03:44.360 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:03:44.360 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:03:45.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:03:44 smithi157 bash[24585]: cluster 2024-09-16T11:03:43.719397+0000 mgr.a (mgr.14373) 14122 : cluster [DBG] pgmap v9795: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:03:45.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:03:44 smithi086 bash[24289]: cluster 2024-09-16T11:03:43.719397+0000 mgr.a (mgr.14373) 14122 : cluster [DBG] pgmap v9795: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:03:45.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:03:44 smithi047 bash[22744]: cluster 2024-09-16T11:03:43.719397+0000 mgr.a (mgr.14373) 14122 : cluster [DBG] pgmap v9795: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:03:46.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:03:45 smithi157 bash[24585]: audit 2024-09-16T11:03:43.910461+0000 mgr.a (mgr.14373) 14123 : audit [DBG] from='client.306228 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:03:46.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:03:45 smithi157 bash[24585]: audit 2024-09-16T11:03:45.563822+0000 mon.b (mon.2) 1290 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T11:03:46.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:03:45 smithi086 bash[24289]: audit 2024-09-16T11:03:43.910461+0000 mgr.a (mgr.14373) 14123 : audit [DBG] from='client.306228 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:03:46.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:03:45 smithi086 bash[24289]: audit 2024-09-16T11:03:45.563822+0000 mon.b (mon.2) 1290 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T11:03:46.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:03:45 smithi047 bash[22744]: audit 2024-09-16T11:03:43.910461+0000 mgr.a (mgr.14373) 14123 : audit [DBG] from='client.306228 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:03:46.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:03:45 smithi047 bash[22744]: audit 2024-09-16T11:03:45.563822+0000 mon.b (mon.2) 1290 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T11:03:47.161 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:03:46 smithi047 bash[22744]: cluster 2024-09-16T11:03:45.720286+0000 mgr.a (mgr.14373) 14124 : cluster [DBG] pgmap v9796: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:03:47.161 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:03:46 smithi047 bash[22744]: audit 2024-09-16T11:03:46.399861+0000 mon.b (mon.2) 1291 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T11:03:47.161 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:03:46 smithi047 bash[22744]: audit 2024-09-16T11:03:46.401883+0000 mon.b (mon.2) 1292 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T11:03:47.161 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:03:46 smithi047 bash[22744]: audit 2024-09-16T11:03:46.413138+0000 mon.a (mon.0) 1407 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:03:47.161 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:03:46 smithi047 bash[22744]: audit 2024-09-16T11:03:46.418373+0000 mon.b (mon.2) 1293 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:03:47.161 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:03:46 smithi047 bash[22744]: audit 2024-09-16T11:03:46.420193+0000 mgr.a (mgr.14373) 14125 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:03:47.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:03:46 smithi157 bash[24585]: cluster 2024-09-16T11:03:45.720286+0000 mgr.a (mgr.14373) 14124 : cluster [DBG] pgmap v9796: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:03:47.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:03:46 smithi157 bash[24585]: audit 2024-09-16T11:03:46.399861+0000 mon.b (mon.2) 1291 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T11:03:47.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:03:46 smithi157 bash[24585]: audit 2024-09-16T11:03:46.401883+0000 mon.b (mon.2) 1292 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T11:03:47.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:03:46 smithi157 bash[24585]: audit 2024-09-16T11:03:46.413138+0000 mon.a (mon.0) 1407 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:03:47.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:03:46 smithi157 bash[24585]: audit 2024-09-16T11:03:46.418373+0000 mon.b (mon.2) 1293 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:03:47.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:03:46 smithi157 bash[24585]: audit 2024-09-16T11:03:46.420193+0000 mgr.a (mgr.14373) 14125 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:03:47.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:03:46 smithi086 bash[24289]: cluster 2024-09-16T11:03:45.720286+0000 mgr.a (mgr.14373) 14124 : cluster [DBG] pgmap v9796: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:03:47.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:03:46 smithi086 bash[24289]: audit 2024-09-16T11:03:46.399861+0000 mon.b (mon.2) 1291 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T11:03:47.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:03:46 smithi086 bash[24289]: audit 2024-09-16T11:03:46.401883+0000 mon.b (mon.2) 1292 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T11:03:47.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:03:46 smithi086 bash[24289]: audit 2024-09-16T11:03:46.413138+0000 mon.a (mon.0) 1407 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:03:47.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:03:46 smithi086 bash[24289]: audit 2024-09-16T11:03:46.418373+0000 mon.b (mon.2) 1293 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:03:47.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:03:46 smithi086 bash[24289]: audit 2024-09-16T11:03:46.420193+0000 mgr.a (mgr.14373) 14125 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:03:47.592 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 11:03:47 smithi047 bash[22994]: debug 2024-09-16T11:03:47.155+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T11:03:47.593 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 11:03:47 smithi047 bash[22994]: debug 2024-09-16T11:03:47.155+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T11:03:48.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:03:47 smithi157 bash[24585]: audit 2024-09-16T11:03:47.159564+0000 mgr.a (mgr.14373) 14126 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T11:03:48.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:03:47 smithi157 bash[24585]: cephadm 2024-09-16T11:03:47.161730+0000 mgr.a (mgr.14373) 14127 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T11:03:48.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:03:47 smithi157 bash[24585]: cluster 2024-09-16T11:03:47.723063+0000 mgr.a (mgr.14373) 14128 : cluster [DBG] pgmap v9797: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 3.2 KiB/s rd, 2 op/s 2024-09-16T11:03:48.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:03:47 smithi086 bash[24289]: audit 2024-09-16T11:03:47.159564+0000 mgr.a (mgr.14373) 14126 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T11:03:48.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:03:47 smithi086 bash[24289]: cephadm 2024-09-16T11:03:47.161730+0000 mgr.a (mgr.14373) 14127 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T11:03:48.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:03:47 smithi086 bash[24289]: cluster 2024-09-16T11:03:47.723063+0000 mgr.a (mgr.14373) 14128 : cluster [DBG] pgmap v9797: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 3.2 KiB/s rd, 2 op/s 2024-09-16T11:03:48.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:03:47 smithi047 bash[22744]: audit 2024-09-16T11:03:47.159564+0000 mgr.a (mgr.14373) 14126 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T11:03:48.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:03:47 smithi047 bash[22744]: cephadm 2024-09-16T11:03:47.161730+0000 mgr.a (mgr.14373) 14127 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T11:03:48.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:03:47 smithi047 bash[22744]: cluster 2024-09-16T11:03:47.723063+0000 mgr.a (mgr.14373) 14128 : cluster [DBG] pgmap v9797: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 3.2 KiB/s rd, 2 op/s 2024-09-16T11:03:49.361 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:03:49.362 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:03:49.362 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:03:50.148 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:03:50.148 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:03:50.148 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:03:50.148 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:03:50.148 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:03:51.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:03:50 smithi157 bash[24585]: audit 2024-09-16T11:03:49.696714+0000 mgr.a (mgr.14373) 14129 : audit [DBG] from='client.306411 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:03:51.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:03:50 smithi157 bash[24585]: cluster 2024-09-16T11:03:49.723969+0000 mgr.a (mgr.14373) 14130 : cluster [DBG] pgmap v9798: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-16T11:03:51.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:03:50 smithi086 bash[24289]: audit 2024-09-16T11:03:49.696714+0000 mgr.a (mgr.14373) 14129 : audit [DBG] from='client.306411 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:03:51.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:03:50 smithi086 bash[24289]: cluster 2024-09-16T11:03:49.723969+0000 mgr.a (mgr.14373) 14130 : cluster [DBG] pgmap v9798: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-16T11:03:51.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:03:50 smithi047 bash[22744]: audit 2024-09-16T11:03:49.696714+0000 mgr.a (mgr.14373) 14129 : audit [DBG] from='client.306411 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:03:51.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:03:50 smithi047 bash[22744]: cluster 2024-09-16T11:03:49.723969+0000 mgr.a (mgr.14373) 14130 : cluster [DBG] pgmap v9798: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-16T11:03:53.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:03:52 smithi157 bash[24585]: cluster 2024-09-16T11:03:51.726303+0000 mgr.a (mgr.14373) 14131 : cluster [DBG] pgmap v9799: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:03:53.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:03:52 smithi086 bash[24289]: cluster 2024-09-16T11:03:51.726303+0000 mgr.a (mgr.14373) 14131 : cluster [DBG] pgmap v9799: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:03:53.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:03:52 smithi047 bash[22744]: cluster 2024-09-16T11:03:51.726303+0000 mgr.a (mgr.14373) 14131 : cluster [DBG] pgmap v9799: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:03:55.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:03:54 smithi157 bash[24585]: cluster 2024-09-16T11:03:53.727067+0000 mgr.a (mgr.14373) 14132 : cluster [DBG] pgmap v9800: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:03:55.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:03:54 smithi086 bash[24289]: cluster 2024-09-16T11:03:53.727067+0000 mgr.a (mgr.14373) 14132 : cluster [DBG] pgmap v9800: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:03:55.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:03:54 smithi047 bash[22744]: cluster 2024-09-16T11:03:53.727067+0000 mgr.a (mgr.14373) 14132 : cluster [DBG] pgmap v9800: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:03:55.149 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:03:55.150 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:03:55.150 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:03:55.926 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:03:55.926 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:03:55.926 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:03:55.926 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:03:55.926 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:03:57.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:03:56 smithi157 bash[24585]: audit 2024-09-16T11:03:55.486873+0000 mgr.a (mgr.14373) 14133 : audit [DBG] from='client.306489 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:03:57.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:03:56 smithi157 bash[24585]: cluster 2024-09-16T11:03:55.727929+0000 mgr.a (mgr.14373) 14134 : cluster [DBG] pgmap v9801: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:03:57.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:03:56 smithi086 bash[24289]: audit 2024-09-16T11:03:55.486873+0000 mgr.a (mgr.14373) 14133 : audit [DBG] from='client.306489 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:03:57.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:03:56 smithi086 bash[24289]: cluster 2024-09-16T11:03:55.727929+0000 mgr.a (mgr.14373) 14134 : cluster [DBG] pgmap v9801: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:03:57.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:03:56 smithi047 bash[22744]: audit 2024-09-16T11:03:55.486873+0000 mgr.a (mgr.14373) 14133 : audit [DBG] from='client.306489 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:03:57.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:03:56 smithi047 bash[22744]: cluster 2024-09-16T11:03:55.727929+0000 mgr.a (mgr.14373) 14134 : cluster [DBG] pgmap v9801: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:03:59.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:03:58 smithi157 bash[24585]: cluster 2024-09-16T11:03:57.730378+0000 mgr.a (mgr.14373) 14135 : cluster [DBG] pgmap v9802: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:03:59.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:03:58 smithi086 bash[24289]: cluster 2024-09-16T11:03:57.730378+0000 mgr.a (mgr.14373) 14135 : cluster [DBG] pgmap v9802: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:03:59.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:03:58 smithi047 bash[22744]: cluster 2024-09-16T11:03:57.730378+0000 mgr.a (mgr.14373) 14135 : cluster [DBG] pgmap v9802: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:04:00.927 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:04:00.928 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:04:00.928 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:04:01.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:04:00 smithi157 bash[24585]: cluster 2024-09-16T11:03:59.731157+0000 mgr.a (mgr.14373) 14136 : cluster [DBG] pgmap v9803: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T11:04:01.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:04:00 smithi086 bash[24289]: cluster 2024-09-16T11:03:59.731157+0000 mgr.a (mgr.14373) 14136 : cluster [DBG] pgmap v9803: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T11:04:01.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:04:00 smithi047 bash[22744]: cluster 2024-09-16T11:03:59.731157+0000 mgr.a (mgr.14373) 14136 : cluster [DBG] pgmap v9803: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T11:04:01.697 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:04:01.697 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:04:01.697 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:04:01.697 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:04:01.698 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:04:03.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:04:02 smithi086 bash[24289]: audit 2024-09-16T11:04:01.258039+0000 mgr.a (mgr.14373) 14137 : audit [DBG] from='client.306564 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:04:03.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:04:02 smithi086 bash[24289]: cluster 2024-09-16T11:04:01.732525+0000 mgr.a (mgr.14373) 14138 : cluster [DBG] pgmap v9804: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 6.8 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T11:04:03.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:04:02 smithi047 bash[22744]: audit 2024-09-16T11:04:01.258039+0000 mgr.a (mgr.14373) 14137 : audit [DBG] from='client.306564 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:04:03.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:04:02 smithi047 bash[22744]: cluster 2024-09-16T11:04:01.732525+0000 mgr.a (mgr.14373) 14138 : cluster [DBG] pgmap v9804: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 6.8 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T11:04:03.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:04:02 smithi157 bash[24585]: audit 2024-09-16T11:04:01.258039+0000 mgr.a (mgr.14373) 14137 : audit [DBG] from='client.306564 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:04:03.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:04:02 smithi157 bash[24585]: cluster 2024-09-16T11:04:01.732525+0000 mgr.a (mgr.14373) 14138 : cluster [DBG] pgmap v9804: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 6.8 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T11:04:05.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:04:04 smithi086 bash[24289]: cluster 2024-09-16T11:04:03.733239+0000 mgr.a (mgr.14373) 14139 : cluster [DBG] pgmap v9805: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T11:04:05.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:04:04 smithi047 bash[22744]: cluster 2024-09-16T11:04:03.733239+0000 mgr.a (mgr.14373) 14139 : cluster [DBG] pgmap v9805: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T11:04:05.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:04:04 smithi157 bash[24585]: cluster 2024-09-16T11:04:03.733239+0000 mgr.a (mgr.14373) 14139 : cluster [DBG] pgmap v9805: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T11:04:06.698 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:04:06.699 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:04:06.699 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:04:07.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:04:06 smithi086 bash[24289]: cluster 2024-09-16T11:04:05.733987+0000 mgr.a (mgr.14373) 14140 : cluster [DBG] pgmap v9806: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T11:04:07.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:04:06 smithi047 bash[22744]: cluster 2024-09-16T11:04:05.733987+0000 mgr.a (mgr.14373) 14140 : cluster [DBG] pgmap v9806: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T11:04:07.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:04:06 smithi157 bash[24585]: cluster 2024-09-16T11:04:05.733987+0000 mgr.a (mgr.14373) 14140 : cluster [DBG] pgmap v9806: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T11:04:07.445 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:04:07.445 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:04:07.446 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:04:07.446 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:04:07.446 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:04:09.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:04:08 smithi086 bash[24289]: audit 2024-09-16T11:04:07.029491+0000 mgr.a (mgr.14373) 14141 : audit [DBG] from='client.306642 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:04:09.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:04:08 smithi086 bash[24289]: cluster 2024-09-16T11:04:07.736777+0000 mgr.a (mgr.14373) 14142 : cluster [DBG] pgmap v9807: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:04:09.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:04:08 smithi047 bash[22744]: audit 2024-09-16T11:04:07.029491+0000 mgr.a (mgr.14373) 14141 : audit [DBG] from='client.306642 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:04:09.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:04:08 smithi047 bash[22744]: cluster 2024-09-16T11:04:07.736777+0000 mgr.a (mgr.14373) 14142 : cluster [DBG] pgmap v9807: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:04:09.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:04:08 smithi157 bash[24585]: audit 2024-09-16T11:04:07.029491+0000 mgr.a (mgr.14373) 14141 : audit [DBG] from='client.306642 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:04:09.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:04:08 smithi157 bash[24585]: cluster 2024-09-16T11:04:07.736777+0000 mgr.a (mgr.14373) 14142 : cluster [DBG] pgmap v9807: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:04:11.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:04:10 smithi047 bash[22744]: cluster 2024-09-16T11:04:09.737564+0000 mgr.a (mgr.14373) 14143 : cluster [DBG] pgmap v9808: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:04:11.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:04:10 smithi157 bash[24585]: cluster 2024-09-16T11:04:09.737564+0000 mgr.a (mgr.14373) 14143 : cluster [DBG] pgmap v9808: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:04:11.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:04:10 smithi086 bash[24289]: cluster 2024-09-16T11:04:09.737564+0000 mgr.a (mgr.14373) 14143 : cluster [DBG] pgmap v9808: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:04:12.447 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:04:12.448 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:04:12.448 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:04:13.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:04:12 smithi047 bash[22744]: cluster 2024-09-16T11:04:11.739556+0000 mgr.a (mgr.14373) 14144 : cluster [DBG] pgmap v9809: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:04:13.235 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:04:13.235 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:04:13.235 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:04:13.235 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:04:13.235 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:04:13.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:04:12 smithi157 bash[24585]: cluster 2024-09-16T11:04:11.739556+0000 mgr.a (mgr.14373) 14144 : cluster [DBG] pgmap v9809: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:04:13.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:04:12 smithi086 bash[24289]: cluster 2024-09-16T11:04:11.739556+0000 mgr.a (mgr.14373) 14144 : cluster [DBG] pgmap v9809: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:04:14.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:04:13 smithi047 bash[22744]: audit 2024-09-16T11:04:12.783224+0000 mgr.a (mgr.14373) 14145 : audit [DBG] from='client.306717 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:04:14.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:04:13 smithi157 bash[24585]: audit 2024-09-16T11:04:12.783224+0000 mgr.a (mgr.14373) 14145 : audit [DBG] from='client.306717 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:04:14.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:04:13 smithi086 bash[24289]: audit 2024-09-16T11:04:12.783224+0000 mgr.a (mgr.14373) 14145 : audit [DBG] from='client.306717 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:04:15.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:04:14 smithi047 bash[22744]: cluster 2024-09-16T11:04:13.740563+0000 mgr.a (mgr.14373) 14146 : cluster [DBG] pgmap v9810: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-16T11:04:15.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:04:14 smithi157 bash[24585]: cluster 2024-09-16T11:04:13.740563+0000 mgr.a (mgr.14373) 14146 : cluster [DBG] pgmap v9810: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-16T11:04:15.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:04:14 smithi086 bash[24289]: cluster 2024-09-16T11:04:13.740563+0000 mgr.a (mgr.14373) 14146 : cluster [DBG] pgmap v9810: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-16T11:04:17.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:04:16 smithi157 bash[24585]: cluster 2024-09-16T11:04:15.741355+0000 mgr.a (mgr.14373) 14147 : cluster [DBG] pgmap v9811: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-16T11:04:17.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:04:16 smithi086 bash[24289]: cluster 2024-09-16T11:04:15.741355+0000 mgr.a (mgr.14373) 14147 : cluster [DBG] pgmap v9811: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-16T11:04:17.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:04:16 smithi047 bash[22744]: cluster 2024-09-16T11:04:15.741355+0000 mgr.a (mgr.14373) 14147 : cluster [DBG] pgmap v9811: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-16T11:04:18.236 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:04:18.237 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:04:18.237 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:04:19.020 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:04:19.020 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:04:19.021 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:04:19.021 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:04:19.021 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:04:19.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:04:18 smithi157 bash[24585]: cluster 2024-09-16T11:04:17.743589+0000 mgr.a (mgr.14373) 14148 : cluster [DBG] pgmap v9812: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-16T11:04:19.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:04:18 smithi086 bash[24289]: cluster 2024-09-16T11:04:17.743589+0000 mgr.a (mgr.14373) 14148 : cluster [DBG] pgmap v9812: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-16T11:04:19.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:04:18 smithi047 bash[22744]: cluster 2024-09-16T11:04:17.743589+0000 mgr.a (mgr.14373) 14148 : cluster [DBG] pgmap v9812: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-16T11:04:20.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:04:19 smithi157 bash[24585]: audit 2024-09-16T11:04:18.568512+0000 mgr.a (mgr.14373) 14149 : audit [DBG] from='client.306795 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:04:20.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:04:19 smithi086 bash[24289]: audit 2024-09-16T11:04:18.568512+0000 mgr.a (mgr.14373) 14149 : audit [DBG] from='client.306795 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:04:20.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:04:19 smithi047 bash[22744]: audit 2024-09-16T11:04:18.568512+0000 mgr.a (mgr.14373) 14149 : audit [DBG] from='client.306795 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:04:21.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:04:20 smithi157 bash[24585]: cluster 2024-09-16T11:04:19.744525+0000 mgr.a (mgr.14373) 14150 : cluster [DBG] pgmap v9813: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:04:21.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:04:20 smithi086 bash[24289]: cluster 2024-09-16T11:04:19.744525+0000 mgr.a (mgr.14373) 14150 : cluster [DBG] pgmap v9813: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:04:21.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:04:20 smithi047 bash[22744]: cluster 2024-09-16T11:04:19.744525+0000 mgr.a (mgr.14373) 14150 : cluster [DBG] pgmap v9813: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:04:23.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:04:22 smithi157 bash[24585]: cluster 2024-09-16T11:04:21.746755+0000 mgr.a (mgr.14373) 14151 : cluster [DBG] pgmap v9814: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:04:23.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:04:22 smithi086 bash[24289]: cluster 2024-09-16T11:04:21.746755+0000 mgr.a (mgr.14373) 14151 : cluster [DBG] pgmap v9814: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:04:23.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:04:22 smithi047 bash[22744]: cluster 2024-09-16T11:04:21.746755+0000 mgr.a (mgr.14373) 14151 : cluster [DBG] pgmap v9814: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:04:24.021 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:04:24.022 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:04:24.022 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:04:24.782 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:04:24.782 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:04:24.782 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:04:24.782 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:04:24.782 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:04:25.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:04:24 smithi157 bash[24585]: cluster 2024-09-16T11:04:23.747526+0000 mgr.a (mgr.14373) 14152 : cluster [DBG] pgmap v9815: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:04:25.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:04:24 smithi086 bash[24289]: cluster 2024-09-16T11:04:23.747526+0000 mgr.a (mgr.14373) 14152 : cluster [DBG] pgmap v9815: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:04:25.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:04:24 smithi047 bash[22744]: cluster 2024-09-16T11:04:23.747526+0000 mgr.a (mgr.14373) 14152 : cluster [DBG] pgmap v9815: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:04:26.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:04:25 smithi157 bash[24585]: audit 2024-09-16T11:04:24.352182+0000 mgr.a (mgr.14373) 14153 : audit [DBG] from='client.306867 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:04:26.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:04:25 smithi086 bash[24289]: audit 2024-09-16T11:04:24.352182+0000 mgr.a (mgr.14373) 14153 : audit [DBG] from='client.306867 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:04:26.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:04:25 smithi047 bash[22744]: audit 2024-09-16T11:04:24.352182+0000 mgr.a (mgr.14373) 14153 : audit [DBG] from='client.306867 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:04:27.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:04:26 smithi157 bash[24585]: cluster 2024-09-16T11:04:25.748484+0000 mgr.a (mgr.14373) 14154 : cluster [DBG] pgmap v9816: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:04:27.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:04:26 smithi086 bash[24289]: cluster 2024-09-16T11:04:25.748484+0000 mgr.a (mgr.14373) 14154 : cluster [DBG] pgmap v9816: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:04:27.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:04:26 smithi047 bash[22744]: cluster 2024-09-16T11:04:25.748484+0000 mgr.a (mgr.14373) 14154 : cluster [DBG] pgmap v9816: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:04:29.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:04:28 smithi157 bash[24585]: cluster 2024-09-16T11:04:27.750736+0000 mgr.a (mgr.14373) 14155 : cluster [DBG] pgmap v9817: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:04:29.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:04:28 smithi086 bash[24289]: cluster 2024-09-16T11:04:27.750736+0000 mgr.a (mgr.14373) 14155 : cluster [DBG] pgmap v9817: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:04:29.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:04:28 smithi047 bash[22744]: cluster 2024-09-16T11:04:27.750736+0000 mgr.a (mgr.14373) 14155 : cluster [DBG] pgmap v9817: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:04:29.783 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:04:29.784 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:04:29.784 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:04:30.562 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:04:30.562 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:04:30.563 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:04:30.563 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:04:30.563 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:04:31.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:04:30 smithi157 bash[24585]: cluster 2024-09-16T11:04:29.751511+0000 mgr.a (mgr.14373) 14156 : cluster [DBG] pgmap v9818: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:04:31.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:04:30 smithi086 bash[24289]: cluster 2024-09-16T11:04:29.751511+0000 mgr.a (mgr.14373) 14156 : cluster [DBG] pgmap v9818: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:04:31.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:04:30 smithi047 bash[22744]: cluster 2024-09-16T11:04:29.751511+0000 mgr.a (mgr.14373) 14156 : cluster [DBG] pgmap v9818: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:04:32.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:04:31 smithi157 bash[24585]: audit 2024-09-16T11:04:30.120523+0000 mgr.a (mgr.14373) 14157 : audit [DBG] from='client.306945 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:04:32.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:04:31 smithi086 bash[24289]: audit 2024-09-16T11:04:30.120523+0000 mgr.a (mgr.14373) 14157 : audit [DBG] from='client.306945 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:04:32.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:04:31 smithi047 bash[22744]: audit 2024-09-16T11:04:30.120523+0000 mgr.a (mgr.14373) 14157 : audit [DBG] from='client.306945 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:04:33.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:04:32 smithi157 bash[24585]: cluster 2024-09-16T11:04:31.753814+0000 mgr.a (mgr.14373) 14158 : cluster [DBG] pgmap v9819: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:04:33.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:04:32 smithi086 bash[24289]: cluster 2024-09-16T11:04:31.753814+0000 mgr.a (mgr.14373) 14158 : cluster [DBG] pgmap v9819: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:04:33.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:04:32 smithi047 bash[22744]: cluster 2024-09-16T11:04:31.753814+0000 mgr.a (mgr.14373) 14158 : cluster [DBG] pgmap v9819: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:04:34.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:04:33 smithi157 bash[24585]: cluster 2024-09-16T11:04:33.754636+0000 mgr.a (mgr.14373) 14159 : cluster [DBG] pgmap v9820: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:04:34.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:04:33 smithi086 bash[24289]: cluster 2024-09-16T11:04:33.754636+0000 mgr.a (mgr.14373) 14159 : cluster [DBG] pgmap v9820: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:04:34.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:04:33 smithi047 bash[22744]: cluster 2024-09-16T11:04:33.754636+0000 mgr.a (mgr.14373) 14159 : cluster [DBG] pgmap v9820: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:04:35.564 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:04:35.564 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:04:35.564 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:04:36.350 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:04:36.351 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:04:36.351 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:04:36.351 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:04:36.351 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:04:37.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:04:36 smithi086 bash[24289]: cluster 2024-09-16T11:04:35.755342+0000 mgr.a (mgr.14373) 14160 : cluster [DBG] pgmap v9821: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:04:37.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:04:36 smithi047 bash[22744]: cluster 2024-09-16T11:04:35.755342+0000 mgr.a (mgr.14373) 14160 : cluster [DBG] pgmap v9821: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:04:37.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:04:36 smithi157 bash[24585]: cluster 2024-09-16T11:04:35.755342+0000 mgr.a (mgr.14373) 14160 : cluster [DBG] pgmap v9821: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:04:38.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:04:37 smithi047 bash[22744]: audit 2024-09-16T11:04:35.901180+0000 mgr.a (mgr.14373) 14161 : audit [DBG] from='client.307017 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:04:38.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:04:37 smithi157 bash[24585]: audit 2024-09-16T11:04:35.901180+0000 mgr.a (mgr.14373) 14161 : audit [DBG] from='client.307017 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:04:38.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:04:37 smithi086 bash[24289]: audit 2024-09-16T11:04:35.901180+0000 mgr.a (mgr.14373) 14161 : audit [DBG] from='client.307017 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:04:39.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:04:38 smithi047 bash[22744]: cluster 2024-09-16T11:04:37.757744+0000 mgr.a (mgr.14373) 14162 : cluster [DBG] pgmap v9822: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:04:39.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:04:38 smithi157 bash[24585]: cluster 2024-09-16T11:04:37.757744+0000 mgr.a (mgr.14373) 14162 : cluster [DBG] pgmap v9822: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:04:39.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:04:38 smithi086 bash[24289]: cluster 2024-09-16T11:04:37.757744+0000 mgr.a (mgr.14373) 14162 : cluster [DBG] pgmap v9822: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:04:41.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:04:40 smithi047 bash[22744]: cluster 2024-09-16T11:04:39.758559+0000 mgr.a (mgr.14373) 14163 : cluster [DBG] pgmap v9823: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:04:41.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:04:40 smithi157 bash[24585]: cluster 2024-09-16T11:04:39.758559+0000 mgr.a (mgr.14373) 14163 : cluster [DBG] pgmap v9823: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:04:41.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:04:40 smithi086 bash[24289]: cluster 2024-09-16T11:04:39.758559+0000 mgr.a (mgr.14373) 14163 : cluster [DBG] pgmap v9823: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:04:41.352 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:04:41.353 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:04:41.353 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:04:42.109 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:04:42.110 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:04:42.110 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:04:42.110 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:04:42.110 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:04:43.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:04:42 smithi047 bash[22744]: audit 2024-09-16T11:04:41.685994+0000 mgr.a (mgr.14373) 14164 : audit [DBG] from='client.307095 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:04:43.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:04:42 smithi047 bash[22744]: cluster 2024-09-16T11:04:41.761120+0000 mgr.a (mgr.14373) 14165 : cluster [DBG] pgmap v9824: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:04:43.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:04:42 smithi157 bash[24585]: audit 2024-09-16T11:04:41.685994+0000 mgr.a (mgr.14373) 14164 : audit [DBG] from='client.307095 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:04:43.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:04:42 smithi157 bash[24585]: cluster 2024-09-16T11:04:41.761120+0000 mgr.a (mgr.14373) 14165 : cluster [DBG] pgmap v9824: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:04:43.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:04:42 smithi086 bash[24289]: audit 2024-09-16T11:04:41.685994+0000 mgr.a (mgr.14373) 14164 : audit [DBG] from='client.307095 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:04:43.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:04:42 smithi086 bash[24289]: cluster 2024-09-16T11:04:41.761120+0000 mgr.a (mgr.14373) 14165 : cluster [DBG] pgmap v9824: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:04:45.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:04:44 smithi047 bash[22744]: cluster 2024-09-16T11:04:43.762011+0000 mgr.a (mgr.14373) 14166 : cluster [DBG] pgmap v9825: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:04:45.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:04:44 smithi157 bash[24585]: cluster 2024-09-16T11:04:43.762011+0000 mgr.a (mgr.14373) 14166 : cluster [DBG] pgmap v9825: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:04:45.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:04:44 smithi086 bash[24289]: cluster 2024-09-16T11:04:43.762011+0000 mgr.a (mgr.14373) 14166 : cluster [DBG] pgmap v9825: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:04:47.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:04:46 smithi047 bash[22744]: cluster 2024-09-16T11:04:45.762837+0000 mgr.a (mgr.14373) 14167 : cluster [DBG] pgmap v9826: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T11:04:47.111 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:04:47.112 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:04:47.112 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:04:47.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:04:46 smithi157 bash[24585]: cluster 2024-09-16T11:04:45.762837+0000 mgr.a (mgr.14373) 14167 : cluster [DBG] pgmap v9826: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T11:04:47.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:04:46 smithi086 bash[24289]: cluster 2024-09-16T11:04:45.762837+0000 mgr.a (mgr.14373) 14167 : cluster [DBG] pgmap v9826: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T11:04:47.869 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:04:47.869 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:04:47.869 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:04:47.869 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:04:47.869 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:04:48.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:04:47 smithi157 bash[24585]: audit 2024-09-16T11:04:47.215997+0000 mon.b (mon.2) 1294 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T11:04:48.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:04:47 smithi086 bash[24289]: audit 2024-09-16T11:04:47.215997+0000 mon.b (mon.2) 1294 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T11:04:48.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:04:47 smithi047 bash[22744]: audit 2024-09-16T11:04:47.215997+0000 mon.b (mon.2) 1294 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T11:04:49.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:04:48 smithi157 bash[24585]: audit 2024-09-16T11:04:47.445084+0000 mgr.a (mgr.14373) 14168 : audit [DBG] from='client.307173 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:04:49.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:04:48 smithi157 bash[24585]: cluster 2024-09-16T11:04:47.772734+0000 mgr.a (mgr.14373) 14169 : cluster [DBG] pgmap v9827: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:04:49.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:04:48 smithi086 bash[24289]: audit 2024-09-16T11:04:47.445084+0000 mgr.a (mgr.14373) 14168 : audit [DBG] from='client.307173 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:04:49.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:04:48 smithi086 bash[24289]: cluster 2024-09-16T11:04:47.772734+0000 mgr.a (mgr.14373) 14169 : cluster [DBG] pgmap v9827: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:04:49.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:04:48 smithi047 bash[22744]: audit 2024-09-16T11:04:47.445084+0000 mgr.a (mgr.14373) 14168 : audit [DBG] from='client.307173 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:04:49.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:04:48 smithi047 bash[22744]: cluster 2024-09-16T11:04:47.772734+0000 mgr.a (mgr.14373) 14169 : cluster [DBG] pgmap v9827: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:04:51.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:04:50 smithi157 bash[24585]: cluster 2024-09-16T11:04:49.773336+0000 mgr.a (mgr.14373) 14170 : cluster [DBG] pgmap v9828: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:04:51.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:04:50 smithi086 bash[24289]: cluster 2024-09-16T11:04:49.773336+0000 mgr.a (mgr.14373) 14170 : cluster [DBG] pgmap v9828: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:04:51.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:04:50 smithi047 bash[22744]: cluster 2024-09-16T11:04:49.773336+0000 mgr.a (mgr.14373) 14170 : cluster [DBG] pgmap v9828: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:04:52.870 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:04:52.871 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:04:52.871 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:04:53.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:04:52 smithi157 bash[24585]: cluster 2024-09-16T11:04:51.775293+0000 mgr.a (mgr.14373) 14171 : cluster [DBG] pgmap v9829: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:04:53.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:04:52 smithi157 bash[24585]: audit 2024-09-16T11:04:52.519018+0000 mon.a (mon.0) 1408 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:04:53.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:04:52 smithi157 bash[24585]: audit 2024-09-16T11:04:52.523556+0000 mon.a (mon.0) 1409 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:04:53.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:04:52 smithi157 bash[24585]: audit 2024-09-16T11:04:52.528268+0000 mon.a (mon.0) 1410 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:04:53.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:04:52 smithi157 bash[24585]: audit 2024-09-16T11:04:52.532027+0000 mon.a (mon.0) 1411 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:04:53.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:04:52 smithi157 bash[24585]: audit 2024-09-16T11:04:52.571087+0000 mon.a (mon.0) 1412 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:04:53.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:04:52 smithi157 bash[24585]: audit 2024-09-16T11:04:52.575308+0000 mon.a (mon.0) 1413 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:04:53.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:04:52 smithi086 bash[24289]: cluster 2024-09-16T11:04:51.775293+0000 mgr.a (mgr.14373) 14171 : cluster [DBG] pgmap v9829: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:04:53.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:04:52 smithi086 bash[24289]: audit 2024-09-16T11:04:52.519018+0000 mon.a (mon.0) 1408 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:04:53.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:04:52 smithi086 bash[24289]: audit 2024-09-16T11:04:52.523556+0000 mon.a (mon.0) 1409 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:04:53.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:04:52 smithi086 bash[24289]: audit 2024-09-16T11:04:52.528268+0000 mon.a (mon.0) 1410 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:04:53.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:04:52 smithi086 bash[24289]: audit 2024-09-16T11:04:52.532027+0000 mon.a (mon.0) 1411 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:04:53.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:04:52 smithi086 bash[24289]: audit 2024-09-16T11:04:52.571087+0000 mon.a (mon.0) 1412 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:04:53.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:04:52 smithi086 bash[24289]: audit 2024-09-16T11:04:52.575308+0000 mon.a (mon.0) 1413 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:04:53.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:04:52 smithi047 bash[22744]: cluster 2024-09-16T11:04:51.775293+0000 mgr.a (mgr.14373) 14171 : cluster [DBG] pgmap v9829: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:04:53.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:04:52 smithi047 bash[22744]: audit 2024-09-16T11:04:52.519018+0000 mon.a (mon.0) 1408 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:04:53.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:04:52 smithi047 bash[22744]: audit 2024-09-16T11:04:52.523556+0000 mon.a (mon.0) 1409 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:04:53.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:04:52 smithi047 bash[22744]: audit 2024-09-16T11:04:52.528268+0000 mon.a (mon.0) 1410 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:04:53.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:04:52 smithi047 bash[22744]: audit 2024-09-16T11:04:52.532027+0000 mon.a (mon.0) 1411 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:04:53.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:04:52 smithi047 bash[22744]: audit 2024-09-16T11:04:52.571087+0000 mon.a (mon.0) 1412 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:04:53.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:04:52 smithi047 bash[22744]: audit 2024-09-16T11:04:52.575308+0000 mon.a (mon.0) 1413 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:04:53.624 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:04:53.624 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:04:53.624 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:04:53.624 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:04:53.624 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:04:54.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:04:53 smithi157 bash[24585]: audit 2024-09-16T11:04:53.310129+0000 mon.b (mon.2) 1295 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T11:04:54.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:04:53 smithi157 bash[24585]: audit 2024-09-16T11:04:53.311512+0000 mon.b (mon.2) 1296 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T11:04:54.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:04:53 smithi157 bash[24585]: audit 2024-09-16T11:04:53.317713+0000 mon.a (mon.0) 1414 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:04:54.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:04:53 smithi157 bash[24585]: audit 2024-09-16T11:04:53.322609+0000 mon.b (mon.2) 1297 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:04:54.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:04:53 smithi086 bash[24289]: audit 2024-09-16T11:04:53.310129+0000 mon.b (mon.2) 1295 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T11:04:54.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:04:53 smithi086 bash[24289]: audit 2024-09-16T11:04:53.311512+0000 mon.b (mon.2) 1296 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T11:04:54.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:04:53 smithi086 bash[24289]: audit 2024-09-16T11:04:53.317713+0000 mon.a (mon.0) 1414 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:04:54.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:04:53 smithi086 bash[24289]: audit 2024-09-16T11:04:53.322609+0000 mon.b (mon.2) 1297 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:04:54.323 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:04:53 smithi047 bash[22744]: audit 2024-09-16T11:04:53.310129+0000 mon.b (mon.2) 1295 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T11:04:54.323 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:04:53 smithi047 bash[22744]: audit 2024-09-16T11:04:53.311512+0000 mon.b (mon.2) 1296 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T11:04:54.323 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:04:53 smithi047 bash[22744]: audit 2024-09-16T11:04:53.317713+0000 mon.a (mon.0) 1414 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:04:54.323 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:04:53 smithi047 bash[22744]: audit 2024-09-16T11:04:53.322609+0000 mon.b (mon.2) 1297 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:04:54.592 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 11:04:54 smithi047 bash[22994]: debug 2024-09-16T11:04:54.321+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T11:04:54.593 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 11:04:54 smithi047 bash[22994]: debug 2024-09-16T11:04:54.321+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T11:04:55.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:04:54 smithi157 bash[24585]: audit 2024-09-16T11:04:53.200088+0000 mgr.a (mgr.14373) 14172 : audit [DBG] from='client.307245 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:04:55.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:04:54 smithi157 bash[24585]: audit 2024-09-16T11:04:53.324355+0000 mgr.a (mgr.14373) 14173 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:04:55.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:04:54 smithi157 bash[24585]: cluster 2024-09-16T11:04:53.775910+0000 mgr.a (mgr.14373) 14174 : cluster [DBG] pgmap v9830: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:04:55.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:04:54 smithi086 bash[24289]: audit 2024-09-16T11:04:53.200088+0000 mgr.a (mgr.14373) 14172 : audit [DBG] from='client.307245 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:04:55.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:04:54 smithi086 bash[24289]: audit 2024-09-16T11:04:53.324355+0000 mgr.a (mgr.14373) 14173 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:04:55.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:04:54 smithi086 bash[24289]: cluster 2024-09-16T11:04:53.775910+0000 mgr.a (mgr.14373) 14174 : cluster [DBG] pgmap v9830: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:04:55.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:04:54 smithi047 bash[22744]: audit 2024-09-16T11:04:53.200088+0000 mgr.a (mgr.14373) 14172 : audit [DBG] from='client.307245 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:04:55.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:04:54 smithi047 bash[22744]: audit 2024-09-16T11:04:53.324355+0000 mgr.a (mgr.14373) 14173 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:04:55.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:04:54 smithi047 bash[22744]: cluster 2024-09-16T11:04:53.775910+0000 mgr.a (mgr.14373) 14174 : cluster [DBG] pgmap v9830: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:04:56.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:04:55 smithi157 bash[24585]: audit 2024-09-16T11:04:54.322381+0000 mgr.a (mgr.14373) 14175 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T11:04:56.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:04:55 smithi157 bash[24585]: cephadm 2024-09-16T11:04:54.324507+0000 mgr.a (mgr.14373) 14176 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T11:04:56.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:04:55 smithi086 bash[24289]: audit 2024-09-16T11:04:54.322381+0000 mgr.a (mgr.14373) 14175 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T11:04:56.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:04:55 smithi086 bash[24289]: cephadm 2024-09-16T11:04:54.324507+0000 mgr.a (mgr.14373) 14176 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T11:04:56.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:04:55 smithi047 bash[22744]: audit 2024-09-16T11:04:54.322381+0000 mgr.a (mgr.14373) 14175 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T11:04:56.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:04:55 smithi047 bash[22744]: cephadm 2024-09-16T11:04:54.324507+0000 mgr.a (mgr.14373) 14176 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T11:04:57.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:04:56 smithi157 bash[24585]: cluster 2024-09-16T11:04:55.776918+0000 mgr.a (mgr.14373) 14177 : cluster [DBG] pgmap v9831: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:04:57.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:04:56 smithi086 bash[24289]: cluster 2024-09-16T11:04:55.776918+0000 mgr.a (mgr.14373) 14177 : cluster [DBG] pgmap v9831: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:04:57.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:04:56 smithi047 bash[22744]: cluster 2024-09-16T11:04:55.776918+0000 mgr.a (mgr.14373) 14177 : cluster [DBG] pgmap v9831: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:04:58.626 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:04:58.626 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:04:58.626 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:04:59.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:04:58 smithi157 bash[24585]: cluster 2024-09-16T11:04:57.779332+0000 mgr.a (mgr.14373) 14178 : cluster [DBG] pgmap v9832: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:04:59.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:04:58 smithi086 bash[24289]: cluster 2024-09-16T11:04:57.779332+0000 mgr.a (mgr.14373) 14178 : cluster [DBG] pgmap v9832: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:04:59.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:04:58 smithi047 bash[22744]: cluster 2024-09-16T11:04:57.779332+0000 mgr.a (mgr.14373) 14178 : cluster [DBG] pgmap v9832: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:04:59.405 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:04:59.405 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:04:59.405 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:04:59.405 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:04:59.405 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:05:01.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:05:00 smithi157 bash[24585]: audit 2024-09-16T11:04:58.963180+0000 mgr.a (mgr.14373) 14179 : audit [DBG] from='client.307425 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:05:01.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:05:00 smithi157 bash[24585]: cluster 2024-09-16T11:04:59.780325+0000 mgr.a (mgr.14373) 14180 : cluster [DBG] pgmap v9833: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:05:01.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:05:00 smithi086 bash[24289]: audit 2024-09-16T11:04:58.963180+0000 mgr.a (mgr.14373) 14179 : audit [DBG] from='client.307425 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:05:01.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:05:00 smithi086 bash[24289]: cluster 2024-09-16T11:04:59.780325+0000 mgr.a (mgr.14373) 14180 : cluster [DBG] pgmap v9833: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:05:01.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:05:00 smithi047 bash[22744]: audit 2024-09-16T11:04:58.963180+0000 mgr.a (mgr.14373) 14179 : audit [DBG] from='client.307425 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:05:01.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:05:00 smithi047 bash[22744]: cluster 2024-09-16T11:04:59.780325+0000 mgr.a (mgr.14373) 14180 : cluster [DBG] pgmap v9833: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:05:03.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:05:02 smithi157 bash[24585]: cluster 2024-09-16T11:05:01.782552+0000 mgr.a (mgr.14373) 14181 : cluster [DBG] pgmap v9834: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:05:03.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:05:02 smithi086 bash[24289]: cluster 2024-09-16T11:05:01.782552+0000 mgr.a (mgr.14373) 14181 : cluster [DBG] pgmap v9834: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:05:03.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:05:02 smithi047 bash[22744]: cluster 2024-09-16T11:05:01.782552+0000 mgr.a (mgr.14373) 14181 : cluster [DBG] pgmap v9834: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:05:04.407 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:05:04.407 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:05:04.407 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:05:05.162 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:05:05.163 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:05:05.163 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:05:05.163 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:05:05.163 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:05:05.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:05:04 smithi157 bash[24585]: cluster 2024-09-16T11:05:03.783334+0000 mgr.a (mgr.14373) 14182 : cluster [DBG] pgmap v9835: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:05:05.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:05:04 smithi086 bash[24289]: cluster 2024-09-16T11:05:03.783334+0000 mgr.a (mgr.14373) 14182 : cluster [DBG] pgmap v9835: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:05:05.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:05:04 smithi047 bash[22744]: cluster 2024-09-16T11:05:03.783334+0000 mgr.a (mgr.14373) 14182 : cluster [DBG] pgmap v9835: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:05:06.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:05:05 smithi157 bash[24585]: audit 2024-09-16T11:05:04.736977+0000 mgr.a (mgr.14373) 14183 : audit [DBG] from='client.307500 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:05:06.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:05:05 smithi086 bash[24289]: audit 2024-09-16T11:05:04.736977+0000 mgr.a (mgr.14373) 14183 : audit [DBG] from='client.307500 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:05:06.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:05:05 smithi047 bash[22744]: audit 2024-09-16T11:05:04.736977+0000 mgr.a (mgr.14373) 14183 : audit [DBG] from='client.307500 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:05:07.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:05:06 smithi157 bash[24585]: cluster 2024-09-16T11:05:05.784306+0000 mgr.a (mgr.14373) 14184 : cluster [DBG] pgmap v9836: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:05:07.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:05:06 smithi086 bash[24289]: cluster 2024-09-16T11:05:05.784306+0000 mgr.a (mgr.14373) 14184 : cluster [DBG] pgmap v9836: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:05:07.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:05:06 smithi047 bash[22744]: cluster 2024-09-16T11:05:05.784306+0000 mgr.a (mgr.14373) 14184 : cluster [DBG] pgmap v9836: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:05:08.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:05:07 smithi157 bash[24585]: cluster 2024-09-16T11:05:07.786587+0000 mgr.a (mgr.14373) 14185 : cluster [DBG] pgmap v9837: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:05:08.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:05:07 smithi086 bash[24289]: cluster 2024-09-16T11:05:07.786587+0000 mgr.a (mgr.14373) 14185 : cluster [DBG] pgmap v9837: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:05:08.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:05:07 smithi047 bash[22744]: cluster 2024-09-16T11:05:07.786587+0000 mgr.a (mgr.14373) 14185 : cluster [DBG] pgmap v9837: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:05:10.164 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:05:10.165 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:05:10.165 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:05:10.934 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:05:10.934 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:05:10.934 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:05:10.934 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:05:10.934 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:05:11.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:05:10 smithi157 bash[24585]: cluster 2024-09-16T11:05:09.787343+0000 mgr.a (mgr.14373) 14186 : cluster [DBG] pgmap v9838: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:05:11.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:05:10 smithi086 bash[24289]: cluster 2024-09-16T11:05:09.787343+0000 mgr.a (mgr.14373) 14186 : cluster [DBG] pgmap v9838: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:05:11.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:05:10 smithi047 bash[22744]: cluster 2024-09-16T11:05:09.787343+0000 mgr.a (mgr.14373) 14186 : cluster [DBG] pgmap v9838: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:05:12.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:05:11 smithi157 bash[24585]: audit 2024-09-16T11:05:10.497200+0000 mgr.a (mgr.14373) 14187 : audit [DBG] from='client.307578 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:05:12.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:05:11 smithi086 bash[24289]: audit 2024-09-16T11:05:10.497200+0000 mgr.a (mgr.14373) 14187 : audit [DBG] from='client.307578 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:05:12.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:05:11 smithi047 bash[22744]: audit 2024-09-16T11:05:10.497200+0000 mgr.a (mgr.14373) 14187 : audit [DBG] from='client.307578 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:05:13.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:05:12 smithi157 bash[24585]: cluster 2024-09-16T11:05:11.789812+0000 mgr.a (mgr.14373) 14188 : cluster [DBG] pgmap v9839: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:05:13.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:05:12 smithi086 bash[24289]: cluster 2024-09-16T11:05:11.789812+0000 mgr.a (mgr.14373) 14188 : cluster [DBG] pgmap v9839: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:05:13.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:05:12 smithi047 bash[22744]: cluster 2024-09-16T11:05:11.789812+0000 mgr.a (mgr.14373) 14188 : cluster [DBG] pgmap v9839: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:05:15.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:05:14 smithi157 bash[24585]: cluster 2024-09-16T11:05:13.790780+0000 mgr.a (mgr.14373) 14189 : cluster [DBG] pgmap v9840: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:05:15.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:05:14 smithi086 bash[24289]: cluster 2024-09-16T11:05:13.790780+0000 mgr.a (mgr.14373) 14189 : cluster [DBG] pgmap v9840: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:05:15.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:05:14 smithi047 bash[22744]: cluster 2024-09-16T11:05:13.790780+0000 mgr.a (mgr.14373) 14189 : cluster [DBG] pgmap v9840: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:05:15.935 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:05:15.936 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:05:15.936 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:05:16.716 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:05:16.717 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:05:16.717 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:05:16.717 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:05:16.717 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:05:17.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:05:16 smithi157 bash[24585]: cluster 2024-09-16T11:05:15.791715+0000 mgr.a (mgr.14373) 14190 : cluster [DBG] pgmap v9841: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:05:17.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:05:16 smithi086 bash[24289]: cluster 2024-09-16T11:05:15.791715+0000 mgr.a (mgr.14373) 14190 : cluster [DBG] pgmap v9841: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:05:17.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:05:16 smithi047 bash[22744]: cluster 2024-09-16T11:05:15.791715+0000 mgr.a (mgr.14373) 14190 : cluster [DBG] pgmap v9841: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:05:18.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:05:17 smithi157 bash[24585]: audit 2024-09-16T11:05:16.274690+0000 mgr.a (mgr.14373) 14191 : audit [DBG] from='client.307653 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:05:18.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:05:17 smithi086 bash[24289]: audit 2024-09-16T11:05:16.274690+0000 mgr.a (mgr.14373) 14191 : audit [DBG] from='client.307653 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:05:18.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:05:17 smithi047 bash[22744]: audit 2024-09-16T11:05:16.274690+0000 mgr.a (mgr.14373) 14191 : audit [DBG] from='client.307653 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:05:19.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:05:18 smithi157 bash[24585]: cluster 2024-09-16T11:05:17.794574+0000 mgr.a (mgr.14373) 14192 : cluster [DBG] pgmap v9842: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-16T11:05:19.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:05:18 smithi086 bash[24289]: cluster 2024-09-16T11:05:17.794574+0000 mgr.a (mgr.14373) 14192 : cluster [DBG] pgmap v9842: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-16T11:05:19.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:05:18 smithi047 bash[22744]: cluster 2024-09-16T11:05:17.794574+0000 mgr.a (mgr.14373) 14192 : cluster [DBG] pgmap v9842: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-16T11:05:21.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:05:20 smithi157 bash[24585]: cluster 2024-09-16T11:05:19.795381+0000 mgr.a (mgr.14373) 14193 : cluster [DBG] pgmap v9843: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T11:05:21.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:05:20 smithi086 bash[24289]: cluster 2024-09-16T11:05:19.795381+0000 mgr.a (mgr.14373) 14193 : cluster [DBG] pgmap v9843: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T11:05:21.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:05:20 smithi047 bash[22744]: cluster 2024-09-16T11:05:19.795381+0000 mgr.a (mgr.14373) 14193 : cluster [DBG] pgmap v9843: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T11:05:21.718 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:05:21.719 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:05:21.719 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:05:22.452 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:05:22.452 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:05:22.452 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:05:22.452 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:05:22.453 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:05:23.309 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:05:22 smithi157 bash[24585]: cluster 2024-09-16T11:05:21.797352+0000 mgr.a (mgr.14373) 14194 : cluster [DBG] pgmap v9844: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:05:23.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:05:22 smithi086 bash[24289]: cluster 2024-09-16T11:05:21.797352+0000 mgr.a (mgr.14373) 14194 : cluster [DBG] pgmap v9844: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:05:23.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:05:22 smithi047 bash[22744]: cluster 2024-09-16T11:05:21.797352+0000 mgr.a (mgr.14373) 14194 : cluster [DBG] pgmap v9844: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:05:24.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:05:23 smithi157 bash[24585]: audit 2024-09-16T11:05:22.044909+0000 mgr.a (mgr.14373) 14195 : audit [DBG] from='client.307731 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:05:24.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:05:23 smithi086 bash[24289]: audit 2024-09-16T11:05:22.044909+0000 mgr.a (mgr.14373) 14195 : audit [DBG] from='client.307731 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:05:24.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:05:23 smithi047 bash[22744]: audit 2024-09-16T11:05:22.044909+0000 mgr.a (mgr.14373) 14195 : audit [DBG] from='client.307731 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:05:25.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:05:24 smithi157 bash[24585]: cluster 2024-09-16T11:05:23.798257+0000 mgr.a (mgr.14373) 14196 : cluster [DBG] pgmap v9845: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:05:25.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:05:24 smithi086 bash[24289]: cluster 2024-09-16T11:05:23.798257+0000 mgr.a (mgr.14373) 14196 : cluster [DBG] pgmap v9845: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:05:25.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:05:24 smithi047 bash[22744]: cluster 2024-09-16T11:05:23.798257+0000 mgr.a (mgr.14373) 14196 : cluster [DBG] pgmap v9845: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:05:27.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:05:26 smithi157 bash[24585]: cluster 2024-09-16T11:05:25.799101+0000 mgr.a (mgr.14373) 14197 : cluster [DBG] pgmap v9846: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T11:05:27.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:05:26 smithi086 bash[24289]: cluster 2024-09-16T11:05:25.799101+0000 mgr.a (mgr.14373) 14197 : cluster [DBG] pgmap v9846: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T11:05:27.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:05:26 smithi047 bash[22744]: cluster 2024-09-16T11:05:25.799101+0000 mgr.a (mgr.14373) 14197 : cluster [DBG] pgmap v9846: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T11:05:27.453 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:05:27.454 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:05:27.454 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:05:28.225 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:05:28.225 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:05:28.225 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:05:28.225 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:05:28.225 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:05:28.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:05:27 smithi157 bash[24585]: audit 2024-09-16T11:05:27.793047+0000 mgr.a (mgr.14373) 14198 : audit [DBG] from='client.307809 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:05:28.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:05:27 smithi157 bash[24585]: cluster 2024-09-16T11:05:27.809939+0000 mgr.a (mgr.14373) 14199 : cluster [DBG] pgmap v9847: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:05:28.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:05:27 smithi086 bash[24289]: audit 2024-09-16T11:05:27.793047+0000 mgr.a (mgr.14373) 14198 : audit [DBG] from='client.307809 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:05:28.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:05:27 smithi086 bash[24289]: cluster 2024-09-16T11:05:27.809939+0000 mgr.a (mgr.14373) 14199 : cluster [DBG] pgmap v9847: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:05:28.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:05:27 smithi047 bash[22744]: audit 2024-09-16T11:05:27.793047+0000 mgr.a (mgr.14373) 14198 : audit [DBG] from='client.307809 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:05:28.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:05:27 smithi047 bash[22744]: cluster 2024-09-16T11:05:27.809939+0000 mgr.a (mgr.14373) 14199 : cluster [DBG] pgmap v9847: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:05:31.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:05:30 smithi157 bash[24585]: cluster 2024-09-16T11:05:29.811004+0000 mgr.a (mgr.14373) 14200 : cluster [DBG] pgmap v9848: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-16T11:05:31.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:05:30 smithi086 bash[24289]: cluster 2024-09-16T11:05:29.811004+0000 mgr.a (mgr.14373) 14200 : cluster [DBG] pgmap v9848: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-16T11:05:31.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:05:30 smithi047 bash[22744]: cluster 2024-09-16T11:05:29.811004+0000 mgr.a (mgr.14373) 14200 : cluster [DBG] pgmap v9848: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-16T11:05:33.226 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:05:33.227 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:05:33.227 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:05:33.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:05:32 smithi157 bash[24585]: cluster 2024-09-16T11:05:31.813168+0000 mgr.a (mgr.14373) 14201 : cluster [DBG] pgmap v9849: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-16T11:05:33.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:05:32 smithi086 bash[24289]: cluster 2024-09-16T11:05:31.813168+0000 mgr.a (mgr.14373) 14201 : cluster [DBG] pgmap v9849: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-16T11:05:33.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:05:32 smithi047 bash[22744]: cluster 2024-09-16T11:05:31.813168+0000 mgr.a (mgr.14373) 14201 : cluster [DBG] pgmap v9849: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-16T11:05:34.024 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:05:34.024 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:05:34.025 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:05:34.025 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:05:34.025 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:05:35.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:05:34 smithi157 bash[24585]: audit 2024-09-16T11:05:33.570810+0000 mgr.a (mgr.14373) 14202 : audit [DBG] from='client.307884 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:05:35.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:05:34 smithi157 bash[24585]: cluster 2024-09-16T11:05:33.815228+0000 mgr.a (mgr.14373) 14203 : cluster [DBG] pgmap v9850: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:05:35.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:05:34 smithi086 bash[24289]: audit 2024-09-16T11:05:33.570810+0000 mgr.a (mgr.14373) 14202 : audit [DBG] from='client.307884 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:05:35.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:05:34 smithi086 bash[24289]: cluster 2024-09-16T11:05:33.815228+0000 mgr.a (mgr.14373) 14203 : cluster [DBG] pgmap v9850: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:05:35.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:05:34 smithi047 bash[22744]: audit 2024-09-16T11:05:33.570810+0000 mgr.a (mgr.14373) 14202 : audit [DBG] from='client.307884 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:05:35.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:05:34 smithi047 bash[22744]: cluster 2024-09-16T11:05:33.815228+0000 mgr.a (mgr.14373) 14203 : cluster [DBG] pgmap v9850: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:05:37.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:05:36 smithi157 bash[24585]: cluster 2024-09-16T11:05:35.816180+0000 mgr.a (mgr.14373) 14204 : cluster [DBG] pgmap v9851: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:05:37.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:05:36 smithi086 bash[24289]: cluster 2024-09-16T11:05:35.816180+0000 mgr.a (mgr.14373) 14204 : cluster [DBG] pgmap v9851: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:05:37.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:05:36 smithi047 bash[22744]: cluster 2024-09-16T11:05:35.816180+0000 mgr.a (mgr.14373) 14204 : cluster [DBG] pgmap v9851: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:05:39.026 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:05:39.026 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:05:39.027 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:05:39.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:05:38 smithi157 bash[24585]: cluster 2024-09-16T11:05:37.818421+0000 mgr.a (mgr.14373) 14205 : cluster [DBG] pgmap v9852: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:05:39.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:05:38 smithi086 bash[24289]: cluster 2024-09-16T11:05:37.818421+0000 mgr.a (mgr.14373) 14205 : cluster [DBG] pgmap v9852: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:05:39.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:05:38 smithi047 bash[22744]: cluster 2024-09-16T11:05:37.818421+0000 mgr.a (mgr.14373) 14205 : cluster [DBG] pgmap v9852: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:05:39.776 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:05:39.777 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:05:39.777 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:05:39.777 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:05:39.777 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:05:41.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:05:40 smithi157 bash[24585]: audit 2024-09-16T11:05:39.358884+0000 mgr.a (mgr.14373) 14206 : audit [DBG] from='client.307962 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:05:41.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:05:40 smithi157 bash[24585]: cluster 2024-09-16T11:05:39.819169+0000 mgr.a (mgr.14373) 14207 : cluster [DBG] pgmap v9853: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:05:41.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:05:40 smithi086 bash[24289]: audit 2024-09-16T11:05:39.358884+0000 mgr.a (mgr.14373) 14206 : audit [DBG] from='client.307962 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:05:41.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:05:40 smithi086 bash[24289]: cluster 2024-09-16T11:05:39.819169+0000 mgr.a (mgr.14373) 14207 : cluster [DBG] pgmap v9853: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:05:41.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:05:40 smithi047 bash[22744]: audit 2024-09-16T11:05:39.358884+0000 mgr.a (mgr.14373) 14206 : audit [DBG] from='client.307962 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:05:41.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:05:40 smithi047 bash[22744]: cluster 2024-09-16T11:05:39.819169+0000 mgr.a (mgr.14373) 14207 : cluster [DBG] pgmap v9853: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:05:43.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:05:42 smithi157 bash[24585]: cluster 2024-09-16T11:05:41.821281+0000 mgr.a (mgr.14373) 14208 : cluster [DBG] pgmap v9854: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:05:43.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:05:42 smithi086 bash[24289]: cluster 2024-09-16T11:05:41.821281+0000 mgr.a (mgr.14373) 14208 : cluster [DBG] pgmap v9854: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:05:43.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:05:42 smithi047 bash[22744]: cluster 2024-09-16T11:05:41.821281+0000 mgr.a (mgr.14373) 14208 : cluster [DBG] pgmap v9854: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:05:44.778 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:05:44.779 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:05:44.779 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:05:45.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:05:44 smithi157 bash[24585]: cluster 2024-09-16T11:05:43.822059+0000 mgr.a (mgr.14373) 14209 : cluster [DBG] pgmap v9855: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:05:45.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:05:44 smithi086 bash[24289]: cluster 2024-09-16T11:05:43.822059+0000 mgr.a (mgr.14373) 14209 : cluster [DBG] pgmap v9855: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:05:45.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:05:44 smithi047 bash[22744]: cluster 2024-09-16T11:05:43.822059+0000 mgr.a (mgr.14373) 14209 : cluster [DBG] pgmap v9855: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:05:45.542 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:05:45.542 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:05:45.542 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:05:45.542 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:05:45.542 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:05:47.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:05:46 smithi157 bash[24585]: audit 2024-09-16T11:05:45.108511+0000 mgr.a (mgr.14373) 14210 : audit [DBG] from='client.308040 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:05:47.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:05:46 smithi157 bash[24585]: cluster 2024-09-16T11:05:45.823039+0000 mgr.a (mgr.14373) 14211 : cluster [DBG] pgmap v9856: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:05:47.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:05:46 smithi086 bash[24289]: audit 2024-09-16T11:05:45.108511+0000 mgr.a (mgr.14373) 14210 : audit [DBG] from='client.308040 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:05:47.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:05:46 smithi086 bash[24289]: cluster 2024-09-16T11:05:45.823039+0000 mgr.a (mgr.14373) 14211 : cluster [DBG] pgmap v9856: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:05:47.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:05:46 smithi047 bash[22744]: audit 2024-09-16T11:05:45.108511+0000 mgr.a (mgr.14373) 14210 : audit [DBG] from='client.308040 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:05:47.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:05:46 smithi047 bash[22744]: cluster 2024-09-16T11:05:45.823039+0000 mgr.a (mgr.14373) 14211 : cluster [DBG] pgmap v9856: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:05:48.308 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:05:47 smithi157 bash[24585]: cluster 2024-09-16T11:05:47.825262+0000 mgr.a (mgr.14373) 14212 : cluster [DBG] pgmap v9857: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:05:48.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:05:47 smithi086 bash[24289]: cluster 2024-09-16T11:05:47.825262+0000 mgr.a (mgr.14373) 14212 : cluster [DBG] pgmap v9857: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:05:48.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:05:47 smithi047 bash[22744]: cluster 2024-09-16T11:05:47.825262+0000 mgr.a (mgr.14373) 14212 : cluster [DBG] pgmap v9857: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:05:50.543 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:05:50.544 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:05:50.544 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:05:51.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:05:50 smithi157 bash[24585]: cluster 2024-09-16T11:05:49.826013+0000 mgr.a (mgr.14373) 14213 : cluster [DBG] pgmap v9858: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:05:51.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:05:50 smithi086 bash[24289]: cluster 2024-09-16T11:05:49.826013+0000 mgr.a (mgr.14373) 14213 : cluster [DBG] pgmap v9858: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:05:51.326 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:05:51.326 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:05:51.326 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:05:51.326 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:05:51.326 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:05:51.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:05:50 smithi047 bash[22744]: cluster 2024-09-16T11:05:49.826013+0000 mgr.a (mgr.14373) 14213 : cluster [DBG] pgmap v9858: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:05:52.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:05:51 smithi157 bash[24585]: audit 2024-09-16T11:05:50.885598+0000 mgr.a (mgr.14373) 14214 : audit [DBG] from='client.308115 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:05:52.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:05:51 smithi086 bash[24289]: audit 2024-09-16T11:05:50.885598+0000 mgr.a (mgr.14373) 14214 : audit [DBG] from='client.308115 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:05:52.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:05:51 smithi047 bash[22744]: audit 2024-09-16T11:05:50.885598+0000 mgr.a (mgr.14373) 14214 : audit [DBG] from='client.308115 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:05:53.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:05:52 smithi157 bash[24585]: cluster 2024-09-16T11:05:51.828405+0000 mgr.a (mgr.14373) 14215 : cluster [DBG] pgmap v9859: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:05:53.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:05:52 smithi086 bash[24289]: cluster 2024-09-16T11:05:51.828405+0000 mgr.a (mgr.14373) 14215 : cluster [DBG] pgmap v9859: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:05:53.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:05:52 smithi047 bash[22744]: cluster 2024-09-16T11:05:51.828405+0000 mgr.a (mgr.14373) 14215 : cluster [DBG] pgmap v9859: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:05:55.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:05:54 smithi157 bash[24585]: cluster 2024-09-16T11:05:53.829177+0000 mgr.a (mgr.14373) 14216 : cluster [DBG] pgmap v9860: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:05:55.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:05:54 smithi157 bash[24585]: audit 2024-09-16T11:05:54.375614+0000 mon.b (mon.2) 1298 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T11:05:55.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:05:54 smithi086 bash[24289]: cluster 2024-09-16T11:05:53.829177+0000 mgr.a (mgr.14373) 14216 : cluster [DBG] pgmap v9860: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:05:55.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:05:54 smithi086 bash[24289]: audit 2024-09-16T11:05:54.375614+0000 mon.b (mon.2) 1298 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T11:05:55.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:05:54 smithi047 bash[22744]: cluster 2024-09-16T11:05:53.829177+0000 mgr.a (mgr.14373) 14216 : cluster [DBG] pgmap v9860: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:05:55.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:05:54 smithi047 bash[22744]: audit 2024-09-16T11:05:54.375614+0000 mon.b (mon.2) 1298 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T11:05:56.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:05:55 smithi157 bash[24585]: audit 2024-09-16T11:05:55.205920+0000 mon.b (mon.2) 1299 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T11:05:56.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:05:55 smithi157 bash[24585]: audit 2024-09-16T11:05:55.207983+0000 mon.b (mon.2) 1300 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T11:05:56.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:05:55 smithi157 bash[24585]: audit 2024-09-16T11:05:55.220435+0000 mon.a (mon.0) 1415 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:05:56.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:05:55 smithi157 bash[24585]: audit 2024-09-16T11:05:55.225402+0000 mon.b (mon.2) 1301 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:05:56.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:05:55 smithi086 bash[24289]: audit 2024-09-16T11:05:55.205920+0000 mon.b (mon.2) 1299 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T11:05:56.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:05:55 smithi086 bash[24289]: audit 2024-09-16T11:05:55.207983+0000 mon.b (mon.2) 1300 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T11:05:56.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:05:55 smithi086 bash[24289]: audit 2024-09-16T11:05:55.220435+0000 mon.a (mon.0) 1415 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:05:56.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:05:55 smithi086 bash[24289]: audit 2024-09-16T11:05:55.225402+0000 mon.b (mon.2) 1301 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:05:56.327 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:05:56.328 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:05:56.328 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:05:56.342 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 11:05:55 smithi047 bash[22994]: debug 2024-09-16T11:05:55.960+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T11:05:56.342 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 11:05:55 smithi047 bash[22994]: debug 2024-09-16T11:05:55.960+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T11:05:56.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:05:55 smithi047 bash[22744]: audit 2024-09-16T11:05:55.205920+0000 mon.b (mon.2) 1299 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T11:05:56.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:05:55 smithi047 bash[22744]: audit 2024-09-16T11:05:55.207983+0000 mon.b (mon.2) 1300 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T11:05:56.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:05:55 smithi047 bash[22744]: audit 2024-09-16T11:05:55.220435+0000 mon.a (mon.0) 1415 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:05:56.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:05:55 smithi047 bash[22744]: audit 2024-09-16T11:05:55.225402+0000 mon.b (mon.2) 1301 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:05:57.082 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:05:57.083 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:05:57.083 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:05:57.083 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:05:57.083 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:05:57.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:05:56 smithi157 bash[24585]: audit 2024-09-16T11:05:55.227200+0000 mgr.a (mgr.14373) 14217 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:05:57.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:05:56 smithi157 bash[24585]: cluster 2024-09-16T11:05:55.829634+0000 mgr.a (mgr.14373) 14218 : cluster [DBG] pgmap v9861: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:05:57.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:05:56 smithi086 bash[24289]: audit 2024-09-16T11:05:55.227200+0000 mgr.a (mgr.14373) 14217 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:05:57.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:05:56 smithi086 bash[24289]: cluster 2024-09-16T11:05:55.829634+0000 mgr.a (mgr.14373) 14218 : cluster [DBG] pgmap v9861: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:05:57.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:05:56 smithi047 bash[22744]: audit 2024-09-16T11:05:55.227200+0000 mgr.a (mgr.14373) 14217 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:05:57.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:05:56 smithi047 bash[22744]: cluster 2024-09-16T11:05:55.829634+0000 mgr.a (mgr.14373) 14218 : cluster [DBG] pgmap v9861: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:05:58.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:05:57 smithi157 bash[24585]: audit 2024-09-16T11:05:55.963937+0000 mgr.a (mgr.14373) 14219 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T11:05:58.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:05:57 smithi157 bash[24585]: cephadm 2024-09-16T11:05:55.965878+0000 mgr.a (mgr.14373) 14220 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T11:05:58.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:05:57 smithi157 bash[24585]: audit 2024-09-16T11:05:56.661023+0000 mgr.a (mgr.14373) 14221 : audit [DBG] from='client.308301 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:05:58.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:05:57 smithi086 bash[24289]: audit 2024-09-16T11:05:55.963937+0000 mgr.a (mgr.14373) 14219 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T11:05:58.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:05:57 smithi086 bash[24289]: cephadm 2024-09-16T11:05:55.965878+0000 mgr.a (mgr.14373) 14220 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T11:05:58.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:05:57 smithi086 bash[24289]: audit 2024-09-16T11:05:56.661023+0000 mgr.a (mgr.14373) 14221 : audit [DBG] from='client.308301 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:05:58.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:05:57 smithi047 bash[22744]: audit 2024-09-16T11:05:55.963937+0000 mgr.a (mgr.14373) 14219 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T11:05:58.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:05:57 smithi047 bash[22744]: cephadm 2024-09-16T11:05:55.965878+0000 mgr.a (mgr.14373) 14220 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T11:05:58.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:05:57 smithi047 bash[22744]: audit 2024-09-16T11:05:56.661023+0000 mgr.a (mgr.14373) 14221 : audit [DBG] from='client.308301 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:05:59.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:05:58 smithi157 bash[24585]: cluster 2024-09-16T11:05:57.832348+0000 mgr.a (mgr.14373) 14222 : cluster [DBG] pgmap v9862: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:05:59.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:05:58 smithi086 bash[24289]: cluster 2024-09-16T11:05:57.832348+0000 mgr.a (mgr.14373) 14222 : cluster [DBG] pgmap v9862: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:05:59.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:05:58 smithi047 bash[22744]: cluster 2024-09-16T11:05:57.832348+0000 mgr.a (mgr.14373) 14222 : cluster [DBG] pgmap v9862: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:06:00.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:05:59 smithi157 bash[24585]: cluster 2024-09-16T11:05:59.833146+0000 mgr.a (mgr.14373) 14223 : cluster [DBG] pgmap v9863: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T11:06:00.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:05:59 smithi086 bash[24289]: cluster 2024-09-16T11:05:59.833146+0000 mgr.a (mgr.14373) 14223 : cluster [DBG] pgmap v9863: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T11:06:00.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:05:59 smithi047 bash[22744]: cluster 2024-09-16T11:05:59.833146+0000 mgr.a (mgr.14373) 14223 : cluster [DBG] pgmap v9863: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T11:06:02.084 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:06:02.085 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:06:02.085 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:06:02.857 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:06:02.857 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:06:02.858 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:06:02.858 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:06:02.858 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:06:03.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:06:02 smithi157 bash[24585]: cluster 2024-09-16T11:06:01.835203+0000 mgr.a (mgr.14373) 14224 : cluster [DBG] pgmap v9864: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:06:03.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:06:02 smithi086 bash[24289]: cluster 2024-09-16T11:06:01.835203+0000 mgr.a (mgr.14373) 14224 : cluster [DBG] pgmap v9864: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:06:03.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:06:02 smithi047 bash[22744]: cluster 2024-09-16T11:06:01.835203+0000 mgr.a (mgr.14373) 14224 : cluster [DBG] pgmap v9864: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:06:04.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:06:03 smithi157 bash[24585]: audit 2024-09-16T11:06:02.419402+0000 mgr.a (mgr.14373) 14225 : audit [DBG] from='client.308379 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:06:04.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:06:03 smithi086 bash[24289]: audit 2024-09-16T11:06:02.419402+0000 mgr.a (mgr.14373) 14225 : audit [DBG] from='client.308379 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:06:04.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:06:03 smithi047 bash[22744]: audit 2024-09-16T11:06:02.419402+0000 mgr.a (mgr.14373) 14225 : audit [DBG] from='client.308379 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:06:05.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:06:04 smithi157 bash[24585]: cluster 2024-09-16T11:06:03.836115+0000 mgr.a (mgr.14373) 14226 : cluster [DBG] pgmap v9865: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T11:06:05.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:06:04 smithi086 bash[24289]: cluster 2024-09-16T11:06:03.836115+0000 mgr.a (mgr.14373) 14226 : cluster [DBG] pgmap v9865: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T11:06:05.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:06:04 smithi047 bash[22744]: cluster 2024-09-16T11:06:03.836115+0000 mgr.a (mgr.14373) 14226 : cluster [DBG] pgmap v9865: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T11:06:07.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:06:06 smithi157 bash[24585]: cluster 2024-09-16T11:06:05.836906+0000 mgr.a (mgr.14373) 14227 : cluster [DBG] pgmap v9866: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T11:06:07.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:06:06 smithi086 bash[24289]: cluster 2024-09-16T11:06:05.836906+0000 mgr.a (mgr.14373) 14227 : cluster [DBG] pgmap v9866: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T11:06:07.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:06:06 smithi047 bash[22744]: cluster 2024-09-16T11:06:05.836906+0000 mgr.a (mgr.14373) 14227 : cluster [DBG] pgmap v9866: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T11:06:07.859 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:06:07.859 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:06:07.860 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:06:08.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:06:07 smithi157 bash[24585]: cluster 2024-09-16T11:06:07.839153+0000 mgr.a (mgr.14373) 14228 : cluster [DBG] pgmap v9867: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:06:08.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:06:07 smithi086 bash[24289]: cluster 2024-09-16T11:06:07.839153+0000 mgr.a (mgr.14373) 14228 : cluster [DBG] pgmap v9867: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:06:08.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:06:07 smithi047 bash[22744]: cluster 2024-09-16T11:06:07.839153+0000 mgr.a (mgr.14373) 14228 : cluster [DBG] pgmap v9867: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:06:08.627 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:06:08.627 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:06:08.627 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:06:08.628 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:06:08.628 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:06:09.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:06:08 smithi157 bash[24585]: audit 2024-09-16T11:06:08.194847+0000 mgr.a (mgr.14373) 14229 : audit [DBG] from='client.308457 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:06:09.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:06:08 smithi086 bash[24289]: audit 2024-09-16T11:06:08.194847+0000 mgr.a (mgr.14373) 14229 : audit [DBG] from='client.308457 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:06:09.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:06:08 smithi047 bash[22744]: audit 2024-09-16T11:06:08.194847+0000 mgr.a (mgr.14373) 14229 : audit [DBG] from='client.308457 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:06:10.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:06:09 smithi157 bash[24585]: cluster 2024-09-16T11:06:09.840051+0000 mgr.a (mgr.14373) 14230 : cluster [DBG] pgmap v9868: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:06:10.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:06:09 smithi086 bash[24289]: cluster 2024-09-16T11:06:09.840051+0000 mgr.a (mgr.14373) 14230 : cluster [DBG] pgmap v9868: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:06:10.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:06:09 smithi047 bash[22744]: cluster 2024-09-16T11:06:09.840051+0000 mgr.a (mgr.14373) 14230 : cluster [DBG] pgmap v9868: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:06:13.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:06:12 smithi157 bash[24585]: cluster 2024-09-16T11:06:11.842214+0000 mgr.a (mgr.14373) 14231 : cluster [DBG] pgmap v9869: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:06:13.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:06:12 smithi086 bash[24289]: cluster 2024-09-16T11:06:11.842214+0000 mgr.a (mgr.14373) 14231 : cluster [DBG] pgmap v9869: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:06:13.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:06:12 smithi047 bash[22744]: cluster 2024-09-16T11:06:11.842214+0000 mgr.a (mgr.14373) 14231 : cluster [DBG] pgmap v9869: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:06:13.629 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:06:13.630 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:06:13.630 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:06:14.411 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:06:14.412 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:06:14.412 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:06:14.412 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:06:14.412 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:06:15.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:06:14 smithi157 bash[24585]: cluster 2024-09-16T11:06:13.842953+0000 mgr.a (mgr.14373) 14232 : cluster [DBG] pgmap v9870: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:06:15.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:06:14 smithi086 bash[24289]: cluster 2024-09-16T11:06:13.842953+0000 mgr.a (mgr.14373) 14232 : cluster [DBG] pgmap v9870: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:06:15.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:06:14 smithi047 bash[22744]: cluster 2024-09-16T11:06:13.842953+0000 mgr.a (mgr.14373) 14232 : cluster [DBG] pgmap v9870: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:06:16.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:06:15 smithi157 bash[24585]: audit 2024-09-16T11:06:13.962188+0000 mgr.a (mgr.14373) 14233 : audit [DBG] from='client.308532 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:06:16.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:06:15 smithi086 bash[24289]: audit 2024-09-16T11:06:13.962188+0000 mgr.a (mgr.14373) 14233 : audit [DBG] from='client.308532 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:06:16.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:06:15 smithi047 bash[22744]: audit 2024-09-16T11:06:13.962188+0000 mgr.a (mgr.14373) 14233 : audit [DBG] from='client.308532 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:06:17.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:06:16 smithi157 bash[24585]: cluster 2024-09-16T11:06:15.843834+0000 mgr.a (mgr.14373) 14234 : cluster [DBG] pgmap v9871: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:06:17.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:06:16 smithi086 bash[24289]: cluster 2024-09-16T11:06:15.843834+0000 mgr.a (mgr.14373) 14234 : cluster [DBG] pgmap v9871: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:06:17.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:06:16 smithi047 bash[22744]: cluster 2024-09-16T11:06:15.843834+0000 mgr.a (mgr.14373) 14234 : cluster [DBG] pgmap v9871: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:06:18.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:06:17 smithi157 bash[24585]: cluster 2024-09-16T11:06:17.846054+0000 mgr.a (mgr.14373) 14235 : cluster [DBG] pgmap v9872: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:06:18.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:06:17 smithi086 bash[24289]: cluster 2024-09-16T11:06:17.846054+0000 mgr.a (mgr.14373) 14235 : cluster [DBG] pgmap v9872: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:06:18.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:06:17 smithi047 bash[22744]: cluster 2024-09-16T11:06:17.846054+0000 mgr.a (mgr.14373) 14235 : cluster [DBG] pgmap v9872: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:06:19.413 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:06:19.414 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:06:19.414 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:06:20.192 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:06:20.193 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:06:20.193 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:06:20.193 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:06:20.193 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:06:21.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:06:20 smithi157 bash[24585]: audit 2024-09-16T11:06:19.745587+0000 mgr.a (mgr.14373) 14236 : audit [DBG] from='client.308610 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:06:21.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:06:20 smithi157 bash[24585]: cluster 2024-09-16T11:06:19.846575+0000 mgr.a (mgr.14373) 14237 : cluster [DBG] pgmap v9873: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:06:21.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:06:20 smithi086 bash[24289]: audit 2024-09-16T11:06:19.745587+0000 mgr.a (mgr.14373) 14236 : audit [DBG] from='client.308610 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:06:21.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:06:20 smithi086 bash[24289]: cluster 2024-09-16T11:06:19.846575+0000 mgr.a (mgr.14373) 14237 : cluster [DBG] pgmap v9873: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:06:21.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:06:20 smithi047 bash[22744]: audit 2024-09-16T11:06:19.745587+0000 mgr.a (mgr.14373) 14236 : audit [DBG] from='client.308610 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:06:21.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:06:20 smithi047 bash[22744]: cluster 2024-09-16T11:06:19.846575+0000 mgr.a (mgr.14373) 14237 : cluster [DBG] pgmap v9873: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:06:23.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:06:22 smithi157 bash[24585]: cluster 2024-09-16T11:06:21.848844+0000 mgr.a (mgr.14373) 14238 : cluster [DBG] pgmap v9874: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:06:23.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:06:22 smithi086 bash[24289]: cluster 2024-09-16T11:06:21.848844+0000 mgr.a (mgr.14373) 14238 : cluster [DBG] pgmap v9874: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:06:23.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:06:22 smithi047 bash[22744]: cluster 2024-09-16T11:06:21.848844+0000 mgr.a (mgr.14373) 14238 : cluster [DBG] pgmap v9874: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:06:25.195 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:06:25.195 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:06:25.195 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:06:25.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:06:24 smithi157 bash[24585]: cluster 2024-09-16T11:06:23.849631+0000 mgr.a (mgr.14373) 14239 : cluster [DBG] pgmap v9875: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:06:25.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:06:24 smithi086 bash[24289]: cluster 2024-09-16T11:06:23.849631+0000 mgr.a (mgr.14373) 14239 : cluster [DBG] pgmap v9875: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:06:25.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:06:24 smithi047 bash[22744]: cluster 2024-09-16T11:06:23.849631+0000 mgr.a (mgr.14373) 14239 : cluster [DBG] pgmap v9875: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:06:25.979 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:06:25.979 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:06:25.979 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:06:25.979 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:06:25.979 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:06:26.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:06:25 smithi157 bash[24585]: audit 2024-09-16T11:06:25.528101+0000 mgr.a (mgr.14373) 14240 : audit [DBG] from='client.308685 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:06:26.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:06:25 smithi157 bash[24585]: cluster 2024-09-16T11:06:25.850187+0000 mgr.a (mgr.14373) 14241 : cluster [DBG] pgmap v9876: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:06:26.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:06:25 smithi086 bash[24289]: audit 2024-09-16T11:06:25.528101+0000 mgr.a (mgr.14373) 14240 : audit [DBG] from='client.308685 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:06:26.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:06:25 smithi086 bash[24289]: cluster 2024-09-16T11:06:25.850187+0000 mgr.a (mgr.14373) 14241 : cluster [DBG] pgmap v9876: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:06:26.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:06:25 smithi047 bash[22744]: audit 2024-09-16T11:06:25.528101+0000 mgr.a (mgr.14373) 14240 : audit [DBG] from='client.308685 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:06:26.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:06:25 smithi047 bash[22744]: cluster 2024-09-16T11:06:25.850187+0000 mgr.a (mgr.14373) 14241 : cluster [DBG] pgmap v9876: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:06:29.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:06:28 smithi157 bash[24585]: cluster 2024-09-16T11:06:27.852592+0000 mgr.a (mgr.14373) 14242 : cluster [DBG] pgmap v9877: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:06:29.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:06:28 smithi086 bash[24289]: cluster 2024-09-16T11:06:27.852592+0000 mgr.a (mgr.14373) 14242 : cluster [DBG] pgmap v9877: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:06:29.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:06:28 smithi047 bash[22744]: cluster 2024-09-16T11:06:27.852592+0000 mgr.a (mgr.14373) 14242 : cluster [DBG] pgmap v9877: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:06:30.980 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:06:30.981 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:06:30.981 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:06:31.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:06:30 smithi157 bash[24585]: cluster 2024-09-16T11:06:29.853557+0000 mgr.a (mgr.14373) 14243 : cluster [DBG] pgmap v9878: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:06:31.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:06:30 smithi086 bash[24289]: cluster 2024-09-16T11:06:29.853557+0000 mgr.a (mgr.14373) 14243 : cluster [DBG] pgmap v9878: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:06:31.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:06:30 smithi047 bash[22744]: cluster 2024-09-16T11:06:29.853557+0000 mgr.a (mgr.14373) 14243 : cluster [DBG] pgmap v9878: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:06:31.756 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:06:31.757 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:06:31.757 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:06:31.757 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:06:31.757 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:06:32.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:06:31 smithi157 bash[24585]: audit 2024-09-16T11:06:31.313871+0000 mgr.a (mgr.14373) 14244 : audit [DBG] from='client.308760 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:06:32.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:06:31 smithi157 bash[24585]: cluster 2024-09-16T11:06:31.856386+0000 mgr.a (mgr.14373) 14245 : cluster [DBG] pgmap v9879: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-16T11:06:32.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:06:31 smithi086 bash[24289]: audit 2024-09-16T11:06:31.313871+0000 mgr.a (mgr.14373) 14244 : audit [DBG] from='client.308760 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:06:32.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:06:31 smithi086 bash[24289]: cluster 2024-09-16T11:06:31.856386+0000 mgr.a (mgr.14373) 14245 : cluster [DBG] pgmap v9879: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-16T11:06:32.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:06:31 smithi047 bash[22744]: audit 2024-09-16T11:06:31.313871+0000 mgr.a (mgr.14373) 14244 : audit [DBG] from='client.308760 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:06:32.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:06:31 smithi047 bash[22744]: cluster 2024-09-16T11:06:31.856386+0000 mgr.a (mgr.14373) 14245 : cluster [DBG] pgmap v9879: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-16T11:06:35.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:06:34 smithi157 bash[24585]: cluster 2024-09-16T11:06:33.857145+0000 mgr.a (mgr.14373) 14246 : cluster [DBG] pgmap v9880: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T11:06:35.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:06:34 smithi086 bash[24289]: cluster 2024-09-16T11:06:33.857145+0000 mgr.a (mgr.14373) 14246 : cluster [DBG] pgmap v9880: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T11:06:35.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:06:34 smithi047 bash[22744]: cluster 2024-09-16T11:06:33.857145+0000 mgr.a (mgr.14373) 14246 : cluster [DBG] pgmap v9880: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T11:06:36.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:06:35 smithi157 bash[24585]: cluster 2024-09-16T11:06:35.857889+0000 mgr.a (mgr.14373) 14247 : cluster [DBG] pgmap v9881: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T11:06:36.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:06:35 smithi086 bash[24289]: cluster 2024-09-16T11:06:35.857889+0000 mgr.a (mgr.14373) 14247 : cluster [DBG] pgmap v9881: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T11:06:36.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:06:35 smithi047 bash[22744]: cluster 2024-09-16T11:06:35.857889+0000 mgr.a (mgr.14373) 14247 : cluster [DBG] pgmap v9881: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T11:06:36.758 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:06:36.758 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:06:36.759 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:06:37.504 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:06:37.505 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:06:37.505 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:06:37.505 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:06:37.505 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:06:38.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:06:37 smithi157 bash[24585]: audit 2024-09-16T11:06:37.090031+0000 mgr.a (mgr.14373) 14248 : audit [DBG] from='client.308838 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:06:38.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:06:37 smithi157 bash[24585]: cluster 2024-09-16T11:06:37.860542+0000 mgr.a (mgr.14373) 14249 : cluster [DBG] pgmap v9882: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:06:38.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:06:37 smithi086 bash[24289]: audit 2024-09-16T11:06:37.090031+0000 mgr.a (mgr.14373) 14248 : audit [DBG] from='client.308838 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:06:38.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:06:37 smithi086 bash[24289]: cluster 2024-09-16T11:06:37.860542+0000 mgr.a (mgr.14373) 14249 : cluster [DBG] pgmap v9882: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:06:38.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:06:37 smithi047 bash[22744]: audit 2024-09-16T11:06:37.090031+0000 mgr.a (mgr.14373) 14248 : audit [DBG] from='client.308838 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:06:38.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:06:37 smithi047 bash[22744]: cluster 2024-09-16T11:06:37.860542+0000 mgr.a (mgr.14373) 14249 : cluster [DBG] pgmap v9882: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:06:40.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:06:39 smithi157 bash[24585]: cluster 2024-09-16T11:06:39.861311+0000 mgr.a (mgr.14373) 14250 : cluster [DBG] pgmap v9883: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:06:40.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:06:39 smithi086 bash[24289]: cluster 2024-09-16T11:06:39.861311+0000 mgr.a (mgr.14373) 14250 : cluster [DBG] pgmap v9883: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:06:40.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:06:39 smithi047 bash[22744]: cluster 2024-09-16T11:06:39.861311+0000 mgr.a (mgr.14373) 14250 : cluster [DBG] pgmap v9883: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:06:42.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:06:41 smithi157 bash[24585]: cluster 2024-09-16T11:06:41.863312+0000 mgr.a (mgr.14373) 14251 : cluster [DBG] pgmap v9884: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:06:42.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:06:41 smithi086 bash[24289]: cluster 2024-09-16T11:06:41.863312+0000 mgr.a (mgr.14373) 14251 : cluster [DBG] pgmap v9884: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:06:42.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:06:41 smithi047 bash[22744]: cluster 2024-09-16T11:06:41.863312+0000 mgr.a (mgr.14373) 14251 : cluster [DBG] pgmap v9884: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:06:42.506 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:06:42.506 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:06:42.507 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:06:43.268 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:06:43.269 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:06:43.269 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:06:43.269 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:06:43.269 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:06:43.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:06:42 smithi157 bash[24585]: audit 2024-09-16T11:06:42.834778+0000 mgr.a (mgr.14373) 14252 : audit [DBG] from='client.308916 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:06:43.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:06:42 smithi086 bash[24289]: audit 2024-09-16T11:06:42.834778+0000 mgr.a (mgr.14373) 14252 : audit [DBG] from='client.308916 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:06:43.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:06:42 smithi047 bash[22744]: audit 2024-09-16T11:06:42.834778+0000 mgr.a (mgr.14373) 14252 : audit [DBG] from='client.308916 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:06:44.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:06:43 smithi157 bash[24585]: cluster 2024-09-16T11:06:43.864217+0000 mgr.a (mgr.14373) 14253 : cluster [DBG] pgmap v9885: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-16T11:06:44.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:06:43 smithi086 bash[24289]: cluster 2024-09-16T11:06:43.864217+0000 mgr.a (mgr.14373) 14253 : cluster [DBG] pgmap v9885: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-16T11:06:44.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:06:43 smithi047 bash[22744]: cluster 2024-09-16T11:06:43.864217+0000 mgr.a (mgr.14373) 14253 : cluster [DBG] pgmap v9885: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-16T11:06:46.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:06:45 smithi157 bash[24585]: cluster 2024-09-16T11:06:45.865072+0000 mgr.a (mgr.14373) 14254 : cluster [DBG] pgmap v9886: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-16T11:06:46.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:06:45 smithi086 bash[24289]: cluster 2024-09-16T11:06:45.865072+0000 mgr.a (mgr.14373) 14254 : cluster [DBG] pgmap v9886: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-16T11:06:46.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:06:45 smithi047 bash[22744]: cluster 2024-09-16T11:06:45.865072+0000 mgr.a (mgr.14373) 14254 : cluster [DBG] pgmap v9886: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-16T11:06:48.270 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:06:48.271 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:06:48.271 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:06:48.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:06:47 smithi157 bash[24585]: cluster 2024-09-16T11:06:47.867287+0000 mgr.a (mgr.14373) 14255 : cluster [DBG] pgmap v9887: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-16T11:06:48.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:06:47 smithi086 bash[24289]: cluster 2024-09-16T11:06:47.867287+0000 mgr.a (mgr.14373) 14255 : cluster [DBG] pgmap v9887: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-16T11:06:48.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:06:47 smithi047 bash[22744]: cluster 2024-09-16T11:06:47.867287+0000 mgr.a (mgr.14373) 14255 : cluster [DBG] pgmap v9887: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-16T11:06:49.056 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:06:49.056 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:06:49.056 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:06:49.056 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:06:49.056 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:06:49.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:06:48 smithi157 bash[24585]: audit 2024-09-16T11:06:48.607075+0000 mgr.a (mgr.14373) 14256 : audit [DBG] from='client.308988 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:06:49.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:06:48 smithi086 bash[24289]: audit 2024-09-16T11:06:48.607075+0000 mgr.a (mgr.14373) 14256 : audit [DBG] from='client.308988 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:06:49.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:06:48 smithi047 bash[22744]: audit 2024-09-16T11:06:48.607075+0000 mgr.a (mgr.14373) 14256 : audit [DBG] from='client.308988 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:06:50.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:06:49 smithi157 bash[24585]: cluster 2024-09-16T11:06:49.868199+0000 mgr.a (mgr.14373) 14257 : cluster [DBG] pgmap v9888: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:06:50.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:06:49 smithi086 bash[24289]: cluster 2024-09-16T11:06:49.868199+0000 mgr.a (mgr.14373) 14257 : cluster [DBG] pgmap v9888: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:06:50.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:06:49 smithi047 bash[22744]: cluster 2024-09-16T11:06:49.868199+0000 mgr.a (mgr.14373) 14257 : cluster [DBG] pgmap v9888: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:06:52.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:06:51 smithi157 bash[24585]: cluster 2024-09-16T11:06:51.870438+0000 mgr.a (mgr.14373) 14258 : cluster [DBG] pgmap v9889: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:06:52.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:06:51 smithi086 bash[24289]: cluster 2024-09-16T11:06:51.870438+0000 mgr.a (mgr.14373) 14258 : cluster [DBG] pgmap v9889: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:06:52.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:06:51 smithi047 bash[22744]: cluster 2024-09-16T11:06:51.870438+0000 mgr.a (mgr.14373) 14258 : cluster [DBG] pgmap v9889: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:06:54.057 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:06:54.058 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:06:54.058 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:06:54.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:06:53 smithi157 bash[24585]: cluster 2024-09-16T11:06:53.871133+0000 mgr.a (mgr.14373) 14259 : cluster [DBG] pgmap v9890: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:06:54.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:06:53 smithi086 bash[24289]: cluster 2024-09-16T11:06:53.871133+0000 mgr.a (mgr.14373) 14259 : cluster [DBG] pgmap v9890: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:06:54.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:06:53 smithi047 bash[22744]: cluster 2024-09-16T11:06:53.871133+0000 mgr.a (mgr.14373) 14259 : cluster [DBG] pgmap v9890: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:06:54.848 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:06:54.848 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:06:54.849 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:06:54.849 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:06:54.849 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:06:55.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:06:54 smithi157 bash[24585]: audit 2024-09-16T11:06:54.396667+0000 mgr.a (mgr.14373) 14260 : audit [DBG] from='client.309063 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:06:55.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:06:54 smithi086 bash[24289]: audit 2024-09-16T11:06:54.396667+0000 mgr.a (mgr.14373) 14260 : audit [DBG] from='client.309063 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:06:55.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:06:54 smithi047 bash[22744]: audit 2024-09-16T11:06:54.396667+0000 mgr.a (mgr.14373) 14260 : audit [DBG] from='client.309063 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:06:56.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:06:55 smithi157 bash[24585]: cluster 2024-09-16T11:06:55.872161+0000 mgr.a (mgr.14373) 14261 : cluster [DBG] pgmap v9891: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:06:56.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:06:55 smithi086 bash[24289]: cluster 2024-09-16T11:06:55.872161+0000 mgr.a (mgr.14373) 14261 : cluster [DBG] pgmap v9891: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:06:56.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:06:55 smithi047 bash[22744]: cluster 2024-09-16T11:06:55.872161+0000 mgr.a (mgr.14373) 14261 : cluster [DBG] pgmap v9891: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:06:57.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:06:56 smithi157 bash[24585]: audit 2024-09-16T11:06:56.022289+0000 mon.b (mon.2) 1302 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T11:06:57.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:06:56 smithi157 bash[24585]: audit 2024-09-16T11:06:56.864796+0000 mon.b (mon.2) 1303 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T11:06:57.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:06:56 smithi157 bash[24585]: audit 2024-09-16T11:06:56.866996+0000 mon.b (mon.2) 1304 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T11:06:57.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:06:56 smithi157 bash[24585]: audit 2024-09-16T11:06:56.876576+0000 mon.a (mon.0) 1416 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:06:57.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:06:56 smithi157 bash[24585]: audit 2024-09-16T11:06:56.883820+0000 mon.b (mon.2) 1305 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:06:57.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:06:56 smithi157 bash[24585]: audit 2024-09-16T11:06:56.886683+0000 mgr.a (mgr.14373) 14262 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:06:57.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:06:56 smithi086 bash[24289]: audit 2024-09-16T11:06:56.022289+0000 mon.b (mon.2) 1302 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T11:06:57.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:06:56 smithi086 bash[24289]: audit 2024-09-16T11:06:56.864796+0000 mon.b (mon.2) 1303 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T11:06:57.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:06:56 smithi086 bash[24289]: audit 2024-09-16T11:06:56.866996+0000 mon.b (mon.2) 1304 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T11:06:57.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:06:56 smithi086 bash[24289]: audit 2024-09-16T11:06:56.876576+0000 mon.a (mon.0) 1416 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:06:57.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:06:56 smithi086 bash[24289]: audit 2024-09-16T11:06:56.883820+0000 mon.b (mon.2) 1305 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:06:57.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:06:56 smithi086 bash[24289]: audit 2024-09-16T11:06:56.886683+0000 mgr.a (mgr.14373) 14262 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:06:57.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:06:56 smithi047 bash[22744]: audit 2024-09-16T11:06:56.022289+0000 mon.b (mon.2) 1302 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T11:06:57.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:06:56 smithi047 bash[22744]: audit 2024-09-16T11:06:56.864796+0000 mon.b (mon.2) 1303 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T11:06:57.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:06:56 smithi047 bash[22744]: audit 2024-09-16T11:06:56.866996+0000 mon.b (mon.2) 1304 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T11:06:57.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:06:56 smithi047 bash[22744]: audit 2024-09-16T11:06:56.876576+0000 mon.a (mon.0) 1416 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:06:57.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:06:56 smithi047 bash[22744]: audit 2024-09-16T11:06:56.883820+0000 mon.b (mon.2) 1305 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:06:57.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:06:56 smithi047 bash[22744]: audit 2024-09-16T11:06:56.886683+0000 mgr.a (mgr.14373) 14262 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:06:57.992 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 11:06:57 smithi047 bash[22994]: debug 2024-09-16T11:06:57.634+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T11:06:57.993 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 11:06:57 smithi047 bash[22994]: debug 2024-09-16T11:06:57.638+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T11:06:58.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:06:57 smithi157 bash[24585]: audit 2024-09-16T11:06:57.641893+0000 mgr.a (mgr.14373) 14263 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T11:06:58.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:06:57 smithi157 bash[24585]: cephadm 2024-09-16T11:06:57.643919+0000 mgr.a (mgr.14373) 14264 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T11:06:58.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:06:57 smithi157 bash[24585]: cluster 2024-09-16T11:06:57.874911+0000 mgr.a (mgr.14373) 14265 : cluster [DBG] pgmap v9892: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:06:58.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:06:57 smithi086 bash[24289]: audit 2024-09-16T11:06:57.641893+0000 mgr.a (mgr.14373) 14263 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T11:06:58.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:06:57 smithi086 bash[24289]: cephadm 2024-09-16T11:06:57.643919+0000 mgr.a (mgr.14373) 14264 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T11:06:58.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:06:57 smithi086 bash[24289]: cluster 2024-09-16T11:06:57.874911+0000 mgr.a (mgr.14373) 14265 : cluster [DBG] pgmap v9892: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:06:58.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:06:57 smithi047 bash[22744]: audit 2024-09-16T11:06:57.641893+0000 mgr.a (mgr.14373) 14263 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T11:06:58.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:06:57 smithi047 bash[22744]: cephadm 2024-09-16T11:06:57.643919+0000 mgr.a (mgr.14373) 14264 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T11:06:58.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:06:57 smithi047 bash[22744]: cluster 2024-09-16T11:06:57.874911+0000 mgr.a (mgr.14373) 14265 : cluster [DBG] pgmap v9892: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:06:59.850 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:06:59.851 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:06:59.851 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:07:00.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:06:59 smithi157 bash[24585]: cluster 2024-09-16T11:06:59.875496+0000 mgr.a (mgr.14373) 14266 : cluster [DBG] pgmap v9893: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:07:00.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:06:59 smithi086 bash[24289]: cluster 2024-09-16T11:06:59.875496+0000 mgr.a (mgr.14373) 14266 : cluster [DBG] pgmap v9893: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:07:00.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:06:59 smithi047 bash[22744]: cluster 2024-09-16T11:06:59.875496+0000 mgr.a (mgr.14373) 14266 : cluster [DBG] pgmap v9893: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:07:00.609 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:07:00.609 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:07:00.609 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:07:00.609 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:07:00.610 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:07:01.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:07:00 smithi157 bash[24585]: audit 2024-09-16T11:07:00.182614+0000 mgr.a (mgr.14373) 14267 : audit [DBG] from='client.309243 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:07:01.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:07:00 smithi086 bash[24289]: audit 2024-09-16T11:07:00.182614+0000 mgr.a (mgr.14373) 14267 : audit [DBG] from='client.309243 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:07:01.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:07:00 smithi047 bash[22744]: audit 2024-09-16T11:07:00.182614+0000 mgr.a (mgr.14373) 14267 : audit [DBG] from='client.309243 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:07:02.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:07:01 smithi157 bash[24585]: cluster 2024-09-16T11:07:01.877784+0000 mgr.a (mgr.14373) 14268 : cluster [DBG] pgmap v9894: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:07:02.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:07:01 smithi086 bash[24289]: cluster 2024-09-16T11:07:01.877784+0000 mgr.a (mgr.14373) 14268 : cluster [DBG] pgmap v9894: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:07:02.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:07:01 smithi047 bash[22744]: cluster 2024-09-16T11:07:01.877784+0000 mgr.a (mgr.14373) 14268 : cluster [DBG] pgmap v9894: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:07:04.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:07:03 smithi157 bash[24585]: cluster 2024-09-16T11:07:03.878606+0000 mgr.a (mgr.14373) 14269 : cluster [DBG] pgmap v9895: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:07:04.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:07:03 smithi086 bash[24289]: cluster 2024-09-16T11:07:03.878606+0000 mgr.a (mgr.14373) 14269 : cluster [DBG] pgmap v9895: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:07:04.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:07:03 smithi047 bash[22744]: cluster 2024-09-16T11:07:03.878606+0000 mgr.a (mgr.14373) 14269 : cluster [DBG] pgmap v9895: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:07:05.611 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:07:05.611 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:07:05.611 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:07:06.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:07:05 smithi157 bash[24585]: cluster 2024-09-16T11:07:05.879370+0000 mgr.a (mgr.14373) 14270 : cluster [DBG] pgmap v9896: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:07:06.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:07:05 smithi086 bash[24289]: cluster 2024-09-16T11:07:05.879370+0000 mgr.a (mgr.14373) 14270 : cluster [DBG] pgmap v9896: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:07:06.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:07:05 smithi047 bash[22744]: cluster 2024-09-16T11:07:05.879370+0000 mgr.a (mgr.14373) 14270 : cluster [DBG] pgmap v9896: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:07:06.370 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:07:06.370 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:07:06.370 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:07:06.370 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:07:06.371 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:07:07.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:07:06 smithi157 bash[24585]: audit 2024-09-16T11:07:05.939427+0000 mgr.a (mgr.14373) 14271 : audit [DBG] from='client.309318 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:07:07.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:07:06 smithi086 bash[24289]: audit 2024-09-16T11:07:05.939427+0000 mgr.a (mgr.14373) 14271 : audit [DBG] from='client.309318 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:07:07.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:07:06 smithi047 bash[22744]: audit 2024-09-16T11:07:05.939427+0000 mgr.a (mgr.14373) 14271 : audit [DBG] from='client.309318 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:07:08.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:07:07 smithi157 bash[24585]: cluster 2024-09-16T11:07:07.881889+0000 mgr.a (mgr.14373) 14272 : cluster [DBG] pgmap v9897: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:07:08.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:07:07 smithi086 bash[24289]: cluster 2024-09-16T11:07:07.881889+0000 mgr.a (mgr.14373) 14272 : cluster [DBG] pgmap v9897: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:07:08.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:07:07 smithi047 bash[22744]: cluster 2024-09-16T11:07:07.881889+0000 mgr.a (mgr.14373) 14272 : cluster [DBG] pgmap v9897: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:07:10.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:07:09 smithi157 bash[24585]: cluster 2024-09-16T11:07:09.882665+0000 mgr.a (mgr.14373) 14273 : cluster [DBG] pgmap v9898: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:07:10.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:07:09 smithi086 bash[24289]: cluster 2024-09-16T11:07:09.882665+0000 mgr.a (mgr.14373) 14273 : cluster [DBG] pgmap v9898: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:07:10.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:07:09 smithi047 bash[22744]: cluster 2024-09-16T11:07:09.882665+0000 mgr.a (mgr.14373) 14273 : cluster [DBG] pgmap v9898: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:07:11.371 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:07:11.372 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:07:11.372 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:07:12.133 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:07:12.133 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:07:12.133 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:07:12.133 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:07:12.133 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:07:12.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:07:11 smithi157 bash[24585]: audit 2024-09-16T11:07:11.703530+0000 mgr.a (mgr.14373) 14274 : audit [DBG] from='client.309393 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:07:12.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:07:11 smithi157 bash[24585]: cluster 2024-09-16T11:07:11.883979+0000 mgr.a (mgr.14373) 14275 : cluster [DBG] pgmap v9899: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:07:12.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:07:11 smithi086 bash[24289]: audit 2024-09-16T11:07:11.703530+0000 mgr.a (mgr.14373) 14274 : audit [DBG] from='client.309393 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:07:12.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:07:11 smithi086 bash[24289]: cluster 2024-09-16T11:07:11.883979+0000 mgr.a (mgr.14373) 14275 : cluster [DBG] pgmap v9899: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:07:12.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:07:11 smithi047 bash[22744]: audit 2024-09-16T11:07:11.703530+0000 mgr.a (mgr.14373) 14274 : audit [DBG] from='client.309393 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:07:12.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:07:11 smithi047 bash[22744]: cluster 2024-09-16T11:07:11.883979+0000 mgr.a (mgr.14373) 14275 : cluster [DBG] pgmap v9899: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:07:14.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:07:13 smithi157 bash[24585]: cluster 2024-09-16T11:07:13.884834+0000 mgr.a (mgr.14373) 14276 : cluster [DBG] pgmap v9900: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T11:07:14.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:07:13 smithi086 bash[24289]: cluster 2024-09-16T11:07:13.884834+0000 mgr.a (mgr.14373) 14276 : cluster [DBG] pgmap v9900: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T11:07:14.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:07:13 smithi047 bash[22744]: cluster 2024-09-16T11:07:13.884834+0000 mgr.a (mgr.14373) 14276 : cluster [DBG] pgmap v9900: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T11:07:16.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:07:15 smithi157 bash[24585]: cluster 2024-09-16T11:07:15.885611+0000 mgr.a (mgr.14373) 14277 : cluster [DBG] pgmap v9901: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T11:07:16.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:07:15 smithi086 bash[24289]: cluster 2024-09-16T11:07:15.885611+0000 mgr.a (mgr.14373) 14277 : cluster [DBG] pgmap v9901: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T11:07:16.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:07:15 smithi047 bash[22744]: cluster 2024-09-16T11:07:15.885611+0000 mgr.a (mgr.14373) 14277 : cluster [DBG] pgmap v9901: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T11:07:17.134 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:07:17.135 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:07:17.135 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:07:17.875 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:07:17.876 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:07:17.876 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:07:17.876 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:07:17.876 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:07:18.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:07:17 smithi157 bash[24585]: audit 2024-09-16T11:07:17.461725+0000 mgr.a (mgr.14373) 14278 : audit [DBG] from='client.309471 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:07:18.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:07:17 smithi157 bash[24585]: cluster 2024-09-16T11:07:17.886744+0000 mgr.a (mgr.14373) 14279 : cluster [DBG] pgmap v9902: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:07:18.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:07:17 smithi086 bash[24289]: audit 2024-09-16T11:07:17.461725+0000 mgr.a (mgr.14373) 14278 : audit [DBG] from='client.309471 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:07:18.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:07:17 smithi086 bash[24289]: cluster 2024-09-16T11:07:17.886744+0000 mgr.a (mgr.14373) 14279 : cluster [DBG] pgmap v9902: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:07:18.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:07:17 smithi047 bash[22744]: audit 2024-09-16T11:07:17.461725+0000 mgr.a (mgr.14373) 14278 : audit [DBG] from='client.309471 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:07:18.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:07:17 smithi047 bash[22744]: cluster 2024-09-16T11:07:17.886744+0000 mgr.a (mgr.14373) 14279 : cluster [DBG] pgmap v9902: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:07:20.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:07:19 smithi157 bash[24585]: cluster 2024-09-16T11:07:19.887474+0000 mgr.a (mgr.14373) 14280 : cluster [DBG] pgmap v9903: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T11:07:20.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:07:19 smithi086 bash[24289]: cluster 2024-09-16T11:07:19.887474+0000 mgr.a (mgr.14373) 14280 : cluster [DBG] pgmap v9903: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T11:07:20.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:07:19 smithi047 bash[22744]: cluster 2024-09-16T11:07:19.887474+0000 mgr.a (mgr.14373) 14280 : cluster [DBG] pgmap v9903: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T11:07:22.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:07:21 smithi157 bash[24585]: cluster 2024-09-16T11:07:21.889459+0000 mgr.a (mgr.14373) 14281 : cluster [DBG] pgmap v9904: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:07:22.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:07:21 smithi086 bash[24289]: cluster 2024-09-16T11:07:21.889459+0000 mgr.a (mgr.14373) 14281 : cluster [DBG] pgmap v9904: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:07:22.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:07:21 smithi047 bash[22744]: cluster 2024-09-16T11:07:21.889459+0000 mgr.a (mgr.14373) 14281 : cluster [DBG] pgmap v9904: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:07:22.877 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:07:22.878 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:07:22.878 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:07:23.621 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:07:23.621 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:07:23.621 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:07:23.621 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:07:23.621 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:07:24.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:07:23 smithi157 bash[24585]: audit 2024-09-16T11:07:23.203685+0000 mgr.a (mgr.14373) 14282 : audit [DBG] from='client.309549 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:07:24.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:07:23 smithi157 bash[24585]: cluster 2024-09-16T11:07:23.890319+0000 mgr.a (mgr.14373) 14283 : cluster [DBG] pgmap v9905: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:07:24.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:07:23 smithi086 bash[24289]: audit 2024-09-16T11:07:23.203685+0000 mgr.a (mgr.14373) 14282 : audit [DBG] from='client.309549 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:07:24.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:07:23 smithi086 bash[24289]: cluster 2024-09-16T11:07:23.890319+0000 mgr.a (mgr.14373) 14283 : cluster [DBG] pgmap v9905: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:07:24.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:07:23 smithi047 bash[22744]: audit 2024-09-16T11:07:23.203685+0000 mgr.a (mgr.14373) 14282 : audit [DBG] from='client.309549 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:07:24.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:07:23 smithi047 bash[22744]: cluster 2024-09-16T11:07:23.890319+0000 mgr.a (mgr.14373) 14283 : cluster [DBG] pgmap v9905: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:07:26.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:07:25 smithi157 bash[24585]: cluster 2024-09-16T11:07:25.891147+0000 mgr.a (mgr.14373) 14284 : cluster [DBG] pgmap v9906: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:07:26.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:07:25 smithi086 bash[24289]: cluster 2024-09-16T11:07:25.891147+0000 mgr.a (mgr.14373) 14284 : cluster [DBG] pgmap v9906: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:07:26.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:07:25 smithi047 bash[22744]: cluster 2024-09-16T11:07:25.891147+0000 mgr.a (mgr.14373) 14284 : cluster [DBG] pgmap v9906: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:07:28.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:07:27 smithi157 bash[24585]: cluster 2024-09-16T11:07:27.893333+0000 mgr.a (mgr.14373) 14285 : cluster [DBG] pgmap v9907: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:07:28.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:07:27 smithi086 bash[24289]: cluster 2024-09-16T11:07:27.893333+0000 mgr.a (mgr.14373) 14285 : cluster [DBG] pgmap v9907: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:07:28.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:07:27 smithi047 bash[22744]: cluster 2024-09-16T11:07:27.893333+0000 mgr.a (mgr.14373) 14285 : cluster [DBG] pgmap v9907: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:07:28.622 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:07:28.623 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:07:28.623 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:07:29.368 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:07:29.368 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:07:29.368 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:07:29.368 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:07:29.368 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:07:30.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:07:29 smithi157 bash[24585]: audit 2024-09-16T11:07:28.952335+0000 mgr.a (mgr.14373) 14286 : audit [DBG] from='client.309627 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:07:30.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:07:29 smithi157 bash[24585]: cluster 2024-09-16T11:07:29.894307+0000 mgr.a (mgr.14373) 14287 : cluster [DBG] pgmap v9908: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:07:30.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:07:29 smithi086 bash[24289]: audit 2024-09-16T11:07:28.952335+0000 mgr.a (mgr.14373) 14286 : audit [DBG] from='client.309627 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:07:30.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:07:29 smithi086 bash[24289]: cluster 2024-09-16T11:07:29.894307+0000 mgr.a (mgr.14373) 14287 : cluster [DBG] pgmap v9908: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:07:30.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:07:29 smithi047 bash[22744]: audit 2024-09-16T11:07:28.952335+0000 mgr.a (mgr.14373) 14286 : audit [DBG] from='client.309627 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:07:30.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:07:29 smithi047 bash[22744]: cluster 2024-09-16T11:07:29.894307+0000 mgr.a (mgr.14373) 14287 : cluster [DBG] pgmap v9908: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:07:32.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:07:31 smithi157 bash[24585]: cluster 2024-09-16T11:07:31.896431+0000 mgr.a (mgr.14373) 14288 : cluster [DBG] pgmap v9909: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:07:32.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:07:31 smithi086 bash[24289]: cluster 2024-09-16T11:07:31.896431+0000 mgr.a (mgr.14373) 14288 : cluster [DBG] pgmap v9909: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:07:32.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:07:31 smithi047 bash[22744]: cluster 2024-09-16T11:07:31.896431+0000 mgr.a (mgr.14373) 14288 : cluster [DBG] pgmap v9909: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:07:34.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:07:33 smithi157 bash[24585]: cluster 2024-09-16T11:07:33.897200+0000 mgr.a (mgr.14373) 14289 : cluster [DBG] pgmap v9910: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:07:34.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:07:33 smithi086 bash[24289]: cluster 2024-09-16T11:07:33.897200+0000 mgr.a (mgr.14373) 14289 : cluster [DBG] pgmap v9910: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:07:34.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:07:33 smithi047 bash[22744]: cluster 2024-09-16T11:07:33.897200+0000 mgr.a (mgr.14373) 14289 : cluster [DBG] pgmap v9910: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:07:34.369 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:07:34.370 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:07:34.370 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:07:35.113 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:07:35.113 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:07:35.113 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:07:35.114 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:07:35.114 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:07:35.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:07:34 smithi157 bash[24585]: audit 2024-09-16T11:07:34.698016+0000 mgr.a (mgr.14373) 14290 : audit [DBG] from='client.309702 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:07:35.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:07:34 smithi086 bash[24289]: audit 2024-09-16T11:07:34.698016+0000 mgr.a (mgr.14373) 14290 : audit [DBG] from='client.309702 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:07:35.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:07:34 smithi047 bash[22744]: audit 2024-09-16T11:07:34.698016+0000 mgr.a (mgr.14373) 14290 : audit [DBG] from='client.309702 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:07:36.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:07:35 smithi157 bash[24585]: cluster 2024-09-16T11:07:35.898177+0000 mgr.a (mgr.14373) 14291 : cluster [DBG] pgmap v9911: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:07:36.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:07:35 smithi086 bash[24289]: cluster 2024-09-16T11:07:35.898177+0000 mgr.a (mgr.14373) 14291 : cluster [DBG] pgmap v9911: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:07:36.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:07:35 smithi047 bash[22744]: cluster 2024-09-16T11:07:35.898177+0000 mgr.a (mgr.14373) 14291 : cluster [DBG] pgmap v9911: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:07:38.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:07:37 smithi157 bash[24585]: cluster 2024-09-16T11:07:37.900397+0000 mgr.a (mgr.14373) 14292 : cluster [DBG] pgmap v9912: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:07:38.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:07:37 smithi086 bash[24289]: cluster 2024-09-16T11:07:37.900397+0000 mgr.a (mgr.14373) 14292 : cluster [DBG] pgmap v9912: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:07:38.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:07:37 smithi047 bash[22744]: cluster 2024-09-16T11:07:37.900397+0000 mgr.a (mgr.14373) 14292 : cluster [DBG] pgmap v9912: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:07:40.115 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:07:40.115 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:07:40.115 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:07:40.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:07:39 smithi157 bash[24585]: cluster 2024-09-16T11:07:39.901129+0000 mgr.a (mgr.14373) 14293 : cluster [DBG] pgmap v9913: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:07:40.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:07:39 smithi086 bash[24289]: cluster 2024-09-16T11:07:39.901129+0000 mgr.a (mgr.14373) 14293 : cluster [DBG] pgmap v9913: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:07:40.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:07:39 smithi047 bash[22744]: cluster 2024-09-16T11:07:39.901129+0000 mgr.a (mgr.14373) 14293 : cluster [DBG] pgmap v9913: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:07:40.870 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:07:40.870 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:07:40.871 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:07:40.871 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:07:40.871 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:07:41.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:07:40 smithi157 bash[24585]: audit 2024-09-16T11:07:40.444992+0000 mgr.a (mgr.14373) 14294 : audit [DBG] from='client.309777 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:07:41.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:07:40 smithi086 bash[24289]: audit 2024-09-16T11:07:40.444992+0000 mgr.a (mgr.14373) 14294 : audit [DBG] from='client.309777 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:07:41.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:07:40 smithi047 bash[22744]: audit 2024-09-16T11:07:40.444992+0000 mgr.a (mgr.14373) 14294 : audit [DBG] from='client.309777 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:07:42.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:07:41 smithi157 bash[24585]: cluster 2024-09-16T11:07:41.903403+0000 mgr.a (mgr.14373) 14295 : cluster [DBG] pgmap v9914: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:07:42.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:07:41 smithi086 bash[24289]: cluster 2024-09-16T11:07:41.903403+0000 mgr.a (mgr.14373) 14295 : cluster [DBG] pgmap v9914: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:07:42.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:07:41 smithi047 bash[22744]: cluster 2024-09-16T11:07:41.903403+0000 mgr.a (mgr.14373) 14295 : cluster [DBG] pgmap v9914: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:07:44.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:07:43 smithi157 bash[24585]: cluster 2024-09-16T11:07:43.904166+0000 mgr.a (mgr.14373) 14296 : cluster [DBG] pgmap v9915: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:07:44.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:07:43 smithi086 bash[24289]: cluster 2024-09-16T11:07:43.904166+0000 mgr.a (mgr.14373) 14296 : cluster [DBG] pgmap v9915: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:07:44.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:07:43 smithi047 bash[22744]: cluster 2024-09-16T11:07:43.904166+0000 mgr.a (mgr.14373) 14296 : cluster [DBG] pgmap v9915: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:07:45.872 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:07:45.873 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:07:45.873 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:07:46.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:07:45 smithi157 bash[24585]: cluster 2024-09-16T11:07:45.904869+0000 mgr.a (mgr.14373) 14297 : cluster [DBG] pgmap v9916: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:07:46.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:07:45 smithi086 bash[24289]: cluster 2024-09-16T11:07:45.904869+0000 mgr.a (mgr.14373) 14297 : cluster [DBG] pgmap v9916: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:07:46.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:07:45 smithi047 bash[22744]: cluster 2024-09-16T11:07:45.904869+0000 mgr.a (mgr.14373) 14297 : cluster [DBG] pgmap v9916: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:07:46.625 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:07:46.625 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:07:46.625 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:07:46.626 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:07:46.626 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:07:47.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:07:46 smithi157 bash[24585]: audit 2024-09-16T11:07:46.203412+0000 mgr.a (mgr.14373) 14298 : audit [DBG] from='client.309855 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:07:47.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:07:46 smithi086 bash[24289]: audit 2024-09-16T11:07:46.203412+0000 mgr.a (mgr.14373) 14298 : audit [DBG] from='client.309855 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:07:47.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:07:46 smithi047 bash[22744]: audit 2024-09-16T11:07:46.203412+0000 mgr.a (mgr.14373) 14298 : audit [DBG] from='client.309855 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:07:48.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:07:47 smithi157 bash[24585]: cluster 2024-09-16T11:07:47.907629+0000 mgr.a (mgr.14373) 14299 : cluster [DBG] pgmap v9917: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:07:48.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:07:47 smithi086 bash[24289]: cluster 2024-09-16T11:07:47.907629+0000 mgr.a (mgr.14373) 14299 : cluster [DBG] pgmap v9917: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:07:48.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:07:47 smithi047 bash[22744]: cluster 2024-09-16T11:07:47.907629+0000 mgr.a (mgr.14373) 14299 : cluster [DBG] pgmap v9917: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:07:50.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:07:49 smithi157 bash[24585]: cluster 2024-09-16T11:07:49.908382+0000 mgr.a (mgr.14373) 14300 : cluster [DBG] pgmap v9918: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:07:50.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:07:49 smithi086 bash[24289]: cluster 2024-09-16T11:07:49.908382+0000 mgr.a (mgr.14373) 14300 : cluster [DBG] pgmap v9918: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:07:50.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:07:49 smithi047 bash[22744]: cluster 2024-09-16T11:07:49.908382+0000 mgr.a (mgr.14373) 14300 : cluster [DBG] pgmap v9918: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:07:51.627 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:07:51.628 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:07:51.628 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:07:52.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:07:51 smithi157 bash[24585]: cluster 2024-09-16T11:07:51.910211+0000 mgr.a (mgr.14373) 14301 : cluster [DBG] pgmap v9919: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:07:52.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:07:51 smithi086 bash[24289]: cluster 2024-09-16T11:07:51.910211+0000 mgr.a (mgr.14373) 14301 : cluster [DBG] pgmap v9919: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:07:52.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:07:51 smithi047 bash[22744]: cluster 2024-09-16T11:07:51.910211+0000 mgr.a (mgr.14373) 14301 : cluster [DBG] pgmap v9919: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:07:52.385 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:07:52.385 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:07:52.385 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:07:52.385 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:07:52.385 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:07:53.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:07:52 smithi157 bash[24585]: audit 2024-09-16T11:07:51.955025+0000 mgr.a (mgr.14373) 14302 : audit [DBG] from='client.309933 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:07:53.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:07:52 smithi086 bash[24289]: audit 2024-09-16T11:07:51.955025+0000 mgr.a (mgr.14373) 14302 : audit [DBG] from='client.309933 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:07:53.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:07:52 smithi047 bash[22744]: audit 2024-09-16T11:07:51.955025+0000 mgr.a (mgr.14373) 14302 : audit [DBG] from='client.309933 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:07:54.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:07:53 smithi157 bash[24585]: cluster 2024-09-16T11:07:53.911169+0000 mgr.a (mgr.14373) 14303 : cluster [DBG] pgmap v9920: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:07:54.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:07:53 smithi086 bash[24289]: cluster 2024-09-16T11:07:53.911169+0000 mgr.a (mgr.14373) 14303 : cluster [DBG] pgmap v9920: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:07:54.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:07:53 smithi047 bash[22744]: cluster 2024-09-16T11:07:53.911169+0000 mgr.a (mgr.14373) 14303 : cluster [DBG] pgmap v9920: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:07:56.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:07:55 smithi157 bash[24585]: cluster 2024-09-16T11:07:55.911939+0000 mgr.a (mgr.14373) 14304 : cluster [DBG] pgmap v9921: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T11:07:56.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:07:55 smithi086 bash[24289]: cluster 2024-09-16T11:07:55.911939+0000 mgr.a (mgr.14373) 14304 : cluster [DBG] pgmap v9921: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T11:07:56.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:07:55 smithi047 bash[22744]: cluster 2024-09-16T11:07:55.911939+0000 mgr.a (mgr.14373) 14304 : cluster [DBG] pgmap v9921: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T11:07:57.386 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:07:57.387 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:07:57.387 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:07:58.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:07:57 smithi157 bash[24585]: audit 2024-09-16T11:07:57.697054+0000 mon.b (mon.2) 1306 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T11:07:58.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:07:57 smithi086 bash[24289]: audit 2024-09-16T11:07:57.697054+0000 mon.b (mon.2) 1306 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T11:07:58.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:07:57 smithi047 bash[22744]: audit 2024-09-16T11:07:57.697054+0000 mon.b (mon.2) 1306 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T11:07:58.171 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:07:58.171 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:07:58.171 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:07:58.171 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:07:58.171 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:07:59.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:07:58 smithi157 bash[24585]: audit 2024-09-16T11:07:57.743868+0000 mgr.a (mgr.14373) 14305 : audit [DBG] from='client.310011 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:07:59.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:07:58 smithi157 bash[24585]: cluster 2024-09-16T11:07:57.913602+0000 mgr.a (mgr.14373) 14306 : cluster [DBG] pgmap v9922: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:07:59.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:07:58 smithi157 bash[24585]: audit 2024-09-16T11:07:58.517904+0000 mon.b (mon.2) 1307 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T11:07:59.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:07:58 smithi157 bash[24585]: audit 2024-09-16T11:07:58.520162+0000 mon.b (mon.2) 1308 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T11:07:59.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:07:58 smithi157 bash[24585]: audit 2024-09-16T11:07:58.531347+0000 mon.a (mon.0) 1417 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:07:59.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:07:58 smithi157 bash[24585]: audit 2024-09-16T11:07:58.537324+0000 mon.b (mon.2) 1309 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:07:59.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:07:58 smithi086 bash[24289]: audit 2024-09-16T11:07:57.743868+0000 mgr.a (mgr.14373) 14305 : audit [DBG] from='client.310011 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:07:59.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:07:58 smithi086 bash[24289]: cluster 2024-09-16T11:07:57.913602+0000 mgr.a (mgr.14373) 14306 : cluster [DBG] pgmap v9922: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:07:59.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:07:58 smithi086 bash[24289]: audit 2024-09-16T11:07:58.517904+0000 mon.b (mon.2) 1307 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T11:07:59.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:07:58 smithi086 bash[24289]: audit 2024-09-16T11:07:58.520162+0000 mon.b (mon.2) 1308 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T11:07:59.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:07:58 smithi086 bash[24289]: audit 2024-09-16T11:07:58.531347+0000 mon.a (mon.0) 1417 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:07:59.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:07:58 smithi086 bash[24289]: audit 2024-09-16T11:07:58.537324+0000 mon.b (mon.2) 1309 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:07:59.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:07:58 smithi047 bash[22744]: audit 2024-09-16T11:07:57.743868+0000 mgr.a (mgr.14373) 14305 : audit [DBG] from='client.310011 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:07:59.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:07:58 smithi047 bash[22744]: cluster 2024-09-16T11:07:57.913602+0000 mgr.a (mgr.14373) 14306 : cluster [DBG] pgmap v9922: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:07:59.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:07:58 smithi047 bash[22744]: audit 2024-09-16T11:07:58.517904+0000 mon.b (mon.2) 1307 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T11:07:59.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:07:58 smithi047 bash[22744]: audit 2024-09-16T11:07:58.520162+0000 mon.b (mon.2) 1308 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T11:07:59.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:07:58 smithi047 bash[22744]: audit 2024-09-16T11:07:58.531347+0000 mon.a (mon.0) 1417 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:07:59.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:07:58 smithi047 bash[22744]: audit 2024-09-16T11:07:58.537324+0000 mon.b (mon.2) 1309 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:07:59.592 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 11:07:59 smithi047 bash[22994]: debug 2024-09-16T11:07:59.273+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T11:07:59.592 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 11:07:59 smithi047 bash[22994]: debug 2024-09-16T11:07:59.277+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T11:08:00.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:07:59 smithi157 bash[24585]: audit 2024-09-16T11:07:58.540332+0000 mgr.a (mgr.14373) 14307 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:08:00.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:07:59 smithi086 bash[24289]: audit 2024-09-16T11:07:58.540332+0000 mgr.a (mgr.14373) 14307 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:08:00.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:07:59 smithi047 bash[22744]: audit 2024-09-16T11:07:58.540332+0000 mgr.a (mgr.14373) 14307 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:08:01.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:08:00 smithi157 bash[24585]: audit 2024-09-16T11:07:59.278199+0000 mgr.a (mgr.14373) 14308 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T11:08:01.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:08:00 smithi157 bash[24585]: cephadm 2024-09-16T11:07:59.280673+0000 mgr.a (mgr.14373) 14309 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T11:08:01.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:08:00 smithi157 bash[24585]: cluster 2024-09-16T11:07:59.914572+0000 mgr.a (mgr.14373) 14310 : cluster [DBG] pgmap v9923: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:08:01.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:08:00 smithi086 bash[24289]: audit 2024-09-16T11:07:59.278199+0000 mgr.a (mgr.14373) 14308 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T11:08:01.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:08:00 smithi086 bash[24289]: cephadm 2024-09-16T11:07:59.280673+0000 mgr.a (mgr.14373) 14309 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T11:08:01.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:08:00 smithi086 bash[24289]: cluster 2024-09-16T11:07:59.914572+0000 mgr.a (mgr.14373) 14310 : cluster [DBG] pgmap v9923: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:08:01.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:08:00 smithi047 bash[22744]: audit 2024-09-16T11:07:59.278199+0000 mgr.a (mgr.14373) 14308 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T11:08:01.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:08:00 smithi047 bash[22744]: cephadm 2024-09-16T11:07:59.280673+0000 mgr.a (mgr.14373) 14309 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T11:08:01.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:08:00 smithi047 bash[22744]: cluster 2024-09-16T11:07:59.914572+0000 mgr.a (mgr.14373) 14310 : cluster [DBG] pgmap v9923: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:08:02.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:08:01 smithi157 bash[24585]: cluster 2024-09-16T11:08:01.916711+0000 mgr.a (mgr.14373) 14311 : cluster [DBG] pgmap v9924: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:08:02.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:08:01 smithi086 bash[24289]: cluster 2024-09-16T11:08:01.916711+0000 mgr.a (mgr.14373) 14311 : cluster [DBG] pgmap v9924: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:08:02.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:08:01 smithi047 bash[22744]: cluster 2024-09-16T11:08:01.916711+0000 mgr.a (mgr.14373) 14311 : cluster [DBG] pgmap v9924: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:08:03.172 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:08:03.173 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:08:03.173 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:08:03.926 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:08:03.926 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:08:03.926 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:08:03.926 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:08:03.926 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:08:04.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:08:03 smithi157 bash[24585]: audit 2024-09-16T11:08:03.505160+0000 mgr.a (mgr.14373) 14312 : audit [DBG] from='client.310194 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:08:04.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:08:03 smithi157 bash[24585]: cluster 2024-09-16T11:08:03.917197+0000 mgr.a (mgr.14373) 14313 : cluster [DBG] pgmap v9925: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:08:04.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:08:03 smithi086 bash[24289]: audit 2024-09-16T11:08:03.505160+0000 mgr.a (mgr.14373) 14312 : audit [DBG] from='client.310194 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:08:04.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:08:03 smithi086 bash[24289]: cluster 2024-09-16T11:08:03.917197+0000 mgr.a (mgr.14373) 14313 : cluster [DBG] pgmap v9925: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:08:04.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:08:03 smithi047 bash[22744]: audit 2024-09-16T11:08:03.505160+0000 mgr.a (mgr.14373) 14312 : audit [DBG] from='client.310194 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:08:04.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:08:03 smithi047 bash[22744]: cluster 2024-09-16T11:08:03.917197+0000 mgr.a (mgr.14373) 14313 : cluster [DBG] pgmap v9925: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:08:06.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:08:05 smithi157 bash[24585]: cluster 2024-09-16T11:08:05.917970+0000 mgr.a (mgr.14373) 14314 : cluster [DBG] pgmap v9926: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:08:06.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:08:05 smithi086 bash[24289]: cluster 2024-09-16T11:08:05.917970+0000 mgr.a (mgr.14373) 14314 : cluster [DBG] pgmap v9926: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:08:06.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:08:05 smithi047 bash[22744]: cluster 2024-09-16T11:08:05.917970+0000 mgr.a (mgr.14373) 14314 : cluster [DBG] pgmap v9926: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:08:08.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:08:07 smithi157 bash[24585]: cluster 2024-09-16T11:08:07.920257+0000 mgr.a (mgr.14373) 14315 : cluster [DBG] pgmap v9927: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 12 KiB/s rd, 426 B/s wr, 14 op/s 2024-09-16T11:08:08.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:08:07 smithi086 bash[24289]: cluster 2024-09-16T11:08:07.920257+0000 mgr.a (mgr.14373) 14315 : cluster [DBG] pgmap v9927: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 12 KiB/s rd, 426 B/s wr, 14 op/s 2024-09-16T11:08:08.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:08:07 smithi047 bash[22744]: cluster 2024-09-16T11:08:07.920257+0000 mgr.a (mgr.14373) 14315 : cluster [DBG] pgmap v9927: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 12 KiB/s rd, 426 B/s wr, 14 op/s 2024-09-16T11:08:08.927 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:08:08.928 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:08:08.928 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:08:09.679 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:08:09.679 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:08:09.679 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:08:09.679 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:08:09.679 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:08:10.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:08:09 smithi157 bash[24585]: audit 2024-09-16T11:08:09.260358+0000 mgr.a (mgr.14373) 14316 : audit [DBG] from='client.310272 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:08:10.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:08:09 smithi157 bash[24585]: cluster 2024-09-16T11:08:09.921244+0000 mgr.a (mgr.14373) 14317 : cluster [DBG] pgmap v9928: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 11 KiB/s rd, 426 B/s wr, 13 op/s 2024-09-16T11:08:10.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:08:09 smithi086 bash[24289]: audit 2024-09-16T11:08:09.260358+0000 mgr.a (mgr.14373) 14316 : audit [DBG] from='client.310272 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:08:10.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:08:09 smithi086 bash[24289]: cluster 2024-09-16T11:08:09.921244+0000 mgr.a (mgr.14373) 14317 : cluster [DBG] pgmap v9928: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 11 KiB/s rd, 426 B/s wr, 13 op/s 2024-09-16T11:08:10.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:08:09 smithi047 bash[22744]: audit 2024-09-16T11:08:09.260358+0000 mgr.a (mgr.14373) 14316 : audit [DBG] from='client.310272 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:08:10.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:08:09 smithi047 bash[22744]: cluster 2024-09-16T11:08:09.921244+0000 mgr.a (mgr.14373) 14317 : cluster [DBG] pgmap v9928: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 11 KiB/s rd, 426 B/s wr, 13 op/s 2024-09-16T11:08:12.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:08:11 smithi157 bash[24585]: cluster 2024-09-16T11:08:11.923449+0000 mgr.a (mgr.14373) 14318 : cluster [DBG] pgmap v9929: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 12 KiB/s rd, 426 B/s wr, 14 op/s 2024-09-16T11:08:12.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:08:11 smithi086 bash[24289]: cluster 2024-09-16T11:08:11.923449+0000 mgr.a (mgr.14373) 14318 : cluster [DBG] pgmap v9929: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 12 KiB/s rd, 426 B/s wr, 14 op/s 2024-09-16T11:08:12.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:08:11 smithi047 bash[22744]: cluster 2024-09-16T11:08:11.923449+0000 mgr.a (mgr.14373) 14318 : cluster [DBG] pgmap v9929: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 12 KiB/s rd, 426 B/s wr, 14 op/s 2024-09-16T11:08:14.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:08:13 smithi157 bash[24585]: cluster 2024-09-16T11:08:13.924206+0000 mgr.a (mgr.14373) 14319 : cluster [DBG] pgmap v9930: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-16T11:08:14.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:08:13 smithi086 bash[24289]: cluster 2024-09-16T11:08:13.924206+0000 mgr.a (mgr.14373) 14319 : cluster [DBG] pgmap v9930: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-16T11:08:14.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:08:13 smithi047 bash[22744]: cluster 2024-09-16T11:08:13.924206+0000 mgr.a (mgr.14373) 14319 : cluster [DBG] pgmap v9930: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-16T11:08:14.680 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:08:14.681 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:08:14.681 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:08:15.469 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:08:15.472 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:08:15.472 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:08:15.472 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:08:15.472 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:08:16.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:08:15 smithi157 bash[24585]: audit 2024-09-16T11:08:15.020277+0000 mgr.a (mgr.14373) 14320 : audit [DBG] from='client.310347 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:08:16.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:08:15 smithi157 bash[24585]: cluster 2024-09-16T11:08:15.925203+0000 mgr.a (mgr.14373) 14321 : cluster [DBG] pgmap v9931: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-16T11:08:16.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:08:15 smithi086 bash[24289]: audit 2024-09-16T11:08:15.020277+0000 mgr.a (mgr.14373) 14320 : audit [DBG] from='client.310347 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:08:16.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:08:15 smithi086 bash[24289]: cluster 2024-09-16T11:08:15.925203+0000 mgr.a (mgr.14373) 14321 : cluster [DBG] pgmap v9931: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-16T11:08:16.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:08:15 smithi047 bash[22744]: audit 2024-09-16T11:08:15.020277+0000 mgr.a (mgr.14373) 14320 : audit [DBG] from='client.310347 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:08:16.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:08:15 smithi047 bash[22744]: cluster 2024-09-16T11:08:15.925203+0000 mgr.a (mgr.14373) 14321 : cluster [DBG] pgmap v9931: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-16T11:08:18.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:08:17 smithi157 bash[24585]: cluster 2024-09-16T11:08:17.927464+0000 mgr.a (mgr.14373) 14322 : cluster [DBG] pgmap v9932: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-16T11:08:18.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:08:17 smithi086 bash[24289]: cluster 2024-09-16T11:08:17.927464+0000 mgr.a (mgr.14373) 14322 : cluster [DBG] pgmap v9932: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-16T11:08:18.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:08:17 smithi047 bash[22744]: cluster 2024-09-16T11:08:17.927464+0000 mgr.a (mgr.14373) 14322 : cluster [DBG] pgmap v9932: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-16T11:08:20.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:08:19 smithi157 bash[24585]: cluster 2024-09-16T11:08:19.928239+0000 mgr.a (mgr.14373) 14323 : cluster [DBG] pgmap v9933: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:08:20.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:08:19 smithi086 bash[24289]: cluster 2024-09-16T11:08:19.928239+0000 mgr.a (mgr.14373) 14323 : cluster [DBG] pgmap v9933: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:08:20.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:08:19 smithi047 bash[22744]: cluster 2024-09-16T11:08:19.928239+0000 mgr.a (mgr.14373) 14323 : cluster [DBG] pgmap v9933: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:08:20.470 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:08:20.471 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:08:20.471 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:08:21.245 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:08:21.245 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:08:21.245 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:08:21.246 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:08:21.246 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:08:21.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:08:20 smithi157 bash[24585]: audit 2024-09-16T11:08:20.802441+0000 mgr.a (mgr.14373) 14324 : audit [DBG] from='client.310419 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:08:21.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:08:20 smithi086 bash[24289]: audit 2024-09-16T11:08:20.802441+0000 mgr.a (mgr.14373) 14324 : audit [DBG] from='client.310419 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:08:21.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:08:20 smithi047 bash[22744]: audit 2024-09-16T11:08:20.802441+0000 mgr.a (mgr.14373) 14324 : audit [DBG] from='client.310419 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:08:22.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:08:21 smithi157 bash[24585]: cluster 2024-09-16T11:08:21.930616+0000 mgr.a (mgr.14373) 14325 : cluster [DBG] pgmap v9934: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:08:22.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:08:21 smithi086 bash[24289]: cluster 2024-09-16T11:08:21.930616+0000 mgr.a (mgr.14373) 14325 : cluster [DBG] pgmap v9934: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:08:22.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:08:21 smithi047 bash[22744]: cluster 2024-09-16T11:08:21.930616+0000 mgr.a (mgr.14373) 14325 : cluster [DBG] pgmap v9934: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:08:24.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:08:23 smithi157 bash[24585]: cluster 2024-09-16T11:08:23.931399+0000 mgr.a (mgr.14373) 14326 : cluster [DBG] pgmap v9935: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:08:24.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:08:23 smithi086 bash[24289]: cluster 2024-09-16T11:08:23.931399+0000 mgr.a (mgr.14373) 14326 : cluster [DBG] pgmap v9935: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:08:24.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:08:23 smithi047 bash[22744]: cluster 2024-09-16T11:08:23.931399+0000 mgr.a (mgr.14373) 14326 : cluster [DBG] pgmap v9935: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:08:26.246 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:08:26.247 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:08:26.247 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:08:26.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:08:25 smithi157 bash[24585]: cluster 2024-09-16T11:08:25.932180+0000 mgr.a (mgr.14373) 14327 : cluster [DBG] pgmap v9936: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:08:26.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:08:25 smithi086 bash[24289]: cluster 2024-09-16T11:08:25.932180+0000 mgr.a (mgr.14373) 14327 : cluster [DBG] pgmap v9936: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:08:26.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:08:25 smithi047 bash[22744]: cluster 2024-09-16T11:08:25.932180+0000 mgr.a (mgr.14373) 14327 : cluster [DBG] pgmap v9936: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:08:27.036 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:08:27.036 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:08:27.037 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:08:27.037 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:08:27.037 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:08:27.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:08:26 smithi157 bash[24585]: audit 2024-09-16T11:08:26.585137+0000 mgr.a (mgr.14373) 14328 : audit [DBG] from='client.310494 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:08:27.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:08:26 smithi086 bash[24289]: audit 2024-09-16T11:08:26.585137+0000 mgr.a (mgr.14373) 14328 : audit [DBG] from='client.310494 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:08:27.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:08:26 smithi047 bash[22744]: audit 2024-09-16T11:08:26.585137+0000 mgr.a (mgr.14373) 14328 : audit [DBG] from='client.310494 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:08:29.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:08:29 smithi157 bash[24585]: cluster 2024-09-16T11:08:27.935007+0000 mgr.a (mgr.14373) 14329 : cluster [DBG] pgmap v9937: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:08:29.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:08:29 smithi086 bash[24289]: cluster 2024-09-16T11:08:27.935007+0000 mgr.a (mgr.14373) 14329 : cluster [DBG] pgmap v9937: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:08:29.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:08:29 smithi047 bash[22744]: cluster 2024-09-16T11:08:27.935007+0000 mgr.a (mgr.14373) 14329 : cluster [DBG] pgmap v9937: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:08:31.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:08:31 smithi157 bash[24585]: cluster 2024-09-16T11:08:29.935971+0000 mgr.a (mgr.14373) 14330 : cluster [DBG] pgmap v9938: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:08:31.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:08:31 smithi086 bash[24289]: cluster 2024-09-16T11:08:29.935971+0000 mgr.a (mgr.14373) 14330 : cluster [DBG] pgmap v9938: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:08:31.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:08:31 smithi047 bash[22744]: cluster 2024-09-16T11:08:29.935971+0000 mgr.a (mgr.14373) 14330 : cluster [DBG] pgmap v9938: 225 pgs: 225 active+clean; 589 KiB data, 183 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:08:32.038 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:08:32.038 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:08:32.039 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:08:32.821 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:08:32.821 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:08:32.822 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:08:32.822 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:08:32.822 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:08:33.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:08:33 smithi157 bash[24585]: cluster 2024-09-16T11:08:31.937915+0000 mgr.a (mgr.14373) 14331 : cluster [DBG] pgmap v9939: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 65 KiB/s rd, 0 B/s wr, 107 op/s 2024-09-16T11:08:33.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:08:33 smithi157 bash[24585]: audit 2024-09-16T11:08:32.373359+0000 mgr.a (mgr.14373) 14332 : audit [DBG] from='client.310572 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:08:33.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:08:33 smithi086 bash[24289]: cluster 2024-09-16T11:08:31.937915+0000 mgr.a (mgr.14373) 14331 : cluster [DBG] pgmap v9939: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 65 KiB/s rd, 0 B/s wr, 107 op/s 2024-09-16T11:08:33.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:08:33 smithi086 bash[24289]: audit 2024-09-16T11:08:32.373359+0000 mgr.a (mgr.14373) 14332 : audit [DBG] from='client.310572 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:08:33.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:08:33 smithi047 bash[22744]: cluster 2024-09-16T11:08:31.937915+0000 mgr.a (mgr.14373) 14331 : cluster [DBG] pgmap v9939: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 65 KiB/s rd, 0 B/s wr, 107 op/s 2024-09-16T11:08:33.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:08:33 smithi047 bash[22744]: audit 2024-09-16T11:08:32.373359+0000 mgr.a (mgr.14373) 14332 : audit [DBG] from='client.310572 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:08:35.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:08:35 smithi157 bash[24585]: cluster 2024-09-16T11:08:33.938889+0000 mgr.a (mgr.14373) 14333 : cluster [DBG] pgmap v9940: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 64 KiB/s rd, 0 B/s wr, 106 op/s 2024-09-16T11:08:35.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:08:35 smithi086 bash[24289]: cluster 2024-09-16T11:08:33.938889+0000 mgr.a (mgr.14373) 14333 : cluster [DBG] pgmap v9940: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 64 KiB/s rd, 0 B/s wr, 106 op/s 2024-09-16T11:08:35.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:08:35 smithi047 bash[22744]: cluster 2024-09-16T11:08:33.938889+0000 mgr.a (mgr.14373) 14333 : cluster [DBG] pgmap v9940: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 64 KiB/s rd, 0 B/s wr, 106 op/s 2024-09-16T11:08:37.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:08:37 smithi157 bash[24585]: cluster 2024-09-16T11:08:35.939724+0000 mgr.a (mgr.14373) 14334 : cluster [DBG] pgmap v9941: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 64 KiB/s rd, 0 B/s wr, 106 op/s 2024-09-16T11:08:37.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:08:37 smithi086 bash[24289]: cluster 2024-09-16T11:08:35.939724+0000 mgr.a (mgr.14373) 14334 : cluster [DBG] pgmap v9941: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 64 KiB/s rd, 0 B/s wr, 106 op/s 2024-09-16T11:08:37.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:08:37 smithi047 bash[22744]: cluster 2024-09-16T11:08:35.939724+0000 mgr.a (mgr.14373) 14334 : cluster [DBG] pgmap v9941: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 64 KiB/s rd, 0 B/s wr, 106 op/s 2024-09-16T11:08:37.823 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:08:37.824 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:08:37.824 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:08:38.604 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:08:38.604 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:08:38.604 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:08:38.604 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:08:38.605 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:08:39.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:08:39 smithi157 bash[24585]: cluster 2024-09-16T11:08:37.941145+0000 mgr.a (mgr.14373) 14335 : cluster [DBG] pgmap v9942: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 65 KiB/s rd, 0 B/s wr, 107 op/s 2024-09-16T11:08:39.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:08:39 smithi157 bash[24585]: audit 2024-09-16T11:08:38.156839+0000 mgr.a (mgr.14373) 14336 : audit [DBG] from='client.310650 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:08:39.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:08:39 smithi086 bash[24289]: cluster 2024-09-16T11:08:37.941145+0000 mgr.a (mgr.14373) 14335 : cluster [DBG] pgmap v9942: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 65 KiB/s rd, 0 B/s wr, 107 op/s 2024-09-16T11:08:39.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:08:39 smithi086 bash[24289]: audit 2024-09-16T11:08:38.156839+0000 mgr.a (mgr.14373) 14336 : audit [DBG] from='client.310650 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:08:39.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:08:39 smithi047 bash[22744]: cluster 2024-09-16T11:08:37.941145+0000 mgr.a (mgr.14373) 14335 : cluster [DBG] pgmap v9942: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 65 KiB/s rd, 0 B/s wr, 107 op/s 2024-09-16T11:08:39.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:08:39 smithi047 bash[22744]: audit 2024-09-16T11:08:38.156839+0000 mgr.a (mgr.14373) 14336 : audit [DBG] from='client.310650 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:08:41.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:08:41 smithi157 bash[24585]: cluster 2024-09-16T11:08:39.942058+0000 mgr.a (mgr.14373) 14337 : cluster [DBG] pgmap v9943: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 65 KiB/s rd, 0 B/s wr, 107 op/s 2024-09-16T11:08:41.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:08:41 smithi086 bash[24289]: cluster 2024-09-16T11:08:39.942058+0000 mgr.a (mgr.14373) 14337 : cluster [DBG] pgmap v9943: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 65 KiB/s rd, 0 B/s wr, 107 op/s 2024-09-16T11:08:41.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:08:41 smithi047 bash[22744]: cluster 2024-09-16T11:08:39.942058+0000 mgr.a (mgr.14373) 14337 : cluster [DBG] pgmap v9943: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 65 KiB/s rd, 0 B/s wr, 107 op/s 2024-09-16T11:08:43.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:08:43 smithi157 bash[24585]: cluster 2024-09-16T11:08:41.944291+0000 mgr.a (mgr.14373) 14338 : cluster [DBG] pgmap v9944: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 66 KiB/s rd, 0 B/s wr, 108 op/s 2024-09-16T11:08:43.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:08:43 smithi086 bash[24289]: cluster 2024-09-16T11:08:41.944291+0000 mgr.a (mgr.14373) 14338 : cluster [DBG] pgmap v9944: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 66 KiB/s rd, 0 B/s wr, 108 op/s 2024-09-16T11:08:43.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:08:43 smithi047 bash[22744]: cluster 2024-09-16T11:08:41.944291+0000 mgr.a (mgr.14373) 14338 : cluster [DBG] pgmap v9944: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 66 KiB/s rd, 0 B/s wr, 108 op/s 2024-09-16T11:08:43.605 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:08:43.606 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:08:43.606 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:08:44.397 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:08:44.398 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:08:44.398 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:08:44.398 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:08:44.398 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:08:45.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:08:45 smithi157 bash[24585]: audit 2024-09-16T11:08:43.943815+0000 mgr.a (mgr.14373) 14339 : audit [DBG] from='client.310728 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:08:45.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:08:45 smithi157 bash[24585]: cluster 2024-09-16T11:08:43.961668+0000 mgr.a (mgr.14373) 14340 : cluster [DBG] pgmap v9945: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:08:45.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:08:45 smithi086 bash[24289]: audit 2024-09-16T11:08:43.943815+0000 mgr.a (mgr.14373) 14339 : audit [DBG] from='client.310728 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:08:45.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:08:45 smithi086 bash[24289]: cluster 2024-09-16T11:08:43.961668+0000 mgr.a (mgr.14373) 14340 : cluster [DBG] pgmap v9945: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:08:45.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:08:45 smithi047 bash[22744]: audit 2024-09-16T11:08:43.943815+0000 mgr.a (mgr.14373) 14339 : audit [DBG] from='client.310728 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:08:45.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:08:45 smithi047 bash[22744]: cluster 2024-09-16T11:08:43.961668+0000 mgr.a (mgr.14373) 14340 : cluster [DBG] pgmap v9945: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:08:47.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:08:47 smithi157 bash[24585]: cluster 2024-09-16T11:08:45.962934+0000 mgr.a (mgr.14373) 14341 : cluster [DBG] pgmap v9946: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:08:47.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:08:47 smithi086 bash[24289]: cluster 2024-09-16T11:08:45.962934+0000 mgr.a (mgr.14373) 14341 : cluster [DBG] pgmap v9946: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:08:47.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:08:47 smithi047 bash[22744]: cluster 2024-09-16T11:08:45.962934+0000 mgr.a (mgr.14373) 14341 : cluster [DBG] pgmap v9946: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:08:49.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:08:49 smithi157 bash[24585]: cluster 2024-09-16T11:08:47.965170+0000 mgr.a (mgr.14373) 14342 : cluster [DBG] pgmap v9947: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:08:49.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:08:49 smithi086 bash[24289]: cluster 2024-09-16T11:08:47.965170+0000 mgr.a (mgr.14373) 14342 : cluster [DBG] pgmap v9947: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:08:49.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:08:49 smithi047 bash[22744]: cluster 2024-09-16T11:08:47.965170+0000 mgr.a (mgr.14373) 14342 : cluster [DBG] pgmap v9947: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:08:49.399 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:08:49.400 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:08:49.400 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:08:50.173 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:08:50.173 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:08:50.173 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:08:50.173 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:08:50.173 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:08:50.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:08:50 smithi157 bash[24585]: audit 2024-09-16T11:08:49.736178+0000 mgr.a (mgr.14373) 14343 : audit [DBG] from='client.310806 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:08:50.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:08:50 smithi086 bash[24289]: audit 2024-09-16T11:08:49.736178+0000 mgr.a (mgr.14373) 14343 : audit [DBG] from='client.310806 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:08:50.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:08:50 smithi047 bash[22744]: audit 2024-09-16T11:08:49.736178+0000 mgr.a (mgr.14373) 14343 : audit [DBG] from='client.310806 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:08:51.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:08:51 smithi157 bash[24585]: cluster 2024-09-16T11:08:49.972817+0000 mgr.a (mgr.14373) 14344 : cluster [DBG] pgmap v9948: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:08:51.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:08:51 smithi086 bash[24289]: cluster 2024-09-16T11:08:49.972817+0000 mgr.a (mgr.14373) 14344 : cluster [DBG] pgmap v9948: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:08:51.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:08:51 smithi047 bash[22744]: cluster 2024-09-16T11:08:49.972817+0000 mgr.a (mgr.14373) 14344 : cluster [DBG] pgmap v9948: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:08:53.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:08:53 smithi086 bash[24289]: cluster 2024-09-16T11:08:51.975057+0000 mgr.a (mgr.14373) 14345 : cluster [DBG] pgmap v9949: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:08:53.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:08:53 smithi047 bash[22744]: cluster 2024-09-16T11:08:51.975057+0000 mgr.a (mgr.14373) 14345 : cluster [DBG] pgmap v9949: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:08:53.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:08:53 smithi157 bash[24585]: cluster 2024-09-16T11:08:51.975057+0000 mgr.a (mgr.14373) 14345 : cluster [DBG] pgmap v9949: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:08:55.174 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:08:55.175 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:08:55.175 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:08:55.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:08:55 smithi086 bash[24289]: cluster 2024-09-16T11:08:53.975803+0000 mgr.a (mgr.14373) 14346 : cluster [DBG] pgmap v9950: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:08:55.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:08:55 smithi047 bash[22744]: cluster 2024-09-16T11:08:53.975803+0000 mgr.a (mgr.14373) 14346 : cluster [DBG] pgmap v9950: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:08:55.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:08:55 smithi157 bash[24585]: cluster 2024-09-16T11:08:53.975803+0000 mgr.a (mgr.14373) 14346 : cluster [DBG] pgmap v9950: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:08:55.921 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:08:55.921 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:08:55.921 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:08:55.921 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:08:55.921 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:08:56.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:08:56 smithi047 bash[22744]: audit 2024-09-16T11:08:55.499634+0000 mgr.a (mgr.14373) 14347 : audit [DBG] from='client.310884 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:08:56.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:08:56 smithi157 bash[24585]: audit 2024-09-16T11:08:55.499634+0000 mgr.a (mgr.14373) 14347 : audit [DBG] from='client.310884 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:08:56.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:08:56 smithi086 bash[24289]: audit 2024-09-16T11:08:55.499634+0000 mgr.a (mgr.14373) 14347 : audit [DBG] from='client.310884 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:08:57.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:08:57 smithi047 bash[22744]: cluster 2024-09-16T11:08:55.976477+0000 mgr.a (mgr.14373) 14348 : cluster [DBG] pgmap v9951: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:08:57.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:08:57 smithi157 bash[24585]: cluster 2024-09-16T11:08:55.976477+0000 mgr.a (mgr.14373) 14348 : cluster [DBG] pgmap v9951: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:08:57.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:08:57 smithi086 bash[24289]: cluster 2024-09-16T11:08:55.976477+0000 mgr.a (mgr.14373) 14348 : cluster [DBG] pgmap v9951: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:08:59.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:08:59 smithi047 bash[22744]: cluster 2024-09-16T11:08:57.978677+0000 mgr.a (mgr.14373) 14349 : cluster [DBG] pgmap v9952: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:08:59.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:08:59 smithi157 bash[24585]: cluster 2024-09-16T11:08:57.978677+0000 mgr.a (mgr.14373) 14349 : cluster [DBG] pgmap v9952: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:08:59.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:08:59 smithi086 bash[24289]: cluster 2024-09-16T11:08:57.978677+0000 mgr.a (mgr.14373) 14349 : cluster [DBG] pgmap v9952: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:09:00.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:09:00 smithi047 bash[22744]: audit 2024-09-16T11:08:59.332504+0000 mon.b (mon.2) 1310 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T11:09:00.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:09:00 smithi047 bash[22744]: audit 2024-09-16T11:08:59.961481+0000 mon.a (mon.0) 1418 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:09:00.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:09:00 smithi047 bash[22744]: audit 2024-09-16T11:08:59.966546+0000 mon.a (mon.0) 1419 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:09:00.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:09:00 smithi157 bash[24585]: audit 2024-09-16T11:08:59.332504+0000 mon.b (mon.2) 1310 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T11:09:00.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:09:00 smithi157 bash[24585]: audit 2024-09-16T11:08:59.961481+0000 mon.a (mon.0) 1418 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:09:00.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:09:00 smithi157 bash[24585]: audit 2024-09-16T11:08:59.966546+0000 mon.a (mon.0) 1419 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:09:00.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:09:00 smithi086 bash[24289]: audit 2024-09-16T11:08:59.332504+0000 mon.b (mon.2) 1310 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T11:09:00.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:09:00 smithi086 bash[24289]: audit 2024-09-16T11:08:59.961481+0000 mon.a (mon.0) 1418 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:09:00.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:09:00 smithi086 bash[24289]: audit 2024-09-16T11:08:59.966546+0000 mon.a (mon.0) 1419 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:09:00.922 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:09:00.922 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:09:00.922 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:09:01.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:09:01 smithi047 bash[22744]: cluster 2024-09-16T11:08:59.979157+0000 mgr.a (mgr.14373) 14350 : cluster [DBG] pgmap v9953: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:09:01.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:09:01 smithi047 bash[22744]: audit 2024-09-16T11:09:00.765062+0000 mon.b (mon.2) 1311 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T11:09:01.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:09:01 smithi047 bash[22744]: audit 2024-09-16T11:09:00.767156+0000 mon.b (mon.2) 1312 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T11:09:01.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:09:01 smithi047 bash[22744]: audit 2024-09-16T11:09:00.779306+0000 mon.a (mon.0) 1420 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:09:01.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:09:01 smithi047 bash[22744]: audit 2024-09-16T11:09:00.784741+0000 mon.b (mon.2) 1313 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:09:01.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:09:01 smithi047 bash[22744]: audit 2024-09-16T11:09:00.786784+0000 mgr.a (mgr.14373) 14351 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:09:01.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:09:01 smithi157 bash[24585]: cluster 2024-09-16T11:08:59.979157+0000 mgr.a (mgr.14373) 14350 : cluster [DBG] pgmap v9953: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:09:01.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:09:01 smithi157 bash[24585]: audit 2024-09-16T11:09:00.765062+0000 mon.b (mon.2) 1311 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T11:09:01.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:09:01 smithi157 bash[24585]: audit 2024-09-16T11:09:00.767156+0000 mon.b (mon.2) 1312 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T11:09:01.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:09:01 smithi157 bash[24585]: audit 2024-09-16T11:09:00.779306+0000 mon.a (mon.0) 1420 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:09:01.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:09:01 smithi157 bash[24585]: audit 2024-09-16T11:09:00.784741+0000 mon.b (mon.2) 1313 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:09:01.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:09:01 smithi157 bash[24585]: audit 2024-09-16T11:09:00.786784+0000 mgr.a (mgr.14373) 14351 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:09:01.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:09:01 smithi086 bash[24289]: cluster 2024-09-16T11:08:59.979157+0000 mgr.a (mgr.14373) 14350 : cluster [DBG] pgmap v9953: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:09:01.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:09:01 smithi086 bash[24289]: audit 2024-09-16T11:09:00.765062+0000 mon.b (mon.2) 1311 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T11:09:01.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:09:01 smithi086 bash[24289]: audit 2024-09-16T11:09:00.767156+0000 mon.b (mon.2) 1312 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T11:09:01.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:09:01 smithi086 bash[24289]: audit 2024-09-16T11:09:00.779306+0000 mon.a (mon.0) 1420 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:09:01.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:09:01 smithi086 bash[24289]: audit 2024-09-16T11:09:00.784741+0000 mon.b (mon.2) 1313 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:09:01.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:09:01 smithi086 bash[24289]: audit 2024-09-16T11:09:00.786784+0000 mgr.a (mgr.14373) 14351 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:09:01.842 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 11:09:01 smithi047 bash[22994]: debug 2024-09-16T11:09:01.512+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T11:09:01.842 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 11:09:01 smithi047 bash[22994]: debug 2024-09-16T11:09:01.524+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T11:09:01.924 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:09:01.925 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:09:01.925 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:09:01.925 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:09:01.925 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:09:02.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:09:02 smithi047 bash[22744]: audit 2024-09-16T11:09:01.249481+0000 mgr.a (mgr.14373) 14352 : audit [DBG] from='client.310998 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:09:02.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:09:02 smithi047 bash[22744]: audit 2024-09-16T11:09:01.515309+0000 mgr.a (mgr.14373) 14353 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T11:09:02.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:09:02 smithi047 bash[22744]: cephadm 2024-09-16T11:09:01.526665+0000 mgr.a (mgr.14373) 14354 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T11:09:02.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:09:02 smithi157 bash[24585]: audit 2024-09-16T11:09:01.249481+0000 mgr.a (mgr.14373) 14352 : audit [DBG] from='client.310998 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:09:02.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:09:02 smithi157 bash[24585]: audit 2024-09-16T11:09:01.515309+0000 mgr.a (mgr.14373) 14353 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T11:09:02.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:09:02 smithi157 bash[24585]: cephadm 2024-09-16T11:09:01.526665+0000 mgr.a (mgr.14373) 14354 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T11:09:02.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:09:02 smithi086 bash[24289]: audit 2024-09-16T11:09:01.249481+0000 mgr.a (mgr.14373) 14352 : audit [DBG] from='client.310998 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:09:02.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:09:02 smithi086 bash[24289]: audit 2024-09-16T11:09:01.515309+0000 mgr.a (mgr.14373) 14353 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T11:09:02.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:09:02 smithi086 bash[24289]: cephadm 2024-09-16T11:09:01.526665+0000 mgr.a (mgr.14373) 14354 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T11:09:03.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:09:03 smithi047 bash[22744]: cluster 2024-09-16T11:09:01.980472+0000 mgr.a (mgr.14373) 14355 : cluster [DBG] pgmap v9954: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 4.8 KiB/s rd, 255 B/s wr, 4 op/s 2024-09-16T11:09:03.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:09:03 smithi157 bash[24585]: cluster 2024-09-16T11:09:01.980472+0000 mgr.a (mgr.14373) 14355 : cluster [DBG] pgmap v9954: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 4.8 KiB/s rd, 255 B/s wr, 4 op/s 2024-09-16T11:09:03.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:09:03 smithi086 bash[24289]: cluster 2024-09-16T11:09:01.980472+0000 mgr.a (mgr.14373) 14355 : cluster [DBG] pgmap v9954: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 4.8 KiB/s rd, 255 B/s wr, 4 op/s 2024-09-16T11:09:05.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:09:05 smithi157 bash[24585]: cluster 2024-09-16T11:09:03.981219+0000 mgr.a (mgr.14373) 14356 : cluster [DBG] pgmap v9955: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 3.9 KiB/s rd, 255 B/s wr, 4 op/s 2024-09-16T11:09:05.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:09:05 smithi086 bash[24289]: cluster 2024-09-16T11:09:03.981219+0000 mgr.a (mgr.14373) 14356 : cluster [DBG] pgmap v9955: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 3.9 KiB/s rd, 255 B/s wr, 4 op/s 2024-09-16T11:09:05.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:09:05 smithi047 bash[22744]: cluster 2024-09-16T11:09:03.981219+0000 mgr.a (mgr.14373) 14356 : cluster [DBG] pgmap v9955: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 3.9 KiB/s rd, 255 B/s wr, 4 op/s 2024-09-16T11:09:06.928 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:09:06.928 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:09:06.928 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:09:07.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:09:07 smithi157 bash[24585]: cluster 2024-09-16T11:09:05.981967+0000 mgr.a (mgr.14373) 14357 : cluster [DBG] pgmap v9956: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 3.9 KiB/s rd, 255 B/s wr, 4 op/s 2024-09-16T11:09:07.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:09:07 smithi086 bash[24289]: cluster 2024-09-16T11:09:05.981967+0000 mgr.a (mgr.14373) 14357 : cluster [DBG] pgmap v9956: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 3.9 KiB/s rd, 255 B/s wr, 4 op/s 2024-09-16T11:09:07.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:09:07 smithi047 bash[22744]: cluster 2024-09-16T11:09:05.981967+0000 mgr.a (mgr.14373) 14357 : cluster [DBG] pgmap v9956: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 3.9 KiB/s rd, 255 B/s wr, 4 op/s 2024-09-16T11:09:07.710 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:09:07.711 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:09:07.711 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:09:07.711 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:09:07.711 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:09:08.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:09:08 smithi157 bash[24585]: audit 2024-09-16T11:09:07.260296+0000 mgr.a (mgr.14373) 14358 : audit [DBG] from='client.311148 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:09:08.572 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:09:08 smithi086 bash[24289]: audit 2024-09-16T11:09:07.260296+0000 mgr.a (mgr.14373) 14358 : audit [DBG] from='client.311148 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:09:08.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:09:08 smithi047 bash[22744]: audit 2024-09-16T11:09:07.260296+0000 mgr.a (mgr.14373) 14358 : audit [DBG] from='client.311148 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:09:09.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:09:09 smithi157 bash[24585]: cluster 2024-09-16T11:09:07.984788+0000 mgr.a (mgr.14373) 14359 : cluster [DBG] pgmap v9957: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:09:09.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:09:09 smithi086 bash[24289]: cluster 2024-09-16T11:09:07.984788+0000 mgr.a (mgr.14373) 14359 : cluster [DBG] pgmap v9957: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:09:09.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:09:09 smithi047 bash[22744]: cluster 2024-09-16T11:09:07.984788+0000 mgr.a (mgr.14373) 14359 : cluster [DBG] pgmap v9957: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:09:11.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:09:11 smithi157 bash[24585]: cluster 2024-09-16T11:09:09.985576+0000 mgr.a (mgr.14373) 14360 : cluster [DBG] pgmap v9958: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T11:09:11.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:09:11 smithi086 bash[24289]: cluster 2024-09-16T11:09:09.985576+0000 mgr.a (mgr.14373) 14360 : cluster [DBG] pgmap v9958: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T11:09:11.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:09:11 smithi047 bash[22744]: cluster 2024-09-16T11:09:09.985576+0000 mgr.a (mgr.14373) 14360 : cluster [DBG] pgmap v9958: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T11:09:12.712 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:09:12.713 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:09:12.713 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:09:13.465 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:09:13.465 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:09:13.465 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:09:13.465 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:09:13.465 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:09:13.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:09:13 smithi157 bash[24585]: cluster 2024-09-16T11:09:11.987563+0000 mgr.a (mgr.14373) 14361 : cluster [DBG] pgmap v9959: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:09:13.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:09:13 smithi086 bash[24289]: cluster 2024-09-16T11:09:11.987563+0000 mgr.a (mgr.14373) 14361 : cluster [DBG] pgmap v9959: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:09:13.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:09:13 smithi047 bash[22744]: cluster 2024-09-16T11:09:11.987563+0000 mgr.a (mgr.14373) 14361 : cluster [DBG] pgmap v9959: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:09:14.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:09:14 smithi157 bash[24585]: audit 2024-09-16T11:09:13.042780+0000 mgr.a (mgr.14373) 14362 : audit [DBG] from='client.311220 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:09:14.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:09:14 smithi086 bash[24289]: audit 2024-09-16T11:09:13.042780+0000 mgr.a (mgr.14373) 14362 : audit [DBG] from='client.311220 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:09:14.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:09:14 smithi047 bash[22744]: audit 2024-09-16T11:09:13.042780+0000 mgr.a (mgr.14373) 14362 : audit [DBG] from='client.311220 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:09:15.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:09:15 smithi157 bash[24585]: cluster 2024-09-16T11:09:13.988593+0000 mgr.a (mgr.14373) 14363 : cluster [DBG] pgmap v9960: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 4.0 KiB/s rd, 170 B/s wr, 3 op/s 2024-09-16T11:09:15.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:09:15 smithi086 bash[24289]: cluster 2024-09-16T11:09:13.988593+0000 mgr.a (mgr.14373) 14363 : cluster [DBG] pgmap v9960: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 4.0 KiB/s rd, 170 B/s wr, 3 op/s 2024-09-16T11:09:15.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:09:15 smithi047 bash[22744]: cluster 2024-09-16T11:09:13.988593+0000 mgr.a (mgr.14373) 14363 : cluster [DBG] pgmap v9960: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 4.0 KiB/s rd, 170 B/s wr, 3 op/s 2024-09-16T11:09:17.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:09:17 smithi157 bash[24585]: cluster 2024-09-16T11:09:15.989434+0000 mgr.a (mgr.14373) 14364 : cluster [DBG] pgmap v9961: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 4.0 KiB/s rd, 170 B/s wr, 3 op/s 2024-09-16T11:09:17.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:09:17 smithi086 bash[24289]: cluster 2024-09-16T11:09:15.989434+0000 mgr.a (mgr.14373) 14364 : cluster [DBG] pgmap v9961: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 4.0 KiB/s rd, 170 B/s wr, 3 op/s 2024-09-16T11:09:17.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:09:17 smithi047 bash[22744]: cluster 2024-09-16T11:09:15.989434+0000 mgr.a (mgr.14373) 14364 : cluster [DBG] pgmap v9961: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 4.0 KiB/s rd, 170 B/s wr, 3 op/s 2024-09-16T11:09:18.466 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:09:18.467 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:09:18.467 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:09:19.250 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:09:19.250 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:09:19.250 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:09:19.251 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:09:19.251 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:09:19.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:09:19 smithi157 bash[24585]: cluster 2024-09-16T11:09:17.991660+0000 mgr.a (mgr.14373) 14365 : cluster [DBG] pgmap v9962: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 4.9 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-16T11:09:19.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:09:19 smithi157 bash[24585]: audit 2024-09-16T11:09:18.804075+0000 mgr.a (mgr.14373) 14366 : audit [DBG] from='client.311295 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:09:19.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:09:19 smithi086 bash[24289]: cluster 2024-09-16T11:09:17.991660+0000 mgr.a (mgr.14373) 14365 : cluster [DBG] pgmap v9962: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 4.9 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-16T11:09:19.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:09:19 smithi086 bash[24289]: audit 2024-09-16T11:09:18.804075+0000 mgr.a (mgr.14373) 14366 : audit [DBG] from='client.311295 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:09:19.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:09:19 smithi047 bash[22744]: cluster 2024-09-16T11:09:17.991660+0000 mgr.a (mgr.14373) 14365 : cluster [DBG] pgmap v9962: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 4.9 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-16T11:09:19.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:09:19 smithi047 bash[22744]: audit 2024-09-16T11:09:18.804075+0000 mgr.a (mgr.14373) 14366 : audit [DBG] from='client.311295 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:09:21.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:09:21 smithi157 bash[24585]: cluster 2024-09-16T11:09:19.992640+0000 mgr.a (mgr.14373) 14367 : cluster [DBG] pgmap v9963: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:09:21.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:09:21 smithi086 bash[24289]: cluster 2024-09-16T11:09:19.992640+0000 mgr.a (mgr.14373) 14367 : cluster [DBG] pgmap v9963: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:09:21.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:09:21 smithi047 bash[22744]: cluster 2024-09-16T11:09:19.992640+0000 mgr.a (mgr.14373) 14367 : cluster [DBG] pgmap v9963: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:09:23.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:09:23 smithi157 bash[24585]: cluster 2024-09-16T11:09:21.994829+0000 mgr.a (mgr.14373) 14368 : cluster [DBG] pgmap v9964: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:09:23.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:09:23 smithi086 bash[24289]: cluster 2024-09-16T11:09:21.994829+0000 mgr.a (mgr.14373) 14368 : cluster [DBG] pgmap v9964: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:09:23.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:09:23 smithi047 bash[22744]: cluster 2024-09-16T11:09:21.994829+0000 mgr.a (mgr.14373) 14368 : cluster [DBG] pgmap v9964: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:09:24.252 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:09:24.252 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:09:24.253 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:09:25.044 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:09:25.045 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:09:25.045 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:09:25.045 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:09:25.045 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:09:25.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:09:25 smithi157 bash[24585]: cluster 2024-09-16T11:09:23.995562+0000 mgr.a (mgr.14373) 14369 : cluster [DBG] pgmap v9965: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:09:25.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:09:25 smithi157 bash[24585]: audit 2024-09-16T11:09:24.591385+0000 mgr.a (mgr.14373) 14370 : audit [DBG] from='client.311373 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:09:25.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:09:25 smithi086 bash[24289]: cluster 2024-09-16T11:09:23.995562+0000 mgr.a (mgr.14373) 14369 : cluster [DBG] pgmap v9965: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:09:25.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:09:25 smithi086 bash[24289]: audit 2024-09-16T11:09:24.591385+0000 mgr.a (mgr.14373) 14370 : audit [DBG] from='client.311373 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:09:25.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:09:25 smithi047 bash[22744]: cluster 2024-09-16T11:09:23.995562+0000 mgr.a (mgr.14373) 14369 : cluster [DBG] pgmap v9965: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:09:25.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:09:25 smithi047 bash[22744]: audit 2024-09-16T11:09:24.591385+0000 mgr.a (mgr.14373) 14370 : audit [DBG] from='client.311373 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:09:27.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:09:27 smithi157 bash[24585]: cluster 2024-09-16T11:09:25.996460+0000 mgr.a (mgr.14373) 14371 : cluster [DBG] pgmap v9966: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:09:27.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:09:27 smithi086 bash[24289]: cluster 2024-09-16T11:09:25.996460+0000 mgr.a (mgr.14373) 14371 : cluster [DBG] pgmap v9966: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:09:27.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:09:27 smithi047 bash[22744]: cluster 2024-09-16T11:09:25.996460+0000 mgr.a (mgr.14373) 14371 : cluster [DBG] pgmap v9966: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:09:29.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:09:29 smithi157 bash[24585]: cluster 2024-09-16T11:09:27.998750+0000 mgr.a (mgr.14373) 14372 : cluster [DBG] pgmap v9967: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:09:29.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:09:29 smithi086 bash[24289]: cluster 2024-09-16T11:09:27.998750+0000 mgr.a (mgr.14373) 14372 : cluster [DBG] pgmap v9967: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:09:29.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:09:29 smithi047 bash[22744]: cluster 2024-09-16T11:09:27.998750+0000 mgr.a (mgr.14373) 14372 : cluster [DBG] pgmap v9967: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:09:30.046 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:09:30.047 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:09:30.047 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:09:30.794 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:09:30.794 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:09:30.794 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:09:30.794 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:09:30.794 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:09:31.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:09:31 smithi157 bash[24585]: cluster 2024-09-16T11:09:29.999647+0000 mgr.a (mgr.14373) 14373 : cluster [DBG] pgmap v9968: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:09:31.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:09:31 smithi157 bash[24585]: audit 2024-09-16T11:09:30.372229+0000 mgr.a (mgr.14373) 14374 : audit [DBG] from='client.311445 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:09:31.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:09:31 smithi086 bash[24289]: cluster 2024-09-16T11:09:29.999647+0000 mgr.a (mgr.14373) 14373 : cluster [DBG] pgmap v9968: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:09:31.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:09:31 smithi086 bash[24289]: audit 2024-09-16T11:09:30.372229+0000 mgr.a (mgr.14373) 14374 : audit [DBG] from='client.311445 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:09:31.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:09:31 smithi047 bash[22744]: cluster 2024-09-16T11:09:29.999647+0000 mgr.a (mgr.14373) 14373 : cluster [DBG] pgmap v9968: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:09:31.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:09:31 smithi047 bash[22744]: audit 2024-09-16T11:09:30.372229+0000 mgr.a (mgr.14373) 14374 : audit [DBG] from='client.311445 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:09:33.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:09:33 smithi157 bash[24585]: cluster 2024-09-16T11:09:32.001939+0000 mgr.a (mgr.14373) 14375 : cluster [DBG] pgmap v9969: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:09:33.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:09:33 smithi086 bash[24289]: cluster 2024-09-16T11:09:32.001939+0000 mgr.a (mgr.14373) 14375 : cluster [DBG] pgmap v9969: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:09:33.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:09:33 smithi047 bash[22744]: cluster 2024-09-16T11:09:32.001939+0000 mgr.a (mgr.14373) 14375 : cluster [DBG] pgmap v9969: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:09:35.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:09:35 smithi157 bash[24585]: cluster 2024-09-16T11:09:34.002743+0000 mgr.a (mgr.14373) 14376 : cluster [DBG] pgmap v9970: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:09:35.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:09:35 smithi086 bash[24289]: cluster 2024-09-16T11:09:34.002743+0000 mgr.a (mgr.14373) 14376 : cluster [DBG] pgmap v9970: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:09:35.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:09:35 smithi047 bash[22744]: cluster 2024-09-16T11:09:34.002743+0000 mgr.a (mgr.14373) 14376 : cluster [DBG] pgmap v9970: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:09:35.795 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:09:35.796 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:09:35.796 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:09:36.553 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:09:36.553 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:09:36.553 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:09:36.553 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:09:36.553 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:09:37.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:09:37 smithi157 bash[24585]: cluster 2024-09-16T11:09:36.003439+0000 mgr.a (mgr.14373) 14377 : cluster [DBG] pgmap v9971: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:09:37.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:09:37 smithi157 bash[24585]: audit 2024-09-16T11:09:36.123417+0000 mgr.a (mgr.14373) 14378 : audit [DBG] from='client.311523 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:09:37.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:09:37 smithi086 bash[24289]: cluster 2024-09-16T11:09:36.003439+0000 mgr.a (mgr.14373) 14377 : cluster [DBG] pgmap v9971: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:09:37.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:09:37 smithi086 bash[24289]: audit 2024-09-16T11:09:36.123417+0000 mgr.a (mgr.14373) 14378 : audit [DBG] from='client.311523 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:09:37.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:09:37 smithi047 bash[22744]: cluster 2024-09-16T11:09:36.003439+0000 mgr.a (mgr.14373) 14377 : cluster [DBG] pgmap v9971: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:09:37.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:09:37 smithi047 bash[22744]: audit 2024-09-16T11:09:36.123417+0000 mgr.a (mgr.14373) 14378 : audit [DBG] from='client.311523 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:09:39.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:09:39 smithi157 bash[24585]: cluster 2024-09-16T11:09:38.006182+0000 mgr.a (mgr.14373) 14379 : cluster [DBG] pgmap v9972: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-16T11:09:39.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:09:39 smithi086 bash[24289]: cluster 2024-09-16T11:09:38.006182+0000 mgr.a (mgr.14373) 14379 : cluster [DBG] pgmap v9972: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-16T11:09:39.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:09:39 smithi047 bash[22744]: cluster 2024-09-16T11:09:38.006182+0000 mgr.a (mgr.14373) 14379 : cluster [DBG] pgmap v9972: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-16T11:09:41.554 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:09:41.555 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:09:41.555 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:09:41.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:09:41 smithi157 bash[24585]: cluster 2024-09-16T11:09:40.007018+0000 mgr.a (mgr.14373) 14380 : cluster [DBG] pgmap v9973: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T11:09:41.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:09:41 smithi086 bash[24289]: cluster 2024-09-16T11:09:40.007018+0000 mgr.a (mgr.14373) 14380 : cluster [DBG] pgmap v9973: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T11:09:41.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:09:41 smithi047 bash[22744]: cluster 2024-09-16T11:09:40.007018+0000 mgr.a (mgr.14373) 14380 : cluster [DBG] pgmap v9973: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T11:09:42.328 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:09:42.328 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:09:42.328 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:09:42.328 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:09:42.328 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:09:42.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:09:42 smithi157 bash[24585]: audit 2024-09-16T11:09:41.893310+0000 mgr.a (mgr.14373) 14381 : audit [DBG] from='client.311601 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:09:42.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:09:42 smithi086 bash[24289]: audit 2024-09-16T11:09:41.893310+0000 mgr.a (mgr.14373) 14381 : audit [DBG] from='client.311601 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:09:42.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:09:42 smithi047 bash[22744]: audit 2024-09-16T11:09:41.893310+0000 mgr.a (mgr.14373) 14381 : audit [DBG] from='client.311601 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:09:43.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:09:43 smithi157 bash[24585]: cluster 2024-09-16T11:09:42.008294+0000 mgr.a (mgr.14373) 14382 : cluster [DBG] pgmap v9974: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:09:43.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:09:43 smithi086 bash[24289]: cluster 2024-09-16T11:09:42.008294+0000 mgr.a (mgr.14373) 14382 : cluster [DBG] pgmap v9974: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:09:43.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:09:43 smithi047 bash[22744]: cluster 2024-09-16T11:09:42.008294+0000 mgr.a (mgr.14373) 14382 : cluster [DBG] pgmap v9974: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:09:45.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:09:45 smithi157 bash[24585]: cluster 2024-09-16T11:09:44.009270+0000 mgr.a (mgr.14373) 14383 : cluster [DBG] pgmap v9975: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:09:45.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:09:45 smithi086 bash[24289]: cluster 2024-09-16T11:09:44.009270+0000 mgr.a (mgr.14373) 14383 : cluster [DBG] pgmap v9975: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:09:45.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:09:45 smithi047 bash[22744]: cluster 2024-09-16T11:09:44.009270+0000 mgr.a (mgr.14373) 14383 : cluster [DBG] pgmap v9975: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:09:47.330 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:09:47.330 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:09:47.330 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:09:47.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:09:47 smithi157 bash[24585]: cluster 2024-09-16T11:09:46.010214+0000 mgr.a (mgr.14373) 14384 : cluster [DBG] pgmap v9976: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T11:09:47.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:09:47 smithi086 bash[24289]: cluster 2024-09-16T11:09:46.010214+0000 mgr.a (mgr.14373) 14384 : cluster [DBG] pgmap v9976: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T11:09:47.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:09:47 smithi047 bash[22744]: cluster 2024-09-16T11:09:46.010214+0000 mgr.a (mgr.14373) 14384 : cluster [DBG] pgmap v9976: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T11:09:48.085 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:09:48.085 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:09:48.085 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:09:48.086 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:09:48.086 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:09:48.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:09:48 smithi157 bash[24585]: audit 2024-09-16T11:09:47.660512+0000 mgr.a (mgr.14373) 14385 : audit [DBG] from='client.311679 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:09:48.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:09:48 smithi086 bash[24289]: audit 2024-09-16T11:09:47.660512+0000 mgr.a (mgr.14373) 14385 : audit [DBG] from='client.311679 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:09:48.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:09:48 smithi047 bash[22744]: audit 2024-09-16T11:09:47.660512+0000 mgr.a (mgr.14373) 14385 : audit [DBG] from='client.311679 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:09:49.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:09:49 smithi157 bash[24585]: cluster 2024-09-16T11:09:48.011517+0000 mgr.a (mgr.14373) 14386 : cluster [DBG] pgmap v9977: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:09:49.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:09:49 smithi086 bash[24289]: cluster 2024-09-16T11:09:48.011517+0000 mgr.a (mgr.14373) 14386 : cluster [DBG] pgmap v9977: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:09:49.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:09:49 smithi047 bash[22744]: cluster 2024-09-16T11:09:48.011517+0000 mgr.a (mgr.14373) 14386 : cluster [DBG] pgmap v9977: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:09:51.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:09:51 smithi157 bash[24585]: cluster 2024-09-16T11:09:50.012258+0000 mgr.a (mgr.14373) 14387 : cluster [DBG] pgmap v9978: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-16T11:09:51.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:09:51 smithi086 bash[24289]: cluster 2024-09-16T11:09:50.012258+0000 mgr.a (mgr.14373) 14387 : cluster [DBG] pgmap v9978: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-16T11:09:51.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:09:51 smithi047 bash[22744]: cluster 2024-09-16T11:09:50.012258+0000 mgr.a (mgr.14373) 14387 : cluster [DBG] pgmap v9978: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-16T11:09:53.087 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:09:53.087 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:09:53.088 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:09:53.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:09:53 smithi157 bash[24585]: cluster 2024-09-16T11:09:52.014305+0000 mgr.a (mgr.14373) 14388 : cluster [DBG] pgmap v9979: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 3.0 KiB/s rd, 2 op/s 2024-09-16T11:09:53.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:09:53 smithi086 bash[24289]: cluster 2024-09-16T11:09:52.014305+0000 mgr.a (mgr.14373) 14388 : cluster [DBG] pgmap v9979: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 3.0 KiB/s rd, 2 op/s 2024-09-16T11:09:53.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:09:53 smithi047 bash[22744]: cluster 2024-09-16T11:09:52.014305+0000 mgr.a (mgr.14373) 14388 : cluster [DBG] pgmap v9979: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 3.0 KiB/s rd, 2 op/s 2024-09-16T11:09:53.864 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:09:53.864 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:09:53.864 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:09:53.864 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:09:53.864 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:09:54.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:09:54 smithi157 bash[24585]: audit 2024-09-16T11:09:53.422075+0000 mgr.a (mgr.14373) 14389 : audit [DBG] from='client.311754 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:09:54.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:09:54 smithi086 bash[24289]: audit 2024-09-16T11:09:53.422075+0000 mgr.a (mgr.14373) 14389 : audit [DBG] from='client.311754 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:09:54.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:09:54 smithi047 bash[22744]: audit 2024-09-16T11:09:53.422075+0000 mgr.a (mgr.14373) 14389 : audit [DBG] from='client.311754 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:09:55.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:09:55 smithi157 bash[24585]: cluster 2024-09-16T11:09:54.015226+0000 mgr.a (mgr.14373) 14390 : cluster [DBG] pgmap v9980: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-16T11:09:55.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:09:55 smithi086 bash[24289]: cluster 2024-09-16T11:09:54.015226+0000 mgr.a (mgr.14373) 14390 : cluster [DBG] pgmap v9980: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-16T11:09:55.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:09:55 smithi047 bash[22744]: cluster 2024-09-16T11:09:54.015226+0000 mgr.a (mgr.14373) 14390 : cluster [DBG] pgmap v9980: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-16T11:09:57.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:09:57 smithi157 bash[24585]: cluster 2024-09-16T11:09:56.015985+0000 mgr.a (mgr.14373) 14391 : cluster [DBG] pgmap v9981: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-16T11:09:57.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:09:57 smithi086 bash[24289]: cluster 2024-09-16T11:09:56.015985+0000 mgr.a (mgr.14373) 14391 : cluster [DBG] pgmap v9981: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-16T11:09:57.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:09:57 smithi047 bash[22744]: cluster 2024-09-16T11:09:56.015985+0000 mgr.a (mgr.14373) 14391 : cluster [DBG] pgmap v9981: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-16T11:09:58.865 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:09:58.866 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:09:58.866 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:09:59.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:09:59 smithi157 bash[24585]: cluster 2024-09-16T11:09:58.018189+0000 mgr.a (mgr.14373) 14392 : cluster [DBG] pgmap v9982: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 3.2 KiB/s rd, 2 op/s 2024-09-16T11:09:59.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:09:59 smithi086 bash[24289]: cluster 2024-09-16T11:09:58.018189+0000 mgr.a (mgr.14373) 14392 : cluster [DBG] pgmap v9982: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 3.2 KiB/s rd, 2 op/s 2024-09-16T11:09:59.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:09:59 smithi047 bash[22744]: cluster 2024-09-16T11:09:58.018189+0000 mgr.a (mgr.14373) 14392 : cluster [DBG] pgmap v9982: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 3.2 KiB/s rd, 2 op/s 2024-09-16T11:09:59.649 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:09:59.649 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:09:59.649 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:09:59.649 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:09:59.649 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:10:00.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:10:00 smithi157 bash[24585]: audit 2024-09-16T11:09:59.198759+0000 mgr.a (mgr.14373) 14393 : audit [DBG] from='client.311829 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:10:00.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:10:00 smithi157 bash[24585]: cluster 2024-09-16T11:10:00.000144+0000 mon.a (mon.0) 1421 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-16T11:10:00.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:10:00 smithi086 bash[24289]: audit 2024-09-16T11:09:59.198759+0000 mgr.a (mgr.14373) 14393 : audit [DBG] from='client.311829 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:10:00.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:10:00 smithi086 bash[24289]: cluster 2024-09-16T11:10:00.000144+0000 mon.a (mon.0) 1421 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-16T11:10:00.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:10:00 smithi047 bash[22744]: audit 2024-09-16T11:09:59.198759+0000 mgr.a (mgr.14373) 14393 : audit [DBG] from='client.311829 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:10:00.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:10:00 smithi047 bash[22744]: cluster 2024-09-16T11:10:00.000144+0000 mon.a (mon.0) 1421 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-16T11:10:01.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:10:01 smithi157 bash[24585]: cluster 2024-09-16T11:10:00.019148+0000 mgr.a (mgr.14373) 14394 : cluster [DBG] pgmap v9983: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-16T11:10:01.573 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:10:01 smithi086 bash[24289]: cluster 2024-09-16T11:10:00.019148+0000 mgr.a (mgr.14373) 14394 : cluster [DBG] pgmap v9983: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-16T11:10:01.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:10:01 smithi047 bash[22744]: cluster 2024-09-16T11:10:00.019148+0000 mgr.a (mgr.14373) 14394 : cluster [DBG] pgmap v9983: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-16T11:10:02.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:10:02 smithi157 bash[24585]: audit 2024-09-16T11:10:01.588763+0000 mon.b (mon.2) 1314 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T11:10:02.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:10:02 smithi157 bash[24585]: audit 2024-09-16T11:10:02.198140+0000 mon.a (mon.0) 1422 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:10:02.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:10:02 smithi157 bash[24585]: audit 2024-09-16T11:10:02.205354+0000 mon.a (mon.0) 1423 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:10:02.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:10:02 smithi157 bash[24585]: audit 2024-09-16T11:10:02.209136+0000 mon.a (mon.0) 1424 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:10:02.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:10:02 smithi157 bash[24585]: audit 2024-09-16T11:10:02.215589+0000 mon.a (mon.0) 1425 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:10:02.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:10:02 smithi086 bash[24289]: audit 2024-09-16T11:10:01.588763+0000 mon.b (mon.2) 1314 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T11:10:02.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:10:02 smithi086 bash[24289]: audit 2024-09-16T11:10:02.198140+0000 mon.a (mon.0) 1422 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:10:02.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:10:02 smithi086 bash[24289]: audit 2024-09-16T11:10:02.205354+0000 mon.a (mon.0) 1423 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:10:02.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:10:02 smithi086 bash[24289]: audit 2024-09-16T11:10:02.209136+0000 mon.a (mon.0) 1424 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:10:02.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:10:02 smithi086 bash[24289]: audit 2024-09-16T11:10:02.215589+0000 mon.a (mon.0) 1425 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:10:02.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:10:02 smithi047 bash[22744]: audit 2024-09-16T11:10:01.588763+0000 mon.b (mon.2) 1314 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T11:10:02.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:10:02 smithi047 bash[22744]: audit 2024-09-16T11:10:02.198140+0000 mon.a (mon.0) 1422 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:10:02.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:10:02 smithi047 bash[22744]: audit 2024-09-16T11:10:02.205354+0000 mon.a (mon.0) 1423 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:10:02.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:10:02 smithi047 bash[22744]: audit 2024-09-16T11:10:02.209136+0000 mon.a (mon.0) 1424 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:10:02.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:10:02 smithi047 bash[22744]: audit 2024-09-16T11:10:02.215589+0000 mon.a (mon.0) 1425 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:10:03.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:10:03 smithi157 bash[24585]: cluster 2024-09-16T11:10:02.021432+0000 mgr.a (mgr.14373) 14395 : cluster [DBG] pgmap v9984: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 3.2 KiB/s rd, 2 op/s 2024-09-16T11:10:03.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:10:03 smithi157 bash[24585]: audit 2024-09-16T11:10:02.866589+0000 mon.b (mon.2) 1315 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T11:10:03.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:10:03 smithi157 bash[24585]: audit 2024-09-16T11:10:02.868779+0000 mon.b (mon.2) 1316 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T11:10:03.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:10:03 smithi157 bash[24585]: audit 2024-09-16T11:10:02.878538+0000 mon.a (mon.0) 1426 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:10:03.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:10:03 smithi157 bash[24585]: audit 2024-09-16T11:10:02.885981+0000 mon.b (mon.2) 1317 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:10:03.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:10:03 smithi157 bash[24585]: audit 2024-09-16T11:10:02.888757+0000 mgr.a (mgr.14373) 14396 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:10:03.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:10:03 smithi086 bash[24289]: cluster 2024-09-16T11:10:02.021432+0000 mgr.a (mgr.14373) 14395 : cluster [DBG] pgmap v9984: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 3.2 KiB/s rd, 2 op/s 2024-09-16T11:10:03.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:10:03 smithi086 bash[24289]: audit 2024-09-16T11:10:02.866589+0000 mon.b (mon.2) 1315 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T11:10:03.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:10:03 smithi086 bash[24289]: audit 2024-09-16T11:10:02.868779+0000 mon.b (mon.2) 1316 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T11:10:03.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:10:03 smithi086 bash[24289]: audit 2024-09-16T11:10:02.878538+0000 mon.a (mon.0) 1426 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:10:03.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:10:03 smithi086 bash[24289]: audit 2024-09-16T11:10:02.885981+0000 mon.b (mon.2) 1317 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:10:03.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:10:03 smithi086 bash[24289]: audit 2024-09-16T11:10:02.888757+0000 mgr.a (mgr.14373) 14396 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:10:03.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:10:03 smithi047 bash[22744]: cluster 2024-09-16T11:10:02.021432+0000 mgr.a (mgr.14373) 14395 : cluster [DBG] pgmap v9984: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 3.2 KiB/s rd, 2 op/s 2024-09-16T11:10:03.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:10:03 smithi047 bash[22744]: audit 2024-09-16T11:10:02.866589+0000 mon.b (mon.2) 1315 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T11:10:03.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:10:03 smithi047 bash[22744]: audit 2024-09-16T11:10:02.868779+0000 mon.b (mon.2) 1316 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T11:10:03.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:10:03 smithi047 bash[22744]: audit 2024-09-16T11:10:02.878538+0000 mon.a (mon.0) 1426 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:10:03.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:10:03 smithi047 bash[22744]: audit 2024-09-16T11:10:02.885981+0000 mon.b (mon.2) 1317 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:10:03.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:10:03 smithi047 bash[22744]: audit 2024-09-16T11:10:02.888757+0000 mgr.a (mgr.14373) 14396 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:10:04.092 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 11:10:03 smithi047 bash[22994]: debug 2024-09-16T11:10:03.634+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T11:10:04.093 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 11:10:03 smithi047 bash[22994]: debug 2024-09-16T11:10:03.638+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T11:10:04.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:10:04 smithi157 bash[24585]: audit 2024-09-16T11:10:03.640565+0000 mgr.a (mgr.14373) 14397 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T11:10:04.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:10:04 smithi157 bash[24585]: cephadm 2024-09-16T11:10:03.642614+0000 mgr.a (mgr.14373) 14398 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T11:10:04.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:10:04 smithi086 bash[24289]: audit 2024-09-16T11:10:03.640565+0000 mgr.a (mgr.14373) 14397 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T11:10:04.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:10:04 smithi086 bash[24289]: cephadm 2024-09-16T11:10:03.642614+0000 mgr.a (mgr.14373) 14398 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T11:10:04.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:10:04 smithi047 bash[22744]: audit 2024-09-16T11:10:03.640565+0000 mgr.a (mgr.14373) 14397 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T11:10:04.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:10:04 smithi047 bash[22744]: cephadm 2024-09-16T11:10:03.642614+0000 mgr.a (mgr.14373) 14398 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T11:10:04.650 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:10:04.651 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:10:04.651 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:10:05.411 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:10:05.411 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:10:05.411 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:10:05.411 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:10:05.411 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:10:05.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:10:05 smithi157 bash[24585]: cluster 2024-09-16T11:10:04.022339+0000 mgr.a (mgr.14373) 14399 : cluster [DBG] pgmap v9985: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:10:05.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:10:05 smithi086 bash[24289]: cluster 2024-09-16T11:10:04.022339+0000 mgr.a (mgr.14373) 14399 : cluster [DBG] pgmap v9985: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:10:05.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:10:05 smithi047 bash[22744]: cluster 2024-09-16T11:10:04.022339+0000 mgr.a (mgr.14373) 14399 : cluster [DBG] pgmap v9985: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:10:06.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:10:06 smithi157 bash[24585]: audit 2024-09-16T11:10:04.977912+0000 mgr.a (mgr.14373) 14400 : audit [DBG] from='client.312009 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:10:06.812 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:10:06 smithi047 bash[22744]: audit 2024-09-16T11:10:04.977912+0000 mgr.a (mgr.14373) 14400 : audit [DBG] from='client.312009 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:10:06.812 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:10:06 smithi086 bash[24289]: audit 2024-09-16T11:10:04.977912+0000 mgr.a (mgr.14373) 14400 : audit [DBG] from='client.312009 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:10:07.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:10:07 smithi157 bash[24585]: cluster 2024-09-16T11:10:06.023251+0000 mgr.a (mgr.14373) 14401 : cluster [DBG] pgmap v9986: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:10:07.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:10:07 smithi086 bash[24289]: cluster 2024-09-16T11:10:06.023251+0000 mgr.a (mgr.14373) 14401 : cluster [DBG] pgmap v9986: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:10:07.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:10:07 smithi047 bash[22744]: cluster 2024-09-16T11:10:06.023251+0000 mgr.a (mgr.14373) 14401 : cluster [DBG] pgmap v9986: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:10:09.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:10:09 smithi157 bash[24585]: cluster 2024-09-16T11:10:08.025470+0000 mgr.a (mgr.14373) 14402 : cluster [DBG] pgmap v9987: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:10:09.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:10:09 smithi086 bash[24289]: cluster 2024-09-16T11:10:08.025470+0000 mgr.a (mgr.14373) 14402 : cluster [DBG] pgmap v9987: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:10:09.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:10:09 smithi047 bash[22744]: cluster 2024-09-16T11:10:08.025470+0000 mgr.a (mgr.14373) 14402 : cluster [DBG] pgmap v9987: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:10:10.412 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:10:10.413 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:10:10.413 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:10:11.189 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:10:11.189 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:10:11.190 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:10:11.190 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:10:11.190 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:10:11.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:10:11 smithi157 bash[24585]: cluster 2024-09-16T11:10:10.026185+0000 mgr.a (mgr.14373) 14403 : cluster [DBG] pgmap v9988: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:10:11.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:10:11 smithi157 bash[24585]: audit 2024-09-16T11:10:10.745241+0000 mgr.a (mgr.14373) 14404 : audit [DBG] from='client.312087 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:10:11.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:10:11 smithi086 bash[24289]: cluster 2024-09-16T11:10:10.026185+0000 mgr.a (mgr.14373) 14403 : cluster [DBG] pgmap v9988: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:10:11.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:10:11 smithi086 bash[24289]: audit 2024-09-16T11:10:10.745241+0000 mgr.a (mgr.14373) 14404 : audit [DBG] from='client.312087 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:10:11.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:10:11 smithi047 bash[22744]: cluster 2024-09-16T11:10:10.026185+0000 mgr.a (mgr.14373) 14403 : cluster [DBG] pgmap v9988: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:10:11.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:10:11 smithi047 bash[22744]: audit 2024-09-16T11:10:10.745241+0000 mgr.a (mgr.14373) 14404 : audit [DBG] from='client.312087 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:10:13.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:10:13 smithi157 bash[24585]: cluster 2024-09-16T11:10:12.028459+0000 mgr.a (mgr.14373) 14405 : cluster [DBG] pgmap v9989: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:10:13.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:10:13 smithi086 bash[24289]: cluster 2024-09-16T11:10:12.028459+0000 mgr.a (mgr.14373) 14405 : cluster [DBG] pgmap v9989: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:10:13.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:10:13 smithi047 bash[22744]: cluster 2024-09-16T11:10:12.028459+0000 mgr.a (mgr.14373) 14405 : cluster [DBG] pgmap v9989: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:10:15.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:10:15 smithi086 bash[24289]: cluster 2024-09-16T11:10:14.029205+0000 mgr.a (mgr.14373) 14406 : cluster [DBG] pgmap v9990: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:10:15.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:10:15 smithi047 bash[22744]: cluster 2024-09-16T11:10:14.029205+0000 mgr.a (mgr.14373) 14406 : cluster [DBG] pgmap v9990: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:10:15.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:10:15 smithi157 bash[24585]: cluster 2024-09-16T11:10:14.029205+0000 mgr.a (mgr.14373) 14406 : cluster [DBG] pgmap v9990: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:10:16.190 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:10:16.191 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:10:16.191 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:10:16.980 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:10:16.980 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:10:16.980 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:10:16.980 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:10:16.980 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:10:17.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:10:17 smithi086 bash[24289]: cluster 2024-09-16T11:10:16.029973+0000 mgr.a (mgr.14373) 14407 : cluster [DBG] pgmap v9991: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:10:17.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:10:17 smithi086 bash[24289]: audit 2024-09-16T11:10:16.528725+0000 mgr.a (mgr.14373) 14408 : audit [DBG] from='client.312162 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:10:17.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:10:17 smithi047 bash[22744]: cluster 2024-09-16T11:10:16.029973+0000 mgr.a (mgr.14373) 14407 : cluster [DBG] pgmap v9991: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:10:17.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:10:17 smithi047 bash[22744]: audit 2024-09-16T11:10:16.528725+0000 mgr.a (mgr.14373) 14408 : audit [DBG] from='client.312162 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:10:17.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:10:17 smithi157 bash[24585]: cluster 2024-09-16T11:10:16.029973+0000 mgr.a (mgr.14373) 14407 : cluster [DBG] pgmap v9991: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:10:17.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:10:17 smithi157 bash[24585]: audit 2024-09-16T11:10:16.528725+0000 mgr.a (mgr.14373) 14408 : audit [DBG] from='client.312162 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:10:19.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:10:19 smithi086 bash[24289]: cluster 2024-09-16T11:10:18.032634+0000 mgr.a (mgr.14373) 14409 : cluster [DBG] pgmap v9992: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:10:19.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:10:19 smithi047 bash[22744]: cluster 2024-09-16T11:10:18.032634+0000 mgr.a (mgr.14373) 14409 : cluster [DBG] pgmap v9992: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:10:19.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:10:19 smithi157 bash[24585]: cluster 2024-09-16T11:10:18.032634+0000 mgr.a (mgr.14373) 14409 : cluster [DBG] pgmap v9992: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:10:21.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:10:21 smithi086 bash[24289]: cluster 2024-09-16T11:10:20.033412+0000 mgr.a (mgr.14373) 14410 : cluster [DBG] pgmap v9993: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:10:21.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:10:21 smithi047 bash[22744]: cluster 2024-09-16T11:10:20.033412+0000 mgr.a (mgr.14373) 14410 : cluster [DBG] pgmap v9993: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:10:21.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:10:21 smithi157 bash[24585]: cluster 2024-09-16T11:10:20.033412+0000 mgr.a (mgr.14373) 14410 : cluster [DBG] pgmap v9993: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:10:21.981 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:10:21.982 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:10:21.982 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:10:22.753 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:10:22.753 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:10:22.753 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:10:22.753 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:10:22.753 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:10:23.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:10:23 smithi047 bash[22744]: cluster 2024-09-16T11:10:22.035475+0000 mgr.a (mgr.14373) 14411 : cluster [DBG] pgmap v9994: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:10:23.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:10:23 smithi047 bash[22744]: audit 2024-09-16T11:10:22.315079+0000 mgr.a (mgr.14373) 14412 : audit [DBG] from='client.312234 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:10:23.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:10:23 smithi157 bash[24585]: cluster 2024-09-16T11:10:22.035475+0000 mgr.a (mgr.14373) 14411 : cluster [DBG] pgmap v9994: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:10:23.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:10:23 smithi157 bash[24585]: audit 2024-09-16T11:10:22.315079+0000 mgr.a (mgr.14373) 14412 : audit [DBG] from='client.312234 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:10:23.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:10:23 smithi086 bash[24289]: cluster 2024-09-16T11:10:22.035475+0000 mgr.a (mgr.14373) 14411 : cluster [DBG] pgmap v9994: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:10:23.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:10:23 smithi086 bash[24289]: audit 2024-09-16T11:10:22.315079+0000 mgr.a (mgr.14373) 14412 : audit [DBG] from='client.312234 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:10:25.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:10:25 smithi047 bash[22744]: cluster 2024-09-16T11:10:24.036358+0000 mgr.a (mgr.14373) 14413 : cluster [DBG] pgmap v9995: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:10:25.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:10:25 smithi157 bash[24585]: cluster 2024-09-16T11:10:24.036358+0000 mgr.a (mgr.14373) 14413 : cluster [DBG] pgmap v9995: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:10:25.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:10:25 smithi086 bash[24289]: cluster 2024-09-16T11:10:24.036358+0000 mgr.a (mgr.14373) 14413 : cluster [DBG] pgmap v9995: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:10:27.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:10:27 smithi047 bash[22744]: cluster 2024-09-16T11:10:26.037125+0000 mgr.a (mgr.14373) 14414 : cluster [DBG] pgmap v9996: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T11:10:27.754 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:10:27.755 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:10:27.755 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:10:27.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:10:27 smithi157 bash[24585]: cluster 2024-09-16T11:10:26.037125+0000 mgr.a (mgr.14373) 14414 : cluster [DBG] pgmap v9996: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T11:10:27.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:10:27 smithi086 bash[24289]: cluster 2024-09-16T11:10:26.037125+0000 mgr.a (mgr.14373) 14414 : cluster [DBG] pgmap v9996: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T11:10:28.519 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:10:28.520 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:10:28.520 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:10:28.520 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:10:28.520 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:10:29.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:10:29 smithi047 bash[22744]: cluster 2024-09-16T11:10:28.039214+0000 mgr.a (mgr.14373) 14415 : cluster [DBG] pgmap v9997: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:10:29.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:10:29 smithi047 bash[22744]: audit 2024-09-16T11:10:28.085016+0000 mgr.a (mgr.14373) 14416 : audit [DBG] from='client.312312 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:10:29.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:10:29 smithi157 bash[24585]: cluster 2024-09-16T11:10:28.039214+0000 mgr.a (mgr.14373) 14415 : cluster [DBG] pgmap v9997: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:10:29.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:10:29 smithi157 bash[24585]: audit 2024-09-16T11:10:28.085016+0000 mgr.a (mgr.14373) 14416 : audit [DBG] from='client.312312 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:10:29.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:10:29 smithi086 bash[24289]: cluster 2024-09-16T11:10:28.039214+0000 mgr.a (mgr.14373) 14415 : cluster [DBG] pgmap v9997: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:10:29.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:10:29 smithi086 bash[24289]: audit 2024-09-16T11:10:28.085016+0000 mgr.a (mgr.14373) 14416 : audit [DBG] from='client.312312 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:10:31.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:10:31 smithi047 bash[22744]: cluster 2024-09-16T11:10:30.040081+0000 mgr.a (mgr.14373) 14417 : cluster [DBG] pgmap v9998: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:10:31.809 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:10:31 smithi157 bash[24585]: cluster 2024-09-16T11:10:30.040081+0000 mgr.a (mgr.14373) 14417 : cluster [DBG] pgmap v9998: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:10:31.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:10:31 smithi086 bash[24289]: cluster 2024-09-16T11:10:30.040081+0000 mgr.a (mgr.14373) 14417 : cluster [DBG] pgmap v9998: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:10:33.521 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:10:33.522 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:10:33.522 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:10:33.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:10:33 smithi157 bash[24585]: cluster 2024-09-16T11:10:32.042237+0000 mgr.a (mgr.14373) 14418 : cluster [DBG] pgmap v9999: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:10:33.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:10:33 smithi086 bash[24289]: cluster 2024-09-16T11:10:32.042237+0000 mgr.a (mgr.14373) 14418 : cluster [DBG] pgmap v9999: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:10:33.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:10:33 smithi047 bash[22744]: cluster 2024-09-16T11:10:32.042237+0000 mgr.a (mgr.14373) 14418 : cluster [DBG] pgmap v9999: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:10:34.305 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:10:34.306 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:10:34.306 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:10:34.306 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:10:34.306 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:10:34.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:10:34 smithi157 bash[24585]: audit 2024-09-16T11:10:33.853493+0000 mgr.a (mgr.14373) 14419 : audit [DBG] from='client.312390 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:10:34.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:10:34 smithi086 bash[24289]: audit 2024-09-16T11:10:33.853493+0000 mgr.a (mgr.14373) 14419 : audit [DBG] from='client.312390 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:10:34.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:10:34 smithi047 bash[22744]: audit 2024-09-16T11:10:33.853493+0000 mgr.a (mgr.14373) 14419 : audit [DBG] from='client.312390 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:10:35.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:10:35 smithi157 bash[24585]: cluster 2024-09-16T11:10:34.042780+0000 mgr.a (mgr.14373) 14420 : cluster [DBG] pgmap v10000: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:10:35.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:10:35 smithi086 bash[24289]: cluster 2024-09-16T11:10:34.042780+0000 mgr.a (mgr.14373) 14420 : cluster [DBG] pgmap v10000: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:10:35.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:10:35 smithi047 bash[22744]: cluster 2024-09-16T11:10:34.042780+0000 mgr.a (mgr.14373) 14420 : cluster [DBG] pgmap v10000: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:10:37.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:10:37 smithi157 bash[24585]: cluster 2024-09-16T11:10:36.043613+0000 mgr.a (mgr.14373) 14421 : cluster [DBG] pgmap v10001: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:10:37.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:10:37 smithi086 bash[24289]: cluster 2024-09-16T11:10:36.043613+0000 mgr.a (mgr.14373) 14421 : cluster [DBG] pgmap v10001: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:10:37.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:10:37 smithi047 bash[22744]: cluster 2024-09-16T11:10:36.043613+0000 mgr.a (mgr.14373) 14421 : cluster [DBG] pgmap v10001: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:10:39.307 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:10:39.308 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:10:39.308 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:10:39.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:10:39 smithi157 bash[24585]: cluster 2024-09-16T11:10:38.045812+0000 mgr.a (mgr.14373) 14422 : cluster [DBG] pgmap v10002: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:10:39.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:10:39 smithi086 bash[24289]: cluster 2024-09-16T11:10:38.045812+0000 mgr.a (mgr.14373) 14422 : cluster [DBG] pgmap v10002: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:10:39.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:10:39 smithi047 bash[22744]: cluster 2024-09-16T11:10:38.045812+0000 mgr.a (mgr.14373) 14422 : cluster [DBG] pgmap v10002: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:10:40.089 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:10:40.090 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:10:40.090 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:10:40.090 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:10:40.090 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:10:40.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:10:40 smithi157 bash[24585]: audit 2024-09-16T11:10:39.641888+0000 mgr.a (mgr.14373) 14423 : audit [DBG] from='client.312462 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:10:40.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:10:40 smithi086 bash[24289]: audit 2024-09-16T11:10:39.641888+0000 mgr.a (mgr.14373) 14423 : audit [DBG] from='client.312462 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:10:40.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:10:40 smithi047 bash[22744]: audit 2024-09-16T11:10:39.641888+0000 mgr.a (mgr.14373) 14423 : audit [DBG] from='client.312462 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:10:41.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:10:41 smithi157 bash[24585]: cluster 2024-09-16T11:10:40.046337+0000 mgr.a (mgr.14373) 14424 : cluster [DBG] pgmap v10003: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:10:41.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:10:41 smithi086 bash[24289]: cluster 2024-09-16T11:10:40.046337+0000 mgr.a (mgr.14373) 14424 : cluster [DBG] pgmap v10003: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:10:41.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:10:41 smithi047 bash[22744]: cluster 2024-09-16T11:10:40.046337+0000 mgr.a (mgr.14373) 14424 : cluster [DBG] pgmap v10003: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:10:43.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:10:43 smithi157 bash[24585]: cluster 2024-09-16T11:10:42.048430+0000 mgr.a (mgr.14373) 14425 : cluster [DBG] pgmap v10004: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:10:43.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:10:43 smithi086 bash[24289]: cluster 2024-09-16T11:10:42.048430+0000 mgr.a (mgr.14373) 14425 : cluster [DBG] pgmap v10004: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:10:43.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:10:43 smithi047 bash[22744]: cluster 2024-09-16T11:10:42.048430+0000 mgr.a (mgr.14373) 14425 : cluster [DBG] pgmap v10004: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:10:45.091 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:10:45.091 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:10:45.091 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:10:45.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:10:45 smithi157 bash[24585]: cluster 2024-09-16T11:10:44.049165+0000 mgr.a (mgr.14373) 14426 : cluster [DBG] pgmap v10005: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:10:45.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:10:45 smithi086 bash[24289]: cluster 2024-09-16T11:10:44.049165+0000 mgr.a (mgr.14373) 14426 : cluster [DBG] pgmap v10005: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:10:45.831 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:10:45.832 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:10:45.832 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:10:45.832 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:10:45.832 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:10:45.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:10:45 smithi047 bash[22744]: cluster 2024-09-16T11:10:44.049165+0000 mgr.a (mgr.14373) 14426 : cluster [DBG] pgmap v10005: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:10:46.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:10:46 smithi157 bash[24585]: audit 2024-09-16T11:10:45.422517+0000 mgr.a (mgr.14373) 14427 : audit [DBG] from='client.312537 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:10:46.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:10:46 smithi086 bash[24289]: audit 2024-09-16T11:10:45.422517+0000 mgr.a (mgr.14373) 14427 : audit [DBG] from='client.312537 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:10:46.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:10:46 smithi047 bash[22744]: audit 2024-09-16T11:10:45.422517+0000 mgr.a (mgr.14373) 14427 : audit [DBG] from='client.312537 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:10:47.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:10:47 smithi157 bash[24585]: cluster 2024-09-16T11:10:46.050002+0000 mgr.a (mgr.14373) 14428 : cluster [DBG] pgmap v10006: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:10:47.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:10:47 smithi086 bash[24289]: cluster 2024-09-16T11:10:46.050002+0000 mgr.a (mgr.14373) 14428 : cluster [DBG] pgmap v10006: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:10:47.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:10:47 smithi047 bash[22744]: cluster 2024-09-16T11:10:46.050002+0000 mgr.a (mgr.14373) 14428 : cluster [DBG] pgmap v10006: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:10:49.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:10:49 smithi157 bash[24585]: cluster 2024-09-16T11:10:48.052222+0000 mgr.a (mgr.14373) 14429 : cluster [DBG] pgmap v10007: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:10:49.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:10:49 smithi086 bash[24289]: cluster 2024-09-16T11:10:48.052222+0000 mgr.a (mgr.14373) 14429 : cluster [DBG] pgmap v10007: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:10:49.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:10:49 smithi047 bash[22744]: cluster 2024-09-16T11:10:48.052222+0000 mgr.a (mgr.14373) 14429 : cluster [DBG] pgmap v10007: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:10:50.833 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:10:50.834 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:10:50.834 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:10:51.636 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:10:51.637 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:10:51.637 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:10:51.637 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:10:51.637 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:10:51.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:10:51 smithi157 bash[24585]: cluster 2024-09-16T11:10:50.052983+0000 mgr.a (mgr.14373) 14430 : cluster [DBG] pgmap v10008: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:10:51.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:10:51 smithi086 bash[24289]: cluster 2024-09-16T11:10:50.052983+0000 mgr.a (mgr.14373) 14430 : cluster [DBG] pgmap v10008: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:10:51.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:10:51 smithi047 bash[22744]: cluster 2024-09-16T11:10:50.052983+0000 mgr.a (mgr.14373) 14430 : cluster [DBG] pgmap v10008: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:10:52.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:10:52 smithi157 bash[24585]: audit 2024-09-16T11:10:51.167325+0000 mgr.a (mgr.14373) 14431 : audit [DBG] from='client.312615 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:10:52.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:10:52 smithi086 bash[24289]: audit 2024-09-16T11:10:51.167325+0000 mgr.a (mgr.14373) 14431 : audit [DBG] from='client.312615 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:10:52.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:10:52 smithi047 bash[22744]: audit 2024-09-16T11:10:51.167325+0000 mgr.a (mgr.14373) 14431 : audit [DBG] from='client.312615 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:10:53.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:10:53 smithi157 bash[24585]: cluster 2024-09-16T11:10:52.055830+0000 mgr.a (mgr.14373) 14432 : cluster [DBG] pgmap v10009: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-16T11:10:53.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:10:53 smithi086 bash[24289]: cluster 2024-09-16T11:10:52.055830+0000 mgr.a (mgr.14373) 14432 : cluster [DBG] pgmap v10009: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-16T11:10:53.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:10:53 smithi047 bash[22744]: cluster 2024-09-16T11:10:52.055830+0000 mgr.a (mgr.14373) 14432 : cluster [DBG] pgmap v10009: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-16T11:10:55.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:10:55 smithi157 bash[24585]: cluster 2024-09-16T11:10:54.056631+0000 mgr.a (mgr.14373) 14433 : cluster [DBG] pgmap v10010: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-16T11:10:55.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:10:55 smithi086 bash[24289]: cluster 2024-09-16T11:10:54.056631+0000 mgr.a (mgr.14373) 14433 : cluster [DBG] pgmap v10010: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-16T11:10:55.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:10:55 smithi047 bash[22744]: cluster 2024-09-16T11:10:54.056631+0000 mgr.a (mgr.14373) 14433 : cluster [DBG] pgmap v10010: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-16T11:10:56.638 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:10:56.639 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:10:56.639 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:10:57.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:10:57 smithi157 bash[24585]: cluster 2024-09-16T11:10:56.057381+0000 mgr.a (mgr.14373) 14434 : cluster [DBG] pgmap v10011: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-16T11:10:57.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:10:57 smithi157 bash[24585]: audit 2024-09-16T11:10:56.967026+0000 mgr.a (mgr.14373) 14435 : audit [DBG] from='client.312693 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:10:57.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:10:57 smithi086 bash[24289]: cluster 2024-09-16T11:10:56.057381+0000 mgr.a (mgr.14373) 14434 : cluster [DBG] pgmap v10011: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-16T11:10:57.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:10:57 smithi086 bash[24289]: audit 2024-09-16T11:10:56.967026+0000 mgr.a (mgr.14373) 14435 : audit [DBG] from='client.312693 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:10:57.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:10:57 smithi047 bash[22744]: cluster 2024-09-16T11:10:56.057381+0000 mgr.a (mgr.14373) 14434 : cluster [DBG] pgmap v10011: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-16T11:10:57.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:10:57 smithi047 bash[22744]: audit 2024-09-16T11:10:56.967026+0000 mgr.a (mgr.14373) 14435 : audit [DBG] from='client.312693 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:10:57.397 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:10:57.397 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:10:57.397 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:10:57.397 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:10:57.397 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:10:59.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:10:59 smithi157 bash[24585]: cluster 2024-09-16T11:10:58.060085+0000 mgr.a (mgr.14373) 14436 : cluster [DBG] pgmap v10012: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:10:59.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:10:59 smithi086 bash[24289]: cluster 2024-09-16T11:10:58.060085+0000 mgr.a (mgr.14373) 14436 : cluster [DBG] pgmap v10012: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:10:59.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:10:59 smithi047 bash[22744]: cluster 2024-09-16T11:10:58.060085+0000 mgr.a (mgr.14373) 14436 : cluster [DBG] pgmap v10012: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:11:01.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:11:01 smithi157 bash[24585]: cluster 2024-09-16T11:11:00.060849+0000 mgr.a (mgr.14373) 14437 : cluster [DBG] pgmap v10013: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:11:01.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:11:01 smithi086 bash[24289]: cluster 2024-09-16T11:11:00.060849+0000 mgr.a (mgr.14373) 14437 : cluster [DBG] pgmap v10013: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:11:01.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:11:01 smithi047 bash[22744]: cluster 2024-09-16T11:11:00.060849+0000 mgr.a (mgr.14373) 14437 : cluster [DBG] pgmap v10013: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:11:02.397 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:11:02.398 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:11:02.398 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:11:03.186 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:11:03.186 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:11:03.186 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:11:03.186 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:11:03.186 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:11:03.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:11:03 smithi157 bash[24585]: cluster 2024-09-16T11:11:02.062767+0000 mgr.a (mgr.14373) 14438 : cluster [DBG] pgmap v10014: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:11:03.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:11:03 smithi157 bash[24585]: audit 2024-09-16T11:11:02.734296+0000 mgr.a (mgr.14373) 14439 : audit [DBG] from='client.312765 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:11:03.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:11:03 smithi086 bash[24289]: cluster 2024-09-16T11:11:02.062767+0000 mgr.a (mgr.14373) 14438 : cluster [DBG] pgmap v10014: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:11:03.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:11:03 smithi086 bash[24289]: audit 2024-09-16T11:11:02.734296+0000 mgr.a (mgr.14373) 14439 : audit [DBG] from='client.312765 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:11:03.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:11:03 smithi047 bash[22744]: cluster 2024-09-16T11:11:02.062767+0000 mgr.a (mgr.14373) 14438 : cluster [DBG] pgmap v10014: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:11:03.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:11:03 smithi047 bash[22744]: audit 2024-09-16T11:11:02.734296+0000 mgr.a (mgr.14373) 14439 : audit [DBG] from='client.312765 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:11:04.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:11:04 smithi157 bash[24585]: audit 2024-09-16T11:11:03.695612+0000 mon.b (mon.2) 1318 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T11:11:04.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:11:04 smithi086 bash[24289]: audit 2024-09-16T11:11:03.695612+0000 mon.b (mon.2) 1318 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T11:11:04.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:11:04 smithi047 bash[22744]: audit 2024-09-16T11:11:03.695612+0000 mon.b (mon.2) 1318 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T11:11:05.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:11:05 smithi157 bash[24585]: cluster 2024-09-16T11:11:04.063692+0000 mgr.a (mgr.14373) 14440 : cluster [DBG] pgmap v10015: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-16T11:11:05.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:11:05 smithi086 bash[24289]: cluster 2024-09-16T11:11:04.063692+0000 mgr.a (mgr.14373) 14440 : cluster [DBG] pgmap v10015: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-16T11:11:05.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:11:05 smithi047 bash[22744]: cluster 2024-09-16T11:11:04.063692+0000 mgr.a (mgr.14373) 14440 : cluster [DBG] pgmap v10015: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-16T11:11:07.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:11:07 smithi157 bash[24585]: cluster 2024-09-16T11:11:06.064499+0000 mgr.a (mgr.14373) 14441 : cluster [DBG] pgmap v10016: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-16T11:11:07.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:11:07 smithi086 bash[24289]: cluster 2024-09-16T11:11:06.064499+0000 mgr.a (mgr.14373) 14441 : cluster [DBG] pgmap v10016: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-16T11:11:07.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:11:07 smithi047 bash[22744]: cluster 2024-09-16T11:11:06.064499+0000 mgr.a (mgr.14373) 14441 : cluster [DBG] pgmap v10016: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-16T11:11:08.187 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:11:08.188 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:11:08.188 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:11:08.948 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:11:08.948 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:11:08.948 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:11:08.948 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:11:08.948 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:11:09.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:11:09 smithi157 bash[24585]: cluster 2024-09-16T11:11:08.066751+0000 mgr.a (mgr.14373) 14442 : cluster [DBG] pgmap v10017: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-09-16T11:11:09.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:11:09 smithi157 bash[24585]: audit 2024-09-16T11:11:08.519356+0000 mgr.a (mgr.14373) 14443 : audit [DBG] from='client.312843 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:11:09.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:11:09 smithi086 bash[24289]: cluster 2024-09-16T11:11:08.066751+0000 mgr.a (mgr.14373) 14442 : cluster [DBG] pgmap v10017: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-09-16T11:11:09.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:11:09 smithi086 bash[24289]: audit 2024-09-16T11:11:08.519356+0000 mgr.a (mgr.14373) 14443 : audit [DBG] from='client.312843 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:11:09.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:11:09 smithi047 bash[22744]: cluster 2024-09-16T11:11:08.066751+0000 mgr.a (mgr.14373) 14442 : cluster [DBG] pgmap v10017: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-09-16T11:11:09.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:11:09 smithi047 bash[22744]: audit 2024-09-16T11:11:08.519356+0000 mgr.a (mgr.14373) 14443 : audit [DBG] from='client.312843 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:11:11.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:11:11 smithi047 bash[22744]: cluster 2024-09-16T11:11:10.067756+0000 mgr.a (mgr.14373) 14444 : cluster [DBG] pgmap v10018: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:11:11.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:11:11 smithi157 bash[24585]: cluster 2024-09-16T11:11:10.067756+0000 mgr.a (mgr.14373) 14444 : cluster [DBG] pgmap v10018: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:11:11.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:11:11 smithi086 bash[24289]: cluster 2024-09-16T11:11:10.067756+0000 mgr.a (mgr.14373) 14444 : cluster [DBG] pgmap v10018: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:11:13.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:11:13 smithi157 bash[24585]: cluster 2024-09-16T11:11:12.068882+0000 mgr.a (mgr.14373) 14445 : cluster [DBG] pgmap v10019: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:11:13.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:11:13 smithi086 bash[24289]: cluster 2024-09-16T11:11:12.068882+0000 mgr.a (mgr.14373) 14445 : cluster [DBG] pgmap v10019: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:11:13.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:11:13 smithi047 bash[22744]: cluster 2024-09-16T11:11:12.068882+0000 mgr.a (mgr.14373) 14445 : cluster [DBG] pgmap v10019: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:11:13.949 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:11:13.950 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:11:13.950 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:11:14.737 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:11:14.737 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:11:14.737 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:11:14.737 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:11:14.737 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:11:15.344 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:11:15 smithi086 bash[24289]: cluster 2024-09-16T11:11:14.069287+0000 mgr.a (mgr.14373) 14446 : cluster [DBG] pgmap v10020: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:11:15.593 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 11:11:15 smithi047 bash[22994]: debug 2024-09-16T11:11:15.441+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T11:11:15.593 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 11:11:15 smithi047 bash[22994]: debug 2024-09-16T11:11:15.441+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T11:11:15.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:11:15 smithi047 bash[22744]: cluster 2024-09-16T11:11:14.069287+0000 mgr.a (mgr.14373) 14446 : cluster [DBG] pgmap v10020: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:11:15.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:11:15 smithi047 bash[22744]: audit 2024-09-16T11:11:14.281936+0000 mgr.a (mgr.14373) 14447 : audit [DBG] from='client.312918 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:11:15.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:11:15 smithi047 bash[22744]: audit 2024-09-16T11:11:14.342072+0000 mon.a (mon.0) 1427 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:11:15.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:11:15 smithi047 bash[22744]: audit 2024-09-16T11:11:14.349718+0000 mon.a (mon.0) 1428 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:11:15.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:11:15 smithi047 bash[22744]: audit 2024-09-16T11:11:14.353330+0000 mon.b (mon.2) 1319 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T11:11:15.594 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:11:15 smithi047 bash[22744]: audit 2024-09-16T11:11:14.354847+0000 mon.b (mon.2) 1320 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T11:11:15.594 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:11:15 smithi047 bash[22744]: audit 2024-09-16T11:11:14.361984+0000 mon.a (mon.0) 1429 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:11:15.594 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:11:15 smithi047 bash[22744]: audit 2024-09-16T11:11:14.366316+0000 mon.b (mon.2) 1321 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:11:15.594 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:11:15 smithi047 bash[22744]: audit 2024-09-16T11:11:14.368009+0000 mgr.a (mgr.14373) 14448 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:11:15.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:11:15 smithi157 bash[24585]: cluster 2024-09-16T11:11:14.069287+0000 mgr.a (mgr.14373) 14446 : cluster [DBG] pgmap v10020: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:11:15.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:11:15 smithi157 bash[24585]: audit 2024-09-16T11:11:14.281936+0000 mgr.a (mgr.14373) 14447 : audit [DBG] from='client.312918 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:11:15.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:11:15 smithi157 bash[24585]: audit 2024-09-16T11:11:14.342072+0000 mon.a (mon.0) 1427 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:11:15.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:11:15 smithi157 bash[24585]: audit 2024-09-16T11:11:14.349718+0000 mon.a (mon.0) 1428 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:11:15.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:11:15 smithi157 bash[24585]: audit 2024-09-16T11:11:14.353330+0000 mon.b (mon.2) 1319 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T11:11:15.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:11:15 smithi157 bash[24585]: audit 2024-09-16T11:11:14.354847+0000 mon.b (mon.2) 1320 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T11:11:15.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:11:15 smithi157 bash[24585]: audit 2024-09-16T11:11:14.361984+0000 mon.a (mon.0) 1429 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:11:15.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:11:15 smithi157 bash[24585]: audit 2024-09-16T11:11:14.366316+0000 mon.b (mon.2) 1321 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:11:15.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:11:15 smithi157 bash[24585]: audit 2024-09-16T11:11:14.368009+0000 mgr.a (mgr.14373) 14448 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:11:15.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:11:15 smithi086 bash[24289]: audit 2024-09-16T11:11:14.281936+0000 mgr.a (mgr.14373) 14447 : audit [DBG] from='client.312918 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:11:15.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:11:15 smithi086 bash[24289]: audit 2024-09-16T11:11:14.342072+0000 mon.a (mon.0) 1427 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:11:15.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:11:15 smithi086 bash[24289]: audit 2024-09-16T11:11:14.349718+0000 mon.a (mon.0) 1428 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:11:15.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:11:15 smithi086 bash[24289]: audit 2024-09-16T11:11:14.353330+0000 mon.b (mon.2) 1319 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T11:11:15.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:11:15 smithi086 bash[24289]: audit 2024-09-16T11:11:14.354847+0000 mon.b (mon.2) 1320 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T11:11:15.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:11:15 smithi086 bash[24289]: audit 2024-09-16T11:11:14.361984+0000 mon.a (mon.0) 1429 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:11:15.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:11:15 smithi086 bash[24289]: audit 2024-09-16T11:11:14.366316+0000 mon.b (mon.2) 1321 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:11:15.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:11:15 smithi086 bash[24289]: audit 2024-09-16T11:11:14.368009+0000 mgr.a (mgr.14373) 14448 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:11:16.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:11:16 smithi157 bash[24585]: audit 2024-09-16T11:11:15.444303+0000 mgr.a (mgr.14373) 14449 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T11:11:16.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:11:16 smithi157 bash[24585]: cephadm 2024-09-16T11:11:15.446301+0000 mgr.a (mgr.14373) 14450 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T11:11:16.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:11:16 smithi086 bash[24289]: audit 2024-09-16T11:11:15.444303+0000 mgr.a (mgr.14373) 14449 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T11:11:16.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:11:16 smithi086 bash[24289]: cephadm 2024-09-16T11:11:15.446301+0000 mgr.a (mgr.14373) 14450 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T11:11:16.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:11:16 smithi047 bash[22744]: audit 2024-09-16T11:11:15.444303+0000 mgr.a (mgr.14373) 14449 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T11:11:16.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:11:16 smithi047 bash[22744]: cephadm 2024-09-16T11:11:15.446301+0000 mgr.a (mgr.14373) 14450 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T11:11:17.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:11:17 smithi157 bash[24585]: cluster 2024-09-16T11:11:16.070167+0000 mgr.a (mgr.14373) 14451 : cluster [DBG] pgmap v10021: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:11:17.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:11:17 smithi086 bash[24289]: cluster 2024-09-16T11:11:16.070167+0000 mgr.a (mgr.14373) 14451 : cluster [DBG] pgmap v10021: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:11:17.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:11:17 smithi047 bash[22744]: cluster 2024-09-16T11:11:16.070167+0000 mgr.a (mgr.14373) 14451 : cluster [DBG] pgmap v10021: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:11:19.738 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:11:19.739 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:11:19.739 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:11:19.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:11:19 smithi157 bash[24585]: cluster 2024-09-16T11:11:18.072444+0000 mgr.a (mgr.14373) 14452 : cluster [DBG] pgmap v10022: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:11:19.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:11:19 smithi086 bash[24289]: cluster 2024-09-16T11:11:18.072444+0000 mgr.a (mgr.14373) 14452 : cluster [DBG] pgmap v10022: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:11:19.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:11:19 smithi047 bash[22744]: cluster 2024-09-16T11:11:18.072444+0000 mgr.a (mgr.14373) 14452 : cluster [DBG] pgmap v10022: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:11:20.506 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:11:20.506 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:11:20.506 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:11:20.506 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:11:20.506 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:11:21.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:11:21 smithi157 bash[24585]: audit 2024-09-16T11:11:20.072905+0000 mgr.a (mgr.14373) 14453 : audit [DBG] from='client.313104 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:11:21.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:11:21 smithi157 bash[24585]: cluster 2024-09-16T11:11:20.083858+0000 mgr.a (mgr.14373) 14454 : cluster [DBG] pgmap v10023: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:11:21.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:11:21 smithi086 bash[24289]: audit 2024-09-16T11:11:20.072905+0000 mgr.a (mgr.14373) 14453 : audit [DBG] from='client.313104 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:11:21.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:11:21 smithi086 bash[24289]: cluster 2024-09-16T11:11:20.083858+0000 mgr.a (mgr.14373) 14454 : cluster [DBG] pgmap v10023: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:11:21.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:11:21 smithi047 bash[22744]: audit 2024-09-16T11:11:20.072905+0000 mgr.a (mgr.14373) 14453 : audit [DBG] from='client.313104 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:11:21.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:11:21 smithi047 bash[22744]: cluster 2024-09-16T11:11:20.083858+0000 mgr.a (mgr.14373) 14454 : cluster [DBG] pgmap v10023: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:11:23.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:11:23 smithi157 bash[24585]: cluster 2024-09-16T11:11:22.086429+0000 mgr.a (mgr.14373) 14455 : cluster [DBG] pgmap v10024: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:11:23.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:11:23 smithi086 bash[24289]: cluster 2024-09-16T11:11:22.086429+0000 mgr.a (mgr.14373) 14455 : cluster [DBG] pgmap v10024: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:11:23.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:11:23 smithi047 bash[22744]: cluster 2024-09-16T11:11:22.086429+0000 mgr.a (mgr.14373) 14455 : cluster [DBG] pgmap v10024: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:11:25.507 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:11:25.508 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:11:25.508 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:11:25.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:11:25 smithi157 bash[24585]: cluster 2024-09-16T11:11:24.087146+0000 mgr.a (mgr.14373) 14456 : cluster [DBG] pgmap v10025: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:11:25.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:11:25 smithi086 bash[24289]: cluster 2024-09-16T11:11:24.087146+0000 mgr.a (mgr.14373) 14456 : cluster [DBG] pgmap v10025: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:11:25.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:11:25 smithi047 bash[22744]: cluster 2024-09-16T11:11:24.087146+0000 mgr.a (mgr.14373) 14456 : cluster [DBG] pgmap v10025: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:11:26.255 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:11:26.255 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:11:26.255 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:11:26.256 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:11:26.256 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:11:26.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:11:26 smithi157 bash[24585]: audit 2024-09-16T11:11:25.834726+0000 mgr.a (mgr.14373) 14457 : audit [DBG] from='client.313179 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:11:26.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:11:26 smithi086 bash[24289]: audit 2024-09-16T11:11:25.834726+0000 mgr.a (mgr.14373) 14457 : audit [DBG] from='client.313179 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:11:26.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:11:26 smithi047 bash[22744]: audit 2024-09-16T11:11:25.834726+0000 mgr.a (mgr.14373) 14457 : audit [DBG] from='client.313179 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:11:27.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:11:27 smithi157 bash[24585]: cluster 2024-09-16T11:11:26.087664+0000 mgr.a (mgr.14373) 14458 : cluster [DBG] pgmap v10026: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:11:27.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:11:27 smithi086 bash[24289]: cluster 2024-09-16T11:11:26.087664+0000 mgr.a (mgr.14373) 14458 : cluster [DBG] pgmap v10026: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:11:27.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:11:27 smithi047 bash[22744]: cluster 2024-09-16T11:11:26.087664+0000 mgr.a (mgr.14373) 14458 : cluster [DBG] pgmap v10026: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:11:29.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:11:29 smithi157 bash[24585]: cluster 2024-09-16T11:11:28.089952+0000 mgr.a (mgr.14373) 14459 : cluster [DBG] pgmap v10027: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:11:29.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:11:29 smithi086 bash[24289]: cluster 2024-09-16T11:11:28.089952+0000 mgr.a (mgr.14373) 14459 : cluster [DBG] pgmap v10027: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:11:29.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:11:29 smithi047 bash[22744]: cluster 2024-09-16T11:11:28.089952+0000 mgr.a (mgr.14373) 14459 : cluster [DBG] pgmap v10027: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:11:31.257 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:11:31.258 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:11:31.258 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:11:31.808 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:11:31 smithi157 bash[24585]: cluster 2024-09-16T11:11:30.090745+0000 mgr.a (mgr.14373) 14460 : cluster [DBG] pgmap v10028: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:11:31.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:11:31 smithi086 bash[24289]: cluster 2024-09-16T11:11:30.090745+0000 mgr.a (mgr.14373) 14460 : cluster [DBG] pgmap v10028: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:11:31.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:11:31 smithi047 bash[22744]: cluster 2024-09-16T11:11:30.090745+0000 mgr.a (mgr.14373) 14460 : cluster [DBG] pgmap v10028: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:11:32.009 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:11:32.009 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:11:32.009 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:11:32.009 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:11:32.009 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:11:32.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:11:32 smithi157 bash[24585]: audit 2024-09-16T11:11:31.587398+0000 mgr.a (mgr.14373) 14461 : audit [DBG] from='client.313257 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:11:32.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:11:32 smithi086 bash[24289]: audit 2024-09-16T11:11:31.587398+0000 mgr.a (mgr.14373) 14461 : audit [DBG] from='client.313257 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:11:32.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:11:32 smithi047 bash[22744]: audit 2024-09-16T11:11:31.587398+0000 mgr.a (mgr.14373) 14461 : audit [DBG] from='client.313257 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:11:33.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:11:33 smithi157 bash[24585]: cluster 2024-09-16T11:11:32.093524+0000 mgr.a (mgr.14373) 14462 : cluster [DBG] pgmap v10029: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:11:33.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:11:33 smithi086 bash[24289]: cluster 2024-09-16T11:11:32.093524+0000 mgr.a (mgr.14373) 14462 : cluster [DBG] pgmap v10029: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:11:33.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:11:33 smithi047 bash[22744]: cluster 2024-09-16T11:11:32.093524+0000 mgr.a (mgr.14373) 14462 : cluster [DBG] pgmap v10029: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:11:35.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:11:35 smithi157 bash[24585]: cluster 2024-09-16T11:11:34.094478+0000 mgr.a (mgr.14373) 14463 : cluster [DBG] pgmap v10030: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:11:35.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:11:35 smithi086 bash[24289]: cluster 2024-09-16T11:11:34.094478+0000 mgr.a (mgr.14373) 14463 : cluster [DBG] pgmap v10030: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:11:35.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:11:35 smithi047 bash[22744]: cluster 2024-09-16T11:11:34.094478+0000 mgr.a (mgr.14373) 14463 : cluster [DBG] pgmap v10030: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:11:37.010 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:11:37.011 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:11:37.011 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:11:37.790 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:11:37.790 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:11:37.790 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:11:37.790 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:11:37.790 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:11:37.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:11:37 smithi157 bash[24585]: cluster 2024-09-16T11:11:36.095413+0000 mgr.a (mgr.14373) 14464 : cluster [DBG] pgmap v10031: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T11:11:37.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:11:37 smithi086 bash[24289]: cluster 2024-09-16T11:11:36.095413+0000 mgr.a (mgr.14373) 14464 : cluster [DBG] pgmap v10031: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T11:11:37.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:11:37 smithi047 bash[22744]: cluster 2024-09-16T11:11:36.095413+0000 mgr.a (mgr.14373) 14464 : cluster [DBG] pgmap v10031: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T11:11:38.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:11:38 smithi157 bash[24585]: audit 2024-09-16T11:11:37.345847+0000 mgr.a (mgr.14373) 14465 : audit [DBG] from='client.313329 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:11:38.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:11:38 smithi086 bash[24289]: audit 2024-09-16T11:11:37.345847+0000 mgr.a (mgr.14373) 14465 : audit [DBG] from='client.313329 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:11:38.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:11:38 smithi047 bash[22744]: audit 2024-09-16T11:11:37.345847+0000 mgr.a (mgr.14373) 14465 : audit [DBG] from='client.313329 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:11:39.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:11:39 smithi157 bash[24585]: cluster 2024-09-16T11:11:38.098236+0000 mgr.a (mgr.14373) 14466 : cluster [DBG] pgmap v10032: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:11:39.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:11:39 smithi086 bash[24289]: cluster 2024-09-16T11:11:38.098236+0000 mgr.a (mgr.14373) 14466 : cluster [DBG] pgmap v10032: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:11:39.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:11:39 smithi047 bash[22744]: cluster 2024-09-16T11:11:38.098236+0000 mgr.a (mgr.14373) 14466 : cluster [DBG] pgmap v10032: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:11:41.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:11:41 smithi157 bash[24585]: cluster 2024-09-16T11:11:40.099025+0000 mgr.a (mgr.14373) 14467 : cluster [DBG] pgmap v10033: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:11:41.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:11:41 smithi086 bash[24289]: cluster 2024-09-16T11:11:40.099025+0000 mgr.a (mgr.14373) 14467 : cluster [DBG] pgmap v10033: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:11:41.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:11:41 smithi047 bash[22744]: cluster 2024-09-16T11:11:40.099025+0000 mgr.a (mgr.14373) 14467 : cluster [DBG] pgmap v10033: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:11:42.791 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:11:42.792 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:11:42.792 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:11:43.575 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:11:43.575 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:11:43.575 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:11:43.575 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:11:43.575 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:11:43.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:11:43 smithi157 bash[24585]: cluster 2024-09-16T11:11:42.100987+0000 mgr.a (mgr.14373) 14468 : cluster [DBG] pgmap v10034: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:11:43.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:11:43 smithi086 bash[24289]: cluster 2024-09-16T11:11:42.100987+0000 mgr.a (mgr.14373) 14468 : cluster [DBG] pgmap v10034: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:11:43.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:11:43 smithi047 bash[22744]: cluster 2024-09-16T11:11:42.100987+0000 mgr.a (mgr.14373) 14468 : cluster [DBG] pgmap v10034: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:11:44.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:11:44 smithi157 bash[24585]: audit 2024-09-16T11:11:43.130757+0000 mgr.a (mgr.14373) 14469 : audit [DBG] from='client.313407 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:11:44.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:11:44 smithi086 bash[24289]: audit 2024-09-16T11:11:43.130757+0000 mgr.a (mgr.14373) 14469 : audit [DBG] from='client.313407 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:11:44.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:11:44 smithi047 bash[22744]: audit 2024-09-16T11:11:43.130757+0000 mgr.a (mgr.14373) 14469 : audit [DBG] from='client.313407 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:11:45.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:11:45 smithi157 bash[24585]: cluster 2024-09-16T11:11:44.101948+0000 mgr.a (mgr.14373) 14470 : cluster [DBG] pgmap v10035: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:11:45.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:11:45 smithi086 bash[24289]: cluster 2024-09-16T11:11:44.101948+0000 mgr.a (mgr.14373) 14470 : cluster [DBG] pgmap v10035: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:11:45.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:11:45 smithi047 bash[22744]: cluster 2024-09-16T11:11:44.101948+0000 mgr.a (mgr.14373) 14470 : cluster [DBG] pgmap v10035: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:11:47.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:11:47 smithi157 bash[24585]: cluster 2024-09-16T11:11:46.102714+0000 mgr.a (mgr.14373) 14471 : cluster [DBG] pgmap v10036: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:11:47.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:11:47 smithi086 bash[24289]: cluster 2024-09-16T11:11:46.102714+0000 mgr.a (mgr.14373) 14471 : cluster [DBG] pgmap v10036: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:11:47.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:11:47 smithi047 bash[22744]: cluster 2024-09-16T11:11:46.102714+0000 mgr.a (mgr.14373) 14471 : cluster [DBG] pgmap v10036: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:11:48.577 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:11:48.578 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:11:48.578 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:11:49.351 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:11:49.352 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:11:49.352 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:11:49.352 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:11:49.352 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:11:49.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:11:49 smithi157 bash[24585]: cluster 2024-09-16T11:11:48.104836+0000 mgr.a (mgr.14373) 14472 : cluster [DBG] pgmap v10037: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:11:49.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:11:49 smithi157 bash[24585]: audit 2024-09-16T11:11:48.908940+0000 mgr.a (mgr.14373) 14473 : audit [DBG] from='client.313485 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:11:49.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:11:49 smithi086 bash[24289]: cluster 2024-09-16T11:11:48.104836+0000 mgr.a (mgr.14373) 14472 : cluster [DBG] pgmap v10037: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:11:49.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:11:49 smithi086 bash[24289]: audit 2024-09-16T11:11:48.908940+0000 mgr.a (mgr.14373) 14473 : audit [DBG] from='client.313485 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:11:49.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:11:49 smithi047 bash[22744]: cluster 2024-09-16T11:11:48.104836+0000 mgr.a (mgr.14373) 14472 : cluster [DBG] pgmap v10037: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:11:49.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:11:49 smithi047 bash[22744]: audit 2024-09-16T11:11:48.908940+0000 mgr.a (mgr.14373) 14473 : audit [DBG] from='client.313485 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:11:51.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:11:51 smithi157 bash[24585]: cluster 2024-09-16T11:11:50.105802+0000 mgr.a (mgr.14373) 14474 : cluster [DBG] pgmap v10038: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:11:51.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:11:51 smithi086 bash[24289]: cluster 2024-09-16T11:11:50.105802+0000 mgr.a (mgr.14373) 14474 : cluster [DBG] pgmap v10038: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:11:51.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:11:51 smithi047 bash[22744]: cluster 2024-09-16T11:11:50.105802+0000 mgr.a (mgr.14373) 14474 : cluster [DBG] pgmap v10038: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:11:53.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:11:53 smithi157 bash[24585]: cluster 2024-09-16T11:11:52.108046+0000 mgr.a (mgr.14373) 14475 : cluster [DBG] pgmap v10039: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:11:53.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:11:53 smithi086 bash[24289]: cluster 2024-09-16T11:11:52.108046+0000 mgr.a (mgr.14373) 14475 : cluster [DBG] pgmap v10039: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:11:53.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:11:53 smithi047 bash[22744]: cluster 2024-09-16T11:11:52.108046+0000 mgr.a (mgr.14373) 14475 : cluster [DBG] pgmap v10039: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:11:54.353 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:11:54.354 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:11:54.354 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:11:55.133 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:11:55.134 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:11:55.134 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:11:55.134 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:11:55.134 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:11:55.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:11:55 smithi157 bash[24585]: cluster 2024-09-16T11:11:54.108802+0000 mgr.a (mgr.14373) 14476 : cluster [DBG] pgmap v10040: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:11:55.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:11:55 smithi157 bash[24585]: audit 2024-09-16T11:11:54.691496+0000 mgr.a (mgr.14373) 14477 : audit [DBG] from='client.313563 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:11:55.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:11:55 smithi086 bash[24289]: cluster 2024-09-16T11:11:54.108802+0000 mgr.a (mgr.14373) 14476 : cluster [DBG] pgmap v10040: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:11:55.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:11:55 smithi086 bash[24289]: audit 2024-09-16T11:11:54.691496+0000 mgr.a (mgr.14373) 14477 : audit [DBG] from='client.313563 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:11:55.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:11:55 smithi047 bash[22744]: cluster 2024-09-16T11:11:54.108802+0000 mgr.a (mgr.14373) 14476 : cluster [DBG] pgmap v10040: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:11:55.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:11:55 smithi047 bash[22744]: audit 2024-09-16T11:11:54.691496+0000 mgr.a (mgr.14373) 14477 : audit [DBG] from='client.313563 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:11:57.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:11:57 smithi086 bash[24289]: cluster 2024-09-16T11:11:56.109758+0000 mgr.a (mgr.14373) 14478 : cluster [DBG] pgmap v10041: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:11:57.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:11:57 smithi047 bash[22744]: cluster 2024-09-16T11:11:56.109758+0000 mgr.a (mgr.14373) 14478 : cluster [DBG] pgmap v10041: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:11:57.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:11:57 smithi157 bash[24585]: cluster 2024-09-16T11:11:56.109758+0000 mgr.a (mgr.14373) 14478 : cluster [DBG] pgmap v10041: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:11:59.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:11:59 smithi157 bash[24585]: cluster 2024-09-16T11:11:58.112025+0000 mgr.a (mgr.14373) 14479 : cluster [DBG] pgmap v10042: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:11:59.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:11:59 smithi086 bash[24289]: cluster 2024-09-16T11:11:58.112025+0000 mgr.a (mgr.14373) 14479 : cluster [DBG] pgmap v10042: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:11:59.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:11:59 smithi047 bash[22744]: cluster 2024-09-16T11:11:58.112025+0000 mgr.a (mgr.14373) 14479 : cluster [DBG] pgmap v10042: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:12:00.135 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:12:00.135 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:12:00.135 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:12:00.918 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:12:00.919 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:12:00.919 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:12:00.919 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:12:00.919 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:12:01.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:12:01 smithi157 bash[24585]: cluster 2024-09-16T11:12:00.112758+0000 mgr.a (mgr.14373) 14480 : cluster [DBG] pgmap v10043: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:12:01.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:12:01 smithi157 bash[24585]: audit 2024-09-16T11:12:00.464832+0000 mgr.a (mgr.14373) 14481 : audit [DBG] from='client.313635 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:12:01.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:12:01 smithi086 bash[24289]: cluster 2024-09-16T11:12:00.112758+0000 mgr.a (mgr.14373) 14480 : cluster [DBG] pgmap v10043: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:12:01.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:12:01 smithi086 bash[24289]: audit 2024-09-16T11:12:00.464832+0000 mgr.a (mgr.14373) 14481 : audit [DBG] from='client.313635 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:12:01.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:12:01 smithi047 bash[22744]: cluster 2024-09-16T11:12:00.112758+0000 mgr.a (mgr.14373) 14480 : cluster [DBG] pgmap v10043: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:12:01.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:12:01 smithi047 bash[22744]: audit 2024-09-16T11:12:00.464832+0000 mgr.a (mgr.14373) 14481 : audit [DBG] from='client.313635 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:12:03.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:12:03 smithi157 bash[24585]: cluster 2024-09-16T11:12:02.115245+0000 mgr.a (mgr.14373) 14482 : cluster [DBG] pgmap v10044: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:12:03.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:12:03 smithi086 bash[24289]: cluster 2024-09-16T11:12:02.115245+0000 mgr.a (mgr.14373) 14482 : cluster [DBG] pgmap v10044: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:12:03.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:12:03 smithi047 bash[22744]: cluster 2024-09-16T11:12:02.115245+0000 mgr.a (mgr.14373) 14482 : cluster [DBG] pgmap v10044: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:12:05.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:12:05 smithi157 bash[24585]: cluster 2024-09-16T11:12:04.116193+0000 mgr.a (mgr.14373) 14483 : cluster [DBG] pgmap v10045: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:12:05.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:12:05 smithi086 bash[24289]: cluster 2024-09-16T11:12:04.116193+0000 mgr.a (mgr.14373) 14483 : cluster [DBG] pgmap v10045: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:12:05.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:12:05 smithi047 bash[22744]: cluster 2024-09-16T11:12:04.116193+0000 mgr.a (mgr.14373) 14483 : cluster [DBG] pgmap v10045: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:12:05.920 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:12:05.921 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:12:05.921 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:12:06.686 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:12:06.686 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:12:06.686 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:12:06.686 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:12:06.687 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:12:07.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:12:07 smithi157 bash[24585]: cluster 2024-09-16T11:12:06.116778+0000 mgr.a (mgr.14373) 14484 : cluster [DBG] pgmap v10046: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:12:07.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:12:07 smithi157 bash[24585]: audit 2024-09-16T11:12:06.251926+0000 mgr.a (mgr.14373) 14485 : audit [DBG] from='client.313710 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:12:07.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:12:07 smithi086 bash[24289]: cluster 2024-09-16T11:12:06.116778+0000 mgr.a (mgr.14373) 14484 : cluster [DBG] pgmap v10046: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:12:07.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:12:07 smithi086 bash[24289]: audit 2024-09-16T11:12:06.251926+0000 mgr.a (mgr.14373) 14485 : audit [DBG] from='client.313710 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:12:07.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:12:07 smithi047 bash[22744]: cluster 2024-09-16T11:12:06.116778+0000 mgr.a (mgr.14373) 14484 : cluster [DBG] pgmap v10046: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:12:07.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:12:07 smithi047 bash[22744]: audit 2024-09-16T11:12:06.251926+0000 mgr.a (mgr.14373) 14485 : audit [DBG] from='client.313710 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:12:09.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:12:09 smithi157 bash[24585]: cluster 2024-09-16T11:12:08.119610+0000 mgr.a (mgr.14373) 14486 : cluster [DBG] pgmap v10047: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:12:09.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:12:09 smithi086 bash[24289]: cluster 2024-09-16T11:12:08.119610+0000 mgr.a (mgr.14373) 14486 : cluster [DBG] pgmap v10047: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:12:09.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:12:09 smithi047 bash[22744]: cluster 2024-09-16T11:12:08.119610+0000 mgr.a (mgr.14373) 14486 : cluster [DBG] pgmap v10047: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:12:11.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:12:11 smithi157 bash[24585]: cluster 2024-09-16T11:12:10.120583+0000 mgr.a (mgr.14373) 14487 : cluster [DBG] pgmap v10048: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:12:11.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:12:11 smithi086 bash[24289]: cluster 2024-09-16T11:12:10.120583+0000 mgr.a (mgr.14373) 14487 : cluster [DBG] pgmap v10048: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:12:11.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:12:11 smithi047 bash[22744]: cluster 2024-09-16T11:12:10.120583+0000 mgr.a (mgr.14373) 14487 : cluster [DBG] pgmap v10048: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:12:11.688 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:12:11.688 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:12:11.689 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:12:12.435 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:12:12.436 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:12:12.436 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:12:12.436 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:12:12.436 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:12:13.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:12:13 smithi157 bash[24585]: audit 2024-09-16T11:12:12.018443+0000 mgr.a (mgr.14373) 14488 : audit [DBG] from='client.313788 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:12:13.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:12:13 smithi157 bash[24585]: cluster 2024-09-16T11:12:12.121816+0000 mgr.a (mgr.14373) 14489 : cluster [DBG] pgmap v10049: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:12:13.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:12:13 smithi086 bash[24289]: audit 2024-09-16T11:12:12.018443+0000 mgr.a (mgr.14373) 14488 : audit [DBG] from='client.313788 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:12:13.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:12:13 smithi086 bash[24289]: cluster 2024-09-16T11:12:12.121816+0000 mgr.a (mgr.14373) 14489 : cluster [DBG] pgmap v10049: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:12:13.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:12:13 smithi047 bash[22744]: audit 2024-09-16T11:12:12.018443+0000 mgr.a (mgr.14373) 14488 : audit [DBG] from='client.313788 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:12:13.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:12:13 smithi047 bash[22744]: cluster 2024-09-16T11:12:12.121816+0000 mgr.a (mgr.14373) 14489 : cluster [DBG] pgmap v10049: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:12:15.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:12:15 smithi157 bash[24585]: cluster 2024-09-16T11:12:14.122677+0000 mgr.a (mgr.14373) 14490 : cluster [DBG] pgmap v10050: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:12:15.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:12:15 smithi086 bash[24289]: cluster 2024-09-16T11:12:14.122677+0000 mgr.a (mgr.14373) 14490 : cluster [DBG] pgmap v10050: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:12:15.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:12:15 smithi047 bash[22744]: cluster 2024-09-16T11:12:14.122677+0000 mgr.a (mgr.14373) 14490 : cluster [DBG] pgmap v10050: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:12:16.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:12:16 smithi157 bash[24585]: audit 2024-09-16T11:12:15.511591+0000 mon.b (mon.2) 1322 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T11:12:16.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:12:16 smithi086 bash[24289]: audit 2024-09-16T11:12:15.511591+0000 mon.b (mon.2) 1322 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T11:12:16.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:12:16 smithi047 bash[22744]: audit 2024-09-16T11:12:15.511591+0000 mon.b (mon.2) 1322 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T11:12:17.437 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:12:17.438 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:12:17.438 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:12:17.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:12:17 smithi157 bash[24585]: cluster 2024-09-16T11:12:16.123394+0000 mgr.a (mgr.14373) 14491 : cluster [DBG] pgmap v10051: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T11:12:17.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:12:17 smithi086 bash[24289]: cluster 2024-09-16T11:12:16.123394+0000 mgr.a (mgr.14373) 14491 : cluster [DBG] pgmap v10051: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T11:12:17.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:12:17 smithi047 bash[22744]: cluster 2024-09-16T11:12:16.123394+0000 mgr.a (mgr.14373) 14491 : cluster [DBG] pgmap v10051: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T11:12:18.189 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:12:18.189 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:12:18.190 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:12:18.190 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:12:18.190 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:12:18.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:12:18 smithi157 bash[24585]: audit 2024-09-16T11:12:17.764241+0000 mgr.a (mgr.14373) 14492 : audit [DBG] from='client.313866 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:12:18.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:12:18 smithi086 bash[24289]: audit 2024-09-16T11:12:17.764241+0000 mgr.a (mgr.14373) 14492 : audit [DBG] from='client.313866 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:12:18.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:12:18 smithi047 bash[22744]: audit 2024-09-16T11:12:17.764241+0000 mgr.a (mgr.14373) 14492 : audit [DBG] from='client.313866 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:12:19.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:12:19 smithi157 bash[24585]: cluster 2024-09-16T11:12:18.126226+0000 mgr.a (mgr.14373) 14493 : cluster [DBG] pgmap v10052: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:12:19.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:12:19 smithi086 bash[24289]: cluster 2024-09-16T11:12:18.126226+0000 mgr.a (mgr.14373) 14493 : cluster [DBG] pgmap v10052: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:12:19.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:12:19 smithi047 bash[22744]: cluster 2024-09-16T11:12:18.126226+0000 mgr.a (mgr.14373) 14493 : cluster [DBG] pgmap v10052: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:12:21.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:12:21 smithi157 bash[24585]: cluster 2024-09-16T11:12:20.127023+0000 mgr.a (mgr.14373) 14494 : cluster [DBG] pgmap v10053: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:12:21.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:12:21 smithi086 bash[24289]: cluster 2024-09-16T11:12:20.127023+0000 mgr.a (mgr.14373) 14494 : cluster [DBG] pgmap v10053: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:12:21.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:12:21 smithi047 bash[22744]: cluster 2024-09-16T11:12:20.127023+0000 mgr.a (mgr.14373) 14494 : cluster [DBG] pgmap v10053: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:12:23.191 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:12:23.191 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:12:23.191 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:12:23.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:12:23 smithi157 bash[24585]: cluster 2024-09-16T11:12:22.128944+0000 mgr.a (mgr.14373) 14495 : cluster [DBG] pgmap v10054: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:12:23.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:12:23 smithi086 bash[24289]: cluster 2024-09-16T11:12:22.128944+0000 mgr.a (mgr.14373) 14495 : cluster [DBG] pgmap v10054: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:12:23.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:12:23 smithi047 bash[22744]: cluster 2024-09-16T11:12:22.128944+0000 mgr.a (mgr.14373) 14495 : cluster [DBG] pgmap v10054: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:12:23.969 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:12:23.970 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:12:23.970 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:12:23.970 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:12:23.970 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:12:24.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:12:24 smithi157 bash[24585]: audit 2024-09-16T11:12:23.531392+0000 mgr.a (mgr.14373) 14496 : audit [DBG] from='client.313941 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:12:24.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:12:24 smithi086 bash[24289]: audit 2024-09-16T11:12:23.531392+0000 mgr.a (mgr.14373) 14496 : audit [DBG] from='client.313941 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:12:24.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:12:24 smithi047 bash[22744]: audit 2024-09-16T11:12:23.531392+0000 mgr.a (mgr.14373) 14496 : audit [DBG] from='client.313941 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:12:25.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:12:25 smithi157 bash[24585]: cluster 2024-09-16T11:12:24.129900+0000 mgr.a (mgr.14373) 14497 : cluster [DBG] pgmap v10055: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:12:25.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:12:25 smithi086 bash[24289]: cluster 2024-09-16T11:12:24.129900+0000 mgr.a (mgr.14373) 14497 : cluster [DBG] pgmap v10055: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:12:25.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:12:25 smithi047 bash[22744]: cluster 2024-09-16T11:12:24.129900+0000 mgr.a (mgr.14373) 14497 : cluster [DBG] pgmap v10055: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:12:27.343 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 11:12:27 smithi047 bash[22994]: debug 2024-09-16T11:12:26.995+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T11:12:27.343 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 11:12:27 smithi047 bash[22994]: debug 2024-09-16T11:12:26.999+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T11:12:27.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:12:27 smithi047 bash[22744]: cluster 2024-09-16T11:12:26.130873+0000 mgr.a (mgr.14373) 14498 : cluster [DBG] pgmap v10056: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:12:27.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:12:27 smithi047 bash[22744]: audit 2024-09-16T11:12:26.185936+0000 mon.a (mon.0) 1430 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:12:27.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:12:27 smithi047 bash[22744]: audit 2024-09-16T11:12:26.197514+0000 mon.a (mon.0) 1431 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:12:27.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:12:27 smithi047 bash[22744]: audit 2024-09-16T11:12:26.200166+0000 mon.b (mon.2) 1323 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T11:12:27.344 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:12:27 smithi047 bash[22744]: audit 2024-09-16T11:12:26.202579+0000 mon.b (mon.2) 1324 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T11:12:27.344 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:12:27 smithi047 bash[22744]: audit 2024-09-16T11:12:26.214680+0000 mon.a (mon.0) 1432 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:12:27.344 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:12:27 smithi047 bash[22744]: audit 2024-09-16T11:12:26.219787+0000 mon.b (mon.2) 1325 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:12:27.344 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:12:27 smithi047 bash[22744]: audit 2024-09-16T11:12:26.222798+0000 mgr.a (mgr.14373) 14499 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:12:27.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:12:27 smithi157 bash[24585]: cluster 2024-09-16T11:12:26.130873+0000 mgr.a (mgr.14373) 14498 : cluster [DBG] pgmap v10056: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:12:27.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:12:27 smithi157 bash[24585]: audit 2024-09-16T11:12:26.185936+0000 mon.a (mon.0) 1430 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:12:27.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:12:27 smithi157 bash[24585]: audit 2024-09-16T11:12:26.197514+0000 mon.a (mon.0) 1431 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:12:27.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:12:27 smithi157 bash[24585]: audit 2024-09-16T11:12:26.200166+0000 mon.b (mon.2) 1323 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T11:12:27.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:12:27 smithi157 bash[24585]: audit 2024-09-16T11:12:26.202579+0000 mon.b (mon.2) 1324 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T11:12:27.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:12:27 smithi157 bash[24585]: audit 2024-09-16T11:12:26.214680+0000 mon.a (mon.0) 1432 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:12:27.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:12:27 smithi157 bash[24585]: audit 2024-09-16T11:12:26.219787+0000 mon.b (mon.2) 1325 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:12:27.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:12:27 smithi157 bash[24585]: audit 2024-09-16T11:12:26.222798+0000 mgr.a (mgr.14373) 14499 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:12:27.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:12:27 smithi086 bash[24289]: cluster 2024-09-16T11:12:26.130873+0000 mgr.a (mgr.14373) 14498 : cluster [DBG] pgmap v10056: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:12:27.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:12:27 smithi086 bash[24289]: audit 2024-09-16T11:12:26.185936+0000 mon.a (mon.0) 1430 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:12:27.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:12:27 smithi086 bash[24289]: audit 2024-09-16T11:12:26.197514+0000 mon.a (mon.0) 1431 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:12:27.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:12:27 smithi086 bash[24289]: audit 2024-09-16T11:12:26.200166+0000 mon.b (mon.2) 1323 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T11:12:27.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:12:27 smithi086 bash[24289]: audit 2024-09-16T11:12:26.202579+0000 mon.b (mon.2) 1324 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T11:12:27.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:12:27 smithi086 bash[24289]: audit 2024-09-16T11:12:26.214680+0000 mon.a (mon.0) 1432 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:12:27.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:12:27 smithi086 bash[24289]: audit 2024-09-16T11:12:26.219787+0000 mon.b (mon.2) 1325 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:12:27.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:12:27 smithi086 bash[24289]: audit 2024-09-16T11:12:26.222798+0000 mgr.a (mgr.14373) 14499 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:12:28.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:12:28 smithi157 bash[24585]: audit 2024-09-16T11:12:27.001018+0000 mgr.a (mgr.14373) 14500 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T11:12:28.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:12:28 smithi157 bash[24585]: cephadm 2024-09-16T11:12:27.002574+0000 mgr.a (mgr.14373) 14501 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T11:12:28.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:12:28 smithi086 bash[24289]: audit 2024-09-16T11:12:27.001018+0000 mgr.a (mgr.14373) 14500 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T11:12:28.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:12:28 smithi086 bash[24289]: cephadm 2024-09-16T11:12:27.002574+0000 mgr.a (mgr.14373) 14501 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T11:12:28.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:12:28 smithi047 bash[22744]: audit 2024-09-16T11:12:27.001018+0000 mgr.a (mgr.14373) 14500 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T11:12:28.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:12:28 smithi047 bash[22744]: cephadm 2024-09-16T11:12:27.002574+0000 mgr.a (mgr.14373) 14501 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T11:12:28.971 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:12:28.972 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:12:28.972 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:12:29.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:12:29 smithi157 bash[24585]: cluster 2024-09-16T11:12:28.133579+0000 mgr.a (mgr.14373) 14502 : cluster [DBG] pgmap v10057: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 3.4 KiB/s rd, 3 op/s 2024-09-16T11:12:29.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:12:29 smithi086 bash[24289]: cluster 2024-09-16T11:12:28.133579+0000 mgr.a (mgr.14373) 14502 : cluster [DBG] pgmap v10057: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 3.4 KiB/s rd, 3 op/s 2024-09-16T11:12:29.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:12:29 smithi047 bash[22744]: cluster 2024-09-16T11:12:28.133579+0000 mgr.a (mgr.14373) 14502 : cluster [DBG] pgmap v10057: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 3.4 KiB/s rd, 3 op/s 2024-09-16T11:12:29.740 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:12:29.740 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:12:29.740 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:12:29.740 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:12:29.741 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:12:30.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:12:30 smithi157 bash[24585]: audit 2024-09-16T11:12:29.303965+0000 mgr.a (mgr.14373) 14503 : audit [DBG] from='client.314121 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:12:30.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:12:30 smithi086 bash[24289]: audit 2024-09-16T11:12:29.303965+0000 mgr.a (mgr.14373) 14503 : audit [DBG] from='client.314121 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:12:30.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:12:30 smithi047 bash[22744]: audit 2024-09-16T11:12:29.303965+0000 mgr.a (mgr.14373) 14503 : audit [DBG] from='client.314121 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:12:31.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:12:31 smithi157 bash[24585]: cluster 2024-09-16T11:12:30.134544+0000 mgr.a (mgr.14373) 14504 : cluster [DBG] pgmap v10058: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-16T11:12:31.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:12:31 smithi086 bash[24289]: cluster 2024-09-16T11:12:30.134544+0000 mgr.a (mgr.14373) 14504 : cluster [DBG] pgmap v10058: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-16T11:12:31.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:12:31 smithi047 bash[22744]: cluster 2024-09-16T11:12:30.134544+0000 mgr.a (mgr.14373) 14504 : cluster [DBG] pgmap v10058: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-16T11:12:33.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:12:33 smithi157 bash[24585]: cluster 2024-09-16T11:12:32.136660+0000 mgr.a (mgr.14373) 14505 : cluster [DBG] pgmap v10059: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:12:33.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:12:33 smithi086 bash[24289]: cluster 2024-09-16T11:12:32.136660+0000 mgr.a (mgr.14373) 14505 : cluster [DBG] pgmap v10059: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:12:33.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:12:33 smithi047 bash[22744]: cluster 2024-09-16T11:12:32.136660+0000 mgr.a (mgr.14373) 14505 : cluster [DBG] pgmap v10059: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:12:34.741 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:12:34.742 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:12:34.742 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:12:35.494 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:12:35.494 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:12:35.495 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:12:35.495 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:12:35.495 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:12:35.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:12:35 smithi157 bash[24585]: cluster 2024-09-16T11:12:34.137410+0000 mgr.a (mgr.14373) 14506 : cluster [DBG] pgmap v10060: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:12:35.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:12:35 smithi086 bash[24289]: cluster 2024-09-16T11:12:34.137410+0000 mgr.a (mgr.14373) 14506 : cluster [DBG] pgmap v10060: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:12:35.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:12:35 smithi047 bash[22744]: cluster 2024-09-16T11:12:34.137410+0000 mgr.a (mgr.14373) 14506 : cluster [DBG] pgmap v10060: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:12:36.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:12:36 smithi157 bash[24585]: audit 2024-09-16T11:12:35.073937+0000 mgr.a (mgr.14373) 14507 : audit [DBG] from='client.314193 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:12:36.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:12:36 smithi086 bash[24289]: audit 2024-09-16T11:12:35.073937+0000 mgr.a (mgr.14373) 14507 : audit [DBG] from='client.314193 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:12:36.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:12:36 smithi047 bash[22744]: audit 2024-09-16T11:12:35.073937+0000 mgr.a (mgr.14373) 14507 : audit [DBG] from='client.314193 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:12:37.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:12:37 smithi157 bash[24585]: cluster 2024-09-16T11:12:36.138412+0000 mgr.a (mgr.14373) 14508 : cluster [DBG] pgmap v10061: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:12:37.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:12:37 smithi086 bash[24289]: cluster 2024-09-16T11:12:36.138412+0000 mgr.a (mgr.14373) 14508 : cluster [DBG] pgmap v10061: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:12:37.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:12:37 smithi047 bash[22744]: cluster 2024-09-16T11:12:36.138412+0000 mgr.a (mgr.14373) 14508 : cluster [DBG] pgmap v10061: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:12:39.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:12:39 smithi157 bash[24585]: cluster 2024-09-16T11:12:38.140705+0000 mgr.a (mgr.14373) 14509 : cluster [DBG] pgmap v10062: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:12:39.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:12:39 smithi086 bash[24289]: cluster 2024-09-16T11:12:38.140705+0000 mgr.a (mgr.14373) 14509 : cluster [DBG] pgmap v10062: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:12:39.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:12:39 smithi047 bash[22744]: cluster 2024-09-16T11:12:38.140705+0000 mgr.a (mgr.14373) 14509 : cluster [DBG] pgmap v10062: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:12:40.496 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:12:40.497 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:12:40.497 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:12:41.281 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:12:41.281 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:12:41.281 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:12:41.281 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:12:41.281 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:12:41.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:12:41 smithi157 bash[24585]: cluster 2024-09-16T11:12:40.141486+0000 mgr.a (mgr.14373) 14510 : cluster [DBG] pgmap v10063: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T11:12:41.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:12:41 smithi157 bash[24585]: audit 2024-09-16T11:12:40.830798+0000 mgr.a (mgr.14373) 14511 : audit [DBG] from='client.314271 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:12:41.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:12:41 smithi086 bash[24289]: cluster 2024-09-16T11:12:40.141486+0000 mgr.a (mgr.14373) 14510 : cluster [DBG] pgmap v10063: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T11:12:41.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:12:41 smithi086 bash[24289]: audit 2024-09-16T11:12:40.830798+0000 mgr.a (mgr.14373) 14511 : audit [DBG] from='client.314271 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:12:41.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:12:41 smithi047 bash[22744]: cluster 2024-09-16T11:12:40.141486+0000 mgr.a (mgr.14373) 14510 : cluster [DBG] pgmap v10063: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T11:12:41.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:12:41 smithi047 bash[22744]: audit 2024-09-16T11:12:40.830798+0000 mgr.a (mgr.14373) 14511 : audit [DBG] from='client.314271 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:12:43.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:12:43 smithi157 bash[24585]: cluster 2024-09-16T11:12:42.143873+0000 mgr.a (mgr.14373) 14512 : cluster [DBG] pgmap v10064: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:12:43.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:12:43 smithi086 bash[24289]: cluster 2024-09-16T11:12:42.143873+0000 mgr.a (mgr.14373) 14512 : cluster [DBG] pgmap v10064: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:12:43.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:12:43 smithi047 bash[22744]: cluster 2024-09-16T11:12:42.143873+0000 mgr.a (mgr.14373) 14512 : cluster [DBG] pgmap v10064: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:12:45.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:12:45 smithi157 bash[24585]: cluster 2024-09-16T11:12:44.144645+0000 mgr.a (mgr.14373) 14513 : cluster [DBG] pgmap v10065: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:12:45.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:12:45 smithi086 bash[24289]: cluster 2024-09-16T11:12:44.144645+0000 mgr.a (mgr.14373) 14513 : cluster [DBG] pgmap v10065: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:12:45.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:12:45 smithi047 bash[22744]: cluster 2024-09-16T11:12:44.144645+0000 mgr.a (mgr.14373) 14513 : cluster [DBG] pgmap v10065: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:12:46.283 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:12:46.283 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:12:46.284 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:12:47.032 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:12:47.032 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:12:47.032 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:12:47.032 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:12:47.032 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:12:47.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:12:47 smithi157 bash[24585]: cluster 2024-09-16T11:12:46.145398+0000 mgr.a (mgr.14373) 14514 : cluster [DBG] pgmap v10066: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:12:47.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:12:47 smithi157 bash[24585]: audit 2024-09-16T11:12:46.611201+0000 mgr.a (mgr.14373) 14515 : audit [DBG] from='client.314349 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:12:47.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:12:47 smithi086 bash[24289]: cluster 2024-09-16T11:12:46.145398+0000 mgr.a (mgr.14373) 14514 : cluster [DBG] pgmap v10066: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:12:47.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:12:47 smithi086 bash[24289]: audit 2024-09-16T11:12:46.611201+0000 mgr.a (mgr.14373) 14515 : audit [DBG] from='client.314349 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:12:47.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:12:47 smithi047 bash[22744]: cluster 2024-09-16T11:12:46.145398+0000 mgr.a (mgr.14373) 14514 : cluster [DBG] pgmap v10066: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:12:47.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:12:47 smithi047 bash[22744]: audit 2024-09-16T11:12:46.611201+0000 mgr.a (mgr.14373) 14515 : audit [DBG] from='client.314349 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:12:49.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:12:49 smithi157 bash[24585]: cluster 2024-09-16T11:12:48.148042+0000 mgr.a (mgr.14373) 14516 : cluster [DBG] pgmap v10067: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:12:49.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:12:49 smithi086 bash[24289]: cluster 2024-09-16T11:12:48.148042+0000 mgr.a (mgr.14373) 14516 : cluster [DBG] pgmap v10067: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:12:49.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:12:49 smithi047 bash[22744]: cluster 2024-09-16T11:12:48.148042+0000 mgr.a (mgr.14373) 14516 : cluster [DBG] pgmap v10067: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:12:51.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:12:51 smithi157 bash[24585]: cluster 2024-09-16T11:12:50.148841+0000 mgr.a (mgr.14373) 14517 : cluster [DBG] pgmap v10068: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:12:51.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:12:51 smithi086 bash[24289]: cluster 2024-09-16T11:12:50.148841+0000 mgr.a (mgr.14373) 14517 : cluster [DBG] pgmap v10068: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:12:51.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:12:51 smithi047 bash[22744]: cluster 2024-09-16T11:12:50.148841+0000 mgr.a (mgr.14373) 14517 : cluster [DBG] pgmap v10068: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:12:52.033 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:12:52.034 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:12:52.034 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:12:52.785 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:12:52.785 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:12:52.785 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:12:52.785 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:12:52.785 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:12:53.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:12:53 smithi157 bash[24585]: cluster 2024-09-16T11:12:52.150000+0000 mgr.a (mgr.14373) 14518 : cluster [DBG] pgmap v10069: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:12:53.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:12:53 smithi157 bash[24585]: audit 2024-09-16T11:12:52.365237+0000 mgr.a (mgr.14373) 14519 : audit [DBG] from='client.314421 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:12:53.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:12:53 smithi086 bash[24289]: cluster 2024-09-16T11:12:52.150000+0000 mgr.a (mgr.14373) 14518 : cluster [DBG] pgmap v10069: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:12:53.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:12:53 smithi086 bash[24289]: audit 2024-09-16T11:12:52.365237+0000 mgr.a (mgr.14373) 14519 : audit [DBG] from='client.314421 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:12:53.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:12:53 smithi047 bash[22744]: cluster 2024-09-16T11:12:52.150000+0000 mgr.a (mgr.14373) 14518 : cluster [DBG] pgmap v10069: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:12:53.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:12:53 smithi047 bash[22744]: audit 2024-09-16T11:12:52.365237+0000 mgr.a (mgr.14373) 14519 : audit [DBG] from='client.314421 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:12:55.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:12:55 smithi157 bash[24585]: cluster 2024-09-16T11:12:54.150899+0000 mgr.a (mgr.14373) 14520 : cluster [DBG] pgmap v10070: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T11:12:55.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:12:55 smithi086 bash[24289]: cluster 2024-09-16T11:12:54.150899+0000 mgr.a (mgr.14373) 14520 : cluster [DBG] pgmap v10070: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T11:12:55.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:12:55 smithi047 bash[22744]: cluster 2024-09-16T11:12:54.150899+0000 mgr.a (mgr.14373) 14520 : cluster [DBG] pgmap v10070: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T11:12:57.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:12:57 smithi157 bash[24585]: cluster 2024-09-16T11:12:56.151841+0000 mgr.a (mgr.14373) 14521 : cluster [DBG] pgmap v10071: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T11:12:57.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:12:57 smithi086 bash[24289]: cluster 2024-09-16T11:12:56.151841+0000 mgr.a (mgr.14373) 14521 : cluster [DBG] pgmap v10071: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T11:12:57.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:12:57 smithi047 bash[22744]: cluster 2024-09-16T11:12:56.151841+0000 mgr.a (mgr.14373) 14521 : cluster [DBG] pgmap v10071: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T11:12:57.786 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:12:57.787 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:12:57.787 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:12:58.539 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:12:58.540 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:12:58.540 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:12:58.540 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:12:58.541 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:12:59.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:12:59 smithi157 bash[24585]: audit 2024-09-16T11:12:58.118754+0000 mgr.a (mgr.14373) 14522 : audit [DBG] from='client.314496 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:12:59.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:12:59 smithi157 bash[24585]: cluster 2024-09-16T11:12:58.153363+0000 mgr.a (mgr.14373) 14523 : cluster [DBG] pgmap v10072: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:12:59.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:12:59 smithi086 bash[24289]: audit 2024-09-16T11:12:58.118754+0000 mgr.a (mgr.14373) 14522 : audit [DBG] from='client.314496 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:12:59.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:12:59 smithi086 bash[24289]: cluster 2024-09-16T11:12:58.153363+0000 mgr.a (mgr.14373) 14523 : cluster [DBG] pgmap v10072: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:12:59.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:12:59 smithi047 bash[22744]: audit 2024-09-16T11:12:58.118754+0000 mgr.a (mgr.14373) 14522 : audit [DBG] from='client.314496 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:12:59.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:12:59 smithi047 bash[22744]: cluster 2024-09-16T11:12:58.153363+0000 mgr.a (mgr.14373) 14523 : cluster [DBG] pgmap v10072: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:13:01.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:13:01 smithi157 bash[24585]: cluster 2024-09-16T11:13:00.153904+0000 mgr.a (mgr.14373) 14524 : cluster [DBG] pgmap v10073: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:13:01.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:13:01 smithi086 bash[24289]: cluster 2024-09-16T11:13:00.153904+0000 mgr.a (mgr.14373) 14524 : cluster [DBG] pgmap v10073: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:13:01.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:13:01 smithi047 bash[22744]: cluster 2024-09-16T11:13:00.153904+0000 mgr.a (mgr.14373) 14524 : cluster [DBG] pgmap v10073: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:13:03.541 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:13:03.541 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:13:03.542 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:13:03.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:13:03 smithi157 bash[24585]: cluster 2024-09-16T11:13:02.156028+0000 mgr.a (mgr.14373) 14525 : cluster [DBG] pgmap v10074: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:13:03.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:13:03 smithi086 bash[24289]: cluster 2024-09-16T11:13:02.156028+0000 mgr.a (mgr.14373) 14525 : cluster [DBG] pgmap v10074: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:13:03.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:13:03 smithi047 bash[22744]: cluster 2024-09-16T11:13:02.156028+0000 mgr.a (mgr.14373) 14525 : cluster [DBG] pgmap v10074: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:13:04.335 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:13:04.335 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:13:04.335 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:13:04.335 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:13:04.336 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:13:04.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:13:04 smithi157 bash[24585]: audit 2024-09-16T11:13:03.880771+0000 mgr.a (mgr.14373) 14526 : audit [DBG] from='client.314574 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:13:04.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:13:04 smithi086 bash[24289]: audit 2024-09-16T11:13:03.880771+0000 mgr.a (mgr.14373) 14526 : audit [DBG] from='client.314574 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:13:04.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:13:04 smithi047 bash[22744]: audit 2024-09-16T11:13:03.880771+0000 mgr.a (mgr.14373) 14526 : audit [DBG] from='client.314574 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:13:05.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:13:05 smithi157 bash[24585]: cluster 2024-09-16T11:13:04.156677+0000 mgr.a (mgr.14373) 14527 : cluster [DBG] pgmap v10075: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:13:05.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:13:05 smithi086 bash[24289]: cluster 2024-09-16T11:13:04.156677+0000 mgr.a (mgr.14373) 14527 : cluster [DBG] pgmap v10075: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:13:05.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:13:05 smithi047 bash[22744]: cluster 2024-09-16T11:13:04.156677+0000 mgr.a (mgr.14373) 14527 : cluster [DBG] pgmap v10075: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:13:07.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:13:07 smithi157 bash[24585]: cluster 2024-09-16T11:13:06.157636+0000 mgr.a (mgr.14373) 14528 : cluster [DBG] pgmap v10076: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:13:07.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:13:07 smithi086 bash[24289]: cluster 2024-09-16T11:13:06.157636+0000 mgr.a (mgr.14373) 14528 : cluster [DBG] pgmap v10076: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:13:07.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:13:07 smithi047 bash[22744]: cluster 2024-09-16T11:13:06.157636+0000 mgr.a (mgr.14373) 14528 : cluster [DBG] pgmap v10076: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:13:09.336 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:13:09.337 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:13:09.337 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:13:09.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:13:09 smithi157 bash[24585]: cluster 2024-09-16T11:13:08.159947+0000 mgr.a (mgr.14373) 14529 : cluster [DBG] pgmap v10077: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:13:09.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:13:09 smithi086 bash[24289]: cluster 2024-09-16T11:13:08.159947+0000 mgr.a (mgr.14373) 14529 : cluster [DBG] pgmap v10077: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:13:09.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:13:09 smithi047 bash[22744]: cluster 2024-09-16T11:13:08.159947+0000 mgr.a (mgr.14373) 14529 : cluster [DBG] pgmap v10077: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:13:10.094 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:13:10.095 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:13:10.095 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:13:10.095 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:13:10.095 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:13:10.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:13:10 smithi157 bash[24585]: audit 2024-09-16T11:13:09.669231+0000 mgr.a (mgr.14373) 14530 : audit [DBG] from='client.314649 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:13:10.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:13:10 smithi086 bash[24289]: audit 2024-09-16T11:13:09.669231+0000 mgr.a (mgr.14373) 14530 : audit [DBG] from='client.314649 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:13:10.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:13:10 smithi047 bash[22744]: audit 2024-09-16T11:13:09.669231+0000 mgr.a (mgr.14373) 14530 : audit [DBG] from='client.314649 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:13:11.573 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:13:11 smithi086 bash[24289]: cluster 2024-09-16T11:13:10.160442+0000 mgr.a (mgr.14373) 14531 : cluster [DBG] pgmap v10078: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:13:11.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:13:11 smithi047 bash[22744]: cluster 2024-09-16T11:13:10.160442+0000 mgr.a (mgr.14373) 14531 : cluster [DBG] pgmap v10078: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:13:11.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:13:11 smithi157 bash[24585]: cluster 2024-09-16T11:13:10.160442+0000 mgr.a (mgr.14373) 14531 : cluster [DBG] pgmap v10078: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:13:13.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:13:13 smithi086 bash[24289]: cluster 2024-09-16T11:13:12.162561+0000 mgr.a (mgr.14373) 14532 : cluster [DBG] pgmap v10079: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:13:13.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:13:13 smithi047 bash[22744]: cluster 2024-09-16T11:13:12.162561+0000 mgr.a (mgr.14373) 14532 : cluster [DBG] pgmap v10079: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:13:13.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:13:13 smithi157 bash[24585]: cluster 2024-09-16T11:13:12.162561+0000 mgr.a (mgr.14373) 14532 : cluster [DBG] pgmap v10079: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:13:15.096 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:13:15.096 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:13:15.097 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:13:15.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:13:15 smithi086 bash[24289]: cluster 2024-09-16T11:13:14.163353+0000 mgr.a (mgr.14373) 14533 : cluster [DBG] pgmap v10080: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:13:15.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:13:15 smithi047 bash[22744]: cluster 2024-09-16T11:13:14.163353+0000 mgr.a (mgr.14373) 14533 : cluster [DBG] pgmap v10080: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:13:15.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:13:15 smithi157 bash[24585]: cluster 2024-09-16T11:13:14.163353+0000 mgr.a (mgr.14373) 14533 : cluster [DBG] pgmap v10080: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:13:15.877 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:13:15.877 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:13:15.877 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:13:15.877 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:13:15.878 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:13:16.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:13:16 smithi047 bash[22744]: audit 2024-09-16T11:13:15.431511+0000 mgr.a (mgr.14373) 14534 : audit [DBG] from='client.314721 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:13:16.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:13:16 smithi157 bash[24585]: audit 2024-09-16T11:13:15.431511+0000 mgr.a (mgr.14373) 14534 : audit [DBG] from='client.314721 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:13:16.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:13:16 smithi086 bash[24289]: audit 2024-09-16T11:13:15.431511+0000 mgr.a (mgr.14373) 14534 : audit [DBG] from='client.314721 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:13:17.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:13:17 smithi047 bash[22744]: cluster 2024-09-16T11:13:16.164351+0000 mgr.a (mgr.14373) 14535 : cluster [DBG] pgmap v10081: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:13:17.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:13:17 smithi157 bash[24585]: cluster 2024-09-16T11:13:16.164351+0000 mgr.a (mgr.14373) 14535 : cluster [DBG] pgmap v10081: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:13:17.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:13:17 smithi086 bash[24289]: cluster 2024-09-16T11:13:16.164351+0000 mgr.a (mgr.14373) 14535 : cluster [DBG] pgmap v10081: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:13:19.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:13:19 smithi047 bash[22744]: cluster 2024-09-16T11:13:18.166675+0000 mgr.a (mgr.14373) 14536 : cluster [DBG] pgmap v10082: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:13:19.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:13:19 smithi157 bash[24585]: cluster 2024-09-16T11:13:18.166675+0000 mgr.a (mgr.14373) 14536 : cluster [DBG] pgmap v10082: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:13:19.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:13:19 smithi086 bash[24289]: cluster 2024-09-16T11:13:18.166675+0000 mgr.a (mgr.14373) 14536 : cluster [DBG] pgmap v10082: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:13:20.879 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:13:20.879 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:13:20.879 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:13:21.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:13:21 smithi047 bash[22744]: cluster 2024-09-16T11:13:20.167460+0000 mgr.a (mgr.14373) 14537 : cluster [DBG] pgmap v10083: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:13:21.660 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:13:21.660 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:13:21.660 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:13:21.660 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:13:21.660 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:13:21.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:13:21 smithi157 bash[24585]: cluster 2024-09-16T11:13:20.167460+0000 mgr.a (mgr.14373) 14537 : cluster [DBG] pgmap v10083: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:13:21.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:13:21 smithi086 bash[24289]: cluster 2024-09-16T11:13:20.167460+0000 mgr.a (mgr.14373) 14537 : cluster [DBG] pgmap v10083: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:13:22.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:13:22 smithi157 bash[24585]: audit 2024-09-16T11:13:21.219259+0000 mgr.a (mgr.14373) 14538 : audit [DBG] from='client.314796 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:13:22.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:13:22 smithi086 bash[24289]: audit 2024-09-16T11:13:21.219259+0000 mgr.a (mgr.14373) 14538 : audit [DBG] from='client.314796 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:13:22.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:13:22 smithi047 bash[22744]: audit 2024-09-16T11:13:21.219259+0000 mgr.a (mgr.14373) 14538 : audit [DBG] from='client.314796 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:13:23.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:13:23 smithi157 bash[24585]: cluster 2024-09-16T11:13:22.170316+0000 mgr.a (mgr.14373) 14539 : cluster [DBG] pgmap v10084: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-16T11:13:23.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:13:23 smithi086 bash[24289]: cluster 2024-09-16T11:13:22.170316+0000 mgr.a (mgr.14373) 14539 : cluster [DBG] pgmap v10084: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-16T11:13:23.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:13:23 smithi047 bash[22744]: cluster 2024-09-16T11:13:22.170316+0000 mgr.a (mgr.14373) 14539 : cluster [DBG] pgmap v10084: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-16T11:13:25.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:13:25 smithi157 bash[24585]: cluster 2024-09-16T11:13:24.171106+0000 mgr.a (mgr.14373) 14540 : cluster [DBG] pgmap v10085: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T11:13:25.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:13:25 smithi086 bash[24289]: cluster 2024-09-16T11:13:24.171106+0000 mgr.a (mgr.14373) 14540 : cluster [DBG] pgmap v10085: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T11:13:25.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:13:25 smithi047 bash[22744]: cluster 2024-09-16T11:13:24.171106+0000 mgr.a (mgr.14373) 14540 : cluster [DBG] pgmap v10085: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T11:13:26.661 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:13:26.663 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:13:26.663 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:13:27.421 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:13:27.422 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:13:27.422 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:13:27.422 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:13:27.422 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:13:27.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:13:27 smithi157 bash[24585]: cluster 2024-09-16T11:13:26.172024+0000 mgr.a (mgr.14373) 14541 : cluster [DBG] pgmap v10086: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T11:13:27.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:13:27 smithi157 bash[24585]: audit 2024-09-16T11:13:26.994000+0000 mgr.a (mgr.14373) 14542 : audit [DBG] from='client.314871 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:13:27.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:13:27 smithi157 bash[24585]: audit 2024-09-16T11:13:27.058971+0000 mon.b (mon.2) 1326 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T11:13:27.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:13:27 smithi086 bash[24289]: cluster 2024-09-16T11:13:26.172024+0000 mgr.a (mgr.14373) 14541 : cluster [DBG] pgmap v10086: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T11:13:27.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:13:27 smithi086 bash[24289]: audit 2024-09-16T11:13:26.994000+0000 mgr.a (mgr.14373) 14542 : audit [DBG] from='client.314871 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:13:27.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:13:27 smithi086 bash[24289]: audit 2024-09-16T11:13:27.058971+0000 mon.b (mon.2) 1326 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T11:13:27.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:13:27 smithi047 bash[22744]: cluster 2024-09-16T11:13:26.172024+0000 mgr.a (mgr.14373) 14541 : cluster [DBG] pgmap v10086: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T11:13:27.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:13:27 smithi047 bash[22744]: audit 2024-09-16T11:13:26.994000+0000 mgr.a (mgr.14373) 14542 : audit [DBG] from='client.314871 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:13:27.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:13:27 smithi047 bash[22744]: audit 2024-09-16T11:13:27.058971+0000 mon.b (mon.2) 1326 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T11:13:29.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:13:29 smithi157 bash[24585]: cluster 2024-09-16T11:13:28.174663+0000 mgr.a (mgr.14373) 14543 : cluster [DBG] pgmap v10087: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:13:29.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:13:29 smithi086 bash[24289]: cluster 2024-09-16T11:13:28.174663+0000 mgr.a (mgr.14373) 14543 : cluster [DBG] pgmap v10087: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:13:29.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:13:29 smithi047 bash[22744]: cluster 2024-09-16T11:13:28.174663+0000 mgr.a (mgr.14373) 14543 : cluster [DBG] pgmap v10087: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:13:31.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:13:31 smithi157 bash[24585]: cluster 2024-09-16T11:13:30.175488+0000 mgr.a (mgr.14373) 14544 : cluster [DBG] pgmap v10088: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:13:31.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:13:31 smithi086 bash[24289]: cluster 2024-09-16T11:13:30.175488+0000 mgr.a (mgr.14373) 14544 : cluster [DBG] pgmap v10088: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:13:31.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:13:31 smithi047 bash[22744]: cluster 2024-09-16T11:13:30.175488+0000 mgr.a (mgr.14373) 14544 : cluster [DBG] pgmap v10088: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:13:32.423 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:13:32.424 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:13:32.424 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:13:33.214 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:13:33.214 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:13:33.214 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:13:33.215 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:13:33.215 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:13:33.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:13:33 smithi157 bash[24585]: cluster 2024-09-16T11:13:32.177463+0000 mgr.a (mgr.14373) 14545 : cluster [DBG] pgmap v10089: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:13:33.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:13:33 smithi157 bash[24585]: audit 2024-09-16T11:13:32.759655+0000 mgr.a (mgr.14373) 14546 : audit [DBG] from='client.314949 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:13:33.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:13:33 smithi086 bash[24289]: cluster 2024-09-16T11:13:32.177463+0000 mgr.a (mgr.14373) 14545 : cluster [DBG] pgmap v10089: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:13:33.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:13:33 smithi086 bash[24289]: audit 2024-09-16T11:13:32.759655+0000 mgr.a (mgr.14373) 14546 : audit [DBG] from='client.314949 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:13:33.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:13:33 smithi047 bash[22744]: cluster 2024-09-16T11:13:32.177463+0000 mgr.a (mgr.14373) 14545 : cluster [DBG] pgmap v10089: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:13:33.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:13:33 smithi047 bash[22744]: audit 2024-09-16T11:13:32.759655+0000 mgr.a (mgr.14373) 14546 : audit [DBG] from='client.314949 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:13:35.718 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:13:35 smithi157 bash[24585]: cluster 2024-09-16T11:13:34.178407+0000 mgr.a (mgr.14373) 14547 : cluster [DBG] pgmap v10090: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-16T11:13:35.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:13:35 smithi086 bash[24289]: cluster 2024-09-16T11:13:34.178407+0000 mgr.a (mgr.14373) 14547 : cluster [DBG] pgmap v10090: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-16T11:13:35.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:13:35 smithi047 bash[22744]: cluster 2024-09-16T11:13:34.178407+0000 mgr.a (mgr.14373) 14547 : cluster [DBG] pgmap v10090: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-16T11:13:37.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:13:37 smithi157 bash[24585]: cluster 2024-09-16T11:13:36.179191+0000 mgr.a (mgr.14373) 14548 : cluster [DBG] pgmap v10091: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-16T11:13:37.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:13:37 smithi086 bash[24289]: cluster 2024-09-16T11:13:36.179191+0000 mgr.a (mgr.14373) 14548 : cluster [DBG] pgmap v10091: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-16T11:13:37.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:13:37 smithi047 bash[22744]: cluster 2024-09-16T11:13:36.179191+0000 mgr.a (mgr.14373) 14548 : cluster [DBG] pgmap v10091: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-16T11:13:38.215 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:13:38.216 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:13:38.216 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:13:38.592 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 11:13:38 smithi047 bash[22994]: debug 2024-09-16T11:13:38.326+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T11:13:38.592 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 11:13:38 smithi047 bash[22994]: debug 2024-09-16T11:13:38.326+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T11:13:38.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:13:38 smithi047 bash[22744]: audit 2024-09-16T11:13:37.511947+0000 mon.a (mon.0) 1433 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:13:38.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:13:38 smithi047 bash[22744]: audit 2024-09-16T11:13:37.522939+0000 mon.a (mon.0) 1434 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:13:38.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:13:38 smithi047 bash[22744]: audit 2024-09-16T11:13:37.525648+0000 mon.b (mon.2) 1327 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T11:13:38.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:13:38 smithi047 bash[22744]: audit 2024-09-16T11:13:37.527975+0000 mon.b (mon.2) 1328 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T11:13:38.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:13:38 smithi047 bash[22744]: audit 2024-09-16T11:13:37.540350+0000 mon.a (mon.0) 1435 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:13:38.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:13:38 smithi047 bash[22744]: audit 2024-09-16T11:13:37.546218+0000 mon.b (mon.2) 1329 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:13:38.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:13:38 smithi047 bash[22744]: audit 2024-09-16T11:13:37.549125+0000 mgr.a (mgr.14373) 14549 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:13:38.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:13:38 smithi157 bash[24585]: audit 2024-09-16T11:13:37.511947+0000 mon.a (mon.0) 1433 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:13:38.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:13:38 smithi157 bash[24585]: audit 2024-09-16T11:13:37.522939+0000 mon.a (mon.0) 1434 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:13:38.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:13:38 smithi157 bash[24585]: audit 2024-09-16T11:13:37.525648+0000 mon.b (mon.2) 1327 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T11:13:38.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:13:38 smithi157 bash[24585]: audit 2024-09-16T11:13:37.527975+0000 mon.b (mon.2) 1328 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T11:13:38.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:13:38 smithi157 bash[24585]: audit 2024-09-16T11:13:37.540350+0000 mon.a (mon.0) 1435 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:13:38.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:13:38 smithi157 bash[24585]: audit 2024-09-16T11:13:37.546218+0000 mon.b (mon.2) 1329 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:13:38.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:13:38 smithi157 bash[24585]: audit 2024-09-16T11:13:37.549125+0000 mgr.a (mgr.14373) 14549 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:13:38.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:13:38 smithi086 bash[24289]: audit 2024-09-16T11:13:37.511947+0000 mon.a (mon.0) 1433 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:13:38.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:13:38 smithi086 bash[24289]: audit 2024-09-16T11:13:37.522939+0000 mon.a (mon.0) 1434 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:13:38.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:13:38 smithi086 bash[24289]: audit 2024-09-16T11:13:37.525648+0000 mon.b (mon.2) 1327 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T11:13:38.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:13:38 smithi086 bash[24289]: audit 2024-09-16T11:13:37.527975+0000 mon.b (mon.2) 1328 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T11:13:38.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:13:38 smithi086 bash[24289]: audit 2024-09-16T11:13:37.540350+0000 mon.a (mon.0) 1435 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:13:38.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:13:38 smithi086 bash[24289]: audit 2024-09-16T11:13:37.546218+0000 mon.b (mon.2) 1329 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:13:38.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:13:38 smithi086 bash[24289]: audit 2024-09-16T11:13:37.549125+0000 mgr.a (mgr.14373) 14549 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:13:38.950 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:13:38.950 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:13:38.950 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:13:38.950 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:13:38.950 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:13:39.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:13:39 smithi157 bash[24585]: cluster 2024-09-16T11:13:38.180438+0000 mgr.a (mgr.14373) 14550 : cluster [DBG] pgmap v10092: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-16T11:13:39.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:13:39 smithi157 bash[24585]: audit 2024-09-16T11:13:38.326642+0000 mgr.a (mgr.14373) 14551 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T11:13:39.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:13:39 smithi157 bash[24585]: cephadm 2024-09-16T11:13:38.328281+0000 mgr.a (mgr.14373) 14552 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T11:13:39.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:13:39 smithi157 bash[24585]: audit 2024-09-16T11:13:38.527649+0000 mgr.a (mgr.14373) 14553 : audit [DBG] from='client.315126 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:13:39.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:13:39 smithi086 bash[24289]: cluster 2024-09-16T11:13:38.180438+0000 mgr.a (mgr.14373) 14550 : cluster [DBG] pgmap v10092: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-16T11:13:39.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:13:39 smithi086 bash[24289]: audit 2024-09-16T11:13:38.326642+0000 mgr.a (mgr.14373) 14551 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T11:13:39.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:13:39 smithi086 bash[24289]: cephadm 2024-09-16T11:13:38.328281+0000 mgr.a (mgr.14373) 14552 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T11:13:39.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:13:39 smithi086 bash[24289]: audit 2024-09-16T11:13:38.527649+0000 mgr.a (mgr.14373) 14553 : audit [DBG] from='client.315126 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:13:39.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:13:39 smithi047 bash[22744]: cluster 2024-09-16T11:13:38.180438+0000 mgr.a (mgr.14373) 14550 : cluster [DBG] pgmap v10092: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-16T11:13:39.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:13:39 smithi047 bash[22744]: audit 2024-09-16T11:13:38.326642+0000 mgr.a (mgr.14373) 14551 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T11:13:39.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:13:39 smithi047 bash[22744]: cephadm 2024-09-16T11:13:38.328281+0000 mgr.a (mgr.14373) 14552 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T11:13:39.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:13:39 smithi047 bash[22744]: audit 2024-09-16T11:13:38.527649+0000 mgr.a (mgr.14373) 14553 : audit [DBG] from='client.315126 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:13:41.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:13:41 smithi157 bash[24585]: cluster 2024-09-16T11:13:40.181312+0000 mgr.a (mgr.14373) 14554 : cluster [DBG] pgmap v10093: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:13:41.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:13:41 smithi086 bash[24289]: cluster 2024-09-16T11:13:40.181312+0000 mgr.a (mgr.14373) 14554 : cluster [DBG] pgmap v10093: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:13:41.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:13:41 smithi047 bash[22744]: cluster 2024-09-16T11:13:40.181312+0000 mgr.a (mgr.14373) 14554 : cluster [DBG] pgmap v10093: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:13:43.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:13:43 smithi157 bash[24585]: cluster 2024-09-16T11:13:42.183605+0000 mgr.a (mgr.14373) 14555 : cluster [DBG] pgmap v10094: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:13:43.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:13:43 smithi086 bash[24289]: cluster 2024-09-16T11:13:42.183605+0000 mgr.a (mgr.14373) 14555 : cluster [DBG] pgmap v10094: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:13:43.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:13:43 smithi047 bash[22744]: cluster 2024-09-16T11:13:42.183605+0000 mgr.a (mgr.14373) 14555 : cluster [DBG] pgmap v10094: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:13:43.951 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:13:43.952 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:13:43.952 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:13:44.738 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:13:44.738 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:13:44.738 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:13:44.738 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:13:44.738 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:13:45.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:13:45 smithi157 bash[24585]: cluster 2024-09-16T11:13:44.184384+0000 mgr.a (mgr.14373) 14556 : cluster [DBG] pgmap v10095: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:13:45.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:13:45 smithi157 bash[24585]: audit 2024-09-16T11:13:44.288341+0000 mgr.a (mgr.14373) 14557 : audit [DBG] from='client.315201 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:13:45.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:13:45 smithi086 bash[24289]: cluster 2024-09-16T11:13:44.184384+0000 mgr.a (mgr.14373) 14556 : cluster [DBG] pgmap v10095: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:13:45.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:13:45 smithi086 bash[24289]: audit 2024-09-16T11:13:44.288341+0000 mgr.a (mgr.14373) 14557 : audit [DBG] from='client.315201 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:13:45.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:13:45 smithi047 bash[22744]: cluster 2024-09-16T11:13:44.184384+0000 mgr.a (mgr.14373) 14556 : cluster [DBG] pgmap v10095: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:13:45.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:13:45 smithi047 bash[22744]: audit 2024-09-16T11:13:44.288341+0000 mgr.a (mgr.14373) 14557 : audit [DBG] from='client.315201 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:13:47.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:13:47 smithi086 bash[24289]: cluster 2024-09-16T11:13:46.185275+0000 mgr.a (mgr.14373) 14558 : cluster [DBG] pgmap v10096: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:13:47.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:13:47 smithi047 bash[22744]: cluster 2024-09-16T11:13:46.185275+0000 mgr.a (mgr.14373) 14558 : cluster [DBG] pgmap v10096: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:13:48.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:13:47 smithi157 bash[24585]: cluster 2024-09-16T11:13:46.185275+0000 mgr.a (mgr.14373) 14558 : cluster [DBG] pgmap v10096: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:13:49.739 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:13:49.740 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:13:49.740 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:13:49.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:13:49 smithi086 bash[24289]: cluster 2024-09-16T11:13:48.187514+0000 mgr.a (mgr.14373) 14559 : cluster [DBG] pgmap v10097: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:13:49.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:13:49 smithi047 bash[22744]: cluster 2024-09-16T11:13:48.187514+0000 mgr.a (mgr.14373) 14559 : cluster [DBG] pgmap v10097: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:13:50.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:13:49 smithi157 bash[24585]: cluster 2024-09-16T11:13:48.187514+0000 mgr.a (mgr.14373) 14559 : cluster [DBG] pgmap v10097: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:13:50.500 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:13:50.501 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:13:50.501 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:13:50.501 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:13:50.501 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:13:51.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:13:51 smithi086 bash[24289]: audit 2024-09-16T11:13:50.074190+0000 mgr.a (mgr.14373) 14560 : audit [DBG] from='client.315279 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:13:51.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:13:51 smithi086 bash[24289]: cluster 2024-09-16T11:13:50.188033+0000 mgr.a (mgr.14373) 14561 : cluster [DBG] pgmap v10098: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:13:51.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:13:51 smithi047 bash[22744]: audit 2024-09-16T11:13:50.074190+0000 mgr.a (mgr.14373) 14560 : audit [DBG] from='client.315279 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:13:51.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:13:51 smithi047 bash[22744]: cluster 2024-09-16T11:13:50.188033+0000 mgr.a (mgr.14373) 14561 : cluster [DBG] pgmap v10098: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:13:52.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:13:51 smithi157 bash[24585]: audit 2024-09-16T11:13:50.074190+0000 mgr.a (mgr.14373) 14560 : audit [DBG] from='client.315279 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:13:52.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:13:51 smithi157 bash[24585]: cluster 2024-09-16T11:13:50.188033+0000 mgr.a (mgr.14373) 14561 : cluster [DBG] pgmap v10098: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:13:53.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:13:53 smithi047 bash[22744]: cluster 2024-09-16T11:13:52.190286+0000 mgr.a (mgr.14373) 14562 : cluster [DBG] pgmap v10099: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:13:54.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:13:53 smithi157 bash[24585]: cluster 2024-09-16T11:13:52.190286+0000 mgr.a (mgr.14373) 14562 : cluster [DBG] pgmap v10099: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:13:54.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:13:53 smithi086 bash[24289]: cluster 2024-09-16T11:13:52.190286+0000 mgr.a (mgr.14373) 14562 : cluster [DBG] pgmap v10099: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:13:55.502 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:13:55.503 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:13:55.503 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:13:55.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:13:55 smithi047 bash[22744]: cluster 2024-09-16T11:13:54.191045+0000 mgr.a (mgr.14373) 14563 : cluster [DBG] pgmap v10100: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:13:56.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:13:55 smithi157 bash[24585]: cluster 2024-09-16T11:13:54.191045+0000 mgr.a (mgr.14373) 14563 : cluster [DBG] pgmap v10100: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:13:56.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:13:55 smithi086 bash[24289]: cluster 2024-09-16T11:13:54.191045+0000 mgr.a (mgr.14373) 14563 : cluster [DBG] pgmap v10100: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:13:56.283 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:13:56.283 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:13:56.283 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:13:56.283 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:13:56.283 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:13:56.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:13:56 smithi047 bash[22744]: audit 2024-09-16T11:13:55.842184+0000 mgr.a (mgr.14373) 14564 : audit [DBG] from='client.315354 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:13:57.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:13:56 smithi157 bash[24585]: audit 2024-09-16T11:13:55.842184+0000 mgr.a (mgr.14373) 14564 : audit [DBG] from='client.315354 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:13:57.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:13:56 smithi086 bash[24289]: audit 2024-09-16T11:13:55.842184+0000 mgr.a (mgr.14373) 14564 : audit [DBG] from='client.315354 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:13:57.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:13:57 smithi047 bash[22744]: cluster 2024-09-16T11:13:56.191627+0000 mgr.a (mgr.14373) 14565 : cluster [DBG] pgmap v10101: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:13:58.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:13:57 smithi157 bash[24585]: cluster 2024-09-16T11:13:56.191627+0000 mgr.a (mgr.14373) 14565 : cluster [DBG] pgmap v10101: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:13:58.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:13:57 smithi086 bash[24289]: cluster 2024-09-16T11:13:56.191627+0000 mgr.a (mgr.14373) 14565 : cluster [DBG] pgmap v10101: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:13:59.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:13:59 smithi047 bash[22744]: cluster 2024-09-16T11:13:58.193817+0000 mgr.a (mgr.14373) 14566 : cluster [DBG] pgmap v10102: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:14:00.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:13:59 smithi157 bash[24585]: cluster 2024-09-16T11:13:58.193817+0000 mgr.a (mgr.14373) 14566 : cluster [DBG] pgmap v10102: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:14:00.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:13:59 smithi086 bash[24289]: cluster 2024-09-16T11:13:58.193817+0000 mgr.a (mgr.14373) 14566 : cluster [DBG] pgmap v10102: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:14:01.285 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:14:01.285 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:14:01.285 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:14:02.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:14:01 smithi157 bash[24585]: cluster 2024-09-16T11:14:00.194607+0000 mgr.a (mgr.14373) 14567 : cluster [DBG] pgmap v10103: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:14:02.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:14:01 smithi086 bash[24289]: cluster 2024-09-16T11:14:00.194607+0000 mgr.a (mgr.14373) 14567 : cluster [DBG] pgmap v10103: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:14:02.071 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:14:02.071 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:14:02.071 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:14:02.071 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:14:02.071 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:14:02.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:14:01 smithi047 bash[22744]: cluster 2024-09-16T11:14:00.194607+0000 mgr.a (mgr.14373) 14567 : cluster [DBG] pgmap v10103: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:14:03.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:14:02 smithi157 bash[24585]: audit 2024-09-16T11:14:01.624006+0000 mgr.a (mgr.14373) 14568 : audit [DBG] from='client.315429 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:14:03.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:14:02 smithi086 bash[24289]: audit 2024-09-16T11:14:01.624006+0000 mgr.a (mgr.14373) 14568 : audit [DBG] from='client.315429 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:14:03.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:14:02 smithi047 bash[22744]: audit 2024-09-16T11:14:01.624006+0000 mgr.a (mgr.14373) 14568 : audit [DBG] from='client.315429 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:14:04.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:14:03 smithi157 bash[24585]: cluster 2024-09-16T11:14:02.197387+0000 mgr.a (mgr.14373) 14569 : cluster [DBG] pgmap v10104: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:14:04.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:14:03 smithi086 bash[24289]: cluster 2024-09-16T11:14:02.197387+0000 mgr.a (mgr.14373) 14569 : cluster [DBG] pgmap v10104: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:14:04.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:14:03 smithi047 bash[22744]: cluster 2024-09-16T11:14:02.197387+0000 mgr.a (mgr.14373) 14569 : cluster [DBG] pgmap v10104: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:14:06.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:14:05 smithi157 bash[24585]: cluster 2024-09-16T11:14:04.198124+0000 mgr.a (mgr.14373) 14570 : cluster [DBG] pgmap v10105: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:14:06.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:14:05 smithi086 bash[24289]: cluster 2024-09-16T11:14:04.198124+0000 mgr.a (mgr.14373) 14570 : cluster [DBG] pgmap v10105: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:14:06.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:14:05 smithi047 bash[22744]: cluster 2024-09-16T11:14:04.198124+0000 mgr.a (mgr.14373) 14570 : cluster [DBG] pgmap v10105: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:14:07.072 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:14:07.073 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:14:07.073 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:14:07.817 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:14:07.817 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:14:07.817 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:14:07.817 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:14:07.818 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:14:08.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:14:07 smithi157 bash[24585]: cluster 2024-09-16T11:14:06.199007+0000 mgr.a (mgr.14373) 14571 : cluster [DBG] pgmap v10106: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T11:14:08.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:14:07 smithi086 bash[24289]: cluster 2024-09-16T11:14:06.199007+0000 mgr.a (mgr.14373) 14571 : cluster [DBG] pgmap v10106: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T11:14:08.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:14:07 smithi047 bash[22744]: cluster 2024-09-16T11:14:06.199007+0000 mgr.a (mgr.14373) 14571 : cluster [DBG] pgmap v10106: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T11:14:09.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:14:08 smithi157 bash[24585]: audit 2024-09-16T11:14:07.401290+0000 mgr.a (mgr.14373) 14572 : audit [DBG] from='client.315507 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:14:09.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:14:08 smithi086 bash[24289]: audit 2024-09-16T11:14:07.401290+0000 mgr.a (mgr.14373) 14572 : audit [DBG] from='client.315507 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:14:09.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:14:08 smithi047 bash[22744]: audit 2024-09-16T11:14:07.401290+0000 mgr.a (mgr.14373) 14572 : audit [DBG] from='client.315507 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:14:10.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:14:09 smithi157 bash[24585]: cluster 2024-09-16T11:14:08.201699+0000 mgr.a (mgr.14373) 14573 : cluster [DBG] pgmap v10107: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:14:10.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:14:09 smithi086 bash[24289]: cluster 2024-09-16T11:14:08.201699+0000 mgr.a (mgr.14373) 14573 : cluster [DBG] pgmap v10107: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:14:10.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:14:09 smithi047 bash[22744]: cluster 2024-09-16T11:14:08.201699+0000 mgr.a (mgr.14373) 14573 : cluster [DBG] pgmap v10107: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:14:12.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:14:11 smithi157 bash[24585]: cluster 2024-09-16T11:14:10.202618+0000 mgr.a (mgr.14373) 14574 : cluster [DBG] pgmap v10108: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:14:12.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:14:11 smithi086 bash[24289]: cluster 2024-09-16T11:14:10.202618+0000 mgr.a (mgr.14373) 14574 : cluster [DBG] pgmap v10108: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:14:12.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:14:11 smithi047 bash[22744]: cluster 2024-09-16T11:14:10.202618+0000 mgr.a (mgr.14373) 14574 : cluster [DBG] pgmap v10108: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:14:12.818 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:14:12.819 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:14:12.819 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:14:13.589 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:14:13.590 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:14:13.590 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:14:13.590 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:14:13.590 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:14:14.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:14:13 smithi157 bash[24585]: cluster 2024-09-16T11:14:12.204765+0000 mgr.a (mgr.14373) 14575 : cluster [DBG] pgmap v10109: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:14:14.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:14:13 smithi086 bash[24289]: cluster 2024-09-16T11:14:12.204765+0000 mgr.a (mgr.14373) 14575 : cluster [DBG] pgmap v10109: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:14:14.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:14:13 smithi047 bash[22744]: cluster 2024-09-16T11:14:12.204765+0000 mgr.a (mgr.14373) 14575 : cluster [DBG] pgmap v10109: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:14:15.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:14:14 smithi157 bash[24585]: audit 2024-09-16T11:14:13.152159+0000 mgr.a (mgr.14373) 14576 : audit [DBG] from='client.315582 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:14:15.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:14:14 smithi086 bash[24289]: audit 2024-09-16T11:14:13.152159+0000 mgr.a (mgr.14373) 14576 : audit [DBG] from='client.315582 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:14:15.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:14:14 smithi047 bash[22744]: audit 2024-09-16T11:14:13.152159+0000 mgr.a (mgr.14373) 14576 : audit [DBG] from='client.315582 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:14:16.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:14:15 smithi157 bash[24585]: cluster 2024-09-16T11:14:14.205669+0000 mgr.a (mgr.14373) 14577 : cluster [DBG] pgmap v10110: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:14:16.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:14:15 smithi086 bash[24289]: cluster 2024-09-16T11:14:14.205669+0000 mgr.a (mgr.14373) 14577 : cluster [DBG] pgmap v10110: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:14:16.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:14:15 smithi047 bash[22744]: cluster 2024-09-16T11:14:14.205669+0000 mgr.a (mgr.14373) 14577 : cluster [DBG] pgmap v10110: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:14:18.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:14:17 smithi157 bash[24585]: cluster 2024-09-16T11:14:16.206458+0000 mgr.a (mgr.14373) 14578 : cluster [DBG] pgmap v10111: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:14:18.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:14:17 smithi086 bash[24289]: cluster 2024-09-16T11:14:16.206458+0000 mgr.a (mgr.14373) 14578 : cluster [DBG] pgmap v10111: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:14:18.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:14:17 smithi047 bash[22744]: cluster 2024-09-16T11:14:16.206458+0000 mgr.a (mgr.14373) 14578 : cluster [DBG] pgmap v10111: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:14:18.591 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:14:18.592 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:14:18.592 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:14:19.354 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:14:19.354 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:14:19.355 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:14:19.355 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:14:19.355 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:14:20.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:14:19 smithi157 bash[24585]: cluster 2024-09-16T11:14:18.208571+0000 mgr.a (mgr.14373) 14579 : cluster [DBG] pgmap v10112: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:14:20.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:14:19 smithi157 bash[24585]: audit 2024-09-16T11:14:18.924242+0000 mgr.a (mgr.14373) 14580 : audit [DBG] from='client.315660 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:14:20.072 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:14:19 smithi086 bash[24289]: cluster 2024-09-16T11:14:18.208571+0000 mgr.a (mgr.14373) 14579 : cluster [DBG] pgmap v10112: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:14:20.072 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:14:19 smithi086 bash[24289]: audit 2024-09-16T11:14:18.924242+0000 mgr.a (mgr.14373) 14580 : audit [DBG] from='client.315660 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:14:20.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:14:19 smithi047 bash[22744]: cluster 2024-09-16T11:14:18.208571+0000 mgr.a (mgr.14373) 14579 : cluster [DBG] pgmap v10112: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:14:20.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:14:19 smithi047 bash[22744]: audit 2024-09-16T11:14:18.924242+0000 mgr.a (mgr.14373) 14580 : audit [DBG] from='client.315660 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:14:22.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:14:21 smithi157 bash[24585]: cluster 2024-09-16T11:14:20.209459+0000 mgr.a (mgr.14373) 14581 : cluster [DBG] pgmap v10113: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:14:22.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:14:21 smithi086 bash[24289]: cluster 2024-09-16T11:14:20.209459+0000 mgr.a (mgr.14373) 14581 : cluster [DBG] pgmap v10113: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:14:22.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:14:21 smithi047 bash[22744]: cluster 2024-09-16T11:14:20.209459+0000 mgr.a (mgr.14373) 14581 : cluster [DBG] pgmap v10113: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:14:24.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:14:23 smithi157 bash[24585]: cluster 2024-09-16T11:14:22.211740+0000 mgr.a (mgr.14373) 14582 : cluster [DBG] pgmap v10114: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:14:24.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:14:23 smithi086 bash[24289]: cluster 2024-09-16T11:14:22.211740+0000 mgr.a (mgr.14373) 14582 : cluster [DBG] pgmap v10114: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:14:24.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:14:23 smithi047 bash[22744]: cluster 2024-09-16T11:14:22.211740+0000 mgr.a (mgr.14373) 14582 : cluster [DBG] pgmap v10114: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:14:24.356 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:14:24.357 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:14:24.357 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:14:25.119 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:14:25.119 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:14:25.119 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:14:25.119 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:14:25.119 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:14:26.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:14:25 smithi157 bash[24585]: cluster 2024-09-16T11:14:24.212420+0000 mgr.a (mgr.14373) 14583 : cluster [DBG] pgmap v10115: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:14:26.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:14:25 smithi157 bash[24585]: audit 2024-09-16T11:14:24.689240+0000 mgr.a (mgr.14373) 14584 : audit [DBG] from='client.315738 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:14:26.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:14:25 smithi086 bash[24289]: cluster 2024-09-16T11:14:24.212420+0000 mgr.a (mgr.14373) 14583 : cluster [DBG] pgmap v10115: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:14:26.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:14:25 smithi086 bash[24289]: audit 2024-09-16T11:14:24.689240+0000 mgr.a (mgr.14373) 14584 : audit [DBG] from='client.315738 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:14:26.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:14:25 smithi047 bash[22744]: cluster 2024-09-16T11:14:24.212420+0000 mgr.a (mgr.14373) 14583 : cluster [DBG] pgmap v10115: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:14:26.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:14:25 smithi047 bash[22744]: audit 2024-09-16T11:14:24.689240+0000 mgr.a (mgr.14373) 14584 : audit [DBG] from='client.315738 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:14:28.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:14:27 smithi157 bash[24585]: cluster 2024-09-16T11:14:26.213312+0000 mgr.a (mgr.14373) 14585 : cluster [DBG] pgmap v10116: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:14:28.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:14:27 smithi086 bash[24289]: cluster 2024-09-16T11:14:26.213312+0000 mgr.a (mgr.14373) 14585 : cluster [DBG] pgmap v10116: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:14:28.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:14:27 smithi047 bash[22744]: cluster 2024-09-16T11:14:26.213312+0000 mgr.a (mgr.14373) 14585 : cluster [DBG] pgmap v10116: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:14:30.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:14:29 smithi157 bash[24585]: cluster 2024-09-16T11:14:28.215580+0000 mgr.a (mgr.14373) 14586 : cluster [DBG] pgmap v10117: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:14:30.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:14:29 smithi086 bash[24289]: cluster 2024-09-16T11:14:28.215580+0000 mgr.a (mgr.14373) 14586 : cluster [DBG] pgmap v10117: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:14:30.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:14:29 smithi047 bash[22744]: cluster 2024-09-16T11:14:28.215580+0000 mgr.a (mgr.14373) 14586 : cluster [DBG] pgmap v10117: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:14:30.120 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:14:30.121 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:14:30.121 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:14:30.911 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:14:30.912 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:14:30.912 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:14:30.912 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:14:30.912 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:14:32.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:14:31 smithi157 bash[24585]: cluster 2024-09-16T11:14:30.216085+0000 mgr.a (mgr.14373) 14587 : cluster [DBG] pgmap v10118: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:14:32.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:14:31 smithi157 bash[24585]: audit 2024-09-16T11:14:30.455619+0000 mgr.a (mgr.14373) 14588 : audit [DBG] from='client.315810 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:14:32.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:14:31 smithi086 bash[24289]: cluster 2024-09-16T11:14:30.216085+0000 mgr.a (mgr.14373) 14587 : cluster [DBG] pgmap v10118: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:14:32.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:14:31 smithi086 bash[24289]: audit 2024-09-16T11:14:30.455619+0000 mgr.a (mgr.14373) 14588 : audit [DBG] from='client.315810 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:14:32.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:14:31 smithi047 bash[22744]: cluster 2024-09-16T11:14:30.216085+0000 mgr.a (mgr.14373) 14587 : cluster [DBG] pgmap v10118: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:14:32.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:14:31 smithi047 bash[22744]: audit 2024-09-16T11:14:30.455619+0000 mgr.a (mgr.14373) 14588 : audit [DBG] from='client.315810 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:14:34.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:14:33 smithi157 bash[24585]: cluster 2024-09-16T11:14:32.218416+0000 mgr.a (mgr.14373) 14589 : cluster [DBG] pgmap v10119: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:14:34.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:14:33 smithi086 bash[24289]: cluster 2024-09-16T11:14:32.218416+0000 mgr.a (mgr.14373) 14589 : cluster [DBG] pgmap v10119: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:14:34.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:14:33 smithi047 bash[22744]: cluster 2024-09-16T11:14:32.218416+0000 mgr.a (mgr.14373) 14589 : cluster [DBG] pgmap v10119: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:14:35.913 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:14:35.914 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:14:35.914 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:14:36.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:14:35 smithi157 bash[24585]: cluster 2024-09-16T11:14:34.219175+0000 mgr.a (mgr.14373) 14590 : cluster [DBG] pgmap v10120: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:14:36.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:14:35 smithi086 bash[24289]: cluster 2024-09-16T11:14:34.219175+0000 mgr.a (mgr.14373) 14590 : cluster [DBG] pgmap v10120: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:14:36.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:14:35 smithi047 bash[22744]: cluster 2024-09-16T11:14:34.219175+0000 mgr.a (mgr.14373) 14590 : cluster [DBG] pgmap v10120: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:14:36.663 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:14:36.663 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:14:36.663 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:14:36.663 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:14:36.663 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:14:38.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:14:37 smithi157 bash[24585]: cluster 2024-09-16T11:14:36.220006+0000 mgr.a (mgr.14373) 14591 : cluster [DBG] pgmap v10121: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:14:38.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:14:37 smithi157 bash[24585]: audit 2024-09-16T11:14:36.243264+0000 mgr.a (mgr.14373) 14592 : audit [DBG] from='client.315882 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:14:38.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:14:37 smithi086 bash[24289]: cluster 2024-09-16T11:14:36.220006+0000 mgr.a (mgr.14373) 14591 : cluster [DBG] pgmap v10121: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:14:38.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:14:37 smithi086 bash[24289]: audit 2024-09-16T11:14:36.243264+0000 mgr.a (mgr.14373) 14592 : audit [DBG] from='client.315882 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:14:38.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:14:37 smithi047 bash[22744]: cluster 2024-09-16T11:14:36.220006+0000 mgr.a (mgr.14373) 14591 : cluster [DBG] pgmap v10121: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:14:38.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:14:37 smithi047 bash[22744]: audit 2024-09-16T11:14:36.243264+0000 mgr.a (mgr.14373) 14592 : audit [DBG] from='client.315882 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:14:39.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:14:38 smithi157 bash[24585]: audit 2024-09-16T11:14:38.376613+0000 mon.b (mon.2) 1330 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T11:14:39.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:14:38 smithi086 bash[24289]: audit 2024-09-16T11:14:38.376613+0000 mon.b (mon.2) 1330 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T11:14:39.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:14:38 smithi047 bash[22744]: audit 2024-09-16T11:14:38.376613+0000 mon.b (mon.2) 1330 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T11:14:40.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:14:39 smithi157 bash[24585]: cluster 2024-09-16T11:14:38.222724+0000 mgr.a (mgr.14373) 14593 : cluster [DBG] pgmap v10122: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-16T11:14:40.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:14:39 smithi086 bash[24289]: cluster 2024-09-16T11:14:38.222724+0000 mgr.a (mgr.14373) 14593 : cluster [DBG] pgmap v10122: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-16T11:14:40.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:14:39 smithi047 bash[22744]: cluster 2024-09-16T11:14:38.222724+0000 mgr.a (mgr.14373) 14593 : cluster [DBG] pgmap v10122: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-16T11:14:40.843 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 11:14:40 smithi047 bash[22994]: debug 2024-09-16T11:14:40.488+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T11:14:40.843 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 11:14:40 smithi047 bash[22994]: debug 2024-09-16T11:14:40.492+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T11:14:40.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:14:40 smithi047 bash[22744]: audit 2024-09-16T11:14:39.707172+0000 mon.a (mon.0) 1436 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:14:40.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:14:40 smithi047 bash[22744]: audit 2024-09-16T11:14:39.711388+0000 mon.a (mon.0) 1437 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:14:40.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:14:40 smithi047 bash[22744]: audit 2024-09-16T11:14:39.717180+0000 mon.a (mon.0) 1438 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:14:40.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:14:40 smithi047 bash[22744]: audit 2024-09-16T11:14:39.721894+0000 mon.a (mon.0) 1439 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:14:40.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:14:40 smithi047 bash[22744]: audit 2024-09-16T11:14:39.728796+0000 mon.a (mon.0) 1440 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:14:40.844 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:14:40 smithi047 bash[22744]: audit 2024-09-16T11:14:39.737828+0000 mon.a (mon.0) 1441 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:14:40.844 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:14:40 smithi047 bash[22744]: audit 2024-09-16T11:14:39.743553+0000 mon.b (mon.2) 1331 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T11:14:40.844 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:14:40 smithi047 bash[22744]: audit 2024-09-16T11:14:39.745562+0000 mon.b (mon.2) 1332 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T11:14:40.844 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:14:40 smithi047 bash[22744]: audit 2024-09-16T11:14:39.753332+0000 mon.a (mon.0) 1442 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:14:40.844 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:14:40 smithi047 bash[22744]: audit 2024-09-16T11:14:39.760286+0000 mon.b (mon.2) 1333 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:14:40.844 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:14:40 smithi047 bash[22744]: audit 2024-09-16T11:14:39.762219+0000 mgr.a (mgr.14373) 14594 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:14:41.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:14:40 smithi157 bash[24585]: audit 2024-09-16T11:14:39.707172+0000 mon.a (mon.0) 1436 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:14:41.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:14:40 smithi157 bash[24585]: audit 2024-09-16T11:14:39.711388+0000 mon.a (mon.0) 1437 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:14:41.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:14:40 smithi157 bash[24585]: audit 2024-09-16T11:14:39.717180+0000 mon.a (mon.0) 1438 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:14:41.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:14:40 smithi157 bash[24585]: audit 2024-09-16T11:14:39.721894+0000 mon.a (mon.0) 1439 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:14:41.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:14:40 smithi157 bash[24585]: audit 2024-09-16T11:14:39.728796+0000 mon.a (mon.0) 1440 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:14:41.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:14:40 smithi157 bash[24585]: audit 2024-09-16T11:14:39.737828+0000 mon.a (mon.0) 1441 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:14:41.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:14:40 smithi157 bash[24585]: audit 2024-09-16T11:14:39.743553+0000 mon.b (mon.2) 1331 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T11:14:41.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:14:40 smithi157 bash[24585]: audit 2024-09-16T11:14:39.745562+0000 mon.b (mon.2) 1332 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T11:14:41.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:14:40 smithi157 bash[24585]: audit 2024-09-16T11:14:39.753332+0000 mon.a (mon.0) 1442 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:14:41.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:14:40 smithi157 bash[24585]: audit 2024-09-16T11:14:39.760286+0000 mon.b (mon.2) 1333 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:14:41.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:14:40 smithi157 bash[24585]: audit 2024-09-16T11:14:39.762219+0000 mgr.a (mgr.14373) 14594 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:14:41.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:14:40 smithi086 bash[24289]: audit 2024-09-16T11:14:39.707172+0000 mon.a (mon.0) 1436 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:14:41.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:14:40 smithi086 bash[24289]: audit 2024-09-16T11:14:39.711388+0000 mon.a (mon.0) 1437 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:14:41.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:14:40 smithi086 bash[24289]: audit 2024-09-16T11:14:39.717180+0000 mon.a (mon.0) 1438 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:14:41.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:14:40 smithi086 bash[24289]: audit 2024-09-16T11:14:39.721894+0000 mon.a (mon.0) 1439 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:14:41.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:14:40 smithi086 bash[24289]: audit 2024-09-16T11:14:39.728796+0000 mon.a (mon.0) 1440 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:14:41.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:14:40 smithi086 bash[24289]: audit 2024-09-16T11:14:39.737828+0000 mon.a (mon.0) 1441 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:14:41.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:14:40 smithi086 bash[24289]: audit 2024-09-16T11:14:39.743553+0000 mon.b (mon.2) 1331 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T11:14:41.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:14:40 smithi086 bash[24289]: audit 2024-09-16T11:14:39.745562+0000 mon.b (mon.2) 1332 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T11:14:41.072 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:14:40 smithi086 bash[24289]: audit 2024-09-16T11:14:39.753332+0000 mon.a (mon.0) 1442 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:14:41.072 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:14:40 smithi086 bash[24289]: audit 2024-09-16T11:14:39.760286+0000 mon.b (mon.2) 1333 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:14:41.072 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:14:40 smithi086 bash[24289]: audit 2024-09-16T11:14:39.762219+0000 mgr.a (mgr.14373) 14594 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:14:41.664 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:14:41.665 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:14:41.665 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:14:42.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:14:41 smithi157 bash[24585]: cluster 2024-09-16T11:14:40.223302+0000 mgr.a (mgr.14373) 14595 : cluster [DBG] pgmap v10123: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T11:14:42.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:14:41 smithi157 bash[24585]: audit 2024-09-16T11:14:40.492166+0000 mgr.a (mgr.14373) 14596 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T11:14:42.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:14:41 smithi157 bash[24585]: cephadm 2024-09-16T11:14:40.494393+0000 mgr.a (mgr.14373) 14597 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T11:14:42.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:14:41 smithi086 bash[24289]: cluster 2024-09-16T11:14:40.223302+0000 mgr.a (mgr.14373) 14595 : cluster [DBG] pgmap v10123: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T11:14:42.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:14:41 smithi086 bash[24289]: audit 2024-09-16T11:14:40.492166+0000 mgr.a (mgr.14373) 14596 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T11:14:42.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:14:41 smithi086 bash[24289]: cephadm 2024-09-16T11:14:40.494393+0000 mgr.a (mgr.14373) 14597 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T11:14:42.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:14:41 smithi047 bash[22744]: cluster 2024-09-16T11:14:40.223302+0000 mgr.a (mgr.14373) 14595 : cluster [DBG] pgmap v10123: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T11:14:42.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:14:41 smithi047 bash[22744]: audit 2024-09-16T11:14:40.492166+0000 mgr.a (mgr.14373) 14596 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T11:14:42.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:14:41 smithi047 bash[22744]: cephadm 2024-09-16T11:14:40.494393+0000 mgr.a (mgr.14373) 14597 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T11:14:42.435 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:14:42.435 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:14:42.435 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:14:42.435 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:14:42.435 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:14:43.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:14:42 smithi157 bash[24585]: audit 2024-09-16T11:14:41.989494+0000 mgr.a (mgr.14373) 14598 : audit [DBG] from='client.316068 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:14:43.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:14:42 smithi086 bash[24289]: audit 2024-09-16T11:14:41.989494+0000 mgr.a (mgr.14373) 14598 : audit [DBG] from='client.316068 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:14:43.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:14:42 smithi047 bash[22744]: audit 2024-09-16T11:14:41.989494+0000 mgr.a (mgr.14373) 14598 : audit [DBG] from='client.316068 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:14:44.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:14:43 smithi157 bash[24585]: cluster 2024-09-16T11:14:42.228733+0000 mgr.a (mgr.14373) 14599 : cluster [DBG] pgmap v10124: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:14:44.072 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:14:43 smithi086 bash[24289]: cluster 2024-09-16T11:14:42.228733+0000 mgr.a (mgr.14373) 14599 : cluster [DBG] pgmap v10124: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:14:44.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:14:43 smithi047 bash[22744]: cluster 2024-09-16T11:14:42.228733+0000 mgr.a (mgr.14373) 14599 : cluster [DBG] pgmap v10124: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:14:46.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:14:45 smithi157 bash[24585]: cluster 2024-09-16T11:14:44.229703+0000 mgr.a (mgr.14373) 14600 : cluster [DBG] pgmap v10125: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T11:14:46.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:14:45 smithi086 bash[24289]: cluster 2024-09-16T11:14:44.229703+0000 mgr.a (mgr.14373) 14600 : cluster [DBG] pgmap v10125: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T11:14:46.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:14:45 smithi047 bash[22744]: cluster 2024-09-16T11:14:44.229703+0000 mgr.a (mgr.14373) 14600 : cluster [DBG] pgmap v10125: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T11:14:47.437 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:14:47.438 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:14:47.438 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:14:48.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:14:47 smithi157 bash[24585]: cluster 2024-09-16T11:14:46.230528+0000 mgr.a (mgr.14373) 14601 : cluster [DBG] pgmap v10126: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T11:14:48.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:14:47 smithi086 bash[24289]: cluster 2024-09-16T11:14:46.230528+0000 mgr.a (mgr.14373) 14601 : cluster [DBG] pgmap v10126: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T11:14:48.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:14:47 smithi047 bash[22744]: cluster 2024-09-16T11:14:46.230528+0000 mgr.a (mgr.14373) 14601 : cluster [DBG] pgmap v10126: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T11:14:48.183 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:14:48.184 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:14:48.184 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:14:48.184 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:14:48.184 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:14:49.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:14:48 smithi157 bash[24585]: audit 2024-09-16T11:14:47.767173+0000 mgr.a (mgr.14373) 14602 : audit [DBG] from='client.316146 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:14:49.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:14:48 smithi086 bash[24289]: audit 2024-09-16T11:14:47.767173+0000 mgr.a (mgr.14373) 14602 : audit [DBG] from='client.316146 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:14:49.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:14:48 smithi047 bash[22744]: audit 2024-09-16T11:14:47.767173+0000 mgr.a (mgr.14373) 14602 : audit [DBG] from='client.316146 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:14:50.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:14:49 smithi157 bash[24585]: cluster 2024-09-16T11:14:48.231873+0000 mgr.a (mgr.14373) 14603 : cluster [DBG] pgmap v10127: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:14:50.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:14:49 smithi086 bash[24289]: cluster 2024-09-16T11:14:48.231873+0000 mgr.a (mgr.14373) 14603 : cluster [DBG] pgmap v10127: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:14:50.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:14:49 smithi047 bash[22744]: cluster 2024-09-16T11:14:48.231873+0000 mgr.a (mgr.14373) 14603 : cluster [DBG] pgmap v10127: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:14:52.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:14:51 smithi157 bash[24585]: cluster 2024-09-16T11:14:50.232748+0000 mgr.a (mgr.14373) 14604 : cluster [DBG] pgmap v10128: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T11:14:52.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:14:51 smithi086 bash[24289]: cluster 2024-09-16T11:14:50.232748+0000 mgr.a (mgr.14373) 14604 : cluster [DBG] pgmap v10128: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T11:14:52.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:14:51 smithi047 bash[22744]: cluster 2024-09-16T11:14:50.232748+0000 mgr.a (mgr.14373) 14604 : cluster [DBG] pgmap v10128: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T11:14:53.185 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:14:53.186 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:14:53.186 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:14:53.938 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:14:53.938 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:14:53.938 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:14:53.938 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:14:53.938 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:14:54.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:14:53 smithi157 bash[24585]: cluster 2024-09-16T11:14:52.234818+0000 mgr.a (mgr.14373) 14605 : cluster [DBG] pgmap v10129: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:14:54.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:14:53 smithi086 bash[24289]: cluster 2024-09-16T11:14:52.234818+0000 mgr.a (mgr.14373) 14605 : cluster [DBG] pgmap v10129: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:14:54.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:14:53 smithi047 bash[22744]: cluster 2024-09-16T11:14:52.234818+0000 mgr.a (mgr.14373) 14605 : cluster [DBG] pgmap v10129: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:14:55.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:14:54 smithi157 bash[24585]: audit 2024-09-16T11:14:53.517082+0000 mgr.a (mgr.14373) 14606 : audit [DBG] from='client.316218 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:14:55.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:14:54 smithi086 bash[24289]: audit 2024-09-16T11:14:53.517082+0000 mgr.a (mgr.14373) 14606 : audit [DBG] from='client.316218 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:14:55.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:14:54 smithi047 bash[22744]: audit 2024-09-16T11:14:53.517082+0000 mgr.a (mgr.14373) 14606 : audit [DBG] from='client.316218 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:14:56.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:14:55 smithi157 bash[24585]: cluster 2024-09-16T11:14:54.235752+0000 mgr.a (mgr.14373) 14607 : cluster [DBG] pgmap v10130: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:14:56.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:14:55 smithi086 bash[24289]: cluster 2024-09-16T11:14:54.235752+0000 mgr.a (mgr.14373) 14607 : cluster [DBG] pgmap v10130: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:14:56.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:14:55 smithi047 bash[22744]: cluster 2024-09-16T11:14:54.235752+0000 mgr.a (mgr.14373) 14607 : cluster [DBG] pgmap v10130: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:14:57.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:14:57 smithi157 bash[24585]: cluster 2024-09-16T11:14:56.236509+0000 mgr.a (mgr.14373) 14608 : cluster [DBG] pgmap v10131: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:14:57.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:14:57 smithi086 bash[24289]: cluster 2024-09-16T11:14:56.236509+0000 mgr.a (mgr.14373) 14608 : cluster [DBG] pgmap v10131: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:14:57.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:14:57 smithi047 bash[22744]: cluster 2024-09-16T11:14:56.236509+0000 mgr.a (mgr.14373) 14608 : cluster [DBG] pgmap v10131: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:14:58.939 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:14:58.942 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:14:58.942 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:14:59.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:14:59 smithi157 bash[24585]: cluster 2024-09-16T11:14:58.238860+0000 mgr.a (mgr.14373) 14609 : cluster [DBG] pgmap v10132: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:14:59.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:14:59 smithi086 bash[24289]: cluster 2024-09-16T11:14:58.238860+0000 mgr.a (mgr.14373) 14609 : cluster [DBG] pgmap v10132: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:14:59.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:14:59 smithi047 bash[22744]: cluster 2024-09-16T11:14:58.238860+0000 mgr.a (mgr.14373) 14609 : cluster [DBG] pgmap v10132: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:14:59.689 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:14:59.689 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:14:59.689 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:14:59.689 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:14:59.689 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:15:00.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:15:00 smithi157 bash[24585]: audit 2024-09-16T11:14:59.270576+0000 mgr.a (mgr.14373) 14610 : audit [DBG] from='client.316293 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:15:00.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:15:00 smithi086 bash[24289]: audit 2024-09-16T11:14:59.270576+0000 mgr.a (mgr.14373) 14610 : audit [DBG] from='client.316293 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:15:00.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:15:00 smithi047 bash[22744]: audit 2024-09-16T11:14:59.270576+0000 mgr.a (mgr.14373) 14610 : audit [DBG] from='client.316293 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:15:01.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:15:01 smithi086 bash[24289]: cluster 2024-09-16T11:15:00.239851+0000 mgr.a (mgr.14373) 14611 : cluster [DBG] pgmap v10133: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:15:01.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:15:01 smithi047 bash[22744]: cluster 2024-09-16T11:15:00.239851+0000 mgr.a (mgr.14373) 14611 : cluster [DBG] pgmap v10133: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:15:01.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:15:01 smithi157 bash[24585]: cluster 2024-09-16T11:15:00.239851+0000 mgr.a (mgr.14373) 14611 : cluster [DBG] pgmap v10133: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:15:03.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:15:03 smithi086 bash[24289]: cluster 2024-09-16T11:15:02.242114+0000 mgr.a (mgr.14373) 14612 : cluster [DBG] pgmap v10134: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:15:03.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:15:03 smithi047 bash[22744]: cluster 2024-09-16T11:15:02.242114+0000 mgr.a (mgr.14373) 14612 : cluster [DBG] pgmap v10134: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:15:03.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:15:03 smithi157 bash[24585]: cluster 2024-09-16T11:15:02.242114+0000 mgr.a (mgr.14373) 14612 : cluster [DBG] pgmap v10134: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:15:04.690 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:15:04.691 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:15:04.691 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:15:05.468 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:15:05.468 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:15:05.469 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:15:05.469 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:15:05.469 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:15:05.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:15:05 smithi086 bash[24289]: cluster 2024-09-16T11:15:04.242982+0000 mgr.a (mgr.14373) 14613 : cluster [DBG] pgmap v10135: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:15:05.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:15:05 smithi086 bash[24289]: audit 2024-09-16T11:15:05.024078+0000 mgr.a (mgr.14373) 14614 : audit [DBG] from='client.316371 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:15:05.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:15:05 smithi047 bash[22744]: cluster 2024-09-16T11:15:04.242982+0000 mgr.a (mgr.14373) 14613 : cluster [DBG] pgmap v10135: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:15:05.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:15:05 smithi047 bash[22744]: audit 2024-09-16T11:15:05.024078+0000 mgr.a (mgr.14373) 14614 : audit [DBG] from='client.316371 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:15:05.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:15:05 smithi157 bash[24585]: cluster 2024-09-16T11:15:04.242982+0000 mgr.a (mgr.14373) 14613 : cluster [DBG] pgmap v10135: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:15:05.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:15:05 smithi157 bash[24585]: audit 2024-09-16T11:15:05.024078+0000 mgr.a (mgr.14373) 14614 : audit [DBG] from='client.316371 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:15:07.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:15:07 smithi047 bash[22744]: cluster 2024-09-16T11:15:06.243979+0000 mgr.a (mgr.14373) 14615 : cluster [DBG] pgmap v10136: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:15:07.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:15:07 smithi157 bash[24585]: cluster 2024-09-16T11:15:06.243979+0000 mgr.a (mgr.14373) 14615 : cluster [DBG] pgmap v10136: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:15:07.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:15:07 smithi086 bash[24289]: cluster 2024-09-16T11:15:06.243979+0000 mgr.a (mgr.14373) 14615 : cluster [DBG] pgmap v10136: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:15:09.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:15:09 smithi047 bash[22744]: cluster 2024-09-16T11:15:08.246209+0000 mgr.a (mgr.14373) 14616 : cluster [DBG] pgmap v10137: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:15:09.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:15:09 smithi157 bash[24585]: cluster 2024-09-16T11:15:08.246209+0000 mgr.a (mgr.14373) 14616 : cluster [DBG] pgmap v10137: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:15:09.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:15:09 smithi086 bash[24289]: cluster 2024-09-16T11:15:08.246209+0000 mgr.a (mgr.14373) 14616 : cluster [DBG] pgmap v10137: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:15:10.470 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:15:10.470 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:15:10.470 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:15:11.256 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:15:11.256 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:15:11.256 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:15:11.256 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:15:11.256 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:15:11.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:15:11 smithi047 bash[22744]: cluster 2024-09-16T11:15:10.246990+0000 mgr.a (mgr.14373) 14617 : cluster [DBG] pgmap v10138: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:15:11.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:15:11 smithi047 bash[22744]: audit 2024-09-16T11:15:10.803293+0000 mgr.a (mgr.14373) 14618 : audit [DBG] from='client.316449 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:15:11.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:15:11 smithi157 bash[24585]: cluster 2024-09-16T11:15:10.246990+0000 mgr.a (mgr.14373) 14617 : cluster [DBG] pgmap v10138: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:15:11.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:15:11 smithi157 bash[24585]: audit 2024-09-16T11:15:10.803293+0000 mgr.a (mgr.14373) 14618 : audit [DBG] from='client.316449 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:15:11.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:15:11 smithi086 bash[24289]: cluster 2024-09-16T11:15:10.246990+0000 mgr.a (mgr.14373) 14617 : cluster [DBG] pgmap v10138: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:15:11.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:15:11 smithi086 bash[24289]: audit 2024-09-16T11:15:10.803293+0000 mgr.a (mgr.14373) 14618 : audit [DBG] from='client.316449 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:15:13.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:15:13 smithi047 bash[22744]: cluster 2024-09-16T11:15:12.249451+0000 mgr.a (mgr.14373) 14619 : cluster [DBG] pgmap v10139: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:15:13.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:15:13 smithi157 bash[24585]: cluster 2024-09-16T11:15:12.249451+0000 mgr.a (mgr.14373) 14619 : cluster [DBG] pgmap v10139: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:15:13.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:15:13 smithi086 bash[24289]: cluster 2024-09-16T11:15:12.249451+0000 mgr.a (mgr.14373) 14619 : cluster [DBG] pgmap v10139: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:15:15.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:15:15 smithi047 bash[22744]: cluster 2024-09-16T11:15:14.250261+0000 mgr.a (mgr.14373) 14620 : cluster [DBG] pgmap v10140: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:15:15.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:15:15 smithi157 bash[24585]: cluster 2024-09-16T11:15:14.250261+0000 mgr.a (mgr.14373) 14620 : cluster [DBG] pgmap v10140: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:15:15.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:15:15 smithi086 bash[24289]: cluster 2024-09-16T11:15:14.250261+0000 mgr.a (mgr.14373) 14620 : cluster [DBG] pgmap v10140: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:15:16.257 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:15:16.258 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:15:16.258 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:15:17.036 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:15:17.036 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:15:17.036 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:15:17.037 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:15:17.037 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:15:17.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:15:17 smithi047 bash[22744]: cluster 2024-09-16T11:15:16.251027+0000 mgr.a (mgr.14373) 14621 : cluster [DBG] pgmap v10141: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:15:17.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:15:17 smithi047 bash[22744]: audit 2024-09-16T11:15:16.595433+0000 mgr.a (mgr.14373) 14622 : audit [DBG] from='client.316524 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:15:17.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:15:17 smithi157 bash[24585]: cluster 2024-09-16T11:15:16.251027+0000 mgr.a (mgr.14373) 14621 : cluster [DBG] pgmap v10141: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:15:17.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:15:17 smithi157 bash[24585]: audit 2024-09-16T11:15:16.595433+0000 mgr.a (mgr.14373) 14622 : audit [DBG] from='client.316524 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:15:17.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:15:17 smithi086 bash[24289]: cluster 2024-09-16T11:15:16.251027+0000 mgr.a (mgr.14373) 14621 : cluster [DBG] pgmap v10141: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:15:17.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:15:17 smithi086 bash[24289]: audit 2024-09-16T11:15:16.595433+0000 mgr.a (mgr.14373) 14622 : audit [DBG] from='client.316524 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:15:19.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:15:19 smithi157 bash[24585]: cluster 2024-09-16T11:15:18.253780+0000 mgr.a (mgr.14373) 14623 : cluster [DBG] pgmap v10142: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:15:19.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:15:19 smithi086 bash[24289]: cluster 2024-09-16T11:15:18.253780+0000 mgr.a (mgr.14373) 14623 : cluster [DBG] pgmap v10142: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:15:19.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:15:19 smithi047 bash[22744]: cluster 2024-09-16T11:15:18.253780+0000 mgr.a (mgr.14373) 14623 : cluster [DBG] pgmap v10142: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:15:21.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:15:21 smithi157 bash[24585]: cluster 2024-09-16T11:15:20.254578+0000 mgr.a (mgr.14373) 14624 : cluster [DBG] pgmap v10143: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:15:21.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:15:21 smithi086 bash[24289]: cluster 2024-09-16T11:15:20.254578+0000 mgr.a (mgr.14373) 14624 : cluster [DBG] pgmap v10143: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:15:21.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:15:21 smithi047 bash[22744]: cluster 2024-09-16T11:15:20.254578+0000 mgr.a (mgr.14373) 14624 : cluster [DBG] pgmap v10143: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:15:22.038 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:15:22.038 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:15:22.039 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:15:22.825 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:15:22.825 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:15:22.826 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:15:22.826 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:15:22.826 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:15:23.808 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:15:23 smithi157 bash[24585]: cluster 2024-09-16T11:15:22.256499+0000 mgr.a (mgr.14373) 14625 : cluster [DBG] pgmap v10144: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:15:23.808 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:15:23 smithi157 bash[24585]: audit 2024-09-16T11:15:22.374611+0000 mgr.a (mgr.14373) 14626 : audit [DBG] from='client.316602 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:15:23.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:15:23 smithi086 bash[24289]: cluster 2024-09-16T11:15:22.256499+0000 mgr.a (mgr.14373) 14625 : cluster [DBG] pgmap v10144: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:15:23.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:15:23 smithi086 bash[24289]: audit 2024-09-16T11:15:22.374611+0000 mgr.a (mgr.14373) 14626 : audit [DBG] from='client.316602 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:15:23.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:15:23 smithi047 bash[22744]: cluster 2024-09-16T11:15:22.256499+0000 mgr.a (mgr.14373) 14625 : cluster [DBG] pgmap v10144: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:15:23.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:15:23 smithi047 bash[22744]: audit 2024-09-16T11:15:22.374611+0000 mgr.a (mgr.14373) 14626 : audit [DBG] from='client.316602 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:15:25.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:15:25 smithi157 bash[24585]: cluster 2024-09-16T11:15:24.257461+0000 mgr.a (mgr.14373) 14627 : cluster [DBG] pgmap v10145: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:15:25.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:15:25 smithi086 bash[24289]: cluster 2024-09-16T11:15:24.257461+0000 mgr.a (mgr.14373) 14627 : cluster [DBG] pgmap v10145: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:15:25.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:15:25 smithi047 bash[22744]: cluster 2024-09-16T11:15:24.257461+0000 mgr.a (mgr.14373) 14627 : cluster [DBG] pgmap v10145: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:15:27.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:15:27 smithi157 bash[24585]: cluster 2024-09-16T11:15:26.258240+0000 mgr.a (mgr.14373) 14628 : cluster [DBG] pgmap v10146: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T11:15:27.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:15:27 smithi086 bash[24289]: cluster 2024-09-16T11:15:26.258240+0000 mgr.a (mgr.14373) 14628 : cluster [DBG] pgmap v10146: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T11:15:27.826 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:15:27.828 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:15:27.828 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:15:27.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:15:27 smithi047 bash[22744]: cluster 2024-09-16T11:15:26.258240+0000 mgr.a (mgr.14373) 14628 : cluster [DBG] pgmap v10146: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T11:15:28.581 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:15:28.581 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:15:28.581 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:15:28.581 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:15:28.581 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:15:29.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:15:29 smithi157 bash[24585]: audit 2024-09-16T11:15:28.159781+0000 mgr.a (mgr.14373) 14629 : audit [DBG] from='client.316677 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:15:29.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:15:29 smithi157 bash[24585]: cluster 2024-09-16T11:15:28.259505+0000 mgr.a (mgr.14373) 14630 : cluster [DBG] pgmap v10147: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:15:29.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:15:29 smithi086 bash[24289]: audit 2024-09-16T11:15:28.159781+0000 mgr.a (mgr.14373) 14629 : audit [DBG] from='client.316677 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:15:29.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:15:29 smithi086 bash[24289]: cluster 2024-09-16T11:15:28.259505+0000 mgr.a (mgr.14373) 14630 : cluster [DBG] pgmap v10147: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:15:29.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:15:29 smithi047 bash[22744]: audit 2024-09-16T11:15:28.159781+0000 mgr.a (mgr.14373) 14629 : audit [DBG] from='client.316677 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:15:29.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:15:29 smithi047 bash[22744]: cluster 2024-09-16T11:15:28.259505+0000 mgr.a (mgr.14373) 14630 : cluster [DBG] pgmap v10147: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:15:31.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:15:31 smithi157 bash[24585]: cluster 2024-09-16T11:15:30.260368+0000 mgr.a (mgr.14373) 14631 : cluster [DBG] pgmap v10148: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:15:31.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:15:31 smithi086 bash[24289]: cluster 2024-09-16T11:15:30.260368+0000 mgr.a (mgr.14373) 14631 : cluster [DBG] pgmap v10148: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:15:31.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:15:31 smithi047 bash[22744]: cluster 2024-09-16T11:15:30.260368+0000 mgr.a (mgr.14373) 14631 : cluster [DBG] pgmap v10148: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:15:33.582 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:15:33.583 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:15:33.583 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:15:33.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:15:33 smithi157 bash[24585]: cluster 2024-09-16T11:15:32.262572+0000 mgr.a (mgr.14373) 14632 : cluster [DBG] pgmap v10149: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:15:33.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:15:33 smithi086 bash[24289]: cluster 2024-09-16T11:15:32.262572+0000 mgr.a (mgr.14373) 14632 : cluster [DBG] pgmap v10149: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:15:33.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:15:33 smithi047 bash[22744]: cluster 2024-09-16T11:15:32.262572+0000 mgr.a (mgr.14373) 14632 : cluster [DBG] pgmap v10149: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:15:34.326 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:15:34.327 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:15:34.327 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:15:34.327 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:15:34.327 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:15:34.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:15:34 smithi157 bash[24585]: audit 2024-09-16T11:15:33.912343+0000 mgr.a (mgr.14373) 14633 : audit [DBG] from='client.316755 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:15:34.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:15:34 smithi086 bash[24289]: audit 2024-09-16T11:15:33.912343+0000 mgr.a (mgr.14373) 14633 : audit [DBG] from='client.316755 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:15:34.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:15:34 smithi047 bash[22744]: audit 2024-09-16T11:15:33.912343+0000 mgr.a (mgr.14373) 14633 : audit [DBG] from='client.316755 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:15:35.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:15:35 smithi157 bash[24585]: cluster 2024-09-16T11:15:34.263171+0000 mgr.a (mgr.14373) 14634 : cluster [DBG] pgmap v10150: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:15:35.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:15:35 smithi086 bash[24289]: cluster 2024-09-16T11:15:34.263171+0000 mgr.a (mgr.14373) 14634 : cluster [DBG] pgmap v10150: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:15:35.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:15:35 smithi047 bash[22744]: cluster 2024-09-16T11:15:34.263171+0000 mgr.a (mgr.14373) 14634 : cluster [DBG] pgmap v10150: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:15:37.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:15:37 smithi157 bash[24585]: cluster 2024-09-16T11:15:36.263962+0000 mgr.a (mgr.14373) 14635 : cluster [DBG] pgmap v10151: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:15:37.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:15:37 smithi086 bash[24289]: cluster 2024-09-16T11:15:36.263962+0000 mgr.a (mgr.14373) 14635 : cluster [DBG] pgmap v10151: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:15:37.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:15:37 smithi047 bash[22744]: cluster 2024-09-16T11:15:36.263962+0000 mgr.a (mgr.14373) 14635 : cluster [DBG] pgmap v10151: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:15:39.328 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:15:39.329 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:15:39.329 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:15:39.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:15:39 smithi047 bash[22744]: cluster 2024-09-16T11:15:38.266194+0000 mgr.a (mgr.14373) 14636 : cluster [DBG] pgmap v10152: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:15:39.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:15:39 smithi157 bash[24585]: cluster 2024-09-16T11:15:38.266194+0000 mgr.a (mgr.14373) 14636 : cluster [DBG] pgmap v10152: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:15:39.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:15:39 smithi086 bash[24289]: cluster 2024-09-16T11:15:38.266194+0000 mgr.a (mgr.14373) 14636 : cluster [DBG] pgmap v10152: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:15:40.094 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:15:40.095 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:15:40.095 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:15:40.095 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:15:40.095 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:15:40.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:15:40 smithi047 bash[22744]: audit 2024-09-16T11:15:39.662931+0000 mgr.a (mgr.14373) 14637 : audit [DBG] from='client.316833 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:15:40.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:15:40 smithi157 bash[24585]: audit 2024-09-16T11:15:39.662931+0000 mgr.a (mgr.14373) 14637 : audit [DBG] from='client.316833 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:15:40.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:15:40 smithi086 bash[24289]: audit 2024-09-16T11:15:39.662931+0000 mgr.a (mgr.14373) 14637 : audit [DBG] from='client.316833 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:15:41.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:15:41 smithi047 bash[22744]: cluster 2024-09-16T11:15:40.267151+0000 mgr.a (mgr.14373) 14638 : cluster [DBG] pgmap v10153: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:15:41.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:15:41 smithi047 bash[22744]: audit 2024-09-16T11:15:40.558613+0000 mon.b (mon.2) 1334 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T11:15:41.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:15:41 smithi157 bash[24585]: cluster 2024-09-16T11:15:40.267151+0000 mgr.a (mgr.14373) 14638 : cluster [DBG] pgmap v10153: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:15:41.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:15:41 smithi157 bash[24585]: audit 2024-09-16T11:15:40.558613+0000 mon.b (mon.2) 1334 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T11:15:41.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:15:41 smithi086 bash[24289]: cluster 2024-09-16T11:15:40.267151+0000 mgr.a (mgr.14373) 14638 : cluster [DBG] pgmap v10153: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:15:41.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:15:41 smithi086 bash[24289]: audit 2024-09-16T11:15:40.558613+0000 mon.b (mon.2) 1334 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T11:15:43.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:15:43 smithi047 bash[22744]: cluster 2024-09-16T11:15:42.269487+0000 mgr.a (mgr.14373) 14639 : cluster [DBG] pgmap v10154: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:15:43.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:15:43 smithi157 bash[24585]: cluster 2024-09-16T11:15:42.269487+0000 mgr.a (mgr.14373) 14639 : cluster [DBG] pgmap v10154: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:15:43.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:15:43 smithi086 bash[24289]: cluster 2024-09-16T11:15:42.269487+0000 mgr.a (mgr.14373) 14639 : cluster [DBG] pgmap v10154: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:15:45.096 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:15:45.097 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:15:45.097 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:15:45.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:15:45 smithi157 bash[24585]: cluster 2024-09-16T11:15:44.270298+0000 mgr.a (mgr.14373) 14640 : cluster [DBG] pgmap v10155: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:15:45.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:15:45 smithi086 bash[24289]: cluster 2024-09-16T11:15:44.270298+0000 mgr.a (mgr.14373) 14640 : cluster [DBG] pgmap v10155: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:15:45.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:15:45 smithi047 bash[22744]: cluster 2024-09-16T11:15:44.270298+0000 mgr.a (mgr.14373) 14640 : cluster [DBG] pgmap v10155: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:15:45.900 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:15:45.900 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:15:45.900 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:15:45.900 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:15:45.900 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:15:47.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:15:46 smithi157 bash[24585]: audit 2024-09-16T11:15:45.432263+0000 mgr.a (mgr.14373) 14641 : audit [DBG] from='client.316911 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:15:47.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:15:46 smithi157 bash[24585]: audit 2024-09-16T11:15:45.910820+0000 mon.a (mon.0) 1443 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:15:47.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:15:46 smithi157 bash[24585]: audit 2024-09-16T11:15:45.916503+0000 mon.a (mon.0) 1444 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:15:47.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:15:46 smithi157 bash[24585]: audit 2024-09-16T11:15:45.928867+0000 mon.a (mon.0) 1445 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:15:47.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:15:46 smithi157 bash[24585]: audit 2024-09-16T11:15:45.931479+0000 mon.a (mon.0) 1446 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:15:47.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:15:46 smithi157 bash[24585]: audit 2024-09-16T11:15:45.934846+0000 mon.a (mon.0) 1447 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:15:47.308 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:15:46 smithi157 bash[24585]: audit 2024-09-16T11:15:45.937419+0000 mon.a (mon.0) 1448 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:15:47.308 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:15:46 smithi157 bash[24585]: audit 2024-09-16T11:15:46.682373+0000 mon.b (mon.2) 1335 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T11:15:47.308 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:15:46 smithi157 bash[24585]: audit 2024-09-16T11:15:46.684635+0000 mon.b (mon.2) 1336 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T11:15:47.308 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:15:46 smithi157 bash[24585]: audit 2024-09-16T11:15:46.696124+0000 mon.a (mon.0) 1449 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:15:47.308 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:15:46 smithi157 bash[24585]: audit 2024-09-16T11:15:46.701306+0000 mon.b (mon.2) 1337 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:15:47.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:15:46 smithi086 bash[24289]: audit 2024-09-16T11:15:45.432263+0000 mgr.a (mgr.14373) 14641 : audit [DBG] from='client.316911 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:15:47.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:15:46 smithi086 bash[24289]: audit 2024-09-16T11:15:45.910820+0000 mon.a (mon.0) 1443 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:15:47.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:15:46 smithi086 bash[24289]: audit 2024-09-16T11:15:45.916503+0000 mon.a (mon.0) 1444 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:15:47.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:15:46 smithi086 bash[24289]: audit 2024-09-16T11:15:45.928867+0000 mon.a (mon.0) 1445 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:15:47.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:15:46 smithi086 bash[24289]: audit 2024-09-16T11:15:45.931479+0000 mon.a (mon.0) 1446 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:15:47.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:15:46 smithi086 bash[24289]: audit 2024-09-16T11:15:45.934846+0000 mon.a (mon.0) 1447 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:15:47.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:15:46 smithi086 bash[24289]: audit 2024-09-16T11:15:45.937419+0000 mon.a (mon.0) 1448 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:15:47.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:15:46 smithi086 bash[24289]: audit 2024-09-16T11:15:46.682373+0000 mon.b (mon.2) 1335 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T11:15:47.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:15:46 smithi086 bash[24289]: audit 2024-09-16T11:15:46.684635+0000 mon.b (mon.2) 1336 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T11:15:47.322 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:15:46 smithi086 bash[24289]: audit 2024-09-16T11:15:46.696124+0000 mon.a (mon.0) 1449 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:15:47.322 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:15:46 smithi086 bash[24289]: audit 2024-09-16T11:15:46.701306+0000 mon.b (mon.2) 1337 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:15:47.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:15:46 smithi047 bash[22744]: audit 2024-09-16T11:15:45.432263+0000 mgr.a (mgr.14373) 14641 : audit [DBG] from='client.316911 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:15:47.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:15:46 smithi047 bash[22744]: audit 2024-09-16T11:15:45.910820+0000 mon.a (mon.0) 1443 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:15:47.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:15:46 smithi047 bash[22744]: audit 2024-09-16T11:15:45.916503+0000 mon.a (mon.0) 1444 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:15:47.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:15:46 smithi047 bash[22744]: audit 2024-09-16T11:15:45.928867+0000 mon.a (mon.0) 1445 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:15:47.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:15:46 smithi047 bash[22744]: audit 2024-09-16T11:15:45.931479+0000 mon.a (mon.0) 1446 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:15:47.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:15:46 smithi047 bash[22744]: audit 2024-09-16T11:15:45.934846+0000 mon.a (mon.0) 1447 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:15:47.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:15:46 smithi047 bash[22744]: audit 2024-09-16T11:15:45.937419+0000 mon.a (mon.0) 1448 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:15:47.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:15:46 smithi047 bash[22744]: audit 2024-09-16T11:15:46.682373+0000 mon.b (mon.2) 1335 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T11:15:47.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:15:46 smithi047 bash[22744]: audit 2024-09-16T11:15:46.684635+0000 mon.b (mon.2) 1336 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T11:15:47.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:15:46 smithi047 bash[22744]: audit 2024-09-16T11:15:46.696124+0000 mon.a (mon.0) 1449 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:15:47.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:15:46 smithi047 bash[22744]: audit 2024-09-16T11:15:46.701306+0000 mon.b (mon.2) 1337 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:15:47.842 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 11:15:47 smithi047 bash[22994]: debug 2024-09-16T11:15:47.447+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T11:15:47.842 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 11:15:47 smithi047 bash[22994]: debug 2024-09-16T11:15:47.451+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T11:15:48.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:15:47 smithi157 bash[24585]: cluster 2024-09-16T11:15:46.271224+0000 mgr.a (mgr.14373) 14642 : cluster [DBG] pgmap v10156: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:15:48.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:15:47 smithi157 bash[24585]: audit 2024-09-16T11:15:46.704262+0000 mgr.a (mgr.14373) 14643 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:15:48.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:15:47 smithi086 bash[24289]: cluster 2024-09-16T11:15:46.271224+0000 mgr.a (mgr.14373) 14642 : cluster [DBG] pgmap v10156: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:15:48.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:15:47 smithi086 bash[24289]: audit 2024-09-16T11:15:46.704262+0000 mgr.a (mgr.14373) 14643 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:15:48.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:15:47 smithi047 bash[22744]: cluster 2024-09-16T11:15:46.271224+0000 mgr.a (mgr.14373) 14642 : cluster [DBG] pgmap v10156: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:15:48.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:15:47 smithi047 bash[22744]: audit 2024-09-16T11:15:46.704262+0000 mgr.a (mgr.14373) 14643 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:15:49.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:15:48 smithi157 bash[24585]: audit 2024-09-16T11:15:47.453992+0000 mgr.a (mgr.14373) 14644 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T11:15:49.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:15:48 smithi157 bash[24585]: cephadm 2024-09-16T11:15:47.456212+0000 mgr.a (mgr.14373) 14645 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T11:15:49.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:15:48 smithi086 bash[24289]: audit 2024-09-16T11:15:47.453992+0000 mgr.a (mgr.14373) 14644 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T11:15:49.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:15:48 smithi086 bash[24289]: cephadm 2024-09-16T11:15:47.456212+0000 mgr.a (mgr.14373) 14645 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T11:15:49.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:15:48 smithi047 bash[22744]: audit 2024-09-16T11:15:47.453992+0000 mgr.a (mgr.14373) 14644 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T11:15:49.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:15:48 smithi047 bash[22744]: cephadm 2024-09-16T11:15:47.456212+0000 mgr.a (mgr.14373) 14645 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T11:15:50.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:15:49 smithi157 bash[24585]: cluster 2024-09-16T11:15:48.274132+0000 mgr.a (mgr.14373) 14646 : cluster [DBG] pgmap v10157: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:15:50.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:15:49 smithi086 bash[24289]: cluster 2024-09-16T11:15:48.274132+0000 mgr.a (mgr.14373) 14646 : cluster [DBG] pgmap v10157: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:15:50.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:15:49 smithi047 bash[22744]: cluster 2024-09-16T11:15:48.274132+0000 mgr.a (mgr.14373) 14646 : cluster [DBG] pgmap v10157: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:15:50.901 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:15:50.902 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:15:50.902 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:15:51.667 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:15:51.667 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:15:51.667 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:15:51.667 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:15:51.668 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:15:52.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:15:51 smithi157 bash[24585]: cluster 2024-09-16T11:15:50.274968+0000 mgr.a (mgr.14373) 14647 : cluster [DBG] pgmap v10158: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:15:52.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:15:51 smithi086 bash[24289]: cluster 2024-09-16T11:15:50.274968+0000 mgr.a (mgr.14373) 14647 : cluster [DBG] pgmap v10158: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:15:52.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:15:51 smithi047 bash[22744]: cluster 2024-09-16T11:15:50.274968+0000 mgr.a (mgr.14373) 14647 : cluster [DBG] pgmap v10158: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:15:53.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:15:52 smithi157 bash[24585]: audit 2024-09-16T11:15:51.235230+0000 mgr.a (mgr.14373) 14648 : audit [DBG] from='client.317091 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:15:53.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:15:52 smithi086 bash[24289]: audit 2024-09-16T11:15:51.235230+0000 mgr.a (mgr.14373) 14648 : audit [DBG] from='client.317091 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:15:53.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:15:52 smithi047 bash[22744]: audit 2024-09-16T11:15:51.235230+0000 mgr.a (mgr.14373) 14648 : audit [DBG] from='client.317091 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:15:54.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:15:53 smithi157 bash[24585]: cluster 2024-09-16T11:15:52.277767+0000 mgr.a (mgr.14373) 14649 : cluster [DBG] pgmap v10159: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:15:54.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:15:53 smithi086 bash[24289]: cluster 2024-09-16T11:15:52.277767+0000 mgr.a (mgr.14373) 14649 : cluster [DBG] pgmap v10159: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:15:54.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:15:53 smithi047 bash[22744]: cluster 2024-09-16T11:15:52.277767+0000 mgr.a (mgr.14373) 14649 : cluster [DBG] pgmap v10159: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:15:56.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:15:55 smithi157 bash[24585]: cluster 2024-09-16T11:15:54.278601+0000 mgr.a (mgr.14373) 14650 : cluster [DBG] pgmap v10160: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T11:15:56.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:15:55 smithi086 bash[24289]: cluster 2024-09-16T11:15:54.278601+0000 mgr.a (mgr.14373) 14650 : cluster [DBG] pgmap v10160: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T11:15:56.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:15:55 smithi047 bash[22744]: cluster 2024-09-16T11:15:54.278601+0000 mgr.a (mgr.14373) 14650 : cluster [DBG] pgmap v10160: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T11:15:56.669 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:15:56.669 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:15:56.670 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:15:57.425 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:15:57.426 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:15:57.426 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:15:57.426 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:15:57.426 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:15:58.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:15:57 smithi157 bash[24585]: cluster 2024-09-16T11:15:56.279365+0000 mgr.a (mgr.14373) 14651 : cluster [DBG] pgmap v10161: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T11:15:58.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:15:57 smithi157 bash[24585]: audit 2024-09-16T11:15:57.000543+0000 mgr.a (mgr.14373) 14652 : audit [DBG] from='client.317169 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:15:58.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:15:57 smithi086 bash[24289]: cluster 2024-09-16T11:15:56.279365+0000 mgr.a (mgr.14373) 14651 : cluster [DBG] pgmap v10161: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T11:15:58.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:15:57 smithi086 bash[24289]: audit 2024-09-16T11:15:57.000543+0000 mgr.a (mgr.14373) 14652 : audit [DBG] from='client.317169 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:15:58.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:15:57 smithi047 bash[22744]: cluster 2024-09-16T11:15:56.279365+0000 mgr.a (mgr.14373) 14651 : cluster [DBG] pgmap v10161: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T11:15:58.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:15:57 smithi047 bash[22744]: audit 2024-09-16T11:15:57.000543+0000 mgr.a (mgr.14373) 14652 : audit [DBG] from='client.317169 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:16:00.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:15:59 smithi157 bash[24585]: cluster 2024-09-16T11:15:58.282198+0000 mgr.a (mgr.14373) 14653 : cluster [DBG] pgmap v10162: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:16:00.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:15:59 smithi086 bash[24289]: cluster 2024-09-16T11:15:58.282198+0000 mgr.a (mgr.14373) 14653 : cluster [DBG] pgmap v10162: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:16:00.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:15:59 smithi047 bash[22744]: cluster 2024-09-16T11:15:58.282198+0000 mgr.a (mgr.14373) 14653 : cluster [DBG] pgmap v10162: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:16:02.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:16:01 smithi157 bash[24585]: cluster 2024-09-16T11:16:00.283032+0000 mgr.a (mgr.14373) 14654 : cluster [DBG] pgmap v10163: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T11:16:02.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:16:01 smithi086 bash[24289]: cluster 2024-09-16T11:16:00.283032+0000 mgr.a (mgr.14373) 14654 : cluster [DBG] pgmap v10163: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T11:16:02.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:16:01 smithi047 bash[22744]: cluster 2024-09-16T11:16:00.283032+0000 mgr.a (mgr.14373) 14654 : cluster [DBG] pgmap v10163: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T11:16:02.427 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:16:02.428 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:16:02.428 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:16:03.181 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:16:03.182 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:16:03.182 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:16:03.182 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:16:03.182 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:16:04.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:16:03 smithi157 bash[24585]: cluster 2024-09-16T11:16:02.285054+0000 mgr.a (mgr.14373) 14655 : cluster [DBG] pgmap v10164: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:16:04.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:16:03 smithi157 bash[24585]: audit 2024-09-16T11:16:02.762915+0000 mgr.a (mgr.14373) 14656 : audit [DBG] from='client.317247 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:16:04.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:16:03 smithi086 bash[24289]: cluster 2024-09-16T11:16:02.285054+0000 mgr.a (mgr.14373) 14655 : cluster [DBG] pgmap v10164: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:16:04.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:16:03 smithi086 bash[24289]: audit 2024-09-16T11:16:02.762915+0000 mgr.a (mgr.14373) 14656 : audit [DBG] from='client.317247 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:16:04.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:16:03 smithi047 bash[22744]: cluster 2024-09-16T11:16:02.285054+0000 mgr.a (mgr.14373) 14655 : cluster [DBG] pgmap v10164: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:16:04.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:16:03 smithi047 bash[22744]: audit 2024-09-16T11:16:02.762915+0000 mgr.a (mgr.14373) 14656 : audit [DBG] from='client.317247 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:16:06.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:16:05 smithi157 bash[24585]: cluster 2024-09-16T11:16:04.285970+0000 mgr.a (mgr.14373) 14657 : cluster [DBG] pgmap v10165: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-16T11:16:06.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:16:05 smithi086 bash[24289]: cluster 2024-09-16T11:16:04.285970+0000 mgr.a (mgr.14373) 14657 : cluster [DBG] pgmap v10165: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-16T11:16:06.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:16:05 smithi047 bash[22744]: cluster 2024-09-16T11:16:04.285970+0000 mgr.a (mgr.14373) 14657 : cluster [DBG] pgmap v10165: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-16T11:16:08.183 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:16:08.184 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:16:08.184 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:16:08.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:16:07 smithi157 bash[24585]: cluster 2024-09-16T11:16:06.286794+0000 mgr.a (mgr.14373) 14658 : cluster [DBG] pgmap v10166: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-16T11:16:08.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:16:07 smithi086 bash[24289]: cluster 2024-09-16T11:16:06.286794+0000 mgr.a (mgr.14373) 14658 : cluster [DBG] pgmap v10166: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-16T11:16:08.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:16:07 smithi047 bash[22744]: cluster 2024-09-16T11:16:06.286794+0000 mgr.a (mgr.14373) 14658 : cluster [DBG] pgmap v10166: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-16T11:16:08.933 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:16:08.934 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:16:08.934 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:16:08.934 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:16:08.934 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:16:10.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:16:09 smithi157 bash[24585]: cluster 2024-09-16T11:16:08.287895+0000 mgr.a (mgr.14373) 14659 : cluster [DBG] pgmap v10167: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-16T11:16:10.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:16:09 smithi157 bash[24585]: audit 2024-09-16T11:16:08.511627+0000 mgr.a (mgr.14373) 14660 : audit [DBG] from='client.317325 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:16:10.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:16:09 smithi086 bash[24289]: cluster 2024-09-16T11:16:08.287895+0000 mgr.a (mgr.14373) 14659 : cluster [DBG] pgmap v10167: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-16T11:16:10.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:16:09 smithi086 bash[24289]: audit 2024-09-16T11:16:08.511627+0000 mgr.a (mgr.14373) 14660 : audit [DBG] from='client.317325 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:16:10.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:16:09 smithi047 bash[22744]: cluster 2024-09-16T11:16:08.287895+0000 mgr.a (mgr.14373) 14659 : cluster [DBG] pgmap v10167: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-16T11:16:10.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:16:09 smithi047 bash[22744]: audit 2024-09-16T11:16:08.511627+0000 mgr.a (mgr.14373) 14660 : audit [DBG] from='client.317325 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:16:12.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:16:12 smithi157 bash[24585]: cluster 2024-09-16T11:16:10.288777+0000 mgr.a (mgr.14373) 14661 : cluster [DBG] pgmap v10168: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:16:12.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:16:12 smithi086 bash[24289]: cluster 2024-09-16T11:16:10.288777+0000 mgr.a (mgr.14373) 14661 : cluster [DBG] pgmap v10168: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:16:12.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:16:12 smithi047 bash[22744]: cluster 2024-09-16T11:16:10.288777+0000 mgr.a (mgr.14373) 14661 : cluster [DBG] pgmap v10168: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:16:13.935 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:16:13.936 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:16:13.936 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:16:14.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:16:14 smithi157 bash[24585]: cluster 2024-09-16T11:16:12.291029+0000 mgr.a (mgr.14373) 14662 : cluster [DBG] pgmap v10169: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:16:14.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:16:14 smithi086 bash[24289]: cluster 2024-09-16T11:16:12.291029+0000 mgr.a (mgr.14373) 14662 : cluster [DBG] pgmap v10169: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:16:14.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:16:14 smithi047 bash[22744]: cluster 2024-09-16T11:16:12.291029+0000 mgr.a (mgr.14373) 14662 : cluster [DBG] pgmap v10169: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:16:14.719 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:16:14.719 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:16:14.719 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:16:14.719 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:16:14.720 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:16:16.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:16:16 smithi157 bash[24585]: audit 2024-09-16T11:16:14.271515+0000 mgr.a (mgr.14373) 14663 : audit [DBG] from='client.317403 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:16:16.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:16:16 smithi157 bash[24585]: cluster 2024-09-16T11:16:14.292247+0000 mgr.a (mgr.14373) 14664 : cluster [DBG] pgmap v10170: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:16:16.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:16:16 smithi086 bash[24289]: audit 2024-09-16T11:16:14.271515+0000 mgr.a (mgr.14373) 14663 : audit [DBG] from='client.317403 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:16:16.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:16:16 smithi086 bash[24289]: cluster 2024-09-16T11:16:14.292247+0000 mgr.a (mgr.14373) 14664 : cluster [DBG] pgmap v10170: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:16:16.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:16:16 smithi047 bash[22744]: audit 2024-09-16T11:16:14.271515+0000 mgr.a (mgr.14373) 14663 : audit [DBG] from='client.317403 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:16:16.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:16:16 smithi047 bash[22744]: cluster 2024-09-16T11:16:14.292247+0000 mgr.a (mgr.14373) 14664 : cluster [DBG] pgmap v10170: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:16:18.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:16:18 smithi157 bash[24585]: cluster 2024-09-16T11:16:16.293252+0000 mgr.a (mgr.14373) 14665 : cluster [DBG] pgmap v10171: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:16:18.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:16:18 smithi086 bash[24289]: cluster 2024-09-16T11:16:16.293252+0000 mgr.a (mgr.14373) 14665 : cluster [DBG] pgmap v10171: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:16:18.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:16:18 smithi047 bash[22744]: cluster 2024-09-16T11:16:16.293252+0000 mgr.a (mgr.14373) 14665 : cluster [DBG] pgmap v10171: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:16:19.720 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:16:19.721 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:16:19.721 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:16:20.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:16:20 smithi157 bash[24585]: cluster 2024-09-16T11:16:18.295514+0000 mgr.a (mgr.14373) 14666 : cluster [DBG] pgmap v10172: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:16:20.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:16:20 smithi086 bash[24289]: cluster 2024-09-16T11:16:18.295514+0000 mgr.a (mgr.14373) 14666 : cluster [DBG] pgmap v10172: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:16:20.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:16:20 smithi047 bash[22744]: cluster 2024-09-16T11:16:18.295514+0000 mgr.a (mgr.14373) 14666 : cluster [DBG] pgmap v10172: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:16:20.504 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:16:20.504 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:16:20.504 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:16:20.504 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:16:20.504 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:16:21.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:16:21 smithi157 bash[24585]: audit 2024-09-16T11:16:20.052703+0000 mgr.a (mgr.14373) 14667 : audit [DBG] from='client.317475 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:16:21.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:16:21 smithi086 bash[24289]: audit 2024-09-16T11:16:20.052703+0000 mgr.a (mgr.14373) 14667 : audit [DBG] from='client.317475 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:16:21.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:16:21 smithi047 bash[22744]: audit 2024-09-16T11:16:20.052703+0000 mgr.a (mgr.14373) 14667 : audit [DBG] from='client.317475 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:16:22.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:16:22 smithi157 bash[24585]: cluster 2024-09-16T11:16:20.296308+0000 mgr.a (mgr.14373) 14668 : cluster [DBG] pgmap v10173: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:16:22.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:16:22 smithi086 bash[24289]: cluster 2024-09-16T11:16:20.296308+0000 mgr.a (mgr.14373) 14668 : cluster [DBG] pgmap v10173: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:16:22.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:16:22 smithi047 bash[22744]: cluster 2024-09-16T11:16:20.296308+0000 mgr.a (mgr.14373) 14668 : cluster [DBG] pgmap v10173: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:16:24.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:16:24 smithi157 bash[24585]: cluster 2024-09-16T11:16:22.298686+0000 mgr.a (mgr.14373) 14669 : cluster [DBG] pgmap v10174: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:16:24.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:16:24 smithi086 bash[24289]: cluster 2024-09-16T11:16:22.298686+0000 mgr.a (mgr.14373) 14669 : cluster [DBG] pgmap v10174: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:16:24.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:16:24 smithi047 bash[22744]: cluster 2024-09-16T11:16:22.298686+0000 mgr.a (mgr.14373) 14669 : cluster [DBG] pgmap v10174: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:16:25.505 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:16:25.506 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:16:25.506 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:16:26.277 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:16:26.278 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:16:26.278 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:16:26.278 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:16:26.278 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:16:26.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:16:26 smithi157 bash[24585]: cluster 2024-09-16T11:16:24.299418+0000 mgr.a (mgr.14373) 14670 : cluster [DBG] pgmap v10175: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:16:26.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:16:26 smithi086 bash[24289]: cluster 2024-09-16T11:16:24.299418+0000 mgr.a (mgr.14373) 14670 : cluster [DBG] pgmap v10175: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:16:26.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:16:26 smithi047 bash[22744]: cluster 2024-09-16T11:16:24.299418+0000 mgr.a (mgr.14373) 14670 : cluster [DBG] pgmap v10175: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:16:27.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:16:27 smithi157 bash[24585]: audit 2024-09-16T11:16:25.839782+0000 mgr.a (mgr.14373) 14671 : audit [DBG] from='client.317553 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:16:27.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:16:27 smithi086 bash[24289]: audit 2024-09-16T11:16:25.839782+0000 mgr.a (mgr.14373) 14671 : audit [DBG] from='client.317553 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:16:27.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:16:27 smithi047 bash[22744]: audit 2024-09-16T11:16:25.839782+0000 mgr.a (mgr.14373) 14671 : audit [DBG] from='client.317553 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:16:28.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:16:28 smithi157 bash[24585]: cluster 2024-09-16T11:16:26.300042+0000 mgr.a (mgr.14373) 14672 : cluster [DBG] pgmap v10176: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:16:28.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:16:28 smithi086 bash[24289]: cluster 2024-09-16T11:16:26.300042+0000 mgr.a (mgr.14373) 14672 : cluster [DBG] pgmap v10176: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:16:28.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:16:28 smithi047 bash[22744]: cluster 2024-09-16T11:16:26.300042+0000 mgr.a (mgr.14373) 14672 : cluster [DBG] pgmap v10176: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:16:30.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:16:30 smithi086 bash[24289]: cluster 2024-09-16T11:16:28.302223+0000 mgr.a (mgr.14373) 14673 : cluster [DBG] pgmap v10177: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:16:30.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:16:30 smithi047 bash[22744]: cluster 2024-09-16T11:16:28.302223+0000 mgr.a (mgr.14373) 14673 : cluster [DBG] pgmap v10177: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:16:30.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:16:30 smithi157 bash[24585]: cluster 2024-09-16T11:16:28.302223+0000 mgr.a (mgr.14373) 14673 : cluster [DBG] pgmap v10177: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:16:31.279 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:16:31.280 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:16:31.280 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:16:32.050 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:16:32.050 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:16:32.050 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:16:32.050 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:16:32.050 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:16:32.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:16:32 smithi086 bash[24289]: cluster 2024-09-16T11:16:30.303024+0000 mgr.a (mgr.14373) 14674 : cluster [DBG] pgmap v10178: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:16:32.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:16:32 smithi047 bash[22744]: cluster 2024-09-16T11:16:30.303024+0000 mgr.a (mgr.14373) 14674 : cluster [DBG] pgmap v10178: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:16:32.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:16:32 smithi157 bash[24585]: cluster 2024-09-16T11:16:30.303024+0000 mgr.a (mgr.14373) 14674 : cluster [DBG] pgmap v10178: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:16:33.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:16:33 smithi086 bash[24289]: audit 2024-09-16T11:16:31.615656+0000 mgr.a (mgr.14373) 14675 : audit [DBG] from='client.317628 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:16:33.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:16:33 smithi047 bash[22744]: audit 2024-09-16T11:16:31.615656+0000 mgr.a (mgr.14373) 14675 : audit [DBG] from='client.317628 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:16:33.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:16:33 smithi157 bash[24585]: audit 2024-09-16T11:16:31.615656+0000 mgr.a (mgr.14373) 14675 : audit [DBG] from='client.317628 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:16:34.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:16:34 smithi047 bash[22744]: cluster 2024-09-16T11:16:32.305717+0000 mgr.a (mgr.14373) 14676 : cluster [DBG] pgmap v10179: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:16:34.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:16:34 smithi157 bash[24585]: cluster 2024-09-16T11:16:32.305717+0000 mgr.a (mgr.14373) 14676 : cluster [DBG] pgmap v10179: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:16:34.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:16:34 smithi086 bash[24289]: cluster 2024-09-16T11:16:32.305717+0000 mgr.a (mgr.14373) 14676 : cluster [DBG] pgmap v10179: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:16:36.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:16:36 smithi047 bash[22744]: cluster 2024-09-16T11:16:34.306569+0000 mgr.a (mgr.14373) 14677 : cluster [DBG] pgmap v10180: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:16:36.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:16:36 smithi157 bash[24585]: cluster 2024-09-16T11:16:34.306569+0000 mgr.a (mgr.14373) 14677 : cluster [DBG] pgmap v10180: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:16:36.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:16:36 smithi086 bash[24289]: cluster 2024-09-16T11:16:34.306569+0000 mgr.a (mgr.14373) 14677 : cluster [DBG] pgmap v10180: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:16:37.051 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:16:37.052 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:16:37.052 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:16:37.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:16:37 smithi157 bash[24585]: cluster 2024-09-16T11:16:36.307315+0000 mgr.a (mgr.14373) 14678 : cluster [DBG] pgmap v10181: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T11:16:37.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:16:37 smithi086 bash[24289]: cluster 2024-09-16T11:16:36.307315+0000 mgr.a (mgr.14373) 14678 : cluster [DBG] pgmap v10181: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T11:16:37.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:16:37 smithi047 bash[22744]: cluster 2024-09-16T11:16:36.307315+0000 mgr.a (mgr.14373) 14678 : cluster [DBG] pgmap v10181: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T11:16:37.815 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:16:37.815 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:16:37.815 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:16:37.815 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:16:37.816 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:16:38.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:16:38 smithi157 bash[24585]: audit 2024-09-16T11:16:37.380697+0000 mgr.a (mgr.14373) 14679 : audit [DBG] from='client.317706 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:16:38.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:16:38 smithi086 bash[24289]: audit 2024-09-16T11:16:37.380697+0000 mgr.a (mgr.14373) 14679 : audit [DBG] from='client.317706 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:16:38.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:16:38 smithi047 bash[22744]: audit 2024-09-16T11:16:37.380697+0000 mgr.a (mgr.14373) 14679 : audit [DBG] from='client.317706 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:16:39.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:16:39 smithi157 bash[24585]: cluster 2024-09-16T11:16:38.310162+0000 mgr.a (mgr.14373) 14680 : cluster [DBG] pgmap v10182: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:16:39.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:16:39 smithi086 bash[24289]: cluster 2024-09-16T11:16:38.310162+0000 mgr.a (mgr.14373) 14680 : cluster [DBG] pgmap v10182: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:16:39.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:16:39 smithi047 bash[22744]: cluster 2024-09-16T11:16:38.310162+0000 mgr.a (mgr.14373) 14680 : cluster [DBG] pgmap v10182: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:16:41.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:16:41 smithi157 bash[24585]: cluster 2024-09-16T11:16:40.310929+0000 mgr.a (mgr.14373) 14681 : cluster [DBG] pgmap v10183: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:16:41.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:16:41 smithi086 bash[24289]: cluster 2024-09-16T11:16:40.310929+0000 mgr.a (mgr.14373) 14681 : cluster [DBG] pgmap v10183: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:16:41.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:16:41 smithi047 bash[22744]: cluster 2024-09-16T11:16:40.310929+0000 mgr.a (mgr.14373) 14681 : cluster [DBG] pgmap v10183: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:16:42.816 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:16:42.817 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:16:42.817 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:16:43.583 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:16:43.584 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:16:43.584 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:16:43.584 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:16:43.584 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:16:43.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:16:43 smithi157 bash[24585]: cluster 2024-09-16T11:16:42.312858+0000 mgr.a (mgr.14373) 14682 : cluster [DBG] pgmap v10184: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:16:43.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:16:43 smithi086 bash[24289]: cluster 2024-09-16T11:16:42.312858+0000 mgr.a (mgr.14373) 14682 : cluster [DBG] pgmap v10184: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:16:43.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:16:43 smithi047 bash[22744]: cluster 2024-09-16T11:16:42.312858+0000 mgr.a (mgr.14373) 14682 : cluster [DBG] pgmap v10184: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:16:44.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:16:44 smithi157 bash[24585]: audit 2024-09-16T11:16:43.150971+0000 mgr.a (mgr.14373) 14683 : audit [DBG] from='client.317784 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:16:44.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:16:44 smithi086 bash[24289]: audit 2024-09-16T11:16:43.150971+0000 mgr.a (mgr.14373) 14683 : audit [DBG] from='client.317784 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:16:44.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:16:44 smithi047 bash[22744]: audit 2024-09-16T11:16:43.150971+0000 mgr.a (mgr.14373) 14683 : audit [DBG] from='client.317784 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:16:45.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:16:45 smithi157 bash[24585]: cluster 2024-09-16T11:16:44.313757+0000 mgr.a (mgr.14373) 14684 : cluster [DBG] pgmap v10185: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:16:45.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:16:45 smithi086 bash[24289]: cluster 2024-09-16T11:16:44.313757+0000 mgr.a (mgr.14373) 14684 : cluster [DBG] pgmap v10185: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:16:45.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:16:45 smithi047 bash[22744]: cluster 2024-09-16T11:16:44.313757+0000 mgr.a (mgr.14373) 14684 : cluster [DBG] pgmap v10185: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:16:47.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:16:47 smithi157 bash[24585]: cluster 2024-09-16T11:16:46.314557+0000 mgr.a (mgr.14373) 14685 : cluster [DBG] pgmap v10186: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:16:47.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:16:47 smithi086 bash[24289]: cluster 2024-09-16T11:16:46.314557+0000 mgr.a (mgr.14373) 14685 : cluster [DBG] pgmap v10186: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:16:47.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:16:47 smithi047 bash[22744]: cluster 2024-09-16T11:16:46.314557+0000 mgr.a (mgr.14373) 14685 : cluster [DBG] pgmap v10186: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:16:48.585 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:16:48.585 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:16:48.585 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:16:48.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:16:48 smithi157 bash[24585]: audit 2024-09-16T11:16:47.508510+0000 mon.b (mon.2) 1338 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T11:16:48.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:16:48 smithi157 bash[24585]: audit 2024-09-16T11:16:48.348669+0000 mon.b (mon.2) 1339 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T11:16:48.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:16:48 smithi157 bash[24585]: audit 2024-09-16T11:16:48.350725+0000 mon.b (mon.2) 1340 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T11:16:48.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:16:48 smithi157 bash[24585]: audit 2024-09-16T11:16:48.361790+0000 mon.a (mon.0) 1450 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:16:48.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:16:48 smithi157 bash[24585]: audit 2024-09-16T11:16:48.365677+0000 mon.b (mon.2) 1341 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:16:48.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:16:48 smithi086 bash[24289]: audit 2024-09-16T11:16:47.508510+0000 mon.b (mon.2) 1338 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T11:16:48.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:16:48 smithi086 bash[24289]: audit 2024-09-16T11:16:48.348669+0000 mon.b (mon.2) 1339 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T11:16:48.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:16:48 smithi086 bash[24289]: audit 2024-09-16T11:16:48.350725+0000 mon.b (mon.2) 1340 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T11:16:48.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:16:48 smithi086 bash[24289]: audit 2024-09-16T11:16:48.361790+0000 mon.a (mon.0) 1450 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:16:48.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:16:48 smithi086 bash[24289]: audit 2024-09-16T11:16:48.365677+0000 mon.b (mon.2) 1341 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:16:48.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:16:48 smithi047 bash[22744]: audit 2024-09-16T11:16:47.508510+0000 mon.b (mon.2) 1338 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T11:16:48.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:16:48 smithi047 bash[22744]: audit 2024-09-16T11:16:48.348669+0000 mon.b (mon.2) 1339 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T11:16:48.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:16:48 smithi047 bash[22744]: audit 2024-09-16T11:16:48.350725+0000 mon.b (mon.2) 1340 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T11:16:48.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:16:48 smithi047 bash[22744]: audit 2024-09-16T11:16:48.361790+0000 mon.a (mon.0) 1450 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:16:48.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:16:48 smithi047 bash[22744]: audit 2024-09-16T11:16:48.365677+0000 mon.b (mon.2) 1341 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:16:49.575 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:16:49.575 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:16:49.576 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:16:49.576 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:16:49.576 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:16:49.592 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 11:16:49 smithi047 bash[22994]: debug 2024-09-16T11:16:49.150+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T11:16:49.592 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 11:16:49 smithi047 bash[22994]: debug 2024-09-16T11:16:49.170+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T11:16:49.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:16:49 smithi047 bash[22744]: cluster 2024-09-16T11:16:48.316602+0000 mgr.a (mgr.14373) 14686 : cluster [DBG] pgmap v10187: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:16:49.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:16:49 smithi047 bash[22744]: audit 2024-09-16T11:16:48.368380+0000 mgr.a (mgr.14373) 14687 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:16:49.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:16:49 smithi047 bash[22744]: audit 2024-09-16T11:16:48.915145+0000 mgr.a (mgr.14373) 14688 : audit [DBG] from='client.317910 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:16:49.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:16:49 smithi157 bash[24585]: cluster 2024-09-16T11:16:48.316602+0000 mgr.a (mgr.14373) 14686 : cluster [DBG] pgmap v10187: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:16:49.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:16:49 smithi157 bash[24585]: audit 2024-09-16T11:16:48.368380+0000 mgr.a (mgr.14373) 14687 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:16:49.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:16:49 smithi157 bash[24585]: audit 2024-09-16T11:16:48.915145+0000 mgr.a (mgr.14373) 14688 : audit [DBG] from='client.317910 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:16:49.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:16:49 smithi086 bash[24289]: cluster 2024-09-16T11:16:48.316602+0000 mgr.a (mgr.14373) 14686 : cluster [DBG] pgmap v10187: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:16:49.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:16:49 smithi086 bash[24289]: audit 2024-09-16T11:16:48.368380+0000 mgr.a (mgr.14373) 14687 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:16:49.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:16:49 smithi086 bash[24289]: audit 2024-09-16T11:16:48.915145+0000 mgr.a (mgr.14373) 14688 : audit [DBG] from='client.317910 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:16:50.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:16:50 smithi157 bash[24585]: audit 2024-09-16T11:16:49.151639+0000 mgr.a (mgr.14373) 14689 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T11:16:50.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:16:50 smithi157 bash[24585]: cephadm 2024-09-16T11:16:49.170859+0000 mgr.a (mgr.14373) 14690 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T11:16:50.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:16:50 smithi086 bash[24289]: audit 2024-09-16T11:16:49.151639+0000 mgr.a (mgr.14373) 14689 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T11:16:50.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:16:50 smithi086 bash[24289]: cephadm 2024-09-16T11:16:49.170859+0000 mgr.a (mgr.14373) 14690 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T11:16:50.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:16:50 smithi047 bash[22744]: audit 2024-09-16T11:16:49.151639+0000 mgr.a (mgr.14373) 14689 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T11:16:50.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:16:50 smithi047 bash[22744]: cephadm 2024-09-16T11:16:49.170859+0000 mgr.a (mgr.14373) 14690 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T11:16:51.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:16:51 smithi157 bash[24585]: cluster 2024-09-16T11:16:50.317512+0000 mgr.a (mgr.14373) 14691 : cluster [DBG] pgmap v10188: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:16:51.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:16:51 smithi086 bash[24289]: cluster 2024-09-16T11:16:50.317512+0000 mgr.a (mgr.14373) 14691 : cluster [DBG] pgmap v10188: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:16:51.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:16:51 smithi047 bash[22744]: cluster 2024-09-16T11:16:50.317512+0000 mgr.a (mgr.14373) 14691 : cluster [DBG] pgmap v10188: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:16:53.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:16:53 smithi157 bash[24585]: cluster 2024-09-16T11:16:52.319701+0000 mgr.a (mgr.14373) 14692 : cluster [DBG] pgmap v10189: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:16:53.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:16:53 smithi086 bash[24289]: cluster 2024-09-16T11:16:52.319701+0000 mgr.a (mgr.14373) 14692 : cluster [DBG] pgmap v10189: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:16:53.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:16:53 smithi047 bash[22744]: cluster 2024-09-16T11:16:52.319701+0000 mgr.a (mgr.14373) 14692 : cluster [DBG] pgmap v10189: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:16:54.576 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:16:54.577 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:16:54.577 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:16:55.340 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:16:55.341 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:16:55.341 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:16:55.341 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:16:55.341 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:16:55.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:16:55 smithi157 bash[24585]: cluster 2024-09-16T11:16:54.320448+0000 mgr.a (mgr.14373) 14693 : cluster [DBG] pgmap v10190: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:16:55.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:16:55 smithi157 bash[24585]: audit 2024-09-16T11:16:54.915937+0000 mgr.a (mgr.14373) 14694 : audit [DBG] from='client.318045 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:16:55.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:16:55 smithi086 bash[24289]: cluster 2024-09-16T11:16:54.320448+0000 mgr.a (mgr.14373) 14693 : cluster [DBG] pgmap v10190: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:16:55.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:16:55 smithi086 bash[24289]: audit 2024-09-16T11:16:54.915937+0000 mgr.a (mgr.14373) 14694 : audit [DBG] from='client.318045 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:16:55.844 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:16:55 smithi047 bash[22744]: cluster 2024-09-16T11:16:54.320448+0000 mgr.a (mgr.14373) 14693 : cluster [DBG] pgmap v10190: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:16:55.844 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:16:55 smithi047 bash[22744]: audit 2024-09-16T11:16:54.915937+0000 mgr.a (mgr.14373) 14694 : audit [DBG] from='client.318045 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:16:57.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:16:57 smithi157 bash[24585]: cluster 2024-09-16T11:16:56.321503+0000 mgr.a (mgr.14373) 14695 : cluster [DBG] pgmap v10191: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:16:57.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:16:57 smithi086 bash[24289]: cluster 2024-09-16T11:16:56.321503+0000 mgr.a (mgr.14373) 14695 : cluster [DBG] pgmap v10191: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:16:57.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:16:57 smithi047 bash[22744]: cluster 2024-09-16T11:16:56.321503+0000 mgr.a (mgr.14373) 14695 : cluster [DBG] pgmap v10191: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:16:59.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:16:59 smithi157 bash[24585]: cluster 2024-09-16T11:16:58.323890+0000 mgr.a (mgr.14373) 14696 : cluster [DBG] pgmap v10192: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:16:59.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:16:59 smithi086 bash[24289]: cluster 2024-09-16T11:16:58.323890+0000 mgr.a (mgr.14373) 14696 : cluster [DBG] pgmap v10192: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:16:59.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:16:59 smithi047 bash[22744]: cluster 2024-09-16T11:16:58.323890+0000 mgr.a (mgr.14373) 14696 : cluster [DBG] pgmap v10192: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:17:00.342 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:17:00.343 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:17:00.343 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:17:01.092 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:17:01.092 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:17:01.092 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:17:01.092 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:17:01.092 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:17:01.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:17:01 smithi157 bash[24585]: cluster 2024-09-16T11:17:00.324823+0000 mgr.a (mgr.14373) 14697 : cluster [DBG] pgmap v10193: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:17:01.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:17:01 smithi157 bash[24585]: audit 2024-09-16T11:17:00.670898+0000 mgr.a (mgr.14373) 14698 : audit [DBG] from='client.318120 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:17:01.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:17:01 smithi086 bash[24289]: cluster 2024-09-16T11:17:00.324823+0000 mgr.a (mgr.14373) 14697 : cluster [DBG] pgmap v10193: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:17:01.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:17:01 smithi086 bash[24289]: audit 2024-09-16T11:17:00.670898+0000 mgr.a (mgr.14373) 14698 : audit [DBG] from='client.318120 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:17:01.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:17:01 smithi047 bash[22744]: cluster 2024-09-16T11:17:00.324823+0000 mgr.a (mgr.14373) 14697 : cluster [DBG] pgmap v10193: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:17:01.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:17:01 smithi047 bash[22744]: audit 2024-09-16T11:17:00.670898+0000 mgr.a (mgr.14373) 14698 : audit [DBG] from='client.318120 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:17:03.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:17:03 smithi157 bash[24585]: cluster 2024-09-16T11:17:02.327203+0000 mgr.a (mgr.14373) 14699 : cluster [DBG] pgmap v10194: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:17:03.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:17:03 smithi086 bash[24289]: cluster 2024-09-16T11:17:02.327203+0000 mgr.a (mgr.14373) 14699 : cluster [DBG] pgmap v10194: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:17:03.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:17:03 smithi047 bash[22744]: cluster 2024-09-16T11:17:02.327203+0000 mgr.a (mgr.14373) 14699 : cluster [DBG] pgmap v10194: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:17:05.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:17:05 smithi157 bash[24585]: cluster 2024-09-16T11:17:04.327985+0000 mgr.a (mgr.14373) 14700 : cluster [DBG] pgmap v10195: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:17:05.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:17:05 smithi086 bash[24289]: cluster 2024-09-16T11:17:04.327985+0000 mgr.a (mgr.14373) 14700 : cluster [DBG] pgmap v10195: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:17:05.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:17:05 smithi047 bash[22744]: cluster 2024-09-16T11:17:04.327985+0000 mgr.a (mgr.14373) 14700 : cluster [DBG] pgmap v10195: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:17:06.093 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:17:06.094 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:17:06.094 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:17:06.854 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:17:06.854 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:17:06.854 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:17:06.855 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:17:06.855 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:17:07.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:17:07 smithi157 bash[24585]: cluster 2024-09-16T11:17:06.328841+0000 mgr.a (mgr.14373) 14701 : cluster [DBG] pgmap v10196: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:17:07.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:17:07 smithi157 bash[24585]: audit 2024-09-16T11:17:06.427815+0000 mgr.a (mgr.14373) 14702 : audit [DBG] from='client.318198 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:17:07.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:17:07 smithi086 bash[24289]: cluster 2024-09-16T11:17:06.328841+0000 mgr.a (mgr.14373) 14701 : cluster [DBG] pgmap v10196: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:17:07.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:17:07 smithi086 bash[24289]: audit 2024-09-16T11:17:06.427815+0000 mgr.a (mgr.14373) 14702 : audit [DBG] from='client.318198 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:17:07.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:17:07 smithi047 bash[22744]: cluster 2024-09-16T11:17:06.328841+0000 mgr.a (mgr.14373) 14701 : cluster [DBG] pgmap v10196: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:17:07.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:17:07 smithi047 bash[22744]: audit 2024-09-16T11:17:06.427815+0000 mgr.a (mgr.14373) 14702 : audit [DBG] from='client.318198 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:17:09.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:17:09 smithi157 bash[24585]: cluster 2024-09-16T11:17:08.331558+0000 mgr.a (mgr.14373) 14703 : cluster [DBG] pgmap v10197: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:17:09.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:17:09 smithi086 bash[24289]: cluster 2024-09-16T11:17:08.331558+0000 mgr.a (mgr.14373) 14703 : cluster [DBG] pgmap v10197: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:17:09.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:17:09 smithi047 bash[22744]: cluster 2024-09-16T11:17:08.331558+0000 mgr.a (mgr.14373) 14703 : cluster [DBG] pgmap v10197: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:17:11.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:17:11 smithi157 bash[24585]: cluster 2024-09-16T11:17:10.332313+0000 mgr.a (mgr.14373) 14704 : cluster [DBG] pgmap v10198: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:17:11.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:17:11 smithi086 bash[24289]: cluster 2024-09-16T11:17:10.332313+0000 mgr.a (mgr.14373) 14704 : cluster [DBG] pgmap v10198: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:17:11.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:17:11 smithi047 bash[22744]: cluster 2024-09-16T11:17:10.332313+0000 mgr.a (mgr.14373) 14704 : cluster [DBG] pgmap v10198: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:17:11.856 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:17:11.856 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:17:11.857 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:17:12.631 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:17:12.632 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:17:12.632 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:17:12.632 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:17:12.632 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:17:13.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:17:13 smithi157 bash[24585]: audit 2024-09-16T11:17:12.188219+0000 mgr.a (mgr.14373) 14705 : audit [DBG] from='client.318276 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:17:13.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:17:13 smithi157 bash[24585]: cluster 2024-09-16T11:17:12.333889+0000 mgr.a (mgr.14373) 14706 : cluster [DBG] pgmap v10199: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:17:13.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:17:13 smithi086 bash[24289]: audit 2024-09-16T11:17:12.188219+0000 mgr.a (mgr.14373) 14705 : audit [DBG] from='client.318276 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:17:13.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:17:13 smithi086 bash[24289]: cluster 2024-09-16T11:17:12.333889+0000 mgr.a (mgr.14373) 14706 : cluster [DBG] pgmap v10199: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:17:13.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:17:13 smithi047 bash[22744]: audit 2024-09-16T11:17:12.188219+0000 mgr.a (mgr.14373) 14705 : audit [DBG] from='client.318276 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:17:13.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:17:13 smithi047 bash[22744]: cluster 2024-09-16T11:17:12.333889+0000 mgr.a (mgr.14373) 14706 : cluster [DBG] pgmap v10199: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:17:15.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:17:15 smithi157 bash[24585]: cluster 2024-09-16T11:17:14.334797+0000 mgr.a (mgr.14373) 14707 : cluster [DBG] pgmap v10200: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:17:15.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:17:15 smithi086 bash[24289]: cluster 2024-09-16T11:17:14.334797+0000 mgr.a (mgr.14373) 14707 : cluster [DBG] pgmap v10200: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:17:15.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:17:15 smithi047 bash[22744]: cluster 2024-09-16T11:17:14.334797+0000 mgr.a (mgr.14373) 14707 : cluster [DBG] pgmap v10200: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:17:17.633 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:17:17.634 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:17:17.634 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:17:17.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:17:17 smithi157 bash[24585]: cluster 2024-09-16T11:17:16.335597+0000 mgr.a (mgr.14373) 14708 : cluster [DBG] pgmap v10201: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T11:17:17.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:17:17 smithi086 bash[24289]: cluster 2024-09-16T11:17:16.335597+0000 mgr.a (mgr.14373) 14708 : cluster [DBG] pgmap v10201: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T11:17:17.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:17:17 smithi047 bash[22744]: cluster 2024-09-16T11:17:16.335597+0000 mgr.a (mgr.14373) 14708 : cluster [DBG] pgmap v10201: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T11:17:18.381 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:17:18.381 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:17:18.381 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:17:18.381 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:17:18.381 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:17:18.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:17:18 smithi157 bash[24585]: audit 2024-09-16T11:17:17.955169+0000 mgr.a (mgr.14373) 14709 : audit [DBG] from='client.318351 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:17:18.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:17:18 smithi086 bash[24289]: audit 2024-09-16T11:17:17.955169+0000 mgr.a (mgr.14373) 14709 : audit [DBG] from='client.318351 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:17:18.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:17:18 smithi047 bash[22744]: audit 2024-09-16T11:17:17.955169+0000 mgr.a (mgr.14373) 14709 : audit [DBG] from='client.318351 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:17:19.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:17:19 smithi157 bash[24585]: cluster 2024-09-16T11:17:18.336948+0000 mgr.a (mgr.14373) 14710 : cluster [DBG] pgmap v10202: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:17:19.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:17:19 smithi086 bash[24289]: cluster 2024-09-16T11:17:18.336948+0000 mgr.a (mgr.14373) 14710 : cluster [DBG] pgmap v10202: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:17:19.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:17:19 smithi047 bash[22744]: cluster 2024-09-16T11:17:18.336948+0000 mgr.a (mgr.14373) 14710 : cluster [DBG] pgmap v10202: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:17:21.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:17:21 smithi157 bash[24585]: cluster 2024-09-16T11:17:20.337680+0000 mgr.a (mgr.14373) 14711 : cluster [DBG] pgmap v10203: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:17:21.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:17:21 smithi086 bash[24289]: cluster 2024-09-16T11:17:20.337680+0000 mgr.a (mgr.14373) 14711 : cluster [DBG] pgmap v10203: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:17:21.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:17:21 smithi047 bash[22744]: cluster 2024-09-16T11:17:20.337680+0000 mgr.a (mgr.14373) 14711 : cluster [DBG] pgmap v10203: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:17:23.382 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:17:23.383 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:17:23.383 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:17:23.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:17:23 smithi157 bash[24585]: cluster 2024-09-16T11:17:22.339650+0000 mgr.a (mgr.14373) 14712 : cluster [DBG] pgmap v10204: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:17:23.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:17:23 smithi086 bash[24289]: cluster 2024-09-16T11:17:22.339650+0000 mgr.a (mgr.14373) 14712 : cluster [DBG] pgmap v10204: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:17:23.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:17:23 smithi047 bash[22744]: cluster 2024-09-16T11:17:22.339650+0000 mgr.a (mgr.14373) 14712 : cluster [DBG] pgmap v10204: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:17:24.137 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:17:24.137 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:17:24.137 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:17:24.137 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:17:24.137 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:17:24.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:17:24 smithi157 bash[24585]: audit 2024-09-16T11:17:23.715248+0000 mgr.a (mgr.14373) 14713 : audit [DBG] from='client.318429 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:17:24.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:17:24 smithi086 bash[24289]: audit 2024-09-16T11:17:23.715248+0000 mgr.a (mgr.14373) 14713 : audit [DBG] from='client.318429 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:17:24.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:17:24 smithi047 bash[22744]: audit 2024-09-16T11:17:23.715248+0000 mgr.a (mgr.14373) 14713 : audit [DBG] from='client.318429 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:17:25.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:17:25 smithi157 bash[24585]: cluster 2024-09-16T11:17:24.340606+0000 mgr.a (mgr.14373) 14714 : cluster [DBG] pgmap v10205: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:17:25.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:17:25 smithi086 bash[24289]: cluster 2024-09-16T11:17:24.340606+0000 mgr.a (mgr.14373) 14714 : cluster [DBG] pgmap v10205: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:17:25.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:17:25 smithi047 bash[22744]: cluster 2024-09-16T11:17:24.340606+0000 mgr.a (mgr.14373) 14714 : cluster [DBG] pgmap v10205: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:17:27.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:17:27 smithi157 bash[24585]: cluster 2024-09-16T11:17:26.341519+0000 mgr.a (mgr.14373) 14715 : cluster [DBG] pgmap v10206: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:17:27.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:17:27 smithi086 bash[24289]: cluster 2024-09-16T11:17:26.341519+0000 mgr.a (mgr.14373) 14715 : cluster [DBG] pgmap v10206: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:17:27.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:17:27 smithi047 bash[22744]: cluster 2024-09-16T11:17:26.341519+0000 mgr.a (mgr.14373) 14715 : cluster [DBG] pgmap v10206: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:17:29.138 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:17:29.139 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:17:29.139 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:17:29.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:17:29 smithi157 bash[24585]: cluster 2024-09-16T11:17:28.343883+0000 mgr.a (mgr.14373) 14716 : cluster [DBG] pgmap v10207: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:17:29.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:17:29 smithi086 bash[24289]: cluster 2024-09-16T11:17:28.343883+0000 mgr.a (mgr.14373) 14716 : cluster [DBG] pgmap v10207: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:17:29.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:17:29 smithi047 bash[22744]: cluster 2024-09-16T11:17:28.343883+0000 mgr.a (mgr.14373) 14716 : cluster [DBG] pgmap v10207: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:17:29.914 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:17:29.915 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:17:29.915 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:17:29.915 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:17:29.915 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:17:30.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:17:30 smithi157 bash[24585]: audit 2024-09-16T11:17:29.474668+0000 mgr.a (mgr.14373) 14717 : audit [DBG] from='client.318504 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:17:30.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:17:30 smithi086 bash[24289]: audit 2024-09-16T11:17:29.474668+0000 mgr.a (mgr.14373) 14717 : audit [DBG] from='client.318504 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:17:30.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:17:30 smithi047 bash[22744]: audit 2024-09-16T11:17:29.474668+0000 mgr.a (mgr.14373) 14717 : audit [DBG] from='client.318504 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:17:31.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:17:31 smithi157 bash[24585]: cluster 2024-09-16T11:17:30.344781+0000 mgr.a (mgr.14373) 14718 : cluster [DBG] pgmap v10208: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:17:31.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:17:31 smithi086 bash[24289]: cluster 2024-09-16T11:17:30.344781+0000 mgr.a (mgr.14373) 14718 : cluster [DBG] pgmap v10208: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:17:31.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:17:31 smithi047 bash[22744]: cluster 2024-09-16T11:17:30.344781+0000 mgr.a (mgr.14373) 14718 : cluster [DBG] pgmap v10208: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:17:33.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:17:33 smithi157 bash[24585]: cluster 2024-09-16T11:17:32.346998+0000 mgr.a (mgr.14373) 14719 : cluster [DBG] pgmap v10209: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:17:33.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:17:33 smithi086 bash[24289]: cluster 2024-09-16T11:17:32.346998+0000 mgr.a (mgr.14373) 14719 : cluster [DBG] pgmap v10209: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:17:33.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:17:33 smithi047 bash[22744]: cluster 2024-09-16T11:17:32.346998+0000 mgr.a (mgr.14373) 14719 : cluster [DBG] pgmap v10209: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:17:34.916 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:17:34.917 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:17:34.917 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:17:35.699 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:17:35.699 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:17:35.699 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:17:35.699 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:17:35.699 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:17:35.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:17:35 smithi157 bash[24585]: cluster 2024-09-16T11:17:34.347745+0000 mgr.a (mgr.14373) 14720 : cluster [DBG] pgmap v10210: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:17:35.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:17:35 smithi086 bash[24289]: cluster 2024-09-16T11:17:34.347745+0000 mgr.a (mgr.14373) 14720 : cluster [DBG] pgmap v10210: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:17:35.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:17:35 smithi047 bash[22744]: cluster 2024-09-16T11:17:34.347745+0000 mgr.a (mgr.14373) 14720 : cluster [DBG] pgmap v10210: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:17:36.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:17:36 smithi157 bash[24585]: audit 2024-09-16T11:17:35.256167+0000 mgr.a (mgr.14373) 14721 : audit [DBG] from='client.318582 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:17:36.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:17:36 smithi086 bash[24289]: audit 2024-09-16T11:17:35.256167+0000 mgr.a (mgr.14373) 14721 : audit [DBG] from='client.318582 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:17:36.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:17:36 smithi047 bash[22744]: audit 2024-09-16T11:17:35.256167+0000 mgr.a (mgr.14373) 14721 : audit [DBG] from='client.318582 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:17:37.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:17:37 smithi157 bash[24585]: cluster 2024-09-16T11:17:36.348627+0000 mgr.a (mgr.14373) 14722 : cluster [DBG] pgmap v10211: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:17:37.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:17:37 smithi086 bash[24289]: cluster 2024-09-16T11:17:36.348627+0000 mgr.a (mgr.14373) 14722 : cluster [DBG] pgmap v10211: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:17:37.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:17:37 smithi047 bash[22744]: cluster 2024-09-16T11:17:36.348627+0000 mgr.a (mgr.14373) 14722 : cluster [DBG] pgmap v10211: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:17:39.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:17:39 smithi157 bash[24585]: cluster 2024-09-16T11:17:38.350882+0000 mgr.a (mgr.14373) 14723 : cluster [DBG] pgmap v10212: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:17:39.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:17:39 smithi086 bash[24289]: cluster 2024-09-16T11:17:38.350882+0000 mgr.a (mgr.14373) 14723 : cluster [DBG] pgmap v10212: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:17:39.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:17:39 smithi047 bash[22744]: cluster 2024-09-16T11:17:38.350882+0000 mgr.a (mgr.14373) 14723 : cluster [DBG] pgmap v10212: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:17:40.700 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:17:40.701 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:17:40.701 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:17:41.483 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:17:41.484 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:17:41.484 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:17:41.484 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:17:41.484 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:17:41.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:17:41 smithi157 bash[24585]: cluster 2024-09-16T11:17:40.351634+0000 mgr.a (mgr.14373) 14724 : cluster [DBG] pgmap v10213: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:17:41.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:17:41 smithi157 bash[24585]: audit 2024-09-16T11:17:41.035600+0000 mgr.a (mgr.14373) 14725 : audit [DBG] from='client.318660 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:17:41.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:17:41 smithi086 bash[24289]: cluster 2024-09-16T11:17:40.351634+0000 mgr.a (mgr.14373) 14724 : cluster [DBG] pgmap v10213: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:17:41.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:17:41 smithi086 bash[24289]: audit 2024-09-16T11:17:41.035600+0000 mgr.a (mgr.14373) 14725 : audit [DBG] from='client.318660 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:17:41.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:17:41 smithi047 bash[22744]: cluster 2024-09-16T11:17:40.351634+0000 mgr.a (mgr.14373) 14724 : cluster [DBG] pgmap v10213: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:17:41.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:17:41 smithi047 bash[22744]: audit 2024-09-16T11:17:41.035600+0000 mgr.a (mgr.14373) 14725 : audit [DBG] from='client.318660 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:17:43.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:17:43 smithi086 bash[24289]: cluster 2024-09-16T11:17:42.353900+0000 mgr.a (mgr.14373) 14726 : cluster [DBG] pgmap v10214: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:17:43.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:17:43 smithi047 bash[22744]: cluster 2024-09-16T11:17:42.353900+0000 mgr.a (mgr.14373) 14726 : cluster [DBG] pgmap v10214: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:17:44.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:17:43 smithi157 bash[24585]: cluster 2024-09-16T11:17:42.353900+0000 mgr.a (mgr.14373) 14726 : cluster [DBG] pgmap v10214: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:17:45.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:17:45 smithi086 bash[24289]: cluster 2024-09-16T11:17:44.354692+0000 mgr.a (mgr.14373) 14727 : cluster [DBG] pgmap v10215: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:17:45.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:17:45 smithi047 bash[22744]: cluster 2024-09-16T11:17:44.354692+0000 mgr.a (mgr.14373) 14727 : cluster [DBG] pgmap v10215: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:17:46.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:17:45 smithi157 bash[24585]: cluster 2024-09-16T11:17:44.354692+0000 mgr.a (mgr.14373) 14727 : cluster [DBG] pgmap v10215: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:17:46.485 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:17:46.486 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:17:46.486 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:17:47.241 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:17:47.241 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:17:47.241 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:17:47.241 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:17:47.241 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:17:47.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:17:47 smithi086 bash[24289]: cluster 2024-09-16T11:17:46.355443+0000 mgr.a (mgr.14373) 14728 : cluster [DBG] pgmap v10216: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:17:47.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:17:47 smithi086 bash[24289]: audit 2024-09-16T11:17:46.807488+0000 mgr.a (mgr.14373) 14729 : audit [DBG] from='client.318735 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:17:47.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:17:47 smithi047 bash[22744]: cluster 2024-09-16T11:17:46.355443+0000 mgr.a (mgr.14373) 14728 : cluster [DBG] pgmap v10216: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:17:47.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:17:47 smithi047 bash[22744]: audit 2024-09-16T11:17:46.807488+0000 mgr.a (mgr.14373) 14729 : audit [DBG] from='client.318735 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:17:48.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:17:47 smithi157 bash[24585]: cluster 2024-09-16T11:17:46.355443+0000 mgr.a (mgr.14373) 14728 : cluster [DBG] pgmap v10216: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:17:48.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:17:47 smithi157 bash[24585]: audit 2024-09-16T11:17:46.807488+0000 mgr.a (mgr.14373) 14729 : audit [DBG] from='client.318735 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:17:49.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:17:49 smithi047 bash[22744]: cluster 2024-09-16T11:17:48.358082+0000 mgr.a (mgr.14373) 14730 : cluster [DBG] pgmap v10217: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:17:49.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:17:49 smithi047 bash[22744]: audit 2024-09-16T11:17:49.231719+0000 mon.b (mon.2) 1342 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T11:17:50.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:17:49 smithi157 bash[24585]: cluster 2024-09-16T11:17:48.358082+0000 mgr.a (mgr.14373) 14730 : cluster [DBG] pgmap v10217: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:17:50.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:17:49 smithi157 bash[24585]: audit 2024-09-16T11:17:49.231719+0000 mon.b (mon.2) 1342 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T11:17:50.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:17:49 smithi086 bash[24289]: cluster 2024-09-16T11:17:48.358082+0000 mgr.a (mgr.14373) 14730 : cluster [DBG] pgmap v10217: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:17:50.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:17:49 smithi086 bash[24289]: audit 2024-09-16T11:17:49.231719+0000 mon.b (mon.2) 1342 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T11:17:50.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:17:50 smithi047 bash[22744]: audit 2024-09-16T11:17:50.076012+0000 mon.b (mon.2) 1343 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T11:17:50.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:17:50 smithi047 bash[22744]: audit 2024-09-16T11:17:50.077659+0000 mon.b (mon.2) 1344 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T11:17:50.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:17:50 smithi047 bash[22744]: audit 2024-09-16T11:17:50.088012+0000 mon.a (mon.0) 1451 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:17:50.839 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:17:50 smithi047 bash[22744]: audit 2024-09-16T11:17:50.091661+0000 mon.b (mon.2) 1345 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:17:51.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:17:50 smithi157 bash[24585]: audit 2024-09-16T11:17:50.076012+0000 mon.b (mon.2) 1343 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T11:17:51.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:17:50 smithi157 bash[24585]: audit 2024-09-16T11:17:50.077659+0000 mon.b (mon.2) 1344 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T11:17:51.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:17:50 smithi157 bash[24585]: audit 2024-09-16T11:17:50.088012+0000 mon.a (mon.0) 1451 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:17:51.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:17:50 smithi157 bash[24585]: audit 2024-09-16T11:17:50.091661+0000 mon.b (mon.2) 1345 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:17:51.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:17:50 smithi086 bash[24289]: audit 2024-09-16T11:17:50.076012+0000 mon.b (mon.2) 1343 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T11:17:51.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:17:50 smithi086 bash[24289]: audit 2024-09-16T11:17:50.077659+0000 mon.b (mon.2) 1344 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T11:17:51.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:17:50 smithi086 bash[24289]: audit 2024-09-16T11:17:50.088012+0000 mon.a (mon.0) 1451 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:17:51.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:17:50 smithi086 bash[24289]: audit 2024-09-16T11:17:50.091661+0000 mon.b (mon.2) 1345 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:17:51.092 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 11:17:50 smithi047 bash[22994]: debug 2024-09-16T11:17:50.832+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T11:17:51.093 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 11:17:50 smithi047 bash[22994]: debug 2024-09-16T11:17:50.836+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T11:17:52.243 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:17:52.244 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:17:52.244 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:17:52.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:17:52 smithi047 bash[22744]: audit 2024-09-16T11:17:50.094497+0000 mgr.a (mgr.14373) 14731 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:17:52.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:17:52 smithi047 bash[22744]: cluster 2024-09-16T11:17:50.358642+0000 mgr.a (mgr.14373) 14732 : cluster [DBG] pgmap v10218: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:17:52.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:17:52 smithi047 bash[22744]: audit 2024-09-16T11:17:50.837753+0000 mgr.a (mgr.14373) 14733 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T11:17:52.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:17:52 smithi047 bash[22744]: cephadm 2024-09-16T11:17:50.839446+0000 mgr.a (mgr.14373) 14734 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T11:17:52.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:17:52 smithi157 bash[24585]: audit 2024-09-16T11:17:50.094497+0000 mgr.a (mgr.14373) 14731 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:17:52.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:17:52 smithi157 bash[24585]: cluster 2024-09-16T11:17:50.358642+0000 mgr.a (mgr.14373) 14732 : cluster [DBG] pgmap v10218: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:17:52.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:17:52 smithi157 bash[24585]: audit 2024-09-16T11:17:50.837753+0000 mgr.a (mgr.14373) 14733 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T11:17:52.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:17:52 smithi157 bash[24585]: cephadm 2024-09-16T11:17:50.839446+0000 mgr.a (mgr.14373) 14734 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T11:17:52.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:17:52 smithi086 bash[24289]: audit 2024-09-16T11:17:50.094497+0000 mgr.a (mgr.14373) 14731 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:17:52.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:17:52 smithi086 bash[24289]: cluster 2024-09-16T11:17:50.358642+0000 mgr.a (mgr.14373) 14732 : cluster [DBG] pgmap v10218: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:17:52.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:17:52 smithi086 bash[24289]: audit 2024-09-16T11:17:50.837753+0000 mgr.a (mgr.14373) 14733 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T11:17:52.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:17:52 smithi086 bash[24289]: cephadm 2024-09-16T11:17:50.839446+0000 mgr.a (mgr.14373) 14734 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T11:17:53.015 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:17:53.016 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:17:53.016 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:17:53.016 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:17:53.016 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:17:54.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:17:54 smithi157 bash[24585]: cluster 2024-09-16T11:17:52.359656+0000 mgr.a (mgr.14373) 14735 : cluster [DBG] pgmap v10219: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:17:54.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:17:54 smithi157 bash[24585]: audit 2024-09-16T11:17:52.578200+0000 mgr.a (mgr.14373) 14736 : audit [DBG] from='client.318915 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:17:54.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:17:54 smithi086 bash[24289]: cluster 2024-09-16T11:17:52.359656+0000 mgr.a (mgr.14373) 14735 : cluster [DBG] pgmap v10219: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:17:54.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:17:54 smithi086 bash[24289]: audit 2024-09-16T11:17:52.578200+0000 mgr.a (mgr.14373) 14736 : audit [DBG] from='client.318915 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:17:54.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:17:54 smithi047 bash[22744]: cluster 2024-09-16T11:17:52.359656+0000 mgr.a (mgr.14373) 14735 : cluster [DBG] pgmap v10219: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:17:54.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:17:54 smithi047 bash[22744]: audit 2024-09-16T11:17:52.578200+0000 mgr.a (mgr.14373) 14736 : audit [DBG] from='client.318915 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:17:55.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:17:55 smithi157 bash[24585]: cluster 2024-09-16T11:17:54.360508+0000 mgr.a (mgr.14373) 14737 : cluster [DBG] pgmap v10220: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T11:17:55.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:17:55 smithi086 bash[24289]: cluster 2024-09-16T11:17:54.360508+0000 mgr.a (mgr.14373) 14737 : cluster [DBG] pgmap v10220: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T11:17:55.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:17:55 smithi047 bash[22744]: cluster 2024-09-16T11:17:54.360508+0000 mgr.a (mgr.14373) 14737 : cluster [DBG] pgmap v10220: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T11:17:57.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:17:57 smithi157 bash[24585]: cluster 2024-09-16T11:17:56.361295+0000 mgr.a (mgr.14373) 14738 : cluster [DBG] pgmap v10221: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T11:17:57.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:17:57 smithi086 bash[24289]: cluster 2024-09-16T11:17:56.361295+0000 mgr.a (mgr.14373) 14738 : cluster [DBG] pgmap v10221: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T11:17:57.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:17:57 smithi047 bash[22744]: cluster 2024-09-16T11:17:56.361295+0000 mgr.a (mgr.14373) 14738 : cluster [DBG] pgmap v10221: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T11:17:58.017 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:17:58.018 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:17:58.018 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:17:58.767 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:17:58.767 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:17:58.768 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:17:58.768 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:17:58.768 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:17:59.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:17:59 smithi157 bash[24585]: audit 2024-09-16T11:17:58.348671+0000 mgr.a (mgr.14373) 14739 : audit [DBG] from='client.318993 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:17:59.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:17:59 smithi157 bash[24585]: cluster 2024-09-16T11:17:58.365394+0000 mgr.a (mgr.14373) 14740 : cluster [DBG] pgmap v10222: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:17:59.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:17:59 smithi086 bash[24289]: audit 2024-09-16T11:17:58.348671+0000 mgr.a (mgr.14373) 14739 : audit [DBG] from='client.318993 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:17:59.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:17:59 smithi086 bash[24289]: cluster 2024-09-16T11:17:58.365394+0000 mgr.a (mgr.14373) 14740 : cluster [DBG] pgmap v10222: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:17:59.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:17:59 smithi047 bash[22744]: audit 2024-09-16T11:17:58.348671+0000 mgr.a (mgr.14373) 14739 : audit [DBG] from='client.318993 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:17:59.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:17:59 smithi047 bash[22744]: cluster 2024-09-16T11:17:58.365394+0000 mgr.a (mgr.14373) 14740 : cluster [DBG] pgmap v10222: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:18:01.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:18:01 smithi157 bash[24585]: cluster 2024-09-16T11:18:00.366292+0000 mgr.a (mgr.14373) 14741 : cluster [DBG] pgmap v10223: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:18:01.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:18:01 smithi086 bash[24289]: cluster 2024-09-16T11:18:00.366292+0000 mgr.a (mgr.14373) 14741 : cluster [DBG] pgmap v10223: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:18:01.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:18:01 smithi047 bash[22744]: cluster 2024-09-16T11:18:00.366292+0000 mgr.a (mgr.14373) 14741 : cluster [DBG] pgmap v10223: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:18:03.769 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:18:03.770 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:18:03.770 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:18:03.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:18:03 smithi157 bash[24585]: cluster 2024-09-16T11:18:02.368487+0000 mgr.a (mgr.14373) 14742 : cluster [DBG] pgmap v10224: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:18:03.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:18:03 smithi086 bash[24289]: cluster 2024-09-16T11:18:02.368487+0000 mgr.a (mgr.14373) 14742 : cluster [DBG] pgmap v10224: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:18:03.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:18:03 smithi047 bash[22744]: cluster 2024-09-16T11:18:02.368487+0000 mgr.a (mgr.14373) 14742 : cluster [DBG] pgmap v10224: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:18:04.517 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:18:04.517 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:18:04.517 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:18:04.517 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:18:04.517 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:18:05.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:18:05 smithi157 bash[24585]: audit 2024-09-16T11:18:04.100371+0000 mgr.a (mgr.14373) 14743 : audit [DBG] from='client.319071 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:18:05.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:18:05 smithi157 bash[24585]: cluster 2024-09-16T11:18:04.368999+0000 mgr.a (mgr.14373) 14744 : cluster [DBG] pgmap v10225: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:18:05.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:18:05 smithi086 bash[24289]: audit 2024-09-16T11:18:04.100371+0000 mgr.a (mgr.14373) 14743 : audit [DBG] from='client.319071 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:18:05.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:18:05 smithi086 bash[24289]: cluster 2024-09-16T11:18:04.368999+0000 mgr.a (mgr.14373) 14744 : cluster [DBG] pgmap v10225: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:18:05.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:18:05 smithi047 bash[22744]: audit 2024-09-16T11:18:04.100371+0000 mgr.a (mgr.14373) 14743 : audit [DBG] from='client.319071 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:18:05.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:18:05 smithi047 bash[22744]: cluster 2024-09-16T11:18:04.368999+0000 mgr.a (mgr.14373) 14744 : cluster [DBG] pgmap v10225: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:18:07.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:18:07 smithi157 bash[24585]: cluster 2024-09-16T11:18:06.369839+0000 mgr.a (mgr.14373) 14745 : cluster [DBG] pgmap v10226: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:18:07.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:18:07 smithi086 bash[24289]: cluster 2024-09-16T11:18:06.369839+0000 mgr.a (mgr.14373) 14745 : cluster [DBG] pgmap v10226: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:18:07.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:18:07 smithi047 bash[22744]: cluster 2024-09-16T11:18:06.369839+0000 mgr.a (mgr.14373) 14745 : cluster [DBG] pgmap v10226: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:18:09.519 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:18:09.519 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:18:09.519 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:18:09.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:18:09 smithi157 bash[24585]: cluster 2024-09-16T11:18:08.372062+0000 mgr.a (mgr.14373) 14746 : cluster [DBG] pgmap v10227: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-16T11:18:09.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:18:09 smithi086 bash[24289]: cluster 2024-09-16T11:18:08.372062+0000 mgr.a (mgr.14373) 14746 : cluster [DBG] pgmap v10227: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-16T11:18:09.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:18:09 smithi047 bash[22744]: cluster 2024-09-16T11:18:08.372062+0000 mgr.a (mgr.14373) 14746 : cluster [DBG] pgmap v10227: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-16T11:18:10.308 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:18:10.308 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:18:10.308 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:18:10.308 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:18:10.308 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:18:10.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:18:10 smithi157 bash[24585]: audit 2024-09-16T11:18:09.856895+0000 mgr.a (mgr.14373) 14747 : audit [DBG] from='client.319149 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:18:10.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:18:10 smithi086 bash[24289]: audit 2024-09-16T11:18:09.856895+0000 mgr.a (mgr.14373) 14747 : audit [DBG] from='client.319149 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:18:10.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:18:10 smithi047 bash[22744]: audit 2024-09-16T11:18:09.856895+0000 mgr.a (mgr.14373) 14747 : audit [DBG] from='client.319149 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:18:11.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:18:11 smithi157 bash[24585]: cluster 2024-09-16T11:18:10.372546+0000 mgr.a (mgr.14373) 14748 : cluster [DBG] pgmap v10228: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-16T11:18:11.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:18:11 smithi086 bash[24289]: cluster 2024-09-16T11:18:10.372546+0000 mgr.a (mgr.14373) 14748 : cluster [DBG] pgmap v10228: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-16T11:18:11.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:18:11 smithi047 bash[22744]: cluster 2024-09-16T11:18:10.372546+0000 mgr.a (mgr.14373) 14748 : cluster [DBG] pgmap v10228: 225 pgs: 225 active+clean; 589 KiB data, 209 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-16T11:18:13.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:18:13 smithi157 bash[24585]: cluster 2024-09-16T11:18:12.374697+0000 mgr.a (mgr.14373) 14749 : cluster [DBG] pgmap v10229: 225 pgs: 225 active+clean; 589 KiB data, 213 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-16T11:18:13.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:18:13 smithi086 bash[24289]: cluster 2024-09-16T11:18:12.374697+0000 mgr.a (mgr.14373) 14749 : cluster [DBG] pgmap v10229: 225 pgs: 225 active+clean; 589 KiB data, 213 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-16T11:18:13.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:18:13 smithi047 bash[22744]: cluster 2024-09-16T11:18:12.374697+0000 mgr.a (mgr.14373) 14749 : cluster [DBG] pgmap v10229: 225 pgs: 225 active+clean; 589 KiB data, 213 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-16T11:18:15.309 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:18:15.310 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:18:15.310 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:18:15.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:18:15 smithi157 bash[24585]: cluster 2024-09-16T11:18:14.375457+0000 mgr.a (mgr.14373) 14750 : cluster [DBG] pgmap v10230: 225 pgs: 225 active+clean; 589 KiB data, 213 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-16T11:18:15.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:18:15 smithi086 bash[24289]: cluster 2024-09-16T11:18:14.375457+0000 mgr.a (mgr.14373) 14750 : cluster [DBG] pgmap v10230: 225 pgs: 225 active+clean; 589 KiB data, 213 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-16T11:18:15.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:18:15 smithi047 bash[22744]: cluster 2024-09-16T11:18:14.375457+0000 mgr.a (mgr.14373) 14750 : cluster [DBG] pgmap v10230: 225 pgs: 225 active+clean; 589 KiB data, 213 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-16T11:18:16.091 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:18:16.091 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:18:16.091 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:18:16.092 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:18:16.092 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:18:16.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:18:16 smithi157 bash[24585]: audit 2024-09-16T11:18:15.642911+0000 mgr.a (mgr.14373) 14751 : audit [DBG] from='client.319227 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:18:16.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:18:16 smithi086 bash[24289]: audit 2024-09-16T11:18:15.642911+0000 mgr.a (mgr.14373) 14751 : audit [DBG] from='client.319227 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:18:16.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:18:16 smithi047 bash[22744]: audit 2024-09-16T11:18:15.642911+0000 mgr.a (mgr.14373) 14751 : audit [DBG] from='client.319227 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:18:17.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:18:17 smithi157 bash[24585]: cluster 2024-09-16T11:18:16.376405+0000 mgr.a (mgr.14373) 14752 : cluster [DBG] pgmap v10231: 225 pgs: 225 active+clean; 589 KiB data, 213 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-16T11:18:17.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:18:17 smithi086 bash[24289]: cluster 2024-09-16T11:18:16.376405+0000 mgr.a (mgr.14373) 14752 : cluster [DBG] pgmap v10231: 225 pgs: 225 active+clean; 589 KiB data, 213 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-16T11:18:17.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:18:17 smithi047 bash[22744]: cluster 2024-09-16T11:18:16.376405+0000 mgr.a (mgr.14373) 14752 : cluster [DBG] pgmap v10231: 225 pgs: 225 active+clean; 589 KiB data, 213 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-16T11:18:19.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:18:19 smithi157 bash[24585]: cluster 2024-09-16T11:18:18.378649+0000 mgr.a (mgr.14373) 14753 : cluster [DBG] pgmap v10232: 225 pgs: 225 active+clean; 589 KiB data, 213 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-16T11:18:19.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:18:19 smithi086 bash[24289]: cluster 2024-09-16T11:18:18.378649+0000 mgr.a (mgr.14373) 14753 : cluster [DBG] pgmap v10232: 225 pgs: 225 active+clean; 589 KiB data, 213 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-16T11:18:19.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:18:19 smithi047 bash[22744]: cluster 2024-09-16T11:18:18.378649+0000 mgr.a (mgr.14373) 14753 : cluster [DBG] pgmap v10232: 225 pgs: 225 active+clean; 589 KiB data, 213 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-16T11:18:21.096 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:18:21.097 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:18:21.097 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:18:21.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:18:21 smithi157 bash[24585]: cluster 2024-09-16T11:18:20.379426+0000 mgr.a (mgr.14373) 14754 : cluster [DBG] pgmap v10233: 225 pgs: 225 active+clean; 589 KiB data, 213 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:18:21.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:18:21 smithi086 bash[24289]: cluster 2024-09-16T11:18:20.379426+0000 mgr.a (mgr.14373) 14754 : cluster [DBG] pgmap v10233: 225 pgs: 225 active+clean; 589 KiB data, 213 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:18:21.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:18:21 smithi047 bash[22744]: cluster 2024-09-16T11:18:20.379426+0000 mgr.a (mgr.14373) 14754 : cluster [DBG] pgmap v10233: 225 pgs: 225 active+clean; 589 KiB data, 213 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:18:21.870 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:18:21.870 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:18:21.871 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:18:21.871 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:18:21.871 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:18:22.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:18:22 smithi157 bash[24585]: audit 2024-09-16T11:18:21.431286+0000 mgr.a (mgr.14373) 14755 : audit [DBG] from='client.319305 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:18:22.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:18:22 smithi086 bash[24289]: audit 2024-09-16T11:18:21.431286+0000 mgr.a (mgr.14373) 14755 : audit [DBG] from='client.319305 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:18:22.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:18:22 smithi047 bash[22744]: audit 2024-09-16T11:18:21.431286+0000 mgr.a (mgr.14373) 14755 : audit [DBG] from='client.319305 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:18:23.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:18:23 smithi157 bash[24585]: cluster 2024-09-16T11:18:22.382435+0000 mgr.a (mgr.14373) 14756 : cluster [DBG] pgmap v10234: 225 pgs: 225 active+clean; 589 KiB data, 213 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:18:23.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:18:23 smithi086 bash[24289]: cluster 2024-09-16T11:18:22.382435+0000 mgr.a (mgr.14373) 14756 : cluster [DBG] pgmap v10234: 225 pgs: 225 active+clean; 589 KiB data, 213 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:18:23.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:18:23 smithi047 bash[22744]: cluster 2024-09-16T11:18:22.382435+0000 mgr.a (mgr.14373) 14756 : cluster [DBG] pgmap v10234: 225 pgs: 225 active+clean; 589 KiB data, 213 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:18:25.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:18:25 smithi157 bash[24585]: cluster 2024-09-16T11:18:24.383246+0000 mgr.a (mgr.14373) 14757 : cluster [DBG] pgmap v10235: 225 pgs: 225 active+clean; 589 KiB data, 213 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:18:25.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:18:25 smithi086 bash[24289]: cluster 2024-09-16T11:18:24.383246+0000 mgr.a (mgr.14373) 14757 : cluster [DBG] pgmap v10235: 225 pgs: 225 active+clean; 589 KiB data, 213 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:18:25.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:18:25 smithi047 bash[22744]: cluster 2024-09-16T11:18:24.383246+0000 mgr.a (mgr.14373) 14757 : cluster [DBG] pgmap v10235: 225 pgs: 225 active+clean; 589 KiB data, 213 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:18:26.872 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:18:26.872 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:18:26.872 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:18:27.647 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:18:27.648 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:18:27.648 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:18:27.648 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:18:27.648 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:18:27.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:18:27 smithi157 bash[24585]: cluster 2024-09-16T11:18:26.383997+0000 mgr.a (mgr.14373) 14758 : cluster [DBG] pgmap v10236: 225 pgs: 225 active+clean; 589 KiB data, 213 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:18:27.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:18:27 smithi086 bash[24289]: cluster 2024-09-16T11:18:26.383997+0000 mgr.a (mgr.14373) 14758 : cluster [DBG] pgmap v10236: 225 pgs: 225 active+clean; 589 KiB data, 213 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:18:27.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:18:27 smithi047 bash[22744]: cluster 2024-09-16T11:18:26.383997+0000 mgr.a (mgr.14373) 14758 : cluster [DBG] pgmap v10236: 225 pgs: 225 active+clean; 589 KiB data, 213 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:18:28.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:18:28 smithi157 bash[24585]: audit 2024-09-16T11:18:27.203161+0000 mgr.a (mgr.14373) 14759 : audit [DBG] from='client.319383 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:18:28.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:18:28 smithi086 bash[24289]: audit 2024-09-16T11:18:27.203161+0000 mgr.a (mgr.14373) 14759 : audit [DBG] from='client.319383 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:18:28.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:18:28 smithi047 bash[22744]: audit 2024-09-16T11:18:27.203161+0000 mgr.a (mgr.14373) 14759 : audit [DBG] from='client.319383 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:18:29.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:18:29 smithi157 bash[24585]: cluster 2024-09-16T11:18:28.386747+0000 mgr.a (mgr.14373) 14760 : cluster [DBG] pgmap v10237: 225 pgs: 225 active+clean; 589 KiB data, 213 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:18:29.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:18:29 smithi086 bash[24289]: cluster 2024-09-16T11:18:28.386747+0000 mgr.a (mgr.14373) 14760 : cluster [DBG] pgmap v10237: 225 pgs: 225 active+clean; 589 KiB data, 213 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:18:29.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:18:29 smithi047 bash[22744]: cluster 2024-09-16T11:18:28.386747+0000 mgr.a (mgr.14373) 14760 : cluster [DBG] pgmap v10237: 225 pgs: 225 active+clean; 589 KiB data, 213 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:18:31.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:18:31 smithi157 bash[24585]: cluster 2024-09-16T11:18:30.387683+0000 mgr.a (mgr.14373) 14761 : cluster [DBG] pgmap v10238: 225 pgs: 225 active+clean; 589 KiB data, 213 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:18:31.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:18:31 smithi086 bash[24289]: cluster 2024-09-16T11:18:30.387683+0000 mgr.a (mgr.14373) 14761 : cluster [DBG] pgmap v10238: 225 pgs: 225 active+clean; 589 KiB data, 213 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:18:31.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:18:31 smithi047 bash[22744]: cluster 2024-09-16T11:18:30.387683+0000 mgr.a (mgr.14373) 14761 : cluster [DBG] pgmap v10238: 225 pgs: 225 active+clean; 589 KiB data, 213 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:18:32.649 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:18:32.650 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:18:32.650 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:18:33.439 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:18:33.439 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:18:33.439 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:18:33.440 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:18:33.440 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:18:33.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:18:33 smithi157 bash[24585]: cluster 2024-09-16T11:18:32.389686+0000 mgr.a (mgr.14373) 14762 : cluster [DBG] pgmap v10239: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 65 KiB/s rd, 0 B/s wr, 107 op/s 2024-09-16T11:18:33.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:18:33 smithi157 bash[24585]: audit 2024-09-16T11:18:32.985190+0000 mgr.a (mgr.14373) 14763 : audit [DBG] from='client.319461 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:18:33.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:18:33 smithi086 bash[24289]: cluster 2024-09-16T11:18:32.389686+0000 mgr.a (mgr.14373) 14762 : cluster [DBG] pgmap v10239: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 65 KiB/s rd, 0 B/s wr, 107 op/s 2024-09-16T11:18:33.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:18:33 smithi086 bash[24289]: audit 2024-09-16T11:18:32.985190+0000 mgr.a (mgr.14373) 14763 : audit [DBG] from='client.319461 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:18:33.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:18:33 smithi047 bash[22744]: cluster 2024-09-16T11:18:32.389686+0000 mgr.a (mgr.14373) 14762 : cluster [DBG] pgmap v10239: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 65 KiB/s rd, 0 B/s wr, 107 op/s 2024-09-16T11:18:33.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:18:33 smithi047 bash[22744]: audit 2024-09-16T11:18:32.985190+0000 mgr.a (mgr.14373) 14763 : audit [DBG] from='client.319461 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:18:35.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:18:35 smithi157 bash[24585]: cluster 2024-09-16T11:18:34.390673+0000 mgr.a (mgr.14373) 14764 : cluster [DBG] pgmap v10240: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 65 KiB/s rd, 0 B/s wr, 107 op/s 2024-09-16T11:18:35.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:18:35 smithi086 bash[24289]: cluster 2024-09-16T11:18:34.390673+0000 mgr.a (mgr.14373) 14764 : cluster [DBG] pgmap v10240: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 65 KiB/s rd, 0 B/s wr, 107 op/s 2024-09-16T11:18:35.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:18:35 smithi047 bash[22744]: cluster 2024-09-16T11:18:34.390673+0000 mgr.a (mgr.14373) 14764 : cluster [DBG] pgmap v10240: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 65 KiB/s rd, 0 B/s wr, 107 op/s 2024-09-16T11:18:37.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:18:37 smithi157 bash[24585]: cluster 2024-09-16T11:18:36.391454+0000 mgr.a (mgr.14373) 14765 : cluster [DBG] pgmap v10241: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 65 KiB/s rd, 0 B/s wr, 107 op/s 2024-09-16T11:18:37.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:18:37 smithi086 bash[24289]: cluster 2024-09-16T11:18:36.391454+0000 mgr.a (mgr.14373) 14765 : cluster [DBG] pgmap v10241: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 65 KiB/s rd, 0 B/s wr, 107 op/s 2024-09-16T11:18:37.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:18:37 smithi047 bash[22744]: cluster 2024-09-16T11:18:36.391454+0000 mgr.a (mgr.14373) 14765 : cluster [DBG] pgmap v10241: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 65 KiB/s rd, 0 B/s wr, 107 op/s 2024-09-16T11:18:38.441 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:18:38.441 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:18:38.441 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:18:39.218 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:18:39.218 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:18:39.218 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:18:39.218 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:18:39.218 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:18:39.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:18:39 smithi157 bash[24585]: cluster 2024-09-16T11:18:38.393652+0000 mgr.a (mgr.14373) 14766 : cluster [DBG] pgmap v10242: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 66 KiB/s rd, 0 B/s wr, 108 op/s 2024-09-16T11:18:39.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:18:39 smithi157 bash[24585]: audit 2024-09-16T11:18:38.779697+0000 mgr.a (mgr.14373) 14767 : audit [DBG] from='client.319533 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:18:39.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:18:39 smithi086 bash[24289]: cluster 2024-09-16T11:18:38.393652+0000 mgr.a (mgr.14373) 14766 : cluster [DBG] pgmap v10242: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 66 KiB/s rd, 0 B/s wr, 108 op/s 2024-09-16T11:18:39.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:18:39 smithi086 bash[24289]: audit 2024-09-16T11:18:38.779697+0000 mgr.a (mgr.14373) 14767 : audit [DBG] from='client.319533 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:18:39.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:18:39 smithi047 bash[22744]: cluster 2024-09-16T11:18:38.393652+0000 mgr.a (mgr.14373) 14766 : cluster [DBG] pgmap v10242: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 66 KiB/s rd, 0 B/s wr, 108 op/s 2024-09-16T11:18:39.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:18:39 smithi047 bash[22744]: audit 2024-09-16T11:18:38.779697+0000 mgr.a (mgr.14373) 14767 : audit [DBG] from='client.319533 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:18:41.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:18:41 smithi157 bash[24585]: cluster 2024-09-16T11:18:40.394662+0000 mgr.a (mgr.14373) 14768 : cluster [DBG] pgmap v10243: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 65 KiB/s rd, 0 B/s wr, 107 op/s 2024-09-16T11:18:41.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:18:41 smithi086 bash[24289]: cluster 2024-09-16T11:18:40.394662+0000 mgr.a (mgr.14373) 14768 : cluster [DBG] pgmap v10243: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 65 KiB/s rd, 0 B/s wr, 107 op/s 2024-09-16T11:18:41.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:18:41 smithi047 bash[22744]: cluster 2024-09-16T11:18:40.394662+0000 mgr.a (mgr.14373) 14768 : cluster [DBG] pgmap v10243: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 65 KiB/s rd, 0 B/s wr, 107 op/s 2024-09-16T11:18:43.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:18:43 smithi157 bash[24585]: cluster 2024-09-16T11:18:42.396952+0000 mgr.a (mgr.14373) 14769 : cluster [DBG] pgmap v10244: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 66 KiB/s rd, 0 B/s wr, 108 op/s 2024-09-16T11:18:43.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:18:43 smithi086 bash[24289]: cluster 2024-09-16T11:18:42.396952+0000 mgr.a (mgr.14373) 14769 : cluster [DBG] pgmap v10244: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 66 KiB/s rd, 0 B/s wr, 108 op/s 2024-09-16T11:18:43.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:18:43 smithi047 bash[22744]: cluster 2024-09-16T11:18:42.396952+0000 mgr.a (mgr.14373) 14769 : cluster [DBG] pgmap v10244: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 66 KiB/s rd, 0 B/s wr, 108 op/s 2024-09-16T11:18:44.220 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:18:44.220 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:18:44.220 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:18:45.000 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:18:45.001 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:18:45.001 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:18:45.001 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:18:45.001 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:18:45.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:18:45 smithi157 bash[24585]: cluster 2024-09-16T11:18:44.397485+0000 mgr.a (mgr.14373) 14770 : cluster [DBG] pgmap v10245: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:18:45.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:18:45 smithi157 bash[24585]: audit 2024-09-16T11:18:44.553737+0000 mgr.a (mgr.14373) 14771 : audit [DBG] from='client.319608 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:18:45.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:18:45 smithi086 bash[24289]: cluster 2024-09-16T11:18:44.397485+0000 mgr.a (mgr.14373) 14770 : cluster [DBG] pgmap v10245: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:18:45.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:18:45 smithi086 bash[24289]: audit 2024-09-16T11:18:44.553737+0000 mgr.a (mgr.14373) 14771 : audit [DBG] from='client.319608 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:18:45.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:18:45 smithi047 bash[22744]: cluster 2024-09-16T11:18:44.397485+0000 mgr.a (mgr.14373) 14770 : cluster [DBG] pgmap v10245: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:18:45.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:18:45 smithi047 bash[22744]: audit 2024-09-16T11:18:44.553737+0000 mgr.a (mgr.14373) 14771 : audit [DBG] from='client.319608 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:18:47.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:18:47 smithi157 bash[24585]: cluster 2024-09-16T11:18:46.398427+0000 mgr.a (mgr.14373) 14772 : cluster [DBG] pgmap v10246: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:18:47.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:18:47 smithi086 bash[24289]: cluster 2024-09-16T11:18:46.398427+0000 mgr.a (mgr.14373) 14772 : cluster [DBG] pgmap v10246: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:18:47.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:18:47 smithi047 bash[22744]: cluster 2024-09-16T11:18:46.398427+0000 mgr.a (mgr.14373) 14772 : cluster [DBG] pgmap v10246: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:18:49.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:18:49 smithi157 bash[24585]: cluster 2024-09-16T11:18:48.400581+0000 mgr.a (mgr.14373) 14773 : cluster [DBG] pgmap v10247: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:18:49.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:18:49 smithi086 bash[24289]: cluster 2024-09-16T11:18:48.400581+0000 mgr.a (mgr.14373) 14773 : cluster [DBG] pgmap v10247: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:18:49.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:18:49 smithi047 bash[22744]: cluster 2024-09-16T11:18:48.400581+0000 mgr.a (mgr.14373) 14773 : cluster [DBG] pgmap v10247: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:18:50.002 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:18:50.003 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:18:50.003 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:18:50.753 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:18:50.753 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:18:50.753 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:18:50.753 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:18:50.753 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:18:51.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:18:51 smithi157 bash[24585]: audit 2024-09-16T11:18:50.329052+0000 mgr.a (mgr.14373) 14774 : audit [DBG] from='client.319683 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:18:51.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:18:51 smithi157 bash[24585]: cluster 2024-09-16T11:18:50.401118+0000 mgr.a (mgr.14373) 14775 : cluster [DBG] pgmap v10248: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:18:51.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:18:51 smithi157 bash[24585]: audit 2024-09-16T11:18:50.890235+0000 mon.b (mon.2) 1346 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T11:18:51.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:18:51 smithi086 bash[24289]: audit 2024-09-16T11:18:50.329052+0000 mgr.a (mgr.14373) 14774 : audit [DBG] from='client.319683 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:18:51.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:18:51 smithi086 bash[24289]: cluster 2024-09-16T11:18:50.401118+0000 mgr.a (mgr.14373) 14775 : cluster [DBG] pgmap v10248: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:18:51.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:18:51 smithi086 bash[24289]: audit 2024-09-16T11:18:50.890235+0000 mon.b (mon.2) 1346 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T11:18:51.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:18:51 smithi047 bash[22744]: audit 2024-09-16T11:18:50.329052+0000 mgr.a (mgr.14373) 14774 : audit [DBG] from='client.319683 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:18:51.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:18:51 smithi047 bash[22744]: cluster 2024-09-16T11:18:50.401118+0000 mgr.a (mgr.14373) 14775 : cluster [DBG] pgmap v10248: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:18:51.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:18:51 smithi047 bash[22744]: audit 2024-09-16T11:18:50.890235+0000 mon.b (mon.2) 1346 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T11:18:52.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:18:52 smithi157 bash[24585]: audit 2024-09-16T11:18:51.720648+0000 mon.b (mon.2) 1347 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T11:18:52.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:18:52 smithi157 bash[24585]: audit 2024-09-16T11:18:51.722571+0000 mon.b (mon.2) 1348 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T11:18:52.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:18:52 smithi157 bash[24585]: audit 2024-09-16T11:18:51.733126+0000 mon.a (mon.0) 1452 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:18:52.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:18:52 smithi157 bash[24585]: audit 2024-09-16T11:18:51.736966+0000 mon.b (mon.2) 1349 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:18:52.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:18:52 smithi157 bash[24585]: audit 2024-09-16T11:18:51.739767+0000 mgr.a (mgr.14373) 14776 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:18:52.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:18:52 smithi086 bash[24289]: audit 2024-09-16T11:18:51.720648+0000 mon.b (mon.2) 1347 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T11:18:52.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:18:52 smithi086 bash[24289]: audit 2024-09-16T11:18:51.722571+0000 mon.b (mon.2) 1348 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T11:18:52.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:18:52 smithi086 bash[24289]: audit 2024-09-16T11:18:51.733126+0000 mon.a (mon.0) 1452 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:18:52.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:18:52 smithi086 bash[24289]: audit 2024-09-16T11:18:51.736966+0000 mon.b (mon.2) 1349 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:18:52.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:18:52 smithi086 bash[24289]: audit 2024-09-16T11:18:51.739767+0000 mgr.a (mgr.14373) 14776 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:18:52.842 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 11:18:52 smithi047 bash[22994]: debug 2024-09-16T11:18:52.487+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T11:18:52.842 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 11:18:52 smithi047 bash[22994]: debug 2024-09-16T11:18:52.491+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T11:18:52.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:18:52 smithi047 bash[22744]: audit 2024-09-16T11:18:51.720648+0000 mon.b (mon.2) 1347 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T11:18:52.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:18:52 smithi047 bash[22744]: audit 2024-09-16T11:18:51.722571+0000 mon.b (mon.2) 1348 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T11:18:52.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:18:52 smithi047 bash[22744]: audit 2024-09-16T11:18:51.733126+0000 mon.a (mon.0) 1452 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:18:52.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:18:52 smithi047 bash[22744]: audit 2024-09-16T11:18:51.736966+0000 mon.b (mon.2) 1349 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:18:52.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:18:52 smithi047 bash[22744]: audit 2024-09-16T11:18:51.739767+0000 mgr.a (mgr.14373) 14776 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:18:54.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:18:53 smithi157 bash[24585]: cluster 2024-09-16T11:18:52.403479+0000 mgr.a (mgr.14373) 14777 : cluster [DBG] pgmap v10249: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:18:54.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:18:53 smithi157 bash[24585]: audit 2024-09-16T11:18:52.491861+0000 mgr.a (mgr.14373) 14778 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T11:18:54.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:18:53 smithi157 bash[24585]: cephadm 2024-09-16T11:18:52.494702+0000 mgr.a (mgr.14373) 14779 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T11:18:54.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:18:53 smithi086 bash[24289]: cluster 2024-09-16T11:18:52.403479+0000 mgr.a (mgr.14373) 14777 : cluster [DBG] pgmap v10249: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:18:54.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:18:53 smithi086 bash[24289]: audit 2024-09-16T11:18:52.491861+0000 mgr.a (mgr.14373) 14778 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T11:18:54.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:18:53 smithi086 bash[24289]: cephadm 2024-09-16T11:18:52.494702+0000 mgr.a (mgr.14373) 14779 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T11:18:54.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:18:53 smithi047 bash[22744]: cluster 2024-09-16T11:18:52.403479+0000 mgr.a (mgr.14373) 14777 : cluster [DBG] pgmap v10249: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:18:54.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:18:53 smithi047 bash[22744]: audit 2024-09-16T11:18:52.491861+0000 mgr.a (mgr.14373) 14778 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T11:18:54.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:18:53 smithi047 bash[22744]: cephadm 2024-09-16T11:18:52.494702+0000 mgr.a (mgr.14373) 14779 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T11:18:55.755 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:18:55.755 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:18:55.755 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:18:56.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:18:55 smithi157 bash[24585]: cluster 2024-09-16T11:18:54.404236+0000 mgr.a (mgr.14373) 14780 : cluster [DBG] pgmap v10250: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:18:56.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:18:55 smithi086 bash[24289]: cluster 2024-09-16T11:18:54.404236+0000 mgr.a (mgr.14373) 14780 : cluster [DBG] pgmap v10250: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:18:56.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:18:55 smithi047 bash[22744]: cluster 2024-09-16T11:18:54.404236+0000 mgr.a (mgr.14373) 14780 : cluster [DBG] pgmap v10250: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:18:56.525 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:18:56.525 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:18:56.525 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:18:56.525 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:18:56.525 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:18:57.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:18:56 smithi157 bash[24585]: audit 2024-09-16T11:18:56.084428+0000 mgr.a (mgr.14373) 14781 : audit [DBG] from='client.319863 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:18:57.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:18:56 smithi086 bash[24289]: audit 2024-09-16T11:18:56.084428+0000 mgr.a (mgr.14373) 14781 : audit [DBG] from='client.319863 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:18:57.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:18:56 smithi047 bash[22744]: audit 2024-09-16T11:18:56.084428+0000 mgr.a (mgr.14373) 14781 : audit [DBG] from='client.319863 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:18:58.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:18:57 smithi157 bash[24585]: cluster 2024-09-16T11:18:56.404800+0000 mgr.a (mgr.14373) 14782 : cluster [DBG] pgmap v10251: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:18:58.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:18:57 smithi086 bash[24289]: cluster 2024-09-16T11:18:56.404800+0000 mgr.a (mgr.14373) 14782 : cluster [DBG] pgmap v10251: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:18:58.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:18:57 smithi047 bash[22744]: cluster 2024-09-16T11:18:56.404800+0000 mgr.a (mgr.14373) 14782 : cluster [DBG] pgmap v10251: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:19:00.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:18:59 smithi157 bash[24585]: cluster 2024-09-16T11:18:58.407263+0000 mgr.a (mgr.14373) 14783 : cluster [DBG] pgmap v10252: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:19:00.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:18:59 smithi086 bash[24289]: cluster 2024-09-16T11:18:58.407263+0000 mgr.a (mgr.14373) 14783 : cluster [DBG] pgmap v10252: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:19:00.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:18:59 smithi047 bash[22744]: cluster 2024-09-16T11:18:58.407263+0000 mgr.a (mgr.14373) 14783 : cluster [DBG] pgmap v10252: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:19:01.526 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:19:01.527 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:19:01.527 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:19:02.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:19:01 smithi157 bash[24585]: cluster 2024-09-16T11:19:00.408238+0000 mgr.a (mgr.14373) 14784 : cluster [DBG] pgmap v10253: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:19:02.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:19:01 smithi086 bash[24289]: cluster 2024-09-16T11:19:00.408238+0000 mgr.a (mgr.14373) 14784 : cluster [DBG] pgmap v10253: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:19:02.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:19:01 smithi047 bash[22744]: cluster 2024-09-16T11:19:00.408238+0000 mgr.a (mgr.14373) 14784 : cluster [DBG] pgmap v10253: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:19:02.274 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:19:02.274 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:19:02.274 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:19:02.274 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:19:02.274 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:19:03.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:19:02 smithi157 bash[24585]: audit 2024-09-16T11:19:01.851490+0000 mgr.a (mgr.14373) 14785 : audit [DBG] from='client.319938 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:19:03.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:19:02 smithi086 bash[24289]: audit 2024-09-16T11:19:01.851490+0000 mgr.a (mgr.14373) 14785 : audit [DBG] from='client.319938 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:19:03.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:19:02 smithi047 bash[22744]: audit 2024-09-16T11:19:01.851490+0000 mgr.a (mgr.14373) 14785 : audit [DBG] from='client.319938 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:19:04.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:19:03 smithi157 bash[24585]: cluster 2024-09-16T11:19:02.411080+0000 mgr.a (mgr.14373) 14786 : cluster [DBG] pgmap v10254: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:19:04.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:19:03 smithi086 bash[24289]: cluster 2024-09-16T11:19:02.411080+0000 mgr.a (mgr.14373) 14786 : cluster [DBG] pgmap v10254: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:19:04.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:19:03 smithi047 bash[22744]: cluster 2024-09-16T11:19:02.411080+0000 mgr.a (mgr.14373) 14786 : cluster [DBG] pgmap v10254: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:19:06.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:19:05 smithi157 bash[24585]: cluster 2024-09-16T11:19:04.411882+0000 mgr.a (mgr.14373) 14787 : cluster [DBG] pgmap v10255: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T11:19:06.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:19:05 smithi086 bash[24289]: cluster 2024-09-16T11:19:04.411882+0000 mgr.a (mgr.14373) 14787 : cluster [DBG] pgmap v10255: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T11:19:06.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:19:05 smithi047 bash[22744]: cluster 2024-09-16T11:19:04.411882+0000 mgr.a (mgr.14373) 14787 : cluster [DBG] pgmap v10255: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T11:19:07.275 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:19:07.276 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:19:07.276 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:19:08.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:19:07 smithi157 bash[24585]: cluster 2024-09-16T11:19:06.412652+0000 mgr.a (mgr.14373) 14788 : cluster [DBG] pgmap v10256: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T11:19:08.063 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:19:08.064 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:19:08.064 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:19:08.064 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:19:08.064 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:19:08.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:19:07 smithi086 bash[24289]: cluster 2024-09-16T11:19:06.412652+0000 mgr.a (mgr.14373) 14788 : cluster [DBG] pgmap v10256: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T11:19:08.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:19:07 smithi047 bash[22744]: cluster 2024-09-16T11:19:06.412652+0000 mgr.a (mgr.14373) 14788 : cluster [DBG] pgmap v10256: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T11:19:09.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:19:08 smithi157 bash[24585]: audit 2024-09-16T11:19:07.612108+0000 mgr.a (mgr.14373) 14789 : audit [DBG] from='client.320016 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:19:09.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:19:08 smithi086 bash[24289]: audit 2024-09-16T11:19:07.612108+0000 mgr.a (mgr.14373) 14789 : audit [DBG] from='client.320016 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:19:09.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:19:08 smithi047 bash[22744]: audit 2024-09-16T11:19:07.612108+0000 mgr.a (mgr.14373) 14789 : audit [DBG] from='client.320016 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:19:10.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:19:09 smithi157 bash[24585]: cluster 2024-09-16T11:19:08.415637+0000 mgr.a (mgr.14373) 14790 : cluster [DBG] pgmap v10257: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:19:10.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:19:09 smithi086 bash[24289]: cluster 2024-09-16T11:19:08.415637+0000 mgr.a (mgr.14373) 14790 : cluster [DBG] pgmap v10257: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:19:10.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:19:09 smithi047 bash[22744]: cluster 2024-09-16T11:19:08.415637+0000 mgr.a (mgr.14373) 14790 : cluster [DBG] pgmap v10257: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:19:12.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:19:11 smithi157 bash[24585]: cluster 2024-09-16T11:19:10.416622+0000 mgr.a (mgr.14373) 14791 : cluster [DBG] pgmap v10258: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:19:12.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:19:11 smithi086 bash[24289]: cluster 2024-09-16T11:19:10.416622+0000 mgr.a (mgr.14373) 14791 : cluster [DBG] pgmap v10258: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:19:12.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:19:11 smithi047 bash[22744]: cluster 2024-09-16T11:19:10.416622+0000 mgr.a (mgr.14373) 14791 : cluster [DBG] pgmap v10258: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:19:13.065 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:19:13.066 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:19:13.066 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:19:13.793 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:19:13.794 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:19:13.794 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:19:13.794 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:19:13.794 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:19:14.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:19:13 smithi157 bash[24585]: cluster 2024-09-16T11:19:12.418825+0000 mgr.a (mgr.14373) 14792 : cluster [DBG] pgmap v10259: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:19:14.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:19:13 smithi086 bash[24289]: cluster 2024-09-16T11:19:12.418825+0000 mgr.a (mgr.14373) 14792 : cluster [DBG] pgmap v10259: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:19:14.095 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:19:13 smithi047 bash[22744]: cluster 2024-09-16T11:19:12.418825+0000 mgr.a (mgr.14373) 14792 : cluster [DBG] pgmap v10259: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:19:15.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:19:14 smithi157 bash[24585]: audit 2024-09-16T11:19:13.381556+0000 mgr.a (mgr.14373) 14793 : audit [DBG] from='client.320091 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:19:15.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:19:14 smithi086 bash[24289]: audit 2024-09-16T11:19:13.381556+0000 mgr.a (mgr.14373) 14793 : audit [DBG] from='client.320091 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:19:15.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:19:14 smithi047 bash[22744]: audit 2024-09-16T11:19:13.381556+0000 mgr.a (mgr.14373) 14793 : audit [DBG] from='client.320091 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:19:16.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:19:15 smithi157 bash[24585]: cluster 2024-09-16T11:19:14.419830+0000 mgr.a (mgr.14373) 14794 : cluster [DBG] pgmap v10260: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:19:16.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:19:15 smithi086 bash[24289]: cluster 2024-09-16T11:19:14.419830+0000 mgr.a (mgr.14373) 14794 : cluster [DBG] pgmap v10260: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:19:16.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:19:15 smithi047 bash[22744]: cluster 2024-09-16T11:19:14.419830+0000 mgr.a (mgr.14373) 14794 : cluster [DBG] pgmap v10260: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:19:18.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:19:17 smithi157 bash[24585]: cluster 2024-09-16T11:19:16.420606+0000 mgr.a (mgr.14373) 14795 : cluster [DBG] pgmap v10261: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:19:18.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:19:17 smithi086 bash[24289]: cluster 2024-09-16T11:19:16.420606+0000 mgr.a (mgr.14373) 14795 : cluster [DBG] pgmap v10261: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:19:18.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:19:17 smithi047 bash[22744]: cluster 2024-09-16T11:19:16.420606+0000 mgr.a (mgr.14373) 14795 : cluster [DBG] pgmap v10261: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:19:18.795 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:19:18.796 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:19:18.796 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:19:19.576 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:19:19.576 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:19:19.576 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:19:19.577 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:19:19.577 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:19:20.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:19:19 smithi086 bash[24289]: cluster 2024-09-16T11:19:18.422753+0000 mgr.a (mgr.14373) 14796 : cluster [DBG] pgmap v10262: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:19:20.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:19:19 smithi047 bash[22744]: cluster 2024-09-16T11:19:18.422753+0000 mgr.a (mgr.14373) 14796 : cluster [DBG] pgmap v10262: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:19:20.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:19:19 smithi157 bash[24585]: cluster 2024-09-16T11:19:18.422753+0000 mgr.a (mgr.14373) 14796 : cluster [DBG] pgmap v10262: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:19:21.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:19:20 smithi047 bash[22744]: audit 2024-09-16T11:19:19.130766+0000 mgr.a (mgr.14373) 14797 : audit [DBG] from='client.320169 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:19:21.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:19:20 smithi157 bash[24585]: audit 2024-09-16T11:19:19.130766+0000 mgr.a (mgr.14373) 14797 : audit [DBG] from='client.320169 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:19:21.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:19:20 smithi086 bash[24289]: audit 2024-09-16T11:19:19.130766+0000 mgr.a (mgr.14373) 14797 : audit [DBG] from='client.320169 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:19:22.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:19:21 smithi047 bash[22744]: cluster 2024-09-16T11:19:20.423688+0000 mgr.a (mgr.14373) 14798 : cluster [DBG] pgmap v10263: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:19:22.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:19:21 smithi157 bash[24585]: cluster 2024-09-16T11:19:20.423688+0000 mgr.a (mgr.14373) 14798 : cluster [DBG] pgmap v10263: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:19:22.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:19:21 smithi086 bash[24289]: cluster 2024-09-16T11:19:20.423688+0000 mgr.a (mgr.14373) 14798 : cluster [DBG] pgmap v10263: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:19:24.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:19:23 smithi047 bash[22744]: cluster 2024-09-16T11:19:22.425917+0000 mgr.a (mgr.14373) 14799 : cluster [DBG] pgmap v10264: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:19:24.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:19:23 smithi157 bash[24585]: cluster 2024-09-16T11:19:22.425917+0000 mgr.a (mgr.14373) 14799 : cluster [DBG] pgmap v10264: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:19:24.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:19:23 smithi086 bash[24289]: cluster 2024-09-16T11:19:22.425917+0000 mgr.a (mgr.14373) 14799 : cluster [DBG] pgmap v10264: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:19:24.577 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:19:24.578 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:19:24.578 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:19:25.359 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:19:25.359 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:19:25.359 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:19:25.359 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:19:25.359 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:19:26.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:19:25 smithi047 bash[22744]: cluster 2024-09-16T11:19:24.426717+0000 mgr.a (mgr.14373) 14800 : cluster [DBG] pgmap v10265: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:19:26.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:19:25 smithi047 bash[22744]: audit 2024-09-16T11:19:24.910577+0000 mgr.a (mgr.14373) 14801 : audit [DBG] from='client.320247 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:19:26.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:19:25 smithi157 bash[24585]: cluster 2024-09-16T11:19:24.426717+0000 mgr.a (mgr.14373) 14800 : cluster [DBG] pgmap v10265: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:19:26.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:19:25 smithi157 bash[24585]: audit 2024-09-16T11:19:24.910577+0000 mgr.a (mgr.14373) 14801 : audit [DBG] from='client.320247 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:19:26.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:19:25 smithi086 bash[24289]: cluster 2024-09-16T11:19:24.426717+0000 mgr.a (mgr.14373) 14800 : cluster [DBG] pgmap v10265: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:19:26.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:19:25 smithi086 bash[24289]: audit 2024-09-16T11:19:24.910577+0000 mgr.a (mgr.14373) 14801 : audit [DBG] from='client.320247 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:19:28.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:19:27 smithi047 bash[22744]: cluster 2024-09-16T11:19:26.427659+0000 mgr.a (mgr.14373) 14802 : cluster [DBG] pgmap v10266: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:19:28.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:19:27 smithi157 bash[24585]: cluster 2024-09-16T11:19:26.427659+0000 mgr.a (mgr.14373) 14802 : cluster [DBG] pgmap v10266: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:19:28.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:19:27 smithi086 bash[24289]: cluster 2024-09-16T11:19:26.427659+0000 mgr.a (mgr.14373) 14802 : cluster [DBG] pgmap v10266: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:19:30.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:19:29 smithi047 bash[22744]: cluster 2024-09-16T11:19:28.429862+0000 mgr.a (mgr.14373) 14803 : cluster [DBG] pgmap v10267: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:19:30.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:19:29 smithi157 bash[24585]: cluster 2024-09-16T11:19:28.429862+0000 mgr.a (mgr.14373) 14803 : cluster [DBG] pgmap v10267: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:19:30.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:19:29 smithi086 bash[24289]: cluster 2024-09-16T11:19:28.429862+0000 mgr.a (mgr.14373) 14803 : cluster [DBG] pgmap v10267: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:19:30.360 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:19:30.361 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:19:30.361 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:19:31.093 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:19:31.094 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:19:31.094 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:19:31.094 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:19:31.094 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:19:32.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:19:31 smithi157 bash[24585]: cluster 2024-09-16T11:19:30.430407+0000 mgr.a (mgr.14373) 14804 : cluster [DBG] pgmap v10268: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:19:32.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:19:31 smithi157 bash[24585]: audit 2024-09-16T11:19:30.683628+0000 mgr.a (mgr.14373) 14805 : audit [DBG] from='client.320325 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:19:32.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:19:31 smithi086 bash[24289]: cluster 2024-09-16T11:19:30.430407+0000 mgr.a (mgr.14373) 14804 : cluster [DBG] pgmap v10268: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:19:32.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:19:31 smithi086 bash[24289]: audit 2024-09-16T11:19:30.683628+0000 mgr.a (mgr.14373) 14805 : audit [DBG] from='client.320325 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:19:32.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:19:31 smithi047 bash[22744]: cluster 2024-09-16T11:19:30.430407+0000 mgr.a (mgr.14373) 14804 : cluster [DBG] pgmap v10268: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:19:32.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:19:31 smithi047 bash[22744]: audit 2024-09-16T11:19:30.683628+0000 mgr.a (mgr.14373) 14805 : audit [DBG] from='client.320325 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:19:34.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:19:33 smithi157 bash[24585]: cluster 2024-09-16T11:19:32.432599+0000 mgr.a (mgr.14373) 14806 : cluster [DBG] pgmap v10269: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:19:34.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:19:33 smithi086 bash[24289]: cluster 2024-09-16T11:19:32.432599+0000 mgr.a (mgr.14373) 14806 : cluster [DBG] pgmap v10269: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:19:34.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:19:33 smithi047 bash[22744]: cluster 2024-09-16T11:19:32.432599+0000 mgr.a (mgr.14373) 14806 : cluster [DBG] pgmap v10269: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:19:36.095 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:19:36.095 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:19:36.096 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:19:36.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:19:35 smithi157 bash[24585]: cluster 2024-09-16T11:19:34.433390+0000 mgr.a (mgr.14373) 14807 : cluster [DBG] pgmap v10270: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:19:36.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:19:35 smithi086 bash[24289]: cluster 2024-09-16T11:19:34.433390+0000 mgr.a (mgr.14373) 14807 : cluster [DBG] pgmap v10270: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:19:36.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:19:35 smithi047 bash[22744]: cluster 2024-09-16T11:19:34.433390+0000 mgr.a (mgr.14373) 14807 : cluster [DBG] pgmap v10270: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:19:36.893 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:19:36.893 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:19:36.893 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:19:36.893 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:19:36.893 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:19:38.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:19:37 smithi157 bash[24585]: audit 2024-09-16T11:19:36.435077+0000 mgr.a (mgr.14373) 14808 : audit [DBG] from='client.320400 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:19:38.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:19:37 smithi157 bash[24585]: cluster 2024-09-16T11:19:36.435661+0000 mgr.a (mgr.14373) 14809 : cluster [DBG] pgmap v10271: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:19:38.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:19:37 smithi086 bash[24289]: audit 2024-09-16T11:19:36.435077+0000 mgr.a (mgr.14373) 14808 : audit [DBG] from='client.320400 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:19:38.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:19:37 smithi086 bash[24289]: cluster 2024-09-16T11:19:36.435661+0000 mgr.a (mgr.14373) 14809 : cluster [DBG] pgmap v10271: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:19:38.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:19:37 smithi047 bash[22744]: audit 2024-09-16T11:19:36.435077+0000 mgr.a (mgr.14373) 14808 : audit [DBG] from='client.320400 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:19:38.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:19:37 smithi047 bash[22744]: cluster 2024-09-16T11:19:36.435661+0000 mgr.a (mgr.14373) 14809 : cluster [DBG] pgmap v10271: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:19:40.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:19:39 smithi157 bash[24585]: cluster 2024-09-16T11:19:38.438292+0000 mgr.a (mgr.14373) 14810 : cluster [DBG] pgmap v10272: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:19:40.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:19:39 smithi086 bash[24289]: cluster 2024-09-16T11:19:38.438292+0000 mgr.a (mgr.14373) 14810 : cluster [DBG] pgmap v10272: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:19:40.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:19:39 smithi047 bash[22744]: cluster 2024-09-16T11:19:38.438292+0000 mgr.a (mgr.14373) 14810 : cluster [DBG] pgmap v10272: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:19:41.894 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:19:41.895 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:19:41.895 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:19:42.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:19:41 smithi157 bash[24585]: cluster 2024-09-16T11:19:40.439119+0000 mgr.a (mgr.14373) 14811 : cluster [DBG] pgmap v10273: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:19:42.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:19:41 smithi086 bash[24289]: cluster 2024-09-16T11:19:40.439119+0000 mgr.a (mgr.14373) 14811 : cluster [DBG] pgmap v10273: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:19:42.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:19:41 smithi047 bash[22744]: cluster 2024-09-16T11:19:40.439119+0000 mgr.a (mgr.14373) 14811 : cluster [DBG] pgmap v10273: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:19:42.654 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:19:42.655 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:19:42.655 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:19:42.655 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:19:42.655 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:19:44.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:19:43 smithi157 bash[24585]: audit 2024-09-16T11:19:42.225193+0000 mgr.a (mgr.14373) 14812 : audit [DBG] from='client.320478 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:19:44.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:19:43 smithi157 bash[24585]: cluster 2024-09-16T11:19:42.440345+0000 mgr.a (mgr.14373) 14813 : cluster [DBG] pgmap v10274: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:19:44.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:19:43 smithi086 bash[24289]: audit 2024-09-16T11:19:42.225193+0000 mgr.a (mgr.14373) 14812 : audit [DBG] from='client.320478 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:19:44.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:19:43 smithi086 bash[24289]: cluster 2024-09-16T11:19:42.440345+0000 mgr.a (mgr.14373) 14813 : cluster [DBG] pgmap v10274: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:19:44.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:19:43 smithi047 bash[22744]: audit 2024-09-16T11:19:42.225193+0000 mgr.a (mgr.14373) 14812 : audit [DBG] from='client.320478 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:19:44.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:19:43 smithi047 bash[22744]: cluster 2024-09-16T11:19:42.440345+0000 mgr.a (mgr.14373) 14813 : cluster [DBG] pgmap v10274: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:19:46.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:19:45 smithi157 bash[24585]: cluster 2024-09-16T11:19:44.441232+0000 mgr.a (mgr.14373) 14814 : cluster [DBG] pgmap v10275: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:19:46.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:19:45 smithi086 bash[24289]: cluster 2024-09-16T11:19:44.441232+0000 mgr.a (mgr.14373) 14814 : cluster [DBG] pgmap v10275: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:19:46.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:19:45 smithi047 bash[22744]: cluster 2024-09-16T11:19:44.441232+0000 mgr.a (mgr.14373) 14814 : cluster [DBG] pgmap v10275: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:19:47.656 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:19:47.657 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:19:47.657 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:19:48.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:19:47 smithi157 bash[24585]: cluster 2024-09-16T11:19:46.442014+0000 mgr.a (mgr.14373) 14815 : cluster [DBG] pgmap v10276: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:19:48.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:19:47 smithi086 bash[24289]: cluster 2024-09-16T11:19:46.442014+0000 mgr.a (mgr.14373) 14815 : cluster [DBG] pgmap v10276: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:19:48.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:19:47 smithi047 bash[22744]: cluster 2024-09-16T11:19:46.442014+0000 mgr.a (mgr.14373) 14815 : cluster [DBG] pgmap v10276: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:19:48.415 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:19:48.416 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:19:48.416 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:19:48.416 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:19:48.416 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:19:49.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:19:48 smithi157 bash[24585]: audit 2024-09-16T11:19:47.987197+0000 mgr.a (mgr.14373) 14816 : audit [DBG] from='client.320556 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:19:49.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:19:48 smithi086 bash[24289]: audit 2024-09-16T11:19:47.987197+0000 mgr.a (mgr.14373) 14816 : audit [DBG] from='client.320556 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:19:49.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:19:48 smithi047 bash[22744]: audit 2024-09-16T11:19:47.987197+0000 mgr.a (mgr.14373) 14816 : audit [DBG] from='client.320556 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:19:50.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:19:49 smithi157 bash[24585]: cluster 2024-09-16T11:19:48.443416+0000 mgr.a (mgr.14373) 14817 : cluster [DBG] pgmap v10277: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:19:50.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:19:49 smithi086 bash[24289]: cluster 2024-09-16T11:19:48.443416+0000 mgr.a (mgr.14373) 14817 : cluster [DBG] pgmap v10277: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:19:50.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:19:49 smithi047 bash[22744]: cluster 2024-09-16T11:19:48.443416+0000 mgr.a (mgr.14373) 14817 : cluster [DBG] pgmap v10277: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:19:52.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:19:51 smithi157 bash[24585]: cluster 2024-09-16T11:19:50.444166+0000 mgr.a (mgr.14373) 14818 : cluster [DBG] pgmap v10278: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:19:52.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:19:51 smithi086 bash[24289]: cluster 2024-09-16T11:19:50.444166+0000 mgr.a (mgr.14373) 14818 : cluster [DBG] pgmap v10278: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:19:52.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:19:51 smithi047 bash[22744]: cluster 2024-09-16T11:19:50.444166+0000 mgr.a (mgr.14373) 14818 : cluster [DBG] pgmap v10278: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:19:53.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:19:52 smithi157 bash[24585]: audit 2024-09-16T11:19:52.548588+0000 mon.b (mon.2) 1350 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T11:19:53.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:19:52 smithi086 bash[24289]: audit 2024-09-16T11:19:52.548588+0000 mon.b (mon.2) 1350 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T11:19:53.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:19:52 smithi047 bash[22744]: audit 2024-09-16T11:19:52.548588+0000 mon.b (mon.2) 1350 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T11:19:53.418 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:19:53.419 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:19:53.419 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:19:54.166 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:19:54.166 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:19:54.166 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:19:54.166 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:19:54.166 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:19:54.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:19:53 smithi157 bash[24585]: cluster 2024-09-16T11:19:52.446182+0000 mgr.a (mgr.14373) 14819 : cluster [DBG] pgmap v10279: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:19:54.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:19:53 smithi157 bash[24585]: audit 2024-09-16T11:19:53.177929+0000 mon.a (mon.0) 1453 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:19:54.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:19:53 smithi157 bash[24585]: audit 2024-09-16T11:19:53.183629+0000 mon.a (mon.0) 1454 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:19:54.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:19:53 smithi086 bash[24289]: cluster 2024-09-16T11:19:52.446182+0000 mgr.a (mgr.14373) 14819 : cluster [DBG] pgmap v10279: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:19:54.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:19:53 smithi086 bash[24289]: audit 2024-09-16T11:19:53.177929+0000 mon.a (mon.0) 1453 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:19:54.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:19:53 smithi086 bash[24289]: audit 2024-09-16T11:19:53.183629+0000 mon.a (mon.0) 1454 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:19:54.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:19:53 smithi047 bash[22744]: cluster 2024-09-16T11:19:52.446182+0000 mgr.a (mgr.14373) 14819 : cluster [DBG] pgmap v10279: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:19:54.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:19:53 smithi047 bash[22744]: audit 2024-09-16T11:19:53.177929+0000 mon.a (mon.0) 1453 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:19:54.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:19:53 smithi047 bash[22744]: audit 2024-09-16T11:19:53.183629+0000 mon.a (mon.0) 1454 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:19:55.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:19:54 smithi157 bash[24585]: audit 2024-09-16T11:19:53.739111+0000 mgr.a (mgr.14373) 14820 : audit [DBG] from='client.320634 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:19:55.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:19:54 smithi157 bash[24585]: audit 2024-09-16T11:19:53.976553+0000 mon.b (mon.2) 1351 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T11:19:55.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:19:54 smithi157 bash[24585]: audit 2024-09-16T11:19:53.978417+0000 mon.b (mon.2) 1352 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T11:19:55.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:19:54 smithi157 bash[24585]: audit 2024-09-16T11:19:53.985697+0000 mon.a (mon.0) 1455 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:19:55.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:19:54 smithi157 bash[24585]: audit 2024-09-16T11:19:53.991050+0000 mon.b (mon.2) 1353 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:19:55.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:19:54 smithi157 bash[24585]: audit 2024-09-16T11:19:53.994208+0000 mgr.a (mgr.14373) 14821 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:19:55.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:19:54 smithi086 bash[24289]: audit 2024-09-16T11:19:53.739111+0000 mgr.a (mgr.14373) 14820 : audit [DBG] from='client.320634 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:19:55.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:19:54 smithi086 bash[24289]: audit 2024-09-16T11:19:53.976553+0000 mon.b (mon.2) 1351 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T11:19:55.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:19:54 smithi086 bash[24289]: audit 2024-09-16T11:19:53.978417+0000 mon.b (mon.2) 1352 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T11:19:55.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:19:54 smithi086 bash[24289]: audit 2024-09-16T11:19:53.985697+0000 mon.a (mon.0) 1455 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:19:55.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:19:54 smithi086 bash[24289]: audit 2024-09-16T11:19:53.991050+0000 mon.b (mon.2) 1353 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:19:55.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:19:54 smithi086 bash[24289]: audit 2024-09-16T11:19:53.994208+0000 mgr.a (mgr.14373) 14821 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:19:55.342 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 11:19:54 smithi047 bash[22994]: debug 2024-09-16T11:19:54.862+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T11:19:55.343 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 11:19:54 smithi047 bash[22994]: debug 2024-09-16T11:19:54.866+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T11:19:55.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:19:54 smithi047 bash[22744]: audit 2024-09-16T11:19:53.739111+0000 mgr.a (mgr.14373) 14820 : audit [DBG] from='client.320634 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:19:55.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:19:54 smithi047 bash[22744]: audit 2024-09-16T11:19:53.976553+0000 mon.b (mon.2) 1351 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T11:19:55.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:19:54 smithi047 bash[22744]: audit 2024-09-16T11:19:53.978417+0000 mon.b (mon.2) 1352 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T11:19:55.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:19:54 smithi047 bash[22744]: audit 2024-09-16T11:19:53.985697+0000 mon.a (mon.0) 1455 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:19:55.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:19:54 smithi047 bash[22744]: audit 2024-09-16T11:19:53.991050+0000 mon.b (mon.2) 1353 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:19:55.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:19:54 smithi047 bash[22744]: audit 2024-09-16T11:19:53.994208+0000 mgr.a (mgr.14373) 14821 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:19:56.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:19:55 smithi157 bash[24585]: cluster 2024-09-16T11:19:54.446675+0000 mgr.a (mgr.14373) 14822 : cluster [DBG] pgmap v10280: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:19:56.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:19:55 smithi157 bash[24585]: audit 2024-09-16T11:19:54.864467+0000 mgr.a (mgr.14373) 14823 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T11:19:56.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:19:55 smithi157 bash[24585]: cephadm 2024-09-16T11:19:54.866377+0000 mgr.a (mgr.14373) 14824 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T11:19:56.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:19:55 smithi086 bash[24289]: cluster 2024-09-16T11:19:54.446675+0000 mgr.a (mgr.14373) 14822 : cluster [DBG] pgmap v10280: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:19:56.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:19:55 smithi086 bash[24289]: audit 2024-09-16T11:19:54.864467+0000 mgr.a (mgr.14373) 14823 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T11:19:56.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:19:55 smithi086 bash[24289]: cephadm 2024-09-16T11:19:54.866377+0000 mgr.a (mgr.14373) 14824 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T11:19:56.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:19:55 smithi047 bash[22744]: cluster 2024-09-16T11:19:54.446675+0000 mgr.a (mgr.14373) 14822 : cluster [DBG] pgmap v10280: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:19:56.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:19:55 smithi047 bash[22744]: audit 2024-09-16T11:19:54.864467+0000 mgr.a (mgr.14373) 14823 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T11:19:56.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:19:55 smithi047 bash[22744]: cephadm 2024-09-16T11:19:54.866377+0000 mgr.a (mgr.14373) 14824 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T11:19:58.308 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:19:57 smithi157 bash[24585]: cluster 2024-09-16T11:19:56.447562+0000 mgr.a (mgr.14373) 14825 : cluster [DBG] pgmap v10281: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:19:58.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:19:57 smithi086 bash[24289]: cluster 2024-09-16T11:19:56.447562+0000 mgr.a (mgr.14373) 14825 : cluster [DBG] pgmap v10281: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:19:58.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:19:57 smithi047 bash[22744]: cluster 2024-09-16T11:19:56.447562+0000 mgr.a (mgr.14373) 14825 : cluster [DBG] pgmap v10281: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:19:59.167 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:19:59.168 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:19:59.168 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:19:59.948 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:19:59.948 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:19:59.948 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:19:59.948 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:19:59.948 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:20:00.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:19:59 smithi157 bash[24585]: cluster 2024-09-16T11:19:58.449874+0000 mgr.a (mgr.14373) 14826 : cluster [DBG] pgmap v10282: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:20:00.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:19:59 smithi086 bash[24289]: cluster 2024-09-16T11:19:58.449874+0000 mgr.a (mgr.14373) 14826 : cluster [DBG] pgmap v10282: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:20:00.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:19:59 smithi047 bash[22744]: cluster 2024-09-16T11:19:58.449874+0000 mgr.a (mgr.14373) 14826 : cluster [DBG] pgmap v10282: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:20:01.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:20:00 smithi157 bash[24585]: audit 2024-09-16T11:19:59.502171+0000 mgr.a (mgr.14373) 14827 : audit [DBG] from='client.320817 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:20:01.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:20:00 smithi157 bash[24585]: cluster 2024-09-16T11:20:00.000095+0000 mon.a (mon.0) 1456 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-16T11:20:01.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:20:00 smithi086 bash[24289]: audit 2024-09-16T11:19:59.502171+0000 mgr.a (mgr.14373) 14827 : audit [DBG] from='client.320817 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:20:01.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:20:00 smithi086 bash[24289]: cluster 2024-09-16T11:20:00.000095+0000 mon.a (mon.0) 1456 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-16T11:20:01.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:20:00 smithi047 bash[22744]: audit 2024-09-16T11:19:59.502171+0000 mgr.a (mgr.14373) 14827 : audit [DBG] from='client.320817 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:20:01.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:20:00 smithi047 bash[22744]: cluster 2024-09-16T11:20:00.000095+0000 mon.a (mon.0) 1456 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-16T11:20:02.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:20:02 smithi157 bash[24585]: cluster 2024-09-16T11:20:00.450927+0000 mgr.a (mgr.14373) 14828 : cluster [DBG] pgmap v10283: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:20:02.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:20:02 smithi086 bash[24289]: cluster 2024-09-16T11:20:00.450927+0000 mgr.a (mgr.14373) 14828 : cluster [DBG] pgmap v10283: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:20:02.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:20:02 smithi047 bash[22744]: cluster 2024-09-16T11:20:00.450927+0000 mgr.a (mgr.14373) 14828 : cluster [DBG] pgmap v10283: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:20:04.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:20:04 smithi157 bash[24585]: cluster 2024-09-16T11:20:02.453183+0000 mgr.a (mgr.14373) 14829 : cluster [DBG] pgmap v10284: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:20:04.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:20:04 smithi086 bash[24289]: cluster 2024-09-16T11:20:02.453183+0000 mgr.a (mgr.14373) 14829 : cluster [DBG] pgmap v10284: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:20:04.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:20:04 smithi047 bash[22744]: cluster 2024-09-16T11:20:02.453183+0000 mgr.a (mgr.14373) 14829 : cluster [DBG] pgmap v10284: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:20:04.949 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:20:04.950 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:20:04.950 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:20:05.695 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:20:05.695 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:20:05.696 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:20:05.696 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:20:05.696 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:20:06.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:20:06 smithi157 bash[24585]: cluster 2024-09-16T11:20:04.453957+0000 mgr.a (mgr.14373) 14830 : cluster [DBG] pgmap v10285: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:20:06.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:20:06 smithi086 bash[24289]: cluster 2024-09-16T11:20:04.453957+0000 mgr.a (mgr.14373) 14830 : cluster [DBG] pgmap v10285: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:20:06.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:20:06 smithi047 bash[22744]: cluster 2024-09-16T11:20:04.453957+0000 mgr.a (mgr.14373) 14830 : cluster [DBG] pgmap v10285: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:20:07.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:20:07 smithi157 bash[24585]: audit 2024-09-16T11:20:05.273397+0000 mgr.a (mgr.14373) 14831 : audit [DBG] from='client.320895 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:20:07.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:20:07 smithi086 bash[24289]: audit 2024-09-16T11:20:05.273397+0000 mgr.a (mgr.14373) 14831 : audit [DBG] from='client.320895 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:20:07.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:20:07 smithi047 bash[22744]: audit 2024-09-16T11:20:05.273397+0000 mgr.a (mgr.14373) 14831 : audit [DBG] from='client.320895 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:20:08.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:20:08 smithi157 bash[24585]: cluster 2024-09-16T11:20:06.454941+0000 mgr.a (mgr.14373) 14832 : cluster [DBG] pgmap v10286: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:20:08.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:20:08 smithi086 bash[24289]: cluster 2024-09-16T11:20:06.454941+0000 mgr.a (mgr.14373) 14832 : cluster [DBG] pgmap v10286: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:20:08.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:20:08 smithi047 bash[22744]: cluster 2024-09-16T11:20:06.454941+0000 mgr.a (mgr.14373) 14832 : cluster [DBG] pgmap v10286: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:20:10.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:20:10 smithi157 bash[24585]: cluster 2024-09-16T11:20:08.457176+0000 mgr.a (mgr.14373) 14833 : cluster [DBG] pgmap v10287: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:20:10.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:20:10 smithi086 bash[24289]: cluster 2024-09-16T11:20:08.457176+0000 mgr.a (mgr.14373) 14833 : cluster [DBG] pgmap v10287: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:20:10.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:20:10 smithi047 bash[22744]: cluster 2024-09-16T11:20:08.457176+0000 mgr.a (mgr.14373) 14833 : cluster [DBG] pgmap v10287: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:20:10.697 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:20:10.697 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:20:10.698 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:20:11.449 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:20:11.449 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:20:11.449 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:20:11.449 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:20:11.449 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:20:12.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:20:12 smithi157 bash[24585]: cluster 2024-09-16T11:20:10.457998+0000 mgr.a (mgr.14373) 14834 : cluster [DBG] pgmap v10288: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:20:12.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:20:12 smithi157 bash[24585]: audit 2024-09-16T11:20:11.028045+0000 mgr.a (mgr.14373) 14835 : audit [DBG] from='client.320973 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:20:12.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:20:12 smithi086 bash[24289]: cluster 2024-09-16T11:20:10.457998+0000 mgr.a (mgr.14373) 14834 : cluster [DBG] pgmap v10288: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:20:12.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:20:12 smithi086 bash[24289]: audit 2024-09-16T11:20:11.028045+0000 mgr.a (mgr.14373) 14835 : audit [DBG] from='client.320973 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:20:12.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:20:12 smithi047 bash[22744]: cluster 2024-09-16T11:20:10.457998+0000 mgr.a (mgr.14373) 14834 : cluster [DBG] pgmap v10288: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:20:12.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:20:12 smithi047 bash[22744]: audit 2024-09-16T11:20:11.028045+0000 mgr.a (mgr.14373) 14835 : audit [DBG] from='client.320973 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:20:14.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:20:14 smithi157 bash[24585]: cluster 2024-09-16T11:20:12.460345+0000 mgr.a (mgr.14373) 14836 : cluster [DBG] pgmap v10289: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:20:14.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:20:14 smithi086 bash[24289]: cluster 2024-09-16T11:20:12.460345+0000 mgr.a (mgr.14373) 14836 : cluster [DBG] pgmap v10289: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:20:14.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:20:14 smithi047 bash[22744]: cluster 2024-09-16T11:20:12.460345+0000 mgr.a (mgr.14373) 14836 : cluster [DBG] pgmap v10289: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:20:16.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:20:16 smithi157 bash[24585]: cluster 2024-09-16T11:20:14.461149+0000 mgr.a (mgr.14373) 14837 : cluster [DBG] pgmap v10290: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:20:16.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:20:16 smithi086 bash[24289]: cluster 2024-09-16T11:20:14.461149+0000 mgr.a (mgr.14373) 14837 : cluster [DBG] pgmap v10290: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:20:16.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:20:16 smithi047 bash[22744]: cluster 2024-09-16T11:20:14.461149+0000 mgr.a (mgr.14373) 14837 : cluster [DBG] pgmap v10290: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:20:16.450 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:20:16.451 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:20:16.451 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:20:17.214 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:20:17.215 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:20:17.215 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:20:17.215 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:20:17.215 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:20:18.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:20:18 smithi157 bash[24585]: cluster 2024-09-16T11:20:16.461824+0000 mgr.a (mgr.14373) 14838 : cluster [DBG] pgmap v10291: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:20:18.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:20:18 smithi157 bash[24585]: audit 2024-09-16T11:20:16.782396+0000 mgr.a (mgr.14373) 14839 : audit [DBG] from='client.321051 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:20:18.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:20:18 smithi086 bash[24289]: cluster 2024-09-16T11:20:16.461824+0000 mgr.a (mgr.14373) 14838 : cluster [DBG] pgmap v10291: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:20:18.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:20:18 smithi086 bash[24289]: audit 2024-09-16T11:20:16.782396+0000 mgr.a (mgr.14373) 14839 : audit [DBG] from='client.321051 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:20:18.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:20:18 smithi047 bash[22744]: cluster 2024-09-16T11:20:16.461824+0000 mgr.a (mgr.14373) 14838 : cluster [DBG] pgmap v10291: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:20:18.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:20:18 smithi047 bash[22744]: audit 2024-09-16T11:20:16.782396+0000 mgr.a (mgr.14373) 14839 : audit [DBG] from='client.321051 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:20:20.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:20:20 smithi157 bash[24585]: cluster 2024-09-16T11:20:18.464668+0000 mgr.a (mgr.14373) 14840 : cluster [DBG] pgmap v10292: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:20:20.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:20:20 smithi086 bash[24289]: cluster 2024-09-16T11:20:18.464668+0000 mgr.a (mgr.14373) 14840 : cluster [DBG] pgmap v10292: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:20:20.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:20:20 smithi047 bash[22744]: cluster 2024-09-16T11:20:18.464668+0000 mgr.a (mgr.14373) 14840 : cluster [DBG] pgmap v10292: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:20:22.216 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:20:22.216 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:20:22.217 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:20:22.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:20:22 smithi086 bash[24289]: cluster 2024-09-16T11:20:20.465645+0000 mgr.a (mgr.14373) 14841 : cluster [DBG] pgmap v10293: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:20:22.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:20:22 smithi047 bash[22744]: cluster 2024-09-16T11:20:20.465645+0000 mgr.a (mgr.14373) 14841 : cluster [DBG] pgmap v10293: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:20:22.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:20:22 smithi157 bash[24585]: cluster 2024-09-16T11:20:20.465645+0000 mgr.a (mgr.14373) 14841 : cluster [DBG] pgmap v10293: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:20:23.003 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:20:23.003 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:20:23.003 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:20:23.003 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:20:23.003 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:20:24.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:20:24 smithi086 bash[24289]: cluster 2024-09-16T11:20:22.467790+0000 mgr.a (mgr.14373) 14842 : cluster [DBG] pgmap v10294: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:20:24.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:20:24 smithi086 bash[24289]: audit 2024-09-16T11:20:22.550397+0000 mgr.a (mgr.14373) 14843 : audit [DBG] from='client.321126 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:20:24.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:20:24 smithi047 bash[22744]: cluster 2024-09-16T11:20:22.467790+0000 mgr.a (mgr.14373) 14842 : cluster [DBG] pgmap v10294: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:20:24.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:20:24 smithi047 bash[22744]: audit 2024-09-16T11:20:22.550397+0000 mgr.a (mgr.14373) 14843 : audit [DBG] from='client.321126 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:20:24.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:20:24 smithi157 bash[24585]: cluster 2024-09-16T11:20:22.467790+0000 mgr.a (mgr.14373) 14842 : cluster [DBG] pgmap v10294: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:20:24.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:20:24 smithi157 bash[24585]: audit 2024-09-16T11:20:22.550397+0000 mgr.a (mgr.14373) 14843 : audit [DBG] from='client.321126 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:20:26.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:20:26 smithi086 bash[24289]: cluster 2024-09-16T11:20:24.468727+0000 mgr.a (mgr.14373) 14844 : cluster [DBG] pgmap v10295: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:20:26.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:20:26 smithi047 bash[22744]: cluster 2024-09-16T11:20:24.468727+0000 mgr.a (mgr.14373) 14844 : cluster [DBG] pgmap v10295: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:20:26.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:20:26 smithi157 bash[24585]: cluster 2024-09-16T11:20:24.468727+0000 mgr.a (mgr.14373) 14844 : cluster [DBG] pgmap v10295: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:20:28.005 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:20:28.005 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:20:28.005 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:20:28.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:20:28 smithi047 bash[22744]: cluster 2024-09-16T11:20:26.469494+0000 mgr.a (mgr.14373) 14845 : cluster [DBG] pgmap v10296: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T11:20:28.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:20:28 smithi157 bash[24585]: cluster 2024-09-16T11:20:26.469494+0000 mgr.a (mgr.14373) 14845 : cluster [DBG] pgmap v10296: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T11:20:28.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:20:28 smithi086 bash[24289]: cluster 2024-09-16T11:20:26.469494+0000 mgr.a (mgr.14373) 14845 : cluster [DBG] pgmap v10296: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T11:20:28.792 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:20:28.792 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:20:28.793 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:20:28.793 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:20:28.793 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:20:30.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:20:30 smithi047 bash[22744]: audit 2024-09-16T11:20:28.338231+0000 mgr.a (mgr.14373) 14846 : audit [DBG] from='client.321201 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:20:30.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:20:30 smithi047 bash[22744]: cluster 2024-09-16T11:20:28.471158+0000 mgr.a (mgr.14373) 14847 : cluster [DBG] pgmap v10297: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:20:30.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:20:30 smithi157 bash[24585]: audit 2024-09-16T11:20:28.338231+0000 mgr.a (mgr.14373) 14846 : audit [DBG] from='client.321201 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:20:30.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:20:30 smithi157 bash[24585]: cluster 2024-09-16T11:20:28.471158+0000 mgr.a (mgr.14373) 14847 : cluster [DBG] pgmap v10297: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:20:30.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:20:30 smithi086 bash[24289]: audit 2024-09-16T11:20:28.338231+0000 mgr.a (mgr.14373) 14846 : audit [DBG] from='client.321201 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:20:30.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:20:30 smithi086 bash[24289]: cluster 2024-09-16T11:20:28.471158+0000 mgr.a (mgr.14373) 14847 : cluster [DBG] pgmap v10297: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:20:32.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:20:32 smithi047 bash[22744]: cluster 2024-09-16T11:20:30.472056+0000 mgr.a (mgr.14373) 14848 : cluster [DBG] pgmap v10298: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:20:32.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:20:32 smithi157 bash[24585]: cluster 2024-09-16T11:20:30.472056+0000 mgr.a (mgr.14373) 14848 : cluster [DBG] pgmap v10298: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:20:32.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:20:32 smithi086 bash[24289]: cluster 2024-09-16T11:20:30.472056+0000 mgr.a (mgr.14373) 14848 : cluster [DBG] pgmap v10298: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:20:33.794 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:20:33.795 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:20:33.795 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:20:34.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:20:34 smithi047 bash[22744]: cluster 2024-09-16T11:20:32.474287+0000 mgr.a (mgr.14373) 14849 : cluster [DBG] pgmap v10299: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:20:34.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:20:34 smithi157 bash[24585]: cluster 2024-09-16T11:20:32.474287+0000 mgr.a (mgr.14373) 14849 : cluster [DBG] pgmap v10299: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:20:34.565 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:20:34.565 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:20:34.565 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:20:34.565 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:20:34.565 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:20:34.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:20:34 smithi086 bash[24289]: cluster 2024-09-16T11:20:32.474287+0000 mgr.a (mgr.14373) 14849 : cluster [DBG] pgmap v10299: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:20:36.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:20:36 smithi047 bash[22744]: audit 2024-09-16T11:20:34.131741+0000 mgr.a (mgr.14373) 14850 : audit [DBG] from='client.321276 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:20:36.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:20:36 smithi047 bash[22744]: cluster 2024-09-16T11:20:34.474904+0000 mgr.a (mgr.14373) 14851 : cluster [DBG] pgmap v10300: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:20:36.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:20:36 smithi157 bash[24585]: audit 2024-09-16T11:20:34.131741+0000 mgr.a (mgr.14373) 14850 : audit [DBG] from='client.321276 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:20:36.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:20:36 smithi157 bash[24585]: cluster 2024-09-16T11:20:34.474904+0000 mgr.a (mgr.14373) 14851 : cluster [DBG] pgmap v10300: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:20:36.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:20:36 smithi086 bash[24289]: audit 2024-09-16T11:20:34.131741+0000 mgr.a (mgr.14373) 14850 : audit [DBG] from='client.321276 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:20:36.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:20:36 smithi086 bash[24289]: cluster 2024-09-16T11:20:34.474904+0000 mgr.a (mgr.14373) 14851 : cluster [DBG] pgmap v10300: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:20:38.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:20:38 smithi157 bash[24585]: cluster 2024-09-16T11:20:36.475638+0000 mgr.a (mgr.14373) 14852 : cluster [DBG] pgmap v10301: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:20:38.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:20:38 smithi086 bash[24289]: cluster 2024-09-16T11:20:36.475638+0000 mgr.a (mgr.14373) 14852 : cluster [DBG] pgmap v10301: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:20:38.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:20:38 smithi047 bash[22744]: cluster 2024-09-16T11:20:36.475638+0000 mgr.a (mgr.14373) 14852 : cluster [DBG] pgmap v10301: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:20:39.567 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:20:39.568 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:20:39.568 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:20:40.325 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:20:40.326 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:20:40.326 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:20:40.326 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:20:40.326 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:20:40.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:20:40 smithi157 bash[24585]: cluster 2024-09-16T11:20:38.477863+0000 mgr.a (mgr.14373) 14853 : cluster [DBG] pgmap v10302: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:20:40.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:20:40 smithi086 bash[24289]: cluster 2024-09-16T11:20:38.477863+0000 mgr.a (mgr.14373) 14853 : cluster [DBG] pgmap v10302: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:20:40.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:20:40 smithi047 bash[22744]: cluster 2024-09-16T11:20:38.477863+0000 mgr.a (mgr.14373) 14853 : cluster [DBG] pgmap v10302: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:20:41.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:20:41 smithi157 bash[24585]: audit 2024-09-16T11:20:39.901458+0000 mgr.a (mgr.14373) 14854 : audit [DBG] from='client.321354 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:20:41.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:20:41 smithi086 bash[24289]: audit 2024-09-16T11:20:39.901458+0000 mgr.a (mgr.14373) 14854 : audit [DBG] from='client.321354 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:20:41.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:20:41 smithi047 bash[22744]: audit 2024-09-16T11:20:39.901458+0000 mgr.a (mgr.14373) 14854 : audit [DBG] from='client.321354 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:20:42.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:20:42 smithi157 bash[24585]: cluster 2024-09-16T11:20:40.478827+0000 mgr.a (mgr.14373) 14855 : cluster [DBG] pgmap v10303: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:20:42.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:20:42 smithi086 bash[24289]: cluster 2024-09-16T11:20:40.478827+0000 mgr.a (mgr.14373) 14855 : cluster [DBG] pgmap v10303: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:20:42.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:20:42 smithi047 bash[22744]: cluster 2024-09-16T11:20:40.478827+0000 mgr.a (mgr.14373) 14855 : cluster [DBG] pgmap v10303: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:20:44.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:20:44 smithi157 bash[24585]: cluster 2024-09-16T11:20:42.481051+0000 mgr.a (mgr.14373) 14856 : cluster [DBG] pgmap v10304: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:20:44.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:20:44 smithi086 bash[24289]: cluster 2024-09-16T11:20:42.481051+0000 mgr.a (mgr.14373) 14856 : cluster [DBG] pgmap v10304: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:20:44.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:20:44 smithi047 bash[22744]: cluster 2024-09-16T11:20:42.481051+0000 mgr.a (mgr.14373) 14856 : cluster [DBG] pgmap v10304: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:20:45.327 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:20:45.328 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:20:45.328 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:20:46.092 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:20:46.092 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:20:46.092 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:20:46.092 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:20:46.092 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:20:46.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:20:46 smithi157 bash[24585]: cluster 2024-09-16T11:20:44.481805+0000 mgr.a (mgr.14373) 14857 : cluster [DBG] pgmap v10305: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:20:46.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:20:46 smithi086 bash[24289]: cluster 2024-09-16T11:20:44.481805+0000 mgr.a (mgr.14373) 14857 : cluster [DBG] pgmap v10305: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:20:46.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:20:46 smithi047 bash[22744]: cluster 2024-09-16T11:20:44.481805+0000 mgr.a (mgr.14373) 14857 : cluster [DBG] pgmap v10305: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:20:47.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:20:47 smithi157 bash[24585]: audit 2024-09-16T11:20:45.662061+0000 mgr.a (mgr.14373) 14858 : audit [DBG] from='client.321429 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:20:47.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:20:47 smithi086 bash[24289]: audit 2024-09-16T11:20:45.662061+0000 mgr.a (mgr.14373) 14858 : audit [DBG] from='client.321429 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:20:47.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:20:47 smithi047 bash[22744]: audit 2024-09-16T11:20:45.662061+0000 mgr.a (mgr.14373) 14858 : audit [DBG] from='client.321429 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:20:48.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:20:48 smithi157 bash[24585]: cluster 2024-09-16T11:20:46.482875+0000 mgr.a (mgr.14373) 14859 : cluster [DBG] pgmap v10306: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:20:48.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:20:48 smithi086 bash[24289]: cluster 2024-09-16T11:20:46.482875+0000 mgr.a (mgr.14373) 14859 : cluster [DBG] pgmap v10306: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:20:48.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:20:48 smithi047 bash[22744]: cluster 2024-09-16T11:20:46.482875+0000 mgr.a (mgr.14373) 14859 : cluster [DBG] pgmap v10306: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:20:50.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:20:50 smithi157 bash[24585]: cluster 2024-09-16T11:20:48.485153+0000 mgr.a (mgr.14373) 14860 : cluster [DBG] pgmap v10307: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:20:50.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:20:50 smithi086 bash[24289]: cluster 2024-09-16T11:20:48.485153+0000 mgr.a (mgr.14373) 14860 : cluster [DBG] pgmap v10307: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:20:50.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:20:50 smithi047 bash[22744]: cluster 2024-09-16T11:20:48.485153+0000 mgr.a (mgr.14373) 14860 : cluster [DBG] pgmap v10307: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:20:51.093 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:20:51.094 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:20:51.094 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:20:51.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:20:51 smithi157 bash[24585]: cluster 2024-09-16T11:20:50.485922+0000 mgr.a (mgr.14373) 14861 : cluster [DBG] pgmap v10308: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:20:51.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:20:51 smithi086 bash[24289]: cluster 2024-09-16T11:20:50.485922+0000 mgr.a (mgr.14373) 14861 : cluster [DBG] pgmap v10308: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:20:51.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:20:51 smithi047 bash[22744]: cluster 2024-09-16T11:20:50.485922+0000 mgr.a (mgr.14373) 14861 : cluster [DBG] pgmap v10308: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:20:51.841 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:20:51.841 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:20:51.841 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:20:51.841 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:20:51.841 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:20:52.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:20:52 smithi157 bash[24585]: audit 2024-09-16T11:20:51.428100+0000 mgr.a (mgr.14373) 14862 : audit [DBG] from='client.321507 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:20:52.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:20:52 smithi086 bash[24289]: audit 2024-09-16T11:20:51.428100+0000 mgr.a (mgr.14373) 14862 : audit [DBG] from='client.321507 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:20:52.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:20:52 smithi047 bash[22744]: audit 2024-09-16T11:20:51.428100+0000 mgr.a (mgr.14373) 14862 : audit [DBG] from='client.321507 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:20:53.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:20:53 smithi157 bash[24585]: cluster 2024-09-16T11:20:52.488647+0000 mgr.a (mgr.14373) 14863 : cluster [DBG] pgmap v10309: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:20:53.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:20:53 smithi086 bash[24289]: cluster 2024-09-16T11:20:52.488647+0000 mgr.a (mgr.14373) 14863 : cluster [DBG] pgmap v10309: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:20:53.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:20:53 smithi047 bash[22744]: cluster 2024-09-16T11:20:52.488647+0000 mgr.a (mgr.14373) 14863 : cluster [DBG] pgmap v10309: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:20:55.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:20:55 smithi157 bash[24585]: cluster 2024-09-16T11:20:54.489411+0000 mgr.a (mgr.14373) 14864 : cluster [DBG] pgmap v10310: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:20:55.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:20:55 smithi157 bash[24585]: audit 2024-09-16T11:20:54.922228+0000 mon.b (mon.2) 1354 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T11:20:55.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:20:55 smithi157 bash[24585]: audit 2024-09-16T11:20:55.539555+0000 mon.a (mon.0) 1457 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:20:55.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:20:55 smithi086 bash[24289]: cluster 2024-09-16T11:20:54.489411+0000 mgr.a (mgr.14373) 14864 : cluster [DBG] pgmap v10310: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:20:55.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:20:55 smithi086 bash[24289]: audit 2024-09-16T11:20:54.922228+0000 mon.b (mon.2) 1354 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T11:20:55.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:20:55 smithi086 bash[24289]: audit 2024-09-16T11:20:55.539555+0000 mon.a (mon.0) 1457 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:20:55.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:20:55 smithi047 bash[22744]: cluster 2024-09-16T11:20:54.489411+0000 mgr.a (mgr.14373) 14864 : cluster [DBG] pgmap v10310: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:20:55.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:20:55 smithi047 bash[22744]: audit 2024-09-16T11:20:54.922228+0000 mon.b (mon.2) 1354 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T11:20:55.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:20:55 smithi047 bash[22744]: audit 2024-09-16T11:20:55.539555+0000 mon.a (mon.0) 1457 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:20:56.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:20:56 smithi157 bash[24585]: audit 2024-09-16T11:20:55.545270+0000 mon.a (mon.0) 1458 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:20:56.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:20:56 smithi157 bash[24585]: audit 2024-09-16T11:20:55.550722+0000 mon.a (mon.0) 1459 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:20:56.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:20:56 smithi157 bash[24585]: audit 2024-09-16T11:20:55.559376+0000 mon.a (mon.0) 1460 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:20:56.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:20:56 smithi157 bash[24585]: audit 2024-09-16T11:20:56.188498+0000 mon.b (mon.2) 1355 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T11:20:56.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:20:56 smithi157 bash[24585]: audit 2024-09-16T11:20:56.190628+0000 mon.b (mon.2) 1356 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T11:20:56.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:20:56 smithi157 bash[24585]: audit 2024-09-16T11:20:56.201866+0000 mon.a (mon.0) 1461 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:20:56.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:20:56 smithi157 bash[24585]: audit 2024-09-16T11:20:56.205439+0000 mon.b (mon.2) 1357 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:20:56.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:20:56 smithi086 bash[24289]: audit 2024-09-16T11:20:55.545270+0000 mon.a (mon.0) 1458 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:20:56.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:20:56 smithi086 bash[24289]: audit 2024-09-16T11:20:55.550722+0000 mon.a (mon.0) 1459 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:20:56.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:20:56 smithi086 bash[24289]: audit 2024-09-16T11:20:55.559376+0000 mon.a (mon.0) 1460 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:20:56.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:20:56 smithi086 bash[24289]: audit 2024-09-16T11:20:56.188498+0000 mon.b (mon.2) 1355 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T11:20:56.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:20:56 smithi086 bash[24289]: audit 2024-09-16T11:20:56.190628+0000 mon.b (mon.2) 1356 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T11:20:56.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:20:56 smithi086 bash[24289]: audit 2024-09-16T11:20:56.201866+0000 mon.a (mon.0) 1461 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:20:56.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:20:56 smithi086 bash[24289]: audit 2024-09-16T11:20:56.205439+0000 mon.b (mon.2) 1357 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:20:56.842 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:20:56.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:20:56 smithi047 bash[22744]: audit 2024-09-16T11:20:55.545270+0000 mon.a (mon.0) 1458 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:20:56.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:20:56 smithi047 bash[22744]: audit 2024-09-16T11:20:55.550722+0000 mon.a (mon.0) 1459 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:20:56.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:20:56 smithi047 bash[22744]: audit 2024-09-16T11:20:55.559376+0000 mon.a (mon.0) 1460 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:20:56.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:20:56 smithi047 bash[22744]: audit 2024-09-16T11:20:56.188498+0000 mon.b (mon.2) 1355 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T11:20:56.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:20:56 smithi047 bash[22744]: audit 2024-09-16T11:20:56.190628+0000 mon.b (mon.2) 1356 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T11:20:56.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:20:56 smithi047 bash[22744]: audit 2024-09-16T11:20:56.201866+0000 mon.a (mon.0) 1461 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:20:56.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:20:56 smithi047 bash[22744]: audit 2024-09-16T11:20:56.205439+0000 mon.b (mon.2) 1357 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:20:56.843 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:20:56.843 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:20:57.342 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 11:20:56 smithi047 bash[22994]: debug 2024-09-16T11:20:56.944+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T11:20:57.342 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 11:20:56 smithi047 bash[22994]: debug 2024-09-16T11:20:56.948+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T11:20:57.570 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:20:57.570 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:20:57.570 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:20:57.570 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:20:57.570 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:20:57.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:20:57 smithi086 bash[24289]: audit 2024-09-16T11:20:56.208198+0000 mgr.a (mgr.14373) 14865 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:20:57.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:20:57 smithi086 bash[24289]: cluster 2024-09-16T11:20:56.489927+0000 mgr.a (mgr.14373) 14866 : cluster [DBG] pgmap v10311: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T11:20:57.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:20:57 smithi086 bash[24289]: audit 2024-09-16T11:20:56.949831+0000 mgr.a (mgr.14373) 14867 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T11:20:57.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:20:57 smithi086 bash[24289]: cephadm 2024-09-16T11:20:56.951504+0000 mgr.a (mgr.14373) 14868 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T11:20:57.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:20:57 smithi047 bash[22744]: audit 2024-09-16T11:20:56.208198+0000 mgr.a (mgr.14373) 14865 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:20:57.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:20:57 smithi047 bash[22744]: cluster 2024-09-16T11:20:56.489927+0000 mgr.a (mgr.14373) 14866 : cluster [DBG] pgmap v10311: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T11:20:57.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:20:57 smithi047 bash[22744]: audit 2024-09-16T11:20:56.949831+0000 mgr.a (mgr.14373) 14867 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T11:20:57.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:20:57 smithi047 bash[22744]: cephadm 2024-09-16T11:20:56.951504+0000 mgr.a (mgr.14373) 14868 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T11:20:58.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:20:57 smithi157 bash[24585]: audit 2024-09-16T11:20:56.208198+0000 mgr.a (mgr.14373) 14865 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:20:58.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:20:57 smithi157 bash[24585]: cluster 2024-09-16T11:20:56.489927+0000 mgr.a (mgr.14373) 14866 : cluster [DBG] pgmap v10311: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T11:20:58.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:20:57 smithi157 bash[24585]: audit 2024-09-16T11:20:56.949831+0000 mgr.a (mgr.14373) 14867 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T11:20:58.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:20:57 smithi157 bash[24585]: cephadm 2024-09-16T11:20:56.951504+0000 mgr.a (mgr.14373) 14868 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T11:20:58.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:20:58 smithi086 bash[24289]: audit 2024-09-16T11:20:57.155659+0000 mgr.a (mgr.14373) 14869 : audit [DBG] from='client.321693 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:20:58.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:20:58 smithi047 bash[22744]: audit 2024-09-16T11:20:57.155659+0000 mgr.a (mgr.14373) 14869 : audit [DBG] from='client.321693 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:20:59.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:20:58 smithi157 bash[24585]: audit 2024-09-16T11:20:57.155659+0000 mgr.a (mgr.14373) 14869 : audit [DBG] from='client.321693 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:20:59.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:20:59 smithi086 bash[24289]: cluster 2024-09-16T11:20:58.492528+0000 mgr.a (mgr.14373) 14870 : cluster [DBG] pgmap v10312: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 3.4 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-16T11:20:59.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:20:59 smithi047 bash[22744]: cluster 2024-09-16T11:20:58.492528+0000 mgr.a (mgr.14373) 14870 : cluster [DBG] pgmap v10312: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 3.4 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-16T11:21:00.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:20:59 smithi157 bash[24585]: cluster 2024-09-16T11:20:58.492528+0000 mgr.a (mgr.14373) 14870 : cluster [DBG] pgmap v10312: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 3.4 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-16T11:21:01.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:21:01 smithi047 bash[22744]: cluster 2024-09-16T11:21:00.493262+0000 mgr.a (mgr.14373) 14871 : cluster [DBG] pgmap v10313: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-16T11:21:02.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:21:01 smithi157 bash[24585]: cluster 2024-09-16T11:21:00.493262+0000 mgr.a (mgr.14373) 14871 : cluster [DBG] pgmap v10313: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-16T11:21:02.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:21:01 smithi086 bash[24289]: cluster 2024-09-16T11:21:00.493262+0000 mgr.a (mgr.14373) 14871 : cluster [DBG] pgmap v10313: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-16T11:21:02.571 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:21:02.572 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:21:02.572 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:21:03.349 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:21:03.350 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:21:03.350 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:21:03.350 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:21:03.350 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:21:03.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:21:03 smithi047 bash[22744]: cluster 2024-09-16T11:21:02.495291+0000 mgr.a (mgr.14373) 14872 : cluster [DBG] pgmap v10314: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:21:03.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:21:03 smithi047 bash[22744]: audit 2024-09-16T11:21:02.905013+0000 mgr.a (mgr.14373) 14873 : audit [DBG] from='client.321771 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:21:04.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:21:03 smithi157 bash[24585]: cluster 2024-09-16T11:21:02.495291+0000 mgr.a (mgr.14373) 14872 : cluster [DBG] pgmap v10314: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:21:04.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:21:03 smithi157 bash[24585]: audit 2024-09-16T11:21:02.905013+0000 mgr.a (mgr.14373) 14873 : audit [DBG] from='client.321771 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:21:04.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:21:03 smithi086 bash[24289]: cluster 2024-09-16T11:21:02.495291+0000 mgr.a (mgr.14373) 14872 : cluster [DBG] pgmap v10314: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:21:04.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:21:03 smithi086 bash[24289]: audit 2024-09-16T11:21:02.905013+0000 mgr.a (mgr.14373) 14873 : audit [DBG] from='client.321771 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:21:05.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:21:05 smithi047 bash[22744]: cluster 2024-09-16T11:21:04.496200+0000 mgr.a (mgr.14373) 14874 : cluster [DBG] pgmap v10315: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:21:06.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:21:05 smithi157 bash[24585]: cluster 2024-09-16T11:21:04.496200+0000 mgr.a (mgr.14373) 14874 : cluster [DBG] pgmap v10315: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:21:06.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:21:05 smithi086 bash[24289]: cluster 2024-09-16T11:21:04.496200+0000 mgr.a (mgr.14373) 14874 : cluster [DBG] pgmap v10315: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:21:07.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:21:07 smithi047 bash[22744]: cluster 2024-09-16T11:21:06.496967+0000 mgr.a (mgr.14373) 14875 : cluster [DBG] pgmap v10316: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:21:08.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:21:07 smithi157 bash[24585]: cluster 2024-09-16T11:21:06.496967+0000 mgr.a (mgr.14373) 14875 : cluster [DBG] pgmap v10316: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:21:08.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:21:07 smithi086 bash[24289]: cluster 2024-09-16T11:21:06.496967+0000 mgr.a (mgr.14373) 14875 : cluster [DBG] pgmap v10316: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:21:08.351 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:21:08.352 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:21:08.352 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:21:09.134 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:21:09.134 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:21:09.134 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:21:09.134 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:21:09.134 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:21:09.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:21:09 smithi047 bash[22744]: cluster 2024-09-16T11:21:08.498397+0000 mgr.a (mgr.14373) 14876 : cluster [DBG] pgmap v10317: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:21:09.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:21:09 smithi047 bash[22744]: audit 2024-09-16T11:21:08.691872+0000 mgr.a (mgr.14373) 14877 : audit [DBG] from='client.321849 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:21:10.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:21:09 smithi157 bash[24585]: cluster 2024-09-16T11:21:08.498397+0000 mgr.a (mgr.14373) 14876 : cluster [DBG] pgmap v10317: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:21:10.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:21:09 smithi157 bash[24585]: audit 2024-09-16T11:21:08.691872+0000 mgr.a (mgr.14373) 14877 : audit [DBG] from='client.321849 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:21:10.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:21:09 smithi086 bash[24289]: cluster 2024-09-16T11:21:08.498397+0000 mgr.a (mgr.14373) 14876 : cluster [DBG] pgmap v10317: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:21:10.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:21:09 smithi086 bash[24289]: audit 2024-09-16T11:21:08.691872+0000 mgr.a (mgr.14373) 14877 : audit [DBG] from='client.321849 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:21:12.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:21:11 smithi157 bash[24585]: cluster 2024-09-16T11:21:10.499251+0000 mgr.a (mgr.14373) 14878 : cluster [DBG] pgmap v10318: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 5.4 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-16T11:21:12.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:21:11 smithi086 bash[24289]: cluster 2024-09-16T11:21:10.499251+0000 mgr.a (mgr.14373) 14878 : cluster [DBG] pgmap v10318: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 5.4 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-16T11:21:12.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:21:11 smithi047 bash[22744]: cluster 2024-09-16T11:21:10.499251+0000 mgr.a (mgr.14373) 14878 : cluster [DBG] pgmap v10318: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 5.4 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-16T11:21:14.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:21:13 smithi157 bash[24585]: cluster 2024-09-16T11:21:12.501496+0000 mgr.a (mgr.14373) 14879 : cluster [DBG] pgmap v10319: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-16T11:21:14.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:21:13 smithi086 bash[24289]: cluster 2024-09-16T11:21:12.501496+0000 mgr.a (mgr.14373) 14879 : cluster [DBG] pgmap v10319: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-16T11:21:14.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:21:13 smithi047 bash[22744]: cluster 2024-09-16T11:21:12.501496+0000 mgr.a (mgr.14373) 14879 : cluster [DBG] pgmap v10319: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-16T11:21:14.135 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:21:14.136 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:21:14.136 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:21:14.923 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:21:14.924 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:21:14.924 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:21:14.924 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:21:14.924 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:21:16.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:21:15 smithi157 bash[24585]: audit 2024-09-16T11:21:14.474798+0000 mgr.a (mgr.14373) 14880 : audit [DBG] from='client.321924 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:21:16.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:21:15 smithi157 bash[24585]: cluster 2024-09-16T11:21:14.502155+0000 mgr.a (mgr.14373) 14881 : cluster [DBG] pgmap v10320: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:21:16.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:21:15 smithi086 bash[24289]: audit 2024-09-16T11:21:14.474798+0000 mgr.a (mgr.14373) 14880 : audit [DBG] from='client.321924 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:21:16.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:21:15 smithi086 bash[24289]: cluster 2024-09-16T11:21:14.502155+0000 mgr.a (mgr.14373) 14881 : cluster [DBG] pgmap v10320: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:21:16.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:21:15 smithi047 bash[22744]: audit 2024-09-16T11:21:14.474798+0000 mgr.a (mgr.14373) 14880 : audit [DBG] from='client.321924 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:21:16.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:21:15 smithi047 bash[22744]: cluster 2024-09-16T11:21:14.502155+0000 mgr.a (mgr.14373) 14881 : cluster [DBG] pgmap v10320: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:21:18.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:21:17 smithi157 bash[24585]: cluster 2024-09-16T11:21:16.503025+0000 mgr.a (mgr.14373) 14882 : cluster [DBG] pgmap v10321: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:21:18.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:21:17 smithi086 bash[24289]: cluster 2024-09-16T11:21:16.503025+0000 mgr.a (mgr.14373) 14882 : cluster [DBG] pgmap v10321: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:21:18.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:21:17 smithi047 bash[22744]: cluster 2024-09-16T11:21:16.503025+0000 mgr.a (mgr.14373) 14882 : cluster [DBG] pgmap v10321: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:21:19.925 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:21:19.925 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:21:19.925 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:21:20.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:21:19 smithi157 bash[24585]: cluster 2024-09-16T11:21:18.505241+0000 mgr.a (mgr.14373) 14883 : cluster [DBG] pgmap v10322: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:21:20.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:21:19 smithi086 bash[24289]: cluster 2024-09-16T11:21:18.505241+0000 mgr.a (mgr.14373) 14883 : cluster [DBG] pgmap v10322: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:21:20.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:21:19 smithi047 bash[22744]: cluster 2024-09-16T11:21:18.505241+0000 mgr.a (mgr.14373) 14883 : cluster [DBG] pgmap v10322: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:21:20.667 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:21:20.668 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:21:20.668 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:21:20.668 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:21:20.668 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:21:22.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:21:21 smithi157 bash[24585]: audit 2024-09-16T11:21:20.252205+0000 mgr.a (mgr.14373) 14884 : audit [DBG] from='client.321996 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:21:22.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:21:21 smithi157 bash[24585]: cluster 2024-09-16T11:21:20.505776+0000 mgr.a (mgr.14373) 14885 : cluster [DBG] pgmap v10323: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:21:22.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:21:21 smithi086 bash[24289]: audit 2024-09-16T11:21:20.252205+0000 mgr.a (mgr.14373) 14884 : audit [DBG] from='client.321996 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:21:22.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:21:21 smithi086 bash[24289]: cluster 2024-09-16T11:21:20.505776+0000 mgr.a (mgr.14373) 14885 : cluster [DBG] pgmap v10323: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:21:22.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:21:21 smithi047 bash[22744]: audit 2024-09-16T11:21:20.252205+0000 mgr.a (mgr.14373) 14884 : audit [DBG] from='client.321996 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:21:22.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:21:21 smithi047 bash[22744]: cluster 2024-09-16T11:21:20.505776+0000 mgr.a (mgr.14373) 14885 : cluster [DBG] pgmap v10323: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:21:24.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:21:23 smithi157 bash[24585]: cluster 2024-09-16T11:21:22.508119+0000 mgr.a (mgr.14373) 14886 : cluster [DBG] pgmap v10324: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:21:24.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:21:23 smithi086 bash[24289]: cluster 2024-09-16T11:21:22.508119+0000 mgr.a (mgr.14373) 14886 : cluster [DBG] pgmap v10324: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:21:24.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:21:23 smithi047 bash[22744]: cluster 2024-09-16T11:21:22.508119+0000 mgr.a (mgr.14373) 14886 : cluster [DBG] pgmap v10324: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:21:25.669 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:21:25.670 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:21:25.670 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:21:26.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:21:25 smithi157 bash[24585]: cluster 2024-09-16T11:21:24.508880+0000 mgr.a (mgr.14373) 14887 : cluster [DBG] pgmap v10325: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:21:26.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:21:25 smithi086 bash[24289]: cluster 2024-09-16T11:21:24.508880+0000 mgr.a (mgr.14373) 14887 : cluster [DBG] pgmap v10325: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:21:26.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:21:25 smithi047 bash[22744]: cluster 2024-09-16T11:21:24.508880+0000 mgr.a (mgr.14373) 14887 : cluster [DBG] pgmap v10325: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:21:26.425 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:21:26.425 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:21:26.426 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:21:26.426 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:21:26.426 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:21:27.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:21:26 smithi157 bash[24585]: audit 2024-09-16T11:21:25.989680+0000 mgr.a (mgr.14373) 14888 : audit [DBG] from='client.322074 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:21:27.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:21:26 smithi086 bash[24289]: audit 2024-09-16T11:21:25.989680+0000 mgr.a (mgr.14373) 14888 : audit [DBG] from='client.322074 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:21:27.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:21:26 smithi047 bash[22744]: audit 2024-09-16T11:21:25.989680+0000 mgr.a (mgr.14373) 14888 : audit [DBG] from='client.322074 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:21:28.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:21:27 smithi157 bash[24585]: cluster 2024-09-16T11:21:26.509767+0000 mgr.a (mgr.14373) 14889 : cluster [DBG] pgmap v10326: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:21:28.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:21:27 smithi086 bash[24289]: cluster 2024-09-16T11:21:26.509767+0000 mgr.a (mgr.14373) 14889 : cluster [DBG] pgmap v10326: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:21:28.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:21:27 smithi047 bash[22744]: cluster 2024-09-16T11:21:26.509767+0000 mgr.a (mgr.14373) 14889 : cluster [DBG] pgmap v10326: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:21:30.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:21:29 smithi157 bash[24585]: cluster 2024-09-16T11:21:28.512043+0000 mgr.a (mgr.14373) 14890 : cluster [DBG] pgmap v10327: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:21:30.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:21:29 smithi086 bash[24289]: cluster 2024-09-16T11:21:28.512043+0000 mgr.a (mgr.14373) 14890 : cluster [DBG] pgmap v10327: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:21:30.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:21:29 smithi047 bash[22744]: cluster 2024-09-16T11:21:28.512043+0000 mgr.a (mgr.14373) 14890 : cluster [DBG] pgmap v10327: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:21:31.427 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:21:31.427 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:21:31.428 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:21:32.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:21:31 smithi157 bash[24585]: cluster 2024-09-16T11:21:30.512801+0000 mgr.a (mgr.14373) 14891 : cluster [DBG] pgmap v10328: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:21:32.072 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:21:31 smithi086 bash[24289]: cluster 2024-09-16T11:21:30.512801+0000 mgr.a (mgr.14373) 14891 : cluster [DBG] pgmap v10328: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:21:32.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:21:31 smithi047 bash[22744]: cluster 2024-09-16T11:21:30.512801+0000 mgr.a (mgr.14373) 14891 : cluster [DBG] pgmap v10328: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:21:32.188 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:21:32.188 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:21:32.188 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:21:32.188 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:21:32.188 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:21:33.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:21:32 smithi157 bash[24585]: audit 2024-09-16T11:21:31.762701+0000 mgr.a (mgr.14373) 14892 : audit [DBG] from='client.322152 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:21:33.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:21:32 smithi086 bash[24289]: audit 2024-09-16T11:21:31.762701+0000 mgr.a (mgr.14373) 14892 : audit [DBG] from='client.322152 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:21:33.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:21:32 smithi047 bash[22744]: audit 2024-09-16T11:21:31.762701+0000 mgr.a (mgr.14373) 14892 : audit [DBG] from='client.322152 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:21:34.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:21:33 smithi157 bash[24585]: cluster 2024-09-16T11:21:32.515490+0000 mgr.a (mgr.14373) 14893 : cluster [DBG] pgmap v10329: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:21:34.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:21:33 smithi086 bash[24289]: cluster 2024-09-16T11:21:32.515490+0000 mgr.a (mgr.14373) 14893 : cluster [DBG] pgmap v10329: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:21:34.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:21:33 smithi047 bash[22744]: cluster 2024-09-16T11:21:32.515490+0000 mgr.a (mgr.14373) 14893 : cluster [DBG] pgmap v10329: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:21:36.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:21:35 smithi157 bash[24585]: cluster 2024-09-16T11:21:34.516238+0000 mgr.a (mgr.14373) 14894 : cluster [DBG] pgmap v10330: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:21:36.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:21:35 smithi086 bash[24289]: cluster 2024-09-16T11:21:34.516238+0000 mgr.a (mgr.14373) 14894 : cluster [DBG] pgmap v10330: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:21:36.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:21:35 smithi047 bash[22744]: cluster 2024-09-16T11:21:34.516238+0000 mgr.a (mgr.14373) 14894 : cluster [DBG] pgmap v10330: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:21:37.190 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:21:37.190 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:21:37.191 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:21:37.936 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:21:37.936 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:21:37.936 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:21:37.936 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:21:37.937 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:21:38.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:21:37 smithi157 bash[24585]: cluster 2024-09-16T11:21:36.516965+0000 mgr.a (mgr.14373) 14895 : cluster [DBG] pgmap v10331: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T11:21:38.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:21:37 smithi086 bash[24289]: cluster 2024-09-16T11:21:36.516965+0000 mgr.a (mgr.14373) 14895 : cluster [DBG] pgmap v10331: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T11:21:38.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:21:37 smithi047 bash[22744]: cluster 2024-09-16T11:21:36.516965+0000 mgr.a (mgr.14373) 14895 : cluster [DBG] pgmap v10331: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T11:21:39.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:21:38 smithi157 bash[24585]: audit 2024-09-16T11:21:37.517268+0000 mgr.a (mgr.14373) 14896 : audit [DBG] from='client.322227 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:21:39.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:21:38 smithi086 bash[24289]: audit 2024-09-16T11:21:37.517268+0000 mgr.a (mgr.14373) 14896 : audit [DBG] from='client.322227 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:21:39.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:21:38 smithi047 bash[22744]: audit 2024-09-16T11:21:37.517268+0000 mgr.a (mgr.14373) 14896 : audit [DBG] from='client.322227 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:21:40.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:21:39 smithi157 bash[24585]: cluster 2024-09-16T11:21:38.519715+0000 mgr.a (mgr.14373) 14897 : cluster [DBG] pgmap v10332: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:21:40.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:21:39 smithi086 bash[24289]: cluster 2024-09-16T11:21:38.519715+0000 mgr.a (mgr.14373) 14897 : cluster [DBG] pgmap v10332: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:21:40.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:21:39 smithi047 bash[22744]: cluster 2024-09-16T11:21:38.519715+0000 mgr.a (mgr.14373) 14897 : cluster [DBG] pgmap v10332: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:21:42.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:21:41 smithi157 bash[24585]: cluster 2024-09-16T11:21:40.520461+0000 mgr.a (mgr.14373) 14898 : cluster [DBG] pgmap v10333: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:21:42.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:21:41 smithi086 bash[24289]: cluster 2024-09-16T11:21:40.520461+0000 mgr.a (mgr.14373) 14898 : cluster [DBG] pgmap v10333: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:21:42.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:21:41 smithi047 bash[22744]: cluster 2024-09-16T11:21:40.520461+0000 mgr.a (mgr.14373) 14898 : cluster [DBG] pgmap v10333: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:21:42.938 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:21:42.938 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:21:42.939 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:21:43.734 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:21:43.735 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:21:43.735 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:21:43.735 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:21:43.735 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:21:44.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:21:43 smithi157 bash[24585]: cluster 2024-09-16T11:21:42.522497+0000 mgr.a (mgr.14373) 14899 : cluster [DBG] pgmap v10334: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:21:44.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:21:43 smithi086 bash[24289]: cluster 2024-09-16T11:21:42.522497+0000 mgr.a (mgr.14373) 14899 : cluster [DBG] pgmap v10334: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:21:44.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:21:43 smithi047 bash[22744]: cluster 2024-09-16T11:21:42.522497+0000 mgr.a (mgr.14373) 14899 : cluster [DBG] pgmap v10334: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:21:45.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:21:44 smithi157 bash[24585]: audit 2024-09-16T11:21:43.279275+0000 mgr.a (mgr.14373) 14900 : audit [DBG] from='client.322305 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:21:45.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:21:44 smithi086 bash[24289]: audit 2024-09-16T11:21:43.279275+0000 mgr.a (mgr.14373) 14900 : audit [DBG] from='client.322305 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:21:45.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:21:44 smithi047 bash[22744]: audit 2024-09-16T11:21:43.279275+0000 mgr.a (mgr.14373) 14900 : audit [DBG] from='client.322305 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:21:46.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:21:45 smithi157 bash[24585]: cluster 2024-09-16T11:21:44.523406+0000 mgr.a (mgr.14373) 14901 : cluster [DBG] pgmap v10335: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:21:46.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:21:45 smithi086 bash[24289]: cluster 2024-09-16T11:21:44.523406+0000 mgr.a (mgr.14373) 14901 : cluster [DBG] pgmap v10335: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:21:46.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:21:45 smithi047 bash[22744]: cluster 2024-09-16T11:21:44.523406+0000 mgr.a (mgr.14373) 14901 : cluster [DBG] pgmap v10335: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:21:48.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:21:47 smithi157 bash[24585]: cluster 2024-09-16T11:21:46.524138+0000 mgr.a (mgr.14373) 14902 : cluster [DBG] pgmap v10336: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:21:48.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:21:47 smithi086 bash[24289]: cluster 2024-09-16T11:21:46.524138+0000 mgr.a (mgr.14373) 14902 : cluster [DBG] pgmap v10336: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:21:48.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:21:47 smithi047 bash[22744]: cluster 2024-09-16T11:21:46.524138+0000 mgr.a (mgr.14373) 14902 : cluster [DBG] pgmap v10336: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:21:48.736 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:21:48.737 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:21:48.737 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:21:49.519 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:21:49.520 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:21:49.520 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:21:49.520 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:21:49.520 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:21:50.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:21:49 smithi157 bash[24585]: cluster 2024-09-16T11:21:48.526328+0000 mgr.a (mgr.14373) 14903 : cluster [DBG] pgmap v10337: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:21:50.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:21:49 smithi157 bash[24585]: audit 2024-09-16T11:21:49.068284+0000 mgr.a (mgr.14373) 14904 : audit [DBG] from='client.322383 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:21:50.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:21:49 smithi086 bash[24289]: cluster 2024-09-16T11:21:48.526328+0000 mgr.a (mgr.14373) 14903 : cluster [DBG] pgmap v10337: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:21:50.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:21:49 smithi086 bash[24289]: audit 2024-09-16T11:21:49.068284+0000 mgr.a (mgr.14373) 14904 : audit [DBG] from='client.322383 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:21:50.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:21:49 smithi047 bash[22744]: cluster 2024-09-16T11:21:48.526328+0000 mgr.a (mgr.14373) 14903 : cluster [DBG] pgmap v10337: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:21:50.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:21:49 smithi047 bash[22744]: audit 2024-09-16T11:21:49.068284+0000 mgr.a (mgr.14373) 14904 : audit [DBG] from='client.322383 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:21:52.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:21:51 smithi157 bash[24585]: cluster 2024-09-16T11:21:50.527646+0000 mgr.a (mgr.14373) 14905 : cluster [DBG] pgmap v10338: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:21:52.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:21:51 smithi086 bash[24289]: cluster 2024-09-16T11:21:50.527646+0000 mgr.a (mgr.14373) 14905 : cluster [DBG] pgmap v10338: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:21:52.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:21:51 smithi047 bash[22744]: cluster 2024-09-16T11:21:50.527646+0000 mgr.a (mgr.14373) 14905 : cluster [DBG] pgmap v10338: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:21:54.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:21:53 smithi157 bash[24585]: cluster 2024-09-16T11:21:52.529932+0000 mgr.a (mgr.14373) 14906 : cluster [DBG] pgmap v10339: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:21:54.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:21:53 smithi086 bash[24289]: cluster 2024-09-16T11:21:52.529932+0000 mgr.a (mgr.14373) 14906 : cluster [DBG] pgmap v10339: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:21:54.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:21:53 smithi047 bash[22744]: cluster 2024-09-16T11:21:52.529932+0000 mgr.a (mgr.14373) 14906 : cluster [DBG] pgmap v10339: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:21:54.521 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:21:54.522 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:21:54.522 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:21:55.267 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:21:55.267 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:21:55.267 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:21:55.267 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:21:55.267 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:21:56.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:21:55 smithi157 bash[24585]: cluster 2024-09-16T11:21:54.530518+0000 mgr.a (mgr.14373) 14907 : cluster [DBG] pgmap v10340: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:21:56.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:21:55 smithi157 bash[24585]: audit 2024-09-16T11:21:54.850998+0000 mgr.a (mgr.14373) 14908 : audit [DBG] from='client.322455 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:21:56.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:21:55 smithi086 bash[24289]: cluster 2024-09-16T11:21:54.530518+0000 mgr.a (mgr.14373) 14907 : cluster [DBG] pgmap v10340: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:21:56.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:21:55 smithi086 bash[24289]: audit 2024-09-16T11:21:54.850998+0000 mgr.a (mgr.14373) 14908 : audit [DBG] from='client.322455 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:21:56.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:21:55 smithi047 bash[22744]: cluster 2024-09-16T11:21:54.530518+0000 mgr.a (mgr.14373) 14907 : cluster [DBG] pgmap v10340: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:21:56.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:21:55 smithi047 bash[22744]: audit 2024-09-16T11:21:54.850998+0000 mgr.a (mgr.14373) 14908 : audit [DBG] from='client.322455 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:21:58.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:21:57 smithi157 bash[24585]: cluster 2024-09-16T11:21:56.531404+0000 mgr.a (mgr.14373) 14909 : cluster [DBG] pgmap v10341: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:21:58.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:21:57 smithi157 bash[24585]: audit 2024-09-16T11:21:57.000658+0000 mon.b (mon.2) 1358 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T11:21:58.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:21:57 smithi086 bash[24289]: cluster 2024-09-16T11:21:56.531404+0000 mgr.a (mgr.14373) 14909 : cluster [DBG] pgmap v10341: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:21:58.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:21:57 smithi086 bash[24289]: audit 2024-09-16T11:21:57.000658+0000 mon.b (mon.2) 1358 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T11:21:58.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:21:57 smithi047 bash[22744]: cluster 2024-09-16T11:21:56.531404+0000 mgr.a (mgr.14373) 14909 : cluster [DBG] pgmap v10341: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:21:58.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:21:57 smithi047 bash[22744]: audit 2024-09-16T11:21:57.000658+0000 mon.b (mon.2) 1358 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T11:21:59.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:21:58 smithi157 bash[24585]: audit 2024-09-16T11:21:57.862689+0000 mon.b (mon.2) 1359 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T11:21:59.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:21:58 smithi157 bash[24585]: audit 2024-09-16T11:21:57.864840+0000 mon.b (mon.2) 1360 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T11:21:59.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:21:58 smithi157 bash[24585]: audit 2024-09-16T11:21:57.876751+0000 mon.a (mon.0) 1462 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:21:59.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:21:58 smithi157 bash[24585]: audit 2024-09-16T11:21:57.881681+0000 mon.b (mon.2) 1361 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:21:59.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:21:58 smithi157 bash[24585]: audit 2024-09-16T11:21:57.884362+0000 mgr.a (mgr.14373) 14910 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:21:59.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:21:58 smithi086 bash[24289]: audit 2024-09-16T11:21:57.862689+0000 mon.b (mon.2) 1359 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T11:21:59.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:21:58 smithi086 bash[24289]: audit 2024-09-16T11:21:57.864840+0000 mon.b (mon.2) 1360 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T11:21:59.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:21:58 smithi086 bash[24289]: audit 2024-09-16T11:21:57.876751+0000 mon.a (mon.0) 1462 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:21:59.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:21:58 smithi086 bash[24289]: audit 2024-09-16T11:21:57.881681+0000 mon.b (mon.2) 1361 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:21:59.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:21:58 smithi086 bash[24289]: audit 2024-09-16T11:21:57.884362+0000 mgr.a (mgr.14373) 14910 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:21:59.092 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 11:21:58 smithi047 bash[22994]: debug 2024-09-16T11:21:58.623+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T11:21:59.093 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 11:21:58 smithi047 bash[22994]: debug 2024-09-16T11:21:58.627+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T11:21:59.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:21:58 smithi047 bash[22744]: audit 2024-09-16T11:21:57.862689+0000 mon.b (mon.2) 1359 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T11:21:59.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:21:58 smithi047 bash[22744]: audit 2024-09-16T11:21:57.864840+0000 mon.b (mon.2) 1360 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T11:21:59.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:21:58 smithi047 bash[22744]: audit 2024-09-16T11:21:57.876751+0000 mon.a (mon.0) 1462 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:21:59.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:21:58 smithi047 bash[22744]: audit 2024-09-16T11:21:57.881681+0000 mon.b (mon.2) 1361 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:21:59.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:21:58 smithi047 bash[22744]: audit 2024-09-16T11:21:57.884362+0000 mgr.a (mgr.14373) 14910 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:22:00.268 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:22:00.269 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:22:00.269 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:22:00.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:21:59 smithi157 bash[24585]: cluster 2024-09-16T11:21:58.533010+0000 mgr.a (mgr.14373) 14911 : cluster [DBG] pgmap v10342: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:22:00.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:21:59 smithi157 bash[24585]: audit 2024-09-16T11:21:58.630306+0000 mgr.a (mgr.14373) 14912 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T11:22:00.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:21:59 smithi157 bash[24585]: cephadm 2024-09-16T11:21:58.632199+0000 mgr.a (mgr.14373) 14913 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T11:22:00.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:21:59 smithi086 bash[24289]: cluster 2024-09-16T11:21:58.533010+0000 mgr.a (mgr.14373) 14911 : cluster [DBG] pgmap v10342: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:22:00.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:21:59 smithi086 bash[24289]: audit 2024-09-16T11:21:58.630306+0000 mgr.a (mgr.14373) 14912 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T11:22:00.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:21:59 smithi086 bash[24289]: cephadm 2024-09-16T11:21:58.632199+0000 mgr.a (mgr.14373) 14913 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T11:22:00.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:21:59 smithi047 bash[22744]: cluster 2024-09-16T11:21:58.533010+0000 mgr.a (mgr.14373) 14911 : cluster [DBG] pgmap v10342: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:22:00.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:21:59 smithi047 bash[22744]: audit 2024-09-16T11:21:58.630306+0000 mgr.a (mgr.14373) 14912 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T11:22:00.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:21:59 smithi047 bash[22744]: cephadm 2024-09-16T11:21:58.632199+0000 mgr.a (mgr.14373) 14913 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T11:22:01.015 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:22:01.015 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:22:01.015 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:22:01.015 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:22:01.015 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:22:02.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:22:01 smithi157 bash[24585]: cluster 2024-09-16T11:22:00.533743+0000 mgr.a (mgr.14373) 14914 : cluster [DBG] pgmap v10343: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:22:02.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:22:01 smithi157 bash[24585]: audit 2024-09-16T11:22:00.603163+0000 mgr.a (mgr.14373) 14915 : audit [DBG] from='client.322635 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:22:02.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:22:01 smithi086 bash[24289]: cluster 2024-09-16T11:22:00.533743+0000 mgr.a (mgr.14373) 14914 : cluster [DBG] pgmap v10343: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:22:02.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:22:01 smithi086 bash[24289]: audit 2024-09-16T11:22:00.603163+0000 mgr.a (mgr.14373) 14915 : audit [DBG] from='client.322635 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:22:02.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:22:01 smithi047 bash[22744]: cluster 2024-09-16T11:22:00.533743+0000 mgr.a (mgr.14373) 14914 : cluster [DBG] pgmap v10343: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:22:02.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:22:01 smithi047 bash[22744]: audit 2024-09-16T11:22:00.603163+0000 mgr.a (mgr.14373) 14915 : audit [DBG] from='client.322635 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:22:04.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:22:03 smithi157 bash[24585]: cluster 2024-09-16T11:22:02.536174+0000 mgr.a (mgr.14373) 14916 : cluster [DBG] pgmap v10344: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:22:04.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:22:03 smithi086 bash[24289]: cluster 2024-09-16T11:22:02.536174+0000 mgr.a (mgr.14373) 14916 : cluster [DBG] pgmap v10344: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:22:04.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:22:03 smithi047 bash[22744]: cluster 2024-09-16T11:22:02.536174+0000 mgr.a (mgr.14373) 14916 : cluster [DBG] pgmap v10344: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:22:06.016 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:22:06.017 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:22:06.017 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:22:06.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:22:05 smithi157 bash[24585]: cluster 2024-09-16T11:22:04.536945+0000 mgr.a (mgr.14373) 14917 : cluster [DBG] pgmap v10345: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:22:06.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:22:05 smithi086 bash[24289]: cluster 2024-09-16T11:22:04.536945+0000 mgr.a (mgr.14373) 14917 : cluster [DBG] pgmap v10345: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:22:06.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:22:05 smithi047 bash[22744]: cluster 2024-09-16T11:22:04.536945+0000 mgr.a (mgr.14373) 14917 : cluster [DBG] pgmap v10345: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:22:06.805 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:22:06.805 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:22:06.805 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:22:06.805 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:22:06.806 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:22:08.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:22:07 smithi157 bash[24585]: audit 2024-09-16T11:22:06.351210+0000 mgr.a (mgr.14373) 14918 : audit [DBG] from='client.322710 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:22:08.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:22:07 smithi157 bash[24585]: cluster 2024-09-16T11:22:06.537470+0000 mgr.a (mgr.14373) 14919 : cluster [DBG] pgmap v10346: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:22:08.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:22:07 smithi086 bash[24289]: audit 2024-09-16T11:22:06.351210+0000 mgr.a (mgr.14373) 14918 : audit [DBG] from='client.322710 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:22:08.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:22:07 smithi086 bash[24289]: cluster 2024-09-16T11:22:06.537470+0000 mgr.a (mgr.14373) 14919 : cluster [DBG] pgmap v10346: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:22:08.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:22:07 smithi047 bash[22744]: audit 2024-09-16T11:22:06.351210+0000 mgr.a (mgr.14373) 14918 : audit [DBG] from='client.322710 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:22:08.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:22:07 smithi047 bash[22744]: cluster 2024-09-16T11:22:06.537470+0000 mgr.a (mgr.14373) 14919 : cluster [DBG] pgmap v10346: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:22:10.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:22:09 smithi157 bash[24585]: cluster 2024-09-16T11:22:08.540160+0000 mgr.a (mgr.14373) 14920 : cluster [DBG] pgmap v10347: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:22:10.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:22:09 smithi086 bash[24289]: cluster 2024-09-16T11:22:08.540160+0000 mgr.a (mgr.14373) 14920 : cluster [DBG] pgmap v10347: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:22:10.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:22:09 smithi047 bash[22744]: cluster 2024-09-16T11:22:08.540160+0000 mgr.a (mgr.14373) 14920 : cluster [DBG] pgmap v10347: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:22:11.806 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:22:11.807 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:22:11.808 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:22:12.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:22:11 smithi157 bash[24585]: cluster 2024-09-16T11:22:10.541096+0000 mgr.a (mgr.14373) 14921 : cluster [DBG] pgmap v10348: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 6.2 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T11:22:12.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:22:11 smithi086 bash[24289]: cluster 2024-09-16T11:22:10.541096+0000 mgr.a (mgr.14373) 14921 : cluster [DBG] pgmap v10348: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 6.2 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T11:22:12.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:22:11 smithi047 bash[22744]: cluster 2024-09-16T11:22:10.541096+0000 mgr.a (mgr.14373) 14921 : cluster [DBG] pgmap v10348: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 6.2 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T11:22:12.599 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:22:12.600 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:22:12.600 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:22:12.600 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:22:12.600 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:22:13.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:22:12 smithi157 bash[24585]: audit 2024-09-16T11:22:12.145990+0000 mgr.a (mgr.14373) 14922 : audit [DBG] from='client.322788 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:22:13.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:22:12 smithi086 bash[24289]: audit 2024-09-16T11:22:12.145990+0000 mgr.a (mgr.14373) 14922 : audit [DBG] from='client.322788 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:22:13.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:22:12 smithi047 bash[22744]: audit 2024-09-16T11:22:12.145990+0000 mgr.a (mgr.14373) 14922 : audit [DBG] from='client.322788 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:22:14.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:22:13 smithi157 bash[24585]: cluster 2024-09-16T11:22:12.542522+0000 mgr.a (mgr.14373) 14923 : cluster [DBG] pgmap v10349: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:22:14.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:22:13 smithi086 bash[24289]: cluster 2024-09-16T11:22:12.542522+0000 mgr.a (mgr.14373) 14923 : cluster [DBG] pgmap v10349: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:22:14.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:22:13 smithi047 bash[22744]: cluster 2024-09-16T11:22:12.542522+0000 mgr.a (mgr.14373) 14923 : cluster [DBG] pgmap v10349: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:22:16.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:22:15 smithi157 bash[24585]: cluster 2024-09-16T11:22:14.543222+0000 mgr.a (mgr.14373) 14924 : cluster [DBG] pgmap v10350: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:22:16.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:22:15 smithi086 bash[24289]: cluster 2024-09-16T11:22:14.543222+0000 mgr.a (mgr.14373) 14924 : cluster [DBG] pgmap v10350: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:22:16.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:22:15 smithi047 bash[22744]: cluster 2024-09-16T11:22:14.543222+0000 mgr.a (mgr.14373) 14924 : cluster [DBG] pgmap v10350: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:22:17.601 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:22:17.602 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:22:17.602 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:22:18.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:22:17 smithi157 bash[24585]: cluster 2024-09-16T11:22:16.543980+0000 mgr.a (mgr.14373) 14925 : cluster [DBG] pgmap v10351: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T11:22:18.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:22:17 smithi086 bash[24289]: cluster 2024-09-16T11:22:16.543980+0000 mgr.a (mgr.14373) 14925 : cluster [DBG] pgmap v10351: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T11:22:18.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:22:17 smithi047 bash[22744]: cluster 2024-09-16T11:22:16.543980+0000 mgr.a (mgr.14373) 14925 : cluster [DBG] pgmap v10351: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T11:22:18.359 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:22:18.360 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:22:18.360 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:22:18.360 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:22:18.360 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:22:19.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:22:18 smithi157 bash[24585]: audit 2024-09-16T11:22:17.932721+0000 mgr.a (mgr.14373) 14926 : audit [DBG] from='client.322860 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:22:19.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:22:18 smithi086 bash[24289]: audit 2024-09-16T11:22:17.932721+0000 mgr.a (mgr.14373) 14926 : audit [DBG] from='client.322860 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:22:19.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:22:18 smithi047 bash[22744]: audit 2024-09-16T11:22:17.932721+0000 mgr.a (mgr.14373) 14926 : audit [DBG] from='client.322860 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:22:20.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:22:19 smithi157 bash[24585]: cluster 2024-09-16T11:22:18.546727+0000 mgr.a (mgr.14373) 14927 : cluster [DBG] pgmap v10352: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:22:20.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:22:19 smithi086 bash[24289]: cluster 2024-09-16T11:22:18.546727+0000 mgr.a (mgr.14373) 14927 : cluster [DBG] pgmap v10352: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:22:20.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:22:19 smithi047 bash[22744]: cluster 2024-09-16T11:22:18.546727+0000 mgr.a (mgr.14373) 14927 : cluster [DBG] pgmap v10352: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:22:22.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:22:21 smithi157 bash[24585]: cluster 2024-09-16T11:22:20.547553+0000 mgr.a (mgr.14373) 14928 : cluster [DBG] pgmap v10353: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-16T11:22:22.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:22:21 smithi086 bash[24289]: cluster 2024-09-16T11:22:20.547553+0000 mgr.a (mgr.14373) 14928 : cluster [DBG] pgmap v10353: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-16T11:22:22.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:22:21 smithi047 bash[22744]: cluster 2024-09-16T11:22:20.547553+0000 mgr.a (mgr.14373) 14928 : cluster [DBG] pgmap v10353: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-16T11:22:23.361 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:22:23.362 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:22:23.362 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:22:24.142 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:22:24.143 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:22:24.143 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:22:24.143 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:22:24.143 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:22:24.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:22:23 smithi157 bash[24585]: cluster 2024-09-16T11:22:22.549594+0000 mgr.a (mgr.14373) 14929 : cluster [DBG] pgmap v10354: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-09-16T11:22:24.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:22:23 smithi086 bash[24289]: cluster 2024-09-16T11:22:22.549594+0000 mgr.a (mgr.14373) 14929 : cluster [DBG] pgmap v10354: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-09-16T11:22:24.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:22:23 smithi047 bash[22744]: cluster 2024-09-16T11:22:22.549594+0000 mgr.a (mgr.14373) 14929 : cluster [DBG] pgmap v10354: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-09-16T11:22:25.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:22:24 smithi157 bash[24585]: audit 2024-09-16T11:22:23.691019+0000 mgr.a (mgr.14373) 14930 : audit [DBG] from='client.322938 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:22:25.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:22:24 smithi086 bash[24289]: audit 2024-09-16T11:22:23.691019+0000 mgr.a (mgr.14373) 14930 : audit [DBG] from='client.322938 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:22:25.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:22:24 smithi047 bash[22744]: audit 2024-09-16T11:22:23.691019+0000 mgr.a (mgr.14373) 14930 : audit [DBG] from='client.322938 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:22:26.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:22:25 smithi157 bash[24585]: cluster 2024-09-16T11:22:24.550758+0000 mgr.a (mgr.14373) 14931 : cluster [DBG] pgmap v10355: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:22:26.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:22:25 smithi086 bash[24289]: cluster 2024-09-16T11:22:24.550758+0000 mgr.a (mgr.14373) 14931 : cluster [DBG] pgmap v10355: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:22:26.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:22:25 smithi047 bash[22744]: cluster 2024-09-16T11:22:24.550758+0000 mgr.a (mgr.14373) 14931 : cluster [DBG] pgmap v10355: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:22:28.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:22:27 smithi157 bash[24585]: cluster 2024-09-16T11:22:26.551586+0000 mgr.a (mgr.14373) 14932 : cluster [DBG] pgmap v10356: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:22:28.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:22:27 smithi086 bash[24289]: cluster 2024-09-16T11:22:26.551586+0000 mgr.a (mgr.14373) 14932 : cluster [DBG] pgmap v10356: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:22:28.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:22:27 smithi047 bash[22744]: cluster 2024-09-16T11:22:26.551586+0000 mgr.a (mgr.14373) 14932 : cluster [DBG] pgmap v10356: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:22:29.144 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:22:29.145 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:22:29.145 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:22:29.892 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:22:29.893 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:22:29.893 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:22:29.893 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:22:29.893 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:22:30.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:22:29 smithi157 bash[24585]: cluster 2024-09-16T11:22:28.553881+0000 mgr.a (mgr.14373) 14933 : cluster [DBG] pgmap v10357: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:22:30.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:22:29 smithi086 bash[24289]: cluster 2024-09-16T11:22:28.553881+0000 mgr.a (mgr.14373) 14933 : cluster [DBG] pgmap v10357: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:22:30.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:22:29 smithi047 bash[22744]: cluster 2024-09-16T11:22:28.553881+0000 mgr.a (mgr.14373) 14933 : cluster [DBG] pgmap v10357: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:22:31.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:22:30 smithi157 bash[24585]: audit 2024-09-16T11:22:29.476430+0000 mgr.a (mgr.14373) 14934 : audit [DBG] from='client.323016 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:22:31.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:22:30 smithi086 bash[24289]: audit 2024-09-16T11:22:29.476430+0000 mgr.a (mgr.14373) 14934 : audit [DBG] from='client.323016 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:22:31.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:22:30 smithi047 bash[22744]: audit 2024-09-16T11:22:29.476430+0000 mgr.a (mgr.14373) 14934 : audit [DBG] from='client.323016 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:22:32.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:22:31 smithi157 bash[24585]: cluster 2024-09-16T11:22:30.554910+0000 mgr.a (mgr.14373) 14935 : cluster [DBG] pgmap v10358: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:22:32.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:22:31 smithi086 bash[24289]: cluster 2024-09-16T11:22:30.554910+0000 mgr.a (mgr.14373) 14935 : cluster [DBG] pgmap v10358: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:22:32.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:22:31 smithi047 bash[22744]: cluster 2024-09-16T11:22:30.554910+0000 mgr.a (mgr.14373) 14935 : cluster [DBG] pgmap v10358: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:22:34.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:22:33 smithi157 bash[24585]: cluster 2024-09-16T11:22:32.557130+0000 mgr.a (mgr.14373) 14936 : cluster [DBG] pgmap v10359: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:22:34.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:22:33 smithi086 bash[24289]: cluster 2024-09-16T11:22:32.557130+0000 mgr.a (mgr.14373) 14936 : cluster [DBG] pgmap v10359: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:22:34.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:22:33 smithi047 bash[22744]: cluster 2024-09-16T11:22:32.557130+0000 mgr.a (mgr.14373) 14936 : cluster [DBG] pgmap v10359: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:22:34.891 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:22:34.892 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:22:34.892 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:22:35.650 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:22:35.651 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:22:35.651 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:22:35.651 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:22:35.651 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:22:36.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:22:35 smithi157 bash[24585]: cluster 2024-09-16T11:22:34.557878+0000 mgr.a (mgr.14373) 14937 : cluster [DBG] pgmap v10360: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:22:36.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:22:35 smithi086 bash[24289]: cluster 2024-09-16T11:22:34.557878+0000 mgr.a (mgr.14373) 14937 : cluster [DBG] pgmap v10360: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:22:36.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:22:35 smithi047 bash[22744]: cluster 2024-09-16T11:22:34.557878+0000 mgr.a (mgr.14373) 14937 : cluster [DBG] pgmap v10360: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:22:37.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:22:36 smithi157 bash[24585]: audit 2024-09-16T11:22:35.227802+0000 mgr.a (mgr.14373) 14938 : audit [DBG] from='client.323091 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:22:37.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:22:36 smithi086 bash[24289]: audit 2024-09-16T11:22:35.227802+0000 mgr.a (mgr.14373) 14938 : audit [DBG] from='client.323091 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:22:37.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:22:36 smithi047 bash[22744]: audit 2024-09-16T11:22:35.227802+0000 mgr.a (mgr.14373) 14938 : audit [DBG] from='client.323091 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:22:38.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:22:37 smithi157 bash[24585]: cluster 2024-09-16T11:22:36.558845+0000 mgr.a (mgr.14373) 14939 : cluster [DBG] pgmap v10361: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:22:38.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:22:37 smithi086 bash[24289]: cluster 2024-09-16T11:22:36.558845+0000 mgr.a (mgr.14373) 14939 : cluster [DBG] pgmap v10361: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:22:38.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:22:37 smithi047 bash[22744]: cluster 2024-09-16T11:22:36.558845+0000 mgr.a (mgr.14373) 14939 : cluster [DBG] pgmap v10361: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:22:40.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:22:39 smithi157 bash[24585]: cluster 2024-09-16T11:22:38.561117+0000 mgr.a (mgr.14373) 14940 : cluster [DBG] pgmap v10362: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:22:40.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:22:39 smithi086 bash[24289]: cluster 2024-09-16T11:22:38.561117+0000 mgr.a (mgr.14373) 14940 : cluster [DBG] pgmap v10362: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:22:40.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:22:39 smithi047 bash[22744]: cluster 2024-09-16T11:22:38.561117+0000 mgr.a (mgr.14373) 14940 : cluster [DBG] pgmap v10362: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:22:40.652 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:22:40.653 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:22:40.653 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:22:41.408 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:22:41.408 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:22:41.408 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:22:41.409 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:22:41.409 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:22:42.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:22:42 smithi157 bash[24585]: cluster 2024-09-16T11:22:40.561918+0000 mgr.a (mgr.14373) 14941 : cluster [DBG] pgmap v10363: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:22:42.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:22:42 smithi157 bash[24585]: audit 2024-09-16T11:22:40.983098+0000 mgr.a (mgr.14373) 14942 : audit [DBG] from='client.323169 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:22:42.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:22:42 smithi086 bash[24289]: cluster 2024-09-16T11:22:40.561918+0000 mgr.a (mgr.14373) 14941 : cluster [DBG] pgmap v10363: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:22:42.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:22:42 smithi086 bash[24289]: audit 2024-09-16T11:22:40.983098+0000 mgr.a (mgr.14373) 14942 : audit [DBG] from='client.323169 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:22:42.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:22:41 smithi047 bash[22744]: cluster 2024-09-16T11:22:40.561918+0000 mgr.a (mgr.14373) 14941 : cluster [DBG] pgmap v10363: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:22:42.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:22:41 smithi047 bash[22744]: audit 2024-09-16T11:22:40.983098+0000 mgr.a (mgr.14373) 14942 : audit [DBG] from='client.323169 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:22:44.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:22:44 smithi157 bash[24585]: cluster 2024-09-16T11:22:42.564238+0000 mgr.a (mgr.14373) 14943 : cluster [DBG] pgmap v10364: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:22:44.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:22:44 smithi086 bash[24289]: cluster 2024-09-16T11:22:42.564238+0000 mgr.a (mgr.14373) 14943 : cluster [DBG] pgmap v10364: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:22:44.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:22:44 smithi047 bash[22744]: cluster 2024-09-16T11:22:42.564238+0000 mgr.a (mgr.14373) 14943 : cluster [DBG] pgmap v10364: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:22:46.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:22:46 smithi157 bash[24585]: cluster 2024-09-16T11:22:44.564974+0000 mgr.a (mgr.14373) 14944 : cluster [DBG] pgmap v10365: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-16T11:22:46.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:22:46 smithi086 bash[24289]: cluster 2024-09-16T11:22:44.564974+0000 mgr.a (mgr.14373) 14944 : cluster [DBG] pgmap v10365: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-16T11:22:46.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:22:46 smithi047 bash[22744]: cluster 2024-09-16T11:22:44.564974+0000 mgr.a (mgr.14373) 14944 : cluster [DBG] pgmap v10365: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-16T11:22:46.409 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:22:46.410 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:22:46.410 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:22:47.182 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:22:47.183 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:22:47.183 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:22:47.183 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:22:47.183 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:22:48.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:22:48 smithi157 bash[24585]: cluster 2024-09-16T11:22:46.566486+0000 mgr.a (mgr.14373) 14945 : cluster [DBG] pgmap v10366: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:22:48.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:22:48 smithi157 bash[24585]: audit 2024-09-16T11:22:46.747424+0000 mgr.a (mgr.14373) 14946 : audit [DBG] from='client.323244 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:22:48.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:22:48 smithi086 bash[24289]: cluster 2024-09-16T11:22:46.566486+0000 mgr.a (mgr.14373) 14945 : cluster [DBG] pgmap v10366: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:22:48.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:22:48 smithi086 bash[24289]: audit 2024-09-16T11:22:46.747424+0000 mgr.a (mgr.14373) 14946 : audit [DBG] from='client.323244 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:22:48.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:22:48 smithi047 bash[22744]: cluster 2024-09-16T11:22:46.566486+0000 mgr.a (mgr.14373) 14945 : cluster [DBG] pgmap v10366: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:22:48.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:22:48 smithi047 bash[22744]: audit 2024-09-16T11:22:46.747424+0000 mgr.a (mgr.14373) 14946 : audit [DBG] from='client.323244 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:22:50.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:22:50 smithi157 bash[24585]: cluster 2024-09-16T11:22:48.568136+0000 mgr.a (mgr.14373) 14947 : cluster [DBG] pgmap v10367: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:22:50.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:22:50 smithi086 bash[24289]: cluster 2024-09-16T11:22:48.568136+0000 mgr.a (mgr.14373) 14947 : cluster [DBG] pgmap v10367: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:22:50.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:22:50 smithi047 bash[22744]: cluster 2024-09-16T11:22:48.568136+0000 mgr.a (mgr.14373) 14947 : cluster [DBG] pgmap v10367: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:22:52.184 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:22:52.185 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:22:52.185 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:22:52.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:22:52 smithi157 bash[24585]: cluster 2024-09-16T11:22:50.568917+0000 mgr.a (mgr.14373) 14948 : cluster [DBG] pgmap v10368: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:22:52.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:22:52 smithi086 bash[24289]: cluster 2024-09-16T11:22:50.568917+0000 mgr.a (mgr.14373) 14948 : cluster [DBG] pgmap v10368: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:22:52.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:22:52 smithi047 bash[22744]: cluster 2024-09-16T11:22:50.568917+0000 mgr.a (mgr.14373) 14948 : cluster [DBG] pgmap v10368: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:22:52.934 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:22:52.934 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:22:52.934 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:22:52.934 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:22:52.934 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:22:54.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:22:54 smithi157 bash[24585]: audit 2024-09-16T11:22:52.514563+0000 mgr.a (mgr.14373) 14949 : audit [DBG] from='client.323322 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:22:54.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:22:54 smithi157 bash[24585]: cluster 2024-09-16T11:22:52.571893+0000 mgr.a (mgr.14373) 14950 : cluster [DBG] pgmap v10369: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:22:54.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:22:54 smithi086 bash[24289]: audit 2024-09-16T11:22:52.514563+0000 mgr.a (mgr.14373) 14949 : audit [DBG] from='client.323322 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:22:54.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:22:54 smithi086 bash[24289]: cluster 2024-09-16T11:22:52.571893+0000 mgr.a (mgr.14373) 14950 : cluster [DBG] pgmap v10369: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:22:54.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:22:54 smithi047 bash[22744]: audit 2024-09-16T11:22:52.514563+0000 mgr.a (mgr.14373) 14949 : audit [DBG] from='client.323322 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:22:54.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:22:54 smithi047 bash[22744]: cluster 2024-09-16T11:22:52.571893+0000 mgr.a (mgr.14373) 14950 : cluster [DBG] pgmap v10369: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:22:56.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:22:56 smithi157 bash[24585]: cluster 2024-09-16T11:22:54.572797+0000 mgr.a (mgr.14373) 14951 : cluster [DBG] pgmap v10370: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-16T11:22:56.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:22:56 smithi086 bash[24289]: cluster 2024-09-16T11:22:54.572797+0000 mgr.a (mgr.14373) 14951 : cluster [DBG] pgmap v10370: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-16T11:22:56.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:22:56 smithi047 bash[22744]: cluster 2024-09-16T11:22:54.572797+0000 mgr.a (mgr.14373) 14951 : cluster [DBG] pgmap v10370: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-16T11:22:57.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:22:57 smithi157 bash[24585]: cluster 2024-09-16T11:22:56.575020+0000 mgr.a (mgr.14373) 14952 : cluster [DBG] pgmap v10371: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:22:57.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:22:57 smithi086 bash[24289]: cluster 2024-09-16T11:22:56.575020+0000 mgr.a (mgr.14373) 14952 : cluster [DBG] pgmap v10371: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:22:57.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:22:57 smithi047 bash[22744]: cluster 2024-09-16T11:22:56.575020+0000 mgr.a (mgr.14373) 14952 : cluster [DBG] pgmap v10371: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:22:57.935 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:22:57.936 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:22:57.936 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:22:58.720 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:22:58.721 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:22:58.721 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:22:58.721 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:22:58.721 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:23:00.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:22:59 smithi157 bash[24585]: audit 2024-09-16T11:22:58.270786+0000 mgr.a (mgr.14373) 14953 : audit [DBG] from='client.323400 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:23:00.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:22:59 smithi157 bash[24585]: cluster 2024-09-16T11:22:58.576297+0000 mgr.a (mgr.14373) 14954 : cluster [DBG] pgmap v10372: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:23:00.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:22:59 smithi157 bash[24585]: audit 2024-09-16T11:22:58.687657+0000 mon.b (mon.2) 1362 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T11:23:00.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:22:59 smithi157 bash[24585]: audit 2024-09-16T11:22:59.452133+0000 mon.b (mon.2) 1363 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T11:23:00.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:22:59 smithi157 bash[24585]: audit 2024-09-16T11:22:59.454127+0000 mon.b (mon.2) 1364 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T11:23:00.058 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:22:59 smithi157 bash[24585]: audit 2024-09-16T11:22:59.465441+0000 mon.a (mon.0) 1463 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:23:00.058 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:22:59 smithi157 bash[24585]: audit 2024-09-16T11:22:59.468323+0000 mon.b (mon.2) 1365 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:23:00.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:22:59 smithi086 bash[24289]: audit 2024-09-16T11:22:58.270786+0000 mgr.a (mgr.14373) 14953 : audit [DBG] from='client.323400 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:23:00.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:22:59 smithi086 bash[24289]: cluster 2024-09-16T11:22:58.576297+0000 mgr.a (mgr.14373) 14954 : cluster [DBG] pgmap v10372: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:23:00.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:22:59 smithi086 bash[24289]: audit 2024-09-16T11:22:58.687657+0000 mon.b (mon.2) 1362 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T11:23:00.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:22:59 smithi086 bash[24289]: audit 2024-09-16T11:22:59.452133+0000 mon.b (mon.2) 1363 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T11:23:00.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:22:59 smithi086 bash[24289]: audit 2024-09-16T11:22:59.454127+0000 mon.b (mon.2) 1364 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T11:23:00.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:22:59 smithi086 bash[24289]: audit 2024-09-16T11:22:59.465441+0000 mon.a (mon.0) 1463 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:23:00.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:22:59 smithi086 bash[24289]: audit 2024-09-16T11:22:59.468323+0000 mon.b (mon.2) 1365 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:23:00.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:22:59 smithi047 bash[22744]: audit 2024-09-16T11:22:58.270786+0000 mgr.a (mgr.14373) 14953 : audit [DBG] from='client.323400 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:23:00.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:22:59 smithi047 bash[22744]: cluster 2024-09-16T11:22:58.576297+0000 mgr.a (mgr.14373) 14954 : cluster [DBG] pgmap v10372: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:23:00.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:22:59 smithi047 bash[22744]: audit 2024-09-16T11:22:58.687657+0000 mon.b (mon.2) 1362 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T11:23:00.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:22:59 smithi047 bash[22744]: audit 2024-09-16T11:22:59.452133+0000 mon.b (mon.2) 1363 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T11:23:00.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:22:59 smithi047 bash[22744]: audit 2024-09-16T11:22:59.454127+0000 mon.b (mon.2) 1364 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T11:23:00.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:22:59 smithi047 bash[22744]: audit 2024-09-16T11:22:59.465441+0000 mon.a (mon.0) 1463 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:23:00.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:22:59 smithi047 bash[22744]: audit 2024-09-16T11:22:59.468323+0000 mon.b (mon.2) 1365 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:23:00.592 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 11:23:00 smithi047 bash[22994]: debug 2024-09-16T11:23:00.230+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T11:23:00.593 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 11:23:00 smithi047 bash[22994]: debug 2024-09-16T11:23:00.234+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T11:23:01.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:23:00 smithi157 bash[24585]: audit 2024-09-16T11:22:59.471162+0000 mgr.a (mgr.14373) 14955 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:23:01.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:23:00 smithi086 bash[24289]: audit 2024-09-16T11:22:59.471162+0000 mgr.a (mgr.14373) 14955 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:23:01.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:23:00 smithi047 bash[22744]: audit 2024-09-16T11:22:59.471162+0000 mgr.a (mgr.14373) 14955 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:23:02.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:23:01 smithi157 bash[24585]: audit 2024-09-16T11:23:00.232809+0000 mgr.a (mgr.14373) 14956 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T11:23:02.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:23:01 smithi157 bash[24585]: cephadm 2024-09-16T11:23:00.234980+0000 mgr.a (mgr.14373) 14957 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T11:23:02.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:23:01 smithi157 bash[24585]: cluster 2024-09-16T11:23:00.577408+0000 mgr.a (mgr.14373) 14958 : cluster [DBG] pgmap v10373: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:23:02.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:23:01 smithi086 bash[24289]: audit 2024-09-16T11:23:00.232809+0000 mgr.a (mgr.14373) 14956 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T11:23:02.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:23:01 smithi086 bash[24289]: cephadm 2024-09-16T11:23:00.234980+0000 mgr.a (mgr.14373) 14957 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T11:23:02.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:23:01 smithi086 bash[24289]: cluster 2024-09-16T11:23:00.577408+0000 mgr.a (mgr.14373) 14958 : cluster [DBG] pgmap v10373: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:23:02.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:23:01 smithi047 bash[22744]: audit 2024-09-16T11:23:00.232809+0000 mgr.a (mgr.14373) 14956 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T11:23:02.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:23:01 smithi047 bash[22744]: cephadm 2024-09-16T11:23:00.234980+0000 mgr.a (mgr.14373) 14957 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T11:23:02.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:23:01 smithi047 bash[22744]: cluster 2024-09-16T11:23:00.577408+0000 mgr.a (mgr.14373) 14958 : cluster [DBG] pgmap v10373: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:23:03.722 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:23:03.723 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:23:03.723 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:23:04.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:23:03 smithi157 bash[24585]: cluster 2024-09-16T11:23:02.579864+0000 mgr.a (mgr.14373) 14959 : cluster [DBG] pgmap v10374: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:23:04.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:23:03 smithi086 bash[24289]: cluster 2024-09-16T11:23:02.579864+0000 mgr.a (mgr.14373) 14959 : cluster [DBG] pgmap v10374: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:23:04.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:23:03 smithi047 bash[22744]: cluster 2024-09-16T11:23:02.579864+0000 mgr.a (mgr.14373) 14959 : cluster [DBG] pgmap v10374: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:23:04.477 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:23:04.477 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:23:04.477 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:23:04.477 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:23:04.477 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:23:05.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:23:04 smithi157 bash[24585]: audit 2024-09-16T11:23:04.047820+0000 mgr.a (mgr.14373) 14960 : audit [DBG] from='client.323586 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:23:05.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:23:04 smithi086 bash[24289]: audit 2024-09-16T11:23:04.047820+0000 mgr.a (mgr.14373) 14960 : audit [DBG] from='client.323586 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:23:05.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:23:04 smithi047 bash[22744]: audit 2024-09-16T11:23:04.047820+0000 mgr.a (mgr.14373) 14960 : audit [DBG] from='client.323586 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:23:06.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:23:05 smithi157 bash[24585]: cluster 2024-09-16T11:23:04.580864+0000 mgr.a (mgr.14373) 14961 : cluster [DBG] pgmap v10375: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:23:06.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:23:05 smithi086 bash[24289]: cluster 2024-09-16T11:23:04.580864+0000 mgr.a (mgr.14373) 14961 : cluster [DBG] pgmap v10375: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:23:06.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:23:05 smithi047 bash[22744]: cluster 2024-09-16T11:23:04.580864+0000 mgr.a (mgr.14373) 14961 : cluster [DBG] pgmap v10375: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:23:08.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:23:07 smithi157 bash[24585]: cluster 2024-09-16T11:23:06.583017+0000 mgr.a (mgr.14373) 14962 : cluster [DBG] pgmap v10376: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:23:08.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:23:07 smithi086 bash[24289]: cluster 2024-09-16T11:23:06.583017+0000 mgr.a (mgr.14373) 14962 : cluster [DBG] pgmap v10376: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:23:08.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:23:07 smithi047 bash[22744]: cluster 2024-09-16T11:23:06.583017+0000 mgr.a (mgr.14373) 14962 : cluster [DBG] pgmap v10376: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:23:09.478 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:23:09.479 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:23:09.479 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:23:10.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:23:09 smithi157 bash[24585]: cluster 2024-09-16T11:23:08.583823+0000 mgr.a (mgr.14373) 14963 : cluster [DBG] pgmap v10377: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 7.1 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:23:10.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:23:09 smithi086 bash[24289]: cluster 2024-09-16T11:23:08.583823+0000 mgr.a (mgr.14373) 14963 : cluster [DBG] pgmap v10377: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 7.1 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:23:10.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:23:09 smithi047 bash[22744]: cluster 2024-09-16T11:23:08.583823+0000 mgr.a (mgr.14373) 14963 : cluster [DBG] pgmap v10377: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 7.1 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:23:10.269 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:23:10.269 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:23:10.269 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:23:10.269 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:23:10.269 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:23:11.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:23:10 smithi157 bash[24585]: audit 2024-09-16T11:23:09.817355+0000 mgr.a (mgr.14373) 14964 : audit [DBG] from='client.323661 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:23:11.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:23:10 smithi086 bash[24289]: audit 2024-09-16T11:23:09.817355+0000 mgr.a (mgr.14373) 14964 : audit [DBG] from='client.323661 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:23:11.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:23:10 smithi047 bash[22744]: audit 2024-09-16T11:23:09.817355+0000 mgr.a (mgr.14373) 14964 : audit [DBG] from='client.323661 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:23:12.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:23:11 smithi157 bash[24585]: cluster 2024-09-16T11:23:10.584791+0000 mgr.a (mgr.14373) 14965 : cluster [DBG] pgmap v10378: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:23:12.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:23:11 smithi086 bash[24289]: cluster 2024-09-16T11:23:10.584791+0000 mgr.a (mgr.14373) 14965 : cluster [DBG] pgmap v10378: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:23:12.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:23:11 smithi047 bash[22744]: cluster 2024-09-16T11:23:10.584791+0000 mgr.a (mgr.14373) 14965 : cluster [DBG] pgmap v10378: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:23:14.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:23:13 smithi157 bash[24585]: cluster 2024-09-16T11:23:12.587094+0000 mgr.a (mgr.14373) 14966 : cluster [DBG] pgmap v10379: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:23:14.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:23:13 smithi086 bash[24289]: cluster 2024-09-16T11:23:12.587094+0000 mgr.a (mgr.14373) 14966 : cluster [DBG] pgmap v10379: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:23:14.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:23:13 smithi047 bash[22744]: cluster 2024-09-16T11:23:12.587094+0000 mgr.a (mgr.14373) 14966 : cluster [DBG] pgmap v10379: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:23:15.271 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:23:15.272 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:23:15.272 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:23:16.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:23:15 smithi157 bash[24585]: cluster 2024-09-16T11:23:14.587852+0000 mgr.a (mgr.14373) 14967 : cluster [DBG] pgmap v10380: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:23:16.064 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:23:16.064 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:23:16.064 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:23:16.064 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:23:16.065 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:23:16.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:23:15 smithi086 bash[24289]: cluster 2024-09-16T11:23:14.587852+0000 mgr.a (mgr.14373) 14967 : cluster [DBG] pgmap v10380: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:23:16.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:23:15 smithi047 bash[22744]: cluster 2024-09-16T11:23:14.587852+0000 mgr.a (mgr.14373) 14967 : cluster [DBG] pgmap v10380: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:23:17.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:23:16 smithi157 bash[24585]: audit 2024-09-16T11:23:15.608351+0000 mgr.a (mgr.14373) 14968 : audit [DBG] from='client.323736 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:23:17.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:23:16 smithi086 bash[24289]: audit 2024-09-16T11:23:15.608351+0000 mgr.a (mgr.14373) 14968 : audit [DBG] from='client.323736 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:23:17.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:23:16 smithi047 bash[22744]: audit 2024-09-16T11:23:15.608351+0000 mgr.a (mgr.14373) 14968 : audit [DBG] from='client.323736 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:23:18.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:23:17 smithi157 bash[24585]: cluster 2024-09-16T11:23:16.590223+0000 mgr.a (mgr.14373) 14969 : cluster [DBG] pgmap v10381: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:23:18.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:23:17 smithi086 bash[24289]: cluster 2024-09-16T11:23:16.590223+0000 mgr.a (mgr.14373) 14969 : cluster [DBG] pgmap v10381: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:23:18.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:23:17 smithi047 bash[22744]: cluster 2024-09-16T11:23:16.590223+0000 mgr.a (mgr.14373) 14969 : cluster [DBG] pgmap v10381: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:23:20.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:23:19 smithi157 bash[24585]: cluster 2024-09-16T11:23:18.591030+0000 mgr.a (mgr.14373) 14970 : cluster [DBG] pgmap v10382: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:23:20.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:23:19 smithi086 bash[24289]: cluster 2024-09-16T11:23:18.591030+0000 mgr.a (mgr.14373) 14970 : cluster [DBG] pgmap v10382: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:23:20.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:23:19 smithi047 bash[22744]: cluster 2024-09-16T11:23:18.591030+0000 mgr.a (mgr.14373) 14970 : cluster [DBG] pgmap v10382: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:23:21.066 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:23:21.066 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:23:21.066 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:23:21.808 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:23:21.809 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:23:21.809 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:23:21.809 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:23:21.809 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:23:22.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:23:21 smithi157 bash[24585]: cluster 2024-09-16T11:23:20.591867+0000 mgr.a (mgr.14373) 14971 : cluster [DBG] pgmap v10383: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:23:22.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:23:21 smithi086 bash[24289]: cluster 2024-09-16T11:23:20.591867+0000 mgr.a (mgr.14373) 14971 : cluster [DBG] pgmap v10383: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:23:22.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:23:21 smithi047 bash[22744]: cluster 2024-09-16T11:23:20.591867+0000 mgr.a (mgr.14373) 14971 : cluster [DBG] pgmap v10383: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:23:23.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:23:22 smithi157 bash[24585]: audit 2024-09-16T11:23:21.396265+0000 mgr.a (mgr.14373) 14972 : audit [DBG] from='client.323811 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:23:23.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:23:22 smithi086 bash[24289]: audit 2024-09-16T11:23:21.396265+0000 mgr.a (mgr.14373) 14972 : audit [DBG] from='client.323811 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:23:23.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:23:22 smithi047 bash[22744]: audit 2024-09-16T11:23:21.396265+0000 mgr.a (mgr.14373) 14972 : audit [DBG] from='client.323811 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:23:24.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:23:23 smithi157 bash[24585]: cluster 2024-09-16T11:23:22.594764+0000 mgr.a (mgr.14373) 14973 : cluster [DBG] pgmap v10384: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:23:24.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:23:23 smithi086 bash[24289]: cluster 2024-09-16T11:23:22.594764+0000 mgr.a (mgr.14373) 14973 : cluster [DBG] pgmap v10384: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:23:24.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:23:23 smithi047 bash[22744]: cluster 2024-09-16T11:23:22.594764+0000 mgr.a (mgr.14373) 14973 : cluster [DBG] pgmap v10384: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:23:26.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:23:25 smithi157 bash[24585]: cluster 2024-09-16T11:23:24.595534+0000 mgr.a (mgr.14373) 14974 : cluster [DBG] pgmap v10385: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:23:26.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:23:25 smithi086 bash[24289]: cluster 2024-09-16T11:23:24.595534+0000 mgr.a (mgr.14373) 14974 : cluster [DBG] pgmap v10385: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:23:26.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:23:25 smithi047 bash[22744]: cluster 2024-09-16T11:23:24.595534+0000 mgr.a (mgr.14373) 14974 : cluster [DBG] pgmap v10385: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:23:26.810 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:23:26.811 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:23:26.811 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:23:27.596 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:23:27.596 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:23:27.596 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:23:27.596 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:23:27.596 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:23:28.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:23:27 smithi157 bash[24585]: cluster 2024-09-16T11:23:26.597595+0000 mgr.a (mgr.14373) 14975 : cluster [DBG] pgmap v10386: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:23:28.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:23:27 smithi157 bash[24585]: audit 2024-09-16T11:23:27.143309+0000 mgr.a (mgr.14373) 14976 : audit [DBG] from='client.323889 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:23:28.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:23:27 smithi086 bash[24289]: cluster 2024-09-16T11:23:26.597595+0000 mgr.a (mgr.14373) 14975 : cluster [DBG] pgmap v10386: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:23:28.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:23:27 smithi086 bash[24289]: audit 2024-09-16T11:23:27.143309+0000 mgr.a (mgr.14373) 14976 : audit [DBG] from='client.323889 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:23:28.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:23:27 smithi047 bash[22744]: cluster 2024-09-16T11:23:26.597595+0000 mgr.a (mgr.14373) 14975 : cluster [DBG] pgmap v10386: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:23:28.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:23:27 smithi047 bash[22744]: audit 2024-09-16T11:23:27.143309+0000 mgr.a (mgr.14373) 14976 : audit [DBG] from='client.323889 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:23:30.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:23:29 smithi157 bash[24585]: cluster 2024-09-16T11:23:28.598533+0000 mgr.a (mgr.14373) 14977 : cluster [DBG] pgmap v10387: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:23:30.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:23:29 smithi086 bash[24289]: cluster 2024-09-16T11:23:28.598533+0000 mgr.a (mgr.14373) 14977 : cluster [DBG] pgmap v10387: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:23:30.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:23:29 smithi047 bash[22744]: cluster 2024-09-16T11:23:28.598533+0000 mgr.a (mgr.14373) 14977 : cluster [DBG] pgmap v10387: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:23:32.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:23:31 smithi157 bash[24585]: cluster 2024-09-16T11:23:30.599367+0000 mgr.a (mgr.14373) 14978 : cluster [DBG] pgmap v10388: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T11:23:32.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:23:31 smithi086 bash[24289]: cluster 2024-09-16T11:23:30.599367+0000 mgr.a (mgr.14373) 14978 : cluster [DBG] pgmap v10388: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T11:23:32.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:23:31 smithi047 bash[22744]: cluster 2024-09-16T11:23:30.599367+0000 mgr.a (mgr.14373) 14978 : cluster [DBG] pgmap v10388: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T11:23:32.598 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:23:32.598 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:23:32.599 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:23:33.336 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:23:33.337 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:23:33.337 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:23:33.337 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:23:33.337 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:23:34.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:23:33 smithi157 bash[24585]: cluster 2024-09-16T11:23:32.600795+0000 mgr.a (mgr.14373) 14979 : cluster [DBG] pgmap v10389: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:23:34.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:23:33 smithi157 bash[24585]: audit 2024-09-16T11:23:32.926993+0000 mgr.a (mgr.14373) 14980 : audit [DBG] from='client.323967 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:23:34.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:23:33 smithi086 bash[24289]: cluster 2024-09-16T11:23:32.600795+0000 mgr.a (mgr.14373) 14979 : cluster [DBG] pgmap v10389: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:23:34.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:23:33 smithi086 bash[24289]: audit 2024-09-16T11:23:32.926993+0000 mgr.a (mgr.14373) 14980 : audit [DBG] from='client.323967 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:23:34.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:23:33 smithi047 bash[22744]: cluster 2024-09-16T11:23:32.600795+0000 mgr.a (mgr.14373) 14979 : cluster [DBG] pgmap v10389: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:23:34.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:23:33 smithi047 bash[22744]: audit 2024-09-16T11:23:32.926993+0000 mgr.a (mgr.14373) 14980 : audit [DBG] from='client.323967 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:23:36.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:23:35 smithi157 bash[24585]: cluster 2024-09-16T11:23:34.601673+0000 mgr.a (mgr.14373) 14981 : cluster [DBG] pgmap v10390: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:23:36.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:23:35 smithi086 bash[24289]: cluster 2024-09-16T11:23:34.601673+0000 mgr.a (mgr.14373) 14981 : cluster [DBG] pgmap v10390: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:23:36.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:23:35 smithi047 bash[22744]: cluster 2024-09-16T11:23:34.601673+0000 mgr.a (mgr.14373) 14981 : cluster [DBG] pgmap v10390: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:23:38.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:23:37 smithi157 bash[24585]: cluster 2024-09-16T11:23:36.603859+0000 mgr.a (mgr.14373) 14982 : cluster [DBG] pgmap v10391: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:23:38.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:23:37 smithi086 bash[24289]: cluster 2024-09-16T11:23:36.603859+0000 mgr.a (mgr.14373) 14982 : cluster [DBG] pgmap v10391: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:23:38.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:23:37 smithi047 bash[22744]: cluster 2024-09-16T11:23:36.603859+0000 mgr.a (mgr.14373) 14982 : cluster [DBG] pgmap v10391: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:23:38.338 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:23:38.339 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:23:38.339 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:23:39.093 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:23:39.094 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:23:39.094 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:23:39.094 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:23:39.094 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:23:40.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:23:39 smithi157 bash[24585]: cluster 2024-09-16T11:23:38.604590+0000 mgr.a (mgr.14373) 14983 : cluster [DBG] pgmap v10392: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:23:40.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:23:39 smithi157 bash[24585]: audit 2024-09-16T11:23:38.669332+0000 mgr.a (mgr.14373) 14984 : audit [DBG] from='client.324045 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:23:40.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:23:39 smithi086 bash[24289]: cluster 2024-09-16T11:23:38.604590+0000 mgr.a (mgr.14373) 14983 : cluster [DBG] pgmap v10392: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:23:40.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:23:39 smithi086 bash[24289]: audit 2024-09-16T11:23:38.669332+0000 mgr.a (mgr.14373) 14984 : audit [DBG] from='client.324045 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:23:40.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:23:39 smithi047 bash[22744]: cluster 2024-09-16T11:23:38.604590+0000 mgr.a (mgr.14373) 14983 : cluster [DBG] pgmap v10392: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:23:40.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:23:39 smithi047 bash[22744]: audit 2024-09-16T11:23:38.669332+0000 mgr.a (mgr.14373) 14984 : audit [DBG] from='client.324045 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:23:42.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:23:41 smithi157 bash[24585]: cluster 2024-09-16T11:23:40.605515+0000 mgr.a (mgr.14373) 14985 : cluster [DBG] pgmap v10393: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:23:42.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:23:41 smithi086 bash[24289]: cluster 2024-09-16T11:23:40.605515+0000 mgr.a (mgr.14373) 14985 : cluster [DBG] pgmap v10393: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:23:42.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:23:41 smithi047 bash[22744]: cluster 2024-09-16T11:23:40.605515+0000 mgr.a (mgr.14373) 14985 : cluster [DBG] pgmap v10393: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:23:44.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:23:43 smithi157 bash[24585]: cluster 2024-09-16T11:23:42.607871+0000 mgr.a (mgr.14373) 14986 : cluster [DBG] pgmap v10394: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:23:44.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:23:43 smithi086 bash[24289]: cluster 2024-09-16T11:23:42.607871+0000 mgr.a (mgr.14373) 14986 : cluster [DBG] pgmap v10394: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:23:44.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:23:43 smithi047 bash[22744]: cluster 2024-09-16T11:23:42.607871+0000 mgr.a (mgr.14373) 14986 : cluster [DBG] pgmap v10394: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:23:44.097 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:23:44.097 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:23:44.097 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:23:44.871 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:23:44.871 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:23:44.871 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:23:44.871 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:23:44.871 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:23:46.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:23:45 smithi157 bash[24585]: audit 2024-09-16T11:23:44.429968+0000 mgr.a (mgr.14373) 14987 : audit [DBG] from='client.324120 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:23:46.058 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:23:45 smithi157 bash[24585]: cluster 2024-09-16T11:23:44.608475+0000 mgr.a (mgr.14373) 14988 : cluster [DBG] pgmap v10395: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:23:46.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:23:45 smithi086 bash[24289]: audit 2024-09-16T11:23:44.429968+0000 mgr.a (mgr.14373) 14987 : audit [DBG] from='client.324120 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:23:46.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:23:45 smithi086 bash[24289]: cluster 2024-09-16T11:23:44.608475+0000 mgr.a (mgr.14373) 14988 : cluster [DBG] pgmap v10395: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:23:46.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:23:45 smithi047 bash[22744]: audit 2024-09-16T11:23:44.429968+0000 mgr.a (mgr.14373) 14987 : audit [DBG] from='client.324120 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:23:46.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:23:45 smithi047 bash[22744]: cluster 2024-09-16T11:23:44.608475+0000 mgr.a (mgr.14373) 14988 : cluster [DBG] pgmap v10395: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:23:48.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:23:47 smithi157 bash[24585]: cluster 2024-09-16T11:23:46.610736+0000 mgr.a (mgr.14373) 14989 : cluster [DBG] pgmap v10396: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:23:48.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:23:47 smithi086 bash[24289]: cluster 2024-09-16T11:23:46.610736+0000 mgr.a (mgr.14373) 14989 : cluster [DBG] pgmap v10396: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:23:48.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:23:47 smithi047 bash[22744]: cluster 2024-09-16T11:23:46.610736+0000 mgr.a (mgr.14373) 14989 : cluster [DBG] pgmap v10396: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:23:49.873 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:23:49.873 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:23:49.873 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:23:50.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:23:49 smithi157 bash[24585]: cluster 2024-09-16T11:23:48.611510+0000 mgr.a (mgr.14373) 14990 : cluster [DBG] pgmap v10397: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:23:50.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:23:49 smithi086 bash[24289]: cluster 2024-09-16T11:23:48.611510+0000 mgr.a (mgr.14373) 14990 : cluster [DBG] pgmap v10397: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:23:50.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:23:49 smithi047 bash[22744]: cluster 2024-09-16T11:23:48.611510+0000 mgr.a (mgr.14373) 14990 : cluster [DBG] pgmap v10397: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:23:50.645 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:23:50.646 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:23:50.646 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:23:50.646 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:23:50.646 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:23:52.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:23:51 smithi157 bash[24585]: audit 2024-09-16T11:23:50.205048+0000 mgr.a (mgr.14373) 14991 : audit [DBG] from='client.324198 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:23:52.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:23:51 smithi157 bash[24585]: cluster 2024-09-16T11:23:50.612041+0000 mgr.a (mgr.14373) 14992 : cluster [DBG] pgmap v10398: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:23:52.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:23:51 smithi086 bash[24289]: audit 2024-09-16T11:23:50.205048+0000 mgr.a (mgr.14373) 14991 : audit [DBG] from='client.324198 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:23:52.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:23:51 smithi086 bash[24289]: cluster 2024-09-16T11:23:50.612041+0000 mgr.a (mgr.14373) 14992 : cluster [DBG] pgmap v10398: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:23:52.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:23:51 smithi047 bash[22744]: audit 2024-09-16T11:23:50.205048+0000 mgr.a (mgr.14373) 14991 : audit [DBG] from='client.324198 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:23:52.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:23:51 smithi047 bash[22744]: cluster 2024-09-16T11:23:50.612041+0000 mgr.a (mgr.14373) 14992 : cluster [DBG] pgmap v10398: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:23:54.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:23:53 smithi157 bash[24585]: cluster 2024-09-16T11:23:52.614224+0000 mgr.a (mgr.14373) 14993 : cluster [DBG] pgmap v10399: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:23:54.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:23:53 smithi086 bash[24289]: cluster 2024-09-16T11:23:52.614224+0000 mgr.a (mgr.14373) 14993 : cluster [DBG] pgmap v10399: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:23:54.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:23:53 smithi047 bash[22744]: cluster 2024-09-16T11:23:52.614224+0000 mgr.a (mgr.14373) 14993 : cluster [DBG] pgmap v10399: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:23:55.647 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:23:55.648 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:23:55.648 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:23:56.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:23:55 smithi157 bash[24585]: cluster 2024-09-16T11:23:54.614988+0000 mgr.a (mgr.14373) 14994 : cluster [DBG] pgmap v10400: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:23:56.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:23:55 smithi086 bash[24289]: cluster 2024-09-16T11:23:54.614988+0000 mgr.a (mgr.14373) 14994 : cluster [DBG] pgmap v10400: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:23:56.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:23:55 smithi047 bash[22744]: cluster 2024-09-16T11:23:54.614988+0000 mgr.a (mgr.14373) 14994 : cluster [DBG] pgmap v10400: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:23:56.444 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:23:56.445 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:23:56.445 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:23:56.445 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:23:56.445 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:23:57.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:23:56 smithi157 bash[24585]: audit 2024-09-16T11:23:55.985462+0000 mgr.a (mgr.14373) 14995 : audit [DBG] from='client.324276 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:23:57.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:23:56 smithi086 bash[24289]: audit 2024-09-16T11:23:55.985462+0000 mgr.a (mgr.14373) 14995 : audit [DBG] from='client.324276 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:23:57.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:23:56 smithi047 bash[22744]: audit 2024-09-16T11:23:55.985462+0000 mgr.a (mgr.14373) 14995 : audit [DBG] from='client.324276 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:23:58.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:23:57 smithi157 bash[24585]: cluster 2024-09-16T11:23:56.617320+0000 mgr.a (mgr.14373) 14996 : cluster [DBG] pgmap v10401: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-16T11:23:58.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:23:57 smithi086 bash[24289]: cluster 2024-09-16T11:23:56.617320+0000 mgr.a (mgr.14373) 14996 : cluster [DBG] pgmap v10401: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-16T11:23:58.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:23:57 smithi047 bash[22744]: cluster 2024-09-16T11:23:56.617320+0000 mgr.a (mgr.14373) 14996 : cluster [DBG] pgmap v10401: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-16T11:24:00.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:23:59 smithi157 bash[24585]: cluster 2024-09-16T11:23:58.618068+0000 mgr.a (mgr.14373) 14997 : cluster [DBG] pgmap v10402: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T11:24:00.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:23:59 smithi086 bash[24289]: cluster 2024-09-16T11:23:58.618068+0000 mgr.a (mgr.14373) 14997 : cluster [DBG] pgmap v10402: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T11:24:00.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:23:59 smithi047 bash[22744]: cluster 2024-09-16T11:23:58.618068+0000 mgr.a (mgr.14373) 14997 : cluster [DBG] pgmap v10402: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T11:24:01.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:24:00 smithi086 bash[24289]: audit 2024-09-16T11:24:00.289381+0000 mon.b (mon.2) 1366 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T11:24:01.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:24:00 smithi047 bash[22744]: audit 2024-09-16T11:24:00.289381+0000 mon.b (mon.2) 1366 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T11:24:01.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:24:00 smithi157 bash[24585]: audit 2024-09-16T11:24:00.289381+0000 mon.b (mon.2) 1366 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T11:24:01.446 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:24:01.446 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:24:01.446 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:24:02.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:24:01 smithi086 bash[24289]: cluster 2024-09-16T11:24:00.618813+0000 mgr.a (mgr.14373) 14998 : cluster [DBG] pgmap v10403: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T11:24:02.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:24:01 smithi086 bash[24289]: audit 2024-09-16T11:24:01.127757+0000 mon.b (mon.2) 1367 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T11:24:02.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:24:01 smithi086 bash[24289]: audit 2024-09-16T11:24:01.129953+0000 mon.b (mon.2) 1368 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T11:24:02.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:24:01 smithi086 bash[24289]: audit 2024-09-16T11:24:01.142087+0000 mon.a (mon.0) 1464 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:24:02.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:24:01 smithi086 bash[24289]: audit 2024-09-16T11:24:01.147406+0000 mon.b (mon.2) 1369 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:24:02.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:24:01 smithi086 bash[24289]: audit 2024-09-16T11:24:01.150209+0000 mgr.a (mgr.14373) 14999 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:24:02.093 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 11:24:01 smithi047 bash[22994]: debug 2024-09-16T11:24:01.896+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T11:24:02.093 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 11:24:01 smithi047 bash[22994]: debug 2024-09-16T11:24:01.908+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T11:24:02.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:24:01 smithi047 bash[22744]: cluster 2024-09-16T11:24:00.618813+0000 mgr.a (mgr.14373) 14998 : cluster [DBG] pgmap v10403: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T11:24:02.094 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:24:01 smithi047 bash[22744]: audit 2024-09-16T11:24:01.127757+0000 mon.b (mon.2) 1367 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T11:24:02.094 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:24:01 smithi047 bash[22744]: audit 2024-09-16T11:24:01.129953+0000 mon.b (mon.2) 1368 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T11:24:02.094 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:24:01 smithi047 bash[22744]: audit 2024-09-16T11:24:01.142087+0000 mon.a (mon.0) 1464 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:24:02.094 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:24:01 smithi047 bash[22744]: audit 2024-09-16T11:24:01.147406+0000 mon.b (mon.2) 1369 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:24:02.094 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:24:01 smithi047 bash[22744]: audit 2024-09-16T11:24:01.150209+0000 mgr.a (mgr.14373) 14999 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:24:02.301 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:24:02.301 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:24:02.302 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:24:02.302 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:24:02.302 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:24:02.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:24:01 smithi157 bash[24585]: cluster 2024-09-16T11:24:00.618813+0000 mgr.a (mgr.14373) 14998 : cluster [DBG] pgmap v10403: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T11:24:02.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:24:01 smithi157 bash[24585]: audit 2024-09-16T11:24:01.127757+0000 mon.b (mon.2) 1367 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T11:24:02.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:24:01 smithi157 bash[24585]: audit 2024-09-16T11:24:01.129953+0000 mon.b (mon.2) 1368 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T11:24:02.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:24:01 smithi157 bash[24585]: audit 2024-09-16T11:24:01.142087+0000 mon.a (mon.0) 1464 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:24:02.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:24:01 smithi157 bash[24585]: audit 2024-09-16T11:24:01.147406+0000 mon.b (mon.2) 1369 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:24:02.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:24:01 smithi157 bash[24585]: audit 2024-09-16T11:24:01.150209+0000 mgr.a (mgr.14373) 14999 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:24:03.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:24:02 smithi086 bash[24289]: audit 2024-09-16T11:24:01.770488+0000 mgr.a (mgr.14373) 15000 : audit [DBG] from='client.324405 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:24:03.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:24:02 smithi086 bash[24289]: audit 2024-09-16T11:24:01.899916+0000 mgr.a (mgr.14373) 15001 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T11:24:03.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:24:02 smithi086 bash[24289]: cephadm 2024-09-16T11:24:01.912052+0000 mgr.a (mgr.14373) 15002 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T11:24:03.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:24:02 smithi047 bash[22744]: audit 2024-09-16T11:24:01.770488+0000 mgr.a (mgr.14373) 15000 : audit [DBG] from='client.324405 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:24:03.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:24:02 smithi047 bash[22744]: audit 2024-09-16T11:24:01.899916+0000 mgr.a (mgr.14373) 15001 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T11:24:03.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:24:02 smithi047 bash[22744]: cephadm 2024-09-16T11:24:01.912052+0000 mgr.a (mgr.14373) 15002 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T11:24:03.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:24:02 smithi157 bash[24585]: audit 2024-09-16T11:24:01.770488+0000 mgr.a (mgr.14373) 15000 : audit [DBG] from='client.324405 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:24:03.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:24:02 smithi157 bash[24585]: audit 2024-09-16T11:24:01.899916+0000 mgr.a (mgr.14373) 15001 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T11:24:03.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:24:02 smithi157 bash[24585]: cephadm 2024-09-16T11:24:01.912052+0000 mgr.a (mgr.14373) 15002 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T11:24:04.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:24:03 smithi047 bash[22744]: cluster 2024-09-16T11:24:02.621625+0000 mgr.a (mgr.14373) 15003 : cluster [DBG] pgmap v10404: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 2.9 KiB/s rd, 85 B/s wr, 2 op/s 2024-09-16T11:24:04.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:24:03 smithi157 bash[24585]: cluster 2024-09-16T11:24:02.621625+0000 mgr.a (mgr.14373) 15003 : cluster [DBG] pgmap v10404: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 2.9 KiB/s rd, 85 B/s wr, 2 op/s 2024-09-16T11:24:04.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:24:03 smithi086 bash[24289]: cluster 2024-09-16T11:24:02.621625+0000 mgr.a (mgr.14373) 15003 : cluster [DBG] pgmap v10404: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 2.9 KiB/s rd, 85 B/s wr, 2 op/s 2024-09-16T11:24:06.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:24:05 smithi047 bash[22744]: cluster 2024-09-16T11:24:04.622588+0000 mgr.a (mgr.14373) 15004 : cluster [DBG] pgmap v10405: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 85 B/s wr, 2 op/s 2024-09-16T11:24:06.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:24:05 smithi157 bash[24585]: cluster 2024-09-16T11:24:04.622588+0000 mgr.a (mgr.14373) 15004 : cluster [DBG] pgmap v10405: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 85 B/s wr, 2 op/s 2024-09-16T11:24:06.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:24:05 smithi086 bash[24289]: cluster 2024-09-16T11:24:04.622588+0000 mgr.a (mgr.14373) 15004 : cluster [DBG] pgmap v10405: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 85 B/s wr, 2 op/s 2024-09-16T11:24:07.303 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:24:07.304 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:24:07.304 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:24:08.086 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:24:08.087 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:24:08.087 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:24:08.087 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:24:08.087 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:24:08.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:24:07 smithi047 bash[22744]: cluster 2024-09-16T11:24:06.624529+0000 mgr.a (mgr.14373) 15005 : cluster [DBG] pgmap v10406: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:24:08.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:24:07 smithi157 bash[24585]: cluster 2024-09-16T11:24:06.624529+0000 mgr.a (mgr.14373) 15005 : cluster [DBG] pgmap v10406: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:24:08.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:24:07 smithi086 bash[24289]: cluster 2024-09-16T11:24:06.624529+0000 mgr.a (mgr.14373) 15005 : cluster [DBG] pgmap v10406: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:24:09.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:24:08 smithi047 bash[22744]: audit 2024-09-16T11:24:07.635762+0000 mgr.a (mgr.14373) 15006 : audit [DBG] from='client.324531 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:24:09.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:24:08 smithi157 bash[24585]: audit 2024-09-16T11:24:07.635762+0000 mgr.a (mgr.14373) 15006 : audit [DBG] from='client.324531 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:24:09.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:24:08 smithi086 bash[24289]: audit 2024-09-16T11:24:07.635762+0000 mgr.a (mgr.14373) 15006 : audit [DBG] from='client.324531 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:24:10.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:24:09 smithi047 bash[22744]: cluster 2024-09-16T11:24:08.625502+0000 mgr.a (mgr.14373) 15007 : cluster [DBG] pgmap v10407: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T11:24:10.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:24:09 smithi157 bash[24585]: cluster 2024-09-16T11:24:08.625502+0000 mgr.a (mgr.14373) 15007 : cluster [DBG] pgmap v10407: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T11:24:10.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:24:09 smithi086 bash[24289]: cluster 2024-09-16T11:24:08.625502+0000 mgr.a (mgr.14373) 15007 : cluster [DBG] pgmap v10407: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T11:24:12.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:24:11 smithi157 bash[24585]: cluster 2024-09-16T11:24:10.626303+0000 mgr.a (mgr.14373) 15008 : cluster [DBG] pgmap v10408: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T11:24:12.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:24:11 smithi086 bash[24289]: cluster 2024-09-16T11:24:10.626303+0000 mgr.a (mgr.14373) 15008 : cluster [DBG] pgmap v10408: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T11:24:12.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:24:11 smithi047 bash[22744]: cluster 2024-09-16T11:24:10.626303+0000 mgr.a (mgr.14373) 15008 : cluster [DBG] pgmap v10408: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T11:24:13.088 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:24:13.089 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:24:13.089 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:24:13.838 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:24:13.838 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:24:13.838 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:24:13.838 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:24:13.838 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:24:14.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:24:13 smithi157 bash[24585]: cluster 2024-09-16T11:24:12.628567+0000 mgr.a (mgr.14373) 15009 : cluster [DBG] pgmap v10409: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 7.4 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:24:14.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:24:13 smithi086 bash[24289]: cluster 2024-09-16T11:24:12.628567+0000 mgr.a (mgr.14373) 15009 : cluster [DBG] pgmap v10409: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 7.4 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:24:14.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:24:13 smithi047 bash[22744]: cluster 2024-09-16T11:24:12.628567+0000 mgr.a (mgr.14373) 15009 : cluster [DBG] pgmap v10409: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 7.4 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:24:15.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:24:14 smithi157 bash[24585]: audit 2024-09-16T11:24:13.422404+0000 mgr.a (mgr.14373) 15010 : audit [DBG] from='client.324609 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:24:15.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:24:14 smithi086 bash[24289]: audit 2024-09-16T11:24:13.422404+0000 mgr.a (mgr.14373) 15010 : audit [DBG] from='client.324609 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:24:15.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:24:14 smithi047 bash[22744]: audit 2024-09-16T11:24:13.422404+0000 mgr.a (mgr.14373) 15010 : audit [DBG] from='client.324609 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:24:16.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:24:15 smithi157 bash[24585]: cluster 2024-09-16T11:24:14.629461+0000 mgr.a (mgr.14373) 15011 : cluster [DBG] pgmap v10410: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 5.9 KiB/s rd, 341 B/s wr, 5 op/s 2024-09-16T11:24:16.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:24:15 smithi086 bash[24289]: cluster 2024-09-16T11:24:14.629461+0000 mgr.a (mgr.14373) 15011 : cluster [DBG] pgmap v10410: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 5.9 KiB/s rd, 341 B/s wr, 5 op/s 2024-09-16T11:24:16.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:24:15 smithi047 bash[22744]: cluster 2024-09-16T11:24:14.629461+0000 mgr.a (mgr.14373) 15011 : cluster [DBG] pgmap v10410: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 5.9 KiB/s rd, 341 B/s wr, 5 op/s 2024-09-16T11:24:18.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:24:17 smithi157 bash[24585]: cluster 2024-09-16T11:24:16.631642+0000 mgr.a (mgr.14373) 15012 : cluster [DBG] pgmap v10411: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 6.8 KiB/s rd, 341 B/s wr, 6 op/s 2024-09-16T11:24:18.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:24:17 smithi086 bash[24289]: cluster 2024-09-16T11:24:16.631642+0000 mgr.a (mgr.14373) 15012 : cluster [DBG] pgmap v10411: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 6.8 KiB/s rd, 341 B/s wr, 6 op/s 2024-09-16T11:24:18.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:24:17 smithi047 bash[22744]: cluster 2024-09-16T11:24:16.631642+0000 mgr.a (mgr.14373) 15012 : cluster [DBG] pgmap v10411: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 6.8 KiB/s rd, 341 B/s wr, 6 op/s 2024-09-16T11:24:18.839 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:24:18.840 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:24:18.840 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:24:19.589 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:24:19.590 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:24:19.590 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:24:19.590 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:24:19.590 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:24:20.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:24:19 smithi157 bash[24585]: cluster 2024-09-16T11:24:18.632421+0000 mgr.a (mgr.14373) 15013 : cluster [DBG] pgmap v10412: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:24:20.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:24:19 smithi157 bash[24585]: audit 2024-09-16T11:24:19.170853+0000 mgr.a (mgr.14373) 15014 : audit [DBG] from='client.324687 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:24:20.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:24:19 smithi086 bash[24289]: cluster 2024-09-16T11:24:18.632421+0000 mgr.a (mgr.14373) 15013 : cluster [DBG] pgmap v10412: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:24:20.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:24:19 smithi086 bash[24289]: audit 2024-09-16T11:24:19.170853+0000 mgr.a (mgr.14373) 15014 : audit [DBG] from='client.324687 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:24:20.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:24:19 smithi047 bash[22744]: cluster 2024-09-16T11:24:18.632421+0000 mgr.a (mgr.14373) 15013 : cluster [DBG] pgmap v10412: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:24:20.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:24:19 smithi047 bash[22744]: audit 2024-09-16T11:24:19.170853+0000 mgr.a (mgr.14373) 15014 : audit [DBG] from='client.324687 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:24:22.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:24:21 smithi157 bash[24585]: cluster 2024-09-16T11:24:20.633351+0000 mgr.a (mgr.14373) 15015 : cluster [DBG] pgmap v10413: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:24:22.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:24:21 smithi086 bash[24289]: cluster 2024-09-16T11:24:20.633351+0000 mgr.a (mgr.14373) 15015 : cluster [DBG] pgmap v10413: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:24:22.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:24:21 smithi047 bash[22744]: cluster 2024-09-16T11:24:20.633351+0000 mgr.a (mgr.14373) 15015 : cluster [DBG] pgmap v10413: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:24:24.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:24:23 smithi157 bash[24585]: cluster 2024-09-16T11:24:22.635682+0000 mgr.a (mgr.14373) 15016 : cluster [DBG] pgmap v10414: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:24:24.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:24:23 smithi086 bash[24289]: cluster 2024-09-16T11:24:22.635682+0000 mgr.a (mgr.14373) 15016 : cluster [DBG] pgmap v10414: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:24:24.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:24:23 smithi047 bash[22744]: cluster 2024-09-16T11:24:22.635682+0000 mgr.a (mgr.14373) 15016 : cluster [DBG] pgmap v10414: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:24:24.591 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:24:24.592 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:24:24.592 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:24:25.354 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:24:25.354 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:24:25.354 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:24:25.354 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:24:25.355 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:24:26.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:24:25 smithi157 bash[24585]: cluster 2024-09-16T11:24:24.636600+0000 mgr.a (mgr.14373) 15017 : cluster [DBG] pgmap v10415: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:24:26.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:24:25 smithi157 bash[24585]: audit 2024-09-16T11:24:24.923496+0000 mgr.a (mgr.14373) 15018 : audit [DBG] from='client.324759 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:24:26.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:24:25 smithi086 bash[24289]: cluster 2024-09-16T11:24:24.636600+0000 mgr.a (mgr.14373) 15017 : cluster [DBG] pgmap v10415: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:24:26.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:24:25 smithi086 bash[24289]: audit 2024-09-16T11:24:24.923496+0000 mgr.a (mgr.14373) 15018 : audit [DBG] from='client.324759 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:24:26.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:24:25 smithi047 bash[22744]: cluster 2024-09-16T11:24:24.636600+0000 mgr.a (mgr.14373) 15017 : cluster [DBG] pgmap v10415: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:24:26.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:24:25 smithi047 bash[22744]: audit 2024-09-16T11:24:24.923496+0000 mgr.a (mgr.14373) 15018 : audit [DBG] from='client.324759 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:24:28.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:24:27 smithi157 bash[24585]: cluster 2024-09-16T11:24:26.638888+0000 mgr.a (mgr.14373) 15019 : cluster [DBG] pgmap v10416: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:24:28.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:24:27 smithi086 bash[24289]: cluster 2024-09-16T11:24:26.638888+0000 mgr.a (mgr.14373) 15019 : cluster [DBG] pgmap v10416: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:24:28.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:24:27 smithi047 bash[22744]: cluster 2024-09-16T11:24:26.638888+0000 mgr.a (mgr.14373) 15019 : cluster [DBG] pgmap v10416: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:24:30.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:24:29 smithi157 bash[24585]: cluster 2024-09-16T11:24:28.639646+0000 mgr.a (mgr.14373) 15020 : cluster [DBG] pgmap v10417: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:24:30.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:24:29 smithi086 bash[24289]: cluster 2024-09-16T11:24:28.639646+0000 mgr.a (mgr.14373) 15020 : cluster [DBG] pgmap v10417: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:24:30.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:24:29 smithi047 bash[22744]: cluster 2024-09-16T11:24:28.639646+0000 mgr.a (mgr.14373) 15020 : cluster [DBG] pgmap v10417: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:24:30.355 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:24:30.356 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:24:30.356 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:24:31.135 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:24:31.135 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:24:31.135 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:24:31.135 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:24:31.135 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:24:32.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:24:31 smithi157 bash[24585]: cluster 2024-09-16T11:24:30.640362+0000 mgr.a (mgr.14373) 15021 : cluster [DBG] pgmap v10418: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:24:32.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:24:31 smithi157 bash[24585]: audit 2024-09-16T11:24:30.687743+0000 mgr.a (mgr.14373) 15022 : audit [DBG] from='client.324837 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:24:32.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:24:31 smithi086 bash[24289]: cluster 2024-09-16T11:24:30.640362+0000 mgr.a (mgr.14373) 15021 : cluster [DBG] pgmap v10418: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:24:32.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:24:31 smithi086 bash[24289]: audit 2024-09-16T11:24:30.687743+0000 mgr.a (mgr.14373) 15022 : audit [DBG] from='client.324837 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:24:32.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:24:31 smithi047 bash[22744]: cluster 2024-09-16T11:24:30.640362+0000 mgr.a (mgr.14373) 15021 : cluster [DBG] pgmap v10418: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:24:32.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:24:31 smithi047 bash[22744]: audit 2024-09-16T11:24:30.687743+0000 mgr.a (mgr.14373) 15022 : audit [DBG] from='client.324837 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:24:34.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:24:33 smithi157 bash[24585]: cluster 2024-09-16T11:24:32.642695+0000 mgr.a (mgr.14373) 15023 : cluster [DBG] pgmap v10419: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:24:34.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:24:33 smithi086 bash[24289]: cluster 2024-09-16T11:24:32.642695+0000 mgr.a (mgr.14373) 15023 : cluster [DBG] pgmap v10419: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:24:34.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:24:33 smithi047 bash[22744]: cluster 2024-09-16T11:24:32.642695+0000 mgr.a (mgr.14373) 15023 : cluster [DBG] pgmap v10419: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:24:36.136 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:24:36.137 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:24:36.137 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:24:36.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:24:35 smithi157 bash[24585]: cluster 2024-09-16T11:24:34.643464+0000 mgr.a (mgr.14373) 15024 : cluster [DBG] pgmap v10420: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:24:36.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:24:35 smithi086 bash[24289]: cluster 2024-09-16T11:24:34.643464+0000 mgr.a (mgr.14373) 15024 : cluster [DBG] pgmap v10420: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:24:36.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:24:35 smithi047 bash[22744]: cluster 2024-09-16T11:24:34.643464+0000 mgr.a (mgr.14373) 15024 : cluster [DBG] pgmap v10420: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:24:36.897 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:24:36.897 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:24:36.897 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:24:36.897 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:24:36.897 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:24:38.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:24:37 smithi157 bash[24585]: audit 2024-09-16T11:24:36.464526+0000 mgr.a (mgr.14373) 15025 : audit [DBG] from='client.324912 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:24:38.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:24:37 smithi157 bash[24585]: cluster 2024-09-16T11:24:36.644997+0000 mgr.a (mgr.14373) 15026 : cluster [DBG] pgmap v10421: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:24:38.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:24:37 smithi086 bash[24289]: audit 2024-09-16T11:24:36.464526+0000 mgr.a (mgr.14373) 15025 : audit [DBG] from='client.324912 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:24:38.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:24:37 smithi086 bash[24289]: cluster 2024-09-16T11:24:36.644997+0000 mgr.a (mgr.14373) 15026 : cluster [DBG] pgmap v10421: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:24:38.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:24:37 smithi047 bash[22744]: audit 2024-09-16T11:24:36.464526+0000 mgr.a (mgr.14373) 15025 : audit [DBG] from='client.324912 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:24:38.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:24:37 smithi047 bash[22744]: cluster 2024-09-16T11:24:36.644997+0000 mgr.a (mgr.14373) 15026 : cluster [DBG] pgmap v10421: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:24:40.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:24:39 smithi157 bash[24585]: cluster 2024-09-16T11:24:38.645879+0000 mgr.a (mgr.14373) 15027 : cluster [DBG] pgmap v10422: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T11:24:40.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:24:39 smithi086 bash[24289]: cluster 2024-09-16T11:24:38.645879+0000 mgr.a (mgr.14373) 15027 : cluster [DBG] pgmap v10422: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T11:24:40.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:24:39 smithi047 bash[22744]: cluster 2024-09-16T11:24:38.645879+0000 mgr.a (mgr.14373) 15027 : cluster [DBG] pgmap v10422: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T11:24:41.899 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:24:41.899 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:24:41.899 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:24:42.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:24:41 smithi157 bash[24585]: cluster 2024-09-16T11:24:40.646669+0000 mgr.a (mgr.14373) 15028 : cluster [DBG] pgmap v10423: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T11:24:42.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:24:41 smithi086 bash[24289]: cluster 2024-09-16T11:24:40.646669+0000 mgr.a (mgr.14373) 15028 : cluster [DBG] pgmap v10423: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T11:24:42.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:24:41 smithi047 bash[22744]: cluster 2024-09-16T11:24:40.646669+0000 mgr.a (mgr.14373) 15028 : cluster [DBG] pgmap v10423: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T11:24:42.681 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:24:42.681 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:24:42.681 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:24:42.681 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:24:42.681 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:24:44.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:24:43 smithi157 bash[24585]: audit 2024-09-16T11:24:42.240545+0000 mgr.a (mgr.14373) 15029 : audit [DBG] from='client.324990 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:24:44.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:24:43 smithi157 bash[24585]: cluster 2024-09-16T11:24:42.647869+0000 mgr.a (mgr.14373) 15030 : cluster [DBG] pgmap v10424: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:24:44.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:24:43 smithi086 bash[24289]: audit 2024-09-16T11:24:42.240545+0000 mgr.a (mgr.14373) 15029 : audit [DBG] from='client.324990 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:24:44.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:24:43 smithi086 bash[24289]: cluster 2024-09-16T11:24:42.647869+0000 mgr.a (mgr.14373) 15030 : cluster [DBG] pgmap v10424: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:24:44.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:24:43 smithi047 bash[22744]: audit 2024-09-16T11:24:42.240545+0000 mgr.a (mgr.14373) 15029 : audit [DBG] from='client.324990 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:24:44.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:24:43 smithi047 bash[22744]: cluster 2024-09-16T11:24:42.647869+0000 mgr.a (mgr.14373) 15030 : cluster [DBG] pgmap v10424: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:24:46.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:24:45 smithi157 bash[24585]: cluster 2024-09-16T11:24:44.648745+0000 mgr.a (mgr.14373) 15031 : cluster [DBG] pgmap v10425: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T11:24:46.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:24:45 smithi086 bash[24289]: cluster 2024-09-16T11:24:44.648745+0000 mgr.a (mgr.14373) 15031 : cluster [DBG] pgmap v10425: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T11:24:46.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:24:45 smithi047 bash[22744]: cluster 2024-09-16T11:24:44.648745+0000 mgr.a (mgr.14373) 15031 : cluster [DBG] pgmap v10425: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T11:24:47.682 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:24:47.683 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:24:47.683 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:24:48.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:24:47 smithi157 bash[24585]: cluster 2024-09-16T11:24:46.650729+0000 mgr.a (mgr.14373) 15032 : cluster [DBG] pgmap v10426: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:24:48.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:24:47 smithi086 bash[24289]: cluster 2024-09-16T11:24:46.650729+0000 mgr.a (mgr.14373) 15032 : cluster [DBG] pgmap v10426: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:24:48.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:24:47 smithi047 bash[22744]: cluster 2024-09-16T11:24:46.650729+0000 mgr.a (mgr.14373) 15032 : cluster [DBG] pgmap v10426: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:24:48.436 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:24:48.436 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:24:48.436 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:24:48.436 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:24:48.436 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:24:49.309 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:24:48 smithi157 bash[24585]: audit 2024-09-16T11:24:48.012245+0000 mgr.a (mgr.14373) 15033 : audit [DBG] from='client.325065 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:24:49.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:24:48 smithi086 bash[24289]: audit 2024-09-16T11:24:48.012245+0000 mgr.a (mgr.14373) 15033 : audit [DBG] from='client.325065 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:24:49.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:24:48 smithi047 bash[22744]: audit 2024-09-16T11:24:48.012245+0000 mgr.a (mgr.14373) 15033 : audit [DBG] from='client.325065 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:24:50.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:24:49 smithi157 bash[24585]: cluster 2024-09-16T11:24:48.651623+0000 mgr.a (mgr.14373) 15034 : cluster [DBG] pgmap v10427: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:24:50.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:24:49 smithi086 bash[24289]: cluster 2024-09-16T11:24:48.651623+0000 mgr.a (mgr.14373) 15034 : cluster [DBG] pgmap v10427: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:24:50.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:24:49 smithi047 bash[22744]: cluster 2024-09-16T11:24:48.651623+0000 mgr.a (mgr.14373) 15034 : cluster [DBG] pgmap v10427: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:24:52.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:24:51 smithi157 bash[24585]: cluster 2024-09-16T11:24:50.652395+0000 mgr.a (mgr.14373) 15035 : cluster [DBG] pgmap v10428: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:24:52.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:24:51 smithi086 bash[24289]: cluster 2024-09-16T11:24:50.652395+0000 mgr.a (mgr.14373) 15035 : cluster [DBG] pgmap v10428: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:24:52.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:24:51 smithi047 bash[22744]: cluster 2024-09-16T11:24:50.652395+0000 mgr.a (mgr.14373) 15035 : cluster [DBG] pgmap v10428: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:24:53.437 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:24:53.438 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:24:53.438 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:24:54.186 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:24:54.187 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:24:54.187 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:24:54.187 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:24:54.187 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:24:54.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:24:53 smithi157 bash[24585]: cluster 2024-09-16T11:24:52.654617+0000 mgr.a (mgr.14373) 15036 : cluster [DBG] pgmap v10429: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:24:54.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:24:53 smithi086 bash[24289]: cluster 2024-09-16T11:24:52.654617+0000 mgr.a (mgr.14373) 15036 : cluster [DBG] pgmap v10429: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:24:54.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:24:53 smithi047 bash[22744]: cluster 2024-09-16T11:24:52.654617+0000 mgr.a (mgr.14373) 15036 : cluster [DBG] pgmap v10429: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:24:55.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:24:54 smithi157 bash[24585]: audit 2024-09-16T11:24:53.765992+0000 mgr.a (mgr.14373) 15037 : audit [DBG] from='client.325143 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:24:55.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:24:54 smithi086 bash[24289]: audit 2024-09-16T11:24:53.765992+0000 mgr.a (mgr.14373) 15037 : audit [DBG] from='client.325143 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:24:55.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:24:54 smithi047 bash[22744]: audit 2024-09-16T11:24:53.765992+0000 mgr.a (mgr.14373) 15037 : audit [DBG] from='client.325143 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:24:56.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:24:55 smithi157 bash[24585]: cluster 2024-09-16T11:24:54.655626+0000 mgr.a (mgr.14373) 15038 : cluster [DBG] pgmap v10430: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:24:56.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:24:55 smithi086 bash[24289]: cluster 2024-09-16T11:24:54.655626+0000 mgr.a (mgr.14373) 15038 : cluster [DBG] pgmap v10430: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:24:56.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:24:55 smithi047 bash[22744]: cluster 2024-09-16T11:24:54.655626+0000 mgr.a (mgr.14373) 15038 : cluster [DBG] pgmap v10430: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:24:58.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:24:57 smithi157 bash[24585]: cluster 2024-09-16T11:24:56.657839+0000 mgr.a (mgr.14373) 15039 : cluster [DBG] pgmap v10431: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:24:58.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:24:57 smithi086 bash[24289]: cluster 2024-09-16T11:24:56.657839+0000 mgr.a (mgr.14373) 15039 : cluster [DBG] pgmap v10431: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:24:58.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:24:57 smithi047 bash[22744]: cluster 2024-09-16T11:24:56.657839+0000 mgr.a (mgr.14373) 15039 : cluster [DBG] pgmap v10431: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:24:59.188 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:24:59.189 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:24:59.189 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:24:59.962 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:24:59.962 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:24:59.962 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:24:59.962 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:24:59.962 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:25:00.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:24:59 smithi157 bash[24585]: cluster 2024-09-16T11:24:58.658624+0000 mgr.a (mgr.14373) 15040 : cluster [DBG] pgmap v10432: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:25:00.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:24:59 smithi086 bash[24289]: cluster 2024-09-16T11:24:58.658624+0000 mgr.a (mgr.14373) 15040 : cluster [DBG] pgmap v10432: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:25:00.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:24:59 smithi047 bash[22744]: cluster 2024-09-16T11:24:58.658624+0000 mgr.a (mgr.14373) 15040 : cluster [DBG] pgmap v10432: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:25:01.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:25:00 smithi157 bash[24585]: audit 2024-09-16T11:24:59.523718+0000 mgr.a (mgr.14373) 15041 : audit [DBG] from='client.325221 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:25:01.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:25:00 smithi086 bash[24289]: audit 2024-09-16T11:24:59.523718+0000 mgr.a (mgr.14373) 15041 : audit [DBG] from='client.325221 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:25:01.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:25:00 smithi047 bash[22744]: audit 2024-09-16T11:24:59.523718+0000 mgr.a (mgr.14373) 15041 : audit [DBG] from='client.325221 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:25:02.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:25:01 smithi157 bash[24585]: cluster 2024-09-16T11:25:00.659506+0000 mgr.a (mgr.14373) 15042 : cluster [DBG] pgmap v10433: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:25:02.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:25:01 smithi157 bash[24585]: audit 2024-09-16T11:25:01.968025+0000 mon.b (mon.2) 1370 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T11:25:02.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:25:01 smithi086 bash[24289]: cluster 2024-09-16T11:25:00.659506+0000 mgr.a (mgr.14373) 15042 : cluster [DBG] pgmap v10433: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:25:02.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:25:01 smithi086 bash[24289]: audit 2024-09-16T11:25:01.968025+0000 mon.b (mon.2) 1370 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T11:25:02.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:25:01 smithi047 bash[22744]: cluster 2024-09-16T11:25:00.659506+0000 mgr.a (mgr.14373) 15042 : cluster [DBG] pgmap v10433: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:25:02.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:25:01 smithi047 bash[22744]: audit 2024-09-16T11:25:01.968025+0000 mon.b (mon.2) 1370 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T11:25:03.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:25:02 smithi157 bash[24585]: audit 2024-09-16T11:25:02.800724+0000 mon.b (mon.2) 1371 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T11:25:03.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:25:02 smithi157 bash[24585]: audit 2024-09-16T11:25:02.802929+0000 mon.b (mon.2) 1372 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T11:25:03.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:25:02 smithi157 bash[24585]: audit 2024-09-16T11:25:02.815249+0000 mon.a (mon.0) 1465 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:25:03.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:25:02 smithi157 bash[24585]: audit 2024-09-16T11:25:02.820501+0000 mon.b (mon.2) 1373 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:25:03.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:25:02 smithi086 bash[24289]: audit 2024-09-16T11:25:02.800724+0000 mon.b (mon.2) 1371 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T11:25:03.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:25:02 smithi086 bash[24289]: audit 2024-09-16T11:25:02.802929+0000 mon.b (mon.2) 1372 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T11:25:03.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:25:02 smithi086 bash[24289]: audit 2024-09-16T11:25:02.815249+0000 mon.a (mon.0) 1465 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:25:03.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:25:02 smithi086 bash[24289]: audit 2024-09-16T11:25:02.820501+0000 mon.b (mon.2) 1373 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:25:03.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:25:02 smithi047 bash[22744]: audit 2024-09-16T11:25:02.800724+0000 mon.b (mon.2) 1371 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T11:25:03.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:25:02 smithi047 bash[22744]: audit 2024-09-16T11:25:02.802929+0000 mon.b (mon.2) 1372 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T11:25:03.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:25:02 smithi047 bash[22744]: audit 2024-09-16T11:25:02.815249+0000 mon.a (mon.0) 1465 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:25:03.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:25:02 smithi047 bash[22744]: audit 2024-09-16T11:25:02.820501+0000 mon.b (mon.2) 1373 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:25:03.843 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 11:25:03 smithi047 bash[22994]: debug 2024-09-16T11:25:03.563+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T11:25:03.843 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 11:25:03 smithi047 bash[22994]: debug 2024-09-16T11:25:03.563+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T11:25:04.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:25:03 smithi157 bash[24585]: cluster 2024-09-16T11:25:02.661610+0000 mgr.a (mgr.14373) 15043 : cluster [DBG] pgmap v10434: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:25:04.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:25:03 smithi157 bash[24585]: audit 2024-09-16T11:25:02.823336+0000 mgr.a (mgr.14373) 15044 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:25:04.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:25:03 smithi086 bash[24289]: cluster 2024-09-16T11:25:02.661610+0000 mgr.a (mgr.14373) 15043 : cluster [DBG] pgmap v10434: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:25:04.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:25:03 smithi086 bash[24289]: audit 2024-09-16T11:25:02.823336+0000 mgr.a (mgr.14373) 15044 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:25:04.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:25:03 smithi047 bash[22744]: cluster 2024-09-16T11:25:02.661610+0000 mgr.a (mgr.14373) 15043 : cluster [DBG] pgmap v10434: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:25:04.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:25:03 smithi047 bash[22744]: audit 2024-09-16T11:25:02.823336+0000 mgr.a (mgr.14373) 15044 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:25:04.964 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:25:04.965 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:25:04.965 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:25:05.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:25:05 smithi157 bash[24585]: audit 2024-09-16T11:25:03.567538+0000 mgr.a (mgr.14373) 15045 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T11:25:05.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:25:05 smithi157 bash[24585]: cephadm 2024-09-16T11:25:03.569975+0000 mgr.a (mgr.14373) 15046 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T11:25:05.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:25:05 smithi086 bash[24289]: audit 2024-09-16T11:25:03.567538+0000 mgr.a (mgr.14373) 15045 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T11:25:05.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:25:05 smithi086 bash[24289]: cephadm 2024-09-16T11:25:03.569975+0000 mgr.a (mgr.14373) 15046 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T11:25:05.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:25:05 smithi047 bash[22744]: audit 2024-09-16T11:25:03.567538+0000 mgr.a (mgr.14373) 15045 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T11:25:05.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:25:05 smithi047 bash[22744]: cephadm 2024-09-16T11:25:03.569975+0000 mgr.a (mgr.14373) 15046 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T11:25:05.728 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:25:05.729 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:25:05.729 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:25:05.729 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:25:05.729 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:25:06.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:25:06 smithi157 bash[24585]: cluster 2024-09-16T11:25:04.662537+0000 mgr.a (mgr.14373) 15047 : cluster [DBG] pgmap v10435: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:25:06.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:25:06 smithi086 bash[24289]: cluster 2024-09-16T11:25:04.662537+0000 mgr.a (mgr.14373) 15047 : cluster [DBG] pgmap v10435: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:25:06.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:25:06 smithi047 bash[22744]: cluster 2024-09-16T11:25:04.662537+0000 mgr.a (mgr.14373) 15047 : cluster [DBG] pgmap v10435: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:25:07.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:25:07 smithi157 bash[24585]: audit 2024-09-16T11:25:05.297595+0000 mgr.a (mgr.14373) 15048 : audit [DBG] from='client.325407 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:25:07.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:25:07 smithi086 bash[24289]: audit 2024-09-16T11:25:05.297595+0000 mgr.a (mgr.14373) 15048 : audit [DBG] from='client.325407 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:25:07.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:25:07 smithi047 bash[22744]: audit 2024-09-16T11:25:05.297595+0000 mgr.a (mgr.14373) 15048 : audit [DBG] from='client.325407 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:25:08.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:25:08 smithi157 bash[24585]: cluster 2024-09-16T11:25:06.664801+0000 mgr.a (mgr.14373) 15049 : cluster [DBG] pgmap v10436: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:25:08.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:25:08 smithi086 bash[24289]: cluster 2024-09-16T11:25:06.664801+0000 mgr.a (mgr.14373) 15049 : cluster [DBG] pgmap v10436: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:25:08.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:25:08 smithi047 bash[22744]: cluster 2024-09-16T11:25:06.664801+0000 mgr.a (mgr.14373) 15049 : cluster [DBG] pgmap v10436: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:25:10.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:25:10 smithi157 bash[24585]: cluster 2024-09-16T11:25:08.665568+0000 mgr.a (mgr.14373) 15050 : cluster [DBG] pgmap v10437: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:25:10.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:25:10 smithi086 bash[24289]: cluster 2024-09-16T11:25:08.665568+0000 mgr.a (mgr.14373) 15050 : cluster [DBG] pgmap v10437: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:25:10.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:25:10 smithi047 bash[22744]: cluster 2024-09-16T11:25:08.665568+0000 mgr.a (mgr.14373) 15050 : cluster [DBG] pgmap v10437: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:25:10.730 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:25:10.731 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:25:10.731 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:25:11.521 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:25:11.521 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:25:11.521 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:25:11.522 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:25:11.522 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:25:12.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:25:12 smithi157 bash[24585]: cluster 2024-09-16T11:25:10.666310+0000 mgr.a (mgr.14373) 15051 : cluster [DBG] pgmap v10438: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:25:12.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:25:12 smithi157 bash[24585]: audit 2024-09-16T11:25:11.066490+0000 mgr.a (mgr.14373) 15052 : audit [DBG] from='client.325485 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:25:12.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:25:12 smithi086 bash[24289]: cluster 2024-09-16T11:25:10.666310+0000 mgr.a (mgr.14373) 15051 : cluster [DBG] pgmap v10438: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:25:12.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:25:12 smithi086 bash[24289]: audit 2024-09-16T11:25:11.066490+0000 mgr.a (mgr.14373) 15052 : audit [DBG] from='client.325485 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:25:12.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:25:12 smithi047 bash[22744]: cluster 2024-09-16T11:25:10.666310+0000 mgr.a (mgr.14373) 15051 : cluster [DBG] pgmap v10438: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:25:12.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:25:12 smithi047 bash[22744]: audit 2024-09-16T11:25:11.066490+0000 mgr.a (mgr.14373) 15052 : audit [DBG] from='client.325485 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:25:14.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:25:14 smithi157 bash[24585]: cluster 2024-09-16T11:25:12.668713+0000 mgr.a (mgr.14373) 15053 : cluster [DBG] pgmap v10439: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:25:14.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:25:14 smithi086 bash[24289]: cluster 2024-09-16T11:25:12.668713+0000 mgr.a (mgr.14373) 15053 : cluster [DBG] pgmap v10439: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:25:14.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:25:14 smithi047 bash[22744]: cluster 2024-09-16T11:25:12.668713+0000 mgr.a (mgr.14373) 15053 : cluster [DBG] pgmap v10439: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:25:16.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:25:16 smithi157 bash[24585]: cluster 2024-09-16T11:25:14.669478+0000 mgr.a (mgr.14373) 15054 : cluster [DBG] pgmap v10440: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T11:25:16.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:25:16 smithi086 bash[24289]: cluster 2024-09-16T11:25:14.669478+0000 mgr.a (mgr.14373) 15054 : cluster [DBG] pgmap v10440: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T11:25:16.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:25:16 smithi047 bash[22744]: cluster 2024-09-16T11:25:14.669478+0000 mgr.a (mgr.14373) 15054 : cluster [DBG] pgmap v10440: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T11:25:16.523 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:25:16.523 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:25:16.523 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:25:17.306 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:25:17.307 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:25:17.307 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:25:17.307 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:25:17.307 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:25:18.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:25:18 smithi157 bash[24585]: cluster 2024-09-16T11:25:16.670631+0000 mgr.a (mgr.14373) 15055 : cluster [DBG] pgmap v10441: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:25:18.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:25:18 smithi157 bash[24585]: audit 2024-09-16T11:25:16.856508+0000 mgr.a (mgr.14373) 15056 : audit [DBG] from='client.325560 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:25:18.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:25:18 smithi086 bash[24289]: cluster 2024-09-16T11:25:16.670631+0000 mgr.a (mgr.14373) 15055 : cluster [DBG] pgmap v10441: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:25:18.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:25:18 smithi086 bash[24289]: audit 2024-09-16T11:25:16.856508+0000 mgr.a (mgr.14373) 15056 : audit [DBG] from='client.325560 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:25:18.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:25:18 smithi047 bash[22744]: cluster 2024-09-16T11:25:16.670631+0000 mgr.a (mgr.14373) 15055 : cluster [DBG] pgmap v10441: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:25:18.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:25:18 smithi047 bash[22744]: audit 2024-09-16T11:25:16.856508+0000 mgr.a (mgr.14373) 15056 : audit [DBG] from='client.325560 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:25:20.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:25:20 smithi157 bash[24585]: cluster 2024-09-16T11:25:18.671485+0000 mgr.a (mgr.14373) 15057 : cluster [DBG] pgmap v10442: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T11:25:20.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:25:20 smithi086 bash[24289]: cluster 2024-09-16T11:25:18.671485+0000 mgr.a (mgr.14373) 15057 : cluster [DBG] pgmap v10442: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T11:25:20.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:25:20 smithi047 bash[22744]: cluster 2024-09-16T11:25:18.671485+0000 mgr.a (mgr.14373) 15057 : cluster [DBG] pgmap v10442: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T11:25:22.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:25:22 smithi157 bash[24585]: cluster 2024-09-16T11:25:20.672268+0000 mgr.a (mgr.14373) 15058 : cluster [DBG] pgmap v10443: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T11:25:22.308 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:25:22.309 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:25:22.309 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:25:22.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:25:22 smithi086 bash[24289]: cluster 2024-09-16T11:25:20.672268+0000 mgr.a (mgr.14373) 15058 : cluster [DBG] pgmap v10443: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T11:25:22.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:25:22 smithi047 bash[22744]: cluster 2024-09-16T11:25:20.672268+0000 mgr.a (mgr.14373) 15058 : cluster [DBG] pgmap v10443: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T11:25:23.082 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:25:23.083 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:25:23.083 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:25:23.083 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:25:23.083 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:25:24.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:25:24 smithi157 bash[24585]: audit 2024-09-16T11:25:22.642729+0000 mgr.a (mgr.14373) 15059 : audit [DBG] from='client.325638 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:25:24.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:25:24 smithi157 bash[24585]: cluster 2024-09-16T11:25:22.675219+0000 mgr.a (mgr.14373) 15060 : cluster [DBG] pgmap v10444: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:25:24.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:25:24 smithi086 bash[24289]: audit 2024-09-16T11:25:22.642729+0000 mgr.a (mgr.14373) 15059 : audit [DBG] from='client.325638 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:25:24.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:25:24 smithi086 bash[24289]: cluster 2024-09-16T11:25:22.675219+0000 mgr.a (mgr.14373) 15060 : cluster [DBG] pgmap v10444: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:25:24.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:25:24 smithi047 bash[22744]: audit 2024-09-16T11:25:22.642729+0000 mgr.a (mgr.14373) 15059 : audit [DBG] from='client.325638 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:25:24.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:25:24 smithi047 bash[22744]: cluster 2024-09-16T11:25:22.675219+0000 mgr.a (mgr.14373) 15060 : cluster [DBG] pgmap v10444: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:25:26.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:25:26 smithi157 bash[24585]: cluster 2024-09-16T11:25:24.676206+0000 mgr.a (mgr.14373) 15061 : cluster [DBG] pgmap v10445: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-16T11:25:26.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:25:26 smithi086 bash[24289]: cluster 2024-09-16T11:25:24.676206+0000 mgr.a (mgr.14373) 15061 : cluster [DBG] pgmap v10445: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-16T11:25:26.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:25:26 smithi047 bash[22744]: cluster 2024-09-16T11:25:24.676206+0000 mgr.a (mgr.14373) 15061 : cluster [DBG] pgmap v10445: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-16T11:25:28.084 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:25:28.085 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:25:28.085 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:25:28.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:25:28 smithi086 bash[24289]: cluster 2024-09-16T11:25:26.678379+0000 mgr.a (mgr.14373) 15062 : cluster [DBG] pgmap v10446: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-16T11:25:28.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:25:28 smithi047 bash[22744]: cluster 2024-09-16T11:25:26.678379+0000 mgr.a (mgr.14373) 15062 : cluster [DBG] pgmap v10446: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-16T11:25:28.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:25:28 smithi157 bash[24585]: cluster 2024-09-16T11:25:26.678379+0000 mgr.a (mgr.14373) 15062 : cluster [DBG] pgmap v10446: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-16T11:25:28.871 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:25:28.871 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:25:28.872 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:25:28.872 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:25:28.872 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:25:30.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:25:30 smithi086 bash[24289]: audit 2024-09-16T11:25:28.418801+0000 mgr.a (mgr.14373) 15063 : audit [DBG] from='client.325716 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:25:30.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:25:30 smithi086 bash[24289]: cluster 2024-09-16T11:25:28.679056+0000 mgr.a (mgr.14373) 15064 : cluster [DBG] pgmap v10447: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:25:30.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:25:30 smithi047 bash[22744]: audit 2024-09-16T11:25:28.418801+0000 mgr.a (mgr.14373) 15063 : audit [DBG] from='client.325716 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:25:30.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:25:30 smithi047 bash[22744]: cluster 2024-09-16T11:25:28.679056+0000 mgr.a (mgr.14373) 15064 : cluster [DBG] pgmap v10447: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:25:30.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:25:30 smithi157 bash[24585]: audit 2024-09-16T11:25:28.418801+0000 mgr.a (mgr.14373) 15063 : audit [DBG] from='client.325716 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:25:30.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:25:30 smithi157 bash[24585]: cluster 2024-09-16T11:25:28.679056+0000 mgr.a (mgr.14373) 15064 : cluster [DBG] pgmap v10447: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:25:32.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:25:32 smithi086 bash[24289]: cluster 2024-09-16T11:25:30.680009+0000 mgr.a (mgr.14373) 15065 : cluster [DBG] pgmap v10448: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:25:32.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:25:32 smithi047 bash[22744]: cluster 2024-09-16T11:25:30.680009+0000 mgr.a (mgr.14373) 15065 : cluster [DBG] pgmap v10448: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:25:32.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:25:32 smithi157 bash[24585]: cluster 2024-09-16T11:25:30.680009+0000 mgr.a (mgr.14373) 15065 : cluster [DBG] pgmap v10448: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:25:33.873 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:25:33.874 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:25:33.874 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:25:34.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:25:34 smithi047 bash[22744]: cluster 2024-09-16T11:25:32.682301+0000 mgr.a (mgr.14373) 15066 : cluster [DBG] pgmap v10449: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:25:34.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:25:34 smithi157 bash[24585]: cluster 2024-09-16T11:25:32.682301+0000 mgr.a (mgr.14373) 15066 : cluster [DBG] pgmap v10449: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:25:34.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:25:34 smithi086 bash[24289]: cluster 2024-09-16T11:25:32.682301+0000 mgr.a (mgr.14373) 15066 : cluster [DBG] pgmap v10449: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:25:34.661 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:25:34.661 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:25:34.661 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:25:34.661 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:25:34.661 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:25:36.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:25:36 smithi047 bash[22744]: audit 2024-09-16T11:25:34.213270+0000 mgr.a (mgr.14373) 15067 : audit [DBG] from='client.325791 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:25:36.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:25:36 smithi047 bash[22744]: cluster 2024-09-16T11:25:34.682989+0000 mgr.a (mgr.14373) 15068 : cluster [DBG] pgmap v10450: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:25:36.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:25:36 smithi157 bash[24585]: audit 2024-09-16T11:25:34.213270+0000 mgr.a (mgr.14373) 15067 : audit [DBG] from='client.325791 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:25:36.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:25:36 smithi157 bash[24585]: cluster 2024-09-16T11:25:34.682989+0000 mgr.a (mgr.14373) 15068 : cluster [DBG] pgmap v10450: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:25:36.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:25:36 smithi086 bash[24289]: audit 2024-09-16T11:25:34.213270+0000 mgr.a (mgr.14373) 15067 : audit [DBG] from='client.325791 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:25:36.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:25:36 smithi086 bash[24289]: cluster 2024-09-16T11:25:34.682989+0000 mgr.a (mgr.14373) 15068 : cluster [DBG] pgmap v10450: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:25:38.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:25:38 smithi047 bash[22744]: cluster 2024-09-16T11:25:36.685099+0000 mgr.a (mgr.14373) 15069 : cluster [DBG] pgmap v10451: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:25:38.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:25:38 smithi157 bash[24585]: cluster 2024-09-16T11:25:36.685099+0000 mgr.a (mgr.14373) 15069 : cluster [DBG] pgmap v10451: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:25:38.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:25:38 smithi086 bash[24289]: cluster 2024-09-16T11:25:36.685099+0000 mgr.a (mgr.14373) 15069 : cluster [DBG] pgmap v10451: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:25:39.663 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:25:39.663 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:25:39.664 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:25:40.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:25:40 smithi047 bash[22744]: cluster 2024-09-16T11:25:38.685853+0000 mgr.a (mgr.14373) 15070 : cluster [DBG] pgmap v10452: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:25:40.446 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:25:40.446 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:25:40.446 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:25:40.446 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:25:40.446 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:25:40.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:25:40 smithi157 bash[24585]: cluster 2024-09-16T11:25:38.685853+0000 mgr.a (mgr.14373) 15070 : cluster [DBG] pgmap v10452: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:25:40.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:25:40 smithi086 bash[24289]: cluster 2024-09-16T11:25:38.685853+0000 mgr.a (mgr.14373) 15070 : cluster [DBG] pgmap v10452: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:25:41.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:25:41 smithi157 bash[24585]: audit 2024-09-16T11:25:39.998092+0000 mgr.a (mgr.14373) 15071 : audit [DBG] from='client.325869 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:25:41.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:25:41 smithi086 bash[24289]: audit 2024-09-16T11:25:39.998092+0000 mgr.a (mgr.14373) 15071 : audit [DBG] from='client.325869 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:25:41.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:25:41 smithi047 bash[22744]: audit 2024-09-16T11:25:39.998092+0000 mgr.a (mgr.14373) 15071 : audit [DBG] from='client.325869 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:25:42.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:25:42 smithi157 bash[24585]: cluster 2024-09-16T11:25:40.686848+0000 mgr.a (mgr.14373) 15072 : cluster [DBG] pgmap v10453: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:25:42.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:25:42 smithi086 bash[24289]: cluster 2024-09-16T11:25:40.686848+0000 mgr.a (mgr.14373) 15072 : cluster [DBG] pgmap v10453: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:25:42.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:25:42 smithi047 bash[22744]: cluster 2024-09-16T11:25:40.686848+0000 mgr.a (mgr.14373) 15072 : cluster [DBG] pgmap v10453: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:25:44.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:25:44 smithi157 bash[24585]: cluster 2024-09-16T11:25:42.689089+0000 mgr.a (mgr.14373) 15073 : cluster [DBG] pgmap v10454: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:25:44.572 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:25:44 smithi086 bash[24289]: cluster 2024-09-16T11:25:42.689089+0000 mgr.a (mgr.14373) 15073 : cluster [DBG] pgmap v10454: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:25:44.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:25:44 smithi047 bash[22744]: cluster 2024-09-16T11:25:42.689089+0000 mgr.a (mgr.14373) 15073 : cluster [DBG] pgmap v10454: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:25:45.447 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:25:45.448 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:25:45.448 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:25:46.210 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:25:46.210 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:25:46.210 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:25:46.210 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:25:46.210 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:25:46.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:25:46 smithi157 bash[24585]: cluster 2024-09-16T11:25:44.689856+0000 mgr.a (mgr.14373) 15074 : cluster [DBG] pgmap v10455: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:25:46.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:25:46 smithi086 bash[24289]: cluster 2024-09-16T11:25:44.689856+0000 mgr.a (mgr.14373) 15074 : cluster [DBG] pgmap v10455: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:25:46.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:25:46 smithi047 bash[22744]: cluster 2024-09-16T11:25:44.689856+0000 mgr.a (mgr.14373) 15074 : cluster [DBG] pgmap v10455: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:25:47.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:25:47 smithi157 bash[24585]: audit 2024-09-16T11:25:45.782635+0000 mgr.a (mgr.14373) 15075 : audit [DBG] from='client.325947 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:25:47.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:25:47 smithi086 bash[24289]: audit 2024-09-16T11:25:45.782635+0000 mgr.a (mgr.14373) 15075 : audit [DBG] from='client.325947 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:25:47.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:25:47 smithi047 bash[22744]: audit 2024-09-16T11:25:45.782635+0000 mgr.a (mgr.14373) 15075 : audit [DBG] from='client.325947 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:25:48.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:25:48 smithi157 bash[24585]: cluster 2024-09-16T11:25:46.692179+0000 mgr.a (mgr.14373) 15076 : cluster [DBG] pgmap v10456: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:25:48.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:25:48 smithi086 bash[24289]: cluster 2024-09-16T11:25:46.692179+0000 mgr.a (mgr.14373) 15076 : cluster [DBG] pgmap v10456: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:25:48.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:25:48 smithi047 bash[22744]: cluster 2024-09-16T11:25:46.692179+0000 mgr.a (mgr.14373) 15076 : cluster [DBG] pgmap v10456: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:25:50.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:25:50 smithi157 bash[24585]: cluster 2024-09-16T11:25:48.692927+0000 mgr.a (mgr.14373) 15077 : cluster [DBG] pgmap v10457: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:25:50.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:25:50 smithi086 bash[24289]: cluster 2024-09-16T11:25:48.692927+0000 mgr.a (mgr.14373) 15077 : cluster [DBG] pgmap v10457: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:25:50.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:25:50 smithi047 bash[22744]: cluster 2024-09-16T11:25:48.692927+0000 mgr.a (mgr.14373) 15077 : cluster [DBG] pgmap v10457: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:25:51.211 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:25:51.212 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:25:51.212 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:25:51.989 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:25:51.989 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:25:51.989 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:25:51.989 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:25:51.989 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:25:52.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:25:52 smithi157 bash[24585]: cluster 2024-09-16T11:25:50.693693+0000 mgr.a (mgr.14373) 15078 : cluster [DBG] pgmap v10458: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:25:52.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:25:52 smithi086 bash[24289]: cluster 2024-09-16T11:25:50.693693+0000 mgr.a (mgr.14373) 15078 : cluster [DBG] pgmap v10458: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:25:52.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:25:52 smithi047 bash[22744]: cluster 2024-09-16T11:25:50.693693+0000 mgr.a (mgr.14373) 15078 : cluster [DBG] pgmap v10458: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:25:53.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:25:53 smithi157 bash[24585]: audit 2024-09-16T11:25:51.544131+0000 mgr.a (mgr.14373) 15079 : audit [DBG] from='client.326022 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:25:53.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:25:53 smithi086 bash[24289]: audit 2024-09-16T11:25:51.544131+0000 mgr.a (mgr.14373) 15079 : audit [DBG] from='client.326022 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:25:53.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:25:53 smithi047 bash[22744]: audit 2024-09-16T11:25:51.544131+0000 mgr.a (mgr.14373) 15079 : audit [DBG] from='client.326022 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:25:54.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:25:54 smithi157 bash[24585]: cluster 2024-09-16T11:25:52.697185+0000 mgr.a (mgr.14373) 15080 : cluster [DBG] pgmap v10459: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:25:54.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:25:54 smithi086 bash[24289]: cluster 2024-09-16T11:25:52.697185+0000 mgr.a (mgr.14373) 15080 : cluster [DBG] pgmap v10459: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:25:54.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:25:54 smithi047 bash[22744]: cluster 2024-09-16T11:25:52.697185+0000 mgr.a (mgr.14373) 15080 : cluster [DBG] pgmap v10459: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:25:56.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:25:56 smithi157 bash[24585]: cluster 2024-09-16T11:25:54.698015+0000 mgr.a (mgr.14373) 15081 : cluster [DBG] pgmap v10460: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:25:56.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:25:56 smithi086 bash[24289]: cluster 2024-09-16T11:25:54.698015+0000 mgr.a (mgr.14373) 15081 : cluster [DBG] pgmap v10460: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:25:56.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:25:56 smithi047 bash[22744]: cluster 2024-09-16T11:25:54.698015+0000 mgr.a (mgr.14373) 15081 : cluster [DBG] pgmap v10460: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:25:56.990 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:25:56.991 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:25:56.991 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:25:57.772 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:25:57.773 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:25:57.773 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:25:57.773 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:25:57.773 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:25:58.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:25:58 smithi157 bash[24585]: cluster 2024-09-16T11:25:56.699936+0000 mgr.a (mgr.14373) 15082 : cluster [DBG] pgmap v10461: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:25:58.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:25:58 smithi086 bash[24289]: cluster 2024-09-16T11:25:56.699936+0000 mgr.a (mgr.14373) 15082 : cluster [DBG] pgmap v10461: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:25:58.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:25:58 smithi047 bash[22744]: cluster 2024-09-16T11:25:56.699936+0000 mgr.a (mgr.14373) 15082 : cluster [DBG] pgmap v10461: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:25:59.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:25:59 smithi157 bash[24585]: audit 2024-09-16T11:25:57.325816+0000 mgr.a (mgr.14373) 15083 : audit [DBG] from='client.326100 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:25:59.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:25:59 smithi086 bash[24289]: audit 2024-09-16T11:25:57.325816+0000 mgr.a (mgr.14373) 15083 : audit [DBG] from='client.326100 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:25:59.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:25:59 smithi047 bash[22744]: audit 2024-09-16T11:25:57.325816+0000 mgr.a (mgr.14373) 15083 : audit [DBG] from='client.326100 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:26:00.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:26:00 smithi157 bash[24585]: cluster 2024-09-16T11:25:58.700870+0000 mgr.a (mgr.14373) 15084 : cluster [DBG] pgmap v10462: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:26:00.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:26:00 smithi086 bash[24289]: cluster 2024-09-16T11:25:58.700870+0000 mgr.a (mgr.14373) 15084 : cluster [DBG] pgmap v10462: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:26:00.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:26:00 smithi047 bash[22744]: cluster 2024-09-16T11:25:58.700870+0000 mgr.a (mgr.14373) 15084 : cluster [DBG] pgmap v10462: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:26:02.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:26:02 smithi157 bash[24585]: cluster 2024-09-16T11:26:00.701676+0000 mgr.a (mgr.14373) 15085 : cluster [DBG] pgmap v10463: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:26:02.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:26:02 smithi086 bash[24289]: cluster 2024-09-16T11:26:00.701676+0000 mgr.a (mgr.14373) 15085 : cluster [DBG] pgmap v10463: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:26:02.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:26:02 smithi047 bash[22744]: cluster 2024-09-16T11:26:00.701676+0000 mgr.a (mgr.14373) 15085 : cluster [DBG] pgmap v10463: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:26:02.774 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:26:02.775 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:26:02.775 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:26:03.558 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:26:03.559 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:26:03.559 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:26:03.559 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:26:03.559 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:26:04.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:26:04 smithi157 bash[24585]: cluster 2024-09-16T11:26:02.703894+0000 mgr.a (mgr.14373) 15086 : cluster [DBG] pgmap v10464: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:26:04.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:26:04 smithi157 bash[24585]: audit 2024-09-16T11:26:03.112124+0000 mgr.a (mgr.14373) 15087 : audit [DBG] from='client.326178 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:26:04.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:26:04 smithi157 bash[24585]: audit 2024-09-16T11:26:03.626448+0000 mon.b (mon.2) 1374 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T11:26:04.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:26:04 smithi086 bash[24289]: cluster 2024-09-16T11:26:02.703894+0000 mgr.a (mgr.14373) 15086 : cluster [DBG] pgmap v10464: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:26:04.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:26:04 smithi086 bash[24289]: audit 2024-09-16T11:26:03.112124+0000 mgr.a (mgr.14373) 15087 : audit [DBG] from='client.326178 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:26:04.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:26:04 smithi086 bash[24289]: audit 2024-09-16T11:26:03.626448+0000 mon.b (mon.2) 1374 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T11:26:04.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:26:04 smithi047 bash[22744]: cluster 2024-09-16T11:26:02.703894+0000 mgr.a (mgr.14373) 15086 : cluster [DBG] pgmap v10464: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:26:04.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:26:04 smithi047 bash[22744]: audit 2024-09-16T11:26:03.112124+0000 mgr.a (mgr.14373) 15087 : audit [DBG] from='client.326178 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:26:04.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:26:04 smithi047 bash[22744]: audit 2024-09-16T11:26:03.626448+0000 mon.b (mon.2) 1374 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T11:26:06.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:26:06 smithi157 bash[24585]: cluster 2024-09-16T11:26:04.704841+0000 mgr.a (mgr.14373) 15088 : cluster [DBG] pgmap v10465: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:26:06.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:26:06 smithi086 bash[24289]: cluster 2024-09-16T11:26:04.704841+0000 mgr.a (mgr.14373) 15088 : cluster [DBG] pgmap v10465: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:26:06.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:26:06 smithi047 bash[22744]: cluster 2024-09-16T11:26:04.704841+0000 mgr.a (mgr.14373) 15088 : cluster [DBG] pgmap v10465: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:26:08.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:26:08 smithi157 bash[24585]: cluster 2024-09-16T11:26:06.707007+0000 mgr.a (mgr.14373) 15089 : cluster [DBG] pgmap v10466: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:26:08.560 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:26:08.561 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:26:08.561 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:26:08.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:26:08 smithi086 bash[24289]: cluster 2024-09-16T11:26:06.707007+0000 mgr.a (mgr.14373) 15089 : cluster [DBG] pgmap v10466: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:26:08.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:26:08 smithi047 bash[22744]: cluster 2024-09-16T11:26:06.707007+0000 mgr.a (mgr.14373) 15089 : cluster [DBG] pgmap v10466: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:26:09.341 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:26:09.341 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:26:09.341 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:26:09.341 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:26:09.341 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:26:10.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:26:09 smithi157 bash[24585]: cluster 2024-09-16T11:26:08.707635+0000 mgr.a (mgr.14373) 15090 : cluster [DBG] pgmap v10467: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:26:10.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:26:09 smithi157 bash[24585]: audit 2024-09-16T11:26:08.901810+0000 mgr.a (mgr.14373) 15091 : audit [DBG] from='client.326256 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:26:10.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:26:09 smithi157 bash[24585]: audit 2024-09-16T11:26:08.968006+0000 mon.a (mon.0) 1466 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:26:10.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:26:09 smithi157 bash[24585]: audit 2024-09-16T11:26:08.975087+0000 mon.a (mon.0) 1467 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:26:10.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:26:09 smithi157 bash[24585]: audit 2024-09-16T11:26:08.989000+0000 mon.a (mon.0) 1468 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:26:10.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:26:09 smithi157 bash[24585]: audit 2024-09-16T11:26:08.996488+0000 mon.a (mon.0) 1469 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:26:10.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:26:09 smithi157 bash[24585]: audit 2024-09-16T11:26:09.002958+0000 mon.a (mon.0) 1470 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:26:10.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:26:09 smithi157 bash[24585]: audit 2024-09-16T11:26:09.009926+0000 mon.a (mon.0) 1471 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:26:10.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:26:09 smithi157 bash[24585]: audit 2024-09-16T11:26:09.728678+0000 mon.b (mon.2) 1375 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T11:26:10.308 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:26:09 smithi157 bash[24585]: audit 2024-09-16T11:26:09.731334+0000 mon.b (mon.2) 1376 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T11:26:10.308 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:26:09 smithi157 bash[24585]: audit 2024-09-16T11:26:09.741635+0000 mon.a (mon.0) 1472 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:26:10.308 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:26:09 smithi157 bash[24585]: audit 2024-09-16T11:26:09.749310+0000 mon.b (mon.2) 1377 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:26:10.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:26:09 smithi086 bash[24289]: cluster 2024-09-16T11:26:08.707635+0000 mgr.a (mgr.14373) 15090 : cluster [DBG] pgmap v10467: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:26:10.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:26:09 smithi086 bash[24289]: audit 2024-09-16T11:26:08.901810+0000 mgr.a (mgr.14373) 15091 : audit [DBG] from='client.326256 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:26:10.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:26:09 smithi086 bash[24289]: audit 2024-09-16T11:26:08.968006+0000 mon.a (mon.0) 1466 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:26:10.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:26:09 smithi086 bash[24289]: audit 2024-09-16T11:26:08.975087+0000 mon.a (mon.0) 1467 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:26:10.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:26:09 smithi086 bash[24289]: audit 2024-09-16T11:26:08.989000+0000 mon.a (mon.0) 1468 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:26:10.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:26:09 smithi086 bash[24289]: audit 2024-09-16T11:26:08.996488+0000 mon.a (mon.0) 1469 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:26:10.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:26:09 smithi086 bash[24289]: audit 2024-09-16T11:26:09.002958+0000 mon.a (mon.0) 1470 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:26:10.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:26:09 smithi086 bash[24289]: audit 2024-09-16T11:26:09.009926+0000 mon.a (mon.0) 1471 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:26:10.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:26:09 smithi086 bash[24289]: audit 2024-09-16T11:26:09.728678+0000 mon.b (mon.2) 1375 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T11:26:10.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:26:09 smithi086 bash[24289]: audit 2024-09-16T11:26:09.731334+0000 mon.b (mon.2) 1376 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T11:26:10.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:26:09 smithi086 bash[24289]: audit 2024-09-16T11:26:09.741635+0000 mon.a (mon.0) 1472 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:26:10.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:26:09 smithi086 bash[24289]: audit 2024-09-16T11:26:09.749310+0000 mon.b (mon.2) 1377 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:26:10.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:26:09 smithi047 bash[22744]: cluster 2024-09-16T11:26:08.707635+0000 mgr.a (mgr.14373) 15090 : cluster [DBG] pgmap v10467: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:26:10.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:26:09 smithi047 bash[22744]: audit 2024-09-16T11:26:08.901810+0000 mgr.a (mgr.14373) 15091 : audit [DBG] from='client.326256 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:26:10.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:26:09 smithi047 bash[22744]: audit 2024-09-16T11:26:08.968006+0000 mon.a (mon.0) 1466 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:26:10.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:26:09 smithi047 bash[22744]: audit 2024-09-16T11:26:08.975087+0000 mon.a (mon.0) 1467 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:26:10.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:26:09 smithi047 bash[22744]: audit 2024-09-16T11:26:08.989000+0000 mon.a (mon.0) 1468 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:26:10.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:26:09 smithi047 bash[22744]: audit 2024-09-16T11:26:08.996488+0000 mon.a (mon.0) 1469 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:26:10.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:26:09 smithi047 bash[22744]: audit 2024-09-16T11:26:09.002958+0000 mon.a (mon.0) 1470 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:26:10.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:26:09 smithi047 bash[22744]: audit 2024-09-16T11:26:09.009926+0000 mon.a (mon.0) 1471 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:26:10.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:26:09 smithi047 bash[22744]: audit 2024-09-16T11:26:09.728678+0000 mon.b (mon.2) 1375 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T11:26:10.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:26:09 smithi047 bash[22744]: audit 2024-09-16T11:26:09.731334+0000 mon.b (mon.2) 1376 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T11:26:10.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:26:09 smithi047 bash[22744]: audit 2024-09-16T11:26:09.741635+0000 mon.a (mon.0) 1472 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:26:10.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:26:09 smithi047 bash[22744]: audit 2024-09-16T11:26:09.749310+0000 mon.b (mon.2) 1377 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:26:10.842 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 11:26:10 smithi047 bash[22994]: debug 2024-09-16T11:26:10.489+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T11:26:10.842 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 11:26:10 smithi047 bash[22994]: debug 2024-09-16T11:26:10.493+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T11:26:11.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:26:10 smithi157 bash[24585]: audit 2024-09-16T11:26:09.752570+0000 mgr.a (mgr.14373) 15092 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:26:11.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:26:10 smithi086 bash[24289]: audit 2024-09-16T11:26:09.752570+0000 mgr.a (mgr.14373) 15092 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:26:11.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:26:10 smithi047 bash[22744]: audit 2024-09-16T11:26:09.752570+0000 mgr.a (mgr.14373) 15092 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:26:12.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:26:11 smithi157 bash[24585]: audit 2024-09-16T11:26:10.493398+0000 mgr.a (mgr.14373) 15093 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T11:26:12.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:26:11 smithi157 bash[24585]: cephadm 2024-09-16T11:26:10.495730+0000 mgr.a (mgr.14373) 15094 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T11:26:12.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:26:11 smithi157 bash[24585]: cluster 2024-09-16T11:26:10.708551+0000 mgr.a (mgr.14373) 15095 : cluster [DBG] pgmap v10468: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:26:12.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:26:11 smithi086 bash[24289]: audit 2024-09-16T11:26:10.493398+0000 mgr.a (mgr.14373) 15093 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T11:26:12.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:26:11 smithi086 bash[24289]: cephadm 2024-09-16T11:26:10.495730+0000 mgr.a (mgr.14373) 15094 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T11:26:12.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:26:11 smithi086 bash[24289]: cluster 2024-09-16T11:26:10.708551+0000 mgr.a (mgr.14373) 15095 : cluster [DBG] pgmap v10468: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:26:12.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:26:11 smithi047 bash[22744]: audit 2024-09-16T11:26:10.493398+0000 mgr.a (mgr.14373) 15093 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T11:26:12.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:26:11 smithi047 bash[22744]: cephadm 2024-09-16T11:26:10.495730+0000 mgr.a (mgr.14373) 15094 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T11:26:12.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:26:11 smithi047 bash[22744]: cluster 2024-09-16T11:26:10.708551+0000 mgr.a (mgr.14373) 15095 : cluster [DBG] pgmap v10468: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:26:14.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:26:13 smithi157 bash[24585]: cluster 2024-09-16T11:26:12.710816+0000 mgr.a (mgr.14373) 15096 : cluster [DBG] pgmap v10469: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:26:14.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:26:13 smithi086 bash[24289]: cluster 2024-09-16T11:26:12.710816+0000 mgr.a (mgr.14373) 15096 : cluster [DBG] pgmap v10469: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:26:14.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:26:13 smithi047 bash[22744]: cluster 2024-09-16T11:26:12.710816+0000 mgr.a (mgr.14373) 15096 : cluster [DBG] pgmap v10469: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:26:14.342 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:26:14.343 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:26:14.343 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:26:15.093 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:26:15.093 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:26:15.093 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:26:15.093 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:26:15.093 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:26:16.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:26:15 smithi157 bash[24585]: audit 2024-09-16T11:26:14.669297+0000 mgr.a (mgr.14373) 15097 : audit [DBG] from='client.326436 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:26:16.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:26:15 smithi157 bash[24585]: cluster 2024-09-16T11:26:14.711511+0000 mgr.a (mgr.14373) 15098 : cluster [DBG] pgmap v10470: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:26:16.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:26:15 smithi086 bash[24289]: audit 2024-09-16T11:26:14.669297+0000 mgr.a (mgr.14373) 15097 : audit [DBG] from='client.326436 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:26:16.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:26:15 smithi086 bash[24289]: cluster 2024-09-16T11:26:14.711511+0000 mgr.a (mgr.14373) 15098 : cluster [DBG] pgmap v10470: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:26:16.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:26:15 smithi047 bash[22744]: audit 2024-09-16T11:26:14.669297+0000 mgr.a (mgr.14373) 15097 : audit [DBG] from='client.326436 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:26:16.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:26:15 smithi047 bash[22744]: cluster 2024-09-16T11:26:14.711511+0000 mgr.a (mgr.14373) 15098 : cluster [DBG] pgmap v10470: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:26:18.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:26:17 smithi157 bash[24585]: cluster 2024-09-16T11:26:16.713892+0000 mgr.a (mgr.14373) 15099 : cluster [DBG] pgmap v10471: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:26:18.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:26:17 smithi086 bash[24289]: cluster 2024-09-16T11:26:16.713892+0000 mgr.a (mgr.14373) 15099 : cluster [DBG] pgmap v10471: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:26:18.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:26:17 smithi047 bash[22744]: cluster 2024-09-16T11:26:16.713892+0000 mgr.a (mgr.14373) 15099 : cluster [DBG] pgmap v10471: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:26:20.094 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:26:20.095 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:26:20.095 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:26:20.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:26:19 smithi157 bash[24585]: cluster 2024-09-16T11:26:18.714774+0000 mgr.a (mgr.14373) 15100 : cluster [DBG] pgmap v10472: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:26:20.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:26:19 smithi086 bash[24289]: cluster 2024-09-16T11:26:18.714774+0000 mgr.a (mgr.14373) 15100 : cluster [DBG] pgmap v10472: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:26:20.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:26:19 smithi047 bash[22744]: cluster 2024-09-16T11:26:18.714774+0000 mgr.a (mgr.14373) 15100 : cluster [DBG] pgmap v10472: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:26:20.838 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:26:20.838 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:26:20.839 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:26:20.839 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:26:20.839 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:26:22.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:26:22 smithi157 bash[24585]: audit 2024-09-16T11:26:20.425437+0000 mgr.a (mgr.14373) 15101 : audit [DBG] from='client.326514 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:26:22.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:26:22 smithi157 bash[24585]: cluster 2024-09-16T11:26:20.715316+0000 mgr.a (mgr.14373) 15102 : cluster [DBG] pgmap v10473: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:26:22.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:26:22 smithi086 bash[24289]: audit 2024-09-16T11:26:20.425437+0000 mgr.a (mgr.14373) 15101 : audit [DBG] from='client.326514 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:26:22.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:26:22 smithi086 bash[24289]: cluster 2024-09-16T11:26:20.715316+0000 mgr.a (mgr.14373) 15102 : cluster [DBG] pgmap v10473: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:26:22.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:26:22 smithi047 bash[22744]: audit 2024-09-16T11:26:20.425437+0000 mgr.a (mgr.14373) 15101 : audit [DBG] from='client.326514 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:26:22.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:26:22 smithi047 bash[22744]: cluster 2024-09-16T11:26:20.715316+0000 mgr.a (mgr.14373) 15102 : cluster [DBG] pgmap v10473: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:26:24.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:26:24 smithi157 bash[24585]: cluster 2024-09-16T11:26:22.717662+0000 mgr.a (mgr.14373) 15103 : cluster [DBG] pgmap v10474: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:26:24.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:26:24 smithi086 bash[24289]: cluster 2024-09-16T11:26:22.717662+0000 mgr.a (mgr.14373) 15103 : cluster [DBG] pgmap v10474: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:26:24.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:26:24 smithi047 bash[22744]: cluster 2024-09-16T11:26:22.717662+0000 mgr.a (mgr.14373) 15103 : cluster [DBG] pgmap v10474: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:26:25.840 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:26:25.841 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:26:25.841 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:26:26.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:26:26 smithi157 bash[24585]: cluster 2024-09-16T11:26:24.718651+0000 mgr.a (mgr.14373) 15104 : cluster [DBG] pgmap v10475: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:26:26.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:26:26 smithi086 bash[24289]: cluster 2024-09-16T11:26:24.718651+0000 mgr.a (mgr.14373) 15104 : cluster [DBG] pgmap v10475: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:26:26.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:26:26 smithi047 bash[22744]: cluster 2024-09-16T11:26:24.718651+0000 mgr.a (mgr.14373) 15104 : cluster [DBG] pgmap v10475: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:26:26.585 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:26:26.585 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:26:26.585 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:26:26.585 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:26:26.585 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:26:27.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:26:27 smithi157 bash[24585]: audit 2024-09-16T11:26:26.171208+0000 mgr.a (mgr.14373) 15105 : audit [DBG] from='client.326592 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:26:27.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:26:27 smithi086 bash[24289]: audit 2024-09-16T11:26:26.171208+0000 mgr.a (mgr.14373) 15105 : audit [DBG] from='client.326592 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:26:27.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:26:27 smithi047 bash[22744]: audit 2024-09-16T11:26:26.171208+0000 mgr.a (mgr.14373) 15105 : audit [DBG] from='client.326592 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:26:28.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:26:28 smithi157 bash[24585]: cluster 2024-09-16T11:26:26.721223+0000 mgr.a (mgr.14373) 15106 : cluster [DBG] pgmap v10476: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-16T11:26:28.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:26:28 smithi086 bash[24289]: cluster 2024-09-16T11:26:26.721223+0000 mgr.a (mgr.14373) 15106 : cluster [DBG] pgmap v10476: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-16T11:26:28.344 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:26:28 smithi047 bash[22744]: cluster 2024-09-16T11:26:26.721223+0000 mgr.a (mgr.14373) 15106 : cluster [DBG] pgmap v10476: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-16T11:26:30.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:26:30 smithi157 bash[24585]: cluster 2024-09-16T11:26:28.722029+0000 mgr.a (mgr.14373) 15107 : cluster [DBG] pgmap v10477: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T11:26:30.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:26:30 smithi086 bash[24289]: cluster 2024-09-16T11:26:28.722029+0000 mgr.a (mgr.14373) 15107 : cluster [DBG] pgmap v10477: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T11:26:30.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:26:30 smithi047 bash[22744]: cluster 2024-09-16T11:26:28.722029+0000 mgr.a (mgr.14373) 15107 : cluster [DBG] pgmap v10477: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T11:26:31.586 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:26:31.587 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:26:31.587 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:26:32.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:26:32 smithi157 bash[24585]: cluster 2024-09-16T11:26:30.722817+0000 mgr.a (mgr.14373) 15108 : cluster [DBG] pgmap v10478: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T11:26:32.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:26:32 smithi086 bash[24289]: cluster 2024-09-16T11:26:30.722817+0000 mgr.a (mgr.14373) 15108 : cluster [DBG] pgmap v10478: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T11:26:32.341 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:26:32.341 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:26:32.342 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:26:32.342 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:26:32.342 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:26:32.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:26:32 smithi047 bash[22744]: cluster 2024-09-16T11:26:30.722817+0000 mgr.a (mgr.14373) 15108 : cluster [DBG] pgmap v10478: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T11:26:33.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:26:33 smithi157 bash[24585]: audit 2024-09-16T11:26:31.916475+0000 mgr.a (mgr.14373) 15109 : audit [DBG] from='client.326670 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:26:33.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:26:33 smithi086 bash[24289]: audit 2024-09-16T11:26:31.916475+0000 mgr.a (mgr.14373) 15109 : audit [DBG] from='client.326670 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:26:33.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:26:33 smithi047 bash[22744]: audit 2024-09-16T11:26:31.916475+0000 mgr.a (mgr.14373) 15109 : audit [DBG] from='client.326670 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:26:34.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:26:34 smithi157 bash[24585]: cluster 2024-09-16T11:26:32.725599+0000 mgr.a (mgr.14373) 15110 : cluster [DBG] pgmap v10479: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:26:34.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:26:34 smithi086 bash[24289]: cluster 2024-09-16T11:26:32.725599+0000 mgr.a (mgr.14373) 15110 : cluster [DBG] pgmap v10479: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:26:34.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:26:34 smithi047 bash[22744]: cluster 2024-09-16T11:26:32.725599+0000 mgr.a (mgr.14373) 15110 : cluster [DBG] pgmap v10479: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:26:36.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:26:36 smithi157 bash[24585]: cluster 2024-09-16T11:26:34.726394+0000 mgr.a (mgr.14373) 15111 : cluster [DBG] pgmap v10480: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:26:36.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:26:36 smithi086 bash[24289]: cluster 2024-09-16T11:26:34.726394+0000 mgr.a (mgr.14373) 15111 : cluster [DBG] pgmap v10480: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:26:36.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:26:36 smithi047 bash[22744]: cluster 2024-09-16T11:26:34.726394+0000 mgr.a (mgr.14373) 15111 : cluster [DBG] pgmap v10480: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:26:37.343 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:26:37.343 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:26:37.344 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:26:38.119 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:26:38.119 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:26:38.119 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:26:38.120 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:26:38.120 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:26:38.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:26:38 smithi157 bash[24585]: cluster 2024-09-16T11:26:36.728333+0000 mgr.a (mgr.14373) 15112 : cluster [DBG] pgmap v10481: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:26:38.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:26:38 smithi086 bash[24289]: cluster 2024-09-16T11:26:36.728333+0000 mgr.a (mgr.14373) 15112 : cluster [DBG] pgmap v10481: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:26:38.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:26:38 smithi047 bash[22744]: cluster 2024-09-16T11:26:36.728333+0000 mgr.a (mgr.14373) 15112 : cluster [DBG] pgmap v10481: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:26:39.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:26:39 smithi086 bash[24289]: audit 2024-09-16T11:26:37.677816+0000 mgr.a (mgr.14373) 15113 : audit [DBG] from='client.326745 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:26:39.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:26:39 smithi047 bash[22744]: audit 2024-09-16T11:26:37.677816+0000 mgr.a (mgr.14373) 15113 : audit [DBG] from='client.326745 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:26:39.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:26:39 smithi157 bash[24585]: audit 2024-09-16T11:26:37.677816+0000 mgr.a (mgr.14373) 15113 : audit [DBG] from='client.326745 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:26:40.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:26:40 smithi086 bash[24289]: cluster 2024-09-16T11:26:38.729458+0000 mgr.a (mgr.14373) 15114 : cluster [DBG] pgmap v10482: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-16T11:26:40.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:26:40 smithi047 bash[22744]: cluster 2024-09-16T11:26:38.729458+0000 mgr.a (mgr.14373) 15114 : cluster [DBG] pgmap v10482: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-16T11:26:40.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:26:40 smithi157 bash[24585]: cluster 2024-09-16T11:26:38.729458+0000 mgr.a (mgr.14373) 15114 : cluster [DBG] pgmap v10482: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-16T11:26:42.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:26:42 smithi086 bash[24289]: cluster 2024-09-16T11:26:40.730297+0000 mgr.a (mgr.14373) 15115 : cluster [DBG] pgmap v10483: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-16T11:26:42.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:26:42 smithi047 bash[22744]: cluster 2024-09-16T11:26:40.730297+0000 mgr.a (mgr.14373) 15115 : cluster [DBG] pgmap v10483: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-16T11:26:42.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:26:42 smithi157 bash[24585]: cluster 2024-09-16T11:26:40.730297+0000 mgr.a (mgr.14373) 15115 : cluster [DBG] pgmap v10483: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-16T11:26:43.120 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:26:43.121 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:26:43.121 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:26:43.865 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:26:43.866 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:26:43.866 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:26:43.866 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:26:43.866 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:26:44.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:26:44 smithi086 bash[24289]: cluster 2024-09-16T11:26:42.732513+0000 mgr.a (mgr.14373) 15116 : cluster [DBG] pgmap v10484: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-16T11:26:44.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:26:44 smithi047 bash[22744]: cluster 2024-09-16T11:26:42.732513+0000 mgr.a (mgr.14373) 15116 : cluster [DBG] pgmap v10484: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-16T11:26:44.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:26:44 smithi157 bash[24585]: cluster 2024-09-16T11:26:42.732513+0000 mgr.a (mgr.14373) 15116 : cluster [DBG] pgmap v10484: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-16T11:26:45.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:26:45 smithi047 bash[22744]: audit 2024-09-16T11:26:43.452612+0000 mgr.a (mgr.14373) 15117 : audit [DBG] from='client.326823 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:26:45.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:26:45 smithi157 bash[24585]: audit 2024-09-16T11:26:43.452612+0000 mgr.a (mgr.14373) 15117 : audit [DBG] from='client.326823 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:26:45.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:26:45 smithi086 bash[24289]: audit 2024-09-16T11:26:43.452612+0000 mgr.a (mgr.14373) 15117 : audit [DBG] from='client.326823 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:26:46.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:26:46 smithi047 bash[22744]: cluster 2024-09-16T11:26:44.733508+0000 mgr.a (mgr.14373) 15118 : cluster [DBG] pgmap v10485: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:26:46.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:26:46 smithi157 bash[24585]: cluster 2024-09-16T11:26:44.733508+0000 mgr.a (mgr.14373) 15118 : cluster [DBG] pgmap v10485: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:26:46.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:26:46 smithi086 bash[24289]: cluster 2024-09-16T11:26:44.733508+0000 mgr.a (mgr.14373) 15118 : cluster [DBG] pgmap v10485: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:26:48.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:26:48 smithi047 bash[22744]: cluster 2024-09-16T11:26:46.735684+0000 mgr.a (mgr.14373) 15119 : cluster [DBG] pgmap v10486: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:26:48.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:26:48 smithi157 bash[24585]: cluster 2024-09-16T11:26:46.735684+0000 mgr.a (mgr.14373) 15119 : cluster [DBG] pgmap v10486: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:26:48.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:26:48 smithi086 bash[24289]: cluster 2024-09-16T11:26:46.735684+0000 mgr.a (mgr.14373) 15119 : cluster [DBG] pgmap v10486: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:26:48.867 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:26:48.868 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:26:48.868 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:26:49.608 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:26:49.608 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:26:49.608 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:26:49.608 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:26:49.608 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:26:50.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:26:50 smithi047 bash[22744]: cluster 2024-09-16T11:26:48.736443+0000 mgr.a (mgr.14373) 15120 : cluster [DBG] pgmap v10487: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:26:50.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:26:50 smithi047 bash[22744]: audit 2024-09-16T11:26:49.194210+0000 mgr.a (mgr.14373) 15121 : audit [DBG] from='client.326901 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:26:50.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:26:50 smithi157 bash[24585]: cluster 2024-09-16T11:26:48.736443+0000 mgr.a (mgr.14373) 15120 : cluster [DBG] pgmap v10487: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:26:50.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:26:50 smithi157 bash[24585]: audit 2024-09-16T11:26:49.194210+0000 mgr.a (mgr.14373) 15121 : audit [DBG] from='client.326901 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:26:50.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:26:50 smithi086 bash[24289]: cluster 2024-09-16T11:26:48.736443+0000 mgr.a (mgr.14373) 15120 : cluster [DBG] pgmap v10487: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:26:50.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:26:50 smithi086 bash[24289]: audit 2024-09-16T11:26:49.194210+0000 mgr.a (mgr.14373) 15121 : audit [DBG] from='client.326901 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:26:52.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:26:52 smithi047 bash[22744]: cluster 2024-09-16T11:26:50.737351+0000 mgr.a (mgr.14373) 15122 : cluster [DBG] pgmap v10488: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:26:52.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:26:52 smithi157 bash[24585]: cluster 2024-09-16T11:26:50.737351+0000 mgr.a (mgr.14373) 15122 : cluster [DBG] pgmap v10488: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:26:52.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:26:52 smithi086 bash[24289]: cluster 2024-09-16T11:26:50.737351+0000 mgr.a (mgr.14373) 15122 : cluster [DBG] pgmap v10488: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:26:54.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:26:54 smithi157 bash[24585]: cluster 2024-09-16T11:26:52.739615+0000 mgr.a (mgr.14373) 15123 : cluster [DBG] pgmap v10489: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:26:54.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:26:54 smithi086 bash[24289]: cluster 2024-09-16T11:26:52.739615+0000 mgr.a (mgr.14373) 15123 : cluster [DBG] pgmap v10489: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:26:54.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:26:54 smithi047 bash[22744]: cluster 2024-09-16T11:26:52.739615+0000 mgr.a (mgr.14373) 15123 : cluster [DBG] pgmap v10489: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:26:54.609 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:26:54.610 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:26:54.610 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:26:55.366 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:26:55.367 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:26:55.367 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:26:55.367 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:26:55.367 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:26:56.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:26:56 smithi157 bash[24585]: cluster 2024-09-16T11:26:54.740090+0000 mgr.a (mgr.14373) 15124 : cluster [DBG] pgmap v10490: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:26:56.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:26:56 smithi157 bash[24585]: audit 2024-09-16T11:26:54.942579+0000 mgr.a (mgr.14373) 15125 : audit [DBG] from='client.326979 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:26:56.572 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:26:56 smithi086 bash[24289]: cluster 2024-09-16T11:26:54.740090+0000 mgr.a (mgr.14373) 15124 : cluster [DBG] pgmap v10490: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:26:56.572 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:26:56 smithi086 bash[24289]: audit 2024-09-16T11:26:54.942579+0000 mgr.a (mgr.14373) 15125 : audit [DBG] from='client.326979 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:26:56.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:26:56 smithi047 bash[22744]: cluster 2024-09-16T11:26:54.740090+0000 mgr.a (mgr.14373) 15124 : cluster [DBG] pgmap v10490: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:26:56.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:26:56 smithi047 bash[22744]: audit 2024-09-16T11:26:54.942579+0000 mgr.a (mgr.14373) 15125 : audit [DBG] from='client.326979 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:26:57.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:26:57 smithi157 bash[24585]: cluster 2024-09-16T11:26:56.742308+0000 mgr.a (mgr.14373) 15126 : cluster [DBG] pgmap v10491: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:26:57.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:26:57 smithi086 bash[24289]: cluster 2024-09-16T11:26:56.742308+0000 mgr.a (mgr.14373) 15126 : cluster [DBG] pgmap v10491: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:26:57.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:26:57 smithi047 bash[22744]: cluster 2024-09-16T11:26:56.742308+0000 mgr.a (mgr.14373) 15126 : cluster [DBG] pgmap v10491: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:27:00.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:26:59 smithi157 bash[24585]: cluster 2024-09-16T11:26:58.743095+0000 mgr.a (mgr.14373) 15127 : cluster [DBG] pgmap v10492: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:27:00.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:26:59 smithi086 bash[24289]: cluster 2024-09-16T11:26:58.743095+0000 mgr.a (mgr.14373) 15127 : cluster [DBG] pgmap v10492: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:27:00.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:26:59 smithi047 bash[22744]: cluster 2024-09-16T11:26:58.743095+0000 mgr.a (mgr.14373) 15127 : cluster [DBG] pgmap v10492: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:27:00.368 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:27:00.369 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:27:00.369 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:27:01.134 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:27:01.134 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:27:01.134 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:27:01.135 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:27:01.135 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:27:02.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:27:01 smithi157 bash[24585]: audit 2024-09-16T11:27:00.698831+0000 mgr.a (mgr.14373) 15128 : audit [DBG] from='client.327057 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:27:02.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:27:01 smithi157 bash[24585]: cluster 2024-09-16T11:27:00.744124+0000 mgr.a (mgr.14373) 15129 : cluster [DBG] pgmap v10493: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:27:02.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:27:01 smithi086 bash[24289]: audit 2024-09-16T11:27:00.698831+0000 mgr.a (mgr.14373) 15128 : audit [DBG] from='client.327057 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:27:02.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:27:01 smithi086 bash[24289]: cluster 2024-09-16T11:27:00.744124+0000 mgr.a (mgr.14373) 15129 : cluster [DBG] pgmap v10493: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:27:02.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:27:01 smithi047 bash[22744]: audit 2024-09-16T11:27:00.698831+0000 mgr.a (mgr.14373) 15128 : audit [DBG] from='client.327057 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:27:02.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:27:01 smithi047 bash[22744]: cluster 2024-09-16T11:27:00.744124+0000 mgr.a (mgr.14373) 15129 : cluster [DBG] pgmap v10493: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:27:04.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:27:03 smithi086 bash[24289]: cluster 2024-09-16T11:27:02.746573+0000 mgr.a (mgr.14373) 15130 : cluster [DBG] pgmap v10494: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:27:04.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:27:03 smithi047 bash[22744]: cluster 2024-09-16T11:27:02.746573+0000 mgr.a (mgr.14373) 15130 : cluster [DBG] pgmap v10494: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:27:04.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:27:03 smithi157 bash[24585]: cluster 2024-09-16T11:27:02.746573+0000 mgr.a (mgr.14373) 15130 : cluster [DBG] pgmap v10494: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:27:06.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:27:05 smithi086 bash[24289]: cluster 2024-09-16T11:27:04.747357+0000 mgr.a (mgr.14373) 15131 : cluster [DBG] pgmap v10495: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:27:06.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:27:05 smithi047 bash[22744]: cluster 2024-09-16T11:27:04.747357+0000 mgr.a (mgr.14373) 15131 : cluster [DBG] pgmap v10495: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:27:06.136 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:27:06.137 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:27:06.137 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:27:06.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:27:05 smithi157 bash[24585]: cluster 2024-09-16T11:27:04.747357+0000 mgr.a (mgr.14373) 15131 : cluster [DBG] pgmap v10495: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:27:06.897 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:27:06.898 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:27:06.898 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:27:06.898 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:27:06.898 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:27:08.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:27:07 smithi086 bash[24289]: audit 2024-09-16T11:27:06.462658+0000 mgr.a (mgr.14373) 15132 : audit [DBG] from='client.327135 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:27:08.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:27:07 smithi086 bash[24289]: cluster 2024-09-16T11:27:06.748687+0000 mgr.a (mgr.14373) 15133 : cluster [DBG] pgmap v10496: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:27:08.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:27:07 smithi047 bash[22744]: audit 2024-09-16T11:27:06.462658+0000 mgr.a (mgr.14373) 15132 : audit [DBG] from='client.327135 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:27:08.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:27:07 smithi047 bash[22744]: cluster 2024-09-16T11:27:06.748687+0000 mgr.a (mgr.14373) 15133 : cluster [DBG] pgmap v10496: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:27:08.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:27:07 smithi157 bash[24585]: audit 2024-09-16T11:27:06.462658+0000 mgr.a (mgr.14373) 15132 : audit [DBG] from='client.327135 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:27:08.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:27:07 smithi157 bash[24585]: cluster 2024-09-16T11:27:06.748687+0000 mgr.a (mgr.14373) 15133 : cluster [DBG] pgmap v10496: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:27:10.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:27:09 smithi047 bash[22744]: cluster 2024-09-16T11:27:08.749737+0000 mgr.a (mgr.14373) 15134 : cluster [DBG] pgmap v10497: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:27:10.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:27:09 smithi157 bash[24585]: cluster 2024-09-16T11:27:08.749737+0000 mgr.a (mgr.14373) 15134 : cluster [DBG] pgmap v10497: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:27:10.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:27:09 smithi086 bash[24289]: cluster 2024-09-16T11:27:08.749737+0000 mgr.a (mgr.14373) 15134 : cluster [DBG] pgmap v10497: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:27:11.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:27:10 smithi047 bash[22744]: audit 2024-09-16T11:27:10.550258+0000 mon.b (mon.2) 1378 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T11:27:11.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:27:10 smithi157 bash[24585]: audit 2024-09-16T11:27:10.550258+0000 mon.b (mon.2) 1378 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T11:27:11.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:27:10 smithi086 bash[24289]: audit 2024-09-16T11:27:10.550258+0000 mon.b (mon.2) 1378 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T11:27:11.899 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:27:11.899 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:27:11.899 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:27:12.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:27:11 smithi047 bash[22744]: cluster 2024-09-16T11:27:10.750693+0000 mgr.a (mgr.14373) 15135 : cluster [DBG] pgmap v10498: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T11:27:12.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:27:11 smithi047 bash[22744]: audit 2024-09-16T11:27:11.398785+0000 mon.b (mon.2) 1379 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T11:27:12.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:27:11 smithi047 bash[22744]: audit 2024-09-16T11:27:11.401019+0000 mon.b (mon.2) 1380 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T11:27:12.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:27:11 smithi047 bash[22744]: audit 2024-09-16T11:27:11.412608+0000 mon.a (mon.0) 1473 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:27:12.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:27:11 smithi047 bash[22744]: audit 2024-09-16T11:27:11.417637+0000 mon.b (mon.2) 1381 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:27:12.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:27:11 smithi157 bash[24585]: cluster 2024-09-16T11:27:10.750693+0000 mgr.a (mgr.14373) 15135 : cluster [DBG] pgmap v10498: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T11:27:12.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:27:11 smithi157 bash[24585]: audit 2024-09-16T11:27:11.398785+0000 mon.b (mon.2) 1379 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T11:27:12.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:27:11 smithi157 bash[24585]: audit 2024-09-16T11:27:11.401019+0000 mon.b (mon.2) 1380 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T11:27:12.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:27:11 smithi157 bash[24585]: audit 2024-09-16T11:27:11.412608+0000 mon.a (mon.0) 1473 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:27:12.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:27:11 smithi157 bash[24585]: audit 2024-09-16T11:27:11.417637+0000 mon.b (mon.2) 1381 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:27:12.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:27:11 smithi086 bash[24289]: cluster 2024-09-16T11:27:10.750693+0000 mgr.a (mgr.14373) 15135 : cluster [DBG] pgmap v10498: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T11:27:12.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:27:11 smithi086 bash[24289]: audit 2024-09-16T11:27:11.398785+0000 mon.b (mon.2) 1379 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T11:27:12.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:27:11 smithi086 bash[24289]: audit 2024-09-16T11:27:11.401019+0000 mon.b (mon.2) 1380 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T11:27:12.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:27:11 smithi086 bash[24289]: audit 2024-09-16T11:27:11.412608+0000 mon.a (mon.0) 1473 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:27:12.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:27:11 smithi086 bash[24289]: audit 2024-09-16T11:27:11.417637+0000 mon.b (mon.2) 1381 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:27:12.592 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 11:27:12 smithi047 bash[22994]: debug 2024-09-16T11:27:12.172+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T11:27:12.592 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 11:27:12 smithi047 bash[22994]: debug 2024-09-16T11:27:12.176+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T11:27:12.624 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:27:12.624 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:27:12.624 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:27:12.624 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:27:12.624 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:27:13.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:27:12 smithi047 bash[22744]: audit 2024-09-16T11:27:11.420569+0000 mgr.a (mgr.14373) 15136 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:27:13.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:27:12 smithi047 bash[22744]: audit 2024-09-16T11:27:12.178043+0000 mgr.a (mgr.14373) 15137 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T11:27:13.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:27:12 smithi047 bash[22744]: cephadm 2024-09-16T11:27:12.180521+0000 mgr.a (mgr.14373) 15138 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T11:27:13.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:27:12 smithi157 bash[24585]: audit 2024-09-16T11:27:11.420569+0000 mgr.a (mgr.14373) 15136 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:27:13.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:27:12 smithi157 bash[24585]: audit 2024-09-16T11:27:12.178043+0000 mgr.a (mgr.14373) 15137 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T11:27:13.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:27:12 smithi157 bash[24585]: cephadm 2024-09-16T11:27:12.180521+0000 mgr.a (mgr.14373) 15138 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T11:27:13.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:27:12 smithi086 bash[24289]: audit 2024-09-16T11:27:11.420569+0000 mgr.a (mgr.14373) 15136 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:27:13.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:27:12 smithi086 bash[24289]: audit 2024-09-16T11:27:12.178043+0000 mgr.a (mgr.14373) 15137 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T11:27:13.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:27:12 smithi086 bash[24289]: cephadm 2024-09-16T11:27:12.180521+0000 mgr.a (mgr.14373) 15138 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T11:27:14.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:27:13 smithi157 bash[24585]: audit 2024-09-16T11:27:12.223806+0000 mgr.a (mgr.14373) 15139 : audit [DBG] from='client.327300 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:27:14.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:27:13 smithi157 bash[24585]: cluster 2024-09-16T11:27:12.753649+0000 mgr.a (mgr.14373) 15140 : cluster [DBG] pgmap v10499: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:27:14.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:27:13 smithi086 bash[24289]: audit 2024-09-16T11:27:12.223806+0000 mgr.a (mgr.14373) 15139 : audit [DBG] from='client.327300 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:27:14.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:27:13 smithi086 bash[24289]: cluster 2024-09-16T11:27:12.753649+0000 mgr.a (mgr.14373) 15140 : cluster [DBG] pgmap v10499: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:27:14.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:27:13 smithi047 bash[22744]: audit 2024-09-16T11:27:12.223806+0000 mgr.a (mgr.14373) 15139 : audit [DBG] from='client.327300 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:27:14.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:27:13 smithi047 bash[22744]: cluster 2024-09-16T11:27:12.753649+0000 mgr.a (mgr.14373) 15140 : cluster [DBG] pgmap v10499: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:27:16.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:27:15 smithi157 bash[24585]: cluster 2024-09-16T11:27:14.754649+0000 mgr.a (mgr.14373) 15141 : cluster [DBG] pgmap v10500: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:27:16.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:27:15 smithi086 bash[24289]: cluster 2024-09-16T11:27:14.754649+0000 mgr.a (mgr.14373) 15141 : cluster [DBG] pgmap v10500: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:27:16.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:27:15 smithi047 bash[22744]: cluster 2024-09-16T11:27:14.754649+0000 mgr.a (mgr.14373) 15141 : cluster [DBG] pgmap v10500: 225 pgs: 225 active+clean; 589 KiB data, 221 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:27:17.625 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:27:17.626 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:27:17.626 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:27:18.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:27:17 smithi157 bash[24585]: cluster 2024-09-16T11:27:16.756763+0000 mgr.a (mgr.14373) 15142 : cluster [DBG] pgmap v10501: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:27:18.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:27:17 smithi086 bash[24289]: cluster 2024-09-16T11:27:16.756763+0000 mgr.a (mgr.14373) 15142 : cluster [DBG] pgmap v10501: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:27:18.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:27:17 smithi047 bash[22744]: cluster 2024-09-16T11:27:16.756763+0000 mgr.a (mgr.14373) 15142 : cluster [DBG] pgmap v10501: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:27:18.402 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:27:18.402 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:27:18.402 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:27:18.402 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:27:18.402 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:27:19.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:27:18 smithi157 bash[24585]: audit 2024-09-16T11:27:17.961983+0000 mgr.a (mgr.14373) 15143 : audit [DBG] from='client.327393 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:27:19.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:27:18 smithi086 bash[24289]: audit 2024-09-16T11:27:17.961983+0000 mgr.a (mgr.14373) 15143 : audit [DBG] from='client.327393 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:27:19.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:27:18 smithi047 bash[22744]: audit 2024-09-16T11:27:17.961983+0000 mgr.a (mgr.14373) 15143 : audit [DBG] from='client.327393 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:27:20.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:27:19 smithi157 bash[24585]: cluster 2024-09-16T11:27:18.757872+0000 mgr.a (mgr.14373) 15144 : cluster [DBG] pgmap v10502: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:27:20.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:27:19 smithi086 bash[24289]: cluster 2024-09-16T11:27:18.757872+0000 mgr.a (mgr.14373) 15144 : cluster [DBG] pgmap v10502: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:27:20.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:27:19 smithi047 bash[22744]: cluster 2024-09-16T11:27:18.757872+0000 mgr.a (mgr.14373) 15144 : cluster [DBG] pgmap v10502: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:27:22.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:27:21 smithi157 bash[24585]: cluster 2024-09-16T11:27:20.758746+0000 mgr.a (mgr.14373) 15145 : cluster [DBG] pgmap v10503: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:27:22.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:27:21 smithi086 bash[24289]: cluster 2024-09-16T11:27:20.758746+0000 mgr.a (mgr.14373) 15145 : cluster [DBG] pgmap v10503: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:27:22.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:27:21 smithi047 bash[22744]: cluster 2024-09-16T11:27:20.758746+0000 mgr.a (mgr.14373) 15145 : cluster [DBG] pgmap v10503: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:27:23.403 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:27:23.404 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:27:23.404 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:27:24.195 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:27:24.195 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:27:24.195 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:27:24.195 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:27:24.196 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:27:24.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:27:23 smithi157 bash[24585]: cluster 2024-09-16T11:27:22.760994+0000 mgr.a (mgr.14373) 15146 : cluster [DBG] pgmap v10504: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:27:24.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:27:23 smithi086 bash[24289]: cluster 2024-09-16T11:27:22.760994+0000 mgr.a (mgr.14373) 15146 : cluster [DBG] pgmap v10504: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:27:24.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:27:23 smithi047 bash[22744]: cluster 2024-09-16T11:27:22.760994+0000 mgr.a (mgr.14373) 15146 : cluster [DBG] pgmap v10504: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:27:25.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:27:24 smithi157 bash[24585]: audit 2024-09-16T11:27:23.743225+0000 mgr.a (mgr.14373) 15147 : audit [DBG] from='client.327468 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:27:25.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:27:24 smithi086 bash[24289]: audit 2024-09-16T11:27:23.743225+0000 mgr.a (mgr.14373) 15147 : audit [DBG] from='client.327468 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:27:25.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:27:24 smithi047 bash[22744]: audit 2024-09-16T11:27:23.743225+0000 mgr.a (mgr.14373) 15147 : audit [DBG] from='client.327468 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:27:26.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:27:25 smithi157 bash[24585]: cluster 2024-09-16T11:27:24.761955+0000 mgr.a (mgr.14373) 15148 : cluster [DBG] pgmap v10505: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:27:26.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:27:25 smithi086 bash[24289]: cluster 2024-09-16T11:27:24.761955+0000 mgr.a (mgr.14373) 15148 : cluster [DBG] pgmap v10505: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:27:26.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:27:25 smithi047 bash[22744]: cluster 2024-09-16T11:27:24.761955+0000 mgr.a (mgr.14373) 15148 : cluster [DBG] pgmap v10505: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:27:28.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:27:27 smithi157 bash[24585]: cluster 2024-09-16T11:27:26.764812+0000 mgr.a (mgr.14373) 15149 : cluster [DBG] pgmap v10506: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:27:28.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:27:27 smithi086 bash[24289]: cluster 2024-09-16T11:27:26.764812+0000 mgr.a (mgr.14373) 15149 : cluster [DBG] pgmap v10506: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:27:28.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:27:27 smithi047 bash[22744]: cluster 2024-09-16T11:27:26.764812+0000 mgr.a (mgr.14373) 15149 : cluster [DBG] pgmap v10506: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:27:29.196 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:27:29.197 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:27:29.197 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:27:29.943 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:27:29.943 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:27:29.943 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:27:29.944 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:27:29.944 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:27:30.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:27:29 smithi157 bash[24585]: cluster 2024-09-16T11:27:28.765595+0000 mgr.a (mgr.14373) 15150 : cluster [DBG] pgmap v10507: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:27:30.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:27:29 smithi086 bash[24289]: cluster 2024-09-16T11:27:28.765595+0000 mgr.a (mgr.14373) 15150 : cluster [DBG] pgmap v10507: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:27:30.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:27:29 smithi047 bash[22744]: cluster 2024-09-16T11:27:28.765595+0000 mgr.a (mgr.14373) 15150 : cluster [DBG] pgmap v10507: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:27:31.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:27:30 smithi157 bash[24585]: audit 2024-09-16T11:27:29.527846+0000 mgr.a (mgr.14373) 15151 : audit [DBG] from='client.327543 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:27:31.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:27:30 smithi086 bash[24289]: audit 2024-09-16T11:27:29.527846+0000 mgr.a (mgr.14373) 15151 : audit [DBG] from='client.327543 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:27:31.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:27:30 smithi047 bash[22744]: audit 2024-09-16T11:27:29.527846+0000 mgr.a (mgr.14373) 15151 : audit [DBG] from='client.327543 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:27:32.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:27:31 smithi157 bash[24585]: cluster 2024-09-16T11:27:30.766614+0000 mgr.a (mgr.14373) 15152 : cluster [DBG] pgmap v10508: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:27:32.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:27:31 smithi086 bash[24289]: cluster 2024-09-16T11:27:30.766614+0000 mgr.a (mgr.14373) 15152 : cluster [DBG] pgmap v10508: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:27:32.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:27:31 smithi047 bash[22744]: cluster 2024-09-16T11:27:30.766614+0000 mgr.a (mgr.14373) 15152 : cluster [DBG] pgmap v10508: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:27:34.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:27:33 smithi157 bash[24585]: cluster 2024-09-16T11:27:32.768861+0000 mgr.a (mgr.14373) 15153 : cluster [DBG] pgmap v10509: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:27:34.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:27:33 smithi086 bash[24289]: cluster 2024-09-16T11:27:32.768861+0000 mgr.a (mgr.14373) 15153 : cluster [DBG] pgmap v10509: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:27:34.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:27:33 smithi047 bash[22744]: cluster 2024-09-16T11:27:32.768861+0000 mgr.a (mgr.14373) 15153 : cluster [DBG] pgmap v10509: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:27:34.945 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:27:34.946 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:27:34.946 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:27:35.731 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:27:35.732 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:27:35.732 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:27:35.732 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:27:35.732 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:27:36.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:27:35 smithi157 bash[24585]: cluster 2024-09-16T11:27:34.769602+0000 mgr.a (mgr.14373) 15154 : cluster [DBG] pgmap v10510: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:27:36.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:27:35 smithi086 bash[24289]: cluster 2024-09-16T11:27:34.769602+0000 mgr.a (mgr.14373) 15154 : cluster [DBG] pgmap v10510: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:27:36.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:27:35 smithi047 bash[22744]: cluster 2024-09-16T11:27:34.769602+0000 mgr.a (mgr.14373) 15154 : cluster [DBG] pgmap v10510: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:27:37.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:27:36 smithi157 bash[24585]: audit 2024-09-16T11:27:35.279286+0000 mgr.a (mgr.14373) 15155 : audit [DBG] from='client.327615 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:27:37.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:27:36 smithi086 bash[24289]: audit 2024-09-16T11:27:35.279286+0000 mgr.a (mgr.14373) 15155 : audit [DBG] from='client.327615 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:27:37.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:27:36 smithi047 bash[22744]: audit 2024-09-16T11:27:35.279286+0000 mgr.a (mgr.14373) 15155 : audit [DBG] from='client.327615 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:27:38.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:27:37 smithi157 bash[24585]: cluster 2024-09-16T11:27:36.771932+0000 mgr.a (mgr.14373) 15156 : cluster [DBG] pgmap v10511: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:27:38.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:27:37 smithi086 bash[24289]: cluster 2024-09-16T11:27:36.771932+0000 mgr.a (mgr.14373) 15156 : cluster [DBG] pgmap v10511: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:27:38.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:27:37 smithi047 bash[22744]: cluster 2024-09-16T11:27:36.771932+0000 mgr.a (mgr.14373) 15156 : cluster [DBG] pgmap v10511: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:27:40.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:27:39 smithi157 bash[24585]: cluster 2024-09-16T11:27:38.772689+0000 mgr.a (mgr.14373) 15157 : cluster [DBG] pgmap v10512: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:27:40.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:27:39 smithi086 bash[24289]: cluster 2024-09-16T11:27:38.772689+0000 mgr.a (mgr.14373) 15157 : cluster [DBG] pgmap v10512: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:27:40.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:27:39 smithi047 bash[22744]: cluster 2024-09-16T11:27:38.772689+0000 mgr.a (mgr.14373) 15157 : cluster [DBG] pgmap v10512: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:27:40.733 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:27:40.734 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:27:40.734 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:27:41.515 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:27:41.515 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:27:41.515 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:27:41.515 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:27:41.515 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:27:42.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:27:41 smithi157 bash[24585]: cluster 2024-09-16T11:27:40.773451+0000 mgr.a (mgr.14373) 15158 : cluster [DBG] pgmap v10513: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:27:42.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:27:41 smithi157 bash[24585]: audit 2024-09-16T11:27:41.065743+0000 mgr.a (mgr.14373) 15159 : audit [DBG] from='client.327690 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:27:42.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:27:41 smithi086 bash[24289]: cluster 2024-09-16T11:27:40.773451+0000 mgr.a (mgr.14373) 15158 : cluster [DBG] pgmap v10513: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:27:42.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:27:41 smithi086 bash[24289]: audit 2024-09-16T11:27:41.065743+0000 mgr.a (mgr.14373) 15159 : audit [DBG] from='client.327690 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:27:42.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:27:41 smithi047 bash[22744]: cluster 2024-09-16T11:27:40.773451+0000 mgr.a (mgr.14373) 15158 : cluster [DBG] pgmap v10513: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:27:42.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:27:41 smithi047 bash[22744]: audit 2024-09-16T11:27:41.065743+0000 mgr.a (mgr.14373) 15159 : audit [DBG] from='client.327690 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:27:44.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:27:43 smithi157 bash[24585]: cluster 2024-09-16T11:27:42.775673+0000 mgr.a (mgr.14373) 15160 : cluster [DBG] pgmap v10514: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-16T11:27:44.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:27:43 smithi086 bash[24289]: cluster 2024-09-16T11:27:42.775673+0000 mgr.a (mgr.14373) 15160 : cluster [DBG] pgmap v10514: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-16T11:27:44.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:27:43 smithi047 bash[22744]: cluster 2024-09-16T11:27:42.775673+0000 mgr.a (mgr.14373) 15160 : cluster [DBG] pgmap v10514: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-16T11:27:46.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:27:45 smithi157 bash[24585]: cluster 2024-09-16T11:27:44.776418+0000 mgr.a (mgr.14373) 15161 : cluster [DBG] pgmap v10515: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T11:27:46.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:27:45 smithi086 bash[24289]: cluster 2024-09-16T11:27:44.776418+0000 mgr.a (mgr.14373) 15161 : cluster [DBG] pgmap v10515: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T11:27:46.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:27:45 smithi047 bash[22744]: cluster 2024-09-16T11:27:44.776418+0000 mgr.a (mgr.14373) 15161 : cluster [DBG] pgmap v10515: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T11:27:46.517 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:27:46.517 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:27:46.517 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:27:47.299 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:27:47.299 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:27:47.299 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:27:47.299 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:27:47.299 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:27:48.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:27:47 smithi157 bash[24585]: cluster 2024-09-16T11:27:46.778446+0000 mgr.a (mgr.14373) 15162 : cluster [DBG] pgmap v10516: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:27:48.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:27:47 smithi157 bash[24585]: audit 2024-09-16T11:27:46.852031+0000 mgr.a (mgr.14373) 15163 : audit [DBG] from='client.327768 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:27:48.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:27:47 smithi086 bash[24289]: cluster 2024-09-16T11:27:46.778446+0000 mgr.a (mgr.14373) 15162 : cluster [DBG] pgmap v10516: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:27:48.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:27:47 smithi086 bash[24289]: audit 2024-09-16T11:27:46.852031+0000 mgr.a (mgr.14373) 15163 : audit [DBG] from='client.327768 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:27:48.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:27:47 smithi047 bash[22744]: cluster 2024-09-16T11:27:46.778446+0000 mgr.a (mgr.14373) 15162 : cluster [DBG] pgmap v10516: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:27:48.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:27:47 smithi047 bash[22744]: audit 2024-09-16T11:27:46.852031+0000 mgr.a (mgr.14373) 15163 : audit [DBG] from='client.327768 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:27:50.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:27:49 smithi157 bash[24585]: cluster 2024-09-16T11:27:48.779295+0000 mgr.a (mgr.14373) 15164 : cluster [DBG] pgmap v10517: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:27:50.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:27:49 smithi086 bash[24289]: cluster 2024-09-16T11:27:48.779295+0000 mgr.a (mgr.14373) 15164 : cluster [DBG] pgmap v10517: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:27:50.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:27:49 smithi047 bash[22744]: cluster 2024-09-16T11:27:48.779295+0000 mgr.a (mgr.14373) 15164 : cluster [DBG] pgmap v10517: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:27:52.300 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:27:52.301 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:27:52.301 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:27:52.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:27:51 smithi157 bash[24585]: cluster 2024-09-16T11:27:50.780079+0000 mgr.a (mgr.14373) 15165 : cluster [DBG] pgmap v10518: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T11:27:52.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:27:51 smithi086 bash[24289]: cluster 2024-09-16T11:27:50.780079+0000 mgr.a (mgr.14373) 15165 : cluster [DBG] pgmap v10518: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T11:27:52.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:27:51 smithi047 bash[22744]: cluster 2024-09-16T11:27:50.780079+0000 mgr.a (mgr.14373) 15165 : cluster [DBG] pgmap v10518: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T11:27:53.098 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:27:53.099 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:27:53.099 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:27:53.099 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:27:53.099 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:27:54.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:27:53 smithi157 bash[24585]: audit 2024-09-16T11:27:52.640095+0000 mgr.a (mgr.14373) 15166 : audit [DBG] from='client.327843 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:27:54.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:27:53 smithi157 bash[24585]: cluster 2024-09-16T11:27:52.781370+0000 mgr.a (mgr.14373) 15167 : cluster [DBG] pgmap v10519: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:27:54.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:27:53 smithi086 bash[24289]: audit 2024-09-16T11:27:52.640095+0000 mgr.a (mgr.14373) 15166 : audit [DBG] from='client.327843 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:27:54.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:27:53 smithi086 bash[24289]: cluster 2024-09-16T11:27:52.781370+0000 mgr.a (mgr.14373) 15167 : cluster [DBG] pgmap v10519: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:27:54.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:27:53 smithi047 bash[22744]: audit 2024-09-16T11:27:52.640095+0000 mgr.a (mgr.14373) 15166 : audit [DBG] from='client.327843 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:27:54.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:27:53 smithi047 bash[22744]: cluster 2024-09-16T11:27:52.781370+0000 mgr.a (mgr.14373) 15167 : cluster [DBG] pgmap v10519: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:27:56.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:27:55 smithi157 bash[24585]: cluster 2024-09-16T11:27:54.782222+0000 mgr.a (mgr.14373) 15168 : cluster [DBG] pgmap v10520: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-16T11:27:56.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:27:55 smithi086 bash[24289]: cluster 2024-09-16T11:27:54.782222+0000 mgr.a (mgr.14373) 15168 : cluster [DBG] pgmap v10520: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-16T11:27:56.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:27:55 smithi047 bash[22744]: cluster 2024-09-16T11:27:54.782222+0000 mgr.a (mgr.14373) 15168 : cluster [DBG] pgmap v10520: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-16T11:27:58.100 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:27:58.101 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:27:58.101 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:27:58.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:27:57 smithi157 bash[24585]: cluster 2024-09-16T11:27:56.784368+0000 mgr.a (mgr.14373) 15169 : cluster [DBG] pgmap v10521: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-16T11:27:58.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:27:57 smithi086 bash[24289]: cluster 2024-09-16T11:27:56.784368+0000 mgr.a (mgr.14373) 15169 : cluster [DBG] pgmap v10521: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-16T11:27:58.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:27:57 smithi047 bash[22744]: cluster 2024-09-16T11:27:56.784368+0000 mgr.a (mgr.14373) 15169 : cluster [DBG] pgmap v10521: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-16T11:27:58.863 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:27:58.864 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:27:58.864 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:27:58.864 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:27:58.864 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:28:00.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:27:59 smithi157 bash[24585]: audit 2024-09-16T11:27:58.431564+0000 mgr.a (mgr.14373) 15170 : audit [DBG] from='client.327921 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:28:00.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:27:59 smithi157 bash[24585]: cluster 2024-09-16T11:27:58.784960+0000 mgr.a (mgr.14373) 15171 : cluster [DBG] pgmap v10522: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:28:00.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:27:59 smithi086 bash[24289]: audit 2024-09-16T11:27:58.431564+0000 mgr.a (mgr.14373) 15170 : audit [DBG] from='client.327921 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:28:00.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:27:59 smithi086 bash[24289]: cluster 2024-09-16T11:27:58.784960+0000 mgr.a (mgr.14373) 15171 : cluster [DBG] pgmap v10522: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:28:00.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:27:59 smithi047 bash[22744]: audit 2024-09-16T11:27:58.431564+0000 mgr.a (mgr.14373) 15170 : audit [DBG] from='client.327921 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:28:00.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:27:59 smithi047 bash[22744]: cluster 2024-09-16T11:27:58.784960+0000 mgr.a (mgr.14373) 15171 : cluster [DBG] pgmap v10522: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:28:02.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:28:01 smithi157 bash[24585]: cluster 2024-09-16T11:28:00.785711+0000 mgr.a (mgr.14373) 15172 : cluster [DBG] pgmap v10523: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:28:02.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:28:01 smithi086 bash[24289]: cluster 2024-09-16T11:28:00.785711+0000 mgr.a (mgr.14373) 15172 : cluster [DBG] pgmap v10523: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:28:02.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:28:01 smithi047 bash[22744]: cluster 2024-09-16T11:28:00.785711+0000 mgr.a (mgr.14373) 15172 : cluster [DBG] pgmap v10523: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:28:03.865 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:28:03.866 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:28:03.866 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:28:04.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:28:03 smithi157 bash[24585]: cluster 2024-09-16T11:28:02.787950+0000 mgr.a (mgr.14373) 15173 : cluster [DBG] pgmap v10524: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:28:04.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:28:03 smithi086 bash[24289]: cluster 2024-09-16T11:28:02.787950+0000 mgr.a (mgr.14373) 15173 : cluster [DBG] pgmap v10524: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:28:04.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:28:03 smithi047 bash[22744]: cluster 2024-09-16T11:28:02.787950+0000 mgr.a (mgr.14373) 15173 : cluster [DBG] pgmap v10524: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:28:04.658 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:28:04.658 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:28:04.658 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:28:04.658 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:28:04.658 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:28:05.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:28:04 smithi157 bash[24585]: audit 2024-09-16T11:28:04.202418+0000 mgr.a (mgr.14373) 15174 : audit [DBG] from='client.327996 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:28:05.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:28:04 smithi086 bash[24289]: audit 2024-09-16T11:28:04.202418+0000 mgr.a (mgr.14373) 15174 : audit [DBG] from='client.327996 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:28:05.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:28:04 smithi047 bash[22744]: audit 2024-09-16T11:28:04.202418+0000 mgr.a (mgr.14373) 15174 : audit [DBG] from='client.327996 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:28:06.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:28:05 smithi157 bash[24585]: cluster 2024-09-16T11:28:04.788885+0000 mgr.a (mgr.14373) 15175 : cluster [DBG] pgmap v10525: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:28:06.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:28:05 smithi086 bash[24289]: cluster 2024-09-16T11:28:04.788885+0000 mgr.a (mgr.14373) 15175 : cluster [DBG] pgmap v10525: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:28:06.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:28:05 smithi047 bash[22744]: cluster 2024-09-16T11:28:04.788885+0000 mgr.a (mgr.14373) 15175 : cluster [DBG] pgmap v10525: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:28:08.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:28:07 smithi157 bash[24585]: cluster 2024-09-16T11:28:06.791086+0000 mgr.a (mgr.14373) 15176 : cluster [DBG] pgmap v10526: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-16T11:28:08.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:28:07 smithi086 bash[24289]: cluster 2024-09-16T11:28:06.791086+0000 mgr.a (mgr.14373) 15176 : cluster [DBG] pgmap v10526: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-16T11:28:08.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:28:07 smithi047 bash[22744]: cluster 2024-09-16T11:28:06.791086+0000 mgr.a (mgr.14373) 15176 : cluster [DBG] pgmap v10526: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-16T11:28:09.660 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:28:09.660 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:28:09.661 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:28:10.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:28:10 smithi157 bash[24585]: cluster 2024-09-16T11:28:08.791835+0000 mgr.a (mgr.14373) 15177 : cluster [DBG] pgmap v10527: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-16T11:28:10.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:28:10 smithi086 bash[24289]: cluster 2024-09-16T11:28:08.791835+0000 mgr.a (mgr.14373) 15177 : cluster [DBG] pgmap v10527: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-16T11:28:10.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:28:10 smithi047 bash[22744]: cluster 2024-09-16T11:28:08.791835+0000 mgr.a (mgr.14373) 15177 : cluster [DBG] pgmap v10527: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-16T11:28:10.425 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:28:10.426 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:28:10.426 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:28:10.426 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:28:10.426 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:28:11.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:28:11 smithi157 bash[24585]: audit 2024-09-16T11:28:09.989901+0000 mgr.a (mgr.14373) 15178 : audit [DBG] from='client.328071 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:28:11.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:28:11 smithi086 bash[24289]: audit 2024-09-16T11:28:09.989901+0000 mgr.a (mgr.14373) 15178 : audit [DBG] from='client.328071 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:28:11.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:28:11 smithi047 bash[22744]: audit 2024-09-16T11:28:09.989901+0000 mgr.a (mgr.14373) 15178 : audit [DBG] from='client.328071 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:28:12.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:28:12 smithi157 bash[24585]: cluster 2024-09-16T11:28:10.792699+0000 mgr.a (mgr.14373) 15179 : cluster [DBG] pgmap v10528: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-16T11:28:12.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:28:12 smithi086 bash[24289]: cluster 2024-09-16T11:28:10.792699+0000 mgr.a (mgr.14373) 15179 : cluster [DBG] pgmap v10528: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-16T11:28:12.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:28:12 smithi047 bash[22744]: cluster 2024-09-16T11:28:10.792699+0000 mgr.a (mgr.14373) 15179 : cluster [DBG] pgmap v10528: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-16T11:28:13.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:28:13 smithi157 bash[24585]: audit 2024-09-16T11:28:12.246626+0000 mon.b (mon.2) 1382 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T11:28:13.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:28:13 smithi086 bash[24289]: audit 2024-09-16T11:28:12.246626+0000 mon.b (mon.2) 1382 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T11:28:13.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:28:13 smithi047 bash[22744]: audit 2024-09-16T11:28:12.246626+0000 mon.b (mon.2) 1382 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T11:28:14.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:28:14 smithi157 bash[24585]: cluster 2024-09-16T11:28:12.794894+0000 mgr.a (mgr.14373) 15180 : cluster [DBG] pgmap v10529: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-16T11:28:14.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:28:14 smithi157 bash[24585]: audit 2024-09-16T11:28:13.076025+0000 mon.b (mon.2) 1383 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T11:28:14.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:28:14 smithi157 bash[24585]: audit 2024-09-16T11:28:13.078169+0000 mon.b (mon.2) 1384 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T11:28:14.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:28:14 smithi157 bash[24585]: audit 2024-09-16T11:28:13.090430+0000 mon.a (mon.0) 1474 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:28:14.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:28:14 smithi157 bash[24585]: audit 2024-09-16T11:28:13.095440+0000 mon.b (mon.2) 1385 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:28:14.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:28:14 smithi157 bash[24585]: audit 2024-09-16T11:28:13.098226+0000 mgr.a (mgr.14373) 15181 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:28:14.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:28:14 smithi086 bash[24289]: cluster 2024-09-16T11:28:12.794894+0000 mgr.a (mgr.14373) 15180 : cluster [DBG] pgmap v10529: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-16T11:28:14.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:28:14 smithi086 bash[24289]: audit 2024-09-16T11:28:13.076025+0000 mon.b (mon.2) 1383 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T11:28:14.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:28:14 smithi086 bash[24289]: audit 2024-09-16T11:28:13.078169+0000 mon.b (mon.2) 1384 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T11:28:14.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:28:14 smithi086 bash[24289]: audit 2024-09-16T11:28:13.090430+0000 mon.a (mon.0) 1474 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:28:14.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:28:14 smithi086 bash[24289]: audit 2024-09-16T11:28:13.095440+0000 mon.b (mon.2) 1385 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:28:14.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:28:14 smithi086 bash[24289]: audit 2024-09-16T11:28:13.098226+0000 mgr.a (mgr.14373) 15181 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:28:14.342 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 11:28:13 smithi047 bash[22994]: debug 2024-09-16T11:28:13.855+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T11:28:14.343 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 11:28:13 smithi047 bash[22994]: debug 2024-09-16T11:28:13.859+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T11:28:14.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:28:14 smithi047 bash[22744]: cluster 2024-09-16T11:28:12.794894+0000 mgr.a (mgr.14373) 15180 : cluster [DBG] pgmap v10529: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-16T11:28:14.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:28:14 smithi047 bash[22744]: audit 2024-09-16T11:28:13.076025+0000 mon.b (mon.2) 1383 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T11:28:14.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:28:14 smithi047 bash[22744]: audit 2024-09-16T11:28:13.078169+0000 mon.b (mon.2) 1384 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T11:28:14.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:28:14 smithi047 bash[22744]: audit 2024-09-16T11:28:13.090430+0000 mon.a (mon.0) 1474 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:28:14.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:28:14 smithi047 bash[22744]: audit 2024-09-16T11:28:13.095440+0000 mon.b (mon.2) 1385 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:28:14.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:28:14 smithi047 bash[22744]: audit 2024-09-16T11:28:13.098226+0000 mgr.a (mgr.14373) 15181 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:28:15.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:28:15 smithi157 bash[24585]: audit 2024-09-16T11:28:13.861190+0000 mgr.a (mgr.14373) 15182 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T11:28:15.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:28:15 smithi157 bash[24585]: cephadm 2024-09-16T11:28:13.863181+0000 mgr.a (mgr.14373) 15183 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T11:28:15.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:28:15 smithi086 bash[24289]: audit 2024-09-16T11:28:13.861190+0000 mgr.a (mgr.14373) 15182 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T11:28:15.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:28:15 smithi086 bash[24289]: cephadm 2024-09-16T11:28:13.863181+0000 mgr.a (mgr.14373) 15183 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T11:28:15.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:28:15 smithi047 bash[22744]: audit 2024-09-16T11:28:13.861190+0000 mgr.a (mgr.14373) 15182 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T11:28:15.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:28:15 smithi047 bash[22744]: cephadm 2024-09-16T11:28:13.863181+0000 mgr.a (mgr.14373) 15183 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T11:28:15.427 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:28:15.428 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:28:15.428 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:28:16.207 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:28:16.207 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:28:16.207 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:28:16.207 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:28:16.207 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:28:16.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:28:16 smithi157 bash[24585]: cluster 2024-09-16T11:28:14.795791+0000 mgr.a (mgr.14373) 15184 : cluster [DBG] pgmap v10530: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-16T11:28:16.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:28:16 smithi086 bash[24289]: cluster 2024-09-16T11:28:14.795791+0000 mgr.a (mgr.14373) 15184 : cluster [DBG] pgmap v10530: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-16T11:28:16.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:28:16 smithi047 bash[22744]: cluster 2024-09-16T11:28:14.795791+0000 mgr.a (mgr.14373) 15184 : cluster [DBG] pgmap v10530: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-16T11:28:17.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:28:17 smithi157 bash[24585]: audit 2024-09-16T11:28:15.767808+0000 mgr.a (mgr.14373) 15185 : audit [DBG] from='client.328254 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:28:17.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:28:17 smithi086 bash[24289]: audit 2024-09-16T11:28:15.767808+0000 mgr.a (mgr.14373) 15185 : audit [DBG] from='client.328254 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:28:17.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:28:17 smithi047 bash[22744]: audit 2024-09-16T11:28:15.767808+0000 mgr.a (mgr.14373) 15185 : audit [DBG] from='client.328254 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:28:18.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:28:18 smithi157 bash[24585]: cluster 2024-09-16T11:28:16.798238+0000 mgr.a (mgr.14373) 15186 : cluster [DBG] pgmap v10531: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 12 KiB/s rd, 426 B/s wr, 14 op/s 2024-09-16T11:28:18.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:28:18 smithi086 bash[24289]: cluster 2024-09-16T11:28:16.798238+0000 mgr.a (mgr.14373) 15186 : cluster [DBG] pgmap v10531: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 12 KiB/s rd, 426 B/s wr, 14 op/s 2024-09-16T11:28:18.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:28:18 smithi047 bash[22744]: cluster 2024-09-16T11:28:16.798238+0000 mgr.a (mgr.14373) 15186 : cluster [DBG] pgmap v10531: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 12 KiB/s rd, 426 B/s wr, 14 op/s 2024-09-16T11:28:20.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:28:20 smithi157 bash[24585]: cluster 2024-09-16T11:28:18.799033+0000 mgr.a (mgr.14373) 15187 : cluster [DBG] pgmap v10532: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:28:20.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:28:20 smithi086 bash[24289]: cluster 2024-09-16T11:28:18.799033+0000 mgr.a (mgr.14373) 15187 : cluster [DBG] pgmap v10532: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:28:20.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:28:20 smithi047 bash[22744]: cluster 2024-09-16T11:28:18.799033+0000 mgr.a (mgr.14373) 15187 : cluster [DBG] pgmap v10532: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:28:21.208 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:28:21.209 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:28:21.209 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:28:21.959 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:28:21.959 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:28:21.959 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:28:21.959 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:28:21.959 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:28:22.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:28:22 smithi086 bash[24289]: cluster 2024-09-16T11:28:20.799783+0000 mgr.a (mgr.14373) 15188 : cluster [DBG] pgmap v10533: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:28:22.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:28:22 smithi047 bash[22744]: cluster 2024-09-16T11:28:20.799783+0000 mgr.a (mgr.14373) 15188 : cluster [DBG] pgmap v10533: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:28:22.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:28:22 smithi157 bash[24585]: cluster 2024-09-16T11:28:20.799783+0000 mgr.a (mgr.14373) 15188 : cluster [DBG] pgmap v10533: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:28:23.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:28:23 smithi086 bash[24289]: audit 2024-09-16T11:28:21.531139+0000 mgr.a (mgr.14373) 15189 : audit [DBG] from='client.328326 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:28:23.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:28:23 smithi047 bash[22744]: audit 2024-09-16T11:28:21.531139+0000 mgr.a (mgr.14373) 15189 : audit [DBG] from='client.328326 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:28:23.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:28:23 smithi157 bash[24585]: audit 2024-09-16T11:28:21.531139+0000 mgr.a (mgr.14373) 15189 : audit [DBG] from='client.328326 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:28:24.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:28:24 smithi086 bash[24289]: cluster 2024-09-16T11:28:22.802493+0000 mgr.a (mgr.14373) 15190 : cluster [DBG] pgmap v10534: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:28:24.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:28:24 smithi047 bash[22744]: cluster 2024-09-16T11:28:22.802493+0000 mgr.a (mgr.14373) 15190 : cluster [DBG] pgmap v10534: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:28:24.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:28:24 smithi157 bash[24585]: cluster 2024-09-16T11:28:22.802493+0000 mgr.a (mgr.14373) 15190 : cluster [DBG] pgmap v10534: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:28:26.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:28:26 smithi047 bash[22744]: cluster 2024-09-16T11:28:24.803298+0000 mgr.a (mgr.14373) 15191 : cluster [DBG] pgmap v10535: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T11:28:26.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:28:26 smithi157 bash[24585]: cluster 2024-09-16T11:28:24.803298+0000 mgr.a (mgr.14373) 15191 : cluster [DBG] pgmap v10535: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T11:28:26.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:28:26 smithi086 bash[24289]: cluster 2024-09-16T11:28:24.803298+0000 mgr.a (mgr.14373) 15191 : cluster [DBG] pgmap v10535: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T11:28:26.960 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:28:26.961 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:28:26.962 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:28:27.710 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:28:27.710 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:28:27.710 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:28:27.710 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:28:27.710 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:28:28.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:28:28 smithi047 bash[22744]: cluster 2024-09-16T11:28:26.805217+0000 mgr.a (mgr.14373) 15192 : cluster [DBG] pgmap v10536: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:28:28.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:28:28 smithi157 bash[24585]: cluster 2024-09-16T11:28:26.805217+0000 mgr.a (mgr.14373) 15192 : cluster [DBG] pgmap v10536: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:28:28.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:28:28 smithi086 bash[24289]: cluster 2024-09-16T11:28:26.805217+0000 mgr.a (mgr.14373) 15192 : cluster [DBG] pgmap v10536: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:28:29.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:28:29 smithi047 bash[22744]: audit 2024-09-16T11:28:27.291477+0000 mgr.a (mgr.14373) 15193 : audit [DBG] from='client.328404 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:28:29.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:28:29 smithi157 bash[24585]: audit 2024-09-16T11:28:27.291477+0000 mgr.a (mgr.14373) 15193 : audit [DBG] from='client.328404 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:28:29.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:28:29 smithi086 bash[24289]: audit 2024-09-16T11:28:27.291477+0000 mgr.a (mgr.14373) 15193 : audit [DBG] from='client.328404 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:28:30.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:28:30 smithi047 bash[22744]: cluster 2024-09-16T11:28:28.806082+0000 mgr.a (mgr.14373) 15194 : cluster [DBG] pgmap v10537: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:28:30.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:28:30 smithi157 bash[24585]: cluster 2024-09-16T11:28:28.806082+0000 mgr.a (mgr.14373) 15194 : cluster [DBG] pgmap v10537: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:28:30.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:28:30 smithi086 bash[24289]: cluster 2024-09-16T11:28:28.806082+0000 mgr.a (mgr.14373) 15194 : cluster [DBG] pgmap v10537: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:28:32.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:28:32 smithi047 bash[22744]: cluster 2024-09-16T11:28:30.806935+0000 mgr.a (mgr.14373) 15195 : cluster [DBG] pgmap v10538: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T11:28:32.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:28:32 smithi157 bash[24585]: cluster 2024-09-16T11:28:30.806935+0000 mgr.a (mgr.14373) 15195 : cluster [DBG] pgmap v10538: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T11:28:32.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:28:32 smithi086 bash[24289]: cluster 2024-09-16T11:28:30.806935+0000 mgr.a (mgr.14373) 15195 : cluster [DBG] pgmap v10538: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T11:28:32.711 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:28:32.712 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:28:32.712 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:28:33.498 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:28:33.498 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:28:33.498 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:28:33.498 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:28:33.498 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:28:34.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:28:34 smithi157 bash[24585]: cluster 2024-09-16T11:28:32.808230+0000 mgr.a (mgr.14373) 15196 : cluster [DBG] pgmap v10539: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 55 op/s 2024-09-16T11:28:34.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:28:34 smithi157 bash[24585]: audit 2024-09-16T11:28:33.045899+0000 mgr.a (mgr.14373) 15197 : audit [DBG] from='client.328482 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:28:34.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:28:34 smithi086 bash[24289]: cluster 2024-09-16T11:28:32.808230+0000 mgr.a (mgr.14373) 15196 : cluster [DBG] pgmap v10539: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 55 op/s 2024-09-16T11:28:34.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:28:34 smithi086 bash[24289]: audit 2024-09-16T11:28:33.045899+0000 mgr.a (mgr.14373) 15197 : audit [DBG] from='client.328482 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:28:34.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:28:34 smithi047 bash[22744]: cluster 2024-09-16T11:28:32.808230+0000 mgr.a (mgr.14373) 15196 : cluster [DBG] pgmap v10539: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 55 op/s 2024-09-16T11:28:34.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:28:34 smithi047 bash[22744]: audit 2024-09-16T11:28:33.045899+0000 mgr.a (mgr.14373) 15197 : audit [DBG] from='client.328482 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:28:36.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:28:36 smithi157 bash[24585]: cluster 2024-09-16T11:28:34.809096+0000 mgr.a (mgr.14373) 15198 : cluster [DBG] pgmap v10540: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 55 op/s 2024-09-16T11:28:36.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:28:36 smithi086 bash[24289]: cluster 2024-09-16T11:28:34.809096+0000 mgr.a (mgr.14373) 15198 : cluster [DBG] pgmap v10540: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 55 op/s 2024-09-16T11:28:36.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:28:36 smithi047 bash[22744]: cluster 2024-09-16T11:28:34.809096+0000 mgr.a (mgr.14373) 15198 : cluster [DBG] pgmap v10540: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 55 op/s 2024-09-16T11:28:38.499 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:28:38.500 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:28:38.500 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:28:38.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:28:38 smithi157 bash[24585]: cluster 2024-09-16T11:28:36.811260+0000 mgr.a (mgr.14373) 15199 : cluster [DBG] pgmap v10541: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 66 KiB/s rd, 0 B/s wr, 108 op/s 2024-09-16T11:28:38.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:28:38 smithi086 bash[24289]: cluster 2024-09-16T11:28:36.811260+0000 mgr.a (mgr.14373) 15199 : cluster [DBG] pgmap v10541: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 66 KiB/s rd, 0 B/s wr, 108 op/s 2024-09-16T11:28:38.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:28:38 smithi047 bash[22744]: cluster 2024-09-16T11:28:36.811260+0000 mgr.a (mgr.14373) 15199 : cluster [DBG] pgmap v10541: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 66 KiB/s rd, 0 B/s wr, 108 op/s 2024-09-16T11:28:39.289 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:28:39.290 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:28:39.290 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:28:39.290 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:28:39.290 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:28:40.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:28:40 smithi157 bash[24585]: cluster 2024-09-16T11:28:38.811991+0000 mgr.a (mgr.14373) 15200 : cluster [DBG] pgmap v10542: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 65 KiB/s rd, 0 B/s wr, 107 op/s 2024-09-16T11:28:40.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:28:40 smithi157 bash[24585]: audit 2024-09-16T11:28:38.843573+0000 mgr.a (mgr.14373) 15201 : audit [DBG] from='client.328554 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:28:40.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:28:40 smithi086 bash[24289]: cluster 2024-09-16T11:28:38.811991+0000 mgr.a (mgr.14373) 15200 : cluster [DBG] pgmap v10542: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 65 KiB/s rd, 0 B/s wr, 107 op/s 2024-09-16T11:28:40.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:28:40 smithi086 bash[24289]: audit 2024-09-16T11:28:38.843573+0000 mgr.a (mgr.14373) 15201 : audit [DBG] from='client.328554 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:28:40.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:28:40 smithi047 bash[22744]: cluster 2024-09-16T11:28:38.811991+0000 mgr.a (mgr.14373) 15200 : cluster [DBG] pgmap v10542: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 65 KiB/s rd, 0 B/s wr, 107 op/s 2024-09-16T11:28:40.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:28:40 smithi047 bash[22744]: audit 2024-09-16T11:28:38.843573+0000 mgr.a (mgr.14373) 15201 : audit [DBG] from='client.328554 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:28:42.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:28:42 smithi157 bash[24585]: cluster 2024-09-16T11:28:40.812888+0000 mgr.a (mgr.14373) 15202 : cluster [DBG] pgmap v10543: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 65 KiB/s rd, 0 B/s wr, 107 op/s 2024-09-16T11:28:42.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:28:42 smithi086 bash[24289]: cluster 2024-09-16T11:28:40.812888+0000 mgr.a (mgr.14373) 15202 : cluster [DBG] pgmap v10543: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 65 KiB/s rd, 0 B/s wr, 107 op/s 2024-09-16T11:28:42.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:28:42 smithi047 bash[22744]: cluster 2024-09-16T11:28:40.812888+0000 mgr.a (mgr.14373) 15202 : cluster [DBG] pgmap v10543: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 65 KiB/s rd, 0 B/s wr, 107 op/s 2024-09-16T11:28:44.291 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:28:44.292 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:28:44.292 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:28:44.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:28:44 smithi157 bash[24585]: cluster 2024-09-16T11:28:42.815196+0000 mgr.a (mgr.14373) 15203 : cluster [DBG] pgmap v10544: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 66 KiB/s rd, 0 B/s wr, 108 op/s 2024-09-16T11:28:44.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:28:44 smithi086 bash[24289]: cluster 2024-09-16T11:28:42.815196+0000 mgr.a (mgr.14373) 15203 : cluster [DBG] pgmap v10544: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 66 KiB/s rd, 0 B/s wr, 108 op/s 2024-09-16T11:28:44.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:28:44 smithi047 bash[22744]: cluster 2024-09-16T11:28:42.815196+0000 mgr.a (mgr.14373) 15203 : cluster [DBG] pgmap v10544: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 66 KiB/s rd, 0 B/s wr, 108 op/s 2024-09-16T11:28:45.107 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:28:45.107 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:28:45.107 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:28:45.108 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:28:45.108 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:28:46.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:28:46 smithi157 bash[24585]: audit 2024-09-16T11:28:44.636293+0000 mgr.a (mgr.14373) 15204 : audit [DBG] from='client.328632 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:28:46.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:28:46 smithi157 bash[24585]: cluster 2024-09-16T11:28:44.815779+0000 mgr.a (mgr.14373) 15205 : cluster [DBG] pgmap v10545: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 33 KiB/s rd, 0 B/s wr, 53 op/s 2024-09-16T11:28:46.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:28:46 smithi086 bash[24289]: audit 2024-09-16T11:28:44.636293+0000 mgr.a (mgr.14373) 15204 : audit [DBG] from='client.328632 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:28:46.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:28:46 smithi086 bash[24289]: cluster 2024-09-16T11:28:44.815779+0000 mgr.a (mgr.14373) 15205 : cluster [DBG] pgmap v10545: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 33 KiB/s rd, 0 B/s wr, 53 op/s 2024-09-16T11:28:46.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:28:46 smithi047 bash[22744]: audit 2024-09-16T11:28:44.636293+0000 mgr.a (mgr.14373) 15204 : audit [DBG] from='client.328632 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:28:46.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:28:46 smithi047 bash[22744]: cluster 2024-09-16T11:28:44.815779+0000 mgr.a (mgr.14373) 15205 : cluster [DBG] pgmap v10545: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 33 KiB/s rd, 0 B/s wr, 53 op/s 2024-09-16T11:28:48.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:28:48 smithi157 bash[24585]: cluster 2024-09-16T11:28:46.818036+0000 mgr.a (mgr.14373) 15206 : cluster [DBG] pgmap v10546: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-16T11:28:48.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:28:48 smithi086 bash[24289]: cluster 2024-09-16T11:28:46.818036+0000 mgr.a (mgr.14373) 15206 : cluster [DBG] pgmap v10546: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-16T11:28:48.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:28:48 smithi047 bash[22744]: cluster 2024-09-16T11:28:46.818036+0000 mgr.a (mgr.14373) 15206 : cluster [DBG] pgmap v10546: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-09-16T11:28:50.109 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:28:50.110 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:28:50.110 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:28:50.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:28:50 smithi157 bash[24585]: cluster 2024-09-16T11:28:48.818811+0000 mgr.a (mgr.14373) 15207 : cluster [DBG] pgmap v10547: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:28:50.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:28:50 smithi086 bash[24289]: cluster 2024-09-16T11:28:48.818811+0000 mgr.a (mgr.14373) 15207 : cluster [DBG] pgmap v10547: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:28:50.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:28:50 smithi047 bash[22744]: cluster 2024-09-16T11:28:48.818811+0000 mgr.a (mgr.14373) 15207 : cluster [DBG] pgmap v10547: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:28:50.901 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:28:50.902 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:28:50.902 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:28:50.902 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:28:50.902 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:28:52.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:28:52 smithi157 bash[24585]: audit 2024-09-16T11:28:50.447070+0000 mgr.a (mgr.14373) 15208 : audit [DBG] from='client.328707 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:28:52.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:28:52 smithi157 bash[24585]: cluster 2024-09-16T11:28:50.819331+0000 mgr.a (mgr.14373) 15209 : cluster [DBG] pgmap v10548: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:28:52.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:28:52 smithi086 bash[24289]: audit 2024-09-16T11:28:50.447070+0000 mgr.a (mgr.14373) 15208 : audit [DBG] from='client.328707 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:28:52.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:28:52 smithi086 bash[24289]: cluster 2024-09-16T11:28:50.819331+0000 mgr.a (mgr.14373) 15209 : cluster [DBG] pgmap v10548: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:28:52.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:28:52 smithi047 bash[22744]: audit 2024-09-16T11:28:50.447070+0000 mgr.a (mgr.14373) 15208 : audit [DBG] from='client.328707 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:28:52.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:28:52 smithi047 bash[22744]: cluster 2024-09-16T11:28:50.819331+0000 mgr.a (mgr.14373) 15209 : cluster [DBG] pgmap v10548: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:28:54.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:28:54 smithi157 bash[24585]: cluster 2024-09-16T11:28:52.821532+0000 mgr.a (mgr.14373) 15210 : cluster [DBG] pgmap v10549: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:28:54.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:28:54 smithi086 bash[24289]: cluster 2024-09-16T11:28:52.821532+0000 mgr.a (mgr.14373) 15210 : cluster [DBG] pgmap v10549: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:28:54.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:28:54 smithi047 bash[22744]: cluster 2024-09-16T11:28:52.821532+0000 mgr.a (mgr.14373) 15210 : cluster [DBG] pgmap v10549: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:28:55.903 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:28:55.904 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:28:55.904 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:28:56.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:28:56 smithi157 bash[24585]: cluster 2024-09-16T11:28:54.822378+0000 mgr.a (mgr.14373) 15211 : cluster [DBG] pgmap v10550: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:28:56.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:28:56 smithi086 bash[24289]: cluster 2024-09-16T11:28:54.822378+0000 mgr.a (mgr.14373) 15211 : cluster [DBG] pgmap v10550: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:28:56.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:28:56 smithi047 bash[22744]: cluster 2024-09-16T11:28:54.822378+0000 mgr.a (mgr.14373) 15211 : cluster [DBG] pgmap v10550: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:28:56.685 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:28:56.685 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:28:56.686 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:28:56.686 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:28:56.686 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:28:58.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:28:58 smithi157 bash[24585]: audit 2024-09-16T11:28:56.246872+0000 mgr.a (mgr.14373) 15212 : audit [DBG] from='client.328785 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:28:58.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:28:58 smithi157 bash[24585]: cluster 2024-09-16T11:28:56.824694+0000 mgr.a (mgr.14373) 15213 : cluster [DBG] pgmap v10551: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-16T11:28:58.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:28:58 smithi086 bash[24289]: audit 2024-09-16T11:28:56.246872+0000 mgr.a (mgr.14373) 15212 : audit [DBG] from='client.328785 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:28:58.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:28:58 smithi086 bash[24289]: cluster 2024-09-16T11:28:56.824694+0000 mgr.a (mgr.14373) 15213 : cluster [DBG] pgmap v10551: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-16T11:28:58.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:28:58 smithi047 bash[22744]: audit 2024-09-16T11:28:56.246872+0000 mgr.a (mgr.14373) 15212 : audit [DBG] from='client.328785 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:28:58.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:28:58 smithi047 bash[22744]: cluster 2024-09-16T11:28:56.824694+0000 mgr.a (mgr.14373) 15213 : cluster [DBG] pgmap v10551: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-16T11:29:00.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:29:00 smithi157 bash[24585]: cluster 2024-09-16T11:28:58.825472+0000 mgr.a (mgr.14373) 15214 : cluster [DBG] pgmap v10552: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T11:29:00.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:29:00 smithi086 bash[24289]: cluster 2024-09-16T11:28:58.825472+0000 mgr.a (mgr.14373) 15214 : cluster [DBG] pgmap v10552: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T11:29:00.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:29:00 smithi047 bash[22744]: cluster 2024-09-16T11:28:58.825472+0000 mgr.a (mgr.14373) 15214 : cluster [DBG] pgmap v10552: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T11:29:01.687 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:29:01.687 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:29:01.688 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:29:02.473 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:29:02.473 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:29:02.473 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:29:02.473 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:29:02.474 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:29:02.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:29:02 smithi157 bash[24585]: cluster 2024-09-16T11:29:00.826240+0000 mgr.a (mgr.14373) 15215 : cluster [DBG] pgmap v10553: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T11:29:02.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:29:02 smithi086 bash[24289]: cluster 2024-09-16T11:29:00.826240+0000 mgr.a (mgr.14373) 15215 : cluster [DBG] pgmap v10553: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T11:29:02.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:29:02 smithi047 bash[22744]: cluster 2024-09-16T11:29:00.826240+0000 mgr.a (mgr.14373) 15215 : cluster [DBG] pgmap v10553: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T11:29:03.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:29:03 smithi157 bash[24585]: audit 2024-09-16T11:29:02.023750+0000 mgr.a (mgr.14373) 15216 : audit [DBG] from='client.328863 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:29:03.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:29:03 smithi086 bash[24289]: audit 2024-09-16T11:29:02.023750+0000 mgr.a (mgr.14373) 15216 : audit [DBG] from='client.328863 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:29:03.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:29:03 smithi047 bash[22744]: audit 2024-09-16T11:29:02.023750+0000 mgr.a (mgr.14373) 15216 : audit [DBG] from='client.328863 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:29:04.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:29:04 smithi157 bash[24585]: cluster 2024-09-16T11:29:02.828990+0000 mgr.a (mgr.14373) 15217 : cluster [DBG] pgmap v10554: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:29:04.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:29:04 smithi086 bash[24289]: cluster 2024-09-16T11:29:02.828990+0000 mgr.a (mgr.14373) 15217 : cluster [DBG] pgmap v10554: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:29:04.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:29:04 smithi047 bash[22744]: cluster 2024-09-16T11:29:02.828990+0000 mgr.a (mgr.14373) 15217 : cluster [DBG] pgmap v10554: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:29:06.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:29:06 smithi157 bash[24585]: cluster 2024-09-16T11:29:04.829809+0000 mgr.a (mgr.14373) 15218 : cluster [DBG] pgmap v10555: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:29:06.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:29:06 smithi086 bash[24289]: cluster 2024-09-16T11:29:04.829809+0000 mgr.a (mgr.14373) 15218 : cluster [DBG] pgmap v10555: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:29:06.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:29:06 smithi047 bash[22744]: cluster 2024-09-16T11:29:04.829809+0000 mgr.a (mgr.14373) 15218 : cluster [DBG] pgmap v10555: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:29:07.475 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:29:07.475 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:29:07.475 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:29:08.218 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:29:08.219 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:29:08.219 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:29:08.219 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:29:08.219 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:29:08.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:29:08 smithi157 bash[24585]: cluster 2024-09-16T11:29:06.831759+0000 mgr.a (mgr.14373) 15219 : cluster [DBG] pgmap v10556: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:29:08.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:29:08 smithi086 bash[24289]: cluster 2024-09-16T11:29:06.831759+0000 mgr.a (mgr.14373) 15219 : cluster [DBG] pgmap v10556: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:29:08.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:29:08 smithi047 bash[22744]: cluster 2024-09-16T11:29:06.831759+0000 mgr.a (mgr.14373) 15219 : cluster [DBG] pgmap v10556: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:29:09.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:29:09 smithi157 bash[24585]: audit 2024-09-16T11:29:07.804735+0000 mgr.a (mgr.14373) 15220 : audit [DBG] from='client.328935 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:29:09.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:29:09 smithi086 bash[24289]: audit 2024-09-16T11:29:07.804735+0000 mgr.a (mgr.14373) 15220 : audit [DBG] from='client.328935 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:29:09.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:29:09 smithi047 bash[22744]: audit 2024-09-16T11:29:07.804735+0000 mgr.a (mgr.14373) 15220 : audit [DBG] from='client.328935 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:29:10.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:29:10 smithi157 bash[24585]: cluster 2024-09-16T11:29:08.832730+0000 mgr.a (mgr.14373) 15221 : cluster [DBG] pgmap v10557: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-16T11:29:10.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:29:10 smithi086 bash[24289]: cluster 2024-09-16T11:29:08.832730+0000 mgr.a (mgr.14373) 15221 : cluster [DBG] pgmap v10557: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-16T11:29:10.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:29:10 smithi047 bash[22744]: cluster 2024-09-16T11:29:08.832730+0000 mgr.a (mgr.14373) 15221 : cluster [DBG] pgmap v10557: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-16T11:29:12.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:29:12 smithi157 bash[24585]: cluster 2024-09-16T11:29:10.833505+0000 mgr.a (mgr.14373) 15222 : cluster [DBG] pgmap v10558: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-16T11:29:12.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:29:12 smithi086 bash[24289]: cluster 2024-09-16T11:29:10.833505+0000 mgr.a (mgr.14373) 15222 : cluster [DBG] pgmap v10558: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-16T11:29:12.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:29:12 smithi047 bash[22744]: cluster 2024-09-16T11:29:10.833505+0000 mgr.a (mgr.14373) 15222 : cluster [DBG] pgmap v10558: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-16T11:29:13.220 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:29:13.221 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:29:13.221 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:29:14.026 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:29:14.026 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:29:14.026 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:29:14.026 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:29:14.026 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:29:14.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:29:14 smithi157 bash[24585]: cluster 2024-09-16T11:29:12.835809+0000 mgr.a (mgr.14373) 15223 : cluster [DBG] pgmap v10559: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-16T11:29:14.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:29:14 smithi157 bash[24585]: audit 2024-09-16T11:29:13.913294+0000 mon.b (mon.2) 1386 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T11:29:14.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:29:14 smithi086 bash[24289]: cluster 2024-09-16T11:29:12.835809+0000 mgr.a (mgr.14373) 15223 : cluster [DBG] pgmap v10559: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-16T11:29:14.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:29:14 smithi086 bash[24289]: audit 2024-09-16T11:29:13.913294+0000 mon.b (mon.2) 1386 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T11:29:14.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:29:14 smithi047 bash[22744]: cluster 2024-09-16T11:29:12.835809+0000 mgr.a (mgr.14373) 15223 : cluster [DBG] pgmap v10559: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-16T11:29:14.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:29:14 smithi047 bash[22744]: audit 2024-09-16T11:29:13.913294+0000 mon.b (mon.2) 1386 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T11:29:15.489 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:29:15 smithi047 bash[22744]: audit 2024-09-16T11:29:13.559148+0000 mgr.a (mgr.14373) 15224 : audit [DBG] from='client.329010 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:29:15.489 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:29:15 smithi047 bash[22744]: audit 2024-09-16T11:29:14.702550+0000 mon.b (mon.2) 1387 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T11:29:15.489 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:29:15 smithi047 bash[22744]: audit 2024-09-16T11:29:14.704925+0000 mon.b (mon.2) 1388 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T11:29:15.489 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:29:15 smithi047 bash[22744]: audit 2024-09-16T11:29:14.717131+0000 mon.a (mon.0) 1475 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:29:15.489 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:29:15 smithi047 bash[22744]: audit 2024-09-16T11:29:14.722855+0000 mon.b (mon.2) 1389 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:29:15.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:29:15 smithi157 bash[24585]: audit 2024-09-16T11:29:13.559148+0000 mgr.a (mgr.14373) 15224 : audit [DBG] from='client.329010 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:29:15.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:29:15 smithi157 bash[24585]: audit 2024-09-16T11:29:14.702550+0000 mon.b (mon.2) 1387 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T11:29:15.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:29:15 smithi157 bash[24585]: audit 2024-09-16T11:29:14.704925+0000 mon.b (mon.2) 1388 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T11:29:15.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:29:15 smithi157 bash[24585]: audit 2024-09-16T11:29:14.717131+0000 mon.a (mon.0) 1475 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:29:15.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:29:15 smithi157 bash[24585]: audit 2024-09-16T11:29:14.722855+0000 mon.b (mon.2) 1389 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:29:15.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:29:15 smithi086 bash[24289]: audit 2024-09-16T11:29:13.559148+0000 mgr.a (mgr.14373) 15224 : audit [DBG] from='client.329010 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:29:15.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:29:15 smithi086 bash[24289]: audit 2024-09-16T11:29:14.702550+0000 mon.b (mon.2) 1387 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T11:29:15.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:29:15 smithi086 bash[24289]: audit 2024-09-16T11:29:14.704925+0000 mon.b (mon.2) 1388 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T11:29:15.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:29:15 smithi086 bash[24289]: audit 2024-09-16T11:29:14.717131+0000 mon.a (mon.0) 1475 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:29:15.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:29:15 smithi086 bash[24289]: audit 2024-09-16T11:29:14.722855+0000 mon.b (mon.2) 1389 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:29:15.842 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 11:29:15 smithi047 bash[22994]: debug 2024-09-16T11:29:15.485+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T11:29:15.843 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 11:29:15 smithi047 bash[22994]: debug 2024-09-16T11:29:15.485+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T11:29:16.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:29:16 smithi157 bash[24585]: audit 2024-09-16T11:29:14.726139+0000 mgr.a (mgr.14373) 15225 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:29:16.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:29:16 smithi157 bash[24585]: cluster 2024-09-16T11:29:14.836410+0000 mgr.a (mgr.14373) 15226 : cluster [DBG] pgmap v10560: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:29:16.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:29:16 smithi086 bash[24289]: audit 2024-09-16T11:29:14.726139+0000 mgr.a (mgr.14373) 15225 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:29:16.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:29:16 smithi086 bash[24289]: cluster 2024-09-16T11:29:14.836410+0000 mgr.a (mgr.14373) 15226 : cluster [DBG] pgmap v10560: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:29:16.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:29:16 smithi047 bash[22744]: audit 2024-09-16T11:29:14.726139+0000 mgr.a (mgr.14373) 15225 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:29:16.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:29:16 smithi047 bash[22744]: cluster 2024-09-16T11:29:14.836410+0000 mgr.a (mgr.14373) 15226 : cluster [DBG] pgmap v10560: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:29:17.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:29:17 smithi157 bash[24585]: audit 2024-09-16T11:29:15.487625+0000 mgr.a (mgr.14373) 15227 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T11:29:17.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:29:17 smithi157 bash[24585]: cephadm 2024-09-16T11:29:15.489747+0000 mgr.a (mgr.14373) 15228 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T11:29:17.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:29:17 smithi086 bash[24289]: audit 2024-09-16T11:29:15.487625+0000 mgr.a (mgr.14373) 15227 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T11:29:17.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:29:17 smithi086 bash[24289]: cephadm 2024-09-16T11:29:15.489747+0000 mgr.a (mgr.14373) 15228 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T11:29:17.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:29:17 smithi047 bash[22744]: audit 2024-09-16T11:29:15.487625+0000 mgr.a (mgr.14373) 15227 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T11:29:17.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:29:17 smithi047 bash[22744]: cephadm 2024-09-16T11:29:15.489747+0000 mgr.a (mgr.14373) 15228 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T11:29:18.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:29:18 smithi157 bash[24585]: cluster 2024-09-16T11:29:16.838742+0000 mgr.a (mgr.14373) 15229 : cluster [DBG] pgmap v10561: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:29:18.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:29:18 smithi086 bash[24289]: cluster 2024-09-16T11:29:16.838742+0000 mgr.a (mgr.14373) 15229 : cluster [DBG] pgmap v10561: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:29:18.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:29:18 smithi047 bash[22744]: cluster 2024-09-16T11:29:16.838742+0000 mgr.a (mgr.14373) 15229 : cluster [DBG] pgmap v10561: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:29:19.027 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:29:19.028 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:29:19.029 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:29:19.781 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:29:19.782 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:29:19.782 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:29:19.782 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:29:19.782 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:29:20.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:29:20 smithi157 bash[24585]: cluster 2024-09-16T11:29:18.839514+0000 mgr.a (mgr.14373) 15230 : cluster [DBG] pgmap v10562: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:29:20.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:29:20 smithi086 bash[24289]: cluster 2024-09-16T11:29:18.839514+0000 mgr.a (mgr.14373) 15230 : cluster [DBG] pgmap v10562: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:29:20.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:29:20 smithi047 bash[22744]: cluster 2024-09-16T11:29:18.839514+0000 mgr.a (mgr.14373) 15230 : cluster [DBG] pgmap v10562: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:29:21.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:29:21 smithi157 bash[24585]: audit 2024-09-16T11:29:19.362939+0000 mgr.a (mgr.14373) 15231 : audit [DBG] from='client.329190 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:29:21.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:29:21 smithi086 bash[24289]: audit 2024-09-16T11:29:19.362939+0000 mgr.a (mgr.14373) 15231 : audit [DBG] from='client.329190 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:29:21.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:29:21 smithi047 bash[22744]: audit 2024-09-16T11:29:19.362939+0000 mgr.a (mgr.14373) 15231 : audit [DBG] from='client.329190 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:29:22.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:29:22 smithi157 bash[24585]: cluster 2024-09-16T11:29:20.840493+0000 mgr.a (mgr.14373) 15232 : cluster [DBG] pgmap v10563: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:29:22.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:29:22 smithi086 bash[24289]: cluster 2024-09-16T11:29:20.840493+0000 mgr.a (mgr.14373) 15232 : cluster [DBG] pgmap v10563: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:29:22.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:29:22 smithi047 bash[22744]: cluster 2024-09-16T11:29:20.840493+0000 mgr.a (mgr.14373) 15232 : cluster [DBG] pgmap v10563: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:29:24.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:29:24 smithi157 bash[24585]: cluster 2024-09-16T11:29:22.842768+0000 mgr.a (mgr.14373) 15233 : cluster [DBG] pgmap v10564: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:29:24.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:29:24 smithi086 bash[24289]: cluster 2024-09-16T11:29:22.842768+0000 mgr.a (mgr.14373) 15233 : cluster [DBG] pgmap v10564: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:29:24.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:29:24 smithi047 bash[22744]: cluster 2024-09-16T11:29:22.842768+0000 mgr.a (mgr.14373) 15233 : cluster [DBG] pgmap v10564: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:29:24.783 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:29:24.784 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:29:24.784 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:29:25.537 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:29:25.537 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:29:25.537 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:29:25.537 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:29:25.537 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:29:26.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:29:26 smithi157 bash[24585]: cluster 2024-09-16T11:29:24.843317+0000 mgr.a (mgr.14373) 15234 : cluster [DBG] pgmap v10565: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:29:26.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:29:26 smithi157 bash[24585]: audit 2024-09-16T11:29:25.114732+0000 mgr.a (mgr.14373) 15235 : audit [DBG] from='client.329268 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:29:26.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:29:26 smithi086 bash[24289]: cluster 2024-09-16T11:29:24.843317+0000 mgr.a (mgr.14373) 15234 : cluster [DBG] pgmap v10565: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:29:26.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:29:26 smithi086 bash[24289]: audit 2024-09-16T11:29:25.114732+0000 mgr.a (mgr.14373) 15235 : audit [DBG] from='client.329268 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:29:26.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:29:26 smithi047 bash[22744]: cluster 2024-09-16T11:29:24.843317+0000 mgr.a (mgr.14373) 15234 : cluster [DBG] pgmap v10565: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:29:26.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:29:26 smithi047 bash[22744]: audit 2024-09-16T11:29:25.114732+0000 mgr.a (mgr.14373) 15235 : audit [DBG] from='client.329268 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:29:27.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:29:27 smithi086 bash[24289]: cluster 2024-09-16T11:29:26.845580+0000 mgr.a (mgr.14373) 15236 : cluster [DBG] pgmap v10566: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:29:27.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:29:27 smithi047 bash[22744]: cluster 2024-09-16T11:29:26.845580+0000 mgr.a (mgr.14373) 15236 : cluster [DBG] pgmap v10566: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:29:27.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:29:27 smithi157 bash[24585]: cluster 2024-09-16T11:29:26.845580+0000 mgr.a (mgr.14373) 15236 : cluster [DBG] pgmap v10566: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:29:30.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:29:29 smithi157 bash[24585]: cluster 2024-09-16T11:29:28.846363+0000 mgr.a (mgr.14373) 15237 : cluster [DBG] pgmap v10567: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:29:30.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:29:29 smithi086 bash[24289]: cluster 2024-09-16T11:29:28.846363+0000 mgr.a (mgr.14373) 15237 : cluster [DBG] pgmap v10567: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:29:30.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:29:29 smithi047 bash[22744]: cluster 2024-09-16T11:29:28.846363+0000 mgr.a (mgr.14373) 15237 : cluster [DBG] pgmap v10567: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:29:30.538 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:29:30.539 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:29:30.539 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:29:31.284 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:29:31.285 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:29:31.285 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:29:31.285 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:29:31.285 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:29:32.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:29:31 smithi157 bash[24585]: cluster 2024-09-16T11:29:30.847083+0000 mgr.a (mgr.14373) 15238 : cluster [DBG] pgmap v10568: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:29:32.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:29:31 smithi157 bash[24585]: audit 2024-09-16T11:29:30.871829+0000 mgr.a (mgr.14373) 15239 : audit [DBG] from='client.329346 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:29:32.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:29:31 smithi086 bash[24289]: cluster 2024-09-16T11:29:30.847083+0000 mgr.a (mgr.14373) 15238 : cluster [DBG] pgmap v10568: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:29:32.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:29:31 smithi086 bash[24289]: audit 2024-09-16T11:29:30.871829+0000 mgr.a (mgr.14373) 15239 : audit [DBG] from='client.329346 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:29:32.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:29:31 smithi047 bash[22744]: cluster 2024-09-16T11:29:30.847083+0000 mgr.a (mgr.14373) 15238 : cluster [DBG] pgmap v10568: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:29:32.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:29:31 smithi047 bash[22744]: audit 2024-09-16T11:29:30.871829+0000 mgr.a (mgr.14373) 15239 : audit [DBG] from='client.329346 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:29:34.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:29:33 smithi157 bash[24585]: cluster 2024-09-16T11:29:32.849538+0000 mgr.a (mgr.14373) 15240 : cluster [DBG] pgmap v10569: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:29:34.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:29:33 smithi086 bash[24289]: cluster 2024-09-16T11:29:32.849538+0000 mgr.a (mgr.14373) 15240 : cluster [DBG] pgmap v10569: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:29:34.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:29:33 smithi047 bash[22744]: cluster 2024-09-16T11:29:32.849538+0000 mgr.a (mgr.14373) 15240 : cluster [DBG] pgmap v10569: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:29:36.286 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:29:36.287 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:29:36.287 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:29:36.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:29:35 smithi157 bash[24585]: cluster 2024-09-16T11:29:34.850534+0000 mgr.a (mgr.14373) 15241 : cluster [DBG] pgmap v10570: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:29:36.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:29:35 smithi086 bash[24289]: cluster 2024-09-16T11:29:34.850534+0000 mgr.a (mgr.14373) 15241 : cluster [DBG] pgmap v10570: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:29:36.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:29:35 smithi047 bash[22744]: cluster 2024-09-16T11:29:34.850534+0000 mgr.a (mgr.14373) 15241 : cluster [DBG] pgmap v10570: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:29:37.068 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:29:37.069 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:29:37.069 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:29:37.069 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:29:37.069 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:29:38.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:29:37 smithi157 bash[24585]: audit 2024-09-16T11:29:36.626276+0000 mgr.a (mgr.14373) 15242 : audit [DBG] from='client.329421 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:29:38.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:29:37 smithi157 bash[24585]: cluster 2024-09-16T11:29:36.851809+0000 mgr.a (mgr.14373) 15243 : cluster [DBG] pgmap v10571: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:29:38.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:29:37 smithi086 bash[24289]: audit 2024-09-16T11:29:36.626276+0000 mgr.a (mgr.14373) 15242 : audit [DBG] from='client.329421 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:29:38.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:29:37 smithi086 bash[24289]: cluster 2024-09-16T11:29:36.851809+0000 mgr.a (mgr.14373) 15243 : cluster [DBG] pgmap v10571: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:29:38.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:29:37 smithi047 bash[22744]: audit 2024-09-16T11:29:36.626276+0000 mgr.a (mgr.14373) 15242 : audit [DBG] from='client.329421 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:29:38.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:29:37 smithi047 bash[22744]: cluster 2024-09-16T11:29:36.851809+0000 mgr.a (mgr.14373) 15243 : cluster [DBG] pgmap v10571: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:29:40.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:29:39 smithi157 bash[24585]: cluster 2024-09-16T11:29:38.852667+0000 mgr.a (mgr.14373) 15244 : cluster [DBG] pgmap v10572: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T11:29:40.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:29:39 smithi086 bash[24289]: cluster 2024-09-16T11:29:38.852667+0000 mgr.a (mgr.14373) 15244 : cluster [DBG] pgmap v10572: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T11:29:40.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:29:39 smithi047 bash[22744]: cluster 2024-09-16T11:29:38.852667+0000 mgr.a (mgr.14373) 15244 : cluster [DBG] pgmap v10572: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T11:29:42.070 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:29:42.071 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:29:42.071 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:29:42.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:29:41 smithi157 bash[24585]: cluster 2024-09-16T11:29:40.853452+0000 mgr.a (mgr.14373) 15245 : cluster [DBG] pgmap v10573: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T11:29:42.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:29:41 smithi086 bash[24289]: cluster 2024-09-16T11:29:40.853452+0000 mgr.a (mgr.14373) 15245 : cluster [DBG] pgmap v10573: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T11:29:42.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:29:41 smithi047 bash[22744]: cluster 2024-09-16T11:29:40.853452+0000 mgr.a (mgr.14373) 15245 : cluster [DBG] pgmap v10573: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T11:29:42.856 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:29:42.856 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:29:42.856 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:29:42.856 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:29:42.856 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:29:44.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:29:43 smithi157 bash[24585]: audit 2024-09-16T11:29:42.408799+0000 mgr.a (mgr.14373) 15246 : audit [DBG] from='client.329499 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:29:44.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:29:43 smithi157 bash[24585]: cluster 2024-09-16T11:29:42.854974+0000 mgr.a (mgr.14373) 15247 : cluster [DBG] pgmap v10574: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:29:44.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:29:43 smithi086 bash[24289]: audit 2024-09-16T11:29:42.408799+0000 mgr.a (mgr.14373) 15246 : audit [DBG] from='client.329499 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:29:44.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:29:43 smithi086 bash[24289]: cluster 2024-09-16T11:29:42.854974+0000 mgr.a (mgr.14373) 15247 : cluster [DBG] pgmap v10574: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:29:44.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:29:43 smithi047 bash[22744]: audit 2024-09-16T11:29:42.408799+0000 mgr.a (mgr.14373) 15246 : audit [DBG] from='client.329499 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:29:44.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:29:43 smithi047 bash[22744]: cluster 2024-09-16T11:29:42.854974+0000 mgr.a (mgr.14373) 15247 : cluster [DBG] pgmap v10574: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:29:46.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:29:45 smithi157 bash[24585]: cluster 2024-09-16T11:29:44.855851+0000 mgr.a (mgr.14373) 15248 : cluster [DBG] pgmap v10575: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T11:29:46.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:29:45 smithi086 bash[24289]: cluster 2024-09-16T11:29:44.855851+0000 mgr.a (mgr.14373) 15248 : cluster [DBG] pgmap v10575: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T11:29:46.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:29:45 smithi047 bash[22744]: cluster 2024-09-16T11:29:44.855851+0000 mgr.a (mgr.14373) 15248 : cluster [DBG] pgmap v10575: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T11:29:47.858 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:29:47.858 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:29:47.859 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:29:48.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:29:47 smithi157 bash[24585]: cluster 2024-09-16T11:29:46.857942+0000 mgr.a (mgr.14373) 15249 : cluster [DBG] pgmap v10576: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:29:48.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:29:47 smithi086 bash[24289]: cluster 2024-09-16T11:29:46.857942+0000 mgr.a (mgr.14373) 15249 : cluster [DBG] pgmap v10576: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:29:48.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:29:47 smithi047 bash[22744]: cluster 2024-09-16T11:29:46.857942+0000 mgr.a (mgr.14373) 15249 : cluster [DBG] pgmap v10576: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:29:48.597 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:29:48.598 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:29:48.598 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:29:48.598 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:29:48.598 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:29:49.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:29:48 smithi157 bash[24585]: audit 2024-09-16T11:29:48.185078+0000 mgr.a (mgr.14373) 15250 : audit [DBG] from='client.329574 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:29:49.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:29:48 smithi086 bash[24289]: audit 2024-09-16T11:29:48.185078+0000 mgr.a (mgr.14373) 15250 : audit [DBG] from='client.329574 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:29:49.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:29:48 smithi047 bash[22744]: audit 2024-09-16T11:29:48.185078+0000 mgr.a (mgr.14373) 15250 : audit [DBG] from='client.329574 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:29:50.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:29:49 smithi157 bash[24585]: cluster 2024-09-16T11:29:48.859034+0000 mgr.a (mgr.14373) 15251 : cluster [DBG] pgmap v10577: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:29:50.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:29:49 smithi086 bash[24289]: cluster 2024-09-16T11:29:48.859034+0000 mgr.a (mgr.14373) 15251 : cluster [DBG] pgmap v10577: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:29:50.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:29:49 smithi047 bash[22744]: cluster 2024-09-16T11:29:48.859034+0000 mgr.a (mgr.14373) 15251 : cluster [DBG] pgmap v10577: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:29:52.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:29:51 smithi157 bash[24585]: cluster 2024-09-16T11:29:50.860009+0000 mgr.a (mgr.14373) 15252 : cluster [DBG] pgmap v10578: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:29:52.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:29:51 smithi086 bash[24289]: cluster 2024-09-16T11:29:50.860009+0000 mgr.a (mgr.14373) 15252 : cluster [DBG] pgmap v10578: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:29:52.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:29:51 smithi047 bash[22744]: cluster 2024-09-16T11:29:50.860009+0000 mgr.a (mgr.14373) 15252 : cluster [DBG] pgmap v10578: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:29:53.599 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:29:53.600 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:29:53.600 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:29:54.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:29:53 smithi157 bash[24585]: cluster 2024-09-16T11:29:52.862399+0000 mgr.a (mgr.14373) 15253 : cluster [DBG] pgmap v10579: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:29:54.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:29:53 smithi086 bash[24289]: cluster 2024-09-16T11:29:52.862399+0000 mgr.a (mgr.14373) 15253 : cluster [DBG] pgmap v10579: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:29:54.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:29:53 smithi047 bash[22744]: cluster 2024-09-16T11:29:52.862399+0000 mgr.a (mgr.14373) 15253 : cluster [DBG] pgmap v10579: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:29:54.349 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:29:54.350 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:29:54.350 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:29:54.350 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:29:54.350 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:29:55.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:29:54 smithi157 bash[24585]: audit 2024-09-16T11:29:53.928234+0000 mgr.a (mgr.14373) 15254 : audit [DBG] from='client.329652 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:29:55.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:29:54 smithi086 bash[24289]: audit 2024-09-16T11:29:53.928234+0000 mgr.a (mgr.14373) 15254 : audit [DBG] from='client.329652 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:29:55.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:29:54 smithi047 bash[22744]: audit 2024-09-16T11:29:53.928234+0000 mgr.a (mgr.14373) 15254 : audit [DBG] from='client.329652 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:29:56.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:29:55 smithi157 bash[24585]: cluster 2024-09-16T11:29:54.863362+0000 mgr.a (mgr.14373) 15255 : cluster [DBG] pgmap v10580: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:29:56.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:29:55 smithi086 bash[24289]: cluster 2024-09-16T11:29:54.863362+0000 mgr.a (mgr.14373) 15255 : cluster [DBG] pgmap v10580: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:29:56.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:29:55 smithi047 bash[22744]: cluster 2024-09-16T11:29:54.863362+0000 mgr.a (mgr.14373) 15255 : cluster [DBG] pgmap v10580: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:29:58.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:29:57 smithi157 bash[24585]: cluster 2024-09-16T11:29:56.865523+0000 mgr.a (mgr.14373) 15256 : cluster [DBG] pgmap v10581: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:29:58.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:29:57 smithi086 bash[24289]: cluster 2024-09-16T11:29:56.865523+0000 mgr.a (mgr.14373) 15256 : cluster [DBG] pgmap v10581: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:29:58.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:29:57 smithi047 bash[22744]: cluster 2024-09-16T11:29:56.865523+0000 mgr.a (mgr.14373) 15256 : cluster [DBG] pgmap v10581: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:29:59.351 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:29:59.352 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:29:59.352 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:30:00.129 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:30:00.129 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:30:00.129 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:30:00.129 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:30:00.129 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:30:00.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:29:59 smithi157 bash[24585]: cluster 2024-09-16T11:29:58.866288+0000 mgr.a (mgr.14373) 15257 : cluster [DBG] pgmap v10582: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:30:00.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:29:59 smithi086 bash[24289]: cluster 2024-09-16T11:29:58.866288+0000 mgr.a (mgr.14373) 15257 : cluster [DBG] pgmap v10582: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:30:00.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:29:59 smithi047 bash[22744]: cluster 2024-09-16T11:29:58.866288+0000 mgr.a (mgr.14373) 15257 : cluster [DBG] pgmap v10582: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:30:01.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:30:00 smithi157 bash[24585]: audit 2024-09-16T11:29:59.686872+0000 mgr.a (mgr.14373) 15258 : audit [DBG] from='client.329727 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:30:01.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:30:00 smithi157 bash[24585]: cluster 2024-09-16T11:30:00.000080+0000 mon.a (mon.0) 1476 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-16T11:30:01.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:30:00 smithi086 bash[24289]: audit 2024-09-16T11:29:59.686872+0000 mgr.a (mgr.14373) 15258 : audit [DBG] from='client.329727 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:30:01.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:30:00 smithi086 bash[24289]: cluster 2024-09-16T11:30:00.000080+0000 mon.a (mon.0) 1476 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-16T11:30:01.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:30:00 smithi047 bash[22744]: audit 2024-09-16T11:29:59.686872+0000 mgr.a (mgr.14373) 15258 : audit [DBG] from='client.329727 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:30:01.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:30:00 smithi047 bash[22744]: cluster 2024-09-16T11:30:00.000080+0000 mon.a (mon.0) 1476 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-16T11:30:02.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:30:01 smithi157 bash[24585]: cluster 2024-09-16T11:30:00.867244+0000 mgr.a (mgr.14373) 15259 : cluster [DBG] pgmap v10583: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:30:02.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:30:01 smithi086 bash[24289]: cluster 2024-09-16T11:30:00.867244+0000 mgr.a (mgr.14373) 15259 : cluster [DBG] pgmap v10583: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:30:02.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:30:01 smithi047 bash[22744]: cluster 2024-09-16T11:30:00.867244+0000 mgr.a (mgr.14373) 15259 : cluster [DBG] pgmap v10583: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:30:04.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:30:03 smithi157 bash[24585]: cluster 2024-09-16T11:30:02.869486+0000 mgr.a (mgr.14373) 15260 : cluster [DBG] pgmap v10584: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:30:04.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:30:03 smithi086 bash[24289]: cluster 2024-09-16T11:30:02.869486+0000 mgr.a (mgr.14373) 15260 : cluster [DBG] pgmap v10584: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:30:04.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:30:03 smithi047 bash[22744]: cluster 2024-09-16T11:30:02.869486+0000 mgr.a (mgr.14373) 15260 : cluster [DBG] pgmap v10584: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:30:05.130 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:30:05.131 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:30:05.131 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:30:05.908 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:30:05.908 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:30:05.908 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:30:05.908 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:30:05.908 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:30:06.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:30:06 smithi157 bash[24585]: cluster 2024-09-16T11:30:04.870254+0000 mgr.a (mgr.14373) 15261 : cluster [DBG] pgmap v10585: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:30:06.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:30:06 smithi086 bash[24289]: cluster 2024-09-16T11:30:04.870254+0000 mgr.a (mgr.14373) 15261 : cluster [DBG] pgmap v10585: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:30:06.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:30:06 smithi047 bash[22744]: cluster 2024-09-16T11:30:04.870254+0000 mgr.a (mgr.14373) 15261 : cluster [DBG] pgmap v10585: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:30:07.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:30:07 smithi157 bash[24585]: audit 2024-09-16T11:30:05.464701+0000 mgr.a (mgr.14373) 15262 : audit [DBG] from='client.329805 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:30:07.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:30:07 smithi086 bash[24289]: audit 2024-09-16T11:30:05.464701+0000 mgr.a (mgr.14373) 15262 : audit [DBG] from='client.329805 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:30:07.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:30:07 smithi047 bash[22744]: audit 2024-09-16T11:30:05.464701+0000 mgr.a (mgr.14373) 15262 : audit [DBG] from='client.329805 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:30:08.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:30:08 smithi157 bash[24585]: cluster 2024-09-16T11:30:06.872578+0000 mgr.a (mgr.14373) 15263 : cluster [DBG] pgmap v10586: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:30:08.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:30:08 smithi086 bash[24289]: cluster 2024-09-16T11:30:06.872578+0000 mgr.a (mgr.14373) 15263 : cluster [DBG] pgmap v10586: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:30:08.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:30:08 smithi047 bash[22744]: cluster 2024-09-16T11:30:06.872578+0000 mgr.a (mgr.14373) 15263 : cluster [DBG] pgmap v10586: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:30:10.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:30:10 smithi157 bash[24585]: cluster 2024-09-16T11:30:08.873350+0000 mgr.a (mgr.14373) 15264 : cluster [DBG] pgmap v10587: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:30:10.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:30:10 smithi086 bash[24289]: cluster 2024-09-16T11:30:08.873350+0000 mgr.a (mgr.14373) 15264 : cluster [DBG] pgmap v10587: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:30:10.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:30:10 smithi047 bash[22744]: cluster 2024-09-16T11:30:08.873350+0000 mgr.a (mgr.14373) 15264 : cluster [DBG] pgmap v10587: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:30:10.909 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:30:10.910 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:30:10.910 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:30:11.685 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:30:11.685 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:30:11.685 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:30:11.686 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:30:11.686 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:30:12.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:30:12 smithi157 bash[24585]: cluster 2024-09-16T11:30:10.874169+0000 mgr.a (mgr.14373) 15265 : cluster [DBG] pgmap v10588: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:30:12.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:30:12 smithi157 bash[24585]: audit 2024-09-16T11:30:11.246204+0000 mgr.a (mgr.14373) 15266 : audit [DBG] from='client.329880 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:30:12.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:30:12 smithi086 bash[24289]: cluster 2024-09-16T11:30:10.874169+0000 mgr.a (mgr.14373) 15265 : cluster [DBG] pgmap v10588: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:30:12.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:30:12 smithi086 bash[24289]: audit 2024-09-16T11:30:11.246204+0000 mgr.a (mgr.14373) 15266 : audit [DBG] from='client.329880 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:30:12.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:30:12 smithi047 bash[22744]: cluster 2024-09-16T11:30:10.874169+0000 mgr.a (mgr.14373) 15265 : cluster [DBG] pgmap v10588: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:30:12.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:30:12 smithi047 bash[22744]: audit 2024-09-16T11:30:11.246204+0000 mgr.a (mgr.14373) 15266 : audit [DBG] from='client.329880 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:30:14.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:30:14 smithi157 bash[24585]: cluster 2024-09-16T11:30:12.876593+0000 mgr.a (mgr.14373) 15267 : cluster [DBG] pgmap v10589: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-16T11:30:14.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:30:14 smithi086 bash[24289]: cluster 2024-09-16T11:30:12.876593+0000 mgr.a (mgr.14373) 15267 : cluster [DBG] pgmap v10589: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-16T11:30:14.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:30:14 smithi047 bash[22744]: cluster 2024-09-16T11:30:12.876593+0000 mgr.a (mgr.14373) 15267 : cluster [DBG] pgmap v10589: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-16T11:30:16.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:30:16 smithi157 bash[24585]: cluster 2024-09-16T11:30:14.877389+0000 mgr.a (mgr.14373) 15268 : cluster [DBG] pgmap v10590: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T11:30:16.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:30:16 smithi157 bash[24585]: audit 2024-09-16T11:30:15.545300+0000 mon.b (mon.2) 1390 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T11:30:16.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:30:16 smithi086 bash[24289]: cluster 2024-09-16T11:30:14.877389+0000 mgr.a (mgr.14373) 15268 : cluster [DBG] pgmap v10590: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T11:30:16.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:30:16 smithi086 bash[24289]: audit 2024-09-16T11:30:15.545300+0000 mon.b (mon.2) 1390 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T11:30:16.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:30:16 smithi047 bash[22744]: cluster 2024-09-16T11:30:14.877389+0000 mgr.a (mgr.14373) 15268 : cluster [DBG] pgmap v10590: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T11:30:16.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:30:16 smithi047 bash[22744]: audit 2024-09-16T11:30:15.545300+0000 mon.b (mon.2) 1390 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T11:30:16.686 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:30:16.687 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:30:16.687 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:30:17.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:30:17 smithi157 bash[24585]: audit 2024-09-16T11:30:16.171290+0000 mon.a (mon.0) 1477 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:30:17.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:30:17 smithi157 bash[24585]: audit 2024-09-16T11:30:16.176979+0000 mon.a (mon.0) 1478 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:30:17.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:30:17 smithi157 bash[24585]: audit 2024-09-16T11:30:16.948279+0000 mon.b (mon.2) 1391 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T11:30:17.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:30:17 smithi157 bash[24585]: audit 2024-09-16T11:30:16.949708+0000 mon.b (mon.2) 1392 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T11:30:17.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:30:17 smithi157 bash[24585]: audit 2024-09-16T11:30:16.957213+0000 mon.a (mon.0) 1479 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:30:17.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:30:17 smithi157 bash[24585]: audit 2024-09-16T11:30:16.963302+0000 mon.b (mon.2) 1393 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:30:17.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:30:17 smithi086 bash[24289]: audit 2024-09-16T11:30:16.171290+0000 mon.a (mon.0) 1477 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:30:17.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:30:17 smithi086 bash[24289]: audit 2024-09-16T11:30:16.176979+0000 mon.a (mon.0) 1478 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:30:17.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:30:17 smithi086 bash[24289]: audit 2024-09-16T11:30:16.948279+0000 mon.b (mon.2) 1391 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T11:30:17.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:30:17 smithi086 bash[24289]: audit 2024-09-16T11:30:16.949708+0000 mon.b (mon.2) 1392 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T11:30:17.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:30:17 smithi086 bash[24289]: audit 2024-09-16T11:30:16.957213+0000 mon.a (mon.0) 1479 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:30:17.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:30:17 smithi086 bash[24289]: audit 2024-09-16T11:30:16.963302+0000 mon.b (mon.2) 1393 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:30:17.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:30:17 smithi047 bash[22744]: audit 2024-09-16T11:30:16.171290+0000 mon.a (mon.0) 1477 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:30:17.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:30:17 smithi047 bash[22744]: audit 2024-09-16T11:30:16.176979+0000 mon.a (mon.0) 1478 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:30:17.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:30:17 smithi047 bash[22744]: audit 2024-09-16T11:30:16.948279+0000 mon.b (mon.2) 1391 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T11:30:17.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:30:17 smithi047 bash[22744]: audit 2024-09-16T11:30:16.949708+0000 mon.b (mon.2) 1392 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T11:30:17.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:30:17 smithi047 bash[22744]: audit 2024-09-16T11:30:16.957213+0000 mon.a (mon.0) 1479 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:30:17.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:30:17 smithi047 bash[22744]: audit 2024-09-16T11:30:16.963302+0000 mon.b (mon.2) 1393 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:30:18.089 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:30:18.089 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:30:18.089 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:30:18.089 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:30:18.089 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:30:18.092 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 11:30:17 smithi047 bash[22994]: debug 2024-09-16T11:30:17.680+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T11:30:18.092 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 11:30:17 smithi047 bash[22994]: debug 2024-09-16T11:30:17.692+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T11:30:18.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:30:18 smithi157 bash[24585]: cluster 2024-09-16T11:30:16.878663+0000 mgr.a (mgr.14373) 15269 : cluster [DBG] pgmap v10591: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:30:18.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:30:18 smithi157 bash[24585]: audit 2024-09-16T11:30:16.964892+0000 mgr.a (mgr.14373) 15270 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:30:18.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:30:18 smithi157 bash[24585]: audit 2024-09-16T11:30:17.014102+0000 mgr.a (mgr.14373) 15271 : audit [DBG] from='client.329958 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:30:18.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:30:18 smithi086 bash[24289]: cluster 2024-09-16T11:30:16.878663+0000 mgr.a (mgr.14373) 15269 : cluster [DBG] pgmap v10591: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:30:18.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:30:18 smithi086 bash[24289]: audit 2024-09-16T11:30:16.964892+0000 mgr.a (mgr.14373) 15270 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:30:18.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:30:18 smithi086 bash[24289]: audit 2024-09-16T11:30:17.014102+0000 mgr.a (mgr.14373) 15271 : audit [DBG] from='client.329958 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:30:18.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:30:18 smithi047 bash[22744]: cluster 2024-09-16T11:30:16.878663+0000 mgr.a (mgr.14373) 15269 : cluster [DBG] pgmap v10591: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:30:18.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:30:18 smithi047 bash[22744]: audit 2024-09-16T11:30:16.964892+0000 mgr.a (mgr.14373) 15270 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:30:18.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:30:18 smithi047 bash[22744]: audit 2024-09-16T11:30:17.014102+0000 mgr.a (mgr.14373) 15271 : audit [DBG] from='client.329958 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:30:19.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:30:19 smithi157 bash[24585]: audit 2024-09-16T11:30:17.683736+0000 mgr.a (mgr.14373) 15272 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T11:30:19.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:30:19 smithi157 bash[24585]: cephadm 2024-09-16T11:30:17.697176+0000 mgr.a (mgr.14373) 15273 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T11:30:19.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:30:19 smithi086 bash[24289]: audit 2024-09-16T11:30:17.683736+0000 mgr.a (mgr.14373) 15272 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T11:30:19.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:30:19 smithi086 bash[24289]: cephadm 2024-09-16T11:30:17.697176+0000 mgr.a (mgr.14373) 15273 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T11:30:19.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:30:19 smithi047 bash[22744]: audit 2024-09-16T11:30:17.683736+0000 mgr.a (mgr.14373) 15272 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T11:30:19.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:30:19 smithi047 bash[22744]: cephadm 2024-09-16T11:30:17.697176+0000 mgr.a (mgr.14373) 15273 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T11:30:20.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:30:20 smithi157 bash[24585]: cluster 2024-09-16T11:30:18.879647+0000 mgr.a (mgr.14373) 15274 : cluster [DBG] pgmap v10592: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T11:30:20.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:30:20 smithi086 bash[24289]: cluster 2024-09-16T11:30:18.879647+0000 mgr.a (mgr.14373) 15274 : cluster [DBG] pgmap v10592: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T11:30:20.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:30:20 smithi047 bash[22744]: cluster 2024-09-16T11:30:18.879647+0000 mgr.a (mgr.14373) 15274 : cluster [DBG] pgmap v10592: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T11:30:22.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:30:22 smithi157 bash[24585]: cluster 2024-09-16T11:30:20.880437+0000 mgr.a (mgr.14373) 15275 : cluster [DBG] pgmap v10593: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T11:30:22.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:30:22 smithi086 bash[24289]: cluster 2024-09-16T11:30:20.880437+0000 mgr.a (mgr.14373) 15275 : cluster [DBG] pgmap v10593: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T11:30:22.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:30:22 smithi047 bash[22744]: cluster 2024-09-16T11:30:20.880437+0000 mgr.a (mgr.14373) 15275 : cluster [DBG] pgmap v10593: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T11:30:23.090 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:30:23.091 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:30:23.091 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:30:23.873 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:30:23.873 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:30:23.873 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:30:23.873 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:30:23.873 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:30:24.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:30:24 smithi157 bash[24585]: cluster 2024-09-16T11:30:22.882707+0000 mgr.a (mgr.14373) 15276 : cluster [DBG] pgmap v10594: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:30:24.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:30:24 smithi086 bash[24289]: cluster 2024-09-16T11:30:22.882707+0000 mgr.a (mgr.14373) 15276 : cluster [DBG] pgmap v10594: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:30:24.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:30:24 smithi047 bash[22744]: cluster 2024-09-16T11:30:22.882707+0000 mgr.a (mgr.14373) 15276 : cluster [DBG] pgmap v10594: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:30:25.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:30:25 smithi157 bash[24585]: audit 2024-09-16T11:30:23.429152+0000 mgr.a (mgr.14373) 15277 : audit [DBG] from='client.330144 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:30:25.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:30:25 smithi086 bash[24289]: audit 2024-09-16T11:30:23.429152+0000 mgr.a (mgr.14373) 15277 : audit [DBG] from='client.330144 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:30:25.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:30:25 smithi047 bash[22744]: audit 2024-09-16T11:30:23.429152+0000 mgr.a (mgr.14373) 15277 : audit [DBG] from='client.330144 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:30:26.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:30:26 smithi157 bash[24585]: cluster 2024-09-16T11:30:24.883659+0000 mgr.a (mgr.14373) 15278 : cluster [DBG] pgmap v10595: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T11:30:26.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:30:26 smithi086 bash[24289]: cluster 2024-09-16T11:30:24.883659+0000 mgr.a (mgr.14373) 15278 : cluster [DBG] pgmap v10595: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T11:30:26.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:30:26 smithi047 bash[22744]: cluster 2024-09-16T11:30:24.883659+0000 mgr.a (mgr.14373) 15278 : cluster [DBG] pgmap v10595: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T11:30:28.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:30:28 smithi157 bash[24585]: cluster 2024-09-16T11:30:26.885829+0000 mgr.a (mgr.14373) 15279 : cluster [DBG] pgmap v10596: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:30:28.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:30:28 smithi086 bash[24289]: cluster 2024-09-16T11:30:26.885829+0000 mgr.a (mgr.14373) 15279 : cluster [DBG] pgmap v10596: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:30:28.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:30:28 smithi047 bash[22744]: cluster 2024-09-16T11:30:26.885829+0000 mgr.a (mgr.14373) 15279 : cluster [DBG] pgmap v10596: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:30:28.874 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:30:28.875 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:30:28.875 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:30:29.651 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:30:29.651 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:30:29.651 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:30:29.651 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:30:29.651 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:30:30.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:30:30 smithi157 bash[24585]: cluster 2024-09-16T11:30:28.886614+0000 mgr.a (mgr.14373) 15280 : cluster [DBG] pgmap v10597: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:30:30.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:30:30 smithi157 bash[24585]: audit 2024-09-16T11:30:29.208875+0000 mgr.a (mgr.14373) 15281 : audit [DBG] from='client.330222 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:30:30.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:30:30 smithi086 bash[24289]: cluster 2024-09-16T11:30:28.886614+0000 mgr.a (mgr.14373) 15280 : cluster [DBG] pgmap v10597: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:30:30.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:30:30 smithi086 bash[24289]: audit 2024-09-16T11:30:29.208875+0000 mgr.a (mgr.14373) 15281 : audit [DBG] from='client.330222 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:30:30.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:30:30 smithi047 bash[22744]: cluster 2024-09-16T11:30:28.886614+0000 mgr.a (mgr.14373) 15280 : cluster [DBG] pgmap v10597: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:30:30.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:30:30 smithi047 bash[22744]: audit 2024-09-16T11:30:29.208875+0000 mgr.a (mgr.14373) 15281 : audit [DBG] from='client.330222 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:30:32.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:30:32 smithi157 bash[24585]: cluster 2024-09-16T11:30:30.887527+0000 mgr.a (mgr.14373) 15282 : cluster [DBG] pgmap v10598: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:30:32.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:30:32 smithi086 bash[24289]: cluster 2024-09-16T11:30:30.887527+0000 mgr.a (mgr.14373) 15282 : cluster [DBG] pgmap v10598: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:30:32.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:30:32 smithi047 bash[22744]: cluster 2024-09-16T11:30:30.887527+0000 mgr.a (mgr.14373) 15282 : cluster [DBG] pgmap v10598: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:30:34.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:30:34 smithi157 bash[24585]: cluster 2024-09-16T11:30:32.889789+0000 mgr.a (mgr.14373) 15283 : cluster [DBG] pgmap v10599: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:30:34.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:30:34 smithi086 bash[24289]: cluster 2024-09-16T11:30:32.889789+0000 mgr.a (mgr.14373) 15283 : cluster [DBG] pgmap v10599: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:30:34.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:30:34 smithi047 bash[22744]: cluster 2024-09-16T11:30:32.889789+0000 mgr.a (mgr.14373) 15283 : cluster [DBG] pgmap v10599: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:30:34.652 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:30:34.653 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:30:34.653 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:30:35.402 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:30:35.403 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:30:35.403 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:30:35.403 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:30:35.403 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:30:36.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:30:36 smithi157 bash[24585]: cluster 2024-09-16T11:30:34.890523+0000 mgr.a (mgr.14373) 15284 : cluster [DBG] pgmap v10600: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:30:36.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:30:36 smithi157 bash[24585]: audit 2024-09-16T11:30:34.982890+0000 mgr.a (mgr.14373) 15285 : audit [DBG] from='client.330297 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:30:36.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:30:36 smithi086 bash[24289]: cluster 2024-09-16T11:30:34.890523+0000 mgr.a (mgr.14373) 15284 : cluster [DBG] pgmap v10600: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:30:36.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:30:36 smithi086 bash[24289]: audit 2024-09-16T11:30:34.982890+0000 mgr.a (mgr.14373) 15285 : audit [DBG] from='client.330297 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:30:36.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:30:36 smithi047 bash[22744]: cluster 2024-09-16T11:30:34.890523+0000 mgr.a (mgr.14373) 15284 : cluster [DBG] pgmap v10600: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:30:36.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:30:36 smithi047 bash[22744]: audit 2024-09-16T11:30:34.982890+0000 mgr.a (mgr.14373) 15285 : audit [DBG] from='client.330297 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:30:38.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:30:38 smithi157 bash[24585]: cluster 2024-09-16T11:30:36.892811+0000 mgr.a (mgr.14373) 15286 : cluster [DBG] pgmap v10601: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:30:38.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:30:38 smithi086 bash[24289]: cluster 2024-09-16T11:30:36.892811+0000 mgr.a (mgr.14373) 15286 : cluster [DBG] pgmap v10601: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:30:38.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:30:38 smithi047 bash[22744]: cluster 2024-09-16T11:30:36.892811+0000 mgr.a (mgr.14373) 15286 : cluster [DBG] pgmap v10601: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:30:40.404 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:30:40.405 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:30:40.405 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:30:40.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:30:40 smithi157 bash[24585]: cluster 2024-09-16T11:30:38.893610+0000 mgr.a (mgr.14373) 15287 : cluster [DBG] pgmap v10602: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:30:40.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:30:40 smithi086 bash[24289]: cluster 2024-09-16T11:30:38.893610+0000 mgr.a (mgr.14373) 15287 : cluster [DBG] pgmap v10602: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:30:40.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:30:40 smithi047 bash[22744]: cluster 2024-09-16T11:30:38.893610+0000 mgr.a (mgr.14373) 15287 : cluster [DBG] pgmap v10602: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:30:41.166 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:30:41.166 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:30:41.166 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:30:41.167 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:30:41.167 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:30:42.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:30:42 smithi157 bash[24585]: audit 2024-09-16T11:30:40.737079+0000 mgr.a (mgr.14373) 15288 : audit [DBG] from='client.330375 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:30:42.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:30:42 smithi157 bash[24585]: cluster 2024-09-16T11:30:40.894683+0000 mgr.a (mgr.14373) 15289 : cluster [DBG] pgmap v10603: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:30:42.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:30:42 smithi086 bash[24289]: audit 2024-09-16T11:30:40.737079+0000 mgr.a (mgr.14373) 15288 : audit [DBG] from='client.330375 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:30:42.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:30:42 smithi086 bash[24289]: cluster 2024-09-16T11:30:40.894683+0000 mgr.a (mgr.14373) 15289 : cluster [DBG] pgmap v10603: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:30:42.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:30:42 smithi047 bash[22744]: audit 2024-09-16T11:30:40.737079+0000 mgr.a (mgr.14373) 15288 : audit [DBG] from='client.330375 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:30:42.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:30:42 smithi047 bash[22744]: cluster 2024-09-16T11:30:40.894683+0000 mgr.a (mgr.14373) 15289 : cluster [DBG] pgmap v10603: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:30:44.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:30:44 smithi157 bash[24585]: cluster 2024-09-16T11:30:42.896994+0000 mgr.a (mgr.14373) 15290 : cluster [DBG] pgmap v10604: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:30:44.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:30:44 smithi086 bash[24289]: cluster 2024-09-16T11:30:42.896994+0000 mgr.a (mgr.14373) 15290 : cluster [DBG] pgmap v10604: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:30:44.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:30:44 smithi047 bash[22744]: cluster 2024-09-16T11:30:42.896994+0000 mgr.a (mgr.14373) 15290 : cluster [DBG] pgmap v10604: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:30:46.168 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:30:46.168 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:30:46.169 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:30:46.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:30:46 smithi157 bash[24585]: cluster 2024-09-16T11:30:44.897822+0000 mgr.a (mgr.14373) 15291 : cluster [DBG] pgmap v10605: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:30:46.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:30:46 smithi086 bash[24289]: cluster 2024-09-16T11:30:44.897822+0000 mgr.a (mgr.14373) 15291 : cluster [DBG] pgmap v10605: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:30:46.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:30:46 smithi047 bash[22744]: cluster 2024-09-16T11:30:44.897822+0000 mgr.a (mgr.14373) 15291 : cluster [DBG] pgmap v10605: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:30:46.956 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:30:46.956 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:30:46.956 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:30:46.956 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:30:46.956 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:30:48.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:30:48 smithi157 bash[24585]: audit 2024-09-16T11:30:46.506936+0000 mgr.a (mgr.14373) 15292 : audit [DBG] from='client.330453 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:30:48.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:30:48 smithi157 bash[24585]: cluster 2024-09-16T11:30:46.899254+0000 mgr.a (mgr.14373) 15293 : cluster [DBG] pgmap v10606: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:30:48.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:30:48 smithi086 bash[24289]: audit 2024-09-16T11:30:46.506936+0000 mgr.a (mgr.14373) 15292 : audit [DBG] from='client.330453 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:30:48.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:30:48 smithi086 bash[24289]: cluster 2024-09-16T11:30:46.899254+0000 mgr.a (mgr.14373) 15293 : cluster [DBG] pgmap v10606: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:30:48.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:30:48 smithi047 bash[22744]: audit 2024-09-16T11:30:46.506936+0000 mgr.a (mgr.14373) 15292 : audit [DBG] from='client.330453 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:30:48.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:30:48 smithi047 bash[22744]: cluster 2024-09-16T11:30:46.899254+0000 mgr.a (mgr.14373) 15293 : cluster [DBG] pgmap v10606: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:30:50.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:30:50 smithi157 bash[24585]: cluster 2024-09-16T11:30:48.900006+0000 mgr.a (mgr.14373) 15294 : cluster [DBG] pgmap v10607: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:30:50.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:30:50 smithi086 bash[24289]: cluster 2024-09-16T11:30:48.900006+0000 mgr.a (mgr.14373) 15294 : cluster [DBG] pgmap v10607: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:30:50.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:30:50 smithi047 bash[22744]: cluster 2024-09-16T11:30:48.900006+0000 mgr.a (mgr.14373) 15294 : cluster [DBG] pgmap v10607: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:30:51.957 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:30:51.958 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:30:51.958 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:30:52.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:30:52 smithi157 bash[24585]: cluster 2024-09-16T11:30:50.900736+0000 mgr.a (mgr.14373) 15295 : cluster [DBG] pgmap v10608: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T11:30:52.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:30:52 smithi086 bash[24289]: cluster 2024-09-16T11:30:50.900736+0000 mgr.a (mgr.14373) 15295 : cluster [DBG] pgmap v10608: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T11:30:52.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:30:52 smithi047 bash[22744]: cluster 2024-09-16T11:30:50.900736+0000 mgr.a (mgr.14373) 15295 : cluster [DBG] pgmap v10608: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T11:30:52.738 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:30:52.739 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:30:52.739 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:30:52.739 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:30:52.739 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:30:54.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:30:54 smithi157 bash[24585]: audit 2024-09-16T11:30:52.290783+0000 mgr.a (mgr.14373) 15296 : audit [DBG] from='client.330528 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:30:54.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:30:54 smithi157 bash[24585]: cluster 2024-09-16T11:30:52.903642+0000 mgr.a (mgr.14373) 15297 : cluster [DBG] pgmap v10609: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:30:54.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:30:54 smithi086 bash[24289]: audit 2024-09-16T11:30:52.290783+0000 mgr.a (mgr.14373) 15296 : audit [DBG] from='client.330528 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:30:54.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:30:54 smithi086 bash[24289]: cluster 2024-09-16T11:30:52.903642+0000 mgr.a (mgr.14373) 15297 : cluster [DBG] pgmap v10609: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:30:54.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:30:54 smithi047 bash[22744]: audit 2024-09-16T11:30:52.290783+0000 mgr.a (mgr.14373) 15296 : audit [DBG] from='client.330528 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:30:54.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:30:54 smithi047 bash[22744]: cluster 2024-09-16T11:30:52.903642+0000 mgr.a (mgr.14373) 15297 : cluster [DBG] pgmap v10609: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:30:56.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:30:56 smithi157 bash[24585]: cluster 2024-09-16T11:30:54.904612+0000 mgr.a (mgr.14373) 15298 : cluster [DBG] pgmap v10610: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:30:56.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:30:56 smithi086 bash[24289]: cluster 2024-09-16T11:30:54.904612+0000 mgr.a (mgr.14373) 15298 : cluster [DBG] pgmap v10610: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:30:56.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:30:56 smithi047 bash[22744]: cluster 2024-09-16T11:30:54.904612+0000 mgr.a (mgr.14373) 15298 : cluster [DBG] pgmap v10610: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:30:57.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:30:57 smithi047 bash[22744]: cluster 2024-09-16T11:30:56.906746+0000 mgr.a (mgr.14373) 15299 : cluster [DBG] pgmap v10611: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:30:57.740 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:30:57.741 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:30:57.741 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:30:57.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:30:57 smithi157 bash[24585]: cluster 2024-09-16T11:30:56.906746+0000 mgr.a (mgr.14373) 15299 : cluster [DBG] pgmap v10611: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:30:57.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:30:57 smithi086 bash[24289]: cluster 2024-09-16T11:30:56.906746+0000 mgr.a (mgr.14373) 15299 : cluster [DBG] pgmap v10611: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:30:58.533 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:30:58.533 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:30:58.533 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:30:58.534 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:30:58.534 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:30:58.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:30:58 smithi047 bash[22744]: audit 2024-09-16T11:30:58.077334+0000 mgr.a (mgr.14373) 15300 : audit [DBG] from='client.330603 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:30:58.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:30:58 smithi157 bash[24585]: audit 2024-09-16T11:30:58.077334+0000 mgr.a (mgr.14373) 15300 : audit [DBG] from='client.330603 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:30:58.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:30:58 smithi086 bash[24289]: audit 2024-09-16T11:30:58.077334+0000 mgr.a (mgr.14373) 15300 : audit [DBG] from='client.330603 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:30:59.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:30:59 smithi157 bash[24585]: cluster 2024-09-16T11:30:58.907769+0000 mgr.a (mgr.14373) 15301 : cluster [DBG] pgmap v10612: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:30:59.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:30:59 smithi086 bash[24289]: cluster 2024-09-16T11:30:58.907769+0000 mgr.a (mgr.14373) 15301 : cluster [DBG] pgmap v10612: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:30:59.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:30:59 smithi047 bash[22744]: cluster 2024-09-16T11:30:58.907769+0000 mgr.a (mgr.14373) 15301 : cluster [DBG] pgmap v10612: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:31:02.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:31:01 smithi157 bash[24585]: cluster 2024-09-16T11:31:00.908546+0000 mgr.a (mgr.14373) 15302 : cluster [DBG] pgmap v10613: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:31:02.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:31:01 smithi086 bash[24289]: cluster 2024-09-16T11:31:00.908546+0000 mgr.a (mgr.14373) 15302 : cluster [DBG] pgmap v10613: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:31:02.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:31:01 smithi047 bash[22744]: cluster 2024-09-16T11:31:00.908546+0000 mgr.a (mgr.14373) 15302 : cluster [DBG] pgmap v10613: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:31:03.535 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:31:03.536 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:31:03.536 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:31:04.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:31:03 smithi157 bash[24585]: cluster 2024-09-16T11:31:02.910779+0000 mgr.a (mgr.14373) 15303 : cluster [DBG] pgmap v10614: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:31:04.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:31:03 smithi086 bash[24289]: cluster 2024-09-16T11:31:02.910779+0000 mgr.a (mgr.14373) 15303 : cluster [DBG] pgmap v10614: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:31:04.327 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:31:04.327 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:31:04.327 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:31:04.327 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:31:04.327 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:31:04.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:31:03 smithi047 bash[22744]: cluster 2024-09-16T11:31:02.910779+0000 mgr.a (mgr.14373) 15303 : cluster [DBG] pgmap v10614: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:31:05.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:31:04 smithi157 bash[24585]: audit 2024-09-16T11:31:03.869606+0000 mgr.a (mgr.14373) 15304 : audit [DBG] from='client.330678 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:31:05.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:31:04 smithi086 bash[24289]: audit 2024-09-16T11:31:03.869606+0000 mgr.a (mgr.14373) 15304 : audit [DBG] from='client.330678 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:31:05.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:31:04 smithi047 bash[22744]: audit 2024-09-16T11:31:03.869606+0000 mgr.a (mgr.14373) 15304 : audit [DBG] from='client.330678 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:31:06.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:31:05 smithi157 bash[24585]: cluster 2024-09-16T11:31:04.911884+0000 mgr.a (mgr.14373) 15305 : cluster [DBG] pgmap v10615: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:31:06.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:31:05 smithi086 bash[24289]: cluster 2024-09-16T11:31:04.911884+0000 mgr.a (mgr.14373) 15305 : cluster [DBG] pgmap v10615: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:31:06.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:31:05 smithi047 bash[22744]: cluster 2024-09-16T11:31:04.911884+0000 mgr.a (mgr.14373) 15305 : cluster [DBG] pgmap v10615: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:31:08.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:31:07 smithi157 bash[24585]: cluster 2024-09-16T11:31:06.914149+0000 mgr.a (mgr.14373) 15306 : cluster [DBG] pgmap v10616: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:31:08.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:31:07 smithi086 bash[24289]: cluster 2024-09-16T11:31:06.914149+0000 mgr.a (mgr.14373) 15306 : cluster [DBG] pgmap v10616: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:31:08.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:31:07 smithi047 bash[22744]: cluster 2024-09-16T11:31:06.914149+0000 mgr.a (mgr.14373) 15306 : cluster [DBG] pgmap v10616: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:31:09.329 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:31:09.330 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:31:09.330 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:31:10.102 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:31:10.103 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:31:10.103 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:31:10.103 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:31:10.103 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:31:10.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:31:09 smithi157 bash[24585]: cluster 2024-09-16T11:31:08.914939+0000 mgr.a (mgr.14373) 15307 : cluster [DBG] pgmap v10617: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:31:10.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:31:09 smithi086 bash[24289]: cluster 2024-09-16T11:31:08.914939+0000 mgr.a (mgr.14373) 15307 : cluster [DBG] pgmap v10617: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:31:10.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:31:09 smithi047 bash[22744]: cluster 2024-09-16T11:31:08.914939+0000 mgr.a (mgr.14373) 15307 : cluster [DBG] pgmap v10617: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:31:11.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:31:11 smithi157 bash[24585]: audit 2024-09-16T11:31:09.659729+0000 mgr.a (mgr.14373) 15308 : audit [DBG] from='client.330756 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:31:11.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:31:10 smithi086 bash[24289]: audit 2024-09-16T11:31:09.659729+0000 mgr.a (mgr.14373) 15308 : audit [DBG] from='client.330756 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:31:11.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:31:10 smithi047 bash[22744]: audit 2024-09-16T11:31:09.659729+0000 mgr.a (mgr.14373) 15308 : audit [DBG] from='client.330756 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:31:12.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:31:12 smithi157 bash[24585]: cluster 2024-09-16T11:31:10.915824+0000 mgr.a (mgr.14373) 15309 : cluster [DBG] pgmap v10618: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:31:12.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:31:12 smithi086 bash[24289]: cluster 2024-09-16T11:31:10.915824+0000 mgr.a (mgr.14373) 15309 : cluster [DBG] pgmap v10618: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:31:12.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:31:12 smithi047 bash[22744]: cluster 2024-09-16T11:31:10.915824+0000 mgr.a (mgr.14373) 15309 : cluster [DBG] pgmap v10618: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:31:14.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:31:14 smithi157 bash[24585]: cluster 2024-09-16T11:31:12.918082+0000 mgr.a (mgr.14373) 15310 : cluster [DBG] pgmap v10619: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:31:14.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:31:14 smithi086 bash[24289]: cluster 2024-09-16T11:31:12.918082+0000 mgr.a (mgr.14373) 15310 : cluster [DBG] pgmap v10619: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:31:14.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:31:14 smithi047 bash[22744]: cluster 2024-09-16T11:31:12.918082+0000 mgr.a (mgr.14373) 15310 : cluster [DBG] pgmap v10619: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:31:15.104 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:31:15.105 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:31:15.105 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:31:15.886 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:31:15.886 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:31:15.886 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:31:15.887 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:31:15.887 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:31:16.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:31:16 smithi157 bash[24585]: cluster 2024-09-16T11:31:14.918858+0000 mgr.a (mgr.14373) 15311 : cluster [DBG] pgmap v10620: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:31:16.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:31:16 smithi086 bash[24289]: cluster 2024-09-16T11:31:14.918858+0000 mgr.a (mgr.14373) 15311 : cluster [DBG] pgmap v10620: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:31:16.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:31:16 smithi047 bash[22744]: cluster 2024-09-16T11:31:14.918858+0000 mgr.a (mgr.14373) 15311 : cluster [DBG] pgmap v10620: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:31:17.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:31:17 smithi157 bash[24585]: audit 2024-09-16T11:31:15.437200+0000 mgr.a (mgr.14373) 15312 : audit [DBG] from='client.330834 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:31:17.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:31:17 smithi086 bash[24289]: audit 2024-09-16T11:31:15.437200+0000 mgr.a (mgr.14373) 15312 : audit [DBG] from='client.330834 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:31:17.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:31:17 smithi047 bash[22744]: audit 2024-09-16T11:31:15.437200+0000 mgr.a (mgr.14373) 15312 : audit [DBG] from='client.330834 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:31:18.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:31:18 smithi157 bash[24585]: cluster 2024-09-16T11:31:16.921100+0000 mgr.a (mgr.14373) 15313 : cluster [DBG] pgmap v10621: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:31:18.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:31:18 smithi157 bash[24585]: audit 2024-09-16T11:31:17.750403+0000 mon.b (mon.2) 1394 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T11:31:18.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:31:18 smithi086 bash[24289]: cluster 2024-09-16T11:31:16.921100+0000 mgr.a (mgr.14373) 15313 : cluster [DBG] pgmap v10621: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:31:18.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:31:18 smithi086 bash[24289]: audit 2024-09-16T11:31:17.750403+0000 mon.b (mon.2) 1394 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T11:31:18.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:31:18 smithi047 bash[22744]: cluster 2024-09-16T11:31:16.921100+0000 mgr.a (mgr.14373) 15313 : cluster [DBG] pgmap v10621: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:31:18.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:31:18 smithi047 bash[22744]: audit 2024-09-16T11:31:17.750403+0000 mon.b (mon.2) 1394 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T11:31:19.794 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:31:19 smithi047 bash[22744]: audit 2024-09-16T11:31:18.346653+0000 mon.a (mon.0) 1480 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:31:19.794 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:31:19 smithi047 bash[22744]: audit 2024-09-16T11:31:18.355039+0000 mon.a (mon.0) 1481 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:31:19.795 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:31:19 smithi047 bash[22744]: audit 2024-09-16T11:31:18.359786+0000 mon.a (mon.0) 1482 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:31:19.795 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:31:19 smithi047 bash[22744]: audit 2024-09-16T11:31:18.366684+0000 mon.a (mon.0) 1483 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:31:19.795 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:31:19 smithi047 bash[22744]: cluster 2024-09-16T11:31:18.921842+0000 mgr.a (mgr.14373) 15314 : cluster [DBG] pgmap v10622: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:31:19.795 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:31:19 smithi047 bash[22744]: audit 2024-09-16T11:31:19.027818+0000 mon.b (mon.2) 1395 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T11:31:19.795 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:31:19 smithi047 bash[22744]: audit 2024-09-16T11:31:19.029802+0000 mon.b (mon.2) 1396 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T11:31:19.795 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:31:19 smithi047 bash[22744]: audit 2024-09-16T11:31:19.041141+0000 mon.a (mon.0) 1484 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:31:19.795 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:31:19 smithi047 bash[22744]: audit 2024-09-16T11:31:19.046382+0000 mon.b (mon.2) 1397 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:31:19.795 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:31:19 smithi047 bash[22744]: audit 2024-09-16T11:31:19.049084+0000 mgr.a (mgr.14373) 15315 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:31:19.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:31:19 smithi157 bash[24585]: audit 2024-09-16T11:31:18.346653+0000 mon.a (mon.0) 1480 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:31:19.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:31:19 smithi157 bash[24585]: audit 2024-09-16T11:31:18.355039+0000 mon.a (mon.0) 1481 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:31:19.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:31:19 smithi157 bash[24585]: audit 2024-09-16T11:31:18.359786+0000 mon.a (mon.0) 1482 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:31:19.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:31:19 smithi157 bash[24585]: audit 2024-09-16T11:31:18.366684+0000 mon.a (mon.0) 1483 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:31:19.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:31:19 smithi157 bash[24585]: cluster 2024-09-16T11:31:18.921842+0000 mgr.a (mgr.14373) 15314 : cluster [DBG] pgmap v10622: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:31:19.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:31:19 smithi157 bash[24585]: audit 2024-09-16T11:31:19.027818+0000 mon.b (mon.2) 1395 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T11:31:19.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:31:19 smithi157 bash[24585]: audit 2024-09-16T11:31:19.029802+0000 mon.b (mon.2) 1396 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T11:31:19.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:31:19 smithi157 bash[24585]: audit 2024-09-16T11:31:19.041141+0000 mon.a (mon.0) 1484 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:31:19.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:31:19 smithi157 bash[24585]: audit 2024-09-16T11:31:19.046382+0000 mon.b (mon.2) 1397 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:31:19.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:31:19 smithi157 bash[24585]: audit 2024-09-16T11:31:19.049084+0000 mgr.a (mgr.14373) 15315 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:31:19.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:31:19 smithi086 bash[24289]: audit 2024-09-16T11:31:18.346653+0000 mon.a (mon.0) 1480 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:31:19.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:31:19 smithi086 bash[24289]: audit 2024-09-16T11:31:18.355039+0000 mon.a (mon.0) 1481 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:31:19.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:31:19 smithi086 bash[24289]: audit 2024-09-16T11:31:18.359786+0000 mon.a (mon.0) 1482 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:31:19.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:31:19 smithi086 bash[24289]: audit 2024-09-16T11:31:18.366684+0000 mon.a (mon.0) 1483 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:31:19.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:31:19 smithi086 bash[24289]: cluster 2024-09-16T11:31:18.921842+0000 mgr.a (mgr.14373) 15314 : cluster [DBG] pgmap v10622: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:31:19.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:31:19 smithi086 bash[24289]: audit 2024-09-16T11:31:19.027818+0000 mon.b (mon.2) 1395 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T11:31:19.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:31:19 smithi086 bash[24289]: audit 2024-09-16T11:31:19.029802+0000 mon.b (mon.2) 1396 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T11:31:19.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:31:19 smithi086 bash[24289]: audit 2024-09-16T11:31:19.041141+0000 mon.a (mon.0) 1484 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:31:19.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:31:19 smithi086 bash[24289]: audit 2024-09-16T11:31:19.046382+0000 mon.b (mon.2) 1397 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:31:19.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:31:19 smithi086 bash[24289]: audit 2024-09-16T11:31:19.049084+0000 mgr.a (mgr.14373) 15315 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:31:20.092 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 11:31:19 smithi047 bash[22994]: debug 2024-09-16T11:31:19.787+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T11:31:20.092 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 11:31:19 smithi047 bash[22994]: debug 2024-09-16T11:31:19.791+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T11:31:20.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:31:20 smithi157 bash[24585]: audit 2024-09-16T11:31:19.793420+0000 mgr.a (mgr.14373) 15316 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T11:31:20.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:31:20 smithi157 bash[24585]: cephadm 2024-09-16T11:31:19.795438+0000 mgr.a (mgr.14373) 15317 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T11:31:20.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:31:20 smithi086 bash[24289]: audit 2024-09-16T11:31:19.793420+0000 mgr.a (mgr.14373) 15316 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T11:31:20.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:31:20 smithi086 bash[24289]: cephadm 2024-09-16T11:31:19.795438+0000 mgr.a (mgr.14373) 15317 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T11:31:20.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:31:20 smithi047 bash[22744]: audit 2024-09-16T11:31:19.793420+0000 mgr.a (mgr.14373) 15316 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T11:31:20.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:31:20 smithi047 bash[22744]: cephadm 2024-09-16T11:31:19.795438+0000 mgr.a (mgr.14373) 15317 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T11:31:20.887 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:31:20.888 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:31:20.889 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:31:21.673 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:31:21.673 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:31:21.673 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:31:21.674 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:31:21.674 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:31:21.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:31:21 smithi157 bash[24585]: cluster 2024-09-16T11:31:20.922752+0000 mgr.a (mgr.14373) 15318 : cluster [DBG] pgmap v10623: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:31:21.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:31:21 smithi157 bash[24585]: audit 2024-09-16T11:31:21.228573+0000 mgr.a (mgr.14373) 15319 : audit [DBG] from='client.331020 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:31:21.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:31:21 smithi086 bash[24289]: cluster 2024-09-16T11:31:20.922752+0000 mgr.a (mgr.14373) 15318 : cluster [DBG] pgmap v10623: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:31:21.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:31:21 smithi086 bash[24289]: audit 2024-09-16T11:31:21.228573+0000 mgr.a (mgr.14373) 15319 : audit [DBG] from='client.331020 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:31:21.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:31:21 smithi047 bash[22744]: cluster 2024-09-16T11:31:20.922752+0000 mgr.a (mgr.14373) 15318 : cluster [DBG] pgmap v10623: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:31:21.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:31:21 smithi047 bash[22744]: audit 2024-09-16T11:31:21.228573+0000 mgr.a (mgr.14373) 15319 : audit [DBG] from='client.331020 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:31:24.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:31:23 smithi157 bash[24585]: cluster 2024-09-16T11:31:22.925101+0000 mgr.a (mgr.14373) 15320 : cluster [DBG] pgmap v10624: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:31:24.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:31:23 smithi086 bash[24289]: cluster 2024-09-16T11:31:22.925101+0000 mgr.a (mgr.14373) 15320 : cluster [DBG] pgmap v10624: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:31:24.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:31:23 smithi047 bash[22744]: cluster 2024-09-16T11:31:22.925101+0000 mgr.a (mgr.14373) 15320 : cluster [DBG] pgmap v10624: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:31:26.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:31:25 smithi157 bash[24585]: cluster 2024-09-16T11:31:24.925890+0000 mgr.a (mgr.14373) 15321 : cluster [DBG] pgmap v10625: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T11:31:26.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:31:25 smithi086 bash[24289]: cluster 2024-09-16T11:31:24.925890+0000 mgr.a (mgr.14373) 15321 : cluster [DBG] pgmap v10625: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T11:31:26.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:31:25 smithi047 bash[22744]: cluster 2024-09-16T11:31:24.925890+0000 mgr.a (mgr.14373) 15321 : cluster [DBG] pgmap v10625: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T11:31:26.675 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:31:26.675 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:31:26.676 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:31:27.438 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:31:27.438 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:31:27.438 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:31:27.438 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:31:27.438 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:31:28.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:31:27 smithi157 bash[24585]: cluster 2024-09-16T11:31:26.927849+0000 mgr.a (mgr.14373) 15322 : cluster [DBG] pgmap v10626: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:31:28.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:31:27 smithi157 bash[24585]: audit 2024-09-16T11:31:27.012794+0000 mgr.a (mgr.14373) 15323 : audit [DBG] from='client.331095 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:31:28.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:31:27 smithi086 bash[24289]: cluster 2024-09-16T11:31:26.927849+0000 mgr.a (mgr.14373) 15322 : cluster [DBG] pgmap v10626: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:31:28.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:31:27 smithi086 bash[24289]: audit 2024-09-16T11:31:27.012794+0000 mgr.a (mgr.14373) 15323 : audit [DBG] from='client.331095 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:31:28.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:31:27 smithi047 bash[22744]: cluster 2024-09-16T11:31:26.927849+0000 mgr.a (mgr.14373) 15322 : cluster [DBG] pgmap v10626: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:31:28.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:31:27 smithi047 bash[22744]: audit 2024-09-16T11:31:27.012794+0000 mgr.a (mgr.14373) 15323 : audit [DBG] from='client.331095 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:31:30.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:31:30 smithi157 bash[24585]: cluster 2024-09-16T11:31:28.928739+0000 mgr.a (mgr.14373) 15324 : cluster [DBG] pgmap v10627: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T11:31:30.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:31:30 smithi086 bash[24289]: cluster 2024-09-16T11:31:28.928739+0000 mgr.a (mgr.14373) 15324 : cluster [DBG] pgmap v10627: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T11:31:30.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:31:30 smithi047 bash[22744]: cluster 2024-09-16T11:31:28.928739+0000 mgr.a (mgr.14373) 15324 : cluster [DBG] pgmap v10627: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T11:31:32.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:31:32 smithi157 bash[24585]: cluster 2024-09-16T11:31:30.929510+0000 mgr.a (mgr.14373) 15325 : cluster [DBG] pgmap v10628: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T11:31:32.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:31:32 smithi086 bash[24289]: cluster 2024-09-16T11:31:30.929510+0000 mgr.a (mgr.14373) 15325 : cluster [DBG] pgmap v10628: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T11:31:32.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:31:32 smithi047 bash[22744]: cluster 2024-09-16T11:31:30.929510+0000 mgr.a (mgr.14373) 15325 : cluster [DBG] pgmap v10628: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T11:31:32.439 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:31:32.440 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:31:32.440 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:31:33.219 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:31:33.219 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:31:33.219 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:31:33.219 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:31:33.219 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:31:34.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:31:34 smithi157 bash[24585]: audit 2024-09-16T11:31:32.773090+0000 mgr.a (mgr.14373) 15326 : audit [DBG] from='client.331173 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:31:34.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:31:34 smithi157 bash[24585]: cluster 2024-09-16T11:31:32.931258+0000 mgr.a (mgr.14373) 15327 : cluster [DBG] pgmap v10629: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:31:34.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:31:34 smithi086 bash[24289]: audit 2024-09-16T11:31:32.773090+0000 mgr.a (mgr.14373) 15326 : audit [DBG] from='client.331173 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:31:34.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:31:34 smithi086 bash[24289]: cluster 2024-09-16T11:31:32.931258+0000 mgr.a (mgr.14373) 15327 : cluster [DBG] pgmap v10629: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:31:34.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:31:34 smithi047 bash[22744]: audit 2024-09-16T11:31:32.773090+0000 mgr.a (mgr.14373) 15326 : audit [DBG] from='client.331173 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:31:34.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:31:34 smithi047 bash[22744]: cluster 2024-09-16T11:31:32.931258+0000 mgr.a (mgr.14373) 15327 : cluster [DBG] pgmap v10629: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:31:36.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:31:36 smithi157 bash[24585]: cluster 2024-09-16T11:31:34.932276+0000 mgr.a (mgr.14373) 15328 : cluster [DBG] pgmap v10630: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-16T11:31:36.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:31:36 smithi086 bash[24289]: cluster 2024-09-16T11:31:34.932276+0000 mgr.a (mgr.14373) 15328 : cluster [DBG] pgmap v10630: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-16T11:31:36.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:31:36 smithi047 bash[22744]: cluster 2024-09-16T11:31:34.932276+0000 mgr.a (mgr.14373) 15328 : cluster [DBG] pgmap v10630: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-16T11:31:38.220 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:31:38.221 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:31:38.221 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:31:38.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:31:38 smithi157 bash[24585]: cluster 2024-09-16T11:31:36.934640+0000 mgr.a (mgr.14373) 15329 : cluster [DBG] pgmap v10631: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-16T11:31:38.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:31:38 smithi086 bash[24289]: cluster 2024-09-16T11:31:36.934640+0000 mgr.a (mgr.14373) 15329 : cluster [DBG] pgmap v10631: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-16T11:31:38.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:31:38 smithi047 bash[22744]: cluster 2024-09-16T11:31:36.934640+0000 mgr.a (mgr.14373) 15329 : cluster [DBG] pgmap v10631: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-16T11:31:39.009 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:31:39.010 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:31:39.010 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:31:39.010 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:31:39.010 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:31:40.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:31:40 smithi157 bash[24585]: audit 2024-09-16T11:31:38.552738+0000 mgr.a (mgr.14373) 15330 : audit [DBG] from='client.331248 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:31:40.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:31:40 smithi157 bash[24585]: cluster 2024-09-16T11:31:38.935193+0000 mgr.a (mgr.14373) 15331 : cluster [DBG] pgmap v10632: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:31:40.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:31:40 smithi086 bash[24289]: audit 2024-09-16T11:31:38.552738+0000 mgr.a (mgr.14373) 15330 : audit [DBG] from='client.331248 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:31:40.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:31:40 smithi086 bash[24289]: cluster 2024-09-16T11:31:38.935193+0000 mgr.a (mgr.14373) 15331 : cluster [DBG] pgmap v10632: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:31:40.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:31:40 smithi047 bash[22744]: audit 2024-09-16T11:31:38.552738+0000 mgr.a (mgr.14373) 15330 : audit [DBG] from='client.331248 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:31:40.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:31:40 smithi047 bash[22744]: cluster 2024-09-16T11:31:38.935193+0000 mgr.a (mgr.14373) 15331 : cluster [DBG] pgmap v10632: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:31:42.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:31:42 smithi157 bash[24585]: cluster 2024-09-16T11:31:40.935918+0000 mgr.a (mgr.14373) 15332 : cluster [DBG] pgmap v10633: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:31:42.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:31:42 smithi086 bash[24289]: cluster 2024-09-16T11:31:40.935918+0000 mgr.a (mgr.14373) 15332 : cluster [DBG] pgmap v10633: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:31:42.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:31:42 smithi047 bash[22744]: cluster 2024-09-16T11:31:40.935918+0000 mgr.a (mgr.14373) 15332 : cluster [DBG] pgmap v10633: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:31:44.011 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:31:44.012 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:31:44.012 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:31:44.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:31:44 smithi157 bash[24585]: cluster 2024-09-16T11:31:42.938325+0000 mgr.a (mgr.14373) 15333 : cluster [DBG] pgmap v10634: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:31:44.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:31:44 smithi086 bash[24289]: cluster 2024-09-16T11:31:42.938325+0000 mgr.a (mgr.14373) 15333 : cluster [DBG] pgmap v10634: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:31:44.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:31:44 smithi047 bash[22744]: cluster 2024-09-16T11:31:42.938325+0000 mgr.a (mgr.14373) 15333 : cluster [DBG] pgmap v10634: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:31:44.792 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:31:44.792 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:31:44.792 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:31:44.792 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:31:44.792 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:31:46.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:31:46 smithi157 bash[24585]: audit 2024-09-16T11:31:44.349445+0000 mgr.a (mgr.14373) 15334 : audit [DBG] from='client.331323 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:31:46.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:31:46 smithi157 bash[24585]: cluster 2024-09-16T11:31:44.939441+0000 mgr.a (mgr.14373) 15335 : cluster [DBG] pgmap v10635: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:31:46.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:31:46 smithi086 bash[24289]: audit 2024-09-16T11:31:44.349445+0000 mgr.a (mgr.14373) 15334 : audit [DBG] from='client.331323 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:31:46.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:31:46 smithi086 bash[24289]: cluster 2024-09-16T11:31:44.939441+0000 mgr.a (mgr.14373) 15335 : cluster [DBG] pgmap v10635: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:31:46.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:31:46 smithi047 bash[22744]: audit 2024-09-16T11:31:44.349445+0000 mgr.a (mgr.14373) 15334 : audit [DBG] from='client.331323 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:31:46.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:31:46 smithi047 bash[22744]: cluster 2024-09-16T11:31:44.939441+0000 mgr.a (mgr.14373) 15335 : cluster [DBG] pgmap v10635: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:31:48.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:31:48 smithi157 bash[24585]: cluster 2024-09-16T11:31:46.941784+0000 mgr.a (mgr.14373) 15336 : cluster [DBG] pgmap v10636: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:31:48.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:31:48 smithi086 bash[24289]: cluster 2024-09-16T11:31:46.941784+0000 mgr.a (mgr.14373) 15336 : cluster [DBG] pgmap v10636: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:31:48.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:31:48 smithi047 bash[22744]: cluster 2024-09-16T11:31:46.941784+0000 mgr.a (mgr.14373) 15336 : cluster [DBG] pgmap v10636: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:31:49.796 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:31:49.796 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:31:49.796 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:31:50.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:31:50 smithi157 bash[24585]: cluster 2024-09-16T11:31:48.942590+0000 mgr.a (mgr.14373) 15337 : cluster [DBG] pgmap v10637: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:31:50.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:31:50 smithi086 bash[24289]: cluster 2024-09-16T11:31:48.942590+0000 mgr.a (mgr.14373) 15337 : cluster [DBG] pgmap v10637: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:31:50.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:31:50 smithi047 bash[22744]: cluster 2024-09-16T11:31:48.942590+0000 mgr.a (mgr.14373) 15337 : cluster [DBG] pgmap v10637: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:31:50.562 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:31:50.562 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:31:50.562 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:31:50.562 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:31:50.562 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:31:51.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:31:51 smithi157 bash[24585]: audit 2024-09-16T11:31:50.126979+0000 mgr.a (mgr.14373) 15338 : audit [DBG] from='client.331398 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:31:51.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:31:51 smithi086 bash[24289]: audit 2024-09-16T11:31:50.126979+0000 mgr.a (mgr.14373) 15338 : audit [DBG] from='client.331398 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:31:51.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:31:51 smithi047 bash[22744]: audit 2024-09-16T11:31:50.126979+0000 mgr.a (mgr.14373) 15338 : audit [DBG] from='client.331398 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:31:52.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:31:52 smithi086 bash[24289]: cluster 2024-09-16T11:31:50.943460+0000 mgr.a (mgr.14373) 15339 : cluster [DBG] pgmap v10638: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:31:52.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:31:52 smithi047 bash[22744]: cluster 2024-09-16T11:31:50.943460+0000 mgr.a (mgr.14373) 15339 : cluster [DBG] pgmap v10638: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:31:52.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:31:52 smithi157 bash[24585]: cluster 2024-09-16T11:31:50.943460+0000 mgr.a (mgr.14373) 15339 : cluster [DBG] pgmap v10638: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:31:54.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:31:54 smithi086 bash[24289]: cluster 2024-09-16T11:31:52.945682+0000 mgr.a (mgr.14373) 15340 : cluster [DBG] pgmap v10639: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:31:54.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:31:54 smithi047 bash[22744]: cluster 2024-09-16T11:31:52.945682+0000 mgr.a (mgr.14373) 15340 : cluster [DBG] pgmap v10639: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:31:54.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:31:54 smithi157 bash[24585]: cluster 2024-09-16T11:31:52.945682+0000 mgr.a (mgr.14373) 15340 : cluster [DBG] pgmap v10639: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:31:55.564 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:31:55.564 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:31:55.564 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:31:56.319 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:31:56.320 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:31:56.320 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:31:56.320 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:31:56.320 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:31:56.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:31:56 smithi086 bash[24289]: cluster 2024-09-16T11:31:54.946470+0000 mgr.a (mgr.14373) 15341 : cluster [DBG] pgmap v10640: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:31:56.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:31:56 smithi047 bash[22744]: cluster 2024-09-16T11:31:54.946470+0000 mgr.a (mgr.14373) 15341 : cluster [DBG] pgmap v10640: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:31:56.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:31:56 smithi157 bash[24585]: cluster 2024-09-16T11:31:54.946470+0000 mgr.a (mgr.14373) 15341 : cluster [DBG] pgmap v10640: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:31:57.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:31:57 smithi047 bash[22744]: audit 2024-09-16T11:31:55.895836+0000 mgr.a (mgr.14373) 15342 : audit [DBG] from='client.331476 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:31:57.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:31:57 smithi157 bash[24585]: audit 2024-09-16T11:31:55.895836+0000 mgr.a (mgr.14373) 15342 : audit [DBG] from='client.331476 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:31:57.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:31:57 smithi086 bash[24289]: audit 2024-09-16T11:31:55.895836+0000 mgr.a (mgr.14373) 15342 : audit [DBG] from='client.331476 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:31:58.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:31:58 smithi047 bash[22744]: cluster 2024-09-16T11:31:56.948691+0000 mgr.a (mgr.14373) 15343 : cluster [DBG] pgmap v10641: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:31:58.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:31:58 smithi157 bash[24585]: cluster 2024-09-16T11:31:56.948691+0000 mgr.a (mgr.14373) 15343 : cluster [DBG] pgmap v10641: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:31:58.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:31:58 smithi086 bash[24289]: cluster 2024-09-16T11:31:56.948691+0000 mgr.a (mgr.14373) 15343 : cluster [DBG] pgmap v10641: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:32:00.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:32:00 smithi047 bash[22744]: cluster 2024-09-16T11:31:58.949391+0000 mgr.a (mgr.14373) 15344 : cluster [DBG] pgmap v10642: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:32:00.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:32:00 smithi157 bash[24585]: cluster 2024-09-16T11:31:58.949391+0000 mgr.a (mgr.14373) 15344 : cluster [DBG] pgmap v10642: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:32:00.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:32:00 smithi086 bash[24289]: cluster 2024-09-16T11:31:58.949391+0000 mgr.a (mgr.14373) 15344 : cluster [DBG] pgmap v10642: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:32:01.322 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:32:01.322 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:32:01.322 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:32:02.085 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:32:02.085 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:32:02.085 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:32:02.085 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:32:02.085 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:32:02.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:32:02 smithi047 bash[22744]: cluster 2024-09-16T11:32:00.950123+0000 mgr.a (mgr.14373) 15345 : cluster [DBG] pgmap v10643: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:32:02.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:32:02 smithi157 bash[24585]: cluster 2024-09-16T11:32:00.950123+0000 mgr.a (mgr.14373) 15345 : cluster [DBG] pgmap v10643: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:32:02.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:32:02 smithi086 bash[24289]: cluster 2024-09-16T11:32:00.950123+0000 mgr.a (mgr.14373) 15345 : cluster [DBG] pgmap v10643: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:32:03.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:32:03 smithi157 bash[24585]: audit 2024-09-16T11:32:01.652703+0000 mgr.a (mgr.14373) 15346 : audit [DBG] from='client.331554 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:32:03.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:32:03 smithi086 bash[24289]: audit 2024-09-16T11:32:01.652703+0000 mgr.a (mgr.14373) 15346 : audit [DBG] from='client.331554 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:32:03.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:32:03 smithi047 bash[22744]: audit 2024-09-16T11:32:01.652703+0000 mgr.a (mgr.14373) 15346 : audit [DBG] from='client.331554 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:32:04.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:32:04 smithi157 bash[24585]: cluster 2024-09-16T11:32:02.952881+0000 mgr.a (mgr.14373) 15347 : cluster [DBG] pgmap v10644: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:32:04.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:32:04 smithi086 bash[24289]: cluster 2024-09-16T11:32:02.952881+0000 mgr.a (mgr.14373) 15347 : cluster [DBG] pgmap v10644: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:32:04.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:32:04 smithi047 bash[22744]: cluster 2024-09-16T11:32:02.952881+0000 mgr.a (mgr.14373) 15347 : cluster [DBG] pgmap v10644: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:32:06.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:32:06 smithi157 bash[24585]: cluster 2024-09-16T11:32:04.953649+0000 mgr.a (mgr.14373) 15348 : cluster [DBG] pgmap v10645: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:32:06.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:32:06 smithi086 bash[24289]: cluster 2024-09-16T11:32:04.953649+0000 mgr.a (mgr.14373) 15348 : cluster [DBG] pgmap v10645: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:32:06.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:32:06 smithi047 bash[22744]: cluster 2024-09-16T11:32:04.953649+0000 mgr.a (mgr.14373) 15348 : cluster [DBG] pgmap v10645: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:32:07.086 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:32:07.087 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:32:07.087 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:32:07.833 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:32:07.833 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:32:07.833 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:32:07.834 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:32:07.834 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:32:08.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:32:08 smithi157 bash[24585]: cluster 2024-09-16T11:32:06.955653+0000 mgr.a (mgr.14373) 15349 : cluster [DBG] pgmap v10646: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:32:08.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:32:08 smithi086 bash[24289]: cluster 2024-09-16T11:32:06.955653+0000 mgr.a (mgr.14373) 15349 : cluster [DBG] pgmap v10646: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:32:08.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:32:08 smithi047 bash[22744]: cluster 2024-09-16T11:32:06.955653+0000 mgr.a (mgr.14373) 15349 : cluster [DBG] pgmap v10646: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:32:09.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:32:09 smithi157 bash[24585]: audit 2024-09-16T11:32:07.416585+0000 mgr.a (mgr.14373) 15350 : audit [DBG] from='client.331632 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:32:09.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:32:09 smithi086 bash[24289]: audit 2024-09-16T11:32:07.416585+0000 mgr.a (mgr.14373) 15350 : audit [DBG] from='client.331632 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:32:09.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:32:09 smithi047 bash[22744]: audit 2024-09-16T11:32:07.416585+0000 mgr.a (mgr.14373) 15350 : audit [DBG] from='client.331632 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:32:10.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:32:10 smithi157 bash[24585]: cluster 2024-09-16T11:32:08.956533+0000 mgr.a (mgr.14373) 15351 : cluster [DBG] pgmap v10647: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:32:10.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:32:10 smithi086 bash[24289]: cluster 2024-09-16T11:32:08.956533+0000 mgr.a (mgr.14373) 15351 : cluster [DBG] pgmap v10647: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:32:10.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:32:10 smithi047 bash[22744]: cluster 2024-09-16T11:32:08.956533+0000 mgr.a (mgr.14373) 15351 : cluster [DBG] pgmap v10647: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:32:12.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:32:12 smithi157 bash[24585]: cluster 2024-09-16T11:32:10.957304+0000 mgr.a (mgr.14373) 15352 : cluster [DBG] pgmap v10648: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T11:32:12.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:32:12 smithi086 bash[24289]: cluster 2024-09-16T11:32:10.957304+0000 mgr.a (mgr.14373) 15352 : cluster [DBG] pgmap v10648: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T11:32:12.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:32:12 smithi047 bash[22744]: cluster 2024-09-16T11:32:10.957304+0000 mgr.a (mgr.14373) 15352 : cluster [DBG] pgmap v10648: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T11:32:12.835 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:32:12.836 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:32:12.836 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:32:13.614 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:32:13.615 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:32:13.615 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:32:13.615 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:32:13.615 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:32:14.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:32:14 smithi157 bash[24585]: cluster 2024-09-16T11:32:12.958481+0000 mgr.a (mgr.14373) 15353 : cluster [DBG] pgmap v10649: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:32:14.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:32:14 smithi157 bash[24585]: audit 2024-09-16T11:32:13.171182+0000 mgr.a (mgr.14373) 15354 : audit [DBG] from='client.331710 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:32:14.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:32:14 smithi086 bash[24289]: cluster 2024-09-16T11:32:12.958481+0000 mgr.a (mgr.14373) 15353 : cluster [DBG] pgmap v10649: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:32:14.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:32:14 smithi086 bash[24289]: audit 2024-09-16T11:32:13.171182+0000 mgr.a (mgr.14373) 15354 : audit [DBG] from='client.331710 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:32:14.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:32:14 smithi047 bash[22744]: cluster 2024-09-16T11:32:12.958481+0000 mgr.a (mgr.14373) 15353 : cluster [DBG] pgmap v10649: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:32:14.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:32:14 smithi047 bash[22744]: audit 2024-09-16T11:32:13.171182+0000 mgr.a (mgr.14373) 15354 : audit [DBG] from='client.331710 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:32:16.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:32:16 smithi157 bash[24585]: cluster 2024-09-16T11:32:14.959273+0000 mgr.a (mgr.14373) 15355 : cluster [DBG] pgmap v10650: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:32:16.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:32:16 smithi086 bash[24289]: cluster 2024-09-16T11:32:14.959273+0000 mgr.a (mgr.14373) 15355 : cluster [DBG] pgmap v10650: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:32:16.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:32:16 smithi047 bash[22744]: cluster 2024-09-16T11:32:14.959273+0000 mgr.a (mgr.14373) 15355 : cluster [DBG] pgmap v10650: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:32:18.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:32:18 smithi157 bash[24585]: cluster 2024-09-16T11:32:16.961497+0000 mgr.a (mgr.14373) 15356 : cluster [DBG] pgmap v10651: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:32:18.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:32:18 smithi086 bash[24289]: cluster 2024-09-16T11:32:16.961497+0000 mgr.a (mgr.14373) 15356 : cluster [DBG] pgmap v10651: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:32:18.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:32:18 smithi047 bash[22744]: cluster 2024-09-16T11:32:16.961497+0000 mgr.a (mgr.14373) 15356 : cluster [DBG] pgmap v10651: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:32:18.616 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:32:18.617 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:32:18.617 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:32:19.401 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:32:19.401 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:32:19.402 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:32:19.402 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:32:19.402 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:32:20.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:32:20 smithi157 bash[24585]: audit 2024-09-16T11:32:18.954742+0000 mgr.a (mgr.14373) 15357 : audit [DBG] from='client.331785 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:32:20.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:32:20 smithi157 bash[24585]: cluster 2024-09-16T11:32:18.972540+0000 mgr.a (mgr.14373) 15358 : cluster [DBG] pgmap v10652: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:32:20.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:32:20 smithi157 bash[24585]: audit 2024-09-16T11:32:19.846182+0000 mon.b (mon.2) 1398 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T11:32:20.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:32:20 smithi086 bash[24289]: audit 2024-09-16T11:32:18.954742+0000 mgr.a (mgr.14373) 15357 : audit [DBG] from='client.331785 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:32:20.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:32:20 smithi086 bash[24289]: cluster 2024-09-16T11:32:18.972540+0000 mgr.a (mgr.14373) 15358 : cluster [DBG] pgmap v10652: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:32:20.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:32:20 smithi086 bash[24289]: audit 2024-09-16T11:32:19.846182+0000 mon.b (mon.2) 1398 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T11:32:20.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:32:20 smithi047 bash[22744]: audit 2024-09-16T11:32:18.954742+0000 mgr.a (mgr.14373) 15357 : audit [DBG] from='client.331785 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:32:20.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:32:20 smithi047 bash[22744]: cluster 2024-09-16T11:32:18.972540+0000 mgr.a (mgr.14373) 15358 : cluster [DBG] pgmap v10652: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:32:20.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:32:20 smithi047 bash[22744]: audit 2024-09-16T11:32:19.846182+0000 mon.b (mon.2) 1398 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T11:32:21.448 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:32:21 smithi047 bash[22744]: audit 2024-09-16T11:32:20.681438+0000 mon.b (mon.2) 1399 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T11:32:21.449 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:32:21 smithi047 bash[22744]: audit 2024-09-16T11:32:20.683710+0000 mon.b (mon.2) 1400 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T11:32:21.449 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:32:21 smithi047 bash[22744]: audit 2024-09-16T11:32:20.696155+0000 mon.a (mon.0) 1485 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:32:21.449 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:32:21 smithi047 bash[22744]: audit 2024-09-16T11:32:20.701101+0000 mon.b (mon.2) 1401 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:32:21.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:32:21 smithi157 bash[24585]: audit 2024-09-16T11:32:20.681438+0000 mon.b (mon.2) 1399 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T11:32:21.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:32:21 smithi157 bash[24585]: audit 2024-09-16T11:32:20.683710+0000 mon.b (mon.2) 1400 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T11:32:21.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:32:21 smithi157 bash[24585]: audit 2024-09-16T11:32:20.696155+0000 mon.a (mon.0) 1485 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:32:21.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:32:21 smithi157 bash[24585]: audit 2024-09-16T11:32:20.701101+0000 mon.b (mon.2) 1401 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:32:21.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:32:21 smithi086 bash[24289]: audit 2024-09-16T11:32:20.681438+0000 mon.b (mon.2) 1399 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T11:32:21.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:32:21 smithi086 bash[24289]: audit 2024-09-16T11:32:20.683710+0000 mon.b (mon.2) 1400 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T11:32:21.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:32:21 smithi086 bash[24289]: audit 2024-09-16T11:32:20.696155+0000 mon.a (mon.0) 1485 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:32:21.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:32:21 smithi086 bash[24289]: audit 2024-09-16T11:32:20.701101+0000 mon.b (mon.2) 1401 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:32:21.842 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 11:32:21 smithi047 bash[22994]: debug 2024-09-16T11:32:21.445+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T11:32:21.842 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 11:32:21 smithi047 bash[22994]: debug 2024-09-16T11:32:21.445+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T11:32:22.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:32:22 smithi157 bash[24585]: audit 2024-09-16T11:32:20.704330+0000 mgr.a (mgr.14373) 15359 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:32:22.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:32:22 smithi157 bash[24585]: cluster 2024-09-16T11:32:20.973190+0000 mgr.a (mgr.14373) 15360 : cluster [DBG] pgmap v10653: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:32:22.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:32:22 smithi086 bash[24289]: audit 2024-09-16T11:32:20.704330+0000 mgr.a (mgr.14373) 15359 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:32:22.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:32:22 smithi086 bash[24289]: cluster 2024-09-16T11:32:20.973190+0000 mgr.a (mgr.14373) 15360 : cluster [DBG] pgmap v10653: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:32:22.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:32:22 smithi047 bash[22744]: audit 2024-09-16T11:32:20.704330+0000 mgr.a (mgr.14373) 15359 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:32:22.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:32:22 smithi047 bash[22744]: cluster 2024-09-16T11:32:20.973190+0000 mgr.a (mgr.14373) 15360 : cluster [DBG] pgmap v10653: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:32:23.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:32:23 smithi157 bash[24585]: audit 2024-09-16T11:32:21.447140+0000 mgr.a (mgr.14373) 15361 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T11:32:23.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:32:23 smithi157 bash[24585]: cephadm 2024-09-16T11:32:21.449322+0000 mgr.a (mgr.14373) 15362 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T11:32:23.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:32:23 smithi086 bash[24289]: audit 2024-09-16T11:32:21.447140+0000 mgr.a (mgr.14373) 15361 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T11:32:23.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:32:23 smithi086 bash[24289]: cephadm 2024-09-16T11:32:21.449322+0000 mgr.a (mgr.14373) 15362 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T11:32:23.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:32:23 smithi047 bash[22744]: audit 2024-09-16T11:32:21.447140+0000 mgr.a (mgr.14373) 15361 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T11:32:23.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:32:23 smithi047 bash[22744]: cephadm 2024-09-16T11:32:21.449322+0000 mgr.a (mgr.14373) 15362 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T11:32:24.403 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:32:24.403 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:32:24.404 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:32:24.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:32:24 smithi157 bash[24585]: cluster 2024-09-16T11:32:22.975634+0000 mgr.a (mgr.14373) 15363 : cluster [DBG] pgmap v10654: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:32:24.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:32:24 smithi086 bash[24289]: cluster 2024-09-16T11:32:22.975634+0000 mgr.a (mgr.14373) 15363 : cluster [DBG] pgmap v10654: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:32:24.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:32:24 smithi047 bash[22744]: cluster 2024-09-16T11:32:22.975634+0000 mgr.a (mgr.14373) 15363 : cluster [DBG] pgmap v10654: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:32:25.156 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:32:25.156 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:32:25.157 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:32:25.157 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:32:25.157 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:32:26.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:32:26 smithi157 bash[24585]: audit 2024-09-16T11:32:24.733597+0000 mgr.a (mgr.14373) 15364 : audit [DBG] from='client.331968 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:32:26.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:32:26 smithi157 bash[24585]: cluster 2024-09-16T11:32:24.976233+0000 mgr.a (mgr.14373) 15365 : cluster [DBG] pgmap v10655: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:32:26.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:32:26 smithi086 bash[24289]: audit 2024-09-16T11:32:24.733597+0000 mgr.a (mgr.14373) 15364 : audit [DBG] from='client.331968 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:32:26.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:32:26 smithi086 bash[24289]: cluster 2024-09-16T11:32:24.976233+0000 mgr.a (mgr.14373) 15365 : cluster [DBG] pgmap v10655: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:32:26.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:32:26 smithi047 bash[22744]: audit 2024-09-16T11:32:24.733597+0000 mgr.a (mgr.14373) 15364 : audit [DBG] from='client.331968 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:32:26.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:32:26 smithi047 bash[22744]: cluster 2024-09-16T11:32:24.976233+0000 mgr.a (mgr.14373) 15365 : cluster [DBG] pgmap v10655: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:32:28.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:32:28 smithi157 bash[24585]: cluster 2024-09-16T11:32:26.978499+0000 mgr.a (mgr.14373) 15366 : cluster [DBG] pgmap v10656: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:32:28.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:32:28 smithi086 bash[24289]: cluster 2024-09-16T11:32:26.978499+0000 mgr.a (mgr.14373) 15366 : cluster [DBG] pgmap v10656: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:32:28.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:32:28 smithi047 bash[22744]: cluster 2024-09-16T11:32:26.978499+0000 mgr.a (mgr.14373) 15366 : cluster [DBG] pgmap v10656: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:32:30.157 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:32:30.158 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:32:30.158 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:32:30.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:32:30 smithi157 bash[24585]: cluster 2024-09-16T11:32:28.979271+0000 mgr.a (mgr.14373) 15367 : cluster [DBG] pgmap v10657: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 425 B/s wr, 7 op/s 2024-09-16T11:32:30.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:32:30 smithi086 bash[24289]: cluster 2024-09-16T11:32:28.979271+0000 mgr.a (mgr.14373) 15367 : cluster [DBG] pgmap v10657: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 425 B/s wr, 7 op/s 2024-09-16T11:32:30.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:32:30 smithi047 bash[22744]: cluster 2024-09-16T11:32:28.979271+0000 mgr.a (mgr.14373) 15367 : cluster [DBG] pgmap v10657: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 425 B/s wr, 7 op/s 2024-09-16T11:32:30.913 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:32:30.914 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:32:30.914 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:32:30.914 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:32:30.914 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:32:32.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:32:32 smithi157 bash[24585]: audit 2024-09-16T11:32:30.492796+0000 mgr.a (mgr.14373) 15368 : audit [DBG] from='client.332046 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:32:32.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:32:32 smithi157 bash[24585]: cluster 2024-09-16T11:32:30.980113+0000 mgr.a (mgr.14373) 15369 : cluster [DBG] pgmap v10658: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:32:32.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:32:32 smithi086 bash[24289]: audit 2024-09-16T11:32:30.492796+0000 mgr.a (mgr.14373) 15368 : audit [DBG] from='client.332046 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:32:32.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:32:32 smithi086 bash[24289]: cluster 2024-09-16T11:32:30.980113+0000 mgr.a (mgr.14373) 15369 : cluster [DBG] pgmap v10658: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:32:32.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:32:32 smithi047 bash[22744]: audit 2024-09-16T11:32:30.492796+0000 mgr.a (mgr.14373) 15368 : audit [DBG] from='client.332046 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:32:32.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:32:32 smithi047 bash[22744]: cluster 2024-09-16T11:32:30.980113+0000 mgr.a (mgr.14373) 15369 : cluster [DBG] pgmap v10658: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:32:34.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:32:34 smithi157 bash[24585]: cluster 2024-09-16T11:32:32.982447+0000 mgr.a (mgr.14373) 15370 : cluster [DBG] pgmap v10659: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:32:34.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:32:34 smithi086 bash[24289]: cluster 2024-09-16T11:32:32.982447+0000 mgr.a (mgr.14373) 15370 : cluster [DBG] pgmap v10659: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:32:34.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:32:34 smithi047 bash[22744]: cluster 2024-09-16T11:32:32.982447+0000 mgr.a (mgr.14373) 15370 : cluster [DBG] pgmap v10659: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:32:35.915 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:32:35.916 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:32:35.916 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:32:36.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:32:36 smithi157 bash[24585]: cluster 2024-09-16T11:32:34.983210+0000 mgr.a (mgr.14373) 15371 : cluster [DBG] pgmap v10660: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:32:36.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:32:36 smithi086 bash[24289]: cluster 2024-09-16T11:32:34.983210+0000 mgr.a (mgr.14373) 15371 : cluster [DBG] pgmap v10660: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:32:36.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:32:36 smithi047 bash[22744]: cluster 2024-09-16T11:32:34.983210+0000 mgr.a (mgr.14373) 15371 : cluster [DBG] pgmap v10660: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:32:36.690 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:32:36.690 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:32:36.690 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:32:36.690 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:32:36.690 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:32:37.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:32:37 smithi157 bash[24585]: audit 2024-09-16T11:32:36.248043+0000 mgr.a (mgr.14373) 15372 : audit [DBG] from='client.332124 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:32:37.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:32:37 smithi086 bash[24289]: audit 2024-09-16T11:32:36.248043+0000 mgr.a (mgr.14373) 15372 : audit [DBG] from='client.332124 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:32:37.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:32:37 smithi047 bash[22744]: audit 2024-09-16T11:32:36.248043+0000 mgr.a (mgr.14373) 15372 : audit [DBG] from='client.332124 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:32:38.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:32:38 smithi157 bash[24585]: cluster 2024-09-16T11:32:36.985568+0000 mgr.a (mgr.14373) 15373 : cluster [DBG] pgmap v10661: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-16T11:32:38.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:32:38 smithi086 bash[24289]: cluster 2024-09-16T11:32:36.985568+0000 mgr.a (mgr.14373) 15373 : cluster [DBG] pgmap v10661: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-16T11:32:38.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:32:38 smithi047 bash[22744]: cluster 2024-09-16T11:32:36.985568+0000 mgr.a (mgr.14373) 15373 : cluster [DBG] pgmap v10661: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-16T11:32:40.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:32:40 smithi157 bash[24585]: cluster 2024-09-16T11:32:38.986393+0000 mgr.a (mgr.14373) 15374 : cluster [DBG] pgmap v10662: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T11:32:40.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:32:40 smithi086 bash[24289]: cluster 2024-09-16T11:32:38.986393+0000 mgr.a (mgr.14373) 15374 : cluster [DBG] pgmap v10662: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T11:32:40.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:32:40 smithi047 bash[22744]: cluster 2024-09-16T11:32:38.986393+0000 mgr.a (mgr.14373) 15374 : cluster [DBG] pgmap v10662: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T11:32:41.691 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:32:41.692 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:32:41.692 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:32:42.456 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:32:42.456 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:32:42.456 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:32:42.456 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:32:42.456 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:32:42.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:32:42 smithi157 bash[24585]: cluster 2024-09-16T11:32:40.987203+0000 mgr.a (mgr.14373) 15375 : cluster [DBG] pgmap v10663: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T11:32:42.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:32:42 smithi086 bash[24289]: cluster 2024-09-16T11:32:40.987203+0000 mgr.a (mgr.14373) 15375 : cluster [DBG] pgmap v10663: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T11:32:42.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:32:42 smithi047 bash[22744]: cluster 2024-09-16T11:32:40.987203+0000 mgr.a (mgr.14373) 15375 : cluster [DBG] pgmap v10663: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T11:32:43.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:32:43 smithi157 bash[24585]: audit 2024-09-16T11:32:42.026547+0000 mgr.a (mgr.14373) 15376 : audit [DBG] from='client.332202 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:32:43.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:32:43 smithi086 bash[24289]: audit 2024-09-16T11:32:42.026547+0000 mgr.a (mgr.14373) 15376 : audit [DBG] from='client.332202 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:32:43.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:32:43 smithi047 bash[22744]: audit 2024-09-16T11:32:42.026547+0000 mgr.a (mgr.14373) 15376 : audit [DBG] from='client.332202 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:32:44.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:32:44 smithi157 bash[24585]: cluster 2024-09-16T11:32:42.990094+0000 mgr.a (mgr.14373) 15377 : cluster [DBG] pgmap v10664: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:32:44.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:32:44 smithi086 bash[24289]: cluster 2024-09-16T11:32:42.990094+0000 mgr.a (mgr.14373) 15377 : cluster [DBG] pgmap v10664: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:32:44.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:32:44 smithi047 bash[22744]: cluster 2024-09-16T11:32:42.990094+0000 mgr.a (mgr.14373) 15377 : cluster [DBG] pgmap v10664: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:32:46.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:32:46 smithi157 bash[24585]: cluster 2024-09-16T11:32:44.991093+0000 mgr.a (mgr.14373) 15378 : cluster [DBG] pgmap v10665: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:32:46.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:32:46 smithi086 bash[24289]: cluster 2024-09-16T11:32:44.991093+0000 mgr.a (mgr.14373) 15378 : cluster [DBG] pgmap v10665: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:32:46.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:32:46 smithi047 bash[22744]: cluster 2024-09-16T11:32:44.991093+0000 mgr.a (mgr.14373) 15378 : cluster [DBG] pgmap v10665: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:32:47.457 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:32:47.458 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:32:47.458 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:32:48.238 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:32:48.239 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:32:48.239 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:32:48.239 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:32:48.239 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:32:48.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:32:48 smithi157 bash[24585]: cluster 2024-09-16T11:32:46.993237+0000 mgr.a (mgr.14373) 15379 : cluster [DBG] pgmap v10666: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:32:48.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:32:48 smithi086 bash[24289]: cluster 2024-09-16T11:32:46.993237+0000 mgr.a (mgr.14373) 15379 : cluster [DBG] pgmap v10666: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:32:48.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:32:48 smithi047 bash[22744]: cluster 2024-09-16T11:32:46.993237+0000 mgr.a (mgr.14373) 15379 : cluster [DBG] pgmap v10666: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:32:49.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:32:49 smithi157 bash[24585]: audit 2024-09-16T11:32:47.795327+0000 mgr.a (mgr.14373) 15380 : audit [DBG] from='client.332280 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:32:49.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:32:49 smithi086 bash[24289]: audit 2024-09-16T11:32:47.795327+0000 mgr.a (mgr.14373) 15380 : audit [DBG] from='client.332280 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:32:49.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:32:49 smithi047 bash[22744]: audit 2024-09-16T11:32:47.795327+0000 mgr.a (mgr.14373) 15380 : audit [DBG] from='client.332280 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:32:50.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:32:50 smithi157 bash[24585]: cluster 2024-09-16T11:32:48.994195+0000 mgr.a (mgr.14373) 15381 : cluster [DBG] pgmap v10667: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-16T11:32:50.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:32:50 smithi086 bash[24289]: cluster 2024-09-16T11:32:48.994195+0000 mgr.a (mgr.14373) 15381 : cluster [DBG] pgmap v10667: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-16T11:32:50.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:32:50 smithi047 bash[22744]: cluster 2024-09-16T11:32:48.994195+0000 mgr.a (mgr.14373) 15381 : cluster [DBG] pgmap v10667: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-16T11:32:52.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:32:52 smithi157 bash[24585]: cluster 2024-09-16T11:32:50.994997+0000 mgr.a (mgr.14373) 15382 : cluster [DBG] pgmap v10668: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-16T11:32:52.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:32:52 smithi086 bash[24289]: cluster 2024-09-16T11:32:50.994997+0000 mgr.a (mgr.14373) 15382 : cluster [DBG] pgmap v10668: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-16T11:32:52.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:32:52 smithi047 bash[22744]: cluster 2024-09-16T11:32:50.994997+0000 mgr.a (mgr.14373) 15382 : cluster [DBG] pgmap v10668: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-16T11:32:53.240 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:32:53.241 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:32:53.241 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:32:54.012 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:32:54.013 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:32:54.013 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:32:54.013 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:32:54.013 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:32:54.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:32:54 smithi157 bash[24585]: cluster 2024-09-16T11:32:52.997198+0000 mgr.a (mgr.14373) 15383 : cluster [DBG] pgmap v10669: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-16T11:32:54.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:32:54 smithi086 bash[24289]: cluster 2024-09-16T11:32:52.997198+0000 mgr.a (mgr.14373) 15383 : cluster [DBG] pgmap v10669: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-16T11:32:54.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:32:54 smithi047 bash[22744]: cluster 2024-09-16T11:32:52.997198+0000 mgr.a (mgr.14373) 15383 : cluster [DBG] pgmap v10669: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-16T11:32:55.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:32:55 smithi157 bash[24585]: audit 2024-09-16T11:32:53.574251+0000 mgr.a (mgr.14373) 15384 : audit [DBG] from='client.332355 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:32:55.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:32:55 smithi086 bash[24289]: audit 2024-09-16T11:32:53.574251+0000 mgr.a (mgr.14373) 15384 : audit [DBG] from='client.332355 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:32:55.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:32:55 smithi047 bash[22744]: audit 2024-09-16T11:32:53.574251+0000 mgr.a (mgr.14373) 15384 : audit [DBG] from='client.332355 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:32:56.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:32:56 smithi157 bash[24585]: cluster 2024-09-16T11:32:54.998215+0000 mgr.a (mgr.14373) 15385 : cluster [DBG] pgmap v10670: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:32:56.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:32:56 smithi086 bash[24289]: cluster 2024-09-16T11:32:54.998215+0000 mgr.a (mgr.14373) 15385 : cluster [DBG] pgmap v10670: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:32:56.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:32:56 smithi047 bash[22744]: cluster 2024-09-16T11:32:54.998215+0000 mgr.a (mgr.14373) 15385 : cluster [DBG] pgmap v10670: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:32:58.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:32:58 smithi157 bash[24585]: cluster 2024-09-16T11:32:57.000363+0000 mgr.a (mgr.14373) 15386 : cluster [DBG] pgmap v10671: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:32:58.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:32:58 smithi086 bash[24289]: cluster 2024-09-16T11:32:57.000363+0000 mgr.a (mgr.14373) 15386 : cluster [DBG] pgmap v10671: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:32:58.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:32:58 smithi047 bash[22744]: cluster 2024-09-16T11:32:57.000363+0000 mgr.a (mgr.14373) 15386 : cluster [DBG] pgmap v10671: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:32:59.014 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:32:59.014 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:32:59.015 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:32:59.788 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:32:59.789 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:32:59.789 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:32:59.789 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:32:59.789 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:33:00.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:33:00 smithi157 bash[24585]: cluster 2024-09-16T11:32:59.001125+0000 mgr.a (mgr.14373) 15387 : cluster [DBG] pgmap v10672: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:33:00.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:33:00 smithi086 bash[24289]: cluster 2024-09-16T11:32:59.001125+0000 mgr.a (mgr.14373) 15387 : cluster [DBG] pgmap v10672: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:33:00.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:33:00 smithi047 bash[22744]: cluster 2024-09-16T11:32:59.001125+0000 mgr.a (mgr.14373) 15387 : cluster [DBG] pgmap v10672: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:33:01.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:33:01 smithi157 bash[24585]: audit 2024-09-16T11:32:59.345440+0000 mgr.a (mgr.14373) 15388 : audit [DBG] from='client.332433 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:33:01.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:33:01 smithi086 bash[24289]: audit 2024-09-16T11:32:59.345440+0000 mgr.a (mgr.14373) 15388 : audit [DBG] from='client.332433 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:33:01.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:33:01 smithi047 bash[22744]: audit 2024-09-16T11:32:59.345440+0000 mgr.a (mgr.14373) 15388 : audit [DBG] from='client.332433 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:33:02.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:33:02 smithi157 bash[24585]: cluster 2024-09-16T11:33:01.002093+0000 mgr.a (mgr.14373) 15389 : cluster [DBG] pgmap v10673: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:33:02.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:33:02 smithi086 bash[24289]: cluster 2024-09-16T11:33:01.002093+0000 mgr.a (mgr.14373) 15389 : cluster [DBG] pgmap v10673: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:33:02.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:33:02 smithi047 bash[22744]: cluster 2024-09-16T11:33:01.002093+0000 mgr.a (mgr.14373) 15389 : cluster [DBG] pgmap v10673: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:33:04.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:33:04 smithi157 bash[24585]: cluster 2024-09-16T11:33:03.004354+0000 mgr.a (mgr.14373) 15390 : cluster [DBG] pgmap v10674: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:33:04.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:33:04 smithi086 bash[24289]: cluster 2024-09-16T11:33:03.004354+0000 mgr.a (mgr.14373) 15390 : cluster [DBG] pgmap v10674: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:33:04.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:33:04 smithi047 bash[22744]: cluster 2024-09-16T11:33:03.004354+0000 mgr.a (mgr.14373) 15390 : cluster [DBG] pgmap v10674: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:33:04.790 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:33:04.790 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:33:04.791 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:33:05.567 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:33:05.567 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:33:05.567 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:33:05.567 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:33:05.567 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:33:06.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:33:06 smithi157 bash[24585]: cluster 2024-09-16T11:33:05.005093+0000 mgr.a (mgr.14373) 15391 : cluster [DBG] pgmap v10675: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:33:06.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:33:06 smithi157 bash[24585]: audit 2024-09-16T11:33:05.119700+0000 mgr.a (mgr.14373) 15392 : audit [DBG] from='client.332511 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:33:06.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:33:06 smithi086 bash[24289]: cluster 2024-09-16T11:33:05.005093+0000 mgr.a (mgr.14373) 15391 : cluster [DBG] pgmap v10675: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:33:06.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:33:06 smithi086 bash[24289]: audit 2024-09-16T11:33:05.119700+0000 mgr.a (mgr.14373) 15392 : audit [DBG] from='client.332511 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:33:06.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:33:06 smithi047 bash[22744]: cluster 2024-09-16T11:33:05.005093+0000 mgr.a (mgr.14373) 15391 : cluster [DBG] pgmap v10675: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:33:06.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:33:06 smithi047 bash[22744]: audit 2024-09-16T11:33:05.119700+0000 mgr.a (mgr.14373) 15392 : audit [DBG] from='client.332511 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:33:08.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:33:08 smithi157 bash[24585]: cluster 2024-09-16T11:33:07.007516+0000 mgr.a (mgr.14373) 15393 : cluster [DBG] pgmap v10676: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:33:08.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:33:08 smithi086 bash[24289]: cluster 2024-09-16T11:33:07.007516+0000 mgr.a (mgr.14373) 15393 : cluster [DBG] pgmap v10676: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:33:08.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:33:08 smithi047 bash[22744]: cluster 2024-09-16T11:33:07.007516+0000 mgr.a (mgr.14373) 15393 : cluster [DBG] pgmap v10676: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:33:10.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:33:10 smithi157 bash[24585]: cluster 2024-09-16T11:33:09.008296+0000 mgr.a (mgr.14373) 15394 : cluster [DBG] pgmap v10677: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:33:10.568 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:33:10.569 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:33:10.569 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:33:10.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:33:10 smithi086 bash[24289]: cluster 2024-09-16T11:33:09.008296+0000 mgr.a (mgr.14373) 15394 : cluster [DBG] pgmap v10677: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:33:10.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:33:10 smithi047 bash[22744]: cluster 2024-09-16T11:33:09.008296+0000 mgr.a (mgr.14373) 15394 : cluster [DBG] pgmap v10677: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:33:11.331 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:33:11.332 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:33:11.332 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:33:11.332 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:33:11.332 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:33:12.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:33:12 smithi157 bash[24585]: audit 2024-09-16T11:33:10.905594+0000 mgr.a (mgr.14373) 15395 : audit [DBG] from='client.332586 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:33:12.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:33:12 smithi157 bash[24585]: cluster 2024-09-16T11:33:11.008843+0000 mgr.a (mgr.14373) 15396 : cluster [DBG] pgmap v10678: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:33:12.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:33:12 smithi086 bash[24289]: audit 2024-09-16T11:33:10.905594+0000 mgr.a (mgr.14373) 15395 : audit [DBG] from='client.332586 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:33:12.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:33:12 smithi086 bash[24289]: cluster 2024-09-16T11:33:11.008843+0000 mgr.a (mgr.14373) 15396 : cluster [DBG] pgmap v10678: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:33:12.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:33:12 smithi047 bash[22744]: audit 2024-09-16T11:33:10.905594+0000 mgr.a (mgr.14373) 15395 : audit [DBG] from='client.332586 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:33:12.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:33:12 smithi047 bash[22744]: cluster 2024-09-16T11:33:11.008843+0000 mgr.a (mgr.14373) 15396 : cluster [DBG] pgmap v10678: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:33:14.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:33:14 smithi157 bash[24585]: cluster 2024-09-16T11:33:13.011204+0000 mgr.a (mgr.14373) 15397 : cluster [DBG] pgmap v10679: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:33:14.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:33:14 smithi086 bash[24289]: cluster 2024-09-16T11:33:13.011204+0000 mgr.a (mgr.14373) 15397 : cluster [DBG] pgmap v10679: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:33:14.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:33:14 smithi047 bash[22744]: cluster 2024-09-16T11:33:13.011204+0000 mgr.a (mgr.14373) 15397 : cluster [DBG] pgmap v10679: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:33:16.333 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:33:16.334 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:33:16.334 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:33:16.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:33:16 smithi157 bash[24585]: cluster 2024-09-16T11:33:15.011986+0000 mgr.a (mgr.14373) 15398 : cluster [DBG] pgmap v10680: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:33:16.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:33:16 smithi086 bash[24289]: cluster 2024-09-16T11:33:15.011986+0000 mgr.a (mgr.14373) 15398 : cluster [DBG] pgmap v10680: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:33:16.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:33:16 smithi047 bash[22744]: cluster 2024-09-16T11:33:15.011986+0000 mgr.a (mgr.14373) 15398 : cluster [DBG] pgmap v10680: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:33:17.088 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:33:17.089 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:33:17.089 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:33:17.089 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:33:17.089 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:33:18.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:33:18 smithi157 bash[24585]: audit 2024-09-16T11:33:16.663023+0000 mgr.a (mgr.14373) 15399 : audit [DBG] from='client.332661 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:33:18.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:33:18 smithi157 bash[24585]: cluster 2024-09-16T11:33:17.013296+0000 mgr.a (mgr.14373) 15400 : cluster [DBG] pgmap v10681: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:33:18.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:33:18 smithi086 bash[24289]: audit 2024-09-16T11:33:16.663023+0000 mgr.a (mgr.14373) 15399 : audit [DBG] from='client.332661 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:33:18.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:33:18 smithi086 bash[24289]: cluster 2024-09-16T11:33:17.013296+0000 mgr.a (mgr.14373) 15400 : cluster [DBG] pgmap v10681: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:33:18.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:33:18 smithi047 bash[22744]: audit 2024-09-16T11:33:16.663023+0000 mgr.a (mgr.14373) 15399 : audit [DBG] from='client.332661 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:33:18.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:33:18 smithi047 bash[22744]: cluster 2024-09-16T11:33:17.013296+0000 mgr.a (mgr.14373) 15400 : cluster [DBG] pgmap v10681: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:33:19.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:33:19 smithi086 bash[24289]: cluster 2024-09-16T11:33:19.014042+0000 mgr.a (mgr.14373) 15401 : cluster [DBG] pgmap v10682: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T11:33:19.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:33:19 smithi047 bash[22744]: cluster 2024-09-16T11:33:19.014042+0000 mgr.a (mgr.14373) 15401 : cluster [DBG] pgmap v10682: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T11:33:19.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:33:19 smithi157 bash[24585]: cluster 2024-09-16T11:33:19.014042+0000 mgr.a (mgr.14373) 15401 : cluster [DBG] pgmap v10682: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T11:33:22.089 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:33:22.090 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:33:22.090 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:33:22.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:33:22 smithi047 bash[22744]: cluster 2024-09-16T11:33:21.014827+0000 mgr.a (mgr.14373) 15402 : cluster [DBG] pgmap v10683: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T11:33:22.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:33:22 smithi047 bash[22744]: audit 2024-09-16T11:33:21.508044+0000 mon.b (mon.2) 1402 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T11:33:22.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:33:22 smithi157 bash[24585]: cluster 2024-09-16T11:33:21.014827+0000 mgr.a (mgr.14373) 15402 : cluster [DBG] pgmap v10683: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T11:33:22.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:33:22 smithi157 bash[24585]: audit 2024-09-16T11:33:21.508044+0000 mon.b (mon.2) 1402 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T11:33:22.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:33:22 smithi086 bash[24289]: cluster 2024-09-16T11:33:21.014827+0000 mgr.a (mgr.14373) 15402 : cluster [DBG] pgmap v10683: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T11:33:22.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:33:22 smithi086 bash[24289]: audit 2024-09-16T11:33:21.508044+0000 mon.b (mon.2) 1402 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T11:33:23.343 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 11:33:23 smithi047 bash[22994]: debug 2024-09-16T11:33:23.072+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T11:33:23.343 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 11:33:23 smithi047 bash[22994]: debug 2024-09-16T11:33:23.084+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T11:33:23.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:33:23 smithi047 bash[22744]: audit 2024-09-16T11:33:22.337311+0000 mon.b (mon.2) 1403 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T11:33:23.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:33:23 smithi047 bash[22744]: audit 2024-09-16T11:33:22.338992+0000 mon.b (mon.2) 1404 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T11:33:23.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:33:23 smithi047 bash[22744]: audit 2024-09-16T11:33:22.346151+0000 mon.a (mon.0) 1486 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:33:23.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:33:23 smithi047 bash[22744]: audit 2024-09-16T11:33:22.351069+0000 mon.b (mon.2) 1405 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:33:23.482 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:33:23.482 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:33:23.482 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:33:23.482 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:33:23.483 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:33:23.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:33:23 smithi157 bash[24585]: audit 2024-09-16T11:33:22.337311+0000 mon.b (mon.2) 1403 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T11:33:23.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:33:23 smithi157 bash[24585]: audit 2024-09-16T11:33:22.338992+0000 mon.b (mon.2) 1404 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T11:33:23.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:33:23 smithi157 bash[24585]: audit 2024-09-16T11:33:22.346151+0000 mon.a (mon.0) 1486 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:33:23.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:33:23 smithi157 bash[24585]: audit 2024-09-16T11:33:22.351069+0000 mon.b (mon.2) 1405 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:33:23.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:33:23 smithi086 bash[24289]: audit 2024-09-16T11:33:22.337311+0000 mon.b (mon.2) 1403 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T11:33:23.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:33:23 smithi086 bash[24289]: audit 2024-09-16T11:33:22.338992+0000 mon.b (mon.2) 1404 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T11:33:23.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:33:23 smithi086 bash[24289]: audit 2024-09-16T11:33:22.346151+0000 mon.a (mon.0) 1486 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:33:23.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:33:23 smithi086 bash[24289]: audit 2024-09-16T11:33:22.351069+0000 mon.b (mon.2) 1405 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:33:24.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:33:24 smithi047 bash[22744]: audit 2024-09-16T11:33:22.353791+0000 mgr.a (mgr.14373) 15403 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:33:24.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:33:24 smithi047 bash[22744]: audit 2024-09-16T11:33:22.417615+0000 mgr.a (mgr.14373) 15404 : audit [DBG] from='client.332739 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:33:24.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:33:24 smithi047 bash[22744]: cluster 2024-09-16T11:33:23.016152+0000 mgr.a (mgr.14373) 15405 : cluster [DBG] pgmap v10684: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:33:24.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:33:24 smithi047 bash[22744]: audit 2024-09-16T11:33:23.077321+0000 mgr.a (mgr.14373) 15406 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T11:33:24.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:33:24 smithi047 bash[22744]: cephadm 2024-09-16T11:33:23.089056+0000 mgr.a (mgr.14373) 15407 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T11:33:24.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:33:24 smithi157 bash[24585]: audit 2024-09-16T11:33:22.353791+0000 mgr.a (mgr.14373) 15403 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:33:24.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:33:24 smithi157 bash[24585]: audit 2024-09-16T11:33:22.417615+0000 mgr.a (mgr.14373) 15404 : audit [DBG] from='client.332739 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:33:24.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:33:24 smithi157 bash[24585]: cluster 2024-09-16T11:33:23.016152+0000 mgr.a (mgr.14373) 15405 : cluster [DBG] pgmap v10684: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:33:24.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:33:24 smithi157 bash[24585]: audit 2024-09-16T11:33:23.077321+0000 mgr.a (mgr.14373) 15406 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T11:33:24.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:33:24 smithi157 bash[24585]: cephadm 2024-09-16T11:33:23.089056+0000 mgr.a (mgr.14373) 15407 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T11:33:24.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:33:24 smithi086 bash[24289]: audit 2024-09-16T11:33:22.353791+0000 mgr.a (mgr.14373) 15403 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:33:24.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:33:24 smithi086 bash[24289]: audit 2024-09-16T11:33:22.417615+0000 mgr.a (mgr.14373) 15404 : audit [DBG] from='client.332739 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:33:24.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:33:24 smithi086 bash[24289]: cluster 2024-09-16T11:33:23.016152+0000 mgr.a (mgr.14373) 15405 : cluster [DBG] pgmap v10684: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:33:24.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:33:24 smithi086 bash[24289]: audit 2024-09-16T11:33:23.077321+0000 mgr.a (mgr.14373) 15406 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T11:33:24.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:33:24 smithi086 bash[24289]: cephadm 2024-09-16T11:33:23.089056+0000 mgr.a (mgr.14373) 15407 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T11:33:26.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:33:26 smithi047 bash[22744]: cluster 2024-09-16T11:33:25.017041+0000 mgr.a (mgr.14373) 15408 : cluster [DBG] pgmap v10685: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T11:33:26.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:33:26 smithi157 bash[24585]: cluster 2024-09-16T11:33:25.017041+0000 mgr.a (mgr.14373) 15408 : cluster [DBG] pgmap v10685: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T11:33:26.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:33:26 smithi086 bash[24289]: cluster 2024-09-16T11:33:25.017041+0000 mgr.a (mgr.14373) 15408 : cluster [DBG] pgmap v10685: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T11:33:28.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:33:28 smithi047 bash[22744]: cluster 2024-09-16T11:33:27.019243+0000 mgr.a (mgr.14373) 15409 : cluster [DBG] pgmap v10686: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:33:28.484 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:33:28.484 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:33:28.484 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:33:28.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:33:28 smithi157 bash[24585]: cluster 2024-09-16T11:33:27.019243+0000 mgr.a (mgr.14373) 15409 : cluster [DBG] pgmap v10686: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:33:28.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:33:28 smithi086 bash[24289]: cluster 2024-09-16T11:33:27.019243+0000 mgr.a (mgr.14373) 15409 : cluster [DBG] pgmap v10686: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:33:29.295 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:33:29.295 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:33:29.295 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:33:29.295 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:33:29.295 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:33:30.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:33:30 smithi047 bash[22744]: audit 2024-09-16T11:33:28.822303+0000 mgr.a (mgr.14373) 15410 : audit [DBG] from='client.332922 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:33:30.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:33:30 smithi047 bash[22744]: cluster 2024-09-16T11:33:29.020056+0000 mgr.a (mgr.14373) 15411 : cluster [DBG] pgmap v10687: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:33:30.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:33:30 smithi157 bash[24585]: audit 2024-09-16T11:33:28.822303+0000 mgr.a (mgr.14373) 15410 : audit [DBG] from='client.332922 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:33:30.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:33:30 smithi157 bash[24585]: cluster 2024-09-16T11:33:29.020056+0000 mgr.a (mgr.14373) 15411 : cluster [DBG] pgmap v10687: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:33:30.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:33:30 smithi086 bash[24289]: audit 2024-09-16T11:33:28.822303+0000 mgr.a (mgr.14373) 15410 : audit [DBG] from='client.332922 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:33:30.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:33:30 smithi086 bash[24289]: cluster 2024-09-16T11:33:29.020056+0000 mgr.a (mgr.14373) 15411 : cluster [DBG] pgmap v10687: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:33:32.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:33:32 smithi157 bash[24585]: cluster 2024-09-16T11:33:31.021021+0000 mgr.a (mgr.14373) 15412 : cluster [DBG] pgmap v10688: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:33:32.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:33:32 smithi086 bash[24289]: cluster 2024-09-16T11:33:31.021021+0000 mgr.a (mgr.14373) 15412 : cluster [DBG] pgmap v10688: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:33:32.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:33:32 smithi047 bash[22744]: cluster 2024-09-16T11:33:31.021021+0000 mgr.a (mgr.14373) 15412 : cluster [DBG] pgmap v10688: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:33:34.297 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:33:34.297 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:33:34.298 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:33:34.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:33:34 smithi157 bash[24585]: cluster 2024-09-16T11:33:33.023317+0000 mgr.a (mgr.14373) 15413 : cluster [DBG] pgmap v10689: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:33:34.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:33:34 smithi086 bash[24289]: cluster 2024-09-16T11:33:33.023317+0000 mgr.a (mgr.14373) 15413 : cluster [DBG] pgmap v10689: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:33:34.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:33:34 smithi047 bash[22744]: cluster 2024-09-16T11:33:33.023317+0000 mgr.a (mgr.14373) 15413 : cluster [DBG] pgmap v10689: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:33:35.084 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:33:35.084 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:33:35.085 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:33:35.085 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:33:35.085 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:33:36.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:33:36 smithi157 bash[24585]: audit 2024-09-16T11:33:34.630443+0000 mgr.a (mgr.14373) 15414 : audit [DBG] from='client.332997 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:33:36.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:33:36 smithi157 bash[24585]: cluster 2024-09-16T11:33:35.023844+0000 mgr.a (mgr.14373) 15415 : cluster [DBG] pgmap v10690: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:33:36.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:33:36 smithi086 bash[24289]: audit 2024-09-16T11:33:34.630443+0000 mgr.a (mgr.14373) 15414 : audit [DBG] from='client.332997 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:33:36.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:33:36 smithi086 bash[24289]: cluster 2024-09-16T11:33:35.023844+0000 mgr.a (mgr.14373) 15415 : cluster [DBG] pgmap v10690: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:33:36.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:33:36 smithi047 bash[22744]: audit 2024-09-16T11:33:34.630443+0000 mgr.a (mgr.14373) 15414 : audit [DBG] from='client.332997 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:33:36.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:33:36 smithi047 bash[22744]: cluster 2024-09-16T11:33:35.023844+0000 mgr.a (mgr.14373) 15415 : cluster [DBG] pgmap v10690: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:33:38.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:33:38 smithi157 bash[24585]: cluster 2024-09-16T11:33:37.026020+0000 mgr.a (mgr.14373) 15416 : cluster [DBG] pgmap v10691: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:33:38.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:33:38 smithi086 bash[24289]: cluster 2024-09-16T11:33:37.026020+0000 mgr.a (mgr.14373) 15416 : cluster [DBG] pgmap v10691: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:33:38.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:33:38 smithi047 bash[22744]: cluster 2024-09-16T11:33:37.026020+0000 mgr.a (mgr.14373) 15416 : cluster [DBG] pgmap v10691: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:33:40.086 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:33:40.086 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:33:40.087 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:33:40.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:33:40 smithi157 bash[24585]: cluster 2024-09-16T11:33:39.026824+0000 mgr.a (mgr.14373) 15417 : cluster [DBG] pgmap v10692: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:33:40.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:33:40 smithi086 bash[24289]: cluster 2024-09-16T11:33:39.026824+0000 mgr.a (mgr.14373) 15417 : cluster [DBG] pgmap v10692: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:33:40.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:33:40 smithi047 bash[22744]: cluster 2024-09-16T11:33:39.026824+0000 mgr.a (mgr.14373) 15417 : cluster [DBG] pgmap v10692: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:33:40.849 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:33:40.849 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:33:40.849 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:33:40.849 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:33:40.849 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:33:42.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:33:42 smithi157 bash[24585]: audit 2024-09-16T11:33:40.415066+0000 mgr.a (mgr.14373) 15418 : audit [DBG] from='client.333075 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:33:42.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:33:42 smithi157 bash[24585]: cluster 2024-09-16T11:33:41.028074+0000 mgr.a (mgr.14373) 15419 : cluster [DBG] pgmap v10693: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:33:42.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:33:42 smithi086 bash[24289]: audit 2024-09-16T11:33:40.415066+0000 mgr.a (mgr.14373) 15418 : audit [DBG] from='client.333075 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:33:42.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:33:42 smithi086 bash[24289]: cluster 2024-09-16T11:33:41.028074+0000 mgr.a (mgr.14373) 15419 : cluster [DBG] pgmap v10693: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:33:42.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:33:42 smithi047 bash[22744]: audit 2024-09-16T11:33:40.415066+0000 mgr.a (mgr.14373) 15418 : audit [DBG] from='client.333075 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:33:42.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:33:42 smithi047 bash[22744]: cluster 2024-09-16T11:33:41.028074+0000 mgr.a (mgr.14373) 15419 : cluster [DBG] pgmap v10693: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:33:44.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:33:44 smithi157 bash[24585]: cluster 2024-09-16T11:33:43.030412+0000 mgr.a (mgr.14373) 15420 : cluster [DBG] pgmap v10694: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:33:44.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:33:44 smithi086 bash[24289]: cluster 2024-09-16T11:33:43.030412+0000 mgr.a (mgr.14373) 15420 : cluster [DBG] pgmap v10694: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:33:44.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:33:44 smithi047 bash[22744]: cluster 2024-09-16T11:33:43.030412+0000 mgr.a (mgr.14373) 15420 : cluster [DBG] pgmap v10694: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:33:45.850 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:33:45.851 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:33:45.851 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:33:46.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:33:46 smithi157 bash[24585]: cluster 2024-09-16T11:33:45.031196+0000 mgr.a (mgr.14373) 15421 : cluster [DBG] pgmap v10695: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:33:46.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:33:46 smithi086 bash[24289]: cluster 2024-09-16T11:33:45.031196+0000 mgr.a (mgr.14373) 15421 : cluster [DBG] pgmap v10695: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:33:46.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:33:46 smithi047 bash[22744]: cluster 2024-09-16T11:33:45.031196+0000 mgr.a (mgr.14373) 15421 : cluster [DBG] pgmap v10695: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:33:46.640 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:33:46.641 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:33:46.641 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:33:46.641 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:33:46.641 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:33:47.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:33:47 smithi157 bash[24585]: audit 2024-09-16T11:33:46.187457+0000 mgr.a (mgr.14373) 15422 : audit [DBG] from='client.333150 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:33:47.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:33:47 smithi086 bash[24289]: audit 2024-09-16T11:33:46.187457+0000 mgr.a (mgr.14373) 15422 : audit [DBG] from='client.333150 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:33:47.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:33:47 smithi047 bash[22744]: audit 2024-09-16T11:33:46.187457+0000 mgr.a (mgr.14373) 15422 : audit [DBG] from='client.333150 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:33:48.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:33:48 smithi157 bash[24585]: cluster 2024-09-16T11:33:47.033542+0000 mgr.a (mgr.14373) 15423 : cluster [DBG] pgmap v10696: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-16T11:33:48.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:33:48 smithi086 bash[24289]: cluster 2024-09-16T11:33:47.033542+0000 mgr.a (mgr.14373) 15423 : cluster [DBG] pgmap v10696: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-16T11:33:48.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:33:48 smithi047 bash[22744]: cluster 2024-09-16T11:33:47.033542+0000 mgr.a (mgr.14373) 15423 : cluster [DBG] pgmap v10696: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-16T11:33:50.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:33:50 smithi157 bash[24585]: cluster 2024-09-16T11:33:49.034291+0000 mgr.a (mgr.14373) 15424 : cluster [DBG] pgmap v10697: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T11:33:50.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:33:50 smithi086 bash[24289]: cluster 2024-09-16T11:33:49.034291+0000 mgr.a (mgr.14373) 15424 : cluster [DBG] pgmap v10697: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T11:33:50.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:33:50 smithi047 bash[22744]: cluster 2024-09-16T11:33:49.034291+0000 mgr.a (mgr.14373) 15424 : cluster [DBG] pgmap v10697: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T11:33:51.639 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:33:51.640 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:33:51.640 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:33:52.440 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:33:52.440 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:33:52.440 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:33:52.441 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:33:52.441 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:33:52.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:33:52 smithi157 bash[24585]: cluster 2024-09-16T11:33:51.035090+0000 mgr.a (mgr.14373) 15425 : cluster [DBG] pgmap v10698: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T11:33:52.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:33:52 smithi086 bash[24289]: cluster 2024-09-16T11:33:51.035090+0000 mgr.a (mgr.14373) 15425 : cluster [DBG] pgmap v10698: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T11:33:52.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:33:52 smithi047 bash[22744]: cluster 2024-09-16T11:33:51.035090+0000 mgr.a (mgr.14373) 15425 : cluster [DBG] pgmap v10698: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T11:33:53.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:33:53 smithi157 bash[24585]: audit 2024-09-16T11:33:51.972560+0000 mgr.a (mgr.14373) 15426 : audit [DBG] from='client.333228 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:33:53.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:33:53 smithi086 bash[24289]: audit 2024-09-16T11:33:51.972560+0000 mgr.a (mgr.14373) 15426 : audit [DBG] from='client.333228 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:33:53.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:33:53 smithi047 bash[22744]: audit 2024-09-16T11:33:51.972560+0000 mgr.a (mgr.14373) 15426 : audit [DBG] from='client.333228 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:33:54.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:33:54 smithi157 bash[24585]: cluster 2024-09-16T11:33:53.037979+0000 mgr.a (mgr.14373) 15427 : cluster [DBG] pgmap v10699: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:33:54.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:33:54 smithi086 bash[24289]: cluster 2024-09-16T11:33:53.037979+0000 mgr.a (mgr.14373) 15427 : cluster [DBG] pgmap v10699: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:33:54.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:33:54 smithi047 bash[22744]: cluster 2024-09-16T11:33:53.037979+0000 mgr.a (mgr.14373) 15427 : cluster [DBG] pgmap v10699: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:33:56.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:33:56 smithi157 bash[24585]: cluster 2024-09-16T11:33:55.038997+0000 mgr.a (mgr.14373) 15428 : cluster [DBG] pgmap v10700: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:33:56.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:33:56 smithi086 bash[24289]: cluster 2024-09-16T11:33:55.038997+0000 mgr.a (mgr.14373) 15428 : cluster [DBG] pgmap v10700: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:33:56.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:33:56 smithi047 bash[22744]: cluster 2024-09-16T11:33:55.038997+0000 mgr.a (mgr.14373) 15428 : cluster [DBG] pgmap v10700: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:33:57.441 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:33:57.442 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:33:57.442 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:33:57.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:33:57 smithi157 bash[24585]: cluster 2024-09-16T11:33:57.041083+0000 mgr.a (mgr.14373) 15429 : cluster [DBG] pgmap v10701: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:33:57.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:33:57 smithi086 bash[24289]: cluster 2024-09-16T11:33:57.041083+0000 mgr.a (mgr.14373) 15429 : cluster [DBG] pgmap v10701: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:33:57.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:33:57 smithi047 bash[22744]: cluster 2024-09-16T11:33:57.041083+0000 mgr.a (mgr.14373) 15429 : cluster [DBG] pgmap v10701: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:33:58.203 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:33:58.203 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:33:58.203 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:33:58.204 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:33:58.204 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:33:58.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:33:58 smithi157 bash[24585]: audit 2024-09-16T11:33:57.775487+0000 mgr.a (mgr.14373) 15430 : audit [DBG] from='client.333306 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:33:58.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:33:58 smithi086 bash[24289]: audit 2024-09-16T11:33:57.775487+0000 mgr.a (mgr.14373) 15430 : audit [DBG] from='client.333306 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:33:58.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:33:58 smithi047 bash[22744]: audit 2024-09-16T11:33:57.775487+0000 mgr.a (mgr.14373) 15430 : audit [DBG] from='client.333306 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:33:59.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:33:59 smithi157 bash[24585]: cluster 2024-09-16T11:33:59.042249+0000 mgr.a (mgr.14373) 15431 : cluster [DBG] pgmap v10702: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-16T11:33:59.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:33:59 smithi086 bash[24289]: cluster 2024-09-16T11:33:59.042249+0000 mgr.a (mgr.14373) 15431 : cluster [DBG] pgmap v10702: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-16T11:33:59.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:33:59 smithi047 bash[22744]: cluster 2024-09-16T11:33:59.042249+0000 mgr.a (mgr.14373) 15431 : cluster [DBG] pgmap v10702: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-16T11:34:02.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:34:02 smithi157 bash[24585]: cluster 2024-09-16T11:34:01.043282+0000 mgr.a (mgr.14373) 15432 : cluster [DBG] pgmap v10703: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-16T11:34:02.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:34:02 smithi086 bash[24289]: cluster 2024-09-16T11:34:01.043282+0000 mgr.a (mgr.14373) 15432 : cluster [DBG] pgmap v10703: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-16T11:34:02.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:34:02 smithi047 bash[22744]: cluster 2024-09-16T11:34:01.043282+0000 mgr.a (mgr.14373) 15432 : cluster [DBG] pgmap v10703: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-16T11:34:03.205 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:34:03.206 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:34:03.206 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:34:03.973 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:34:03.974 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:34:03.974 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:34:03.974 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:34:03.974 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:34:04.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:34:04 smithi157 bash[24585]: cluster 2024-09-16T11:34:03.045664+0000 mgr.a (mgr.14373) 15433 : cluster [DBG] pgmap v10704: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-16T11:34:04.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:34:04 smithi086 bash[24289]: cluster 2024-09-16T11:34:03.045664+0000 mgr.a (mgr.14373) 15433 : cluster [DBG] pgmap v10704: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-16T11:34:04.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:34:04 smithi047 bash[22744]: cluster 2024-09-16T11:34:03.045664+0000 mgr.a (mgr.14373) 15433 : cluster [DBG] pgmap v10704: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-16T11:34:05.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:34:05 smithi157 bash[24585]: audit 2024-09-16T11:34:03.536940+0000 mgr.a (mgr.14373) 15434 : audit [DBG] from='client.333384 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:34:05.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:34:05 smithi086 bash[24289]: audit 2024-09-16T11:34:03.536940+0000 mgr.a (mgr.14373) 15434 : audit [DBG] from='client.333384 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:34:05.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:34:05 smithi047 bash[22744]: audit 2024-09-16T11:34:03.536940+0000 mgr.a (mgr.14373) 15434 : audit [DBG] from='client.333384 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:34:06.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:34:06 smithi157 bash[24585]: cluster 2024-09-16T11:34:05.046627+0000 mgr.a (mgr.14373) 15435 : cluster [DBG] pgmap v10705: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:34:06.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:34:06 smithi086 bash[24289]: cluster 2024-09-16T11:34:05.046627+0000 mgr.a (mgr.14373) 15435 : cluster [DBG] pgmap v10705: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:34:06.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:34:06 smithi047 bash[22744]: cluster 2024-09-16T11:34:05.046627+0000 mgr.a (mgr.14373) 15435 : cluster [DBG] pgmap v10705: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:34:08.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:34:08 smithi157 bash[24585]: cluster 2024-09-16T11:34:07.048821+0000 mgr.a (mgr.14373) 15436 : cluster [DBG] pgmap v10706: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:34:08.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:34:08 smithi086 bash[24289]: cluster 2024-09-16T11:34:07.048821+0000 mgr.a (mgr.14373) 15436 : cluster [DBG] pgmap v10706: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:34:08.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:34:08 smithi047 bash[22744]: cluster 2024-09-16T11:34:07.048821+0000 mgr.a (mgr.14373) 15436 : cluster [DBG] pgmap v10706: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:34:08.975 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:34:08.976 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:34:08.976 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:34:09.754 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:34:09.754 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:34:09.754 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:34:09.754 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:34:09.754 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:34:10.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:34:10 smithi157 bash[24585]: cluster 2024-09-16T11:34:09.049575+0000 mgr.a (mgr.14373) 15437 : cluster [DBG] pgmap v10707: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:34:10.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:34:10 smithi086 bash[24289]: cluster 2024-09-16T11:34:09.049575+0000 mgr.a (mgr.14373) 15437 : cluster [DBG] pgmap v10707: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:34:10.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:34:10 smithi047 bash[22744]: cluster 2024-09-16T11:34:09.049575+0000 mgr.a (mgr.14373) 15437 : cluster [DBG] pgmap v10707: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:34:11.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:34:11 smithi157 bash[24585]: audit 2024-09-16T11:34:09.313822+0000 mgr.a (mgr.14373) 15438 : audit [DBG] from='client.333462 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:34:11.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:34:11 smithi086 bash[24289]: audit 2024-09-16T11:34:09.313822+0000 mgr.a (mgr.14373) 15438 : audit [DBG] from='client.333462 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:34:11.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:34:11 smithi047 bash[22744]: audit 2024-09-16T11:34:09.313822+0000 mgr.a (mgr.14373) 15438 : audit [DBG] from='client.333462 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:34:12.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:34:12 smithi157 bash[24585]: cluster 2024-09-16T11:34:11.050515+0000 mgr.a (mgr.14373) 15439 : cluster [DBG] pgmap v10708: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:34:12.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:34:12 smithi086 bash[24289]: cluster 2024-09-16T11:34:11.050515+0000 mgr.a (mgr.14373) 15439 : cluster [DBG] pgmap v10708: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:34:12.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:34:12 smithi047 bash[22744]: cluster 2024-09-16T11:34:11.050515+0000 mgr.a (mgr.14373) 15439 : cluster [DBG] pgmap v10708: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:34:14.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:34:14 smithi157 bash[24585]: cluster 2024-09-16T11:34:13.052751+0000 mgr.a (mgr.14373) 15440 : cluster [DBG] pgmap v10709: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:34:14.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:34:14 smithi086 bash[24289]: cluster 2024-09-16T11:34:13.052751+0000 mgr.a (mgr.14373) 15440 : cluster [DBG] pgmap v10709: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:34:14.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:34:14 smithi047 bash[22744]: cluster 2024-09-16T11:34:13.052751+0000 mgr.a (mgr.14373) 15440 : cluster [DBG] pgmap v10709: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:34:14.755 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:34:14.756 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:34:14.756 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:34:15.519 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:34:15.520 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:34:15.520 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:34:15.520 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:34:15.520 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:34:16.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:34:16 smithi157 bash[24585]: cluster 2024-09-16T11:34:15.053466+0000 mgr.a (mgr.14373) 15441 : cluster [DBG] pgmap v10710: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:34:16.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:34:16 smithi157 bash[24585]: audit 2024-09-16T11:34:15.084757+0000 mgr.a (mgr.14373) 15442 : audit [DBG] from='client.333540 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:34:16.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:34:16 smithi086 bash[24289]: cluster 2024-09-16T11:34:15.053466+0000 mgr.a (mgr.14373) 15441 : cluster [DBG] pgmap v10710: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:34:16.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:34:16 smithi086 bash[24289]: audit 2024-09-16T11:34:15.084757+0000 mgr.a (mgr.14373) 15442 : audit [DBG] from='client.333540 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:34:16.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:34:16 smithi047 bash[22744]: cluster 2024-09-16T11:34:15.053466+0000 mgr.a (mgr.14373) 15441 : cluster [DBG] pgmap v10710: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:34:16.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:34:16 smithi047 bash[22744]: audit 2024-09-16T11:34:15.084757+0000 mgr.a (mgr.14373) 15442 : audit [DBG] from='client.333540 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:34:18.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:34:18 smithi157 bash[24585]: cluster 2024-09-16T11:34:17.055774+0000 mgr.a (mgr.14373) 15443 : cluster [DBG] pgmap v10711: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:34:18.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:34:18 smithi086 bash[24289]: cluster 2024-09-16T11:34:17.055774+0000 mgr.a (mgr.14373) 15443 : cluster [DBG] pgmap v10711: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:34:18.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:34:18 smithi047 bash[22744]: cluster 2024-09-16T11:34:17.055774+0000 mgr.a (mgr.14373) 15443 : cluster [DBG] pgmap v10711: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:34:20.521 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:34:20.522 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:34:20.522 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:34:20.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:34:20 smithi157 bash[24585]: cluster 2024-09-16T11:34:19.056537+0000 mgr.a (mgr.14373) 15444 : cluster [DBG] pgmap v10712: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:34:20.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:34:20 smithi086 bash[24289]: cluster 2024-09-16T11:34:19.056537+0000 mgr.a (mgr.14373) 15444 : cluster [DBG] pgmap v10712: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:34:20.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:34:20 smithi047 bash[22744]: cluster 2024-09-16T11:34:19.056537+0000 mgr.a (mgr.14373) 15444 : cluster [DBG] pgmap v10712: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:34:21.295 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:34:21.296 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:34:21.296 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:34:21.296 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:34:21.296 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:34:22.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:34:22 smithi157 bash[24585]: audit 2024-09-16T11:34:20.851551+0000 mgr.a (mgr.14373) 15445 : audit [DBG] from='client.333615 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:34:22.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:34:22 smithi157 bash[24585]: cluster 2024-09-16T11:34:21.057128+0000 mgr.a (mgr.14373) 15446 : cluster [DBG] pgmap v10713: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:34:22.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:34:22 smithi086 bash[24289]: audit 2024-09-16T11:34:20.851551+0000 mgr.a (mgr.14373) 15445 : audit [DBG] from='client.333615 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:34:22.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:34:22 smithi086 bash[24289]: cluster 2024-09-16T11:34:21.057128+0000 mgr.a (mgr.14373) 15446 : cluster [DBG] pgmap v10713: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:34:22.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:34:22 smithi047 bash[22744]: audit 2024-09-16T11:34:20.851551+0000 mgr.a (mgr.14373) 15445 : audit [DBG] from='client.333615 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:34:22.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:34:22 smithi047 bash[22744]: cluster 2024-09-16T11:34:21.057128+0000 mgr.a (mgr.14373) 15446 : cluster [DBG] pgmap v10713: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:34:23.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:34:23 smithi157 bash[24585]: audit 2024-09-16T11:34:23.141727+0000 mon.b (mon.2) 1406 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T11:34:23.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:34:23 smithi086 bash[24289]: audit 2024-09-16T11:34:23.141727+0000 mon.b (mon.2) 1406 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T11:34:23.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:34:23 smithi047 bash[22744]: audit 2024-09-16T11:34:23.141727+0000 mon.b (mon.2) 1406 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T11:34:24.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:34:24 smithi157 bash[24585]: cluster 2024-09-16T11:34:23.059451+0000 mgr.a (mgr.14373) 15447 : cluster [DBG] pgmap v10714: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:34:24.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:34:24 smithi157 bash[24585]: audit 2024-09-16T11:34:24.004783+0000 mon.b (mon.2) 1407 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T11:34:24.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:34:24 smithi157 bash[24585]: audit 2024-09-16T11:34:24.006984+0000 mon.b (mon.2) 1408 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T11:34:24.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:34:24 smithi157 bash[24585]: audit 2024-09-16T11:34:24.019102+0000 mon.a (mon.0) 1487 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:34:24.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:34:24 smithi157 bash[24585]: audit 2024-09-16T11:34:24.024520+0000 mon.b (mon.2) 1409 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:34:24.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:34:24 smithi086 bash[24289]: cluster 2024-09-16T11:34:23.059451+0000 mgr.a (mgr.14373) 15447 : cluster [DBG] pgmap v10714: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:34:24.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:34:24 smithi086 bash[24289]: audit 2024-09-16T11:34:24.004783+0000 mon.b (mon.2) 1407 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T11:34:24.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:34:24 smithi086 bash[24289]: audit 2024-09-16T11:34:24.006984+0000 mon.b (mon.2) 1408 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T11:34:24.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:34:24 smithi086 bash[24289]: audit 2024-09-16T11:34:24.019102+0000 mon.a (mon.0) 1487 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:34:24.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:34:24 smithi086 bash[24289]: audit 2024-09-16T11:34:24.024520+0000 mon.b (mon.2) 1409 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:34:24.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:34:24 smithi047 bash[22744]: cluster 2024-09-16T11:34:23.059451+0000 mgr.a (mgr.14373) 15447 : cluster [DBG] pgmap v10714: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:34:24.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:34:24 smithi047 bash[22744]: audit 2024-09-16T11:34:24.004783+0000 mon.b (mon.2) 1407 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T11:34:24.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:34:24 smithi047 bash[22744]: audit 2024-09-16T11:34:24.006984+0000 mon.b (mon.2) 1408 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T11:34:24.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:34:24 smithi047 bash[22744]: audit 2024-09-16T11:34:24.019102+0000 mon.a (mon.0) 1487 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:34:24.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:34:24 smithi047 bash[22744]: audit 2024-09-16T11:34:24.024520+0000 mon.b (mon.2) 1409 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:34:25.092 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 11:34:24 smithi047 bash[22994]: debug 2024-09-16T11:34:24.783+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T11:34:25.093 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 11:34:24 smithi047 bash[22994]: debug 2024-09-16T11:34:24.783+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T11:34:25.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:34:25 smithi157 bash[24585]: audit 2024-09-16T11:34:24.026248+0000 mgr.a (mgr.14373) 15448 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:34:25.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:34:25 smithi086 bash[24289]: audit 2024-09-16T11:34:24.026248+0000 mgr.a (mgr.14373) 15448 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:34:25.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:34:25 smithi047 bash[22744]: audit 2024-09-16T11:34:24.026248+0000 mgr.a (mgr.14373) 15448 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:34:26.297 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:34:26.298 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:34:26.298 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:34:26.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:34:26 smithi157 bash[24585]: audit 2024-09-16T11:34:24.787621+0000 mgr.a (mgr.14373) 15449 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T11:34:26.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:34:26 smithi157 bash[24585]: cephadm 2024-09-16T11:34:24.790152+0000 mgr.a (mgr.14373) 15450 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T11:34:26.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:34:26 smithi157 bash[24585]: cluster 2024-09-16T11:34:25.060415+0000 mgr.a (mgr.14373) 15451 : cluster [DBG] pgmap v10715: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:34:26.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:34:26 smithi086 bash[24289]: audit 2024-09-16T11:34:24.787621+0000 mgr.a (mgr.14373) 15449 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T11:34:26.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:34:26 smithi086 bash[24289]: cephadm 2024-09-16T11:34:24.790152+0000 mgr.a (mgr.14373) 15450 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T11:34:26.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:34:26 smithi086 bash[24289]: cluster 2024-09-16T11:34:25.060415+0000 mgr.a (mgr.14373) 15451 : cluster [DBG] pgmap v10715: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:34:26.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:34:26 smithi047 bash[22744]: audit 2024-09-16T11:34:24.787621+0000 mgr.a (mgr.14373) 15449 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T11:34:26.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:34:26 smithi047 bash[22744]: cephadm 2024-09-16T11:34:24.790152+0000 mgr.a (mgr.14373) 15450 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T11:34:26.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:34:26 smithi047 bash[22744]: cluster 2024-09-16T11:34:25.060415+0000 mgr.a (mgr.14373) 15451 : cluster [DBG] pgmap v10715: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:34:27.086 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:34:27.086 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:34:27.087 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:34:27.087 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:34:27.087 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:34:28.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:34:28 smithi157 bash[24585]: audit 2024-09-16T11:34:26.633573+0000 mgr.a (mgr.14373) 15452 : audit [DBG] from='client.333801 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:34:28.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:34:28 smithi157 bash[24585]: cluster 2024-09-16T11:34:27.062073+0000 mgr.a (mgr.14373) 15453 : cluster [DBG] pgmap v10716: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:34:28.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:34:28 smithi086 bash[24289]: audit 2024-09-16T11:34:26.633573+0000 mgr.a (mgr.14373) 15452 : audit [DBG] from='client.333801 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:34:28.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:34:28 smithi086 bash[24289]: cluster 2024-09-16T11:34:27.062073+0000 mgr.a (mgr.14373) 15453 : cluster [DBG] pgmap v10716: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:34:28.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:34:28 smithi047 bash[22744]: audit 2024-09-16T11:34:26.633573+0000 mgr.a (mgr.14373) 15452 : audit [DBG] from='client.333801 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:34:28.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:34:28 smithi047 bash[22744]: cluster 2024-09-16T11:34:27.062073+0000 mgr.a (mgr.14373) 15453 : cluster [DBG] pgmap v10716: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:34:30.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:34:30 smithi157 bash[24585]: cluster 2024-09-16T11:34:29.062860+0000 mgr.a (mgr.14373) 15454 : cluster [DBG] pgmap v10717: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T11:34:30.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:34:30 smithi086 bash[24289]: cluster 2024-09-16T11:34:29.062860+0000 mgr.a (mgr.14373) 15454 : cluster [DBG] pgmap v10717: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T11:34:30.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:34:30 smithi047 bash[22744]: cluster 2024-09-16T11:34:29.062860+0000 mgr.a (mgr.14373) 15454 : cluster [DBG] pgmap v10717: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T11:34:32.088 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:34:32.088 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:34:32.089 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:34:32.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:34:32 smithi157 bash[24585]: cluster 2024-09-16T11:34:31.063622+0000 mgr.a (mgr.14373) 15455 : cluster [DBG] pgmap v10718: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T11:34:32.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:34:32 smithi086 bash[24289]: cluster 2024-09-16T11:34:31.063622+0000 mgr.a (mgr.14373) 15455 : cluster [DBG] pgmap v10718: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T11:34:32.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:34:32 smithi047 bash[22744]: cluster 2024-09-16T11:34:31.063622+0000 mgr.a (mgr.14373) 15455 : cluster [DBG] pgmap v10718: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T11:34:32.844 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:34:32.844 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:34:32.844 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:34:32.844 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:34:32.844 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:34:34.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:34:34 smithi157 bash[24585]: audit 2024-09-16T11:34:32.416027+0000 mgr.a (mgr.14373) 15456 : audit [DBG] from='client.333879 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:34:34.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:34:34 smithi157 bash[24585]: cluster 2024-09-16T11:34:33.066365+0000 mgr.a (mgr.14373) 15457 : cluster [DBG] pgmap v10719: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:34:34.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:34:34 smithi086 bash[24289]: audit 2024-09-16T11:34:32.416027+0000 mgr.a (mgr.14373) 15456 : audit [DBG] from='client.333879 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:34:34.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:34:34 smithi086 bash[24289]: cluster 2024-09-16T11:34:33.066365+0000 mgr.a (mgr.14373) 15457 : cluster [DBG] pgmap v10719: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:34:34.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:34:34 smithi047 bash[22744]: audit 2024-09-16T11:34:32.416027+0000 mgr.a (mgr.14373) 15456 : audit [DBG] from='client.333879 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:34:34.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:34:34 smithi047 bash[22744]: cluster 2024-09-16T11:34:33.066365+0000 mgr.a (mgr.14373) 15457 : cluster [DBG] pgmap v10719: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:34:36.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:34:36 smithi157 bash[24585]: cluster 2024-09-16T11:34:35.067305+0000 mgr.a (mgr.14373) 15458 : cluster [DBG] pgmap v10720: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T11:34:36.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:34:36 smithi086 bash[24289]: cluster 2024-09-16T11:34:35.067305+0000 mgr.a (mgr.14373) 15458 : cluster [DBG] pgmap v10720: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T11:34:36.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:34:36 smithi047 bash[22744]: cluster 2024-09-16T11:34:35.067305+0000 mgr.a (mgr.14373) 15458 : cluster [DBG] pgmap v10720: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T11:34:37.845 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:34:37.846 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:34:37.846 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:34:38.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:34:38 smithi157 bash[24585]: cluster 2024-09-16T11:34:37.069348+0000 mgr.a (mgr.14373) 15459 : cluster [DBG] pgmap v10721: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:34:38.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:34:38 smithi086 bash[24289]: cluster 2024-09-16T11:34:37.069348+0000 mgr.a (mgr.14373) 15459 : cluster [DBG] pgmap v10721: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:34:38.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:34:38 smithi047 bash[22744]: cluster 2024-09-16T11:34:37.069348+0000 mgr.a (mgr.14373) 15459 : cluster [DBG] pgmap v10721: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:34:38.599 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:34:38.600 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:34:38.600 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:34:38.600 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:34:38.600 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:34:39.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:34:39 smithi157 bash[24585]: audit 2024-09-16T11:34:38.174139+0000 mgr.a (mgr.14373) 15460 : audit [DBG] from='client.333957 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:34:39.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:34:39 smithi086 bash[24289]: audit 2024-09-16T11:34:38.174139+0000 mgr.a (mgr.14373) 15460 : audit [DBG] from='client.333957 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:34:39.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:34:39 smithi047 bash[22744]: audit 2024-09-16T11:34:38.174139+0000 mgr.a (mgr.14373) 15460 : audit [DBG] from='client.333957 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:34:40.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:34:40 smithi157 bash[24585]: cluster 2024-09-16T11:34:39.070336+0000 mgr.a (mgr.14373) 15461 : cluster [DBG] pgmap v10722: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:34:40.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:34:40 smithi086 bash[24289]: cluster 2024-09-16T11:34:39.070336+0000 mgr.a (mgr.14373) 15461 : cluster [DBG] pgmap v10722: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:34:40.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:34:40 smithi047 bash[22744]: cluster 2024-09-16T11:34:39.070336+0000 mgr.a (mgr.14373) 15461 : cluster [DBG] pgmap v10722: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:34:42.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:34:42 smithi157 bash[24585]: cluster 2024-09-16T11:34:41.071116+0000 mgr.a (mgr.14373) 15462 : cluster [DBG] pgmap v10723: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:34:42.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:34:42 smithi086 bash[24289]: cluster 2024-09-16T11:34:41.071116+0000 mgr.a (mgr.14373) 15462 : cluster [DBG] pgmap v10723: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:34:42.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:34:42 smithi047 bash[22744]: cluster 2024-09-16T11:34:41.071116+0000 mgr.a (mgr.14373) 15462 : cluster [DBG] pgmap v10723: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:34:43.602 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:34:43.602 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:34:43.602 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:34:44.387 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:34:44.387 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:34:44.387 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:34:44.388 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:34:44.388 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:34:44.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:34:44 smithi157 bash[24585]: cluster 2024-09-16T11:34:43.073316+0000 mgr.a (mgr.14373) 15463 : cluster [DBG] pgmap v10724: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:34:44.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:34:44 smithi086 bash[24289]: cluster 2024-09-16T11:34:43.073316+0000 mgr.a (mgr.14373) 15463 : cluster [DBG] pgmap v10724: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:34:44.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:34:44 smithi047 bash[22744]: cluster 2024-09-16T11:34:43.073316+0000 mgr.a (mgr.14373) 15463 : cluster [DBG] pgmap v10724: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:34:45.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:34:45 smithi157 bash[24585]: audit 2024-09-16T11:34:43.931878+0000 mgr.a (mgr.14373) 15464 : audit [DBG] from='client.334035 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:34:45.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:34:45 smithi086 bash[24289]: audit 2024-09-16T11:34:43.931878+0000 mgr.a (mgr.14373) 15464 : audit [DBG] from='client.334035 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:34:45.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:34:45 smithi047 bash[22744]: audit 2024-09-16T11:34:43.931878+0000 mgr.a (mgr.14373) 15464 : audit [DBG] from='client.334035 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:34:46.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:34:46 smithi157 bash[24585]: cluster 2024-09-16T11:34:45.074238+0000 mgr.a (mgr.14373) 15465 : cluster [DBG] pgmap v10725: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:34:46.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:34:46 smithi086 bash[24289]: cluster 2024-09-16T11:34:45.074238+0000 mgr.a (mgr.14373) 15465 : cluster [DBG] pgmap v10725: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:34:46.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:34:46 smithi047 bash[22744]: cluster 2024-09-16T11:34:45.074238+0000 mgr.a (mgr.14373) 15465 : cluster [DBG] pgmap v10725: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:34:48.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:34:48 smithi157 bash[24585]: cluster 2024-09-16T11:34:47.076463+0000 mgr.a (mgr.14373) 15466 : cluster [DBG] pgmap v10726: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:34:48.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:34:48 smithi086 bash[24289]: cluster 2024-09-16T11:34:47.076463+0000 mgr.a (mgr.14373) 15466 : cluster [DBG] pgmap v10726: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:34:48.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:34:48 smithi047 bash[22744]: cluster 2024-09-16T11:34:47.076463+0000 mgr.a (mgr.14373) 15466 : cluster [DBG] pgmap v10726: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:34:49.389 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:34:49.390 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:34:49.390 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:34:50.148 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:34:50.148 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:34:50.148 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:34:50.148 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:34:50.149 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:34:50.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:34:50 smithi157 bash[24585]: cluster 2024-09-16T11:34:49.077222+0000 mgr.a (mgr.14373) 15467 : cluster [DBG] pgmap v10727: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:34:50.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:34:50 smithi086 bash[24289]: cluster 2024-09-16T11:34:49.077222+0000 mgr.a (mgr.14373) 15467 : cluster [DBG] pgmap v10727: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:34:50.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:34:50 smithi047 bash[22744]: cluster 2024-09-16T11:34:49.077222+0000 mgr.a (mgr.14373) 15467 : cluster [DBG] pgmap v10727: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:34:51.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:34:51 smithi157 bash[24585]: audit 2024-09-16T11:34:49.722783+0000 mgr.a (mgr.14373) 15468 : audit [DBG] from='client.334110 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:34:51.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:34:51 smithi086 bash[24289]: audit 2024-09-16T11:34:49.722783+0000 mgr.a (mgr.14373) 15468 : audit [DBG] from='client.334110 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:34:51.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:34:51 smithi047 bash[22744]: audit 2024-09-16T11:34:49.722783+0000 mgr.a (mgr.14373) 15468 : audit [DBG] from='client.334110 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:34:52.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:34:52 smithi157 bash[24585]: cluster 2024-09-16T11:34:51.078137+0000 mgr.a (mgr.14373) 15469 : cluster [DBG] pgmap v10728: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:34:52.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:34:52 smithi086 bash[24289]: cluster 2024-09-16T11:34:51.078137+0000 mgr.a (mgr.14373) 15469 : cluster [DBG] pgmap v10728: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:34:52.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:34:52 smithi047 bash[22744]: cluster 2024-09-16T11:34:51.078137+0000 mgr.a (mgr.14373) 15469 : cluster [DBG] pgmap v10728: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:34:54.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:34:54 smithi157 bash[24585]: cluster 2024-09-16T11:34:53.080330+0000 mgr.a (mgr.14373) 15470 : cluster [DBG] pgmap v10729: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:34:54.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:34:54 smithi086 bash[24289]: cluster 2024-09-16T11:34:53.080330+0000 mgr.a (mgr.14373) 15470 : cluster [DBG] pgmap v10729: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:34:54.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:34:54 smithi047 bash[22744]: cluster 2024-09-16T11:34:53.080330+0000 mgr.a (mgr.14373) 15470 : cluster [DBG] pgmap v10729: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:34:55.150 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:34:55.150 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:34:55.151 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:34:55.930 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:34:55.930 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:34:55.930 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:34:55.930 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:34:55.930 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:34:56.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:34:56 smithi157 bash[24585]: cluster 2024-09-16T11:34:55.081070+0000 mgr.a (mgr.14373) 15471 : cluster [DBG] pgmap v10730: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:34:56.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:34:56 smithi086 bash[24289]: cluster 2024-09-16T11:34:55.081070+0000 mgr.a (mgr.14373) 15471 : cluster [DBG] pgmap v10730: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:34:56.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:34:56 smithi047 bash[22744]: cluster 2024-09-16T11:34:55.081070+0000 mgr.a (mgr.14373) 15471 : cluster [DBG] pgmap v10730: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:34:57.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:34:57 smithi157 bash[24585]: audit 2024-09-16T11:34:55.486872+0000 mgr.a (mgr.14373) 15472 : audit [DBG] from='client.334188 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:34:57.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:34:57 smithi086 bash[24289]: audit 2024-09-16T11:34:55.486872+0000 mgr.a (mgr.14373) 15472 : audit [DBG] from='client.334188 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:34:57.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:34:57 smithi047 bash[22744]: audit 2024-09-16T11:34:55.486872+0000 mgr.a (mgr.14373) 15472 : audit [DBG] from='client.334188 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:34:58.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:34:58 smithi157 bash[24585]: cluster 2024-09-16T11:34:57.083397+0000 mgr.a (mgr.14373) 15473 : cluster [DBG] pgmap v10731: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:34:58.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:34:58 smithi086 bash[24289]: cluster 2024-09-16T11:34:57.083397+0000 mgr.a (mgr.14373) 15473 : cluster [DBG] pgmap v10731: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:34:58.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:34:58 smithi047 bash[22744]: cluster 2024-09-16T11:34:57.083397+0000 mgr.a (mgr.14373) 15473 : cluster [DBG] pgmap v10731: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:35:00.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:35:00 smithi157 bash[24585]: cluster 2024-09-16T11:34:59.084189+0000 mgr.a (mgr.14373) 15474 : cluster [DBG] pgmap v10732: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:35:00.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:35:00 smithi086 bash[24289]: cluster 2024-09-16T11:34:59.084189+0000 mgr.a (mgr.14373) 15474 : cluster [DBG] pgmap v10732: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:35:00.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:35:00 smithi047 bash[22744]: cluster 2024-09-16T11:34:59.084189+0000 mgr.a (mgr.14373) 15474 : cluster [DBG] pgmap v10732: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:35:00.933 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:35:00.933 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:35:00.933 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:35:01.710 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:35:01.711 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:35:01.711 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:35:01.711 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:35:01.711 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:35:02.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:35:02 smithi157 bash[24585]: cluster 2024-09-16T11:35:01.084916+0000 mgr.a (mgr.14373) 15475 : cluster [DBG] pgmap v10733: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:35:02.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:35:02 smithi157 bash[24585]: audit 2024-09-16T11:35:01.265246+0000 mgr.a (mgr.14373) 15476 : audit [DBG] from='client.334266 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:35:02.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:35:02 smithi086 bash[24289]: cluster 2024-09-16T11:35:01.084916+0000 mgr.a (mgr.14373) 15475 : cluster [DBG] pgmap v10733: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:35:02.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:35:02 smithi086 bash[24289]: audit 2024-09-16T11:35:01.265246+0000 mgr.a (mgr.14373) 15476 : audit [DBG] from='client.334266 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:35:02.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:35:02 smithi047 bash[22744]: cluster 2024-09-16T11:35:01.084916+0000 mgr.a (mgr.14373) 15475 : cluster [DBG] pgmap v10733: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:35:02.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:35:02 smithi047 bash[22744]: audit 2024-09-16T11:35:01.265246+0000 mgr.a (mgr.14373) 15476 : audit [DBG] from='client.334266 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:35:04.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:35:04 smithi157 bash[24585]: cluster 2024-09-16T11:35:03.087317+0000 mgr.a (mgr.14373) 15477 : cluster [DBG] pgmap v10734: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-16T11:35:04.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:35:04 smithi086 bash[24289]: cluster 2024-09-16T11:35:03.087317+0000 mgr.a (mgr.14373) 15477 : cluster [DBG] pgmap v10734: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-16T11:35:04.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:35:04 smithi047 bash[22744]: cluster 2024-09-16T11:35:03.087317+0000 mgr.a (mgr.14373) 15477 : cluster [DBG] pgmap v10734: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-16T11:35:06.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:35:06 smithi157 bash[24585]: cluster 2024-09-16T11:35:05.088090+0000 mgr.a (mgr.14373) 15478 : cluster [DBG] pgmap v10735: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T11:35:06.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:35:06 smithi086 bash[24289]: cluster 2024-09-16T11:35:05.088090+0000 mgr.a (mgr.14373) 15478 : cluster [DBG] pgmap v10735: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T11:35:06.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:35:06 smithi047 bash[22744]: cluster 2024-09-16T11:35:05.088090+0000 mgr.a (mgr.14373) 15478 : cluster [DBG] pgmap v10735: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T11:35:06.712 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:35:06.713 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:35:06.713 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:35:07.498 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:35:07.498 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:35:07.498 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:35:07.498 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:35:07.498 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:35:08.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:35:08 smithi157 bash[24585]: audit 2024-09-16T11:35:07.050179+0000 mgr.a (mgr.14373) 15479 : audit [DBG] from='client.334341 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:35:08.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:35:08 smithi157 bash[24585]: cluster 2024-09-16T11:35:07.090944+0000 mgr.a (mgr.14373) 15480 : cluster [DBG] pgmap v10736: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:35:08.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:35:08 smithi086 bash[24289]: audit 2024-09-16T11:35:07.050179+0000 mgr.a (mgr.14373) 15479 : audit [DBG] from='client.334341 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:35:08.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:35:08 smithi086 bash[24289]: cluster 2024-09-16T11:35:07.090944+0000 mgr.a (mgr.14373) 15480 : cluster [DBG] pgmap v10736: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:35:08.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:35:08 smithi047 bash[22744]: audit 2024-09-16T11:35:07.050179+0000 mgr.a (mgr.14373) 15479 : audit [DBG] from='client.334341 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:35:08.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:35:08 smithi047 bash[22744]: cluster 2024-09-16T11:35:07.090944+0000 mgr.a (mgr.14373) 15480 : cluster [DBG] pgmap v10736: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:35:10.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:35:10 smithi157 bash[24585]: cluster 2024-09-16T11:35:09.091879+0000 mgr.a (mgr.14373) 15481 : cluster [DBG] pgmap v10737: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:35:10.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:35:10 smithi086 bash[24289]: cluster 2024-09-16T11:35:09.091879+0000 mgr.a (mgr.14373) 15481 : cluster [DBG] pgmap v10737: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:35:10.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:35:10 smithi047 bash[22744]: cluster 2024-09-16T11:35:09.091879+0000 mgr.a (mgr.14373) 15481 : cluster [DBG] pgmap v10737: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:35:12.499 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:35:12.500 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:35:12.500 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:35:12.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:35:12 smithi086 bash[24289]: cluster 2024-09-16T11:35:11.092708+0000 mgr.a (mgr.14373) 15482 : cluster [DBG] pgmap v10738: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T11:35:12.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:35:12 smithi047 bash[22744]: cluster 2024-09-16T11:35:11.092708+0000 mgr.a (mgr.14373) 15482 : cluster [DBG] pgmap v10738: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T11:35:12.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:35:12 smithi157 bash[24585]: cluster 2024-09-16T11:35:11.092708+0000 mgr.a (mgr.14373) 15482 : cluster [DBG] pgmap v10738: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T11:35:13.281 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:35:13.281 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:35:13.281 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:35:13.281 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:35:13.281 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:35:14.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:35:14 smithi086 bash[24289]: audit 2024-09-16T11:35:12.838925+0000 mgr.a (mgr.14373) 15483 : audit [DBG] from='client.334413 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:35:14.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:35:14 smithi086 bash[24289]: cluster 2024-09-16T11:35:13.095050+0000 mgr.a (mgr.14373) 15484 : cluster [DBG] pgmap v10739: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:35:14.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:35:14 smithi047 bash[22744]: audit 2024-09-16T11:35:12.838925+0000 mgr.a (mgr.14373) 15483 : audit [DBG] from='client.334413 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:35:14.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:35:14 smithi047 bash[22744]: cluster 2024-09-16T11:35:13.095050+0000 mgr.a (mgr.14373) 15484 : cluster [DBG] pgmap v10739: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:35:14.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:35:14 smithi157 bash[24585]: audit 2024-09-16T11:35:12.838925+0000 mgr.a (mgr.14373) 15483 : audit [DBG] from='client.334413 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:35:14.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:35:14 smithi157 bash[24585]: cluster 2024-09-16T11:35:13.095050+0000 mgr.a (mgr.14373) 15484 : cluster [DBG] pgmap v10739: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:35:16.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:35:16 smithi047 bash[22744]: cluster 2024-09-16T11:35:15.096083+0000 mgr.a (mgr.14373) 15485 : cluster [DBG] pgmap v10740: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-16T11:35:16.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:35:16 smithi157 bash[24585]: cluster 2024-09-16T11:35:15.096083+0000 mgr.a (mgr.14373) 15485 : cluster [DBG] pgmap v10740: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-16T11:35:16.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:35:16 smithi086 bash[24289]: cluster 2024-09-16T11:35:15.096083+0000 mgr.a (mgr.14373) 15485 : cluster [DBG] pgmap v10740: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-16T11:35:18.282 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:35:18.283 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:35:18.283 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:35:18.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:35:18 smithi047 bash[22744]: cluster 2024-09-16T11:35:17.098537+0000 mgr.a (mgr.14373) 15486 : cluster [DBG] pgmap v10741: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-16T11:35:18.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:35:18 smithi157 bash[24585]: cluster 2024-09-16T11:35:17.098537+0000 mgr.a (mgr.14373) 15486 : cluster [DBG] pgmap v10741: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-16T11:35:18.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:35:18 smithi086 bash[24289]: cluster 2024-09-16T11:35:17.098537+0000 mgr.a (mgr.14373) 15486 : cluster [DBG] pgmap v10741: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-16T11:35:19.073 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:35:19.073 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:35:19.073 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:35:19.073 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:35:19.073 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:35:19.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:35:19 smithi157 bash[24585]: audit 2024-09-16T11:35:18.619697+0000 mgr.a (mgr.14373) 15487 : audit [DBG] from='client.334491 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:35:19.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:35:19 smithi157 bash[24585]: cluster 2024-09-16T11:35:19.099128+0000 mgr.a (mgr.14373) 15488 : cluster [DBG] pgmap v10742: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:35:19.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:35:19 smithi086 bash[24289]: audit 2024-09-16T11:35:18.619697+0000 mgr.a (mgr.14373) 15487 : audit [DBG] from='client.334491 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:35:19.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:35:19 smithi086 bash[24289]: cluster 2024-09-16T11:35:19.099128+0000 mgr.a (mgr.14373) 15488 : cluster [DBG] pgmap v10742: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:35:19.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:35:19 smithi047 bash[22744]: audit 2024-09-16T11:35:18.619697+0000 mgr.a (mgr.14373) 15487 : audit [DBG] from='client.334491 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:35:19.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:35:19 smithi047 bash[22744]: cluster 2024-09-16T11:35:19.099128+0000 mgr.a (mgr.14373) 15488 : cluster [DBG] pgmap v10742: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:35:22.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:35:22 smithi157 bash[24585]: cluster 2024-09-16T11:35:21.099865+0000 mgr.a (mgr.14373) 15489 : cluster [DBG] pgmap v10743: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:35:22.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:35:22 smithi086 bash[24289]: cluster 2024-09-16T11:35:21.099865+0000 mgr.a (mgr.14373) 15489 : cluster [DBG] pgmap v10743: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:35:22.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:35:22 smithi047 bash[22744]: cluster 2024-09-16T11:35:21.099865+0000 mgr.a (mgr.14373) 15489 : cluster [DBG] pgmap v10743: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:35:24.074 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:35:24.075 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:35:24.075 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:35:24.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:35:24 smithi157 bash[24585]: cluster 2024-09-16T11:35:23.102073+0000 mgr.a (mgr.14373) 15490 : cluster [DBG] pgmap v10744: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:35:24.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:35:24 smithi086 bash[24289]: cluster 2024-09-16T11:35:23.102073+0000 mgr.a (mgr.14373) 15490 : cluster [DBG] pgmap v10744: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:35:24.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:35:24 smithi047 bash[22744]: cluster 2024-09-16T11:35:23.102073+0000 mgr.a (mgr.14373) 15490 : cluster [DBG] pgmap v10744: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:35:24.847 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:35:24.847 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:35:24.847 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:35:24.847 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:35:24.847 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:35:25.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:35:25 smithi157 bash[24585]: audit 2024-09-16T11:35:24.842403+0000 mon.b (mon.2) 1410 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T11:35:25.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:35:25 smithi086 bash[24289]: audit 2024-09-16T11:35:24.842403+0000 mon.b (mon.2) 1410 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T11:35:25.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:35:25 smithi047 bash[22744]: audit 2024-09-16T11:35:24.842403+0000 mon.b (mon.2) 1410 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T11:35:26.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:35:26 smithi157 bash[24585]: audit 2024-09-16T11:35:24.401811+0000 mgr.a (mgr.14373) 15491 : audit [DBG] from='client.334569 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:35:26.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:35:26 smithi157 bash[24585]: cluster 2024-09-16T11:35:25.102992+0000 mgr.a (mgr.14373) 15492 : cluster [DBG] pgmap v10745: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:35:26.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:35:26 smithi157 bash[24585]: audit 2024-09-16T11:35:25.591557+0000 mon.b (mon.2) 1411 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T11:35:26.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:35:26 smithi157 bash[24585]: audit 2024-09-16T11:35:25.593468+0000 mon.b (mon.2) 1412 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T11:35:26.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:35:26 smithi157 bash[24585]: audit 2024-09-16T11:35:25.605071+0000 mon.a (mon.0) 1488 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:35:26.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:35:26 smithi157 bash[24585]: audit 2024-09-16T11:35:25.608554+0000 mon.b (mon.2) 1413 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:35:26.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:35:26 smithi086 bash[24289]: audit 2024-09-16T11:35:24.401811+0000 mgr.a (mgr.14373) 15491 : audit [DBG] from='client.334569 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:35:26.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:35:26 smithi086 bash[24289]: cluster 2024-09-16T11:35:25.102992+0000 mgr.a (mgr.14373) 15492 : cluster [DBG] pgmap v10745: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:35:26.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:35:26 smithi086 bash[24289]: audit 2024-09-16T11:35:25.591557+0000 mon.b (mon.2) 1411 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T11:35:26.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:35:26 smithi086 bash[24289]: audit 2024-09-16T11:35:25.593468+0000 mon.b (mon.2) 1412 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T11:35:26.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:35:26 smithi086 bash[24289]: audit 2024-09-16T11:35:25.605071+0000 mon.a (mon.0) 1488 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:35:26.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:35:26 smithi086 bash[24289]: audit 2024-09-16T11:35:25.608554+0000 mon.b (mon.2) 1413 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:35:26.592 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 11:35:26 smithi047 bash[22994]: debug 2024-09-16T11:35:26.349+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T11:35:26.593 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 11:35:26 smithi047 bash[22994]: debug 2024-09-16T11:35:26.349+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T11:35:26.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:35:26 smithi047 bash[22744]: audit 2024-09-16T11:35:24.401811+0000 mgr.a (mgr.14373) 15491 : audit [DBG] from='client.334569 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:35:26.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:35:26 smithi047 bash[22744]: cluster 2024-09-16T11:35:25.102992+0000 mgr.a (mgr.14373) 15492 : cluster [DBG] pgmap v10745: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:35:26.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:35:26 smithi047 bash[22744]: audit 2024-09-16T11:35:25.591557+0000 mon.b (mon.2) 1411 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T11:35:26.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:35:26 smithi047 bash[22744]: audit 2024-09-16T11:35:25.593468+0000 mon.b (mon.2) 1412 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T11:35:26.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:35:26 smithi047 bash[22744]: audit 2024-09-16T11:35:25.605071+0000 mon.a (mon.0) 1488 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:35:26.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:35:26 smithi047 bash[22744]: audit 2024-09-16T11:35:25.608554+0000 mon.b (mon.2) 1413 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:35:27.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:35:27 smithi157 bash[24585]: audit 2024-09-16T11:35:25.610709+0000 mgr.a (mgr.14373) 15493 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:35:27.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:35:27 smithi086 bash[24289]: audit 2024-09-16T11:35:25.610709+0000 mgr.a (mgr.14373) 15493 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:35:27.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:35:27 smithi047 bash[22744]: audit 2024-09-16T11:35:25.610709+0000 mgr.a (mgr.14373) 15493 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:35:28.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:35:28 smithi157 bash[24585]: audit 2024-09-16T11:35:26.351763+0000 mgr.a (mgr.14373) 15494 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T11:35:28.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:35:28 smithi157 bash[24585]: cephadm 2024-09-16T11:35:26.353576+0000 mgr.a (mgr.14373) 15495 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T11:35:28.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:35:28 smithi157 bash[24585]: cluster 2024-09-16T11:35:27.105332+0000 mgr.a (mgr.14373) 15496 : cluster [DBG] pgmap v10746: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:35:28.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:35:28 smithi086 bash[24289]: audit 2024-09-16T11:35:26.351763+0000 mgr.a (mgr.14373) 15494 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T11:35:28.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:35:28 smithi086 bash[24289]: cephadm 2024-09-16T11:35:26.353576+0000 mgr.a (mgr.14373) 15495 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T11:35:28.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:35:28 smithi086 bash[24289]: cluster 2024-09-16T11:35:27.105332+0000 mgr.a (mgr.14373) 15496 : cluster [DBG] pgmap v10746: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:35:28.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:35:28 smithi047 bash[22744]: audit 2024-09-16T11:35:26.351763+0000 mgr.a (mgr.14373) 15494 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T11:35:28.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:35:28 smithi047 bash[22744]: cephadm 2024-09-16T11:35:26.353576+0000 mgr.a (mgr.14373) 15495 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T11:35:28.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:35:28 smithi047 bash[22744]: cluster 2024-09-16T11:35:27.105332+0000 mgr.a (mgr.14373) 15496 : cluster [DBG] pgmap v10746: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:35:29.848 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:35:29.849 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:35:29.849 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:35:30.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:35:30 smithi157 bash[24585]: cluster 2024-09-16T11:35:29.106082+0000 mgr.a (mgr.14373) 15497 : cluster [DBG] pgmap v10747: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:35:30.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:35:30 smithi086 bash[24289]: cluster 2024-09-16T11:35:29.106082+0000 mgr.a (mgr.14373) 15497 : cluster [DBG] pgmap v10747: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:35:30.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:35:30 smithi047 bash[22744]: cluster 2024-09-16T11:35:29.106082+0000 mgr.a (mgr.14373) 15497 : cluster [DBG] pgmap v10747: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:35:30.601 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:35:30.601 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:35:30.601 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:35:30.602 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:35:30.602 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:35:31.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:35:31 smithi157 bash[24585]: audit 2024-09-16T11:35:30.178432+0000 mgr.a (mgr.14373) 15498 : audit [DBG] from='client.334752 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:35:31.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:35:31 smithi086 bash[24289]: audit 2024-09-16T11:35:30.178432+0000 mgr.a (mgr.14373) 15498 : audit [DBG] from='client.334752 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:35:31.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:35:31 smithi047 bash[22744]: audit 2024-09-16T11:35:30.178432+0000 mgr.a (mgr.14373) 15498 : audit [DBG] from='client.334752 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:35:32.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:35:32 smithi157 bash[24585]: cluster 2024-09-16T11:35:31.107018+0000 mgr.a (mgr.14373) 15499 : cluster [DBG] pgmap v10748: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:35:32.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:35:32 smithi086 bash[24289]: cluster 2024-09-16T11:35:31.107018+0000 mgr.a (mgr.14373) 15499 : cluster [DBG] pgmap v10748: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:35:32.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:35:32 smithi047 bash[22744]: cluster 2024-09-16T11:35:31.107018+0000 mgr.a (mgr.14373) 15499 : cluster [DBG] pgmap v10748: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:35:34.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:35:34 smithi157 bash[24585]: cluster 2024-09-16T11:35:33.109249+0000 mgr.a (mgr.14373) 15500 : cluster [DBG] pgmap v10749: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:35:34.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:35:34 smithi086 bash[24289]: cluster 2024-09-16T11:35:33.109249+0000 mgr.a (mgr.14373) 15500 : cluster [DBG] pgmap v10749: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:35:34.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:35:34 smithi047 bash[22744]: cluster 2024-09-16T11:35:33.109249+0000 mgr.a (mgr.14373) 15500 : cluster [DBG] pgmap v10749: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:35:35.603 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:35:35.604 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:35:35.604 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:35:36.374 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:35:36.374 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:35:36.374 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:35:36.374 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:35:36.374 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:35:36.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:35:36 smithi157 bash[24585]: cluster 2024-09-16T11:35:35.110010+0000 mgr.a (mgr.14373) 15501 : cluster [DBG] pgmap v10750: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:35:36.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:35:36 smithi086 bash[24289]: cluster 2024-09-16T11:35:35.110010+0000 mgr.a (mgr.14373) 15501 : cluster [DBG] pgmap v10750: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:35:36.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:35:36 smithi047 bash[22744]: cluster 2024-09-16T11:35:35.110010+0000 mgr.a (mgr.14373) 15501 : cluster [DBG] pgmap v10750: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:35:37.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:35:37 smithi157 bash[24585]: audit 2024-09-16T11:35:35.939734+0000 mgr.a (mgr.14373) 15502 : audit [DBG] from='client.334830 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:35:37.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:35:37 smithi086 bash[24289]: audit 2024-09-16T11:35:35.939734+0000 mgr.a (mgr.14373) 15502 : audit [DBG] from='client.334830 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:35:37.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:35:37 smithi047 bash[22744]: audit 2024-09-16T11:35:35.939734+0000 mgr.a (mgr.14373) 15502 : audit [DBG] from='client.334830 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:35:38.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:35:38 smithi157 bash[24585]: cluster 2024-09-16T11:35:37.112337+0000 mgr.a (mgr.14373) 15503 : cluster [DBG] pgmap v10751: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:35:38.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:35:38 smithi086 bash[24289]: cluster 2024-09-16T11:35:37.112337+0000 mgr.a (mgr.14373) 15503 : cluster [DBG] pgmap v10751: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:35:38.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:35:38 smithi047 bash[22744]: cluster 2024-09-16T11:35:37.112337+0000 mgr.a (mgr.14373) 15503 : cluster [DBG] pgmap v10751: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:35:40.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:35:40 smithi157 bash[24585]: cluster 2024-09-16T11:35:39.113063+0000 mgr.a (mgr.14373) 15504 : cluster [DBG] pgmap v10752: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:35:40.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:35:40 smithi086 bash[24289]: cluster 2024-09-16T11:35:39.113063+0000 mgr.a (mgr.14373) 15504 : cluster [DBG] pgmap v10752: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:35:40.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:35:40 smithi047 bash[22744]: cluster 2024-09-16T11:35:39.113063+0000 mgr.a (mgr.14373) 15504 : cluster [DBG] pgmap v10752: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:35:41.376 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:35:41.376 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:35:41.376 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:35:42.122 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:35:42.122 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:35:42.123 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:35:42.123 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:35:42.123 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:35:42.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:35:42 smithi157 bash[24585]: cluster 2024-09-16T11:35:41.113941+0000 mgr.a (mgr.14373) 15505 : cluster [DBG] pgmap v10753: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:35:42.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:35:42 smithi086 bash[24289]: cluster 2024-09-16T11:35:41.113941+0000 mgr.a (mgr.14373) 15505 : cluster [DBG] pgmap v10753: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:35:42.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:35:42 smithi047 bash[22744]: cluster 2024-09-16T11:35:41.113941+0000 mgr.a (mgr.14373) 15505 : cluster [DBG] pgmap v10753: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:35:43.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:35:43 smithi157 bash[24585]: audit 2024-09-16T11:35:41.706175+0000 mgr.a (mgr.14373) 15506 : audit [DBG] from='client.334908 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:35:43.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:35:43 smithi086 bash[24289]: audit 2024-09-16T11:35:41.706175+0000 mgr.a (mgr.14373) 15506 : audit [DBG] from='client.334908 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:35:43.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:35:43 smithi047 bash[22744]: audit 2024-09-16T11:35:41.706175+0000 mgr.a (mgr.14373) 15506 : audit [DBG] from='client.334908 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:35:44.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:35:44 smithi157 bash[24585]: cluster 2024-09-16T11:35:43.116619+0000 mgr.a (mgr.14373) 15507 : cluster [DBG] pgmap v10754: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:35:44.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:35:44 smithi086 bash[24289]: cluster 2024-09-16T11:35:43.116619+0000 mgr.a (mgr.14373) 15507 : cluster [DBG] pgmap v10754: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:35:44.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:35:44 smithi047 bash[22744]: cluster 2024-09-16T11:35:43.116619+0000 mgr.a (mgr.14373) 15507 : cluster [DBG] pgmap v10754: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:35:46.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:35:46 smithi157 bash[24585]: cluster 2024-09-16T11:35:45.117370+0000 mgr.a (mgr.14373) 15508 : cluster [DBG] pgmap v10755: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:35:46.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:35:46 smithi086 bash[24289]: cluster 2024-09-16T11:35:45.117370+0000 mgr.a (mgr.14373) 15508 : cluster [DBG] pgmap v10755: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:35:46.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:35:46 smithi047 bash[22744]: cluster 2024-09-16T11:35:45.117370+0000 mgr.a (mgr.14373) 15508 : cluster [DBG] pgmap v10755: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:35:47.124 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:35:47.125 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:35:47.125 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:35:47.903 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:35:47.903 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:35:47.903 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:35:47.903 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:35:47.903 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:35:48.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:35:48 smithi157 bash[24585]: cluster 2024-09-16T11:35:47.119430+0000 mgr.a (mgr.14373) 15509 : cluster [DBG] pgmap v10756: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:35:48.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:35:48 smithi086 bash[24289]: cluster 2024-09-16T11:35:47.119430+0000 mgr.a (mgr.14373) 15509 : cluster [DBG] pgmap v10756: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:35:48.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:35:48 smithi047 bash[22744]: cluster 2024-09-16T11:35:47.119430+0000 mgr.a (mgr.14373) 15509 : cluster [DBG] pgmap v10756: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:35:49.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:35:49 smithi157 bash[24585]: audit 2024-09-16T11:35:47.457868+0000 mgr.a (mgr.14373) 15510 : audit [DBG] from='client.334986 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:35:49.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:35:49 smithi086 bash[24289]: audit 2024-09-16T11:35:47.457868+0000 mgr.a (mgr.14373) 15510 : audit [DBG] from='client.334986 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:35:49.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:35:49 smithi047 bash[22744]: audit 2024-09-16T11:35:47.457868+0000 mgr.a (mgr.14373) 15510 : audit [DBG] from='client.334986 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:35:50.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:35:50 smithi157 bash[24585]: cluster 2024-09-16T11:35:49.120299+0000 mgr.a (mgr.14373) 15511 : cluster [DBG] pgmap v10757: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:35:50.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:35:50 smithi086 bash[24289]: cluster 2024-09-16T11:35:49.120299+0000 mgr.a (mgr.14373) 15511 : cluster [DBG] pgmap v10757: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:35:50.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:35:50 smithi047 bash[22744]: cluster 2024-09-16T11:35:49.120299+0000 mgr.a (mgr.14373) 15511 : cluster [DBG] pgmap v10757: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:35:52.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:35:52 smithi157 bash[24585]: cluster 2024-09-16T11:35:51.121080+0000 mgr.a (mgr.14373) 15512 : cluster [DBG] pgmap v10758: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T11:35:52.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:35:52 smithi086 bash[24289]: cluster 2024-09-16T11:35:51.121080+0000 mgr.a (mgr.14373) 15512 : cluster [DBG] pgmap v10758: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T11:35:52.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:35:52 smithi047 bash[22744]: cluster 2024-09-16T11:35:51.121080+0000 mgr.a (mgr.14373) 15512 : cluster [DBG] pgmap v10758: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T11:35:52.904 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:35:52.905 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:35:52.905 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:35:53.654 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:35:53.654 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:35:53.654 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:35:53.654 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:35:53.654 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:35:54.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:35:54 smithi157 bash[24585]: cluster 2024-09-16T11:35:53.122457+0000 mgr.a (mgr.14373) 15513 : cluster [DBG] pgmap v10759: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:35:54.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:35:54 smithi157 bash[24585]: audit 2024-09-16T11:35:53.239251+0000 mgr.a (mgr.14373) 15514 : audit [DBG] from='client.335058 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:35:54.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:35:54 smithi086 bash[24289]: cluster 2024-09-16T11:35:53.122457+0000 mgr.a (mgr.14373) 15513 : cluster [DBG] pgmap v10759: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:35:54.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:35:54 smithi086 bash[24289]: audit 2024-09-16T11:35:53.239251+0000 mgr.a (mgr.14373) 15514 : audit [DBG] from='client.335058 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:35:54.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:35:54 smithi047 bash[22744]: cluster 2024-09-16T11:35:53.122457+0000 mgr.a (mgr.14373) 15513 : cluster [DBG] pgmap v10759: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:35:54.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:35:54 smithi047 bash[22744]: audit 2024-09-16T11:35:53.239251+0000 mgr.a (mgr.14373) 15514 : audit [DBG] from='client.335058 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:35:56.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:35:56 smithi157 bash[24585]: cluster 2024-09-16T11:35:55.123323+0000 mgr.a (mgr.14373) 15515 : cluster [DBG] pgmap v10760: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:35:56.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:35:56 smithi086 bash[24289]: cluster 2024-09-16T11:35:55.123323+0000 mgr.a (mgr.14373) 15515 : cluster [DBG] pgmap v10760: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:35:56.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:35:56 smithi047 bash[22744]: cluster 2024-09-16T11:35:55.123323+0000 mgr.a (mgr.14373) 15515 : cluster [DBG] pgmap v10760: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:35:58.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:35:58 smithi157 bash[24585]: cluster 2024-09-16T11:35:57.125561+0000 mgr.a (mgr.14373) 15516 : cluster [DBG] pgmap v10761: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:35:58.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:35:58 smithi086 bash[24289]: cluster 2024-09-16T11:35:57.125561+0000 mgr.a (mgr.14373) 15516 : cluster [DBG] pgmap v10761: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:35:58.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:35:58 smithi047 bash[22744]: cluster 2024-09-16T11:35:57.125561+0000 mgr.a (mgr.14373) 15516 : cluster [DBG] pgmap v10761: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:35:58.656 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:35:58.657 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:35:58.657 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:35:59.448 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:35:59.448 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:35:59.448 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:35:59.448 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:35:59.449 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:36:00.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:36:00 smithi157 bash[24585]: audit 2024-09-16T11:35:58.992731+0000 mgr.a (mgr.14373) 15517 : audit [DBG] from='client.335136 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:36:00.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:36:00 smithi157 bash[24585]: cluster 2024-09-16T11:35:59.126068+0000 mgr.a (mgr.14373) 15518 : cluster [DBG] pgmap v10762: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:36:00.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:36:00 smithi086 bash[24289]: audit 2024-09-16T11:35:58.992731+0000 mgr.a (mgr.14373) 15517 : audit [DBG] from='client.335136 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:36:00.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:36:00 smithi086 bash[24289]: cluster 2024-09-16T11:35:59.126068+0000 mgr.a (mgr.14373) 15518 : cluster [DBG] pgmap v10762: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:36:00.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:36:00 smithi047 bash[22744]: audit 2024-09-16T11:35:58.992731+0000 mgr.a (mgr.14373) 15517 : audit [DBG] from='client.335136 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:36:00.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:36:00 smithi047 bash[22744]: cluster 2024-09-16T11:35:59.126068+0000 mgr.a (mgr.14373) 15518 : cluster [DBG] pgmap v10762: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:36:02.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:36:02 smithi157 bash[24585]: cluster 2024-09-16T11:36:01.126965+0000 mgr.a (mgr.14373) 15519 : cluster [DBG] pgmap v10763: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:36:02.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:36:02 smithi086 bash[24289]: cluster 2024-09-16T11:36:01.126965+0000 mgr.a (mgr.14373) 15519 : cluster [DBG] pgmap v10763: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:36:02.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:36:02 smithi047 bash[22744]: cluster 2024-09-16T11:36:01.126965+0000 mgr.a (mgr.14373) 15519 : cluster [DBG] pgmap v10763: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:36:04.450 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:36:04.450 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:36:04.450 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:36:04.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:36:04 smithi157 bash[24585]: cluster 2024-09-16T11:36:03.129241+0000 mgr.a (mgr.14373) 15520 : cluster [DBG] pgmap v10764: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:36:04.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:36:04 smithi086 bash[24289]: cluster 2024-09-16T11:36:03.129241+0000 mgr.a (mgr.14373) 15520 : cluster [DBG] pgmap v10764: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:36:04.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:36:04 smithi047 bash[22744]: cluster 2024-09-16T11:36:03.129241+0000 mgr.a (mgr.14373) 15520 : cluster [DBG] pgmap v10764: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:36:05.213 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:36:05.213 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:36:05.213 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:36:05.213 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:36:05.214 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:36:06.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:36:06 smithi157 bash[24585]: audit 2024-09-16T11:36:04.779403+0000 mgr.a (mgr.14373) 15521 : audit [DBG] from='client.335211 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:36:06.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:36:06 smithi157 bash[24585]: cluster 2024-09-16T11:36:05.129770+0000 mgr.a (mgr.14373) 15522 : cluster [DBG] pgmap v10765: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:36:06.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:36:06 smithi086 bash[24289]: audit 2024-09-16T11:36:04.779403+0000 mgr.a (mgr.14373) 15521 : audit [DBG] from='client.335211 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:36:06.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:36:06 smithi086 bash[24289]: cluster 2024-09-16T11:36:05.129770+0000 mgr.a (mgr.14373) 15522 : cluster [DBG] pgmap v10765: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:36:06.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:36:06 smithi047 bash[22744]: audit 2024-09-16T11:36:04.779403+0000 mgr.a (mgr.14373) 15521 : audit [DBG] from='client.335211 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:36:06.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:36:06 smithi047 bash[22744]: cluster 2024-09-16T11:36:05.129770+0000 mgr.a (mgr.14373) 15522 : cluster [DBG] pgmap v10765: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:36:08.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:36:08 smithi157 bash[24585]: cluster 2024-09-16T11:36:07.132243+0000 mgr.a (mgr.14373) 15523 : cluster [DBG] pgmap v10766: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:36:08.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:36:08 smithi086 bash[24289]: cluster 2024-09-16T11:36:07.132243+0000 mgr.a (mgr.14373) 15523 : cluster [DBG] pgmap v10766: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:36:08.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:36:08 smithi047 bash[22744]: cluster 2024-09-16T11:36:07.132243+0000 mgr.a (mgr.14373) 15523 : cluster [DBG] pgmap v10766: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:36:10.215 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:36:10.215 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:36:10.215 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:36:10.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:36:10 smithi157 bash[24585]: cluster 2024-09-16T11:36:09.133202+0000 mgr.a (mgr.14373) 15524 : cluster [DBG] pgmap v10767: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:36:10.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:36:10 smithi086 bash[24289]: cluster 2024-09-16T11:36:09.133202+0000 mgr.a (mgr.14373) 15524 : cluster [DBG] pgmap v10767: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:36:10.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:36:10 smithi047 bash[22744]: cluster 2024-09-16T11:36:09.133202+0000 mgr.a (mgr.14373) 15524 : cluster [DBG] pgmap v10767: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:36:10.988 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:36:10.988 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:36:10.988 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:36:10.988 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:36:10.988 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:36:12.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:36:12 smithi157 bash[24585]: audit 2024-09-16T11:36:10.547809+0000 mgr.a (mgr.14373) 15525 : audit [DBG] from='client.335286 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:36:12.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:36:12 smithi157 bash[24585]: cluster 2024-09-16T11:36:11.134334+0000 mgr.a (mgr.14373) 15526 : cluster [DBG] pgmap v10768: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:36:12.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:36:12 smithi086 bash[24289]: audit 2024-09-16T11:36:10.547809+0000 mgr.a (mgr.14373) 15525 : audit [DBG] from='client.335286 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:36:12.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:36:12 smithi086 bash[24289]: cluster 2024-09-16T11:36:11.134334+0000 mgr.a (mgr.14373) 15526 : cluster [DBG] pgmap v10768: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:36:12.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:36:12 smithi047 bash[22744]: audit 2024-09-16T11:36:10.547809+0000 mgr.a (mgr.14373) 15525 : audit [DBG] from='client.335286 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:36:12.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:36:12 smithi047 bash[22744]: cluster 2024-09-16T11:36:11.134334+0000 mgr.a (mgr.14373) 15526 : cluster [DBG] pgmap v10768: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:36:14.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:36:14 smithi086 bash[24289]: cluster 2024-09-16T11:36:13.136615+0000 mgr.a (mgr.14373) 15527 : cluster [DBG] pgmap v10769: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:36:14.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:36:14 smithi047 bash[22744]: cluster 2024-09-16T11:36:13.136615+0000 mgr.a (mgr.14373) 15527 : cluster [DBG] pgmap v10769: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:36:14.809 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:36:14 smithi157 bash[24585]: cluster 2024-09-16T11:36:13.136615+0000 mgr.a (mgr.14373) 15527 : cluster [DBG] pgmap v10769: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:36:15.989 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:36:15.990 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:36:15.990 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:36:16.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:36:16 smithi086 bash[24289]: cluster 2024-09-16T11:36:15.137382+0000 mgr.a (mgr.14373) 15528 : cluster [DBG] pgmap v10770: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:36:16.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:36:16 smithi047 bash[22744]: cluster 2024-09-16T11:36:15.137382+0000 mgr.a (mgr.14373) 15528 : cluster [DBG] pgmap v10770: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:36:16.750 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:36:16.751 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:36:16.751 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:36:16.751 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:36:16.751 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:36:16.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:36:16 smithi157 bash[24585]: cluster 2024-09-16T11:36:15.137382+0000 mgr.a (mgr.14373) 15528 : cluster [DBG] pgmap v10770: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:36:17.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:36:17 smithi047 bash[22744]: audit 2024-09-16T11:36:16.320127+0000 mgr.a (mgr.14373) 15529 : audit [DBG] from='client.335364 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:36:17.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:36:17 smithi157 bash[24585]: audit 2024-09-16T11:36:16.320127+0000 mgr.a (mgr.14373) 15529 : audit [DBG] from='client.335364 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:36:17.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:36:17 smithi086 bash[24289]: audit 2024-09-16T11:36:16.320127+0000 mgr.a (mgr.14373) 15529 : audit [DBG] from='client.335364 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:36:18.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:36:18 smithi047 bash[22744]: cluster 2024-09-16T11:36:17.139822+0000 mgr.a (mgr.14373) 15530 : cluster [DBG] pgmap v10771: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-16T11:36:18.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:36:18 smithi157 bash[24585]: cluster 2024-09-16T11:36:17.139822+0000 mgr.a (mgr.14373) 15530 : cluster [DBG] pgmap v10771: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-16T11:36:18.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:36:18 smithi086 bash[24289]: cluster 2024-09-16T11:36:17.139822+0000 mgr.a (mgr.14373) 15530 : cluster [DBG] pgmap v10771: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-16T11:36:20.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:36:20 smithi047 bash[22744]: cluster 2024-09-16T11:36:19.140641+0000 mgr.a (mgr.14373) 15531 : cluster [DBG] pgmap v10772: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T11:36:20.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:36:20 smithi157 bash[24585]: cluster 2024-09-16T11:36:19.140641+0000 mgr.a (mgr.14373) 15531 : cluster [DBG] pgmap v10772: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T11:36:20.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:36:20 smithi086 bash[24289]: cluster 2024-09-16T11:36:19.140641+0000 mgr.a (mgr.14373) 15531 : cluster [DBG] pgmap v10772: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T11:36:21.752 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:36:21.753 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:36:21.753 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:36:22.540 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:36:22.540 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:36:22.540 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:36:22.540 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:36:22.540 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:36:22.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:36:22 smithi047 bash[22744]: cluster 2024-09-16T11:36:21.141419+0000 mgr.a (mgr.14373) 15532 : cluster [DBG] pgmap v10773: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T11:36:22.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:36:22 smithi157 bash[24585]: cluster 2024-09-16T11:36:21.141419+0000 mgr.a (mgr.14373) 15532 : cluster [DBG] pgmap v10773: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T11:36:22.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:36:22 smithi086 bash[24289]: cluster 2024-09-16T11:36:21.141419+0000 mgr.a (mgr.14373) 15532 : cluster [DBG] pgmap v10773: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T11:36:23.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:36:23 smithi047 bash[22744]: audit 2024-09-16T11:36:22.088876+0000 mgr.a (mgr.14373) 15533 : audit [DBG] from='client.335439 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:36:23.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:36:23 smithi157 bash[24585]: audit 2024-09-16T11:36:22.088876+0000 mgr.a (mgr.14373) 15533 : audit [DBG] from='client.335439 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:36:23.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:36:23 smithi086 bash[24289]: audit 2024-09-16T11:36:22.088876+0000 mgr.a (mgr.14373) 15533 : audit [DBG] from='client.335439 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:36:24.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:36:24 smithi157 bash[24585]: cluster 2024-09-16T11:36:23.144315+0000 mgr.a (mgr.14373) 15534 : cluster [DBG] pgmap v10774: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:36:24.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:36:24 smithi086 bash[24289]: cluster 2024-09-16T11:36:23.144315+0000 mgr.a (mgr.14373) 15534 : cluster [DBG] pgmap v10774: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:36:24.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:36:24 smithi047 bash[22744]: cluster 2024-09-16T11:36:23.144315+0000 mgr.a (mgr.14373) 15534 : cluster [DBG] pgmap v10774: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:36:26.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:36:26 smithi157 bash[24585]: cluster 2024-09-16T11:36:25.145120+0000 mgr.a (mgr.14373) 15535 : cluster [DBG] pgmap v10775: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:36:26.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:36:26 smithi086 bash[24289]: cluster 2024-09-16T11:36:25.145120+0000 mgr.a (mgr.14373) 15535 : cluster [DBG] pgmap v10775: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:36:26.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:36:26 smithi047 bash[22744]: cluster 2024-09-16T11:36:25.145120+0000 mgr.a (mgr.14373) 15535 : cluster [DBG] pgmap v10775: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:36:27.541 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:36:27.542 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:36:27.542 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:36:27.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:36:27 smithi157 bash[24585]: audit 2024-09-16T11:36:26.404129+0000 mon.b (mon.2) 1414 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T11:36:27.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:36:27 smithi157 bash[24585]: cluster 2024-09-16T11:36:27.147174+0000 mgr.a (mgr.14373) 15536 : cluster [DBG] pgmap v10776: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:36:27.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:36:27 smithi086 bash[24289]: audit 2024-09-16T11:36:26.404129+0000 mon.b (mon.2) 1414 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T11:36:27.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:36:27 smithi086 bash[24289]: cluster 2024-09-16T11:36:27.147174+0000 mgr.a (mgr.14373) 15536 : cluster [DBG] pgmap v10776: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:36:27.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:36:27 smithi047 bash[22744]: audit 2024-09-16T11:36:26.404129+0000 mon.b (mon.2) 1414 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T11:36:27.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:36:27 smithi047 bash[22744]: cluster 2024-09-16T11:36:27.147174+0000 mgr.a (mgr.14373) 15536 : cluster [DBG] pgmap v10776: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:36:28.311 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:36:28.311 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:36:28.311 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:36:28.311 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:36:28.311 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:36:28.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:36:28 smithi157 bash[24585]: audit 2024-09-16T11:36:27.876838+0000 mgr.a (mgr.14373) 15537 : audit [DBG] from='client.335514 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:36:28.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:36:28 smithi086 bash[24289]: audit 2024-09-16T11:36:27.876838+0000 mgr.a (mgr.14373) 15537 : audit [DBG] from='client.335514 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:36:28.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:36:28 smithi047 bash[22744]: audit 2024-09-16T11:36:27.876838+0000 mgr.a (mgr.14373) 15537 : audit [DBG] from='client.335514 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:36:29.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:36:29 smithi157 bash[24585]: cluster 2024-09-16T11:36:29.148171+0000 mgr.a (mgr.14373) 15538 : cluster [DBG] pgmap v10777: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-16T11:36:29.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:36:29 smithi086 bash[24289]: cluster 2024-09-16T11:36:29.148171+0000 mgr.a (mgr.14373) 15538 : cluster [DBG] pgmap v10777: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-16T11:36:29.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:36:29 smithi047 bash[22744]: cluster 2024-09-16T11:36:29.148171+0000 mgr.a (mgr.14373) 15538 : cluster [DBG] pgmap v10777: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-16T11:36:32.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:36:32 smithi157 bash[24585]: cluster 2024-09-16T11:36:31.148994+0000 mgr.a (mgr.14373) 15539 : cluster [DBG] pgmap v10778: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-16T11:36:32.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:36:32 smithi157 bash[24585]: audit 2024-09-16T11:36:31.751343+0000 mon.a (mon.0) 1489 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:36:32.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:36:32 smithi157 bash[24585]: audit 2024-09-16T11:36:31.758910+0000 mon.a (mon.0) 1490 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:36:32.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:36:32 smithi157 bash[24585]: audit 2024-09-16T11:36:31.789861+0000 mon.a (mon.0) 1491 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:36:32.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:36:32 smithi157 bash[24585]: audit 2024-09-16T11:36:31.792382+0000 mon.a (mon.0) 1492 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:36:32.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:36:32 smithi157 bash[24585]: audit 2024-09-16T11:36:31.796118+0000 mon.a (mon.0) 1493 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:36:32.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:36:32 smithi157 bash[24585]: audit 2024-09-16T11:36:31.799175+0000 mon.a (mon.0) 1494 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:36:32.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:36:32 smithi086 bash[24289]: cluster 2024-09-16T11:36:31.148994+0000 mgr.a (mgr.14373) 15539 : cluster [DBG] pgmap v10778: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-16T11:36:32.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:36:32 smithi086 bash[24289]: audit 2024-09-16T11:36:31.751343+0000 mon.a (mon.0) 1489 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:36:32.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:36:32 smithi086 bash[24289]: audit 2024-09-16T11:36:31.758910+0000 mon.a (mon.0) 1490 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:36:32.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:36:32 smithi086 bash[24289]: audit 2024-09-16T11:36:31.789861+0000 mon.a (mon.0) 1491 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:36:32.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:36:32 smithi086 bash[24289]: audit 2024-09-16T11:36:31.792382+0000 mon.a (mon.0) 1492 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:36:32.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:36:32 smithi086 bash[24289]: audit 2024-09-16T11:36:31.796118+0000 mon.a (mon.0) 1493 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:36:32.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:36:32 smithi086 bash[24289]: audit 2024-09-16T11:36:31.799175+0000 mon.a (mon.0) 1494 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:36:32.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:36:32 smithi047 bash[22744]: cluster 2024-09-16T11:36:31.148994+0000 mgr.a (mgr.14373) 15539 : cluster [DBG] pgmap v10778: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-16T11:36:32.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:36:32 smithi047 bash[22744]: audit 2024-09-16T11:36:31.751343+0000 mon.a (mon.0) 1489 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:36:32.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:36:32 smithi047 bash[22744]: audit 2024-09-16T11:36:31.758910+0000 mon.a (mon.0) 1490 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:36:32.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:36:32 smithi047 bash[22744]: audit 2024-09-16T11:36:31.789861+0000 mon.a (mon.0) 1491 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:36:32.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:36:32 smithi047 bash[22744]: audit 2024-09-16T11:36:31.792382+0000 mon.a (mon.0) 1492 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:36:32.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:36:32 smithi047 bash[22744]: audit 2024-09-16T11:36:31.796118+0000 mon.a (mon.0) 1493 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:36:32.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:36:32 smithi047 bash[22744]: audit 2024-09-16T11:36:31.799175+0000 mon.a (mon.0) 1494 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:36:33.312 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:36:33.313 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:36:33.313 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:36:33.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:36:33 smithi157 bash[24585]: audit 2024-09-16T11:36:32.500677+0000 mon.b (mon.2) 1415 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T11:36:33.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:36:33 smithi157 bash[24585]: audit 2024-09-16T11:36:32.502943+0000 mon.b (mon.2) 1416 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T11:36:33.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:36:33 smithi157 bash[24585]: audit 2024-09-16T11:36:32.515022+0000 mon.a (mon.0) 1495 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:36:33.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:36:33 smithi157 bash[24585]: audit 2024-09-16T11:36:32.519940+0000 mon.b (mon.2) 1417 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:36:33.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:36:33 smithi086 bash[24289]: audit 2024-09-16T11:36:32.500677+0000 mon.b (mon.2) 1415 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T11:36:33.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:36:33 smithi086 bash[24289]: audit 2024-09-16T11:36:32.502943+0000 mon.b (mon.2) 1416 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T11:36:33.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:36:33 smithi086 bash[24289]: audit 2024-09-16T11:36:32.515022+0000 mon.a (mon.0) 1495 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:36:33.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:36:33 smithi086 bash[24289]: audit 2024-09-16T11:36:32.519940+0000 mon.b (mon.2) 1417 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:36:33.592 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 11:36:33 smithi047 bash[22994]: debug 2024-09-16T11:36:33.324+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T11:36:33.592 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 11:36:33 smithi047 bash[22994]: debug 2024-09-16T11:36:33.328+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T11:36:33.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:36:33 smithi047 bash[22744]: audit 2024-09-16T11:36:32.500677+0000 mon.b (mon.2) 1415 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T11:36:33.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:36:33 smithi047 bash[22744]: audit 2024-09-16T11:36:32.502943+0000 mon.b (mon.2) 1416 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T11:36:33.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:36:33 smithi047 bash[22744]: audit 2024-09-16T11:36:32.515022+0000 mon.a (mon.0) 1495 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:36:33.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:36:33 smithi047 bash[22744]: audit 2024-09-16T11:36:32.519940+0000 mon.b (mon.2) 1417 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:36:34.102 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:36:34.103 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:36:34.103 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:36:34.103 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:36:34.103 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:36:34.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:36:34 smithi157 bash[24585]: audit 2024-09-16T11:36:32.522748+0000 mgr.a (mgr.14373) 15540 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:36:34.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:36:34 smithi157 bash[24585]: cluster 2024-09-16T11:36:33.150320+0000 mgr.a (mgr.14373) 15541 : cluster [DBG] pgmap v10779: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-16T11:36:34.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:36:34 smithi157 bash[24585]: audit 2024-09-16T11:36:33.329806+0000 mgr.a (mgr.14373) 15542 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T11:36:34.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:36:34 smithi157 bash[24585]: cephadm 2024-09-16T11:36:33.332336+0000 mgr.a (mgr.14373) 15543 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T11:36:34.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:36:34 smithi086 bash[24289]: audit 2024-09-16T11:36:32.522748+0000 mgr.a (mgr.14373) 15540 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:36:34.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:36:34 smithi086 bash[24289]: cluster 2024-09-16T11:36:33.150320+0000 mgr.a (mgr.14373) 15541 : cluster [DBG] pgmap v10779: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-16T11:36:34.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:36:34 smithi086 bash[24289]: audit 2024-09-16T11:36:33.329806+0000 mgr.a (mgr.14373) 15542 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T11:36:34.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:36:34 smithi086 bash[24289]: cephadm 2024-09-16T11:36:33.332336+0000 mgr.a (mgr.14373) 15543 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T11:36:34.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:36:34 smithi047 bash[22744]: audit 2024-09-16T11:36:32.522748+0000 mgr.a (mgr.14373) 15540 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:36:34.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:36:34 smithi047 bash[22744]: cluster 2024-09-16T11:36:33.150320+0000 mgr.a (mgr.14373) 15541 : cluster [DBG] pgmap v10779: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-16T11:36:34.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:36:34 smithi047 bash[22744]: audit 2024-09-16T11:36:33.329806+0000 mgr.a (mgr.14373) 15542 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T11:36:34.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:36:34 smithi047 bash[22744]: cephadm 2024-09-16T11:36:33.332336+0000 mgr.a (mgr.14373) 15543 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T11:36:35.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:36:35 smithi157 bash[24585]: audit 2024-09-16T11:36:33.649862+0000 mgr.a (mgr.14373) 15544 : audit [DBG] from='client.335697 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:36:35.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:36:35 smithi086 bash[24289]: audit 2024-09-16T11:36:33.649862+0000 mgr.a (mgr.14373) 15544 : audit [DBG] from='client.335697 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:36:35.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:36:35 smithi047 bash[22744]: audit 2024-09-16T11:36:33.649862+0000 mgr.a (mgr.14373) 15544 : audit [DBG] from='client.335697 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:36:36.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:36:36 smithi157 bash[24585]: cluster 2024-09-16T11:36:35.151218+0000 mgr.a (mgr.14373) 15545 : cluster [DBG] pgmap v10780: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:36:36.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:36:36 smithi086 bash[24289]: cluster 2024-09-16T11:36:35.151218+0000 mgr.a (mgr.14373) 15545 : cluster [DBG] pgmap v10780: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:36:36.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:36:36 smithi047 bash[22744]: cluster 2024-09-16T11:36:35.151218+0000 mgr.a (mgr.14373) 15545 : cluster [DBG] pgmap v10780: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:36:38.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:36:38 smithi157 bash[24585]: cluster 2024-09-16T11:36:37.153476+0000 mgr.a (mgr.14373) 15546 : cluster [DBG] pgmap v10781: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:36:38.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:36:38 smithi086 bash[24289]: cluster 2024-09-16T11:36:37.153476+0000 mgr.a (mgr.14373) 15546 : cluster [DBG] pgmap v10781: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:36:38.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:36:38 smithi047 bash[22744]: cluster 2024-09-16T11:36:37.153476+0000 mgr.a (mgr.14373) 15546 : cluster [DBG] pgmap v10781: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:36:39.104 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:36:39.105 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:36:39.105 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:36:39.894 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:36:39.894 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:36:39.894 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:36:39.895 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:36:39.895 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:36:40.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:36:40 smithi157 bash[24585]: cluster 2024-09-16T11:36:39.154155+0000 mgr.a (mgr.14373) 15547 : cluster [DBG] pgmap v10782: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:36:40.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:36:40 smithi086 bash[24289]: cluster 2024-09-16T11:36:39.154155+0000 mgr.a (mgr.14373) 15547 : cluster [DBG] pgmap v10782: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:36:40.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:36:40 smithi047 bash[22744]: cluster 2024-09-16T11:36:39.154155+0000 mgr.a (mgr.14373) 15547 : cluster [DBG] pgmap v10782: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:36:41.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:36:41 smithi157 bash[24585]: audit 2024-09-16T11:36:39.444484+0000 mgr.a (mgr.14373) 15548 : audit [DBG] from='client.335772 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:36:41.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:36:41 smithi086 bash[24289]: audit 2024-09-16T11:36:39.444484+0000 mgr.a (mgr.14373) 15548 : audit [DBG] from='client.335772 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:36:41.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:36:41 smithi047 bash[22744]: audit 2024-09-16T11:36:39.444484+0000 mgr.a (mgr.14373) 15548 : audit [DBG] from='client.335772 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:36:42.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:36:42 smithi157 bash[24585]: cluster 2024-09-16T11:36:41.155111+0000 mgr.a (mgr.14373) 15549 : cluster [DBG] pgmap v10783: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:36:42.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:36:42 smithi086 bash[24289]: cluster 2024-09-16T11:36:41.155111+0000 mgr.a (mgr.14373) 15549 : cluster [DBG] pgmap v10783: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:36:42.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:36:42 smithi047 bash[22744]: cluster 2024-09-16T11:36:41.155111+0000 mgr.a (mgr.14373) 15549 : cluster [DBG] pgmap v10783: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:36:44.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:36:44 smithi157 bash[24585]: cluster 2024-09-16T11:36:43.157362+0000 mgr.a (mgr.14373) 15550 : cluster [DBG] pgmap v10784: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:36:44.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:36:44 smithi086 bash[24289]: cluster 2024-09-16T11:36:43.157362+0000 mgr.a (mgr.14373) 15550 : cluster [DBG] pgmap v10784: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:36:44.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:36:44 smithi047 bash[22744]: cluster 2024-09-16T11:36:43.157362+0000 mgr.a (mgr.14373) 15550 : cluster [DBG] pgmap v10784: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:36:44.895 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:36:44.896 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:36:44.896 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:36:45.681 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:36:45.682 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:36:45.682 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:36:45.682 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:36:45.682 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:36:46.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:36:46 smithi157 bash[24585]: cluster 2024-09-16T11:36:45.158106+0000 mgr.a (mgr.14373) 15551 : cluster [DBG] pgmap v10785: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:36:46.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:36:46 smithi157 bash[24585]: audit 2024-09-16T11:36:45.232032+0000 mgr.a (mgr.14373) 15552 : audit [DBG] from='client.335850 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:36:46.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:36:46 smithi086 bash[24289]: cluster 2024-09-16T11:36:45.158106+0000 mgr.a (mgr.14373) 15551 : cluster [DBG] pgmap v10785: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:36:46.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:36:46 smithi086 bash[24289]: audit 2024-09-16T11:36:45.232032+0000 mgr.a (mgr.14373) 15552 : audit [DBG] from='client.335850 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:36:46.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:36:46 smithi047 bash[22744]: cluster 2024-09-16T11:36:45.158106+0000 mgr.a (mgr.14373) 15551 : cluster [DBG] pgmap v10785: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:36:46.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:36:46 smithi047 bash[22744]: audit 2024-09-16T11:36:45.232032+0000 mgr.a (mgr.14373) 15552 : audit [DBG] from='client.335850 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:36:48.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:36:48 smithi157 bash[24585]: cluster 2024-09-16T11:36:47.160506+0000 mgr.a (mgr.14373) 15553 : cluster [DBG] pgmap v10786: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:36:48.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:36:48 smithi086 bash[24289]: cluster 2024-09-16T11:36:47.160506+0000 mgr.a (mgr.14373) 15553 : cluster [DBG] pgmap v10786: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:36:48.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:36:48 smithi047 bash[22744]: cluster 2024-09-16T11:36:47.160506+0000 mgr.a (mgr.14373) 15553 : cluster [DBG] pgmap v10786: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:36:50.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:36:50 smithi157 bash[24585]: cluster 2024-09-16T11:36:49.161314+0000 mgr.a (mgr.14373) 15554 : cluster [DBG] pgmap v10787: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:36:50.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:36:50 smithi086 bash[24289]: cluster 2024-09-16T11:36:49.161314+0000 mgr.a (mgr.14373) 15554 : cluster [DBG] pgmap v10787: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:36:50.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:36:50 smithi047 bash[22744]: cluster 2024-09-16T11:36:49.161314+0000 mgr.a (mgr.14373) 15554 : cluster [DBG] pgmap v10787: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:36:50.684 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:36:50.685 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:36:50.685 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:36:51.469 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:36:51.469 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:36:51.469 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:36:51.469 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:36:51.469 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:36:52.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:36:52 smithi157 bash[24585]: audit 2024-09-16T11:36:51.021063+0000 mgr.a (mgr.14373) 15555 : audit [DBG] from='client.335928 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:36:52.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:36:52 smithi157 bash[24585]: cluster 2024-09-16T11:36:51.162237+0000 mgr.a (mgr.14373) 15556 : cluster [DBG] pgmap v10788: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:36:52.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:36:52 smithi086 bash[24289]: audit 2024-09-16T11:36:51.021063+0000 mgr.a (mgr.14373) 15555 : audit [DBG] from='client.335928 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:36:52.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:36:52 smithi086 bash[24289]: cluster 2024-09-16T11:36:51.162237+0000 mgr.a (mgr.14373) 15556 : cluster [DBG] pgmap v10788: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:36:52.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:36:52 smithi047 bash[22744]: audit 2024-09-16T11:36:51.021063+0000 mgr.a (mgr.14373) 15555 : audit [DBG] from='client.335928 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:36:52.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:36:52 smithi047 bash[22744]: cluster 2024-09-16T11:36:51.162237+0000 mgr.a (mgr.14373) 15556 : cluster [DBG] pgmap v10788: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:36:54.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:36:54 smithi157 bash[24585]: cluster 2024-09-16T11:36:53.164548+0000 mgr.a (mgr.14373) 15557 : cluster [DBG] pgmap v10789: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:36:54.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:36:54 smithi086 bash[24289]: cluster 2024-09-16T11:36:53.164548+0000 mgr.a (mgr.14373) 15557 : cluster [DBG] pgmap v10789: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:36:54.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:36:54 smithi047 bash[22744]: cluster 2024-09-16T11:36:53.164548+0000 mgr.a (mgr.14373) 15557 : cluster [DBG] pgmap v10789: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:36:56.470 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:36:56.471 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:36:56.471 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:36:56.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:36:56 smithi157 bash[24585]: cluster 2024-09-16T11:36:55.165359+0000 mgr.a (mgr.14373) 15558 : cluster [DBG] pgmap v10790: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:36:56.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:36:56 smithi086 bash[24289]: cluster 2024-09-16T11:36:55.165359+0000 mgr.a (mgr.14373) 15558 : cluster [DBG] pgmap v10790: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:36:56.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:36:56 smithi047 bash[22744]: cluster 2024-09-16T11:36:55.165359+0000 mgr.a (mgr.14373) 15558 : cluster [DBG] pgmap v10790: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:36:57.267 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:36:57.267 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:36:57.267 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:36:57.267 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:36:57.267 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:36:58.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:36:58 smithi157 bash[24585]: audit 2024-09-16T11:36:56.809818+0000 mgr.a (mgr.14373) 15559 : audit [DBG] from='client.336003 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:36:58.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:36:58 smithi157 bash[24585]: cluster 2024-09-16T11:36:57.167384+0000 mgr.a (mgr.14373) 15560 : cluster [DBG] pgmap v10791: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:36:58.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:36:58 smithi086 bash[24289]: audit 2024-09-16T11:36:56.809818+0000 mgr.a (mgr.14373) 15559 : audit [DBG] from='client.336003 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:36:58.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:36:58 smithi086 bash[24289]: cluster 2024-09-16T11:36:57.167384+0000 mgr.a (mgr.14373) 15560 : cluster [DBG] pgmap v10791: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:36:58.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:36:58 smithi047 bash[22744]: audit 2024-09-16T11:36:56.809818+0000 mgr.a (mgr.14373) 15559 : audit [DBG] from='client.336003 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:36:58.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:36:58 smithi047 bash[22744]: cluster 2024-09-16T11:36:57.167384+0000 mgr.a (mgr.14373) 15560 : cluster [DBG] pgmap v10791: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:37:00.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:37:00 smithi157 bash[24585]: cluster 2024-09-16T11:36:59.168318+0000 mgr.a (mgr.14373) 15561 : cluster [DBG] pgmap v10792: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:37:00.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:37:00 smithi086 bash[24289]: cluster 2024-09-16T11:36:59.168318+0000 mgr.a (mgr.14373) 15561 : cluster [DBG] pgmap v10792: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:37:00.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:37:00 smithi047 bash[22744]: cluster 2024-09-16T11:36:59.168318+0000 mgr.a (mgr.14373) 15561 : cluster [DBG] pgmap v10792: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:37:02.268 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:37:02.269 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:37:02.269 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:37:02.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:37:02 smithi157 bash[24585]: cluster 2024-09-16T11:37:01.169285+0000 mgr.a (mgr.14373) 15562 : cluster [DBG] pgmap v10793: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T11:37:02.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:37:02 smithi086 bash[24289]: cluster 2024-09-16T11:37:01.169285+0000 mgr.a (mgr.14373) 15562 : cluster [DBG] pgmap v10793: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T11:37:02.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:37:02 smithi047 bash[22744]: cluster 2024-09-16T11:37:01.169285+0000 mgr.a (mgr.14373) 15562 : cluster [DBG] pgmap v10793: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T11:37:03.066 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:37:03.066 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:37:03.066 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:37:03.067 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:37:03.067 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:37:04.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:37:04 smithi157 bash[24585]: audit 2024-09-16T11:37:02.607357+0000 mgr.a (mgr.14373) 15563 : audit [DBG] from='client.336081 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:37:04.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:37:04 smithi157 bash[24585]: cluster 2024-09-16T11:37:03.172226+0000 mgr.a (mgr.14373) 15564 : cluster [DBG] pgmap v10794: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:37:04.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:37:04 smithi086 bash[24289]: audit 2024-09-16T11:37:02.607357+0000 mgr.a (mgr.14373) 15563 : audit [DBG] from='client.336081 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:37:04.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:37:04 smithi086 bash[24289]: cluster 2024-09-16T11:37:03.172226+0000 mgr.a (mgr.14373) 15564 : cluster [DBG] pgmap v10794: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:37:04.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:37:04 smithi047 bash[22744]: audit 2024-09-16T11:37:02.607357+0000 mgr.a (mgr.14373) 15563 : audit [DBG] from='client.336081 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:37:04.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:37:04 smithi047 bash[22744]: cluster 2024-09-16T11:37:03.172226+0000 mgr.a (mgr.14373) 15564 : cluster [DBG] pgmap v10794: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:37:06.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:37:06 smithi157 bash[24585]: cluster 2024-09-16T11:37:05.173029+0000 mgr.a (mgr.14373) 15565 : cluster [DBG] pgmap v10795: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:37:06.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:37:06 smithi086 bash[24289]: cluster 2024-09-16T11:37:05.173029+0000 mgr.a (mgr.14373) 15565 : cluster [DBG] pgmap v10795: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:37:06.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:37:06 smithi047 bash[22744]: cluster 2024-09-16T11:37:05.173029+0000 mgr.a (mgr.14373) 15565 : cluster [DBG] pgmap v10795: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:37:08.068 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:37:08.069 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:37:08.069 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:37:08.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:37:08 smithi157 bash[24585]: cluster 2024-09-16T11:37:07.174989+0000 mgr.a (mgr.14373) 15566 : cluster [DBG] pgmap v10796: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:37:08.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:37:08 smithi086 bash[24289]: cluster 2024-09-16T11:37:07.174989+0000 mgr.a (mgr.14373) 15566 : cluster [DBG] pgmap v10796: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:37:08.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:37:08 smithi047 bash[22744]: cluster 2024-09-16T11:37:07.174989+0000 mgr.a (mgr.14373) 15566 : cluster [DBG] pgmap v10796: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:37:08.844 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:37:08.845 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:37:08.845 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:37:08.845 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:37:08.845 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:37:10.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:37:10 smithi157 bash[24585]: audit 2024-09-16T11:37:08.401256+0000 mgr.a (mgr.14373) 15567 : audit [DBG] from='client.336153 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:37:10.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:37:10 smithi157 bash[24585]: cluster 2024-09-16T11:37:09.176076+0000 mgr.a (mgr.14373) 15568 : cluster [DBG] pgmap v10797: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:37:10.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:37:10 smithi086 bash[24289]: audit 2024-09-16T11:37:08.401256+0000 mgr.a (mgr.14373) 15567 : audit [DBG] from='client.336153 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:37:10.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:37:10 smithi086 bash[24289]: cluster 2024-09-16T11:37:09.176076+0000 mgr.a (mgr.14373) 15568 : cluster [DBG] pgmap v10797: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:37:10.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:37:10 smithi047 bash[22744]: audit 2024-09-16T11:37:08.401256+0000 mgr.a (mgr.14373) 15567 : audit [DBG] from='client.336153 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:37:10.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:37:10 smithi047 bash[22744]: cluster 2024-09-16T11:37:09.176076+0000 mgr.a (mgr.14373) 15568 : cluster [DBG] pgmap v10797: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:37:12.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:37:12 smithi157 bash[24585]: cluster 2024-09-16T11:37:11.177084+0000 mgr.a (mgr.14373) 15569 : cluster [DBG] pgmap v10798: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:37:12.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:37:12 smithi086 bash[24289]: cluster 2024-09-16T11:37:11.177084+0000 mgr.a (mgr.14373) 15569 : cluster [DBG] pgmap v10798: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:37:12.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:37:12 smithi047 bash[22744]: cluster 2024-09-16T11:37:11.177084+0000 mgr.a (mgr.14373) 15569 : cluster [DBG] pgmap v10798: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:37:13.846 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:37:13.847 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:37:13.847 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:37:14.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:37:14 smithi086 bash[24289]: cluster 2024-09-16T11:37:13.179376+0000 mgr.a (mgr.14373) 15570 : cluster [DBG] pgmap v10799: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:37:14.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:37:14 smithi047 bash[22744]: cluster 2024-09-16T11:37:13.179376+0000 mgr.a (mgr.14373) 15570 : cluster [DBG] pgmap v10799: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:37:14.604 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:37:14.605 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:37:14.605 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:37:14.605 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:37:14.605 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:37:14.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:37:14 smithi157 bash[24585]: cluster 2024-09-16T11:37:13.179376+0000 mgr.a (mgr.14373) 15570 : cluster [DBG] pgmap v10799: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:37:15.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:37:15 smithi086 bash[24289]: audit 2024-09-16T11:37:14.178555+0000 mgr.a (mgr.14373) 15571 : audit [DBG] from='client.336228 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:37:15.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:37:15 smithi047 bash[22744]: audit 2024-09-16T11:37:14.178555+0000 mgr.a (mgr.14373) 15571 : audit [DBG] from='client.336228 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:37:15.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:37:15 smithi157 bash[24585]: audit 2024-09-16T11:37:14.178555+0000 mgr.a (mgr.14373) 15571 : audit [DBG] from='client.336228 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:37:16.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:37:16 smithi086 bash[24289]: cluster 2024-09-16T11:37:15.180385+0000 mgr.a (mgr.14373) 15572 : cluster [DBG] pgmap v10800: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:37:16.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:37:16 smithi047 bash[22744]: cluster 2024-09-16T11:37:15.180385+0000 mgr.a (mgr.14373) 15572 : cluster [DBG] pgmap v10800: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:37:16.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:37:16 smithi157 bash[24585]: cluster 2024-09-16T11:37:15.180385+0000 mgr.a (mgr.14373) 15572 : cluster [DBG] pgmap v10800: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:37:18.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:37:18 smithi047 bash[22744]: cluster 2024-09-16T11:37:17.182594+0000 mgr.a (mgr.14373) 15573 : cluster [DBG] pgmap v10801: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:37:18.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:37:18 smithi157 bash[24585]: cluster 2024-09-16T11:37:17.182594+0000 mgr.a (mgr.14373) 15573 : cluster [DBG] pgmap v10801: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:37:18.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:37:18 smithi086 bash[24289]: cluster 2024-09-16T11:37:17.182594+0000 mgr.a (mgr.14373) 15573 : cluster [DBG] pgmap v10801: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:37:19.606 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:37:19.607 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:37:19.607 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:37:20.401 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:37:20.402 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:37:20.402 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:37:20.402 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:37:20.402 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:37:20.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:37:20 smithi047 bash[22744]: cluster 2024-09-16T11:37:19.183387+0000 mgr.a (mgr.14373) 15574 : cluster [DBG] pgmap v10802: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:37:20.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:37:20 smithi157 bash[24585]: cluster 2024-09-16T11:37:19.183387+0000 mgr.a (mgr.14373) 15574 : cluster [DBG] pgmap v10802: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:37:20.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:37:20 smithi086 bash[24289]: cluster 2024-09-16T11:37:19.183387+0000 mgr.a (mgr.14373) 15574 : cluster [DBG] pgmap v10802: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:37:21.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:37:21 smithi047 bash[22744]: audit 2024-09-16T11:37:19.937649+0000 mgr.a (mgr.14373) 15575 : audit [DBG] from='client.336306 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:37:21.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:37:21 smithi157 bash[24585]: audit 2024-09-16T11:37:19.937649+0000 mgr.a (mgr.14373) 15575 : audit [DBG] from='client.336306 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:37:21.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:37:21 smithi086 bash[24289]: audit 2024-09-16T11:37:19.937649+0000 mgr.a (mgr.14373) 15575 : audit [DBG] from='client.336306 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:37:22.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:37:22 smithi047 bash[22744]: cluster 2024-09-16T11:37:21.184389+0000 mgr.a (mgr.14373) 15576 : cluster [DBG] pgmap v10803: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:37:22.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:37:22 smithi157 bash[24585]: cluster 2024-09-16T11:37:21.184389+0000 mgr.a (mgr.14373) 15576 : cluster [DBG] pgmap v10803: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:37:22.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:37:22 smithi086 bash[24289]: cluster 2024-09-16T11:37:21.184389+0000 mgr.a (mgr.14373) 15576 : cluster [DBG] pgmap v10803: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:37:24.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:37:24 smithi047 bash[22744]: cluster 2024-09-16T11:37:23.186662+0000 mgr.a (mgr.14373) 15577 : cluster [DBG] pgmap v10804: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:37:24.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:37:24 smithi157 bash[24585]: cluster 2024-09-16T11:37:23.186662+0000 mgr.a (mgr.14373) 15577 : cluster [DBG] pgmap v10804: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:37:24.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:37:24 smithi086 bash[24289]: cluster 2024-09-16T11:37:23.186662+0000 mgr.a (mgr.14373) 15577 : cluster [DBG] pgmap v10804: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:37:25.403 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:37:25.403 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:37:25.404 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:37:26.150 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:37:26.150 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:37:26.150 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:37:26.150 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:37:26.151 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:37:26.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:37:26 smithi157 bash[24585]: cluster 2024-09-16T11:37:25.187408+0000 mgr.a (mgr.14373) 15578 : cluster [DBG] pgmap v10805: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:37:26.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:37:26 smithi086 bash[24289]: cluster 2024-09-16T11:37:25.187408+0000 mgr.a (mgr.14373) 15578 : cluster [DBG] pgmap v10805: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:37:26.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:37:26 smithi047 bash[22744]: cluster 2024-09-16T11:37:25.187408+0000 mgr.a (mgr.14373) 15578 : cluster [DBG] pgmap v10805: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:37:27.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:37:27 smithi157 bash[24585]: audit 2024-09-16T11:37:25.729890+0000 mgr.a (mgr.14373) 15579 : audit [DBG] from='client.336384 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:37:27.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:37:27 smithi086 bash[24289]: audit 2024-09-16T11:37:25.729890+0000 mgr.a (mgr.14373) 15579 : audit [DBG] from='client.336384 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:37:27.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:37:27 smithi047 bash[22744]: audit 2024-09-16T11:37:25.729890+0000 mgr.a (mgr.14373) 15579 : audit [DBG] from='client.336384 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:37:28.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:37:28 smithi157 bash[24585]: cluster 2024-09-16T11:37:27.189738+0000 mgr.a (mgr.14373) 15580 : cluster [DBG] pgmap v10806: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:37:28.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:37:28 smithi086 bash[24289]: cluster 2024-09-16T11:37:27.189738+0000 mgr.a (mgr.14373) 15580 : cluster [DBG] pgmap v10806: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:37:28.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:37:28 smithi047 bash[22744]: cluster 2024-09-16T11:37:27.189738+0000 mgr.a (mgr.14373) 15580 : cluster [DBG] pgmap v10806: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:37:30.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:37:30 smithi157 bash[24585]: cluster 2024-09-16T11:37:29.190543+0000 mgr.a (mgr.14373) 15581 : cluster [DBG] pgmap v10807: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:37:30.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:37:30 smithi086 bash[24289]: cluster 2024-09-16T11:37:29.190543+0000 mgr.a (mgr.14373) 15581 : cluster [DBG] pgmap v10807: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:37:30.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:37:30 smithi047 bash[22744]: cluster 2024-09-16T11:37:29.190543+0000 mgr.a (mgr.14373) 15581 : cluster [DBG] pgmap v10807: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:37:31.151 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:37:31.152 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:37:31.152 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:37:31.897 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:37:31.897 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:37:31.897 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:37:31.897 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:37:31.897 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:37:32.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:37:32 smithi157 bash[24585]: cluster 2024-09-16T11:37:31.191323+0000 mgr.a (mgr.14373) 15582 : cluster [DBG] pgmap v10808: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:37:32.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:37:32 smithi086 bash[24289]: cluster 2024-09-16T11:37:31.191323+0000 mgr.a (mgr.14373) 15582 : cluster [DBG] pgmap v10808: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:37:32.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:37:32 smithi047 bash[22744]: cluster 2024-09-16T11:37:31.191323+0000 mgr.a (mgr.14373) 15582 : cluster [DBG] pgmap v10808: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:37:33.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:37:33 smithi157 bash[24585]: audit 2024-09-16T11:37:31.481813+0000 mgr.a (mgr.14373) 15583 : audit [DBG] from='client.336462 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:37:33.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:37:33 smithi086 bash[24289]: audit 2024-09-16T11:37:31.481813+0000 mgr.a (mgr.14373) 15583 : audit [DBG] from='client.336462 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:37:33.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:37:33 smithi047 bash[22744]: audit 2024-09-16T11:37:31.481813+0000 mgr.a (mgr.14373) 15583 : audit [DBG] from='client.336462 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:37:34.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:37:34 smithi157 bash[24585]: cluster 2024-09-16T11:37:33.193714+0000 mgr.a (mgr.14373) 15584 : cluster [DBG] pgmap v10809: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-16T11:37:34.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:37:34 smithi157 bash[24585]: audit 2024-09-16T11:37:33.392470+0000 mon.b (mon.2) 1418 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T11:37:34.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:37:34 smithi157 bash[24585]: audit 2024-09-16T11:37:34.248593+0000 mon.b (mon.2) 1419 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T11:37:34.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:37:34 smithi157 bash[24585]: audit 2024-09-16T11:37:34.250332+0000 mon.b (mon.2) 1420 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T11:37:34.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:37:34 smithi157 bash[24585]: audit 2024-09-16T11:37:34.261161+0000 mon.a (mon.0) 1496 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:37:34.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:37:34 smithi157 bash[24585]: audit 2024-09-16T11:37:34.266373+0000 mon.b (mon.2) 1421 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:37:34.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:37:34 smithi157 bash[24585]: audit 2024-09-16T11:37:34.269122+0000 mgr.a (mgr.14373) 15585 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:37:34.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:37:34 smithi086 bash[24289]: cluster 2024-09-16T11:37:33.193714+0000 mgr.a (mgr.14373) 15584 : cluster [DBG] pgmap v10809: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-16T11:37:34.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:37:34 smithi086 bash[24289]: audit 2024-09-16T11:37:33.392470+0000 mon.b (mon.2) 1418 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T11:37:34.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:37:34 smithi086 bash[24289]: audit 2024-09-16T11:37:34.248593+0000 mon.b (mon.2) 1419 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T11:37:34.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:37:34 smithi086 bash[24289]: audit 2024-09-16T11:37:34.250332+0000 mon.b (mon.2) 1420 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T11:37:34.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:37:34 smithi086 bash[24289]: audit 2024-09-16T11:37:34.261161+0000 mon.a (mon.0) 1496 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:37:34.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:37:34 smithi086 bash[24289]: audit 2024-09-16T11:37:34.266373+0000 mon.b (mon.2) 1421 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:37:34.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:37:34 smithi086 bash[24289]: audit 2024-09-16T11:37:34.269122+0000 mgr.a (mgr.14373) 15585 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:37:34.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:37:34 smithi047 bash[22744]: cluster 2024-09-16T11:37:33.193714+0000 mgr.a (mgr.14373) 15584 : cluster [DBG] pgmap v10809: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-16T11:37:34.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:37:34 smithi047 bash[22744]: audit 2024-09-16T11:37:33.392470+0000 mon.b (mon.2) 1418 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T11:37:34.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:37:34 smithi047 bash[22744]: audit 2024-09-16T11:37:34.248593+0000 mon.b (mon.2) 1419 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T11:37:34.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:37:34 smithi047 bash[22744]: audit 2024-09-16T11:37:34.250332+0000 mon.b (mon.2) 1420 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T11:37:34.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:37:34 smithi047 bash[22744]: audit 2024-09-16T11:37:34.261161+0000 mon.a (mon.0) 1496 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:37:34.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:37:34 smithi047 bash[22744]: audit 2024-09-16T11:37:34.266373+0000 mon.b (mon.2) 1421 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:37:34.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:37:34 smithi047 bash[22744]: audit 2024-09-16T11:37:34.269122+0000 mgr.a (mgr.14373) 15585 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:37:35.342 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 11:37:35 smithi047 bash[22994]: debug 2024-09-16T11:37:35.019+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T11:37:35.343 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 11:37:35 smithi047 bash[22994]: debug 2024-09-16T11:37:35.019+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T11:37:35.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:37:35 smithi157 bash[24585]: audit 2024-09-16T11:37:35.023601+0000 mgr.a (mgr.14373) 15586 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T11:37:35.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:37:35 smithi157 bash[24585]: cephadm 2024-09-16T11:37:35.025625+0000 mgr.a (mgr.14373) 15587 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T11:37:35.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:37:35 smithi157 bash[24585]: cluster 2024-09-16T11:37:35.194676+0000 mgr.a (mgr.14373) 15588 : cluster [DBG] pgmap v10810: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-16T11:37:35.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:37:35 smithi086 bash[24289]: audit 2024-09-16T11:37:35.023601+0000 mgr.a (mgr.14373) 15586 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T11:37:35.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:37:35 smithi086 bash[24289]: cephadm 2024-09-16T11:37:35.025625+0000 mgr.a (mgr.14373) 15587 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T11:37:35.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:37:35 smithi086 bash[24289]: cluster 2024-09-16T11:37:35.194676+0000 mgr.a (mgr.14373) 15588 : cluster [DBG] pgmap v10810: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-16T11:37:35.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:37:35 smithi047 bash[22744]: audit 2024-09-16T11:37:35.023601+0000 mgr.a (mgr.14373) 15586 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T11:37:35.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:37:35 smithi047 bash[22744]: cephadm 2024-09-16T11:37:35.025625+0000 mgr.a (mgr.14373) 15587 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T11:37:35.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:37:35 smithi047 bash[22744]: cluster 2024-09-16T11:37:35.194676+0000 mgr.a (mgr.14373) 15588 : cluster [DBG] pgmap v10810: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-16T11:37:36.898 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:37:36.899 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:37:36.899 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:37:37.672 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:37:37.673 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:37:37.673 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:37:37.673 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:37:37.673 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:37:38.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:37:38 smithi157 bash[24585]: cluster 2024-09-16T11:37:37.196861+0000 mgr.a (mgr.14373) 15589 : cluster [DBG] pgmap v10811: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:37:38.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:37:38 smithi157 bash[24585]: audit 2024-09-16T11:37:37.233176+0000 mgr.a (mgr.14373) 15590 : audit [DBG] from='client.336645 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:37:38.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:37:38 smithi086 bash[24289]: cluster 2024-09-16T11:37:37.196861+0000 mgr.a (mgr.14373) 15589 : cluster [DBG] pgmap v10811: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:37:38.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:37:38 smithi086 bash[24289]: audit 2024-09-16T11:37:37.233176+0000 mgr.a (mgr.14373) 15590 : audit [DBG] from='client.336645 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:37:38.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:37:38 smithi047 bash[22744]: cluster 2024-09-16T11:37:37.196861+0000 mgr.a (mgr.14373) 15589 : cluster [DBG] pgmap v10811: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:37:38.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:37:38 smithi047 bash[22744]: audit 2024-09-16T11:37:37.233176+0000 mgr.a (mgr.14373) 15590 : audit [DBG] from='client.336645 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:37:40.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:37:40 smithi157 bash[24585]: cluster 2024-09-16T11:37:39.197787+0000 mgr.a (mgr.14373) 15591 : cluster [DBG] pgmap v10812: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T11:37:40.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:37:40 smithi086 bash[24289]: cluster 2024-09-16T11:37:39.197787+0000 mgr.a (mgr.14373) 15591 : cluster [DBG] pgmap v10812: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T11:37:40.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:37:40 smithi047 bash[22744]: cluster 2024-09-16T11:37:39.197787+0000 mgr.a (mgr.14373) 15591 : cluster [DBG] pgmap v10812: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T11:37:42.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:37:42 smithi157 bash[24585]: cluster 2024-09-16T11:37:41.198585+0000 mgr.a (mgr.14373) 15592 : cluster [DBG] pgmap v10813: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T11:37:42.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:37:42 smithi086 bash[24289]: cluster 2024-09-16T11:37:41.198585+0000 mgr.a (mgr.14373) 15592 : cluster [DBG] pgmap v10813: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T11:37:42.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:37:42 smithi047 bash[22744]: cluster 2024-09-16T11:37:41.198585+0000 mgr.a (mgr.14373) 15592 : cluster [DBG] pgmap v10813: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T11:37:42.677 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:37:42.677 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:37:42.677 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:37:43.450 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:37:43.450 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:37:43.450 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:37:43.450 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:37:43.450 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:37:44.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:37:44 smithi157 bash[24585]: audit 2024-09-16T11:37:43.015206+0000 mgr.a (mgr.14373) 15593 : audit [DBG] from='client.336723 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:37:44.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:37:44 smithi157 bash[24585]: cluster 2024-09-16T11:37:43.199951+0000 mgr.a (mgr.14373) 15594 : cluster [DBG] pgmap v10814: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:37:44.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:37:44 smithi086 bash[24289]: audit 2024-09-16T11:37:43.015206+0000 mgr.a (mgr.14373) 15593 : audit [DBG] from='client.336723 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:37:44.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:37:44 smithi086 bash[24289]: cluster 2024-09-16T11:37:43.199951+0000 mgr.a (mgr.14373) 15594 : cluster [DBG] pgmap v10814: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:37:44.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:37:44 smithi047 bash[22744]: audit 2024-09-16T11:37:43.015206+0000 mgr.a (mgr.14373) 15593 : audit [DBG] from='client.336723 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:37:44.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:37:44 smithi047 bash[22744]: cluster 2024-09-16T11:37:43.199951+0000 mgr.a (mgr.14373) 15594 : cluster [DBG] pgmap v10814: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:37:46.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:37:46 smithi157 bash[24585]: cluster 2024-09-16T11:37:45.200862+0000 mgr.a (mgr.14373) 15595 : cluster [DBG] pgmap v10815: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 6.9 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T11:37:46.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:37:46 smithi086 bash[24289]: cluster 2024-09-16T11:37:45.200862+0000 mgr.a (mgr.14373) 15595 : cluster [DBG] pgmap v10815: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 6.9 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T11:37:46.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:37:46 smithi047 bash[22744]: cluster 2024-09-16T11:37:45.200862+0000 mgr.a (mgr.14373) 15595 : cluster [DBG] pgmap v10815: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 6.9 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T11:37:48.451 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:37:48.452 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:37:48.452 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:37:48.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:37:48 smithi157 bash[24585]: cluster 2024-09-16T11:37:47.203076+0000 mgr.a (mgr.14373) 15596 : cluster [DBG] pgmap v10816: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.8 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:37:48.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:37:48 smithi086 bash[24289]: cluster 2024-09-16T11:37:47.203076+0000 mgr.a (mgr.14373) 15596 : cluster [DBG] pgmap v10816: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.8 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:37:48.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:37:48 smithi047 bash[22744]: cluster 2024-09-16T11:37:47.203076+0000 mgr.a (mgr.14373) 15596 : cluster [DBG] pgmap v10816: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.8 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:37:49.234 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:37:49.234 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:37:49.235 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:37:49.235 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:37:49.235 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:37:50.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:37:50 smithi157 bash[24585]: audit 2024-09-16T11:37:48.788569+0000 mgr.a (mgr.14373) 15597 : audit [DBG] from='client.336801 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:37:50.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:37:50 smithi157 bash[24585]: cluster 2024-09-16T11:37:49.203583+0000 mgr.a (mgr.14373) 15598 : cluster [DBG] pgmap v10817: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:37:50.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:37:50 smithi086 bash[24289]: audit 2024-09-16T11:37:48.788569+0000 mgr.a (mgr.14373) 15597 : audit [DBG] from='client.336801 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:37:50.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:37:50 smithi086 bash[24289]: cluster 2024-09-16T11:37:49.203583+0000 mgr.a (mgr.14373) 15598 : cluster [DBG] pgmap v10817: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:37:50.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:37:50 smithi047 bash[22744]: audit 2024-09-16T11:37:48.788569+0000 mgr.a (mgr.14373) 15597 : audit [DBG] from='client.336801 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:37:50.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:37:50 smithi047 bash[22744]: cluster 2024-09-16T11:37:49.203583+0000 mgr.a (mgr.14373) 15598 : cluster [DBG] pgmap v10817: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:37:52.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:37:52 smithi157 bash[24585]: cluster 2024-09-16T11:37:51.204308+0000 mgr.a (mgr.14373) 15599 : cluster [DBG] pgmap v10818: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:37:52.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:37:52 smithi086 bash[24289]: cluster 2024-09-16T11:37:51.204308+0000 mgr.a (mgr.14373) 15599 : cluster [DBG] pgmap v10818: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:37:52.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:37:52 smithi047 bash[22744]: cluster 2024-09-16T11:37:51.204308+0000 mgr.a (mgr.14373) 15599 : cluster [DBG] pgmap v10818: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:37:54.236 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:37:54.236 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:37:54.236 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:37:54.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:37:54 smithi157 bash[24585]: cluster 2024-09-16T11:37:53.206567+0000 mgr.a (mgr.14373) 15600 : cluster [DBG] pgmap v10819: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:37:54.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:37:54 smithi086 bash[24289]: cluster 2024-09-16T11:37:53.206567+0000 mgr.a (mgr.14373) 15600 : cluster [DBG] pgmap v10819: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:37:54.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:37:54 smithi047 bash[22744]: cluster 2024-09-16T11:37:53.206567+0000 mgr.a (mgr.14373) 15600 : cluster [DBG] pgmap v10819: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:37:55.018 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:37:55.018 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:37:55.018 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:37:55.019 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:37:55.019 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:37:56.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:37:56 smithi157 bash[24585]: audit 2024-09-16T11:37:54.568797+0000 mgr.a (mgr.14373) 15601 : audit [DBG] from='client.336879 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:37:56.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:37:56 smithi157 bash[24585]: cluster 2024-09-16T11:37:55.207566+0000 mgr.a (mgr.14373) 15602 : cluster [DBG] pgmap v10820: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:37:56.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:37:56 smithi086 bash[24289]: audit 2024-09-16T11:37:54.568797+0000 mgr.a (mgr.14373) 15601 : audit [DBG] from='client.336879 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:37:56.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:37:56 smithi086 bash[24289]: cluster 2024-09-16T11:37:55.207566+0000 mgr.a (mgr.14373) 15602 : cluster [DBG] pgmap v10820: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:37:56.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:37:56 smithi047 bash[22744]: audit 2024-09-16T11:37:54.568797+0000 mgr.a (mgr.14373) 15601 : audit [DBG] from='client.336879 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:37:56.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:37:56 smithi047 bash[22744]: cluster 2024-09-16T11:37:55.207566+0000 mgr.a (mgr.14373) 15602 : cluster [DBG] pgmap v10820: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:37:58.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:37:58 smithi157 bash[24585]: cluster 2024-09-16T11:37:57.209791+0000 mgr.a (mgr.14373) 15603 : cluster [DBG] pgmap v10821: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:37:58.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:37:58 smithi086 bash[24289]: cluster 2024-09-16T11:37:57.209791+0000 mgr.a (mgr.14373) 15603 : cluster [DBG] pgmap v10821: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:37:58.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:37:58 smithi047 bash[22744]: cluster 2024-09-16T11:37:57.209791+0000 mgr.a (mgr.14373) 15603 : cluster [DBG] pgmap v10821: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:38:00.020 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:38:00.020 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:38:00.020 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:38:00.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:38:00 smithi157 bash[24585]: cluster 2024-09-16T11:37:59.210585+0000 mgr.a (mgr.14373) 15604 : cluster [DBG] pgmap v10822: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:38:00.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:38:00 smithi086 bash[24289]: cluster 2024-09-16T11:37:59.210585+0000 mgr.a (mgr.14373) 15604 : cluster [DBG] pgmap v10822: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:38:00.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:38:00 smithi047 bash[22744]: cluster 2024-09-16T11:37:59.210585+0000 mgr.a (mgr.14373) 15604 : cluster [DBG] pgmap v10822: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:38:00.765 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:38:00.765 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:38:00.766 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:38:00.766 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:38:00.766 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:38:01.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:38:01 smithi086 bash[24289]: audit 2024-09-16T11:38:00.349323+0000 mgr.a (mgr.14373) 15605 : audit [DBG] from='client.336954 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:38:01.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:38:01 smithi047 bash[22744]: audit 2024-09-16T11:38:00.349323+0000 mgr.a (mgr.14373) 15605 : audit [DBG] from='client.336954 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:38:01.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:38:01 smithi157 bash[24585]: audit 2024-09-16T11:38:00.349323+0000 mgr.a (mgr.14373) 15605 : audit [DBG] from='client.336954 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:38:02.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:38:02 smithi086 bash[24289]: cluster 2024-09-16T11:38:01.211577+0000 mgr.a (mgr.14373) 15606 : cluster [DBG] pgmap v10823: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:38:02.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:38:02 smithi047 bash[22744]: cluster 2024-09-16T11:38:01.211577+0000 mgr.a (mgr.14373) 15606 : cluster [DBG] pgmap v10823: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:38:02.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:38:02 smithi157 bash[24585]: cluster 2024-09-16T11:38:01.211577+0000 mgr.a (mgr.14373) 15606 : cluster [DBG] pgmap v10823: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:38:04.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:38:04 smithi086 bash[24289]: cluster 2024-09-16T11:38:03.213860+0000 mgr.a (mgr.14373) 15607 : cluster [DBG] pgmap v10824: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:38:04.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:38:04 smithi047 bash[22744]: cluster 2024-09-16T11:38:03.213860+0000 mgr.a (mgr.14373) 15607 : cluster [DBG] pgmap v10824: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:38:04.808 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:38:04 smithi157 bash[24585]: cluster 2024-09-16T11:38:03.213860+0000 mgr.a (mgr.14373) 15607 : cluster [DBG] pgmap v10824: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:38:05.767 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:38:05.768 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:38:05.768 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:38:06.559 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:38:06.559 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:38:06.560 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:38:06.560 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:38:06.560 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:38:06.572 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:38:06 smithi157 bash[24585]: cluster 2024-09-16T11:38:05.214676+0000 mgr.a (mgr.14373) 15608 : cluster [DBG] pgmap v10825: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:38:06.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:38:06 smithi047 bash[22744]: cluster 2024-09-16T11:38:05.214676+0000 mgr.a (mgr.14373) 15608 : cluster [DBG] pgmap v10825: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:38:06.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:38:06 smithi086 bash[24289]: cluster 2024-09-16T11:38:05.214676+0000 mgr.a (mgr.14373) 15608 : cluster [DBG] pgmap v10825: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:38:07.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:38:07 smithi047 bash[22744]: audit 2024-09-16T11:38:06.106921+0000 mgr.a (mgr.14373) 15609 : audit [DBG] from='client.337029 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:38:07.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:38:07 smithi157 bash[24585]: audit 2024-09-16T11:38:06.106921+0000 mgr.a (mgr.14373) 15609 : audit [DBG] from='client.337029 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:38:07.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:38:07 smithi086 bash[24289]: audit 2024-09-16T11:38:06.106921+0000 mgr.a (mgr.14373) 15609 : audit [DBG] from='client.337029 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:38:08.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:38:08 smithi047 bash[22744]: cluster 2024-09-16T11:38:07.217557+0000 mgr.a (mgr.14373) 15610 : cluster [DBG] pgmap v10826: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 22 KiB/s rd, 0 B/s wr, 35 op/s 2024-09-16T11:38:08.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:38:08 smithi157 bash[24585]: cluster 2024-09-16T11:38:07.217557+0000 mgr.a (mgr.14373) 15610 : cluster [DBG] pgmap v10826: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 22 KiB/s rd, 0 B/s wr, 35 op/s 2024-09-16T11:38:08.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:38:08 smithi086 bash[24289]: cluster 2024-09-16T11:38:07.217557+0000 mgr.a (mgr.14373) 15610 : cluster [DBG] pgmap v10826: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 22 KiB/s rd, 0 B/s wr, 35 op/s 2024-09-16T11:38:10.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:38:10 smithi047 bash[22744]: cluster 2024-09-16T11:38:09.218412+0000 mgr.a (mgr.14373) 15611 : cluster [DBG] pgmap v10827: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 21 KiB/s rd, 0 B/s wr, 34 op/s 2024-09-16T11:38:10.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:38:10 smithi157 bash[24585]: cluster 2024-09-16T11:38:09.218412+0000 mgr.a (mgr.14373) 15611 : cluster [DBG] pgmap v10827: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 21 KiB/s rd, 0 B/s wr, 34 op/s 2024-09-16T11:38:10.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:38:10 smithi086 bash[24289]: cluster 2024-09-16T11:38:09.218412+0000 mgr.a (mgr.14373) 15611 : cluster [DBG] pgmap v10827: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 21 KiB/s rd, 0 B/s wr, 34 op/s 2024-09-16T11:38:11.560 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:38:11.561 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:38:11.561 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:38:12.351 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:38:12.351 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:38:12.351 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:38:12.351 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:38:12.351 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:38:12.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:38:12 smithi047 bash[22744]: cluster 2024-09-16T11:38:11.219218+0000 mgr.a (mgr.14373) 15612 : cluster [DBG] pgmap v10828: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 21 KiB/s rd, 0 B/s wr, 34 op/s 2024-09-16T11:38:12.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:38:12 smithi157 bash[24585]: cluster 2024-09-16T11:38:11.219218+0000 mgr.a (mgr.14373) 15612 : cluster [DBG] pgmap v10828: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 21 KiB/s rd, 0 B/s wr, 34 op/s 2024-09-16T11:38:12.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:38:12 smithi086 bash[24289]: cluster 2024-09-16T11:38:11.219218+0000 mgr.a (mgr.14373) 15612 : cluster [DBG] pgmap v10828: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 21 KiB/s rd, 0 B/s wr, 34 op/s 2024-09-16T11:38:13.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:38:13 smithi047 bash[22744]: audit 2024-09-16T11:38:11.897561+0000 mgr.a (mgr.14373) 15613 : audit [DBG] from='client.337107 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:38:13.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:38:13 smithi157 bash[24585]: audit 2024-09-16T11:38:11.897561+0000 mgr.a (mgr.14373) 15613 : audit [DBG] from='client.337107 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:38:13.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:38:13 smithi086 bash[24289]: audit 2024-09-16T11:38:11.897561+0000 mgr.a (mgr.14373) 15613 : audit [DBG] from='client.337107 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:38:14.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:38:14 smithi157 bash[24585]: cluster 2024-09-16T11:38:13.222116+0000 mgr.a (mgr.14373) 15614 : cluster [DBG] pgmap v10829: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 22 KiB/s rd, 0 B/s wr, 34 op/s 2024-09-16T11:38:14.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:38:14 smithi086 bash[24289]: cluster 2024-09-16T11:38:13.222116+0000 mgr.a (mgr.14373) 15614 : cluster [DBG] pgmap v10829: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 22 KiB/s rd, 0 B/s wr, 34 op/s 2024-09-16T11:38:14.844 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:38:14 smithi047 bash[22744]: cluster 2024-09-16T11:38:13.222116+0000 mgr.a (mgr.14373) 15614 : cluster [DBG] pgmap v10829: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 22 KiB/s rd, 0 B/s wr, 34 op/s 2024-09-16T11:38:16.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:38:16 smithi157 bash[24585]: cluster 2024-09-16T11:38:15.223087+0000 mgr.a (mgr.14373) 15615 : cluster [DBG] pgmap v10830: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 21 KiB/s rd, 0 B/s wr, 34 op/s 2024-09-16T11:38:16.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:38:16 smithi086 bash[24289]: cluster 2024-09-16T11:38:15.223087+0000 mgr.a (mgr.14373) 15615 : cluster [DBG] pgmap v10830: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 21 KiB/s rd, 0 B/s wr, 34 op/s 2024-09-16T11:38:16.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:38:16 smithi047 bash[22744]: cluster 2024-09-16T11:38:15.223087+0000 mgr.a (mgr.14373) 15615 : cluster [DBG] pgmap v10830: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 21 KiB/s rd, 0 B/s wr, 34 op/s 2024-09-16T11:38:17.352 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:38:17.353 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:38:17.354 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:38:18.123 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:38:18.123 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:38:18.123 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:38:18.123 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:38:18.123 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:38:18.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:38:18 smithi157 bash[24585]: cluster 2024-09-16T11:38:17.225271+0000 mgr.a (mgr.14373) 15616 : cluster [DBG] pgmap v10831: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 22 KiB/s rd, 0 B/s wr, 34 op/s 2024-09-16T11:38:18.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:38:18 smithi086 bash[24289]: cluster 2024-09-16T11:38:17.225271+0000 mgr.a (mgr.14373) 15616 : cluster [DBG] pgmap v10831: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 22 KiB/s rd, 0 B/s wr, 34 op/s 2024-09-16T11:38:18.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:38:18 smithi047 bash[22744]: cluster 2024-09-16T11:38:17.225271+0000 mgr.a (mgr.14373) 15616 : cluster [DBG] pgmap v10831: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 22 KiB/s rd, 0 B/s wr, 34 op/s 2024-09-16T11:38:19.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:38:19 smithi157 bash[24585]: audit 2024-09-16T11:38:17.690880+0000 mgr.a (mgr.14373) 15617 : audit [DBG] from='client.337179 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:38:19.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:38:19 smithi086 bash[24289]: audit 2024-09-16T11:38:17.690880+0000 mgr.a (mgr.14373) 15617 : audit [DBG] from='client.337179 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:38:19.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:38:19 smithi047 bash[22744]: audit 2024-09-16T11:38:17.690880+0000 mgr.a (mgr.14373) 15617 : audit [DBG] from='client.337179 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:38:20.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:38:20 smithi157 bash[24585]: cluster 2024-09-16T11:38:19.226242+0000 mgr.a (mgr.14373) 15618 : cluster [DBG] pgmap v10832: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-16T11:38:20.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:38:20 smithi086 bash[24289]: cluster 2024-09-16T11:38:19.226242+0000 mgr.a (mgr.14373) 15618 : cluster [DBG] pgmap v10832: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-16T11:38:20.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:38:20 smithi047 bash[22744]: cluster 2024-09-16T11:38:19.226242+0000 mgr.a (mgr.14373) 15618 : cluster [DBG] pgmap v10832: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-16T11:38:22.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:38:22 smithi157 bash[24585]: cluster 2024-09-16T11:38:21.227013+0000 mgr.a (mgr.14373) 15619 : cluster [DBG] pgmap v10833: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-16T11:38:22.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:38:22 smithi086 bash[24289]: cluster 2024-09-16T11:38:21.227013+0000 mgr.a (mgr.14373) 15619 : cluster [DBG] pgmap v10833: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-16T11:38:22.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:38:22 smithi047 bash[22744]: cluster 2024-09-16T11:38:21.227013+0000 mgr.a (mgr.14373) 15619 : cluster [DBG] pgmap v10833: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-16T11:38:23.124 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:38:23.125 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:38:23.125 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:38:23.917 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:38:23.918 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:38:23.918 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:38:23.918 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:38:23.918 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:38:24.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:38:24 smithi157 bash[24585]: cluster 2024-09-16T11:38:23.228448+0000 mgr.a (mgr.14373) 15620 : cluster [DBG] pgmap v10834: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-16T11:38:24.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:38:24 smithi086 bash[24289]: cluster 2024-09-16T11:38:23.228448+0000 mgr.a (mgr.14373) 15620 : cluster [DBG] pgmap v10834: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-16T11:38:24.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:38:24 smithi047 bash[22744]: cluster 2024-09-16T11:38:23.228448+0000 mgr.a (mgr.14373) 15620 : cluster [DBG] pgmap v10834: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-16T11:38:25.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:38:25 smithi157 bash[24585]: audit 2024-09-16T11:38:23.460742+0000 mgr.a (mgr.14373) 15621 : audit [DBG] from='client.337257 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:38:25.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:38:25 smithi086 bash[24289]: audit 2024-09-16T11:38:23.460742+0000 mgr.a (mgr.14373) 15621 : audit [DBG] from='client.337257 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:38:25.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:38:25 smithi047 bash[22744]: audit 2024-09-16T11:38:23.460742+0000 mgr.a (mgr.14373) 15621 : audit [DBG] from='client.337257 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:38:26.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:38:26 smithi157 bash[24585]: cluster 2024-09-16T11:38:25.229348+0000 mgr.a (mgr.14373) 15622 : cluster [DBG] pgmap v10835: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:38:26.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:38:26 smithi086 bash[24289]: cluster 2024-09-16T11:38:25.229348+0000 mgr.a (mgr.14373) 15622 : cluster [DBG] pgmap v10835: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:38:26.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:38:26 smithi047 bash[22744]: cluster 2024-09-16T11:38:25.229348+0000 mgr.a (mgr.14373) 15622 : cluster [DBG] pgmap v10835: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:38:27.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:38:27 smithi157 bash[24585]: cluster 2024-09-16T11:38:27.231609+0000 mgr.a (mgr.14373) 15623 : cluster [DBG] pgmap v10836: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:38:27.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:38:27 smithi086 bash[24289]: cluster 2024-09-16T11:38:27.231609+0000 mgr.a (mgr.14373) 15623 : cluster [DBG] pgmap v10836: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:38:27.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:38:27 smithi047 bash[22744]: cluster 2024-09-16T11:38:27.231609+0000 mgr.a (mgr.14373) 15623 : cluster [DBG] pgmap v10836: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:38:28.919 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:38:28.920 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:38:28.920 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:38:29.669 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:38:29.669 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:38:29.669 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:38:29.669 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:38:29.669 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:38:30.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:38:30 smithi157 bash[24585]: cluster 2024-09-16T11:38:29.232335+0000 mgr.a (mgr.14373) 15624 : cluster [DBG] pgmap v10837: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:38:30.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:38:30 smithi157 bash[24585]: audit 2024-09-16T11:38:29.250993+0000 mgr.a (mgr.14373) 15625 : audit [DBG] from='client.337326 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:38:30.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:38:30 smithi086 bash[24289]: cluster 2024-09-16T11:38:29.232335+0000 mgr.a (mgr.14373) 15624 : cluster [DBG] pgmap v10837: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:38:30.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:38:30 smithi086 bash[24289]: audit 2024-09-16T11:38:29.250993+0000 mgr.a (mgr.14373) 15625 : audit [DBG] from='client.337326 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:38:30.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:38:30 smithi047 bash[22744]: cluster 2024-09-16T11:38:29.232335+0000 mgr.a (mgr.14373) 15624 : cluster [DBG] pgmap v10837: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:38:30.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:38:30 smithi047 bash[22744]: audit 2024-09-16T11:38:29.250993+0000 mgr.a (mgr.14373) 15625 : audit [DBG] from='client.337326 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:38:32.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:38:32 smithi157 bash[24585]: cluster 2024-09-16T11:38:31.233232+0000 mgr.a (mgr.14373) 15626 : cluster [DBG] pgmap v10838: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:38:32.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:38:32 smithi086 bash[24289]: cluster 2024-09-16T11:38:31.233232+0000 mgr.a (mgr.14373) 15626 : cluster [DBG] pgmap v10838: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:38:32.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:38:32 smithi047 bash[22744]: cluster 2024-09-16T11:38:31.233232+0000 mgr.a (mgr.14373) 15626 : cluster [DBG] pgmap v10838: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:38:34.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:38:34 smithi157 bash[24585]: cluster 2024-09-16T11:38:33.235514+0000 mgr.a (mgr.14373) 15627 : cluster [DBG] pgmap v10839: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:38:34.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:38:34 smithi086 bash[24289]: cluster 2024-09-16T11:38:33.235514+0000 mgr.a (mgr.14373) 15627 : cluster [DBG] pgmap v10839: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:38:34.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:38:34 smithi047 bash[22744]: cluster 2024-09-16T11:38:33.235514+0000 mgr.a (mgr.14373) 15627 : cluster [DBG] pgmap v10839: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:38:34.670 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:38:34.671 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:38:34.671 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:38:35.472 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:38:35.472 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:38:35.472 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:38:35.472 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:38:35.472 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:38:35.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:38:35 smithi086 bash[24289]: audit 2024-09-16T11:38:35.078570+0000 mon.b (mon.2) 1422 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T11:38:35.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:38:35 smithi047 bash[22744]: audit 2024-09-16T11:38:35.078570+0000 mon.b (mon.2) 1422 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T11:38:35.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:38:35 smithi157 bash[24585]: audit 2024-09-16T11:38:35.078570+0000 mon.b (mon.2) 1422 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T11:38:36.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:38:36 smithi086 bash[24289]: audit 2024-09-16T11:38:35.006277+0000 mgr.a (mgr.14373) 15628 : audit [DBG] from='client.337404 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:38:36.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:38:36 smithi086 bash[24289]: cluster 2024-09-16T11:38:35.236040+0000 mgr.a (mgr.14373) 15629 : cluster [DBG] pgmap v10840: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:38:36.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:38:36 smithi086 bash[24289]: audit 2024-09-16T11:38:35.875588+0000 mon.b (mon.2) 1423 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T11:38:36.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:38:36 smithi086 bash[24289]: audit 2024-09-16T11:38:35.877957+0000 mon.b (mon.2) 1424 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T11:38:36.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:38:36 smithi086 bash[24289]: audit 2024-09-16T11:38:35.890014+0000 mon.a (mon.0) 1497 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:38:36.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:38:36 smithi086 bash[24289]: audit 2024-09-16T11:38:35.893609+0000 mon.b (mon.2) 1425 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:38:36.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:38:36 smithi047 bash[22744]: audit 2024-09-16T11:38:35.006277+0000 mgr.a (mgr.14373) 15628 : audit [DBG] from='client.337404 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:38:36.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:38:36 smithi047 bash[22744]: cluster 2024-09-16T11:38:35.236040+0000 mgr.a (mgr.14373) 15629 : cluster [DBG] pgmap v10840: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:38:36.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:38:36 smithi047 bash[22744]: audit 2024-09-16T11:38:35.875588+0000 mon.b (mon.2) 1423 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T11:38:36.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:38:36 smithi047 bash[22744]: audit 2024-09-16T11:38:35.877957+0000 mon.b (mon.2) 1424 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T11:38:36.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:38:36 smithi047 bash[22744]: audit 2024-09-16T11:38:35.890014+0000 mon.a (mon.0) 1497 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:38:36.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:38:36 smithi047 bash[22744]: audit 2024-09-16T11:38:35.893609+0000 mon.b (mon.2) 1425 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:38:36.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:38:36 smithi157 bash[24585]: audit 2024-09-16T11:38:35.006277+0000 mgr.a (mgr.14373) 15628 : audit [DBG] from='client.337404 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:38:36.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:38:36 smithi157 bash[24585]: cluster 2024-09-16T11:38:35.236040+0000 mgr.a (mgr.14373) 15629 : cluster [DBG] pgmap v10840: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:38:36.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:38:36 smithi157 bash[24585]: audit 2024-09-16T11:38:35.875588+0000 mon.b (mon.2) 1423 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T11:38:36.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:38:36 smithi157 bash[24585]: audit 2024-09-16T11:38:35.877957+0000 mon.b (mon.2) 1424 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T11:38:36.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:38:36 smithi157 bash[24585]: audit 2024-09-16T11:38:35.890014+0000 mon.a (mon.0) 1497 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:38:36.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:38:36 smithi157 bash[24585]: audit 2024-09-16T11:38:35.893609+0000 mon.b (mon.2) 1425 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:38:37.092 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 11:38:36 smithi047 bash[22994]: debug 2024-09-16T11:38:36.641+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T11:38:37.093 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 11:38:36 smithi047 bash[22994]: debug 2024-09-16T11:38:36.645+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T11:38:37.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:38:37 smithi086 bash[24289]: audit 2024-09-16T11:38:35.896832+0000 mgr.a (mgr.14373) 15630 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:38:37.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:38:37 smithi047 bash[22744]: audit 2024-09-16T11:38:35.896832+0000 mgr.a (mgr.14373) 15630 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:38:37.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:38:37 smithi157 bash[24585]: audit 2024-09-16T11:38:35.896832+0000 mgr.a (mgr.14373) 15630 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:38:38.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:38:38 smithi086 bash[24289]: audit 2024-09-16T11:38:36.645357+0000 mgr.a (mgr.14373) 15631 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T11:38:38.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:38:38 smithi086 bash[24289]: cephadm 2024-09-16T11:38:36.647543+0000 mgr.a (mgr.14373) 15632 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T11:38:38.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:38:38 smithi086 bash[24289]: cluster 2024-09-16T11:38:37.238829+0000 mgr.a (mgr.14373) 15633 : cluster [DBG] pgmap v10841: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 68 KiB/s rd, 255 B/s wr, 110 op/s 2024-09-16T11:38:38.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:38:38 smithi047 bash[22744]: audit 2024-09-16T11:38:36.645357+0000 mgr.a (mgr.14373) 15631 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T11:38:38.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:38:38 smithi047 bash[22744]: cephadm 2024-09-16T11:38:36.647543+0000 mgr.a (mgr.14373) 15632 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T11:38:38.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:38:38 smithi047 bash[22744]: cluster 2024-09-16T11:38:37.238829+0000 mgr.a (mgr.14373) 15633 : cluster [DBG] pgmap v10841: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 68 KiB/s rd, 255 B/s wr, 110 op/s 2024-09-16T11:38:38.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:38:38 smithi157 bash[24585]: audit 2024-09-16T11:38:36.645357+0000 mgr.a (mgr.14373) 15631 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T11:38:38.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:38:38 smithi157 bash[24585]: cephadm 2024-09-16T11:38:36.647543+0000 mgr.a (mgr.14373) 15632 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T11:38:38.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:38:38 smithi157 bash[24585]: cluster 2024-09-16T11:38:37.238829+0000 mgr.a (mgr.14373) 15633 : cluster [DBG] pgmap v10841: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 68 KiB/s rd, 255 B/s wr, 110 op/s 2024-09-16T11:38:40.473 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:38:40.474 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:38:40.474 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:38:40.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:38:40 smithi047 bash[22744]: cluster 2024-09-16T11:38:39.239797+0000 mgr.a (mgr.14373) 15634 : cluster [DBG] pgmap v10842: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 67 KiB/s rd, 255 B/s wr, 109 op/s 2024-09-16T11:38:40.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:38:40 smithi157 bash[24585]: cluster 2024-09-16T11:38:39.239797+0000 mgr.a (mgr.14373) 15634 : cluster [DBG] pgmap v10842: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 67 KiB/s rd, 255 B/s wr, 109 op/s 2024-09-16T11:38:40.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:38:40 smithi086 bash[24289]: cluster 2024-09-16T11:38:39.239797+0000 mgr.a (mgr.14373) 15634 : cluster [DBG] pgmap v10842: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 67 KiB/s rd, 255 B/s wr, 109 op/s 2024-09-16T11:38:41.224 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:38:41.224 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:38:41.224 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:38:41.225 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:38:41.225 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:38:42.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:38:42 smithi047 bash[22744]: audit 2024-09-16T11:38:40.807212+0000 mgr.a (mgr.14373) 15635 : audit [DBG] from='client.337575 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:38:42.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:38:42 smithi047 bash[22744]: cluster 2024-09-16T11:38:41.240461+0000 mgr.a (mgr.14373) 15636 : cluster [DBG] pgmap v10843: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 67 KiB/s rd, 255 B/s wr, 109 op/s 2024-09-16T11:38:42.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:38:42 smithi157 bash[24585]: audit 2024-09-16T11:38:40.807212+0000 mgr.a (mgr.14373) 15635 : audit [DBG] from='client.337575 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:38:42.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:38:42 smithi157 bash[24585]: cluster 2024-09-16T11:38:41.240461+0000 mgr.a (mgr.14373) 15636 : cluster [DBG] pgmap v10843: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 67 KiB/s rd, 255 B/s wr, 109 op/s 2024-09-16T11:38:42.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:38:42 smithi086 bash[24289]: audit 2024-09-16T11:38:40.807212+0000 mgr.a (mgr.14373) 15635 : audit [DBG] from='client.337575 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:38:42.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:38:42 smithi086 bash[24289]: cluster 2024-09-16T11:38:41.240461+0000 mgr.a (mgr.14373) 15636 : cluster [DBG] pgmap v10843: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 67 KiB/s rd, 255 B/s wr, 109 op/s 2024-09-16T11:38:44.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:38:44 smithi047 bash[22744]: cluster 2024-09-16T11:38:43.242753+0000 mgr.a (mgr.14373) 15637 : cluster [DBG] pgmap v10844: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 71 KiB/s rd, 426 B/s wr, 113 op/s 2024-09-16T11:38:44.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:38:44 smithi157 bash[24585]: cluster 2024-09-16T11:38:43.242753+0000 mgr.a (mgr.14373) 15637 : cluster [DBG] pgmap v10844: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 71 KiB/s rd, 426 B/s wr, 113 op/s 2024-09-16T11:38:44.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:38:44 smithi086 bash[24289]: cluster 2024-09-16T11:38:43.242753+0000 mgr.a (mgr.14373) 15637 : cluster [DBG] pgmap v10844: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 71 KiB/s rd, 426 B/s wr, 113 op/s 2024-09-16T11:38:46.225 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:38:46.226 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:38:46.226 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:38:46.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:38:46 smithi047 bash[22744]: cluster 2024-09-16T11:38:45.243507+0000 mgr.a (mgr.14373) 15638 : cluster [DBG] pgmap v10845: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 70 KiB/s rd, 426 B/s wr, 112 op/s 2024-09-16T11:38:46.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:38:46 smithi157 bash[24585]: cluster 2024-09-16T11:38:45.243507+0000 mgr.a (mgr.14373) 15638 : cluster [DBG] pgmap v10845: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 70 KiB/s rd, 426 B/s wr, 112 op/s 2024-09-16T11:38:46.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:38:46 smithi086 bash[24289]: cluster 2024-09-16T11:38:45.243507+0000 mgr.a (mgr.14373) 15638 : cluster [DBG] pgmap v10845: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 70 KiB/s rd, 426 B/s wr, 112 op/s 2024-09-16T11:38:47.006 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:38:47.007 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:38:47.007 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:38:47.007 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:38:47.007 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:38:48.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:38:48 smithi157 bash[24585]: audit 2024-09-16T11:38:46.559443+0000 mgr.a (mgr.14373) 15639 : audit [DBG] from='client.337653 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:38:48.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:38:48 smithi157 bash[24585]: cluster 2024-09-16T11:38:47.246404+0000 mgr.a (mgr.14373) 15640 : cluster [DBG] pgmap v10846: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 70 KiB/s rd, 426 B/s wr, 112 op/s 2024-09-16T11:38:48.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:38:48 smithi086 bash[24289]: audit 2024-09-16T11:38:46.559443+0000 mgr.a (mgr.14373) 15639 : audit [DBG] from='client.337653 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:38:48.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:38:48 smithi086 bash[24289]: cluster 2024-09-16T11:38:47.246404+0000 mgr.a (mgr.14373) 15640 : cluster [DBG] pgmap v10846: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 70 KiB/s rd, 426 B/s wr, 112 op/s 2024-09-16T11:38:48.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:38:48 smithi047 bash[22744]: audit 2024-09-16T11:38:46.559443+0000 mgr.a (mgr.14373) 15639 : audit [DBG] from='client.337653 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:38:48.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:38:48 smithi047 bash[22744]: cluster 2024-09-16T11:38:47.246404+0000 mgr.a (mgr.14373) 15640 : cluster [DBG] pgmap v10846: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 70 KiB/s rd, 426 B/s wr, 112 op/s 2024-09-16T11:38:50.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:38:50 smithi157 bash[24585]: cluster 2024-09-16T11:38:49.247178+0000 mgr.a (mgr.14373) 15641 : cluster [DBG] pgmap v10847: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 4.2 KiB/s rd, 170 B/s wr, 3 op/s 2024-09-16T11:38:50.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:38:50 smithi086 bash[24289]: cluster 2024-09-16T11:38:49.247178+0000 mgr.a (mgr.14373) 15641 : cluster [DBG] pgmap v10847: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 4.2 KiB/s rd, 170 B/s wr, 3 op/s 2024-09-16T11:38:50.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:38:50 smithi047 bash[22744]: cluster 2024-09-16T11:38:49.247178+0000 mgr.a (mgr.14373) 15641 : cluster [DBG] pgmap v10847: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 4.2 KiB/s rd, 170 B/s wr, 3 op/s 2024-09-16T11:38:52.008 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:38:52.009 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:38:52.009 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:38:52.754 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:38:52.755 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:38:52.755 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:38:52.755 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:38:52.755 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:38:52.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:38:52 smithi157 bash[24585]: cluster 2024-09-16T11:38:51.247930+0000 mgr.a (mgr.14373) 15642 : cluster [DBG] pgmap v10848: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 4.2 KiB/s rd, 170 B/s wr, 3 op/s 2024-09-16T11:38:52.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:38:52 smithi086 bash[24289]: cluster 2024-09-16T11:38:51.247930+0000 mgr.a (mgr.14373) 15642 : cluster [DBG] pgmap v10848: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 4.2 KiB/s rd, 170 B/s wr, 3 op/s 2024-09-16T11:38:52.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:38:52 smithi047 bash[22744]: cluster 2024-09-16T11:38:51.247930+0000 mgr.a (mgr.14373) 15642 : cluster [DBG] pgmap v10848: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 4.2 KiB/s rd, 170 B/s wr, 3 op/s 2024-09-16T11:38:53.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:38:53 smithi157 bash[24585]: audit 2024-09-16T11:38:52.341078+0000 mgr.a (mgr.14373) 15643 : audit [DBG] from='client.337731 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:38:53.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:38:53 smithi086 bash[24289]: audit 2024-09-16T11:38:52.341078+0000 mgr.a (mgr.14373) 15643 : audit [DBG] from='client.337731 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:38:53.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:38:53 smithi047 bash[22744]: audit 2024-09-16T11:38:52.341078+0000 mgr.a (mgr.14373) 15643 : audit [DBG] from='client.337731 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:38:54.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:38:54 smithi157 bash[24585]: cluster 2024-09-16T11:38:53.250652+0000 mgr.a (mgr.14373) 15644 : cluster [DBG] pgmap v10849: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 5.1 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-16T11:38:54.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:38:54 smithi086 bash[24289]: cluster 2024-09-16T11:38:53.250652+0000 mgr.a (mgr.14373) 15644 : cluster [DBG] pgmap v10849: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 5.1 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-16T11:38:54.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:38:54 smithi047 bash[22744]: cluster 2024-09-16T11:38:53.250652+0000 mgr.a (mgr.14373) 15644 : cluster [DBG] pgmap v10849: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 5.1 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-16T11:38:56.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:38:56 smithi157 bash[24585]: cluster 2024-09-16T11:38:55.251400+0000 mgr.a (mgr.14373) 15645 : cluster [DBG] pgmap v10850: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:38:56.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:38:56 smithi086 bash[24289]: cluster 2024-09-16T11:38:55.251400+0000 mgr.a (mgr.14373) 15645 : cluster [DBG] pgmap v10850: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:38:56.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:38:56 smithi047 bash[22744]: cluster 2024-09-16T11:38:55.251400+0000 mgr.a (mgr.14373) 15645 : cluster [DBG] pgmap v10850: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:38:57.756 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:38:57.757 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:38:57.757 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:38:57.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:38:57 smithi157 bash[24585]: cluster 2024-09-16T11:38:57.253413+0000 mgr.a (mgr.14373) 15646 : cluster [DBG] pgmap v10851: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:38:57.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:38:57 smithi086 bash[24289]: cluster 2024-09-16T11:38:57.253413+0000 mgr.a (mgr.14373) 15646 : cluster [DBG] pgmap v10851: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:38:57.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:38:57 smithi047 bash[22744]: cluster 2024-09-16T11:38:57.253413+0000 mgr.a (mgr.14373) 15646 : cluster [DBG] pgmap v10851: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:38:58.526 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:38:58.526 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:38:58.526 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:38:58.526 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:38:58.526 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:38:58.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:38:58 smithi157 bash[24585]: audit 2024-09-16T11:38:58.091713+0000 mgr.a (mgr.14373) 15647 : audit [DBG] from='client.337809 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:38:58.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:38:58 smithi086 bash[24289]: audit 2024-09-16T11:38:58.091713+0000 mgr.a (mgr.14373) 15647 : audit [DBG] from='client.337809 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:38:58.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:38:58 smithi047 bash[22744]: audit 2024-09-16T11:38:58.091713+0000 mgr.a (mgr.14373) 15647 : audit [DBG] from='client.337809 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:38:59.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:38:59 smithi157 bash[24585]: cluster 2024-09-16T11:38:59.254291+0000 mgr.a (mgr.14373) 15648 : cluster [DBG] pgmap v10852: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:38:59.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:38:59 smithi086 bash[24289]: cluster 2024-09-16T11:38:59.254291+0000 mgr.a (mgr.14373) 15648 : cluster [DBG] pgmap v10852: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:38:59.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:38:59 smithi047 bash[22744]: cluster 2024-09-16T11:38:59.254291+0000 mgr.a (mgr.14373) 15648 : cluster [DBG] pgmap v10852: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:39:02.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:39:02 smithi086 bash[24289]: cluster 2024-09-16T11:39:01.255066+0000 mgr.a (mgr.14373) 15649 : cluster [DBG] pgmap v10853: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:39:02.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:39:02 smithi047 bash[22744]: cluster 2024-09-16T11:39:01.255066+0000 mgr.a (mgr.14373) 15649 : cluster [DBG] pgmap v10853: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:39:02.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:39:02 smithi157 bash[24585]: cluster 2024-09-16T11:39:01.255066+0000 mgr.a (mgr.14373) 15649 : cluster [DBG] pgmap v10853: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:39:03.527 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:39:03.528 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:39:03.528 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:39:04.312 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:39:04.312 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:39:04.312 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:39:04.312 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:39:04.312 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:39:04.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:39:04 smithi086 bash[24289]: cluster 2024-09-16T11:39:03.257271+0000 mgr.a (mgr.14373) 15650 : cluster [DBG] pgmap v10854: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:39:04.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:39:04 smithi047 bash[22744]: cluster 2024-09-16T11:39:03.257271+0000 mgr.a (mgr.14373) 15650 : cluster [DBG] pgmap v10854: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:39:04.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:39:04 smithi157 bash[24585]: cluster 2024-09-16T11:39:03.257271+0000 mgr.a (mgr.14373) 15650 : cluster [DBG] pgmap v10854: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:39:05.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:39:05 smithi047 bash[22744]: audit 2024-09-16T11:39:03.859694+0000 mgr.a (mgr.14373) 15651 : audit [DBG] from='client.337887 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:39:05.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:39:05 smithi157 bash[24585]: audit 2024-09-16T11:39:03.859694+0000 mgr.a (mgr.14373) 15651 : audit [DBG] from='client.337887 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:39:05.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:39:05 smithi086 bash[24289]: audit 2024-09-16T11:39:03.859694+0000 mgr.a (mgr.14373) 15651 : audit [DBG] from='client.337887 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:39:06.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:39:06 smithi047 bash[22744]: cluster 2024-09-16T11:39:05.258181+0000 mgr.a (mgr.14373) 15652 : cluster [DBG] pgmap v10855: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:39:06.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:39:06 smithi157 bash[24585]: cluster 2024-09-16T11:39:05.258181+0000 mgr.a (mgr.14373) 15652 : cluster [DBG] pgmap v10855: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:39:06.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:39:06 smithi086 bash[24289]: cluster 2024-09-16T11:39:05.258181+0000 mgr.a (mgr.14373) 15652 : cluster [DBG] pgmap v10855: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:39:08.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:39:08 smithi047 bash[22744]: cluster 2024-09-16T11:39:07.260372+0000 mgr.a (mgr.14373) 15653 : cluster [DBG] pgmap v10856: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:39:08.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:39:08 smithi157 bash[24585]: cluster 2024-09-16T11:39:07.260372+0000 mgr.a (mgr.14373) 15653 : cluster [DBG] pgmap v10856: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:39:08.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:39:08 smithi086 bash[24289]: cluster 2024-09-16T11:39:07.260372+0000 mgr.a (mgr.14373) 15653 : cluster [DBG] pgmap v10856: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:39:09.313 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:39:09.314 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:39:09.314 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:39:10.096 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:39:10.096 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:39:10.096 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:39:10.097 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:39:10.097 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:39:10.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:39:10 smithi047 bash[22744]: cluster 2024-09-16T11:39:09.261093+0000 mgr.a (mgr.14373) 15654 : cluster [DBG] pgmap v10857: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:39:10.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:39:10 smithi157 bash[24585]: cluster 2024-09-16T11:39:09.261093+0000 mgr.a (mgr.14373) 15654 : cluster [DBG] pgmap v10857: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:39:10.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:39:10 smithi086 bash[24289]: cluster 2024-09-16T11:39:09.261093+0000 mgr.a (mgr.14373) 15654 : cluster [DBG] pgmap v10857: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:39:11.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:39:11 smithi157 bash[24585]: audit 2024-09-16T11:39:09.653607+0000 mgr.a (mgr.14373) 15655 : audit [DBG] from='client.337965 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:39:11.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:39:11 smithi086 bash[24289]: audit 2024-09-16T11:39:09.653607+0000 mgr.a (mgr.14373) 15655 : audit [DBG] from='client.337965 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:39:11.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:39:11 smithi047 bash[22744]: audit 2024-09-16T11:39:09.653607+0000 mgr.a (mgr.14373) 15655 : audit [DBG] from='client.337965 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:39:12.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:39:12 smithi157 bash[24585]: cluster 2024-09-16T11:39:11.261999+0000 mgr.a (mgr.14373) 15656 : cluster [DBG] pgmap v10858: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:39:12.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:39:12 smithi086 bash[24289]: cluster 2024-09-16T11:39:11.261999+0000 mgr.a (mgr.14373) 15656 : cluster [DBG] pgmap v10858: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:39:12.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:39:12 smithi047 bash[22744]: cluster 2024-09-16T11:39:11.261999+0000 mgr.a (mgr.14373) 15656 : cluster [DBG] pgmap v10858: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:39:14.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:39:14 smithi157 bash[24585]: cluster 2024-09-16T11:39:13.264352+0000 mgr.a (mgr.14373) 15657 : cluster [DBG] pgmap v10859: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:39:14.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:39:14 smithi086 bash[24289]: cluster 2024-09-16T11:39:13.264352+0000 mgr.a (mgr.14373) 15657 : cluster [DBG] pgmap v10859: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:39:14.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:39:14 smithi047 bash[22744]: cluster 2024-09-16T11:39:13.264352+0000 mgr.a (mgr.14373) 15657 : cluster [DBG] pgmap v10859: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:39:15.097 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:39:15.098 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:39:15.098 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:39:15.871 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:39:15.872 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:39:15.872 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:39:15.872 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:39:15.872 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:39:16.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:39:16 smithi157 bash[24585]: cluster 2024-09-16T11:39:15.265093+0000 mgr.a (mgr.14373) 15658 : cluster [DBG] pgmap v10860: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:39:16.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:39:16 smithi086 bash[24289]: cluster 2024-09-16T11:39:15.265093+0000 mgr.a (mgr.14373) 15658 : cluster [DBG] pgmap v10860: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:39:16.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:39:16 smithi047 bash[22744]: cluster 2024-09-16T11:39:15.265093+0000 mgr.a (mgr.14373) 15658 : cluster [DBG] pgmap v10860: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:39:17.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:39:17 smithi157 bash[24585]: audit 2024-09-16T11:39:15.432312+0000 mgr.a (mgr.14373) 15659 : audit [DBG] from='client.338043 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:39:17.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:39:17 smithi086 bash[24289]: audit 2024-09-16T11:39:15.432312+0000 mgr.a (mgr.14373) 15659 : audit [DBG] from='client.338043 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:39:17.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:39:17 smithi047 bash[22744]: audit 2024-09-16T11:39:15.432312+0000 mgr.a (mgr.14373) 15659 : audit [DBG] from='client.338043 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:39:18.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:39:18 smithi157 bash[24585]: cluster 2024-09-16T11:39:17.267444+0000 mgr.a (mgr.14373) 15660 : cluster [DBG] pgmap v10861: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:39:18.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:39:18 smithi086 bash[24289]: cluster 2024-09-16T11:39:17.267444+0000 mgr.a (mgr.14373) 15660 : cluster [DBG] pgmap v10861: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:39:18.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:39:18 smithi047 bash[22744]: cluster 2024-09-16T11:39:17.267444+0000 mgr.a (mgr.14373) 15660 : cluster [DBG] pgmap v10861: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:39:20.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:39:20 smithi157 bash[24585]: cluster 2024-09-16T11:39:19.268203+0000 mgr.a (mgr.14373) 15661 : cluster [DBG] pgmap v10862: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:39:20.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:39:20 smithi086 bash[24289]: cluster 2024-09-16T11:39:19.268203+0000 mgr.a (mgr.14373) 15661 : cluster [DBG] pgmap v10862: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:39:20.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:39:20 smithi047 bash[22744]: cluster 2024-09-16T11:39:19.268203+0000 mgr.a (mgr.14373) 15661 : cluster [DBG] pgmap v10862: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:39:20.873 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:39:20.874 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:39:20.874 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:39:21.644 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:39:21.645 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:39:21.645 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:39:21.645 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:39:21.645 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:39:22.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:39:22 smithi157 bash[24585]: audit 2024-09-16T11:39:21.210214+0000 mgr.a (mgr.14373) 15662 : audit [DBG] from='client.338118 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:39:22.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:39:22 smithi157 bash[24585]: cluster 2024-09-16T11:39:21.269383+0000 mgr.a (mgr.14373) 15663 : cluster [DBG] pgmap v10863: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:39:22.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:39:22 smithi086 bash[24289]: audit 2024-09-16T11:39:21.210214+0000 mgr.a (mgr.14373) 15662 : audit [DBG] from='client.338118 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:39:22.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:39:22 smithi086 bash[24289]: cluster 2024-09-16T11:39:21.269383+0000 mgr.a (mgr.14373) 15663 : cluster [DBG] pgmap v10863: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:39:22.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:39:22 smithi047 bash[22744]: audit 2024-09-16T11:39:21.210214+0000 mgr.a (mgr.14373) 15662 : audit [DBG] from='client.338118 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:39:22.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:39:22 smithi047 bash[22744]: cluster 2024-09-16T11:39:21.269383+0000 mgr.a (mgr.14373) 15663 : cluster [DBG] pgmap v10863: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:39:24.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:39:24 smithi157 bash[24585]: cluster 2024-09-16T11:39:23.272237+0000 mgr.a (mgr.14373) 15664 : cluster [DBG] pgmap v10864: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:39:24.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:39:24 smithi086 bash[24289]: cluster 2024-09-16T11:39:23.272237+0000 mgr.a (mgr.14373) 15664 : cluster [DBG] pgmap v10864: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:39:24.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:39:24 smithi047 bash[22744]: cluster 2024-09-16T11:39:23.272237+0000 mgr.a (mgr.14373) 15664 : cluster [DBG] pgmap v10864: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:39:26.646 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:39:26.646 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:39:26.647 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:39:26.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:39:26 smithi157 bash[24585]: cluster 2024-09-16T11:39:25.272994+0000 mgr.a (mgr.14373) 15665 : cluster [DBG] pgmap v10865: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:39:26.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:39:26 smithi086 bash[24289]: cluster 2024-09-16T11:39:25.272994+0000 mgr.a (mgr.14373) 15665 : cluster [DBG] pgmap v10865: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:39:26.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:39:26 smithi047 bash[22744]: cluster 2024-09-16T11:39:25.272994+0000 mgr.a (mgr.14373) 15665 : cluster [DBG] pgmap v10865: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:39:27.402 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:39:27.403 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:39:27.403 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:39:27.403 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:39:27.403 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:39:28.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:39:28 smithi157 bash[24585]: audit 2024-09-16T11:39:26.977983+0000 mgr.a (mgr.14373) 15666 : audit [DBG] from='client.338190 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:39:28.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:39:28 smithi157 bash[24585]: cluster 2024-09-16T11:39:27.274354+0000 mgr.a (mgr.14373) 15667 : cluster [DBG] pgmap v10866: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:39:28.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:39:28 smithi086 bash[24289]: audit 2024-09-16T11:39:26.977983+0000 mgr.a (mgr.14373) 15666 : audit [DBG] from='client.338190 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:39:28.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:39:28 smithi086 bash[24289]: cluster 2024-09-16T11:39:27.274354+0000 mgr.a (mgr.14373) 15667 : cluster [DBG] pgmap v10866: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:39:28.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:39:28 smithi047 bash[22744]: audit 2024-09-16T11:39:26.977983+0000 mgr.a (mgr.14373) 15666 : audit [DBG] from='client.338190 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:39:28.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:39:28 smithi047 bash[22744]: cluster 2024-09-16T11:39:27.274354+0000 mgr.a (mgr.14373) 15667 : cluster [DBG] pgmap v10866: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:39:30.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:39:30 smithi157 bash[24585]: cluster 2024-09-16T11:39:29.275223+0000 mgr.a (mgr.14373) 15668 : cluster [DBG] pgmap v10867: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:39:30.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:39:30 smithi086 bash[24289]: cluster 2024-09-16T11:39:29.275223+0000 mgr.a (mgr.14373) 15668 : cluster [DBG] pgmap v10867: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:39:30.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:39:30 smithi047 bash[22744]: cluster 2024-09-16T11:39:29.275223+0000 mgr.a (mgr.14373) 15668 : cluster [DBG] pgmap v10867: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:39:32.405 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:39:32.405 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:39:32.405 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:39:32.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:39:32 smithi157 bash[24585]: cluster 2024-09-16T11:39:31.275987+0000 mgr.a (mgr.14373) 15669 : cluster [DBG] pgmap v10868: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T11:39:32.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:39:32 smithi086 bash[24289]: cluster 2024-09-16T11:39:31.275987+0000 mgr.a (mgr.14373) 15669 : cluster [DBG] pgmap v10868: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T11:39:32.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:39:32 smithi047 bash[22744]: cluster 2024-09-16T11:39:31.275987+0000 mgr.a (mgr.14373) 15669 : cluster [DBG] pgmap v10868: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T11:39:33.172 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:39:33.172 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:39:33.172 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:39:33.172 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:39:33.172 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:39:33.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:39:33 smithi157 bash[24585]: audit 2024-09-16T11:39:32.738078+0000 mgr.a (mgr.14373) 15670 : audit [DBG] from='client.338265 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:39:33.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:39:33 smithi157 bash[24585]: cluster 2024-09-16T11:39:33.278635+0000 mgr.a (mgr.14373) 15671 : cluster [DBG] pgmap v10869: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:39:33.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:39:33 smithi086 bash[24289]: audit 2024-09-16T11:39:32.738078+0000 mgr.a (mgr.14373) 15670 : audit [DBG] from='client.338265 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:39:33.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:39:33 smithi086 bash[24289]: cluster 2024-09-16T11:39:33.278635+0000 mgr.a (mgr.14373) 15671 : cluster [DBG] pgmap v10869: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:39:33.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:39:33 smithi047 bash[22744]: audit 2024-09-16T11:39:32.738078+0000 mgr.a (mgr.14373) 15670 : audit [DBG] from='client.338265 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:39:33.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:39:33 smithi047 bash[22744]: cluster 2024-09-16T11:39:33.278635+0000 mgr.a (mgr.14373) 15671 : cluster [DBG] pgmap v10869: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:39:36.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:39:36 smithi047 bash[22744]: cluster 2024-09-16T11:39:35.279407+0000 mgr.a (mgr.14373) 15672 : cluster [DBG] pgmap v10870: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:39:36.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:39:36 smithi157 bash[24585]: cluster 2024-09-16T11:39:35.279407+0000 mgr.a (mgr.14373) 15672 : cluster [DBG] pgmap v10870: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:39:36.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:39:36 smithi086 bash[24289]: cluster 2024-09-16T11:39:35.279407+0000 mgr.a (mgr.14373) 15672 : cluster [DBG] pgmap v10870: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:39:37.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:39:37 smithi157 bash[24585]: audit 2024-09-16T11:39:36.698509+0000 mon.b (mon.2) 1426 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T11:39:37.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:39:37 smithi086 bash[24289]: audit 2024-09-16T11:39:36.698509+0000 mon.b (mon.2) 1426 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T11:39:37.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:39:37 smithi047 bash[22744]: audit 2024-09-16T11:39:36.698509+0000 mon.b (mon.2) 1426 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T11:39:38.173 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:39:38.174 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:39:38.174 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:39:38.592 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 11:39:38 smithi047 bash[22994]: debug 2024-09-16T11:39:38.280+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T11:39:38.593 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 11:39:38 smithi047 bash[22994]: debug 2024-09-16T11:39:38.284+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T11:39:38.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:39:38 smithi047 bash[22744]: cluster 2024-09-16T11:39:37.280379+0000 mgr.a (mgr.14373) 15673 : cluster [DBG] pgmap v10871: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:39:38.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:39:38 smithi047 bash[22744]: audit 2024-09-16T11:39:37.526827+0000 mon.b (mon.2) 1427 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T11:39:38.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:39:38 smithi047 bash[22744]: audit 2024-09-16T11:39:37.529040+0000 mon.b (mon.2) 1428 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T11:39:38.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:39:38 smithi047 bash[22744]: audit 2024-09-16T11:39:37.540963+0000 mon.a (mon.0) 1498 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:39:38.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:39:38 smithi047 bash[22744]: audit 2024-09-16T11:39:37.546420+0000 mon.b (mon.2) 1429 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:39:38.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:39:38 smithi157 bash[24585]: cluster 2024-09-16T11:39:37.280379+0000 mgr.a (mgr.14373) 15673 : cluster [DBG] pgmap v10871: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:39:38.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:39:38 smithi157 bash[24585]: audit 2024-09-16T11:39:37.526827+0000 mon.b (mon.2) 1427 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T11:39:38.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:39:38 smithi157 bash[24585]: audit 2024-09-16T11:39:37.529040+0000 mon.b (mon.2) 1428 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T11:39:38.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:39:38 smithi157 bash[24585]: audit 2024-09-16T11:39:37.540963+0000 mon.a (mon.0) 1498 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:39:38.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:39:38 smithi157 bash[24585]: audit 2024-09-16T11:39:37.546420+0000 mon.b (mon.2) 1429 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:39:38.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:39:38 smithi086 bash[24289]: cluster 2024-09-16T11:39:37.280379+0000 mgr.a (mgr.14373) 15673 : cluster [DBG] pgmap v10871: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:39:38.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:39:38 smithi086 bash[24289]: audit 2024-09-16T11:39:37.526827+0000 mon.b (mon.2) 1427 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T11:39:38.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:39:38 smithi086 bash[24289]: audit 2024-09-16T11:39:37.529040+0000 mon.b (mon.2) 1428 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T11:39:38.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:39:38 smithi086 bash[24289]: audit 2024-09-16T11:39:37.540963+0000 mon.a (mon.0) 1498 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:39:38.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:39:38 smithi086 bash[24289]: audit 2024-09-16T11:39:37.546420+0000 mon.b (mon.2) 1429 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:39:38.941 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:39:38.941 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:39:38.941 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:39:38.941 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:39:38.941 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:39:39.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:39:39 smithi157 bash[24585]: audit 2024-09-16T11:39:37.549108+0000 mgr.a (mgr.14373) 15674 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:39:39.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:39:39 smithi157 bash[24585]: audit 2024-09-16T11:39:38.286259+0000 mgr.a (mgr.14373) 15675 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T11:39:39.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:39:39 smithi157 bash[24585]: cephadm 2024-09-16T11:39:38.287976+0000 mgr.a (mgr.14373) 15676 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T11:39:39.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:39:39 smithi086 bash[24289]: audit 2024-09-16T11:39:37.549108+0000 mgr.a (mgr.14373) 15674 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:39:39.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:39:39 smithi086 bash[24289]: audit 2024-09-16T11:39:38.286259+0000 mgr.a (mgr.14373) 15675 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T11:39:39.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:39:39 smithi086 bash[24289]: cephadm 2024-09-16T11:39:38.287976+0000 mgr.a (mgr.14373) 15676 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T11:39:39.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:39:39 smithi047 bash[22744]: audit 2024-09-16T11:39:37.549108+0000 mgr.a (mgr.14373) 15674 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:39:39.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:39:39 smithi047 bash[22744]: audit 2024-09-16T11:39:38.286259+0000 mgr.a (mgr.14373) 15675 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T11:39:39.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:39:39 smithi047 bash[22744]: cephadm 2024-09-16T11:39:38.287976+0000 mgr.a (mgr.14373) 15676 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T11:39:40.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:39:40 smithi157 bash[24585]: audit 2024-09-16T11:39:38.502624+0000 mgr.a (mgr.14373) 15677 : audit [DBG] from='client.338451 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:39:40.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:39:40 smithi157 bash[24585]: cluster 2024-09-16T11:39:39.281273+0000 mgr.a (mgr.14373) 15678 : cluster [DBG] pgmap v10872: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:39:40.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:39:40 smithi086 bash[24289]: audit 2024-09-16T11:39:38.502624+0000 mgr.a (mgr.14373) 15677 : audit [DBG] from='client.338451 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:39:40.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:39:40 smithi086 bash[24289]: cluster 2024-09-16T11:39:39.281273+0000 mgr.a (mgr.14373) 15678 : cluster [DBG] pgmap v10872: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:39:40.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:39:40 smithi047 bash[22744]: audit 2024-09-16T11:39:38.502624+0000 mgr.a (mgr.14373) 15677 : audit [DBG] from='client.338451 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:39:40.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:39:40 smithi047 bash[22744]: cluster 2024-09-16T11:39:39.281273+0000 mgr.a (mgr.14373) 15678 : cluster [DBG] pgmap v10872: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:39:42.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:39:42 smithi157 bash[24585]: cluster 2024-09-16T11:39:41.282047+0000 mgr.a (mgr.14373) 15679 : cluster [DBG] pgmap v10873: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:39:42.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:39:42 smithi086 bash[24289]: cluster 2024-09-16T11:39:41.282047+0000 mgr.a (mgr.14373) 15679 : cluster [DBG] pgmap v10873: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:39:42.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:39:42 smithi047 bash[22744]: cluster 2024-09-16T11:39:41.282047+0000 mgr.a (mgr.14373) 15679 : cluster [DBG] pgmap v10873: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:39:43.942 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:39:43.943 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:39:43.943 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:39:44.735 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:39:44.735 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:39:44.735 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:39:44.735 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:39:44.735 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:39:44.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:39:44 smithi157 bash[24585]: cluster 2024-09-16T11:39:43.284295+0000 mgr.a (mgr.14373) 15680 : cluster [DBG] pgmap v10874: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:39:44.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:39:44 smithi086 bash[24289]: cluster 2024-09-16T11:39:43.284295+0000 mgr.a (mgr.14373) 15680 : cluster [DBG] pgmap v10874: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:39:44.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:39:44 smithi047 bash[22744]: cluster 2024-09-16T11:39:43.284295+0000 mgr.a (mgr.14373) 15680 : cluster [DBG] pgmap v10874: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:39:45.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:39:45 smithi157 bash[24585]: audit 2024-09-16T11:39:44.280325+0000 mgr.a (mgr.14373) 15681 : audit [DBG] from='client.338523 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:39:45.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:39:45 smithi086 bash[24289]: audit 2024-09-16T11:39:44.280325+0000 mgr.a (mgr.14373) 15681 : audit [DBG] from='client.338523 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:39:45.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:39:45 smithi047 bash[22744]: audit 2024-09-16T11:39:44.280325+0000 mgr.a (mgr.14373) 15681 : audit [DBG] from='client.338523 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:39:46.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:39:46 smithi157 bash[24585]: cluster 2024-09-16T11:39:45.285271+0000 mgr.a (mgr.14373) 15682 : cluster [DBG] pgmap v10875: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:39:46.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:39:46 smithi086 bash[24289]: cluster 2024-09-16T11:39:45.285271+0000 mgr.a (mgr.14373) 15682 : cluster [DBG] pgmap v10875: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:39:46.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:39:46 smithi047 bash[22744]: cluster 2024-09-16T11:39:45.285271+0000 mgr.a (mgr.14373) 15682 : cluster [DBG] pgmap v10875: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:39:48.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:39:48 smithi157 bash[24585]: cluster 2024-09-16T11:39:47.287514+0000 mgr.a (mgr.14373) 15683 : cluster [DBG] pgmap v10876: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:39:48.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:39:48 smithi086 bash[24289]: cluster 2024-09-16T11:39:47.287514+0000 mgr.a (mgr.14373) 15683 : cluster [DBG] pgmap v10876: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:39:48.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:39:48 smithi047 bash[22744]: cluster 2024-09-16T11:39:47.287514+0000 mgr.a (mgr.14373) 15683 : cluster [DBG] pgmap v10876: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:39:49.736 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:39:49.737 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:39:49.737 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:39:50.539 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:39:50.539 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:39:50.539 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:39:50.540 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:39:50.540 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:39:50.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:39:50 smithi157 bash[24585]: cluster 2024-09-16T11:39:49.288269+0000 mgr.a (mgr.14373) 15684 : cluster [DBG] pgmap v10877: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:39:50.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:39:50 smithi086 bash[24289]: cluster 2024-09-16T11:39:49.288269+0000 mgr.a (mgr.14373) 15684 : cluster [DBG] pgmap v10877: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:39:50.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:39:50 smithi047 bash[22744]: cluster 2024-09-16T11:39:49.288269+0000 mgr.a (mgr.14373) 15684 : cluster [DBG] pgmap v10877: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:39:51.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:39:51 smithi157 bash[24585]: audit 2024-09-16T11:39:50.071677+0000 mgr.a (mgr.14373) 15685 : audit [DBG] from='client.338601 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:39:51.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:39:51 smithi086 bash[24289]: audit 2024-09-16T11:39:50.071677+0000 mgr.a (mgr.14373) 15685 : audit [DBG] from='client.338601 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:39:51.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:39:51 smithi047 bash[22744]: audit 2024-09-16T11:39:50.071677+0000 mgr.a (mgr.14373) 15685 : audit [DBG] from='client.338601 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:39:52.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:39:52 smithi157 bash[24585]: cluster 2024-09-16T11:39:51.289444+0000 mgr.a (mgr.14373) 15686 : cluster [DBG] pgmap v10878: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:39:52.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:39:52 smithi086 bash[24289]: cluster 2024-09-16T11:39:51.289444+0000 mgr.a (mgr.14373) 15686 : cluster [DBG] pgmap v10878: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:39:52.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:39:52 smithi047 bash[22744]: cluster 2024-09-16T11:39:51.289444+0000 mgr.a (mgr.14373) 15686 : cluster [DBG] pgmap v10878: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:39:53.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:39:53 smithi157 bash[24585]: cluster 2024-09-16T11:39:53.291784+0000 mgr.a (mgr.14373) 15687 : cluster [DBG] pgmap v10879: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:39:53.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:39:53 smithi086 bash[24289]: cluster 2024-09-16T11:39:53.291784+0000 mgr.a (mgr.14373) 15687 : cluster [DBG] pgmap v10879: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:39:53.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:39:53 smithi047 bash[22744]: cluster 2024-09-16T11:39:53.291784+0000 mgr.a (mgr.14373) 15687 : cluster [DBG] pgmap v10879: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:39:55.541 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:39:55.542 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:39:55.542 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:39:56.292 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:39:56.293 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:39:56.293 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:39:56.293 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:39:56.293 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:39:56.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:39:56 smithi157 bash[24585]: cluster 2024-09-16T11:39:55.292491+0000 mgr.a (mgr.14373) 15688 : cluster [DBG] pgmap v10880: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:39:56.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:39:56 smithi086 bash[24289]: cluster 2024-09-16T11:39:55.292491+0000 mgr.a (mgr.14373) 15688 : cluster [DBG] pgmap v10880: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:39:56.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:39:56 smithi047 bash[22744]: cluster 2024-09-16T11:39:55.292491+0000 mgr.a (mgr.14373) 15688 : cluster [DBG] pgmap v10880: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:39:57.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:39:57 smithi157 bash[24585]: audit 2024-09-16T11:39:55.868661+0000 mgr.a (mgr.14373) 15689 : audit [DBG] from='client.338673 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:39:57.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:39:57 smithi086 bash[24289]: audit 2024-09-16T11:39:55.868661+0000 mgr.a (mgr.14373) 15689 : audit [DBG] from='client.338673 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:39:57.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:39:57 smithi047 bash[22744]: audit 2024-09-16T11:39:55.868661+0000 mgr.a (mgr.14373) 15689 : audit [DBG] from='client.338673 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:39:58.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:39:58 smithi157 bash[24585]: cluster 2024-09-16T11:39:57.294872+0000 mgr.a (mgr.14373) 15690 : cluster [DBG] pgmap v10881: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:39:58.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:39:58 smithi086 bash[24289]: cluster 2024-09-16T11:39:57.294872+0000 mgr.a (mgr.14373) 15690 : cluster [DBG] pgmap v10881: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:39:58.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:39:58 smithi047 bash[22744]: cluster 2024-09-16T11:39:57.294872+0000 mgr.a (mgr.14373) 15690 : cluster [DBG] pgmap v10881: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:40:00.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:40:00 smithi157 bash[24585]: cluster 2024-09-16T11:39:59.295643+0000 mgr.a (mgr.14373) 15691 : cluster [DBG] pgmap v10882: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:40:00.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:40:00 smithi157 bash[24585]: cluster 2024-09-16T11:40:00.000144+0000 mon.a (mon.0) 1499 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-16T11:40:00.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:40:00 smithi086 bash[24289]: cluster 2024-09-16T11:39:59.295643+0000 mgr.a (mgr.14373) 15691 : cluster [DBG] pgmap v10882: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:40:00.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:40:00 smithi086 bash[24289]: cluster 2024-09-16T11:40:00.000144+0000 mon.a (mon.0) 1499 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-16T11:40:00.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:40:00 smithi047 bash[22744]: cluster 2024-09-16T11:39:59.295643+0000 mgr.a (mgr.14373) 15691 : cluster [DBG] pgmap v10882: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:40:00.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:40:00 smithi047 bash[22744]: cluster 2024-09-16T11:40:00.000144+0000 mon.a (mon.0) 1499 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-16T11:40:01.294 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:40:01.295 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:40:01.295 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:40:02.050 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:40:02.051 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:40:02.051 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:40:02.051 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:40:02.051 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:40:02.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:40:02 smithi157 bash[24585]: cluster 2024-09-16T11:40:01.296351+0000 mgr.a (mgr.14373) 15692 : cluster [DBG] pgmap v10883: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:40:02.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:40:02 smithi086 bash[24289]: cluster 2024-09-16T11:40:01.296351+0000 mgr.a (mgr.14373) 15692 : cluster [DBG] pgmap v10883: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:40:02.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:40:02 smithi047 bash[22744]: cluster 2024-09-16T11:40:01.296351+0000 mgr.a (mgr.14373) 15692 : cluster [DBG] pgmap v10883: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:40:03.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:40:03 smithi157 bash[24585]: audit 2024-09-16T11:40:01.625021+0000 mgr.a (mgr.14373) 15693 : audit [DBG] from='client.338748 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:40:03.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:40:03 smithi086 bash[24289]: audit 2024-09-16T11:40:01.625021+0000 mgr.a (mgr.14373) 15693 : audit [DBG] from='client.338748 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:40:03.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:40:03 smithi047 bash[22744]: audit 2024-09-16T11:40:01.625021+0000 mgr.a (mgr.14373) 15693 : audit [DBG] from='client.338748 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:40:04.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:40:04 smithi157 bash[24585]: cluster 2024-09-16T11:40:03.299211+0000 mgr.a (mgr.14373) 15694 : cluster [DBG] pgmap v10884: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:40:04.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:40:04 smithi086 bash[24289]: cluster 2024-09-16T11:40:03.299211+0000 mgr.a (mgr.14373) 15694 : cluster [DBG] pgmap v10884: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:40:04.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:40:04 smithi047 bash[22744]: cluster 2024-09-16T11:40:03.299211+0000 mgr.a (mgr.14373) 15694 : cluster [DBG] pgmap v10884: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:40:06.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:40:06 smithi157 bash[24585]: cluster 2024-09-16T11:40:05.300013+0000 mgr.a (mgr.14373) 15695 : cluster [DBG] pgmap v10885: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:40:06.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:40:06 smithi086 bash[24289]: cluster 2024-09-16T11:40:05.300013+0000 mgr.a (mgr.14373) 15695 : cluster [DBG] pgmap v10885: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:40:06.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:40:06 smithi047 bash[22744]: cluster 2024-09-16T11:40:05.300013+0000 mgr.a (mgr.14373) 15695 : cluster [DBG] pgmap v10885: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:40:07.052 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:40:07.053 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:40:07.053 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:40:07.837 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:40:07.838 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:40:07.838 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:40:07.838 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:40:07.838 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:40:08.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:40:08 smithi157 bash[24585]: cluster 2024-09-16T11:40:07.302105+0000 mgr.a (mgr.14373) 15696 : cluster [DBG] pgmap v10886: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:40:08.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:40:08 smithi157 bash[24585]: audit 2024-09-16T11:40:07.385750+0000 mgr.a (mgr.14373) 15697 : audit [DBG] from='client.338820 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:40:08.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:40:08 smithi086 bash[24289]: cluster 2024-09-16T11:40:07.302105+0000 mgr.a (mgr.14373) 15696 : cluster [DBG] pgmap v10886: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:40:08.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:40:08 smithi086 bash[24289]: audit 2024-09-16T11:40:07.385750+0000 mgr.a (mgr.14373) 15697 : audit [DBG] from='client.338820 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:40:08.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:40:08 smithi047 bash[22744]: cluster 2024-09-16T11:40:07.302105+0000 mgr.a (mgr.14373) 15696 : cluster [DBG] pgmap v10886: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:40:08.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:40:08 smithi047 bash[22744]: audit 2024-09-16T11:40:07.385750+0000 mgr.a (mgr.14373) 15697 : audit [DBG] from='client.338820 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:40:10.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:40:10 smithi157 bash[24585]: cluster 2024-09-16T11:40:09.303098+0000 mgr.a (mgr.14373) 15698 : cluster [DBG] pgmap v10887: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:40:10.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:40:10 smithi086 bash[24289]: cluster 2024-09-16T11:40:09.303098+0000 mgr.a (mgr.14373) 15698 : cluster [DBG] pgmap v10887: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:40:10.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:40:10 smithi047 bash[22744]: cluster 2024-09-16T11:40:09.303098+0000 mgr.a (mgr.14373) 15698 : cluster [DBG] pgmap v10887: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:40:12.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:40:12 smithi157 bash[24585]: cluster 2024-09-16T11:40:11.303895+0000 mgr.a (mgr.14373) 15699 : cluster [DBG] pgmap v10888: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T11:40:12.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:40:12 smithi086 bash[24289]: cluster 2024-09-16T11:40:11.303895+0000 mgr.a (mgr.14373) 15699 : cluster [DBG] pgmap v10888: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T11:40:12.839 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:40:12.839 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:40:12.840 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:40:12.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:40:12 smithi047 bash[22744]: cluster 2024-09-16T11:40:11.303895+0000 mgr.a (mgr.14373) 15699 : cluster [DBG] pgmap v10888: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T11:40:13.594 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:40:13.594 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:40:13.594 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:40:13.595 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:40:13.595 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:40:14.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:40:14 smithi157 bash[24585]: audit 2024-09-16T11:40:13.173196+0000 mgr.a (mgr.14373) 15700 : audit [DBG] from='client.338892 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:40:14.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:40:14 smithi157 bash[24585]: cluster 2024-09-16T11:40:13.313443+0000 mgr.a (mgr.14373) 15701 : cluster [DBG] pgmap v10889: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:40:14.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:40:14 smithi086 bash[24289]: audit 2024-09-16T11:40:13.173196+0000 mgr.a (mgr.14373) 15700 : audit [DBG] from='client.338892 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:40:14.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:40:14 smithi086 bash[24289]: cluster 2024-09-16T11:40:13.313443+0000 mgr.a (mgr.14373) 15701 : cluster [DBG] pgmap v10889: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:40:14.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:40:14 smithi047 bash[22744]: audit 2024-09-16T11:40:13.173196+0000 mgr.a (mgr.14373) 15700 : audit [DBG] from='client.338892 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:40:14.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:40:14 smithi047 bash[22744]: cluster 2024-09-16T11:40:13.313443+0000 mgr.a (mgr.14373) 15701 : cluster [DBG] pgmap v10889: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:40:16.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:40:16 smithi157 bash[24585]: cluster 2024-09-16T11:40:15.314482+0000 mgr.a (mgr.14373) 15702 : cluster [DBG] pgmap v10890: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:40:16.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:40:16 smithi086 bash[24289]: cluster 2024-09-16T11:40:15.314482+0000 mgr.a (mgr.14373) 15702 : cluster [DBG] pgmap v10890: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:40:16.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:40:16 smithi047 bash[22744]: cluster 2024-09-16T11:40:15.314482+0000 mgr.a (mgr.14373) 15702 : cluster [DBG] pgmap v10890: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:40:18.596 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:40:18.596 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:40:18.596 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:40:18.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:40:18 smithi157 bash[24585]: cluster 2024-09-16T11:40:17.316873+0000 mgr.a (mgr.14373) 15703 : cluster [DBG] pgmap v10891: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:40:18.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:40:18 smithi086 bash[24289]: cluster 2024-09-16T11:40:17.316873+0000 mgr.a (mgr.14373) 15703 : cluster [DBG] pgmap v10891: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:40:18.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:40:18 smithi047 bash[22744]: cluster 2024-09-16T11:40:17.316873+0000 mgr.a (mgr.14373) 15703 : cluster [DBG] pgmap v10891: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:40:19.381 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:40:19.381 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:40:19.381 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:40:19.381 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:40:19.382 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:40:19.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:40:19 smithi157 bash[24585]: audit 2024-09-16T11:40:18.932470+0000 mgr.a (mgr.14373) 15704 : audit [DBG] from='client.338970 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:40:19.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:40:19 smithi157 bash[24585]: cluster 2024-09-16T11:40:19.317460+0000 mgr.a (mgr.14373) 15705 : cluster [DBG] pgmap v10892: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:40:19.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:40:19 smithi086 bash[24289]: audit 2024-09-16T11:40:18.932470+0000 mgr.a (mgr.14373) 15704 : audit [DBG] from='client.338970 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:40:19.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:40:19 smithi086 bash[24289]: cluster 2024-09-16T11:40:19.317460+0000 mgr.a (mgr.14373) 15705 : cluster [DBG] pgmap v10892: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:40:19.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:40:19 smithi047 bash[22744]: audit 2024-09-16T11:40:18.932470+0000 mgr.a (mgr.14373) 15704 : audit [DBG] from='client.338970 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:40:19.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:40:19 smithi047 bash[22744]: cluster 2024-09-16T11:40:19.317460+0000 mgr.a (mgr.14373) 15705 : cluster [DBG] pgmap v10892: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:40:22.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:40:22 smithi157 bash[24585]: cluster 2024-09-16T11:40:21.318209+0000 mgr.a (mgr.14373) 15706 : cluster [DBG] pgmap v10893: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:40:22.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:40:22 smithi086 bash[24289]: cluster 2024-09-16T11:40:21.318209+0000 mgr.a (mgr.14373) 15706 : cluster [DBG] pgmap v10893: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:40:22.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:40:22 smithi047 bash[22744]: cluster 2024-09-16T11:40:21.318209+0000 mgr.a (mgr.14373) 15706 : cluster [DBG] pgmap v10893: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:40:24.383 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:40:24.383 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:40:24.383 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:40:24.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:40:24 smithi157 bash[24585]: cluster 2024-09-16T11:40:23.320504+0000 mgr.a (mgr.14373) 15707 : cluster [DBG] pgmap v10894: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:40:24.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:40:24 smithi086 bash[24289]: cluster 2024-09-16T11:40:23.320504+0000 mgr.a (mgr.14373) 15707 : cluster [DBG] pgmap v10894: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:40:24.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:40:24 smithi047 bash[22744]: cluster 2024-09-16T11:40:23.320504+0000 mgr.a (mgr.14373) 15707 : cluster [DBG] pgmap v10894: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:40:25.123 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:40:25.123 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:40:25.123 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:40:25.123 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:40:25.123 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:40:26.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:40:26 smithi157 bash[24585]: audit 2024-09-16T11:40:24.708664+0000 mgr.a (mgr.14373) 15708 : audit [DBG] from='client.339048 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:40:26.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:40:26 smithi157 bash[24585]: cluster 2024-09-16T11:40:25.321461+0000 mgr.a (mgr.14373) 15709 : cluster [DBG] pgmap v10895: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:40:26.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:40:26 smithi086 bash[24289]: audit 2024-09-16T11:40:24.708664+0000 mgr.a (mgr.14373) 15708 : audit [DBG] from='client.339048 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:40:26.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:40:26 smithi086 bash[24289]: cluster 2024-09-16T11:40:25.321461+0000 mgr.a (mgr.14373) 15709 : cluster [DBG] pgmap v10895: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:40:26.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:40:26 smithi047 bash[22744]: audit 2024-09-16T11:40:24.708664+0000 mgr.a (mgr.14373) 15708 : audit [DBG] from='client.339048 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:40:26.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:40:26 smithi047 bash[22744]: cluster 2024-09-16T11:40:25.321461+0000 mgr.a (mgr.14373) 15709 : cluster [DBG] pgmap v10895: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:40:27.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:40:27 smithi157 bash[24585]: cluster 2024-09-16T11:40:27.323743+0000 mgr.a (mgr.14373) 15710 : cluster [DBG] pgmap v10896: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:40:27.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:40:27 smithi086 bash[24289]: cluster 2024-09-16T11:40:27.323743+0000 mgr.a (mgr.14373) 15710 : cluster [DBG] pgmap v10896: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:40:27.844 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:40:27 smithi047 bash[22744]: cluster 2024-09-16T11:40:27.323743+0000 mgr.a (mgr.14373) 15710 : cluster [DBG] pgmap v10896: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:40:30.125 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:40:30.125 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:40:30.126 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:40:30.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:40:30 smithi157 bash[24585]: cluster 2024-09-16T11:40:29.324501+0000 mgr.a (mgr.14373) 15711 : cluster [DBG] pgmap v10897: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:40:30.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:40:30 smithi086 bash[24289]: cluster 2024-09-16T11:40:29.324501+0000 mgr.a (mgr.14373) 15711 : cluster [DBG] pgmap v10897: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:40:30.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:40:30 smithi047 bash[22744]: cluster 2024-09-16T11:40:29.324501+0000 mgr.a (mgr.14373) 15711 : cluster [DBG] pgmap v10897: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:40:30.885 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:40:30.886 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:40:30.886 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:40:30.886 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:40:30.886 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:40:32.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:40:32 smithi157 bash[24585]: audit 2024-09-16T11:40:30.455639+0000 mgr.a (mgr.14373) 15712 : audit [DBG] from='client.339123 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:40:32.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:40:32 smithi157 bash[24585]: cluster 2024-09-16T11:40:31.325674+0000 mgr.a (mgr.14373) 15713 : cluster [DBG] pgmap v10898: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:40:32.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:40:32 smithi086 bash[24289]: audit 2024-09-16T11:40:30.455639+0000 mgr.a (mgr.14373) 15712 : audit [DBG] from='client.339123 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:40:32.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:40:32 smithi086 bash[24289]: cluster 2024-09-16T11:40:31.325674+0000 mgr.a (mgr.14373) 15713 : cluster [DBG] pgmap v10898: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:40:32.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:40:32 smithi047 bash[22744]: audit 2024-09-16T11:40:30.455639+0000 mgr.a (mgr.14373) 15712 : audit [DBG] from='client.339123 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:40:32.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:40:32 smithi047 bash[22744]: cluster 2024-09-16T11:40:31.325674+0000 mgr.a (mgr.14373) 15713 : cluster [DBG] pgmap v10898: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:40:34.808 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:40:34 smithi157 bash[24585]: cluster 2024-09-16T11:40:33.328162+0000 mgr.a (mgr.14373) 15714 : cluster [DBG] pgmap v10899: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:40:34.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:40:34 smithi086 bash[24289]: cluster 2024-09-16T11:40:33.328162+0000 mgr.a (mgr.14373) 15714 : cluster [DBG] pgmap v10899: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:40:34.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:40:34 smithi047 bash[22744]: cluster 2024-09-16T11:40:33.328162+0000 mgr.a (mgr.14373) 15714 : cluster [DBG] pgmap v10899: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:40:35.887 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:40:35.888 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:40:35.888 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:40:36.628 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:40:36.628 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:40:36.628 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:40:36.628 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:40:36.628 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:40:36.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:40:36 smithi157 bash[24585]: cluster 2024-09-16T11:40:35.329103+0000 mgr.a (mgr.14373) 15715 : cluster [DBG] pgmap v10900: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:40:36.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:40:36 smithi086 bash[24289]: cluster 2024-09-16T11:40:35.329103+0000 mgr.a (mgr.14373) 15715 : cluster [DBG] pgmap v10900: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:40:36.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:40:36 smithi047 bash[22744]: cluster 2024-09-16T11:40:35.329103+0000 mgr.a (mgr.14373) 15715 : cluster [DBG] pgmap v10900: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:40:37.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:40:37 smithi157 bash[24585]: audit 2024-09-16T11:40:36.216057+0000 mgr.a (mgr.14373) 15716 : audit [DBG] from='client.339201 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:40:37.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:40:37 smithi086 bash[24289]: audit 2024-09-16T11:40:36.216057+0000 mgr.a (mgr.14373) 15716 : audit [DBG] from='client.339201 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:40:37.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:40:37 smithi047 bash[22744]: audit 2024-09-16T11:40:36.216057+0000 mgr.a (mgr.14373) 15716 : audit [DBG] from='client.339201 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:40:38.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:40:38 smithi157 bash[24585]: cluster 2024-09-16T11:40:37.332035+0000 mgr.a (mgr.14373) 15717 : cluster [DBG] pgmap v10901: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-16T11:40:38.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:40:38 smithi157 bash[24585]: audit 2024-09-16T11:40:38.340364+0000 mon.b (mon.2) 1430 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T11:40:38.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:40:38 smithi086 bash[24289]: cluster 2024-09-16T11:40:37.332035+0000 mgr.a (mgr.14373) 15717 : cluster [DBG] pgmap v10901: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-16T11:40:38.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:40:38 smithi086 bash[24289]: audit 2024-09-16T11:40:38.340364+0000 mon.b (mon.2) 1430 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T11:40:38.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:40:38 smithi047 bash[22744]: cluster 2024-09-16T11:40:37.332035+0000 mgr.a (mgr.14373) 15717 : cluster [DBG] pgmap v10901: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-16T11:40:38.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:40:38 smithi047 bash[22744]: audit 2024-09-16T11:40:38.340364+0000 mon.b (mon.2) 1430 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T11:40:40.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:40:39 smithi157 bash[24585]: audit 2024-09-16T11:40:38.973219+0000 mon.a (mon.0) 1500 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:40:40.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:40:39 smithi157 bash[24585]: audit 2024-09-16T11:40:38.979110+0000 mon.a (mon.0) 1501 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:40:40.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:40:39 smithi157 bash[24585]: cluster 2024-09-16T11:40:39.332796+0000 mgr.a (mgr.14373) 15718 : cluster [DBG] pgmap v10902: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-16T11:40:40.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:40:39 smithi157 bash[24585]: audit 2024-09-16T11:40:39.787628+0000 mon.b (mon.2) 1431 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T11:40:40.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:40:39 smithi157 bash[24585]: audit 2024-09-16T11:40:39.789579+0000 mon.b (mon.2) 1432 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T11:40:40.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:40:39 smithi157 bash[24585]: audit 2024-09-16T11:40:39.800451+0000 mon.a (mon.0) 1502 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:40:40.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:40:39 smithi157 bash[24585]: audit 2024-09-16T11:40:39.806090+0000 mon.b (mon.2) 1433 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:40:40.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:40:39 smithi086 bash[24289]: audit 2024-09-16T11:40:38.973219+0000 mon.a (mon.0) 1500 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:40:40.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:40:39 smithi086 bash[24289]: audit 2024-09-16T11:40:38.979110+0000 mon.a (mon.0) 1501 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:40:40.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:40:39 smithi086 bash[24289]: cluster 2024-09-16T11:40:39.332796+0000 mgr.a (mgr.14373) 15718 : cluster [DBG] pgmap v10902: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-16T11:40:40.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:40:39 smithi086 bash[24289]: audit 2024-09-16T11:40:39.787628+0000 mon.b (mon.2) 1431 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T11:40:40.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:40:39 smithi086 bash[24289]: audit 2024-09-16T11:40:39.789579+0000 mon.b (mon.2) 1432 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T11:40:40.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:40:39 smithi086 bash[24289]: audit 2024-09-16T11:40:39.800451+0000 mon.a (mon.0) 1502 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:40:40.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:40:39 smithi086 bash[24289]: audit 2024-09-16T11:40:39.806090+0000 mon.b (mon.2) 1433 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:40:40.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:40:39 smithi047 bash[22744]: audit 2024-09-16T11:40:38.973219+0000 mon.a (mon.0) 1500 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:40:40.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:40:39 smithi047 bash[22744]: audit 2024-09-16T11:40:38.979110+0000 mon.a (mon.0) 1501 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:40:40.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:40:39 smithi047 bash[22744]: cluster 2024-09-16T11:40:39.332796+0000 mgr.a (mgr.14373) 15718 : cluster [DBG] pgmap v10902: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-16T11:40:40.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:40:39 smithi047 bash[22744]: audit 2024-09-16T11:40:39.787628+0000 mon.b (mon.2) 1431 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T11:40:40.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:40:39 smithi047 bash[22744]: audit 2024-09-16T11:40:39.789579+0000 mon.b (mon.2) 1432 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T11:40:40.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:40:39 smithi047 bash[22744]: audit 2024-09-16T11:40:39.800451+0000 mon.a (mon.0) 1502 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:40:40.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:40:39 smithi047 bash[22744]: audit 2024-09-16T11:40:39.806090+0000 mon.b (mon.2) 1433 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:40:40.843 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 11:40:40 smithi047 bash[22994]: debug 2024-09-16T11:40:40.538+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T11:40:40.843 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 11:40:40 smithi047 bash[22994]: debug 2024-09-16T11:40:40.542+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T11:40:41.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:40:40 smithi157 bash[24585]: audit 2024-09-16T11:40:39.808853+0000 mgr.a (mgr.14373) 15719 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:40:41.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:40:40 smithi086 bash[24289]: audit 2024-09-16T11:40:39.808853+0000 mgr.a (mgr.14373) 15719 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:40:41.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:40:40 smithi047 bash[22744]: audit 2024-09-16T11:40:39.808853+0000 mgr.a (mgr.14373) 15719 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:40:41.629 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:40:41.630 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:40:41.630 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:40:42.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:40:41 smithi157 bash[24585]: audit 2024-09-16T11:40:40.546210+0000 mgr.a (mgr.14373) 15720 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T11:40:42.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:40:41 smithi157 bash[24585]: cephadm 2024-09-16T11:40:40.548154+0000 mgr.a (mgr.14373) 15721 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T11:40:42.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:40:41 smithi157 bash[24585]: cluster 2024-09-16T11:40:41.333744+0000 mgr.a (mgr.14373) 15722 : cluster [DBG] pgmap v10903: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-16T11:40:42.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:40:41 smithi086 bash[24289]: audit 2024-09-16T11:40:40.546210+0000 mgr.a (mgr.14373) 15720 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T11:40:42.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:40:41 smithi086 bash[24289]: cephadm 2024-09-16T11:40:40.548154+0000 mgr.a (mgr.14373) 15721 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T11:40:42.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:40:41 smithi086 bash[24289]: cluster 2024-09-16T11:40:41.333744+0000 mgr.a (mgr.14373) 15722 : cluster [DBG] pgmap v10903: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-16T11:40:42.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:40:41 smithi047 bash[22744]: audit 2024-09-16T11:40:40.546210+0000 mgr.a (mgr.14373) 15720 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T11:40:42.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:40:41 smithi047 bash[22744]: cephadm 2024-09-16T11:40:40.548154+0000 mgr.a (mgr.14373) 15721 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T11:40:42.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:40:41 smithi047 bash[22744]: cluster 2024-09-16T11:40:41.333744+0000 mgr.a (mgr.14373) 15722 : cluster [DBG] pgmap v10903: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-16T11:40:42.390 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:40:42.390 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:40:42.390 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:40:42.390 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:40:42.390 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:40:43.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:40:42 smithi157 bash[24585]: audit 2024-09-16T11:40:41.961178+0000 mgr.a (mgr.14373) 15723 : audit [DBG] from='client.339387 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:40:43.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:40:42 smithi086 bash[24289]: audit 2024-09-16T11:40:41.961178+0000 mgr.a (mgr.14373) 15723 : audit [DBG] from='client.339387 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:40:43.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:40:42 smithi047 bash[22744]: audit 2024-09-16T11:40:41.961178+0000 mgr.a (mgr.14373) 15723 : audit [DBG] from='client.339387 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:40:44.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:40:44 smithi157 bash[24585]: cluster 2024-09-16T11:40:43.336540+0000 mgr.a (mgr.14373) 15724 : cluster [DBG] pgmap v10904: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:40:44.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:40:44 smithi086 bash[24289]: cluster 2024-09-16T11:40:43.336540+0000 mgr.a (mgr.14373) 15724 : cluster [DBG] pgmap v10904: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:40:44.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:40:43 smithi047 bash[22744]: cluster 2024-09-16T11:40:43.336540+0000 mgr.a (mgr.14373) 15724 : cluster [DBG] pgmap v10904: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:40:46.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:40:46 smithi157 bash[24585]: cluster 2024-09-16T11:40:45.337333+0000 mgr.a (mgr.14373) 15725 : cluster [DBG] pgmap v10905: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T11:40:46.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:40:46 smithi086 bash[24289]: cluster 2024-09-16T11:40:45.337333+0000 mgr.a (mgr.14373) 15725 : cluster [DBG] pgmap v10905: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T11:40:46.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:40:46 smithi047 bash[22744]: cluster 2024-09-16T11:40:45.337333+0000 mgr.a (mgr.14373) 15725 : cluster [DBG] pgmap v10905: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T11:40:47.391 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:40:47.392 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:40:47.392 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:40:48.180 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:40:48.180 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:40:48.180 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:40:48.180 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:40:48.181 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:40:48.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:40:48 smithi157 bash[24585]: cluster 2024-09-16T11:40:47.339325+0000 mgr.a (mgr.14373) 15726 : cluster [DBG] pgmap v10906: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:40:48.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:40:48 smithi086 bash[24289]: cluster 2024-09-16T11:40:47.339325+0000 mgr.a (mgr.14373) 15726 : cluster [DBG] pgmap v10906: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:40:48.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:40:48 smithi047 bash[22744]: cluster 2024-09-16T11:40:47.339325+0000 mgr.a (mgr.14373) 15726 : cluster [DBG] pgmap v10906: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:40:49.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:40:49 smithi157 bash[24585]: audit 2024-09-16T11:40:47.729208+0000 mgr.a (mgr.14373) 15727 : audit [DBG] from='client.339465 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:40:49.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:40:49 smithi086 bash[24289]: audit 2024-09-16T11:40:47.729208+0000 mgr.a (mgr.14373) 15727 : audit [DBG] from='client.339465 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:40:49.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:40:49 smithi047 bash[22744]: audit 2024-09-16T11:40:47.729208+0000 mgr.a (mgr.14373) 15727 : audit [DBG] from='client.339465 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:40:50.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:40:50 smithi157 bash[24585]: cluster 2024-09-16T11:40:49.340274+0000 mgr.a (mgr.14373) 15728 : cluster [DBG] pgmap v10907: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 6.8 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T11:40:50.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:40:50 smithi086 bash[24289]: cluster 2024-09-16T11:40:49.340274+0000 mgr.a (mgr.14373) 15728 : cluster [DBG] pgmap v10907: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 6.8 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T11:40:50.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:40:50 smithi047 bash[22744]: cluster 2024-09-16T11:40:49.340274+0000 mgr.a (mgr.14373) 15728 : cluster [DBG] pgmap v10907: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 6.8 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T11:40:52.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:40:52 smithi157 bash[24585]: cluster 2024-09-16T11:40:51.341105+0000 mgr.a (mgr.14373) 15729 : cluster [DBG] pgmap v10908: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 6.8 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T11:40:52.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:40:52 smithi086 bash[24289]: cluster 2024-09-16T11:40:51.341105+0000 mgr.a (mgr.14373) 15729 : cluster [DBG] pgmap v10908: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 6.8 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T11:40:52.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:40:52 smithi047 bash[22744]: cluster 2024-09-16T11:40:51.341105+0000 mgr.a (mgr.14373) 15729 : cluster [DBG] pgmap v10908: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 6.8 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T11:40:53.181 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:40:53.182 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:40:53.182 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:40:53.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:40:53 smithi157 bash[24585]: cluster 2024-09-16T11:40:53.343284+0000 mgr.a (mgr.14373) 15730 : cluster [DBG] pgmap v10909: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:40:53.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:40:53 smithi086 bash[24289]: cluster 2024-09-16T11:40:53.343284+0000 mgr.a (mgr.14373) 15730 : cluster [DBG] pgmap v10909: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:40:53.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:40:53 smithi047 bash[22744]: cluster 2024-09-16T11:40:53.343284+0000 mgr.a (mgr.14373) 15730 : cluster [DBG] pgmap v10909: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:40:53.943 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:40:53.944 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:40:53.944 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:40:53.944 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:40:53.944 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:40:54.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:40:54 smithi157 bash[24585]: audit 2024-09-16T11:40:53.514771+0000 mgr.a (mgr.14373) 15731 : audit [DBG] from='client.339543 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:40:54.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:40:54 smithi086 bash[24289]: audit 2024-09-16T11:40:53.514771+0000 mgr.a (mgr.14373) 15731 : audit [DBG] from='client.339543 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:40:54.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:40:54 smithi047 bash[22744]: audit 2024-09-16T11:40:53.514771+0000 mgr.a (mgr.14373) 15731 : audit [DBG] from='client.339543 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:40:55.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:40:55 smithi157 bash[24585]: cluster 2024-09-16T11:40:55.344215+0000 mgr.a (mgr.14373) 15732 : cluster [DBG] pgmap v10910: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:40:55.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:40:55 smithi086 bash[24289]: cluster 2024-09-16T11:40:55.344215+0000 mgr.a (mgr.14373) 15732 : cluster [DBG] pgmap v10910: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:40:55.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:40:55 smithi047 bash[22744]: cluster 2024-09-16T11:40:55.344215+0000 mgr.a (mgr.14373) 15732 : cluster [DBG] pgmap v10910: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:40:58.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:40:58 smithi157 bash[24585]: cluster 2024-09-16T11:40:57.346416+0000 mgr.a (mgr.14373) 15733 : cluster [DBG] pgmap v10911: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:40:58.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:40:58 smithi086 bash[24289]: cluster 2024-09-16T11:40:57.346416+0000 mgr.a (mgr.14373) 15733 : cluster [DBG] pgmap v10911: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:40:58.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:40:58 smithi047 bash[22744]: cluster 2024-09-16T11:40:57.346416+0000 mgr.a (mgr.14373) 15733 : cluster [DBG] pgmap v10911: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:40:58.945 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:40:58.946 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:40:58.946 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:40:59.692 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:40:59.692 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:40:59.693 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:40:59.693 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:40:59.693 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:41:00.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:41:00 smithi157 bash[24585]: audit 2024-09-16T11:40:59.272355+0000 mgr.a (mgr.14373) 15734 : audit [DBG] from='client.339621 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:41:00.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:41:00 smithi157 bash[24585]: cluster 2024-09-16T11:40:59.346958+0000 mgr.a (mgr.14373) 15735 : cluster [DBG] pgmap v10912: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:41:00.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:41:00 smithi086 bash[24289]: audit 2024-09-16T11:40:59.272355+0000 mgr.a (mgr.14373) 15734 : audit [DBG] from='client.339621 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:41:00.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:41:00 smithi086 bash[24289]: cluster 2024-09-16T11:40:59.346958+0000 mgr.a (mgr.14373) 15735 : cluster [DBG] pgmap v10912: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:41:00.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:41:00 smithi047 bash[22744]: audit 2024-09-16T11:40:59.272355+0000 mgr.a (mgr.14373) 15734 : audit [DBG] from='client.339621 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:41:00.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:41:00 smithi047 bash[22744]: cluster 2024-09-16T11:40:59.346958+0000 mgr.a (mgr.14373) 15735 : cluster [DBG] pgmap v10912: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:41:02.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:41:02 smithi157 bash[24585]: cluster 2024-09-16T11:41:01.347826+0000 mgr.a (mgr.14373) 15736 : cluster [DBG] pgmap v10913: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:41:02.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:41:02 smithi086 bash[24289]: cluster 2024-09-16T11:41:01.347826+0000 mgr.a (mgr.14373) 15736 : cluster [DBG] pgmap v10913: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:41:02.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:41:02 smithi047 bash[22744]: cluster 2024-09-16T11:41:01.347826+0000 mgr.a (mgr.14373) 15736 : cluster [DBG] pgmap v10913: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:41:04.694 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:41:04.695 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:41:04.695 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:41:04.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:41:04 smithi157 bash[24585]: cluster 2024-09-16T11:41:03.350198+0000 mgr.a (mgr.14373) 15737 : cluster [DBG] pgmap v10914: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:41:04.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:41:04 smithi086 bash[24289]: cluster 2024-09-16T11:41:03.350198+0000 mgr.a (mgr.14373) 15737 : cluster [DBG] pgmap v10914: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:41:04.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:41:04 smithi047 bash[22744]: cluster 2024-09-16T11:41:03.350198+0000 mgr.a (mgr.14373) 15737 : cluster [DBG] pgmap v10914: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:41:05.487 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:41:05.487 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:41:05.487 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:41:05.487 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:41:05.487 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:41:05.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:41:05 smithi157 bash[24585]: audit 2024-09-16T11:41:05.030946+0000 mgr.a (mgr.14373) 15738 : audit [DBG] from='client.339699 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:41:05.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:41:05 smithi157 bash[24585]: cluster 2024-09-16T11:41:05.350759+0000 mgr.a (mgr.14373) 15739 : cluster [DBG] pgmap v10915: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:41:05.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:41:05 smithi086 bash[24289]: audit 2024-09-16T11:41:05.030946+0000 mgr.a (mgr.14373) 15738 : audit [DBG] from='client.339699 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:41:05.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:41:05 smithi086 bash[24289]: cluster 2024-09-16T11:41:05.350759+0000 mgr.a (mgr.14373) 15739 : cluster [DBG] pgmap v10915: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:41:05.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:41:05 smithi047 bash[22744]: audit 2024-09-16T11:41:05.030946+0000 mgr.a (mgr.14373) 15738 : audit [DBG] from='client.339699 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:41:05.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:41:05 smithi047 bash[22744]: cluster 2024-09-16T11:41:05.350759+0000 mgr.a (mgr.14373) 15739 : cluster [DBG] pgmap v10915: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:41:08.808 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:41:08 smithi157 bash[24585]: cluster 2024-09-16T11:41:07.353226+0000 mgr.a (mgr.14373) 15740 : cluster [DBG] pgmap v10916: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:41:08.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:41:08 smithi086 bash[24289]: cluster 2024-09-16T11:41:07.353226+0000 mgr.a (mgr.14373) 15740 : cluster [DBG] pgmap v10916: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:41:08.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:41:08 smithi047 bash[22744]: cluster 2024-09-16T11:41:07.353226+0000 mgr.a (mgr.14373) 15740 : cluster [DBG] pgmap v10916: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:41:10.488 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:41:10.489 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:41:10.489 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:41:10.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:41:10 smithi157 bash[24585]: cluster 2024-09-16T11:41:09.354189+0000 mgr.a (mgr.14373) 15741 : cluster [DBG] pgmap v10917: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:41:10.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:41:10 smithi086 bash[24289]: cluster 2024-09-16T11:41:09.354189+0000 mgr.a (mgr.14373) 15741 : cluster [DBG] pgmap v10917: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:41:10.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:41:10 smithi047 bash[22744]: cluster 2024-09-16T11:41:09.354189+0000 mgr.a (mgr.14373) 15741 : cluster [DBG] pgmap v10917: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:41:11.239 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:41:11.239 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:41:11.239 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:41:11.239 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:41:11.239 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:41:12.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:41:12 smithi157 bash[24585]: audit 2024-09-16T11:41:10.819043+0000 mgr.a (mgr.14373) 15742 : audit [DBG] from='client.339771 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:41:12.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:41:12 smithi157 bash[24585]: cluster 2024-09-16T11:41:11.355185+0000 mgr.a (mgr.14373) 15743 : cluster [DBG] pgmap v10918: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:41:12.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:41:12 smithi086 bash[24289]: audit 2024-09-16T11:41:10.819043+0000 mgr.a (mgr.14373) 15742 : audit [DBG] from='client.339771 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:41:12.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:41:12 smithi086 bash[24289]: cluster 2024-09-16T11:41:11.355185+0000 mgr.a (mgr.14373) 15743 : cluster [DBG] pgmap v10918: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:41:12.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:41:12 smithi047 bash[22744]: audit 2024-09-16T11:41:10.819043+0000 mgr.a (mgr.14373) 15742 : audit [DBG] from='client.339771 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:41:12.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:41:12 smithi047 bash[22744]: cluster 2024-09-16T11:41:11.355185+0000 mgr.a (mgr.14373) 15743 : cluster [DBG] pgmap v10918: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:41:13.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:41:13 smithi157 bash[24585]: cluster 2024-09-16T11:41:13.357487+0000 mgr.a (mgr.14373) 15744 : cluster [DBG] pgmap v10919: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:41:13.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:41:13 smithi086 bash[24289]: cluster 2024-09-16T11:41:13.357487+0000 mgr.a (mgr.14373) 15744 : cluster [DBG] pgmap v10919: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:41:13.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:41:13 smithi047 bash[22744]: cluster 2024-09-16T11:41:13.357487+0000 mgr.a (mgr.14373) 15744 : cluster [DBG] pgmap v10919: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:41:16.241 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:41:16.241 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:41:16.241 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:41:16.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:41:16 smithi157 bash[24585]: cluster 2024-09-16T11:41:15.358263+0000 mgr.a (mgr.14373) 15745 : cluster [DBG] pgmap v10920: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:41:16.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:41:16 smithi086 bash[24289]: cluster 2024-09-16T11:41:15.358263+0000 mgr.a (mgr.14373) 15745 : cluster [DBG] pgmap v10920: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:41:16.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:41:16 smithi047 bash[22744]: cluster 2024-09-16T11:41:15.358263+0000 mgr.a (mgr.14373) 15745 : cluster [DBG] pgmap v10920: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:41:16.988 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:41:16.989 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:41:16.989 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:41:16.989 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:41:16.989 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:41:18.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:41:18 smithi157 bash[24585]: audit 2024-09-16T11:41:16.572031+0000 mgr.a (mgr.14373) 15746 : audit [DBG] from='client.339849 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:41:18.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:41:18 smithi157 bash[24585]: cluster 2024-09-16T11:41:17.361029+0000 mgr.a (mgr.14373) 15747 : cluster [DBG] pgmap v10921: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:41:18.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:41:18 smithi086 bash[24289]: audit 2024-09-16T11:41:16.572031+0000 mgr.a (mgr.14373) 15746 : audit [DBG] from='client.339849 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:41:18.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:41:18 smithi086 bash[24289]: cluster 2024-09-16T11:41:17.361029+0000 mgr.a (mgr.14373) 15747 : cluster [DBG] pgmap v10921: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:41:18.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:41:18 smithi047 bash[22744]: audit 2024-09-16T11:41:16.572031+0000 mgr.a (mgr.14373) 15746 : audit [DBG] from='client.339849 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:41:18.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:41:18 smithi047 bash[22744]: cluster 2024-09-16T11:41:17.361029+0000 mgr.a (mgr.14373) 15747 : cluster [DBG] pgmap v10921: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:41:19.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:41:19 smithi157 bash[24585]: cluster 2024-09-16T11:41:19.361815+0000 mgr.a (mgr.14373) 15748 : cluster [DBG] pgmap v10922: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:41:19.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:41:19 smithi086 bash[24289]: cluster 2024-09-16T11:41:19.361815+0000 mgr.a (mgr.14373) 15748 : cluster [DBG] pgmap v10922: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:41:19.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:41:19 smithi047 bash[22744]: cluster 2024-09-16T11:41:19.361815+0000 mgr.a (mgr.14373) 15748 : cluster [DBG] pgmap v10922: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:41:21.990 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:41:21.991 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:41:21.991 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:41:22.769 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:41:22.769 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:41:22.770 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:41:22.770 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:41:22.770 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:41:22.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:41:22 smithi157 bash[24585]: cluster 2024-09-16T11:41:21.362586+0000 mgr.a (mgr.14373) 15749 : cluster [DBG] pgmap v10923: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T11:41:22.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:41:22 smithi086 bash[24289]: cluster 2024-09-16T11:41:21.362586+0000 mgr.a (mgr.14373) 15749 : cluster [DBG] pgmap v10923: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T11:41:22.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:41:22 smithi047 bash[22744]: cluster 2024-09-16T11:41:21.362586+0000 mgr.a (mgr.14373) 15749 : cluster [DBG] pgmap v10923: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T11:41:23.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:41:23 smithi157 bash[24585]: audit 2024-09-16T11:41:22.322873+0000 mgr.a (mgr.14373) 15750 : audit [DBG] from='client.339927 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:41:23.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:41:23 smithi086 bash[24289]: audit 2024-09-16T11:41:22.322873+0000 mgr.a (mgr.14373) 15750 : audit [DBG] from='client.339927 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:41:23.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:41:23 smithi047 bash[22744]: audit 2024-09-16T11:41:22.322873+0000 mgr.a (mgr.14373) 15750 : audit [DBG] from='client.339927 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:41:24.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:41:24 smithi157 bash[24585]: cluster 2024-09-16T11:41:23.365543+0000 mgr.a (mgr.14373) 15751 : cluster [DBG] pgmap v10924: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:41:24.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:41:24 smithi086 bash[24289]: cluster 2024-09-16T11:41:23.365543+0000 mgr.a (mgr.14373) 15751 : cluster [DBG] pgmap v10924: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:41:24.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:41:24 smithi047 bash[22744]: cluster 2024-09-16T11:41:23.365543+0000 mgr.a (mgr.14373) 15751 : cluster [DBG] pgmap v10924: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:41:25.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:41:25 smithi157 bash[24585]: cluster 2024-09-16T11:41:25.366580+0000 mgr.a (mgr.14373) 15752 : cluster [DBG] pgmap v10925: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:41:25.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:41:25 smithi086 bash[24289]: cluster 2024-09-16T11:41:25.366580+0000 mgr.a (mgr.14373) 15752 : cluster [DBG] pgmap v10925: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:41:25.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:41:25 smithi047 bash[22744]: cluster 2024-09-16T11:41:25.366580+0000 mgr.a (mgr.14373) 15752 : cluster [DBG] pgmap v10925: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:41:27.771 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:41:27.772 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:41:27.772 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:41:27.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:41:27 smithi157 bash[24585]: cluster 2024-09-16T11:41:27.368733+0000 mgr.a (mgr.14373) 15753 : cluster [DBG] pgmap v10926: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:41:27.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:41:27 smithi086 bash[24289]: cluster 2024-09-16T11:41:27.368733+0000 mgr.a (mgr.14373) 15753 : cluster [DBG] pgmap v10926: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:41:27.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:41:27 smithi047 bash[22744]: cluster 2024-09-16T11:41:27.368733+0000 mgr.a (mgr.14373) 15753 : cluster [DBG] pgmap v10926: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:41:28.555 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:41:28.556 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:41:28.556 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:41:28.556 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:41:28.556 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:41:28.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:41:28 smithi157 bash[24585]: audit 2024-09-16T11:41:28.109472+0000 mgr.a (mgr.14373) 15754 : audit [DBG] from='client.340005 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:41:28.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:41:28 smithi086 bash[24289]: audit 2024-09-16T11:41:28.109472+0000 mgr.a (mgr.14373) 15754 : audit [DBG] from='client.340005 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:41:28.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:41:28 smithi047 bash[22744]: audit 2024-09-16T11:41:28.109472+0000 mgr.a (mgr.14373) 15754 : audit [DBG] from='client.340005 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:41:29.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:41:29 smithi157 bash[24585]: cluster 2024-09-16T11:41:29.369868+0000 mgr.a (mgr.14373) 15755 : cluster [DBG] pgmap v10927: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:41:29.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:41:29 smithi086 bash[24289]: cluster 2024-09-16T11:41:29.369868+0000 mgr.a (mgr.14373) 15755 : cluster [DBG] pgmap v10927: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:41:29.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:41:29 smithi047 bash[22744]: cluster 2024-09-16T11:41:29.369868+0000 mgr.a (mgr.14373) 15755 : cluster [DBG] pgmap v10927: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:41:31.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:41:31 smithi157 bash[24585]: cluster 2024-09-16T11:41:31.370655+0000 mgr.a (mgr.14373) 15756 : cluster [DBG] pgmap v10928: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:41:31.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:41:31 smithi086 bash[24289]: cluster 2024-09-16T11:41:31.370655+0000 mgr.a (mgr.14373) 15756 : cluster [DBG] pgmap v10928: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:41:31.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:41:31 smithi047 bash[22744]: cluster 2024-09-16T11:41:31.370655+0000 mgr.a (mgr.14373) 15756 : cluster [DBG] pgmap v10928: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:41:33.557 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:41:33.558 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:41:33.558 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:41:33.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:41:33 smithi157 bash[24585]: cluster 2024-09-16T11:41:33.372871+0000 mgr.a (mgr.14373) 15757 : cluster [DBG] pgmap v10929: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:41:33.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:41:33 smithi086 bash[24289]: cluster 2024-09-16T11:41:33.372871+0000 mgr.a (mgr.14373) 15757 : cluster [DBG] pgmap v10929: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:41:33.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:41:33 smithi047 bash[22744]: cluster 2024-09-16T11:41:33.372871+0000 mgr.a (mgr.14373) 15757 : cluster [DBG] pgmap v10929: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:41:34.313 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:41:34.313 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:41:34.313 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:41:34.313 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:41:34.313 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:41:34.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:41:34 smithi157 bash[24585]: audit 2024-09-16T11:41:33.888448+0000 mgr.a (mgr.14373) 15758 : audit [DBG] from='client.340083 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:41:34.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:41:34 smithi086 bash[24289]: audit 2024-09-16T11:41:33.888448+0000 mgr.a (mgr.14373) 15758 : audit [DBG] from='client.340083 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:41:34.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:41:34 smithi047 bash[22744]: audit 2024-09-16T11:41:33.888448+0000 mgr.a (mgr.14373) 15758 : audit [DBG] from='client.340083 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:41:35.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:41:35 smithi157 bash[24585]: cluster 2024-09-16T11:41:35.373768+0000 mgr.a (mgr.14373) 15759 : cluster [DBG] pgmap v10930: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:41:35.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:41:35 smithi086 bash[24289]: cluster 2024-09-16T11:41:35.373768+0000 mgr.a (mgr.14373) 15759 : cluster [DBG] pgmap v10930: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:41:35.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:41:35 smithi047 bash[22744]: cluster 2024-09-16T11:41:35.373768+0000 mgr.a (mgr.14373) 15759 : cluster [DBG] pgmap v10930: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:41:37.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:41:37 smithi157 bash[24585]: cluster 2024-09-16T11:41:37.375976+0000 mgr.a (mgr.14373) 15760 : cluster [DBG] pgmap v10931: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:41:37.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:41:37 smithi086 bash[24289]: cluster 2024-09-16T11:41:37.375976+0000 mgr.a (mgr.14373) 15760 : cluster [DBG] pgmap v10931: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:41:37.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:41:37 smithi047 bash[22744]: cluster 2024-09-16T11:41:37.375976+0000 mgr.a (mgr.14373) 15760 : cluster [DBG] pgmap v10931: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:41:39.314 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:41:39.315 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:41:39.315 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:41:39.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:41:39 smithi157 bash[24585]: cluster 2024-09-16T11:41:39.376721+0000 mgr.a (mgr.14373) 15761 : cluster [DBG] pgmap v10932: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:41:39.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:41:39 smithi086 bash[24289]: cluster 2024-09-16T11:41:39.376721+0000 mgr.a (mgr.14373) 15761 : cluster [DBG] pgmap v10932: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:41:39.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:41:39 smithi047 bash[22744]: cluster 2024-09-16T11:41:39.376721+0000 mgr.a (mgr.14373) 15761 : cluster [DBG] pgmap v10932: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:41:40.106 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:41:40.106 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:41:40.106 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:41:40.106 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:41:40.106 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:41:40.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:41:40 smithi157 bash[24585]: audit 2024-09-16T11:41:39.655896+0000 mgr.a (mgr.14373) 15762 : audit [DBG] from='client.340161 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:41:40.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:41:40 smithi086 bash[24289]: audit 2024-09-16T11:41:39.655896+0000 mgr.a (mgr.14373) 15762 : audit [DBG] from='client.340161 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:41:40.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:41:40 smithi047 bash[22744]: audit 2024-09-16T11:41:39.655896+0000 mgr.a (mgr.14373) 15762 : audit [DBG] from='client.340161 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:41:41.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:41:41 smithi157 bash[24585]: audit 2024-09-16T11:41:40.608994+0000 mon.b (mon.2) 1434 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T11:41:41.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:41:41 smithi157 bash[24585]: audit 2024-09-16T11:41:41.218410+0000 mon.a (mon.0) 1503 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:41:41.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:41:41 smithi157 bash[24585]: audit 2024-09-16T11:41:41.224956+0000 mon.a (mon.0) 1504 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:41:41.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:41:41 smithi157 bash[24585]: audit 2024-09-16T11:41:41.230784+0000 mon.a (mon.0) 1505 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:41:41.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:41:41 smithi157 bash[24585]: audit 2024-09-16T11:41:41.234169+0000 mon.a (mon.0) 1506 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:41:41.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:41:41 smithi157 bash[24585]: cluster 2024-09-16T11:41:41.377640+0000 mgr.a (mgr.14373) 15763 : cluster [DBG] pgmap v10933: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:41:41.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:41:41 smithi086 bash[24289]: audit 2024-09-16T11:41:40.608994+0000 mon.b (mon.2) 1434 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T11:41:41.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:41:41 smithi086 bash[24289]: audit 2024-09-16T11:41:41.218410+0000 mon.a (mon.0) 1503 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:41:41.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:41:41 smithi086 bash[24289]: audit 2024-09-16T11:41:41.224956+0000 mon.a (mon.0) 1504 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:41:41.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:41:41 smithi086 bash[24289]: audit 2024-09-16T11:41:41.230784+0000 mon.a (mon.0) 1505 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:41:41.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:41:41 smithi086 bash[24289]: audit 2024-09-16T11:41:41.234169+0000 mon.a (mon.0) 1506 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:41:41.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:41:41 smithi086 bash[24289]: cluster 2024-09-16T11:41:41.377640+0000 mgr.a (mgr.14373) 15763 : cluster [DBG] pgmap v10933: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:41:41.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:41:41 smithi047 bash[22744]: audit 2024-09-16T11:41:40.608994+0000 mon.b (mon.2) 1434 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T11:41:41.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:41:41 smithi047 bash[22744]: audit 2024-09-16T11:41:41.218410+0000 mon.a (mon.0) 1503 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:41:41.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:41:41 smithi047 bash[22744]: audit 2024-09-16T11:41:41.224956+0000 mon.a (mon.0) 1504 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:41:41.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:41:41 smithi047 bash[22744]: audit 2024-09-16T11:41:41.230784+0000 mon.a (mon.0) 1505 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:41:41.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:41:41 smithi047 bash[22744]: audit 2024-09-16T11:41:41.234169+0000 mon.a (mon.0) 1506 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:41:41.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:41:41 smithi047 bash[22744]: cluster 2024-09-16T11:41:41.377640+0000 mgr.a (mgr.14373) 15763 : cluster [DBG] pgmap v10933: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:41:43.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:41:43 smithi157 bash[24585]: cluster 2024-09-16T11:41:43.379934+0000 mgr.a (mgr.14373) 15764 : cluster [DBG] pgmap v10934: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:41:43.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:41:43 smithi086 bash[24289]: cluster 2024-09-16T11:41:43.379934+0000 mgr.a (mgr.14373) 15764 : cluster [DBG] pgmap v10934: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:41:43.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:41:43 smithi047 bash[22744]: cluster 2024-09-16T11:41:43.379934+0000 mgr.a (mgr.14373) 15764 : cluster [DBG] pgmap v10934: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:41:45.107 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:41:45.108 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:41:45.108 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:41:45.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:41:45 smithi157 bash[24585]: cluster 2024-09-16T11:41:45.380659+0000 mgr.a (mgr.14373) 15765 : cluster [DBG] pgmap v10935: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:41:45.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:41:45 smithi086 bash[24289]: cluster 2024-09-16T11:41:45.380659+0000 mgr.a (mgr.14373) 15765 : cluster [DBG] pgmap v10935: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:41:45.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:41:45 smithi047 bash[22744]: cluster 2024-09-16T11:41:45.380659+0000 mgr.a (mgr.14373) 15765 : cluster [DBG] pgmap v10935: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:41:45.853 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:41:45.853 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:41:45.853 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:41:45.853 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:41:45.854 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:41:46.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:41:46 smithi157 bash[24585]: audit 2024-09-16T11:41:45.438046+0000 mgr.a (mgr.14373) 15766 : audit [DBG] from='client.340239 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:41:46.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:41:46 smithi086 bash[24289]: audit 2024-09-16T11:41:45.438046+0000 mgr.a (mgr.14373) 15766 : audit [DBG] from='client.340239 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:41:46.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:41:46 smithi047 bash[22744]: audit 2024-09-16T11:41:45.438046+0000 mgr.a (mgr.14373) 15766 : audit [DBG] from='client.340239 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:41:47.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:41:47 smithi157 bash[24585]: cluster 2024-09-16T11:41:47.383017+0000 mgr.a (mgr.14373) 15767 : cluster [DBG] pgmap v10936: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:41:47.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:41:47 smithi086 bash[24289]: cluster 2024-09-16T11:41:47.383017+0000 mgr.a (mgr.14373) 15767 : cluster [DBG] pgmap v10936: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:41:47.823 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:41:47 smithi047 bash[22744]: cluster 2024-09-16T11:41:47.383017+0000 mgr.a (mgr.14373) 15767 : cluster [DBG] pgmap v10936: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:41:49.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:41:49 smithi047 bash[22744]: cluster 2024-09-16T11:41:49.383525+0000 mgr.a (mgr.14373) 15768 : cluster [DBG] pgmap v10937: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:41:49.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:41:49 smithi157 bash[24585]: cluster 2024-09-16T11:41:49.383525+0000 mgr.a (mgr.14373) 15768 : cluster [DBG] pgmap v10937: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:41:49.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:41:49 smithi086 bash[24289]: cluster 2024-09-16T11:41:49.383525+0000 mgr.a (mgr.14373) 15768 : cluster [DBG] pgmap v10937: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:41:50.855 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:41:50.855 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:41:50.855 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:41:52.322 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:41:52.322 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:41:52.322 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:41:52.322 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:41:52.322 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:41:52.342 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 11:41:51 smithi047 bash[22994]: debug 2024-09-16T11:41:51.897+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T11:41:52.343 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 11:41:51 smithi047 bash[22994]: debug 2024-09-16T11:41:51.909+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T11:41:52.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:41:52 smithi047 bash[22744]: audit 2024-09-16T11:41:51.105228+0000 mon.a (mon.0) 1507 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:41:52.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:41:52 smithi047 bash[22744]: audit 2024-09-16T11:41:51.114367+0000 mon.a (mon.0) 1508 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:41:52.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:41:52 smithi047 bash[22744]: audit 2024-09-16T11:41:51.118208+0000 mon.b (mon.2) 1435 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T11:41:52.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:41:52 smithi047 bash[22744]: audit 2024-09-16T11:41:51.119991+0000 mon.b (mon.2) 1436 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T11:41:52.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:41:52 smithi047 bash[22744]: audit 2024-09-16T11:41:51.128053+0000 mon.a (mon.0) 1509 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:41:52.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:41:52 smithi047 bash[22744]: audit 2024-09-16T11:41:51.132820+0000 mon.b (mon.2) 1437 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:41:52.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:41:52 smithi047 bash[22744]: audit 2024-09-16T11:41:51.134617+0000 mgr.a (mgr.14373) 15769 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:41:52.344 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:41:52 smithi047 bash[22744]: audit 2024-09-16T11:41:51.218068+0000 mgr.a (mgr.14373) 15770 : audit [DBG] from='client.340311 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:41:52.344 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:41:52 smithi047 bash[22744]: cluster 2024-09-16T11:41:51.383993+0000 mgr.a (mgr.14373) 15771 : cluster [DBG] pgmap v10938: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:41:52.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:41:52 smithi157 bash[24585]: audit 2024-09-16T11:41:51.105228+0000 mon.a (mon.0) 1507 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:41:52.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:41:52 smithi157 bash[24585]: audit 2024-09-16T11:41:51.114367+0000 mon.a (mon.0) 1508 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:41:52.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:41:52 smithi157 bash[24585]: audit 2024-09-16T11:41:51.118208+0000 mon.b (mon.2) 1435 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T11:41:52.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:41:52 smithi157 bash[24585]: audit 2024-09-16T11:41:51.119991+0000 mon.b (mon.2) 1436 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T11:41:52.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:41:52 smithi157 bash[24585]: audit 2024-09-16T11:41:51.128053+0000 mon.a (mon.0) 1509 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:41:52.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:41:52 smithi157 bash[24585]: audit 2024-09-16T11:41:51.132820+0000 mon.b (mon.2) 1437 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:41:52.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:41:52 smithi157 bash[24585]: audit 2024-09-16T11:41:51.134617+0000 mgr.a (mgr.14373) 15769 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:41:52.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:41:52 smithi157 bash[24585]: audit 2024-09-16T11:41:51.218068+0000 mgr.a (mgr.14373) 15770 : audit [DBG] from='client.340311 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:41:52.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:41:52 smithi157 bash[24585]: cluster 2024-09-16T11:41:51.383993+0000 mgr.a (mgr.14373) 15771 : cluster [DBG] pgmap v10938: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:41:52.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:41:52 smithi086 bash[24289]: audit 2024-09-16T11:41:51.105228+0000 mon.a (mon.0) 1507 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:41:52.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:41:52 smithi086 bash[24289]: audit 2024-09-16T11:41:51.114367+0000 mon.a (mon.0) 1508 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:41:52.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:41:52 smithi086 bash[24289]: audit 2024-09-16T11:41:51.118208+0000 mon.b (mon.2) 1435 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T11:41:52.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:41:52 smithi086 bash[24289]: audit 2024-09-16T11:41:51.119991+0000 mon.b (mon.2) 1436 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T11:41:52.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:41:52 smithi086 bash[24289]: audit 2024-09-16T11:41:51.128053+0000 mon.a (mon.0) 1509 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:41:52.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:41:52 smithi086 bash[24289]: audit 2024-09-16T11:41:51.132820+0000 mon.b (mon.2) 1437 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:41:52.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:41:52 smithi086 bash[24289]: audit 2024-09-16T11:41:51.134617+0000 mgr.a (mgr.14373) 15769 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:41:52.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:41:52 smithi086 bash[24289]: audit 2024-09-16T11:41:51.218068+0000 mgr.a (mgr.14373) 15770 : audit [DBG] from='client.340311 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:41:52.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:41:52 smithi086 bash[24289]: cluster 2024-09-16T11:41:51.383993+0000 mgr.a (mgr.14373) 15771 : cluster [DBG] pgmap v10938: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:41:53.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:41:53 smithi157 bash[24585]: audit 2024-09-16T11:41:51.898332+0000 mgr.a (mgr.14373) 15772 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T11:41:53.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:41:53 smithi157 bash[24585]: cephadm 2024-09-16T11:41:51.914081+0000 mgr.a (mgr.14373) 15773 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T11:41:53.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:41:53 smithi086 bash[24289]: audit 2024-09-16T11:41:51.898332+0000 mgr.a (mgr.14373) 15772 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T11:41:53.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:41:53 smithi086 bash[24289]: cephadm 2024-09-16T11:41:51.914081+0000 mgr.a (mgr.14373) 15773 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T11:41:53.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:41:53 smithi047 bash[22744]: audit 2024-09-16T11:41:51.898332+0000 mgr.a (mgr.14373) 15772 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T11:41:53.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:41:53 smithi047 bash[22744]: cephadm 2024-09-16T11:41:51.914081+0000 mgr.a (mgr.14373) 15773 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T11:41:54.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:41:54 smithi157 bash[24585]: cluster 2024-09-16T11:41:53.386708+0000 mgr.a (mgr.14373) 15774 : cluster [DBG] pgmap v10939: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 3.0 KiB/s rd, 170 B/s wr, 2 op/s 2024-09-16T11:41:54.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:41:54 smithi086 bash[24289]: cluster 2024-09-16T11:41:53.386708+0000 mgr.a (mgr.14373) 15774 : cluster [DBG] pgmap v10939: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 3.0 KiB/s rd, 170 B/s wr, 2 op/s 2024-09-16T11:41:54.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:41:54 smithi047 bash[22744]: cluster 2024-09-16T11:41:53.386708+0000 mgr.a (mgr.14373) 15774 : cluster [DBG] pgmap v10939: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 3.0 KiB/s rd, 170 B/s wr, 2 op/s 2024-09-16T11:41:55.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:41:55 smithi157 bash[24585]: cluster 2024-09-16T11:41:55.387484+0000 mgr.a (mgr.14373) 15775 : cluster [DBG] pgmap v10940: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 170 B/s wr, 2 op/s 2024-09-16T11:41:55.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:41:55 smithi086 bash[24289]: cluster 2024-09-16T11:41:55.387484+0000 mgr.a (mgr.14373) 15775 : cluster [DBG] pgmap v10940: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 170 B/s wr, 2 op/s 2024-09-16T11:41:55.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:41:55 smithi047 bash[22744]: cluster 2024-09-16T11:41:55.387484+0000 mgr.a (mgr.14373) 15775 : cluster [DBG] pgmap v10940: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 170 B/s wr, 2 op/s 2024-09-16T11:41:57.323 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:41:57.324 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:41:57.324 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:41:57.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:41:57 smithi157 bash[24585]: cluster 2024-09-16T11:41:57.389635+0000 mgr.a (mgr.14373) 15776 : cluster [DBG] pgmap v10941: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:41:57.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:41:57 smithi086 bash[24289]: cluster 2024-09-16T11:41:57.389635+0000 mgr.a (mgr.14373) 15776 : cluster [DBG] pgmap v10941: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:41:57.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:41:57 smithi047 bash[22744]: cluster 2024-09-16T11:41:57.389635+0000 mgr.a (mgr.14373) 15776 : cluster [DBG] pgmap v10941: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:41:58.110 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:41:58.110 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:41:58.110 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:41:58.110 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:41:58.110 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:41:58.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:41:58 smithi157 bash[24585]: audit 2024-09-16T11:41:57.661776+0000 mgr.a (mgr.14373) 15777 : audit [DBG] from='client.340497 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:41:58.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:41:58 smithi086 bash[24289]: audit 2024-09-16T11:41:57.661776+0000 mgr.a (mgr.14373) 15777 : audit [DBG] from='client.340497 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:41:58.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:41:58 smithi047 bash[22744]: audit 2024-09-16T11:41:57.661776+0000 mgr.a (mgr.14373) 15777 : audit [DBG] from='client.340497 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:41:59.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:41:59 smithi157 bash[24585]: cluster 2024-09-16T11:41:59.390733+0000 mgr.a (mgr.14373) 15778 : cluster [DBG] pgmap v10942: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T11:41:59.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:41:59 smithi086 bash[24289]: cluster 2024-09-16T11:41:59.390733+0000 mgr.a (mgr.14373) 15778 : cluster [DBG] pgmap v10942: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T11:41:59.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:41:59 smithi047 bash[22744]: cluster 2024-09-16T11:41:59.390733+0000 mgr.a (mgr.14373) 15778 : cluster [DBG] pgmap v10942: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T11:42:01.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:42:01 smithi157 bash[24585]: cluster 2024-09-16T11:42:01.391706+0000 mgr.a (mgr.14373) 15779 : cluster [DBG] pgmap v10943: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T11:42:01.831 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:42:01 smithi086 bash[24289]: cluster 2024-09-16T11:42:01.391706+0000 mgr.a (mgr.14373) 15779 : cluster [DBG] pgmap v10943: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T11:42:01.844 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:42:01 smithi047 bash[22744]: cluster 2024-09-16T11:42:01.391706+0000 mgr.a (mgr.14373) 15779 : cluster [DBG] pgmap v10943: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T11:42:03.111 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:42:03.112 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:42:03.112 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:42:03.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:42:03 smithi157 bash[24585]: cluster 2024-09-16T11:42:03.393914+0000 mgr.a (mgr.14373) 15780 : cluster [DBG] pgmap v10944: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:42:03.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:42:03 smithi086 bash[24289]: cluster 2024-09-16T11:42:03.393914+0000 mgr.a (mgr.14373) 15780 : cluster [DBG] pgmap v10944: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:42:03.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:42:03 smithi047 bash[22744]: cluster 2024-09-16T11:42:03.393914+0000 mgr.a (mgr.14373) 15780 : cluster [DBG] pgmap v10944: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:42:03.888 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:42:03.888 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:42:03.888 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:42:03.888 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:42:03.889 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:42:04.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:42:04 smithi157 bash[24585]: audit 2024-09-16T11:42:03.444181+0000 mgr.a (mgr.14373) 15781 : audit [DBG] from='client.340572 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:42:04.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:42:04 smithi086 bash[24289]: audit 2024-09-16T11:42:03.444181+0000 mgr.a (mgr.14373) 15781 : audit [DBG] from='client.340572 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:42:04.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:42:04 smithi047 bash[22744]: audit 2024-09-16T11:42:03.444181+0000 mgr.a (mgr.14373) 15781 : audit [DBG] from='client.340572 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:42:05.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:42:05 smithi157 bash[24585]: cluster 2024-09-16T11:42:05.394850+0000 mgr.a (mgr.14373) 15782 : cluster [DBG] pgmap v10945: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-16T11:42:05.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:42:05 smithi086 bash[24289]: cluster 2024-09-16T11:42:05.394850+0000 mgr.a (mgr.14373) 15782 : cluster [DBG] pgmap v10945: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-16T11:42:05.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:42:05 smithi047 bash[22744]: cluster 2024-09-16T11:42:05.394850+0000 mgr.a (mgr.14373) 15782 : cluster [DBG] pgmap v10945: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-16T11:42:07.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:42:07 smithi157 bash[24585]: cluster 2024-09-16T11:42:07.397069+0000 mgr.a (mgr.14373) 15783 : cluster [DBG] pgmap v10946: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-16T11:42:07.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:42:07 smithi086 bash[24289]: cluster 2024-09-16T11:42:07.397069+0000 mgr.a (mgr.14373) 15783 : cluster [DBG] pgmap v10946: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-16T11:42:07.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:42:07 smithi047 bash[22744]: cluster 2024-09-16T11:42:07.397069+0000 mgr.a (mgr.14373) 15783 : cluster [DBG] pgmap v10946: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-16T11:42:08.888 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:42:08.889 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:42:08.889 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:42:09.656 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:42:09.657 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:42:09.657 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:42:09.657 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:42:09.657 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:42:09.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:42:09 smithi157 bash[24585]: audit 2024-09-16T11:42:09.220489+0000 mgr.a (mgr.14373) 15784 : audit [DBG] from='client.340650 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:42:09.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:42:09 smithi157 bash[24585]: cluster 2024-09-16T11:42:09.397911+0000 mgr.a (mgr.14373) 15785 : cluster [DBG] pgmap v10947: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:42:09.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:42:09 smithi086 bash[24289]: audit 2024-09-16T11:42:09.220489+0000 mgr.a (mgr.14373) 15784 : audit [DBG] from='client.340650 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:42:09.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:42:09 smithi086 bash[24289]: cluster 2024-09-16T11:42:09.397911+0000 mgr.a (mgr.14373) 15785 : cluster [DBG] pgmap v10947: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:42:09.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:42:09 smithi047 bash[22744]: audit 2024-09-16T11:42:09.220489+0000 mgr.a (mgr.14373) 15784 : audit [DBG] from='client.340650 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:42:09.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:42:09 smithi047 bash[22744]: cluster 2024-09-16T11:42:09.397911+0000 mgr.a (mgr.14373) 15785 : cluster [DBG] pgmap v10947: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:42:11.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:42:11 smithi157 bash[24585]: cluster 2024-09-16T11:42:11.398845+0000 mgr.a (mgr.14373) 15786 : cluster [DBG] pgmap v10948: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:42:11.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:42:11 smithi086 bash[24289]: cluster 2024-09-16T11:42:11.398845+0000 mgr.a (mgr.14373) 15786 : cluster [DBG] pgmap v10948: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:42:11.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:42:11 smithi047 bash[22744]: cluster 2024-09-16T11:42:11.398845+0000 mgr.a (mgr.14373) 15786 : cluster [DBG] pgmap v10948: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:42:13.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:42:13 smithi157 bash[24585]: cluster 2024-09-16T11:42:13.401102+0000 mgr.a (mgr.14373) 15787 : cluster [DBG] pgmap v10949: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:42:13.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:42:13 smithi086 bash[24289]: cluster 2024-09-16T11:42:13.401102+0000 mgr.a (mgr.14373) 15787 : cluster [DBG] pgmap v10949: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:42:13.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:42:13 smithi047 bash[22744]: cluster 2024-09-16T11:42:13.401102+0000 mgr.a (mgr.14373) 15787 : cluster [DBG] pgmap v10949: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:42:14.658 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:42:14.659 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:42:14.659 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:42:15.449 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:42:15.449 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:42:15.450 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:42:15.450 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:42:15.450 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:42:15.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:42:15 smithi157 bash[24585]: audit 2024-09-16T11:42:14.991378+0000 mgr.a (mgr.14373) 15788 : audit [DBG] from='client.340728 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:42:15.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:42:15 smithi157 bash[24585]: cluster 2024-09-16T11:42:15.401703+0000 mgr.a (mgr.14373) 15789 : cluster [DBG] pgmap v10950: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:42:15.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:42:15 smithi086 bash[24289]: audit 2024-09-16T11:42:14.991378+0000 mgr.a (mgr.14373) 15788 : audit [DBG] from='client.340728 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:42:15.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:42:15 smithi086 bash[24289]: cluster 2024-09-16T11:42:15.401703+0000 mgr.a (mgr.14373) 15789 : cluster [DBG] pgmap v10950: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:42:15.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:42:15 smithi047 bash[22744]: audit 2024-09-16T11:42:14.991378+0000 mgr.a (mgr.14373) 15788 : audit [DBG] from='client.340728 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:42:15.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:42:15 smithi047 bash[22744]: cluster 2024-09-16T11:42:15.401703+0000 mgr.a (mgr.14373) 15789 : cluster [DBG] pgmap v10950: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:42:17.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:42:17 smithi157 bash[24585]: cluster 2024-09-16T11:42:17.403887+0000 mgr.a (mgr.14373) 15790 : cluster [DBG] pgmap v10951: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:42:17.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:42:17 smithi086 bash[24289]: cluster 2024-09-16T11:42:17.403887+0000 mgr.a (mgr.14373) 15790 : cluster [DBG] pgmap v10951: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:42:17.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:42:17 smithi047 bash[22744]: cluster 2024-09-16T11:42:17.403887+0000 mgr.a (mgr.14373) 15790 : cluster [DBG] pgmap v10951: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:42:19.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:42:19 smithi157 bash[24585]: cluster 2024-09-16T11:42:19.404649+0000 mgr.a (mgr.14373) 15791 : cluster [DBG] pgmap v10952: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:42:19.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:42:19 smithi086 bash[24289]: cluster 2024-09-16T11:42:19.404649+0000 mgr.a (mgr.14373) 15791 : cluster [DBG] pgmap v10952: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:42:19.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:42:19 smithi047 bash[22744]: cluster 2024-09-16T11:42:19.404649+0000 mgr.a (mgr.14373) 15791 : cluster [DBG] pgmap v10952: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:42:20.451 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:42:20.452 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:42:20.452 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:42:21.229 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:42:21.230 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:42:21.230 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:42:21.230 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:42:21.230 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:42:21.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:42:21 smithi157 bash[24585]: audit 2024-09-16T11:42:20.785320+0000 mgr.a (mgr.14373) 15792 : audit [DBG] from='client.340806 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:42:21.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:42:21 smithi157 bash[24585]: cluster 2024-09-16T11:42:21.405560+0000 mgr.a (mgr.14373) 15793 : cluster [DBG] pgmap v10953: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:42:21.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:42:21 smithi086 bash[24289]: audit 2024-09-16T11:42:20.785320+0000 mgr.a (mgr.14373) 15792 : audit [DBG] from='client.340806 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:42:21.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:42:21 smithi086 bash[24289]: cluster 2024-09-16T11:42:21.405560+0000 mgr.a (mgr.14373) 15793 : cluster [DBG] pgmap v10953: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:42:21.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:42:21 smithi047 bash[22744]: audit 2024-09-16T11:42:20.785320+0000 mgr.a (mgr.14373) 15792 : audit [DBG] from='client.340806 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:42:21.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:42:21 smithi047 bash[22744]: cluster 2024-09-16T11:42:21.405560+0000 mgr.a (mgr.14373) 15793 : cluster [DBG] pgmap v10953: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:42:23.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:42:23 smithi157 bash[24585]: cluster 2024-09-16T11:42:23.407842+0000 mgr.a (mgr.14373) 15794 : cluster [DBG] pgmap v10954: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:42:23.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:42:23 smithi086 bash[24289]: cluster 2024-09-16T11:42:23.407842+0000 mgr.a (mgr.14373) 15794 : cluster [DBG] pgmap v10954: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:42:23.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:42:23 smithi047 bash[22744]: cluster 2024-09-16T11:42:23.407842+0000 mgr.a (mgr.14373) 15794 : cluster [DBG] pgmap v10954: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:42:25.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:42:25 smithi157 bash[24585]: cluster 2024-09-16T11:42:25.408598+0000 mgr.a (mgr.14373) 15795 : cluster [DBG] pgmap v10955: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:42:25.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:42:25 smithi086 bash[24289]: cluster 2024-09-16T11:42:25.408598+0000 mgr.a (mgr.14373) 15795 : cluster [DBG] pgmap v10955: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:42:25.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:42:25 smithi047 bash[22744]: cluster 2024-09-16T11:42:25.408598+0000 mgr.a (mgr.14373) 15795 : cluster [DBG] pgmap v10955: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:42:26.231 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:42:26.232 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:42:26.232 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:42:26.980 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:42:26.981 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:42:26.981 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:42:26.981 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:42:26.981 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:42:27.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:42:27 smithi157 bash[24585]: audit 2024-09-16T11:42:26.560553+0000 mgr.a (mgr.14373) 15796 : audit [DBG] from='client.340884 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:42:27.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:42:27 smithi157 bash[24585]: cluster 2024-09-16T11:42:27.411274+0000 mgr.a (mgr.14373) 15797 : cluster [DBG] pgmap v10956: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:42:27.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:42:27 smithi086 bash[24289]: audit 2024-09-16T11:42:26.560553+0000 mgr.a (mgr.14373) 15796 : audit [DBG] from='client.340884 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:42:27.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:42:27 smithi086 bash[24289]: cluster 2024-09-16T11:42:27.411274+0000 mgr.a (mgr.14373) 15797 : cluster [DBG] pgmap v10956: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:42:27.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:42:27 smithi047 bash[22744]: audit 2024-09-16T11:42:26.560553+0000 mgr.a (mgr.14373) 15796 : audit [DBG] from='client.340884 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:42:27.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:42:27 smithi047 bash[22744]: cluster 2024-09-16T11:42:27.411274+0000 mgr.a (mgr.14373) 15797 : cluster [DBG] pgmap v10956: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:42:29.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:42:29 smithi157 bash[24585]: cluster 2024-09-16T11:42:29.412059+0000 mgr.a (mgr.14373) 15798 : cluster [DBG] pgmap v10957: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:42:29.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:42:29 smithi086 bash[24289]: cluster 2024-09-16T11:42:29.412059+0000 mgr.a (mgr.14373) 15798 : cluster [DBG] pgmap v10957: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:42:29.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:42:29 smithi047 bash[22744]: cluster 2024-09-16T11:42:29.412059+0000 mgr.a (mgr.14373) 15798 : cluster [DBG] pgmap v10957: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:42:31.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:42:31 smithi157 bash[24585]: cluster 2024-09-16T11:42:31.412839+0000 mgr.a (mgr.14373) 15799 : cluster [DBG] pgmap v10958: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T11:42:31.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:42:31 smithi086 bash[24289]: cluster 2024-09-16T11:42:31.412839+0000 mgr.a (mgr.14373) 15799 : cluster [DBG] pgmap v10958: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T11:42:31.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:42:31 smithi047 bash[22744]: cluster 2024-09-16T11:42:31.412839+0000 mgr.a (mgr.14373) 15799 : cluster [DBG] pgmap v10958: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T11:42:31.982 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:42:31.983 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:42:31.983 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:42:32.760 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:42:32.760 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:42:32.760 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:42:32.760 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:42:32.761 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:42:32.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:42:32 smithi157 bash[24585]: audit 2024-09-16T11:42:32.313397+0000 mgr.a (mgr.14373) 15800 : audit [DBG] from='client.340956 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:42:32.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:42:32 smithi086 bash[24289]: audit 2024-09-16T11:42:32.313397+0000 mgr.a (mgr.14373) 15800 : audit [DBG] from='client.340956 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:42:32.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:42:32 smithi047 bash[22744]: audit 2024-09-16T11:42:32.313397+0000 mgr.a (mgr.14373) 15800 : audit [DBG] from='client.340956 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:42:33.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:42:33 smithi157 bash[24585]: cluster 2024-09-16T11:42:33.415637+0000 mgr.a (mgr.14373) 15801 : cluster [DBG] pgmap v10959: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:42:33.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:42:33 smithi086 bash[24289]: cluster 2024-09-16T11:42:33.415637+0000 mgr.a (mgr.14373) 15801 : cluster [DBG] pgmap v10959: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:42:33.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:42:33 smithi047 bash[22744]: cluster 2024-09-16T11:42:33.415637+0000 mgr.a (mgr.14373) 15801 : cluster [DBG] pgmap v10959: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:42:35.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:42:35 smithi157 bash[24585]: cluster 2024-09-16T11:42:35.416383+0000 mgr.a (mgr.14373) 15802 : cluster [DBG] pgmap v10960: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:42:35.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:42:35 smithi086 bash[24289]: cluster 2024-09-16T11:42:35.416383+0000 mgr.a (mgr.14373) 15802 : cluster [DBG] pgmap v10960: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:42:35.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:42:35 smithi047 bash[22744]: cluster 2024-09-16T11:42:35.416383+0000 mgr.a (mgr.14373) 15802 : cluster [DBG] pgmap v10960: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:42:37.761 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:42:37.762 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:42:37.762 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:42:37.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:42:37 smithi157 bash[24585]: cluster 2024-09-16T11:42:37.418388+0000 mgr.a (mgr.14373) 15803 : cluster [DBG] pgmap v10961: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:42:37.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:42:37 smithi086 bash[24289]: cluster 2024-09-16T11:42:37.418388+0000 mgr.a (mgr.14373) 15803 : cluster [DBG] pgmap v10961: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:42:37.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:42:37 smithi047 bash[22744]: cluster 2024-09-16T11:42:37.418388+0000 mgr.a (mgr.14373) 15803 : cluster [DBG] pgmap v10961: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:42:38.505 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:42:38.505 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:42:38.505 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:42:38.505 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:42:38.505 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:42:38.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:42:38 smithi157 bash[24585]: audit 2024-09-16T11:42:38.089610+0000 mgr.a (mgr.14373) 15804 : audit [DBG] from='client.341034 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:42:38.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:42:38 smithi086 bash[24289]: audit 2024-09-16T11:42:38.089610+0000 mgr.a (mgr.14373) 15804 : audit [DBG] from='client.341034 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:42:38.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:42:38 smithi047 bash[22744]: audit 2024-09-16T11:42:38.089610+0000 mgr.a (mgr.14373) 15804 : audit [DBG] from='client.341034 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:42:39.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:42:39 smithi157 bash[24585]: cluster 2024-09-16T11:42:39.419278+0000 mgr.a (mgr.14373) 15805 : cluster [DBG] pgmap v10962: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:42:39.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:42:39 smithi086 bash[24289]: cluster 2024-09-16T11:42:39.419278+0000 mgr.a (mgr.14373) 15805 : cluster [DBG] pgmap v10962: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:42:39.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:42:39 smithi047 bash[22744]: cluster 2024-09-16T11:42:39.419278+0000 mgr.a (mgr.14373) 15805 : cluster [DBG] pgmap v10962: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:42:41.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:42:41 smithi157 bash[24585]: cluster 2024-09-16T11:42:41.420155+0000 mgr.a (mgr.14373) 15806 : cluster [DBG] pgmap v10963: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:42:41.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:42:41 smithi086 bash[24289]: cluster 2024-09-16T11:42:41.420155+0000 mgr.a (mgr.14373) 15806 : cluster [DBG] pgmap v10963: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:42:41.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:42:41 smithi047 bash[22744]: cluster 2024-09-16T11:42:41.420155+0000 mgr.a (mgr.14373) 15806 : cluster [DBG] pgmap v10963: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:42:43.506 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:42:43.507 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:42:43.507 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:42:43.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:42:43 smithi157 bash[24585]: cluster 2024-09-16T11:42:43.422548+0000 mgr.a (mgr.14373) 15807 : cluster [DBG] pgmap v10964: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:42:43.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:42:43 smithi086 bash[24289]: cluster 2024-09-16T11:42:43.422548+0000 mgr.a (mgr.14373) 15807 : cluster [DBG] pgmap v10964: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:42:43.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:42:43 smithi047 bash[22744]: cluster 2024-09-16T11:42:43.422548+0000 mgr.a (mgr.14373) 15807 : cluster [DBG] pgmap v10964: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:42:44.257 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:42:44.258 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:42:44.258 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:42:44.258 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:42:44.258 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:42:44.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:42:44 smithi157 bash[24585]: audit 2024-09-16T11:42:43.832786+0000 mgr.a (mgr.14373) 15808 : audit [DBG] from='client.341112 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:42:44.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:42:44 smithi086 bash[24289]: audit 2024-09-16T11:42:43.832786+0000 mgr.a (mgr.14373) 15808 : audit [DBG] from='client.341112 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:42:44.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:42:44 smithi047 bash[22744]: audit 2024-09-16T11:42:43.832786+0000 mgr.a (mgr.14373) 15808 : audit [DBG] from='client.341112 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:42:45.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:42:45 smithi157 bash[24585]: cluster 2024-09-16T11:42:45.423494+0000 mgr.a (mgr.14373) 15809 : cluster [DBG] pgmap v10965: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:42:45.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:42:45 smithi086 bash[24289]: cluster 2024-09-16T11:42:45.423494+0000 mgr.a (mgr.14373) 15809 : cluster [DBG] pgmap v10965: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:42:45.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:42:45 smithi047 bash[22744]: cluster 2024-09-16T11:42:45.423494+0000 mgr.a (mgr.14373) 15809 : cluster [DBG] pgmap v10965: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:42:47.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:42:47 smithi157 bash[24585]: cluster 2024-09-16T11:42:47.425683+0000 mgr.a (mgr.14373) 15810 : cluster [DBG] pgmap v10966: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:42:47.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:42:47 smithi086 bash[24289]: cluster 2024-09-16T11:42:47.425683+0000 mgr.a (mgr.14373) 15810 : cluster [DBG] pgmap v10966: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:42:47.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:42:47 smithi047 bash[22744]: cluster 2024-09-16T11:42:47.425683+0000 mgr.a (mgr.14373) 15810 : cluster [DBG] pgmap v10966: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:42:49.259 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:42:49.260 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:42:49.260 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:42:49.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:42:49 smithi157 bash[24585]: cluster 2024-09-16T11:42:49.426438+0000 mgr.a (mgr.14373) 15811 : cluster [DBG] pgmap v10967: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:42:49.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:42:49 smithi086 bash[24289]: cluster 2024-09-16T11:42:49.426438+0000 mgr.a (mgr.14373) 15811 : cluster [DBG] pgmap v10967: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:42:49.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:42:49 smithi047 bash[22744]: cluster 2024-09-16T11:42:49.426438+0000 mgr.a (mgr.14373) 15811 : cluster [DBG] pgmap v10967: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:42:50.021 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:42:50.022 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:42:50.022 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:42:50.022 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:42:50.022 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:42:50.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:42:50 smithi157 bash[24585]: audit 2024-09-16T11:42:49.593273+0000 mgr.a (mgr.14373) 15812 : audit [DBG] from='client.341190 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:42:50.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:42:50 smithi086 bash[24289]: audit 2024-09-16T11:42:49.593273+0000 mgr.a (mgr.14373) 15812 : audit [DBG] from='client.341190 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:42:50.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:42:50 smithi047 bash[22744]: audit 2024-09-16T11:42:49.593273+0000 mgr.a (mgr.14373) 15812 : audit [DBG] from='client.341190 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:42:51.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:42:51 smithi157 bash[24585]: cluster 2024-09-16T11:42:51.427904+0000 mgr.a (mgr.14373) 15813 : cluster [DBG] pgmap v10968: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-16T11:42:51.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:42:51 smithi086 bash[24289]: cluster 2024-09-16T11:42:51.427904+0000 mgr.a (mgr.14373) 15813 : cluster [DBG] pgmap v10968: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-16T11:42:51.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:42:51 smithi047 bash[22744]: cluster 2024-09-16T11:42:51.427904+0000 mgr.a (mgr.14373) 15813 : cluster [DBG] pgmap v10968: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-16T11:42:52.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:42:52 smithi157 bash[24585]: audit 2024-09-16T11:42:51.979877+0000 mon.b (mon.2) 1438 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T11:42:52.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:42:52 smithi086 bash[24289]: audit 2024-09-16T11:42:51.979877+0000 mon.b (mon.2) 1438 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T11:42:52.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:42:52 smithi047 bash[22744]: audit 2024-09-16T11:42:51.979877+0000 mon.b (mon.2) 1438 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T11:42:53.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:42:53 smithi157 bash[24585]: cluster 2024-09-16T11:42:53.429592+0000 mgr.a (mgr.14373) 15814 : cluster [DBG] pgmap v10969: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:42:53.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:42:53 smithi086 bash[24289]: cluster 2024-09-16T11:42:53.429592+0000 mgr.a (mgr.14373) 15814 : cluster [DBG] pgmap v10969: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:42:53.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:42:53 smithi047 bash[22744]: cluster 2024-09-16T11:42:53.429592+0000 mgr.a (mgr.14373) 15814 : cluster [DBG] pgmap v10969: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:42:55.022 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:42:55.023 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:42:55.023 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:42:55.787 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:42:55.787 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:42:55.787 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:42:55.787 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:42:55.787 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:42:55.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:42:55 smithi157 bash[24585]: audit 2024-09-16T11:42:55.361652+0000 mgr.a (mgr.14373) 15815 : audit [DBG] from='client.341268 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:42:55.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:42:55 smithi157 bash[24585]: cluster 2024-09-16T11:42:55.430372+0000 mgr.a (mgr.14373) 15816 : cluster [DBG] pgmap v10970: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:42:55.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:42:55 smithi086 bash[24289]: audit 2024-09-16T11:42:55.361652+0000 mgr.a (mgr.14373) 15815 : audit [DBG] from='client.341268 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:42:55.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:42:55 smithi086 bash[24289]: cluster 2024-09-16T11:42:55.430372+0000 mgr.a (mgr.14373) 15816 : cluster [DBG] pgmap v10970: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:42:55.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:42:55 smithi047 bash[22744]: audit 2024-09-16T11:42:55.361652+0000 mgr.a (mgr.14373) 15815 : audit [DBG] from='client.341268 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:42:55.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:42:55 smithi047 bash[22744]: cluster 2024-09-16T11:42:55.430372+0000 mgr.a (mgr.14373) 15816 : cluster [DBG] pgmap v10970: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:42:57.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:42:57 smithi157 bash[24585]: cluster 2024-09-16T11:42:57.432732+0000 mgr.a (mgr.14373) 15817 : cluster [DBG] pgmap v10971: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:42:57.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:42:57 smithi086 bash[24289]: cluster 2024-09-16T11:42:57.432732+0000 mgr.a (mgr.14373) 15817 : cluster [DBG] pgmap v10971: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:42:57.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:42:57 smithi047 bash[22744]: cluster 2024-09-16T11:42:57.432732+0000 mgr.a (mgr.14373) 15817 : cluster [DBG] pgmap v10971: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:42:59.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:42:59 smithi157 bash[24585]: cluster 2024-09-16T11:42:59.433524+0000 mgr.a (mgr.14373) 15818 : cluster [DBG] pgmap v10972: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:42:59.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:42:59 smithi086 bash[24289]: cluster 2024-09-16T11:42:59.433524+0000 mgr.a (mgr.14373) 15818 : cluster [DBG] pgmap v10972: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:42:59.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:42:59 smithi047 bash[22744]: cluster 2024-09-16T11:42:59.433524+0000 mgr.a (mgr.14373) 15818 : cluster [DBG] pgmap v10972: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:43:00.788 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:43:00.790 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:43:00.790 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:43:01.565 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:43:01.565 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:43:01.565 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:43:01.565 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:43:01.565 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:43:01.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:43:01 smithi157 bash[24585]: audit 2024-09-16T11:43:01.123408+0000 mgr.a (mgr.14373) 15819 : audit [DBG] from='client.341343 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:43:01.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:43:01 smithi157 bash[24585]: cluster 2024-09-16T11:43:01.434447+0000 mgr.a (mgr.14373) 15820 : cluster [DBG] pgmap v10973: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-16T11:43:01.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:43:01 smithi086 bash[24289]: audit 2024-09-16T11:43:01.123408+0000 mgr.a (mgr.14373) 15819 : audit [DBG] from='client.341343 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:43:01.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:43:01 smithi086 bash[24289]: cluster 2024-09-16T11:43:01.434447+0000 mgr.a (mgr.14373) 15820 : cluster [DBG] pgmap v10973: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-16T11:43:01.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:43:01 smithi047 bash[22744]: audit 2024-09-16T11:43:01.123408+0000 mgr.a (mgr.14373) 15819 : audit [DBG] from='client.341343 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:43:01.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:43:01 smithi047 bash[22744]: cluster 2024-09-16T11:43:01.434447+0000 mgr.a (mgr.14373) 15820 : cluster [DBG] pgmap v10973: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-16T11:43:03.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:43:03 smithi157 bash[24585]: audit 2024-09-16T11:43:02.296502+0000 mon.a (mon.0) 1510 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:43:03.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:43:03 smithi157 bash[24585]: audit 2024-09-16T11:43:02.307302+0000 mon.a (mon.0) 1511 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:43:03.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:43:03 smithi157 bash[24585]: audit 2024-09-16T11:43:02.310402+0000 mon.b (mon.2) 1439 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T11:43:03.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:43:03 smithi157 bash[24585]: audit 2024-09-16T11:43:02.312745+0000 mon.b (mon.2) 1440 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T11:43:03.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:43:03 smithi157 bash[24585]: audit 2024-09-16T11:43:02.324917+0000 mon.a (mon.0) 1512 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:43:03.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:43:03 smithi157 bash[24585]: audit 2024-09-16T11:43:02.330223+0000 mon.b (mon.2) 1441 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:43:03.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:43:03 smithi157 bash[24585]: audit 2024-09-16T11:43:02.333277+0000 mgr.a (mgr.14373) 15821 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:43:03.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:43:03 smithi086 bash[24289]: audit 2024-09-16T11:43:02.296502+0000 mon.a (mon.0) 1510 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:43:03.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:43:03 smithi086 bash[24289]: audit 2024-09-16T11:43:02.307302+0000 mon.a (mon.0) 1511 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:43:03.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:43:03 smithi086 bash[24289]: audit 2024-09-16T11:43:02.310402+0000 mon.b (mon.2) 1439 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T11:43:03.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:43:03 smithi086 bash[24289]: audit 2024-09-16T11:43:02.312745+0000 mon.b (mon.2) 1440 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T11:43:03.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:43:03 smithi086 bash[24289]: audit 2024-09-16T11:43:02.324917+0000 mon.a (mon.0) 1512 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:43:03.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:43:03 smithi086 bash[24289]: audit 2024-09-16T11:43:02.330223+0000 mon.b (mon.2) 1441 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:43:03.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:43:03 smithi086 bash[24289]: audit 2024-09-16T11:43:02.333277+0000 mgr.a (mgr.14373) 15821 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:43:03.593 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 11:43:03 smithi047 bash[22994]: debug 2024-09-16T11:43:03.103+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T11:43:03.593 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 11:43:03 smithi047 bash[22994]: debug 2024-09-16T11:43:03.107+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T11:43:03.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:43:03 smithi047 bash[22744]: audit 2024-09-16T11:43:02.296502+0000 mon.a (mon.0) 1510 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:43:03.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:43:03 smithi047 bash[22744]: audit 2024-09-16T11:43:02.307302+0000 mon.a (mon.0) 1511 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:43:03.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:43:03 smithi047 bash[22744]: audit 2024-09-16T11:43:02.310402+0000 mon.b (mon.2) 1439 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T11:43:03.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:43:03 smithi047 bash[22744]: audit 2024-09-16T11:43:02.312745+0000 mon.b (mon.2) 1440 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T11:43:03.594 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:43:03 smithi047 bash[22744]: audit 2024-09-16T11:43:02.324917+0000 mon.a (mon.0) 1512 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:43:03.594 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:43:03 smithi047 bash[22744]: audit 2024-09-16T11:43:02.330223+0000 mon.b (mon.2) 1441 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:43:03.594 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:43:03 smithi047 bash[22744]: audit 2024-09-16T11:43:02.333277+0000 mgr.a (mgr.14373) 15821 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:43:04.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:43:04 smithi157 bash[24585]: audit 2024-09-16T11:43:03.108913+0000 mgr.a (mgr.14373) 15822 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T11:43:04.560 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:43:04 smithi157 bash[24585]: cephadm 2024-09-16T11:43:03.111135+0000 mgr.a (mgr.14373) 15823 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T11:43:04.560 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:43:04 smithi157 bash[24585]: cluster 2024-09-16T11:43:03.436531+0000 mgr.a (mgr.14373) 15824 : cluster [DBG] pgmap v10974: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 2 op/s 2024-09-16T11:43:04.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:43:04 smithi086 bash[24289]: audit 2024-09-16T11:43:03.108913+0000 mgr.a (mgr.14373) 15822 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T11:43:04.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:43:04 smithi086 bash[24289]: cephadm 2024-09-16T11:43:03.111135+0000 mgr.a (mgr.14373) 15823 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T11:43:04.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:43:04 smithi086 bash[24289]: cluster 2024-09-16T11:43:03.436531+0000 mgr.a (mgr.14373) 15824 : cluster [DBG] pgmap v10974: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 2 op/s 2024-09-16T11:43:04.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:43:04 smithi047 bash[22744]: audit 2024-09-16T11:43:03.108913+0000 mgr.a (mgr.14373) 15822 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T11:43:04.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:43:04 smithi047 bash[22744]: cephadm 2024-09-16T11:43:03.111135+0000 mgr.a (mgr.14373) 15823 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T11:43:04.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:43:04 smithi047 bash[22744]: cluster 2024-09-16T11:43:03.436531+0000 mgr.a (mgr.14373) 15824 : cluster [DBG] pgmap v10974: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 2 op/s 2024-09-16T11:43:05.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:43:05 smithi157 bash[24585]: cluster 2024-09-16T11:43:05.437300+0000 mgr.a (mgr.14373) 15825 : cluster [DBG] pgmap v10975: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T11:43:05.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:43:05 smithi086 bash[24289]: cluster 2024-09-16T11:43:05.437300+0000 mgr.a (mgr.14373) 15825 : cluster [DBG] pgmap v10975: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T11:43:05.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:43:05 smithi047 bash[22744]: cluster 2024-09-16T11:43:05.437300+0000 mgr.a (mgr.14373) 15825 : cluster [DBG] pgmap v10975: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T11:43:06.566 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:43:06.567 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:43:06.567 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:43:07.350 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:43:07.351 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:43:07.351 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:43:07.351 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:43:07.351 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:43:07.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:43:07 smithi157 bash[24585]: audit 2024-09-16T11:43:06.900687+0000 mgr.a (mgr.14373) 15826 : audit [DBG] from='client.341523 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:43:07.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:43:07 smithi086 bash[24289]: audit 2024-09-16T11:43:06.900687+0000 mgr.a (mgr.14373) 15826 : audit [DBG] from='client.341523 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:43:07.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:43:07 smithi047 bash[22744]: audit 2024-09-16T11:43:06.900687+0000 mgr.a (mgr.14373) 15826 : audit [DBG] from='client.341523 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:43:08.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:43:08 smithi157 bash[24585]: cluster 2024-09-16T11:43:07.439386+0000 mgr.a (mgr.14373) 15827 : cluster [DBG] pgmap v10976: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:43:08.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:43:08 smithi086 bash[24289]: cluster 2024-09-16T11:43:07.439386+0000 mgr.a (mgr.14373) 15827 : cluster [DBG] pgmap v10976: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:43:08.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:43:08 smithi047 bash[22744]: cluster 2024-09-16T11:43:07.439386+0000 mgr.a (mgr.14373) 15827 : cluster [DBG] pgmap v10976: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:43:10.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:43:10 smithi157 bash[24585]: cluster 2024-09-16T11:43:09.440288+0000 mgr.a (mgr.14373) 15828 : cluster [DBG] pgmap v10977: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T11:43:10.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:43:10 smithi086 bash[24289]: cluster 2024-09-16T11:43:09.440288+0000 mgr.a (mgr.14373) 15828 : cluster [DBG] pgmap v10977: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T11:43:10.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:43:10 smithi047 bash[22744]: cluster 2024-09-16T11:43:09.440288+0000 mgr.a (mgr.14373) 15828 : cluster [DBG] pgmap v10977: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T11:43:12.352 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:43:12.353 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:43:12.353 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:43:12.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:43:12 smithi157 bash[24585]: cluster 2024-09-16T11:43:11.441640+0000 mgr.a (mgr.14373) 15829 : cluster [DBG] pgmap v10978: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 6.2 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T11:43:12.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:43:12 smithi086 bash[24289]: cluster 2024-09-16T11:43:11.441640+0000 mgr.a (mgr.14373) 15829 : cluster [DBG] pgmap v10978: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 6.2 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T11:43:12.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:43:12 smithi047 bash[22744]: cluster 2024-09-16T11:43:11.441640+0000 mgr.a (mgr.14373) 15829 : cluster [DBG] pgmap v10978: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 6.2 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T11:43:13.130 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:43:13.131 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:43:13.131 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:43:13.131 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:43:13.131 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:43:13.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:43:13 smithi157 bash[24585]: audit 2024-09-16T11:43:12.687509+0000 mgr.a (mgr.14373) 15830 : audit [DBG] from='client.341601 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:43:13.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:43:13 smithi086 bash[24289]: audit 2024-09-16T11:43:12.687509+0000 mgr.a (mgr.14373) 15830 : audit [DBG] from='client.341601 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:43:13.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:43:13 smithi047 bash[22744]: audit 2024-09-16T11:43:12.687509+0000 mgr.a (mgr.14373) 15830 : audit [DBG] from='client.341601 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:43:14.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:43:14 smithi157 bash[24585]: cluster 2024-09-16T11:43:13.443940+0000 mgr.a (mgr.14373) 15831 : cluster [DBG] pgmap v10979: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 6.9 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T11:43:14.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:43:14 smithi086 bash[24289]: cluster 2024-09-16T11:43:13.443940+0000 mgr.a (mgr.14373) 15831 : cluster [DBG] pgmap v10979: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 6.9 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T11:43:14.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:43:14 smithi047 bash[22744]: cluster 2024-09-16T11:43:13.443940+0000 mgr.a (mgr.14373) 15831 : cluster [DBG] pgmap v10979: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 6.9 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T11:43:16.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:43:16 smithi157 bash[24585]: cluster 2024-09-16T11:43:15.444741+0000 mgr.a (mgr.14373) 15832 : cluster [DBG] pgmap v10980: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T11:43:16.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:43:16 smithi086 bash[24289]: cluster 2024-09-16T11:43:15.444741+0000 mgr.a (mgr.14373) 15832 : cluster [DBG] pgmap v10980: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T11:43:16.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:43:16 smithi047 bash[22744]: cluster 2024-09-16T11:43:15.444741+0000 mgr.a (mgr.14373) 15832 : cluster [DBG] pgmap v10980: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T11:43:18.132 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:43:18.133 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:43:18.133 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:43:18.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:43:18 smithi157 bash[24585]: cluster 2024-09-16T11:43:17.446793+0000 mgr.a (mgr.14373) 15833 : cluster [DBG] pgmap v10981: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.4 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:43:18.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:43:18 smithi086 bash[24289]: cluster 2024-09-16T11:43:17.446793+0000 mgr.a (mgr.14373) 15833 : cluster [DBG] pgmap v10981: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.4 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:43:18.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:43:18 smithi047 bash[22744]: cluster 2024-09-16T11:43:17.446793+0000 mgr.a (mgr.14373) 15833 : cluster [DBG] pgmap v10981: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.4 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:43:18.887 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:43:18.887 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:43:18.887 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:43:18.887 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:43:18.888 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:43:19.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:43:19 smithi157 bash[24585]: audit 2024-09-16T11:43:18.463822+0000 mgr.a (mgr.14373) 15834 : audit [DBG] from='client.341679 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:43:19.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:43:19 smithi086 bash[24289]: audit 2024-09-16T11:43:18.463822+0000 mgr.a (mgr.14373) 15834 : audit [DBG] from='client.341679 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:43:19.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:43:19 smithi047 bash[22744]: audit 2024-09-16T11:43:18.463822+0000 mgr.a (mgr.14373) 15834 : audit [DBG] from='client.341679 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:43:20.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:43:20 smithi157 bash[24585]: cluster 2024-09-16T11:43:19.447694+0000 mgr.a (mgr.14373) 15835 : cluster [DBG] pgmap v10982: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:43:20.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:43:20 smithi086 bash[24289]: cluster 2024-09-16T11:43:19.447694+0000 mgr.a (mgr.14373) 15835 : cluster [DBG] pgmap v10982: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:43:20.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:43:20 smithi047 bash[22744]: cluster 2024-09-16T11:43:19.447694+0000 mgr.a (mgr.14373) 15835 : cluster [DBG] pgmap v10982: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:43:22.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:43:22 smithi157 bash[24585]: cluster 2024-09-16T11:43:21.449111+0000 mgr.a (mgr.14373) 15836 : cluster [DBG] pgmap v10983: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-16T11:43:22.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:43:22 smithi086 bash[24289]: cluster 2024-09-16T11:43:21.449111+0000 mgr.a (mgr.14373) 15836 : cluster [DBG] pgmap v10983: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-16T11:43:22.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:43:22 smithi047 bash[22744]: cluster 2024-09-16T11:43:21.449111+0000 mgr.a (mgr.14373) 15836 : cluster [DBG] pgmap v10983: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-16T11:43:23.889 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:43:23.889 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:43:23.890 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:43:24.647 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:43:24.648 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:43:24.648 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:43:24.648 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:43:24.648 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:43:24.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:43:24 smithi157 bash[24585]: cluster 2024-09-16T11:43:23.450817+0000 mgr.a (mgr.14373) 15837 : cluster [DBG] pgmap v10984: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:43:24.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:43:24 smithi157 bash[24585]: audit 2024-09-16T11:43:24.219285+0000 mgr.a (mgr.14373) 15838 : audit [DBG] from='client.341757 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:43:24.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:43:24 smithi086 bash[24289]: cluster 2024-09-16T11:43:23.450817+0000 mgr.a (mgr.14373) 15837 : cluster [DBG] pgmap v10984: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:43:24.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:43:24 smithi086 bash[24289]: audit 2024-09-16T11:43:24.219285+0000 mgr.a (mgr.14373) 15838 : audit [DBG] from='client.341757 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:43:24.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:43:24 smithi047 bash[22744]: cluster 2024-09-16T11:43:23.450817+0000 mgr.a (mgr.14373) 15837 : cluster [DBG] pgmap v10984: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:43:24.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:43:24 smithi047 bash[22744]: audit 2024-09-16T11:43:24.219285+0000 mgr.a (mgr.14373) 15838 : audit [DBG] from='client.341757 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:43:26.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:43:26 smithi086 bash[24289]: cluster 2024-09-16T11:43:25.451833+0000 mgr.a (mgr.14373) 15839 : cluster [DBG] pgmap v10985: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:43:26.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:43:26 smithi047 bash[22744]: cluster 2024-09-16T11:43:25.451833+0000 mgr.a (mgr.14373) 15839 : cluster [DBG] pgmap v10985: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:43:27.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:43:26 smithi157 bash[24585]: cluster 2024-09-16T11:43:25.451833+0000 mgr.a (mgr.14373) 15839 : cluster [DBG] pgmap v10985: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:43:28.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:43:28 smithi086 bash[24289]: cluster 2024-09-16T11:43:27.454075+0000 mgr.a (mgr.14373) 15840 : cluster [DBG] pgmap v10986: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:43:28.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:43:28 smithi047 bash[22744]: cluster 2024-09-16T11:43:27.454075+0000 mgr.a (mgr.14373) 15840 : cluster [DBG] pgmap v10986: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:43:29.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:43:28 smithi157 bash[24585]: cluster 2024-09-16T11:43:27.454075+0000 mgr.a (mgr.14373) 15840 : cluster [DBG] pgmap v10986: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:43:29.649 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:43:29.649 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:43:29.650 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:43:30.398 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:43:30.398 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:43:30.398 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:43:30.398 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:43:30.399 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:43:30.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:43:30 smithi086 bash[24289]: cluster 2024-09-16T11:43:29.454858+0000 mgr.a (mgr.14373) 15841 : cluster [DBG] pgmap v10987: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:43:30.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:43:30 smithi086 bash[24289]: audit 2024-09-16T11:43:29.974095+0000 mgr.a (mgr.14373) 15842 : audit [DBG] from='client.341832 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:43:30.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:43:30 smithi047 bash[22744]: cluster 2024-09-16T11:43:29.454858+0000 mgr.a (mgr.14373) 15841 : cluster [DBG] pgmap v10987: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:43:30.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:43:30 smithi047 bash[22744]: audit 2024-09-16T11:43:29.974095+0000 mgr.a (mgr.14373) 15842 : audit [DBG] from='client.341832 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:43:31.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:43:30 smithi157 bash[24585]: cluster 2024-09-16T11:43:29.454858+0000 mgr.a (mgr.14373) 15841 : cluster [DBG] pgmap v10987: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:43:31.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:43:30 smithi157 bash[24585]: audit 2024-09-16T11:43:29.974095+0000 mgr.a (mgr.14373) 15842 : audit [DBG] from='client.341832 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:43:32.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:43:32 smithi086 bash[24289]: cluster 2024-09-16T11:43:31.456423+0000 mgr.a (mgr.14373) 15843 : cluster [DBG] pgmap v10988: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-16T11:43:32.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:43:32 smithi047 bash[22744]: cluster 2024-09-16T11:43:31.456423+0000 mgr.a (mgr.14373) 15843 : cluster [DBG] pgmap v10988: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-16T11:43:33.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:43:32 smithi157 bash[24585]: cluster 2024-09-16T11:43:31.456423+0000 mgr.a (mgr.14373) 15843 : cluster [DBG] pgmap v10988: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-16T11:43:34.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:43:34 smithi047 bash[22744]: cluster 2024-09-16T11:43:33.458107+0000 mgr.a (mgr.14373) 15844 : cluster [DBG] pgmap v10989: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:43:35.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:43:34 smithi157 bash[24585]: cluster 2024-09-16T11:43:33.458107+0000 mgr.a (mgr.14373) 15844 : cluster [DBG] pgmap v10989: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:43:35.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:43:34 smithi086 bash[24289]: cluster 2024-09-16T11:43:33.458107+0000 mgr.a (mgr.14373) 15844 : cluster [DBG] pgmap v10989: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:43:35.400 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:43:35.400 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:43:35.401 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:43:36.160 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:43:36.161 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:43:36.161 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:43:36.161 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:43:36.161 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:43:36.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:43:36 smithi047 bash[22744]: cluster 2024-09-16T11:43:35.458688+0000 mgr.a (mgr.14373) 15845 : cluster [DBG] pgmap v10990: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:43:36.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:43:36 smithi047 bash[22744]: audit 2024-09-16T11:43:35.737686+0000 mgr.a (mgr.14373) 15846 : audit [DBG] from='client.341907 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:43:37.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:43:36 smithi157 bash[24585]: cluster 2024-09-16T11:43:35.458688+0000 mgr.a (mgr.14373) 15845 : cluster [DBG] pgmap v10990: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:43:37.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:43:36 smithi157 bash[24585]: audit 2024-09-16T11:43:35.737686+0000 mgr.a (mgr.14373) 15846 : audit [DBG] from='client.341907 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:43:37.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:43:36 smithi086 bash[24289]: cluster 2024-09-16T11:43:35.458688+0000 mgr.a (mgr.14373) 15845 : cluster [DBG] pgmap v10990: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:43:37.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:43:36 smithi086 bash[24289]: audit 2024-09-16T11:43:35.737686+0000 mgr.a (mgr.14373) 15846 : audit [DBG] from='client.341907 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:43:38.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:43:38 smithi047 bash[22744]: cluster 2024-09-16T11:43:37.461108+0000 mgr.a (mgr.14373) 15847 : cluster [DBG] pgmap v10991: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:43:39.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:43:38 smithi157 bash[24585]: cluster 2024-09-16T11:43:37.461108+0000 mgr.a (mgr.14373) 15847 : cluster [DBG] pgmap v10991: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:43:39.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:43:38 smithi086 bash[24289]: cluster 2024-09-16T11:43:37.461108+0000 mgr.a (mgr.14373) 15847 : cluster [DBG] pgmap v10991: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:43:40.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:43:40 smithi047 bash[22744]: cluster 2024-09-16T11:43:39.461917+0000 mgr.a (mgr.14373) 15848 : cluster [DBG] pgmap v10992: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:43:41.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:43:40 smithi157 bash[24585]: cluster 2024-09-16T11:43:39.461917+0000 mgr.a (mgr.14373) 15848 : cluster [DBG] pgmap v10992: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:43:41.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:43:40 smithi086 bash[24289]: cluster 2024-09-16T11:43:39.461917+0000 mgr.a (mgr.14373) 15848 : cluster [DBG] pgmap v10992: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:43:41.162 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:43:41.163 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:43:41.163 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:43:41.939 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:43:41.939 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:43:41.939 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:43:41.939 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:43:41.939 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:43:42.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:43:42 smithi047 bash[22744]: cluster 2024-09-16T11:43:41.462689+0000 mgr.a (mgr.14373) 15849 : cluster [DBG] pgmap v10993: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:43:42.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:43:42 smithi047 bash[22744]: audit 2024-09-16T11:43:41.498629+0000 mgr.a (mgr.14373) 15850 : audit [DBG] from='client.341982 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:43:43.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:43:42 smithi157 bash[24585]: cluster 2024-09-16T11:43:41.462689+0000 mgr.a (mgr.14373) 15849 : cluster [DBG] pgmap v10993: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:43:43.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:43:42 smithi157 bash[24585]: audit 2024-09-16T11:43:41.498629+0000 mgr.a (mgr.14373) 15850 : audit [DBG] from='client.341982 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:43:43.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:43:42 smithi086 bash[24289]: cluster 2024-09-16T11:43:41.462689+0000 mgr.a (mgr.14373) 15849 : cluster [DBG] pgmap v10993: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:43:43.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:43:42 smithi086 bash[24289]: audit 2024-09-16T11:43:41.498629+0000 mgr.a (mgr.14373) 15850 : audit [DBG] from='client.341982 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:43:45.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:43:44 smithi157 bash[24585]: cluster 2024-09-16T11:43:43.465033+0000 mgr.a (mgr.14373) 15851 : cluster [DBG] pgmap v10994: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-16T11:43:45.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:43:44 smithi086 bash[24289]: cluster 2024-09-16T11:43:43.465033+0000 mgr.a (mgr.14373) 15851 : cluster [DBG] pgmap v10994: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-16T11:43:45.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:43:44 smithi047 bash[22744]: cluster 2024-09-16T11:43:43.465033+0000 mgr.a (mgr.14373) 15851 : cluster [DBG] pgmap v10994: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-16T11:43:46.941 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:43:46.942 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:43:46.942 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:43:47.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:43:46 smithi157 bash[24585]: cluster 2024-09-16T11:43:45.465870+0000 mgr.a (mgr.14373) 15852 : cluster [DBG] pgmap v10995: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:43:47.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:43:46 smithi086 bash[24289]: cluster 2024-09-16T11:43:45.465870+0000 mgr.a (mgr.14373) 15852 : cluster [DBG] pgmap v10995: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:43:47.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:43:46 smithi047 bash[22744]: cluster 2024-09-16T11:43:45.465870+0000 mgr.a (mgr.14373) 15852 : cluster [DBG] pgmap v10995: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:43:47.731 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:43:47.731 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:43:47.731 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:43:47.732 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:43:47.732 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:43:48.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:43:47 smithi157 bash[24585]: audit 2024-09-16T11:43:47.274795+0000 mgr.a (mgr.14373) 15853 : audit [DBG] from='client.342060 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:43:48.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:43:47 smithi086 bash[24289]: audit 2024-09-16T11:43:47.274795+0000 mgr.a (mgr.14373) 15853 : audit [DBG] from='client.342060 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:43:48.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:43:47 smithi047 bash[22744]: audit 2024-09-16T11:43:47.274795+0000 mgr.a (mgr.14373) 15853 : audit [DBG] from='client.342060 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:43:49.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:43:48 smithi157 bash[24585]: cluster 2024-09-16T11:43:47.467357+0000 mgr.a (mgr.14373) 15854 : cluster [DBG] pgmap v10996: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:43:49.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:43:48 smithi086 bash[24289]: cluster 2024-09-16T11:43:47.467357+0000 mgr.a (mgr.14373) 15854 : cluster [DBG] pgmap v10996: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:43:49.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:43:48 smithi047 bash[22744]: cluster 2024-09-16T11:43:47.467357+0000 mgr.a (mgr.14373) 15854 : cluster [DBG] pgmap v10996: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:43:51.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:43:50 smithi157 bash[24585]: cluster 2024-09-16T11:43:49.468185+0000 mgr.a (mgr.14373) 15855 : cluster [DBG] pgmap v10997: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:43:51.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:43:50 smithi086 bash[24289]: cluster 2024-09-16T11:43:49.468185+0000 mgr.a (mgr.14373) 15855 : cluster [DBG] pgmap v10997: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:43:51.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:43:50 smithi047 bash[22744]: cluster 2024-09-16T11:43:49.468185+0000 mgr.a (mgr.14373) 15855 : cluster [DBG] pgmap v10997: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:43:52.733 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:43:52.734 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:43:52.734 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:43:53.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:43:52 smithi157 bash[24585]: cluster 2024-09-16T11:43:51.470014+0000 mgr.a (mgr.14373) 15856 : cluster [DBG] pgmap v10998: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T11:43:53.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:43:52 smithi086 bash[24289]: cluster 2024-09-16T11:43:51.470014+0000 mgr.a (mgr.14373) 15856 : cluster [DBG] pgmap v10998: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T11:43:53.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:43:52 smithi047 bash[22744]: cluster 2024-09-16T11:43:51.470014+0000 mgr.a (mgr.14373) 15856 : cluster [DBG] pgmap v10998: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T11:43:53.521 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:43:53.521 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:43:53.521 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:43:53.521 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:43:53.522 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:43:54.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:43:53 smithi157 bash[24585]: audit 2024-09-16T11:43:53.073106+0000 mgr.a (mgr.14373) 15857 : audit [DBG] from='client.342138 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:43:54.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:43:53 smithi086 bash[24289]: audit 2024-09-16T11:43:53.073106+0000 mgr.a (mgr.14373) 15857 : audit [DBG] from='client.342138 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:43:54.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:43:53 smithi047 bash[22744]: audit 2024-09-16T11:43:53.073106+0000 mgr.a (mgr.14373) 15857 : audit [DBG] from='client.342138 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:43:55.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:43:54 smithi157 bash[24585]: cluster 2024-09-16T11:43:53.471021+0000 mgr.a (mgr.14373) 15858 : cluster [DBG] pgmap v10999: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:43:55.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:43:54 smithi086 bash[24289]: cluster 2024-09-16T11:43:53.471021+0000 mgr.a (mgr.14373) 15858 : cluster [DBG] pgmap v10999: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:43:55.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:43:54 smithi047 bash[22744]: cluster 2024-09-16T11:43:53.471021+0000 mgr.a (mgr.14373) 15858 : cluster [DBG] pgmap v10999: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:43:57.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:43:56 smithi157 bash[24585]: cluster 2024-09-16T11:43:55.471805+0000 mgr.a (mgr.14373) 15859 : cluster [DBG] pgmap v11000: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:43:57.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:43:56 smithi086 bash[24289]: cluster 2024-09-16T11:43:55.471805+0000 mgr.a (mgr.14373) 15859 : cluster [DBG] pgmap v11000: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:43:57.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:43:56 smithi047 bash[22744]: cluster 2024-09-16T11:43:55.471805+0000 mgr.a (mgr.14373) 15859 : cluster [DBG] pgmap v11000: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:43:58.523 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:43:58.523 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:43:58.523 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:43:59.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:43:58 smithi157 bash[24585]: cluster 2024-09-16T11:43:57.473828+0000 mgr.a (mgr.14373) 15860 : cluster [DBG] pgmap v11001: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:43:59.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:43:58 smithi086 bash[24289]: cluster 2024-09-16T11:43:57.473828+0000 mgr.a (mgr.14373) 15860 : cluster [DBG] pgmap v11001: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:43:59.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:43:58 smithi047 bash[22744]: cluster 2024-09-16T11:43:57.473828+0000 mgr.a (mgr.14373) 15860 : cluster [DBG] pgmap v11001: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:43:59.295 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:43:59.295 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:43:59.295 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:43:59.295 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:43:59.295 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:44:00.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:43:59 smithi157 bash[24585]: audit 2024-09-16T11:43:58.858821+0000 mgr.a (mgr.14373) 15861 : audit [DBG] from='client.342216 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:44:00.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:43:59 smithi086 bash[24289]: audit 2024-09-16T11:43:58.858821+0000 mgr.a (mgr.14373) 15861 : audit [DBG] from='client.342216 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:44:00.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:43:59 smithi047 bash[22744]: audit 2024-09-16T11:43:58.858821+0000 mgr.a (mgr.14373) 15861 : audit [DBG] from='client.342216 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:44:01.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:44:00 smithi157 bash[24585]: cluster 2024-09-16T11:43:59.474788+0000 mgr.a (mgr.14373) 15862 : cluster [DBG] pgmap v11002: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:44:01.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:44:00 smithi086 bash[24289]: cluster 2024-09-16T11:43:59.474788+0000 mgr.a (mgr.14373) 15862 : cluster [DBG] pgmap v11002: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:44:01.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:44:00 smithi047 bash[22744]: cluster 2024-09-16T11:43:59.474788+0000 mgr.a (mgr.14373) 15862 : cluster [DBG] pgmap v11002: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:44:03.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:44:02 smithi157 bash[24585]: cluster 2024-09-16T11:44:01.476595+0000 mgr.a (mgr.14373) 15863 : cluster [DBG] pgmap v11003: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-16T11:44:03.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:44:02 smithi086 bash[24289]: cluster 2024-09-16T11:44:01.476595+0000 mgr.a (mgr.14373) 15863 : cluster [DBG] pgmap v11003: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-16T11:44:03.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:44:02 smithi047 bash[22744]: cluster 2024-09-16T11:44:01.476595+0000 mgr.a (mgr.14373) 15863 : cluster [DBG] pgmap v11003: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-16T11:44:04.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:44:03 smithi157 bash[24585]: audit 2024-09-16T11:44:03.189889+0000 mon.b (mon.2) 1442 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T11:44:04.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:44:03 smithi086 bash[24289]: audit 2024-09-16T11:44:03.189889+0000 mon.b (mon.2) 1442 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T11:44:04.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:44:03 smithi047 bash[22744]: audit 2024-09-16T11:44:03.189889+0000 mon.b (mon.2) 1442 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T11:44:04.296 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:44:04.297 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:44:04.297 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:44:05.056 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:44:05.056 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:44:05.056 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:44:05.057 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:44:05.057 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:44:05.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:44:04 smithi157 bash[24585]: cluster 2024-09-16T11:44:03.477853+0000 mgr.a (mgr.14373) 15864 : cluster [DBG] pgmap v11004: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.4 KiB/s rd, 2 op/s 2024-09-16T11:44:05.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:44:04 smithi086 bash[24289]: cluster 2024-09-16T11:44:03.477853+0000 mgr.a (mgr.14373) 15864 : cluster [DBG] pgmap v11004: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.4 KiB/s rd, 2 op/s 2024-09-16T11:44:05.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:44:04 smithi047 bash[22744]: cluster 2024-09-16T11:44:03.477853+0000 mgr.a (mgr.14373) 15864 : cluster [DBG] pgmap v11004: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.4 KiB/s rd, 2 op/s 2024-09-16T11:44:06.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:44:05 smithi157 bash[24585]: audit 2024-09-16T11:44:04.627588+0000 mgr.a (mgr.14373) 15865 : audit [DBG] from='client.342291 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:44:06.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:44:05 smithi086 bash[24289]: audit 2024-09-16T11:44:04.627588+0000 mgr.a (mgr.14373) 15865 : audit [DBG] from='client.342291 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:44:06.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:44:05 smithi047 bash[22744]: audit 2024-09-16T11:44:04.627588+0000 mgr.a (mgr.14373) 15865 : audit [DBG] from='client.342291 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:44:07.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:44:06 smithi157 bash[24585]: cluster 2024-09-16T11:44:05.478834+0000 mgr.a (mgr.14373) 15866 : cluster [DBG] pgmap v11005: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:44:07.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:44:06 smithi086 bash[24289]: cluster 2024-09-16T11:44:05.478834+0000 mgr.a (mgr.14373) 15866 : cluster [DBG] pgmap v11005: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:44:07.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:44:06 smithi047 bash[22744]: cluster 2024-09-16T11:44:05.478834+0000 mgr.a (mgr.14373) 15866 : cluster [DBG] pgmap v11005: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:44:09.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:44:08 smithi157 bash[24585]: cluster 2024-09-16T11:44:07.481118+0000 mgr.a (mgr.14373) 15867 : cluster [DBG] pgmap v11006: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:44:09.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:44:08 smithi086 bash[24289]: cluster 2024-09-16T11:44:07.481118+0000 mgr.a (mgr.14373) 15867 : cluster [DBG] pgmap v11006: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:44:09.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:44:08 smithi047 bash[22744]: cluster 2024-09-16T11:44:07.481118+0000 mgr.a (mgr.14373) 15867 : cluster [DBG] pgmap v11006: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:44:10.058 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:44:10.059 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:44:10.059 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:44:10.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:44:10 smithi157 bash[24585]: cluster 2024-09-16T11:44:09.481918+0000 mgr.a (mgr.14373) 15868 : cluster [DBG] pgmap v11007: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:44:10.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:44:10 smithi157 bash[24585]: audit 2024-09-16T11:44:10.388383+0000 mgr.a (mgr.14373) 15869 : audit [DBG] from='client.342366 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:44:10.822 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:44:10.822 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:44:10.822 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:44:10.823 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:44:10.823 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:44:11.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:44:10 smithi086 bash[24289]: cluster 2024-09-16T11:44:09.481918+0000 mgr.a (mgr.14373) 15868 : cluster [DBG] pgmap v11007: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:44:11.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:44:10 smithi086 bash[24289]: audit 2024-09-16T11:44:10.388383+0000 mgr.a (mgr.14373) 15869 : audit [DBG] from='client.342366 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:44:11.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:44:10 smithi047 bash[22744]: cluster 2024-09-16T11:44:09.481918+0000 mgr.a (mgr.14373) 15868 : cluster [DBG] pgmap v11007: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:44:11.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:44:10 smithi047 bash[22744]: audit 2024-09-16T11:44:10.388383+0000 mgr.a (mgr.14373) 15869 : audit [DBG] from='client.342366 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:44:13.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:44:12 smithi157 bash[24585]: cluster 2024-09-16T11:44:11.483955+0000 mgr.a (mgr.14373) 15870 : cluster [DBG] pgmap v11008: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-16T11:44:13.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:44:12 smithi086 bash[24289]: cluster 2024-09-16T11:44:11.483955+0000 mgr.a (mgr.14373) 15870 : cluster [DBG] pgmap v11008: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-16T11:44:13.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:44:12 smithi047 bash[22744]: cluster 2024-09-16T11:44:11.483955+0000 mgr.a (mgr.14373) 15870 : cluster [DBG] pgmap v11008: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-16T11:44:15.093 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 11:44:14 smithi047 bash[22994]: debug 2024-09-16T11:44:14.738+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T11:44:15.093 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 11:44:14 smithi047 bash[22994]: debug 2024-09-16T11:44:14.742+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T11:44:15.094 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:44:14 smithi047 bash[22744]: cluster 2024-09-16T11:44:13.485204+0000 mgr.a (mgr.14373) 15871 : cluster [DBG] pgmap v11009: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.4 KiB/s rd, 2 op/s 2024-09-16T11:44:15.094 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:44:14 smithi047 bash[22744]: audit 2024-09-16T11:44:13.910242+0000 mon.a (mon.0) 1513 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:44:15.094 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:44:14 smithi047 bash[22744]: audit 2024-09-16T11:44:13.921951+0000 mon.a (mon.0) 1514 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:44:15.094 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:44:14 smithi047 bash[22744]: audit 2024-09-16T11:44:13.925770+0000 mon.b (mon.2) 1443 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T11:44:15.094 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:44:14 smithi047 bash[22744]: audit 2024-09-16T11:44:13.928363+0000 mon.b (mon.2) 1444 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T11:44:15.095 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:44:14 smithi047 bash[22744]: audit 2024-09-16T11:44:13.940325+0000 mon.a (mon.0) 1515 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:44:15.095 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:44:14 smithi047 bash[22744]: audit 2024-09-16T11:44:13.947256+0000 mon.b (mon.2) 1445 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:44:15.095 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:44:14 smithi047 bash[22744]: audit 2024-09-16T11:44:13.949997+0000 mgr.a (mgr.14373) 15872 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:44:15.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:44:14 smithi157 bash[24585]: cluster 2024-09-16T11:44:13.485204+0000 mgr.a (mgr.14373) 15871 : cluster [DBG] pgmap v11009: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.4 KiB/s rd, 2 op/s 2024-09-16T11:44:15.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:44:14 smithi157 bash[24585]: audit 2024-09-16T11:44:13.910242+0000 mon.a (mon.0) 1513 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:44:15.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:44:14 smithi157 bash[24585]: audit 2024-09-16T11:44:13.921951+0000 mon.a (mon.0) 1514 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:44:15.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:44:14 smithi157 bash[24585]: audit 2024-09-16T11:44:13.925770+0000 mon.b (mon.2) 1443 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T11:44:15.308 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:44:14 smithi157 bash[24585]: audit 2024-09-16T11:44:13.928363+0000 mon.b (mon.2) 1444 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T11:44:15.308 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:44:14 smithi157 bash[24585]: audit 2024-09-16T11:44:13.940325+0000 mon.a (mon.0) 1515 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:44:15.308 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:44:14 smithi157 bash[24585]: audit 2024-09-16T11:44:13.947256+0000 mon.b (mon.2) 1445 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:44:15.308 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:44:14 smithi157 bash[24585]: audit 2024-09-16T11:44:13.949997+0000 mgr.a (mgr.14373) 15872 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:44:15.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:44:14 smithi086 bash[24289]: cluster 2024-09-16T11:44:13.485204+0000 mgr.a (mgr.14373) 15871 : cluster [DBG] pgmap v11009: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.4 KiB/s rd, 2 op/s 2024-09-16T11:44:15.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:44:14 smithi086 bash[24289]: audit 2024-09-16T11:44:13.910242+0000 mon.a (mon.0) 1513 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:44:15.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:44:14 smithi086 bash[24289]: audit 2024-09-16T11:44:13.921951+0000 mon.a (mon.0) 1514 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:44:15.322 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:44:14 smithi086 bash[24289]: audit 2024-09-16T11:44:13.925770+0000 mon.b (mon.2) 1443 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T11:44:15.322 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:44:14 smithi086 bash[24289]: audit 2024-09-16T11:44:13.928363+0000 mon.b (mon.2) 1444 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T11:44:15.322 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:44:14 smithi086 bash[24289]: audit 2024-09-16T11:44:13.940325+0000 mon.a (mon.0) 1515 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:44:15.322 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:44:14 smithi086 bash[24289]: audit 2024-09-16T11:44:13.947256+0000 mon.b (mon.2) 1445 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:44:15.322 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:44:14 smithi086 bash[24289]: audit 2024-09-16T11:44:13.949997+0000 mgr.a (mgr.14373) 15872 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:44:15.823 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:44:15.824 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:44:15.824 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:44:16.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:44:15 smithi157 bash[24585]: audit 2024-09-16T11:44:14.741504+0000 mgr.a (mgr.14373) 15873 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T11:44:16.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:44:15 smithi157 bash[24585]: cephadm 2024-09-16T11:44:14.743754+0000 mgr.a (mgr.14373) 15874 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T11:44:16.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:44:15 smithi086 bash[24289]: audit 2024-09-16T11:44:14.741504+0000 mgr.a (mgr.14373) 15873 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T11:44:16.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:44:15 smithi086 bash[24289]: cephadm 2024-09-16T11:44:14.743754+0000 mgr.a (mgr.14373) 15874 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T11:44:16.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:44:15 smithi047 bash[22744]: audit 2024-09-16T11:44:14.741504+0000 mgr.a (mgr.14373) 15873 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T11:44:16.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:44:15 smithi047 bash[22744]: cephadm 2024-09-16T11:44:14.743754+0000 mgr.a (mgr.14373) 15874 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T11:44:16.598 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:44:16.598 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:44:16.598 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:44:16.598 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:44:16.598 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:44:17.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:44:16 smithi157 bash[24585]: cluster 2024-09-16T11:44:15.486304+0000 mgr.a (mgr.14373) 15875 : cluster [DBG] pgmap v11010: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:44:17.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:44:16 smithi157 bash[24585]: audit 2024-09-16T11:44:16.151963+0000 mgr.a (mgr.14373) 15876 : audit [DBG] from='client.342552 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:44:17.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:44:16 smithi086 bash[24289]: cluster 2024-09-16T11:44:15.486304+0000 mgr.a (mgr.14373) 15875 : cluster [DBG] pgmap v11010: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:44:17.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:44:16 smithi086 bash[24289]: audit 2024-09-16T11:44:16.151963+0000 mgr.a (mgr.14373) 15876 : audit [DBG] from='client.342552 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:44:17.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:44:16 smithi047 bash[22744]: cluster 2024-09-16T11:44:15.486304+0000 mgr.a (mgr.14373) 15875 : cluster [DBG] pgmap v11010: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:44:17.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:44:16 smithi047 bash[22744]: audit 2024-09-16T11:44:16.151963+0000 mgr.a (mgr.14373) 15876 : audit [DBG] from='client.342552 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:44:19.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:44:18 smithi157 bash[24585]: cluster 2024-09-16T11:44:17.488868+0000 mgr.a (mgr.14373) 15877 : cluster [DBG] pgmap v11011: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:44:19.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:44:18 smithi086 bash[24289]: cluster 2024-09-16T11:44:17.488868+0000 mgr.a (mgr.14373) 15877 : cluster [DBG] pgmap v11011: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:44:19.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:44:18 smithi047 bash[22744]: cluster 2024-09-16T11:44:17.488868+0000 mgr.a (mgr.14373) 15877 : cluster [DBG] pgmap v11011: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:44:21.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:44:20 smithi157 bash[24585]: cluster 2024-09-16T11:44:19.489651+0000 mgr.a (mgr.14373) 15878 : cluster [DBG] pgmap v11012: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T11:44:21.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:44:20 smithi086 bash[24289]: cluster 2024-09-16T11:44:19.489651+0000 mgr.a (mgr.14373) 15878 : cluster [DBG] pgmap v11012: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T11:44:21.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:44:20 smithi047 bash[22744]: cluster 2024-09-16T11:44:19.489651+0000 mgr.a (mgr.14373) 15878 : cluster [DBG] pgmap v11012: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T11:44:21.599 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:44:21.600 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:44:21.600 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:44:22.342 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:44:22.343 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:44:22.343 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:44:22.343 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:44:22.343 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:44:23.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:44:22 smithi157 bash[24585]: cluster 2024-09-16T11:44:21.491616+0000 mgr.a (mgr.14373) 15879 : cluster [DBG] pgmap v11013: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:44:23.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:44:22 smithi157 bash[24585]: audit 2024-09-16T11:44:21.926820+0000 mgr.a (mgr.14373) 15880 : audit [DBG] from='client.342627 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:44:23.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:44:22 smithi086 bash[24289]: cluster 2024-09-16T11:44:21.491616+0000 mgr.a (mgr.14373) 15879 : cluster [DBG] pgmap v11013: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:44:23.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:44:22 smithi086 bash[24289]: audit 2024-09-16T11:44:21.926820+0000 mgr.a (mgr.14373) 15880 : audit [DBG] from='client.342627 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:44:23.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:44:22 smithi047 bash[22744]: cluster 2024-09-16T11:44:21.491616+0000 mgr.a (mgr.14373) 15879 : cluster [DBG] pgmap v11013: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:44:23.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:44:22 smithi047 bash[22744]: audit 2024-09-16T11:44:21.926820+0000 mgr.a (mgr.14373) 15880 : audit [DBG] from='client.342627 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:44:25.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:44:24 smithi157 bash[24585]: cluster 2024-09-16T11:44:23.492599+0000 mgr.a (mgr.14373) 15881 : cluster [DBG] pgmap v11014: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T11:44:25.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:44:24 smithi086 bash[24289]: cluster 2024-09-16T11:44:23.492599+0000 mgr.a (mgr.14373) 15881 : cluster [DBG] pgmap v11014: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T11:44:25.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:44:24 smithi047 bash[22744]: cluster 2024-09-16T11:44:23.492599+0000 mgr.a (mgr.14373) 15881 : cluster [DBG] pgmap v11014: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T11:44:27.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:44:26 smithi157 bash[24585]: cluster 2024-09-16T11:44:25.493390+0000 mgr.a (mgr.14373) 15882 : cluster [DBG] pgmap v11015: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T11:44:27.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:44:26 smithi086 bash[24289]: cluster 2024-09-16T11:44:25.493390+0000 mgr.a (mgr.14373) 15882 : cluster [DBG] pgmap v11015: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T11:44:27.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:44:26 smithi047 bash[22744]: cluster 2024-09-16T11:44:25.493390+0000 mgr.a (mgr.14373) 15882 : cluster [DBG] pgmap v11015: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T11:44:27.344 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:44:27.345 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:44:27.345 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:44:28.102 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:44:28.102 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:44:28.102 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:44:28.102 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:44:28.102 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:44:29.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:44:28 smithi157 bash[24585]: cluster 2024-09-16T11:44:27.494782+0000 mgr.a (mgr.14373) 15883 : cluster [DBG] pgmap v11016: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:44:29.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:44:28 smithi157 bash[24585]: audit 2024-09-16T11:44:27.674440+0000 mgr.a (mgr.14373) 15884 : audit [DBG] from='client.342699 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:44:29.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:44:28 smithi086 bash[24289]: cluster 2024-09-16T11:44:27.494782+0000 mgr.a (mgr.14373) 15883 : cluster [DBG] pgmap v11016: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:44:29.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:44:28 smithi086 bash[24289]: audit 2024-09-16T11:44:27.674440+0000 mgr.a (mgr.14373) 15884 : audit [DBG] from='client.342699 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:44:29.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:44:28 smithi047 bash[22744]: cluster 2024-09-16T11:44:27.494782+0000 mgr.a (mgr.14373) 15883 : cluster [DBG] pgmap v11016: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:44:29.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:44:28 smithi047 bash[22744]: audit 2024-09-16T11:44:27.674440+0000 mgr.a (mgr.14373) 15884 : audit [DBG] from='client.342699 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:44:31.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:44:30 smithi157 bash[24585]: cluster 2024-09-16T11:44:29.495639+0000 mgr.a (mgr.14373) 15885 : cluster [DBG] pgmap v11017: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-16T11:44:31.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:44:30 smithi086 bash[24289]: cluster 2024-09-16T11:44:29.495639+0000 mgr.a (mgr.14373) 15885 : cluster [DBG] pgmap v11017: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-16T11:44:31.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:44:30 smithi047 bash[22744]: cluster 2024-09-16T11:44:29.495639+0000 mgr.a (mgr.14373) 15885 : cluster [DBG] pgmap v11017: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-16T11:44:33.104 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:44:33.104 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:44:33.105 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:44:33.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:44:32 smithi157 bash[24585]: cluster 2024-09-16T11:44:31.497764+0000 mgr.a (mgr.14373) 15886 : cluster [DBG] pgmap v11018: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-16T11:44:33.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:44:32 smithi086 bash[24289]: cluster 2024-09-16T11:44:31.497764+0000 mgr.a (mgr.14373) 15886 : cluster [DBG] pgmap v11018: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-16T11:44:33.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:44:32 smithi047 bash[22744]: cluster 2024-09-16T11:44:31.497764+0000 mgr.a (mgr.14373) 15886 : cluster [DBG] pgmap v11018: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-16T11:44:33.850 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:44:33.851 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:44:33.851 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:44:33.851 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:44:33.851 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:44:34.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:44:33 smithi157 bash[24585]: audit 2024-09-16T11:44:33.433066+0000 mgr.a (mgr.14373) 15887 : audit [DBG] from='client.342777 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:44:34.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:44:33 smithi086 bash[24289]: audit 2024-09-16T11:44:33.433066+0000 mgr.a (mgr.14373) 15887 : audit [DBG] from='client.342777 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:44:34.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:44:33 smithi047 bash[22744]: audit 2024-09-16T11:44:33.433066+0000 mgr.a (mgr.14373) 15887 : audit [DBG] from='client.342777 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:44:35.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:44:34 smithi157 bash[24585]: cluster 2024-09-16T11:44:33.498276+0000 mgr.a (mgr.14373) 15888 : cluster [DBG] pgmap v11019: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:44:35.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:44:34 smithi086 bash[24289]: cluster 2024-09-16T11:44:33.498276+0000 mgr.a (mgr.14373) 15888 : cluster [DBG] pgmap v11019: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:44:35.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:44:34 smithi047 bash[22744]: cluster 2024-09-16T11:44:33.498276+0000 mgr.a (mgr.14373) 15888 : cluster [DBG] pgmap v11019: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:44:37.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:44:36 smithi157 bash[24585]: cluster 2024-09-16T11:44:35.499174+0000 mgr.a (mgr.14373) 15889 : cluster [DBG] pgmap v11020: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:44:37.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:44:36 smithi086 bash[24289]: cluster 2024-09-16T11:44:35.499174+0000 mgr.a (mgr.14373) 15889 : cluster [DBG] pgmap v11020: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:44:37.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:44:36 smithi047 bash[22744]: cluster 2024-09-16T11:44:35.499174+0000 mgr.a (mgr.14373) 15889 : cluster [DBG] pgmap v11020: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:44:38.852 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:44:38.853 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:44:38.853 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:44:39.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:44:38 smithi157 bash[24585]: cluster 2024-09-16T11:44:37.501422+0000 mgr.a (mgr.14373) 15890 : cluster [DBG] pgmap v11021: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:44:39.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:44:38 smithi086 bash[24289]: cluster 2024-09-16T11:44:37.501422+0000 mgr.a (mgr.14373) 15890 : cluster [DBG] pgmap v11021: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:44:39.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:44:38 smithi047 bash[22744]: cluster 2024-09-16T11:44:37.501422+0000 mgr.a (mgr.14373) 15890 : cluster [DBG] pgmap v11021: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:44:39.605 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:44:39.606 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:44:39.606 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:44:39.606 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:44:39.606 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:44:40.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:44:39 smithi157 bash[24585]: audit 2024-09-16T11:44:39.185098+0000 mgr.a (mgr.14373) 15891 : audit [DBG] from='client.342855 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:44:40.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:44:39 smithi086 bash[24289]: audit 2024-09-16T11:44:39.185098+0000 mgr.a (mgr.14373) 15891 : audit [DBG] from='client.342855 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:44:40.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:44:39 smithi047 bash[22744]: audit 2024-09-16T11:44:39.185098+0000 mgr.a (mgr.14373) 15891 : audit [DBG] from='client.342855 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:44:41.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:44:40 smithi157 bash[24585]: cluster 2024-09-16T11:44:39.506297+0000 mgr.a (mgr.14373) 15892 : cluster [DBG] pgmap v11022: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:44:41.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:44:40 smithi086 bash[24289]: cluster 2024-09-16T11:44:39.506297+0000 mgr.a (mgr.14373) 15892 : cluster [DBG] pgmap v11022: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:44:41.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:44:40 smithi047 bash[22744]: cluster 2024-09-16T11:44:39.506297+0000 mgr.a (mgr.14373) 15892 : cluster [DBG] pgmap v11022: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:44:43.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:44:42 smithi157 bash[24585]: cluster 2024-09-16T11:44:41.508491+0000 mgr.a (mgr.14373) 15893 : cluster [DBG] pgmap v11023: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:44:43.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:44:42 smithi086 bash[24289]: cluster 2024-09-16T11:44:41.508491+0000 mgr.a (mgr.14373) 15893 : cluster [DBG] pgmap v11023: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:44:43.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:44:42 smithi047 bash[22744]: cluster 2024-09-16T11:44:41.508491+0000 mgr.a (mgr.14373) 15893 : cluster [DBG] pgmap v11023: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:44:44.607 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:44:44.608 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:44:44.608 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:44:45.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:44:44 smithi157 bash[24585]: cluster 2024-09-16T11:44:43.509252+0000 mgr.a (mgr.14373) 15894 : cluster [DBG] pgmap v11024: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:44:45.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:44:44 smithi086 bash[24289]: cluster 2024-09-16T11:44:43.509252+0000 mgr.a (mgr.14373) 15894 : cluster [DBG] pgmap v11024: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:44:45.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:44:44 smithi047 bash[22744]: cluster 2024-09-16T11:44:43.509252+0000 mgr.a (mgr.14373) 15894 : cluster [DBG] pgmap v11024: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:44:45.401 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:44:45.401 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:44:45.401 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:44:45.401 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:44:45.401 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:44:46.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:44:46 smithi157 bash[24585]: audit 2024-09-16T11:44:44.941634+0000 mgr.a (mgr.14373) 15895 : audit [DBG] from='client.342933 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:44:46.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:44:46 smithi086 bash[24289]: audit 2024-09-16T11:44:44.941634+0000 mgr.a (mgr.14373) 15895 : audit [DBG] from='client.342933 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:44:46.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:44:46 smithi047 bash[22744]: audit 2024-09-16T11:44:44.941634+0000 mgr.a (mgr.14373) 15895 : audit [DBG] from='client.342933 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:44:47.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:44:47 smithi157 bash[24585]: cluster 2024-09-16T11:44:45.510218+0000 mgr.a (mgr.14373) 15896 : cluster [DBG] pgmap v11025: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:44:47.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:44:47 smithi086 bash[24289]: cluster 2024-09-16T11:44:45.510218+0000 mgr.a (mgr.14373) 15896 : cluster [DBG] pgmap v11025: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:44:47.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:44:47 smithi047 bash[22744]: cluster 2024-09-16T11:44:45.510218+0000 mgr.a (mgr.14373) 15896 : cluster [DBG] pgmap v11025: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:44:49.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:44:49 smithi157 bash[24585]: cluster 2024-09-16T11:44:47.512496+0000 mgr.a (mgr.14373) 15897 : cluster [DBG] pgmap v11026: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:44:49.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:44:49 smithi086 bash[24289]: cluster 2024-09-16T11:44:47.512496+0000 mgr.a (mgr.14373) 15897 : cluster [DBG] pgmap v11026: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:44:49.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:44:49 smithi047 bash[22744]: cluster 2024-09-16T11:44:47.512496+0000 mgr.a (mgr.14373) 15897 : cluster [DBG] pgmap v11026: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:44:50.402 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:44:50.403 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:44:50.403 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:44:51.179 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:44:51.179 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:44:51.179 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:44:51.179 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:44:51.180 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:44:51.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:44:51 smithi157 bash[24585]: cluster 2024-09-16T11:44:49.513254+0000 mgr.a (mgr.14373) 15898 : cluster [DBG] pgmap v11027: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:44:51.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:44:51 smithi086 bash[24289]: cluster 2024-09-16T11:44:49.513254+0000 mgr.a (mgr.14373) 15898 : cluster [DBG] pgmap v11027: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:44:51.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:44:51 smithi047 bash[22744]: cluster 2024-09-16T11:44:49.513254+0000 mgr.a (mgr.14373) 15898 : cluster [DBG] pgmap v11027: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:44:52.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:44:52 smithi157 bash[24585]: audit 2024-09-16T11:44:50.735739+0000 mgr.a (mgr.14373) 15899 : audit [DBG] from='client.343011 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:44:52.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:44:52 smithi086 bash[24289]: audit 2024-09-16T11:44:50.735739+0000 mgr.a (mgr.14373) 15899 : audit [DBG] from='client.343011 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:44:52.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:44:52 smithi047 bash[22744]: audit 2024-09-16T11:44:50.735739+0000 mgr.a (mgr.14373) 15899 : audit [DBG] from='client.343011 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:44:53.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:44:53 smithi157 bash[24585]: cluster 2024-09-16T11:44:51.515606+0000 mgr.a (mgr.14373) 15900 : cluster [DBG] pgmap v11028: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:44:53.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:44:53 smithi086 bash[24289]: cluster 2024-09-16T11:44:51.515606+0000 mgr.a (mgr.14373) 15900 : cluster [DBG] pgmap v11028: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:44:53.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:44:53 smithi047 bash[22744]: cluster 2024-09-16T11:44:51.515606+0000 mgr.a (mgr.14373) 15900 : cluster [DBG] pgmap v11028: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:44:55.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:44:55 smithi157 bash[24585]: cluster 2024-09-16T11:44:53.516407+0000 mgr.a (mgr.14373) 15901 : cluster [DBG] pgmap v11029: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:44:55.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:44:55 smithi086 bash[24289]: cluster 2024-09-16T11:44:53.516407+0000 mgr.a (mgr.14373) 15901 : cluster [DBG] pgmap v11029: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:44:55.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:44:55 smithi047 bash[22744]: cluster 2024-09-16T11:44:53.516407+0000 mgr.a (mgr.14373) 15901 : cluster [DBG] pgmap v11029: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:44:56.180 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:44:56.181 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:44:56.181 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:44:56.953 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:44:56.953 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:44:56.953 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:44:56.953 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:44:56.953 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:44:57.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:44:57 smithi157 bash[24585]: cluster 2024-09-16T11:44:55.517203+0000 mgr.a (mgr.14373) 15902 : cluster [DBG] pgmap v11030: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:44:57.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:44:57 smithi086 bash[24289]: cluster 2024-09-16T11:44:55.517203+0000 mgr.a (mgr.14373) 15902 : cluster [DBG] pgmap v11030: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:44:57.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:44:57 smithi047 bash[22744]: cluster 2024-09-16T11:44:55.517203+0000 mgr.a (mgr.14373) 15902 : cluster [DBG] pgmap v11030: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:44:58.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:44:58 smithi157 bash[24585]: audit 2024-09-16T11:44:56.517697+0000 mgr.a (mgr.14373) 15903 : audit [DBG] from='client.343089 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:44:58.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:44:58 smithi086 bash[24289]: audit 2024-09-16T11:44:56.517697+0000 mgr.a (mgr.14373) 15903 : audit [DBG] from='client.343089 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:44:58.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:44:58 smithi047 bash[22744]: audit 2024-09-16T11:44:56.517697+0000 mgr.a (mgr.14373) 15903 : audit [DBG] from='client.343089 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:44:59.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:44:59 smithi157 bash[24585]: cluster 2024-09-16T11:44:57.520183+0000 mgr.a (mgr.14373) 15904 : cluster [DBG] pgmap v11031: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:44:59.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:44:59 smithi086 bash[24289]: cluster 2024-09-16T11:44:57.520183+0000 mgr.a (mgr.14373) 15904 : cluster [DBG] pgmap v11031: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:44:59.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:44:59 smithi047 bash[22744]: cluster 2024-09-16T11:44:57.520183+0000 mgr.a (mgr.14373) 15904 : cluster [DBG] pgmap v11031: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:45:01.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:45:01 smithi157 bash[24585]: cluster 2024-09-16T11:44:59.521043+0000 mgr.a (mgr.14373) 15905 : cluster [DBG] pgmap v11032: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:45:01.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:45:01 smithi086 bash[24289]: cluster 2024-09-16T11:44:59.521043+0000 mgr.a (mgr.14373) 15905 : cluster [DBG] pgmap v11032: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:45:01.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:45:01 smithi047 bash[22744]: cluster 2024-09-16T11:44:59.521043+0000 mgr.a (mgr.14373) 15905 : cluster [DBG] pgmap v11032: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:45:01.955 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:45:01.955 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:45:01.955 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:45:02.750 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:45:02.750 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:45:02.750 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:45:02.750 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:45:02.751 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:45:03.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:45:03 smithi157 bash[24585]: cluster 2024-09-16T11:45:01.522966+0000 mgr.a (mgr.14373) 15906 : cluster [DBG] pgmap v11033: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:45:03.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:45:03 smithi157 bash[24585]: audit 2024-09-16T11:45:02.292174+0000 mgr.a (mgr.14373) 15907 : audit [DBG] from='client.343164 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:45:03.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:45:03 smithi086 bash[24289]: cluster 2024-09-16T11:45:01.522966+0000 mgr.a (mgr.14373) 15906 : cluster [DBG] pgmap v11033: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:45:03.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:45:03 smithi086 bash[24289]: audit 2024-09-16T11:45:02.292174+0000 mgr.a (mgr.14373) 15907 : audit [DBG] from='client.343164 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:45:03.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:45:03 smithi047 bash[22744]: cluster 2024-09-16T11:45:01.522966+0000 mgr.a (mgr.14373) 15906 : cluster [DBG] pgmap v11033: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:45:03.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:45:03 smithi047 bash[22744]: audit 2024-09-16T11:45:02.292174+0000 mgr.a (mgr.14373) 15907 : audit [DBG] from='client.343164 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:45:05.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:45:05 smithi157 bash[24585]: cluster 2024-09-16T11:45:03.523907+0000 mgr.a (mgr.14373) 15908 : cluster [DBG] pgmap v11034: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:45:05.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:45:05 smithi086 bash[24289]: cluster 2024-09-16T11:45:03.523907+0000 mgr.a (mgr.14373) 15908 : cluster [DBG] pgmap v11034: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:45:05.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:45:05 smithi047 bash[22744]: cluster 2024-09-16T11:45:03.523907+0000 mgr.a (mgr.14373) 15908 : cluster [DBG] pgmap v11034: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:45:07.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:45:07 smithi086 bash[24289]: cluster 2024-09-16T11:45:05.524710+0000 mgr.a (mgr.14373) 15909 : cluster [DBG] pgmap v11035: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T11:45:07.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:45:07 smithi047 bash[22744]: cluster 2024-09-16T11:45:05.524710+0000 mgr.a (mgr.14373) 15909 : cluster [DBG] pgmap v11035: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T11:45:07.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:45:07 smithi157 bash[24585]: cluster 2024-09-16T11:45:05.524710+0000 mgr.a (mgr.14373) 15909 : cluster [DBG] pgmap v11035: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T11:45:07.752 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:45:07.753 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:45:07.753 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:45:08.534 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:45:08.535 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:45:08.535 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:45:08.535 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:45:08.535 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:45:09.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:45:09 smithi086 bash[24289]: cluster 2024-09-16T11:45:07.527003+0000 mgr.a (mgr.14373) 15910 : cluster [DBG] pgmap v11036: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:45:09.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:45:09 smithi086 bash[24289]: audit 2024-09-16T11:45:08.089513+0000 mgr.a (mgr.14373) 15911 : audit [DBG] from='client.343242 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:45:09.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:45:09 smithi047 bash[22744]: cluster 2024-09-16T11:45:07.527003+0000 mgr.a (mgr.14373) 15910 : cluster [DBG] pgmap v11036: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:45:09.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:45:09 smithi047 bash[22744]: audit 2024-09-16T11:45:08.089513+0000 mgr.a (mgr.14373) 15911 : audit [DBG] from='client.343242 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:45:09.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:45:09 smithi157 bash[24585]: cluster 2024-09-16T11:45:07.527003+0000 mgr.a (mgr.14373) 15910 : cluster [DBG] pgmap v11036: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:45:09.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:45:09 smithi157 bash[24585]: audit 2024-09-16T11:45:08.089513+0000 mgr.a (mgr.14373) 15911 : audit [DBG] from='client.343242 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:45:11.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:45:11 smithi086 bash[24289]: cluster 2024-09-16T11:45:09.527945+0000 mgr.a (mgr.14373) 15912 : cluster [DBG] pgmap v11037: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:45:11.344 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:45:11 smithi047 bash[22744]: cluster 2024-09-16T11:45:09.527945+0000 mgr.a (mgr.14373) 15912 : cluster [DBG] pgmap v11037: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:45:11.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:45:11 smithi157 bash[24585]: cluster 2024-09-16T11:45:09.527945+0000 mgr.a (mgr.14373) 15912 : cluster [DBG] pgmap v11037: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:45:13.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:45:13 smithi047 bash[22744]: cluster 2024-09-16T11:45:11.530124+0000 mgr.a (mgr.14373) 15913 : cluster [DBG] pgmap v11038: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:45:13.536 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:45:13.537 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:45:13.537 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:45:13.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:45:13 smithi157 bash[24585]: cluster 2024-09-16T11:45:11.530124+0000 mgr.a (mgr.14373) 15913 : cluster [DBG] pgmap v11038: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:45:13.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:45:13 smithi086 bash[24289]: cluster 2024-09-16T11:45:11.530124+0000 mgr.a (mgr.14373) 15913 : cluster [DBG] pgmap v11038: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:45:14.321 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:45:14.322 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:45:14.322 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:45:14.322 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:45:14.322 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:45:15.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:45:15 smithi047 bash[22744]: cluster 2024-09-16T11:45:13.530914+0000 mgr.a (mgr.14373) 15914 : cluster [DBG] pgmap v11039: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:45:15.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:45:15 smithi047 bash[22744]: audit 2024-09-16T11:45:13.875292+0000 mgr.a (mgr.14373) 15915 : audit [DBG] from='client.343320 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:45:15.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:45:15 smithi047 bash[22744]: audit 2024-09-16T11:45:14.802497+0000 mon.b (mon.2) 1446 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T11:45:15.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:45:15 smithi157 bash[24585]: cluster 2024-09-16T11:45:13.530914+0000 mgr.a (mgr.14373) 15914 : cluster [DBG] pgmap v11039: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:45:15.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:45:15 smithi157 bash[24585]: audit 2024-09-16T11:45:13.875292+0000 mgr.a (mgr.14373) 15915 : audit [DBG] from='client.343320 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:45:15.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:45:15 smithi157 bash[24585]: audit 2024-09-16T11:45:14.802497+0000 mon.b (mon.2) 1446 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T11:45:15.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:45:15 smithi086 bash[24289]: cluster 2024-09-16T11:45:13.530914+0000 mgr.a (mgr.14373) 15914 : cluster [DBG] pgmap v11039: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:45:15.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:45:15 smithi086 bash[24289]: audit 2024-09-16T11:45:13.875292+0000 mgr.a (mgr.14373) 15915 : audit [DBG] from='client.343320 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:45:15.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:45:15 smithi086 bash[24289]: audit 2024-09-16T11:45:14.802497+0000 mon.b (mon.2) 1446 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T11:45:17.343 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 11:45:16 smithi047 bash[22994]: debug 2024-09-16T11:45:16.932+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T11:45:17.343 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 11:45:16 smithi047 bash[22994]: debug 2024-09-16T11:45:16.936+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T11:45:17.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:45:17 smithi047 bash[22744]: cluster 2024-09-16T11:45:15.531952+0000 mgr.a (mgr.14373) 15916 : cluster [DBG] pgmap v11040: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:45:17.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:45:17 smithi047 bash[22744]: audit 2024-09-16T11:45:16.108938+0000 mon.a (mon.0) 1516 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:45:17.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:45:17 smithi047 bash[22744]: audit 2024-09-16T11:45:16.117171+0000 mon.a (mon.0) 1517 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:45:17.344 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:45:17 smithi047 bash[22744]: audit 2024-09-16T11:45:16.136345+0000 mon.a (mon.0) 1518 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:45:17.344 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:45:17 smithi047 bash[22744]: audit 2024-09-16T11:45:16.140352+0000 mon.a (mon.0) 1519 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:45:17.344 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:45:17 smithi047 bash[22744]: audit 2024-09-16T11:45:16.148529+0000 mon.a (mon.0) 1520 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:45:17.344 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:45:17 smithi047 bash[22744]: audit 2024-09-16T11:45:16.154414+0000 mon.a (mon.0) 1521 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:45:17.344 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:45:17 smithi047 bash[22744]: audit 2024-09-16T11:45:16.155891+0000 mon.b (mon.2) 1447 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T11:45:17.344 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:45:17 smithi047 bash[22744]: audit 2024-09-16T11:45:16.156986+0000 mon.b (mon.2) 1448 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T11:45:17.344 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:45:17 smithi047 bash[22744]: audit 2024-09-16T11:45:16.165577+0000 mon.a (mon.0) 1522 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:45:17.344 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:45:17 smithi047 bash[22744]: audit 2024-09-16T11:45:16.170617+0000 mon.b (mon.2) 1449 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:45:17.344 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:45:17 smithi047 bash[22744]: audit 2024-09-16T11:45:16.173342+0000 mgr.a (mgr.14373) 15917 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:45:17.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:45:17 smithi157 bash[24585]: cluster 2024-09-16T11:45:15.531952+0000 mgr.a (mgr.14373) 15916 : cluster [DBG] pgmap v11040: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:45:17.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:45:17 smithi157 bash[24585]: audit 2024-09-16T11:45:16.108938+0000 mon.a (mon.0) 1516 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:45:17.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:45:17 smithi157 bash[24585]: audit 2024-09-16T11:45:16.117171+0000 mon.a (mon.0) 1517 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:45:17.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:45:17 smithi157 bash[24585]: audit 2024-09-16T11:45:16.136345+0000 mon.a (mon.0) 1518 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:45:17.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:45:17 smithi157 bash[24585]: audit 2024-09-16T11:45:16.140352+0000 mon.a (mon.0) 1519 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:45:17.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:45:17 smithi157 bash[24585]: audit 2024-09-16T11:45:16.148529+0000 mon.a (mon.0) 1520 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:45:17.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:45:17 smithi157 bash[24585]: audit 2024-09-16T11:45:16.154414+0000 mon.a (mon.0) 1521 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:45:17.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:45:17 smithi157 bash[24585]: audit 2024-09-16T11:45:16.155891+0000 mon.b (mon.2) 1447 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T11:45:17.558 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:45:17 smithi157 bash[24585]: audit 2024-09-16T11:45:16.156986+0000 mon.b (mon.2) 1448 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T11:45:17.558 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:45:17 smithi157 bash[24585]: audit 2024-09-16T11:45:16.165577+0000 mon.a (mon.0) 1522 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:45:17.558 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:45:17 smithi157 bash[24585]: audit 2024-09-16T11:45:16.170617+0000 mon.b (mon.2) 1449 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:45:17.558 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:45:17 smithi157 bash[24585]: audit 2024-09-16T11:45:16.173342+0000 mgr.a (mgr.14373) 15917 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:45:17.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:45:17 smithi086 bash[24289]: cluster 2024-09-16T11:45:15.531952+0000 mgr.a (mgr.14373) 15916 : cluster [DBG] pgmap v11040: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:45:17.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:45:17 smithi086 bash[24289]: audit 2024-09-16T11:45:16.108938+0000 mon.a (mon.0) 1516 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:45:17.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:45:17 smithi086 bash[24289]: audit 2024-09-16T11:45:16.117171+0000 mon.a (mon.0) 1517 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:45:17.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:45:17 smithi086 bash[24289]: audit 2024-09-16T11:45:16.136345+0000 mon.a (mon.0) 1518 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:45:17.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:45:17 smithi086 bash[24289]: audit 2024-09-16T11:45:16.140352+0000 mon.a (mon.0) 1519 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:45:17.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:45:17 smithi086 bash[24289]: audit 2024-09-16T11:45:16.148529+0000 mon.a (mon.0) 1520 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:45:17.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:45:17 smithi086 bash[24289]: audit 2024-09-16T11:45:16.154414+0000 mon.a (mon.0) 1521 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:45:17.572 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:45:17 smithi086 bash[24289]: audit 2024-09-16T11:45:16.155891+0000 mon.b (mon.2) 1447 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T11:45:17.572 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:45:17 smithi086 bash[24289]: audit 2024-09-16T11:45:16.156986+0000 mon.b (mon.2) 1448 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T11:45:17.572 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:45:17 smithi086 bash[24289]: audit 2024-09-16T11:45:16.165577+0000 mon.a (mon.0) 1522 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:45:17.572 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:45:17 smithi086 bash[24289]: audit 2024-09-16T11:45:16.170617+0000 mon.b (mon.2) 1449 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:45:17.572 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:45:17 smithi086 bash[24289]: audit 2024-09-16T11:45:16.173342+0000 mgr.a (mgr.14373) 15917 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:45:18.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:45:18 smithi157 bash[24585]: audit 2024-09-16T11:45:16.937623+0000 mgr.a (mgr.14373) 15918 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T11:45:18.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:45:18 smithi157 bash[24585]: cephadm 2024-09-16T11:45:16.939893+0000 mgr.a (mgr.14373) 15919 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T11:45:18.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:45:18 smithi086 bash[24289]: audit 2024-09-16T11:45:16.937623+0000 mgr.a (mgr.14373) 15918 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T11:45:18.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:45:18 smithi086 bash[24289]: cephadm 2024-09-16T11:45:16.939893+0000 mgr.a (mgr.14373) 15919 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T11:45:18.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:45:18 smithi047 bash[22744]: audit 2024-09-16T11:45:16.937623+0000 mgr.a (mgr.14373) 15918 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T11:45:18.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:45:18 smithi047 bash[22744]: cephadm 2024-09-16T11:45:16.939893+0000 mgr.a (mgr.14373) 15919 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T11:45:19.323 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:45:19.324 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:45:19.324 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:45:19.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:45:19 smithi157 bash[24585]: cluster 2024-09-16T11:45:17.534781+0000 mgr.a (mgr.14373) 15920 : cluster [DBG] pgmap v11041: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 3.9 KiB/s rd, 170 B/s wr, 3 op/s 2024-09-16T11:45:19.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:45:19 smithi086 bash[24289]: cluster 2024-09-16T11:45:17.534781+0000 mgr.a (mgr.14373) 15920 : cluster [DBG] pgmap v11041: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 3.9 KiB/s rd, 170 B/s wr, 3 op/s 2024-09-16T11:45:19.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:45:19 smithi047 bash[22744]: cluster 2024-09-16T11:45:17.534781+0000 mgr.a (mgr.14373) 15920 : cluster [DBG] pgmap v11041: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 3.9 KiB/s rd, 170 B/s wr, 3 op/s 2024-09-16T11:45:20.081 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:45:20.082 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:45:20.082 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:45:20.082 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:45:20.082 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:45:21.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:45:21 smithi157 bash[24585]: cluster 2024-09-16T11:45:19.535544+0000 mgr.a (mgr.14373) 15921 : cluster [DBG] pgmap v11042: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 3.0 KiB/s rd, 170 B/s wr, 2 op/s 2024-09-16T11:45:21.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:45:21 smithi157 bash[24585]: audit 2024-09-16T11:45:19.652218+0000 mgr.a (mgr.14373) 15922 : audit [DBG] from='client.343500 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:45:21.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:45:21 smithi086 bash[24289]: cluster 2024-09-16T11:45:19.535544+0000 mgr.a (mgr.14373) 15921 : cluster [DBG] pgmap v11042: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 3.0 KiB/s rd, 170 B/s wr, 2 op/s 2024-09-16T11:45:21.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:45:21 smithi086 bash[24289]: audit 2024-09-16T11:45:19.652218+0000 mgr.a (mgr.14373) 15922 : audit [DBG] from='client.343500 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:45:21.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:45:21 smithi047 bash[22744]: cluster 2024-09-16T11:45:19.535544+0000 mgr.a (mgr.14373) 15921 : cluster [DBG] pgmap v11042: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 3.0 KiB/s rd, 170 B/s wr, 2 op/s 2024-09-16T11:45:21.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:45:21 smithi047 bash[22744]: audit 2024-09-16T11:45:19.652218+0000 mgr.a (mgr.14373) 15922 : audit [DBG] from='client.343500 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:45:23.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:45:23 smithi157 bash[24585]: cluster 2024-09-16T11:45:21.537775+0000 mgr.a (mgr.14373) 15923 : cluster [DBG] pgmap v11043: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:45:23.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:45:23 smithi086 bash[24289]: cluster 2024-09-16T11:45:21.537775+0000 mgr.a (mgr.14373) 15923 : cluster [DBG] pgmap v11043: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:45:23.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:45:23 smithi047 bash[22744]: cluster 2024-09-16T11:45:21.537775+0000 mgr.a (mgr.14373) 15923 : cluster [DBG] pgmap v11043: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:45:25.083 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:45:25.084 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:45:25.084 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:45:25.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:45:25 smithi157 bash[24585]: cluster 2024-09-16T11:45:23.538572+0000 mgr.a (mgr.14373) 15924 : cluster [DBG] pgmap v11044: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:45:25.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:45:25 smithi086 bash[24289]: cluster 2024-09-16T11:45:23.538572+0000 mgr.a (mgr.14373) 15924 : cluster [DBG] pgmap v11044: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:45:25.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:45:25 smithi047 bash[22744]: cluster 2024-09-16T11:45:23.538572+0000 mgr.a (mgr.14373) 15924 : cluster [DBG] pgmap v11044: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:45:25.837 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:45:25.837 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:45:25.838 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:45:25.838 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:45:25.838 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:45:26.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:45:26 smithi157 bash[24585]: audit 2024-09-16T11:45:25.412339+0000 mgr.a (mgr.14373) 15925 : audit [DBG] from='client.343572 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:45:26.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:45:26 smithi086 bash[24289]: audit 2024-09-16T11:45:25.412339+0000 mgr.a (mgr.14373) 15925 : audit [DBG] from='client.343572 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:45:26.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:45:26 smithi047 bash[22744]: audit 2024-09-16T11:45:25.412339+0000 mgr.a (mgr.14373) 15925 : audit [DBG] from='client.343572 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:45:27.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:45:27 smithi157 bash[24585]: cluster 2024-09-16T11:45:25.539064+0000 mgr.a (mgr.14373) 15926 : cluster [DBG] pgmap v11045: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:45:27.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:45:27 smithi086 bash[24289]: cluster 2024-09-16T11:45:25.539064+0000 mgr.a (mgr.14373) 15926 : cluster [DBG] pgmap v11045: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:45:27.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:45:27 smithi047 bash[22744]: cluster 2024-09-16T11:45:25.539064+0000 mgr.a (mgr.14373) 15926 : cluster [DBG] pgmap v11045: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:45:29.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:45:29 smithi157 bash[24585]: cluster 2024-09-16T11:45:27.541377+0000 mgr.a (mgr.14373) 15927 : cluster [DBG] pgmap v11046: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:45:29.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:45:29 smithi086 bash[24289]: cluster 2024-09-16T11:45:27.541377+0000 mgr.a (mgr.14373) 15927 : cluster [DBG] pgmap v11046: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:45:29.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:45:29 smithi047 bash[22744]: cluster 2024-09-16T11:45:27.541377+0000 mgr.a (mgr.14373) 15927 : cluster [DBG] pgmap v11046: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:45:30.839 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:45:30.839 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:45:30.839 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:45:31.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:45:31 smithi157 bash[24585]: cluster 2024-09-16T11:45:29.542175+0000 mgr.a (mgr.14373) 15928 : cluster [DBG] pgmap v11047: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-16T11:45:31.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:45:31 smithi086 bash[24289]: cluster 2024-09-16T11:45:29.542175+0000 mgr.a (mgr.14373) 15928 : cluster [DBG] pgmap v11047: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-16T11:45:31.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:45:31 smithi047 bash[22744]: cluster 2024-09-16T11:45:29.542175+0000 mgr.a (mgr.14373) 15928 : cluster [DBG] pgmap v11047: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-16T11:45:31.630 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:45:31.631 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:45:31.631 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:45:31.631 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:45:31.631 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:45:32.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:45:32 smithi157 bash[24585]: audit 2024-09-16T11:45:31.184853+0000 mgr.a (mgr.14373) 15929 : audit [DBG] from='client.343647 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:45:32.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:45:32 smithi086 bash[24289]: audit 2024-09-16T11:45:31.184853+0000 mgr.a (mgr.14373) 15929 : audit [DBG] from='client.343647 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:45:32.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:45:32 smithi047 bash[22744]: audit 2024-09-16T11:45:31.184853+0000 mgr.a (mgr.14373) 15929 : audit [DBG] from='client.343647 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:45:33.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:45:33 smithi157 bash[24585]: cluster 2024-09-16T11:45:31.543527+0000 mgr.a (mgr.14373) 15930 : cluster [DBG] pgmap v11048: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 6.2 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-16T11:45:33.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:45:33 smithi086 bash[24289]: cluster 2024-09-16T11:45:31.543527+0000 mgr.a (mgr.14373) 15930 : cluster [DBG] pgmap v11048: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 6.2 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-16T11:45:33.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:45:33 smithi047 bash[22744]: cluster 2024-09-16T11:45:31.543527+0000 mgr.a (mgr.14373) 15930 : cluster [DBG] pgmap v11048: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 6.2 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-16T11:45:35.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:45:35 smithi157 bash[24585]: cluster 2024-09-16T11:45:33.544428+0000 mgr.a (mgr.14373) 15931 : cluster [DBG] pgmap v11049: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T11:45:35.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:45:35 smithi086 bash[24289]: cluster 2024-09-16T11:45:33.544428+0000 mgr.a (mgr.14373) 15931 : cluster [DBG] pgmap v11049: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T11:45:35.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:45:35 smithi047 bash[22744]: cluster 2024-09-16T11:45:33.544428+0000 mgr.a (mgr.14373) 15931 : cluster [DBG] pgmap v11049: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T11:45:36.632 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:45:36.633 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:45:36.633 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:45:37.415 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:45:37.415 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:45:37.415 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:45:37.415 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:45:37.415 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:45:37.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:45:37 smithi157 bash[24585]: cluster 2024-09-16T11:45:35.545392+0000 mgr.a (mgr.14373) 15932 : cluster [DBG] pgmap v11050: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T11:45:37.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:45:37 smithi086 bash[24289]: cluster 2024-09-16T11:45:35.545392+0000 mgr.a (mgr.14373) 15932 : cluster [DBG] pgmap v11050: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T11:45:37.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:45:37 smithi047 bash[22744]: cluster 2024-09-16T11:45:35.545392+0000 mgr.a (mgr.14373) 15932 : cluster [DBG] pgmap v11050: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T11:45:38.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:45:38 smithi157 bash[24585]: audit 2024-09-16T11:45:36.969851+0000 mgr.a (mgr.14373) 15933 : audit [DBG] from='client.343719 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:45:38.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:45:38 smithi086 bash[24289]: audit 2024-09-16T11:45:36.969851+0000 mgr.a (mgr.14373) 15933 : audit [DBG] from='client.343719 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:45:38.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:45:38 smithi047 bash[22744]: audit 2024-09-16T11:45:36.969851+0000 mgr.a (mgr.14373) 15933 : audit [DBG] from='client.343719 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:45:39.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:45:39 smithi157 bash[24585]: cluster 2024-09-16T11:45:37.548273+0000 mgr.a (mgr.14373) 15934 : cluster [DBG] pgmap v11051: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:45:39.573 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:45:39 smithi086 bash[24289]: cluster 2024-09-16T11:45:37.548273+0000 mgr.a (mgr.14373) 15934 : cluster [DBG] pgmap v11051: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:45:39.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:45:39 smithi047 bash[22744]: cluster 2024-09-16T11:45:37.548273+0000 mgr.a (mgr.14373) 15934 : cluster [DBG] pgmap v11051: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:45:41.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:45:41 smithi157 bash[24585]: cluster 2024-09-16T11:45:39.549055+0000 mgr.a (mgr.14373) 15935 : cluster [DBG] pgmap v11052: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:45:41.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:45:41 smithi086 bash[24289]: cluster 2024-09-16T11:45:39.549055+0000 mgr.a (mgr.14373) 15935 : cluster [DBG] pgmap v11052: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:45:41.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:45:41 smithi047 bash[22744]: cluster 2024-09-16T11:45:39.549055+0000 mgr.a (mgr.14373) 15935 : cluster [DBG] pgmap v11052: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:45:42.416 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:45:42.417 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:45:42.417 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:45:43.214 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:45:43.214 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:45:43.214 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:45:43.214 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:45:43.214 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:45:43.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:45:43 smithi157 bash[24585]: cluster 2024-09-16T11:45:41.550997+0000 mgr.a (mgr.14373) 15936 : cluster [DBG] pgmap v11053: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:45:43.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:45:43 smithi086 bash[24289]: cluster 2024-09-16T11:45:41.550997+0000 mgr.a (mgr.14373) 15936 : cluster [DBG] pgmap v11053: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:45:43.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:45:43 smithi047 bash[22744]: cluster 2024-09-16T11:45:41.550997+0000 mgr.a (mgr.14373) 15936 : cluster [DBG] pgmap v11053: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:45:44.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:45:44 smithi157 bash[24585]: audit 2024-09-16T11:45:42.749872+0000 mgr.a (mgr.14373) 15937 : audit [DBG] from='client.343794 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:45:44.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:45:44 smithi086 bash[24289]: audit 2024-09-16T11:45:42.749872+0000 mgr.a (mgr.14373) 15937 : audit [DBG] from='client.343794 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:45:44.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:45:44 smithi047 bash[22744]: audit 2024-09-16T11:45:42.749872+0000 mgr.a (mgr.14373) 15937 : audit [DBG] from='client.343794 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:45:45.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:45:45 smithi157 bash[24585]: cluster 2024-09-16T11:45:43.551977+0000 mgr.a (mgr.14373) 15938 : cluster [DBG] pgmap v11054: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-09-16T11:45:45.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:45:45 smithi086 bash[24289]: cluster 2024-09-16T11:45:43.551977+0000 mgr.a (mgr.14373) 15938 : cluster [DBG] pgmap v11054: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-09-16T11:45:45.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:45:45 smithi047 bash[22744]: cluster 2024-09-16T11:45:43.551977+0000 mgr.a (mgr.14373) 15938 : cluster [DBG] pgmap v11054: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-09-16T11:45:47.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:45:47 smithi157 bash[24585]: cluster 2024-09-16T11:45:45.552902+0000 mgr.a (mgr.14373) 15939 : cluster [DBG] pgmap v11055: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-09-16T11:45:47.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:45:47 smithi086 bash[24289]: cluster 2024-09-16T11:45:45.552902+0000 mgr.a (mgr.14373) 15939 : cluster [DBG] pgmap v11055: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-09-16T11:45:47.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:45:47 smithi047 bash[22744]: cluster 2024-09-16T11:45:45.552902+0000 mgr.a (mgr.14373) 15939 : cluster [DBG] pgmap v11055: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-09-16T11:45:48.215 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:45:48.216 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:45:48.217 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:45:48.997 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:45:48.997 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:45:48.997 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:45:48.997 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:45:48.997 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:45:49.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:45:49 smithi157 bash[24585]: cluster 2024-09-16T11:45:47.555311+0000 mgr.a (mgr.14373) 15940 : cluster [DBG] pgmap v11056: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.4 KiB/s rd, 2 op/s 2024-09-16T11:45:49.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:45:49 smithi086 bash[24289]: cluster 2024-09-16T11:45:47.555311+0000 mgr.a (mgr.14373) 15940 : cluster [DBG] pgmap v11056: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.4 KiB/s rd, 2 op/s 2024-09-16T11:45:49.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:45:49 smithi047 bash[22744]: cluster 2024-09-16T11:45:47.555311+0000 mgr.a (mgr.14373) 15940 : cluster [DBG] pgmap v11056: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.4 KiB/s rd, 2 op/s 2024-09-16T11:45:50.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:45:50 smithi157 bash[24585]: audit 2024-09-16T11:45:48.548702+0000 mgr.a (mgr.14373) 15941 : audit [DBG] from='client.343872 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:45:50.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:45:50 smithi086 bash[24289]: audit 2024-09-16T11:45:48.548702+0000 mgr.a (mgr.14373) 15941 : audit [DBG] from='client.343872 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:45:50.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:45:50 smithi047 bash[22744]: audit 2024-09-16T11:45:48.548702+0000 mgr.a (mgr.14373) 15941 : audit [DBG] from='client.343872 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:45:51.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:45:51 smithi157 bash[24585]: cluster 2024-09-16T11:45:49.556354+0000 mgr.a (mgr.14373) 15942 : cluster [DBG] pgmap v11057: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:45:51.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:45:51 smithi086 bash[24289]: cluster 2024-09-16T11:45:49.556354+0000 mgr.a (mgr.14373) 15942 : cluster [DBG] pgmap v11057: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:45:51.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:45:51 smithi047 bash[22744]: cluster 2024-09-16T11:45:49.556354+0000 mgr.a (mgr.14373) 15942 : cluster [DBG] pgmap v11057: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:45:53.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:45:53 smithi157 bash[24585]: cluster 2024-09-16T11:45:51.558610+0000 mgr.a (mgr.14373) 15943 : cluster [DBG] pgmap v11058: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:45:53.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:45:53 smithi086 bash[24289]: cluster 2024-09-16T11:45:51.558610+0000 mgr.a (mgr.14373) 15943 : cluster [DBG] pgmap v11058: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:45:53.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:45:53 smithi047 bash[22744]: cluster 2024-09-16T11:45:51.558610+0000 mgr.a (mgr.14373) 15943 : cluster [DBG] pgmap v11058: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:45:53.999 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:45:53.999 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:45:54.000 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:45:54.777 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:45:54.777 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:45:54.777 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:45:54.777 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:45:54.778 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:45:55.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:45:55 smithi157 bash[24585]: cluster 2024-09-16T11:45:53.559487+0000 mgr.a (mgr.14373) 15944 : cluster [DBG] pgmap v11059: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:45:55.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:45:55 smithi157 bash[24585]: audit 2024-09-16T11:45:54.332903+0000 mgr.a (mgr.14373) 15945 : audit [DBG] from='client.343947 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:45:55.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:45:55 smithi086 bash[24289]: cluster 2024-09-16T11:45:53.559487+0000 mgr.a (mgr.14373) 15944 : cluster [DBG] pgmap v11059: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:45:55.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:45:55 smithi086 bash[24289]: audit 2024-09-16T11:45:54.332903+0000 mgr.a (mgr.14373) 15945 : audit [DBG] from='client.343947 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:45:55.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:45:55 smithi047 bash[22744]: cluster 2024-09-16T11:45:53.559487+0000 mgr.a (mgr.14373) 15944 : cluster [DBG] pgmap v11059: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:45:55.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:45:55 smithi047 bash[22744]: audit 2024-09-16T11:45:54.332903+0000 mgr.a (mgr.14373) 15945 : audit [DBG] from='client.343947 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:45:57.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:45:57 smithi157 bash[24585]: cluster 2024-09-16T11:45:55.560392+0000 mgr.a (mgr.14373) 15946 : cluster [DBG] pgmap v11060: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:45:57.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:45:57 smithi086 bash[24289]: cluster 2024-09-16T11:45:55.560392+0000 mgr.a (mgr.14373) 15946 : cluster [DBG] pgmap v11060: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:45:57.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:45:57 smithi047 bash[22744]: cluster 2024-09-16T11:45:55.560392+0000 mgr.a (mgr.14373) 15946 : cluster [DBG] pgmap v11060: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:45:59.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:45:59 smithi157 bash[24585]: cluster 2024-09-16T11:45:57.562661+0000 mgr.a (mgr.14373) 15947 : cluster [DBG] pgmap v11061: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:45:59.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:45:59 smithi086 bash[24289]: cluster 2024-09-16T11:45:57.562661+0000 mgr.a (mgr.14373) 15947 : cluster [DBG] pgmap v11061: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:45:59.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:45:59 smithi047 bash[22744]: cluster 2024-09-16T11:45:57.562661+0000 mgr.a (mgr.14373) 15947 : cluster [DBG] pgmap v11061: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:45:59.778 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:45:59.779 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:45:59.780 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:46:00.588 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:46:00.588 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:46:00.588 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:46:00.588 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:46:00.588 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:46:01.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:46:01 smithi157 bash[24585]: cluster 2024-09-16T11:45:59.563427+0000 mgr.a (mgr.14373) 15948 : cluster [DBG] pgmap v11062: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:46:01.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:46:01 smithi157 bash[24585]: audit 2024-09-16T11:46:00.166054+0000 mgr.a (mgr.14373) 15949 : audit [DBG] from='client.344025 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:46:01.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:46:01 smithi086 bash[24289]: cluster 2024-09-16T11:45:59.563427+0000 mgr.a (mgr.14373) 15948 : cluster [DBG] pgmap v11062: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:46:01.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:46:01 smithi086 bash[24289]: audit 2024-09-16T11:46:00.166054+0000 mgr.a (mgr.14373) 15949 : audit [DBG] from='client.344025 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:46:01.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:46:01 smithi047 bash[22744]: cluster 2024-09-16T11:45:59.563427+0000 mgr.a (mgr.14373) 15948 : cluster [DBG] pgmap v11062: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:46:01.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:46:01 smithi047 bash[22744]: audit 2024-09-16T11:46:00.166054+0000 mgr.a (mgr.14373) 15949 : audit [DBG] from='client.344025 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:46:03.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:46:03 smithi157 bash[24585]: cluster 2024-09-16T11:46:01.565674+0000 mgr.a (mgr.14373) 15950 : cluster [DBG] pgmap v11063: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:46:03.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:46:03 smithi086 bash[24289]: cluster 2024-09-16T11:46:01.565674+0000 mgr.a (mgr.14373) 15950 : cluster [DBG] pgmap v11063: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:46:03.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:46:03 smithi047 bash[22744]: cluster 2024-09-16T11:46:01.565674+0000 mgr.a (mgr.14373) 15950 : cluster [DBG] pgmap v11063: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:46:05.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:46:05 smithi157 bash[24585]: cluster 2024-09-16T11:46:03.566469+0000 mgr.a (mgr.14373) 15951 : cluster [DBG] pgmap v11064: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:46:05.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:46:05 smithi086 bash[24289]: cluster 2024-09-16T11:46:03.566469+0000 mgr.a (mgr.14373) 15951 : cluster [DBG] pgmap v11064: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:46:05.589 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:46:05.590 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:46:05.590 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:46:05.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:46:05 smithi047 bash[22744]: cluster 2024-09-16T11:46:03.566469+0000 mgr.a (mgr.14373) 15951 : cluster [DBG] pgmap v11064: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:46:06.366 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:46:06.366 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:46:06.366 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:46:06.367 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:46:06.367 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:46:07.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:46:07 smithi157 bash[24585]: cluster 2024-09-16T11:46:05.567178+0000 mgr.a (mgr.14373) 15952 : cluster [DBG] pgmap v11065: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:46:07.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:46:07 smithi157 bash[24585]: audit 2024-09-16T11:46:05.923206+0000 mgr.a (mgr.14373) 15953 : audit [DBG] from='client.344103 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:46:07.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:46:07 smithi086 bash[24289]: cluster 2024-09-16T11:46:05.567178+0000 mgr.a (mgr.14373) 15952 : cluster [DBG] pgmap v11065: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:46:07.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:46:07 smithi086 bash[24289]: audit 2024-09-16T11:46:05.923206+0000 mgr.a (mgr.14373) 15953 : audit [DBG] from='client.344103 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:46:07.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:46:07 smithi047 bash[22744]: cluster 2024-09-16T11:46:05.567178+0000 mgr.a (mgr.14373) 15952 : cluster [DBG] pgmap v11065: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:46:07.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:46:07 smithi047 bash[22744]: audit 2024-09-16T11:46:05.923206+0000 mgr.a (mgr.14373) 15953 : audit [DBG] from='client.344103 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:46:09.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:46:09 smithi157 bash[24585]: cluster 2024-09-16T11:46:07.569515+0000 mgr.a (mgr.14373) 15954 : cluster [DBG] pgmap v11066: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:46:09.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:46:09 smithi086 bash[24289]: cluster 2024-09-16T11:46:07.569515+0000 mgr.a (mgr.14373) 15954 : cluster [DBG] pgmap v11066: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:46:09.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:46:09 smithi047 bash[22744]: cluster 2024-09-16T11:46:07.569515+0000 mgr.a (mgr.14373) 15954 : cluster [DBG] pgmap v11066: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:46:11.368 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:46:11.369 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:46:11.369 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:46:11.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:46:11 smithi157 bash[24585]: cluster 2024-09-16T11:46:09.570277+0000 mgr.a (mgr.14373) 15955 : cluster [DBG] pgmap v11067: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:46:11.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:46:11 smithi086 bash[24289]: cluster 2024-09-16T11:46:09.570277+0000 mgr.a (mgr.14373) 15955 : cluster [DBG] pgmap v11067: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:46:11.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:46:11 smithi047 bash[22744]: cluster 2024-09-16T11:46:09.570277+0000 mgr.a (mgr.14373) 15955 : cluster [DBG] pgmap v11067: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:46:12.162 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:46:12.162 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:46:12.162 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:46:12.162 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:46:12.162 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:46:13.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:46:13 smithi157 bash[24585]: cluster 2024-09-16T11:46:11.572181+0000 mgr.a (mgr.14373) 15956 : cluster [DBG] pgmap v11068: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:46:13.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:46:13 smithi157 bash[24585]: audit 2024-09-16T11:46:11.705099+0000 mgr.a (mgr.14373) 15957 : audit [DBG] from='client.344178 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:46:13.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:46:13 smithi086 bash[24289]: cluster 2024-09-16T11:46:11.572181+0000 mgr.a (mgr.14373) 15956 : cluster [DBG] pgmap v11068: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:46:13.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:46:13 smithi086 bash[24289]: audit 2024-09-16T11:46:11.705099+0000 mgr.a (mgr.14373) 15957 : audit [DBG] from='client.344178 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:46:13.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:46:13 smithi047 bash[22744]: cluster 2024-09-16T11:46:11.572181+0000 mgr.a (mgr.14373) 15956 : cluster [DBG] pgmap v11068: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:46:13.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:46:13 smithi047 bash[22744]: audit 2024-09-16T11:46:11.705099+0000 mgr.a (mgr.14373) 15957 : audit [DBG] from='client.344178 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:46:15.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:46:15 smithi157 bash[24585]: cluster 2024-09-16T11:46:13.573086+0000 mgr.a (mgr.14373) 15958 : cluster [DBG] pgmap v11069: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:46:15.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:46:15 smithi086 bash[24289]: cluster 2024-09-16T11:46:13.573086+0000 mgr.a (mgr.14373) 15958 : cluster [DBG] pgmap v11069: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:46:15.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:46:15 smithi047 bash[22744]: cluster 2024-09-16T11:46:13.573086+0000 mgr.a (mgr.14373) 15958 : cluster [DBG] pgmap v11069: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:46:17.163 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:46:17.164 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:46:17.164 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:46:17.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:46:17 smithi157 bash[24585]: cluster 2024-09-16T11:46:15.573863+0000 mgr.a (mgr.14373) 15959 : cluster [DBG] pgmap v11070: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T11:46:17.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:46:17 smithi157 bash[24585]: audit 2024-09-16T11:46:17.003952+0000 mon.b (mon.2) 1450 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T11:46:17.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:46:17 smithi086 bash[24289]: cluster 2024-09-16T11:46:15.573863+0000 mgr.a (mgr.14373) 15959 : cluster [DBG] pgmap v11070: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T11:46:17.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:46:17 smithi086 bash[24289]: audit 2024-09-16T11:46:17.003952+0000 mon.b (mon.2) 1450 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T11:46:17.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:46:17 smithi047 bash[22744]: cluster 2024-09-16T11:46:15.573863+0000 mgr.a (mgr.14373) 15959 : cluster [DBG] pgmap v11070: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T11:46:17.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:46:17 smithi047 bash[22744]: audit 2024-09-16T11:46:17.003952+0000 mon.b (mon.2) 1450 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T11:46:17.932 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:46:17.932 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:46:17.932 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:46:17.932 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:46:17.932 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:46:18.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:46:18 smithi157 bash[24585]: audit 2024-09-16T11:46:17.868935+0000 mon.b (mon.2) 1451 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T11:46:18.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:46:18 smithi157 bash[24585]: audit 2024-09-16T11:46:17.870682+0000 mon.b (mon.2) 1452 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T11:46:18.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:46:18 smithi157 bash[24585]: audit 2024-09-16T11:46:17.877047+0000 mon.a (mon.0) 1523 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:46:18.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:46:18 smithi157 bash[24585]: audit 2024-09-16T11:46:17.882156+0000 mon.b (mon.2) 1453 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:46:18.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:46:18 smithi086 bash[24289]: audit 2024-09-16T11:46:17.868935+0000 mon.b (mon.2) 1451 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T11:46:18.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:46:18 smithi086 bash[24289]: audit 2024-09-16T11:46:17.870682+0000 mon.b (mon.2) 1452 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T11:46:18.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:46:18 smithi086 bash[24289]: audit 2024-09-16T11:46:17.877047+0000 mon.a (mon.0) 1523 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:46:18.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:46:18 smithi086 bash[24289]: audit 2024-09-16T11:46:17.882156+0000 mon.b (mon.2) 1453 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:46:18.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:46:18 smithi047 bash[22744]: audit 2024-09-16T11:46:17.868935+0000 mon.b (mon.2) 1451 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T11:46:18.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:46:18 smithi047 bash[22744]: audit 2024-09-16T11:46:17.870682+0000 mon.b (mon.2) 1452 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T11:46:18.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:46:18 smithi047 bash[22744]: audit 2024-09-16T11:46:17.877047+0000 mon.a (mon.0) 1523 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:46:18.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:46:18 smithi047 bash[22744]: audit 2024-09-16T11:46:17.882156+0000 mon.b (mon.2) 1453 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:46:19.093 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 11:46:18 smithi047 bash[22994]: debug 2024-09-16T11:46:18.647+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T11:46:19.093 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 11:46:18 smithi047 bash[22994]: debug 2024-09-16T11:46:18.647+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T11:46:19.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:46:19 smithi157 bash[24585]: audit 2024-09-16T11:46:17.493703+0000 mgr.a (mgr.14373) 15960 : audit [DBG] from='client.344256 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:46:19.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:46:19 smithi157 bash[24585]: cluster 2024-09-16T11:46:17.575396+0000 mgr.a (mgr.14373) 15961 : cluster [DBG] pgmap v11071: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:46:19.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:46:19 smithi157 bash[24585]: audit 2024-09-16T11:46:17.883595+0000 mgr.a (mgr.14373) 15962 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:46:19.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:46:19 smithi086 bash[24289]: audit 2024-09-16T11:46:17.493703+0000 mgr.a (mgr.14373) 15960 : audit [DBG] from='client.344256 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:46:19.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:46:19 smithi086 bash[24289]: cluster 2024-09-16T11:46:17.575396+0000 mgr.a (mgr.14373) 15961 : cluster [DBG] pgmap v11071: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:46:19.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:46:19 smithi086 bash[24289]: audit 2024-09-16T11:46:17.883595+0000 mgr.a (mgr.14373) 15962 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:46:19.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:46:19 smithi047 bash[22744]: audit 2024-09-16T11:46:17.493703+0000 mgr.a (mgr.14373) 15960 : audit [DBG] from='client.344256 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:46:19.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:46:19 smithi047 bash[22744]: cluster 2024-09-16T11:46:17.575396+0000 mgr.a (mgr.14373) 15961 : cluster [DBG] pgmap v11071: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:46:19.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:46:19 smithi047 bash[22744]: audit 2024-09-16T11:46:17.883595+0000 mgr.a (mgr.14373) 15962 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:46:20.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:46:20 smithi157 bash[24585]: audit 2024-09-16T11:46:18.651120+0000 mgr.a (mgr.14373) 15963 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T11:46:20.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:46:20 smithi157 bash[24585]: cephadm 2024-09-16T11:46:18.653316+0000 mgr.a (mgr.14373) 15964 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T11:46:20.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:46:20 smithi086 bash[24289]: audit 2024-09-16T11:46:18.651120+0000 mgr.a (mgr.14373) 15963 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T11:46:20.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:46:20 smithi086 bash[24289]: cephadm 2024-09-16T11:46:18.653316+0000 mgr.a (mgr.14373) 15964 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T11:46:20.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:46:20 smithi047 bash[22744]: audit 2024-09-16T11:46:18.651120+0000 mgr.a (mgr.14373) 15963 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T11:46:20.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:46:20 smithi047 bash[22744]: cephadm 2024-09-16T11:46:18.653316+0000 mgr.a (mgr.14373) 15964 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T11:46:21.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:46:21 smithi157 bash[24585]: cluster 2024-09-16T11:46:19.576249+0000 mgr.a (mgr.14373) 15965 : cluster [DBG] pgmap v11072: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T11:46:21.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:46:21 smithi086 bash[24289]: cluster 2024-09-16T11:46:19.576249+0000 mgr.a (mgr.14373) 15965 : cluster [DBG] pgmap v11072: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T11:46:21.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:46:21 smithi047 bash[22744]: cluster 2024-09-16T11:46:19.576249+0000 mgr.a (mgr.14373) 15965 : cluster [DBG] pgmap v11072: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T11:46:22.934 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:46:22.934 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:46:22.934 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:46:23.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:46:23 smithi157 bash[24585]: cluster 2024-09-16T11:46:21.578334+0000 mgr.a (mgr.14373) 15966 : cluster [DBG] pgmap v11073: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:46:23.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:46:23 smithi086 bash[24289]: cluster 2024-09-16T11:46:21.578334+0000 mgr.a (mgr.14373) 15966 : cluster [DBG] pgmap v11073: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:46:23.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:46:23 smithi047 bash[22744]: cluster 2024-09-16T11:46:21.578334+0000 mgr.a (mgr.14373) 15966 : cluster [DBG] pgmap v11073: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:46:23.680 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:46:23.680 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:46:23.680 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:46:23.680 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:46:23.680 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:46:24.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:46:24 smithi086 bash[24289]: audit 2024-09-16T11:46:23.261472+0000 mgr.a (mgr.14373) 15967 : audit [DBG] from='client.344439 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:46:24.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:46:24 smithi047 bash[22744]: audit 2024-09-16T11:46:23.261472+0000 mgr.a (mgr.14373) 15967 : audit [DBG] from='client.344439 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:46:24.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:46:24 smithi157 bash[24585]: audit 2024-09-16T11:46:23.261472+0000 mgr.a (mgr.14373) 15967 : audit [DBG] from='client.344439 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:46:25.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:46:25 smithi086 bash[24289]: cluster 2024-09-16T11:46:23.582623+0000 mgr.a (mgr.14373) 15968 : cluster [DBG] pgmap v11074: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:46:25.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:46:25 smithi047 bash[22744]: cluster 2024-09-16T11:46:23.582623+0000 mgr.a (mgr.14373) 15968 : cluster [DBG] pgmap v11074: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:46:25.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:46:25 smithi157 bash[24585]: cluster 2024-09-16T11:46:23.582623+0000 mgr.a (mgr.14373) 15968 : cluster [DBG] pgmap v11074: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:46:27.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:46:27 smithi047 bash[22744]: cluster 2024-09-16T11:46:25.583389+0000 mgr.a (mgr.14373) 15969 : cluster [DBG] pgmap v11075: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:46:27.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:46:27 smithi157 bash[24585]: cluster 2024-09-16T11:46:25.583389+0000 mgr.a (mgr.14373) 15969 : cluster [DBG] pgmap v11075: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:46:27.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:46:27 smithi086 bash[24289]: cluster 2024-09-16T11:46:25.583389+0000 mgr.a (mgr.14373) 15969 : cluster [DBG] pgmap v11075: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:46:28.681 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:46:28.682 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:46:28.682 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:46:29.437 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:46:29.437 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:46:29.437 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:46:29.438 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:46:29.438 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:46:29.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:46:29 smithi047 bash[22744]: cluster 2024-09-16T11:46:27.585594+0000 mgr.a (mgr.14373) 15970 : cluster [DBG] pgmap v11076: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:46:29.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:46:29 smithi157 bash[24585]: cluster 2024-09-16T11:46:27.585594+0000 mgr.a (mgr.14373) 15970 : cluster [DBG] pgmap v11076: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:46:29.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:46:29 smithi086 bash[24289]: cluster 2024-09-16T11:46:27.585594+0000 mgr.a (mgr.14373) 15970 : cluster [DBG] pgmap v11076: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:46:30.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:46:30 smithi047 bash[22744]: audit 2024-09-16T11:46:29.009440+0000 mgr.a (mgr.14373) 15971 : audit [DBG] from='client.344517 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:46:30.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:46:30 smithi157 bash[24585]: audit 2024-09-16T11:46:29.009440+0000 mgr.a (mgr.14373) 15971 : audit [DBG] from='client.344517 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:46:30.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:46:30 smithi086 bash[24289]: audit 2024-09-16T11:46:29.009440+0000 mgr.a (mgr.14373) 15971 : audit [DBG] from='client.344517 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:46:31.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:46:31 smithi047 bash[22744]: cluster 2024-09-16T11:46:29.586477+0000 mgr.a (mgr.14373) 15972 : cluster [DBG] pgmap v11077: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:46:31.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:46:31 smithi157 bash[24585]: cluster 2024-09-16T11:46:29.586477+0000 mgr.a (mgr.14373) 15972 : cluster [DBG] pgmap v11077: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:46:31.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:46:31 smithi086 bash[24289]: cluster 2024-09-16T11:46:29.586477+0000 mgr.a (mgr.14373) 15972 : cluster [DBG] pgmap v11077: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:46:33.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:46:33 smithi047 bash[22744]: cluster 2024-09-16T11:46:31.588621+0000 mgr.a (mgr.14373) 15973 : cluster [DBG] pgmap v11078: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:46:33.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:46:33 smithi157 bash[24585]: cluster 2024-09-16T11:46:31.588621+0000 mgr.a (mgr.14373) 15973 : cluster [DBG] pgmap v11078: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:46:33.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:46:33 smithi086 bash[24289]: cluster 2024-09-16T11:46:31.588621+0000 mgr.a (mgr.14373) 15973 : cluster [DBG] pgmap v11078: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:46:34.439 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:46:34.439 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:46:34.440 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:46:35.185 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:46:35.185 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:46:35.185 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:46:35.186 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:46:35.186 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:46:35.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:46:35 smithi157 bash[24585]: cluster 2024-09-16T11:46:33.589363+0000 mgr.a (mgr.14373) 15974 : cluster [DBG] pgmap v11079: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:46:35.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:46:35 smithi086 bash[24289]: cluster 2024-09-16T11:46:33.589363+0000 mgr.a (mgr.14373) 15974 : cluster [DBG] pgmap v11079: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:46:35.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:46:35 smithi047 bash[22744]: cluster 2024-09-16T11:46:33.589363+0000 mgr.a (mgr.14373) 15974 : cluster [DBG] pgmap v11079: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:46:36.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:46:36 smithi157 bash[24585]: audit 2024-09-16T11:46:34.767694+0000 mgr.a (mgr.14373) 15975 : audit [DBG] from='client.344592 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:46:36.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:46:36 smithi086 bash[24289]: audit 2024-09-16T11:46:34.767694+0000 mgr.a (mgr.14373) 15975 : audit [DBG] from='client.344592 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:46:36.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:46:36 smithi047 bash[22744]: audit 2024-09-16T11:46:34.767694+0000 mgr.a (mgr.14373) 15975 : audit [DBG] from='client.344592 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:46:37.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:46:37 smithi157 bash[24585]: cluster 2024-09-16T11:46:35.590445+0000 mgr.a (mgr.14373) 15976 : cluster [DBG] pgmap v11080: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:46:37.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:46:37 smithi086 bash[24289]: cluster 2024-09-16T11:46:35.590445+0000 mgr.a (mgr.14373) 15976 : cluster [DBG] pgmap v11080: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:46:37.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:46:37 smithi047 bash[22744]: cluster 2024-09-16T11:46:35.590445+0000 mgr.a (mgr.14373) 15976 : cluster [DBG] pgmap v11080: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:46:39.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:46:39 smithi157 bash[24585]: cluster 2024-09-16T11:46:37.592705+0000 mgr.a (mgr.14373) 15977 : cluster [DBG] pgmap v11081: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:46:39.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:46:39 smithi086 bash[24289]: cluster 2024-09-16T11:46:37.592705+0000 mgr.a (mgr.14373) 15977 : cluster [DBG] pgmap v11081: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:46:39.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:46:39 smithi047 bash[22744]: cluster 2024-09-16T11:46:37.592705+0000 mgr.a (mgr.14373) 15977 : cluster [DBG] pgmap v11081: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:46:40.187 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:46:40.187 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:46:40.188 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:46:40.941 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:46:40.942 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:46:40.942 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:46:40.942 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:46:40.942 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:46:41.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:46:41 smithi157 bash[24585]: cluster 2024-09-16T11:46:39.593444+0000 mgr.a (mgr.14373) 15978 : cluster [DBG] pgmap v11082: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:46:41.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:46:41 smithi086 bash[24289]: cluster 2024-09-16T11:46:39.593444+0000 mgr.a (mgr.14373) 15978 : cluster [DBG] pgmap v11082: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:46:41.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:46:41 smithi047 bash[22744]: cluster 2024-09-16T11:46:39.593444+0000 mgr.a (mgr.14373) 15978 : cluster [DBG] pgmap v11082: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:46:42.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:46:42 smithi157 bash[24585]: audit 2024-09-16T11:46:40.513169+0000 mgr.a (mgr.14373) 15979 : audit [DBG] from='client.344667 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:46:42.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:46:42 smithi086 bash[24289]: audit 2024-09-16T11:46:40.513169+0000 mgr.a (mgr.14373) 15979 : audit [DBG] from='client.344667 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:46:42.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:46:42 smithi047 bash[22744]: audit 2024-09-16T11:46:40.513169+0000 mgr.a (mgr.14373) 15979 : audit [DBG] from='client.344667 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:46:43.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:46:43 smithi157 bash[24585]: cluster 2024-09-16T11:46:41.595712+0000 mgr.a (mgr.14373) 15980 : cluster [DBG] pgmap v11083: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:46:43.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:46:43 smithi086 bash[24289]: cluster 2024-09-16T11:46:41.595712+0000 mgr.a (mgr.14373) 15980 : cluster [DBG] pgmap v11083: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:46:43.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:46:43 smithi047 bash[22744]: cluster 2024-09-16T11:46:41.595712+0000 mgr.a (mgr.14373) 15980 : cluster [DBG] pgmap v11083: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:46:45.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:46:45 smithi157 bash[24585]: cluster 2024-09-16T11:46:43.596458+0000 mgr.a (mgr.14373) 15981 : cluster [DBG] pgmap v11084: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:46:45.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:46:45 smithi086 bash[24289]: cluster 2024-09-16T11:46:43.596458+0000 mgr.a (mgr.14373) 15981 : cluster [DBG] pgmap v11084: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:46:45.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:46:45 smithi047 bash[22744]: cluster 2024-09-16T11:46:43.596458+0000 mgr.a (mgr.14373) 15981 : cluster [DBG] pgmap v11084: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:46:45.943 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:46:45.944 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:46:45.944 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:46:46.727 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:46:46.727 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:46:46.728 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:46:46.728 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:46:46.728 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:46:47.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:46:47 smithi157 bash[24585]: cluster 2024-09-16T11:46:45.597224+0000 mgr.a (mgr.14373) 15982 : cluster [DBG] pgmap v11085: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:46:47.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:46:47 smithi157 bash[24585]: audit 2024-09-16T11:46:46.280892+0000 mgr.a (mgr.14373) 15983 : audit [DBG] from='client.344742 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:46:47.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:46:47 smithi086 bash[24289]: cluster 2024-09-16T11:46:45.597224+0000 mgr.a (mgr.14373) 15982 : cluster [DBG] pgmap v11085: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:46:47.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:46:47 smithi086 bash[24289]: audit 2024-09-16T11:46:46.280892+0000 mgr.a (mgr.14373) 15983 : audit [DBG] from='client.344742 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:46:47.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:46:47 smithi047 bash[22744]: cluster 2024-09-16T11:46:45.597224+0000 mgr.a (mgr.14373) 15982 : cluster [DBG] pgmap v11085: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:46:47.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:46:47 smithi047 bash[22744]: audit 2024-09-16T11:46:46.280892+0000 mgr.a (mgr.14373) 15983 : audit [DBG] from='client.344742 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:46:49.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:46:49 smithi157 bash[24585]: cluster 2024-09-16T11:46:47.600024+0000 mgr.a (mgr.14373) 15984 : cluster [DBG] pgmap v11086: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-16T11:46:49.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:46:49 smithi086 bash[24289]: cluster 2024-09-16T11:46:47.600024+0000 mgr.a (mgr.14373) 15984 : cluster [DBG] pgmap v11086: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-16T11:46:49.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:46:49 smithi047 bash[22744]: cluster 2024-09-16T11:46:47.600024+0000 mgr.a (mgr.14373) 15984 : cluster [DBG] pgmap v11086: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-16T11:46:51.729 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:46:51.729 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:46:51.729 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:46:51.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:46:51 smithi157 bash[24585]: cluster 2024-09-16T11:46:49.600997+0000 mgr.a (mgr.14373) 15985 : cluster [DBG] pgmap v11087: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-16T11:46:51.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:46:51 smithi086 bash[24289]: cluster 2024-09-16T11:46:49.600997+0000 mgr.a (mgr.14373) 15985 : cluster [DBG] pgmap v11087: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-16T11:46:51.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:46:51 smithi047 bash[22744]: cluster 2024-09-16T11:46:49.600997+0000 mgr.a (mgr.14373) 15985 : cluster [DBG] pgmap v11087: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-16T11:46:52.520 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:46:52.521 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:46:52.521 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:46:52.521 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:46:52.521 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:46:53.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:46:53 smithi157 bash[24585]: cluster 2024-09-16T11:46:51.602995+0000 mgr.a (mgr.14373) 15986 : cluster [DBG] pgmap v11088: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:46:53.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:46:53 smithi157 bash[24585]: audit 2024-09-16T11:46:52.060693+0000 mgr.a (mgr.14373) 15987 : audit [DBG] from='client.344820 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:46:53.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:46:53 smithi086 bash[24289]: cluster 2024-09-16T11:46:51.602995+0000 mgr.a (mgr.14373) 15986 : cluster [DBG] pgmap v11088: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:46:53.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:46:53 smithi086 bash[24289]: audit 2024-09-16T11:46:52.060693+0000 mgr.a (mgr.14373) 15987 : audit [DBG] from='client.344820 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:46:53.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:46:53 smithi047 bash[22744]: cluster 2024-09-16T11:46:51.602995+0000 mgr.a (mgr.14373) 15986 : cluster [DBG] pgmap v11088: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:46:53.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:46:53 smithi047 bash[22744]: audit 2024-09-16T11:46:52.060693+0000 mgr.a (mgr.14373) 15987 : audit [DBG] from='client.344820 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:46:55.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:46:55 smithi157 bash[24585]: cluster 2024-09-16T11:46:53.603887+0000 mgr.a (mgr.14373) 15988 : cluster [DBG] pgmap v11089: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:46:55.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:46:55 smithi086 bash[24289]: cluster 2024-09-16T11:46:53.603887+0000 mgr.a (mgr.14373) 15988 : cluster [DBG] pgmap v11089: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:46:55.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:46:55 smithi047 bash[22744]: cluster 2024-09-16T11:46:53.603887+0000 mgr.a (mgr.14373) 15988 : cluster [DBG] pgmap v11089: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:46:57.522 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:46:57.523 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:46:57.523 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:46:57.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:46:57 smithi157 bash[24585]: cluster 2024-09-16T11:46:55.604697+0000 mgr.a (mgr.14373) 15989 : cluster [DBG] pgmap v11090: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T11:46:57.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:46:57 smithi086 bash[24289]: cluster 2024-09-16T11:46:55.604697+0000 mgr.a (mgr.14373) 15989 : cluster [DBG] pgmap v11090: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T11:46:57.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:46:57 smithi047 bash[22744]: cluster 2024-09-16T11:46:55.604697+0000 mgr.a (mgr.14373) 15989 : cluster [DBG] pgmap v11090: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T11:46:58.289 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:46:58.289 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:46:58.289 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:46:58.289 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:46:58.289 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:46:59.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:46:59 smithi157 bash[24585]: cluster 2024-09-16T11:46:57.607076+0000 mgr.a (mgr.14373) 15990 : cluster [DBG] pgmap v11091: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:46:59.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:46:59 smithi157 bash[24585]: audit 2024-09-16T11:46:57.855557+0000 mgr.a (mgr.14373) 15991 : audit [DBG] from='client.344898 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:46:59.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:46:59 smithi086 bash[24289]: cluster 2024-09-16T11:46:57.607076+0000 mgr.a (mgr.14373) 15990 : cluster [DBG] pgmap v11091: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:46:59.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:46:59 smithi086 bash[24289]: audit 2024-09-16T11:46:57.855557+0000 mgr.a (mgr.14373) 15991 : audit [DBG] from='client.344898 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:46:59.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:46:59 smithi047 bash[22744]: cluster 2024-09-16T11:46:57.607076+0000 mgr.a (mgr.14373) 15990 : cluster [DBG] pgmap v11091: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:46:59.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:46:59 smithi047 bash[22744]: audit 2024-09-16T11:46:57.855557+0000 mgr.a (mgr.14373) 15991 : audit [DBG] from='client.344898 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:47:01.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:47:01 smithi157 bash[24585]: cluster 2024-09-16T11:46:59.608070+0000 mgr.a (mgr.14373) 15992 : cluster [DBG] pgmap v11092: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-16T11:47:01.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:47:01 smithi086 bash[24289]: cluster 2024-09-16T11:46:59.608070+0000 mgr.a (mgr.14373) 15992 : cluster [DBG] pgmap v11092: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-16T11:47:01.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:47:01 smithi047 bash[22744]: cluster 2024-09-16T11:46:59.608070+0000 mgr.a (mgr.14373) 15992 : cluster [DBG] pgmap v11092: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-16T11:47:03.290 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:47:03.291 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:47:03.291 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:47:03.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:47:03 smithi157 bash[24585]: cluster 2024-09-16T11:47:01.610193+0000 mgr.a (mgr.14373) 15993 : cluster [DBG] pgmap v11093: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-09-16T11:47:03.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:47:03 smithi086 bash[24289]: cluster 2024-09-16T11:47:01.610193+0000 mgr.a (mgr.14373) 15993 : cluster [DBG] pgmap v11093: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-09-16T11:47:03.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:47:03 smithi047 bash[22744]: cluster 2024-09-16T11:47:01.610193+0000 mgr.a (mgr.14373) 15993 : cluster [DBG] pgmap v11093: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-09-16T11:47:04.073 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:47:04.073 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:47:04.073 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:47:04.073 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:47:04.074 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:47:05.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:47:05 smithi157 bash[24585]: cluster 2024-09-16T11:47:03.610924+0000 mgr.a (mgr.14373) 15994 : cluster [DBG] pgmap v11094: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:47:05.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:47:05 smithi157 bash[24585]: audit 2024-09-16T11:47:03.626014+0000 mgr.a (mgr.14373) 15995 : audit [DBG] from='client.344976 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:47:05.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:47:05 smithi086 bash[24289]: cluster 2024-09-16T11:47:03.610924+0000 mgr.a (mgr.14373) 15994 : cluster [DBG] pgmap v11094: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:47:05.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:47:05 smithi086 bash[24289]: audit 2024-09-16T11:47:03.626014+0000 mgr.a (mgr.14373) 15995 : audit [DBG] from='client.344976 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:47:05.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:47:05 smithi047 bash[22744]: cluster 2024-09-16T11:47:03.610924+0000 mgr.a (mgr.14373) 15994 : cluster [DBG] pgmap v11094: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:47:05.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:47:05 smithi047 bash[22744]: audit 2024-09-16T11:47:03.626014+0000 mgr.a (mgr.14373) 15995 : audit [DBG] from='client.344976 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:47:07.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:47:07 smithi157 bash[24585]: cluster 2024-09-16T11:47:05.611935+0000 mgr.a (mgr.14373) 15996 : cluster [DBG] pgmap v11095: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:47:07.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:47:07 smithi086 bash[24289]: cluster 2024-09-16T11:47:05.611935+0000 mgr.a (mgr.14373) 15996 : cluster [DBG] pgmap v11095: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:47:07.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:47:07 smithi047 bash[22744]: cluster 2024-09-16T11:47:05.611935+0000 mgr.a (mgr.14373) 15996 : cluster [DBG] pgmap v11095: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:47:09.074 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:47:09.075 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:47:09.075 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:47:09.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:47:09 smithi157 bash[24585]: cluster 2024-09-16T11:47:07.614204+0000 mgr.a (mgr.14373) 15997 : cluster [DBG] pgmap v11096: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:47:09.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:47:09 smithi086 bash[24289]: cluster 2024-09-16T11:47:07.614204+0000 mgr.a (mgr.14373) 15997 : cluster [DBG] pgmap v11096: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:47:09.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:47:09 smithi047 bash[22744]: cluster 2024-09-16T11:47:07.614204+0000 mgr.a (mgr.14373) 15997 : cluster [DBG] pgmap v11096: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:47:09.860 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:47:09.860 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:47:09.860 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:47:09.860 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:47:09.860 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:47:10.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:47:10 smithi157 bash[24585]: audit 2024-09-16T11:47:09.411464+0000 mgr.a (mgr.14373) 15998 : audit [DBG] from='client.345054 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:47:10.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:47:10 smithi086 bash[24289]: audit 2024-09-16T11:47:09.411464+0000 mgr.a (mgr.14373) 15998 : audit [DBG] from='client.345054 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:47:10.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:47:10 smithi047 bash[22744]: audit 2024-09-16T11:47:09.411464+0000 mgr.a (mgr.14373) 15998 : audit [DBG] from='client.345054 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:47:11.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:47:11 smithi157 bash[24585]: cluster 2024-09-16T11:47:09.614854+0000 mgr.a (mgr.14373) 15999 : cluster [DBG] pgmap v11097: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:47:11.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:47:11 smithi086 bash[24289]: cluster 2024-09-16T11:47:09.614854+0000 mgr.a (mgr.14373) 15999 : cluster [DBG] pgmap v11097: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:47:11.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:47:11 smithi047 bash[22744]: cluster 2024-09-16T11:47:09.614854+0000 mgr.a (mgr.14373) 15999 : cluster [DBG] pgmap v11097: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:47:13.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:47:13 smithi157 bash[24585]: cluster 2024-09-16T11:47:11.617025+0000 mgr.a (mgr.14373) 16000 : cluster [DBG] pgmap v11098: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:47:13.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:47:13 smithi086 bash[24289]: cluster 2024-09-16T11:47:11.617025+0000 mgr.a (mgr.14373) 16000 : cluster [DBG] pgmap v11098: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:47:13.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:47:13 smithi047 bash[22744]: cluster 2024-09-16T11:47:11.617025+0000 mgr.a (mgr.14373) 16000 : cluster [DBG] pgmap v11098: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:47:14.861 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:47:14.862 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:47:14.862 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:47:15.647 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:47:15.647 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:47:15.647 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:47:15.647 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:47:15.648 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:47:15.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:47:15 smithi157 bash[24585]: cluster 2024-09-16T11:47:13.617835+0000 mgr.a (mgr.14373) 16001 : cluster [DBG] pgmap v11099: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:47:15.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:47:15 smithi086 bash[24289]: cluster 2024-09-16T11:47:13.617835+0000 mgr.a (mgr.14373) 16001 : cluster [DBG] pgmap v11099: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:47:15.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:47:15 smithi047 bash[22744]: cluster 2024-09-16T11:47:13.617835+0000 mgr.a (mgr.14373) 16001 : cluster [DBG] pgmap v11099: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:47:16.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:47:16 smithi157 bash[24585]: audit 2024-09-16T11:47:15.200948+0000 mgr.a (mgr.14373) 16002 : audit [DBG] from='client.345129 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:47:16.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:47:16 smithi086 bash[24289]: audit 2024-09-16T11:47:15.200948+0000 mgr.a (mgr.14373) 16002 : audit [DBG] from='client.345129 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:47:16.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:47:16 smithi047 bash[22744]: audit 2024-09-16T11:47:15.200948+0000 mgr.a (mgr.14373) 16002 : audit [DBG] from='client.345129 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:47:17.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:47:17 smithi157 bash[24585]: cluster 2024-09-16T11:47:15.618316+0000 mgr.a (mgr.14373) 16003 : cluster [DBG] pgmap v11100: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:47:17.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:47:17 smithi086 bash[24289]: cluster 2024-09-16T11:47:15.618316+0000 mgr.a (mgr.14373) 16003 : cluster [DBG] pgmap v11100: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:47:17.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:47:17 smithi047 bash[22744]: cluster 2024-09-16T11:47:15.618316+0000 mgr.a (mgr.14373) 16003 : cluster [DBG] pgmap v11100: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:47:19.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:47:19 smithi157 bash[24585]: cluster 2024-09-16T11:47:17.620555+0000 mgr.a (mgr.14373) 16004 : cluster [DBG] pgmap v11101: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:47:19.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:47:19 smithi157 bash[24585]: audit 2024-09-16T11:47:18.704785+0000 mon.b (mon.2) 1454 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T11:47:19.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:47:19 smithi086 bash[24289]: cluster 2024-09-16T11:47:17.620555+0000 mgr.a (mgr.14373) 16004 : cluster [DBG] pgmap v11101: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:47:19.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:47:19 smithi086 bash[24289]: audit 2024-09-16T11:47:18.704785+0000 mon.b (mon.2) 1454 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T11:47:19.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:47:19 smithi047 bash[22744]: cluster 2024-09-16T11:47:17.620555+0000 mgr.a (mgr.14373) 16004 : cluster [DBG] pgmap v11101: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:47:19.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:47:19 smithi047 bash[22744]: audit 2024-09-16T11:47:18.704785+0000 mon.b (mon.2) 1454 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T11:47:20.648 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:47:20.649 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:47:20.650 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:47:21.409 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:47:21.409 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:47:21.409 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:47:21.409 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:47:21.409 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:47:21.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:47:21 smithi157 bash[24585]: cluster 2024-09-16T11:47:19.621296+0000 mgr.a (mgr.14373) 16005 : cluster [DBG] pgmap v11102: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:47:21.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:47:21 smithi086 bash[24289]: cluster 2024-09-16T11:47:19.621296+0000 mgr.a (mgr.14373) 16005 : cluster [DBG] pgmap v11102: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:47:21.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:47:21 smithi047 bash[22744]: cluster 2024-09-16T11:47:19.621296+0000 mgr.a (mgr.14373) 16005 : cluster [DBG] pgmap v11102: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:47:22.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:47:22 smithi157 bash[24585]: audit 2024-09-16T11:47:20.988400+0000 mgr.a (mgr.14373) 16006 : audit [DBG] from='client.345207 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:47:22.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:47:22 smithi086 bash[24289]: audit 2024-09-16T11:47:20.988400+0000 mgr.a (mgr.14373) 16006 : audit [DBG] from='client.345207 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:47:22.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:47:22 smithi047 bash[22744]: audit 2024-09-16T11:47:20.988400+0000 mgr.a (mgr.14373) 16006 : audit [DBG] from='client.345207 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:47:23.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:47:23 smithi157 bash[24585]: cluster 2024-09-16T11:47:21.623552+0000 mgr.a (mgr.14373) 16007 : cluster [DBG] pgmap v11103: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:47:23.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:47:23 smithi086 bash[24289]: cluster 2024-09-16T11:47:21.623552+0000 mgr.a (mgr.14373) 16007 : cluster [DBG] pgmap v11103: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:47:23.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:47:23 smithi047 bash[22744]: cluster 2024-09-16T11:47:21.623552+0000 mgr.a (mgr.14373) 16007 : cluster [DBG] pgmap v11103: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:47:25.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:47:25 smithi157 bash[24585]: cluster 2024-09-16T11:47:23.624321+0000 mgr.a (mgr.14373) 16008 : cluster [DBG] pgmap v11104: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:47:25.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:47:25 smithi157 bash[24585]: audit 2024-09-16T11:47:24.092737+0000 mon.a (mon.0) 1524 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:47:25.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:47:25 smithi157 bash[24585]: audit 2024-09-16T11:47:24.099291+0000 mon.a (mon.0) 1525 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:47:25.558 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:47:25 smithi157 bash[24585]: audit 2024-09-16T11:47:24.112436+0000 mon.a (mon.0) 1526 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:47:25.558 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:47:25 smithi157 bash[24585]: audit 2024-09-16T11:47:24.117557+0000 mon.a (mon.0) 1527 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:47:25.558 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:47:25 smithi157 bash[24585]: audit 2024-09-16T11:47:24.120113+0000 mon.a (mon.0) 1528 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:47:25.558 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:47:25 smithi157 bash[24585]: audit 2024-09-16T11:47:24.125150+0000 mon.a (mon.0) 1529 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:47:25.558 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:47:25 smithi157 bash[24585]: audit 2024-09-16T11:47:24.867940+0000 mon.b (mon.2) 1455 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T11:47:25.558 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:47:25 smithi157 bash[24585]: audit 2024-09-16T11:47:24.869713+0000 mon.b (mon.2) 1456 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T11:47:25.558 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:47:25 smithi157 bash[24585]: audit 2024-09-16T11:47:24.879906+0000 mon.a (mon.0) 1530 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:47:25.558 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:47:25 smithi157 bash[24585]: audit 2024-09-16T11:47:24.883096+0000 mon.b (mon.2) 1457 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:47:25.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:47:25 smithi086 bash[24289]: cluster 2024-09-16T11:47:23.624321+0000 mgr.a (mgr.14373) 16008 : cluster [DBG] pgmap v11104: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:47:25.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:47:25 smithi086 bash[24289]: audit 2024-09-16T11:47:24.092737+0000 mon.a (mon.0) 1524 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:47:25.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:47:25 smithi086 bash[24289]: audit 2024-09-16T11:47:24.099291+0000 mon.a (mon.0) 1525 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:47:25.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:47:25 smithi086 bash[24289]: audit 2024-09-16T11:47:24.112436+0000 mon.a (mon.0) 1526 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:47:25.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:47:25 smithi086 bash[24289]: audit 2024-09-16T11:47:24.117557+0000 mon.a (mon.0) 1527 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:47:25.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:47:25 smithi086 bash[24289]: audit 2024-09-16T11:47:24.120113+0000 mon.a (mon.0) 1528 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:47:25.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:47:25 smithi086 bash[24289]: audit 2024-09-16T11:47:24.125150+0000 mon.a (mon.0) 1529 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:47:25.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:47:25 smithi086 bash[24289]: audit 2024-09-16T11:47:24.867940+0000 mon.b (mon.2) 1455 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T11:47:25.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:47:25 smithi086 bash[24289]: audit 2024-09-16T11:47:24.869713+0000 mon.b (mon.2) 1456 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T11:47:25.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:47:25 smithi086 bash[24289]: audit 2024-09-16T11:47:24.879906+0000 mon.a (mon.0) 1530 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:47:25.572 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:47:25 smithi086 bash[24289]: audit 2024-09-16T11:47:24.883096+0000 mon.b (mon.2) 1457 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:47:25.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:47:25 smithi047 bash[22744]: cluster 2024-09-16T11:47:23.624321+0000 mgr.a (mgr.14373) 16008 : cluster [DBG] pgmap v11104: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:47:25.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:47:25 smithi047 bash[22744]: audit 2024-09-16T11:47:24.092737+0000 mon.a (mon.0) 1524 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:47:25.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:47:25 smithi047 bash[22744]: audit 2024-09-16T11:47:24.099291+0000 mon.a (mon.0) 1525 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:47:25.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:47:25 smithi047 bash[22744]: audit 2024-09-16T11:47:24.112436+0000 mon.a (mon.0) 1526 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:47:25.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:47:25 smithi047 bash[22744]: audit 2024-09-16T11:47:24.117557+0000 mon.a (mon.0) 1527 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:47:25.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:47:25 smithi047 bash[22744]: audit 2024-09-16T11:47:24.120113+0000 mon.a (mon.0) 1528 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:47:25.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:47:25 smithi047 bash[22744]: audit 2024-09-16T11:47:24.125150+0000 mon.a (mon.0) 1529 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:47:25.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:47:25 smithi047 bash[22744]: audit 2024-09-16T11:47:24.867940+0000 mon.b (mon.2) 1455 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T11:47:25.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:47:25 smithi047 bash[22744]: audit 2024-09-16T11:47:24.869713+0000 mon.b (mon.2) 1456 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T11:47:25.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:47:25 smithi047 bash[22744]: audit 2024-09-16T11:47:24.879906+0000 mon.a (mon.0) 1530 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:47:25.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:47:25 smithi047 bash[22744]: audit 2024-09-16T11:47:24.883096+0000 mon.b (mon.2) 1457 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:47:26.093 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 11:47:25 smithi047 bash[22994]: debug 2024-09-16T11:47:25.650+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T11:47:26.093 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 11:47:25 smithi047 bash[22994]: debug 2024-09-16T11:47:25.654+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T11:47:26.410 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:47:26.411 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:47:26.411 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:47:26.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:47:26 smithi157 bash[24585]: audit 2024-09-16T11:47:24.885581+0000 mgr.a (mgr.14373) 16009 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:47:26.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:47:26 smithi086 bash[24289]: audit 2024-09-16T11:47:24.885581+0000 mgr.a (mgr.14373) 16009 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:47:26.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:47:26 smithi047 bash[22744]: audit 2024-09-16T11:47:24.885581+0000 mgr.a (mgr.14373) 16009 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:47:27.172 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:47:27.173 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:47:27.173 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:47:27.173 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:47:27.173 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:47:27.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:47:27 smithi157 bash[24585]: cluster 2024-09-16T11:47:25.624856+0000 mgr.a (mgr.14373) 16010 : cluster [DBG] pgmap v11105: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:47:27.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:47:27 smithi157 bash[24585]: audit 2024-09-16T11:47:25.652601+0000 mgr.a (mgr.14373) 16011 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T11:47:27.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:47:27 smithi157 bash[24585]: cephadm 2024-09-16T11:47:25.654857+0000 mgr.a (mgr.14373) 16012 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T11:47:27.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:47:27 smithi086 bash[24289]: cluster 2024-09-16T11:47:25.624856+0000 mgr.a (mgr.14373) 16010 : cluster [DBG] pgmap v11105: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:47:27.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:47:27 smithi086 bash[24289]: audit 2024-09-16T11:47:25.652601+0000 mgr.a (mgr.14373) 16011 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T11:47:27.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:47:27 smithi086 bash[24289]: cephadm 2024-09-16T11:47:25.654857+0000 mgr.a (mgr.14373) 16012 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T11:47:27.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:47:27 smithi047 bash[22744]: cluster 2024-09-16T11:47:25.624856+0000 mgr.a (mgr.14373) 16010 : cluster [DBG] pgmap v11105: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:47:27.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:47:27 smithi047 bash[22744]: audit 2024-09-16T11:47:25.652601+0000 mgr.a (mgr.14373) 16011 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T11:47:27.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:47:27 smithi047 bash[22744]: cephadm 2024-09-16T11:47:25.654857+0000 mgr.a (mgr.14373) 16012 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T11:47:28.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:47:28 smithi157 bash[24585]: audit 2024-09-16T11:47:26.741235+0000 mgr.a (mgr.14373) 16013 : audit [DBG] from='client.345393 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:47:28.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:47:28 smithi086 bash[24289]: audit 2024-09-16T11:47:26.741235+0000 mgr.a (mgr.14373) 16013 : audit [DBG] from='client.345393 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:47:28.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:47:28 smithi047 bash[22744]: audit 2024-09-16T11:47:26.741235+0000 mgr.a (mgr.14373) 16013 : audit [DBG] from='client.345393 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:47:29.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:47:29 smithi157 bash[24585]: cluster 2024-09-16T11:47:27.627639+0000 mgr.a (mgr.14373) 16014 : cluster [DBG] pgmap v11106: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:47:29.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:47:29 smithi086 bash[24289]: cluster 2024-09-16T11:47:27.627639+0000 mgr.a (mgr.14373) 16014 : cluster [DBG] pgmap v11106: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:47:29.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:47:29 smithi047 bash[22744]: cluster 2024-09-16T11:47:27.627639+0000 mgr.a (mgr.14373) 16014 : cluster [DBG] pgmap v11106: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:47:31.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:47:31 smithi157 bash[24585]: cluster 2024-09-16T11:47:29.628448+0000 mgr.a (mgr.14373) 16015 : cluster [DBG] pgmap v11107: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T11:47:31.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:47:31 smithi086 bash[24289]: cluster 2024-09-16T11:47:29.628448+0000 mgr.a (mgr.14373) 16015 : cluster [DBG] pgmap v11107: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T11:47:31.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:47:31 smithi047 bash[22744]: cluster 2024-09-16T11:47:29.628448+0000 mgr.a (mgr.14373) 16015 : cluster [DBG] pgmap v11107: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T11:47:32.174 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:47:32.175 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:47:32.175 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:47:32.918 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:47:32.918 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:47:32.918 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:47:32.919 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:47:32.919 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:47:33.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:47:33 smithi157 bash[24585]: cluster 2024-09-16T11:47:31.630414+0000 mgr.a (mgr.14373) 16016 : cluster [DBG] pgmap v11108: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:47:33.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:47:33 smithi086 bash[24289]: cluster 2024-09-16T11:47:31.630414+0000 mgr.a (mgr.14373) 16016 : cluster [DBG] pgmap v11108: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:47:33.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:47:33 smithi047 bash[22744]: cluster 2024-09-16T11:47:31.630414+0000 mgr.a (mgr.14373) 16016 : cluster [DBG] pgmap v11108: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:47:34.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:47:34 smithi157 bash[24585]: audit 2024-09-16T11:47:32.502210+0000 mgr.a (mgr.14373) 16017 : audit [DBG] from='client.345471 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:47:34.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:47:34 smithi086 bash[24289]: audit 2024-09-16T11:47:32.502210+0000 mgr.a (mgr.14373) 16017 : audit [DBG] from='client.345471 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:47:34.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:47:34 smithi047 bash[22744]: audit 2024-09-16T11:47:32.502210+0000 mgr.a (mgr.14373) 16017 : audit [DBG] from='client.345471 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:47:35.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:47:35 smithi157 bash[24585]: cluster 2024-09-16T11:47:33.631339+0000 mgr.a (mgr.14373) 16018 : cluster [DBG] pgmap v11109: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T11:47:35.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:47:35 smithi086 bash[24289]: cluster 2024-09-16T11:47:33.631339+0000 mgr.a (mgr.14373) 16018 : cluster [DBG] pgmap v11109: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T11:47:35.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:47:35 smithi047 bash[22744]: cluster 2024-09-16T11:47:33.631339+0000 mgr.a (mgr.14373) 16018 : cluster [DBG] pgmap v11109: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T11:47:37.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:47:37 smithi157 bash[24585]: cluster 2024-09-16T11:47:35.632124+0000 mgr.a (mgr.14373) 16019 : cluster [DBG] pgmap v11110: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T11:47:37.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:47:37 smithi086 bash[24289]: cluster 2024-09-16T11:47:35.632124+0000 mgr.a (mgr.14373) 16019 : cluster [DBG] pgmap v11110: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T11:47:37.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:47:37 smithi047 bash[22744]: cluster 2024-09-16T11:47:35.632124+0000 mgr.a (mgr.14373) 16019 : cluster [DBG] pgmap v11110: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T11:47:37.919 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:47:37.920 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:47:37.920 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:47:38.693 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:47:38.693 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:47:38.694 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:47:38.694 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:47:38.694 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:47:39.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:47:39 smithi157 bash[24585]: cluster 2024-09-16T11:47:37.634405+0000 mgr.a (mgr.14373) 16020 : cluster [DBG] pgmap v11111: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:47:39.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:47:39 smithi157 bash[24585]: audit 2024-09-16T11:47:38.256340+0000 mgr.a (mgr.14373) 16021 : audit [DBG] from='client.345549 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:47:39.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:47:39 smithi086 bash[24289]: cluster 2024-09-16T11:47:37.634405+0000 mgr.a (mgr.14373) 16020 : cluster [DBG] pgmap v11111: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:47:39.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:47:39 smithi086 bash[24289]: audit 2024-09-16T11:47:38.256340+0000 mgr.a (mgr.14373) 16021 : audit [DBG] from='client.345549 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:47:39.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:47:39 smithi047 bash[22744]: cluster 2024-09-16T11:47:37.634405+0000 mgr.a (mgr.14373) 16020 : cluster [DBG] pgmap v11111: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:47:39.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:47:39 smithi047 bash[22744]: audit 2024-09-16T11:47:38.256340+0000 mgr.a (mgr.14373) 16021 : audit [DBG] from='client.345549 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:47:41.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:47:41 smithi157 bash[24585]: cluster 2024-09-16T11:47:39.635403+0000 mgr.a (mgr.14373) 16022 : cluster [DBG] pgmap v11112: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:47:41.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:47:41 smithi086 bash[24289]: cluster 2024-09-16T11:47:39.635403+0000 mgr.a (mgr.14373) 16022 : cluster [DBG] pgmap v11112: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:47:41.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:47:41 smithi047 bash[22744]: cluster 2024-09-16T11:47:39.635403+0000 mgr.a (mgr.14373) 16022 : cluster [DBG] pgmap v11112: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:47:43.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:47:43 smithi157 bash[24585]: cluster 2024-09-16T11:47:41.637612+0000 mgr.a (mgr.14373) 16023 : cluster [DBG] pgmap v11113: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:47:43.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:47:43 smithi086 bash[24289]: cluster 2024-09-16T11:47:41.637612+0000 mgr.a (mgr.14373) 16023 : cluster [DBG] pgmap v11113: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:47:43.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:47:43 smithi047 bash[22744]: cluster 2024-09-16T11:47:41.637612+0000 mgr.a (mgr.14373) 16023 : cluster [DBG] pgmap v11113: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:47:43.695 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:47:43.695 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:47:43.696 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:47:44.448 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:47:44.448 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:47:44.448 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:47:44.448 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:47:44.448 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:47:45.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:47:45 smithi157 bash[24585]: cluster 2024-09-16T11:47:43.638415+0000 mgr.a (mgr.14373) 16024 : cluster [DBG] pgmap v11114: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:47:45.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:47:45 smithi157 bash[24585]: audit 2024-09-16T11:47:44.025917+0000 mgr.a (mgr.14373) 16025 : audit [DBG] from='client.345621 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:47:45.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:47:45 smithi086 bash[24289]: cluster 2024-09-16T11:47:43.638415+0000 mgr.a (mgr.14373) 16024 : cluster [DBG] pgmap v11114: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:47:45.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:47:45 smithi086 bash[24289]: audit 2024-09-16T11:47:44.025917+0000 mgr.a (mgr.14373) 16025 : audit [DBG] from='client.345621 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:47:45.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:47:45 smithi047 bash[22744]: cluster 2024-09-16T11:47:43.638415+0000 mgr.a (mgr.14373) 16024 : cluster [DBG] pgmap v11114: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:47:45.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:47:45 smithi047 bash[22744]: audit 2024-09-16T11:47:44.025917+0000 mgr.a (mgr.14373) 16025 : audit [DBG] from='client.345621 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:47:47.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:47:47 smithi157 bash[24585]: cluster 2024-09-16T11:47:45.639400+0000 mgr.a (mgr.14373) 16026 : cluster [DBG] pgmap v11115: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:47:47.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:47:47 smithi086 bash[24289]: cluster 2024-09-16T11:47:45.639400+0000 mgr.a (mgr.14373) 16026 : cluster [DBG] pgmap v11115: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:47:47.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:47:47 smithi047 bash[22744]: cluster 2024-09-16T11:47:45.639400+0000 mgr.a (mgr.14373) 16026 : cluster [DBG] pgmap v11115: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:47:49.449 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:47:49.450 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:47:49.450 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:47:49.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:47:49 smithi157 bash[24585]: cluster 2024-09-16T11:47:47.641653+0000 mgr.a (mgr.14373) 16027 : cluster [DBG] pgmap v11116: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:47:49.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:47:49 smithi086 bash[24289]: cluster 2024-09-16T11:47:47.641653+0000 mgr.a (mgr.14373) 16027 : cluster [DBG] pgmap v11116: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:47:49.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:47:49 smithi047 bash[22744]: cluster 2024-09-16T11:47:47.641653+0000 mgr.a (mgr.14373) 16027 : cluster [DBG] pgmap v11116: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:47:50.190 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:47:50.191 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:47:50.191 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:47:50.191 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:47:50.191 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:47:51.561 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:47:51 smithi157 bash[24585]: cluster 2024-09-16T11:47:49.642427+0000 mgr.a (mgr.14373) 16028 : cluster [DBG] pgmap v11117: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:47:51.561 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:47:51 smithi157 bash[24585]: audit 2024-09-16T11:47:49.779793+0000 mgr.a (mgr.14373) 16029 : audit [DBG] from='client.345696 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:47:51.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:47:51 smithi086 bash[24289]: cluster 2024-09-16T11:47:49.642427+0000 mgr.a (mgr.14373) 16028 : cluster [DBG] pgmap v11117: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:47:51.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:47:51 smithi086 bash[24289]: audit 2024-09-16T11:47:49.779793+0000 mgr.a (mgr.14373) 16029 : audit [DBG] from='client.345696 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:47:51.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:47:51 smithi047 bash[22744]: cluster 2024-09-16T11:47:49.642427+0000 mgr.a (mgr.14373) 16028 : cluster [DBG] pgmap v11117: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:47:51.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:47:51 smithi047 bash[22744]: audit 2024-09-16T11:47:49.779793+0000 mgr.a (mgr.14373) 16029 : audit [DBG] from='client.345696 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:47:53.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:47:53 smithi157 bash[24585]: cluster 2024-09-16T11:47:51.644603+0000 mgr.a (mgr.14373) 16030 : cluster [DBG] pgmap v11118: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:47:53.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:47:53 smithi086 bash[24289]: cluster 2024-09-16T11:47:51.644603+0000 mgr.a (mgr.14373) 16030 : cluster [DBG] pgmap v11118: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:47:53.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:47:53 smithi047 bash[22744]: cluster 2024-09-16T11:47:51.644603+0000 mgr.a (mgr.14373) 16030 : cluster [DBG] pgmap v11118: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:47:55.192 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:47:55.193 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:47:55.193 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:47:55.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:47:55 smithi157 bash[24585]: cluster 2024-09-16T11:47:53.645373+0000 mgr.a (mgr.14373) 16031 : cluster [DBG] pgmap v11119: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:47:55.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:47:55 smithi086 bash[24289]: cluster 2024-09-16T11:47:53.645373+0000 mgr.a (mgr.14373) 16031 : cluster [DBG] pgmap v11119: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:47:55.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:47:55 smithi047 bash[22744]: cluster 2024-09-16T11:47:53.645373+0000 mgr.a (mgr.14373) 16031 : cluster [DBG] pgmap v11119: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:47:55.944 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:47:55.945 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:47:55.945 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:47:55.945 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:47:55.945 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:47:57.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:47:57 smithi157 bash[24585]: audit 2024-09-16T11:47:55.525302+0000 mgr.a (mgr.14373) 16032 : audit [DBG] from='client.345774 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:47:57.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:47:57 smithi157 bash[24585]: cluster 2024-09-16T11:47:55.645990+0000 mgr.a (mgr.14373) 16033 : cluster [DBG] pgmap v11120: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:47:57.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:47:57 smithi086 bash[24289]: audit 2024-09-16T11:47:55.525302+0000 mgr.a (mgr.14373) 16032 : audit [DBG] from='client.345774 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:47:57.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:47:57 smithi086 bash[24289]: cluster 2024-09-16T11:47:55.645990+0000 mgr.a (mgr.14373) 16033 : cluster [DBG] pgmap v11120: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:47:57.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:47:57 smithi047 bash[22744]: audit 2024-09-16T11:47:55.525302+0000 mgr.a (mgr.14373) 16032 : audit [DBG] from='client.345774 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:47:57.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:47:57 smithi047 bash[22744]: cluster 2024-09-16T11:47:55.645990+0000 mgr.a (mgr.14373) 16033 : cluster [DBG] pgmap v11120: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:47:59.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:47:59 smithi157 bash[24585]: cluster 2024-09-16T11:47:57.648322+0000 mgr.a (mgr.14373) 16034 : cluster [DBG] pgmap v11121: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:47:59.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:47:59 smithi086 bash[24289]: cluster 2024-09-16T11:47:57.648322+0000 mgr.a (mgr.14373) 16034 : cluster [DBG] pgmap v11121: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:47:59.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:47:59 smithi047 bash[22744]: cluster 2024-09-16T11:47:57.648322+0000 mgr.a (mgr.14373) 16034 : cluster [DBG] pgmap v11121: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:48:00.946 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:48:00.947 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:48:00.947 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:48:01.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:48:01 smithi157 bash[24585]: cluster 2024-09-16T11:47:59.649107+0000 mgr.a (mgr.14373) 16035 : cluster [DBG] pgmap v11122: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:48:01.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:48:01 smithi086 bash[24289]: cluster 2024-09-16T11:47:59.649107+0000 mgr.a (mgr.14373) 16035 : cluster [DBG] pgmap v11122: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:48:01.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:48:01 smithi047 bash[22744]: cluster 2024-09-16T11:47:59.649107+0000 mgr.a (mgr.14373) 16035 : cluster [DBG] pgmap v11122: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:48:01.724 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:48:01.724 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:48:01.724 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:48:01.724 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:48:01.724 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:48:02.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:48:02 smithi157 bash[24585]: audit 2024-09-16T11:48:01.276792+0000 mgr.a (mgr.14373) 16036 : audit [DBG] from='client.345852 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:48:02.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:48:02 smithi086 bash[24289]: audit 2024-09-16T11:48:01.276792+0000 mgr.a (mgr.14373) 16036 : audit [DBG] from='client.345852 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:48:02.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:48:02 smithi047 bash[22744]: audit 2024-09-16T11:48:01.276792+0000 mgr.a (mgr.14373) 16036 : audit [DBG] from='client.345852 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:48:03.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:48:03 smithi157 bash[24585]: cluster 2024-09-16T11:48:01.650435+0000 mgr.a (mgr.14373) 16037 : cluster [DBG] pgmap v11123: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-16T11:48:03.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:48:03 smithi086 bash[24289]: cluster 2024-09-16T11:48:01.650435+0000 mgr.a (mgr.14373) 16037 : cluster [DBG] pgmap v11123: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-16T11:48:03.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:48:03 smithi047 bash[22744]: cluster 2024-09-16T11:48:01.650435+0000 mgr.a (mgr.14373) 16037 : cluster [DBG] pgmap v11123: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-16T11:48:05.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:48:05 smithi157 bash[24585]: cluster 2024-09-16T11:48:03.651146+0000 mgr.a (mgr.14373) 16038 : cluster [DBG] pgmap v11124: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T11:48:05.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:48:05 smithi086 bash[24289]: cluster 2024-09-16T11:48:03.651146+0000 mgr.a (mgr.14373) 16038 : cluster [DBG] pgmap v11124: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T11:48:05.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:48:05 smithi047 bash[22744]: cluster 2024-09-16T11:48:03.651146+0000 mgr.a (mgr.14373) 16038 : cluster [DBG] pgmap v11124: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T11:48:06.725 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:48:06.726 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:48:06.726 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:48:07.531 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:48:07.532 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:48:07.532 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:48:07.532 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:48:07.532 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:48:07.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:48:07 smithi157 bash[24585]: cluster 2024-09-16T11:48:05.651888+0000 mgr.a (mgr.14373) 16039 : cluster [DBG] pgmap v11125: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T11:48:07.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:48:07 smithi086 bash[24289]: cluster 2024-09-16T11:48:05.651888+0000 mgr.a (mgr.14373) 16039 : cluster [DBG] pgmap v11125: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T11:48:07.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:48:07 smithi047 bash[22744]: cluster 2024-09-16T11:48:05.651888+0000 mgr.a (mgr.14373) 16039 : cluster [DBG] pgmap v11125: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T11:48:08.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:48:08 smithi157 bash[24585]: audit 2024-09-16T11:48:07.067341+0000 mgr.a (mgr.14373) 16040 : audit [DBG] from='client.345927 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:48:08.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:48:08 smithi086 bash[24289]: audit 2024-09-16T11:48:07.067341+0000 mgr.a (mgr.14373) 16040 : audit [DBG] from='client.345927 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:48:08.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:48:08 smithi047 bash[22744]: audit 2024-09-16T11:48:07.067341+0000 mgr.a (mgr.14373) 16040 : audit [DBG] from='client.345927 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:48:09.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:48:09 smithi157 bash[24585]: cluster 2024-09-16T11:48:07.654670+0000 mgr.a (mgr.14373) 16041 : cluster [DBG] pgmap v11126: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-16T11:48:09.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:48:09 smithi086 bash[24289]: cluster 2024-09-16T11:48:07.654670+0000 mgr.a (mgr.14373) 16041 : cluster [DBG] pgmap v11126: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-16T11:48:09.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:48:09 smithi047 bash[22744]: cluster 2024-09-16T11:48:07.654670+0000 mgr.a (mgr.14373) 16041 : cluster [DBG] pgmap v11126: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-16T11:48:11.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:48:11 smithi157 bash[24585]: cluster 2024-09-16T11:48:09.655607+0000 mgr.a (mgr.14373) 16042 : cluster [DBG] pgmap v11127: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 4.9 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-16T11:48:11.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:48:11 smithi086 bash[24289]: cluster 2024-09-16T11:48:09.655607+0000 mgr.a (mgr.14373) 16042 : cluster [DBG] pgmap v11127: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 4.9 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-16T11:48:11.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:48:11 smithi047 bash[22744]: cluster 2024-09-16T11:48:09.655607+0000 mgr.a (mgr.14373) 16042 : cluster [DBG] pgmap v11127: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 4.9 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-16T11:48:12.533 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:48:12.534 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:48:12.534 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:48:13.286 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:48:13.287 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:48:13.287 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:48:13.287 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:48:13.287 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:48:13.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:48:13 smithi157 bash[24585]: cluster 2024-09-16T11:48:11.657735+0000 mgr.a (mgr.14373) 16043 : cluster [DBG] pgmap v11128: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-16T11:48:13.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:48:13 smithi086 bash[24289]: cluster 2024-09-16T11:48:11.657735+0000 mgr.a (mgr.14373) 16043 : cluster [DBG] pgmap v11128: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-16T11:48:13.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:48:13 smithi047 bash[22744]: cluster 2024-09-16T11:48:11.657735+0000 mgr.a (mgr.14373) 16043 : cluster [DBG] pgmap v11128: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-16T11:48:14.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:48:14 smithi157 bash[24585]: audit 2024-09-16T11:48:12.864742+0000 mgr.a (mgr.14373) 16044 : audit [DBG] from='client.346005 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:48:14.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:48:14 smithi086 bash[24289]: audit 2024-09-16T11:48:12.864742+0000 mgr.a (mgr.14373) 16044 : audit [DBG] from='client.346005 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:48:14.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:48:14 smithi047 bash[22744]: audit 2024-09-16T11:48:12.864742+0000 mgr.a (mgr.14373) 16044 : audit [DBG] from='client.346005 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:48:15.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:48:15 smithi157 bash[24585]: cluster 2024-09-16T11:48:13.658930+0000 mgr.a (mgr.14373) 16045 : cluster [DBG] pgmap v11129: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 5.6 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-16T11:48:15.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:48:15 smithi086 bash[24289]: cluster 2024-09-16T11:48:13.658930+0000 mgr.a (mgr.14373) 16045 : cluster [DBG] pgmap v11129: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 5.6 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-16T11:48:15.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:48:15 smithi047 bash[22744]: cluster 2024-09-16T11:48:13.658930+0000 mgr.a (mgr.14373) 16045 : cluster [DBG] pgmap v11129: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 5.6 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-16T11:48:17.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:48:17 smithi157 bash[24585]: cluster 2024-09-16T11:48:15.659929+0000 mgr.a (mgr.14373) 16046 : cluster [DBG] pgmap v11130: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 5.6 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-16T11:48:17.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:48:17 smithi086 bash[24289]: cluster 2024-09-16T11:48:15.659929+0000 mgr.a (mgr.14373) 16046 : cluster [DBG] pgmap v11130: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 5.6 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-16T11:48:17.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:48:17 smithi047 bash[22744]: cluster 2024-09-16T11:48:15.659929+0000 mgr.a (mgr.14373) 16046 : cluster [DBG] pgmap v11130: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 5.6 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-16T11:48:18.288 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:48:18.288 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:48:18.288 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:48:19.042 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:48:19.042 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:48:19.042 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:48:19.042 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:48:19.042 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:48:19.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:48:19 smithi157 bash[24585]: cluster 2024-09-16T11:48:17.662315+0000 mgr.a (mgr.14373) 16047 : cluster [DBG] pgmap v11131: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-16T11:48:19.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:48:19 smithi086 bash[24289]: cluster 2024-09-16T11:48:17.662315+0000 mgr.a (mgr.14373) 16047 : cluster [DBG] pgmap v11131: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-16T11:48:19.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:48:19 smithi047 bash[22744]: cluster 2024-09-16T11:48:17.662315+0000 mgr.a (mgr.14373) 16047 : cluster [DBG] pgmap v11131: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-16T11:48:20.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:48:20 smithi157 bash[24585]: audit 2024-09-16T11:48:18.622303+0000 mgr.a (mgr.14373) 16048 : audit [DBG] from='client.346083 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:48:20.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:48:20 smithi086 bash[24289]: audit 2024-09-16T11:48:18.622303+0000 mgr.a (mgr.14373) 16048 : audit [DBG] from='client.346083 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:48:20.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:48:20 smithi047 bash[22744]: audit 2024-09-16T11:48:18.622303+0000 mgr.a (mgr.14373) 16048 : audit [DBG] from='client.346083 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:48:21.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:48:21 smithi157 bash[24585]: cluster 2024-09-16T11:48:19.663341+0000 mgr.a (mgr.14373) 16049 : cluster [DBG] pgmap v11132: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:48:21.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:48:21 smithi086 bash[24289]: cluster 2024-09-16T11:48:19.663341+0000 mgr.a (mgr.14373) 16049 : cluster [DBG] pgmap v11132: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:48:21.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:48:21 smithi047 bash[22744]: cluster 2024-09-16T11:48:19.663341+0000 mgr.a (mgr.14373) 16049 : cluster [DBG] pgmap v11132: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:48:23.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:48:23 smithi157 bash[24585]: cluster 2024-09-16T11:48:21.665464+0000 mgr.a (mgr.14373) 16050 : cluster [DBG] pgmap v11133: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:48:23.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:48:23 smithi086 bash[24289]: cluster 2024-09-16T11:48:21.665464+0000 mgr.a (mgr.14373) 16050 : cluster [DBG] pgmap v11133: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:48:23.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:48:23 smithi047 bash[22744]: cluster 2024-09-16T11:48:21.665464+0000 mgr.a (mgr.14373) 16050 : cluster [DBG] pgmap v11133: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:48:24.043 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:48:24.044 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:48:24.044 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:48:24.830 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:48:24.831 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:48:24.831 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:48:24.831 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:48:24.831 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:48:25.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:48:25 smithi157 bash[24585]: cluster 2024-09-16T11:48:23.666217+0000 mgr.a (mgr.14373) 16051 : cluster [DBG] pgmap v11134: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:48:25.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:48:25 smithi157 bash[24585]: audit 2024-09-16T11:48:24.376335+0000 mgr.a (mgr.14373) 16052 : audit [DBG] from='client.346158 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:48:25.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:48:25 smithi086 bash[24289]: cluster 2024-09-16T11:48:23.666217+0000 mgr.a (mgr.14373) 16051 : cluster [DBG] pgmap v11134: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:48:25.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:48:25 smithi086 bash[24289]: audit 2024-09-16T11:48:24.376335+0000 mgr.a (mgr.14373) 16052 : audit [DBG] from='client.346158 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:48:25.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:48:25 smithi047 bash[22744]: cluster 2024-09-16T11:48:23.666217+0000 mgr.a (mgr.14373) 16051 : cluster [DBG] pgmap v11134: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:48:25.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:48:25 smithi047 bash[22744]: audit 2024-09-16T11:48:24.376335+0000 mgr.a (mgr.14373) 16052 : audit [DBG] from='client.346158 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:48:26.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:48:26 smithi157 bash[24585]: audit 2024-09-16T11:48:25.704004+0000 mon.b (mon.2) 1458 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T11:48:26.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:48:26 smithi086 bash[24289]: audit 2024-09-16T11:48:25.704004+0000 mon.b (mon.2) 1458 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T11:48:26.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:48:26 smithi047 bash[22744]: audit 2024-09-16T11:48:25.704004+0000 mon.b (mon.2) 1458 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T11:48:27.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:48:27 smithi157 bash[24585]: cluster 2024-09-16T11:48:25.667172+0000 mgr.a (mgr.14373) 16053 : cluster [DBG] pgmap v11135: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:48:27.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:48:27 smithi157 bash[24585]: audit 2024-09-16T11:48:26.540435+0000 mon.b (mon.2) 1459 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T11:48:27.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:48:27 smithi157 bash[24585]: audit 2024-09-16T11:48:26.542795+0000 mon.b (mon.2) 1460 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T11:48:27.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:48:27 smithi157 bash[24585]: audit 2024-09-16T11:48:26.555635+0000 mon.a (mon.0) 1531 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:48:27.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:48:27 smithi157 bash[24585]: audit 2024-09-16T11:48:26.561810+0000 mon.b (mon.2) 1461 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:48:27.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:48:27 smithi086 bash[24289]: cluster 2024-09-16T11:48:25.667172+0000 mgr.a (mgr.14373) 16053 : cluster [DBG] pgmap v11135: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:48:27.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:48:27 smithi086 bash[24289]: audit 2024-09-16T11:48:26.540435+0000 mon.b (mon.2) 1459 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T11:48:27.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:48:27 smithi086 bash[24289]: audit 2024-09-16T11:48:26.542795+0000 mon.b (mon.2) 1460 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T11:48:27.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:48:27 smithi086 bash[24289]: audit 2024-09-16T11:48:26.555635+0000 mon.a (mon.0) 1531 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:48:27.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:48:27 smithi086 bash[24289]: audit 2024-09-16T11:48:26.561810+0000 mon.b (mon.2) 1461 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:48:27.592 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 11:48:27 smithi047 bash[22994]: debug 2024-09-16T11:48:27.316+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T11:48:27.593 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 11:48:27 smithi047 bash[22994]: debug 2024-09-16T11:48:27.320+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T11:48:27.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:48:27 smithi047 bash[22744]: cluster 2024-09-16T11:48:25.667172+0000 mgr.a (mgr.14373) 16053 : cluster [DBG] pgmap v11135: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:48:27.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:48:27 smithi047 bash[22744]: audit 2024-09-16T11:48:26.540435+0000 mon.b (mon.2) 1459 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T11:48:27.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:48:27 smithi047 bash[22744]: audit 2024-09-16T11:48:26.542795+0000 mon.b (mon.2) 1460 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T11:48:27.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:48:27 smithi047 bash[22744]: audit 2024-09-16T11:48:26.555635+0000 mon.a (mon.0) 1531 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:48:27.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:48:27 smithi047 bash[22744]: audit 2024-09-16T11:48:26.561810+0000 mon.b (mon.2) 1461 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:48:28.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:48:28 smithi157 bash[24585]: audit 2024-09-16T11:48:26.563362+0000 mgr.a (mgr.14373) 16054 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:48:28.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:48:28 smithi157 bash[24585]: audit 2024-09-16T11:48:27.321647+0000 mgr.a (mgr.14373) 16055 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T11:48:28.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:48:28 smithi157 bash[24585]: cephadm 2024-09-16T11:48:27.323624+0000 mgr.a (mgr.14373) 16056 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T11:48:28.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:48:28 smithi086 bash[24289]: audit 2024-09-16T11:48:26.563362+0000 mgr.a (mgr.14373) 16054 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:48:28.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:48:28 smithi086 bash[24289]: audit 2024-09-16T11:48:27.321647+0000 mgr.a (mgr.14373) 16055 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T11:48:28.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:48:28 smithi086 bash[24289]: cephadm 2024-09-16T11:48:27.323624+0000 mgr.a (mgr.14373) 16056 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T11:48:28.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:48:28 smithi047 bash[22744]: audit 2024-09-16T11:48:26.563362+0000 mgr.a (mgr.14373) 16054 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:48:28.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:48:28 smithi047 bash[22744]: audit 2024-09-16T11:48:27.321647+0000 mgr.a (mgr.14373) 16055 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T11:48:28.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:48:28 smithi047 bash[22744]: cephadm 2024-09-16T11:48:27.323624+0000 mgr.a (mgr.14373) 16056 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T11:48:29.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:48:29 smithi157 bash[24585]: cluster 2024-09-16T11:48:27.669910+0000 mgr.a (mgr.14373) 16057 : cluster [DBG] pgmap v11136: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:48:29.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:48:29 smithi086 bash[24289]: cluster 2024-09-16T11:48:27.669910+0000 mgr.a (mgr.14373) 16057 : cluster [DBG] pgmap v11136: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:48:29.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:48:29 smithi047 bash[22744]: cluster 2024-09-16T11:48:27.669910+0000 mgr.a (mgr.14373) 16057 : cluster [DBG] pgmap v11136: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:48:29.832 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:48:29.833 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:48:29.833 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:48:30.618 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:48:30.618 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:48:30.618 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:48:30.618 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:48:30.618 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:48:31.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:48:31 smithi157 bash[24585]: cluster 2024-09-16T11:48:29.670725+0000 mgr.a (mgr.14373) 16058 : cluster [DBG] pgmap v11137: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:48:31.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:48:31 smithi157 bash[24585]: audit 2024-09-16T11:48:30.168631+0000 mgr.a (mgr.14373) 16059 : audit [DBG] from='client.346341 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:48:31.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:48:31 smithi086 bash[24289]: cluster 2024-09-16T11:48:29.670725+0000 mgr.a (mgr.14373) 16058 : cluster [DBG] pgmap v11137: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:48:31.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:48:31 smithi086 bash[24289]: audit 2024-09-16T11:48:30.168631+0000 mgr.a (mgr.14373) 16059 : audit [DBG] from='client.346341 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:48:31.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:48:31 smithi047 bash[22744]: cluster 2024-09-16T11:48:29.670725+0000 mgr.a (mgr.14373) 16058 : cluster [DBG] pgmap v11137: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:48:31.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:48:31 smithi047 bash[22744]: audit 2024-09-16T11:48:30.168631+0000 mgr.a (mgr.14373) 16059 : audit [DBG] from='client.346341 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:48:33.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:48:33 smithi157 bash[24585]: cluster 2024-09-16T11:48:31.672970+0000 mgr.a (mgr.14373) 16060 : cluster [DBG] pgmap v11138: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:48:33.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:48:33 smithi086 bash[24289]: cluster 2024-09-16T11:48:31.672970+0000 mgr.a (mgr.14373) 16060 : cluster [DBG] pgmap v11138: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:48:33.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:48:33 smithi047 bash[22744]: cluster 2024-09-16T11:48:31.672970+0000 mgr.a (mgr.14373) 16060 : cluster [DBG] pgmap v11138: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:48:35.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:48:35 smithi157 bash[24585]: cluster 2024-09-16T11:48:33.673858+0000 mgr.a (mgr.14373) 16061 : cluster [DBG] pgmap v11139: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:48:35.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:48:35 smithi086 bash[24289]: cluster 2024-09-16T11:48:33.673858+0000 mgr.a (mgr.14373) 16061 : cluster [DBG] pgmap v11139: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:48:35.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:48:35 smithi047 bash[22744]: cluster 2024-09-16T11:48:33.673858+0000 mgr.a (mgr.14373) 16061 : cluster [DBG] pgmap v11139: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:48:35.619 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:48:35.620 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:48:35.620 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:48:36.402 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:48:36.402 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:48:36.402 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:48:36.402 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:48:36.402 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:48:37.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:48:37 smithi086 bash[24289]: cluster 2024-09-16T11:48:35.674638+0000 mgr.a (mgr.14373) 16062 : cluster [DBG] pgmap v11140: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:48:37.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:48:37 smithi086 bash[24289]: audit 2024-09-16T11:48:35.954997+0000 mgr.a (mgr.14373) 16063 : audit [DBG] from='client.346416 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:48:37.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:48:37 smithi047 bash[22744]: cluster 2024-09-16T11:48:35.674638+0000 mgr.a (mgr.14373) 16062 : cluster [DBG] pgmap v11140: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:48:37.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:48:37 smithi047 bash[22744]: audit 2024-09-16T11:48:35.954997+0000 mgr.a (mgr.14373) 16063 : audit [DBG] from='client.346416 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:48:37.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:48:37 smithi157 bash[24585]: cluster 2024-09-16T11:48:35.674638+0000 mgr.a (mgr.14373) 16062 : cluster [DBG] pgmap v11140: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:48:37.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:48:37 smithi157 bash[24585]: audit 2024-09-16T11:48:35.954997+0000 mgr.a (mgr.14373) 16063 : audit [DBG] from='client.346416 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:48:39.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:48:39 smithi086 bash[24289]: cluster 2024-09-16T11:48:37.677030+0000 mgr.a (mgr.14373) 16064 : cluster [DBG] pgmap v11141: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 71 KiB/s rd, 426 B/s wr, 113 op/s 2024-09-16T11:48:39.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:48:39 smithi047 bash[22744]: cluster 2024-09-16T11:48:37.677030+0000 mgr.a (mgr.14373) 16064 : cluster [DBG] pgmap v11141: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 71 KiB/s rd, 426 B/s wr, 113 op/s 2024-09-16T11:48:39.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:48:39 smithi157 bash[24585]: cluster 2024-09-16T11:48:37.677030+0000 mgr.a (mgr.14373) 16064 : cluster [DBG] pgmap v11141: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 71 KiB/s rd, 426 B/s wr, 113 op/s 2024-09-16T11:48:41.403 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:48:41.405 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:48:41.405 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:48:41.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:48:41 smithi086 bash[24289]: cluster 2024-09-16T11:48:39.677875+0000 mgr.a (mgr.14373) 16065 : cluster [DBG] pgmap v11142: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 70 KiB/s rd, 426 B/s wr, 112 op/s 2024-09-16T11:48:41.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:48:41 smithi047 bash[22744]: cluster 2024-09-16T11:48:39.677875+0000 mgr.a (mgr.14373) 16065 : cluster [DBG] pgmap v11142: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 70 KiB/s rd, 426 B/s wr, 112 op/s 2024-09-16T11:48:41.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:48:41 smithi157 bash[24585]: cluster 2024-09-16T11:48:39.677875+0000 mgr.a (mgr.14373) 16065 : cluster [DBG] pgmap v11142: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 70 KiB/s rd, 426 B/s wr, 112 op/s 2024-09-16T11:48:42.183 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:48:42.183 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:48:42.183 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:48:42.183 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:48:42.184 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:48:43.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:48:43 smithi047 bash[22744]: cluster 2024-09-16T11:48:41.679834+0000 mgr.a (mgr.14373) 16066 : cluster [DBG] pgmap v11143: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 70 KiB/s rd, 426 B/s wr, 112 op/s 2024-09-16T11:48:43.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:48:43 smithi047 bash[22744]: audit 2024-09-16T11:48:41.741625+0000 mgr.a (mgr.14373) 16067 : audit [DBG] from='client.346494 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:48:43.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:48:43 smithi157 bash[24585]: cluster 2024-09-16T11:48:41.679834+0000 mgr.a (mgr.14373) 16066 : cluster [DBG] pgmap v11143: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 70 KiB/s rd, 426 B/s wr, 112 op/s 2024-09-16T11:48:43.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:48:43 smithi157 bash[24585]: audit 2024-09-16T11:48:41.741625+0000 mgr.a (mgr.14373) 16067 : audit [DBG] from='client.346494 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:48:43.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:48:43 smithi086 bash[24289]: cluster 2024-09-16T11:48:41.679834+0000 mgr.a (mgr.14373) 16066 : cluster [DBG] pgmap v11143: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 70 KiB/s rd, 426 B/s wr, 112 op/s 2024-09-16T11:48:43.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:48:43 smithi086 bash[24289]: audit 2024-09-16T11:48:41.741625+0000 mgr.a (mgr.14373) 16067 : audit [DBG] from='client.346494 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:48:45.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:48:45 smithi047 bash[22744]: cluster 2024-09-16T11:48:43.680704+0000 mgr.a (mgr.14373) 16068 : cluster [DBG] pgmap v11144: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 64 KiB/s rd, 0 B/s wr, 106 op/s 2024-09-16T11:48:45.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:48:45 smithi157 bash[24585]: cluster 2024-09-16T11:48:43.680704+0000 mgr.a (mgr.14373) 16068 : cluster [DBG] pgmap v11144: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 64 KiB/s rd, 0 B/s wr, 106 op/s 2024-09-16T11:48:45.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:48:45 smithi086 bash[24289]: cluster 2024-09-16T11:48:43.680704+0000 mgr.a (mgr.14373) 16068 : cluster [DBG] pgmap v11144: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 64 KiB/s rd, 0 B/s wr, 106 op/s 2024-09-16T11:48:47.185 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:48:47.186 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:48:47.186 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:48:47.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:48:47 smithi047 bash[22744]: cluster 2024-09-16T11:48:45.681490+0000 mgr.a (mgr.14373) 16069 : cluster [DBG] pgmap v11145: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 64 KiB/s rd, 0 B/s wr, 106 op/s 2024-09-16T11:48:47.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:48:47 smithi157 bash[24585]: cluster 2024-09-16T11:48:45.681490+0000 mgr.a (mgr.14373) 16069 : cluster [DBG] pgmap v11145: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 64 KiB/s rd, 0 B/s wr, 106 op/s 2024-09-16T11:48:47.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:48:47 smithi086 bash[24289]: cluster 2024-09-16T11:48:45.681490+0000 mgr.a (mgr.14373) 16069 : cluster [DBG] pgmap v11145: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 64 KiB/s rd, 0 B/s wr, 106 op/s 2024-09-16T11:48:47.968 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:48:47.968 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:48:47.968 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:48:47.969 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:48:47.969 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:48:49.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:48:49 smithi047 bash[22744]: audit 2024-09-16T11:48:47.519995+0000 mgr.a (mgr.14373) 16070 : audit [DBG] from='client.346572 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:48:49.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:48:49 smithi047 bash[22744]: cluster 2024-09-16T11:48:47.682907+0000 mgr.a (mgr.14373) 16071 : cluster [DBG] pgmap v11146: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 65 KiB/s rd, 0 B/s wr, 107 op/s 2024-09-16T11:48:49.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:48:49 smithi157 bash[24585]: audit 2024-09-16T11:48:47.519995+0000 mgr.a (mgr.14373) 16070 : audit [DBG] from='client.346572 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:48:49.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:48:49 smithi157 bash[24585]: cluster 2024-09-16T11:48:47.682907+0000 mgr.a (mgr.14373) 16071 : cluster [DBG] pgmap v11146: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 65 KiB/s rd, 0 B/s wr, 107 op/s 2024-09-16T11:48:49.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:48:49 smithi086 bash[24289]: audit 2024-09-16T11:48:47.519995+0000 mgr.a (mgr.14373) 16070 : audit [DBG] from='client.346572 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:48:49.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:48:49 smithi086 bash[24289]: cluster 2024-09-16T11:48:47.682907+0000 mgr.a (mgr.14373) 16071 : cluster [DBG] pgmap v11146: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 65 KiB/s rd, 0 B/s wr, 107 op/s 2024-09-16T11:48:51.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:48:51 smithi047 bash[22744]: cluster 2024-09-16T11:48:49.683788+0000 mgr.a (mgr.14373) 16072 : cluster [DBG] pgmap v11147: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T11:48:51.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:48:51 smithi157 bash[24585]: cluster 2024-09-16T11:48:49.683788+0000 mgr.a (mgr.14373) 16072 : cluster [DBG] pgmap v11147: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T11:48:51.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:48:51 smithi086 bash[24289]: cluster 2024-09-16T11:48:49.683788+0000 mgr.a (mgr.14373) 16072 : cluster [DBG] pgmap v11147: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T11:48:52.970 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:48:52.970 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:48:52.970 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:48:53.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:48:53 smithi047 bash[22744]: cluster 2024-09-16T11:48:51.685927+0000 mgr.a (mgr.14373) 16073 : cluster [DBG] pgmap v11148: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:48:53.729 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:48:53.729 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:48:53.729 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:48:53.729 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:48:53.729 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:48:53.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:48:53 smithi157 bash[24585]: cluster 2024-09-16T11:48:51.685927+0000 mgr.a (mgr.14373) 16073 : cluster [DBG] pgmap v11148: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:48:53.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:48:53 smithi086 bash[24289]: cluster 2024-09-16T11:48:51.685927+0000 mgr.a (mgr.14373) 16073 : cluster [DBG] pgmap v11148: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:48:54.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:48:54 smithi157 bash[24585]: audit 2024-09-16T11:48:53.300278+0000 mgr.a (mgr.14373) 16074 : audit [DBG] from='client.346650 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:48:54.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:48:54 smithi086 bash[24289]: audit 2024-09-16T11:48:53.300278+0000 mgr.a (mgr.14373) 16074 : audit [DBG] from='client.346650 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:48:54.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:48:54 smithi047 bash[22744]: audit 2024-09-16T11:48:53.300278+0000 mgr.a (mgr.14373) 16074 : audit [DBG] from='client.346650 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:48:55.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:48:55 smithi157 bash[24585]: cluster 2024-09-16T11:48:53.686505+0000 mgr.a (mgr.14373) 16075 : cluster [DBG] pgmap v11149: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:48:55.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:48:55 smithi086 bash[24289]: cluster 2024-09-16T11:48:53.686505+0000 mgr.a (mgr.14373) 16075 : cluster [DBG] pgmap v11149: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:48:55.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:48:55 smithi047 bash[22744]: cluster 2024-09-16T11:48:53.686505+0000 mgr.a (mgr.14373) 16075 : cluster [DBG] pgmap v11149: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:48:57.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:48:57 smithi157 bash[24585]: cluster 2024-09-16T11:48:55.687233+0000 mgr.a (mgr.14373) 16076 : cluster [DBG] pgmap v11150: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:48:57.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:48:57 smithi086 bash[24289]: cluster 2024-09-16T11:48:55.687233+0000 mgr.a (mgr.14373) 16076 : cluster [DBG] pgmap v11150: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:48:57.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:48:57 smithi047 bash[22744]: cluster 2024-09-16T11:48:55.687233+0000 mgr.a (mgr.14373) 16076 : cluster [DBG] pgmap v11150: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:48:58.731 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:48:58.731 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:48:58.732 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:48:59.501 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:48:59.502 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:48:59.502 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:48:59.502 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:48:59.502 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:48:59.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:48:59 smithi157 bash[24585]: cluster 2024-09-16T11:48:57.689449+0000 mgr.a (mgr.14373) 16077 : cluster [DBG] pgmap v11151: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:48:59.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:48:59 smithi086 bash[24289]: cluster 2024-09-16T11:48:57.689449+0000 mgr.a (mgr.14373) 16077 : cluster [DBG] pgmap v11151: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:48:59.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:48:59 smithi047 bash[22744]: cluster 2024-09-16T11:48:57.689449+0000 mgr.a (mgr.14373) 16077 : cluster [DBG] pgmap v11151: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:49:00.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:49:00 smithi157 bash[24585]: audit 2024-09-16T11:48:59.068467+0000 mgr.a (mgr.14373) 16078 : audit [DBG] from='client.346725 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:49:00.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:49:00 smithi086 bash[24289]: audit 2024-09-16T11:48:59.068467+0000 mgr.a (mgr.14373) 16078 : audit [DBG] from='client.346725 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:49:00.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:49:00 smithi047 bash[22744]: audit 2024-09-16T11:48:59.068467+0000 mgr.a (mgr.14373) 16078 : audit [DBG] from='client.346725 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:49:01.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:49:01 smithi157 bash[24585]: cluster 2024-09-16T11:48:59.690416+0000 mgr.a (mgr.14373) 16079 : cluster [DBG] pgmap v11152: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:49:01.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:49:01 smithi086 bash[24289]: cluster 2024-09-16T11:48:59.690416+0000 mgr.a (mgr.14373) 16079 : cluster [DBG] pgmap v11152: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:49:01.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:49:01 smithi047 bash[22744]: cluster 2024-09-16T11:48:59.690416+0000 mgr.a (mgr.14373) 16079 : cluster [DBG] pgmap v11152: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:49:03.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:49:03 smithi157 bash[24585]: cluster 2024-09-16T11:49:01.692492+0000 mgr.a (mgr.14373) 16080 : cluster [DBG] pgmap v11153: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:49:03.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:49:03 smithi086 bash[24289]: cluster 2024-09-16T11:49:01.692492+0000 mgr.a (mgr.14373) 16080 : cluster [DBG] pgmap v11153: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:49:03.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:49:03 smithi047 bash[22744]: cluster 2024-09-16T11:49:01.692492+0000 mgr.a (mgr.14373) 16080 : cluster [DBG] pgmap v11153: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:49:04.503 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:49:04.504 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:49:04.504 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:49:05.275 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:49:05.276 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:49:05.276 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:49:05.276 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:49:05.277 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:49:05.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:49:05 smithi157 bash[24585]: cluster 2024-09-16T11:49:03.693242+0000 mgr.a (mgr.14373) 16081 : cluster [DBG] pgmap v11154: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:49:05.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:49:05 smithi086 bash[24289]: cluster 2024-09-16T11:49:03.693242+0000 mgr.a (mgr.14373) 16081 : cluster [DBG] pgmap v11154: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:49:05.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:49:05 smithi047 bash[22744]: cluster 2024-09-16T11:49:03.693242+0000 mgr.a (mgr.14373) 16081 : cluster [DBG] pgmap v11154: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:49:06.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:49:06 smithi157 bash[24585]: audit 2024-09-16T11:49:04.832941+0000 mgr.a (mgr.14373) 16082 : audit [DBG] from='client.346800 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:49:06.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:49:06 smithi086 bash[24289]: audit 2024-09-16T11:49:04.832941+0000 mgr.a (mgr.14373) 16082 : audit [DBG] from='client.346800 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:49:06.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:49:06 smithi047 bash[22744]: audit 2024-09-16T11:49:04.832941+0000 mgr.a (mgr.14373) 16082 : audit [DBG] from='client.346800 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:49:07.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:49:07 smithi157 bash[24585]: cluster 2024-09-16T11:49:05.694206+0000 mgr.a (mgr.14373) 16083 : cluster [DBG] pgmap v11155: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:49:07.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:49:07 smithi086 bash[24289]: cluster 2024-09-16T11:49:05.694206+0000 mgr.a (mgr.14373) 16083 : cluster [DBG] pgmap v11155: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:49:07.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:49:07 smithi047 bash[22744]: cluster 2024-09-16T11:49:05.694206+0000 mgr.a (mgr.14373) 16083 : cluster [DBG] pgmap v11155: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:49:09.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:49:09 smithi157 bash[24585]: cluster 2024-09-16T11:49:07.696474+0000 mgr.a (mgr.14373) 16084 : cluster [DBG] pgmap v11156: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:49:09.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:49:09 smithi086 bash[24289]: cluster 2024-09-16T11:49:07.696474+0000 mgr.a (mgr.14373) 16084 : cluster [DBG] pgmap v11156: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:49:09.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:49:09 smithi047 bash[22744]: cluster 2024-09-16T11:49:07.696474+0000 mgr.a (mgr.14373) 16084 : cluster [DBG] pgmap v11156: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:49:10.277 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:49:10.278 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:49:10.278 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:49:11.064 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:49:11.065 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:49:11.065 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:49:11.065 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:49:11.065 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:49:11.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:49:11 smithi157 bash[24585]: cluster 2024-09-16T11:49:09.697263+0000 mgr.a (mgr.14373) 16085 : cluster [DBG] pgmap v11157: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:49:11.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:49:11 smithi086 bash[24289]: cluster 2024-09-16T11:49:09.697263+0000 mgr.a (mgr.14373) 16085 : cluster [DBG] pgmap v11157: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:49:11.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:49:11 smithi047 bash[22744]: cluster 2024-09-16T11:49:09.697263+0000 mgr.a (mgr.14373) 16085 : cluster [DBG] pgmap v11157: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:49:12.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:49:12 smithi157 bash[24585]: audit 2024-09-16T11:49:10.613458+0000 mgr.a (mgr.14373) 16086 : audit [DBG] from='client.346878 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:49:12.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:49:12 smithi086 bash[24289]: audit 2024-09-16T11:49:10.613458+0000 mgr.a (mgr.14373) 16086 : audit [DBG] from='client.346878 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:49:12.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:49:12 smithi047 bash[22744]: audit 2024-09-16T11:49:10.613458+0000 mgr.a (mgr.14373) 16086 : audit [DBG] from='client.346878 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:49:13.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:49:13 smithi157 bash[24585]: cluster 2024-09-16T11:49:11.699568+0000 mgr.a (mgr.14373) 16087 : cluster [DBG] pgmap v11158: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:49:13.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:49:13 smithi086 bash[24289]: cluster 2024-09-16T11:49:11.699568+0000 mgr.a (mgr.14373) 16087 : cluster [DBG] pgmap v11158: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:49:13.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:49:13 smithi047 bash[22744]: cluster 2024-09-16T11:49:11.699568+0000 mgr.a (mgr.14373) 16087 : cluster [DBG] pgmap v11158: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:49:15.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:49:15 smithi157 bash[24585]: cluster 2024-09-16T11:49:13.700339+0000 mgr.a (mgr.14373) 16088 : cluster [DBG] pgmap v11159: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:49:15.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:49:15 smithi086 bash[24289]: cluster 2024-09-16T11:49:13.700339+0000 mgr.a (mgr.14373) 16088 : cluster [DBG] pgmap v11159: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:49:15.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:49:15 smithi047 bash[22744]: cluster 2024-09-16T11:49:13.700339+0000 mgr.a (mgr.14373) 16088 : cluster [DBG] pgmap v11159: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:49:16.066 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:49:16.067 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:49:16.067 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:49:16.843 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:49:16.843 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:49:16.843 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:49:16.843 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:49:16.843 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:49:17.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:49:17 smithi157 bash[24585]: cluster 2024-09-16T11:49:15.701114+0000 mgr.a (mgr.14373) 16089 : cluster [DBG] pgmap v11160: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:49:17.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:49:17 smithi157 bash[24585]: audit 2024-09-16T11:49:16.401190+0000 mgr.a (mgr.14373) 16090 : audit [DBG] from='client.346950 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:49:17.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:49:17 smithi086 bash[24289]: cluster 2024-09-16T11:49:15.701114+0000 mgr.a (mgr.14373) 16089 : cluster [DBG] pgmap v11160: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:49:17.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:49:17 smithi086 bash[24289]: audit 2024-09-16T11:49:16.401190+0000 mgr.a (mgr.14373) 16090 : audit [DBG] from='client.346950 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:49:17.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:49:17 smithi047 bash[22744]: cluster 2024-09-16T11:49:15.701114+0000 mgr.a (mgr.14373) 16089 : cluster [DBG] pgmap v11160: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:49:17.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:49:17 smithi047 bash[22744]: audit 2024-09-16T11:49:16.401190+0000 mgr.a (mgr.14373) 16090 : audit [DBG] from='client.346950 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:49:19.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:49:19 smithi157 bash[24585]: cluster 2024-09-16T11:49:17.703846+0000 mgr.a (mgr.14373) 16091 : cluster [DBG] pgmap v11161: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:49:19.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:49:19 smithi086 bash[24289]: cluster 2024-09-16T11:49:17.703846+0000 mgr.a (mgr.14373) 16091 : cluster [DBG] pgmap v11161: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:49:19.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:49:19 smithi047 bash[22744]: cluster 2024-09-16T11:49:17.703846+0000 mgr.a (mgr.14373) 16091 : cluster [DBG] pgmap v11161: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:49:21.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:49:21 smithi157 bash[24585]: cluster 2024-09-16T11:49:19.704657+0000 mgr.a (mgr.14373) 16092 : cluster [DBG] pgmap v11162: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:49:21.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:49:21 smithi086 bash[24289]: cluster 2024-09-16T11:49:19.704657+0000 mgr.a (mgr.14373) 16092 : cluster [DBG] pgmap v11162: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:49:21.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:49:21 smithi047 bash[22744]: cluster 2024-09-16T11:49:19.704657+0000 mgr.a (mgr.14373) 16092 : cluster [DBG] pgmap v11162: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:49:21.844 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:49:21.845 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:49:21.845 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:49:22.628 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:49:22.628 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:49:22.629 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:49:22.629 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:49:22.629 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:49:23.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:49:23 smithi157 bash[24585]: cluster 2024-09-16T11:49:21.706739+0000 mgr.a (mgr.14373) 16093 : cluster [DBG] pgmap v11163: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:49:23.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:49:23 smithi157 bash[24585]: audit 2024-09-16T11:49:22.177464+0000 mgr.a (mgr.14373) 16094 : audit [DBG] from='client.347028 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:49:23.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:49:23 smithi086 bash[24289]: cluster 2024-09-16T11:49:21.706739+0000 mgr.a (mgr.14373) 16093 : cluster [DBG] pgmap v11163: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:49:23.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:49:23 smithi086 bash[24289]: audit 2024-09-16T11:49:22.177464+0000 mgr.a (mgr.14373) 16094 : audit [DBG] from='client.347028 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:49:23.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:49:23 smithi047 bash[22744]: cluster 2024-09-16T11:49:21.706739+0000 mgr.a (mgr.14373) 16093 : cluster [DBG] pgmap v11163: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:49:23.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:49:23 smithi047 bash[22744]: audit 2024-09-16T11:49:22.177464+0000 mgr.a (mgr.14373) 16094 : audit [DBG] from='client.347028 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:49:25.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:49:25 smithi157 bash[24585]: cluster 2024-09-16T11:49:23.707608+0000 mgr.a (mgr.14373) 16095 : cluster [DBG] pgmap v11164: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:49:25.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:49:25 smithi086 bash[24289]: cluster 2024-09-16T11:49:23.707608+0000 mgr.a (mgr.14373) 16095 : cluster [DBG] pgmap v11164: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:49:25.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:49:25 smithi047 bash[22744]: cluster 2024-09-16T11:49:23.707608+0000 mgr.a (mgr.14373) 16095 : cluster [DBG] pgmap v11164: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:49:27.630 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:49:27.630 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:49:27.631 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:49:27.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:49:27 smithi157 bash[24585]: cluster 2024-09-16T11:49:25.708396+0000 mgr.a (mgr.14373) 16096 : cluster [DBG] pgmap v11165: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T11:49:27.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:49:27 smithi157 bash[24585]: audit 2024-09-16T11:49:27.376127+0000 mon.b (mon.2) 1462 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T11:49:27.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:49:27 smithi086 bash[24289]: cluster 2024-09-16T11:49:25.708396+0000 mgr.a (mgr.14373) 16096 : cluster [DBG] pgmap v11165: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T11:49:27.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:49:27 smithi086 bash[24289]: audit 2024-09-16T11:49:27.376127+0000 mon.b (mon.2) 1462 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T11:49:27.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:49:27 smithi047 bash[22744]: cluster 2024-09-16T11:49:25.708396+0000 mgr.a (mgr.14373) 16096 : cluster [DBG] pgmap v11165: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T11:49:27.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:49:27 smithi047 bash[22744]: audit 2024-09-16T11:49:27.376127+0000 mon.b (mon.2) 1462 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T11:49:28.379 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:49:28.379 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:49:28.379 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:49:28.379 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:49:28.379 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:49:28.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:49:28 smithi157 bash[24585]: audit 2024-09-16T11:49:28.256835+0000 mon.b (mon.2) 1463 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T11:49:28.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:49:28 smithi157 bash[24585]: audit 2024-09-16T11:49:28.258215+0000 mon.b (mon.2) 1464 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T11:49:28.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:49:28 smithi157 bash[24585]: audit 2024-09-16T11:49:28.265151+0000 mon.a (mon.0) 1532 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:49:28.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:49:28 smithi157 bash[24585]: audit 2024-09-16T11:49:28.269764+0000 mon.b (mon.2) 1465 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:49:28.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:49:28 smithi086 bash[24289]: audit 2024-09-16T11:49:28.256835+0000 mon.b (mon.2) 1463 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T11:49:28.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:49:28 smithi086 bash[24289]: audit 2024-09-16T11:49:28.258215+0000 mon.b (mon.2) 1464 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T11:49:28.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:49:28 smithi086 bash[24289]: audit 2024-09-16T11:49:28.265151+0000 mon.a (mon.0) 1532 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:49:28.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:49:28 smithi086 bash[24289]: audit 2024-09-16T11:49:28.269764+0000 mon.b (mon.2) 1465 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:49:28.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:49:28 smithi047 bash[22744]: audit 2024-09-16T11:49:28.256835+0000 mon.b (mon.2) 1463 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T11:49:28.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:49:28 smithi047 bash[22744]: audit 2024-09-16T11:49:28.258215+0000 mon.b (mon.2) 1464 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T11:49:28.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:49:28 smithi047 bash[22744]: audit 2024-09-16T11:49:28.265151+0000 mon.a (mon.0) 1532 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:49:28.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:49:28 smithi047 bash[22744]: audit 2024-09-16T11:49:28.269764+0000 mon.b (mon.2) 1465 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:49:29.342 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 11:49:29 smithi047 bash[22994]: debug 2024-09-16T11:49:29.063+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T11:49:29.343 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 11:49:29 smithi047 bash[22994]: debug 2024-09-16T11:49:29.063+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T11:49:29.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:49:29 smithi157 bash[24585]: cluster 2024-09-16T11:49:27.709435+0000 mgr.a (mgr.14373) 16097 : cluster [DBG] pgmap v11166: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:49:29.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:49:29 smithi157 bash[24585]: audit 2024-09-16T11:49:27.944431+0000 mgr.a (mgr.14373) 16098 : audit [DBG] from='client.347106 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:49:29.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:49:29 smithi157 bash[24585]: audit 2024-09-16T11:49:28.280532+0000 mgr.a (mgr.14373) 16099 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:49:29.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:49:29 smithi086 bash[24289]: cluster 2024-09-16T11:49:27.709435+0000 mgr.a (mgr.14373) 16097 : cluster [DBG] pgmap v11166: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:49:29.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:49:29 smithi086 bash[24289]: audit 2024-09-16T11:49:27.944431+0000 mgr.a (mgr.14373) 16098 : audit [DBG] from='client.347106 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:49:29.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:49:29 smithi086 bash[24289]: audit 2024-09-16T11:49:28.280532+0000 mgr.a (mgr.14373) 16099 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:49:29.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:49:29 smithi047 bash[22744]: cluster 2024-09-16T11:49:27.709435+0000 mgr.a (mgr.14373) 16097 : cluster [DBG] pgmap v11166: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:49:29.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:49:29 smithi047 bash[22744]: audit 2024-09-16T11:49:27.944431+0000 mgr.a (mgr.14373) 16098 : audit [DBG] from='client.347106 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:49:29.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:49:29 smithi047 bash[22744]: audit 2024-09-16T11:49:28.280532+0000 mgr.a (mgr.14373) 16099 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:49:30.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:49:30 smithi157 bash[24585]: audit 2024-09-16T11:49:29.067208+0000 mgr.a (mgr.14373) 16100 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T11:49:30.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:49:30 smithi157 bash[24585]: cephadm 2024-09-16T11:49:29.069404+0000 mgr.a (mgr.14373) 16101 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T11:49:30.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:49:30 smithi086 bash[24289]: audit 2024-09-16T11:49:29.067208+0000 mgr.a (mgr.14373) 16100 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T11:49:30.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:49:30 smithi086 bash[24289]: cephadm 2024-09-16T11:49:29.069404+0000 mgr.a (mgr.14373) 16101 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T11:49:30.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:49:30 smithi047 bash[22744]: audit 2024-09-16T11:49:29.067208+0000 mgr.a (mgr.14373) 16100 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T11:49:30.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:49:30 smithi047 bash[22744]: cephadm 2024-09-16T11:49:29.069404+0000 mgr.a (mgr.14373) 16101 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T11:49:31.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:49:31 smithi157 bash[24585]: cluster 2024-09-16T11:49:29.710507+0000 mgr.a (mgr.14373) 16102 : cluster [DBG] pgmap v11167: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:49:31.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:49:31 smithi086 bash[24289]: cluster 2024-09-16T11:49:29.710507+0000 mgr.a (mgr.14373) 16102 : cluster [DBG] pgmap v11167: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:49:31.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:49:31 smithi047 bash[22744]: cluster 2024-09-16T11:49:29.710507+0000 mgr.a (mgr.14373) 16102 : cluster [DBG] pgmap v11167: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:49:33.381 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:49:33.381 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:49:33.381 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:49:33.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:49:33 smithi157 bash[24585]: cluster 2024-09-16T11:49:31.712804+0000 mgr.a (mgr.14373) 16103 : cluster [DBG] pgmap v11168: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:49:33.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:49:33 smithi086 bash[24289]: cluster 2024-09-16T11:49:31.712804+0000 mgr.a (mgr.14373) 16103 : cluster [DBG] pgmap v11168: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:49:33.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:49:33 smithi047 bash[22744]: cluster 2024-09-16T11:49:31.712804+0000 mgr.a (mgr.14373) 16103 : cluster [DBG] pgmap v11168: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:49:34.129 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:49:34.130 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:49:34.130 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:49:34.130 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:49:34.130 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:49:35.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:49:35 smithi157 bash[24585]: audit 2024-09-16T11:49:33.707940+0000 mgr.a (mgr.14373) 16104 : audit [DBG] from='client.347283 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:49:35.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:49:35 smithi157 bash[24585]: cluster 2024-09-16T11:49:33.725805+0000 mgr.a (mgr.14373) 16105 : cluster [DBG] pgmap v11169: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 425 B/s wr, 7 op/s 2024-09-16T11:49:35.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:49:35 smithi086 bash[24289]: audit 2024-09-16T11:49:33.707940+0000 mgr.a (mgr.14373) 16104 : audit [DBG] from='client.347283 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:49:35.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:49:35 smithi086 bash[24289]: cluster 2024-09-16T11:49:33.725805+0000 mgr.a (mgr.14373) 16105 : cluster [DBG] pgmap v11169: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 425 B/s wr, 7 op/s 2024-09-16T11:49:35.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:49:35 smithi047 bash[22744]: audit 2024-09-16T11:49:33.707940+0000 mgr.a (mgr.14373) 16104 : audit [DBG] from='client.347283 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:49:35.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:49:35 smithi047 bash[22744]: cluster 2024-09-16T11:49:33.725805+0000 mgr.a (mgr.14373) 16105 : cluster [DBG] pgmap v11169: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 425 B/s wr, 7 op/s 2024-09-16T11:49:37.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:49:37 smithi157 bash[24585]: cluster 2024-09-16T11:49:35.726842+0000 mgr.a (mgr.14373) 16106 : cluster [DBG] pgmap v11170: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 425 B/s wr, 7 op/s 2024-09-16T11:49:37.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:49:37 smithi086 bash[24289]: cluster 2024-09-16T11:49:35.726842+0000 mgr.a (mgr.14373) 16106 : cluster [DBG] pgmap v11170: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 425 B/s wr, 7 op/s 2024-09-16T11:49:37.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:49:37 smithi047 bash[22744]: cluster 2024-09-16T11:49:35.726842+0000 mgr.a (mgr.14373) 16106 : cluster [DBG] pgmap v11170: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 425 B/s wr, 7 op/s 2024-09-16T11:49:39.131 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:49:39.132 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:49:39.132 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:49:39.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:49:39 smithi157 bash[24585]: cluster 2024-09-16T11:49:37.729086+0000 mgr.a (mgr.14373) 16107 : cluster [DBG] pgmap v11171: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 425 B/s wr, 7 op/s 2024-09-16T11:49:39.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:49:39 smithi086 bash[24289]: cluster 2024-09-16T11:49:37.729086+0000 mgr.a (mgr.14373) 16107 : cluster [DBG] pgmap v11171: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 425 B/s wr, 7 op/s 2024-09-16T11:49:39.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:49:39 smithi047 bash[22744]: cluster 2024-09-16T11:49:37.729086+0000 mgr.a (mgr.14373) 16107 : cluster [DBG] pgmap v11171: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 425 B/s wr, 7 op/s 2024-09-16T11:49:39.881 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:49:39.882 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:49:39.882 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:49:39.882 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:49:39.882 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:49:40.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:49:40 smithi157 bash[24585]: audit 2024-09-16T11:49:39.463333+0000 mgr.a (mgr.14373) 16108 : audit [DBG] from='client.347355 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:49:40.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:49:40 smithi086 bash[24289]: audit 2024-09-16T11:49:39.463333+0000 mgr.a (mgr.14373) 16108 : audit [DBG] from='client.347355 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:49:40.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:49:40 smithi047 bash[22744]: audit 2024-09-16T11:49:39.463333+0000 mgr.a (mgr.14373) 16108 : audit [DBG] from='client.347355 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:49:41.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:49:41 smithi157 bash[24585]: cluster 2024-09-16T11:49:39.729608+0000 mgr.a (mgr.14373) 16109 : cluster [DBG] pgmap v11172: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 425 B/s wr, 7 op/s 2024-09-16T11:49:41.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:49:41 smithi086 bash[24289]: cluster 2024-09-16T11:49:39.729608+0000 mgr.a (mgr.14373) 16109 : cluster [DBG] pgmap v11172: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 425 B/s wr, 7 op/s 2024-09-16T11:49:41.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:49:41 smithi047 bash[22744]: cluster 2024-09-16T11:49:39.729608+0000 mgr.a (mgr.14373) 16109 : cluster [DBG] pgmap v11172: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 425 B/s wr, 7 op/s 2024-09-16T11:49:43.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:49:43 smithi157 bash[24585]: cluster 2024-09-16T11:49:41.731846+0000 mgr.a (mgr.14373) 16110 : cluster [DBG] pgmap v11173: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 425 B/s wr, 7 op/s 2024-09-16T11:49:43.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:49:43 smithi086 bash[24289]: cluster 2024-09-16T11:49:41.731846+0000 mgr.a (mgr.14373) 16110 : cluster [DBG] pgmap v11173: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 425 B/s wr, 7 op/s 2024-09-16T11:49:43.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:49:43 smithi047 bash[22744]: cluster 2024-09-16T11:49:41.731846+0000 mgr.a (mgr.14373) 16110 : cluster [DBG] pgmap v11173: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 425 B/s wr, 7 op/s 2024-09-16T11:49:44.883 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:49:44.883 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:49:44.883 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:49:45.657 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:49:45.658 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:49:45.658 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:49:45.658 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:49:45.658 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:49:45.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:49:45 smithi157 bash[24585]: cluster 2024-09-16T11:49:43.732603+0000 mgr.a (mgr.14373) 16111 : cluster [DBG] pgmap v11174: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:49:45.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:49:45 smithi086 bash[24289]: cluster 2024-09-16T11:49:43.732603+0000 mgr.a (mgr.14373) 16111 : cluster [DBG] pgmap v11174: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:49:45.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:49:45 smithi047 bash[22744]: cluster 2024-09-16T11:49:43.732603+0000 mgr.a (mgr.14373) 16111 : cluster [DBG] pgmap v11174: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:49:46.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:49:46 smithi157 bash[24585]: audit 2024-09-16T11:49:45.213596+0000 mgr.a (mgr.14373) 16112 : audit [DBG] from='client.347430 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:49:46.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:49:46 smithi086 bash[24289]: audit 2024-09-16T11:49:45.213596+0000 mgr.a (mgr.14373) 16112 : audit [DBG] from='client.347430 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:49:46.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:49:46 smithi047 bash[22744]: audit 2024-09-16T11:49:45.213596+0000 mgr.a (mgr.14373) 16112 : audit [DBG] from='client.347430 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:49:47.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:49:47 smithi157 bash[24585]: cluster 2024-09-16T11:49:45.733554+0000 mgr.a (mgr.14373) 16113 : cluster [DBG] pgmap v11175: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:49:47.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:49:47 smithi086 bash[24289]: cluster 2024-09-16T11:49:45.733554+0000 mgr.a (mgr.14373) 16113 : cluster [DBG] pgmap v11175: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:49:47.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:49:47 smithi047 bash[22744]: cluster 2024-09-16T11:49:45.733554+0000 mgr.a (mgr.14373) 16113 : cluster [DBG] pgmap v11175: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:49:49.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:49:49 smithi157 bash[24585]: cluster 2024-09-16T11:49:47.735877+0000 mgr.a (mgr.14373) 16114 : cluster [DBG] pgmap v11176: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:49:49.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:49:49 smithi086 bash[24289]: cluster 2024-09-16T11:49:47.735877+0000 mgr.a (mgr.14373) 16114 : cluster [DBG] pgmap v11176: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:49:49.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:49:49 smithi047 bash[22744]: cluster 2024-09-16T11:49:47.735877+0000 mgr.a (mgr.14373) 16114 : cluster [DBG] pgmap v11176: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:49:50.659 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:49:50.659 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:49:50.660 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:49:51.399 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:49:51.399 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:49:51.399 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:49:51.399 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:49:51.399 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:49:51.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:49:51 smithi157 bash[24585]: cluster 2024-09-16T11:49:49.736668+0000 mgr.a (mgr.14373) 16115 : cluster [DBG] pgmap v11177: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:49:51.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:49:51 smithi086 bash[24289]: cluster 2024-09-16T11:49:49.736668+0000 mgr.a (mgr.14373) 16115 : cluster [DBG] pgmap v11177: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:49:51.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:49:51 smithi047 bash[22744]: cluster 2024-09-16T11:49:49.736668+0000 mgr.a (mgr.14373) 16115 : cluster [DBG] pgmap v11177: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:49:52.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:49:52 smithi157 bash[24585]: audit 2024-09-16T11:49:50.990937+0000 mgr.a (mgr.14373) 16116 : audit [DBG] from='client.347508 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:49:52.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:49:52 smithi086 bash[24289]: audit 2024-09-16T11:49:50.990937+0000 mgr.a (mgr.14373) 16116 : audit [DBG] from='client.347508 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:49:52.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:49:52 smithi047 bash[22744]: audit 2024-09-16T11:49:50.990937+0000 mgr.a (mgr.14373) 16116 : audit [DBG] from='client.347508 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:49:53.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:49:53 smithi157 bash[24585]: cluster 2024-09-16T11:49:51.738920+0000 mgr.a (mgr.14373) 16117 : cluster [DBG] pgmap v11178: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:49:53.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:49:53 smithi086 bash[24289]: cluster 2024-09-16T11:49:51.738920+0000 mgr.a (mgr.14373) 16117 : cluster [DBG] pgmap v11178: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:49:53.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:49:53 smithi047 bash[22744]: cluster 2024-09-16T11:49:51.738920+0000 mgr.a (mgr.14373) 16117 : cluster [DBG] pgmap v11178: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:49:54.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:49:54 smithi047 bash[22744]: cluster 2024-09-16T11:49:53.739683+0000 mgr.a (mgr.14373) 16118 : cluster [DBG] pgmap v11179: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:49:55.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:49:54 smithi157 bash[24585]: cluster 2024-09-16T11:49:53.739683+0000 mgr.a (mgr.14373) 16118 : cluster [DBG] pgmap v11179: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:49:55.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:49:54 smithi086 bash[24289]: cluster 2024-09-16T11:49:53.739683+0000 mgr.a (mgr.14373) 16118 : cluster [DBG] pgmap v11179: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:49:56.401 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:49:56.401 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:49:56.402 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:49:57.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:49:56 smithi157 bash[24585]: cluster 2024-09-16T11:49:55.740417+0000 mgr.a (mgr.14373) 16119 : cluster [DBG] pgmap v11180: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:49:57.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:49:56 smithi086 bash[24289]: cluster 2024-09-16T11:49:55.740417+0000 mgr.a (mgr.14373) 16119 : cluster [DBG] pgmap v11180: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:49:57.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:49:56 smithi047 bash[22744]: cluster 2024-09-16T11:49:55.740417+0000 mgr.a (mgr.14373) 16119 : cluster [DBG] pgmap v11180: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:49:57.191 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:49:57.191 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:49:57.191 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:49:57.191 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:49:57.191 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:49:58.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:49:57 smithi086 bash[24289]: audit 2024-09-16T11:49:56.739187+0000 mgr.a (mgr.14373) 16120 : audit [DBG] from='client.347583 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:49:58.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:49:57 smithi047 bash[22744]: audit 2024-09-16T11:49:56.739187+0000 mgr.a (mgr.14373) 16120 : audit [DBG] from='client.347583 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:49:58.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:49:57 smithi157 bash[24585]: audit 2024-09-16T11:49:56.739187+0000 mgr.a (mgr.14373) 16120 : audit [DBG] from='client.347583 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:49:59.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:49:58 smithi086 bash[24289]: cluster 2024-09-16T11:49:57.743288+0000 mgr.a (mgr.14373) 16121 : cluster [DBG] pgmap v11181: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:49:59.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:49:58 smithi047 bash[22744]: cluster 2024-09-16T11:49:57.743288+0000 mgr.a (mgr.14373) 16121 : cluster [DBG] pgmap v11181: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:49:59.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:49:58 smithi157 bash[24585]: cluster 2024-09-16T11:49:57.743288+0000 mgr.a (mgr.14373) 16121 : cluster [DBG] pgmap v11181: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:50:01.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:50:00 smithi086 bash[24289]: cluster 2024-09-16T11:49:59.744109+0000 mgr.a (mgr.14373) 16122 : cluster [DBG] pgmap v11182: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:50:01.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:50:00 smithi086 bash[24289]: cluster 2024-09-16T11:50:00.000148+0000 mon.a (mon.0) 1533 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-16T11:50:01.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:50:00 smithi047 bash[22744]: cluster 2024-09-16T11:49:59.744109+0000 mgr.a (mgr.14373) 16122 : cluster [DBG] pgmap v11182: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:50:01.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:50:00 smithi047 bash[22744]: cluster 2024-09-16T11:50:00.000148+0000 mon.a (mon.0) 1533 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-16T11:50:01.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:50:00 smithi157 bash[24585]: cluster 2024-09-16T11:49:59.744109+0000 mgr.a (mgr.14373) 16122 : cluster [DBG] pgmap v11182: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:50:01.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:50:00 smithi157 bash[24585]: cluster 2024-09-16T11:50:00.000148+0000 mon.a (mon.0) 1533 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-16T11:50:02.192 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:50:02.193 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:50:02.193 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:50:02.979 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:50:02.979 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:50:02.980 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:50:02.980 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:50:02.980 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:50:03.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:50:02 smithi086 bash[24289]: cluster 2024-09-16T11:50:01.746064+0000 mgr.a (mgr.14373) 16123 : cluster [DBG] pgmap v11183: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:50:03.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:50:02 smithi047 bash[22744]: cluster 2024-09-16T11:50:01.746064+0000 mgr.a (mgr.14373) 16123 : cluster [DBG] pgmap v11183: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:50:03.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:50:02 smithi157 bash[24585]: cluster 2024-09-16T11:50:01.746064+0000 mgr.a (mgr.14373) 16123 : cluster [DBG] pgmap v11183: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:50:04.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:50:03 smithi047 bash[22744]: audit 2024-09-16T11:50:02.530641+0000 mgr.a (mgr.14373) 16124 : audit [DBG] from='client.347658 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:50:04.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:50:03 smithi157 bash[24585]: audit 2024-09-16T11:50:02.530641+0000 mgr.a (mgr.14373) 16124 : audit [DBG] from='client.347658 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:50:04.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:50:03 smithi086 bash[24289]: audit 2024-09-16T11:50:02.530641+0000 mgr.a (mgr.14373) 16124 : audit [DBG] from='client.347658 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:50:05.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:50:04 smithi047 bash[22744]: cluster 2024-09-16T11:50:03.746958+0000 mgr.a (mgr.14373) 16125 : cluster [DBG] pgmap v11184: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:50:05.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:50:04 smithi157 bash[24585]: cluster 2024-09-16T11:50:03.746958+0000 mgr.a (mgr.14373) 16125 : cluster [DBG] pgmap v11184: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:50:05.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:50:04 smithi086 bash[24289]: cluster 2024-09-16T11:50:03.746958+0000 mgr.a (mgr.14373) 16125 : cluster [DBG] pgmap v11184: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:50:07.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:50:06 smithi047 bash[22744]: cluster 2024-09-16T11:50:05.747778+0000 mgr.a (mgr.14373) 16126 : cluster [DBG] pgmap v11185: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T11:50:07.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:50:06 smithi157 bash[24585]: cluster 2024-09-16T11:50:05.747778+0000 mgr.a (mgr.14373) 16126 : cluster [DBG] pgmap v11185: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T11:50:07.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:50:06 smithi086 bash[24289]: cluster 2024-09-16T11:50:05.747778+0000 mgr.a (mgr.14373) 16126 : cluster [DBG] pgmap v11185: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T11:50:07.981 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:50:07.981 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:50:07.982 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:50:08.754 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:50:08.754 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:50:08.754 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:50:08.754 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:50:08.754 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:50:09.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:50:08 smithi047 bash[22744]: cluster 2024-09-16T11:50:07.750417+0000 mgr.a (mgr.14373) 16127 : cluster [DBG] pgmap v11186: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:50:09.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:50:08 smithi047 bash[22744]: audit 2024-09-16T11:50:08.315427+0000 mgr.a (mgr.14373) 16128 : audit [DBG] from='client.347736 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:50:09.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:50:08 smithi157 bash[24585]: cluster 2024-09-16T11:50:07.750417+0000 mgr.a (mgr.14373) 16127 : cluster [DBG] pgmap v11186: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:50:09.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:50:08 smithi157 bash[24585]: audit 2024-09-16T11:50:08.315427+0000 mgr.a (mgr.14373) 16128 : audit [DBG] from='client.347736 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:50:09.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:50:08 smithi086 bash[24289]: cluster 2024-09-16T11:50:07.750417+0000 mgr.a (mgr.14373) 16127 : cluster [DBG] pgmap v11186: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:50:09.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:50:08 smithi086 bash[24289]: audit 2024-09-16T11:50:08.315427+0000 mgr.a (mgr.14373) 16128 : audit [DBG] from='client.347736 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:50:11.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:50:10 smithi047 bash[22744]: cluster 2024-09-16T11:50:09.751239+0000 mgr.a (mgr.14373) 16129 : cluster [DBG] pgmap v11187: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:50:11.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:50:10 smithi157 bash[24585]: cluster 2024-09-16T11:50:09.751239+0000 mgr.a (mgr.14373) 16129 : cluster [DBG] pgmap v11187: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:50:11.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:50:10 smithi086 bash[24289]: cluster 2024-09-16T11:50:09.751239+0000 mgr.a (mgr.14373) 16129 : cluster [DBG] pgmap v11187: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:50:13.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:50:12 smithi157 bash[24585]: cluster 2024-09-16T11:50:11.753372+0000 mgr.a (mgr.14373) 16130 : cluster [DBG] pgmap v11188: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:50:13.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:50:12 smithi086 bash[24289]: cluster 2024-09-16T11:50:11.753372+0000 mgr.a (mgr.14373) 16130 : cluster [DBG] pgmap v11188: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:50:13.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:50:12 smithi047 bash[22744]: cluster 2024-09-16T11:50:11.753372+0000 mgr.a (mgr.14373) 16130 : cluster [DBG] pgmap v11188: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:50:13.755 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:50:13.757 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:50:13.757 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:50:14.541 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:50:14.542 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:50:14.542 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:50:14.542 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:50:14.542 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:50:15.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:50:14 smithi157 bash[24585]: cluster 2024-09-16T11:50:13.754126+0000 mgr.a (mgr.14373) 16131 : cluster [DBG] pgmap v11189: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:50:15.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:50:14 smithi157 bash[24585]: audit 2024-09-16T11:50:14.095537+0000 mgr.a (mgr.14373) 16132 : audit [DBG] from='client.347814 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:50:15.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:50:14 smithi086 bash[24289]: cluster 2024-09-16T11:50:13.754126+0000 mgr.a (mgr.14373) 16131 : cluster [DBG] pgmap v11189: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:50:15.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:50:14 smithi086 bash[24289]: audit 2024-09-16T11:50:14.095537+0000 mgr.a (mgr.14373) 16132 : audit [DBG] from='client.347814 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:50:15.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:50:14 smithi047 bash[22744]: cluster 2024-09-16T11:50:13.754126+0000 mgr.a (mgr.14373) 16131 : cluster [DBG] pgmap v11189: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:50:15.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:50:14 smithi047 bash[22744]: audit 2024-09-16T11:50:14.095537+0000 mgr.a (mgr.14373) 16132 : audit [DBG] from='client.347814 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:50:17.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:50:16 smithi157 bash[24585]: cluster 2024-09-16T11:50:15.755014+0000 mgr.a (mgr.14373) 16133 : cluster [DBG] pgmap v11190: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:50:17.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:50:16 smithi086 bash[24289]: cluster 2024-09-16T11:50:15.755014+0000 mgr.a (mgr.14373) 16133 : cluster [DBG] pgmap v11190: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:50:17.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:50:16 smithi047 bash[22744]: cluster 2024-09-16T11:50:15.755014+0000 mgr.a (mgr.14373) 16133 : cluster [DBG] pgmap v11190: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:50:19.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:50:18 smithi157 bash[24585]: cluster 2024-09-16T11:50:17.757240+0000 mgr.a (mgr.14373) 16134 : cluster [DBG] pgmap v11191: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:50:19.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:50:18 smithi086 bash[24289]: cluster 2024-09-16T11:50:17.757240+0000 mgr.a (mgr.14373) 16134 : cluster [DBG] pgmap v11191: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:50:19.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:50:18 smithi047 bash[22744]: cluster 2024-09-16T11:50:17.757240+0000 mgr.a (mgr.14373) 16134 : cluster [DBG] pgmap v11191: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:50:19.543 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:50:19.544 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:50:19.544 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:50:20.315 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:50:20.315 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:50:20.315 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:50:20.315 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:50:20.316 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:50:21.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:50:20 smithi157 bash[24585]: cluster 2024-09-16T11:50:19.757979+0000 mgr.a (mgr.14373) 16135 : cluster [DBG] pgmap v11192: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:50:21.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:50:20 smithi157 bash[24585]: audit 2024-09-16T11:50:19.879327+0000 mgr.a (mgr.14373) 16136 : audit [DBG] from='client.347889 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:50:21.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:50:20 smithi086 bash[24289]: cluster 2024-09-16T11:50:19.757979+0000 mgr.a (mgr.14373) 16135 : cluster [DBG] pgmap v11192: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:50:21.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:50:20 smithi086 bash[24289]: audit 2024-09-16T11:50:19.879327+0000 mgr.a (mgr.14373) 16136 : audit [DBG] from='client.347889 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:50:21.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:50:20 smithi047 bash[22744]: cluster 2024-09-16T11:50:19.757979+0000 mgr.a (mgr.14373) 16135 : cluster [DBG] pgmap v11192: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:50:21.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:50:20 smithi047 bash[22744]: audit 2024-09-16T11:50:19.879327+0000 mgr.a (mgr.14373) 16136 : audit [DBG] from='client.347889 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:50:23.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:50:22 smithi157 bash[24585]: cluster 2024-09-16T11:50:21.760262+0000 mgr.a (mgr.14373) 16137 : cluster [DBG] pgmap v11193: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:50:23.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:50:22 smithi086 bash[24289]: cluster 2024-09-16T11:50:21.760262+0000 mgr.a (mgr.14373) 16137 : cluster [DBG] pgmap v11193: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:50:23.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:50:22 smithi047 bash[22744]: cluster 2024-09-16T11:50:21.760262+0000 mgr.a (mgr.14373) 16137 : cluster [DBG] pgmap v11193: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:50:25.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:50:24 smithi157 bash[24585]: cluster 2024-09-16T11:50:23.760996+0000 mgr.a (mgr.14373) 16138 : cluster [DBG] pgmap v11194: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:50:25.316 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:50:25.317 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:50:25.317 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:50:25.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:50:24 smithi086 bash[24289]: cluster 2024-09-16T11:50:23.760996+0000 mgr.a (mgr.14373) 16138 : cluster [DBG] pgmap v11194: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:50:25.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:50:24 smithi047 bash[22744]: cluster 2024-09-16T11:50:23.760996+0000 mgr.a (mgr.14373) 16138 : cluster [DBG] pgmap v11194: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:50:26.094 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:50:26.094 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:50:26.094 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:50:26.095 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:50:26.095 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:50:27.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:50:26 smithi157 bash[24585]: audit 2024-09-16T11:50:25.649638+0000 mgr.a (mgr.14373) 16139 : audit [DBG] from='client.347961 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:50:27.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:50:26 smithi157 bash[24585]: cluster 2024-09-16T11:50:25.761458+0000 mgr.a (mgr.14373) 16140 : cluster [DBG] pgmap v11195: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:50:27.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:50:26 smithi086 bash[24289]: audit 2024-09-16T11:50:25.649638+0000 mgr.a (mgr.14373) 16139 : audit [DBG] from='client.347961 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:50:27.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:50:26 smithi086 bash[24289]: cluster 2024-09-16T11:50:25.761458+0000 mgr.a (mgr.14373) 16140 : cluster [DBG] pgmap v11195: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:50:27.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:50:26 smithi047 bash[22744]: audit 2024-09-16T11:50:25.649638+0000 mgr.a (mgr.14373) 16139 : audit [DBG] from='client.347961 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:50:27.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:50:26 smithi047 bash[22744]: cluster 2024-09-16T11:50:25.761458+0000 mgr.a (mgr.14373) 16140 : cluster [DBG] pgmap v11195: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:50:29.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:50:28 smithi157 bash[24585]: cluster 2024-09-16T11:50:27.763842+0000 mgr.a (mgr.14373) 16141 : cluster [DBG] pgmap v11196: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:50:29.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:50:28 smithi086 bash[24289]: cluster 2024-09-16T11:50:27.763842+0000 mgr.a (mgr.14373) 16141 : cluster [DBG] pgmap v11196: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:50:29.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:50:28 smithi047 bash[22744]: cluster 2024-09-16T11:50:27.763842+0000 mgr.a (mgr.14373) 16141 : cluster [DBG] pgmap v11196: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:50:30.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:50:29 smithi157 bash[24585]: audit 2024-09-16T11:50:29.119826+0000 mon.b (mon.2) 1466 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T11:50:30.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:50:29 smithi086 bash[24289]: audit 2024-09-16T11:50:29.119826+0000 mon.b (mon.2) 1466 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T11:50:30.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:50:29 smithi047 bash[22744]: audit 2024-09-16T11:50:29.119826+0000 mon.b (mon.2) 1466 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T11:50:31.093 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 11:50:30 smithi047 bash[22994]: debug 2024-09-16T11:50:30.726+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T11:50:31.093 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 11:50:30 smithi047 bash[22994]: debug 2024-09-16T11:50:30.730+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T11:50:31.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:50:30 smithi047 bash[22744]: cluster 2024-09-16T11:50:29.764472+0000 mgr.a (mgr.14373) 16142 : cluster [DBG] pgmap v11197: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:50:31.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:50:30 smithi047 bash[22744]: audit 2024-09-16T11:50:29.945323+0000 mon.b (mon.2) 1467 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T11:50:31.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:50:30 smithi047 bash[22744]: audit 2024-09-16T11:50:29.947349+0000 mon.b (mon.2) 1468 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T11:50:31.094 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:50:30 smithi047 bash[22744]: audit 2024-09-16T11:50:29.958776+0000 mon.a (mon.0) 1534 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:50:31.094 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:50:30 smithi047 bash[22744]: audit 2024-09-16T11:50:29.963805+0000 mon.b (mon.2) 1469 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:50:31.094 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:50:30 smithi047 bash[22744]: audit 2024-09-16T11:50:29.966428+0000 mgr.a (mgr.14373) 16143 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:50:31.095 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:50:31.096 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:50:31.096 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:50:31.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:50:30 smithi157 bash[24585]: cluster 2024-09-16T11:50:29.764472+0000 mgr.a (mgr.14373) 16142 : cluster [DBG] pgmap v11197: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:50:31.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:50:30 smithi157 bash[24585]: audit 2024-09-16T11:50:29.945323+0000 mon.b (mon.2) 1467 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T11:50:31.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:50:30 smithi157 bash[24585]: audit 2024-09-16T11:50:29.947349+0000 mon.b (mon.2) 1468 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T11:50:31.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:50:30 smithi157 bash[24585]: audit 2024-09-16T11:50:29.958776+0000 mon.a (mon.0) 1534 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:50:31.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:50:30 smithi157 bash[24585]: audit 2024-09-16T11:50:29.963805+0000 mon.b (mon.2) 1469 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:50:31.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:50:30 smithi157 bash[24585]: audit 2024-09-16T11:50:29.966428+0000 mgr.a (mgr.14373) 16143 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:50:31.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:50:30 smithi086 bash[24289]: cluster 2024-09-16T11:50:29.764472+0000 mgr.a (mgr.14373) 16142 : cluster [DBG] pgmap v11197: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:50:31.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:50:30 smithi086 bash[24289]: audit 2024-09-16T11:50:29.945323+0000 mon.b (mon.2) 1467 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T11:50:31.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:50:30 smithi086 bash[24289]: audit 2024-09-16T11:50:29.947349+0000 mon.b (mon.2) 1468 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T11:50:31.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:50:30 smithi086 bash[24289]: audit 2024-09-16T11:50:29.958776+0000 mon.a (mon.0) 1534 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:50:31.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:50:30 smithi086 bash[24289]: audit 2024-09-16T11:50:29.963805+0000 mon.b (mon.2) 1469 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:50:31.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:50:30 smithi086 bash[24289]: audit 2024-09-16T11:50:29.966428+0000 mgr.a (mgr.14373) 16143 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:50:31.884 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:50:31.884 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:50:31.884 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:50:31.884 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:50:31.884 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:50:32.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:50:31 smithi157 bash[24585]: audit 2024-09-16T11:50:30.730156+0000 mgr.a (mgr.14373) 16144 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T11:50:32.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:50:31 smithi157 bash[24585]: cephadm 2024-09-16T11:50:30.732405+0000 mgr.a (mgr.14373) 16145 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T11:50:32.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:50:31 smithi157 bash[24585]: audit 2024-09-16T11:50:31.431238+0000 mgr.a (mgr.14373) 16146 : audit [DBG] from='client.348138 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:50:32.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:50:31 smithi086 bash[24289]: audit 2024-09-16T11:50:30.730156+0000 mgr.a (mgr.14373) 16144 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T11:50:32.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:50:31 smithi086 bash[24289]: cephadm 2024-09-16T11:50:30.732405+0000 mgr.a (mgr.14373) 16145 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T11:50:32.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:50:31 smithi086 bash[24289]: audit 2024-09-16T11:50:31.431238+0000 mgr.a (mgr.14373) 16146 : audit [DBG] from='client.348138 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:50:32.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:50:31 smithi047 bash[22744]: audit 2024-09-16T11:50:30.730156+0000 mgr.a (mgr.14373) 16144 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T11:50:32.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:50:31 smithi047 bash[22744]: cephadm 2024-09-16T11:50:30.732405+0000 mgr.a (mgr.14373) 16145 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T11:50:32.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:50:31 smithi047 bash[22744]: audit 2024-09-16T11:50:31.431238+0000 mgr.a (mgr.14373) 16146 : audit [DBG] from='client.348138 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:50:33.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:50:32 smithi157 bash[24585]: cluster 2024-09-16T11:50:31.765718+0000 mgr.a (mgr.14373) 16147 : cluster [DBG] pgmap v11198: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:50:33.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:50:32 smithi086 bash[24289]: cluster 2024-09-16T11:50:31.765718+0000 mgr.a (mgr.14373) 16147 : cluster [DBG] pgmap v11198: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:50:33.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:50:32 smithi047 bash[22744]: cluster 2024-09-16T11:50:31.765718+0000 mgr.a (mgr.14373) 16147 : cluster [DBG] pgmap v11198: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:50:35.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:50:34 smithi157 bash[24585]: cluster 2024-09-16T11:50:33.766615+0000 mgr.a (mgr.14373) 16148 : cluster [DBG] pgmap v11199: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T11:50:35.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:50:34 smithi086 bash[24289]: cluster 2024-09-16T11:50:33.766615+0000 mgr.a (mgr.14373) 16148 : cluster [DBG] pgmap v11199: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T11:50:35.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:50:34 smithi047 bash[22744]: cluster 2024-09-16T11:50:33.766615+0000 mgr.a (mgr.14373) 16148 : cluster [DBG] pgmap v11199: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T11:50:36.885 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:50:36.886 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:50:36.886 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:50:37.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:50:36 smithi157 bash[24585]: cluster 2024-09-16T11:50:35.767442+0000 mgr.a (mgr.14373) 16149 : cluster [DBG] pgmap v11200: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T11:50:37.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:50:36 smithi086 bash[24289]: cluster 2024-09-16T11:50:35.767442+0000 mgr.a (mgr.14373) 16149 : cluster [DBG] pgmap v11200: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T11:50:37.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:50:36 smithi047 bash[22744]: cluster 2024-09-16T11:50:35.767442+0000 mgr.a (mgr.14373) 16149 : cluster [DBG] pgmap v11200: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T11:50:37.641 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:50:37.641 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:50:37.641 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:50:37.641 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:50:37.642 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:50:38.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:50:37 smithi157 bash[24585]: audit 2024-09-16T11:50:37.218697+0000 mgr.a (mgr.14373) 16150 : audit [DBG] from='client.348216 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:50:38.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:50:37 smithi086 bash[24289]: audit 2024-09-16T11:50:37.218697+0000 mgr.a (mgr.14373) 16150 : audit [DBG] from='client.348216 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:50:38.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:50:37 smithi047 bash[22744]: audit 2024-09-16T11:50:37.218697+0000 mgr.a (mgr.14373) 16150 : audit [DBG] from='client.348216 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:50:39.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:50:38 smithi157 bash[24585]: cluster 2024-09-16T11:50:37.770171+0000 mgr.a (mgr.14373) 16151 : cluster [DBG] pgmap v11201: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:50:39.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:50:38 smithi086 bash[24289]: cluster 2024-09-16T11:50:37.770171+0000 mgr.a (mgr.14373) 16151 : cluster [DBG] pgmap v11201: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:50:39.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:50:38 smithi047 bash[22744]: cluster 2024-09-16T11:50:37.770171+0000 mgr.a (mgr.14373) 16151 : cluster [DBG] pgmap v11201: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:50:41.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:50:40 smithi157 bash[24585]: cluster 2024-09-16T11:50:39.770971+0000 mgr.a (mgr.14373) 16152 : cluster [DBG] pgmap v11202: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T11:50:41.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:50:40 smithi086 bash[24289]: cluster 2024-09-16T11:50:39.770971+0000 mgr.a (mgr.14373) 16152 : cluster [DBG] pgmap v11202: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T11:50:41.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:50:40 smithi047 bash[22744]: cluster 2024-09-16T11:50:39.770971+0000 mgr.a (mgr.14373) 16152 : cluster [DBG] pgmap v11202: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T11:50:42.643 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:50:42.643 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:50:42.644 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:50:43.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:50:42 smithi157 bash[24585]: cluster 2024-09-16T11:50:41.772902+0000 mgr.a (mgr.14373) 16153 : cluster [DBG] pgmap v11203: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:50:43.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:50:42 smithi086 bash[24289]: cluster 2024-09-16T11:50:41.772902+0000 mgr.a (mgr.14373) 16153 : cluster [DBG] pgmap v11203: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:50:43.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:50:42 smithi047 bash[22744]: cluster 2024-09-16T11:50:41.772902+0000 mgr.a (mgr.14373) 16153 : cluster [DBG] pgmap v11203: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:50:43.428 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:50:43.429 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:50:43.429 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:50:43.429 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:50:43.429 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:50:44.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:50:43 smithi157 bash[24585]: audit 2024-09-16T11:50:42.976729+0000 mgr.a (mgr.14373) 16154 : audit [DBG] from='client.348294 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:50:44.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:50:43 smithi086 bash[24289]: audit 2024-09-16T11:50:42.976729+0000 mgr.a (mgr.14373) 16154 : audit [DBG] from='client.348294 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:50:44.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:50:43 smithi047 bash[22744]: audit 2024-09-16T11:50:42.976729+0000 mgr.a (mgr.14373) 16154 : audit [DBG] from='client.348294 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:50:45.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:50:44 smithi157 bash[24585]: cluster 2024-09-16T11:50:43.773891+0000 mgr.a (mgr.14373) 16155 : cluster [DBG] pgmap v11204: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:50:45.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:50:44 smithi086 bash[24289]: cluster 2024-09-16T11:50:43.773891+0000 mgr.a (mgr.14373) 16155 : cluster [DBG] pgmap v11204: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:50:45.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:50:44 smithi047 bash[22744]: cluster 2024-09-16T11:50:43.773891+0000 mgr.a (mgr.14373) 16155 : cluster [DBG] pgmap v11204: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:50:47.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:50:46 smithi157 bash[24585]: cluster 2024-09-16T11:50:45.774705+0000 mgr.a (mgr.14373) 16156 : cluster [DBG] pgmap v11205: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:50:47.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:50:46 smithi086 bash[24289]: cluster 2024-09-16T11:50:45.774705+0000 mgr.a (mgr.14373) 16156 : cluster [DBG] pgmap v11205: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:50:47.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:50:46 smithi047 bash[22744]: cluster 2024-09-16T11:50:45.774705+0000 mgr.a (mgr.14373) 16156 : cluster [DBG] pgmap v11205: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:50:48.430 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:50:48.431 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:50:48.431 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:50:49.222 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:50:49.223 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:50:49.223 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:50:49.223 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:50:49.223 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:50:49.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:50:48 smithi157 bash[24585]: cluster 2024-09-16T11:50:47.776930+0000 mgr.a (mgr.14373) 16157 : cluster [DBG] pgmap v11206: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:50:49.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:50:48 smithi086 bash[24289]: cluster 2024-09-16T11:50:47.776930+0000 mgr.a (mgr.14373) 16157 : cluster [DBG] pgmap v11206: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:50:49.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:50:48 smithi047 bash[22744]: cluster 2024-09-16T11:50:47.776930+0000 mgr.a (mgr.14373) 16157 : cluster [DBG] pgmap v11206: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:50:50.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:50:49 smithi157 bash[24585]: audit 2024-09-16T11:50:48.773243+0000 mgr.a (mgr.14373) 16158 : audit [DBG] from='client.348369 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:50:50.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:50:49 smithi086 bash[24289]: audit 2024-09-16T11:50:48.773243+0000 mgr.a (mgr.14373) 16158 : audit [DBG] from='client.348369 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:50:50.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:50:49 smithi047 bash[22744]: audit 2024-09-16T11:50:48.773243+0000 mgr.a (mgr.14373) 16158 : audit [DBG] from='client.348369 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:50:51.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:50:50 smithi157 bash[24585]: cluster 2024-09-16T11:50:49.777917+0000 mgr.a (mgr.14373) 16159 : cluster [DBG] pgmap v11207: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:50:51.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:50:50 smithi086 bash[24289]: cluster 2024-09-16T11:50:49.777917+0000 mgr.a (mgr.14373) 16159 : cluster [DBG] pgmap v11207: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:50:51.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:50:50 smithi047 bash[22744]: cluster 2024-09-16T11:50:49.777917+0000 mgr.a (mgr.14373) 16159 : cluster [DBG] pgmap v11207: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:50:53.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:50:52 smithi157 bash[24585]: cluster 2024-09-16T11:50:51.780155+0000 mgr.a (mgr.14373) 16160 : cluster [DBG] pgmap v11208: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:50:53.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:50:52 smithi086 bash[24289]: cluster 2024-09-16T11:50:51.780155+0000 mgr.a (mgr.14373) 16160 : cluster [DBG] pgmap v11208: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:50:53.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:50:52 smithi047 bash[22744]: cluster 2024-09-16T11:50:51.780155+0000 mgr.a (mgr.14373) 16160 : cluster [DBG] pgmap v11208: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:50:54.224 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:50:54.225 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:50:54.225 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:50:55.001 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:50:55.001 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:50:55.001 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:50:55.002 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:50:55.002 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:50:55.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:50:54 smithi157 bash[24585]: cluster 2024-09-16T11:50:53.780936+0000 mgr.a (mgr.14373) 16161 : cluster [DBG] pgmap v11209: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:50:55.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:50:54 smithi086 bash[24289]: cluster 2024-09-16T11:50:53.780936+0000 mgr.a (mgr.14373) 16161 : cluster [DBG] pgmap v11209: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:50:55.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:50:54 smithi047 bash[22744]: cluster 2024-09-16T11:50:53.780936+0000 mgr.a (mgr.14373) 16161 : cluster [DBG] pgmap v11209: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:50:56.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:50:55 smithi157 bash[24585]: audit 2024-09-16T11:50:54.555723+0000 mgr.a (mgr.14373) 16162 : audit [DBG] from='client.348447 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:50:56.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:50:55 smithi086 bash[24289]: audit 2024-09-16T11:50:54.555723+0000 mgr.a (mgr.14373) 16162 : audit [DBG] from='client.348447 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:50:56.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:50:55 smithi047 bash[22744]: audit 2024-09-16T11:50:54.555723+0000 mgr.a (mgr.14373) 16162 : audit [DBG] from='client.348447 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:50:57.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:50:56 smithi157 bash[24585]: cluster 2024-09-16T11:50:55.781952+0000 mgr.a (mgr.14373) 16163 : cluster [DBG] pgmap v11210: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:50:57.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:50:56 smithi086 bash[24289]: cluster 2024-09-16T11:50:55.781952+0000 mgr.a (mgr.14373) 16163 : cluster [DBG] pgmap v11210: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:50:57.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:50:56 smithi047 bash[22744]: cluster 2024-09-16T11:50:55.781952+0000 mgr.a (mgr.14373) 16163 : cluster [DBG] pgmap v11210: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:50:59.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:50:58 smithi157 bash[24585]: cluster 2024-09-16T11:50:57.784217+0000 mgr.a (mgr.14373) 16164 : cluster [DBG] pgmap v11211: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:50:59.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:50:58 smithi086 bash[24289]: cluster 2024-09-16T11:50:57.784217+0000 mgr.a (mgr.14373) 16164 : cluster [DBG] pgmap v11211: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:50:59.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:50:58 smithi047 bash[22744]: cluster 2024-09-16T11:50:57.784217+0000 mgr.a (mgr.14373) 16164 : cluster [DBG] pgmap v11211: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:51:00.003 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:51:00.003 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:51:00.003 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:51:00.762 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:51:00.762 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:51:00.762 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:51:00.762 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:51:00.763 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:51:01.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:51:00 smithi157 bash[24585]: cluster 2024-09-16T11:50:59.784999+0000 mgr.a (mgr.14373) 16165 : cluster [DBG] pgmap v11212: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:51:01.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:51:00 smithi157 bash[24585]: audit 2024-09-16T11:51:00.340756+0000 mgr.a (mgr.14373) 16166 : audit [DBG] from='client.348522 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:51:01.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:51:00 smithi086 bash[24289]: cluster 2024-09-16T11:50:59.784999+0000 mgr.a (mgr.14373) 16165 : cluster [DBG] pgmap v11212: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:51:01.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:51:00 smithi086 bash[24289]: audit 2024-09-16T11:51:00.340756+0000 mgr.a (mgr.14373) 16166 : audit [DBG] from='client.348522 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:51:01.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:51:00 smithi047 bash[22744]: cluster 2024-09-16T11:50:59.784999+0000 mgr.a (mgr.14373) 16165 : cluster [DBG] pgmap v11212: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:51:01.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:51:00 smithi047 bash[22744]: audit 2024-09-16T11:51:00.340756+0000 mgr.a (mgr.14373) 16166 : audit [DBG] from='client.348522 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:51:03.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:51:02 smithi157 bash[24585]: cluster 2024-09-16T11:51:01.787403+0000 mgr.a (mgr.14373) 16167 : cluster [DBG] pgmap v11213: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:51:03.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:51:02 smithi086 bash[24289]: cluster 2024-09-16T11:51:01.787403+0000 mgr.a (mgr.14373) 16167 : cluster [DBG] pgmap v11213: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:51:03.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:51:02 smithi047 bash[22744]: cluster 2024-09-16T11:51:01.787403+0000 mgr.a (mgr.14373) 16167 : cluster [DBG] pgmap v11213: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:51:05.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:51:04 smithi157 bash[24585]: cluster 2024-09-16T11:51:03.788215+0000 mgr.a (mgr.14373) 16168 : cluster [DBG] pgmap v11214: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:51:05.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:51:04 smithi086 bash[24289]: cluster 2024-09-16T11:51:03.788215+0000 mgr.a (mgr.14373) 16168 : cluster [DBG] pgmap v11214: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:51:05.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:51:04 smithi047 bash[22744]: cluster 2024-09-16T11:51:03.788215+0000 mgr.a (mgr.14373) 16168 : cluster [DBG] pgmap v11214: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:51:05.763 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:51:05.764 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:51:05.764 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:51:06.529 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:51:06.529 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:51:06.529 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:51:06.529 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:51:06.529 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:51:07.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:51:06 smithi157 bash[24585]: cluster 2024-09-16T11:51:05.788991+0000 mgr.a (mgr.14373) 16169 : cluster [DBG] pgmap v11215: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:51:07.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:51:06 smithi157 bash[24585]: audit 2024-09-16T11:51:06.098676+0000 mgr.a (mgr.14373) 16170 : audit [DBG] from='client.348600 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:51:07.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:51:06 smithi086 bash[24289]: cluster 2024-09-16T11:51:05.788991+0000 mgr.a (mgr.14373) 16169 : cluster [DBG] pgmap v11215: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:51:07.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:51:06 smithi086 bash[24289]: audit 2024-09-16T11:51:06.098676+0000 mgr.a (mgr.14373) 16170 : audit [DBG] from='client.348600 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:51:07.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:51:06 smithi047 bash[22744]: cluster 2024-09-16T11:51:05.788991+0000 mgr.a (mgr.14373) 16169 : cluster [DBG] pgmap v11215: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:51:07.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:51:06 smithi047 bash[22744]: audit 2024-09-16T11:51:06.098676+0000 mgr.a (mgr.14373) 16170 : audit [DBG] from='client.348600 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:51:09.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:51:09 smithi157 bash[24585]: cluster 2024-09-16T11:51:07.791473+0000 mgr.a (mgr.14373) 16171 : cluster [DBG] pgmap v11216: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:51:09.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:51:09 smithi086 bash[24289]: cluster 2024-09-16T11:51:07.791473+0000 mgr.a (mgr.14373) 16171 : cluster [DBG] pgmap v11216: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:51:09.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:51:09 smithi047 bash[22744]: cluster 2024-09-16T11:51:07.791473+0000 mgr.a (mgr.14373) 16171 : cluster [DBG] pgmap v11216: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:51:11.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:51:11 smithi157 bash[24585]: cluster 2024-09-16T11:51:09.792272+0000 mgr.a (mgr.14373) 16172 : cluster [DBG] pgmap v11217: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:51:11.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:51:11 smithi086 bash[24289]: cluster 2024-09-16T11:51:09.792272+0000 mgr.a (mgr.14373) 16172 : cluster [DBG] pgmap v11217: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:51:11.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:51:11 smithi047 bash[22744]: cluster 2024-09-16T11:51:09.792272+0000 mgr.a (mgr.14373) 16172 : cluster [DBG] pgmap v11217: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:51:11.530 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:51:11.531 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:51:11.531 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:51:12.315 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:51:12.315 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:51:12.316 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:51:12.316 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:51:12.316 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:51:13.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:51:13 smithi157 bash[24585]: cluster 2024-09-16T11:51:11.794217+0000 mgr.a (mgr.14373) 16173 : cluster [DBG] pgmap v11218: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:51:13.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:51:13 smithi157 bash[24585]: audit 2024-09-16T11:51:11.863614+0000 mgr.a (mgr.14373) 16174 : audit [DBG] from='client.348675 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:51:13.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:51:13 smithi086 bash[24289]: cluster 2024-09-16T11:51:11.794217+0000 mgr.a (mgr.14373) 16173 : cluster [DBG] pgmap v11218: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:51:13.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:51:13 smithi086 bash[24289]: audit 2024-09-16T11:51:11.863614+0000 mgr.a (mgr.14373) 16174 : audit [DBG] from='client.348675 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:51:13.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:51:13 smithi047 bash[22744]: cluster 2024-09-16T11:51:11.794217+0000 mgr.a (mgr.14373) 16173 : cluster [DBG] pgmap v11218: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:51:13.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:51:13 smithi047 bash[22744]: audit 2024-09-16T11:51:11.863614+0000 mgr.a (mgr.14373) 16174 : audit [DBG] from='client.348675 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:51:15.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:51:15 smithi157 bash[24585]: cluster 2024-09-16T11:51:13.795106+0000 mgr.a (mgr.14373) 16175 : cluster [DBG] pgmap v11219: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:51:15.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:51:15 smithi086 bash[24289]: cluster 2024-09-16T11:51:13.795106+0000 mgr.a (mgr.14373) 16175 : cluster [DBG] pgmap v11219: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:51:15.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:51:15 smithi047 bash[22744]: cluster 2024-09-16T11:51:13.795106+0000 mgr.a (mgr.14373) 16175 : cluster [DBG] pgmap v11219: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:51:17.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:51:17 smithi157 bash[24585]: cluster 2024-09-16T11:51:15.795892+0000 mgr.a (mgr.14373) 16176 : cluster [DBG] pgmap v11220: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T11:51:17.316 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:51:17.317 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:51:17.317 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:51:17.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:51:17 smithi086 bash[24289]: cluster 2024-09-16T11:51:15.795892+0000 mgr.a (mgr.14373) 16176 : cluster [DBG] pgmap v11220: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T11:51:17.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:51:17 smithi047 bash[22744]: cluster 2024-09-16T11:51:15.795892+0000 mgr.a (mgr.14373) 16176 : cluster [DBG] pgmap v11220: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T11:51:18.085 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:51:18.086 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:51:18.086 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:51:18.086 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:51:18.086 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:51:19.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:51:19 smithi157 bash[24585]: audit 2024-09-16T11:51:17.645967+0000 mgr.a (mgr.14373) 16177 : audit [DBG] from='client.348750 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:51:19.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:51:19 smithi157 bash[24585]: cluster 2024-09-16T11:51:17.797259+0000 mgr.a (mgr.14373) 16178 : cluster [DBG] pgmap v11221: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:51:19.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:51:19 smithi086 bash[24289]: audit 2024-09-16T11:51:17.645967+0000 mgr.a (mgr.14373) 16177 : audit [DBG] from='client.348750 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:51:19.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:51:19 smithi086 bash[24289]: cluster 2024-09-16T11:51:17.797259+0000 mgr.a (mgr.14373) 16178 : cluster [DBG] pgmap v11221: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:51:19.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:51:19 smithi047 bash[22744]: audit 2024-09-16T11:51:17.645967+0000 mgr.a (mgr.14373) 16177 : audit [DBG] from='client.348750 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:51:19.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:51:19 smithi047 bash[22744]: cluster 2024-09-16T11:51:17.797259+0000 mgr.a (mgr.14373) 16178 : cluster [DBG] pgmap v11221: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:51:21.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:51:21 smithi157 bash[24585]: cluster 2024-09-16T11:51:19.798167+0000 mgr.a (mgr.14373) 16179 : cluster [DBG] pgmap v11222: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T11:51:21.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:51:21 smithi086 bash[24289]: cluster 2024-09-16T11:51:19.798167+0000 mgr.a (mgr.14373) 16179 : cluster [DBG] pgmap v11222: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T11:51:21.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:51:21 smithi047 bash[22744]: cluster 2024-09-16T11:51:19.798167+0000 mgr.a (mgr.14373) 16179 : cluster [DBG] pgmap v11222: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T11:51:23.087 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:51:23.088 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:51:23.088 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:51:23.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:51:23 smithi157 bash[24585]: cluster 2024-09-16T11:51:21.800223+0000 mgr.a (mgr.14373) 16180 : cluster [DBG] pgmap v11223: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:51:23.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:51:23 smithi086 bash[24289]: cluster 2024-09-16T11:51:21.800223+0000 mgr.a (mgr.14373) 16180 : cluster [DBG] pgmap v11223: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:51:23.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:51:23 smithi047 bash[22744]: cluster 2024-09-16T11:51:21.800223+0000 mgr.a (mgr.14373) 16180 : cluster [DBG] pgmap v11223: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:51:23.878 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:51:23.879 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:51:23.879 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:51:23.879 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:51:23.879 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:51:24.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:51:24 smithi157 bash[24585]: audit 2024-09-16T11:51:23.421030+0000 mgr.a (mgr.14373) 16181 : audit [DBG] from='client.348828 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:51:24.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:51:24 smithi086 bash[24289]: audit 2024-09-16T11:51:23.421030+0000 mgr.a (mgr.14373) 16181 : audit [DBG] from='client.348828 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:51:24.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:51:24 smithi047 bash[22744]: audit 2024-09-16T11:51:23.421030+0000 mgr.a (mgr.14373) 16181 : audit [DBG] from='client.348828 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:51:25.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:51:25 smithi157 bash[24585]: cluster 2024-09-16T11:51:23.800786+0000 mgr.a (mgr.14373) 16182 : cluster [DBG] pgmap v11224: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:51:25.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:51:25 smithi086 bash[24289]: cluster 2024-09-16T11:51:23.800786+0000 mgr.a (mgr.14373) 16182 : cluster [DBG] pgmap v11224: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:51:25.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:51:25 smithi047 bash[22744]: cluster 2024-09-16T11:51:23.800786+0000 mgr.a (mgr.14373) 16182 : cluster [DBG] pgmap v11224: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:51:27.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:51:27 smithi157 bash[24585]: cluster 2024-09-16T11:51:25.801555+0000 mgr.a (mgr.14373) 16183 : cluster [DBG] pgmap v11225: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:51:27.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:51:27 smithi086 bash[24289]: cluster 2024-09-16T11:51:25.801555+0000 mgr.a (mgr.14373) 16183 : cluster [DBG] pgmap v11225: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:51:27.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:51:27 smithi047 bash[22744]: cluster 2024-09-16T11:51:25.801555+0000 mgr.a (mgr.14373) 16183 : cluster [DBG] pgmap v11225: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:51:28.880 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:51:28.880 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:51:28.880 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:51:29.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:51:29 smithi157 bash[24585]: cluster 2024-09-16T11:51:27.803941+0000 mgr.a (mgr.14373) 16184 : cluster [DBG] pgmap v11226: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:51:29.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:51:29 smithi086 bash[24289]: cluster 2024-09-16T11:51:27.803941+0000 mgr.a (mgr.14373) 16184 : cluster [DBG] pgmap v11226: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:51:29.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:51:29 smithi047 bash[22744]: cluster 2024-09-16T11:51:27.803941+0000 mgr.a (mgr.14373) 16184 : cluster [DBG] pgmap v11226: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:51:29.644 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:51:29.644 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:51:29.645 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:51:29.645 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:51:29.645 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:51:30.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:51:30 smithi157 bash[24585]: audit 2024-09-16T11:51:29.209017+0000 mgr.a (mgr.14373) 16185 : audit [DBG] from='client.348906 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:51:30.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:51:30 smithi086 bash[24289]: audit 2024-09-16T11:51:29.209017+0000 mgr.a (mgr.14373) 16185 : audit [DBG] from='client.348906 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:51:30.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:51:30 smithi047 bash[22744]: audit 2024-09-16T11:51:29.209017+0000 mgr.a (mgr.14373) 16185 : audit [DBG] from='client.348906 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:51:31.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:51:31 smithi086 bash[24289]: cluster 2024-09-16T11:51:29.804942+0000 mgr.a (mgr.14373) 16186 : cluster [DBG] pgmap v11227: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:51:31.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:51:31 smithi086 bash[24289]: audit 2024-09-16T11:51:30.792211+0000 mon.b (mon.2) 1470 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T11:51:31.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:51:31 smithi047 bash[22744]: cluster 2024-09-16T11:51:29.804942+0000 mgr.a (mgr.14373) 16186 : cluster [DBG] pgmap v11227: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:51:31.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:51:31 smithi047 bash[22744]: audit 2024-09-16T11:51:30.792211+0000 mon.b (mon.2) 1470 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T11:51:31.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:51:31 smithi157 bash[24585]: cluster 2024-09-16T11:51:29.804942+0000 mgr.a (mgr.14373) 16186 : cluster [DBG] pgmap v11227: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:51:31.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:51:31 smithi157 bash[24585]: audit 2024-09-16T11:51:30.792211+0000 mon.b (mon.2) 1470 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T11:51:32.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:51:32 smithi157 bash[24585]: audit 2024-09-16T11:51:31.421232+0000 mon.a (mon.0) 1535 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:51:32.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:51:32 smithi157 bash[24585]: audit 2024-09-16T11:51:31.429463+0000 mon.a (mon.0) 1536 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:51:32.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:51:32 smithi157 bash[24585]: audit 2024-09-16T11:51:32.203211+0000 mon.b (mon.2) 1471 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T11:51:32.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:51:32 smithi157 bash[24585]: audit 2024-09-16T11:51:32.204925+0000 mon.b (mon.2) 1472 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T11:51:32.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:51:32 smithi157 bash[24585]: audit 2024-09-16T11:51:32.216735+0000 mon.a (mon.0) 1537 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:51:32.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:51:32 smithi157 bash[24585]: audit 2024-09-16T11:51:32.222398+0000 mon.b (mon.2) 1473 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:51:32.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:51:32 smithi086 bash[24289]: audit 2024-09-16T11:51:31.421232+0000 mon.a (mon.0) 1535 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:51:32.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:51:32 smithi086 bash[24289]: audit 2024-09-16T11:51:31.429463+0000 mon.a (mon.0) 1536 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:51:32.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:51:32 smithi086 bash[24289]: audit 2024-09-16T11:51:32.203211+0000 mon.b (mon.2) 1471 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T11:51:32.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:51:32 smithi086 bash[24289]: audit 2024-09-16T11:51:32.204925+0000 mon.b (mon.2) 1472 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T11:51:32.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:51:32 smithi086 bash[24289]: audit 2024-09-16T11:51:32.216735+0000 mon.a (mon.0) 1537 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:51:32.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:51:32 smithi086 bash[24289]: audit 2024-09-16T11:51:32.222398+0000 mon.b (mon.2) 1473 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:51:32.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:51:32 smithi047 bash[22744]: audit 2024-09-16T11:51:31.421232+0000 mon.a (mon.0) 1535 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:51:32.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:51:32 smithi047 bash[22744]: audit 2024-09-16T11:51:31.429463+0000 mon.a (mon.0) 1536 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:51:32.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:51:32 smithi047 bash[22744]: audit 2024-09-16T11:51:32.203211+0000 mon.b (mon.2) 1471 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T11:51:32.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:51:32 smithi047 bash[22744]: audit 2024-09-16T11:51:32.204925+0000 mon.b (mon.2) 1472 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T11:51:32.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:51:32 smithi047 bash[22744]: audit 2024-09-16T11:51:32.216735+0000 mon.a (mon.0) 1537 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:51:32.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:51:32 smithi047 bash[22744]: audit 2024-09-16T11:51:32.222398+0000 mon.b (mon.2) 1473 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:51:33.342 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 11:51:32 smithi047 bash[22994]: debug 2024-09-16T11:51:32.984+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T11:51:33.343 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 11:51:32 smithi047 bash[22994]: debug 2024-09-16T11:51:32.988+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T11:51:33.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:51:33 smithi157 bash[24585]: cluster 2024-09-16T11:51:31.807144+0000 mgr.a (mgr.14373) 16187 : cluster [DBG] pgmap v11228: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:51:33.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:51:33 smithi157 bash[24585]: audit 2024-09-16T11:51:32.225093+0000 mgr.a (mgr.14373) 16188 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:51:33.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:51:33 smithi086 bash[24289]: cluster 2024-09-16T11:51:31.807144+0000 mgr.a (mgr.14373) 16187 : cluster [DBG] pgmap v11228: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:51:33.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:51:33 smithi086 bash[24289]: audit 2024-09-16T11:51:32.225093+0000 mgr.a (mgr.14373) 16188 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:51:33.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:51:33 smithi047 bash[22744]: cluster 2024-09-16T11:51:31.807144+0000 mgr.a (mgr.14373) 16187 : cluster [DBG] pgmap v11228: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:51:33.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:51:33 smithi047 bash[22744]: audit 2024-09-16T11:51:32.225093+0000 mgr.a (mgr.14373) 16188 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:51:34.644 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:51:34.645 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:51:34.645 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:51:34.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:51:34 smithi157 bash[24585]: audit 2024-09-16T11:51:32.989055+0000 mgr.a (mgr.14373) 16189 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T11:51:34.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:51:34 smithi157 bash[24585]: cephadm 2024-09-16T11:51:32.991272+0000 mgr.a (mgr.14373) 16190 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T11:51:34.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:51:34 smithi086 bash[24289]: audit 2024-09-16T11:51:32.989055+0000 mgr.a (mgr.14373) 16189 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T11:51:34.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:51:34 smithi086 bash[24289]: cephadm 2024-09-16T11:51:32.991272+0000 mgr.a (mgr.14373) 16190 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T11:51:34.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:51:34 smithi047 bash[22744]: audit 2024-09-16T11:51:32.989055+0000 mgr.a (mgr.14373) 16189 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T11:51:34.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:51:34 smithi047 bash[22744]: cephadm 2024-09-16T11:51:32.991272+0000 mgr.a (mgr.14373) 16190 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T11:51:35.433 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:51:35.433 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:51:35.434 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:51:35.434 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:51:35.434 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:51:35.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:51:35 smithi157 bash[24585]: cluster 2024-09-16T11:51:33.808070+0000 mgr.a (mgr.14373) 16191 : cluster [DBG] pgmap v11229: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:51:35.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:51:35 smithi086 bash[24289]: cluster 2024-09-16T11:51:33.808070+0000 mgr.a (mgr.14373) 16191 : cluster [DBG] pgmap v11229: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:51:35.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:51:35 smithi047 bash[22744]: cluster 2024-09-16T11:51:33.808070+0000 mgr.a (mgr.14373) 16191 : cluster [DBG] pgmap v11229: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:51:36.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:51:36 smithi157 bash[24585]: audit 2024-09-16T11:51:34.979771+0000 mgr.a (mgr.14373) 16192 : audit [DBG] from='client.349092 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:51:36.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:51:36 smithi086 bash[24289]: audit 2024-09-16T11:51:34.979771+0000 mgr.a (mgr.14373) 16192 : audit [DBG] from='client.349092 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:51:36.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:51:36 smithi047 bash[22744]: audit 2024-09-16T11:51:34.979771+0000 mgr.a (mgr.14373) 16192 : audit [DBG] from='client.349092 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:51:37.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:51:37 smithi157 bash[24585]: cluster 2024-09-16T11:51:35.809041+0000 mgr.a (mgr.14373) 16193 : cluster [DBG] pgmap v11230: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:51:37.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:51:37 smithi086 bash[24289]: cluster 2024-09-16T11:51:35.809041+0000 mgr.a (mgr.14373) 16193 : cluster [DBG] pgmap v11230: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:51:37.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:51:37 smithi047 bash[22744]: cluster 2024-09-16T11:51:35.809041+0000 mgr.a (mgr.14373) 16193 : cluster [DBG] pgmap v11230: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:51:39.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:51:39 smithi157 bash[24585]: cluster 2024-09-16T11:51:37.811364+0000 mgr.a (mgr.14373) 16194 : cluster [DBG] pgmap v11231: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:51:39.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:51:39 smithi086 bash[24289]: cluster 2024-09-16T11:51:37.811364+0000 mgr.a (mgr.14373) 16194 : cluster [DBG] pgmap v11231: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:51:39.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:51:39 smithi047 bash[22744]: cluster 2024-09-16T11:51:37.811364+0000 mgr.a (mgr.14373) 16194 : cluster [DBG] pgmap v11231: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:51:40.435 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:51:40.436 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:51:40.436 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:51:41.180 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:51:41.181 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:51:41.181 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:51:41.181 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:51:41.181 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:51:41.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:51:41 smithi157 bash[24585]: cluster 2024-09-16T11:51:39.812133+0000 mgr.a (mgr.14373) 16195 : cluster [DBG] pgmap v11232: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:51:41.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:51:41 smithi086 bash[24289]: cluster 2024-09-16T11:51:39.812133+0000 mgr.a (mgr.14373) 16195 : cluster [DBG] pgmap v11232: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:51:41.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:51:41 smithi047 bash[22744]: cluster 2024-09-16T11:51:39.812133+0000 mgr.a (mgr.14373) 16195 : cluster [DBG] pgmap v11232: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:51:42.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:51:42 smithi157 bash[24585]: audit 2024-09-16T11:51:40.765467+0000 mgr.a (mgr.14373) 16196 : audit [DBG] from='client.349164 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:51:42.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:51:42 smithi086 bash[24289]: audit 2024-09-16T11:51:40.765467+0000 mgr.a (mgr.14373) 16196 : audit [DBG] from='client.349164 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:51:42.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:51:42 smithi047 bash[22744]: audit 2024-09-16T11:51:40.765467+0000 mgr.a (mgr.14373) 16196 : audit [DBG] from='client.349164 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:51:43.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:51:43 smithi157 bash[24585]: cluster 2024-09-16T11:51:41.814654+0000 mgr.a (mgr.14373) 16197 : cluster [DBG] pgmap v11233: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:51:43.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:51:43 smithi086 bash[24289]: cluster 2024-09-16T11:51:41.814654+0000 mgr.a (mgr.14373) 16197 : cluster [DBG] pgmap v11233: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:51:43.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:51:43 smithi047 bash[22744]: cluster 2024-09-16T11:51:41.814654+0000 mgr.a (mgr.14373) 16197 : cluster [DBG] pgmap v11233: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:51:45.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:51:45 smithi157 bash[24585]: cluster 2024-09-16T11:51:43.815482+0000 mgr.a (mgr.14373) 16198 : cluster [DBG] pgmap v11234: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:51:45.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:51:45 smithi086 bash[24289]: cluster 2024-09-16T11:51:43.815482+0000 mgr.a (mgr.14373) 16198 : cluster [DBG] pgmap v11234: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:51:45.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:51:45 smithi047 bash[22744]: cluster 2024-09-16T11:51:43.815482+0000 mgr.a (mgr.14373) 16198 : cluster [DBG] pgmap v11234: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:51:46.182 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:51:46.182 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:51:46.183 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:51:46.939 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:51:46.939 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:51:46.939 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:51:46.939 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:51:46.940 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:51:47.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:51:47 smithi157 bash[24585]: cluster 2024-09-16T11:51:45.816379+0000 mgr.a (mgr.14373) 16199 : cluster [DBG] pgmap v11235: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:51:47.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:51:47 smithi157 bash[24585]: audit 2024-09-16T11:51:46.511607+0000 mgr.a (mgr.14373) 16200 : audit [DBG] from='client.349242 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:51:47.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:51:47 smithi086 bash[24289]: cluster 2024-09-16T11:51:45.816379+0000 mgr.a (mgr.14373) 16199 : cluster [DBG] pgmap v11235: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:51:47.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:51:47 smithi086 bash[24289]: audit 2024-09-16T11:51:46.511607+0000 mgr.a (mgr.14373) 16200 : audit [DBG] from='client.349242 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:51:47.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:51:47 smithi047 bash[22744]: cluster 2024-09-16T11:51:45.816379+0000 mgr.a (mgr.14373) 16199 : cluster [DBG] pgmap v11235: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:51:47.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:51:47 smithi047 bash[22744]: audit 2024-09-16T11:51:46.511607+0000 mgr.a (mgr.14373) 16200 : audit [DBG] from='client.349242 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:51:49.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:51:49 smithi157 bash[24585]: cluster 2024-09-16T11:51:47.819279+0000 mgr.a (mgr.14373) 16201 : cluster [DBG] pgmap v11236: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:51:49.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:51:49 smithi086 bash[24289]: cluster 2024-09-16T11:51:47.819279+0000 mgr.a (mgr.14373) 16201 : cluster [DBG] pgmap v11236: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:51:49.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:51:49 smithi047 bash[22744]: cluster 2024-09-16T11:51:47.819279+0000 mgr.a (mgr.14373) 16201 : cluster [DBG] pgmap v11236: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:51:51.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:51:51 smithi157 bash[24585]: cluster 2024-09-16T11:51:49.820074+0000 mgr.a (mgr.14373) 16202 : cluster [DBG] pgmap v11237: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:51:51.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:51:51 smithi086 bash[24289]: cluster 2024-09-16T11:51:49.820074+0000 mgr.a (mgr.14373) 16202 : cluster [DBG] pgmap v11237: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:51:51.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:51:51 smithi047 bash[22744]: cluster 2024-09-16T11:51:49.820074+0000 mgr.a (mgr.14373) 16202 : cluster [DBG] pgmap v11237: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:51:51.941 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:51:51.941 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:51:51.941 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:51:52.685 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:51:52.685 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:51:52.685 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:51:52.685 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:51:52.686 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:51:53.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:51:53 smithi157 bash[24585]: cluster 2024-09-16T11:51:51.821992+0000 mgr.a (mgr.14373) 16203 : cluster [DBG] pgmap v11238: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:51:53.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:51:53 smithi157 bash[24585]: audit 2024-09-16T11:51:52.267984+0000 mgr.a (mgr.14373) 16204 : audit [DBG] from='client.349317 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:51:53.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:51:53 smithi086 bash[24289]: cluster 2024-09-16T11:51:51.821992+0000 mgr.a (mgr.14373) 16203 : cluster [DBG] pgmap v11238: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:51:53.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:51:53 smithi086 bash[24289]: audit 2024-09-16T11:51:52.267984+0000 mgr.a (mgr.14373) 16204 : audit [DBG] from='client.349317 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:51:53.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:51:53 smithi047 bash[22744]: cluster 2024-09-16T11:51:51.821992+0000 mgr.a (mgr.14373) 16203 : cluster [DBG] pgmap v11238: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:51:53.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:51:53 smithi047 bash[22744]: audit 2024-09-16T11:51:52.267984+0000 mgr.a (mgr.14373) 16204 : audit [DBG] from='client.349317 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:51:55.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:51:55 smithi157 bash[24585]: cluster 2024-09-16T11:51:53.823058+0000 mgr.a (mgr.14373) 16205 : cluster [DBG] pgmap v11239: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:51:55.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:51:55 smithi086 bash[24289]: cluster 2024-09-16T11:51:53.823058+0000 mgr.a (mgr.14373) 16205 : cluster [DBG] pgmap v11239: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:51:55.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:51:55 smithi047 bash[22744]: cluster 2024-09-16T11:51:53.823058+0000 mgr.a (mgr.14373) 16205 : cluster [DBG] pgmap v11239: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:51:57.687 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:51:57.688 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:51:57.688 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:51:57.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:51:57 smithi157 bash[24585]: cluster 2024-09-16T11:51:55.823871+0000 mgr.a (mgr.14373) 16206 : cluster [DBG] pgmap v11240: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T11:51:57.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:51:57 smithi086 bash[24289]: cluster 2024-09-16T11:51:55.823871+0000 mgr.a (mgr.14373) 16206 : cluster [DBG] pgmap v11240: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T11:51:57.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:51:57 smithi047 bash[22744]: cluster 2024-09-16T11:51:55.823871+0000 mgr.a (mgr.14373) 16206 : cluster [DBG] pgmap v11240: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T11:51:58.468 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:51:58.468 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:51:58.468 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:51:58.468 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:51:58.468 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:51:59.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:51:59 smithi157 bash[24585]: cluster 2024-09-16T11:51:57.825415+0000 mgr.a (mgr.14373) 16207 : cluster [DBG] pgmap v11241: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:51:59.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:51:59 smithi157 bash[24585]: audit 2024-09-16T11:51:58.022869+0000 mgr.a (mgr.14373) 16208 : audit [DBG] from='client.349392 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:51:59.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:51:59 smithi086 bash[24289]: cluster 2024-09-16T11:51:57.825415+0000 mgr.a (mgr.14373) 16207 : cluster [DBG] pgmap v11241: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:51:59.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:51:59 smithi086 bash[24289]: audit 2024-09-16T11:51:58.022869+0000 mgr.a (mgr.14373) 16208 : audit [DBG] from='client.349392 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:51:59.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:51:59 smithi047 bash[22744]: cluster 2024-09-16T11:51:57.825415+0000 mgr.a (mgr.14373) 16207 : cluster [DBG] pgmap v11241: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:51:59.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:51:59 smithi047 bash[22744]: audit 2024-09-16T11:51:58.022869+0000 mgr.a (mgr.14373) 16208 : audit [DBG] from='client.349392 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:52:01.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:52:01 smithi157 bash[24585]: cluster 2024-09-16T11:51:59.826494+0000 mgr.a (mgr.14373) 16209 : cluster [DBG] pgmap v11242: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:52:01.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:52:01 smithi086 bash[24289]: cluster 2024-09-16T11:51:59.826494+0000 mgr.a (mgr.14373) 16209 : cluster [DBG] pgmap v11242: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:52:01.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:52:01 smithi047 bash[22744]: cluster 2024-09-16T11:51:59.826494+0000 mgr.a (mgr.14373) 16209 : cluster [DBG] pgmap v11242: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:52:03.469 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:52:03.470 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:52:03.470 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:52:03.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:52:03 smithi157 bash[24585]: cluster 2024-09-16T11:52:01.828694+0000 mgr.a (mgr.14373) 16210 : cluster [DBG] pgmap v11243: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:52:03.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:52:03 smithi086 bash[24289]: cluster 2024-09-16T11:52:01.828694+0000 mgr.a (mgr.14373) 16210 : cluster [DBG] pgmap v11243: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:52:03.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:52:03 smithi047 bash[22744]: cluster 2024-09-16T11:52:01.828694+0000 mgr.a (mgr.14373) 16210 : cluster [DBG] pgmap v11243: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:52:04.247 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:52:04.248 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:52:04.248 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:52:04.248 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:52:04.248 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:52:05.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:52:05 smithi157 bash[24585]: audit 2024-09-16T11:52:03.804601+0000 mgr.a (mgr.14373) 16211 : audit [DBG] from='client.349470 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:52:05.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:52:05 smithi157 bash[24585]: cluster 2024-09-16T11:52:03.829750+0000 mgr.a (mgr.14373) 16212 : cluster [DBG] pgmap v11244: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:52:05.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:52:05 smithi086 bash[24289]: audit 2024-09-16T11:52:03.804601+0000 mgr.a (mgr.14373) 16211 : audit [DBG] from='client.349470 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:52:05.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:52:05 smithi086 bash[24289]: cluster 2024-09-16T11:52:03.829750+0000 mgr.a (mgr.14373) 16212 : cluster [DBG] pgmap v11244: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:52:05.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:52:05 smithi047 bash[22744]: audit 2024-09-16T11:52:03.804601+0000 mgr.a (mgr.14373) 16211 : audit [DBG] from='client.349470 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:52:05.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:52:05 smithi047 bash[22744]: cluster 2024-09-16T11:52:03.829750+0000 mgr.a (mgr.14373) 16212 : cluster [DBG] pgmap v11244: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:52:07.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:52:07 smithi157 bash[24585]: cluster 2024-09-16T11:52:05.830759+0000 mgr.a (mgr.14373) 16213 : cluster [DBG] pgmap v11245: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:52:07.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:52:07 smithi086 bash[24289]: cluster 2024-09-16T11:52:05.830759+0000 mgr.a (mgr.14373) 16213 : cluster [DBG] pgmap v11245: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:52:07.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:52:07 smithi047 bash[22744]: cluster 2024-09-16T11:52:05.830759+0000 mgr.a (mgr.14373) 16213 : cluster [DBG] pgmap v11245: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:52:09.249 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:52:09.250 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:52:09.250 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:52:09.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:52:09 smithi157 bash[24585]: cluster 2024-09-16T11:52:07.833000+0000 mgr.a (mgr.14373) 16214 : cluster [DBG] pgmap v11246: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:52:09.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:52:09 smithi086 bash[24289]: cluster 2024-09-16T11:52:07.833000+0000 mgr.a (mgr.14373) 16214 : cluster [DBG] pgmap v11246: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:52:09.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:52:09 smithi047 bash[22744]: cluster 2024-09-16T11:52:07.833000+0000 mgr.a (mgr.14373) 16214 : cluster [DBG] pgmap v11246: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:52:10.004 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:52:10.005 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:52:10.005 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:52:10.005 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:52:10.005 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:52:11.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:52:11 smithi157 bash[24585]: audit 2024-09-16T11:52:09.577046+0000 mgr.a (mgr.14373) 16215 : audit [DBG] from='client.349548 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:52:11.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:52:11 smithi157 bash[24585]: cluster 2024-09-16T11:52:09.833591+0000 mgr.a (mgr.14373) 16216 : cluster [DBG] pgmap v11247: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:52:11.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:52:11 smithi086 bash[24289]: audit 2024-09-16T11:52:09.577046+0000 mgr.a (mgr.14373) 16215 : audit [DBG] from='client.349548 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:52:11.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:52:11 smithi086 bash[24289]: cluster 2024-09-16T11:52:09.833591+0000 mgr.a (mgr.14373) 16216 : cluster [DBG] pgmap v11247: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:52:11.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:52:11 smithi047 bash[22744]: audit 2024-09-16T11:52:09.577046+0000 mgr.a (mgr.14373) 16215 : audit [DBG] from='client.349548 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:52:11.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:52:11 smithi047 bash[22744]: cluster 2024-09-16T11:52:09.833591+0000 mgr.a (mgr.14373) 16216 : cluster [DBG] pgmap v11247: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:52:13.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:52:13 smithi157 bash[24585]: cluster 2024-09-16T11:52:11.835867+0000 mgr.a (mgr.14373) 16217 : cluster [DBG] pgmap v11248: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:52:13.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:52:13 smithi086 bash[24289]: cluster 2024-09-16T11:52:11.835867+0000 mgr.a (mgr.14373) 16217 : cluster [DBG] pgmap v11248: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:52:13.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:52:13 smithi047 bash[22744]: cluster 2024-09-16T11:52:11.835867+0000 mgr.a (mgr.14373) 16217 : cluster [DBG] pgmap v11248: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:52:15.006 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:52:15.006 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:52:15.007 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:52:15.751 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:52:15.751 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:52:15.751 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:52:15.751 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:52:15.751 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:52:15.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:52:15 smithi157 bash[24585]: cluster 2024-09-16T11:52:13.836642+0000 mgr.a (mgr.14373) 16218 : cluster [DBG] pgmap v11249: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:52:15.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:52:15 smithi086 bash[24289]: cluster 2024-09-16T11:52:13.836642+0000 mgr.a (mgr.14373) 16218 : cluster [DBG] pgmap v11249: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:52:15.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:52:15 smithi047 bash[22744]: cluster 2024-09-16T11:52:13.836642+0000 mgr.a (mgr.14373) 16218 : cluster [DBG] pgmap v11249: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:52:16.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:52:16 smithi157 bash[24585]: audit 2024-09-16T11:52:15.334679+0000 mgr.a (mgr.14373) 16219 : audit [DBG] from='client.349626 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:52:16.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:52:16 smithi086 bash[24289]: audit 2024-09-16T11:52:15.334679+0000 mgr.a (mgr.14373) 16219 : audit [DBG] from='client.349626 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:52:16.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:52:16 smithi047 bash[22744]: audit 2024-09-16T11:52:15.334679+0000 mgr.a (mgr.14373) 16219 : audit [DBG] from='client.349626 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:52:17.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:52:17 smithi157 bash[24585]: cluster 2024-09-16T11:52:15.837586+0000 mgr.a (mgr.14373) 16220 : cluster [DBG] pgmap v11250: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:52:17.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:52:17 smithi086 bash[24289]: cluster 2024-09-16T11:52:15.837586+0000 mgr.a (mgr.14373) 16220 : cluster [DBG] pgmap v11250: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:52:17.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:52:17 smithi047 bash[22744]: cluster 2024-09-16T11:52:15.837586+0000 mgr.a (mgr.14373) 16220 : cluster [DBG] pgmap v11250: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:52:19.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:52:19 smithi086 bash[24289]: cluster 2024-09-16T11:52:17.839877+0000 mgr.a (mgr.14373) 16221 : cluster [DBG] pgmap v11251: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:52:19.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:52:19 smithi047 bash[22744]: cluster 2024-09-16T11:52:17.839877+0000 mgr.a (mgr.14373) 16221 : cluster [DBG] pgmap v11251: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:52:20.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:52:19 smithi157 bash[24585]: cluster 2024-09-16T11:52:17.839877+0000 mgr.a (mgr.14373) 16221 : cluster [DBG] pgmap v11251: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:52:20.752 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:52:20.753 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:52:20.754 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:52:21.522 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:52:21.522 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:52:21.522 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:52:21.522 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:52:21.522 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:52:21.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:52:21 smithi086 bash[24289]: cluster 2024-09-16T11:52:19.840644+0000 mgr.a (mgr.14373) 16222 : cluster [DBG] pgmap v11252: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:52:21.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:52:21 smithi047 bash[22744]: cluster 2024-09-16T11:52:19.840644+0000 mgr.a (mgr.14373) 16222 : cluster [DBG] pgmap v11252: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:52:22.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:52:21 smithi157 bash[24585]: cluster 2024-09-16T11:52:19.840644+0000 mgr.a (mgr.14373) 16222 : cluster [DBG] pgmap v11252: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:52:22.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:52:22 smithi086 bash[24289]: audit 2024-09-16T11:52:21.088804+0000 mgr.a (mgr.14373) 16223 : audit [DBG] from='client.349701 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:52:22.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:52:22 smithi047 bash[22744]: audit 2024-09-16T11:52:21.088804+0000 mgr.a (mgr.14373) 16223 : audit [DBG] from='client.349701 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:52:23.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:52:22 smithi157 bash[24585]: audit 2024-09-16T11:52:21.088804+0000 mgr.a (mgr.14373) 16223 : audit [DBG] from='client.349701 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:52:23.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:52:23 smithi047 bash[22744]: cluster 2024-09-16T11:52:21.842994+0000 mgr.a (mgr.14373) 16224 : cluster [DBG] pgmap v11253: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:52:24.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:52:23 smithi157 bash[24585]: cluster 2024-09-16T11:52:21.842994+0000 mgr.a (mgr.14373) 16224 : cluster [DBG] pgmap v11253: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:52:24.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:52:23 smithi086 bash[24289]: cluster 2024-09-16T11:52:21.842994+0000 mgr.a (mgr.14373) 16224 : cluster [DBG] pgmap v11253: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:52:24.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:52:24 smithi047 bash[22744]: cluster 2024-09-16T11:52:23.843733+0000 mgr.a (mgr.14373) 16225 : cluster [DBG] pgmap v11254: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:52:25.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:52:24 smithi157 bash[24585]: cluster 2024-09-16T11:52:23.843733+0000 mgr.a (mgr.14373) 16225 : cluster [DBG] pgmap v11254: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:52:25.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:52:24 smithi086 bash[24289]: cluster 2024-09-16T11:52:23.843733+0000 mgr.a (mgr.14373) 16225 : cluster [DBG] pgmap v11254: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:52:26.523 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:52:26.524 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:52:26.524 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:52:27.297 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:52:27.297 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:52:27.297 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:52:27.297 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:52:27.297 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:52:27.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:52:26 smithi157 bash[24585]: cluster 2024-09-16T11:52:25.844498+0000 mgr.a (mgr.14373) 16226 : cluster [DBG] pgmap v11255: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:52:27.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:52:26 smithi086 bash[24289]: cluster 2024-09-16T11:52:25.844498+0000 mgr.a (mgr.14373) 16226 : cluster [DBG] pgmap v11255: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:52:27.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:52:26 smithi047 bash[22744]: cluster 2024-09-16T11:52:25.844498+0000 mgr.a (mgr.14373) 16226 : cluster [DBG] pgmap v11255: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:52:28.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:52:27 smithi157 bash[24585]: audit 2024-09-16T11:52:26.863363+0000 mgr.a (mgr.14373) 16227 : audit [DBG] from='client.349779 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:52:28.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:52:27 smithi086 bash[24289]: audit 2024-09-16T11:52:26.863363+0000 mgr.a (mgr.14373) 16227 : audit [DBG] from='client.349779 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:52:28.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:52:27 smithi047 bash[22744]: audit 2024-09-16T11:52:26.863363+0000 mgr.a (mgr.14373) 16227 : audit [DBG] from='client.349779 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:52:29.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:52:28 smithi157 bash[24585]: cluster 2024-09-16T11:52:27.847429+0000 mgr.a (mgr.14373) 16228 : cluster [DBG] pgmap v11256: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:52:29.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:52:28 smithi086 bash[24289]: cluster 2024-09-16T11:52:27.847429+0000 mgr.a (mgr.14373) 16228 : cluster [DBG] pgmap v11256: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:52:29.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:52:28 smithi047 bash[22744]: cluster 2024-09-16T11:52:27.847429+0000 mgr.a (mgr.14373) 16228 : cluster [DBG] pgmap v11256: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:52:31.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:52:30 smithi157 bash[24585]: cluster 2024-09-16T11:52:29.848192+0000 mgr.a (mgr.14373) 16229 : cluster [DBG] pgmap v11257: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:52:31.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:52:30 smithi086 bash[24289]: cluster 2024-09-16T11:52:29.848192+0000 mgr.a (mgr.14373) 16229 : cluster [DBG] pgmap v11257: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:52:31.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:52:30 smithi047 bash[22744]: cluster 2024-09-16T11:52:29.848192+0000 mgr.a (mgr.14373) 16229 : cluster [DBG] pgmap v11257: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:52:32.299 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:52:32.299 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:52:32.299 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:52:33.080 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:52:33.081 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:52:33.081 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:52:33.081 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:52:33.081 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:52:33.308 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:52:32 smithi157 bash[24585]: cluster 2024-09-16T11:52:31.850035+0000 mgr.a (mgr.14373) 16230 : cluster [DBG] pgmap v11258: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:52:33.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:52:32 smithi086 bash[24289]: cluster 2024-09-16T11:52:31.850035+0000 mgr.a (mgr.14373) 16230 : cluster [DBG] pgmap v11258: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:52:33.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:52:32 smithi047 bash[22744]: cluster 2024-09-16T11:52:31.850035+0000 mgr.a (mgr.14373) 16230 : cluster [DBG] pgmap v11258: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:52:34.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:52:33 smithi157 bash[24585]: audit 2024-09-16T11:52:32.633439+0000 mgr.a (mgr.14373) 16231 : audit [DBG] from='client.349857 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:52:34.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:52:33 smithi157 bash[24585]: audit 2024-09-16T11:52:33.042602+0000 mon.b (mon.2) 1474 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T11:52:34.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:52:33 smithi157 bash[24585]: audit 2024-09-16T11:52:33.603664+0000 mon.a (mon.0) 1538 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:52:34.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:52:33 smithi157 bash[24585]: audit 2024-09-16T11:52:33.611606+0000 mon.a (mon.0) 1539 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:52:34.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:52:33 smithi157 bash[24585]: audit 2024-09-16T11:52:33.616753+0000 mon.a (mon.0) 1540 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:52:34.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:52:33 smithi157 bash[24585]: audit 2024-09-16T11:52:33.622492+0000 mon.a (mon.0) 1541 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:52:34.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:52:33 smithi086 bash[24289]: audit 2024-09-16T11:52:32.633439+0000 mgr.a (mgr.14373) 16231 : audit [DBG] from='client.349857 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:52:34.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:52:33 smithi086 bash[24289]: audit 2024-09-16T11:52:33.042602+0000 mon.b (mon.2) 1474 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T11:52:34.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:52:33 smithi086 bash[24289]: audit 2024-09-16T11:52:33.603664+0000 mon.a (mon.0) 1538 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:52:34.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:52:33 smithi086 bash[24289]: audit 2024-09-16T11:52:33.611606+0000 mon.a (mon.0) 1539 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:52:34.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:52:33 smithi086 bash[24289]: audit 2024-09-16T11:52:33.616753+0000 mon.a (mon.0) 1540 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:52:34.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:52:33 smithi086 bash[24289]: audit 2024-09-16T11:52:33.622492+0000 mon.a (mon.0) 1541 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:52:34.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:52:33 smithi047 bash[22744]: audit 2024-09-16T11:52:32.633439+0000 mgr.a (mgr.14373) 16231 : audit [DBG] from='client.349857 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:52:34.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:52:33 smithi047 bash[22744]: audit 2024-09-16T11:52:33.042602+0000 mon.b (mon.2) 1474 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T11:52:34.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:52:33 smithi047 bash[22744]: audit 2024-09-16T11:52:33.603664+0000 mon.a (mon.0) 1538 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:52:34.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:52:33 smithi047 bash[22744]: audit 2024-09-16T11:52:33.611606+0000 mon.a (mon.0) 1539 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:52:34.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:52:33 smithi047 bash[22744]: audit 2024-09-16T11:52:33.616753+0000 mon.a (mon.0) 1540 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:52:34.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:52:33 smithi047 bash[22744]: audit 2024-09-16T11:52:33.622492+0000 mon.a (mon.0) 1541 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:52:35.196 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:52:34 smithi047 bash[22744]: cluster 2024-09-16T11:52:33.850919+0000 mgr.a (mgr.14373) 16232 : cluster [DBG] pgmap v11259: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:52:35.197 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:52:34 smithi047 bash[22744]: audit 2024-09-16T11:52:34.426618+0000 mon.b (mon.2) 1475 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T11:52:35.197 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:52:34 smithi047 bash[22744]: audit 2024-09-16T11:52:34.428515+0000 mon.b (mon.2) 1476 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T11:52:35.197 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:52:34 smithi047 bash[22744]: audit 2024-09-16T11:52:34.439914+0000 mon.a (mon.0) 1542 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:52:35.197 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:52:34 smithi047 bash[22744]: audit 2024-09-16T11:52:34.445162+0000 mon.b (mon.2) 1477 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:52:35.197 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:52:34 smithi047 bash[22744]: audit 2024-09-16T11:52:34.447805+0000 mgr.a (mgr.14373) 16233 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:52:35.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:52:34 smithi157 bash[24585]: cluster 2024-09-16T11:52:33.850919+0000 mgr.a (mgr.14373) 16232 : cluster [DBG] pgmap v11259: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:52:35.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:52:34 smithi157 bash[24585]: audit 2024-09-16T11:52:34.426618+0000 mon.b (mon.2) 1475 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T11:52:35.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:52:34 smithi157 bash[24585]: audit 2024-09-16T11:52:34.428515+0000 mon.b (mon.2) 1476 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T11:52:35.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:52:34 smithi157 bash[24585]: audit 2024-09-16T11:52:34.439914+0000 mon.a (mon.0) 1542 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:52:35.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:52:34 smithi157 bash[24585]: audit 2024-09-16T11:52:34.445162+0000 mon.b (mon.2) 1477 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:52:35.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:52:34 smithi157 bash[24585]: audit 2024-09-16T11:52:34.447805+0000 mgr.a (mgr.14373) 16233 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:52:35.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:52:34 smithi086 bash[24289]: cluster 2024-09-16T11:52:33.850919+0000 mgr.a (mgr.14373) 16232 : cluster [DBG] pgmap v11259: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:52:35.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:52:34 smithi086 bash[24289]: audit 2024-09-16T11:52:34.426618+0000 mon.b (mon.2) 1475 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T11:52:35.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:52:34 smithi086 bash[24289]: audit 2024-09-16T11:52:34.428515+0000 mon.b (mon.2) 1476 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T11:52:35.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:52:34 smithi086 bash[24289]: audit 2024-09-16T11:52:34.439914+0000 mon.a (mon.0) 1542 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:52:35.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:52:34 smithi086 bash[24289]: audit 2024-09-16T11:52:34.445162+0000 mon.b (mon.2) 1477 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:52:35.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:52:34 smithi086 bash[24289]: audit 2024-09-16T11:52:34.447805+0000 mgr.a (mgr.14373) 16233 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:52:35.593 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 11:52:35 smithi047 bash[22994]: debug 2024-09-16T11:52:35.191+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T11:52:35.593 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 11:52:35 smithi047 bash[22994]: debug 2024-09-16T11:52:35.191+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T11:52:36.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:52:35 smithi157 bash[24585]: audit 2024-09-16T11:52:35.195203+0000 mgr.a (mgr.14373) 16234 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T11:52:36.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:52:35 smithi157 bash[24585]: cephadm 2024-09-16T11:52:35.197445+0000 mgr.a (mgr.14373) 16235 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T11:52:36.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:52:35 smithi086 bash[24289]: audit 2024-09-16T11:52:35.195203+0000 mgr.a (mgr.14373) 16234 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T11:52:36.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:52:35 smithi086 bash[24289]: cephadm 2024-09-16T11:52:35.197445+0000 mgr.a (mgr.14373) 16235 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T11:52:36.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:52:35 smithi047 bash[22744]: audit 2024-09-16T11:52:35.195203+0000 mgr.a (mgr.14373) 16234 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T11:52:36.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:52:35 smithi047 bash[22744]: cephadm 2024-09-16T11:52:35.197445+0000 mgr.a (mgr.14373) 16235 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T11:52:37.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:52:36 smithi157 bash[24585]: cluster 2024-09-16T11:52:35.851831+0000 mgr.a (mgr.14373) 16236 : cluster [DBG] pgmap v11260: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T11:52:37.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:52:36 smithi086 bash[24289]: cluster 2024-09-16T11:52:35.851831+0000 mgr.a (mgr.14373) 16236 : cluster [DBG] pgmap v11260: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T11:52:37.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:52:36 smithi047 bash[22744]: cluster 2024-09-16T11:52:35.851831+0000 mgr.a (mgr.14373) 16236 : cluster [DBG] pgmap v11260: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T11:52:38.082 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:52:38.083 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:52:38.083 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:52:38.868 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:52:38.868 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:52:38.868 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:52:38.868 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:52:38.868 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:52:39.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:52:38 smithi157 bash[24585]: cluster 2024-09-16T11:52:37.854063+0000 mgr.a (mgr.14373) 16237 : cluster [DBG] pgmap v11261: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:52:39.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:52:38 smithi157 bash[24585]: audit 2024-09-16T11:52:38.414004+0000 mgr.a (mgr.14373) 16238 : audit [DBG] from='client.350037 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:52:39.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:52:38 smithi086 bash[24289]: cluster 2024-09-16T11:52:37.854063+0000 mgr.a (mgr.14373) 16237 : cluster [DBG] pgmap v11261: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:52:39.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:52:38 smithi086 bash[24289]: audit 2024-09-16T11:52:38.414004+0000 mgr.a (mgr.14373) 16238 : audit [DBG] from='client.350037 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:52:39.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:52:38 smithi047 bash[22744]: cluster 2024-09-16T11:52:37.854063+0000 mgr.a (mgr.14373) 16237 : cluster [DBG] pgmap v11261: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:52:39.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:52:38 smithi047 bash[22744]: audit 2024-09-16T11:52:38.414004+0000 mgr.a (mgr.14373) 16238 : audit [DBG] from='client.350037 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:52:41.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:52:40 smithi157 bash[24585]: cluster 2024-09-16T11:52:39.855069+0000 mgr.a (mgr.14373) 16239 : cluster [DBG] pgmap v11262: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:52:41.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:52:40 smithi086 bash[24289]: cluster 2024-09-16T11:52:39.855069+0000 mgr.a (mgr.14373) 16239 : cluster [DBG] pgmap v11262: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:52:41.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:52:40 smithi047 bash[22744]: cluster 2024-09-16T11:52:39.855069+0000 mgr.a (mgr.14373) 16239 : cluster [DBG] pgmap v11262: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:52:43.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:52:42 smithi157 bash[24585]: cluster 2024-09-16T11:52:41.857327+0000 mgr.a (mgr.14373) 16240 : cluster [DBG] pgmap v11263: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:52:43.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:52:42 smithi086 bash[24289]: cluster 2024-09-16T11:52:41.857327+0000 mgr.a (mgr.14373) 16240 : cluster [DBG] pgmap v11263: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:52:43.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:52:42 smithi047 bash[22744]: cluster 2024-09-16T11:52:41.857327+0000 mgr.a (mgr.14373) 16240 : cluster [DBG] pgmap v11263: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:52:43.869 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:52:43.870 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:52:43.870 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:52:44.619 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:52:44.620 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:52:44.620 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:52:44.620 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:52:44.620 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:52:45.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:52:44 smithi157 bash[24585]: cluster 2024-09-16T11:52:43.858281+0000 mgr.a (mgr.14373) 16241 : cluster [DBG] pgmap v11264: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:52:45.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:52:44 smithi157 bash[24585]: audit 2024-09-16T11:52:44.199699+0000 mgr.a (mgr.14373) 16242 : audit [DBG] from='client.350112 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:52:45.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:52:44 smithi086 bash[24289]: cluster 2024-09-16T11:52:43.858281+0000 mgr.a (mgr.14373) 16241 : cluster [DBG] pgmap v11264: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:52:45.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:52:44 smithi086 bash[24289]: audit 2024-09-16T11:52:44.199699+0000 mgr.a (mgr.14373) 16242 : audit [DBG] from='client.350112 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:52:45.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:52:44 smithi047 bash[22744]: cluster 2024-09-16T11:52:43.858281+0000 mgr.a (mgr.14373) 16241 : cluster [DBG] pgmap v11264: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:52:45.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:52:44 smithi047 bash[22744]: audit 2024-09-16T11:52:44.199699+0000 mgr.a (mgr.14373) 16242 : audit [DBG] from='client.350112 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:52:47.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:52:46 smithi157 bash[24585]: cluster 2024-09-16T11:52:45.859399+0000 mgr.a (mgr.14373) 16243 : cluster [DBG] pgmap v11265: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:52:47.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:52:46 smithi086 bash[24289]: cluster 2024-09-16T11:52:45.859399+0000 mgr.a (mgr.14373) 16243 : cluster [DBG] pgmap v11265: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:52:47.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:52:46 smithi047 bash[22744]: cluster 2024-09-16T11:52:45.859399+0000 mgr.a (mgr.14373) 16243 : cluster [DBG] pgmap v11265: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:52:49.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:52:48 smithi157 bash[24585]: cluster 2024-09-16T11:52:47.861650+0000 mgr.a (mgr.14373) 16244 : cluster [DBG] pgmap v11266: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:52:49.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:52:48 smithi086 bash[24289]: cluster 2024-09-16T11:52:47.861650+0000 mgr.a (mgr.14373) 16244 : cluster [DBG] pgmap v11266: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:52:49.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:52:48 smithi047 bash[22744]: cluster 2024-09-16T11:52:47.861650+0000 mgr.a (mgr.14373) 16244 : cluster [DBG] pgmap v11266: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:52:49.621 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:52:49.621 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:52:49.621 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:52:50.385 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:52:50.386 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:52:50.386 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:52:50.386 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:52:50.386 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:52:51.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:52:50 smithi157 bash[24585]: cluster 2024-09-16T11:52:49.862189+0000 mgr.a (mgr.14373) 16245 : cluster [DBG] pgmap v11267: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:52:51.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:52:50 smithi157 bash[24585]: audit 2024-09-16T11:52:49.953975+0000 mgr.a (mgr.14373) 16246 : audit [DBG] from='client.350187 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:52:51.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:52:50 smithi086 bash[24289]: cluster 2024-09-16T11:52:49.862189+0000 mgr.a (mgr.14373) 16245 : cluster [DBG] pgmap v11267: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:52:51.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:52:50 smithi086 bash[24289]: audit 2024-09-16T11:52:49.953975+0000 mgr.a (mgr.14373) 16246 : audit [DBG] from='client.350187 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:52:51.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:52:50 smithi047 bash[22744]: cluster 2024-09-16T11:52:49.862189+0000 mgr.a (mgr.14373) 16245 : cluster [DBG] pgmap v11267: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:52:51.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:52:50 smithi047 bash[22744]: audit 2024-09-16T11:52:49.953975+0000 mgr.a (mgr.14373) 16246 : audit [DBG] from='client.350187 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:52:53.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:52:52 smithi157 bash[24585]: cluster 2024-09-16T11:52:51.864425+0000 mgr.a (mgr.14373) 16247 : cluster [DBG] pgmap v11268: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:52:53.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:52:52 smithi086 bash[24289]: cluster 2024-09-16T11:52:51.864425+0000 mgr.a (mgr.14373) 16247 : cluster [DBG] pgmap v11268: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:52:53.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:52:52 smithi047 bash[22744]: cluster 2024-09-16T11:52:51.864425+0000 mgr.a (mgr.14373) 16247 : cluster [DBG] pgmap v11268: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:52:55.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:52:54 smithi157 bash[24585]: cluster 2024-09-16T11:52:53.865228+0000 mgr.a (mgr.14373) 16248 : cluster [DBG] pgmap v11269: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:52:55.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:52:54 smithi086 bash[24289]: cluster 2024-09-16T11:52:53.865228+0000 mgr.a (mgr.14373) 16248 : cluster [DBG] pgmap v11269: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:52:55.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:52:54 smithi047 bash[22744]: cluster 2024-09-16T11:52:53.865228+0000 mgr.a (mgr.14373) 16248 : cluster [DBG] pgmap v11269: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:52:55.387 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:52:55.388 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:52:55.388 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:52:56.189 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:52:56.189 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:52:56.189 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:52:56.189 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:52:56.189 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:52:57.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:52:56 smithi157 bash[24585]: audit 2024-09-16T11:52:55.727115+0000 mgr.a (mgr.14373) 16249 : audit [DBG] from='client.350262 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:52:57.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:52:56 smithi157 bash[24585]: cluster 2024-09-16T11:52:55.875059+0000 mgr.a (mgr.14373) 16250 : cluster [DBG] pgmap v11270: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:52:57.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:52:56 smithi086 bash[24289]: audit 2024-09-16T11:52:55.727115+0000 mgr.a (mgr.14373) 16249 : audit [DBG] from='client.350262 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:52:57.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:52:56 smithi086 bash[24289]: cluster 2024-09-16T11:52:55.875059+0000 mgr.a (mgr.14373) 16250 : cluster [DBG] pgmap v11270: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:52:57.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:52:56 smithi047 bash[22744]: audit 2024-09-16T11:52:55.727115+0000 mgr.a (mgr.14373) 16249 : audit [DBG] from='client.350262 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:52:57.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:52:56 smithi047 bash[22744]: cluster 2024-09-16T11:52:55.875059+0000 mgr.a (mgr.14373) 16250 : cluster [DBG] pgmap v11270: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:52:59.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:52:58 smithi157 bash[24585]: cluster 2024-09-16T11:52:57.877449+0000 mgr.a (mgr.14373) 16251 : cluster [DBG] pgmap v11271: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:52:59.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:52:58 smithi086 bash[24289]: cluster 2024-09-16T11:52:57.877449+0000 mgr.a (mgr.14373) 16251 : cluster [DBG] pgmap v11271: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:52:59.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:52:58 smithi047 bash[22744]: cluster 2024-09-16T11:52:57.877449+0000 mgr.a (mgr.14373) 16251 : cluster [DBG] pgmap v11271: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:53:01.190 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:53:01.191 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:53:01.191 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:53:01.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:53:00 smithi157 bash[24585]: cluster 2024-09-16T11:52:59.878215+0000 mgr.a (mgr.14373) 16252 : cluster [DBG] pgmap v11272: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:53:01.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:53:00 smithi086 bash[24289]: cluster 2024-09-16T11:52:59.878215+0000 mgr.a (mgr.14373) 16252 : cluster [DBG] pgmap v11272: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:53:01.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:53:00 smithi047 bash[22744]: cluster 2024-09-16T11:52:59.878215+0000 mgr.a (mgr.14373) 16252 : cluster [DBG] pgmap v11272: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:53:01.946 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:53:01.947 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:53:01.947 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:53:01.947 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:53:01.947 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:53:02.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:53:02 smithi157 bash[24585]: audit 2024-09-16T11:53:01.523379+0000 mgr.a (mgr.14373) 16253 : audit [DBG] from='client.350340 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:53:02.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:53:02 smithi086 bash[24289]: audit 2024-09-16T11:53:01.523379+0000 mgr.a (mgr.14373) 16253 : audit [DBG] from='client.350340 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:53:02.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:53:02 smithi047 bash[22744]: audit 2024-09-16T11:53:01.523379+0000 mgr.a (mgr.14373) 16253 : audit [DBG] from='client.350340 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:53:03.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:53:03 smithi157 bash[24585]: cluster 2024-09-16T11:53:01.879537+0000 mgr.a (mgr.14373) 16254 : cluster [DBG] pgmap v11273: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:53:03.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:53:03 smithi086 bash[24289]: cluster 2024-09-16T11:53:01.879537+0000 mgr.a (mgr.14373) 16254 : cluster [DBG] pgmap v11273: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:53:03.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:53:03 smithi047 bash[22744]: cluster 2024-09-16T11:53:01.879537+0000 mgr.a (mgr.14373) 16254 : cluster [DBG] pgmap v11273: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:53:05.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:53:05 smithi157 bash[24585]: cluster 2024-09-16T11:53:03.880277+0000 mgr.a (mgr.14373) 16255 : cluster [DBG] pgmap v11274: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:53:05.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:53:05 smithi086 bash[24289]: cluster 2024-09-16T11:53:03.880277+0000 mgr.a (mgr.14373) 16255 : cluster [DBG] pgmap v11274: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:53:05.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:53:05 smithi047 bash[22744]: cluster 2024-09-16T11:53:03.880277+0000 mgr.a (mgr.14373) 16255 : cluster [DBG] pgmap v11274: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:53:06.948 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:53:06.949 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:53:06.949 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:53:07.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:53:07 smithi157 bash[24585]: cluster 2024-09-16T11:53:05.881044+0000 mgr.a (mgr.14373) 16256 : cluster [DBG] pgmap v11275: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:53:07.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:53:07 smithi086 bash[24289]: cluster 2024-09-16T11:53:05.881044+0000 mgr.a (mgr.14373) 16256 : cluster [DBG] pgmap v11275: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:53:07.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:53:07 smithi047 bash[22744]: cluster 2024-09-16T11:53:05.881044+0000 mgr.a (mgr.14373) 16256 : cluster [DBG] pgmap v11275: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:53:07.725 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:53:07.725 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:53:07.725 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:53:07.725 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:53:07.725 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:53:08.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:53:08 smithi157 bash[24585]: audit 2024-09-16T11:53:07.285564+0000 mgr.a (mgr.14373) 16257 : audit [DBG] from='client.350418 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:53:08.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:53:08 smithi086 bash[24289]: audit 2024-09-16T11:53:07.285564+0000 mgr.a (mgr.14373) 16257 : audit [DBG] from='client.350418 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:53:08.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:53:08 smithi047 bash[22744]: audit 2024-09-16T11:53:07.285564+0000 mgr.a (mgr.14373) 16257 : audit [DBG] from='client.350418 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:53:09.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:53:09 smithi157 bash[24585]: cluster 2024-09-16T11:53:07.883848+0000 mgr.a (mgr.14373) 16258 : cluster [DBG] pgmap v11276: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:53:09.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:53:09 smithi086 bash[24289]: cluster 2024-09-16T11:53:07.883848+0000 mgr.a (mgr.14373) 16258 : cluster [DBG] pgmap v11276: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:53:09.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:53:09 smithi047 bash[22744]: cluster 2024-09-16T11:53:07.883848+0000 mgr.a (mgr.14373) 16258 : cluster [DBG] pgmap v11276: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:53:11.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:53:11 smithi157 bash[24585]: cluster 2024-09-16T11:53:09.884638+0000 mgr.a (mgr.14373) 16259 : cluster [DBG] pgmap v11277: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:53:11.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:53:11 smithi086 bash[24289]: cluster 2024-09-16T11:53:09.884638+0000 mgr.a (mgr.14373) 16259 : cluster [DBG] pgmap v11277: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:53:11.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:53:11 smithi047 bash[22744]: cluster 2024-09-16T11:53:09.884638+0000 mgr.a (mgr.14373) 16259 : cluster [DBG] pgmap v11277: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:53:12.726 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:53:12.727 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:53:12.727 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:53:13.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:53:13 smithi157 bash[24585]: cluster 2024-09-16T11:53:11.886585+0000 mgr.a (mgr.14373) 16260 : cluster [DBG] pgmap v11278: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:53:13.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:53:13 smithi086 bash[24289]: cluster 2024-09-16T11:53:11.886585+0000 mgr.a (mgr.14373) 16260 : cluster [DBG] pgmap v11278: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:53:13.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:53:13 smithi047 bash[22744]: cluster 2024-09-16T11:53:11.886585+0000 mgr.a (mgr.14373) 16260 : cluster [DBG] pgmap v11278: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:53:13.489 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:53:13.489 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:53:13.489 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:53:13.489 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:53:13.490 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:53:14.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:53:14 smithi157 bash[24585]: audit 2024-09-16T11:53:13.058715+0000 mgr.a (mgr.14373) 16261 : audit [DBG] from='client.350490 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:53:14.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:53:14 smithi086 bash[24289]: audit 2024-09-16T11:53:13.058715+0000 mgr.a (mgr.14373) 16261 : audit [DBG] from='client.350490 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:53:14.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:53:14 smithi047 bash[22744]: audit 2024-09-16T11:53:13.058715+0000 mgr.a (mgr.14373) 16261 : audit [DBG] from='client.350490 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:53:15.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:53:15 smithi157 bash[24585]: cluster 2024-09-16T11:53:13.887474+0000 mgr.a (mgr.14373) 16262 : cluster [DBG] pgmap v11279: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:53:15.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:53:15 smithi086 bash[24289]: cluster 2024-09-16T11:53:13.887474+0000 mgr.a (mgr.14373) 16262 : cluster [DBG] pgmap v11279: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:53:15.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:53:15 smithi047 bash[22744]: cluster 2024-09-16T11:53:13.887474+0000 mgr.a (mgr.14373) 16262 : cluster [DBG] pgmap v11279: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:53:17.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:53:17 smithi157 bash[24585]: cluster 2024-09-16T11:53:15.888270+0000 mgr.a (mgr.14373) 16263 : cluster [DBG] pgmap v11280: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:53:17.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:53:17 smithi086 bash[24289]: cluster 2024-09-16T11:53:15.888270+0000 mgr.a (mgr.14373) 16263 : cluster [DBG] pgmap v11280: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:53:17.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:53:17 smithi047 bash[22744]: cluster 2024-09-16T11:53:15.888270+0000 mgr.a (mgr.14373) 16263 : cluster [DBG] pgmap v11280: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:53:18.490 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:53:18.491 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:53:18.491 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:53:19.238 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:53:19.239 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:53:19.239 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:53:19.239 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:53:19.239 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:53:19.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:53:19 smithi157 bash[24585]: cluster 2024-09-16T11:53:17.890518+0000 mgr.a (mgr.14373) 16264 : cluster [DBG] pgmap v11281: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:53:19.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:53:19 smithi086 bash[24289]: cluster 2024-09-16T11:53:17.890518+0000 mgr.a (mgr.14373) 16264 : cluster [DBG] pgmap v11281: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:53:19.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:53:19 smithi047 bash[22744]: cluster 2024-09-16T11:53:17.890518+0000 mgr.a (mgr.14373) 16264 : cluster [DBG] pgmap v11281: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:53:20.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:53:20 smithi086 bash[24289]: audit 2024-09-16T11:53:18.819973+0000 mgr.a (mgr.14373) 16265 : audit [DBG] from='client.350568 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:53:20.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:53:20 smithi047 bash[22744]: audit 2024-09-16T11:53:18.819973+0000 mgr.a (mgr.14373) 16265 : audit [DBG] from='client.350568 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:53:20.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:53:20 smithi157 bash[24585]: audit 2024-09-16T11:53:18.819973+0000 mgr.a (mgr.14373) 16265 : audit [DBG] from='client.350568 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:53:21.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:53:21 smithi086 bash[24289]: cluster 2024-09-16T11:53:19.891460+0000 mgr.a (mgr.14373) 16266 : cluster [DBG] pgmap v11282: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:53:21.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:53:21 smithi047 bash[22744]: cluster 2024-09-16T11:53:19.891460+0000 mgr.a (mgr.14373) 16266 : cluster [DBG] pgmap v11282: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:53:21.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:53:21 smithi157 bash[24585]: cluster 2024-09-16T11:53:19.891460+0000 mgr.a (mgr.14373) 16266 : cluster [DBG] pgmap v11282: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:53:23.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:53:23 smithi086 bash[24289]: cluster 2024-09-16T11:53:21.893594+0000 mgr.a (mgr.14373) 16267 : cluster [DBG] pgmap v11283: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:53:23.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:53:23 smithi047 bash[22744]: cluster 2024-09-16T11:53:21.893594+0000 mgr.a (mgr.14373) 16267 : cluster [DBG] pgmap v11283: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:53:23.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:53:23 smithi157 bash[24585]: cluster 2024-09-16T11:53:21.893594+0000 mgr.a (mgr.14373) 16267 : cluster [DBG] pgmap v11283: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:53:24.240 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:53:24.241 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:53:24.241 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:53:25.011 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:53:25.012 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:53:25.012 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:53:25.012 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:53:25.012 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:53:25.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:53:25 smithi086 bash[24289]: cluster 2024-09-16T11:53:23.894386+0000 mgr.a (mgr.14373) 16268 : cluster [DBG] pgmap v11284: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:53:25.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:53:25 smithi086 bash[24289]: audit 2024-09-16T11:53:24.575414+0000 mgr.a (mgr.14373) 16269 : audit [DBG] from='client.350646 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:53:25.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:53:25 smithi047 bash[22744]: cluster 2024-09-16T11:53:23.894386+0000 mgr.a (mgr.14373) 16268 : cluster [DBG] pgmap v11284: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:53:25.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:53:25 smithi047 bash[22744]: audit 2024-09-16T11:53:24.575414+0000 mgr.a (mgr.14373) 16269 : audit [DBG] from='client.350646 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:53:25.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:53:25 smithi157 bash[24585]: cluster 2024-09-16T11:53:23.894386+0000 mgr.a (mgr.14373) 16268 : cluster [DBG] pgmap v11284: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:53:25.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:53:25 smithi157 bash[24585]: audit 2024-09-16T11:53:24.575414+0000 mgr.a (mgr.14373) 16269 : audit [DBG] from='client.350646 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:53:27.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:53:27 smithi047 bash[22744]: cluster 2024-09-16T11:53:25.895308+0000 mgr.a (mgr.14373) 16270 : cluster [DBG] pgmap v11285: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:53:27.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:53:27 smithi157 bash[24585]: cluster 2024-09-16T11:53:25.895308+0000 mgr.a (mgr.14373) 16270 : cluster [DBG] pgmap v11285: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:53:27.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:53:27 smithi086 bash[24289]: cluster 2024-09-16T11:53:25.895308+0000 mgr.a (mgr.14373) 16270 : cluster [DBG] pgmap v11285: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:53:29.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:53:29 smithi047 bash[22744]: cluster 2024-09-16T11:53:27.897546+0000 mgr.a (mgr.14373) 16271 : cluster [DBG] pgmap v11286: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:53:29.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:53:29 smithi157 bash[24585]: cluster 2024-09-16T11:53:27.897546+0000 mgr.a (mgr.14373) 16271 : cluster [DBG] pgmap v11286: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:53:29.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:53:29 smithi086 bash[24289]: cluster 2024-09-16T11:53:27.897546+0000 mgr.a (mgr.14373) 16271 : cluster [DBG] pgmap v11286: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:53:30.013 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:53:30.014 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:53:30.014 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:53:30.788 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:53:30.788 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:53:30.789 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:53:30.789 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:53:30.789 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:53:31.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:53:31 smithi047 bash[22744]: cluster 2024-09-16T11:53:29.898322+0000 mgr.a (mgr.14373) 16272 : cluster [DBG] pgmap v11287: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:53:31.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:53:31 smithi047 bash[22744]: audit 2024-09-16T11:53:30.343533+0000 mgr.a (mgr.14373) 16273 : audit [DBG] from='client.350724 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:53:31.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:53:31 smithi157 bash[24585]: cluster 2024-09-16T11:53:29.898322+0000 mgr.a (mgr.14373) 16272 : cluster [DBG] pgmap v11287: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:53:31.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:53:31 smithi157 bash[24585]: audit 2024-09-16T11:53:30.343533+0000 mgr.a (mgr.14373) 16273 : audit [DBG] from='client.350724 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:53:31.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:53:31 smithi086 bash[24289]: cluster 2024-09-16T11:53:29.898322+0000 mgr.a (mgr.14373) 16272 : cluster [DBG] pgmap v11287: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:53:31.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:53:31 smithi086 bash[24289]: audit 2024-09-16T11:53:30.343533+0000 mgr.a (mgr.14373) 16273 : audit [DBG] from='client.350724 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:53:33.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:53:33 smithi047 bash[22744]: cluster 2024-09-16T11:53:31.900615+0000 mgr.a (mgr.14373) 16274 : cluster [DBG] pgmap v11288: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:53:33.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:53:33 smithi157 bash[24585]: cluster 2024-09-16T11:53:31.900615+0000 mgr.a (mgr.14373) 16274 : cluster [DBG] pgmap v11288: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:53:33.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:53:33 smithi086 bash[24289]: cluster 2024-09-16T11:53:31.900615+0000 mgr.a (mgr.14373) 16274 : cluster [DBG] pgmap v11288: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:53:35.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:53:35 smithi047 bash[22744]: cluster 2024-09-16T11:53:33.901537+0000 mgr.a (mgr.14373) 16275 : cluster [DBG] pgmap v11289: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:53:35.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:53:35 smithi157 bash[24585]: cluster 2024-09-16T11:53:33.901537+0000 mgr.a (mgr.14373) 16275 : cluster [DBG] pgmap v11289: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:53:35.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:53:35 smithi086 bash[24289]: cluster 2024-09-16T11:53:33.901537+0000 mgr.a (mgr.14373) 16275 : cluster [DBG] pgmap v11289: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:53:35.789 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:53:35.790 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:53:35.790 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:53:36.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:53:36 smithi157 bash[24585]: audit 2024-09-16T11:53:35.255522+0000 mon.b (mon.2) 1478 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T11:53:36.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:53:36 smithi086 bash[24289]: audit 2024-09-16T11:53:35.255522+0000 mon.b (mon.2) 1478 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T11:53:36.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:53:36 smithi047 bash[22744]: audit 2024-09-16T11:53:35.255522+0000 mon.b (mon.2) 1478 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T11:53:37.092 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 11:53:36 smithi047 bash[22994]: debug 2024-09-16T11:53:36.858+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T11:53:37.092 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 11:53:36 smithi047 bash[22994]: debug 2024-09-16T11:53:36.870+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T11:53:37.283 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:53:37.284 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:53:37.284 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:53:37.284 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:53:37.284 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:53:37.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:53:37 smithi157 bash[24585]: cluster 2024-09-16T11:53:35.902068+0000 mgr.a (mgr.14373) 16276 : cluster [DBG] pgmap v11290: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:53:37.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:53:37 smithi157 bash[24585]: audit 2024-09-16T11:53:36.091524+0000 mon.b (mon.2) 1479 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T11:53:37.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:53:37 smithi157 bash[24585]: audit 2024-09-16T11:53:36.107858+0000 mon.b (mon.2) 1480 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T11:53:37.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:53:37 smithi157 bash[24585]: audit 2024-09-16T11:53:36.117338+0000 mon.a (mon.0) 1543 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:53:37.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:53:37 smithi157 bash[24585]: audit 2024-09-16T11:53:36.121914+0000 mon.b (mon.2) 1481 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:53:37.558 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:53:37 smithi157 bash[24585]: audit 2024-09-16T11:53:36.123312+0000 mgr.a (mgr.14373) 16277 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:53:37.558 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:53:37 smithi157 bash[24585]: audit 2024-09-16T11:53:36.144430+0000 mgr.a (mgr.14373) 16278 : audit [DBG] from='client.350799 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:53:37.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:53:37 smithi086 bash[24289]: cluster 2024-09-16T11:53:35.902068+0000 mgr.a (mgr.14373) 16276 : cluster [DBG] pgmap v11290: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:53:37.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:53:37 smithi086 bash[24289]: audit 2024-09-16T11:53:36.091524+0000 mon.b (mon.2) 1479 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T11:53:37.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:53:37 smithi086 bash[24289]: audit 2024-09-16T11:53:36.107858+0000 mon.b (mon.2) 1480 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T11:53:37.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:53:37 smithi086 bash[24289]: audit 2024-09-16T11:53:36.117338+0000 mon.a (mon.0) 1543 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:53:37.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:53:37 smithi086 bash[24289]: audit 2024-09-16T11:53:36.121914+0000 mon.b (mon.2) 1481 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:53:37.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:53:37 smithi086 bash[24289]: audit 2024-09-16T11:53:36.123312+0000 mgr.a (mgr.14373) 16277 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:53:37.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:53:37 smithi086 bash[24289]: audit 2024-09-16T11:53:36.144430+0000 mgr.a (mgr.14373) 16278 : audit [DBG] from='client.350799 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:53:37.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:53:37 smithi047 bash[22744]: cluster 2024-09-16T11:53:35.902068+0000 mgr.a (mgr.14373) 16276 : cluster [DBG] pgmap v11290: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:53:37.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:53:37 smithi047 bash[22744]: audit 2024-09-16T11:53:36.091524+0000 mon.b (mon.2) 1479 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T11:53:37.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:53:37 smithi047 bash[22744]: audit 2024-09-16T11:53:36.107858+0000 mon.b (mon.2) 1480 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T11:53:37.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:53:37 smithi047 bash[22744]: audit 2024-09-16T11:53:36.117338+0000 mon.a (mon.0) 1543 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:53:37.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:53:37 smithi047 bash[22744]: audit 2024-09-16T11:53:36.121914+0000 mon.b (mon.2) 1481 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:53:37.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:53:37 smithi047 bash[22744]: audit 2024-09-16T11:53:36.123312+0000 mgr.a (mgr.14373) 16277 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:53:37.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:53:37 smithi047 bash[22744]: audit 2024-09-16T11:53:36.144430+0000 mgr.a (mgr.14373) 16278 : audit [DBG] from='client.350799 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:53:38.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:53:38 smithi157 bash[24585]: audit 2024-09-16T11:53:36.858420+0000 mgr.a (mgr.14373) 16279 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T11:53:38.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:53:38 smithi157 bash[24585]: cephadm 2024-09-16T11:53:36.873334+0000 mgr.a (mgr.14373) 16280 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T11:53:38.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:53:38 smithi086 bash[24289]: audit 2024-09-16T11:53:36.858420+0000 mgr.a (mgr.14373) 16279 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T11:53:38.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:53:38 smithi086 bash[24289]: cephadm 2024-09-16T11:53:36.873334+0000 mgr.a (mgr.14373) 16280 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T11:53:38.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:53:38 smithi047 bash[22744]: audit 2024-09-16T11:53:36.858420+0000 mgr.a (mgr.14373) 16279 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T11:53:38.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:53:38 smithi047 bash[22744]: cephadm 2024-09-16T11:53:36.873334+0000 mgr.a (mgr.14373) 16280 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T11:53:39.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:53:39 smithi157 bash[24585]: cluster 2024-09-16T11:53:37.904816+0000 mgr.a (mgr.14373) 16281 : cluster [DBG] pgmap v11291: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.9 KiB/s rd, 85 B/s wr, 2 op/s 2024-09-16T11:53:39.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:53:39 smithi086 bash[24289]: cluster 2024-09-16T11:53:37.904816+0000 mgr.a (mgr.14373) 16281 : cluster [DBG] pgmap v11291: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.9 KiB/s rd, 85 B/s wr, 2 op/s 2024-09-16T11:53:39.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:53:39 smithi047 bash[22744]: cluster 2024-09-16T11:53:37.904816+0000 mgr.a (mgr.14373) 16281 : cluster [DBG] pgmap v11291: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.9 KiB/s rd, 85 B/s wr, 2 op/s 2024-09-16T11:53:41.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:53:41 smithi157 bash[24585]: cluster 2024-09-16T11:53:39.905604+0000 mgr.a (mgr.14373) 16282 : cluster [DBG] pgmap v11292: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 85 B/s wr, 2 op/s 2024-09-16T11:53:41.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:53:41 smithi086 bash[24289]: cluster 2024-09-16T11:53:39.905604+0000 mgr.a (mgr.14373) 16282 : cluster [DBG] pgmap v11292: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 85 B/s wr, 2 op/s 2024-09-16T11:53:41.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:53:41 smithi047 bash[22744]: cluster 2024-09-16T11:53:39.905604+0000 mgr.a (mgr.14373) 16282 : cluster [DBG] pgmap v11292: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 85 B/s wr, 2 op/s 2024-09-16T11:53:42.285 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:53:42.286 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:53:42.286 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:53:43.032 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:53:43.032 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:53:43.032 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:53:43.033 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:53:43.033 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:53:43.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:53:43 smithi157 bash[24585]: cluster 2024-09-16T11:53:41.907663+0000 mgr.a (mgr.14373) 16283 : cluster [DBG] pgmap v11293: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:53:43.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:53:43 smithi086 bash[24289]: cluster 2024-09-16T11:53:41.907663+0000 mgr.a (mgr.14373) 16283 : cluster [DBG] pgmap v11293: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:53:43.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:53:43 smithi047 bash[22744]: cluster 2024-09-16T11:53:41.907663+0000 mgr.a (mgr.14373) 16283 : cluster [DBG] pgmap v11293: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:53:44.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:53:44 smithi157 bash[24585]: audit 2024-09-16T11:53:42.607424+0000 mgr.a (mgr.14373) 16284 : audit [DBG] from='client.350979 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:53:44.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:53:44 smithi086 bash[24289]: audit 2024-09-16T11:53:42.607424+0000 mgr.a (mgr.14373) 16284 : audit [DBG] from='client.350979 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:53:44.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:53:44 smithi047 bash[22744]: audit 2024-09-16T11:53:42.607424+0000 mgr.a (mgr.14373) 16284 : audit [DBG] from='client.350979 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:53:45.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:53:45 smithi157 bash[24585]: cluster 2024-09-16T11:53:43.908695+0000 mgr.a (mgr.14373) 16285 : cluster [DBG] pgmap v11294: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T11:53:45.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:53:45 smithi086 bash[24289]: cluster 2024-09-16T11:53:43.908695+0000 mgr.a (mgr.14373) 16285 : cluster [DBG] pgmap v11294: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T11:53:45.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:53:45 smithi047 bash[22744]: cluster 2024-09-16T11:53:43.908695+0000 mgr.a (mgr.14373) 16285 : cluster [DBG] pgmap v11294: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T11:53:47.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:53:47 smithi157 bash[24585]: cluster 2024-09-16T11:53:45.909666+0000 mgr.a (mgr.14373) 16286 : cluster [DBG] pgmap v11295: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T11:53:47.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:53:47 smithi086 bash[24289]: cluster 2024-09-16T11:53:45.909666+0000 mgr.a (mgr.14373) 16286 : cluster [DBG] pgmap v11295: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T11:53:47.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:53:47 smithi047 bash[22744]: cluster 2024-09-16T11:53:45.909666+0000 mgr.a (mgr.14373) 16286 : cluster [DBG] pgmap v11295: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T11:53:48.034 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:53:48.034 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:53:48.035 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:53:48.811 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:53:48.811 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:53:48.811 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:53:48.812 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:53:48.812 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:53:49.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:53:49 smithi157 bash[24585]: cluster 2024-09-16T11:53:47.912053+0000 mgr.a (mgr.14373) 16287 : cluster [DBG] pgmap v11296: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:53:49.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:53:49 smithi157 bash[24585]: audit 2024-09-16T11:53:48.364654+0000 mgr.a (mgr.14373) 16288 : audit [DBG] from='client.351057 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:53:49.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:53:49 smithi086 bash[24289]: cluster 2024-09-16T11:53:47.912053+0000 mgr.a (mgr.14373) 16287 : cluster [DBG] pgmap v11296: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:53:49.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:53:49 smithi086 bash[24289]: audit 2024-09-16T11:53:48.364654+0000 mgr.a (mgr.14373) 16288 : audit [DBG] from='client.351057 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:53:49.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:53:49 smithi047 bash[22744]: cluster 2024-09-16T11:53:47.912053+0000 mgr.a (mgr.14373) 16287 : cluster [DBG] pgmap v11296: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:53:49.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:53:49 smithi047 bash[22744]: audit 2024-09-16T11:53:48.364654+0000 mgr.a (mgr.14373) 16288 : audit [DBG] from='client.351057 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:53:51.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:53:51 smithi157 bash[24585]: cluster 2024-09-16T11:53:49.912956+0000 mgr.a (mgr.14373) 16289 : cluster [DBG] pgmap v11297: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 5.9 KiB/s rd, 341 B/s wr, 5 op/s 2024-09-16T11:53:51.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:53:51 smithi086 bash[24289]: cluster 2024-09-16T11:53:49.912956+0000 mgr.a (mgr.14373) 16289 : cluster [DBG] pgmap v11297: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 5.9 KiB/s rd, 341 B/s wr, 5 op/s 2024-09-16T11:53:51.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:53:51 smithi047 bash[22744]: cluster 2024-09-16T11:53:49.912956+0000 mgr.a (mgr.14373) 16289 : cluster [DBG] pgmap v11297: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 5.9 KiB/s rd, 341 B/s wr, 5 op/s 2024-09-16T11:53:53.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:53:53 smithi157 bash[24585]: cluster 2024-09-16T11:53:51.915132+0000 mgr.a (mgr.14373) 16290 : cluster [DBG] pgmap v11298: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 6.8 KiB/s rd, 341 B/s wr, 6 op/s 2024-09-16T11:53:53.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:53:53 smithi086 bash[24289]: cluster 2024-09-16T11:53:51.915132+0000 mgr.a (mgr.14373) 16290 : cluster [DBG] pgmap v11298: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 6.8 KiB/s rd, 341 B/s wr, 6 op/s 2024-09-16T11:53:53.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:53:53 smithi047 bash[22744]: cluster 2024-09-16T11:53:51.915132+0000 mgr.a (mgr.14373) 16290 : cluster [DBG] pgmap v11298: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 6.8 KiB/s rd, 341 B/s wr, 6 op/s 2024-09-16T11:53:53.812 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:53:53.813 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:53:53.813 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:53:54.566 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:53:54.566 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:53:54.566 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:53:54.567 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:53:54.567 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:53:55.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:53:55 smithi157 bash[24585]: cluster 2024-09-16T11:53:53.915587+0000 mgr.a (mgr.14373) 16291 : cluster [DBG] pgmap v11299: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:53:55.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:53:55 smithi157 bash[24585]: audit 2024-09-16T11:53:54.145521+0000 mgr.a (mgr.14373) 16292 : audit [DBG] from='client.351129 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:53:55.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:53:55 smithi086 bash[24289]: cluster 2024-09-16T11:53:53.915587+0000 mgr.a (mgr.14373) 16291 : cluster [DBG] pgmap v11299: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:53:55.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:53:55 smithi086 bash[24289]: audit 2024-09-16T11:53:54.145521+0000 mgr.a (mgr.14373) 16292 : audit [DBG] from='client.351129 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:53:55.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:53:55 smithi047 bash[22744]: cluster 2024-09-16T11:53:53.915587+0000 mgr.a (mgr.14373) 16291 : cluster [DBG] pgmap v11299: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:53:55.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:53:55 smithi047 bash[22744]: audit 2024-09-16T11:53:54.145521+0000 mgr.a (mgr.14373) 16292 : audit [DBG] from='client.351129 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:53:57.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:53:57 smithi157 bash[24585]: cluster 2024-09-16T11:53:55.916430+0000 mgr.a (mgr.14373) 16293 : cluster [DBG] pgmap v11300: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:53:57.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:53:57 smithi086 bash[24289]: cluster 2024-09-16T11:53:55.916430+0000 mgr.a (mgr.14373) 16293 : cluster [DBG] pgmap v11300: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:53:57.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:53:57 smithi047 bash[22744]: cluster 2024-09-16T11:53:55.916430+0000 mgr.a (mgr.14373) 16293 : cluster [DBG] pgmap v11300: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:53:59.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:53:59 smithi157 bash[24585]: cluster 2024-09-16T11:53:57.918795+0000 mgr.a (mgr.14373) 16294 : cluster [DBG] pgmap v11301: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:53:59.567 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:53:59.568 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:53:59.568 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:53:59.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:53:59 smithi086 bash[24289]: cluster 2024-09-16T11:53:57.918795+0000 mgr.a (mgr.14373) 16294 : cluster [DBG] pgmap v11301: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:53:59.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:53:59 smithi047 bash[22744]: cluster 2024-09-16T11:53:57.918795+0000 mgr.a (mgr.14373) 16294 : cluster [DBG] pgmap v11301: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:54:00.310 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:54:00.311 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:54:00.311 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:54:00.311 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:54:00.311 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:54:01.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:54:01 smithi157 bash[24585]: audit 2024-09-16T11:53:59.895369+0000 mgr.a (mgr.14373) 16295 : audit [DBG] from='client.351207 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:54:01.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:54:01 smithi157 bash[24585]: cluster 2024-09-16T11:53:59.919540+0000 mgr.a (mgr.14373) 16296 : cluster [DBG] pgmap v11302: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:54:01.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:54:01 smithi086 bash[24289]: audit 2024-09-16T11:53:59.895369+0000 mgr.a (mgr.14373) 16295 : audit [DBG] from='client.351207 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:54:01.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:54:01 smithi086 bash[24289]: cluster 2024-09-16T11:53:59.919540+0000 mgr.a (mgr.14373) 16296 : cluster [DBG] pgmap v11302: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:54:01.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:54:01 smithi047 bash[22744]: audit 2024-09-16T11:53:59.895369+0000 mgr.a (mgr.14373) 16295 : audit [DBG] from='client.351207 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:54:01.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:54:01 smithi047 bash[22744]: cluster 2024-09-16T11:53:59.919540+0000 mgr.a (mgr.14373) 16296 : cluster [DBG] pgmap v11302: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:54:03.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:54:03 smithi157 bash[24585]: cluster 2024-09-16T11:54:01.921849+0000 mgr.a (mgr.14373) 16297 : cluster [DBG] pgmap v11303: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:54:03.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:54:03 smithi086 bash[24289]: cluster 2024-09-16T11:54:01.921849+0000 mgr.a (mgr.14373) 16297 : cluster [DBG] pgmap v11303: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:54:03.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:54:03 smithi047 bash[22744]: cluster 2024-09-16T11:54:01.921849+0000 mgr.a (mgr.14373) 16297 : cluster [DBG] pgmap v11303: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:54:05.312 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:54:05.313 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:54:05.313 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:54:05.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:54:05 smithi157 bash[24585]: cluster 2024-09-16T11:54:03.922657+0000 mgr.a (mgr.14373) 16298 : cluster [DBG] pgmap v11304: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:54:05.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:54:05 smithi086 bash[24289]: cluster 2024-09-16T11:54:03.922657+0000 mgr.a (mgr.14373) 16298 : cluster [DBG] pgmap v11304: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:54:05.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:54:05 smithi047 bash[22744]: cluster 2024-09-16T11:54:03.922657+0000 mgr.a (mgr.14373) 16298 : cluster [DBG] pgmap v11304: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:54:06.103 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:54:06.103 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:54:06.103 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:54:06.104 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:54:06.104 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:54:07.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:54:07 smithi157 bash[24585]: audit 2024-09-16T11:54:05.649054+0000 mgr.a (mgr.14373) 16299 : audit [DBG] from='client.351285 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:54:07.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:54:07 smithi157 bash[24585]: cluster 2024-09-16T11:54:05.923189+0000 mgr.a (mgr.14373) 16300 : cluster [DBG] pgmap v11305: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:54:07.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:54:07 smithi086 bash[24289]: audit 2024-09-16T11:54:05.649054+0000 mgr.a (mgr.14373) 16299 : audit [DBG] from='client.351285 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:54:07.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:54:07 smithi086 bash[24289]: cluster 2024-09-16T11:54:05.923189+0000 mgr.a (mgr.14373) 16300 : cluster [DBG] pgmap v11305: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:54:07.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:54:07 smithi047 bash[22744]: audit 2024-09-16T11:54:05.649054+0000 mgr.a (mgr.14373) 16299 : audit [DBG] from='client.351285 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:54:07.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:54:07 smithi047 bash[22744]: cluster 2024-09-16T11:54:05.923189+0000 mgr.a (mgr.14373) 16300 : cluster [DBG] pgmap v11305: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:54:09.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:54:09 smithi157 bash[24585]: cluster 2024-09-16T11:54:07.925732+0000 mgr.a (mgr.14373) 16301 : cluster [DBG] pgmap v11306: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:54:09.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:54:09 smithi086 bash[24289]: cluster 2024-09-16T11:54:07.925732+0000 mgr.a (mgr.14373) 16301 : cluster [DBG] pgmap v11306: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:54:09.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:54:09 smithi047 bash[22744]: cluster 2024-09-16T11:54:07.925732+0000 mgr.a (mgr.14373) 16301 : cluster [DBG] pgmap v11306: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:54:11.105 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:54:11.106 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:54:11.106 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:54:11.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:54:11 smithi157 bash[24585]: cluster 2024-09-16T11:54:09.926580+0000 mgr.a (mgr.14373) 16302 : cluster [DBG] pgmap v11307: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:54:11.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:54:11 smithi086 bash[24289]: cluster 2024-09-16T11:54:09.926580+0000 mgr.a (mgr.14373) 16302 : cluster [DBG] pgmap v11307: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:54:11.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:54:11 smithi047 bash[22744]: cluster 2024-09-16T11:54:09.926580+0000 mgr.a (mgr.14373) 16302 : cluster [DBG] pgmap v11307: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:54:11.883 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:54:11.883 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:54:11.884 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:54:11.884 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:54:11.884 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:54:12.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:54:12 smithi157 bash[24585]: audit 2024-09-16T11:54:11.439171+0000 mgr.a (mgr.14373) 16303 : audit [DBG] from='client.351363 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:54:12.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:54:12 smithi086 bash[24289]: audit 2024-09-16T11:54:11.439171+0000 mgr.a (mgr.14373) 16303 : audit [DBG] from='client.351363 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:54:12.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:54:12 smithi047 bash[22744]: audit 2024-09-16T11:54:11.439171+0000 mgr.a (mgr.14373) 16303 : audit [DBG] from='client.351363 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:54:13.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:54:13 smithi157 bash[24585]: cluster 2024-09-16T11:54:11.927839+0000 mgr.a (mgr.14373) 16304 : cluster [DBG] pgmap v11308: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:54:13.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:54:13 smithi086 bash[24289]: cluster 2024-09-16T11:54:11.927839+0000 mgr.a (mgr.14373) 16304 : cluster [DBG] pgmap v11308: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:54:13.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:54:13 smithi047 bash[22744]: cluster 2024-09-16T11:54:11.927839+0000 mgr.a (mgr.14373) 16304 : cluster [DBG] pgmap v11308: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:54:15.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:54:15 smithi157 bash[24585]: cluster 2024-09-16T11:54:13.928580+0000 mgr.a (mgr.14373) 16305 : cluster [DBG] pgmap v11309: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T11:54:15.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:54:15 smithi086 bash[24289]: cluster 2024-09-16T11:54:13.928580+0000 mgr.a (mgr.14373) 16305 : cluster [DBG] pgmap v11309: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T11:54:15.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:54:15 smithi047 bash[22744]: cluster 2024-09-16T11:54:13.928580+0000 mgr.a (mgr.14373) 16305 : cluster [DBG] pgmap v11309: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T11:54:16.885 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:54:16.886 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:54:16.886 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:54:17.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:54:17 smithi157 bash[24585]: cluster 2024-09-16T11:54:15.929359+0000 mgr.a (mgr.14373) 16306 : cluster [DBG] pgmap v11310: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T11:54:17.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:54:17 smithi086 bash[24289]: cluster 2024-09-16T11:54:15.929359+0000 mgr.a (mgr.14373) 16306 : cluster [DBG] pgmap v11310: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T11:54:17.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:54:17 smithi047 bash[22744]: cluster 2024-09-16T11:54:15.929359+0000 mgr.a (mgr.14373) 16306 : cluster [DBG] pgmap v11310: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T11:54:17.641 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:54:17.641 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:54:17.641 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:54:17.641 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:54:17.642 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:54:18.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:54:18 smithi157 bash[24585]: audit 2024-09-16T11:54:17.219220+0000 mgr.a (mgr.14373) 16307 : audit [DBG] from='client.351441 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:54:18.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:54:18 smithi086 bash[24289]: audit 2024-09-16T11:54:17.219220+0000 mgr.a (mgr.14373) 16307 : audit [DBG] from='client.351441 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:54:18.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:54:18 smithi047 bash[22744]: audit 2024-09-16T11:54:17.219220+0000 mgr.a (mgr.14373) 16307 : audit [DBG] from='client.351441 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:54:19.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:54:19 smithi157 bash[24585]: cluster 2024-09-16T11:54:17.932163+0000 mgr.a (mgr.14373) 16308 : cluster [DBG] pgmap v11311: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:54:19.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:54:19 smithi086 bash[24289]: cluster 2024-09-16T11:54:17.932163+0000 mgr.a (mgr.14373) 16308 : cluster [DBG] pgmap v11311: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:54:19.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:54:19 smithi047 bash[22744]: cluster 2024-09-16T11:54:17.932163+0000 mgr.a (mgr.14373) 16308 : cluster [DBG] pgmap v11311: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:54:21.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:54:21 smithi157 bash[24585]: cluster 2024-09-16T11:54:19.933011+0000 mgr.a (mgr.14373) 16309 : cluster [DBG] pgmap v11312: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:54:21.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:54:21 smithi086 bash[24289]: cluster 2024-09-16T11:54:19.933011+0000 mgr.a (mgr.14373) 16309 : cluster [DBG] pgmap v11312: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:54:21.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:54:21 smithi047 bash[22744]: cluster 2024-09-16T11:54:19.933011+0000 mgr.a (mgr.14373) 16309 : cluster [DBG] pgmap v11312: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:54:22.643 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:54:22.643 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:54:22.644 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:54:23.394 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:54:23.394 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:54:23.395 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:54:23.395 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:54:23.395 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:54:23.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:54:23 smithi157 bash[24585]: cluster 2024-09-16T11:54:21.934955+0000 mgr.a (mgr.14373) 16310 : cluster [DBG] pgmap v11313: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:54:23.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:54:23 smithi086 bash[24289]: cluster 2024-09-16T11:54:21.934955+0000 mgr.a (mgr.14373) 16310 : cluster [DBG] pgmap v11313: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:54:23.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:54:23 smithi047 bash[22744]: cluster 2024-09-16T11:54:21.934955+0000 mgr.a (mgr.14373) 16310 : cluster [DBG] pgmap v11313: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:54:24.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:54:24 smithi157 bash[24585]: audit 2024-09-16T11:54:22.971875+0000 mgr.a (mgr.14373) 16311 : audit [DBG] from='client.351516 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:54:24.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:54:24 smithi086 bash[24289]: audit 2024-09-16T11:54:22.971875+0000 mgr.a (mgr.14373) 16311 : audit [DBG] from='client.351516 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:54:24.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:54:24 smithi047 bash[22744]: audit 2024-09-16T11:54:22.971875+0000 mgr.a (mgr.14373) 16311 : audit [DBG] from='client.351516 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:54:25.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:54:25 smithi157 bash[24585]: cluster 2024-09-16T11:54:23.935938+0000 mgr.a (mgr.14373) 16312 : cluster [DBG] pgmap v11314: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:54:25.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:54:25 smithi086 bash[24289]: cluster 2024-09-16T11:54:23.935938+0000 mgr.a (mgr.14373) 16312 : cluster [DBG] pgmap v11314: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:54:25.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:54:25 smithi047 bash[22744]: cluster 2024-09-16T11:54:23.935938+0000 mgr.a (mgr.14373) 16312 : cluster [DBG] pgmap v11314: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:54:27.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:54:27 smithi157 bash[24585]: cluster 2024-09-16T11:54:25.936764+0000 mgr.a (mgr.14373) 16313 : cluster [DBG] pgmap v11315: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:54:27.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:54:27 smithi086 bash[24289]: cluster 2024-09-16T11:54:25.936764+0000 mgr.a (mgr.14373) 16313 : cluster [DBG] pgmap v11315: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:54:27.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:54:27 smithi047 bash[22744]: cluster 2024-09-16T11:54:25.936764+0000 mgr.a (mgr.14373) 16313 : cluster [DBG] pgmap v11315: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:54:28.396 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:54:28.397 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:54:28.397 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:54:29.174 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:54:29.175 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:54:29.175 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:54:29.175 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:54:29.175 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:54:29.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:54:29 smithi157 bash[24585]: cluster 2024-09-16T11:54:27.939055+0000 mgr.a (mgr.14373) 16314 : cluster [DBG] pgmap v11316: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:54:29.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:54:29 smithi086 bash[24289]: cluster 2024-09-16T11:54:27.939055+0000 mgr.a (mgr.14373) 16314 : cluster [DBG] pgmap v11316: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:54:29.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:54:29 smithi047 bash[22744]: cluster 2024-09-16T11:54:27.939055+0000 mgr.a (mgr.14373) 16314 : cluster [DBG] pgmap v11316: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:54:30.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:54:30 smithi157 bash[24585]: audit 2024-09-16T11:54:28.734038+0000 mgr.a (mgr.14373) 16315 : audit [DBG] from='client.351594 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:54:30.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:54:30 smithi086 bash[24289]: audit 2024-09-16T11:54:28.734038+0000 mgr.a (mgr.14373) 16315 : audit [DBG] from='client.351594 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:54:30.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:54:30 smithi047 bash[22744]: audit 2024-09-16T11:54:28.734038+0000 mgr.a (mgr.14373) 16315 : audit [DBG] from='client.351594 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:54:31.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:54:31 smithi157 bash[24585]: cluster 2024-09-16T11:54:29.940057+0000 mgr.a (mgr.14373) 16316 : cluster [DBG] pgmap v11317: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:54:31.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:54:31 smithi086 bash[24289]: cluster 2024-09-16T11:54:29.940057+0000 mgr.a (mgr.14373) 16316 : cluster [DBG] pgmap v11317: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:54:31.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:54:31 smithi047 bash[22744]: cluster 2024-09-16T11:54:29.940057+0000 mgr.a (mgr.14373) 16316 : cluster [DBG] pgmap v11317: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:54:33.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:54:33 smithi157 bash[24585]: cluster 2024-09-16T11:54:31.942246+0000 mgr.a (mgr.14373) 16317 : cluster [DBG] pgmap v11318: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:54:33.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:54:33 smithi086 bash[24289]: cluster 2024-09-16T11:54:31.942246+0000 mgr.a (mgr.14373) 16317 : cluster [DBG] pgmap v11318: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:54:33.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:54:33 smithi047 bash[22744]: cluster 2024-09-16T11:54:31.942246+0000 mgr.a (mgr.14373) 16317 : cluster [DBG] pgmap v11318: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:54:34.176 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:54:34.177 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:54:34.179 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:54:34.954 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:54:34.954 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:54:34.954 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:54:34.954 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:54:34.954 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:54:35.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:54:35 smithi157 bash[24585]: cluster 2024-09-16T11:54:33.943051+0000 mgr.a (mgr.14373) 16318 : cluster [DBG] pgmap v11319: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:54:35.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:54:35 smithi157 bash[24585]: audit 2024-09-16T11:54:34.508760+0000 mgr.a (mgr.14373) 16319 : audit [DBG] from='client.351672 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:54:35.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:54:35 smithi086 bash[24289]: cluster 2024-09-16T11:54:33.943051+0000 mgr.a (mgr.14373) 16318 : cluster [DBG] pgmap v11319: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:54:35.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:54:35 smithi086 bash[24289]: audit 2024-09-16T11:54:34.508760+0000 mgr.a (mgr.14373) 16319 : audit [DBG] from='client.351672 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:54:35.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:54:35 smithi047 bash[22744]: cluster 2024-09-16T11:54:33.943051+0000 mgr.a (mgr.14373) 16318 : cluster [DBG] pgmap v11319: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:54:35.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:54:35 smithi047 bash[22744]: audit 2024-09-16T11:54:34.508760+0000 mgr.a (mgr.14373) 16319 : audit [DBG] from='client.351672 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:54:37.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:54:37 smithi157 bash[24585]: cluster 2024-09-16T11:54:35.944036+0000 mgr.a (mgr.14373) 16320 : cluster [DBG] pgmap v11320: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:54:37.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:54:37 smithi157 bash[24585]: audit 2024-09-16T11:54:36.936095+0000 mon.b (mon.2) 1482 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T11:54:37.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:54:37 smithi086 bash[24289]: cluster 2024-09-16T11:54:35.944036+0000 mgr.a (mgr.14373) 16320 : cluster [DBG] pgmap v11320: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:54:37.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:54:37 smithi086 bash[24289]: audit 2024-09-16T11:54:36.936095+0000 mon.b (mon.2) 1482 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T11:54:37.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:54:37 smithi047 bash[22744]: cluster 2024-09-16T11:54:35.944036+0000 mgr.a (mgr.14373) 16320 : cluster [DBG] pgmap v11320: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:54:37.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:54:37 smithi047 bash[22744]: audit 2024-09-16T11:54:36.936095+0000 mon.b (mon.2) 1482 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T11:54:38.556 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:54:38 smithi047 bash[22744]: audit 2024-09-16T11:54:37.787654+0000 mon.b (mon.2) 1483 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T11:54:38.556 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:54:38 smithi047 bash[22744]: audit 2024-09-16T11:54:37.789665+0000 mon.b (mon.2) 1484 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T11:54:38.556 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:54:38 smithi047 bash[22744]: audit 2024-09-16T11:54:37.799984+0000 mon.a (mon.0) 1544 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:54:38.556 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:54:38 smithi047 bash[22744]: audit 2024-09-16T11:54:37.807591+0000 mon.b (mon.2) 1485 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:54:38.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:54:38 smithi157 bash[24585]: audit 2024-09-16T11:54:37.787654+0000 mon.b (mon.2) 1483 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T11:54:38.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:54:38 smithi157 bash[24585]: audit 2024-09-16T11:54:37.789665+0000 mon.b (mon.2) 1484 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T11:54:38.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:54:38 smithi157 bash[24585]: audit 2024-09-16T11:54:37.799984+0000 mon.a (mon.0) 1544 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:54:38.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:54:38 smithi157 bash[24585]: audit 2024-09-16T11:54:37.807591+0000 mon.b (mon.2) 1485 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:54:38.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:54:38 smithi086 bash[24289]: audit 2024-09-16T11:54:37.787654+0000 mon.b (mon.2) 1483 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T11:54:38.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:54:38 smithi086 bash[24289]: audit 2024-09-16T11:54:37.789665+0000 mon.b (mon.2) 1484 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T11:54:38.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:54:38 smithi086 bash[24289]: audit 2024-09-16T11:54:37.799984+0000 mon.a (mon.0) 1544 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:54:38.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:54:38 smithi086 bash[24289]: audit 2024-09-16T11:54:37.807591+0000 mon.b (mon.2) 1485 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:54:38.843 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 11:54:38 smithi047 bash[22994]: debug 2024-09-16T11:54:38.552+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T11:54:38.843 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 11:54:38 smithi047 bash[22994]: debug 2024-09-16T11:54:38.552+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T11:54:39.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:54:39 smithi157 bash[24585]: audit 2024-09-16T11:54:37.810176+0000 mgr.a (mgr.14373) 16321 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:54:39.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:54:39 smithi157 bash[24585]: cluster 2024-09-16T11:54:37.945460+0000 mgr.a (mgr.14373) 16322 : cluster [DBG] pgmap v11321: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:54:39.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:54:39 smithi157 bash[24585]: audit 2024-09-16T11:54:38.554890+0000 mgr.a (mgr.14373) 16323 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T11:54:39.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:54:39 smithi157 bash[24585]: cephadm 2024-09-16T11:54:38.557337+0000 mgr.a (mgr.14373) 16324 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T11:54:39.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:54:39 smithi086 bash[24289]: audit 2024-09-16T11:54:37.810176+0000 mgr.a (mgr.14373) 16321 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:54:39.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:54:39 smithi086 bash[24289]: cluster 2024-09-16T11:54:37.945460+0000 mgr.a (mgr.14373) 16322 : cluster [DBG] pgmap v11321: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:54:39.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:54:39 smithi086 bash[24289]: audit 2024-09-16T11:54:38.554890+0000 mgr.a (mgr.14373) 16323 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T11:54:39.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:54:39 smithi086 bash[24289]: cephadm 2024-09-16T11:54:38.557337+0000 mgr.a (mgr.14373) 16324 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T11:54:39.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:54:39 smithi047 bash[22744]: audit 2024-09-16T11:54:37.810176+0000 mgr.a (mgr.14373) 16321 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:54:39.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:54:39 smithi047 bash[22744]: cluster 2024-09-16T11:54:37.945460+0000 mgr.a (mgr.14373) 16322 : cluster [DBG] pgmap v11321: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:54:39.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:54:39 smithi047 bash[22744]: audit 2024-09-16T11:54:38.554890+0000 mgr.a (mgr.14373) 16323 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T11:54:39.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:54:39 smithi047 bash[22744]: cephadm 2024-09-16T11:54:38.557337+0000 mgr.a (mgr.14373) 16324 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T11:54:39.956 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:54:39.956 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:54:39.957 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:54:40.705 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:54:40.705 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:54:40.705 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:54:40.705 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:54:40.706 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:54:41.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:54:41 smithi157 bash[24585]: cluster 2024-09-16T11:54:39.946430+0000 mgr.a (mgr.14373) 16325 : cluster [DBG] pgmap v11322: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:54:41.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:54:41 smithi157 bash[24585]: audit 2024-09-16T11:54:40.283115+0000 mgr.a (mgr.14373) 16326 : audit [DBG] from='client.351855 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:54:41.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:54:41 smithi086 bash[24289]: cluster 2024-09-16T11:54:39.946430+0000 mgr.a (mgr.14373) 16325 : cluster [DBG] pgmap v11322: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:54:41.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:54:41 smithi086 bash[24289]: audit 2024-09-16T11:54:40.283115+0000 mgr.a (mgr.14373) 16326 : audit [DBG] from='client.351855 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:54:41.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:54:41 smithi047 bash[22744]: cluster 2024-09-16T11:54:39.946430+0000 mgr.a (mgr.14373) 16325 : cluster [DBG] pgmap v11322: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:54:41.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:54:41 smithi047 bash[22744]: audit 2024-09-16T11:54:40.283115+0000 mgr.a (mgr.14373) 16326 : audit [DBG] from='client.351855 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:54:43.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:54:43 smithi157 bash[24585]: cluster 2024-09-16T11:54:41.948728+0000 mgr.a (mgr.14373) 16327 : cluster [DBG] pgmap v11323: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:54:43.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:54:43 smithi086 bash[24289]: cluster 2024-09-16T11:54:41.948728+0000 mgr.a (mgr.14373) 16327 : cluster [DBG] pgmap v11323: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:54:43.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:54:43 smithi047 bash[22744]: cluster 2024-09-16T11:54:41.948728+0000 mgr.a (mgr.14373) 16327 : cluster [DBG] pgmap v11323: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:54:45.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:54:45 smithi157 bash[24585]: cluster 2024-09-16T11:54:43.949516+0000 mgr.a (mgr.14373) 16328 : cluster [DBG] pgmap v11324: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:54:45.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:54:45 smithi086 bash[24289]: cluster 2024-09-16T11:54:43.949516+0000 mgr.a (mgr.14373) 16328 : cluster [DBG] pgmap v11324: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:54:45.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:54:45 smithi047 bash[22744]: cluster 2024-09-16T11:54:43.949516+0000 mgr.a (mgr.14373) 16328 : cluster [DBG] pgmap v11324: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:54:45.706 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:54:45.707 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:54:45.707 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:54:46.466 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:54:46.466 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:54:46.466 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:54:46.466 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:54:46.466 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:54:47.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:54:47 smithi157 bash[24585]: cluster 2024-09-16T11:54:45.950250+0000 mgr.a (mgr.14373) 16329 : cluster [DBG] pgmap v11325: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:54:47.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:54:47 smithi157 bash[24585]: audit 2024-09-16T11:54:46.036163+0000 mgr.a (mgr.14373) 16330 : audit [DBG] from='client.351933 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:54:47.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:54:47 smithi086 bash[24289]: cluster 2024-09-16T11:54:45.950250+0000 mgr.a (mgr.14373) 16329 : cluster [DBG] pgmap v11325: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:54:47.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:54:47 smithi086 bash[24289]: audit 2024-09-16T11:54:46.036163+0000 mgr.a (mgr.14373) 16330 : audit [DBG] from='client.351933 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:54:47.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:54:47 smithi047 bash[22744]: cluster 2024-09-16T11:54:45.950250+0000 mgr.a (mgr.14373) 16329 : cluster [DBG] pgmap v11325: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:54:47.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:54:47 smithi047 bash[22744]: audit 2024-09-16T11:54:46.036163+0000 mgr.a (mgr.14373) 16330 : audit [DBG] from='client.351933 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:54:49.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:54:49 smithi157 bash[24585]: cluster 2024-09-16T11:54:47.952664+0000 mgr.a (mgr.14373) 16331 : cluster [DBG] pgmap v11326: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:54:49.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:54:49 smithi086 bash[24289]: cluster 2024-09-16T11:54:47.952664+0000 mgr.a (mgr.14373) 16331 : cluster [DBG] pgmap v11326: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:54:49.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:54:49 smithi047 bash[22744]: cluster 2024-09-16T11:54:47.952664+0000 mgr.a (mgr.14373) 16331 : cluster [DBG] pgmap v11326: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:54:51.467 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:54:51.468 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:54:51.468 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:54:51.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:54:51 smithi157 bash[24585]: cluster 2024-09-16T11:54:49.953457+0000 mgr.a (mgr.14373) 16332 : cluster [DBG] pgmap v11327: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T11:54:51.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:54:51 smithi086 bash[24289]: cluster 2024-09-16T11:54:49.953457+0000 mgr.a (mgr.14373) 16332 : cluster [DBG] pgmap v11327: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T11:54:51.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:54:51 smithi047 bash[22744]: cluster 2024-09-16T11:54:49.953457+0000 mgr.a (mgr.14373) 16332 : cluster [DBG] pgmap v11327: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T11:54:52.233 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:54:52.233 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:54:52.234 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:54:52.234 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:54:52.234 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:54:53.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:54:53 smithi086 bash[24289]: audit 2024-09-16T11:54:51.800274+0000 mgr.a (mgr.14373) 16333 : audit [DBG] from='client.352011 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:54:53.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:54:53 smithi086 bash[24289]: cluster 2024-09-16T11:54:51.954819+0000 mgr.a (mgr.14373) 16334 : cluster [DBG] pgmap v11328: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:54:53.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:54:53 smithi047 bash[22744]: audit 2024-09-16T11:54:51.800274+0000 mgr.a (mgr.14373) 16333 : audit [DBG] from='client.352011 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:54:53.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:54:53 smithi047 bash[22744]: cluster 2024-09-16T11:54:51.954819+0000 mgr.a (mgr.14373) 16334 : cluster [DBG] pgmap v11328: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:54:53.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:54:53 smithi157 bash[24585]: audit 2024-09-16T11:54:51.800274+0000 mgr.a (mgr.14373) 16333 : audit [DBG] from='client.352011 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:54:53.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:54:53 smithi157 bash[24585]: cluster 2024-09-16T11:54:51.954819+0000 mgr.a (mgr.14373) 16334 : cluster [DBG] pgmap v11328: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:54:55.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:54:55 smithi086 bash[24289]: cluster 2024-09-16T11:54:53.955688+0000 mgr.a (mgr.14373) 16335 : cluster [DBG] pgmap v11329: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T11:54:55.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:54:55 smithi047 bash[22744]: cluster 2024-09-16T11:54:53.955688+0000 mgr.a (mgr.14373) 16335 : cluster [DBG] pgmap v11329: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T11:54:55.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:54:55 smithi157 bash[24585]: cluster 2024-09-16T11:54:53.955688+0000 mgr.a (mgr.14373) 16335 : cluster [DBG] pgmap v11329: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T11:54:57.235 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:54:57.235 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:54:57.235 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:54:57.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:54:57 smithi086 bash[24289]: cluster 2024-09-16T11:54:55.956483+0000 mgr.a (mgr.14373) 16336 : cluster [DBG] pgmap v11330: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T11:54:57.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:54:57 smithi047 bash[22744]: cluster 2024-09-16T11:54:55.956483+0000 mgr.a (mgr.14373) 16336 : cluster [DBG] pgmap v11330: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T11:54:57.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:54:57 smithi157 bash[24585]: cluster 2024-09-16T11:54:55.956483+0000 mgr.a (mgr.14373) 16336 : cluster [DBG] pgmap v11330: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T11:54:58.002 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:54:58.002 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:54:58.002 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:54:58.002 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:54:58.002 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:54:58.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:54:58 smithi047 bash[22744]: audit 2024-09-16T11:54:57.567914+0000 mgr.a (mgr.14373) 16337 : audit [DBG] from='client.352089 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:54:58.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:54:58 smithi157 bash[24585]: audit 2024-09-16T11:54:57.567914+0000 mgr.a (mgr.14373) 16337 : audit [DBG] from='client.352089 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:54:58.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:54:58 smithi086 bash[24289]: audit 2024-09-16T11:54:57.567914+0000 mgr.a (mgr.14373) 16337 : audit [DBG] from='client.352089 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:54:59.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:54:59 smithi047 bash[22744]: cluster 2024-09-16T11:54:57.957823+0000 mgr.a (mgr.14373) 16338 : cluster [DBG] pgmap v11331: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:54:59.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:54:59 smithi157 bash[24585]: cluster 2024-09-16T11:54:57.957823+0000 mgr.a (mgr.14373) 16338 : cluster [DBG] pgmap v11331: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:54:59.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:54:59 smithi086 bash[24289]: cluster 2024-09-16T11:54:57.957823+0000 mgr.a (mgr.14373) 16338 : cluster [DBG] pgmap v11331: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:55:01.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:55:01 smithi086 bash[24289]: cluster 2024-09-16T11:54:59.958581+0000 mgr.a (mgr.14373) 16339 : cluster [DBG] pgmap v11332: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-16T11:55:01.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:55:01 smithi047 bash[22744]: cluster 2024-09-16T11:54:59.958581+0000 mgr.a (mgr.14373) 16339 : cluster [DBG] pgmap v11332: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-16T11:55:01.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:55:01 smithi157 bash[24585]: cluster 2024-09-16T11:54:59.958581+0000 mgr.a (mgr.14373) 16339 : cluster [DBG] pgmap v11332: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-16T11:55:03.003 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:55:03.004 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:55:03.004 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:55:03.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:55:03 smithi047 bash[22744]: cluster 2024-09-16T11:55:01.960579+0000 mgr.a (mgr.14373) 16340 : cluster [DBG] pgmap v11333: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-16T11:55:03.792 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:55:03.793 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:55:03.793 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:55:03.793 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:55:03.793 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:55:03.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:55:03 smithi157 bash[24585]: cluster 2024-09-16T11:55:01.960579+0000 mgr.a (mgr.14373) 16340 : cluster [DBG] pgmap v11333: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-16T11:55:03.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:55:03 smithi086 bash[24289]: cluster 2024-09-16T11:55:01.960579+0000 mgr.a (mgr.14373) 16340 : cluster [DBG] pgmap v11333: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-16T11:55:04.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:55:04 smithi157 bash[24585]: audit 2024-09-16T11:55:03.339629+0000 mgr.a (mgr.14373) 16341 : audit [DBG] from='client.352167 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:55:04.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:55:04 smithi086 bash[24289]: audit 2024-09-16T11:55:03.339629+0000 mgr.a (mgr.14373) 16341 : audit [DBG] from='client.352167 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:55:04.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:55:04 smithi047 bash[22744]: audit 2024-09-16T11:55:03.339629+0000 mgr.a (mgr.14373) 16341 : audit [DBG] from='client.352167 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:55:05.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:55:05 smithi157 bash[24585]: cluster 2024-09-16T11:55:03.961541+0000 mgr.a (mgr.14373) 16342 : cluster [DBG] pgmap v11334: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:55:05.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:55:05 smithi086 bash[24289]: cluster 2024-09-16T11:55:03.961541+0000 mgr.a (mgr.14373) 16342 : cluster [DBG] pgmap v11334: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:55:05.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:55:05 smithi047 bash[22744]: cluster 2024-09-16T11:55:03.961541+0000 mgr.a (mgr.14373) 16342 : cluster [DBG] pgmap v11334: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:55:07.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:55:07 smithi157 bash[24585]: cluster 2024-09-16T11:55:05.962382+0000 mgr.a (mgr.14373) 16343 : cluster [DBG] pgmap v11335: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:55:07.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:55:07 smithi086 bash[24289]: cluster 2024-09-16T11:55:05.962382+0000 mgr.a (mgr.14373) 16343 : cluster [DBG] pgmap v11335: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:55:07.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:55:07 smithi047 bash[22744]: cluster 2024-09-16T11:55:05.962382+0000 mgr.a (mgr.14373) 16343 : cluster [DBG] pgmap v11335: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:55:08.792 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:55:08.793 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:55:08.793 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:55:09.548 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:55:09.548 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:55:09.548 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:55:09.548 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:55:09.548 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:55:09.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:55:09 smithi157 bash[24585]: cluster 2024-09-16T11:55:07.964666+0000 mgr.a (mgr.14373) 16344 : cluster [DBG] pgmap v11336: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:55:09.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:55:09 smithi086 bash[24289]: cluster 2024-09-16T11:55:07.964666+0000 mgr.a (mgr.14373) 16344 : cluster [DBG] pgmap v11336: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:55:09.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:55:09 smithi047 bash[22744]: cluster 2024-09-16T11:55:07.964666+0000 mgr.a (mgr.14373) 16344 : cluster [DBG] pgmap v11336: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:55:10.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:55:10 smithi157 bash[24585]: audit 2024-09-16T11:55:09.124750+0000 mgr.a (mgr.14373) 16345 : audit [DBG] from='client.352242 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:55:10.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:55:10 smithi086 bash[24289]: audit 2024-09-16T11:55:09.124750+0000 mgr.a (mgr.14373) 16345 : audit [DBG] from='client.352242 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:55:10.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:55:10 smithi047 bash[22744]: audit 2024-09-16T11:55:09.124750+0000 mgr.a (mgr.14373) 16345 : audit [DBG] from='client.352242 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:55:11.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:55:11 smithi157 bash[24585]: cluster 2024-09-16T11:55:09.965650+0000 mgr.a (mgr.14373) 16346 : cluster [DBG] pgmap v11337: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:55:11.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:55:11 smithi086 bash[24289]: cluster 2024-09-16T11:55:09.965650+0000 mgr.a (mgr.14373) 16346 : cluster [DBG] pgmap v11337: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:55:11.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:55:11 smithi047 bash[22744]: cluster 2024-09-16T11:55:09.965650+0000 mgr.a (mgr.14373) 16346 : cluster [DBG] pgmap v11337: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:55:13.809 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:55:13 smithi157 bash[24585]: cluster 2024-09-16T11:55:11.967843+0000 mgr.a (mgr.14373) 16347 : cluster [DBG] pgmap v11338: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:55:13.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:55:13 smithi086 bash[24289]: cluster 2024-09-16T11:55:11.967843+0000 mgr.a (mgr.14373) 16347 : cluster [DBG] pgmap v11338: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:55:13.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:55:13 smithi047 bash[22744]: cluster 2024-09-16T11:55:11.967843+0000 mgr.a (mgr.14373) 16347 : cluster [DBG] pgmap v11338: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:55:14.549 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:55:14.550 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:55:14.550 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:55:15.321 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:55:15.321 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:55:15.321 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:55:15.321 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:55:15.321 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:55:15.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:55:15 smithi157 bash[24585]: cluster 2024-09-16T11:55:13.968611+0000 mgr.a (mgr.14373) 16348 : cluster [DBG] pgmap v11339: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:55:15.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:55:15 smithi086 bash[24289]: cluster 2024-09-16T11:55:13.968611+0000 mgr.a (mgr.14373) 16348 : cluster [DBG] pgmap v11339: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:55:15.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:55:15 smithi047 bash[22744]: cluster 2024-09-16T11:55:13.968611+0000 mgr.a (mgr.14373) 16348 : cluster [DBG] pgmap v11339: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:55:16.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:55:16 smithi157 bash[24585]: audit 2024-09-16T11:55:14.881601+0000 mgr.a (mgr.14373) 16349 : audit [DBG] from='client.352320 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:55:16.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:55:16 smithi086 bash[24289]: audit 2024-09-16T11:55:14.881601+0000 mgr.a (mgr.14373) 16349 : audit [DBG] from='client.352320 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:55:16.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:55:16 smithi047 bash[22744]: audit 2024-09-16T11:55:14.881601+0000 mgr.a (mgr.14373) 16349 : audit [DBG] from='client.352320 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:55:17.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:55:17 smithi157 bash[24585]: cluster 2024-09-16T11:55:15.969623+0000 mgr.a (mgr.14373) 16350 : cluster [DBG] pgmap v11340: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:55:17.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:55:17 smithi086 bash[24289]: cluster 2024-09-16T11:55:15.969623+0000 mgr.a (mgr.14373) 16350 : cluster [DBG] pgmap v11340: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:55:17.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:55:17 smithi047 bash[22744]: cluster 2024-09-16T11:55:15.969623+0000 mgr.a (mgr.14373) 16350 : cluster [DBG] pgmap v11340: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:55:19.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:55:19 smithi157 bash[24585]: cluster 2024-09-16T11:55:17.971865+0000 mgr.a (mgr.14373) 16351 : cluster [DBG] pgmap v11341: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:55:19.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:55:19 smithi086 bash[24289]: cluster 2024-09-16T11:55:17.971865+0000 mgr.a (mgr.14373) 16351 : cluster [DBG] pgmap v11341: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:55:19.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:55:19 smithi047 bash[22744]: cluster 2024-09-16T11:55:17.971865+0000 mgr.a (mgr.14373) 16351 : cluster [DBG] pgmap v11341: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:55:20.322 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:55:20.323 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:55:20.324 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:55:21.097 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:55:21.097 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:55:21.097 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:55:21.097 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:55:21.097 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:55:21.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:55:21 smithi157 bash[24585]: cluster 2024-09-16T11:55:19.972676+0000 mgr.a (mgr.14373) 16352 : cluster [DBG] pgmap v11342: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:55:21.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:55:21 smithi086 bash[24289]: cluster 2024-09-16T11:55:19.972676+0000 mgr.a (mgr.14373) 16352 : cluster [DBG] pgmap v11342: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:55:21.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:55:21 smithi047 bash[22744]: cluster 2024-09-16T11:55:19.972676+0000 mgr.a (mgr.14373) 16352 : cluster [DBG] pgmap v11342: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:55:22.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:55:22 smithi157 bash[24585]: audit 2024-09-16T11:55:20.656783+0000 mgr.a (mgr.14373) 16353 : audit [DBG] from='client.352395 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:55:22.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:55:22 smithi086 bash[24289]: audit 2024-09-16T11:55:20.656783+0000 mgr.a (mgr.14373) 16353 : audit [DBG] from='client.352395 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:55:22.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:55:22 smithi047 bash[22744]: audit 2024-09-16T11:55:20.656783+0000 mgr.a (mgr.14373) 16353 : audit [DBG] from='client.352395 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:55:23.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:55:23 smithi157 bash[24585]: cluster 2024-09-16T11:55:21.975093+0000 mgr.a (mgr.14373) 16354 : cluster [DBG] pgmap v11343: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:55:23.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:55:23 smithi086 bash[24289]: cluster 2024-09-16T11:55:21.975093+0000 mgr.a (mgr.14373) 16354 : cluster [DBG] pgmap v11343: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:55:23.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:55:23 smithi047 bash[22744]: cluster 2024-09-16T11:55:21.975093+0000 mgr.a (mgr.14373) 16354 : cluster [DBG] pgmap v11343: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:55:25.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:55:25 smithi157 bash[24585]: cluster 2024-09-16T11:55:23.975859+0000 mgr.a (mgr.14373) 16355 : cluster [DBG] pgmap v11344: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:55:25.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:55:25 smithi086 bash[24289]: cluster 2024-09-16T11:55:23.975859+0000 mgr.a (mgr.14373) 16355 : cluster [DBG] pgmap v11344: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:55:25.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:55:25 smithi047 bash[22744]: cluster 2024-09-16T11:55:23.975859+0000 mgr.a (mgr.14373) 16355 : cluster [DBG] pgmap v11344: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:55:26.098 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:55:26.099 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:55:26.099 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:55:26.863 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:55:26.864 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:55:26.864 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:55:26.864 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:55:26.864 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:55:27.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:55:27 smithi157 bash[24585]: cluster 2024-09-16T11:55:25.976628+0000 mgr.a (mgr.14373) 16356 : cluster [DBG] pgmap v11345: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:55:27.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:55:27 smithi157 bash[24585]: audit 2024-09-16T11:55:26.431422+0000 mgr.a (mgr.14373) 16357 : audit [DBG] from='client.352464 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:55:27.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:55:27 smithi086 bash[24289]: cluster 2024-09-16T11:55:25.976628+0000 mgr.a (mgr.14373) 16356 : cluster [DBG] pgmap v11345: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:55:27.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:55:27 smithi086 bash[24289]: audit 2024-09-16T11:55:26.431422+0000 mgr.a (mgr.14373) 16357 : audit [DBG] from='client.352464 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:55:27.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:55:27 smithi047 bash[22744]: cluster 2024-09-16T11:55:25.976628+0000 mgr.a (mgr.14373) 16356 : cluster [DBG] pgmap v11345: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:55:27.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:55:27 smithi047 bash[22744]: audit 2024-09-16T11:55:26.431422+0000 mgr.a (mgr.14373) 16357 : audit [DBG] from='client.352464 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:55:29.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:55:29 smithi157 bash[24585]: cluster 2024-09-16T11:55:27.979397+0000 mgr.a (mgr.14373) 16358 : cluster [DBG] pgmap v11346: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:55:29.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:55:29 smithi086 bash[24289]: cluster 2024-09-16T11:55:27.979397+0000 mgr.a (mgr.14373) 16358 : cluster [DBG] pgmap v11346: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:55:29.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:55:29 smithi047 bash[22744]: cluster 2024-09-16T11:55:27.979397+0000 mgr.a (mgr.14373) 16358 : cluster [DBG] pgmap v11346: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:55:31.808 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:55:31 smithi157 bash[24585]: cluster 2024-09-16T11:55:29.980224+0000 mgr.a (mgr.14373) 16359 : cluster [DBG] pgmap v11347: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:55:31.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:55:31 smithi086 bash[24289]: cluster 2024-09-16T11:55:29.980224+0000 mgr.a (mgr.14373) 16359 : cluster [DBG] pgmap v11347: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:55:31.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:55:31 smithi047 bash[22744]: cluster 2024-09-16T11:55:29.980224+0000 mgr.a (mgr.14373) 16359 : cluster [DBG] pgmap v11347: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:55:31.865 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:55:31.866 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:55:31.866 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:55:32.628 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:55:32.629 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:55:32.629 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:55:32.629 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:55:32.629 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:55:33.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:55:33 smithi157 bash[24585]: cluster 2024-09-16T11:55:31.981536+0000 mgr.a (mgr.14373) 16360 : cluster [DBG] pgmap v11348: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:55:33.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:55:33 smithi157 bash[24585]: audit 2024-09-16T11:55:32.201087+0000 mgr.a (mgr.14373) 16361 : audit [DBG] from='client.352542 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:55:33.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:55:33 smithi086 bash[24289]: cluster 2024-09-16T11:55:31.981536+0000 mgr.a (mgr.14373) 16360 : cluster [DBG] pgmap v11348: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:55:33.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:55:33 smithi086 bash[24289]: audit 2024-09-16T11:55:32.201087+0000 mgr.a (mgr.14373) 16361 : audit [DBG] from='client.352542 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:55:33.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:55:33 smithi047 bash[22744]: cluster 2024-09-16T11:55:31.981536+0000 mgr.a (mgr.14373) 16360 : cluster [DBG] pgmap v11348: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:55:33.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:55:33 smithi047 bash[22744]: audit 2024-09-16T11:55:32.201087+0000 mgr.a (mgr.14373) 16361 : audit [DBG] from='client.352542 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:55:35.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:55:35 smithi157 bash[24585]: cluster 2024-09-16T11:55:33.982435+0000 mgr.a (mgr.14373) 16362 : cluster [DBG] pgmap v11349: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:55:35.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:55:35 smithi086 bash[24289]: cluster 2024-09-16T11:55:33.982435+0000 mgr.a (mgr.14373) 16362 : cluster [DBG] pgmap v11349: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:55:35.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:55:35 smithi047 bash[22744]: cluster 2024-09-16T11:55:33.982435+0000 mgr.a (mgr.14373) 16362 : cluster [DBG] pgmap v11349: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:55:37.626 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:55:37.627 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:55:37.627 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:55:37.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:55:37 smithi157 bash[24585]: cluster 2024-09-16T11:55:35.983174+0000 mgr.a (mgr.14373) 16363 : cluster [DBG] pgmap v11350: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T11:55:37.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:55:37 smithi086 bash[24289]: cluster 2024-09-16T11:55:35.983174+0000 mgr.a (mgr.14373) 16363 : cluster [DBG] pgmap v11350: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T11:55:37.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:55:37 smithi047 bash[22744]: cluster 2024-09-16T11:55:35.983174+0000 mgr.a (mgr.14373) 16363 : cluster [DBG] pgmap v11350: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T11:55:38.412 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:55:38.413 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:55:38.413 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:55:38.413 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:55:38.413 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:55:39.808 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:55:39 smithi157 bash[24585]: audit 2024-09-16T11:55:37.962702+0000 mgr.a (mgr.14373) 16364 : audit [DBG] from='client.352614 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:55:39.808 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:55:39 smithi157 bash[24585]: cluster 2024-09-16T11:55:37.985716+0000 mgr.a (mgr.14373) 16365 : cluster [DBG] pgmap v11351: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:55:39.808 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:55:39 smithi157 bash[24585]: audit 2024-09-16T11:55:38.610641+0000 mon.b (mon.2) 1486 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T11:55:39.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:55:39 smithi086 bash[24289]: audit 2024-09-16T11:55:37.962702+0000 mgr.a (mgr.14373) 16364 : audit [DBG] from='client.352614 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:55:39.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:55:39 smithi086 bash[24289]: cluster 2024-09-16T11:55:37.985716+0000 mgr.a (mgr.14373) 16365 : cluster [DBG] pgmap v11351: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:55:39.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:55:39 smithi086 bash[24289]: audit 2024-09-16T11:55:38.610641+0000 mon.b (mon.2) 1486 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T11:55:39.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:55:39 smithi047 bash[22744]: audit 2024-09-16T11:55:37.962702+0000 mgr.a (mgr.14373) 16364 : audit [DBG] from='client.352614 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:55:39.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:55:39 smithi047 bash[22744]: cluster 2024-09-16T11:55:37.985716+0000 mgr.a (mgr.14373) 16365 : cluster [DBG] pgmap v11351: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:55:39.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:55:39 smithi047 bash[22744]: audit 2024-09-16T11:55:38.610641+0000 mon.b (mon.2) 1486 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T11:55:40.593 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 11:55:40 smithi047 bash[22994]: debug 2024-09-16T11:55:40.223+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T11:55:40.593 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 11:55:40 smithi047 bash[22994]: debug 2024-09-16T11:55:40.223+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T11:55:40.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:55:40 smithi047 bash[22744]: audit 2024-09-16T11:55:39.451664+0000 mon.b (mon.2) 1487 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T11:55:40.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:55:40 smithi047 bash[22744]: audit 2024-09-16T11:55:39.453632+0000 mon.b (mon.2) 1488 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T11:55:40.594 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:55:40 smithi047 bash[22744]: audit 2024-09-16T11:55:39.464147+0000 mon.a (mon.0) 1545 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:55:40.594 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:55:40 smithi047 bash[22744]: audit 2024-09-16T11:55:39.467741+0000 mon.b (mon.2) 1489 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:55:40.594 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:55:40 smithi047 bash[22744]: audit 2024-09-16T11:55:39.470431+0000 mgr.a (mgr.14373) 16366 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:55:40.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:55:40 smithi157 bash[24585]: audit 2024-09-16T11:55:39.451664+0000 mon.b (mon.2) 1487 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T11:55:40.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:55:40 smithi157 bash[24585]: audit 2024-09-16T11:55:39.453632+0000 mon.b (mon.2) 1488 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T11:55:40.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:55:40 smithi157 bash[24585]: audit 2024-09-16T11:55:39.464147+0000 mon.a (mon.0) 1545 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:55:40.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:55:40 smithi157 bash[24585]: audit 2024-09-16T11:55:39.467741+0000 mon.b (mon.2) 1489 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:55:40.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:55:40 smithi157 bash[24585]: audit 2024-09-16T11:55:39.470431+0000 mgr.a (mgr.14373) 16366 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:55:40.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:55:40 smithi086 bash[24289]: audit 2024-09-16T11:55:39.451664+0000 mon.b (mon.2) 1487 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T11:55:40.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:55:40 smithi086 bash[24289]: audit 2024-09-16T11:55:39.453632+0000 mon.b (mon.2) 1488 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T11:55:40.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:55:40 smithi086 bash[24289]: audit 2024-09-16T11:55:39.464147+0000 mon.a (mon.0) 1545 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:55:40.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:55:40 smithi086 bash[24289]: audit 2024-09-16T11:55:39.467741+0000 mon.b (mon.2) 1489 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:55:40.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:55:40 smithi086 bash[24289]: audit 2024-09-16T11:55:39.470431+0000 mgr.a (mgr.14373) 16366 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:55:41.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:55:41 smithi157 bash[24585]: cluster 2024-09-16T11:55:39.986301+0000 mgr.a (mgr.14373) 16367 : cluster [DBG] pgmap v11352: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:55:41.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:55:41 smithi157 bash[24585]: audit 2024-09-16T11:55:40.227416+0000 mgr.a (mgr.14373) 16368 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T11:55:41.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:55:41 smithi157 bash[24585]: cephadm 2024-09-16T11:55:40.229460+0000 mgr.a (mgr.14373) 16369 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T11:55:41.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:55:41 smithi086 bash[24289]: cluster 2024-09-16T11:55:39.986301+0000 mgr.a (mgr.14373) 16367 : cluster [DBG] pgmap v11352: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:55:41.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:55:41 smithi086 bash[24289]: audit 2024-09-16T11:55:40.227416+0000 mgr.a (mgr.14373) 16368 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T11:55:41.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:55:41 smithi086 bash[24289]: cephadm 2024-09-16T11:55:40.229460+0000 mgr.a (mgr.14373) 16369 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T11:55:41.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:55:41 smithi047 bash[22744]: cluster 2024-09-16T11:55:39.986301+0000 mgr.a (mgr.14373) 16367 : cluster [DBG] pgmap v11352: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:55:41.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:55:41 smithi047 bash[22744]: audit 2024-09-16T11:55:40.227416+0000 mgr.a (mgr.14373) 16368 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T11:55:41.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:55:41 smithi047 bash[22744]: cephadm 2024-09-16T11:55:40.229460+0000 mgr.a (mgr.14373) 16369 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T11:55:43.414 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:55:43.415 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:55:43.415 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:55:43.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:55:43 smithi157 bash[24585]: cluster 2024-09-16T11:55:41.988573+0000 mgr.a (mgr.14373) 16370 : cluster [DBG] pgmap v11353: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:55:43.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:55:43 smithi086 bash[24289]: cluster 2024-09-16T11:55:41.988573+0000 mgr.a (mgr.14373) 16370 : cluster [DBG] pgmap v11353: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:55:43.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:55:43 smithi047 bash[22744]: cluster 2024-09-16T11:55:41.988573+0000 mgr.a (mgr.14373) 16370 : cluster [DBG] pgmap v11353: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:55:44.157 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:55:44.157 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:55:44.157 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:55:44.157 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:55:44.157 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:55:45.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:55:45 smithi157 bash[24585]: audit 2024-09-16T11:55:43.735246+0000 mgr.a (mgr.14373) 16371 : audit [DBG] from='client.352800 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:55:45.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:55:45 smithi157 bash[24585]: cluster 2024-09-16T11:55:43.989574+0000 mgr.a (mgr.14373) 16372 : cluster [DBG] pgmap v11354: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:55:45.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:55:45 smithi086 bash[24289]: audit 2024-09-16T11:55:43.735246+0000 mgr.a (mgr.14373) 16371 : audit [DBG] from='client.352800 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:55:45.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:55:45 smithi086 bash[24289]: cluster 2024-09-16T11:55:43.989574+0000 mgr.a (mgr.14373) 16372 : cluster [DBG] pgmap v11354: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:55:45.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:55:45 smithi047 bash[22744]: audit 2024-09-16T11:55:43.735246+0000 mgr.a (mgr.14373) 16371 : audit [DBG] from='client.352800 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:55:45.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:55:45 smithi047 bash[22744]: cluster 2024-09-16T11:55:43.989574+0000 mgr.a (mgr.14373) 16372 : cluster [DBG] pgmap v11354: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:55:47.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:55:47 smithi157 bash[24585]: cluster 2024-09-16T11:55:45.990536+0000 mgr.a (mgr.14373) 16373 : cluster [DBG] pgmap v11355: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:55:47.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:55:47 smithi086 bash[24289]: cluster 2024-09-16T11:55:45.990536+0000 mgr.a (mgr.14373) 16373 : cluster [DBG] pgmap v11355: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:55:47.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:55:47 smithi047 bash[22744]: cluster 2024-09-16T11:55:45.990536+0000 mgr.a (mgr.14373) 16373 : cluster [DBG] pgmap v11355: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:55:49.158 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:55:49.159 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:55:49.159 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:55:49.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:55:49 smithi157 bash[24585]: cluster 2024-09-16T11:55:47.992802+0000 mgr.a (mgr.14373) 16374 : cluster [DBG] pgmap v11356: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:55:49.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:55:49 smithi086 bash[24289]: cluster 2024-09-16T11:55:47.992802+0000 mgr.a (mgr.14373) 16374 : cluster [DBG] pgmap v11356: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:55:49.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:55:49 smithi047 bash[22744]: cluster 2024-09-16T11:55:47.992802+0000 mgr.a (mgr.14373) 16374 : cluster [DBG] pgmap v11356: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:55:49.917 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:55:49.917 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:55:49.917 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:55:49.918 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:55:49.918 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:55:50.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:55:50 smithi157 bash[24585]: audit 2024-09-16T11:55:49.488572+0000 mgr.a (mgr.14373) 16375 : audit [DBG] from='client.352878 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:55:50.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:55:50 smithi086 bash[24289]: audit 2024-09-16T11:55:49.488572+0000 mgr.a (mgr.14373) 16375 : audit [DBG] from='client.352878 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:55:50.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:55:50 smithi047 bash[22744]: audit 2024-09-16T11:55:49.488572+0000 mgr.a (mgr.14373) 16375 : audit [DBG] from='client.352878 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:55:51.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:55:51 smithi157 bash[24585]: cluster 2024-09-16T11:55:49.993800+0000 mgr.a (mgr.14373) 16376 : cluster [DBG] pgmap v11357: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:55:51.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:55:51 smithi086 bash[24289]: cluster 2024-09-16T11:55:49.993800+0000 mgr.a (mgr.14373) 16376 : cluster [DBG] pgmap v11357: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:55:51.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:55:51 smithi047 bash[22744]: cluster 2024-09-16T11:55:49.993800+0000 mgr.a (mgr.14373) 16376 : cluster [DBG] pgmap v11357: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:55:53.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:55:53 smithi157 bash[24585]: cluster 2024-09-16T11:55:51.996021+0000 mgr.a (mgr.14373) 16377 : cluster [DBG] pgmap v11358: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:55:53.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:55:53 smithi086 bash[24289]: cluster 2024-09-16T11:55:51.996021+0000 mgr.a (mgr.14373) 16377 : cluster [DBG] pgmap v11358: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:55:53.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:55:53 smithi047 bash[22744]: cluster 2024-09-16T11:55:51.996021+0000 mgr.a (mgr.14373) 16377 : cluster [DBG] pgmap v11358: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:55:54.919 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:55:54.919 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:55:54.920 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:55:55.699 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:55:55.699 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:55:55.699 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:55:55.699 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:55:55.699 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:55:55.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:55:55 smithi157 bash[24585]: cluster 2024-09-16T11:55:53.996940+0000 mgr.a (mgr.14373) 16378 : cluster [DBG] pgmap v11359: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:55:55.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:55:55 smithi086 bash[24289]: cluster 2024-09-16T11:55:53.996940+0000 mgr.a (mgr.14373) 16378 : cluster [DBG] pgmap v11359: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:55:55.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:55:55 smithi047 bash[22744]: cluster 2024-09-16T11:55:53.996940+0000 mgr.a (mgr.14373) 16378 : cluster [DBG] pgmap v11359: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:55:56.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:55:56 smithi157 bash[24585]: audit 2024-09-16T11:55:55.254426+0000 mgr.a (mgr.14373) 16379 : audit [DBG] from='client.352956 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:55:56.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:55:56 smithi086 bash[24289]: audit 2024-09-16T11:55:55.254426+0000 mgr.a (mgr.14373) 16379 : audit [DBG] from='client.352956 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:55:56.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:55:56 smithi047 bash[22744]: audit 2024-09-16T11:55:55.254426+0000 mgr.a (mgr.14373) 16379 : audit [DBG] from='client.352956 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:55:57.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:55:57 smithi157 bash[24585]: cluster 2024-09-16T11:55:55.997910+0000 mgr.a (mgr.14373) 16380 : cluster [DBG] pgmap v11360: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:55:57.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:55:57 smithi086 bash[24289]: cluster 2024-09-16T11:55:55.997910+0000 mgr.a (mgr.14373) 16380 : cluster [DBG] pgmap v11360: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:55:57.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:55:57 smithi047 bash[22744]: cluster 2024-09-16T11:55:55.997910+0000 mgr.a (mgr.14373) 16380 : cluster [DBG] pgmap v11360: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:55:59.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:55:59 smithi157 bash[24585]: cluster 2024-09-16T11:55:58.000246+0000 mgr.a (mgr.14373) 16381 : cluster [DBG] pgmap v11361: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:55:59.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:55:59 smithi086 bash[24289]: cluster 2024-09-16T11:55:58.000246+0000 mgr.a (mgr.14373) 16381 : cluster [DBG] pgmap v11361: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:55:59.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:55:59 smithi047 bash[22744]: cluster 2024-09-16T11:55:58.000246+0000 mgr.a (mgr.14373) 16381 : cluster [DBG] pgmap v11361: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:56:00.701 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:56:00.701 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:56:00.702 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:56:01.444 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:56:01.444 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:56:01.444 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:56:01.444 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:56:01.445 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:56:01.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:56:01 smithi157 bash[24585]: cluster 2024-09-16T11:56:00.001015+0000 mgr.a (mgr.14373) 16382 : cluster [DBG] pgmap v11362: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:56:01.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:56:01 smithi086 bash[24289]: cluster 2024-09-16T11:56:00.001015+0000 mgr.a (mgr.14373) 16382 : cluster [DBG] pgmap v11362: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:56:01.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:56:01 smithi047 bash[22744]: cluster 2024-09-16T11:56:00.001015+0000 mgr.a (mgr.14373) 16382 : cluster [DBG] pgmap v11362: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:56:02.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:56:02 smithi157 bash[24585]: audit 2024-09-16T11:56:01.029996+0000 mgr.a (mgr.14373) 16383 : audit [DBG] from='client.353031 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:56:02.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:56:02 smithi086 bash[24289]: audit 2024-09-16T11:56:01.029996+0000 mgr.a (mgr.14373) 16383 : audit [DBG] from='client.353031 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:56:02.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:56:02 smithi047 bash[22744]: audit 2024-09-16T11:56:01.029996+0000 mgr.a (mgr.14373) 16383 : audit [DBG] from='client.353031 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:56:03.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:56:03 smithi157 bash[24585]: cluster 2024-09-16T11:56:02.003421+0000 mgr.a (mgr.14373) 16384 : cluster [DBG] pgmap v11363: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:56:03.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:56:03 smithi086 bash[24289]: cluster 2024-09-16T11:56:02.003421+0000 mgr.a (mgr.14373) 16384 : cluster [DBG] pgmap v11363: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:56:03.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:56:03 smithi047 bash[22744]: cluster 2024-09-16T11:56:02.003421+0000 mgr.a (mgr.14373) 16384 : cluster [DBG] pgmap v11363: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:56:05.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:56:05 smithi157 bash[24585]: cluster 2024-09-16T11:56:04.004189+0000 mgr.a (mgr.14373) 16385 : cluster [DBG] pgmap v11364: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:56:05.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:56:05 smithi086 bash[24289]: cluster 2024-09-16T11:56:04.004189+0000 mgr.a (mgr.14373) 16385 : cluster [DBG] pgmap v11364: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:56:05.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:56:05 smithi047 bash[22744]: cluster 2024-09-16T11:56:04.004189+0000 mgr.a (mgr.14373) 16385 : cluster [DBG] pgmap v11364: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:56:06.445 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:56:06.446 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:56:06.446 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:56:07.221 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:56:07.222 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:56:07.222 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:56:07.222 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:56:07.222 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:56:07.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:56:07 smithi157 bash[24585]: cluster 2024-09-16T11:56:06.004970+0000 mgr.a (mgr.14373) 16386 : cluster [DBG] pgmap v11365: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:56:07.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:56:07 smithi086 bash[24289]: cluster 2024-09-16T11:56:06.004970+0000 mgr.a (mgr.14373) 16386 : cluster [DBG] pgmap v11365: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:56:07.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:56:07 smithi047 bash[22744]: cluster 2024-09-16T11:56:06.004970+0000 mgr.a (mgr.14373) 16386 : cluster [DBG] pgmap v11365: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:56:08.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:56:08 smithi157 bash[24585]: audit 2024-09-16T11:56:06.787843+0000 mgr.a (mgr.14373) 16387 : audit [DBG] from='client.353106 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:56:08.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:56:08 smithi086 bash[24289]: audit 2024-09-16T11:56:06.787843+0000 mgr.a (mgr.14373) 16387 : audit [DBG] from='client.353106 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:56:08.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:56:08 smithi047 bash[22744]: audit 2024-09-16T11:56:06.787843+0000 mgr.a (mgr.14373) 16387 : audit [DBG] from='client.353106 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:56:09.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:56:09 smithi157 bash[24585]: cluster 2024-09-16T11:56:08.007688+0000 mgr.a (mgr.14373) 16388 : cluster [DBG] pgmap v11366: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:56:09.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:56:09 smithi086 bash[24289]: cluster 2024-09-16T11:56:08.007688+0000 mgr.a (mgr.14373) 16388 : cluster [DBG] pgmap v11366: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:56:09.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:56:09 smithi047 bash[22744]: cluster 2024-09-16T11:56:08.007688+0000 mgr.a (mgr.14373) 16388 : cluster [DBG] pgmap v11366: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:56:11.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:56:11 smithi157 bash[24585]: cluster 2024-09-16T11:56:10.008621+0000 mgr.a (mgr.14373) 16389 : cluster [DBG] pgmap v11367: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:56:11.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:56:11 smithi086 bash[24289]: cluster 2024-09-16T11:56:10.008621+0000 mgr.a (mgr.14373) 16389 : cluster [DBG] pgmap v11367: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:56:11.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:56:11 smithi047 bash[22744]: cluster 2024-09-16T11:56:10.008621+0000 mgr.a (mgr.14373) 16389 : cluster [DBG] pgmap v11367: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:56:12.223 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:56:12.224 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:56:12.224 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:56:13.007 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:56:13.007 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:56:13.007 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:56:13.007 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:56:13.008 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:56:13.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:56:13 smithi086 bash[24289]: cluster 2024-09-16T11:56:12.010799+0000 mgr.a (mgr.14373) 16390 : cluster [DBG] pgmap v11368: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:56:13.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:56:13 smithi086 bash[24289]: audit 2024-09-16T11:56:12.561173+0000 mgr.a (mgr.14373) 16391 : audit [DBG] from='client.353181 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:56:13.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:56:13 smithi047 bash[22744]: cluster 2024-09-16T11:56:12.010799+0000 mgr.a (mgr.14373) 16390 : cluster [DBG] pgmap v11368: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:56:13.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:56:13 smithi047 bash[22744]: audit 2024-09-16T11:56:12.561173+0000 mgr.a (mgr.14373) 16391 : audit [DBG] from='client.353181 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:56:14.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:56:13 smithi157 bash[24585]: cluster 2024-09-16T11:56:12.010799+0000 mgr.a (mgr.14373) 16390 : cluster [DBG] pgmap v11368: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:56:14.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:56:13 smithi157 bash[24585]: audit 2024-09-16T11:56:12.561173+0000 mgr.a (mgr.14373) 16391 : audit [DBG] from='client.353181 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:56:15.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:56:15 smithi086 bash[24289]: cluster 2024-09-16T11:56:14.011890+0000 mgr.a (mgr.14373) 16392 : cluster [DBG] pgmap v11369: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:56:15.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:56:15 smithi047 bash[22744]: cluster 2024-09-16T11:56:14.011890+0000 mgr.a (mgr.14373) 16392 : cluster [DBG] pgmap v11369: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:56:16.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:56:15 smithi157 bash[24585]: cluster 2024-09-16T11:56:14.011890+0000 mgr.a (mgr.14373) 16392 : cluster [DBG] pgmap v11369: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:56:17.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:56:17 smithi086 bash[24289]: cluster 2024-09-16T11:56:16.012867+0000 mgr.a (mgr.14373) 16393 : cluster [DBG] pgmap v11370: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:56:17.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:56:17 smithi047 bash[22744]: cluster 2024-09-16T11:56:16.012867+0000 mgr.a (mgr.14373) 16393 : cluster [DBG] pgmap v11370: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:56:18.009 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:56:18.010 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:56:18.010 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:56:18.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:56:17 smithi157 bash[24585]: cluster 2024-09-16T11:56:16.012867+0000 mgr.a (mgr.14373) 16393 : cluster [DBG] pgmap v11370: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:56:18.769 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:56:18.770 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:56:18.770 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:56:18.770 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:56:18.770 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:56:19.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:56:19 smithi047 bash[22744]: cluster 2024-09-16T11:56:18.015262+0000 mgr.a (mgr.14373) 16394 : cluster [DBG] pgmap v11371: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:56:19.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:56:19 smithi047 bash[22744]: audit 2024-09-16T11:56:18.338533+0000 mgr.a (mgr.14373) 16395 : audit [DBG] from='client.353259 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:56:20.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:56:19 smithi157 bash[24585]: cluster 2024-09-16T11:56:18.015262+0000 mgr.a (mgr.14373) 16394 : cluster [DBG] pgmap v11371: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:56:20.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:56:19 smithi157 bash[24585]: audit 2024-09-16T11:56:18.338533+0000 mgr.a (mgr.14373) 16395 : audit [DBG] from='client.353259 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:56:20.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:56:19 smithi086 bash[24289]: cluster 2024-09-16T11:56:18.015262+0000 mgr.a (mgr.14373) 16394 : cluster [DBG] pgmap v11371: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:56:20.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:56:19 smithi086 bash[24289]: audit 2024-09-16T11:56:18.338533+0000 mgr.a (mgr.14373) 16395 : audit [DBG] from='client.353259 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:56:21.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:56:21 smithi047 bash[22744]: cluster 2024-09-16T11:56:20.016232+0000 mgr.a (mgr.14373) 16396 : cluster [DBG] pgmap v11372: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:56:22.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:56:21 smithi157 bash[24585]: cluster 2024-09-16T11:56:20.016232+0000 mgr.a (mgr.14373) 16396 : cluster [DBG] pgmap v11372: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:56:22.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:56:21 smithi086 bash[24289]: cluster 2024-09-16T11:56:20.016232+0000 mgr.a (mgr.14373) 16396 : cluster [DBG] pgmap v11372: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:56:23.771 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:56:23.772 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:56:23.772 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:56:23.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:56:23 smithi047 bash[22744]: cluster 2024-09-16T11:56:22.018452+0000 mgr.a (mgr.14373) 16397 : cluster [DBG] pgmap v11373: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:56:24.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:56:23 smithi157 bash[24585]: cluster 2024-09-16T11:56:22.018452+0000 mgr.a (mgr.14373) 16397 : cluster [DBG] pgmap v11373: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:56:24.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:56:23 smithi086 bash[24289]: cluster 2024-09-16T11:56:22.018452+0000 mgr.a (mgr.14373) 16397 : cluster [DBG] pgmap v11373: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:56:24.542 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:56:24.542 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:56:24.543 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:56:24.543 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:56:24.543 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:56:25.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:56:25 smithi047 bash[22744]: cluster 2024-09-16T11:56:24.019197+0000 mgr.a (mgr.14373) 16398 : cluster [DBG] pgmap v11374: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:56:25.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:56:25 smithi047 bash[22744]: audit 2024-09-16T11:56:24.112317+0000 mgr.a (mgr.14373) 16399 : audit [DBG] from='client.353337 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:56:26.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:56:25 smithi157 bash[24585]: cluster 2024-09-16T11:56:24.019197+0000 mgr.a (mgr.14373) 16398 : cluster [DBG] pgmap v11374: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:56:26.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:56:25 smithi157 bash[24585]: audit 2024-09-16T11:56:24.112317+0000 mgr.a (mgr.14373) 16399 : audit [DBG] from='client.353337 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:56:26.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:56:25 smithi086 bash[24289]: cluster 2024-09-16T11:56:24.019197+0000 mgr.a (mgr.14373) 16398 : cluster [DBG] pgmap v11374: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:56:26.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:56:25 smithi086 bash[24289]: audit 2024-09-16T11:56:24.112317+0000 mgr.a (mgr.14373) 16399 : audit [DBG] from='client.353337 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:56:27.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:56:27 smithi047 bash[22744]: cluster 2024-09-16T11:56:26.020293+0000 mgr.a (mgr.14373) 16400 : cluster [DBG] pgmap v11375: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:56:28.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:56:27 smithi157 bash[24585]: cluster 2024-09-16T11:56:26.020293+0000 mgr.a (mgr.14373) 16400 : cluster [DBG] pgmap v11375: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:56:28.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:56:27 smithi086 bash[24289]: cluster 2024-09-16T11:56:26.020293+0000 mgr.a (mgr.14373) 16400 : cluster [DBG] pgmap v11375: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:56:29.544 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:56:29.544 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:56:29.544 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:56:30.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:56:29 smithi157 bash[24585]: cluster 2024-09-16T11:56:28.022689+0000 mgr.a (mgr.14373) 16401 : cluster [DBG] pgmap v11376: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:56:30.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:56:29 smithi086 bash[24289]: cluster 2024-09-16T11:56:28.022689+0000 mgr.a (mgr.14373) 16401 : cluster [DBG] pgmap v11376: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:56:30.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:56:29 smithi047 bash[22744]: cluster 2024-09-16T11:56:28.022689+0000 mgr.a (mgr.14373) 16401 : cluster [DBG] pgmap v11376: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:56:30.327 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:56:30.327 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:56:30.327 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:56:30.327 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:56:30.327 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:56:32.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:56:31 smithi157 bash[24585]: audit 2024-09-16T11:56:29.883255+0000 mgr.a (mgr.14373) 16402 : audit [DBG] from='client.353415 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:56:32.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:56:31 smithi157 bash[24585]: cluster 2024-09-16T11:56:30.026462+0000 mgr.a (mgr.14373) 16403 : cluster [DBG] pgmap v11377: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:56:32.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:56:31 smithi086 bash[24289]: audit 2024-09-16T11:56:29.883255+0000 mgr.a (mgr.14373) 16402 : audit [DBG] from='client.353415 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:56:32.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:56:31 smithi086 bash[24289]: cluster 2024-09-16T11:56:30.026462+0000 mgr.a (mgr.14373) 16403 : cluster [DBG] pgmap v11377: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:56:32.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:56:31 smithi047 bash[22744]: audit 2024-09-16T11:56:29.883255+0000 mgr.a (mgr.14373) 16402 : audit [DBG] from='client.353415 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:56:32.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:56:31 smithi047 bash[22744]: cluster 2024-09-16T11:56:30.026462+0000 mgr.a (mgr.14373) 16403 : cluster [DBG] pgmap v11377: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:56:34.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:56:33 smithi157 bash[24585]: cluster 2024-09-16T11:56:32.028743+0000 mgr.a (mgr.14373) 16404 : cluster [DBG] pgmap v11378: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:56:34.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:56:33 smithi086 bash[24289]: cluster 2024-09-16T11:56:32.028743+0000 mgr.a (mgr.14373) 16404 : cluster [DBG] pgmap v11378: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:56:34.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:56:33 smithi047 bash[22744]: cluster 2024-09-16T11:56:32.028743+0000 mgr.a (mgr.14373) 16404 : cluster [DBG] pgmap v11378: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:56:35.329 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:56:35.329 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:56:35.329 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:56:36.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:56:35 smithi157 bash[24585]: cluster 2024-09-16T11:56:34.029496+0000 mgr.a (mgr.14373) 16405 : cluster [DBG] pgmap v11379: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:56:36.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:56:35 smithi086 bash[24289]: cluster 2024-09-16T11:56:34.029496+0000 mgr.a (mgr.14373) 16405 : cluster [DBG] pgmap v11379: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:56:36.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:56:35 smithi047 bash[22744]: cluster 2024-09-16T11:56:34.029496+0000 mgr.a (mgr.14373) 16405 : cluster [DBG] pgmap v11379: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:56:36.102 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:56:36.102 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:56:36.102 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:56:36.102 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:56:36.102 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:56:38.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:56:37 smithi157 bash[24585]: audit 2024-09-16T11:56:35.660384+0000 mgr.a (mgr.14373) 16406 : audit [DBG] from='client.353487 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:56:38.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:56:37 smithi157 bash[24585]: cluster 2024-09-16T11:56:36.030063+0000 mgr.a (mgr.14373) 16407 : cluster [DBG] pgmap v11380: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:56:38.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:56:37 smithi086 bash[24289]: audit 2024-09-16T11:56:35.660384+0000 mgr.a (mgr.14373) 16406 : audit [DBG] from='client.353487 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:56:38.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:56:37 smithi086 bash[24289]: cluster 2024-09-16T11:56:36.030063+0000 mgr.a (mgr.14373) 16407 : cluster [DBG] pgmap v11380: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:56:38.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:56:37 smithi047 bash[22744]: audit 2024-09-16T11:56:35.660384+0000 mgr.a (mgr.14373) 16406 : audit [DBG] from='client.353487 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:56:38.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:56:37 smithi047 bash[22744]: cluster 2024-09-16T11:56:36.030063+0000 mgr.a (mgr.14373) 16407 : cluster [DBG] pgmap v11380: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:56:40.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:56:39 smithi157 bash[24585]: cluster 2024-09-16T11:56:38.032321+0000 mgr.a (mgr.14373) 16408 : cluster [DBG] pgmap v11381: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:56:40.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:56:39 smithi086 bash[24289]: cluster 2024-09-16T11:56:38.032321+0000 mgr.a (mgr.14373) 16408 : cluster [DBG] pgmap v11381: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:56:40.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:56:39 smithi047 bash[22744]: cluster 2024-09-16T11:56:38.032321+0000 mgr.a (mgr.14373) 16408 : cluster [DBG] pgmap v11381: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:56:41.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:56:40 smithi157 bash[24585]: audit 2024-09-16T11:56:40.280216+0000 mon.b (mon.2) 1490 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T11:56:41.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:56:40 smithi086 bash[24289]: audit 2024-09-16T11:56:40.280216+0000 mon.b (mon.2) 1490 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T11:56:41.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:56:40 smithi047 bash[22744]: audit 2024-09-16T11:56:40.280216+0000 mon.b (mon.2) 1490 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T11:56:41.103 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:56:41.104 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:56:41.104 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:56:41.888 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:56:41 smithi047 bash[22744]: cluster 2024-09-16T11:56:40.033105+0000 mgr.a (mgr.14373) 16409 : cluster [DBG] pgmap v11382: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:56:41.888 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:56:41 smithi047 bash[22744]: audit 2024-09-16T11:56:41.124473+0000 mon.b (mon.2) 1491 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T11:56:41.888 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:56:41 smithi047 bash[22744]: audit 2024-09-16T11:56:41.126166+0000 mon.b (mon.2) 1492 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T11:56:41.888 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:56:41 smithi047 bash[22744]: audit 2024-09-16T11:56:41.135446+0000 mon.a (mon.0) 1546 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:56:41.888 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:56:41 smithi047 bash[22744]: audit 2024-09-16T11:56:41.143557+0000 mon.b (mon.2) 1493 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:56:42.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:56:41 smithi157 bash[24585]: cluster 2024-09-16T11:56:40.033105+0000 mgr.a (mgr.14373) 16409 : cluster [DBG] pgmap v11382: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:56:42.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:56:41 smithi157 bash[24585]: audit 2024-09-16T11:56:41.124473+0000 mon.b (mon.2) 1491 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T11:56:42.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:56:41 smithi157 bash[24585]: audit 2024-09-16T11:56:41.126166+0000 mon.b (mon.2) 1492 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T11:56:42.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:56:41 smithi157 bash[24585]: audit 2024-09-16T11:56:41.135446+0000 mon.a (mon.0) 1546 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:56:42.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:56:41 smithi157 bash[24585]: audit 2024-09-16T11:56:41.143557+0000 mon.b (mon.2) 1493 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:56:42.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:56:41 smithi086 bash[24289]: cluster 2024-09-16T11:56:40.033105+0000 mgr.a (mgr.14373) 16409 : cluster [DBG] pgmap v11382: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:56:42.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:56:41 smithi086 bash[24289]: audit 2024-09-16T11:56:41.124473+0000 mon.b (mon.2) 1491 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T11:56:42.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:56:41 smithi086 bash[24289]: audit 2024-09-16T11:56:41.126166+0000 mon.b (mon.2) 1492 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T11:56:42.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:56:41 smithi086 bash[24289]: audit 2024-09-16T11:56:41.135446+0000 mon.a (mon.0) 1546 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:56:42.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:56:41 smithi086 bash[24289]: audit 2024-09-16T11:56:41.143557+0000 mon.b (mon.2) 1493 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:56:42.299 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:56:42.300 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:56:42.300 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:56:42.300 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:56:42.300 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:56:42.342 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 11:56:41 smithi047 bash[22994]: debug 2024-09-16T11:56:41.881+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T11:56:42.342 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 11:56:41 smithi047 bash[22994]: debug 2024-09-16T11:56:41.897+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T11:56:43.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:56:42 smithi157 bash[24585]: audit 2024-09-16T11:56:41.145240+0000 mgr.a (mgr.14373) 16410 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:56:43.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:56:42 smithi157 bash[24585]: audit 2024-09-16T11:56:41.454197+0000 mgr.a (mgr.14373) 16411 : audit [DBG] from='client.353568 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:56:43.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:56:42 smithi086 bash[24289]: audit 2024-09-16T11:56:41.145240+0000 mgr.a (mgr.14373) 16410 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:56:43.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:56:42 smithi086 bash[24289]: audit 2024-09-16T11:56:41.454197+0000 mgr.a (mgr.14373) 16411 : audit [DBG] from='client.353568 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:56:43.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:56:42 smithi047 bash[22744]: audit 2024-09-16T11:56:41.145240+0000 mgr.a (mgr.14373) 16410 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:56:43.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:56:42 smithi047 bash[22744]: audit 2024-09-16T11:56:41.454197+0000 mgr.a (mgr.14373) 16411 : audit [DBG] from='client.353568 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:56:44.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:56:43 smithi157 bash[24585]: audit 2024-09-16T11:56:41.886275+0000 mgr.a (mgr.14373) 16412 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T11:56:44.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:56:43 smithi157 bash[24585]: cephadm 2024-09-16T11:56:41.901463+0000 mgr.a (mgr.14373) 16413 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T11:56:44.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:56:43 smithi157 bash[24585]: cluster 2024-09-16T11:56:42.034508+0000 mgr.a (mgr.14373) 16414 : cluster [DBG] pgmap v11383: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 3.4 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-16T11:56:44.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:56:43 smithi086 bash[24289]: audit 2024-09-16T11:56:41.886275+0000 mgr.a (mgr.14373) 16412 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T11:56:44.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:56:43 smithi086 bash[24289]: cephadm 2024-09-16T11:56:41.901463+0000 mgr.a (mgr.14373) 16413 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T11:56:44.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:56:43 smithi086 bash[24289]: cluster 2024-09-16T11:56:42.034508+0000 mgr.a (mgr.14373) 16414 : cluster [DBG] pgmap v11383: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 3.4 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-16T11:56:44.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:56:43 smithi047 bash[22744]: audit 2024-09-16T11:56:41.886275+0000 mgr.a (mgr.14373) 16412 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T11:56:44.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:56:43 smithi047 bash[22744]: cephadm 2024-09-16T11:56:41.901463+0000 mgr.a (mgr.14373) 16413 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T11:56:44.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:56:43 smithi047 bash[22744]: cluster 2024-09-16T11:56:42.034508+0000 mgr.a (mgr.14373) 16414 : cluster [DBG] pgmap v11383: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 3.4 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-16T11:56:46.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:56:45 smithi157 bash[24585]: cluster 2024-09-16T11:56:44.035337+0000 mgr.a (mgr.14373) 16415 : cluster [DBG] pgmap v11384: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-16T11:56:46.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:56:45 smithi086 bash[24289]: cluster 2024-09-16T11:56:44.035337+0000 mgr.a (mgr.14373) 16415 : cluster [DBG] pgmap v11384: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-16T11:56:46.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:56:45 smithi047 bash[22744]: cluster 2024-09-16T11:56:44.035337+0000 mgr.a (mgr.14373) 16415 : cluster [DBG] pgmap v11384: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-16T11:56:47.301 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:56:47.302 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:56:47.302 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:56:48.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:56:47 smithi157 bash[24585]: cluster 2024-09-16T11:56:46.036099+0000 mgr.a (mgr.14373) 16416 : cluster [DBG] pgmap v11385: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-16T11:56:48.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:56:47 smithi086 bash[24289]: cluster 2024-09-16T11:56:46.036099+0000 mgr.a (mgr.14373) 16416 : cluster [DBG] pgmap v11385: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-16T11:56:48.078 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:56:48.078 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:56:48.079 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:56:48.079 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:56:48.079 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:56:48.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:56:47 smithi047 bash[22744]: cluster 2024-09-16T11:56:46.036099+0000 mgr.a (mgr.14373) 16416 : cluster [DBG] pgmap v11385: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-16T11:56:49.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:56:48 smithi157 bash[24585]: audit 2024-09-16T11:56:47.635267+0000 mgr.a (mgr.14373) 16417 : audit [DBG] from='client.353748 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:56:49.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:56:48 smithi086 bash[24289]: audit 2024-09-16T11:56:47.635267+0000 mgr.a (mgr.14373) 16417 : audit [DBG] from='client.353748 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:56:49.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:56:48 smithi047 bash[22744]: audit 2024-09-16T11:56:47.635267+0000 mgr.a (mgr.14373) 16417 : audit [DBG] from='client.353748 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:56:50.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:56:49 smithi157 bash[24585]: cluster 2024-09-16T11:56:48.037668+0000 mgr.a (mgr.14373) 16418 : cluster [DBG] pgmap v11386: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:56:50.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:56:49 smithi086 bash[24289]: cluster 2024-09-16T11:56:48.037668+0000 mgr.a (mgr.14373) 16418 : cluster [DBG] pgmap v11386: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:56:50.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:56:49 smithi047 bash[22744]: cluster 2024-09-16T11:56:48.037668+0000 mgr.a (mgr.14373) 16418 : cluster [DBG] pgmap v11386: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:56:51.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:56:50 smithi157 bash[24585]: cluster 2024-09-16T11:56:50.038464+0000 mgr.a (mgr.14373) 16419 : cluster [DBG] pgmap v11387: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T11:56:51.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:56:50 smithi086 bash[24289]: cluster 2024-09-16T11:56:50.038464+0000 mgr.a (mgr.14373) 16419 : cluster [DBG] pgmap v11387: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T11:56:51.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:56:50 smithi047 bash[22744]: cluster 2024-09-16T11:56:50.038464+0000 mgr.a (mgr.14373) 16419 : cluster [DBG] pgmap v11387: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T11:56:53.080 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:56:53.081 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:56:53.081 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:56:53.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:56:53 smithi157 bash[24585]: cluster 2024-09-16T11:56:52.040449+0000 mgr.a (mgr.14373) 16420 : cluster [DBG] pgmap v11388: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:56:53.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:56:53 smithi086 bash[24289]: cluster 2024-09-16T11:56:52.040449+0000 mgr.a (mgr.14373) 16420 : cluster [DBG] pgmap v11388: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:56:53.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:56:53 smithi047 bash[22744]: cluster 2024-09-16T11:56:52.040449+0000 mgr.a (mgr.14373) 16420 : cluster [DBG] pgmap v11388: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:56:53.879 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:56:53.880 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:56:53.880 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:56:53.880 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:56:53.880 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:56:54.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:56:54 smithi157 bash[24585]: audit 2024-09-16T11:56:53.426539+0000 mgr.a (mgr.14373) 16421 : audit [DBG] from='client.353823 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:56:54.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:56:54 smithi086 bash[24289]: audit 2024-09-16T11:56:53.426539+0000 mgr.a (mgr.14373) 16421 : audit [DBG] from='client.353823 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:56:54.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:56:54 smithi047 bash[22744]: audit 2024-09-16T11:56:53.426539+0000 mgr.a (mgr.14373) 16421 : audit [DBG] from='client.353823 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:56:55.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:56:55 smithi157 bash[24585]: cluster 2024-09-16T11:56:54.041613+0000 mgr.a (mgr.14373) 16422 : cluster [DBG] pgmap v11389: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 5.4 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-16T11:56:55.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:56:55 smithi086 bash[24289]: cluster 2024-09-16T11:56:54.041613+0000 mgr.a (mgr.14373) 16422 : cluster [DBG] pgmap v11389: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 5.4 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-16T11:56:55.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:56:55 smithi047 bash[22744]: cluster 2024-09-16T11:56:54.041613+0000 mgr.a (mgr.14373) 16422 : cluster [DBG] pgmap v11389: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 5.4 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-16T11:56:57.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:56:57 smithi157 bash[24585]: cluster 2024-09-16T11:56:56.042628+0000 mgr.a (mgr.14373) 16423 : cluster [DBG] pgmap v11390: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 5.4 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-16T11:56:57.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:56:57 smithi086 bash[24289]: cluster 2024-09-16T11:56:56.042628+0000 mgr.a (mgr.14373) 16423 : cluster [DBG] pgmap v11390: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 5.4 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-16T11:56:57.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:56:57 smithi047 bash[22744]: cluster 2024-09-16T11:56:56.042628+0000 mgr.a (mgr.14373) 16423 : cluster [DBG] pgmap v11390: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 5.4 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-16T11:56:58.881 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:56:58.897 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:56:58.897 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:56:59.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:56:59 smithi157 bash[24585]: cluster 2024-09-16T11:56:58.045018+0000 mgr.a (mgr.14373) 16424 : cluster [DBG] pgmap v11391: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-16T11:56:59.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:56:59 smithi086 bash[24289]: cluster 2024-09-16T11:56:58.045018+0000 mgr.a (mgr.14373) 16424 : cluster [DBG] pgmap v11391: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-16T11:56:59.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:56:59 smithi047 bash[22744]: cluster 2024-09-16T11:56:58.045018+0000 mgr.a (mgr.14373) 16424 : cluster [DBG] pgmap v11391: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-16T11:56:59.655 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:56:59.656 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:56:59.656 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:56:59.656 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:56:59.656 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:57:00.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:57:00 smithi157 bash[24585]: audit 2024-09-16T11:56:59.218699+0000 mgr.a (mgr.14373) 16425 : audit [DBG] from='client.353901 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:57:00.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:57:00 smithi086 bash[24289]: audit 2024-09-16T11:56:59.218699+0000 mgr.a (mgr.14373) 16425 : audit [DBG] from='client.353901 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:57:00.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:57:00 smithi047 bash[22744]: audit 2024-09-16T11:56:59.218699+0000 mgr.a (mgr.14373) 16425 : audit [DBG] from='client.353901 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:57:01.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:57:01 smithi157 bash[24585]: cluster 2024-09-16T11:57:00.046096+0000 mgr.a (mgr.14373) 16426 : cluster [DBG] pgmap v11392: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:57:01.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:57:01 smithi086 bash[24289]: cluster 2024-09-16T11:57:00.046096+0000 mgr.a (mgr.14373) 16426 : cluster [DBG] pgmap v11392: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:57:01.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:57:01 smithi047 bash[22744]: cluster 2024-09-16T11:57:00.046096+0000 mgr.a (mgr.14373) 16426 : cluster [DBG] pgmap v11392: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:57:03.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:57:02 smithi157 bash[24585]: cluster 2024-09-16T11:57:02.048566+0000 mgr.a (mgr.14373) 16427 : cluster [DBG] pgmap v11393: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:57:03.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:57:02 smithi086 bash[24289]: cluster 2024-09-16T11:57:02.048566+0000 mgr.a (mgr.14373) 16427 : cluster [DBG] pgmap v11393: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:57:03.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:57:02 smithi047 bash[22744]: cluster 2024-09-16T11:57:02.048566+0000 mgr.a (mgr.14373) 16427 : cluster [DBG] pgmap v11393: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:57:04.657 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:57:04.658 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:57:04.658 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:57:05.439 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:57:05.439 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:57:05.439 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:57:05.439 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:57:05.439 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:57:05.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:57:05 smithi157 bash[24585]: cluster 2024-09-16T11:57:04.049507+0000 mgr.a (mgr.14373) 16428 : cluster [DBG] pgmap v11394: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:57:05.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:57:05 smithi086 bash[24289]: cluster 2024-09-16T11:57:04.049507+0000 mgr.a (mgr.14373) 16428 : cluster [DBG] pgmap v11394: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:57:05.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:57:05 smithi047 bash[22744]: cluster 2024-09-16T11:57:04.049507+0000 mgr.a (mgr.14373) 16428 : cluster [DBG] pgmap v11394: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:57:06.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:57:06 smithi157 bash[24585]: audit 2024-09-16T11:57:04.993595+0000 mgr.a (mgr.14373) 16429 : audit [DBG] from='client.353976 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:57:06.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:57:06 smithi086 bash[24289]: audit 2024-09-16T11:57:04.993595+0000 mgr.a (mgr.14373) 16429 : audit [DBG] from='client.353976 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:57:06.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:57:06 smithi047 bash[22744]: audit 2024-09-16T11:57:04.993595+0000 mgr.a (mgr.14373) 16429 : audit [DBG] from='client.353976 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:57:07.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:57:07 smithi157 bash[24585]: cluster 2024-09-16T11:57:06.050645+0000 mgr.a (mgr.14373) 16430 : cluster [DBG] pgmap v11395: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:57:07.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:57:07 smithi086 bash[24289]: cluster 2024-09-16T11:57:06.050645+0000 mgr.a (mgr.14373) 16430 : cluster [DBG] pgmap v11395: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:57:07.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:57:07 smithi047 bash[22744]: cluster 2024-09-16T11:57:06.050645+0000 mgr.a (mgr.14373) 16430 : cluster [DBG] pgmap v11395: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:57:09.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:57:09 smithi157 bash[24585]: cluster 2024-09-16T11:57:08.053087+0000 mgr.a (mgr.14373) 16431 : cluster [DBG] pgmap v11396: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:57:09.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:57:09 smithi086 bash[24289]: cluster 2024-09-16T11:57:08.053087+0000 mgr.a (mgr.14373) 16431 : cluster [DBG] pgmap v11396: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:57:09.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:57:09 smithi047 bash[22744]: cluster 2024-09-16T11:57:08.053087+0000 mgr.a (mgr.14373) 16431 : cluster [DBG] pgmap v11396: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:57:10.440 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:57:10.441 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:57:10.441 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:57:11.206 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:57:11.206 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:57:11.206 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:57:11.206 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:57:11.206 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:57:11.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:57:11 smithi157 bash[24585]: cluster 2024-09-16T11:57:10.054029+0000 mgr.a (mgr.14373) 16432 : cluster [DBG] pgmap v11397: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:57:11.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:57:11 smithi086 bash[24289]: cluster 2024-09-16T11:57:10.054029+0000 mgr.a (mgr.14373) 16432 : cluster [DBG] pgmap v11397: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:57:11.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:57:11 smithi047 bash[22744]: cluster 2024-09-16T11:57:10.054029+0000 mgr.a (mgr.14373) 16432 : cluster [DBG] pgmap v11397: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:57:12.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:57:12 smithi157 bash[24585]: audit 2024-09-16T11:57:10.774894+0000 mgr.a (mgr.14373) 16433 : audit [DBG] from='client.354051 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:57:12.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:57:12 smithi086 bash[24289]: audit 2024-09-16T11:57:10.774894+0000 mgr.a (mgr.14373) 16433 : audit [DBG] from='client.354051 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:57:12.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:57:12 smithi047 bash[22744]: audit 2024-09-16T11:57:10.774894+0000 mgr.a (mgr.14373) 16433 : audit [DBG] from='client.354051 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:57:13.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:57:13 smithi157 bash[24585]: cluster 2024-09-16T11:57:12.056357+0000 mgr.a (mgr.14373) 16434 : cluster [DBG] pgmap v11398: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:57:13.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:57:13 smithi086 bash[24289]: cluster 2024-09-16T11:57:12.056357+0000 mgr.a (mgr.14373) 16434 : cluster [DBG] pgmap v11398: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:57:13.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:57:13 smithi047 bash[22744]: cluster 2024-09-16T11:57:12.056357+0000 mgr.a (mgr.14373) 16434 : cluster [DBG] pgmap v11398: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:57:15.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:57:15 smithi157 bash[24585]: cluster 2024-09-16T11:57:14.057152+0000 mgr.a (mgr.14373) 16435 : cluster [DBG] pgmap v11399: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:57:15.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:57:15 smithi086 bash[24289]: cluster 2024-09-16T11:57:14.057152+0000 mgr.a (mgr.14373) 16435 : cluster [DBG] pgmap v11399: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:57:15.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:57:15 smithi047 bash[22744]: cluster 2024-09-16T11:57:14.057152+0000 mgr.a (mgr.14373) 16435 : cluster [DBG] pgmap v11399: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:57:16.207 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:57:16.208 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:57:16.208 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:57:16.996 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:57:16.997 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:57:16.997 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:57:16.997 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:57:16.997 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:57:17.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:57:17 smithi157 bash[24585]: cluster 2024-09-16T11:57:16.057951+0000 mgr.a (mgr.14373) 16436 : cluster [DBG] pgmap v11400: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:57:17.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:57:17 smithi157 bash[24585]: audit 2024-09-16T11:57:16.542895+0000 mgr.a (mgr.14373) 16437 : audit [DBG] from='client.354129 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:57:17.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:57:17 smithi086 bash[24289]: cluster 2024-09-16T11:57:16.057951+0000 mgr.a (mgr.14373) 16436 : cluster [DBG] pgmap v11400: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:57:17.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:57:17 smithi086 bash[24289]: audit 2024-09-16T11:57:16.542895+0000 mgr.a (mgr.14373) 16437 : audit [DBG] from='client.354129 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:57:17.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:57:17 smithi047 bash[22744]: cluster 2024-09-16T11:57:16.057951+0000 mgr.a (mgr.14373) 16436 : cluster [DBG] pgmap v11400: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:57:17.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:57:17 smithi047 bash[22744]: audit 2024-09-16T11:57:16.542895+0000 mgr.a (mgr.14373) 16437 : audit [DBG] from='client.354129 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:57:19.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:57:19 smithi157 bash[24585]: cluster 2024-09-16T11:57:18.060597+0000 mgr.a (mgr.14373) 16438 : cluster [DBG] pgmap v11401: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:57:19.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:57:19 smithi086 bash[24289]: cluster 2024-09-16T11:57:18.060597+0000 mgr.a (mgr.14373) 16438 : cluster [DBG] pgmap v11401: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:57:19.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:57:19 smithi047 bash[22744]: cluster 2024-09-16T11:57:18.060597+0000 mgr.a (mgr.14373) 16438 : cluster [DBG] pgmap v11401: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:57:21.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:57:21 smithi157 bash[24585]: cluster 2024-09-16T11:57:20.061390+0000 mgr.a (mgr.14373) 16439 : cluster [DBG] pgmap v11402: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:57:21.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:57:21 smithi086 bash[24289]: cluster 2024-09-16T11:57:20.061390+0000 mgr.a (mgr.14373) 16439 : cluster [DBG] pgmap v11402: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:57:21.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:57:21 smithi047 bash[22744]: cluster 2024-09-16T11:57:20.061390+0000 mgr.a (mgr.14373) 16439 : cluster [DBG] pgmap v11402: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:57:21.998 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:57:21.999 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:57:21.999 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:57:22.744 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:57:22.744 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:57:22.744 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:57:22.744 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:57:22.745 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:57:23.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:57:23 smithi157 bash[24585]: cluster 2024-09-16T11:57:22.063421+0000 mgr.a (mgr.14373) 16440 : cluster [DBG] pgmap v11403: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:57:23.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:57:23 smithi157 bash[24585]: audit 2024-09-16T11:57:22.323706+0000 mgr.a (mgr.14373) 16441 : audit [DBG] from='client.354207 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:57:23.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:57:23 smithi086 bash[24289]: cluster 2024-09-16T11:57:22.063421+0000 mgr.a (mgr.14373) 16440 : cluster [DBG] pgmap v11403: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:57:23.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:57:23 smithi086 bash[24289]: audit 2024-09-16T11:57:22.323706+0000 mgr.a (mgr.14373) 16441 : audit [DBG] from='client.354207 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:57:23.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:57:23 smithi047 bash[22744]: cluster 2024-09-16T11:57:22.063421+0000 mgr.a (mgr.14373) 16440 : cluster [DBG] pgmap v11403: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:57:23.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:57:23 smithi047 bash[22744]: audit 2024-09-16T11:57:22.323706+0000 mgr.a (mgr.14373) 16441 : audit [DBG] from='client.354207 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:57:25.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:57:25 smithi157 bash[24585]: cluster 2024-09-16T11:57:24.064323+0000 mgr.a (mgr.14373) 16442 : cluster [DBG] pgmap v11404: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:57:25.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:57:25 smithi086 bash[24289]: cluster 2024-09-16T11:57:24.064323+0000 mgr.a (mgr.14373) 16442 : cluster [DBG] pgmap v11404: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:57:25.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:57:25 smithi047 bash[22744]: cluster 2024-09-16T11:57:24.064323+0000 mgr.a (mgr.14373) 16442 : cluster [DBG] pgmap v11404: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:57:27.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:57:27 smithi157 bash[24585]: cluster 2024-09-16T11:57:26.065100+0000 mgr.a (mgr.14373) 16443 : cluster [DBG] pgmap v11405: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T11:57:27.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:57:27 smithi086 bash[24289]: cluster 2024-09-16T11:57:26.065100+0000 mgr.a (mgr.14373) 16443 : cluster [DBG] pgmap v11405: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T11:57:27.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:57:27 smithi047 bash[22744]: cluster 2024-09-16T11:57:26.065100+0000 mgr.a (mgr.14373) 16443 : cluster [DBG] pgmap v11405: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T11:57:27.745 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:57:27.746 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:57:27.746 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:57:28.497 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:57:28.497 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:57:28.497 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:57:28.497 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:57:28.498 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:57:29.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:57:29 smithi157 bash[24585]: cluster 2024-09-16T11:57:28.067224+0000 mgr.a (mgr.14373) 16444 : cluster [DBG] pgmap v11406: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:57:29.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:57:29 smithi157 bash[24585]: audit 2024-09-16T11:57:28.077987+0000 mgr.a (mgr.14373) 16445 : audit [DBG] from='client.354285 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:57:29.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:57:29 smithi086 bash[24289]: cluster 2024-09-16T11:57:28.067224+0000 mgr.a (mgr.14373) 16444 : cluster [DBG] pgmap v11406: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:57:29.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:57:29 smithi086 bash[24289]: audit 2024-09-16T11:57:28.077987+0000 mgr.a (mgr.14373) 16445 : audit [DBG] from='client.354285 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:57:29.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:57:29 smithi047 bash[22744]: cluster 2024-09-16T11:57:28.067224+0000 mgr.a (mgr.14373) 16444 : cluster [DBG] pgmap v11406: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:57:29.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:57:29 smithi047 bash[22744]: audit 2024-09-16T11:57:28.077987+0000 mgr.a (mgr.14373) 16445 : audit [DBG] from='client.354285 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:57:31.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:57:31 smithi157 bash[24585]: cluster 2024-09-16T11:57:30.068104+0000 mgr.a (mgr.14373) 16446 : cluster [DBG] pgmap v11407: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:57:31.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:57:31 smithi086 bash[24289]: cluster 2024-09-16T11:57:30.068104+0000 mgr.a (mgr.14373) 16446 : cluster [DBG] pgmap v11407: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:57:31.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:57:31 smithi047 bash[22744]: cluster 2024-09-16T11:57:30.068104+0000 mgr.a (mgr.14373) 16446 : cluster [DBG] pgmap v11407: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:57:33.499 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:57:33.500 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:57:33.500 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:57:33.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:57:33 smithi157 bash[24585]: cluster 2024-09-16T11:57:32.070222+0000 mgr.a (mgr.14373) 16447 : cluster [DBG] pgmap v11408: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:57:33.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:57:33 smithi086 bash[24289]: cluster 2024-09-16T11:57:32.070222+0000 mgr.a (mgr.14373) 16447 : cluster [DBG] pgmap v11408: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:57:33.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:57:33 smithi047 bash[22744]: cluster 2024-09-16T11:57:32.070222+0000 mgr.a (mgr.14373) 16447 : cluster [DBG] pgmap v11408: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:57:34.281 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:57:34.281 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:57:34.281 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:57:34.281 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:57:34.281 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:57:35.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:57:35 smithi157 bash[24585]: audit 2024-09-16T11:57:33.834940+0000 mgr.a (mgr.14373) 16448 : audit [DBG] from='client.354363 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:57:35.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:57:35 smithi157 bash[24585]: cluster 2024-09-16T11:57:34.079863+0000 mgr.a (mgr.14373) 16449 : cluster [DBG] pgmap v11409: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:57:35.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:57:35 smithi086 bash[24289]: audit 2024-09-16T11:57:33.834940+0000 mgr.a (mgr.14373) 16448 : audit [DBG] from='client.354363 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:57:35.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:57:35 smithi086 bash[24289]: cluster 2024-09-16T11:57:34.079863+0000 mgr.a (mgr.14373) 16449 : cluster [DBG] pgmap v11409: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:57:35.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:57:35 smithi047 bash[22744]: audit 2024-09-16T11:57:33.834940+0000 mgr.a (mgr.14373) 16448 : audit [DBG] from='client.354363 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:57:35.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:57:35 smithi047 bash[22744]: cluster 2024-09-16T11:57:34.079863+0000 mgr.a (mgr.14373) 16449 : cluster [DBG] pgmap v11409: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:57:37.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:57:37 smithi157 bash[24585]: cluster 2024-09-16T11:57:36.080768+0000 mgr.a (mgr.14373) 16450 : cluster [DBG] pgmap v11410: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:57:37.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:57:37 smithi086 bash[24289]: cluster 2024-09-16T11:57:36.080768+0000 mgr.a (mgr.14373) 16450 : cluster [DBG] pgmap v11410: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:57:37.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:57:37 smithi047 bash[22744]: cluster 2024-09-16T11:57:36.080768+0000 mgr.a (mgr.14373) 16450 : cluster [DBG] pgmap v11410: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:57:39.282 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:57:39.283 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:57:39.283 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:57:39.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:57:39 smithi157 bash[24585]: cluster 2024-09-16T11:57:38.083015+0000 mgr.a (mgr.14373) 16451 : cluster [DBG] pgmap v11411: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:57:39.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:57:39 smithi086 bash[24289]: cluster 2024-09-16T11:57:38.083015+0000 mgr.a (mgr.14373) 16451 : cluster [DBG] pgmap v11411: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:57:39.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:57:39 smithi047 bash[22744]: cluster 2024-09-16T11:57:38.083015+0000 mgr.a (mgr.14373) 16451 : cluster [DBG] pgmap v11411: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:57:40.053 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:57:40.053 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:57:40.053 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:57:40.054 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:57:40.054 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:57:40.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:57:40 smithi157 bash[24585]: audit 2024-09-16T11:57:39.622300+0000 mgr.a (mgr.14373) 16452 : audit [DBG] from='client.354438 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:57:40.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:57:40 smithi086 bash[24289]: audit 2024-09-16T11:57:39.622300+0000 mgr.a (mgr.14373) 16452 : audit [DBG] from='client.354438 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:57:40.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:57:40 smithi047 bash[22744]: audit 2024-09-16T11:57:39.622300+0000 mgr.a (mgr.14373) 16452 : audit [DBG] from='client.354438 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:57:41.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:57:41 smithi157 bash[24585]: cluster 2024-09-16T11:57:40.083880+0000 mgr.a (mgr.14373) 16453 : cluster [DBG] pgmap v11412: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:57:41.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:57:41 smithi086 bash[24289]: cluster 2024-09-16T11:57:40.083880+0000 mgr.a (mgr.14373) 16453 : cluster [DBG] pgmap v11412: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:57:41.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:57:41 smithi047 bash[22744]: cluster 2024-09-16T11:57:40.083880+0000 mgr.a (mgr.14373) 16453 : cluster [DBG] pgmap v11412: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:57:42.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:57:42 smithi157 bash[24585]: audit 2024-09-16T11:57:41.962396+0000 mon.b (mon.2) 1494 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T11:57:42.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:57:42 smithi086 bash[24289]: audit 2024-09-16T11:57:41.962396+0000 mon.b (mon.2) 1494 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T11:57:42.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:57:42 smithi047 bash[22744]: audit 2024-09-16T11:57:41.962396+0000 mon.b (mon.2) 1494 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T11:57:43.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:57:43 smithi157 bash[24585]: cluster 2024-09-16T11:57:42.086124+0000 mgr.a (mgr.14373) 16454 : cluster [DBG] pgmap v11413: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:57:43.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:57:43 smithi086 bash[24289]: cluster 2024-09-16T11:57:42.086124+0000 mgr.a (mgr.14373) 16454 : cluster [DBG] pgmap v11413: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:57:43.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:57:43 smithi047 bash[22744]: cluster 2024-09-16T11:57:42.086124+0000 mgr.a (mgr.14373) 16454 : cluster [DBG] pgmap v11413: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:57:45.055 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:57:45.056 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:57:45.056 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:57:45.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:57:45 smithi157 bash[24585]: cluster 2024-09-16T11:57:44.086919+0000 mgr.a (mgr.14373) 16455 : cluster [DBG] pgmap v11414: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:57:45.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:57:45 smithi086 bash[24289]: cluster 2024-09-16T11:57:44.086919+0000 mgr.a (mgr.14373) 16455 : cluster [DBG] pgmap v11414: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:57:45.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:57:45 smithi047 bash[22744]: cluster 2024-09-16T11:57:44.086919+0000 mgr.a (mgr.14373) 16455 : cluster [DBG] pgmap v11414: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:57:45.789 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:57:45.790 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:57:45.790 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:57:45.790 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:57:45.790 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:57:46.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:57:46 smithi157 bash[24585]: audit 2024-09-16T11:57:45.369613+0000 mgr.a (mgr.14373) 16456 : audit [DBG] from='client.354513 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:57:46.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:57:46 smithi086 bash[24289]: audit 2024-09-16T11:57:45.369613+0000 mgr.a (mgr.14373) 16456 : audit [DBG] from='client.354513 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:57:46.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:57:46 smithi047 bash[22744]: audit 2024-09-16T11:57:45.369613+0000 mgr.a (mgr.14373) 16456 : audit [DBG] from='client.354513 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:57:47.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:57:47 smithi157 bash[24585]: cluster 2024-09-16T11:57:46.087863+0000 mgr.a (mgr.14373) 16457 : cluster [DBG] pgmap v11415: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:57:47.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:57:47 smithi086 bash[24289]: cluster 2024-09-16T11:57:46.087863+0000 mgr.a (mgr.14373) 16457 : cluster [DBG] pgmap v11415: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:57:47.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:57:47 smithi047 bash[22744]: cluster 2024-09-16T11:57:46.087863+0000 mgr.a (mgr.14373) 16457 : cluster [DBG] pgmap v11415: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:57:48.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:57:48 smithi047 bash[22744]: audit 2024-09-16T11:57:47.315825+0000 mon.a (mon.0) 1547 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:57:48.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:57:48 smithi047 bash[22744]: audit 2024-09-16T11:57:47.322395+0000 mon.a (mon.0) 1548 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:57:48.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:57:48 smithi047 bash[22744]: audit 2024-09-16T11:57:47.335733+0000 mon.a (mon.0) 1549 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:57:48.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:57:48 smithi047 bash[22744]: audit 2024-09-16T11:57:47.340395+0000 mon.a (mon.0) 1550 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:57:48.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:57:48 smithi047 bash[22744]: audit 2024-09-16T11:57:47.345701+0000 mon.a (mon.0) 1551 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:57:48.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:57:48 smithi047 bash[22744]: audit 2024-09-16T11:57:47.351063+0000 mon.a (mon.0) 1552 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:57:48.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:57:48 smithi047 bash[22744]: audit 2024-09-16T11:57:48.059397+0000 mon.b (mon.2) 1495 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T11:57:48.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:57:48 smithi047 bash[22744]: audit 2024-09-16T11:57:48.061717+0000 mon.b (mon.2) 1496 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T11:57:48.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:57:48 smithi047 bash[22744]: audit 2024-09-16T11:57:48.073473+0000 mon.a (mon.0) 1553 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:57:48.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:57:48 smithi047 bash[22744]: audit 2024-09-16T11:57:48.081296+0000 mon.b (mon.2) 1497 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:57:48.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:57:48 smithi157 bash[24585]: audit 2024-09-16T11:57:47.315825+0000 mon.a (mon.0) 1547 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:57:48.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:57:48 smithi157 bash[24585]: audit 2024-09-16T11:57:47.322395+0000 mon.a (mon.0) 1548 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:57:48.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:57:48 smithi157 bash[24585]: audit 2024-09-16T11:57:47.335733+0000 mon.a (mon.0) 1549 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:57:48.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:57:48 smithi157 bash[24585]: audit 2024-09-16T11:57:47.340395+0000 mon.a (mon.0) 1550 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:57:48.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:57:48 smithi157 bash[24585]: audit 2024-09-16T11:57:47.345701+0000 mon.a (mon.0) 1551 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:57:48.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:57:48 smithi157 bash[24585]: audit 2024-09-16T11:57:47.351063+0000 mon.a (mon.0) 1552 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:57:48.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:57:48 smithi157 bash[24585]: audit 2024-09-16T11:57:48.059397+0000 mon.b (mon.2) 1495 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T11:57:48.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:57:48 smithi157 bash[24585]: audit 2024-09-16T11:57:48.061717+0000 mon.b (mon.2) 1496 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T11:57:48.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:57:48 smithi157 bash[24585]: audit 2024-09-16T11:57:48.073473+0000 mon.a (mon.0) 1553 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:57:48.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:57:48 smithi157 bash[24585]: audit 2024-09-16T11:57:48.081296+0000 mon.b (mon.2) 1497 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:57:48.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:57:48 smithi086 bash[24289]: audit 2024-09-16T11:57:47.315825+0000 mon.a (mon.0) 1547 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:57:48.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:57:48 smithi086 bash[24289]: audit 2024-09-16T11:57:47.322395+0000 mon.a (mon.0) 1548 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:57:48.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:57:48 smithi086 bash[24289]: audit 2024-09-16T11:57:47.335733+0000 mon.a (mon.0) 1549 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:57:48.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:57:48 smithi086 bash[24289]: audit 2024-09-16T11:57:47.340395+0000 mon.a (mon.0) 1550 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:57:48.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:57:48 smithi086 bash[24289]: audit 2024-09-16T11:57:47.345701+0000 mon.a (mon.0) 1551 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:57:48.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:57:48 smithi086 bash[24289]: audit 2024-09-16T11:57:47.351063+0000 mon.a (mon.0) 1552 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:57:48.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:57:48 smithi086 bash[24289]: audit 2024-09-16T11:57:48.059397+0000 mon.b (mon.2) 1495 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T11:57:48.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:57:48 smithi086 bash[24289]: audit 2024-09-16T11:57:48.061717+0000 mon.b (mon.2) 1496 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T11:57:48.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:57:48 smithi086 bash[24289]: audit 2024-09-16T11:57:48.073473+0000 mon.a (mon.0) 1553 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:57:48.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:57:48 smithi086 bash[24289]: audit 2024-09-16T11:57:48.081296+0000 mon.b (mon.2) 1497 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:57:49.093 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 11:57:48 smithi047 bash[22994]: debug 2024-09-16T11:57:48.820+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T11:57:49.093 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 11:57:48 smithi047 bash[22994]: debug 2024-09-16T11:57:48.824+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T11:57:49.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:57:49 smithi086 bash[24289]: audit 2024-09-16T11:57:48.083792+0000 mgr.a (mgr.14373) 16458 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:57:49.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:57:49 smithi086 bash[24289]: cluster 2024-09-16T11:57:48.106815+0000 mgr.a (mgr.14373) 16459 : cluster [DBG] pgmap v11416: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:57:49.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:57:49 smithi047 bash[22744]: audit 2024-09-16T11:57:48.083792+0000 mgr.a (mgr.14373) 16458 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:57:49.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:57:49 smithi047 bash[22744]: cluster 2024-09-16T11:57:48.106815+0000 mgr.a (mgr.14373) 16459 : cluster [DBG] pgmap v11416: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:57:49.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:57:49 smithi157 bash[24585]: audit 2024-09-16T11:57:48.083792+0000 mgr.a (mgr.14373) 16458 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:57:49.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:57:49 smithi157 bash[24585]: cluster 2024-09-16T11:57:48.106815+0000 mgr.a (mgr.14373) 16459 : cluster [DBG] pgmap v11416: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:57:50.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:57:50 smithi047 bash[22744]: audit 2024-09-16T11:57:48.825785+0000 mgr.a (mgr.14373) 16460 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T11:57:50.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:57:50 smithi047 bash[22744]: cephadm 2024-09-16T11:57:48.827916+0000 mgr.a (mgr.14373) 16461 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T11:57:50.791 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:57:50.791 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:57:50.791 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:57:50.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:57:50 smithi157 bash[24585]: audit 2024-09-16T11:57:48.825785+0000 mgr.a (mgr.14373) 16460 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T11:57:50.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:57:50 smithi157 bash[24585]: cephadm 2024-09-16T11:57:48.827916+0000 mgr.a (mgr.14373) 16461 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T11:57:50.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:57:50 smithi086 bash[24289]: audit 2024-09-16T11:57:48.825785+0000 mgr.a (mgr.14373) 16460 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T11:57:50.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:57:50 smithi086 bash[24289]: cephadm 2024-09-16T11:57:48.827916+0000 mgr.a (mgr.14373) 16461 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T11:57:51.553 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:57:51.553 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:57:51.553 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:57:51.553 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:57:51.553 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:57:51.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:57:51 smithi047 bash[22744]: cluster 2024-09-16T11:57:50.107971+0000 mgr.a (mgr.14373) 16462 : cluster [DBG] pgmap v11417: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:57:51.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:57:51 smithi157 bash[24585]: cluster 2024-09-16T11:57:50.107971+0000 mgr.a (mgr.14373) 16462 : cluster [DBG] pgmap v11417: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:57:51.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:57:51 smithi086 bash[24289]: cluster 2024-09-16T11:57:50.107971+0000 mgr.a (mgr.14373) 16462 : cluster [DBG] pgmap v11417: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:57:52.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:57:52 smithi047 bash[22744]: audit 2024-09-16T11:57:51.123549+0000 mgr.a (mgr.14373) 16463 : audit [DBG] from='client.354693 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:57:52.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:57:52 smithi157 bash[24585]: audit 2024-09-16T11:57:51.123549+0000 mgr.a (mgr.14373) 16463 : audit [DBG] from='client.354693 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:57:52.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:57:52 smithi086 bash[24289]: audit 2024-09-16T11:57:51.123549+0000 mgr.a (mgr.14373) 16463 : audit [DBG] from='client.354693 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:57:53.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:57:53 smithi047 bash[22744]: cluster 2024-09-16T11:57:52.110464+0000 mgr.a (mgr.14373) 16464 : cluster [DBG] pgmap v11418: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 425 B/s wr, 7 op/s 2024-09-16T11:57:53.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:57:53 smithi157 bash[24585]: cluster 2024-09-16T11:57:52.110464+0000 mgr.a (mgr.14373) 16464 : cluster [DBG] pgmap v11418: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 425 B/s wr, 7 op/s 2024-09-16T11:57:53.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:57:53 smithi086 bash[24289]: cluster 2024-09-16T11:57:52.110464+0000 mgr.a (mgr.14373) 16464 : cluster [DBG] pgmap v11418: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 425 B/s wr, 7 op/s 2024-09-16T11:57:55.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:57:55 smithi157 bash[24585]: cluster 2024-09-16T11:57:54.111231+0000 mgr.a (mgr.14373) 16465 : cluster [DBG] pgmap v11419: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 425 B/s wr, 6 op/s 2024-09-16T11:57:55.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:57:55 smithi086 bash[24289]: cluster 2024-09-16T11:57:54.111231+0000 mgr.a (mgr.14373) 16465 : cluster [DBG] pgmap v11419: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 425 B/s wr, 6 op/s 2024-09-16T11:57:55.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:57:55 smithi047 bash[22744]: cluster 2024-09-16T11:57:54.111231+0000 mgr.a (mgr.14373) 16465 : cluster [DBG] pgmap v11419: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 425 B/s wr, 6 op/s 2024-09-16T11:57:56.554 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:57:56.555 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:57:56.555 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:57:57.332 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:57:57.332 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:57:57.332 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:57:57.332 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:57:57.333 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:57:57.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:57:57 smithi157 bash[24585]: cluster 2024-09-16T11:57:56.111981+0000 mgr.a (mgr.14373) 16466 : cluster [DBG] pgmap v11420: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 425 B/s wr, 6 op/s 2024-09-16T11:57:57.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:57:57 smithi086 bash[24289]: cluster 2024-09-16T11:57:56.111981+0000 mgr.a (mgr.14373) 16466 : cluster [DBG] pgmap v11420: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 425 B/s wr, 6 op/s 2024-09-16T11:57:57.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:57:57 smithi047 bash[22744]: cluster 2024-09-16T11:57:56.111981+0000 mgr.a (mgr.14373) 16466 : cluster [DBG] pgmap v11420: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 425 B/s wr, 6 op/s 2024-09-16T11:57:58.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:57:58 smithi157 bash[24585]: audit 2024-09-16T11:57:56.889677+0000 mgr.a (mgr.14373) 16467 : audit [DBG] from='client.354771 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:57:58.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:57:58 smithi086 bash[24289]: audit 2024-09-16T11:57:56.889677+0000 mgr.a (mgr.14373) 16467 : audit [DBG] from='client.354771 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:57:58.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:57:58 smithi047 bash[22744]: audit 2024-09-16T11:57:56.889677+0000 mgr.a (mgr.14373) 16467 : audit [DBG] from='client.354771 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:57:59.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:57:59 smithi157 bash[24585]: cluster 2024-09-16T11:57:58.114808+0000 mgr.a (mgr.14373) 16468 : cluster [DBG] pgmap v11421: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 425 B/s wr, 7 op/s 2024-09-16T11:57:59.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:57:59 smithi086 bash[24289]: cluster 2024-09-16T11:57:58.114808+0000 mgr.a (mgr.14373) 16468 : cluster [DBG] pgmap v11421: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 425 B/s wr, 7 op/s 2024-09-16T11:57:59.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:57:59 smithi047 bash[22744]: cluster 2024-09-16T11:57:58.114808+0000 mgr.a (mgr.14373) 16468 : cluster [DBG] pgmap v11421: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 425 B/s wr, 7 op/s 2024-09-16T11:58:01.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:58:01 smithi157 bash[24585]: cluster 2024-09-16T11:58:00.115393+0000 mgr.a (mgr.14373) 16469 : cluster [DBG] pgmap v11422: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T11:58:01.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:58:01 smithi086 bash[24289]: cluster 2024-09-16T11:58:00.115393+0000 mgr.a (mgr.14373) 16469 : cluster [DBG] pgmap v11422: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T11:58:01.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:58:01 smithi047 bash[22744]: cluster 2024-09-16T11:58:00.115393+0000 mgr.a (mgr.14373) 16469 : cluster [DBG] pgmap v11422: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T11:58:02.334 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:58:02.334 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:58:02.334 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:58:03.105 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:58:03.106 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:58:03.106 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:58:03.106 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:58:03.106 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:58:03.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:58:03 smithi157 bash[24585]: cluster 2024-09-16T11:58:02.117473+0000 mgr.a (mgr.14373) 16470 : cluster [DBG] pgmap v11423: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:58:03.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:58:03 smithi157 bash[24585]: audit 2024-09-16T11:58:02.662771+0000 mgr.a (mgr.14373) 16471 : audit [DBG] from='client.354846 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:58:03.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:58:03 smithi086 bash[24289]: cluster 2024-09-16T11:58:02.117473+0000 mgr.a (mgr.14373) 16470 : cluster [DBG] pgmap v11423: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:58:03.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:58:03 smithi086 bash[24289]: audit 2024-09-16T11:58:02.662771+0000 mgr.a (mgr.14373) 16471 : audit [DBG] from='client.354846 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:58:03.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:58:03 smithi047 bash[22744]: cluster 2024-09-16T11:58:02.117473+0000 mgr.a (mgr.14373) 16470 : cluster [DBG] pgmap v11423: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:58:03.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:58:03 smithi047 bash[22744]: audit 2024-09-16T11:58:02.662771+0000 mgr.a (mgr.14373) 16471 : audit [DBG] from='client.354846 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:58:05.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:58:05 smithi157 bash[24585]: cluster 2024-09-16T11:58:04.118637+0000 mgr.a (mgr.14373) 16472 : cluster [DBG] pgmap v11424: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-16T11:58:05.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:58:05 smithi086 bash[24289]: cluster 2024-09-16T11:58:04.118637+0000 mgr.a (mgr.14373) 16472 : cluster [DBG] pgmap v11424: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-16T11:58:05.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:58:05 smithi047 bash[22744]: cluster 2024-09-16T11:58:04.118637+0000 mgr.a (mgr.14373) 16472 : cluster [DBG] pgmap v11424: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-16T11:58:07.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:58:07 smithi157 bash[24585]: cluster 2024-09-16T11:58:06.119643+0000 mgr.a (mgr.14373) 16473 : cluster [DBG] pgmap v11425: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-16T11:58:07.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:58:07 smithi086 bash[24289]: cluster 2024-09-16T11:58:06.119643+0000 mgr.a (mgr.14373) 16473 : cluster [DBG] pgmap v11425: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-16T11:58:07.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:58:07 smithi047 bash[22744]: cluster 2024-09-16T11:58:06.119643+0000 mgr.a (mgr.14373) 16473 : cluster [DBG] pgmap v11425: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-16T11:58:08.107 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:58:08.108 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:58:08.108 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:58:08.862 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:58:08.863 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:58:08.863 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:58:08.863 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:58:08.863 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:58:09.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:58:09 smithi157 bash[24585]: cluster 2024-09-16T11:58:08.121256+0000 mgr.a (mgr.14373) 16474 : cluster [DBG] pgmap v11426: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 6.2 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-16T11:58:09.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:58:09 smithi157 bash[24585]: audit 2024-09-16T11:58:08.430816+0000 mgr.a (mgr.14373) 16475 : audit [DBG] from='client.354921 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:58:09.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:58:09 smithi086 bash[24289]: cluster 2024-09-16T11:58:08.121256+0000 mgr.a (mgr.14373) 16474 : cluster [DBG] pgmap v11426: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 6.2 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-16T11:58:09.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:58:09 smithi086 bash[24289]: audit 2024-09-16T11:58:08.430816+0000 mgr.a (mgr.14373) 16475 : audit [DBG] from='client.354921 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:58:09.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:58:09 smithi047 bash[22744]: cluster 2024-09-16T11:58:08.121256+0000 mgr.a (mgr.14373) 16474 : cluster [DBG] pgmap v11426: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 6.2 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-16T11:58:09.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:58:09 smithi047 bash[22744]: audit 2024-09-16T11:58:08.430816+0000 mgr.a (mgr.14373) 16475 : audit [DBG] from='client.354921 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:58:11.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:58:11 smithi157 bash[24585]: cluster 2024-09-16T11:58:10.122222+0000 mgr.a (mgr.14373) 16476 : cluster [DBG] pgmap v11427: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-16T11:58:11.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:58:11 smithi086 bash[24289]: cluster 2024-09-16T11:58:10.122222+0000 mgr.a (mgr.14373) 16476 : cluster [DBG] pgmap v11427: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-16T11:58:11.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:58:11 smithi047 bash[22744]: cluster 2024-09-16T11:58:10.122222+0000 mgr.a (mgr.14373) 16476 : cluster [DBG] pgmap v11427: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-16T11:58:13.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:58:13 smithi157 bash[24585]: cluster 2024-09-16T11:58:12.124363+0000 mgr.a (mgr.14373) 16477 : cluster [DBG] pgmap v11428: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-16T11:58:13.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:58:13 smithi086 bash[24289]: cluster 2024-09-16T11:58:12.124363+0000 mgr.a (mgr.14373) 16477 : cluster [DBG] pgmap v11428: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-16T11:58:13.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:58:13 smithi047 bash[22744]: cluster 2024-09-16T11:58:12.124363+0000 mgr.a (mgr.14373) 16477 : cluster [DBG] pgmap v11428: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-16T11:58:13.864 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:58:13.865 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:58:13.865 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:58:14.622 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:58:14.622 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:58:14.622 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:58:14.622 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:58:14.622 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:58:15.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:58:15 smithi157 bash[24585]: cluster 2024-09-16T11:58:14.125209+0000 mgr.a (mgr.14373) 16478 : cluster [DBG] pgmap v11429: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-16T11:58:15.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:58:15 smithi157 bash[24585]: audit 2024-09-16T11:58:14.194546+0000 mgr.a (mgr.14373) 16479 : audit [DBG] from='client.354999 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:58:15.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:58:15 smithi086 bash[24289]: cluster 2024-09-16T11:58:14.125209+0000 mgr.a (mgr.14373) 16478 : cluster [DBG] pgmap v11429: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-16T11:58:15.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:58:15 smithi086 bash[24289]: audit 2024-09-16T11:58:14.194546+0000 mgr.a (mgr.14373) 16479 : audit [DBG] from='client.354999 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:58:15.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:58:15 smithi047 bash[22744]: cluster 2024-09-16T11:58:14.125209+0000 mgr.a (mgr.14373) 16478 : cluster [DBG] pgmap v11429: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-16T11:58:15.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:58:15 smithi047 bash[22744]: audit 2024-09-16T11:58:14.194546+0000 mgr.a (mgr.14373) 16479 : audit [DBG] from='client.354999 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:58:17.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:58:17 smithi157 bash[24585]: cluster 2024-09-16T11:58:16.126411+0000 mgr.a (mgr.14373) 16480 : cluster [DBG] pgmap v11430: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-16T11:58:17.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:58:17 smithi086 bash[24289]: cluster 2024-09-16T11:58:16.126411+0000 mgr.a (mgr.14373) 16480 : cluster [DBG] pgmap v11430: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-16T11:58:17.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:58:17 smithi047 bash[22744]: cluster 2024-09-16T11:58:16.126411+0000 mgr.a (mgr.14373) 16480 : cluster [DBG] pgmap v11430: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-16T11:58:19.623 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:58:19.624 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:58:19.624 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:58:19.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:58:19 smithi157 bash[24585]: cluster 2024-09-16T11:58:18.128644+0000 mgr.a (mgr.14373) 16481 : cluster [DBG] pgmap v11431: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-16T11:58:19.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:58:19 smithi086 bash[24289]: cluster 2024-09-16T11:58:18.128644+0000 mgr.a (mgr.14373) 16481 : cluster [DBG] pgmap v11431: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-16T11:58:19.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:58:19 smithi047 bash[22744]: cluster 2024-09-16T11:58:18.128644+0000 mgr.a (mgr.14373) 16481 : cluster [DBG] pgmap v11431: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-16T11:58:20.394 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:58:20.394 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:58:20.394 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:58:20.394 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:58:20.394 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:58:21.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:58:21 smithi157 bash[24585]: audit 2024-09-16T11:58:19.959363+0000 mgr.a (mgr.14373) 16482 : audit [DBG] from='client.355074 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:58:21.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:58:21 smithi157 bash[24585]: cluster 2024-09-16T11:58:20.129262+0000 mgr.a (mgr.14373) 16483 : cluster [DBG] pgmap v11432: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:58:21.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:58:21 smithi086 bash[24289]: audit 2024-09-16T11:58:19.959363+0000 mgr.a (mgr.14373) 16482 : audit [DBG] from='client.355074 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:58:21.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:58:21 smithi086 bash[24289]: cluster 2024-09-16T11:58:20.129262+0000 mgr.a (mgr.14373) 16483 : cluster [DBG] pgmap v11432: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:58:21.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:58:21 smithi047 bash[22744]: audit 2024-09-16T11:58:19.959363+0000 mgr.a (mgr.14373) 16482 : audit [DBG] from='client.355074 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:58:21.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:58:21 smithi047 bash[22744]: cluster 2024-09-16T11:58:20.129262+0000 mgr.a (mgr.14373) 16483 : cluster [DBG] pgmap v11432: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:58:23.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:58:23 smithi157 bash[24585]: cluster 2024-09-16T11:58:22.131545+0000 mgr.a (mgr.14373) 16484 : cluster [DBG] pgmap v11433: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:58:23.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:58:23 smithi086 bash[24289]: cluster 2024-09-16T11:58:22.131545+0000 mgr.a (mgr.14373) 16484 : cluster [DBG] pgmap v11433: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:58:23.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:58:23 smithi047 bash[22744]: cluster 2024-09-16T11:58:22.131545+0000 mgr.a (mgr.14373) 16484 : cluster [DBG] pgmap v11433: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:58:25.395 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:58:25.396 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:58:25.396 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:58:25.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:58:25 smithi157 bash[24585]: cluster 2024-09-16T11:58:24.132331+0000 mgr.a (mgr.14373) 16485 : cluster [DBG] pgmap v11434: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:58:25.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:58:25 smithi086 bash[24289]: cluster 2024-09-16T11:58:24.132331+0000 mgr.a (mgr.14373) 16485 : cluster [DBG] pgmap v11434: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:58:25.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:58:25 smithi047 bash[22744]: cluster 2024-09-16T11:58:24.132331+0000 mgr.a (mgr.14373) 16485 : cluster [DBG] pgmap v11434: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:58:26.175 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:58:26.176 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:58:26.176 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:58:26.176 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:58:26.176 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:58:27.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:58:27 smithi157 bash[24585]: audit 2024-09-16T11:58:25.729122+0000 mgr.a (mgr.14373) 16486 : audit [DBG] from='client.355146 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:58:27.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:58:27 smithi157 bash[24585]: cluster 2024-09-16T11:58:26.132899+0000 mgr.a (mgr.14373) 16487 : cluster [DBG] pgmap v11435: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:58:27.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:58:27 smithi086 bash[24289]: audit 2024-09-16T11:58:25.729122+0000 mgr.a (mgr.14373) 16486 : audit [DBG] from='client.355146 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:58:27.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:58:27 smithi086 bash[24289]: cluster 2024-09-16T11:58:26.132899+0000 mgr.a (mgr.14373) 16487 : cluster [DBG] pgmap v11435: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:58:27.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:58:27 smithi047 bash[22744]: audit 2024-09-16T11:58:25.729122+0000 mgr.a (mgr.14373) 16486 : audit [DBG] from='client.355146 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:58:27.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:58:27 smithi047 bash[22744]: cluster 2024-09-16T11:58:26.132899+0000 mgr.a (mgr.14373) 16487 : cluster [DBG] pgmap v11435: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:58:29.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:58:29 smithi157 bash[24585]: cluster 2024-09-16T11:58:28.135131+0000 mgr.a (mgr.14373) 16488 : cluster [DBG] pgmap v11436: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:58:29.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:58:29 smithi086 bash[24289]: cluster 2024-09-16T11:58:28.135131+0000 mgr.a (mgr.14373) 16488 : cluster [DBG] pgmap v11436: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:58:29.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:58:29 smithi047 bash[22744]: cluster 2024-09-16T11:58:28.135131+0000 mgr.a (mgr.14373) 16488 : cluster [DBG] pgmap v11436: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:58:31.177 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:58:31.178 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:58:31.178 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:58:31.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:58:31 smithi157 bash[24585]: cluster 2024-09-16T11:58:30.135913+0000 mgr.a (mgr.14373) 16489 : cluster [DBG] pgmap v11437: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:58:31.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:58:31 smithi086 bash[24289]: cluster 2024-09-16T11:58:30.135913+0000 mgr.a (mgr.14373) 16489 : cluster [DBG] pgmap v11437: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:58:31.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:58:31 smithi047 bash[22744]: cluster 2024-09-16T11:58:30.135913+0000 mgr.a (mgr.14373) 16489 : cluster [DBG] pgmap v11437: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:58:31.921 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:58:31.921 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:58:31.921 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:58:31.921 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:58:31.921 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:58:32.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:58:32 smithi157 bash[24585]: audit 2024-09-16T11:58:31.510275+0000 mgr.a (mgr.14373) 16490 : audit [DBG] from='client.355224 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:58:32.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:58:32 smithi086 bash[24289]: audit 2024-09-16T11:58:31.510275+0000 mgr.a (mgr.14373) 16490 : audit [DBG] from='client.355224 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:58:32.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:58:32 smithi047 bash[22744]: audit 2024-09-16T11:58:31.510275+0000 mgr.a (mgr.14373) 16490 : audit [DBG] from='client.355224 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:58:33.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:58:33 smithi157 bash[24585]: cluster 2024-09-16T11:58:32.138706+0000 mgr.a (mgr.14373) 16491 : cluster [DBG] pgmap v11438: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:58:33.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:58:33 smithi086 bash[24289]: cluster 2024-09-16T11:58:32.138706+0000 mgr.a (mgr.14373) 16491 : cluster [DBG] pgmap v11438: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:58:33.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:58:33 smithi047 bash[22744]: cluster 2024-09-16T11:58:32.138706+0000 mgr.a (mgr.14373) 16491 : cluster [DBG] pgmap v11438: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:58:35.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:58:35 smithi157 bash[24585]: cluster 2024-09-16T11:58:34.139539+0000 mgr.a (mgr.14373) 16492 : cluster [DBG] pgmap v11439: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:58:35.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:58:35 smithi086 bash[24289]: cluster 2024-09-16T11:58:34.139539+0000 mgr.a (mgr.14373) 16492 : cluster [DBG] pgmap v11439: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:58:35.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:58:35 smithi047 bash[22744]: cluster 2024-09-16T11:58:34.139539+0000 mgr.a (mgr.14373) 16492 : cluster [DBG] pgmap v11439: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:58:36.922 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:58:36.923 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:58:36.923 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:58:37.695 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:58:37.696 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:58:37.696 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:58:37.696 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:58:37.696 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:58:37.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:58:37 smithi157 bash[24585]: cluster 2024-09-16T11:58:36.140348+0000 mgr.a (mgr.14373) 16493 : cluster [DBG] pgmap v11440: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T11:58:37.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:58:37 smithi086 bash[24289]: cluster 2024-09-16T11:58:36.140348+0000 mgr.a (mgr.14373) 16493 : cluster [DBG] pgmap v11440: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T11:58:37.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:58:37 smithi047 bash[22744]: cluster 2024-09-16T11:58:36.140348+0000 mgr.a (mgr.14373) 16493 : cluster [DBG] pgmap v11440: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T11:58:38.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:58:38 smithi157 bash[24585]: audit 2024-09-16T11:58:37.254590+0000 mgr.a (mgr.14373) 16494 : audit [DBG] from='client.355302 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:58:38.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:58:38 smithi086 bash[24289]: audit 2024-09-16T11:58:37.254590+0000 mgr.a (mgr.14373) 16494 : audit [DBG] from='client.355302 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:58:38.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:58:38 smithi047 bash[22744]: audit 2024-09-16T11:58:37.254590+0000 mgr.a (mgr.14373) 16494 : audit [DBG] from='client.355302 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:58:39.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:58:39 smithi157 bash[24585]: cluster 2024-09-16T11:58:38.143222+0000 mgr.a (mgr.14373) 16495 : cluster [DBG] pgmap v11441: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 65 KiB/s rd, 0 B/s wr, 107 op/s 2024-09-16T11:58:39.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:58:39 smithi086 bash[24289]: cluster 2024-09-16T11:58:38.143222+0000 mgr.a (mgr.14373) 16495 : cluster [DBG] pgmap v11441: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 65 KiB/s rd, 0 B/s wr, 107 op/s 2024-09-16T11:58:39.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:58:39 smithi047 bash[22744]: cluster 2024-09-16T11:58:38.143222+0000 mgr.a (mgr.14373) 16495 : cluster [DBG] pgmap v11441: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 65 KiB/s rd, 0 B/s wr, 107 op/s 2024-09-16T11:58:41.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:58:41 smithi157 bash[24585]: cluster 2024-09-16T11:58:40.144013+0000 mgr.a (mgr.14373) 16496 : cluster [DBG] pgmap v11442: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 64 KiB/s rd, 0 B/s wr, 106 op/s 2024-09-16T11:58:41.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:58:41 smithi086 bash[24289]: cluster 2024-09-16T11:58:40.144013+0000 mgr.a (mgr.14373) 16496 : cluster [DBG] pgmap v11442: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 64 KiB/s rd, 0 B/s wr, 106 op/s 2024-09-16T11:58:41.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:58:41 smithi047 bash[22744]: cluster 2024-09-16T11:58:40.144013+0000 mgr.a (mgr.14373) 16496 : cluster [DBG] pgmap v11442: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 64 KiB/s rd, 0 B/s wr, 106 op/s 2024-09-16T11:58:42.697 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:58:42.698 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:58:42.698 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:58:43.483 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:58:43.483 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:58:43.483 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:58:43.483 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:58:43.483 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:58:43.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:58:43 smithi157 bash[24585]: cluster 2024-09-16T11:58:42.145984+0000 mgr.a (mgr.14373) 16497 : cluster [DBG] pgmap v11443: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 65 KiB/s rd, 0 B/s wr, 107 op/s 2024-09-16T11:58:43.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:58:43 smithi086 bash[24289]: cluster 2024-09-16T11:58:42.145984+0000 mgr.a (mgr.14373) 16497 : cluster [DBG] pgmap v11443: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 65 KiB/s rd, 0 B/s wr, 107 op/s 2024-09-16T11:58:43.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:58:43 smithi047 bash[22744]: cluster 2024-09-16T11:58:42.145984+0000 mgr.a (mgr.14373) 16497 : cluster [DBG] pgmap v11443: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 65 KiB/s rd, 0 B/s wr, 107 op/s 2024-09-16T11:58:44.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:58:44 smithi157 bash[24585]: audit 2024-09-16T11:58:43.035951+0000 mgr.a (mgr.14373) 16498 : audit [DBG] from='client.355380 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:58:44.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:58:44 smithi086 bash[24289]: audit 2024-09-16T11:58:43.035951+0000 mgr.a (mgr.14373) 16498 : audit [DBG] from='client.355380 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:58:44.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:58:44 smithi047 bash[22744]: audit 2024-09-16T11:58:43.035951+0000 mgr.a (mgr.14373) 16498 : audit [DBG] from='client.355380 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:58:45.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:58:45 smithi157 bash[24585]: cluster 2024-09-16T11:58:44.146955+0000 mgr.a (mgr.14373) 16499 : cluster [DBG] pgmap v11444: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 65 KiB/s rd, 0 B/s wr, 107 op/s 2024-09-16T11:58:45.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:58:45 smithi086 bash[24289]: cluster 2024-09-16T11:58:44.146955+0000 mgr.a (mgr.14373) 16499 : cluster [DBG] pgmap v11444: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 65 KiB/s rd, 0 B/s wr, 107 op/s 2024-09-16T11:58:45.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:58:45 smithi047 bash[22744]: cluster 2024-09-16T11:58:44.146955+0000 mgr.a (mgr.14373) 16499 : cluster [DBG] pgmap v11444: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 65 KiB/s rd, 0 B/s wr, 107 op/s 2024-09-16T11:58:47.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:58:47 smithi157 bash[24585]: cluster 2024-09-16T11:58:46.147792+0000 mgr.a (mgr.14373) 16500 : cluster [DBG] pgmap v11445: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 65 KiB/s rd, 0 B/s wr, 107 op/s 2024-09-16T11:58:47.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:58:47 smithi086 bash[24289]: cluster 2024-09-16T11:58:46.147792+0000 mgr.a (mgr.14373) 16500 : cluster [DBG] pgmap v11445: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 65 KiB/s rd, 0 B/s wr, 107 op/s 2024-09-16T11:58:47.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:58:47 smithi047 bash[22744]: cluster 2024-09-16T11:58:46.147792+0000 mgr.a (mgr.14373) 16500 : cluster [DBG] pgmap v11445: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 65 KiB/s rd, 0 B/s wr, 107 op/s 2024-09-16T11:58:48.484 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:58:48.485 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:58:48.486 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:58:49.262 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:58:49.262 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:58:49.263 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:58:49.263 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:58:49.263 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:58:49.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:58:49 smithi157 bash[24585]: cluster 2024-09-16T11:58:48.150045+0000 mgr.a (mgr.14373) 16501 : cluster [DBG] pgmap v11446: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 66 KiB/s rd, 0 B/s wr, 108 op/s 2024-09-16T11:58:49.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:58:49 smithi157 bash[24585]: audit 2024-09-16T11:58:48.901562+0000 mon.b (mon.2) 1498 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T11:58:49.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:58:49 smithi086 bash[24289]: cluster 2024-09-16T11:58:48.150045+0000 mgr.a (mgr.14373) 16501 : cluster [DBG] pgmap v11446: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 66 KiB/s rd, 0 B/s wr, 108 op/s 2024-09-16T11:58:49.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:58:49 smithi086 bash[24289]: audit 2024-09-16T11:58:48.901562+0000 mon.b (mon.2) 1498 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T11:58:49.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:58:49 smithi047 bash[22744]: cluster 2024-09-16T11:58:48.150045+0000 mgr.a (mgr.14373) 16501 : cluster [DBG] pgmap v11446: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 66 KiB/s rd, 0 B/s wr, 108 op/s 2024-09-16T11:58:49.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:58:49 smithi047 bash[22744]: audit 2024-09-16T11:58:48.901562+0000 mon.b (mon.2) 1498 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T11:58:50.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:58:50 smithi157 bash[24585]: audit 2024-09-16T11:58:48.825495+0000 mgr.a (mgr.14373) 16502 : audit [DBG] from='client.355455 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:58:50.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:58:50 smithi157 bash[24585]: audit 2024-09-16T11:58:49.721180+0000 mon.b (mon.2) 1499 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T11:58:50.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:58:50 smithi157 bash[24585]: audit 2024-09-16T11:58:49.723583+0000 mon.b (mon.2) 1500 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T11:58:50.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:58:50 smithi157 bash[24585]: audit 2024-09-16T11:58:49.735103+0000 mon.a (mon.0) 1554 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:58:50.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:58:50 smithi157 bash[24585]: audit 2024-09-16T11:58:49.741845+0000 mon.b (mon.2) 1501 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:58:50.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:58:50 smithi086 bash[24289]: audit 2024-09-16T11:58:48.825495+0000 mgr.a (mgr.14373) 16502 : audit [DBG] from='client.355455 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:58:50.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:58:50 smithi086 bash[24289]: audit 2024-09-16T11:58:49.721180+0000 mon.b (mon.2) 1499 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T11:58:50.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:58:50 smithi086 bash[24289]: audit 2024-09-16T11:58:49.723583+0000 mon.b (mon.2) 1500 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T11:58:50.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:58:50 smithi086 bash[24289]: audit 2024-09-16T11:58:49.735103+0000 mon.a (mon.0) 1554 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:58:50.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:58:50 smithi086 bash[24289]: audit 2024-09-16T11:58:49.741845+0000 mon.b (mon.2) 1501 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:58:50.842 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 11:58:50 smithi047 bash[22994]: debug 2024-09-16T11:58:50.487+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T11:58:50.843 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 11:58:50 smithi047 bash[22994]: debug 2024-09-16T11:58:50.491+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T11:58:50.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:58:50 smithi047 bash[22744]: audit 2024-09-16T11:58:48.825495+0000 mgr.a (mgr.14373) 16502 : audit [DBG] from='client.355455 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:58:50.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:58:50 smithi047 bash[22744]: audit 2024-09-16T11:58:49.721180+0000 mon.b (mon.2) 1499 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T11:58:50.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:58:50 smithi047 bash[22744]: audit 2024-09-16T11:58:49.723583+0000 mon.b (mon.2) 1500 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T11:58:50.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:58:50 smithi047 bash[22744]: audit 2024-09-16T11:58:49.735103+0000 mon.a (mon.0) 1554 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:58:50.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:58:50 smithi047 bash[22744]: audit 2024-09-16T11:58:49.741845+0000 mon.b (mon.2) 1501 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:58:51.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:58:51 smithi157 bash[24585]: audit 2024-09-16T11:58:49.743794+0000 mgr.a (mgr.14373) 16503 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:58:51.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:58:51 smithi157 bash[24585]: cluster 2024-09-16T11:58:50.150641+0000 mgr.a (mgr.14373) 16504 : cluster [DBG] pgmap v11447: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:58:51.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:58:51 smithi157 bash[24585]: audit 2024-09-16T11:58:50.490999+0000 mgr.a (mgr.14373) 16505 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T11:58:51.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:58:51 smithi157 bash[24585]: cephadm 2024-09-16T11:58:50.494589+0000 mgr.a (mgr.14373) 16506 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T11:58:51.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:58:51 smithi086 bash[24289]: audit 2024-09-16T11:58:49.743794+0000 mgr.a (mgr.14373) 16503 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:58:51.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:58:51 smithi086 bash[24289]: cluster 2024-09-16T11:58:50.150641+0000 mgr.a (mgr.14373) 16504 : cluster [DBG] pgmap v11447: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:58:51.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:58:51 smithi086 bash[24289]: audit 2024-09-16T11:58:50.490999+0000 mgr.a (mgr.14373) 16505 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T11:58:51.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:58:51 smithi086 bash[24289]: cephadm 2024-09-16T11:58:50.494589+0000 mgr.a (mgr.14373) 16506 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T11:58:51.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:58:51 smithi047 bash[22744]: audit 2024-09-16T11:58:49.743794+0000 mgr.a (mgr.14373) 16503 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:58:51.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:58:51 smithi047 bash[22744]: cluster 2024-09-16T11:58:50.150641+0000 mgr.a (mgr.14373) 16504 : cluster [DBG] pgmap v11447: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:58:51.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:58:51 smithi047 bash[22744]: audit 2024-09-16T11:58:50.490999+0000 mgr.a (mgr.14373) 16505 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T11:58:51.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:58:51 smithi047 bash[22744]: cephadm 2024-09-16T11:58:50.494589+0000 mgr.a (mgr.14373) 16506 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T11:58:53.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:58:53 smithi157 bash[24585]: cluster 2024-09-16T11:58:52.152882+0000 mgr.a (mgr.14373) 16507 : cluster [DBG] pgmap v11448: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:58:53.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:58:53 smithi086 bash[24289]: cluster 2024-09-16T11:58:52.152882+0000 mgr.a (mgr.14373) 16507 : cluster [DBG] pgmap v11448: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:58:53.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:58:53 smithi047 bash[22744]: cluster 2024-09-16T11:58:52.152882+0000 mgr.a (mgr.14373) 16507 : cluster [DBG] pgmap v11448: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:58:54.264 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:58:54.264 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:58:54.265 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:58:55.049 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:58:55.049 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:58:55.049 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:58:55.049 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:58:55.049 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:58:55.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:58:55 smithi157 bash[24585]: cluster 2024-09-16T11:58:54.153783+0000 mgr.a (mgr.14373) 16508 : cluster [DBG] pgmap v11449: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:58:55.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:58:55 smithi157 bash[24585]: audit 2024-09-16T11:58:54.600828+0000 mgr.a (mgr.14373) 16509 : audit [DBG] from='client.355638 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:58:55.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:58:55 smithi086 bash[24289]: cluster 2024-09-16T11:58:54.153783+0000 mgr.a (mgr.14373) 16508 : cluster [DBG] pgmap v11449: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:58:55.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:58:55 smithi086 bash[24289]: audit 2024-09-16T11:58:54.600828+0000 mgr.a (mgr.14373) 16509 : audit [DBG] from='client.355638 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:58:55.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:58:55 smithi047 bash[22744]: cluster 2024-09-16T11:58:54.153783+0000 mgr.a (mgr.14373) 16508 : cluster [DBG] pgmap v11449: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:58:55.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:58:55 smithi047 bash[22744]: audit 2024-09-16T11:58:54.600828+0000 mgr.a (mgr.14373) 16509 : audit [DBG] from='client.355638 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:58:57.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:58:57 smithi157 bash[24585]: cluster 2024-09-16T11:58:56.154788+0000 mgr.a (mgr.14373) 16510 : cluster [DBG] pgmap v11450: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:58:57.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:58:57 smithi086 bash[24289]: cluster 2024-09-16T11:58:56.154788+0000 mgr.a (mgr.14373) 16510 : cluster [DBG] pgmap v11450: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:58:57.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:58:57 smithi047 bash[22744]: cluster 2024-09-16T11:58:56.154788+0000 mgr.a (mgr.14373) 16510 : cluster [DBG] pgmap v11450: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:58:59.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:58:59 smithi157 bash[24585]: cluster 2024-09-16T11:58:58.157035+0000 mgr.a (mgr.14373) 16511 : cluster [DBG] pgmap v11451: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:58:59.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:58:59 smithi086 bash[24289]: cluster 2024-09-16T11:58:58.157035+0000 mgr.a (mgr.14373) 16511 : cluster [DBG] pgmap v11451: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:58:59.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:58:59 smithi047 bash[22744]: cluster 2024-09-16T11:58:58.157035+0000 mgr.a (mgr.14373) 16511 : cluster [DBG] pgmap v11451: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:59:00.050 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:59:00.051 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:59:00.051 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:59:00.812 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:59:00.813 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:59:00.813 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:59:00.813 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:59:00.813 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:59:01.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:59:01 smithi157 bash[24585]: cluster 2024-09-16T11:59:00.157439+0000 mgr.a (mgr.14373) 16512 : cluster [DBG] pgmap v11452: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:59:01.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:59:01 smithi157 bash[24585]: audit 2024-09-16T11:59:00.378070+0000 mgr.a (mgr.14373) 16513 : audit [DBG] from='client.355713 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:59:01.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:59:01 smithi086 bash[24289]: cluster 2024-09-16T11:59:00.157439+0000 mgr.a (mgr.14373) 16512 : cluster [DBG] pgmap v11452: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:59:01.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:59:01 smithi086 bash[24289]: audit 2024-09-16T11:59:00.378070+0000 mgr.a (mgr.14373) 16513 : audit [DBG] from='client.355713 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:59:01.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:59:01 smithi047 bash[22744]: cluster 2024-09-16T11:59:00.157439+0000 mgr.a (mgr.14373) 16512 : cluster [DBG] pgmap v11452: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:59:01.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:59:01 smithi047 bash[22744]: audit 2024-09-16T11:59:00.378070+0000 mgr.a (mgr.14373) 16513 : audit [DBG] from='client.355713 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:59:03.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:59:03 smithi157 bash[24585]: cluster 2024-09-16T11:59:02.159676+0000 mgr.a (mgr.14373) 16514 : cluster [DBG] pgmap v11453: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:59:03.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:59:03 smithi086 bash[24289]: cluster 2024-09-16T11:59:02.159676+0000 mgr.a (mgr.14373) 16514 : cluster [DBG] pgmap v11453: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:59:03.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:59:03 smithi047 bash[22744]: cluster 2024-09-16T11:59:02.159676+0000 mgr.a (mgr.14373) 16514 : cluster [DBG] pgmap v11453: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T11:59:05.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:59:05 smithi157 bash[24585]: cluster 2024-09-16T11:59:04.160442+0000 mgr.a (mgr.14373) 16515 : cluster [DBG] pgmap v11454: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:59:05.814 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:59:05.815 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:59:05.815 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:59:05.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:59:05 smithi086 bash[24289]: cluster 2024-09-16T11:59:04.160442+0000 mgr.a (mgr.14373) 16515 : cluster [DBG] pgmap v11454: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:59:05.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:59:05 smithi047 bash[22744]: cluster 2024-09-16T11:59:04.160442+0000 mgr.a (mgr.14373) 16515 : cluster [DBG] pgmap v11454: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:59:06.591 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:59:06.591 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:59:06.591 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:59:06.591 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:59:06.591 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:59:07.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:59:07 smithi157 bash[24585]: audit 2024-09-16T11:59:06.145900+0000 mgr.a (mgr.14373) 16516 : audit [DBG] from='client.355791 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:59:07.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:59:07 smithi157 bash[24585]: cluster 2024-09-16T11:59:06.162555+0000 mgr.a (mgr.14373) 16517 : cluster [DBG] pgmap v11455: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:59:07.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:59:07 smithi086 bash[24289]: audit 2024-09-16T11:59:06.145900+0000 mgr.a (mgr.14373) 16516 : audit [DBG] from='client.355791 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:59:07.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:59:07 smithi086 bash[24289]: cluster 2024-09-16T11:59:06.162555+0000 mgr.a (mgr.14373) 16517 : cluster [DBG] pgmap v11455: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:59:07.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:59:07 smithi047 bash[22744]: audit 2024-09-16T11:59:06.145900+0000 mgr.a (mgr.14373) 16516 : audit [DBG] from='client.355791 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:59:07.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:59:07 smithi047 bash[22744]: cluster 2024-09-16T11:59:06.162555+0000 mgr.a (mgr.14373) 16517 : cluster [DBG] pgmap v11455: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:59:09.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:59:09 smithi157 bash[24585]: cluster 2024-09-16T11:59:08.165021+0000 mgr.a (mgr.14373) 16518 : cluster [DBG] pgmap v11456: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-16T11:59:09.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:59:09 smithi086 bash[24289]: cluster 2024-09-16T11:59:08.165021+0000 mgr.a (mgr.14373) 16518 : cluster [DBG] pgmap v11456: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-16T11:59:09.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:59:09 smithi047 bash[22744]: cluster 2024-09-16T11:59:08.165021+0000 mgr.a (mgr.14373) 16518 : cluster [DBG] pgmap v11456: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-16T11:59:11.593 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:59:11.593 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:59:11.594 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:59:11.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:59:11 smithi157 bash[24585]: cluster 2024-09-16T11:59:10.165801+0000 mgr.a (mgr.14373) 16519 : cluster [DBG] pgmap v11457: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T11:59:11.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:59:11 smithi086 bash[24289]: cluster 2024-09-16T11:59:10.165801+0000 mgr.a (mgr.14373) 16519 : cluster [DBG] pgmap v11457: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T11:59:11.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:59:11 smithi047 bash[22744]: cluster 2024-09-16T11:59:10.165801+0000 mgr.a (mgr.14373) 16519 : cluster [DBG] pgmap v11457: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T11:59:12.380 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:59:12.380 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:59:12.380 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:59:12.380 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:59:12.380 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:59:13.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:59:13 smithi157 bash[24585]: audit 2024-09-16T11:59:11.927328+0000 mgr.a (mgr.14373) 16520 : audit [DBG] from='client.355869 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:59:13.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:59:13 smithi157 bash[24585]: cluster 2024-09-16T11:59:12.173921+0000 mgr.a (mgr.14373) 16521 : cluster [DBG] pgmap v11458: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:59:13.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:59:13 smithi086 bash[24289]: audit 2024-09-16T11:59:11.927328+0000 mgr.a (mgr.14373) 16520 : audit [DBG] from='client.355869 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:59:13.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:59:13 smithi086 bash[24289]: cluster 2024-09-16T11:59:12.173921+0000 mgr.a (mgr.14373) 16521 : cluster [DBG] pgmap v11458: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:59:13.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:59:13 smithi047 bash[22744]: audit 2024-09-16T11:59:11.927328+0000 mgr.a (mgr.14373) 16520 : audit [DBG] from='client.355869 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:59:13.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:59:13 smithi047 bash[22744]: cluster 2024-09-16T11:59:12.173921+0000 mgr.a (mgr.14373) 16521 : cluster [DBG] pgmap v11458: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:59:15.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:59:15 smithi157 bash[24585]: cluster 2024-09-16T11:59:14.174833+0000 mgr.a (mgr.14373) 16522 : cluster [DBG] pgmap v11459: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:59:15.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:59:15 smithi086 bash[24289]: cluster 2024-09-16T11:59:14.174833+0000 mgr.a (mgr.14373) 16522 : cluster [DBG] pgmap v11459: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:59:15.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:59:15 smithi047 bash[22744]: cluster 2024-09-16T11:59:14.174833+0000 mgr.a (mgr.14373) 16522 : cluster [DBG] pgmap v11459: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:59:17.382 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:59:17.382 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:59:17.383 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:59:17.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:59:17 smithi157 bash[24585]: cluster 2024-09-16T11:59:16.175592+0000 mgr.a (mgr.14373) 16523 : cluster [DBG] pgmap v11460: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:59:17.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:59:17 smithi086 bash[24289]: cluster 2024-09-16T11:59:16.175592+0000 mgr.a (mgr.14373) 16523 : cluster [DBG] pgmap v11460: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:59:17.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:59:17 smithi047 bash[22744]: cluster 2024-09-16T11:59:16.175592+0000 mgr.a (mgr.14373) 16523 : cluster [DBG] pgmap v11460: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:59:18.157 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:59:18.157 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:59:18.157 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:59:18.157 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:59:18.157 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:59:19.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:59:19 smithi157 bash[24585]: audit 2024-09-16T11:59:17.712298+0000 mgr.a (mgr.14373) 16524 : audit [DBG] from='client.355947 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:59:19.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:59:19 smithi157 bash[24585]: cluster 2024-09-16T11:59:18.177025+0000 mgr.a (mgr.14373) 16525 : cluster [DBG] pgmap v11461: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:59:19.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:59:19 smithi086 bash[24289]: audit 2024-09-16T11:59:17.712298+0000 mgr.a (mgr.14373) 16524 : audit [DBG] from='client.355947 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:59:19.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:59:19 smithi086 bash[24289]: cluster 2024-09-16T11:59:18.177025+0000 mgr.a (mgr.14373) 16525 : cluster [DBG] pgmap v11461: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:59:19.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:59:19 smithi047 bash[22744]: audit 2024-09-16T11:59:17.712298+0000 mgr.a (mgr.14373) 16524 : audit [DBG] from='client.355947 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:59:19.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:59:19 smithi047 bash[22744]: cluster 2024-09-16T11:59:18.177025+0000 mgr.a (mgr.14373) 16525 : cluster [DBG] pgmap v11461: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:59:21.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:59:21 smithi086 bash[24289]: cluster 2024-09-16T11:59:20.177748+0000 mgr.a (mgr.14373) 16526 : cluster [DBG] pgmap v11462: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-16T11:59:21.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:59:21 smithi047 bash[22744]: cluster 2024-09-16T11:59:20.177748+0000 mgr.a (mgr.14373) 16526 : cluster [DBG] pgmap v11462: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-16T11:59:22.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:59:21 smithi157 bash[24585]: cluster 2024-09-16T11:59:20.177748+0000 mgr.a (mgr.14373) 16526 : cluster [DBG] pgmap v11462: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-16T11:59:23.158 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:59:23.159 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:59:23.159 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:59:23.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:59:23 smithi086 bash[24289]: cluster 2024-09-16T11:59:22.179783+0000 mgr.a (mgr.14373) 16527 : cluster [DBG] pgmap v11463: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-16T11:59:23.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:59:23 smithi047 bash[22744]: cluster 2024-09-16T11:59:22.179783+0000 mgr.a (mgr.14373) 16527 : cluster [DBG] pgmap v11463: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-16T11:59:23.950 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:59:23.950 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:59:23.950 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:59:23.950 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:59:23.951 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:59:24.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:59:23 smithi157 bash[24585]: cluster 2024-09-16T11:59:22.179783+0000 mgr.a (mgr.14373) 16527 : cluster [DBG] pgmap v11463: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-16T11:59:24.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:59:24 smithi086 bash[24289]: audit 2024-09-16T11:59:23.492613+0000 mgr.a (mgr.14373) 16528 : audit [DBG] from='client.356025 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:59:24.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:59:24 smithi047 bash[22744]: audit 2024-09-16T11:59:23.492613+0000 mgr.a (mgr.14373) 16528 : audit [DBG] from='client.356025 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:59:25.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:59:24 smithi157 bash[24585]: audit 2024-09-16T11:59:23.492613+0000 mgr.a (mgr.14373) 16528 : audit [DBG] from='client.356025 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:59:25.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:59:25 smithi047 bash[22744]: cluster 2024-09-16T11:59:24.180712+0000 mgr.a (mgr.14373) 16529 : cluster [DBG] pgmap v11464: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:59:26.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:59:25 smithi157 bash[24585]: cluster 2024-09-16T11:59:24.180712+0000 mgr.a (mgr.14373) 16529 : cluster [DBG] pgmap v11464: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:59:26.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:59:25 smithi086 bash[24289]: cluster 2024-09-16T11:59:24.180712+0000 mgr.a (mgr.14373) 16529 : cluster [DBG] pgmap v11464: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:59:27.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:59:27 smithi047 bash[22744]: cluster 2024-09-16T11:59:26.181512+0000 mgr.a (mgr.14373) 16530 : cluster [DBG] pgmap v11465: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:59:28.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:59:27 smithi157 bash[24585]: cluster 2024-09-16T11:59:26.181512+0000 mgr.a (mgr.14373) 16530 : cluster [DBG] pgmap v11465: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:59:28.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:59:27 smithi086 bash[24289]: cluster 2024-09-16T11:59:26.181512+0000 mgr.a (mgr.14373) 16530 : cluster [DBG] pgmap v11465: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:59:28.952 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:59:28.953 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:59:28.953 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:59:29.712 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:59:29.712 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:59:29.712 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:59:29.712 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:59:29.712 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:59:29.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:59:29 smithi047 bash[22744]: cluster 2024-09-16T11:59:28.183733+0000 mgr.a (mgr.14373) 16531 : cluster [DBG] pgmap v11466: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:59:30.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:59:29 smithi157 bash[24585]: cluster 2024-09-16T11:59:28.183733+0000 mgr.a (mgr.14373) 16531 : cluster [DBG] pgmap v11466: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:59:30.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:59:29 smithi086 bash[24289]: cluster 2024-09-16T11:59:28.183733+0000 mgr.a (mgr.14373) 16531 : cluster [DBG] pgmap v11466: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:59:30.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:59:30 smithi047 bash[22744]: audit 2024-09-16T11:59:29.284138+0000 mgr.a (mgr.14373) 16532 : audit [DBG] from='client.356103 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:59:31.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:59:30 smithi157 bash[24585]: audit 2024-09-16T11:59:29.284138+0000 mgr.a (mgr.14373) 16532 : audit [DBG] from='client.356103 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:59:31.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:59:30 smithi086 bash[24289]: audit 2024-09-16T11:59:29.284138+0000 mgr.a (mgr.14373) 16532 : audit [DBG] from='client.356103 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:59:31.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:59:31 smithi047 bash[22744]: cluster 2024-09-16T11:59:30.184701+0000 mgr.a (mgr.14373) 16533 : cluster [DBG] pgmap v11467: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:59:32.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:59:31 smithi157 bash[24585]: cluster 2024-09-16T11:59:30.184701+0000 mgr.a (mgr.14373) 16533 : cluster [DBG] pgmap v11467: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:59:32.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:59:31 smithi086 bash[24289]: cluster 2024-09-16T11:59:30.184701+0000 mgr.a (mgr.14373) 16533 : cluster [DBG] pgmap v11467: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:59:34.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:59:33 smithi157 bash[24585]: cluster 2024-09-16T11:59:32.186885+0000 mgr.a (mgr.14373) 16534 : cluster [DBG] pgmap v11468: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:59:34.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:59:33 smithi086 bash[24289]: cluster 2024-09-16T11:59:32.186885+0000 mgr.a (mgr.14373) 16534 : cluster [DBG] pgmap v11468: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:59:34.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:59:33 smithi047 bash[22744]: cluster 2024-09-16T11:59:32.186885+0000 mgr.a (mgr.14373) 16534 : cluster [DBG] pgmap v11468: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:59:34.713 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:59:34.714 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:59:34.714 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:59:35.476 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:59:35.477 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:59:35.477 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:59:35.477 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:59:35.477 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:59:36.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:59:35 smithi157 bash[24585]: cluster 2024-09-16T11:59:34.187647+0000 mgr.a (mgr.14373) 16535 : cluster [DBG] pgmap v11469: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:59:36.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:59:35 smithi086 bash[24289]: cluster 2024-09-16T11:59:34.187647+0000 mgr.a (mgr.14373) 16535 : cluster [DBG] pgmap v11469: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:59:36.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:59:35 smithi047 bash[22744]: cluster 2024-09-16T11:59:34.187647+0000 mgr.a (mgr.14373) 16535 : cluster [DBG] pgmap v11469: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:59:37.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:59:36 smithi157 bash[24585]: audit 2024-09-16T11:59:35.054327+0000 mgr.a (mgr.14373) 16536 : audit [DBG] from='client.356181 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:59:37.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:59:36 smithi086 bash[24289]: audit 2024-09-16T11:59:35.054327+0000 mgr.a (mgr.14373) 16536 : audit [DBG] from='client.356181 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:59:37.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:59:36 smithi047 bash[22744]: audit 2024-09-16T11:59:35.054327+0000 mgr.a (mgr.14373) 16536 : audit [DBG] from='client.356181 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:59:38.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:59:37 smithi157 bash[24585]: cluster 2024-09-16T11:59:36.188584+0000 mgr.a (mgr.14373) 16537 : cluster [DBG] pgmap v11470: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:59:38.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:59:37 smithi086 bash[24289]: cluster 2024-09-16T11:59:36.188584+0000 mgr.a (mgr.14373) 16537 : cluster [DBG] pgmap v11470: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:59:38.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:59:37 smithi047 bash[22744]: cluster 2024-09-16T11:59:36.188584+0000 mgr.a (mgr.14373) 16537 : cluster [DBG] pgmap v11470: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:59:40.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:59:39 smithi157 bash[24585]: cluster 2024-09-16T11:59:38.190848+0000 mgr.a (mgr.14373) 16538 : cluster [DBG] pgmap v11471: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:59:40.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:59:39 smithi086 bash[24289]: cluster 2024-09-16T11:59:38.190848+0000 mgr.a (mgr.14373) 16538 : cluster [DBG] pgmap v11471: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:59:40.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:59:39 smithi047 bash[22744]: cluster 2024-09-16T11:59:38.190848+0000 mgr.a (mgr.14373) 16538 : cluster [DBG] pgmap v11471: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:59:40.478 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:59:40.479 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:59:40.479 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:59:41.230 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:59:41.230 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:59:41.230 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:59:41.230 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:59:41.230 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:59:42.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:59:41 smithi157 bash[24585]: cluster 2024-09-16T11:59:40.191597+0000 mgr.a (mgr.14373) 16539 : cluster [DBG] pgmap v11472: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:59:42.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:59:41 smithi086 bash[24289]: cluster 2024-09-16T11:59:40.191597+0000 mgr.a (mgr.14373) 16539 : cluster [DBG] pgmap v11472: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:59:42.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:59:41 smithi047 bash[22744]: cluster 2024-09-16T11:59:40.191597+0000 mgr.a (mgr.14373) 16539 : cluster [DBG] pgmap v11472: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:59:43.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:59:42 smithi157 bash[24585]: audit 2024-09-16T11:59:40.808479+0000 mgr.a (mgr.14373) 16540 : audit [DBG] from='client.356256 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:59:43.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:59:42 smithi086 bash[24289]: audit 2024-09-16T11:59:40.808479+0000 mgr.a (mgr.14373) 16540 : audit [DBG] from='client.356256 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:59:43.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:59:42 smithi047 bash[22744]: audit 2024-09-16T11:59:40.808479+0000 mgr.a (mgr.14373) 16540 : audit [DBG] from='client.356256 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:59:44.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:59:43 smithi157 bash[24585]: cluster 2024-09-16T11:59:42.193850+0000 mgr.a (mgr.14373) 16541 : cluster [DBG] pgmap v11473: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:59:44.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:59:43 smithi086 bash[24289]: cluster 2024-09-16T11:59:42.193850+0000 mgr.a (mgr.14373) 16541 : cluster [DBG] pgmap v11473: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:59:44.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:59:43 smithi047 bash[22744]: cluster 2024-09-16T11:59:42.193850+0000 mgr.a (mgr.14373) 16541 : cluster [DBG] pgmap v11473: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T11:59:46.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:59:45 smithi157 bash[24585]: cluster 2024-09-16T11:59:44.194639+0000 mgr.a (mgr.14373) 16542 : cluster [DBG] pgmap v11474: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:59:46.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:59:45 smithi086 bash[24289]: cluster 2024-09-16T11:59:44.194639+0000 mgr.a (mgr.14373) 16542 : cluster [DBG] pgmap v11474: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:59:46.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:59:45 smithi047 bash[22744]: cluster 2024-09-16T11:59:44.194639+0000 mgr.a (mgr.14373) 16542 : cluster [DBG] pgmap v11474: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:59:46.231 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:59:46.232 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:59:46.232 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:59:46.989 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:59:46.990 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:59:46.990 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:59:46.990 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:59:46.990 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:59:48.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:59:47 smithi157 bash[24585]: cluster 2024-09-16T11:59:46.195402+0000 mgr.a (mgr.14373) 16543 : cluster [DBG] pgmap v11475: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:59:48.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:59:47 smithi157 bash[24585]: audit 2024-09-16T11:59:46.557941+0000 mgr.a (mgr.14373) 16544 : audit [DBG] from='client.356334 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:59:48.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:59:47 smithi086 bash[24289]: cluster 2024-09-16T11:59:46.195402+0000 mgr.a (mgr.14373) 16543 : cluster [DBG] pgmap v11475: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:59:48.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:59:47 smithi086 bash[24289]: audit 2024-09-16T11:59:46.557941+0000 mgr.a (mgr.14373) 16544 : audit [DBG] from='client.356334 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:59:48.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:59:47 smithi047 bash[22744]: cluster 2024-09-16T11:59:46.195402+0000 mgr.a (mgr.14373) 16543 : cluster [DBG] pgmap v11475: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:59:48.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:59:47 smithi047 bash[22744]: audit 2024-09-16T11:59:46.557941+0000 mgr.a (mgr.14373) 16544 : audit [DBG] from='client.356334 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:59:50.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:59:49 smithi157 bash[24585]: cluster 2024-09-16T11:59:48.198065+0000 mgr.a (mgr.14373) 16545 : cluster [DBG] pgmap v11476: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:59:50.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:59:49 smithi086 bash[24289]: cluster 2024-09-16T11:59:48.198065+0000 mgr.a (mgr.14373) 16545 : cluster [DBG] pgmap v11476: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:59:50.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:59:49 smithi047 bash[22744]: cluster 2024-09-16T11:59:48.198065+0000 mgr.a (mgr.14373) 16545 : cluster [DBG] pgmap v11476: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:59:51.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:59:50 smithi157 bash[24585]: audit 2024-09-16T11:59:50.549824+0000 mon.b (mon.2) 1502 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T11:59:51.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:59:50 smithi086 bash[24289]: audit 2024-09-16T11:59:50.549824+0000 mon.b (mon.2) 1502 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T11:59:51.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:59:50 smithi047 bash[22744]: audit 2024-09-16T11:59:50.549824+0000 mon.b (mon.2) 1502 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T11:59:51.991 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:59:51.991 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:59:51.992 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:59:52.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:59:51 smithi157 bash[24585]: cluster 2024-09-16T11:59:50.198843+0000 mgr.a (mgr.14373) 16546 : cluster [DBG] pgmap v11477: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:59:52.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:59:51 smithi157 bash[24585]: audit 2024-09-16T11:59:51.385815+0000 mon.b (mon.2) 1503 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T11:59:52.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:59:51 smithi157 bash[24585]: audit 2024-09-16T11:59:51.387980+0000 mon.b (mon.2) 1504 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T11:59:52.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:59:51 smithi157 bash[24585]: audit 2024-09-16T11:59:51.399292+0000 mon.a (mon.0) 1555 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:59:52.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:59:51 smithi157 bash[24585]: audit 2024-09-16T11:59:51.407495+0000 mon.b (mon.2) 1505 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:59:52.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:59:51 smithi086 bash[24289]: cluster 2024-09-16T11:59:50.198843+0000 mgr.a (mgr.14373) 16546 : cluster [DBG] pgmap v11477: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:59:52.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:59:51 smithi086 bash[24289]: audit 2024-09-16T11:59:51.385815+0000 mon.b (mon.2) 1503 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T11:59:52.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:59:51 smithi086 bash[24289]: audit 2024-09-16T11:59:51.387980+0000 mon.b (mon.2) 1504 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T11:59:52.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:59:51 smithi086 bash[24289]: audit 2024-09-16T11:59:51.399292+0000 mon.a (mon.0) 1555 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:59:52.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:59:51 smithi086 bash[24289]: audit 2024-09-16T11:59:51.407495+0000 mon.b (mon.2) 1505 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:59:52.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:59:51 smithi047 bash[22744]: cluster 2024-09-16T11:59:50.198843+0000 mgr.a (mgr.14373) 16546 : cluster [DBG] pgmap v11477: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T11:59:52.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:59:51 smithi047 bash[22744]: audit 2024-09-16T11:59:51.385815+0000 mon.b (mon.2) 1503 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T11:59:52.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:59:51 smithi047 bash[22744]: audit 2024-09-16T11:59:51.387980+0000 mon.b (mon.2) 1504 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T11:59:52.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:59:51 smithi047 bash[22744]: audit 2024-09-16T11:59:51.399292+0000 mon.a (mon.0) 1555 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T11:59:52.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:59:51 smithi047 bash[22744]: audit 2024-09-16T11:59:51.407495+0000 mon.b (mon.2) 1505 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:59:52.592 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 11:59:52 smithi047 bash[22994]: debug 2024-09-16T11:59:52.153+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T11:59:52.593 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 11:59:52 smithi047 bash[22994]: debug 2024-09-16T11:59:52.157+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T11:59:52.727 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:59:52.728 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:59:52.728 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:59:52.728 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:59:52.728 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T11:59:53.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:59:52 smithi157 bash[24585]: audit 2024-09-16T11:59:51.410005+0000 mgr.a (mgr.14373) 16547 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:59:53.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:59:52 smithi086 bash[24289]: audit 2024-09-16T11:59:51.410005+0000 mgr.a (mgr.14373) 16547 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:59:53.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:59:52 smithi047 bash[22744]: audit 2024-09-16T11:59:51.410005+0000 mgr.a (mgr.14373) 16547 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T11:59:54.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:59:53 smithi157 bash[24585]: audit 2024-09-16T11:59:52.156920+0000 mgr.a (mgr.14373) 16548 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T11:59:54.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:59:53 smithi157 bash[24585]: cephadm 2024-09-16T11:59:52.158790+0000 mgr.a (mgr.14373) 16549 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T11:59:54.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:59:53 smithi157 bash[24585]: cluster 2024-09-16T11:59:52.199997+0000 mgr.a (mgr.14373) 16550 : cluster [DBG] pgmap v11478: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:59:54.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:59:53 smithi157 bash[24585]: audit 2024-09-16T11:59:52.304316+0000 mgr.a (mgr.14373) 16551 : audit [DBG] from='client.356514 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:59:54.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:59:53 smithi086 bash[24289]: audit 2024-09-16T11:59:52.156920+0000 mgr.a (mgr.14373) 16548 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T11:59:54.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:59:53 smithi086 bash[24289]: cephadm 2024-09-16T11:59:52.158790+0000 mgr.a (mgr.14373) 16549 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T11:59:54.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:59:53 smithi086 bash[24289]: cluster 2024-09-16T11:59:52.199997+0000 mgr.a (mgr.14373) 16550 : cluster [DBG] pgmap v11478: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:59:54.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:59:53 smithi086 bash[24289]: audit 2024-09-16T11:59:52.304316+0000 mgr.a (mgr.14373) 16551 : audit [DBG] from='client.356514 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:59:54.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:59:53 smithi047 bash[22744]: audit 2024-09-16T11:59:52.156920+0000 mgr.a (mgr.14373) 16548 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T11:59:54.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:59:53 smithi047 bash[22744]: cephadm 2024-09-16T11:59:52.158790+0000 mgr.a (mgr.14373) 16549 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T11:59:54.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:59:53 smithi047 bash[22744]: cluster 2024-09-16T11:59:52.199997+0000 mgr.a (mgr.14373) 16550 : cluster [DBG] pgmap v11478: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T11:59:54.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:59:53 smithi047 bash[22744]: audit 2024-09-16T11:59:52.304316+0000 mgr.a (mgr.14373) 16551 : audit [DBG] from='client.356514 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T11:59:56.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:59:55 smithi157 bash[24585]: cluster 2024-09-16T11:59:54.200811+0000 mgr.a (mgr.14373) 16552 : cluster [DBG] pgmap v11479: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T11:59:56.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:59:55 smithi086 bash[24289]: cluster 2024-09-16T11:59:54.200811+0000 mgr.a (mgr.14373) 16552 : cluster [DBG] pgmap v11479: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T11:59:56.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:59:55 smithi047 bash[22744]: cluster 2024-09-16T11:59:54.200811+0000 mgr.a (mgr.14373) 16552 : cluster [DBG] pgmap v11479: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T11:59:57.729 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T11:59:57.729 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T11:59:57.730 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T11:59:58.058 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:59:57 smithi157 bash[24585]: cluster 2024-09-16T11:59:56.201576+0000 mgr.a (mgr.14373) 16553 : cluster [DBG] pgmap v11480: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T11:59:58.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:59:57 smithi086 bash[24289]: cluster 2024-09-16T11:59:56.201576+0000 mgr.a (mgr.14373) 16553 : cluster [DBG] pgmap v11480: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T11:59:58.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:59:57 smithi047 bash[22744]: cluster 2024-09-16T11:59:56.201576+0000 mgr.a (mgr.14373) 16553 : cluster [DBG] pgmap v11480: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T11:59:58.500 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T11:59:58.501 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T11:59:58.501 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T11:59:58.501 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T11:59:58.501 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:00:00.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:59:59 smithi157 bash[24585]: audit 2024-09-16T11:59:58.063547+0000 mgr.a (mgr.14373) 16554 : audit [DBG] from='client.356589 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:00:00.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 11:59:59 smithi157 bash[24585]: cluster 2024-09-16T11:59:58.208570+0000 mgr.a (mgr.14373) 16555 : cluster [DBG] pgmap v11481: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:00:00.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:59:59 smithi086 bash[24289]: audit 2024-09-16T11:59:58.063547+0000 mgr.a (mgr.14373) 16554 : audit [DBG] from='client.356589 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:00:00.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 11:59:59 smithi086 bash[24289]: cluster 2024-09-16T11:59:58.208570+0000 mgr.a (mgr.14373) 16555 : cluster [DBG] pgmap v11481: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:00:00.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:59:59 smithi047 bash[22744]: audit 2024-09-16T11:59:58.063547+0000 mgr.a (mgr.14373) 16554 : audit [DBG] from='client.356589 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:00:00.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 11:59:59 smithi047 bash[22744]: cluster 2024-09-16T11:59:58.208570+0000 mgr.a (mgr.14373) 16555 : cluster [DBG] pgmap v11481: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:00:01.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:00:00 smithi157 bash[24585]: cluster 2024-09-16T12:00:00.000147+0000 mon.a (mon.0) 1556 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-16T12:00:01.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:00:00 smithi086 bash[24289]: cluster 2024-09-16T12:00:00.000147+0000 mon.a (mon.0) 1556 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-16T12:00:01.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:00:00 smithi047 bash[22744]: cluster 2024-09-16T12:00:00.000147+0000 mon.a (mon.0) 1556 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-16T12:00:02.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:00:01 smithi157 bash[24585]: cluster 2024-09-16T12:00:00.209441+0000 mgr.a (mgr.14373) 16556 : cluster [DBG] pgmap v11482: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:00:02.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:00:01 smithi086 bash[24289]: cluster 2024-09-16T12:00:00.209441+0000 mgr.a (mgr.14373) 16556 : cluster [DBG] pgmap v11482: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:00:02.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:00:01 smithi047 bash[22744]: cluster 2024-09-16T12:00:00.209441+0000 mgr.a (mgr.14373) 16556 : cluster [DBG] pgmap v11482: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:00:03.502 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:00:03.503 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:00:03.503 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:00:04.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:00:03 smithi157 bash[24585]: cluster 2024-09-16T12:00:02.211690+0000 mgr.a (mgr.14373) 16557 : cluster [DBG] pgmap v11483: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:00:04.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:00:03 smithi086 bash[24289]: cluster 2024-09-16T12:00:02.211690+0000 mgr.a (mgr.14373) 16557 : cluster [DBG] pgmap v11483: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:00:04.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:00:03 smithi047 bash[22744]: cluster 2024-09-16T12:00:02.211690+0000 mgr.a (mgr.14373) 16557 : cluster [DBG] pgmap v11483: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:00:04.287 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:00:04.288 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:00:04.288 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:00:04.288 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:00:04.288 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:00:06.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:00:05 smithi157 bash[24585]: audit 2024-09-16T12:00:03.840142+0000 mgr.a (mgr.14373) 16558 : audit [DBG] from='client.356667 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:00:06.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:00:05 smithi157 bash[24585]: cluster 2024-09-16T12:00:04.212239+0000 mgr.a (mgr.14373) 16559 : cluster [DBG] pgmap v11484: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:00:06.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:00:05 smithi086 bash[24289]: audit 2024-09-16T12:00:03.840142+0000 mgr.a (mgr.14373) 16558 : audit [DBG] from='client.356667 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:00:06.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:00:05 smithi086 bash[24289]: cluster 2024-09-16T12:00:04.212239+0000 mgr.a (mgr.14373) 16559 : cluster [DBG] pgmap v11484: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:00:06.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:00:05 smithi047 bash[22744]: audit 2024-09-16T12:00:03.840142+0000 mgr.a (mgr.14373) 16558 : audit [DBG] from='client.356667 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:00:06.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:00:05 smithi047 bash[22744]: cluster 2024-09-16T12:00:04.212239+0000 mgr.a (mgr.14373) 16559 : cluster [DBG] pgmap v11484: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:00:08.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:00:07 smithi157 bash[24585]: cluster 2024-09-16T12:00:06.212989+0000 mgr.a (mgr.14373) 16560 : cluster [DBG] pgmap v11485: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:00:08.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:00:07 smithi086 bash[24289]: cluster 2024-09-16T12:00:06.212989+0000 mgr.a (mgr.14373) 16560 : cluster [DBG] pgmap v11485: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:00:08.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:00:07 smithi047 bash[22744]: cluster 2024-09-16T12:00:06.212989+0000 mgr.a (mgr.14373) 16560 : cluster [DBG] pgmap v11485: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:00:09.289 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:00:09.290 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:00:09.290 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:00:10.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:00:09 smithi157 bash[24585]: cluster 2024-09-16T12:00:08.215221+0000 mgr.a (mgr.14373) 16561 : cluster [DBG] pgmap v11486: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:00:10.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:00:09 smithi086 bash[24289]: cluster 2024-09-16T12:00:08.215221+0000 mgr.a (mgr.14373) 16561 : cluster [DBG] pgmap v11486: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:00:10.076 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:00:10.076 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:00:10.076 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:00:10.076 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:00:10.077 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:00:10.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:00:09 smithi047 bash[22744]: cluster 2024-09-16T12:00:08.215221+0000 mgr.a (mgr.14373) 16561 : cluster [DBG] pgmap v11486: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:00:11.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:00:10 smithi157 bash[24585]: audit 2024-09-16T12:00:09.625058+0000 mgr.a (mgr.14373) 16562 : audit [DBG] from='client.356742 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:00:11.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:00:10 smithi086 bash[24289]: audit 2024-09-16T12:00:09.625058+0000 mgr.a (mgr.14373) 16562 : audit [DBG] from='client.356742 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:00:11.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:00:10 smithi047 bash[22744]: audit 2024-09-16T12:00:09.625058+0000 mgr.a (mgr.14373) 16562 : audit [DBG] from='client.356742 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:00:12.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:00:11 smithi157 bash[24585]: cluster 2024-09-16T12:00:10.216192+0000 mgr.a (mgr.14373) 16563 : cluster [DBG] pgmap v11487: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:00:12.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:00:11 smithi086 bash[24289]: cluster 2024-09-16T12:00:10.216192+0000 mgr.a (mgr.14373) 16563 : cluster [DBG] pgmap v11487: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:00:12.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:00:11 smithi047 bash[22744]: cluster 2024-09-16T12:00:10.216192+0000 mgr.a (mgr.14373) 16563 : cluster [DBG] pgmap v11487: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:00:13.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:00:12 smithi157 bash[24585]: cluster 2024-09-16T12:00:12.218492+0000 mgr.a (mgr.14373) 16564 : cluster [DBG] pgmap v11488: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:00:13.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:00:12 smithi086 bash[24289]: cluster 2024-09-16T12:00:12.218492+0000 mgr.a (mgr.14373) 16564 : cluster [DBG] pgmap v11488: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:00:13.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:00:12 smithi047 bash[22744]: cluster 2024-09-16T12:00:12.218492+0000 mgr.a (mgr.14373) 16564 : cluster [DBG] pgmap v11488: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:00:15.078 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:00:15.078 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:00:15.078 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:00:15.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:00:15 smithi157 bash[24585]: cluster 2024-09-16T12:00:14.219249+0000 mgr.a (mgr.14373) 16565 : cluster [DBG] pgmap v11489: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:00:15.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:00:15 smithi086 bash[24289]: cluster 2024-09-16T12:00:14.219249+0000 mgr.a (mgr.14373) 16565 : cluster [DBG] pgmap v11489: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:00:15.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:00:15 smithi047 bash[22744]: cluster 2024-09-16T12:00:14.219249+0000 mgr.a (mgr.14373) 16565 : cluster [DBG] pgmap v11489: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:00:15.861 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:00:15.861 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:00:15.861 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:00:15.861 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:00:15.861 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:00:16.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:00:16 smithi157 bash[24585]: audit 2024-09-16T12:00:15.417559+0000 mgr.a (mgr.14373) 16566 : audit [DBG] from='client.356820 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:00:16.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:00:16 smithi086 bash[24289]: audit 2024-09-16T12:00:15.417559+0000 mgr.a (mgr.14373) 16566 : audit [DBG] from='client.356820 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:00:16.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:00:16 smithi047 bash[22744]: audit 2024-09-16T12:00:15.417559+0000 mgr.a (mgr.14373) 16566 : audit [DBG] from='client.356820 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:00:17.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:00:17 smithi157 bash[24585]: cluster 2024-09-16T12:00:16.220224+0000 mgr.a (mgr.14373) 16567 : cluster [DBG] pgmap v11490: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:00:17.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:00:17 smithi086 bash[24289]: cluster 2024-09-16T12:00:16.220224+0000 mgr.a (mgr.14373) 16567 : cluster [DBG] pgmap v11490: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:00:17.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:00:17 smithi047 bash[22744]: cluster 2024-09-16T12:00:16.220224+0000 mgr.a (mgr.14373) 16567 : cluster [DBG] pgmap v11490: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:00:19.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:00:19 smithi157 bash[24585]: cluster 2024-09-16T12:00:18.222519+0000 mgr.a (mgr.14373) 16568 : cluster [DBG] pgmap v11491: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:00:19.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:00:19 smithi086 bash[24289]: cluster 2024-09-16T12:00:18.222519+0000 mgr.a (mgr.14373) 16568 : cluster [DBG] pgmap v11491: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:00:19.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:00:19 smithi047 bash[22744]: cluster 2024-09-16T12:00:18.222519+0000 mgr.a (mgr.14373) 16568 : cluster [DBG] pgmap v11491: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:00:20.862 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:00:20.863 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:00:20.863 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:00:21.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:00:21 smithi157 bash[24585]: cluster 2024-09-16T12:00:20.223262+0000 mgr.a (mgr.14373) 16569 : cluster [DBG] pgmap v11492: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:00:21.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:00:21 smithi086 bash[24289]: cluster 2024-09-16T12:00:20.223262+0000 mgr.a (mgr.14373) 16569 : cluster [DBG] pgmap v11492: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:00:21.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:00:21 smithi047 bash[22744]: cluster 2024-09-16T12:00:20.223262+0000 mgr.a (mgr.14373) 16569 : cluster [DBG] pgmap v11492: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:00:21.643 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:00:21.644 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:00:21.644 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:00:21.644 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:00:21.644 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:00:22.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:00:22 smithi157 bash[24585]: audit 2024-09-16T12:00:21.196425+0000 mgr.a (mgr.14373) 16570 : audit [DBG] from='client.356898 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:00:22.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:00:22 smithi086 bash[24289]: audit 2024-09-16T12:00:21.196425+0000 mgr.a (mgr.14373) 16570 : audit [DBG] from='client.356898 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:00:22.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:00:22 smithi047 bash[22744]: audit 2024-09-16T12:00:21.196425+0000 mgr.a (mgr.14373) 16570 : audit [DBG] from='client.356898 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:00:23.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:00:23 smithi086 bash[24289]: cluster 2024-09-16T12:00:22.225582+0000 mgr.a (mgr.14373) 16571 : cluster [DBG] pgmap v11493: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-16T12:00:23.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:00:23 smithi047 bash[22744]: cluster 2024-09-16T12:00:22.225582+0000 mgr.a (mgr.14373) 16571 : cluster [DBG] pgmap v11493: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-16T12:00:23.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:00:23 smithi157 bash[24585]: cluster 2024-09-16T12:00:22.225582+0000 mgr.a (mgr.14373) 16571 : cluster [DBG] pgmap v11493: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-16T12:00:25.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:00:25 smithi086 bash[24289]: cluster 2024-09-16T12:00:24.226384+0000 mgr.a (mgr.14373) 16572 : cluster [DBG] pgmap v11494: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T12:00:25.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:00:25 smithi047 bash[22744]: cluster 2024-09-16T12:00:24.226384+0000 mgr.a (mgr.14373) 16572 : cluster [DBG] pgmap v11494: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T12:00:25.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:00:25 smithi157 bash[24585]: cluster 2024-09-16T12:00:24.226384+0000 mgr.a (mgr.14373) 16572 : cluster [DBG] pgmap v11494: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T12:00:26.645 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:00:26.646 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:00:26.646 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:00:27.404 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:00:27.404 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:00:27.404 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:00:27.405 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:00:27.405 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:00:27.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:00:27 smithi086 bash[24289]: cluster 2024-09-16T12:00:26.227112+0000 mgr.a (mgr.14373) 16573 : cluster [DBG] pgmap v11495: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T12:00:27.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:00:27 smithi047 bash[22744]: cluster 2024-09-16T12:00:26.227112+0000 mgr.a (mgr.14373) 16573 : cluster [DBG] pgmap v11495: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T12:00:27.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:00:27 smithi157 bash[24585]: cluster 2024-09-16T12:00:26.227112+0000 mgr.a (mgr.14373) 16573 : cluster [DBG] pgmap v11495: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T12:00:28.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:00:28 smithi047 bash[22744]: audit 2024-09-16T12:00:26.976833+0000 mgr.a (mgr.14373) 16574 : audit [DBG] from='client.356970 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:00:28.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:00:28 smithi157 bash[24585]: audit 2024-09-16T12:00:26.976833+0000 mgr.a (mgr.14373) 16574 : audit [DBG] from='client.356970 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:00:28.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:00:28 smithi086 bash[24289]: audit 2024-09-16T12:00:26.976833+0000 mgr.a (mgr.14373) 16574 : audit [DBG] from='client.356970 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:00:29.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:00:29 smithi047 bash[22744]: cluster 2024-09-16T12:00:28.229792+0000 mgr.a (mgr.14373) 16575 : cluster [DBG] pgmap v11496: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:00:29.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:00:29 smithi157 bash[24585]: cluster 2024-09-16T12:00:28.229792+0000 mgr.a (mgr.14373) 16575 : cluster [DBG] pgmap v11496: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:00:29.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:00:29 smithi086 bash[24289]: cluster 2024-09-16T12:00:28.229792+0000 mgr.a (mgr.14373) 16575 : cluster [DBG] pgmap v11496: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:00:31.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:00:31 smithi047 bash[22744]: cluster 2024-09-16T12:00:30.230563+0000 mgr.a (mgr.14373) 16576 : cluster [DBG] pgmap v11497: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:00:31.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:00:31 smithi157 bash[24585]: cluster 2024-09-16T12:00:30.230563+0000 mgr.a (mgr.14373) 16576 : cluster [DBG] pgmap v11497: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:00:31.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:00:31 smithi086 bash[24289]: cluster 2024-09-16T12:00:30.230563+0000 mgr.a (mgr.14373) 16576 : cluster [DBG] pgmap v11497: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:00:32.406 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:00:32.407 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:00:32.407 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:00:33.139 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:00:33.140 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:00:33.140 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:00:33.140 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:00:33.140 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:00:33.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:00:33 smithi047 bash[22744]: cluster 2024-09-16T12:00:32.232487+0000 mgr.a (mgr.14373) 16577 : cluster [DBG] pgmap v11498: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:00:33.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:00:33 smithi157 bash[24585]: cluster 2024-09-16T12:00:32.232487+0000 mgr.a (mgr.14373) 16577 : cluster [DBG] pgmap v11498: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:00:33.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:00:33 smithi086 bash[24289]: cluster 2024-09-16T12:00:32.232487+0000 mgr.a (mgr.14373) 16577 : cluster [DBG] pgmap v11498: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:00:34.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:00:34 smithi047 bash[22744]: audit 2024-09-16T12:00:32.734535+0000 mgr.a (mgr.14373) 16578 : audit [DBG] from='client.357048 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:00:34.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:00:34 smithi157 bash[24585]: audit 2024-09-16T12:00:32.734535+0000 mgr.a (mgr.14373) 16578 : audit [DBG] from='client.357048 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:00:34.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:00:34 smithi086 bash[24289]: audit 2024-09-16T12:00:32.734535+0000 mgr.a (mgr.14373) 16578 : audit [DBG] from='client.357048 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:00:35.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:00:35 smithi157 bash[24585]: cluster 2024-09-16T12:00:34.233358+0000 mgr.a (mgr.14373) 16579 : cluster [DBG] pgmap v11499: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-16T12:00:35.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:00:35 smithi086 bash[24289]: cluster 2024-09-16T12:00:34.233358+0000 mgr.a (mgr.14373) 16579 : cluster [DBG] pgmap v11499: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-16T12:00:35.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:00:35 smithi047 bash[22744]: cluster 2024-09-16T12:00:34.233358+0000 mgr.a (mgr.14373) 16579 : cluster [DBG] pgmap v11499: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-16T12:00:37.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:00:37 smithi157 bash[24585]: cluster 2024-09-16T12:00:36.234140+0000 mgr.a (mgr.14373) 16580 : cluster [DBG] pgmap v11500: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-16T12:00:37.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:00:37 smithi086 bash[24289]: cluster 2024-09-16T12:00:36.234140+0000 mgr.a (mgr.14373) 16580 : cluster [DBG] pgmap v11500: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-16T12:00:37.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:00:37 smithi047 bash[22744]: cluster 2024-09-16T12:00:36.234140+0000 mgr.a (mgr.14373) 16580 : cluster [DBG] pgmap v11500: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-16T12:00:38.141 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:00:38.141 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:00:38.142 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:00:38.913 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:00:38.913 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:00:38.914 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:00:38.914 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:00:38.914 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:00:39.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:00:39 smithi157 bash[24585]: cluster 2024-09-16T12:00:38.235923+0000 mgr.a (mgr.14373) 16581 : cluster [DBG] pgmap v11501: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-16T12:00:39.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:00:39 smithi157 bash[24585]: audit 2024-09-16T12:00:38.476186+0000 mgr.a (mgr.14373) 16582 : audit [DBG] from='client.357126 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:00:39.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:00:39 smithi086 bash[24289]: cluster 2024-09-16T12:00:38.235923+0000 mgr.a (mgr.14373) 16581 : cluster [DBG] pgmap v11501: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-16T12:00:39.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:00:39 smithi086 bash[24289]: audit 2024-09-16T12:00:38.476186+0000 mgr.a (mgr.14373) 16582 : audit [DBG] from='client.357126 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:00:39.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:00:39 smithi047 bash[22744]: cluster 2024-09-16T12:00:38.235923+0000 mgr.a (mgr.14373) 16581 : cluster [DBG] pgmap v11501: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-16T12:00:39.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:00:39 smithi047 bash[22744]: audit 2024-09-16T12:00:38.476186+0000 mgr.a (mgr.14373) 16582 : audit [DBG] from='client.357126 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:00:41.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:00:41 smithi157 bash[24585]: cluster 2024-09-16T12:00:40.236826+0000 mgr.a (mgr.14373) 16583 : cluster [DBG] pgmap v11502: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:00:41.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:00:41 smithi086 bash[24289]: cluster 2024-09-16T12:00:40.236826+0000 mgr.a (mgr.14373) 16583 : cluster [DBG] pgmap v11502: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:00:41.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:00:41 smithi047 bash[22744]: cluster 2024-09-16T12:00:40.236826+0000 mgr.a (mgr.14373) 16583 : cluster [DBG] pgmap v11502: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:00:43.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:00:43 smithi157 bash[24585]: cluster 2024-09-16T12:00:42.238999+0000 mgr.a (mgr.14373) 16584 : cluster [DBG] pgmap v11503: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:00:43.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:00:43 smithi086 bash[24289]: cluster 2024-09-16T12:00:42.238999+0000 mgr.a (mgr.14373) 16584 : cluster [DBG] pgmap v11503: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:00:43.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:00:43 smithi047 bash[22744]: cluster 2024-09-16T12:00:42.238999+0000 mgr.a (mgr.14373) 16584 : cluster [DBG] pgmap v11503: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:00:43.915 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:00:43.915 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:00:43.916 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:00:44.693 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:00:44.693 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:00:44.693 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:00:44.693 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:00:44.693 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:00:45.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:00:45 smithi157 bash[24585]: cluster 2024-09-16T12:00:44.239730+0000 mgr.a (mgr.14373) 16585 : cluster [DBG] pgmap v11504: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:00:45.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:00:45 smithi157 bash[24585]: audit 2024-09-16T12:00:44.254454+0000 mgr.a (mgr.14373) 16586 : audit [DBG] from='client.357201 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:00:45.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:00:45 smithi086 bash[24289]: cluster 2024-09-16T12:00:44.239730+0000 mgr.a (mgr.14373) 16585 : cluster [DBG] pgmap v11504: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:00:45.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:00:45 smithi086 bash[24289]: audit 2024-09-16T12:00:44.254454+0000 mgr.a (mgr.14373) 16586 : audit [DBG] from='client.357201 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:00:45.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:00:45 smithi047 bash[22744]: cluster 2024-09-16T12:00:44.239730+0000 mgr.a (mgr.14373) 16585 : cluster [DBG] pgmap v11504: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:00:45.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:00:45 smithi047 bash[22744]: audit 2024-09-16T12:00:44.254454+0000 mgr.a (mgr.14373) 16586 : audit [DBG] from='client.357201 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:00:47.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:00:47 smithi157 bash[24585]: cluster 2024-09-16T12:00:46.240616+0000 mgr.a (mgr.14373) 16587 : cluster [DBG] pgmap v11505: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:00:47.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:00:47 smithi086 bash[24289]: cluster 2024-09-16T12:00:46.240616+0000 mgr.a (mgr.14373) 16587 : cluster [DBG] pgmap v11505: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:00:47.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:00:47 smithi047 bash[22744]: cluster 2024-09-16T12:00:46.240616+0000 mgr.a (mgr.14373) 16587 : cluster [DBG] pgmap v11505: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:00:49.695 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:00:49.696 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:00:49.696 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:00:49.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:00:49 smithi157 bash[24585]: cluster 2024-09-16T12:00:48.242836+0000 mgr.a (mgr.14373) 16588 : cluster [DBG] pgmap v11506: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:00:49.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:00:49 smithi086 bash[24289]: cluster 2024-09-16T12:00:48.242836+0000 mgr.a (mgr.14373) 16588 : cluster [DBG] pgmap v11506: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:00:49.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:00:49 smithi047 bash[22744]: cluster 2024-09-16T12:00:48.242836+0000 mgr.a (mgr.14373) 16588 : cluster [DBG] pgmap v11506: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:00:50.444 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:00:50.444 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:00:50.445 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:00:50.445 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:00:50.445 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:00:51.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:00:51 smithi157 bash[24585]: audit 2024-09-16T12:00:50.022739+0000 mgr.a (mgr.14373) 16589 : audit [DBG] from='client.357276 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:00:51.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:00:51 smithi157 bash[24585]: cluster 2024-09-16T12:00:50.252492+0000 mgr.a (mgr.14373) 16590 : cluster [DBG] pgmap v11507: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:00:51.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:00:51 smithi086 bash[24289]: audit 2024-09-16T12:00:50.022739+0000 mgr.a (mgr.14373) 16589 : audit [DBG] from='client.357276 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:00:51.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:00:51 smithi086 bash[24289]: cluster 2024-09-16T12:00:50.252492+0000 mgr.a (mgr.14373) 16590 : cluster [DBG] pgmap v11507: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:00:51.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:00:51 smithi047 bash[22744]: audit 2024-09-16T12:00:50.022739+0000 mgr.a (mgr.14373) 16589 : audit [DBG] from='client.357276 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:00:51.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:00:51 smithi047 bash[22744]: cluster 2024-09-16T12:00:50.252492+0000 mgr.a (mgr.14373) 16590 : cluster [DBG] pgmap v11507: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:00:52.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:00:52 smithi157 bash[24585]: audit 2024-09-16T12:00:52.206886+0000 mon.b (mon.2) 1506 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T12:00:52.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:00:52 smithi086 bash[24289]: audit 2024-09-16T12:00:52.206886+0000 mon.b (mon.2) 1506 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T12:00:52.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:00:52 smithi047 bash[22744]: audit 2024-09-16T12:00:52.206886+0000 mon.b (mon.2) 1506 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T12:00:53.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:00:53 smithi157 bash[24585]: cluster 2024-09-16T12:00:52.254839+0000 mgr.a (mgr.14373) 16591 : cluster [DBG] pgmap v11508: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:00:53.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:00:53 smithi157 bash[24585]: audit 2024-09-16T12:00:53.050440+0000 mon.b (mon.2) 1507 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T12:00:53.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:00:53 smithi157 bash[24585]: audit 2024-09-16T12:00:53.052659+0000 mon.b (mon.2) 1508 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T12:00:53.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:00:53 smithi157 bash[24585]: audit 2024-09-16T12:00:53.064550+0000 mon.a (mon.0) 1557 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:00:53.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:00:53 smithi157 bash[24585]: audit 2024-09-16T12:00:53.071295+0000 mon.b (mon.2) 1509 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:00:53.820 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:00:53 smithi047 bash[22744]: cluster 2024-09-16T12:00:52.254839+0000 mgr.a (mgr.14373) 16591 : cluster [DBG] pgmap v11508: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:00:53.820 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:00:53 smithi047 bash[22744]: audit 2024-09-16T12:00:53.050440+0000 mon.b (mon.2) 1507 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T12:00:53.820 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:00:53 smithi047 bash[22744]: audit 2024-09-16T12:00:53.052659+0000 mon.b (mon.2) 1508 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T12:00:53.820 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:00:53 smithi047 bash[22744]: audit 2024-09-16T12:00:53.064550+0000 mon.a (mon.0) 1557 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:00:53.820 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:00:53 smithi047 bash[22744]: audit 2024-09-16T12:00:53.071295+0000 mon.b (mon.2) 1509 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:00:53.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:00:53 smithi086 bash[24289]: cluster 2024-09-16T12:00:52.254839+0000 mgr.a (mgr.14373) 16591 : cluster [DBG] pgmap v11508: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:00:53.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:00:53 smithi086 bash[24289]: audit 2024-09-16T12:00:53.050440+0000 mon.b (mon.2) 1507 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T12:00:53.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:00:53 smithi086 bash[24289]: audit 2024-09-16T12:00:53.052659+0000 mon.b (mon.2) 1508 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T12:00:53.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:00:53 smithi086 bash[24289]: audit 2024-09-16T12:00:53.064550+0000 mon.a (mon.0) 1557 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:00:53.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:00:53 smithi086 bash[24289]: audit 2024-09-16T12:00:53.071295+0000 mon.b (mon.2) 1509 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:00:54.093 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 12:00:53 smithi047 bash[22994]: debug 2024-09-16T12:00:53.816+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T12:00:54.093 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 12:00:53 smithi047 bash[22994]: debug 2024-09-16T12:00:53.816+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T12:00:54.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:00:54 smithi157 bash[24585]: audit 2024-09-16T12:00:53.073845+0000 mgr.a (mgr.14373) 16592 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:00:54.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:00:54 smithi086 bash[24289]: audit 2024-09-16T12:00:53.073845+0000 mgr.a (mgr.14373) 16592 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:00:54.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:00:54 smithi047 bash[22744]: audit 2024-09-16T12:00:53.073845+0000 mgr.a (mgr.14373) 16592 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:00:55.446 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:00:55.447 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:00:55.447 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:00:55.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:00:55 smithi157 bash[24585]: audit 2024-09-16T12:00:53.818683+0000 mgr.a (mgr.14373) 16593 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T12:00:55.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:00:55 smithi157 bash[24585]: cephadm 2024-09-16T12:00:53.820698+0000 mgr.a (mgr.14373) 16594 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T12:00:55.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:00:55 smithi157 bash[24585]: cluster 2024-09-16T12:00:54.255681+0000 mgr.a (mgr.14373) 16595 : cluster [DBG] pgmap v11509: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:00:55.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:00:55 smithi086 bash[24289]: audit 2024-09-16T12:00:53.818683+0000 mgr.a (mgr.14373) 16593 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T12:00:55.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:00:55 smithi086 bash[24289]: cephadm 2024-09-16T12:00:53.820698+0000 mgr.a (mgr.14373) 16594 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T12:00:55.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:00:55 smithi086 bash[24289]: cluster 2024-09-16T12:00:54.255681+0000 mgr.a (mgr.14373) 16595 : cluster [DBG] pgmap v11509: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:00:55.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:00:55 smithi047 bash[22744]: audit 2024-09-16T12:00:53.818683+0000 mgr.a (mgr.14373) 16593 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T12:00:55.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:00:55 smithi047 bash[22744]: cephadm 2024-09-16T12:00:53.820698+0000 mgr.a (mgr.14373) 16594 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T12:00:55.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:00:55 smithi047 bash[22744]: cluster 2024-09-16T12:00:54.255681+0000 mgr.a (mgr.14373) 16595 : cluster [DBG] pgmap v11509: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:00:56.207 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:00:56.208 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:00:56.208 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:00:56.208 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:00:56.208 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:00:57.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:00:57 smithi157 bash[24585]: audit 2024-09-16T12:00:55.782774+0000 mgr.a (mgr.14373) 16596 : audit [DBG] from='client.357462 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:00:57.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:00:57 smithi157 bash[24585]: cluster 2024-09-16T12:00:56.256224+0000 mgr.a (mgr.14373) 16597 : cluster [DBG] pgmap v11510: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:00:57.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:00:57 smithi086 bash[24289]: audit 2024-09-16T12:00:55.782774+0000 mgr.a (mgr.14373) 16596 : audit [DBG] from='client.357462 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:00:57.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:00:57 smithi086 bash[24289]: cluster 2024-09-16T12:00:56.256224+0000 mgr.a (mgr.14373) 16597 : cluster [DBG] pgmap v11510: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:00:57.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:00:57 smithi047 bash[22744]: audit 2024-09-16T12:00:55.782774+0000 mgr.a (mgr.14373) 16596 : audit [DBG] from='client.357462 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:00:57.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:00:57 smithi047 bash[22744]: cluster 2024-09-16T12:00:56.256224+0000 mgr.a (mgr.14373) 16597 : cluster [DBG] pgmap v11510: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:00:59.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:00:59 smithi157 bash[24585]: cluster 2024-09-16T12:00:58.258433+0000 mgr.a (mgr.14373) 16598 : cluster [DBG] pgmap v11511: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:00:59.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:00:59 smithi086 bash[24289]: cluster 2024-09-16T12:00:58.258433+0000 mgr.a (mgr.14373) 16598 : cluster [DBG] pgmap v11511: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:00:59.844 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:00:59 smithi047 bash[22744]: cluster 2024-09-16T12:00:58.258433+0000 mgr.a (mgr.14373) 16598 : cluster [DBG] pgmap v11511: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:01:01.209 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:01:01.210 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:01:01.210 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:01:01.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:01:01 smithi157 bash[24585]: cluster 2024-09-16T12:01:00.259265+0000 mgr.a (mgr.14373) 16599 : cluster [DBG] pgmap v11512: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:01:01.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:01:01 smithi086 bash[24289]: cluster 2024-09-16T12:01:00.259265+0000 mgr.a (mgr.14373) 16599 : cluster [DBG] pgmap v11512: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:01:01.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:01:01 smithi047 bash[22744]: cluster 2024-09-16T12:01:00.259265+0000 mgr.a (mgr.14373) 16599 : cluster [DBG] pgmap v11512: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:01:01.991 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:01:01.991 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:01:01.991 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:01:01.991 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:01:01.992 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:01:02.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:01:02 smithi157 bash[24585]: audit 2024-09-16T12:01:01.542787+0000 mgr.a (mgr.14373) 16600 : audit [DBG] from='client.357540 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:01:02.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:01:02 smithi086 bash[24289]: audit 2024-09-16T12:01:01.542787+0000 mgr.a (mgr.14373) 16600 : audit [DBG] from='client.357540 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:01:02.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:01:02 smithi047 bash[22744]: audit 2024-09-16T12:01:01.542787+0000 mgr.a (mgr.14373) 16600 : audit [DBG] from='client.357540 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:01:03.809 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:01:03 smithi157 bash[24585]: cluster 2024-09-16T12:01:02.261983+0000 mgr.a (mgr.14373) 16601 : cluster [DBG] pgmap v11513: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:01:03.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:01:03 smithi086 bash[24289]: cluster 2024-09-16T12:01:02.261983+0000 mgr.a (mgr.14373) 16601 : cluster [DBG] pgmap v11513: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:01:03.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:01:03 smithi047 bash[22744]: cluster 2024-09-16T12:01:02.261983+0000 mgr.a (mgr.14373) 16601 : cluster [DBG] pgmap v11513: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:01:05.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:01:05 smithi157 bash[24585]: cluster 2024-09-16T12:01:04.262792+0000 mgr.a (mgr.14373) 16602 : cluster [DBG] pgmap v11514: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T12:01:05.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:01:05 smithi086 bash[24289]: cluster 2024-09-16T12:01:04.262792+0000 mgr.a (mgr.14373) 16602 : cluster [DBG] pgmap v11514: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T12:01:05.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:01:05 smithi047 bash[22744]: cluster 2024-09-16T12:01:04.262792+0000 mgr.a (mgr.14373) 16602 : cluster [DBG] pgmap v11514: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T12:01:06.993 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:01:06.993 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:01:06.993 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:01:07.741 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:01:07.742 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:01:07.742 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:01:07.742 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:01:07.742 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:01:07.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:01:07 smithi157 bash[24585]: cluster 2024-09-16T12:01:06.263503+0000 mgr.a (mgr.14373) 16603 : cluster [DBG] pgmap v11515: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T12:01:07.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:01:07 smithi086 bash[24289]: cluster 2024-09-16T12:01:06.263503+0000 mgr.a (mgr.14373) 16603 : cluster [DBG] pgmap v11515: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T12:01:07.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:01:07 smithi047 bash[22744]: cluster 2024-09-16T12:01:06.263503+0000 mgr.a (mgr.14373) 16603 : cluster [DBG] pgmap v11515: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T12:01:08.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:01:08 smithi157 bash[24585]: audit 2024-09-16T12:01:07.324738+0000 mgr.a (mgr.14373) 16604 : audit [DBG] from='client.357618 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:01:08.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:01:08 smithi086 bash[24289]: audit 2024-09-16T12:01:07.324738+0000 mgr.a (mgr.14373) 16604 : audit [DBG] from='client.357618 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:01:08.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:01:08 smithi047 bash[22744]: audit 2024-09-16T12:01:07.324738+0000 mgr.a (mgr.14373) 16604 : audit [DBG] from='client.357618 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:01:09.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:01:09 smithi157 bash[24585]: cluster 2024-09-16T12:01:08.266211+0000 mgr.a (mgr.14373) 16605 : cluster [DBG] pgmap v11516: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:01:09.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:01:09 smithi086 bash[24289]: cluster 2024-09-16T12:01:08.266211+0000 mgr.a (mgr.14373) 16605 : cluster [DBG] pgmap v11516: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:01:09.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:01:09 smithi047 bash[22744]: cluster 2024-09-16T12:01:08.266211+0000 mgr.a (mgr.14373) 16605 : cluster [DBG] pgmap v11516: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:01:11.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:01:11 smithi157 bash[24585]: cluster 2024-09-16T12:01:10.267169+0000 mgr.a (mgr.14373) 16606 : cluster [DBG] pgmap v11517: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:01:11.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:01:11 smithi086 bash[24289]: cluster 2024-09-16T12:01:10.267169+0000 mgr.a (mgr.14373) 16606 : cluster [DBG] pgmap v11517: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:01:11.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:01:11 smithi047 bash[22744]: cluster 2024-09-16T12:01:10.267169+0000 mgr.a (mgr.14373) 16606 : cluster [DBG] pgmap v11517: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:01:12.743 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:01:12.744 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:01:12.744 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:01:13.506 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:01:13.507 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:01:13.507 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:01:13.507 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:01:13.507 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:01:13.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:01:13 smithi157 bash[24585]: cluster 2024-09-16T12:01:12.269320+0000 mgr.a (mgr.14373) 16607 : cluster [DBG] pgmap v11518: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:01:13.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:01:13 smithi086 bash[24289]: cluster 2024-09-16T12:01:12.269320+0000 mgr.a (mgr.14373) 16607 : cluster [DBG] pgmap v11518: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:01:13.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:01:13 smithi047 bash[22744]: cluster 2024-09-16T12:01:12.269320+0000 mgr.a (mgr.14373) 16607 : cluster [DBG] pgmap v11518: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:01:14.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:01:14 smithi157 bash[24585]: audit 2024-09-16T12:01:13.074749+0000 mgr.a (mgr.14373) 16608 : audit [DBG] from='client.357696 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:01:14.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:01:14 smithi086 bash[24289]: audit 2024-09-16T12:01:13.074749+0000 mgr.a (mgr.14373) 16608 : audit [DBG] from='client.357696 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:01:14.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:01:14 smithi047 bash[22744]: audit 2024-09-16T12:01:13.074749+0000 mgr.a (mgr.14373) 16608 : audit [DBG] from='client.357696 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:01:15.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:01:15 smithi157 bash[24585]: cluster 2024-09-16T12:01:14.270231+0000 mgr.a (mgr.14373) 16609 : cluster [DBG] pgmap v11519: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:01:15.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:01:15 smithi086 bash[24289]: cluster 2024-09-16T12:01:14.270231+0000 mgr.a (mgr.14373) 16609 : cluster [DBG] pgmap v11519: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:01:15.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:01:15 smithi047 bash[22744]: cluster 2024-09-16T12:01:14.270231+0000 mgr.a (mgr.14373) 16609 : cluster [DBG] pgmap v11519: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:01:17.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:01:17 smithi157 bash[24585]: cluster 2024-09-16T12:01:16.270985+0000 mgr.a (mgr.14373) 16610 : cluster [DBG] pgmap v11520: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:01:17.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:01:17 smithi086 bash[24289]: cluster 2024-09-16T12:01:16.270985+0000 mgr.a (mgr.14373) 16610 : cluster [DBG] pgmap v11520: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:01:17.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:01:17 smithi047 bash[22744]: cluster 2024-09-16T12:01:16.270985+0000 mgr.a (mgr.14373) 16610 : cluster [DBG] pgmap v11520: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:01:18.508 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:01:18.508 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:01:18.509 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:01:19.294 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:01:19.295 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:01:19.295 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:01:19.295 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:01:19.295 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:01:19.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:01:19 smithi157 bash[24585]: cluster 2024-09-16T12:01:18.273196+0000 mgr.a (mgr.14373) 16611 : cluster [DBG] pgmap v11521: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:01:19.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:01:19 smithi086 bash[24289]: cluster 2024-09-16T12:01:18.273196+0000 mgr.a (mgr.14373) 16611 : cluster [DBG] pgmap v11521: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:01:19.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:01:19 smithi047 bash[22744]: cluster 2024-09-16T12:01:18.273196+0000 mgr.a (mgr.14373) 16611 : cluster [DBG] pgmap v11521: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:01:20.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:01:20 smithi157 bash[24585]: audit 2024-09-16T12:01:18.844130+0000 mgr.a (mgr.14373) 16612 : audit [DBG] from='client.357774 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:01:20.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:01:20 smithi086 bash[24289]: audit 2024-09-16T12:01:18.844130+0000 mgr.a (mgr.14373) 16612 : audit [DBG] from='client.357774 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:01:20.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:01:20 smithi047 bash[22744]: audit 2024-09-16T12:01:18.844130+0000 mgr.a (mgr.14373) 16612 : audit [DBG] from='client.357774 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:01:21.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:01:21 smithi157 bash[24585]: cluster 2024-09-16T12:01:20.274310+0000 mgr.a (mgr.14373) 16613 : cluster [DBG] pgmap v11522: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:01:21.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:01:21 smithi086 bash[24289]: cluster 2024-09-16T12:01:20.274310+0000 mgr.a (mgr.14373) 16613 : cluster [DBG] pgmap v11522: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:01:21.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:01:21 smithi047 bash[22744]: cluster 2024-09-16T12:01:20.274310+0000 mgr.a (mgr.14373) 16613 : cluster [DBG] pgmap v11522: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:01:23.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:01:23 smithi157 bash[24585]: cluster 2024-09-16T12:01:22.276543+0000 mgr.a (mgr.14373) 16614 : cluster [DBG] pgmap v11523: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:01:23.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:01:23 smithi086 bash[24289]: cluster 2024-09-16T12:01:22.276543+0000 mgr.a (mgr.14373) 16614 : cluster [DBG] pgmap v11523: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:01:23.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:01:23 smithi047 bash[22744]: cluster 2024-09-16T12:01:22.276543+0000 mgr.a (mgr.14373) 16614 : cluster [DBG] pgmap v11523: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:01:24.296 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:01:24.297 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:01:24.297 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:01:25.049 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:01:25.050 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:01:25.050 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:01:25.050 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:01:25.050 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:01:25.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:01:25 smithi157 bash[24585]: cluster 2024-09-16T12:01:24.277450+0000 mgr.a (mgr.14373) 16615 : cluster [DBG] pgmap v11524: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:01:25.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:01:25 smithi157 bash[24585]: audit 2024-09-16T12:01:24.628182+0000 mgr.a (mgr.14373) 16616 : audit [DBG] from='client.357852 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:01:25.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:01:25 smithi086 bash[24289]: cluster 2024-09-16T12:01:24.277450+0000 mgr.a (mgr.14373) 16615 : cluster [DBG] pgmap v11524: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:01:25.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:01:25 smithi086 bash[24289]: audit 2024-09-16T12:01:24.628182+0000 mgr.a (mgr.14373) 16616 : audit [DBG] from='client.357852 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:01:25.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:01:25 smithi047 bash[22744]: cluster 2024-09-16T12:01:24.277450+0000 mgr.a (mgr.14373) 16615 : cluster [DBG] pgmap v11524: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:01:25.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:01:25 smithi047 bash[22744]: audit 2024-09-16T12:01:24.628182+0000 mgr.a (mgr.14373) 16616 : audit [DBG] from='client.357852 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:01:27.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:01:27 smithi157 bash[24585]: cluster 2024-09-16T12:01:26.278459+0000 mgr.a (mgr.14373) 16617 : cluster [DBG] pgmap v11525: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:01:27.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:01:27 smithi086 bash[24289]: cluster 2024-09-16T12:01:26.278459+0000 mgr.a (mgr.14373) 16617 : cluster [DBG] pgmap v11525: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:01:27.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:01:27 smithi047 bash[22744]: cluster 2024-09-16T12:01:26.278459+0000 mgr.a (mgr.14373) 16617 : cluster [DBG] pgmap v11525: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:01:29.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:01:29 smithi157 bash[24585]: cluster 2024-09-16T12:01:28.280677+0000 mgr.a (mgr.14373) 16618 : cluster [DBG] pgmap v11526: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:01:29.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:01:29 smithi086 bash[24289]: cluster 2024-09-16T12:01:28.280677+0000 mgr.a (mgr.14373) 16618 : cluster [DBG] pgmap v11526: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:01:29.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:01:29 smithi047 bash[22744]: cluster 2024-09-16T12:01:28.280677+0000 mgr.a (mgr.14373) 16618 : cluster [DBG] pgmap v11526: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:01:30.051 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:01:30.052 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:01:30.052 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:01:30.802 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:01:30.802 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:01:30.803 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:01:30.803 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:01:30.803 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:01:31.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:01:31 smithi157 bash[24585]: cluster 2024-09-16T12:01:30.281401+0000 mgr.a (mgr.14373) 16619 : cluster [DBG] pgmap v11527: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:01:31.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:01:31 smithi157 bash[24585]: audit 2024-09-16T12:01:30.379242+0000 mgr.a (mgr.14373) 16620 : audit [DBG] from='client.357927 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:01:31.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:01:31 smithi086 bash[24289]: cluster 2024-09-16T12:01:30.281401+0000 mgr.a (mgr.14373) 16619 : cluster [DBG] pgmap v11527: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:01:31.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:01:31 smithi086 bash[24289]: audit 2024-09-16T12:01:30.379242+0000 mgr.a (mgr.14373) 16620 : audit [DBG] from='client.357927 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:01:31.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:01:31 smithi047 bash[22744]: cluster 2024-09-16T12:01:30.281401+0000 mgr.a (mgr.14373) 16619 : cluster [DBG] pgmap v11527: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:01:31.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:01:31 smithi047 bash[22744]: audit 2024-09-16T12:01:30.379242+0000 mgr.a (mgr.14373) 16620 : audit [DBG] from='client.357927 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:01:33.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:01:33 smithi157 bash[24585]: cluster 2024-09-16T12:01:32.283740+0000 mgr.a (mgr.14373) 16621 : cluster [DBG] pgmap v11528: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:01:33.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:01:33 smithi086 bash[24289]: cluster 2024-09-16T12:01:32.283740+0000 mgr.a (mgr.14373) 16621 : cluster [DBG] pgmap v11528: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:01:33.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:01:33 smithi047 bash[22744]: cluster 2024-09-16T12:01:32.283740+0000 mgr.a (mgr.14373) 16621 : cluster [DBG] pgmap v11528: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:01:35.804 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:01:35.804 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:01:35.804 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:01:35.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:01:35 smithi157 bash[24585]: cluster 2024-09-16T12:01:34.284520+0000 mgr.a (mgr.14373) 16622 : cluster [DBG] pgmap v11529: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:01:35.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:01:35 smithi086 bash[24289]: cluster 2024-09-16T12:01:34.284520+0000 mgr.a (mgr.14373) 16622 : cluster [DBG] pgmap v11529: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:01:35.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:01:35 smithi047 bash[22744]: cluster 2024-09-16T12:01:34.284520+0000 mgr.a (mgr.14373) 16622 : cluster [DBG] pgmap v11529: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:01:36.561 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:01:36.562 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:01:36.562 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:01:36.562 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:01:36.562 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:01:37.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:01:37 smithi157 bash[24585]: audit 2024-09-16T12:01:36.130243+0000 mgr.a (mgr.14373) 16623 : audit [DBG] from='client.358005 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:01:37.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:01:37 smithi157 bash[24585]: cluster 2024-09-16T12:01:36.285102+0000 mgr.a (mgr.14373) 16624 : cluster [DBG] pgmap v11530: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:01:37.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:01:37 smithi086 bash[24289]: audit 2024-09-16T12:01:36.130243+0000 mgr.a (mgr.14373) 16623 : audit [DBG] from='client.358005 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:01:37.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:01:37 smithi086 bash[24289]: cluster 2024-09-16T12:01:36.285102+0000 mgr.a (mgr.14373) 16624 : cluster [DBG] pgmap v11530: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:01:37.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:01:37 smithi047 bash[22744]: audit 2024-09-16T12:01:36.130243+0000 mgr.a (mgr.14373) 16623 : audit [DBG] from='client.358005 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:01:37.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:01:37 smithi047 bash[22744]: cluster 2024-09-16T12:01:36.285102+0000 mgr.a (mgr.14373) 16624 : cluster [DBG] pgmap v11530: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:01:39.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:01:39 smithi157 bash[24585]: cluster 2024-09-16T12:01:38.287454+0000 mgr.a (mgr.14373) 16625 : cluster [DBG] pgmap v11531: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-16T12:01:39.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:01:39 smithi086 bash[24289]: cluster 2024-09-16T12:01:38.287454+0000 mgr.a (mgr.14373) 16625 : cluster [DBG] pgmap v11531: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-16T12:01:39.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:01:39 smithi047 bash[22744]: cluster 2024-09-16T12:01:38.287454+0000 mgr.a (mgr.14373) 16625 : cluster [DBG] pgmap v11531: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-16T12:01:41.563 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:01:41.564 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:01:41.564 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:01:41.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:01:41 smithi157 bash[24585]: cluster 2024-09-16T12:01:40.288218+0000 mgr.a (mgr.14373) 16626 : cluster [DBG] pgmap v11532: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T12:01:41.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:01:41 smithi086 bash[24289]: cluster 2024-09-16T12:01:40.288218+0000 mgr.a (mgr.14373) 16626 : cluster [DBG] pgmap v11532: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T12:01:41.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:01:41 smithi047 bash[22744]: cluster 2024-09-16T12:01:40.288218+0000 mgr.a (mgr.14373) 16626 : cluster [DBG] pgmap v11532: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T12:01:42.344 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:01:42.345 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:01:42.345 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:01:42.345 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:01:42.345 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:01:43.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:01:43 smithi157 bash[24585]: audit 2024-09-16T12:01:41.900942+0000 mgr.a (mgr.14373) 16627 : audit [DBG] from='client.358083 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:01:43.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:01:43 smithi157 bash[24585]: cluster 2024-09-16T12:01:42.289526+0000 mgr.a (mgr.14373) 16628 : cluster [DBG] pgmap v11533: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:01:43.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:01:43 smithi086 bash[24289]: audit 2024-09-16T12:01:41.900942+0000 mgr.a (mgr.14373) 16627 : audit [DBG] from='client.358083 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:01:43.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:01:43 smithi086 bash[24289]: cluster 2024-09-16T12:01:42.289526+0000 mgr.a (mgr.14373) 16628 : cluster [DBG] pgmap v11533: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:01:43.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:01:43 smithi047 bash[22744]: audit 2024-09-16T12:01:41.900942+0000 mgr.a (mgr.14373) 16627 : audit [DBG] from='client.358083 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:01:43.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:01:43 smithi047 bash[22744]: cluster 2024-09-16T12:01:42.289526+0000 mgr.a (mgr.14373) 16628 : cluster [DBG] pgmap v11533: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:01:45.808 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:01:45 smithi157 bash[24585]: cluster 2024-09-16T12:01:44.290265+0000 mgr.a (mgr.14373) 16629 : cluster [DBG] pgmap v11534: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T12:01:45.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:01:45 smithi086 bash[24289]: cluster 2024-09-16T12:01:44.290265+0000 mgr.a (mgr.14373) 16629 : cluster [DBG] pgmap v11534: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T12:01:45.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:01:45 smithi047 bash[22744]: cluster 2024-09-16T12:01:44.290265+0000 mgr.a (mgr.14373) 16629 : cluster [DBG] pgmap v11534: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T12:01:47.346 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:01:47.347 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:01:47.347 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:01:47.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:01:47 smithi157 bash[24585]: cluster 2024-09-16T12:01:46.290968+0000 mgr.a (mgr.14373) 16630 : cluster [DBG] pgmap v11535: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T12:01:47.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:01:47 smithi086 bash[24289]: cluster 2024-09-16T12:01:46.290968+0000 mgr.a (mgr.14373) 16630 : cluster [DBG] pgmap v11535: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T12:01:47.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:01:47 smithi047 bash[22744]: cluster 2024-09-16T12:01:46.290968+0000 mgr.a (mgr.14373) 16630 : cluster [DBG] pgmap v11535: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T12:01:48.116 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:01:48.116 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:01:48.116 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:01:48.116 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:01:48.116 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:01:48.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:01:48 smithi157 bash[24585]: audit 2024-09-16T12:01:47.678407+0000 mgr.a (mgr.14373) 16631 : audit [DBG] from='client.358161 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:01:48.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:01:48 smithi086 bash[24289]: audit 2024-09-16T12:01:47.678407+0000 mgr.a (mgr.14373) 16631 : audit [DBG] from='client.358161 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:01:48.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:01:48 smithi047 bash[22744]: audit 2024-09-16T12:01:47.678407+0000 mgr.a (mgr.14373) 16631 : audit [DBG] from='client.358161 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:01:49.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:01:49 smithi157 bash[24585]: cluster 2024-09-16T12:01:48.293679+0000 mgr.a (mgr.14373) 16632 : cluster [DBG] pgmap v11536: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:01:49.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:01:49 smithi086 bash[24289]: cluster 2024-09-16T12:01:48.293679+0000 mgr.a (mgr.14373) 16632 : cluster [DBG] pgmap v11536: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:01:49.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:01:49 smithi047 bash[22744]: cluster 2024-09-16T12:01:48.293679+0000 mgr.a (mgr.14373) 16632 : cluster [DBG] pgmap v11536: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:01:51.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:01:51 smithi157 bash[24585]: cluster 2024-09-16T12:01:50.294506+0000 mgr.a (mgr.14373) 16633 : cluster [DBG] pgmap v11537: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-16T12:01:51.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:01:51 smithi086 bash[24289]: cluster 2024-09-16T12:01:50.294506+0000 mgr.a (mgr.14373) 16633 : cluster [DBG] pgmap v11537: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-16T12:01:51.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:01:51 smithi047 bash[22744]: cluster 2024-09-16T12:01:50.294506+0000 mgr.a (mgr.14373) 16633 : cluster [DBG] pgmap v11537: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-16T12:01:53.118 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:01:53.119 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:01:53.119 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:01:53.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:01:53 smithi086 bash[24289]: cluster 2024-09-16T12:01:52.296463+0000 mgr.a (mgr.14373) 16634 : cluster [DBG] pgmap v11538: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-16T12:01:53.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:01:53 smithi047 bash[22744]: cluster 2024-09-16T12:01:52.296463+0000 mgr.a (mgr.14373) 16634 : cluster [DBG] pgmap v11538: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-16T12:01:53.912 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:01:53.913 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:01:53.913 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:01:53.913 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:01:53.913 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:01:54.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:01:53 smithi157 bash[24585]: cluster 2024-09-16T12:01:52.296463+0000 mgr.a (mgr.14373) 16634 : cluster [DBG] pgmap v11538: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-16T12:01:54.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:01:54 smithi086 bash[24289]: audit 2024-09-16T12:01:53.455430+0000 mgr.a (mgr.14373) 16635 : audit [DBG] from='client.358239 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:01:54.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:01:54 smithi086 bash[24289]: audit 2024-09-16T12:01:53.870800+0000 mon.b (mon.2) 1510 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T12:01:54.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:01:54 smithi086 bash[24289]: audit 2024-09-16T12:01:54.416217+0000 mon.a (mon.0) 1558 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:01:54.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:01:54 smithi086 bash[24289]: audit 2024-09-16T12:01:54.424014+0000 mon.a (mon.0) 1559 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:01:54.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:01:54 smithi047 bash[22744]: audit 2024-09-16T12:01:53.455430+0000 mgr.a (mgr.14373) 16635 : audit [DBG] from='client.358239 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:01:54.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:01:54 smithi047 bash[22744]: audit 2024-09-16T12:01:53.870800+0000 mon.b (mon.2) 1510 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T12:01:54.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:01:54 smithi047 bash[22744]: audit 2024-09-16T12:01:54.416217+0000 mon.a (mon.0) 1558 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:01:54.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:01:54 smithi047 bash[22744]: audit 2024-09-16T12:01:54.424014+0000 mon.a (mon.0) 1559 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:01:55.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:01:54 smithi157 bash[24585]: audit 2024-09-16T12:01:53.455430+0000 mgr.a (mgr.14373) 16635 : audit [DBG] from='client.358239 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:01:55.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:01:54 smithi157 bash[24585]: audit 2024-09-16T12:01:53.870800+0000 mon.b (mon.2) 1510 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T12:01:55.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:01:54 smithi157 bash[24585]: audit 2024-09-16T12:01:54.416217+0000 mon.a (mon.0) 1558 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:01:55.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:01:54 smithi157 bash[24585]: audit 2024-09-16T12:01:54.424014+0000 mon.a (mon.0) 1559 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:01:55.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:01:55 smithi086 bash[24289]: cluster 2024-09-16T12:01:54.297370+0000 mgr.a (mgr.14373) 16636 : cluster [DBG] pgmap v11539: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:01:55.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:01:55 smithi086 bash[24289]: audit 2024-09-16T12:01:55.209337+0000 mon.b (mon.2) 1511 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T12:01:55.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:01:55 smithi086 bash[24289]: audit 2024-09-16T12:01:55.211515+0000 mon.b (mon.2) 1512 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T12:01:55.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:01:55 smithi086 bash[24289]: audit 2024-09-16T12:01:55.222897+0000 mon.a (mon.0) 1560 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:01:55.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:01:55 smithi086 bash[24289]: audit 2024-09-16T12:01:55.228648+0000 mon.b (mon.2) 1513 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:01:55.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:01:55 smithi047 bash[22744]: cluster 2024-09-16T12:01:54.297370+0000 mgr.a (mgr.14373) 16636 : cluster [DBG] pgmap v11539: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:01:55.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:01:55 smithi047 bash[22744]: audit 2024-09-16T12:01:55.209337+0000 mon.b (mon.2) 1511 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T12:01:55.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:01:55 smithi047 bash[22744]: audit 2024-09-16T12:01:55.211515+0000 mon.b (mon.2) 1512 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T12:01:55.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:01:55 smithi047 bash[22744]: audit 2024-09-16T12:01:55.222897+0000 mon.a (mon.0) 1560 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:01:55.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:01:55 smithi047 bash[22744]: audit 2024-09-16T12:01:55.228648+0000 mon.b (mon.2) 1513 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:01:56.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:01:55 smithi157 bash[24585]: cluster 2024-09-16T12:01:54.297370+0000 mgr.a (mgr.14373) 16636 : cluster [DBG] pgmap v11539: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:01:56.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:01:55 smithi157 bash[24585]: audit 2024-09-16T12:01:55.209337+0000 mon.b (mon.2) 1511 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T12:01:56.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:01:55 smithi157 bash[24585]: audit 2024-09-16T12:01:55.211515+0000 mon.b (mon.2) 1512 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T12:01:56.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:01:55 smithi157 bash[24585]: audit 2024-09-16T12:01:55.222897+0000 mon.a (mon.0) 1560 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:01:56.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:01:55 smithi157 bash[24585]: audit 2024-09-16T12:01:55.228648+0000 mon.b (mon.2) 1513 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:01:56.344 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 12:01:55 smithi047 bash[22994]: debug 2024-09-16T12:01:55.979+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T12:01:56.344 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 12:01:55 smithi047 bash[22994]: debug 2024-09-16T12:01:55.979+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T12:01:56.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:01:56 smithi086 bash[24289]: audit 2024-09-16T12:01:55.231337+0000 mgr.a (mgr.14373) 16637 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:01:56.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:01:56 smithi047 bash[22744]: audit 2024-09-16T12:01:55.231337+0000 mgr.a (mgr.14373) 16637 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:01:57.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:01:56 smithi157 bash[24585]: audit 2024-09-16T12:01:55.231337+0000 mgr.a (mgr.14373) 16637 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:01:57.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:01:57 smithi047 bash[22744]: audit 2024-09-16T12:01:55.983175+0000 mgr.a (mgr.14373) 16638 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T12:01:57.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:01:57 smithi047 bash[22744]: cephadm 2024-09-16T12:01:55.985325+0000 mgr.a (mgr.14373) 16639 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T12:01:57.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:01:57 smithi047 bash[22744]: cluster 2024-09-16T12:01:56.298330+0000 mgr.a (mgr.14373) 16640 : cluster [DBG] pgmap v11540: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:01:58.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:01:57 smithi157 bash[24585]: audit 2024-09-16T12:01:55.983175+0000 mgr.a (mgr.14373) 16638 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T12:01:58.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:01:57 smithi157 bash[24585]: cephadm 2024-09-16T12:01:55.985325+0000 mgr.a (mgr.14373) 16639 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T12:01:58.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:01:57 smithi157 bash[24585]: cluster 2024-09-16T12:01:56.298330+0000 mgr.a (mgr.14373) 16640 : cluster [DBG] pgmap v11540: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:01:58.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:01:57 smithi086 bash[24289]: audit 2024-09-16T12:01:55.983175+0000 mgr.a (mgr.14373) 16638 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T12:01:58.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:01:57 smithi086 bash[24289]: cephadm 2024-09-16T12:01:55.985325+0000 mgr.a (mgr.14373) 16639 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T12:01:58.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:01:57 smithi086 bash[24289]: cluster 2024-09-16T12:01:56.298330+0000 mgr.a (mgr.14373) 16640 : cluster [DBG] pgmap v11540: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:01:58.914 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:01:58.915 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:01:58.915 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:01:59.700 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:01:59.700 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:01:59.700 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:01:59.700 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:01:59.700 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:01:59.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:01:59 smithi047 bash[22744]: cluster 2024-09-16T12:01:58.300609+0000 mgr.a (mgr.14373) 16641 : cluster [DBG] pgmap v11541: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:02:00.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:01:59 smithi157 bash[24585]: cluster 2024-09-16T12:01:58.300609+0000 mgr.a (mgr.14373) 16641 : cluster [DBG] pgmap v11541: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:02:00.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:01:59 smithi086 bash[24289]: cluster 2024-09-16T12:01:58.300609+0000 mgr.a (mgr.14373) 16641 : cluster [DBG] pgmap v11541: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:02:00.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:02:00 smithi047 bash[22744]: audit 2024-09-16T12:01:59.250693+0000 mgr.a (mgr.14373) 16642 : audit [DBG] from='client.358425 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:02:01.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:02:00 smithi157 bash[24585]: audit 2024-09-16T12:01:59.250693+0000 mgr.a (mgr.14373) 16642 : audit [DBG] from='client.358425 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:02:01.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:02:00 smithi086 bash[24289]: audit 2024-09-16T12:01:59.250693+0000 mgr.a (mgr.14373) 16642 : audit [DBG] from='client.358425 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:02:02.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:02:01 smithi157 bash[24585]: cluster 2024-09-16T12:02:00.301592+0000 mgr.a (mgr.14373) 16643 : cluster [DBG] pgmap v11542: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:02:02.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:02:01 smithi086 bash[24289]: cluster 2024-09-16T12:02:00.301592+0000 mgr.a (mgr.14373) 16643 : cluster [DBG] pgmap v11542: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:02:02.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:02:01 smithi047 bash[22744]: cluster 2024-09-16T12:02:00.301592+0000 mgr.a (mgr.14373) 16643 : cluster [DBG] pgmap v11542: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:02:04.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:02:03 smithi157 bash[24585]: cluster 2024-09-16T12:02:02.303875+0000 mgr.a (mgr.14373) 16644 : cluster [DBG] pgmap v11543: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:02:04.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:02:03 smithi086 bash[24289]: cluster 2024-09-16T12:02:02.303875+0000 mgr.a (mgr.14373) 16644 : cluster [DBG] pgmap v11543: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:02:04.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:02:03 smithi047 bash[22744]: cluster 2024-09-16T12:02:02.303875+0000 mgr.a (mgr.14373) 16644 : cluster [DBG] pgmap v11543: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:02:04.701 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:02:04.702 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:02:04.702 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:02:05.456 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:02:05.457 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:02:05.457 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:02:05.457 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:02:05.457 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:02:06.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:02:05 smithi157 bash[24585]: cluster 2024-09-16T12:02:04.304650+0000 mgr.a (mgr.14373) 16645 : cluster [DBG] pgmap v11544: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:02:06.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:02:05 smithi086 bash[24289]: cluster 2024-09-16T12:02:04.304650+0000 mgr.a (mgr.14373) 16645 : cluster [DBG] pgmap v11544: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:02:06.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:02:05 smithi047 bash[22744]: cluster 2024-09-16T12:02:04.304650+0000 mgr.a (mgr.14373) 16645 : cluster [DBG] pgmap v11544: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:02:07.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:02:06 smithi157 bash[24585]: audit 2024-09-16T12:02:05.028895+0000 mgr.a (mgr.14373) 16646 : audit [DBG] from='client.358500 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:02:07.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:02:06 smithi086 bash[24289]: audit 2024-09-16T12:02:05.028895+0000 mgr.a (mgr.14373) 16646 : audit [DBG] from='client.358500 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:02:07.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:02:06 smithi047 bash[22744]: audit 2024-09-16T12:02:05.028895+0000 mgr.a (mgr.14373) 16646 : audit [DBG] from='client.358500 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:02:08.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:02:07 smithi157 bash[24585]: cluster 2024-09-16T12:02:06.305654+0000 mgr.a (mgr.14373) 16647 : cluster [DBG] pgmap v11545: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:02:08.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:02:07 smithi086 bash[24289]: cluster 2024-09-16T12:02:06.305654+0000 mgr.a (mgr.14373) 16647 : cluster [DBG] pgmap v11545: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:02:08.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:02:07 smithi047 bash[22744]: cluster 2024-09-16T12:02:06.305654+0000 mgr.a (mgr.14373) 16647 : cluster [DBG] pgmap v11545: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:02:10.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:02:09 smithi157 bash[24585]: cluster 2024-09-16T12:02:08.307901+0000 mgr.a (mgr.14373) 16648 : cluster [DBG] pgmap v11546: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:02:10.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:02:09 smithi086 bash[24289]: cluster 2024-09-16T12:02:08.307901+0000 mgr.a (mgr.14373) 16648 : cluster [DBG] pgmap v11546: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:02:10.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:02:09 smithi047 bash[22744]: cluster 2024-09-16T12:02:08.307901+0000 mgr.a (mgr.14373) 16648 : cluster [DBG] pgmap v11546: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:02:10.458 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:02:10.458 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:02:10.459 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:02:11.234 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:02:11.235 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:02:11.235 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:02:11.235 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:02:11.235 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:02:12.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:02:11 smithi157 bash[24585]: cluster 2024-09-16T12:02:10.308673+0000 mgr.a (mgr.14373) 16649 : cluster [DBG] pgmap v11547: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:02:12.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:02:11 smithi086 bash[24289]: cluster 2024-09-16T12:02:10.308673+0000 mgr.a (mgr.14373) 16649 : cluster [DBG] pgmap v11547: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:02:12.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:02:11 smithi047 bash[22744]: cluster 2024-09-16T12:02:10.308673+0000 mgr.a (mgr.14373) 16649 : cluster [DBG] pgmap v11547: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:02:13.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:02:12 smithi157 bash[24585]: audit 2024-09-16T12:02:10.793766+0000 mgr.a (mgr.14373) 16650 : audit [DBG] from='client.358578 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:02:13.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:02:12 smithi086 bash[24289]: audit 2024-09-16T12:02:10.793766+0000 mgr.a (mgr.14373) 16650 : audit [DBG] from='client.358578 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:02:13.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:02:12 smithi047 bash[22744]: audit 2024-09-16T12:02:10.793766+0000 mgr.a (mgr.14373) 16650 : audit [DBG] from='client.358578 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:02:14.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:02:13 smithi157 bash[24585]: cluster 2024-09-16T12:02:12.311133+0000 mgr.a (mgr.14373) 16651 : cluster [DBG] pgmap v11548: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:02:14.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:02:13 smithi086 bash[24289]: cluster 2024-09-16T12:02:12.311133+0000 mgr.a (mgr.14373) 16651 : cluster [DBG] pgmap v11548: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:02:14.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:02:13 smithi047 bash[22744]: cluster 2024-09-16T12:02:12.311133+0000 mgr.a (mgr.14373) 16651 : cluster [DBG] pgmap v11548: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:02:16.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:02:15 smithi157 bash[24585]: cluster 2024-09-16T12:02:14.311946+0000 mgr.a (mgr.14373) 16652 : cluster [DBG] pgmap v11549: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:02:16.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:02:15 smithi086 bash[24289]: cluster 2024-09-16T12:02:14.311946+0000 mgr.a (mgr.14373) 16652 : cluster [DBG] pgmap v11549: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:02:16.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:02:15 smithi047 bash[22744]: cluster 2024-09-16T12:02:14.311946+0000 mgr.a (mgr.14373) 16652 : cluster [DBG] pgmap v11549: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:02:16.236 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:02:16.237 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:02:16.237 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:02:17.023 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:02:17.023 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:02:17.023 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:02:17.023 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:02:17.023 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:02:18.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:02:17 smithi157 bash[24585]: cluster 2024-09-16T12:02:16.312523+0000 mgr.a (mgr.14373) 16653 : cluster [DBG] pgmap v11550: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:02:18.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:02:17 smithi157 bash[24585]: audit 2024-09-16T12:02:16.572228+0000 mgr.a (mgr.14373) 16654 : audit [DBG] from='client.358650 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:02:18.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:02:17 smithi086 bash[24289]: cluster 2024-09-16T12:02:16.312523+0000 mgr.a (mgr.14373) 16653 : cluster [DBG] pgmap v11550: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:02:18.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:02:17 smithi086 bash[24289]: audit 2024-09-16T12:02:16.572228+0000 mgr.a (mgr.14373) 16654 : audit [DBG] from='client.358650 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:02:18.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:02:17 smithi047 bash[22744]: cluster 2024-09-16T12:02:16.312523+0000 mgr.a (mgr.14373) 16653 : cluster [DBG] pgmap v11550: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:02:18.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:02:17 smithi047 bash[22744]: audit 2024-09-16T12:02:16.572228+0000 mgr.a (mgr.14373) 16654 : audit [DBG] from='client.358650 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:02:20.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:02:19 smithi157 bash[24585]: cluster 2024-09-16T12:02:18.315268+0000 mgr.a (mgr.14373) 16655 : cluster [DBG] pgmap v11551: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:02:20.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:02:19 smithi086 bash[24289]: cluster 2024-09-16T12:02:18.315268+0000 mgr.a (mgr.14373) 16655 : cluster [DBG] pgmap v11551: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:02:20.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:02:19 smithi047 bash[22744]: cluster 2024-09-16T12:02:18.315268+0000 mgr.a (mgr.14373) 16655 : cluster [DBG] pgmap v11551: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:02:22.025 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:02:22.025 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:02:22.026 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:02:22.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:02:21 smithi157 bash[24585]: cluster 2024-09-16T12:02:20.316187+0000 mgr.a (mgr.14373) 16656 : cluster [DBG] pgmap v11552: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:02:22.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:02:21 smithi086 bash[24289]: cluster 2024-09-16T12:02:20.316187+0000 mgr.a (mgr.14373) 16656 : cluster [DBG] pgmap v11552: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:02:22.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:02:21 smithi047 bash[22744]: cluster 2024-09-16T12:02:20.316187+0000 mgr.a (mgr.14373) 16656 : cluster [DBG] pgmap v11552: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:02:22.814 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:02:22.814 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:02:22.814 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:02:22.815 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:02:22.815 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:02:24.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:02:23 smithi157 bash[24585]: cluster 2024-09-16T12:02:22.318250+0000 mgr.a (mgr.14373) 16657 : cluster [DBG] pgmap v11553: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:02:24.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:02:23 smithi157 bash[24585]: audit 2024-09-16T12:02:22.360756+0000 mgr.a (mgr.14373) 16658 : audit [DBG] from='client.358725 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:02:24.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:02:23 smithi086 bash[24289]: cluster 2024-09-16T12:02:22.318250+0000 mgr.a (mgr.14373) 16657 : cluster [DBG] pgmap v11553: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:02:24.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:02:23 smithi086 bash[24289]: audit 2024-09-16T12:02:22.360756+0000 mgr.a (mgr.14373) 16658 : audit [DBG] from='client.358725 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:02:24.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:02:23 smithi047 bash[22744]: cluster 2024-09-16T12:02:22.318250+0000 mgr.a (mgr.14373) 16657 : cluster [DBG] pgmap v11553: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:02:24.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:02:23 smithi047 bash[22744]: audit 2024-09-16T12:02:22.360756+0000 mgr.a (mgr.14373) 16658 : audit [DBG] from='client.358725 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:02:26.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:02:25 smithi157 bash[24585]: cluster 2024-09-16T12:02:24.319140+0000 mgr.a (mgr.14373) 16659 : cluster [DBG] pgmap v11554: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:02:26.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:02:25 smithi086 bash[24289]: cluster 2024-09-16T12:02:24.319140+0000 mgr.a (mgr.14373) 16659 : cluster [DBG] pgmap v11554: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:02:26.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:02:25 smithi047 bash[22744]: cluster 2024-09-16T12:02:24.319140+0000 mgr.a (mgr.14373) 16659 : cluster [DBG] pgmap v11554: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:02:27.816 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:02:27.816 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:02:27.817 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:02:28.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:02:27 smithi157 bash[24585]: cluster 2024-09-16T12:02:26.319946+0000 mgr.a (mgr.14373) 16660 : cluster [DBG] pgmap v11555: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T12:02:28.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:02:27 smithi086 bash[24289]: cluster 2024-09-16T12:02:26.319946+0000 mgr.a (mgr.14373) 16660 : cluster [DBG] pgmap v11555: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T12:02:28.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:02:27 smithi047 bash[22744]: cluster 2024-09-16T12:02:26.319946+0000 mgr.a (mgr.14373) 16660 : cluster [DBG] pgmap v11555: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T12:02:28.588 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:02:28.589 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:02:28.589 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:02:28.589 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:02:28.589 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:02:30.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:02:29 smithi157 bash[24585]: audit 2024-09-16T12:02:28.150929+0000 mgr.a (mgr.14373) 16661 : audit [DBG] from='client.358803 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:02:30.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:02:29 smithi157 bash[24585]: cluster 2024-09-16T12:02:28.321346+0000 mgr.a (mgr.14373) 16662 : cluster [DBG] pgmap v11556: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:02:30.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:02:29 smithi086 bash[24289]: audit 2024-09-16T12:02:28.150929+0000 mgr.a (mgr.14373) 16661 : audit [DBG] from='client.358803 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:02:30.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:02:29 smithi086 bash[24289]: cluster 2024-09-16T12:02:28.321346+0000 mgr.a (mgr.14373) 16662 : cluster [DBG] pgmap v11556: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:02:30.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:02:29 smithi047 bash[22744]: audit 2024-09-16T12:02:28.150929+0000 mgr.a (mgr.14373) 16661 : audit [DBG] from='client.358803 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:02:30.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:02:29 smithi047 bash[22744]: cluster 2024-09-16T12:02:28.321346+0000 mgr.a (mgr.14373) 16662 : cluster [DBG] pgmap v11556: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:02:32.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:02:31 smithi157 bash[24585]: cluster 2024-09-16T12:02:30.322218+0000 mgr.a (mgr.14373) 16663 : cluster [DBG] pgmap v11557: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:02:32.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:02:31 smithi086 bash[24289]: cluster 2024-09-16T12:02:30.322218+0000 mgr.a (mgr.14373) 16663 : cluster [DBG] pgmap v11557: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:02:32.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:02:31 smithi047 bash[22744]: cluster 2024-09-16T12:02:30.322218+0000 mgr.a (mgr.14373) 16663 : cluster [DBG] pgmap v11557: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:02:33.590 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:02:33.591 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:02:33.591 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:02:34.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:02:33 smithi157 bash[24585]: cluster 2024-09-16T12:02:32.324390+0000 mgr.a (mgr.14373) 16664 : cluster [DBG] pgmap v11558: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:02:34.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:02:33 smithi086 bash[24289]: cluster 2024-09-16T12:02:32.324390+0000 mgr.a (mgr.14373) 16664 : cluster [DBG] pgmap v11558: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:02:34.094 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:02:33 smithi047 bash[22744]: cluster 2024-09-16T12:02:32.324390+0000 mgr.a (mgr.14373) 16664 : cluster [DBG] pgmap v11558: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:02:34.374 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:02:34.375 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:02:34.375 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:02:34.375 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:02:34.375 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:02:36.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:02:35 smithi157 bash[24585]: audit 2024-09-16T12:02:33.924597+0000 mgr.a (mgr.14373) 16665 : audit [DBG] from='client.358881 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:02:36.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:02:35 smithi157 bash[24585]: cluster 2024-09-16T12:02:34.324987+0000 mgr.a (mgr.14373) 16666 : cluster [DBG] pgmap v11559: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:02:36.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:02:35 smithi086 bash[24289]: audit 2024-09-16T12:02:33.924597+0000 mgr.a (mgr.14373) 16665 : audit [DBG] from='client.358881 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:02:36.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:02:35 smithi086 bash[24289]: cluster 2024-09-16T12:02:34.324987+0000 mgr.a (mgr.14373) 16666 : cluster [DBG] pgmap v11559: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:02:36.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:02:35 smithi047 bash[22744]: audit 2024-09-16T12:02:33.924597+0000 mgr.a (mgr.14373) 16665 : audit [DBG] from='client.358881 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:02:36.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:02:35 smithi047 bash[22744]: cluster 2024-09-16T12:02:34.324987+0000 mgr.a (mgr.14373) 16666 : cluster [DBG] pgmap v11559: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:02:38.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:02:37 smithi157 bash[24585]: cluster 2024-09-16T12:02:36.325718+0000 mgr.a (mgr.14373) 16667 : cluster [DBG] pgmap v11560: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:02:38.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:02:37 smithi086 bash[24289]: cluster 2024-09-16T12:02:36.325718+0000 mgr.a (mgr.14373) 16667 : cluster [DBG] pgmap v11560: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:02:38.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:02:37 smithi047 bash[22744]: cluster 2024-09-16T12:02:36.325718+0000 mgr.a (mgr.14373) 16667 : cluster [DBG] pgmap v11560: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:02:39.376 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:02:39.377 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:02:39.377 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:02:40.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:02:39 smithi157 bash[24585]: cluster 2024-09-16T12:02:38.327957+0000 mgr.a (mgr.14373) 16668 : cluster [DBG] pgmap v11561: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:02:40.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:02:39 smithi086 bash[24289]: cluster 2024-09-16T12:02:38.327957+0000 mgr.a (mgr.14373) 16668 : cluster [DBG] pgmap v11561: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:02:40.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:02:39 smithi047 bash[22744]: cluster 2024-09-16T12:02:38.327957+0000 mgr.a (mgr.14373) 16668 : cluster [DBG] pgmap v11561: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:02:40.130 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:02:40.131 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:02:40.131 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:02:40.131 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:02:40.131 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:02:41.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:02:40 smithi157 bash[24585]: audit 2024-09-16T12:02:39.706666+0000 mgr.a (mgr.14373) 16669 : audit [DBG] from='client.358956 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:02:41.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:02:40 smithi086 bash[24289]: audit 2024-09-16T12:02:39.706666+0000 mgr.a (mgr.14373) 16669 : audit [DBG] from='client.358956 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:02:41.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:02:40 smithi047 bash[22744]: audit 2024-09-16T12:02:39.706666+0000 mgr.a (mgr.14373) 16669 : audit [DBG] from='client.358956 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:02:42.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:02:41 smithi157 bash[24585]: cluster 2024-09-16T12:02:40.328903+0000 mgr.a (mgr.14373) 16670 : cluster [DBG] pgmap v11562: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:02:42.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:02:41 smithi086 bash[24289]: cluster 2024-09-16T12:02:40.328903+0000 mgr.a (mgr.14373) 16670 : cluster [DBG] pgmap v11562: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:02:42.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:02:41 smithi047 bash[22744]: cluster 2024-09-16T12:02:40.328903+0000 mgr.a (mgr.14373) 16670 : cluster [DBG] pgmap v11562: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:02:44.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:02:43 smithi157 bash[24585]: cluster 2024-09-16T12:02:42.331203+0000 mgr.a (mgr.14373) 16671 : cluster [DBG] pgmap v11563: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:02:44.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:02:43 smithi086 bash[24289]: cluster 2024-09-16T12:02:42.331203+0000 mgr.a (mgr.14373) 16671 : cluster [DBG] pgmap v11563: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:02:44.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:02:43 smithi047 bash[22744]: cluster 2024-09-16T12:02:42.331203+0000 mgr.a (mgr.14373) 16671 : cluster [DBG] pgmap v11563: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:02:45.132 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:02:45.133 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:02:45.133 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:02:45.910 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:02:45.910 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:02:45.910 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:02:45.910 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:02:45.910 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:02:46.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:02:45 smithi157 bash[24585]: cluster 2024-09-16T12:02:44.331969+0000 mgr.a (mgr.14373) 16672 : cluster [DBG] pgmap v11564: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:02:46.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:02:45 smithi086 bash[24289]: cluster 2024-09-16T12:02:44.331969+0000 mgr.a (mgr.14373) 16672 : cluster [DBG] pgmap v11564: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:02:46.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:02:45 smithi047 bash[22744]: cluster 2024-09-16T12:02:44.331969+0000 mgr.a (mgr.14373) 16672 : cluster [DBG] pgmap v11564: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:02:47.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:02:46 smithi157 bash[24585]: audit 2024-09-16T12:02:45.467809+0000 mgr.a (mgr.14373) 16673 : audit [DBG] from='client.359034 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:02:47.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:02:46 smithi086 bash[24289]: audit 2024-09-16T12:02:45.467809+0000 mgr.a (mgr.14373) 16673 : audit [DBG] from='client.359034 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:02:47.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:02:46 smithi047 bash[22744]: audit 2024-09-16T12:02:45.467809+0000 mgr.a (mgr.14373) 16673 : audit [DBG] from='client.359034 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:02:48.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:02:47 smithi157 bash[24585]: cluster 2024-09-16T12:02:46.332956+0000 mgr.a (mgr.14373) 16674 : cluster [DBG] pgmap v11565: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:02:48.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:02:47 smithi086 bash[24289]: cluster 2024-09-16T12:02:46.332956+0000 mgr.a (mgr.14373) 16674 : cluster [DBG] pgmap v11565: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:02:48.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:02:47 smithi047 bash[22744]: cluster 2024-09-16T12:02:46.332956+0000 mgr.a (mgr.14373) 16674 : cluster [DBG] pgmap v11565: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:02:50.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:02:49 smithi157 bash[24585]: cluster 2024-09-16T12:02:48.335220+0000 mgr.a (mgr.14373) 16675 : cluster [DBG] pgmap v11566: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:02:50.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:02:49 smithi086 bash[24289]: cluster 2024-09-16T12:02:48.335220+0000 mgr.a (mgr.14373) 16675 : cluster [DBG] pgmap v11566: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:02:50.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:02:49 smithi047 bash[22744]: cluster 2024-09-16T12:02:48.335220+0000 mgr.a (mgr.14373) 16675 : cluster [DBG] pgmap v11566: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:02:50.911 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:02:50.912 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:02:50.912 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:02:51.661 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:02:51.662 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:02:51.662 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:02:51.662 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:02:51.662 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:02:52.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:02:51 smithi157 bash[24585]: cluster 2024-09-16T12:02:50.335989+0000 mgr.a (mgr.14373) 16676 : cluster [DBG] pgmap v11567: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:02:52.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:02:51 smithi086 bash[24289]: cluster 2024-09-16T12:02:50.335989+0000 mgr.a (mgr.14373) 16676 : cluster [DBG] pgmap v11567: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:02:52.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:02:51 smithi047 bash[22744]: cluster 2024-09-16T12:02:50.335989+0000 mgr.a (mgr.14373) 16676 : cluster [DBG] pgmap v11567: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:02:53.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:02:52 smithi157 bash[24585]: audit 2024-09-16T12:02:51.238276+0000 mgr.a (mgr.14373) 16677 : audit [DBG] from='client.359109 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:02:53.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:02:52 smithi086 bash[24289]: audit 2024-09-16T12:02:51.238276+0000 mgr.a (mgr.14373) 16677 : audit [DBG] from='client.359109 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:02:53.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:02:52 smithi047 bash[22744]: audit 2024-09-16T12:02:51.238276+0000 mgr.a (mgr.14373) 16677 : audit [DBG] from='client.359109 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:02:54.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:02:53 smithi157 bash[24585]: cluster 2024-09-16T12:02:52.338568+0000 mgr.a (mgr.14373) 16678 : cluster [DBG] pgmap v11568: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-16T12:02:54.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:02:53 smithi086 bash[24289]: cluster 2024-09-16T12:02:52.338568+0000 mgr.a (mgr.14373) 16678 : cluster [DBG] pgmap v11568: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-16T12:02:54.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:02:53 smithi047 bash[22744]: cluster 2024-09-16T12:02:52.338568+0000 mgr.a (mgr.14373) 16678 : cluster [DBG] pgmap v11568: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-16T12:02:56.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:02:55 smithi157 bash[24585]: cluster 2024-09-16T12:02:54.339370+0000 mgr.a (mgr.14373) 16679 : cluster [DBG] pgmap v11569: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T12:02:56.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:02:55 smithi086 bash[24289]: cluster 2024-09-16T12:02:54.339370+0000 mgr.a (mgr.14373) 16679 : cluster [DBG] pgmap v11569: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T12:02:56.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:02:55 smithi047 bash[22744]: cluster 2024-09-16T12:02:54.339370+0000 mgr.a (mgr.14373) 16679 : cluster [DBG] pgmap v11569: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T12:02:56.662 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:02:56.663 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:02:56.663 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:02:57.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:02:56 smithi157 bash[24585]: audit 2024-09-16T12:02:56.041585+0000 mon.b (mon.2) 1514 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T12:02:57.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:02:56 smithi157 bash[24585]: audit 2024-09-16T12:02:56.655209+0000 mon.a (mon.0) 1561 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:02:57.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:02:56 smithi157 bash[24585]: audit 2024-09-16T12:02:56.658319+0000 mon.a (mon.0) 1562 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:02:57.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:02:56 smithi157 bash[24585]: audit 2024-09-16T12:02:56.662887+0000 mon.a (mon.0) 1563 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:02:57.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:02:56 smithi157 bash[24585]: audit 2024-09-16T12:02:56.667632+0000 mon.a (mon.0) 1564 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:02:57.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:02:56 smithi086 bash[24289]: audit 2024-09-16T12:02:56.041585+0000 mon.b (mon.2) 1514 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T12:02:57.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:02:56 smithi086 bash[24289]: audit 2024-09-16T12:02:56.655209+0000 mon.a (mon.0) 1561 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:02:57.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:02:56 smithi086 bash[24289]: audit 2024-09-16T12:02:56.658319+0000 mon.a (mon.0) 1562 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:02:57.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:02:56 smithi086 bash[24289]: audit 2024-09-16T12:02:56.662887+0000 mon.a (mon.0) 1563 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:02:57.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:02:56 smithi086 bash[24289]: audit 2024-09-16T12:02:56.667632+0000 mon.a (mon.0) 1564 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:02:57.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:02:56 smithi047 bash[22744]: audit 2024-09-16T12:02:56.041585+0000 mon.b (mon.2) 1514 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T12:02:57.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:02:56 smithi047 bash[22744]: audit 2024-09-16T12:02:56.655209+0000 mon.a (mon.0) 1561 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:02:57.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:02:56 smithi047 bash[22744]: audit 2024-09-16T12:02:56.658319+0000 mon.a (mon.0) 1562 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:02:57.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:02:56 smithi047 bash[22744]: audit 2024-09-16T12:02:56.662887+0000 mon.a (mon.0) 1563 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:02:57.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:02:56 smithi047 bash[22744]: audit 2024-09-16T12:02:56.667632+0000 mon.a (mon.0) 1564 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:02:57.457 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:02:57.457 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:02:57.457 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:02:57.458 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:02:57.458 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:02:58.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:02:57 smithi157 bash[24585]: cluster 2024-09-16T12:02:56.340119+0000 mgr.a (mgr.14373) 16680 : cluster [DBG] pgmap v11570: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T12:02:58.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:02:57 smithi157 bash[24585]: audit 2024-09-16T12:02:57.356563+0000 mon.b (mon.2) 1515 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T12:02:58.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:02:57 smithi157 bash[24585]: audit 2024-09-16T12:02:57.358212+0000 mon.b (mon.2) 1516 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T12:02:58.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:02:57 smithi157 bash[24585]: audit 2024-09-16T12:02:57.366303+0000 mon.a (mon.0) 1565 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:02:58.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:02:57 smithi157 bash[24585]: audit 2024-09-16T12:02:57.370698+0000 mon.b (mon.2) 1517 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:02:58.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:02:57 smithi086 bash[24289]: cluster 2024-09-16T12:02:56.340119+0000 mgr.a (mgr.14373) 16680 : cluster [DBG] pgmap v11570: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T12:02:58.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:02:57 smithi086 bash[24289]: audit 2024-09-16T12:02:57.356563+0000 mon.b (mon.2) 1515 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T12:02:58.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:02:57 smithi086 bash[24289]: audit 2024-09-16T12:02:57.358212+0000 mon.b (mon.2) 1516 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T12:02:58.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:02:57 smithi086 bash[24289]: audit 2024-09-16T12:02:57.366303+0000 mon.a (mon.0) 1565 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:02:58.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:02:57 smithi086 bash[24289]: audit 2024-09-16T12:02:57.370698+0000 mon.b (mon.2) 1517 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:02:58.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:02:57 smithi047 bash[22744]: cluster 2024-09-16T12:02:56.340119+0000 mgr.a (mgr.14373) 16680 : cluster [DBG] pgmap v11570: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T12:02:58.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:02:57 smithi047 bash[22744]: audit 2024-09-16T12:02:57.356563+0000 mon.b (mon.2) 1515 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T12:02:58.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:02:57 smithi047 bash[22744]: audit 2024-09-16T12:02:57.358212+0000 mon.b (mon.2) 1516 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T12:02:58.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:02:57 smithi047 bash[22744]: audit 2024-09-16T12:02:57.366303+0000 mon.a (mon.0) 1565 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:02:58.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:02:57 smithi047 bash[22744]: audit 2024-09-16T12:02:57.370698+0000 mon.b (mon.2) 1517 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:02:58.593 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 12:02:58 smithi047 bash[22994]: debug 2024-09-16T12:02:58.153+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T12:02:58.593 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 12:02:58 smithi047 bash[22994]: debug 2024-09-16T12:02:58.153+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T12:02:59.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:02:58 smithi157 bash[24585]: audit 2024-09-16T12:02:57.004912+0000 mgr.a (mgr.14373) 16681 : audit [DBG] from='client.359187 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:02:59.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:02:58 smithi157 bash[24585]: audit 2024-09-16T12:02:57.372085+0000 mgr.a (mgr.14373) 16682 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:02:59.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:02:58 smithi086 bash[24289]: audit 2024-09-16T12:02:57.004912+0000 mgr.a (mgr.14373) 16681 : audit [DBG] from='client.359187 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:02:59.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:02:58 smithi086 bash[24289]: audit 2024-09-16T12:02:57.372085+0000 mgr.a (mgr.14373) 16682 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:02:59.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:02:58 smithi047 bash[22744]: audit 2024-09-16T12:02:57.004912+0000 mgr.a (mgr.14373) 16681 : audit [DBG] from='client.359187 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:02:59.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:02:58 smithi047 bash[22744]: audit 2024-09-16T12:02:57.372085+0000 mgr.a (mgr.14373) 16682 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:03:00.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:02:59 smithi157 bash[24585]: audit 2024-09-16T12:02:58.155619+0000 mgr.a (mgr.14373) 16683 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T12:03:00.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:02:59 smithi157 bash[24585]: cephadm 2024-09-16T12:02:58.158168+0000 mgr.a (mgr.14373) 16684 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T12:03:00.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:02:59 smithi157 bash[24585]: cluster 2024-09-16T12:02:58.342818+0000 mgr.a (mgr.14373) 16685 : cluster [DBG] pgmap v11571: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:03:00.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:02:59 smithi086 bash[24289]: audit 2024-09-16T12:02:58.155619+0000 mgr.a (mgr.14373) 16683 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T12:03:00.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:02:59 smithi086 bash[24289]: cephadm 2024-09-16T12:02:58.158168+0000 mgr.a (mgr.14373) 16684 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T12:03:00.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:02:59 smithi086 bash[24289]: cluster 2024-09-16T12:02:58.342818+0000 mgr.a (mgr.14373) 16685 : cluster [DBG] pgmap v11571: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:03:00.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:02:59 smithi047 bash[22744]: audit 2024-09-16T12:02:58.155619+0000 mgr.a (mgr.14373) 16683 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T12:03:00.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:02:59 smithi047 bash[22744]: cephadm 2024-09-16T12:02:58.158168+0000 mgr.a (mgr.14373) 16684 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T12:03:00.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:02:59 smithi047 bash[22744]: cluster 2024-09-16T12:02:58.342818+0000 mgr.a (mgr.14373) 16685 : cluster [DBG] pgmap v11571: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:03:01.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:03:00 smithi157 bash[24585]: cluster 2024-09-16T12:03:00.343572+0000 mgr.a (mgr.14373) 16686 : cluster [DBG] pgmap v11572: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:03:01.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:03:00 smithi086 bash[24289]: cluster 2024-09-16T12:03:00.343572+0000 mgr.a (mgr.14373) 16686 : cluster [DBG] pgmap v11572: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:03:01.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:03:00 smithi047 bash[22744]: cluster 2024-09-16T12:03:00.343572+0000 mgr.a (mgr.14373) 16686 : cluster [DBG] pgmap v11572: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:03:02.459 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:03:02.460 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:03:02.460 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:03:03.256 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:03:03.257 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:03:03.257 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:03:03.257 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:03:03.257 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:03:03.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:03:03 smithi157 bash[24585]: cluster 2024-09-16T12:03:02.345701+0000 mgr.a (mgr.14373) 16687 : cluster [DBG] pgmap v11573: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:03:03.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:03:03 smithi086 bash[24289]: cluster 2024-09-16T12:03:02.345701+0000 mgr.a (mgr.14373) 16687 : cluster [DBG] pgmap v11573: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:03:03.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:03:03 smithi047 bash[22744]: cluster 2024-09-16T12:03:02.345701+0000 mgr.a (mgr.14373) 16687 : cluster [DBG] pgmap v11573: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:03:04.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:03:04 smithi157 bash[24585]: audit 2024-09-16T12:03:02.795312+0000 mgr.a (mgr.14373) 16688 : audit [DBG] from='client.359373 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:03:04.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:03:04 smithi086 bash[24289]: audit 2024-09-16T12:03:02.795312+0000 mgr.a (mgr.14373) 16688 : audit [DBG] from='client.359373 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:03:04.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:03:04 smithi047 bash[22744]: audit 2024-09-16T12:03:02.795312+0000 mgr.a (mgr.14373) 16688 : audit [DBG] from='client.359373 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:03:05.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:03:05 smithi157 bash[24585]: cluster 2024-09-16T12:03:04.346670+0000 mgr.a (mgr.14373) 16689 : cluster [DBG] pgmap v11574: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T12:03:05.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:03:05 smithi086 bash[24289]: cluster 2024-09-16T12:03:04.346670+0000 mgr.a (mgr.14373) 16689 : cluster [DBG] pgmap v11574: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T12:03:05.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:03:05 smithi047 bash[22744]: cluster 2024-09-16T12:03:04.346670+0000 mgr.a (mgr.14373) 16689 : cluster [DBG] pgmap v11574: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T12:03:07.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:03:07 smithi157 bash[24585]: cluster 2024-09-16T12:03:06.347456+0000 mgr.a (mgr.14373) 16690 : cluster [DBG] pgmap v11575: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T12:03:07.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:03:07 smithi086 bash[24289]: cluster 2024-09-16T12:03:06.347456+0000 mgr.a (mgr.14373) 16690 : cluster [DBG] pgmap v11575: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T12:03:07.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:03:07 smithi047 bash[22744]: cluster 2024-09-16T12:03:06.347456+0000 mgr.a (mgr.14373) 16690 : cluster [DBG] pgmap v11575: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T12:03:08.258 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:03:08.259 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:03:08.259 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:03:09.021 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:03:09.022 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:03:09.022 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:03:09.022 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:03:09.022 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:03:09.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:03:09 smithi157 bash[24585]: cluster 2024-09-16T12:03:08.349394+0000 mgr.a (mgr.14373) 16691 : cluster [DBG] pgmap v11576: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:03:09.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:03:09 smithi157 bash[24585]: audit 2024-09-16T12:03:08.590565+0000 mgr.a (mgr.14373) 16692 : audit [DBG] from='client.359451 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:03:09.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:03:09 smithi086 bash[24289]: cluster 2024-09-16T12:03:08.349394+0000 mgr.a (mgr.14373) 16691 : cluster [DBG] pgmap v11576: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:03:09.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:03:09 smithi086 bash[24289]: audit 2024-09-16T12:03:08.590565+0000 mgr.a (mgr.14373) 16692 : audit [DBG] from='client.359451 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:03:09.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:03:09 smithi047 bash[22744]: cluster 2024-09-16T12:03:08.349394+0000 mgr.a (mgr.14373) 16691 : cluster [DBG] pgmap v11576: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:03:09.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:03:09 smithi047 bash[22744]: audit 2024-09-16T12:03:08.590565+0000 mgr.a (mgr.14373) 16692 : audit [DBG] from='client.359451 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:03:11.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:03:11 smithi157 bash[24585]: cluster 2024-09-16T12:03:10.350306+0000 mgr.a (mgr.14373) 16693 : cluster [DBG] pgmap v11577: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:03:11.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:03:11 smithi086 bash[24289]: cluster 2024-09-16T12:03:10.350306+0000 mgr.a (mgr.14373) 16693 : cluster [DBG] pgmap v11577: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:03:11.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:03:11 smithi047 bash[22744]: cluster 2024-09-16T12:03:10.350306+0000 mgr.a (mgr.14373) 16693 : cluster [DBG] pgmap v11577: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:03:13.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:03:13 smithi157 bash[24585]: cluster 2024-09-16T12:03:12.352540+0000 mgr.a (mgr.14373) 16694 : cluster [DBG] pgmap v11578: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:03:13.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:03:13 smithi086 bash[24289]: cluster 2024-09-16T12:03:12.352540+0000 mgr.a (mgr.14373) 16694 : cluster [DBG] pgmap v11578: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:03:13.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:03:13 smithi047 bash[22744]: cluster 2024-09-16T12:03:12.352540+0000 mgr.a (mgr.14373) 16694 : cluster [DBG] pgmap v11578: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:03:14.023 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:03:14.024 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:03:14.024 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:03:14.810 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:03:14.810 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:03:14.810 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:03:14.810 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:03:14.810 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:03:15.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:03:15 smithi157 bash[24585]: cluster 2024-09-16T12:03:14.353274+0000 mgr.a (mgr.14373) 16695 : cluster [DBG] pgmap v11579: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:03:15.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:03:15 smithi157 bash[24585]: audit 2024-09-16T12:03:14.363140+0000 mgr.a (mgr.14373) 16696 : audit [DBG] from='client.359526 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:03:15.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:03:15 smithi086 bash[24289]: cluster 2024-09-16T12:03:14.353274+0000 mgr.a (mgr.14373) 16695 : cluster [DBG] pgmap v11579: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:03:15.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:03:15 smithi086 bash[24289]: audit 2024-09-16T12:03:14.363140+0000 mgr.a (mgr.14373) 16696 : audit [DBG] from='client.359526 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:03:15.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:03:15 smithi047 bash[22744]: cluster 2024-09-16T12:03:14.353274+0000 mgr.a (mgr.14373) 16695 : cluster [DBG] pgmap v11579: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:03:15.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:03:15 smithi047 bash[22744]: audit 2024-09-16T12:03:14.363140+0000 mgr.a (mgr.14373) 16696 : audit [DBG] from='client.359526 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:03:17.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:03:17 smithi157 bash[24585]: cluster 2024-09-16T12:03:16.354332+0000 mgr.a (mgr.14373) 16697 : cluster [DBG] pgmap v11580: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:03:17.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:03:17 smithi086 bash[24289]: cluster 2024-09-16T12:03:16.354332+0000 mgr.a (mgr.14373) 16697 : cluster [DBG] pgmap v11580: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:03:17.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:03:17 smithi047 bash[22744]: cluster 2024-09-16T12:03:16.354332+0000 mgr.a (mgr.14373) 16697 : cluster [DBG] pgmap v11580: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:03:19.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:03:19 smithi157 bash[24585]: cluster 2024-09-16T12:03:18.357025+0000 mgr.a (mgr.14373) 16698 : cluster [DBG] pgmap v11581: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:03:19.811 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:03:19.812 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:03:19.812 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:03:19.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:03:19 smithi086 bash[24289]: cluster 2024-09-16T12:03:18.357025+0000 mgr.a (mgr.14373) 16698 : cluster [DBG] pgmap v11581: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:03:19.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:03:19 smithi047 bash[22744]: cluster 2024-09-16T12:03:18.357025+0000 mgr.a (mgr.14373) 16698 : cluster [DBG] pgmap v11581: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:03:20.569 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:03:20.569 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:03:20.569 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:03:20.569 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:03:20.569 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:03:21.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:03:21 smithi157 bash[24585]: audit 2024-09-16T12:03:20.141097+0000 mgr.a (mgr.14373) 16699 : audit [DBG] from='client.359604 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:03:21.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:03:21 smithi157 bash[24585]: cluster 2024-09-16T12:03:20.357549+0000 mgr.a (mgr.14373) 16700 : cluster [DBG] pgmap v11582: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:03:21.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:03:21 smithi086 bash[24289]: audit 2024-09-16T12:03:20.141097+0000 mgr.a (mgr.14373) 16699 : audit [DBG] from='client.359604 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:03:21.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:03:21 smithi086 bash[24289]: cluster 2024-09-16T12:03:20.357549+0000 mgr.a (mgr.14373) 16700 : cluster [DBG] pgmap v11582: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:03:21.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:03:21 smithi047 bash[22744]: audit 2024-09-16T12:03:20.141097+0000 mgr.a (mgr.14373) 16699 : audit [DBG] from='client.359604 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:03:21.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:03:21 smithi047 bash[22744]: cluster 2024-09-16T12:03:20.357549+0000 mgr.a (mgr.14373) 16700 : cluster [DBG] pgmap v11582: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:03:23.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:03:23 smithi157 bash[24585]: cluster 2024-09-16T12:03:22.359981+0000 mgr.a (mgr.14373) 16701 : cluster [DBG] pgmap v11583: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:03:23.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:03:23 smithi086 bash[24289]: cluster 2024-09-16T12:03:22.359981+0000 mgr.a (mgr.14373) 16701 : cluster [DBG] pgmap v11583: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:03:23.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:03:23 smithi047 bash[22744]: cluster 2024-09-16T12:03:22.359981+0000 mgr.a (mgr.14373) 16701 : cluster [DBG] pgmap v11583: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:03:25.570 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:03:25.571 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:03:25.571 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:03:25.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:03:25 smithi157 bash[24585]: cluster 2024-09-16T12:03:24.360777+0000 mgr.a (mgr.14373) 16702 : cluster [DBG] pgmap v11584: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:03:25.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:03:25 smithi086 bash[24289]: cluster 2024-09-16T12:03:24.360777+0000 mgr.a (mgr.14373) 16702 : cluster [DBG] pgmap v11584: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:03:25.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:03:25 smithi047 bash[22744]: cluster 2024-09-16T12:03:24.360777+0000 mgr.a (mgr.14373) 16702 : cluster [DBG] pgmap v11584: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:03:26.320 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:03:26.321 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:03:26.321 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:03:26.321 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:03:26.321 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:03:27.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:03:27 smithi157 bash[24585]: audit 2024-09-16T12:03:25.898650+0000 mgr.a (mgr.14373) 16703 : audit [DBG] from='client.359679 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:03:27.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:03:27 smithi157 bash[24585]: cluster 2024-09-16T12:03:26.361522+0000 mgr.a (mgr.14373) 16704 : cluster [DBG] pgmap v11585: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:03:27.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:03:27 smithi086 bash[24289]: audit 2024-09-16T12:03:25.898650+0000 mgr.a (mgr.14373) 16703 : audit [DBG] from='client.359679 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:03:27.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:03:27 smithi086 bash[24289]: cluster 2024-09-16T12:03:26.361522+0000 mgr.a (mgr.14373) 16704 : cluster [DBG] pgmap v11585: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:03:27.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:03:27 smithi047 bash[22744]: audit 2024-09-16T12:03:25.898650+0000 mgr.a (mgr.14373) 16703 : audit [DBG] from='client.359679 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:03:27.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:03:27 smithi047 bash[22744]: cluster 2024-09-16T12:03:26.361522+0000 mgr.a (mgr.14373) 16704 : cluster [DBG] pgmap v11585: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:03:29.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:03:29 smithi157 bash[24585]: cluster 2024-09-16T12:03:28.363839+0000 mgr.a (mgr.14373) 16705 : cluster [DBG] pgmap v11586: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:03:29.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:03:29 smithi086 bash[24289]: cluster 2024-09-16T12:03:28.363839+0000 mgr.a (mgr.14373) 16705 : cluster [DBG] pgmap v11586: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:03:29.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:03:29 smithi047 bash[22744]: cluster 2024-09-16T12:03:28.363839+0000 mgr.a (mgr.14373) 16705 : cluster [DBG] pgmap v11586: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:03:31.322 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:03:31.323 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:03:31.323 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:03:31.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:03:31 smithi157 bash[24585]: cluster 2024-09-16T12:03:30.364741+0000 mgr.a (mgr.14373) 16706 : cluster [DBG] pgmap v11587: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:03:31.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:03:31 smithi086 bash[24289]: cluster 2024-09-16T12:03:30.364741+0000 mgr.a (mgr.14373) 16706 : cluster [DBG] pgmap v11587: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:03:31.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:03:31 smithi047 bash[22744]: cluster 2024-09-16T12:03:30.364741+0000 mgr.a (mgr.14373) 16706 : cluster [DBG] pgmap v11587: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:03:32.079 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:03:32.079 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:03:32.079 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:03:32.079 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:03:32.079 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:03:32.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:03:32 smithi157 bash[24585]: audit 2024-09-16T12:03:31.650368+0000 mgr.a (mgr.14373) 16707 : audit [DBG] from='client.359757 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:03:32.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:03:32 smithi086 bash[24289]: audit 2024-09-16T12:03:31.650368+0000 mgr.a (mgr.14373) 16707 : audit [DBG] from='client.359757 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:03:32.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:03:32 smithi047 bash[22744]: audit 2024-09-16T12:03:31.650368+0000 mgr.a (mgr.14373) 16707 : audit [DBG] from='client.359757 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:03:33.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:03:33 smithi157 bash[24585]: cluster 2024-09-16T12:03:32.367696+0000 mgr.a (mgr.14373) 16708 : cluster [DBG] pgmap v11588: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:03:33.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:03:33 smithi086 bash[24289]: cluster 2024-09-16T12:03:32.367696+0000 mgr.a (mgr.14373) 16708 : cluster [DBG] pgmap v11588: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:03:33.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:03:33 smithi047 bash[22744]: cluster 2024-09-16T12:03:32.367696+0000 mgr.a (mgr.14373) 16708 : cluster [DBG] pgmap v11588: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:03:35.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:03:35 smithi157 bash[24585]: cluster 2024-09-16T12:03:34.368644+0000 mgr.a (mgr.14373) 16709 : cluster [DBG] pgmap v11589: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:03:35.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:03:35 smithi086 bash[24289]: cluster 2024-09-16T12:03:34.368644+0000 mgr.a (mgr.14373) 16709 : cluster [DBG] pgmap v11589: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:03:35.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:03:35 smithi047 bash[22744]: cluster 2024-09-16T12:03:34.368644+0000 mgr.a (mgr.14373) 16709 : cluster [DBG] pgmap v11589: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:03:37.080 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:03:37.081 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:03:37.081 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:03:37.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:03:37 smithi157 bash[24585]: cluster 2024-09-16T12:03:36.369557+0000 mgr.a (mgr.14373) 16710 : cluster [DBG] pgmap v11590: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:03:37.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:03:37 smithi086 bash[24289]: cluster 2024-09-16T12:03:36.369557+0000 mgr.a (mgr.14373) 16710 : cluster [DBG] pgmap v11590: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:03:37.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:03:37 smithi047 bash[22744]: cluster 2024-09-16T12:03:36.369557+0000 mgr.a (mgr.14373) 16710 : cluster [DBG] pgmap v11590: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:03:37.853 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:03:37.854 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:03:37.854 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:03:37.854 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:03:37.854 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:03:38.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:03:38 smithi157 bash[24585]: audit 2024-09-16T12:03:37.410036+0000 mgr.a (mgr.14373) 16711 : audit [DBG] from='client.359832 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:03:38.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:03:38 smithi086 bash[24289]: audit 2024-09-16T12:03:37.410036+0000 mgr.a (mgr.14373) 16711 : audit [DBG] from='client.359832 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:03:38.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:03:38 smithi047 bash[22744]: audit 2024-09-16T12:03:37.410036+0000 mgr.a (mgr.14373) 16711 : audit [DBG] from='client.359832 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:03:39.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:03:39 smithi157 bash[24585]: cluster 2024-09-16T12:03:38.372523+0000 mgr.a (mgr.14373) 16712 : cluster [DBG] pgmap v11591: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:03:39.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:03:39 smithi086 bash[24289]: cluster 2024-09-16T12:03:38.372523+0000 mgr.a (mgr.14373) 16712 : cluster [DBG] pgmap v11591: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:03:39.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:03:39 smithi047 bash[22744]: cluster 2024-09-16T12:03:38.372523+0000 mgr.a (mgr.14373) 16712 : cluster [DBG] pgmap v11591: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:03:41.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:03:41 smithi157 bash[24585]: cluster 2024-09-16T12:03:40.373470+0000 mgr.a (mgr.14373) 16713 : cluster [DBG] pgmap v11592: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:03:41.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:03:41 smithi086 bash[24289]: cluster 2024-09-16T12:03:40.373470+0000 mgr.a (mgr.14373) 16713 : cluster [DBG] pgmap v11592: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:03:41.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:03:41 smithi047 bash[22744]: cluster 2024-09-16T12:03:40.373470+0000 mgr.a (mgr.14373) 16713 : cluster [DBG] pgmap v11592: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:03:42.855 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:03:42.856 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:03:42.856 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:03:43.613 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:03:43.614 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:03:43.614 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:03:43.614 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:03:43.614 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:03:43.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:03:43 smithi157 bash[24585]: cluster 2024-09-16T12:03:42.375552+0000 mgr.a (mgr.14373) 16714 : cluster [DBG] pgmap v11593: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:03:43.826 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:03:43 smithi086 bash[24289]: cluster 2024-09-16T12:03:42.375552+0000 mgr.a (mgr.14373) 16714 : cluster [DBG] pgmap v11593: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:03:43.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:03:43 smithi047 bash[22744]: cluster 2024-09-16T12:03:42.375552+0000 mgr.a (mgr.14373) 16714 : cluster [DBG] pgmap v11593: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:03:44.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:03:44 smithi157 bash[24585]: audit 2024-09-16T12:03:43.188431+0000 mgr.a (mgr.14373) 16715 : audit [DBG] from='client.359910 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:03:44.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:03:44 smithi086 bash[24289]: audit 2024-09-16T12:03:43.188431+0000 mgr.a (mgr.14373) 16715 : audit [DBG] from='client.359910 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:03:44.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:03:44 smithi047 bash[22744]: audit 2024-09-16T12:03:43.188431+0000 mgr.a (mgr.14373) 16715 : audit [DBG] from='client.359910 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:03:45.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:03:45 smithi157 bash[24585]: cluster 2024-09-16T12:03:44.376460+0000 mgr.a (mgr.14373) 16716 : cluster [DBG] pgmap v11594: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:03:45.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:03:45 smithi086 bash[24289]: cluster 2024-09-16T12:03:44.376460+0000 mgr.a (mgr.14373) 16716 : cluster [DBG] pgmap v11594: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:03:45.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:03:45 smithi047 bash[22744]: cluster 2024-09-16T12:03:44.376460+0000 mgr.a (mgr.14373) 16716 : cluster [DBG] pgmap v11594: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:03:47.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:03:47 smithi157 bash[24585]: cluster 2024-09-16T12:03:46.377281+0000 mgr.a (mgr.14373) 16717 : cluster [DBG] pgmap v11595: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:03:47.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:03:47 smithi086 bash[24289]: cluster 2024-09-16T12:03:46.377281+0000 mgr.a (mgr.14373) 16717 : cluster [DBG] pgmap v11595: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:03:47.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:03:47 smithi047 bash[22744]: cluster 2024-09-16T12:03:46.377281+0000 mgr.a (mgr.14373) 16717 : cluster [DBG] pgmap v11595: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:03:48.615 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:03:48.616 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:03:48.616 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:03:49.396 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:03:49.397 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:03:49.397 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:03:49.397 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:03:49.397 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:03:49.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:03:49 smithi157 bash[24585]: cluster 2024-09-16T12:03:48.379553+0000 mgr.a (mgr.14373) 16718 : cluster [DBG] pgmap v11596: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:03:49.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:03:49 smithi086 bash[24289]: cluster 2024-09-16T12:03:48.379553+0000 mgr.a (mgr.14373) 16718 : cluster [DBG] pgmap v11596: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:03:49.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:03:49 smithi047 bash[22744]: cluster 2024-09-16T12:03:48.379553+0000 mgr.a (mgr.14373) 16718 : cluster [DBG] pgmap v11596: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:03:50.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:03:50 smithi157 bash[24585]: audit 2024-09-16T12:03:48.948377+0000 mgr.a (mgr.14373) 16719 : audit [DBG] from='client.359988 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:03:50.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:03:50 smithi086 bash[24289]: audit 2024-09-16T12:03:48.948377+0000 mgr.a (mgr.14373) 16719 : audit [DBG] from='client.359988 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:03:50.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:03:50 smithi047 bash[22744]: audit 2024-09-16T12:03:48.948377+0000 mgr.a (mgr.14373) 16719 : audit [DBG] from='client.359988 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:03:51.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:03:51 smithi157 bash[24585]: cluster 2024-09-16T12:03:50.380438+0000 mgr.a (mgr.14373) 16720 : cluster [DBG] pgmap v11597: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:03:51.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:03:51 smithi086 bash[24289]: cluster 2024-09-16T12:03:50.380438+0000 mgr.a (mgr.14373) 16720 : cluster [DBG] pgmap v11597: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:03:51.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:03:51 smithi047 bash[22744]: cluster 2024-09-16T12:03:50.380438+0000 mgr.a (mgr.14373) 16720 : cluster [DBG] pgmap v11597: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:03:53.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:03:52 smithi047 bash[22744]: cluster 2024-09-16T12:03:52.382744+0000 mgr.a (mgr.14373) 16721 : cluster [DBG] pgmap v11598: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:03:53.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:03:52 smithi157 bash[24585]: cluster 2024-09-16T12:03:52.382744+0000 mgr.a (mgr.14373) 16721 : cluster [DBG] pgmap v11598: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:03:53.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:03:52 smithi086 bash[24289]: cluster 2024-09-16T12:03:52.382744+0000 mgr.a (mgr.14373) 16721 : cluster [DBG] pgmap v11598: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:03:54.397 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:03:54.397 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:03:54.397 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:03:55.181 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:03:55.182 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:03:55.182 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:03:55.182 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:03:55.182 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:03:55.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:03:55 smithi157 bash[24585]: cluster 2024-09-16T12:03:54.383497+0000 mgr.a (mgr.14373) 16722 : cluster [DBG] pgmap v11599: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:03:55.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:03:55 smithi157 bash[24585]: audit 2024-09-16T12:03:54.732768+0000 mgr.a (mgr.14373) 16723 : audit [DBG] from='client.360063 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:03:55.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:03:55 smithi086 bash[24289]: cluster 2024-09-16T12:03:54.383497+0000 mgr.a (mgr.14373) 16722 : cluster [DBG] pgmap v11599: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:03:55.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:03:55 smithi086 bash[24289]: audit 2024-09-16T12:03:54.732768+0000 mgr.a (mgr.14373) 16723 : audit [DBG] from='client.360063 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:03:55.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:03:55 smithi047 bash[22744]: cluster 2024-09-16T12:03:54.383497+0000 mgr.a (mgr.14373) 16722 : cluster [DBG] pgmap v11599: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:03:55.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:03:55 smithi047 bash[22744]: audit 2024-09-16T12:03:54.732768+0000 mgr.a (mgr.14373) 16723 : audit [DBG] from='client.360063 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:03:57.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:03:57 smithi157 bash[24585]: cluster 2024-09-16T12:03:56.384535+0000 mgr.a (mgr.14373) 16724 : cluster [DBG] pgmap v11600: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:03:57.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:03:57 smithi086 bash[24289]: cluster 2024-09-16T12:03:56.384535+0000 mgr.a (mgr.14373) 16724 : cluster [DBG] pgmap v11600: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:03:57.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:03:57 smithi047 bash[22744]: cluster 2024-09-16T12:03:56.384535+0000 mgr.a (mgr.14373) 16724 : cluster [DBG] pgmap v11600: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:03:58.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:03:58 smithi157 bash[24585]: audit 2024-09-16T12:03:58.214008+0000 mon.b (mon.2) 1518 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T12:03:58.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:03:58 smithi086 bash[24289]: audit 2024-09-16T12:03:58.214008+0000 mon.b (mon.2) 1518 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T12:03:58.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:03:58 smithi047 bash[22744]: audit 2024-09-16T12:03:58.214008+0000 mon.b (mon.2) 1518 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T12:03:59.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:03:59 smithi157 bash[24585]: cluster 2024-09-16T12:03:58.386923+0000 mgr.a (mgr.14373) 16725 : cluster [DBG] pgmap v11601: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:03:59.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:03:59 smithi157 bash[24585]: audit 2024-09-16T12:03:59.066774+0000 mon.b (mon.2) 1519 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T12:03:59.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:03:59 smithi157 bash[24585]: audit 2024-09-16T12:03:59.068952+0000 mon.b (mon.2) 1520 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T12:03:59.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:03:59 smithi157 bash[24585]: audit 2024-09-16T12:03:59.078409+0000 mon.a (mon.0) 1566 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:03:59.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:03:59 smithi157 bash[24585]: audit 2024-09-16T12:03:59.086167+0000 mon.b (mon.2) 1521 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:03:59.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:03:59 smithi086 bash[24289]: cluster 2024-09-16T12:03:58.386923+0000 mgr.a (mgr.14373) 16725 : cluster [DBG] pgmap v11601: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:03:59.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:03:59 smithi086 bash[24289]: audit 2024-09-16T12:03:59.066774+0000 mon.b (mon.2) 1519 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T12:03:59.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:03:59 smithi086 bash[24289]: audit 2024-09-16T12:03:59.068952+0000 mon.b (mon.2) 1520 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T12:03:59.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:03:59 smithi086 bash[24289]: audit 2024-09-16T12:03:59.078409+0000 mon.a (mon.0) 1566 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:03:59.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:03:59 smithi086 bash[24289]: audit 2024-09-16T12:03:59.086167+0000 mon.b (mon.2) 1521 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:03:59.825 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:03:59 smithi047 bash[22744]: cluster 2024-09-16T12:03:58.386923+0000 mgr.a (mgr.14373) 16725 : cluster [DBG] pgmap v11601: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:03:59.825 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:03:59 smithi047 bash[22744]: audit 2024-09-16T12:03:59.066774+0000 mon.b (mon.2) 1519 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T12:03:59.825 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:03:59 smithi047 bash[22744]: audit 2024-09-16T12:03:59.068952+0000 mon.b (mon.2) 1520 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T12:03:59.825 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:03:59 smithi047 bash[22744]: audit 2024-09-16T12:03:59.078409+0000 mon.a (mon.0) 1566 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:03:59.826 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:03:59 smithi047 bash[22744]: audit 2024-09-16T12:03:59.086167+0000 mon.b (mon.2) 1521 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:04:00.093 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 12:03:59 smithi047 bash[22994]: debug 2024-09-16T12:03:59.820+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T12:04:00.093 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 12:03:59 smithi047 bash[22994]: debug 2024-09-16T12:03:59.820+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T12:04:00.183 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:04:00.184 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:04:00.184 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:04:00.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:04:00 smithi157 bash[24585]: audit 2024-09-16T12:03:59.088548+0000 mgr.a (mgr.14373) 16726 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:04:00.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:04:00 smithi086 bash[24289]: audit 2024-09-16T12:03:59.088548+0000 mgr.a (mgr.14373) 16726 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:04:00.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:04:00 smithi047 bash[22744]: audit 2024-09-16T12:03:59.088548+0000 mgr.a (mgr.14373) 16726 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:04:00.957 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:04:00.957 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:04:00.957 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:04:00.957 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:04:00.957 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:04:01.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:04:01 smithi157 bash[24585]: audit 2024-09-16T12:03:59.824029+0000 mgr.a (mgr.14373) 16727 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T12:04:01.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:04:01 smithi157 bash[24585]: cephadm 2024-09-16T12:03:59.825805+0000 mgr.a (mgr.14373) 16728 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T12:04:01.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:04:01 smithi157 bash[24585]: cluster 2024-09-16T12:04:00.388003+0000 mgr.a (mgr.14373) 16729 : cluster [DBG] pgmap v11602: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:04:01.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:04:01 smithi157 bash[24585]: audit 2024-09-16T12:04:00.515307+0000 mgr.a (mgr.14373) 16730 : audit [DBG] from='client.360243 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:04:01.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:04:01 smithi086 bash[24289]: audit 2024-09-16T12:03:59.824029+0000 mgr.a (mgr.14373) 16727 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T12:04:01.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:04:01 smithi086 bash[24289]: cephadm 2024-09-16T12:03:59.825805+0000 mgr.a (mgr.14373) 16728 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T12:04:01.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:04:01 smithi086 bash[24289]: cluster 2024-09-16T12:04:00.388003+0000 mgr.a (mgr.14373) 16729 : cluster [DBG] pgmap v11602: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:04:01.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:04:01 smithi086 bash[24289]: audit 2024-09-16T12:04:00.515307+0000 mgr.a (mgr.14373) 16730 : audit [DBG] from='client.360243 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:04:01.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:04:01 smithi047 bash[22744]: audit 2024-09-16T12:03:59.824029+0000 mgr.a (mgr.14373) 16727 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T12:04:01.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:04:01 smithi047 bash[22744]: cephadm 2024-09-16T12:03:59.825805+0000 mgr.a (mgr.14373) 16728 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T12:04:01.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:04:01 smithi047 bash[22744]: cluster 2024-09-16T12:04:00.388003+0000 mgr.a (mgr.14373) 16729 : cluster [DBG] pgmap v11602: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:04:01.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:04:01 smithi047 bash[22744]: audit 2024-09-16T12:04:00.515307+0000 mgr.a (mgr.14373) 16730 : audit [DBG] from='client.360243 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:04:03.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:04:03 smithi157 bash[24585]: cluster 2024-09-16T12:04:02.390413+0000 mgr.a (mgr.14373) 16731 : cluster [DBG] pgmap v11603: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:04:03.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:04:03 smithi086 bash[24289]: cluster 2024-09-16T12:04:02.390413+0000 mgr.a (mgr.14373) 16731 : cluster [DBG] pgmap v11603: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:04:03.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:04:03 smithi047 bash[22744]: cluster 2024-09-16T12:04:02.390413+0000 mgr.a (mgr.14373) 16731 : cluster [DBG] pgmap v11603: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:04:05.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:04:05 smithi157 bash[24585]: cluster 2024-09-16T12:04:04.391189+0000 mgr.a (mgr.14373) 16732 : cluster [DBG] pgmap v11604: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:04:05.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:04:05 smithi086 bash[24289]: cluster 2024-09-16T12:04:04.391189+0000 mgr.a (mgr.14373) 16732 : cluster [DBG] pgmap v11604: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:04:05.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:04:05 smithi047 bash[22744]: cluster 2024-09-16T12:04:04.391189+0000 mgr.a (mgr.14373) 16732 : cluster [DBG] pgmap v11604: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:04:05.959 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:04:05.959 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:04:05.959 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:04:06.751 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:04:06.751 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:04:06.751 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:04:06.751 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:04:06.751 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:04:07.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:04:07 smithi157 bash[24585]: audit 2024-09-16T12:04:06.295393+0000 mgr.a (mgr.14373) 16733 : audit [DBG] from='client.360321 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:04:07.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:04:07 smithi157 bash[24585]: cluster 2024-09-16T12:04:06.391867+0000 mgr.a (mgr.14373) 16734 : cluster [DBG] pgmap v11605: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:04:07.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:04:07 smithi086 bash[24289]: audit 2024-09-16T12:04:06.295393+0000 mgr.a (mgr.14373) 16733 : audit [DBG] from='client.360321 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:04:07.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:04:07 smithi086 bash[24289]: cluster 2024-09-16T12:04:06.391867+0000 mgr.a (mgr.14373) 16734 : cluster [DBG] pgmap v11605: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:04:07.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:04:07 smithi047 bash[22744]: audit 2024-09-16T12:04:06.295393+0000 mgr.a (mgr.14373) 16733 : audit [DBG] from='client.360321 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:04:07.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:04:07 smithi047 bash[22744]: cluster 2024-09-16T12:04:06.391867+0000 mgr.a (mgr.14373) 16734 : cluster [DBG] pgmap v11605: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:04:09.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:04:09 smithi157 bash[24585]: cluster 2024-09-16T12:04:08.394223+0000 mgr.a (mgr.14373) 16735 : cluster [DBG] pgmap v11606: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:04:09.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:04:09 smithi086 bash[24289]: cluster 2024-09-16T12:04:08.394223+0000 mgr.a (mgr.14373) 16735 : cluster [DBG] pgmap v11606: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:04:09.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:04:09 smithi047 bash[22744]: cluster 2024-09-16T12:04:08.394223+0000 mgr.a (mgr.14373) 16735 : cluster [DBG] pgmap v11606: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:04:11.752 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:04:11.753 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:04:11.753 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:04:11.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:04:11 smithi157 bash[24585]: cluster 2024-09-16T12:04:10.394999+0000 mgr.a (mgr.14373) 16736 : cluster [DBG] pgmap v11607: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T12:04:11.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:04:11 smithi086 bash[24289]: cluster 2024-09-16T12:04:10.394999+0000 mgr.a (mgr.14373) 16736 : cluster [DBG] pgmap v11607: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T12:04:11.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:04:11 smithi047 bash[22744]: cluster 2024-09-16T12:04:10.394999+0000 mgr.a (mgr.14373) 16736 : cluster [DBG] pgmap v11607: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T12:04:12.510 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:04:12.511 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:04:12.511 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:04:12.511 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:04:12.511 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:04:13.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:04:13 smithi157 bash[24585]: audit 2024-09-16T12:04:12.087077+0000 mgr.a (mgr.14373) 16737 : audit [DBG] from='client.360393 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:04:13.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:04:13 smithi157 bash[24585]: cluster 2024-09-16T12:04:12.396219+0000 mgr.a (mgr.14373) 16738 : cluster [DBG] pgmap v11608: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:04:13.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:04:13 smithi086 bash[24289]: audit 2024-09-16T12:04:12.087077+0000 mgr.a (mgr.14373) 16737 : audit [DBG] from='client.360393 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:04:13.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:04:13 smithi086 bash[24289]: cluster 2024-09-16T12:04:12.396219+0000 mgr.a (mgr.14373) 16738 : cluster [DBG] pgmap v11608: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:04:13.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:04:13 smithi047 bash[22744]: audit 2024-09-16T12:04:12.087077+0000 mgr.a (mgr.14373) 16737 : audit [DBG] from='client.360393 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:04:13.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:04:13 smithi047 bash[22744]: cluster 2024-09-16T12:04:12.396219+0000 mgr.a (mgr.14373) 16738 : cluster [DBG] pgmap v11608: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:04:15.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:04:15 smithi157 bash[24585]: cluster 2024-09-16T12:04:14.397067+0000 mgr.a (mgr.14373) 16739 : cluster [DBG] pgmap v11609: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T12:04:15.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:04:15 smithi086 bash[24289]: cluster 2024-09-16T12:04:14.397067+0000 mgr.a (mgr.14373) 16739 : cluster [DBG] pgmap v11609: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T12:04:15.844 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:04:15 smithi047 bash[22744]: cluster 2024-09-16T12:04:14.397067+0000 mgr.a (mgr.14373) 16739 : cluster [DBG] pgmap v11609: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T12:04:17.512 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:04:17.512 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:04:17.513 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:04:17.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:04:17 smithi157 bash[24585]: cluster 2024-09-16T12:04:16.397841+0000 mgr.a (mgr.14373) 16740 : cluster [DBG] pgmap v11610: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T12:04:17.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:04:17 smithi086 bash[24289]: cluster 2024-09-16T12:04:16.397841+0000 mgr.a (mgr.14373) 16740 : cluster [DBG] pgmap v11610: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T12:04:17.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:04:17 smithi047 bash[22744]: cluster 2024-09-16T12:04:16.397841+0000 mgr.a (mgr.14373) 16740 : cluster [DBG] pgmap v11610: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T12:04:18.299 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:04:18.300 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:04:18.300 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:04:18.300 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:04:18.300 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:04:19.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:04:19 smithi157 bash[24585]: audit 2024-09-16T12:04:17.845333+0000 mgr.a (mgr.14373) 16741 : audit [DBG] from='client.360468 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:04:19.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:04:19 smithi157 bash[24585]: cluster 2024-09-16T12:04:18.400614+0000 mgr.a (mgr.14373) 16742 : cluster [DBG] pgmap v11611: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:04:19.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:04:19 smithi086 bash[24289]: audit 2024-09-16T12:04:17.845333+0000 mgr.a (mgr.14373) 16741 : audit [DBG] from='client.360468 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:04:19.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:04:19 smithi086 bash[24289]: cluster 2024-09-16T12:04:18.400614+0000 mgr.a (mgr.14373) 16742 : cluster [DBG] pgmap v11611: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:04:19.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:04:19 smithi047 bash[22744]: audit 2024-09-16T12:04:17.845333+0000 mgr.a (mgr.14373) 16741 : audit [DBG] from='client.360468 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:04:19.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:04:19 smithi047 bash[22744]: cluster 2024-09-16T12:04:18.400614+0000 mgr.a (mgr.14373) 16742 : cluster [DBG] pgmap v11611: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:04:21.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:04:21 smithi157 bash[24585]: cluster 2024-09-16T12:04:20.401396+0000 mgr.a (mgr.14373) 16743 : cluster [DBG] pgmap v11612: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-16T12:04:21.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:04:21 smithi086 bash[24289]: cluster 2024-09-16T12:04:20.401396+0000 mgr.a (mgr.14373) 16743 : cluster [DBG] pgmap v11612: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-16T12:04:21.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:04:21 smithi047 bash[22744]: cluster 2024-09-16T12:04:20.401396+0000 mgr.a (mgr.14373) 16743 : cluster [DBG] pgmap v11612: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-16T12:04:23.301 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:04:23.302 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:04:23.302 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:04:23.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:04:23 smithi157 bash[24585]: cluster 2024-09-16T12:04:22.403424+0000 mgr.a (mgr.14373) 16744 : cluster [DBG] pgmap v11613: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-16T12:04:23.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:04:23 smithi086 bash[24289]: cluster 2024-09-16T12:04:22.403424+0000 mgr.a (mgr.14373) 16744 : cluster [DBG] pgmap v11613: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-16T12:04:23.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:04:23 smithi047 bash[22744]: cluster 2024-09-16T12:04:22.403424+0000 mgr.a (mgr.14373) 16744 : cluster [DBG] pgmap v11613: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-16T12:04:24.087 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:04:24.087 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:04:24.087 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:04:24.087 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:04:24.088 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:04:24.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:04:24 smithi157 bash[24585]: audit 2024-09-16T12:04:23.641863+0000 mgr.a (mgr.14373) 16745 : audit [DBG] from='client.360546 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:04:24.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:04:24 smithi086 bash[24289]: audit 2024-09-16T12:04:23.641863+0000 mgr.a (mgr.14373) 16745 : audit [DBG] from='client.360546 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:04:24.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:04:24 smithi047 bash[22744]: audit 2024-09-16T12:04:23.641863+0000 mgr.a (mgr.14373) 16745 : audit [DBG] from='client.360546 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:04:25.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:04:25 smithi157 bash[24585]: cluster 2024-09-16T12:04:24.404338+0000 mgr.a (mgr.14373) 16746 : cluster [DBG] pgmap v11614: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:04:25.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:04:25 smithi086 bash[24289]: cluster 2024-09-16T12:04:24.404338+0000 mgr.a (mgr.14373) 16746 : cluster [DBG] pgmap v11614: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:04:25.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:04:25 smithi047 bash[22744]: cluster 2024-09-16T12:04:24.404338+0000 mgr.a (mgr.14373) 16746 : cluster [DBG] pgmap v11614: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:04:27.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:04:27 smithi157 bash[24585]: cluster 2024-09-16T12:04:26.405280+0000 mgr.a (mgr.14373) 16747 : cluster [DBG] pgmap v11615: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:04:27.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:04:27 smithi086 bash[24289]: cluster 2024-09-16T12:04:26.405280+0000 mgr.a (mgr.14373) 16747 : cluster [DBG] pgmap v11615: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:04:27.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:04:27 smithi047 bash[22744]: cluster 2024-09-16T12:04:26.405280+0000 mgr.a (mgr.14373) 16747 : cluster [DBG] pgmap v11615: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:04:29.089 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:04:29.089 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:04:29.090 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:04:29.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:04:29 smithi157 bash[24585]: cluster 2024-09-16T12:04:28.407682+0000 mgr.a (mgr.14373) 16748 : cluster [DBG] pgmap v11616: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:04:29.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:04:29 smithi086 bash[24289]: cluster 2024-09-16T12:04:28.407682+0000 mgr.a (mgr.14373) 16748 : cluster [DBG] pgmap v11616: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:04:29.841 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:04:29.841 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:04:29.842 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:04:29.842 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:04:29.842 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:04:29.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:04:29 smithi047 bash[22744]: cluster 2024-09-16T12:04:28.407682+0000 mgr.a (mgr.14373) 16748 : cluster [DBG] pgmap v11616: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:04:30.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:04:30 smithi157 bash[24585]: audit 2024-09-16T12:04:29.418946+0000 mgr.a (mgr.14373) 16749 : audit [DBG] from='client.360624 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:04:30.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:04:30 smithi086 bash[24289]: audit 2024-09-16T12:04:29.418946+0000 mgr.a (mgr.14373) 16749 : audit [DBG] from='client.360624 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:04:30.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:04:30 smithi047 bash[22744]: audit 2024-09-16T12:04:29.418946+0000 mgr.a (mgr.14373) 16749 : audit [DBG] from='client.360624 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:04:31.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:04:31 smithi157 bash[24585]: cluster 2024-09-16T12:04:30.408586+0000 mgr.a (mgr.14373) 16750 : cluster [DBG] pgmap v11617: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:04:31.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:04:31 smithi086 bash[24289]: cluster 2024-09-16T12:04:30.408586+0000 mgr.a (mgr.14373) 16750 : cluster [DBG] pgmap v11617: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:04:31.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:04:31 smithi047 bash[22744]: cluster 2024-09-16T12:04:30.408586+0000 mgr.a (mgr.14373) 16750 : cluster [DBG] pgmap v11617: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:04:33.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:04:33 smithi157 bash[24585]: cluster 2024-09-16T12:04:32.411053+0000 mgr.a (mgr.14373) 16751 : cluster [DBG] pgmap v11618: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:04:33.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:04:33 smithi086 bash[24289]: cluster 2024-09-16T12:04:32.411053+0000 mgr.a (mgr.14373) 16751 : cluster [DBG] pgmap v11618: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:04:33.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:04:33 smithi047 bash[22744]: cluster 2024-09-16T12:04:32.411053+0000 mgr.a (mgr.14373) 16751 : cluster [DBG] pgmap v11618: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:04:34.843 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:04:34.844 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:04:34.844 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:04:35.632 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:04:35.632 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:04:35.632 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:04:35.633 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:04:35.633 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:04:35.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:04:35 smithi157 bash[24585]: cluster 2024-09-16T12:04:34.411824+0000 mgr.a (mgr.14373) 16752 : cluster [DBG] pgmap v11619: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:04:35.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:04:35 smithi086 bash[24289]: cluster 2024-09-16T12:04:34.411824+0000 mgr.a (mgr.14373) 16752 : cluster [DBG] pgmap v11619: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:04:35.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:04:35 smithi047 bash[22744]: cluster 2024-09-16T12:04:34.411824+0000 mgr.a (mgr.14373) 16752 : cluster [DBG] pgmap v11619: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:04:36.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:04:36 smithi086 bash[24289]: audit 2024-09-16T12:04:35.180591+0000 mgr.a (mgr.14373) 16753 : audit [DBG] from='client.360702 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:04:36.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:04:36 smithi047 bash[22744]: audit 2024-09-16T12:04:35.180591+0000 mgr.a (mgr.14373) 16753 : audit [DBG] from='client.360702 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:04:37.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:04:36 smithi157 bash[24585]: audit 2024-09-16T12:04:35.180591+0000 mgr.a (mgr.14373) 16753 : audit [DBG] from='client.360702 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:04:37.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:04:37 smithi086 bash[24289]: cluster 2024-09-16T12:04:36.412732+0000 mgr.a (mgr.14373) 16754 : cluster [DBG] pgmap v11620: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:04:37.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:04:37 smithi047 bash[22744]: cluster 2024-09-16T12:04:36.412732+0000 mgr.a (mgr.14373) 16754 : cluster [DBG] pgmap v11620: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:04:38.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:04:37 smithi157 bash[24585]: cluster 2024-09-16T12:04:36.412732+0000 mgr.a (mgr.14373) 16754 : cluster [DBG] pgmap v11620: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:04:39.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:04:39 smithi086 bash[24289]: cluster 2024-09-16T12:04:38.415052+0000 mgr.a (mgr.14373) 16755 : cluster [DBG] pgmap v11621: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:04:39.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:04:39 smithi047 bash[22744]: cluster 2024-09-16T12:04:38.415052+0000 mgr.a (mgr.14373) 16755 : cluster [DBG] pgmap v11621: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:04:40.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:04:39 smithi157 bash[24585]: cluster 2024-09-16T12:04:38.415052+0000 mgr.a (mgr.14373) 16755 : cluster [DBG] pgmap v11621: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:04:40.634 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:04:40.635 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:04:40.635 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:04:41.397 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:04:41.397 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:04:41.397 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:04:41.397 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:04:41.397 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:04:41.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:04:41 smithi086 bash[24289]: cluster 2024-09-16T12:04:40.415819+0000 mgr.a (mgr.14373) 16756 : cluster [DBG] pgmap v11622: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:04:41.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:04:41 smithi047 bash[22744]: cluster 2024-09-16T12:04:40.415819+0000 mgr.a (mgr.14373) 16756 : cluster [DBG] pgmap v11622: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:04:42.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:04:41 smithi157 bash[24585]: cluster 2024-09-16T12:04:40.415819+0000 mgr.a (mgr.14373) 16756 : cluster [DBG] pgmap v11622: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:04:42.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:04:42 smithi047 bash[22744]: audit 2024-09-16T12:04:40.969465+0000 mgr.a (mgr.14373) 16757 : audit [DBG] from='client.360777 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:04:43.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:04:42 smithi157 bash[24585]: audit 2024-09-16T12:04:40.969465+0000 mgr.a (mgr.14373) 16757 : audit [DBG] from='client.360777 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:04:43.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:04:42 smithi086 bash[24289]: audit 2024-09-16T12:04:40.969465+0000 mgr.a (mgr.14373) 16757 : audit [DBG] from='client.360777 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:04:43.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:04:43 smithi047 bash[22744]: cluster 2024-09-16T12:04:42.418158+0000 mgr.a (mgr.14373) 16758 : cluster [DBG] pgmap v11623: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:04:44.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:04:43 smithi157 bash[24585]: cluster 2024-09-16T12:04:42.418158+0000 mgr.a (mgr.14373) 16758 : cluster [DBG] pgmap v11623: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:04:44.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:04:43 smithi086 bash[24289]: cluster 2024-09-16T12:04:42.418158+0000 mgr.a (mgr.14373) 16758 : cluster [DBG] pgmap v11623: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:04:45.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:04:45 smithi047 bash[22744]: cluster 2024-09-16T12:04:44.418895+0000 mgr.a (mgr.14373) 16759 : cluster [DBG] pgmap v11624: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:04:46.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:04:45 smithi157 bash[24585]: cluster 2024-09-16T12:04:44.418895+0000 mgr.a (mgr.14373) 16759 : cluster [DBG] pgmap v11624: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:04:46.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:04:45 smithi086 bash[24289]: cluster 2024-09-16T12:04:44.418895+0000 mgr.a (mgr.14373) 16759 : cluster [DBG] pgmap v11624: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:04:46.398 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:04:46.399 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:04:46.399 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:04:47.159 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:04:47.159 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:04:47.159 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:04:47.159 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:04:47.159 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:04:47.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:04:47 smithi047 bash[22744]: cluster 2024-09-16T12:04:46.419506+0000 mgr.a (mgr.14373) 16760 : cluster [DBG] pgmap v11625: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:04:47.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:04:47 smithi047 bash[22744]: audit 2024-09-16T12:04:46.730450+0000 mgr.a (mgr.14373) 16761 : audit [DBG] from='client.360855 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:04:48.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:04:47 smithi157 bash[24585]: cluster 2024-09-16T12:04:46.419506+0000 mgr.a (mgr.14373) 16760 : cluster [DBG] pgmap v11625: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:04:48.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:04:47 smithi157 bash[24585]: audit 2024-09-16T12:04:46.730450+0000 mgr.a (mgr.14373) 16761 : audit [DBG] from='client.360855 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:04:48.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:04:47 smithi086 bash[24289]: cluster 2024-09-16T12:04:46.419506+0000 mgr.a (mgr.14373) 16760 : cluster [DBG] pgmap v11625: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:04:48.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:04:47 smithi086 bash[24289]: audit 2024-09-16T12:04:46.730450+0000 mgr.a (mgr.14373) 16761 : audit [DBG] from='client.360855 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:04:50.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:04:49 smithi157 bash[24585]: cluster 2024-09-16T12:04:48.422280+0000 mgr.a (mgr.14373) 16762 : cluster [DBG] pgmap v11626: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:04:50.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:04:49 smithi086 bash[24289]: cluster 2024-09-16T12:04:48.422280+0000 mgr.a (mgr.14373) 16762 : cluster [DBG] pgmap v11626: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:04:50.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:04:49 smithi047 bash[22744]: cluster 2024-09-16T12:04:48.422280+0000 mgr.a (mgr.14373) 16762 : cluster [DBG] pgmap v11626: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:04:52.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:04:51 smithi157 bash[24585]: cluster 2024-09-16T12:04:50.423182+0000 mgr.a (mgr.14373) 16763 : cluster [DBG] pgmap v11627: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:04:52.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:04:51 smithi086 bash[24289]: cluster 2024-09-16T12:04:50.423182+0000 mgr.a (mgr.14373) 16763 : cluster [DBG] pgmap v11627: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:04:52.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:04:51 smithi047 bash[22744]: cluster 2024-09-16T12:04:50.423182+0000 mgr.a (mgr.14373) 16763 : cluster [DBG] pgmap v11627: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:04:52.160 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:04:52.161 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:04:52.161 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:04:52.925 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:04:52.925 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:04:52.925 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:04:52.925 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:04:52.928 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:04:54.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:04:53 smithi157 bash[24585]: cluster 2024-09-16T12:04:52.425111+0000 mgr.a (mgr.14373) 16764 : cluster [DBG] pgmap v11628: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:04:54.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:04:53 smithi157 bash[24585]: audit 2024-09-16T12:04:52.488942+0000 mgr.a (mgr.14373) 16765 : audit [DBG] from='client.360933 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:04:54.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:04:53 smithi086 bash[24289]: cluster 2024-09-16T12:04:52.425111+0000 mgr.a (mgr.14373) 16764 : cluster [DBG] pgmap v11628: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:04:54.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:04:53 smithi086 bash[24289]: audit 2024-09-16T12:04:52.488942+0000 mgr.a (mgr.14373) 16765 : audit [DBG] from='client.360933 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:04:54.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:04:53 smithi047 bash[22744]: cluster 2024-09-16T12:04:52.425111+0000 mgr.a (mgr.14373) 16764 : cluster [DBG] pgmap v11628: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:04:54.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:04:53 smithi047 bash[22744]: audit 2024-09-16T12:04:52.488942+0000 mgr.a (mgr.14373) 16765 : audit [DBG] from='client.360933 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:04:56.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:04:55 smithi157 bash[24585]: cluster 2024-09-16T12:04:54.426204+0000 mgr.a (mgr.14373) 16766 : cluster [DBG] pgmap v11629: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:04:56.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:04:55 smithi086 bash[24289]: cluster 2024-09-16T12:04:54.426204+0000 mgr.a (mgr.14373) 16766 : cluster [DBG] pgmap v11629: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:04:56.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:04:55 smithi047 bash[22744]: cluster 2024-09-16T12:04:54.426204+0000 mgr.a (mgr.14373) 16766 : cluster [DBG] pgmap v11629: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:04:57.926 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:04:57.927 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:04:57.927 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:04:58.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:04:57 smithi157 bash[24585]: cluster 2024-09-16T12:04:56.427117+0000 mgr.a (mgr.14373) 16767 : cluster [DBG] pgmap v11630: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T12:04:58.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:04:57 smithi086 bash[24289]: cluster 2024-09-16T12:04:56.427117+0000 mgr.a (mgr.14373) 16767 : cluster [DBG] pgmap v11630: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T12:04:58.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:04:57 smithi047 bash[22744]: cluster 2024-09-16T12:04:56.427117+0000 mgr.a (mgr.14373) 16767 : cluster [DBG] pgmap v11630: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T12:04:58.675 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:04:58.675 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:04:58.675 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:04:58.675 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:04:58.675 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:05:00.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:04:59 smithi157 bash[24585]: audit 2024-09-16T12:04:58.253277+0000 mgr.a (mgr.14373) 16768 : audit [DBG] from='client.361008 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:05:00.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:04:59 smithi157 bash[24585]: cluster 2024-09-16T12:04:58.428431+0000 mgr.a (mgr.14373) 16769 : cluster [DBG] pgmap v11631: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:05:00.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:04:59 smithi086 bash[24289]: audit 2024-09-16T12:04:58.253277+0000 mgr.a (mgr.14373) 16768 : audit [DBG] from='client.361008 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:05:00.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:04:59 smithi086 bash[24289]: cluster 2024-09-16T12:04:58.428431+0000 mgr.a (mgr.14373) 16769 : cluster [DBG] pgmap v11631: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:05:00.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:04:59 smithi047 bash[22744]: audit 2024-09-16T12:04:58.253277+0000 mgr.a (mgr.14373) 16768 : audit [DBG] from='client.361008 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:05:00.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:04:59 smithi047 bash[22744]: cluster 2024-09-16T12:04:58.428431+0000 mgr.a (mgr.14373) 16769 : cluster [DBG] pgmap v11631: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:05:01.042 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:05:00 smithi157 bash[24585]: audit 2024-09-16T12:04:59.877258+0000 mon.b (mon.2) 1522 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T12:05:01.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:05:00 smithi086 bash[24289]: audit 2024-09-16T12:04:59.877258+0000 mon.b (mon.2) 1522 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T12:05:01.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:05:00 smithi047 bash[22744]: audit 2024-09-16T12:04:59.877258+0000 mon.b (mon.2) 1522 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T12:05:01.843 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 12:05:01 smithi047 bash[22994]: debug 2024-09-16T12:05:01.463+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T12:05:01.843 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 12:05:01 smithi047 bash[22994]: debug 2024-09-16T12:05:01.467+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T12:05:01.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:05:01 smithi047 bash[22744]: cluster 2024-09-16T12:05:00.429313+0000 mgr.a (mgr.14373) 16770 : cluster [DBG] pgmap v11632: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:05:01.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:05:01 smithi047 bash[22744]: audit 2024-09-16T12:05:00.700262+0000 mon.b (mon.2) 1523 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T12:05:01.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:05:01 smithi047 bash[22744]: audit 2024-09-16T12:05:00.702197+0000 mon.b (mon.2) 1524 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T12:05:01.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:05:01 smithi047 bash[22744]: audit 2024-09-16T12:05:00.713289+0000 mon.a (mon.0) 1567 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:05:01.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:05:01 smithi047 bash[22744]: audit 2024-09-16T12:05:00.718341+0000 mon.b (mon.2) 1525 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:05:01.844 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:05:01 smithi047 bash[22744]: audit 2024-09-16T12:05:00.721028+0000 mgr.a (mgr.14373) 16771 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:05:02.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:05:01 smithi157 bash[24585]: cluster 2024-09-16T12:05:00.429313+0000 mgr.a (mgr.14373) 16770 : cluster [DBG] pgmap v11632: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:05:02.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:05:01 smithi157 bash[24585]: audit 2024-09-16T12:05:00.700262+0000 mon.b (mon.2) 1523 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T12:05:02.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:05:01 smithi157 bash[24585]: audit 2024-09-16T12:05:00.702197+0000 mon.b (mon.2) 1524 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T12:05:02.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:05:01 smithi157 bash[24585]: audit 2024-09-16T12:05:00.713289+0000 mon.a (mon.0) 1567 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:05:02.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:05:01 smithi157 bash[24585]: audit 2024-09-16T12:05:00.718341+0000 mon.b (mon.2) 1525 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:05:02.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:05:01 smithi157 bash[24585]: audit 2024-09-16T12:05:00.721028+0000 mgr.a (mgr.14373) 16771 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:05:02.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:05:01 smithi086 bash[24289]: cluster 2024-09-16T12:05:00.429313+0000 mgr.a (mgr.14373) 16770 : cluster [DBG] pgmap v11632: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:05:02.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:05:01 smithi086 bash[24289]: audit 2024-09-16T12:05:00.700262+0000 mon.b (mon.2) 1523 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T12:05:02.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:05:01 smithi086 bash[24289]: audit 2024-09-16T12:05:00.702197+0000 mon.b (mon.2) 1524 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T12:05:02.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:05:01 smithi086 bash[24289]: audit 2024-09-16T12:05:00.713289+0000 mon.a (mon.0) 1567 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:05:02.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:05:01 smithi086 bash[24289]: audit 2024-09-16T12:05:00.718341+0000 mon.b (mon.2) 1525 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:05:02.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:05:01 smithi086 bash[24289]: audit 2024-09-16T12:05:00.721028+0000 mgr.a (mgr.14373) 16771 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:05:03.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:05:02 smithi157 bash[24585]: audit 2024-09-16T12:05:01.470197+0000 mgr.a (mgr.14373) 16772 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T12:05:03.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:05:02 smithi157 bash[24585]: cephadm 2024-09-16T12:05:01.472416+0000 mgr.a (mgr.14373) 16773 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T12:05:03.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:05:02 smithi086 bash[24289]: audit 2024-09-16T12:05:01.470197+0000 mgr.a (mgr.14373) 16772 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T12:05:03.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:05:02 smithi086 bash[24289]: cephadm 2024-09-16T12:05:01.472416+0000 mgr.a (mgr.14373) 16773 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T12:05:03.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:05:02 smithi047 bash[22744]: audit 2024-09-16T12:05:01.470197+0000 mgr.a (mgr.14373) 16772 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T12:05:03.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:05:02 smithi047 bash[22744]: cephadm 2024-09-16T12:05:01.472416+0000 mgr.a (mgr.14373) 16773 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T12:05:03.676 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:05:03.677 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:05:03.677 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:05:04.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:05:03 smithi157 bash[24585]: cluster 2024-09-16T12:05:02.431789+0000 mgr.a (mgr.14373) 16774 : cluster [DBG] pgmap v11633: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:05:04.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:05:03 smithi086 bash[24289]: cluster 2024-09-16T12:05:02.431789+0000 mgr.a (mgr.14373) 16774 : cluster [DBG] pgmap v11633: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:05:04.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:05:03 smithi047 bash[22744]: cluster 2024-09-16T12:05:02.431789+0000 mgr.a (mgr.14373) 16774 : cluster [DBG] pgmap v11633: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:05:04.421 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:05:04.421 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:05:04.421 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:05:04.421 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:05:04.421 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:05:06.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:05:05 smithi157 bash[24585]: audit 2024-09-16T12:05:04.004398+0000 mgr.a (mgr.14373) 16775 : audit [DBG] from='client.361191 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:05:06.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:05:05 smithi157 bash[24585]: cluster 2024-09-16T12:05:04.432319+0000 mgr.a (mgr.14373) 16776 : cluster [DBG] pgmap v11634: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:05:06.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:05:05 smithi086 bash[24289]: audit 2024-09-16T12:05:04.004398+0000 mgr.a (mgr.14373) 16775 : audit [DBG] from='client.361191 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:05:06.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:05:05 smithi086 bash[24289]: cluster 2024-09-16T12:05:04.432319+0000 mgr.a (mgr.14373) 16776 : cluster [DBG] pgmap v11634: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:05:06.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:05:05 smithi047 bash[22744]: audit 2024-09-16T12:05:04.004398+0000 mgr.a (mgr.14373) 16775 : audit [DBG] from='client.361191 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:05:06.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:05:05 smithi047 bash[22744]: cluster 2024-09-16T12:05:04.432319+0000 mgr.a (mgr.14373) 16776 : cluster [DBG] pgmap v11634: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:05:08.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:05:07 smithi157 bash[24585]: cluster 2024-09-16T12:05:06.433074+0000 mgr.a (mgr.14373) 16777 : cluster [DBG] pgmap v11635: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:05:08.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:05:07 smithi086 bash[24289]: cluster 2024-09-16T12:05:06.433074+0000 mgr.a (mgr.14373) 16777 : cluster [DBG] pgmap v11635: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:05:08.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:05:07 smithi047 bash[22744]: cluster 2024-09-16T12:05:06.433074+0000 mgr.a (mgr.14373) 16777 : cluster [DBG] pgmap v11635: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:05:09.423 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:05:09.423 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:05:09.423 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:05:10.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:05:09 smithi157 bash[24585]: cluster 2024-09-16T12:05:08.435333+0000 mgr.a (mgr.14373) 16778 : cluster [DBG] pgmap v11636: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:05:10.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:05:09 smithi086 bash[24289]: cluster 2024-09-16T12:05:08.435333+0000 mgr.a (mgr.14373) 16778 : cluster [DBG] pgmap v11636: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:05:10.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:05:09 smithi047 bash[22744]: cluster 2024-09-16T12:05:08.435333+0000 mgr.a (mgr.14373) 16778 : cluster [DBG] pgmap v11636: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:05:10.206 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:05:10.207 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:05:10.207 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:05:10.207 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:05:10.207 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:05:11.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:05:10 smithi157 bash[24585]: audit 2024-09-16T12:05:09.757135+0000 mgr.a (mgr.14373) 16779 : audit [DBG] from='client.361269 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:05:11.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:05:10 smithi086 bash[24289]: audit 2024-09-16T12:05:09.757135+0000 mgr.a (mgr.14373) 16779 : audit [DBG] from='client.361269 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:05:11.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:05:10 smithi047 bash[22744]: audit 2024-09-16T12:05:09.757135+0000 mgr.a (mgr.14373) 16779 : audit [DBG] from='client.361269 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:05:12.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:05:11 smithi157 bash[24585]: cluster 2024-09-16T12:05:10.436263+0000 mgr.a (mgr.14373) 16780 : cluster [DBG] pgmap v11637: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:05:12.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:05:11 smithi086 bash[24289]: cluster 2024-09-16T12:05:10.436263+0000 mgr.a (mgr.14373) 16780 : cluster [DBG] pgmap v11637: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:05:12.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:05:11 smithi047 bash[22744]: cluster 2024-09-16T12:05:10.436263+0000 mgr.a (mgr.14373) 16780 : cluster [DBG] pgmap v11637: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:05:14.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:05:13 smithi157 bash[24585]: cluster 2024-09-16T12:05:12.438518+0000 mgr.a (mgr.14373) 16781 : cluster [DBG] pgmap v11638: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:05:14.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:05:13 smithi086 bash[24289]: cluster 2024-09-16T12:05:12.438518+0000 mgr.a (mgr.14373) 16781 : cluster [DBG] pgmap v11638: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:05:14.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:05:13 smithi047 bash[22744]: cluster 2024-09-16T12:05:12.438518+0000 mgr.a (mgr.14373) 16781 : cluster [DBG] pgmap v11638: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:05:15.208 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:05:15.209 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:05:15.209 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:05:15.992 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:05:15.993 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:05:15.993 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:05:15.993 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:05:15.993 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:05:16.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:05:15 smithi157 bash[24585]: cluster 2024-09-16T12:05:14.439286+0000 mgr.a (mgr.14373) 16782 : cluster [DBG] pgmap v11639: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:05:16.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:05:15 smithi086 bash[24289]: cluster 2024-09-16T12:05:14.439286+0000 mgr.a (mgr.14373) 16782 : cluster [DBG] pgmap v11639: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:05:16.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:05:15 smithi047 bash[22744]: cluster 2024-09-16T12:05:14.439286+0000 mgr.a (mgr.14373) 16782 : cluster [DBG] pgmap v11639: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:05:17.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:05:16 smithi157 bash[24585]: audit 2024-09-16T12:05:15.549598+0000 mgr.a (mgr.14373) 16783 : audit [DBG] from='client.361344 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:05:17.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:05:16 smithi086 bash[24289]: audit 2024-09-16T12:05:15.549598+0000 mgr.a (mgr.14373) 16783 : audit [DBG] from='client.361344 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:05:17.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:05:16 smithi047 bash[22744]: audit 2024-09-16T12:05:15.549598+0000 mgr.a (mgr.14373) 16783 : audit [DBG] from='client.361344 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:05:18.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:05:17 smithi157 bash[24585]: cluster 2024-09-16T12:05:16.440416+0000 mgr.a (mgr.14373) 16784 : cluster [DBG] pgmap v11640: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:05:18.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:05:17 smithi086 bash[24289]: cluster 2024-09-16T12:05:16.440416+0000 mgr.a (mgr.14373) 16784 : cluster [DBG] pgmap v11640: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:05:18.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:05:17 smithi047 bash[22744]: cluster 2024-09-16T12:05:16.440416+0000 mgr.a (mgr.14373) 16784 : cluster [DBG] pgmap v11640: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:05:20.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:05:19 smithi157 bash[24585]: cluster 2024-09-16T12:05:18.442737+0000 mgr.a (mgr.14373) 16785 : cluster [DBG] pgmap v11641: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 3.2 KiB/s rd, 2 op/s 2024-09-16T12:05:20.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:05:19 smithi086 bash[24289]: cluster 2024-09-16T12:05:18.442737+0000 mgr.a (mgr.14373) 16785 : cluster [DBG] pgmap v11641: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 3.2 KiB/s rd, 2 op/s 2024-09-16T12:05:20.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:05:19 smithi047 bash[22744]: cluster 2024-09-16T12:05:18.442737+0000 mgr.a (mgr.14373) 16785 : cluster [DBG] pgmap v11641: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 3.2 KiB/s rd, 2 op/s 2024-09-16T12:05:20.994 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:05:20.995 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:05:20.995 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:05:21.752 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:05:21.753 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:05:21.753 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:05:21.753 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:05:21.753 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:05:22.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:05:21 smithi157 bash[24585]: cluster 2024-09-16T12:05:20.443525+0000 mgr.a (mgr.14373) 16786 : cluster [DBG] pgmap v11642: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-16T12:05:22.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:05:21 smithi086 bash[24289]: cluster 2024-09-16T12:05:20.443525+0000 mgr.a (mgr.14373) 16786 : cluster [DBG] pgmap v11642: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-16T12:05:22.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:05:21 smithi047 bash[22744]: cluster 2024-09-16T12:05:20.443525+0000 mgr.a (mgr.14373) 16786 : cluster [DBG] pgmap v11642: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-16T12:05:23.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:05:22 smithi157 bash[24585]: audit 2024-09-16T12:05:21.323363+0000 mgr.a (mgr.14373) 16787 : audit [DBG] from='client.361419 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:05:23.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:05:22 smithi086 bash[24289]: audit 2024-09-16T12:05:21.323363+0000 mgr.a (mgr.14373) 16787 : audit [DBG] from='client.361419 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:05:23.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:05:22 smithi047 bash[22744]: audit 2024-09-16T12:05:21.323363+0000 mgr.a (mgr.14373) 16787 : audit [DBG] from='client.361419 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:05:24.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:05:23 smithi157 bash[24585]: cluster 2024-09-16T12:05:22.446012+0000 mgr.a (mgr.14373) 16788 : cluster [DBG] pgmap v11643: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-09-16T12:05:24.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:05:23 smithi086 bash[24289]: cluster 2024-09-16T12:05:22.446012+0000 mgr.a (mgr.14373) 16788 : cluster [DBG] pgmap v11643: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-09-16T12:05:24.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:05:23 smithi047 bash[22744]: cluster 2024-09-16T12:05:22.446012+0000 mgr.a (mgr.14373) 16788 : cluster [DBG] pgmap v11643: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-09-16T12:05:26.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:05:25 smithi157 bash[24585]: cluster 2024-09-16T12:05:24.446799+0000 mgr.a (mgr.14373) 16789 : cluster [DBG] pgmap v11644: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-16T12:05:26.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:05:25 smithi086 bash[24289]: cluster 2024-09-16T12:05:24.446799+0000 mgr.a (mgr.14373) 16789 : cluster [DBG] pgmap v11644: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-16T12:05:26.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:05:25 smithi047 bash[22744]: cluster 2024-09-16T12:05:24.446799+0000 mgr.a (mgr.14373) 16789 : cluster [DBG] pgmap v11644: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-16T12:05:26.754 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:05:26.755 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:05:26.755 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:05:27.538 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:05:27.538 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:05:27.538 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:05:27.538 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:05:27.538 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:05:28.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:05:27 smithi157 bash[24585]: cluster 2024-09-16T12:05:26.447560+0000 mgr.a (mgr.14373) 16790 : cluster [DBG] pgmap v11645: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-16T12:05:28.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:05:27 smithi086 bash[24289]: cluster 2024-09-16T12:05:26.447560+0000 mgr.a (mgr.14373) 16790 : cluster [DBG] pgmap v11645: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-16T12:05:28.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:05:27 smithi047 bash[22744]: cluster 2024-09-16T12:05:26.447560+0000 mgr.a (mgr.14373) 16790 : cluster [DBG] pgmap v11645: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-16T12:05:29.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:05:28 smithi157 bash[24585]: audit 2024-09-16T12:05:27.088662+0000 mgr.a (mgr.14373) 16791 : audit [DBG] from='client.361491 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:05:29.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:05:28 smithi086 bash[24289]: audit 2024-09-16T12:05:27.088662+0000 mgr.a (mgr.14373) 16791 : audit [DBG] from='client.361491 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:05:29.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:05:28 smithi047 bash[22744]: audit 2024-09-16T12:05:27.088662+0000 mgr.a (mgr.14373) 16791 : audit [DBG] from='client.361491 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:05:30.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:05:29 smithi157 bash[24585]: cluster 2024-09-16T12:05:28.450527+0000 mgr.a (mgr.14373) 16792 : cluster [DBG] pgmap v11646: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-16T12:05:30.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:05:29 smithi086 bash[24289]: cluster 2024-09-16T12:05:28.450527+0000 mgr.a (mgr.14373) 16792 : cluster [DBG] pgmap v11646: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-16T12:05:30.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:05:29 smithi047 bash[22744]: cluster 2024-09-16T12:05:28.450527+0000 mgr.a (mgr.14373) 16792 : cluster [DBG] pgmap v11646: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-16T12:05:32.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:05:31 smithi157 bash[24585]: cluster 2024-09-16T12:05:30.451492+0000 mgr.a (mgr.14373) 16793 : cluster [DBG] pgmap v11647: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:05:32.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:05:31 smithi086 bash[24289]: cluster 2024-09-16T12:05:30.451492+0000 mgr.a (mgr.14373) 16793 : cluster [DBG] pgmap v11647: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:05:32.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:05:31 smithi047 bash[22744]: cluster 2024-09-16T12:05:30.451492+0000 mgr.a (mgr.14373) 16793 : cluster [DBG] pgmap v11647: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:05:32.539 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:05:32.540 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:05:32.540 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:05:33.292 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:05:33.293 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:05:33.293 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:05:33.293 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:05:33.293 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:05:34.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:05:33 smithi157 bash[24585]: cluster 2024-09-16T12:05:32.453591+0000 mgr.a (mgr.14373) 16794 : cluster [DBG] pgmap v11648: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:05:34.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:05:33 smithi086 bash[24289]: cluster 2024-09-16T12:05:32.453591+0000 mgr.a (mgr.14373) 16794 : cluster [DBG] pgmap v11648: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:05:34.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:05:33 smithi047 bash[22744]: cluster 2024-09-16T12:05:32.453591+0000 mgr.a (mgr.14373) 16794 : cluster [DBG] pgmap v11648: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:05:35.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:05:34 smithi157 bash[24585]: audit 2024-09-16T12:05:32.867655+0000 mgr.a (mgr.14373) 16795 : audit [DBG] from='client.361569 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:05:35.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:05:34 smithi086 bash[24289]: audit 2024-09-16T12:05:32.867655+0000 mgr.a (mgr.14373) 16795 : audit [DBG] from='client.361569 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:05:35.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:05:34 smithi047 bash[22744]: audit 2024-09-16T12:05:32.867655+0000 mgr.a (mgr.14373) 16795 : audit [DBG] from='client.361569 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:05:36.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:05:35 smithi157 bash[24585]: cluster 2024-09-16T12:05:34.454558+0000 mgr.a (mgr.14373) 16796 : cluster [DBG] pgmap v11649: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-16T12:05:36.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:05:35 smithi086 bash[24289]: cluster 2024-09-16T12:05:34.454558+0000 mgr.a (mgr.14373) 16796 : cluster [DBG] pgmap v11649: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-16T12:05:36.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:05:35 smithi047 bash[22744]: cluster 2024-09-16T12:05:34.454558+0000 mgr.a (mgr.14373) 16796 : cluster [DBG] pgmap v11649: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-16T12:05:38.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:05:37 smithi157 bash[24585]: cluster 2024-09-16T12:05:36.455404+0000 mgr.a (mgr.14373) 16797 : cluster [DBG] pgmap v11650: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-16T12:05:38.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:05:37 smithi086 bash[24289]: cluster 2024-09-16T12:05:36.455404+0000 mgr.a (mgr.14373) 16797 : cluster [DBG] pgmap v11650: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-16T12:05:38.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:05:37 smithi047 bash[22744]: cluster 2024-09-16T12:05:36.455404+0000 mgr.a (mgr.14373) 16797 : cluster [DBG] pgmap v11650: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-16T12:05:38.294 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:05:38.295 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:05:38.295 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:05:39.067 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:05:39.067 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:05:39.067 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:05:39.067 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:05:39.067 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:05:40.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:05:39 smithi157 bash[24585]: cluster 2024-09-16T12:05:38.456783+0000 mgr.a (mgr.14373) 16798 : cluster [DBG] pgmap v11651: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-16T12:05:40.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:05:39 smithi157 bash[24585]: audit 2024-09-16T12:05:38.629060+0000 mgr.a (mgr.14373) 16799 : audit [DBG] from='client.361638 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:05:40.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:05:39 smithi086 bash[24289]: cluster 2024-09-16T12:05:38.456783+0000 mgr.a (mgr.14373) 16798 : cluster [DBG] pgmap v11651: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-16T12:05:40.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:05:39 smithi086 bash[24289]: audit 2024-09-16T12:05:38.629060+0000 mgr.a (mgr.14373) 16799 : audit [DBG] from='client.361638 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:05:40.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:05:39 smithi047 bash[22744]: cluster 2024-09-16T12:05:38.456783+0000 mgr.a (mgr.14373) 16798 : cluster [DBG] pgmap v11651: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-16T12:05:40.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:05:39 smithi047 bash[22744]: audit 2024-09-16T12:05:38.629060+0000 mgr.a (mgr.14373) 16799 : audit [DBG] from='client.361638 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:05:42.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:05:41 smithi157 bash[24585]: cluster 2024-09-16T12:05:40.457735+0000 mgr.a (mgr.14373) 16800 : cluster [DBG] pgmap v11652: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:05:42.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:05:41 smithi086 bash[24289]: cluster 2024-09-16T12:05:40.457735+0000 mgr.a (mgr.14373) 16800 : cluster [DBG] pgmap v11652: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:05:42.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:05:41 smithi047 bash[22744]: cluster 2024-09-16T12:05:40.457735+0000 mgr.a (mgr.14373) 16800 : cluster [DBG] pgmap v11652: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:05:44.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:05:43 smithi157 bash[24585]: cluster 2024-09-16T12:05:42.459963+0000 mgr.a (mgr.14373) 16801 : cluster [DBG] pgmap v11653: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:05:44.068 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:05:44.069 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:05:44.069 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:05:44.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:05:43 smithi086 bash[24289]: cluster 2024-09-16T12:05:42.459963+0000 mgr.a (mgr.14373) 16801 : cluster [DBG] pgmap v11653: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:05:44.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:05:43 smithi047 bash[22744]: cluster 2024-09-16T12:05:42.459963+0000 mgr.a (mgr.14373) 16801 : cluster [DBG] pgmap v11653: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:05:44.864 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:05:44.865 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:05:44.865 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:05:44.865 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:05:44.865 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:05:46.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:05:45 smithi157 bash[24585]: audit 2024-09-16T12:05:44.405054+0000 mgr.a (mgr.14373) 16802 : audit [DBG] from='client.361716 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:05:46.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:05:45 smithi157 bash[24585]: cluster 2024-09-16T12:05:44.460610+0000 mgr.a (mgr.14373) 16803 : cluster [DBG] pgmap v11654: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:05:46.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:05:45 smithi086 bash[24289]: audit 2024-09-16T12:05:44.405054+0000 mgr.a (mgr.14373) 16802 : audit [DBG] from='client.361716 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:05:46.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:05:45 smithi086 bash[24289]: cluster 2024-09-16T12:05:44.460610+0000 mgr.a (mgr.14373) 16803 : cluster [DBG] pgmap v11654: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:05:46.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:05:45 smithi047 bash[22744]: audit 2024-09-16T12:05:44.405054+0000 mgr.a (mgr.14373) 16802 : audit [DBG] from='client.361716 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:05:46.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:05:45 smithi047 bash[22744]: cluster 2024-09-16T12:05:44.460610+0000 mgr.a (mgr.14373) 16803 : cluster [DBG] pgmap v11654: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:05:48.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:05:47 smithi157 bash[24585]: cluster 2024-09-16T12:05:46.461704+0000 mgr.a (mgr.14373) 16804 : cluster [DBG] pgmap v11655: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:05:48.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:05:47 smithi086 bash[24289]: cluster 2024-09-16T12:05:46.461704+0000 mgr.a (mgr.14373) 16804 : cluster [DBG] pgmap v11655: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:05:48.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:05:47 smithi047 bash[22744]: cluster 2024-09-16T12:05:46.461704+0000 mgr.a (mgr.14373) 16804 : cluster [DBG] pgmap v11655: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:05:49.866 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:05:49.867 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:05:49.867 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:05:50.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:05:49 smithi157 bash[24585]: cluster 2024-09-16T12:05:48.464140+0000 mgr.a (mgr.14373) 16805 : cluster [DBG] pgmap v11656: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:05:50.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:05:49 smithi086 bash[24289]: cluster 2024-09-16T12:05:48.464140+0000 mgr.a (mgr.14373) 16805 : cluster [DBG] pgmap v11656: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:05:50.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:05:49 smithi047 bash[22744]: cluster 2024-09-16T12:05:48.464140+0000 mgr.a (mgr.14373) 16805 : cluster [DBG] pgmap v11656: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:05:50.633 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:05:50.634 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:05:50.634 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:05:50.634 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:05:50.634 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:05:52.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:05:51 smithi157 bash[24585]: audit 2024-09-16T12:05:50.199638+0000 mgr.a (mgr.14373) 16806 : audit [DBG] from='client.361794 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:05:52.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:05:51 smithi157 bash[24585]: cluster 2024-09-16T12:05:50.464950+0000 mgr.a (mgr.14373) 16807 : cluster [DBG] pgmap v11657: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:05:52.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:05:51 smithi086 bash[24289]: audit 2024-09-16T12:05:50.199638+0000 mgr.a (mgr.14373) 16806 : audit [DBG] from='client.361794 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:05:52.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:05:51 smithi086 bash[24289]: cluster 2024-09-16T12:05:50.464950+0000 mgr.a (mgr.14373) 16807 : cluster [DBG] pgmap v11657: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:05:52.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:05:51 smithi047 bash[22744]: audit 2024-09-16T12:05:50.199638+0000 mgr.a (mgr.14373) 16806 : audit [DBG] from='client.361794 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:05:52.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:05:51 smithi047 bash[22744]: cluster 2024-09-16T12:05:50.464950+0000 mgr.a (mgr.14373) 16807 : cluster [DBG] pgmap v11657: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:05:54.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:05:53 smithi157 bash[24585]: cluster 2024-09-16T12:05:52.467336+0000 mgr.a (mgr.14373) 16808 : cluster [DBG] pgmap v11658: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:05:54.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:05:53 smithi086 bash[24289]: cluster 2024-09-16T12:05:52.467336+0000 mgr.a (mgr.14373) 16808 : cluster [DBG] pgmap v11658: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:05:54.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:05:53 smithi047 bash[22744]: cluster 2024-09-16T12:05:52.467336+0000 mgr.a (mgr.14373) 16808 : cluster [DBG] pgmap v11658: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:05:55.635 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:05:55.636 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:05:55.636 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:05:56.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:05:55 smithi157 bash[24585]: cluster 2024-09-16T12:05:54.468120+0000 mgr.a (mgr.14373) 16809 : cluster [DBG] pgmap v11659: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:05:56.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:05:55 smithi086 bash[24289]: cluster 2024-09-16T12:05:54.468120+0000 mgr.a (mgr.14373) 16809 : cluster [DBG] pgmap v11659: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:05:56.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:05:55 smithi047 bash[22744]: cluster 2024-09-16T12:05:54.468120+0000 mgr.a (mgr.14373) 16809 : cluster [DBG] pgmap v11659: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:05:56.403 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:05:56.404 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:05:56.404 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:05:56.404 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:05:56.404 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:05:58.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:05:57 smithi157 bash[24585]: audit 2024-09-16T12:05:55.965832+0000 mgr.a (mgr.14373) 16810 : audit [DBG] from='client.361869 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:05:58.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:05:57 smithi157 bash[24585]: cluster 2024-09-16T12:05:56.469031+0000 mgr.a (mgr.14373) 16811 : cluster [DBG] pgmap v11660: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:05:58.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:05:57 smithi086 bash[24289]: audit 2024-09-16T12:05:55.965832+0000 mgr.a (mgr.14373) 16810 : audit [DBG] from='client.361869 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:05:58.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:05:57 smithi086 bash[24289]: cluster 2024-09-16T12:05:56.469031+0000 mgr.a (mgr.14373) 16811 : cluster [DBG] pgmap v11660: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:05:58.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:05:57 smithi047 bash[22744]: audit 2024-09-16T12:05:55.965832+0000 mgr.a (mgr.14373) 16810 : audit [DBG] from='client.361869 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:05:58.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:05:57 smithi047 bash[22744]: cluster 2024-09-16T12:05:56.469031+0000 mgr.a (mgr.14373) 16811 : cluster [DBG] pgmap v11660: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:06:00.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:05:59 smithi157 bash[24585]: cluster 2024-09-16T12:05:58.471322+0000 mgr.a (mgr.14373) 16812 : cluster [DBG] pgmap v11661: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:06:00.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:05:59 smithi086 bash[24289]: cluster 2024-09-16T12:05:58.471322+0000 mgr.a (mgr.14373) 16812 : cluster [DBG] pgmap v11661: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:06:00.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:05:59 smithi047 bash[22744]: cluster 2024-09-16T12:05:58.471322+0000 mgr.a (mgr.14373) 16812 : cluster [DBG] pgmap v11661: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:06:01.405 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:06:01.406 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:06:01.406 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:06:02.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:06:01 smithi157 bash[24585]: cluster 2024-09-16T12:06:00.472111+0000 mgr.a (mgr.14373) 16813 : cluster [DBG] pgmap v11662: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:06:02.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:06:01 smithi157 bash[24585]: audit 2024-09-16T12:06:01.526339+0000 mon.b (mon.2) 1526 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T12:06:02.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:06:01 smithi086 bash[24289]: cluster 2024-09-16T12:06:00.472111+0000 mgr.a (mgr.14373) 16813 : cluster [DBG] pgmap v11662: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:06:02.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:06:01 smithi086 bash[24289]: audit 2024-09-16T12:06:01.526339+0000 mon.b (mon.2) 1526 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T12:06:02.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:06:01 smithi047 bash[22744]: cluster 2024-09-16T12:06:00.472111+0000 mgr.a (mgr.14373) 16813 : cluster [DBG] pgmap v11662: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:06:02.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:06:01 smithi047 bash[22744]: audit 2024-09-16T12:06:01.526339+0000 mon.b (mon.2) 1526 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T12:06:02.175 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:06:02.176 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:06:02.176 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:06:02.176 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:06:02.176 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:06:03.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:06:02 smithi157 bash[24585]: audit 2024-09-16T12:06:01.740241+0000 mgr.a (mgr.14373) 16814 : audit [DBG] from='client.361941 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:06:03.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:06:02 smithi157 bash[24585]: audit 2024-09-16T12:06:02.328170+0000 mon.b (mon.2) 1527 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T12:06:03.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:06:02 smithi157 bash[24585]: audit 2024-09-16T12:06:02.330583+0000 mon.b (mon.2) 1528 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T12:06:03.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:06:02 smithi157 bash[24585]: audit 2024-09-16T12:06:02.342122+0000 mon.a (mon.0) 1568 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:06:03.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:06:02 smithi157 bash[24585]: audit 2024-09-16T12:06:02.347576+0000 mon.b (mon.2) 1529 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:06:03.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:06:02 smithi157 bash[24585]: audit 2024-09-16T12:06:02.350575+0000 mgr.a (mgr.14373) 16815 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:06:03.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:06:02 smithi157 bash[24585]: cluster 2024-09-16T12:06:02.474019+0000 mgr.a (mgr.14373) 16816 : cluster [DBG] pgmap v11663: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:06:03.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:06:02 smithi086 bash[24289]: audit 2024-09-16T12:06:01.740241+0000 mgr.a (mgr.14373) 16814 : audit [DBG] from='client.361941 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:06:03.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:06:02 smithi086 bash[24289]: audit 2024-09-16T12:06:02.328170+0000 mon.b (mon.2) 1527 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T12:06:03.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:06:02 smithi086 bash[24289]: audit 2024-09-16T12:06:02.330583+0000 mon.b (mon.2) 1528 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T12:06:03.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:06:02 smithi086 bash[24289]: audit 2024-09-16T12:06:02.342122+0000 mon.a (mon.0) 1568 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:06:03.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:06:02 smithi086 bash[24289]: audit 2024-09-16T12:06:02.347576+0000 mon.b (mon.2) 1529 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:06:03.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:06:02 smithi086 bash[24289]: audit 2024-09-16T12:06:02.350575+0000 mgr.a (mgr.14373) 16815 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:06:03.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:06:02 smithi086 bash[24289]: cluster 2024-09-16T12:06:02.474019+0000 mgr.a (mgr.14373) 16816 : cluster [DBG] pgmap v11663: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:06:03.078 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:06:02 smithi047 bash[22744]: audit 2024-09-16T12:06:01.740241+0000 mgr.a (mgr.14373) 16814 : audit [DBG] from='client.361941 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:06:03.078 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:06:02 smithi047 bash[22744]: audit 2024-09-16T12:06:02.328170+0000 mon.b (mon.2) 1527 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T12:06:03.078 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:06:02 smithi047 bash[22744]: audit 2024-09-16T12:06:02.330583+0000 mon.b (mon.2) 1528 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T12:06:03.078 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:06:02 smithi047 bash[22744]: audit 2024-09-16T12:06:02.342122+0000 mon.a (mon.0) 1568 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:06:03.078 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:06:02 smithi047 bash[22744]: audit 2024-09-16T12:06:02.347576+0000 mon.b (mon.2) 1529 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:06:03.078 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:06:02 smithi047 bash[22744]: audit 2024-09-16T12:06:02.350575+0000 mgr.a (mgr.14373) 16815 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:06:03.078 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:06:02 smithi047 bash[22744]: cluster 2024-09-16T12:06:02.474019+0000 mgr.a (mgr.14373) 16816 : cluster [DBG] pgmap v11663: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:06:03.342 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 12:06:03 smithi047 bash[22994]: debug 2024-09-16T12:06:03.073+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T12:06:03.343 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 12:06:03 smithi047 bash[22994]: debug 2024-09-16T12:06:03.073+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T12:06:04.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:06:04 smithi157 bash[24585]: audit 2024-09-16T12:06:03.076609+0000 mgr.a (mgr.14373) 16817 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T12:06:04.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:06:04 smithi157 bash[24585]: cephadm 2024-09-16T12:06:03.078326+0000 mgr.a (mgr.14373) 16818 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T12:06:04.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:06:04 smithi086 bash[24289]: audit 2024-09-16T12:06:03.076609+0000 mgr.a (mgr.14373) 16817 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T12:06:04.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:06:04 smithi086 bash[24289]: cephadm 2024-09-16T12:06:03.078326+0000 mgr.a (mgr.14373) 16818 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T12:06:04.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:06:04 smithi047 bash[22744]: audit 2024-09-16T12:06:03.076609+0000 mgr.a (mgr.14373) 16817 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T12:06:04.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:06:04 smithi047 bash[22744]: cephadm 2024-09-16T12:06:03.078326+0000 mgr.a (mgr.14373) 16818 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T12:06:05.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:06:05 smithi157 bash[24585]: cluster 2024-09-16T12:06:04.474921+0000 mgr.a (mgr.14373) 16819 : cluster [DBG] pgmap v11664: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:06:05.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:06:05 smithi086 bash[24289]: cluster 2024-09-16T12:06:04.474921+0000 mgr.a (mgr.14373) 16819 : cluster [DBG] pgmap v11664: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:06:05.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:06:05 smithi047 bash[22744]: cluster 2024-09-16T12:06:04.474921+0000 mgr.a (mgr.14373) 16819 : cluster [DBG] pgmap v11664: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:06:07.177 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:06:07.231 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:06:07.231 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:06:07.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:06:07 smithi157 bash[24585]: cluster 2024-09-16T12:06:06.475689+0000 mgr.a (mgr.14373) 16820 : cluster [DBG] pgmap v11665: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T12:06:07.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:06:07 smithi086 bash[24289]: cluster 2024-09-16T12:06:06.475689+0000 mgr.a (mgr.14373) 16820 : cluster [DBG] pgmap v11665: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T12:06:07.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:06:07 smithi047 bash[22744]: cluster 2024-09-16T12:06:06.475689+0000 mgr.a (mgr.14373) 16820 : cluster [DBG] pgmap v11665: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T12:06:07.953 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:06:07.953 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:06:07.953 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:06:07.953 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:06:07.953 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:06:08.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:06:08 smithi157 bash[24585]: audit 2024-09-16T12:06:07.513320+0000 mgr.a (mgr.14373) 16821 : audit [DBG] from='client.362127 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:06:08.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:06:08 smithi086 bash[24289]: audit 2024-09-16T12:06:07.513320+0000 mgr.a (mgr.14373) 16821 : audit [DBG] from='client.362127 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:06:08.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:06:08 smithi047 bash[22744]: audit 2024-09-16T12:06:07.513320+0000 mgr.a (mgr.14373) 16821 : audit [DBG] from='client.362127 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:06:09.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:06:09 smithi157 bash[24585]: cluster 2024-09-16T12:06:08.478540+0000 mgr.a (mgr.14373) 16822 : cluster [DBG] pgmap v11666: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:06:09.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:06:09 smithi086 bash[24289]: cluster 2024-09-16T12:06:08.478540+0000 mgr.a (mgr.14373) 16822 : cluster [DBG] pgmap v11666: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:06:09.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:06:09 smithi047 bash[22744]: cluster 2024-09-16T12:06:08.478540+0000 mgr.a (mgr.14373) 16822 : cluster [DBG] pgmap v11666: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:06:11.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:06:11 smithi157 bash[24585]: cluster 2024-09-16T12:06:10.479347+0000 mgr.a (mgr.14373) 16823 : cluster [DBG] pgmap v11667: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T12:06:11.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:06:11 smithi086 bash[24289]: cluster 2024-09-16T12:06:10.479347+0000 mgr.a (mgr.14373) 16823 : cluster [DBG] pgmap v11667: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T12:06:11.845 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:06:11 smithi047 bash[22744]: cluster 2024-09-16T12:06:10.479347+0000 mgr.a (mgr.14373) 16823 : cluster [DBG] pgmap v11667: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T12:06:12.954 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:06:12.955 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:06:12.955 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:06:13.745 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:06:13.746 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:06:13.746 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:06:13.746 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:06:13.746 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:06:13.806 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:06:13 smithi157 bash[24585]: cluster 2024-09-16T12:06:12.481371+0000 mgr.a (mgr.14373) 16824 : cluster [DBG] pgmap v11668: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:06:13.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:06:13 smithi086 bash[24289]: cluster 2024-09-16T12:06:12.481371+0000 mgr.a (mgr.14373) 16824 : cluster [DBG] pgmap v11668: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:06:13.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:06:13 smithi047 bash[22744]: cluster 2024-09-16T12:06:12.481371+0000 mgr.a (mgr.14373) 16824 : cluster [DBG] pgmap v11668: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:06:14.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:06:14 smithi086 bash[24289]: audit 2024-09-16T12:06:13.292047+0000 mgr.a (mgr.14373) 16825 : audit [DBG] from='client.362202 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:06:14.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:06:14 smithi047 bash[22744]: audit 2024-09-16T12:06:13.292047+0000 mgr.a (mgr.14373) 16825 : audit [DBG] from='client.362202 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:06:15.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:06:14 smithi157 bash[24585]: audit 2024-09-16T12:06:13.292047+0000 mgr.a (mgr.14373) 16825 : audit [DBG] from='client.362202 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:06:15.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:06:15 smithi086 bash[24289]: cluster 2024-09-16T12:06:14.482322+0000 mgr.a (mgr.14373) 16826 : cluster [DBG] pgmap v11669: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:06:15.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:06:15 smithi047 bash[22744]: cluster 2024-09-16T12:06:14.482322+0000 mgr.a (mgr.14373) 16826 : cluster [DBG] pgmap v11669: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:06:16.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:06:15 smithi157 bash[24585]: cluster 2024-09-16T12:06:14.482322+0000 mgr.a (mgr.14373) 16826 : cluster [DBG] pgmap v11669: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:06:17.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:06:17 smithi086 bash[24289]: cluster 2024-09-16T12:06:16.483149+0000 mgr.a (mgr.14373) 16827 : cluster [DBG] pgmap v11670: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:06:17.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:06:17 smithi047 bash[22744]: cluster 2024-09-16T12:06:16.483149+0000 mgr.a (mgr.14373) 16827 : cluster [DBG] pgmap v11670: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:06:18.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:06:17 smithi157 bash[24585]: cluster 2024-09-16T12:06:16.483149+0000 mgr.a (mgr.14373) 16827 : cluster [DBG] pgmap v11670: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:06:18.747 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:06:18.748 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:06:18.748 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:06:19.527 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:06:19.528 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:06:19.528 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:06:19.528 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:06:19.528 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:06:19.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:06:19 smithi047 bash[22744]: cluster 2024-09-16T12:06:18.485404+0000 mgr.a (mgr.14373) 16828 : cluster [DBG] pgmap v11671: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:06:20.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:06:19 smithi157 bash[24585]: cluster 2024-09-16T12:06:18.485404+0000 mgr.a (mgr.14373) 16828 : cluster [DBG] pgmap v11671: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:06:20.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:06:19 smithi086 bash[24289]: cluster 2024-09-16T12:06:18.485404+0000 mgr.a (mgr.14373) 16828 : cluster [DBG] pgmap v11671: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:06:20.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:06:20 smithi047 bash[22744]: audit 2024-09-16T12:06:19.086617+0000 mgr.a (mgr.14373) 16829 : audit [DBG] from='client.362274 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:06:21.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:06:20 smithi157 bash[24585]: audit 2024-09-16T12:06:19.086617+0000 mgr.a (mgr.14373) 16829 : audit [DBG] from='client.362274 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:06:21.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:06:20 smithi086 bash[24289]: audit 2024-09-16T12:06:19.086617+0000 mgr.a (mgr.14373) 16829 : audit [DBG] from='client.362274 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:06:21.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:06:21 smithi047 bash[22744]: cluster 2024-09-16T12:06:20.486421+0000 mgr.a (mgr.14373) 16830 : cluster [DBG] pgmap v11672: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:06:22.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:06:21 smithi157 bash[24585]: cluster 2024-09-16T12:06:20.486421+0000 mgr.a (mgr.14373) 16830 : cluster [DBG] pgmap v11672: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:06:22.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:06:21 smithi086 bash[24289]: cluster 2024-09-16T12:06:20.486421+0000 mgr.a (mgr.14373) 16830 : cluster [DBG] pgmap v11672: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:06:23.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:06:23 smithi047 bash[22744]: cluster 2024-09-16T12:06:22.488614+0000 mgr.a (mgr.14373) 16831 : cluster [DBG] pgmap v11673: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:06:24.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:06:23 smithi157 bash[24585]: cluster 2024-09-16T12:06:22.488614+0000 mgr.a (mgr.14373) 16831 : cluster [DBG] pgmap v11673: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:06:24.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:06:23 smithi086 bash[24289]: cluster 2024-09-16T12:06:22.488614+0000 mgr.a (mgr.14373) 16831 : cluster [DBG] pgmap v11673: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:06:24.529 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:06:24.530 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:06:24.530 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:06:25.308 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:06:25.308 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:06:25.308 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:06:25.308 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:06:25.308 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:06:25.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:06:25 smithi047 bash[22744]: cluster 2024-09-16T12:06:24.489368+0000 mgr.a (mgr.14373) 16832 : cluster [DBG] pgmap v11674: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:06:26.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:06:25 smithi157 bash[24585]: cluster 2024-09-16T12:06:24.489368+0000 mgr.a (mgr.14373) 16832 : cluster [DBG] pgmap v11674: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:06:26.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:06:25 smithi086 bash[24289]: cluster 2024-09-16T12:06:24.489368+0000 mgr.a (mgr.14373) 16832 : cluster [DBG] pgmap v11674: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:06:27.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:06:26 smithi157 bash[24585]: audit 2024-09-16T12:06:24.867402+0000 mgr.a (mgr.14373) 16833 : audit [DBG] from='client.362349 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:06:27.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:06:26 smithi086 bash[24289]: audit 2024-09-16T12:06:24.867402+0000 mgr.a (mgr.14373) 16833 : audit [DBG] from='client.362349 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:06:27.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:06:26 smithi047 bash[22744]: audit 2024-09-16T12:06:24.867402+0000 mgr.a (mgr.14373) 16833 : audit [DBG] from='client.362349 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:06:28.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:06:27 smithi157 bash[24585]: cluster 2024-09-16T12:06:26.490241+0000 mgr.a (mgr.14373) 16834 : cluster [DBG] pgmap v11675: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:06:28.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:06:27 smithi086 bash[24289]: cluster 2024-09-16T12:06:26.490241+0000 mgr.a (mgr.14373) 16834 : cluster [DBG] pgmap v11675: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:06:28.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:06:27 smithi047 bash[22744]: cluster 2024-09-16T12:06:26.490241+0000 mgr.a (mgr.14373) 16834 : cluster [DBG] pgmap v11675: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:06:30.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:06:29 smithi157 bash[24585]: cluster 2024-09-16T12:06:28.492452+0000 mgr.a (mgr.14373) 16835 : cluster [DBG] pgmap v11676: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:06:30.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:06:29 smithi086 bash[24289]: cluster 2024-09-16T12:06:28.492452+0000 mgr.a (mgr.14373) 16835 : cluster [DBG] pgmap v11676: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:06:30.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:06:29 smithi047 bash[22744]: cluster 2024-09-16T12:06:28.492452+0000 mgr.a (mgr.14373) 16835 : cluster [DBG] pgmap v11676: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:06:30.309 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:06:30.310 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:06:30.310 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:06:31.085 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:06:31.085 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:06:31.085 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:06:31.085 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:06:31.085 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:06:32.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:06:31 smithi157 bash[24585]: cluster 2024-09-16T12:06:30.492986+0000 mgr.a (mgr.14373) 16836 : cluster [DBG] pgmap v11677: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:06:32.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:06:31 smithi157 bash[24585]: audit 2024-09-16T12:06:30.643879+0000 mgr.a (mgr.14373) 16837 : audit [DBG] from='client.362427 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:06:32.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:06:31 smithi086 bash[24289]: cluster 2024-09-16T12:06:30.492986+0000 mgr.a (mgr.14373) 16836 : cluster [DBG] pgmap v11677: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:06:32.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:06:31 smithi086 bash[24289]: audit 2024-09-16T12:06:30.643879+0000 mgr.a (mgr.14373) 16837 : audit [DBG] from='client.362427 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:06:32.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:06:31 smithi047 bash[22744]: cluster 2024-09-16T12:06:30.492986+0000 mgr.a (mgr.14373) 16836 : cluster [DBG] pgmap v11677: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:06:32.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:06:31 smithi047 bash[22744]: audit 2024-09-16T12:06:30.643879+0000 mgr.a (mgr.14373) 16837 : audit [DBG] from='client.362427 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:06:34.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:06:33 smithi157 bash[24585]: cluster 2024-09-16T12:06:32.495274+0000 mgr.a (mgr.14373) 16838 : cluster [DBG] pgmap v11678: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:06:34.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:06:33 smithi086 bash[24289]: cluster 2024-09-16T12:06:32.495274+0000 mgr.a (mgr.14373) 16838 : cluster [DBG] pgmap v11678: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:06:34.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:06:33 smithi047 bash[22744]: cluster 2024-09-16T12:06:32.495274+0000 mgr.a (mgr.14373) 16838 : cluster [DBG] pgmap v11678: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:06:36.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:06:35 smithi157 bash[24585]: cluster 2024-09-16T12:06:34.496054+0000 mgr.a (mgr.14373) 16839 : cluster [DBG] pgmap v11679: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:06:36.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:06:35 smithi086 bash[24289]: cluster 2024-09-16T12:06:34.496054+0000 mgr.a (mgr.14373) 16839 : cluster [DBG] pgmap v11679: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:06:36.086 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:06:36.087 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:06:36.087 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:06:36.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:06:35 smithi047 bash[22744]: cluster 2024-09-16T12:06:34.496054+0000 mgr.a (mgr.14373) 16839 : cluster [DBG] pgmap v11679: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:06:36.854 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:06:36.854 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:06:36.854 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:06:36.855 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:06:36.855 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:06:38.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:06:37 smithi157 bash[24585]: audit 2024-09-16T12:06:36.416817+0000 mgr.a (mgr.14373) 16840 : audit [DBG] from='client.362502 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:06:38.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:06:37 smithi157 bash[24585]: cluster 2024-09-16T12:06:36.496660+0000 mgr.a (mgr.14373) 16841 : cluster [DBG] pgmap v11680: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:06:38.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:06:37 smithi086 bash[24289]: audit 2024-09-16T12:06:36.416817+0000 mgr.a (mgr.14373) 16840 : audit [DBG] from='client.362502 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:06:38.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:06:37 smithi086 bash[24289]: cluster 2024-09-16T12:06:36.496660+0000 mgr.a (mgr.14373) 16841 : cluster [DBG] pgmap v11680: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:06:38.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:06:37 smithi047 bash[22744]: audit 2024-09-16T12:06:36.416817+0000 mgr.a (mgr.14373) 16840 : audit [DBG] from='client.362502 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:06:38.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:06:37 smithi047 bash[22744]: cluster 2024-09-16T12:06:36.496660+0000 mgr.a (mgr.14373) 16841 : cluster [DBG] pgmap v11680: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:06:40.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:06:39 smithi157 bash[24585]: cluster 2024-09-16T12:06:38.499159+0000 mgr.a (mgr.14373) 16842 : cluster [DBG] pgmap v11681: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-16T12:06:40.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:06:39 smithi086 bash[24289]: cluster 2024-09-16T12:06:38.499159+0000 mgr.a (mgr.14373) 16842 : cluster [DBG] pgmap v11681: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-16T12:06:40.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:06:39 smithi047 bash[22744]: cluster 2024-09-16T12:06:38.499159+0000 mgr.a (mgr.14373) 16842 : cluster [DBG] pgmap v11681: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-16T12:06:41.856 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:06:41.857 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:06:41.857 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:06:42.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:06:41 smithi157 bash[24585]: cluster 2024-09-16T12:06:40.500137+0000 mgr.a (mgr.14373) 16843 : cluster [DBG] pgmap v11682: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-16T12:06:42.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:06:41 smithi086 bash[24289]: cluster 2024-09-16T12:06:40.500137+0000 mgr.a (mgr.14373) 16843 : cluster [DBG] pgmap v11682: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-16T12:06:42.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:06:41 smithi047 bash[22744]: cluster 2024-09-16T12:06:40.500137+0000 mgr.a (mgr.14373) 16843 : cluster [DBG] pgmap v11682: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-16T12:06:42.610 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:06:42.610 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:06:42.610 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:06:42.610 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:06:42.611 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:06:44.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:06:43 smithi157 bash[24585]: audit 2024-09-16T12:06:42.186004+0000 mgr.a (mgr.14373) 16844 : audit [DBG] from='client.362574 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:06:44.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:06:43 smithi157 bash[24585]: cluster 2024-09-16T12:06:42.501370+0000 mgr.a (mgr.14373) 16845 : cluster [DBG] pgmap v11683: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:06:44.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:06:43 smithi086 bash[24289]: audit 2024-09-16T12:06:42.186004+0000 mgr.a (mgr.14373) 16844 : audit [DBG] from='client.362574 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:06:44.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:06:43 smithi086 bash[24289]: cluster 2024-09-16T12:06:42.501370+0000 mgr.a (mgr.14373) 16845 : cluster [DBG] pgmap v11683: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:06:44.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:06:43 smithi047 bash[22744]: audit 2024-09-16T12:06:42.186004+0000 mgr.a (mgr.14373) 16844 : audit [DBG] from='client.362574 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:06:44.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:06:43 smithi047 bash[22744]: cluster 2024-09-16T12:06:42.501370+0000 mgr.a (mgr.14373) 16845 : cluster [DBG] pgmap v11683: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:06:46.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:06:45 smithi157 bash[24585]: cluster 2024-09-16T12:06:44.502215+0000 mgr.a (mgr.14373) 16846 : cluster [DBG] pgmap v11684: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T12:06:46.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:06:45 smithi086 bash[24289]: cluster 2024-09-16T12:06:44.502215+0000 mgr.a (mgr.14373) 16846 : cluster [DBG] pgmap v11684: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T12:06:46.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:06:45 smithi047 bash[22744]: cluster 2024-09-16T12:06:44.502215+0000 mgr.a (mgr.14373) 16846 : cluster [DBG] pgmap v11684: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T12:06:47.612 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:06:47.613 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:06:47.613 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:06:48.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:06:47 smithi157 bash[24585]: cluster 2024-09-16T12:06:46.502988+0000 mgr.a (mgr.14373) 16847 : cluster [DBG] pgmap v11685: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T12:06:48.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:06:47 smithi086 bash[24289]: cluster 2024-09-16T12:06:46.502988+0000 mgr.a (mgr.14373) 16847 : cluster [DBG] pgmap v11685: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T12:06:48.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:06:47 smithi047 bash[22744]: cluster 2024-09-16T12:06:46.502988+0000 mgr.a (mgr.14373) 16847 : cluster [DBG] pgmap v11685: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T12:06:48.365 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:06:48.365 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:06:48.366 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:06:48.366 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:06:48.366 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:06:50.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:06:49 smithi157 bash[24585]: audit 2024-09-16T12:06:47.948872+0000 mgr.a (mgr.14373) 16848 : audit [DBG] from='client.362652 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:06:50.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:06:49 smithi157 bash[24585]: cluster 2024-09-16T12:06:48.505740+0000 mgr.a (mgr.14373) 16849 : cluster [DBG] pgmap v11686: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:06:50.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:06:49 smithi086 bash[24289]: audit 2024-09-16T12:06:47.948872+0000 mgr.a (mgr.14373) 16848 : audit [DBG] from='client.362652 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:06:50.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:06:49 smithi086 bash[24289]: cluster 2024-09-16T12:06:48.505740+0000 mgr.a (mgr.14373) 16849 : cluster [DBG] pgmap v11686: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:06:50.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:06:49 smithi047 bash[22744]: audit 2024-09-16T12:06:47.948872+0000 mgr.a (mgr.14373) 16848 : audit [DBG] from='client.362652 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:06:50.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:06:49 smithi047 bash[22744]: cluster 2024-09-16T12:06:48.505740+0000 mgr.a (mgr.14373) 16849 : cluster [DBG] pgmap v11686: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:06:52.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:06:51 smithi157 bash[24585]: cluster 2024-09-16T12:06:50.506573+0000 mgr.a (mgr.14373) 16850 : cluster [DBG] pgmap v11687: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-16T12:06:52.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:06:51 smithi086 bash[24289]: cluster 2024-09-16T12:06:50.506573+0000 mgr.a (mgr.14373) 16850 : cluster [DBG] pgmap v11687: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-16T12:06:52.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:06:51 smithi047 bash[22744]: cluster 2024-09-16T12:06:50.506573+0000 mgr.a (mgr.14373) 16850 : cluster [DBG] pgmap v11687: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-16T12:06:53.367 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:06:53.367 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:06:53.368 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:06:54.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:06:53 smithi157 bash[24585]: cluster 2024-09-16T12:06:52.508568+0000 mgr.a (mgr.14373) 16851 : cluster [DBG] pgmap v11688: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:06:54.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:06:53 smithi086 bash[24289]: cluster 2024-09-16T12:06:52.508568+0000 mgr.a (mgr.14373) 16851 : cluster [DBG] pgmap v11688: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:06:54.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:06:53 smithi047 bash[22744]: cluster 2024-09-16T12:06:52.508568+0000 mgr.a (mgr.14373) 16851 : cluster [DBG] pgmap v11688: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:06:54.150 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:06:54.151 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:06:54.151 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:06:54.151 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:06:54.151 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:06:55.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:06:54 smithi157 bash[24585]: audit 2024-09-16T12:06:53.705603+0000 mgr.a (mgr.14373) 16852 : audit [DBG] from='client.362730 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:06:55.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:06:54 smithi086 bash[24289]: audit 2024-09-16T12:06:53.705603+0000 mgr.a (mgr.14373) 16852 : audit [DBG] from='client.362730 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:06:55.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:06:54 smithi047 bash[22744]: audit 2024-09-16T12:06:53.705603+0000 mgr.a (mgr.14373) 16852 : audit [DBG] from='client.362730 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:06:56.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:06:55 smithi157 bash[24585]: cluster 2024-09-16T12:06:54.509544+0000 mgr.a (mgr.14373) 16853 : cluster [DBG] pgmap v11689: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:06:56.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:06:55 smithi086 bash[24289]: cluster 2024-09-16T12:06:54.509544+0000 mgr.a (mgr.14373) 16853 : cluster [DBG] pgmap v11689: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:06:56.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:06:55 smithi047 bash[22744]: cluster 2024-09-16T12:06:54.509544+0000 mgr.a (mgr.14373) 16853 : cluster [DBG] pgmap v11689: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:06:58.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:06:57 smithi157 bash[24585]: cluster 2024-09-16T12:06:56.510508+0000 mgr.a (mgr.14373) 16854 : cluster [DBG] pgmap v11690: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:06:58.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:06:57 smithi086 bash[24289]: cluster 2024-09-16T12:06:56.510508+0000 mgr.a (mgr.14373) 16854 : cluster [DBG] pgmap v11690: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:06:58.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:06:57 smithi047 bash[22744]: cluster 2024-09-16T12:06:56.510508+0000 mgr.a (mgr.14373) 16854 : cluster [DBG] pgmap v11690: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:06:59.152 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:06:59.153 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:06:59.153 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:06:59.937 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:06:59.937 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:06:59.937 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:06:59.937 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:06:59.937 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:07:00.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:06:59 smithi157 bash[24585]: cluster 2024-09-16T12:06:58.512849+0000 mgr.a (mgr.14373) 16855 : cluster [DBG] pgmap v11691: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:07:00.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:06:59 smithi086 bash[24289]: cluster 2024-09-16T12:06:58.512849+0000 mgr.a (mgr.14373) 16855 : cluster [DBG] pgmap v11691: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:07:00.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:06:59 smithi047 bash[22744]: cluster 2024-09-16T12:06:58.512849+0000 mgr.a (mgr.14373) 16855 : cluster [DBG] pgmap v11691: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:07:01.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:07:00 smithi157 bash[24585]: audit 2024-09-16T12:06:59.486270+0000 mgr.a (mgr.14373) 16856 : audit [DBG] from='client.362805 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:07:01.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:07:00 smithi086 bash[24289]: audit 2024-09-16T12:06:59.486270+0000 mgr.a (mgr.14373) 16856 : audit [DBG] from='client.362805 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:07:01.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:07:00 smithi047 bash[22744]: audit 2024-09-16T12:06:59.486270+0000 mgr.a (mgr.14373) 16856 : audit [DBG] from='client.362805 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:07:02.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:07:01 smithi157 bash[24585]: cluster 2024-09-16T12:07:00.513861+0000 mgr.a (mgr.14373) 16857 : cluster [DBG] pgmap v11692: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:07:02.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:07:01 smithi086 bash[24289]: cluster 2024-09-16T12:07:00.513861+0000 mgr.a (mgr.14373) 16857 : cluster [DBG] pgmap v11692: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:07:02.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:07:01 smithi047 bash[22744]: cluster 2024-09-16T12:07:00.513861+0000 mgr.a (mgr.14373) 16857 : cluster [DBG] pgmap v11692: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:07:04.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:07:03 smithi157 bash[24585]: cluster 2024-09-16T12:07:02.516106+0000 mgr.a (mgr.14373) 16858 : cluster [DBG] pgmap v11693: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:07:04.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:07:03 smithi157 bash[24585]: audit 2024-09-16T12:07:03.132752+0000 mon.b (mon.2) 1530 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T12:07:04.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:07:03 smithi086 bash[24289]: cluster 2024-09-16T12:07:02.516106+0000 mgr.a (mgr.14373) 16858 : cluster [DBG] pgmap v11693: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:07:04.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:07:03 smithi086 bash[24289]: audit 2024-09-16T12:07:03.132752+0000 mon.b (mon.2) 1530 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T12:07:04.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:07:03 smithi047 bash[22744]: cluster 2024-09-16T12:07:02.516106+0000 mgr.a (mgr.14373) 16858 : cluster [DBG] pgmap v11693: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:07:04.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:07:03 smithi047 bash[22744]: audit 2024-09-16T12:07:03.132752+0000 mon.b (mon.2) 1530 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T12:07:04.938 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:07:04.939 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:07:04.939 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:07:05.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:07:04 smithi157 bash[24585]: audit 2024-09-16T12:07:03.950554+0000 mon.b (mon.2) 1531 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T12:07:05.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:07:04 smithi157 bash[24585]: audit 2024-09-16T12:07:03.952538+0000 mon.b (mon.2) 1532 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T12:07:05.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:07:04 smithi157 bash[24585]: audit 2024-09-16T12:07:03.963731+0000 mon.a (mon.0) 1569 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:07:05.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:07:04 smithi157 bash[24585]: audit 2024-09-16T12:07:03.969067+0000 mon.b (mon.2) 1533 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:07:05.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:07:04 smithi086 bash[24289]: audit 2024-09-16T12:07:03.950554+0000 mon.b (mon.2) 1531 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T12:07:05.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:07:04 smithi086 bash[24289]: audit 2024-09-16T12:07:03.952538+0000 mon.b (mon.2) 1532 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T12:07:05.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:07:04 smithi086 bash[24289]: audit 2024-09-16T12:07:03.963731+0000 mon.a (mon.0) 1569 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:07:05.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:07:04 smithi086 bash[24289]: audit 2024-09-16T12:07:03.969067+0000 mon.b (mon.2) 1533 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:07:05.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:07:04 smithi047 bash[22744]: audit 2024-09-16T12:07:03.950554+0000 mon.b (mon.2) 1531 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T12:07:05.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:07:04 smithi047 bash[22744]: audit 2024-09-16T12:07:03.952538+0000 mon.b (mon.2) 1532 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T12:07:05.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:07:04 smithi047 bash[22744]: audit 2024-09-16T12:07:03.963731+0000 mon.a (mon.0) 1569 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:07:05.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:07:04 smithi047 bash[22744]: audit 2024-09-16T12:07:03.969067+0000 mon.b (mon.2) 1533 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:07:05.093 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 12:07:04 smithi047 bash[22994]: debug 2024-09-16T12:07:04.720+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T12:07:05.093 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 12:07:04 smithi047 bash[22994]: debug 2024-09-16T12:07:04.720+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T12:07:05.720 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:07:05.720 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:07:05.720 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:07:05.720 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:07:05.720 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:07:06.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:07:05 smithi157 bash[24585]: audit 2024-09-16T12:07:03.971607+0000 mgr.a (mgr.14373) 16859 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:07:06.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:07:05 smithi157 bash[24585]: cluster 2024-09-16T12:07:04.516652+0000 mgr.a (mgr.14373) 16860 : cluster [DBG] pgmap v11694: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:07:06.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:07:05 smithi157 bash[24585]: audit 2024-09-16T12:07:04.722562+0000 mgr.a (mgr.14373) 16861 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T12:07:06.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:07:05 smithi157 bash[24585]: cephadm 2024-09-16T12:07:04.724689+0000 mgr.a (mgr.14373) 16862 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T12:07:06.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:07:05 smithi086 bash[24289]: audit 2024-09-16T12:07:03.971607+0000 mgr.a (mgr.14373) 16859 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:07:06.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:07:05 smithi086 bash[24289]: cluster 2024-09-16T12:07:04.516652+0000 mgr.a (mgr.14373) 16860 : cluster [DBG] pgmap v11694: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:07:06.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:07:05 smithi086 bash[24289]: audit 2024-09-16T12:07:04.722562+0000 mgr.a (mgr.14373) 16861 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T12:07:06.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:07:05 smithi086 bash[24289]: cephadm 2024-09-16T12:07:04.724689+0000 mgr.a (mgr.14373) 16862 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T12:07:06.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:07:05 smithi047 bash[22744]: audit 2024-09-16T12:07:03.971607+0000 mgr.a (mgr.14373) 16859 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:07:06.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:07:05 smithi047 bash[22744]: cluster 2024-09-16T12:07:04.516652+0000 mgr.a (mgr.14373) 16860 : cluster [DBG] pgmap v11694: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:07:06.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:07:05 smithi047 bash[22744]: audit 2024-09-16T12:07:04.722562+0000 mgr.a (mgr.14373) 16861 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T12:07:06.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:07:05 smithi047 bash[22744]: cephadm 2024-09-16T12:07:04.724689+0000 mgr.a (mgr.14373) 16862 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T12:07:07.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:07:06 smithi157 bash[24585]: audit 2024-09-16T12:07:05.272391+0000 mgr.a (mgr.14373) 16863 : audit [DBG] from='client.362988 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:07:07.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:07:06 smithi086 bash[24289]: audit 2024-09-16T12:07:05.272391+0000 mgr.a (mgr.14373) 16863 : audit [DBG] from='client.362988 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:07:07.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:07:06 smithi047 bash[22744]: audit 2024-09-16T12:07:05.272391+0000 mgr.a (mgr.14373) 16863 : audit [DBG] from='client.362988 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:07:08.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:07:07 smithi157 bash[24585]: cluster 2024-09-16T12:07:06.517508+0000 mgr.a (mgr.14373) 16864 : cluster [DBG] pgmap v11695: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:07:08.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:07:07 smithi086 bash[24289]: cluster 2024-09-16T12:07:06.517508+0000 mgr.a (mgr.14373) 16864 : cluster [DBG] pgmap v11695: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:07:08.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:07:07 smithi047 bash[22744]: cluster 2024-09-16T12:07:06.517508+0000 mgr.a (mgr.14373) 16864 : cluster [DBG] pgmap v11695: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:07:10.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:07:09 smithi157 bash[24585]: cluster 2024-09-16T12:07:08.519771+0000 mgr.a (mgr.14373) 16865 : cluster [DBG] pgmap v11696: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:07:10.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:07:09 smithi086 bash[24289]: cluster 2024-09-16T12:07:08.519771+0000 mgr.a (mgr.14373) 16865 : cluster [DBG] pgmap v11696: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:07:10.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:07:09 smithi047 bash[22744]: cluster 2024-09-16T12:07:08.519771+0000 mgr.a (mgr.14373) 16865 : cluster [DBG] pgmap v11696: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:07:10.722 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:07:10.722 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:07:10.722 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:07:11.482 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:07:11.482 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:07:11.483 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:07:11.483 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:07:11.483 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:07:12.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:07:11 smithi157 bash[24585]: cluster 2024-09-16T12:07:10.520526+0000 mgr.a (mgr.14373) 16866 : cluster [DBG] pgmap v11697: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:07:12.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:07:11 smithi086 bash[24289]: cluster 2024-09-16T12:07:10.520526+0000 mgr.a (mgr.14373) 16866 : cluster [DBG] pgmap v11697: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:07:12.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:07:11 smithi047 bash[22744]: cluster 2024-09-16T12:07:10.520526+0000 mgr.a (mgr.14373) 16866 : cluster [DBG] pgmap v11697: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:07:13.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:07:12 smithi157 bash[24585]: audit 2024-09-16T12:07:11.050616+0000 mgr.a (mgr.14373) 16867 : audit [DBG] from='client.363063 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:07:13.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:07:12 smithi086 bash[24289]: audit 2024-09-16T12:07:11.050616+0000 mgr.a (mgr.14373) 16867 : audit [DBG] from='client.363063 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:07:13.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:07:12 smithi047 bash[22744]: audit 2024-09-16T12:07:11.050616+0000 mgr.a (mgr.14373) 16867 : audit [DBG] from='client.363063 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:07:14.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:07:13 smithi157 bash[24585]: cluster 2024-09-16T12:07:12.522872+0000 mgr.a (mgr.14373) 16868 : cluster [DBG] pgmap v11698: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:07:14.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:07:13 smithi086 bash[24289]: cluster 2024-09-16T12:07:12.522872+0000 mgr.a (mgr.14373) 16868 : cluster [DBG] pgmap v11698: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:07:14.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:07:13 smithi047 bash[22744]: cluster 2024-09-16T12:07:12.522872+0000 mgr.a (mgr.14373) 16868 : cluster [DBG] pgmap v11698: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:07:16.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:07:15 smithi157 bash[24585]: cluster 2024-09-16T12:07:14.523674+0000 mgr.a (mgr.14373) 16869 : cluster [DBG] pgmap v11699: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:07:16.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:07:15 smithi086 bash[24289]: cluster 2024-09-16T12:07:14.523674+0000 mgr.a (mgr.14373) 16869 : cluster [DBG] pgmap v11699: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:07:16.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:07:15 smithi047 bash[22744]: cluster 2024-09-16T12:07:14.523674+0000 mgr.a (mgr.14373) 16869 : cluster [DBG] pgmap v11699: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:07:16.484 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:07:16.484 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:07:16.484 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:07:17.227 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:07:17.227 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:07:17.227 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:07:17.228 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:07:17.228 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:07:18.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:07:17 smithi157 bash[24585]: cluster 2024-09-16T12:07:16.524423+0000 mgr.a (mgr.14373) 16870 : cluster [DBG] pgmap v11700: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:07:18.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:07:17 smithi086 bash[24289]: cluster 2024-09-16T12:07:16.524423+0000 mgr.a (mgr.14373) 16870 : cluster [DBG] pgmap v11700: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:07:18.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:07:17 smithi047 bash[22744]: cluster 2024-09-16T12:07:16.524423+0000 mgr.a (mgr.14373) 16870 : cluster [DBG] pgmap v11700: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:07:19.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:07:18 smithi157 bash[24585]: audit 2024-09-16T12:07:16.813484+0000 mgr.a (mgr.14373) 16871 : audit [DBG] from='client.363141 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:07:19.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:07:18 smithi086 bash[24289]: audit 2024-09-16T12:07:16.813484+0000 mgr.a (mgr.14373) 16871 : audit [DBG] from='client.363141 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:07:19.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:07:18 smithi047 bash[22744]: audit 2024-09-16T12:07:16.813484+0000 mgr.a (mgr.14373) 16871 : audit [DBG] from='client.363141 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:07:20.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:07:19 smithi157 bash[24585]: cluster 2024-09-16T12:07:18.527123+0000 mgr.a (mgr.14373) 16872 : cluster [DBG] pgmap v11701: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:07:20.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:07:19 smithi086 bash[24289]: cluster 2024-09-16T12:07:18.527123+0000 mgr.a (mgr.14373) 16872 : cluster [DBG] pgmap v11701: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:07:20.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:07:19 smithi047 bash[22744]: cluster 2024-09-16T12:07:18.527123+0000 mgr.a (mgr.14373) 16872 : cluster [DBG] pgmap v11701: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:07:22.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:07:21 smithi157 bash[24585]: cluster 2024-09-16T12:07:20.527888+0000 mgr.a (mgr.14373) 16873 : cluster [DBG] pgmap v11702: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:07:22.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:07:21 smithi086 bash[24289]: cluster 2024-09-16T12:07:20.527888+0000 mgr.a (mgr.14373) 16873 : cluster [DBG] pgmap v11702: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:07:22.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:07:21 smithi047 bash[22744]: cluster 2024-09-16T12:07:20.527888+0000 mgr.a (mgr.14373) 16873 : cluster [DBG] pgmap v11702: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:07:22.229 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:07:22.229 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:07:22.230 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:07:23.015 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:07:23.015 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:07:23.015 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:07:23.016 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:07:23.016 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:07:24.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:07:23 smithi157 bash[24585]: cluster 2024-09-16T12:07:22.529856+0000 mgr.a (mgr.14373) 16874 : cluster [DBG] pgmap v11703: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:07:24.069 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:07:23 smithi157 bash[24585]: audit 2024-09-16T12:07:22.564035+0000 mgr.a (mgr.14373) 16875 : audit [DBG] from='client.363216 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:07:24.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:07:23 smithi086 bash[24289]: cluster 2024-09-16T12:07:22.529856+0000 mgr.a (mgr.14373) 16874 : cluster [DBG] pgmap v11703: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:07:24.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:07:23 smithi086 bash[24289]: audit 2024-09-16T12:07:22.564035+0000 mgr.a (mgr.14373) 16875 : audit [DBG] from='client.363216 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:07:24.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:07:23 smithi047 bash[22744]: cluster 2024-09-16T12:07:22.529856+0000 mgr.a (mgr.14373) 16874 : cluster [DBG] pgmap v11703: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:07:24.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:07:23 smithi047 bash[22744]: audit 2024-09-16T12:07:22.564035+0000 mgr.a (mgr.14373) 16875 : audit [DBG] from='client.363216 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:07:26.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:07:25 smithi157 bash[24585]: cluster 2024-09-16T12:07:24.530744+0000 mgr.a (mgr.14373) 16876 : cluster [DBG] pgmap v11704: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:07:26.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:07:25 smithi086 bash[24289]: cluster 2024-09-16T12:07:24.530744+0000 mgr.a (mgr.14373) 16876 : cluster [DBG] pgmap v11704: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:07:26.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:07:25 smithi047 bash[22744]: cluster 2024-09-16T12:07:24.530744+0000 mgr.a (mgr.14373) 16876 : cluster [DBG] pgmap v11704: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:07:28.017 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:07:28.017 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:07:28.018 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:07:28.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:07:27 smithi157 bash[24585]: cluster 2024-09-16T12:07:26.531520+0000 mgr.a (mgr.14373) 16877 : cluster [DBG] pgmap v11705: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T12:07:28.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:07:27 smithi086 bash[24289]: cluster 2024-09-16T12:07:26.531520+0000 mgr.a (mgr.14373) 16877 : cluster [DBG] pgmap v11705: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T12:07:28.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:07:27 smithi047 bash[22744]: cluster 2024-09-16T12:07:26.531520+0000 mgr.a (mgr.14373) 16877 : cluster [DBG] pgmap v11705: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T12:07:28.777 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:07:28.777 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:07:28.777 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:07:28.777 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:07:28.778 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:07:30.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:07:29 smithi157 bash[24585]: audit 2024-09-16T12:07:28.348187+0000 mgr.a (mgr.14373) 16878 : audit [DBG] from='client.363294 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:07:30.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:07:29 smithi157 bash[24585]: cluster 2024-09-16T12:07:28.533332+0000 mgr.a (mgr.14373) 16879 : cluster [DBG] pgmap v11706: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:07:30.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:07:29 smithi086 bash[24289]: audit 2024-09-16T12:07:28.348187+0000 mgr.a (mgr.14373) 16878 : audit [DBG] from='client.363294 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:07:30.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:07:29 smithi086 bash[24289]: cluster 2024-09-16T12:07:28.533332+0000 mgr.a (mgr.14373) 16879 : cluster [DBG] pgmap v11706: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:07:30.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:07:29 smithi047 bash[22744]: audit 2024-09-16T12:07:28.348187+0000 mgr.a (mgr.14373) 16878 : audit [DBG] from='client.363294 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:07:30.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:07:29 smithi047 bash[22744]: cluster 2024-09-16T12:07:28.533332+0000 mgr.a (mgr.14373) 16879 : cluster [DBG] pgmap v11706: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:07:32.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:07:31 smithi157 bash[24585]: cluster 2024-09-16T12:07:30.534196+0000 mgr.a (mgr.14373) 16880 : cluster [DBG] pgmap v11707: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:07:32.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:07:31 smithi086 bash[24289]: cluster 2024-09-16T12:07:30.534196+0000 mgr.a (mgr.14373) 16880 : cluster [DBG] pgmap v11707: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:07:32.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:07:31 smithi047 bash[22744]: cluster 2024-09-16T12:07:30.534196+0000 mgr.a (mgr.14373) 16880 : cluster [DBG] pgmap v11707: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:07:33.779 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:07:33.779 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:07:33.779 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:07:34.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:07:33 smithi157 bash[24585]: cluster 2024-09-16T12:07:32.536399+0000 mgr.a (mgr.14373) 16881 : cluster [DBG] pgmap v11708: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:07:34.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:07:33 smithi086 bash[24289]: cluster 2024-09-16T12:07:32.536399+0000 mgr.a (mgr.14373) 16881 : cluster [DBG] pgmap v11708: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:07:34.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:07:33 smithi047 bash[22744]: cluster 2024-09-16T12:07:32.536399+0000 mgr.a (mgr.14373) 16881 : cluster [DBG] pgmap v11708: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:07:34.521 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:07:34.522 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:07:34.522 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:07:34.522 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:07:34.522 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:07:36.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:07:35 smithi157 bash[24585]: audit 2024-09-16T12:07:34.108652+0000 mgr.a (mgr.14373) 16882 : audit [DBG] from='client.363372 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:07:36.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:07:35 smithi157 bash[24585]: cluster 2024-09-16T12:07:34.537063+0000 mgr.a (mgr.14373) 16883 : cluster [DBG] pgmap v11709: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:07:36.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:07:35 smithi086 bash[24289]: audit 2024-09-16T12:07:34.108652+0000 mgr.a (mgr.14373) 16882 : audit [DBG] from='client.363372 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:07:36.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:07:35 smithi086 bash[24289]: cluster 2024-09-16T12:07:34.537063+0000 mgr.a (mgr.14373) 16883 : cluster [DBG] pgmap v11709: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:07:36.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:07:35 smithi047 bash[22744]: audit 2024-09-16T12:07:34.108652+0000 mgr.a (mgr.14373) 16882 : audit [DBG] from='client.363372 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:07:36.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:07:35 smithi047 bash[22744]: cluster 2024-09-16T12:07:34.537063+0000 mgr.a (mgr.14373) 16883 : cluster [DBG] pgmap v11709: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:07:38.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:07:37 smithi157 bash[24585]: cluster 2024-09-16T12:07:36.537773+0000 mgr.a (mgr.14373) 16884 : cluster [DBG] pgmap v11710: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:07:38.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:07:37 smithi086 bash[24289]: cluster 2024-09-16T12:07:36.537773+0000 mgr.a (mgr.14373) 16884 : cluster [DBG] pgmap v11710: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:07:38.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:07:37 smithi047 bash[22744]: cluster 2024-09-16T12:07:36.537773+0000 mgr.a (mgr.14373) 16884 : cluster [DBG] pgmap v11710: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:07:39.523 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:07:39.524 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:07:39.524 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:07:40.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:07:39 smithi157 bash[24585]: cluster 2024-09-16T12:07:38.540010+0000 mgr.a (mgr.14373) 16885 : cluster [DBG] pgmap v11711: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:07:40.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:07:39 smithi086 bash[24289]: cluster 2024-09-16T12:07:38.540010+0000 mgr.a (mgr.14373) 16885 : cluster [DBG] pgmap v11711: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:07:40.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:07:39 smithi047 bash[22744]: cluster 2024-09-16T12:07:38.540010+0000 mgr.a (mgr.14373) 16885 : cluster [DBG] pgmap v11711: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:07:40.316 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:07:40.316 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:07:40.316 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:07:40.316 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:07:40.316 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:07:42.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:07:41 smithi157 bash[24585]: audit 2024-09-16T12:07:39.855142+0000 mgr.a (mgr.14373) 16886 : audit [DBG] from='client.363450 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:07:42.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:07:41 smithi157 bash[24585]: cluster 2024-09-16T12:07:40.541105+0000 mgr.a (mgr.14373) 16887 : cluster [DBG] pgmap v11712: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:07:42.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:07:41 smithi086 bash[24289]: audit 2024-09-16T12:07:39.855142+0000 mgr.a (mgr.14373) 16886 : audit [DBG] from='client.363450 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:07:42.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:07:41 smithi086 bash[24289]: cluster 2024-09-16T12:07:40.541105+0000 mgr.a (mgr.14373) 16887 : cluster [DBG] pgmap v11712: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:07:42.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:07:41 smithi047 bash[22744]: audit 2024-09-16T12:07:39.855142+0000 mgr.a (mgr.14373) 16886 : audit [DBG] from='client.363450 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:07:42.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:07:41 smithi047 bash[22744]: cluster 2024-09-16T12:07:40.541105+0000 mgr.a (mgr.14373) 16887 : cluster [DBG] pgmap v11712: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:07:44.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:07:43 smithi157 bash[24585]: cluster 2024-09-16T12:07:42.543389+0000 mgr.a (mgr.14373) 16888 : cluster [DBG] pgmap v11713: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:07:44.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:07:43 smithi086 bash[24289]: cluster 2024-09-16T12:07:42.543389+0000 mgr.a (mgr.14373) 16888 : cluster [DBG] pgmap v11713: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:07:44.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:07:43 smithi047 bash[22744]: cluster 2024-09-16T12:07:42.543389+0000 mgr.a (mgr.14373) 16888 : cluster [DBG] pgmap v11713: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:07:45.317 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:07:45.318 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:07:45.318 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:07:46.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:07:45 smithi086 bash[24289]: cluster 2024-09-16T12:07:44.544126+0000 mgr.a (mgr.14373) 16889 : cluster [DBG] pgmap v11714: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:07:46.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:07:45 smithi047 bash[22744]: cluster 2024-09-16T12:07:44.544126+0000 mgr.a (mgr.14373) 16889 : cluster [DBG] pgmap v11714: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:07:46.104 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:07:46.104 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:07:46.104 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:07:46.104 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:07:46.104 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:07:46.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:07:45 smithi157 bash[24585]: cluster 2024-09-16T12:07:44.544126+0000 mgr.a (mgr.14373) 16889 : cluster [DBG] pgmap v11714: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:07:47.073 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:07:46 smithi086 bash[24289]: audit 2024-09-16T12:07:45.649446+0000 mgr.a (mgr.14373) 16890 : audit [DBG] from='client.363525 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:07:47.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:07:46 smithi047 bash[22744]: audit 2024-09-16T12:07:45.649446+0000 mgr.a (mgr.14373) 16890 : audit [DBG] from='client.363525 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:07:47.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:07:46 smithi157 bash[24585]: audit 2024-09-16T12:07:45.649446+0000 mgr.a (mgr.14373) 16890 : audit [DBG] from='client.363525 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:07:48.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:07:47 smithi086 bash[24289]: cluster 2024-09-16T12:07:46.546420+0000 mgr.a (mgr.14373) 16891 : cluster [DBG] pgmap v11715: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:07:48.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:07:47 smithi047 bash[22744]: cluster 2024-09-16T12:07:46.546420+0000 mgr.a (mgr.14373) 16891 : cluster [DBG] pgmap v11715: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:07:48.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:07:47 smithi157 bash[24585]: cluster 2024-09-16T12:07:46.546420+0000 mgr.a (mgr.14373) 16891 : cluster [DBG] pgmap v11715: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:07:49.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:07:48 smithi047 bash[22744]: cluster 2024-09-16T12:07:48.547167+0000 mgr.a (mgr.14373) 16892 : cluster [DBG] pgmap v11716: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:07:49.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:07:48 smithi157 bash[24585]: cluster 2024-09-16T12:07:48.547167+0000 mgr.a (mgr.14373) 16892 : cluster [DBG] pgmap v11716: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:07:49.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:07:48 smithi086 bash[24289]: cluster 2024-09-16T12:07:48.547167+0000 mgr.a (mgr.14373) 16892 : cluster [DBG] pgmap v11716: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:07:51.105 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:07:51.106 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:07:51.106 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:07:51.869 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:07:51.869 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:07:51.869 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:07:51.869 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:07:51.869 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:07:52.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:07:51 smithi157 bash[24585]: cluster 2024-09-16T12:07:50.547920+0000 mgr.a (mgr.14373) 16893 : cluster [DBG] pgmap v11717: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:07:52.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:07:51 smithi086 bash[24289]: cluster 2024-09-16T12:07:50.547920+0000 mgr.a (mgr.14373) 16893 : cluster [DBG] pgmap v11717: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:07:52.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:07:51 smithi047 bash[22744]: cluster 2024-09-16T12:07:50.547920+0000 mgr.a (mgr.14373) 16893 : cluster [DBG] pgmap v11717: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:07:53.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:07:52 smithi157 bash[24585]: audit 2024-09-16T12:07:51.438317+0000 mgr.a (mgr.14373) 16894 : audit [DBG] from='client.363603 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:07:53.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:07:52 smithi086 bash[24289]: audit 2024-09-16T12:07:51.438317+0000 mgr.a (mgr.14373) 16894 : audit [DBG] from='client.363603 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:07:53.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:07:52 smithi047 bash[22744]: audit 2024-09-16T12:07:51.438317+0000 mgr.a (mgr.14373) 16894 : audit [DBG] from='client.363603 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:07:54.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:07:53 smithi157 bash[24585]: cluster 2024-09-16T12:07:52.550641+0000 mgr.a (mgr.14373) 16895 : cluster [DBG] pgmap v11718: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:07:54.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:07:53 smithi086 bash[24289]: cluster 2024-09-16T12:07:52.550641+0000 mgr.a (mgr.14373) 16895 : cluster [DBG] pgmap v11718: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:07:54.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:07:53 smithi047 bash[22744]: cluster 2024-09-16T12:07:52.550641+0000 mgr.a (mgr.14373) 16895 : cluster [DBG] pgmap v11718: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:07:56.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:07:55 smithi157 bash[24585]: cluster 2024-09-16T12:07:54.551417+0000 mgr.a (mgr.14373) 16896 : cluster [DBG] pgmap v11719: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:07:56.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:07:55 smithi086 bash[24289]: cluster 2024-09-16T12:07:54.551417+0000 mgr.a (mgr.14373) 16896 : cluster [DBG] pgmap v11719: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:07:56.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:07:55 smithi047 bash[22744]: cluster 2024-09-16T12:07:54.551417+0000 mgr.a (mgr.14373) 16896 : cluster [DBG] pgmap v11719: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:07:56.870 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:07:56.871 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:07:56.871 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:07:57.657 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:07:57.657 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:07:57.658 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:07:57.658 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:07:57.658 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:07:58.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:07:57 smithi157 bash[24585]: cluster 2024-09-16T12:07:56.553359+0000 mgr.a (mgr.14373) 16897 : cluster [DBG] pgmap v11720: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:07:58.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:07:57 smithi086 bash[24289]: cluster 2024-09-16T12:07:56.553359+0000 mgr.a (mgr.14373) 16897 : cluster [DBG] pgmap v11720: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:07:58.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:07:57 smithi047 bash[22744]: cluster 2024-09-16T12:07:56.553359+0000 mgr.a (mgr.14373) 16897 : cluster [DBG] pgmap v11720: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:07:59.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:07:58 smithi157 bash[24585]: audit 2024-09-16T12:07:57.204864+0000 mgr.a (mgr.14373) 16898 : audit [DBG] from='client.363675 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:07:59.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:07:58 smithi086 bash[24289]: audit 2024-09-16T12:07:57.204864+0000 mgr.a (mgr.14373) 16898 : audit [DBG] from='client.363675 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:07:59.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:07:58 smithi047 bash[22744]: audit 2024-09-16T12:07:57.204864+0000 mgr.a (mgr.14373) 16898 : audit [DBG] from='client.363675 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:08:00.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:07:59 smithi157 bash[24585]: cluster 2024-09-16T12:07:58.554423+0000 mgr.a (mgr.14373) 16899 : cluster [DBG] pgmap v11721: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:08:00.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:07:59 smithi086 bash[24289]: cluster 2024-09-16T12:07:58.554423+0000 mgr.a (mgr.14373) 16899 : cluster [DBG] pgmap v11721: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:08:00.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:07:59 smithi047 bash[22744]: cluster 2024-09-16T12:07:58.554423+0000 mgr.a (mgr.14373) 16899 : cluster [DBG] pgmap v11721: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:08:02.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:08:01 smithi157 bash[24585]: cluster 2024-09-16T12:08:00.555238+0000 mgr.a (mgr.14373) 16900 : cluster [DBG] pgmap v11722: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T12:08:02.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:08:01 smithi086 bash[24289]: cluster 2024-09-16T12:08:00.555238+0000 mgr.a (mgr.14373) 16900 : cluster [DBG] pgmap v11722: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T12:08:02.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:08:01 smithi047 bash[22744]: cluster 2024-09-16T12:08:00.555238+0000 mgr.a (mgr.14373) 16900 : cluster [DBG] pgmap v11722: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T12:08:02.659 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:08:02.659 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:08:02.659 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:08:03.413 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:08:03.413 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:08:03.413 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:08:03.413 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:08:03.413 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:08:04.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:08:03 smithi157 bash[24585]: cluster 2024-09-16T12:08:02.557481+0000 mgr.a (mgr.14373) 16901 : cluster [DBG] pgmap v11723: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:08:04.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:08:03 smithi086 bash[24289]: cluster 2024-09-16T12:08:02.557481+0000 mgr.a (mgr.14373) 16901 : cluster [DBG] pgmap v11723: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:08:04.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:08:03 smithi047 bash[22744]: cluster 2024-09-16T12:08:02.557481+0000 mgr.a (mgr.14373) 16901 : cluster [DBG] pgmap v11723: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:08:05.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:08:04 smithi157 bash[24585]: audit 2024-09-16T12:08:02.986894+0000 mgr.a (mgr.14373) 16902 : audit [DBG] from='client.363747 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:08:05.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:08:04 smithi086 bash[24289]: audit 2024-09-16T12:08:02.986894+0000 mgr.a (mgr.14373) 16902 : audit [DBG] from='client.363747 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:08:05.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:08:04 smithi047 bash[22744]: audit 2024-09-16T12:08:02.986894+0000 mgr.a (mgr.14373) 16902 : audit [DBG] from='client.363747 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:08:06.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:08:05 smithi157 bash[24585]: cluster 2024-09-16T12:08:04.558412+0000 mgr.a (mgr.14373) 16903 : cluster [DBG] pgmap v11724: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:08:06.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:08:05 smithi157 bash[24585]: audit 2024-09-16T12:08:04.794192+0000 mon.b (mon.2) 1534 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T12:08:06.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:08:05 smithi086 bash[24289]: cluster 2024-09-16T12:08:04.558412+0000 mgr.a (mgr.14373) 16903 : cluster [DBG] pgmap v11724: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:08:06.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:08:05 smithi086 bash[24289]: audit 2024-09-16T12:08:04.794192+0000 mon.b (mon.2) 1534 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T12:08:06.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:08:05 smithi047 bash[22744]: cluster 2024-09-16T12:08:04.558412+0000 mgr.a (mgr.14373) 16903 : cluster [DBG] pgmap v11724: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:08:06.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:08:05 smithi047 bash[22744]: audit 2024-09-16T12:08:04.794192+0000 mon.b (mon.2) 1534 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T12:08:08.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:08:07 smithi157 bash[24585]: cluster 2024-09-16T12:08:06.560581+0000 mgr.a (mgr.14373) 16904 : cluster [DBG] pgmap v11725: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-16T12:08:08.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:08:07 smithi086 bash[24289]: cluster 2024-09-16T12:08:06.560581+0000 mgr.a (mgr.14373) 16904 : cluster [DBG] pgmap v11725: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-16T12:08:08.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:08:07 smithi047 bash[22744]: cluster 2024-09-16T12:08:06.560581+0000 mgr.a (mgr.14373) 16904 : cluster [DBG] pgmap v11725: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-16T12:08:08.414 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:08:08.415 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:08:08.415 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:08:09.207 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:08:09.207 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:08:09.207 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:08:09.207 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:08:09.208 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:08:10.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:08:09 smithi157 bash[24585]: cluster 2024-09-16T12:08:08.561219+0000 mgr.a (mgr.14373) 16905 : cluster [DBG] pgmap v11726: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-16T12:08:10.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:08:09 smithi157 bash[24585]: audit 2024-09-16T12:08:08.757132+0000 mgr.a (mgr.14373) 16906 : audit [DBG] from='client.363825 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:08:10.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:08:09 smithi086 bash[24289]: cluster 2024-09-16T12:08:08.561219+0000 mgr.a (mgr.14373) 16905 : cluster [DBG] pgmap v11726: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-16T12:08:10.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:08:09 smithi086 bash[24289]: audit 2024-09-16T12:08:08.757132+0000 mgr.a (mgr.14373) 16906 : audit [DBG] from='client.363825 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:08:10.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:08:09 smithi047 bash[22744]: cluster 2024-09-16T12:08:08.561219+0000 mgr.a (mgr.14373) 16905 : cluster [DBG] pgmap v11726: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-16T12:08:10.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:08:09 smithi047 bash[22744]: audit 2024-09-16T12:08:08.757132+0000 mgr.a (mgr.14373) 16906 : audit [DBG] from='client.363825 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:08:11.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:08:11 smithi157 bash[24585]: audit 2024-09-16T12:08:10.141520+0000 mon.a (mon.0) 1570 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:08:11.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:08:11 smithi157 bash[24585]: audit 2024-09-16T12:08:10.148042+0000 mon.a (mon.0) 1571 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:08:11.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:08:11 smithi157 bash[24585]: audit 2024-09-16T12:08:10.152509+0000 mon.a (mon.0) 1572 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:08:11.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:08:11 smithi157 bash[24585]: audit 2024-09-16T12:08:10.159180+0000 mon.a (mon.0) 1573 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:08:11.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:08:11 smithi157 bash[24585]: audit 2024-09-16T12:08:10.188345+0000 mon.a (mon.0) 1574 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:08:11.558 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:08:11 smithi157 bash[24585]: audit 2024-09-16T12:08:10.198381+0000 mon.a (mon.0) 1575 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:08:11.558 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:08:11 smithi157 bash[24585]: cluster 2024-09-16T12:08:10.562091+0000 mgr.a (mgr.14373) 16907 : cluster [DBG] pgmap v11727: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-16T12:08:11.558 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:08:11 smithi157 bash[24585]: audit 2024-09-16T12:08:10.914159+0000 mon.b (mon.2) 1535 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T12:08:11.558 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:08:11 smithi157 bash[24585]: audit 2024-09-16T12:08:10.915949+0000 mon.b (mon.2) 1536 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T12:08:11.558 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:08:11 smithi157 bash[24585]: audit 2024-09-16T12:08:10.926310+0000 mon.a (mon.0) 1576 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:08:11.558 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:08:11 smithi157 bash[24585]: audit 2024-09-16T12:08:10.931985+0000 mon.b (mon.2) 1537 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:08:11.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:08:11 smithi086 bash[24289]: audit 2024-09-16T12:08:10.141520+0000 mon.a (mon.0) 1570 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:08:11.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:08:11 smithi086 bash[24289]: audit 2024-09-16T12:08:10.148042+0000 mon.a (mon.0) 1571 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:08:11.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:08:11 smithi086 bash[24289]: audit 2024-09-16T12:08:10.152509+0000 mon.a (mon.0) 1572 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:08:11.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:08:11 smithi086 bash[24289]: audit 2024-09-16T12:08:10.159180+0000 mon.a (mon.0) 1573 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:08:11.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:08:11 smithi086 bash[24289]: audit 2024-09-16T12:08:10.188345+0000 mon.a (mon.0) 1574 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:08:11.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:08:11 smithi086 bash[24289]: audit 2024-09-16T12:08:10.198381+0000 mon.a (mon.0) 1575 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:08:11.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:08:11 smithi086 bash[24289]: cluster 2024-09-16T12:08:10.562091+0000 mgr.a (mgr.14373) 16907 : cluster [DBG] pgmap v11727: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-16T12:08:11.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:08:11 smithi086 bash[24289]: audit 2024-09-16T12:08:10.914159+0000 mon.b (mon.2) 1535 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T12:08:11.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:08:11 smithi086 bash[24289]: audit 2024-09-16T12:08:10.915949+0000 mon.b (mon.2) 1536 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T12:08:11.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:08:11 smithi086 bash[24289]: audit 2024-09-16T12:08:10.926310+0000 mon.a (mon.0) 1576 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:08:11.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:08:11 smithi086 bash[24289]: audit 2024-09-16T12:08:10.931985+0000 mon.b (mon.2) 1537 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:08:11.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:08:11 smithi047 bash[22744]: audit 2024-09-16T12:08:10.141520+0000 mon.a (mon.0) 1570 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:08:11.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:08:11 smithi047 bash[22744]: audit 2024-09-16T12:08:10.148042+0000 mon.a (mon.0) 1571 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:08:11.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:08:11 smithi047 bash[22744]: audit 2024-09-16T12:08:10.152509+0000 mon.a (mon.0) 1572 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:08:11.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:08:11 smithi047 bash[22744]: audit 2024-09-16T12:08:10.159180+0000 mon.a (mon.0) 1573 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:08:11.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:08:11 smithi047 bash[22744]: audit 2024-09-16T12:08:10.188345+0000 mon.a (mon.0) 1574 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:08:11.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:08:11 smithi047 bash[22744]: audit 2024-09-16T12:08:10.198381+0000 mon.a (mon.0) 1575 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:08:11.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:08:11 smithi047 bash[22744]: cluster 2024-09-16T12:08:10.562091+0000 mgr.a (mgr.14373) 16907 : cluster [DBG] pgmap v11727: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-16T12:08:11.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:08:11 smithi047 bash[22744]: audit 2024-09-16T12:08:10.914159+0000 mon.b (mon.2) 1535 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T12:08:11.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:08:11 smithi047 bash[22744]: audit 2024-09-16T12:08:10.915949+0000 mon.b (mon.2) 1536 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T12:08:11.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:08:11 smithi047 bash[22744]: audit 2024-09-16T12:08:10.926310+0000 mon.a (mon.0) 1576 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:08:11.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:08:11 smithi047 bash[22744]: audit 2024-09-16T12:08:10.931985+0000 mon.b (mon.2) 1537 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:08:12.093 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 12:08:11 smithi047 bash[22994]: debug 2024-09-16T12:08:11.674+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T12:08:12.093 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 12:08:11 smithi047 bash[22994]: debug 2024-09-16T12:08:11.678+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T12:08:12.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:08:12 smithi157 bash[24585]: audit 2024-09-16T12:08:10.934047+0000 mgr.a (mgr.14373) 16908 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:08:12.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:08:12 smithi157 bash[24585]: audit 2024-09-16T12:08:11.682223+0000 mgr.a (mgr.14373) 16909 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T12:08:12.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:08:12 smithi157 bash[24585]: cephadm 2024-09-16T12:08:11.684061+0000 mgr.a (mgr.14373) 16910 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T12:08:12.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:08:12 smithi086 bash[24289]: audit 2024-09-16T12:08:10.934047+0000 mgr.a (mgr.14373) 16908 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:08:12.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:08:12 smithi086 bash[24289]: audit 2024-09-16T12:08:11.682223+0000 mgr.a (mgr.14373) 16909 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T12:08:12.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:08:12 smithi086 bash[24289]: cephadm 2024-09-16T12:08:11.684061+0000 mgr.a (mgr.14373) 16910 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T12:08:12.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:08:12 smithi047 bash[22744]: audit 2024-09-16T12:08:10.934047+0000 mgr.a (mgr.14373) 16908 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:08:12.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:08:12 smithi047 bash[22744]: audit 2024-09-16T12:08:11.682223+0000 mgr.a (mgr.14373) 16909 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T12:08:12.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:08:12 smithi047 bash[22744]: cephadm 2024-09-16T12:08:11.684061+0000 mgr.a (mgr.14373) 16910 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T12:08:13.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:08:13 smithi157 bash[24585]: cluster 2024-09-16T12:08:12.564974+0000 mgr.a (mgr.14373) 16911 : cluster [DBG] pgmap v11728: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 8.6 KiB/s rd, 255 B/s wr, 11 op/s 2024-09-16T12:08:13.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:08:13 smithi086 bash[24289]: cluster 2024-09-16T12:08:12.564974+0000 mgr.a (mgr.14373) 16911 : cluster [DBG] pgmap v11728: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 8.6 KiB/s rd, 255 B/s wr, 11 op/s 2024-09-16T12:08:13.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:08:13 smithi047 bash[22744]: cluster 2024-09-16T12:08:12.564974+0000 mgr.a (mgr.14373) 16911 : cluster [DBG] pgmap v11728: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 8.6 KiB/s rd, 255 B/s wr, 11 op/s 2024-09-16T12:08:14.209 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:08:14.209 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:08:14.210 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:08:14.981 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:08:14.981 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:08:14.982 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:08:14.982 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:08:14.982 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:08:16.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:08:15 smithi157 bash[24585]: audit 2024-09-16T12:08:14.541001+0000 mgr.a (mgr.14373) 16912 : audit [DBG] from='client.364005 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:08:16.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:08:15 smithi157 bash[24585]: cluster 2024-09-16T12:08:14.566419+0000 mgr.a (mgr.14373) 16913 : cluster [DBG] pgmap v11729: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 255 B/s wr, 10 op/s 2024-09-16T12:08:16.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:08:15 smithi086 bash[24289]: audit 2024-09-16T12:08:14.541001+0000 mgr.a (mgr.14373) 16912 : audit [DBG] from='client.364005 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:08:16.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:08:15 smithi086 bash[24289]: cluster 2024-09-16T12:08:14.566419+0000 mgr.a (mgr.14373) 16913 : cluster [DBG] pgmap v11729: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 255 B/s wr, 10 op/s 2024-09-16T12:08:16.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:08:15 smithi047 bash[22744]: audit 2024-09-16T12:08:14.541001+0000 mgr.a (mgr.14373) 16912 : audit [DBG] from='client.364005 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:08:16.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:08:15 smithi047 bash[22744]: cluster 2024-09-16T12:08:14.566419+0000 mgr.a (mgr.14373) 16913 : cluster [DBG] pgmap v11729: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 255 B/s wr, 10 op/s 2024-09-16T12:08:18.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:08:17 smithi157 bash[24585]: cluster 2024-09-16T12:08:16.568914+0000 mgr.a (mgr.14373) 16914 : cluster [DBG] pgmap v11730: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 12 KiB/s rd, 426 B/s wr, 14 op/s 2024-09-16T12:08:18.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:08:17 smithi086 bash[24289]: cluster 2024-09-16T12:08:16.568914+0000 mgr.a (mgr.14373) 16914 : cluster [DBG] pgmap v11730: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 12 KiB/s rd, 426 B/s wr, 14 op/s 2024-09-16T12:08:18.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:08:17 smithi047 bash[22744]: cluster 2024-09-16T12:08:16.568914+0000 mgr.a (mgr.14373) 16914 : cluster [DBG] pgmap v11730: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 12 KiB/s rd, 426 B/s wr, 14 op/s 2024-09-16T12:08:19.983 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:08:19.983 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:08:19.984 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:08:20.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:08:19 smithi157 bash[24585]: cluster 2024-09-16T12:08:18.569711+0000 mgr.a (mgr.14373) 16915 : cluster [DBG] pgmap v11731: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:08:20.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:08:19 smithi086 bash[24289]: cluster 2024-09-16T12:08:18.569711+0000 mgr.a (mgr.14373) 16915 : cluster [DBG] pgmap v11731: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:08:20.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:08:19 smithi047 bash[22744]: cluster 2024-09-16T12:08:18.569711+0000 mgr.a (mgr.14373) 16915 : cluster [DBG] pgmap v11731: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:08:20.737 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:08:20.737 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:08:20.737 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:08:20.737 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:08:20.737 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:08:22.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:08:21 smithi157 bash[24585]: audit 2024-09-16T12:08:20.305202+0000 mgr.a (mgr.14373) 16916 : audit [DBG] from='client.364083 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:08:22.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:08:21 smithi157 bash[24585]: cluster 2024-09-16T12:08:20.570270+0000 mgr.a (mgr.14373) 16917 : cluster [DBG] pgmap v11732: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:08:22.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:08:21 smithi086 bash[24289]: audit 2024-09-16T12:08:20.305202+0000 mgr.a (mgr.14373) 16916 : audit [DBG] from='client.364083 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:08:22.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:08:21 smithi086 bash[24289]: cluster 2024-09-16T12:08:20.570270+0000 mgr.a (mgr.14373) 16917 : cluster [DBG] pgmap v11732: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:08:22.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:08:21 smithi047 bash[22744]: audit 2024-09-16T12:08:20.305202+0000 mgr.a (mgr.14373) 16916 : audit [DBG] from='client.364083 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:08:22.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:08:21 smithi047 bash[22744]: cluster 2024-09-16T12:08:20.570270+0000 mgr.a (mgr.14373) 16917 : cluster [DBG] pgmap v11732: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:08:24.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:08:23 smithi157 bash[24585]: cluster 2024-09-16T12:08:22.572630+0000 mgr.a (mgr.14373) 16918 : cluster [DBG] pgmap v11733: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:08:24.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:08:23 smithi086 bash[24289]: cluster 2024-09-16T12:08:22.572630+0000 mgr.a (mgr.14373) 16918 : cluster [DBG] pgmap v11733: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:08:24.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:08:23 smithi047 bash[22744]: cluster 2024-09-16T12:08:22.572630+0000 mgr.a (mgr.14373) 16918 : cluster [DBG] pgmap v11733: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:08:25.739 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:08:25.739 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:08:25.740 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:08:26.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:08:25 smithi157 bash[24585]: cluster 2024-09-16T12:08:24.573408+0000 mgr.a (mgr.14373) 16919 : cluster [DBG] pgmap v11734: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 5.2 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-16T12:08:26.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:08:25 smithi086 bash[24289]: cluster 2024-09-16T12:08:24.573408+0000 mgr.a (mgr.14373) 16919 : cluster [DBG] pgmap v11734: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 5.2 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-16T12:08:26.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:08:25 smithi047 bash[22744]: cluster 2024-09-16T12:08:24.573408+0000 mgr.a (mgr.14373) 16919 : cluster [DBG] pgmap v11734: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 5.2 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-16T12:08:26.516 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:08:26.516 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:08:26.516 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:08:26.516 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:08:26.517 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:08:28.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:08:27 smithi157 bash[24585]: audit 2024-09-16T12:08:26.068962+0000 mgr.a (mgr.14373) 16920 : audit [DBG] from='client.364161 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:08:28.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:08:27 smithi157 bash[24585]: cluster 2024-09-16T12:08:26.575133+0000 mgr.a (mgr.14373) 16921 : cluster [DBG] pgmap v11735: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 5.7 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-16T12:08:28.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:08:27 smithi086 bash[24289]: audit 2024-09-16T12:08:26.068962+0000 mgr.a (mgr.14373) 16920 : audit [DBG] from='client.364161 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:08:28.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:08:27 smithi086 bash[24289]: cluster 2024-09-16T12:08:26.575133+0000 mgr.a (mgr.14373) 16921 : cluster [DBG] pgmap v11735: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 5.7 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-16T12:08:28.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:08:27 smithi047 bash[22744]: audit 2024-09-16T12:08:26.068962+0000 mgr.a (mgr.14373) 16920 : audit [DBG] from='client.364161 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:08:28.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:08:27 smithi047 bash[22744]: cluster 2024-09-16T12:08:26.575133+0000 mgr.a (mgr.14373) 16921 : cluster [DBG] pgmap v11735: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 5.7 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-16T12:08:30.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:08:29 smithi157 bash[24585]: cluster 2024-09-16T12:08:28.575842+0000 mgr.a (mgr.14373) 16922 : cluster [DBG] pgmap v11736: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T12:08:30.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:08:29 smithi086 bash[24289]: cluster 2024-09-16T12:08:28.575842+0000 mgr.a (mgr.14373) 16922 : cluster [DBG] pgmap v11736: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T12:08:30.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:08:29 smithi047 bash[22744]: cluster 2024-09-16T12:08:28.575842+0000 mgr.a (mgr.14373) 16922 : cluster [DBG] pgmap v11736: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T12:08:31.517 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:08:31.518 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:08:31.518 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:08:32.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:08:31 smithi157 bash[24585]: cluster 2024-09-16T12:08:30.576621+0000 mgr.a (mgr.14373) 16923 : cluster [DBG] pgmap v11737: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T12:08:32.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:08:31 smithi086 bash[24289]: cluster 2024-09-16T12:08:30.576621+0000 mgr.a (mgr.14373) 16923 : cluster [DBG] pgmap v11737: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T12:08:32.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:08:31 smithi047 bash[22744]: cluster 2024-09-16T12:08:30.576621+0000 mgr.a (mgr.14373) 16923 : cluster [DBG] pgmap v11737: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T12:08:32.310 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:08:32.311 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:08:32.311 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:08:32.311 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:08:32.311 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:08:34.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:08:33 smithi157 bash[24585]: audit 2024-09-16T12:08:31.853683+0000 mgr.a (mgr.14373) 16924 : audit [DBG] from='client.364239 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:08:34.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:08:33 smithi157 bash[24585]: cluster 2024-09-16T12:08:32.579508+0000 mgr.a (mgr.14373) 16925 : cluster [DBG] pgmap v11738: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:08:34.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:08:33 smithi086 bash[24289]: audit 2024-09-16T12:08:31.853683+0000 mgr.a (mgr.14373) 16924 : audit [DBG] from='client.364239 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:08:34.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:08:33 smithi086 bash[24289]: cluster 2024-09-16T12:08:32.579508+0000 mgr.a (mgr.14373) 16925 : cluster [DBG] pgmap v11738: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:08:34.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:08:33 smithi047 bash[22744]: audit 2024-09-16T12:08:31.853683+0000 mgr.a (mgr.14373) 16924 : audit [DBG] from='client.364239 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:08:34.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:08:33 smithi047 bash[22744]: cluster 2024-09-16T12:08:32.579508+0000 mgr.a (mgr.14373) 16925 : cluster [DBG] pgmap v11738: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:08:36.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:08:35 smithi157 bash[24585]: cluster 2024-09-16T12:08:34.580327+0000 mgr.a (mgr.14373) 16926 : cluster [DBG] pgmap v11739: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:08:36.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:08:35 smithi086 bash[24289]: cluster 2024-09-16T12:08:34.580327+0000 mgr.a (mgr.14373) 16926 : cluster [DBG] pgmap v11739: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:08:36.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:08:35 smithi047 bash[22744]: cluster 2024-09-16T12:08:34.580327+0000 mgr.a (mgr.14373) 16926 : cluster [DBG] pgmap v11739: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:08:37.312 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:08:37.313 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:08:37.313 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:08:38.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:08:37 smithi157 bash[24585]: cluster 2024-09-16T12:08:36.582285+0000 mgr.a (mgr.14373) 16927 : cluster [DBG] pgmap v11740: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 65 KiB/s rd, 0 B/s wr, 107 op/s 2024-09-16T12:08:38.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:08:37 smithi086 bash[24289]: cluster 2024-09-16T12:08:36.582285+0000 mgr.a (mgr.14373) 16927 : cluster [DBG] pgmap v11740: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 65 KiB/s rd, 0 B/s wr, 107 op/s 2024-09-16T12:08:38.077 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:08:38.078 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:08:38.078 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:08:38.078 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:08:38.078 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:08:38.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:08:37 smithi047 bash[22744]: cluster 2024-09-16T12:08:36.582285+0000 mgr.a (mgr.14373) 16927 : cluster [DBG] pgmap v11740: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 65 KiB/s rd, 0 B/s wr, 107 op/s 2024-09-16T12:08:39.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:08:38 smithi157 bash[24585]: audit 2024-09-16T12:08:37.648177+0000 mgr.a (mgr.14373) 16928 : audit [DBG] from='client.364317 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:08:39.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:08:38 smithi086 bash[24289]: audit 2024-09-16T12:08:37.648177+0000 mgr.a (mgr.14373) 16928 : audit [DBG] from='client.364317 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:08:39.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:08:38 smithi047 bash[22744]: audit 2024-09-16T12:08:37.648177+0000 mgr.a (mgr.14373) 16928 : audit [DBG] from='client.364317 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:08:40.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:08:39 smithi157 bash[24585]: cluster 2024-09-16T12:08:38.583446+0000 mgr.a (mgr.14373) 16929 : cluster [DBG] pgmap v11741: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 65 KiB/s rd, 0 B/s wr, 106 op/s 2024-09-16T12:08:40.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:08:39 smithi086 bash[24289]: cluster 2024-09-16T12:08:38.583446+0000 mgr.a (mgr.14373) 16929 : cluster [DBG] pgmap v11741: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 65 KiB/s rd, 0 B/s wr, 106 op/s 2024-09-16T12:08:40.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:08:39 smithi047 bash[22744]: cluster 2024-09-16T12:08:38.583446+0000 mgr.a (mgr.14373) 16929 : cluster [DBG] pgmap v11741: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 65 KiB/s rd, 0 B/s wr, 106 op/s 2024-09-16T12:08:42.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:08:41 smithi157 bash[24585]: cluster 2024-09-16T12:08:40.584468+0000 mgr.a (mgr.14373) 16930 : cluster [DBG] pgmap v11742: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 65 KiB/s rd, 0 B/s wr, 106 op/s 2024-09-16T12:08:42.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:08:41 smithi086 bash[24289]: cluster 2024-09-16T12:08:40.584468+0000 mgr.a (mgr.14373) 16930 : cluster [DBG] pgmap v11742: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 65 KiB/s rd, 0 B/s wr, 106 op/s 2024-09-16T12:08:42.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:08:41 smithi047 bash[22744]: cluster 2024-09-16T12:08:40.584468+0000 mgr.a (mgr.14373) 16930 : cluster [DBG] pgmap v11742: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 65 KiB/s rd, 0 B/s wr, 106 op/s 2024-09-16T12:08:43.079 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:08:43.080 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:08:43.080 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:08:43.825 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:08:43.825 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:08:43.825 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:08:43.825 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:08:43.826 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:08:44.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:08:43 smithi157 bash[24585]: cluster 2024-09-16T12:08:42.587025+0000 mgr.a (mgr.14373) 16931 : cluster [DBG] pgmap v11743: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 66 KiB/s rd, 0 B/s wr, 107 op/s 2024-09-16T12:08:44.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:08:43 smithi086 bash[24289]: cluster 2024-09-16T12:08:42.587025+0000 mgr.a (mgr.14373) 16931 : cluster [DBG] pgmap v11743: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 66 KiB/s rd, 0 B/s wr, 107 op/s 2024-09-16T12:08:44.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:08:43 smithi047 bash[22744]: cluster 2024-09-16T12:08:42.587025+0000 mgr.a (mgr.14373) 16931 : cluster [DBG] pgmap v11743: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 66 KiB/s rd, 0 B/s wr, 107 op/s 2024-09-16T12:08:45.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:08:44 smithi157 bash[24585]: audit 2024-09-16T12:08:43.409957+0000 mgr.a (mgr.14373) 16932 : audit [DBG] from='client.364395 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:08:45.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:08:44 smithi086 bash[24289]: audit 2024-09-16T12:08:43.409957+0000 mgr.a (mgr.14373) 16932 : audit [DBG] from='client.364395 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:08:45.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:08:44 smithi047 bash[22744]: audit 2024-09-16T12:08:43.409957+0000 mgr.a (mgr.14373) 16932 : audit [DBG] from='client.364395 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:08:46.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:08:45 smithi157 bash[24585]: cluster 2024-09-16T12:08:44.588043+0000 mgr.a (mgr.14373) 16933 : cluster [DBG] pgmap v11744: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 65 KiB/s rd, 0 B/s wr, 107 op/s 2024-09-16T12:08:46.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:08:45 smithi086 bash[24289]: cluster 2024-09-16T12:08:44.588043+0000 mgr.a (mgr.14373) 16933 : cluster [DBG] pgmap v11744: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 65 KiB/s rd, 0 B/s wr, 107 op/s 2024-09-16T12:08:46.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:08:45 smithi047 bash[22744]: cluster 2024-09-16T12:08:44.588043+0000 mgr.a (mgr.14373) 16933 : cluster [DBG] pgmap v11744: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 65 KiB/s rd, 0 B/s wr, 107 op/s 2024-09-16T12:08:48.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:08:47 smithi157 bash[24585]: cluster 2024-09-16T12:08:46.590247+0000 mgr.a (mgr.14373) 16934 : cluster [DBG] pgmap v11745: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 66 KiB/s rd, 0 B/s wr, 108 op/s 2024-09-16T12:08:48.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:08:47 smithi086 bash[24289]: cluster 2024-09-16T12:08:46.590247+0000 mgr.a (mgr.14373) 16934 : cluster [DBG] pgmap v11745: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 66 KiB/s rd, 0 B/s wr, 108 op/s 2024-09-16T12:08:48.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:08:47 smithi047 bash[22744]: cluster 2024-09-16T12:08:46.590247+0000 mgr.a (mgr.14373) 16934 : cluster [DBG] pgmap v11745: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 66 KiB/s rd, 0 B/s wr, 108 op/s 2024-09-16T12:08:48.827 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:08:48.827 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:08:48.827 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:08:49.619 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:08:49.620 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:08:49.620 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:08:49.620 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:08:49.620 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:08:50.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:08:49 smithi157 bash[24585]: cluster 2024-09-16T12:08:48.591045+0000 mgr.a (mgr.14373) 16935 : cluster [DBG] pgmap v11746: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:08:50.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:08:49 smithi086 bash[24289]: cluster 2024-09-16T12:08:48.591045+0000 mgr.a (mgr.14373) 16935 : cluster [DBG] pgmap v11746: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:08:50.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:08:49 smithi047 bash[22744]: cluster 2024-09-16T12:08:48.591045+0000 mgr.a (mgr.14373) 16935 : cluster [DBG] pgmap v11746: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:08:51.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:08:50 smithi157 bash[24585]: audit 2024-09-16T12:08:49.167591+0000 mgr.a (mgr.14373) 16936 : audit [DBG] from='client.364470 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:08:51.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:08:50 smithi086 bash[24289]: audit 2024-09-16T12:08:49.167591+0000 mgr.a (mgr.14373) 16936 : audit [DBG] from='client.364470 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:08:51.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:08:50 smithi047 bash[22744]: audit 2024-09-16T12:08:49.167591+0000 mgr.a (mgr.14373) 16936 : audit [DBG] from='client.364470 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:08:52.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:08:51 smithi157 bash[24585]: cluster 2024-09-16T12:08:50.592087+0000 mgr.a (mgr.14373) 16937 : cluster [DBG] pgmap v11747: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:08:52.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:08:51 smithi086 bash[24289]: cluster 2024-09-16T12:08:50.592087+0000 mgr.a (mgr.14373) 16937 : cluster [DBG] pgmap v11747: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:08:52.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:08:51 smithi047 bash[22744]: cluster 2024-09-16T12:08:50.592087+0000 mgr.a (mgr.14373) 16937 : cluster [DBG] pgmap v11747: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:08:54.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:08:53 smithi157 bash[24585]: cluster 2024-09-16T12:08:52.594388+0000 mgr.a (mgr.14373) 16938 : cluster [DBG] pgmap v11748: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:08:54.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:08:53 smithi086 bash[24289]: cluster 2024-09-16T12:08:52.594388+0000 mgr.a (mgr.14373) 16938 : cluster [DBG] pgmap v11748: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:08:54.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:08:53 smithi047 bash[22744]: cluster 2024-09-16T12:08:52.594388+0000 mgr.a (mgr.14373) 16938 : cluster [DBG] pgmap v11748: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:08:54.621 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:08:54.621 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:08:54.622 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:08:55.409 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:08:55.409 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:08:55.409 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:08:55.409 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:08:55.409 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:08:56.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:08:55 smithi157 bash[24585]: cluster 2024-09-16T12:08:54.595180+0000 mgr.a (mgr.14373) 16939 : cluster [DBG] pgmap v11749: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:08:56.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:08:55 smithi086 bash[24289]: cluster 2024-09-16T12:08:54.595180+0000 mgr.a (mgr.14373) 16939 : cluster [DBG] pgmap v11749: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:08:56.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:08:55 smithi047 bash[22744]: cluster 2024-09-16T12:08:54.595180+0000 mgr.a (mgr.14373) 16939 : cluster [DBG] pgmap v11749: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:08:57.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:08:56 smithi157 bash[24585]: audit 2024-09-16T12:08:54.958739+0000 mgr.a (mgr.14373) 16940 : audit [DBG] from='client.364548 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:08:57.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:08:56 smithi086 bash[24289]: audit 2024-09-16T12:08:54.958739+0000 mgr.a (mgr.14373) 16940 : audit [DBG] from='client.364548 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:08:57.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:08:56 smithi047 bash[22744]: audit 2024-09-16T12:08:54.958739+0000 mgr.a (mgr.14373) 16940 : audit [DBG] from='client.364548 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:08:58.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:08:57 smithi157 bash[24585]: cluster 2024-09-16T12:08:56.597571+0000 mgr.a (mgr.14373) 16941 : cluster [DBG] pgmap v11750: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:08:58.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:08:57 smithi086 bash[24289]: cluster 2024-09-16T12:08:56.597571+0000 mgr.a (mgr.14373) 16941 : cluster [DBG] pgmap v11750: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:08:58.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:08:57 smithi047 bash[22744]: cluster 2024-09-16T12:08:56.597571+0000 mgr.a (mgr.14373) 16941 : cluster [DBG] pgmap v11750: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:09:00.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:08:59 smithi157 bash[24585]: cluster 2024-09-16T12:08:58.598417+0000 mgr.a (mgr.14373) 16942 : cluster [DBG] pgmap v11751: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:09:00.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:08:59 smithi086 bash[24289]: cluster 2024-09-16T12:08:58.598417+0000 mgr.a (mgr.14373) 16942 : cluster [DBG] pgmap v11751: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:09:00.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:08:59 smithi047 bash[22744]: cluster 2024-09-16T12:08:58.598417+0000 mgr.a (mgr.14373) 16942 : cluster [DBG] pgmap v11751: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:09:00.410 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:09:00.411 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:09:00.411 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:09:01.212 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:09:01.213 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:09:01.213 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:09:01.213 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:09:01.213 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:09:02.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:09:01 smithi157 bash[24585]: cluster 2024-09-16T12:09:00.599076+0000 mgr.a (mgr.14373) 16943 : cluster [DBG] pgmap v11752: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:09:02.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:09:01 smithi157 bash[24585]: audit 2024-09-16T12:09:00.752519+0000 mgr.a (mgr.14373) 16944 : audit [DBG] from='client.364623 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:09:02.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:09:01 smithi086 bash[24289]: cluster 2024-09-16T12:09:00.599076+0000 mgr.a (mgr.14373) 16943 : cluster [DBG] pgmap v11752: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:09:02.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:09:01 smithi086 bash[24289]: audit 2024-09-16T12:09:00.752519+0000 mgr.a (mgr.14373) 16944 : audit [DBG] from='client.364623 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:09:02.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:09:01 smithi047 bash[22744]: cluster 2024-09-16T12:09:00.599076+0000 mgr.a (mgr.14373) 16943 : cluster [DBG] pgmap v11752: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:09:02.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:09:01 smithi047 bash[22744]: audit 2024-09-16T12:09:00.752519+0000 mgr.a (mgr.14373) 16944 : audit [DBG] from='client.364623 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:09:04.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:09:03 smithi157 bash[24585]: cluster 2024-09-16T12:09:02.601483+0000 mgr.a (mgr.14373) 16945 : cluster [DBG] pgmap v11753: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:09:04.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:09:03 smithi086 bash[24289]: cluster 2024-09-16T12:09:02.601483+0000 mgr.a (mgr.14373) 16945 : cluster [DBG] pgmap v11753: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:09:04.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:09:03 smithi047 bash[22744]: cluster 2024-09-16T12:09:02.601483+0000 mgr.a (mgr.14373) 16945 : cluster [DBG] pgmap v11753: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:09:06.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:09:05 smithi157 bash[24585]: cluster 2024-09-16T12:09:04.602251+0000 mgr.a (mgr.14373) 16946 : cluster [DBG] pgmap v11754: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:09:06.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:09:05 smithi086 bash[24289]: cluster 2024-09-16T12:09:04.602251+0000 mgr.a (mgr.14373) 16946 : cluster [DBG] pgmap v11754: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:09:06.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:09:05 smithi047 bash[22744]: cluster 2024-09-16T12:09:04.602251+0000 mgr.a (mgr.14373) 16946 : cluster [DBG] pgmap v11754: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:09:06.214 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:09:06.215 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:09:06.215 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:09:07.000 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:09:07.000 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:09:07.000 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:09:07.000 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:09:07.000 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:09:08.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:09:07 smithi157 bash[24585]: audit 2024-09-16T12:09:06.552589+0000 mgr.a (mgr.14373) 16947 : audit [DBG] from='client.364695 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:09:08.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:09:07 smithi157 bash[24585]: cluster 2024-09-16T12:09:06.605307+0000 mgr.a (mgr.14373) 16948 : cluster [DBG] pgmap v11755: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:09:08.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:09:07 smithi086 bash[24289]: audit 2024-09-16T12:09:06.552589+0000 mgr.a (mgr.14373) 16947 : audit [DBG] from='client.364695 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:09:08.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:09:07 smithi086 bash[24289]: cluster 2024-09-16T12:09:06.605307+0000 mgr.a (mgr.14373) 16948 : cluster [DBG] pgmap v11755: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:09:08.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:09:07 smithi047 bash[22744]: audit 2024-09-16T12:09:06.552589+0000 mgr.a (mgr.14373) 16947 : audit [DBG] from='client.364695 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:09:08.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:09:07 smithi047 bash[22744]: cluster 2024-09-16T12:09:06.605307+0000 mgr.a (mgr.14373) 16948 : cluster [DBG] pgmap v11755: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:09:10.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:09:09 smithi157 bash[24585]: cluster 2024-09-16T12:09:08.606293+0000 mgr.a (mgr.14373) 16949 : cluster [DBG] pgmap v11756: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:09:10.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:09:09 smithi086 bash[24289]: cluster 2024-09-16T12:09:08.606293+0000 mgr.a (mgr.14373) 16949 : cluster [DBG] pgmap v11756: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:09:10.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:09:09 smithi047 bash[22744]: cluster 2024-09-16T12:09:08.606293+0000 mgr.a (mgr.14373) 16949 : cluster [DBG] pgmap v11756: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:09:12.001 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:09:12.002 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:09:12.002 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:09:12.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:09:11 smithi157 bash[24585]: cluster 2024-09-16T12:09:10.607096+0000 mgr.a (mgr.14373) 16950 : cluster [DBG] pgmap v11757: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:09:12.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:09:11 smithi157 bash[24585]: audit 2024-09-16T12:09:11.735490+0000 mon.b (mon.2) 1538 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T12:09:12.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:09:11 smithi086 bash[24289]: cluster 2024-09-16T12:09:10.607096+0000 mgr.a (mgr.14373) 16950 : cluster [DBG] pgmap v11757: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:09:12.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:09:11 smithi086 bash[24289]: audit 2024-09-16T12:09:11.735490+0000 mon.b (mon.2) 1538 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T12:09:12.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:09:11 smithi047 bash[22744]: cluster 2024-09-16T12:09:10.607096+0000 mgr.a (mgr.14373) 16950 : cluster [DBG] pgmap v11757: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:09:12.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:09:11 smithi047 bash[22744]: audit 2024-09-16T12:09:11.735490+0000 mon.b (mon.2) 1538 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T12:09:12.777 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:09:12.778 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:09:12.778 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:09:12.778 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:09:12.778 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:09:13.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:09:12 smithi157 bash[24585]: audit 2024-09-16T12:09:12.595520+0000 mon.b (mon.2) 1539 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T12:09:13.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:09:12 smithi157 bash[24585]: audit 2024-09-16T12:09:12.596985+0000 mon.b (mon.2) 1540 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T12:09:13.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:09:12 smithi157 bash[24585]: audit 2024-09-16T12:09:12.606462+0000 mon.a (mon.0) 1577 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:09:13.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:09:12 smithi157 bash[24585]: audit 2024-09-16T12:09:12.610457+0000 mon.b (mon.2) 1541 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:09:13.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:09:12 smithi086 bash[24289]: audit 2024-09-16T12:09:12.595520+0000 mon.b (mon.2) 1539 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T12:09:13.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:09:12 smithi086 bash[24289]: audit 2024-09-16T12:09:12.596985+0000 mon.b (mon.2) 1540 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T12:09:13.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:09:12 smithi086 bash[24289]: audit 2024-09-16T12:09:12.606462+0000 mon.a (mon.0) 1577 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:09:13.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:09:12 smithi086 bash[24289]: audit 2024-09-16T12:09:12.610457+0000 mon.b (mon.2) 1541 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:09:13.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:09:12 smithi047 bash[22744]: audit 2024-09-16T12:09:12.595520+0000 mon.b (mon.2) 1539 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T12:09:13.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:09:12 smithi047 bash[22744]: audit 2024-09-16T12:09:12.596985+0000 mon.b (mon.2) 1540 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T12:09:13.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:09:12 smithi047 bash[22744]: audit 2024-09-16T12:09:12.606462+0000 mon.a (mon.0) 1577 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:09:13.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:09:12 smithi047 bash[22744]: audit 2024-09-16T12:09:12.610457+0000 mon.b (mon.2) 1541 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:09:13.775 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 12:09:13 smithi047 bash[22994]: debug 2024-09-16T12:09:13.481+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T12:09:13.775 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 12:09:13 smithi047 bash[22994]: debug 2024-09-16T12:09:13.481+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T12:09:14.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:09:13 smithi157 bash[24585]: audit 2024-09-16T12:09:12.325261+0000 mgr.a (mgr.14373) 16951 : audit [DBG] from='client.364767 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:09:14.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:09:13 smithi157 bash[24585]: cluster 2024-09-16T12:09:12.609950+0000 mgr.a (mgr.14373) 16952 : cluster [DBG] pgmap v11758: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:09:14.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:09:13 smithi157 bash[24585]: audit 2024-09-16T12:09:12.612674+0000 mgr.a (mgr.14373) 16953 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:09:14.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:09:13 smithi086 bash[24289]: audit 2024-09-16T12:09:12.325261+0000 mgr.a (mgr.14373) 16951 : audit [DBG] from='client.364767 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:09:14.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:09:13 smithi086 bash[24289]: cluster 2024-09-16T12:09:12.609950+0000 mgr.a (mgr.14373) 16952 : cluster [DBG] pgmap v11758: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:09:14.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:09:13 smithi086 bash[24289]: audit 2024-09-16T12:09:12.612674+0000 mgr.a (mgr.14373) 16953 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:09:14.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:09:13 smithi047 bash[22744]: audit 2024-09-16T12:09:12.325261+0000 mgr.a (mgr.14373) 16951 : audit [DBG] from='client.364767 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:09:14.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:09:13 smithi047 bash[22744]: cluster 2024-09-16T12:09:12.609950+0000 mgr.a (mgr.14373) 16952 : cluster [DBG] pgmap v11758: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:09:14.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:09:13 smithi047 bash[22744]: audit 2024-09-16T12:09:12.612674+0000 mgr.a (mgr.14373) 16953 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:09:15.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:09:14 smithi157 bash[24585]: audit 2024-09-16T12:09:13.482408+0000 mgr.a (mgr.14373) 16954 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T12:09:15.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:09:14 smithi157 bash[24585]: cephadm 2024-09-16T12:09:13.484678+0000 mgr.a (mgr.14373) 16955 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T12:09:15.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:09:14 smithi086 bash[24289]: audit 2024-09-16T12:09:13.482408+0000 mgr.a (mgr.14373) 16954 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T12:09:15.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:09:14 smithi086 bash[24289]: cephadm 2024-09-16T12:09:13.484678+0000 mgr.a (mgr.14373) 16955 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T12:09:15.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:09:14 smithi047 bash[22744]: audit 2024-09-16T12:09:13.482408+0000 mgr.a (mgr.14373) 16954 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T12:09:15.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:09:14 smithi047 bash[22744]: cephadm 2024-09-16T12:09:13.484678+0000 mgr.a (mgr.14373) 16955 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T12:09:16.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:09:15 smithi157 bash[24585]: cluster 2024-09-16T12:09:14.611153+0000 mgr.a (mgr.14373) 16956 : cluster [DBG] pgmap v11759: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:09:16.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:09:15 smithi086 bash[24289]: cluster 2024-09-16T12:09:14.611153+0000 mgr.a (mgr.14373) 16956 : cluster [DBG] pgmap v11759: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:09:16.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:09:15 smithi047 bash[22744]: cluster 2024-09-16T12:09:14.611153+0000 mgr.a (mgr.14373) 16956 : cluster [DBG] pgmap v11759: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:09:17.779 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:09:17.780 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:09:17.780 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:09:18.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:09:17 smithi157 bash[24585]: cluster 2024-09-16T12:09:16.613354+0000 mgr.a (mgr.14373) 16957 : cluster [DBG] pgmap v11760: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:09:18.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:09:17 smithi086 bash[24289]: cluster 2024-09-16T12:09:16.613354+0000 mgr.a (mgr.14373) 16957 : cluster [DBG] pgmap v11760: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:09:18.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:09:17 smithi047 bash[22744]: cluster 2024-09-16T12:09:16.613354+0000 mgr.a (mgr.14373) 16957 : cluster [DBG] pgmap v11760: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:09:18.538 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:09:18.538 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:09:18.538 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:09:18.538 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:09:18.538 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:09:20.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:09:19 smithi157 bash[24585]: audit 2024-09-16T12:09:18.110944+0000 mgr.a (mgr.14373) 16958 : audit [DBG] from='client.364947 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:09:20.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:09:19 smithi157 bash[24585]: cluster 2024-09-16T12:09:18.614519+0000 mgr.a (mgr.14373) 16959 : cluster [DBG] pgmap v11761: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:09:20.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:09:19 smithi086 bash[24289]: audit 2024-09-16T12:09:18.110944+0000 mgr.a (mgr.14373) 16958 : audit [DBG] from='client.364947 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:09:20.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:09:19 smithi086 bash[24289]: cluster 2024-09-16T12:09:18.614519+0000 mgr.a (mgr.14373) 16959 : cluster [DBG] pgmap v11761: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:09:20.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:09:19 smithi047 bash[22744]: audit 2024-09-16T12:09:18.110944+0000 mgr.a (mgr.14373) 16958 : audit [DBG] from='client.364947 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:09:20.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:09:19 smithi047 bash[22744]: cluster 2024-09-16T12:09:18.614519+0000 mgr.a (mgr.14373) 16959 : cluster [DBG] pgmap v11761: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:09:22.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:09:21 smithi157 bash[24585]: cluster 2024-09-16T12:09:20.615373+0000 mgr.a (mgr.14373) 16960 : cluster [DBG] pgmap v11762: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:09:22.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:09:21 smithi086 bash[24289]: cluster 2024-09-16T12:09:20.615373+0000 mgr.a (mgr.14373) 16960 : cluster [DBG] pgmap v11762: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:09:22.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:09:21 smithi047 bash[22744]: cluster 2024-09-16T12:09:20.615373+0000 mgr.a (mgr.14373) 16960 : cluster [DBG] pgmap v11762: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:09:23.539 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:09:23.540 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:09:23.540 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:09:24.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:09:23 smithi157 bash[24585]: cluster 2024-09-16T12:09:22.617615+0000 mgr.a (mgr.14373) 16961 : cluster [DBG] pgmap v11763: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:09:24.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:09:23 smithi086 bash[24289]: cluster 2024-09-16T12:09:22.617615+0000 mgr.a (mgr.14373) 16961 : cluster [DBG] pgmap v11763: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:09:24.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:09:23 smithi047 bash[22744]: cluster 2024-09-16T12:09:22.617615+0000 mgr.a (mgr.14373) 16961 : cluster [DBG] pgmap v11763: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:09:24.298 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:09:24.298 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:09:24.298 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:09:24.298 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:09:24.298 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:09:26.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:09:25 smithi086 bash[24289]: audit 2024-09-16T12:09:23.872817+0000 mgr.a (mgr.14373) 16962 : audit [DBG] from='client.365022 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:09:26.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:09:25 smithi086 bash[24289]: cluster 2024-09-16T12:09:24.618758+0000 mgr.a (mgr.14373) 16963 : cluster [DBG] pgmap v11764: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:09:26.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:09:25 smithi047 bash[22744]: audit 2024-09-16T12:09:23.872817+0000 mgr.a (mgr.14373) 16962 : audit [DBG] from='client.365022 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:09:26.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:09:25 smithi047 bash[22744]: cluster 2024-09-16T12:09:24.618758+0000 mgr.a (mgr.14373) 16963 : cluster [DBG] pgmap v11764: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:09:26.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:09:25 smithi157 bash[24585]: audit 2024-09-16T12:09:23.872817+0000 mgr.a (mgr.14373) 16962 : audit [DBG] from='client.365022 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:09:26.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:09:25 smithi157 bash[24585]: cluster 2024-09-16T12:09:24.618758+0000 mgr.a (mgr.14373) 16963 : cluster [DBG] pgmap v11764: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:09:28.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:09:27 smithi086 bash[24289]: cluster 2024-09-16T12:09:26.621127+0000 mgr.a (mgr.14373) 16964 : cluster [DBG] pgmap v11765: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:09:28.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:09:27 smithi047 bash[22744]: cluster 2024-09-16T12:09:26.621127+0000 mgr.a (mgr.14373) 16964 : cluster [DBG] pgmap v11765: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:09:28.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:09:27 smithi157 bash[24585]: cluster 2024-09-16T12:09:26.621127+0000 mgr.a (mgr.14373) 16964 : cluster [DBG] pgmap v11765: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:09:29.300 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:09:29.301 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:09:29.301 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:09:30.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:09:29 smithi086 bash[24289]: cluster 2024-09-16T12:09:28.622079+0000 mgr.a (mgr.14373) 16965 : cluster [DBG] pgmap v11766: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:09:30.083 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:09:30.083 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:09:30.083 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:09:30.083 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:09:30.084 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:09:30.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:09:29 smithi047 bash[22744]: cluster 2024-09-16T12:09:28.622079+0000 mgr.a (mgr.14373) 16965 : cluster [DBG] pgmap v11766: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:09:30.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:09:29 smithi157 bash[24585]: cluster 2024-09-16T12:09:28.622079+0000 mgr.a (mgr.14373) 16965 : cluster [DBG] pgmap v11766: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:09:31.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:09:30 smithi047 bash[22744]: audit 2024-09-16T12:09:29.637165+0000 mgr.a (mgr.14373) 16966 : audit [DBG] from='client.365097 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:09:31.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:09:30 smithi157 bash[24585]: audit 2024-09-16T12:09:29.637165+0000 mgr.a (mgr.14373) 16966 : audit [DBG] from='client.365097 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:09:31.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:09:30 smithi086 bash[24289]: audit 2024-09-16T12:09:29.637165+0000 mgr.a (mgr.14373) 16966 : audit [DBG] from='client.365097 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:09:32.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:09:31 smithi047 bash[22744]: cluster 2024-09-16T12:09:30.623105+0000 mgr.a (mgr.14373) 16967 : cluster [DBG] pgmap v11767: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:09:32.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:09:31 smithi157 bash[24585]: cluster 2024-09-16T12:09:30.623105+0000 mgr.a (mgr.14373) 16967 : cluster [DBG] pgmap v11767: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:09:32.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:09:31 smithi086 bash[24289]: cluster 2024-09-16T12:09:30.623105+0000 mgr.a (mgr.14373) 16967 : cluster [DBG] pgmap v11767: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:09:34.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:09:33 smithi047 bash[22744]: cluster 2024-09-16T12:09:32.625388+0000 mgr.a (mgr.14373) 16968 : cluster [DBG] pgmap v11768: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:09:34.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:09:33 smithi157 bash[24585]: cluster 2024-09-16T12:09:32.625388+0000 mgr.a (mgr.14373) 16968 : cluster [DBG] pgmap v11768: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:09:34.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:09:33 smithi086 bash[24289]: cluster 2024-09-16T12:09:32.625388+0000 mgr.a (mgr.14373) 16968 : cluster [DBG] pgmap v11768: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:09:35.085 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:09:35.085 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:09:35.086 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:09:35.872 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:09:35.872 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:09:35.873 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:09:35.873 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:09:35.873 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:09:36.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:09:35 smithi047 bash[22744]: cluster 2024-09-16T12:09:34.626133+0000 mgr.a (mgr.14373) 16969 : cluster [DBG] pgmap v11769: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:09:36.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:09:35 smithi157 bash[24585]: cluster 2024-09-16T12:09:34.626133+0000 mgr.a (mgr.14373) 16969 : cluster [DBG] pgmap v11769: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:09:36.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:09:35 smithi086 bash[24289]: cluster 2024-09-16T12:09:34.626133+0000 mgr.a (mgr.14373) 16969 : cluster [DBG] pgmap v11769: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:09:37.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:09:36 smithi047 bash[22744]: audit 2024-09-16T12:09:35.422957+0000 mgr.a (mgr.14373) 16970 : audit [DBG] from='client.365175 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:09:37.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:09:36 smithi157 bash[24585]: audit 2024-09-16T12:09:35.422957+0000 mgr.a (mgr.14373) 16970 : audit [DBG] from='client.365175 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:09:37.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:09:36 smithi086 bash[24289]: audit 2024-09-16T12:09:35.422957+0000 mgr.a (mgr.14373) 16970 : audit [DBG] from='client.365175 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:09:38.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:09:37 smithi047 bash[22744]: cluster 2024-09-16T12:09:36.628495+0000 mgr.a (mgr.14373) 16971 : cluster [DBG] pgmap v11770: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:09:38.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:09:37 smithi157 bash[24585]: cluster 2024-09-16T12:09:36.628495+0000 mgr.a (mgr.14373) 16971 : cluster [DBG] pgmap v11770: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:09:38.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:09:37 smithi086 bash[24289]: cluster 2024-09-16T12:09:36.628495+0000 mgr.a (mgr.14373) 16971 : cluster [DBG] pgmap v11770: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:09:39.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:09:38 smithi157 bash[24585]: cluster 2024-09-16T12:09:38.629266+0000 mgr.a (mgr.14373) 16972 : cluster [DBG] pgmap v11771: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:09:39.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:09:38 smithi086 bash[24289]: cluster 2024-09-16T12:09:38.629266+0000 mgr.a (mgr.14373) 16972 : cluster [DBG] pgmap v11771: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:09:39.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:09:38 smithi047 bash[22744]: cluster 2024-09-16T12:09:38.629266+0000 mgr.a (mgr.14373) 16972 : cluster [DBG] pgmap v11771: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:09:40.873 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:09:40.874 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:09:40.874 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:09:41.629 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:09:41.630 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:09:41.630 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:09:41.630 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:09:41.630 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:09:42.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:09:41 smithi157 bash[24585]: cluster 2024-09-16T12:09:40.630147+0000 mgr.a (mgr.14373) 16973 : cluster [DBG] pgmap v11772: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:09:42.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:09:41 smithi086 bash[24289]: cluster 2024-09-16T12:09:40.630147+0000 mgr.a (mgr.14373) 16973 : cluster [DBG] pgmap v11772: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:09:42.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:09:41 smithi047 bash[22744]: cluster 2024-09-16T12:09:40.630147+0000 mgr.a (mgr.14373) 16973 : cluster [DBG] pgmap v11772: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:09:43.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:09:42 smithi157 bash[24585]: audit 2024-09-16T12:09:41.204080+0000 mgr.a (mgr.14373) 16974 : audit [DBG] from='client.365250 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:09:43.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:09:42 smithi086 bash[24289]: audit 2024-09-16T12:09:41.204080+0000 mgr.a (mgr.14373) 16974 : audit [DBG] from='client.365250 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:09:43.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:09:42 smithi047 bash[22744]: audit 2024-09-16T12:09:41.204080+0000 mgr.a (mgr.14373) 16974 : audit [DBG] from='client.365250 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:09:44.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:09:43 smithi157 bash[24585]: cluster 2024-09-16T12:09:42.632903+0000 mgr.a (mgr.14373) 16975 : cluster [DBG] pgmap v11773: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-16T12:09:44.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:09:43 smithi086 bash[24289]: cluster 2024-09-16T12:09:42.632903+0000 mgr.a (mgr.14373) 16975 : cluster [DBG] pgmap v11773: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-16T12:09:44.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:09:43 smithi047 bash[22744]: cluster 2024-09-16T12:09:42.632903+0000 mgr.a (mgr.14373) 16975 : cluster [DBG] pgmap v11773: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-16T12:09:46.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:09:45 smithi157 bash[24585]: cluster 2024-09-16T12:09:44.633695+0000 mgr.a (mgr.14373) 16976 : cluster [DBG] pgmap v11774: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-16T12:09:46.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:09:45 smithi086 bash[24289]: cluster 2024-09-16T12:09:44.633695+0000 mgr.a (mgr.14373) 16976 : cluster [DBG] pgmap v11774: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-16T12:09:46.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:09:45 smithi047 bash[22744]: cluster 2024-09-16T12:09:44.633695+0000 mgr.a (mgr.14373) 16976 : cluster [DBG] pgmap v11774: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-16T12:09:46.631 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:09:46.632 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:09:46.632 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:09:47.375 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:09:47.375 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:09:47.375 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:09:47.375 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:09:47.376 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:09:48.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:09:47 smithi157 bash[24585]: cluster 2024-09-16T12:09:46.635707+0000 mgr.a (mgr.14373) 16977 : cluster [DBG] pgmap v11775: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:09:48.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:09:47 smithi086 bash[24289]: cluster 2024-09-16T12:09:46.635707+0000 mgr.a (mgr.14373) 16977 : cluster [DBG] pgmap v11775: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:09:48.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:09:47 smithi047 bash[22744]: cluster 2024-09-16T12:09:46.635707+0000 mgr.a (mgr.14373) 16977 : cluster [DBG] pgmap v11775: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:09:49.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:09:48 smithi157 bash[24585]: audit 2024-09-16T12:09:46.961926+0000 mgr.a (mgr.14373) 16978 : audit [DBG] from='client.365325 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:09:49.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:09:48 smithi086 bash[24289]: audit 2024-09-16T12:09:46.961926+0000 mgr.a (mgr.14373) 16978 : audit [DBG] from='client.365325 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:09:49.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:09:48 smithi047 bash[22744]: audit 2024-09-16T12:09:46.961926+0000 mgr.a (mgr.14373) 16978 : audit [DBG] from='client.365325 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:09:50.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:09:49 smithi157 bash[24585]: cluster 2024-09-16T12:09:48.636596+0000 mgr.a (mgr.14373) 16979 : cluster [DBG] pgmap v11776: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:09:50.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:09:49 smithi086 bash[24289]: cluster 2024-09-16T12:09:48.636596+0000 mgr.a (mgr.14373) 16979 : cluster [DBG] pgmap v11776: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:09:50.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:09:49 smithi047 bash[22744]: cluster 2024-09-16T12:09:48.636596+0000 mgr.a (mgr.14373) 16979 : cluster [DBG] pgmap v11776: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:09:52.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:09:51 smithi157 bash[24585]: cluster 2024-09-16T12:09:50.637357+0000 mgr.a (mgr.14373) 16980 : cluster [DBG] pgmap v11777: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T12:09:52.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:09:51 smithi086 bash[24289]: cluster 2024-09-16T12:09:50.637357+0000 mgr.a (mgr.14373) 16980 : cluster [DBG] pgmap v11777: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T12:09:52.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:09:51 smithi047 bash[22744]: cluster 2024-09-16T12:09:50.637357+0000 mgr.a (mgr.14373) 16980 : cluster [DBG] pgmap v11777: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T12:09:52.377 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:09:52.377 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:09:52.378 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:09:53.150 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:09:53.151 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:09:53.151 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:09:53.151 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:09:53.151 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:09:54.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:09:53 smithi157 bash[24585]: cluster 2024-09-16T12:09:52.638723+0000 mgr.a (mgr.14373) 16981 : cluster [DBG] pgmap v11778: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:09:54.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:09:53 smithi157 bash[24585]: audit 2024-09-16T12:09:52.709580+0000 mgr.a (mgr.14373) 16982 : audit [DBG] from='client.365400 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:09:54.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:09:53 smithi086 bash[24289]: cluster 2024-09-16T12:09:52.638723+0000 mgr.a (mgr.14373) 16981 : cluster [DBG] pgmap v11778: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:09:54.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:09:53 smithi086 bash[24289]: audit 2024-09-16T12:09:52.709580+0000 mgr.a (mgr.14373) 16982 : audit [DBG] from='client.365400 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:09:54.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:09:53 smithi047 bash[22744]: cluster 2024-09-16T12:09:52.638723+0000 mgr.a (mgr.14373) 16981 : cluster [DBG] pgmap v11778: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:09:54.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:09:53 smithi047 bash[22744]: audit 2024-09-16T12:09:52.709580+0000 mgr.a (mgr.14373) 16982 : audit [DBG] from='client.365400 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:09:56.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:09:55 smithi157 bash[24585]: cluster 2024-09-16T12:09:54.639696+0000 mgr.a (mgr.14373) 16983 : cluster [DBG] pgmap v11779: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-16T12:09:56.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:09:55 smithi086 bash[24289]: cluster 2024-09-16T12:09:54.639696+0000 mgr.a (mgr.14373) 16983 : cluster [DBG] pgmap v11779: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-16T12:09:56.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:09:55 smithi047 bash[22744]: cluster 2024-09-16T12:09:54.639696+0000 mgr.a (mgr.14373) 16983 : cluster [DBG] pgmap v11779: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-16T12:09:58.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:09:57 smithi157 bash[24585]: cluster 2024-09-16T12:09:56.641882+0000 mgr.a (mgr.14373) 16984 : cluster [DBG] pgmap v11780: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-09-16T12:09:58.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:09:57 smithi086 bash[24289]: cluster 2024-09-16T12:09:56.641882+0000 mgr.a (mgr.14373) 16984 : cluster [DBG] pgmap v11780: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-09-16T12:09:58.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:09:57 smithi047 bash[22744]: cluster 2024-09-16T12:09:56.641882+0000 mgr.a (mgr.14373) 16984 : cluster [DBG] pgmap v11780: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-09-16T12:09:58.152 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:09:58.153 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:09:58.153 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:09:58.939 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:09:58.939 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:09:58.939 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:09:58.939 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:09:58.939 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:10:00.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:09:59 smithi157 bash[24585]: audit 2024-09-16T12:09:58.487877+0000 mgr.a (mgr.14373) 16985 : audit [DBG] from='client.365475 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:10:00.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:09:59 smithi157 bash[24585]: cluster 2024-09-16T12:09:58.642640+0000 mgr.a (mgr.14373) 16986 : cluster [DBG] pgmap v11781: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:10:00.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:09:59 smithi086 bash[24289]: audit 2024-09-16T12:09:58.487877+0000 mgr.a (mgr.14373) 16985 : audit [DBG] from='client.365475 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:10:00.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:09:59 smithi086 bash[24289]: cluster 2024-09-16T12:09:58.642640+0000 mgr.a (mgr.14373) 16986 : cluster [DBG] pgmap v11781: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:10:00.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:09:59 smithi047 bash[22744]: audit 2024-09-16T12:09:58.487877+0000 mgr.a (mgr.14373) 16985 : audit [DBG] from='client.365475 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:10:00.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:09:59 smithi047 bash[22744]: cluster 2024-09-16T12:09:58.642640+0000 mgr.a (mgr.14373) 16986 : cluster [DBG] pgmap v11781: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:10:01.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:10:00 smithi157 bash[24585]: cluster 2024-09-16T12:10:00.000134+0000 mon.a (mon.0) 1578 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-16T12:10:01.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:10:00 smithi086 bash[24289]: cluster 2024-09-16T12:10:00.000134+0000 mon.a (mon.0) 1578 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-16T12:10:01.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:10:00 smithi047 bash[22744]: cluster 2024-09-16T12:10:00.000134+0000 mon.a (mon.0) 1578 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-16T12:10:02.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:10:01 smithi157 bash[24585]: cluster 2024-09-16T12:10:00.643525+0000 mgr.a (mgr.14373) 16987 : cluster [DBG] pgmap v11782: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:10:02.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:10:01 smithi086 bash[24289]: cluster 2024-09-16T12:10:00.643525+0000 mgr.a (mgr.14373) 16987 : cluster [DBG] pgmap v11782: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:10:02.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:10:01 smithi047 bash[22744]: cluster 2024-09-16T12:10:00.643525+0000 mgr.a (mgr.14373) 16987 : cluster [DBG] pgmap v11782: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:10:03.940 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:10:03.941 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:10:03.941 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:10:04.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:10:03 smithi157 bash[24585]: cluster 2024-09-16T12:10:02.645761+0000 mgr.a (mgr.14373) 16988 : cluster [DBG] pgmap v11783: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:10:04.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:10:03 smithi086 bash[24289]: cluster 2024-09-16T12:10:02.645761+0000 mgr.a (mgr.14373) 16988 : cluster [DBG] pgmap v11783: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:10:04.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:10:03 smithi047 bash[22744]: cluster 2024-09-16T12:10:02.645761+0000 mgr.a (mgr.14373) 16988 : cluster [DBG] pgmap v11783: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:10:04.716 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:10:04.716 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:10:04.716 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:10:04.717 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:10:04.717 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:10:06.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:10:05 smithi157 bash[24585]: audit 2024-09-16T12:10:04.280340+0000 mgr.a (mgr.14373) 16989 : audit [DBG] from='client.365547 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:10:06.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:10:05 smithi157 bash[24585]: cluster 2024-09-16T12:10:04.646318+0000 mgr.a (mgr.14373) 16990 : cluster [DBG] pgmap v11784: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:10:06.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:10:05 smithi086 bash[24289]: audit 2024-09-16T12:10:04.280340+0000 mgr.a (mgr.14373) 16989 : audit [DBG] from='client.365547 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:10:06.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:10:05 smithi086 bash[24289]: cluster 2024-09-16T12:10:04.646318+0000 mgr.a (mgr.14373) 16990 : cluster [DBG] pgmap v11784: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:10:06.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:10:05 smithi047 bash[22744]: audit 2024-09-16T12:10:04.280340+0000 mgr.a (mgr.14373) 16989 : audit [DBG] from='client.365547 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:10:06.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:10:05 smithi047 bash[22744]: cluster 2024-09-16T12:10:04.646318+0000 mgr.a (mgr.14373) 16990 : cluster [DBG] pgmap v11784: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:10:08.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:10:07 smithi157 bash[24585]: cluster 2024-09-16T12:10:06.648466+0000 mgr.a (mgr.14373) 16991 : cluster [DBG] pgmap v11785: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:10:08.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:10:07 smithi086 bash[24289]: cluster 2024-09-16T12:10:06.648466+0000 mgr.a (mgr.14373) 16991 : cluster [DBG] pgmap v11785: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:10:08.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:10:07 smithi047 bash[22744]: cluster 2024-09-16T12:10:06.648466+0000 mgr.a (mgr.14373) 16991 : cluster [DBG] pgmap v11785: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:10:09.718 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:10:09.718 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:10:09.718 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:10:10.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:10:09 smithi157 bash[24585]: cluster 2024-09-16T12:10:08.649222+0000 mgr.a (mgr.14373) 16992 : cluster [DBG] pgmap v11786: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:10:10.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:10:09 smithi086 bash[24289]: cluster 2024-09-16T12:10:08.649222+0000 mgr.a (mgr.14373) 16992 : cluster [DBG] pgmap v11786: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:10:10.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:10:09 smithi047 bash[22744]: cluster 2024-09-16T12:10:08.649222+0000 mgr.a (mgr.14373) 16992 : cluster [DBG] pgmap v11786: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:10:10.486 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:10:10.486 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:10:10.486 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:10:10.486 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:10:10.486 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:10:12.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:10:11 smithi157 bash[24585]: audit 2024-09-16T12:10:10.048298+0000 mgr.a (mgr.14373) 16993 : audit [DBG] from='client.365625 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:10:12.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:10:11 smithi157 bash[24585]: cluster 2024-09-16T12:10:10.650148+0000 mgr.a (mgr.14373) 16994 : cluster [DBG] pgmap v11787: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:10:12.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:10:11 smithi086 bash[24289]: audit 2024-09-16T12:10:10.048298+0000 mgr.a (mgr.14373) 16993 : audit [DBG] from='client.365625 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:10:12.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:10:11 smithi086 bash[24289]: cluster 2024-09-16T12:10:10.650148+0000 mgr.a (mgr.14373) 16994 : cluster [DBG] pgmap v11787: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:10:12.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:10:11 smithi047 bash[22744]: audit 2024-09-16T12:10:10.048298+0000 mgr.a (mgr.14373) 16993 : audit [DBG] from='client.365625 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:10:12.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:10:11 smithi047 bash[22744]: cluster 2024-09-16T12:10:10.650148+0000 mgr.a (mgr.14373) 16994 : cluster [DBG] pgmap v11787: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:10:14.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:10:13 smithi157 bash[24585]: cluster 2024-09-16T12:10:12.652423+0000 mgr.a (mgr.14373) 16995 : cluster [DBG] pgmap v11788: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:10:14.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:10:13 smithi157 bash[24585]: audit 2024-09-16T12:10:13.539699+0000 mon.b (mon.2) 1542 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T12:10:14.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:10:13 smithi086 bash[24289]: cluster 2024-09-16T12:10:12.652423+0000 mgr.a (mgr.14373) 16995 : cluster [DBG] pgmap v11788: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:10:14.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:10:13 smithi086 bash[24289]: audit 2024-09-16T12:10:13.539699+0000 mon.b (mon.2) 1542 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T12:10:14.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:10:13 smithi047 bash[22744]: cluster 2024-09-16T12:10:12.652423+0000 mgr.a (mgr.14373) 16995 : cluster [DBG] pgmap v11788: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:10:14.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:10:13 smithi047 bash[22744]: audit 2024-09-16T12:10:13.539699+0000 mon.b (mon.2) 1542 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T12:10:15.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:10:14 smithi157 bash[24585]: audit 2024-09-16T12:10:14.378100+0000 mon.b (mon.2) 1543 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T12:10:15.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:10:14 smithi157 bash[24585]: audit 2024-09-16T12:10:14.380002+0000 mon.b (mon.2) 1544 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T12:10:15.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:10:14 smithi157 bash[24585]: audit 2024-09-16T12:10:14.391609+0000 mon.a (mon.0) 1579 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:10:15.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:10:14 smithi157 bash[24585]: audit 2024-09-16T12:10:14.396907+0000 mon.b (mon.2) 1545 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:10:15.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:10:14 smithi086 bash[24289]: audit 2024-09-16T12:10:14.378100+0000 mon.b (mon.2) 1543 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T12:10:15.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:10:14 smithi086 bash[24289]: audit 2024-09-16T12:10:14.380002+0000 mon.b (mon.2) 1544 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T12:10:15.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:10:14 smithi086 bash[24289]: audit 2024-09-16T12:10:14.391609+0000 mon.a (mon.0) 1579 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:10:15.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:10:14 smithi086 bash[24289]: audit 2024-09-16T12:10:14.396907+0000 mon.b (mon.2) 1545 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:10:15.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:10:14 smithi047 bash[22744]: audit 2024-09-16T12:10:14.378100+0000 mon.b (mon.2) 1543 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T12:10:15.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:10:14 smithi047 bash[22744]: audit 2024-09-16T12:10:14.380002+0000 mon.b (mon.2) 1544 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T12:10:15.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:10:14 smithi047 bash[22744]: audit 2024-09-16T12:10:14.391609+0000 mon.a (mon.0) 1579 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:10:15.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:10:14 smithi047 bash[22744]: audit 2024-09-16T12:10:14.396907+0000 mon.b (mon.2) 1545 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:10:15.487 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:10:15.488 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:10:15.488 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:10:15.592 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 12:10:15 smithi047 bash[22994]: debug 2024-09-16T12:10:15.140+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T12:10:15.593 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 12:10:15 smithi047 bash[22994]: debug 2024-09-16T12:10:15.140+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T12:10:16.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:10:15 smithi157 bash[24585]: audit 2024-09-16T12:10:14.399506+0000 mgr.a (mgr.14373) 16996 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:10:16.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:10:15 smithi157 bash[24585]: cluster 2024-09-16T12:10:14.652954+0000 mgr.a (mgr.14373) 16997 : cluster [DBG] pgmap v11789: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:10:16.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:10:15 smithi086 bash[24289]: audit 2024-09-16T12:10:14.399506+0000 mgr.a (mgr.14373) 16996 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:10:16.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:10:15 smithi086 bash[24289]: cluster 2024-09-16T12:10:14.652954+0000 mgr.a (mgr.14373) 16997 : cluster [DBG] pgmap v11789: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:10:16.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:10:15 smithi047 bash[22744]: audit 2024-09-16T12:10:14.399506+0000 mgr.a (mgr.14373) 16996 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:10:16.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:10:15 smithi047 bash[22744]: cluster 2024-09-16T12:10:14.652954+0000 mgr.a (mgr.14373) 16997 : cluster [DBG] pgmap v11789: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:10:16.218 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:10:16.219 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:10:16.219 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:10:16.219 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:10:16.219 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:10:17.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:10:16 smithi157 bash[24585]: audit 2024-09-16T12:10:15.143138+0000 mgr.a (mgr.14373) 16998 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T12:10:17.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:10:16 smithi157 bash[24585]: cephadm 2024-09-16T12:10:15.145249+0000 mgr.a (mgr.14373) 16999 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T12:10:17.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:10:16 smithi157 bash[24585]: audit 2024-09-16T12:10:15.806655+0000 mgr.a (mgr.14373) 17000 : audit [DBG] from='client.365811 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:10:17.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:10:16 smithi086 bash[24289]: audit 2024-09-16T12:10:15.143138+0000 mgr.a (mgr.14373) 16998 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T12:10:17.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:10:16 smithi086 bash[24289]: cephadm 2024-09-16T12:10:15.145249+0000 mgr.a (mgr.14373) 16999 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T12:10:17.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:10:16 smithi086 bash[24289]: audit 2024-09-16T12:10:15.806655+0000 mgr.a (mgr.14373) 17000 : audit [DBG] from='client.365811 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:10:17.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:10:16 smithi047 bash[22744]: audit 2024-09-16T12:10:15.143138+0000 mgr.a (mgr.14373) 16998 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T12:10:17.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:10:16 smithi047 bash[22744]: cephadm 2024-09-16T12:10:15.145249+0000 mgr.a (mgr.14373) 16999 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T12:10:17.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:10:16 smithi047 bash[22744]: audit 2024-09-16T12:10:15.806655+0000 mgr.a (mgr.14373) 17000 : audit [DBG] from='client.365811 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:10:18.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:10:17 smithi157 bash[24585]: cluster 2024-09-16T12:10:16.655415+0000 mgr.a (mgr.14373) 17001 : cluster [DBG] pgmap v11790: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:10:18.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:10:17 smithi086 bash[24289]: cluster 2024-09-16T12:10:16.655415+0000 mgr.a (mgr.14373) 17001 : cluster [DBG] pgmap v11790: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:10:18.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:10:17 smithi047 bash[22744]: cluster 2024-09-16T12:10:16.655415+0000 mgr.a (mgr.14373) 17001 : cluster [DBG] pgmap v11790: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:10:20.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:10:19 smithi157 bash[24585]: cluster 2024-09-16T12:10:18.656245+0000 mgr.a (mgr.14373) 17002 : cluster [DBG] pgmap v11791: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:10:20.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:10:19 smithi086 bash[24289]: cluster 2024-09-16T12:10:18.656245+0000 mgr.a (mgr.14373) 17002 : cluster [DBG] pgmap v11791: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:10:20.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:10:19 smithi047 bash[22744]: cluster 2024-09-16T12:10:18.656245+0000 mgr.a (mgr.14373) 17002 : cluster [DBG] pgmap v11791: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:10:21.220 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:10:21.221 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:10:21.221 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:10:22.003 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:10:22.003 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:10:22.004 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:10:22.004 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:10:22.004 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:10:22.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:10:21 smithi157 bash[24585]: cluster 2024-09-16T12:10:20.656999+0000 mgr.a (mgr.14373) 17003 : cluster [DBG] pgmap v11792: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:10:22.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:10:21 smithi086 bash[24289]: cluster 2024-09-16T12:10:20.656999+0000 mgr.a (mgr.14373) 17003 : cluster [DBG] pgmap v11792: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:10:22.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:10:21 smithi047 bash[22744]: cluster 2024-09-16T12:10:20.656999+0000 mgr.a (mgr.14373) 17003 : cluster [DBG] pgmap v11792: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:10:23.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:10:22 smithi157 bash[24585]: audit 2024-09-16T12:10:21.555024+0000 mgr.a (mgr.14373) 17004 : audit [DBG] from='client.365886 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:10:23.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:10:22 smithi086 bash[24289]: audit 2024-09-16T12:10:21.555024+0000 mgr.a (mgr.14373) 17004 : audit [DBG] from='client.365886 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:10:23.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:10:22 smithi047 bash[22744]: audit 2024-09-16T12:10:21.555024+0000 mgr.a (mgr.14373) 17004 : audit [DBG] from='client.365886 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:10:24.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:10:23 smithi086 bash[24289]: cluster 2024-09-16T12:10:22.659856+0000 mgr.a (mgr.14373) 17005 : cluster [DBG] pgmap v11793: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:10:24.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:10:23 smithi047 bash[22744]: cluster 2024-09-16T12:10:22.659856+0000 mgr.a (mgr.14373) 17005 : cluster [DBG] pgmap v11793: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:10:24.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:10:23 smithi157 bash[24585]: cluster 2024-09-16T12:10:22.659856+0000 mgr.a (mgr.14373) 17005 : cluster [DBG] pgmap v11793: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:10:26.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:10:25 smithi086 bash[24289]: cluster 2024-09-16T12:10:24.660646+0000 mgr.a (mgr.14373) 17006 : cluster [DBG] pgmap v11794: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T12:10:26.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:10:25 smithi047 bash[22744]: cluster 2024-09-16T12:10:24.660646+0000 mgr.a (mgr.14373) 17006 : cluster [DBG] pgmap v11794: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T12:10:26.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:10:25 smithi157 bash[24585]: cluster 2024-09-16T12:10:24.660646+0000 mgr.a (mgr.14373) 17006 : cluster [DBG] pgmap v11794: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T12:10:27.005 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:10:27.006 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:10:27.006 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:10:27.789 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:10:27.789 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:10:27.789 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:10:27.789 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:10:27.790 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:10:28.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:10:27 smithi086 bash[24289]: cluster 2024-09-16T12:10:26.662595+0000 mgr.a (mgr.14373) 17007 : cluster [DBG] pgmap v11795: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:10:28.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:10:27 smithi047 bash[22744]: cluster 2024-09-16T12:10:26.662595+0000 mgr.a (mgr.14373) 17007 : cluster [DBG] pgmap v11795: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:10:28.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:10:27 smithi157 bash[24585]: cluster 2024-09-16T12:10:26.662595+0000 mgr.a (mgr.14373) 17007 : cluster [DBG] pgmap v11795: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:10:29.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:10:28 smithi086 bash[24289]: audit 2024-09-16T12:10:27.343088+0000 mgr.a (mgr.14373) 17008 : audit [DBG] from='client.365964 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:10:29.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:10:28 smithi047 bash[22744]: audit 2024-09-16T12:10:27.343088+0000 mgr.a (mgr.14373) 17008 : audit [DBG] from='client.365964 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:10:29.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:10:28 smithi157 bash[24585]: audit 2024-09-16T12:10:27.343088+0000 mgr.a (mgr.14373) 17008 : audit [DBG] from='client.365964 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:10:30.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:10:29 smithi047 bash[22744]: cluster 2024-09-16T12:10:28.663494+0000 mgr.a (mgr.14373) 17009 : cluster [DBG] pgmap v11796: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:10:30.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:10:29 smithi157 bash[24585]: cluster 2024-09-16T12:10:28.663494+0000 mgr.a (mgr.14373) 17009 : cluster [DBG] pgmap v11796: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:10:30.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:10:29 smithi086 bash[24289]: cluster 2024-09-16T12:10:28.663494+0000 mgr.a (mgr.14373) 17009 : cluster [DBG] pgmap v11796: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:10:32.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:10:31 smithi047 bash[22744]: cluster 2024-09-16T12:10:30.664276+0000 mgr.a (mgr.14373) 17010 : cluster [DBG] pgmap v11797: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T12:10:32.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:10:31 smithi157 bash[24585]: cluster 2024-09-16T12:10:30.664276+0000 mgr.a (mgr.14373) 17010 : cluster [DBG] pgmap v11797: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T12:10:32.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:10:31 smithi086 bash[24289]: cluster 2024-09-16T12:10:30.664276+0000 mgr.a (mgr.14373) 17010 : cluster [DBG] pgmap v11797: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T12:10:32.791 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:10:32.792 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:10:32.792 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:10:33.568 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:10:33.568 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:10:33.569 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:10:33.569 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:10:33.569 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:10:34.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:10:33 smithi047 bash[22744]: cluster 2024-09-16T12:10:32.666523+0000 mgr.a (mgr.14373) 17011 : cluster [DBG] pgmap v11798: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:10:34.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:10:33 smithi157 bash[24585]: cluster 2024-09-16T12:10:32.666523+0000 mgr.a (mgr.14373) 17011 : cluster [DBG] pgmap v11798: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:10:34.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:10:33 smithi086 bash[24289]: cluster 2024-09-16T12:10:32.666523+0000 mgr.a (mgr.14373) 17011 : cluster [DBG] pgmap v11798: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:10:35.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:10:34 smithi157 bash[24585]: audit 2024-09-16T12:10:33.125900+0000 mgr.a (mgr.14373) 17012 : audit [DBG] from='client.366039 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:10:35.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:10:34 smithi086 bash[24289]: audit 2024-09-16T12:10:33.125900+0000 mgr.a (mgr.14373) 17012 : audit [DBG] from='client.366039 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:10:35.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:10:34 smithi047 bash[22744]: audit 2024-09-16T12:10:33.125900+0000 mgr.a (mgr.14373) 17012 : audit [DBG] from='client.366039 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:10:36.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:10:35 smithi157 bash[24585]: cluster 2024-09-16T12:10:34.667406+0000 mgr.a (mgr.14373) 17013 : cluster [DBG] pgmap v11799: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:10:36.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:10:35 smithi086 bash[24289]: cluster 2024-09-16T12:10:34.667406+0000 mgr.a (mgr.14373) 17013 : cluster [DBG] pgmap v11799: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:10:36.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:10:35 smithi047 bash[22744]: cluster 2024-09-16T12:10:34.667406+0000 mgr.a (mgr.14373) 17013 : cluster [DBG] pgmap v11799: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:10:37.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:10:36 smithi157 bash[24585]: cluster 2024-09-16T12:10:36.669543+0000 mgr.a (mgr.14373) 17014 : cluster [DBG] pgmap v11800: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:10:37.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:10:36 smithi086 bash[24289]: cluster 2024-09-16T12:10:36.669543+0000 mgr.a (mgr.14373) 17014 : cluster [DBG] pgmap v11800: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:10:37.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:10:36 smithi047 bash[22744]: cluster 2024-09-16T12:10:36.669543+0000 mgr.a (mgr.14373) 17014 : cluster [DBG] pgmap v11800: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:10:38.570 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:10:38.571 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:10:38.571 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:10:39.302 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:10:39.302 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:10:39.302 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:10:39.302 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:10:39.302 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:10:40.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:10:39 smithi157 bash[24585]: cluster 2024-09-16T12:10:38.669966+0000 mgr.a (mgr.14373) 17015 : cluster [DBG] pgmap v11801: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:10:40.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:10:39 smithi086 bash[24289]: cluster 2024-09-16T12:10:38.669966+0000 mgr.a (mgr.14373) 17015 : cluster [DBG] pgmap v11801: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:10:40.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:10:39 smithi047 bash[22744]: cluster 2024-09-16T12:10:38.669966+0000 mgr.a (mgr.14373) 17015 : cluster [DBG] pgmap v11801: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:10:41.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:10:40 smithi157 bash[24585]: audit 2024-09-16T12:10:38.896019+0000 mgr.a (mgr.14373) 17016 : audit [DBG] from='client.366117 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:10:41.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:10:40 smithi086 bash[24289]: audit 2024-09-16T12:10:38.896019+0000 mgr.a (mgr.14373) 17016 : audit [DBG] from='client.366117 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:10:41.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:10:40 smithi047 bash[22744]: audit 2024-09-16T12:10:38.896019+0000 mgr.a (mgr.14373) 17016 : audit [DBG] from='client.366117 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:10:42.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:10:41 smithi157 bash[24585]: cluster 2024-09-16T12:10:40.670827+0000 mgr.a (mgr.14373) 17017 : cluster [DBG] pgmap v11802: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:10:42.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:10:41 smithi086 bash[24289]: cluster 2024-09-16T12:10:40.670827+0000 mgr.a (mgr.14373) 17017 : cluster [DBG] pgmap v11802: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:10:42.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:10:41 smithi047 bash[22744]: cluster 2024-09-16T12:10:40.670827+0000 mgr.a (mgr.14373) 17017 : cluster [DBG] pgmap v11802: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:10:43.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:10:42 smithi157 bash[24585]: cluster 2024-09-16T12:10:42.673062+0000 mgr.a (mgr.14373) 17018 : cluster [DBG] pgmap v11803: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:10:43.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:10:42 smithi086 bash[24289]: cluster 2024-09-16T12:10:42.673062+0000 mgr.a (mgr.14373) 17018 : cluster [DBG] pgmap v11803: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:10:43.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:10:42 smithi047 bash[22744]: cluster 2024-09-16T12:10:42.673062+0000 mgr.a (mgr.14373) 17018 : cluster [DBG] pgmap v11803: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:10:44.304 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:10:44.305 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:10:44.305 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:10:45.082 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:10:45.083 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:10:45.083 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:10:45.083 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:10:45.083 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:10:46.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:10:45 smithi157 bash[24585]: audit 2024-09-16T12:10:44.638979+0000 mgr.a (mgr.14373) 17019 : audit [DBG] from='client.366195 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:10:46.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:10:45 smithi157 bash[24585]: cluster 2024-09-16T12:10:44.673735+0000 mgr.a (mgr.14373) 17020 : cluster [DBG] pgmap v11804: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:10:46.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:10:45 smithi086 bash[24289]: audit 2024-09-16T12:10:44.638979+0000 mgr.a (mgr.14373) 17019 : audit [DBG] from='client.366195 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:10:46.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:10:45 smithi086 bash[24289]: cluster 2024-09-16T12:10:44.673735+0000 mgr.a (mgr.14373) 17020 : cluster [DBG] pgmap v11804: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:10:46.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:10:45 smithi047 bash[22744]: audit 2024-09-16T12:10:44.638979+0000 mgr.a (mgr.14373) 17019 : audit [DBG] from='client.366195 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:10:46.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:10:45 smithi047 bash[22744]: cluster 2024-09-16T12:10:44.673735+0000 mgr.a (mgr.14373) 17020 : cluster [DBG] pgmap v11804: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:10:48.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:10:47 smithi157 bash[24585]: cluster 2024-09-16T12:10:46.676162+0000 mgr.a (mgr.14373) 17021 : cluster [DBG] pgmap v11805: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:10:48.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:10:47 smithi086 bash[24289]: cluster 2024-09-16T12:10:46.676162+0000 mgr.a (mgr.14373) 17021 : cluster [DBG] pgmap v11805: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:10:48.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:10:47 smithi047 bash[22744]: cluster 2024-09-16T12:10:46.676162+0000 mgr.a (mgr.14373) 17021 : cluster [DBG] pgmap v11805: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:10:50.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:10:49 smithi157 bash[24585]: cluster 2024-09-16T12:10:48.677087+0000 mgr.a (mgr.14373) 17022 : cluster [DBG] pgmap v11806: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:10:50.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:10:49 smithi086 bash[24289]: cluster 2024-09-16T12:10:48.677087+0000 mgr.a (mgr.14373) 17022 : cluster [DBG] pgmap v11806: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:10:50.084 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:10:50.084 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:10:50.085 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:10:50.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:10:49 smithi047 bash[22744]: cluster 2024-09-16T12:10:48.677087+0000 mgr.a (mgr.14373) 17022 : cluster [DBG] pgmap v11806: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:10:50.864 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:10:50.864 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:10:50.864 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:10:50.865 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:10:50.865 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:10:52.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:10:51 smithi157 bash[24585]: audit 2024-09-16T12:10:50.417840+0000 mgr.a (mgr.14373) 17023 : audit [DBG] from='client.366273 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:10:52.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:10:51 smithi157 bash[24585]: cluster 2024-09-16T12:10:50.677665+0000 mgr.a (mgr.14373) 17024 : cluster [DBG] pgmap v11807: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:10:52.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:10:51 smithi086 bash[24289]: audit 2024-09-16T12:10:50.417840+0000 mgr.a (mgr.14373) 17023 : audit [DBG] from='client.366273 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:10:52.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:10:51 smithi086 bash[24289]: cluster 2024-09-16T12:10:50.677665+0000 mgr.a (mgr.14373) 17024 : cluster [DBG] pgmap v11807: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:10:52.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:10:51 smithi047 bash[22744]: audit 2024-09-16T12:10:50.417840+0000 mgr.a (mgr.14373) 17023 : audit [DBG] from='client.366273 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:10:52.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:10:51 smithi047 bash[22744]: cluster 2024-09-16T12:10:50.677665+0000 mgr.a (mgr.14373) 17024 : cluster [DBG] pgmap v11807: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:10:54.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:10:53 smithi157 bash[24585]: cluster 2024-09-16T12:10:52.680044+0000 mgr.a (mgr.14373) 17025 : cluster [DBG] pgmap v11808: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:10:54.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:10:53 smithi086 bash[24289]: cluster 2024-09-16T12:10:52.680044+0000 mgr.a (mgr.14373) 17025 : cluster [DBG] pgmap v11808: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:10:54.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:10:53 smithi047 bash[22744]: cluster 2024-09-16T12:10:52.680044+0000 mgr.a (mgr.14373) 17025 : cluster [DBG] pgmap v11808: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:10:55.866 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:10:55.866 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:10:55.866 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:10:56.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:10:55 smithi157 bash[24585]: cluster 2024-09-16T12:10:54.680818+0000 mgr.a (mgr.14373) 17026 : cluster [DBG] pgmap v11809: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:10:56.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:10:55 smithi086 bash[24289]: cluster 2024-09-16T12:10:54.680818+0000 mgr.a (mgr.14373) 17026 : cluster [DBG] pgmap v11809: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:10:56.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:10:55 smithi047 bash[22744]: cluster 2024-09-16T12:10:54.680818+0000 mgr.a (mgr.14373) 17026 : cluster [DBG] pgmap v11809: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:10:56.617 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:10:56.617 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:10:56.617 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:10:56.617 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:10:56.617 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:10:58.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:10:57 smithi157 bash[24585]: audit 2024-09-16T12:10:56.194726+0000 mgr.a (mgr.14373) 17027 : audit [DBG] from='client.366351 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:10:58.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:10:57 smithi157 bash[24585]: cluster 2024-09-16T12:10:56.682162+0000 mgr.a (mgr.14373) 17028 : cluster [DBG] pgmap v11810: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-16T12:10:58.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:10:57 smithi086 bash[24289]: audit 2024-09-16T12:10:56.194726+0000 mgr.a (mgr.14373) 17027 : audit [DBG] from='client.366351 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:10:58.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:10:57 smithi086 bash[24289]: cluster 2024-09-16T12:10:56.682162+0000 mgr.a (mgr.14373) 17028 : cluster [DBG] pgmap v11810: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-16T12:10:58.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:10:57 smithi047 bash[22744]: audit 2024-09-16T12:10:56.194726+0000 mgr.a (mgr.14373) 17027 : audit [DBG] from='client.366351 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:10:58.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:10:57 smithi047 bash[22744]: cluster 2024-09-16T12:10:56.682162+0000 mgr.a (mgr.14373) 17028 : cluster [DBG] pgmap v11810: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-16T12:11:00.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:10:59 smithi157 bash[24585]: cluster 2024-09-16T12:10:58.682922+0000 mgr.a (mgr.14373) 17029 : cluster [DBG] pgmap v11811: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-16T12:11:00.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:10:59 smithi086 bash[24289]: cluster 2024-09-16T12:10:58.682922+0000 mgr.a (mgr.14373) 17029 : cluster [DBG] pgmap v11811: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-16T12:11:00.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:10:59 smithi047 bash[22744]: cluster 2024-09-16T12:10:58.682922+0000 mgr.a (mgr.14373) 17029 : cluster [DBG] pgmap v11811: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-16T12:11:01.618 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:11:01.619 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:11:01.620 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:11:02.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:11:01 smithi157 bash[24585]: cluster 2024-09-16T12:11:00.683828+0000 mgr.a (mgr.14373) 17030 : cluster [DBG] pgmap v11812: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-16T12:11:02.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:11:01 smithi086 bash[24289]: cluster 2024-09-16T12:11:00.683828+0000 mgr.a (mgr.14373) 17030 : cluster [DBG] pgmap v11812: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-16T12:11:02.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:11:01 smithi047 bash[22744]: cluster 2024-09-16T12:11:00.683828+0000 mgr.a (mgr.14373) 17030 : cluster [DBG] pgmap v11812: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-16T12:11:02.394 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:11:02.394 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:11:02.394 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:11:02.394 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:11:02.395 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:11:04.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:11:03 smithi157 bash[24585]: audit 2024-09-16T12:11:01.955549+0000 mgr.a (mgr.14373) 17031 : audit [DBG] from='client.366426 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:11:04.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:11:03 smithi157 bash[24585]: cluster 2024-09-16T12:11:02.686681+0000 mgr.a (mgr.14373) 17032 : cluster [DBG] pgmap v11813: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:11:04.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:11:03 smithi086 bash[24289]: audit 2024-09-16T12:11:01.955549+0000 mgr.a (mgr.14373) 17031 : audit [DBG] from='client.366426 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:11:04.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:11:03 smithi086 bash[24289]: cluster 2024-09-16T12:11:02.686681+0000 mgr.a (mgr.14373) 17032 : cluster [DBG] pgmap v11813: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:11:04.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:11:03 smithi047 bash[22744]: audit 2024-09-16T12:11:01.955549+0000 mgr.a (mgr.14373) 17031 : audit [DBG] from='client.366426 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:11:04.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:11:03 smithi047 bash[22744]: cluster 2024-09-16T12:11:02.686681+0000 mgr.a (mgr.14373) 17032 : cluster [DBG] pgmap v11813: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:11:06.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:11:05 smithi157 bash[24585]: cluster 2024-09-16T12:11:04.687461+0000 mgr.a (mgr.14373) 17033 : cluster [DBG] pgmap v11814: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:11:06.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:11:05 smithi086 bash[24289]: cluster 2024-09-16T12:11:04.687461+0000 mgr.a (mgr.14373) 17033 : cluster [DBG] pgmap v11814: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:11:06.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:11:05 smithi047 bash[22744]: cluster 2024-09-16T12:11:04.687461+0000 mgr.a (mgr.14373) 17033 : cluster [DBG] pgmap v11814: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:11:07.396 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:11:07.397 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:11:07.397 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:11:08.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:11:07 smithi157 bash[24585]: cluster 2024-09-16T12:11:06.689365+0000 mgr.a (mgr.14373) 17034 : cluster [DBG] pgmap v11815: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:11:08.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:11:07 smithi086 bash[24289]: cluster 2024-09-16T12:11:06.689365+0000 mgr.a (mgr.14373) 17034 : cluster [DBG] pgmap v11815: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:11:08.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:11:07 smithi047 bash[22744]: cluster 2024-09-16T12:11:06.689365+0000 mgr.a (mgr.14373) 17034 : cluster [DBG] pgmap v11815: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:11:08.185 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:11:08.186 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:11:08.186 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:11:08.186 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:11:08.186 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:11:09.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:11:08 smithi157 bash[24585]: audit 2024-09-16T12:11:07.730748+0000 mgr.a (mgr.14373) 17035 : audit [DBG] from='client.366504 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:11:09.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:11:08 smithi086 bash[24289]: audit 2024-09-16T12:11:07.730748+0000 mgr.a (mgr.14373) 17035 : audit [DBG] from='client.366504 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:11:09.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:11:08 smithi047 bash[22744]: audit 2024-09-16T12:11:07.730748+0000 mgr.a (mgr.14373) 17035 : audit [DBG] from='client.366504 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:11:10.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:11:09 smithi157 bash[24585]: cluster 2024-09-16T12:11:08.690277+0000 mgr.a (mgr.14373) 17036 : cluster [DBG] pgmap v11816: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-16T12:11:10.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:11:09 smithi086 bash[24289]: cluster 2024-09-16T12:11:08.690277+0000 mgr.a (mgr.14373) 17036 : cluster [DBG] pgmap v11816: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-16T12:11:10.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:11:09 smithi047 bash[22744]: cluster 2024-09-16T12:11:08.690277+0000 mgr.a (mgr.14373) 17036 : cluster [DBG] pgmap v11816: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-16T12:11:12.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:11:11 smithi157 bash[24585]: cluster 2024-09-16T12:11:10.691075+0000 mgr.a (mgr.14373) 17037 : cluster [DBG] pgmap v11817: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-16T12:11:12.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:11:11 smithi086 bash[24289]: cluster 2024-09-16T12:11:10.691075+0000 mgr.a (mgr.14373) 17037 : cluster [DBG] pgmap v11817: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-16T12:11:12.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:11:11 smithi047 bash[22744]: cluster 2024-09-16T12:11:10.691075+0000 mgr.a (mgr.14373) 17037 : cluster [DBG] pgmap v11817: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-16T12:11:13.187 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:11:13.188 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:11:13.188 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:11:13.933 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:11:13.934 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:11:13.934 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:11:13.934 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:11:13.934 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:11:14.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:11:13 smithi157 bash[24585]: cluster 2024-09-16T12:11:12.693290+0000 mgr.a (mgr.14373) 17038 : cluster [DBG] pgmap v11818: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-09-16T12:11:14.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:11:13 smithi047 bash[22744]: cluster 2024-09-16T12:11:12.693290+0000 mgr.a (mgr.14373) 17038 : cluster [DBG] pgmap v11818: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-09-16T12:11:14.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:11:13 smithi086 bash[24289]: cluster 2024-09-16T12:11:12.693290+0000 mgr.a (mgr.14373) 17038 : cluster [DBG] pgmap v11818: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-09-16T12:11:15.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:11:14 smithi086 bash[24289]: audit 2024-09-16T12:11:13.522028+0000 mgr.a (mgr.14373) 17039 : audit [DBG] from='client.366582 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:11:15.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:11:14 smithi047 bash[22744]: audit 2024-09-16T12:11:13.522028+0000 mgr.a (mgr.14373) 17039 : audit [DBG] from='client.366582 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:11:15.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:11:14 smithi157 bash[24585]: audit 2024-09-16T12:11:13.522028+0000 mgr.a (mgr.14373) 17039 : audit [DBG] from='client.366582 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:11:16.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:11:15 smithi086 bash[24289]: cluster 2024-09-16T12:11:14.694217+0000 mgr.a (mgr.14373) 17040 : cluster [DBG] pgmap v11819: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:11:16.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:11:15 smithi086 bash[24289]: audit 2024-09-16T12:11:15.195300+0000 mon.b (mon.2) 1546 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T12:11:16.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:11:15 smithi047 bash[22744]: cluster 2024-09-16T12:11:14.694217+0000 mgr.a (mgr.14373) 17040 : cluster [DBG] pgmap v11819: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:11:16.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:11:15 smithi047 bash[22744]: audit 2024-09-16T12:11:15.195300+0000 mon.b (mon.2) 1546 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T12:11:16.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:11:15 smithi157 bash[24585]: cluster 2024-09-16T12:11:14.694217+0000 mgr.a (mgr.14373) 17040 : cluster [DBG] pgmap v11819: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:11:16.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:11:15 smithi157 bash[24585]: audit 2024-09-16T12:11:15.195300+0000 mon.b (mon.2) 1546 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T12:11:17.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:11:16 smithi086 bash[24289]: audit 2024-09-16T12:11:16.007796+0000 mon.b (mon.2) 1547 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T12:11:17.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:11:16 smithi086 bash[24289]: audit 2024-09-16T12:11:16.009873+0000 mon.b (mon.2) 1548 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T12:11:17.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:11:16 smithi086 bash[24289]: audit 2024-09-16T12:11:16.021064+0000 mon.a (mon.0) 1580 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:11:17.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:11:16 smithi086 bash[24289]: audit 2024-09-16T12:11:16.026539+0000 mon.b (mon.2) 1549 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:11:17.092 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 12:11:16 smithi047 bash[22994]: debug 2024-09-16T12:11:16.790+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T12:11:17.093 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 12:11:16 smithi047 bash[22994]: debug 2024-09-16T12:11:16.790+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T12:11:17.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:11:16 smithi047 bash[22744]: audit 2024-09-16T12:11:16.007796+0000 mon.b (mon.2) 1547 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T12:11:17.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:11:16 smithi047 bash[22744]: audit 2024-09-16T12:11:16.009873+0000 mon.b (mon.2) 1548 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T12:11:17.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:11:16 smithi047 bash[22744]: audit 2024-09-16T12:11:16.021064+0000 mon.a (mon.0) 1580 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:11:17.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:11:16 smithi047 bash[22744]: audit 2024-09-16T12:11:16.026539+0000 mon.b (mon.2) 1549 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:11:17.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:11:16 smithi157 bash[24585]: audit 2024-09-16T12:11:16.007796+0000 mon.b (mon.2) 1547 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T12:11:17.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:11:16 smithi157 bash[24585]: audit 2024-09-16T12:11:16.009873+0000 mon.b (mon.2) 1548 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T12:11:17.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:11:16 smithi157 bash[24585]: audit 2024-09-16T12:11:16.021064+0000 mon.a (mon.0) 1580 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:11:17.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:11:16 smithi157 bash[24585]: audit 2024-09-16T12:11:16.026539+0000 mon.b (mon.2) 1549 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:11:18.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:11:17 smithi086 bash[24289]: audit 2024-09-16T12:11:16.029240+0000 mgr.a (mgr.14373) 17041 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:11:18.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:11:17 smithi086 bash[24289]: cluster 2024-09-16T12:11:16.696086+0000 mgr.a (mgr.14373) 17042 : cluster [DBG] pgmap v11820: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 4.6 KiB/s rd, 255 B/s wr, 4 op/s 2024-09-16T12:11:18.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:11:17 smithi086 bash[24289]: audit 2024-09-16T12:11:16.795341+0000 mgr.a (mgr.14373) 17043 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T12:11:18.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:11:17 smithi086 bash[24289]: cephadm 2024-09-16T12:11:16.797560+0000 mgr.a (mgr.14373) 17044 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T12:11:18.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:11:17 smithi047 bash[22744]: audit 2024-09-16T12:11:16.029240+0000 mgr.a (mgr.14373) 17041 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:11:18.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:11:17 smithi047 bash[22744]: cluster 2024-09-16T12:11:16.696086+0000 mgr.a (mgr.14373) 17042 : cluster [DBG] pgmap v11820: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 4.6 KiB/s rd, 255 B/s wr, 4 op/s 2024-09-16T12:11:18.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:11:17 smithi047 bash[22744]: audit 2024-09-16T12:11:16.795341+0000 mgr.a (mgr.14373) 17043 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T12:11:18.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:11:17 smithi047 bash[22744]: cephadm 2024-09-16T12:11:16.797560+0000 mgr.a (mgr.14373) 17044 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T12:11:18.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:11:17 smithi157 bash[24585]: audit 2024-09-16T12:11:16.029240+0000 mgr.a (mgr.14373) 17041 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:11:18.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:11:17 smithi157 bash[24585]: cluster 2024-09-16T12:11:16.696086+0000 mgr.a (mgr.14373) 17042 : cluster [DBG] pgmap v11820: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 4.6 KiB/s rd, 255 B/s wr, 4 op/s 2024-09-16T12:11:18.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:11:17 smithi157 bash[24585]: audit 2024-09-16T12:11:16.795341+0000 mgr.a (mgr.14373) 17043 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T12:11:18.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:11:17 smithi157 bash[24585]: cephadm 2024-09-16T12:11:16.797560+0000 mgr.a (mgr.14373) 17044 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T12:11:18.935 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:11:18.936 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:11:18.936 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:11:19.705 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:11:19.705 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:11:19.705 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:11:19.706 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:11:19.706 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:11:20.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:11:19 smithi047 bash[22744]: cluster 2024-09-16T12:11:18.696826+0000 mgr.a (mgr.14373) 17045 : cluster [DBG] pgmap v11821: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 3.7 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-16T12:11:20.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:11:19 smithi157 bash[24585]: cluster 2024-09-16T12:11:18.696826+0000 mgr.a (mgr.14373) 17045 : cluster [DBG] pgmap v11821: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 3.7 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-16T12:11:20.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:11:19 smithi086 bash[24289]: cluster 2024-09-16T12:11:18.696826+0000 mgr.a (mgr.14373) 17045 : cluster [DBG] pgmap v11821: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 3.7 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-16T12:11:21.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:11:20 smithi047 bash[22744]: audit 2024-09-16T12:11:19.274289+0000 mgr.a (mgr.14373) 17046 : audit [DBG] from='client.366765 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:11:21.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:11:20 smithi157 bash[24585]: audit 2024-09-16T12:11:19.274289+0000 mgr.a (mgr.14373) 17046 : audit [DBG] from='client.366765 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:11:21.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:11:20 smithi086 bash[24289]: audit 2024-09-16T12:11:19.274289+0000 mgr.a (mgr.14373) 17046 : audit [DBG] from='client.366765 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:11:22.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:11:21 smithi047 bash[22744]: cluster 2024-09-16T12:11:20.697871+0000 mgr.a (mgr.14373) 17047 : cluster [DBG] pgmap v11822: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 3.7 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-16T12:11:22.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:11:21 smithi157 bash[24585]: cluster 2024-09-16T12:11:20.697871+0000 mgr.a (mgr.14373) 17047 : cluster [DBG] pgmap v11822: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 3.7 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-16T12:11:22.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:11:21 smithi086 bash[24289]: cluster 2024-09-16T12:11:20.697871+0000 mgr.a (mgr.14373) 17047 : cluster [DBG] pgmap v11822: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 3.7 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-16T12:11:24.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:11:23 smithi047 bash[22744]: cluster 2024-09-16T12:11:22.700154+0000 mgr.a (mgr.14373) 17048 : cluster [DBG] pgmap v11823: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:11:24.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:11:23 smithi157 bash[24585]: cluster 2024-09-16T12:11:22.700154+0000 mgr.a (mgr.14373) 17048 : cluster [DBG] pgmap v11823: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:11:24.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:11:23 smithi086 bash[24289]: cluster 2024-09-16T12:11:22.700154+0000 mgr.a (mgr.14373) 17048 : cluster [DBG] pgmap v11823: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:11:24.707 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:11:24.707 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:11:24.708 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:11:25.481 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:11:25.481 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:11:25.481 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:11:25.481 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:11:25.482 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:11:26.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:11:25 smithi047 bash[22744]: cluster 2024-09-16T12:11:24.700973+0000 mgr.a (mgr.14373) 17049 : cluster [DBG] pgmap v11824: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:11:26.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:11:25 smithi157 bash[24585]: cluster 2024-09-16T12:11:24.700973+0000 mgr.a (mgr.14373) 17049 : cluster [DBG] pgmap v11824: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:11:26.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:11:25 smithi086 bash[24289]: cluster 2024-09-16T12:11:24.700973+0000 mgr.a (mgr.14373) 17049 : cluster [DBG] pgmap v11824: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:11:27.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:11:26 smithi157 bash[24585]: audit 2024-09-16T12:11:25.043739+0000 mgr.a (mgr.14373) 17050 : audit [DBG] from='client.366843 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:11:27.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:11:26 smithi086 bash[24289]: audit 2024-09-16T12:11:25.043739+0000 mgr.a (mgr.14373) 17050 : audit [DBG] from='client.366843 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:11:27.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:11:26 smithi047 bash[22744]: audit 2024-09-16T12:11:25.043739+0000 mgr.a (mgr.14373) 17050 : audit [DBG] from='client.366843 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:11:28.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:11:27 smithi157 bash[24585]: cluster 2024-09-16T12:11:26.703245+0000 mgr.a (mgr.14373) 17051 : cluster [DBG] pgmap v11825: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:11:28.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:11:27 smithi086 bash[24289]: cluster 2024-09-16T12:11:26.703245+0000 mgr.a (mgr.14373) 17051 : cluster [DBG] pgmap v11825: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:11:28.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:11:27 smithi047 bash[22744]: cluster 2024-09-16T12:11:26.703245+0000 mgr.a (mgr.14373) 17051 : cluster [DBG] pgmap v11825: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:11:30.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:11:29 smithi157 bash[24585]: cluster 2024-09-16T12:11:28.704024+0000 mgr.a (mgr.14373) 17052 : cluster [DBG] pgmap v11826: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 5.2 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-16T12:11:30.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:11:29 smithi086 bash[24289]: cluster 2024-09-16T12:11:28.704024+0000 mgr.a (mgr.14373) 17052 : cluster [DBG] pgmap v11826: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 5.2 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-16T12:11:30.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:11:29 smithi047 bash[22744]: cluster 2024-09-16T12:11:28.704024+0000 mgr.a (mgr.14373) 17052 : cluster [DBG] pgmap v11826: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 5.2 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-16T12:11:30.483 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:11:30.483 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:11:30.483 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:11:31.250 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:11:31.250 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:11:31.250 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:11:31.250 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:11:31.251 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:11:32.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:11:31 smithi157 bash[24585]: cluster 2024-09-16T12:11:30.704541+0000 mgr.a (mgr.14373) 17053 : cluster [DBG] pgmap v11827: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 5.2 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-16T12:11:32.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:11:31 smithi157 bash[24585]: audit 2024-09-16T12:11:30.809845+0000 mgr.a (mgr.14373) 17054 : audit [DBG] from='client.366918 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:11:32.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:11:31 smithi086 bash[24289]: cluster 2024-09-16T12:11:30.704541+0000 mgr.a (mgr.14373) 17053 : cluster [DBG] pgmap v11827: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 5.2 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-16T12:11:32.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:11:31 smithi086 bash[24289]: audit 2024-09-16T12:11:30.809845+0000 mgr.a (mgr.14373) 17054 : audit [DBG] from='client.366918 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:11:32.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:11:31 smithi047 bash[22744]: cluster 2024-09-16T12:11:30.704541+0000 mgr.a (mgr.14373) 17053 : cluster [DBG] pgmap v11827: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 5.2 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-16T12:11:32.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:11:31 smithi047 bash[22744]: audit 2024-09-16T12:11:30.809845+0000 mgr.a (mgr.14373) 17054 : audit [DBG] from='client.366918 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:11:33.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:11:32 smithi157 bash[24585]: cluster 2024-09-16T12:11:32.706865+0000 mgr.a (mgr.14373) 17055 : cluster [DBG] pgmap v11828: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-16T12:11:33.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:11:32 smithi086 bash[24289]: cluster 2024-09-16T12:11:32.706865+0000 mgr.a (mgr.14373) 17055 : cluster [DBG] pgmap v11828: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-16T12:11:33.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:11:32 smithi047 bash[22744]: cluster 2024-09-16T12:11:32.706865+0000 mgr.a (mgr.14373) 17055 : cluster [DBG] pgmap v11828: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-16T12:11:36.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:11:35 smithi157 bash[24585]: cluster 2024-09-16T12:11:34.707632+0000 mgr.a (mgr.14373) 17056 : cluster [DBG] pgmap v11829: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:11:36.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:11:35 smithi086 bash[24289]: cluster 2024-09-16T12:11:34.707632+0000 mgr.a (mgr.14373) 17056 : cluster [DBG] pgmap v11829: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:11:36.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:11:35 smithi047 bash[22744]: cluster 2024-09-16T12:11:34.707632+0000 mgr.a (mgr.14373) 17056 : cluster [DBG] pgmap v11829: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:11:36.251 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:11:36.252 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:11:36.252 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:11:37.002 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:11:37.003 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:11:37.003 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:11:37.003 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:11:37.003 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:11:38.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:11:37 smithi157 bash[24585]: audit 2024-09-16T12:11:36.579256+0000 mgr.a (mgr.14373) 17057 : audit [DBG] from='client.366996 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:11:38.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:11:37 smithi157 bash[24585]: cluster 2024-09-16T12:11:36.709443+0000 mgr.a (mgr.14373) 17058 : cluster [DBG] pgmap v11830: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:11:38.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:11:37 smithi086 bash[24289]: audit 2024-09-16T12:11:36.579256+0000 mgr.a (mgr.14373) 17057 : audit [DBG] from='client.366996 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:11:38.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:11:37 smithi086 bash[24289]: cluster 2024-09-16T12:11:36.709443+0000 mgr.a (mgr.14373) 17058 : cluster [DBG] pgmap v11830: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:11:38.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:11:37 smithi047 bash[22744]: audit 2024-09-16T12:11:36.579256+0000 mgr.a (mgr.14373) 17057 : audit [DBG] from='client.366996 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:11:38.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:11:37 smithi047 bash[22744]: cluster 2024-09-16T12:11:36.709443+0000 mgr.a (mgr.14373) 17058 : cluster [DBG] pgmap v11830: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:11:40.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:11:39 smithi157 bash[24585]: cluster 2024-09-16T12:11:38.710304+0000 mgr.a (mgr.14373) 17059 : cluster [DBG] pgmap v11831: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T12:11:40.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:11:39 smithi086 bash[24289]: cluster 2024-09-16T12:11:38.710304+0000 mgr.a (mgr.14373) 17059 : cluster [DBG] pgmap v11831: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T12:11:40.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:11:39 smithi047 bash[22744]: cluster 2024-09-16T12:11:38.710304+0000 mgr.a (mgr.14373) 17059 : cluster [DBG] pgmap v11831: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T12:11:42.004 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:11:42.004 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:11:42.005 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:11:42.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:11:41 smithi157 bash[24585]: cluster 2024-09-16T12:11:40.711101+0000 mgr.a (mgr.14373) 17060 : cluster [DBG] pgmap v11832: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T12:11:42.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:11:41 smithi086 bash[24289]: cluster 2024-09-16T12:11:40.711101+0000 mgr.a (mgr.14373) 17060 : cluster [DBG] pgmap v11832: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T12:11:42.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:11:41 smithi047 bash[22744]: cluster 2024-09-16T12:11:40.711101+0000 mgr.a (mgr.14373) 17060 : cluster [DBG] pgmap v11832: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T12:11:42.790 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:11:42.790 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:11:42.790 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:11:42.790 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:11:42.790 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:11:44.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:11:43 smithi157 bash[24585]: audit 2024-09-16T12:11:42.337136+0000 mgr.a (mgr.14373) 17061 : audit [DBG] from='client.367071 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:11:44.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:11:43 smithi157 bash[24585]: cluster 2024-09-16T12:11:42.712417+0000 mgr.a (mgr.14373) 17062 : cluster [DBG] pgmap v11833: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:11:44.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:11:43 smithi086 bash[24289]: audit 2024-09-16T12:11:42.337136+0000 mgr.a (mgr.14373) 17061 : audit [DBG] from='client.367071 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:11:44.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:11:43 smithi086 bash[24289]: cluster 2024-09-16T12:11:42.712417+0000 mgr.a (mgr.14373) 17062 : cluster [DBG] pgmap v11833: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:11:44.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:11:43 smithi047 bash[22744]: audit 2024-09-16T12:11:42.337136+0000 mgr.a (mgr.14373) 17061 : audit [DBG] from='client.367071 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:11:44.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:11:43 smithi047 bash[22744]: cluster 2024-09-16T12:11:42.712417+0000 mgr.a (mgr.14373) 17062 : cluster [DBG] pgmap v11833: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:11:46.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:11:45 smithi157 bash[24585]: cluster 2024-09-16T12:11:44.713164+0000 mgr.a (mgr.14373) 17063 : cluster [DBG] pgmap v11834: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T12:11:46.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:11:45 smithi086 bash[24289]: cluster 2024-09-16T12:11:44.713164+0000 mgr.a (mgr.14373) 17063 : cluster [DBG] pgmap v11834: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T12:11:46.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:11:45 smithi047 bash[22744]: cluster 2024-09-16T12:11:44.713164+0000 mgr.a (mgr.14373) 17063 : cluster [DBG] pgmap v11834: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T12:11:47.791 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:11:47.792 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:11:47.792 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:11:48.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:11:47 smithi157 bash[24585]: cluster 2024-09-16T12:11:46.715124+0000 mgr.a (mgr.14373) 17064 : cluster [DBG] pgmap v11835: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:11:48.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:11:47 smithi086 bash[24289]: cluster 2024-09-16T12:11:46.715124+0000 mgr.a (mgr.14373) 17064 : cluster [DBG] pgmap v11835: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:11:48.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:11:47 smithi047 bash[22744]: cluster 2024-09-16T12:11:46.715124+0000 mgr.a (mgr.14373) 17064 : cluster [DBG] pgmap v11835: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:11:48.544 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:11:48.544 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:11:48.544 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:11:48.544 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:11:48.545 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:11:50.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:11:49 smithi157 bash[24585]: audit 2024-09-16T12:11:48.122514+0000 mgr.a (mgr.14373) 17065 : audit [DBG] from='client.367149 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:11:50.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:11:49 smithi157 bash[24585]: cluster 2024-09-16T12:11:48.715967+0000 mgr.a (mgr.14373) 17066 : cluster [DBG] pgmap v11836: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:11:50.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:11:49 smithi086 bash[24289]: audit 2024-09-16T12:11:48.122514+0000 mgr.a (mgr.14373) 17065 : audit [DBG] from='client.367149 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:11:50.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:11:49 smithi086 bash[24289]: cluster 2024-09-16T12:11:48.715967+0000 mgr.a (mgr.14373) 17066 : cluster [DBG] pgmap v11836: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:11:50.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:11:49 smithi047 bash[22744]: audit 2024-09-16T12:11:48.122514+0000 mgr.a (mgr.14373) 17065 : audit [DBG] from='client.367149 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:11:50.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:11:49 smithi047 bash[22744]: cluster 2024-09-16T12:11:48.715967+0000 mgr.a (mgr.14373) 17066 : cluster [DBG] pgmap v11836: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:11:52.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:11:51 smithi157 bash[24585]: cluster 2024-09-16T12:11:50.716713+0000 mgr.a (mgr.14373) 17067 : cluster [DBG] pgmap v11837: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:11:52.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:11:51 smithi086 bash[24289]: cluster 2024-09-16T12:11:50.716713+0000 mgr.a (mgr.14373) 17067 : cluster [DBG] pgmap v11837: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:11:52.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:11:51 smithi047 bash[22744]: cluster 2024-09-16T12:11:50.716713+0000 mgr.a (mgr.14373) 17067 : cluster [DBG] pgmap v11837: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:11:53.545 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:11:53.546 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:11:53.546 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:11:54.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:11:53 smithi157 bash[24585]: cluster 2024-09-16T12:11:52.718949+0000 mgr.a (mgr.14373) 17068 : cluster [DBG] pgmap v11838: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:11:54.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:11:53 smithi086 bash[24289]: cluster 2024-09-16T12:11:52.718949+0000 mgr.a (mgr.14373) 17068 : cluster [DBG] pgmap v11838: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:11:54.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:11:53 smithi047 bash[22744]: cluster 2024-09-16T12:11:52.718949+0000 mgr.a (mgr.14373) 17068 : cluster [DBG] pgmap v11838: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:11:54.326 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:11:54.326 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:11:54.327 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:11:54.327 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:11:54.327 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:11:56.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:11:55 smithi086 bash[24289]: audit 2024-09-16T12:11:53.879158+0000 mgr.a (mgr.14373) 17069 : audit [DBG] from='client.367224 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:11:56.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:11:55 smithi086 bash[24289]: cluster 2024-09-16T12:11:54.719829+0000 mgr.a (mgr.14373) 17070 : cluster [DBG] pgmap v11839: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:11:56.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:11:55 smithi047 bash[22744]: audit 2024-09-16T12:11:53.879158+0000 mgr.a (mgr.14373) 17069 : audit [DBG] from='client.367224 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:11:56.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:11:55 smithi047 bash[22744]: cluster 2024-09-16T12:11:54.719829+0000 mgr.a (mgr.14373) 17070 : cluster [DBG] pgmap v11839: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:11:56.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:11:55 smithi157 bash[24585]: audit 2024-09-16T12:11:53.879158+0000 mgr.a (mgr.14373) 17069 : audit [DBG] from='client.367224 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:11:56.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:11:55 smithi157 bash[24585]: cluster 2024-09-16T12:11:54.719829+0000 mgr.a (mgr.14373) 17070 : cluster [DBG] pgmap v11839: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:11:58.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:11:57 smithi086 bash[24289]: cluster 2024-09-16T12:11:56.721997+0000 mgr.a (mgr.14373) 17071 : cluster [DBG] pgmap v11840: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:11:58.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:11:57 smithi047 bash[22744]: cluster 2024-09-16T12:11:56.721997+0000 mgr.a (mgr.14373) 17071 : cluster [DBG] pgmap v11840: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:11:58.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:11:57 smithi157 bash[24585]: cluster 2024-09-16T12:11:56.721997+0000 mgr.a (mgr.14373) 17071 : cluster [DBG] pgmap v11840: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:11:59.328 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:11:59.329 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:11:59.329 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:12:00.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:11:59 smithi086 bash[24289]: cluster 2024-09-16T12:11:58.722761+0000 mgr.a (mgr.14373) 17072 : cluster [DBG] pgmap v11841: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:12:00.091 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:12:00.091 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:12:00.092 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:12:00.092 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:12:00.092 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:12:00.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:11:59 smithi047 bash[22744]: cluster 2024-09-16T12:11:58.722761+0000 mgr.a (mgr.14373) 17072 : cluster [DBG] pgmap v11841: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:12:00.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:11:59 smithi157 bash[24585]: cluster 2024-09-16T12:11:58.722761+0000 mgr.a (mgr.14373) 17072 : cluster [DBG] pgmap v11841: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:12:01.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:12:00 smithi086 bash[24289]: audit 2024-09-16T12:11:59.660515+0000 mgr.a (mgr.14373) 17073 : audit [DBG] from='client.367296 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:12:01.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:12:00 smithi047 bash[22744]: audit 2024-09-16T12:11:59.660515+0000 mgr.a (mgr.14373) 17073 : audit [DBG] from='client.367296 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:12:01.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:12:00 smithi157 bash[24585]: audit 2024-09-16T12:11:59.660515+0000 mgr.a (mgr.14373) 17073 : audit [DBG] from='client.367296 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:12:02.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:12:01 smithi047 bash[22744]: cluster 2024-09-16T12:12:00.723812+0000 mgr.a (mgr.14373) 17074 : cluster [DBG] pgmap v11842: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:12:02.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:12:01 smithi157 bash[24585]: cluster 2024-09-16T12:12:00.723812+0000 mgr.a (mgr.14373) 17074 : cluster [DBG] pgmap v11842: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:12:02.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:12:01 smithi086 bash[24289]: cluster 2024-09-16T12:12:00.723812+0000 mgr.a (mgr.14373) 17074 : cluster [DBG] pgmap v11842: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:12:04.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:12:03 smithi047 bash[22744]: cluster 2024-09-16T12:12:02.726249+0000 mgr.a (mgr.14373) 17075 : cluster [DBG] pgmap v11843: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:12:04.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:12:03 smithi157 bash[24585]: cluster 2024-09-16T12:12:02.726249+0000 mgr.a (mgr.14373) 17075 : cluster [DBG] pgmap v11843: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:12:04.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:12:03 smithi086 bash[24289]: cluster 2024-09-16T12:12:02.726249+0000 mgr.a (mgr.14373) 17075 : cluster [DBG] pgmap v11843: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:12:05.093 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:12:05.094 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:12:05.094 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:12:05.881 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:12:05.882 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:12:05.882 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:12:05.882 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:12:05.882 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:12:06.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:12:05 smithi047 bash[22744]: cluster 2024-09-16T12:12:04.727180+0000 mgr.a (mgr.14373) 17076 : cluster [DBG] pgmap v11844: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:12:06.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:12:05 smithi157 bash[24585]: cluster 2024-09-16T12:12:04.727180+0000 mgr.a (mgr.14373) 17076 : cluster [DBG] pgmap v11844: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:12:06.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:12:05 smithi086 bash[24289]: cluster 2024-09-16T12:12:04.727180+0000 mgr.a (mgr.14373) 17076 : cluster [DBG] pgmap v11844: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:12:07.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:12:06 smithi157 bash[24585]: audit 2024-09-16T12:12:05.431519+0000 mgr.a (mgr.14373) 17077 : audit [DBG] from='client.367374 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:12:07.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:12:06 smithi086 bash[24289]: audit 2024-09-16T12:12:05.431519+0000 mgr.a (mgr.14373) 17077 : audit [DBG] from='client.367374 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:12:07.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:12:06 smithi047 bash[22744]: audit 2024-09-16T12:12:05.431519+0000 mgr.a (mgr.14373) 17077 : audit [DBG] from='client.367374 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:12:08.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:12:07 smithi157 bash[24585]: cluster 2024-09-16T12:12:06.729491+0000 mgr.a (mgr.14373) 17078 : cluster [DBG] pgmap v11845: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:12:08.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:12:07 smithi086 bash[24289]: cluster 2024-09-16T12:12:06.729491+0000 mgr.a (mgr.14373) 17078 : cluster [DBG] pgmap v11845: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:12:08.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:12:07 smithi047 bash[22744]: cluster 2024-09-16T12:12:06.729491+0000 mgr.a (mgr.14373) 17078 : cluster [DBG] pgmap v11845: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:12:10.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:12:09 smithi157 bash[24585]: cluster 2024-09-16T12:12:08.730264+0000 mgr.a (mgr.14373) 17079 : cluster [DBG] pgmap v11846: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:12:10.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:12:09 smithi086 bash[24289]: cluster 2024-09-16T12:12:08.730264+0000 mgr.a (mgr.14373) 17079 : cluster [DBG] pgmap v11846: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:12:10.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:12:09 smithi047 bash[22744]: cluster 2024-09-16T12:12:08.730264+0000 mgr.a (mgr.14373) 17079 : cluster [DBG] pgmap v11846: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:12:10.883 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:12:10.884 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:12:10.884 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:12:11.673 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:12:11.673 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:12:11.673 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:12:11.673 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:12:11.673 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:12:12.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:12:11 smithi157 bash[24585]: cluster 2024-09-16T12:12:10.731079+0000 mgr.a (mgr.14373) 17080 : cluster [DBG] pgmap v11847: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:12:12.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:12:11 smithi086 bash[24289]: cluster 2024-09-16T12:12:10.731079+0000 mgr.a (mgr.14373) 17080 : cluster [DBG] pgmap v11847: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:12:12.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:12:11 smithi047 bash[22744]: cluster 2024-09-16T12:12:10.731079+0000 mgr.a (mgr.14373) 17080 : cluster [DBG] pgmap v11847: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:12:13.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:12:12 smithi157 bash[24585]: audit 2024-09-16T12:12:11.220979+0000 mgr.a (mgr.14373) 17081 : audit [DBG] from='client.367452 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:12:13.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:12:12 smithi086 bash[24289]: audit 2024-09-16T12:12:11.220979+0000 mgr.a (mgr.14373) 17081 : audit [DBG] from='client.367452 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:12:13.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:12:12 smithi047 bash[22744]: audit 2024-09-16T12:12:11.220979+0000 mgr.a (mgr.14373) 17081 : audit [DBG] from='client.367452 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:12:14.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:12:13 smithi157 bash[24585]: cluster 2024-09-16T12:12:12.733876+0000 mgr.a (mgr.14373) 17082 : cluster [DBG] pgmap v11848: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-16T12:12:14.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:12:13 smithi086 bash[24289]: cluster 2024-09-16T12:12:12.733876+0000 mgr.a (mgr.14373) 17082 : cluster [DBG] pgmap v11848: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-16T12:12:14.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:12:13 smithi047 bash[22744]: cluster 2024-09-16T12:12:12.733876+0000 mgr.a (mgr.14373) 17082 : cluster [DBG] pgmap v11848: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-16T12:12:16.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:12:15 smithi157 bash[24585]: cluster 2024-09-16T12:12:14.734701+0000 mgr.a (mgr.14373) 17083 : cluster [DBG] pgmap v11849: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-16T12:12:16.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:12:15 smithi086 bash[24289]: cluster 2024-09-16T12:12:14.734701+0000 mgr.a (mgr.14373) 17083 : cluster [DBG] pgmap v11849: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-16T12:12:16.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:12:15 smithi047 bash[22744]: cluster 2024-09-16T12:12:14.734701+0000 mgr.a (mgr.14373) 17083 : cluster [DBG] pgmap v11849: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-16T12:12:16.674 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:12:16.675 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:12:16.675 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:12:17.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:12:16 smithi157 bash[24585]: cluster 2024-09-16T12:12:16.736670+0000 mgr.a (mgr.14373) 17084 : cluster [DBG] pgmap v11850: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:12:17.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:12:16 smithi157 bash[24585]: audit 2024-09-16T12:12:16.859258+0000 mon.b (mon.2) 1550 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T12:12:17.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:12:16 smithi086 bash[24289]: cluster 2024-09-16T12:12:16.736670+0000 mgr.a (mgr.14373) 17084 : cluster [DBG] pgmap v11850: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:12:17.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:12:16 smithi086 bash[24289]: audit 2024-09-16T12:12:16.859258+0000 mon.b (mon.2) 1550 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T12:12:17.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:12:16 smithi047 bash[22744]: cluster 2024-09-16T12:12:16.736670+0000 mgr.a (mgr.14373) 17084 : cluster [DBG] pgmap v11850: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:12:17.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:12:16 smithi047 bash[22744]: audit 2024-09-16T12:12:16.859258+0000 mon.b (mon.2) 1550 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T12:12:17.466 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:12:17.466 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:12:17.466 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:12:17.466 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:12:17.467 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:12:19.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:12:18 smithi157 bash[24585]: audit 2024-09-16T12:12:17.015356+0000 mgr.a (mgr.14373) 17085 : audit [DBG] from='client.367530 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:12:19.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:12:18 smithi157 bash[24585]: audit 2024-09-16T12:12:17.630408+0000 mon.a (mon.0) 1581 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:12:19.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:12:18 smithi157 bash[24585]: audit 2024-09-16T12:12:17.639986+0000 mon.a (mon.0) 1582 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:12:19.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:12:18 smithi086 bash[24289]: audit 2024-09-16T12:12:17.015356+0000 mgr.a (mgr.14373) 17085 : audit [DBG] from='client.367530 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:12:19.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:12:18 smithi086 bash[24289]: audit 2024-09-16T12:12:17.630408+0000 mon.a (mon.0) 1581 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:12:19.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:12:18 smithi086 bash[24289]: audit 2024-09-16T12:12:17.639986+0000 mon.a (mon.0) 1582 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:12:19.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:12:18 smithi047 bash[22744]: audit 2024-09-16T12:12:17.015356+0000 mgr.a (mgr.14373) 17085 : audit [DBG] from='client.367530 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:12:19.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:12:18 smithi047 bash[22744]: audit 2024-09-16T12:12:17.630408+0000 mon.a (mon.0) 1581 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:12:19.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:12:18 smithi047 bash[22744]: audit 2024-09-16T12:12:17.639986+0000 mon.a (mon.0) 1582 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:12:20.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:12:19 smithi157 bash[24585]: cluster 2024-09-16T12:12:18.737143+0000 mgr.a (mgr.14373) 17086 : cluster [DBG] pgmap v11851: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:12:20.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:12:19 smithi086 bash[24289]: cluster 2024-09-16T12:12:18.737143+0000 mgr.a (mgr.14373) 17086 : cluster [DBG] pgmap v11851: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:12:20.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:12:19 smithi047 bash[22744]: cluster 2024-09-16T12:12:18.737143+0000 mgr.a (mgr.14373) 17086 : cluster [DBG] pgmap v11851: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:12:22.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:12:21 smithi157 bash[24585]: cluster 2024-09-16T12:12:20.737872+0000 mgr.a (mgr.14373) 17087 : cluster [DBG] pgmap v11852: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T12:12:22.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:12:21 smithi086 bash[24289]: cluster 2024-09-16T12:12:20.737872+0000 mgr.a (mgr.14373) 17087 : cluster [DBG] pgmap v11852: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T12:12:22.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:12:21 smithi047 bash[22744]: cluster 2024-09-16T12:12:20.737872+0000 mgr.a (mgr.14373) 17087 : cluster [DBG] pgmap v11852: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T12:12:22.468 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:12:22.469 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:12:22.469 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:12:23.219 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:12:23.219 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:12:23.219 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:12:23.219 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:12:23.219 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:12:24.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:12:23 smithi157 bash[24585]: cluster 2024-09-16T12:12:22.740039+0000 mgr.a (mgr.14373) 17088 : cluster [DBG] pgmap v11853: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:12:24.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:12:23 smithi157 bash[24585]: audit 2024-09-16T12:12:22.802001+0000 mgr.a (mgr.14373) 17089 : audit [DBG] from='client.367602 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:12:24.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:12:23 smithi086 bash[24289]: cluster 2024-09-16T12:12:22.740039+0000 mgr.a (mgr.14373) 17088 : cluster [DBG] pgmap v11853: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:12:24.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:12:23 smithi086 bash[24289]: audit 2024-09-16T12:12:22.802001+0000 mgr.a (mgr.14373) 17089 : audit [DBG] from='client.367602 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:12:24.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:12:23 smithi047 bash[22744]: cluster 2024-09-16T12:12:22.740039+0000 mgr.a (mgr.14373) 17088 : cluster [DBG] pgmap v11853: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:12:24.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:12:23 smithi047 bash[22744]: audit 2024-09-16T12:12:22.802001+0000 mgr.a (mgr.14373) 17089 : audit [DBG] from='client.367602 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:12:25.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:12:25 smithi047 bash[22744]: cluster 2024-09-16T12:12:24.740813+0000 mgr.a (mgr.14373) 17090 : cluster [DBG] pgmap v11854: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-16T12:12:26.056 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:12:25 smithi157 bash[24585]: cluster 2024-09-16T12:12:24.740813+0000 mgr.a (mgr.14373) 17090 : cluster [DBG] pgmap v11854: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-16T12:12:26.084 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:12:25 smithi086 bash[24289]: cluster 2024-09-16T12:12:24.740813+0000 mgr.a (mgr.14373) 17090 : cluster [DBG] pgmap v11854: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-16T12:12:28.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:12:27 smithi086 bash[24289]: cluster 2024-09-16T12:12:26.742562+0000 mgr.a (mgr.14373) 17091 : cluster [DBG] pgmap v11855: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-09-16T12:12:28.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:12:27 smithi047 bash[22744]: cluster 2024-09-16T12:12:26.742562+0000 mgr.a (mgr.14373) 17091 : cluster [DBG] pgmap v11855: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-09-16T12:12:28.221 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:12:28.222 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:12:28.222 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:12:28.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:12:27 smithi157 bash[24585]: cluster 2024-09-16T12:12:26.742562+0000 mgr.a (mgr.14373) 17091 : cluster [DBG] pgmap v11855: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-09-16T12:12:29.342 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 12:12:29 smithi047 bash[22994]: debug 2024-09-16T12:12:29.029+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T12:12:29.343 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 12:12:29 smithi047 bash[22994]: debug 2024-09-16T12:12:29.045+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T12:12:29.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:12:29 smithi047 bash[22744]: audit 2024-09-16T12:12:28.204192+0000 mon.a (mon.0) 1583 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:12:29.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:12:29 smithi047 bash[22744]: audit 2024-09-16T12:12:28.214113+0000 mon.a (mon.0) 1584 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:12:29.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:12:29 smithi047 bash[22744]: audit 2024-09-16T12:12:28.218948+0000 mon.b (mon.2) 1551 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T12:12:29.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:12:29 smithi047 bash[22744]: audit 2024-09-16T12:12:28.221368+0000 mon.b (mon.2) 1552 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T12:12:29.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:12:29 smithi047 bash[22744]: audit 2024-09-16T12:12:28.232962+0000 mon.a (mon.0) 1585 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:12:29.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:12:29 smithi047 bash[22744]: audit 2024-09-16T12:12:28.238507+0000 mon.b (mon.2) 1553 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:12:29.344 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:12:29 smithi047 bash[22744]: audit 2024-09-16T12:12:28.241047+0000 mgr.a (mgr.14373) 17092 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:12:29.344 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:12:29 smithi047 bash[22744]: audit 2024-09-16T12:12:28.590296+0000 mgr.a (mgr.14373) 17093 : audit [DBG] from='client.367683 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:12:29.344 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:12:29 smithi047 bash[22744]: cluster 2024-09-16T12:12:28.743487+0000 mgr.a (mgr.14373) 17094 : cluster [DBG] pgmap v11856: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:12:29.441 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:12:29.441 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:12:29.441 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:12:29.441 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:12:29.442 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:12:29.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:12:29 smithi157 bash[24585]: audit 2024-09-16T12:12:28.204192+0000 mon.a (mon.0) 1583 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:12:29.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:12:29 smithi157 bash[24585]: audit 2024-09-16T12:12:28.214113+0000 mon.a (mon.0) 1584 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:12:29.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:12:29 smithi157 bash[24585]: audit 2024-09-16T12:12:28.218948+0000 mon.b (mon.2) 1551 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T12:12:29.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:12:29 smithi157 bash[24585]: audit 2024-09-16T12:12:28.221368+0000 mon.b (mon.2) 1552 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T12:12:29.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:12:29 smithi157 bash[24585]: audit 2024-09-16T12:12:28.232962+0000 mon.a (mon.0) 1585 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:12:29.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:12:29 smithi157 bash[24585]: audit 2024-09-16T12:12:28.238507+0000 mon.b (mon.2) 1553 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:12:29.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:12:29 smithi157 bash[24585]: audit 2024-09-16T12:12:28.241047+0000 mgr.a (mgr.14373) 17092 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:12:29.558 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:12:29 smithi157 bash[24585]: audit 2024-09-16T12:12:28.590296+0000 mgr.a (mgr.14373) 17093 : audit [DBG] from='client.367683 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:12:29.558 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:12:29 smithi157 bash[24585]: cluster 2024-09-16T12:12:28.743487+0000 mgr.a (mgr.14373) 17094 : cluster [DBG] pgmap v11856: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:12:29.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:12:29 smithi086 bash[24289]: audit 2024-09-16T12:12:28.204192+0000 mon.a (mon.0) 1583 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:12:29.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:12:29 smithi086 bash[24289]: audit 2024-09-16T12:12:28.214113+0000 mon.a (mon.0) 1584 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:12:29.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:12:29 smithi086 bash[24289]: audit 2024-09-16T12:12:28.218948+0000 mon.b (mon.2) 1551 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T12:12:29.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:12:29 smithi086 bash[24289]: audit 2024-09-16T12:12:28.221368+0000 mon.b (mon.2) 1552 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T12:12:29.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:12:29 smithi086 bash[24289]: audit 2024-09-16T12:12:28.232962+0000 mon.a (mon.0) 1585 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:12:29.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:12:29 smithi086 bash[24289]: audit 2024-09-16T12:12:28.238507+0000 mon.b (mon.2) 1553 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:12:29.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:12:29 smithi086 bash[24289]: audit 2024-09-16T12:12:28.241047+0000 mgr.a (mgr.14373) 17092 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:12:29.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:12:29 smithi086 bash[24289]: audit 2024-09-16T12:12:28.590296+0000 mgr.a (mgr.14373) 17093 : audit [DBG] from='client.367683 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:12:29.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:12:29 smithi086 bash[24289]: cluster 2024-09-16T12:12:28.743487+0000 mgr.a (mgr.14373) 17094 : cluster [DBG] pgmap v11856: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:12:30.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:12:30 smithi157 bash[24585]: audit 2024-09-16T12:12:29.033756+0000 mgr.a (mgr.14373) 17095 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T12:12:30.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:12:30 smithi157 bash[24585]: cephadm 2024-09-16T12:12:29.046512+0000 mgr.a (mgr.14373) 17096 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T12:12:30.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:12:30 smithi086 bash[24289]: audit 2024-09-16T12:12:29.033756+0000 mgr.a (mgr.14373) 17095 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T12:12:30.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:12:30 smithi086 bash[24289]: cephadm 2024-09-16T12:12:29.046512+0000 mgr.a (mgr.14373) 17096 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T12:12:30.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:12:30 smithi047 bash[22744]: audit 2024-09-16T12:12:29.033756+0000 mgr.a (mgr.14373) 17095 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T12:12:30.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:12:30 smithi047 bash[22744]: cephadm 2024-09-16T12:12:29.046512+0000 mgr.a (mgr.14373) 17096 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T12:12:31.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:12:31 smithi157 bash[24585]: cluster 2024-09-16T12:12:30.744459+0000 mgr.a (mgr.14373) 17097 : cluster [DBG] pgmap v11857: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:12:31.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:12:31 smithi086 bash[24289]: cluster 2024-09-16T12:12:30.744459+0000 mgr.a (mgr.14373) 17097 : cluster [DBG] pgmap v11857: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:12:31.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:12:31 smithi047 bash[22744]: cluster 2024-09-16T12:12:30.744459+0000 mgr.a (mgr.14373) 17097 : cluster [DBG] pgmap v11857: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:12:34.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:12:33 smithi157 bash[24585]: cluster 2024-09-16T12:12:32.746677+0000 mgr.a (mgr.14373) 17098 : cluster [DBG] pgmap v11858: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:12:34.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:12:33 smithi086 bash[24289]: cluster 2024-09-16T12:12:32.746677+0000 mgr.a (mgr.14373) 17098 : cluster [DBG] pgmap v11858: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:12:34.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:12:33 smithi047 bash[22744]: cluster 2024-09-16T12:12:32.746677+0000 mgr.a (mgr.14373) 17098 : cluster [DBG] pgmap v11858: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:12:34.443 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:12:34.444 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:12:34.444 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:12:35.212 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:12:35.212 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:12:35.213 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:12:35.213 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:12:35.213 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:12:36.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:12:35 smithi086 bash[24289]: cluster 2024-09-16T12:12:34.747421+0000 mgr.a (mgr.14373) 17099 : cluster [DBG] pgmap v11859: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:12:36.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:12:35 smithi086 bash[24289]: audit 2024-09-16T12:12:34.777654+0000 mgr.a (mgr.14373) 17100 : audit [DBG] from='client.367866 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:12:36.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:12:35 smithi047 bash[22744]: cluster 2024-09-16T12:12:34.747421+0000 mgr.a (mgr.14373) 17099 : cluster [DBG] pgmap v11859: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:12:36.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:12:35 smithi047 bash[22744]: audit 2024-09-16T12:12:34.777654+0000 mgr.a (mgr.14373) 17100 : audit [DBG] from='client.367866 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:12:36.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:12:35 smithi157 bash[24585]: cluster 2024-09-16T12:12:34.747421+0000 mgr.a (mgr.14373) 17099 : cluster [DBG] pgmap v11859: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:12:36.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:12:35 smithi157 bash[24585]: audit 2024-09-16T12:12:34.777654+0000 mgr.a (mgr.14373) 17100 : audit [DBG] from='client.367866 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:12:38.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:12:37 smithi086 bash[24289]: cluster 2024-09-16T12:12:36.749758+0000 mgr.a (mgr.14373) 17101 : cluster [DBG] pgmap v11860: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:12:38.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:12:37 smithi047 bash[22744]: cluster 2024-09-16T12:12:36.749758+0000 mgr.a (mgr.14373) 17101 : cluster [DBG] pgmap v11860: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:12:38.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:12:37 smithi157 bash[24585]: cluster 2024-09-16T12:12:36.749758+0000 mgr.a (mgr.14373) 17101 : cluster [DBG] pgmap v11860: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:12:40.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:12:39 smithi086 bash[24289]: cluster 2024-09-16T12:12:38.750711+0000 mgr.a (mgr.14373) 17102 : cluster [DBG] pgmap v11861: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:12:40.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:12:39 smithi047 bash[22744]: cluster 2024-09-16T12:12:38.750711+0000 mgr.a (mgr.14373) 17102 : cluster [DBG] pgmap v11861: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:12:40.214 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:12:40.214 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:12:40.214 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:12:40.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:12:39 smithi157 bash[24585]: cluster 2024-09-16T12:12:38.750711+0000 mgr.a (mgr.14373) 17102 : cluster [DBG] pgmap v11861: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:12:41.000 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:12:41.000 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:12:41.001 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:12:41.001 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:12:41.001 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:12:42.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:12:41 smithi047 bash[22744]: audit 2024-09-16T12:12:40.549720+0000 mgr.a (mgr.14373) 17103 : audit [DBG] from='client.367941 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:12:42.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:12:41 smithi047 bash[22744]: cluster 2024-09-16T12:12:40.751331+0000 mgr.a (mgr.14373) 17104 : cluster [DBG] pgmap v11862: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:12:42.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:12:41 smithi157 bash[24585]: audit 2024-09-16T12:12:40.549720+0000 mgr.a (mgr.14373) 17103 : audit [DBG] from='client.367941 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:12:42.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:12:41 smithi157 bash[24585]: cluster 2024-09-16T12:12:40.751331+0000 mgr.a (mgr.14373) 17104 : cluster [DBG] pgmap v11862: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:12:42.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:12:41 smithi086 bash[24289]: audit 2024-09-16T12:12:40.549720+0000 mgr.a (mgr.14373) 17103 : audit [DBG] from='client.367941 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:12:42.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:12:41 smithi086 bash[24289]: cluster 2024-09-16T12:12:40.751331+0000 mgr.a (mgr.14373) 17104 : cluster [DBG] pgmap v11862: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:12:44.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:12:43 smithi047 bash[22744]: cluster 2024-09-16T12:12:42.753617+0000 mgr.a (mgr.14373) 17105 : cluster [DBG] pgmap v11863: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:12:44.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:12:43 smithi157 bash[24585]: cluster 2024-09-16T12:12:42.753617+0000 mgr.a (mgr.14373) 17105 : cluster [DBG] pgmap v11863: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:12:44.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:12:43 smithi086 bash[24289]: cluster 2024-09-16T12:12:42.753617+0000 mgr.a (mgr.14373) 17105 : cluster [DBG] pgmap v11863: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:12:46.002 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:12:46.003 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:12:46.003 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:12:46.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:12:45 smithi047 bash[22744]: cluster 2024-09-16T12:12:44.754417+0000 mgr.a (mgr.14373) 17106 : cluster [DBG] pgmap v11864: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:12:46.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:12:45 smithi157 bash[24585]: cluster 2024-09-16T12:12:44.754417+0000 mgr.a (mgr.14373) 17106 : cluster [DBG] pgmap v11864: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:12:46.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:12:45 smithi086 bash[24289]: cluster 2024-09-16T12:12:44.754417+0000 mgr.a (mgr.14373) 17106 : cluster [DBG] pgmap v11864: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:12:46.778 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:12:46.778 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:12:46.778 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:12:46.778 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:12:46.779 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:12:48.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:12:47 smithi047 bash[22744]: audit 2024-09-16T12:12:46.334333+0000 mgr.a (mgr.14373) 17107 : audit [DBG] from='client.368019 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:12:48.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:12:47 smithi047 bash[22744]: cluster 2024-09-16T12:12:46.755948+0000 mgr.a (mgr.14373) 17108 : cluster [DBG] pgmap v11865: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:12:48.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:12:47 smithi157 bash[24585]: audit 2024-09-16T12:12:46.334333+0000 mgr.a (mgr.14373) 17107 : audit [DBG] from='client.368019 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:12:48.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:12:47 smithi157 bash[24585]: cluster 2024-09-16T12:12:46.755948+0000 mgr.a (mgr.14373) 17108 : cluster [DBG] pgmap v11865: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:12:48.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:12:47 smithi086 bash[24289]: audit 2024-09-16T12:12:46.334333+0000 mgr.a (mgr.14373) 17107 : audit [DBG] from='client.368019 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:12:48.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:12:47 smithi086 bash[24289]: cluster 2024-09-16T12:12:46.755948+0000 mgr.a (mgr.14373) 17108 : cluster [DBG] pgmap v11865: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:12:50.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:12:49 smithi047 bash[22744]: cluster 2024-09-16T12:12:48.756679+0000 mgr.a (mgr.14373) 17109 : cluster [DBG] pgmap v11866: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T12:12:50.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:12:49 smithi157 bash[24585]: cluster 2024-09-16T12:12:48.756679+0000 mgr.a (mgr.14373) 17109 : cluster [DBG] pgmap v11866: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T12:12:50.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:12:49 smithi086 bash[24289]: cluster 2024-09-16T12:12:48.756679+0000 mgr.a (mgr.14373) 17109 : cluster [DBG] pgmap v11866: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T12:12:51.780 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:12:51.781 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:12:51.781 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:12:52.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:12:51 smithi157 bash[24585]: cluster 2024-09-16T12:12:50.757425+0000 mgr.a (mgr.14373) 17110 : cluster [DBG] pgmap v11867: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T12:12:52.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:12:51 smithi086 bash[24289]: cluster 2024-09-16T12:12:50.757425+0000 mgr.a (mgr.14373) 17110 : cluster [DBG] pgmap v11867: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T12:12:52.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:12:51 smithi047 bash[22744]: cluster 2024-09-16T12:12:50.757425+0000 mgr.a (mgr.14373) 17110 : cluster [DBG] pgmap v11867: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T12:12:52.571 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:12:52.572 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:12:52.572 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:12:52.572 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:12:52.572 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:12:54.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:12:53 smithi157 bash[24585]: audit 2024-09-16T12:12:52.116339+0000 mgr.a (mgr.14373) 17111 : audit [DBG] from='client.368097 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:12:54.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:12:53 smithi157 bash[24585]: cluster 2024-09-16T12:12:52.760277+0000 mgr.a (mgr.14373) 17112 : cluster [DBG] pgmap v11868: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:12:54.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:12:53 smithi086 bash[24289]: audit 2024-09-16T12:12:52.116339+0000 mgr.a (mgr.14373) 17111 : audit [DBG] from='client.368097 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:12:54.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:12:53 smithi086 bash[24289]: cluster 2024-09-16T12:12:52.760277+0000 mgr.a (mgr.14373) 17112 : cluster [DBG] pgmap v11868: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:12:54.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:12:53 smithi047 bash[22744]: audit 2024-09-16T12:12:52.116339+0000 mgr.a (mgr.14373) 17111 : audit [DBG] from='client.368097 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:12:54.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:12:53 smithi047 bash[22744]: cluster 2024-09-16T12:12:52.760277+0000 mgr.a (mgr.14373) 17112 : cluster [DBG] pgmap v11868: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:12:56.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:12:55 smithi157 bash[24585]: cluster 2024-09-16T12:12:54.761262+0000 mgr.a (mgr.14373) 17113 : cluster [DBG] pgmap v11869: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:12:56.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:12:55 smithi086 bash[24289]: cluster 2024-09-16T12:12:54.761262+0000 mgr.a (mgr.14373) 17113 : cluster [DBG] pgmap v11869: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:12:56.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:12:55 smithi047 bash[22744]: cluster 2024-09-16T12:12:54.761262+0000 mgr.a (mgr.14373) 17113 : cluster [DBG] pgmap v11869: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:12:57.573 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:12:57.574 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:12:57.574 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:12:58.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:12:57 smithi157 bash[24585]: cluster 2024-09-16T12:12:56.763859+0000 mgr.a (mgr.14373) 17114 : cluster [DBG] pgmap v11870: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:12:58.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:12:57 smithi086 bash[24289]: cluster 2024-09-16T12:12:56.763859+0000 mgr.a (mgr.14373) 17114 : cluster [DBG] pgmap v11870: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:12:58.330 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:12:58.330 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:12:58.330 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:12:58.331 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:12:58.331 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:12:58.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:12:57 smithi047 bash[22744]: cluster 2024-09-16T12:12:56.763859+0000 mgr.a (mgr.14373) 17114 : cluster [DBG] pgmap v11870: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:13:00.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:12:59 smithi157 bash[24585]: audit 2024-09-16T12:12:57.907647+0000 mgr.a (mgr.14373) 17115 : audit [DBG] from='client.368172 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:13:00.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:12:59 smithi157 bash[24585]: cluster 2024-09-16T12:12:58.764827+0000 mgr.a (mgr.14373) 17116 : cluster [DBG] pgmap v11871: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:13:00.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:12:59 smithi086 bash[24289]: audit 2024-09-16T12:12:57.907647+0000 mgr.a (mgr.14373) 17115 : audit [DBG] from='client.368172 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:13:00.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:12:59 smithi086 bash[24289]: cluster 2024-09-16T12:12:58.764827+0000 mgr.a (mgr.14373) 17116 : cluster [DBG] pgmap v11871: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:13:00.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:12:59 smithi047 bash[22744]: audit 2024-09-16T12:12:57.907647+0000 mgr.a (mgr.14373) 17115 : audit [DBG] from='client.368172 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:13:00.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:12:59 smithi047 bash[22744]: cluster 2024-09-16T12:12:58.764827+0000 mgr.a (mgr.14373) 17116 : cluster [DBG] pgmap v11871: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:13:02.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:13:01 smithi157 bash[24585]: cluster 2024-09-16T12:13:00.765777+0000 mgr.a (mgr.14373) 17117 : cluster [DBG] pgmap v11872: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:13:02.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:13:01 smithi086 bash[24289]: cluster 2024-09-16T12:13:00.765777+0000 mgr.a (mgr.14373) 17117 : cluster [DBG] pgmap v11872: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:13:02.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:13:01 smithi047 bash[22744]: cluster 2024-09-16T12:13:00.765777+0000 mgr.a (mgr.14373) 17117 : cluster [DBG] pgmap v11872: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:13:03.332 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:13:03.332 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:13:03.333 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:13:04.101 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:13:04.101 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:13:04.102 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:13:04.102 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:13:04.102 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:13:04.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:13:03 smithi157 bash[24585]: cluster 2024-09-16T12:13:02.768199+0000 mgr.a (mgr.14373) 17118 : cluster [DBG] pgmap v11873: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:13:04.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:13:03 smithi086 bash[24289]: cluster 2024-09-16T12:13:02.768199+0000 mgr.a (mgr.14373) 17118 : cluster [DBG] pgmap v11873: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:13:04.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:13:03 smithi047 bash[22744]: cluster 2024-09-16T12:13:02.768199+0000 mgr.a (mgr.14373) 17118 : cluster [DBG] pgmap v11873: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:13:05.308 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:13:04 smithi157 bash[24585]: audit 2024-09-16T12:13:03.665233+0000 mgr.a (mgr.14373) 17119 : audit [DBG] from='client.368247 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:13:05.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:13:04 smithi086 bash[24289]: audit 2024-09-16T12:13:03.665233+0000 mgr.a (mgr.14373) 17119 : audit [DBG] from='client.368247 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:13:05.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:13:04 smithi047 bash[22744]: audit 2024-09-16T12:13:03.665233+0000 mgr.a (mgr.14373) 17119 : audit [DBG] from='client.368247 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:13:06.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:13:05 smithi157 bash[24585]: cluster 2024-09-16T12:13:04.769355+0000 mgr.a (mgr.14373) 17120 : cluster [DBG] pgmap v11874: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:13:06.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:13:05 smithi086 bash[24289]: cluster 2024-09-16T12:13:04.769355+0000 mgr.a (mgr.14373) 17120 : cluster [DBG] pgmap v11874: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:13:06.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:13:05 smithi047 bash[22744]: cluster 2024-09-16T12:13:04.769355+0000 mgr.a (mgr.14373) 17120 : cluster [DBG] pgmap v11874: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:13:07.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:13:06 smithi157 bash[24585]: cluster 2024-09-16T12:13:06.771597+0000 mgr.a (mgr.14373) 17121 : cluster [DBG] pgmap v11875: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:13:07.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:13:06 smithi086 bash[24289]: cluster 2024-09-16T12:13:06.771597+0000 mgr.a (mgr.14373) 17121 : cluster [DBG] pgmap v11875: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:13:07.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:13:06 smithi047 bash[22744]: cluster 2024-09-16T12:13:06.771597+0000 mgr.a (mgr.14373) 17121 : cluster [DBG] pgmap v11875: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:13:09.102 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:13:09.103 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:13:09.103 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:13:09.879 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:13:09.880 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:13:09.880 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:13:09.880 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:13:09.880 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:13:10.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:13:09 smithi047 bash[22744]: cluster 2024-09-16T12:13:08.772361+0000 mgr.a (mgr.14373) 17122 : cluster [DBG] pgmap v11876: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:13:10.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:13:09 smithi157 bash[24585]: cluster 2024-09-16T12:13:08.772361+0000 mgr.a (mgr.14373) 17122 : cluster [DBG] pgmap v11876: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:13:10.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:13:09 smithi086 bash[24289]: cluster 2024-09-16T12:13:08.772361+0000 mgr.a (mgr.14373) 17122 : cluster [DBG] pgmap v11876: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:13:11.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:13:10 smithi047 bash[22744]: audit 2024-09-16T12:13:09.436258+0000 mgr.a (mgr.14373) 17123 : audit [DBG] from='client.368322 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:13:11.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:13:10 smithi157 bash[24585]: audit 2024-09-16T12:13:09.436258+0000 mgr.a (mgr.14373) 17123 : audit [DBG] from='client.368322 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:13:11.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:13:10 smithi086 bash[24289]: audit 2024-09-16T12:13:09.436258+0000 mgr.a (mgr.14373) 17123 : audit [DBG] from='client.368322 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:13:12.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:13:11 smithi047 bash[22744]: cluster 2024-09-16T12:13:10.773306+0000 mgr.a (mgr.14373) 17124 : cluster [DBG] pgmap v11877: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:13:12.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:13:11 smithi157 bash[24585]: cluster 2024-09-16T12:13:10.773306+0000 mgr.a (mgr.14373) 17124 : cluster [DBG] pgmap v11877: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:13:12.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:13:11 smithi086 bash[24289]: cluster 2024-09-16T12:13:10.773306+0000 mgr.a (mgr.14373) 17124 : cluster [DBG] pgmap v11877: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:13:14.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:13:13 smithi157 bash[24585]: cluster 2024-09-16T12:13:12.775599+0000 mgr.a (mgr.14373) 17125 : cluster [DBG] pgmap v11878: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:13:14.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:13:13 smithi086 bash[24289]: cluster 2024-09-16T12:13:12.775599+0000 mgr.a (mgr.14373) 17125 : cluster [DBG] pgmap v11878: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:13:14.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:13:13 smithi047 bash[22744]: cluster 2024-09-16T12:13:12.775599+0000 mgr.a (mgr.14373) 17125 : cluster [DBG] pgmap v11878: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:13:14.881 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:13:14.882 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:13:14.882 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:13:15.665 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:13:15.665 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:13:15.666 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:13:15.666 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:13:15.666 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:13:16.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:13:15 smithi157 bash[24585]: cluster 2024-09-16T12:13:14.776360+0000 mgr.a (mgr.14373) 17126 : cluster [DBG] pgmap v11879: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:13:16.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:13:15 smithi086 bash[24289]: cluster 2024-09-16T12:13:14.776360+0000 mgr.a (mgr.14373) 17126 : cluster [DBG] pgmap v11879: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:13:16.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:13:15 smithi047 bash[22744]: cluster 2024-09-16T12:13:14.776360+0000 mgr.a (mgr.14373) 17126 : cluster [DBG] pgmap v11879: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:13:17.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:13:16 smithi157 bash[24585]: audit 2024-09-16T12:13:15.218894+0000 mgr.a (mgr.14373) 17127 : audit [DBG] from='client.368400 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:13:17.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:13:16 smithi086 bash[24289]: audit 2024-09-16T12:13:15.218894+0000 mgr.a (mgr.14373) 17127 : audit [DBG] from='client.368400 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:13:17.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:13:16 smithi047 bash[22744]: audit 2024-09-16T12:13:15.218894+0000 mgr.a (mgr.14373) 17127 : audit [DBG] from='client.368400 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:13:18.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:13:17 smithi157 bash[24585]: cluster 2024-09-16T12:13:16.778742+0000 mgr.a (mgr.14373) 17128 : cluster [DBG] pgmap v11880: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:13:18.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:13:17 smithi086 bash[24289]: cluster 2024-09-16T12:13:16.778742+0000 mgr.a (mgr.14373) 17128 : cluster [DBG] pgmap v11880: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:13:18.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:13:17 smithi047 bash[22744]: cluster 2024-09-16T12:13:16.778742+0000 mgr.a (mgr.14373) 17128 : cluster [DBG] pgmap v11880: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:13:20.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:13:19 smithi157 bash[24585]: cluster 2024-09-16T12:13:18.779498+0000 mgr.a (mgr.14373) 17129 : cluster [DBG] pgmap v11881: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:13:20.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:13:19 smithi086 bash[24289]: cluster 2024-09-16T12:13:18.779498+0000 mgr.a (mgr.14373) 17129 : cluster [DBG] pgmap v11881: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:13:20.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:13:19 smithi047 bash[22744]: cluster 2024-09-16T12:13:18.779498+0000 mgr.a (mgr.14373) 17129 : cluster [DBG] pgmap v11881: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:13:20.667 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:13:20.667 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:13:20.668 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:13:21.459 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:13:21.460 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:13:21.460 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:13:21.460 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:13:21.460 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:13:22.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:13:21 smithi157 bash[24585]: cluster 2024-09-16T12:13:20.779927+0000 mgr.a (mgr.14373) 17130 : cluster [DBG] pgmap v11882: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:13:22.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:13:21 smithi086 bash[24289]: cluster 2024-09-16T12:13:20.779927+0000 mgr.a (mgr.14373) 17130 : cluster [DBG] pgmap v11882: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:13:22.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:13:21 smithi047 bash[22744]: cluster 2024-09-16T12:13:20.779927+0000 mgr.a (mgr.14373) 17130 : cluster [DBG] pgmap v11882: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:13:23.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:13:22 smithi157 bash[24585]: audit 2024-09-16T12:13:21.005169+0000 mgr.a (mgr.14373) 17131 : audit [DBG] from='client.368475 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:13:23.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:13:22 smithi086 bash[24289]: audit 2024-09-16T12:13:21.005169+0000 mgr.a (mgr.14373) 17131 : audit [DBG] from='client.368475 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:13:23.344 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:13:22 smithi047 bash[22744]: audit 2024-09-16T12:13:21.005169+0000 mgr.a (mgr.14373) 17131 : audit [DBG] from='client.368475 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:13:24.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:13:23 smithi157 bash[24585]: cluster 2024-09-16T12:13:22.782243+0000 mgr.a (mgr.14373) 17132 : cluster [DBG] pgmap v11883: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:13:24.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:13:23 smithi086 bash[24289]: cluster 2024-09-16T12:13:22.782243+0000 mgr.a (mgr.14373) 17132 : cluster [DBG] pgmap v11883: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:13:24.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:13:23 smithi047 bash[22744]: cluster 2024-09-16T12:13:22.782243+0000 mgr.a (mgr.14373) 17132 : cluster [DBG] pgmap v11883: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:13:26.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:13:25 smithi157 bash[24585]: cluster 2024-09-16T12:13:24.783029+0000 mgr.a (mgr.14373) 17133 : cluster [DBG] pgmap v11884: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:13:26.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:13:25 smithi086 bash[24289]: cluster 2024-09-16T12:13:24.783029+0000 mgr.a (mgr.14373) 17133 : cluster [DBG] pgmap v11884: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:13:26.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:13:25 smithi047 bash[22744]: cluster 2024-09-16T12:13:24.783029+0000 mgr.a (mgr.14373) 17133 : cluster [DBG] pgmap v11884: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:13:26.461 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:13:26.462 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:13:26.462 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:13:27.211 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:13:27.211 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:13:27.211 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:13:27.211 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:13:27.211 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:13:27.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:13:26 smithi157 bash[24585]: cluster 2024-09-16T12:13:26.784929+0000 mgr.a (mgr.14373) 17134 : cluster [DBG] pgmap v11885: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:13:27.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:13:26 smithi157 bash[24585]: audit 2024-09-16T12:13:26.787828+0000 mgr.a (mgr.14373) 17135 : audit [DBG] from='client.368553 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:13:27.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:13:26 smithi086 bash[24289]: cluster 2024-09-16T12:13:26.784929+0000 mgr.a (mgr.14373) 17134 : cluster [DBG] pgmap v11885: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:13:27.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:13:26 smithi086 bash[24289]: audit 2024-09-16T12:13:26.787828+0000 mgr.a (mgr.14373) 17135 : audit [DBG] from='client.368553 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:13:27.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:13:26 smithi047 bash[22744]: cluster 2024-09-16T12:13:26.784929+0000 mgr.a (mgr.14373) 17134 : cluster [DBG] pgmap v11885: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:13:27.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:13:26 smithi047 bash[22744]: audit 2024-09-16T12:13:26.787828+0000 mgr.a (mgr.14373) 17135 : audit [DBG] from='client.368553 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:13:30.308 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:13:29 smithi157 bash[24585]: cluster 2024-09-16T12:13:28.785791+0000 mgr.a (mgr.14373) 17136 : cluster [DBG] pgmap v11886: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T12:13:30.308 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:13:29 smithi157 bash[24585]: audit 2024-09-16T12:13:29.103427+0000 mon.b (mon.2) 1554 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T12:13:30.308 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:13:29 smithi157 bash[24585]: audit 2024-09-16T12:13:29.731754+0000 mon.a (mon.0) 1586 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:13:30.309 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:13:29 smithi157 bash[24585]: audit 2024-09-16T12:13:29.734833+0000 mon.a (mon.0) 1587 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:13:30.309 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:13:29 smithi157 bash[24585]: audit 2024-09-16T12:13:29.742095+0000 mon.a (mon.0) 1588 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:13:30.309 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:13:29 smithi157 bash[24585]: audit 2024-09-16T12:13:29.746931+0000 mon.a (mon.0) 1589 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:13:30.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:13:29 smithi086 bash[24289]: cluster 2024-09-16T12:13:28.785791+0000 mgr.a (mgr.14373) 17136 : cluster [DBG] pgmap v11886: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T12:13:30.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:13:29 smithi086 bash[24289]: audit 2024-09-16T12:13:29.103427+0000 mon.b (mon.2) 1554 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T12:13:30.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:13:29 smithi086 bash[24289]: audit 2024-09-16T12:13:29.731754+0000 mon.a (mon.0) 1586 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:13:30.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:13:29 smithi086 bash[24289]: audit 2024-09-16T12:13:29.734833+0000 mon.a (mon.0) 1587 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:13:30.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:13:29 smithi086 bash[24289]: audit 2024-09-16T12:13:29.742095+0000 mon.a (mon.0) 1588 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:13:30.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:13:29 smithi086 bash[24289]: audit 2024-09-16T12:13:29.746931+0000 mon.a (mon.0) 1589 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:13:30.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:13:29 smithi047 bash[22744]: cluster 2024-09-16T12:13:28.785791+0000 mgr.a (mgr.14373) 17136 : cluster [DBG] pgmap v11886: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T12:13:30.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:13:29 smithi047 bash[22744]: audit 2024-09-16T12:13:29.103427+0000 mon.b (mon.2) 1554 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T12:13:30.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:13:29 smithi047 bash[22744]: audit 2024-09-16T12:13:29.731754+0000 mon.a (mon.0) 1586 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:13:30.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:13:29 smithi047 bash[22744]: audit 2024-09-16T12:13:29.734833+0000 mon.a (mon.0) 1587 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:13:30.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:13:29 smithi047 bash[22744]: audit 2024-09-16T12:13:29.742095+0000 mon.a (mon.0) 1588 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:13:30.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:13:29 smithi047 bash[22744]: audit 2024-09-16T12:13:29.746931+0000 mon.a (mon.0) 1589 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:13:32.212 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:13:32.213 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:13:32.213 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:13:32.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:13:31 smithi157 bash[24585]: cluster 2024-09-16T12:13:30.786596+0000 mgr.a (mgr.14373) 17137 : cluster [DBG] pgmap v11887: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T12:13:32.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:13:31 smithi086 bash[24289]: cluster 2024-09-16T12:13:30.786596+0000 mgr.a (mgr.14373) 17137 : cluster [DBG] pgmap v11887: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T12:13:32.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:13:31 smithi047 bash[22744]: cluster 2024-09-16T12:13:30.786596+0000 mgr.a (mgr.14373) 17137 : cluster [DBG] pgmap v11887: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T12:13:32.958 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:13:32.958 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:13:32.958 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:13:32.958 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:13:32.958 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:13:34.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:13:33 smithi157 bash[24585]: audit 2024-09-16T12:13:32.536191+0000 mgr.a (mgr.14373) 17138 : audit [DBG] from='client.368631 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:13:34.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:13:33 smithi157 bash[24585]: cluster 2024-09-16T12:13:32.787881+0000 mgr.a (mgr.14373) 17139 : cluster [DBG] pgmap v11888: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:13:34.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:13:33 smithi086 bash[24289]: audit 2024-09-16T12:13:32.536191+0000 mgr.a (mgr.14373) 17138 : audit [DBG] from='client.368631 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:13:34.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:13:33 smithi086 bash[24289]: cluster 2024-09-16T12:13:32.787881+0000 mgr.a (mgr.14373) 17139 : cluster [DBG] pgmap v11888: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:13:34.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:13:33 smithi047 bash[22744]: audit 2024-09-16T12:13:32.536191+0000 mgr.a (mgr.14373) 17138 : audit [DBG] from='client.368631 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:13:34.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:13:33 smithi047 bash[22744]: cluster 2024-09-16T12:13:32.787881+0000 mgr.a (mgr.14373) 17139 : cluster [DBG] pgmap v11888: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:13:36.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:13:35 smithi086 bash[24289]: cluster 2024-09-16T12:13:34.788748+0000 mgr.a (mgr.14373) 17140 : cluster [DBG] pgmap v11889: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T12:13:36.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:13:35 smithi157 bash[24585]: cluster 2024-09-16T12:13:34.788748+0000 mgr.a (mgr.14373) 17140 : cluster [DBG] pgmap v11889: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T12:13:36.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:13:35 smithi047 bash[22744]: cluster 2024-09-16T12:13:34.788748+0000 mgr.a (mgr.14373) 17140 : cluster [DBG] pgmap v11889: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T12:13:37.959 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:13:37.960 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:13:37.960 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:13:38.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:13:37 smithi157 bash[24585]: cluster 2024-09-16T12:13:36.790927+0000 mgr.a (mgr.14373) 17141 : cluster [DBG] pgmap v11890: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:13:38.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:13:37 smithi086 bash[24289]: cluster 2024-09-16T12:13:36.790927+0000 mgr.a (mgr.14373) 17141 : cluster [DBG] pgmap v11890: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:13:38.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:13:37 smithi047 bash[22744]: cluster 2024-09-16T12:13:36.790927+0000 mgr.a (mgr.14373) 17141 : cluster [DBG] pgmap v11890: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:13:38.701 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:13:38.701 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:13:38.701 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:13:38.701 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:13:38.701 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:13:40.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:13:39 smithi086 bash[24289]: audit 2024-09-16T12:13:38.285662+0000 mgr.a (mgr.14373) 17142 : audit [DBG] from='client.368709 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:13:40.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:13:39 smithi086 bash[24289]: cluster 2024-09-16T12:13:38.791454+0000 mgr.a (mgr.14373) 17143 : cluster [DBG] pgmap v11891: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:13:40.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:13:39 smithi157 bash[24585]: audit 2024-09-16T12:13:38.285662+0000 mgr.a (mgr.14373) 17142 : audit [DBG] from='client.368709 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:13:40.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:13:39 smithi157 bash[24585]: cluster 2024-09-16T12:13:38.791454+0000 mgr.a (mgr.14373) 17143 : cluster [DBG] pgmap v11891: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:13:40.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:13:39 smithi047 bash[22744]: audit 2024-09-16T12:13:38.285662+0000 mgr.a (mgr.14373) 17142 : audit [DBG] from='client.368709 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:13:40.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:13:39 smithi047 bash[22744]: cluster 2024-09-16T12:13:38.791454+0000 mgr.a (mgr.14373) 17143 : cluster [DBG] pgmap v11891: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:13:41.593 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 12:13:41 smithi047 bash[22994]: debug 2024-09-16T12:13:41.311+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T12:13:41.593 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 12:13:41 smithi047 bash[22994]: debug 2024-09-16T12:13:41.311+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T12:13:41.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:13:41 smithi047 bash[22744]: audit 2024-09-16T12:13:40.473977+0000 mon.a (mon.0) 1590 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:13:41.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:13:41 smithi047 bash[22744]: audit 2024-09-16T12:13:40.484861+0000 mon.a (mon.0) 1591 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:13:41.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:13:41 smithi047 bash[22744]: audit 2024-09-16T12:13:40.488049+0000 mon.b (mon.2) 1555 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T12:13:41.594 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:13:41 smithi047 bash[22744]: audit 2024-09-16T12:13:40.490455+0000 mon.b (mon.2) 1556 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T12:13:41.594 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:13:41 smithi047 bash[22744]: audit 2024-09-16T12:13:40.502306+0000 mon.a (mon.0) 1592 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:13:41.594 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:13:41 smithi047 bash[22744]: audit 2024-09-16T12:13:40.507988+0000 mon.b (mon.2) 1557 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:13:41.594 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:13:41 smithi047 bash[22744]: audit 2024-09-16T12:13:40.510775+0000 mgr.a (mgr.14373) 17144 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:13:41.594 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:13:41 smithi047 bash[22744]: cluster 2024-09-16T12:13:40.791940+0000 mgr.a (mgr.14373) 17145 : cluster [DBG] pgmap v11892: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:13:41.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:13:41 smithi157 bash[24585]: audit 2024-09-16T12:13:40.473977+0000 mon.a (mon.0) 1590 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:13:41.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:13:41 smithi157 bash[24585]: audit 2024-09-16T12:13:40.484861+0000 mon.a (mon.0) 1591 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:13:41.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:13:41 smithi157 bash[24585]: audit 2024-09-16T12:13:40.488049+0000 mon.b (mon.2) 1555 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T12:13:41.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:13:41 smithi157 bash[24585]: audit 2024-09-16T12:13:40.490455+0000 mon.b (mon.2) 1556 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T12:13:41.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:13:41 smithi157 bash[24585]: audit 2024-09-16T12:13:40.502306+0000 mon.a (mon.0) 1592 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:13:41.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:13:41 smithi157 bash[24585]: audit 2024-09-16T12:13:40.507988+0000 mon.b (mon.2) 1557 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:13:41.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:13:41 smithi157 bash[24585]: audit 2024-09-16T12:13:40.510775+0000 mgr.a (mgr.14373) 17144 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:13:41.808 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:13:41 smithi157 bash[24585]: cluster 2024-09-16T12:13:40.791940+0000 mgr.a (mgr.14373) 17145 : cluster [DBG] pgmap v11892: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:13:41.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:13:41 smithi086 bash[24289]: audit 2024-09-16T12:13:40.473977+0000 mon.a (mon.0) 1590 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:13:41.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:13:41 smithi086 bash[24289]: audit 2024-09-16T12:13:40.484861+0000 mon.a (mon.0) 1591 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:13:41.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:13:41 smithi086 bash[24289]: audit 2024-09-16T12:13:40.488049+0000 mon.b (mon.2) 1555 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T12:13:41.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:13:41 smithi086 bash[24289]: audit 2024-09-16T12:13:40.490455+0000 mon.b (mon.2) 1556 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T12:13:41.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:13:41 smithi086 bash[24289]: audit 2024-09-16T12:13:40.502306+0000 mon.a (mon.0) 1592 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:13:41.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:13:41 smithi086 bash[24289]: audit 2024-09-16T12:13:40.507988+0000 mon.b (mon.2) 1557 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:13:41.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:13:41 smithi086 bash[24289]: audit 2024-09-16T12:13:40.510775+0000 mgr.a (mgr.14373) 17144 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:13:41.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:13:41 smithi086 bash[24289]: cluster 2024-09-16T12:13:40.791940+0000 mgr.a (mgr.14373) 17145 : cluster [DBG] pgmap v11892: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:13:42.808 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:13:42 smithi157 bash[24585]: audit 2024-09-16T12:13:41.315401+0000 mgr.a (mgr.14373) 17146 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T12:13:42.808 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:13:42 smithi157 bash[24585]: cephadm 2024-09-16T12:13:41.317987+0000 mgr.a (mgr.14373) 17147 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T12:13:42.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:13:42 smithi086 bash[24289]: audit 2024-09-16T12:13:41.315401+0000 mgr.a (mgr.14373) 17146 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T12:13:42.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:13:42 smithi086 bash[24289]: cephadm 2024-09-16T12:13:41.317987+0000 mgr.a (mgr.14373) 17147 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T12:13:42.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:13:42 smithi047 bash[22744]: audit 2024-09-16T12:13:41.315401+0000 mgr.a (mgr.14373) 17146 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T12:13:42.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:13:42 smithi047 bash[22744]: cephadm 2024-09-16T12:13:41.317987+0000 mgr.a (mgr.14373) 17147 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T12:13:43.702 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:13:43.703 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:13:43.703 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:13:43.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:13:43 smithi157 bash[24585]: cluster 2024-09-16T12:13:42.794218+0000 mgr.a (mgr.14373) 17148 : cluster [DBG] pgmap v11893: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:13:43.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:13:43 smithi086 bash[24289]: cluster 2024-09-16T12:13:42.794218+0000 mgr.a (mgr.14373) 17148 : cluster [DBG] pgmap v11893: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:13:43.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:13:43 smithi047 bash[22744]: cluster 2024-09-16T12:13:42.794218+0000 mgr.a (mgr.14373) 17148 : cluster [DBG] pgmap v11893: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:13:44.465 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:13:44.466 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:13:44.466 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:13:44.466 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:13:44.466 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:13:46.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:13:45 smithi157 bash[24585]: audit 2024-09-16T12:13:44.034574+0000 mgr.a (mgr.14373) 17149 : audit [DBG] from='client.368892 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:13:46.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:13:45 smithi157 bash[24585]: cluster 2024-09-16T12:13:44.795210+0000 mgr.a (mgr.14373) 17150 : cluster [DBG] pgmap v11894: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:13:46.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:13:45 smithi086 bash[24289]: audit 2024-09-16T12:13:44.034574+0000 mgr.a (mgr.14373) 17149 : audit [DBG] from='client.368892 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:13:46.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:13:45 smithi086 bash[24289]: cluster 2024-09-16T12:13:44.795210+0000 mgr.a (mgr.14373) 17150 : cluster [DBG] pgmap v11894: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:13:46.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:13:45 smithi047 bash[22744]: audit 2024-09-16T12:13:44.034574+0000 mgr.a (mgr.14373) 17149 : audit [DBG] from='client.368892 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:13:46.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:13:45 smithi047 bash[22744]: cluster 2024-09-16T12:13:44.795210+0000 mgr.a (mgr.14373) 17150 : cluster [DBG] pgmap v11894: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:13:48.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:13:47 smithi157 bash[24585]: cluster 2024-09-16T12:13:46.797412+0000 mgr.a (mgr.14373) 17151 : cluster [DBG] pgmap v11895: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:13:48.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:13:47 smithi086 bash[24289]: cluster 2024-09-16T12:13:46.797412+0000 mgr.a (mgr.14373) 17151 : cluster [DBG] pgmap v11895: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:13:48.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:13:47 smithi047 bash[22744]: cluster 2024-09-16T12:13:46.797412+0000 mgr.a (mgr.14373) 17151 : cluster [DBG] pgmap v11895: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:13:49.467 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:13:49.468 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:13:49.468 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:13:50.232 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:13:50.232 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:13:50.232 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:13:50.232 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:13:50.232 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:13:50.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:13:49 smithi157 bash[24585]: cluster 2024-09-16T12:13:48.798169+0000 mgr.a (mgr.14373) 17152 : cluster [DBG] pgmap v11896: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:13:50.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:13:49 smithi086 bash[24289]: cluster 2024-09-16T12:13:48.798169+0000 mgr.a (mgr.14373) 17152 : cluster [DBG] pgmap v11896: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:13:50.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:13:49 smithi047 bash[22744]: cluster 2024-09-16T12:13:48.798169+0000 mgr.a (mgr.14373) 17152 : cluster [DBG] pgmap v11896: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:13:51.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:13:50 smithi157 bash[24585]: audit 2024-09-16T12:13:49.798376+0000 mgr.a (mgr.14373) 17153 : audit [DBG] from='client.368970 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:13:51.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:13:50 smithi086 bash[24289]: audit 2024-09-16T12:13:49.798376+0000 mgr.a (mgr.14373) 17153 : audit [DBG] from='client.368970 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:13:51.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:13:50 smithi047 bash[22744]: audit 2024-09-16T12:13:49.798376+0000 mgr.a (mgr.14373) 17153 : audit [DBG] from='client.368970 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:13:52.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:13:51 smithi157 bash[24585]: cluster 2024-09-16T12:13:50.799092+0000 mgr.a (mgr.14373) 17154 : cluster [DBG] pgmap v11897: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:13:52.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:13:51 smithi086 bash[24289]: cluster 2024-09-16T12:13:50.799092+0000 mgr.a (mgr.14373) 17154 : cluster [DBG] pgmap v11897: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:13:52.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:13:51 smithi047 bash[22744]: cluster 2024-09-16T12:13:50.799092+0000 mgr.a (mgr.14373) 17154 : cluster [DBG] pgmap v11897: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:13:54.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:13:53 smithi157 bash[24585]: cluster 2024-09-16T12:13:52.801281+0000 mgr.a (mgr.14373) 17155 : cluster [DBG] pgmap v11898: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:13:54.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:13:53 smithi086 bash[24289]: cluster 2024-09-16T12:13:52.801281+0000 mgr.a (mgr.14373) 17155 : cluster [DBG] pgmap v11898: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:13:54.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:13:53 smithi047 bash[22744]: cluster 2024-09-16T12:13:52.801281+0000 mgr.a (mgr.14373) 17155 : cluster [DBG] pgmap v11898: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:13:55.233 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:13:55.234 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:13:55.234 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:13:56.030 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:13:56.030 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:13:56.030 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:13:56.030 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:13:56.030 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:13:56.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:13:55 smithi157 bash[24585]: cluster 2024-09-16T12:13:54.802050+0000 mgr.a (mgr.14373) 17156 : cluster [DBG] pgmap v11899: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:13:56.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:13:55 smithi086 bash[24289]: cluster 2024-09-16T12:13:54.802050+0000 mgr.a (mgr.14373) 17156 : cluster [DBG] pgmap v11899: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:13:56.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:13:55 smithi047 bash[22744]: cluster 2024-09-16T12:13:54.802050+0000 mgr.a (mgr.14373) 17156 : cluster [DBG] pgmap v11899: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:13:57.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:13:56 smithi157 bash[24585]: audit 2024-09-16T12:13:55.570716+0000 mgr.a (mgr.14373) 17157 : audit [DBG] from='client.369048 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:13:57.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:13:56 smithi086 bash[24289]: audit 2024-09-16T12:13:55.570716+0000 mgr.a (mgr.14373) 17157 : audit [DBG] from='client.369048 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:13:57.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:13:56 smithi047 bash[22744]: audit 2024-09-16T12:13:55.570716+0000 mgr.a (mgr.14373) 17157 : audit [DBG] from='client.369048 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:13:58.311 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:13:57 smithi157 bash[24585]: cluster 2024-09-16T12:13:56.804403+0000 mgr.a (mgr.14373) 17158 : cluster [DBG] pgmap v11900: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:13:58.340 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:13:57 smithi086 bash[24289]: cluster 2024-09-16T12:13:56.804403+0000 mgr.a (mgr.14373) 17158 : cluster [DBG] pgmap v11900: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:13:58.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:13:57 smithi047 bash[22744]: cluster 2024-09-16T12:13:56.804403+0000 mgr.a (mgr.14373) 17158 : cluster [DBG] pgmap v11900: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:13:59.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:13:58 smithi157 bash[24585]: cluster 2024-09-16T12:13:58.805188+0000 mgr.a (mgr.14373) 17159 : cluster [DBG] pgmap v11901: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:13:59.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:13:58 smithi086 bash[24289]: cluster 2024-09-16T12:13:58.805188+0000 mgr.a (mgr.14373) 17159 : cluster [DBG] pgmap v11901: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:13:59.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:13:58 smithi047 bash[22744]: cluster 2024-09-16T12:13:58.805188+0000 mgr.a (mgr.14373) 17159 : cluster [DBG] pgmap v11901: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:14:01.031 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:14:01.032 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:14:01.032 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:14:01.795 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:14:01.796 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:14:01.796 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:14:01.796 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:14:01.796 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:14:02.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:14:01 smithi157 bash[24585]: cluster 2024-09-16T12:14:00.805961+0000 mgr.a (mgr.14373) 17160 : cluster [DBG] pgmap v11902: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:14:02.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:14:01 smithi086 bash[24289]: cluster 2024-09-16T12:14:00.805961+0000 mgr.a (mgr.14373) 17160 : cluster [DBG] pgmap v11902: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:14:02.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:14:01 smithi047 bash[22744]: cluster 2024-09-16T12:14:00.805961+0000 mgr.a (mgr.14373) 17160 : cluster [DBG] pgmap v11902: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:14:03.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:14:02 smithi157 bash[24585]: audit 2024-09-16T12:14:01.363295+0000 mgr.a (mgr.14373) 17161 : audit [DBG] from='client.369126 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:14:03.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:14:02 smithi086 bash[24289]: audit 2024-09-16T12:14:01.363295+0000 mgr.a (mgr.14373) 17161 : audit [DBG] from='client.369126 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:14:03.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:14:02 smithi047 bash[22744]: audit 2024-09-16T12:14:01.363295+0000 mgr.a (mgr.14373) 17161 : audit [DBG] from='client.369126 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:14:04.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:14:03 smithi157 bash[24585]: cluster 2024-09-16T12:14:02.808678+0000 mgr.a (mgr.14373) 17162 : cluster [DBG] pgmap v11903: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:14:04.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:14:03 smithi086 bash[24289]: cluster 2024-09-16T12:14:02.808678+0000 mgr.a (mgr.14373) 17162 : cluster [DBG] pgmap v11903: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:14:04.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:14:03 smithi047 bash[22744]: cluster 2024-09-16T12:14:02.808678+0000 mgr.a (mgr.14373) 17162 : cluster [DBG] pgmap v11903: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:14:06.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:14:05 smithi157 bash[24585]: cluster 2024-09-16T12:14:04.809496+0000 mgr.a (mgr.14373) 17163 : cluster [DBG] pgmap v11904: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:14:06.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:14:05 smithi086 bash[24289]: cluster 2024-09-16T12:14:04.809496+0000 mgr.a (mgr.14373) 17163 : cluster [DBG] pgmap v11904: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:14:06.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:14:05 smithi047 bash[22744]: cluster 2024-09-16T12:14:04.809496+0000 mgr.a (mgr.14373) 17163 : cluster [DBG] pgmap v11904: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:14:06.797 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:14:06.798 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:14:06.798 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:14:07.556 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:14:07.557 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:14:07.557 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:14:07.557 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:14:07.557 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:14:08.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:14:07 smithi157 bash[24585]: cluster 2024-09-16T12:14:06.811519+0000 mgr.a (mgr.14373) 17164 : cluster [DBG] pgmap v11905: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:14:08.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:14:07 smithi086 bash[24289]: cluster 2024-09-16T12:14:06.811519+0000 mgr.a (mgr.14373) 17164 : cluster [DBG] pgmap v11905: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:14:08.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:14:07 smithi047 bash[22744]: cluster 2024-09-16T12:14:06.811519+0000 mgr.a (mgr.14373) 17164 : cluster [DBG] pgmap v11905: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:14:09.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:14:08 smithi157 bash[24585]: audit 2024-09-16T12:14:07.130633+0000 mgr.a (mgr.14373) 17165 : audit [DBG] from='client.369201 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:14:09.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:14:08 smithi086 bash[24289]: audit 2024-09-16T12:14:07.130633+0000 mgr.a (mgr.14373) 17165 : audit [DBG] from='client.369201 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:14:09.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:14:08 smithi047 bash[22744]: audit 2024-09-16T12:14:07.130633+0000 mgr.a (mgr.14373) 17165 : audit [DBG] from='client.369201 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:14:10.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:14:09 smithi157 bash[24585]: cluster 2024-09-16T12:14:08.812437+0000 mgr.a (mgr.14373) 17166 : cluster [DBG] pgmap v11906: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:14:10.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:14:09 smithi086 bash[24289]: cluster 2024-09-16T12:14:08.812437+0000 mgr.a (mgr.14373) 17166 : cluster [DBG] pgmap v11906: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:14:10.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:14:09 smithi047 bash[22744]: cluster 2024-09-16T12:14:08.812437+0000 mgr.a (mgr.14373) 17166 : cluster [DBG] pgmap v11906: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:14:11.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:14:10 smithi157 bash[24585]: cluster 2024-09-16T12:14:10.813213+0000 mgr.a (mgr.14373) 17167 : cluster [DBG] pgmap v11907: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T12:14:11.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:14:10 smithi086 bash[24289]: cluster 2024-09-16T12:14:10.813213+0000 mgr.a (mgr.14373) 17167 : cluster [DBG] pgmap v11907: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T12:14:11.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:14:10 smithi047 bash[22744]: cluster 2024-09-16T12:14:10.813213+0000 mgr.a (mgr.14373) 17167 : cluster [DBG] pgmap v11907: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T12:14:12.558 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:14:12.559 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:14:12.559 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:14:13.339 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:14:13.339 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:14:13.339 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:14:13.339 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:14:13.339 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:14:14.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:14:13 smithi157 bash[24585]: cluster 2024-09-16T12:14:12.815401+0000 mgr.a (mgr.14373) 17168 : cluster [DBG] pgmap v11908: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:14:14.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:14:13 smithi086 bash[24289]: cluster 2024-09-16T12:14:12.815401+0000 mgr.a (mgr.14373) 17168 : cluster [DBG] pgmap v11908: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:14:14.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:14:13 smithi047 bash[22744]: cluster 2024-09-16T12:14:12.815401+0000 mgr.a (mgr.14373) 17168 : cluster [DBG] pgmap v11908: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:14:15.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:14:14 smithi157 bash[24585]: audit 2024-09-16T12:14:12.891157+0000 mgr.a (mgr.14373) 17169 : audit [DBG] from='client.369279 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:14:15.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:14:14 smithi086 bash[24289]: audit 2024-09-16T12:14:12.891157+0000 mgr.a (mgr.14373) 17169 : audit [DBG] from='client.369279 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:14:15.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:14:14 smithi047 bash[22744]: audit 2024-09-16T12:14:12.891157+0000 mgr.a (mgr.14373) 17169 : audit [DBG] from='client.369279 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:14:16.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:14:15 smithi157 bash[24585]: cluster 2024-09-16T12:14:14.816291+0000 mgr.a (mgr.14373) 17170 : cluster [DBG] pgmap v11909: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:14:16.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:14:15 smithi086 bash[24289]: cluster 2024-09-16T12:14:14.816291+0000 mgr.a (mgr.14373) 17170 : cluster [DBG] pgmap v11909: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:14:16.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:14:15 smithi047 bash[22744]: cluster 2024-09-16T12:14:14.816291+0000 mgr.a (mgr.14373) 17170 : cluster [DBG] pgmap v11909: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:14:18.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:14:17 smithi157 bash[24585]: cluster 2024-09-16T12:14:16.818437+0000 mgr.a (mgr.14373) 17171 : cluster [DBG] pgmap v11910: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:14:18.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:14:17 smithi086 bash[24289]: cluster 2024-09-16T12:14:16.818437+0000 mgr.a (mgr.14373) 17171 : cluster [DBG] pgmap v11910: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:14:18.340 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:14:18.341 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:14:18.341 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:14:18.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:14:17 smithi047 bash[22744]: cluster 2024-09-16T12:14:16.818437+0000 mgr.a (mgr.14373) 17171 : cluster [DBG] pgmap v11910: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:14:19.096 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:14:19.096 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:14:19.096 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:14:19.097 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:14:19.097 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:14:20.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:14:19 smithi157 bash[24585]: audit 2024-09-16T12:14:18.668799+0000 mgr.a (mgr.14373) 17172 : audit [DBG] from='client.369357 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:14:20.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:14:19 smithi157 bash[24585]: cluster 2024-09-16T12:14:18.818973+0000 mgr.a (mgr.14373) 17173 : cluster [DBG] pgmap v11911: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:14:20.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:14:19 smithi086 bash[24289]: audit 2024-09-16T12:14:18.668799+0000 mgr.a (mgr.14373) 17172 : audit [DBG] from='client.369357 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:14:20.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:14:19 smithi086 bash[24289]: cluster 2024-09-16T12:14:18.818973+0000 mgr.a (mgr.14373) 17173 : cluster [DBG] pgmap v11911: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:14:20.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:14:19 smithi047 bash[22744]: audit 2024-09-16T12:14:18.668799+0000 mgr.a (mgr.14373) 17172 : audit [DBG] from='client.369357 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:14:20.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:14:19 smithi047 bash[22744]: cluster 2024-09-16T12:14:18.818973+0000 mgr.a (mgr.14373) 17173 : cluster [DBG] pgmap v11911: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:14:22.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:14:21 smithi157 bash[24585]: cluster 2024-09-16T12:14:20.819843+0000 mgr.a (mgr.14373) 17174 : cluster [DBG] pgmap v11912: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:14:22.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:14:21 smithi086 bash[24289]: cluster 2024-09-16T12:14:20.819843+0000 mgr.a (mgr.14373) 17174 : cluster [DBG] pgmap v11912: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:14:22.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:14:21 smithi047 bash[22744]: cluster 2024-09-16T12:14:20.819843+0000 mgr.a (mgr.14373) 17174 : cluster [DBG] pgmap v11912: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:14:24.098 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:14:24.098 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:14:24.099 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:14:24.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:14:23 smithi157 bash[24585]: cluster 2024-09-16T12:14:22.822092+0000 mgr.a (mgr.14373) 17175 : cluster [DBG] pgmap v11913: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:14:24.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:14:23 smithi086 bash[24289]: cluster 2024-09-16T12:14:22.822092+0000 mgr.a (mgr.14373) 17175 : cluster [DBG] pgmap v11913: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:14:24.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:14:23 smithi047 bash[22744]: cluster 2024-09-16T12:14:22.822092+0000 mgr.a (mgr.14373) 17175 : cluster [DBG] pgmap v11913: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:14:24.862 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:14:24.863 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:14:24.863 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:14:24.863 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:14:24.863 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:14:26.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:14:25 smithi157 bash[24585]: audit 2024-09-16T12:14:24.422974+0000 mgr.a (mgr.14373) 17176 : audit [DBG] from='client.369432 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:14:26.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:14:25 smithi157 bash[24585]: cluster 2024-09-16T12:14:24.822671+0000 mgr.a (mgr.14373) 17177 : cluster [DBG] pgmap v11914: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:14:26.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:14:25 smithi086 bash[24289]: audit 2024-09-16T12:14:24.422974+0000 mgr.a (mgr.14373) 17176 : audit [DBG] from='client.369432 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:14:26.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:14:25 smithi086 bash[24289]: cluster 2024-09-16T12:14:24.822671+0000 mgr.a (mgr.14373) 17177 : cluster [DBG] pgmap v11914: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:14:26.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:14:25 smithi047 bash[22744]: audit 2024-09-16T12:14:24.422974+0000 mgr.a (mgr.14373) 17176 : audit [DBG] from='client.369432 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:14:26.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:14:25 smithi047 bash[22744]: cluster 2024-09-16T12:14:24.822671+0000 mgr.a (mgr.14373) 17177 : cluster [DBG] pgmap v11914: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:14:27.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:14:26 smithi157 bash[24585]: cluster 2024-09-16T12:14:26.824780+0000 mgr.a (mgr.14373) 17178 : cluster [DBG] pgmap v11915: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:14:27.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:14:26 smithi086 bash[24289]: cluster 2024-09-16T12:14:26.824780+0000 mgr.a (mgr.14373) 17178 : cluster [DBG] pgmap v11915: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:14:27.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:14:26 smithi047 bash[22744]: cluster 2024-09-16T12:14:26.824780+0000 mgr.a (mgr.14373) 17178 : cluster [DBG] pgmap v11915: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:14:29.864 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:14:29.865 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:14:29.865 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:14:30.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:14:29 smithi157 bash[24585]: cluster 2024-09-16T12:14:28.825568+0000 mgr.a (mgr.14373) 17179 : cluster [DBG] pgmap v11916: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:14:30.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:14:29 smithi086 bash[24289]: cluster 2024-09-16T12:14:28.825568+0000 mgr.a (mgr.14373) 17179 : cluster [DBG] pgmap v11916: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:14:30.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:14:29 smithi047 bash[22744]: cluster 2024-09-16T12:14:28.825568+0000 mgr.a (mgr.14373) 17179 : cluster [DBG] pgmap v11916: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:14:30.617 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:14:30.617 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:14:30.617 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:14:30.617 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:14:30.617 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:14:32.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:14:31 smithi157 bash[24585]: audit 2024-09-16T12:14:30.195449+0000 mgr.a (mgr.14373) 17180 : audit [DBG] from='client.369507 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:14:32.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:14:31 smithi157 bash[24585]: cluster 2024-09-16T12:14:30.826572+0000 mgr.a (mgr.14373) 17181 : cluster [DBG] pgmap v11917: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:14:32.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:14:31 smithi086 bash[24289]: audit 2024-09-16T12:14:30.195449+0000 mgr.a (mgr.14373) 17180 : audit [DBG] from='client.369507 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:14:32.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:14:31 smithi086 bash[24289]: cluster 2024-09-16T12:14:30.826572+0000 mgr.a (mgr.14373) 17181 : cluster [DBG] pgmap v11917: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:14:32.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:14:31 smithi047 bash[22744]: audit 2024-09-16T12:14:30.195449+0000 mgr.a (mgr.14373) 17180 : audit [DBG] from='client.369507 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:14:32.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:14:31 smithi047 bash[22744]: cluster 2024-09-16T12:14:30.826572+0000 mgr.a (mgr.14373) 17181 : cluster [DBG] pgmap v11917: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:14:34.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:14:33 smithi157 bash[24585]: cluster 2024-09-16T12:14:32.828790+0000 mgr.a (mgr.14373) 17182 : cluster [DBG] pgmap v11918: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:14:34.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:14:33 smithi086 bash[24289]: cluster 2024-09-16T12:14:32.828790+0000 mgr.a (mgr.14373) 17182 : cluster [DBG] pgmap v11918: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:14:34.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:14:33 smithi047 bash[22744]: cluster 2024-09-16T12:14:32.828790+0000 mgr.a (mgr.14373) 17182 : cluster [DBG] pgmap v11918: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:14:35.619 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:14:35.620 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:14:35.620 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:14:36.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:14:35 smithi157 bash[24585]: cluster 2024-09-16T12:14:34.829552+0000 mgr.a (mgr.14373) 17183 : cluster [DBG] pgmap v11919: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:14:36.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:14:35 smithi086 bash[24289]: cluster 2024-09-16T12:14:34.829552+0000 mgr.a (mgr.14373) 17183 : cluster [DBG] pgmap v11919: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:14:36.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:14:35 smithi047 bash[22744]: cluster 2024-09-16T12:14:34.829552+0000 mgr.a (mgr.14373) 17183 : cluster [DBG] pgmap v11919: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:14:36.408 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:14:36.408 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:14:36.408 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:14:36.408 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:14:36.408 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:14:38.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:14:37 smithi157 bash[24585]: audit 2024-09-16T12:14:35.956117+0000 mgr.a (mgr.14373) 17184 : audit [DBG] from='client.369585 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:14:38.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:14:37 smithi157 bash[24585]: cluster 2024-09-16T12:14:36.831946+0000 mgr.a (mgr.14373) 17185 : cluster [DBG] pgmap v11920: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:14:38.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:14:37 smithi086 bash[24289]: audit 2024-09-16T12:14:35.956117+0000 mgr.a (mgr.14373) 17184 : audit [DBG] from='client.369585 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:14:38.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:14:37 smithi086 bash[24289]: cluster 2024-09-16T12:14:36.831946+0000 mgr.a (mgr.14373) 17185 : cluster [DBG] pgmap v11920: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:14:38.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:14:37 smithi047 bash[22744]: audit 2024-09-16T12:14:35.956117+0000 mgr.a (mgr.14373) 17184 : audit [DBG] from='client.369585 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:14:38.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:14:37 smithi047 bash[22744]: cluster 2024-09-16T12:14:36.831946+0000 mgr.a (mgr.14373) 17185 : cluster [DBG] pgmap v11920: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:14:39.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:14:38 smithi157 bash[24585]: cluster 2024-09-16T12:14:38.832891+0000 mgr.a (mgr.14373) 17186 : cluster [DBG] pgmap v11921: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:14:39.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:14:38 smithi086 bash[24289]: cluster 2024-09-16T12:14:38.832891+0000 mgr.a (mgr.14373) 17186 : cluster [DBG] pgmap v11921: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:14:39.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:14:38 smithi047 bash[22744]: cluster 2024-09-16T12:14:38.832891+0000 mgr.a (mgr.14373) 17186 : cluster [DBG] pgmap v11921: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:14:41.410 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:14:41.410 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:14:41.410 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:14:42.197 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:14:42.197 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:14:42.197 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:14:42.197 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:14:42.198 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:14:42.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:14:41 smithi157 bash[24585]: cluster 2024-09-16T12:14:40.833822+0000 mgr.a (mgr.14373) 17187 : cluster [DBG] pgmap v11922: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:14:42.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:14:41 smithi157 bash[24585]: audit 2024-09-16T12:14:41.396665+0000 mon.b (mon.2) 1558 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T12:14:42.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:14:41 smithi086 bash[24289]: cluster 2024-09-16T12:14:40.833822+0000 mgr.a (mgr.14373) 17187 : cluster [DBG] pgmap v11922: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:14:42.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:14:41 smithi086 bash[24289]: audit 2024-09-16T12:14:41.396665+0000 mon.b (mon.2) 1558 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T12:14:42.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:14:41 smithi047 bash[22744]: cluster 2024-09-16T12:14:40.833822+0000 mgr.a (mgr.14373) 17187 : cluster [DBG] pgmap v11922: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:14:42.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:14:41 smithi047 bash[22744]: audit 2024-09-16T12:14:41.396665+0000 mon.b (mon.2) 1558 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T12:14:43.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:14:42 smithi157 bash[24585]: audit 2024-09-16T12:14:41.748649+0000 mgr.a (mgr.14373) 17188 : audit [DBG] from='client.369660 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:14:43.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:14:42 smithi086 bash[24289]: audit 2024-09-16T12:14:41.748649+0000 mgr.a (mgr.14373) 17188 : audit [DBG] from='client.369660 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:14:43.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:14:42 smithi047 bash[22744]: audit 2024-09-16T12:14:41.748649+0000 mgr.a (mgr.14373) 17188 : audit [DBG] from='client.369660 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:14:44.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:14:43 smithi157 bash[24585]: cluster 2024-09-16T12:14:42.836511+0000 mgr.a (mgr.14373) 17189 : cluster [DBG] pgmap v11923: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:14:44.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:14:43 smithi086 bash[24289]: cluster 2024-09-16T12:14:42.836511+0000 mgr.a (mgr.14373) 17189 : cluster [DBG] pgmap v11923: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:14:44.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:14:43 smithi047 bash[22744]: cluster 2024-09-16T12:14:42.836511+0000 mgr.a (mgr.14373) 17189 : cluster [DBG] pgmap v11923: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:14:46.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:14:45 smithi157 bash[24585]: cluster 2024-09-16T12:14:44.837448+0000 mgr.a (mgr.14373) 17190 : cluster [DBG] pgmap v11924: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:14:46.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:14:45 smithi086 bash[24289]: cluster 2024-09-16T12:14:44.837448+0000 mgr.a (mgr.14373) 17190 : cluster [DBG] pgmap v11924: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:14:46.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:14:45 smithi047 bash[22744]: cluster 2024-09-16T12:14:44.837448+0000 mgr.a (mgr.14373) 17190 : cluster [DBG] pgmap v11924: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:14:47.199 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:14:47.200 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:14:47.200 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:14:47.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:14:46 smithi157 bash[24585]: cluster 2024-09-16T12:14:46.839432+0000 mgr.a (mgr.14373) 17191 : cluster [DBG] pgmap v11925: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:14:47.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:14:46 smithi086 bash[24289]: cluster 2024-09-16T12:14:46.839432+0000 mgr.a (mgr.14373) 17191 : cluster [DBG] pgmap v11925: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:14:47.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:14:46 smithi047 bash[22744]: cluster 2024-09-16T12:14:46.839432+0000 mgr.a (mgr.14373) 17191 : cluster [DBG] pgmap v11925: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:14:47.975 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:14:47.975 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:14:47.976 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:14:47.976 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:14:47.976 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:14:48.278 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:14:47 smithi157 bash[24585]: audit 2024-09-16T12:14:47.532011+0000 mgr.a (mgr.14373) 17192 : audit [DBG] from='client.369735 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:14:48.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:14:47 smithi086 bash[24289]: audit 2024-09-16T12:14:47.532011+0000 mgr.a (mgr.14373) 17192 : audit [DBG] from='client.369735 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:14:48.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:14:47 smithi047 bash[22744]: audit 2024-09-16T12:14:47.532011+0000 mgr.a (mgr.14373) 17192 : audit [DBG] from='client.369735 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:14:49.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:14:48 smithi157 bash[24585]: cluster 2024-09-16T12:14:48.840296+0000 mgr.a (mgr.14373) 17193 : cluster [DBG] pgmap v11926: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:14:49.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:14:48 smithi086 bash[24289]: cluster 2024-09-16T12:14:48.840296+0000 mgr.a (mgr.14373) 17193 : cluster [DBG] pgmap v11926: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:14:49.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:14:48 smithi047 bash[22744]: cluster 2024-09-16T12:14:48.840296+0000 mgr.a (mgr.14373) 17193 : cluster [DBG] pgmap v11926: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:14:52.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:14:51 smithi157 bash[24585]: cluster 2024-09-16T12:14:50.841056+0000 mgr.a (mgr.14373) 17194 : cluster [DBG] pgmap v11927: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T12:14:52.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:14:51 smithi157 bash[24585]: audit 2024-09-16T12:14:51.878481+0000 mon.a (mon.0) 1593 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:14:52.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:14:51 smithi157 bash[24585]: audit 2024-09-16T12:14:51.889867+0000 mon.a (mon.0) 1594 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:14:52.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:14:51 smithi157 bash[24585]: audit 2024-09-16T12:14:51.893001+0000 mon.b (mon.2) 1559 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T12:14:52.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:14:51 smithi086 bash[24289]: cluster 2024-09-16T12:14:50.841056+0000 mgr.a (mgr.14373) 17194 : cluster [DBG] pgmap v11927: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T12:14:52.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:14:51 smithi086 bash[24289]: audit 2024-09-16T12:14:51.878481+0000 mon.a (mon.0) 1593 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:14:52.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:14:51 smithi086 bash[24289]: audit 2024-09-16T12:14:51.889867+0000 mon.a (mon.0) 1594 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:14:52.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:14:51 smithi086 bash[24289]: audit 2024-09-16T12:14:51.893001+0000 mon.b (mon.2) 1559 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T12:14:52.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:14:51 smithi047 bash[22744]: cluster 2024-09-16T12:14:50.841056+0000 mgr.a (mgr.14373) 17194 : cluster [DBG] pgmap v11927: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T12:14:52.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:14:51 smithi047 bash[22744]: audit 2024-09-16T12:14:51.878481+0000 mon.a (mon.0) 1593 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:14:52.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:14:51 smithi047 bash[22744]: audit 2024-09-16T12:14:51.889867+0000 mon.a (mon.0) 1594 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:14:52.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:14:51 smithi047 bash[22744]: audit 2024-09-16T12:14:51.893001+0000 mon.b (mon.2) 1559 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T12:14:52.977 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:14:52.977 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:14:52.978 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:14:53.093 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 12:14:52 smithi047 bash[22994]: debug 2024-09-16T12:14:52.706+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T12:14:53.093 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 12:14:52 smithi047 bash[22994]: debug 2024-09-16T12:14:52.710+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T12:14:53.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:14:52 smithi047 bash[22744]: audit 2024-09-16T12:14:51.895301+0000 mon.b (mon.2) 1560 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T12:14:53.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:14:52 smithi047 bash[22744]: audit 2024-09-16T12:14:51.909855+0000 mon.a (mon.0) 1595 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:14:53.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:14:52 smithi047 bash[22744]: audit 2024-09-16T12:14:51.915279+0000 mon.b (mon.2) 1561 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:14:53.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:14:52 smithi157 bash[24585]: audit 2024-09-16T12:14:51.895301+0000 mon.b (mon.2) 1560 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T12:14:53.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:14:52 smithi157 bash[24585]: audit 2024-09-16T12:14:51.909855+0000 mon.a (mon.0) 1595 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:14:53.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:14:52 smithi157 bash[24585]: audit 2024-09-16T12:14:51.915279+0000 mon.b (mon.2) 1561 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:14:53.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:14:52 smithi086 bash[24289]: audit 2024-09-16T12:14:51.895301+0000 mon.b (mon.2) 1560 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T12:14:53.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:14:52 smithi086 bash[24289]: audit 2024-09-16T12:14:51.909855+0000 mon.a (mon.0) 1595 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:14:53.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:14:52 smithi086 bash[24289]: audit 2024-09-16T12:14:51.915279+0000 mon.b (mon.2) 1561 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:14:53.733 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:14:53.733 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:14:53.733 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:14:53.733 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:14:53.733 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:14:54.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:14:53 smithi157 bash[24585]: audit 2024-09-16T12:14:51.917745+0000 mgr.a (mgr.14373) 17195 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:14:54.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:14:53 smithi157 bash[24585]: audit 2024-09-16T12:14:52.708965+0000 mgr.a (mgr.14373) 17196 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T12:14:54.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:14:53 smithi157 bash[24585]: cephadm 2024-09-16T12:14:52.710993+0000 mgr.a (mgr.14373) 17197 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T12:14:54.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:14:53 smithi157 bash[24585]: cluster 2024-09-16T12:14:52.843881+0000 mgr.a (mgr.14373) 17198 : cluster [DBG] pgmap v11928: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:14:54.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:14:53 smithi086 bash[24289]: audit 2024-09-16T12:14:51.917745+0000 mgr.a (mgr.14373) 17195 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:14:54.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:14:53 smithi086 bash[24289]: audit 2024-09-16T12:14:52.708965+0000 mgr.a (mgr.14373) 17196 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T12:14:54.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:14:53 smithi086 bash[24289]: cephadm 2024-09-16T12:14:52.710993+0000 mgr.a (mgr.14373) 17197 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T12:14:54.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:14:53 smithi086 bash[24289]: cluster 2024-09-16T12:14:52.843881+0000 mgr.a (mgr.14373) 17198 : cluster [DBG] pgmap v11928: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:14:54.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:14:53 smithi047 bash[22744]: audit 2024-09-16T12:14:51.917745+0000 mgr.a (mgr.14373) 17195 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:14:54.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:14:53 smithi047 bash[22744]: audit 2024-09-16T12:14:52.708965+0000 mgr.a (mgr.14373) 17196 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T12:14:54.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:14:53 smithi047 bash[22744]: cephadm 2024-09-16T12:14:52.710993+0000 mgr.a (mgr.14373) 17197 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T12:14:54.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:14:53 smithi047 bash[22744]: cluster 2024-09-16T12:14:52.843881+0000 mgr.a (mgr.14373) 17198 : cluster [DBG] pgmap v11928: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:14:55.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:14:54 smithi157 bash[24585]: audit 2024-09-16T12:14:53.305677+0000 mgr.a (mgr.14373) 17199 : audit [DBG] from='client.369912 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:14:55.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:14:54 smithi086 bash[24289]: audit 2024-09-16T12:14:53.305677+0000 mgr.a (mgr.14373) 17199 : audit [DBG] from='client.369912 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:14:55.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:14:54 smithi047 bash[22744]: audit 2024-09-16T12:14:53.305677+0000 mgr.a (mgr.14373) 17199 : audit [DBG] from='client.369912 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:14:56.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:14:55 smithi157 bash[24585]: cluster 2024-09-16T12:14:54.844779+0000 mgr.a (mgr.14373) 17200 : cluster [DBG] pgmap v11929: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:14:56.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:14:55 smithi086 bash[24289]: cluster 2024-09-16T12:14:54.844779+0000 mgr.a (mgr.14373) 17200 : cluster [DBG] pgmap v11929: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:14:56.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:14:55 smithi047 bash[22744]: cluster 2024-09-16T12:14:54.844779+0000 mgr.a (mgr.14373) 17200 : cluster [DBG] pgmap v11929: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:14:57.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:14:56 smithi157 bash[24585]: cluster 2024-09-16T12:14:56.846956+0000 mgr.a (mgr.14373) 17201 : cluster [DBG] pgmap v11930: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:14:57.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:14:56 smithi086 bash[24289]: cluster 2024-09-16T12:14:56.846956+0000 mgr.a (mgr.14373) 17201 : cluster [DBG] pgmap v11930: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:14:57.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:14:56 smithi047 bash[22744]: cluster 2024-09-16T12:14:56.846956+0000 mgr.a (mgr.14373) 17201 : cluster [DBG] pgmap v11930: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:14:58.734 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:14:58.735 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:14:58.735 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:14:59.515 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:14:59.516 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:14:59.516 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:14:59.516 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:14:59.516 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:15:00.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:14:59 smithi157 bash[24585]: cluster 2024-09-16T12:14:58.847384+0000 mgr.a (mgr.14373) 17202 : cluster [DBG] pgmap v11931: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:15:00.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:14:59 smithi086 bash[24289]: cluster 2024-09-16T12:14:58.847384+0000 mgr.a (mgr.14373) 17202 : cluster [DBG] pgmap v11931: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:15:00.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:14:59 smithi047 bash[22744]: cluster 2024-09-16T12:14:58.847384+0000 mgr.a (mgr.14373) 17202 : cluster [DBG] pgmap v11931: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:15:01.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:15:00 smithi157 bash[24585]: audit 2024-09-16T12:14:59.073378+0000 mgr.a (mgr.14373) 17203 : audit [DBG] from='client.369990 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:15:01.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:15:00 smithi086 bash[24289]: audit 2024-09-16T12:14:59.073378+0000 mgr.a (mgr.14373) 17203 : audit [DBG] from='client.369990 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:15:01.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:15:00 smithi047 bash[22744]: audit 2024-09-16T12:14:59.073378+0000 mgr.a (mgr.14373) 17203 : audit [DBG] from='client.369990 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:15:02.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:15:01 smithi047 bash[22744]: cluster 2024-09-16T12:15:00.848217+0000 mgr.a (mgr.14373) 17204 : cluster [DBG] pgmap v11932: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:15:02.306 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:15:01 smithi157 bash[24585]: cluster 2024-09-16T12:15:00.848217+0000 mgr.a (mgr.14373) 17204 : cluster [DBG] pgmap v11932: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:15:02.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:15:01 smithi086 bash[24289]: cluster 2024-09-16T12:15:00.848217+0000 mgr.a (mgr.14373) 17204 : cluster [DBG] pgmap v11932: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:15:03.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:15:02 smithi157 bash[24585]: cluster 2024-09-16T12:15:02.850470+0000 mgr.a (mgr.14373) 17205 : cluster [DBG] pgmap v11933: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:15:03.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:15:02 smithi086 bash[24289]: cluster 2024-09-16T12:15:02.850470+0000 mgr.a (mgr.14373) 17205 : cluster [DBG] pgmap v11933: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:15:03.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:15:02 smithi047 bash[22744]: cluster 2024-09-16T12:15:02.850470+0000 mgr.a (mgr.14373) 17205 : cluster [DBG] pgmap v11933: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:15:04.517 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:15:04.518 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:15:04.518 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:15:05.270 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:15:05.271 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:15:05.271 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:15:05.271 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:15:05.271 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:15:05.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:15:04 smithi157 bash[24585]: audit 2024-09-16T12:15:04.849407+0000 mgr.a (mgr.14373) 17206 : audit [DBG] from='client.370068 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:15:05.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:15:04 smithi157 bash[24585]: cluster 2024-09-16T12:15:04.864060+0000 mgr.a (mgr.14373) 17207 : cluster [DBG] pgmap v11934: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 425 B/s wr, 7 op/s 2024-09-16T12:15:05.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:15:04 smithi086 bash[24289]: audit 2024-09-16T12:15:04.849407+0000 mgr.a (mgr.14373) 17206 : audit [DBG] from='client.370068 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:15:05.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:15:04 smithi086 bash[24289]: cluster 2024-09-16T12:15:04.864060+0000 mgr.a (mgr.14373) 17207 : cluster [DBG] pgmap v11934: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 425 B/s wr, 7 op/s 2024-09-16T12:15:05.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:15:04 smithi047 bash[22744]: audit 2024-09-16T12:15:04.849407+0000 mgr.a (mgr.14373) 17206 : audit [DBG] from='client.370068 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:15:05.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:15:04 smithi047 bash[22744]: cluster 2024-09-16T12:15:04.864060+0000 mgr.a (mgr.14373) 17207 : cluster [DBG] pgmap v11934: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 425 B/s wr, 7 op/s 2024-09-16T12:15:07.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:15:06 smithi157 bash[24585]: cluster 2024-09-16T12:15:06.866488+0000 mgr.a (mgr.14373) 17208 : cluster [DBG] pgmap v11935: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 425 B/s wr, 7 op/s 2024-09-16T12:15:07.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:15:06 smithi086 bash[24289]: cluster 2024-09-16T12:15:06.866488+0000 mgr.a (mgr.14373) 17208 : cluster [DBG] pgmap v11935: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 425 B/s wr, 7 op/s 2024-09-16T12:15:07.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:15:06 smithi047 bash[22744]: cluster 2024-09-16T12:15:06.866488+0000 mgr.a (mgr.14373) 17208 : cluster [DBG] pgmap v11935: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 425 B/s wr, 7 op/s 2024-09-16T12:15:09.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:15:08 smithi157 bash[24585]: cluster 2024-09-16T12:15:08.867246+0000 mgr.a (mgr.14373) 17209 : cluster [DBG] pgmap v11936: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:15:09.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:15:08 smithi086 bash[24289]: cluster 2024-09-16T12:15:08.867246+0000 mgr.a (mgr.14373) 17209 : cluster [DBG] pgmap v11936: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:15:09.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:15:08 smithi047 bash[22744]: cluster 2024-09-16T12:15:08.867246+0000 mgr.a (mgr.14373) 17209 : cluster [DBG] pgmap v11936: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:15:10.272 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:15:10.273 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:15:10.273 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:15:11.043 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:15:11.043 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:15:11.043 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:15:11.043 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:15:11.043 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:15:11.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:15:10 smithi157 bash[24585]: audit 2024-09-16T12:15:10.605780+0000 mgr.a (mgr.14373) 17210 : audit [DBG] from='client.370140 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:15:11.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:15:10 smithi157 bash[24585]: cluster 2024-09-16T12:15:10.867813+0000 mgr.a (mgr.14373) 17211 : cluster [DBG] pgmap v11937: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:15:11.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:15:10 smithi086 bash[24289]: audit 2024-09-16T12:15:10.605780+0000 mgr.a (mgr.14373) 17210 : audit [DBG] from='client.370140 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:15:11.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:15:10 smithi086 bash[24289]: cluster 2024-09-16T12:15:10.867813+0000 mgr.a (mgr.14373) 17211 : cluster [DBG] pgmap v11937: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:15:11.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:15:10 smithi047 bash[22744]: audit 2024-09-16T12:15:10.605780+0000 mgr.a (mgr.14373) 17210 : audit [DBG] from='client.370140 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:15:11.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:15:10 smithi047 bash[22744]: cluster 2024-09-16T12:15:10.867813+0000 mgr.a (mgr.14373) 17211 : cluster [DBG] pgmap v11937: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:15:13.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:15:12 smithi157 bash[24585]: cluster 2024-09-16T12:15:12.870211+0000 mgr.a (mgr.14373) 17212 : cluster [DBG] pgmap v11938: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:15:13.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:15:12 smithi086 bash[24289]: cluster 2024-09-16T12:15:12.870211+0000 mgr.a (mgr.14373) 17212 : cluster [DBG] pgmap v11938: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:15:13.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:15:12 smithi047 bash[22744]: cluster 2024-09-16T12:15:12.870211+0000 mgr.a (mgr.14373) 17212 : cluster [DBG] pgmap v11938: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:15:15.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:15:14 smithi157 bash[24585]: cluster 2024-09-16T12:15:14.871140+0000 mgr.a (mgr.14373) 17213 : cluster [DBG] pgmap v11939: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:15:15.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:15:14 smithi086 bash[24289]: cluster 2024-09-16T12:15:14.871140+0000 mgr.a (mgr.14373) 17213 : cluster [DBG] pgmap v11939: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:15:15.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:15:14 smithi047 bash[22744]: cluster 2024-09-16T12:15:14.871140+0000 mgr.a (mgr.14373) 17213 : cluster [DBG] pgmap v11939: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:15:16.045 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:15:16.046 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:15:16.046 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:15:16.840 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:15:16.841 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:15:16.841 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:15:16.841 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:15:16.841 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:15:17.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:15:16 smithi157 bash[24585]: audit 2024-09-16T12:15:16.382365+0000 mgr.a (mgr.14373) 17214 : audit [DBG] from='client.370218 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:15:17.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:15:16 smithi157 bash[24585]: cluster 2024-09-16T12:15:16.872622+0000 mgr.a (mgr.14373) 17215 : cluster [DBG] pgmap v11940: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:15:17.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:15:16 smithi086 bash[24289]: audit 2024-09-16T12:15:16.382365+0000 mgr.a (mgr.14373) 17214 : audit [DBG] from='client.370218 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:15:17.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:15:16 smithi086 bash[24289]: cluster 2024-09-16T12:15:16.872622+0000 mgr.a (mgr.14373) 17215 : cluster [DBG] pgmap v11940: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:15:17.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:15:16 smithi047 bash[22744]: audit 2024-09-16T12:15:16.382365+0000 mgr.a (mgr.14373) 17214 : audit [DBG] from='client.370218 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:15:17.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:15:16 smithi047 bash[22744]: cluster 2024-09-16T12:15:16.872622+0000 mgr.a (mgr.14373) 17215 : cluster [DBG] pgmap v11940: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:15:19.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:15:18 smithi157 bash[24585]: cluster 2024-09-16T12:15:18.873311+0000 mgr.a (mgr.14373) 17216 : cluster [DBG] pgmap v11941: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T12:15:19.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:15:18 smithi086 bash[24289]: cluster 2024-09-16T12:15:18.873311+0000 mgr.a (mgr.14373) 17216 : cluster [DBG] pgmap v11941: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T12:15:19.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:15:18 smithi047 bash[22744]: cluster 2024-09-16T12:15:18.873311+0000 mgr.a (mgr.14373) 17216 : cluster [DBG] pgmap v11941: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T12:15:21.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:15:20 smithi157 bash[24585]: cluster 2024-09-16T12:15:20.874056+0000 mgr.a (mgr.14373) 17217 : cluster [DBG] pgmap v11942: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T12:15:21.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:15:20 smithi086 bash[24289]: cluster 2024-09-16T12:15:20.874056+0000 mgr.a (mgr.14373) 17217 : cluster [DBG] pgmap v11942: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T12:15:21.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:15:20 smithi047 bash[22744]: cluster 2024-09-16T12:15:20.874056+0000 mgr.a (mgr.14373) 17217 : cluster [DBG] pgmap v11942: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T12:15:21.842 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:15:21.843 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:15:21.843 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:15:22.627 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:15:22.627 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:15:22.628 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:15:22.628 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:15:22.628 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:15:23.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:15:22 smithi157 bash[24585]: audit 2024-09-16T12:15:22.180605+0000 mgr.a (mgr.14373) 17218 : audit [DBG] from='client.370296 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:15:23.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:15:22 smithi157 bash[24585]: cluster 2024-09-16T12:15:22.876684+0000 mgr.a (mgr.14373) 17219 : cluster [DBG] pgmap v11943: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:15:23.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:15:22 smithi086 bash[24289]: audit 2024-09-16T12:15:22.180605+0000 mgr.a (mgr.14373) 17218 : audit [DBG] from='client.370296 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:15:23.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:15:22 smithi086 bash[24289]: cluster 2024-09-16T12:15:22.876684+0000 mgr.a (mgr.14373) 17219 : cluster [DBG] pgmap v11943: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:15:23.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:15:22 smithi047 bash[22744]: audit 2024-09-16T12:15:22.180605+0000 mgr.a (mgr.14373) 17218 : audit [DBG] from='client.370296 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:15:23.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:15:22 smithi047 bash[22744]: cluster 2024-09-16T12:15:22.876684+0000 mgr.a (mgr.14373) 17219 : cluster [DBG] pgmap v11943: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:15:25.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:15:24 smithi157 bash[24585]: cluster 2024-09-16T12:15:24.877458+0000 mgr.a (mgr.14373) 17220 : cluster [DBG] pgmap v11944: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:15:25.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:15:24 smithi086 bash[24289]: cluster 2024-09-16T12:15:24.877458+0000 mgr.a (mgr.14373) 17220 : cluster [DBG] pgmap v11944: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:15:25.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:15:24 smithi047 bash[22744]: cluster 2024-09-16T12:15:24.877458+0000 mgr.a (mgr.14373) 17220 : cluster [DBG] pgmap v11944: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:15:27.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:15:26 smithi157 bash[24585]: cluster 2024-09-16T12:15:26.879412+0000 mgr.a (mgr.14373) 17221 : cluster [DBG] pgmap v11945: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:15:27.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:15:26 smithi086 bash[24289]: cluster 2024-09-16T12:15:26.879412+0000 mgr.a (mgr.14373) 17221 : cluster [DBG] pgmap v11945: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:15:27.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:15:26 smithi047 bash[22744]: cluster 2024-09-16T12:15:26.879412+0000 mgr.a (mgr.14373) 17221 : cluster [DBG] pgmap v11945: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:15:27.629 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:15:27.630 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:15:27.630 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:15:28.419 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:15:28.420 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:15:28.420 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:15:28.420 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:15:28.420 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:15:29.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:15:28 smithi157 bash[24585]: audit 2024-09-16T12:15:27.970597+0000 mgr.a (mgr.14373) 17222 : audit [DBG] from='client.370368 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:15:29.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:15:28 smithi157 bash[24585]: cluster 2024-09-16T12:15:28.880311+0000 mgr.a (mgr.14373) 17223 : cluster [DBG] pgmap v11946: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:15:29.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:15:28 smithi086 bash[24289]: audit 2024-09-16T12:15:27.970597+0000 mgr.a (mgr.14373) 17222 : audit [DBG] from='client.370368 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:15:29.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:15:28 smithi086 bash[24289]: cluster 2024-09-16T12:15:28.880311+0000 mgr.a (mgr.14373) 17223 : cluster [DBG] pgmap v11946: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:15:29.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:15:28 smithi047 bash[22744]: audit 2024-09-16T12:15:27.970597+0000 mgr.a (mgr.14373) 17222 : audit [DBG] from='client.370368 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:15:29.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:15:28 smithi047 bash[22744]: cluster 2024-09-16T12:15:28.880311+0000 mgr.a (mgr.14373) 17223 : cluster [DBG] pgmap v11946: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:15:31.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:15:30 smithi157 bash[24585]: cluster 2024-09-16T12:15:30.881070+0000 mgr.a (mgr.14373) 17224 : cluster [DBG] pgmap v11947: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:15:31.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:15:30 smithi086 bash[24289]: cluster 2024-09-16T12:15:30.881070+0000 mgr.a (mgr.14373) 17224 : cluster [DBG] pgmap v11947: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:15:31.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:15:30 smithi047 bash[22744]: cluster 2024-09-16T12:15:30.881070+0000 mgr.a (mgr.14373) 17224 : cluster [DBG] pgmap v11947: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:15:33.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:15:32 smithi157 bash[24585]: cluster 2024-09-16T12:15:32.883399+0000 mgr.a (mgr.14373) 17225 : cluster [DBG] pgmap v11948: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:15:33.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:15:32 smithi086 bash[24289]: cluster 2024-09-16T12:15:32.883399+0000 mgr.a (mgr.14373) 17225 : cluster [DBG] pgmap v11948: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:15:33.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:15:32 smithi047 bash[22744]: cluster 2024-09-16T12:15:32.883399+0000 mgr.a (mgr.14373) 17225 : cluster [DBG] pgmap v11948: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:15:33.421 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:15:33.422 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:15:33.422 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:15:34.196 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:15:34.196 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:15:34.196 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:15:34.196 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:15:34.196 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:15:34.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:15:33 smithi157 bash[24585]: audit 2024-09-16T12:15:33.756316+0000 mgr.a (mgr.14373) 17226 : audit [DBG] from='client.370446 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:15:34.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:15:33 smithi086 bash[24289]: audit 2024-09-16T12:15:33.756316+0000 mgr.a (mgr.14373) 17226 : audit [DBG] from='client.370446 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:15:34.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:15:33 smithi047 bash[22744]: audit 2024-09-16T12:15:33.756316+0000 mgr.a (mgr.14373) 17226 : audit [DBG] from='client.370446 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:15:35.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:15:34 smithi157 bash[24585]: cluster 2024-09-16T12:15:34.884320+0000 mgr.a (mgr.14373) 17227 : cluster [DBG] pgmap v11949: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:15:35.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:15:34 smithi086 bash[24289]: cluster 2024-09-16T12:15:34.884320+0000 mgr.a (mgr.14373) 17227 : cluster [DBG] pgmap v11949: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:15:35.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:15:34 smithi047 bash[22744]: cluster 2024-09-16T12:15:34.884320+0000 mgr.a (mgr.14373) 17227 : cluster [DBG] pgmap v11949: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:15:37.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:15:36 smithi157 bash[24585]: cluster 2024-09-16T12:15:36.887030+0000 mgr.a (mgr.14373) 17228 : cluster [DBG] pgmap v11950: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:15:37.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:15:36 smithi086 bash[24289]: cluster 2024-09-16T12:15:36.887030+0000 mgr.a (mgr.14373) 17228 : cluster [DBG] pgmap v11950: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:15:37.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:15:36 smithi047 bash[22744]: cluster 2024-09-16T12:15:36.887030+0000 mgr.a (mgr.14373) 17228 : cluster [DBG] pgmap v11950: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:15:39.198 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:15:39.198 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:15:39.198 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:15:39.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:15:38 smithi157 bash[24585]: cluster 2024-09-16T12:15:38.887836+0000 mgr.a (mgr.14373) 17229 : cluster [DBG] pgmap v11951: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:15:39.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:15:38 smithi086 bash[24289]: cluster 2024-09-16T12:15:38.887836+0000 mgr.a (mgr.14373) 17229 : cluster [DBG] pgmap v11951: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:15:39.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:15:38 smithi047 bash[22744]: cluster 2024-09-16T12:15:38.887836+0000 mgr.a (mgr.14373) 17229 : cluster [DBG] pgmap v11951: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:15:39.955 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:15:39.955 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:15:39.955 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:15:39.955 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:15:39.955 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:15:40.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:15:39 smithi157 bash[24585]: audit 2024-09-16T12:15:39.527606+0000 mgr.a (mgr.14373) 17230 : audit [DBG] from='client.370521 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:15:40.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:15:39 smithi086 bash[24289]: audit 2024-09-16T12:15:39.527606+0000 mgr.a (mgr.14373) 17230 : audit [DBG] from='client.370521 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:15:40.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:15:39 smithi047 bash[22744]: audit 2024-09-16T12:15:39.527606+0000 mgr.a (mgr.14373) 17230 : audit [DBG] from='client.370521 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:15:41.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:15:40 smithi157 bash[24585]: cluster 2024-09-16T12:15:40.888816+0000 mgr.a (mgr.14373) 17231 : cluster [DBG] pgmap v11952: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:15:41.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:15:40 smithi086 bash[24289]: cluster 2024-09-16T12:15:40.888816+0000 mgr.a (mgr.14373) 17231 : cluster [DBG] pgmap v11952: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:15:41.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:15:40 smithi047 bash[22744]: cluster 2024-09-16T12:15:40.888816+0000 mgr.a (mgr.14373) 17231 : cluster [DBG] pgmap v11952: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:15:43.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:15:42 smithi157 bash[24585]: cluster 2024-09-16T12:15:42.891003+0000 mgr.a (mgr.14373) 17232 : cluster [DBG] pgmap v11953: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:15:43.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:15:42 smithi086 bash[24289]: cluster 2024-09-16T12:15:42.891003+0000 mgr.a (mgr.14373) 17232 : cluster [DBG] pgmap v11953: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:15:43.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:15:42 smithi047 bash[22744]: cluster 2024-09-16T12:15:42.891003+0000 mgr.a (mgr.14373) 17232 : cluster [DBG] pgmap v11953: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:15:44.956 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:15:44.957 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:15:44.957 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:15:45.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:15:44 smithi157 bash[24585]: cluster 2024-09-16T12:15:44.891721+0000 mgr.a (mgr.14373) 17233 : cluster [DBG] pgmap v11954: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:15:45.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:15:44 smithi086 bash[24289]: cluster 2024-09-16T12:15:44.891721+0000 mgr.a (mgr.14373) 17233 : cluster [DBG] pgmap v11954: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:15:45.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:15:44 smithi047 bash[22744]: cluster 2024-09-16T12:15:44.891721+0000 mgr.a (mgr.14373) 17233 : cluster [DBG] pgmap v11954: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:15:45.729 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:15:45.729 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:15:45.729 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:15:45.729 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:15:45.729 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:15:46.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:15:45 smithi157 bash[24585]: audit 2024-09-16T12:15:45.289123+0000 mgr.a (mgr.14373) 17234 : audit [DBG] from='client.370599 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:15:46.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:15:45 smithi086 bash[24289]: audit 2024-09-16T12:15:45.289123+0000 mgr.a (mgr.14373) 17234 : audit [DBG] from='client.370599 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:15:46.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:15:45 smithi047 bash[22744]: audit 2024-09-16T12:15:45.289123+0000 mgr.a (mgr.14373) 17234 : audit [DBG] from='client.370599 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:15:47.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:15:46 smithi157 bash[24585]: cluster 2024-09-16T12:15:46.894025+0000 mgr.a (mgr.14373) 17235 : cluster [DBG] pgmap v11955: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:15:47.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:15:46 smithi086 bash[24289]: cluster 2024-09-16T12:15:46.894025+0000 mgr.a (mgr.14373) 17235 : cluster [DBG] pgmap v11955: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:15:47.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:15:46 smithi047 bash[22744]: cluster 2024-09-16T12:15:46.894025+0000 mgr.a (mgr.14373) 17235 : cluster [DBG] pgmap v11955: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:15:49.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:15:48 smithi157 bash[24585]: cluster 2024-09-16T12:15:48.894819+0000 mgr.a (mgr.14373) 17236 : cluster [DBG] pgmap v11956: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:15:49.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:15:48 smithi086 bash[24289]: cluster 2024-09-16T12:15:48.894819+0000 mgr.a (mgr.14373) 17236 : cluster [DBG] pgmap v11956: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:15:49.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:15:48 smithi047 bash[22744]: cluster 2024-09-16T12:15:48.894819+0000 mgr.a (mgr.14373) 17236 : cluster [DBG] pgmap v11956: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:15:50.730 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:15:50.731 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:15:50.731 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:15:51.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:15:50 smithi157 bash[24585]: cluster 2024-09-16T12:15:50.895433+0000 mgr.a (mgr.14373) 17237 : cluster [DBG] pgmap v11957: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:15:51.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:15:50 smithi086 bash[24289]: cluster 2024-09-16T12:15:50.895433+0000 mgr.a (mgr.14373) 17237 : cluster [DBG] pgmap v11957: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:15:51.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:15:50 smithi047 bash[22744]: cluster 2024-09-16T12:15:50.895433+0000 mgr.a (mgr.14373) 17237 : cluster [DBG] pgmap v11957: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:15:51.488 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:15:51.488 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:15:51.488 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:15:51.488 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:15:51.488 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:15:52.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:15:51 smithi157 bash[24585]: audit 2024-09-16T12:15:51.063708+0000 mgr.a (mgr.14373) 17238 : audit [DBG] from='client.370677 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:15:52.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:15:51 smithi086 bash[24289]: audit 2024-09-16T12:15:51.063708+0000 mgr.a (mgr.14373) 17238 : audit [DBG] from='client.370677 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:15:52.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:15:51 smithi047 bash[22744]: audit 2024-09-16T12:15:51.063708+0000 mgr.a (mgr.14373) 17238 : audit [DBG] from='client.370677 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:15:53.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:15:52 smithi157 bash[24585]: audit 2024-09-16T12:15:52.772693+0000 mon.b (mon.2) 1562 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T12:15:53.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:15:52 smithi157 bash[24585]: cluster 2024-09-16T12:15:52.896915+0000 mgr.a (mgr.14373) 17239 : cluster [DBG] pgmap v11958: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:15:53.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:15:52 smithi086 bash[24289]: audit 2024-09-16T12:15:52.772693+0000 mon.b (mon.2) 1562 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T12:15:53.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:15:52 smithi086 bash[24289]: cluster 2024-09-16T12:15:52.896915+0000 mgr.a (mgr.14373) 17239 : cluster [DBG] pgmap v11958: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:15:53.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:15:52 smithi047 bash[22744]: audit 2024-09-16T12:15:52.772693+0000 mon.b (mon.2) 1562 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T12:15:53.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:15:52 smithi047 bash[22744]: cluster 2024-09-16T12:15:52.896915+0000 mgr.a (mgr.14373) 17239 : cluster [DBG] pgmap v11958: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:15:55.343 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 12:15:54 smithi047 bash[22994]: debug 2024-09-16T12:15:54.928+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T12:15:55.343 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 12:15:54 smithi047 bash[22994]: debug 2024-09-16T12:15:54.932+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T12:15:55.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:15:55 smithi047 bash[22744]: audit 2024-09-16T12:15:54.131988+0000 mon.a (mon.0) 1596 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:15:55.344 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:15:55 smithi047 bash[22744]: audit 2024-09-16T12:15:54.136447+0000 mon.a (mon.0) 1597 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:15:55.344 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:15:55 smithi047 bash[22744]: audit 2024-09-16T12:15:54.140678+0000 mon.a (mon.0) 1598 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:15:55.344 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:15:55 smithi047 bash[22744]: audit 2024-09-16T12:15:54.144121+0000 mon.a (mon.0) 1599 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:15:55.344 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:15:55 smithi047 bash[22744]: audit 2024-09-16T12:15:54.147140+0000 mon.a (mon.0) 1600 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:15:55.344 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:15:55 smithi047 bash[22744]: audit 2024-09-16T12:15:54.153652+0000 mon.a (mon.0) 1601 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:15:55.344 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:15:55 smithi047 bash[22744]: audit 2024-09-16T12:15:54.159590+0000 mon.b (mon.2) 1563 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T12:15:55.344 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:15:55 smithi047 bash[22744]: audit 2024-09-16T12:15:54.161174+0000 mon.b (mon.2) 1564 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T12:15:55.344 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:15:55 smithi047 bash[22744]: audit 2024-09-16T12:15:54.169300+0000 mon.a (mon.0) 1602 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:15:55.344 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:15:55 smithi047 bash[22744]: audit 2024-09-16T12:15:54.177751+0000 mon.b (mon.2) 1565 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:15:55.344 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:15:55 smithi047 bash[22744]: audit 2024-09-16T12:15:54.179252+0000 mgr.a (mgr.14373) 17240 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:15:55.345 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:15:55 smithi047 bash[22744]: cluster 2024-09-16T12:15:54.897534+0000 mgr.a (mgr.14373) 17241 : cluster [DBG] pgmap v11959: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:15:55.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:15:55 smithi157 bash[24585]: audit 2024-09-16T12:15:54.131988+0000 mon.a (mon.0) 1596 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:15:55.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:15:55 smithi157 bash[24585]: audit 2024-09-16T12:15:54.136447+0000 mon.a (mon.0) 1597 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:15:55.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:15:55 smithi157 bash[24585]: audit 2024-09-16T12:15:54.140678+0000 mon.a (mon.0) 1598 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:15:55.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:15:55 smithi157 bash[24585]: audit 2024-09-16T12:15:54.144121+0000 mon.a (mon.0) 1599 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:15:55.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:15:55 smithi157 bash[24585]: audit 2024-09-16T12:15:54.147140+0000 mon.a (mon.0) 1600 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:15:55.558 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:15:55 smithi157 bash[24585]: audit 2024-09-16T12:15:54.153652+0000 mon.a (mon.0) 1601 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:15:55.558 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:15:55 smithi157 bash[24585]: audit 2024-09-16T12:15:54.159590+0000 mon.b (mon.2) 1563 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T12:15:55.558 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:15:55 smithi157 bash[24585]: audit 2024-09-16T12:15:54.161174+0000 mon.b (mon.2) 1564 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T12:15:55.558 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:15:55 smithi157 bash[24585]: audit 2024-09-16T12:15:54.169300+0000 mon.a (mon.0) 1602 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:15:55.558 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:15:55 smithi157 bash[24585]: audit 2024-09-16T12:15:54.177751+0000 mon.b (mon.2) 1565 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:15:55.558 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:15:55 smithi157 bash[24585]: audit 2024-09-16T12:15:54.179252+0000 mgr.a (mgr.14373) 17240 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:15:55.558 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:15:55 smithi157 bash[24585]: cluster 2024-09-16T12:15:54.897534+0000 mgr.a (mgr.14373) 17241 : cluster [DBG] pgmap v11959: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:15:55.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:15:55 smithi086 bash[24289]: audit 2024-09-16T12:15:54.131988+0000 mon.a (mon.0) 1596 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:15:55.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:15:55 smithi086 bash[24289]: audit 2024-09-16T12:15:54.136447+0000 mon.a (mon.0) 1597 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:15:55.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:15:55 smithi086 bash[24289]: audit 2024-09-16T12:15:54.140678+0000 mon.a (mon.0) 1598 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:15:55.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:15:55 smithi086 bash[24289]: audit 2024-09-16T12:15:54.144121+0000 mon.a (mon.0) 1599 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:15:55.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:15:55 smithi086 bash[24289]: audit 2024-09-16T12:15:54.147140+0000 mon.a (mon.0) 1600 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:15:55.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:15:55 smithi086 bash[24289]: audit 2024-09-16T12:15:54.153652+0000 mon.a (mon.0) 1601 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:15:55.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:15:55 smithi086 bash[24289]: audit 2024-09-16T12:15:54.159590+0000 mon.b (mon.2) 1563 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T12:15:55.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:15:55 smithi086 bash[24289]: audit 2024-09-16T12:15:54.161174+0000 mon.b (mon.2) 1564 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T12:15:55.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:15:55 smithi086 bash[24289]: audit 2024-09-16T12:15:54.169300+0000 mon.a (mon.0) 1602 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:15:55.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:15:55 smithi086 bash[24289]: audit 2024-09-16T12:15:54.177751+0000 mon.b (mon.2) 1565 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:15:55.572 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:15:55 smithi086 bash[24289]: audit 2024-09-16T12:15:54.179252+0000 mgr.a (mgr.14373) 17240 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:15:55.572 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:15:55 smithi086 bash[24289]: cluster 2024-09-16T12:15:54.897534+0000 mgr.a (mgr.14373) 17241 : cluster [DBG] pgmap v11959: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:15:56.489 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:15:56.490 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:15:56.491 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:15:56.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:15:56 smithi157 bash[24585]: audit 2024-09-16T12:15:54.931958+0000 mgr.a (mgr.14373) 17242 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T12:15:56.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:15:56 smithi157 bash[24585]: cephadm 2024-09-16T12:15:54.934465+0000 mgr.a (mgr.14373) 17243 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T12:15:56.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:15:56 smithi086 bash[24289]: audit 2024-09-16T12:15:54.931958+0000 mgr.a (mgr.14373) 17242 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T12:15:56.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:15:56 smithi086 bash[24289]: cephadm 2024-09-16T12:15:54.934465+0000 mgr.a (mgr.14373) 17243 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T12:15:56.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:15:56 smithi047 bash[22744]: audit 2024-09-16T12:15:54.931958+0000 mgr.a (mgr.14373) 17242 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T12:15:56.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:15:56 smithi047 bash[22744]: cephadm 2024-09-16T12:15:54.934465+0000 mgr.a (mgr.14373) 17243 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T12:15:57.260 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:15:57.260 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:15:57.260 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:15:57.260 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:15:57.260 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:15:57.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:15:57 smithi157 bash[24585]: audit 2024-09-16T12:15:56.823837+0000 mgr.a (mgr.14373) 17244 : audit [DBG] from='client.370860 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:15:57.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:15:57 smithi157 bash[24585]: cluster 2024-09-16T12:15:56.898984+0000 mgr.a (mgr.14373) 17245 : cluster [DBG] pgmap v11960: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:15:57.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:15:57 smithi086 bash[24289]: audit 2024-09-16T12:15:56.823837+0000 mgr.a (mgr.14373) 17244 : audit [DBG] from='client.370860 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:15:57.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:15:57 smithi086 bash[24289]: cluster 2024-09-16T12:15:56.898984+0000 mgr.a (mgr.14373) 17245 : cluster [DBG] pgmap v11960: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:15:57.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:15:57 smithi047 bash[22744]: audit 2024-09-16T12:15:56.823837+0000 mgr.a (mgr.14373) 17244 : audit [DBG] from='client.370860 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:15:57.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:15:57 smithi047 bash[22744]: cluster 2024-09-16T12:15:56.898984+0000 mgr.a (mgr.14373) 17245 : cluster [DBG] pgmap v11960: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:15:59.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:15:58 smithi157 bash[24585]: cluster 2024-09-16T12:15:58.899952+0000 mgr.a (mgr.14373) 17246 : cluster [DBG] pgmap v11961: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T12:15:59.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:15:58 smithi086 bash[24289]: cluster 2024-09-16T12:15:58.899952+0000 mgr.a (mgr.14373) 17246 : cluster [DBG] pgmap v11961: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T12:15:59.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:15:58 smithi047 bash[22744]: cluster 2024-09-16T12:15:58.899952+0000 mgr.a (mgr.14373) 17246 : cluster [DBG] pgmap v11961: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T12:16:01.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:16:00 smithi157 bash[24585]: cluster 2024-09-16T12:16:00.900893+0000 mgr.a (mgr.14373) 17247 : cluster [DBG] pgmap v11962: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T12:16:01.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:16:00 smithi086 bash[24289]: cluster 2024-09-16T12:16:00.900893+0000 mgr.a (mgr.14373) 17247 : cluster [DBG] pgmap v11962: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T12:16:01.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:16:00 smithi047 bash[22744]: cluster 2024-09-16T12:16:00.900893+0000 mgr.a (mgr.14373) 17247 : cluster [DBG] pgmap v11962: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T12:16:02.261 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:16:02.262 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:16:02.262 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:16:03.001 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:16:03.002 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:16:03.002 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:16:03.002 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:16:03.002 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:16:03.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:16:02 smithi157 bash[24585]: audit 2024-09-16T12:16:02.587368+0000 mgr.a (mgr.14373) 17248 : audit [DBG] from='client.370932 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:16:03.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:16:02 smithi157 bash[24585]: cluster 2024-09-16T12:16:02.903780+0000 mgr.a (mgr.14373) 17249 : cluster [DBG] pgmap v11963: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:16:03.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:16:02 smithi086 bash[24289]: audit 2024-09-16T12:16:02.587368+0000 mgr.a (mgr.14373) 17248 : audit [DBG] from='client.370932 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:16:03.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:16:02 smithi086 bash[24289]: cluster 2024-09-16T12:16:02.903780+0000 mgr.a (mgr.14373) 17249 : cluster [DBG] pgmap v11963: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:16:03.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:16:02 smithi047 bash[22744]: audit 2024-09-16T12:16:02.587368+0000 mgr.a (mgr.14373) 17248 : audit [DBG] from='client.370932 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:16:03.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:16:02 smithi047 bash[22744]: cluster 2024-09-16T12:16:02.903780+0000 mgr.a (mgr.14373) 17249 : cluster [DBG] pgmap v11963: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:16:05.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:16:04 smithi157 bash[24585]: cluster 2024-09-16T12:16:04.904544+0000 mgr.a (mgr.14373) 17250 : cluster [DBG] pgmap v11964: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T12:16:05.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:16:04 smithi086 bash[24289]: cluster 2024-09-16T12:16:04.904544+0000 mgr.a (mgr.14373) 17250 : cluster [DBG] pgmap v11964: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T12:16:05.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:16:04 smithi047 bash[22744]: cluster 2024-09-16T12:16:04.904544+0000 mgr.a (mgr.14373) 17250 : cluster [DBG] pgmap v11964: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T12:16:07.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:16:06 smithi157 bash[24585]: cluster 2024-09-16T12:16:06.906479+0000 mgr.a (mgr.14373) 17251 : cluster [DBG] pgmap v11965: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:16:07.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:16:06 smithi086 bash[24289]: cluster 2024-09-16T12:16:06.906479+0000 mgr.a (mgr.14373) 17251 : cluster [DBG] pgmap v11965: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:16:07.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:16:06 smithi047 bash[22744]: cluster 2024-09-16T12:16:06.906479+0000 mgr.a (mgr.14373) 17251 : cluster [DBG] pgmap v11965: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:16:08.003 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:16:08.004 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:16:08.004 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:16:08.765 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:16:08.766 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:16:08.766 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:16:08.766 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:16:08.766 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:16:09.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:16:08 smithi157 bash[24585]: audit 2024-09-16T12:16:08.336054+0000 mgr.a (mgr.14373) 17252 : audit [DBG] from='client.371010 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:16:09.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:16:08 smithi157 bash[24585]: cluster 2024-09-16T12:16:08.907452+0000 mgr.a (mgr.14373) 17253 : cluster [DBG] pgmap v11966: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:16:09.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:16:08 smithi086 bash[24289]: audit 2024-09-16T12:16:08.336054+0000 mgr.a (mgr.14373) 17252 : audit [DBG] from='client.371010 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:16:09.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:16:08 smithi086 bash[24289]: cluster 2024-09-16T12:16:08.907452+0000 mgr.a (mgr.14373) 17253 : cluster [DBG] pgmap v11966: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:16:09.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:16:08 smithi047 bash[22744]: audit 2024-09-16T12:16:08.336054+0000 mgr.a (mgr.14373) 17252 : audit [DBG] from='client.371010 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:16:09.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:16:08 smithi047 bash[22744]: cluster 2024-09-16T12:16:08.907452+0000 mgr.a (mgr.14373) 17253 : cluster [DBG] pgmap v11966: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:16:11.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:16:10 smithi157 bash[24585]: cluster 2024-09-16T12:16:10.908242+0000 mgr.a (mgr.14373) 17254 : cluster [DBG] pgmap v11967: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:16:11.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:16:10 smithi086 bash[24289]: cluster 2024-09-16T12:16:10.908242+0000 mgr.a (mgr.14373) 17254 : cluster [DBG] pgmap v11967: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:16:11.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:16:10 smithi047 bash[22744]: cluster 2024-09-16T12:16:10.908242+0000 mgr.a (mgr.14373) 17254 : cluster [DBG] pgmap v11967: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:16:13.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:16:12 smithi157 bash[24585]: cluster 2024-09-16T12:16:12.910455+0000 mgr.a (mgr.14373) 17255 : cluster [DBG] pgmap v11968: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:16:13.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:16:12 smithi086 bash[24289]: cluster 2024-09-16T12:16:12.910455+0000 mgr.a (mgr.14373) 17255 : cluster [DBG] pgmap v11968: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:16:13.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:16:12 smithi047 bash[22744]: cluster 2024-09-16T12:16:12.910455+0000 mgr.a (mgr.14373) 17255 : cluster [DBG] pgmap v11968: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:16:13.767 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:16:13.767 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:16:13.768 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:16:14.537 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:16:14.538 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:16:14.538 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:16:14.538 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:16:14.538 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:16:15.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:16:14 smithi157 bash[24585]: audit 2024-09-16T12:16:14.100912+0000 mgr.a (mgr.14373) 17256 : audit [DBG] from='client.371088 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:16:15.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:16:14 smithi157 bash[24585]: cluster 2024-09-16T12:16:14.911426+0000 mgr.a (mgr.14373) 17257 : cluster [DBG] pgmap v11969: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:16:15.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:16:14 smithi086 bash[24289]: audit 2024-09-16T12:16:14.100912+0000 mgr.a (mgr.14373) 17256 : audit [DBG] from='client.371088 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:16:15.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:16:14 smithi086 bash[24289]: cluster 2024-09-16T12:16:14.911426+0000 mgr.a (mgr.14373) 17257 : cluster [DBG] pgmap v11969: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:16:15.345 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:16:14 smithi047 bash[22744]: audit 2024-09-16T12:16:14.100912+0000 mgr.a (mgr.14373) 17256 : audit [DBG] from='client.371088 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:16:15.345 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:16:14 smithi047 bash[22744]: cluster 2024-09-16T12:16:14.911426+0000 mgr.a (mgr.14373) 17257 : cluster [DBG] pgmap v11969: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:16:17.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:16:16 smithi157 bash[24585]: cluster 2024-09-16T12:16:16.913614+0000 mgr.a (mgr.14373) 17258 : cluster [DBG] pgmap v11970: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:16:17.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:16:16 smithi086 bash[24289]: cluster 2024-09-16T12:16:16.913614+0000 mgr.a (mgr.14373) 17258 : cluster [DBG] pgmap v11970: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:16:17.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:16:16 smithi047 bash[22744]: cluster 2024-09-16T12:16:16.913614+0000 mgr.a (mgr.14373) 17258 : cluster [DBG] pgmap v11970: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:16:19.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:16:18 smithi157 bash[24585]: cluster 2024-09-16T12:16:18.914551+0000 mgr.a (mgr.14373) 17259 : cluster [DBG] pgmap v11971: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:16:19.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:16:18 smithi086 bash[24289]: cluster 2024-09-16T12:16:18.914551+0000 mgr.a (mgr.14373) 17259 : cluster [DBG] pgmap v11971: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:16:19.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:16:18 smithi047 bash[22744]: cluster 2024-09-16T12:16:18.914551+0000 mgr.a (mgr.14373) 17259 : cluster [DBG] pgmap v11971: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:16:19.539 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:16:19.540 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:16:19.540 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:16:20.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:16:19 smithi157 bash[24585]: audit 2024-09-16T12:16:19.872919+0000 mgr.a (mgr.14373) 17260 : audit [DBG] from='client.371163 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:16:20.310 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:16:20.310 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:16:20.310 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:16:20.311 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:16:20.311 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:16:20.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:16:19 smithi086 bash[24289]: audit 2024-09-16T12:16:19.872919+0000 mgr.a (mgr.14373) 17260 : audit [DBG] from='client.371163 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:16:20.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:16:19 smithi047 bash[22744]: audit 2024-09-16T12:16:19.872919+0000 mgr.a (mgr.14373) 17260 : audit [DBG] from='client.371163 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:16:21.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:16:20 smithi157 bash[24585]: cluster 2024-09-16T12:16:20.915528+0000 mgr.a (mgr.14373) 17261 : cluster [DBG] pgmap v11972: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:16:21.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:16:20 smithi086 bash[24289]: cluster 2024-09-16T12:16:20.915528+0000 mgr.a (mgr.14373) 17261 : cluster [DBG] pgmap v11972: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:16:21.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:16:20 smithi047 bash[22744]: cluster 2024-09-16T12:16:20.915528+0000 mgr.a (mgr.14373) 17261 : cluster [DBG] pgmap v11972: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:16:23.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:16:22 smithi157 bash[24585]: cluster 2024-09-16T12:16:22.917750+0000 mgr.a (mgr.14373) 17262 : cluster [DBG] pgmap v11973: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:16:23.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:16:22 smithi086 bash[24289]: cluster 2024-09-16T12:16:22.917750+0000 mgr.a (mgr.14373) 17262 : cluster [DBG] pgmap v11973: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:16:23.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:16:22 smithi047 bash[22744]: cluster 2024-09-16T12:16:22.917750+0000 mgr.a (mgr.14373) 17262 : cluster [DBG] pgmap v11973: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:16:25.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:16:24 smithi157 bash[24585]: cluster 2024-09-16T12:16:24.918574+0000 mgr.a (mgr.14373) 17263 : cluster [DBG] pgmap v11974: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:16:25.312 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:16:25.313 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:16:25.313 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:16:25.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:16:24 smithi086 bash[24289]: cluster 2024-09-16T12:16:24.918574+0000 mgr.a (mgr.14373) 17263 : cluster [DBG] pgmap v11974: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:16:25.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:16:24 smithi047 bash[22744]: cluster 2024-09-16T12:16:24.918574+0000 mgr.a (mgr.14373) 17263 : cluster [DBG] pgmap v11974: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:16:26.087 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:16:26.088 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:16:26.088 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:16:26.088 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:16:26.088 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:16:26.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:16:25 smithi157 bash[24585]: audit 2024-09-16T12:16:25.645587+0000 mgr.a (mgr.14373) 17264 : audit [DBG] from='client.371241 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:16:26.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:16:25 smithi086 bash[24289]: audit 2024-09-16T12:16:25.645587+0000 mgr.a (mgr.14373) 17264 : audit [DBG] from='client.371241 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:16:26.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:16:25 smithi047 bash[22744]: audit 2024-09-16T12:16:25.645587+0000 mgr.a (mgr.14373) 17264 : audit [DBG] from='client.371241 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:16:27.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:16:26 smithi157 bash[24585]: cluster 2024-09-16T12:16:26.921079+0000 mgr.a (mgr.14373) 17265 : cluster [DBG] pgmap v11975: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:16:27.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:16:26 smithi086 bash[24289]: cluster 2024-09-16T12:16:26.921079+0000 mgr.a (mgr.14373) 17265 : cluster [DBG] pgmap v11975: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:16:27.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:16:26 smithi047 bash[22744]: cluster 2024-09-16T12:16:26.921079+0000 mgr.a (mgr.14373) 17265 : cluster [DBG] pgmap v11975: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:16:29.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:16:28 smithi157 bash[24585]: cluster 2024-09-16T12:16:28.922041+0000 mgr.a (mgr.14373) 17266 : cluster [DBG] pgmap v11976: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:16:29.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:16:28 smithi086 bash[24289]: cluster 2024-09-16T12:16:28.922041+0000 mgr.a (mgr.14373) 17266 : cluster [DBG] pgmap v11976: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:16:29.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:16:28 smithi047 bash[22744]: cluster 2024-09-16T12:16:28.922041+0000 mgr.a (mgr.14373) 17266 : cluster [DBG] pgmap v11976: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:16:31.089 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:16:31.089 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:16:31.089 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:16:31.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:16:30 smithi157 bash[24585]: cluster 2024-09-16T12:16:30.923022+0000 mgr.a (mgr.14373) 17267 : cluster [DBG] pgmap v11977: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:16:31.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:16:30 smithi086 bash[24289]: cluster 2024-09-16T12:16:30.923022+0000 mgr.a (mgr.14373) 17267 : cluster [DBG] pgmap v11977: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:16:31.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:16:30 smithi047 bash[22744]: cluster 2024-09-16T12:16:30.923022+0000 mgr.a (mgr.14373) 17267 : cluster [DBG] pgmap v11977: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:16:31.836 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:16:31.836 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:16:31.836 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:16:31.836 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:16:31.836 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:16:32.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:16:31 smithi157 bash[24585]: audit 2024-09-16T12:16:31.418545+0000 mgr.a (mgr.14373) 17268 : audit [DBG] from='client.371319 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:16:32.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:16:31 smithi086 bash[24289]: audit 2024-09-16T12:16:31.418545+0000 mgr.a (mgr.14373) 17268 : audit [DBG] from='client.371319 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:16:32.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:16:31 smithi047 bash[22744]: audit 2024-09-16T12:16:31.418545+0000 mgr.a (mgr.14373) 17268 : audit [DBG] from='client.371319 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:16:34.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:16:33 smithi157 bash[24585]: cluster 2024-09-16T12:16:32.925842+0000 mgr.a (mgr.14373) 17269 : cluster [DBG] pgmap v11978: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:16:34.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:16:33 smithi086 bash[24289]: cluster 2024-09-16T12:16:32.925842+0000 mgr.a (mgr.14373) 17269 : cluster [DBG] pgmap v11978: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:16:34.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:16:33 smithi047 bash[22744]: cluster 2024-09-16T12:16:32.925842+0000 mgr.a (mgr.14373) 17269 : cluster [DBG] pgmap v11978: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:16:36.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:16:35 smithi157 bash[24585]: cluster 2024-09-16T12:16:34.926663+0000 mgr.a (mgr.14373) 17270 : cluster [DBG] pgmap v11979: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:16:36.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:16:35 smithi086 bash[24289]: cluster 2024-09-16T12:16:34.926663+0000 mgr.a (mgr.14373) 17270 : cluster [DBG] pgmap v11979: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:16:36.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:16:35 smithi047 bash[22744]: cluster 2024-09-16T12:16:34.926663+0000 mgr.a (mgr.14373) 17270 : cluster [DBG] pgmap v11979: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:16:36.837 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:16:36.838 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:16:36.838 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:16:37.607 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:16:37.608 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:16:37.608 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:16:37.608 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:16:37.608 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:16:38.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:16:38 smithi157 bash[24585]: cluster 2024-09-16T12:16:36.928529+0000 mgr.a (mgr.14373) 17271 : cluster [DBG] pgmap v11980: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:16:38.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:16:38 smithi157 bash[24585]: audit 2024-09-16T12:16:37.174849+0000 mgr.a (mgr.14373) 17272 : audit [DBG] from='client.371394 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:16:38.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:16:38 smithi086 bash[24289]: cluster 2024-09-16T12:16:36.928529+0000 mgr.a (mgr.14373) 17271 : cluster [DBG] pgmap v11980: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:16:38.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:16:38 smithi086 bash[24289]: audit 2024-09-16T12:16:37.174849+0000 mgr.a (mgr.14373) 17272 : audit [DBG] from='client.371394 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:16:38.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:16:38 smithi047 bash[22744]: cluster 2024-09-16T12:16:36.928529+0000 mgr.a (mgr.14373) 17271 : cluster [DBG] pgmap v11980: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:16:38.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:16:38 smithi047 bash[22744]: audit 2024-09-16T12:16:37.174849+0000 mgr.a (mgr.14373) 17272 : audit [DBG] from='client.371394 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:16:40.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:16:40 smithi157 bash[24585]: cluster 2024-09-16T12:16:38.929425+0000 mgr.a (mgr.14373) 17273 : cluster [DBG] pgmap v11981: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:16:40.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:16:40 smithi086 bash[24289]: cluster 2024-09-16T12:16:38.929425+0000 mgr.a (mgr.14373) 17273 : cluster [DBG] pgmap v11981: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:16:40.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:16:40 smithi047 bash[22744]: cluster 2024-09-16T12:16:38.929425+0000 mgr.a (mgr.14373) 17273 : cluster [DBG] pgmap v11981: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:16:42.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:16:42 smithi157 bash[24585]: cluster 2024-09-16T12:16:40.930205+0000 mgr.a (mgr.14373) 17274 : cluster [DBG] pgmap v11982: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T12:16:42.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:16:42 smithi086 bash[24289]: cluster 2024-09-16T12:16:40.930205+0000 mgr.a (mgr.14373) 17274 : cluster [DBG] pgmap v11982: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T12:16:42.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:16:42 smithi047 bash[22744]: cluster 2024-09-16T12:16:40.930205+0000 mgr.a (mgr.14373) 17274 : cluster [DBG] pgmap v11982: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T12:16:42.609 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:16:42.610 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:16:42.610 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:16:43.362 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:16:43.362 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:16:43.362 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:16:43.363 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:16:43.363 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:16:44.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:16:44 smithi157 bash[24585]: cluster 2024-09-16T12:16:42.932247+0000 mgr.a (mgr.14373) 17275 : cluster [DBG] pgmap v11983: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:16:44.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:16:44 smithi157 bash[24585]: audit 2024-09-16T12:16:42.939762+0000 mgr.a (mgr.14373) 17276 : audit [DBG] from='client.371472 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:16:44.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:16:44 smithi086 bash[24289]: cluster 2024-09-16T12:16:42.932247+0000 mgr.a (mgr.14373) 17275 : cluster [DBG] pgmap v11983: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:16:44.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:16:44 smithi086 bash[24289]: audit 2024-09-16T12:16:42.939762+0000 mgr.a (mgr.14373) 17276 : audit [DBG] from='client.371472 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:16:44.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:16:44 smithi047 bash[22744]: cluster 2024-09-16T12:16:42.932247+0000 mgr.a (mgr.14373) 17275 : cluster [DBG] pgmap v11983: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:16:44.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:16:44 smithi047 bash[22744]: audit 2024-09-16T12:16:42.939762+0000 mgr.a (mgr.14373) 17276 : audit [DBG] from='client.371472 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:16:46.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:16:46 smithi157 bash[24585]: cluster 2024-09-16T12:16:44.933358+0000 mgr.a (mgr.14373) 17277 : cluster [DBG] pgmap v11984: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:16:46.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:16:46 smithi086 bash[24289]: cluster 2024-09-16T12:16:44.933358+0000 mgr.a (mgr.14373) 17277 : cluster [DBG] pgmap v11984: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:16:46.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:16:46 smithi047 bash[22744]: cluster 2024-09-16T12:16:44.933358+0000 mgr.a (mgr.14373) 17277 : cluster [DBG] pgmap v11984: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:16:48.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:16:48 smithi157 bash[24585]: cluster 2024-09-16T12:16:46.935555+0000 mgr.a (mgr.14373) 17278 : cluster [DBG] pgmap v11985: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:16:48.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:16:48 smithi086 bash[24289]: cluster 2024-09-16T12:16:46.935555+0000 mgr.a (mgr.14373) 17278 : cluster [DBG] pgmap v11985: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:16:48.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:16:48 smithi047 bash[22744]: cluster 2024-09-16T12:16:46.935555+0000 mgr.a (mgr.14373) 17278 : cluster [DBG] pgmap v11985: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:16:48.363 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:16:48.364 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:16:48.364 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:16:49.127 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:16:49.127 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:16:49.127 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:16:49.127 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:16:49.127 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:16:49.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:16:49 smithi157 bash[24585]: audit 2024-09-16T12:16:48.694155+0000 mgr.a (mgr.14373) 17279 : audit [DBG] from='client.371550 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:16:49.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:16:49 smithi086 bash[24289]: audit 2024-09-16T12:16:48.694155+0000 mgr.a (mgr.14373) 17279 : audit [DBG] from='client.371550 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:16:49.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:16:49 smithi047 bash[22744]: audit 2024-09-16T12:16:48.694155+0000 mgr.a (mgr.14373) 17279 : audit [DBG] from='client.371550 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:16:50.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:16:50 smithi157 bash[24585]: cluster 2024-09-16T12:16:48.936096+0000 mgr.a (mgr.14373) 17280 : cluster [DBG] pgmap v11986: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:16:50.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:16:50 smithi086 bash[24289]: cluster 2024-09-16T12:16:48.936096+0000 mgr.a (mgr.14373) 17280 : cluster [DBG] pgmap v11986: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:16:50.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:16:50 smithi047 bash[22744]: cluster 2024-09-16T12:16:48.936096+0000 mgr.a (mgr.14373) 17280 : cluster [DBG] pgmap v11986: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:16:52.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:16:52 smithi157 bash[24585]: cluster 2024-09-16T12:16:50.936958+0000 mgr.a (mgr.14373) 17281 : cluster [DBG] pgmap v11987: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:16:52.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:16:52 smithi086 bash[24289]: cluster 2024-09-16T12:16:50.936958+0000 mgr.a (mgr.14373) 17281 : cluster [DBG] pgmap v11987: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:16:52.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:16:52 smithi047 bash[22744]: cluster 2024-09-16T12:16:50.936958+0000 mgr.a (mgr.14373) 17281 : cluster [DBG] pgmap v11987: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:16:54.128 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:16:54.129 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:16:54.129 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:16:54.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:16:54 smithi157 bash[24585]: cluster 2024-09-16T12:16:52.939390+0000 mgr.a (mgr.14373) 17282 : cluster [DBG] pgmap v11988: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:16:54.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:16:54 smithi086 bash[24289]: cluster 2024-09-16T12:16:52.939390+0000 mgr.a (mgr.14373) 17282 : cluster [DBG] pgmap v11988: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:16:54.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:16:54 smithi047 bash[22744]: cluster 2024-09-16T12:16:52.939390+0000 mgr.a (mgr.14373) 17282 : cluster [DBG] pgmap v11988: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:16:54.908 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:16:54.909 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:16:54.909 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:16:54.909 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:16:54.909 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:16:55.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:16:55 smithi157 bash[24585]: audit 2024-09-16T12:16:54.463784+0000 mgr.a (mgr.14373) 17283 : audit [DBG] from='client.371625 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:16:55.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:16:55 smithi157 bash[24585]: audit 2024-09-16T12:16:55.010195+0000 mon.b (mon.2) 1566 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T12:16:55.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:16:55 smithi086 bash[24289]: audit 2024-09-16T12:16:54.463784+0000 mgr.a (mgr.14373) 17283 : audit [DBG] from='client.371625 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:16:55.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:16:55 smithi086 bash[24289]: audit 2024-09-16T12:16:55.010195+0000 mon.b (mon.2) 1566 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T12:16:55.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:16:55 smithi047 bash[22744]: audit 2024-09-16T12:16:54.463784+0000 mgr.a (mgr.14373) 17283 : audit [DBG] from='client.371625 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:16:55.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:16:55 smithi047 bash[22744]: audit 2024-09-16T12:16:55.010195+0000 mon.b (mon.2) 1566 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T12:16:56.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:16:56 smithi157 bash[24585]: cluster 2024-09-16T12:16:54.940083+0000 mgr.a (mgr.14373) 17284 : cluster [DBG] pgmap v11989: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:16:56.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:16:56 smithi157 bash[24585]: audit 2024-09-16T12:16:55.852235+0000 mon.b (mon.2) 1567 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T12:16:56.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:16:56 smithi157 bash[24585]: audit 2024-09-16T12:16:55.854256+0000 mon.b (mon.2) 1568 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T12:16:56.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:16:56 smithi157 bash[24585]: audit 2024-09-16T12:16:55.865566+0000 mon.a (mon.0) 1603 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:16:56.308 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:16:56 smithi157 bash[24585]: audit 2024-09-16T12:16:55.871095+0000 mon.b (mon.2) 1569 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:16:56.308 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:16:56 smithi157 bash[24585]: audit 2024-09-16T12:16:55.873740+0000 mgr.a (mgr.14373) 17285 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:16:56.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:16:56 smithi086 bash[24289]: cluster 2024-09-16T12:16:54.940083+0000 mgr.a (mgr.14373) 17284 : cluster [DBG] pgmap v11989: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:16:56.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:16:56 smithi086 bash[24289]: audit 2024-09-16T12:16:55.852235+0000 mon.b (mon.2) 1567 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T12:16:56.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:16:56 smithi086 bash[24289]: audit 2024-09-16T12:16:55.854256+0000 mon.b (mon.2) 1568 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T12:16:56.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:16:56 smithi086 bash[24289]: audit 2024-09-16T12:16:55.865566+0000 mon.a (mon.0) 1603 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:16:56.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:16:56 smithi086 bash[24289]: audit 2024-09-16T12:16:55.871095+0000 mon.b (mon.2) 1569 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:16:56.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:16:56 smithi086 bash[24289]: audit 2024-09-16T12:16:55.873740+0000 mgr.a (mgr.14373) 17285 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:16:56.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:16:56 smithi047 bash[22744]: cluster 2024-09-16T12:16:54.940083+0000 mgr.a (mgr.14373) 17284 : cluster [DBG] pgmap v11989: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:16:56.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:16:56 smithi047 bash[22744]: audit 2024-09-16T12:16:55.852235+0000 mon.b (mon.2) 1567 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T12:16:56.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:16:56 smithi047 bash[22744]: audit 2024-09-16T12:16:55.854256+0000 mon.b (mon.2) 1568 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T12:16:56.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:16:56 smithi047 bash[22744]: audit 2024-09-16T12:16:55.865566+0000 mon.a (mon.0) 1603 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:16:56.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:16:56 smithi047 bash[22744]: audit 2024-09-16T12:16:55.871095+0000 mon.b (mon.2) 1569 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:16:56.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:16:56 smithi047 bash[22744]: audit 2024-09-16T12:16:55.873740+0000 mgr.a (mgr.14373) 17285 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:16:57.060 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 12:16:56 smithi047 bash[22994]: debug 2024-09-16T12:16:56.623+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T12:16:57.060 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 12:16:56 smithi047 bash[22994]: debug 2024-09-16T12:16:56.627+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T12:16:57.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:16:57 smithi086 bash[24289]: audit 2024-09-16T12:16:56.629681+0000 mgr.a (mgr.14373) 17286 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T12:16:57.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:16:57 smithi086 bash[24289]: cephadm 2024-09-16T12:16:56.631975+0000 mgr.a (mgr.14373) 17287 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T12:16:57.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:16:57 smithi047 bash[22744]: audit 2024-09-16T12:16:56.629681+0000 mgr.a (mgr.14373) 17286 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T12:16:57.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:16:57 smithi047 bash[22744]: cephadm 2024-09-16T12:16:56.631975+0000 mgr.a (mgr.14373) 17287 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T12:16:57.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:16:57 smithi157 bash[24585]: audit 2024-09-16T12:16:56.629681+0000 mgr.a (mgr.14373) 17286 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T12:16:57.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:16:57 smithi157 bash[24585]: cephadm 2024-09-16T12:16:56.631975+0000 mgr.a (mgr.14373) 17287 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T12:16:58.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:16:58 smithi086 bash[24289]: cluster 2024-09-16T12:16:56.942423+0000 mgr.a (mgr.14373) 17288 : cluster [DBG] pgmap v11990: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 6.4 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-16T12:16:58.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:16:58 smithi047 bash[22744]: cluster 2024-09-16T12:16:56.942423+0000 mgr.a (mgr.14373) 17288 : cluster [DBG] pgmap v11990: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 6.4 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-16T12:16:58.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:16:58 smithi157 bash[24585]: cluster 2024-09-16T12:16:56.942423+0000 mgr.a (mgr.14373) 17288 : cluster [DBG] pgmap v11990: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 6.4 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-16T12:16:59.910 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:16:59.910 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:16:59.910 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:17:00.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:17:00 smithi086 bash[24289]: cluster 2024-09-16T12:16:58.943179+0000 mgr.a (mgr.14373) 17289 : cluster [DBG] pgmap v11991: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 5.5 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-16T12:17:00.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:17:00 smithi047 bash[22744]: cluster 2024-09-16T12:16:58.943179+0000 mgr.a (mgr.14373) 17289 : cluster [DBG] pgmap v11991: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 5.5 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-16T12:17:00.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:17:00 smithi157 bash[24585]: cluster 2024-09-16T12:16:58.943179+0000 mgr.a (mgr.14373) 17289 : cluster [DBG] pgmap v11991: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 5.5 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-16T12:17:00.665 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:17:00.665 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:17:00.665 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:17:00.665 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:17:00.665 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:17:01.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:17:01 smithi047 bash[22744]: audit 2024-09-16T12:17:00.239751+0000 mgr.a (mgr.14373) 17290 : audit [DBG] from='client.371811 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:17:01.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:17:01 smithi157 bash[24585]: audit 2024-09-16T12:17:00.239751+0000 mgr.a (mgr.14373) 17290 : audit [DBG] from='client.371811 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:17:01.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:17:01 smithi086 bash[24289]: audit 2024-09-16T12:17:00.239751+0000 mgr.a (mgr.14373) 17290 : audit [DBG] from='client.371811 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:17:02.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:17:02 smithi047 bash[22744]: cluster 2024-09-16T12:17:00.944270+0000 mgr.a (mgr.14373) 17291 : cluster [DBG] pgmap v11992: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 5.5 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-16T12:17:02.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:17:02 smithi157 bash[24585]: cluster 2024-09-16T12:17:00.944270+0000 mgr.a (mgr.14373) 17291 : cluster [DBG] pgmap v11992: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 5.5 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-16T12:17:02.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:17:02 smithi086 bash[24289]: cluster 2024-09-16T12:17:00.944270+0000 mgr.a (mgr.14373) 17291 : cluster [DBG] pgmap v11992: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 5.5 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-16T12:17:04.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:17:04 smithi047 bash[22744]: cluster 2024-09-16T12:17:02.947088+0000 mgr.a (mgr.14373) 17292 : cluster [DBG] pgmap v11993: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:17:04.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:17:04 smithi157 bash[24585]: cluster 2024-09-16T12:17:02.947088+0000 mgr.a (mgr.14373) 17292 : cluster [DBG] pgmap v11993: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:17:04.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:17:04 smithi086 bash[24289]: cluster 2024-09-16T12:17:02.947088+0000 mgr.a (mgr.14373) 17292 : cluster [DBG] pgmap v11993: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:17:05.666 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:17:05.667 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:17:05.667 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:17:06.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:17:06 smithi047 bash[22744]: cluster 2024-09-16T12:17:04.948026+0000 mgr.a (mgr.14373) 17293 : cluster [DBG] pgmap v11994: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:17:06.409 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:17:06.410 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:17:06.410 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:17:06.410 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:17:06.410 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:17:06.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:17:06 smithi157 bash[24585]: cluster 2024-09-16T12:17:04.948026+0000 mgr.a (mgr.14373) 17293 : cluster [DBG] pgmap v11994: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:17:06.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:17:06 smithi086 bash[24289]: cluster 2024-09-16T12:17:04.948026+0000 mgr.a (mgr.14373) 17293 : cluster [DBG] pgmap v11994: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:17:07.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:17:07 smithi157 bash[24585]: audit 2024-09-16T12:17:05.991422+0000 mgr.a (mgr.14373) 17294 : audit [DBG] from='client.371886 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:17:07.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:17:07 smithi086 bash[24289]: audit 2024-09-16T12:17:05.991422+0000 mgr.a (mgr.14373) 17294 : audit [DBG] from='client.371886 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:17:07.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:17:07 smithi047 bash[22744]: audit 2024-09-16T12:17:05.991422+0000 mgr.a (mgr.14373) 17294 : audit [DBG] from='client.371886 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:17:08.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:17:08 smithi157 bash[24585]: cluster 2024-09-16T12:17:06.950332+0000 mgr.a (mgr.14373) 17295 : cluster [DBG] pgmap v11995: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:17:08.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:17:08 smithi086 bash[24289]: cluster 2024-09-16T12:17:06.950332+0000 mgr.a (mgr.14373) 17295 : cluster [DBG] pgmap v11995: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:17:08.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:17:08 smithi047 bash[22744]: cluster 2024-09-16T12:17:06.950332+0000 mgr.a (mgr.14373) 17295 : cluster [DBG] pgmap v11995: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:17:10.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:17:10 smithi157 bash[24585]: cluster 2024-09-16T12:17:08.951145+0000 mgr.a (mgr.14373) 17296 : cluster [DBG] pgmap v11996: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 3.3 KiB/s rd, 170 B/s wr, 3 op/s 2024-09-16T12:17:10.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:17:10 smithi086 bash[24289]: cluster 2024-09-16T12:17:08.951145+0000 mgr.a (mgr.14373) 17296 : cluster [DBG] pgmap v11996: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 3.3 KiB/s rd, 170 B/s wr, 3 op/s 2024-09-16T12:17:10.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:17:10 smithi047 bash[22744]: cluster 2024-09-16T12:17:08.951145+0000 mgr.a (mgr.14373) 17296 : cluster [DBG] pgmap v11996: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 3.3 KiB/s rd, 170 B/s wr, 3 op/s 2024-09-16T12:17:11.411 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:17:11.412 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:17:11.412 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:17:12.179 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:17:12.179 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:17:12.180 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:17:12.180 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:17:12.180 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:17:12.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:17:12 smithi157 bash[24585]: cluster 2024-09-16T12:17:10.951857+0000 mgr.a (mgr.14373) 17297 : cluster [DBG] pgmap v11997: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 3.3 KiB/s rd, 170 B/s wr, 3 op/s 2024-09-16T12:17:12.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:17:12 smithi157 bash[24585]: audit 2024-09-16T12:17:11.750123+0000 mgr.a (mgr.14373) 17298 : audit [DBG] from='client.371961 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:17:12.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:17:12 smithi086 bash[24289]: cluster 2024-09-16T12:17:10.951857+0000 mgr.a (mgr.14373) 17297 : cluster [DBG] pgmap v11997: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 3.3 KiB/s rd, 170 B/s wr, 3 op/s 2024-09-16T12:17:12.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:17:12 smithi086 bash[24289]: audit 2024-09-16T12:17:11.750123+0000 mgr.a (mgr.14373) 17298 : audit [DBG] from='client.371961 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:17:12.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:17:12 smithi047 bash[22744]: cluster 2024-09-16T12:17:10.951857+0000 mgr.a (mgr.14373) 17297 : cluster [DBG] pgmap v11997: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 3.3 KiB/s rd, 170 B/s wr, 3 op/s 2024-09-16T12:17:12.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:17:12 smithi047 bash[22744]: audit 2024-09-16T12:17:11.750123+0000 mgr.a (mgr.14373) 17298 : audit [DBG] from='client.371961 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:17:14.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:17:14 smithi157 bash[24585]: cluster 2024-09-16T12:17:12.954694+0000 mgr.a (mgr.14373) 17299 : cluster [DBG] pgmap v11998: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 3.3 KiB/s rd, 170 B/s wr, 3 op/s 2024-09-16T12:17:14.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:17:14 smithi086 bash[24289]: cluster 2024-09-16T12:17:12.954694+0000 mgr.a (mgr.14373) 17299 : cluster [DBG] pgmap v11998: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 3.3 KiB/s rd, 170 B/s wr, 3 op/s 2024-09-16T12:17:14.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:17:14 smithi047 bash[22744]: cluster 2024-09-16T12:17:12.954694+0000 mgr.a (mgr.14373) 17299 : cluster [DBG] pgmap v11998: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 3.3 KiB/s rd, 170 B/s wr, 3 op/s 2024-09-16T12:17:16.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:17:16 smithi157 bash[24585]: cluster 2024-09-16T12:17:14.955476+0000 mgr.a (mgr.14373) 17300 : cluster [DBG] pgmap v11999: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:17:16.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:17:16 smithi086 bash[24289]: cluster 2024-09-16T12:17:14.955476+0000 mgr.a (mgr.14373) 17300 : cluster [DBG] pgmap v11999: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:17:16.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:17:16 smithi047 bash[22744]: cluster 2024-09-16T12:17:14.955476+0000 mgr.a (mgr.14373) 17300 : cluster [DBG] pgmap v11999: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:17:17.181 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:17:17.182 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:17:17.182 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:17:17.974 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:17:17.974 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:17:17.974 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:17:17.974 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:17:17.975 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:17:18.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:17:18 smithi157 bash[24585]: cluster 2024-09-16T12:17:16.957419+0000 mgr.a (mgr.14373) 17301 : cluster [DBG] pgmap v12000: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:17:18.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:17:18 smithi157 bash[24585]: audit 2024-09-16T12:17:17.517695+0000 mgr.a (mgr.14373) 17302 : audit [DBG] from='client.372036 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:17:18.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:17:18 smithi086 bash[24289]: cluster 2024-09-16T12:17:16.957419+0000 mgr.a (mgr.14373) 17301 : cluster [DBG] pgmap v12000: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:17:18.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:17:18 smithi086 bash[24289]: audit 2024-09-16T12:17:17.517695+0000 mgr.a (mgr.14373) 17302 : audit [DBG] from='client.372036 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:17:18.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:17:18 smithi047 bash[22744]: cluster 2024-09-16T12:17:16.957419+0000 mgr.a (mgr.14373) 17301 : cluster [DBG] pgmap v12000: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:17:18.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:17:18 smithi047 bash[22744]: audit 2024-09-16T12:17:17.517695+0000 mgr.a (mgr.14373) 17302 : audit [DBG] from='client.372036 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:17:20.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:17:20 smithi157 bash[24585]: cluster 2024-09-16T12:17:18.958326+0000 mgr.a (mgr.14373) 17303 : cluster [DBG] pgmap v12001: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:17:20.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:17:20 smithi086 bash[24289]: cluster 2024-09-16T12:17:18.958326+0000 mgr.a (mgr.14373) 17303 : cluster [DBG] pgmap v12001: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:17:20.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:17:20 smithi047 bash[22744]: cluster 2024-09-16T12:17:18.958326+0000 mgr.a (mgr.14373) 17303 : cluster [DBG] pgmap v12001: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:17:22.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:17:22 smithi157 bash[24585]: cluster 2024-09-16T12:17:20.959151+0000 mgr.a (mgr.14373) 17304 : cluster [DBG] pgmap v12002: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T12:17:22.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:17:22 smithi086 bash[24289]: cluster 2024-09-16T12:17:20.959151+0000 mgr.a (mgr.14373) 17304 : cluster [DBG] pgmap v12002: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T12:17:22.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:17:22 smithi047 bash[22744]: cluster 2024-09-16T12:17:20.959151+0000 mgr.a (mgr.14373) 17304 : cluster [DBG] pgmap v12002: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T12:17:22.976 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:17:22.977 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:17:22.977 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:17:23.768 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:17:23.768 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:17:23.768 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:17:23.768 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:17:23.768 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:17:24.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:17:24 smithi157 bash[24585]: cluster 2024-09-16T12:17:22.961366+0000 mgr.a (mgr.14373) 17305 : cluster [DBG] pgmap v12003: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:17:24.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:17:24 smithi157 bash[24585]: audit 2024-09-16T12:17:23.314509+0000 mgr.a (mgr.14373) 17306 : audit [DBG] from='client.372114 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:17:24.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:17:24 smithi086 bash[24289]: cluster 2024-09-16T12:17:22.961366+0000 mgr.a (mgr.14373) 17305 : cluster [DBG] pgmap v12003: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:17:24.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:17:24 smithi086 bash[24289]: audit 2024-09-16T12:17:23.314509+0000 mgr.a (mgr.14373) 17306 : audit [DBG] from='client.372114 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:17:24.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:17:24 smithi047 bash[22744]: cluster 2024-09-16T12:17:22.961366+0000 mgr.a (mgr.14373) 17305 : cluster [DBG] pgmap v12003: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:17:24.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:17:24 smithi047 bash[22744]: audit 2024-09-16T12:17:23.314509+0000 mgr.a (mgr.14373) 17306 : audit [DBG] from='client.372114 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:17:26.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:17:26 smithi157 bash[24585]: cluster 2024-09-16T12:17:24.962263+0000 mgr.a (mgr.14373) 17307 : cluster [DBG] pgmap v12004: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:17:26.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:17:26 smithi086 bash[24289]: cluster 2024-09-16T12:17:24.962263+0000 mgr.a (mgr.14373) 17307 : cluster [DBG] pgmap v12004: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:17:26.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:17:26 smithi047 bash[22744]: cluster 2024-09-16T12:17:24.962263+0000 mgr.a (mgr.14373) 17307 : cluster [DBG] pgmap v12004: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:17:28.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:17:28 smithi157 bash[24585]: cluster 2024-09-16T12:17:26.964376+0000 mgr.a (mgr.14373) 17308 : cluster [DBG] pgmap v12005: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:17:28.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:17:28 smithi086 bash[24289]: cluster 2024-09-16T12:17:26.964376+0000 mgr.a (mgr.14373) 17308 : cluster [DBG] pgmap v12005: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:17:28.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:17:28 smithi047 bash[22744]: cluster 2024-09-16T12:17:26.964376+0000 mgr.a (mgr.14373) 17308 : cluster [DBG] pgmap v12005: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:17:28.770 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:17:28.770 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:17:28.770 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:17:29.517 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:17:29.517 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:17:29.517 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:17:29.517 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:17:29.517 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:17:30.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:17:30 smithi157 bash[24585]: cluster 2024-09-16T12:17:28.965071+0000 mgr.a (mgr.14373) 17309 : cluster [DBG] pgmap v12006: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:17:30.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:17:30 smithi157 bash[24585]: audit 2024-09-16T12:17:29.101524+0000 mgr.a (mgr.14373) 17310 : audit [DBG] from='client.372189 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:17:30.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:17:30 smithi086 bash[24289]: cluster 2024-09-16T12:17:28.965071+0000 mgr.a (mgr.14373) 17309 : cluster [DBG] pgmap v12006: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:17:30.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:17:30 smithi086 bash[24289]: audit 2024-09-16T12:17:29.101524+0000 mgr.a (mgr.14373) 17310 : audit [DBG] from='client.372189 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:17:30.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:17:30 smithi047 bash[22744]: cluster 2024-09-16T12:17:28.965071+0000 mgr.a (mgr.14373) 17309 : cluster [DBG] pgmap v12006: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:17:30.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:17:30 smithi047 bash[22744]: audit 2024-09-16T12:17:29.101524+0000 mgr.a (mgr.14373) 17310 : audit [DBG] from='client.372189 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:17:32.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:17:32 smithi157 bash[24585]: cluster 2024-09-16T12:17:30.966005+0000 mgr.a (mgr.14373) 17311 : cluster [DBG] pgmap v12007: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:17:32.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:17:32 smithi086 bash[24289]: cluster 2024-09-16T12:17:30.966005+0000 mgr.a (mgr.14373) 17311 : cluster [DBG] pgmap v12007: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:17:32.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:17:32 smithi047 bash[22744]: cluster 2024-09-16T12:17:30.966005+0000 mgr.a (mgr.14373) 17311 : cluster [DBG] pgmap v12007: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:17:34.518 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:17:34.519 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:17:34.519 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:17:34.556 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:17:34 smithi157 bash[24585]: cluster 2024-09-16T12:17:32.968254+0000 mgr.a (mgr.14373) 17312 : cluster [DBG] pgmap v12008: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:17:34.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:17:34 smithi086 bash[24289]: cluster 2024-09-16T12:17:32.968254+0000 mgr.a (mgr.14373) 17312 : cluster [DBG] pgmap v12008: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:17:34.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:17:34 smithi047 bash[22744]: cluster 2024-09-16T12:17:32.968254+0000 mgr.a (mgr.14373) 17312 : cluster [DBG] pgmap v12008: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:17:35.302 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:17:35.303 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:17:35.303 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:17:35.303 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:17:35.303 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:17:35.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:17:35 smithi157 bash[24585]: audit 2024-09-16T12:17:34.855371+0000 mgr.a (mgr.14373) 17313 : audit [DBG] from='client.372267 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:17:35.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:17:35 smithi086 bash[24289]: audit 2024-09-16T12:17:34.855371+0000 mgr.a (mgr.14373) 17313 : audit [DBG] from='client.372267 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:17:35.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:17:35 smithi047 bash[22744]: audit 2024-09-16T12:17:34.855371+0000 mgr.a (mgr.14373) 17313 : audit [DBG] from='client.372267 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:17:36.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:17:36 smithi157 bash[24585]: cluster 2024-09-16T12:17:34.968821+0000 mgr.a (mgr.14373) 17314 : cluster [DBG] pgmap v12009: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:17:36.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:17:36 smithi086 bash[24289]: cluster 2024-09-16T12:17:34.968821+0000 mgr.a (mgr.14373) 17314 : cluster [DBG] pgmap v12009: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:17:36.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:17:36 smithi047 bash[22744]: cluster 2024-09-16T12:17:34.968821+0000 mgr.a (mgr.14373) 17314 : cluster [DBG] pgmap v12009: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:17:38.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:17:38 smithi157 bash[24585]: cluster 2024-09-16T12:17:36.971239+0000 mgr.a (mgr.14373) 17315 : cluster [DBG] pgmap v12010: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:17:38.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:17:38 smithi086 bash[24289]: cluster 2024-09-16T12:17:36.971239+0000 mgr.a (mgr.14373) 17315 : cluster [DBG] pgmap v12010: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:17:38.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:17:38 smithi047 bash[22744]: cluster 2024-09-16T12:17:36.971239+0000 mgr.a (mgr.14373) 17315 : cluster [DBG] pgmap v12010: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:17:40.304 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:17:40.305 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:17:40.305 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:17:40.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:17:40 smithi157 bash[24585]: cluster 2024-09-16T12:17:38.972040+0000 mgr.a (mgr.14373) 17316 : cluster [DBG] pgmap v12011: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:17:40.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:17:40 smithi086 bash[24289]: cluster 2024-09-16T12:17:38.972040+0000 mgr.a (mgr.14373) 17316 : cluster [DBG] pgmap v12011: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:17:40.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:17:40 smithi047 bash[22744]: cluster 2024-09-16T12:17:38.972040+0000 mgr.a (mgr.14373) 17316 : cluster [DBG] pgmap v12011: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:17:41.092 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:17:41.092 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:17:41.093 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:17:41.093 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:17:41.093 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:17:41.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:17:41 smithi157 bash[24585]: audit 2024-09-16T12:17:40.638297+0000 mgr.a (mgr.14373) 17317 : audit [DBG] from='client.372345 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:17:41.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:17:41 smithi086 bash[24289]: audit 2024-09-16T12:17:40.638297+0000 mgr.a (mgr.14373) 17317 : audit [DBG] from='client.372345 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:17:41.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:17:41 smithi047 bash[22744]: audit 2024-09-16T12:17:40.638297+0000 mgr.a (mgr.14373) 17317 : audit [DBG] from='client.372345 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:17:42.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:17:42 smithi157 bash[24585]: cluster 2024-09-16T12:17:40.972691+0000 mgr.a (mgr.14373) 17318 : cluster [DBG] pgmap v12012: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:17:42.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:17:42 smithi086 bash[24289]: cluster 2024-09-16T12:17:40.972691+0000 mgr.a (mgr.14373) 17318 : cluster [DBG] pgmap v12012: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:17:42.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:17:42 smithi047 bash[22744]: cluster 2024-09-16T12:17:40.972691+0000 mgr.a (mgr.14373) 17318 : cluster [DBG] pgmap v12012: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:17:44.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:17:44 smithi157 bash[24585]: cluster 2024-09-16T12:17:42.974950+0000 mgr.a (mgr.14373) 17319 : cluster [DBG] pgmap v12013: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:17:44.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:17:44 smithi086 bash[24289]: cluster 2024-09-16T12:17:42.974950+0000 mgr.a (mgr.14373) 17319 : cluster [DBG] pgmap v12013: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:17:44.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:17:44 smithi047 bash[22744]: cluster 2024-09-16T12:17:42.974950+0000 mgr.a (mgr.14373) 17319 : cluster [DBG] pgmap v12013: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:17:46.094 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:17:46.095 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:17:46.095 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:17:46.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:17:46 smithi157 bash[24585]: cluster 2024-09-16T12:17:44.975738+0000 mgr.a (mgr.14373) 17320 : cluster [DBG] pgmap v12014: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:17:46.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:17:46 smithi086 bash[24289]: cluster 2024-09-16T12:17:44.975738+0000 mgr.a (mgr.14373) 17320 : cluster [DBG] pgmap v12014: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:17:46.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:17:46 smithi047 bash[22744]: cluster 2024-09-16T12:17:44.975738+0000 mgr.a (mgr.14373) 17320 : cluster [DBG] pgmap v12014: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:17:46.824 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:17:46.825 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:17:46.825 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:17:46.825 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:17:46.825 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:17:47.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:17:47 smithi157 bash[24585]: audit 2024-09-16T12:17:46.418079+0000 mgr.a (mgr.14373) 17321 : audit [DBG] from='client.372423 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:17:47.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:17:47 smithi086 bash[24289]: audit 2024-09-16T12:17:46.418079+0000 mgr.a (mgr.14373) 17321 : audit [DBG] from='client.372423 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:17:47.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:17:47 smithi047 bash[22744]: audit 2024-09-16T12:17:46.418079+0000 mgr.a (mgr.14373) 17321 : audit [DBG] from='client.372423 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:17:48.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:17:48 smithi157 bash[24585]: cluster 2024-09-16T12:17:46.978498+0000 mgr.a (mgr.14373) 17322 : cluster [DBG] pgmap v12015: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:17:48.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:17:48 smithi086 bash[24289]: cluster 2024-09-16T12:17:46.978498+0000 mgr.a (mgr.14373) 17322 : cluster [DBG] pgmap v12015: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:17:48.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:17:48 smithi047 bash[22744]: cluster 2024-09-16T12:17:46.978498+0000 mgr.a (mgr.14373) 17322 : cluster [DBG] pgmap v12015: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:17:50.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:17:50 smithi157 bash[24585]: cluster 2024-09-16T12:17:48.979212+0000 mgr.a (mgr.14373) 17323 : cluster [DBG] pgmap v12016: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:17:50.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:17:50 smithi086 bash[24289]: cluster 2024-09-16T12:17:48.979212+0000 mgr.a (mgr.14373) 17323 : cluster [DBG] pgmap v12016: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:17:50.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:17:50 smithi047 bash[22744]: cluster 2024-09-16T12:17:48.979212+0000 mgr.a (mgr.14373) 17323 : cluster [DBG] pgmap v12016: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:17:51.826 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:17:51.827 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:17:51.827 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:17:52.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:17:52 smithi157 bash[24585]: cluster 2024-09-16T12:17:50.979984+0000 mgr.a (mgr.14373) 17324 : cluster [DBG] pgmap v12017: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T12:17:52.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:17:52 smithi086 bash[24289]: cluster 2024-09-16T12:17:50.979984+0000 mgr.a (mgr.14373) 17324 : cluster [DBG] pgmap v12017: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T12:17:52.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:17:52 smithi047 bash[22744]: cluster 2024-09-16T12:17:50.979984+0000 mgr.a (mgr.14373) 17324 : cluster [DBG] pgmap v12017: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T12:17:52.610 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:17:52.611 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:17:52.611 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:17:52.611 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:17:52.611 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:17:53.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:17:53 smithi157 bash[24585]: audit 2024-09-16T12:17:52.162177+0000 mgr.a (mgr.14373) 17325 : audit [DBG] from='client.372498 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:17:53.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:17:53 smithi086 bash[24289]: audit 2024-09-16T12:17:52.162177+0000 mgr.a (mgr.14373) 17325 : audit [DBG] from='client.372498 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:17:53.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:17:53 smithi047 bash[22744]: audit 2024-09-16T12:17:52.162177+0000 mgr.a (mgr.14373) 17325 : audit [DBG] from='client.372498 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:17:54.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:17:54 smithi157 bash[24585]: cluster 2024-09-16T12:17:52.982902+0000 mgr.a (mgr.14373) 17326 : cluster [DBG] pgmap v12018: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:17:54.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:17:54 smithi086 bash[24289]: cluster 2024-09-16T12:17:52.982902+0000 mgr.a (mgr.14373) 17326 : cluster [DBG] pgmap v12018: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:17:54.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:17:54 smithi047 bash[22744]: cluster 2024-09-16T12:17:52.982902+0000 mgr.a (mgr.14373) 17326 : cluster [DBG] pgmap v12018: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:17:56.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:17:56 smithi157 bash[24585]: cluster 2024-09-16T12:17:54.983829+0000 mgr.a (mgr.14373) 17327 : cluster [DBG] pgmap v12019: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:17:56.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:17:56 smithi086 bash[24289]: cluster 2024-09-16T12:17:54.983829+0000 mgr.a (mgr.14373) 17327 : cluster [DBG] pgmap v12019: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:17:56.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:17:56 smithi047 bash[22744]: cluster 2024-09-16T12:17:54.983829+0000 mgr.a (mgr.14373) 17327 : cluster [DBG] pgmap v12019: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:17:57.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:17:57 smithi157 bash[24585]: audit 2024-09-16T12:17:56.682513+0000 mon.b (mon.2) 1570 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T12:17:57.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:17:57 smithi086 bash[24289]: audit 2024-09-16T12:17:56.682513+0000 mon.b (mon.2) 1570 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T12:17:57.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:17:57 smithi047 bash[22744]: audit 2024-09-16T12:17:56.682513+0000 mon.b (mon.2) 1570 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T12:17:57.612 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:17:57.613 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:17:57.613 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:17:58.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:17:58 smithi157 bash[24585]: cluster 2024-09-16T12:17:56.985982+0000 mgr.a (mgr.14373) 17328 : cluster [DBG] pgmap v12020: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:17:58.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:17:58 smithi157 bash[24585]: audit 2024-09-16T12:17:57.542427+0000 mon.b (mon.2) 1571 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T12:17:58.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:17:58 smithi157 bash[24585]: audit 2024-09-16T12:17:57.544612+0000 mon.b (mon.2) 1572 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T12:17:58.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:17:58 smithi157 bash[24585]: audit 2024-09-16T12:17:57.556562+0000 mon.a (mon.0) 1604 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:17:58.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:17:58 smithi157 bash[24585]: audit 2024-09-16T12:17:57.561828+0000 mon.b (mon.2) 1573 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:17:58.558 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:17:58 smithi157 bash[24585]: audit 2024-09-16T12:17:57.564194+0000 mgr.a (mgr.14373) 17329 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:17:58.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:17:58 smithi086 bash[24289]: cluster 2024-09-16T12:17:56.985982+0000 mgr.a (mgr.14373) 17328 : cluster [DBG] pgmap v12020: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:17:58.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:17:58 smithi086 bash[24289]: audit 2024-09-16T12:17:57.542427+0000 mon.b (mon.2) 1571 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T12:17:58.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:17:58 smithi086 bash[24289]: audit 2024-09-16T12:17:57.544612+0000 mon.b (mon.2) 1572 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T12:17:58.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:17:58 smithi086 bash[24289]: audit 2024-09-16T12:17:57.556562+0000 mon.a (mon.0) 1604 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:17:58.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:17:58 smithi086 bash[24289]: audit 2024-09-16T12:17:57.561828+0000 mon.b (mon.2) 1573 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:17:58.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:17:58 smithi086 bash[24289]: audit 2024-09-16T12:17:57.564194+0000 mgr.a (mgr.14373) 17329 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:17:58.592 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 12:17:58 smithi047 bash[22994]: debug 2024-09-16T12:17:58.310+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T12:17:58.592 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 12:17:58 smithi047 bash[22994]: debug 2024-09-16T12:17:58.326+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T12:17:58.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:17:58 smithi047 bash[22744]: cluster 2024-09-16T12:17:56.985982+0000 mgr.a (mgr.14373) 17328 : cluster [DBG] pgmap v12020: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:17:58.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:17:58 smithi047 bash[22744]: audit 2024-09-16T12:17:57.542427+0000 mon.b (mon.2) 1571 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T12:17:58.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:17:58 smithi047 bash[22744]: audit 2024-09-16T12:17:57.544612+0000 mon.b (mon.2) 1572 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T12:17:58.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:17:58 smithi047 bash[22744]: audit 2024-09-16T12:17:57.556562+0000 mon.a (mon.0) 1604 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:17:58.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:17:58 smithi047 bash[22744]: audit 2024-09-16T12:17:57.561828+0000 mon.b (mon.2) 1573 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:17:58.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:17:58 smithi047 bash[22744]: audit 2024-09-16T12:17:57.564194+0000 mgr.a (mgr.14373) 17329 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:17:58.722 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:17:58.723 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:17:58.723 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:17:58.723 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:17:58.723 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:17:59.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:17:59 smithi157 bash[24585]: audit 2024-09-16T12:17:57.947186+0000 mgr.a (mgr.14373) 17330 : audit [DBG] from='client.372594 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:17:59.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:17:59 smithi157 bash[24585]: audit 2024-09-16T12:17:58.313872+0000 mgr.a (mgr.14373) 17331 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T12:17:59.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:17:59 smithi157 bash[24585]: cephadm 2024-09-16T12:17:58.329707+0000 mgr.a (mgr.14373) 17332 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T12:17:59.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:17:59 smithi086 bash[24289]: audit 2024-09-16T12:17:57.947186+0000 mgr.a (mgr.14373) 17330 : audit [DBG] from='client.372594 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:17:59.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:17:59 smithi086 bash[24289]: audit 2024-09-16T12:17:58.313872+0000 mgr.a (mgr.14373) 17331 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T12:17:59.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:17:59 smithi086 bash[24289]: cephadm 2024-09-16T12:17:58.329707+0000 mgr.a (mgr.14373) 17332 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T12:17:59.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:17:59 smithi047 bash[22744]: audit 2024-09-16T12:17:57.947186+0000 mgr.a (mgr.14373) 17330 : audit [DBG] from='client.372594 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:17:59.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:17:59 smithi047 bash[22744]: audit 2024-09-16T12:17:58.313872+0000 mgr.a (mgr.14373) 17331 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T12:17:59.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:17:59 smithi047 bash[22744]: cephadm 2024-09-16T12:17:58.329707+0000 mgr.a (mgr.14373) 17332 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T12:18:00.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:18:00 smithi157 bash[24585]: cluster 2024-09-16T12:17:58.986951+0000 mgr.a (mgr.14373) 17333 : cluster [DBG] pgmap v12021: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:18:00.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:18:00 smithi086 bash[24289]: cluster 2024-09-16T12:17:58.986951+0000 mgr.a (mgr.14373) 17333 : cluster [DBG] pgmap v12021: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:18:00.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:18:00 smithi047 bash[22744]: cluster 2024-09-16T12:17:58.986951+0000 mgr.a (mgr.14373) 17333 : cluster [DBG] pgmap v12021: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:18:02.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:18:02 smithi157 bash[24585]: cluster 2024-09-16T12:18:00.987704+0000 mgr.a (mgr.14373) 17334 : cluster [DBG] pgmap v12022: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:18:02.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:18:02 smithi086 bash[24289]: cluster 2024-09-16T12:18:00.987704+0000 mgr.a (mgr.14373) 17334 : cluster [DBG] pgmap v12022: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:18:02.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:18:02 smithi047 bash[22744]: cluster 2024-09-16T12:18:00.987704+0000 mgr.a (mgr.14373) 17334 : cluster [DBG] pgmap v12022: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:18:03.724 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:18:03.725 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:18:03.725 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:18:04.488 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:18:04.489 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:18:04.489 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:18:04.489 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:18:04.489 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:18:04.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:18:04 smithi157 bash[24585]: cluster 2024-09-16T12:18:02.989906+0000 mgr.a (mgr.14373) 17335 : cluster [DBG] pgmap v12023: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:18:04.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:18:04 smithi086 bash[24289]: cluster 2024-09-16T12:18:02.989906+0000 mgr.a (mgr.14373) 17335 : cluster [DBG] pgmap v12023: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:18:04.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:18:04 smithi047 bash[22744]: cluster 2024-09-16T12:18:02.989906+0000 mgr.a (mgr.14373) 17335 : cluster [DBG] pgmap v12023: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:18:05.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:18:05 smithi157 bash[24585]: audit 2024-09-16T12:18:04.052169+0000 mgr.a (mgr.14373) 17336 : audit [DBG] from='client.372756 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:18:05.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:18:05 smithi086 bash[24289]: audit 2024-09-16T12:18:04.052169+0000 mgr.a (mgr.14373) 17336 : audit [DBG] from='client.372756 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:18:05.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:18:05 smithi047 bash[22744]: audit 2024-09-16T12:18:04.052169+0000 mgr.a (mgr.14373) 17336 : audit [DBG] from='client.372756 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:18:06.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:18:06 smithi157 bash[24585]: cluster 2024-09-16T12:18:04.990812+0000 mgr.a (mgr.14373) 17337 : cluster [DBG] pgmap v12024: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:18:06.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:18:06 smithi086 bash[24289]: cluster 2024-09-16T12:18:04.990812+0000 mgr.a (mgr.14373) 17337 : cluster [DBG] pgmap v12024: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:18:06.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:18:06 smithi047 bash[22744]: cluster 2024-09-16T12:18:04.990812+0000 mgr.a (mgr.14373) 17337 : cluster [DBG] pgmap v12024: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:18:08.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:18:08 smithi157 bash[24585]: cluster 2024-09-16T12:18:06.993007+0000 mgr.a (mgr.14373) 17338 : cluster [DBG] pgmap v12025: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 12 KiB/s rd, 426 B/s wr, 14 op/s 2024-09-16T12:18:08.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:18:08 smithi086 bash[24289]: cluster 2024-09-16T12:18:06.993007+0000 mgr.a (mgr.14373) 17338 : cluster [DBG] pgmap v12025: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 12 KiB/s rd, 426 B/s wr, 14 op/s 2024-09-16T12:18:08.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:18:08 smithi047 bash[22744]: cluster 2024-09-16T12:18:06.993007+0000 mgr.a (mgr.14373) 17338 : cluster [DBG] pgmap v12025: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 12 KiB/s rd, 426 B/s wr, 14 op/s 2024-09-16T12:18:09.490 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:18:09.491 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:18:09.491 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:18:10.237 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:18:10.237 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:18:10.237 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:18:10.237 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:18:10.237 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:18:10.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:18:10 smithi157 bash[24585]: cluster 2024-09-16T12:18:08.993768+0000 mgr.a (mgr.14373) 17339 : cluster [DBG] pgmap v12026: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 11 KiB/s rd, 426 B/s wr, 13 op/s 2024-09-16T12:18:10.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:18:10 smithi157 bash[24585]: audit 2024-09-16T12:18:09.814076+0000 mgr.a (mgr.14373) 17340 : audit [DBG] from='client.372831 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:18:10.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:18:10 smithi086 bash[24289]: cluster 2024-09-16T12:18:08.993768+0000 mgr.a (mgr.14373) 17339 : cluster [DBG] pgmap v12026: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 11 KiB/s rd, 426 B/s wr, 13 op/s 2024-09-16T12:18:10.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:18:10 smithi086 bash[24289]: audit 2024-09-16T12:18:09.814076+0000 mgr.a (mgr.14373) 17340 : audit [DBG] from='client.372831 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:18:10.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:18:10 smithi047 bash[22744]: cluster 2024-09-16T12:18:08.993768+0000 mgr.a (mgr.14373) 17339 : cluster [DBG] pgmap v12026: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 11 KiB/s rd, 426 B/s wr, 13 op/s 2024-09-16T12:18:10.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:18:10 smithi047 bash[22744]: audit 2024-09-16T12:18:09.814076+0000 mgr.a (mgr.14373) 17340 : audit [DBG] from='client.372831 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:18:12.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:18:12 smithi157 bash[24585]: cluster 2024-09-16T12:18:10.994661+0000 mgr.a (mgr.14373) 17341 : cluster [DBG] pgmap v12027: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 11 KiB/s rd, 426 B/s wr, 13 op/s 2024-09-16T12:18:12.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:18:12 smithi086 bash[24289]: cluster 2024-09-16T12:18:10.994661+0000 mgr.a (mgr.14373) 17341 : cluster [DBG] pgmap v12027: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 11 KiB/s rd, 426 B/s wr, 13 op/s 2024-09-16T12:18:12.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:18:12 smithi047 bash[22744]: cluster 2024-09-16T12:18:10.994661+0000 mgr.a (mgr.14373) 17341 : cluster [DBG] pgmap v12027: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 11 KiB/s rd, 426 B/s wr, 13 op/s 2024-09-16T12:18:14.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:18:14 smithi157 bash[24585]: cluster 2024-09-16T12:18:12.996872+0000 mgr.a (mgr.14373) 17342 : cluster [DBG] pgmap v12028: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 12 KiB/s rd, 426 B/s wr, 14 op/s 2024-09-16T12:18:14.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:18:14 smithi086 bash[24289]: cluster 2024-09-16T12:18:12.996872+0000 mgr.a (mgr.14373) 17342 : cluster [DBG] pgmap v12028: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 12 KiB/s rd, 426 B/s wr, 14 op/s 2024-09-16T12:18:14.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:18:14 smithi047 bash[22744]: cluster 2024-09-16T12:18:12.996872+0000 mgr.a (mgr.14373) 17342 : cluster [DBG] pgmap v12028: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 12 KiB/s rd, 426 B/s wr, 14 op/s 2024-09-16T12:18:15.238 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:18:15.239 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:18:15.239 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:18:16.020 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:18:16.021 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:18:16.021 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:18:16.021 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:18:16.021 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:18:16.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:18:16 smithi157 bash[24585]: cluster 2024-09-16T12:18:14.997631+0000 mgr.a (mgr.14373) 17343 : cluster [DBG] pgmap v12029: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-16T12:18:16.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:18:16 smithi157 bash[24585]: audit 2024-09-16T12:18:15.570646+0000 mgr.a (mgr.14373) 17344 : audit [DBG] from='client.372909 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:18:16.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:18:16 smithi086 bash[24289]: cluster 2024-09-16T12:18:14.997631+0000 mgr.a (mgr.14373) 17343 : cluster [DBG] pgmap v12029: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-16T12:18:16.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:18:16 smithi086 bash[24289]: audit 2024-09-16T12:18:15.570646+0000 mgr.a (mgr.14373) 17344 : audit [DBG] from='client.372909 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:18:16.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:18:16 smithi047 bash[22744]: cluster 2024-09-16T12:18:14.997631+0000 mgr.a (mgr.14373) 17343 : cluster [DBG] pgmap v12029: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-16T12:18:16.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:18:16 smithi047 bash[22744]: audit 2024-09-16T12:18:15.570646+0000 mgr.a (mgr.14373) 17344 : audit [DBG] from='client.372909 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:18:18.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:18:18 smithi157 bash[24585]: cluster 2024-09-16T12:18:16.999931+0000 mgr.a (mgr.14373) 17345 : cluster [DBG] pgmap v12030: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-16T12:18:18.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:18:18 smithi086 bash[24289]: cluster 2024-09-16T12:18:16.999931+0000 mgr.a (mgr.14373) 17345 : cluster [DBG] pgmap v12030: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-16T12:18:18.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:18:18 smithi047 bash[22744]: cluster 2024-09-16T12:18:16.999931+0000 mgr.a (mgr.14373) 17345 : cluster [DBG] pgmap v12030: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-16T12:18:20.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:18:20 smithi157 bash[24585]: cluster 2024-09-16T12:18:19.000666+0000 mgr.a (mgr.14373) 17346 : cluster [DBG] pgmap v12031: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:18:20.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:18:20 smithi086 bash[24289]: cluster 2024-09-16T12:18:19.000666+0000 mgr.a (mgr.14373) 17346 : cluster [DBG] pgmap v12031: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:18:20.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:18:20 smithi047 bash[22744]: cluster 2024-09-16T12:18:19.000666+0000 mgr.a (mgr.14373) 17346 : cluster [DBG] pgmap v12031: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:18:21.022 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:18:21.023 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:18:21.023 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:18:21.773 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:18:21.773 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:18:21.773 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:18:21.773 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:18:21.773 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:18:22.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:18:22 smithi157 bash[24585]: cluster 2024-09-16T12:18:21.001423+0000 mgr.a (mgr.14373) 17347 : cluster [DBG] pgmap v12032: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:18:22.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:18:22 smithi157 bash[24585]: audit 2024-09-16T12:18:21.353727+0000 mgr.a (mgr.14373) 17348 : audit [DBG] from='client.372987 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:18:22.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:18:22 smithi086 bash[24289]: cluster 2024-09-16T12:18:21.001423+0000 mgr.a (mgr.14373) 17347 : cluster [DBG] pgmap v12032: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:18:22.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:18:22 smithi086 bash[24289]: audit 2024-09-16T12:18:21.353727+0000 mgr.a (mgr.14373) 17348 : audit [DBG] from='client.372987 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:18:22.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:18:22 smithi047 bash[22744]: cluster 2024-09-16T12:18:21.001423+0000 mgr.a (mgr.14373) 17347 : cluster [DBG] pgmap v12032: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:18:22.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:18:22 smithi047 bash[22744]: audit 2024-09-16T12:18:21.353727+0000 mgr.a (mgr.14373) 17348 : audit [DBG] from='client.372987 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:18:24.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:18:24 smithi157 bash[24585]: cluster 2024-09-16T12:18:23.004120+0000 mgr.a (mgr.14373) 17349 : cluster [DBG] pgmap v12033: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:18:24.572 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:18:24 smithi086 bash[24289]: cluster 2024-09-16T12:18:23.004120+0000 mgr.a (mgr.14373) 17349 : cluster [DBG] pgmap v12033: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:18:24.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:18:24 smithi047 bash[22744]: cluster 2024-09-16T12:18:23.004120+0000 mgr.a (mgr.14373) 17349 : cluster [DBG] pgmap v12033: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:18:26.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:18:26 smithi086 bash[24289]: cluster 2024-09-16T12:18:25.004941+0000 mgr.a (mgr.14373) 17350 : cluster [DBG] pgmap v12034: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:18:26.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:18:26 smithi047 bash[22744]: cluster 2024-09-16T12:18:25.004941+0000 mgr.a (mgr.14373) 17350 : cluster [DBG] pgmap v12034: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:18:26.775 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:18:26.775 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:18:26.775 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:18:26.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:18:26 smithi157 bash[24585]: cluster 2024-09-16T12:18:25.004941+0000 mgr.a (mgr.14373) 17350 : cluster [DBG] pgmap v12034: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:18:27.556 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:18:27.557 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:18:27.557 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:18:27.557 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:18:27.557 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:18:28.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:18:28 smithi086 bash[24289]: cluster 2024-09-16T12:18:27.007052+0000 mgr.a (mgr.14373) 17351 : cluster [DBG] pgmap v12035: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:18:28.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:18:28 smithi086 bash[24289]: audit 2024-09-16T12:18:27.109895+0000 mgr.a (mgr.14373) 17352 : audit [DBG] from='client.373062 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:18:28.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:18:28 smithi047 bash[22744]: cluster 2024-09-16T12:18:27.007052+0000 mgr.a (mgr.14373) 17351 : cluster [DBG] pgmap v12035: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:18:28.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:18:28 smithi047 bash[22744]: audit 2024-09-16T12:18:27.109895+0000 mgr.a (mgr.14373) 17352 : audit [DBG] from='client.373062 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:18:28.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:18:28 smithi157 bash[24585]: cluster 2024-09-16T12:18:27.007052+0000 mgr.a (mgr.14373) 17351 : cluster [DBG] pgmap v12035: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:18:28.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:18:28 smithi157 bash[24585]: audit 2024-09-16T12:18:27.109895+0000 mgr.a (mgr.14373) 17352 : audit [DBG] from='client.373062 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:18:30.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:18:30 smithi086 bash[24289]: cluster 2024-09-16T12:18:29.007945+0000 mgr.a (mgr.14373) 17353 : cluster [DBG] pgmap v12036: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:18:30.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:18:30 smithi047 bash[22744]: cluster 2024-09-16T12:18:29.007945+0000 mgr.a (mgr.14373) 17353 : cluster [DBG] pgmap v12036: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:18:30.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:18:30 smithi157 bash[24585]: cluster 2024-09-16T12:18:29.007945+0000 mgr.a (mgr.14373) 17353 : cluster [DBG] pgmap v12036: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:18:32.558 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:18:32.559 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:18:32.559 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:18:32.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:18:32 smithi047 bash[22744]: cluster 2024-09-16T12:18:31.008761+0000 mgr.a (mgr.14373) 17354 : cluster [DBG] pgmap v12037: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T12:18:32.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:18:32 smithi157 bash[24585]: cluster 2024-09-16T12:18:31.008761+0000 mgr.a (mgr.14373) 17354 : cluster [DBG] pgmap v12037: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T12:18:32.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:18:32 smithi086 bash[24289]: cluster 2024-09-16T12:18:31.008761+0000 mgr.a (mgr.14373) 17354 : cluster [DBG] pgmap v12037: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T12:18:33.337 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:18:33.337 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:18:33.337 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:18:33.338 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:18:33.338 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:18:33.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:18:33 smithi047 bash[22744]: audit 2024-09-16T12:18:32.894248+0000 mgr.a (mgr.14373) 17355 : audit [DBG] from='client.373137 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:18:33.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:18:33 smithi157 bash[24585]: audit 2024-09-16T12:18:32.894248+0000 mgr.a (mgr.14373) 17355 : audit [DBG] from='client.373137 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:18:33.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:18:33 smithi086 bash[24289]: audit 2024-09-16T12:18:32.894248+0000 mgr.a (mgr.14373) 17355 : audit [DBG] from='client.373137 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:18:34.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:18:34 smithi047 bash[22744]: cluster 2024-09-16T12:18:33.010209+0000 mgr.a (mgr.14373) 17356 : cluster [DBG] pgmap v12038: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:18:34.815 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:18:34 smithi157 bash[24585]: cluster 2024-09-16T12:18:33.010209+0000 mgr.a (mgr.14373) 17356 : cluster [DBG] pgmap v12038: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:18:34.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:18:34 smithi086 bash[24289]: cluster 2024-09-16T12:18:33.010209+0000 mgr.a (mgr.14373) 17356 : cluster [DBG] pgmap v12038: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:18:36.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:18:36 smithi047 bash[22744]: cluster 2024-09-16T12:18:35.011061+0000 mgr.a (mgr.14373) 17357 : cluster [DBG] pgmap v12039: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:18:36.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:18:36 smithi157 bash[24585]: cluster 2024-09-16T12:18:35.011061+0000 mgr.a (mgr.14373) 17357 : cluster [DBG] pgmap v12039: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:18:36.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:18:36 smithi086 bash[24289]: cluster 2024-09-16T12:18:35.011061+0000 mgr.a (mgr.14373) 17357 : cluster [DBG] pgmap v12039: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:18:38.339 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:18:38.339 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:18:38.339 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:18:38.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:18:38 smithi047 bash[22744]: cluster 2024-09-16T12:18:37.013379+0000 mgr.a (mgr.14373) 17358 : cluster [DBG] pgmap v12040: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 53 KiB/s rd, 0 B/s wr, 85 op/s 2024-09-16T12:18:38.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:18:38 smithi157 bash[24585]: cluster 2024-09-16T12:18:37.013379+0000 mgr.a (mgr.14373) 17358 : cluster [DBG] pgmap v12040: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 53 KiB/s rd, 0 B/s wr, 85 op/s 2024-09-16T12:18:38.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:18:38 smithi086 bash[24289]: cluster 2024-09-16T12:18:37.013379+0000 mgr.a (mgr.14373) 17358 : cluster [DBG] pgmap v12040: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 53 KiB/s rd, 0 B/s wr, 85 op/s 2024-09-16T12:18:39.127 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:18:39.128 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:18:39.128 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:18:39.128 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:18:39.128 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:18:39.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:18:39 smithi157 bash[24585]: audit 2024-09-16T12:18:38.676445+0000 mgr.a (mgr.14373) 17359 : audit [DBG] from='client.373212 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:18:39.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:18:39 smithi086 bash[24289]: audit 2024-09-16T12:18:38.676445+0000 mgr.a (mgr.14373) 17359 : audit [DBG] from='client.373212 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:18:39.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:18:39 smithi047 bash[22744]: audit 2024-09-16T12:18:38.676445+0000 mgr.a (mgr.14373) 17359 : audit [DBG] from='client.373212 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:18:40.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:18:40 smithi157 bash[24585]: cluster 2024-09-16T12:18:39.020962+0000 mgr.a (mgr.14373) 17360 : cluster [DBG] pgmap v12041: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 52 KiB/s rd, 0 B/s wr, 84 op/s 2024-09-16T12:18:40.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:18:40 smithi086 bash[24289]: cluster 2024-09-16T12:18:39.020962+0000 mgr.a (mgr.14373) 17360 : cluster [DBG] pgmap v12041: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 52 KiB/s rd, 0 B/s wr, 84 op/s 2024-09-16T12:18:40.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:18:40 smithi047 bash[22744]: cluster 2024-09-16T12:18:39.020962+0000 mgr.a (mgr.14373) 17360 : cluster [DBG] pgmap v12041: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 52 KiB/s rd, 0 B/s wr, 84 op/s 2024-09-16T12:18:42.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:18:42 smithi157 bash[24585]: cluster 2024-09-16T12:18:41.021762+0000 mgr.a (mgr.14373) 17361 : cluster [DBG] pgmap v12042: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 52 KiB/s rd, 0 B/s wr, 84 op/s 2024-09-16T12:18:42.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:18:42 smithi086 bash[24289]: cluster 2024-09-16T12:18:41.021762+0000 mgr.a (mgr.14373) 17361 : cluster [DBG] pgmap v12042: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 52 KiB/s rd, 0 B/s wr, 84 op/s 2024-09-16T12:18:42.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:18:42 smithi047 bash[22744]: cluster 2024-09-16T12:18:41.021762+0000 mgr.a (mgr.14373) 17361 : cluster [DBG] pgmap v12042: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 52 KiB/s rd, 0 B/s wr, 84 op/s 2024-09-16T12:18:44.129 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:18:44.130 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:18:44.130 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:18:44.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:18:44 smithi157 bash[24585]: cluster 2024-09-16T12:18:43.024010+0000 mgr.a (mgr.14373) 17362 : cluster [DBG] pgmap v12043: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 66 KiB/s rd, 0 B/s wr, 108 op/s 2024-09-16T12:18:44.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:18:44 smithi086 bash[24289]: cluster 2024-09-16T12:18:43.024010+0000 mgr.a (mgr.14373) 17362 : cluster [DBG] pgmap v12043: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 66 KiB/s rd, 0 B/s wr, 108 op/s 2024-09-16T12:18:44.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:18:44 smithi047 bash[22744]: cluster 2024-09-16T12:18:43.024010+0000 mgr.a (mgr.14373) 17362 : cluster [DBG] pgmap v12043: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 66 KiB/s rd, 0 B/s wr, 108 op/s 2024-09-16T12:18:44.914 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:18:44.914 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:18:44.914 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:18:44.914 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:18:44.914 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:18:45.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:18:45 smithi157 bash[24585]: audit 2024-09-16T12:18:44.468103+0000 mgr.a (mgr.14373) 17363 : audit [DBG] from='client.373290 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:18:45.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:18:45 smithi086 bash[24289]: audit 2024-09-16T12:18:44.468103+0000 mgr.a (mgr.14373) 17363 : audit [DBG] from='client.373290 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:18:45.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:18:45 smithi047 bash[22744]: audit 2024-09-16T12:18:44.468103+0000 mgr.a (mgr.14373) 17363 : audit [DBG] from='client.373290 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:18:46.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:18:46 smithi157 bash[24585]: cluster 2024-09-16T12:18:45.024990+0000 mgr.a (mgr.14373) 17364 : cluster [DBG] pgmap v12044: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 65 KiB/s rd, 0 B/s wr, 107 op/s 2024-09-16T12:18:46.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:18:46 smithi086 bash[24289]: cluster 2024-09-16T12:18:45.024990+0000 mgr.a (mgr.14373) 17364 : cluster [DBG] pgmap v12044: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 65 KiB/s rd, 0 B/s wr, 107 op/s 2024-09-16T12:18:46.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:18:46 smithi047 bash[22744]: cluster 2024-09-16T12:18:45.024990+0000 mgr.a (mgr.14373) 17364 : cluster [DBG] pgmap v12044: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 65 KiB/s rd, 0 B/s wr, 107 op/s 2024-09-16T12:18:48.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:18:48 smithi157 bash[24585]: cluster 2024-09-16T12:18:47.027197+0000 mgr.a (mgr.14373) 17365 : cluster [DBG] pgmap v12045: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 66 KiB/s rd, 0 B/s wr, 108 op/s 2024-09-16T12:18:48.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:18:48 smithi086 bash[24289]: cluster 2024-09-16T12:18:47.027197+0000 mgr.a (mgr.14373) 17365 : cluster [DBG] pgmap v12045: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 66 KiB/s rd, 0 B/s wr, 108 op/s 2024-09-16T12:18:48.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:18:48 smithi047 bash[22744]: cluster 2024-09-16T12:18:47.027197+0000 mgr.a (mgr.14373) 17365 : cluster [DBG] pgmap v12045: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 66 KiB/s rd, 0 B/s wr, 108 op/s 2024-09-16T12:18:49.916 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:18:49.916 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:18:49.917 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:18:50.698 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:18:50.698 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:18:50.698 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:18:50.698 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:18:50.698 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:18:50.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:18:50 smithi157 bash[24585]: cluster 2024-09-16T12:18:49.027937+0000 mgr.a (mgr.14373) 17366 : cluster [DBG] pgmap v12046: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 15 KiB/s rd, 0 B/s wr, 24 op/s 2024-09-16T12:18:50.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:18:50 smithi086 bash[24289]: cluster 2024-09-16T12:18:49.027937+0000 mgr.a (mgr.14373) 17366 : cluster [DBG] pgmap v12046: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 15 KiB/s rd, 0 B/s wr, 24 op/s 2024-09-16T12:18:50.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:18:50 smithi047 bash[22744]: cluster 2024-09-16T12:18:49.027937+0000 mgr.a (mgr.14373) 17366 : cluster [DBG] pgmap v12046: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 15 KiB/s rd, 0 B/s wr, 24 op/s 2024-09-16T12:18:51.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:18:51 smithi157 bash[24585]: audit 2024-09-16T12:18:50.255107+0000 mgr.a (mgr.14373) 17367 : audit [DBG] from='client.373365 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:18:51.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:18:51 smithi086 bash[24289]: audit 2024-09-16T12:18:50.255107+0000 mgr.a (mgr.14373) 17367 : audit [DBG] from='client.373365 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:18:51.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:18:51 smithi047 bash[22744]: audit 2024-09-16T12:18:50.255107+0000 mgr.a (mgr.14373) 17367 : audit [DBG] from='client.373365 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:18:52.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:18:52 smithi157 bash[24585]: cluster 2024-09-16T12:18:51.028814+0000 mgr.a (mgr.14373) 17368 : cluster [DBG] pgmap v12047: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 15 KiB/s rd, 0 B/s wr, 24 op/s 2024-09-16T12:18:52.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:18:52 smithi086 bash[24289]: cluster 2024-09-16T12:18:51.028814+0000 mgr.a (mgr.14373) 17368 : cluster [DBG] pgmap v12047: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 15 KiB/s rd, 0 B/s wr, 24 op/s 2024-09-16T12:18:52.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:18:52 smithi047 bash[22744]: cluster 2024-09-16T12:18:51.028814+0000 mgr.a (mgr.14373) 17368 : cluster [DBG] pgmap v12047: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 15 KiB/s rd, 0 B/s wr, 24 op/s 2024-09-16T12:18:54.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:18:54 smithi157 bash[24585]: cluster 2024-09-16T12:18:53.031092+0000 mgr.a (mgr.14373) 17369 : cluster [DBG] pgmap v12048: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 16 KiB/s rd, 0 B/s wr, 25 op/s 2024-09-16T12:18:54.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:18:54 smithi086 bash[24289]: cluster 2024-09-16T12:18:53.031092+0000 mgr.a (mgr.14373) 17369 : cluster [DBG] pgmap v12048: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 16 KiB/s rd, 0 B/s wr, 25 op/s 2024-09-16T12:18:54.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:18:54 smithi047 bash[22744]: cluster 2024-09-16T12:18:53.031092+0000 mgr.a (mgr.14373) 17369 : cluster [DBG] pgmap v12048: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 16 KiB/s rd, 0 B/s wr, 25 op/s 2024-09-16T12:18:55.700 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:18:55.700 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:18:55.700 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:18:56.445 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:18:56.445 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:18:56.445 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:18:56.445 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:18:56.445 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:18:56.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:18:56 smithi157 bash[24585]: cluster 2024-09-16T12:18:55.031877+0000 mgr.a (mgr.14373) 17370 : cluster [DBG] pgmap v12049: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:18:56.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:18:56 smithi086 bash[24289]: cluster 2024-09-16T12:18:55.031877+0000 mgr.a (mgr.14373) 17370 : cluster [DBG] pgmap v12049: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:18:56.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:18:56 smithi047 bash[22744]: cluster 2024-09-16T12:18:55.031877+0000 mgr.a (mgr.14373) 17370 : cluster [DBG] pgmap v12049: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:18:57.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:18:57 smithi157 bash[24585]: audit 2024-09-16T12:18:56.022460+0000 mgr.a (mgr.14373) 17371 : audit [DBG] from='client.373443 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:18:57.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:18:57 smithi086 bash[24289]: audit 2024-09-16T12:18:56.022460+0000 mgr.a (mgr.14373) 17371 : audit [DBG] from='client.373443 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:18:57.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:18:57 smithi047 bash[22744]: audit 2024-09-16T12:18:56.022460+0000 mgr.a (mgr.14373) 17371 : audit [DBG] from='client.373443 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:18:58.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:18:58 smithi157 bash[24585]: cluster 2024-09-16T12:18:57.034391+0000 mgr.a (mgr.14373) 17372 : cluster [DBG] pgmap v12050: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:18:58.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:18:58 smithi157 bash[24585]: audit 2024-09-16T12:18:58.381384+0000 mon.b (mon.2) 1574 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T12:18:58.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:18:58 smithi086 bash[24289]: cluster 2024-09-16T12:18:57.034391+0000 mgr.a (mgr.14373) 17372 : cluster [DBG] pgmap v12050: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:18:58.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:18:58 smithi086 bash[24289]: audit 2024-09-16T12:18:58.381384+0000 mon.b (mon.2) 1574 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T12:18:58.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:18:58 smithi047 bash[22744]: cluster 2024-09-16T12:18:57.034391+0000 mgr.a (mgr.14373) 17372 : cluster [DBG] pgmap v12050: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:18:58.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:18:58 smithi047 bash[22744]: audit 2024-09-16T12:18:58.381384+0000 mon.b (mon.2) 1574 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T12:19:00.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:19:00 smithi157 bash[24585]: cluster 2024-09-16T12:18:59.035135+0000 mgr.a (mgr.14373) 17373 : cluster [DBG] pgmap v12051: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:19:00.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:19:00 smithi086 bash[24289]: cluster 2024-09-16T12:18:59.035135+0000 mgr.a (mgr.14373) 17373 : cluster [DBG] pgmap v12051: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:19:00.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:19:00 smithi047 bash[22744]: cluster 2024-09-16T12:18:59.035135+0000 mgr.a (mgr.14373) 17373 : cluster [DBG] pgmap v12051: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:19:01.447 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:19:01.447 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:19:01.447 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:19:02.193 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:19:02.194 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:19:02.194 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:19:02.194 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:19:02.194 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:19:02.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:19:02 smithi157 bash[24585]: cluster 2024-09-16T12:19:01.036043+0000 mgr.a (mgr.14373) 17374 : cluster [DBG] pgmap v12052: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:19:02.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:19:02 smithi157 bash[24585]: audit 2024-09-16T12:19:01.770888+0000 mgr.a (mgr.14373) 17375 : audit [DBG] from='client.373521 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:19:02.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:19:02 smithi086 bash[24289]: cluster 2024-09-16T12:19:01.036043+0000 mgr.a (mgr.14373) 17374 : cluster [DBG] pgmap v12052: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:19:02.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:19:02 smithi086 bash[24289]: audit 2024-09-16T12:19:01.770888+0000 mgr.a (mgr.14373) 17375 : audit [DBG] from='client.373521 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:19:02.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:19:02 smithi047 bash[22744]: cluster 2024-09-16T12:19:01.036043+0000 mgr.a (mgr.14373) 17374 : cluster [DBG] pgmap v12052: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:19:02.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:19:02 smithi047 bash[22744]: audit 2024-09-16T12:19:01.770888+0000 mgr.a (mgr.14373) 17375 : audit [DBG] from='client.373521 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:19:05.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:19:04 smithi157 bash[24585]: cluster 2024-09-16T12:19:03.038780+0000 mgr.a (mgr.14373) 17376 : cluster [DBG] pgmap v12053: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:19:05.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:19:04 smithi157 bash[24585]: audit 2024-09-16T12:19:03.721680+0000 mon.a (mon.0) 1605 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:19:05.058 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:19:04 smithi157 bash[24585]: audit 2024-09-16T12:19:03.726551+0000 mon.a (mon.0) 1606 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:19:05.058 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:19:04 smithi157 bash[24585]: audit 2024-09-16T12:19:03.732960+0000 mon.a (mon.0) 1607 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:19:05.058 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:19:04 smithi157 bash[24585]: audit 2024-09-16T12:19:03.738114+0000 mon.a (mon.0) 1608 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:19:05.058 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:19:04 smithi157 bash[24585]: audit 2024-09-16T12:19:03.750427+0000 mon.a (mon.0) 1609 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:19:05.058 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:19:04 smithi157 bash[24585]: audit 2024-09-16T12:19:03.756984+0000 mon.a (mon.0) 1610 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:19:05.058 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:19:04 smithi157 bash[24585]: audit 2024-09-16T12:19:04.492124+0000 mon.b (mon.2) 1575 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T12:19:05.058 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:19:04 smithi157 bash[24585]: audit 2024-09-16T12:19:04.494206+0000 mon.b (mon.2) 1576 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T12:19:05.058 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:19:04 smithi157 bash[24585]: audit 2024-09-16T12:19:04.505345+0000 mon.a (mon.0) 1611 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:19:05.058 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:19:04 smithi157 bash[24585]: audit 2024-09-16T12:19:04.510350+0000 mon.b (mon.2) 1577 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:19:05.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:19:04 smithi086 bash[24289]: cluster 2024-09-16T12:19:03.038780+0000 mgr.a (mgr.14373) 17376 : cluster [DBG] pgmap v12053: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:19:05.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:19:04 smithi086 bash[24289]: audit 2024-09-16T12:19:03.721680+0000 mon.a (mon.0) 1605 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:19:05.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:19:04 smithi086 bash[24289]: audit 2024-09-16T12:19:03.726551+0000 mon.a (mon.0) 1606 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:19:05.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:19:04 smithi086 bash[24289]: audit 2024-09-16T12:19:03.732960+0000 mon.a (mon.0) 1607 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:19:05.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:19:04 smithi086 bash[24289]: audit 2024-09-16T12:19:03.738114+0000 mon.a (mon.0) 1608 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:19:05.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:19:04 smithi086 bash[24289]: audit 2024-09-16T12:19:03.750427+0000 mon.a (mon.0) 1609 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:19:05.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:19:04 smithi086 bash[24289]: audit 2024-09-16T12:19:03.756984+0000 mon.a (mon.0) 1610 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:19:05.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:19:04 smithi086 bash[24289]: audit 2024-09-16T12:19:04.492124+0000 mon.b (mon.2) 1575 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T12:19:05.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:19:04 smithi086 bash[24289]: audit 2024-09-16T12:19:04.494206+0000 mon.b (mon.2) 1576 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T12:19:05.072 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:19:04 smithi086 bash[24289]: audit 2024-09-16T12:19:04.505345+0000 mon.a (mon.0) 1611 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:19:05.072 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:19:04 smithi086 bash[24289]: audit 2024-09-16T12:19:04.510350+0000 mon.b (mon.2) 1577 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:19:05.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:19:04 smithi047 bash[22744]: cluster 2024-09-16T12:19:03.038780+0000 mgr.a (mgr.14373) 17376 : cluster [DBG] pgmap v12053: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:19:05.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:19:04 smithi047 bash[22744]: audit 2024-09-16T12:19:03.721680+0000 mon.a (mon.0) 1605 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:19:05.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:19:04 smithi047 bash[22744]: audit 2024-09-16T12:19:03.726551+0000 mon.a (mon.0) 1606 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:19:05.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:19:04 smithi047 bash[22744]: audit 2024-09-16T12:19:03.732960+0000 mon.a (mon.0) 1607 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:19:05.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:19:04 smithi047 bash[22744]: audit 2024-09-16T12:19:03.738114+0000 mon.a (mon.0) 1608 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:19:05.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:19:04 smithi047 bash[22744]: audit 2024-09-16T12:19:03.750427+0000 mon.a (mon.0) 1609 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:19:05.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:19:04 smithi047 bash[22744]: audit 2024-09-16T12:19:03.756984+0000 mon.a (mon.0) 1610 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:19:05.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:19:04 smithi047 bash[22744]: audit 2024-09-16T12:19:04.492124+0000 mon.b (mon.2) 1575 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T12:19:05.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:19:04 smithi047 bash[22744]: audit 2024-09-16T12:19:04.494206+0000 mon.b (mon.2) 1576 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T12:19:05.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:19:04 smithi047 bash[22744]: audit 2024-09-16T12:19:04.505345+0000 mon.a (mon.0) 1611 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:19:05.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:19:04 smithi047 bash[22744]: audit 2024-09-16T12:19:04.510350+0000 mon.b (mon.2) 1577 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:19:05.593 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 12:19:05 smithi047 bash[22994]: debug 2024-09-16T12:19:05.272+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T12:19:05.593 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 12:19:05 smithi047 bash[22994]: debug 2024-09-16T12:19:05.272+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T12:19:06.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:19:05 smithi157 bash[24585]: audit 2024-09-16T12:19:04.511522+0000 mgr.a (mgr.14373) 17377 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:19:06.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:19:05 smithi086 bash[24289]: audit 2024-09-16T12:19:04.511522+0000 mgr.a (mgr.14373) 17377 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:19:06.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:19:05 smithi047 bash[22744]: audit 2024-09-16T12:19:04.511522+0000 mgr.a (mgr.14373) 17377 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:19:07.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:19:06 smithi157 bash[24585]: cluster 2024-09-16T12:19:05.042961+0000 mgr.a (mgr.14373) 17378 : cluster [DBG] pgmap v12054: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:19:07.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:19:06 smithi157 bash[24585]: audit 2024-09-16T12:19:05.275559+0000 mgr.a (mgr.14373) 17379 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T12:19:07.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:19:06 smithi157 bash[24585]: cephadm 2024-09-16T12:19:05.277960+0000 mgr.a (mgr.14373) 17380 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T12:19:07.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:19:06 smithi086 bash[24289]: cluster 2024-09-16T12:19:05.042961+0000 mgr.a (mgr.14373) 17378 : cluster [DBG] pgmap v12054: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:19:07.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:19:06 smithi086 bash[24289]: audit 2024-09-16T12:19:05.275559+0000 mgr.a (mgr.14373) 17379 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T12:19:07.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:19:06 smithi086 bash[24289]: cephadm 2024-09-16T12:19:05.277960+0000 mgr.a (mgr.14373) 17380 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T12:19:07.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:19:06 smithi047 bash[22744]: cluster 2024-09-16T12:19:05.042961+0000 mgr.a (mgr.14373) 17378 : cluster [DBG] pgmap v12054: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:19:07.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:19:06 smithi047 bash[22744]: audit 2024-09-16T12:19:05.275559+0000 mgr.a (mgr.14373) 17379 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T12:19:07.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:19:06 smithi047 bash[22744]: cephadm 2024-09-16T12:19:05.277960+0000 mgr.a (mgr.14373) 17380 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T12:19:07.195 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:19:07.196 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:19:07.196 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:19:07.967 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:19:07.967 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:19:07.967 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:19:07.968 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:19:07.968 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:19:09.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:19:08 smithi157 bash[24585]: cluster 2024-09-16T12:19:07.045455+0000 mgr.a (mgr.14373) 17381 : cluster [DBG] pgmap v12055: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:19:09.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:19:08 smithi157 bash[24585]: audit 2024-09-16T12:19:07.520073+0000 mgr.a (mgr.14373) 17382 : audit [DBG] from='client.373701 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:19:09.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:19:08 smithi086 bash[24289]: cluster 2024-09-16T12:19:07.045455+0000 mgr.a (mgr.14373) 17381 : cluster [DBG] pgmap v12055: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:19:09.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:19:08 smithi086 bash[24289]: audit 2024-09-16T12:19:07.520073+0000 mgr.a (mgr.14373) 17382 : audit [DBG] from='client.373701 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:19:09.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:19:08 smithi047 bash[22744]: cluster 2024-09-16T12:19:07.045455+0000 mgr.a (mgr.14373) 17381 : cluster [DBG] pgmap v12055: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:19:09.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:19:08 smithi047 bash[22744]: audit 2024-09-16T12:19:07.520073+0000 mgr.a (mgr.14373) 17382 : audit [DBG] from='client.373701 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:19:11.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:19:10 smithi157 bash[24585]: cluster 2024-09-16T12:19:09.046394+0000 mgr.a (mgr.14373) 17383 : cluster [DBG] pgmap v12056: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T12:19:11.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:19:10 smithi086 bash[24289]: cluster 2024-09-16T12:19:09.046394+0000 mgr.a (mgr.14373) 17383 : cluster [DBG] pgmap v12056: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T12:19:11.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:19:10 smithi047 bash[22744]: cluster 2024-09-16T12:19:09.046394+0000 mgr.a (mgr.14373) 17383 : cluster [DBG] pgmap v12056: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T12:19:12.969 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:19:12.969 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:19:12.970 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:19:13.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:19:12 smithi157 bash[24585]: cluster 2024-09-16T12:19:11.047111+0000 mgr.a (mgr.14373) 17384 : cluster [DBG] pgmap v12057: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T12:19:13.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:19:12 smithi086 bash[24289]: cluster 2024-09-16T12:19:11.047111+0000 mgr.a (mgr.14373) 17384 : cluster [DBG] pgmap v12057: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T12:19:13.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:19:12 smithi047 bash[22744]: cluster 2024-09-16T12:19:11.047111+0000 mgr.a (mgr.14373) 17384 : cluster [DBG] pgmap v12057: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T12:19:13.733 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:19:13.734 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:19:13.734 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:19:13.734 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:19:13.734 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:19:15.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:19:14 smithi157 bash[24585]: cluster 2024-09-16T12:19:13.048541+0000 mgr.a (mgr.14373) 17385 : cluster [DBG] pgmap v12058: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:19:15.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:19:14 smithi157 bash[24585]: audit 2024-09-16T12:19:13.302111+0000 mgr.a (mgr.14373) 17386 : audit [DBG] from='client.373779 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:19:15.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:19:14 smithi086 bash[24289]: cluster 2024-09-16T12:19:13.048541+0000 mgr.a (mgr.14373) 17385 : cluster [DBG] pgmap v12058: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:19:15.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:19:14 smithi086 bash[24289]: audit 2024-09-16T12:19:13.302111+0000 mgr.a (mgr.14373) 17386 : audit [DBG] from='client.373779 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:19:15.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:19:14 smithi047 bash[22744]: cluster 2024-09-16T12:19:13.048541+0000 mgr.a (mgr.14373) 17385 : cluster [DBG] pgmap v12058: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:19:15.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:19:14 smithi047 bash[22744]: audit 2024-09-16T12:19:13.302111+0000 mgr.a (mgr.14373) 17386 : audit [DBG] from='client.373779 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:19:17.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:19:16 smithi157 bash[24585]: cluster 2024-09-16T12:19:15.049590+0000 mgr.a (mgr.14373) 17387 : cluster [DBG] pgmap v12059: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:19:17.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:19:16 smithi086 bash[24289]: cluster 2024-09-16T12:19:15.049590+0000 mgr.a (mgr.14373) 17387 : cluster [DBG] pgmap v12059: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:19:17.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:19:16 smithi047 bash[22744]: cluster 2024-09-16T12:19:15.049590+0000 mgr.a (mgr.14373) 17387 : cluster [DBG] pgmap v12059: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:19:18.736 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:19:18.737 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:19:18.737 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:19:19.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:19:18 smithi157 bash[24585]: cluster 2024-09-16T12:19:17.051895+0000 mgr.a (mgr.14373) 17388 : cluster [DBG] pgmap v12060: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:19:19.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:19:18 smithi086 bash[24289]: cluster 2024-09-16T12:19:17.051895+0000 mgr.a (mgr.14373) 17388 : cluster [DBG] pgmap v12060: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:19:19.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:19:18 smithi047 bash[22744]: cluster 2024-09-16T12:19:17.051895+0000 mgr.a (mgr.14373) 17388 : cluster [DBG] pgmap v12060: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:19:19.511 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:19:19.511 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:19:19.511 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:19:19.511 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:19:19.511 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:19:21.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:19:20 smithi157 bash[24585]: cluster 2024-09-16T12:19:19.052678+0000 mgr.a (mgr.14373) 17389 : cluster [DBG] pgmap v12061: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:19:21.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:19:20 smithi157 bash[24585]: audit 2024-09-16T12:19:19.069541+0000 mgr.a (mgr.14373) 17390 : audit [DBG] from='client.373854 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:19:21.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:19:20 smithi086 bash[24289]: cluster 2024-09-16T12:19:19.052678+0000 mgr.a (mgr.14373) 17389 : cluster [DBG] pgmap v12061: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:19:21.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:19:20 smithi086 bash[24289]: audit 2024-09-16T12:19:19.069541+0000 mgr.a (mgr.14373) 17390 : audit [DBG] from='client.373854 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:19:21.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:19:20 smithi047 bash[22744]: cluster 2024-09-16T12:19:19.052678+0000 mgr.a (mgr.14373) 17389 : cluster [DBG] pgmap v12061: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:19:21.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:19:20 smithi047 bash[22744]: audit 2024-09-16T12:19:19.069541+0000 mgr.a (mgr.14373) 17390 : audit [DBG] from='client.373854 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:19:23.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:19:22 smithi157 bash[24585]: cluster 2024-09-16T12:19:21.053654+0000 mgr.a (mgr.14373) 17391 : cluster [DBG] pgmap v12062: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:19:23.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:19:22 smithi086 bash[24289]: cluster 2024-09-16T12:19:21.053654+0000 mgr.a (mgr.14373) 17391 : cluster [DBG] pgmap v12062: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:19:23.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:19:22 smithi047 bash[22744]: cluster 2024-09-16T12:19:21.053654+0000 mgr.a (mgr.14373) 17391 : cluster [DBG] pgmap v12062: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:19:24.512 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:19:24.513 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:19:24.513 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:19:25.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:19:24 smithi157 bash[24585]: cluster 2024-09-16T12:19:23.055919+0000 mgr.a (mgr.14373) 17392 : cluster [DBG] pgmap v12063: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:19:25.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:19:24 smithi086 bash[24289]: cluster 2024-09-16T12:19:23.055919+0000 mgr.a (mgr.14373) 17392 : cluster [DBG] pgmap v12063: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:19:25.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:19:24 smithi047 bash[22744]: cluster 2024-09-16T12:19:23.055919+0000 mgr.a (mgr.14373) 17392 : cluster [DBG] pgmap v12063: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:19:25.273 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:19:25.273 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:19:25.273 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:19:25.273 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:19:25.273 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:19:26.060 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:19:25 smithi157 bash[24585]: audit 2024-09-16T12:19:24.846433+0000 mgr.a (mgr.14373) 17393 : audit [DBG] from='client.373932 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:19:26.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:19:25 smithi086 bash[24289]: audit 2024-09-16T12:19:24.846433+0000 mgr.a (mgr.14373) 17393 : audit [DBG] from='client.373932 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:19:26.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:19:25 smithi047 bash[22744]: audit 2024-09-16T12:19:24.846433+0000 mgr.a (mgr.14373) 17393 : audit [DBG] from='client.373932 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:19:27.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:19:26 smithi157 bash[24585]: cluster 2024-09-16T12:19:25.056413+0000 mgr.a (mgr.14373) 17394 : cluster [DBG] pgmap v12064: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:19:27.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:19:26 smithi086 bash[24289]: cluster 2024-09-16T12:19:25.056413+0000 mgr.a (mgr.14373) 17394 : cluster [DBG] pgmap v12064: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:19:27.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:19:26 smithi047 bash[22744]: cluster 2024-09-16T12:19:25.056413+0000 mgr.a (mgr.14373) 17394 : cluster [DBG] pgmap v12064: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:19:29.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:19:28 smithi157 bash[24585]: cluster 2024-09-16T12:19:27.058728+0000 mgr.a (mgr.14373) 17395 : cluster [DBG] pgmap v12065: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:19:29.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:19:28 smithi086 bash[24289]: cluster 2024-09-16T12:19:27.058728+0000 mgr.a (mgr.14373) 17395 : cluster [DBG] pgmap v12065: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:19:29.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:19:28 smithi047 bash[22744]: cluster 2024-09-16T12:19:27.058728+0000 mgr.a (mgr.14373) 17395 : cluster [DBG] pgmap v12065: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:19:30.275 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:19:30.275 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:19:30.276 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:19:31.029 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:19:31.029 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:19:31.029 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:19:31.029 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:19:31.030 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:19:31.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:19:30 smithi157 bash[24585]: cluster 2024-09-16T12:19:29.059597+0000 mgr.a (mgr.14373) 17396 : cluster [DBG] pgmap v12066: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:19:31.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:19:30 smithi086 bash[24289]: cluster 2024-09-16T12:19:29.059597+0000 mgr.a (mgr.14373) 17396 : cluster [DBG] pgmap v12066: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:19:31.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:19:30 smithi047 bash[22744]: cluster 2024-09-16T12:19:29.059597+0000 mgr.a (mgr.14373) 17396 : cluster [DBG] pgmap v12066: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:19:32.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:19:31 smithi157 bash[24585]: audit 2024-09-16T12:19:30.604880+0000 mgr.a (mgr.14373) 17397 : audit [DBG] from='client.374010 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:19:32.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:19:31 smithi086 bash[24289]: audit 2024-09-16T12:19:30.604880+0000 mgr.a (mgr.14373) 17397 : audit [DBG] from='client.374010 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:19:32.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:19:31 smithi047 bash[22744]: audit 2024-09-16T12:19:30.604880+0000 mgr.a (mgr.14373) 17397 : audit [DBG] from='client.374010 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:19:33.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:19:32 smithi157 bash[24585]: cluster 2024-09-16T12:19:31.060146+0000 mgr.a (mgr.14373) 17398 : cluster [DBG] pgmap v12067: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:19:33.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:19:32 smithi086 bash[24289]: cluster 2024-09-16T12:19:31.060146+0000 mgr.a (mgr.14373) 17398 : cluster [DBG] pgmap v12067: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:19:33.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:19:32 smithi047 bash[22744]: cluster 2024-09-16T12:19:31.060146+0000 mgr.a (mgr.14373) 17398 : cluster [DBG] pgmap v12067: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:19:35.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:19:34 smithi086 bash[24289]: cluster 2024-09-16T12:19:33.062380+0000 mgr.a (mgr.14373) 17399 : cluster [DBG] pgmap v12068: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:19:35.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:19:34 smithi047 bash[22744]: cluster 2024-09-16T12:19:33.062380+0000 mgr.a (mgr.14373) 17399 : cluster [DBG] pgmap v12068: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:19:35.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:19:34 smithi157 bash[24585]: cluster 2024-09-16T12:19:33.062380+0000 mgr.a (mgr.14373) 17399 : cluster [DBG] pgmap v12068: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:19:36.031 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:19:36.031 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:19:36.031 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:19:36.797 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:19:36.797 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:19:36.797 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:19:36.797 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:19:36.797 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:19:37.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:19:36 smithi086 bash[24289]: cluster 2024-09-16T12:19:35.063103+0000 mgr.a (mgr.14373) 17400 : cluster [DBG] pgmap v12069: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:19:37.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:19:36 smithi047 bash[22744]: cluster 2024-09-16T12:19:35.063103+0000 mgr.a (mgr.14373) 17400 : cluster [DBG] pgmap v12069: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:19:37.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:19:36 smithi157 bash[24585]: cluster 2024-09-16T12:19:35.063103+0000 mgr.a (mgr.14373) 17400 : cluster [DBG] pgmap v12069: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:19:38.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:19:37 smithi047 bash[22744]: audit 2024-09-16T12:19:36.361655+0000 mgr.a (mgr.14373) 17401 : audit [DBG] from='client.374085 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:19:38.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:19:37 smithi157 bash[24585]: audit 2024-09-16T12:19:36.361655+0000 mgr.a (mgr.14373) 17401 : audit [DBG] from='client.374085 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:19:38.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:19:37 smithi086 bash[24289]: audit 2024-09-16T12:19:36.361655+0000 mgr.a (mgr.14373) 17401 : audit [DBG] from='client.374085 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:19:39.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:19:38 smithi047 bash[22744]: cluster 2024-09-16T12:19:37.065897+0000 mgr.a (mgr.14373) 17402 : cluster [DBG] pgmap v12070: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:19:39.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:19:38 smithi157 bash[24585]: cluster 2024-09-16T12:19:37.065897+0000 mgr.a (mgr.14373) 17402 : cluster [DBG] pgmap v12070: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:19:39.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:19:38 smithi086 bash[24289]: cluster 2024-09-16T12:19:37.065897+0000 mgr.a (mgr.14373) 17402 : cluster [DBG] pgmap v12070: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:19:41.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:19:40 smithi047 bash[22744]: cluster 2024-09-16T12:19:39.066684+0000 mgr.a (mgr.14373) 17403 : cluster [DBG] pgmap v12071: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:19:41.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:19:40 smithi157 bash[24585]: cluster 2024-09-16T12:19:39.066684+0000 mgr.a (mgr.14373) 17403 : cluster [DBG] pgmap v12071: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:19:41.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:19:40 smithi086 bash[24289]: cluster 2024-09-16T12:19:39.066684+0000 mgr.a (mgr.14373) 17403 : cluster [DBG] pgmap v12071: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:19:41.798 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:19:41.799 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:19:41.799 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:19:42.594 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:19:42.595 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:19:42.595 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:19:42.595 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:19:42.595 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:19:43.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:19:42 smithi047 bash[22744]: cluster 2024-09-16T12:19:41.067440+0000 mgr.a (mgr.14373) 17404 : cluster [DBG] pgmap v12072: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T12:19:43.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:19:42 smithi157 bash[24585]: cluster 2024-09-16T12:19:41.067440+0000 mgr.a (mgr.14373) 17404 : cluster [DBG] pgmap v12072: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T12:19:43.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:19:42 smithi086 bash[24289]: cluster 2024-09-16T12:19:41.067440+0000 mgr.a (mgr.14373) 17404 : cluster [DBG] pgmap v12072: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T12:19:44.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:19:43 smithi047 bash[22744]: audit 2024-09-16T12:19:42.132120+0000 mgr.a (mgr.14373) 17405 : audit [DBG] from='client.374163 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:19:44.308 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:19:43 smithi157 bash[24585]: audit 2024-09-16T12:19:42.132120+0000 mgr.a (mgr.14373) 17405 : audit [DBG] from='client.374163 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:19:44.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:19:43 smithi086 bash[24289]: audit 2024-09-16T12:19:42.132120+0000 mgr.a (mgr.14373) 17405 : audit [DBG] from='client.374163 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:19:45.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:19:44 smithi047 bash[22744]: cluster 2024-09-16T12:19:43.070269+0000 mgr.a (mgr.14373) 17406 : cluster [DBG] pgmap v12073: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:19:45.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:19:44 smithi157 bash[24585]: cluster 2024-09-16T12:19:43.070269+0000 mgr.a (mgr.14373) 17406 : cluster [DBG] pgmap v12073: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:19:45.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:19:44 smithi086 bash[24289]: cluster 2024-09-16T12:19:43.070269+0000 mgr.a (mgr.14373) 17406 : cluster [DBG] pgmap v12073: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:19:47.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:19:46 smithi157 bash[24585]: cluster 2024-09-16T12:19:45.071108+0000 mgr.a (mgr.14373) 17407 : cluster [DBG] pgmap v12074: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:19:47.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:19:46 smithi086 bash[24289]: cluster 2024-09-16T12:19:45.071108+0000 mgr.a (mgr.14373) 17407 : cluster [DBG] pgmap v12074: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:19:47.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:19:46 smithi047 bash[22744]: cluster 2024-09-16T12:19:45.071108+0000 mgr.a (mgr.14373) 17407 : cluster [DBG] pgmap v12074: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:19:47.596 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:19:47.597 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:19:47.597 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:19:48.351 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:19:48.351 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:19:48.351 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:19:48.351 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:19:48.352 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:19:49.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:19:48 smithi157 bash[24585]: cluster 2024-09-16T12:19:47.073133+0000 mgr.a (mgr.14373) 17408 : cluster [DBG] pgmap v12075: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:19:49.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:19:48 smithi157 bash[24585]: audit 2024-09-16T12:19:47.924470+0000 mgr.a (mgr.14373) 17409 : audit [DBG] from='client.374241 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:19:49.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:19:48 smithi086 bash[24289]: cluster 2024-09-16T12:19:47.073133+0000 mgr.a (mgr.14373) 17408 : cluster [DBG] pgmap v12075: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:19:49.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:19:48 smithi086 bash[24289]: audit 2024-09-16T12:19:47.924470+0000 mgr.a (mgr.14373) 17409 : audit [DBG] from='client.374241 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:19:49.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:19:48 smithi047 bash[22744]: cluster 2024-09-16T12:19:47.073133+0000 mgr.a (mgr.14373) 17408 : cluster [DBG] pgmap v12075: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:19:49.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:19:48 smithi047 bash[22744]: audit 2024-09-16T12:19:47.924470+0000 mgr.a (mgr.14373) 17409 : audit [DBG] from='client.374241 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:19:51.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:19:50 smithi157 bash[24585]: cluster 2024-09-16T12:19:49.074101+0000 mgr.a (mgr.14373) 17410 : cluster [DBG] pgmap v12076: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:19:51.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:19:50 smithi086 bash[24289]: cluster 2024-09-16T12:19:49.074101+0000 mgr.a (mgr.14373) 17410 : cluster [DBG] pgmap v12076: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:19:51.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:19:50 smithi047 bash[22744]: cluster 2024-09-16T12:19:49.074101+0000 mgr.a (mgr.14373) 17410 : cluster [DBG] pgmap v12076: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:19:53.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:19:52 smithi157 bash[24585]: cluster 2024-09-16T12:19:51.074898+0000 mgr.a (mgr.14373) 17411 : cluster [DBG] pgmap v12077: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:19:53.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:19:52 smithi086 bash[24289]: cluster 2024-09-16T12:19:51.074898+0000 mgr.a (mgr.14373) 17411 : cluster [DBG] pgmap v12077: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:19:53.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:19:52 smithi047 bash[22744]: cluster 2024-09-16T12:19:51.074898+0000 mgr.a (mgr.14373) 17411 : cluster [DBG] pgmap v12077: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:19:53.352 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:19:53.353 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:19:53.354 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:19:54.140 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:19:54.140 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:19:54.140 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:19:54.140 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:19:54.141 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:19:55.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:19:54 smithi157 bash[24585]: cluster 2024-09-16T12:19:53.077141+0000 mgr.a (mgr.14373) 17412 : cluster [DBG] pgmap v12078: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:19:55.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:19:54 smithi157 bash[24585]: audit 2024-09-16T12:19:53.691620+0000 mgr.a (mgr.14373) 17413 : audit [DBG] from='client.374313 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:19:55.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:19:54 smithi086 bash[24289]: cluster 2024-09-16T12:19:53.077141+0000 mgr.a (mgr.14373) 17412 : cluster [DBG] pgmap v12078: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:19:55.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:19:54 smithi086 bash[24289]: audit 2024-09-16T12:19:53.691620+0000 mgr.a (mgr.14373) 17413 : audit [DBG] from='client.374313 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:19:55.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:19:54 smithi047 bash[22744]: cluster 2024-09-16T12:19:53.077141+0000 mgr.a (mgr.14373) 17412 : cluster [DBG] pgmap v12078: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:19:55.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:19:54 smithi047 bash[22744]: audit 2024-09-16T12:19:53.691620+0000 mgr.a (mgr.14373) 17413 : audit [DBG] from='client.374313 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:19:57.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:19:56 smithi157 bash[24585]: cluster 2024-09-16T12:19:55.078096+0000 mgr.a (mgr.14373) 17414 : cluster [DBG] pgmap v12079: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:19:57.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:19:56 smithi086 bash[24289]: cluster 2024-09-16T12:19:55.078096+0000 mgr.a (mgr.14373) 17414 : cluster [DBG] pgmap v12079: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:19:57.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:19:56 smithi047 bash[22744]: cluster 2024-09-16T12:19:55.078096+0000 mgr.a (mgr.14373) 17414 : cluster [DBG] pgmap v12079: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:19:59.142 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:19:59.142 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:19:59.143 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:19:59.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:19:58 smithi157 bash[24585]: cluster 2024-09-16T12:19:57.080315+0000 mgr.a (mgr.14373) 17415 : cluster [DBG] pgmap v12080: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:19:59.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:19:58 smithi086 bash[24289]: cluster 2024-09-16T12:19:57.080315+0000 mgr.a (mgr.14373) 17415 : cluster [DBG] pgmap v12080: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:19:59.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:19:58 smithi047 bash[22744]: cluster 2024-09-16T12:19:57.080315+0000 mgr.a (mgr.14373) 17415 : cluster [DBG] pgmap v12080: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:19:59.887 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:19:59.887 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:19:59.887 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:19:59.887 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:19:59.888 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:20:01.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:20:00 smithi157 bash[24585]: cluster 2024-09-16T12:19:59.081066+0000 mgr.a (mgr.14373) 17416 : cluster [DBG] pgmap v12081: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:20:01.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:20:00 smithi157 bash[24585]: audit 2024-09-16T12:19:59.467253+0000 mgr.a (mgr.14373) 17417 : audit [DBG] from='client.374388 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:20:01.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:20:00 smithi157 bash[24585]: cluster 2024-09-16T12:20:00.000146+0000 mon.a (mon.0) 1612 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-16T12:20:01.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:20:00 smithi086 bash[24289]: cluster 2024-09-16T12:19:59.081066+0000 mgr.a (mgr.14373) 17416 : cluster [DBG] pgmap v12081: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:20:01.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:20:00 smithi086 bash[24289]: audit 2024-09-16T12:19:59.467253+0000 mgr.a (mgr.14373) 17417 : audit [DBG] from='client.374388 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:20:01.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:20:00 smithi086 bash[24289]: cluster 2024-09-16T12:20:00.000146+0000 mon.a (mon.0) 1612 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-16T12:20:01.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:20:00 smithi047 bash[22744]: cluster 2024-09-16T12:19:59.081066+0000 mgr.a (mgr.14373) 17416 : cluster [DBG] pgmap v12081: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:20:01.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:20:00 smithi047 bash[22744]: audit 2024-09-16T12:19:59.467253+0000 mgr.a (mgr.14373) 17417 : audit [DBG] from='client.374388 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:20:01.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:20:00 smithi047 bash[22744]: cluster 2024-09-16T12:20:00.000146+0000 mon.a (mon.0) 1612 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-16T12:20:03.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:20:02 smithi157 bash[24585]: cluster 2024-09-16T12:20:01.082043+0000 mgr.a (mgr.14373) 17418 : cluster [DBG] pgmap v12082: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:20:03.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:20:02 smithi086 bash[24289]: cluster 2024-09-16T12:20:01.082043+0000 mgr.a (mgr.14373) 17418 : cluster [DBG] pgmap v12082: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:20:03.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:20:02 smithi047 bash[22744]: cluster 2024-09-16T12:20:01.082043+0000 mgr.a (mgr.14373) 17418 : cluster [DBG] pgmap v12082: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:20:04.889 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:20:04.889 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:20:04.890 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:20:05.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:20:04 smithi157 bash[24585]: cluster 2024-09-16T12:20:03.084294+0000 mgr.a (mgr.14373) 17419 : cluster [DBG] pgmap v12083: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:20:05.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:20:04 smithi086 bash[24289]: cluster 2024-09-16T12:20:03.084294+0000 mgr.a (mgr.14373) 17419 : cluster [DBG] pgmap v12083: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:20:05.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:20:04 smithi047 bash[22744]: cluster 2024-09-16T12:20:03.084294+0000 mgr.a (mgr.14373) 17419 : cluster [DBG] pgmap v12083: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:20:05.666 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:20:05.666 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:20:05.666 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:20:05.666 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:20:05.666 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:20:06.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:20:05 smithi157 bash[24585]: audit 2024-09-16T12:20:05.330136+0000 mon.b (mon.2) 1578 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T12:20:06.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:20:05 smithi086 bash[24289]: audit 2024-09-16T12:20:05.330136+0000 mon.b (mon.2) 1578 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T12:20:06.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:20:05 smithi047 bash[22744]: audit 2024-09-16T12:20:05.330136+0000 mon.b (mon.2) 1578 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T12:20:07.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:20:06 smithi157 bash[24585]: cluster 2024-09-16T12:20:05.084816+0000 mgr.a (mgr.14373) 17420 : cluster [DBG] pgmap v12084: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:20:07.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:20:06 smithi157 bash[24585]: audit 2024-09-16T12:20:05.220119+0000 mgr.a (mgr.14373) 17421 : audit [DBG] from='client.374463 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:20:07.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:20:06 smithi157 bash[24585]: audit 2024-09-16T12:20:06.136288+0000 mon.b (mon.2) 1579 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T12:20:07.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:20:06 smithi157 bash[24585]: audit 2024-09-16T12:20:06.138461+0000 mon.b (mon.2) 1580 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T12:20:07.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:20:06 smithi157 bash[24585]: audit 2024-09-16T12:20:06.150534+0000 mon.a (mon.0) 1613 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:20:07.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:20:06 smithi157 bash[24585]: audit 2024-09-16T12:20:06.157676+0000 mon.b (mon.2) 1581 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:20:07.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:20:06 smithi086 bash[24289]: cluster 2024-09-16T12:20:05.084816+0000 mgr.a (mgr.14373) 17420 : cluster [DBG] pgmap v12084: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:20:07.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:20:06 smithi086 bash[24289]: audit 2024-09-16T12:20:05.220119+0000 mgr.a (mgr.14373) 17421 : audit [DBG] from='client.374463 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:20:07.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:20:06 smithi086 bash[24289]: audit 2024-09-16T12:20:06.136288+0000 mon.b (mon.2) 1579 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T12:20:07.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:20:06 smithi086 bash[24289]: audit 2024-09-16T12:20:06.138461+0000 mon.b (mon.2) 1580 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T12:20:07.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:20:06 smithi086 bash[24289]: audit 2024-09-16T12:20:06.150534+0000 mon.a (mon.0) 1613 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:20:07.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:20:06 smithi086 bash[24289]: audit 2024-09-16T12:20:06.157676+0000 mon.b (mon.2) 1581 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:20:07.343 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 12:20:06 smithi047 bash[22994]: debug 2024-09-16T12:20:06.915+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T12:20:07.343 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 12:20:06 smithi047 bash[22994]: debug 2024-09-16T12:20:06.915+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T12:20:07.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:20:06 smithi047 bash[22744]: cluster 2024-09-16T12:20:05.084816+0000 mgr.a (mgr.14373) 17420 : cluster [DBG] pgmap v12084: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:20:07.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:20:06 smithi047 bash[22744]: audit 2024-09-16T12:20:05.220119+0000 mgr.a (mgr.14373) 17421 : audit [DBG] from='client.374463 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:20:07.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:20:06 smithi047 bash[22744]: audit 2024-09-16T12:20:06.136288+0000 mon.b (mon.2) 1579 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T12:20:07.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:20:06 smithi047 bash[22744]: audit 2024-09-16T12:20:06.138461+0000 mon.b (mon.2) 1580 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T12:20:07.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:20:06 smithi047 bash[22744]: audit 2024-09-16T12:20:06.150534+0000 mon.a (mon.0) 1613 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:20:07.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:20:06 smithi047 bash[22744]: audit 2024-09-16T12:20:06.157676+0000 mon.b (mon.2) 1581 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:20:08.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:20:07 smithi157 bash[24585]: audit 2024-09-16T12:20:06.160276+0000 mgr.a (mgr.14373) 17422 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:20:08.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:20:07 smithi157 bash[24585]: audit 2024-09-16T12:20:06.919918+0000 mgr.a (mgr.14373) 17423 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T12:20:08.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:20:07 smithi157 bash[24585]: cephadm 2024-09-16T12:20:06.921942+0000 mgr.a (mgr.14373) 17424 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T12:20:08.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:20:07 smithi086 bash[24289]: audit 2024-09-16T12:20:06.160276+0000 mgr.a (mgr.14373) 17422 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:20:08.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:20:07 smithi086 bash[24289]: audit 2024-09-16T12:20:06.919918+0000 mgr.a (mgr.14373) 17423 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T12:20:08.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:20:07 smithi086 bash[24289]: cephadm 2024-09-16T12:20:06.921942+0000 mgr.a (mgr.14373) 17424 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T12:20:08.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:20:07 smithi047 bash[22744]: audit 2024-09-16T12:20:06.160276+0000 mgr.a (mgr.14373) 17422 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:20:08.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:20:07 smithi047 bash[22744]: audit 2024-09-16T12:20:06.919918+0000 mgr.a (mgr.14373) 17423 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T12:20:08.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:20:07 smithi047 bash[22744]: cephadm 2024-09-16T12:20:06.921942+0000 mgr.a (mgr.14373) 17424 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T12:20:09.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:20:08 smithi157 bash[24585]: cluster 2024-09-16T12:20:07.087581+0000 mgr.a (mgr.14373) 17425 : cluster [DBG] pgmap v12085: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 4.4 KiB/s rd, 255 B/s wr, 4 op/s 2024-09-16T12:20:09.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:20:08 smithi086 bash[24289]: cluster 2024-09-16T12:20:07.087581+0000 mgr.a (mgr.14373) 17425 : cluster [DBG] pgmap v12085: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 4.4 KiB/s rd, 255 B/s wr, 4 op/s 2024-09-16T12:20:09.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:20:08 smithi047 bash[22744]: cluster 2024-09-16T12:20:07.087581+0000 mgr.a (mgr.14373) 17425 : cluster [DBG] pgmap v12085: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 4.4 KiB/s rd, 255 B/s wr, 4 op/s 2024-09-16T12:20:10.667 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:20:10.668 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:20:10.668 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:20:11.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:20:10 smithi157 bash[24585]: cluster 2024-09-16T12:20:09.088381+0000 mgr.a (mgr.14373) 17426 : cluster [DBG] pgmap v12086: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 3.5 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-16T12:20:11.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:20:10 smithi086 bash[24289]: cluster 2024-09-16T12:20:09.088381+0000 mgr.a (mgr.14373) 17426 : cluster [DBG] pgmap v12086: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 3.5 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-16T12:20:11.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:20:10 smithi047 bash[22744]: cluster 2024-09-16T12:20:09.088381+0000 mgr.a (mgr.14373) 17426 : cluster [DBG] pgmap v12086: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 3.5 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-16T12:20:11.451 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:20:11.451 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:20:11.451 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:20:11.451 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:20:11.451 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:20:13.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:20:12 smithi157 bash[24585]: audit 2024-09-16T12:20:11.005850+0000 mgr.a (mgr.14373) 17427 : audit [DBG] from='client.374649 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:20:13.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:20:12 smithi157 bash[24585]: cluster 2024-09-16T12:20:11.089044+0000 mgr.a (mgr.14373) 17428 : cluster [DBG] pgmap v12087: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 3.5 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-16T12:20:13.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:20:12 smithi086 bash[24289]: audit 2024-09-16T12:20:11.005850+0000 mgr.a (mgr.14373) 17427 : audit [DBG] from='client.374649 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:20:13.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:20:12 smithi086 bash[24289]: cluster 2024-09-16T12:20:11.089044+0000 mgr.a (mgr.14373) 17428 : cluster [DBG] pgmap v12087: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 3.5 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-16T12:20:13.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:20:12 smithi047 bash[22744]: audit 2024-09-16T12:20:11.005850+0000 mgr.a (mgr.14373) 17427 : audit [DBG] from='client.374649 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:20:13.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:20:12 smithi047 bash[22744]: cluster 2024-09-16T12:20:11.089044+0000 mgr.a (mgr.14373) 17428 : cluster [DBG] pgmap v12087: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 3.5 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-16T12:20:15.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:20:14 smithi157 bash[24585]: cluster 2024-09-16T12:20:13.091407+0000 mgr.a (mgr.14373) 17429 : cluster [DBG] pgmap v12088: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:20:15.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:20:14 smithi086 bash[24289]: cluster 2024-09-16T12:20:13.091407+0000 mgr.a (mgr.14373) 17429 : cluster [DBG] pgmap v12088: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:20:15.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:20:14 smithi047 bash[22744]: cluster 2024-09-16T12:20:13.091407+0000 mgr.a (mgr.14373) 17429 : cluster [DBG] pgmap v12088: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:20:16.452 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:20:16.453 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:20:16.453 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:20:17.182 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:20:17.183 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:20:17.183 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:20:17.183 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:20:17.183 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:20:17.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:20:16 smithi157 bash[24585]: cluster 2024-09-16T12:20:15.092179+0000 mgr.a (mgr.14373) 17430 : cluster [DBG] pgmap v12089: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:20:17.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:20:16 smithi086 bash[24289]: cluster 2024-09-16T12:20:15.092179+0000 mgr.a (mgr.14373) 17430 : cluster [DBG] pgmap v12089: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:20:17.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:20:16 smithi047 bash[22744]: cluster 2024-09-16T12:20:15.092179+0000 mgr.a (mgr.14373) 17430 : cluster [DBG] pgmap v12089: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:20:18.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:20:17 smithi157 bash[24585]: audit 2024-09-16T12:20:16.773082+0000 mgr.a (mgr.14373) 17431 : audit [DBG] from='client.374724 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:20:18.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:20:17 smithi086 bash[24289]: audit 2024-09-16T12:20:16.773082+0000 mgr.a (mgr.14373) 17431 : audit [DBG] from='client.374724 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:20:18.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:20:17 smithi047 bash[22744]: audit 2024-09-16T12:20:16.773082+0000 mgr.a (mgr.14373) 17431 : audit [DBG] from='client.374724 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:20:19.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:20:18 smithi157 bash[24585]: cluster 2024-09-16T12:20:17.093529+0000 mgr.a (mgr.14373) 17432 : cluster [DBG] pgmap v12090: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:20:19.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:20:18 smithi086 bash[24289]: cluster 2024-09-16T12:20:17.093529+0000 mgr.a (mgr.14373) 17432 : cluster [DBG] pgmap v12090: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:20:19.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:20:18 smithi047 bash[22744]: cluster 2024-09-16T12:20:17.093529+0000 mgr.a (mgr.14373) 17432 : cluster [DBG] pgmap v12090: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:20:21.309 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:20:20 smithi157 bash[24585]: cluster 2024-09-16T12:20:19.094291+0000 mgr.a (mgr.14373) 17433 : cluster [DBG] pgmap v12091: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 4.4 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-16T12:20:21.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:20:20 smithi086 bash[24289]: cluster 2024-09-16T12:20:19.094291+0000 mgr.a (mgr.14373) 17433 : cluster [DBG] pgmap v12091: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 4.4 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-16T12:20:21.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:20:20 smithi047 bash[22744]: cluster 2024-09-16T12:20:19.094291+0000 mgr.a (mgr.14373) 17433 : cluster [DBG] pgmap v12091: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 4.4 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-16T12:20:22.184 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:20:22.185 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:20:22.185 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:20:22.967 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:20:22.967 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:20:22.967 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:20:22.967 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:20:22.967 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:20:23.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:20:22 smithi157 bash[24585]: cluster 2024-09-16T12:20:21.095056+0000 mgr.a (mgr.14373) 17434 : cluster [DBG] pgmap v12092: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 4.4 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-16T12:20:23.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:20:22 smithi086 bash[24289]: cluster 2024-09-16T12:20:21.095056+0000 mgr.a (mgr.14373) 17434 : cluster [DBG] pgmap v12092: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 4.4 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-16T12:20:23.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:20:22 smithi047 bash[22744]: cluster 2024-09-16T12:20:21.095056+0000 mgr.a (mgr.14373) 17434 : cluster [DBG] pgmap v12092: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 4.4 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-16T12:20:24.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:20:23 smithi157 bash[24585]: audit 2024-09-16T12:20:22.517614+0000 mgr.a (mgr.14373) 17435 : audit [DBG] from='client.374802 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:20:24.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:20:23 smithi086 bash[24289]: audit 2024-09-16T12:20:22.517614+0000 mgr.a (mgr.14373) 17435 : audit [DBG] from='client.374802 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:20:24.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:20:23 smithi047 bash[22744]: audit 2024-09-16T12:20:22.517614+0000 mgr.a (mgr.14373) 17435 : audit [DBG] from='client.374802 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:20:25.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:20:24 smithi157 bash[24585]: cluster 2024-09-16T12:20:23.097771+0000 mgr.a (mgr.14373) 17436 : cluster [DBG] pgmap v12093: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 5.3 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-16T12:20:25.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:20:24 smithi086 bash[24289]: cluster 2024-09-16T12:20:23.097771+0000 mgr.a (mgr.14373) 17436 : cluster [DBG] pgmap v12093: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 5.3 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-16T12:20:25.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:20:24 smithi047 bash[22744]: cluster 2024-09-16T12:20:23.097771+0000 mgr.a (mgr.14373) 17436 : cluster [DBG] pgmap v12093: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 5.3 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-16T12:20:27.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:20:26 smithi157 bash[24585]: cluster 2024-09-16T12:20:25.098563+0000 mgr.a (mgr.14373) 17437 : cluster [DBG] pgmap v12094: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:20:27.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:20:26 smithi086 bash[24289]: cluster 2024-09-16T12:20:25.098563+0000 mgr.a (mgr.14373) 17437 : cluster [DBG] pgmap v12094: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:20:27.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:20:26 smithi047 bash[22744]: cluster 2024-09-16T12:20:25.098563+0000 mgr.a (mgr.14373) 17437 : cluster [DBG] pgmap v12094: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:20:27.969 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:20:27.969 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:20:27.969 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:20:28.749 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:20:28.750 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:20:28.750 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:20:28.750 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:20:28.750 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:20:29.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:20:28 smithi157 bash[24585]: cluster 2024-09-16T12:20:27.100598+0000 mgr.a (mgr.14373) 17438 : cluster [DBG] pgmap v12095: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:20:29.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:20:28 smithi086 bash[24289]: cluster 2024-09-16T12:20:27.100598+0000 mgr.a (mgr.14373) 17438 : cluster [DBG] pgmap v12095: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:20:29.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:20:28 smithi047 bash[22744]: cluster 2024-09-16T12:20:27.100598+0000 mgr.a (mgr.14373) 17438 : cluster [DBG] pgmap v12095: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:20:30.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:20:29 smithi157 bash[24585]: audit 2024-09-16T12:20:28.300012+0000 mgr.a (mgr.14373) 17439 : audit [DBG] from='client.374877 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:20:30.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:20:29 smithi086 bash[24289]: audit 2024-09-16T12:20:28.300012+0000 mgr.a (mgr.14373) 17439 : audit [DBG] from='client.374877 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:20:30.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:20:29 smithi047 bash[22744]: audit 2024-09-16T12:20:28.300012+0000 mgr.a (mgr.14373) 17439 : audit [DBG] from='client.374877 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:20:31.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:20:30 smithi157 bash[24585]: cluster 2024-09-16T12:20:29.101594+0000 mgr.a (mgr.14373) 17440 : cluster [DBG] pgmap v12096: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:20:31.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:20:30 smithi086 bash[24289]: cluster 2024-09-16T12:20:29.101594+0000 mgr.a (mgr.14373) 17440 : cluster [DBG] pgmap v12096: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:20:31.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:20:30 smithi047 bash[22744]: cluster 2024-09-16T12:20:29.101594+0000 mgr.a (mgr.14373) 17440 : cluster [DBG] pgmap v12096: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:20:33.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:20:32 smithi157 bash[24585]: cluster 2024-09-16T12:20:31.102417+0000 mgr.a (mgr.14373) 17441 : cluster [DBG] pgmap v12097: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:20:33.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:20:32 smithi086 bash[24289]: cluster 2024-09-16T12:20:31.102417+0000 mgr.a (mgr.14373) 17441 : cluster [DBG] pgmap v12097: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:20:33.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:20:32 smithi047 bash[22744]: cluster 2024-09-16T12:20:31.102417+0000 mgr.a (mgr.14373) 17441 : cluster [DBG] pgmap v12097: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:20:33.751 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:20:33.751 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:20:33.751 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:20:34.527 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:20:34.527 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:20:34.527 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:20:34.527 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:20:34.527 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:20:35.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:20:34 smithi157 bash[24585]: cluster 2024-09-16T12:20:33.104629+0000 mgr.a (mgr.14373) 17442 : cluster [DBG] pgmap v12098: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:20:35.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:20:34 smithi086 bash[24289]: cluster 2024-09-16T12:20:33.104629+0000 mgr.a (mgr.14373) 17442 : cluster [DBG] pgmap v12098: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:20:35.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:20:34 smithi047 bash[22744]: cluster 2024-09-16T12:20:33.104629+0000 mgr.a (mgr.14373) 17442 : cluster [DBG] pgmap v12098: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:20:36.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:20:35 smithi157 bash[24585]: audit 2024-09-16T12:20:34.083848+0000 mgr.a (mgr.14373) 17443 : audit [DBG] from='client.374952 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:20:36.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:20:35 smithi086 bash[24289]: audit 2024-09-16T12:20:34.083848+0000 mgr.a (mgr.14373) 17443 : audit [DBG] from='client.374952 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:20:36.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:20:35 smithi047 bash[22744]: audit 2024-09-16T12:20:34.083848+0000 mgr.a (mgr.14373) 17443 : audit [DBG] from='client.374952 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:20:37.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:20:36 smithi157 bash[24585]: cluster 2024-09-16T12:20:35.105610+0000 mgr.a (mgr.14373) 17444 : cluster [DBG] pgmap v12099: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:20:37.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:20:36 smithi086 bash[24289]: cluster 2024-09-16T12:20:35.105610+0000 mgr.a (mgr.14373) 17444 : cluster [DBG] pgmap v12099: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:20:37.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:20:36 smithi047 bash[22744]: cluster 2024-09-16T12:20:35.105610+0000 mgr.a (mgr.14373) 17444 : cluster [DBG] pgmap v12099: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:20:38.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:20:37 smithi157 bash[24585]: cluster 2024-09-16T12:20:37.107869+0000 mgr.a (mgr.14373) 17445 : cluster [DBG] pgmap v12100: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:20:38.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:20:37 smithi086 bash[24289]: cluster 2024-09-16T12:20:37.107869+0000 mgr.a (mgr.14373) 17445 : cluster [DBG] pgmap v12100: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:20:38.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:20:37 smithi047 bash[22744]: cluster 2024-09-16T12:20:37.107869+0000 mgr.a (mgr.14373) 17445 : cluster [DBG] pgmap v12100: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:20:39.528 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:20:39.529 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:20:39.529 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:20:40.285 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:20:40.285 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:20:40.285 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:20:40.285 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:20:40.285 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:20:40.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:20:40 smithi157 bash[24585]: cluster 2024-09-16T12:20:39.108651+0000 mgr.a (mgr.14373) 17446 : cluster [DBG] pgmap v12101: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:20:40.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:20:40 smithi157 bash[24585]: audit 2024-09-16T12:20:39.853534+0000 mgr.a (mgr.14373) 17447 : audit [DBG] from='client.375030 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:20:40.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:20:40 smithi086 bash[24289]: cluster 2024-09-16T12:20:39.108651+0000 mgr.a (mgr.14373) 17446 : cluster [DBG] pgmap v12101: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:20:40.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:20:40 smithi086 bash[24289]: audit 2024-09-16T12:20:39.853534+0000 mgr.a (mgr.14373) 17447 : audit [DBG] from='client.375030 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:20:40.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:20:40 smithi047 bash[22744]: cluster 2024-09-16T12:20:39.108651+0000 mgr.a (mgr.14373) 17446 : cluster [DBG] pgmap v12101: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:20:40.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:20:40 smithi047 bash[22744]: audit 2024-09-16T12:20:39.853534+0000 mgr.a (mgr.14373) 17447 : audit [DBG] from='client.375030 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:20:42.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:20:42 smithi157 bash[24585]: cluster 2024-09-16T12:20:41.109757+0000 mgr.a (mgr.14373) 17448 : cluster [DBG] pgmap v12102: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:20:42.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:20:42 smithi086 bash[24289]: cluster 2024-09-16T12:20:41.109757+0000 mgr.a (mgr.14373) 17448 : cluster [DBG] pgmap v12102: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:20:42.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:20:42 smithi047 bash[22744]: cluster 2024-09-16T12:20:41.109757+0000 mgr.a (mgr.14373) 17448 : cluster [DBG] pgmap v12102: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:20:44.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:20:44 smithi157 bash[24585]: cluster 2024-09-16T12:20:43.112188+0000 mgr.a (mgr.14373) 17449 : cluster [DBG] pgmap v12103: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:20:44.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:20:44 smithi086 bash[24289]: cluster 2024-09-16T12:20:43.112188+0000 mgr.a (mgr.14373) 17449 : cluster [DBG] pgmap v12103: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:20:44.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:20:44 smithi047 bash[22744]: cluster 2024-09-16T12:20:43.112188+0000 mgr.a (mgr.14373) 17449 : cluster [DBG] pgmap v12103: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:20:45.287 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:20:45.287 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:20:45.287 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:20:46.050 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:20:46.050 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:20:46.050 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:20:46.051 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:20:46.051 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:20:46.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:20:46 smithi157 bash[24585]: cluster 2024-09-16T12:20:45.113096+0000 mgr.a (mgr.14373) 17450 : cluster [DBG] pgmap v12104: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:20:46.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:20:46 smithi157 bash[24585]: audit 2024-09-16T12:20:45.618820+0000 mgr.a (mgr.14373) 17451 : audit [DBG] from='client.375105 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:20:46.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:20:46 smithi086 bash[24289]: cluster 2024-09-16T12:20:45.113096+0000 mgr.a (mgr.14373) 17450 : cluster [DBG] pgmap v12104: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:20:46.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:20:46 smithi086 bash[24289]: audit 2024-09-16T12:20:45.618820+0000 mgr.a (mgr.14373) 17451 : audit [DBG] from='client.375105 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:20:46.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:20:46 smithi047 bash[22744]: cluster 2024-09-16T12:20:45.113096+0000 mgr.a (mgr.14373) 17450 : cluster [DBG] pgmap v12104: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:20:46.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:20:46 smithi047 bash[22744]: audit 2024-09-16T12:20:45.618820+0000 mgr.a (mgr.14373) 17451 : audit [DBG] from='client.375105 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:20:48.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:20:48 smithi157 bash[24585]: cluster 2024-09-16T12:20:47.115854+0000 mgr.a (mgr.14373) 17452 : cluster [DBG] pgmap v12105: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:20:48.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:20:48 smithi086 bash[24289]: cluster 2024-09-16T12:20:47.115854+0000 mgr.a (mgr.14373) 17452 : cluster [DBG] pgmap v12105: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:20:48.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:20:48 smithi047 bash[22744]: cluster 2024-09-16T12:20:47.115854+0000 mgr.a (mgr.14373) 17452 : cluster [DBG] pgmap v12105: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:20:50.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:20:50 smithi157 bash[24585]: cluster 2024-09-16T12:20:49.116677+0000 mgr.a (mgr.14373) 17453 : cluster [DBG] pgmap v12106: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:20:50.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:20:50 smithi086 bash[24289]: cluster 2024-09-16T12:20:49.116677+0000 mgr.a (mgr.14373) 17453 : cluster [DBG] pgmap v12106: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:20:50.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:20:50 smithi047 bash[22744]: cluster 2024-09-16T12:20:49.116677+0000 mgr.a (mgr.14373) 17453 : cluster [DBG] pgmap v12106: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:20:51.052 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:20:51.052 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:20:51.053 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:20:51.816 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:20:51.817 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:20:51.817 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:20:51.817 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:20:51.817 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:20:52.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:20:52 smithi157 bash[24585]: cluster 2024-09-16T12:20:51.117429+0000 mgr.a (mgr.14373) 17454 : cluster [DBG] pgmap v12107: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:20:52.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:20:52 smithi157 bash[24585]: audit 2024-09-16T12:20:51.384136+0000 mgr.a (mgr.14373) 17455 : audit [DBG] from='client.375183 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:20:52.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:20:52 smithi086 bash[24289]: cluster 2024-09-16T12:20:51.117429+0000 mgr.a (mgr.14373) 17454 : cluster [DBG] pgmap v12107: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:20:52.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:20:52 smithi086 bash[24289]: audit 2024-09-16T12:20:51.384136+0000 mgr.a (mgr.14373) 17455 : audit [DBG] from='client.375183 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:20:52.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:20:52 smithi047 bash[22744]: cluster 2024-09-16T12:20:51.117429+0000 mgr.a (mgr.14373) 17454 : cluster [DBG] pgmap v12107: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:20:52.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:20:52 smithi047 bash[22744]: audit 2024-09-16T12:20:51.384136+0000 mgr.a (mgr.14373) 17455 : audit [DBG] from='client.375183 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:20:54.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:20:54 smithi157 bash[24585]: cluster 2024-09-16T12:20:53.120162+0000 mgr.a (mgr.14373) 17456 : cluster [DBG] pgmap v12108: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:20:54.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:20:54 smithi086 bash[24289]: cluster 2024-09-16T12:20:53.120162+0000 mgr.a (mgr.14373) 17456 : cluster [DBG] pgmap v12108: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:20:54.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:20:54 smithi047 bash[22744]: cluster 2024-09-16T12:20:53.120162+0000 mgr.a (mgr.14373) 17456 : cluster [DBG] pgmap v12108: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:20:56.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:20:56 smithi157 bash[24585]: cluster 2024-09-16T12:20:55.120924+0000 mgr.a (mgr.14373) 17457 : cluster [DBG] pgmap v12109: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:20:56.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:20:56 smithi086 bash[24289]: cluster 2024-09-16T12:20:55.120924+0000 mgr.a (mgr.14373) 17457 : cluster [DBG] pgmap v12109: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:20:56.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:20:56 smithi047 bash[22744]: cluster 2024-09-16T12:20:55.120924+0000 mgr.a (mgr.14373) 17457 : cluster [DBG] pgmap v12109: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:20:56.816 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:20:56.817 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:20:56.817 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:20:57.589 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:20:57.589 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:20:57.590 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:20:57.590 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:20:57.590 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:20:58.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:20:58 smithi157 bash[24585]: cluster 2024-09-16T12:20:57.122931+0000 mgr.a (mgr.14373) 17458 : cluster [DBG] pgmap v12110: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:20:58.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:20:58 smithi157 bash[24585]: audit 2024-09-16T12:20:57.151808+0000 mgr.a (mgr.14373) 17459 : audit [DBG] from='client.375261 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:20:58.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:20:58 smithi086 bash[24289]: cluster 2024-09-16T12:20:57.122931+0000 mgr.a (mgr.14373) 17458 : cluster [DBG] pgmap v12110: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:20:58.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:20:58 smithi086 bash[24289]: audit 2024-09-16T12:20:57.151808+0000 mgr.a (mgr.14373) 17459 : audit [DBG] from='client.375261 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:20:58.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:20:58 smithi047 bash[22744]: cluster 2024-09-16T12:20:57.122931+0000 mgr.a (mgr.14373) 17458 : cluster [DBG] pgmap v12110: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:20:58.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:20:58 smithi047 bash[22744]: audit 2024-09-16T12:20:57.151808+0000 mgr.a (mgr.14373) 17459 : audit [DBG] from='client.375261 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:21:00.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:21:00 smithi157 bash[24585]: cluster 2024-09-16T12:20:59.123874+0000 mgr.a (mgr.14373) 17460 : cluster [DBG] pgmap v12111: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:21:00.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:21:00 smithi086 bash[24289]: cluster 2024-09-16T12:20:59.123874+0000 mgr.a (mgr.14373) 17460 : cluster [DBG] pgmap v12111: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:21:00.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:21:00 smithi047 bash[22744]: cluster 2024-09-16T12:20:59.123874+0000 mgr.a (mgr.14373) 17460 : cluster [DBG] pgmap v12111: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:21:02.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:21:02 smithi157 bash[24585]: cluster 2024-09-16T12:21:01.124680+0000 mgr.a (mgr.14373) 17461 : cluster [DBG] pgmap v12112: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T12:21:02.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:21:02 smithi086 bash[24289]: cluster 2024-09-16T12:21:01.124680+0000 mgr.a (mgr.14373) 17461 : cluster [DBG] pgmap v12112: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T12:21:02.591 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:21:02.591 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:21:02.592 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:21:02.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:21:02 smithi047 bash[22744]: cluster 2024-09-16T12:21:01.124680+0000 mgr.a (mgr.14373) 17461 : cluster [DBG] pgmap v12112: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T12:21:03.338 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:21:03.339 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:21:03.339 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:21:03.339 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:21:03.339 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:21:03.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:21:03 smithi157 bash[24585]: audit 2024-09-16T12:21:02.921260+0000 mgr.a (mgr.14373) 17462 : audit [DBG] from='client.375333 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:21:03.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:21:03 smithi086 bash[24289]: audit 2024-09-16T12:21:02.921260+0000 mgr.a (mgr.14373) 17462 : audit [DBG] from='client.375333 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:21:03.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:21:03 smithi047 bash[22744]: audit 2024-09-16T12:21:02.921260+0000 mgr.a (mgr.14373) 17462 : audit [DBG] from='client.375333 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:21:04.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:21:04 smithi157 bash[24585]: cluster 2024-09-16T12:21:03.125933+0000 mgr.a (mgr.14373) 17463 : cluster [DBG] pgmap v12113: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:21:04.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:21:04 smithi086 bash[24289]: cluster 2024-09-16T12:21:03.125933+0000 mgr.a (mgr.14373) 17463 : cluster [DBG] pgmap v12113: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:21:04.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:21:04 smithi047 bash[22744]: cluster 2024-09-16T12:21:03.125933+0000 mgr.a (mgr.14373) 17463 : cluster [DBG] pgmap v12113: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:21:06.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:21:06 smithi157 bash[24585]: cluster 2024-09-16T12:21:05.126817+0000 mgr.a (mgr.14373) 17464 : cluster [DBG] pgmap v12114: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:21:06.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:21:06 smithi086 bash[24289]: cluster 2024-09-16T12:21:05.126817+0000 mgr.a (mgr.14373) 17464 : cluster [DBG] pgmap v12114: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:21:06.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:21:06 smithi047 bash[22744]: cluster 2024-09-16T12:21:05.126817+0000 mgr.a (mgr.14373) 17464 : cluster [DBG] pgmap v12114: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:21:07.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:21:07 smithi157 bash[24585]: audit 2024-09-16T12:21:06.983082+0000 mon.b (mon.2) 1582 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T12:21:07.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:21:07 smithi086 bash[24289]: audit 2024-09-16T12:21:06.983082+0000 mon.b (mon.2) 1582 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T12:21:07.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:21:07 smithi047 bash[22744]: audit 2024-09-16T12:21:06.983082+0000 mon.b (mon.2) 1582 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T12:21:08.339 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:21:08.399 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:21:08.399 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:21:08.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:21:08 smithi157 bash[24585]: cluster 2024-09-16T12:21:07.129020+0000 mgr.a (mgr.14373) 17465 : cluster [DBG] pgmap v12115: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:21:08.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:21:08 smithi157 bash[24585]: audit 2024-09-16T12:21:07.815524+0000 mon.b (mon.2) 1583 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T12:21:08.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:21:08 smithi157 bash[24585]: audit 2024-09-16T12:21:07.817716+0000 mon.b (mon.2) 1584 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T12:21:08.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:21:08 smithi157 bash[24585]: audit 2024-09-16T12:21:07.828834+0000 mon.a (mon.0) 1614 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:21:08.558 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:21:08 smithi157 bash[24585]: audit 2024-09-16T12:21:07.834328+0000 mon.b (mon.2) 1585 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:21:08.558 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:21:08 smithi157 bash[24585]: audit 2024-09-16T12:21:07.836725+0000 mgr.a (mgr.14373) 17466 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:21:08.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:21:08 smithi086 bash[24289]: cluster 2024-09-16T12:21:07.129020+0000 mgr.a (mgr.14373) 17465 : cluster [DBG] pgmap v12115: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:21:08.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:21:08 smithi086 bash[24289]: audit 2024-09-16T12:21:07.815524+0000 mon.b (mon.2) 1583 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T12:21:08.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:21:08 smithi086 bash[24289]: audit 2024-09-16T12:21:07.817716+0000 mon.b (mon.2) 1584 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T12:21:08.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:21:08 smithi086 bash[24289]: audit 2024-09-16T12:21:07.828834+0000 mon.a (mon.0) 1614 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:21:08.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:21:08 smithi086 bash[24289]: audit 2024-09-16T12:21:07.834328+0000 mon.b (mon.2) 1585 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:21:08.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:21:08 smithi086 bash[24289]: audit 2024-09-16T12:21:07.836725+0000 mgr.a (mgr.14373) 17466 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:21:08.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:21:08 smithi047 bash[22744]: cluster 2024-09-16T12:21:07.129020+0000 mgr.a (mgr.14373) 17465 : cluster [DBG] pgmap v12115: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:21:08.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:21:08 smithi047 bash[22744]: audit 2024-09-16T12:21:07.815524+0000 mon.b (mon.2) 1583 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T12:21:08.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:21:08 smithi047 bash[22744]: audit 2024-09-16T12:21:07.817716+0000 mon.b (mon.2) 1584 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T12:21:08.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:21:08 smithi047 bash[22744]: audit 2024-09-16T12:21:07.828834+0000 mon.a (mon.0) 1614 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:21:08.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:21:08 smithi047 bash[22744]: audit 2024-09-16T12:21:07.834328+0000 mon.b (mon.2) 1585 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:21:08.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:21:08 smithi047 bash[22744]: audit 2024-09-16T12:21:07.836725+0000 mgr.a (mgr.14373) 17466 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:21:09.086 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:21:09.087 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:21:09.087 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:21:09.087 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:21:09.087 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:21:09.092 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 12:21:08 smithi047 bash[22994]: debug 2024-09-16T12:21:08.606+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T12:21:09.093 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 12:21:08 smithi047 bash[22994]: debug 2024-09-16T12:21:08.606+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T12:21:09.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:21:09 smithi157 bash[24585]: audit 2024-09-16T12:21:08.606615+0000 mgr.a (mgr.14373) 17467 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T12:21:09.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:21:09 smithi157 bash[24585]: cephadm 2024-09-16T12:21:08.608683+0000 mgr.a (mgr.14373) 17468 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T12:21:09.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:21:09 smithi157 bash[24585]: audit 2024-09-16T12:21:08.679157+0000 mgr.a (mgr.14373) 17469 : audit [DBG] from='client.375498 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:21:09.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:21:09 smithi086 bash[24289]: audit 2024-09-16T12:21:08.606615+0000 mgr.a (mgr.14373) 17467 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T12:21:09.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:21:09 smithi086 bash[24289]: cephadm 2024-09-16T12:21:08.608683+0000 mgr.a (mgr.14373) 17468 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T12:21:09.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:21:09 smithi086 bash[24289]: audit 2024-09-16T12:21:08.679157+0000 mgr.a (mgr.14373) 17469 : audit [DBG] from='client.375498 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:21:09.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:21:09 smithi047 bash[22744]: audit 2024-09-16T12:21:08.606615+0000 mgr.a (mgr.14373) 17467 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T12:21:09.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:21:09 smithi047 bash[22744]: cephadm 2024-09-16T12:21:08.608683+0000 mgr.a (mgr.14373) 17468 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T12:21:09.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:21:09 smithi047 bash[22744]: audit 2024-09-16T12:21:08.679157+0000 mgr.a (mgr.14373) 17469 : audit [DBG] from='client.375498 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:21:10.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:21:10 smithi157 bash[24585]: cluster 2024-09-16T12:21:09.129559+0000 mgr.a (mgr.14373) 17470 : cluster [DBG] pgmap v12116: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:21:10.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:21:10 smithi086 bash[24289]: cluster 2024-09-16T12:21:09.129559+0000 mgr.a (mgr.14373) 17470 : cluster [DBG] pgmap v12116: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:21:10.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:21:10 smithi047 bash[22744]: cluster 2024-09-16T12:21:09.129559+0000 mgr.a (mgr.14373) 17470 : cluster [DBG] pgmap v12116: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:21:12.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:21:12 smithi157 bash[24585]: cluster 2024-09-16T12:21:11.130308+0000 mgr.a (mgr.14373) 17471 : cluster [DBG] pgmap v12117: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:21:12.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:21:12 smithi086 bash[24289]: cluster 2024-09-16T12:21:11.130308+0000 mgr.a (mgr.14373) 17471 : cluster [DBG] pgmap v12117: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:21:12.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:21:12 smithi047 bash[22744]: cluster 2024-09-16T12:21:11.130308+0000 mgr.a (mgr.14373) 17471 : cluster [DBG] pgmap v12117: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:21:14.088 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:21:14.089 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:21:14.089 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:21:14.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:21:14 smithi157 bash[24585]: cluster 2024-09-16T12:21:13.132522+0000 mgr.a (mgr.14373) 17472 : cluster [DBG] pgmap v12118: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:21:14.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:21:14 smithi086 bash[24289]: cluster 2024-09-16T12:21:13.132522+0000 mgr.a (mgr.14373) 17472 : cluster [DBG] pgmap v12118: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:21:14.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:21:14 smithi047 bash[22744]: cluster 2024-09-16T12:21:13.132522+0000 mgr.a (mgr.14373) 17472 : cluster [DBG] pgmap v12118: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:21:14.862 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:21:14.862 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:21:14.863 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:21:14.863 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:21:14.863 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:21:15.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:21:15 smithi157 bash[24585]: audit 2024-09-16T12:21:14.423025+0000 mgr.a (mgr.14373) 17473 : audit [DBG] from='client.375588 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:21:15.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:21:15 smithi086 bash[24289]: audit 2024-09-16T12:21:14.423025+0000 mgr.a (mgr.14373) 17473 : audit [DBG] from='client.375588 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:21:15.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:21:15 smithi047 bash[22744]: audit 2024-09-16T12:21:14.423025+0000 mgr.a (mgr.14373) 17473 : audit [DBG] from='client.375588 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:21:16.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:21:16 smithi157 bash[24585]: cluster 2024-09-16T12:21:15.133496+0000 mgr.a (mgr.14373) 17474 : cluster [DBG] pgmap v12119: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:21:16.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:21:16 smithi086 bash[24289]: cluster 2024-09-16T12:21:15.133496+0000 mgr.a (mgr.14373) 17474 : cluster [DBG] pgmap v12119: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:21:16.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:21:16 smithi047 bash[22744]: cluster 2024-09-16T12:21:15.133496+0000 mgr.a (mgr.14373) 17474 : cluster [DBG] pgmap v12119: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:21:18.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:21:18 smithi157 bash[24585]: cluster 2024-09-16T12:21:17.135668+0000 mgr.a (mgr.14373) 17475 : cluster [DBG] pgmap v12120: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:21:18.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:21:18 smithi086 bash[24289]: cluster 2024-09-16T12:21:17.135668+0000 mgr.a (mgr.14373) 17475 : cluster [DBG] pgmap v12120: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:21:18.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:21:18 smithi047 bash[22744]: cluster 2024-09-16T12:21:17.135668+0000 mgr.a (mgr.14373) 17475 : cluster [DBG] pgmap v12120: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:21:19.864 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:21:19.865 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:21:19.865 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:21:20.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:21:20 smithi157 bash[24585]: cluster 2024-09-16T12:21:19.136441+0000 mgr.a (mgr.14373) 17476 : cluster [DBG] pgmap v12121: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:21:20.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:21:20 smithi086 bash[24289]: cluster 2024-09-16T12:21:19.136441+0000 mgr.a (mgr.14373) 17476 : cluster [DBG] pgmap v12121: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:21:20.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:21:20 smithi047 bash[22744]: cluster 2024-09-16T12:21:19.136441+0000 mgr.a (mgr.14373) 17476 : cluster [DBG] pgmap v12121: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:21:20.646 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:21:20.646 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:21:20.646 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:21:20.646 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:21:20.646 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:21:21.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:21:21 smithi157 bash[24585]: audit 2024-09-16T12:21:20.200097+0000 mgr.a (mgr.14373) 17477 : audit [DBG] from='client.375666 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:21:21.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:21:21 smithi086 bash[24289]: audit 2024-09-16T12:21:20.200097+0000 mgr.a (mgr.14373) 17477 : audit [DBG] from='client.375666 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:21:21.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:21:21 smithi047 bash[22744]: audit 2024-09-16T12:21:20.200097+0000 mgr.a (mgr.14373) 17477 : audit [DBG] from='client.375666 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:21:22.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:21:22 smithi157 bash[24585]: cluster 2024-09-16T12:21:21.137443+0000 mgr.a (mgr.14373) 17478 : cluster [DBG] pgmap v12122: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:21:22.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:21:22 smithi086 bash[24289]: cluster 2024-09-16T12:21:21.137443+0000 mgr.a (mgr.14373) 17478 : cluster [DBG] pgmap v12122: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:21:22.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:21:22 smithi047 bash[22744]: cluster 2024-09-16T12:21:21.137443+0000 mgr.a (mgr.14373) 17478 : cluster [DBG] pgmap v12122: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:21:24.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:21:24 smithi157 bash[24585]: cluster 2024-09-16T12:21:23.139715+0000 mgr.a (mgr.14373) 17479 : cluster [DBG] pgmap v12123: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:21:24.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:21:24 smithi086 bash[24289]: cluster 2024-09-16T12:21:23.139715+0000 mgr.a (mgr.14373) 17479 : cluster [DBG] pgmap v12123: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:21:24.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:21:24 smithi047 bash[22744]: cluster 2024-09-16T12:21:23.139715+0000 mgr.a (mgr.14373) 17479 : cluster [DBG] pgmap v12123: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:21:25.647 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:21:25.648 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:21:25.648 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:21:26.445 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:21:26.446 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:21:26.446 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:21:26.446 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:21:26.446 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:21:26.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:21:26 smithi157 bash[24585]: cluster 2024-09-16T12:21:25.140483+0000 mgr.a (mgr.14373) 17480 : cluster [DBG] pgmap v12124: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:21:26.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:21:26 smithi157 bash[24585]: audit 2024-09-16T12:21:25.985412+0000 mgr.a (mgr.14373) 17481 : audit [DBG] from='client.375741 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:21:26.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:21:26 smithi086 bash[24289]: cluster 2024-09-16T12:21:25.140483+0000 mgr.a (mgr.14373) 17480 : cluster [DBG] pgmap v12124: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:21:26.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:21:26 smithi086 bash[24289]: audit 2024-09-16T12:21:25.985412+0000 mgr.a (mgr.14373) 17481 : audit [DBG] from='client.375741 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:21:26.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:21:26 smithi047 bash[22744]: cluster 2024-09-16T12:21:25.140483+0000 mgr.a (mgr.14373) 17480 : cluster [DBG] pgmap v12124: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:21:26.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:21:26 smithi047 bash[22744]: audit 2024-09-16T12:21:25.985412+0000 mgr.a (mgr.14373) 17481 : audit [DBG] from='client.375741 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:21:28.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:21:28 smithi157 bash[24585]: cluster 2024-09-16T12:21:27.142781+0000 mgr.a (mgr.14373) 17482 : cluster [DBG] pgmap v12125: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:21:28.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:21:28 smithi086 bash[24289]: cluster 2024-09-16T12:21:27.142781+0000 mgr.a (mgr.14373) 17482 : cluster [DBG] pgmap v12125: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:21:28.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:21:28 smithi047 bash[22744]: cluster 2024-09-16T12:21:27.142781+0000 mgr.a (mgr.14373) 17482 : cluster [DBG] pgmap v12125: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:21:30.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:21:30 smithi157 bash[24585]: cluster 2024-09-16T12:21:29.143562+0000 mgr.a (mgr.14373) 17483 : cluster [DBG] pgmap v12126: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:21:30.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:21:30 smithi086 bash[24289]: cluster 2024-09-16T12:21:29.143562+0000 mgr.a (mgr.14373) 17483 : cluster [DBG] pgmap v12126: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:21:30.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:21:30 smithi047 bash[22744]: cluster 2024-09-16T12:21:29.143562+0000 mgr.a (mgr.14373) 17483 : cluster [DBG] pgmap v12126: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:21:31.447 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:21:31.448 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:21:31.448 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:21:32.242 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:21:32.242 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:21:32.242 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:21:32.242 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:21:32.242 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:21:32.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:21:32 smithi086 bash[24289]: cluster 2024-09-16T12:21:31.144327+0000 mgr.a (mgr.14373) 17484 : cluster [DBG] pgmap v12127: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:21:32.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:21:32 smithi086 bash[24289]: audit 2024-09-16T12:21:31.786460+0000 mgr.a (mgr.14373) 17485 : audit [DBG] from='client.375819 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:21:32.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:21:32 smithi047 bash[22744]: cluster 2024-09-16T12:21:31.144327+0000 mgr.a (mgr.14373) 17484 : cluster [DBG] pgmap v12127: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:21:32.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:21:32 smithi047 bash[22744]: audit 2024-09-16T12:21:31.786460+0000 mgr.a (mgr.14373) 17485 : audit [DBG] from='client.375819 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:21:32.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:21:32 smithi157 bash[24585]: cluster 2024-09-16T12:21:31.144327+0000 mgr.a (mgr.14373) 17484 : cluster [DBG] pgmap v12127: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:21:32.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:21:32 smithi157 bash[24585]: audit 2024-09-16T12:21:31.786460+0000 mgr.a (mgr.14373) 17485 : audit [DBG] from='client.375819 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:21:34.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:21:34 smithi086 bash[24289]: cluster 2024-09-16T12:21:33.147140+0000 mgr.a (mgr.14373) 17486 : cluster [DBG] pgmap v12128: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:21:34.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:21:34 smithi047 bash[22744]: cluster 2024-09-16T12:21:33.147140+0000 mgr.a (mgr.14373) 17486 : cluster [DBG] pgmap v12128: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:21:34.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:21:34 smithi157 bash[24585]: cluster 2024-09-16T12:21:33.147140+0000 mgr.a (mgr.14373) 17486 : cluster [DBG] pgmap v12128: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:21:36.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:21:36 smithi086 bash[24289]: cluster 2024-09-16T12:21:35.148095+0000 mgr.a (mgr.14373) 17487 : cluster [DBG] pgmap v12129: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:21:36.595 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:21:36 smithi047 bash[22744]: cluster 2024-09-16T12:21:35.148095+0000 mgr.a (mgr.14373) 17487 : cluster [DBG] pgmap v12129: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:21:36.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:21:36 smithi157 bash[24585]: cluster 2024-09-16T12:21:35.148095+0000 mgr.a (mgr.14373) 17487 : cluster [DBG] pgmap v12129: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:21:37.243 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:21:37.244 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:21:37.244 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:21:38.033 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:21:38.034 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:21:38.034 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:21:38.034 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:21:38.034 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:21:38.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:21:38 smithi047 bash[22744]: cluster 2024-09-16T12:21:37.150268+0000 mgr.a (mgr.14373) 17488 : cluster [DBG] pgmap v12130: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:21:38.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:21:38 smithi047 bash[22744]: audit 2024-09-16T12:21:37.581338+0000 mgr.a (mgr.14373) 17489 : audit [DBG] from='client.375894 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:21:38.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:21:38 smithi157 bash[24585]: cluster 2024-09-16T12:21:37.150268+0000 mgr.a (mgr.14373) 17488 : cluster [DBG] pgmap v12130: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:21:38.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:21:38 smithi157 bash[24585]: audit 2024-09-16T12:21:37.581338+0000 mgr.a (mgr.14373) 17489 : audit [DBG] from='client.375894 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:21:38.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:21:38 smithi086 bash[24289]: cluster 2024-09-16T12:21:37.150268+0000 mgr.a (mgr.14373) 17488 : cluster [DBG] pgmap v12130: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:21:38.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:21:38 smithi086 bash[24289]: audit 2024-09-16T12:21:37.581338+0000 mgr.a (mgr.14373) 17489 : audit [DBG] from='client.375894 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:21:40.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:21:40 smithi047 bash[22744]: cluster 2024-09-16T12:21:39.151224+0000 mgr.a (mgr.14373) 17490 : cluster [DBG] pgmap v12131: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:21:40.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:21:40 smithi157 bash[24585]: cluster 2024-09-16T12:21:39.151224+0000 mgr.a (mgr.14373) 17490 : cluster [DBG] pgmap v12131: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:21:40.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:21:40 smithi086 bash[24289]: cluster 2024-09-16T12:21:39.151224+0000 mgr.a (mgr.14373) 17490 : cluster [DBG] pgmap v12131: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:21:42.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:21:42 smithi047 bash[22744]: cluster 2024-09-16T12:21:41.151998+0000 mgr.a (mgr.14373) 17491 : cluster [DBG] pgmap v12132: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T12:21:42.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:21:42 smithi157 bash[24585]: cluster 2024-09-16T12:21:41.151998+0000 mgr.a (mgr.14373) 17491 : cluster [DBG] pgmap v12132: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T12:21:42.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:21:42 smithi086 bash[24289]: cluster 2024-09-16T12:21:41.151998+0000 mgr.a (mgr.14373) 17491 : cluster [DBG] pgmap v12132: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T12:21:43.035 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:21:43.036 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:21:43.036 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:21:43.783 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:21:43.783 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:21:43.783 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:21:43.783 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:21:43.783 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:21:44.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:21:44 smithi047 bash[22744]: cluster 2024-09-16T12:21:43.153377+0000 mgr.a (mgr.14373) 17492 : cluster [DBG] pgmap v12133: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:21:44.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:21:44 smithi047 bash[22744]: audit 2024-09-16T12:21:43.367609+0000 mgr.a (mgr.14373) 17493 : audit [DBG] from='client.375972 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:21:44.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:21:44 smithi157 bash[24585]: cluster 2024-09-16T12:21:43.153377+0000 mgr.a (mgr.14373) 17492 : cluster [DBG] pgmap v12133: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:21:44.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:21:44 smithi157 bash[24585]: audit 2024-09-16T12:21:43.367609+0000 mgr.a (mgr.14373) 17493 : audit [DBG] from='client.375972 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:21:44.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:21:44 smithi086 bash[24289]: cluster 2024-09-16T12:21:43.153377+0000 mgr.a (mgr.14373) 17492 : cluster [DBG] pgmap v12133: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:21:44.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:21:44 smithi086 bash[24289]: audit 2024-09-16T12:21:43.367609+0000 mgr.a (mgr.14373) 17493 : audit [DBG] from='client.375972 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:21:46.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:21:46 smithi047 bash[22744]: cluster 2024-09-16T12:21:45.154238+0000 mgr.a (mgr.14373) 17494 : cluster [DBG] pgmap v12134: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:21:46.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:21:46 smithi157 bash[24585]: cluster 2024-09-16T12:21:45.154238+0000 mgr.a (mgr.14373) 17494 : cluster [DBG] pgmap v12134: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:21:46.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:21:46 smithi086 bash[24289]: cluster 2024-09-16T12:21:45.154238+0000 mgr.a (mgr.14373) 17494 : cluster [DBG] pgmap v12134: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:21:48.784 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:21:48.785 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:21:48.785 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:21:48.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:21:48 smithi157 bash[24585]: cluster 2024-09-16T12:21:47.156427+0000 mgr.a (mgr.14373) 17495 : cluster [DBG] pgmap v12135: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:21:48.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:21:48 smithi086 bash[24289]: cluster 2024-09-16T12:21:47.156427+0000 mgr.a (mgr.14373) 17495 : cluster [DBG] pgmap v12135: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:21:48.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:21:48 smithi047 bash[22744]: cluster 2024-09-16T12:21:47.156427+0000 mgr.a (mgr.14373) 17495 : cluster [DBG] pgmap v12135: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:21:49.556 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:21:49.557 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:21:49.557 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:21:49.557 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:21:49.557 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:21:50.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:21:50 smithi157 bash[24585]: audit 2024-09-16T12:21:49.115016+0000 mgr.a (mgr.14373) 17496 : audit [DBG] from='client.376050 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:21:50.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:21:50 smithi157 bash[24585]: cluster 2024-09-16T12:21:49.157069+0000 mgr.a (mgr.14373) 17497 : cluster [DBG] pgmap v12136: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:21:50.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:21:50 smithi086 bash[24289]: audit 2024-09-16T12:21:49.115016+0000 mgr.a (mgr.14373) 17496 : audit [DBG] from='client.376050 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:21:50.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:21:50 smithi086 bash[24289]: cluster 2024-09-16T12:21:49.157069+0000 mgr.a (mgr.14373) 17497 : cluster [DBG] pgmap v12136: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:21:50.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:21:50 smithi047 bash[22744]: audit 2024-09-16T12:21:49.115016+0000 mgr.a (mgr.14373) 17496 : audit [DBG] from='client.376050 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:21:50.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:21:50 smithi047 bash[22744]: cluster 2024-09-16T12:21:49.157069+0000 mgr.a (mgr.14373) 17497 : cluster [DBG] pgmap v12136: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:21:52.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:21:52 smithi157 bash[24585]: cluster 2024-09-16T12:21:51.157936+0000 mgr.a (mgr.14373) 17498 : cluster [DBG] pgmap v12137: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:21:52.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:21:52 smithi086 bash[24289]: cluster 2024-09-16T12:21:51.157936+0000 mgr.a (mgr.14373) 17498 : cluster [DBG] pgmap v12137: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:21:52.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:21:52 smithi047 bash[22744]: cluster 2024-09-16T12:21:51.157936+0000 mgr.a (mgr.14373) 17498 : cluster [DBG] pgmap v12137: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:21:54.558 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:21:54.559 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:21:54.559 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:21:54.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:21:54 smithi157 bash[24585]: cluster 2024-09-16T12:21:53.160184+0000 mgr.a (mgr.14373) 17499 : cluster [DBG] pgmap v12138: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:21:54.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:21:54 smithi086 bash[24289]: cluster 2024-09-16T12:21:53.160184+0000 mgr.a (mgr.14373) 17499 : cluster [DBG] pgmap v12138: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:21:54.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:21:54 smithi047 bash[22744]: cluster 2024-09-16T12:21:53.160184+0000 mgr.a (mgr.14373) 17499 : cluster [DBG] pgmap v12138: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:21:55.324 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:21:55.325 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:21:55.325 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:21:55.325 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:21:55.325 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:21:55.810 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:21:55 smithi157 bash[24585]: audit 2024-09-16T12:21:54.894227+0000 mgr.a (mgr.14373) 17500 : audit [DBG] from='client.376125 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:21:55.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:21:55 smithi086 bash[24289]: audit 2024-09-16T12:21:54.894227+0000 mgr.a (mgr.14373) 17500 : audit [DBG] from='client.376125 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:21:55.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:21:55 smithi047 bash[22744]: audit 2024-09-16T12:21:54.894227+0000 mgr.a (mgr.14373) 17500 : audit [DBG] from='client.376125 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:21:56.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:21:56 smithi157 bash[24585]: cluster 2024-09-16T12:21:55.160716+0000 mgr.a (mgr.14373) 17501 : cluster [DBG] pgmap v12139: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:21:56.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:21:56 smithi086 bash[24289]: cluster 2024-09-16T12:21:55.160716+0000 mgr.a (mgr.14373) 17501 : cluster [DBG] pgmap v12139: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:21:56.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:21:56 smithi047 bash[22744]: cluster 2024-09-16T12:21:55.160716+0000 mgr.a (mgr.14373) 17501 : cluster [DBG] pgmap v12139: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:21:58.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:21:58 smithi157 bash[24585]: cluster 2024-09-16T12:21:57.162971+0000 mgr.a (mgr.14373) 17502 : cluster [DBG] pgmap v12140: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:21:58.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:21:58 smithi086 bash[24289]: cluster 2024-09-16T12:21:57.162971+0000 mgr.a (mgr.14373) 17502 : cluster [DBG] pgmap v12140: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:21:58.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:21:58 smithi047 bash[22744]: cluster 2024-09-16T12:21:57.162971+0000 mgr.a (mgr.14373) 17502 : cluster [DBG] pgmap v12140: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:22:00.326 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:22:00.327 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:22:00.327 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:22:00.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:22:00 smithi157 bash[24585]: cluster 2024-09-16T12:21:59.163736+0000 mgr.a (mgr.14373) 17503 : cluster [DBG] pgmap v12141: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:22:00.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:22:00 smithi086 bash[24289]: cluster 2024-09-16T12:21:59.163736+0000 mgr.a (mgr.14373) 17503 : cluster [DBG] pgmap v12141: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:22:00.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:22:00 smithi047 bash[22744]: cluster 2024-09-16T12:21:59.163736+0000 mgr.a (mgr.14373) 17503 : cluster [DBG] pgmap v12141: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:22:01.093 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:22:01.093 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:22:01.093 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:22:01.093 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:22:01.093 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:22:01.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:22:01 smithi157 bash[24585]: audit 2024-09-16T12:22:00.658735+0000 mgr.a (mgr.14373) 17504 : audit [DBG] from='client.376203 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:22:01.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:22:01 smithi086 bash[24289]: audit 2024-09-16T12:22:00.658735+0000 mgr.a (mgr.14373) 17504 : audit [DBG] from='client.376203 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:22:01.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:22:01 smithi047 bash[22744]: audit 2024-09-16T12:22:00.658735+0000 mgr.a (mgr.14373) 17504 : audit [DBG] from='client.376203 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:22:02.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:22:02 smithi157 bash[24585]: cluster 2024-09-16T12:22:01.164712+0000 mgr.a (mgr.14373) 17505 : cluster [DBG] pgmap v12142: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:22:02.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:22:02 smithi086 bash[24289]: cluster 2024-09-16T12:22:01.164712+0000 mgr.a (mgr.14373) 17505 : cluster [DBG] pgmap v12142: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:22:02.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:22:02 smithi047 bash[22744]: cluster 2024-09-16T12:22:01.164712+0000 mgr.a (mgr.14373) 17505 : cluster [DBG] pgmap v12142: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:22:04.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:22:04 smithi157 bash[24585]: cluster 2024-09-16T12:22:03.167004+0000 mgr.a (mgr.14373) 17506 : cluster [DBG] pgmap v12143: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:22:04.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:22:04 smithi086 bash[24289]: cluster 2024-09-16T12:22:03.167004+0000 mgr.a (mgr.14373) 17506 : cluster [DBG] pgmap v12143: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:22:04.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:22:04 smithi047 bash[22744]: cluster 2024-09-16T12:22:03.167004+0000 mgr.a (mgr.14373) 17506 : cluster [DBG] pgmap v12143: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:22:06.094 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:22:06.095 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:22:06.095 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:22:06.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:22:06 smithi157 bash[24585]: cluster 2024-09-16T12:22:05.167806+0000 mgr.a (mgr.14373) 17507 : cluster [DBG] pgmap v12144: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:22:06.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:22:06 smithi086 bash[24289]: cluster 2024-09-16T12:22:05.167806+0000 mgr.a (mgr.14373) 17507 : cluster [DBG] pgmap v12144: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:22:06.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:22:06 smithi047 bash[22744]: cluster 2024-09-16T12:22:05.167806+0000 mgr.a (mgr.14373) 17507 : cluster [DBG] pgmap v12144: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:22:06.868 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:22:06.869 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:22:06.869 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:22:06.869 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:22:06.869 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:22:07.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:22:07 smithi157 bash[24585]: audit 2024-09-16T12:22:06.431396+0000 mgr.a (mgr.14373) 17508 : audit [DBG] from='client.376281 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:22:07.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:22:07 smithi086 bash[24289]: audit 2024-09-16T12:22:06.431396+0000 mgr.a (mgr.14373) 17508 : audit [DBG] from='client.376281 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:22:07.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:22:07 smithi047 bash[22744]: audit 2024-09-16T12:22:06.431396+0000 mgr.a (mgr.14373) 17508 : audit [DBG] from='client.376281 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:22:08.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:22:08 smithi157 bash[24585]: cluster 2024-09-16T12:22:07.170527+0000 mgr.a (mgr.14373) 17509 : cluster [DBG] pgmap v12145: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:22:08.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:22:08 smithi086 bash[24289]: cluster 2024-09-16T12:22:07.170527+0000 mgr.a (mgr.14373) 17509 : cluster [DBG] pgmap v12145: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:22:08.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:22:08 smithi047 bash[22744]: cluster 2024-09-16T12:22:07.170527+0000 mgr.a (mgr.14373) 17509 : cluster [DBG] pgmap v12145: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:22:09.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:22:09 smithi157 bash[24585]: audit 2024-09-16T12:22:08.658870+0000 mon.b (mon.2) 1586 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T12:22:09.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:22:09 smithi086 bash[24289]: audit 2024-09-16T12:22:08.658870+0000 mon.b (mon.2) 1586 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T12:22:09.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:22:09 smithi047 bash[22744]: audit 2024-09-16T12:22:08.658870+0000 mon.b (mon.2) 1586 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T12:22:10.593 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 12:22:10 smithi047 bash[22994]: debug 2024-09-16T12:22:10.280+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T12:22:10.593 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 12:22:10 smithi047 bash[22994]: debug 2024-09-16T12:22:10.280+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T12:22:10.594 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:22:10 smithi047 bash[22744]: cluster 2024-09-16T12:22:09.171270+0000 mgr.a (mgr.14373) 17510 : cluster [DBG] pgmap v12146: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:22:10.594 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:22:10 smithi047 bash[22744]: audit 2024-09-16T12:22:09.513996+0000 mon.b (mon.2) 1587 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T12:22:10.594 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:22:10 smithi047 bash[22744]: audit 2024-09-16T12:22:09.516110+0000 mon.b (mon.2) 1588 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T12:22:10.594 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:22:10 smithi047 bash[22744]: audit 2024-09-16T12:22:09.527681+0000 mon.a (mon.0) 1615 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:22:10.594 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:22:10 smithi047 bash[22744]: audit 2024-09-16T12:22:09.532961+0000 mon.b (mon.2) 1589 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:22:10.594 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:22:10 smithi047 bash[22744]: audit 2024-09-16T12:22:09.535485+0000 mgr.a (mgr.14373) 17511 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:22:10.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:22:10 smithi157 bash[24585]: cluster 2024-09-16T12:22:09.171270+0000 mgr.a (mgr.14373) 17510 : cluster [DBG] pgmap v12146: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:22:10.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:22:10 smithi157 bash[24585]: audit 2024-09-16T12:22:09.513996+0000 mon.b (mon.2) 1587 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T12:22:10.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:22:10 smithi157 bash[24585]: audit 2024-09-16T12:22:09.516110+0000 mon.b (mon.2) 1588 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T12:22:10.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:22:10 smithi157 bash[24585]: audit 2024-09-16T12:22:09.527681+0000 mon.a (mon.0) 1615 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:22:10.808 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:22:10 smithi157 bash[24585]: audit 2024-09-16T12:22:09.532961+0000 mon.b (mon.2) 1589 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:22:10.808 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:22:10 smithi157 bash[24585]: audit 2024-09-16T12:22:09.535485+0000 mgr.a (mgr.14373) 17511 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:22:10.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:22:10 smithi086 bash[24289]: cluster 2024-09-16T12:22:09.171270+0000 mgr.a (mgr.14373) 17510 : cluster [DBG] pgmap v12146: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:22:10.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:22:10 smithi086 bash[24289]: audit 2024-09-16T12:22:09.513996+0000 mon.b (mon.2) 1587 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T12:22:10.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:22:10 smithi086 bash[24289]: audit 2024-09-16T12:22:09.516110+0000 mon.b (mon.2) 1588 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T12:22:10.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:22:10 smithi086 bash[24289]: audit 2024-09-16T12:22:09.527681+0000 mon.a (mon.0) 1615 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:22:10.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:22:10 smithi086 bash[24289]: audit 2024-09-16T12:22:09.532961+0000 mon.b (mon.2) 1589 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:22:10.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:22:10 smithi086 bash[24289]: audit 2024-09-16T12:22:09.535485+0000 mgr.a (mgr.14373) 17511 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:22:11.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:22:11 smithi157 bash[24585]: audit 2024-09-16T12:22:10.282468+0000 mgr.a (mgr.14373) 17512 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T12:22:11.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:22:11 smithi157 bash[24585]: cephadm 2024-09-16T12:22:10.284423+0000 mgr.a (mgr.14373) 17513 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T12:22:11.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:22:11 smithi086 bash[24289]: audit 2024-09-16T12:22:10.282468+0000 mgr.a (mgr.14373) 17512 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T12:22:11.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:22:11 smithi086 bash[24289]: cephadm 2024-09-16T12:22:10.284423+0000 mgr.a (mgr.14373) 17513 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T12:22:11.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:22:11 smithi047 bash[22744]: audit 2024-09-16T12:22:10.282468+0000 mgr.a (mgr.14373) 17512 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T12:22:11.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:22:11 smithi047 bash[22744]: cephadm 2024-09-16T12:22:10.284423+0000 mgr.a (mgr.14373) 17513 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T12:22:11.870 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:22:11.871 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:22:11.871 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:22:12.656 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:22:12.656 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:22:12.656 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:22:12.656 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:22:12.656 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:22:12.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:22:12 smithi157 bash[24585]: cluster 2024-09-16T12:22:11.172179+0000 mgr.a (mgr.14373) 17514 : cluster [DBG] pgmap v12147: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T12:22:12.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:22:12 smithi086 bash[24289]: cluster 2024-09-16T12:22:11.172179+0000 mgr.a (mgr.14373) 17514 : cluster [DBG] pgmap v12147: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T12:22:12.844 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:22:12 smithi047 bash[22744]: cluster 2024-09-16T12:22:11.172179+0000 mgr.a (mgr.14373) 17514 : cluster [DBG] pgmap v12147: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T12:22:13.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:22:13 smithi157 bash[24585]: audit 2024-09-16T12:22:12.210839+0000 mgr.a (mgr.14373) 17515 : audit [DBG] from='client.376467 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:22:13.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:22:13 smithi086 bash[24289]: audit 2024-09-16T12:22:12.210839+0000 mgr.a (mgr.14373) 17515 : audit [DBG] from='client.376467 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:22:13.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:22:13 smithi047 bash[22744]: audit 2024-09-16T12:22:12.210839+0000 mgr.a (mgr.14373) 17515 : audit [DBG] from='client.376467 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:22:14.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:22:14 smithi157 bash[24585]: cluster 2024-09-16T12:22:13.174935+0000 mgr.a (mgr.14373) 17516 : cluster [DBG] pgmap v12148: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:22:14.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:22:14 smithi086 bash[24289]: cluster 2024-09-16T12:22:13.174935+0000 mgr.a (mgr.14373) 17516 : cluster [DBG] pgmap v12148: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:22:14.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:22:14 smithi047 bash[22744]: cluster 2024-09-16T12:22:13.174935+0000 mgr.a (mgr.14373) 17516 : cluster [DBG] pgmap v12148: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:22:16.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:22:16 smithi157 bash[24585]: cluster 2024-09-16T12:22:15.175712+0000 mgr.a (mgr.14373) 17517 : cluster [DBG] pgmap v12149: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T12:22:16.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:22:16 smithi086 bash[24289]: cluster 2024-09-16T12:22:15.175712+0000 mgr.a (mgr.14373) 17517 : cluster [DBG] pgmap v12149: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T12:22:16.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:22:16 smithi047 bash[22744]: cluster 2024-09-16T12:22:15.175712+0000 mgr.a (mgr.14373) 17517 : cluster [DBG] pgmap v12149: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T12:22:17.657 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:22:17.658 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:22:17.658 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:22:18.415 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:22:18.415 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:22:18.416 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:22:18.416 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:22:18.416 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:22:18.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:22:18 smithi157 bash[24585]: cluster 2024-09-16T12:22:17.177715+0000 mgr.a (mgr.14373) 17518 : cluster [DBG] pgmap v12150: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:22:18.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:22:18 smithi157 bash[24585]: audit 2024-09-16T12:22:17.990222+0000 mgr.a (mgr.14373) 17519 : audit [DBG] from='client.376542 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:22:18.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:22:18 smithi086 bash[24289]: cluster 2024-09-16T12:22:17.177715+0000 mgr.a (mgr.14373) 17518 : cluster [DBG] pgmap v12150: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:22:18.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:22:18 smithi086 bash[24289]: audit 2024-09-16T12:22:17.990222+0000 mgr.a (mgr.14373) 17519 : audit [DBG] from='client.376542 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:22:18.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:22:18 smithi047 bash[22744]: cluster 2024-09-16T12:22:17.177715+0000 mgr.a (mgr.14373) 17518 : cluster [DBG] pgmap v12150: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:22:18.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:22:18 smithi047 bash[22744]: audit 2024-09-16T12:22:17.990222+0000 mgr.a (mgr.14373) 17519 : audit [DBG] from='client.376542 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:22:20.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:22:20 smithi157 bash[24585]: cluster 2024-09-16T12:22:19.178768+0000 mgr.a (mgr.14373) 17520 : cluster [DBG] pgmap v12151: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:22:20.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:22:20 smithi086 bash[24289]: cluster 2024-09-16T12:22:19.178768+0000 mgr.a (mgr.14373) 17520 : cluster [DBG] pgmap v12151: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:22:20.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:22:20 smithi047 bash[22744]: cluster 2024-09-16T12:22:19.178768+0000 mgr.a (mgr.14373) 17520 : cluster [DBG] pgmap v12151: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:22:22.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:22:22 smithi157 bash[24585]: cluster 2024-09-16T12:22:21.179591+0000 mgr.a (mgr.14373) 17521 : cluster [DBG] pgmap v12152: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:22:22.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:22:22 smithi086 bash[24289]: cluster 2024-09-16T12:22:21.179591+0000 mgr.a (mgr.14373) 17521 : cluster [DBG] pgmap v12152: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:22:22.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:22:22 smithi047 bash[22744]: cluster 2024-09-16T12:22:21.179591+0000 mgr.a (mgr.14373) 17521 : cluster [DBG] pgmap v12152: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:22:23.417 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:22:23.417 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:22:23.418 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:22:24.163 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:22:24.164 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:22:24.164 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:22:24.164 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:22:24.164 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:22:24.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:22:24 smithi157 bash[24585]: cluster 2024-09-16T12:22:23.181824+0000 mgr.a (mgr.14373) 17522 : cluster [DBG] pgmap v12153: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:22:24.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:22:24 smithi157 bash[24585]: audit 2024-09-16T12:22:23.744941+0000 mgr.a (mgr.14373) 17523 : audit [DBG] from='client.376620 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:22:24.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:22:24 smithi086 bash[24289]: cluster 2024-09-16T12:22:23.181824+0000 mgr.a (mgr.14373) 17522 : cluster [DBG] pgmap v12153: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:22:24.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:22:24 smithi086 bash[24289]: audit 2024-09-16T12:22:23.744941+0000 mgr.a (mgr.14373) 17523 : audit [DBG] from='client.376620 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:22:24.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:22:24 smithi047 bash[22744]: cluster 2024-09-16T12:22:23.181824+0000 mgr.a (mgr.14373) 17522 : cluster [DBG] pgmap v12153: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:22:24.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:22:24 smithi047 bash[22744]: audit 2024-09-16T12:22:23.744941+0000 mgr.a (mgr.14373) 17523 : audit [DBG] from='client.376620 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:22:26.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:22:26 smithi157 bash[24585]: cluster 2024-09-16T12:22:25.182723+0000 mgr.a (mgr.14373) 17524 : cluster [DBG] pgmap v12154: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:22:26.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:22:26 smithi086 bash[24289]: cluster 2024-09-16T12:22:25.182723+0000 mgr.a (mgr.14373) 17524 : cluster [DBG] pgmap v12154: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:22:26.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:22:26 smithi047 bash[22744]: cluster 2024-09-16T12:22:25.182723+0000 mgr.a (mgr.14373) 17524 : cluster [DBG] pgmap v12154: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:22:28.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:22:28 smithi157 bash[24585]: cluster 2024-09-16T12:22:27.185053+0000 mgr.a (mgr.14373) 17525 : cluster [DBG] pgmap v12155: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:22:28.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:22:28 smithi086 bash[24289]: cluster 2024-09-16T12:22:27.185053+0000 mgr.a (mgr.14373) 17525 : cluster [DBG] pgmap v12155: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:22:28.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:22:28 smithi047 bash[22744]: cluster 2024-09-16T12:22:27.185053+0000 mgr.a (mgr.14373) 17525 : cluster [DBG] pgmap v12155: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:22:29.165 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:22:29.166 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:22:29.166 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:22:29.921 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:22:29.922 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:22:29.922 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:22:29.922 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:22:29.922 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:22:30.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:22:30 smithi157 bash[24585]: cluster 2024-09-16T12:22:29.185801+0000 mgr.a (mgr.14373) 17526 : cluster [DBG] pgmap v12156: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:22:30.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:22:30 smithi157 bash[24585]: audit 2024-09-16T12:22:29.496244+0000 mgr.a (mgr.14373) 17527 : audit [DBG] from='client.376695 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:22:30.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:22:30 smithi086 bash[24289]: cluster 2024-09-16T12:22:29.185801+0000 mgr.a (mgr.14373) 17526 : cluster [DBG] pgmap v12156: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:22:30.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:22:30 smithi086 bash[24289]: audit 2024-09-16T12:22:29.496244+0000 mgr.a (mgr.14373) 17527 : audit [DBG] from='client.376695 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:22:30.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:22:30 smithi047 bash[22744]: cluster 2024-09-16T12:22:29.185801+0000 mgr.a (mgr.14373) 17526 : cluster [DBG] pgmap v12156: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:22:30.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:22:30 smithi047 bash[22744]: audit 2024-09-16T12:22:29.496244+0000 mgr.a (mgr.14373) 17527 : audit [DBG] from='client.376695 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:22:32.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:22:32 smithi157 bash[24585]: cluster 2024-09-16T12:22:31.186737+0000 mgr.a (mgr.14373) 17528 : cluster [DBG] pgmap v12157: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:22:32.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:22:32 smithi086 bash[24289]: cluster 2024-09-16T12:22:31.186737+0000 mgr.a (mgr.14373) 17528 : cluster [DBG] pgmap v12157: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:22:32.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:22:32 smithi047 bash[22744]: cluster 2024-09-16T12:22:31.186737+0000 mgr.a (mgr.14373) 17528 : cluster [DBG] pgmap v12157: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:22:34.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:22:34 smithi157 bash[24585]: cluster 2024-09-16T12:22:33.188963+0000 mgr.a (mgr.14373) 17529 : cluster [DBG] pgmap v12158: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:22:34.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:22:34 smithi086 bash[24289]: cluster 2024-09-16T12:22:33.188963+0000 mgr.a (mgr.14373) 17529 : cluster [DBG] pgmap v12158: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:22:34.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:22:34 smithi047 bash[22744]: cluster 2024-09-16T12:22:33.188963+0000 mgr.a (mgr.14373) 17529 : cluster [DBG] pgmap v12158: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:22:34.923 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:22:34.924 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:22:34.924 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:22:35.707 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:22:35.708 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:22:35.708 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:22:35.708 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:22:35.708 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:22:36.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:22:36 smithi157 bash[24585]: cluster 2024-09-16T12:22:35.189685+0000 mgr.a (mgr.14373) 17530 : cluster [DBG] pgmap v12159: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:22:36.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:22:36 smithi157 bash[24585]: audit 2024-09-16T12:22:35.262437+0000 mgr.a (mgr.14373) 17531 : audit [DBG] from='client.376773 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:22:36.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:22:36 smithi086 bash[24289]: cluster 2024-09-16T12:22:35.189685+0000 mgr.a (mgr.14373) 17530 : cluster [DBG] pgmap v12159: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:22:36.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:22:36 smithi086 bash[24289]: audit 2024-09-16T12:22:35.262437+0000 mgr.a (mgr.14373) 17531 : audit [DBG] from='client.376773 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:22:36.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:22:36 smithi047 bash[22744]: cluster 2024-09-16T12:22:35.189685+0000 mgr.a (mgr.14373) 17530 : cluster [DBG] pgmap v12159: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:22:36.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:22:36 smithi047 bash[22744]: audit 2024-09-16T12:22:35.262437+0000 mgr.a (mgr.14373) 17531 : audit [DBG] from='client.376773 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:22:38.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:22:38 smithi157 bash[24585]: cluster 2024-09-16T12:22:37.191962+0000 mgr.a (mgr.14373) 17532 : cluster [DBG] pgmap v12160: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:22:38.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:22:38 smithi086 bash[24289]: cluster 2024-09-16T12:22:37.191962+0000 mgr.a (mgr.14373) 17532 : cluster [DBG] pgmap v12160: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:22:38.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:22:38 smithi047 bash[22744]: cluster 2024-09-16T12:22:37.191962+0000 mgr.a (mgr.14373) 17532 : cluster [DBG] pgmap v12160: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:22:40.709 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:22:40.710 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:22:40.710 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:22:40.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:22:40 smithi157 bash[24585]: cluster 2024-09-16T12:22:39.192710+0000 mgr.a (mgr.14373) 17533 : cluster [DBG] pgmap v12161: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:22:40.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:22:40 smithi086 bash[24289]: cluster 2024-09-16T12:22:39.192710+0000 mgr.a (mgr.14373) 17533 : cluster [DBG] pgmap v12161: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:22:40.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:22:40 smithi047 bash[22744]: cluster 2024-09-16T12:22:39.192710+0000 mgr.a (mgr.14373) 17533 : cluster [DBG] pgmap v12161: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:22:41.463 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:22:41.463 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:22:41.463 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:22:41.463 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:22:41.464 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:22:42.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:22:42 smithi157 bash[24585]: audit 2024-09-16T12:22:41.036977+0000 mgr.a (mgr.14373) 17534 : audit [DBG] from='client.376851 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:22:42.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:22:42 smithi157 bash[24585]: cluster 2024-09-16T12:22:41.193258+0000 mgr.a (mgr.14373) 17535 : cluster [DBG] pgmap v12162: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:22:42.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:22:42 smithi086 bash[24289]: audit 2024-09-16T12:22:41.036977+0000 mgr.a (mgr.14373) 17534 : audit [DBG] from='client.376851 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:22:42.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:22:42 smithi086 bash[24289]: cluster 2024-09-16T12:22:41.193258+0000 mgr.a (mgr.14373) 17535 : cluster [DBG] pgmap v12162: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:22:42.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:22:42 smithi047 bash[22744]: audit 2024-09-16T12:22:41.036977+0000 mgr.a (mgr.14373) 17534 : audit [DBG] from='client.376851 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:22:42.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:22:42 smithi047 bash[22744]: cluster 2024-09-16T12:22:41.193258+0000 mgr.a (mgr.14373) 17535 : cluster [DBG] pgmap v12162: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:22:44.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:22:44 smithi157 bash[24585]: cluster 2024-09-16T12:22:43.195507+0000 mgr.a (mgr.14373) 17536 : cluster [DBG] pgmap v12163: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-16T12:22:44.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:22:44 smithi086 bash[24289]: cluster 2024-09-16T12:22:43.195507+0000 mgr.a (mgr.14373) 17536 : cluster [DBG] pgmap v12163: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-16T12:22:44.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:22:44 smithi047 bash[22744]: cluster 2024-09-16T12:22:43.195507+0000 mgr.a (mgr.14373) 17536 : cluster [DBG] pgmap v12163: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-16T12:22:46.464 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:22:46.465 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:22:46.465 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:22:46.809 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:22:46 smithi157 bash[24585]: cluster 2024-09-16T12:22:45.196276+0000 mgr.a (mgr.14373) 17537 : cluster [DBG] pgmap v12164: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T12:22:46.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:22:46 smithi086 bash[24289]: cluster 2024-09-16T12:22:45.196276+0000 mgr.a (mgr.14373) 17537 : cluster [DBG] pgmap v12164: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T12:22:46.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:22:46 smithi047 bash[22744]: cluster 2024-09-16T12:22:45.196276+0000 mgr.a (mgr.14373) 17537 : cluster [DBG] pgmap v12164: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T12:22:47.236 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:22:47.237 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:22:47.237 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:22:47.237 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:22:47.237 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:22:47.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:22:47 smithi157 bash[24585]: audit 2024-09-16T12:22:46.798381+0000 mgr.a (mgr.14373) 17538 : audit [DBG] from='client.376929 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:22:47.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:22:47 smithi086 bash[24289]: audit 2024-09-16T12:22:46.798381+0000 mgr.a (mgr.14373) 17538 : audit [DBG] from='client.376929 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:22:47.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:22:47 smithi047 bash[22744]: audit 2024-09-16T12:22:46.798381+0000 mgr.a (mgr.14373) 17538 : audit [DBG] from='client.376929 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:22:48.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:22:48 smithi157 bash[24585]: cluster 2024-09-16T12:22:47.197627+0000 mgr.a (mgr.14373) 17539 : cluster [DBG] pgmap v12165: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:22:48.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:22:48 smithi086 bash[24289]: cluster 2024-09-16T12:22:47.197627+0000 mgr.a (mgr.14373) 17539 : cluster [DBG] pgmap v12165: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:22:48.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:22:48 smithi047 bash[22744]: cluster 2024-09-16T12:22:47.197627+0000 mgr.a (mgr.14373) 17539 : cluster [DBG] pgmap v12165: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:22:50.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:22:50 smithi157 bash[24585]: cluster 2024-09-16T12:22:49.198407+0000 mgr.a (mgr.14373) 17540 : cluster [DBG] pgmap v12166: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T12:22:50.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:22:50 smithi086 bash[24289]: cluster 2024-09-16T12:22:49.198407+0000 mgr.a (mgr.14373) 17540 : cluster [DBG] pgmap v12166: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T12:22:50.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:22:50 smithi047 bash[22744]: cluster 2024-09-16T12:22:49.198407+0000 mgr.a (mgr.14373) 17540 : cluster [DBG] pgmap v12166: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T12:22:52.238 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:22:52.239 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:22:52.239 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:22:52.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:22:52 smithi157 bash[24585]: cluster 2024-09-16T12:22:51.199209+0000 mgr.a (mgr.14373) 17541 : cluster [DBG] pgmap v12167: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T12:22:52.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:22:52 smithi086 bash[24289]: cluster 2024-09-16T12:22:51.199209+0000 mgr.a (mgr.14373) 17541 : cluster [DBG] pgmap v12167: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T12:22:52.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:22:52 smithi047 bash[22744]: cluster 2024-09-16T12:22:51.199209+0000 mgr.a (mgr.14373) 17541 : cluster [DBG] pgmap v12167: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T12:22:52.990 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:22:52.990 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:22:52.991 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:22:52.991 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:22:52.991 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:22:53.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:22:53 smithi157 bash[24585]: audit 2024-09-16T12:22:52.563356+0000 mgr.a (mgr.14373) 17542 : audit [DBG] from='client.377001 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:22:53.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:22:53 smithi086 bash[24289]: audit 2024-09-16T12:22:52.563356+0000 mgr.a (mgr.14373) 17542 : audit [DBG] from='client.377001 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:22:53.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:22:53 smithi047 bash[22744]: audit 2024-09-16T12:22:52.563356+0000 mgr.a (mgr.14373) 17542 : audit [DBG] from='client.377001 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:22:54.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:22:54 smithi157 bash[24585]: cluster 2024-09-16T12:22:53.201934+0000 mgr.a (mgr.14373) 17543 : cluster [DBG] pgmap v12168: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:22:54.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:22:54 smithi086 bash[24289]: cluster 2024-09-16T12:22:53.201934+0000 mgr.a (mgr.14373) 17543 : cluster [DBG] pgmap v12168: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:22:54.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:22:54 smithi047 bash[22744]: cluster 2024-09-16T12:22:53.201934+0000 mgr.a (mgr.14373) 17543 : cluster [DBG] pgmap v12168: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:22:56.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:22:56 smithi157 bash[24585]: cluster 2024-09-16T12:22:55.202766+0000 mgr.a (mgr.14373) 17544 : cluster [DBG] pgmap v12169: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-16T12:22:56.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:22:56 smithi086 bash[24289]: cluster 2024-09-16T12:22:55.202766+0000 mgr.a (mgr.14373) 17544 : cluster [DBG] pgmap v12169: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-16T12:22:56.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:22:56 smithi047 bash[22744]: cluster 2024-09-16T12:22:55.202766+0000 mgr.a (mgr.14373) 17544 : cluster [DBG] pgmap v12169: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-16T12:22:57.992 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:22:57.992 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:22:57.993 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:22:58.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:22:58 smithi157 bash[24585]: cluster 2024-09-16T12:22:57.204949+0000 mgr.a (mgr.14373) 17545 : cluster [DBG] pgmap v12170: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-16T12:22:58.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:22:58 smithi086 bash[24289]: cluster 2024-09-16T12:22:57.204949+0000 mgr.a (mgr.14373) 17545 : cluster [DBG] pgmap v12170: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-16T12:22:58.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:22:58 smithi047 bash[22744]: cluster 2024-09-16T12:22:57.204949+0000 mgr.a (mgr.14373) 17545 : cluster [DBG] pgmap v12170: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-16T12:22:58.782 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:22:58.782 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:22:58.783 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:22:58.783 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:22:58.783 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:22:59.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:22:59 smithi157 bash[24585]: audit 2024-09-16T12:22:58.329287+0000 mgr.a (mgr.14373) 17546 : audit [DBG] from='client.377079 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:22:59.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:22:59 smithi086 bash[24289]: audit 2024-09-16T12:22:58.329287+0000 mgr.a (mgr.14373) 17546 : audit [DBG] from='client.377079 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:22:59.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:22:59 smithi047 bash[22744]: audit 2024-09-16T12:22:58.329287+0000 mgr.a (mgr.14373) 17546 : audit [DBG] from='client.377079 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:23:00.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:23:00 smithi157 bash[24585]: cluster 2024-09-16T12:22:59.205970+0000 mgr.a (mgr.14373) 17547 : cluster [DBG] pgmap v12171: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:23:00.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:23:00 smithi086 bash[24289]: cluster 2024-09-16T12:22:59.205970+0000 mgr.a (mgr.14373) 17547 : cluster [DBG] pgmap v12171: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:23:00.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:23:00 smithi047 bash[22744]: cluster 2024-09-16T12:22:59.205970+0000 mgr.a (mgr.14373) 17547 : cluster [DBG] pgmap v12171: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:23:02.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:23:02 smithi157 bash[24585]: cluster 2024-09-16T12:23:01.206791+0000 mgr.a (mgr.14373) 17548 : cluster [DBG] pgmap v12172: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:23:02.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:23:02 smithi086 bash[24289]: cluster 2024-09-16T12:23:01.206791+0000 mgr.a (mgr.14373) 17548 : cluster [DBG] pgmap v12172: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:23:02.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:23:02 smithi047 bash[22744]: cluster 2024-09-16T12:23:01.206791+0000 mgr.a (mgr.14373) 17548 : cluster [DBG] pgmap v12172: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:23:03.783 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:23:03.784 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:23:03.784 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:23:04.543 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:23:04.543 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:23:04.543 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:23:04.543 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:23:04.543 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:23:04.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:23:04 smithi157 bash[24585]: cluster 2024-09-16T12:23:03.209027+0000 mgr.a (mgr.14373) 17549 : cluster [DBG] pgmap v12173: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:23:04.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:23:04 smithi086 bash[24289]: cluster 2024-09-16T12:23:03.209027+0000 mgr.a (mgr.14373) 17549 : cluster [DBG] pgmap v12173: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:23:04.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:23:04 smithi047 bash[22744]: cluster 2024-09-16T12:23:03.209027+0000 mgr.a (mgr.14373) 17549 : cluster [DBG] pgmap v12173: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:23:05.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:23:05 smithi157 bash[24585]: audit 2024-09-16T12:23:04.113898+0000 mgr.a (mgr.14373) 17550 : audit [DBG] from='client.377154 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:23:05.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:23:05 smithi086 bash[24289]: audit 2024-09-16T12:23:04.113898+0000 mgr.a (mgr.14373) 17550 : audit [DBG] from='client.377154 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:23:05.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:23:05 smithi047 bash[22744]: audit 2024-09-16T12:23:04.113898+0000 mgr.a (mgr.14373) 17550 : audit [DBG] from='client.377154 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:23:06.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:23:06 smithi157 bash[24585]: cluster 2024-09-16T12:23:05.210071+0000 mgr.a (mgr.14373) 17551 : cluster [DBG] pgmap v12174: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:23:06.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:23:06 smithi086 bash[24289]: cluster 2024-09-16T12:23:05.210071+0000 mgr.a (mgr.14373) 17551 : cluster [DBG] pgmap v12174: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:23:06.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:23:06 smithi047 bash[22744]: cluster 2024-09-16T12:23:05.210071+0000 mgr.a (mgr.14373) 17551 : cluster [DBG] pgmap v12174: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:23:08.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:23:08 smithi157 bash[24585]: cluster 2024-09-16T12:23:07.212344+0000 mgr.a (mgr.14373) 17552 : cluster [DBG] pgmap v12175: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:23:08.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:23:08 smithi086 bash[24289]: cluster 2024-09-16T12:23:07.212344+0000 mgr.a (mgr.14373) 17552 : cluster [DBG] pgmap v12175: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:23:08.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:23:08 smithi047 bash[22744]: cluster 2024-09-16T12:23:07.212344+0000 mgr.a (mgr.14373) 17552 : cluster [DBG] pgmap v12175: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:23:09.545 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:23:09.545 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:23:09.545 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:23:10.312 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:23:10.312 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:23:10.312 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:23:10.312 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:23:10.313 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:23:10.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:23:10 smithi157 bash[24585]: cluster 2024-09-16T12:23:09.213279+0000 mgr.a (mgr.14373) 17553 : cluster [DBG] pgmap v12176: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:23:10.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:23:10 smithi157 bash[24585]: audit 2024-09-16T12:23:09.871636+0000 mgr.a (mgr.14373) 17554 : audit [DBG] from='client.377232 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:23:10.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:23:10 smithi086 bash[24289]: cluster 2024-09-16T12:23:09.213279+0000 mgr.a (mgr.14373) 17553 : cluster [DBG] pgmap v12176: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:23:10.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:23:10 smithi086 bash[24289]: audit 2024-09-16T12:23:09.871636+0000 mgr.a (mgr.14373) 17554 : audit [DBG] from='client.377232 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:23:10.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:23:10 smithi047 bash[22744]: cluster 2024-09-16T12:23:09.213279+0000 mgr.a (mgr.14373) 17553 : cluster [DBG] pgmap v12176: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:23:10.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:23:10 smithi047 bash[22744]: audit 2024-09-16T12:23:09.871636+0000 mgr.a (mgr.14373) 17554 : audit [DBG] from='client.377232 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:23:11.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:23:11 smithi157 bash[24585]: audit 2024-09-16T12:23:10.335643+0000 mon.b (mon.2) 1590 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T12:23:11.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:23:11 smithi157 bash[24585]: audit 2024-09-16T12:23:10.897833+0000 mon.a (mon.0) 1616 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:23:11.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:23:11 smithi157 bash[24585]: audit 2024-09-16T12:23:10.903982+0000 mon.a (mon.0) 1617 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:23:11.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:23:11 smithi086 bash[24289]: audit 2024-09-16T12:23:10.335643+0000 mon.b (mon.2) 1590 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T12:23:11.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:23:11 smithi086 bash[24289]: audit 2024-09-16T12:23:10.897833+0000 mon.a (mon.0) 1616 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:23:11.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:23:11 smithi086 bash[24289]: audit 2024-09-16T12:23:10.903982+0000 mon.a (mon.0) 1617 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:23:11.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:23:11 smithi047 bash[22744]: audit 2024-09-16T12:23:10.335643+0000 mon.b (mon.2) 1590 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T12:23:11.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:23:11 smithi047 bash[22744]: audit 2024-09-16T12:23:10.897833+0000 mon.a (mon.0) 1616 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:23:11.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:23:11 smithi047 bash[22744]: audit 2024-09-16T12:23:10.903982+0000 mon.a (mon.0) 1617 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:23:12.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:23:12 smithi157 bash[24585]: cluster 2024-09-16T12:23:11.214241+0000 mgr.a (mgr.14373) 17555 : cluster [DBG] pgmap v12177: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:23:12.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:23:12 smithi157 bash[24585]: audit 2024-09-16T12:23:11.695822+0000 mon.b (mon.2) 1591 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T12:23:12.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:23:12 smithi157 bash[24585]: audit 2024-09-16T12:23:11.697678+0000 mon.b (mon.2) 1592 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T12:23:12.558 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:23:12 smithi157 bash[24585]: audit 2024-09-16T12:23:11.708903+0000 mon.a (mon.0) 1618 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:23:12.558 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:23:12 smithi157 bash[24585]: audit 2024-09-16T12:23:11.716126+0000 mon.b (mon.2) 1593 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:23:12.558 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:23:12 smithi157 bash[24585]: audit 2024-09-16T12:23:11.717820+0000 mgr.a (mgr.14373) 17556 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:23:12.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:23:12 smithi086 bash[24289]: cluster 2024-09-16T12:23:11.214241+0000 mgr.a (mgr.14373) 17555 : cluster [DBG] pgmap v12177: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:23:12.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:23:12 smithi086 bash[24289]: audit 2024-09-16T12:23:11.695822+0000 mon.b (mon.2) 1591 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T12:23:12.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:23:12 smithi086 bash[24289]: audit 2024-09-16T12:23:11.697678+0000 mon.b (mon.2) 1592 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T12:23:12.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:23:12 smithi086 bash[24289]: audit 2024-09-16T12:23:11.708903+0000 mon.a (mon.0) 1618 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:23:12.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:23:12 smithi086 bash[24289]: audit 2024-09-16T12:23:11.716126+0000 mon.b (mon.2) 1593 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:23:12.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:23:12 smithi086 bash[24289]: audit 2024-09-16T12:23:11.717820+0000 mgr.a (mgr.14373) 17556 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:23:12.593 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 12:23:12 smithi047 bash[22994]: debug 2024-09-16T12:23:12.471+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T12:23:12.593 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 12:23:12 smithi047 bash[22994]: debug 2024-09-16T12:23:12.475+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T12:23:12.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:23:12 smithi047 bash[22744]: cluster 2024-09-16T12:23:11.214241+0000 mgr.a (mgr.14373) 17555 : cluster [DBG] pgmap v12177: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:23:12.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:23:12 smithi047 bash[22744]: audit 2024-09-16T12:23:11.695822+0000 mon.b (mon.2) 1591 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T12:23:12.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:23:12 smithi047 bash[22744]: audit 2024-09-16T12:23:11.697678+0000 mon.b (mon.2) 1592 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T12:23:12.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:23:12 smithi047 bash[22744]: audit 2024-09-16T12:23:11.708903+0000 mon.a (mon.0) 1618 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:23:12.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:23:12 smithi047 bash[22744]: audit 2024-09-16T12:23:11.716126+0000 mon.b (mon.2) 1593 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:23:12.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:23:12 smithi047 bash[22744]: audit 2024-09-16T12:23:11.717820+0000 mgr.a (mgr.14373) 17556 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:23:13.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:23:13 smithi157 bash[24585]: audit 2024-09-16T12:23:12.478171+0000 mgr.a (mgr.14373) 17557 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T12:23:13.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:23:13 smithi157 bash[24585]: cephadm 2024-09-16T12:23:12.480482+0000 mgr.a (mgr.14373) 17558 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T12:23:13.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:23:13 smithi086 bash[24289]: audit 2024-09-16T12:23:12.478171+0000 mgr.a (mgr.14373) 17557 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T12:23:13.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:23:13 smithi086 bash[24289]: cephadm 2024-09-16T12:23:12.480482+0000 mgr.a (mgr.14373) 17558 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T12:23:13.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:23:13 smithi047 bash[22744]: audit 2024-09-16T12:23:12.478171+0000 mgr.a (mgr.14373) 17557 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T12:23:13.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:23:13 smithi047 bash[22744]: cephadm 2024-09-16T12:23:12.480482+0000 mgr.a (mgr.14373) 17558 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T12:23:14.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:23:14 smithi157 bash[24585]: cluster 2024-09-16T12:23:13.217061+0000 mgr.a (mgr.14373) 17559 : cluster [DBG] pgmap v12178: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:23:14.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:23:14 smithi086 bash[24289]: cluster 2024-09-16T12:23:13.217061+0000 mgr.a (mgr.14373) 17559 : cluster [DBG] pgmap v12178: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:23:14.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:23:14 smithi047 bash[22744]: cluster 2024-09-16T12:23:13.217061+0000 mgr.a (mgr.14373) 17559 : cluster [DBG] pgmap v12178: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:23:15.313 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:23:15.314 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:23:15.314 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:23:16.100 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:23:16.100 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:23:16.100 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:23:16.100 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:23:16.100 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:23:16.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:23:16 smithi086 bash[24289]: cluster 2024-09-16T12:23:15.217863+0000 mgr.a (mgr.14373) 17560 : cluster [DBG] pgmap v12179: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:23:16.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:23:16 smithi086 bash[24289]: audit 2024-09-16T12:23:15.646225+0000 mgr.a (mgr.14373) 17561 : audit [DBG] from='client.377415 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:23:16.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:23:16 smithi047 bash[22744]: cluster 2024-09-16T12:23:15.217863+0000 mgr.a (mgr.14373) 17560 : cluster [DBG] pgmap v12179: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:23:16.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:23:16 smithi047 bash[22744]: audit 2024-09-16T12:23:15.646225+0000 mgr.a (mgr.14373) 17561 : audit [DBG] from='client.377415 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:23:16.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:23:16 smithi157 bash[24585]: cluster 2024-09-16T12:23:15.217863+0000 mgr.a (mgr.14373) 17560 : cluster [DBG] pgmap v12179: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:23:16.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:23:16 smithi157 bash[24585]: audit 2024-09-16T12:23:15.646225+0000 mgr.a (mgr.14373) 17561 : audit [DBG] from='client.377415 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:23:18.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:23:18 smithi086 bash[24289]: cluster 2024-09-16T12:23:17.220234+0000 mgr.a (mgr.14373) 17562 : cluster [DBG] pgmap v12180: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:23:18.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:23:18 smithi047 bash[22744]: cluster 2024-09-16T12:23:17.220234+0000 mgr.a (mgr.14373) 17562 : cluster [DBG] pgmap v12180: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:23:18.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:23:18 smithi157 bash[24585]: cluster 2024-09-16T12:23:17.220234+0000 mgr.a (mgr.14373) 17562 : cluster [DBG] pgmap v12180: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:23:20.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:23:20 smithi086 bash[24289]: cluster 2024-09-16T12:23:19.221033+0000 mgr.a (mgr.14373) 17563 : cluster [DBG] pgmap v12181: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:23:20.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:23:20 smithi047 bash[22744]: cluster 2024-09-16T12:23:19.221033+0000 mgr.a (mgr.14373) 17563 : cluster [DBG] pgmap v12181: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:23:20.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:23:20 smithi157 bash[24585]: cluster 2024-09-16T12:23:19.221033+0000 mgr.a (mgr.14373) 17563 : cluster [DBG] pgmap v12181: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:23:21.101 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:23:21.102 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:23:21.102 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:23:21.894 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:23:21.894 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:23:21.895 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:23:21.895 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:23:21.895 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:23:22.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:23:22 smithi047 bash[22744]: cluster 2024-09-16T12:23:21.221576+0000 mgr.a (mgr.14373) 17564 : cluster [DBG] pgmap v12182: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:23:22.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:23:22 smithi047 bash[22744]: audit 2024-09-16T12:23:21.441138+0000 mgr.a (mgr.14373) 17565 : audit [DBG] from='client.377490 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:23:22.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:23:22 smithi157 bash[24585]: cluster 2024-09-16T12:23:21.221576+0000 mgr.a (mgr.14373) 17564 : cluster [DBG] pgmap v12182: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:23:22.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:23:22 smithi157 bash[24585]: audit 2024-09-16T12:23:21.441138+0000 mgr.a (mgr.14373) 17565 : audit [DBG] from='client.377490 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:23:22.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:23:22 smithi086 bash[24289]: cluster 2024-09-16T12:23:21.221576+0000 mgr.a (mgr.14373) 17564 : cluster [DBG] pgmap v12182: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:23:22.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:23:22 smithi086 bash[24289]: audit 2024-09-16T12:23:21.441138+0000 mgr.a (mgr.14373) 17565 : audit [DBG] from='client.377490 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:23:24.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:23:24 smithi047 bash[22744]: cluster 2024-09-16T12:23:23.224409+0000 mgr.a (mgr.14373) 17566 : cluster [DBG] pgmap v12183: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:23:24.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:23:24 smithi157 bash[24585]: cluster 2024-09-16T12:23:23.224409+0000 mgr.a (mgr.14373) 17566 : cluster [DBG] pgmap v12183: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:23:24.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:23:24 smithi086 bash[24289]: cluster 2024-09-16T12:23:23.224409+0000 mgr.a (mgr.14373) 17566 : cluster [DBG] pgmap v12183: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:23:26.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:23:26 smithi047 bash[22744]: cluster 2024-09-16T12:23:25.225197+0000 mgr.a (mgr.14373) 17567 : cluster [DBG] pgmap v12184: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T12:23:26.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:23:26 smithi157 bash[24585]: cluster 2024-09-16T12:23:25.225197+0000 mgr.a (mgr.14373) 17567 : cluster [DBG] pgmap v12184: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T12:23:26.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:23:26 smithi086 bash[24289]: cluster 2024-09-16T12:23:25.225197+0000 mgr.a (mgr.14373) 17567 : cluster [DBG] pgmap v12184: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T12:23:26.896 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:23:26.897 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:23:26.897 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:23:27.683 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:23:27.683 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:23:27.683 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:23:27.683 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:23:27.683 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:23:28.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:23:28 smithi047 bash[22744]: cluster 2024-09-16T12:23:27.227185+0000 mgr.a (mgr.14373) 17568 : cluster [DBG] pgmap v12185: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:23:28.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:23:28 smithi047 bash[22744]: audit 2024-09-16T12:23:27.234133+0000 mgr.a (mgr.14373) 17569 : audit [DBG] from='client.377568 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:23:28.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:23:28 smithi157 bash[24585]: cluster 2024-09-16T12:23:27.227185+0000 mgr.a (mgr.14373) 17568 : cluster [DBG] pgmap v12185: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:23:28.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:23:28 smithi157 bash[24585]: audit 2024-09-16T12:23:27.234133+0000 mgr.a (mgr.14373) 17569 : audit [DBG] from='client.377568 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:23:28.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:23:28 smithi086 bash[24289]: cluster 2024-09-16T12:23:27.227185+0000 mgr.a (mgr.14373) 17568 : cluster [DBG] pgmap v12185: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:23:28.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:23:28 smithi086 bash[24289]: audit 2024-09-16T12:23:27.234133+0000 mgr.a (mgr.14373) 17569 : audit [DBG] from='client.377568 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:23:30.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:23:30 smithi047 bash[22744]: cluster 2024-09-16T12:23:29.228090+0000 mgr.a (mgr.14373) 17570 : cluster [DBG] pgmap v12186: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:23:30.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:23:30 smithi157 bash[24585]: cluster 2024-09-16T12:23:29.228090+0000 mgr.a (mgr.14373) 17570 : cluster [DBG] pgmap v12186: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:23:30.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:23:30 smithi086 bash[24289]: cluster 2024-09-16T12:23:29.228090+0000 mgr.a (mgr.14373) 17570 : cluster [DBG] pgmap v12186: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:23:32.684 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:23:32.685 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:23:32.685 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:23:32.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:23:32 smithi157 bash[24585]: cluster 2024-09-16T12:23:31.228895+0000 mgr.a (mgr.14373) 17571 : cluster [DBG] pgmap v12187: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T12:23:32.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:23:32 smithi086 bash[24289]: cluster 2024-09-16T12:23:31.228895+0000 mgr.a (mgr.14373) 17571 : cluster [DBG] pgmap v12187: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T12:23:32.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:23:32 smithi047 bash[22744]: cluster 2024-09-16T12:23:31.228895+0000 mgr.a (mgr.14373) 17571 : cluster [DBG] pgmap v12187: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T12:23:33.438 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:23:33.439 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:23:33.439 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:23:33.439 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:23:33.439 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:23:33.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:23:33 smithi157 bash[24585]: audit 2024-09-16T12:23:33.013429+0000 mgr.a (mgr.14373) 17572 : audit [DBG] from='client.377640 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:23:33.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:23:33 smithi086 bash[24289]: audit 2024-09-16T12:23:33.013429+0000 mgr.a (mgr.14373) 17572 : audit [DBG] from='client.377640 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:23:33.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:23:33 smithi047 bash[22744]: audit 2024-09-16T12:23:33.013429+0000 mgr.a (mgr.14373) 17572 : audit [DBG] from='client.377640 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:23:34.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:23:34 smithi157 bash[24585]: cluster 2024-09-16T12:23:33.230101+0000 mgr.a (mgr.14373) 17573 : cluster [DBG] pgmap v12188: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:23:34.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:23:34 smithi086 bash[24289]: cluster 2024-09-16T12:23:33.230101+0000 mgr.a (mgr.14373) 17573 : cluster [DBG] pgmap v12188: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:23:34.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:23:34 smithi047 bash[22744]: cluster 2024-09-16T12:23:33.230101+0000 mgr.a (mgr.14373) 17573 : cluster [DBG] pgmap v12188: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:23:36.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:23:36 smithi157 bash[24585]: cluster 2024-09-16T12:23:35.231177+0000 mgr.a (mgr.14373) 17574 : cluster [DBG] pgmap v12189: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:23:36.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:23:36 smithi086 bash[24289]: cluster 2024-09-16T12:23:35.231177+0000 mgr.a (mgr.14373) 17574 : cluster [DBG] pgmap v12189: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:23:36.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:23:36 smithi047 bash[22744]: cluster 2024-09-16T12:23:35.231177+0000 mgr.a (mgr.14373) 17574 : cluster [DBG] pgmap v12189: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:23:38.440 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:23:38.441 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:23:38.441 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:23:38.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:23:38 smithi157 bash[24585]: cluster 2024-09-16T12:23:37.233534+0000 mgr.a (mgr.14373) 17575 : cluster [DBG] pgmap v12190: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:23:38.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:23:38 smithi086 bash[24289]: cluster 2024-09-16T12:23:37.233534+0000 mgr.a (mgr.14373) 17575 : cluster [DBG] pgmap v12190: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:23:38.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:23:38 smithi047 bash[22744]: cluster 2024-09-16T12:23:37.233534+0000 mgr.a (mgr.14373) 17575 : cluster [DBG] pgmap v12190: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:23:39.233 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:23:39.233 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:23:39.233 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:23:39.233 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:23:39.234 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:23:39.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:23:39 smithi157 bash[24585]: audit 2024-09-16T12:23:38.774970+0000 mgr.a (mgr.14373) 17576 : audit [DBG] from='client.377718 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:23:39.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:23:39 smithi086 bash[24289]: audit 2024-09-16T12:23:38.774970+0000 mgr.a (mgr.14373) 17576 : audit [DBG] from='client.377718 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:23:39.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:23:39 smithi047 bash[22744]: audit 2024-09-16T12:23:38.774970+0000 mgr.a (mgr.14373) 17576 : audit [DBG] from='client.377718 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:23:40.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:23:40 smithi157 bash[24585]: cluster 2024-09-16T12:23:39.234254+0000 mgr.a (mgr.14373) 17577 : cluster [DBG] pgmap v12191: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:23:40.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:23:40 smithi086 bash[24289]: cluster 2024-09-16T12:23:39.234254+0000 mgr.a (mgr.14373) 17577 : cluster [DBG] pgmap v12191: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:23:40.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:23:40 smithi047 bash[22744]: cluster 2024-09-16T12:23:39.234254+0000 mgr.a (mgr.14373) 17577 : cluster [DBG] pgmap v12191: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:23:42.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:23:42 smithi157 bash[24585]: cluster 2024-09-16T12:23:41.234991+0000 mgr.a (mgr.14373) 17578 : cluster [DBG] pgmap v12192: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:23:42.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:23:42 smithi086 bash[24289]: cluster 2024-09-16T12:23:41.234991+0000 mgr.a (mgr.14373) 17578 : cluster [DBG] pgmap v12192: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:23:42.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:23:42 smithi047 bash[22744]: cluster 2024-09-16T12:23:41.234991+0000 mgr.a (mgr.14373) 17578 : cluster [DBG] pgmap v12192: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:23:44.234 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:23:44.236 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:23:44.236 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:23:44.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:23:44 smithi157 bash[24585]: cluster 2024-09-16T12:23:43.237274+0000 mgr.a (mgr.14373) 17579 : cluster [DBG] pgmap v12193: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:23:44.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:23:44 smithi086 bash[24289]: cluster 2024-09-16T12:23:43.237274+0000 mgr.a (mgr.14373) 17579 : cluster [DBG] pgmap v12193: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:23:44.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:23:44 smithi047 bash[22744]: cluster 2024-09-16T12:23:43.237274+0000 mgr.a (mgr.14373) 17579 : cluster [DBG] pgmap v12193: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:23:44.984 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:23:44.984 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:23:44.985 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:23:44.985 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:23:44.985 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:23:45.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:23:45 smithi157 bash[24585]: audit 2024-09-16T12:23:44.564904+0000 mgr.a (mgr.14373) 17580 : audit [DBG] from='client.377796 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:23:45.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:23:45 smithi086 bash[24289]: audit 2024-09-16T12:23:44.564904+0000 mgr.a (mgr.14373) 17580 : audit [DBG] from='client.377796 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:23:45.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:23:45 smithi047 bash[22744]: audit 2024-09-16T12:23:44.564904+0000 mgr.a (mgr.14373) 17580 : audit [DBG] from='client.377796 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:23:46.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:23:46 smithi157 bash[24585]: cluster 2024-09-16T12:23:45.238201+0000 mgr.a (mgr.14373) 17581 : cluster [DBG] pgmap v12194: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:23:46.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:23:46 smithi086 bash[24289]: cluster 2024-09-16T12:23:45.238201+0000 mgr.a (mgr.14373) 17581 : cluster [DBG] pgmap v12194: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:23:46.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:23:46 smithi047 bash[22744]: cluster 2024-09-16T12:23:45.238201+0000 mgr.a (mgr.14373) 17581 : cluster [DBG] pgmap v12194: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:23:48.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:23:48 smithi157 bash[24585]: cluster 2024-09-16T12:23:47.240405+0000 mgr.a (mgr.14373) 17582 : cluster [DBG] pgmap v12195: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:23:48.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:23:48 smithi086 bash[24289]: cluster 2024-09-16T12:23:47.240405+0000 mgr.a (mgr.14373) 17582 : cluster [DBG] pgmap v12195: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:23:48.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:23:48 smithi047 bash[22744]: cluster 2024-09-16T12:23:47.240405+0000 mgr.a (mgr.14373) 17582 : cluster [DBG] pgmap v12195: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:23:49.986 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:23:49.987 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:23:49.987 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:23:50.744 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:23:50.744 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:23:50.745 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:23:50.745 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:23:50.745 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:23:50.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:23:50 smithi157 bash[24585]: cluster 2024-09-16T12:23:49.241187+0000 mgr.a (mgr.14373) 17583 : cluster [DBG] pgmap v12196: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:23:50.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:23:50 smithi086 bash[24289]: cluster 2024-09-16T12:23:49.241187+0000 mgr.a (mgr.14373) 17583 : cluster [DBG] pgmap v12196: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:23:50.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:23:50 smithi047 bash[22744]: cluster 2024-09-16T12:23:49.241187+0000 mgr.a (mgr.14373) 17583 : cluster [DBG] pgmap v12196: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:23:51.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:23:51 smithi157 bash[24585]: audit 2024-09-16T12:23:50.318594+0000 mgr.a (mgr.14373) 17584 : audit [DBG] from='client.377874 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:23:51.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:23:51 smithi086 bash[24289]: audit 2024-09-16T12:23:50.318594+0000 mgr.a (mgr.14373) 17584 : audit [DBG] from='client.377874 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:23:51.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:23:51 smithi047 bash[22744]: audit 2024-09-16T12:23:50.318594+0000 mgr.a (mgr.14373) 17584 : audit [DBG] from='client.377874 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:23:52.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:23:52 smithi157 bash[24585]: cluster 2024-09-16T12:23:51.242157+0000 mgr.a (mgr.14373) 17585 : cluster [DBG] pgmap v12197: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:23:52.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:23:52 smithi086 bash[24289]: cluster 2024-09-16T12:23:51.242157+0000 mgr.a (mgr.14373) 17585 : cluster [DBG] pgmap v12197: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:23:52.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:23:52 smithi047 bash[22744]: cluster 2024-09-16T12:23:51.242157+0000 mgr.a (mgr.14373) 17585 : cluster [DBG] pgmap v12197: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:23:54.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:23:54 smithi157 bash[24585]: cluster 2024-09-16T12:23:53.244347+0000 mgr.a (mgr.14373) 17586 : cluster [DBG] pgmap v12198: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:23:54.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:23:54 smithi086 bash[24289]: cluster 2024-09-16T12:23:53.244347+0000 mgr.a (mgr.14373) 17586 : cluster [DBG] pgmap v12198: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:23:54.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:23:54 smithi047 bash[22744]: cluster 2024-09-16T12:23:53.244347+0000 mgr.a (mgr.14373) 17586 : cluster [DBG] pgmap v12198: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:23:55.746 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:23:55.746 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:23:55.747 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:23:56.512 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:23:56.513 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:23:56.513 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:23:56.513 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:23:56.513 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:23:56.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:23:56 smithi157 bash[24585]: cluster 2024-09-16T12:23:55.245161+0000 mgr.a (mgr.14373) 17587 : cluster [DBG] pgmap v12199: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:23:56.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:23:56 smithi086 bash[24289]: cluster 2024-09-16T12:23:55.245161+0000 mgr.a (mgr.14373) 17587 : cluster [DBG] pgmap v12199: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:23:56.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:23:56 smithi047 bash[22744]: cluster 2024-09-16T12:23:55.245161+0000 mgr.a (mgr.14373) 17587 : cluster [DBG] pgmap v12199: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:23:57.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:23:57 smithi157 bash[24585]: audit 2024-09-16T12:23:56.076586+0000 mgr.a (mgr.14373) 17588 : audit [DBG] from='client.377949 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:23:57.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:23:57 smithi086 bash[24289]: audit 2024-09-16T12:23:56.076586+0000 mgr.a (mgr.14373) 17588 : audit [DBG] from='client.377949 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:23:57.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:23:57 smithi047 bash[22744]: audit 2024-09-16T12:23:56.076586+0000 mgr.a (mgr.14373) 17588 : audit [DBG] from='client.377949 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:23:58.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:23:58 smithi157 bash[24585]: cluster 2024-09-16T12:23:57.247661+0000 mgr.a (mgr.14373) 17589 : cluster [DBG] pgmap v12200: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-16T12:23:58.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:23:58 smithi086 bash[24289]: cluster 2024-09-16T12:23:57.247661+0000 mgr.a (mgr.14373) 17589 : cluster [DBG] pgmap v12200: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-16T12:23:58.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:23:58 smithi047 bash[22744]: cluster 2024-09-16T12:23:57.247661+0000 mgr.a (mgr.14373) 17589 : cluster [DBG] pgmap v12200: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-16T12:24:00.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:24:00 smithi157 bash[24585]: cluster 2024-09-16T12:23:59.248450+0000 mgr.a (mgr.14373) 17590 : cluster [DBG] pgmap v12201: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T12:24:00.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:24:00 smithi086 bash[24289]: cluster 2024-09-16T12:23:59.248450+0000 mgr.a (mgr.14373) 17590 : cluster [DBG] pgmap v12201: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T12:24:00.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:24:00 smithi047 bash[22744]: cluster 2024-09-16T12:23:59.248450+0000 mgr.a (mgr.14373) 17590 : cluster [DBG] pgmap v12201: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T12:24:01.512 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:24:01.513 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:24:01.513 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:24:02.294 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:24:02.294 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:24:02.294 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:24:02.294 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:24:02.294 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:24:02.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:24:02 smithi157 bash[24585]: cluster 2024-09-16T12:24:01.249240+0000 mgr.a (mgr.14373) 17591 : cluster [DBG] pgmap v12202: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T12:24:02.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:24:02 smithi157 bash[24585]: audit 2024-09-16T12:24:01.844784+0000 mgr.a (mgr.14373) 17592 : audit [DBG] from='client.378027 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:24:02.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:24:02 smithi086 bash[24289]: cluster 2024-09-16T12:24:01.249240+0000 mgr.a (mgr.14373) 17591 : cluster [DBG] pgmap v12202: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T12:24:02.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:24:02 smithi086 bash[24289]: audit 2024-09-16T12:24:01.844784+0000 mgr.a (mgr.14373) 17592 : audit [DBG] from='client.378027 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:24:02.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:24:02 smithi047 bash[22744]: cluster 2024-09-16T12:24:01.249240+0000 mgr.a (mgr.14373) 17591 : cluster [DBG] pgmap v12202: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T12:24:02.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:24:02 smithi047 bash[22744]: audit 2024-09-16T12:24:01.844784+0000 mgr.a (mgr.14373) 17592 : audit [DBG] from='client.378027 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:24:04.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:24:04 smithi157 bash[24585]: cluster 2024-09-16T12:24:03.252040+0000 mgr.a (mgr.14373) 17593 : cluster [DBG] pgmap v12203: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:24:04.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:24:04 smithi086 bash[24289]: cluster 2024-09-16T12:24:03.252040+0000 mgr.a (mgr.14373) 17593 : cluster [DBG] pgmap v12203: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:24:04.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:24:04 smithi047 bash[22744]: cluster 2024-09-16T12:24:03.252040+0000 mgr.a (mgr.14373) 17593 : cluster [DBG] pgmap v12203: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:24:06.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:24:06 smithi157 bash[24585]: cluster 2024-09-16T12:24:05.252822+0000 mgr.a (mgr.14373) 17594 : cluster [DBG] pgmap v12204: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:24:06.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:24:06 smithi086 bash[24289]: cluster 2024-09-16T12:24:05.252822+0000 mgr.a (mgr.14373) 17594 : cluster [DBG] pgmap v12204: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:24:06.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:24:06 smithi047 bash[22744]: cluster 2024-09-16T12:24:05.252822+0000 mgr.a (mgr.14373) 17594 : cluster [DBG] pgmap v12204: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:24:07.295 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:24:07.296 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:24:07.296 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:24:08.045 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:24:08.046 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:24:08.046 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:24:08.046 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:24:08.046 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:24:08.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:24:08 smithi157 bash[24585]: cluster 2024-09-16T12:24:07.254900+0000 mgr.a (mgr.14373) 17595 : cluster [DBG] pgmap v12205: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:24:08.808 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:24:08 smithi157 bash[24585]: audit 2024-09-16T12:24:07.626079+0000 mgr.a (mgr.14373) 17596 : audit [DBG] from='client.378105 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:24:08.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:24:08 smithi086 bash[24289]: cluster 2024-09-16T12:24:07.254900+0000 mgr.a (mgr.14373) 17595 : cluster [DBG] pgmap v12205: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:24:08.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:24:08 smithi086 bash[24289]: audit 2024-09-16T12:24:07.626079+0000 mgr.a (mgr.14373) 17596 : audit [DBG] from='client.378105 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:24:08.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:24:08 smithi047 bash[22744]: cluster 2024-09-16T12:24:07.254900+0000 mgr.a (mgr.14373) 17595 : cluster [DBG] pgmap v12205: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:24:08.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:24:08 smithi047 bash[22744]: audit 2024-09-16T12:24:07.626079+0000 mgr.a (mgr.14373) 17596 : audit [DBG] from='client.378105 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:24:10.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:24:10 smithi157 bash[24585]: cluster 2024-09-16T12:24:09.255782+0000 mgr.a (mgr.14373) 17597 : cluster [DBG] pgmap v12206: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-16T12:24:10.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:24:10 smithi086 bash[24289]: cluster 2024-09-16T12:24:09.255782+0000 mgr.a (mgr.14373) 17597 : cluster [DBG] pgmap v12206: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-16T12:24:10.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:24:10 smithi047 bash[22744]: cluster 2024-09-16T12:24:09.255782+0000 mgr.a (mgr.14373) 17597 : cluster [DBG] pgmap v12206: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-16T12:24:12.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:24:12 smithi157 bash[24585]: cluster 2024-09-16T12:24:11.256575+0000 mgr.a (mgr.14373) 17598 : cluster [DBG] pgmap v12207: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-16T12:24:12.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:24:12 smithi086 bash[24289]: cluster 2024-09-16T12:24:11.256575+0000 mgr.a (mgr.14373) 17598 : cluster [DBG] pgmap v12207: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-16T12:24:12.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:24:12 smithi047 bash[22744]: cluster 2024-09-16T12:24:11.256575+0000 mgr.a (mgr.14373) 17598 : cluster [DBG] pgmap v12207: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-16T12:24:13.047 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:24:13.048 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:24:13.048 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:24:13.796 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:24:13.796 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:24:13.796 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:24:13.797 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:24:13.797 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:24:13.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:24:13 smithi157 bash[24585]: audit 2024-09-16T12:24:12.534746+0000 mon.b (mon.2) 1594 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T12:24:13.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:24:13 smithi157 bash[24585]: audit 2024-09-16T12:24:13.150691+0000 mon.a (mon.0) 1619 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:24:13.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:24:13 smithi157 bash[24585]: audit 2024-09-16T12:24:13.156213+0000 mon.a (mon.0) 1620 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:24:13.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:24:13 smithi157 bash[24585]: audit 2024-09-16T12:24:13.163788+0000 mon.a (mon.0) 1621 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:24:13.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:24:13 smithi157 bash[24585]: audit 2024-09-16T12:24:13.168437+0000 mon.a (mon.0) 1622 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:24:13.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:24:13 smithi086 bash[24289]: audit 2024-09-16T12:24:12.534746+0000 mon.b (mon.2) 1594 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T12:24:13.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:24:13 smithi086 bash[24289]: audit 2024-09-16T12:24:13.150691+0000 mon.a (mon.0) 1619 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:24:13.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:24:13 smithi086 bash[24289]: audit 2024-09-16T12:24:13.156213+0000 mon.a (mon.0) 1620 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:24:13.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:24:13 smithi086 bash[24289]: audit 2024-09-16T12:24:13.163788+0000 mon.a (mon.0) 1621 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:24:13.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:24:13 smithi086 bash[24289]: audit 2024-09-16T12:24:13.168437+0000 mon.a (mon.0) 1622 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:24:13.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:24:13 smithi047 bash[22744]: audit 2024-09-16T12:24:12.534746+0000 mon.b (mon.2) 1594 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T12:24:13.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:24:13 smithi047 bash[22744]: audit 2024-09-16T12:24:13.150691+0000 mon.a (mon.0) 1619 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:24:13.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:24:13 smithi047 bash[22744]: audit 2024-09-16T12:24:13.156213+0000 mon.a (mon.0) 1620 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:24:13.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:24:13 smithi047 bash[22744]: audit 2024-09-16T12:24:13.163788+0000 mon.a (mon.0) 1621 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:24:13.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:24:13 smithi047 bash[22744]: audit 2024-09-16T12:24:13.168437+0000 mon.a (mon.0) 1622 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:24:14.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:24:14 smithi157 bash[24585]: cluster 2024-09-16T12:24:13.257559+0000 mgr.a (mgr.14373) 17599 : cluster [DBG] pgmap v12208: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-16T12:24:14.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:24:14 smithi157 bash[24585]: audit 2024-09-16T12:24:13.361730+0000 mgr.a (mgr.14373) 17600 : audit [DBG] from='client.378177 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:24:14.808 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:24:14 smithi157 bash[24585]: audit 2024-09-16T12:24:13.849544+0000 mon.b (mon.2) 1595 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T12:24:14.808 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:24:14 smithi157 bash[24585]: audit 2024-09-16T12:24:13.851290+0000 mon.b (mon.2) 1596 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T12:24:14.808 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:24:14 smithi157 bash[24585]: audit 2024-09-16T12:24:13.858950+0000 mon.a (mon.0) 1623 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:24:14.808 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:24:14 smithi157 bash[24585]: audit 2024-09-16T12:24:13.863761+0000 mon.b (mon.2) 1597 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:24:14.808 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:24:14 smithi157 bash[24585]: audit 2024-09-16T12:24:13.866518+0000 mgr.a (mgr.14373) 17601 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:24:14.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:24:14 smithi086 bash[24289]: cluster 2024-09-16T12:24:13.257559+0000 mgr.a (mgr.14373) 17599 : cluster [DBG] pgmap v12208: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-16T12:24:14.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:24:14 smithi086 bash[24289]: audit 2024-09-16T12:24:13.361730+0000 mgr.a (mgr.14373) 17600 : audit [DBG] from='client.378177 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:24:14.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:24:14 smithi086 bash[24289]: audit 2024-09-16T12:24:13.849544+0000 mon.b (mon.2) 1595 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T12:24:14.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:24:14 smithi086 bash[24289]: audit 2024-09-16T12:24:13.851290+0000 mon.b (mon.2) 1596 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T12:24:14.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:24:14 smithi086 bash[24289]: audit 2024-09-16T12:24:13.858950+0000 mon.a (mon.0) 1623 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:24:14.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:24:14 smithi086 bash[24289]: audit 2024-09-16T12:24:13.863761+0000 mon.b (mon.2) 1597 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:24:14.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:24:14 smithi086 bash[24289]: audit 2024-09-16T12:24:13.866518+0000 mgr.a (mgr.14373) 17601 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:24:14.843 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 12:24:14 smithi047 bash[22994]: debug 2024-09-16T12:24:14.593+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T12:24:14.843 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 12:24:14 smithi047 bash[22994]: debug 2024-09-16T12:24:14.597+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T12:24:14.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:24:14 smithi047 bash[22744]: cluster 2024-09-16T12:24:13.257559+0000 mgr.a (mgr.14373) 17599 : cluster [DBG] pgmap v12208: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-16T12:24:14.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:24:14 smithi047 bash[22744]: audit 2024-09-16T12:24:13.361730+0000 mgr.a (mgr.14373) 17600 : audit [DBG] from='client.378177 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:24:14.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:24:14 smithi047 bash[22744]: audit 2024-09-16T12:24:13.849544+0000 mon.b (mon.2) 1595 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T12:24:14.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:24:14 smithi047 bash[22744]: audit 2024-09-16T12:24:13.851290+0000 mon.b (mon.2) 1596 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T12:24:14.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:24:14 smithi047 bash[22744]: audit 2024-09-16T12:24:13.858950+0000 mon.a (mon.0) 1623 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:24:14.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:24:14 smithi047 bash[22744]: audit 2024-09-16T12:24:13.863761+0000 mon.b (mon.2) 1597 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:24:14.844 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:24:14 smithi047 bash[22744]: audit 2024-09-16T12:24:13.866518+0000 mgr.a (mgr.14373) 17601 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:24:15.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:24:15 smithi157 bash[24585]: audit 2024-09-16T12:24:14.597734+0000 mgr.a (mgr.14373) 17602 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T12:24:15.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:24:15 smithi157 bash[24585]: cephadm 2024-09-16T12:24:14.599990+0000 mgr.a (mgr.14373) 17603 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T12:24:15.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:24:15 smithi086 bash[24289]: audit 2024-09-16T12:24:14.597734+0000 mgr.a (mgr.14373) 17602 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T12:24:15.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:24:15 smithi086 bash[24289]: cephadm 2024-09-16T12:24:14.599990+0000 mgr.a (mgr.14373) 17603 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T12:24:15.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:24:15 smithi047 bash[22744]: audit 2024-09-16T12:24:14.597734+0000 mgr.a (mgr.14373) 17602 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T12:24:15.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:24:15 smithi047 bash[22744]: cephadm 2024-09-16T12:24:14.599990+0000 mgr.a (mgr.14373) 17603 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T12:24:16.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:24:16 smithi157 bash[24585]: cluster 2024-09-16T12:24:15.258502+0000 mgr.a (mgr.14373) 17604 : cluster [DBG] pgmap v12209: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:24:16.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:24:16 smithi086 bash[24289]: cluster 2024-09-16T12:24:15.258502+0000 mgr.a (mgr.14373) 17604 : cluster [DBG] pgmap v12209: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:24:16.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:24:16 smithi047 bash[22744]: cluster 2024-09-16T12:24:15.258502+0000 mgr.a (mgr.14373) 17604 : cluster [DBG] pgmap v12209: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:24:18.798 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:24:18.798 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:24:18.799 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:24:18.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:24:18 smithi157 bash[24585]: cluster 2024-09-16T12:24:17.260730+0000 mgr.a (mgr.14373) 17605 : cluster [DBG] pgmap v12210: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:24:18.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:24:18 smithi086 bash[24289]: cluster 2024-09-16T12:24:17.260730+0000 mgr.a (mgr.14373) 17605 : cluster [DBG] pgmap v12210: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:24:18.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:24:18 smithi047 bash[22744]: cluster 2024-09-16T12:24:17.260730+0000 mgr.a (mgr.14373) 17605 : cluster [DBG] pgmap v12210: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:24:19.583 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:24:19.583 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:24:19.583 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:24:19.583 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:24:19.583 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:24:20.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:24:20 smithi157 bash[24585]: audit 2024-09-16T12:24:19.137533+0000 mgr.a (mgr.14373) 17606 : audit [DBG] from='client.378354 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:24:20.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:24:20 smithi157 bash[24585]: cluster 2024-09-16T12:24:19.261375+0000 mgr.a (mgr.14373) 17607 : cluster [DBG] pgmap v12211: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:24:20.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:24:20 smithi086 bash[24289]: audit 2024-09-16T12:24:19.137533+0000 mgr.a (mgr.14373) 17606 : audit [DBG] from='client.378354 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:24:20.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:24:20 smithi086 bash[24289]: cluster 2024-09-16T12:24:19.261375+0000 mgr.a (mgr.14373) 17607 : cluster [DBG] pgmap v12211: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:24:20.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:24:20 smithi047 bash[22744]: audit 2024-09-16T12:24:19.137533+0000 mgr.a (mgr.14373) 17606 : audit [DBG] from='client.378354 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:24:20.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:24:20 smithi047 bash[22744]: cluster 2024-09-16T12:24:19.261375+0000 mgr.a (mgr.14373) 17607 : cluster [DBG] pgmap v12211: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:24:22.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:24:22 smithi157 bash[24585]: cluster 2024-09-16T12:24:21.262273+0000 mgr.a (mgr.14373) 17608 : cluster [DBG] pgmap v12212: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:24:22.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:24:22 smithi086 bash[24289]: cluster 2024-09-16T12:24:21.262273+0000 mgr.a (mgr.14373) 17608 : cluster [DBG] pgmap v12212: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:24:22.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:24:22 smithi047 bash[22744]: cluster 2024-09-16T12:24:21.262273+0000 mgr.a (mgr.14373) 17608 : cluster [DBG] pgmap v12212: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:24:24.584 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:24:24.585 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:24:24.585 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:24:24.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:24:24 smithi157 bash[24585]: cluster 2024-09-16T12:24:23.264550+0000 mgr.a (mgr.14373) 17609 : cluster [DBG] pgmap v12213: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:24:24.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:24:24 smithi086 bash[24289]: cluster 2024-09-16T12:24:23.264550+0000 mgr.a (mgr.14373) 17609 : cluster [DBG] pgmap v12213: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:24:24.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:24:24 smithi047 bash[22744]: cluster 2024-09-16T12:24:23.264550+0000 mgr.a (mgr.14373) 17609 : cluster [DBG] pgmap v12213: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:24:25.370 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:24:25.370 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:24:25.370 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:24:25.370 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:24:25.370 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:24:25.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:24:25 smithi157 bash[24585]: audit 2024-09-16T12:24:24.920141+0000 mgr.a (mgr.14373) 17610 : audit [DBG] from='client.378432 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:24:25.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:24:25 smithi086 bash[24289]: audit 2024-09-16T12:24:24.920141+0000 mgr.a (mgr.14373) 17610 : audit [DBG] from='client.378432 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:24:25.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:24:25 smithi047 bash[22744]: audit 2024-09-16T12:24:24.920141+0000 mgr.a (mgr.14373) 17610 : audit [DBG] from='client.378432 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:24:26.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:24:26 smithi157 bash[24585]: cluster 2024-09-16T12:24:25.265319+0000 mgr.a (mgr.14373) 17611 : cluster [DBG] pgmap v12214: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:24:26.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:24:26 smithi086 bash[24289]: cluster 2024-09-16T12:24:25.265319+0000 mgr.a (mgr.14373) 17611 : cluster [DBG] pgmap v12214: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:24:26.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:24:26 smithi047 bash[22744]: cluster 2024-09-16T12:24:25.265319+0000 mgr.a (mgr.14373) 17611 : cluster [DBG] pgmap v12214: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:24:28.808 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:24:28 smithi157 bash[24585]: cluster 2024-09-16T12:24:27.267718+0000 mgr.a (mgr.14373) 17612 : cluster [DBG] pgmap v12215: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:24:28.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:24:28 smithi086 bash[24289]: cluster 2024-09-16T12:24:27.267718+0000 mgr.a (mgr.14373) 17612 : cluster [DBG] pgmap v12215: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:24:28.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:24:28 smithi047 bash[22744]: cluster 2024-09-16T12:24:27.267718+0000 mgr.a (mgr.14373) 17612 : cluster [DBG] pgmap v12215: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:24:30.372 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:24:30.373 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:24:30.373 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:24:30.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:24:30 smithi157 bash[24585]: cluster 2024-09-16T12:24:29.268531+0000 mgr.a (mgr.14373) 17613 : cluster [DBG] pgmap v12216: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:24:30.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:24:30 smithi086 bash[24289]: cluster 2024-09-16T12:24:29.268531+0000 mgr.a (mgr.14373) 17613 : cluster [DBG] pgmap v12216: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:24:30.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:24:30 smithi047 bash[22744]: cluster 2024-09-16T12:24:29.268531+0000 mgr.a (mgr.14373) 17613 : cluster [DBG] pgmap v12216: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:24:31.123 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:24:31.124 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:24:31.124 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:24:31.124 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:24:31.124 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:24:31.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:24:31 smithi157 bash[24585]: audit 2024-09-16T12:24:30.704186+0000 mgr.a (mgr.14373) 17614 : audit [DBG] from='client.378507 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:24:31.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:24:31 smithi086 bash[24289]: audit 2024-09-16T12:24:30.704186+0000 mgr.a (mgr.14373) 17614 : audit [DBG] from='client.378507 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:24:31.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:24:31 smithi047 bash[22744]: audit 2024-09-16T12:24:30.704186+0000 mgr.a (mgr.14373) 17614 : audit [DBG] from='client.378507 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:24:32.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:24:32 smithi157 bash[24585]: cluster 2024-09-16T12:24:31.269484+0000 mgr.a (mgr.14373) 17615 : cluster [DBG] pgmap v12217: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:24:32.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:24:32 smithi086 bash[24289]: cluster 2024-09-16T12:24:31.269484+0000 mgr.a (mgr.14373) 17615 : cluster [DBG] pgmap v12217: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:24:32.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:24:32 smithi047 bash[22744]: cluster 2024-09-16T12:24:31.269484+0000 mgr.a (mgr.14373) 17615 : cluster [DBG] pgmap v12217: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:24:34.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:24:34 smithi157 bash[24585]: cluster 2024-09-16T12:24:33.271774+0000 mgr.a (mgr.14373) 17616 : cluster [DBG] pgmap v12218: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:24:34.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:24:34 smithi086 bash[24289]: cluster 2024-09-16T12:24:33.271774+0000 mgr.a (mgr.14373) 17616 : cluster [DBG] pgmap v12218: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:24:34.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:24:34 smithi047 bash[22744]: cluster 2024-09-16T12:24:33.271774+0000 mgr.a (mgr.14373) 17616 : cluster [DBG] pgmap v12218: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:24:36.125 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:24:36.126 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:24:36.127 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:24:36.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:24:36 smithi157 bash[24585]: cluster 2024-09-16T12:24:35.272546+0000 mgr.a (mgr.14373) 17617 : cluster [DBG] pgmap v12219: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:24:36.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:24:36 smithi086 bash[24289]: cluster 2024-09-16T12:24:35.272546+0000 mgr.a (mgr.14373) 17617 : cluster [DBG] pgmap v12219: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:24:36.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:24:36 smithi047 bash[22744]: cluster 2024-09-16T12:24:35.272546+0000 mgr.a (mgr.14373) 17617 : cluster [DBG] pgmap v12219: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:24:36.898 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:24:36.898 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:24:36.898 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:24:36.898 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:24:36.898 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:24:37.808 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:24:37 smithi157 bash[24585]: audit 2024-09-16T12:24:36.459816+0000 mgr.a (mgr.14373) 17618 : audit [DBG] from='client.378585 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:24:37.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:24:37 smithi086 bash[24289]: audit 2024-09-16T12:24:36.459816+0000 mgr.a (mgr.14373) 17618 : audit [DBG] from='client.378585 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:24:37.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:24:37 smithi047 bash[22744]: audit 2024-09-16T12:24:36.459816+0000 mgr.a (mgr.14373) 17618 : audit [DBG] from='client.378585 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:24:38.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:24:38 smithi157 bash[24585]: cluster 2024-09-16T12:24:37.275489+0000 mgr.a (mgr.14373) 17619 : cluster [DBG] pgmap v12220: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:24:38.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:24:38 smithi086 bash[24289]: cluster 2024-09-16T12:24:37.275489+0000 mgr.a (mgr.14373) 17619 : cluster [DBG] pgmap v12220: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:24:38.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:24:38 smithi047 bash[22744]: cluster 2024-09-16T12:24:37.275489+0000 mgr.a (mgr.14373) 17619 : cluster [DBG] pgmap v12220: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:24:40.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:24:40 smithi157 bash[24585]: cluster 2024-09-16T12:24:39.276282+0000 mgr.a (mgr.14373) 17620 : cluster [DBG] pgmap v12221: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:24:40.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:24:40 smithi086 bash[24289]: cluster 2024-09-16T12:24:39.276282+0000 mgr.a (mgr.14373) 17620 : cluster [DBG] pgmap v12221: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:24:40.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:24:40 smithi047 bash[22744]: cluster 2024-09-16T12:24:39.276282+0000 mgr.a (mgr.14373) 17620 : cluster [DBG] pgmap v12221: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:24:41.899 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:24:41.900 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:24:41.901 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:24:42.684 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:24:42.685 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:24:42.685 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:24:42.685 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:24:42.685 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:24:42.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:24:42 smithi157 bash[24585]: cluster 2024-09-16T12:24:41.277068+0000 mgr.a (mgr.14373) 17621 : cluster [DBG] pgmap v12222: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:24:42.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:24:42 smithi086 bash[24289]: cluster 2024-09-16T12:24:41.277068+0000 mgr.a (mgr.14373) 17621 : cluster [DBG] pgmap v12222: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:24:42.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:24:42 smithi047 bash[22744]: cluster 2024-09-16T12:24:41.277068+0000 mgr.a (mgr.14373) 17621 : cluster [DBG] pgmap v12222: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:24:43.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:24:43 smithi157 bash[24585]: audit 2024-09-16T12:24:42.238377+0000 mgr.a (mgr.14373) 17622 : audit [DBG] from='client.378660 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:24:43.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:24:43 smithi086 bash[24289]: audit 2024-09-16T12:24:42.238377+0000 mgr.a (mgr.14373) 17622 : audit [DBG] from='client.378660 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:24:43.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:24:43 smithi047 bash[22744]: audit 2024-09-16T12:24:42.238377+0000 mgr.a (mgr.14373) 17622 : audit [DBG] from='client.378660 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:24:44.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:24:44 smithi157 bash[24585]: cluster 2024-09-16T12:24:43.279834+0000 mgr.a (mgr.14373) 17623 : cluster [DBG] pgmap v12223: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:24:44.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:24:44 smithi086 bash[24289]: cluster 2024-09-16T12:24:43.279834+0000 mgr.a (mgr.14373) 17623 : cluster [DBG] pgmap v12223: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:24:44.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:24:44 smithi047 bash[22744]: cluster 2024-09-16T12:24:43.279834+0000 mgr.a (mgr.14373) 17623 : cluster [DBG] pgmap v12223: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:24:46.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:24:46 smithi086 bash[24289]: cluster 2024-09-16T12:24:45.280625+0000 mgr.a (mgr.14373) 17624 : cluster [DBG] pgmap v12224: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:24:46.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:24:46 smithi047 bash[22744]: cluster 2024-09-16T12:24:45.280625+0000 mgr.a (mgr.14373) 17624 : cluster [DBG] pgmap v12224: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:24:47.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:24:46 smithi157 bash[24585]: cluster 2024-09-16T12:24:45.280625+0000 mgr.a (mgr.14373) 17624 : cluster [DBG] pgmap v12224: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:24:47.686 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:24:47.687 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:24:47.687 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:24:48.449 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:24:48.449 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:24:48.449 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:24:48.450 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:24:48.450 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:24:48.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:24:48 smithi086 bash[24289]: cluster 2024-09-16T12:24:47.282664+0000 mgr.a (mgr.14373) 17625 : cluster [DBG] pgmap v12225: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:24:48.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:24:48 smithi086 bash[24289]: audit 2024-09-16T12:24:48.014523+0000 mgr.a (mgr.14373) 17626 : audit [DBG] from='client.378735 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:24:48.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:24:48 smithi047 bash[22744]: cluster 2024-09-16T12:24:47.282664+0000 mgr.a (mgr.14373) 17625 : cluster [DBG] pgmap v12225: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:24:48.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:24:48 smithi047 bash[22744]: audit 2024-09-16T12:24:48.014523+0000 mgr.a (mgr.14373) 17626 : audit [DBG] from='client.378735 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:24:49.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:24:48 smithi157 bash[24585]: cluster 2024-09-16T12:24:47.282664+0000 mgr.a (mgr.14373) 17625 : cluster [DBG] pgmap v12225: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:24:49.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:24:48 smithi157 bash[24585]: audit 2024-09-16T12:24:48.014523+0000 mgr.a (mgr.14373) 17626 : audit [DBG] from='client.378735 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:24:50.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:24:50 smithi086 bash[24289]: cluster 2024-09-16T12:24:49.283594+0000 mgr.a (mgr.14373) 17627 : cluster [DBG] pgmap v12226: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:24:50.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:24:50 smithi047 bash[22744]: cluster 2024-09-16T12:24:49.283594+0000 mgr.a (mgr.14373) 17627 : cluster [DBG] pgmap v12226: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:24:51.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:24:50 smithi157 bash[24585]: cluster 2024-09-16T12:24:49.283594+0000 mgr.a (mgr.14373) 17627 : cluster [DBG] pgmap v12226: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:24:52.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:24:52 smithi047 bash[22744]: cluster 2024-09-16T12:24:51.284540+0000 mgr.a (mgr.14373) 17628 : cluster [DBG] pgmap v12227: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:24:53.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:24:52 smithi157 bash[24585]: cluster 2024-09-16T12:24:51.284540+0000 mgr.a (mgr.14373) 17628 : cluster [DBG] pgmap v12227: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:24:53.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:24:52 smithi086 bash[24289]: cluster 2024-09-16T12:24:51.284540+0000 mgr.a (mgr.14373) 17628 : cluster [DBG] pgmap v12227: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:24:53.450 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:24:53.451 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:24:53.451 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:24:54.211 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:24:54.211 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:24:54.211 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:24:54.211 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:24:54.211 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:24:54.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:24:54 smithi047 bash[22744]: cluster 2024-09-16T12:24:53.286830+0000 mgr.a (mgr.14373) 17629 : cluster [DBG] pgmap v12228: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:24:54.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:24:54 smithi047 bash[22744]: audit 2024-09-16T12:24:53.777814+0000 mgr.a (mgr.14373) 17630 : audit [DBG] from='client.378813 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:24:55.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:24:54 smithi157 bash[24585]: cluster 2024-09-16T12:24:53.286830+0000 mgr.a (mgr.14373) 17629 : cluster [DBG] pgmap v12228: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:24:55.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:24:54 smithi157 bash[24585]: audit 2024-09-16T12:24:53.777814+0000 mgr.a (mgr.14373) 17630 : audit [DBG] from='client.378813 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:24:55.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:24:54 smithi086 bash[24289]: cluster 2024-09-16T12:24:53.286830+0000 mgr.a (mgr.14373) 17629 : cluster [DBG] pgmap v12228: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:24:55.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:24:54 smithi086 bash[24289]: audit 2024-09-16T12:24:53.777814+0000 mgr.a (mgr.14373) 17630 : audit [DBG] from='client.378813 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:24:56.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:24:56 smithi047 bash[22744]: cluster 2024-09-16T12:24:55.287752+0000 mgr.a (mgr.14373) 17631 : cluster [DBG] pgmap v12229: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:24:57.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:24:56 smithi157 bash[24585]: cluster 2024-09-16T12:24:55.287752+0000 mgr.a (mgr.14373) 17631 : cluster [DBG] pgmap v12229: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:24:57.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:24:56 smithi086 bash[24289]: cluster 2024-09-16T12:24:55.287752+0000 mgr.a (mgr.14373) 17631 : cluster [DBG] pgmap v12229: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:24:58.844 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:24:58 smithi047 bash[22744]: cluster 2024-09-16T12:24:57.290031+0000 mgr.a (mgr.14373) 17632 : cluster [DBG] pgmap v12230: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:24:59.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:24:58 smithi157 bash[24585]: cluster 2024-09-16T12:24:57.290031+0000 mgr.a (mgr.14373) 17632 : cluster [DBG] pgmap v12230: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:24:59.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:24:58 smithi086 bash[24289]: cluster 2024-09-16T12:24:57.290031+0000 mgr.a (mgr.14373) 17632 : cluster [DBG] pgmap v12230: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:24:59.212 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:24:59.213 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:24:59.213 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:24:59.995 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:24:59.995 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:24:59.995 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:24:59.995 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:24:59.996 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:25:00.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:25:00 smithi047 bash[22744]: cluster 2024-09-16T12:24:59.290782+0000 mgr.a (mgr.14373) 17633 : cluster [DBG] pgmap v12231: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:25:00.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:25:00 smithi047 bash[22744]: audit 2024-09-16T12:24:59.548038+0000 mgr.a (mgr.14373) 17634 : audit [DBG] from='client.378888 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:25:01.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:25:00 smithi157 bash[24585]: cluster 2024-09-16T12:24:59.290782+0000 mgr.a (mgr.14373) 17633 : cluster [DBG] pgmap v12231: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:25:01.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:25:00 smithi157 bash[24585]: audit 2024-09-16T12:24:59.548038+0000 mgr.a (mgr.14373) 17634 : audit [DBG] from='client.378888 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:25:01.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:25:00 smithi086 bash[24289]: cluster 2024-09-16T12:24:59.290782+0000 mgr.a (mgr.14373) 17633 : cluster [DBG] pgmap v12231: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:25:01.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:25:00 smithi086 bash[24289]: audit 2024-09-16T12:24:59.548038+0000 mgr.a (mgr.14373) 17634 : audit [DBG] from='client.378888 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:25:02.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:25:02 smithi047 bash[22744]: cluster 2024-09-16T12:25:01.291707+0000 mgr.a (mgr.14373) 17635 : cluster [DBG] pgmap v12232: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:25:03.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:25:02 smithi157 bash[24585]: cluster 2024-09-16T12:25:01.291707+0000 mgr.a (mgr.14373) 17635 : cluster [DBG] pgmap v12232: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:25:03.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:25:02 smithi086 bash[24289]: cluster 2024-09-16T12:25:01.291707+0000 mgr.a (mgr.14373) 17635 : cluster [DBG] pgmap v12232: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:25:04.997 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:25:04.997 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:25:04.998 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:25:05.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:25:04 smithi157 bash[24585]: cluster 2024-09-16T12:25:03.293987+0000 mgr.a (mgr.14373) 17636 : cluster [DBG] pgmap v12233: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:25:05.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:25:04 smithi086 bash[24289]: cluster 2024-09-16T12:25:03.293987+0000 mgr.a (mgr.14373) 17636 : cluster [DBG] pgmap v12233: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:25:05.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:25:04 smithi047 bash[22744]: cluster 2024-09-16T12:25:03.293987+0000 mgr.a (mgr.14373) 17636 : cluster [DBG] pgmap v12233: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:25:05.781 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:25:05.781 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:25:05.781 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:25:05.781 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:25:05.781 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:25:07.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:25:06 smithi157 bash[24585]: cluster 2024-09-16T12:25:05.294747+0000 mgr.a (mgr.14373) 17637 : cluster [DBG] pgmap v12234: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:25:07.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:25:06 smithi157 bash[24585]: audit 2024-09-16T12:25:05.335015+0000 mgr.a (mgr.14373) 17638 : audit [DBG] from='client.378966 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:25:07.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:25:06 smithi086 bash[24289]: cluster 2024-09-16T12:25:05.294747+0000 mgr.a (mgr.14373) 17637 : cluster [DBG] pgmap v12234: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:25:07.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:25:06 smithi086 bash[24289]: audit 2024-09-16T12:25:05.335015+0000 mgr.a (mgr.14373) 17638 : audit [DBG] from='client.378966 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:25:07.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:25:06 smithi047 bash[22744]: cluster 2024-09-16T12:25:05.294747+0000 mgr.a (mgr.14373) 17637 : cluster [DBG] pgmap v12234: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:25:07.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:25:06 smithi047 bash[22744]: audit 2024-09-16T12:25:05.335015+0000 mgr.a (mgr.14373) 17638 : audit [DBG] from='client.378966 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:25:09.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:25:08 smithi157 bash[24585]: cluster 2024-09-16T12:25:07.297098+0000 mgr.a (mgr.14373) 17639 : cluster [DBG] pgmap v12235: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:25:09.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:25:08 smithi086 bash[24289]: cluster 2024-09-16T12:25:07.297098+0000 mgr.a (mgr.14373) 17639 : cluster [DBG] pgmap v12235: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:25:09.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:25:08 smithi047 bash[22744]: cluster 2024-09-16T12:25:07.297098+0000 mgr.a (mgr.14373) 17639 : cluster [DBG] pgmap v12235: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:25:10.782 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:25:10.783 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:25:10.783 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:25:11.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:25:10 smithi157 bash[24585]: cluster 2024-09-16T12:25:09.297863+0000 mgr.a (mgr.14373) 17640 : cluster [DBG] pgmap v12236: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:25:11.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:25:10 smithi086 bash[24289]: cluster 2024-09-16T12:25:09.297863+0000 mgr.a (mgr.14373) 17640 : cluster [DBG] pgmap v12236: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:25:11.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:25:10 smithi047 bash[22744]: cluster 2024-09-16T12:25:09.297863+0000 mgr.a (mgr.14373) 17640 : cluster [DBG] pgmap v12236: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:25:11.523 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:25:11.523 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:25:11.523 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:25:11.523 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:25:11.523 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:25:13.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:25:12 smithi157 bash[24585]: audit 2024-09-16T12:25:11.103976+0000 mgr.a (mgr.14373) 17641 : audit [DBG] from='client.379041 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:25:13.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:25:12 smithi157 bash[24585]: cluster 2024-09-16T12:25:11.298412+0000 mgr.a (mgr.14373) 17642 : cluster [DBG] pgmap v12237: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:25:13.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:25:12 smithi086 bash[24289]: audit 2024-09-16T12:25:11.103976+0000 mgr.a (mgr.14373) 17641 : audit [DBG] from='client.379041 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:25:13.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:25:12 smithi086 bash[24289]: cluster 2024-09-16T12:25:11.298412+0000 mgr.a (mgr.14373) 17642 : cluster [DBG] pgmap v12237: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:25:13.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:25:12 smithi047 bash[22744]: audit 2024-09-16T12:25:11.103976+0000 mgr.a (mgr.14373) 17641 : audit [DBG] from='client.379041 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:25:13.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:25:12 smithi047 bash[22744]: cluster 2024-09-16T12:25:11.298412+0000 mgr.a (mgr.14373) 17642 : cluster [DBG] pgmap v12237: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:25:15.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:25:14 smithi157 bash[24585]: cluster 2024-09-16T12:25:13.300731+0000 mgr.a (mgr.14373) 17643 : cluster [DBG] pgmap v12238: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-16T12:25:15.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:25:14 smithi086 bash[24289]: cluster 2024-09-16T12:25:13.300731+0000 mgr.a (mgr.14373) 17643 : cluster [DBG] pgmap v12238: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-16T12:25:15.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:25:14 smithi047 bash[22744]: cluster 2024-09-16T12:25:13.300731+0000 mgr.a (mgr.14373) 17643 : cluster [DBG] pgmap v12238: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-16T12:25:16.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:25:15 smithi157 bash[24585]: audit 2024-09-16T12:25:14.652861+0000 mon.b (mon.2) 1598 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T12:25:16.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:25:15 smithi157 bash[24585]: audit 2024-09-16T12:25:15.500848+0000 mon.b (mon.2) 1599 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T12:25:16.058 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:25:15 smithi157 bash[24585]: audit 2024-09-16T12:25:15.502904+0000 mon.b (mon.2) 1600 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T12:25:16.058 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:25:15 smithi157 bash[24585]: audit 2024-09-16T12:25:15.513976+0000 mon.a (mon.0) 1624 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:25:16.058 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:25:15 smithi157 bash[24585]: audit 2024-09-16T12:25:15.519529+0000 mon.b (mon.2) 1601 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:25:16.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:25:15 smithi086 bash[24289]: audit 2024-09-16T12:25:14.652861+0000 mon.b (mon.2) 1598 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T12:25:16.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:25:15 smithi086 bash[24289]: audit 2024-09-16T12:25:15.500848+0000 mon.b (mon.2) 1599 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T12:25:16.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:25:15 smithi086 bash[24289]: audit 2024-09-16T12:25:15.502904+0000 mon.b (mon.2) 1600 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T12:25:16.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:25:15 smithi086 bash[24289]: audit 2024-09-16T12:25:15.513976+0000 mon.a (mon.0) 1624 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:25:16.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:25:15 smithi086 bash[24289]: audit 2024-09-16T12:25:15.519529+0000 mon.b (mon.2) 1601 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:25:16.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:25:15 smithi047 bash[22744]: audit 2024-09-16T12:25:14.652861+0000 mon.b (mon.2) 1598 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T12:25:16.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:25:15 smithi047 bash[22744]: audit 2024-09-16T12:25:15.500848+0000 mon.b (mon.2) 1599 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T12:25:16.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:25:15 smithi047 bash[22744]: audit 2024-09-16T12:25:15.502904+0000 mon.b (mon.2) 1600 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T12:25:16.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:25:15 smithi047 bash[22744]: audit 2024-09-16T12:25:15.513976+0000 mon.a (mon.0) 1624 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:25:16.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:25:15 smithi047 bash[22744]: audit 2024-09-16T12:25:15.519529+0000 mon.b (mon.2) 1601 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:25:16.524 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:25:16.525 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:25:16.525 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:25:16.593 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 12:25:16 smithi047 bash[22994]: debug 2024-09-16T12:25:16.256+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T12:25:16.593 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 12:25:16 smithi047 bash[22994]: debug 2024-09-16T12:25:16.256+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T12:25:17.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:25:16 smithi157 bash[24585]: cluster 2024-09-16T12:25:15.301422+0000 mgr.a (mgr.14373) 17644 : cluster [DBG] pgmap v12239: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T12:25:17.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:25:16 smithi157 bash[24585]: audit 2024-09-16T12:25:15.521961+0000 mgr.a (mgr.14373) 17645 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:25:17.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:25:16 smithi086 bash[24289]: cluster 2024-09-16T12:25:15.301422+0000 mgr.a (mgr.14373) 17644 : cluster [DBG] pgmap v12239: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T12:25:17.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:25:16 smithi086 bash[24289]: audit 2024-09-16T12:25:15.521961+0000 mgr.a (mgr.14373) 17645 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:25:17.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:25:16 smithi047 bash[22744]: cluster 2024-09-16T12:25:15.301422+0000 mgr.a (mgr.14373) 17644 : cluster [DBG] pgmap v12239: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T12:25:17.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:25:16 smithi047 bash[22744]: audit 2024-09-16T12:25:15.521961+0000 mgr.a (mgr.14373) 17645 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:25:17.262 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:25:17.262 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:25:17.262 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:25:17.262 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:25:17.262 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:25:18.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:25:17 smithi157 bash[24585]: audit 2024-09-16T12:25:16.258583+0000 mgr.a (mgr.14373) 17646 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T12:25:18.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:25:17 smithi157 bash[24585]: cephadm 2024-09-16T12:25:16.260807+0000 mgr.a (mgr.14373) 17647 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T12:25:18.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:25:17 smithi157 bash[24585]: audit 2024-09-16T12:25:16.844081+0000 mgr.a (mgr.14373) 17648 : audit [DBG] from='client.379224 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:25:18.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:25:17 smithi086 bash[24289]: audit 2024-09-16T12:25:16.258583+0000 mgr.a (mgr.14373) 17646 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T12:25:18.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:25:17 smithi086 bash[24289]: cephadm 2024-09-16T12:25:16.260807+0000 mgr.a (mgr.14373) 17647 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T12:25:18.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:25:17 smithi086 bash[24289]: audit 2024-09-16T12:25:16.844081+0000 mgr.a (mgr.14373) 17648 : audit [DBG] from='client.379224 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:25:18.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:25:17 smithi047 bash[22744]: audit 2024-09-16T12:25:16.258583+0000 mgr.a (mgr.14373) 17646 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T12:25:18.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:25:17 smithi047 bash[22744]: cephadm 2024-09-16T12:25:16.260807+0000 mgr.a (mgr.14373) 17647 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T12:25:18.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:25:17 smithi047 bash[22744]: audit 2024-09-16T12:25:16.844081+0000 mgr.a (mgr.14373) 17648 : audit [DBG] from='client.379224 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:25:19.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:25:18 smithi157 bash[24585]: cluster 2024-09-16T12:25:17.302945+0000 mgr.a (mgr.14373) 17649 : cluster [DBG] pgmap v12240: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:25:19.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:25:18 smithi086 bash[24289]: cluster 2024-09-16T12:25:17.302945+0000 mgr.a (mgr.14373) 17649 : cluster [DBG] pgmap v12240: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:25:19.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:25:18 smithi047 bash[22744]: cluster 2024-09-16T12:25:17.302945+0000 mgr.a (mgr.14373) 17649 : cluster [DBG] pgmap v12240: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:25:21.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:25:20 smithi157 bash[24585]: cluster 2024-09-16T12:25:19.303849+0000 mgr.a (mgr.14373) 17650 : cluster [DBG] pgmap v12241: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T12:25:21.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:25:20 smithi086 bash[24289]: cluster 2024-09-16T12:25:19.303849+0000 mgr.a (mgr.14373) 17650 : cluster [DBG] pgmap v12241: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T12:25:21.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:25:20 smithi047 bash[22744]: cluster 2024-09-16T12:25:19.303849+0000 mgr.a (mgr.14373) 17650 : cluster [DBG] pgmap v12241: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T12:25:22.263 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:25:22.264 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:25:22.264 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:25:23.016 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:25:23.016 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:25:23.016 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:25:23.016 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:25:23.016 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:25:23.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:25:22 smithi157 bash[24585]: cluster 2024-09-16T12:25:21.304808+0000 mgr.a (mgr.14373) 17651 : cluster [DBG] pgmap v12242: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T12:25:23.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:25:22 smithi086 bash[24289]: cluster 2024-09-16T12:25:21.304808+0000 mgr.a (mgr.14373) 17651 : cluster [DBG] pgmap v12242: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T12:25:23.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:25:22 smithi047 bash[22744]: cluster 2024-09-16T12:25:21.304808+0000 mgr.a (mgr.14373) 17651 : cluster [DBG] pgmap v12242: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T12:25:24.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:25:23 smithi157 bash[24585]: audit 2024-09-16T12:25:22.593140+0000 mgr.a (mgr.14373) 17652 : audit [DBG] from='client.379299 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:25:24.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:25:23 smithi086 bash[24289]: audit 2024-09-16T12:25:22.593140+0000 mgr.a (mgr.14373) 17652 : audit [DBG] from='client.379299 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:25:24.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:25:23 smithi047 bash[22744]: audit 2024-09-16T12:25:22.593140+0000 mgr.a (mgr.14373) 17652 : audit [DBG] from='client.379299 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:25:25.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:25:24 smithi157 bash[24585]: cluster 2024-09-16T12:25:23.307589+0000 mgr.a (mgr.14373) 17653 : cluster [DBG] pgmap v12243: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:25:25.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:25:24 smithi086 bash[24289]: cluster 2024-09-16T12:25:23.307589+0000 mgr.a (mgr.14373) 17653 : cluster [DBG] pgmap v12243: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:25:25.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:25:24 smithi047 bash[22744]: cluster 2024-09-16T12:25:23.307589+0000 mgr.a (mgr.14373) 17653 : cluster [DBG] pgmap v12243: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:25:27.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:25:26 smithi157 bash[24585]: cluster 2024-09-16T12:25:25.308371+0000 mgr.a (mgr.14373) 17654 : cluster [DBG] pgmap v12244: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T12:25:27.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:25:26 smithi086 bash[24289]: cluster 2024-09-16T12:25:25.308371+0000 mgr.a (mgr.14373) 17654 : cluster [DBG] pgmap v12244: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T12:25:27.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:25:26 smithi047 bash[22744]: cluster 2024-09-16T12:25:25.308371+0000 mgr.a (mgr.14373) 17654 : cluster [DBG] pgmap v12244: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T12:25:28.017 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:25:28.018 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:25:28.018 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:25:28.799 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:25:28.799 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:25:28.799 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:25:28.799 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:25:28.799 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:25:29.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:25:28 smithi157 bash[24585]: cluster 2024-09-16T12:25:27.310391+0000 mgr.a (mgr.14373) 17655 : cluster [DBG] pgmap v12245: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.4 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:25:29.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:25:28 smithi086 bash[24289]: cluster 2024-09-16T12:25:27.310391+0000 mgr.a (mgr.14373) 17655 : cluster [DBG] pgmap v12245: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.4 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:25:29.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:25:28 smithi047 bash[22744]: cluster 2024-09-16T12:25:27.310391+0000 mgr.a (mgr.14373) 17655 : cluster [DBG] pgmap v12245: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.4 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:25:30.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:25:29 smithi157 bash[24585]: audit 2024-09-16T12:25:28.348103+0000 mgr.a (mgr.14373) 17656 : audit [DBG] from='client.379377 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:25:30.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:25:29 smithi086 bash[24289]: audit 2024-09-16T12:25:28.348103+0000 mgr.a (mgr.14373) 17656 : audit [DBG] from='client.379377 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:25:30.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:25:29 smithi047 bash[22744]: audit 2024-09-16T12:25:28.348103+0000 mgr.a (mgr.14373) 17656 : audit [DBG] from='client.379377 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:25:31.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:25:30 smithi157 bash[24585]: cluster 2024-09-16T12:25:29.311429+0000 mgr.a (mgr.14373) 17657 : cluster [DBG] pgmap v12246: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:25:31.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:25:30 smithi086 bash[24289]: cluster 2024-09-16T12:25:29.311429+0000 mgr.a (mgr.14373) 17657 : cluster [DBG] pgmap v12246: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:25:31.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:25:30 smithi047 bash[22744]: cluster 2024-09-16T12:25:29.311429+0000 mgr.a (mgr.14373) 17657 : cluster [DBG] pgmap v12246: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:25:33.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:25:32 smithi157 bash[24585]: cluster 2024-09-16T12:25:31.312265+0000 mgr.a (mgr.14373) 17658 : cluster [DBG] pgmap v12247: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:25:33.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:25:32 smithi086 bash[24289]: cluster 2024-09-16T12:25:31.312265+0000 mgr.a (mgr.14373) 17658 : cluster [DBG] pgmap v12247: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:25:33.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:25:32 smithi047 bash[22744]: cluster 2024-09-16T12:25:31.312265+0000 mgr.a (mgr.14373) 17658 : cluster [DBG] pgmap v12247: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:25:33.801 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:25:33.801 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:25:33.801 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:25:34.577 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:25:34.578 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:25:34.578 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:25:34.578 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:25:34.578 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:25:35.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:25:34 smithi157 bash[24585]: cluster 2024-09-16T12:25:33.314635+0000 mgr.a (mgr.14373) 17659 : cluster [DBG] pgmap v12248: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:25:35.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:25:34 smithi086 bash[24289]: cluster 2024-09-16T12:25:33.314635+0000 mgr.a (mgr.14373) 17659 : cluster [DBG] pgmap v12248: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:25:35.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:25:34 smithi047 bash[22744]: cluster 2024-09-16T12:25:33.314635+0000 mgr.a (mgr.14373) 17659 : cluster [DBG] pgmap v12248: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:25:36.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:25:35 smithi157 bash[24585]: audit 2024-09-16T12:25:34.132178+0000 mgr.a (mgr.14373) 17660 : audit [DBG] from='client.379455 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:25:36.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:25:35 smithi086 bash[24289]: audit 2024-09-16T12:25:34.132178+0000 mgr.a (mgr.14373) 17660 : audit [DBG] from='client.379455 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:25:36.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:25:35 smithi047 bash[22744]: audit 2024-09-16T12:25:34.132178+0000 mgr.a (mgr.14373) 17660 : audit [DBG] from='client.379455 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:25:37.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:25:36 smithi157 bash[24585]: cluster 2024-09-16T12:25:35.315706+0000 mgr.a (mgr.14373) 17661 : cluster [DBG] pgmap v12249: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:25:37.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:25:36 smithi086 bash[24289]: cluster 2024-09-16T12:25:35.315706+0000 mgr.a (mgr.14373) 17661 : cluster [DBG] pgmap v12249: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:25:37.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:25:36 smithi047 bash[22744]: cluster 2024-09-16T12:25:35.315706+0000 mgr.a (mgr.14373) 17661 : cluster [DBG] pgmap v12249: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:25:39.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:25:38 smithi157 bash[24585]: cluster 2024-09-16T12:25:37.317959+0000 mgr.a (mgr.14373) 17662 : cluster [DBG] pgmap v12250: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:25:39.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:25:38 smithi086 bash[24289]: cluster 2024-09-16T12:25:37.317959+0000 mgr.a (mgr.14373) 17662 : cluster [DBG] pgmap v12250: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:25:39.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:25:38 smithi047 bash[22744]: cluster 2024-09-16T12:25:37.317959+0000 mgr.a (mgr.14373) 17662 : cluster [DBG] pgmap v12250: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:25:39.579 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:25:39.580 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:25:39.580 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:25:40.384 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:25:40.384 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:25:40.384 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:25:40.385 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:25:40.385 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:25:41.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:25:40 smithi157 bash[24585]: cluster 2024-09-16T12:25:39.318744+0000 mgr.a (mgr.14373) 17663 : cluster [DBG] pgmap v12251: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:25:41.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:25:40 smithi157 bash[24585]: audit 2024-09-16T12:25:39.914061+0000 mgr.a (mgr.14373) 17664 : audit [DBG] from='client.379533 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:25:41.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:25:40 smithi086 bash[24289]: cluster 2024-09-16T12:25:39.318744+0000 mgr.a (mgr.14373) 17663 : cluster [DBG] pgmap v12251: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:25:41.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:25:40 smithi086 bash[24289]: audit 2024-09-16T12:25:39.914061+0000 mgr.a (mgr.14373) 17664 : audit [DBG] from='client.379533 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:25:41.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:25:40 smithi047 bash[22744]: cluster 2024-09-16T12:25:39.318744+0000 mgr.a (mgr.14373) 17663 : cluster [DBG] pgmap v12251: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:25:41.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:25:40 smithi047 bash[22744]: audit 2024-09-16T12:25:39.914061+0000 mgr.a (mgr.14373) 17664 : audit [DBG] from='client.379533 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:25:43.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:25:42 smithi157 bash[24585]: cluster 2024-09-16T12:25:41.319807+0000 mgr.a (mgr.14373) 17665 : cluster [DBG] pgmap v12252: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:25:43.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:25:42 smithi086 bash[24289]: cluster 2024-09-16T12:25:41.319807+0000 mgr.a (mgr.14373) 17665 : cluster [DBG] pgmap v12252: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:25:43.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:25:42 smithi047 bash[22744]: cluster 2024-09-16T12:25:41.319807+0000 mgr.a (mgr.14373) 17665 : cluster [DBG] pgmap v12252: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:25:45.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:25:44 smithi157 bash[24585]: cluster 2024-09-16T12:25:43.322067+0000 mgr.a (mgr.14373) 17666 : cluster [DBG] pgmap v12253: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:25:45.094 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:25:44 smithi047 bash[22744]: cluster 2024-09-16T12:25:43.322067+0000 mgr.a (mgr.14373) 17666 : cluster [DBG] pgmap v12253: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:25:45.094 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:25:44 smithi086 bash[24289]: cluster 2024-09-16T12:25:43.322067+0000 mgr.a (mgr.14373) 17666 : cluster [DBG] pgmap v12253: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:25:45.386 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:25:45.387 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:25:45.387 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:25:46.165 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:25:46.166 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:25:46.166 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:25:46.166 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:25:46.166 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:25:47.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:25:46 smithi157 bash[24585]: cluster 2024-09-16T12:25:45.322826+0000 mgr.a (mgr.14373) 17667 : cluster [DBG] pgmap v12254: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:25:47.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:25:46 smithi157 bash[24585]: audit 2024-09-16T12:25:45.720971+0000 mgr.a (mgr.14373) 17668 : audit [DBG] from='client.379605 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:25:47.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:25:46 smithi086 bash[24289]: cluster 2024-09-16T12:25:45.322826+0000 mgr.a (mgr.14373) 17667 : cluster [DBG] pgmap v12254: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:25:47.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:25:46 smithi086 bash[24289]: audit 2024-09-16T12:25:45.720971+0000 mgr.a (mgr.14373) 17668 : audit [DBG] from='client.379605 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:25:47.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:25:46 smithi047 bash[22744]: cluster 2024-09-16T12:25:45.322826+0000 mgr.a (mgr.14373) 17667 : cluster [DBG] pgmap v12254: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:25:47.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:25:46 smithi047 bash[22744]: audit 2024-09-16T12:25:45.720971+0000 mgr.a (mgr.14373) 17668 : audit [DBG] from='client.379605 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:25:49.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:25:48 smithi157 bash[24585]: cluster 2024-09-16T12:25:47.325173+0000 mgr.a (mgr.14373) 17669 : cluster [DBG] pgmap v12255: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:25:49.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:25:48 smithi086 bash[24289]: cluster 2024-09-16T12:25:47.325173+0000 mgr.a (mgr.14373) 17669 : cluster [DBG] pgmap v12255: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:25:49.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:25:48 smithi047 bash[22744]: cluster 2024-09-16T12:25:47.325173+0000 mgr.a (mgr.14373) 17669 : cluster [DBG] pgmap v12255: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:25:51.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:25:50 smithi157 bash[24585]: cluster 2024-09-16T12:25:49.325960+0000 mgr.a (mgr.14373) 17670 : cluster [DBG] pgmap v12256: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:25:51.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:25:50 smithi086 bash[24289]: cluster 2024-09-16T12:25:49.325960+0000 mgr.a (mgr.14373) 17670 : cluster [DBG] pgmap v12256: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:25:51.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:25:50 smithi047 bash[22744]: cluster 2024-09-16T12:25:49.325960+0000 mgr.a (mgr.14373) 17670 : cluster [DBG] pgmap v12256: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:25:51.167 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:25:51.167 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:25:51.167 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:25:51.944 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:25:51.945 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:25:51.945 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:25:51.945 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:25:51.945 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:25:53.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:25:52 smithi157 bash[24585]: cluster 2024-09-16T12:25:51.326628+0000 mgr.a (mgr.14373) 17671 : cluster [DBG] pgmap v12257: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:25:53.058 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:25:52 smithi157 bash[24585]: audit 2024-09-16T12:25:51.498839+0000 mgr.a (mgr.14373) 17672 : audit [DBG] from='client.379683 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:25:53.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:25:52 smithi086 bash[24289]: cluster 2024-09-16T12:25:51.326628+0000 mgr.a (mgr.14373) 17671 : cluster [DBG] pgmap v12257: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:25:53.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:25:52 smithi086 bash[24289]: audit 2024-09-16T12:25:51.498839+0000 mgr.a (mgr.14373) 17672 : audit [DBG] from='client.379683 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:25:53.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:25:52 smithi047 bash[22744]: cluster 2024-09-16T12:25:51.326628+0000 mgr.a (mgr.14373) 17671 : cluster [DBG] pgmap v12257: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:25:53.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:25:52 smithi047 bash[22744]: audit 2024-09-16T12:25:51.498839+0000 mgr.a (mgr.14373) 17672 : audit [DBG] from='client.379683 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:25:55.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:25:54 smithi157 bash[24585]: cluster 2024-09-16T12:25:53.329350+0000 mgr.a (mgr.14373) 17673 : cluster [DBG] pgmap v12258: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:25:55.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:25:54 smithi086 bash[24289]: cluster 2024-09-16T12:25:53.329350+0000 mgr.a (mgr.14373) 17673 : cluster [DBG] pgmap v12258: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:25:55.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:25:54 smithi047 bash[22744]: cluster 2024-09-16T12:25:53.329350+0000 mgr.a (mgr.14373) 17673 : cluster [DBG] pgmap v12258: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:25:56.946 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:25:56.947 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:25:56.947 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:25:57.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:25:56 smithi157 bash[24585]: cluster 2024-09-16T12:25:55.330098+0000 mgr.a (mgr.14373) 17674 : cluster [DBG] pgmap v12259: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:25:57.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:25:56 smithi086 bash[24289]: cluster 2024-09-16T12:25:55.330098+0000 mgr.a (mgr.14373) 17674 : cluster [DBG] pgmap v12259: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:25:57.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:25:56 smithi047 bash[22744]: cluster 2024-09-16T12:25:55.330098+0000 mgr.a (mgr.14373) 17674 : cluster [DBG] pgmap v12259: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:25:57.709 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:25:57.709 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:25:57.709 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:25:57.709 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:25:57.710 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:25:59.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:25:58 smithi157 bash[24585]: audit 2024-09-16T12:25:57.276020+0000 mgr.a (mgr.14373) 17675 : audit [DBG] from='client.379758 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:25:59.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:25:58 smithi157 bash[24585]: cluster 2024-09-16T12:25:57.331892+0000 mgr.a (mgr.14373) 17676 : cluster [DBG] pgmap v12260: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:25:59.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:25:58 smithi086 bash[24289]: audit 2024-09-16T12:25:57.276020+0000 mgr.a (mgr.14373) 17675 : audit [DBG] from='client.379758 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:25:59.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:25:58 smithi086 bash[24289]: cluster 2024-09-16T12:25:57.331892+0000 mgr.a (mgr.14373) 17676 : cluster [DBG] pgmap v12260: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:25:59.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:25:58 smithi047 bash[22744]: audit 2024-09-16T12:25:57.276020+0000 mgr.a (mgr.14373) 17675 : audit [DBG] from='client.379758 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:25:59.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:25:58 smithi047 bash[22744]: cluster 2024-09-16T12:25:57.331892+0000 mgr.a (mgr.14373) 17676 : cluster [DBG] pgmap v12260: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:26:01.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:26:00 smithi157 bash[24585]: cluster 2024-09-16T12:25:59.332760+0000 mgr.a (mgr.14373) 17677 : cluster [DBG] pgmap v12261: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:26:01.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:26:00 smithi086 bash[24289]: cluster 2024-09-16T12:25:59.332760+0000 mgr.a (mgr.14373) 17677 : cluster [DBG] pgmap v12261: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:26:01.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:26:00 smithi047 bash[22744]: cluster 2024-09-16T12:25:59.332760+0000 mgr.a (mgr.14373) 17677 : cluster [DBG] pgmap v12261: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:26:02.711 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:26:02.711 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:26:02.712 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:26:03.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:26:02 smithi157 bash[24585]: cluster 2024-09-16T12:26:01.333548+0000 mgr.a (mgr.14373) 17678 : cluster [DBG] pgmap v12262: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T12:26:03.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:26:02 smithi086 bash[24289]: cluster 2024-09-16T12:26:01.333548+0000 mgr.a (mgr.14373) 17678 : cluster [DBG] pgmap v12262: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T12:26:03.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:26:02 smithi047 bash[22744]: cluster 2024-09-16T12:26:01.333548+0000 mgr.a (mgr.14373) 17678 : cluster [DBG] pgmap v12262: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T12:26:03.489 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:26:03.490 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:26:03.490 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:26:03.490 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:26:03.490 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:26:04.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:26:03 smithi157 bash[24585]: audit 2024-09-16T12:26:03.045725+0000 mgr.a (mgr.14373) 17679 : audit [DBG] from='client.379836 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:26:04.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:26:03 smithi086 bash[24289]: audit 2024-09-16T12:26:03.045725+0000 mgr.a (mgr.14373) 17679 : audit [DBG] from='client.379836 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:26:04.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:26:03 smithi047 bash[22744]: audit 2024-09-16T12:26:03.045725+0000 mgr.a (mgr.14373) 17679 : audit [DBG] from='client.379836 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:26:05.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:26:04 smithi157 bash[24585]: cluster 2024-09-16T12:26:03.335675+0000 mgr.a (mgr.14373) 17680 : cluster [DBG] pgmap v12263: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:26:05.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:26:04 smithi086 bash[24289]: cluster 2024-09-16T12:26:03.335675+0000 mgr.a (mgr.14373) 17680 : cluster [DBG] pgmap v12263: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:26:05.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:26:04 smithi047 bash[22744]: cluster 2024-09-16T12:26:03.335675+0000 mgr.a (mgr.14373) 17680 : cluster [DBG] pgmap v12263: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:26:07.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:26:06 smithi157 bash[24585]: cluster 2024-09-16T12:26:05.336726+0000 mgr.a (mgr.14373) 17681 : cluster [DBG] pgmap v12264: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:26:07.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:26:06 smithi086 bash[24289]: cluster 2024-09-16T12:26:05.336726+0000 mgr.a (mgr.14373) 17681 : cluster [DBG] pgmap v12264: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:26:07.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:26:06 smithi047 bash[22744]: cluster 2024-09-16T12:26:05.336726+0000 mgr.a (mgr.14373) 17681 : cluster [DBG] pgmap v12264: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:26:08.491 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:26:08.492 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:26:08.492 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:26:09.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:26:08 smithi157 bash[24585]: cluster 2024-09-16T12:26:07.339032+0000 mgr.a (mgr.14373) 17682 : cluster [DBG] pgmap v12265: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:26:09.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:26:08 smithi086 bash[24289]: cluster 2024-09-16T12:26:07.339032+0000 mgr.a (mgr.14373) 17682 : cluster [DBG] pgmap v12265: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:26:09.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:26:08 smithi047 bash[22744]: cluster 2024-09-16T12:26:07.339032+0000 mgr.a (mgr.14373) 17682 : cluster [DBG] pgmap v12265: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:26:09.264 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:26:09.264 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:26:09.264 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:26:09.264 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:26:09.264 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:26:10.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:26:09 smithi157 bash[24585]: audit 2024-09-16T12:26:08.828268+0000 mgr.a (mgr.14373) 17683 : audit [DBG] from='client.379914 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:26:10.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:26:09 smithi086 bash[24289]: audit 2024-09-16T12:26:08.828268+0000 mgr.a (mgr.14373) 17683 : audit [DBG] from='client.379914 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:26:10.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:26:09 smithi047 bash[22744]: audit 2024-09-16T12:26:08.828268+0000 mgr.a (mgr.14373) 17683 : audit [DBG] from='client.379914 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:26:11.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:26:10 smithi157 bash[24585]: cluster 2024-09-16T12:26:09.339671+0000 mgr.a (mgr.14373) 17684 : cluster [DBG] pgmap v12266: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:26:11.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:26:10 smithi086 bash[24289]: cluster 2024-09-16T12:26:09.339671+0000 mgr.a (mgr.14373) 17684 : cluster [DBG] pgmap v12266: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:26:11.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:26:10 smithi047 bash[22744]: cluster 2024-09-16T12:26:09.339671+0000 mgr.a (mgr.14373) 17684 : cluster [DBG] pgmap v12266: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:26:13.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:26:12 smithi157 bash[24585]: cluster 2024-09-16T12:26:11.340383+0000 mgr.a (mgr.14373) 17685 : cluster [DBG] pgmap v12267: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:26:13.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:26:12 smithi086 bash[24289]: cluster 2024-09-16T12:26:11.340383+0000 mgr.a (mgr.14373) 17685 : cluster [DBG] pgmap v12267: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:26:13.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:26:12 smithi047 bash[22744]: cluster 2024-09-16T12:26:11.340383+0000 mgr.a (mgr.14373) 17685 : cluster [DBG] pgmap v12267: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:26:14.263 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:26:14.263 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:26:14.264 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:26:15.007 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:26:15.007 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:26:15.008 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:26:15.008 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:26:15.008 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:26:15.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:26:14 smithi157 bash[24585]: cluster 2024-09-16T12:26:13.342606+0000 mgr.a (mgr.14373) 17686 : cluster [DBG] pgmap v12268: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:26:15.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:26:14 smithi086 bash[24289]: cluster 2024-09-16T12:26:13.342606+0000 mgr.a (mgr.14373) 17686 : cluster [DBG] pgmap v12268: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:26:15.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:26:14 smithi047 bash[22744]: cluster 2024-09-16T12:26:13.342606+0000 mgr.a (mgr.14373) 17686 : cluster [DBG] pgmap v12268: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:26:16.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:26:15 smithi086 bash[24289]: audit 2024-09-16T12:26:14.592721+0000 mgr.a (mgr.14373) 17687 : audit [DBG] from='client.379989 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:26:16.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:26:15 smithi047 bash[22744]: audit 2024-09-16T12:26:14.592721+0000 mgr.a (mgr.14373) 17687 : audit [DBG] from='client.379989 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:26:16.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:26:15 smithi157 bash[24585]: audit 2024-09-16T12:26:14.592721+0000 mgr.a (mgr.14373) 17687 : audit [DBG] from='client.379989 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:26:17.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:26:16 smithi086 bash[24289]: cluster 2024-09-16T12:26:15.343491+0000 mgr.a (mgr.14373) 17688 : cluster [DBG] pgmap v12269: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:26:17.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:26:16 smithi086 bash[24289]: audit 2024-09-16T12:26:16.312505+0000 mon.b (mon.2) 1602 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T12:26:17.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:26:16 smithi047 bash[22744]: cluster 2024-09-16T12:26:15.343491+0000 mgr.a (mgr.14373) 17688 : cluster [DBG] pgmap v12269: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:26:17.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:26:16 smithi047 bash[22744]: audit 2024-09-16T12:26:16.312505+0000 mon.b (mon.2) 1602 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T12:26:17.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:26:16 smithi157 bash[24585]: cluster 2024-09-16T12:26:15.343491+0000 mgr.a (mgr.14373) 17688 : cluster [DBG] pgmap v12269: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:26:17.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:26:16 smithi157 bash[24585]: audit 2024-09-16T12:26:16.312505+0000 mon.b (mon.2) 1602 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T12:26:18.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:26:17 smithi086 bash[24289]: audit 2024-09-16T12:26:17.142439+0000 mon.b (mon.2) 1603 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T12:26:18.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:26:17 smithi086 bash[24289]: audit 2024-09-16T12:26:17.144261+0000 mon.b (mon.2) 1604 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T12:26:18.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:26:17 smithi086 bash[24289]: audit 2024-09-16T12:26:17.155267+0000 mon.a (mon.0) 1625 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:26:18.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:26:17 smithi086 bash[24289]: audit 2024-09-16T12:26:17.160785+0000 mon.b (mon.2) 1605 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:26:18.093 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 12:26:17 smithi047 bash[22994]: debug 2024-09-16T12:26:17.903+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T12:26:18.093 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 12:26:17 smithi047 bash[22994]: debug 2024-09-16T12:26:17.903+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T12:26:18.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:26:17 smithi047 bash[22744]: audit 2024-09-16T12:26:17.142439+0000 mon.b (mon.2) 1603 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T12:26:18.094 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:26:17 smithi047 bash[22744]: audit 2024-09-16T12:26:17.144261+0000 mon.b (mon.2) 1604 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T12:26:18.094 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:26:17 smithi047 bash[22744]: audit 2024-09-16T12:26:17.155267+0000 mon.a (mon.0) 1625 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:26:18.094 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:26:17 smithi047 bash[22744]: audit 2024-09-16T12:26:17.160785+0000 mon.b (mon.2) 1605 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:26:18.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:26:17 smithi157 bash[24585]: audit 2024-09-16T12:26:17.142439+0000 mon.b (mon.2) 1603 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T12:26:18.308 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:26:17 smithi157 bash[24585]: audit 2024-09-16T12:26:17.144261+0000 mon.b (mon.2) 1604 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T12:26:18.308 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:26:17 smithi157 bash[24585]: audit 2024-09-16T12:26:17.155267+0000 mon.a (mon.0) 1625 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:26:18.308 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:26:17 smithi157 bash[24585]: audit 2024-09-16T12:26:17.160785+0000 mon.b (mon.2) 1605 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:26:19.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:26:18 smithi086 bash[24289]: audit 2024-09-16T12:26:17.163237+0000 mgr.a (mgr.14373) 17689 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:26:19.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:26:18 smithi086 bash[24289]: cluster 2024-09-16T12:26:17.344747+0000 mgr.a (mgr.14373) 17690 : cluster [DBG] pgmap v12270: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:26:19.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:26:18 smithi086 bash[24289]: audit 2024-09-16T12:26:17.907778+0000 mgr.a (mgr.14373) 17691 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T12:26:19.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:26:18 smithi086 bash[24289]: cephadm 2024-09-16T12:26:17.909775+0000 mgr.a (mgr.14373) 17692 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T12:26:19.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:26:18 smithi047 bash[22744]: audit 2024-09-16T12:26:17.163237+0000 mgr.a (mgr.14373) 17689 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:26:19.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:26:18 smithi047 bash[22744]: cluster 2024-09-16T12:26:17.344747+0000 mgr.a (mgr.14373) 17690 : cluster [DBG] pgmap v12270: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:26:19.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:26:18 smithi047 bash[22744]: audit 2024-09-16T12:26:17.907778+0000 mgr.a (mgr.14373) 17691 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T12:26:19.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:26:18 smithi047 bash[22744]: cephadm 2024-09-16T12:26:17.909775+0000 mgr.a (mgr.14373) 17692 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T12:26:19.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:26:18 smithi157 bash[24585]: audit 2024-09-16T12:26:17.163237+0000 mgr.a (mgr.14373) 17689 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:26:19.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:26:18 smithi157 bash[24585]: cluster 2024-09-16T12:26:17.344747+0000 mgr.a (mgr.14373) 17690 : cluster [DBG] pgmap v12270: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:26:19.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:26:18 smithi157 bash[24585]: audit 2024-09-16T12:26:17.907778+0000 mgr.a (mgr.14373) 17691 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T12:26:19.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:26:18 smithi157 bash[24585]: cephadm 2024-09-16T12:26:17.909775+0000 mgr.a (mgr.14373) 17692 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T12:26:20.009 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:26:20.009 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:26:20.009 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:26:20.772 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:26:20.772 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:26:20.772 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:26:20.772 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:26:20.773 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:26:21.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:26:20 smithi047 bash[22744]: cluster 2024-09-16T12:26:19.345726+0000 mgr.a (mgr.14373) 17693 : cluster [DBG] pgmap v12271: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:26:21.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:26:20 smithi157 bash[24585]: cluster 2024-09-16T12:26:19.345726+0000 mgr.a (mgr.14373) 17693 : cluster [DBG] pgmap v12271: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:26:21.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:26:20 smithi086 bash[24289]: cluster 2024-09-16T12:26:19.345726+0000 mgr.a (mgr.14373) 17693 : cluster [DBG] pgmap v12271: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:26:22.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:26:21 smithi047 bash[22744]: audit 2024-09-16T12:26:20.338123+0000 mgr.a (mgr.14373) 17694 : audit [DBG] from='client.380175 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:26:22.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:26:21 smithi157 bash[24585]: audit 2024-09-16T12:26:20.338123+0000 mgr.a (mgr.14373) 17694 : audit [DBG] from='client.380175 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:26:22.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:26:21 smithi086 bash[24289]: audit 2024-09-16T12:26:20.338123+0000 mgr.a (mgr.14373) 17694 : audit [DBG] from='client.380175 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:26:23.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:26:22 smithi047 bash[22744]: cluster 2024-09-16T12:26:21.346748+0000 mgr.a (mgr.14373) 17695 : cluster [DBG] pgmap v12272: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:26:23.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:26:22 smithi157 bash[24585]: cluster 2024-09-16T12:26:21.346748+0000 mgr.a (mgr.14373) 17695 : cluster [DBG] pgmap v12272: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:26:23.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:26:22 smithi086 bash[24289]: cluster 2024-09-16T12:26:21.346748+0000 mgr.a (mgr.14373) 17695 : cluster [DBG] pgmap v12272: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:26:25.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:26:24 smithi047 bash[22744]: cluster 2024-09-16T12:26:23.349084+0000 mgr.a (mgr.14373) 17696 : cluster [DBG] pgmap v12273: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:26:25.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:26:24 smithi157 bash[24585]: cluster 2024-09-16T12:26:23.349084+0000 mgr.a (mgr.14373) 17696 : cluster [DBG] pgmap v12273: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:26:25.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:26:24 smithi086 bash[24289]: cluster 2024-09-16T12:26:23.349084+0000 mgr.a (mgr.14373) 17696 : cluster [DBG] pgmap v12273: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:26:25.774 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:26:25.774 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:26:25.774 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:26:26.546 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:26:26.547 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:26:26.547 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:26:26.547 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:26:26.547 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:26:27.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:26:26 smithi047 bash[22744]: cluster 2024-09-16T12:26:25.350029+0000 mgr.a (mgr.14373) 17697 : cluster [DBG] pgmap v12274: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:26:27.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:26:26 smithi157 bash[24585]: cluster 2024-09-16T12:26:25.350029+0000 mgr.a (mgr.14373) 17697 : cluster [DBG] pgmap v12274: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:26:27.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:26:26 smithi086 bash[24289]: cluster 2024-09-16T12:26:25.350029+0000 mgr.a (mgr.14373) 17697 : cluster [DBG] pgmap v12274: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:26:28.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:26:27 smithi157 bash[24585]: audit 2024-09-16T12:26:26.110936+0000 mgr.a (mgr.14373) 17698 : audit [DBG] from='client.380253 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:26:28.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:26:27 smithi086 bash[24289]: audit 2024-09-16T12:26:26.110936+0000 mgr.a (mgr.14373) 17698 : audit [DBG] from='client.380253 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:26:28.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:26:27 smithi047 bash[22744]: audit 2024-09-16T12:26:26.110936+0000 mgr.a (mgr.14373) 17698 : audit [DBG] from='client.380253 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:26:29.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:26:28 smithi157 bash[24585]: cluster 2024-09-16T12:26:27.352557+0000 mgr.a (mgr.14373) 17699 : cluster [DBG] pgmap v12275: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:26:29.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:26:28 smithi086 bash[24289]: cluster 2024-09-16T12:26:27.352557+0000 mgr.a (mgr.14373) 17699 : cluster [DBG] pgmap v12275: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:26:29.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:26:28 smithi047 bash[22744]: cluster 2024-09-16T12:26:27.352557+0000 mgr.a (mgr.14373) 17699 : cluster [DBG] pgmap v12275: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:26:31.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:26:30 smithi157 bash[24585]: cluster 2024-09-16T12:26:29.353339+0000 mgr.a (mgr.14373) 17700 : cluster [DBG] pgmap v12276: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T12:26:31.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:26:30 smithi086 bash[24289]: cluster 2024-09-16T12:26:29.353339+0000 mgr.a (mgr.14373) 17700 : cluster [DBG] pgmap v12276: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T12:26:31.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:26:30 smithi047 bash[22744]: cluster 2024-09-16T12:26:29.353339+0000 mgr.a (mgr.14373) 17700 : cluster [DBG] pgmap v12276: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T12:26:31.548 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:26:31.549 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:26:31.549 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:26:32.333 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:26:32.333 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:26:32.333 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:26:32.333 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:26:32.333 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:26:33.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:26:32 smithi157 bash[24585]: cluster 2024-09-16T12:26:31.354114+0000 mgr.a (mgr.14373) 17701 : cluster [DBG] pgmap v12277: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T12:26:33.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:26:32 smithi157 bash[24585]: audit 2024-09-16T12:26:31.882077+0000 mgr.a (mgr.14373) 17702 : audit [DBG] from='client.380328 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:26:33.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:26:32 smithi086 bash[24289]: cluster 2024-09-16T12:26:31.354114+0000 mgr.a (mgr.14373) 17701 : cluster [DBG] pgmap v12277: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T12:26:33.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:26:32 smithi086 bash[24289]: audit 2024-09-16T12:26:31.882077+0000 mgr.a (mgr.14373) 17702 : audit [DBG] from='client.380328 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:26:33.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:26:32 smithi047 bash[22744]: cluster 2024-09-16T12:26:31.354114+0000 mgr.a (mgr.14373) 17701 : cluster [DBG] pgmap v12277: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T12:26:33.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:26:32 smithi047 bash[22744]: audit 2024-09-16T12:26:31.882077+0000 mgr.a (mgr.14373) 17702 : audit [DBG] from='client.380328 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:26:35.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:26:34 smithi157 bash[24585]: cluster 2024-09-16T12:26:33.356897+0000 mgr.a (mgr.14373) 17703 : cluster [DBG] pgmap v12278: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:26:35.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:26:34 smithi086 bash[24289]: cluster 2024-09-16T12:26:33.356897+0000 mgr.a (mgr.14373) 17703 : cluster [DBG] pgmap v12278: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:26:35.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:26:34 smithi047 bash[22744]: cluster 2024-09-16T12:26:33.356897+0000 mgr.a (mgr.14373) 17703 : cluster [DBG] pgmap v12278: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:26:37.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:26:36 smithi157 bash[24585]: cluster 2024-09-16T12:26:35.357734+0000 mgr.a (mgr.14373) 17704 : cluster [DBG] pgmap v12279: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:26:37.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:26:36 smithi086 bash[24289]: cluster 2024-09-16T12:26:35.357734+0000 mgr.a (mgr.14373) 17704 : cluster [DBG] pgmap v12279: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:26:37.334 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:26:37.335 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:26:37.335 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:26:37.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:26:36 smithi047 bash[22744]: cluster 2024-09-16T12:26:35.357734+0000 mgr.a (mgr.14373) 17704 : cluster [DBG] pgmap v12279: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:26:38.127 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:26:38.128 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:26:38.128 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:26:38.128 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:26:38.128 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:26:39.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:26:38 smithi157 bash[24585]: cluster 2024-09-16T12:26:37.359321+0000 mgr.a (mgr.14373) 17705 : cluster [DBG] pgmap v12280: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:26:39.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:26:38 smithi157 bash[24585]: audit 2024-09-16T12:26:37.670904+0000 mgr.a (mgr.14373) 17706 : audit [DBG] from='client.380403 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:26:39.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:26:38 smithi086 bash[24289]: cluster 2024-09-16T12:26:37.359321+0000 mgr.a (mgr.14373) 17705 : cluster [DBG] pgmap v12280: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:26:39.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:26:38 smithi086 bash[24289]: audit 2024-09-16T12:26:37.670904+0000 mgr.a (mgr.14373) 17706 : audit [DBG] from='client.380403 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:26:39.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:26:38 smithi047 bash[22744]: cluster 2024-09-16T12:26:37.359321+0000 mgr.a (mgr.14373) 17705 : cluster [DBG] pgmap v12280: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:26:39.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:26:38 smithi047 bash[22744]: audit 2024-09-16T12:26:37.670904+0000 mgr.a (mgr.14373) 17706 : audit [DBG] from='client.380403 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:26:41.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:26:40 smithi157 bash[24585]: cluster 2024-09-16T12:26:39.360387+0000 mgr.a (mgr.14373) 17707 : cluster [DBG] pgmap v12281: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-16T12:26:41.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:26:40 smithi086 bash[24289]: cluster 2024-09-16T12:26:39.360387+0000 mgr.a (mgr.14373) 17707 : cluster [DBG] pgmap v12281: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-16T12:26:41.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:26:40 smithi047 bash[22744]: cluster 2024-09-16T12:26:39.360387+0000 mgr.a (mgr.14373) 17707 : cluster [DBG] pgmap v12281: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-16T12:26:43.129 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:26:43.130 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:26:43.130 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:26:43.308 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:26:42 smithi157 bash[24585]: cluster 2024-09-16T12:26:41.361226+0000 mgr.a (mgr.14373) 17708 : cluster [DBG] pgmap v12282: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-16T12:26:43.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:26:42 smithi086 bash[24289]: cluster 2024-09-16T12:26:41.361226+0000 mgr.a (mgr.14373) 17708 : cluster [DBG] pgmap v12282: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-16T12:26:43.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:26:42 smithi047 bash[22744]: cluster 2024-09-16T12:26:41.361226+0000 mgr.a (mgr.14373) 17708 : cluster [DBG] pgmap v12282: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-16T12:26:43.918 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:26:43.919 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:26:43.919 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:26:43.919 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:26:43.919 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:26:45.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:26:44 smithi157 bash[24585]: cluster 2024-09-16T12:26:43.363383+0000 mgr.a (mgr.14373) 17709 : cluster [DBG] pgmap v12283: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-16T12:26:45.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:26:44 smithi157 bash[24585]: audit 2024-09-16T12:26:43.465565+0000 mgr.a (mgr.14373) 17710 : audit [DBG] from='client.380481 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:26:45.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:26:44 smithi086 bash[24289]: cluster 2024-09-16T12:26:43.363383+0000 mgr.a (mgr.14373) 17709 : cluster [DBG] pgmap v12283: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-16T12:26:45.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:26:44 smithi086 bash[24289]: audit 2024-09-16T12:26:43.465565+0000 mgr.a (mgr.14373) 17710 : audit [DBG] from='client.380481 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:26:45.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:26:44 smithi047 bash[22744]: cluster 2024-09-16T12:26:43.363383+0000 mgr.a (mgr.14373) 17709 : cluster [DBG] pgmap v12283: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-16T12:26:45.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:26:44 smithi047 bash[22744]: audit 2024-09-16T12:26:43.465565+0000 mgr.a (mgr.14373) 17710 : audit [DBG] from='client.380481 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:26:47.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:26:46 smithi157 bash[24585]: cluster 2024-09-16T12:26:45.364499+0000 mgr.a (mgr.14373) 17711 : cluster [DBG] pgmap v12284: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:26:47.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:26:46 smithi086 bash[24289]: cluster 2024-09-16T12:26:45.364499+0000 mgr.a (mgr.14373) 17711 : cluster [DBG] pgmap v12284: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:26:47.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:26:46 smithi047 bash[22744]: cluster 2024-09-16T12:26:45.364499+0000 mgr.a (mgr.14373) 17711 : cluster [DBG] pgmap v12284: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:26:48.920 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:26:48.920 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:26:48.921 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:26:49.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:26:48 smithi157 bash[24585]: cluster 2024-09-16T12:26:47.366989+0000 mgr.a (mgr.14373) 17712 : cluster [DBG] pgmap v12285: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:26:49.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:26:48 smithi086 bash[24289]: cluster 2024-09-16T12:26:47.366989+0000 mgr.a (mgr.14373) 17712 : cluster [DBG] pgmap v12285: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:26:49.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:26:48 smithi047 bash[22744]: cluster 2024-09-16T12:26:47.366989+0000 mgr.a (mgr.14373) 17712 : cluster [DBG] pgmap v12285: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:26:49.681 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:26:49.681 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:26:49.681 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:26:49.681 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:26:49.681 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:26:51.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:26:50 smithi157 bash[24585]: audit 2024-09-16T12:26:49.251296+0000 mgr.a (mgr.14373) 17713 : audit [DBG] from='client.380556 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:26:51.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:26:50 smithi157 bash[24585]: cluster 2024-09-16T12:26:49.367586+0000 mgr.a (mgr.14373) 17714 : cluster [DBG] pgmap v12286: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:26:51.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:26:50 smithi086 bash[24289]: audit 2024-09-16T12:26:49.251296+0000 mgr.a (mgr.14373) 17713 : audit [DBG] from='client.380556 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:26:51.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:26:50 smithi086 bash[24289]: cluster 2024-09-16T12:26:49.367586+0000 mgr.a (mgr.14373) 17714 : cluster [DBG] pgmap v12286: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:26:51.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:26:50 smithi047 bash[22744]: audit 2024-09-16T12:26:49.251296+0000 mgr.a (mgr.14373) 17713 : audit [DBG] from='client.380556 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:26:51.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:26:50 smithi047 bash[22744]: cluster 2024-09-16T12:26:49.367586+0000 mgr.a (mgr.14373) 17714 : cluster [DBG] pgmap v12286: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:26:53.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:26:52 smithi157 bash[24585]: cluster 2024-09-16T12:26:51.368467+0000 mgr.a (mgr.14373) 17715 : cluster [DBG] pgmap v12287: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:26:53.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:26:52 smithi086 bash[24289]: cluster 2024-09-16T12:26:51.368467+0000 mgr.a (mgr.14373) 17715 : cluster [DBG] pgmap v12287: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:26:53.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:26:52 smithi047 bash[22744]: cluster 2024-09-16T12:26:51.368467+0000 mgr.a (mgr.14373) 17715 : cluster [DBG] pgmap v12287: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:26:54.682 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:26:54.683 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:26:54.683 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:26:55.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:26:54 smithi157 bash[24585]: cluster 2024-09-16T12:26:53.370760+0000 mgr.a (mgr.14373) 17716 : cluster [DBG] pgmap v12288: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:26:55.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:26:54 smithi086 bash[24289]: cluster 2024-09-16T12:26:53.370760+0000 mgr.a (mgr.14373) 17716 : cluster [DBG] pgmap v12288: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:26:55.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:26:54 smithi047 bash[22744]: cluster 2024-09-16T12:26:53.370760+0000 mgr.a (mgr.14373) 17716 : cluster [DBG] pgmap v12288: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:26:55.441 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:26:55.441 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:26:55.441 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:26:55.442 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:26:55.442 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:26:56.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:26:55 smithi157 bash[24585]: audit 2024-09-16T12:26:55.015166+0000 mgr.a (mgr.14373) 17717 : audit [DBG] from='client.380634 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:26:56.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:26:55 smithi086 bash[24289]: audit 2024-09-16T12:26:55.015166+0000 mgr.a (mgr.14373) 17717 : audit [DBG] from='client.380634 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:26:56.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:26:55 smithi047 bash[22744]: audit 2024-09-16T12:26:55.015166+0000 mgr.a (mgr.14373) 17717 : audit [DBG] from='client.380634 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:26:57.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:26:56 smithi157 bash[24585]: cluster 2024-09-16T12:26:55.371294+0000 mgr.a (mgr.14373) 17718 : cluster [DBG] pgmap v12289: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:26:57.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:26:56 smithi086 bash[24289]: cluster 2024-09-16T12:26:55.371294+0000 mgr.a (mgr.14373) 17718 : cluster [DBG] pgmap v12289: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:26:57.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:26:56 smithi047 bash[22744]: cluster 2024-09-16T12:26:55.371294+0000 mgr.a (mgr.14373) 17718 : cluster [DBG] pgmap v12289: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:26:58.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:26:58 smithi157 bash[24585]: cluster 2024-09-16T12:26:57.373508+0000 mgr.a (mgr.14373) 17719 : cluster [DBG] pgmap v12290: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:26:58.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:26:58 smithi086 bash[24289]: cluster 2024-09-16T12:26:57.373508+0000 mgr.a (mgr.14373) 17719 : cluster [DBG] pgmap v12290: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:26:58.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:26:58 smithi047 bash[22744]: cluster 2024-09-16T12:26:57.373508+0000 mgr.a (mgr.14373) 17719 : cluster [DBG] pgmap v12290: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:27:00.443 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:27:00.443 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:27:00.444 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:27:00.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:27:00 smithi157 bash[24585]: cluster 2024-09-16T12:26:59.374253+0000 mgr.a (mgr.14373) 17720 : cluster [DBG] pgmap v12291: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:27:00.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:27:00 smithi086 bash[24289]: cluster 2024-09-16T12:26:59.374253+0000 mgr.a (mgr.14373) 17720 : cluster [DBG] pgmap v12291: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:27:00.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:27:00 smithi047 bash[22744]: cluster 2024-09-16T12:26:59.374253+0000 mgr.a (mgr.14373) 17720 : cluster [DBG] pgmap v12291: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:27:01.191 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:27:01.191 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:27:01.192 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:27:01.192 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:27:01.192 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:27:01.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:27:01 smithi157 bash[24585]: audit 2024-09-16T12:27:00.771092+0000 mgr.a (mgr.14373) 17721 : audit [DBG] from='client.380712 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:27:01.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:27:01 smithi086 bash[24289]: audit 2024-09-16T12:27:00.771092+0000 mgr.a (mgr.14373) 17721 : audit [DBG] from='client.380712 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:27:01.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:27:01 smithi047 bash[22744]: audit 2024-09-16T12:27:00.771092+0000 mgr.a (mgr.14373) 17721 : audit [DBG] from='client.380712 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:27:02.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:27:02 smithi157 bash[24585]: cluster 2024-09-16T12:27:01.375216+0000 mgr.a (mgr.14373) 17722 : cluster [DBG] pgmap v12292: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:27:02.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:27:02 smithi086 bash[24289]: cluster 2024-09-16T12:27:01.375216+0000 mgr.a (mgr.14373) 17722 : cluster [DBG] pgmap v12292: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:27:02.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:27:02 smithi047 bash[22744]: cluster 2024-09-16T12:27:01.375216+0000 mgr.a (mgr.14373) 17722 : cluster [DBG] pgmap v12292: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:27:04.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:27:04 smithi157 bash[24585]: cluster 2024-09-16T12:27:03.377457+0000 mgr.a (mgr.14373) 17723 : cluster [DBG] pgmap v12293: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:27:04.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:27:04 smithi086 bash[24289]: cluster 2024-09-16T12:27:03.377457+0000 mgr.a (mgr.14373) 17723 : cluster [DBG] pgmap v12293: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:27:04.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:27:04 smithi047 bash[22744]: cluster 2024-09-16T12:27:03.377457+0000 mgr.a (mgr.14373) 17723 : cluster [DBG] pgmap v12293: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:27:06.193 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:27:06.194 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:27:06.194 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:27:06.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:27:06 smithi157 bash[24585]: cluster 2024-09-16T12:27:05.378231+0000 mgr.a (mgr.14373) 17724 : cluster [DBG] pgmap v12294: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:27:06.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:27:06 smithi086 bash[24289]: cluster 2024-09-16T12:27:05.378231+0000 mgr.a (mgr.14373) 17724 : cluster [DBG] pgmap v12294: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:27:06.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:27:06 smithi047 bash[22744]: cluster 2024-09-16T12:27:05.378231+0000 mgr.a (mgr.14373) 17724 : cluster [DBG] pgmap v12294: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:27:06.961 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:27:06.961 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:27:06.961 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:27:06.962 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:27:06.962 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:27:07.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:27:07 smithi157 bash[24585]: audit 2024-09-16T12:27:06.526955+0000 mgr.a (mgr.14373) 17725 : audit [DBG] from='client.380790 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:27:07.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:27:07 smithi086 bash[24289]: audit 2024-09-16T12:27:06.526955+0000 mgr.a (mgr.14373) 17725 : audit [DBG] from='client.380790 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:27:07.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:27:07 smithi047 bash[22744]: audit 2024-09-16T12:27:06.526955+0000 mgr.a (mgr.14373) 17725 : audit [DBG] from='client.380790 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:27:08.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:27:08 smithi157 bash[24585]: cluster 2024-09-16T12:27:07.380960+0000 mgr.a (mgr.14373) 17726 : cluster [DBG] pgmap v12295: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:27:08.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:27:08 smithi086 bash[24289]: cluster 2024-09-16T12:27:07.380960+0000 mgr.a (mgr.14373) 17726 : cluster [DBG] pgmap v12295: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:27:08.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:27:08 smithi047 bash[22744]: cluster 2024-09-16T12:27:07.380960+0000 mgr.a (mgr.14373) 17726 : cluster [DBG] pgmap v12295: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:27:10.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:27:10 smithi157 bash[24585]: cluster 2024-09-16T12:27:09.381788+0000 mgr.a (mgr.14373) 17727 : cluster [DBG] pgmap v12296: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:27:10.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:27:10 smithi086 bash[24289]: cluster 2024-09-16T12:27:09.381788+0000 mgr.a (mgr.14373) 17727 : cluster [DBG] pgmap v12296: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:27:10.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:27:10 smithi047 bash[22744]: cluster 2024-09-16T12:27:09.381788+0000 mgr.a (mgr.14373) 17727 : cluster [DBG] pgmap v12296: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:27:11.963 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:27:11.963 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:27:11.964 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:27:12.724 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:27:12.725 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:27:12.725 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:27:12.725 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:27:12.725 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:27:12.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:27:12 smithi157 bash[24585]: cluster 2024-09-16T12:27:11.382769+0000 mgr.a (mgr.14373) 17728 : cluster [DBG] pgmap v12297: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T12:27:12.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:27:12 smithi086 bash[24289]: cluster 2024-09-16T12:27:11.382769+0000 mgr.a (mgr.14373) 17728 : cluster [DBG] pgmap v12297: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T12:27:12.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:27:12 smithi047 bash[22744]: cluster 2024-09-16T12:27:11.382769+0000 mgr.a (mgr.14373) 17728 : cluster [DBG] pgmap v12297: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T12:27:13.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:27:13 smithi157 bash[24585]: audit 2024-09-16T12:27:12.302488+0000 mgr.a (mgr.14373) 17729 : audit [DBG] from='client.380868 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:27:13.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:27:13 smithi086 bash[24289]: audit 2024-09-16T12:27:12.302488+0000 mgr.a (mgr.14373) 17729 : audit [DBG] from='client.380868 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:27:13.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:27:13 smithi047 bash[22744]: audit 2024-09-16T12:27:12.302488+0000 mgr.a (mgr.14373) 17729 : audit [DBG] from='client.380868 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:27:14.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:27:14 smithi157 bash[24585]: cluster 2024-09-16T12:27:13.385629+0000 mgr.a (mgr.14373) 17730 : cluster [DBG] pgmap v12298: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:27:14.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:27:14 smithi086 bash[24289]: cluster 2024-09-16T12:27:13.385629+0000 mgr.a (mgr.14373) 17730 : cluster [DBG] pgmap v12298: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:27:14.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:27:14 smithi047 bash[22744]: cluster 2024-09-16T12:27:13.385629+0000 mgr.a (mgr.14373) 17730 : cluster [DBG] pgmap v12298: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:27:16.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:27:16 smithi157 bash[24585]: cluster 2024-09-16T12:27:15.386438+0000 mgr.a (mgr.14373) 17731 : cluster [DBG] pgmap v12299: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:27:16.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:27:16 smithi086 bash[24289]: cluster 2024-09-16T12:27:15.386438+0000 mgr.a (mgr.14373) 17731 : cluster [DBG] pgmap v12299: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:27:16.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:27:16 smithi047 bash[22744]: cluster 2024-09-16T12:27:15.386438+0000 mgr.a (mgr.14373) 17731 : cluster [DBG] pgmap v12299: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:27:17.726 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:27:17.727 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:27:17.727 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:27:18.481 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:27:18.482 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:27:18.482 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:27:18.482 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:27:18.482 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:27:18.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:27:18 smithi157 bash[24585]: cluster 2024-09-16T12:27:17.388434+0000 mgr.a (mgr.14373) 17732 : cluster [DBG] pgmap v12300: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:27:18.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:27:18 smithi157 bash[24585]: audit 2024-09-16T12:27:17.962636+0000 mon.b (mon.2) 1606 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T12:27:18.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:27:18 smithi157 bash[24585]: audit 2024-09-16T12:27:18.055148+0000 mgr.a (mgr.14373) 17733 : audit [DBG] from='client.380943 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:27:18.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:27:18 smithi086 bash[24289]: cluster 2024-09-16T12:27:17.388434+0000 mgr.a (mgr.14373) 17732 : cluster [DBG] pgmap v12300: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:27:18.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:27:18 smithi086 bash[24289]: audit 2024-09-16T12:27:17.962636+0000 mon.b (mon.2) 1606 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T12:27:18.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:27:18 smithi086 bash[24289]: audit 2024-09-16T12:27:18.055148+0000 mgr.a (mgr.14373) 17733 : audit [DBG] from='client.380943 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:27:18.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:27:18 smithi047 bash[22744]: cluster 2024-09-16T12:27:17.388434+0000 mgr.a (mgr.14373) 17732 : cluster [DBG] pgmap v12300: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:27:18.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:27:18 smithi047 bash[22744]: audit 2024-09-16T12:27:17.962636+0000 mon.b (mon.2) 1606 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T12:27:18.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:27:18 smithi047 bash[22744]: audit 2024-09-16T12:27:18.055148+0000 mgr.a (mgr.14373) 17733 : audit [DBG] from='client.380943 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:27:19.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:27:19 smithi157 bash[24585]: audit 2024-09-16T12:27:18.782533+0000 mon.b (mon.2) 1607 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T12:27:19.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:27:19 smithi157 bash[24585]: audit 2024-09-16T12:27:18.784814+0000 mon.b (mon.2) 1608 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T12:27:19.808 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:27:19 smithi157 bash[24585]: audit 2024-09-16T12:27:18.796381+0000 mon.a (mon.0) 1626 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:27:19.808 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:27:19 smithi157 bash[24585]: audit 2024-09-16T12:27:18.801764+0000 mon.b (mon.2) 1609 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:27:19.808 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:27:19 smithi157 bash[24585]: audit 2024-09-16T12:27:18.804620+0000 mgr.a (mgr.14373) 17734 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:27:19.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:27:19 smithi086 bash[24289]: audit 2024-09-16T12:27:18.782533+0000 mon.b (mon.2) 1607 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T12:27:19.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:27:19 smithi086 bash[24289]: audit 2024-09-16T12:27:18.784814+0000 mon.b (mon.2) 1608 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T12:27:19.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:27:19 smithi086 bash[24289]: audit 2024-09-16T12:27:18.796381+0000 mon.a (mon.0) 1626 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:27:19.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:27:19 smithi086 bash[24289]: audit 2024-09-16T12:27:18.801764+0000 mon.b (mon.2) 1609 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:27:19.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:27:19 smithi086 bash[24289]: audit 2024-09-16T12:27:18.804620+0000 mgr.a (mgr.14373) 17734 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:27:19.843 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 12:27:19 smithi047 bash[22994]: debug 2024-09-16T12:27:19.549+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T12:27:19.843 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 12:27:19 smithi047 bash[22994]: debug 2024-09-16T12:27:19.549+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T12:27:19.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:27:19 smithi047 bash[22744]: audit 2024-09-16T12:27:18.782533+0000 mon.b (mon.2) 1607 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T12:27:19.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:27:19 smithi047 bash[22744]: audit 2024-09-16T12:27:18.784814+0000 mon.b (mon.2) 1608 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T12:27:19.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:27:19 smithi047 bash[22744]: audit 2024-09-16T12:27:18.796381+0000 mon.a (mon.0) 1626 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:27:19.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:27:19 smithi047 bash[22744]: audit 2024-09-16T12:27:18.801764+0000 mon.b (mon.2) 1609 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:27:19.844 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:27:19 smithi047 bash[22744]: audit 2024-09-16T12:27:18.804620+0000 mgr.a (mgr.14373) 17734 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:27:21.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:27:20 smithi157 bash[24585]: cluster 2024-09-16T12:27:19.388930+0000 mgr.a (mgr.14373) 17735 : cluster [DBG] pgmap v12301: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:27:21.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:27:20 smithi157 bash[24585]: audit 2024-09-16T12:27:19.552122+0000 mgr.a (mgr.14373) 17736 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T12:27:21.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:27:20 smithi157 bash[24585]: cephadm 2024-09-16T12:27:19.554072+0000 mgr.a (mgr.14373) 17737 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T12:27:21.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:27:20 smithi086 bash[24289]: cluster 2024-09-16T12:27:19.388930+0000 mgr.a (mgr.14373) 17735 : cluster [DBG] pgmap v12301: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:27:21.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:27:20 smithi086 bash[24289]: audit 2024-09-16T12:27:19.552122+0000 mgr.a (mgr.14373) 17736 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T12:27:21.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:27:20 smithi086 bash[24289]: cephadm 2024-09-16T12:27:19.554072+0000 mgr.a (mgr.14373) 17737 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T12:27:21.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:27:20 smithi047 bash[22744]: cluster 2024-09-16T12:27:19.388930+0000 mgr.a (mgr.14373) 17735 : cluster [DBG] pgmap v12301: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:27:21.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:27:20 smithi047 bash[22744]: audit 2024-09-16T12:27:19.552122+0000 mgr.a (mgr.14373) 17736 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T12:27:21.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:27:20 smithi047 bash[22744]: cephadm 2024-09-16T12:27:19.554072+0000 mgr.a (mgr.14373) 17737 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T12:27:23.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:27:22 smithi157 bash[24585]: cluster 2024-09-16T12:27:21.389646+0000 mgr.a (mgr.14373) 17738 : cluster [DBG] pgmap v12302: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:27:23.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:27:22 smithi086 bash[24289]: cluster 2024-09-16T12:27:21.389646+0000 mgr.a (mgr.14373) 17738 : cluster [DBG] pgmap v12302: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:27:23.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:27:22 smithi047 bash[22744]: cluster 2024-09-16T12:27:21.389646+0000 mgr.a (mgr.14373) 17738 : cluster [DBG] pgmap v12302: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:27:23.483 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:27:23.483 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:27:23.484 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:27:24.266 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:27:24.266 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:27:24.266 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:27:24.266 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:27:24.266 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:27:25.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:27:24 smithi086 bash[24289]: cluster 2024-09-16T12:27:23.391903+0000 mgr.a (mgr.14373) 17739 : cluster [DBG] pgmap v12303: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:27:25.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:27:24 smithi086 bash[24289]: audit 2024-09-16T12:27:23.815850+0000 mgr.a (mgr.14373) 17740 : audit [DBG] from='client.381126 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:27:25.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:27:24 smithi047 bash[22744]: cluster 2024-09-16T12:27:23.391903+0000 mgr.a (mgr.14373) 17739 : cluster [DBG] pgmap v12303: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:27:25.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:27:24 smithi047 bash[22744]: audit 2024-09-16T12:27:23.815850+0000 mgr.a (mgr.14373) 17740 : audit [DBG] from='client.381126 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:27:25.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:27:24 smithi157 bash[24585]: cluster 2024-09-16T12:27:23.391903+0000 mgr.a (mgr.14373) 17739 : cluster [DBG] pgmap v12303: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:27:25.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:27:24 smithi157 bash[24585]: audit 2024-09-16T12:27:23.815850+0000 mgr.a (mgr.14373) 17740 : audit [DBG] from='client.381126 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:27:27.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:27:26 smithi086 bash[24289]: cluster 2024-09-16T12:27:25.392901+0000 mgr.a (mgr.14373) 17741 : cluster [DBG] pgmap v12304: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:27:27.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:27:26 smithi047 bash[22744]: cluster 2024-09-16T12:27:25.392901+0000 mgr.a (mgr.14373) 17741 : cluster [DBG] pgmap v12304: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:27:27.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:27:26 smithi157 bash[24585]: cluster 2024-09-16T12:27:25.392901+0000 mgr.a (mgr.14373) 17741 : cluster [DBG] pgmap v12304: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:27:29.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:27:28 smithi086 bash[24289]: cluster 2024-09-16T12:27:27.395162+0000 mgr.a (mgr.14373) 17742 : cluster [DBG] pgmap v12305: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:27:29.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:27:28 smithi047 bash[22744]: cluster 2024-09-16T12:27:27.395162+0000 mgr.a (mgr.14373) 17742 : cluster [DBG] pgmap v12305: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:27:29.267 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:27:29.268 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:27:29.268 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:27:29.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:27:28 smithi157 bash[24585]: cluster 2024-09-16T12:27:27.395162+0000 mgr.a (mgr.14373) 17742 : cluster [DBG] pgmap v12305: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:27:30.042 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:27:30.042 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:27:30.042 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:27:30.042 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:27:30.042 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:27:31.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:27:30 smithi047 bash[22744]: cluster 2024-09-16T12:27:29.395608+0000 mgr.a (mgr.14373) 17743 : cluster [DBG] pgmap v12306: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:27:31.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:27:30 smithi047 bash[22744]: audit 2024-09-16T12:27:29.601970+0000 mgr.a (mgr.14373) 17744 : audit [DBG] from='client.381204 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:27:31.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:27:30 smithi157 bash[24585]: cluster 2024-09-16T12:27:29.395608+0000 mgr.a (mgr.14373) 17743 : cluster [DBG] pgmap v12306: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:27:31.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:27:30 smithi157 bash[24585]: audit 2024-09-16T12:27:29.601970+0000 mgr.a (mgr.14373) 17744 : audit [DBG] from='client.381204 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:27:31.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:27:30 smithi086 bash[24289]: cluster 2024-09-16T12:27:29.395608+0000 mgr.a (mgr.14373) 17743 : cluster [DBG] pgmap v12306: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:27:31.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:27:30 smithi086 bash[24289]: audit 2024-09-16T12:27:29.601970+0000 mgr.a (mgr.14373) 17744 : audit [DBG] from='client.381204 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:27:33.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:27:32 smithi047 bash[22744]: cluster 2024-09-16T12:27:31.396476+0000 mgr.a (mgr.14373) 17745 : cluster [DBG] pgmap v12307: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:27:33.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:27:32 smithi157 bash[24585]: cluster 2024-09-16T12:27:31.396476+0000 mgr.a (mgr.14373) 17745 : cluster [DBG] pgmap v12307: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:27:33.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:27:32 smithi086 bash[24289]: cluster 2024-09-16T12:27:31.396476+0000 mgr.a (mgr.14373) 17745 : cluster [DBG] pgmap v12307: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:27:35.043 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:27:35.044 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:27:35.044 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:27:35.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:27:34 smithi047 bash[22744]: cluster 2024-09-16T12:27:33.398730+0000 mgr.a (mgr.14373) 17746 : cluster [DBG] pgmap v12308: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:27:35.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:27:34 smithi157 bash[24585]: cluster 2024-09-16T12:27:33.398730+0000 mgr.a (mgr.14373) 17746 : cluster [DBG] pgmap v12308: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:27:35.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:27:34 smithi086 bash[24289]: cluster 2024-09-16T12:27:33.398730+0000 mgr.a (mgr.14373) 17746 : cluster [DBG] pgmap v12308: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:27:35.827 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:27:35.828 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:27:35.828 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:27:35.828 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:27:35.828 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:27:37.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:27:36 smithi047 bash[22744]: audit 2024-09-16T12:27:35.382400+0000 mgr.a (mgr.14373) 17747 : audit [DBG] from='client.381282 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:27:37.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:27:36 smithi047 bash[22744]: cluster 2024-09-16T12:27:35.401723+0000 mgr.a (mgr.14373) 17748 : cluster [DBG] pgmap v12309: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:27:37.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:27:36 smithi157 bash[24585]: audit 2024-09-16T12:27:35.382400+0000 mgr.a (mgr.14373) 17747 : audit [DBG] from='client.381282 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:27:37.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:27:36 smithi157 bash[24585]: cluster 2024-09-16T12:27:35.401723+0000 mgr.a (mgr.14373) 17748 : cluster [DBG] pgmap v12309: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:27:37.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:27:36 smithi086 bash[24289]: audit 2024-09-16T12:27:35.382400+0000 mgr.a (mgr.14373) 17747 : audit [DBG] from='client.381282 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:27:37.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:27:36 smithi086 bash[24289]: cluster 2024-09-16T12:27:35.401723+0000 mgr.a (mgr.14373) 17748 : cluster [DBG] pgmap v12309: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:27:39.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:27:38 smithi047 bash[22744]: cluster 2024-09-16T12:27:37.404201+0000 mgr.a (mgr.14373) 17749 : cluster [DBG] pgmap v12310: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:27:39.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:27:38 smithi157 bash[24585]: cluster 2024-09-16T12:27:37.404201+0000 mgr.a (mgr.14373) 17749 : cluster [DBG] pgmap v12310: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:27:39.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:27:38 smithi086 bash[24289]: cluster 2024-09-16T12:27:37.404201+0000 mgr.a (mgr.14373) 17749 : cluster [DBG] pgmap v12310: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:27:40.829 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:27:40.830 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:27:40.830 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:27:41.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:27:40 smithi047 bash[22744]: cluster 2024-09-16T12:27:39.404984+0000 mgr.a (mgr.14373) 17750 : cluster [DBG] pgmap v12311: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:27:41.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:27:40 smithi157 bash[24585]: cluster 2024-09-16T12:27:39.404984+0000 mgr.a (mgr.14373) 17750 : cluster [DBG] pgmap v12311: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:27:41.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:27:40 smithi086 bash[24289]: cluster 2024-09-16T12:27:39.404984+0000 mgr.a (mgr.14373) 17750 : cluster [DBG] pgmap v12311: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:27:41.624 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:27:41.625 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:27:41.625 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:27:41.625 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:27:41.625 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:27:43.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:27:42 smithi157 bash[24585]: audit 2024-09-16T12:27:41.165869+0000 mgr.a (mgr.14373) 17751 : audit [DBG] from='client.381357 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:27:43.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:27:42 smithi157 bash[24585]: cluster 2024-09-16T12:27:41.405561+0000 mgr.a (mgr.14373) 17752 : cluster [DBG] pgmap v12312: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:27:43.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:27:42 smithi086 bash[24289]: audit 2024-09-16T12:27:41.165869+0000 mgr.a (mgr.14373) 17751 : audit [DBG] from='client.381357 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:27:43.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:27:42 smithi086 bash[24289]: cluster 2024-09-16T12:27:41.405561+0000 mgr.a (mgr.14373) 17752 : cluster [DBG] pgmap v12312: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:27:43.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:27:42 smithi047 bash[22744]: audit 2024-09-16T12:27:41.165869+0000 mgr.a (mgr.14373) 17751 : audit [DBG] from='client.381357 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:27:43.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:27:42 smithi047 bash[22744]: cluster 2024-09-16T12:27:41.405561+0000 mgr.a (mgr.14373) 17752 : cluster [DBG] pgmap v12312: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:27:45.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:27:44 smithi157 bash[24585]: cluster 2024-09-16T12:27:43.417750+0000 mgr.a (mgr.14373) 17753 : cluster [DBG] pgmap v12313: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-16T12:27:45.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:27:44 smithi086 bash[24289]: cluster 2024-09-16T12:27:43.417750+0000 mgr.a (mgr.14373) 17753 : cluster [DBG] pgmap v12313: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-16T12:27:45.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:27:44 smithi047 bash[22744]: cluster 2024-09-16T12:27:43.417750+0000 mgr.a (mgr.14373) 17753 : cluster [DBG] pgmap v12313: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-16T12:27:46.626 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:27:46.627 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:27:46.627 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:27:47.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:27:46 smithi157 bash[24585]: cluster 2024-09-16T12:27:45.418542+0000 mgr.a (mgr.14373) 17754 : cluster [DBG] pgmap v12314: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T12:27:47.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:27:46 smithi086 bash[24289]: cluster 2024-09-16T12:27:45.418542+0000 mgr.a (mgr.14373) 17754 : cluster [DBG] pgmap v12314: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T12:27:47.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:27:46 smithi047 bash[22744]: cluster 2024-09-16T12:27:45.418542+0000 mgr.a (mgr.14373) 17754 : cluster [DBG] pgmap v12314: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T12:27:47.374 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:27:47.374 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:27:47.374 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:27:47.375 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:27:47.375 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:27:48.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:27:47 smithi157 bash[24585]: audit 2024-09-16T12:27:46.950171+0000 mgr.a (mgr.14373) 17755 : audit [DBG] from='client.381435 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:27:48.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:27:47 smithi086 bash[24289]: audit 2024-09-16T12:27:46.950171+0000 mgr.a (mgr.14373) 17755 : audit [DBG] from='client.381435 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:27:48.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:27:47 smithi047 bash[22744]: audit 2024-09-16T12:27:46.950171+0000 mgr.a (mgr.14373) 17755 : audit [DBG] from='client.381435 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:27:49.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:27:48 smithi157 bash[24585]: cluster 2024-09-16T12:27:47.419973+0000 mgr.a (mgr.14373) 17756 : cluster [DBG] pgmap v12315: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:27:49.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:27:48 smithi086 bash[24289]: cluster 2024-09-16T12:27:47.419973+0000 mgr.a (mgr.14373) 17756 : cluster [DBG] pgmap v12315: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:27:49.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:27:48 smithi047 bash[22744]: cluster 2024-09-16T12:27:47.419973+0000 mgr.a (mgr.14373) 17756 : cluster [DBG] pgmap v12315: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:27:51.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:27:50 smithi157 bash[24585]: cluster 2024-09-16T12:27:49.420706+0000 mgr.a (mgr.14373) 17757 : cluster [DBG] pgmap v12316: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:27:51.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:27:50 smithi086 bash[24289]: cluster 2024-09-16T12:27:49.420706+0000 mgr.a (mgr.14373) 17757 : cluster [DBG] pgmap v12316: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:27:51.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:27:50 smithi047 bash[22744]: cluster 2024-09-16T12:27:49.420706+0000 mgr.a (mgr.14373) 17757 : cluster [DBG] pgmap v12316: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:27:52.376 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:27:52.377 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:27:52.377 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:27:53.150 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:27:53.151 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:27:53.151 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:27:53.151 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:27:53.151 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:27:53.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:27:52 smithi157 bash[24585]: cluster 2024-09-16T12:27:51.421516+0000 mgr.a (mgr.14373) 17758 : cluster [DBG] pgmap v12317: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:27:53.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:27:52 smithi086 bash[24289]: cluster 2024-09-16T12:27:51.421516+0000 mgr.a (mgr.14373) 17758 : cluster [DBG] pgmap v12317: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:27:53.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:27:52 smithi047 bash[22744]: cluster 2024-09-16T12:27:51.421516+0000 mgr.a (mgr.14373) 17758 : cluster [DBG] pgmap v12317: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:27:54.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:27:53 smithi157 bash[24585]: audit 2024-09-16T12:27:52.703433+0000 mgr.a (mgr.14373) 17759 : audit [DBG] from='client.381510 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:27:54.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:27:53 smithi086 bash[24289]: audit 2024-09-16T12:27:52.703433+0000 mgr.a (mgr.14373) 17759 : audit [DBG] from='client.381510 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:27:54.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:27:53 smithi047 bash[22744]: audit 2024-09-16T12:27:52.703433+0000 mgr.a (mgr.14373) 17759 : audit [DBG] from='client.381510 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:27:55.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:27:54 smithi157 bash[24585]: cluster 2024-09-16T12:27:53.424347+0000 mgr.a (mgr.14373) 17760 : cluster [DBG] pgmap v12318: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:27:55.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:27:54 smithi086 bash[24289]: cluster 2024-09-16T12:27:53.424347+0000 mgr.a (mgr.14373) 17760 : cluster [DBG] pgmap v12318: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:27:55.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:27:54 smithi047 bash[22744]: cluster 2024-09-16T12:27:53.424347+0000 mgr.a (mgr.14373) 17760 : cluster [DBG] pgmap v12318: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:27:57.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:27:56 smithi157 bash[24585]: cluster 2024-09-16T12:27:55.425160+0000 mgr.a (mgr.14373) 17761 : cluster [DBG] pgmap v12319: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-16T12:27:57.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:27:56 smithi086 bash[24289]: cluster 2024-09-16T12:27:55.425160+0000 mgr.a (mgr.14373) 17761 : cluster [DBG] pgmap v12319: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-16T12:27:57.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:27:56 smithi047 bash[22744]: cluster 2024-09-16T12:27:55.425160+0000 mgr.a (mgr.14373) 17761 : cluster [DBG] pgmap v12319: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-16T12:27:58.152 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:27:58.173 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:27:58.173 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:27:58.934 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:27:58.935 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:27:58.935 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:27:58.935 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:27:58.935 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:27:59.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:27:58 smithi157 bash[24585]: cluster 2024-09-16T12:27:57.427230+0000 mgr.a (mgr.14373) 17762 : cluster [DBG] pgmap v12320: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-16T12:27:59.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:27:58 smithi086 bash[24289]: cluster 2024-09-16T12:27:57.427230+0000 mgr.a (mgr.14373) 17762 : cluster [DBG] pgmap v12320: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-16T12:27:59.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:27:58 smithi047 bash[22744]: cluster 2024-09-16T12:27:57.427230+0000 mgr.a (mgr.14373) 17762 : cluster [DBG] pgmap v12320: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-16T12:28:00.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:27:59 smithi157 bash[24585]: audit 2024-09-16T12:27:58.486132+0000 mgr.a (mgr.14373) 17763 : audit [DBG] from='client.381588 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:28:00.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:27:59 smithi086 bash[24289]: audit 2024-09-16T12:27:58.486132+0000 mgr.a (mgr.14373) 17763 : audit [DBG] from='client.381588 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:28:00.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:27:59 smithi047 bash[22744]: audit 2024-09-16T12:27:58.486132+0000 mgr.a (mgr.14373) 17763 : audit [DBG] from='client.381588 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:28:01.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:28:00 smithi157 bash[24585]: cluster 2024-09-16T12:27:59.428206+0000 mgr.a (mgr.14373) 17764 : cluster [DBG] pgmap v12321: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:28:01.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:28:00 smithi086 bash[24289]: cluster 2024-09-16T12:27:59.428206+0000 mgr.a (mgr.14373) 17764 : cluster [DBG] pgmap v12321: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:28:01.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:28:00 smithi047 bash[22744]: cluster 2024-09-16T12:27:59.428206+0000 mgr.a (mgr.14373) 17764 : cluster [DBG] pgmap v12321: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:28:03.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:28:02 smithi157 bash[24585]: cluster 2024-09-16T12:28:01.428991+0000 mgr.a (mgr.14373) 17765 : cluster [DBG] pgmap v12322: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:28:03.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:28:02 smithi086 bash[24289]: cluster 2024-09-16T12:28:01.428991+0000 mgr.a (mgr.14373) 17765 : cluster [DBG] pgmap v12322: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:28:03.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:28:02 smithi047 bash[22744]: cluster 2024-09-16T12:28:01.428991+0000 mgr.a (mgr.14373) 17765 : cluster [DBG] pgmap v12322: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:28:03.936 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:28:03.937 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:28:03.937 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:28:04.687 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:28:04.687 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:28:04.687 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:28:04.687 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:28:04.687 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:28:05.308 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:28:04 smithi157 bash[24585]: cluster 2024-09-16T12:28:03.431523+0000 mgr.a (mgr.14373) 17766 : cluster [DBG] pgmap v12323: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:28:05.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:28:04 smithi086 bash[24289]: cluster 2024-09-16T12:28:03.431523+0000 mgr.a (mgr.14373) 17766 : cluster [DBG] pgmap v12323: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:28:05.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:28:04 smithi047 bash[22744]: cluster 2024-09-16T12:28:03.431523+0000 mgr.a (mgr.14373) 17766 : cluster [DBG] pgmap v12323: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:28:06.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:28:05 smithi157 bash[24585]: audit 2024-09-16T12:28:04.268485+0000 mgr.a (mgr.14373) 17767 : audit [DBG] from='client.381666 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:28:06.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:28:05 smithi086 bash[24289]: audit 2024-09-16T12:28:04.268485+0000 mgr.a (mgr.14373) 17767 : audit [DBG] from='client.381666 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:28:06.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:28:05 smithi047 bash[22744]: audit 2024-09-16T12:28:04.268485+0000 mgr.a (mgr.14373) 17767 : audit [DBG] from='client.381666 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:28:07.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:28:06 smithi157 bash[24585]: cluster 2024-09-16T12:28:05.432683+0000 mgr.a (mgr.14373) 17768 : cluster [DBG] pgmap v12324: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:28:07.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:28:06 smithi086 bash[24289]: cluster 2024-09-16T12:28:05.432683+0000 mgr.a (mgr.14373) 17768 : cluster [DBG] pgmap v12324: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:28:07.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:28:06 smithi047 bash[22744]: cluster 2024-09-16T12:28:05.432683+0000 mgr.a (mgr.14373) 17768 : cluster [DBG] pgmap v12324: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:28:09.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:28:08 smithi157 bash[24585]: cluster 2024-09-16T12:28:07.435125+0000 mgr.a (mgr.14373) 17769 : cluster [DBG] pgmap v12325: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 4.8 KiB/s rd, 0 B/s wr, 5 op/s 2024-09-16T12:28:09.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:28:08 smithi086 bash[24289]: cluster 2024-09-16T12:28:07.435125+0000 mgr.a (mgr.14373) 17769 : cluster [DBG] pgmap v12325: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 4.8 KiB/s rd, 0 B/s wr, 5 op/s 2024-09-16T12:28:09.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:28:08 smithi047 bash[22744]: cluster 2024-09-16T12:28:07.435125+0000 mgr.a (mgr.14373) 17769 : cluster [DBG] pgmap v12325: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 4.8 KiB/s rd, 0 B/s wr, 5 op/s 2024-09-16T12:28:09.688 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:28:09.689 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:28:09.689 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:28:10.471 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:28:10.471 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:28:10.471 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:28:10.471 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:28:10.471 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:28:11.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:28:10 smithi157 bash[24585]: cluster 2024-09-16T12:28:09.436095+0000 mgr.a (mgr.14373) 17770 : cluster [DBG] pgmap v12326: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 3.9 KiB/s rd, 0 B/s wr, 5 op/s 2024-09-16T12:28:11.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:28:10 smithi157 bash[24585]: audit 2024-09-16T12:28:10.021769+0000 mgr.a (mgr.14373) 17771 : audit [DBG] from='client.381738 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:28:11.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:28:10 smithi086 bash[24289]: cluster 2024-09-16T12:28:09.436095+0000 mgr.a (mgr.14373) 17770 : cluster [DBG] pgmap v12326: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 3.9 KiB/s rd, 0 B/s wr, 5 op/s 2024-09-16T12:28:11.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:28:10 smithi086 bash[24289]: audit 2024-09-16T12:28:10.021769+0000 mgr.a (mgr.14373) 17771 : audit [DBG] from='client.381738 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:28:11.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:28:10 smithi047 bash[22744]: cluster 2024-09-16T12:28:09.436095+0000 mgr.a (mgr.14373) 17770 : cluster [DBG] pgmap v12326: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 3.9 KiB/s rd, 0 B/s wr, 5 op/s 2024-09-16T12:28:11.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:28:10 smithi047 bash[22744]: audit 2024-09-16T12:28:10.021769+0000 mgr.a (mgr.14373) 17771 : audit [DBG] from='client.381738 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:28:13.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:28:12 smithi157 bash[24585]: cluster 2024-09-16T12:28:11.437619+0000 mgr.a (mgr.14373) 17772 : cluster [DBG] pgmap v12327: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 5.2 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-16T12:28:13.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:28:12 smithi086 bash[24289]: cluster 2024-09-16T12:28:11.437619+0000 mgr.a (mgr.14373) 17772 : cluster [DBG] pgmap v12327: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 5.2 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-16T12:28:13.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:28:12 smithi047 bash[22744]: cluster 2024-09-16T12:28:11.437619+0000 mgr.a (mgr.14373) 17772 : cluster [DBG] pgmap v12327: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 5.2 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-16T12:28:15.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:28:14 smithi157 bash[24585]: cluster 2024-09-16T12:28:13.439326+0000 mgr.a (mgr.14373) 17773 : cluster [DBG] pgmap v12328: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-16T12:28:15.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:28:14 smithi086 bash[24289]: cluster 2024-09-16T12:28:13.439326+0000 mgr.a (mgr.14373) 17773 : cluster [DBG] pgmap v12328: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-16T12:28:15.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:28:14 smithi047 bash[22744]: cluster 2024-09-16T12:28:13.439326+0000 mgr.a (mgr.14373) 17773 : cluster [DBG] pgmap v12328: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-16T12:28:15.472 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:28:15.473 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:28:15.473 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:28:16.267 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:28:16.267 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:28:16.267 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:28:16.267 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:28:16.267 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:28:17.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:28:16 smithi157 bash[24585]: cluster 2024-09-16T12:28:15.440128+0000 mgr.a (mgr.14373) 17774 : cluster [DBG] pgmap v12329: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-16T12:28:17.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:28:16 smithi157 bash[24585]: audit 2024-09-16T12:28:15.813285+0000 mgr.a (mgr.14373) 17775 : audit [DBG] from='client.381816 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:28:17.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:28:16 smithi086 bash[24289]: cluster 2024-09-16T12:28:15.440128+0000 mgr.a (mgr.14373) 17774 : cluster [DBG] pgmap v12329: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-16T12:28:17.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:28:16 smithi086 bash[24289]: audit 2024-09-16T12:28:15.813285+0000 mgr.a (mgr.14373) 17775 : audit [DBG] from='client.381816 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:28:17.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:28:16 smithi047 bash[22744]: cluster 2024-09-16T12:28:15.440128+0000 mgr.a (mgr.14373) 17774 : cluster [DBG] pgmap v12329: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-16T12:28:17.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:28:16 smithi047 bash[22744]: audit 2024-09-16T12:28:15.813285+0000 mgr.a (mgr.14373) 17775 : audit [DBG] from='client.381816 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:28:19.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:28:18 smithi157 bash[24585]: cluster 2024-09-16T12:28:17.442547+0000 mgr.a (mgr.14373) 17776 : cluster [DBG] pgmap v12330: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-16T12:28:19.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:28:18 smithi086 bash[24289]: cluster 2024-09-16T12:28:17.442547+0000 mgr.a (mgr.14373) 17776 : cluster [DBG] pgmap v12330: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-16T12:28:19.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:28:18 smithi047 bash[22744]: cluster 2024-09-16T12:28:17.442547+0000 mgr.a (mgr.14373) 17776 : cluster [DBG] pgmap v12330: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-16T12:28:20.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:28:19 smithi157 bash[24585]: audit 2024-09-16T12:28:19.613647+0000 mon.b (mon.2) 1610 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T12:28:20.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:28:19 smithi086 bash[24289]: audit 2024-09-16T12:28:19.613647+0000 mon.b (mon.2) 1610 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T12:28:20.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:28:19 smithi047 bash[22744]: audit 2024-09-16T12:28:19.613647+0000 mon.b (mon.2) 1610 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T12:28:21.239 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:28:20 smithi047 bash[22744]: cluster 2024-09-16T12:28:19.443325+0000 mgr.a (mgr.14373) 17777 : cluster [DBG] pgmap v12331: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 3.7 KiB/s rd, 0 B/s wr, 4 op/s 2024-09-16T12:28:21.239 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:28:20 smithi047 bash[22744]: audit 2024-09-16T12:28:20.441046+0000 mon.b (mon.2) 1611 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T12:28:21.240 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:28:20 smithi047 bash[22744]: audit 2024-09-16T12:28:20.443109+0000 mon.b (mon.2) 1612 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T12:28:21.240 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:28:20 smithi047 bash[22744]: audit 2024-09-16T12:28:20.452875+0000 mon.a (mon.0) 1627 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:28:21.240 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:28:20 smithi047 bash[22744]: audit 2024-09-16T12:28:20.459911+0000 mon.b (mon.2) 1613 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:28:21.268 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:28:21.269 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:28:21.269 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:28:21.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:28:20 smithi157 bash[24585]: cluster 2024-09-16T12:28:19.443325+0000 mgr.a (mgr.14373) 17777 : cluster [DBG] pgmap v12331: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 3.7 KiB/s rd, 0 B/s wr, 4 op/s 2024-09-16T12:28:21.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:28:20 smithi157 bash[24585]: audit 2024-09-16T12:28:20.441046+0000 mon.b (mon.2) 1611 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T12:28:21.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:28:20 smithi157 bash[24585]: audit 2024-09-16T12:28:20.443109+0000 mon.b (mon.2) 1612 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T12:28:21.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:28:20 smithi157 bash[24585]: audit 2024-09-16T12:28:20.452875+0000 mon.a (mon.0) 1627 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:28:21.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:28:20 smithi157 bash[24585]: audit 2024-09-16T12:28:20.459911+0000 mon.b (mon.2) 1613 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:28:21.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:28:20 smithi086 bash[24289]: cluster 2024-09-16T12:28:19.443325+0000 mgr.a (mgr.14373) 17777 : cluster [DBG] pgmap v12331: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 3.7 KiB/s rd, 0 B/s wr, 4 op/s 2024-09-16T12:28:21.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:28:20 smithi086 bash[24289]: audit 2024-09-16T12:28:20.441046+0000 mon.b (mon.2) 1611 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T12:28:21.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:28:20 smithi086 bash[24289]: audit 2024-09-16T12:28:20.443109+0000 mon.b (mon.2) 1612 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T12:28:21.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:28:20 smithi086 bash[24289]: audit 2024-09-16T12:28:20.452875+0000 mon.a (mon.0) 1627 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:28:21.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:28:20 smithi086 bash[24289]: audit 2024-09-16T12:28:20.459911+0000 mon.b (mon.2) 1613 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:28:21.593 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 12:28:21 smithi047 bash[22994]: debug 2024-09-16T12:28:21.232+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T12:28:21.593 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 12:28:21 smithi047 bash[22994]: debug 2024-09-16T12:28:21.236+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T12:28:22.013 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:28:22.014 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:28:22.014 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:28:22.014 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:28:22.014 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:28:22.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:28:21 smithi157 bash[24585]: audit 2024-09-16T12:28:20.462264+0000 mgr.a (mgr.14373) 17778 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:28:22.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:28:21 smithi086 bash[24289]: audit 2024-09-16T12:28:20.462264+0000 mgr.a (mgr.14373) 17778 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:28:22.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:28:21 smithi047 bash[22744]: audit 2024-09-16T12:28:20.462264+0000 mgr.a (mgr.14373) 17778 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:28:23.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:28:22 smithi157 bash[24585]: audit 2024-09-16T12:28:21.237771+0000 mgr.a (mgr.14373) 17779 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T12:28:23.308 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:28:22 smithi157 bash[24585]: cephadm 2024-09-16T12:28:21.239990+0000 mgr.a (mgr.14373) 17780 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T12:28:23.308 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:28:22 smithi157 bash[24585]: cluster 2024-09-16T12:28:21.444978+0000 mgr.a (mgr.14373) 17781 : cluster [DBG] pgmap v12332: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 5.2 KiB/s rd, 85 B/s wr, 6 op/s 2024-09-16T12:28:23.308 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:28:22 smithi157 bash[24585]: audit 2024-09-16T12:28:21.591383+0000 mgr.a (mgr.14373) 17782 : audit [DBG] from='client.381996 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:28:23.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:28:22 smithi086 bash[24289]: audit 2024-09-16T12:28:21.237771+0000 mgr.a (mgr.14373) 17779 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T12:28:23.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:28:22 smithi086 bash[24289]: cephadm 2024-09-16T12:28:21.239990+0000 mgr.a (mgr.14373) 17780 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T12:28:23.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:28:22 smithi086 bash[24289]: cluster 2024-09-16T12:28:21.444978+0000 mgr.a (mgr.14373) 17781 : cluster [DBG] pgmap v12332: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 5.2 KiB/s rd, 85 B/s wr, 6 op/s 2024-09-16T12:28:23.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:28:22 smithi086 bash[24289]: audit 2024-09-16T12:28:21.591383+0000 mgr.a (mgr.14373) 17782 : audit [DBG] from='client.381996 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:28:23.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:28:22 smithi047 bash[22744]: audit 2024-09-16T12:28:21.237771+0000 mgr.a (mgr.14373) 17779 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T12:28:23.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:28:22 smithi047 bash[22744]: cephadm 2024-09-16T12:28:21.239990+0000 mgr.a (mgr.14373) 17780 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T12:28:23.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:28:22 smithi047 bash[22744]: cluster 2024-09-16T12:28:21.444978+0000 mgr.a (mgr.14373) 17781 : cluster [DBG] pgmap v12332: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 5.2 KiB/s rd, 85 B/s wr, 6 op/s 2024-09-16T12:28:23.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:28:22 smithi047 bash[22744]: audit 2024-09-16T12:28:21.591383+0000 mgr.a (mgr.14373) 17782 : audit [DBG] from='client.381996 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:28:25.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:28:24 smithi157 bash[24585]: cluster 2024-09-16T12:28:23.447245+0000 mgr.a (mgr.14373) 17783 : cluster [DBG] pgmap v12333: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 8 op/s 2024-09-16T12:28:25.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:28:24 smithi086 bash[24289]: cluster 2024-09-16T12:28:23.447245+0000 mgr.a (mgr.14373) 17783 : cluster [DBG] pgmap v12333: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 8 op/s 2024-09-16T12:28:25.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:28:24 smithi047 bash[22744]: cluster 2024-09-16T12:28:23.447245+0000 mgr.a (mgr.14373) 17783 : cluster [DBG] pgmap v12333: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 8 op/s 2024-09-16T12:28:27.015 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:28:27.016 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:28:27.016 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:28:27.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:28:26 smithi157 bash[24585]: cluster 2024-09-16T12:28:25.448034+0000 mgr.a (mgr.14373) 17784 : cluster [DBG] pgmap v12334: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T12:28:27.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:28:26 smithi086 bash[24289]: cluster 2024-09-16T12:28:25.448034+0000 mgr.a (mgr.14373) 17784 : cluster [DBG] pgmap v12334: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T12:28:27.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:28:26 smithi047 bash[22744]: cluster 2024-09-16T12:28:25.448034+0000 mgr.a (mgr.14373) 17784 : cluster [DBG] pgmap v12334: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T12:28:27.787 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:28:27.787 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:28:27.788 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:28:27.788 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:28:27.788 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:28:29.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:28:28 smithi157 bash[24585]: audit 2024-09-16T12:28:27.346901+0000 mgr.a (mgr.14373) 17785 : audit [DBG] from='client.382074 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:28:29.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:28:28 smithi157 bash[24585]: cluster 2024-09-16T12:28:27.449465+0000 mgr.a (mgr.14373) 17786 : cluster [DBG] pgmap v12335: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:28:29.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:28:28 smithi086 bash[24289]: audit 2024-09-16T12:28:27.346901+0000 mgr.a (mgr.14373) 17785 : audit [DBG] from='client.382074 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:28:29.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:28:28 smithi086 bash[24289]: cluster 2024-09-16T12:28:27.449465+0000 mgr.a (mgr.14373) 17786 : cluster [DBG] pgmap v12335: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:28:29.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:28:28 smithi047 bash[22744]: audit 2024-09-16T12:28:27.346901+0000 mgr.a (mgr.14373) 17785 : audit [DBG] from='client.382074 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:28:29.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:28:28 smithi047 bash[22744]: cluster 2024-09-16T12:28:27.449465+0000 mgr.a (mgr.14373) 17786 : cluster [DBG] pgmap v12335: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:28:31.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:28:30 smithi157 bash[24585]: cluster 2024-09-16T12:28:29.450490+0000 mgr.a (mgr.14373) 17787 : cluster [DBG] pgmap v12336: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T12:28:31.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:28:30 smithi086 bash[24289]: cluster 2024-09-16T12:28:29.450490+0000 mgr.a (mgr.14373) 17787 : cluster [DBG] pgmap v12336: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T12:28:31.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:28:30 smithi047 bash[22744]: cluster 2024-09-16T12:28:29.450490+0000 mgr.a (mgr.14373) 17787 : cluster [DBG] pgmap v12336: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T12:28:32.789 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:28:32.790 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:28:32.790 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:28:33.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:28:32 smithi157 bash[24585]: cluster 2024-09-16T12:28:31.451930+0000 mgr.a (mgr.14373) 17788 : cluster [DBG] pgmap v12337: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 6.2 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T12:28:33.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:28:32 smithi086 bash[24289]: cluster 2024-09-16T12:28:31.451930+0000 mgr.a (mgr.14373) 17788 : cluster [DBG] pgmap v12337: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 6.2 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T12:28:33.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:28:32 smithi047 bash[22744]: cluster 2024-09-16T12:28:31.451930+0000 mgr.a (mgr.14373) 17788 : cluster [DBG] pgmap v12337: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 6.2 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T12:28:33.545 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:28:33.546 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:28:33.546 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:28:33.546 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:28:33.546 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:28:35.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:28:34 smithi157 bash[24585]: audit 2024-09-16T12:28:33.120847+0000 mgr.a (mgr.14373) 17789 : audit [DBG] from='client.382152 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:28:35.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:28:34 smithi157 bash[24585]: cluster 2024-09-16T12:28:33.453093+0000 mgr.a (mgr.14373) 17790 : cluster [DBG] pgmap v12338: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 5.6 KiB/s rd, 341 B/s wr, 5 op/s 2024-09-16T12:28:35.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:28:34 smithi086 bash[24289]: audit 2024-09-16T12:28:33.120847+0000 mgr.a (mgr.14373) 17789 : audit [DBG] from='client.382152 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:28:35.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:28:34 smithi086 bash[24289]: cluster 2024-09-16T12:28:33.453093+0000 mgr.a (mgr.14373) 17790 : cluster [DBG] pgmap v12338: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 5.6 KiB/s rd, 341 B/s wr, 5 op/s 2024-09-16T12:28:35.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:28:34 smithi047 bash[22744]: audit 2024-09-16T12:28:33.120847+0000 mgr.a (mgr.14373) 17789 : audit [DBG] from='client.382152 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:28:35.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:28:34 smithi047 bash[22744]: cluster 2024-09-16T12:28:33.453093+0000 mgr.a (mgr.14373) 17790 : cluster [DBG] pgmap v12338: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 5.6 KiB/s rd, 341 B/s wr, 5 op/s 2024-09-16T12:28:37.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:28:37 smithi157 bash[24585]: cluster 2024-09-16T12:28:35.453828+0000 mgr.a (mgr.14373) 17791 : cluster [DBG] pgmap v12339: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:28:37.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:28:37 smithi086 bash[24289]: cluster 2024-09-16T12:28:35.453828+0000 mgr.a (mgr.14373) 17791 : cluster [DBG] pgmap v12339: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:28:37.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:28:37 smithi047 bash[22744]: cluster 2024-09-16T12:28:35.453828+0000 mgr.a (mgr.14373) 17791 : cluster [DBG] pgmap v12339: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:28:38.547 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:28:38.548 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:28:38.548 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:28:39.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:28:39 smithi157 bash[24585]: cluster 2024-09-16T12:28:37.456081+0000 mgr.a (mgr.14373) 17792 : cluster [DBG] pgmap v12340: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:28:39.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:28:39 smithi086 bash[24289]: cluster 2024-09-16T12:28:37.456081+0000 mgr.a (mgr.14373) 17792 : cluster [DBG] pgmap v12340: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:28:39.330 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:28:39.330 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:28:39.330 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:28:39.330 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:28:39.330 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:28:39.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:28:39 smithi047 bash[22744]: cluster 2024-09-16T12:28:37.456081+0000 mgr.a (mgr.14373) 17792 : cluster [DBG] pgmap v12340: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:28:40.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:28:40 smithi157 bash[24585]: audit 2024-09-16T12:28:38.878802+0000 mgr.a (mgr.14373) 17793 : audit [DBG] from='client.382230 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:28:40.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:28:40 smithi086 bash[24289]: audit 2024-09-16T12:28:38.878802+0000 mgr.a (mgr.14373) 17793 : audit [DBG] from='client.382230 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:28:40.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:28:40 smithi047 bash[22744]: audit 2024-09-16T12:28:38.878802+0000 mgr.a (mgr.14373) 17793 : audit [DBG] from='client.382230 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:28:41.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:28:41 smithi157 bash[24585]: cluster 2024-09-16T12:28:39.457019+0000 mgr.a (mgr.14373) 17794 : cluster [DBG] pgmap v12341: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:28:41.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:28:41 smithi086 bash[24289]: cluster 2024-09-16T12:28:39.457019+0000 mgr.a (mgr.14373) 17794 : cluster [DBG] pgmap v12341: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:28:41.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:28:41 smithi047 bash[22744]: cluster 2024-09-16T12:28:39.457019+0000 mgr.a (mgr.14373) 17794 : cluster [DBG] pgmap v12341: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:28:43.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:28:43 smithi157 bash[24585]: cluster 2024-09-16T12:28:41.458486+0000 mgr.a (mgr.14373) 17795 : cluster [DBG] pgmap v12342: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 30 KiB/s rd, 0 B/s wr, 49 op/s 2024-09-16T12:28:43.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:28:43 smithi086 bash[24289]: cluster 2024-09-16T12:28:41.458486+0000 mgr.a (mgr.14373) 17795 : cluster [DBG] pgmap v12342: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 30 KiB/s rd, 0 B/s wr, 49 op/s 2024-09-16T12:28:43.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:28:43 smithi047 bash[22744]: cluster 2024-09-16T12:28:41.458486+0000 mgr.a (mgr.14373) 17795 : cluster [DBG] pgmap v12342: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 30 KiB/s rd, 0 B/s wr, 49 op/s 2024-09-16T12:28:44.332 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:28:44.332 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:28:44.333 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:28:45.120 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:28:45.120 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:28:45.120 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:28:45.121 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:28:45.121 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:28:45.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:28:45 smithi157 bash[24585]: cluster 2024-09-16T12:28:43.460210+0000 mgr.a (mgr.14373) 17796 : cluster [DBG] pgmap v12343: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 66 KiB/s rd, 0 B/s wr, 108 op/s 2024-09-16T12:28:45.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:28:45 smithi086 bash[24289]: cluster 2024-09-16T12:28:43.460210+0000 mgr.a (mgr.14373) 17796 : cluster [DBG] pgmap v12343: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 66 KiB/s rd, 0 B/s wr, 108 op/s 2024-09-16T12:28:45.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:28:45 smithi047 bash[22744]: cluster 2024-09-16T12:28:43.460210+0000 mgr.a (mgr.14373) 17796 : cluster [DBG] pgmap v12343: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 66 KiB/s rd, 0 B/s wr, 108 op/s 2024-09-16T12:28:46.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:28:46 smithi157 bash[24585]: audit 2024-09-16T12:28:44.665883+0000 mgr.a (mgr.14373) 17797 : audit [DBG] from='client.382305 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:28:46.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:28:46 smithi086 bash[24289]: audit 2024-09-16T12:28:44.665883+0000 mgr.a (mgr.14373) 17797 : audit [DBG] from='client.382305 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:28:46.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:28:46 smithi047 bash[22744]: audit 2024-09-16T12:28:44.665883+0000 mgr.a (mgr.14373) 17797 : audit [DBG] from='client.382305 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:28:47.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:28:47 smithi157 bash[24585]: cluster 2024-09-16T12:28:45.461219+0000 mgr.a (mgr.14373) 17798 : cluster [DBG] pgmap v12344: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 65 KiB/s rd, 0 B/s wr, 107 op/s 2024-09-16T12:28:47.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:28:47 smithi086 bash[24289]: cluster 2024-09-16T12:28:45.461219+0000 mgr.a (mgr.14373) 17798 : cluster [DBG] pgmap v12344: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 65 KiB/s rd, 0 B/s wr, 107 op/s 2024-09-16T12:28:47.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:28:47 smithi047 bash[22744]: cluster 2024-09-16T12:28:45.461219+0000 mgr.a (mgr.14373) 17798 : cluster [DBG] pgmap v12344: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 65 KiB/s rd, 0 B/s wr, 107 op/s 2024-09-16T12:28:49.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:28:49 smithi157 bash[24585]: cluster 2024-09-16T12:28:47.463511+0000 mgr.a (mgr.14373) 17799 : cluster [DBG] pgmap v12345: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 66 KiB/s rd, 0 B/s wr, 108 op/s 2024-09-16T12:28:49.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:28:49 smithi086 bash[24289]: cluster 2024-09-16T12:28:47.463511+0000 mgr.a (mgr.14373) 17799 : cluster [DBG] pgmap v12345: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 66 KiB/s rd, 0 B/s wr, 108 op/s 2024-09-16T12:28:49.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:28:49 smithi047 bash[22744]: cluster 2024-09-16T12:28:47.463511+0000 mgr.a (mgr.14373) 17799 : cluster [DBG] pgmap v12345: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 66 KiB/s rd, 0 B/s wr, 108 op/s 2024-09-16T12:28:50.121 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:28:50.123 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:28:50.123 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:28:50.899 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:28:50.900 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:28:50.900 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:28:50.900 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:28:50.900 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:28:51.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:28:51 smithi157 bash[24585]: cluster 2024-09-16T12:28:49.464226+0000 mgr.a (mgr.14373) 17800 : cluster [DBG] pgmap v12346: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 65 KiB/s rd, 0 B/s wr, 107 op/s 2024-09-16T12:28:51.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:28:51 smithi086 bash[24289]: cluster 2024-09-16T12:28:49.464226+0000 mgr.a (mgr.14373) 17800 : cluster [DBG] pgmap v12346: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 65 KiB/s rd, 0 B/s wr, 107 op/s 2024-09-16T12:28:51.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:28:51 smithi047 bash[22744]: cluster 2024-09-16T12:28:49.464226+0000 mgr.a (mgr.14373) 17800 : cluster [DBG] pgmap v12346: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 65 KiB/s rd, 0 B/s wr, 107 op/s 2024-09-16T12:28:52.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:28:52 smithi157 bash[24585]: audit 2024-09-16T12:28:50.456106+0000 mgr.a (mgr.14373) 17801 : audit [DBG] from='client.382380 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:28:52.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:28:52 smithi086 bash[24289]: audit 2024-09-16T12:28:50.456106+0000 mgr.a (mgr.14373) 17801 : audit [DBG] from='client.382380 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:28:52.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:28:52 smithi047 bash[22744]: audit 2024-09-16T12:28:50.456106+0000 mgr.a (mgr.14373) 17801 : audit [DBG] from='client.382380 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:28:53.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:28:53 smithi157 bash[24585]: cluster 2024-09-16T12:28:51.465704+0000 mgr.a (mgr.14373) 17802 : cluster [DBG] pgmap v12347: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 65 KiB/s rd, 0 B/s wr, 107 op/s 2024-09-16T12:28:53.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:28:53 smithi086 bash[24289]: cluster 2024-09-16T12:28:51.465704+0000 mgr.a (mgr.14373) 17802 : cluster [DBG] pgmap v12347: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 65 KiB/s rd, 0 B/s wr, 107 op/s 2024-09-16T12:28:53.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:28:53 smithi047 bash[22744]: cluster 2024-09-16T12:28:51.465704+0000 mgr.a (mgr.14373) 17802 : cluster [DBG] pgmap v12347: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 65 KiB/s rd, 0 B/s wr, 107 op/s 2024-09-16T12:28:55.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:28:55 smithi086 bash[24289]: cluster 2024-09-16T12:28:53.467380+0000 mgr.a (mgr.14373) 17803 : cluster [DBG] pgmap v12348: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 38 KiB/s rd, 0 B/s wr, 60 op/s 2024-09-16T12:28:55.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:28:55 smithi047 bash[22744]: cluster 2024-09-16T12:28:53.467380+0000 mgr.a (mgr.14373) 17803 : cluster [DBG] pgmap v12348: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 38 KiB/s rd, 0 B/s wr, 60 op/s 2024-09-16T12:28:55.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:28:55 smithi157 bash[24585]: cluster 2024-09-16T12:28:53.467380+0000 mgr.a (mgr.14373) 17803 : cluster [DBG] pgmap v12348: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 38 KiB/s rd, 0 B/s wr, 60 op/s 2024-09-16T12:28:55.901 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:28:55.902 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:28:55.902 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:28:56.679 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:28:56.680 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:28:56.680 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:28:56.680 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:28:56.680 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:28:57.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:28:57 smithi086 bash[24289]: cluster 2024-09-16T12:28:55.468152+0000 mgr.a (mgr.14373) 17804 : cluster [DBG] pgmap v12349: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:28:57.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:28:57 smithi047 bash[22744]: cluster 2024-09-16T12:28:55.468152+0000 mgr.a (mgr.14373) 17804 : cluster [DBG] pgmap v12349: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:28:57.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:28:57 smithi157 bash[24585]: cluster 2024-09-16T12:28:55.468152+0000 mgr.a (mgr.14373) 17804 : cluster [DBG] pgmap v12349: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:28:58.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:28:58 smithi086 bash[24289]: audit 2024-09-16T12:28:56.235970+0000 mgr.a (mgr.14373) 17805 : audit [DBG] from='client.382458 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:28:58.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:28:58 smithi047 bash[22744]: audit 2024-09-16T12:28:56.235970+0000 mgr.a (mgr.14373) 17805 : audit [DBG] from='client.382458 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:28:58.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:28:58 smithi157 bash[24585]: audit 2024-09-16T12:28:56.235970+0000 mgr.a (mgr.14373) 17805 : audit [DBG] from='client.382458 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:28:59.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:28:59 smithi086 bash[24289]: cluster 2024-09-16T12:28:57.470884+0000 mgr.a (mgr.14373) 17806 : cluster [DBG] pgmap v12350: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-16T12:28:59.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:28:59 smithi047 bash[22744]: cluster 2024-09-16T12:28:57.470884+0000 mgr.a (mgr.14373) 17806 : cluster [DBG] pgmap v12350: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-16T12:28:59.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:28:59 smithi157 bash[24585]: cluster 2024-09-16T12:28:57.470884+0000 mgr.a (mgr.14373) 17806 : cluster [DBG] pgmap v12350: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-16T12:29:01.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:29:01 smithi047 bash[22744]: cluster 2024-09-16T12:28:59.471677+0000 mgr.a (mgr.14373) 17807 : cluster [DBG] pgmap v12351: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-16T12:29:01.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:29:01 smithi157 bash[24585]: cluster 2024-09-16T12:28:59.471677+0000 mgr.a (mgr.14373) 17807 : cluster [DBG] pgmap v12351: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-16T12:29:01.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:29:01 smithi086 bash[24289]: cluster 2024-09-16T12:28:59.471677+0000 mgr.a (mgr.14373) 17807 : cluster [DBG] pgmap v12351: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-16T12:29:01.681 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:29:01.681 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:29:01.682 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:29:02.447 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:29:02.447 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:29:02.447 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:29:02.447 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:29:02.447 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:29:03.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:29:03 smithi047 bash[22744]: cluster 2024-09-16T12:29:01.472861+0000 mgr.a (mgr.14373) 17808 : cluster [DBG] pgmap v12352: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T12:29:03.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:29:03 smithi047 bash[22744]: audit 2024-09-16T12:29:02.012975+0000 mgr.a (mgr.14373) 17809 : audit [DBG] from='client.382536 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:29:03.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:29:03 smithi157 bash[24585]: cluster 2024-09-16T12:29:01.472861+0000 mgr.a (mgr.14373) 17808 : cluster [DBG] pgmap v12352: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T12:29:03.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:29:03 smithi157 bash[24585]: audit 2024-09-16T12:29:02.012975+0000 mgr.a (mgr.14373) 17809 : audit [DBG] from='client.382536 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:29:03.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:29:03 smithi086 bash[24289]: cluster 2024-09-16T12:29:01.472861+0000 mgr.a (mgr.14373) 17808 : cluster [DBG] pgmap v12352: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T12:29:03.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:29:03 smithi086 bash[24289]: audit 2024-09-16T12:29:02.012975+0000 mgr.a (mgr.14373) 17809 : audit [DBG] from='client.382536 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:29:05.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:29:05 smithi047 bash[22744]: cluster 2024-09-16T12:29:03.475075+0000 mgr.a (mgr.14373) 17810 : cluster [DBG] pgmap v12353: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-16T12:29:05.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:29:05 smithi157 bash[24585]: cluster 2024-09-16T12:29:03.475075+0000 mgr.a (mgr.14373) 17810 : cluster [DBG] pgmap v12353: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-16T12:29:05.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:29:05 smithi086 bash[24289]: cluster 2024-09-16T12:29:03.475075+0000 mgr.a (mgr.14373) 17810 : cluster [DBG] pgmap v12353: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-16T12:29:07.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:29:07 smithi047 bash[22744]: cluster 2024-09-16T12:29:05.475867+0000 mgr.a (mgr.14373) 17811 : cluster [DBG] pgmap v12354: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:29:07.448 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:29:07.449 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:29:07.449 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:29:07.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:29:07 smithi157 bash[24585]: cluster 2024-09-16T12:29:05.475867+0000 mgr.a (mgr.14373) 17811 : cluster [DBG] pgmap v12354: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:29:07.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:29:07 smithi086 bash[24289]: cluster 2024-09-16T12:29:05.475867+0000 mgr.a (mgr.14373) 17811 : cluster [DBG] pgmap v12354: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:29:08.238 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:29:08.239 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:29:08.239 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:29:08.239 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:29:08.239 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:29:09.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:29:09 smithi157 bash[24585]: cluster 2024-09-16T12:29:07.477810+0000 mgr.a (mgr.14373) 17812 : cluster [DBG] pgmap v12355: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:29:09.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:29:09 smithi157 bash[24585]: audit 2024-09-16T12:29:07.781954+0000 mgr.a (mgr.14373) 17813 : audit [DBG] from='client.382611 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:29:09.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:29:09 smithi086 bash[24289]: cluster 2024-09-16T12:29:07.477810+0000 mgr.a (mgr.14373) 17812 : cluster [DBG] pgmap v12355: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:29:09.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:29:09 smithi086 bash[24289]: audit 2024-09-16T12:29:07.781954+0000 mgr.a (mgr.14373) 17813 : audit [DBG] from='client.382611 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:29:09.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:29:09 smithi047 bash[22744]: cluster 2024-09-16T12:29:07.477810+0000 mgr.a (mgr.14373) 17812 : cluster [DBG] pgmap v12355: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:29:09.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:29:09 smithi047 bash[22744]: audit 2024-09-16T12:29:07.781954+0000 mgr.a (mgr.14373) 17813 : audit [DBG] from='client.382611 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:29:11.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:29:11 smithi157 bash[24585]: cluster 2024-09-16T12:29:09.478735+0000 mgr.a (mgr.14373) 17814 : cluster [DBG] pgmap v12356: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-16T12:29:11.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:29:11 smithi086 bash[24289]: cluster 2024-09-16T12:29:09.478735+0000 mgr.a (mgr.14373) 17814 : cluster [DBG] pgmap v12356: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-16T12:29:11.596 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:29:11 smithi047 bash[22744]: cluster 2024-09-16T12:29:09.478735+0000 mgr.a (mgr.14373) 17814 : cluster [DBG] pgmap v12356: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-16T12:29:13.240 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:29:13.240 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:29:13.241 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:29:13.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:29:13 smithi157 bash[24585]: cluster 2024-09-16T12:29:11.480112+0000 mgr.a (mgr.14373) 17815 : cluster [DBG] pgmap v12357: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-16T12:29:13.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:29:13 smithi086 bash[24289]: cluster 2024-09-16T12:29:11.480112+0000 mgr.a (mgr.14373) 17815 : cluster [DBG] pgmap v12357: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-16T12:29:13.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:29:13 smithi047 bash[22744]: cluster 2024-09-16T12:29:11.480112+0000 mgr.a (mgr.14373) 17815 : cluster [DBG] pgmap v12357: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-16T12:29:14.022 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:29:14.022 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:29:14.022 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:29:14.022 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:29:14.022 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:29:15.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:29:15 smithi157 bash[24585]: cluster 2024-09-16T12:29:13.481163+0000 mgr.a (mgr.14373) 17816 : cluster [DBG] pgmap v12358: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-16T12:29:15.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:29:15 smithi157 bash[24585]: audit 2024-09-16T12:29:13.577443+0000 mgr.a (mgr.14373) 17817 : audit [DBG] from='client.382686 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:29:15.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:29:15 smithi086 bash[24289]: cluster 2024-09-16T12:29:13.481163+0000 mgr.a (mgr.14373) 17816 : cluster [DBG] pgmap v12358: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-16T12:29:15.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:29:15 smithi086 bash[24289]: audit 2024-09-16T12:29:13.577443+0000 mgr.a (mgr.14373) 17817 : audit [DBG] from='client.382686 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:29:15.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:29:15 smithi047 bash[22744]: cluster 2024-09-16T12:29:13.481163+0000 mgr.a (mgr.14373) 17816 : cluster [DBG] pgmap v12358: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-16T12:29:15.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:29:15 smithi047 bash[22744]: audit 2024-09-16T12:29:13.577443+0000 mgr.a (mgr.14373) 17817 : audit [DBG] from='client.382686 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:29:16.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:29:16 smithi157 bash[24585]: cluster 2024-09-16T12:29:15.482023+0000 mgr.a (mgr.14373) 17818 : cluster [DBG] pgmap v12359: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:29:16.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:29:16 smithi086 bash[24289]: cluster 2024-09-16T12:29:15.482023+0000 mgr.a (mgr.14373) 17818 : cluster [DBG] pgmap v12359: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:29:16.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:29:16 smithi047 bash[22744]: cluster 2024-09-16T12:29:15.482023+0000 mgr.a (mgr.14373) 17818 : cluster [DBG] pgmap v12359: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:29:18.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:29:18 smithi157 bash[24585]: cluster 2024-09-16T12:29:17.484300+0000 mgr.a (mgr.14373) 17819 : cluster [DBG] pgmap v12360: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:29:18.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:29:18 smithi086 bash[24289]: cluster 2024-09-16T12:29:17.484300+0000 mgr.a (mgr.14373) 17819 : cluster [DBG] pgmap v12360: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:29:18.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:29:18 smithi047 bash[22744]: cluster 2024-09-16T12:29:17.484300+0000 mgr.a (mgr.14373) 17819 : cluster [DBG] pgmap v12360: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:29:19.023 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:29:19.024 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:29:19.024 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:29:19.807 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:29:19.807 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:29:19.807 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:29:19.807 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:29:19.807 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:29:20.808 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:29:20 smithi157 bash[24585]: audit 2024-09-16T12:29:19.358749+0000 mgr.a (mgr.14373) 17820 : audit [DBG] from='client.382764 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:29:20.808 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:29:20 smithi157 bash[24585]: cluster 2024-09-16T12:29:19.484829+0000 mgr.a (mgr.14373) 17821 : cluster [DBG] pgmap v12361: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:29:20.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:29:20 smithi086 bash[24289]: audit 2024-09-16T12:29:19.358749+0000 mgr.a (mgr.14373) 17820 : audit [DBG] from='client.382764 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:29:20.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:29:20 smithi086 bash[24289]: cluster 2024-09-16T12:29:19.484829+0000 mgr.a (mgr.14373) 17821 : cluster [DBG] pgmap v12361: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:29:20.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:29:20 smithi047 bash[22744]: audit 2024-09-16T12:29:19.358749+0000 mgr.a (mgr.14373) 17820 : audit [DBG] from='client.382764 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:29:20.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:29:20 smithi047 bash[22744]: cluster 2024-09-16T12:29:19.484829+0000 mgr.a (mgr.14373) 17821 : cluster [DBG] pgmap v12361: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:29:21.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:29:21 smithi157 bash[24585]: audit 2024-09-16T12:29:21.298673+0000 mon.b (mon.2) 1614 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T12:29:21.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:29:21 smithi086 bash[24289]: audit 2024-09-16T12:29:21.298673+0000 mon.b (mon.2) 1614 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T12:29:21.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:29:21 smithi047 bash[22744]: audit 2024-09-16T12:29:21.298673+0000 mon.b (mon.2) 1614 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T12:29:22.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:29:22 smithi086 bash[24289]: cluster 2024-09-16T12:29:21.486576+0000 mgr.a (mgr.14373) 17822 : cluster [DBG] pgmap v12362: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-16T12:29:22.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:29:22 smithi047 bash[22744]: cluster 2024-09-16T12:29:21.486576+0000 mgr.a (mgr.14373) 17822 : cluster [DBG] pgmap v12362: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-16T12:29:23.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:29:22 smithi157 bash[24585]: cluster 2024-09-16T12:29:21.486576+0000 mgr.a (mgr.14373) 17822 : cluster [DBG] pgmap v12362: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-16T12:29:24.808 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:29:24.809 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:29:24.809 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:29:24.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:29:24 smithi086 bash[24289]: cluster 2024-09-16T12:29:23.487762+0000 mgr.a (mgr.14373) 17823 : cluster [DBG] pgmap v12363: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:29:24.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:29:24 smithi047 bash[22744]: cluster 2024-09-16T12:29:23.487762+0000 mgr.a (mgr.14373) 17823 : cluster [DBG] pgmap v12363: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:29:25.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:29:24 smithi157 bash[24585]: cluster 2024-09-16T12:29:23.487762+0000 mgr.a (mgr.14373) 17823 : cluster [DBG] pgmap v12363: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:29:25.558 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:29:25.559 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:29:25.559 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:29:25.559 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:29:25.559 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:29:26.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:29:26 smithi086 bash[24289]: audit 2024-09-16T12:29:25.128541+0000 mgr.a (mgr.14373) 17824 : audit [DBG] from='client.382842 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:29:26.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:29:26 smithi086 bash[24289]: cluster 2024-09-16T12:29:25.488698+0000 mgr.a (mgr.14373) 17825 : cluster [DBG] pgmap v12364: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:29:26.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:29:26 smithi047 bash[22744]: audit 2024-09-16T12:29:25.128541+0000 mgr.a (mgr.14373) 17824 : audit [DBG] from='client.382842 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:29:26.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:29:26 smithi047 bash[22744]: cluster 2024-09-16T12:29:25.488698+0000 mgr.a (mgr.14373) 17825 : cluster [DBG] pgmap v12364: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:29:27.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:29:26 smithi157 bash[24585]: audit 2024-09-16T12:29:25.128541+0000 mgr.a (mgr.14373) 17824 : audit [DBG] from='client.382842 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:29:27.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:29:26 smithi157 bash[24585]: cluster 2024-09-16T12:29:25.488698+0000 mgr.a (mgr.14373) 17825 : cluster [DBG] pgmap v12364: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:29:28.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:29:27 smithi157 bash[24585]: audit 2024-09-16T12:29:26.642832+0000 mon.a (mon.0) 1628 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:29:28.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:29:27 smithi157 bash[24585]: audit 2024-09-16T12:29:26.651797+0000 mon.a (mon.0) 1629 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:29:28.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:29:27 smithi157 bash[24585]: audit 2024-09-16T12:29:26.662485+0000 mon.a (mon.0) 1630 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:29:28.058 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:29:27 smithi157 bash[24585]: audit 2024-09-16T12:29:26.667111+0000 mon.a (mon.0) 1631 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:29:28.058 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:29:27 smithi157 bash[24585]: audit 2024-09-16T12:29:26.681000+0000 mon.a (mon.0) 1632 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:29:28.058 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:29:27 smithi157 bash[24585]: audit 2024-09-16T12:29:26.689336+0000 mon.a (mon.0) 1633 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:29:28.058 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:29:27 smithi157 bash[24585]: audit 2024-09-16T12:29:27.399087+0000 mon.b (mon.2) 1615 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T12:29:28.058 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:29:27 smithi157 bash[24585]: audit 2024-09-16T12:29:27.401517+0000 mon.b (mon.2) 1616 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T12:29:28.058 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:29:27 smithi157 bash[24585]: audit 2024-09-16T12:29:27.412687+0000 mon.a (mon.0) 1634 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:29:28.058 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:29:27 smithi157 bash[24585]: audit 2024-09-16T12:29:27.418448+0000 mon.b (mon.2) 1617 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:29:28.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:29:27 smithi086 bash[24289]: audit 2024-09-16T12:29:26.642832+0000 mon.a (mon.0) 1628 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:29:28.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:29:27 smithi086 bash[24289]: audit 2024-09-16T12:29:26.651797+0000 mon.a (mon.0) 1629 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:29:28.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:29:27 smithi086 bash[24289]: audit 2024-09-16T12:29:26.662485+0000 mon.a (mon.0) 1630 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:29:28.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:29:27 smithi086 bash[24289]: audit 2024-09-16T12:29:26.667111+0000 mon.a (mon.0) 1631 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:29:28.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:29:27 smithi086 bash[24289]: audit 2024-09-16T12:29:26.681000+0000 mon.a (mon.0) 1632 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:29:28.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:29:27 smithi086 bash[24289]: audit 2024-09-16T12:29:26.689336+0000 mon.a (mon.0) 1633 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:29:28.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:29:27 smithi086 bash[24289]: audit 2024-09-16T12:29:27.399087+0000 mon.b (mon.2) 1615 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T12:29:28.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:29:27 smithi086 bash[24289]: audit 2024-09-16T12:29:27.401517+0000 mon.b (mon.2) 1616 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T12:29:28.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:29:27 smithi086 bash[24289]: audit 2024-09-16T12:29:27.412687+0000 mon.a (mon.0) 1634 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:29:28.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:29:27 smithi086 bash[24289]: audit 2024-09-16T12:29:27.418448+0000 mon.b (mon.2) 1617 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:29:28.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:29:27 smithi047 bash[22744]: audit 2024-09-16T12:29:26.642832+0000 mon.a (mon.0) 1628 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:29:28.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:29:27 smithi047 bash[22744]: audit 2024-09-16T12:29:26.651797+0000 mon.a (mon.0) 1629 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:29:28.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:29:27 smithi047 bash[22744]: audit 2024-09-16T12:29:26.662485+0000 mon.a (mon.0) 1630 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:29:28.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:29:27 smithi047 bash[22744]: audit 2024-09-16T12:29:26.667111+0000 mon.a (mon.0) 1631 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:29:28.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:29:27 smithi047 bash[22744]: audit 2024-09-16T12:29:26.681000+0000 mon.a (mon.0) 1632 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:29:28.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:29:27 smithi047 bash[22744]: audit 2024-09-16T12:29:26.689336+0000 mon.a (mon.0) 1633 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:29:28.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:29:27 smithi047 bash[22744]: audit 2024-09-16T12:29:27.399087+0000 mon.b (mon.2) 1615 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T12:29:28.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:29:27 smithi047 bash[22744]: audit 2024-09-16T12:29:27.401517+0000 mon.b (mon.2) 1616 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T12:29:28.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:29:27 smithi047 bash[22744]: audit 2024-09-16T12:29:27.412687+0000 mon.a (mon.0) 1634 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:29:28.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:29:27 smithi047 bash[22744]: audit 2024-09-16T12:29:27.418448+0000 mon.b (mon.2) 1617 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:29:28.593 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 12:29:28 smithi047 bash[22994]: debug 2024-09-16T12:29:28.151+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T12:29:28.593 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 12:29:28 smithi047 bash[22994]: debug 2024-09-16T12:29:28.151+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T12:29:29.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:29:28 smithi157 bash[24585]: audit 2024-09-16T12:29:27.420912+0000 mgr.a (mgr.14373) 17826 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:29:29.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:29:28 smithi157 bash[24585]: cluster 2024-09-16T12:29:27.491087+0000 mgr.a (mgr.14373) 17827 : cluster [DBG] pgmap v12365: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:29:29.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:29:28 smithi086 bash[24289]: audit 2024-09-16T12:29:27.420912+0000 mgr.a (mgr.14373) 17826 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:29:29.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:29:28 smithi086 bash[24289]: cluster 2024-09-16T12:29:27.491087+0000 mgr.a (mgr.14373) 17827 : cluster [DBG] pgmap v12365: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:29:29.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:29:28 smithi047 bash[22744]: audit 2024-09-16T12:29:27.420912+0000 mgr.a (mgr.14373) 17826 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:29:29.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:29:28 smithi047 bash[22744]: cluster 2024-09-16T12:29:27.491087+0000 mgr.a (mgr.14373) 17827 : cluster [DBG] pgmap v12365: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:29:30.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:29:29 smithi157 bash[24585]: audit 2024-09-16T12:29:28.154596+0000 mgr.a (mgr.14373) 17828 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T12:29:30.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:29:29 smithi157 bash[24585]: cephadm 2024-09-16T12:29:28.156378+0000 mgr.a (mgr.14373) 17829 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T12:29:30.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:29:29 smithi086 bash[24289]: audit 2024-09-16T12:29:28.154596+0000 mgr.a (mgr.14373) 17828 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T12:29:30.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:29:29 smithi086 bash[24289]: cephadm 2024-09-16T12:29:28.156378+0000 mgr.a (mgr.14373) 17829 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T12:29:30.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:29:29 smithi047 bash[22744]: audit 2024-09-16T12:29:28.154596+0000 mgr.a (mgr.14373) 17828 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T12:29:30.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:29:29 smithi047 bash[22744]: cephadm 2024-09-16T12:29:28.156378+0000 mgr.a (mgr.14373) 17829 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T12:29:30.560 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:29:30.561 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:29:30.561 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:29:31.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:29:30 smithi157 bash[24585]: cluster 2024-09-16T12:29:29.491936+0000 mgr.a (mgr.14373) 17830 : cluster [DBG] pgmap v12366: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:29:31.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:29:30 smithi086 bash[24289]: cluster 2024-09-16T12:29:29.491936+0000 mgr.a (mgr.14373) 17830 : cluster [DBG] pgmap v12366: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:29:31.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:29:30 smithi047 bash[22744]: cluster 2024-09-16T12:29:29.491936+0000 mgr.a (mgr.14373) 17830 : cluster [DBG] pgmap v12366: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:29:31.327 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:29:31.327 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:29:31.327 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:29:31.328 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:29:31.328 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:29:32.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:29:31 smithi157 bash[24585]: audit 2024-09-16T12:29:30.897892+0000 mgr.a (mgr.14373) 17831 : audit [DBG] from='client.383022 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:29:32.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:29:31 smithi086 bash[24289]: audit 2024-09-16T12:29:30.897892+0000 mgr.a (mgr.14373) 17831 : audit [DBG] from='client.383022 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:29:32.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:29:31 smithi047 bash[22744]: audit 2024-09-16T12:29:30.897892+0000 mgr.a (mgr.14373) 17831 : audit [DBG] from='client.383022 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:29:33.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:29:32 smithi157 bash[24585]: cluster 2024-09-16T12:29:31.493848+0000 mgr.a (mgr.14373) 17832 : cluster [DBG] pgmap v12367: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 4.6 KiB/s rd, 85 B/s wr, 4 op/s 2024-09-16T12:29:33.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:29:32 smithi086 bash[24289]: cluster 2024-09-16T12:29:31.493848+0000 mgr.a (mgr.14373) 17832 : cluster [DBG] pgmap v12367: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 4.6 KiB/s rd, 85 B/s wr, 4 op/s 2024-09-16T12:29:33.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:29:32 smithi047 bash[22744]: cluster 2024-09-16T12:29:31.493848+0000 mgr.a (mgr.14373) 17832 : cluster [DBG] pgmap v12367: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 4.6 KiB/s rd, 85 B/s wr, 4 op/s 2024-09-16T12:29:35.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:29:34 smithi157 bash[24585]: cluster 2024-09-16T12:29:33.495124+0000 mgr.a (mgr.14373) 17833 : cluster [DBG] pgmap v12368: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.6 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:29:35.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:29:34 smithi086 bash[24289]: cluster 2024-09-16T12:29:33.495124+0000 mgr.a (mgr.14373) 17833 : cluster [DBG] pgmap v12368: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.6 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:29:35.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:29:34 smithi047 bash[22744]: cluster 2024-09-16T12:29:33.495124+0000 mgr.a (mgr.14373) 17833 : cluster [DBG] pgmap v12368: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.6 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:29:36.332 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:29:36.333 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:29:36.333 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:29:37.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:29:36 smithi157 bash[24585]: cluster 2024-09-16T12:29:35.495875+0000 mgr.a (mgr.14373) 17834 : cluster [DBG] pgmap v12369: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:29:37.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:29:36 smithi086 bash[24289]: cluster 2024-09-16T12:29:35.495875+0000 mgr.a (mgr.14373) 17834 : cluster [DBG] pgmap v12369: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:29:37.084 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:29:37.084 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:29:37.084 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:29:37.084 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:29:37.084 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:29:37.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:29:36 smithi047 bash[22744]: cluster 2024-09-16T12:29:35.495875+0000 mgr.a (mgr.14373) 17834 : cluster [DBG] pgmap v12369: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:29:38.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:29:37 smithi157 bash[24585]: audit 2024-09-16T12:29:36.652547+0000 mgr.a (mgr.14373) 17835 : audit [DBG] from='client.383097 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:29:38.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:29:37 smithi086 bash[24289]: audit 2024-09-16T12:29:36.652547+0000 mgr.a (mgr.14373) 17835 : audit [DBG] from='client.383097 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:29:38.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:29:37 smithi047 bash[22744]: audit 2024-09-16T12:29:36.652547+0000 mgr.a (mgr.14373) 17835 : audit [DBG] from='client.383097 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:29:39.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:29:38 smithi157 bash[24585]: cluster 2024-09-16T12:29:37.498530+0000 mgr.a (mgr.14373) 17836 : cluster [DBG] pgmap v12370: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:29:39.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:29:38 smithi086 bash[24289]: cluster 2024-09-16T12:29:37.498530+0000 mgr.a (mgr.14373) 17836 : cluster [DBG] pgmap v12370: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:29:39.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:29:38 smithi047 bash[22744]: cluster 2024-09-16T12:29:37.498530+0000 mgr.a (mgr.14373) 17836 : cluster [DBG] pgmap v12370: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:29:41.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:29:40 smithi157 bash[24585]: cluster 2024-09-16T12:29:39.499242+0000 mgr.a (mgr.14373) 17837 : cluster [DBG] pgmap v12371: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T12:29:41.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:29:40 smithi086 bash[24289]: cluster 2024-09-16T12:29:39.499242+0000 mgr.a (mgr.14373) 17837 : cluster [DBG] pgmap v12371: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T12:29:41.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:29:40 smithi047 bash[22744]: cluster 2024-09-16T12:29:39.499242+0000 mgr.a (mgr.14373) 17837 : cluster [DBG] pgmap v12371: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T12:29:42.086 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:29:42.086 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:29:42.086 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:29:42.874 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:29:42.874 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:29:42.874 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:29:42.874 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:29:42.874 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:29:43.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:29:42 smithi157 bash[24585]: cluster 2024-09-16T12:29:41.500945+0000 mgr.a (mgr.14373) 17838 : cluster [DBG] pgmap v12372: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 6.4 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T12:29:43.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:29:42 smithi086 bash[24289]: cluster 2024-09-16T12:29:41.500945+0000 mgr.a (mgr.14373) 17838 : cluster [DBG] pgmap v12372: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 6.4 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T12:29:43.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:29:42 smithi047 bash[22744]: cluster 2024-09-16T12:29:41.500945+0000 mgr.a (mgr.14373) 17838 : cluster [DBG] pgmap v12372: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 6.4 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T12:29:44.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:29:43 smithi157 bash[24585]: audit 2024-09-16T12:29:42.420408+0000 mgr.a (mgr.14373) 17839 : audit [DBG] from='client.383175 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:29:44.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:29:43 smithi086 bash[24289]: audit 2024-09-16T12:29:42.420408+0000 mgr.a (mgr.14373) 17839 : audit [DBG] from='client.383175 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:29:44.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:29:43 smithi047 bash[22744]: audit 2024-09-16T12:29:42.420408+0000 mgr.a (mgr.14373) 17839 : audit [DBG] from='client.383175 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:29:45.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:29:44 smithi157 bash[24585]: cluster 2024-09-16T12:29:43.502662+0000 mgr.a (mgr.14373) 17840 : cluster [DBG] pgmap v12373: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 4.2 KiB/s rd, 341 B/s wr, 4 op/s 2024-09-16T12:29:45.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:29:44 smithi086 bash[24289]: cluster 2024-09-16T12:29:43.502662+0000 mgr.a (mgr.14373) 17840 : cluster [DBG] pgmap v12373: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 4.2 KiB/s rd, 341 B/s wr, 4 op/s 2024-09-16T12:29:45.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:29:44 smithi047 bash[22744]: cluster 2024-09-16T12:29:43.502662+0000 mgr.a (mgr.14373) 17840 : cluster [DBG] pgmap v12373: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 4.2 KiB/s rd, 341 B/s wr, 4 op/s 2024-09-16T12:29:47.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:29:46 smithi157 bash[24585]: cluster 2024-09-16T12:29:45.503438+0000 mgr.a (mgr.14373) 17841 : cluster [DBG] pgmap v12374: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:29:47.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:29:46 smithi086 bash[24289]: cluster 2024-09-16T12:29:45.503438+0000 mgr.a (mgr.14373) 17841 : cluster [DBG] pgmap v12374: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:29:47.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:29:46 smithi047 bash[22744]: cluster 2024-09-16T12:29:45.503438+0000 mgr.a (mgr.14373) 17841 : cluster [DBG] pgmap v12374: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:29:47.876 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:29:47.876 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:29:47.876 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:29:48.630 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:29:48.630 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:29:48.630 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:29:48.630 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:29:48.630 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:29:49.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:29:48 smithi157 bash[24585]: cluster 2024-09-16T12:29:47.505470+0000 mgr.a (mgr.14373) 17842 : cluster [DBG] pgmap v12375: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:29:49.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:29:48 smithi086 bash[24289]: cluster 2024-09-16T12:29:47.505470+0000 mgr.a (mgr.14373) 17842 : cluster [DBG] pgmap v12375: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:29:49.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:29:48 smithi047 bash[22744]: cluster 2024-09-16T12:29:47.505470+0000 mgr.a (mgr.14373) 17842 : cluster [DBG] pgmap v12375: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:29:50.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:29:49 smithi157 bash[24585]: audit 2024-09-16T12:29:48.206972+0000 mgr.a (mgr.14373) 17843 : audit [DBG] from='client.383250 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:29:50.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:29:49 smithi086 bash[24289]: audit 2024-09-16T12:29:48.206972+0000 mgr.a (mgr.14373) 17843 : audit [DBG] from='client.383250 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:29:50.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:29:49 smithi047 bash[22744]: audit 2024-09-16T12:29:48.206972+0000 mgr.a (mgr.14373) 17843 : audit [DBG] from='client.383250 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:29:51.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:29:50 smithi157 bash[24585]: cluster 2024-09-16T12:29:49.506337+0000 mgr.a (mgr.14373) 17844 : cluster [DBG] pgmap v12376: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:29:51.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:29:50 smithi086 bash[24289]: cluster 2024-09-16T12:29:49.506337+0000 mgr.a (mgr.14373) 17844 : cluster [DBG] pgmap v12376: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:29:51.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:29:50 smithi047 bash[22744]: cluster 2024-09-16T12:29:49.506337+0000 mgr.a (mgr.14373) 17844 : cluster [DBG] pgmap v12376: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:29:53.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:29:52 smithi157 bash[24585]: cluster 2024-09-16T12:29:51.508547+0000 mgr.a (mgr.14373) 17845 : cluster [DBG] pgmap v12377: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:29:53.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:29:52 smithi086 bash[24289]: cluster 2024-09-16T12:29:51.508547+0000 mgr.a (mgr.14373) 17845 : cluster [DBG] pgmap v12377: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:29:53.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:29:52 smithi047 bash[22744]: cluster 2024-09-16T12:29:51.508547+0000 mgr.a (mgr.14373) 17845 : cluster [DBG] pgmap v12377: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:29:53.631 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:29:53.632 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:29:53.632 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:29:54.383 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:29:54.383 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:29:54.383 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:29:54.383 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:29:54.383 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:29:55.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:29:54 smithi157 bash[24585]: cluster 2024-09-16T12:29:53.509469+0000 mgr.a (mgr.14373) 17846 : cluster [DBG] pgmap v12378: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.4 KiB/s rd, 2 op/s 2024-09-16T12:29:55.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:29:54 smithi157 bash[24585]: audit 2024-09-16T12:29:53.968740+0000 mgr.a (mgr.14373) 17847 : audit [DBG] from='client.383328 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:29:55.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:29:54 smithi086 bash[24289]: cluster 2024-09-16T12:29:53.509469+0000 mgr.a (mgr.14373) 17846 : cluster [DBG] pgmap v12378: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.4 KiB/s rd, 2 op/s 2024-09-16T12:29:55.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:29:54 smithi086 bash[24289]: audit 2024-09-16T12:29:53.968740+0000 mgr.a (mgr.14373) 17847 : audit [DBG] from='client.383328 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:29:55.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:29:54 smithi047 bash[22744]: cluster 2024-09-16T12:29:53.509469+0000 mgr.a (mgr.14373) 17846 : cluster [DBG] pgmap v12378: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.4 KiB/s rd, 2 op/s 2024-09-16T12:29:55.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:29:54 smithi047 bash[22744]: audit 2024-09-16T12:29:53.968740+0000 mgr.a (mgr.14373) 17847 : audit [DBG] from='client.383328 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:29:57.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:29:56 smithi157 bash[24585]: cluster 2024-09-16T12:29:55.510430+0000 mgr.a (mgr.14373) 17848 : cluster [DBG] pgmap v12379: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:29:57.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:29:56 smithi086 bash[24289]: cluster 2024-09-16T12:29:55.510430+0000 mgr.a (mgr.14373) 17848 : cluster [DBG] pgmap v12379: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:29:57.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:29:56 smithi047 bash[22744]: cluster 2024-09-16T12:29:55.510430+0000 mgr.a (mgr.14373) 17848 : cluster [DBG] pgmap v12379: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:29:59.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:29:58 smithi157 bash[24585]: cluster 2024-09-16T12:29:57.512672+0000 mgr.a (mgr.14373) 17849 : cluster [DBG] pgmap v12380: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:29:59.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:29:58 smithi086 bash[24289]: cluster 2024-09-16T12:29:57.512672+0000 mgr.a (mgr.14373) 17849 : cluster [DBG] pgmap v12380: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:29:59.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:29:58 smithi047 bash[22744]: cluster 2024-09-16T12:29:57.512672+0000 mgr.a (mgr.14373) 17849 : cluster [DBG] pgmap v12380: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:29:59.384 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:29:59.385 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:29:59.385 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:30:00.130 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:30:00.130 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:30:00.130 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:30:00.130 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:30:00.130 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:30:01.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:30:00 smithi157 bash[24585]: cluster 2024-09-16T12:29:59.513121+0000 mgr.a (mgr.14373) 17850 : cluster [DBG] pgmap v12381: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:30:01.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:30:00 smithi157 bash[24585]: audit 2024-09-16T12:29:59.715238+0000 mgr.a (mgr.14373) 17851 : audit [DBG] from='client.383406 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:30:01.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:30:00 smithi157 bash[24585]: cluster 2024-09-16T12:30:00.000079+0000 mon.a (mon.0) 1635 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-16T12:30:01.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:30:00 smithi086 bash[24289]: cluster 2024-09-16T12:29:59.513121+0000 mgr.a (mgr.14373) 17850 : cluster [DBG] pgmap v12381: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:30:01.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:30:00 smithi086 bash[24289]: audit 2024-09-16T12:29:59.715238+0000 mgr.a (mgr.14373) 17851 : audit [DBG] from='client.383406 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:30:01.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:30:00 smithi086 bash[24289]: cluster 2024-09-16T12:30:00.000079+0000 mon.a (mon.0) 1635 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-16T12:30:01.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:30:00 smithi047 bash[22744]: cluster 2024-09-16T12:29:59.513121+0000 mgr.a (mgr.14373) 17850 : cluster [DBG] pgmap v12381: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:30:01.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:30:00 smithi047 bash[22744]: audit 2024-09-16T12:29:59.715238+0000 mgr.a (mgr.14373) 17851 : audit [DBG] from='client.383406 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:30:01.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:30:00 smithi047 bash[22744]: cluster 2024-09-16T12:30:00.000079+0000 mon.a (mon.0) 1635 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-16T12:30:03.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:30:02 smithi157 bash[24585]: cluster 2024-09-16T12:30:01.515307+0000 mgr.a (mgr.14373) 17852 : cluster [DBG] pgmap v12382: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:30:03.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:30:02 smithi086 bash[24289]: cluster 2024-09-16T12:30:01.515307+0000 mgr.a (mgr.14373) 17852 : cluster [DBG] pgmap v12382: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:30:03.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:30:02 smithi047 bash[22744]: cluster 2024-09-16T12:30:01.515307+0000 mgr.a (mgr.14373) 17852 : cluster [DBG] pgmap v12382: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:30:05.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:30:04 smithi157 bash[24585]: cluster 2024-09-16T12:30:03.516077+0000 mgr.a (mgr.14373) 17853 : cluster [DBG] pgmap v12383: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:30:05.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:30:04 smithi086 bash[24289]: cluster 2024-09-16T12:30:03.516077+0000 mgr.a (mgr.14373) 17853 : cluster [DBG] pgmap v12383: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:30:05.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:30:04 smithi047 bash[22744]: cluster 2024-09-16T12:30:03.516077+0000 mgr.a (mgr.14373) 17853 : cluster [DBG] pgmap v12383: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:30:05.131 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:30:05.132 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:30:05.132 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:30:05.906 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:30:05.906 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:30:05.907 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:30:05.907 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:30:05.907 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:30:07.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:30:06 smithi157 bash[24585]: audit 2024-09-16T12:30:05.461725+0000 mgr.a (mgr.14373) 17854 : audit [DBG] from='client.383484 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:30:07.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:30:06 smithi157 bash[24585]: cluster 2024-09-16T12:30:05.516754+0000 mgr.a (mgr.14373) 17855 : cluster [DBG] pgmap v12384: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:30:07.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:30:06 smithi086 bash[24289]: audit 2024-09-16T12:30:05.461725+0000 mgr.a (mgr.14373) 17854 : audit [DBG] from='client.383484 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:30:07.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:30:06 smithi086 bash[24289]: cluster 2024-09-16T12:30:05.516754+0000 mgr.a (mgr.14373) 17855 : cluster [DBG] pgmap v12384: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:30:07.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:30:06 smithi047 bash[22744]: audit 2024-09-16T12:30:05.461725+0000 mgr.a (mgr.14373) 17854 : audit [DBG] from='client.383484 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:30:07.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:30:06 smithi047 bash[22744]: cluster 2024-09-16T12:30:05.516754+0000 mgr.a (mgr.14373) 17855 : cluster [DBG] pgmap v12384: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:30:09.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:30:08 smithi157 bash[24585]: cluster 2024-09-16T12:30:07.519165+0000 mgr.a (mgr.14373) 17856 : cluster [DBG] pgmap v12385: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:30:09.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:30:08 smithi086 bash[24289]: cluster 2024-09-16T12:30:07.519165+0000 mgr.a (mgr.14373) 17856 : cluster [DBG] pgmap v12385: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:30:09.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:30:08 smithi047 bash[22744]: cluster 2024-09-16T12:30:07.519165+0000 mgr.a (mgr.14373) 17856 : cluster [DBG] pgmap v12385: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:30:10.908 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:30:10.908 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:30:10.909 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:30:11.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:30:10 smithi157 bash[24585]: cluster 2024-09-16T12:30:09.519945+0000 mgr.a (mgr.14373) 17857 : cluster [DBG] pgmap v12386: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:30:11.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:30:10 smithi086 bash[24289]: cluster 2024-09-16T12:30:09.519945+0000 mgr.a (mgr.14373) 17857 : cluster [DBG] pgmap v12386: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:30:11.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:30:10 smithi047 bash[22744]: cluster 2024-09-16T12:30:09.519945+0000 mgr.a (mgr.14373) 17857 : cluster [DBG] pgmap v12386: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:30:11.661 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:30:11.662 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:30:11.662 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:30:11.662 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:30:11.662 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:30:13.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:30:12 smithi157 bash[24585]: audit 2024-09-16T12:30:11.239576+0000 mgr.a (mgr.14373) 17858 : audit [DBG] from='client.383559 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:30:13.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:30:12 smithi157 bash[24585]: cluster 2024-09-16T12:30:11.521043+0000 mgr.a (mgr.14373) 17859 : cluster [DBG] pgmap v12387: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-16T12:30:13.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:30:12 smithi086 bash[24289]: audit 2024-09-16T12:30:11.239576+0000 mgr.a (mgr.14373) 17858 : audit [DBG] from='client.383559 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:30:13.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:30:12 smithi086 bash[24289]: cluster 2024-09-16T12:30:11.521043+0000 mgr.a (mgr.14373) 17859 : cluster [DBG] pgmap v12387: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-16T12:30:13.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:30:12 smithi047 bash[22744]: audit 2024-09-16T12:30:11.239576+0000 mgr.a (mgr.14373) 17858 : audit [DBG] from='client.383559 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:30:13.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:30:12 smithi047 bash[22744]: cluster 2024-09-16T12:30:11.521043+0000 mgr.a (mgr.14373) 17859 : cluster [DBG] pgmap v12387: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-16T12:30:15.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:30:14 smithi157 bash[24585]: cluster 2024-09-16T12:30:13.521867+0000 mgr.a (mgr.14373) 17860 : cluster [DBG] pgmap v12388: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T12:30:15.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:30:14 smithi086 bash[24289]: cluster 2024-09-16T12:30:13.521867+0000 mgr.a (mgr.14373) 17860 : cluster [DBG] pgmap v12388: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T12:30:15.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:30:14 smithi047 bash[22744]: cluster 2024-09-16T12:30:13.521867+0000 mgr.a (mgr.14373) 17860 : cluster [DBG] pgmap v12388: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T12:30:16.663 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:30:16.664 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:30:16.664 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:30:17.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:30:16 smithi157 bash[24585]: cluster 2024-09-16T12:30:15.522729+0000 mgr.a (mgr.14373) 17861 : cluster [DBG] pgmap v12389: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T12:30:17.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:30:16 smithi086 bash[24289]: cluster 2024-09-16T12:30:15.522729+0000 mgr.a (mgr.14373) 17861 : cluster [DBG] pgmap v12389: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T12:30:17.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:30:16 smithi047 bash[22744]: cluster 2024-09-16T12:30:15.522729+0000 mgr.a (mgr.14373) 17861 : cluster [DBG] pgmap v12389: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T12:30:17.456 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:30:17.456 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:30:17.456 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:30:17.456 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:30:17.456 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:30:18.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:30:17 smithi157 bash[24585]: audit 2024-09-16T12:30:17.002770+0000 mgr.a (mgr.14373) 17862 : audit [DBG] from='client.383634 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:30:18.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:30:17 smithi086 bash[24289]: audit 2024-09-16T12:30:17.002770+0000 mgr.a (mgr.14373) 17862 : audit [DBG] from='client.383634 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:30:18.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:30:17 smithi047 bash[22744]: audit 2024-09-16T12:30:17.002770+0000 mgr.a (mgr.14373) 17862 : audit [DBG] from='client.383634 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:30:19.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:30:18 smithi157 bash[24585]: cluster 2024-09-16T12:30:17.525560+0000 mgr.a (mgr.14373) 17863 : cluster [DBG] pgmap v12390: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:30:19.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:30:18 smithi086 bash[24289]: cluster 2024-09-16T12:30:17.525560+0000 mgr.a (mgr.14373) 17863 : cluster [DBG] pgmap v12390: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:30:19.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:30:18 smithi047 bash[22744]: cluster 2024-09-16T12:30:17.525560+0000 mgr.a (mgr.14373) 17863 : cluster [DBG] pgmap v12390: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:30:21.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:30:20 smithi157 bash[24585]: cluster 2024-09-16T12:30:19.526387+0000 mgr.a (mgr.14373) 17864 : cluster [DBG] pgmap v12391: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:30:21.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:30:20 smithi086 bash[24289]: cluster 2024-09-16T12:30:19.526387+0000 mgr.a (mgr.14373) 17864 : cluster [DBG] pgmap v12391: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:30:21.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:30:20 smithi047 bash[22744]: cluster 2024-09-16T12:30:19.526387+0000 mgr.a (mgr.14373) 17864 : cluster [DBG] pgmap v12391: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:30:22.457 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:30:22.458 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:30:22.458 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:30:23.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:30:22 smithi157 bash[24585]: cluster 2024-09-16T12:30:21.528337+0000 mgr.a (mgr.14373) 17865 : cluster [DBG] pgmap v12392: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:30:23.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:30:22 smithi086 bash[24289]: cluster 2024-09-16T12:30:21.528337+0000 mgr.a (mgr.14373) 17865 : cluster [DBG] pgmap v12392: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:30:23.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:30:22 smithi047 bash[22744]: cluster 2024-09-16T12:30:21.528337+0000 mgr.a (mgr.14373) 17865 : cluster [DBG] pgmap v12392: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:30:23.231 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:30:23.231 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:30:23.231 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:30:23.232 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:30:23.232 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:30:24.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:30:23 smithi157 bash[24585]: audit 2024-09-16T12:30:22.791512+0000 mgr.a (mgr.14373) 17866 : audit [DBG] from='client.383706 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:30:24.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:30:23 smithi086 bash[24289]: audit 2024-09-16T12:30:22.791512+0000 mgr.a (mgr.14373) 17866 : audit [DBG] from='client.383706 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:30:24.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:30:23 smithi047 bash[22744]: audit 2024-09-16T12:30:22.791512+0000 mgr.a (mgr.14373) 17866 : audit [DBG] from='client.383706 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:30:25.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:30:24 smithi086 bash[24289]: cluster 2024-09-16T12:30:23.529319+0000 mgr.a (mgr.14373) 17867 : cluster [DBG] pgmap v12393: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-16T12:30:25.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:30:24 smithi047 bash[22744]: cluster 2024-09-16T12:30:23.529319+0000 mgr.a (mgr.14373) 17867 : cluster [DBG] pgmap v12393: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-16T12:30:25.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:30:24 smithi157 bash[24585]: cluster 2024-09-16T12:30:23.529319+0000 mgr.a (mgr.14373) 17867 : cluster [DBG] pgmap v12393: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-16T12:30:27.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:30:26 smithi086 bash[24289]: cluster 2024-09-16T12:30:25.530127+0000 mgr.a (mgr.14373) 17868 : cluster [DBG] pgmap v12394: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-16T12:30:27.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:30:26 smithi047 bash[22744]: cluster 2024-09-16T12:30:25.530127+0000 mgr.a (mgr.14373) 17868 : cluster [DBG] pgmap v12394: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-16T12:30:27.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:30:26 smithi157 bash[24585]: cluster 2024-09-16T12:30:25.530127+0000 mgr.a (mgr.14373) 17868 : cluster [DBG] pgmap v12394: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-16T12:30:28.233 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:30:28.233 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:30:28.234 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:30:29.037 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:30:29.037 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:30:29.037 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:30:29.037 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:30:29.037 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:30:29.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:30:28 smithi086 bash[24289]: cluster 2024-09-16T12:30:27.532394+0000 mgr.a (mgr.14373) 17869 : cluster [DBG] pgmap v12395: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-16T12:30:29.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:30:28 smithi086 bash[24289]: audit 2024-09-16T12:30:28.206331+0000 mon.b (mon.2) 1618 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T12:30:29.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:30:28 smithi047 bash[22744]: cluster 2024-09-16T12:30:27.532394+0000 mgr.a (mgr.14373) 17869 : cluster [DBG] pgmap v12395: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-16T12:30:29.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:30:28 smithi047 bash[22744]: audit 2024-09-16T12:30:28.206331+0000 mon.b (mon.2) 1618 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T12:30:29.308 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:30:28 smithi157 bash[24585]: cluster 2024-09-16T12:30:27.532394+0000 mgr.a (mgr.14373) 17869 : cluster [DBG] pgmap v12395: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-16T12:30:29.308 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:30:28 smithi157 bash[24585]: audit 2024-09-16T12:30:28.206331+0000 mon.b (mon.2) 1618 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T12:30:30.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:30:29 smithi086 bash[24289]: audit 2024-09-16T12:30:28.565050+0000 mgr.a (mgr.14373) 17870 : audit [DBG] from='client.383784 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:30:30.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:30:29 smithi086 bash[24289]: audit 2024-09-16T12:30:29.061575+0000 mon.b (mon.2) 1619 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T12:30:30.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:30:29 smithi086 bash[24289]: audit 2024-09-16T12:30:29.063119+0000 mon.b (mon.2) 1620 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T12:30:30.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:30:29 smithi086 bash[24289]: audit 2024-09-16T12:30:29.069284+0000 mon.a (mon.0) 1636 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:30:30.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:30:29 smithi086 bash[24289]: audit 2024-09-16T12:30:29.074615+0000 mon.b (mon.2) 1621 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:30:30.072 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:30:29 smithi086 bash[24289]: audit 2024-09-16T12:30:29.075836+0000 mgr.a (mgr.14373) 17871 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:30:30.093 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 12:30:29 smithi047 bash[22994]: debug 2024-09-16T12:30:29.781+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T12:30:30.093 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 12:30:29 smithi047 bash[22994]: debug 2024-09-16T12:30:29.781+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T12:30:30.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:30:29 smithi047 bash[22744]: audit 2024-09-16T12:30:28.565050+0000 mgr.a (mgr.14373) 17870 : audit [DBG] from='client.383784 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:30:30.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:30:29 smithi047 bash[22744]: audit 2024-09-16T12:30:29.061575+0000 mon.b (mon.2) 1619 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T12:30:30.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:30:29 smithi047 bash[22744]: audit 2024-09-16T12:30:29.063119+0000 mon.b (mon.2) 1620 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T12:30:30.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:30:29 smithi047 bash[22744]: audit 2024-09-16T12:30:29.069284+0000 mon.a (mon.0) 1636 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:30:30.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:30:29 smithi047 bash[22744]: audit 2024-09-16T12:30:29.074615+0000 mon.b (mon.2) 1621 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:30:30.094 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:30:29 smithi047 bash[22744]: audit 2024-09-16T12:30:29.075836+0000 mgr.a (mgr.14373) 17871 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:30:30.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:30:29 smithi157 bash[24585]: audit 2024-09-16T12:30:28.565050+0000 mgr.a (mgr.14373) 17870 : audit [DBG] from='client.383784 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:30:30.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:30:29 smithi157 bash[24585]: audit 2024-09-16T12:30:29.061575+0000 mon.b (mon.2) 1619 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T12:30:30.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:30:29 smithi157 bash[24585]: audit 2024-09-16T12:30:29.063119+0000 mon.b (mon.2) 1620 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T12:30:30.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:30:29 smithi157 bash[24585]: audit 2024-09-16T12:30:29.069284+0000 mon.a (mon.0) 1636 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:30:30.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:30:29 smithi157 bash[24585]: audit 2024-09-16T12:30:29.074615+0000 mon.b (mon.2) 1621 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:30:30.308 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:30:29 smithi157 bash[24585]: audit 2024-09-16T12:30:29.075836+0000 mgr.a (mgr.14373) 17871 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:30:31.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:30:31 smithi047 bash[22744]: cluster 2024-09-16T12:30:29.532867+0000 mgr.a (mgr.14373) 17872 : cluster [DBG] pgmap v12396: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:30:31.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:30:31 smithi047 bash[22744]: audit 2024-09-16T12:30:29.784221+0000 mgr.a (mgr.14373) 17873 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T12:30:31.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:30:31 smithi047 bash[22744]: cephadm 2024-09-16T12:30:29.786220+0000 mgr.a (mgr.14373) 17874 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T12:30:31.559 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:30:31 smithi157 bash[24585]: cluster 2024-09-16T12:30:29.532867+0000 mgr.a (mgr.14373) 17872 : cluster [DBG] pgmap v12396: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:30:31.560 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:30:31 smithi157 bash[24585]: audit 2024-09-16T12:30:29.784221+0000 mgr.a (mgr.14373) 17873 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T12:30:31.560 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:30:31 smithi157 bash[24585]: cephadm 2024-09-16T12:30:29.786220+0000 mgr.a (mgr.14373) 17874 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T12:30:31.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:30:31 smithi086 bash[24289]: cluster 2024-09-16T12:30:29.532867+0000 mgr.a (mgr.14373) 17872 : cluster [DBG] pgmap v12396: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:30:31.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:30:31 smithi086 bash[24289]: audit 2024-09-16T12:30:29.784221+0000 mgr.a (mgr.14373) 17873 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T12:30:31.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:30:31 smithi086 bash[24289]: cephadm 2024-09-16T12:30:29.786220+0000 mgr.a (mgr.14373) 17874 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T12:30:33.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:30:33 smithi047 bash[22744]: cluster 2024-09-16T12:30:31.535094+0000 mgr.a (mgr.14373) 17875 : cluster [DBG] pgmap v12397: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:30:33.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:30:33 smithi157 bash[24585]: cluster 2024-09-16T12:30:31.535094+0000 mgr.a (mgr.14373) 17875 : cluster [DBG] pgmap v12397: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:30:33.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:30:33 smithi086 bash[24289]: cluster 2024-09-16T12:30:31.535094+0000 mgr.a (mgr.14373) 17875 : cluster [DBG] pgmap v12397: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:30:34.038 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:30:34.039 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:30:34.039 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:30:34.807 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:30:34.807 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:30:34.807 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:30:34.807 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:30:34.807 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:30:35.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:30:35 smithi047 bash[22744]: cluster 2024-09-16T12:30:33.535863+0000 mgr.a (mgr.14373) 17876 : cluster [DBG] pgmap v12398: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:30:35.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:30:35 smithi157 bash[24585]: cluster 2024-09-16T12:30:33.535863+0000 mgr.a (mgr.14373) 17876 : cluster [DBG] pgmap v12398: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:30:35.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:30:35 smithi086 bash[24289]: cluster 2024-09-16T12:30:33.535863+0000 mgr.a (mgr.14373) 17876 : cluster [DBG] pgmap v12398: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:30:36.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:30:36 smithi047 bash[22744]: audit 2024-09-16T12:30:34.376051+0000 mgr.a (mgr.14373) 17877 : audit [DBG] from='client.383967 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:30:36.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:30:36 smithi157 bash[24585]: audit 2024-09-16T12:30:34.376051+0000 mgr.a (mgr.14373) 17877 : audit [DBG] from='client.383967 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:30:36.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:30:36 smithi086 bash[24289]: audit 2024-09-16T12:30:34.376051+0000 mgr.a (mgr.14373) 17877 : audit [DBG] from='client.383967 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:30:37.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:30:37 smithi157 bash[24585]: cluster 2024-09-16T12:30:35.536851+0000 mgr.a (mgr.14373) 17878 : cluster [DBG] pgmap v12399: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:30:37.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:30:37 smithi086 bash[24289]: cluster 2024-09-16T12:30:35.536851+0000 mgr.a (mgr.14373) 17878 : cluster [DBG] pgmap v12399: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:30:37.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:30:37 smithi047 bash[22744]: cluster 2024-09-16T12:30:35.536851+0000 mgr.a (mgr.14373) 17878 : cluster [DBG] pgmap v12399: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:30:39.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:30:39 smithi157 bash[24585]: cluster 2024-09-16T12:30:37.539131+0000 mgr.a (mgr.14373) 17879 : cluster [DBG] pgmap v12400: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:30:39.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:30:39 smithi086 bash[24289]: cluster 2024-09-16T12:30:37.539131+0000 mgr.a (mgr.14373) 17879 : cluster [DBG] pgmap v12400: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:30:39.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:30:39 smithi047 bash[22744]: cluster 2024-09-16T12:30:37.539131+0000 mgr.a (mgr.14373) 17879 : cluster [DBG] pgmap v12400: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:30:39.809 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:30:39.809 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:30:39.810 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:30:40.575 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:30:40.575 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:30:40.575 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:30:40.575 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:30:40.575 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:30:41.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:30:41 smithi157 bash[24585]: cluster 2024-09-16T12:30:39.539879+0000 mgr.a (mgr.14373) 17880 : cluster [DBG] pgmap v12401: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:30:41.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:30:41 smithi086 bash[24289]: cluster 2024-09-16T12:30:39.539879+0000 mgr.a (mgr.14373) 17880 : cluster [DBG] pgmap v12401: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:30:41.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:30:41 smithi047 bash[22744]: cluster 2024-09-16T12:30:39.539879+0000 mgr.a (mgr.14373) 17880 : cluster [DBG] pgmap v12401: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:30:42.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:30:42 smithi157 bash[24585]: audit 2024-09-16T12:30:40.143042+0000 mgr.a (mgr.14373) 17881 : audit [DBG] from='client.384042 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:30:42.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:30:42 smithi086 bash[24289]: audit 2024-09-16T12:30:40.143042+0000 mgr.a (mgr.14373) 17881 : audit [DBG] from='client.384042 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:30:42.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:30:42 smithi047 bash[22744]: audit 2024-09-16T12:30:40.143042+0000 mgr.a (mgr.14373) 17881 : audit [DBG] from='client.384042 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:30:43.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:30:43 smithi157 bash[24585]: cluster 2024-09-16T12:30:41.542188+0000 mgr.a (mgr.14373) 17882 : cluster [DBG] pgmap v12402: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:30:43.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:30:43 smithi086 bash[24289]: cluster 2024-09-16T12:30:41.542188+0000 mgr.a (mgr.14373) 17882 : cluster [DBG] pgmap v12402: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:30:43.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:30:43 smithi047 bash[22744]: cluster 2024-09-16T12:30:41.542188+0000 mgr.a (mgr.14373) 17882 : cluster [DBG] pgmap v12402: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:30:45.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:30:45 smithi157 bash[24585]: cluster 2024-09-16T12:30:43.542972+0000 mgr.a (mgr.14373) 17883 : cluster [DBG] pgmap v12403: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:30:45.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:30:45 smithi086 bash[24289]: cluster 2024-09-16T12:30:43.542972+0000 mgr.a (mgr.14373) 17883 : cluster [DBG] pgmap v12403: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:30:45.576 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:30:45.578 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:30:45.578 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:30:45.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:30:45 smithi047 bash[22744]: cluster 2024-09-16T12:30:43.542972+0000 mgr.a (mgr.14373) 17883 : cluster [DBG] pgmap v12403: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:30:46.350 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:30:46.350 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:30:46.350 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:30:46.350 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:30:46.350 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:30:47.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:30:47 smithi157 bash[24585]: cluster 2024-09-16T12:30:45.543742+0000 mgr.a (mgr.14373) 17884 : cluster [DBG] pgmap v12404: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:30:47.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:30:47 smithi157 bash[24585]: audit 2024-09-16T12:30:45.911118+0000 mgr.a (mgr.14373) 17885 : audit [DBG] from='client.384117 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:30:47.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:30:47 smithi086 bash[24289]: cluster 2024-09-16T12:30:45.543742+0000 mgr.a (mgr.14373) 17884 : cluster [DBG] pgmap v12404: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:30:47.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:30:47 smithi086 bash[24289]: audit 2024-09-16T12:30:45.911118+0000 mgr.a (mgr.14373) 17885 : audit [DBG] from='client.384117 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:30:47.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:30:47 smithi047 bash[22744]: cluster 2024-09-16T12:30:45.543742+0000 mgr.a (mgr.14373) 17884 : cluster [DBG] pgmap v12404: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:30:47.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:30:47 smithi047 bash[22744]: audit 2024-09-16T12:30:45.911118+0000 mgr.a (mgr.14373) 17885 : audit [DBG] from='client.384117 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:30:49.558 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:30:49 smithi157 bash[24585]: cluster 2024-09-16T12:30:47.546182+0000 mgr.a (mgr.14373) 17886 : cluster [DBG] pgmap v12405: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:30:49.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:30:49 smithi086 bash[24289]: cluster 2024-09-16T12:30:47.546182+0000 mgr.a (mgr.14373) 17886 : cluster [DBG] pgmap v12405: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:30:49.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:30:49 smithi047 bash[22744]: cluster 2024-09-16T12:30:47.546182+0000 mgr.a (mgr.14373) 17886 : cluster [DBG] pgmap v12405: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:30:51.351 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:30:51.352 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:30:51.352 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:30:51.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:30:51 smithi157 bash[24585]: cluster 2024-09-16T12:30:49.546995+0000 mgr.a (mgr.14373) 17887 : cluster [DBG] pgmap v12406: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:30:51.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:30:51 smithi086 bash[24289]: cluster 2024-09-16T12:30:49.546995+0000 mgr.a (mgr.14373) 17887 : cluster [DBG] pgmap v12406: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:30:51.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:30:51 smithi047 bash[22744]: cluster 2024-09-16T12:30:49.546995+0000 mgr.a (mgr.14373) 17887 : cluster [DBG] pgmap v12406: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:30:52.141 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:30:52.141 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:30:52.141 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:30:52.142 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:30:52.142 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:30:52.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:30:52 smithi157 bash[24585]: cluster 2024-09-16T12:30:51.548925+0000 mgr.a (mgr.14373) 17888 : cluster [DBG] pgmap v12407: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:30:52.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:30:52 smithi157 bash[24585]: audit 2024-09-16T12:30:51.689359+0000 mgr.a (mgr.14373) 17889 : audit [DBG] from='client.384192 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:30:52.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:30:52 smithi086 bash[24289]: cluster 2024-09-16T12:30:51.548925+0000 mgr.a (mgr.14373) 17888 : cluster [DBG] pgmap v12407: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:30:52.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:30:52 smithi086 bash[24289]: audit 2024-09-16T12:30:51.689359+0000 mgr.a (mgr.14373) 17889 : audit [DBG] from='client.384192 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:30:52.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:30:52 smithi047 bash[22744]: cluster 2024-09-16T12:30:51.548925+0000 mgr.a (mgr.14373) 17888 : cluster [DBG] pgmap v12407: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:30:52.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:30:52 smithi047 bash[22744]: audit 2024-09-16T12:30:51.689359+0000 mgr.a (mgr.14373) 17889 : audit [DBG] from='client.384192 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:30:55.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:30:54 smithi157 bash[24585]: cluster 2024-09-16T12:30:53.549869+0000 mgr.a (mgr.14373) 17890 : cluster [DBG] pgmap v12408: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:30:55.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:30:54 smithi086 bash[24289]: cluster 2024-09-16T12:30:53.549869+0000 mgr.a (mgr.14373) 17890 : cluster [DBG] pgmap v12408: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:30:55.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:30:54 smithi047 bash[22744]: cluster 2024-09-16T12:30:53.549869+0000 mgr.a (mgr.14373) 17890 : cluster [DBG] pgmap v12408: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:30:57.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:30:56 smithi157 bash[24585]: cluster 2024-09-16T12:30:55.550674+0000 mgr.a (mgr.14373) 17891 : cluster [DBG] pgmap v12409: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T12:30:57.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:30:56 smithi086 bash[24289]: cluster 2024-09-16T12:30:55.550674+0000 mgr.a (mgr.14373) 17891 : cluster [DBG] pgmap v12409: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T12:30:57.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:30:56 smithi047 bash[22744]: cluster 2024-09-16T12:30:55.550674+0000 mgr.a (mgr.14373) 17891 : cluster [DBG] pgmap v12409: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T12:30:57.143 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:30:57.143 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:30:57.144 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:30:57.910 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:30:57.910 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:30:57.910 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:30:57.910 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:30:57.911 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:30:58.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:30:58 smithi157 bash[24585]: audit 2024-09-16T12:30:57.475705+0000 mgr.a (mgr.14373) 17892 : audit [DBG] from='client.384270 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:30:58.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:30:58 smithi157 bash[24585]: cluster 2024-09-16T12:30:57.552826+0000 mgr.a (mgr.14373) 17893 : cluster [DBG] pgmap v12410: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:30:58.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:30:58 smithi086 bash[24289]: audit 2024-09-16T12:30:57.475705+0000 mgr.a (mgr.14373) 17892 : audit [DBG] from='client.384270 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:30:58.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:30:58 smithi086 bash[24289]: cluster 2024-09-16T12:30:57.552826+0000 mgr.a (mgr.14373) 17893 : cluster [DBG] pgmap v12410: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:30:58.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:30:58 smithi047 bash[22744]: audit 2024-09-16T12:30:57.475705+0000 mgr.a (mgr.14373) 17892 : audit [DBG] from='client.384270 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:30:58.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:30:58 smithi047 bash[22744]: cluster 2024-09-16T12:30:57.552826+0000 mgr.a (mgr.14373) 17893 : cluster [DBG] pgmap v12410: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:31:01.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:31:00 smithi157 bash[24585]: cluster 2024-09-16T12:30:59.553740+0000 mgr.a (mgr.14373) 17894 : cluster [DBG] pgmap v12411: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:31:01.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:31:00 smithi086 bash[24289]: cluster 2024-09-16T12:30:59.553740+0000 mgr.a (mgr.14373) 17894 : cluster [DBG] pgmap v12411: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:31:01.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:31:00 smithi047 bash[22744]: cluster 2024-09-16T12:30:59.553740+0000 mgr.a (mgr.14373) 17894 : cluster [DBG] pgmap v12411: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:31:02.912 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:31:02.912 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:31:02.912 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:31:03.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:31:02 smithi157 bash[24585]: cluster 2024-09-16T12:31:01.555868+0000 mgr.a (mgr.14373) 17895 : cluster [DBG] pgmap v12412: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:31:03.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:31:02 smithi086 bash[24289]: cluster 2024-09-16T12:31:01.555868+0000 mgr.a (mgr.14373) 17895 : cluster [DBG] pgmap v12412: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:31:03.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:31:02 smithi047 bash[22744]: cluster 2024-09-16T12:31:01.555868+0000 mgr.a (mgr.14373) 17895 : cluster [DBG] pgmap v12412: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:31:03.665 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:31:03.666 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:31:03.666 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:31:03.666 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:31:03.666 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:31:05.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:31:04 smithi157 bash[24585]: audit 2024-09-16T12:31:03.243790+0000 mgr.a (mgr.14373) 17896 : audit [DBG] from='client.384345 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:31:05.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:31:04 smithi157 bash[24585]: cluster 2024-09-16T12:31:03.565430+0000 mgr.a (mgr.14373) 17897 : cluster [DBG] pgmap v12413: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:31:05.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:31:04 smithi086 bash[24289]: audit 2024-09-16T12:31:03.243790+0000 mgr.a (mgr.14373) 17896 : audit [DBG] from='client.384345 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:31:05.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:31:04 smithi086 bash[24289]: cluster 2024-09-16T12:31:03.565430+0000 mgr.a (mgr.14373) 17897 : cluster [DBG] pgmap v12413: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:31:05.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:31:04 smithi047 bash[22744]: audit 2024-09-16T12:31:03.243790+0000 mgr.a (mgr.14373) 17896 : audit [DBG] from='client.384345 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:31:05.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:31:04 smithi047 bash[22744]: cluster 2024-09-16T12:31:03.565430+0000 mgr.a (mgr.14373) 17897 : cluster [DBG] pgmap v12413: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:31:07.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:31:06 smithi157 bash[24585]: cluster 2024-09-16T12:31:05.566200+0000 mgr.a (mgr.14373) 17898 : cluster [DBG] pgmap v12414: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:31:07.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:31:06 smithi086 bash[24289]: cluster 2024-09-16T12:31:05.566200+0000 mgr.a (mgr.14373) 17898 : cluster [DBG] pgmap v12414: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:31:07.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:31:06 smithi047 bash[22744]: cluster 2024-09-16T12:31:05.566200+0000 mgr.a (mgr.14373) 17898 : cluster [DBG] pgmap v12414: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:31:08.667 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:31:08.668 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:31:08.668 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:31:09.058 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:31:08 smithi157 bash[24585]: cluster 2024-09-16T12:31:07.568596+0000 mgr.a (mgr.14373) 17899 : cluster [DBG] pgmap v12415: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:31:09.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:31:08 smithi086 bash[24289]: cluster 2024-09-16T12:31:07.568596+0000 mgr.a (mgr.14373) 17899 : cluster [DBG] pgmap v12415: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:31:09.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:31:08 smithi047 bash[22744]: cluster 2024-09-16T12:31:07.568596+0000 mgr.a (mgr.14373) 17899 : cluster [DBG] pgmap v12415: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:31:09.456 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:31:09.456 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:31:09.456 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:31:09.456 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:31:09.456 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:31:10.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:31:09 smithi157 bash[24585]: audit 2024-09-16T12:31:09.002965+0000 mgr.a (mgr.14373) 17900 : audit [DBG] from='client.384423 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:31:10.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:31:09 smithi086 bash[24289]: audit 2024-09-16T12:31:09.002965+0000 mgr.a (mgr.14373) 17900 : audit [DBG] from='client.384423 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:31:10.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:31:09 smithi047 bash[22744]: audit 2024-09-16T12:31:09.002965+0000 mgr.a (mgr.14373) 17900 : audit [DBG] from='client.384423 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:31:11.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:31:10 smithi157 bash[24585]: cluster 2024-09-16T12:31:09.569583+0000 mgr.a (mgr.14373) 17901 : cluster [DBG] pgmap v12416: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:31:11.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:31:10 smithi086 bash[24289]: cluster 2024-09-16T12:31:09.569583+0000 mgr.a (mgr.14373) 17901 : cluster [DBG] pgmap v12416: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:31:11.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:31:10 smithi047 bash[22744]: cluster 2024-09-16T12:31:09.569583+0000 mgr.a (mgr.14373) 17901 : cluster [DBG] pgmap v12416: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:31:13.060 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:31:12 smithi157 bash[24585]: cluster 2024-09-16T12:31:11.571778+0000 mgr.a (mgr.14373) 17902 : cluster [DBG] pgmap v12417: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:31:13.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:31:12 smithi086 bash[24289]: cluster 2024-09-16T12:31:11.571778+0000 mgr.a (mgr.14373) 17902 : cluster [DBG] pgmap v12417: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:31:13.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:31:12 smithi047 bash[22744]: cluster 2024-09-16T12:31:11.571778+0000 mgr.a (mgr.14373) 17902 : cluster [DBG] pgmap v12417: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:31:14.457 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:31:14.458 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:31:14.458 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:31:15.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:31:14 smithi157 bash[24585]: cluster 2024-09-16T12:31:13.572545+0000 mgr.a (mgr.14373) 17903 : cluster [DBG] pgmap v12418: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:31:15.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:31:14 smithi086 bash[24289]: cluster 2024-09-16T12:31:13.572545+0000 mgr.a (mgr.14373) 17903 : cluster [DBG] pgmap v12418: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:31:15.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:31:14 smithi047 bash[22744]: cluster 2024-09-16T12:31:13.572545+0000 mgr.a (mgr.14373) 17903 : cluster [DBG] pgmap v12418: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:31:15.225 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:31:15.225 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:31:15.225 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:31:15.226 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:31:15.226 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:31:16.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:31:15 smithi157 bash[24585]: audit 2024-09-16T12:31:14.792162+0000 mgr.a (mgr.14373) 17904 : audit [DBG] from='client.384501 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:31:16.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:31:15 smithi086 bash[24289]: audit 2024-09-16T12:31:14.792162+0000 mgr.a (mgr.14373) 17904 : audit [DBG] from='client.384501 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:31:16.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:31:15 smithi047 bash[22744]: audit 2024-09-16T12:31:14.792162+0000 mgr.a (mgr.14373) 17904 : audit [DBG] from='client.384501 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:31:17.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:31:16 smithi157 bash[24585]: cluster 2024-09-16T12:31:15.573633+0000 mgr.a (mgr.14373) 17905 : cluster [DBG] pgmap v12419: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:31:17.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:31:16 smithi086 bash[24289]: cluster 2024-09-16T12:31:15.573633+0000 mgr.a (mgr.14373) 17905 : cluster [DBG] pgmap v12419: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:31:17.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:31:16 smithi047 bash[22744]: cluster 2024-09-16T12:31:15.573633+0000 mgr.a (mgr.14373) 17905 : cluster [DBG] pgmap v12419: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:31:19.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:31:18 smithi157 bash[24585]: cluster 2024-09-16T12:31:17.576084+0000 mgr.a (mgr.14373) 17906 : cluster [DBG] pgmap v12420: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:31:19.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:31:18 smithi086 bash[24289]: cluster 2024-09-16T12:31:17.576084+0000 mgr.a (mgr.14373) 17906 : cluster [DBG] pgmap v12420: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:31:19.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:31:18 smithi047 bash[22744]: cluster 2024-09-16T12:31:17.576084+0000 mgr.a (mgr.14373) 17906 : cluster [DBG] pgmap v12420: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:31:20.230 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:31:20.230 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:31:20.230 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:31:20.997 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:31:20.997 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:31:20.997 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:31:20.997 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:31:20.998 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:31:21.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:31:20 smithi157 bash[24585]: cluster 2024-09-16T12:31:19.577010+0000 mgr.a (mgr.14373) 17907 : cluster [DBG] pgmap v12421: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:31:21.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:31:20 smithi086 bash[24289]: cluster 2024-09-16T12:31:19.577010+0000 mgr.a (mgr.14373) 17907 : cluster [DBG] pgmap v12421: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:31:21.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:31:20 smithi047 bash[22744]: cluster 2024-09-16T12:31:19.577010+0000 mgr.a (mgr.14373) 17907 : cluster [DBG] pgmap v12421: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:31:22.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:31:21 smithi157 bash[24585]: audit 2024-09-16T12:31:20.550941+0000 mgr.a (mgr.14373) 17908 : audit [DBG] from='client.384579 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:31:22.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:31:21 smithi086 bash[24289]: audit 2024-09-16T12:31:20.550941+0000 mgr.a (mgr.14373) 17908 : audit [DBG] from='client.384579 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:31:22.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:31:21 smithi047 bash[22744]: audit 2024-09-16T12:31:20.550941+0000 mgr.a (mgr.14373) 17908 : audit [DBG] from='client.384579 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:31:23.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:31:22 smithi157 bash[24585]: cluster 2024-09-16T12:31:21.579581+0000 mgr.a (mgr.14373) 17909 : cluster [DBG] pgmap v12422: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:31:23.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:31:22 smithi086 bash[24289]: cluster 2024-09-16T12:31:21.579581+0000 mgr.a (mgr.14373) 17909 : cluster [DBG] pgmap v12422: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:31:23.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:31:22 smithi047 bash[22744]: cluster 2024-09-16T12:31:21.579581+0000 mgr.a (mgr.14373) 17909 : cluster [DBG] pgmap v12422: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:31:25.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:31:24 smithi157 bash[24585]: cluster 2024-09-16T12:31:23.580385+0000 mgr.a (mgr.14373) 17910 : cluster [DBG] pgmap v12423: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:31:25.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:31:24 smithi086 bash[24289]: cluster 2024-09-16T12:31:23.580385+0000 mgr.a (mgr.14373) 17910 : cluster [DBG] pgmap v12423: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:31:25.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:31:24 smithi047 bash[22744]: cluster 2024-09-16T12:31:23.580385+0000 mgr.a (mgr.14373) 17910 : cluster [DBG] pgmap v12423: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:31:25.998 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:31:25.999 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:31:25.999 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:31:26.762 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:31:26.762 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:31:26.762 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:31:26.762 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:31:26.763 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:31:27.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:31:26 smithi157 bash[24585]: cluster 2024-09-16T12:31:25.581149+0000 mgr.a (mgr.14373) 17911 : cluster [DBG] pgmap v12424: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:31:27.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:31:26 smithi086 bash[24289]: cluster 2024-09-16T12:31:25.581149+0000 mgr.a (mgr.14373) 17911 : cluster [DBG] pgmap v12424: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:31:27.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:31:26 smithi047 bash[22744]: cluster 2024-09-16T12:31:25.581149+0000 mgr.a (mgr.14373) 17911 : cluster [DBG] pgmap v12424: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:31:28.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:31:27 smithi157 bash[24585]: audit 2024-09-16T12:31:26.334451+0000 mgr.a (mgr.14373) 17912 : audit [DBG] from='client.384654 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:31:28.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:31:27 smithi086 bash[24289]: audit 2024-09-16T12:31:26.334451+0000 mgr.a (mgr.14373) 17912 : audit [DBG] from='client.384654 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:31:28.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:31:27 smithi047 bash[22744]: audit 2024-09-16T12:31:26.334451+0000 mgr.a (mgr.14373) 17912 : audit [DBG] from='client.384654 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:31:29.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:31:28 smithi157 bash[24585]: cluster 2024-09-16T12:31:27.583976+0000 mgr.a (mgr.14373) 17913 : cluster [DBG] pgmap v12425: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:31:29.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:31:28 smithi086 bash[24289]: cluster 2024-09-16T12:31:27.583976+0000 mgr.a (mgr.14373) 17913 : cluster [DBG] pgmap v12425: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:31:29.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:31:28 smithi047 bash[22744]: cluster 2024-09-16T12:31:27.583976+0000 mgr.a (mgr.14373) 17913 : cluster [DBG] pgmap v12425: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:31:31.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:31:30 smithi157 bash[24585]: cluster 2024-09-16T12:31:29.584778+0000 mgr.a (mgr.14373) 17914 : cluster [DBG] pgmap v12426: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:31:31.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:31:30 smithi157 bash[24585]: audit 2024-09-16T12:31:29.839037+0000 mon.b (mon.2) 1622 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T12:31:31.058 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:31:30 smithi157 bash[24585]: audit 2024-09-16T12:31:30.690011+0000 mon.b (mon.2) 1623 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T12:31:31.058 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:31:30 smithi157 bash[24585]: audit 2024-09-16T12:31:30.691710+0000 mon.b (mon.2) 1624 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T12:31:31.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:31:30 smithi086 bash[24289]: cluster 2024-09-16T12:31:29.584778+0000 mgr.a (mgr.14373) 17914 : cluster [DBG] pgmap v12426: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:31:31.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:31:30 smithi086 bash[24289]: audit 2024-09-16T12:31:29.839037+0000 mon.b (mon.2) 1622 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T12:31:31.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:31:30 smithi086 bash[24289]: audit 2024-09-16T12:31:30.690011+0000 mon.b (mon.2) 1623 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T12:31:31.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:31:30 smithi086 bash[24289]: audit 2024-09-16T12:31:30.691710+0000 mon.b (mon.2) 1624 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T12:31:31.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:31:30 smithi047 bash[22744]: cluster 2024-09-16T12:31:29.584778+0000 mgr.a (mgr.14373) 17914 : cluster [DBG] pgmap v12426: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:31:31.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:31:30 smithi047 bash[22744]: audit 2024-09-16T12:31:29.839037+0000 mon.b (mon.2) 1622 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T12:31:31.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:31:30 smithi047 bash[22744]: audit 2024-09-16T12:31:30.690011+0000 mon.b (mon.2) 1623 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T12:31:31.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:31:30 smithi047 bash[22744]: audit 2024-09-16T12:31:30.691710+0000 mon.b (mon.2) 1624 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T12:31:31.764 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:31:31.764 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:31:31.764 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:31:31.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:31:31 smithi047 bash[22744]: audit 2024-09-16T12:31:30.701486+0000 mon.a (mon.0) 1637 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:31:31.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:31:31 smithi047 bash[22744]: audit 2024-09-16T12:31:30.709146+0000 mon.b (mon.2) 1625 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:31:31.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:31:31 smithi047 bash[22744]: audit 2024-09-16T12:31:30.711582+0000 mgr.a (mgr.14373) 17915 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:31:31.843 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 12:31:31 smithi047 bash[22994]: debug 2024-09-16T12:31:31.460+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T12:31:31.843 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 12:31:31 smithi047 bash[22994]: debug 2024-09-16T12:31:31.460+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T12:31:32.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:31:31 smithi157 bash[24585]: audit 2024-09-16T12:31:30.701486+0000 mon.a (mon.0) 1637 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:31:32.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:31:31 smithi157 bash[24585]: audit 2024-09-16T12:31:30.709146+0000 mon.b (mon.2) 1625 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:31:32.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:31:31 smithi157 bash[24585]: audit 2024-09-16T12:31:30.711582+0000 mgr.a (mgr.14373) 17915 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:31:32.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:31:31 smithi086 bash[24289]: audit 2024-09-16T12:31:30.701486+0000 mon.a (mon.0) 1637 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:31:32.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:31:31 smithi086 bash[24289]: audit 2024-09-16T12:31:30.709146+0000 mon.b (mon.2) 1625 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:31:32.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:31:31 smithi086 bash[24289]: audit 2024-09-16T12:31:30.711582+0000 mgr.a (mgr.14373) 17915 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:31:32.525 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:31:32.525 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:31:32.525 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:31:32.525 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:31:32.525 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:31:33.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:31:32 smithi157 bash[24585]: audit 2024-09-16T12:31:31.463046+0000 mgr.a (mgr.14373) 17916 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T12:31:33.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:31:32 smithi157 bash[24585]: cephadm 2024-09-16T12:31:31.464924+0000 mgr.a (mgr.14373) 17917 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T12:31:33.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:31:32 smithi157 bash[24585]: cluster 2024-09-16T12:31:31.587031+0000 mgr.a (mgr.14373) 17918 : cluster [DBG] pgmap v12427: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:31:33.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:31:32 smithi157 bash[24585]: audit 2024-09-16T12:31:32.091682+0000 mgr.a (mgr.14373) 17919 : audit [DBG] from='client.384834 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:31:33.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:31:32 smithi086 bash[24289]: audit 2024-09-16T12:31:31.463046+0000 mgr.a (mgr.14373) 17916 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T12:31:33.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:31:32 smithi086 bash[24289]: cephadm 2024-09-16T12:31:31.464924+0000 mgr.a (mgr.14373) 17917 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T12:31:33.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:31:32 smithi086 bash[24289]: cluster 2024-09-16T12:31:31.587031+0000 mgr.a (mgr.14373) 17918 : cluster [DBG] pgmap v12427: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:31:33.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:31:32 smithi086 bash[24289]: audit 2024-09-16T12:31:32.091682+0000 mgr.a (mgr.14373) 17919 : audit [DBG] from='client.384834 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:31:33.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:31:32 smithi047 bash[22744]: audit 2024-09-16T12:31:31.463046+0000 mgr.a (mgr.14373) 17916 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T12:31:33.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:31:32 smithi047 bash[22744]: cephadm 2024-09-16T12:31:31.464924+0000 mgr.a (mgr.14373) 17917 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T12:31:33.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:31:32 smithi047 bash[22744]: cluster 2024-09-16T12:31:31.587031+0000 mgr.a (mgr.14373) 17918 : cluster [DBG] pgmap v12427: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:31:33.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:31:32 smithi047 bash[22744]: audit 2024-09-16T12:31:32.091682+0000 mgr.a (mgr.14373) 17919 : audit [DBG] from='client.384834 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:31:35.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:31:34 smithi157 bash[24585]: cluster 2024-09-16T12:31:33.587935+0000 mgr.a (mgr.14373) 17920 : cluster [DBG] pgmap v12428: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T12:31:35.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:31:34 smithi086 bash[24289]: cluster 2024-09-16T12:31:33.587935+0000 mgr.a (mgr.14373) 17920 : cluster [DBG] pgmap v12428: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T12:31:35.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:31:34 smithi047 bash[22744]: cluster 2024-09-16T12:31:33.587935+0000 mgr.a (mgr.14373) 17920 : cluster [DBG] pgmap v12428: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T12:31:37.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:31:36 smithi157 bash[24585]: cluster 2024-09-16T12:31:35.588721+0000 mgr.a (mgr.14373) 17921 : cluster [DBG] pgmap v12429: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T12:31:37.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:31:36 smithi086 bash[24289]: cluster 2024-09-16T12:31:35.588721+0000 mgr.a (mgr.14373) 17921 : cluster [DBG] pgmap v12429: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T12:31:37.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:31:36 smithi047 bash[22744]: cluster 2024-09-16T12:31:35.588721+0000 mgr.a (mgr.14373) 17921 : cluster [DBG] pgmap v12429: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T12:31:37.526 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:31:37.527 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:31:37.527 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:31:38.288 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:31:38.288 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:31:38.288 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:31:38.288 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:31:38.288 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:31:39.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:31:38 smithi157 bash[24585]: cluster 2024-09-16T12:31:37.590130+0000 mgr.a (mgr.14373) 17922 : cluster [DBG] pgmap v12430: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:31:39.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:31:38 smithi157 bash[24585]: audit 2024-09-16T12:31:37.857713+0000 mgr.a (mgr.14373) 17923 : audit [DBG] from='client.384909 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:31:39.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:31:38 smithi086 bash[24289]: cluster 2024-09-16T12:31:37.590130+0000 mgr.a (mgr.14373) 17922 : cluster [DBG] pgmap v12430: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:31:39.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:31:38 smithi086 bash[24289]: audit 2024-09-16T12:31:37.857713+0000 mgr.a (mgr.14373) 17923 : audit [DBG] from='client.384909 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:31:39.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:31:38 smithi047 bash[22744]: cluster 2024-09-16T12:31:37.590130+0000 mgr.a (mgr.14373) 17922 : cluster [DBG] pgmap v12430: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:31:39.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:31:38 smithi047 bash[22744]: audit 2024-09-16T12:31:37.857713+0000 mgr.a (mgr.14373) 17923 : audit [DBG] from='client.384909 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:31:41.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:31:40 smithi157 bash[24585]: cluster 2024-09-16T12:31:39.590999+0000 mgr.a (mgr.14373) 17924 : cluster [DBG] pgmap v12431: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:31:41.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:31:40 smithi086 bash[24289]: cluster 2024-09-16T12:31:39.590999+0000 mgr.a (mgr.14373) 17924 : cluster [DBG] pgmap v12431: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:31:41.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:31:40 smithi047 bash[22744]: cluster 2024-09-16T12:31:39.590999+0000 mgr.a (mgr.14373) 17924 : cluster [DBG] pgmap v12431: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:31:43.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:31:42 smithi157 bash[24585]: cluster 2024-09-16T12:31:41.593128+0000 mgr.a (mgr.14373) 17925 : cluster [DBG] pgmap v12432: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:31:43.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:31:42 smithi086 bash[24289]: cluster 2024-09-16T12:31:41.593128+0000 mgr.a (mgr.14373) 17925 : cluster [DBG] pgmap v12432: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:31:43.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:31:42 smithi047 bash[22744]: cluster 2024-09-16T12:31:41.593128+0000 mgr.a (mgr.14373) 17925 : cluster [DBG] pgmap v12432: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:31:43.289 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:31:43.290 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:31:43.291 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:31:44.047 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:31:44.047 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:31:44.047 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:31:44.047 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:31:44.047 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:31:45.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:31:44 smithi157 bash[24585]: cluster 2024-09-16T12:31:43.593614+0000 mgr.a (mgr.14373) 17926 : cluster [DBG] pgmap v12433: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:31:45.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:31:44 smithi157 bash[24585]: audit 2024-09-16T12:31:43.622160+0000 mgr.a (mgr.14373) 17927 : audit [DBG] from='client.384981 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:31:45.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:31:44 smithi086 bash[24289]: cluster 2024-09-16T12:31:43.593614+0000 mgr.a (mgr.14373) 17926 : cluster [DBG] pgmap v12433: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:31:45.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:31:44 smithi086 bash[24289]: audit 2024-09-16T12:31:43.622160+0000 mgr.a (mgr.14373) 17927 : audit [DBG] from='client.384981 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:31:45.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:31:44 smithi047 bash[22744]: cluster 2024-09-16T12:31:43.593614+0000 mgr.a (mgr.14373) 17926 : cluster [DBG] pgmap v12433: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:31:45.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:31:44 smithi047 bash[22744]: audit 2024-09-16T12:31:43.622160+0000 mgr.a (mgr.14373) 17927 : audit [DBG] from='client.384981 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:31:47.060 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:31:46 smithi157 bash[24585]: cluster 2024-09-16T12:31:45.594484+0000 mgr.a (mgr.14373) 17928 : cluster [DBG] pgmap v12434: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:31:47.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:31:46 smithi086 bash[24289]: cluster 2024-09-16T12:31:45.594484+0000 mgr.a (mgr.14373) 17928 : cluster [DBG] pgmap v12434: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:31:47.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:31:46 smithi047 bash[22744]: cluster 2024-09-16T12:31:45.594484+0000 mgr.a (mgr.14373) 17928 : cluster [DBG] pgmap v12434: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:31:49.048 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:31:49.049 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:31:49.049 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:31:49.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:31:48 smithi157 bash[24585]: cluster 2024-09-16T12:31:47.596838+0000 mgr.a (mgr.14373) 17929 : cluster [DBG] pgmap v12435: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:31:49.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:31:48 smithi086 bash[24289]: cluster 2024-09-16T12:31:47.596838+0000 mgr.a (mgr.14373) 17929 : cluster [DBG] pgmap v12435: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:31:49.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:31:48 smithi047 bash[22744]: cluster 2024-09-16T12:31:47.596838+0000 mgr.a (mgr.14373) 17929 : cluster [DBG] pgmap v12435: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:31:49.827 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:31:49.827 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:31:49.828 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:31:49.828 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:31:49.828 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:31:51.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:31:50 smithi157 bash[24585]: audit 2024-09-16T12:31:49.382490+0000 mgr.a (mgr.14373) 17930 : audit [DBG] from='client.385059 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:31:51.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:31:50 smithi157 bash[24585]: cluster 2024-09-16T12:31:49.597388+0000 mgr.a (mgr.14373) 17931 : cluster [DBG] pgmap v12436: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:31:51.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:31:50 smithi086 bash[24289]: audit 2024-09-16T12:31:49.382490+0000 mgr.a (mgr.14373) 17930 : audit [DBG] from='client.385059 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:31:51.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:31:50 smithi086 bash[24289]: cluster 2024-09-16T12:31:49.597388+0000 mgr.a (mgr.14373) 17931 : cluster [DBG] pgmap v12436: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:31:51.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:31:50 smithi047 bash[22744]: audit 2024-09-16T12:31:49.382490+0000 mgr.a (mgr.14373) 17930 : audit [DBG] from='client.385059 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:31:51.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:31:50 smithi047 bash[22744]: cluster 2024-09-16T12:31:49.597388+0000 mgr.a (mgr.14373) 17931 : cluster [DBG] pgmap v12436: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:31:53.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:31:52 smithi157 bash[24585]: cluster 2024-09-16T12:31:51.599620+0000 mgr.a (mgr.14373) 17932 : cluster [DBG] pgmap v12437: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:31:53.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:31:52 smithi086 bash[24289]: cluster 2024-09-16T12:31:51.599620+0000 mgr.a (mgr.14373) 17932 : cluster [DBG] pgmap v12437: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:31:53.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:31:52 smithi047 bash[22744]: cluster 2024-09-16T12:31:51.599620+0000 mgr.a (mgr.14373) 17932 : cluster [DBG] pgmap v12437: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:31:54.829 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:31:54.829 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:31:54.830 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:31:55.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:31:54 smithi157 bash[24585]: cluster 2024-09-16T12:31:53.600393+0000 mgr.a (mgr.14373) 17933 : cluster [DBG] pgmap v12438: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:31:55.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:31:54 smithi086 bash[24289]: cluster 2024-09-16T12:31:53.600393+0000 mgr.a (mgr.14373) 17933 : cluster [DBG] pgmap v12438: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:31:55.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:31:54 smithi047 bash[22744]: cluster 2024-09-16T12:31:53.600393+0000 mgr.a (mgr.14373) 17933 : cluster [DBG] pgmap v12438: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:31:55.623 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:31:55.623 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:31:55.623 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:31:55.623 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:31:55.623 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:31:57.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:31:56 smithi157 bash[24585]: audit 2024-09-16T12:31:55.163219+0000 mgr.a (mgr.14373) 17934 : audit [DBG] from='client.385137 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:31:57.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:31:56 smithi157 bash[24585]: cluster 2024-09-16T12:31:55.600976+0000 mgr.a (mgr.14373) 17935 : cluster [DBG] pgmap v12439: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:31:57.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:31:56 smithi086 bash[24289]: audit 2024-09-16T12:31:55.163219+0000 mgr.a (mgr.14373) 17934 : audit [DBG] from='client.385137 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:31:57.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:31:56 smithi086 bash[24289]: cluster 2024-09-16T12:31:55.600976+0000 mgr.a (mgr.14373) 17935 : cluster [DBG] pgmap v12439: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:31:57.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:31:56 smithi047 bash[22744]: audit 2024-09-16T12:31:55.163219+0000 mgr.a (mgr.14373) 17934 : audit [DBG] from='client.385137 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:31:57.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:31:56 smithi047 bash[22744]: cluster 2024-09-16T12:31:55.600976+0000 mgr.a (mgr.14373) 17935 : cluster [DBG] pgmap v12439: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:31:59.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:31:58 smithi157 bash[24585]: cluster 2024-09-16T12:31:57.603220+0000 mgr.a (mgr.14373) 17936 : cluster [DBG] pgmap v12440: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:31:59.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:31:58 smithi086 bash[24289]: cluster 2024-09-16T12:31:57.603220+0000 mgr.a (mgr.14373) 17936 : cluster [DBG] pgmap v12440: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:31:59.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:31:58 smithi047 bash[22744]: cluster 2024-09-16T12:31:57.603220+0000 mgr.a (mgr.14373) 17936 : cluster [DBG] pgmap v12440: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:32:00.625 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:32:00.625 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:32:00.625 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:32:01.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:32:00 smithi157 bash[24585]: cluster 2024-09-16T12:31:59.603998+0000 mgr.a (mgr.14373) 17937 : cluster [DBG] pgmap v12441: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:32:01.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:32:00 smithi086 bash[24289]: cluster 2024-09-16T12:31:59.603998+0000 mgr.a (mgr.14373) 17937 : cluster [DBG] pgmap v12441: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:32:01.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:32:00 smithi047 bash[22744]: cluster 2024-09-16T12:31:59.603998+0000 mgr.a (mgr.14373) 17937 : cluster [DBG] pgmap v12441: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:32:01.388 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:32:01.388 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:32:01.388 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:32:01.388 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:32:01.389 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:32:02.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:32:01 smithi157 bash[24585]: audit 2024-09-16T12:32:00.955847+0000 mgr.a (mgr.14373) 17938 : audit [DBG] from='client.385209 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:32:02.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:32:01 smithi086 bash[24289]: audit 2024-09-16T12:32:00.955847+0000 mgr.a (mgr.14373) 17938 : audit [DBG] from='client.385209 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:32:02.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:32:01 smithi047 bash[22744]: audit 2024-09-16T12:32:00.955847+0000 mgr.a (mgr.14373) 17938 : audit [DBG] from='client.385209 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:32:03.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:32:02 smithi157 bash[24585]: cluster 2024-09-16T12:32:01.606244+0000 mgr.a (mgr.14373) 17939 : cluster [DBG] pgmap v12442: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:32:03.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:32:02 smithi086 bash[24289]: cluster 2024-09-16T12:32:01.606244+0000 mgr.a (mgr.14373) 17939 : cluster [DBG] pgmap v12442: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:32:03.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:32:02 smithi047 bash[22744]: cluster 2024-09-16T12:32:01.606244+0000 mgr.a (mgr.14373) 17939 : cluster [DBG] pgmap v12442: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:32:05.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:32:04 smithi157 bash[24585]: cluster 2024-09-16T12:32:03.607023+0000 mgr.a (mgr.14373) 17940 : cluster [DBG] pgmap v12443: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:32:05.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:32:04 smithi086 bash[24289]: cluster 2024-09-16T12:32:03.607023+0000 mgr.a (mgr.14373) 17940 : cluster [DBG] pgmap v12443: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:32:05.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:32:04 smithi047 bash[22744]: cluster 2024-09-16T12:32:03.607023+0000 mgr.a (mgr.14373) 17940 : cluster [DBG] pgmap v12443: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:32:06.389 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:32:06.390 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:32:06.390 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:32:07.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:32:06 smithi157 bash[24585]: cluster 2024-09-16T12:32:05.607945+0000 mgr.a (mgr.14373) 17941 : cluster [DBG] pgmap v12444: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:32:07.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:32:06 smithi086 bash[24289]: cluster 2024-09-16T12:32:05.607945+0000 mgr.a (mgr.14373) 17941 : cluster [DBG] pgmap v12444: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:32:07.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:32:06 smithi047 bash[22744]: cluster 2024-09-16T12:32:05.607945+0000 mgr.a (mgr.14373) 17941 : cluster [DBG] pgmap v12444: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:32:07.149 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:32:07.149 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:32:07.150 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:32:07.150 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:32:07.150 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:32:08.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:32:07 smithi157 bash[24585]: audit 2024-09-16T12:32:06.718475+0000 mgr.a (mgr.14373) 17942 : audit [DBG] from='client.385284 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:32:08.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:32:07 smithi086 bash[24289]: audit 2024-09-16T12:32:06.718475+0000 mgr.a (mgr.14373) 17942 : audit [DBG] from='client.385284 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:32:08.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:32:07 smithi047 bash[22744]: audit 2024-09-16T12:32:06.718475+0000 mgr.a (mgr.14373) 17942 : audit [DBG] from='client.385284 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:32:09.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:32:08 smithi086 bash[24289]: cluster 2024-09-16T12:32:07.610773+0000 mgr.a (mgr.14373) 17943 : cluster [DBG] pgmap v12445: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:32:09.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:32:08 smithi047 bash[22744]: cluster 2024-09-16T12:32:07.610773+0000 mgr.a (mgr.14373) 17943 : cluster [DBG] pgmap v12445: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:32:09.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:32:08 smithi157 bash[24585]: cluster 2024-09-16T12:32:07.610773+0000 mgr.a (mgr.14373) 17943 : cluster [DBG] pgmap v12445: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:32:11.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:32:10 smithi086 bash[24289]: cluster 2024-09-16T12:32:09.611570+0000 mgr.a (mgr.14373) 17944 : cluster [DBG] pgmap v12446: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:32:11.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:32:10 smithi047 bash[22744]: cluster 2024-09-16T12:32:09.611570+0000 mgr.a (mgr.14373) 17944 : cluster [DBG] pgmap v12446: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:32:11.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:32:10 smithi157 bash[24585]: cluster 2024-09-16T12:32:09.611570+0000 mgr.a (mgr.14373) 17944 : cluster [DBG] pgmap v12446: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:32:12.151 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:32:12.152 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:32:12.152 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:32:12.926 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:32:12.927 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:32:12.927 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:32:12.927 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:32:12.927 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:32:13.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:32:12 smithi086 bash[24289]: cluster 2024-09-16T12:32:11.613512+0000 mgr.a (mgr.14373) 17945 : cluster [DBG] pgmap v12447: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:32:13.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:32:12 smithi047 bash[22744]: cluster 2024-09-16T12:32:11.613512+0000 mgr.a (mgr.14373) 17945 : cluster [DBG] pgmap v12447: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:32:13.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:32:12 smithi157 bash[24585]: cluster 2024-09-16T12:32:11.613512+0000 mgr.a (mgr.14373) 17945 : cluster [DBG] pgmap v12447: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:32:14.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:32:13 smithi047 bash[22744]: audit 2024-09-16T12:32:12.484003+0000 mgr.a (mgr.14373) 17946 : audit [DBG] from='client.385362 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:32:14.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:32:13 smithi157 bash[24585]: audit 2024-09-16T12:32:12.484003+0000 mgr.a (mgr.14373) 17946 : audit [DBG] from='client.385362 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:32:14.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:32:13 smithi086 bash[24289]: audit 2024-09-16T12:32:12.484003+0000 mgr.a (mgr.14373) 17946 : audit [DBG] from='client.385362 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:32:15.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:32:14 smithi047 bash[22744]: cluster 2024-09-16T12:32:13.614461+0000 mgr.a (mgr.14373) 17947 : cluster [DBG] pgmap v12448: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:32:15.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:32:14 smithi157 bash[24585]: cluster 2024-09-16T12:32:13.614461+0000 mgr.a (mgr.14373) 17947 : cluster [DBG] pgmap v12448: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:32:15.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:32:14 smithi086 bash[24289]: cluster 2024-09-16T12:32:13.614461+0000 mgr.a (mgr.14373) 17947 : cluster [DBG] pgmap v12448: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:32:17.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:32:16 smithi047 bash[22744]: cluster 2024-09-16T12:32:15.615248+0000 mgr.a (mgr.14373) 17948 : cluster [DBG] pgmap v12449: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T12:32:17.308 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:32:16 smithi157 bash[24585]: cluster 2024-09-16T12:32:15.615248+0000 mgr.a (mgr.14373) 17948 : cluster [DBG] pgmap v12449: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T12:32:17.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:32:16 smithi086 bash[24289]: cluster 2024-09-16T12:32:15.615248+0000 mgr.a (mgr.14373) 17948 : cluster [DBG] pgmap v12449: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T12:32:17.928 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:32:17.928 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:32:17.929 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:32:18.708 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:32:18.708 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:32:18.708 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:32:18.708 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:32:18.709 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:32:19.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:32:18 smithi047 bash[22744]: cluster 2024-09-16T12:32:17.617470+0000 mgr.a (mgr.14373) 17949 : cluster [DBG] pgmap v12450: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:32:19.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:32:18 smithi157 bash[24585]: cluster 2024-09-16T12:32:17.617470+0000 mgr.a (mgr.14373) 17949 : cluster [DBG] pgmap v12450: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:32:19.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:32:18 smithi086 bash[24289]: cluster 2024-09-16T12:32:17.617470+0000 mgr.a (mgr.14373) 17949 : cluster [DBG] pgmap v12450: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:32:20.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:32:19 smithi157 bash[24585]: audit 2024-09-16T12:32:18.262664+0000 mgr.a (mgr.14373) 17950 : audit [DBG] from='client.385437 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:32:20.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:32:19 smithi086 bash[24289]: audit 2024-09-16T12:32:18.262664+0000 mgr.a (mgr.14373) 17950 : audit [DBG] from='client.385437 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:32:20.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:32:19 smithi047 bash[22744]: audit 2024-09-16T12:32:18.262664+0000 mgr.a (mgr.14373) 17950 : audit [DBG] from='client.385437 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:32:21.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:32:20 smithi157 bash[24585]: cluster 2024-09-16T12:32:19.618404+0000 mgr.a (mgr.14373) 17951 : cluster [DBG] pgmap v12451: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:32:21.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:32:20 smithi086 bash[24289]: cluster 2024-09-16T12:32:19.618404+0000 mgr.a (mgr.14373) 17951 : cluster [DBG] pgmap v12451: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:32:21.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:32:20 smithi047 bash[22744]: cluster 2024-09-16T12:32:19.618404+0000 mgr.a (mgr.14373) 17951 : cluster [DBG] pgmap v12451: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:32:23.309 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:32:22 smithi157 bash[24585]: cluster 2024-09-16T12:32:21.620557+0000 mgr.a (mgr.14373) 17952 : cluster [DBG] pgmap v12452: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:32:23.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:32:22 smithi086 bash[24289]: cluster 2024-09-16T12:32:21.620557+0000 mgr.a (mgr.14373) 17952 : cluster [DBG] pgmap v12452: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:32:23.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:32:22 smithi047 bash[22744]: cluster 2024-09-16T12:32:21.620557+0000 mgr.a (mgr.14373) 17952 : cluster [DBG] pgmap v12452: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:32:23.709 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:32:23.710 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:32:23.710 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:32:24.472 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:32:24.472 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:32:24.473 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:32:24.473 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:32:24.473 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:32:25.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:32:24 smithi157 bash[24585]: cluster 2024-09-16T12:32:23.621322+0000 mgr.a (mgr.14373) 17953 : cluster [DBG] pgmap v12453: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:32:25.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:32:24 smithi157 bash[24585]: audit 2024-09-16T12:32:24.038125+0000 mgr.a (mgr.14373) 17954 : audit [DBG] from='client.385515 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:32:25.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:32:24 smithi086 bash[24289]: cluster 2024-09-16T12:32:23.621322+0000 mgr.a (mgr.14373) 17953 : cluster [DBG] pgmap v12453: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:32:25.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:32:24 smithi086 bash[24289]: audit 2024-09-16T12:32:24.038125+0000 mgr.a (mgr.14373) 17954 : audit [DBG] from='client.385515 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:32:25.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:32:24 smithi047 bash[22744]: cluster 2024-09-16T12:32:23.621322+0000 mgr.a (mgr.14373) 17953 : cluster [DBG] pgmap v12453: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:32:25.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:32:24 smithi047 bash[22744]: audit 2024-09-16T12:32:24.038125+0000 mgr.a (mgr.14373) 17954 : audit [DBG] from='client.385515 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:32:27.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:32:26 smithi157 bash[24585]: cluster 2024-09-16T12:32:25.622253+0000 mgr.a (mgr.14373) 17955 : cluster [DBG] pgmap v12454: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:32:27.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:32:26 smithi086 bash[24289]: cluster 2024-09-16T12:32:25.622253+0000 mgr.a (mgr.14373) 17955 : cluster [DBG] pgmap v12454: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:32:27.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:32:26 smithi047 bash[22744]: cluster 2024-09-16T12:32:25.622253+0000 mgr.a (mgr.14373) 17955 : cluster [DBG] pgmap v12454: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:32:29.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:32:28 smithi157 bash[24585]: cluster 2024-09-16T12:32:27.624493+0000 mgr.a (mgr.14373) 17956 : cluster [DBG] pgmap v12455: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:32:29.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:32:28 smithi086 bash[24289]: cluster 2024-09-16T12:32:27.624493+0000 mgr.a (mgr.14373) 17956 : cluster [DBG] pgmap v12455: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:32:29.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:32:28 smithi047 bash[22744]: cluster 2024-09-16T12:32:27.624493+0000 mgr.a (mgr.14373) 17956 : cluster [DBG] pgmap v12455: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:32:29.474 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:32:29.474 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:32:29.474 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:32:30.265 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:32:30.265 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:32:30.265 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:32:30.265 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:32:30.265 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:32:31.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:32:30 smithi157 bash[24585]: cluster 2024-09-16T12:32:29.625028+0000 mgr.a (mgr.14373) 17957 : cluster [DBG] pgmap v12456: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:32:31.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:32:30 smithi157 bash[24585]: audit 2024-09-16T12:32:29.806317+0000 mgr.a (mgr.14373) 17958 : audit [DBG] from='client.385593 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:32:31.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:32:30 smithi086 bash[24289]: cluster 2024-09-16T12:32:29.625028+0000 mgr.a (mgr.14373) 17957 : cluster [DBG] pgmap v12456: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:32:31.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:32:30 smithi086 bash[24289]: audit 2024-09-16T12:32:29.806317+0000 mgr.a (mgr.14373) 17958 : audit [DBG] from='client.385593 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:32:31.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:32:30 smithi047 bash[22744]: cluster 2024-09-16T12:32:29.625028+0000 mgr.a (mgr.14373) 17957 : cluster [DBG] pgmap v12456: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:32:31.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:32:30 smithi047 bash[22744]: audit 2024-09-16T12:32:29.806317+0000 mgr.a (mgr.14373) 17958 : audit [DBG] from='client.385593 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:32:32.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:32:31 smithi157 bash[24585]: audit 2024-09-16T12:32:31.518319+0000 mon.b (mon.2) 1626 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T12:32:32.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:32:31 smithi086 bash[24289]: audit 2024-09-16T12:32:31.518319+0000 mon.b (mon.2) 1626 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T12:32:32.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:32:31 smithi047 bash[22744]: audit 2024-09-16T12:32:31.518319+0000 mon.b (mon.2) 1626 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T12:32:33.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:32:32 smithi157 bash[24585]: cluster 2024-09-16T12:32:31.626914+0000 mgr.a (mgr.14373) 17959 : cluster [DBG] pgmap v12457: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:32:33.308 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:32:32 smithi157 bash[24585]: audit 2024-09-16T12:32:32.346765+0000 mon.b (mon.2) 1627 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T12:32:33.308 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:32:32 smithi157 bash[24585]: audit 2024-09-16T12:32:32.349030+0000 mon.b (mon.2) 1628 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T12:32:33.308 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:32:32 smithi157 bash[24585]: audit 2024-09-16T12:32:32.359468+0000 mon.a (mon.0) 1638 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:32:33.308 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:32:32 smithi157 bash[24585]: audit 2024-09-16T12:32:32.362924+0000 mon.b (mon.2) 1629 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:32:33.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:32:32 smithi086 bash[24289]: cluster 2024-09-16T12:32:31.626914+0000 mgr.a (mgr.14373) 17959 : cluster [DBG] pgmap v12457: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:32:33.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:32:32 smithi086 bash[24289]: audit 2024-09-16T12:32:32.346765+0000 mon.b (mon.2) 1627 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T12:32:33.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:32:32 smithi086 bash[24289]: audit 2024-09-16T12:32:32.349030+0000 mon.b (mon.2) 1628 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T12:32:33.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:32:32 smithi086 bash[24289]: audit 2024-09-16T12:32:32.359468+0000 mon.a (mon.0) 1638 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:32:33.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:32:32 smithi086 bash[24289]: audit 2024-09-16T12:32:32.362924+0000 mon.b (mon.2) 1629 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:32:33.343 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 12:32:33 smithi047 bash[22994]: debug 2024-09-16T12:32:33.107+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T12:32:33.343 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 12:32:33 smithi047 bash[22994]: debug 2024-09-16T12:32:33.111+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T12:32:33.344 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:32:32 smithi047 bash[22744]: cluster 2024-09-16T12:32:31.626914+0000 mgr.a (mgr.14373) 17959 : cluster [DBG] pgmap v12457: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:32:33.344 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:32:32 smithi047 bash[22744]: audit 2024-09-16T12:32:32.346765+0000 mon.b (mon.2) 1627 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T12:32:33.344 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:32:32 smithi047 bash[22744]: audit 2024-09-16T12:32:32.349030+0000 mon.b (mon.2) 1628 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T12:32:33.344 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:32:32 smithi047 bash[22744]: audit 2024-09-16T12:32:32.359468+0000 mon.a (mon.0) 1638 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:32:33.344 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:32:32 smithi047 bash[22744]: audit 2024-09-16T12:32:32.362924+0000 mon.b (mon.2) 1629 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:32:34.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:32:33 smithi157 bash[24585]: audit 2024-09-16T12:32:32.365344+0000 mgr.a (mgr.14373) 17960 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:32:34.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:32:33 smithi157 bash[24585]: audit 2024-09-16T12:32:33.113447+0000 mgr.a (mgr.14373) 17961 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T12:32:34.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:32:33 smithi157 bash[24585]: cephadm 2024-09-16T12:32:33.115791+0000 mgr.a (mgr.14373) 17962 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T12:32:34.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:32:33 smithi086 bash[24289]: audit 2024-09-16T12:32:32.365344+0000 mgr.a (mgr.14373) 17960 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:32:34.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:32:33 smithi086 bash[24289]: audit 2024-09-16T12:32:33.113447+0000 mgr.a (mgr.14373) 17961 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T12:32:34.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:32:33 smithi086 bash[24289]: cephadm 2024-09-16T12:32:33.115791+0000 mgr.a (mgr.14373) 17962 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T12:32:34.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:32:33 smithi047 bash[22744]: audit 2024-09-16T12:32:32.365344+0000 mgr.a (mgr.14373) 17960 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:32:34.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:32:33 smithi047 bash[22744]: audit 2024-09-16T12:32:33.113447+0000 mgr.a (mgr.14373) 17961 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T12:32:34.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:32:33 smithi047 bash[22744]: cephadm 2024-09-16T12:32:33.115791+0000 mgr.a (mgr.14373) 17962 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T12:32:35.266 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:32:35.267 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:32:35.267 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:32:35.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:32:34 smithi157 bash[24585]: cluster 2024-09-16T12:32:33.627790+0000 mgr.a (mgr.14373) 17963 : cluster [DBG] pgmap v12458: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:32:35.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:32:34 smithi086 bash[24289]: cluster 2024-09-16T12:32:33.627790+0000 mgr.a (mgr.14373) 17963 : cluster [DBG] pgmap v12458: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:32:35.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:32:34 smithi047 bash[22744]: cluster 2024-09-16T12:32:33.627790+0000 mgr.a (mgr.14373) 17963 : cluster [DBG] pgmap v12458: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:32:36.035 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:32:36.035 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:32:36.036 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:32:36.036 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:32:36.036 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:32:37.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:32:36 smithi157 bash[24585]: audit 2024-09-16T12:32:35.601416+0000 mgr.a (mgr.14373) 17964 : audit [DBG] from='client.385779 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:32:37.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:32:36 smithi157 bash[24585]: cluster 2024-09-16T12:32:35.629026+0000 mgr.a (mgr.14373) 17965 : cluster [DBG] pgmap v12459: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:32:37.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:32:36 smithi086 bash[24289]: audit 2024-09-16T12:32:35.601416+0000 mgr.a (mgr.14373) 17964 : audit [DBG] from='client.385779 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:32:37.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:32:36 smithi086 bash[24289]: cluster 2024-09-16T12:32:35.629026+0000 mgr.a (mgr.14373) 17965 : cluster [DBG] pgmap v12459: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:32:37.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:32:36 smithi047 bash[22744]: audit 2024-09-16T12:32:35.601416+0000 mgr.a (mgr.14373) 17964 : audit [DBG] from='client.385779 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:32:37.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:32:36 smithi047 bash[22744]: cluster 2024-09-16T12:32:35.629026+0000 mgr.a (mgr.14373) 17965 : cluster [DBG] pgmap v12459: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:32:39.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:32:38 smithi157 bash[24585]: cluster 2024-09-16T12:32:37.631545+0000 mgr.a (mgr.14373) 17966 : cluster [DBG] pgmap v12460: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:32:39.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:32:38 smithi086 bash[24289]: cluster 2024-09-16T12:32:37.631545+0000 mgr.a (mgr.14373) 17966 : cluster [DBG] pgmap v12460: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:32:39.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:32:38 smithi047 bash[22744]: cluster 2024-09-16T12:32:37.631545+0000 mgr.a (mgr.14373) 17966 : cluster [DBG] pgmap v12460: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:32:41.037 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:32:41.038 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:32:41.038 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:32:41.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:32:40 smithi157 bash[24585]: cluster 2024-09-16T12:32:39.632294+0000 mgr.a (mgr.14373) 17967 : cluster [DBG] pgmap v12461: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:32:41.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:32:40 smithi086 bash[24289]: cluster 2024-09-16T12:32:39.632294+0000 mgr.a (mgr.14373) 17967 : cluster [DBG] pgmap v12461: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:32:41.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:32:40 smithi047 bash[22744]: cluster 2024-09-16T12:32:39.632294+0000 mgr.a (mgr.14373) 17967 : cluster [DBG] pgmap v12461: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:32:41.824 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:32:41.824 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:32:41.824 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:32:41.824 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:32:41.824 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:32:43.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:32:42 smithi157 bash[24585]: audit 2024-09-16T12:32:41.371584+0000 mgr.a (mgr.14373) 17968 : audit [DBG] from='client.385854 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:32:43.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:32:42 smithi157 bash[24585]: cluster 2024-09-16T12:32:41.634085+0000 mgr.a (mgr.14373) 17969 : cluster [DBG] pgmap v12462: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:32:43.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:32:42 smithi086 bash[24289]: audit 2024-09-16T12:32:41.371584+0000 mgr.a (mgr.14373) 17968 : audit [DBG] from='client.385854 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:32:43.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:32:42 smithi086 bash[24289]: cluster 2024-09-16T12:32:41.634085+0000 mgr.a (mgr.14373) 17969 : cluster [DBG] pgmap v12462: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:32:43.344 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:32:42 smithi047 bash[22744]: audit 2024-09-16T12:32:41.371584+0000 mgr.a (mgr.14373) 17968 : audit [DBG] from='client.385854 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:32:43.344 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:32:42 smithi047 bash[22744]: cluster 2024-09-16T12:32:41.634085+0000 mgr.a (mgr.14373) 17969 : cluster [DBG] pgmap v12462: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:32:45.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:32:44 smithi157 bash[24585]: cluster 2024-09-16T12:32:43.634955+0000 mgr.a (mgr.14373) 17970 : cluster [DBG] pgmap v12463: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T12:32:45.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:32:44 smithi086 bash[24289]: cluster 2024-09-16T12:32:43.634955+0000 mgr.a (mgr.14373) 17970 : cluster [DBG] pgmap v12463: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T12:32:45.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:32:44 smithi047 bash[22744]: cluster 2024-09-16T12:32:43.634955+0000 mgr.a (mgr.14373) 17970 : cluster [DBG] pgmap v12463: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T12:32:46.826 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:32:46.826 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:32:46.827 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:32:47.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:32:46 smithi157 bash[24585]: cluster 2024-09-16T12:32:45.635743+0000 mgr.a (mgr.14373) 17971 : cluster [DBG] pgmap v12464: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T12:32:47.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:32:46 smithi086 bash[24289]: cluster 2024-09-16T12:32:45.635743+0000 mgr.a (mgr.14373) 17971 : cluster [DBG] pgmap v12464: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T12:32:47.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:32:46 smithi047 bash[22744]: cluster 2024-09-16T12:32:45.635743+0000 mgr.a (mgr.14373) 17971 : cluster [DBG] pgmap v12464: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T12:32:47.578 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:32:47.578 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:32:47.578 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:32:47.578 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:32:47.578 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:32:49.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:32:48 smithi157 bash[24585]: audit 2024-09-16T12:32:47.163020+0000 mgr.a (mgr.14373) 17972 : audit [DBG] from='client.385929 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:32:49.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:32:48 smithi157 bash[24585]: cluster 2024-09-16T12:32:47.638485+0000 mgr.a (mgr.14373) 17973 : cluster [DBG] pgmap v12465: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:32:49.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:32:48 smithi086 bash[24289]: audit 2024-09-16T12:32:47.163020+0000 mgr.a (mgr.14373) 17972 : audit [DBG] from='client.385929 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:32:49.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:32:48 smithi086 bash[24289]: cluster 2024-09-16T12:32:47.638485+0000 mgr.a (mgr.14373) 17973 : cluster [DBG] pgmap v12465: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:32:49.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:32:48 smithi047 bash[22744]: audit 2024-09-16T12:32:47.163020+0000 mgr.a (mgr.14373) 17972 : audit [DBG] from='client.385929 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:32:49.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:32:48 smithi047 bash[22744]: cluster 2024-09-16T12:32:47.638485+0000 mgr.a (mgr.14373) 17973 : cluster [DBG] pgmap v12465: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:32:51.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:32:50 smithi157 bash[24585]: cluster 2024-09-16T12:32:49.639177+0000 mgr.a (mgr.14373) 17974 : cluster [DBG] pgmap v12466: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:32:51.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:32:50 smithi086 bash[24289]: cluster 2024-09-16T12:32:49.639177+0000 mgr.a (mgr.14373) 17974 : cluster [DBG] pgmap v12466: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:32:51.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:32:50 smithi047 bash[22744]: cluster 2024-09-16T12:32:49.639177+0000 mgr.a (mgr.14373) 17974 : cluster [DBG] pgmap v12466: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:32:52.579 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:32:52.580 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:32:52.580 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:32:53.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:32:52 smithi157 bash[24585]: cluster 2024-09-16T12:32:51.641079+0000 mgr.a (mgr.14373) 17975 : cluster [DBG] pgmap v12467: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:32:53.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:32:52 smithi086 bash[24289]: cluster 2024-09-16T12:32:51.641079+0000 mgr.a (mgr.14373) 17975 : cluster [DBG] pgmap v12467: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:32:53.322 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:32:53.322 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:32:53.322 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:32:53.322 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:32:53.322 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:32:53.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:32:52 smithi047 bash[22744]: cluster 2024-09-16T12:32:51.641079+0000 mgr.a (mgr.14373) 17975 : cluster [DBG] pgmap v12467: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:32:54.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:32:53 smithi157 bash[24585]: audit 2024-09-16T12:32:52.907384+0000 mgr.a (mgr.14373) 17976 : audit [DBG] from='client.386004 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:32:54.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:32:53 smithi086 bash[24289]: audit 2024-09-16T12:32:52.907384+0000 mgr.a (mgr.14373) 17976 : audit [DBG] from='client.386004 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:32:54.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:32:53 smithi047 bash[22744]: audit 2024-09-16T12:32:52.907384+0000 mgr.a (mgr.14373) 17976 : audit [DBG] from='client.386004 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:32:55.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:32:54 smithi157 bash[24585]: cluster 2024-09-16T12:32:53.641944+0000 mgr.a (mgr.14373) 17977 : cluster [DBG] pgmap v12468: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:32:55.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:32:54 smithi086 bash[24289]: cluster 2024-09-16T12:32:53.641944+0000 mgr.a (mgr.14373) 17977 : cluster [DBG] pgmap v12468: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:32:55.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:32:54 smithi047 bash[22744]: cluster 2024-09-16T12:32:53.641944+0000 mgr.a (mgr.14373) 17977 : cluster [DBG] pgmap v12468: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:32:57.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:32:56 smithi157 bash[24585]: cluster 2024-09-16T12:32:55.642741+0000 mgr.a (mgr.14373) 17978 : cluster [DBG] pgmap v12469: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:32:57.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:32:56 smithi086 bash[24289]: cluster 2024-09-16T12:32:55.642741+0000 mgr.a (mgr.14373) 17978 : cluster [DBG] pgmap v12469: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:32:57.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:32:56 smithi047 bash[22744]: cluster 2024-09-16T12:32:55.642741+0000 mgr.a (mgr.14373) 17978 : cluster [DBG] pgmap v12469: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:32:58.324 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:32:58.325 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:32:58.325 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:32:59.119 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:32:59.119 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:32:59.120 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:32:59.120 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:32:59.120 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:32:59.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:32:58 smithi157 bash[24585]: cluster 2024-09-16T12:32:57.644957+0000 mgr.a (mgr.14373) 17979 : cluster [DBG] pgmap v12470: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:32:59.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:32:58 smithi086 bash[24289]: cluster 2024-09-16T12:32:57.644957+0000 mgr.a (mgr.14373) 17979 : cluster [DBG] pgmap v12470: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:32:59.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:32:58 smithi047 bash[22744]: cluster 2024-09-16T12:32:57.644957+0000 mgr.a (mgr.14373) 17979 : cluster [DBG] pgmap v12470: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:33:00.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:32:59 smithi157 bash[24585]: audit 2024-09-16T12:32:58.665737+0000 mgr.a (mgr.14373) 17980 : audit [DBG] from='client.386082 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:33:00.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:32:59 smithi086 bash[24289]: audit 2024-09-16T12:32:58.665737+0000 mgr.a (mgr.14373) 17980 : audit [DBG] from='client.386082 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:33:00.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:32:59 smithi047 bash[22744]: audit 2024-09-16T12:32:58.665737+0000 mgr.a (mgr.14373) 17980 : audit [DBG] from='client.386082 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:33:01.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:33:00 smithi157 bash[24585]: cluster 2024-09-16T12:32:59.645833+0000 mgr.a (mgr.14373) 17981 : cluster [DBG] pgmap v12471: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:33:01.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:33:00 smithi086 bash[24289]: cluster 2024-09-16T12:32:59.645833+0000 mgr.a (mgr.14373) 17981 : cluster [DBG] pgmap v12471: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:33:01.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:33:00 smithi047 bash[22744]: cluster 2024-09-16T12:32:59.645833+0000 mgr.a (mgr.14373) 17981 : cluster [DBG] pgmap v12471: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:33:03.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:33:02 smithi157 bash[24585]: cluster 2024-09-16T12:33:01.648026+0000 mgr.a (mgr.14373) 17982 : cluster [DBG] pgmap v12472: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:33:03.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:33:02 smithi086 bash[24289]: cluster 2024-09-16T12:33:01.648026+0000 mgr.a (mgr.14373) 17982 : cluster [DBG] pgmap v12472: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:33:03.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:33:02 smithi047 bash[22744]: cluster 2024-09-16T12:33:01.648026+0000 mgr.a (mgr.14373) 17982 : cluster [DBG] pgmap v12472: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:33:04.121 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:33:04.122 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:33:04.122 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:33:04.916 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:33:04.917 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:33:04.917 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:33:04.917 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:33:04.917 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:33:05.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:33:04 smithi157 bash[24585]: cluster 2024-09-16T12:33:03.648789+0000 mgr.a (mgr.14373) 17983 : cluster [DBG] pgmap v12473: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:33:05.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:33:04 smithi086 bash[24289]: cluster 2024-09-16T12:33:03.648789+0000 mgr.a (mgr.14373) 17983 : cluster [DBG] pgmap v12473: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:33:05.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:33:04 smithi047 bash[22744]: cluster 2024-09-16T12:33:03.648789+0000 mgr.a (mgr.14373) 17983 : cluster [DBG] pgmap v12473: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:33:06.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:33:05 smithi157 bash[24585]: audit 2024-09-16T12:33:04.455608+0000 mgr.a (mgr.14373) 17984 : audit [DBG] from='client.386160 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:33:06.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:33:05 smithi086 bash[24289]: audit 2024-09-16T12:33:04.455608+0000 mgr.a (mgr.14373) 17984 : audit [DBG] from='client.386160 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:33:06.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:33:05 smithi047 bash[22744]: audit 2024-09-16T12:33:04.455608+0000 mgr.a (mgr.14373) 17984 : audit [DBG] from='client.386160 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:33:07.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:33:06 smithi157 bash[24585]: cluster 2024-09-16T12:33:05.649708+0000 mgr.a (mgr.14373) 17985 : cluster [DBG] pgmap v12474: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:33:07.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:33:06 smithi086 bash[24289]: cluster 2024-09-16T12:33:05.649708+0000 mgr.a (mgr.14373) 17985 : cluster [DBG] pgmap v12474: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:33:07.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:33:06 smithi047 bash[22744]: cluster 2024-09-16T12:33:05.649708+0000 mgr.a (mgr.14373) 17985 : cluster [DBG] pgmap v12474: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:33:09.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:33:08 smithi157 bash[24585]: cluster 2024-09-16T12:33:07.651963+0000 mgr.a (mgr.14373) 17986 : cluster [DBG] pgmap v12475: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:33:09.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:33:08 smithi086 bash[24289]: cluster 2024-09-16T12:33:07.651963+0000 mgr.a (mgr.14373) 17986 : cluster [DBG] pgmap v12475: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:33:09.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:33:08 smithi047 bash[22744]: cluster 2024-09-16T12:33:07.651963+0000 mgr.a (mgr.14373) 17986 : cluster [DBG] pgmap v12475: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:33:09.920 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:33:09.920 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:33:09.921 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:33:10.671 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:33:10.671 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:33:10.671 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:33:10.671 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:33:10.671 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:33:11.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:33:10 smithi157 bash[24585]: cluster 2024-09-16T12:33:09.652705+0000 mgr.a (mgr.14373) 17987 : cluster [DBG] pgmap v12476: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:33:11.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:33:10 smithi086 bash[24289]: cluster 2024-09-16T12:33:09.652705+0000 mgr.a (mgr.14373) 17987 : cluster [DBG] pgmap v12476: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:33:11.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:33:10 smithi047 bash[22744]: cluster 2024-09-16T12:33:09.652705+0000 mgr.a (mgr.14373) 17987 : cluster [DBG] pgmap v12476: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:33:12.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:33:12 smithi157 bash[24585]: audit 2024-09-16T12:33:10.246094+0000 mgr.a (mgr.14373) 17988 : audit [DBG] from='client.386235 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:33:12.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:33:12 smithi086 bash[24289]: audit 2024-09-16T12:33:10.246094+0000 mgr.a (mgr.14373) 17988 : audit [DBG] from='client.386235 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:33:12.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:33:12 smithi047 bash[22744]: audit 2024-09-16T12:33:10.246094+0000 mgr.a (mgr.14373) 17988 : audit [DBG] from='client.386235 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:33:13.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:33:13 smithi157 bash[24585]: cluster 2024-09-16T12:33:11.654986+0000 mgr.a (mgr.14373) 17989 : cluster [DBG] pgmap v12477: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:33:13.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:33:13 smithi086 bash[24289]: cluster 2024-09-16T12:33:11.654986+0000 mgr.a (mgr.14373) 17989 : cluster [DBG] pgmap v12477: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:33:13.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:33:13 smithi047 bash[22744]: cluster 2024-09-16T12:33:11.654986+0000 mgr.a (mgr.14373) 17989 : cluster [DBG] pgmap v12477: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:33:15.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:33:15 smithi157 bash[24585]: cluster 2024-09-16T12:33:13.655732+0000 mgr.a (mgr.14373) 17990 : cluster [DBG] pgmap v12478: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:33:15.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:33:15 smithi086 bash[24289]: cluster 2024-09-16T12:33:13.655732+0000 mgr.a (mgr.14373) 17990 : cluster [DBG] pgmap v12478: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:33:15.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:33:15 smithi047 bash[22744]: cluster 2024-09-16T12:33:13.655732+0000 mgr.a (mgr.14373) 17990 : cluster [DBG] pgmap v12478: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:33:15.672 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:33:15.673 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:33:15.673 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:33:16.427 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:33:16.427 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:33:16.427 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:33:16.427 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:33:16.427 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:33:17.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:33:17 smithi157 bash[24585]: cluster 2024-09-16T12:33:15.656486+0000 mgr.a (mgr.14373) 17991 : cluster [DBG] pgmap v12479: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:33:17.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:33:17 smithi157 bash[24585]: audit 2024-09-16T12:33:16.002150+0000 mgr.a (mgr.14373) 17992 : audit [DBG] from='client.386313 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:33:17.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:33:17 smithi086 bash[24289]: cluster 2024-09-16T12:33:15.656486+0000 mgr.a (mgr.14373) 17991 : cluster [DBG] pgmap v12479: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:33:17.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:33:17 smithi086 bash[24289]: audit 2024-09-16T12:33:16.002150+0000 mgr.a (mgr.14373) 17992 : audit [DBG] from='client.386313 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:33:17.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:33:17 smithi047 bash[22744]: cluster 2024-09-16T12:33:15.656486+0000 mgr.a (mgr.14373) 17991 : cluster [DBG] pgmap v12479: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:33:17.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:33:17 smithi047 bash[22744]: audit 2024-09-16T12:33:16.002150+0000 mgr.a (mgr.14373) 17992 : audit [DBG] from='client.386313 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:33:19.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:33:19 smithi157 bash[24585]: cluster 2024-09-16T12:33:17.658827+0000 mgr.a (mgr.14373) 17993 : cluster [DBG] pgmap v12480: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:33:19.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:33:19 smithi086 bash[24289]: cluster 2024-09-16T12:33:17.658827+0000 mgr.a (mgr.14373) 17993 : cluster [DBG] pgmap v12480: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:33:19.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:33:19 smithi047 bash[22744]: cluster 2024-09-16T12:33:17.658827+0000 mgr.a (mgr.14373) 17993 : cluster [DBG] pgmap v12480: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:33:21.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:33:21 smithi157 bash[24585]: cluster 2024-09-16T12:33:19.659745+0000 mgr.a (mgr.14373) 17994 : cluster [DBG] pgmap v12481: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:33:21.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:33:21 smithi086 bash[24289]: cluster 2024-09-16T12:33:19.659745+0000 mgr.a (mgr.14373) 17994 : cluster [DBG] pgmap v12481: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:33:21.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:33:21 smithi047 bash[22744]: cluster 2024-09-16T12:33:19.659745+0000 mgr.a (mgr.14373) 17994 : cluster [DBG] pgmap v12481: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:33:21.429 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:33:21.429 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:33:21.429 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:33:22.221 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:33:22.221 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:33:22.222 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:33:22.222 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:33:22.222 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:33:23.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:33:23 smithi157 bash[24585]: cluster 2024-09-16T12:33:21.661849+0000 mgr.a (mgr.14373) 17995 : cluster [DBG] pgmap v12482: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:33:23.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:33:23 smithi157 bash[24585]: audit 2024-09-16T12:33:21.763691+0000 mgr.a (mgr.14373) 17996 : audit [DBG] from='client.386385 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:33:23.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:33:23 smithi086 bash[24289]: cluster 2024-09-16T12:33:21.661849+0000 mgr.a (mgr.14373) 17995 : cluster [DBG] pgmap v12482: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:33:23.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:33:23 smithi086 bash[24289]: audit 2024-09-16T12:33:21.763691+0000 mgr.a (mgr.14373) 17996 : audit [DBG] from='client.386385 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:33:23.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:33:23 smithi047 bash[22744]: cluster 2024-09-16T12:33:21.661849+0000 mgr.a (mgr.14373) 17995 : cluster [DBG] pgmap v12482: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:33:23.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:33:23 smithi047 bash[22744]: audit 2024-09-16T12:33:21.763691+0000 mgr.a (mgr.14373) 17996 : audit [DBG] from='client.386385 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:33:25.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:33:25 smithi157 bash[24585]: cluster 2024-09-16T12:33:23.662818+0000 mgr.a (mgr.14373) 17997 : cluster [DBG] pgmap v12483: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:33:25.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:33:25 smithi086 bash[24289]: cluster 2024-09-16T12:33:23.662818+0000 mgr.a (mgr.14373) 17997 : cluster [DBG] pgmap v12483: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:33:25.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:33:25 smithi047 bash[22744]: cluster 2024-09-16T12:33:23.662818+0000 mgr.a (mgr.14373) 17997 : cluster [DBG] pgmap v12483: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:33:27.219 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:33:27.220 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:33:27.220 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:33:27.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:33:27 smithi157 bash[24585]: cluster 2024-09-16T12:33:25.663569+0000 mgr.a (mgr.14373) 17998 : cluster [DBG] pgmap v12484: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T12:33:27.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:33:27 smithi086 bash[24289]: cluster 2024-09-16T12:33:25.663569+0000 mgr.a (mgr.14373) 17998 : cluster [DBG] pgmap v12484: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T12:33:27.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:33:27 smithi047 bash[22744]: cluster 2024-09-16T12:33:25.663569+0000 mgr.a (mgr.14373) 17998 : cluster [DBG] pgmap v12484: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T12:33:28.002 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:33:28.002 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:33:28.002 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:33:28.002 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:33:28.002 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:33:29.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:33:29 smithi157 bash[24585]: audit 2024-09-16T12:33:27.553882+0000 mgr.a (mgr.14373) 17999 : audit [DBG] from='client.386460 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:33:29.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:33:29 smithi157 bash[24585]: cluster 2024-09-16T12:33:27.664775+0000 mgr.a (mgr.14373) 18000 : cluster [DBG] pgmap v12485: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:33:29.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:33:29 smithi086 bash[24289]: audit 2024-09-16T12:33:27.553882+0000 mgr.a (mgr.14373) 17999 : audit [DBG] from='client.386460 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:33:29.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:33:29 smithi086 bash[24289]: cluster 2024-09-16T12:33:27.664775+0000 mgr.a (mgr.14373) 18000 : cluster [DBG] pgmap v12485: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:33:29.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:33:29 smithi047 bash[22744]: audit 2024-09-16T12:33:27.553882+0000 mgr.a (mgr.14373) 17999 : audit [DBG] from='client.386460 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:33:29.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:33:29 smithi047 bash[22744]: cluster 2024-09-16T12:33:27.664775+0000 mgr.a (mgr.14373) 18000 : cluster [DBG] pgmap v12485: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:33:31.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:33:31 smithi157 bash[24585]: cluster 2024-09-16T12:33:29.665597+0000 mgr.a (mgr.14373) 18001 : cluster [DBG] pgmap v12486: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T12:33:31.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:33:31 smithi086 bash[24289]: cluster 2024-09-16T12:33:29.665597+0000 mgr.a (mgr.14373) 18001 : cluster [DBG] pgmap v12486: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T12:33:31.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:33:31 smithi047 bash[22744]: cluster 2024-09-16T12:33:29.665597+0000 mgr.a (mgr.14373) 18001 : cluster [DBG] pgmap v12486: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T12:33:33.004 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:33:33.004 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:33:33.004 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:33:33.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:33:33 smithi157 bash[24585]: cluster 2024-09-16T12:33:31.667726+0000 mgr.a (mgr.14373) 18002 : cluster [DBG] pgmap v12487: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:33:33.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:33:33 smithi086 bash[24289]: cluster 2024-09-16T12:33:31.667726+0000 mgr.a (mgr.14373) 18002 : cluster [DBG] pgmap v12487: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:33:33.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:33:33 smithi047 bash[22744]: cluster 2024-09-16T12:33:31.667726+0000 mgr.a (mgr.14373) 18002 : cluster [DBG] pgmap v12487: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:33:33.768 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:33:33.768 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:33:33.768 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:33:33.768 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:33:33.768 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:33:34.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:33:34 smithi157 bash[24585]: audit 2024-09-16T12:33:33.168888+0000 mon.b (mon.2) 1630 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T12:33:34.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:33:34 smithi157 bash[24585]: audit 2024-09-16T12:33:33.798826+0000 mon.a (mon.0) 1639 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:33:34.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:33:34 smithi157 bash[24585]: audit 2024-09-16T12:33:33.803641+0000 mon.a (mon.0) 1640 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:33:34.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:33:34 smithi086 bash[24289]: audit 2024-09-16T12:33:33.168888+0000 mon.b (mon.2) 1630 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T12:33:34.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:33:34 smithi086 bash[24289]: audit 2024-09-16T12:33:33.798826+0000 mon.a (mon.0) 1639 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:33:34.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:33:34 smithi086 bash[24289]: audit 2024-09-16T12:33:33.803641+0000 mon.a (mon.0) 1640 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:33:34.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:33:34 smithi047 bash[22744]: audit 2024-09-16T12:33:33.168888+0000 mon.b (mon.2) 1630 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T12:33:34.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:33:34 smithi047 bash[22744]: audit 2024-09-16T12:33:33.798826+0000 mon.a (mon.0) 1639 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:33:34.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:33:34 smithi047 bash[22744]: audit 2024-09-16T12:33:33.803641+0000 mon.a (mon.0) 1640 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:33:35.306 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 12:33:35 smithi047 bash[22994]: debug 2024-09-16T12:33:35.297+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T12:33:35.306 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:33:35 smithi047 bash[22744]: audit 2024-09-16T12:33:33.341137+0000 mgr.a (mgr.14373) 18003 : audit [DBG] from='client.386538 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:33:35.307 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:33:35 smithi047 bash[22744]: cluster 2024-09-16T12:33:33.668865+0000 mgr.a (mgr.14373) 18004 : cluster [DBG] pgmap v12488: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:33:35.307 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:33:35 smithi047 bash[22744]: audit 2024-09-16T12:33:34.524918+0000 mon.b (mon.2) 1631 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T12:33:35.307 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:33:35 smithi047 bash[22744]: audit 2024-09-16T12:33:34.526882+0000 mon.b (mon.2) 1632 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T12:33:35.307 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:33:35 smithi047 bash[22744]: audit 2024-09-16T12:33:34.534558+0000 mon.a (mon.0) 1641 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:33:35.307 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:33:35 smithi047 bash[22744]: audit 2024-09-16T12:33:34.540335+0000 mon.b (mon.2) 1633 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:33:35.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:33:35 smithi157 bash[24585]: audit 2024-09-16T12:33:33.341137+0000 mgr.a (mgr.14373) 18003 : audit [DBG] from='client.386538 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:33:35.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:33:35 smithi157 bash[24585]: cluster 2024-09-16T12:33:33.668865+0000 mgr.a (mgr.14373) 18004 : cluster [DBG] pgmap v12488: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:33:35.308 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:33:35 smithi157 bash[24585]: audit 2024-09-16T12:33:34.524918+0000 mon.b (mon.2) 1631 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T12:33:35.308 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:33:35 smithi157 bash[24585]: audit 2024-09-16T12:33:34.526882+0000 mon.b (mon.2) 1632 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T12:33:35.308 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:33:35 smithi157 bash[24585]: audit 2024-09-16T12:33:34.534558+0000 mon.a (mon.0) 1641 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:33:35.308 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:33:35 smithi157 bash[24585]: audit 2024-09-16T12:33:34.540335+0000 mon.b (mon.2) 1633 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:33:35.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:33:35 smithi086 bash[24289]: audit 2024-09-16T12:33:33.341137+0000 mgr.a (mgr.14373) 18003 : audit [DBG] from='client.386538 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:33:35.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:33:35 smithi086 bash[24289]: cluster 2024-09-16T12:33:33.668865+0000 mgr.a (mgr.14373) 18004 : cluster [DBG] pgmap v12488: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:33:35.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:33:35 smithi086 bash[24289]: audit 2024-09-16T12:33:34.524918+0000 mon.b (mon.2) 1631 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T12:33:35.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:33:35 smithi086 bash[24289]: audit 2024-09-16T12:33:34.526882+0000 mon.b (mon.2) 1632 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T12:33:35.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:33:35 smithi086 bash[24289]: audit 2024-09-16T12:33:34.534558+0000 mon.a (mon.0) 1641 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:33:35.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:33:35 smithi086 bash[24289]: audit 2024-09-16T12:33:34.540335+0000 mon.b (mon.2) 1633 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:33:36.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:33:36 smithi086 bash[24289]: audit 2024-09-16T12:33:34.541462+0000 mgr.a (mgr.14373) 18005 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:33:36.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:33:36 smithi047 bash[22744]: audit 2024-09-16T12:33:34.541462+0000 mgr.a (mgr.14373) 18005 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:33:36.343 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 12:33:35 smithi047 bash[22994]: debug 2024-09-16T12:33:35.301+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T12:33:36.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:33:36 smithi157 bash[24585]: audit 2024-09-16T12:33:34.541462+0000 mgr.a (mgr.14373) 18005 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:33:37.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:33:37 smithi086 bash[24289]: audit 2024-09-16T12:33:35.301854+0000 mgr.a (mgr.14373) 18006 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T12:33:37.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:33:37 smithi086 bash[24289]: cephadm 2024-09-16T12:33:35.304451+0000 mgr.a (mgr.14373) 18007 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T12:33:37.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:33:37 smithi086 bash[24289]: cluster 2024-09-16T12:33:35.669743+0000 mgr.a (mgr.14373) 18008 : cluster [DBG] pgmap v12489: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:33:37.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:33:37 smithi047 bash[22744]: audit 2024-09-16T12:33:35.301854+0000 mgr.a (mgr.14373) 18006 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T12:33:37.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:33:37 smithi047 bash[22744]: cephadm 2024-09-16T12:33:35.304451+0000 mgr.a (mgr.14373) 18007 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T12:33:37.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:33:37 smithi047 bash[22744]: cluster 2024-09-16T12:33:35.669743+0000 mgr.a (mgr.14373) 18008 : cluster [DBG] pgmap v12489: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:33:37.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:33:37 smithi157 bash[24585]: audit 2024-09-16T12:33:35.301854+0000 mgr.a (mgr.14373) 18006 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T12:33:37.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:33:37 smithi157 bash[24585]: cephadm 2024-09-16T12:33:35.304451+0000 mgr.a (mgr.14373) 18007 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T12:33:37.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:33:37 smithi157 bash[24585]: cluster 2024-09-16T12:33:35.669743+0000 mgr.a (mgr.14373) 18008 : cluster [DBG] pgmap v12489: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:33:38.769 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:33:38.770 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:33:38.770 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:33:39.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:33:39 smithi086 bash[24289]: cluster 2024-09-16T12:33:37.672015+0000 mgr.a (mgr.14373) 18009 : cluster [DBG] pgmap v12490: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:33:39.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:33:39 smithi047 bash[22744]: cluster 2024-09-16T12:33:37.672015+0000 mgr.a (mgr.14373) 18009 : cluster [DBG] pgmap v12490: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:33:39.556 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:33:39.556 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:33:39.556 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:33:39.556 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:33:39.557 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:33:39.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:33:39 smithi157 bash[24585]: cluster 2024-09-16T12:33:37.672015+0000 mgr.a (mgr.14373) 18009 : cluster [DBG] pgmap v12490: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:33:40.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:33:40 smithi047 bash[22744]: audit 2024-09-16T12:33:39.111040+0000 mgr.a (mgr.14373) 18010 : audit [DBG] from='client.386724 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:33:40.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:33:40 smithi157 bash[24585]: audit 2024-09-16T12:33:39.111040+0000 mgr.a (mgr.14373) 18010 : audit [DBG] from='client.386724 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:33:40.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:33:40 smithi086 bash[24289]: audit 2024-09-16T12:33:39.111040+0000 mgr.a (mgr.14373) 18010 : audit [DBG] from='client.386724 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:33:41.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:33:41 smithi047 bash[22744]: cluster 2024-09-16T12:33:39.672957+0000 mgr.a (mgr.14373) 18011 : cluster [DBG] pgmap v12491: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:33:41.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:33:41 smithi157 bash[24585]: cluster 2024-09-16T12:33:39.672957+0000 mgr.a (mgr.14373) 18011 : cluster [DBG] pgmap v12491: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:33:41.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:33:41 smithi086 bash[24289]: cluster 2024-09-16T12:33:39.672957+0000 mgr.a (mgr.14373) 18011 : cluster [DBG] pgmap v12491: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:33:43.344 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:33:43 smithi047 bash[22744]: cluster 2024-09-16T12:33:41.675135+0000 mgr.a (mgr.14373) 18012 : cluster [DBG] pgmap v12492: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:33:43.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:33:43 smithi157 bash[24585]: cluster 2024-09-16T12:33:41.675135+0000 mgr.a (mgr.14373) 18012 : cluster [DBG] pgmap v12492: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:33:43.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:33:43 smithi086 bash[24289]: cluster 2024-09-16T12:33:41.675135+0000 mgr.a (mgr.14373) 18012 : cluster [DBG] pgmap v12492: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:33:44.558 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:33:44.559 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:33:44.559 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:33:45.329 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:33:45.329 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:33:45.329 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:33:45.329 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:33:45.329 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:33:45.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:33:45 smithi047 bash[22744]: cluster 2024-09-16T12:33:43.675917+0000 mgr.a (mgr.14373) 18013 : cluster [DBG] pgmap v12493: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:33:45.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:33:45 smithi157 bash[24585]: cluster 2024-09-16T12:33:43.675917+0000 mgr.a (mgr.14373) 18013 : cluster [DBG] pgmap v12493: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:33:45.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:33:45 smithi086 bash[24289]: cluster 2024-09-16T12:33:43.675917+0000 mgr.a (mgr.14373) 18013 : cluster [DBG] pgmap v12493: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:33:46.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:33:46 smithi047 bash[22744]: audit 2024-09-16T12:33:44.891650+0000 mgr.a (mgr.14373) 18014 : audit [DBG] from='client.386799 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:33:46.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:33:46 smithi157 bash[24585]: audit 2024-09-16T12:33:44.891650+0000 mgr.a (mgr.14373) 18014 : audit [DBG] from='client.386799 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:33:46.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:33:46 smithi086 bash[24289]: audit 2024-09-16T12:33:44.891650+0000 mgr.a (mgr.14373) 18014 : audit [DBG] from='client.386799 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:33:47.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:33:47 smithi157 bash[24585]: cluster 2024-09-16T12:33:45.677010+0000 mgr.a (mgr.14373) 18015 : cluster [DBG] pgmap v12494: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:33:47.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:33:47 smithi086 bash[24289]: cluster 2024-09-16T12:33:45.677010+0000 mgr.a (mgr.14373) 18015 : cluster [DBG] pgmap v12494: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:33:47.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:33:47 smithi047 bash[22744]: cluster 2024-09-16T12:33:45.677010+0000 mgr.a (mgr.14373) 18015 : cluster [DBG] pgmap v12494: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:33:49.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:33:49 smithi157 bash[24585]: cluster 2024-09-16T12:33:47.679499+0000 mgr.a (mgr.14373) 18016 : cluster [DBG] pgmap v12495: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:33:49.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:33:49 smithi086 bash[24289]: cluster 2024-09-16T12:33:47.679499+0000 mgr.a (mgr.14373) 18016 : cluster [DBG] pgmap v12495: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:33:49.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:33:49 smithi047 bash[22744]: cluster 2024-09-16T12:33:47.679499+0000 mgr.a (mgr.14373) 18016 : cluster [DBG] pgmap v12495: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:33:50.330 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:33:50.331 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:33:50.331 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:33:51.119 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:33:51.119 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:33:51.119 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:33:51.119 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:33:51.119 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:33:51.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:33:51 smithi157 bash[24585]: cluster 2024-09-16T12:33:49.680473+0000 mgr.a (mgr.14373) 18017 : cluster [DBG] pgmap v12496: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:33:51.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:33:51 smithi086 bash[24289]: cluster 2024-09-16T12:33:49.680473+0000 mgr.a (mgr.14373) 18017 : cluster [DBG] pgmap v12496: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:33:51.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:33:51 smithi047 bash[22744]: cluster 2024-09-16T12:33:49.680473+0000 mgr.a (mgr.14373) 18017 : cluster [DBG] pgmap v12496: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:33:52.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:33:52 smithi157 bash[24585]: audit 2024-09-16T12:33:50.664903+0000 mgr.a (mgr.14373) 18018 : audit [DBG] from='client.386877 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:33:52.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:33:52 smithi086 bash[24289]: audit 2024-09-16T12:33:50.664903+0000 mgr.a (mgr.14373) 18018 : audit [DBG] from='client.386877 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:33:52.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:33:52 smithi047 bash[22744]: audit 2024-09-16T12:33:50.664903+0000 mgr.a (mgr.14373) 18018 : audit [DBG] from='client.386877 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:33:53.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:33:53 smithi157 bash[24585]: cluster 2024-09-16T12:33:51.682830+0000 mgr.a (mgr.14373) 18019 : cluster [DBG] pgmap v12497: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:33:53.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:33:53 smithi086 bash[24289]: cluster 2024-09-16T12:33:51.682830+0000 mgr.a (mgr.14373) 18019 : cluster [DBG] pgmap v12497: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:33:53.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:33:53 smithi047 bash[22744]: cluster 2024-09-16T12:33:51.682830+0000 mgr.a (mgr.14373) 18019 : cluster [DBG] pgmap v12497: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:33:55.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:33:55 smithi157 bash[24585]: cluster 2024-09-16T12:33:53.683619+0000 mgr.a (mgr.14373) 18020 : cluster [DBG] pgmap v12498: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:33:55.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:33:55 smithi086 bash[24289]: cluster 2024-09-16T12:33:53.683619+0000 mgr.a (mgr.14373) 18020 : cluster [DBG] pgmap v12498: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:33:55.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:33:55 smithi047 bash[22744]: cluster 2024-09-16T12:33:53.683619+0000 mgr.a (mgr.14373) 18020 : cluster [DBG] pgmap v12498: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:33:56.120 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:33:56.121 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:33:56.121 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:33:56.876 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:33:56.876 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:33:56.877 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:33:56.877 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:33:56.877 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:33:57.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:33:57 smithi157 bash[24585]: cluster 2024-09-16T12:33:55.684436+0000 mgr.a (mgr.14373) 18021 : cluster [DBG] pgmap v12499: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:33:57.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:33:57 smithi086 bash[24289]: cluster 2024-09-16T12:33:55.684436+0000 mgr.a (mgr.14373) 18021 : cluster [DBG] pgmap v12499: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:33:57.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:33:57 smithi047 bash[22744]: cluster 2024-09-16T12:33:55.684436+0000 mgr.a (mgr.14373) 18021 : cluster [DBG] pgmap v12499: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:33:58.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:33:58 smithi157 bash[24585]: audit 2024-09-16T12:33:56.453865+0000 mgr.a (mgr.14373) 18022 : audit [DBG] from='client.386952 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:33:58.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:33:58 smithi086 bash[24289]: audit 2024-09-16T12:33:56.453865+0000 mgr.a (mgr.14373) 18022 : audit [DBG] from='client.386952 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:33:58.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:33:58 smithi047 bash[22744]: audit 2024-09-16T12:33:56.453865+0000 mgr.a (mgr.14373) 18022 : audit [DBG] from='client.386952 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:33:59.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:33:59 smithi157 bash[24585]: cluster 2024-09-16T12:33:57.687408+0000 mgr.a (mgr.14373) 18023 : cluster [DBG] pgmap v12500: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:33:59.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:33:59 smithi086 bash[24289]: cluster 2024-09-16T12:33:57.687408+0000 mgr.a (mgr.14373) 18023 : cluster [DBG] pgmap v12500: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:33:59.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:33:59 smithi047 bash[22744]: cluster 2024-09-16T12:33:57.687408+0000 mgr.a (mgr.14373) 18023 : cluster [DBG] pgmap v12500: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:34:01.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:34:01 smithi157 bash[24585]: cluster 2024-09-16T12:33:59.688391+0000 mgr.a (mgr.14373) 18024 : cluster [DBG] pgmap v12501: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:34:01.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:34:01 smithi086 bash[24289]: cluster 2024-09-16T12:33:59.688391+0000 mgr.a (mgr.14373) 18024 : cluster [DBG] pgmap v12501: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:34:01.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:34:01 smithi047 bash[22744]: cluster 2024-09-16T12:33:59.688391+0000 mgr.a (mgr.14373) 18024 : cluster [DBG] pgmap v12501: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:34:01.878 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:34:01.879 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:34:01.879 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:34:02.629 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:34:02.629 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:34:02.630 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:34:02.630 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:34:02.630 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:34:03.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:34:03 smithi157 bash[24585]: cluster 2024-09-16T12:34:01.690549+0000 mgr.a (mgr.14373) 18025 : cluster [DBG] pgmap v12502: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:34:03.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:34:03 smithi086 bash[24289]: cluster 2024-09-16T12:34:01.690549+0000 mgr.a (mgr.14373) 18025 : cluster [DBG] pgmap v12502: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:34:03.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:34:03 smithi047 bash[22744]: cluster 2024-09-16T12:34:01.690549+0000 mgr.a (mgr.14373) 18025 : cluster [DBG] pgmap v12502: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:34:04.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:34:04 smithi157 bash[24585]: audit 2024-09-16T12:34:02.207049+0000 mgr.a (mgr.14373) 18026 : audit [DBG] from='client.387024 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:34:04.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:34:04 smithi086 bash[24289]: audit 2024-09-16T12:34:02.207049+0000 mgr.a (mgr.14373) 18026 : audit [DBG] from='client.387024 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:34:04.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:34:04 smithi047 bash[22744]: audit 2024-09-16T12:34:02.207049+0000 mgr.a (mgr.14373) 18026 : audit [DBG] from='client.387024 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:34:05.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:34:05 smithi157 bash[24585]: cluster 2024-09-16T12:34:03.691681+0000 mgr.a (mgr.14373) 18027 : cluster [DBG] pgmap v12503: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:34:05.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:34:05 smithi086 bash[24289]: cluster 2024-09-16T12:34:03.691681+0000 mgr.a (mgr.14373) 18027 : cluster [DBG] pgmap v12503: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:34:05.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:34:05 smithi047 bash[22744]: cluster 2024-09-16T12:34:03.691681+0000 mgr.a (mgr.14373) 18027 : cluster [DBG] pgmap v12503: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:34:07.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:34:07 smithi157 bash[24585]: cluster 2024-09-16T12:34:05.692641+0000 mgr.a (mgr.14373) 18028 : cluster [DBG] pgmap v12504: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:34:07.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:34:07 smithi086 bash[24289]: cluster 2024-09-16T12:34:05.692641+0000 mgr.a (mgr.14373) 18028 : cluster [DBG] pgmap v12504: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:34:07.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:34:07 smithi047 bash[22744]: cluster 2024-09-16T12:34:05.692641+0000 mgr.a (mgr.14373) 18028 : cluster [DBG] pgmap v12504: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:34:07.631 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:34:07.631 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:34:07.632 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:34:08.417 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:34:08.418 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:34:08.418 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:34:08.418 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:34:08.418 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:34:09.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:34:09 smithi157 bash[24585]: cluster 2024-09-16T12:34:07.694843+0000 mgr.a (mgr.14373) 18029 : cluster [DBG] pgmap v12505: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:34:09.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:34:09 smithi157 bash[24585]: audit 2024-09-16T12:34:07.968580+0000 mgr.a (mgr.14373) 18030 : audit [DBG] from='client.387102 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:34:09.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:34:09 smithi086 bash[24289]: cluster 2024-09-16T12:34:07.694843+0000 mgr.a (mgr.14373) 18029 : cluster [DBG] pgmap v12505: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:34:09.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:34:09 smithi086 bash[24289]: audit 2024-09-16T12:34:07.968580+0000 mgr.a (mgr.14373) 18030 : audit [DBG] from='client.387102 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:34:09.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:34:09 smithi047 bash[22744]: cluster 2024-09-16T12:34:07.694843+0000 mgr.a (mgr.14373) 18029 : cluster [DBG] pgmap v12505: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:34:09.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:34:09 smithi047 bash[22744]: audit 2024-09-16T12:34:07.968580+0000 mgr.a (mgr.14373) 18030 : audit [DBG] from='client.387102 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:34:11.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:34:11 smithi157 bash[24585]: cluster 2024-09-16T12:34:09.695789+0000 mgr.a (mgr.14373) 18031 : cluster [DBG] pgmap v12506: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:34:11.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:34:11 smithi086 bash[24289]: cluster 2024-09-16T12:34:09.695789+0000 mgr.a (mgr.14373) 18031 : cluster [DBG] pgmap v12506: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:34:11.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:34:11 smithi047 bash[22744]: cluster 2024-09-16T12:34:09.695789+0000 mgr.a (mgr.14373) 18031 : cluster [DBG] pgmap v12506: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:34:13.419 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:34:13.419 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:34:13.420 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:34:13.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:34:13 smithi157 bash[24585]: cluster 2024-09-16T12:34:11.697923+0000 mgr.a (mgr.14373) 18032 : cluster [DBG] pgmap v12507: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:34:13.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:34:13 smithi086 bash[24289]: cluster 2024-09-16T12:34:11.697923+0000 mgr.a (mgr.14373) 18032 : cluster [DBG] pgmap v12507: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:34:13.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:34:13 smithi047 bash[22744]: cluster 2024-09-16T12:34:11.697923+0000 mgr.a (mgr.14373) 18032 : cluster [DBG] pgmap v12507: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:34:14.205 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:34:14.205 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:34:14.206 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:34:14.206 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:34:14.206 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:34:15.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:34:15 smithi157 bash[24585]: cluster 2024-09-16T12:34:13.698671+0000 mgr.a (mgr.14373) 18033 : cluster [DBG] pgmap v12508: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:34:15.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:34:15 smithi157 bash[24585]: audit 2024-09-16T12:34:13.755372+0000 mgr.a (mgr.14373) 18034 : audit [DBG] from='client.387177 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:34:15.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:34:15 smithi086 bash[24289]: cluster 2024-09-16T12:34:13.698671+0000 mgr.a (mgr.14373) 18033 : cluster [DBG] pgmap v12508: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:34:15.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:34:15 smithi086 bash[24289]: audit 2024-09-16T12:34:13.755372+0000 mgr.a (mgr.14373) 18034 : audit [DBG] from='client.387177 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:34:15.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:34:15 smithi047 bash[22744]: cluster 2024-09-16T12:34:13.698671+0000 mgr.a (mgr.14373) 18033 : cluster [DBG] pgmap v12508: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:34:15.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:34:15 smithi047 bash[22744]: audit 2024-09-16T12:34:13.755372+0000 mgr.a (mgr.14373) 18034 : audit [DBG] from='client.387177 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:34:17.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:34:17 smithi157 bash[24585]: cluster 2024-09-16T12:34:15.699618+0000 mgr.a (mgr.14373) 18035 : cluster [DBG] pgmap v12509: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:34:17.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:34:17 smithi086 bash[24289]: cluster 2024-09-16T12:34:15.699618+0000 mgr.a (mgr.14373) 18035 : cluster [DBG] pgmap v12509: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:34:17.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:34:17 smithi047 bash[22744]: cluster 2024-09-16T12:34:15.699618+0000 mgr.a (mgr.14373) 18035 : cluster [DBG] pgmap v12509: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:34:18.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:34:18 smithi157 bash[24585]: cluster 2024-09-16T12:34:17.701879+0000 mgr.a (mgr.14373) 18036 : cluster [DBG] pgmap v12510: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:34:18.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:34:18 smithi086 bash[24289]: cluster 2024-09-16T12:34:17.701879+0000 mgr.a (mgr.14373) 18036 : cluster [DBG] pgmap v12510: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:34:18.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:34:18 smithi047 bash[22744]: cluster 2024-09-16T12:34:17.701879+0000 mgr.a (mgr.14373) 18036 : cluster [DBG] pgmap v12510: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:34:19.207 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:34:19.208 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:34:19.208 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:34:19.980 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:34:19.980 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:34:19.980 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:34:19.980 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:34:19.980 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:34:21.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:34:20 smithi157 bash[24585]: audit 2024-09-16T12:34:19.534673+0000 mgr.a (mgr.14373) 18037 : audit [DBG] from='client.387255 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:34:21.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:34:20 smithi157 bash[24585]: cluster 2024-09-16T12:34:19.702449+0000 mgr.a (mgr.14373) 18038 : cluster [DBG] pgmap v12511: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:34:21.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:34:20 smithi086 bash[24289]: audit 2024-09-16T12:34:19.534673+0000 mgr.a (mgr.14373) 18037 : audit [DBG] from='client.387255 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:34:21.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:34:20 smithi086 bash[24289]: cluster 2024-09-16T12:34:19.702449+0000 mgr.a (mgr.14373) 18038 : cluster [DBG] pgmap v12511: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:34:21.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:34:20 smithi047 bash[22744]: audit 2024-09-16T12:34:19.534673+0000 mgr.a (mgr.14373) 18037 : audit [DBG] from='client.387255 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:34:21.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:34:20 smithi047 bash[22744]: cluster 2024-09-16T12:34:19.702449+0000 mgr.a (mgr.14373) 18038 : cluster [DBG] pgmap v12511: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:34:23.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:34:22 smithi157 bash[24585]: cluster 2024-09-16T12:34:21.704643+0000 mgr.a (mgr.14373) 18039 : cluster [DBG] pgmap v12512: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:34:23.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:34:22 smithi086 bash[24289]: cluster 2024-09-16T12:34:21.704643+0000 mgr.a (mgr.14373) 18039 : cluster [DBG] pgmap v12512: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:34:23.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:34:22 smithi047 bash[22744]: cluster 2024-09-16T12:34:21.704643+0000 mgr.a (mgr.14373) 18039 : cluster [DBG] pgmap v12512: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:34:24.981 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:34:24.982 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:34:24.982 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:34:25.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:34:24 smithi157 bash[24585]: cluster 2024-09-16T12:34:23.705401+0000 mgr.a (mgr.14373) 18040 : cluster [DBG] pgmap v12513: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:34:25.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:34:24 smithi086 bash[24289]: cluster 2024-09-16T12:34:23.705401+0000 mgr.a (mgr.14373) 18040 : cluster [DBG] pgmap v12513: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:34:25.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:34:24 smithi047 bash[22744]: cluster 2024-09-16T12:34:23.705401+0000 mgr.a (mgr.14373) 18040 : cluster [DBG] pgmap v12513: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:34:25.777 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:34:25.777 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:34:25.777 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:34:25.777 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:34:25.778 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:34:27.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:34:26 smithi157 bash[24585]: audit 2024-09-16T12:34:25.315723+0000 mgr.a (mgr.14373) 18041 : audit [DBG] from='client.387330 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:34:27.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:34:26 smithi157 bash[24585]: cluster 2024-09-16T12:34:25.706320+0000 mgr.a (mgr.14373) 18042 : cluster [DBG] pgmap v12514: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:34:27.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:34:26 smithi086 bash[24289]: audit 2024-09-16T12:34:25.315723+0000 mgr.a (mgr.14373) 18041 : audit [DBG] from='client.387330 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:34:27.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:34:26 smithi086 bash[24289]: cluster 2024-09-16T12:34:25.706320+0000 mgr.a (mgr.14373) 18042 : cluster [DBG] pgmap v12514: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:34:27.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:34:26 smithi047 bash[22744]: audit 2024-09-16T12:34:25.315723+0000 mgr.a (mgr.14373) 18041 : audit [DBG] from='client.387330 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:34:27.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:34:26 smithi047 bash[22744]: cluster 2024-09-16T12:34:25.706320+0000 mgr.a (mgr.14373) 18042 : cluster [DBG] pgmap v12514: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:34:29.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:34:28 smithi157 bash[24585]: cluster 2024-09-16T12:34:27.708632+0000 mgr.a (mgr.14373) 18043 : cluster [DBG] pgmap v12515: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:34:29.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:34:28 smithi086 bash[24289]: cluster 2024-09-16T12:34:27.708632+0000 mgr.a (mgr.14373) 18043 : cluster [DBG] pgmap v12515: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:34:29.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:34:28 smithi047 bash[22744]: cluster 2024-09-16T12:34:27.708632+0000 mgr.a (mgr.14373) 18043 : cluster [DBG] pgmap v12515: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:34:30.779 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:34:30.779 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:34:30.780 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:34:31.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:34:30 smithi157 bash[24585]: cluster 2024-09-16T12:34:29.709403+0000 mgr.a (mgr.14373) 18044 : cluster [DBG] pgmap v12516: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:34:31.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:34:30 smithi086 bash[24289]: cluster 2024-09-16T12:34:29.709403+0000 mgr.a (mgr.14373) 18044 : cluster [DBG] pgmap v12516: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:34:31.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:34:30 smithi047 bash[22744]: cluster 2024-09-16T12:34:29.709403+0000 mgr.a (mgr.14373) 18044 : cluster [DBG] pgmap v12516: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:34:31.534 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:34:31.534 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:34:31.534 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:34:31.534 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:34:31.534 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:34:32.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:34:31 smithi157 bash[24585]: audit 2024-09-16T12:34:31.103034+0000 mgr.a (mgr.14373) 18045 : audit [DBG] from='client.387408 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:34:32.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:34:31 smithi086 bash[24289]: audit 2024-09-16T12:34:31.103034+0000 mgr.a (mgr.14373) 18045 : audit [DBG] from='client.387408 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:34:32.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:34:31 smithi047 bash[22744]: audit 2024-09-16T12:34:31.103034+0000 mgr.a (mgr.14373) 18045 : audit [DBG] from='client.387408 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:34:33.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:34:32 smithi157 bash[24585]: cluster 2024-09-16T12:34:31.711661+0000 mgr.a (mgr.14373) 18046 : cluster [DBG] pgmap v12517: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:34:33.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:34:32 smithi086 bash[24289]: cluster 2024-09-16T12:34:31.711661+0000 mgr.a (mgr.14373) 18046 : cluster [DBG] pgmap v12517: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:34:33.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:34:32 smithi047 bash[22744]: cluster 2024-09-16T12:34:31.711661+0000 mgr.a (mgr.14373) 18046 : cluster [DBG] pgmap v12517: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:34:35.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:34:34 smithi157 bash[24585]: cluster 2024-09-16T12:34:33.712435+0000 mgr.a (mgr.14373) 18047 : cluster [DBG] pgmap v12518: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:34:35.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:34:34 smithi086 bash[24289]: cluster 2024-09-16T12:34:33.712435+0000 mgr.a (mgr.14373) 18047 : cluster [DBG] pgmap v12518: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:34:35.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:34:34 smithi047 bash[22744]: cluster 2024-09-16T12:34:33.712435+0000 mgr.a (mgr.14373) 18047 : cluster [DBG] pgmap v12518: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:34:36.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:34:35 smithi086 bash[24289]: audit 2024-09-16T12:34:35.358654+0000 mon.b (mon.2) 1634 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T12:34:36.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:34:35 smithi047 bash[22744]: audit 2024-09-16T12:34:35.358654+0000 mon.b (mon.2) 1634 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T12:34:36.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:34:35 smithi157 bash[24585]: audit 2024-09-16T12:34:35.358654+0000 mon.b (mon.2) 1634 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T12:34:36.535 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:34:36.536 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:34:36.536 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:34:37.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:34:36 smithi157 bash[24585]: cluster 2024-09-16T12:34:35.713160+0000 mgr.a (mgr.14373) 18048 : cluster [DBG] pgmap v12519: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:34:37.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:34:36 smithi157 bash[24585]: audit 2024-09-16T12:34:35.972001+0000 mon.a (mon.0) 1642 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:34:37.308 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:34:36 smithi157 bash[24585]: audit 2024-09-16T12:34:35.981101+0000 mon.a (mon.0) 1643 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:34:37.308 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:34:36 smithi157 bash[24585]: audit 2024-09-16T12:34:35.987702+0000 mon.a (mon.0) 1644 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:34:37.308 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:34:36 smithi157 bash[24585]: audit 2024-09-16T12:34:35.997400+0000 mon.a (mon.0) 1645 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:34:37.308 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:34:36 smithi157 bash[24585]: audit 2024-09-16T12:34:36.652794+0000 mon.b (mon.2) 1635 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T12:34:37.308 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:34:36 smithi157 bash[24585]: audit 2024-09-16T12:34:36.654035+0000 mon.b (mon.2) 1636 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T12:34:37.308 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:34:36 smithi157 bash[24585]: audit 2024-09-16T12:34:36.660032+0000 mon.a (mon.0) 1646 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:34:37.308 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:34:36 smithi157 bash[24585]: audit 2024-09-16T12:34:36.665674+0000 mon.b (mon.2) 1637 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:34:37.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:34:36 smithi086 bash[24289]: cluster 2024-09-16T12:34:35.713160+0000 mgr.a (mgr.14373) 18048 : cluster [DBG] pgmap v12519: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:34:37.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:34:36 smithi086 bash[24289]: audit 2024-09-16T12:34:35.972001+0000 mon.a (mon.0) 1642 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:34:37.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:34:36 smithi086 bash[24289]: audit 2024-09-16T12:34:35.981101+0000 mon.a (mon.0) 1643 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:34:37.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:34:36 smithi086 bash[24289]: audit 2024-09-16T12:34:35.987702+0000 mon.a (mon.0) 1644 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:34:37.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:34:36 smithi086 bash[24289]: audit 2024-09-16T12:34:35.997400+0000 mon.a (mon.0) 1645 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:34:37.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:34:36 smithi086 bash[24289]: audit 2024-09-16T12:34:36.652794+0000 mon.b (mon.2) 1635 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T12:34:37.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:34:36 smithi086 bash[24289]: audit 2024-09-16T12:34:36.654035+0000 mon.b (mon.2) 1636 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T12:34:37.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:34:36 smithi086 bash[24289]: audit 2024-09-16T12:34:36.660032+0000 mon.a (mon.0) 1646 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:34:37.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:34:36 smithi086 bash[24289]: audit 2024-09-16T12:34:36.665674+0000 mon.b (mon.2) 1637 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:34:37.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:34:36 smithi047 bash[22744]: cluster 2024-09-16T12:34:35.713160+0000 mgr.a (mgr.14373) 18048 : cluster [DBG] pgmap v12519: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:34:37.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:34:36 smithi047 bash[22744]: audit 2024-09-16T12:34:35.972001+0000 mon.a (mon.0) 1642 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:34:37.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:34:36 smithi047 bash[22744]: audit 2024-09-16T12:34:35.981101+0000 mon.a (mon.0) 1643 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:34:37.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:34:36 smithi047 bash[22744]: audit 2024-09-16T12:34:35.987702+0000 mon.a (mon.0) 1644 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:34:37.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:34:36 smithi047 bash[22744]: audit 2024-09-16T12:34:35.997400+0000 mon.a (mon.0) 1645 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:34:37.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:34:36 smithi047 bash[22744]: audit 2024-09-16T12:34:36.652794+0000 mon.b (mon.2) 1635 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T12:34:37.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:34:36 smithi047 bash[22744]: audit 2024-09-16T12:34:36.654035+0000 mon.b (mon.2) 1636 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T12:34:37.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:34:36 smithi047 bash[22744]: audit 2024-09-16T12:34:36.660032+0000 mon.a (mon.0) 1646 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:34:37.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:34:36 smithi047 bash[22744]: audit 2024-09-16T12:34:36.665674+0000 mon.b (mon.2) 1637 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:34:37.829 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:34:37.829 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:34:37.829 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:34:37.829 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:34:37.829 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:34:37.842 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 12:34:37 smithi047 bash[22994]: debug 2024-09-16T12:34:37.404+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T12:34:37.843 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 12:34:37 smithi047 bash[22994]: debug 2024-09-16T12:34:37.420+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T12:34:38.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:34:37 smithi157 bash[24585]: audit 2024-09-16T12:34:36.666889+0000 mgr.a (mgr.14373) 18049 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:34:38.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:34:37 smithi157 bash[24585]: audit 2024-09-16T12:34:36.886766+0000 mgr.a (mgr.14373) 18050 : audit [DBG] from='client.387486 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:34:38.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:34:37 smithi086 bash[24289]: audit 2024-09-16T12:34:36.666889+0000 mgr.a (mgr.14373) 18049 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:34:38.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:34:37 smithi086 bash[24289]: audit 2024-09-16T12:34:36.886766+0000 mgr.a (mgr.14373) 18050 : audit [DBG] from='client.387486 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:34:38.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:34:37 smithi047 bash[22744]: audit 2024-09-16T12:34:36.666889+0000 mgr.a (mgr.14373) 18049 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:34:38.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:34:37 smithi047 bash[22744]: audit 2024-09-16T12:34:36.886766+0000 mgr.a (mgr.14373) 18050 : audit [DBG] from='client.387486 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:34:39.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:34:38 smithi157 bash[24585]: audit 2024-09-16T12:34:37.409926+0000 mgr.a (mgr.14373) 18051 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T12:34:39.308 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:34:38 smithi157 bash[24585]: cephadm 2024-09-16T12:34:37.423015+0000 mgr.a (mgr.14373) 18052 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T12:34:39.308 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:34:38 smithi157 bash[24585]: cluster 2024-09-16T12:34:37.714368+0000 mgr.a (mgr.14373) 18053 : cluster [DBG] pgmap v12520: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:34:39.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:34:38 smithi086 bash[24289]: audit 2024-09-16T12:34:37.409926+0000 mgr.a (mgr.14373) 18051 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T12:34:39.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:34:38 smithi086 bash[24289]: cephadm 2024-09-16T12:34:37.423015+0000 mgr.a (mgr.14373) 18052 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T12:34:39.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:34:38 smithi086 bash[24289]: cluster 2024-09-16T12:34:37.714368+0000 mgr.a (mgr.14373) 18053 : cluster [DBG] pgmap v12520: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:34:39.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:34:38 smithi047 bash[22744]: audit 2024-09-16T12:34:37.409926+0000 mgr.a (mgr.14373) 18051 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T12:34:39.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:34:38 smithi047 bash[22744]: cephadm 2024-09-16T12:34:37.423015+0000 mgr.a (mgr.14373) 18052 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T12:34:39.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:34:38 smithi047 bash[22744]: cluster 2024-09-16T12:34:37.714368+0000 mgr.a (mgr.14373) 18053 : cluster [DBG] pgmap v12520: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:34:41.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:34:40 smithi157 bash[24585]: cluster 2024-09-16T12:34:39.715228+0000 mgr.a (mgr.14373) 18054 : cluster [DBG] pgmap v12521: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T12:34:41.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:34:40 smithi086 bash[24289]: cluster 2024-09-16T12:34:39.715228+0000 mgr.a (mgr.14373) 18054 : cluster [DBG] pgmap v12521: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T12:34:41.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:34:40 smithi047 bash[22744]: cluster 2024-09-16T12:34:39.715228+0000 mgr.a (mgr.14373) 18054 : cluster [DBG] pgmap v12521: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T12:34:42.830 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:34:42.831 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:34:42.831 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:34:43.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:34:42 smithi157 bash[24585]: cluster 2024-09-16T12:34:41.717363+0000 mgr.a (mgr.14373) 18055 : cluster [DBG] pgmap v12522: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:34:43.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:34:42 smithi086 bash[24289]: cluster 2024-09-16T12:34:41.717363+0000 mgr.a (mgr.14373) 18055 : cluster [DBG] pgmap v12522: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:34:43.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:34:42 smithi047 bash[22744]: cluster 2024-09-16T12:34:41.717363+0000 mgr.a (mgr.14373) 18055 : cluster [DBG] pgmap v12522: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:34:43.610 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:34:43.610 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:34:43.610 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:34:43.611 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:34:43.611 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:34:44.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:34:43 smithi157 bash[24585]: audit 2024-09-16T12:34:43.169382+0000 mgr.a (mgr.14373) 18056 : audit [DBG] from='client.387666 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:34:44.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:34:43 smithi086 bash[24289]: audit 2024-09-16T12:34:43.169382+0000 mgr.a (mgr.14373) 18056 : audit [DBG] from='client.387666 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:34:44.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:34:43 smithi047 bash[22744]: audit 2024-09-16T12:34:43.169382+0000 mgr.a (mgr.14373) 18056 : audit [DBG] from='client.387666 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:34:45.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:34:45 smithi157 bash[24585]: cluster 2024-09-16T12:34:43.718304+0000 mgr.a (mgr.14373) 18057 : cluster [DBG] pgmap v12523: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T12:34:45.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:34:45 smithi086 bash[24289]: cluster 2024-09-16T12:34:43.718304+0000 mgr.a (mgr.14373) 18057 : cluster [DBG] pgmap v12523: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T12:34:45.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:34:44 smithi047 bash[22744]: cluster 2024-09-16T12:34:43.718304+0000 mgr.a (mgr.14373) 18057 : cluster [DBG] pgmap v12523: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T12:34:47.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:34:47 smithi157 bash[24585]: cluster 2024-09-16T12:34:45.719063+0000 mgr.a (mgr.14373) 18058 : cluster [DBG] pgmap v12524: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T12:34:47.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:34:47 smithi086 bash[24289]: cluster 2024-09-16T12:34:45.719063+0000 mgr.a (mgr.14373) 18058 : cluster [DBG] pgmap v12524: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T12:34:47.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:34:47 smithi047 bash[22744]: cluster 2024-09-16T12:34:45.719063+0000 mgr.a (mgr.14373) 18058 : cluster [DBG] pgmap v12524: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T12:34:48.612 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:34:48.613 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:34:48.613 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:34:49.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:34:49 smithi157 bash[24585]: cluster 2024-09-16T12:34:47.721303+0000 mgr.a (mgr.14373) 18059 : cluster [DBG] pgmap v12525: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:34:49.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:34:49 smithi086 bash[24289]: cluster 2024-09-16T12:34:47.721303+0000 mgr.a (mgr.14373) 18059 : cluster [DBG] pgmap v12525: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:34:49.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:34:49 smithi047 bash[22744]: cluster 2024-09-16T12:34:47.721303+0000 mgr.a (mgr.14373) 18059 : cluster [DBG] pgmap v12525: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:34:49.383 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:34:49.384 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:34:49.384 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:34:49.384 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:34:49.384 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:34:50.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:34:50 smithi157 bash[24585]: audit 2024-09-16T12:34:48.945564+0000 mgr.a (mgr.14373) 18060 : audit [DBG] from='client.387738 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:34:50.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:34:50 smithi086 bash[24289]: audit 2024-09-16T12:34:48.945564+0000 mgr.a (mgr.14373) 18060 : audit [DBG] from='client.387738 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:34:50.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:34:50 smithi047 bash[22744]: audit 2024-09-16T12:34:48.945564+0000 mgr.a (mgr.14373) 18060 : audit [DBG] from='client.387738 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:34:51.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:34:51 smithi157 bash[24585]: cluster 2024-09-16T12:34:49.722278+0000 mgr.a (mgr.14373) 18061 : cluster [DBG] pgmap v12526: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:34:51.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:34:51 smithi086 bash[24289]: cluster 2024-09-16T12:34:49.722278+0000 mgr.a (mgr.14373) 18061 : cluster [DBG] pgmap v12526: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:34:51.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:34:51 smithi047 bash[22744]: cluster 2024-09-16T12:34:49.722278+0000 mgr.a (mgr.14373) 18061 : cluster [DBG] pgmap v12526: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:34:53.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:34:53 smithi157 bash[24585]: cluster 2024-09-16T12:34:51.724442+0000 mgr.a (mgr.14373) 18062 : cluster [DBG] pgmap v12527: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:34:53.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:34:53 smithi086 bash[24289]: cluster 2024-09-16T12:34:51.724442+0000 mgr.a (mgr.14373) 18062 : cluster [DBG] pgmap v12527: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:34:53.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:34:53 smithi047 bash[22744]: cluster 2024-09-16T12:34:51.724442+0000 mgr.a (mgr.14373) 18062 : cluster [DBG] pgmap v12527: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:34:54.385 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:34:54.386 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:34:54.386 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:34:55.165 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:34:55.165 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:34:55.165 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:34:55.165 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:34:55.165 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:34:55.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:34:55 smithi157 bash[24585]: cluster 2024-09-16T12:34:53.725209+0000 mgr.a (mgr.14373) 18063 : cluster [DBG] pgmap v12528: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:34:55.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:34:55 smithi086 bash[24289]: cluster 2024-09-16T12:34:53.725209+0000 mgr.a (mgr.14373) 18063 : cluster [DBG] pgmap v12528: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:34:55.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:34:55 smithi047 bash[22744]: cluster 2024-09-16T12:34:53.725209+0000 mgr.a (mgr.14373) 18063 : cluster [DBG] pgmap v12528: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:34:56.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:34:56 smithi157 bash[24585]: audit 2024-09-16T12:34:54.713735+0000 mgr.a (mgr.14373) 18064 : audit [DBG] from='client.387816 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:34:56.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:34:56 smithi086 bash[24289]: audit 2024-09-16T12:34:54.713735+0000 mgr.a (mgr.14373) 18064 : audit [DBG] from='client.387816 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:34:56.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:34:56 smithi047 bash[22744]: audit 2024-09-16T12:34:54.713735+0000 mgr.a (mgr.14373) 18064 : audit [DBG] from='client.387816 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:34:57.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:34:57 smithi157 bash[24585]: cluster 2024-09-16T12:34:55.726089+0000 mgr.a (mgr.14373) 18065 : cluster [DBG] pgmap v12529: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:34:57.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:34:57 smithi086 bash[24289]: cluster 2024-09-16T12:34:55.726089+0000 mgr.a (mgr.14373) 18065 : cluster [DBG] pgmap v12529: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:34:57.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:34:57 smithi047 bash[22744]: cluster 2024-09-16T12:34:55.726089+0000 mgr.a (mgr.14373) 18065 : cluster [DBG] pgmap v12529: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:34:58.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:34:58 smithi157 bash[24585]: cluster 2024-09-16T12:34:57.728406+0000 mgr.a (mgr.14373) 18066 : cluster [DBG] pgmap v12530: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:34:58.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:34:58 smithi086 bash[24289]: cluster 2024-09-16T12:34:57.728406+0000 mgr.a (mgr.14373) 18066 : cluster [DBG] pgmap v12530: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:34:58.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:34:58 smithi047 bash[22744]: cluster 2024-09-16T12:34:57.728406+0000 mgr.a (mgr.14373) 18066 : cluster [DBG] pgmap v12530: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:35:00.167 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:35:00.167 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:35:00.167 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:35:00.907 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:35:00.908 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:35:00.908 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:35:00.908 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:35:00.908 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:35:01.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:35:00 smithi157 bash[24585]: cluster 2024-09-16T12:34:59.729170+0000 mgr.a (mgr.14373) 18067 : cluster [DBG] pgmap v12531: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:35:01.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:35:00 smithi086 bash[24289]: cluster 2024-09-16T12:34:59.729170+0000 mgr.a (mgr.14373) 18067 : cluster [DBG] pgmap v12531: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:35:01.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:35:00 smithi047 bash[22744]: cluster 2024-09-16T12:34:59.729170+0000 mgr.a (mgr.14373) 18067 : cluster [DBG] pgmap v12531: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:35:02.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:35:01 smithi157 bash[24585]: audit 2024-09-16T12:35:00.489360+0000 mgr.a (mgr.14373) 18068 : audit [DBG] from='client.387891 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:35:02.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:35:01 smithi086 bash[24289]: audit 2024-09-16T12:35:00.489360+0000 mgr.a (mgr.14373) 18068 : audit [DBG] from='client.387891 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:35:02.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:35:01 smithi047 bash[22744]: audit 2024-09-16T12:35:00.489360+0000 mgr.a (mgr.14373) 18068 : audit [DBG] from='client.387891 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:35:03.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:35:02 smithi157 bash[24585]: cluster 2024-09-16T12:35:01.731564+0000 mgr.a (mgr.14373) 18069 : cluster [DBG] pgmap v12532: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:35:03.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:35:02 smithi086 bash[24289]: cluster 2024-09-16T12:35:01.731564+0000 mgr.a (mgr.14373) 18069 : cluster [DBG] pgmap v12532: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:35:03.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:35:02 smithi047 bash[22744]: cluster 2024-09-16T12:35:01.731564+0000 mgr.a (mgr.14373) 18069 : cluster [DBG] pgmap v12532: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:35:05.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:35:04 smithi157 bash[24585]: cluster 2024-09-16T12:35:03.732346+0000 mgr.a (mgr.14373) 18070 : cluster [DBG] pgmap v12533: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:35:05.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:35:04 smithi086 bash[24289]: cluster 2024-09-16T12:35:03.732346+0000 mgr.a (mgr.14373) 18070 : cluster [DBG] pgmap v12533: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:35:05.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:35:04 smithi047 bash[22744]: cluster 2024-09-16T12:35:03.732346+0000 mgr.a (mgr.14373) 18070 : cluster [DBG] pgmap v12533: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:35:05.909 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:35:05.910 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:35:05.910 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:35:06.693 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:35:06.693 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:35:06.693 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:35:06.693 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:35:06.693 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:35:07.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:35:06 smithi086 bash[24289]: cluster 2024-09-16T12:35:05.733119+0000 mgr.a (mgr.14373) 18071 : cluster [DBG] pgmap v12534: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:35:07.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:35:06 smithi047 bash[22744]: cluster 2024-09-16T12:35:05.733119+0000 mgr.a (mgr.14373) 18071 : cluster [DBG] pgmap v12534: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:35:07.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:35:06 smithi157 bash[24585]: cluster 2024-09-16T12:35:05.733119+0000 mgr.a (mgr.14373) 18071 : cluster [DBG] pgmap v12534: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:35:08.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:35:07 smithi086 bash[24289]: audit 2024-09-16T12:35:06.243095+0000 mgr.a (mgr.14373) 18072 : audit [DBG] from='client.387966 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:35:08.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:35:07 smithi047 bash[22744]: audit 2024-09-16T12:35:06.243095+0000 mgr.a (mgr.14373) 18072 : audit [DBG] from='client.387966 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:35:08.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:35:07 smithi157 bash[24585]: audit 2024-09-16T12:35:06.243095+0000 mgr.a (mgr.14373) 18072 : audit [DBG] from='client.387966 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:35:09.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:35:08 smithi086 bash[24289]: cluster 2024-09-16T12:35:07.735881+0000 mgr.a (mgr.14373) 18073 : cluster [DBG] pgmap v12535: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-16T12:35:09.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:35:08 smithi047 bash[22744]: cluster 2024-09-16T12:35:07.735881+0000 mgr.a (mgr.14373) 18073 : cluster [DBG] pgmap v12535: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-16T12:35:09.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:35:08 smithi157 bash[24585]: cluster 2024-09-16T12:35:07.735881+0000 mgr.a (mgr.14373) 18073 : cluster [DBG] pgmap v12535: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-16T12:35:11.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:35:10 smithi047 bash[22744]: cluster 2024-09-16T12:35:09.736644+0000 mgr.a (mgr.14373) 18074 : cluster [DBG] pgmap v12536: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T12:35:11.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:35:10 smithi157 bash[24585]: cluster 2024-09-16T12:35:09.736644+0000 mgr.a (mgr.14373) 18074 : cluster [DBG] pgmap v12536: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T12:35:11.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:35:10 smithi086 bash[24289]: cluster 2024-09-16T12:35:09.736644+0000 mgr.a (mgr.14373) 18074 : cluster [DBG] pgmap v12536: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T12:35:11.694 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:35:11.695 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:35:11.696 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:35:12.481 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:35:12.482 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:35:12.482 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:35:12.482 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:35:12.482 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:35:13.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:35:12 smithi047 bash[22744]: cluster 2024-09-16T12:35:11.738684+0000 mgr.a (mgr.14373) 18075 : cluster [DBG] pgmap v12537: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:35:13.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:35:12 smithi047 bash[22744]: audit 2024-09-16T12:35:12.029053+0000 mgr.a (mgr.14373) 18076 : audit [DBG] from='client.388044 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:35:13.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:35:12 smithi157 bash[24585]: cluster 2024-09-16T12:35:11.738684+0000 mgr.a (mgr.14373) 18075 : cluster [DBG] pgmap v12537: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:35:13.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:35:12 smithi157 bash[24585]: audit 2024-09-16T12:35:12.029053+0000 mgr.a (mgr.14373) 18076 : audit [DBG] from='client.388044 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:35:13.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:35:12 smithi086 bash[24289]: cluster 2024-09-16T12:35:11.738684+0000 mgr.a (mgr.14373) 18075 : cluster [DBG] pgmap v12537: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:35:13.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:35:12 smithi086 bash[24289]: audit 2024-09-16T12:35:12.029053+0000 mgr.a (mgr.14373) 18076 : audit [DBG] from='client.388044 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:35:15.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:35:14 smithi047 bash[22744]: cluster 2024-09-16T12:35:13.739601+0000 mgr.a (mgr.14373) 18077 : cluster [DBG] pgmap v12538: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:35:15.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:35:14 smithi157 bash[24585]: cluster 2024-09-16T12:35:13.739601+0000 mgr.a (mgr.14373) 18077 : cluster [DBG] pgmap v12538: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:35:15.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:35:14 smithi086 bash[24289]: cluster 2024-09-16T12:35:13.739601+0000 mgr.a (mgr.14373) 18077 : cluster [DBG] pgmap v12538: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:35:17.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:35:16 smithi047 bash[22744]: cluster 2024-09-16T12:35:15.740377+0000 mgr.a (mgr.14373) 18078 : cluster [DBG] pgmap v12539: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T12:35:17.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:35:16 smithi157 bash[24585]: cluster 2024-09-16T12:35:15.740377+0000 mgr.a (mgr.14373) 18078 : cluster [DBG] pgmap v12539: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T12:35:17.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:35:16 smithi086 bash[24289]: cluster 2024-09-16T12:35:15.740377+0000 mgr.a (mgr.14373) 18078 : cluster [DBG] pgmap v12539: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T12:35:17.483 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:35:17.484 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:35:17.484 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:35:18.250 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:35:18.251 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:35:18.251 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:35:18.251 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:35:18.251 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:35:19.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:35:18 smithi047 bash[22744]: cluster 2024-09-16T12:35:17.742710+0000 mgr.a (mgr.14373) 18079 : cluster [DBG] pgmap v12540: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:35:19.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:35:18 smithi047 bash[22744]: audit 2024-09-16T12:35:17.816937+0000 mgr.a (mgr.14373) 18080 : audit [DBG] from='client.388122 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:35:19.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:35:18 smithi157 bash[24585]: cluster 2024-09-16T12:35:17.742710+0000 mgr.a (mgr.14373) 18079 : cluster [DBG] pgmap v12540: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:35:19.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:35:18 smithi157 bash[24585]: audit 2024-09-16T12:35:17.816937+0000 mgr.a (mgr.14373) 18080 : audit [DBG] from='client.388122 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:35:19.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:35:18 smithi086 bash[24289]: cluster 2024-09-16T12:35:17.742710+0000 mgr.a (mgr.14373) 18079 : cluster [DBG] pgmap v12540: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:35:19.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:35:18 smithi086 bash[24289]: audit 2024-09-16T12:35:17.816937+0000 mgr.a (mgr.14373) 18080 : audit [DBG] from='client.388122 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:35:21.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:35:20 smithi157 bash[24585]: cluster 2024-09-16T12:35:19.743773+0000 mgr.a (mgr.14373) 18081 : cluster [DBG] pgmap v12541: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-16T12:35:21.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:35:20 smithi086 bash[24289]: cluster 2024-09-16T12:35:19.743773+0000 mgr.a (mgr.14373) 18081 : cluster [DBG] pgmap v12541: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-16T12:35:21.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:35:20 smithi047 bash[22744]: cluster 2024-09-16T12:35:19.743773+0000 mgr.a (mgr.14373) 18081 : cluster [DBG] pgmap v12541: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-16T12:35:23.252 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:35:23.253 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:35:23.253 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:35:23.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:35:22 smithi157 bash[24585]: cluster 2024-09-16T12:35:21.746107+0000 mgr.a (mgr.14373) 18082 : cluster [DBG] pgmap v12542: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-16T12:35:23.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:35:22 smithi086 bash[24289]: cluster 2024-09-16T12:35:21.746107+0000 mgr.a (mgr.14373) 18082 : cluster [DBG] pgmap v12542: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-16T12:35:23.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:35:22 smithi047 bash[22744]: cluster 2024-09-16T12:35:21.746107+0000 mgr.a (mgr.14373) 18082 : cluster [DBG] pgmap v12542: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-16T12:35:24.027 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:35:24.027 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:35:24.027 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:35:24.028 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:35:24.028 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:35:25.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:35:24 smithi157 bash[24585]: audit 2024-09-16T12:35:23.586675+0000 mgr.a (mgr.14373) 18083 : audit [DBG] from='client.388197 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:35:25.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:35:24 smithi157 bash[24585]: cluster 2024-09-16T12:35:23.746828+0000 mgr.a (mgr.14373) 18084 : cluster [DBG] pgmap v12543: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:35:25.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:35:24 smithi086 bash[24289]: audit 2024-09-16T12:35:23.586675+0000 mgr.a (mgr.14373) 18083 : audit [DBG] from='client.388197 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:35:25.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:35:24 smithi086 bash[24289]: cluster 2024-09-16T12:35:23.746828+0000 mgr.a (mgr.14373) 18084 : cluster [DBG] pgmap v12543: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:35:25.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:35:24 smithi047 bash[22744]: audit 2024-09-16T12:35:23.586675+0000 mgr.a (mgr.14373) 18083 : audit [DBG] from='client.388197 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:35:25.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:35:24 smithi047 bash[22744]: cluster 2024-09-16T12:35:23.746828+0000 mgr.a (mgr.14373) 18084 : cluster [DBG] pgmap v12543: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:35:27.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:35:26 smithi157 bash[24585]: cluster 2024-09-16T12:35:25.747668+0000 mgr.a (mgr.14373) 18085 : cluster [DBG] pgmap v12544: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:35:27.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:35:26 smithi086 bash[24289]: cluster 2024-09-16T12:35:25.747668+0000 mgr.a (mgr.14373) 18085 : cluster [DBG] pgmap v12544: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:35:27.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:35:26 smithi047 bash[22744]: cluster 2024-09-16T12:35:25.747668+0000 mgr.a (mgr.14373) 18085 : cluster [DBG] pgmap v12544: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:35:29.029 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:35:29.030 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:35:29.030 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:35:29.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:35:28 smithi157 bash[24585]: cluster 2024-09-16T12:35:27.749918+0000 mgr.a (mgr.14373) 18086 : cluster [DBG] pgmap v12545: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:35:29.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:35:28 smithi086 bash[24289]: cluster 2024-09-16T12:35:27.749918+0000 mgr.a (mgr.14373) 18086 : cluster [DBG] pgmap v12545: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:35:29.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:35:28 smithi047 bash[22744]: cluster 2024-09-16T12:35:27.749918+0000 mgr.a (mgr.14373) 18086 : cluster [DBG] pgmap v12545: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:35:29.791 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:35:29.791 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:35:29.792 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:35:29.792 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:35:29.792 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:35:31.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:35:30 smithi157 bash[24585]: audit 2024-09-16T12:35:29.362230+0000 mgr.a (mgr.14373) 18087 : audit [DBG] from='client.388275 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:35:31.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:35:30 smithi157 bash[24585]: cluster 2024-09-16T12:35:29.750480+0000 mgr.a (mgr.14373) 18088 : cluster [DBG] pgmap v12546: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:35:31.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:35:30 smithi086 bash[24289]: audit 2024-09-16T12:35:29.362230+0000 mgr.a (mgr.14373) 18087 : audit [DBG] from='client.388275 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:35:31.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:35:30 smithi086 bash[24289]: cluster 2024-09-16T12:35:29.750480+0000 mgr.a (mgr.14373) 18088 : cluster [DBG] pgmap v12546: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:35:31.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:35:30 smithi047 bash[22744]: audit 2024-09-16T12:35:29.362230+0000 mgr.a (mgr.14373) 18087 : audit [DBG] from='client.388275 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:35:31.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:35:30 smithi047 bash[22744]: cluster 2024-09-16T12:35:29.750480+0000 mgr.a (mgr.14373) 18088 : cluster [DBG] pgmap v12546: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:35:33.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:35:32 smithi157 bash[24585]: cluster 2024-09-16T12:35:31.752744+0000 mgr.a (mgr.14373) 18089 : cluster [DBG] pgmap v12547: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:35:33.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:35:32 smithi086 bash[24289]: cluster 2024-09-16T12:35:31.752744+0000 mgr.a (mgr.14373) 18089 : cluster [DBG] pgmap v12547: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:35:33.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:35:32 smithi047 bash[22744]: cluster 2024-09-16T12:35:31.752744+0000 mgr.a (mgr.14373) 18089 : cluster [DBG] pgmap v12547: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:35:34.793 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:35:34.793 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:35:34.794 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:35:35.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:35:34 smithi157 bash[24585]: cluster 2024-09-16T12:35:33.753695+0000 mgr.a (mgr.14373) 18090 : cluster [DBG] pgmap v12548: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:35:35.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:35:34 smithi086 bash[24289]: cluster 2024-09-16T12:35:33.753695+0000 mgr.a (mgr.14373) 18090 : cluster [DBG] pgmap v12548: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:35:35.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:35:34 smithi047 bash[22744]: cluster 2024-09-16T12:35:33.753695+0000 mgr.a (mgr.14373) 18090 : cluster [DBG] pgmap v12548: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:35:35.581 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:35:35.581 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:35:35.581 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:35:35.582 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:35:35.582 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:35:36.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:35:35 smithi157 bash[24585]: audit 2024-09-16T12:35:35.134883+0000 mgr.a (mgr.14373) 18091 : audit [DBG] from='client.388347 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:35:36.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:35:35 smithi086 bash[24289]: audit 2024-09-16T12:35:35.134883+0000 mgr.a (mgr.14373) 18091 : audit [DBG] from='client.388347 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:35:36.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:35:35 smithi047 bash[22744]: audit 2024-09-16T12:35:35.134883+0000 mgr.a (mgr.14373) 18091 : audit [DBG] from='client.388347 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:35:37.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:35:36 smithi157 bash[24585]: cluster 2024-09-16T12:35:35.754693+0000 mgr.a (mgr.14373) 18092 : cluster [DBG] pgmap v12549: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:35:37.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:35:36 smithi086 bash[24289]: cluster 2024-09-16T12:35:35.754693+0000 mgr.a (mgr.14373) 18092 : cluster [DBG] pgmap v12549: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:35:37.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:35:36 smithi047 bash[22744]: cluster 2024-09-16T12:35:35.754693+0000 mgr.a (mgr.14373) 18092 : cluster [DBG] pgmap v12549: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:35:38.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:35:37 smithi157 bash[24585]: audit 2024-09-16T12:35:37.484608+0000 mon.b (mon.2) 1638 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T12:35:38.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:35:37 smithi086 bash[24289]: audit 2024-09-16T12:35:37.484608+0000 mon.b (mon.2) 1638 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T12:35:38.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:35:37 smithi047 bash[22744]: audit 2024-09-16T12:35:37.484608+0000 mon.b (mon.2) 1638 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T12:35:39.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:35:38 smithi157 bash[24585]: cluster 2024-09-16T12:35:37.756903+0000 mgr.a (mgr.14373) 18093 : cluster [DBG] pgmap v12550: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:35:39.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:35:38 smithi157 bash[24585]: audit 2024-09-16T12:35:38.336117+0000 mon.b (mon.2) 1639 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T12:35:39.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:35:38 smithi157 bash[24585]: audit 2024-09-16T12:35:38.338277+0000 mon.b (mon.2) 1640 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T12:35:39.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:35:38 smithi157 bash[24585]: audit 2024-09-16T12:35:38.349961+0000 mon.a (mon.0) 1647 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:35:39.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:35:38 smithi157 bash[24585]: audit 2024-09-16T12:35:38.355778+0000 mon.b (mon.2) 1641 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:35:39.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:35:38 smithi086 bash[24289]: cluster 2024-09-16T12:35:37.756903+0000 mgr.a (mgr.14373) 18093 : cluster [DBG] pgmap v12550: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:35:39.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:35:38 smithi086 bash[24289]: audit 2024-09-16T12:35:38.336117+0000 mon.b (mon.2) 1639 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T12:35:39.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:35:38 smithi086 bash[24289]: audit 2024-09-16T12:35:38.338277+0000 mon.b (mon.2) 1640 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T12:35:39.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:35:38 smithi086 bash[24289]: audit 2024-09-16T12:35:38.349961+0000 mon.a (mon.0) 1647 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:35:39.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:35:38 smithi086 bash[24289]: audit 2024-09-16T12:35:38.355778+0000 mon.b (mon.2) 1641 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:35:39.343 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 12:35:39 smithi047 bash[22994]: debug 2024-09-16T12:35:39.099+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T12:35:39.343 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 12:35:39 smithi047 bash[22994]: debug 2024-09-16T12:35:39.103+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T12:35:39.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:35:38 smithi047 bash[22744]: cluster 2024-09-16T12:35:37.756903+0000 mgr.a (mgr.14373) 18093 : cluster [DBG] pgmap v12550: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:35:39.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:35:38 smithi047 bash[22744]: audit 2024-09-16T12:35:38.336117+0000 mon.b (mon.2) 1639 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T12:35:39.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:35:38 smithi047 bash[22744]: audit 2024-09-16T12:35:38.338277+0000 mon.b (mon.2) 1640 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T12:35:39.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:35:38 smithi047 bash[22744]: audit 2024-09-16T12:35:38.349961+0000 mon.a (mon.0) 1647 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:35:39.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:35:38 smithi047 bash[22744]: audit 2024-09-16T12:35:38.355778+0000 mon.b (mon.2) 1641 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:35:40.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:35:39 smithi157 bash[24585]: audit 2024-09-16T12:35:38.357487+0000 mgr.a (mgr.14373) 18094 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:35:40.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:35:39 smithi157 bash[24585]: audit 2024-09-16T12:35:39.104678+0000 mgr.a (mgr.14373) 18095 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T12:35:40.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:35:39 smithi157 bash[24585]: cephadm 2024-09-16T12:35:39.106941+0000 mgr.a (mgr.14373) 18096 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T12:35:40.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:35:39 smithi086 bash[24289]: audit 2024-09-16T12:35:38.357487+0000 mgr.a (mgr.14373) 18094 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:35:40.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:35:39 smithi086 bash[24289]: audit 2024-09-16T12:35:39.104678+0000 mgr.a (mgr.14373) 18095 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T12:35:40.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:35:39 smithi086 bash[24289]: cephadm 2024-09-16T12:35:39.106941+0000 mgr.a (mgr.14373) 18096 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T12:35:40.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:35:39 smithi047 bash[22744]: audit 2024-09-16T12:35:38.357487+0000 mgr.a (mgr.14373) 18094 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:35:40.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:35:39 smithi047 bash[22744]: audit 2024-09-16T12:35:39.104678+0000 mgr.a (mgr.14373) 18095 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T12:35:40.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:35:39 smithi047 bash[22744]: cephadm 2024-09-16T12:35:39.106941+0000 mgr.a (mgr.14373) 18096 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T12:35:40.582 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:35:40.583 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:35:40.584 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:35:41.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:35:40 smithi157 bash[24585]: cluster 2024-09-16T12:35:39.757733+0000 mgr.a (mgr.14373) 18097 : cluster [DBG] pgmap v12551: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:35:41.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:35:40 smithi086 bash[24289]: cluster 2024-09-16T12:35:39.757733+0000 mgr.a (mgr.14373) 18097 : cluster [DBG] pgmap v12551: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:35:41.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:35:40 smithi047 bash[22744]: cluster 2024-09-16T12:35:39.757733+0000 mgr.a (mgr.14373) 18097 : cluster [DBG] pgmap v12551: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:35:41.372 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:35:41.373 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:35:41.373 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:35:41.373 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:35:41.373 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:35:42.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:35:41 smithi157 bash[24585]: audit 2024-09-16T12:35:40.919205+0000 mgr.a (mgr.14373) 18098 : audit [DBG] from='client.388524 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:35:42.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:35:41 smithi086 bash[24289]: audit 2024-09-16T12:35:40.919205+0000 mgr.a (mgr.14373) 18098 : audit [DBG] from='client.388524 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:35:42.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:35:41 smithi047 bash[22744]: audit 2024-09-16T12:35:40.919205+0000 mgr.a (mgr.14373) 18098 : audit [DBG] from='client.388524 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:35:43.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:35:42 smithi157 bash[24585]: cluster 2024-09-16T12:35:41.760147+0000 mgr.a (mgr.14373) 18099 : cluster [DBG] pgmap v12552: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:35:43.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:35:42 smithi086 bash[24289]: cluster 2024-09-16T12:35:41.760147+0000 mgr.a (mgr.14373) 18099 : cluster [DBG] pgmap v12552: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:35:43.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:35:42 smithi047 bash[22744]: cluster 2024-09-16T12:35:41.760147+0000 mgr.a (mgr.14373) 18099 : cluster [DBG] pgmap v12552: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:35:45.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:35:44 smithi157 bash[24585]: cluster 2024-09-16T12:35:43.760939+0000 mgr.a (mgr.14373) 18100 : cluster [DBG] pgmap v12553: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:35:45.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:35:44 smithi086 bash[24289]: cluster 2024-09-16T12:35:43.760939+0000 mgr.a (mgr.14373) 18100 : cluster [DBG] pgmap v12553: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:35:45.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:35:44 smithi047 bash[22744]: cluster 2024-09-16T12:35:43.760939+0000 mgr.a (mgr.14373) 18100 : cluster [DBG] pgmap v12553: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:35:46.374 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:35:46.375 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:35:46.375 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:35:47.139 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:35:47.140 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:35:47.140 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:35:47.140 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:35:47.140 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:35:47.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:35:46 smithi157 bash[24585]: cluster 2024-09-16T12:35:45.761738+0000 mgr.a (mgr.14373) 18101 : cluster [DBG] pgmap v12554: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:35:47.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:35:46 smithi086 bash[24289]: cluster 2024-09-16T12:35:45.761738+0000 mgr.a (mgr.14373) 18101 : cluster [DBG] pgmap v12554: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:35:47.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:35:46 smithi047 bash[22744]: cluster 2024-09-16T12:35:45.761738+0000 mgr.a (mgr.14373) 18101 : cluster [DBG] pgmap v12554: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:35:48.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:35:47 smithi157 bash[24585]: audit 2024-09-16T12:35:46.708876+0000 mgr.a (mgr.14373) 18102 : audit [DBG] from='client.388599 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:35:48.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:35:47 smithi086 bash[24289]: audit 2024-09-16T12:35:46.708876+0000 mgr.a (mgr.14373) 18102 : audit [DBG] from='client.388599 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:35:48.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:35:47 smithi047 bash[22744]: audit 2024-09-16T12:35:46.708876+0000 mgr.a (mgr.14373) 18102 : audit [DBG] from='client.388599 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:35:49.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:35:48 smithi157 bash[24585]: cluster 2024-09-16T12:35:47.764630+0000 mgr.a (mgr.14373) 18103 : cluster [DBG] pgmap v12555: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:35:49.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:35:48 smithi086 bash[24289]: cluster 2024-09-16T12:35:47.764630+0000 mgr.a (mgr.14373) 18103 : cluster [DBG] pgmap v12555: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:35:49.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:35:48 smithi047 bash[22744]: cluster 2024-09-16T12:35:47.764630+0000 mgr.a (mgr.14373) 18103 : cluster [DBG] pgmap v12555: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:35:51.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:35:50 smithi157 bash[24585]: cluster 2024-09-16T12:35:49.765397+0000 mgr.a (mgr.14373) 18104 : cluster [DBG] pgmap v12556: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T12:35:51.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:35:50 smithi086 bash[24289]: cluster 2024-09-16T12:35:49.765397+0000 mgr.a (mgr.14373) 18104 : cluster [DBG] pgmap v12556: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T12:35:51.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:35:50 smithi047 bash[22744]: cluster 2024-09-16T12:35:49.765397+0000 mgr.a (mgr.14373) 18104 : cluster [DBG] pgmap v12556: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T12:35:52.141 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:35:52.142 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:35:52.142 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:35:52.901 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:35:52.901 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:35:52.901 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:35:52.901 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:35:52.901 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:35:53.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:35:52 smithi157 bash[24585]: cluster 2024-09-16T12:35:51.767327+0000 mgr.a (mgr.14373) 18105 : cluster [DBG] pgmap v12557: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:35:53.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:35:52 smithi086 bash[24289]: cluster 2024-09-16T12:35:51.767327+0000 mgr.a (mgr.14373) 18105 : cluster [DBG] pgmap v12557: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:35:53.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:35:52 smithi047 bash[22744]: cluster 2024-09-16T12:35:51.767327+0000 mgr.a (mgr.14373) 18105 : cluster [DBG] pgmap v12557: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:35:54.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:35:53 smithi157 bash[24585]: audit 2024-09-16T12:35:52.473848+0000 mgr.a (mgr.14373) 18106 : audit [DBG] from='client.388677 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:35:54.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:35:53 smithi086 bash[24289]: audit 2024-09-16T12:35:52.473848+0000 mgr.a (mgr.14373) 18106 : audit [DBG] from='client.388677 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:35:54.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:35:53 smithi047 bash[22744]: audit 2024-09-16T12:35:52.473848+0000 mgr.a (mgr.14373) 18106 : audit [DBG] from='client.388677 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:35:55.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:35:54 smithi157 bash[24585]: cluster 2024-09-16T12:35:53.768197+0000 mgr.a (mgr.14373) 18107 : cluster [DBG] pgmap v12558: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:35:55.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:35:54 smithi086 bash[24289]: cluster 2024-09-16T12:35:53.768197+0000 mgr.a (mgr.14373) 18107 : cluster [DBG] pgmap v12558: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:35:55.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:35:54 smithi047 bash[22744]: cluster 2024-09-16T12:35:53.768197+0000 mgr.a (mgr.14373) 18107 : cluster [DBG] pgmap v12558: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:35:57.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:35:56 smithi157 bash[24585]: cluster 2024-09-16T12:35:55.768994+0000 mgr.a (mgr.14373) 18108 : cluster [DBG] pgmap v12559: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T12:35:57.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:35:56 smithi086 bash[24289]: cluster 2024-09-16T12:35:55.768994+0000 mgr.a (mgr.14373) 18108 : cluster [DBG] pgmap v12559: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T12:35:57.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:35:56 smithi047 bash[22744]: cluster 2024-09-16T12:35:55.768994+0000 mgr.a (mgr.14373) 18108 : cluster [DBG] pgmap v12559: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T12:35:57.902 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:35:57.903 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:35:57.903 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:35:58.661 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:35:58.661 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:35:58.661 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:35:58.661 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:35:58.662 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:35:59.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:35:58 smithi157 bash[24585]: cluster 2024-09-16T12:35:57.771235+0000 mgr.a (mgr.14373) 18109 : cluster [DBG] pgmap v12560: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:35:59.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:35:58 smithi086 bash[24289]: cluster 2024-09-16T12:35:57.771235+0000 mgr.a (mgr.14373) 18109 : cluster [DBG] pgmap v12560: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:35:59.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:35:58 smithi047 bash[22744]: cluster 2024-09-16T12:35:57.771235+0000 mgr.a (mgr.14373) 18109 : cluster [DBG] pgmap v12560: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:36:00.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:35:59 smithi157 bash[24585]: audit 2024-09-16T12:35:58.235601+0000 mgr.a (mgr.14373) 18110 : audit [DBG] from='client.388755 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:36:00.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:35:59 smithi086 bash[24289]: audit 2024-09-16T12:35:58.235601+0000 mgr.a (mgr.14373) 18110 : audit [DBG] from='client.388755 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:36:00.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:35:59 smithi047 bash[22744]: audit 2024-09-16T12:35:58.235601+0000 mgr.a (mgr.14373) 18110 : audit [DBG] from='client.388755 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:36:01.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:36:00 smithi157 bash[24585]: cluster 2024-09-16T12:35:59.772156+0000 mgr.a (mgr.14373) 18111 : cluster [DBG] pgmap v12561: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:36:01.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:36:00 smithi086 bash[24289]: cluster 2024-09-16T12:35:59.772156+0000 mgr.a (mgr.14373) 18111 : cluster [DBG] pgmap v12561: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:36:01.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:36:00 smithi047 bash[22744]: cluster 2024-09-16T12:35:59.772156+0000 mgr.a (mgr.14373) 18111 : cluster [DBG] pgmap v12561: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:36:03.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:36:02 smithi157 bash[24585]: cluster 2024-09-16T12:36:01.774293+0000 mgr.a (mgr.14373) 18112 : cluster [DBG] pgmap v12562: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:36:03.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:36:02 smithi086 bash[24289]: cluster 2024-09-16T12:36:01.774293+0000 mgr.a (mgr.14373) 18112 : cluster [DBG] pgmap v12562: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:36:03.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:36:02 smithi047 bash[22744]: cluster 2024-09-16T12:36:01.774293+0000 mgr.a (mgr.14373) 18112 : cluster [DBG] pgmap v12562: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:36:03.663 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:36:03.664 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:36:03.664 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:36:04.414 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:36:04.414 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:36:04.414 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:36:04.414 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:36:04.414 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:36:05.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:36:04 smithi157 bash[24585]: cluster 2024-09-16T12:36:03.774737+0000 mgr.a (mgr.14373) 18113 : cluster [DBG] pgmap v12563: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:36:05.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:36:04 smithi157 bash[24585]: audit 2024-09-16T12:36:03.992125+0000 mgr.a (mgr.14373) 18114 : audit [DBG] from='client.388833 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:36:05.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:36:04 smithi086 bash[24289]: cluster 2024-09-16T12:36:03.774737+0000 mgr.a (mgr.14373) 18113 : cluster [DBG] pgmap v12563: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:36:05.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:36:04 smithi086 bash[24289]: audit 2024-09-16T12:36:03.992125+0000 mgr.a (mgr.14373) 18114 : audit [DBG] from='client.388833 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:36:05.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:36:04 smithi047 bash[22744]: cluster 2024-09-16T12:36:03.774737+0000 mgr.a (mgr.14373) 18113 : cluster [DBG] pgmap v12563: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:36:05.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:36:04 smithi047 bash[22744]: audit 2024-09-16T12:36:03.992125+0000 mgr.a (mgr.14373) 18114 : audit [DBG] from='client.388833 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:36:07.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:36:06 smithi157 bash[24585]: cluster 2024-09-16T12:36:05.775608+0000 mgr.a (mgr.14373) 18115 : cluster [DBG] pgmap v12564: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:36:07.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:36:06 smithi086 bash[24289]: cluster 2024-09-16T12:36:05.775608+0000 mgr.a (mgr.14373) 18115 : cluster [DBG] pgmap v12564: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:36:07.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:36:06 smithi047 bash[22744]: cluster 2024-09-16T12:36:05.775608+0000 mgr.a (mgr.14373) 18115 : cluster [DBG] pgmap v12564: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:36:09.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:36:09 smithi157 bash[24585]: cluster 2024-09-16T12:36:07.777864+0000 mgr.a (mgr.14373) 18116 : cluster [DBG] pgmap v12565: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:36:09.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:36:09 smithi086 bash[24289]: cluster 2024-09-16T12:36:07.777864+0000 mgr.a (mgr.14373) 18116 : cluster [DBG] pgmap v12565: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:36:09.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:36:09 smithi047 bash[22744]: cluster 2024-09-16T12:36:07.777864+0000 mgr.a (mgr.14373) 18116 : cluster [DBG] pgmap v12565: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:36:09.415 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:36:09.416 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:36:09.416 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:36:10.202 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:36:10.202 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:36:10.202 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:36:10.202 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:36:10.202 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:36:11.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:36:11 smithi157 bash[24585]: audit 2024-09-16T12:36:09.750094+0000 mgr.a (mgr.14373) 18117 : audit [DBG] from='client.388908 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:36:11.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:36:11 smithi157 bash[24585]: cluster 2024-09-16T12:36:09.778976+0000 mgr.a (mgr.14373) 18118 : cluster [DBG] pgmap v12566: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:36:11.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:36:11 smithi086 bash[24289]: audit 2024-09-16T12:36:09.750094+0000 mgr.a (mgr.14373) 18117 : audit [DBG] from='client.388908 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:36:11.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:36:11 smithi086 bash[24289]: cluster 2024-09-16T12:36:09.778976+0000 mgr.a (mgr.14373) 18118 : cluster [DBG] pgmap v12566: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:36:11.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:36:11 smithi047 bash[22744]: audit 2024-09-16T12:36:09.750094+0000 mgr.a (mgr.14373) 18117 : audit [DBG] from='client.388908 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:36:11.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:36:11 smithi047 bash[22744]: cluster 2024-09-16T12:36:09.778976+0000 mgr.a (mgr.14373) 18118 : cluster [DBG] pgmap v12566: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:36:13.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:36:13 smithi157 bash[24585]: cluster 2024-09-16T12:36:11.781272+0000 mgr.a (mgr.14373) 18119 : cluster [DBG] pgmap v12567: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:36:13.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:36:13 smithi086 bash[24289]: cluster 2024-09-16T12:36:11.781272+0000 mgr.a (mgr.14373) 18119 : cluster [DBG] pgmap v12567: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:36:13.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:36:13 smithi047 bash[22744]: cluster 2024-09-16T12:36:11.781272+0000 mgr.a (mgr.14373) 18119 : cluster [DBG] pgmap v12567: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:36:15.203 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:36:15.204 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:36:15.204 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:36:15.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:36:15 smithi157 bash[24585]: cluster 2024-09-16T12:36:13.782025+0000 mgr.a (mgr.14373) 18120 : cluster [DBG] pgmap v12568: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:36:15.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:36:15 smithi086 bash[24289]: cluster 2024-09-16T12:36:13.782025+0000 mgr.a (mgr.14373) 18120 : cluster [DBG] pgmap v12568: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:36:15.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:36:15 smithi047 bash[22744]: cluster 2024-09-16T12:36:13.782025+0000 mgr.a (mgr.14373) 18120 : cluster [DBG] pgmap v12568: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:36:15.972 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:36:15.973 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:36:15.973 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:36:15.973 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:36:15.973 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:36:17.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:36:17 smithi157 bash[24585]: audit 2024-09-16T12:36:15.534508+0000 mgr.a (mgr.14373) 18121 : audit [DBG] from='client.388983 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:36:17.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:36:17 smithi157 bash[24585]: cluster 2024-09-16T12:36:15.782719+0000 mgr.a (mgr.14373) 18122 : cluster [DBG] pgmap v12569: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:36:17.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:36:17 smithi086 bash[24289]: audit 2024-09-16T12:36:15.534508+0000 mgr.a (mgr.14373) 18121 : audit [DBG] from='client.388983 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:36:17.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:36:17 smithi086 bash[24289]: cluster 2024-09-16T12:36:15.782719+0000 mgr.a (mgr.14373) 18122 : cluster [DBG] pgmap v12569: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:36:17.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:36:17 smithi047 bash[22744]: audit 2024-09-16T12:36:15.534508+0000 mgr.a (mgr.14373) 18121 : audit [DBG] from='client.388983 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:36:17.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:36:17 smithi047 bash[22744]: cluster 2024-09-16T12:36:15.782719+0000 mgr.a (mgr.14373) 18122 : cluster [DBG] pgmap v12569: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:36:19.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:36:19 smithi157 bash[24585]: cluster 2024-09-16T12:36:17.785042+0000 mgr.a (mgr.14373) 18123 : cluster [DBG] pgmap v12570: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:36:19.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:36:19 smithi086 bash[24289]: cluster 2024-09-16T12:36:17.785042+0000 mgr.a (mgr.14373) 18123 : cluster [DBG] pgmap v12570: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:36:19.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:36:19 smithi047 bash[22744]: cluster 2024-09-16T12:36:17.785042+0000 mgr.a (mgr.14373) 18123 : cluster [DBG] pgmap v12570: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:36:20.974 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:36:20.975 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:36:20.975 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:36:21.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:36:21 smithi157 bash[24585]: cluster 2024-09-16T12:36:19.785810+0000 mgr.a (mgr.14373) 18124 : cluster [DBG] pgmap v12571: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:36:21.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:36:21 smithi086 bash[24289]: cluster 2024-09-16T12:36:19.785810+0000 mgr.a (mgr.14373) 18124 : cluster [DBG] pgmap v12571: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:36:21.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:36:21 smithi047 bash[22744]: cluster 2024-09-16T12:36:19.785810+0000 mgr.a (mgr.14373) 18124 : cluster [DBG] pgmap v12571: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:36:21.735 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:36:21.735 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:36:21.735 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:36:21.735 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:36:21.735 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:36:23.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:36:23 smithi157 bash[24585]: audit 2024-09-16T12:36:21.303850+0000 mgr.a (mgr.14373) 18125 : audit [DBG] from='client.389058 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:36:23.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:36:23 smithi157 bash[24585]: cluster 2024-09-16T12:36:21.788559+0000 mgr.a (mgr.14373) 18126 : cluster [DBG] pgmap v12572: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-16T12:36:23.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:36:23 smithi086 bash[24289]: audit 2024-09-16T12:36:21.303850+0000 mgr.a (mgr.14373) 18125 : audit [DBG] from='client.389058 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:36:23.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:36:23 smithi086 bash[24289]: cluster 2024-09-16T12:36:21.788559+0000 mgr.a (mgr.14373) 18126 : cluster [DBG] pgmap v12572: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-16T12:36:23.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:36:23 smithi047 bash[22744]: audit 2024-09-16T12:36:21.303850+0000 mgr.a (mgr.14373) 18125 : audit [DBG] from='client.389058 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:36:23.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:36:23 smithi047 bash[22744]: cluster 2024-09-16T12:36:21.788559+0000 mgr.a (mgr.14373) 18126 : cluster [DBG] pgmap v12572: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-16T12:36:25.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:36:25 smithi157 bash[24585]: cluster 2024-09-16T12:36:23.789355+0000 mgr.a (mgr.14373) 18127 : cluster [DBG] pgmap v12573: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T12:36:25.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:36:25 smithi086 bash[24289]: cluster 2024-09-16T12:36:23.789355+0000 mgr.a (mgr.14373) 18127 : cluster [DBG] pgmap v12573: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T12:36:25.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:36:25 smithi047 bash[22744]: cluster 2024-09-16T12:36:23.789355+0000 mgr.a (mgr.14373) 18127 : cluster [DBG] pgmap v12573: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T12:36:26.736 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:36:26.737 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:36:26.737 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:36:27.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:36:27 smithi157 bash[24585]: cluster 2024-09-16T12:36:25.790126+0000 mgr.a (mgr.14373) 18128 : cluster [DBG] pgmap v12574: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T12:36:27.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:36:27 smithi086 bash[24289]: cluster 2024-09-16T12:36:25.790126+0000 mgr.a (mgr.14373) 18128 : cluster [DBG] pgmap v12574: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T12:36:27.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:36:27 smithi047 bash[22744]: cluster 2024-09-16T12:36:25.790126+0000 mgr.a (mgr.14373) 18128 : cluster [DBG] pgmap v12574: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T12:36:27.522 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:36:27.522 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:36:27.522 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:36:27.522 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:36:27.522 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:36:28.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:36:28 smithi157 bash[24585]: audit 2024-09-16T12:36:27.073865+0000 mgr.a (mgr.14373) 18129 : audit [DBG] from='client.389136 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:36:28.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:36:28 smithi086 bash[24289]: audit 2024-09-16T12:36:27.073865+0000 mgr.a (mgr.14373) 18129 : audit [DBG] from='client.389136 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:36:28.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:36:28 smithi047 bash[22744]: audit 2024-09-16T12:36:27.073865+0000 mgr.a (mgr.14373) 18129 : audit [DBG] from='client.389136 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:36:29.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:36:29 smithi157 bash[24585]: cluster 2024-09-16T12:36:27.792892+0000 mgr.a (mgr.14373) 18130 : cluster [DBG] pgmap v12575: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:36:29.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:36:29 smithi086 bash[24289]: cluster 2024-09-16T12:36:27.792892+0000 mgr.a (mgr.14373) 18130 : cluster [DBG] pgmap v12575: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:36:29.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:36:29 smithi047 bash[22744]: cluster 2024-09-16T12:36:27.792892+0000 mgr.a (mgr.14373) 18130 : cluster [DBG] pgmap v12575: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:36:31.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:36:31 smithi086 bash[24289]: cluster 2024-09-16T12:36:29.793688+0000 mgr.a (mgr.14373) 18131 : cluster [DBG] pgmap v12576: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:36:31.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:36:31 smithi047 bash[22744]: cluster 2024-09-16T12:36:29.793688+0000 mgr.a (mgr.14373) 18131 : cluster [DBG] pgmap v12576: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:36:31.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:36:31 smithi157 bash[24585]: cluster 2024-09-16T12:36:29.793688+0000 mgr.a (mgr.14373) 18131 : cluster [DBG] pgmap v12576: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:36:32.524 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:36:32.525 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:36:32.525 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:36:33.312 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:36:33.312 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:36:33.312 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:36:33.312 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:36:33.312 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:36:33.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:36:33 smithi086 bash[24289]: cluster 2024-09-16T12:36:31.795655+0000 mgr.a (mgr.14373) 18132 : cluster [DBG] pgmap v12577: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:36:33.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:36:33 smithi047 bash[22744]: cluster 2024-09-16T12:36:31.795655+0000 mgr.a (mgr.14373) 18132 : cluster [DBG] pgmap v12577: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:36:33.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:36:33 smithi157 bash[24585]: cluster 2024-09-16T12:36:31.795655+0000 mgr.a (mgr.14373) 18132 : cluster [DBG] pgmap v12577: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:36:34.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:36:34 smithi086 bash[24289]: audit 2024-09-16T12:36:32.861609+0000 mgr.a (mgr.14373) 18133 : audit [DBG] from='client.389214 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:36:34.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:36:34 smithi047 bash[22744]: audit 2024-09-16T12:36:32.861609+0000 mgr.a (mgr.14373) 18133 : audit [DBG] from='client.389214 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:36:34.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:36:34 smithi157 bash[24585]: audit 2024-09-16T12:36:32.861609+0000 mgr.a (mgr.14373) 18133 : audit [DBG] from='client.389214 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:36:35.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:36:35 smithi047 bash[22744]: cluster 2024-09-16T12:36:33.796540+0000 mgr.a (mgr.14373) 18134 : cluster [DBG] pgmap v12578: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-16T12:36:35.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:36:35 smithi157 bash[24585]: cluster 2024-09-16T12:36:33.796540+0000 mgr.a (mgr.14373) 18134 : cluster [DBG] pgmap v12578: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-16T12:36:35.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:36:35 smithi086 bash[24289]: cluster 2024-09-16T12:36:33.796540+0000 mgr.a (mgr.14373) 18134 : cluster [DBG] pgmap v12578: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-16T12:36:37.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:36:37 smithi047 bash[22744]: cluster 2024-09-16T12:36:35.797373+0000 mgr.a (mgr.14373) 18135 : cluster [DBG] pgmap v12579: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-16T12:36:37.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:36:37 smithi157 bash[24585]: cluster 2024-09-16T12:36:35.797373+0000 mgr.a (mgr.14373) 18135 : cluster [DBG] pgmap v12579: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-16T12:36:37.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:36:37 smithi086 bash[24289]: cluster 2024-09-16T12:36:35.797373+0000 mgr.a (mgr.14373) 18135 : cluster [DBG] pgmap v12579: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-16T12:36:38.313 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:36:38.314 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:36:38.314 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:36:39.100 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:36:39.101 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:36:39.101 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:36:39.101 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:36:39.101 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:36:39.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:36:39 smithi047 bash[22744]: cluster 2024-09-16T12:36:37.799592+0000 mgr.a (mgr.14373) 18136 : cluster [DBG] pgmap v12580: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-16T12:36:39.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:36:39 smithi157 bash[24585]: cluster 2024-09-16T12:36:37.799592+0000 mgr.a (mgr.14373) 18136 : cluster [DBG] pgmap v12580: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-16T12:36:39.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:36:39 smithi086 bash[24289]: cluster 2024-09-16T12:36:37.799592+0000 mgr.a (mgr.14373) 18136 : cluster [DBG] pgmap v12580: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-16T12:36:40.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:36:40 smithi047 bash[22744]: audit 2024-09-16T12:36:38.649772+0000 mgr.a (mgr.14373) 18137 : audit [DBG] from='client.389286 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:36:40.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:36:40 smithi047 bash[22744]: audit 2024-09-16T12:36:39.159304+0000 mon.b (mon.2) 1642 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T12:36:40.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:36:40 smithi047 bash[22744]: audit 2024-09-16T12:36:39.984425+0000 mon.b (mon.2) 1643 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T12:36:40.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:36:40 smithi047 bash[22744]: audit 2024-09-16T12:36:39.986246+0000 mon.b (mon.2) 1644 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T12:36:40.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:36:40 smithi047 bash[22744]: audit 2024-09-16T12:36:39.995632+0000 mon.a (mon.0) 1648 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:36:40.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:36:40 smithi047 bash[22744]: audit 2024-09-16T12:36:40.001124+0000 mon.b (mon.2) 1645 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:36:40.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:36:40 smithi157 bash[24585]: audit 2024-09-16T12:36:38.649772+0000 mgr.a (mgr.14373) 18137 : audit [DBG] from='client.389286 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:36:40.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:36:40 smithi157 bash[24585]: audit 2024-09-16T12:36:39.159304+0000 mon.b (mon.2) 1642 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T12:36:40.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:36:40 smithi157 bash[24585]: audit 2024-09-16T12:36:39.984425+0000 mon.b (mon.2) 1643 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T12:36:40.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:36:40 smithi157 bash[24585]: audit 2024-09-16T12:36:39.986246+0000 mon.b (mon.2) 1644 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T12:36:40.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:36:40 smithi157 bash[24585]: audit 2024-09-16T12:36:39.995632+0000 mon.a (mon.0) 1648 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:36:40.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:36:40 smithi157 bash[24585]: audit 2024-09-16T12:36:40.001124+0000 mon.b (mon.2) 1645 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:36:40.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:36:40 smithi086 bash[24289]: audit 2024-09-16T12:36:38.649772+0000 mgr.a (mgr.14373) 18137 : audit [DBG] from='client.389286 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:36:40.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:36:40 smithi086 bash[24289]: audit 2024-09-16T12:36:39.159304+0000 mon.b (mon.2) 1642 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T12:36:40.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:36:40 smithi086 bash[24289]: audit 2024-09-16T12:36:39.984425+0000 mon.b (mon.2) 1643 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T12:36:40.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:36:40 smithi086 bash[24289]: audit 2024-09-16T12:36:39.986246+0000 mon.b (mon.2) 1644 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T12:36:40.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:36:40 smithi086 bash[24289]: audit 2024-09-16T12:36:39.995632+0000 mon.a (mon.0) 1648 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:36:40.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:36:40 smithi086 bash[24289]: audit 2024-09-16T12:36:40.001124+0000 mon.b (mon.2) 1645 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:36:41.089 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 12:36:40 smithi047 bash[22994]: debug 2024-09-16T12:36:40.757+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T12:36:41.090 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 12:36:40 smithi047 bash[22994]: debug 2024-09-16T12:36:40.761+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T12:36:41.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:36:41 smithi047 bash[22744]: cluster 2024-09-16T12:36:39.800101+0000 mgr.a (mgr.14373) 18138 : cluster [DBG] pgmap v12581: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:36:41.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:36:41 smithi047 bash[22744]: audit 2024-09-16T12:36:40.003745+0000 mgr.a (mgr.14373) 18139 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:36:41.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:36:41 smithi157 bash[24585]: cluster 2024-09-16T12:36:39.800101+0000 mgr.a (mgr.14373) 18138 : cluster [DBG] pgmap v12581: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:36:41.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:36:41 smithi157 bash[24585]: audit 2024-09-16T12:36:40.003745+0000 mgr.a (mgr.14373) 18139 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:36:41.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:36:41 smithi086 bash[24289]: cluster 2024-09-16T12:36:39.800101+0000 mgr.a (mgr.14373) 18138 : cluster [DBG] pgmap v12581: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:36:41.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:36:41 smithi086 bash[24289]: audit 2024-09-16T12:36:40.003745+0000 mgr.a (mgr.14373) 18139 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:36:42.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:36:42 smithi047 bash[22744]: audit 2024-09-16T12:36:40.761916+0000 mgr.a (mgr.14373) 18140 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T12:36:42.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:36:42 smithi047 bash[22744]: cephadm 2024-09-16T12:36:40.764421+0000 mgr.a (mgr.14373) 18141 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T12:36:42.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:36:42 smithi157 bash[24585]: audit 2024-09-16T12:36:40.761916+0000 mgr.a (mgr.14373) 18140 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T12:36:42.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:36:42 smithi157 bash[24585]: cephadm 2024-09-16T12:36:40.764421+0000 mgr.a (mgr.14373) 18141 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T12:36:42.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:36:42 smithi086 bash[24289]: audit 2024-09-16T12:36:40.761916+0000 mgr.a (mgr.14373) 18140 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T12:36:42.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:36:42 smithi086 bash[24289]: cephadm 2024-09-16T12:36:40.764421+0000 mgr.a (mgr.14373) 18141 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T12:36:43.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:36:43 smithi157 bash[24585]: cluster 2024-09-16T12:36:41.802294+0000 mgr.a (mgr.14373) 18142 : cluster [DBG] pgmap v12582: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:36:43.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:36:43 smithi086 bash[24289]: cluster 2024-09-16T12:36:41.802294+0000 mgr.a (mgr.14373) 18142 : cluster [DBG] pgmap v12582: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:36:43.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:36:43 smithi047 bash[22744]: cluster 2024-09-16T12:36:41.802294+0000 mgr.a (mgr.14373) 18142 : cluster [DBG] pgmap v12582: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:36:44.102 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:36:44.103 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:36:44.103 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:36:44.877 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:36:44.877 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:36:44.877 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:36:44.877 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:36:44.877 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:36:45.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:36:45 smithi157 bash[24585]: cluster 2024-09-16T12:36:43.802980+0000 mgr.a (mgr.14373) 18143 : cluster [DBG] pgmap v12583: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:36:45.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:36:45 smithi086 bash[24289]: cluster 2024-09-16T12:36:43.802980+0000 mgr.a (mgr.14373) 18143 : cluster [DBG] pgmap v12583: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:36:45.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:36:45 smithi047 bash[22744]: cluster 2024-09-16T12:36:43.802980+0000 mgr.a (mgr.14373) 18143 : cluster [DBG] pgmap v12583: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:36:46.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:36:46 smithi157 bash[24585]: audit 2024-09-16T12:36:44.433859+0000 mgr.a (mgr.14373) 18144 : audit [DBG] from='client.389472 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:36:46.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:36:46 smithi086 bash[24289]: audit 2024-09-16T12:36:44.433859+0000 mgr.a (mgr.14373) 18144 : audit [DBG] from='client.389472 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:36:46.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:36:46 smithi047 bash[22744]: audit 2024-09-16T12:36:44.433859+0000 mgr.a (mgr.14373) 18144 : audit [DBG] from='client.389472 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:36:47.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:36:47 smithi157 bash[24585]: cluster 2024-09-16T12:36:45.803873+0000 mgr.a (mgr.14373) 18145 : cluster [DBG] pgmap v12584: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:36:47.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:36:47 smithi086 bash[24289]: cluster 2024-09-16T12:36:45.803873+0000 mgr.a (mgr.14373) 18145 : cluster [DBG] pgmap v12584: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:36:47.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:36:47 smithi047 bash[22744]: cluster 2024-09-16T12:36:45.803873+0000 mgr.a (mgr.14373) 18145 : cluster [DBG] pgmap v12584: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:36:49.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:36:49 smithi157 bash[24585]: cluster 2024-09-16T12:36:47.806146+0000 mgr.a (mgr.14373) 18146 : cluster [DBG] pgmap v12585: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:36:49.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:36:49 smithi086 bash[24289]: cluster 2024-09-16T12:36:47.806146+0000 mgr.a (mgr.14373) 18146 : cluster [DBG] pgmap v12585: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:36:49.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:36:49 smithi047 bash[22744]: cluster 2024-09-16T12:36:47.806146+0000 mgr.a (mgr.14373) 18146 : cluster [DBG] pgmap v12585: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:36:49.878 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:36:49.879 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:36:49.879 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:36:50.664 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:36:50.664 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:36:50.664 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:36:50.664 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:36:50.665 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:36:51.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:36:51 smithi157 bash[24585]: cluster 2024-09-16T12:36:49.807013+0000 mgr.a (mgr.14373) 18147 : cluster [DBG] pgmap v12586: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:36:51.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:36:51 smithi157 bash[24585]: audit 2024-09-16T12:36:50.216819+0000 mgr.a (mgr.14373) 18148 : audit [DBG] from='client.389550 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:36:51.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:36:51 smithi086 bash[24289]: cluster 2024-09-16T12:36:49.807013+0000 mgr.a (mgr.14373) 18147 : cluster [DBG] pgmap v12586: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:36:51.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:36:51 smithi086 bash[24289]: audit 2024-09-16T12:36:50.216819+0000 mgr.a (mgr.14373) 18148 : audit [DBG] from='client.389550 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:36:51.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:36:51 smithi047 bash[22744]: cluster 2024-09-16T12:36:49.807013+0000 mgr.a (mgr.14373) 18147 : cluster [DBG] pgmap v12586: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:36:51.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:36:51 smithi047 bash[22744]: audit 2024-09-16T12:36:50.216819+0000 mgr.a (mgr.14373) 18148 : audit [DBG] from='client.389550 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:36:53.560 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:36:53 smithi157 bash[24585]: cluster 2024-09-16T12:36:51.809407+0000 mgr.a (mgr.14373) 18149 : cluster [DBG] pgmap v12587: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:36:53.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:36:53 smithi086 bash[24289]: cluster 2024-09-16T12:36:51.809407+0000 mgr.a (mgr.14373) 18149 : cluster [DBG] pgmap v12587: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:36:53.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:36:53 smithi047 bash[22744]: cluster 2024-09-16T12:36:51.809407+0000 mgr.a (mgr.14373) 18149 : cluster [DBG] pgmap v12587: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:36:55.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:36:55 smithi157 bash[24585]: cluster 2024-09-16T12:36:53.810415+0000 mgr.a (mgr.14373) 18150 : cluster [DBG] pgmap v12588: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:36:55.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:36:55 smithi086 bash[24289]: cluster 2024-09-16T12:36:53.810415+0000 mgr.a (mgr.14373) 18150 : cluster [DBG] pgmap v12588: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:36:55.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:36:55 smithi047 bash[22744]: cluster 2024-09-16T12:36:53.810415+0000 mgr.a (mgr.14373) 18150 : cluster [DBG] pgmap v12588: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:36:55.665 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:36:55.666 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:36:55.666 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:36:56.456 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:36:56.456 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:36:56.456 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:36:56.456 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:36:56.456 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:36:57.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:36:57 smithi157 bash[24585]: cluster 2024-09-16T12:36:55.810996+0000 mgr.a (mgr.14373) 18151 : cluster [DBG] pgmap v12589: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:36:57.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:36:57 smithi157 bash[24585]: audit 2024-09-16T12:36:56.004324+0000 mgr.a (mgr.14373) 18152 : audit [DBG] from='client.389625 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:36:57.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:36:57 smithi086 bash[24289]: cluster 2024-09-16T12:36:55.810996+0000 mgr.a (mgr.14373) 18151 : cluster [DBG] pgmap v12589: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:36:57.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:36:57 smithi086 bash[24289]: audit 2024-09-16T12:36:56.004324+0000 mgr.a (mgr.14373) 18152 : audit [DBG] from='client.389625 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:36:57.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:36:57 smithi047 bash[22744]: cluster 2024-09-16T12:36:55.810996+0000 mgr.a (mgr.14373) 18151 : cluster [DBG] pgmap v12589: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:36:57.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:36:57 smithi047 bash[22744]: audit 2024-09-16T12:36:56.004324+0000 mgr.a (mgr.14373) 18152 : audit [DBG] from='client.389625 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:36:59.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:36:59 smithi157 bash[24585]: cluster 2024-09-16T12:36:57.813325+0000 mgr.a (mgr.14373) 18153 : cluster [DBG] pgmap v12590: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:36:59.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:36:59 smithi086 bash[24289]: cluster 2024-09-16T12:36:57.813325+0000 mgr.a (mgr.14373) 18153 : cluster [DBG] pgmap v12590: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:36:59.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:36:59 smithi047 bash[22744]: cluster 2024-09-16T12:36:57.813325+0000 mgr.a (mgr.14373) 18153 : cluster [DBG] pgmap v12590: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:37:01.457 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:37:01.458 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:37:01.458 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:37:01.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:37:01 smithi157 bash[24585]: cluster 2024-09-16T12:36:59.814099+0000 mgr.a (mgr.14373) 18154 : cluster [DBG] pgmap v12591: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:37:01.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:37:01 smithi086 bash[24289]: cluster 2024-09-16T12:36:59.814099+0000 mgr.a (mgr.14373) 18154 : cluster [DBG] pgmap v12591: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:37:01.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:37:01 smithi047 bash[22744]: cluster 2024-09-16T12:36:59.814099+0000 mgr.a (mgr.14373) 18154 : cluster [DBG] pgmap v12591: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:37:02.247 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:37:02.247 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:37:02.247 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:37:02.247 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:37:02.247 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:37:03.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:37:03 smithi157 bash[24585]: audit 2024-09-16T12:37:01.791021+0000 mgr.a (mgr.14373) 18155 : audit [DBG] from='client.389703 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:37:03.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:37:03 smithi157 bash[24585]: cluster 2024-09-16T12:37:01.816479+0000 mgr.a (mgr.14373) 18156 : cluster [DBG] pgmap v12592: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:37:03.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:37:03 smithi086 bash[24289]: audit 2024-09-16T12:37:01.791021+0000 mgr.a (mgr.14373) 18155 : audit [DBG] from='client.389703 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:37:03.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:37:03 smithi086 bash[24289]: cluster 2024-09-16T12:37:01.816479+0000 mgr.a (mgr.14373) 18156 : cluster [DBG] pgmap v12592: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:37:03.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:37:03 smithi047 bash[22744]: audit 2024-09-16T12:37:01.791021+0000 mgr.a (mgr.14373) 18155 : audit [DBG] from='client.389703 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:37:03.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:37:03 smithi047 bash[22744]: cluster 2024-09-16T12:37:01.816479+0000 mgr.a (mgr.14373) 18156 : cluster [DBG] pgmap v12592: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:37:05.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:37:05 smithi157 bash[24585]: cluster 2024-09-16T12:37:03.817411+0000 mgr.a (mgr.14373) 18157 : cluster [DBG] pgmap v12593: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:37:05.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:37:05 smithi086 bash[24289]: cluster 2024-09-16T12:37:03.817411+0000 mgr.a (mgr.14373) 18157 : cluster [DBG] pgmap v12593: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:37:05.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:37:05 smithi047 bash[22744]: cluster 2024-09-16T12:37:03.817411+0000 mgr.a (mgr.14373) 18157 : cluster [DBG] pgmap v12593: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:37:07.248 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:37:07.249 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:37:07.249 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:37:07.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:37:07 smithi157 bash[24585]: cluster 2024-09-16T12:37:05.818181+0000 mgr.a (mgr.14373) 18158 : cluster [DBG] pgmap v12594: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T12:37:07.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:37:07 smithi086 bash[24289]: cluster 2024-09-16T12:37:05.818181+0000 mgr.a (mgr.14373) 18158 : cluster [DBG] pgmap v12594: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T12:37:07.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:37:07 smithi047 bash[22744]: cluster 2024-09-16T12:37:05.818181+0000 mgr.a (mgr.14373) 18158 : cluster [DBG] pgmap v12594: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T12:37:08.030 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:37:08.030 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:37:08.030 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:37:08.030 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:37:08.030 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:37:09.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:37:09 smithi157 bash[24585]: audit 2024-09-16T12:37:07.586722+0000 mgr.a (mgr.14373) 18159 : audit [DBG] from='client.389775 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:37:09.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:37:09 smithi157 bash[24585]: cluster 2024-09-16T12:37:07.826764+0000 mgr.a (mgr.14373) 18160 : cluster [DBG] pgmap v12595: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:37:09.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:37:09 smithi086 bash[24289]: audit 2024-09-16T12:37:07.586722+0000 mgr.a (mgr.14373) 18159 : audit [DBG] from='client.389775 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:37:09.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:37:09 smithi086 bash[24289]: cluster 2024-09-16T12:37:07.826764+0000 mgr.a (mgr.14373) 18160 : cluster [DBG] pgmap v12595: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:37:09.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:37:09 smithi047 bash[22744]: audit 2024-09-16T12:37:07.586722+0000 mgr.a (mgr.14373) 18159 : audit [DBG] from='client.389775 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:37:09.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:37:09 smithi047 bash[22744]: cluster 2024-09-16T12:37:07.826764+0000 mgr.a (mgr.14373) 18160 : cluster [DBG] pgmap v12595: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:37:11.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:37:11 smithi157 bash[24585]: cluster 2024-09-16T12:37:09.827636+0000 mgr.a (mgr.14373) 18161 : cluster [DBG] pgmap v12596: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:37:11.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:37:11 smithi086 bash[24289]: cluster 2024-09-16T12:37:09.827636+0000 mgr.a (mgr.14373) 18161 : cluster [DBG] pgmap v12596: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:37:11.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:37:11 smithi047 bash[22744]: cluster 2024-09-16T12:37:09.827636+0000 mgr.a (mgr.14373) 18161 : cluster [DBG] pgmap v12596: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:37:13.031 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:37:13.032 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:37:13.032 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:37:13.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:37:13 smithi157 bash[24585]: cluster 2024-09-16T12:37:11.829815+0000 mgr.a (mgr.14373) 18162 : cluster [DBG] pgmap v12597: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:37:13.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:37:13 smithi086 bash[24289]: cluster 2024-09-16T12:37:11.829815+0000 mgr.a (mgr.14373) 18162 : cluster [DBG] pgmap v12597: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:37:13.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:37:13 smithi047 bash[22744]: cluster 2024-09-16T12:37:11.829815+0000 mgr.a (mgr.14373) 18162 : cluster [DBG] pgmap v12597: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:37:13.821 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:37:13.822 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:37:13.822 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:37:13.822 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:37:13.822 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:37:15.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:37:15 smithi157 bash[24585]: audit 2024-09-16T12:37:13.369577+0000 mgr.a (mgr.14373) 18163 : audit [DBG] from='client.389847 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:37:15.558 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:37:15 smithi157 bash[24585]: cluster 2024-09-16T12:37:13.830381+0000 mgr.a (mgr.14373) 18164 : cluster [DBG] pgmap v12598: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:37:15.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:37:15 smithi086 bash[24289]: audit 2024-09-16T12:37:13.369577+0000 mgr.a (mgr.14373) 18163 : audit [DBG] from='client.389847 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:37:15.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:37:15 smithi086 bash[24289]: cluster 2024-09-16T12:37:13.830381+0000 mgr.a (mgr.14373) 18164 : cluster [DBG] pgmap v12598: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:37:15.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:37:15 smithi047 bash[22744]: audit 2024-09-16T12:37:13.369577+0000 mgr.a (mgr.14373) 18163 : audit [DBG] from='client.389847 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:37:15.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:37:15 smithi047 bash[22744]: cluster 2024-09-16T12:37:13.830381+0000 mgr.a (mgr.14373) 18164 : cluster [DBG] pgmap v12598: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:37:17.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:37:17 smithi157 bash[24585]: cluster 2024-09-16T12:37:15.831114+0000 mgr.a (mgr.14373) 18165 : cluster [DBG] pgmap v12599: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:37:17.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:37:17 smithi086 bash[24289]: cluster 2024-09-16T12:37:15.831114+0000 mgr.a (mgr.14373) 18165 : cluster [DBG] pgmap v12599: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:37:17.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:37:17 smithi047 bash[22744]: cluster 2024-09-16T12:37:15.831114+0000 mgr.a (mgr.14373) 18165 : cluster [DBG] pgmap v12599: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:37:18.823 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:37:18.824 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:37:18.824 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:37:19.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:37:19 smithi157 bash[24585]: cluster 2024-09-16T12:37:17.833360+0000 mgr.a (mgr.14373) 18166 : cluster [DBG] pgmap v12600: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:37:19.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:37:19 smithi086 bash[24289]: cluster 2024-09-16T12:37:17.833360+0000 mgr.a (mgr.14373) 18166 : cluster [DBG] pgmap v12600: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:37:19.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:37:19 smithi047 bash[22744]: cluster 2024-09-16T12:37:17.833360+0000 mgr.a (mgr.14373) 18166 : cluster [DBG] pgmap v12600: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:37:19.611 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:37:19.612 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:37:19.612 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:37:19.612 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:37:19.612 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:37:20.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:37:20 smithi157 bash[24585]: audit 2024-09-16T12:37:19.158520+0000 mgr.a (mgr.14373) 18167 : audit [DBG] from='client.389925 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:37:20.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:37:20 smithi086 bash[24289]: audit 2024-09-16T12:37:19.158520+0000 mgr.a (mgr.14373) 18167 : audit [DBG] from='client.389925 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:37:20.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:37:20 smithi047 bash[22744]: audit 2024-09-16T12:37:19.158520+0000 mgr.a (mgr.14373) 18167 : audit [DBG] from='client.389925 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:37:21.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:37:21 smithi157 bash[24585]: cluster 2024-09-16T12:37:19.834321+0000 mgr.a (mgr.14373) 18168 : cluster [DBG] pgmap v12601: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:37:21.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:37:21 smithi086 bash[24289]: cluster 2024-09-16T12:37:19.834321+0000 mgr.a (mgr.14373) 18168 : cluster [DBG] pgmap v12601: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:37:21.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:37:21 smithi047 bash[22744]: cluster 2024-09-16T12:37:19.834321+0000 mgr.a (mgr.14373) 18168 : cluster [DBG] pgmap v12601: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:37:23.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:37:23 smithi157 bash[24585]: cluster 2024-09-16T12:37:21.836489+0000 mgr.a (mgr.14373) 18169 : cluster [DBG] pgmap v12602: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:37:23.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:37:23 smithi086 bash[24289]: cluster 2024-09-16T12:37:21.836489+0000 mgr.a (mgr.14373) 18169 : cluster [DBG] pgmap v12602: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:37:23.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:37:23 smithi047 bash[22744]: cluster 2024-09-16T12:37:21.836489+0000 mgr.a (mgr.14373) 18169 : cluster [DBG] pgmap v12602: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:37:24.613 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:37:24.614 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:37:24.614 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:37:25.373 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:37:25.373 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:37:25.373 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:37:25.373 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:37:25.373 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:37:25.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:37:25 smithi157 bash[24585]: cluster 2024-09-16T12:37:23.837283+0000 mgr.a (mgr.14373) 18170 : cluster [DBG] pgmap v12603: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:37:25.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:37:25 smithi086 bash[24289]: cluster 2024-09-16T12:37:23.837283+0000 mgr.a (mgr.14373) 18170 : cluster [DBG] pgmap v12603: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:37:25.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:37:25 smithi047 bash[22744]: cluster 2024-09-16T12:37:23.837283+0000 mgr.a (mgr.14373) 18170 : cluster [DBG] pgmap v12603: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:37:26.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:37:26 smithi157 bash[24585]: audit 2024-09-16T12:37:24.945414+0000 mgr.a (mgr.14373) 18171 : audit [DBG] from='client.390003 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:37:26.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:37:26 smithi086 bash[24289]: audit 2024-09-16T12:37:24.945414+0000 mgr.a (mgr.14373) 18171 : audit [DBG] from='client.390003 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:37:26.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:37:26 smithi047 bash[22744]: audit 2024-09-16T12:37:24.945414+0000 mgr.a (mgr.14373) 18171 : audit [DBG] from='client.390003 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:37:27.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:37:27 smithi157 bash[24585]: cluster 2024-09-16T12:37:25.838256+0000 mgr.a (mgr.14373) 18172 : cluster [DBG] pgmap v12604: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:37:27.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:37:27 smithi086 bash[24289]: cluster 2024-09-16T12:37:25.838256+0000 mgr.a (mgr.14373) 18172 : cluster [DBG] pgmap v12604: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:37:27.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:37:27 smithi047 bash[22744]: cluster 2024-09-16T12:37:25.838256+0000 mgr.a (mgr.14373) 18172 : cluster [DBG] pgmap v12604: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:37:29.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:37:29 smithi157 bash[24585]: cluster 2024-09-16T12:37:27.840552+0000 mgr.a (mgr.14373) 18173 : cluster [DBG] pgmap v12605: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:37:29.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:37:29 smithi086 bash[24289]: cluster 2024-09-16T12:37:27.840552+0000 mgr.a (mgr.14373) 18173 : cluster [DBG] pgmap v12605: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:37:29.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:37:29 smithi047 bash[22744]: cluster 2024-09-16T12:37:27.840552+0000 mgr.a (mgr.14373) 18173 : cluster [DBG] pgmap v12605: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:37:30.374 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:37:30.375 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:37:30.375 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:37:31.167 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:37:31.167 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:37:31.167 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:37:31.167 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:37:31.167 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:37:31.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:37:31 smithi157 bash[24585]: cluster 2024-09-16T12:37:29.841363+0000 mgr.a (mgr.14373) 18174 : cluster [DBG] pgmap v12606: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:37:31.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:37:31 smithi086 bash[24289]: cluster 2024-09-16T12:37:29.841363+0000 mgr.a (mgr.14373) 18174 : cluster [DBG] pgmap v12606: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:37:31.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:37:31 smithi047 bash[22744]: cluster 2024-09-16T12:37:29.841363+0000 mgr.a (mgr.14373) 18174 : cluster [DBG] pgmap v12606: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:37:32.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:37:32 smithi157 bash[24585]: audit 2024-09-16T12:37:30.705729+0000 mgr.a (mgr.14373) 18175 : audit [DBG] from='client.390081 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:37:32.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:37:32 smithi086 bash[24289]: audit 2024-09-16T12:37:30.705729+0000 mgr.a (mgr.14373) 18175 : audit [DBG] from='client.390081 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:37:32.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:37:32 smithi047 bash[22744]: audit 2024-09-16T12:37:30.705729+0000 mgr.a (mgr.14373) 18175 : audit [DBG] from='client.390081 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:37:33.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:37:33 smithi157 bash[24585]: cluster 2024-09-16T12:37:31.843744+0000 mgr.a (mgr.14373) 18176 : cluster [DBG] pgmap v12607: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:37:33.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:37:33 smithi086 bash[24289]: cluster 2024-09-16T12:37:31.843744+0000 mgr.a (mgr.14373) 18176 : cluster [DBG] pgmap v12607: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:37:33.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:37:33 smithi047 bash[22744]: cluster 2024-09-16T12:37:31.843744+0000 mgr.a (mgr.14373) 18176 : cluster [DBG] pgmap v12607: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:37:35.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:37:35 smithi157 bash[24585]: cluster 2024-09-16T12:37:33.844543+0000 mgr.a (mgr.14373) 18177 : cluster [DBG] pgmap v12608: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:37:35.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:37:35 smithi086 bash[24289]: cluster 2024-09-16T12:37:33.844543+0000 mgr.a (mgr.14373) 18177 : cluster [DBG] pgmap v12608: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:37:35.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:37:35 smithi047 bash[22744]: cluster 2024-09-16T12:37:33.844543+0000 mgr.a (mgr.14373) 18177 : cluster [DBG] pgmap v12608: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:37:36.168 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:37:36.169 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:37:36.169 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:37:36.941 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:37:36.941 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:37:36.941 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:37:36.942 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:37:36.942 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:37:37.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:37:37 smithi157 bash[24585]: cluster 2024-09-16T12:37:35.845317+0000 mgr.a (mgr.14373) 18178 : cluster [DBG] pgmap v12609: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:37:37.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:37:37 smithi086 bash[24289]: cluster 2024-09-16T12:37:35.845317+0000 mgr.a (mgr.14373) 18178 : cluster [DBG] pgmap v12609: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:37:37.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:37:37 smithi047 bash[22744]: cluster 2024-09-16T12:37:35.845317+0000 mgr.a (mgr.14373) 18178 : cluster [DBG] pgmap v12609: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:37:38.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:37:38 smithi157 bash[24585]: audit 2024-09-16T12:37:36.499766+0000 mgr.a (mgr.14373) 18179 : audit [DBG] from='client.390156 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:37:38.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:37:38 smithi086 bash[24289]: audit 2024-09-16T12:37:36.499766+0000 mgr.a (mgr.14373) 18179 : audit [DBG] from='client.390156 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:37:38.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:37:38 smithi047 bash[22744]: audit 2024-09-16T12:37:36.499766+0000 mgr.a (mgr.14373) 18179 : audit [DBG] from='client.390156 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:37:39.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:37:39 smithi157 bash[24585]: cluster 2024-09-16T12:37:37.848127+0000 mgr.a (mgr.14373) 18180 : cluster [DBG] pgmap v12610: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:37:39.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:37:39 smithi086 bash[24289]: cluster 2024-09-16T12:37:37.848127+0000 mgr.a (mgr.14373) 18180 : cluster [DBG] pgmap v12610: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:37:39.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:37:39 smithi047 bash[22744]: cluster 2024-09-16T12:37:37.848127+0000 mgr.a (mgr.14373) 18180 : cluster [DBG] pgmap v12610: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:37:40.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:37:40 smithi157 bash[24585]: cluster 2024-09-16T12:37:39.848938+0000 mgr.a (mgr.14373) 18181 : cluster [DBG] pgmap v12611: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:37:40.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:37:40 smithi086 bash[24289]: cluster 2024-09-16T12:37:39.848938+0000 mgr.a (mgr.14373) 18181 : cluster [DBG] pgmap v12611: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:37:40.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:37:40 smithi047 bash[22744]: cluster 2024-09-16T12:37:39.848938+0000 mgr.a (mgr.14373) 18181 : cluster [DBG] pgmap v12611: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:37:41.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:37:41 smithi157 bash[24585]: audit 2024-09-16T12:37:40.818449+0000 mon.b (mon.2) 1646 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T12:37:41.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:37:41 smithi086 bash[24289]: audit 2024-09-16T12:37:40.818449+0000 mon.b (mon.2) 1646 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T12:37:41.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:37:41 smithi047 bash[22744]: audit 2024-09-16T12:37:40.818449+0000 mon.b (mon.2) 1646 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T12:37:41.942 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:37:41.942 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:37:41.942 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:37:42.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:37:42 smithi157 bash[24585]: audit 2024-09-16T12:37:41.658782+0000 mon.b (mon.2) 1647 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T12:37:42.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:37:42 smithi157 bash[24585]: audit 2024-09-16T12:37:41.661024+0000 mon.b (mon.2) 1648 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T12:37:42.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:37:42 smithi157 bash[24585]: audit 2024-09-16T12:37:41.672791+0000 mon.a (mon.0) 1649 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:37:42.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:37:42 smithi157 bash[24585]: audit 2024-09-16T12:37:41.677982+0000 mon.b (mon.2) 1649 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:37:42.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:37:42 smithi157 bash[24585]: audit 2024-09-16T12:37:41.680353+0000 mgr.a (mgr.14373) 18182 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:37:42.558 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:37:42 smithi157 bash[24585]: cluster 2024-09-16T12:37:41.850415+0000 mgr.a (mgr.14373) 18183 : cluster [DBG] pgmap v12612: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:37:42.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:37:42 smithi086 bash[24289]: audit 2024-09-16T12:37:41.658782+0000 mon.b (mon.2) 1647 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T12:37:42.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:37:42 smithi086 bash[24289]: audit 2024-09-16T12:37:41.661024+0000 mon.b (mon.2) 1648 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T12:37:42.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:37:42 smithi086 bash[24289]: audit 2024-09-16T12:37:41.672791+0000 mon.a (mon.0) 1649 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:37:42.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:37:42 smithi086 bash[24289]: audit 2024-09-16T12:37:41.677982+0000 mon.b (mon.2) 1649 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:37:42.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:37:42 smithi086 bash[24289]: audit 2024-09-16T12:37:41.680353+0000 mgr.a (mgr.14373) 18182 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:37:42.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:37:42 smithi086 bash[24289]: cluster 2024-09-16T12:37:41.850415+0000 mgr.a (mgr.14373) 18183 : cluster [DBG] pgmap v12612: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:37:42.592 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 12:37:42 smithi047 bash[22994]: debug 2024-09-16T12:37:42.440+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T12:37:42.593 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 12:37:42 smithi047 bash[22994]: debug 2024-09-16T12:37:42.452+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T12:37:42.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:37:42 smithi047 bash[22744]: audit 2024-09-16T12:37:41.658782+0000 mon.b (mon.2) 1647 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T12:37:42.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:37:42 smithi047 bash[22744]: audit 2024-09-16T12:37:41.661024+0000 mon.b (mon.2) 1648 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T12:37:42.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:37:42 smithi047 bash[22744]: audit 2024-09-16T12:37:41.672791+0000 mon.a (mon.0) 1649 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:37:42.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:37:42 smithi047 bash[22744]: audit 2024-09-16T12:37:41.677982+0000 mon.b (mon.2) 1649 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:37:42.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:37:42 smithi047 bash[22744]: audit 2024-09-16T12:37:41.680353+0000 mgr.a (mgr.14373) 18182 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:37:42.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:37:42 smithi047 bash[22744]: cluster 2024-09-16T12:37:41.850415+0000 mgr.a (mgr.14373) 18183 : cluster [DBG] pgmap v12612: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:37:42.866 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:37:42.866 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:37:42.866 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:37:42.866 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:37:42.866 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:37:44.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:37:43 smithi157 bash[24585]: audit 2024-09-16T12:37:42.277117+0000 mgr.a (mgr.14373) 18184 : audit [DBG] from='client.390288 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:37:44.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:37:43 smithi157 bash[24585]: audit 2024-09-16T12:37:42.442749+0000 mgr.a (mgr.14373) 18185 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T12:37:44.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:37:43 smithi157 bash[24585]: cephadm 2024-09-16T12:37:42.457095+0000 mgr.a (mgr.14373) 18186 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T12:37:44.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:37:43 smithi086 bash[24289]: audit 2024-09-16T12:37:42.277117+0000 mgr.a (mgr.14373) 18184 : audit [DBG] from='client.390288 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:37:44.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:37:43 smithi086 bash[24289]: audit 2024-09-16T12:37:42.442749+0000 mgr.a (mgr.14373) 18185 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T12:37:44.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:37:43 smithi086 bash[24289]: cephadm 2024-09-16T12:37:42.457095+0000 mgr.a (mgr.14373) 18186 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T12:37:44.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:37:43 smithi047 bash[22744]: audit 2024-09-16T12:37:42.277117+0000 mgr.a (mgr.14373) 18184 : audit [DBG] from='client.390288 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:37:44.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:37:43 smithi047 bash[22744]: audit 2024-09-16T12:37:42.442749+0000 mgr.a (mgr.14373) 18185 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T12:37:44.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:37:43 smithi047 bash[22744]: cephadm 2024-09-16T12:37:42.457095+0000 mgr.a (mgr.14373) 18186 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T12:37:45.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:37:44 smithi157 bash[24585]: cluster 2024-09-16T12:37:43.851264+0000 mgr.a (mgr.14373) 18187 : cluster [DBG] pgmap v12613: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:37:45.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:37:44 smithi086 bash[24289]: cluster 2024-09-16T12:37:43.851264+0000 mgr.a (mgr.14373) 18187 : cluster [DBG] pgmap v12613: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:37:45.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:37:44 smithi047 bash[22744]: cluster 2024-09-16T12:37:43.851264+0000 mgr.a (mgr.14373) 18187 : cluster [DBG] pgmap v12613: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:37:47.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:37:46 smithi157 bash[24585]: cluster 2024-09-16T12:37:45.852091+0000 mgr.a (mgr.14373) 18188 : cluster [DBG] pgmap v12614: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T12:37:47.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:37:46 smithi086 bash[24289]: cluster 2024-09-16T12:37:45.852091+0000 mgr.a (mgr.14373) 18188 : cluster [DBG] pgmap v12614: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T12:37:47.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:37:46 smithi047 bash[22744]: cluster 2024-09-16T12:37:45.852091+0000 mgr.a (mgr.14373) 18188 : cluster [DBG] pgmap v12614: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T12:37:47.867 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:37:47.868 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:37:47.868 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:37:48.640 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:37:48.641 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:37:48.641 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:37:48.641 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:37:48.641 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:37:49.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:37:48 smithi157 bash[24585]: cluster 2024-09-16T12:37:47.854336+0000 mgr.a (mgr.14373) 18189 : cluster [DBG] pgmap v12615: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:37:49.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:37:48 smithi157 bash[24585]: audit 2024-09-16T12:37:48.203250+0000 mgr.a (mgr.14373) 18190 : audit [DBG] from='client.390414 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:37:49.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:37:48 smithi086 bash[24289]: cluster 2024-09-16T12:37:47.854336+0000 mgr.a (mgr.14373) 18189 : cluster [DBG] pgmap v12615: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:37:49.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:37:48 smithi086 bash[24289]: audit 2024-09-16T12:37:48.203250+0000 mgr.a (mgr.14373) 18190 : audit [DBG] from='client.390414 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:37:49.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:37:48 smithi047 bash[22744]: cluster 2024-09-16T12:37:47.854336+0000 mgr.a (mgr.14373) 18189 : cluster [DBG] pgmap v12615: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:37:49.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:37:48 smithi047 bash[22744]: audit 2024-09-16T12:37:48.203250+0000 mgr.a (mgr.14373) 18190 : audit [DBG] from='client.390414 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:37:51.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:37:50 smithi157 bash[24585]: cluster 2024-09-16T12:37:49.855290+0000 mgr.a (mgr.14373) 18191 : cluster [DBG] pgmap v12616: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:37:51.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:37:50 smithi086 bash[24289]: cluster 2024-09-16T12:37:49.855290+0000 mgr.a (mgr.14373) 18191 : cluster [DBG] pgmap v12616: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:37:51.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:37:50 smithi047 bash[22744]: cluster 2024-09-16T12:37:49.855290+0000 mgr.a (mgr.14373) 18191 : cluster [DBG] pgmap v12616: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:37:53.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:37:52 smithi157 bash[24585]: cluster 2024-09-16T12:37:51.857543+0000 mgr.a (mgr.14373) 18192 : cluster [DBG] pgmap v12617: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:37:53.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:37:52 smithi086 bash[24289]: cluster 2024-09-16T12:37:51.857543+0000 mgr.a (mgr.14373) 18192 : cluster [DBG] pgmap v12617: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:37:53.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:37:52 smithi047 bash[22744]: cluster 2024-09-16T12:37:51.857543+0000 mgr.a (mgr.14373) 18192 : cluster [DBG] pgmap v12617: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:37:53.642 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:37:53.642 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:37:53.642 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:37:54.428 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:37:54.429 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:37:54.429 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:37:54.429 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:37:54.429 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:37:55.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:37:54 smithi157 bash[24585]: cluster 2024-09-16T12:37:53.858306+0000 mgr.a (mgr.14373) 18193 : cluster [DBG] pgmap v12618: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:37:55.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:37:54 smithi157 bash[24585]: audit 2024-09-16T12:37:53.977864+0000 mgr.a (mgr.14373) 18194 : audit [DBG] from='client.390492 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:37:55.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:37:54 smithi086 bash[24289]: cluster 2024-09-16T12:37:53.858306+0000 mgr.a (mgr.14373) 18193 : cluster [DBG] pgmap v12618: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:37:55.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:37:54 smithi086 bash[24289]: audit 2024-09-16T12:37:53.977864+0000 mgr.a (mgr.14373) 18194 : audit [DBG] from='client.390492 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:37:55.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:37:54 smithi047 bash[22744]: cluster 2024-09-16T12:37:53.858306+0000 mgr.a (mgr.14373) 18193 : cluster [DBG] pgmap v12618: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:37:55.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:37:54 smithi047 bash[22744]: audit 2024-09-16T12:37:53.977864+0000 mgr.a (mgr.14373) 18194 : audit [DBG] from='client.390492 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:37:57.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:37:56 smithi157 bash[24585]: cluster 2024-09-16T12:37:55.859321+0000 mgr.a (mgr.14373) 18195 : cluster [DBG] pgmap v12619: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:37:57.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:37:56 smithi086 bash[24289]: cluster 2024-09-16T12:37:55.859321+0000 mgr.a (mgr.14373) 18195 : cluster [DBG] pgmap v12619: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:37:57.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:37:56 smithi047 bash[22744]: cluster 2024-09-16T12:37:55.859321+0000 mgr.a (mgr.14373) 18195 : cluster [DBG] pgmap v12619: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:37:59.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:37:58 smithi157 bash[24585]: cluster 2024-09-16T12:37:57.861601+0000 mgr.a (mgr.14373) 18196 : cluster [DBG] pgmap v12620: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:37:59.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:37:58 smithi086 bash[24289]: cluster 2024-09-16T12:37:57.861601+0000 mgr.a (mgr.14373) 18196 : cluster [DBG] pgmap v12620: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:37:59.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:37:58 smithi047 bash[22744]: cluster 2024-09-16T12:37:57.861601+0000 mgr.a (mgr.14373) 18196 : cluster [DBG] pgmap v12620: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:37:59.430 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:37:59.431 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:37:59.431 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:38:00.187 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:38:00.187 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:38:00.187 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:38:00.187 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:38:00.187 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:38:01.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:38:00 smithi157 bash[24585]: audit 2024-09-16T12:37:59.757712+0000 mgr.a (mgr.14373) 18197 : audit [DBG] from='client.390567 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:38:01.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:38:00 smithi157 bash[24585]: cluster 2024-09-16T12:37:59.862186+0000 mgr.a (mgr.14373) 18198 : cluster [DBG] pgmap v12621: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:38:01.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:38:00 smithi086 bash[24289]: audit 2024-09-16T12:37:59.757712+0000 mgr.a (mgr.14373) 18197 : audit [DBG] from='client.390567 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:38:01.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:38:00 smithi086 bash[24289]: cluster 2024-09-16T12:37:59.862186+0000 mgr.a (mgr.14373) 18198 : cluster [DBG] pgmap v12621: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:38:01.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:38:00 smithi047 bash[22744]: audit 2024-09-16T12:37:59.757712+0000 mgr.a (mgr.14373) 18197 : audit [DBG] from='client.390567 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:38:01.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:38:00 smithi047 bash[22744]: cluster 2024-09-16T12:37:59.862186+0000 mgr.a (mgr.14373) 18198 : cluster [DBG] pgmap v12621: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:38:03.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:38:02 smithi157 bash[24585]: cluster 2024-09-16T12:38:01.864390+0000 mgr.a (mgr.14373) 18199 : cluster [DBG] pgmap v12622: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:38:03.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:38:02 smithi086 bash[24289]: cluster 2024-09-16T12:38:01.864390+0000 mgr.a (mgr.14373) 18199 : cluster [DBG] pgmap v12622: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:38:03.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:38:02 smithi047 bash[22744]: cluster 2024-09-16T12:38:01.864390+0000 mgr.a (mgr.14373) 18199 : cluster [DBG] pgmap v12622: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:38:05.188 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:38:05.189 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:38:05.189 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:38:05.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:38:04 smithi157 bash[24585]: cluster 2024-09-16T12:38:03.865184+0000 mgr.a (mgr.14373) 18200 : cluster [DBG] pgmap v12623: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:38:05.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:38:04 smithi086 bash[24289]: cluster 2024-09-16T12:38:03.865184+0000 mgr.a (mgr.14373) 18200 : cluster [DBG] pgmap v12623: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:38:05.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:38:04 smithi047 bash[22744]: cluster 2024-09-16T12:38:03.865184+0000 mgr.a (mgr.14373) 18200 : cluster [DBG] pgmap v12623: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:38:05.973 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:38:05.973 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:38:05.973 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:38:05.973 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:38:05.973 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:38:07.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:38:06 smithi157 bash[24585]: audit 2024-09-16T12:38:05.518169+0000 mgr.a (mgr.14373) 18201 : audit [DBG] from='client.390645 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:38:07.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:38:06 smithi157 bash[24585]: cluster 2024-09-16T12:38:05.865976+0000 mgr.a (mgr.14373) 18202 : cluster [DBG] pgmap v12624: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:38:07.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:38:06 smithi086 bash[24289]: audit 2024-09-16T12:38:05.518169+0000 mgr.a (mgr.14373) 18201 : audit [DBG] from='client.390645 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:38:07.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:38:06 smithi086 bash[24289]: cluster 2024-09-16T12:38:05.865976+0000 mgr.a (mgr.14373) 18202 : cluster [DBG] pgmap v12624: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:38:07.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:38:06 smithi047 bash[22744]: audit 2024-09-16T12:38:05.518169+0000 mgr.a (mgr.14373) 18201 : audit [DBG] from='client.390645 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:38:07.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:38:06 smithi047 bash[22744]: cluster 2024-09-16T12:38:05.865976+0000 mgr.a (mgr.14373) 18202 : cluster [DBG] pgmap v12624: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:38:09.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:38:08 smithi157 bash[24585]: cluster 2024-09-16T12:38:07.868416+0000 mgr.a (mgr.14373) 18203 : cluster [DBG] pgmap v12625: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 16 KiB/s rd, 0 B/s wr, 24 op/s 2024-09-16T12:38:09.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:38:08 smithi086 bash[24289]: cluster 2024-09-16T12:38:07.868416+0000 mgr.a (mgr.14373) 18203 : cluster [DBG] pgmap v12625: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 16 KiB/s rd, 0 B/s wr, 24 op/s 2024-09-16T12:38:09.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:38:08 smithi047 bash[22744]: cluster 2024-09-16T12:38:07.868416+0000 mgr.a (mgr.14373) 18203 : cluster [DBG] pgmap v12625: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 16 KiB/s rd, 0 B/s wr, 24 op/s 2024-09-16T12:38:10.974 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:38:10.975 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:38:10.975 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:38:11.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:38:10 smithi157 bash[24585]: cluster 2024-09-16T12:38:09.869225+0000 mgr.a (mgr.14373) 18204 : cluster [DBG] pgmap v12626: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 15 KiB/s rd, 0 B/s wr, 24 op/s 2024-09-16T12:38:11.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:38:10 smithi086 bash[24289]: cluster 2024-09-16T12:38:09.869225+0000 mgr.a (mgr.14373) 18204 : cluster [DBG] pgmap v12626: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 15 KiB/s rd, 0 B/s wr, 24 op/s 2024-09-16T12:38:11.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:38:10 smithi047 bash[22744]: cluster 2024-09-16T12:38:09.869225+0000 mgr.a (mgr.14373) 18204 : cluster [DBG] pgmap v12626: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 15 KiB/s rd, 0 B/s wr, 24 op/s 2024-09-16T12:38:11.740 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:38:11.740 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:38:11.740 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:38:11.740 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:38:11.740 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:38:13.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:38:12 smithi157 bash[24585]: audit 2024-09-16T12:38:11.307034+0000 mgr.a (mgr.14373) 18205 : audit [DBG] from='client.390720 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:38:13.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:38:12 smithi157 bash[24585]: cluster 2024-09-16T12:38:11.872084+0000 mgr.a (mgr.14373) 18206 : cluster [DBG] pgmap v12627: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 19 KiB/s rd, 0 B/s wr, 30 op/s 2024-09-16T12:38:13.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:38:12 smithi086 bash[24289]: audit 2024-09-16T12:38:11.307034+0000 mgr.a (mgr.14373) 18205 : audit [DBG] from='client.390720 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:38:13.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:38:12 smithi086 bash[24289]: cluster 2024-09-16T12:38:11.872084+0000 mgr.a (mgr.14373) 18206 : cluster [DBG] pgmap v12627: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 19 KiB/s rd, 0 B/s wr, 30 op/s 2024-09-16T12:38:13.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:38:12 smithi047 bash[22744]: audit 2024-09-16T12:38:11.307034+0000 mgr.a (mgr.14373) 18205 : audit [DBG] from='client.390720 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:38:13.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:38:12 smithi047 bash[22744]: cluster 2024-09-16T12:38:11.872084+0000 mgr.a (mgr.14373) 18206 : cluster [DBG] pgmap v12627: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 19 KiB/s rd, 0 B/s wr, 30 op/s 2024-09-16T12:38:15.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:38:14 smithi157 bash[24585]: cluster 2024-09-16T12:38:13.873016+0000 mgr.a (mgr.14373) 18207 : cluster [DBG] pgmap v12628: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 18 KiB/s rd, 0 B/s wr, 29 op/s 2024-09-16T12:38:15.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:38:14 smithi086 bash[24289]: cluster 2024-09-16T12:38:13.873016+0000 mgr.a (mgr.14373) 18207 : cluster [DBG] pgmap v12628: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 18 KiB/s rd, 0 B/s wr, 29 op/s 2024-09-16T12:38:15.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:38:14 smithi047 bash[22744]: cluster 2024-09-16T12:38:13.873016+0000 mgr.a (mgr.14373) 18207 : cluster [DBG] pgmap v12628: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 18 KiB/s rd, 0 B/s wr, 29 op/s 2024-09-16T12:38:16.741 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:38:16.742 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:38:16.742 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:38:17.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:38:16 smithi157 bash[24585]: cluster 2024-09-16T12:38:15.873978+0000 mgr.a (mgr.14373) 18208 : cluster [DBG] pgmap v12629: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 18 KiB/s rd, 0 B/s wr, 29 op/s 2024-09-16T12:38:17.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:38:16 smithi086 bash[24289]: cluster 2024-09-16T12:38:15.873978+0000 mgr.a (mgr.14373) 18208 : cluster [DBG] pgmap v12629: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 18 KiB/s rd, 0 B/s wr, 29 op/s 2024-09-16T12:38:17.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:38:16 smithi047 bash[22744]: cluster 2024-09-16T12:38:15.873978+0000 mgr.a (mgr.14373) 18208 : cluster [DBG] pgmap v12629: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 18 KiB/s rd, 0 B/s wr, 29 op/s 2024-09-16T12:38:17.505 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:38:17.505 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:38:17.505 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:38:17.505 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:38:17.505 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:38:18.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:38:17 smithi157 bash[24585]: audit 2024-09-16T12:38:17.074143+0000 mgr.a (mgr.14373) 18209 : audit [DBG] from='client.390795 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:38:18.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:38:17 smithi086 bash[24289]: audit 2024-09-16T12:38:17.074143+0000 mgr.a (mgr.14373) 18209 : audit [DBG] from='client.390795 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:38:18.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:38:17 smithi047 bash[22744]: audit 2024-09-16T12:38:17.074143+0000 mgr.a (mgr.14373) 18209 : audit [DBG] from='client.390795 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:38:19.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:38:18 smithi157 bash[24585]: cluster 2024-09-16T12:38:17.876837+0000 mgr.a (mgr.14373) 18210 : cluster [DBG] pgmap v12630: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 19 KiB/s rd, 0 B/s wr, 30 op/s 2024-09-16T12:38:19.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:38:18 smithi086 bash[24289]: cluster 2024-09-16T12:38:17.876837+0000 mgr.a (mgr.14373) 18210 : cluster [DBG] pgmap v12630: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 19 KiB/s rd, 0 B/s wr, 30 op/s 2024-09-16T12:38:19.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:38:18 smithi047 bash[22744]: cluster 2024-09-16T12:38:17.876837+0000 mgr.a (mgr.14373) 18210 : cluster [DBG] pgmap v12630: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 19 KiB/s rd, 0 B/s wr, 30 op/s 2024-09-16T12:38:21.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:38:20 smithi157 bash[24585]: cluster 2024-09-16T12:38:19.877646+0000 mgr.a (mgr.14373) 18211 : cluster [DBG] pgmap v12631: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 4.9 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-16T12:38:21.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:38:20 smithi086 bash[24289]: cluster 2024-09-16T12:38:19.877646+0000 mgr.a (mgr.14373) 18211 : cluster [DBG] pgmap v12631: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 4.9 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-16T12:38:21.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:38:20 smithi047 bash[22744]: cluster 2024-09-16T12:38:19.877646+0000 mgr.a (mgr.14373) 18211 : cluster [DBG] pgmap v12631: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 4.9 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-16T12:38:22.506 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:38:22.507 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:38:22.507 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:38:23.275 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:38:23.275 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:38:23.275 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:38:23.276 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:38:23.276 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:38:23.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:38:22 smithi157 bash[24585]: cluster 2024-09-16T12:38:21.879621+0000 mgr.a (mgr.14373) 18212 : cluster [DBG] pgmap v12632: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-16T12:38:23.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:38:22 smithi086 bash[24289]: cluster 2024-09-16T12:38:21.879621+0000 mgr.a (mgr.14373) 18212 : cluster [DBG] pgmap v12632: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-16T12:38:23.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:38:22 smithi047 bash[22744]: cluster 2024-09-16T12:38:21.879621+0000 mgr.a (mgr.14373) 18212 : cluster [DBG] pgmap v12632: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-16T12:38:24.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:38:23 smithi157 bash[24585]: audit 2024-09-16T12:38:22.836238+0000 mgr.a (mgr.14373) 18213 : audit [DBG] from='client.390873 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:38:24.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:38:23 smithi086 bash[24289]: audit 2024-09-16T12:38:22.836238+0000 mgr.a (mgr.14373) 18213 : audit [DBG] from='client.390873 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:38:24.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:38:23 smithi047 bash[22744]: audit 2024-09-16T12:38:22.836238+0000 mgr.a (mgr.14373) 18213 : audit [DBG] from='client.390873 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:38:25.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:38:25 smithi157 bash[24585]: cluster 2024-09-16T12:38:23.880606+0000 mgr.a (mgr.14373) 18214 : cluster [DBG] pgmap v12633: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:38:25.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:38:25 smithi086 bash[24289]: cluster 2024-09-16T12:38:23.880606+0000 mgr.a (mgr.14373) 18214 : cluster [DBG] pgmap v12633: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:38:25.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:38:25 smithi047 bash[22744]: cluster 2024-09-16T12:38:23.880606+0000 mgr.a (mgr.14373) 18214 : cluster [DBG] pgmap v12633: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:38:27.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:38:27 smithi157 bash[24585]: cluster 2024-09-16T12:38:25.881406+0000 mgr.a (mgr.14373) 18215 : cluster [DBG] pgmap v12634: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:38:27.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:38:27 smithi086 bash[24289]: cluster 2024-09-16T12:38:25.881406+0000 mgr.a (mgr.14373) 18215 : cluster [DBG] pgmap v12634: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:38:27.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:38:27 smithi047 bash[22744]: cluster 2024-09-16T12:38:25.881406+0000 mgr.a (mgr.14373) 18215 : cluster [DBG] pgmap v12634: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:38:28.277 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:38:28.277 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:38:28.277 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:38:28.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:38:28 smithi047 bash[22744]: cluster 2024-09-16T12:38:27.883719+0000 mgr.a (mgr.14373) 18216 : cluster [DBG] pgmap v12635: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:38:28.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:38:28 smithi157 bash[24585]: cluster 2024-09-16T12:38:27.883719+0000 mgr.a (mgr.14373) 18216 : cluster [DBG] pgmap v12635: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:38:28.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:38:28 smithi086 bash[24289]: cluster 2024-09-16T12:38:27.883719+0000 mgr.a (mgr.14373) 18216 : cluster [DBG] pgmap v12635: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:38:29.063 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:38:29.064 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:38:29.064 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:38:29.064 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:38:29.064 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:38:29.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:38:29 smithi047 bash[22744]: audit 2024-09-16T12:38:28.610767+0000 mgr.a (mgr.14373) 18217 : audit [DBG] from='client.390951 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:38:29.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:38:29 smithi157 bash[24585]: audit 2024-09-16T12:38:28.610767+0000 mgr.a (mgr.14373) 18217 : audit [DBG] from='client.390951 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:38:29.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:38:29 smithi086 bash[24289]: audit 2024-09-16T12:38:28.610767+0000 mgr.a (mgr.14373) 18217 : audit [DBG] from='client.390951 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:38:30.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:38:30 smithi047 bash[22744]: cluster 2024-09-16T12:38:29.884718+0000 mgr.a (mgr.14373) 18218 : cluster [DBG] pgmap v12636: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:38:30.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:38:30 smithi157 bash[24585]: cluster 2024-09-16T12:38:29.884718+0000 mgr.a (mgr.14373) 18218 : cluster [DBG] pgmap v12636: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:38:30.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:38:30 smithi086 bash[24289]: cluster 2024-09-16T12:38:29.884718+0000 mgr.a (mgr.14373) 18218 : cluster [DBG] pgmap v12636: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:38:33.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:38:32 smithi157 bash[24585]: cluster 2024-09-16T12:38:31.886925+0000 mgr.a (mgr.14373) 18219 : cluster [DBG] pgmap v12637: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:38:33.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:38:32 smithi086 bash[24289]: cluster 2024-09-16T12:38:31.886925+0000 mgr.a (mgr.14373) 18219 : cluster [DBG] pgmap v12637: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:38:33.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:38:32 smithi047 bash[22744]: cluster 2024-09-16T12:38:31.886925+0000 mgr.a (mgr.14373) 18219 : cluster [DBG] pgmap v12637: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:38:34.065 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:38:34.066 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:38:34.066 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:38:34.856 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:38:34.856 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:38:34.856 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:38:34.856 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:38:34.856 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:38:35.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:38:34 smithi157 bash[24585]: cluster 2024-09-16T12:38:33.887725+0000 mgr.a (mgr.14373) 18220 : cluster [DBG] pgmap v12638: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:38:35.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:38:34 smithi086 bash[24289]: cluster 2024-09-16T12:38:33.887725+0000 mgr.a (mgr.14373) 18220 : cluster [DBG] pgmap v12638: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:38:35.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:38:34 smithi047 bash[22744]: cluster 2024-09-16T12:38:33.887725+0000 mgr.a (mgr.14373) 18220 : cluster [DBG] pgmap v12638: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:38:36.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:38:35 smithi157 bash[24585]: audit 2024-09-16T12:38:34.404248+0000 mgr.a (mgr.14373) 18221 : audit [DBG] from='client.391029 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:38:36.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:38:35 smithi086 bash[24289]: audit 2024-09-16T12:38:34.404248+0000 mgr.a (mgr.14373) 18221 : audit [DBG] from='client.391029 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:38:36.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:38:35 smithi047 bash[22744]: audit 2024-09-16T12:38:34.404248+0000 mgr.a (mgr.14373) 18221 : audit [DBG] from='client.391029 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:38:37.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:38:36 smithi157 bash[24585]: cluster 2024-09-16T12:38:35.888723+0000 mgr.a (mgr.14373) 18222 : cluster [DBG] pgmap v12639: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:38:37.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:38:36 smithi086 bash[24289]: cluster 2024-09-16T12:38:35.888723+0000 mgr.a (mgr.14373) 18222 : cluster [DBG] pgmap v12639: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:38:37.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:38:36 smithi047 bash[22744]: cluster 2024-09-16T12:38:35.888723+0000 mgr.a (mgr.14373) 18222 : cluster [DBG] pgmap v12639: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:38:39.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:38:38 smithi157 bash[24585]: cluster 2024-09-16T12:38:37.891382+0000 mgr.a (mgr.14373) 18223 : cluster [DBG] pgmap v12640: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:38:39.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:38:38 smithi086 bash[24289]: cluster 2024-09-16T12:38:37.891382+0000 mgr.a (mgr.14373) 18223 : cluster [DBG] pgmap v12640: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:38:39.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:38:38 smithi047 bash[22744]: cluster 2024-09-16T12:38:37.891382+0000 mgr.a (mgr.14373) 18223 : cluster [DBG] pgmap v12640: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:38:39.857 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:38:39.858 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:38:39.858 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:38:40.650 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:38:40.650 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:38:40.650 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:38:40.650 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:38:40.651 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:38:41.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:38:40 smithi157 bash[24585]: cluster 2024-09-16T12:38:39.892341+0000 mgr.a (mgr.14373) 18224 : cluster [DBG] pgmap v12641: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:38:41.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:38:40 smithi157 bash[24585]: audit 2024-09-16T12:38:40.198991+0000 mgr.a (mgr.14373) 18225 : audit [DBG] from='client.391107 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:38:41.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:38:40 smithi086 bash[24289]: cluster 2024-09-16T12:38:39.892341+0000 mgr.a (mgr.14373) 18224 : cluster [DBG] pgmap v12641: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:38:41.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:38:40 smithi086 bash[24289]: audit 2024-09-16T12:38:40.198991+0000 mgr.a (mgr.14373) 18225 : audit [DBG] from='client.391107 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:38:41.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:38:40 smithi047 bash[22744]: cluster 2024-09-16T12:38:39.892341+0000 mgr.a (mgr.14373) 18224 : cluster [DBG] pgmap v12641: 225 pgs: 225 active+clean; 589 KiB data, 249 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:38:41.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:38:40 smithi047 bash[22744]: audit 2024-09-16T12:38:40.198991+0000 mgr.a (mgr.14373) 18225 : audit [DBG] from='client.391107 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:38:43.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:38:42 smithi157 bash[24585]: cluster 2024-09-16T12:38:41.894922+0000 mgr.a (mgr.14373) 18226 : cluster [DBG] pgmap v12642: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 66 KiB/s rd, 0 B/s wr, 108 op/s 2024-09-16T12:38:43.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:38:42 smithi157 bash[24585]: audit 2024-09-16T12:38:42.513770+0000 mon.b (mon.2) 1650 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T12:38:43.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:38:42 smithi086 bash[24289]: cluster 2024-09-16T12:38:41.894922+0000 mgr.a (mgr.14373) 18226 : cluster [DBG] pgmap v12642: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 66 KiB/s rd, 0 B/s wr, 108 op/s 2024-09-16T12:38:43.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:38:42 smithi086 bash[24289]: audit 2024-09-16T12:38:42.513770+0000 mon.b (mon.2) 1650 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T12:38:43.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:38:42 smithi047 bash[22744]: cluster 2024-09-16T12:38:41.894922+0000 mgr.a (mgr.14373) 18226 : cluster [DBG] pgmap v12642: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 66 KiB/s rd, 0 B/s wr, 108 op/s 2024-09-16T12:38:43.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:38:42 smithi047 bash[22744]: audit 2024-09-16T12:38:42.513770+0000 mon.b (mon.2) 1650 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T12:38:44.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:38:43 smithi157 bash[24585]: audit 2024-09-16T12:38:43.360853+0000 mon.b (mon.2) 1651 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T12:38:44.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:38:43 smithi157 bash[24585]: audit 2024-09-16T12:38:43.362952+0000 mon.b (mon.2) 1652 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T12:38:44.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:38:43 smithi157 bash[24585]: audit 2024-09-16T12:38:43.372295+0000 mon.a (mon.0) 1650 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:38:44.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:38:43 smithi157 bash[24585]: audit 2024-09-16T12:38:43.380332+0000 mon.b (mon.2) 1653 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:38:44.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:38:43 smithi086 bash[24289]: audit 2024-09-16T12:38:43.360853+0000 mon.b (mon.2) 1651 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T12:38:44.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:38:43 smithi086 bash[24289]: audit 2024-09-16T12:38:43.362952+0000 mon.b (mon.2) 1652 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T12:38:44.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:38:43 smithi086 bash[24289]: audit 2024-09-16T12:38:43.372295+0000 mon.a (mon.0) 1650 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:38:44.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:38:43 smithi086 bash[24289]: audit 2024-09-16T12:38:43.380332+0000 mon.b (mon.2) 1653 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:38:44.343 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 12:38:44 smithi047 bash[22994]: debug 2024-09-16T12:38:44.139+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T12:38:44.343 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 12:38:44 smithi047 bash[22994]: debug 2024-09-16T12:38:44.143+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T12:38:44.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:38:43 smithi047 bash[22744]: audit 2024-09-16T12:38:43.360853+0000 mon.b (mon.2) 1651 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T12:38:44.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:38:43 smithi047 bash[22744]: audit 2024-09-16T12:38:43.362952+0000 mon.b (mon.2) 1652 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T12:38:44.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:38:43 smithi047 bash[22744]: audit 2024-09-16T12:38:43.372295+0000 mon.a (mon.0) 1650 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:38:44.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:38:43 smithi047 bash[22744]: audit 2024-09-16T12:38:43.380332+0000 mon.b (mon.2) 1653 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:38:45.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:38:44 smithi157 bash[24585]: audit 2024-09-16T12:38:43.382655+0000 mgr.a (mgr.14373) 18227 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:38:45.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:38:44 smithi157 bash[24585]: cluster 2024-09-16T12:38:43.895437+0000 mgr.a (mgr.14373) 18228 : cluster [DBG] pgmap v12643: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 65 KiB/s rd, 0 B/s wr, 107 op/s 2024-09-16T12:38:45.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:38:44 smithi157 bash[24585]: audit 2024-09-16T12:38:44.145385+0000 mgr.a (mgr.14373) 18229 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T12:38:45.308 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:38:44 smithi157 bash[24585]: cephadm 2024-09-16T12:38:44.147374+0000 mgr.a (mgr.14373) 18230 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T12:38:45.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:38:44 smithi086 bash[24289]: audit 2024-09-16T12:38:43.382655+0000 mgr.a (mgr.14373) 18227 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:38:45.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:38:44 smithi086 bash[24289]: cluster 2024-09-16T12:38:43.895437+0000 mgr.a (mgr.14373) 18228 : cluster [DBG] pgmap v12643: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 65 KiB/s rd, 0 B/s wr, 107 op/s 2024-09-16T12:38:45.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:38:44 smithi086 bash[24289]: audit 2024-09-16T12:38:44.145385+0000 mgr.a (mgr.14373) 18229 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T12:38:45.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:38:44 smithi086 bash[24289]: cephadm 2024-09-16T12:38:44.147374+0000 mgr.a (mgr.14373) 18230 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T12:38:45.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:38:44 smithi047 bash[22744]: audit 2024-09-16T12:38:43.382655+0000 mgr.a (mgr.14373) 18227 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:38:45.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:38:44 smithi047 bash[22744]: cluster 2024-09-16T12:38:43.895437+0000 mgr.a (mgr.14373) 18228 : cluster [DBG] pgmap v12643: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 65 KiB/s rd, 0 B/s wr, 107 op/s 2024-09-16T12:38:45.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:38:44 smithi047 bash[22744]: audit 2024-09-16T12:38:44.145385+0000 mgr.a (mgr.14373) 18229 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T12:38:45.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:38:44 smithi047 bash[22744]: cephadm 2024-09-16T12:38:44.147374+0000 mgr.a (mgr.14373) 18230 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T12:38:45.652 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:38:45.653 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:38:45.653 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:38:46.436 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:38:46.436 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:38:46.436 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:38:46.437 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:38:46.437 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:38:47.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:38:46 smithi157 bash[24585]: cluster 2024-09-16T12:38:45.896426+0000 mgr.a (mgr.14373) 18231 : cluster [DBG] pgmap v12644: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 65 KiB/s rd, 0 B/s wr, 107 op/s 2024-09-16T12:38:47.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:38:46 smithi157 bash[24585]: audit 2024-09-16T12:38:45.987673+0000 mgr.a (mgr.14373) 18232 : audit [DBG] from='client.391287 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:38:47.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:38:46 smithi086 bash[24289]: cluster 2024-09-16T12:38:45.896426+0000 mgr.a (mgr.14373) 18231 : cluster [DBG] pgmap v12644: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 65 KiB/s rd, 0 B/s wr, 107 op/s 2024-09-16T12:38:47.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:38:46 smithi086 bash[24289]: audit 2024-09-16T12:38:45.987673+0000 mgr.a (mgr.14373) 18232 : audit [DBG] from='client.391287 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:38:47.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:38:46 smithi047 bash[22744]: cluster 2024-09-16T12:38:45.896426+0000 mgr.a (mgr.14373) 18231 : cluster [DBG] pgmap v12644: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 65 KiB/s rd, 0 B/s wr, 107 op/s 2024-09-16T12:38:47.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:38:46 smithi047 bash[22744]: audit 2024-09-16T12:38:45.987673+0000 mgr.a (mgr.14373) 18232 : audit [DBG] from='client.391287 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:38:49.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:38:48 smithi157 bash[24585]: cluster 2024-09-16T12:38:47.898902+0000 mgr.a (mgr.14373) 18233 : cluster [DBG] pgmap v12645: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 71 KiB/s rd, 426 B/s wr, 113 op/s 2024-09-16T12:38:49.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:38:48 smithi086 bash[24289]: cluster 2024-09-16T12:38:47.898902+0000 mgr.a (mgr.14373) 18233 : cluster [DBG] pgmap v12645: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 71 KiB/s rd, 426 B/s wr, 113 op/s 2024-09-16T12:38:49.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:38:48 smithi047 bash[22744]: cluster 2024-09-16T12:38:47.898902+0000 mgr.a (mgr.14373) 18233 : cluster [DBG] pgmap v12645: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 71 KiB/s rd, 426 B/s wr, 113 op/s 2024-09-16T12:38:51.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:38:50 smithi157 bash[24585]: cluster 2024-09-16T12:38:49.899687+0000 mgr.a (mgr.14373) 18234 : cluster [DBG] pgmap v12646: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 70 KiB/s rd, 426 B/s wr, 112 op/s 2024-09-16T12:38:51.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:38:50 smithi086 bash[24289]: cluster 2024-09-16T12:38:49.899687+0000 mgr.a (mgr.14373) 18234 : cluster [DBG] pgmap v12646: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 70 KiB/s rd, 426 B/s wr, 112 op/s 2024-09-16T12:38:51.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:38:50 smithi047 bash[22744]: cluster 2024-09-16T12:38:49.899687+0000 mgr.a (mgr.14373) 18234 : cluster [DBG] pgmap v12646: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 70 KiB/s rd, 426 B/s wr, 112 op/s 2024-09-16T12:38:51.437 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:38:51.438 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:38:51.438 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:38:52.232 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:38:52.233 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:38:52.233 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:38:52.233 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:38:52.233 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:38:53.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:38:52 smithi157 bash[24585]: audit 2024-09-16T12:38:51.775300+0000 mgr.a (mgr.14373) 18235 : audit [DBG] from='client.391362 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:38:53.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:38:52 smithi157 bash[24585]: cluster 2024-09-16T12:38:51.901095+0000 mgr.a (mgr.14373) 18236 : cluster [DBG] pgmap v12647: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 70 KiB/s rd, 426 B/s wr, 112 op/s 2024-09-16T12:38:53.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:38:52 smithi086 bash[24289]: audit 2024-09-16T12:38:51.775300+0000 mgr.a (mgr.14373) 18235 : audit [DBG] from='client.391362 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:38:53.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:38:52 smithi086 bash[24289]: cluster 2024-09-16T12:38:51.901095+0000 mgr.a (mgr.14373) 18236 : cluster [DBG] pgmap v12647: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 70 KiB/s rd, 426 B/s wr, 112 op/s 2024-09-16T12:38:53.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:38:52 smithi047 bash[22744]: audit 2024-09-16T12:38:51.775300+0000 mgr.a (mgr.14373) 18235 : audit [DBG] from='client.391362 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:38:53.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:38:52 smithi047 bash[22744]: cluster 2024-09-16T12:38:51.901095+0000 mgr.a (mgr.14373) 18236 : cluster [DBG] pgmap v12647: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 70 KiB/s rd, 426 B/s wr, 112 op/s 2024-09-16T12:38:55.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:38:55 smithi157 bash[24585]: cluster 2024-09-16T12:38:53.902095+0000 mgr.a (mgr.14373) 18237 : cluster [DBG] pgmap v12648: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T12:38:55.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:38:55 smithi086 bash[24289]: cluster 2024-09-16T12:38:53.902095+0000 mgr.a (mgr.14373) 18237 : cluster [DBG] pgmap v12648: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T12:38:55.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:38:54 smithi047 bash[22744]: cluster 2024-09-16T12:38:53.902095+0000 mgr.a (mgr.14373) 18237 : cluster [DBG] pgmap v12648: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T12:38:57.234 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:38:57.234 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:38:57.235 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:38:57.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:38:57 smithi157 bash[24585]: cluster 2024-09-16T12:38:55.903084+0000 mgr.a (mgr.14373) 18238 : cluster [DBG] pgmap v12649: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T12:38:57.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:38:57 smithi086 bash[24289]: cluster 2024-09-16T12:38:55.903084+0000 mgr.a (mgr.14373) 18238 : cluster [DBG] pgmap v12649: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T12:38:57.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:38:57 smithi047 bash[22744]: cluster 2024-09-16T12:38:55.903084+0000 mgr.a (mgr.14373) 18238 : cluster [DBG] pgmap v12649: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T12:38:57.988 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:38:57.988 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:38:57.988 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:38:57.988 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:38:57.988 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:38:58.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:38:58 smithi047 bash[22744]: audit 2024-09-16T12:38:57.560959+0000 mgr.a (mgr.14373) 18239 : audit [DBG] from='client.391437 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:38:58.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:38:58 smithi047 bash[22744]: cluster 2024-09-16T12:38:57.904384+0000 mgr.a (mgr.14373) 18240 : cluster [DBG] pgmap v12650: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:38:58.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:38:58 smithi157 bash[24585]: audit 2024-09-16T12:38:57.560959+0000 mgr.a (mgr.14373) 18239 : audit [DBG] from='client.391437 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:38:58.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:38:58 smithi157 bash[24585]: cluster 2024-09-16T12:38:57.904384+0000 mgr.a (mgr.14373) 18240 : cluster [DBG] pgmap v12650: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:38:58.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:38:58 smithi086 bash[24289]: audit 2024-09-16T12:38:57.560959+0000 mgr.a (mgr.14373) 18239 : audit [DBG] from='client.391437 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:38:58.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:38:58 smithi086 bash[24289]: cluster 2024-09-16T12:38:57.904384+0000 mgr.a (mgr.14373) 18240 : cluster [DBG] pgmap v12650: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:39:01.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:39:00 smithi157 bash[24585]: cluster 2024-09-16T12:38:59.905098+0000 mgr.a (mgr.14373) 18241 : cluster [DBG] pgmap v12651: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-16T12:39:01.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:39:00 smithi086 bash[24289]: cluster 2024-09-16T12:38:59.905098+0000 mgr.a (mgr.14373) 18241 : cluster [DBG] pgmap v12651: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-16T12:39:01.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:39:00 smithi047 bash[22744]: cluster 2024-09-16T12:38:59.905098+0000 mgr.a (mgr.14373) 18241 : cluster [DBG] pgmap v12651: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-16T12:39:02.989 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:39:02.990 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:39:02.990 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:39:03.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:39:02 smithi157 bash[24585]: cluster 2024-09-16T12:39:01.907086+0000 mgr.a (mgr.14373) 18242 : cluster [DBG] pgmap v12652: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-16T12:39:03.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:39:02 smithi086 bash[24289]: cluster 2024-09-16T12:39:01.907086+0000 mgr.a (mgr.14373) 18242 : cluster [DBG] pgmap v12652: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-16T12:39:03.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:39:02 smithi047 bash[22744]: cluster 2024-09-16T12:39:01.907086+0000 mgr.a (mgr.14373) 18242 : cluster [DBG] pgmap v12652: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-16T12:39:03.776 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:39:03.777 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:39:03.777 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:39:03.777 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:39:03.777 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:39:05.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:39:04 smithi157 bash[24585]: audit 2024-09-16T12:39:03.326381+0000 mgr.a (mgr.14373) 18243 : audit [DBG] from='client.391515 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:39:05.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:39:04 smithi157 bash[24585]: cluster 2024-09-16T12:39:03.908112+0000 mgr.a (mgr.14373) 18244 : cluster [DBG] pgmap v12653: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:39:05.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:39:04 smithi086 bash[24289]: audit 2024-09-16T12:39:03.326381+0000 mgr.a (mgr.14373) 18243 : audit [DBG] from='client.391515 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:39:05.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:39:04 smithi086 bash[24289]: cluster 2024-09-16T12:39:03.908112+0000 mgr.a (mgr.14373) 18244 : cluster [DBG] pgmap v12653: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:39:05.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:39:04 smithi047 bash[22744]: audit 2024-09-16T12:39:03.326381+0000 mgr.a (mgr.14373) 18243 : audit [DBG] from='client.391515 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:39:05.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:39:04 smithi047 bash[22744]: cluster 2024-09-16T12:39:03.908112+0000 mgr.a (mgr.14373) 18244 : cluster [DBG] pgmap v12653: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:39:07.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:39:06 smithi157 bash[24585]: cluster 2024-09-16T12:39:05.908916+0000 mgr.a (mgr.14373) 18245 : cluster [DBG] pgmap v12654: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:39:07.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:39:06 smithi086 bash[24289]: cluster 2024-09-16T12:39:05.908916+0000 mgr.a (mgr.14373) 18245 : cluster [DBG] pgmap v12654: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:39:07.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:39:06 smithi047 bash[22744]: cluster 2024-09-16T12:39:05.908916+0000 mgr.a (mgr.14373) 18245 : cluster [DBG] pgmap v12654: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:39:08.778 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:39:08.779 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:39:08.779 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:39:09.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:39:08 smithi157 bash[24585]: cluster 2024-09-16T12:39:07.911214+0000 mgr.a (mgr.14373) 18246 : cluster [DBG] pgmap v12655: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:39:09.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:39:08 smithi086 bash[24289]: cluster 2024-09-16T12:39:07.911214+0000 mgr.a (mgr.14373) 18246 : cluster [DBG] pgmap v12655: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:39:09.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:39:08 smithi047 bash[22744]: cluster 2024-09-16T12:39:07.911214+0000 mgr.a (mgr.14373) 18246 : cluster [DBG] pgmap v12655: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:39:09.560 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:39:09.560 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:39:09.560 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:39:09.561 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:39:09.561 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:39:10.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:39:09 smithi157 bash[24585]: audit 2024-09-16T12:39:09.111520+0000 mgr.a (mgr.14373) 18247 : audit [DBG] from='client.391590 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:39:10.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:39:09 smithi086 bash[24289]: audit 2024-09-16T12:39:09.111520+0000 mgr.a (mgr.14373) 18247 : audit [DBG] from='client.391590 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:39:10.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:39:09 smithi047 bash[22744]: audit 2024-09-16T12:39:09.111520+0000 mgr.a (mgr.14373) 18247 : audit [DBG] from='client.391590 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:39:11.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:39:10 smithi157 bash[24585]: cluster 2024-09-16T12:39:09.912380+0000 mgr.a (mgr.14373) 18248 : cluster [DBG] pgmap v12656: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:39:11.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:39:10 smithi086 bash[24289]: cluster 2024-09-16T12:39:09.912380+0000 mgr.a (mgr.14373) 18248 : cluster [DBG] pgmap v12656: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:39:11.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:39:10 smithi047 bash[22744]: cluster 2024-09-16T12:39:09.912380+0000 mgr.a (mgr.14373) 18248 : cluster [DBG] pgmap v12656: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:39:13.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:39:12 smithi157 bash[24585]: cluster 2024-09-16T12:39:11.914747+0000 mgr.a (mgr.14373) 18249 : cluster [DBG] pgmap v12657: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:39:13.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:39:12 smithi086 bash[24289]: cluster 2024-09-16T12:39:11.914747+0000 mgr.a (mgr.14373) 18249 : cluster [DBG] pgmap v12657: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:39:13.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:39:12 smithi047 bash[22744]: cluster 2024-09-16T12:39:11.914747+0000 mgr.a (mgr.14373) 18249 : cluster [DBG] pgmap v12657: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:39:14.561 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:39:14.562 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:39:14.562 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:39:15.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:39:15 smithi157 bash[24585]: cluster 2024-09-16T12:39:13.915547+0000 mgr.a (mgr.14373) 18250 : cluster [DBG] pgmap v12658: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:39:15.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:39:15 smithi086 bash[24289]: cluster 2024-09-16T12:39:13.915547+0000 mgr.a (mgr.14373) 18250 : cluster [DBG] pgmap v12658: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:39:15.337 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:39:15.337 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:39:15.338 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:39:15.338 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:39:15.338 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:39:15.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:39:15 smithi047 bash[22744]: cluster 2024-09-16T12:39:13.915547+0000 mgr.a (mgr.14373) 18250 : cluster [DBG] pgmap v12658: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:39:16.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:39:16 smithi157 bash[24585]: audit 2024-09-16T12:39:14.893432+0000 mgr.a (mgr.14373) 18251 : audit [DBG] from='client.391668 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:39:16.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:39:16 smithi086 bash[24289]: audit 2024-09-16T12:39:14.893432+0000 mgr.a (mgr.14373) 18251 : audit [DBG] from='client.391668 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:39:16.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:39:16 smithi047 bash[22744]: audit 2024-09-16T12:39:14.893432+0000 mgr.a (mgr.14373) 18251 : audit [DBG] from='client.391668 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:39:17.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:39:17 smithi157 bash[24585]: cluster 2024-09-16T12:39:15.916490+0000 mgr.a (mgr.14373) 18252 : cluster [DBG] pgmap v12659: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:39:17.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:39:17 smithi086 bash[24289]: cluster 2024-09-16T12:39:15.916490+0000 mgr.a (mgr.14373) 18252 : cluster [DBG] pgmap v12659: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:39:17.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:39:17 smithi047 bash[22744]: cluster 2024-09-16T12:39:15.916490+0000 mgr.a (mgr.14373) 18252 : cluster [DBG] pgmap v12659: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:39:19.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:39:19 smithi157 bash[24585]: cluster 2024-09-16T12:39:17.918760+0000 mgr.a (mgr.14373) 18253 : cluster [DBG] pgmap v12660: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:39:19.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:39:19 smithi086 bash[24289]: cluster 2024-09-16T12:39:17.918760+0000 mgr.a (mgr.14373) 18253 : cluster [DBG] pgmap v12660: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:39:19.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:39:19 smithi047 bash[22744]: cluster 2024-09-16T12:39:17.918760+0000 mgr.a (mgr.14373) 18253 : cluster [DBG] pgmap v12660: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:39:20.339 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:39:20.340 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:39:20.340 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:39:21.117 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:39:21.117 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:39:21.117 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:39:21.117 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:39:21.117 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:39:21.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:39:21 smithi157 bash[24585]: cluster 2024-09-16T12:39:19.919528+0000 mgr.a (mgr.14373) 18254 : cluster [DBG] pgmap v12661: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:39:21.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:39:21 smithi086 bash[24289]: cluster 2024-09-16T12:39:19.919528+0000 mgr.a (mgr.14373) 18254 : cluster [DBG] pgmap v12661: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:39:21.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:39:21 smithi047 bash[22744]: cluster 2024-09-16T12:39:19.919528+0000 mgr.a (mgr.14373) 18254 : cluster [DBG] pgmap v12661: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:39:22.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:39:22 smithi157 bash[24585]: audit 2024-09-16T12:39:20.673428+0000 mgr.a (mgr.14373) 18255 : audit [DBG] from='client.391746 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:39:22.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:39:22 smithi086 bash[24289]: audit 2024-09-16T12:39:20.673428+0000 mgr.a (mgr.14373) 18255 : audit [DBG] from='client.391746 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:39:22.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:39:22 smithi047 bash[22744]: audit 2024-09-16T12:39:20.673428+0000 mgr.a (mgr.14373) 18255 : audit [DBG] from='client.391746 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:39:23.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:39:23 smithi157 bash[24585]: cluster 2024-09-16T12:39:21.921779+0000 mgr.a (mgr.14373) 18256 : cluster [DBG] pgmap v12662: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:39:23.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:39:23 smithi086 bash[24289]: cluster 2024-09-16T12:39:21.921779+0000 mgr.a (mgr.14373) 18256 : cluster [DBG] pgmap v12662: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:39:23.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:39:23 smithi047 bash[22744]: cluster 2024-09-16T12:39:21.921779+0000 mgr.a (mgr.14373) 18256 : cluster [DBG] pgmap v12662: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:39:25.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:39:25 smithi157 bash[24585]: cluster 2024-09-16T12:39:23.922554+0000 mgr.a (mgr.14373) 18257 : cluster [DBG] pgmap v12663: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:39:25.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:39:25 smithi086 bash[24289]: cluster 2024-09-16T12:39:23.922554+0000 mgr.a (mgr.14373) 18257 : cluster [DBG] pgmap v12663: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:39:25.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:39:25 smithi047 bash[22744]: cluster 2024-09-16T12:39:23.922554+0000 mgr.a (mgr.14373) 18257 : cluster [DBG] pgmap v12663: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:39:26.118 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:39:26.119 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:39:26.119 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:39:26.858 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:39:26.858 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:39:26.858 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:39:26.858 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:39:26.858 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:39:27.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:39:27 smithi157 bash[24585]: cluster 2024-09-16T12:39:25.923304+0000 mgr.a (mgr.14373) 18258 : cluster [DBG] pgmap v12664: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:39:27.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:39:27 smithi086 bash[24289]: cluster 2024-09-16T12:39:25.923304+0000 mgr.a (mgr.14373) 18258 : cluster [DBG] pgmap v12664: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:39:27.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:39:27 smithi047 bash[22744]: cluster 2024-09-16T12:39:25.923304+0000 mgr.a (mgr.14373) 18258 : cluster [DBG] pgmap v12664: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:39:28.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:39:28 smithi157 bash[24585]: audit 2024-09-16T12:39:26.440463+0000 mgr.a (mgr.14373) 18259 : audit [DBG] from='client.391824 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:39:28.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:39:28 smithi086 bash[24289]: audit 2024-09-16T12:39:26.440463+0000 mgr.a (mgr.14373) 18259 : audit [DBG] from='client.391824 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:39:28.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:39:28 smithi047 bash[22744]: audit 2024-09-16T12:39:26.440463+0000 mgr.a (mgr.14373) 18259 : audit [DBG] from='client.391824 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:39:29.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:39:29 smithi157 bash[24585]: cluster 2024-09-16T12:39:27.925980+0000 mgr.a (mgr.14373) 18260 : cluster [DBG] pgmap v12665: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:39:29.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:39:29 smithi086 bash[24289]: cluster 2024-09-16T12:39:27.925980+0000 mgr.a (mgr.14373) 18260 : cluster [DBG] pgmap v12665: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:39:29.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:39:29 smithi047 bash[22744]: cluster 2024-09-16T12:39:27.925980+0000 mgr.a (mgr.14373) 18260 : cluster [DBG] pgmap v12665: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:39:31.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:39:31 smithi157 bash[24585]: cluster 2024-09-16T12:39:29.926773+0000 mgr.a (mgr.14373) 18261 : cluster [DBG] pgmap v12666: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:39:31.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:39:31 smithi086 bash[24289]: cluster 2024-09-16T12:39:29.926773+0000 mgr.a (mgr.14373) 18261 : cluster [DBG] pgmap v12666: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:39:31.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:39:31 smithi047 bash[22744]: cluster 2024-09-16T12:39:29.926773+0000 mgr.a (mgr.14373) 18261 : cluster [DBG] pgmap v12666: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:39:31.859 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:39:31.860 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:39:31.860 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:39:32.632 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:39:32.632 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:39:32.633 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:39:32.633 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:39:32.633 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:39:33.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:39:33 smithi086 bash[24289]: cluster 2024-09-16T12:39:31.928715+0000 mgr.a (mgr.14373) 18262 : cluster [DBG] pgmap v12667: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:39:33.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:39:33 smithi086 bash[24289]: audit 2024-09-16T12:39:32.192151+0000 mgr.a (mgr.14373) 18263 : audit [DBG] from='client.391896 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:39:33.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:39:33 smithi047 bash[22744]: cluster 2024-09-16T12:39:31.928715+0000 mgr.a (mgr.14373) 18262 : cluster [DBG] pgmap v12667: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:39:33.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:39:33 smithi047 bash[22744]: audit 2024-09-16T12:39:32.192151+0000 mgr.a (mgr.14373) 18263 : audit [DBG] from='client.391896 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:39:33.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:39:33 smithi157 bash[24585]: cluster 2024-09-16T12:39:31.928715+0000 mgr.a (mgr.14373) 18262 : cluster [DBG] pgmap v12667: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:39:33.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:39:33 smithi157 bash[24585]: audit 2024-09-16T12:39:32.192151+0000 mgr.a (mgr.14373) 18263 : audit [DBG] from='client.391896 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:39:35.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:39:35 smithi086 bash[24289]: cluster 2024-09-16T12:39:33.929770+0000 mgr.a (mgr.14373) 18264 : cluster [DBG] pgmap v12668: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:39:35.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:39:35 smithi047 bash[22744]: cluster 2024-09-16T12:39:33.929770+0000 mgr.a (mgr.14373) 18264 : cluster [DBG] pgmap v12668: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:39:35.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:39:35 smithi157 bash[24585]: cluster 2024-09-16T12:39:33.929770+0000 mgr.a (mgr.14373) 18264 : cluster [DBG] pgmap v12668: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:39:37.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:39:37 smithi086 bash[24289]: cluster 2024-09-16T12:39:35.930761+0000 mgr.a (mgr.14373) 18265 : cluster [DBG] pgmap v12669: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T12:39:37.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:39:37 smithi047 bash[22744]: cluster 2024-09-16T12:39:35.930761+0000 mgr.a (mgr.14373) 18265 : cluster [DBG] pgmap v12669: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T12:39:37.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:39:37 smithi157 bash[24585]: cluster 2024-09-16T12:39:35.930761+0000 mgr.a (mgr.14373) 18265 : cluster [DBG] pgmap v12669: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T12:39:37.634 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:39:37.635 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:39:37.635 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:39:38.385 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:39:38.386 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:39:38.386 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:39:38.386 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:39:38.386 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:39:39.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:39:39 smithi047 bash[22744]: cluster 2024-09-16T12:39:37.933074+0000 mgr.a (mgr.14373) 18266 : cluster [DBG] pgmap v12670: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:39:39.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:39:39 smithi047 bash[22744]: audit 2024-09-16T12:39:37.964181+0000 mgr.a (mgr.14373) 18267 : audit [DBG] from='client.391971 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:39:39.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:39:39 smithi157 bash[24585]: cluster 2024-09-16T12:39:37.933074+0000 mgr.a (mgr.14373) 18266 : cluster [DBG] pgmap v12670: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:39:39.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:39:39 smithi157 bash[24585]: audit 2024-09-16T12:39:37.964181+0000 mgr.a (mgr.14373) 18267 : audit [DBG] from='client.391971 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:39:39.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:39:39 smithi086 bash[24289]: cluster 2024-09-16T12:39:37.933074+0000 mgr.a (mgr.14373) 18266 : cluster [DBG] pgmap v12670: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:39:39.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:39:39 smithi086 bash[24289]: audit 2024-09-16T12:39:37.964181+0000 mgr.a (mgr.14373) 18267 : audit [DBG] from='client.391971 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:39:41.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:39:41 smithi047 bash[22744]: cluster 2024-09-16T12:39:39.934008+0000 mgr.a (mgr.14373) 18268 : cluster [DBG] pgmap v12671: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:39:41.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:39:41 smithi157 bash[24585]: cluster 2024-09-16T12:39:39.934008+0000 mgr.a (mgr.14373) 18268 : cluster [DBG] pgmap v12671: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:39:41.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:39:41 smithi086 bash[24289]: cluster 2024-09-16T12:39:39.934008+0000 mgr.a (mgr.14373) 18268 : cluster [DBG] pgmap v12671: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:39:43.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:39:43 smithi047 bash[22744]: cluster 2024-09-16T12:39:41.936181+0000 mgr.a (mgr.14373) 18269 : cluster [DBG] pgmap v12672: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:39:43.387 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:39:43.388 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:39:43.388 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:39:43.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:39:43 smithi157 bash[24585]: cluster 2024-09-16T12:39:41.936181+0000 mgr.a (mgr.14373) 18269 : cluster [DBG] pgmap v12672: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:39:43.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:39:43 smithi086 bash[24289]: cluster 2024-09-16T12:39:41.936181+0000 mgr.a (mgr.14373) 18269 : cluster [DBG] pgmap v12672: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:39:44.139 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:39:44.139 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:39:44.139 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:39:44.139 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:39:44.139 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:39:45.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:39:45 smithi047 bash[22744]: audit 2024-09-16T12:39:43.717466+0000 mgr.a (mgr.14373) 18270 : audit [DBG] from='client.392046 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:39:45.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:39:45 smithi047 bash[22744]: cluster 2024-09-16T12:39:43.941880+0000 mgr.a (mgr.14373) 18271 : cluster [DBG] pgmap v12673: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:39:45.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:39:45 smithi047 bash[22744]: audit 2024-09-16T12:39:44.199692+0000 mon.b (mon.2) 1654 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T12:39:45.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:39:45 smithi157 bash[24585]: audit 2024-09-16T12:39:43.717466+0000 mgr.a (mgr.14373) 18270 : audit [DBG] from='client.392046 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:39:45.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:39:45 smithi157 bash[24585]: cluster 2024-09-16T12:39:43.941880+0000 mgr.a (mgr.14373) 18271 : cluster [DBG] pgmap v12673: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:39:45.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:39:45 smithi157 bash[24585]: audit 2024-09-16T12:39:44.199692+0000 mon.b (mon.2) 1654 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T12:39:45.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:39:45 smithi086 bash[24289]: audit 2024-09-16T12:39:43.717466+0000 mgr.a (mgr.14373) 18270 : audit [DBG] from='client.392046 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:39:45.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:39:45 smithi086 bash[24289]: cluster 2024-09-16T12:39:43.941880+0000 mgr.a (mgr.14373) 18271 : cluster [DBG] pgmap v12673: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:39:45.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:39:45 smithi086 bash[24289]: audit 2024-09-16T12:39:44.199692+0000 mon.b (mon.2) 1654 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T12:39:47.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:39:47 smithi047 bash[22744]: cluster 2024-09-16T12:39:45.942829+0000 mgr.a (mgr.14373) 18272 : cluster [DBG] pgmap v12674: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:39:47.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:39:47 smithi157 bash[24585]: cluster 2024-09-16T12:39:45.942829+0000 mgr.a (mgr.14373) 18272 : cluster [DBG] pgmap v12674: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:39:47.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:39:47 smithi086 bash[24289]: cluster 2024-09-16T12:39:45.942829+0000 mgr.a (mgr.14373) 18272 : cluster [DBG] pgmap v12674: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:39:49.140 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:39:49.141 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:39:49.141 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:39:49.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:39:49 smithi157 bash[24585]: cluster 2024-09-16T12:39:47.945098+0000 mgr.a (mgr.14373) 18273 : cluster [DBG] pgmap v12675: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:39:49.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:39:49 smithi086 bash[24289]: cluster 2024-09-16T12:39:47.945098+0000 mgr.a (mgr.14373) 18273 : cluster [DBG] pgmap v12675: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:39:49.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:39:49 smithi047 bash[22744]: cluster 2024-09-16T12:39:47.945098+0000 mgr.a (mgr.14373) 18273 : cluster [DBG] pgmap v12675: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:39:49.952 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:39:49.952 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:39:49.953 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:39:49.953 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:39:49.953 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:39:50.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:39:50 smithi157 bash[24585]: audit 2024-09-16T12:39:49.471248+0000 mon.a (mon.0) 1651 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:39:50.808 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:39:50 smithi157 bash[24585]: audit 2024-09-16T12:39:49.475769+0000 mon.a (mon.0) 1652 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:39:50.808 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:39:50 smithi157 bash[24585]: audit 2024-09-16T12:39:49.497913+0000 mon.a (mon.0) 1653 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:39:50.808 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:39:50 smithi157 bash[24585]: audit 2024-09-16T12:39:49.502862+0000 mon.a (mon.0) 1654 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:39:50.808 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:39:50 smithi157 bash[24585]: audit 2024-09-16T12:39:49.518941+0000 mon.a (mon.0) 1655 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:39:50.808 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:39:50 smithi157 bash[24585]: audit 2024-09-16T12:39:49.520198+0000 mgr.a (mgr.14373) 18274 : audit [DBG] from='client.392118 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:39:50.808 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:39:50 smithi157 bash[24585]: audit 2024-09-16T12:39:49.523991+0000 mon.a (mon.0) 1656 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:39:50.808 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:39:50 smithi157 bash[24585]: cluster 2024-09-16T12:39:49.945626+0000 mgr.a (mgr.14373) 18275 : cluster [DBG] pgmap v12676: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:39:50.808 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:39:50 smithi157 bash[24585]: audit 2024-09-16T12:39:50.290381+0000 mon.b (mon.2) 1655 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T12:39:50.808 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:39:50 smithi157 bash[24585]: audit 2024-09-16T12:39:50.292581+0000 mon.b (mon.2) 1656 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T12:39:50.808 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:39:50 smithi157 bash[24585]: audit 2024-09-16T12:39:50.304114+0000 mon.a (mon.0) 1657 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:39:50.809 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:39:50 smithi157 bash[24585]: audit 2024-09-16T12:39:50.309901+0000 mon.b (mon.2) 1657 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:39:50.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:39:50 smithi086 bash[24289]: audit 2024-09-16T12:39:49.471248+0000 mon.a (mon.0) 1651 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:39:50.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:39:50 smithi086 bash[24289]: audit 2024-09-16T12:39:49.475769+0000 mon.a (mon.0) 1652 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:39:50.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:39:50 smithi086 bash[24289]: audit 2024-09-16T12:39:49.497913+0000 mon.a (mon.0) 1653 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:39:50.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:39:50 smithi086 bash[24289]: audit 2024-09-16T12:39:49.502862+0000 mon.a (mon.0) 1654 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:39:50.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:39:50 smithi086 bash[24289]: audit 2024-09-16T12:39:49.518941+0000 mon.a (mon.0) 1655 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:39:50.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:39:50 smithi086 bash[24289]: audit 2024-09-16T12:39:49.520198+0000 mgr.a (mgr.14373) 18274 : audit [DBG] from='client.392118 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:39:50.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:39:50 smithi086 bash[24289]: audit 2024-09-16T12:39:49.523991+0000 mon.a (mon.0) 1656 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:39:50.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:39:50 smithi086 bash[24289]: cluster 2024-09-16T12:39:49.945626+0000 mgr.a (mgr.14373) 18275 : cluster [DBG] pgmap v12676: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:39:50.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:39:50 smithi086 bash[24289]: audit 2024-09-16T12:39:50.290381+0000 mon.b (mon.2) 1655 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T12:39:50.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:39:50 smithi086 bash[24289]: audit 2024-09-16T12:39:50.292581+0000 mon.b (mon.2) 1656 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T12:39:50.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:39:50 smithi086 bash[24289]: audit 2024-09-16T12:39:50.304114+0000 mon.a (mon.0) 1657 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:39:50.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:39:50 smithi086 bash[24289]: audit 2024-09-16T12:39:50.309901+0000 mon.b (mon.2) 1657 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:39:50.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:39:50 smithi047 bash[22744]: audit 2024-09-16T12:39:49.471248+0000 mon.a (mon.0) 1651 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:39:50.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:39:50 smithi047 bash[22744]: audit 2024-09-16T12:39:49.475769+0000 mon.a (mon.0) 1652 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:39:50.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:39:50 smithi047 bash[22744]: audit 2024-09-16T12:39:49.497913+0000 mon.a (mon.0) 1653 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:39:50.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:39:50 smithi047 bash[22744]: audit 2024-09-16T12:39:49.502862+0000 mon.a (mon.0) 1654 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:39:50.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:39:50 smithi047 bash[22744]: audit 2024-09-16T12:39:49.518941+0000 mon.a (mon.0) 1655 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:39:50.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:39:50 smithi047 bash[22744]: audit 2024-09-16T12:39:49.520198+0000 mgr.a (mgr.14373) 18274 : audit [DBG] from='client.392118 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:39:50.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:39:50 smithi047 bash[22744]: audit 2024-09-16T12:39:49.523991+0000 mon.a (mon.0) 1656 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:39:50.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:39:50 smithi047 bash[22744]: cluster 2024-09-16T12:39:49.945626+0000 mgr.a (mgr.14373) 18275 : cluster [DBG] pgmap v12676: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:39:50.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:39:50 smithi047 bash[22744]: audit 2024-09-16T12:39:50.290381+0000 mon.b (mon.2) 1655 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T12:39:50.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:39:50 smithi047 bash[22744]: audit 2024-09-16T12:39:50.292581+0000 mon.b (mon.2) 1656 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T12:39:50.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:39:50 smithi047 bash[22744]: audit 2024-09-16T12:39:50.304114+0000 mon.a (mon.0) 1657 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:39:50.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:39:50 smithi047 bash[22744]: audit 2024-09-16T12:39:50.309901+0000 mon.b (mon.2) 1657 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:39:51.343 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 12:39:51 smithi047 bash[22994]: debug 2024-09-16T12:39:51.041+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T12:39:51.343 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 12:39:51 smithi047 bash[22994]: debug 2024-09-16T12:39:51.045+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T12:39:51.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:39:51 smithi157 bash[24585]: audit 2024-09-16T12:39:50.312706+0000 mgr.a (mgr.14373) 18276 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:39:51.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:39:51 smithi157 bash[24585]: audit 2024-09-16T12:39:51.046085+0000 mgr.a (mgr.14373) 18277 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T12:39:51.808 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:39:51 smithi157 bash[24585]: cephadm 2024-09-16T12:39:51.048612+0000 mgr.a (mgr.14373) 18278 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T12:39:51.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:39:51 smithi086 bash[24289]: audit 2024-09-16T12:39:50.312706+0000 mgr.a (mgr.14373) 18276 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:39:51.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:39:51 smithi086 bash[24289]: audit 2024-09-16T12:39:51.046085+0000 mgr.a (mgr.14373) 18277 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T12:39:51.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:39:51 smithi086 bash[24289]: cephadm 2024-09-16T12:39:51.048612+0000 mgr.a (mgr.14373) 18278 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T12:39:51.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:39:51 smithi047 bash[22744]: audit 2024-09-16T12:39:50.312706+0000 mgr.a (mgr.14373) 18276 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:39:51.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:39:51 smithi047 bash[22744]: audit 2024-09-16T12:39:51.046085+0000 mgr.a (mgr.14373) 18277 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T12:39:51.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:39:51 smithi047 bash[22744]: cephadm 2024-09-16T12:39:51.048612+0000 mgr.a (mgr.14373) 18278 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T12:39:52.808 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:39:52 smithi157 bash[24585]: cluster 2024-09-16T12:39:51.947961+0000 mgr.a (mgr.14373) 18279 : cluster [DBG] pgmap v12677: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:39:52.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:39:52 smithi086 bash[24289]: cluster 2024-09-16T12:39:51.947961+0000 mgr.a (mgr.14373) 18279 : cluster [DBG] pgmap v12677: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:39:52.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:39:52 smithi047 bash[22744]: cluster 2024-09-16T12:39:51.947961+0000 mgr.a (mgr.14373) 18279 : cluster [DBG] pgmap v12677: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:39:54.954 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:39:54.954 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:39:54.955 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:39:55.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:39:55 smithi157 bash[24585]: cluster 2024-09-16T12:39:53.948734+0000 mgr.a (mgr.14373) 18280 : cluster [DBG] pgmap v12678: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:39:55.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:39:55 smithi086 bash[24289]: cluster 2024-09-16T12:39:53.948734+0000 mgr.a (mgr.14373) 18280 : cluster [DBG] pgmap v12678: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:39:55.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:39:55 smithi047 bash[22744]: cluster 2024-09-16T12:39:53.948734+0000 mgr.a (mgr.14373) 18280 : cluster [DBG] pgmap v12678: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:39:55.713 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:39:55.713 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:39:55.714 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:39:55.714 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:39:55.714 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:39:57.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:39:57 smithi157 bash[24585]: audit 2024-09-16T12:39:55.287538+0000 mgr.a (mgr.14373) 18281 : audit [DBG] from='client.392301 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:39:57.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:39:57 smithi157 bash[24585]: cluster 2024-09-16T12:39:55.949849+0000 mgr.a (mgr.14373) 18282 : cluster [DBG] pgmap v12679: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:39:57.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:39:57 smithi086 bash[24289]: audit 2024-09-16T12:39:55.287538+0000 mgr.a (mgr.14373) 18281 : audit [DBG] from='client.392301 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:39:57.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:39:57 smithi086 bash[24289]: cluster 2024-09-16T12:39:55.949849+0000 mgr.a (mgr.14373) 18282 : cluster [DBG] pgmap v12679: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:39:57.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:39:57 smithi047 bash[22744]: audit 2024-09-16T12:39:55.287538+0000 mgr.a (mgr.14373) 18281 : audit [DBG] from='client.392301 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:39:57.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:39:57 smithi047 bash[22744]: cluster 2024-09-16T12:39:55.949849+0000 mgr.a (mgr.14373) 18282 : cluster [DBG] pgmap v12679: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:39:58.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:39:58 smithi157 bash[24585]: cluster 2024-09-16T12:39:57.952186+0000 mgr.a (mgr.14373) 18283 : cluster [DBG] pgmap v12680: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:39:58.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:39:58 smithi086 bash[24289]: cluster 2024-09-16T12:39:57.952186+0000 mgr.a (mgr.14373) 18283 : cluster [DBG] pgmap v12680: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:39:58.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:39:58 smithi047 bash[22744]: cluster 2024-09-16T12:39:57.952186+0000 mgr.a (mgr.14373) 18283 : cluster [DBG] pgmap v12680: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:40:00.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:40:00 smithi157 bash[24585]: cluster 2024-09-16T12:40:00.000153+0000 mon.a (mon.0) 1658 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-16T12:40:00.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:40:00 smithi086 bash[24289]: cluster 2024-09-16T12:40:00.000153+0000 mon.a (mon.0) 1658 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-16T12:40:00.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:40:00 smithi047 bash[22744]: cluster 2024-09-16T12:40:00.000153+0000 mon.a (mon.0) 1658 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-16T12:40:00.715 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:40:00.716 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:40:00.716 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:40:01.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:40:01 smithi157 bash[24585]: cluster 2024-09-16T12:39:59.952948+0000 mgr.a (mgr.14373) 18284 : cluster [DBG] pgmap v12681: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:40:01.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:40:01 smithi086 bash[24289]: cluster 2024-09-16T12:39:59.952948+0000 mgr.a (mgr.14373) 18284 : cluster [DBG] pgmap v12681: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:40:01.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:40:01 smithi047 bash[22744]: cluster 2024-09-16T12:39:59.952948+0000 mgr.a (mgr.14373) 18284 : cluster [DBG] pgmap v12681: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:40:01.488 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:40:01.488 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:40:01.488 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:40:01.488 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:40:01.488 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:40:02.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:40:02 smithi086 bash[24289]: audit 2024-09-16T12:40:01.052121+0000 mgr.a (mgr.14373) 18285 : audit [DBG] from='client.392379 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:40:02.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:40:02 smithi047 bash[22744]: audit 2024-09-16T12:40:01.052121+0000 mgr.a (mgr.14373) 18285 : audit [DBG] from='client.392379 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:40:02.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:40:02 smithi157 bash[24585]: audit 2024-09-16T12:40:01.052121+0000 mgr.a (mgr.14373) 18285 : audit [DBG] from='client.392379 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:40:03.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:40:03 smithi086 bash[24289]: cluster 2024-09-16T12:40:01.955298+0000 mgr.a (mgr.14373) 18286 : cluster [DBG] pgmap v12682: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:40:03.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:40:03 smithi047 bash[22744]: cluster 2024-09-16T12:40:01.955298+0000 mgr.a (mgr.14373) 18286 : cluster [DBG] pgmap v12682: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:40:03.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:40:03 smithi157 bash[24585]: cluster 2024-09-16T12:40:01.955298+0000 mgr.a (mgr.14373) 18286 : cluster [DBG] pgmap v12682: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:40:05.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:40:05 smithi047 bash[22744]: cluster 2024-09-16T12:40:03.956044+0000 mgr.a (mgr.14373) 18287 : cluster [DBG] pgmap v12683: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T12:40:05.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:40:05 smithi157 bash[24585]: cluster 2024-09-16T12:40:03.956044+0000 mgr.a (mgr.14373) 18287 : cluster [DBG] pgmap v12683: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T12:40:05.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:40:05 smithi086 bash[24289]: cluster 2024-09-16T12:40:03.956044+0000 mgr.a (mgr.14373) 18287 : cluster [DBG] pgmap v12683: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T12:40:06.490 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:40:06.490 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:40:06.491 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:40:07.254 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:40:07.255 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:40:07.255 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:40:07.255 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:40:07.255 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:40:07.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:40:07 smithi047 bash[22744]: cluster 2024-09-16T12:40:05.956794+0000 mgr.a (mgr.14373) 18288 : cluster [DBG] pgmap v12684: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T12:40:07.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:40:07 smithi157 bash[24585]: cluster 2024-09-16T12:40:05.956794+0000 mgr.a (mgr.14373) 18288 : cluster [DBG] pgmap v12684: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T12:40:07.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:40:07 smithi086 bash[24289]: cluster 2024-09-16T12:40:05.956794+0000 mgr.a (mgr.14373) 18288 : cluster [DBG] pgmap v12684: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T12:40:08.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:40:08 smithi047 bash[22744]: audit 2024-09-16T12:40:06.821793+0000 mgr.a (mgr.14373) 18289 : audit [DBG] from='client.392454 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:40:08.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:40:08 smithi157 bash[24585]: audit 2024-09-16T12:40:06.821793+0000 mgr.a (mgr.14373) 18289 : audit [DBG] from='client.392454 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:40:08.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:40:08 smithi086 bash[24289]: audit 2024-09-16T12:40:06.821793+0000 mgr.a (mgr.14373) 18289 : audit [DBG] from='client.392454 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:40:09.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:40:09 smithi047 bash[22744]: cluster 2024-09-16T12:40:07.959709+0000 mgr.a (mgr.14373) 18290 : cluster [DBG] pgmap v12685: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:40:09.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:40:09 smithi157 bash[24585]: cluster 2024-09-16T12:40:07.959709+0000 mgr.a (mgr.14373) 18290 : cluster [DBG] pgmap v12685: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:40:09.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:40:09 smithi086 bash[24289]: cluster 2024-09-16T12:40:07.959709+0000 mgr.a (mgr.14373) 18290 : cluster [DBG] pgmap v12685: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:40:11.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:40:11 smithi047 bash[22744]: cluster 2024-09-16T12:40:09.960526+0000 mgr.a (mgr.14373) 18291 : cluster [DBG] pgmap v12686: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:40:11.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:40:11 smithi157 bash[24585]: cluster 2024-09-16T12:40:09.960526+0000 mgr.a (mgr.14373) 18291 : cluster [DBG] pgmap v12686: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:40:11.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:40:11 smithi086 bash[24289]: cluster 2024-09-16T12:40:09.960526+0000 mgr.a (mgr.14373) 18291 : cluster [DBG] pgmap v12686: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:40:12.256 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:40:12.257 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:40:12.257 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:40:13.014 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:40:13.014 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:40:13.015 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:40:13.015 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:40:13.015 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:40:13.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:40:13 smithi157 bash[24585]: cluster 2024-09-16T12:40:11.962455+0000 mgr.a (mgr.14373) 18292 : cluster [DBG] pgmap v12687: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:40:13.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:40:13 smithi086 bash[24289]: cluster 2024-09-16T12:40:11.962455+0000 mgr.a (mgr.14373) 18292 : cluster [DBG] pgmap v12687: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:40:13.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:40:13 smithi047 bash[22744]: cluster 2024-09-16T12:40:11.962455+0000 mgr.a (mgr.14373) 18292 : cluster [DBG] pgmap v12687: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:40:14.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:40:14 smithi157 bash[24585]: audit 2024-09-16T12:40:12.586589+0000 mgr.a (mgr.14373) 18293 : audit [DBG] from='client.392529 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:40:14.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:40:14 smithi086 bash[24289]: audit 2024-09-16T12:40:12.586589+0000 mgr.a (mgr.14373) 18293 : audit [DBG] from='client.392529 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:40:14.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:40:14 smithi047 bash[22744]: audit 2024-09-16T12:40:12.586589+0000 mgr.a (mgr.14373) 18293 : audit [DBG] from='client.392529 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:40:15.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:40:15 smithi157 bash[24585]: cluster 2024-09-16T12:40:13.963291+0000 mgr.a (mgr.14373) 18294 : cluster [DBG] pgmap v12688: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-16T12:40:15.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:40:15 smithi086 bash[24289]: cluster 2024-09-16T12:40:13.963291+0000 mgr.a (mgr.14373) 18294 : cluster [DBG] pgmap v12688: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-16T12:40:15.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:40:15 smithi047 bash[22744]: cluster 2024-09-16T12:40:13.963291+0000 mgr.a (mgr.14373) 18294 : cluster [DBG] pgmap v12688: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-16T12:40:17.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:40:17 smithi157 bash[24585]: cluster 2024-09-16T12:40:15.964214+0000 mgr.a (mgr.14373) 18295 : cluster [DBG] pgmap v12689: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-16T12:40:17.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:40:17 smithi086 bash[24289]: cluster 2024-09-16T12:40:15.964214+0000 mgr.a (mgr.14373) 18295 : cluster [DBG] pgmap v12689: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-16T12:40:17.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:40:17 smithi047 bash[22744]: cluster 2024-09-16T12:40:15.964214+0000 mgr.a (mgr.14373) 18295 : cluster [DBG] pgmap v12689: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-16T12:40:18.016 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:40:18.016 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:40:18.017 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:40:18.775 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:40:18.775 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:40:18.775 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:40:18.775 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:40:18.775 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:40:19.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:40:19 smithi157 bash[24585]: cluster 2024-09-16T12:40:17.966512+0000 mgr.a (mgr.14373) 18296 : cluster [DBG] pgmap v12690: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-16T12:40:19.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:40:19 smithi086 bash[24289]: cluster 2024-09-16T12:40:17.966512+0000 mgr.a (mgr.14373) 18296 : cluster [DBG] pgmap v12690: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-16T12:40:19.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:40:19 smithi047 bash[22744]: cluster 2024-09-16T12:40:17.966512+0000 mgr.a (mgr.14373) 18296 : cluster [DBG] pgmap v12690: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-16T12:40:20.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:40:20 smithi157 bash[24585]: audit 2024-09-16T12:40:18.349294+0000 mgr.a (mgr.14373) 18297 : audit [DBG] from='client.392607 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:40:20.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:40:20 smithi086 bash[24289]: audit 2024-09-16T12:40:18.349294+0000 mgr.a (mgr.14373) 18297 : audit [DBG] from='client.392607 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:40:20.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:40:20 smithi047 bash[22744]: audit 2024-09-16T12:40:18.349294+0000 mgr.a (mgr.14373) 18297 : audit [DBG] from='client.392607 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:40:21.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:40:21 smithi157 bash[24585]: cluster 2024-09-16T12:40:19.967397+0000 mgr.a (mgr.14373) 18298 : cluster [DBG] pgmap v12691: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:40:21.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:40:21 smithi086 bash[24289]: cluster 2024-09-16T12:40:19.967397+0000 mgr.a (mgr.14373) 18298 : cluster [DBG] pgmap v12691: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:40:21.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:40:21 smithi047 bash[22744]: cluster 2024-09-16T12:40:19.967397+0000 mgr.a (mgr.14373) 18298 : cluster [DBG] pgmap v12691: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:40:23.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:40:23 smithi157 bash[24585]: cluster 2024-09-16T12:40:21.969730+0000 mgr.a (mgr.14373) 18299 : cluster [DBG] pgmap v12692: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:40:23.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:40:23 smithi086 bash[24289]: cluster 2024-09-16T12:40:21.969730+0000 mgr.a (mgr.14373) 18299 : cluster [DBG] pgmap v12692: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:40:23.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:40:23 smithi047 bash[22744]: cluster 2024-09-16T12:40:21.969730+0000 mgr.a (mgr.14373) 18299 : cluster [DBG] pgmap v12692: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:40:23.776 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:40:23.777 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:40:23.777 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:40:24.556 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:40:24.556 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:40:24.556 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:40:24.556 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:40:24.556 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:40:25.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:40:25 smithi157 bash[24585]: cluster 2024-09-16T12:40:23.970662+0000 mgr.a (mgr.14373) 18300 : cluster [DBG] pgmap v12693: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:40:25.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:40:25 smithi157 bash[24585]: audit 2024-09-16T12:40:24.116957+0000 mgr.a (mgr.14373) 18301 : audit [DBG] from='client.392685 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:40:25.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:40:25 smithi086 bash[24289]: cluster 2024-09-16T12:40:23.970662+0000 mgr.a (mgr.14373) 18300 : cluster [DBG] pgmap v12693: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:40:25.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:40:25 smithi086 bash[24289]: audit 2024-09-16T12:40:24.116957+0000 mgr.a (mgr.14373) 18301 : audit [DBG] from='client.392685 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:40:25.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:40:25 smithi047 bash[22744]: cluster 2024-09-16T12:40:23.970662+0000 mgr.a (mgr.14373) 18300 : cluster [DBG] pgmap v12693: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:40:25.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:40:25 smithi047 bash[22744]: audit 2024-09-16T12:40:24.116957+0000 mgr.a (mgr.14373) 18301 : audit [DBG] from='client.392685 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:40:27.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:40:27 smithi157 bash[24585]: cluster 2024-09-16T12:40:25.971599+0000 mgr.a (mgr.14373) 18302 : cluster [DBG] pgmap v12694: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:40:27.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:40:27 smithi086 bash[24289]: cluster 2024-09-16T12:40:25.971599+0000 mgr.a (mgr.14373) 18302 : cluster [DBG] pgmap v12694: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:40:27.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:40:27 smithi047 bash[22744]: cluster 2024-09-16T12:40:25.971599+0000 mgr.a (mgr.14373) 18302 : cluster [DBG] pgmap v12694: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:40:29.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:40:29 smithi157 bash[24585]: cluster 2024-09-16T12:40:27.973837+0000 mgr.a (mgr.14373) 18303 : cluster [DBG] pgmap v12695: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:40:29.557 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:40:29.558 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:40:29.558 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:40:29.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:40:29 smithi086 bash[24289]: cluster 2024-09-16T12:40:27.973837+0000 mgr.a (mgr.14373) 18303 : cluster [DBG] pgmap v12695: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:40:29.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:40:29 smithi047 bash[22744]: cluster 2024-09-16T12:40:27.973837+0000 mgr.a (mgr.14373) 18303 : cluster [DBG] pgmap v12695: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:40:30.344 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:40:30.344 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:40:30.344 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:40:30.344 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:40:30.344 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:40:31.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:40:31 smithi157 bash[24585]: audit 2024-09-16T12:40:29.893229+0000 mgr.a (mgr.14373) 18304 : audit [DBG] from='client.392763 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:40:31.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:40:31 smithi157 bash[24585]: cluster 2024-09-16T12:40:29.974418+0000 mgr.a (mgr.14373) 18305 : cluster [DBG] pgmap v12696: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:40:31.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:40:31 smithi086 bash[24289]: audit 2024-09-16T12:40:29.893229+0000 mgr.a (mgr.14373) 18304 : audit [DBG] from='client.392763 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:40:31.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:40:31 smithi086 bash[24289]: cluster 2024-09-16T12:40:29.974418+0000 mgr.a (mgr.14373) 18305 : cluster [DBG] pgmap v12696: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:40:31.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:40:31 smithi047 bash[22744]: audit 2024-09-16T12:40:29.893229+0000 mgr.a (mgr.14373) 18304 : audit [DBG] from='client.392763 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:40:31.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:40:31 smithi047 bash[22744]: cluster 2024-09-16T12:40:29.974418+0000 mgr.a (mgr.14373) 18305 : cluster [DBG] pgmap v12696: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:40:33.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:40:33 smithi157 bash[24585]: cluster 2024-09-16T12:40:31.976639+0000 mgr.a (mgr.14373) 18306 : cluster [DBG] pgmap v12697: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:40:33.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:40:33 smithi086 bash[24289]: cluster 2024-09-16T12:40:31.976639+0000 mgr.a (mgr.14373) 18306 : cluster [DBG] pgmap v12697: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:40:33.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:40:33 smithi047 bash[22744]: cluster 2024-09-16T12:40:31.976639+0000 mgr.a (mgr.14373) 18306 : cluster [DBG] pgmap v12697: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:40:35.345 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:40:35.346 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:40:35.346 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:40:35.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:40:35 smithi157 bash[24585]: cluster 2024-09-16T12:40:33.977407+0000 mgr.a (mgr.14373) 18307 : cluster [DBG] pgmap v12698: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:40:35.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:40:35 smithi086 bash[24289]: cluster 2024-09-16T12:40:33.977407+0000 mgr.a (mgr.14373) 18307 : cluster [DBG] pgmap v12698: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:40:35.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:40:35 smithi047 bash[22744]: cluster 2024-09-16T12:40:33.977407+0000 mgr.a (mgr.14373) 18307 : cluster [DBG] pgmap v12698: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:40:36.106 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:40:36.107 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:40:36.107 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:40:36.107 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:40:36.107 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:40:37.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:40:37 smithi157 bash[24585]: audit 2024-09-16T12:40:35.673047+0000 mgr.a (mgr.14373) 18308 : audit [DBG] from='client.392841 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:40:37.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:40:37 smithi157 bash[24585]: cluster 2024-09-16T12:40:35.977864+0000 mgr.a (mgr.14373) 18309 : cluster [DBG] pgmap v12699: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:40:37.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:40:37 smithi086 bash[24289]: audit 2024-09-16T12:40:35.673047+0000 mgr.a (mgr.14373) 18308 : audit [DBG] from='client.392841 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:40:37.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:40:37 smithi086 bash[24289]: cluster 2024-09-16T12:40:35.977864+0000 mgr.a (mgr.14373) 18309 : cluster [DBG] pgmap v12699: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:40:37.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:40:37 smithi047 bash[22744]: audit 2024-09-16T12:40:35.673047+0000 mgr.a (mgr.14373) 18308 : audit [DBG] from='client.392841 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:40:37.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:40:37 smithi047 bash[22744]: cluster 2024-09-16T12:40:35.977864+0000 mgr.a (mgr.14373) 18309 : cluster [DBG] pgmap v12699: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:40:39.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:40:39 smithi157 bash[24585]: cluster 2024-09-16T12:40:37.980235+0000 mgr.a (mgr.14373) 18310 : cluster [DBG] pgmap v12700: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:40:39.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:40:39 smithi086 bash[24289]: cluster 2024-09-16T12:40:37.980235+0000 mgr.a (mgr.14373) 18310 : cluster [DBG] pgmap v12700: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:40:39.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:40:39 smithi047 bash[22744]: cluster 2024-09-16T12:40:37.980235+0000 mgr.a (mgr.14373) 18310 : cluster [DBG] pgmap v12700: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:40:41.108 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:40:41.109 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:40:41.109 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:40:41.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:40:41 smithi157 bash[24585]: cluster 2024-09-16T12:40:39.981000+0000 mgr.a (mgr.14373) 18311 : cluster [DBG] pgmap v12701: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:40:41.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:40:41 smithi086 bash[24289]: cluster 2024-09-16T12:40:39.981000+0000 mgr.a (mgr.14373) 18311 : cluster [DBG] pgmap v12701: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:40:41.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:40:41 smithi047 bash[22744]: cluster 2024-09-16T12:40:39.981000+0000 mgr.a (mgr.14373) 18311 : cluster [DBG] pgmap v12701: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:40:41.885 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:40:41.886 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:40:41.886 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:40:41.886 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:40:41.886 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:40:43.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:40:43 smithi157 bash[24585]: audit 2024-09-16T12:40:41.442388+0000 mgr.a (mgr.14373) 18312 : audit [DBG] from='client.392916 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:40:43.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:40:43 smithi157 bash[24585]: cluster 2024-09-16T12:40:41.983725+0000 mgr.a (mgr.14373) 18313 : cluster [DBG] pgmap v12702: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:40:43.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:40:43 smithi086 bash[24289]: audit 2024-09-16T12:40:41.442388+0000 mgr.a (mgr.14373) 18312 : audit [DBG] from='client.392916 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:40:43.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:40:43 smithi086 bash[24289]: cluster 2024-09-16T12:40:41.983725+0000 mgr.a (mgr.14373) 18313 : cluster [DBG] pgmap v12702: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:40:43.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:40:43 smithi047 bash[22744]: audit 2024-09-16T12:40:41.442388+0000 mgr.a (mgr.14373) 18312 : audit [DBG] from='client.392916 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:40:43.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:40:43 smithi047 bash[22744]: cluster 2024-09-16T12:40:41.983725+0000 mgr.a (mgr.14373) 18313 : cluster [DBG] pgmap v12702: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:40:45.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:40:45 smithi157 bash[24585]: cluster 2024-09-16T12:40:43.984503+0000 mgr.a (mgr.14373) 18314 : cluster [DBG] pgmap v12703: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:40:45.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:40:45 smithi086 bash[24289]: cluster 2024-09-16T12:40:43.984503+0000 mgr.a (mgr.14373) 18314 : cluster [DBG] pgmap v12703: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:40:45.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:40:45 smithi047 bash[22744]: cluster 2024-09-16T12:40:43.984503+0000 mgr.a (mgr.14373) 18314 : cluster [DBG] pgmap v12703: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:40:46.887 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:40:46.888 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:40:46.888 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:40:47.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:40:47 smithi157 bash[24585]: cluster 2024-09-16T12:40:45.985266+0000 mgr.a (mgr.14373) 18315 : cluster [DBG] pgmap v12704: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T12:40:47.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:40:47 smithi086 bash[24289]: cluster 2024-09-16T12:40:45.985266+0000 mgr.a (mgr.14373) 18315 : cluster [DBG] pgmap v12704: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T12:40:47.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:40:47 smithi047 bash[22744]: cluster 2024-09-16T12:40:45.985266+0000 mgr.a (mgr.14373) 18315 : cluster [DBG] pgmap v12704: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T12:40:47.665 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:40:47.666 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:40:47.666 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:40:47.666 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:40:47.666 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:40:48.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:40:48 smithi157 bash[24585]: audit 2024-09-16T12:40:47.228275+0000 mgr.a (mgr.14373) 18316 : audit [DBG] from='client.392994 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:40:48.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:40:48 smithi086 bash[24289]: audit 2024-09-16T12:40:47.228275+0000 mgr.a (mgr.14373) 18316 : audit [DBG] from='client.392994 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:40:48.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:40:48 smithi047 bash[22744]: audit 2024-09-16T12:40:47.228275+0000 mgr.a (mgr.14373) 18316 : audit [DBG] from='client.392994 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:40:49.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:40:49 smithi157 bash[24585]: cluster 2024-09-16T12:40:47.988046+0000 mgr.a (mgr.14373) 18317 : cluster [DBG] pgmap v12705: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:40:49.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:40:49 smithi086 bash[24289]: cluster 2024-09-16T12:40:47.988046+0000 mgr.a (mgr.14373) 18317 : cluster [DBG] pgmap v12705: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:40:49.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:40:49 smithi047 bash[22744]: cluster 2024-09-16T12:40:47.988046+0000 mgr.a (mgr.14373) 18317 : cluster [DBG] pgmap v12705: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:40:51.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:40:51 smithi157 bash[24585]: cluster 2024-09-16T12:40:49.988795+0000 mgr.a (mgr.14373) 18318 : cluster [DBG] pgmap v12706: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:40:51.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:40:51 smithi157 bash[24585]: audit 2024-09-16T12:40:51.101105+0000 mon.b (mon.2) 1658 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T12:40:51.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:40:51 smithi086 bash[24289]: cluster 2024-09-16T12:40:49.988795+0000 mgr.a (mgr.14373) 18318 : cluster [DBG] pgmap v12706: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:40:51.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:40:51 smithi086 bash[24289]: audit 2024-09-16T12:40:51.101105+0000 mon.b (mon.2) 1658 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T12:40:51.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:40:51 smithi047 bash[22744]: cluster 2024-09-16T12:40:49.988795+0000 mgr.a (mgr.14373) 18318 : cluster [DBG] pgmap v12706: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:40:51.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:40:51 smithi047 bash[22744]: audit 2024-09-16T12:40:51.101105+0000 mon.b (mon.2) 1658 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T12:40:52.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:40:52 smithi157 bash[24585]: audit 2024-09-16T12:40:51.930604+0000 mon.b (mon.2) 1659 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T12:40:52.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:40:52 smithi157 bash[24585]: audit 2024-09-16T12:40:51.932878+0000 mon.b (mon.2) 1660 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T12:40:52.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:40:52 smithi157 bash[24585]: audit 2024-09-16T12:40:51.944076+0000 mon.a (mon.0) 1659 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:40:52.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:40:52 smithi157 bash[24585]: audit 2024-09-16T12:40:51.949637+0000 mon.b (mon.2) 1661 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:40:52.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:40:52 smithi086 bash[24289]: audit 2024-09-16T12:40:51.930604+0000 mon.b (mon.2) 1659 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T12:40:52.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:40:52 smithi086 bash[24289]: audit 2024-09-16T12:40:51.932878+0000 mon.b (mon.2) 1660 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T12:40:52.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:40:52 smithi086 bash[24289]: audit 2024-09-16T12:40:51.944076+0000 mon.a (mon.0) 1659 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:40:52.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:40:52 smithi086 bash[24289]: audit 2024-09-16T12:40:51.949637+0000 mon.b (mon.2) 1661 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:40:52.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:40:52 smithi047 bash[22744]: audit 2024-09-16T12:40:51.930604+0000 mon.b (mon.2) 1659 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T12:40:52.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:40:52 smithi047 bash[22744]: audit 2024-09-16T12:40:51.932878+0000 mon.b (mon.2) 1660 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T12:40:52.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:40:52 smithi047 bash[22744]: audit 2024-09-16T12:40:51.944076+0000 mon.a (mon.0) 1659 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:40:52.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:40:52 smithi047 bash[22744]: audit 2024-09-16T12:40:51.949637+0000 mon.b (mon.2) 1661 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:40:52.667 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:40:52.667 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:40:52.667 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:40:53.092 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 12:40:52 smithi047 bash[22994]: debug 2024-09-16T12:40:52.708+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T12:40:53.093 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 12:40:52 smithi047 bash[22994]: debug 2024-09-16T12:40:52.708+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T12:40:53.407 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:40:53.408 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:40:53.408 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:40:53.408 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:40:53.408 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:40:53.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:40:53 smithi157 bash[24585]: audit 2024-09-16T12:40:51.950934+0000 mgr.a (mgr.14373) 18319 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:40:53.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:40:53 smithi157 bash[24585]: cluster 2024-09-16T12:40:51.991876+0000 mgr.a (mgr.14373) 18320 : cluster [DBG] pgmap v12707: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:40:53.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:40:53 smithi086 bash[24289]: audit 2024-09-16T12:40:51.950934+0000 mgr.a (mgr.14373) 18319 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:40:53.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:40:53 smithi086 bash[24289]: cluster 2024-09-16T12:40:51.991876+0000 mgr.a (mgr.14373) 18320 : cluster [DBG] pgmap v12707: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:40:53.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:40:53 smithi047 bash[22744]: audit 2024-09-16T12:40:51.950934+0000 mgr.a (mgr.14373) 18319 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:40:53.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:40:53 smithi047 bash[22744]: cluster 2024-09-16T12:40:51.991876+0000 mgr.a (mgr.14373) 18320 : cluster [DBG] pgmap v12707: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:40:54.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:40:54 smithi157 bash[24585]: audit 2024-09-16T12:40:52.710355+0000 mgr.a (mgr.14373) 18321 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T12:40:54.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:40:54 smithi157 bash[24585]: cephadm 2024-09-16T12:40:52.712230+0000 mgr.a (mgr.14373) 18322 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T12:40:54.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:40:54 smithi157 bash[24585]: audit 2024-09-16T12:40:52.981573+0000 mgr.a (mgr.14373) 18323 : audit [DBG] from='client.393177 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:40:54.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:40:54 smithi086 bash[24289]: audit 2024-09-16T12:40:52.710355+0000 mgr.a (mgr.14373) 18321 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T12:40:54.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:40:54 smithi086 bash[24289]: cephadm 2024-09-16T12:40:52.712230+0000 mgr.a (mgr.14373) 18322 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T12:40:54.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:40:54 smithi086 bash[24289]: audit 2024-09-16T12:40:52.981573+0000 mgr.a (mgr.14373) 18323 : audit [DBG] from='client.393177 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:40:54.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:40:54 smithi047 bash[22744]: audit 2024-09-16T12:40:52.710355+0000 mgr.a (mgr.14373) 18321 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T12:40:54.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:40:54 smithi047 bash[22744]: cephadm 2024-09-16T12:40:52.712230+0000 mgr.a (mgr.14373) 18322 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T12:40:54.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:40:54 smithi047 bash[22744]: audit 2024-09-16T12:40:52.981573+0000 mgr.a (mgr.14373) 18323 : audit [DBG] from='client.393177 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:40:55.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:40:55 smithi157 bash[24585]: cluster 2024-09-16T12:40:53.992860+0000 mgr.a (mgr.14373) 18324 : cluster [DBG] pgmap v12708: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:40:55.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:40:55 smithi086 bash[24289]: cluster 2024-09-16T12:40:53.992860+0000 mgr.a (mgr.14373) 18324 : cluster [DBG] pgmap v12708: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:40:55.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:40:55 smithi047 bash[22744]: cluster 2024-09-16T12:40:53.992860+0000 mgr.a (mgr.14373) 18324 : cluster [DBG] pgmap v12708: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:40:57.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:40:57 smithi157 bash[24585]: cluster 2024-09-16T12:40:55.993657+0000 mgr.a (mgr.14373) 18325 : cluster [DBG] pgmap v12709: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:40:57.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:40:57 smithi086 bash[24289]: cluster 2024-09-16T12:40:55.993657+0000 mgr.a (mgr.14373) 18325 : cluster [DBG] pgmap v12709: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:40:57.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:40:57 smithi047 bash[22744]: cluster 2024-09-16T12:40:55.993657+0000 mgr.a (mgr.14373) 18325 : cluster [DBG] pgmap v12709: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:40:58.409 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:40:58.410 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:40:58.410 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:40:59.185 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:40:59.185 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:40:59.185 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:40:59.185 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:40:59.185 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:40:59.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:40:59 smithi157 bash[24585]: cluster 2024-09-16T12:40:57.995909+0000 mgr.a (mgr.14373) 18326 : cluster [DBG] pgmap v12710: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:40:59.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:40:59 smithi086 bash[24289]: cluster 2024-09-16T12:40:57.995909+0000 mgr.a (mgr.14373) 18326 : cluster [DBG] pgmap v12710: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:40:59.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:40:59 smithi047 bash[22744]: cluster 2024-09-16T12:40:57.995909+0000 mgr.a (mgr.14373) 18326 : cluster [DBG] pgmap v12710: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:41:00.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:41:00 smithi157 bash[24585]: audit 2024-09-16T12:40:58.742456+0000 mgr.a (mgr.14373) 18327 : audit [DBG] from='client.393252 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:41:00.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:41:00 smithi086 bash[24289]: audit 2024-09-16T12:40:58.742456+0000 mgr.a (mgr.14373) 18327 : audit [DBG] from='client.393252 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:41:00.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:41:00 smithi047 bash[22744]: audit 2024-09-16T12:40:58.742456+0000 mgr.a (mgr.14373) 18327 : audit [DBG] from='client.393252 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:41:01.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:41:01 smithi157 bash[24585]: cluster 2024-09-16T12:40:59.996869+0000 mgr.a (mgr.14373) 18328 : cluster [DBG] pgmap v12711: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:41:01.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:41:01 smithi086 bash[24289]: cluster 2024-09-16T12:40:59.996869+0000 mgr.a (mgr.14373) 18328 : cluster [DBG] pgmap v12711: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:41:01.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:41:01 smithi047 bash[22744]: cluster 2024-09-16T12:40:59.996869+0000 mgr.a (mgr.14373) 18328 : cluster [DBG] pgmap v12711: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:41:03.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:41:03 smithi157 bash[24585]: cluster 2024-09-16T12:41:01.999248+0000 mgr.a (mgr.14373) 18329 : cluster [DBG] pgmap v12712: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:41:03.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:41:03 smithi086 bash[24289]: cluster 2024-09-16T12:41:01.999248+0000 mgr.a (mgr.14373) 18329 : cluster [DBG] pgmap v12712: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:41:03.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:41:03 smithi047 bash[22744]: cluster 2024-09-16T12:41:01.999248+0000 mgr.a (mgr.14373) 18329 : cluster [DBG] pgmap v12712: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:41:04.187 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:41:04.187 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:41:04.187 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:41:04.940 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:41:04.940 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:41:04.940 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:41:04.940 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:41:04.940 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:41:05.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:41:05 smithi157 bash[24585]: cluster 2024-09-16T12:41:04.000241+0000 mgr.a (mgr.14373) 18330 : cluster [DBG] pgmap v12713: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:41:05.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:41:05 smithi086 bash[24289]: cluster 2024-09-16T12:41:04.000241+0000 mgr.a (mgr.14373) 18330 : cluster [DBG] pgmap v12713: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:41:05.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:41:05 smithi047 bash[22744]: cluster 2024-09-16T12:41:04.000241+0000 mgr.a (mgr.14373) 18330 : cluster [DBG] pgmap v12713: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:41:06.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:41:06 smithi157 bash[24585]: audit 2024-09-16T12:41:04.514720+0000 mgr.a (mgr.14373) 18331 : audit [DBG] from='client.393330 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:41:06.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:41:06 smithi086 bash[24289]: audit 2024-09-16T12:41:04.514720+0000 mgr.a (mgr.14373) 18331 : audit [DBG] from='client.393330 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:41:06.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:41:06 smithi047 bash[22744]: audit 2024-09-16T12:41:04.514720+0000 mgr.a (mgr.14373) 18331 : audit [DBG] from='client.393330 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:41:07.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:41:07 smithi157 bash[24585]: cluster 2024-09-16T12:41:06.001391+0000 mgr.a (mgr.14373) 18332 : cluster [DBG] pgmap v12714: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:41:07.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:41:07 smithi086 bash[24289]: cluster 2024-09-16T12:41:06.001391+0000 mgr.a (mgr.14373) 18332 : cluster [DBG] pgmap v12714: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:41:07.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:41:07 smithi047 bash[22744]: cluster 2024-09-16T12:41:06.001391+0000 mgr.a (mgr.14373) 18332 : cluster [DBG] pgmap v12714: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:41:09.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:41:09 smithi157 bash[24585]: cluster 2024-09-16T12:41:08.003883+0000 mgr.a (mgr.14373) 18333 : cluster [DBG] pgmap v12715: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:41:09.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:41:09 smithi086 bash[24289]: cluster 2024-09-16T12:41:08.003883+0000 mgr.a (mgr.14373) 18333 : cluster [DBG] pgmap v12715: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:41:09.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:41:09 smithi047 bash[22744]: cluster 2024-09-16T12:41:08.003883+0000 mgr.a (mgr.14373) 18333 : cluster [DBG] pgmap v12715: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:41:09.941 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:41:09.942 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:41:09.942 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:41:10.682 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:41:10.682 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:41:10.682 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:41:10.682 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:41:10.682 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:41:11.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:41:11 smithi157 bash[24585]: cluster 2024-09-16T12:41:10.004500+0000 mgr.a (mgr.14373) 18334 : cluster [DBG] pgmap v12716: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:41:11.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:41:11 smithi157 bash[24585]: audit 2024-09-16T12:41:10.269839+0000 mgr.a (mgr.14373) 18335 : audit [DBG] from='client.393408 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:41:11.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:41:11 smithi086 bash[24289]: cluster 2024-09-16T12:41:10.004500+0000 mgr.a (mgr.14373) 18334 : cluster [DBG] pgmap v12716: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:41:11.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:41:11 smithi086 bash[24289]: audit 2024-09-16T12:41:10.269839+0000 mgr.a (mgr.14373) 18335 : audit [DBG] from='client.393408 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:41:11.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:41:11 smithi047 bash[22744]: cluster 2024-09-16T12:41:10.004500+0000 mgr.a (mgr.14373) 18334 : cluster [DBG] pgmap v12716: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:41:11.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:41:11 smithi047 bash[22744]: audit 2024-09-16T12:41:10.269839+0000 mgr.a (mgr.14373) 18335 : audit [DBG] from='client.393408 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:41:13.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:41:13 smithi157 bash[24585]: cluster 2024-09-16T12:41:12.006830+0000 mgr.a (mgr.14373) 18336 : cluster [DBG] pgmap v12717: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:41:13.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:41:13 smithi086 bash[24289]: cluster 2024-09-16T12:41:12.006830+0000 mgr.a (mgr.14373) 18336 : cluster [DBG] pgmap v12717: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:41:13.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:41:13 smithi047 bash[22744]: cluster 2024-09-16T12:41:12.006830+0000 mgr.a (mgr.14373) 18336 : cluster [DBG] pgmap v12717: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:41:15.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:41:15 smithi157 bash[24585]: cluster 2024-09-16T12:41:14.007661+0000 mgr.a (mgr.14373) 18337 : cluster [DBG] pgmap v12718: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:41:15.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:41:15 smithi086 bash[24289]: cluster 2024-09-16T12:41:14.007661+0000 mgr.a (mgr.14373) 18337 : cluster [DBG] pgmap v12718: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:41:15.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:41:15 smithi047 bash[22744]: cluster 2024-09-16T12:41:14.007661+0000 mgr.a (mgr.14373) 18337 : cluster [DBG] pgmap v12718: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:41:15.683 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:41:15.684 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:41:15.684 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:41:16.475 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:41:16.476 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:41:16.476 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:41:16.476 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:41:16.476 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:41:17.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:41:17 smithi157 bash[24585]: cluster 2024-09-16T12:41:16.008541+0000 mgr.a (mgr.14373) 18338 : cluster [DBG] pgmap v12719: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:41:17.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:41:17 smithi157 bash[24585]: audit 2024-09-16T12:41:16.019664+0000 mgr.a (mgr.14373) 18339 : audit [DBG] from='client.393483 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:41:17.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:41:17 smithi086 bash[24289]: cluster 2024-09-16T12:41:16.008541+0000 mgr.a (mgr.14373) 18338 : cluster [DBG] pgmap v12719: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:41:17.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:41:17 smithi086 bash[24289]: audit 2024-09-16T12:41:16.019664+0000 mgr.a (mgr.14373) 18339 : audit [DBG] from='client.393483 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:41:17.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:41:17 smithi047 bash[22744]: cluster 2024-09-16T12:41:16.008541+0000 mgr.a (mgr.14373) 18338 : cluster [DBG] pgmap v12719: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:41:17.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:41:17 smithi047 bash[22744]: audit 2024-09-16T12:41:16.019664+0000 mgr.a (mgr.14373) 18339 : audit [DBG] from='client.393483 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:41:19.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:41:19 smithi157 bash[24585]: cluster 2024-09-16T12:41:18.011170+0000 mgr.a (mgr.14373) 18340 : cluster [DBG] pgmap v12720: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:41:19.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:41:19 smithi086 bash[24289]: cluster 2024-09-16T12:41:18.011170+0000 mgr.a (mgr.14373) 18340 : cluster [DBG] pgmap v12720: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:41:19.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:41:19 smithi047 bash[22744]: cluster 2024-09-16T12:41:18.011170+0000 mgr.a (mgr.14373) 18340 : cluster [DBG] pgmap v12720: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:41:21.477 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:41:21.478 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:41:21.478 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:41:21.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:41:21 smithi157 bash[24585]: cluster 2024-09-16T12:41:20.012148+0000 mgr.a (mgr.14373) 18341 : cluster [DBG] pgmap v12721: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-16T12:41:21.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:41:21 smithi086 bash[24289]: cluster 2024-09-16T12:41:20.012148+0000 mgr.a (mgr.14373) 18341 : cluster [DBG] pgmap v12721: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-16T12:41:21.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:41:21 smithi047 bash[22744]: cluster 2024-09-16T12:41:20.012148+0000 mgr.a (mgr.14373) 18341 : cluster [DBG] pgmap v12721: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-16T12:41:22.247 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:41:22.247 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:41:22.247 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:41:22.248 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:41:22.248 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:41:23.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:41:23 smithi157 bash[24585]: audit 2024-09-16T12:41:21.810035+0000 mgr.a (mgr.14373) 18342 : audit [DBG] from='client.393558 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:41:23.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:41:23 smithi157 bash[24585]: cluster 2024-09-16T12:41:22.013524+0000 mgr.a (mgr.14373) 18343 : cluster [DBG] pgmap v12722: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:41:23.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:41:23 smithi086 bash[24289]: audit 2024-09-16T12:41:21.810035+0000 mgr.a (mgr.14373) 18342 : audit [DBG] from='client.393558 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:41:23.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:41:23 smithi086 bash[24289]: cluster 2024-09-16T12:41:22.013524+0000 mgr.a (mgr.14373) 18343 : cluster [DBG] pgmap v12722: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:41:23.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:41:23 smithi047 bash[22744]: audit 2024-09-16T12:41:21.810035+0000 mgr.a (mgr.14373) 18342 : audit [DBG] from='client.393558 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:41:23.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:41:23 smithi047 bash[22744]: cluster 2024-09-16T12:41:22.013524+0000 mgr.a (mgr.14373) 18343 : cluster [DBG] pgmap v12722: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:41:25.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:41:25 smithi157 bash[24585]: cluster 2024-09-16T12:41:24.014438+0000 mgr.a (mgr.14373) 18344 : cluster [DBG] pgmap v12723: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:41:25.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:41:25 smithi086 bash[24289]: cluster 2024-09-16T12:41:24.014438+0000 mgr.a (mgr.14373) 18344 : cluster [DBG] pgmap v12723: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:41:25.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:41:25 smithi047 bash[22744]: cluster 2024-09-16T12:41:24.014438+0000 mgr.a (mgr.14373) 18344 : cluster [DBG] pgmap v12723: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:41:27.249 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:41:27.250 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:41:27.250 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:41:27.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:41:27 smithi157 bash[24585]: cluster 2024-09-16T12:41:26.015199+0000 mgr.a (mgr.14373) 18345 : cluster [DBG] pgmap v12724: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T12:41:27.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:41:27 smithi086 bash[24289]: cluster 2024-09-16T12:41:26.015199+0000 mgr.a (mgr.14373) 18345 : cluster [DBG] pgmap v12724: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T12:41:27.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:41:27 smithi047 bash[22744]: cluster 2024-09-16T12:41:26.015199+0000 mgr.a (mgr.14373) 18345 : cluster [DBG] pgmap v12724: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T12:41:28.051 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:41:28.052 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:41:28.052 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:41:28.052 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:41:28.052 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:41:29.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:41:29 smithi157 bash[24585]: audit 2024-09-16T12:41:27.585378+0000 mgr.a (mgr.14373) 18346 : audit [DBG] from='client.393636 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:41:29.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:41:29 smithi157 bash[24585]: cluster 2024-09-16T12:41:28.016706+0000 mgr.a (mgr.14373) 18347 : cluster [DBG] pgmap v12725: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:41:29.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:41:29 smithi086 bash[24289]: audit 2024-09-16T12:41:27.585378+0000 mgr.a (mgr.14373) 18346 : audit [DBG] from='client.393636 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:41:29.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:41:29 smithi086 bash[24289]: cluster 2024-09-16T12:41:28.016706+0000 mgr.a (mgr.14373) 18347 : cluster [DBG] pgmap v12725: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:41:29.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:41:29 smithi047 bash[22744]: audit 2024-09-16T12:41:27.585378+0000 mgr.a (mgr.14373) 18346 : audit [DBG] from='client.393636 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:41:29.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:41:29 smithi047 bash[22744]: cluster 2024-09-16T12:41:28.016706+0000 mgr.a (mgr.14373) 18347 : cluster [DBG] pgmap v12725: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:41:30.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:41:30 smithi157 bash[24585]: cluster 2024-09-16T12:41:30.017466+0000 mgr.a (mgr.14373) 18348 : cluster [DBG] pgmap v12726: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-16T12:41:30.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:41:30 smithi086 bash[24289]: cluster 2024-09-16T12:41:30.017466+0000 mgr.a (mgr.14373) 18348 : cluster [DBG] pgmap v12726: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-16T12:41:30.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:41:30 smithi047 bash[22744]: cluster 2024-09-16T12:41:30.017466+0000 mgr.a (mgr.14373) 18348 : cluster [DBG] pgmap v12726: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-16T12:41:33.053 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:41:33.054 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:41:33.054 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:41:33.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:41:33 smithi047 bash[22744]: cluster 2024-09-16T12:41:32.019393+0000 mgr.a (mgr.14373) 18349 : cluster [DBG] pgmap v12727: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-16T12:41:33.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:41:33 smithi157 bash[24585]: cluster 2024-09-16T12:41:32.019393+0000 mgr.a (mgr.14373) 18349 : cluster [DBG] pgmap v12727: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-16T12:41:33.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:41:33 smithi086 bash[24289]: cluster 2024-09-16T12:41:32.019393+0000 mgr.a (mgr.14373) 18349 : cluster [DBG] pgmap v12727: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-16T12:41:33.805 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:41:33.805 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:41:33.805 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:41:33.806 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:41:33.806 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:41:35.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:41:35 smithi047 bash[22744]: audit 2024-09-16T12:41:33.387697+0000 mgr.a (mgr.14373) 18350 : audit [DBG] from='client.393714 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:41:35.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:41:35 smithi047 bash[22744]: cluster 2024-09-16T12:41:34.020321+0000 mgr.a (mgr.14373) 18351 : cluster [DBG] pgmap v12728: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:41:35.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:41:35 smithi157 bash[24585]: audit 2024-09-16T12:41:33.387697+0000 mgr.a (mgr.14373) 18350 : audit [DBG] from='client.393714 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:41:35.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:41:35 smithi157 bash[24585]: cluster 2024-09-16T12:41:34.020321+0000 mgr.a (mgr.14373) 18351 : cluster [DBG] pgmap v12728: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:41:35.572 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:41:35 smithi086 bash[24289]: audit 2024-09-16T12:41:33.387697+0000 mgr.a (mgr.14373) 18350 : audit [DBG] from='client.393714 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:41:35.572 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:41:35 smithi086 bash[24289]: cluster 2024-09-16T12:41:34.020321+0000 mgr.a (mgr.14373) 18351 : cluster [DBG] pgmap v12728: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:41:37.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:41:37 smithi047 bash[22744]: cluster 2024-09-16T12:41:36.021135+0000 mgr.a (mgr.14373) 18352 : cluster [DBG] pgmap v12729: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:41:37.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:41:37 smithi157 bash[24585]: cluster 2024-09-16T12:41:36.021135+0000 mgr.a (mgr.14373) 18352 : cluster [DBG] pgmap v12729: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:41:37.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:41:37 smithi086 bash[24289]: cluster 2024-09-16T12:41:36.021135+0000 mgr.a (mgr.14373) 18352 : cluster [DBG] pgmap v12729: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:41:38.807 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:41:38.807 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:41:38.807 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:41:39.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:41:39 smithi047 bash[22744]: cluster 2024-09-16T12:41:38.023394+0000 mgr.a (mgr.14373) 18353 : cluster [DBG] pgmap v12730: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:41:39.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:41:39 smithi157 bash[24585]: cluster 2024-09-16T12:41:38.023394+0000 mgr.a (mgr.14373) 18353 : cluster [DBG] pgmap v12730: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:41:39.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:41:39 smithi086 bash[24289]: cluster 2024-09-16T12:41:38.023394+0000 mgr.a (mgr.14373) 18353 : cluster [DBG] pgmap v12730: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:41:39.582 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:41:39.582 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:41:39.582 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:41:39.583 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:41:39.583 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:41:40.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:41:40 smithi157 bash[24585]: audit 2024-09-16T12:41:39.142806+0000 mgr.a (mgr.14373) 18354 : audit [DBG] from='client.393792 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:41:40.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:41:40 smithi086 bash[24289]: audit 2024-09-16T12:41:39.142806+0000 mgr.a (mgr.14373) 18354 : audit [DBG] from='client.393792 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:41:40.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:41:40 smithi047 bash[22744]: audit 2024-09-16T12:41:39.142806+0000 mgr.a (mgr.14373) 18354 : audit [DBG] from='client.393792 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:41:41.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:41:41 smithi157 bash[24585]: cluster 2024-09-16T12:41:40.024349+0000 mgr.a (mgr.14373) 18355 : cluster [DBG] pgmap v12731: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:41:41.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:41:41 smithi086 bash[24289]: cluster 2024-09-16T12:41:40.024349+0000 mgr.a (mgr.14373) 18355 : cluster [DBG] pgmap v12731: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:41:41.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:41:41 smithi047 bash[22744]: cluster 2024-09-16T12:41:40.024349+0000 mgr.a (mgr.14373) 18355 : cluster [DBG] pgmap v12731: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:41:43.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:41:43 smithi157 bash[24585]: cluster 2024-09-16T12:41:42.026558+0000 mgr.a (mgr.14373) 18356 : cluster [DBG] pgmap v12732: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:41:43.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:41:43 smithi086 bash[24289]: cluster 2024-09-16T12:41:42.026558+0000 mgr.a (mgr.14373) 18356 : cluster [DBG] pgmap v12732: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:41:43.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:41:43 smithi047 bash[22744]: cluster 2024-09-16T12:41:42.026558+0000 mgr.a (mgr.14373) 18356 : cluster [DBG] pgmap v12732: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:41:44.584 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:41:44.585 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:41:44.585 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:41:45.360 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:41:45.360 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:41:45.360 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:41:45.360 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:41:45.361 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:41:45.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:41:45 smithi157 bash[24585]: cluster 2024-09-16T12:41:44.027367+0000 mgr.a (mgr.14373) 18357 : cluster [DBG] pgmap v12733: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:41:45.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:41:45 smithi086 bash[24289]: cluster 2024-09-16T12:41:44.027367+0000 mgr.a (mgr.14373) 18357 : cluster [DBG] pgmap v12733: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:41:45.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:41:45 smithi047 bash[22744]: cluster 2024-09-16T12:41:44.027367+0000 mgr.a (mgr.14373) 18357 : cluster [DBG] pgmap v12733: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:41:46.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:41:46 smithi157 bash[24585]: audit 2024-09-16T12:41:44.911940+0000 mgr.a (mgr.14373) 18358 : audit [DBG] from='client.393861 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:41:46.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:41:46 smithi086 bash[24289]: audit 2024-09-16T12:41:44.911940+0000 mgr.a (mgr.14373) 18358 : audit [DBG] from='client.393861 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:41:46.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:41:46 smithi047 bash[22744]: audit 2024-09-16T12:41:44.911940+0000 mgr.a (mgr.14373) 18358 : audit [DBG] from='client.393861 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:41:47.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:41:47 smithi157 bash[24585]: cluster 2024-09-16T12:41:46.028352+0000 mgr.a (mgr.14373) 18359 : cluster [DBG] pgmap v12734: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:41:47.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:41:47 smithi086 bash[24289]: cluster 2024-09-16T12:41:46.028352+0000 mgr.a (mgr.14373) 18359 : cluster [DBG] pgmap v12734: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:41:47.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:41:47 smithi047 bash[22744]: cluster 2024-09-16T12:41:46.028352+0000 mgr.a (mgr.14373) 18359 : cluster [DBG] pgmap v12734: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:41:49.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:41:49 smithi157 bash[24585]: cluster 2024-09-16T12:41:48.030773+0000 mgr.a (mgr.14373) 18360 : cluster [DBG] pgmap v12735: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:41:49.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:41:49 smithi086 bash[24289]: cluster 2024-09-16T12:41:48.030773+0000 mgr.a (mgr.14373) 18360 : cluster [DBG] pgmap v12735: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:41:49.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:41:49 smithi047 bash[22744]: cluster 2024-09-16T12:41:48.030773+0000 mgr.a (mgr.14373) 18360 : cluster [DBG] pgmap v12735: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:41:50.362 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:41:50.363 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:41:50.363 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:41:51.135 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:41:51.135 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:41:51.135 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:41:51.136 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:41:51.136 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:41:51.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:41:51 smithi157 bash[24585]: cluster 2024-09-16T12:41:50.031698+0000 mgr.a (mgr.14373) 18361 : cluster [DBG] pgmap v12736: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:41:51.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:41:51 smithi086 bash[24289]: cluster 2024-09-16T12:41:50.031698+0000 mgr.a (mgr.14373) 18361 : cluster [DBG] pgmap v12736: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:41:51.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:41:51 smithi047 bash[22744]: cluster 2024-09-16T12:41:50.031698+0000 mgr.a (mgr.14373) 18361 : cluster [DBG] pgmap v12736: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:41:52.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:41:52 smithi157 bash[24585]: audit 2024-09-16T12:41:50.693321+0000 mgr.a (mgr.14373) 18362 : audit [DBG] from='client.393939 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:41:52.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:41:52 smithi086 bash[24289]: audit 2024-09-16T12:41:50.693321+0000 mgr.a (mgr.14373) 18362 : audit [DBG] from='client.393939 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:41:52.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:41:52 smithi047 bash[22744]: audit 2024-09-16T12:41:50.693321+0000 mgr.a (mgr.14373) 18362 : audit [DBG] from='client.393939 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:41:53.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:41:53 smithi157 bash[24585]: cluster 2024-09-16T12:41:52.034239+0000 mgr.a (mgr.14373) 18363 : cluster [DBG] pgmap v12737: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:41:53.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:41:53 smithi157 bash[24585]: audit 2024-09-16T12:41:52.763619+0000 mon.b (mon.2) 1662 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T12:41:53.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:41:53 smithi086 bash[24289]: cluster 2024-09-16T12:41:52.034239+0000 mgr.a (mgr.14373) 18363 : cluster [DBG] pgmap v12737: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:41:53.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:41:53 smithi086 bash[24289]: audit 2024-09-16T12:41:52.763619+0000 mon.b (mon.2) 1662 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T12:41:53.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:41:53 smithi047 bash[22744]: cluster 2024-09-16T12:41:52.034239+0000 mgr.a (mgr.14373) 18363 : cluster [DBG] pgmap v12737: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:41:53.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:41:53 smithi047 bash[22744]: audit 2024-09-16T12:41:52.763619+0000 mon.b (mon.2) 1662 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T12:41:54.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:41:54 smithi157 bash[24585]: audit 2024-09-16T12:41:53.589455+0000 mon.b (mon.2) 1663 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T12:41:54.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:41:54 smithi157 bash[24585]: audit 2024-09-16T12:41:53.591250+0000 mon.b (mon.2) 1664 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T12:41:54.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:41:54 smithi157 bash[24585]: audit 2024-09-16T12:41:53.602774+0000 mon.a (mon.0) 1660 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:41:54.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:41:54 smithi157 bash[24585]: audit 2024-09-16T12:41:53.608231+0000 mon.b (mon.2) 1665 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:41:54.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:41:54 smithi086 bash[24289]: audit 2024-09-16T12:41:53.589455+0000 mon.b (mon.2) 1663 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T12:41:54.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:41:54 smithi086 bash[24289]: audit 2024-09-16T12:41:53.591250+0000 mon.b (mon.2) 1664 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T12:41:54.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:41:54 smithi086 bash[24289]: audit 2024-09-16T12:41:53.602774+0000 mon.a (mon.0) 1660 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:41:54.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:41:54 smithi086 bash[24289]: audit 2024-09-16T12:41:53.608231+0000 mon.b (mon.2) 1665 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:41:54.593 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 12:41:54 smithi047 bash[22994]: debug 2024-09-16T12:41:54.350+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T12:41:54.593 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 12:41:54 smithi047 bash[22994]: debug 2024-09-16T12:41:54.350+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T12:41:54.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:41:54 smithi047 bash[22744]: audit 2024-09-16T12:41:53.589455+0000 mon.b (mon.2) 1663 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T12:41:54.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:41:54 smithi047 bash[22744]: audit 2024-09-16T12:41:53.591250+0000 mon.b (mon.2) 1664 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T12:41:54.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:41:54 smithi047 bash[22744]: audit 2024-09-16T12:41:53.602774+0000 mon.a (mon.0) 1660 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:41:54.594 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:41:54 smithi047 bash[22744]: audit 2024-09-16T12:41:53.608231+0000 mon.b (mon.2) 1665 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:41:55.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:41:55 smithi157 bash[24585]: audit 2024-09-16T12:41:53.609404+0000 mgr.a (mgr.14373) 18364 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:41:55.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:41:55 smithi157 bash[24585]: cluster 2024-09-16T12:41:54.036269+0000 mgr.a (mgr.14373) 18365 : cluster [DBG] pgmap v12738: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:41:55.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:41:55 smithi086 bash[24289]: audit 2024-09-16T12:41:53.609404+0000 mgr.a (mgr.14373) 18364 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:41:55.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:41:55 smithi086 bash[24289]: cluster 2024-09-16T12:41:54.036269+0000 mgr.a (mgr.14373) 18365 : cluster [DBG] pgmap v12738: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:41:55.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:41:55 smithi047 bash[22744]: audit 2024-09-16T12:41:53.609404+0000 mgr.a (mgr.14373) 18364 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:41:55.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:41:55 smithi047 bash[22744]: cluster 2024-09-16T12:41:54.036269+0000 mgr.a (mgr.14373) 18365 : cluster [DBG] pgmap v12738: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:41:56.137 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:41:56.138 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:41:56.138 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:41:56.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:41:56 smithi157 bash[24585]: audit 2024-09-16T12:41:54.355397+0000 mgr.a (mgr.14373) 18366 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T12:41:56.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:41:56 smithi157 bash[24585]: cephadm 2024-09-16T12:41:54.357366+0000 mgr.a (mgr.14373) 18367 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T12:41:56.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:41:56 smithi086 bash[24289]: audit 2024-09-16T12:41:54.355397+0000 mgr.a (mgr.14373) 18366 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T12:41:56.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:41:56 smithi086 bash[24289]: cephadm 2024-09-16T12:41:54.357366+0000 mgr.a (mgr.14373) 18367 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T12:41:56.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:41:56 smithi047 bash[22744]: audit 2024-09-16T12:41:54.355397+0000 mgr.a (mgr.14373) 18366 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T12:41:56.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:41:56 smithi047 bash[22744]: cephadm 2024-09-16T12:41:54.357366+0000 mgr.a (mgr.14373) 18367 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T12:41:56.918 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:41:56.918 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:41:56.918 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:41:56.919 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:41:56.919 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:41:57.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:41:57 smithi157 bash[24585]: cluster 2024-09-16T12:41:56.037135+0000 mgr.a (mgr.14373) 18368 : cluster [DBG] pgmap v12739: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:41:57.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:41:57 smithi086 bash[24289]: cluster 2024-09-16T12:41:56.037135+0000 mgr.a (mgr.14373) 18368 : cluster [DBG] pgmap v12739: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:41:57.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:41:57 smithi047 bash[22744]: cluster 2024-09-16T12:41:56.037135+0000 mgr.a (mgr.14373) 18368 : cluster [DBG] pgmap v12739: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:41:58.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:41:58 smithi157 bash[24585]: audit 2024-09-16T12:41:56.472931+0000 mgr.a (mgr.14373) 18369 : audit [DBG] from='client.394113 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:41:58.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:41:58 smithi086 bash[24289]: audit 2024-09-16T12:41:56.472931+0000 mgr.a (mgr.14373) 18369 : audit [DBG] from='client.394113 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:41:58.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:41:58 smithi047 bash[22744]: audit 2024-09-16T12:41:56.472931+0000 mgr.a (mgr.14373) 18369 : audit [DBG] from='client.394113 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:41:59.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:41:59 smithi157 bash[24585]: cluster 2024-09-16T12:41:58.040055+0000 mgr.a (mgr.14373) 18370 : cluster [DBG] pgmap v12740: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:41:59.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:41:59 smithi086 bash[24289]: cluster 2024-09-16T12:41:58.040055+0000 mgr.a (mgr.14373) 18370 : cluster [DBG] pgmap v12740: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:41:59.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:41:59 smithi047 bash[22744]: cluster 2024-09-16T12:41:58.040055+0000 mgr.a (mgr.14373) 18370 : cluster [DBG] pgmap v12740: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:42:01.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:42:01 smithi157 bash[24585]: cluster 2024-09-16T12:42:00.040831+0000 mgr.a (mgr.14373) 18371 : cluster [DBG] pgmap v12741: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T12:42:01.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:42:01 smithi086 bash[24289]: cluster 2024-09-16T12:42:00.040831+0000 mgr.a (mgr.14373) 18371 : cluster [DBG] pgmap v12741: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T12:42:01.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:42:01 smithi047 bash[22744]: cluster 2024-09-16T12:42:00.040831+0000 mgr.a (mgr.14373) 18371 : cluster [DBG] pgmap v12741: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T12:42:01.920 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:42:01.920 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:42:01.921 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:42:02.670 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:42:02.670 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:42:02.670 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:42:02.670 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:42:02.670 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:42:03.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:42:03 smithi157 bash[24585]: cluster 2024-09-16T12:42:02.041815+0000 mgr.a (mgr.14373) 18372 : cluster [DBG] pgmap v12742: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:42:03.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:42:03 smithi157 bash[24585]: audit 2024-09-16T12:42:02.249966+0000 mgr.a (mgr.14373) 18373 : audit [DBG] from='client.394191 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:42:03.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:42:03 smithi086 bash[24289]: cluster 2024-09-16T12:42:02.041815+0000 mgr.a (mgr.14373) 18372 : cluster [DBG] pgmap v12742: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:42:03.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:42:03 smithi086 bash[24289]: audit 2024-09-16T12:42:02.249966+0000 mgr.a (mgr.14373) 18373 : audit [DBG] from='client.394191 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:42:03.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:42:03 smithi047 bash[22744]: cluster 2024-09-16T12:42:02.041815+0000 mgr.a (mgr.14373) 18372 : cluster [DBG] pgmap v12742: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:42:03.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:42:03 smithi047 bash[22744]: audit 2024-09-16T12:42:02.249966+0000 mgr.a (mgr.14373) 18373 : audit [DBG] from='client.394191 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:42:05.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:42:05 smithi157 bash[24585]: cluster 2024-09-16T12:42:04.042857+0000 mgr.a (mgr.14373) 18374 : cluster [DBG] pgmap v12743: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T12:42:05.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:42:05 smithi086 bash[24289]: cluster 2024-09-16T12:42:04.042857+0000 mgr.a (mgr.14373) 18374 : cluster [DBG] pgmap v12743: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T12:42:05.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:42:05 smithi047 bash[22744]: cluster 2024-09-16T12:42:04.042857+0000 mgr.a (mgr.14373) 18374 : cluster [DBG] pgmap v12743: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T12:42:07.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:42:07 smithi157 bash[24585]: cluster 2024-09-16T12:42:06.043823+0000 mgr.a (mgr.14373) 18375 : cluster [DBG] pgmap v12744: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T12:42:07.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:42:07 smithi086 bash[24289]: cluster 2024-09-16T12:42:06.043823+0000 mgr.a (mgr.14373) 18375 : cluster [DBG] pgmap v12744: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T12:42:07.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:42:07 smithi047 bash[22744]: cluster 2024-09-16T12:42:06.043823+0000 mgr.a (mgr.14373) 18375 : cluster [DBG] pgmap v12744: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T12:42:07.671 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:42:07.672 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:42:07.672 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:42:08.447 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:42:08.447 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:42:08.447 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:42:08.447 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:42:08.447 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:42:09.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:42:09 smithi157 bash[24585]: audit 2024-09-16T12:42:08.006693+0000 mgr.a (mgr.14373) 18376 : audit [DBG] from='client.394269 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:42:09.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:42:09 smithi157 bash[24585]: cluster 2024-09-16T12:42:08.045658+0000 mgr.a (mgr.14373) 18377 : cluster [DBG] pgmap v12745: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:42:09.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:42:09 smithi086 bash[24289]: audit 2024-09-16T12:42:08.006693+0000 mgr.a (mgr.14373) 18376 : audit [DBG] from='client.394269 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:42:09.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:42:09 smithi086 bash[24289]: cluster 2024-09-16T12:42:08.045658+0000 mgr.a (mgr.14373) 18377 : cluster [DBG] pgmap v12745: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:42:09.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:42:09 smithi047 bash[22744]: audit 2024-09-16T12:42:08.006693+0000 mgr.a (mgr.14373) 18376 : audit [DBG] from='client.394269 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:42:09.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:42:09 smithi047 bash[22744]: cluster 2024-09-16T12:42:08.045658+0000 mgr.a (mgr.14373) 18377 : cluster [DBG] pgmap v12745: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:42:11.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:42:11 smithi157 bash[24585]: cluster 2024-09-16T12:42:10.046608+0000 mgr.a (mgr.14373) 18378 : cluster [DBG] pgmap v12746: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:42:11.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:42:11 smithi086 bash[24289]: cluster 2024-09-16T12:42:10.046608+0000 mgr.a (mgr.14373) 18378 : cluster [DBG] pgmap v12746: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:42:11.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:42:11 smithi047 bash[22744]: cluster 2024-09-16T12:42:10.046608+0000 mgr.a (mgr.14373) 18378 : cluster [DBG] pgmap v12746: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:42:13.448 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:42:13.449 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:42:13.449 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:42:13.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:42:13 smithi157 bash[24585]: cluster 2024-09-16T12:42:12.048752+0000 mgr.a (mgr.14373) 18379 : cluster [DBG] pgmap v12747: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:42:13.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:42:13 smithi086 bash[24289]: cluster 2024-09-16T12:42:12.048752+0000 mgr.a (mgr.14373) 18379 : cluster [DBG] pgmap v12747: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:42:13.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:42:13 smithi047 bash[22744]: cluster 2024-09-16T12:42:12.048752+0000 mgr.a (mgr.14373) 18379 : cluster [DBG] pgmap v12747: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:42:14.242 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:42:14.242 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:42:14.242 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:42:14.242 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:42:14.242 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:42:15.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:42:15 smithi157 bash[24585]: audit 2024-09-16T12:42:13.784126+0000 mgr.a (mgr.14373) 18380 : audit [DBG] from='client.394344 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:42:15.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:42:15 smithi157 bash[24585]: cluster 2024-09-16T12:42:14.049317+0000 mgr.a (mgr.14373) 18381 : cluster [DBG] pgmap v12748: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:42:15.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:42:15 smithi086 bash[24289]: audit 2024-09-16T12:42:13.784126+0000 mgr.a (mgr.14373) 18380 : audit [DBG] from='client.394344 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:42:15.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:42:15 smithi086 bash[24289]: cluster 2024-09-16T12:42:14.049317+0000 mgr.a (mgr.14373) 18381 : cluster [DBG] pgmap v12748: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:42:15.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:42:15 smithi047 bash[22744]: audit 2024-09-16T12:42:13.784126+0000 mgr.a (mgr.14373) 18380 : audit [DBG] from='client.394344 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:42:15.594 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:42:15 smithi047 bash[22744]: cluster 2024-09-16T12:42:14.049317+0000 mgr.a (mgr.14373) 18381 : cluster [DBG] pgmap v12748: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:42:17.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:42:17 smithi157 bash[24585]: cluster 2024-09-16T12:42:16.050203+0000 mgr.a (mgr.14373) 18382 : cluster [DBG] pgmap v12749: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:42:17.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:42:17 smithi086 bash[24289]: cluster 2024-09-16T12:42:16.050203+0000 mgr.a (mgr.14373) 18382 : cluster [DBG] pgmap v12749: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:42:17.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:42:17 smithi047 bash[22744]: cluster 2024-09-16T12:42:16.050203+0000 mgr.a (mgr.14373) 18382 : cluster [DBG] pgmap v12749: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:42:19.243 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:42:19.244 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:42:19.244 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:42:19.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:42:19 smithi157 bash[24585]: cluster 2024-09-16T12:42:18.052429+0000 mgr.a (mgr.14373) 18383 : cluster [DBG] pgmap v12750: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:42:19.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:42:19 smithi086 bash[24289]: cluster 2024-09-16T12:42:18.052429+0000 mgr.a (mgr.14373) 18383 : cluster [DBG] pgmap v12750: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:42:19.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:42:19 smithi047 bash[22744]: cluster 2024-09-16T12:42:18.052429+0000 mgr.a (mgr.14373) 18383 : cluster [DBG] pgmap v12750: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:42:20.012 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:42:20.012 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:42:20.012 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:42:20.012 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:42:20.012 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:42:21.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:42:21 smithi157 bash[24585]: audit 2024-09-16T12:42:19.571808+0000 mgr.a (mgr.14373) 18384 : audit [DBG] from='client.394422 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:42:21.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:42:21 smithi157 bash[24585]: cluster 2024-09-16T12:42:20.053049+0000 mgr.a (mgr.14373) 18385 : cluster [DBG] pgmap v12751: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:42:21.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:42:21 smithi086 bash[24289]: audit 2024-09-16T12:42:19.571808+0000 mgr.a (mgr.14373) 18384 : audit [DBG] from='client.394422 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:42:21.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:42:21 smithi086 bash[24289]: cluster 2024-09-16T12:42:20.053049+0000 mgr.a (mgr.14373) 18385 : cluster [DBG] pgmap v12751: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:42:21.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:42:21 smithi047 bash[22744]: audit 2024-09-16T12:42:19.571808+0000 mgr.a (mgr.14373) 18384 : audit [DBG] from='client.394422 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:42:21.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:42:21 smithi047 bash[22744]: cluster 2024-09-16T12:42:20.053049+0000 mgr.a (mgr.14373) 18385 : cluster [DBG] pgmap v12751: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:42:23.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:42:23 smithi157 bash[24585]: cluster 2024-09-16T12:42:22.055256+0000 mgr.a (mgr.14373) 18386 : cluster [DBG] pgmap v12752: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:42:23.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:42:23 smithi086 bash[24289]: cluster 2024-09-16T12:42:22.055256+0000 mgr.a (mgr.14373) 18386 : cluster [DBG] pgmap v12752: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:42:23.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:42:23 smithi047 bash[22744]: cluster 2024-09-16T12:42:22.055256+0000 mgr.a (mgr.14373) 18386 : cluster [DBG] pgmap v12752: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:42:25.013 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:42:25.014 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:42:25.014 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:42:25.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:42:25 smithi157 bash[24585]: cluster 2024-09-16T12:42:24.056009+0000 mgr.a (mgr.14373) 18387 : cluster [DBG] pgmap v12753: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:42:25.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:42:25 smithi086 bash[24289]: cluster 2024-09-16T12:42:24.056009+0000 mgr.a (mgr.14373) 18387 : cluster [DBG] pgmap v12753: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:42:25.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:42:25 smithi047 bash[22744]: cluster 2024-09-16T12:42:24.056009+0000 mgr.a (mgr.14373) 18387 : cluster [DBG] pgmap v12753: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:42:25.795 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:42:25.795 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:42:25.795 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:42:25.795 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:42:25.795 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:42:27.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:42:27 smithi157 bash[24585]: audit 2024-09-16T12:42:25.345533+0000 mgr.a (mgr.14373) 18388 : audit [DBG] from='client.394500 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:42:27.558 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:42:27 smithi157 bash[24585]: cluster 2024-09-16T12:42:26.056958+0000 mgr.a (mgr.14373) 18389 : cluster [DBG] pgmap v12754: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:42:27.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:42:27 smithi086 bash[24289]: audit 2024-09-16T12:42:25.345533+0000 mgr.a (mgr.14373) 18388 : audit [DBG] from='client.394500 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:42:27.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:42:27 smithi086 bash[24289]: cluster 2024-09-16T12:42:26.056958+0000 mgr.a (mgr.14373) 18389 : cluster [DBG] pgmap v12754: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:42:27.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:42:27 smithi047 bash[22744]: audit 2024-09-16T12:42:25.345533+0000 mgr.a (mgr.14373) 18388 : audit [DBG] from='client.394500 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:42:27.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:42:27 smithi047 bash[22744]: cluster 2024-09-16T12:42:26.056958+0000 mgr.a (mgr.14373) 18389 : cluster [DBG] pgmap v12754: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:42:29.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:42:29 smithi157 bash[24585]: cluster 2024-09-16T12:42:28.059263+0000 mgr.a (mgr.14373) 18390 : cluster [DBG] pgmap v12755: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:42:29.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:42:29 smithi086 bash[24289]: cluster 2024-09-16T12:42:28.059263+0000 mgr.a (mgr.14373) 18390 : cluster [DBG] pgmap v12755: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:42:29.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:42:29 smithi047 bash[22744]: cluster 2024-09-16T12:42:28.059263+0000 mgr.a (mgr.14373) 18390 : cluster [DBG] pgmap v12755: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:42:30.796 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:42:30.797 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:42:30.798 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:42:31.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:42:31 smithi157 bash[24585]: cluster 2024-09-16T12:42:30.060035+0000 mgr.a (mgr.14373) 18391 : cluster [DBG] pgmap v12756: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:42:31.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:42:31 smithi086 bash[24289]: cluster 2024-09-16T12:42:30.060035+0000 mgr.a (mgr.14373) 18391 : cluster [DBG] pgmap v12756: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:42:31.583 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:42:31.583 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:42:31.583 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:42:31.583 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:42:31.584 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:42:31.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:42:31 smithi047 bash[22744]: cluster 2024-09-16T12:42:30.060035+0000 mgr.a (mgr.14373) 18391 : cluster [DBG] pgmap v12756: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:42:32.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:42:32 smithi157 bash[24585]: audit 2024-09-16T12:42:31.134689+0000 mgr.a (mgr.14373) 18392 : audit [DBG] from='client.394575 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:42:32.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:42:32 smithi086 bash[24289]: audit 2024-09-16T12:42:31.134689+0000 mgr.a (mgr.14373) 18392 : audit [DBG] from='client.394575 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:42:32.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:42:32 smithi047 bash[22744]: audit 2024-09-16T12:42:31.134689+0000 mgr.a (mgr.14373) 18392 : audit [DBG] from='client.394575 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:42:33.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:42:33 smithi157 bash[24585]: cluster 2024-09-16T12:42:32.062570+0000 mgr.a (mgr.14373) 18393 : cluster [DBG] pgmap v12757: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-16T12:42:33.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:42:33 smithi086 bash[24289]: cluster 2024-09-16T12:42:32.062570+0000 mgr.a (mgr.14373) 18393 : cluster [DBG] pgmap v12757: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-16T12:42:33.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:42:33 smithi047 bash[22744]: cluster 2024-09-16T12:42:32.062570+0000 mgr.a (mgr.14373) 18393 : cluster [DBG] pgmap v12757: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-16T12:42:35.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:42:35 smithi157 bash[24585]: cluster 2024-09-16T12:42:34.063360+0000 mgr.a (mgr.14373) 18394 : cluster [DBG] pgmap v12758: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T12:42:35.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:42:35 smithi086 bash[24289]: cluster 2024-09-16T12:42:34.063360+0000 mgr.a (mgr.14373) 18394 : cluster [DBG] pgmap v12758: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T12:42:35.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:42:35 smithi047 bash[22744]: cluster 2024-09-16T12:42:34.063360+0000 mgr.a (mgr.14373) 18394 : cluster [DBG] pgmap v12758: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T12:42:36.585 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:42:36.587 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:42:36.587 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:42:37.340 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:42:37.341 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:42:37.341 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:42:37.341 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:42:37.341 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:42:37.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:42:37 smithi157 bash[24585]: cluster 2024-09-16T12:42:36.064099+0000 mgr.a (mgr.14373) 18395 : cluster [DBG] pgmap v12759: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T12:42:37.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:42:37 smithi086 bash[24289]: cluster 2024-09-16T12:42:36.064099+0000 mgr.a (mgr.14373) 18395 : cluster [DBG] pgmap v12759: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T12:42:37.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:42:37 smithi047 bash[22744]: cluster 2024-09-16T12:42:36.064099+0000 mgr.a (mgr.14373) 18395 : cluster [DBG] pgmap v12759: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T12:42:38.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:42:38 smithi157 bash[24585]: audit 2024-09-16T12:42:36.911473+0000 mgr.a (mgr.14373) 18396 : audit [DBG] from='client.394647 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:42:38.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:42:38 smithi086 bash[24289]: audit 2024-09-16T12:42:36.911473+0000 mgr.a (mgr.14373) 18396 : audit [DBG] from='client.394647 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:42:38.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:42:38 smithi047 bash[22744]: audit 2024-09-16T12:42:36.911473+0000 mgr.a (mgr.14373) 18396 : audit [DBG] from='client.394647 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:42:39.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:42:39 smithi157 bash[24585]: cluster 2024-09-16T12:42:38.066954+0000 mgr.a (mgr.14373) 18397 : cluster [DBG] pgmap v12760: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:42:39.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:42:39 smithi086 bash[24289]: cluster 2024-09-16T12:42:38.066954+0000 mgr.a (mgr.14373) 18397 : cluster [DBG] pgmap v12760: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:42:39.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:42:39 smithi047 bash[22744]: cluster 2024-09-16T12:42:38.066954+0000 mgr.a (mgr.14373) 18397 : cluster [DBG] pgmap v12760: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:42:41.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:42:41 smithi157 bash[24585]: cluster 2024-09-16T12:42:40.067746+0000 mgr.a (mgr.14373) 18398 : cluster [DBG] pgmap v12761: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:42:41.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:42:41 smithi086 bash[24289]: cluster 2024-09-16T12:42:40.067746+0000 mgr.a (mgr.14373) 18398 : cluster [DBG] pgmap v12761: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:42:41.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:42:41 smithi047 bash[22744]: cluster 2024-09-16T12:42:40.067746+0000 mgr.a (mgr.14373) 18398 : cluster [DBG] pgmap v12761: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:42:42.342 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:42:42.343 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:42:42.343 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:42:43.101 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:42:43.101 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:42:43.101 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:42:43.101 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:42:43.101 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:42:43.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:42:43 smithi157 bash[24585]: cluster 2024-09-16T12:42:42.069668+0000 mgr.a (mgr.14373) 18399 : cluster [DBG] pgmap v12762: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:42:43.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:42:43 smithi086 bash[24289]: cluster 2024-09-16T12:42:42.069668+0000 mgr.a (mgr.14373) 18399 : cluster [DBG] pgmap v12762: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:42:43.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:42:43 smithi047 bash[22744]: cluster 2024-09-16T12:42:42.069668+0000 mgr.a (mgr.14373) 18399 : cluster [DBG] pgmap v12762: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:42:44.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:42:44 smithi157 bash[24585]: audit 2024-09-16T12:42:42.682309+0000 mgr.a (mgr.14373) 18400 : audit [DBG] from='client.394722 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:42:44.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:42:44 smithi086 bash[24289]: audit 2024-09-16T12:42:42.682309+0000 mgr.a (mgr.14373) 18400 : audit [DBG] from='client.394722 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:42:44.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:42:44 smithi047 bash[22744]: audit 2024-09-16T12:42:42.682309+0000 mgr.a (mgr.14373) 18400 : audit [DBG] from='client.394722 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:42:45.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:42:45 smithi157 bash[24585]: cluster 2024-09-16T12:42:44.070601+0000 mgr.a (mgr.14373) 18401 : cluster [DBG] pgmap v12763: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-16T12:42:45.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:42:45 smithi086 bash[24289]: cluster 2024-09-16T12:42:44.070601+0000 mgr.a (mgr.14373) 18401 : cluster [DBG] pgmap v12763: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-16T12:42:45.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:42:45 smithi047 bash[22744]: cluster 2024-09-16T12:42:44.070601+0000 mgr.a (mgr.14373) 18401 : cluster [DBG] pgmap v12763: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-16T12:42:47.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:42:47 smithi157 bash[24585]: cluster 2024-09-16T12:42:46.071391+0000 mgr.a (mgr.14373) 18402 : cluster [DBG] pgmap v12764: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-16T12:42:47.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:42:47 smithi086 bash[24289]: cluster 2024-09-16T12:42:46.071391+0000 mgr.a (mgr.14373) 18402 : cluster [DBG] pgmap v12764: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-16T12:42:47.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:42:47 smithi047 bash[22744]: cluster 2024-09-16T12:42:46.071391+0000 mgr.a (mgr.14373) 18402 : cluster [DBG] pgmap v12764: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-16T12:42:48.102 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:42:48.103 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:42:48.103 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:42:48.874 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:42:48.874 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:42:48.874 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:42:48.875 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:42:48.875 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:42:49.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:42:49 smithi157 bash[24585]: cluster 2024-09-16T12:42:48.073636+0000 mgr.a (mgr.14373) 18403 : cluster [DBG] pgmap v12765: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-16T12:42:49.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:42:49 smithi086 bash[24289]: cluster 2024-09-16T12:42:48.073636+0000 mgr.a (mgr.14373) 18403 : cluster [DBG] pgmap v12765: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-16T12:42:49.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:42:49 smithi047 bash[22744]: cluster 2024-09-16T12:42:48.073636+0000 mgr.a (mgr.14373) 18403 : cluster [DBG] pgmap v12765: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-16T12:42:50.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:42:50 smithi157 bash[24585]: audit 2024-09-16T12:42:48.435017+0000 mgr.a (mgr.14373) 18404 : audit [DBG] from='client.394797 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:42:50.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:42:50 smithi086 bash[24289]: audit 2024-09-16T12:42:48.435017+0000 mgr.a (mgr.14373) 18404 : audit [DBG] from='client.394797 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:42:50.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:42:50 smithi047 bash[22744]: audit 2024-09-16T12:42:48.435017+0000 mgr.a (mgr.14373) 18404 : audit [DBG] from='client.394797 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:42:51.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:42:51 smithi157 bash[24585]: cluster 2024-09-16T12:42:50.074513+0000 mgr.a (mgr.14373) 18405 : cluster [DBG] pgmap v12766: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:42:51.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:42:51 smithi086 bash[24289]: cluster 2024-09-16T12:42:50.074513+0000 mgr.a (mgr.14373) 18405 : cluster [DBG] pgmap v12766: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:42:51.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:42:51 smithi047 bash[22744]: cluster 2024-09-16T12:42:50.074513+0000 mgr.a (mgr.14373) 18405 : cluster [DBG] pgmap v12766: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:42:53.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:42:53 smithi157 bash[24585]: cluster 2024-09-16T12:42:52.076800+0000 mgr.a (mgr.14373) 18406 : cluster [DBG] pgmap v12767: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:42:53.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:42:53 smithi086 bash[24289]: cluster 2024-09-16T12:42:52.076800+0000 mgr.a (mgr.14373) 18406 : cluster [DBG] pgmap v12767: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:42:53.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:42:53 smithi047 bash[22744]: cluster 2024-09-16T12:42:52.076800+0000 mgr.a (mgr.14373) 18406 : cluster [DBG] pgmap v12767: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:42:53.876 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:42:53.877 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:42:53.877 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:42:54.635 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:42:54.635 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:42:54.635 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:42:54.635 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:42:54.635 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:42:55.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:42:55 smithi086 bash[24289]: cluster 2024-09-16T12:42:54.077293+0000 mgr.a (mgr.14373) 18407 : cluster [DBG] pgmap v12768: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:42:55.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:42:55 smithi086 bash[24289]: audit 2024-09-16T12:42:54.207396+0000 mgr.a (mgr.14373) 18408 : audit [DBG] from='client.394875 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:42:55.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:42:55 smithi086 bash[24289]: audit 2024-09-16T12:42:54.414609+0000 mon.b (mon.2) 1666 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T12:42:55.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:42:55 smithi047 bash[22744]: cluster 2024-09-16T12:42:54.077293+0000 mgr.a (mgr.14373) 18407 : cluster [DBG] pgmap v12768: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:42:55.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:42:55 smithi047 bash[22744]: audit 2024-09-16T12:42:54.207396+0000 mgr.a (mgr.14373) 18408 : audit [DBG] from='client.394875 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:42:55.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:42:55 smithi047 bash[22744]: audit 2024-09-16T12:42:54.414609+0000 mon.b (mon.2) 1666 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T12:42:55.808 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:42:55 smithi157 bash[24585]: cluster 2024-09-16T12:42:54.077293+0000 mgr.a (mgr.14373) 18407 : cluster [DBG] pgmap v12768: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:42:55.809 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:42:55 smithi157 bash[24585]: audit 2024-09-16T12:42:54.207396+0000 mgr.a (mgr.14373) 18408 : audit [DBG] from='client.394875 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:42:55.809 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:42:55 smithi157 bash[24585]: audit 2024-09-16T12:42:54.414609+0000 mon.b (mon.2) 1666 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T12:42:56.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:42:56 smithi086 bash[24289]: cluster 2024-09-16T12:42:56.078210+0000 mgr.a (mgr.14373) 18409 : cluster [DBG] pgmap v12769: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:42:56.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:42:56 smithi047 bash[22744]: cluster 2024-09-16T12:42:56.078210+0000 mgr.a (mgr.14373) 18409 : cluster [DBG] pgmap v12769: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:42:56.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:42:56 smithi157 bash[24585]: cluster 2024-09-16T12:42:56.078210+0000 mgr.a (mgr.14373) 18409 : cluster [DBG] pgmap v12769: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:42:58.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:42:58 smithi157 bash[24585]: cluster 2024-09-16T12:42:58.080504+0000 mgr.a (mgr.14373) 18410 : cluster [DBG] pgmap v12770: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:42:58.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:42:58 smithi086 bash[24289]: cluster 2024-09-16T12:42:58.080504+0000 mgr.a (mgr.14373) 18410 : cluster [DBG] pgmap v12770: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:42:58.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:42:58 smithi047 bash[22744]: cluster 2024-09-16T12:42:58.080504+0000 mgr.a (mgr.14373) 18410 : cluster [DBG] pgmap v12770: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:42:59.637 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:42:59.638 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:42:59.638 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:43:00.401 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:43:00.402 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:43:00.402 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:43:00.402 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:43:00.402 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:43:01.435 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:43:01 smithi047 bash[22744]: audit 2024-09-16T12:42:59.967273+0000 mgr.a (mgr.14373) 18411 : audit [DBG] from='client.394953 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:43:01.435 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:43:01 smithi047 bash[22744]: cluster 2024-09-16T12:43:00.081014+0000 mgr.a (mgr.14373) 18412 : cluster [DBG] pgmap v12771: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:43:01.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:43:01 smithi157 bash[24585]: audit 2024-09-16T12:42:59.967273+0000 mgr.a (mgr.14373) 18411 : audit [DBG] from='client.394953 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:43:01.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:43:01 smithi157 bash[24585]: cluster 2024-09-16T12:43:00.081014+0000 mgr.a (mgr.14373) 18412 : cluster [DBG] pgmap v12771: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:43:01.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:43:01 smithi086 bash[24289]: audit 2024-09-16T12:42:59.967273+0000 mgr.a (mgr.14373) 18411 : audit [DBG] from='client.394953 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:43:01.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:43:01 smithi086 bash[24289]: cluster 2024-09-16T12:43:00.081014+0000 mgr.a (mgr.14373) 18412 : cluster [DBG] pgmap v12771: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:43:03.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:43:03 smithi157 bash[24585]: cluster 2024-09-16T12:43:02.083467+0000 mgr.a (mgr.14373) 18413 : cluster [DBG] pgmap v12772: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:43:03.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:43:03 smithi086 bash[24289]: cluster 2024-09-16T12:43:02.083467+0000 mgr.a (mgr.14373) 18413 : cluster [DBG] pgmap v12772: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:43:03.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:43:03 smithi047 bash[22744]: cluster 2024-09-16T12:43:02.083467+0000 mgr.a (mgr.14373) 18413 : cluster [DBG] pgmap v12772: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:43:05.403 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:43:05.403 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:43:05.403 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:43:05.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:43:05 smithi157 bash[24585]: cluster 2024-09-16T12:43:04.084187+0000 mgr.a (mgr.14373) 18414 : cluster [DBG] pgmap v12773: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:43:05.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:43:05 smithi157 bash[24585]: audit 2024-09-16T12:43:04.951119+0000 mon.a (mon.0) 1661 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:43:05.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:43:05 smithi157 bash[24585]: audit 2024-09-16T12:43:04.960619+0000 mon.a (mon.0) 1662 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:43:05.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:43:05 smithi157 bash[24585]: audit 2024-09-16T12:43:04.965825+0000 mon.b (mon.2) 1667 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T12:43:05.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:43:05 smithi157 bash[24585]: audit 2024-09-16T12:43:04.968349+0000 mon.b (mon.2) 1668 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T12:43:05.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:43:05 smithi157 bash[24585]: audit 2024-09-16T12:43:04.981558+0000 mon.a (mon.0) 1663 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:43:05.558 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:43:05 smithi157 bash[24585]: audit 2024-09-16T12:43:04.988020+0000 mon.b (mon.2) 1669 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:43:05.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:43:05 smithi086 bash[24289]: cluster 2024-09-16T12:43:04.084187+0000 mgr.a (mgr.14373) 18414 : cluster [DBG] pgmap v12773: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:43:05.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:43:05 smithi086 bash[24289]: audit 2024-09-16T12:43:04.951119+0000 mon.a (mon.0) 1661 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:43:05.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:43:05 smithi086 bash[24289]: audit 2024-09-16T12:43:04.960619+0000 mon.a (mon.0) 1662 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:43:05.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:43:05 smithi086 bash[24289]: audit 2024-09-16T12:43:04.965825+0000 mon.b (mon.2) 1667 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T12:43:05.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:43:05 smithi086 bash[24289]: audit 2024-09-16T12:43:04.968349+0000 mon.b (mon.2) 1668 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T12:43:05.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:43:05 smithi086 bash[24289]: audit 2024-09-16T12:43:04.981558+0000 mon.a (mon.0) 1663 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:43:05.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:43:05 smithi086 bash[24289]: audit 2024-09-16T12:43:04.988020+0000 mon.b (mon.2) 1669 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:43:05.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:43:05 smithi047 bash[22744]: cluster 2024-09-16T12:43:04.084187+0000 mgr.a (mgr.14373) 18414 : cluster [DBG] pgmap v12773: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:43:05.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:43:05 smithi047 bash[22744]: audit 2024-09-16T12:43:04.951119+0000 mon.a (mon.0) 1661 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:43:05.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:43:05 smithi047 bash[22744]: audit 2024-09-16T12:43:04.960619+0000 mon.a (mon.0) 1662 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:43:05.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:43:05 smithi047 bash[22744]: audit 2024-09-16T12:43:04.965825+0000 mon.b (mon.2) 1667 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T12:43:05.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:43:05 smithi047 bash[22744]: audit 2024-09-16T12:43:04.968349+0000 mon.b (mon.2) 1668 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T12:43:05.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:43:05 smithi047 bash[22744]: audit 2024-09-16T12:43:04.981558+0000 mon.a (mon.0) 1663 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:43:05.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:43:05 smithi047 bash[22744]: audit 2024-09-16T12:43:04.988020+0000 mon.b (mon.2) 1669 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:43:06.093 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 12:43:05 smithi047 bash[22994]: debug 2024-09-16T12:43:05.773+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T12:43:06.093 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 12:43:05 smithi047 bash[22994]: debug 2024-09-16T12:43:05.785+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T12:43:06.189 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:43:06.189 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:43:06.190 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:43:06.190 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:43:06.190 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:43:06.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:43:06 smithi157 bash[24585]: audit 2024-09-16T12:43:04.990500+0000 mgr.a (mgr.14373) 18415 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:43:06.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:43:06 smithi086 bash[24289]: audit 2024-09-16T12:43:04.990500+0000 mgr.a (mgr.14373) 18415 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:43:06.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:43:06 smithi047 bash[22744]: audit 2024-09-16T12:43:04.990500+0000 mgr.a (mgr.14373) 18415 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:43:07.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:43:07 smithi157 bash[24585]: audit 2024-09-16T12:43:05.736201+0000 mgr.a (mgr.14373) 18416 : audit [DBG] from='client.395097 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:43:07.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:43:07 smithi157 bash[24585]: audit 2024-09-16T12:43:05.777908+0000 mgr.a (mgr.14373) 18417 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T12:43:07.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:43:07 smithi157 bash[24585]: cephadm 2024-09-16T12:43:05.789214+0000 mgr.a (mgr.14373) 18418 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T12:43:07.558 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:43:07 smithi157 bash[24585]: cluster 2024-09-16T12:43:06.086721+0000 mgr.a (mgr.14373) 18419 : cluster [DBG] pgmap v12774: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:43:07.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:43:07 smithi086 bash[24289]: audit 2024-09-16T12:43:05.736201+0000 mgr.a (mgr.14373) 18416 : audit [DBG] from='client.395097 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:43:07.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:43:07 smithi086 bash[24289]: audit 2024-09-16T12:43:05.777908+0000 mgr.a (mgr.14373) 18417 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T12:43:07.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:43:07 smithi086 bash[24289]: cephadm 2024-09-16T12:43:05.789214+0000 mgr.a (mgr.14373) 18418 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T12:43:07.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:43:07 smithi086 bash[24289]: cluster 2024-09-16T12:43:06.086721+0000 mgr.a (mgr.14373) 18419 : cluster [DBG] pgmap v12774: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:43:07.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:43:07 smithi047 bash[22744]: audit 2024-09-16T12:43:05.736201+0000 mgr.a (mgr.14373) 18416 : audit [DBG] from='client.395097 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:43:07.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:43:07 smithi047 bash[22744]: audit 2024-09-16T12:43:05.777908+0000 mgr.a (mgr.14373) 18417 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T12:43:07.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:43:07 smithi047 bash[22744]: cephadm 2024-09-16T12:43:05.789214+0000 mgr.a (mgr.14373) 18418 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T12:43:07.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:43:07 smithi047 bash[22744]: cluster 2024-09-16T12:43:06.086721+0000 mgr.a (mgr.14373) 18419 : cluster [DBG] pgmap v12774: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:43:09.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:43:09 smithi157 bash[24585]: cluster 2024-09-16T12:43:08.089101+0000 mgr.a (mgr.14373) 18420 : cluster [DBG] pgmap v12775: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:43:09.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:43:09 smithi086 bash[24289]: cluster 2024-09-16T12:43:08.089101+0000 mgr.a (mgr.14373) 18420 : cluster [DBG] pgmap v12775: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:43:09.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:43:09 smithi047 bash[22744]: cluster 2024-09-16T12:43:08.089101+0000 mgr.a (mgr.14373) 18420 : cluster [DBG] pgmap v12775: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:43:11.191 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:43:11.192 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:43:11.192 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:43:11.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:43:11 smithi157 bash[24585]: cluster 2024-09-16T12:43:10.089879+0000 mgr.a (mgr.14373) 18421 : cluster [DBG] pgmap v12776: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:43:11.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:43:11 smithi086 bash[24289]: cluster 2024-09-16T12:43:10.089879+0000 mgr.a (mgr.14373) 18421 : cluster [DBG] pgmap v12776: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:43:11.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:43:11 smithi047 bash[22744]: cluster 2024-09-16T12:43:10.089879+0000 mgr.a (mgr.14373) 18421 : cluster [DBG] pgmap v12776: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:43:11.986 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:43:11.986 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:43:11.986 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:43:11.986 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:43:11.986 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:43:13.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:43:13 smithi157 bash[24585]: audit 2024-09-16T12:43:11.527717+0000 mgr.a (mgr.14373) 18422 : audit [DBG] from='client.395202 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:43:13.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:43:13 smithi157 bash[24585]: cluster 2024-09-16T12:43:12.092130+0000 mgr.a (mgr.14373) 18423 : cluster [DBG] pgmap v12777: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:43:13.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:43:13 smithi086 bash[24289]: audit 2024-09-16T12:43:11.527717+0000 mgr.a (mgr.14373) 18422 : audit [DBG] from='client.395202 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:43:13.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:43:13 smithi086 bash[24289]: cluster 2024-09-16T12:43:12.092130+0000 mgr.a (mgr.14373) 18423 : cluster [DBG] pgmap v12777: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:43:13.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:43:13 smithi047 bash[22744]: audit 2024-09-16T12:43:11.527717+0000 mgr.a (mgr.14373) 18422 : audit [DBG] from='client.395202 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:43:13.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:43:13 smithi047 bash[22744]: cluster 2024-09-16T12:43:12.092130+0000 mgr.a (mgr.14373) 18423 : cluster [DBG] pgmap v12777: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:43:15.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:43:15 smithi157 bash[24585]: cluster 2024-09-16T12:43:14.092862+0000 mgr.a (mgr.14373) 18424 : cluster [DBG] pgmap v12778: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T12:43:15.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:43:15 smithi086 bash[24289]: cluster 2024-09-16T12:43:14.092862+0000 mgr.a (mgr.14373) 18424 : cluster [DBG] pgmap v12778: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T12:43:15.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:43:15 smithi047 bash[22744]: cluster 2024-09-16T12:43:14.092862+0000 mgr.a (mgr.14373) 18424 : cluster [DBG] pgmap v12778: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T12:43:16.988 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:43:16.988 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:43:16.988 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:43:17.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:43:17 smithi157 bash[24585]: cluster 2024-09-16T12:43:16.093613+0000 mgr.a (mgr.14373) 18425 : cluster [DBG] pgmap v12779: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T12:43:17.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:43:17 smithi086 bash[24289]: cluster 2024-09-16T12:43:16.093613+0000 mgr.a (mgr.14373) 18425 : cluster [DBG] pgmap v12779: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T12:43:17.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:43:17 smithi047 bash[22744]: cluster 2024-09-16T12:43:16.093613+0000 mgr.a (mgr.14373) 18425 : cluster [DBG] pgmap v12779: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T12:43:17.739 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:43:17.739 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:43:17.739 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:43:17.739 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:43:17.739 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:43:19.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:43:19 smithi157 bash[24585]: audit 2024-09-16T12:43:17.319601+0000 mgr.a (mgr.14373) 18426 : audit [DBG] from='client.395280 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:43:19.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:43:19 smithi157 bash[24585]: cluster 2024-09-16T12:43:18.096397+0000 mgr.a (mgr.14373) 18427 : cluster [DBG] pgmap v12780: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:43:19.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:43:19 smithi086 bash[24289]: audit 2024-09-16T12:43:17.319601+0000 mgr.a (mgr.14373) 18426 : audit [DBG] from='client.395280 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:43:19.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:43:19 smithi086 bash[24289]: cluster 2024-09-16T12:43:18.096397+0000 mgr.a (mgr.14373) 18427 : cluster [DBG] pgmap v12780: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:43:19.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:43:19 smithi047 bash[22744]: audit 2024-09-16T12:43:17.319601+0000 mgr.a (mgr.14373) 18426 : audit [DBG] from='client.395280 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:43:19.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:43:19 smithi047 bash[22744]: cluster 2024-09-16T12:43:18.096397+0000 mgr.a (mgr.14373) 18427 : cluster [DBG] pgmap v12780: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:43:21.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:43:21 smithi157 bash[24585]: cluster 2024-09-16T12:43:20.097198+0000 mgr.a (mgr.14373) 18428 : cluster [DBG] pgmap v12781: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:43:21.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:43:21 smithi086 bash[24289]: cluster 2024-09-16T12:43:20.097198+0000 mgr.a (mgr.14373) 18428 : cluster [DBG] pgmap v12781: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:43:21.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:43:21 smithi047 bash[22744]: cluster 2024-09-16T12:43:20.097198+0000 mgr.a (mgr.14373) 18428 : cluster [DBG] pgmap v12781: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:43:22.741 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:43:22.741 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:43:22.742 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:43:23.521 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:43:23.522 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:43:23.522 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:43:23.522 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:43:23.522 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:43:23.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:43:23 smithi157 bash[24585]: cluster 2024-09-16T12:43:22.099169+0000 mgr.a (mgr.14373) 18429 : cluster [DBG] pgmap v12782: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:43:23.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:43:23 smithi086 bash[24289]: cluster 2024-09-16T12:43:22.099169+0000 mgr.a (mgr.14373) 18429 : cluster [DBG] pgmap v12782: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:43:23.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:43:23 smithi047 bash[22744]: cluster 2024-09-16T12:43:22.099169+0000 mgr.a (mgr.14373) 18429 : cluster [DBG] pgmap v12782: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:43:24.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:43:24 smithi157 bash[24585]: audit 2024-09-16T12:43:23.072038+0000 mgr.a (mgr.14373) 18430 : audit [DBG] from='client.395358 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:43:24.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:43:24 smithi086 bash[24289]: audit 2024-09-16T12:43:23.072038+0000 mgr.a (mgr.14373) 18430 : audit [DBG] from='client.395358 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:43:24.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:43:24 smithi047 bash[22744]: audit 2024-09-16T12:43:23.072038+0000 mgr.a (mgr.14373) 18430 : audit [DBG] from='client.395358 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:43:25.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:43:25 smithi157 bash[24585]: cluster 2024-09-16T12:43:24.100063+0000 mgr.a (mgr.14373) 18431 : cluster [DBG] pgmap v12783: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:43:25.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:43:25 smithi086 bash[24289]: cluster 2024-09-16T12:43:24.100063+0000 mgr.a (mgr.14373) 18431 : cluster [DBG] pgmap v12783: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:43:25.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:43:25 smithi047 bash[22744]: cluster 2024-09-16T12:43:24.100063+0000 mgr.a (mgr.14373) 18431 : cluster [DBG] pgmap v12783: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:43:27.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:43:27 smithi157 bash[24585]: cluster 2024-09-16T12:43:26.100819+0000 mgr.a (mgr.14373) 18432 : cluster [DBG] pgmap v12784: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:43:27.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:43:27 smithi086 bash[24289]: cluster 2024-09-16T12:43:26.100819+0000 mgr.a (mgr.14373) 18432 : cluster [DBG] pgmap v12784: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:43:27.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:43:27 smithi047 bash[22744]: cluster 2024-09-16T12:43:26.100819+0000 mgr.a (mgr.14373) 18432 : cluster [DBG] pgmap v12784: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:43:28.523 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:43:28.524 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:43:28.524 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:43:29.281 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:43:29.281 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:43:29.281 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:43:29.281 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:43:29.281 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:43:29.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:43:29 smithi157 bash[24585]: cluster 2024-09-16T12:43:28.103055+0000 mgr.a (mgr.14373) 18433 : cluster [DBG] pgmap v12785: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:43:29.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:43:29 smithi086 bash[24289]: cluster 2024-09-16T12:43:28.103055+0000 mgr.a (mgr.14373) 18433 : cluster [DBG] pgmap v12785: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:43:29.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:43:29 smithi047 bash[22744]: cluster 2024-09-16T12:43:28.103055+0000 mgr.a (mgr.14373) 18433 : cluster [DBG] pgmap v12785: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:43:30.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:43:30 smithi157 bash[24585]: audit 2024-09-16T12:43:28.857509+0000 mgr.a (mgr.14373) 18434 : audit [DBG] from='client.395436 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:43:30.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:43:30 smithi086 bash[24289]: audit 2024-09-16T12:43:28.857509+0000 mgr.a (mgr.14373) 18434 : audit [DBG] from='client.395436 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:43:30.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:43:30 smithi047 bash[22744]: audit 2024-09-16T12:43:28.857509+0000 mgr.a (mgr.14373) 18434 : audit [DBG] from='client.395436 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:43:31.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:43:31 smithi157 bash[24585]: cluster 2024-09-16T12:43:30.103917+0000 mgr.a (mgr.14373) 18435 : cluster [DBG] pgmap v12786: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:43:31.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:43:31 smithi086 bash[24289]: cluster 2024-09-16T12:43:30.103917+0000 mgr.a (mgr.14373) 18435 : cluster [DBG] pgmap v12786: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:43:31.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:43:31 smithi047 bash[22744]: cluster 2024-09-16T12:43:30.103917+0000 mgr.a (mgr.14373) 18435 : cluster [DBG] pgmap v12786: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:43:33.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:43:33 smithi157 bash[24585]: cluster 2024-09-16T12:43:32.106065+0000 mgr.a (mgr.14373) 18436 : cluster [DBG] pgmap v12787: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:43:33.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:43:33 smithi086 bash[24289]: cluster 2024-09-16T12:43:32.106065+0000 mgr.a (mgr.14373) 18436 : cluster [DBG] pgmap v12787: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:43:33.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:43:33 smithi047 bash[22744]: cluster 2024-09-16T12:43:32.106065+0000 mgr.a (mgr.14373) 18436 : cluster [DBG] pgmap v12787: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:43:34.282 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:43:34.283 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:43:34.283 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:43:35.034 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:43:35.035 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:43:35.035 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:43:35.035 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:43:35.035 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:43:35.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:43:35 smithi157 bash[24585]: cluster 2024-09-16T12:43:34.106818+0000 mgr.a (mgr.14373) 18437 : cluster [DBG] pgmap v12788: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:43:35.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:43:35 smithi086 bash[24289]: cluster 2024-09-16T12:43:34.106818+0000 mgr.a (mgr.14373) 18437 : cluster [DBG] pgmap v12788: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:43:35.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:43:35 smithi047 bash[22744]: cluster 2024-09-16T12:43:34.106818+0000 mgr.a (mgr.14373) 18437 : cluster [DBG] pgmap v12788: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:43:36.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:43:36 smithi157 bash[24585]: audit 2024-09-16T12:43:34.608577+0000 mgr.a (mgr.14373) 18438 : audit [DBG] from='client.395514 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:43:36.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:43:36 smithi086 bash[24289]: audit 2024-09-16T12:43:34.608577+0000 mgr.a (mgr.14373) 18438 : audit [DBG] from='client.395514 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:43:36.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:43:36 smithi047 bash[22744]: audit 2024-09-16T12:43:34.608577+0000 mgr.a (mgr.14373) 18438 : audit [DBG] from='client.395514 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:43:37.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:43:37 smithi157 bash[24585]: cluster 2024-09-16T12:43:36.107691+0000 mgr.a (mgr.14373) 18439 : cluster [DBG] pgmap v12789: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:43:37.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:43:37 smithi086 bash[24289]: cluster 2024-09-16T12:43:36.107691+0000 mgr.a (mgr.14373) 18439 : cluster [DBG] pgmap v12789: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:43:37.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:43:37 smithi047 bash[22744]: cluster 2024-09-16T12:43:36.107691+0000 mgr.a (mgr.14373) 18439 : cluster [DBG] pgmap v12789: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:43:39.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:43:39 smithi157 bash[24585]: cluster 2024-09-16T12:43:38.109928+0000 mgr.a (mgr.14373) 18440 : cluster [DBG] pgmap v12790: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:43:39.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:43:39 smithi086 bash[24289]: cluster 2024-09-16T12:43:38.109928+0000 mgr.a (mgr.14373) 18440 : cluster [DBG] pgmap v12790: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:43:39.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:43:39 smithi047 bash[22744]: cluster 2024-09-16T12:43:38.109928+0000 mgr.a (mgr.14373) 18440 : cluster [DBG] pgmap v12790: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:43:40.036 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:43:40.037 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:43:40.037 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:43:40.826 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:43:40.827 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:43:40.827 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:43:40.827 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:43:40.827 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:43:41.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:43:41 smithi157 bash[24585]: cluster 2024-09-16T12:43:40.110703+0000 mgr.a (mgr.14373) 18441 : cluster [DBG] pgmap v12791: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:43:41.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:43:41 smithi086 bash[24289]: cluster 2024-09-16T12:43:40.110703+0000 mgr.a (mgr.14373) 18441 : cluster [DBG] pgmap v12791: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:43:41.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:43:41 smithi047 bash[22744]: cluster 2024-09-16T12:43:40.110703+0000 mgr.a (mgr.14373) 18441 : cluster [DBG] pgmap v12791: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:43:42.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:43:42 smithi157 bash[24585]: audit 2024-09-16T12:43:40.379605+0000 mgr.a (mgr.14373) 18442 : audit [DBG] from='client.395589 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:43:42.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:43:42 smithi086 bash[24289]: audit 2024-09-16T12:43:40.379605+0000 mgr.a (mgr.14373) 18442 : audit [DBG] from='client.395589 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:43:42.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:43:42 smithi047 bash[22744]: audit 2024-09-16T12:43:40.379605+0000 mgr.a (mgr.14373) 18442 : audit [DBG] from='client.395589 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:43:43.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:43:43 smithi157 bash[24585]: cluster 2024-09-16T12:43:42.112965+0000 mgr.a (mgr.14373) 18443 : cluster [DBG] pgmap v12792: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:43:43.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:43:43 smithi086 bash[24289]: cluster 2024-09-16T12:43:42.112965+0000 mgr.a (mgr.14373) 18443 : cluster [DBG] pgmap v12792: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:43:43.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:43:43 smithi047 bash[22744]: cluster 2024-09-16T12:43:42.112965+0000 mgr.a (mgr.14373) 18443 : cluster [DBG] pgmap v12792: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:43:45.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:43:45 smithi157 bash[24585]: cluster 2024-09-16T12:43:44.113686+0000 mgr.a (mgr.14373) 18444 : cluster [DBG] pgmap v12793: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:43:45.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:43:45 smithi086 bash[24289]: cluster 2024-09-16T12:43:44.113686+0000 mgr.a (mgr.14373) 18444 : cluster [DBG] pgmap v12793: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:43:45.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:43:45 smithi047 bash[22744]: cluster 2024-09-16T12:43:44.113686+0000 mgr.a (mgr.14373) 18444 : cluster [DBG] pgmap v12793: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:43:45.828 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:43:45.829 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:43:45.829 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:43:46.613 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:43:46.614 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:43:46.614 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:43:46.614 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:43:46.614 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:43:47.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:43:47 smithi157 bash[24585]: cluster 2024-09-16T12:43:46.114447+0000 mgr.a (mgr.14373) 18445 : cluster [DBG] pgmap v12794: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:43:47.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:43:47 smithi157 bash[24585]: audit 2024-09-16T12:43:46.163548+0000 mgr.a (mgr.14373) 18446 : audit [DBG] from='client.395667 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:43:47.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:43:47 smithi086 bash[24289]: cluster 2024-09-16T12:43:46.114447+0000 mgr.a (mgr.14373) 18445 : cluster [DBG] pgmap v12794: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:43:47.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:43:47 smithi086 bash[24289]: audit 2024-09-16T12:43:46.163548+0000 mgr.a (mgr.14373) 18446 : audit [DBG] from='client.395667 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:43:47.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:43:47 smithi047 bash[22744]: cluster 2024-09-16T12:43:46.114447+0000 mgr.a (mgr.14373) 18445 : cluster [DBG] pgmap v12794: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:43:47.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:43:47 smithi047 bash[22744]: audit 2024-09-16T12:43:46.163548+0000 mgr.a (mgr.14373) 18446 : audit [DBG] from='client.395667 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:43:49.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:43:49 smithi157 bash[24585]: cluster 2024-09-16T12:43:48.117133+0000 mgr.a (mgr.14373) 18447 : cluster [DBG] pgmap v12795: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-16T12:43:49.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:43:49 smithi086 bash[24289]: cluster 2024-09-16T12:43:48.117133+0000 mgr.a (mgr.14373) 18447 : cluster [DBG] pgmap v12795: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-16T12:43:49.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:43:49 smithi047 bash[22744]: cluster 2024-09-16T12:43:48.117133+0000 mgr.a (mgr.14373) 18447 : cluster [DBG] pgmap v12795: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-16T12:43:51.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:43:51 smithi157 bash[24585]: cluster 2024-09-16T12:43:50.117940+0000 mgr.a (mgr.14373) 18448 : cluster [DBG] pgmap v12796: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T12:43:51.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:43:51 smithi086 bash[24289]: cluster 2024-09-16T12:43:50.117940+0000 mgr.a (mgr.14373) 18448 : cluster [DBG] pgmap v12796: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T12:43:51.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:43:51 smithi047 bash[22744]: cluster 2024-09-16T12:43:50.117940+0000 mgr.a (mgr.14373) 18448 : cluster [DBG] pgmap v12796: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T12:43:51.615 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:43:51.616 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:43:51.616 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:43:52.412 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:43:52.413 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:43:52.413 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:43:52.413 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:43:52.413 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:43:53.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:43:53 smithi157 bash[24585]: audit 2024-09-16T12:43:51.950421+0000 mgr.a (mgr.14373) 18449 : audit [DBG] from='client.395745 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:43:53.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:43:53 smithi157 bash[24585]: cluster 2024-09-16T12:43:52.119515+0000 mgr.a (mgr.14373) 18450 : cluster [DBG] pgmap v12797: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:43:53.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:43:53 smithi086 bash[24289]: audit 2024-09-16T12:43:51.950421+0000 mgr.a (mgr.14373) 18449 : audit [DBG] from='client.395745 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:43:53.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:43:53 smithi086 bash[24289]: cluster 2024-09-16T12:43:52.119515+0000 mgr.a (mgr.14373) 18450 : cluster [DBG] pgmap v12797: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:43:53.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:43:53 smithi047 bash[22744]: audit 2024-09-16T12:43:51.950421+0000 mgr.a (mgr.14373) 18449 : audit [DBG] from='client.395745 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:43:53.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:43:53 smithi047 bash[22744]: cluster 2024-09-16T12:43:52.119515+0000 mgr.a (mgr.14373) 18450 : cluster [DBG] pgmap v12797: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:43:55.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:43:55 smithi157 bash[24585]: cluster 2024-09-16T12:43:54.120382+0000 mgr.a (mgr.14373) 18451 : cluster [DBG] pgmap v12798: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:43:55.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:43:55 smithi086 bash[24289]: cluster 2024-09-16T12:43:54.120382+0000 mgr.a (mgr.14373) 18451 : cluster [DBG] pgmap v12798: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:43:55.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:43:55 smithi047 bash[22744]: cluster 2024-09-16T12:43:54.120382+0000 mgr.a (mgr.14373) 18451 : cluster [DBG] pgmap v12798: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:43:57.414 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:43:57.414 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:43:57.415 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:43:57.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:43:57 smithi157 bash[24585]: cluster 2024-09-16T12:43:56.121129+0000 mgr.a (mgr.14373) 18452 : cluster [DBG] pgmap v12799: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T12:43:57.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:43:57 smithi086 bash[24289]: cluster 2024-09-16T12:43:56.121129+0000 mgr.a (mgr.14373) 18452 : cluster [DBG] pgmap v12799: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T12:43:57.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:43:57 smithi047 bash[22744]: cluster 2024-09-16T12:43:56.121129+0000 mgr.a (mgr.14373) 18452 : cluster [DBG] pgmap v12799: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T12:43:58.150 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:43:58.150 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:43:58.150 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:43:58.150 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:43:58.150 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:43:59.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:43:59 smithi157 bash[24585]: audit 2024-09-16T12:43:57.740805+0000 mgr.a (mgr.14373) 18453 : audit [DBG] from='client.395820 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:43:59.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:43:59 smithi157 bash[24585]: cluster 2024-09-16T12:43:58.122334+0000 mgr.a (mgr.14373) 18454 : cluster [DBG] pgmap v12800: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:43:59.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:43:59 smithi086 bash[24289]: audit 2024-09-16T12:43:57.740805+0000 mgr.a (mgr.14373) 18453 : audit [DBG] from='client.395820 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:43:59.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:43:59 smithi086 bash[24289]: cluster 2024-09-16T12:43:58.122334+0000 mgr.a (mgr.14373) 18454 : cluster [DBG] pgmap v12800: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:43:59.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:43:59 smithi047 bash[22744]: audit 2024-09-16T12:43:57.740805+0000 mgr.a (mgr.14373) 18453 : audit [DBG] from='client.395820 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:43:59.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:43:59 smithi047 bash[22744]: cluster 2024-09-16T12:43:58.122334+0000 mgr.a (mgr.14373) 18454 : cluster [DBG] pgmap v12800: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:44:01.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:44:01 smithi157 bash[24585]: cluster 2024-09-16T12:44:00.123019+0000 mgr.a (mgr.14373) 18455 : cluster [DBG] pgmap v12801: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-09-16T12:44:01.572 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:44:01 smithi086 bash[24289]: cluster 2024-09-16T12:44:00.123019+0000 mgr.a (mgr.14373) 18455 : cluster [DBG] pgmap v12801: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-09-16T12:44:01.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:44:01 smithi047 bash[22744]: cluster 2024-09-16T12:44:00.123019+0000 mgr.a (mgr.14373) 18455 : cluster [DBG] pgmap v12801: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-09-16T12:44:03.151 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:44:03.152 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:44:03.152 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:44:03.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:44:03 smithi086 bash[24289]: cluster 2024-09-16T12:44:02.124977+0000 mgr.a (mgr.14373) 18456 : cluster [DBG] pgmap v12802: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.4 KiB/s rd, 2 op/s 2024-09-16T12:44:03.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:44:03 smithi047 bash[22744]: cluster 2024-09-16T12:44:02.124977+0000 mgr.a (mgr.14373) 18456 : cluster [DBG] pgmap v12802: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.4 KiB/s rd, 2 op/s 2024-09-16T12:44:03.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:44:03 smithi157 bash[24585]: cluster 2024-09-16T12:44:02.124977+0000 mgr.a (mgr.14373) 18456 : cluster [DBG] pgmap v12802: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.4 KiB/s rd, 2 op/s 2024-09-16T12:44:03.942 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:44:03.942 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:44:03.942 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:44:03.942 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:44:03.942 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:44:05.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:44:05 smithi086 bash[24289]: audit 2024-09-16T12:44:03.485580+0000 mgr.a (mgr.14373) 18457 : audit [DBG] from='client.395898 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:44:05.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:44:05 smithi086 bash[24289]: cluster 2024-09-16T12:44:04.125857+0000 mgr.a (mgr.14373) 18458 : cluster [DBG] pgmap v12803: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:44:05.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:44:05 smithi047 bash[22744]: audit 2024-09-16T12:44:03.485580+0000 mgr.a (mgr.14373) 18457 : audit [DBG] from='client.395898 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:44:05.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:44:05 smithi047 bash[22744]: cluster 2024-09-16T12:44:04.125857+0000 mgr.a (mgr.14373) 18458 : cluster [DBG] pgmap v12803: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:44:05.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:44:05 smithi157 bash[24585]: audit 2024-09-16T12:44:03.485580+0000 mgr.a (mgr.14373) 18457 : audit [DBG] from='client.395898 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:44:05.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:44:05 smithi157 bash[24585]: cluster 2024-09-16T12:44:04.125857+0000 mgr.a (mgr.14373) 18458 : cluster [DBG] pgmap v12803: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:44:06.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:44:06 smithi086 bash[24289]: audit 2024-09-16T12:44:05.842868+0000 mon.b (mon.2) 1670 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T12:44:06.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:44:06 smithi047 bash[22744]: audit 2024-09-16T12:44:05.842868+0000 mon.b (mon.2) 1670 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T12:44:06.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:44:06 smithi157 bash[24585]: audit 2024-09-16T12:44:05.842868+0000 mon.b (mon.2) 1670 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T12:44:07.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:44:07 smithi047 bash[22744]: cluster 2024-09-16T12:44:06.126679+0000 mgr.a (mgr.14373) 18459 : cluster [DBG] pgmap v12804: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:44:07.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:44:07 smithi047 bash[22744]: audit 2024-09-16T12:44:06.472698+0000 mon.a (mon.0) 1664 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:44:07.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:44:07 smithi047 bash[22744]: audit 2024-09-16T12:44:06.481055+0000 mon.a (mon.0) 1665 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:44:07.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:44:07 smithi157 bash[24585]: cluster 2024-09-16T12:44:06.126679+0000 mgr.a (mgr.14373) 18459 : cluster [DBG] pgmap v12804: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:44:07.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:44:07 smithi157 bash[24585]: audit 2024-09-16T12:44:06.472698+0000 mon.a (mon.0) 1664 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:44:07.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:44:07 smithi157 bash[24585]: audit 2024-09-16T12:44:06.481055+0000 mon.a (mon.0) 1665 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:44:07.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:44:07 smithi086 bash[24289]: cluster 2024-09-16T12:44:06.126679+0000 mgr.a (mgr.14373) 18459 : cluster [DBG] pgmap v12804: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:44:07.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:44:07 smithi086 bash[24289]: audit 2024-09-16T12:44:06.472698+0000 mon.a (mon.0) 1664 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:44:07.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:44:07 smithi086 bash[24289]: audit 2024-09-16T12:44:06.481055+0000 mon.a (mon.0) 1665 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:44:08.944 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:44:08.944 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:44:08.945 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:44:09.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:44:09 smithi047 bash[22744]: cluster 2024-09-16T12:44:08.128885+0000 mgr.a (mgr.14373) 18460 : cluster [DBG] pgmap v12805: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:44:09.704 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:44:09.704 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:44:09.704 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:44:09.704 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:44:09.705 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:44:09.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:44:09 smithi157 bash[24585]: cluster 2024-09-16T12:44:08.128885+0000 mgr.a (mgr.14373) 18460 : cluster [DBG] pgmap v12805: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:44:09.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:44:09 smithi086 bash[24289]: cluster 2024-09-16T12:44:08.128885+0000 mgr.a (mgr.14373) 18460 : cluster [DBG] pgmap v12805: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:44:10.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:44:10 smithi047 bash[22744]: audit 2024-09-16T12:44:09.276250+0000 mgr.a (mgr.14373) 18461 : audit [DBG] from='client.395976 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:44:10.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:44:10 smithi157 bash[24585]: audit 2024-09-16T12:44:09.276250+0000 mgr.a (mgr.14373) 18461 : audit [DBG] from='client.395976 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:44:10.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:44:10 smithi086 bash[24289]: audit 2024-09-16T12:44:09.276250+0000 mgr.a (mgr.14373) 18461 : audit [DBG] from='client.395976 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:44:11.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:44:11 smithi047 bash[22744]: cluster 2024-09-16T12:44:10.129802+0000 mgr.a (mgr.14373) 18462 : cluster [DBG] pgmap v12806: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:44:11.709 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:44:11 smithi086 bash[24289]: cluster 2024-09-16T12:44:10.129802+0000 mgr.a (mgr.14373) 18462 : cluster [DBG] pgmap v12806: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:44:11.809 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:44:11 smithi157 bash[24585]: cluster 2024-09-16T12:44:10.129802+0000 mgr.a (mgr.14373) 18462 : cluster [DBG] pgmap v12806: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:44:12.668 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:44:12 smithi086 bash[24289]: cluster 2024-09-16T12:44:12.131991+0000 mgr.a (mgr.14373) 18463 : cluster [DBG] pgmap v12807: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:44:12.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:44:12 smithi157 bash[24585]: cluster 2024-09-16T12:44:12.131991+0000 mgr.a (mgr.14373) 18463 : cluster [DBG] pgmap v12807: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:44:12.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:44:12 smithi047 bash[22744]: cluster 2024-09-16T12:44:12.131991+0000 mgr.a (mgr.14373) 18463 : cluster [DBG] pgmap v12807: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:44:14.706 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:44:14.706 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:44:14.707 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:44:15.454 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:44:15.455 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:44:15.455 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:44:15.455 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:44:15.455 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:44:15.541 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:44:15 smithi086 bash[24289]: cluster 2024-09-16T12:44:14.132726+0000 mgr.a (mgr.14373) 18464 : cluster [DBG] pgmap v12808: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:44:15.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:44:15 smithi157 bash[24585]: cluster 2024-09-16T12:44:14.132726+0000 mgr.a (mgr.14373) 18464 : cluster [DBG] pgmap v12808: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:44:15.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:44:15 smithi047 bash[22744]: cluster 2024-09-16T12:44:14.132726+0000 mgr.a (mgr.14373) 18464 : cluster [DBG] pgmap v12808: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:44:16.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:44:16 smithi157 bash[24585]: audit 2024-09-16T12:44:15.034575+0000 mgr.a (mgr.14373) 18465 : audit [DBG] from='client.396051 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:44:16.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:44:16 smithi157 bash[24585]: audit 2024-09-16T12:44:16.007558+0000 mon.a (mon.0) 1666 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:44:16.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:44:16 smithi157 bash[24585]: audit 2024-09-16T12:44:16.019692+0000 mon.a (mon.0) 1667 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:44:16.558 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:44:16 smithi157 bash[24585]: audit 2024-09-16T12:44:16.023352+0000 mon.b (mon.2) 1671 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T12:44:16.558 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:44:16 smithi157 bash[24585]: audit 2024-09-16T12:44:16.025965+0000 mon.b (mon.2) 1672 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T12:44:16.558 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:44:16 smithi157 bash[24585]: audit 2024-09-16T12:44:16.037954+0000 mon.a (mon.0) 1668 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:44:16.558 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:44:16 smithi157 bash[24585]: audit 2024-09-16T12:44:16.044499+0000 mon.b (mon.2) 1673 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:44:16.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:44:16 smithi086 bash[24289]: audit 2024-09-16T12:44:15.034575+0000 mgr.a (mgr.14373) 18465 : audit [DBG] from='client.396051 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:44:16.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:44:16 smithi086 bash[24289]: audit 2024-09-16T12:44:16.007558+0000 mon.a (mon.0) 1666 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:44:16.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:44:16 smithi086 bash[24289]: audit 2024-09-16T12:44:16.019692+0000 mon.a (mon.0) 1667 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:44:16.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:44:16 smithi086 bash[24289]: audit 2024-09-16T12:44:16.023352+0000 mon.b (mon.2) 1671 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T12:44:16.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:44:16 smithi086 bash[24289]: audit 2024-09-16T12:44:16.025965+0000 mon.b (mon.2) 1672 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T12:44:16.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:44:16 smithi086 bash[24289]: audit 2024-09-16T12:44:16.037954+0000 mon.a (mon.0) 1668 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:44:16.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:44:16 smithi086 bash[24289]: audit 2024-09-16T12:44:16.044499+0000 mon.b (mon.2) 1673 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:44:16.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:44:16 smithi047 bash[22744]: audit 2024-09-16T12:44:15.034575+0000 mgr.a (mgr.14373) 18465 : audit [DBG] from='client.396051 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:44:16.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:44:16 smithi047 bash[22744]: audit 2024-09-16T12:44:16.007558+0000 mon.a (mon.0) 1666 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:44:16.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:44:16 smithi047 bash[22744]: audit 2024-09-16T12:44:16.019692+0000 mon.a (mon.0) 1667 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:44:16.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:44:16 smithi047 bash[22744]: audit 2024-09-16T12:44:16.023352+0000 mon.b (mon.2) 1671 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T12:44:16.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:44:16 smithi047 bash[22744]: audit 2024-09-16T12:44:16.025965+0000 mon.b (mon.2) 1672 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T12:44:16.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:44:16 smithi047 bash[22744]: audit 2024-09-16T12:44:16.037954+0000 mon.a (mon.0) 1668 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:44:16.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:44:16 smithi047 bash[22744]: audit 2024-09-16T12:44:16.044499+0000 mon.b (mon.2) 1673 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:44:17.093 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 12:44:16 smithi047 bash[22994]: debug 2024-09-16T12:44:16.815+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T12:44:17.093 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 12:44:16 smithi047 bash[22994]: debug 2024-09-16T12:44:16.819+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T12:44:17.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:44:17 smithi157 bash[24585]: audit 2024-09-16T12:44:16.047356+0000 mgr.a (mgr.14373) 18466 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:44:17.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:44:17 smithi157 bash[24585]: cluster 2024-09-16T12:44:16.133336+0000 mgr.a (mgr.14373) 18467 : cluster [DBG] pgmap v12809: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:44:17.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:44:17 smithi086 bash[24289]: audit 2024-09-16T12:44:16.047356+0000 mgr.a (mgr.14373) 18466 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:44:17.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:44:17 smithi086 bash[24289]: cluster 2024-09-16T12:44:16.133336+0000 mgr.a (mgr.14373) 18467 : cluster [DBG] pgmap v12809: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:44:17.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:44:17 smithi047 bash[22744]: audit 2024-09-16T12:44:16.047356+0000 mgr.a (mgr.14373) 18466 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:44:17.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:44:17 smithi047 bash[22744]: cluster 2024-09-16T12:44:16.133336+0000 mgr.a (mgr.14373) 18467 : cluster [DBG] pgmap v12809: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:44:18.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:44:18 smithi157 bash[24585]: audit 2024-09-16T12:44:16.822044+0000 mgr.a (mgr.14373) 18468 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T12:44:18.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:44:18 smithi157 bash[24585]: cephadm 2024-09-16T12:44:16.824138+0000 mgr.a (mgr.14373) 18469 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T12:44:18.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:44:18 smithi086 bash[24289]: audit 2024-09-16T12:44:16.822044+0000 mgr.a (mgr.14373) 18468 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T12:44:18.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:44:18 smithi086 bash[24289]: cephadm 2024-09-16T12:44:16.824138+0000 mgr.a (mgr.14373) 18469 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T12:44:18.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:44:18 smithi047 bash[22744]: audit 2024-09-16T12:44:16.822044+0000 mgr.a (mgr.14373) 18468 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T12:44:18.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:44:18 smithi047 bash[22744]: cephadm 2024-09-16T12:44:16.824138+0000 mgr.a (mgr.14373) 18469 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T12:44:19.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:44:19 smithi157 bash[24585]: cluster 2024-09-16T12:44:18.136115+0000 mgr.a (mgr.14373) 18470 : cluster [DBG] pgmap v12810: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 4.6 KiB/s rd, 255 B/s wr, 4 op/s 2024-09-16T12:44:19.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:44:19 smithi086 bash[24289]: cluster 2024-09-16T12:44:18.136115+0000 mgr.a (mgr.14373) 18470 : cluster [DBG] pgmap v12810: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 4.6 KiB/s rd, 255 B/s wr, 4 op/s 2024-09-16T12:44:19.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:44:19 smithi047 bash[22744]: cluster 2024-09-16T12:44:18.136115+0000 mgr.a (mgr.14373) 18470 : cluster [DBG] pgmap v12810: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 4.6 KiB/s rd, 255 B/s wr, 4 op/s 2024-09-16T12:44:20.456 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:44:20.457 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:44:20.457 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:44:21.209 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:44:21.209 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:44:21.209 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:44:21.210 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:44:21.210 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:44:21.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:44:21 smithi157 bash[24585]: cluster 2024-09-16T12:44:20.136916+0000 mgr.a (mgr.14373) 18471 : cluster [DBG] pgmap v12811: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 3.7 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-16T12:44:21.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:44:21 smithi086 bash[24289]: cluster 2024-09-16T12:44:20.136916+0000 mgr.a (mgr.14373) 18471 : cluster [DBG] pgmap v12811: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 3.7 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-16T12:44:21.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:44:21 smithi047 bash[22744]: cluster 2024-09-16T12:44:20.136916+0000 mgr.a (mgr.14373) 18471 : cluster [DBG] pgmap v12811: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 3.7 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-16T12:44:22.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:44:22 smithi157 bash[24585]: audit 2024-09-16T12:44:20.786998+0000 mgr.a (mgr.14373) 18472 : audit [DBG] from='client.396228 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:44:22.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:44:22 smithi086 bash[24289]: audit 2024-09-16T12:44:20.786998+0000 mgr.a (mgr.14373) 18472 : audit [DBG] from='client.396228 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:44:22.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:44:22 smithi047 bash[22744]: audit 2024-09-16T12:44:20.786998+0000 mgr.a (mgr.14373) 18472 : audit [DBG] from='client.396228 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:44:23.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:44:23 smithi157 bash[24585]: cluster 2024-09-16T12:44:22.139224+0000 mgr.a (mgr.14373) 18473 : cluster [DBG] pgmap v12812: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:44:23.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:44:23 smithi086 bash[24289]: cluster 2024-09-16T12:44:22.139224+0000 mgr.a (mgr.14373) 18473 : cluster [DBG] pgmap v12812: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:44:23.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:44:23 smithi047 bash[22744]: cluster 2024-09-16T12:44:22.139224+0000 mgr.a (mgr.14373) 18473 : cluster [DBG] pgmap v12812: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:44:25.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:44:25 smithi157 bash[24585]: cluster 2024-09-16T12:44:24.140046+0000 mgr.a (mgr.14373) 18474 : cluster [DBG] pgmap v12813: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:44:25.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:44:25 smithi086 bash[24289]: cluster 2024-09-16T12:44:24.140046+0000 mgr.a (mgr.14373) 18474 : cluster [DBG] pgmap v12813: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:44:25.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:44:25 smithi047 bash[22744]: cluster 2024-09-16T12:44:24.140046+0000 mgr.a (mgr.14373) 18474 : cluster [DBG] pgmap v12813: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:44:26.210 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:44:26.211 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:44:26.211 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:44:27.000 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:44:27.001 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:44:27.001 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:44:27.001 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:44:27.001 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:44:27.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:44:27 smithi157 bash[24585]: cluster 2024-09-16T12:44:26.140852+0000 mgr.a (mgr.14373) 18475 : cluster [DBG] pgmap v12814: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:44:27.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:44:27 smithi086 bash[24289]: cluster 2024-09-16T12:44:26.140852+0000 mgr.a (mgr.14373) 18475 : cluster [DBG] pgmap v12814: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:44:27.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:44:27 smithi047 bash[22744]: cluster 2024-09-16T12:44:26.140852+0000 mgr.a (mgr.14373) 18475 : cluster [DBG] pgmap v12814: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:44:28.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:44:28 smithi157 bash[24585]: audit 2024-09-16T12:44:26.546619+0000 mgr.a (mgr.14373) 18476 : audit [DBG] from='client.396303 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:44:28.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:44:28 smithi086 bash[24289]: audit 2024-09-16T12:44:26.546619+0000 mgr.a (mgr.14373) 18476 : audit [DBG] from='client.396303 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:44:28.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:44:28 smithi047 bash[22744]: audit 2024-09-16T12:44:26.546619+0000 mgr.a (mgr.14373) 18476 : audit [DBG] from='client.396303 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:44:29.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:44:29 smithi157 bash[24585]: cluster 2024-09-16T12:44:28.143682+0000 mgr.a (mgr.14373) 18477 : cluster [DBG] pgmap v12815: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:44:29.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:44:29 smithi086 bash[24289]: cluster 2024-09-16T12:44:28.143682+0000 mgr.a (mgr.14373) 18477 : cluster [DBG] pgmap v12815: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:44:29.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:44:29 smithi047 bash[22744]: cluster 2024-09-16T12:44:28.143682+0000 mgr.a (mgr.14373) 18477 : cluster [DBG] pgmap v12815: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:44:31.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:44:31 smithi157 bash[24585]: cluster 2024-09-16T12:44:30.144483+0000 mgr.a (mgr.14373) 18478 : cluster [DBG] pgmap v12816: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 4.2 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-16T12:44:31.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:44:31 smithi086 bash[24289]: cluster 2024-09-16T12:44:30.144483+0000 mgr.a (mgr.14373) 18478 : cluster [DBG] pgmap v12816: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 4.2 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-16T12:44:31.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:44:31 smithi047 bash[22744]: cluster 2024-09-16T12:44:30.144483+0000 mgr.a (mgr.14373) 18478 : cluster [DBG] pgmap v12816: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 4.2 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-16T12:44:32.002 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:44:32.003 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:44:32.003 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:44:32.754 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:44:32.755 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:44:32.755 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:44:32.755 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:44:32.755 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:44:33.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:44:33 smithi157 bash[24585]: cluster 2024-09-16T12:44:32.145933+0000 mgr.a (mgr.14373) 18479 : cluster [DBG] pgmap v12817: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 5.2 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-16T12:44:33.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:44:33 smithi086 bash[24289]: cluster 2024-09-16T12:44:32.145933+0000 mgr.a (mgr.14373) 18479 : cluster [DBG] pgmap v12817: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 5.2 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-16T12:44:33.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:44:33 smithi047 bash[22744]: cluster 2024-09-16T12:44:32.145933+0000 mgr.a (mgr.14373) 18479 : cluster [DBG] pgmap v12817: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 5.2 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-16T12:44:34.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:44:34 smithi157 bash[24585]: audit 2024-09-16T12:44:32.331106+0000 mgr.a (mgr.14373) 18480 : audit [DBG] from='client.396375 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:44:34.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:44:34 smithi086 bash[24289]: audit 2024-09-16T12:44:32.331106+0000 mgr.a (mgr.14373) 18480 : audit [DBG] from='client.396375 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:44:34.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:44:34 smithi047 bash[22744]: audit 2024-09-16T12:44:32.331106+0000 mgr.a (mgr.14373) 18480 : audit [DBG] from='client.396375 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:44:35.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:44:35 smithi157 bash[24585]: cluster 2024-09-16T12:44:34.146923+0000 mgr.a (mgr.14373) 18481 : cluster [DBG] pgmap v12818: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:44:35.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:44:35 smithi086 bash[24289]: cluster 2024-09-16T12:44:34.146923+0000 mgr.a (mgr.14373) 18481 : cluster [DBG] pgmap v12818: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:44:35.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:44:35 smithi047 bash[22744]: cluster 2024-09-16T12:44:34.146923+0000 mgr.a (mgr.14373) 18481 : cluster [DBG] pgmap v12818: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:44:37.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:44:37 smithi157 bash[24585]: cluster 2024-09-16T12:44:36.147711+0000 mgr.a (mgr.14373) 18482 : cluster [DBG] pgmap v12819: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T12:44:37.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:44:37 smithi086 bash[24289]: cluster 2024-09-16T12:44:36.147711+0000 mgr.a (mgr.14373) 18482 : cluster [DBG] pgmap v12819: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T12:44:37.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:44:37 smithi047 bash[22744]: cluster 2024-09-16T12:44:36.147711+0000 mgr.a (mgr.14373) 18482 : cluster [DBG] pgmap v12819: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T12:44:37.756 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:44:37.757 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:44:37.757 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:44:38.514 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:44:38.514 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:44:38.514 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:44:38.514 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:44:38.514 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:44:39.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:44:39 smithi157 bash[24585]: audit 2024-09-16T12:44:38.085012+0000 mgr.a (mgr.14373) 18483 : audit [DBG] from='client.396444 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:44:39.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:44:39 smithi157 bash[24585]: cluster 2024-09-16T12:44:38.149085+0000 mgr.a (mgr.14373) 18484 : cluster [DBG] pgmap v12820: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:44:39.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:44:39 smithi086 bash[24289]: audit 2024-09-16T12:44:38.085012+0000 mgr.a (mgr.14373) 18483 : audit [DBG] from='client.396444 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:44:39.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:44:39 smithi086 bash[24289]: cluster 2024-09-16T12:44:38.149085+0000 mgr.a (mgr.14373) 18484 : cluster [DBG] pgmap v12820: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:44:39.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:44:39 smithi047 bash[22744]: audit 2024-09-16T12:44:38.085012+0000 mgr.a (mgr.14373) 18483 : audit [DBG] from='client.396444 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:44:39.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:44:39 smithi047 bash[22744]: cluster 2024-09-16T12:44:38.149085+0000 mgr.a (mgr.14373) 18484 : cluster [DBG] pgmap v12820: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:44:41.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:44:41 smithi157 bash[24585]: cluster 2024-09-16T12:44:40.150013+0000 mgr.a (mgr.14373) 18485 : cluster [DBG] pgmap v12821: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:44:41.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:44:41 smithi086 bash[24289]: cluster 2024-09-16T12:44:40.150013+0000 mgr.a (mgr.14373) 18485 : cluster [DBG] pgmap v12821: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:44:41.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:44:41 smithi047 bash[22744]: cluster 2024-09-16T12:44:40.150013+0000 mgr.a (mgr.14373) 18485 : cluster [DBG] pgmap v12821: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:44:43.515 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:44:43.516 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:44:43.516 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:44:43.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:44:43 smithi157 bash[24585]: cluster 2024-09-16T12:44:42.152214+0000 mgr.a (mgr.14373) 18486 : cluster [DBG] pgmap v12822: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:44:43.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:44:43 smithi086 bash[24289]: cluster 2024-09-16T12:44:42.152214+0000 mgr.a (mgr.14373) 18486 : cluster [DBG] pgmap v12822: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:44:43.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:44:43 smithi047 bash[22744]: cluster 2024-09-16T12:44:42.152214+0000 mgr.a (mgr.14373) 18486 : cluster [DBG] pgmap v12822: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:44:44.273 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:44:44.273 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:44:44.274 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:44:44.274 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:44:44.274 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:44:45.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:44:45 smithi157 bash[24585]: audit 2024-09-16T12:44:43.849063+0000 mgr.a (mgr.14373) 18487 : audit [DBG] from='client.396519 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:44:45.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:44:45 smithi157 bash[24585]: cluster 2024-09-16T12:44:44.152672+0000 mgr.a (mgr.14373) 18488 : cluster [DBG] pgmap v12823: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:44:45.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:44:45 smithi086 bash[24289]: audit 2024-09-16T12:44:43.849063+0000 mgr.a (mgr.14373) 18487 : audit [DBG] from='client.396519 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:44:45.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:44:45 smithi086 bash[24289]: cluster 2024-09-16T12:44:44.152672+0000 mgr.a (mgr.14373) 18488 : cluster [DBG] pgmap v12823: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:44:45.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:44:45 smithi047 bash[22744]: audit 2024-09-16T12:44:43.849063+0000 mgr.a (mgr.14373) 18487 : audit [DBG] from='client.396519 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:44:45.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:44:45 smithi047 bash[22744]: cluster 2024-09-16T12:44:44.152672+0000 mgr.a (mgr.14373) 18488 : cluster [DBG] pgmap v12823: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:44:47.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:44:47 smithi157 bash[24585]: cluster 2024-09-16T12:44:46.153551+0000 mgr.a (mgr.14373) 18489 : cluster [DBG] pgmap v12824: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:44:47.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:44:47 smithi086 bash[24289]: cluster 2024-09-16T12:44:46.153551+0000 mgr.a (mgr.14373) 18489 : cluster [DBG] pgmap v12824: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:44:47.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:44:47 smithi047 bash[22744]: cluster 2024-09-16T12:44:46.153551+0000 mgr.a (mgr.14373) 18489 : cluster [DBG] pgmap v12824: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:44:49.275 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:44:49.275 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:44:49.276 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:44:49.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:44:49 smithi157 bash[24585]: cluster 2024-09-16T12:44:48.155850+0000 mgr.a (mgr.14373) 18490 : cluster [DBG] pgmap v12825: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:44:49.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:44:49 smithi086 bash[24289]: cluster 2024-09-16T12:44:48.155850+0000 mgr.a (mgr.14373) 18490 : cluster [DBG] pgmap v12825: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:44:49.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:44:49 smithi047 bash[22744]: cluster 2024-09-16T12:44:48.155850+0000 mgr.a (mgr.14373) 18490 : cluster [DBG] pgmap v12825: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:44:50.064 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:44:50.065 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:44:50.065 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:44:50.065 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:44:50.065 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:44:51.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:44:51 smithi157 bash[24585]: audit 2024-09-16T12:44:49.613395+0000 mgr.a (mgr.14373) 18491 : audit [DBG] from='client.396594 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:44:51.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:44:51 smithi157 bash[24585]: cluster 2024-09-16T12:44:50.156796+0000 mgr.a (mgr.14373) 18492 : cluster [DBG] pgmap v12826: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:44:51.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:44:51 smithi086 bash[24289]: audit 2024-09-16T12:44:49.613395+0000 mgr.a (mgr.14373) 18491 : audit [DBG] from='client.396594 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:44:51.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:44:51 smithi086 bash[24289]: cluster 2024-09-16T12:44:50.156796+0000 mgr.a (mgr.14373) 18492 : cluster [DBG] pgmap v12826: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:44:51.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:44:51 smithi047 bash[22744]: audit 2024-09-16T12:44:49.613395+0000 mgr.a (mgr.14373) 18491 : audit [DBG] from='client.396594 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:44:51.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:44:51 smithi047 bash[22744]: cluster 2024-09-16T12:44:50.156796+0000 mgr.a (mgr.14373) 18492 : cluster [DBG] pgmap v12826: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:44:53.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:44:53 smithi157 bash[24585]: cluster 2024-09-16T12:44:52.159004+0000 mgr.a (mgr.14373) 18493 : cluster [DBG] pgmap v12827: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:44:53.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:44:53 smithi086 bash[24289]: cluster 2024-09-16T12:44:52.159004+0000 mgr.a (mgr.14373) 18493 : cluster [DBG] pgmap v12827: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:44:53.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:44:53 smithi047 bash[22744]: cluster 2024-09-16T12:44:52.159004+0000 mgr.a (mgr.14373) 18493 : cluster [DBG] pgmap v12827: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:44:55.066 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:44:55.067 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:44:55.067 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:44:55.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:44:55 smithi157 bash[24585]: cluster 2024-09-16T12:44:54.159753+0000 mgr.a (mgr.14373) 18494 : cluster [DBG] pgmap v12828: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:44:55.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:44:55 smithi086 bash[24289]: cluster 2024-09-16T12:44:54.159753+0000 mgr.a (mgr.14373) 18494 : cluster [DBG] pgmap v12828: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:44:55.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:44:55 smithi047 bash[22744]: cluster 2024-09-16T12:44:54.159753+0000 mgr.a (mgr.14373) 18494 : cluster [DBG] pgmap v12828: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:44:55.850 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:44:55.850 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:44:55.850 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:44:55.850 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:44:55.850 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:44:57.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:44:57 smithi157 bash[24585]: audit 2024-09-16T12:44:55.399089+0000 mgr.a (mgr.14373) 18495 : audit [DBG] from='client.396672 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:44:57.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:44:57 smithi157 bash[24585]: cluster 2024-09-16T12:44:56.160729+0000 mgr.a (mgr.14373) 18496 : cluster [DBG] pgmap v12829: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:44:57.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:44:57 smithi086 bash[24289]: audit 2024-09-16T12:44:55.399089+0000 mgr.a (mgr.14373) 18495 : audit [DBG] from='client.396672 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:44:57.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:44:57 smithi086 bash[24289]: cluster 2024-09-16T12:44:56.160729+0000 mgr.a (mgr.14373) 18496 : cluster [DBG] pgmap v12829: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:44:57.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:44:57 smithi047 bash[22744]: audit 2024-09-16T12:44:55.399089+0000 mgr.a (mgr.14373) 18495 : audit [DBG] from='client.396672 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:44:57.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:44:57 smithi047 bash[22744]: cluster 2024-09-16T12:44:56.160729+0000 mgr.a (mgr.14373) 18496 : cluster [DBG] pgmap v12829: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:44:59.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:44:59 smithi086 bash[24289]: cluster 2024-09-16T12:44:58.163025+0000 mgr.a (mgr.14373) 18497 : cluster [DBG] pgmap v12830: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:44:59.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:44:59 smithi047 bash[22744]: cluster 2024-09-16T12:44:58.163025+0000 mgr.a (mgr.14373) 18497 : cluster [DBG] pgmap v12830: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:44:59.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:44:59 smithi157 bash[24585]: cluster 2024-09-16T12:44:58.163025+0000 mgr.a (mgr.14373) 18497 : cluster [DBG] pgmap v12830: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:45:00.851 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:45:00.852 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:45:00.852 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:45:01.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:45:01 smithi157 bash[24585]: cluster 2024-09-16T12:45:00.163799+0000 mgr.a (mgr.14373) 18498 : cluster [DBG] pgmap v12831: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:45:01.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:45:01 smithi086 bash[24289]: cluster 2024-09-16T12:45:00.163799+0000 mgr.a (mgr.14373) 18498 : cluster [DBG] pgmap v12831: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:45:01.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:45:01 smithi047 bash[22744]: cluster 2024-09-16T12:45:00.163799+0000 mgr.a (mgr.14373) 18498 : cluster [DBG] pgmap v12831: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:45:01.632 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:45:01.633 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:45:01.633 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:45:01.633 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:45:01.633 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:45:02.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:45:02 smithi047 bash[22744]: audit 2024-09-16T12:45:01.186024+0000 mgr.a (mgr.14373) 18499 : audit [DBG] from='client.396750 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:45:02.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:45:02 smithi157 bash[24585]: audit 2024-09-16T12:45:01.186024+0000 mgr.a (mgr.14373) 18499 : audit [DBG] from='client.396750 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:45:02.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:45:02 smithi086 bash[24289]: audit 2024-09-16T12:45:01.186024+0000 mgr.a (mgr.14373) 18499 : audit [DBG] from='client.396750 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:45:03.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:45:03 smithi047 bash[22744]: cluster 2024-09-16T12:45:02.166664+0000 mgr.a (mgr.14373) 18500 : cluster [DBG] pgmap v12832: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-16T12:45:03.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:45:03 smithi157 bash[24585]: cluster 2024-09-16T12:45:02.166664+0000 mgr.a (mgr.14373) 18500 : cluster [DBG] pgmap v12832: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-16T12:45:03.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:45:03 smithi086 bash[24289]: cluster 2024-09-16T12:45:02.166664+0000 mgr.a (mgr.14373) 18500 : cluster [DBG] pgmap v12832: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-16T12:45:05.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:45:05 smithi047 bash[22744]: cluster 2024-09-16T12:45:04.167479+0000 mgr.a (mgr.14373) 18501 : cluster [DBG] pgmap v12833: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T12:45:05.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:45:05 smithi157 bash[24585]: cluster 2024-09-16T12:45:04.167479+0000 mgr.a (mgr.14373) 18501 : cluster [DBG] pgmap v12833: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T12:45:05.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:45:05 smithi086 bash[24289]: cluster 2024-09-16T12:45:04.167479+0000 mgr.a (mgr.14373) 18501 : cluster [DBG] pgmap v12833: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T12:45:06.634 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:45:06.635 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:45:06.635 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:45:07.394 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:45:07.394 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:45:07.394 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:45:07.394 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:45:07.394 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:45:07.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:45:07 smithi047 bash[22744]: cluster 2024-09-16T12:45:06.168253+0000 mgr.a (mgr.14373) 18502 : cluster [DBG] pgmap v12834: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T12:45:07.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:45:07 smithi157 bash[24585]: cluster 2024-09-16T12:45:06.168253+0000 mgr.a (mgr.14373) 18502 : cluster [DBG] pgmap v12834: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T12:45:07.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:45:07 smithi086 bash[24289]: cluster 2024-09-16T12:45:06.168253+0000 mgr.a (mgr.14373) 18502 : cluster [DBG] pgmap v12834: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T12:45:08.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:45:08 smithi047 bash[22744]: audit 2024-09-16T12:45:06.962103+0000 mgr.a (mgr.14373) 18503 : audit [DBG] from='client.396825 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:45:08.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:45:08 smithi157 bash[24585]: audit 2024-09-16T12:45:06.962103+0000 mgr.a (mgr.14373) 18503 : audit [DBG] from='client.396825 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:45:08.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:45:08 smithi086 bash[24289]: audit 2024-09-16T12:45:06.962103+0000 mgr.a (mgr.14373) 18503 : audit [DBG] from='client.396825 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:45:09.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:45:09 smithi157 bash[24585]: cluster 2024-09-16T12:45:08.171102+0000 mgr.a (mgr.14373) 18504 : cluster [DBG] pgmap v12835: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:45:09.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:45:09 smithi086 bash[24289]: cluster 2024-09-16T12:45:08.171102+0000 mgr.a (mgr.14373) 18504 : cluster [DBG] pgmap v12835: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:45:09.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:45:09 smithi047 bash[22744]: cluster 2024-09-16T12:45:08.171102+0000 mgr.a (mgr.14373) 18504 : cluster [DBG] pgmap v12835: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:45:10.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:45:10 smithi157 bash[24585]: cluster 2024-09-16T12:45:10.171918+0000 mgr.a (mgr.14373) 18505 : cluster [DBG] pgmap v12836: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:45:10.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:45:10 smithi086 bash[24289]: cluster 2024-09-16T12:45:10.171918+0000 mgr.a (mgr.14373) 18505 : cluster [DBG] pgmap v12836: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:45:10.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:45:10 smithi047 bash[22744]: cluster 2024-09-16T12:45:10.171918+0000 mgr.a (mgr.14373) 18505 : cluster [DBG] pgmap v12836: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:45:12.395 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:45:12.396 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:45:12.396 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:45:13.146 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:45:13.146 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:45:13.147 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:45:13.147 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:45:13.147 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:45:13.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:45:13 smithi157 bash[24585]: cluster 2024-09-16T12:45:12.173842+0000 mgr.a (mgr.14373) 18506 : cluster [DBG] pgmap v12837: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:45:13.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:45:13 smithi086 bash[24289]: cluster 2024-09-16T12:45:12.173842+0000 mgr.a (mgr.14373) 18506 : cluster [DBG] pgmap v12837: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:45:13.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:45:13 smithi047 bash[22744]: cluster 2024-09-16T12:45:12.173842+0000 mgr.a (mgr.14373) 18506 : cluster [DBG] pgmap v12837: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:45:14.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:45:14 smithi157 bash[24585]: audit 2024-09-16T12:45:12.724048+0000 mgr.a (mgr.14373) 18507 : audit [DBG] from='client.396903 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:45:14.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:45:14 smithi086 bash[24289]: audit 2024-09-16T12:45:12.724048+0000 mgr.a (mgr.14373) 18507 : audit [DBG] from='client.396903 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:45:14.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:45:14 smithi047 bash[22744]: audit 2024-09-16T12:45:12.724048+0000 mgr.a (mgr.14373) 18507 : audit [DBG] from='client.396903 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:45:15.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:45:15 smithi157 bash[24585]: cluster 2024-09-16T12:45:14.174979+0000 mgr.a (mgr.14373) 18508 : cluster [DBG] pgmap v12838: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-09-16T12:45:15.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:45:15 smithi086 bash[24289]: cluster 2024-09-16T12:45:14.174979+0000 mgr.a (mgr.14373) 18508 : cluster [DBG] pgmap v12838: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-09-16T12:45:15.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:45:15 smithi047 bash[22744]: cluster 2024-09-16T12:45:14.174979+0000 mgr.a (mgr.14373) 18508 : cluster [DBG] pgmap v12838: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-09-16T12:45:17.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:45:17 smithi157 bash[24585]: cluster 2024-09-16T12:45:16.175961+0000 mgr.a (mgr.14373) 18509 : cluster [DBG] pgmap v12839: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-09-16T12:45:17.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:45:17 smithi157 bash[24585]: audit 2024-09-16T12:45:16.880275+0000 mon.b (mon.2) 1674 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T12:45:17.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:45:17 smithi086 bash[24289]: cluster 2024-09-16T12:45:16.175961+0000 mgr.a (mgr.14373) 18509 : cluster [DBG] pgmap v12839: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-09-16T12:45:17.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:45:17 smithi086 bash[24289]: audit 2024-09-16T12:45:16.880275+0000 mon.b (mon.2) 1674 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T12:45:17.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:45:17 smithi047 bash[22744]: cluster 2024-09-16T12:45:16.175961+0000 mgr.a (mgr.14373) 18509 : cluster [DBG] pgmap v12839: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-09-16T12:45:17.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:45:17 smithi047 bash[22744]: audit 2024-09-16T12:45:16.880275+0000 mon.b (mon.2) 1674 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T12:45:18.148 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:45:18.148 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:45:18.148 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:45:18.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:45:18 smithi157 bash[24585]: audit 2024-09-16T12:45:17.490848+0000 mon.a (mon.0) 1669 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:45:18.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:45:18 smithi157 bash[24585]: audit 2024-09-16T12:45:17.493499+0000 mon.a (mon.0) 1670 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:45:18.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:45:18 smithi157 bash[24585]: audit 2024-09-16T12:45:17.496820+0000 mon.a (mon.0) 1671 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:45:18.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:45:18 smithi157 bash[24585]: audit 2024-09-16T12:45:17.499471+0000 mon.a (mon.0) 1672 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:45:18.808 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:45:18 smithi157 bash[24585]: cluster 2024-09-16T12:45:18.177549+0000 mgr.a (mgr.14373) 18510 : cluster [DBG] pgmap v12840: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.4 KiB/s rd, 2 op/s 2024-09-16T12:45:18.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:45:18 smithi086 bash[24289]: audit 2024-09-16T12:45:17.490848+0000 mon.a (mon.0) 1669 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:45:18.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:45:18 smithi086 bash[24289]: audit 2024-09-16T12:45:17.493499+0000 mon.a (mon.0) 1670 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:45:18.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:45:18 smithi086 bash[24289]: audit 2024-09-16T12:45:17.496820+0000 mon.a (mon.0) 1671 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:45:18.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:45:18 smithi086 bash[24289]: audit 2024-09-16T12:45:17.499471+0000 mon.a (mon.0) 1672 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:45:18.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:45:18 smithi086 bash[24289]: cluster 2024-09-16T12:45:18.177549+0000 mgr.a (mgr.14373) 18510 : cluster [DBG] pgmap v12840: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.4 KiB/s rd, 2 op/s 2024-09-16T12:45:18.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:45:18 smithi047 bash[22744]: audit 2024-09-16T12:45:17.490848+0000 mon.a (mon.0) 1669 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:45:18.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:45:18 smithi047 bash[22744]: audit 2024-09-16T12:45:17.493499+0000 mon.a (mon.0) 1670 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:45:18.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:45:18 smithi047 bash[22744]: audit 2024-09-16T12:45:17.496820+0000 mon.a (mon.0) 1671 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:45:18.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:45:18 smithi047 bash[22744]: audit 2024-09-16T12:45:17.499471+0000 mon.a (mon.0) 1672 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:45:18.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:45:18 smithi047 bash[22744]: cluster 2024-09-16T12:45:18.177549+0000 mgr.a (mgr.14373) 18510 : cluster [DBG] pgmap v12840: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.4 KiB/s rd, 2 op/s 2024-09-16T12:45:18.893 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:45:18.893 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:45:18.893 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:45:18.893 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:45:18.893 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:45:19.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:45:19 smithi157 bash[24585]: audit 2024-09-16T12:45:18.468447+0000 mgr.a (mgr.14373) 18511 : audit [DBG] from='client.396981 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:45:19.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:45:19 smithi086 bash[24289]: audit 2024-09-16T12:45:18.468447+0000 mgr.a (mgr.14373) 18511 : audit [DBG] from='client.396981 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:45:19.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:45:19 smithi047 bash[22744]: audit 2024-09-16T12:45:18.468447+0000 mgr.a (mgr.14373) 18511 : audit [DBG] from='client.396981 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:45:20.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:45:20 smithi157 bash[24585]: cluster 2024-09-16T12:45:20.178546+0000 mgr.a (mgr.14373) 18512 : cluster [DBG] pgmap v12841: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:45:20.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:45:20 smithi086 bash[24289]: cluster 2024-09-16T12:45:20.178546+0000 mgr.a (mgr.14373) 18512 : cluster [DBG] pgmap v12841: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:45:20.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:45:20 smithi047 bash[22744]: cluster 2024-09-16T12:45:20.178546+0000 mgr.a (mgr.14373) 18512 : cluster [DBG] pgmap v12841: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:45:23.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:45:23 smithi157 bash[24585]: cluster 2024-09-16T12:45:22.180930+0000 mgr.a (mgr.14373) 18513 : cluster [DBG] pgmap v12842: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:45:23.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:45:23 smithi086 bash[24289]: cluster 2024-09-16T12:45:22.180930+0000 mgr.a (mgr.14373) 18513 : cluster [DBG] pgmap v12842: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:45:23.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:45:23 smithi047 bash[22744]: cluster 2024-09-16T12:45:22.180930+0000 mgr.a (mgr.14373) 18513 : cluster [DBG] pgmap v12842: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:45:23.894 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:45:23.895 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:45:23.895 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:45:24.645 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:45:24.645 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:45:24.645 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:45:24.645 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:45:24.645 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:45:25.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:45:25 smithi157 bash[24585]: cluster 2024-09-16T12:45:24.181817+0000 mgr.a (mgr.14373) 18514 : cluster [DBG] pgmap v12843: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:45:25.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:45:25 smithi157 bash[24585]: audit 2024-09-16T12:45:24.214352+0000 mgr.a (mgr.14373) 18515 : audit [DBG] from='client.397056 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:45:25.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:45:25 smithi086 bash[24289]: cluster 2024-09-16T12:45:24.181817+0000 mgr.a (mgr.14373) 18514 : cluster [DBG] pgmap v12843: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:45:25.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:45:25 smithi086 bash[24289]: audit 2024-09-16T12:45:24.214352+0000 mgr.a (mgr.14373) 18515 : audit [DBG] from='client.397056 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:45:25.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:45:25 smithi047 bash[22744]: cluster 2024-09-16T12:45:24.181817+0000 mgr.a (mgr.14373) 18514 : cluster [DBG] pgmap v12843: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:45:25.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:45:25 smithi047 bash[22744]: audit 2024-09-16T12:45:24.214352+0000 mgr.a (mgr.14373) 18515 : audit [DBG] from='client.397056 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:45:27.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:45:27 smithi157 bash[24585]: cluster 2024-09-16T12:45:26.182775+0000 mgr.a (mgr.14373) 18516 : cluster [DBG] pgmap v12844: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:45:27.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:45:27 smithi086 bash[24289]: cluster 2024-09-16T12:45:26.182775+0000 mgr.a (mgr.14373) 18516 : cluster [DBG] pgmap v12844: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:45:27.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:45:27 smithi047 bash[22744]: cluster 2024-09-16T12:45:26.182775+0000 mgr.a (mgr.14373) 18516 : cluster [DBG] pgmap v12844: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:45:28.843 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 12:45:28 smithi047 bash[22994]: debug 2024-09-16T12:45:28.518+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T12:45:28.843 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 12:45:28 smithi047 bash[22994]: debug 2024-09-16T12:45:28.522+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T12:45:28.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:45:28 smithi047 bash[22744]: audit 2024-09-16T12:45:27.688975+0000 mon.a (mon.0) 1673 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:45:28.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:45:28 smithi047 bash[22744]: audit 2024-09-16T12:45:27.700492+0000 mon.a (mon.0) 1674 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:45:28.844 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:45:28 smithi047 bash[22744]: audit 2024-09-16T12:45:27.704934+0000 mon.b (mon.2) 1675 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T12:45:28.844 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:45:28 smithi047 bash[22744]: audit 2024-09-16T12:45:27.707325+0000 mon.b (mon.2) 1676 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T12:45:28.844 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:45:28 smithi047 bash[22744]: audit 2024-09-16T12:45:27.719581+0000 mon.a (mon.0) 1675 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:45:28.844 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:45:28 smithi047 bash[22744]: audit 2024-09-16T12:45:27.726580+0000 mon.b (mon.2) 1677 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:45:28.844 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:45:28 smithi047 bash[22744]: audit 2024-09-16T12:45:27.729036+0000 mgr.a (mgr.14373) 18517 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:45:28.844 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:45:28 smithi047 bash[22744]: cluster 2024-09-16T12:45:28.184907+0000 mgr.a (mgr.14373) 18518 : cluster [DBG] pgmap v12845: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:45:29.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:45:28 smithi157 bash[24585]: audit 2024-09-16T12:45:27.688975+0000 mon.a (mon.0) 1673 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:45:29.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:45:28 smithi157 bash[24585]: audit 2024-09-16T12:45:27.700492+0000 mon.a (mon.0) 1674 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:45:29.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:45:28 smithi157 bash[24585]: audit 2024-09-16T12:45:27.704934+0000 mon.b (mon.2) 1675 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T12:45:29.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:45:28 smithi157 bash[24585]: audit 2024-09-16T12:45:27.707325+0000 mon.b (mon.2) 1676 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T12:45:29.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:45:28 smithi157 bash[24585]: audit 2024-09-16T12:45:27.719581+0000 mon.a (mon.0) 1675 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:45:29.058 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:45:28 smithi157 bash[24585]: audit 2024-09-16T12:45:27.726580+0000 mon.b (mon.2) 1677 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:45:29.058 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:45:28 smithi157 bash[24585]: audit 2024-09-16T12:45:27.729036+0000 mgr.a (mgr.14373) 18517 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:45:29.058 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:45:28 smithi157 bash[24585]: cluster 2024-09-16T12:45:28.184907+0000 mgr.a (mgr.14373) 18518 : cluster [DBG] pgmap v12845: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:45:29.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:45:28 smithi086 bash[24289]: audit 2024-09-16T12:45:27.688975+0000 mon.a (mon.0) 1673 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:45:29.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:45:28 smithi086 bash[24289]: audit 2024-09-16T12:45:27.700492+0000 mon.a (mon.0) 1674 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:45:29.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:45:28 smithi086 bash[24289]: audit 2024-09-16T12:45:27.704934+0000 mon.b (mon.2) 1675 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T12:45:29.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:45:28 smithi086 bash[24289]: audit 2024-09-16T12:45:27.707325+0000 mon.b (mon.2) 1676 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T12:45:29.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:45:28 smithi086 bash[24289]: audit 2024-09-16T12:45:27.719581+0000 mon.a (mon.0) 1675 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:45:29.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:45:28 smithi086 bash[24289]: audit 2024-09-16T12:45:27.726580+0000 mon.b (mon.2) 1677 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:45:29.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:45:28 smithi086 bash[24289]: audit 2024-09-16T12:45:27.729036+0000 mgr.a (mgr.14373) 18517 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:45:29.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:45:28 smithi086 bash[24289]: cluster 2024-09-16T12:45:28.184907+0000 mgr.a (mgr.14373) 18518 : cluster [DBG] pgmap v12845: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:45:29.646 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:45:29.647 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:45:29.647 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:45:30.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:45:29 smithi157 bash[24585]: audit 2024-09-16T12:45:28.520634+0000 mgr.a (mgr.14373) 18519 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T12:45:30.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:45:29 smithi157 bash[24585]: cephadm 2024-09-16T12:45:28.523146+0000 mgr.a (mgr.14373) 18520 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T12:45:30.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:45:29 smithi086 bash[24289]: audit 2024-09-16T12:45:28.520634+0000 mgr.a (mgr.14373) 18519 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T12:45:30.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:45:29 smithi086 bash[24289]: cephadm 2024-09-16T12:45:28.523146+0000 mgr.a (mgr.14373) 18520 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T12:45:30.092 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:45:29 smithi047 bash[22744]: audit 2024-09-16T12:45:28.520634+0000 mgr.a (mgr.14373) 18519 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T12:45:30.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:45:29 smithi047 bash[22744]: cephadm 2024-09-16T12:45:28.523146+0000 mgr.a (mgr.14373) 18520 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T12:45:30.407 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:45:30.407 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:45:30.407 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:45:30.408 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:45:30.408 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:45:31.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:45:30 smithi157 bash[24585]: audit 2024-09-16T12:45:29.981409+0000 mgr.a (mgr.14373) 18521 : audit [DBG] from='client.397239 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:45:31.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:45:30 smithi157 bash[24585]: cluster 2024-09-16T12:45:30.185380+0000 mgr.a (mgr.14373) 18522 : cluster [DBG] pgmap v12846: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:45:31.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:45:30 smithi086 bash[24289]: audit 2024-09-16T12:45:29.981409+0000 mgr.a (mgr.14373) 18521 : audit [DBG] from='client.397239 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:45:31.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:45:30 smithi086 bash[24289]: cluster 2024-09-16T12:45:30.185380+0000 mgr.a (mgr.14373) 18522 : cluster [DBG] pgmap v12846: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:45:31.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:45:30 smithi047 bash[22744]: audit 2024-09-16T12:45:29.981409+0000 mgr.a (mgr.14373) 18521 : audit [DBG] from='client.397239 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:45:31.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:45:30 smithi047 bash[22744]: cluster 2024-09-16T12:45:30.185380+0000 mgr.a (mgr.14373) 18522 : cluster [DBG] pgmap v12846: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:45:33.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:45:33 smithi157 bash[24585]: cluster 2024-09-16T12:45:32.187660+0000 mgr.a (mgr.14373) 18523 : cluster [DBG] pgmap v12847: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:45:33.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:45:33 smithi086 bash[24289]: cluster 2024-09-16T12:45:32.187660+0000 mgr.a (mgr.14373) 18523 : cluster [DBG] pgmap v12847: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:45:33.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:45:33 smithi047 bash[22744]: cluster 2024-09-16T12:45:32.187660+0000 mgr.a (mgr.14373) 18523 : cluster [DBG] pgmap v12847: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:45:35.409 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:45:35.410 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:45:35.410 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:45:35.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:45:35 smithi157 bash[24585]: cluster 2024-09-16T12:45:34.188423+0000 mgr.a (mgr.14373) 18524 : cluster [DBG] pgmap v12848: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:45:35.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:45:35 smithi086 bash[24289]: cluster 2024-09-16T12:45:34.188423+0000 mgr.a (mgr.14373) 18524 : cluster [DBG] pgmap v12848: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:45:35.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:45:35 smithi047 bash[22744]: cluster 2024-09-16T12:45:34.188423+0000 mgr.a (mgr.14373) 18524 : cluster [DBG] pgmap v12848: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:45:36.194 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:45:36.195 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:45:36.195 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:45:36.195 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:45:36.195 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:45:37.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:45:37 smithi157 bash[24585]: audit 2024-09-16T12:45:35.749230+0000 mgr.a (mgr.14373) 18525 : audit [DBG] from='client.397317 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:45:37.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:45:37 smithi157 bash[24585]: cluster 2024-09-16T12:45:36.188932+0000 mgr.a (mgr.14373) 18526 : cluster [DBG] pgmap v12849: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:45:37.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:45:37 smithi086 bash[24289]: audit 2024-09-16T12:45:35.749230+0000 mgr.a (mgr.14373) 18525 : audit [DBG] from='client.397317 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:45:37.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:45:37 smithi086 bash[24289]: cluster 2024-09-16T12:45:36.188932+0000 mgr.a (mgr.14373) 18526 : cluster [DBG] pgmap v12849: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:45:37.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:45:37 smithi047 bash[22744]: audit 2024-09-16T12:45:35.749230+0000 mgr.a (mgr.14373) 18525 : audit [DBG] from='client.397317 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:45:37.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:45:37 smithi047 bash[22744]: cluster 2024-09-16T12:45:36.188932+0000 mgr.a (mgr.14373) 18526 : cluster [DBG] pgmap v12849: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:45:39.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:45:39 smithi157 bash[24585]: cluster 2024-09-16T12:45:38.191318+0000 mgr.a (mgr.14373) 18527 : cluster [DBG] pgmap v12850: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:45:39.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:45:39 smithi086 bash[24289]: cluster 2024-09-16T12:45:38.191318+0000 mgr.a (mgr.14373) 18527 : cluster [DBG] pgmap v12850: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:45:39.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:45:39 smithi047 bash[22744]: cluster 2024-09-16T12:45:38.191318+0000 mgr.a (mgr.14373) 18527 : cluster [DBG] pgmap v12850: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:45:41.196 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:45:41.197 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:45:41.197 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:45:41.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:45:41 smithi157 bash[24585]: cluster 2024-09-16T12:45:40.192306+0000 mgr.a (mgr.14373) 18528 : cluster [DBG] pgmap v12851: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:45:41.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:45:41 smithi086 bash[24289]: cluster 2024-09-16T12:45:40.192306+0000 mgr.a (mgr.14373) 18528 : cluster [DBG] pgmap v12851: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:45:41.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:45:41 smithi047 bash[22744]: cluster 2024-09-16T12:45:40.192306+0000 mgr.a (mgr.14373) 18528 : cluster [DBG] pgmap v12851: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:45:41.954 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:45:41.954 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:45:41.954 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:45:41.954 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:45:41.954 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:45:43.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:45:43 smithi157 bash[24585]: audit 2024-09-16T12:45:41.525092+0000 mgr.a (mgr.14373) 18529 : audit [DBG] from='client.397392 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:45:43.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:45:43 smithi157 bash[24585]: cluster 2024-09-16T12:45:42.195120+0000 mgr.a (mgr.14373) 18530 : cluster [DBG] pgmap v12852: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:45:43.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:45:43 smithi086 bash[24289]: audit 2024-09-16T12:45:41.525092+0000 mgr.a (mgr.14373) 18529 : audit [DBG] from='client.397392 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:45:43.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:45:43 smithi086 bash[24289]: cluster 2024-09-16T12:45:42.195120+0000 mgr.a (mgr.14373) 18530 : cluster [DBG] pgmap v12852: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:45:43.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:45:43 smithi047 bash[22744]: audit 2024-09-16T12:45:41.525092+0000 mgr.a (mgr.14373) 18529 : audit [DBG] from='client.397392 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:45:43.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:45:43 smithi047 bash[22744]: cluster 2024-09-16T12:45:42.195120+0000 mgr.a (mgr.14373) 18530 : cluster [DBG] pgmap v12852: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:45:45.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:45:45 smithi157 bash[24585]: cluster 2024-09-16T12:45:44.195917+0000 mgr.a (mgr.14373) 18531 : cluster [DBG] pgmap v12853: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:45:45.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:45:45 smithi086 bash[24289]: cluster 2024-09-16T12:45:44.195917+0000 mgr.a (mgr.14373) 18531 : cluster [DBG] pgmap v12853: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:45:45.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:45:45 smithi047 bash[22744]: cluster 2024-09-16T12:45:44.195917+0000 mgr.a (mgr.14373) 18531 : cluster [DBG] pgmap v12853: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:45:46.955 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:45:46.956 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:45:46.956 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:45:47.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:45:47 smithi157 bash[24585]: cluster 2024-09-16T12:45:46.196672+0000 mgr.a (mgr.14373) 18532 : cluster [DBG] pgmap v12854: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T12:45:47.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:45:47 smithi086 bash[24289]: cluster 2024-09-16T12:45:46.196672+0000 mgr.a (mgr.14373) 18532 : cluster [DBG] pgmap v12854: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T12:45:47.592 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:45:47 smithi047 bash[22744]: cluster 2024-09-16T12:45:46.196672+0000 mgr.a (mgr.14373) 18532 : cluster [DBG] pgmap v12854: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T12:45:47.696 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:45:47.696 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:45:47.697 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:45:47.697 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:45:47.697 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:45:48.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:45:48 smithi157 bash[24585]: audit 2024-09-16T12:45:47.286161+0000 mgr.a (mgr.14373) 18533 : audit [DBG] from='client.397470 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:45:48.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:45:48 smithi086 bash[24289]: audit 2024-09-16T12:45:47.286161+0000 mgr.a (mgr.14373) 18533 : audit [DBG] from='client.397470 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:45:48.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:45:48 smithi047 bash[22744]: audit 2024-09-16T12:45:47.286161+0000 mgr.a (mgr.14373) 18533 : audit [DBG] from='client.397470 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:45:49.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:45:49 smithi157 bash[24585]: cluster 2024-09-16T12:45:48.199629+0000 mgr.a (mgr.14373) 18534 : cluster [DBG] pgmap v12855: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:45:49.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:45:49 smithi086 bash[24289]: cluster 2024-09-16T12:45:48.199629+0000 mgr.a (mgr.14373) 18534 : cluster [DBG] pgmap v12855: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:45:49.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:45:49 smithi047 bash[22744]: cluster 2024-09-16T12:45:48.199629+0000 mgr.a (mgr.14373) 18534 : cluster [DBG] pgmap v12855: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:45:51.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:45:51 smithi157 bash[24585]: cluster 2024-09-16T12:45:50.200446+0000 mgr.a (mgr.14373) 18535 : cluster [DBG] pgmap v12856: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:45:51.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:45:51 smithi086 bash[24289]: cluster 2024-09-16T12:45:50.200446+0000 mgr.a (mgr.14373) 18535 : cluster [DBG] pgmap v12856: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:45:51.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:45:51 smithi047 bash[22744]: cluster 2024-09-16T12:45:50.200446+0000 mgr.a (mgr.14373) 18535 : cluster [DBG] pgmap v12856: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:45:52.698 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:45:52.699 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:45:52.699 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:45:53.451 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:45:53.451 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:45:53.451 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:45:53.452 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:45:53.452 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:45:53.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:45:53 smithi157 bash[24585]: cluster 2024-09-16T12:45:52.202416+0000 mgr.a (mgr.14373) 18536 : cluster [DBG] pgmap v12857: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:45:53.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:45:53 smithi086 bash[24289]: cluster 2024-09-16T12:45:52.202416+0000 mgr.a (mgr.14373) 18536 : cluster [DBG] pgmap v12857: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:45:53.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:45:53 smithi047 bash[22744]: cluster 2024-09-16T12:45:52.202416+0000 mgr.a (mgr.14373) 18536 : cluster [DBG] pgmap v12857: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:45:54.558 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:45:54 smithi157 bash[24585]: audit 2024-09-16T12:45:53.030475+0000 mgr.a (mgr.14373) 18537 : audit [DBG] from='client.397542 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:45:54.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:45:54 smithi086 bash[24289]: audit 2024-09-16T12:45:53.030475+0000 mgr.a (mgr.14373) 18537 : audit [DBG] from='client.397542 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:45:54.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:45:54 smithi047 bash[22744]: audit 2024-09-16T12:45:53.030475+0000 mgr.a (mgr.14373) 18537 : audit [DBG] from='client.397542 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:45:55.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:45:55 smithi086 bash[24289]: cluster 2024-09-16T12:45:54.203358+0000 mgr.a (mgr.14373) 18538 : cluster [DBG] pgmap v12858: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:45:55.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:45:55 smithi047 bash[22744]: cluster 2024-09-16T12:45:54.203358+0000 mgr.a (mgr.14373) 18538 : cluster [DBG] pgmap v12858: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:45:55.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:45:55 smithi157 bash[24585]: cluster 2024-09-16T12:45:54.203358+0000 mgr.a (mgr.14373) 18538 : cluster [DBG] pgmap v12858: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:45:57.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:45:57 smithi086 bash[24289]: cluster 2024-09-16T12:45:56.204155+0000 mgr.a (mgr.14373) 18539 : cluster [DBG] pgmap v12859: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:45:57.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:45:57 smithi047 bash[22744]: cluster 2024-09-16T12:45:56.204155+0000 mgr.a (mgr.14373) 18539 : cluster [DBG] pgmap v12859: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:45:57.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:45:57 smithi157 bash[24585]: cluster 2024-09-16T12:45:56.204155+0000 mgr.a (mgr.14373) 18539 : cluster [DBG] pgmap v12859: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:45:58.453 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:45:58.453 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:45:58.453 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:45:59.241 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:45:59.241 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:45:59.242 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:45:59.242 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:45:59.242 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:45:59.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:45:59 smithi086 bash[24289]: cluster 2024-09-16T12:45:58.206387+0000 mgr.a (mgr.14373) 18540 : cluster [DBG] pgmap v12860: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:45:59.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:45:59 smithi047 bash[22744]: cluster 2024-09-16T12:45:58.206387+0000 mgr.a (mgr.14373) 18540 : cluster [DBG] pgmap v12860: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:45:59.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:45:59 smithi157 bash[24585]: cluster 2024-09-16T12:45:58.206387+0000 mgr.a (mgr.14373) 18540 : cluster [DBG] pgmap v12860: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:46:00.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:46:00 smithi086 bash[24289]: audit 2024-09-16T12:45:58.790489+0000 mgr.a (mgr.14373) 18541 : audit [DBG] from='client.397614 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:46:00.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:46:00 smithi047 bash[22744]: audit 2024-09-16T12:45:58.790489+0000 mgr.a (mgr.14373) 18541 : audit [DBG] from='client.397614 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:46:00.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:46:00 smithi157 bash[24585]: audit 2024-09-16T12:45:58.790489+0000 mgr.a (mgr.14373) 18541 : audit [DBG] from='client.397614 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:46:01.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:46:01 smithi047 bash[22744]: cluster 2024-09-16T12:46:00.207353+0000 mgr.a (mgr.14373) 18542 : cluster [DBG] pgmap v12861: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:46:01.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:46:01 smithi157 bash[24585]: cluster 2024-09-16T12:46:00.207353+0000 mgr.a (mgr.14373) 18542 : cluster [DBG] pgmap v12861: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:46:01.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:46:01 smithi086 bash[24289]: cluster 2024-09-16T12:46:00.207353+0000 mgr.a (mgr.14373) 18542 : cluster [DBG] pgmap v12861: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:46:03.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:46:03 smithi047 bash[22744]: cluster 2024-09-16T12:46:02.209497+0000 mgr.a (mgr.14373) 18543 : cluster [DBG] pgmap v12862: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:46:03.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:46:03 smithi157 bash[24585]: cluster 2024-09-16T12:46:02.209497+0000 mgr.a (mgr.14373) 18543 : cluster [DBG] pgmap v12862: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:46:03.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:46:03 smithi086 bash[24289]: cluster 2024-09-16T12:46:02.209497+0000 mgr.a (mgr.14373) 18543 : cluster [DBG] pgmap v12862: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:46:04.243 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:46:04.244 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:46:04.244 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:46:05.017 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:46:05.018 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:46:05.018 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:46:05.018 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:46:05.018 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:46:05.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:46:05 smithi047 bash[22744]: cluster 2024-09-16T12:46:04.210275+0000 mgr.a (mgr.14373) 18544 : cluster [DBG] pgmap v12863: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:46:05.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:46:05 smithi157 bash[24585]: cluster 2024-09-16T12:46:04.210275+0000 mgr.a (mgr.14373) 18544 : cluster [DBG] pgmap v12863: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:46:05.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:46:05 smithi086 bash[24289]: cluster 2024-09-16T12:46:04.210275+0000 mgr.a (mgr.14373) 18544 : cluster [DBG] pgmap v12863: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:46:06.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:46:06 smithi157 bash[24585]: audit 2024-09-16T12:46:04.573778+0000 mgr.a (mgr.14373) 18545 : audit [DBG] from='client.397692 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:46:06.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:46:06 smithi086 bash[24289]: audit 2024-09-16T12:46:04.573778+0000 mgr.a (mgr.14373) 18545 : audit [DBG] from='client.397692 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:46:06.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:46:06 smithi047 bash[22744]: audit 2024-09-16T12:46:04.573778+0000 mgr.a (mgr.14373) 18545 : audit [DBG] from='client.397692 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:46:07.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:46:07 smithi157 bash[24585]: cluster 2024-09-16T12:46:06.211146+0000 mgr.a (mgr.14373) 18546 : cluster [DBG] pgmap v12864: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:46:07.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:46:07 smithi086 bash[24289]: cluster 2024-09-16T12:46:06.211146+0000 mgr.a (mgr.14373) 18546 : cluster [DBG] pgmap v12864: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:46:07.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:46:07 smithi047 bash[22744]: cluster 2024-09-16T12:46:06.211146+0000 mgr.a (mgr.14373) 18546 : cluster [DBG] pgmap v12864: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:46:09.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:46:09 smithi157 bash[24585]: cluster 2024-09-16T12:46:08.213408+0000 mgr.a (mgr.14373) 18547 : cluster [DBG] pgmap v12865: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:46:09.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:46:09 smithi086 bash[24289]: cluster 2024-09-16T12:46:08.213408+0000 mgr.a (mgr.14373) 18547 : cluster [DBG] pgmap v12865: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:46:09.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:46:09 smithi047 bash[22744]: cluster 2024-09-16T12:46:08.213408+0000 mgr.a (mgr.14373) 18547 : cluster [DBG] pgmap v12865: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:46:10.019 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:46:10.019 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:46:10.020 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:46:10.799 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:46:10.800 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:46:10.800 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:46:10.800 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:46:10.800 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:46:11.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:46:11 smithi157 bash[24585]: cluster 2024-09-16T12:46:10.214156+0000 mgr.a (mgr.14373) 18548 : cluster [DBG] pgmap v12866: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:46:11.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:46:11 smithi157 bash[24585]: audit 2024-09-16T12:46:10.357372+0000 mgr.a (mgr.14373) 18549 : audit [DBG] from='client.397767 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:46:11.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:46:11 smithi086 bash[24289]: cluster 2024-09-16T12:46:10.214156+0000 mgr.a (mgr.14373) 18548 : cluster [DBG] pgmap v12866: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:46:11.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:46:11 smithi086 bash[24289]: audit 2024-09-16T12:46:10.357372+0000 mgr.a (mgr.14373) 18549 : audit [DBG] from='client.397767 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:46:11.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:46:11 smithi047 bash[22744]: cluster 2024-09-16T12:46:10.214156+0000 mgr.a (mgr.14373) 18548 : cluster [DBG] pgmap v12866: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:46:11.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:46:11 smithi047 bash[22744]: audit 2024-09-16T12:46:10.357372+0000 mgr.a (mgr.14373) 18549 : audit [DBG] from='client.397767 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:46:13.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:46:13 smithi157 bash[24585]: cluster 2024-09-16T12:46:12.216432+0000 mgr.a (mgr.14373) 18550 : cluster [DBG] pgmap v12867: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:46:13.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:46:13 smithi086 bash[24289]: cluster 2024-09-16T12:46:12.216432+0000 mgr.a (mgr.14373) 18550 : cluster [DBG] pgmap v12867: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:46:13.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:46:13 smithi047 bash[22744]: cluster 2024-09-16T12:46:12.216432+0000 mgr.a (mgr.14373) 18550 : cluster [DBG] pgmap v12867: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:46:14.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:46:14 smithi157 bash[24585]: cluster 2024-09-16T12:46:14.217214+0000 mgr.a (mgr.14373) 18551 : cluster [DBG] pgmap v12868: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:46:14.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:46:14 smithi086 bash[24289]: cluster 2024-09-16T12:46:14.217214+0000 mgr.a (mgr.14373) 18551 : cluster [DBG] pgmap v12868: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:46:14.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:46:14 smithi047 bash[22744]: cluster 2024-09-16T12:46:14.217214+0000 mgr.a (mgr.14373) 18551 : cluster [DBG] pgmap v12868: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:46:15.801 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:46:15.802 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:46:15.802 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:46:16.566 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:46:16.567 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:46:16.567 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:46:16.567 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:46:16.567 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:46:17.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:46:17 smithi157 bash[24585]: audit 2024-09-16T12:46:16.132887+0000 mgr.a (mgr.14373) 18552 : audit [DBG] from='client.397839 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:46:17.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:46:17 smithi157 bash[24585]: cluster 2024-09-16T12:46:16.217758+0000 mgr.a (mgr.14373) 18553 : cluster [DBG] pgmap v12869: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:46:17.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:46:17 smithi086 bash[24289]: audit 2024-09-16T12:46:16.132887+0000 mgr.a (mgr.14373) 18552 : audit [DBG] from='client.397839 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:46:17.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:46:17 smithi086 bash[24289]: cluster 2024-09-16T12:46:16.217758+0000 mgr.a (mgr.14373) 18553 : cluster [DBG] pgmap v12869: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:46:17.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:46:17 smithi047 bash[22744]: audit 2024-09-16T12:46:16.132887+0000 mgr.a (mgr.14373) 18552 : audit [DBG] from='client.397839 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:46:17.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:46:17 smithi047 bash[22744]: cluster 2024-09-16T12:46:16.217758+0000 mgr.a (mgr.14373) 18553 : cluster [DBG] pgmap v12869: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:46:19.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:46:19 smithi157 bash[24585]: cluster 2024-09-16T12:46:18.220131+0000 mgr.a (mgr.14373) 18554 : cluster [DBG] pgmap v12870: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-16T12:46:19.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:46:19 smithi086 bash[24289]: cluster 2024-09-16T12:46:18.220131+0000 mgr.a (mgr.14373) 18554 : cluster [DBG] pgmap v12870: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-16T12:46:19.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:46:19 smithi047 bash[22744]: cluster 2024-09-16T12:46:18.220131+0000 mgr.a (mgr.14373) 18554 : cluster [DBG] pgmap v12870: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-16T12:46:21.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:46:21 smithi157 bash[24585]: cluster 2024-09-16T12:46:20.220912+0000 mgr.a (mgr.14373) 18555 : cluster [DBG] pgmap v12871: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T12:46:21.568 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:46:21.569 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:46:21.569 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:46:21.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:46:21 smithi086 bash[24289]: cluster 2024-09-16T12:46:20.220912+0000 mgr.a (mgr.14373) 18555 : cluster [DBG] pgmap v12871: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T12:46:21.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:46:21 smithi047 bash[22744]: cluster 2024-09-16T12:46:20.220912+0000 mgr.a (mgr.14373) 18555 : cluster [DBG] pgmap v12871: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T12:46:22.338 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:46:22.338 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:46:22.338 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:46:22.338 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:46:22.338 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:46:23.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:46:23 smithi157 bash[24585]: audit 2024-09-16T12:46:21.904183+0000 mgr.a (mgr.14373) 18556 : audit [DBG] from='client.397917 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:46:23.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:46:23 smithi157 bash[24585]: cluster 2024-09-16T12:46:22.222426+0000 mgr.a (mgr.14373) 18557 : cluster [DBG] pgmap v12872: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:46:23.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:46:23 smithi086 bash[24289]: audit 2024-09-16T12:46:21.904183+0000 mgr.a (mgr.14373) 18556 : audit [DBG] from='client.397917 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:46:23.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:46:23 smithi086 bash[24289]: cluster 2024-09-16T12:46:22.222426+0000 mgr.a (mgr.14373) 18557 : cluster [DBG] pgmap v12872: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:46:23.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:46:23 smithi047 bash[22744]: audit 2024-09-16T12:46:21.904183+0000 mgr.a (mgr.14373) 18556 : audit [DBG] from='client.397917 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:46:23.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:46:23 smithi047 bash[22744]: cluster 2024-09-16T12:46:22.222426+0000 mgr.a (mgr.14373) 18557 : cluster [DBG] pgmap v12872: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:46:25.565 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:46:25 smithi157 bash[24585]: cluster 2024-09-16T12:46:24.223385+0000 mgr.a (mgr.14373) 18558 : cluster [DBG] pgmap v12873: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T12:46:25.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:46:25 smithi086 bash[24289]: cluster 2024-09-16T12:46:24.223385+0000 mgr.a (mgr.14373) 18558 : cluster [DBG] pgmap v12873: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T12:46:25.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:46:25 smithi047 bash[22744]: cluster 2024-09-16T12:46:24.223385+0000 mgr.a (mgr.14373) 18558 : cluster [DBG] pgmap v12873: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T12:46:27.340 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:46:27.340 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:46:27.340 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:46:27.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:46:27 smithi157 bash[24585]: cluster 2024-09-16T12:46:26.224218+0000 mgr.a (mgr.14373) 18559 : cluster [DBG] pgmap v12874: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T12:46:27.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:46:27 smithi086 bash[24289]: cluster 2024-09-16T12:46:26.224218+0000 mgr.a (mgr.14373) 18559 : cluster [DBG] pgmap v12874: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T12:46:27.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:46:27 smithi047 bash[22744]: cluster 2024-09-16T12:46:26.224218+0000 mgr.a (mgr.14373) 18559 : cluster [DBG] pgmap v12874: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T12:46:28.110 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:46:28.111 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:46:28.111 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:46:28.111 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:46:28.111 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:46:29.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:46:29 smithi157 bash[24585]: audit 2024-09-16T12:46:27.671321+0000 mgr.a (mgr.14373) 18560 : audit [DBG] from='client.397995 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:46:29.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:46:29 smithi157 bash[24585]: cluster 2024-09-16T12:46:28.226314+0000 mgr.a (mgr.14373) 18561 : cluster [DBG] pgmap v12875: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:46:29.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:46:29 smithi157 bash[24585]: audit 2024-09-16T12:46:28.589966+0000 mon.b (mon.2) 1678 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T12:46:29.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:46:29 smithi086 bash[24289]: audit 2024-09-16T12:46:27.671321+0000 mgr.a (mgr.14373) 18560 : audit [DBG] from='client.397995 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:46:29.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:46:29 smithi086 bash[24289]: cluster 2024-09-16T12:46:28.226314+0000 mgr.a (mgr.14373) 18561 : cluster [DBG] pgmap v12875: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:46:29.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:46:29 smithi086 bash[24289]: audit 2024-09-16T12:46:28.589966+0000 mon.b (mon.2) 1678 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T12:46:29.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:46:29 smithi047 bash[22744]: audit 2024-09-16T12:46:27.671321+0000 mgr.a (mgr.14373) 18560 : audit [DBG] from='client.397995 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:46:29.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:46:29 smithi047 bash[22744]: cluster 2024-09-16T12:46:28.226314+0000 mgr.a (mgr.14373) 18561 : cluster [DBG] pgmap v12875: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:46:29.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:46:29 smithi047 bash[22744]: audit 2024-09-16T12:46:28.589966+0000 mon.b (mon.2) 1678 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T12:46:31.093 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 12:46:30 smithi047 bash[22994]: debug 2024-09-16T12:46:30.736+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T12:46:31.093 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 12:46:30 smithi047 bash[22994]: debug 2024-09-16T12:46:30.740+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T12:46:31.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:46:30 smithi047 bash[22744]: audit 2024-09-16T12:46:29.954753+0000 mon.a (mon.0) 1676 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:46:31.094 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:46:30 smithi047 bash[22744]: audit 2024-09-16T12:46:29.958772+0000 mon.a (mon.0) 1677 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:46:31.094 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:46:30 smithi047 bash[22744]: audit 2024-09-16T12:46:29.963598+0000 mon.a (mon.0) 1678 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:46:31.094 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:46:30 smithi047 bash[22744]: audit 2024-09-16T12:46:29.968158+0000 mon.a (mon.0) 1679 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:46:31.094 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:46:30 smithi047 bash[22744]: audit 2024-09-16T12:46:29.972792+0000 mon.a (mon.0) 1680 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:46:31.094 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:46:30 smithi047 bash[22744]: audit 2024-09-16T12:46:29.979066+0000 mon.a (mon.0) 1681 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:46:31.094 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:46:30 smithi047 bash[22744]: audit 2024-09-16T12:46:29.980457+0000 mon.b (mon.2) 1679 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T12:46:31.094 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:46:30 smithi047 bash[22744]: audit 2024-09-16T12:46:29.981574+0000 mon.b (mon.2) 1680 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T12:46:31.094 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:46:30 smithi047 bash[22744]: audit 2024-09-16T12:46:29.989386+0000 mon.a (mon.0) 1682 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:46:31.094 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:46:30 smithi047 bash[22744]: audit 2024-09-16T12:46:29.991844+0000 mon.b (mon.2) 1681 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:46:31.094 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:46:30 smithi047 bash[22744]: audit 2024-09-16T12:46:29.994185+0000 mgr.a (mgr.14373) 18562 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:46:31.094 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:46:30 smithi047 bash[22744]: cluster 2024-09-16T12:46:30.226885+0000 mgr.a (mgr.14373) 18563 : cluster [DBG] pgmap v12876: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-16T12:46:31.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:46:30 smithi157 bash[24585]: audit 2024-09-16T12:46:29.954753+0000 mon.a (mon.0) 1676 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:46:31.308 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:46:30 smithi157 bash[24585]: audit 2024-09-16T12:46:29.958772+0000 mon.a (mon.0) 1677 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:46:31.308 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:46:30 smithi157 bash[24585]: audit 2024-09-16T12:46:29.963598+0000 mon.a (mon.0) 1678 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:46:31.308 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:46:30 smithi157 bash[24585]: audit 2024-09-16T12:46:29.968158+0000 mon.a (mon.0) 1679 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:46:31.308 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:46:30 smithi157 bash[24585]: audit 2024-09-16T12:46:29.972792+0000 mon.a (mon.0) 1680 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:46:31.308 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:46:30 smithi157 bash[24585]: audit 2024-09-16T12:46:29.979066+0000 mon.a (mon.0) 1681 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:46:31.308 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:46:30 smithi157 bash[24585]: audit 2024-09-16T12:46:29.980457+0000 mon.b (mon.2) 1679 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T12:46:31.308 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:46:30 smithi157 bash[24585]: audit 2024-09-16T12:46:29.981574+0000 mon.b (mon.2) 1680 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T12:46:31.308 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:46:30 smithi157 bash[24585]: audit 2024-09-16T12:46:29.989386+0000 mon.a (mon.0) 1682 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:46:31.308 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:46:30 smithi157 bash[24585]: audit 2024-09-16T12:46:29.991844+0000 mon.b (mon.2) 1681 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:46:31.308 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:46:30 smithi157 bash[24585]: audit 2024-09-16T12:46:29.994185+0000 mgr.a (mgr.14373) 18562 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:46:31.308 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:46:30 smithi157 bash[24585]: cluster 2024-09-16T12:46:30.226885+0000 mgr.a (mgr.14373) 18563 : cluster [DBG] pgmap v12876: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-16T12:46:31.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:46:30 smithi086 bash[24289]: audit 2024-09-16T12:46:29.954753+0000 mon.a (mon.0) 1676 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:46:31.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:46:30 smithi086 bash[24289]: audit 2024-09-16T12:46:29.958772+0000 mon.a (mon.0) 1677 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:46:31.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:46:30 smithi086 bash[24289]: audit 2024-09-16T12:46:29.963598+0000 mon.a (mon.0) 1678 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:46:31.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:46:30 smithi086 bash[24289]: audit 2024-09-16T12:46:29.968158+0000 mon.a (mon.0) 1679 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:46:31.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:46:30 smithi086 bash[24289]: audit 2024-09-16T12:46:29.972792+0000 mon.a (mon.0) 1680 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:46:31.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:46:30 smithi086 bash[24289]: audit 2024-09-16T12:46:29.979066+0000 mon.a (mon.0) 1681 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:46:31.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:46:30 smithi086 bash[24289]: audit 2024-09-16T12:46:29.980457+0000 mon.b (mon.2) 1679 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T12:46:31.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:46:30 smithi086 bash[24289]: audit 2024-09-16T12:46:29.981574+0000 mon.b (mon.2) 1680 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T12:46:31.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:46:30 smithi086 bash[24289]: audit 2024-09-16T12:46:29.989386+0000 mon.a (mon.0) 1682 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:46:31.322 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:46:30 smithi086 bash[24289]: audit 2024-09-16T12:46:29.991844+0000 mon.b (mon.2) 1681 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:46:31.322 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:46:30 smithi086 bash[24289]: audit 2024-09-16T12:46:29.994185+0000 mgr.a (mgr.14373) 18562 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:46:31.322 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:46:30 smithi086 bash[24289]: cluster 2024-09-16T12:46:30.226885+0000 mgr.a (mgr.14373) 18563 : cluster [DBG] pgmap v12876: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-16T12:46:32.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:46:31 smithi157 bash[24585]: audit 2024-09-16T12:46:30.741305+0000 mgr.a (mgr.14373) 18564 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T12:46:32.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:46:31 smithi157 bash[24585]: cephadm 2024-09-16T12:46:30.743078+0000 mgr.a (mgr.14373) 18565 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T12:46:32.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:46:31 smithi086 bash[24289]: audit 2024-09-16T12:46:30.741305+0000 mgr.a (mgr.14373) 18564 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T12:46:32.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:46:31 smithi086 bash[24289]: cephadm 2024-09-16T12:46:30.743078+0000 mgr.a (mgr.14373) 18565 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T12:46:32.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:46:31 smithi047 bash[22744]: audit 2024-09-16T12:46:30.741305+0000 mgr.a (mgr.14373) 18564 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T12:46:32.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:46:31 smithi047 bash[22744]: cephadm 2024-09-16T12:46:30.743078+0000 mgr.a (mgr.14373) 18565 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T12:46:33.112 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:46:33.113 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:46:33.113 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:46:33.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:46:33 smithi157 bash[24585]: cluster 2024-09-16T12:46:32.229163+0000 mgr.a (mgr.14373) 18566 : cluster [DBG] pgmap v12877: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.4 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:46:33.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:46:33 smithi086 bash[24289]: cluster 2024-09-16T12:46:32.229163+0000 mgr.a (mgr.14373) 18566 : cluster [DBG] pgmap v12877: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.4 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:46:33.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:46:33 smithi047 bash[22744]: cluster 2024-09-16T12:46:32.229163+0000 mgr.a (mgr.14373) 18566 : cluster [DBG] pgmap v12877: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.4 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:46:33.893 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:46:33.893 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:46:33.893 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:46:33.893 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:46:33.893 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:46:35.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:46:35 smithi157 bash[24585]: audit 2024-09-16T12:46:33.445657+0000 mgr.a (mgr.14373) 18567 : audit [DBG] from='client.398178 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:46:35.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:46:35 smithi157 bash[24585]: cluster 2024-09-16T12:46:34.230185+0000 mgr.a (mgr.14373) 18568 : cluster [DBG] pgmap v12878: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:46:35.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:46:35 smithi086 bash[24289]: audit 2024-09-16T12:46:33.445657+0000 mgr.a (mgr.14373) 18567 : audit [DBG] from='client.398178 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:46:35.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:46:35 smithi086 bash[24289]: cluster 2024-09-16T12:46:34.230185+0000 mgr.a (mgr.14373) 18568 : cluster [DBG] pgmap v12878: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:46:35.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:46:35 smithi047 bash[22744]: audit 2024-09-16T12:46:33.445657+0000 mgr.a (mgr.14373) 18567 : audit [DBG] from='client.398178 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:46:35.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:46:35 smithi047 bash[22744]: cluster 2024-09-16T12:46:34.230185+0000 mgr.a (mgr.14373) 18568 : cluster [DBG] pgmap v12878: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:46:37.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:46:37 smithi157 bash[24585]: cluster 2024-09-16T12:46:36.230973+0000 mgr.a (mgr.14373) 18569 : cluster [DBG] pgmap v12879: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:46:37.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:46:37 smithi086 bash[24289]: cluster 2024-09-16T12:46:36.230973+0000 mgr.a (mgr.14373) 18569 : cluster [DBG] pgmap v12879: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:46:37.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:46:37 smithi047 bash[22744]: cluster 2024-09-16T12:46:36.230973+0000 mgr.a (mgr.14373) 18569 : cluster [DBG] pgmap v12879: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:46:38.894 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:46:38.895 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:46:38.895 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:46:39.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:46:39 smithi157 bash[24585]: cluster 2024-09-16T12:46:38.233201+0000 mgr.a (mgr.14373) 18570 : cluster [DBG] pgmap v12880: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:46:39.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:46:39 smithi086 bash[24289]: cluster 2024-09-16T12:46:38.233201+0000 mgr.a (mgr.14373) 18570 : cluster [DBG] pgmap v12880: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:46:39.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:46:39 smithi047 bash[22744]: cluster 2024-09-16T12:46:38.233201+0000 mgr.a (mgr.14373) 18570 : cluster [DBG] pgmap v12880: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:46:39.679 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:46:39.680 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:46:39.680 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:46:39.680 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:46:39.680 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:46:40.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:46:40 smithi086 bash[24289]: audit 2024-09-16T12:46:39.227376+0000 mgr.a (mgr.14373) 18571 : audit [DBG] from='client.398256 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:46:40.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:46:40 smithi047 bash[22744]: audit 2024-09-16T12:46:39.227376+0000 mgr.a (mgr.14373) 18571 : audit [DBG] from='client.398256 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:46:40.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:46:40 smithi157 bash[24585]: audit 2024-09-16T12:46:39.227376+0000 mgr.a (mgr.14373) 18571 : audit [DBG] from='client.398256 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:46:41.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:46:41 smithi086 bash[24289]: cluster 2024-09-16T12:46:40.234318+0000 mgr.a (mgr.14373) 18572 : cluster [DBG] pgmap v12881: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:46:41.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:46:41 smithi047 bash[22744]: cluster 2024-09-16T12:46:40.234318+0000 mgr.a (mgr.14373) 18572 : cluster [DBG] pgmap v12881: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:46:41.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:46:41 smithi157 bash[24585]: cluster 2024-09-16T12:46:40.234318+0000 mgr.a (mgr.14373) 18572 : cluster [DBG] pgmap v12881: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:46:43.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:46:43 smithi086 bash[24289]: cluster 2024-09-16T12:46:42.236599+0000 mgr.a (mgr.14373) 18573 : cluster [DBG] pgmap v12882: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:46:43.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:46:43 smithi047 bash[22744]: cluster 2024-09-16T12:46:42.236599+0000 mgr.a (mgr.14373) 18573 : cluster [DBG] pgmap v12882: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:46:43.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:46:43 smithi157 bash[24585]: cluster 2024-09-16T12:46:42.236599+0000 mgr.a (mgr.14373) 18573 : cluster [DBG] pgmap v12882: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:46:44.681 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:46:44.682 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:46:44.682 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:46:45.446 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:46:45.446 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:46:45.447 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:46:45.447 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:46:45.447 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:46:45.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:46:45 smithi086 bash[24289]: cluster 2024-09-16T12:46:44.237497+0000 mgr.a (mgr.14373) 18574 : cluster [DBG] pgmap v12883: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:46:45.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:46:45 smithi047 bash[22744]: cluster 2024-09-16T12:46:44.237497+0000 mgr.a (mgr.14373) 18574 : cluster [DBG] pgmap v12883: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:46:45.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:46:45 smithi157 bash[24585]: cluster 2024-09-16T12:46:44.237497+0000 mgr.a (mgr.14373) 18574 : cluster [DBG] pgmap v12883: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:46:46.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:46:46 smithi047 bash[22744]: audit 2024-09-16T12:46:45.001805+0000 mgr.a (mgr.14373) 18575 : audit [DBG] from='client.398331 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:46:46.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:46:46 smithi157 bash[24585]: audit 2024-09-16T12:46:45.001805+0000 mgr.a (mgr.14373) 18575 : audit [DBG] from='client.398331 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:46:46.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:46:46 smithi086 bash[24289]: audit 2024-09-16T12:46:45.001805+0000 mgr.a (mgr.14373) 18575 : audit [DBG] from='client.398331 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:46:47.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:46:47 smithi047 bash[22744]: cluster 2024-09-16T12:46:46.238412+0000 mgr.a (mgr.14373) 18576 : cluster [DBG] pgmap v12884: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:46:47.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:46:47 smithi157 bash[24585]: cluster 2024-09-16T12:46:46.238412+0000 mgr.a (mgr.14373) 18576 : cluster [DBG] pgmap v12884: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:46:47.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:46:47 smithi086 bash[24289]: cluster 2024-09-16T12:46:46.238412+0000 mgr.a (mgr.14373) 18576 : cluster [DBG] pgmap v12884: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:46:49.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:46:49 smithi047 bash[22744]: cluster 2024-09-16T12:46:48.240629+0000 mgr.a (mgr.14373) 18577 : cluster [DBG] pgmap v12885: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:46:49.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:46:49 smithi157 bash[24585]: cluster 2024-09-16T12:46:48.240629+0000 mgr.a (mgr.14373) 18577 : cluster [DBG] pgmap v12885: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:46:49.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:46:49 smithi086 bash[24289]: cluster 2024-09-16T12:46:48.240629+0000 mgr.a (mgr.14373) 18577 : cluster [DBG] pgmap v12885: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:46:50.448 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:46:50.449 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:46:50.449 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:46:51.208 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:46:51.208 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:46:51.208 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:46:51.208 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:46:51.208 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:46:51.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:46:51 smithi047 bash[22744]: cluster 2024-09-16T12:46:50.241385+0000 mgr.a (mgr.14373) 18578 : cluster [DBG] pgmap v12886: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:46:51.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:46:51 smithi157 bash[24585]: cluster 2024-09-16T12:46:50.241385+0000 mgr.a (mgr.14373) 18578 : cluster [DBG] pgmap v12886: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:46:51.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:46:51 smithi086 bash[24289]: cluster 2024-09-16T12:46:50.241385+0000 mgr.a (mgr.14373) 18578 : cluster [DBG] pgmap v12886: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:46:52.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:46:52 smithi157 bash[24585]: audit 2024-09-16T12:46:50.779450+0000 mgr.a (mgr.14373) 18579 : audit [DBG] from='client.398409 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:46:52.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:46:52 smithi086 bash[24289]: audit 2024-09-16T12:46:50.779450+0000 mgr.a (mgr.14373) 18579 : audit [DBG] from='client.398409 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:46:52.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:46:52 smithi047 bash[22744]: audit 2024-09-16T12:46:50.779450+0000 mgr.a (mgr.14373) 18579 : audit [DBG] from='client.398409 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:46:53.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:46:53 smithi157 bash[24585]: cluster 2024-09-16T12:46:52.243718+0000 mgr.a (mgr.14373) 18580 : cluster [DBG] pgmap v12887: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:46:53.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:46:53 smithi086 bash[24289]: cluster 2024-09-16T12:46:52.243718+0000 mgr.a (mgr.14373) 18580 : cluster [DBG] pgmap v12887: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:46:53.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:46:53 smithi047 bash[22744]: cluster 2024-09-16T12:46:52.243718+0000 mgr.a (mgr.14373) 18580 : cluster [DBG] pgmap v12887: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:46:55.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:46:55 smithi157 bash[24585]: cluster 2024-09-16T12:46:54.244500+0000 mgr.a (mgr.14373) 18581 : cluster [DBG] pgmap v12888: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:46:55.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:46:55 smithi086 bash[24289]: cluster 2024-09-16T12:46:54.244500+0000 mgr.a (mgr.14373) 18581 : cluster [DBG] pgmap v12888: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:46:55.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:46:55 smithi047 bash[22744]: cluster 2024-09-16T12:46:54.244500+0000 mgr.a (mgr.14373) 18581 : cluster [DBG] pgmap v12888: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:46:56.209 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:46:56.210 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:46:56.210 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:46:56.966 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:46:56.967 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:46:56.967 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:46:56.967 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:46:56.967 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:46:57.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:46:57 smithi157 bash[24585]: cluster 2024-09-16T12:46:56.245109+0000 mgr.a (mgr.14373) 18582 : cluster [DBG] pgmap v12889: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:46:57.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:46:57 smithi086 bash[24289]: cluster 2024-09-16T12:46:56.245109+0000 mgr.a (mgr.14373) 18582 : cluster [DBG] pgmap v12889: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:46:57.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:46:57 smithi047 bash[22744]: cluster 2024-09-16T12:46:56.245109+0000 mgr.a (mgr.14373) 18582 : cluster [DBG] pgmap v12889: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:46:58.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:46:58 smithi157 bash[24585]: audit 2024-09-16T12:46:56.540344+0000 mgr.a (mgr.14373) 18583 : audit [DBG] from='client.398487 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:46:58.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:46:58 smithi086 bash[24289]: audit 2024-09-16T12:46:56.540344+0000 mgr.a (mgr.14373) 18583 : audit [DBG] from='client.398487 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:46:58.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:46:58 smithi047 bash[22744]: audit 2024-09-16T12:46:56.540344+0000 mgr.a (mgr.14373) 18583 : audit [DBG] from='client.398487 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:46:59.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:46:59 smithi157 bash[24585]: cluster 2024-09-16T12:46:58.247819+0000 mgr.a (mgr.14373) 18584 : cluster [DBG] pgmap v12890: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:46:59.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:46:59 smithi086 bash[24289]: cluster 2024-09-16T12:46:58.247819+0000 mgr.a (mgr.14373) 18584 : cluster [DBG] pgmap v12890: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:46:59.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:46:59 smithi047 bash[22744]: cluster 2024-09-16T12:46:58.247819+0000 mgr.a (mgr.14373) 18584 : cluster [DBG] pgmap v12890: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:47:01.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:47:01 smithi157 bash[24585]: cluster 2024-09-16T12:47:00.248337+0000 mgr.a (mgr.14373) 18585 : cluster [DBG] pgmap v12891: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:47:01.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:47:01 smithi086 bash[24289]: cluster 2024-09-16T12:47:00.248337+0000 mgr.a (mgr.14373) 18585 : cluster [DBG] pgmap v12891: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:47:01.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:47:01 smithi047 bash[22744]: cluster 2024-09-16T12:47:00.248337+0000 mgr.a (mgr.14373) 18585 : cluster [DBG] pgmap v12891: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:47:01.968 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:47:01.969 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:47:01.969 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:47:02.749 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:47:02.749 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:47:02.749 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:47:02.749 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:47:02.749 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:47:03.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:47:03 smithi157 bash[24585]: cluster 2024-09-16T12:47:02.250279+0000 mgr.a (mgr.14373) 18586 : cluster [DBG] pgmap v12892: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:47:03.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:47:03 smithi157 bash[24585]: audit 2024-09-16T12:47:02.298474+0000 mgr.a (mgr.14373) 18587 : audit [DBG] from='client.398565 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:47:03.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:47:03 smithi086 bash[24289]: cluster 2024-09-16T12:47:02.250279+0000 mgr.a (mgr.14373) 18586 : cluster [DBG] pgmap v12892: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:47:03.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:47:03 smithi086 bash[24289]: audit 2024-09-16T12:47:02.298474+0000 mgr.a (mgr.14373) 18587 : audit [DBG] from='client.398565 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:47:03.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:47:03 smithi047 bash[22744]: cluster 2024-09-16T12:47:02.250279+0000 mgr.a (mgr.14373) 18586 : cluster [DBG] pgmap v12892: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:47:03.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:47:03 smithi047 bash[22744]: audit 2024-09-16T12:47:02.298474+0000 mgr.a (mgr.14373) 18587 : audit [DBG] from='client.398565 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:47:05.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:47:05 smithi157 bash[24585]: cluster 2024-09-16T12:47:04.251206+0000 mgr.a (mgr.14373) 18588 : cluster [DBG] pgmap v12893: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:47:05.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:47:05 smithi086 bash[24289]: cluster 2024-09-16T12:47:04.251206+0000 mgr.a (mgr.14373) 18588 : cluster [DBG] pgmap v12893: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:47:05.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:47:05 smithi047 bash[22744]: cluster 2024-09-16T12:47:04.251206+0000 mgr.a (mgr.14373) 18588 : cluster [DBG] pgmap v12893: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:47:07.750 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:47:07.751 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:47:07.752 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:47:07.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:47:07 smithi157 bash[24585]: cluster 2024-09-16T12:47:06.251981+0000 mgr.a (mgr.14373) 18589 : cluster [DBG] pgmap v12894: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T12:47:07.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:47:07 smithi086 bash[24289]: cluster 2024-09-16T12:47:06.251981+0000 mgr.a (mgr.14373) 18589 : cluster [DBG] pgmap v12894: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T12:47:07.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:47:07 smithi047 bash[22744]: cluster 2024-09-16T12:47:06.251981+0000 mgr.a (mgr.14373) 18589 : cluster [DBG] pgmap v12894: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T12:47:08.497 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:47:08.497 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:47:08.497 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:47:08.497 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:47:08.497 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:47:09.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:47:09 smithi157 bash[24585]: audit 2024-09-16T12:47:08.076869+0000 mgr.a (mgr.14373) 18590 : audit [DBG] from='client.398643 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:47:09.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:47:09 smithi157 bash[24585]: cluster 2024-09-16T12:47:08.253302+0000 mgr.a (mgr.14373) 18591 : cluster [DBG] pgmap v12895: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:47:09.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:47:09 smithi086 bash[24289]: audit 2024-09-16T12:47:08.076869+0000 mgr.a (mgr.14373) 18590 : audit [DBG] from='client.398643 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:47:09.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:47:09 smithi086 bash[24289]: cluster 2024-09-16T12:47:08.253302+0000 mgr.a (mgr.14373) 18591 : cluster [DBG] pgmap v12895: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:47:09.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:47:09 smithi047 bash[22744]: audit 2024-09-16T12:47:08.076869+0000 mgr.a (mgr.14373) 18590 : audit [DBG] from='client.398643 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:47:09.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:47:09 smithi047 bash[22744]: cluster 2024-09-16T12:47:08.253302+0000 mgr.a (mgr.14373) 18591 : cluster [DBG] pgmap v12895: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:47:10.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:47:10 smithi157 bash[24585]: cluster 2024-09-16T12:47:10.254185+0000 mgr.a (mgr.14373) 18592 : cluster [DBG] pgmap v12896: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:47:10.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:47:10 smithi086 bash[24289]: cluster 2024-09-16T12:47:10.254185+0000 mgr.a (mgr.14373) 18592 : cluster [DBG] pgmap v12896: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:47:10.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:47:10 smithi047 bash[22744]: cluster 2024-09-16T12:47:10.254185+0000 mgr.a (mgr.14373) 18592 : cluster [DBG] pgmap v12896: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:47:13.498 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:47:13.499 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:47:13.500 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:47:13.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:47:13 smithi086 bash[24289]: cluster 2024-09-16T12:47:12.256341+0000 mgr.a (mgr.14373) 18593 : cluster [DBG] pgmap v12897: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:47:13.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:47:13 smithi047 bash[22744]: cluster 2024-09-16T12:47:12.256341+0000 mgr.a (mgr.14373) 18593 : cluster [DBG] pgmap v12897: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:47:13.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:47:13 smithi157 bash[24585]: cluster 2024-09-16T12:47:12.256341+0000 mgr.a (mgr.14373) 18593 : cluster [DBG] pgmap v12897: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:47:14.276 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:47:14.276 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:47:14.276 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:47:14.276 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:47:14.276 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:47:15.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:47:15 smithi086 bash[24289]: audit 2024-09-16T12:47:13.833771+0000 mgr.a (mgr.14373) 18594 : audit [DBG] from='client.398721 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:47:15.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:47:15 smithi086 bash[24289]: cluster 2024-09-16T12:47:14.256823+0000 mgr.a (mgr.14373) 18595 : cluster [DBG] pgmap v12898: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:47:15.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:47:15 smithi047 bash[22744]: audit 2024-09-16T12:47:13.833771+0000 mgr.a (mgr.14373) 18594 : audit [DBG] from='client.398721 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:47:15.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:47:15 smithi047 bash[22744]: cluster 2024-09-16T12:47:14.256823+0000 mgr.a (mgr.14373) 18595 : cluster [DBG] pgmap v12898: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:47:15.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:47:15 smithi157 bash[24585]: audit 2024-09-16T12:47:13.833771+0000 mgr.a (mgr.14373) 18594 : audit [DBG] from='client.398721 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:47:15.841 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:47:15 smithi157 bash[24585]: cluster 2024-09-16T12:47:14.256823+0000 mgr.a (mgr.14373) 18595 : cluster [DBG] pgmap v12898: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:47:17.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:47:17 smithi047 bash[22744]: cluster 2024-09-16T12:47:16.257546+0000 mgr.a (mgr.14373) 18596 : cluster [DBG] pgmap v12899: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:47:17.808 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:47:17 smithi157 bash[24585]: cluster 2024-09-16T12:47:16.257546+0000 mgr.a (mgr.14373) 18596 : cluster [DBG] pgmap v12899: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:47:17.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:47:17 smithi086 bash[24289]: cluster 2024-09-16T12:47:16.257546+0000 mgr.a (mgr.14373) 18596 : cluster [DBG] pgmap v12899: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:47:19.277 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:47:19.278 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:47:19.278 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:47:19.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:47:19 smithi047 bash[22744]: cluster 2024-09-16T12:47:18.259802+0000 mgr.a (mgr.14373) 18597 : cluster [DBG] pgmap v12900: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:47:19.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:47:19 smithi157 bash[24585]: cluster 2024-09-16T12:47:18.259802+0000 mgr.a (mgr.14373) 18597 : cluster [DBG] pgmap v12900: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:47:19.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:47:19 smithi086 bash[24289]: cluster 2024-09-16T12:47:18.259802+0000 mgr.a (mgr.14373) 18597 : cluster [DBG] pgmap v12900: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:47:20.063 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:47:20.063 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:47:20.063 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:47:20.063 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:47:20.063 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:47:21.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:47:21 smithi047 bash[22744]: audit 2024-09-16T12:47:19.613051+0000 mgr.a (mgr.14373) 18598 : audit [DBG] from='client.398796 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:47:21.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:47:21 smithi047 bash[22744]: cluster 2024-09-16T12:47:20.260759+0000 mgr.a (mgr.14373) 18599 : cluster [DBG] pgmap v12901: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:47:21.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:47:21 smithi157 bash[24585]: audit 2024-09-16T12:47:19.613051+0000 mgr.a (mgr.14373) 18598 : audit [DBG] from='client.398796 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:47:21.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:47:21 smithi157 bash[24585]: cluster 2024-09-16T12:47:20.260759+0000 mgr.a (mgr.14373) 18599 : cluster [DBG] pgmap v12901: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:47:21.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:47:21 smithi086 bash[24289]: audit 2024-09-16T12:47:19.613051+0000 mgr.a (mgr.14373) 18598 : audit [DBG] from='client.398796 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:47:21.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:47:21 smithi086 bash[24289]: cluster 2024-09-16T12:47:20.260759+0000 mgr.a (mgr.14373) 18599 : cluster [DBG] pgmap v12901: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:47:23.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:47:23 smithi047 bash[22744]: cluster 2024-09-16T12:47:22.262962+0000 mgr.a (mgr.14373) 18600 : cluster [DBG] pgmap v12902: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:47:23.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:47:23 smithi157 bash[24585]: cluster 2024-09-16T12:47:22.262962+0000 mgr.a (mgr.14373) 18600 : cluster [DBG] pgmap v12902: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:47:23.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:47:23 smithi086 bash[24289]: cluster 2024-09-16T12:47:22.262962+0000 mgr.a (mgr.14373) 18600 : cluster [DBG] pgmap v12902: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:47:25.065 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:47:25.065 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:47:25.065 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:47:25.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:47:25 smithi047 bash[22744]: cluster 2024-09-16T12:47:24.263703+0000 mgr.a (mgr.14373) 18601 : cluster [DBG] pgmap v12903: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:47:25.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:47:25 smithi157 bash[24585]: cluster 2024-09-16T12:47:24.263703+0000 mgr.a (mgr.14373) 18601 : cluster [DBG] pgmap v12903: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:47:25.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:47:25 smithi086 bash[24289]: cluster 2024-09-16T12:47:24.263703+0000 mgr.a (mgr.14373) 18601 : cluster [DBG] pgmap v12903: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:47:25.838 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:47:25.838 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:47:25.839 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:47:25.839 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:47:25.839 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:47:27.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:47:27 smithi157 bash[24585]: audit 2024-09-16T12:47:25.399097+0000 mgr.a (mgr.14373) 18602 : audit [DBG] from='client.398874 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:47:27.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:47:27 smithi157 bash[24585]: cluster 2024-09-16T12:47:26.264607+0000 mgr.a (mgr.14373) 18603 : cluster [DBG] pgmap v12904: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:47:27.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:47:27 smithi086 bash[24289]: audit 2024-09-16T12:47:25.399097+0000 mgr.a (mgr.14373) 18602 : audit [DBG] from='client.398874 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:47:27.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:47:27 smithi086 bash[24289]: cluster 2024-09-16T12:47:26.264607+0000 mgr.a (mgr.14373) 18603 : cluster [DBG] pgmap v12904: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:47:27.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:47:27 smithi047 bash[22744]: audit 2024-09-16T12:47:25.399097+0000 mgr.a (mgr.14373) 18602 : audit [DBG] from='client.398874 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:47:27.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:47:27 smithi047 bash[22744]: cluster 2024-09-16T12:47:26.264607+0000 mgr.a (mgr.14373) 18603 : cluster [DBG] pgmap v12904: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:47:29.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:47:29 smithi157 bash[24585]: cluster 2024-09-16T12:47:28.266875+0000 mgr.a (mgr.14373) 18604 : cluster [DBG] pgmap v12905: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:47:29.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:47:29 smithi086 bash[24289]: cluster 2024-09-16T12:47:28.266875+0000 mgr.a (mgr.14373) 18604 : cluster [DBG] pgmap v12905: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:47:29.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:47:29 smithi047 bash[22744]: cluster 2024-09-16T12:47:28.266875+0000 mgr.a (mgr.14373) 18604 : cluster [DBG] pgmap v12905: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:47:30.840 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:47:30.841 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:47:30.841 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:47:31.615 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:47:31.616 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:47:31.616 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:47:31.616 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:47:31.616 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:47:31.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:47:31 smithi157 bash[24585]: cluster 2024-09-16T12:47:30.267619+0000 mgr.a (mgr.14373) 18605 : cluster [DBG] pgmap v12906: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:47:31.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:47:31 smithi157 bash[24585]: audit 2024-09-16T12:47:30.798900+0000 mon.b (mon.2) 1682 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T12:47:31.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:47:31 smithi086 bash[24289]: cluster 2024-09-16T12:47:30.267619+0000 mgr.a (mgr.14373) 18605 : cluster [DBG] pgmap v12906: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:47:31.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:47:31 smithi086 bash[24289]: audit 2024-09-16T12:47:30.798900+0000 mon.b (mon.2) 1682 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T12:47:31.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:47:31 smithi047 bash[22744]: cluster 2024-09-16T12:47:30.267619+0000 mgr.a (mgr.14373) 18605 : cluster [DBG] pgmap v12906: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:47:31.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:47:31 smithi047 bash[22744]: audit 2024-09-16T12:47:30.798900+0000 mon.b (mon.2) 1682 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T12:47:32.593 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 12:47:32 smithi047 bash[22994]: debug 2024-09-16T12:47:32.335+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T12:47:32.593 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 12:47:32 smithi047 bash[22994]: debug 2024-09-16T12:47:32.339+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T12:47:32.594 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:47:32 smithi047 bash[22744]: audit 2024-09-16T12:47:31.185013+0000 mgr.a (mgr.14373) 18606 : audit [DBG] from='client.398952 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:47:32.594 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:47:32 smithi047 bash[22744]: audit 2024-09-16T12:47:31.614251+0000 mon.b (mon.2) 1683 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T12:47:32.594 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:47:32 smithi047 bash[22744]: audit 2024-09-16T12:47:31.615762+0000 mon.b (mon.2) 1684 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T12:47:32.594 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:47:32 smithi047 bash[22744]: audit 2024-09-16T12:47:31.621857+0000 mon.a (mon.0) 1683 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:47:32.594 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:47:32 smithi047 bash[22744]: audit 2024-09-16T12:47:31.627404+0000 mon.b (mon.2) 1685 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:47:32.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:47:32 smithi157 bash[24585]: audit 2024-09-16T12:47:31.185013+0000 mgr.a (mgr.14373) 18606 : audit [DBG] from='client.398952 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:47:32.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:47:32 smithi157 bash[24585]: audit 2024-09-16T12:47:31.614251+0000 mon.b (mon.2) 1683 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T12:47:32.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:47:32 smithi157 bash[24585]: audit 2024-09-16T12:47:31.615762+0000 mon.b (mon.2) 1684 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T12:47:32.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:47:32 smithi157 bash[24585]: audit 2024-09-16T12:47:31.621857+0000 mon.a (mon.0) 1683 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:47:32.808 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:47:32 smithi157 bash[24585]: audit 2024-09-16T12:47:31.627404+0000 mon.b (mon.2) 1685 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:47:32.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:47:32 smithi086 bash[24289]: audit 2024-09-16T12:47:31.185013+0000 mgr.a (mgr.14373) 18606 : audit [DBG] from='client.398952 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:47:32.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:47:32 smithi086 bash[24289]: audit 2024-09-16T12:47:31.614251+0000 mon.b (mon.2) 1683 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T12:47:32.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:47:32 smithi086 bash[24289]: audit 2024-09-16T12:47:31.615762+0000 mon.b (mon.2) 1684 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T12:47:32.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:47:32 smithi086 bash[24289]: audit 2024-09-16T12:47:31.621857+0000 mon.a (mon.0) 1683 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:47:32.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:47:32 smithi086 bash[24289]: audit 2024-09-16T12:47:31.627404+0000 mon.b (mon.2) 1685 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:47:33.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:47:33 smithi157 bash[24585]: audit 2024-09-16T12:47:31.628528+0000 mgr.a (mgr.14373) 18607 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:47:33.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:47:33 smithi157 bash[24585]: cluster 2024-09-16T12:47:32.269878+0000 mgr.a (mgr.14373) 18608 : cluster [DBG] pgmap v12907: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-16T12:47:33.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:47:33 smithi157 bash[24585]: audit 2024-09-16T12:47:32.341131+0000 mgr.a (mgr.14373) 18609 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T12:47:33.808 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:47:33 smithi157 bash[24585]: cephadm 2024-09-16T12:47:32.343547+0000 mgr.a (mgr.14373) 18610 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T12:47:33.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:47:33 smithi086 bash[24289]: audit 2024-09-16T12:47:31.628528+0000 mgr.a (mgr.14373) 18607 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:47:33.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:47:33 smithi086 bash[24289]: cluster 2024-09-16T12:47:32.269878+0000 mgr.a (mgr.14373) 18608 : cluster [DBG] pgmap v12907: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-16T12:47:33.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:47:33 smithi086 bash[24289]: audit 2024-09-16T12:47:32.341131+0000 mgr.a (mgr.14373) 18609 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T12:47:33.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:47:33 smithi086 bash[24289]: cephadm 2024-09-16T12:47:32.343547+0000 mgr.a (mgr.14373) 18610 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T12:47:33.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:47:33 smithi047 bash[22744]: audit 2024-09-16T12:47:31.628528+0000 mgr.a (mgr.14373) 18607 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:47:33.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:47:33 smithi047 bash[22744]: cluster 2024-09-16T12:47:32.269878+0000 mgr.a (mgr.14373) 18608 : cluster [DBG] pgmap v12907: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-16T12:47:33.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:47:33 smithi047 bash[22744]: audit 2024-09-16T12:47:32.341131+0000 mgr.a (mgr.14373) 18609 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T12:47:33.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:47:33 smithi047 bash[22744]: cephadm 2024-09-16T12:47:32.343547+0000 mgr.a (mgr.14373) 18610 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T12:47:35.808 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:47:35 smithi157 bash[24585]: cluster 2024-09-16T12:47:34.270837+0000 mgr.a (mgr.14373) 18611 : cluster [DBG] pgmap v12908: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T12:47:35.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:47:35 smithi086 bash[24289]: cluster 2024-09-16T12:47:34.270837+0000 mgr.a (mgr.14373) 18611 : cluster [DBG] pgmap v12908: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T12:47:35.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:47:35 smithi047 bash[22744]: cluster 2024-09-16T12:47:34.270837+0000 mgr.a (mgr.14373) 18611 : cluster [DBG] pgmap v12908: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T12:47:36.617 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:47:36.617 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:47:36.618 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:47:37.382 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:47:37.382 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:47:37.382 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:47:37.382 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:47:37.382 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:47:37.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:47:37 smithi157 bash[24585]: cluster 2024-09-16T12:47:36.271764+0000 mgr.a (mgr.14373) 18612 : cluster [DBG] pgmap v12909: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T12:47:37.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:47:37 smithi086 bash[24289]: cluster 2024-09-16T12:47:36.271764+0000 mgr.a (mgr.14373) 18612 : cluster [DBG] pgmap v12909: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T12:47:37.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:47:37 smithi047 bash[22744]: cluster 2024-09-16T12:47:36.271764+0000 mgr.a (mgr.14373) 18612 : cluster [DBG] pgmap v12909: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T12:47:38.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:47:38 smithi157 bash[24585]: audit 2024-09-16T12:47:36.945459+0000 mgr.a (mgr.14373) 18613 : audit [DBG] from='client.399129 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:47:38.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:47:38 smithi086 bash[24289]: audit 2024-09-16T12:47:36.945459+0000 mgr.a (mgr.14373) 18613 : audit [DBG] from='client.399129 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:47:38.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:47:38 smithi047 bash[22744]: audit 2024-09-16T12:47:36.945459+0000 mgr.a (mgr.14373) 18613 : audit [DBG] from='client.399129 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:47:39.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:47:39 smithi157 bash[24585]: cluster 2024-09-16T12:47:38.274563+0000 mgr.a (mgr.14373) 18614 : cluster [DBG] pgmap v12910: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:47:39.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:47:39 smithi086 bash[24289]: cluster 2024-09-16T12:47:38.274563+0000 mgr.a (mgr.14373) 18614 : cluster [DBG] pgmap v12910: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:47:39.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:47:39 smithi047 bash[22744]: cluster 2024-09-16T12:47:38.274563+0000 mgr.a (mgr.14373) 18614 : cluster [DBG] pgmap v12910: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:47:41.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:47:41 smithi157 bash[24585]: cluster 2024-09-16T12:47:40.275347+0000 mgr.a (mgr.14373) 18615 : cluster [DBG] pgmap v12911: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T12:47:41.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:47:41 smithi086 bash[24289]: cluster 2024-09-16T12:47:40.275347+0000 mgr.a (mgr.14373) 18615 : cluster [DBG] pgmap v12911: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T12:47:41.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:47:41 smithi047 bash[22744]: cluster 2024-09-16T12:47:40.275347+0000 mgr.a (mgr.14373) 18615 : cluster [DBG] pgmap v12911: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T12:47:42.383 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:47:42.384 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:47:42.384 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:47:43.138 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:47:43.138 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:47:43.138 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:47:43.139 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:47:43.139 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:47:43.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:47:43 smithi157 bash[24585]: cluster 2024-09-16T12:47:42.277291+0000 mgr.a (mgr.14373) 18616 : cluster [DBG] pgmap v12912: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:47:43.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:47:43 smithi086 bash[24289]: cluster 2024-09-16T12:47:42.277291+0000 mgr.a (mgr.14373) 18616 : cluster [DBG] pgmap v12912: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:47:43.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:47:43 smithi047 bash[22744]: cluster 2024-09-16T12:47:42.277291+0000 mgr.a (mgr.14373) 18616 : cluster [DBG] pgmap v12912: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:47:44.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:47:44 smithi157 bash[24585]: audit 2024-09-16T12:47:42.713567+0000 mgr.a (mgr.14373) 18617 : audit [DBG] from='client.399204 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:47:44.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:47:44 smithi086 bash[24289]: audit 2024-09-16T12:47:42.713567+0000 mgr.a (mgr.14373) 18617 : audit [DBG] from='client.399204 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:47:44.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:47:44 smithi047 bash[22744]: audit 2024-09-16T12:47:42.713567+0000 mgr.a (mgr.14373) 18617 : audit [DBG] from='client.399204 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:47:45.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:47:45 smithi157 bash[24585]: cluster 2024-09-16T12:47:44.278122+0000 mgr.a (mgr.14373) 18618 : cluster [DBG] pgmap v12913: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T12:47:45.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:47:45 smithi086 bash[24289]: cluster 2024-09-16T12:47:44.278122+0000 mgr.a (mgr.14373) 18618 : cluster [DBG] pgmap v12913: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T12:47:45.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:47:45 smithi047 bash[22744]: cluster 2024-09-16T12:47:44.278122+0000 mgr.a (mgr.14373) 18618 : cluster [DBG] pgmap v12913: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T12:47:46.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:47:46 smithi157 bash[24585]: cluster 2024-09-16T12:47:46.278918+0000 mgr.a (mgr.14373) 18619 : cluster [DBG] pgmap v12914: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T12:47:46.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:47:46 smithi086 bash[24289]: cluster 2024-09-16T12:47:46.278918+0000 mgr.a (mgr.14373) 18619 : cluster [DBG] pgmap v12914: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T12:47:46.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:47:46 smithi047 bash[22744]: cluster 2024-09-16T12:47:46.278918+0000 mgr.a (mgr.14373) 18619 : cluster [DBG] pgmap v12914: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T12:47:48.140 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:47:48.141 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:47:48.141 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:47:48.904 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:47:48.904 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:47:48.904 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:47:48.905 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:47:48.905 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:47:49.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:47:49 smithi047 bash[22744]: cluster 2024-09-16T12:47:48.281099+0000 mgr.a (mgr.14373) 18620 : cluster [DBG] pgmap v12915: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.4 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:47:49.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:47:49 smithi157 bash[24585]: cluster 2024-09-16T12:47:48.281099+0000 mgr.a (mgr.14373) 18620 : cluster [DBG] pgmap v12915: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.4 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:47:49.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:47:49 smithi086 bash[24289]: cluster 2024-09-16T12:47:48.281099+0000 mgr.a (mgr.14373) 18620 : cluster [DBG] pgmap v12915: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.4 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:47:50.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:47:50 smithi157 bash[24585]: audit 2024-09-16T12:47:48.469354+0000 mgr.a (mgr.14373) 18621 : audit [DBG] from='client.399279 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:47:50.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:47:50 smithi086 bash[24289]: audit 2024-09-16T12:47:48.469354+0000 mgr.a (mgr.14373) 18621 : audit [DBG] from='client.399279 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:47:50.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:47:50 smithi047 bash[22744]: audit 2024-09-16T12:47:48.469354+0000 mgr.a (mgr.14373) 18621 : audit [DBG] from='client.399279 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:47:51.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:47:51 smithi157 bash[24585]: cluster 2024-09-16T12:47:50.282148+0000 mgr.a (mgr.14373) 18622 : cluster [DBG] pgmap v12916: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:47:51.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:47:51 smithi086 bash[24289]: cluster 2024-09-16T12:47:50.282148+0000 mgr.a (mgr.14373) 18622 : cluster [DBG] pgmap v12916: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:47:51.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:47:51 smithi047 bash[22744]: cluster 2024-09-16T12:47:50.282148+0000 mgr.a (mgr.14373) 18622 : cluster [DBG] pgmap v12916: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:47:53.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:47:53 smithi157 bash[24585]: cluster 2024-09-16T12:47:52.284471+0000 mgr.a (mgr.14373) 18623 : cluster [DBG] pgmap v12917: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:47:53.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:47:53 smithi086 bash[24289]: cluster 2024-09-16T12:47:52.284471+0000 mgr.a (mgr.14373) 18623 : cluster [DBG] pgmap v12917: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:47:53.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:47:53 smithi047 bash[22744]: cluster 2024-09-16T12:47:52.284471+0000 mgr.a (mgr.14373) 18623 : cluster [DBG] pgmap v12917: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:47:53.906 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:47:53.906 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:47:53.907 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:47:54.688 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:47:54.688 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:47:54.688 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:47:54.688 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:47:54.688 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:47:55.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:47:55 smithi157 bash[24585]: audit 2024-09-16T12:47:54.239206+0000 mgr.a (mgr.14373) 18624 : audit [DBG] from='client.399354 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:47:55.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:47:55 smithi157 bash[24585]: cluster 2024-09-16T12:47:54.285253+0000 mgr.a (mgr.14373) 18625 : cluster [DBG] pgmap v12918: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:47:55.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:47:55 smithi086 bash[24289]: audit 2024-09-16T12:47:54.239206+0000 mgr.a (mgr.14373) 18624 : audit [DBG] from='client.399354 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:47:55.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:47:55 smithi086 bash[24289]: cluster 2024-09-16T12:47:54.285253+0000 mgr.a (mgr.14373) 18625 : cluster [DBG] pgmap v12918: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:47:55.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:47:55 smithi047 bash[22744]: audit 2024-09-16T12:47:54.239206+0000 mgr.a (mgr.14373) 18624 : audit [DBG] from='client.399354 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:47:55.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:47:55 smithi047 bash[22744]: cluster 2024-09-16T12:47:54.285253+0000 mgr.a (mgr.14373) 18625 : cluster [DBG] pgmap v12918: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:47:57.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:47:57 smithi157 bash[24585]: cluster 2024-09-16T12:47:56.286401+0000 mgr.a (mgr.14373) 18626 : cluster [DBG] pgmap v12919: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:47:57.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:47:57 smithi086 bash[24289]: cluster 2024-09-16T12:47:56.286401+0000 mgr.a (mgr.14373) 18626 : cluster [DBG] pgmap v12919: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:47:57.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:47:57 smithi047 bash[22744]: cluster 2024-09-16T12:47:56.286401+0000 mgr.a (mgr.14373) 18626 : cluster [DBG] pgmap v12919: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:47:59.689 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:47:59.690 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:47:59.690 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:47:59.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:47:59 smithi157 bash[24585]: cluster 2024-09-16T12:47:58.288805+0000 mgr.a (mgr.14373) 18627 : cluster [DBG] pgmap v12920: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:47:59.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:47:59 smithi086 bash[24289]: cluster 2024-09-16T12:47:58.288805+0000 mgr.a (mgr.14373) 18627 : cluster [DBG] pgmap v12920: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:47:59.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:47:59 smithi047 bash[22744]: cluster 2024-09-16T12:47:58.288805+0000 mgr.a (mgr.14373) 18627 : cluster [DBG] pgmap v12920: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:48:00.451 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:48:00.451 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:48:00.451 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:48:00.451 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:48:00.451 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:48:01.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:48:01 smithi157 bash[24585]: audit 2024-09-16T12:48:00.020419+0000 mgr.a (mgr.14373) 18628 : audit [DBG] from='client.399432 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:48:01.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:48:01 smithi157 bash[24585]: cluster 2024-09-16T12:48:00.289393+0000 mgr.a (mgr.14373) 18629 : cluster [DBG] pgmap v12921: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:48:01.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:48:01 smithi086 bash[24289]: audit 2024-09-16T12:48:00.020419+0000 mgr.a (mgr.14373) 18628 : audit [DBG] from='client.399432 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:48:01.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:48:01 smithi086 bash[24289]: cluster 2024-09-16T12:48:00.289393+0000 mgr.a (mgr.14373) 18629 : cluster [DBG] pgmap v12921: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:48:01.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:48:01 smithi047 bash[22744]: audit 2024-09-16T12:48:00.020419+0000 mgr.a (mgr.14373) 18628 : audit [DBG] from='client.399432 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:48:01.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:48:01 smithi047 bash[22744]: cluster 2024-09-16T12:48:00.289393+0000 mgr.a (mgr.14373) 18629 : cluster [DBG] pgmap v12921: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:48:03.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:48:03 smithi157 bash[24585]: cluster 2024-09-16T12:48:02.291801+0000 mgr.a (mgr.14373) 18630 : cluster [DBG] pgmap v12922: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:48:03.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:48:03 smithi086 bash[24289]: cluster 2024-09-16T12:48:02.291801+0000 mgr.a (mgr.14373) 18630 : cluster [DBG] pgmap v12922: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:48:03.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:48:03 smithi047 bash[22744]: cluster 2024-09-16T12:48:02.291801+0000 mgr.a (mgr.14373) 18630 : cluster [DBG] pgmap v12922: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:48:05.452 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:48:05.453 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:48:05.453 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:48:05.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:48:05 smithi157 bash[24585]: cluster 2024-09-16T12:48:04.292755+0000 mgr.a (mgr.14373) 18631 : cluster [DBG] pgmap v12923: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:48:05.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:48:05 smithi086 bash[24289]: cluster 2024-09-16T12:48:04.292755+0000 mgr.a (mgr.14373) 18631 : cluster [DBG] pgmap v12923: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:48:05.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:48:05 smithi047 bash[22744]: cluster 2024-09-16T12:48:04.292755+0000 mgr.a (mgr.14373) 18631 : cluster [DBG] pgmap v12923: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:48:06.197 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:48:06.197 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:48:06.197 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:48:06.197 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:48:06.197 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:48:07.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:48:07 smithi157 bash[24585]: audit 2024-09-16T12:48:05.783626+0000 mgr.a (mgr.14373) 18632 : audit [DBG] from='client.399507 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:48:07.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:48:07 smithi157 bash[24585]: cluster 2024-09-16T12:48:06.293713+0000 mgr.a (mgr.14373) 18633 : cluster [DBG] pgmap v12924: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:48:07.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:48:07 smithi086 bash[24289]: audit 2024-09-16T12:48:05.783626+0000 mgr.a (mgr.14373) 18632 : audit [DBG] from='client.399507 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:48:07.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:48:07 smithi086 bash[24289]: cluster 2024-09-16T12:48:06.293713+0000 mgr.a (mgr.14373) 18633 : cluster [DBG] pgmap v12924: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:48:07.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:48:07 smithi047 bash[22744]: audit 2024-09-16T12:48:05.783626+0000 mgr.a (mgr.14373) 18632 : audit [DBG] from='client.399507 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:48:07.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:48:07 smithi047 bash[22744]: cluster 2024-09-16T12:48:06.293713+0000 mgr.a (mgr.14373) 18633 : cluster [DBG] pgmap v12924: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:48:09.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:48:09 smithi157 bash[24585]: cluster 2024-09-16T12:48:08.296001+0000 mgr.a (mgr.14373) 18634 : cluster [DBG] pgmap v12925: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:48:09.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:48:09 smithi086 bash[24289]: cluster 2024-09-16T12:48:08.296001+0000 mgr.a (mgr.14373) 18634 : cluster [DBG] pgmap v12925: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:48:09.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:48:09 smithi047 bash[22744]: cluster 2024-09-16T12:48:08.296001+0000 mgr.a (mgr.14373) 18634 : cluster [DBG] pgmap v12925: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:48:11.198 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:48:11.199 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:48:11.199 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:48:11.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:48:11 smithi157 bash[24585]: cluster 2024-09-16T12:48:10.296781+0000 mgr.a (mgr.14373) 18635 : cluster [DBG] pgmap v12926: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:48:11.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:48:11 smithi086 bash[24289]: cluster 2024-09-16T12:48:10.296781+0000 mgr.a (mgr.14373) 18635 : cluster [DBG] pgmap v12926: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:48:11.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:48:11 smithi047 bash[22744]: cluster 2024-09-16T12:48:10.296781+0000 mgr.a (mgr.14373) 18635 : cluster [DBG] pgmap v12926: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:48:11.979 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:48:11.979 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:48:11.979 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:48:11.979 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:48:11.979 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:48:12.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:48:12 smithi157 bash[24585]: audit 2024-09-16T12:48:11.530102+0000 mgr.a (mgr.14373) 18636 : audit [DBG] from='client.399582 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:48:12.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:48:12 smithi157 bash[24585]: cluster 2024-09-16T12:48:12.299619+0000 mgr.a (mgr.14373) 18637 : cluster [DBG] pgmap v12927: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-16T12:48:12.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:48:12 smithi086 bash[24289]: audit 2024-09-16T12:48:11.530102+0000 mgr.a (mgr.14373) 18636 : audit [DBG] from='client.399582 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:48:12.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:48:12 smithi086 bash[24289]: cluster 2024-09-16T12:48:12.299619+0000 mgr.a (mgr.14373) 18637 : cluster [DBG] pgmap v12927: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-16T12:48:12.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:48:12 smithi047 bash[22744]: audit 2024-09-16T12:48:11.530102+0000 mgr.a (mgr.14373) 18636 : audit [DBG] from='client.399582 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:48:12.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:48:12 smithi047 bash[22744]: cluster 2024-09-16T12:48:12.299619+0000 mgr.a (mgr.14373) 18637 : cluster [DBG] pgmap v12927: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-16T12:48:15.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:48:15 smithi157 bash[24585]: cluster 2024-09-16T12:48:14.300414+0000 mgr.a (mgr.14373) 18638 : cluster [DBG] pgmap v12928: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 4.9 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-16T12:48:15.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:48:15 smithi086 bash[24289]: cluster 2024-09-16T12:48:14.300414+0000 mgr.a (mgr.14373) 18638 : cluster [DBG] pgmap v12928: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 4.9 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-16T12:48:15.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:48:15 smithi047 bash[22744]: cluster 2024-09-16T12:48:14.300414+0000 mgr.a (mgr.14373) 18638 : cluster [DBG] pgmap v12928: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 4.9 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-16T12:48:16.981 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:48:16.981 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:48:16.981 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:48:17.743 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:48:17.743 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:48:17.743 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:48:17.743 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:48:17.744 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:48:17.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:48:17 smithi157 bash[24585]: cluster 2024-09-16T12:48:16.301172+0000 mgr.a (mgr.14373) 18639 : cluster [DBG] pgmap v12929: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 4.9 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-16T12:48:17.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:48:17 smithi086 bash[24289]: cluster 2024-09-16T12:48:16.301172+0000 mgr.a (mgr.14373) 18639 : cluster [DBG] pgmap v12929: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 4.9 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-16T12:48:17.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:48:17 smithi047 bash[22744]: cluster 2024-09-16T12:48:16.301172+0000 mgr.a (mgr.14373) 18639 : cluster [DBG] pgmap v12929: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 4.9 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-16T12:48:18.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:48:18 smithi157 bash[24585]: audit 2024-09-16T12:48:17.312619+0000 mgr.a (mgr.14373) 18640 : audit [DBG] from='client.399657 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:48:18.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:48:18 smithi086 bash[24289]: audit 2024-09-16T12:48:17.312619+0000 mgr.a (mgr.14373) 18640 : audit [DBG] from='client.399657 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:48:18.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:48:18 smithi047 bash[22744]: audit 2024-09-16T12:48:17.312619+0000 mgr.a (mgr.14373) 18640 : audit [DBG] from='client.399657 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:48:19.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:48:19 smithi157 bash[24585]: cluster 2024-09-16T12:48:18.303959+0000 mgr.a (mgr.14373) 18641 : cluster [DBG] pgmap v12930: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-16T12:48:19.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:48:19 smithi086 bash[24289]: cluster 2024-09-16T12:48:18.303959+0000 mgr.a (mgr.14373) 18641 : cluster [DBG] pgmap v12930: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-16T12:48:19.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:48:19 smithi047 bash[22744]: cluster 2024-09-16T12:48:18.303959+0000 mgr.a (mgr.14373) 18641 : cluster [DBG] pgmap v12930: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-16T12:48:21.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:48:21 smithi157 bash[24585]: cluster 2024-09-16T12:48:20.304769+0000 mgr.a (mgr.14373) 18642 : cluster [DBG] pgmap v12931: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 4.9 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-16T12:48:21.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:48:21 smithi086 bash[24289]: cluster 2024-09-16T12:48:20.304769+0000 mgr.a (mgr.14373) 18642 : cluster [DBG] pgmap v12931: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 4.9 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-16T12:48:21.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:48:21 smithi047 bash[22744]: cluster 2024-09-16T12:48:20.304769+0000 mgr.a (mgr.14373) 18642 : cluster [DBG] pgmap v12931: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 4.9 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-16T12:48:22.745 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:48:22.745 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:48:22.745 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:48:23.520 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:48:23.521 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:48:23.521 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:48:23.521 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:48:23.521 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:48:23.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:48:23 smithi157 bash[24585]: cluster 2024-09-16T12:48:22.306790+0000 mgr.a (mgr.14373) 18643 : cluster [DBG] pgmap v12932: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-16T12:48:23.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:48:23 smithi086 bash[24289]: cluster 2024-09-16T12:48:22.306790+0000 mgr.a (mgr.14373) 18643 : cluster [DBG] pgmap v12932: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-16T12:48:23.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:48:23 smithi047 bash[22744]: cluster 2024-09-16T12:48:22.306790+0000 mgr.a (mgr.14373) 18643 : cluster [DBG] pgmap v12932: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-16T12:48:24.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:48:24 smithi157 bash[24585]: audit 2024-09-16T12:48:23.080593+0000 mgr.a (mgr.14373) 18644 : audit [DBG] from='client.399735 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:48:24.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:48:24 smithi086 bash[24289]: audit 2024-09-16T12:48:23.080593+0000 mgr.a (mgr.14373) 18644 : audit [DBG] from='client.399735 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:48:24.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:48:24 smithi047 bash[22744]: audit 2024-09-16T12:48:23.080593+0000 mgr.a (mgr.14373) 18644 : audit [DBG] from='client.399735 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:48:25.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:48:25 smithi157 bash[24585]: cluster 2024-09-16T12:48:24.307749+0000 mgr.a (mgr.14373) 18645 : cluster [DBG] pgmap v12933: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:48:25.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:48:25 smithi086 bash[24289]: cluster 2024-09-16T12:48:24.307749+0000 mgr.a (mgr.14373) 18645 : cluster [DBG] pgmap v12933: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:48:25.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:48:25 smithi047 bash[22744]: cluster 2024-09-16T12:48:24.307749+0000 mgr.a (mgr.14373) 18645 : cluster [DBG] pgmap v12933: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:48:27.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:48:27 smithi157 bash[24585]: cluster 2024-09-16T12:48:26.308562+0000 mgr.a (mgr.14373) 18646 : cluster [DBG] pgmap v12934: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:48:27.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:48:27 smithi086 bash[24289]: cluster 2024-09-16T12:48:26.308562+0000 mgr.a (mgr.14373) 18646 : cluster [DBG] pgmap v12934: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:48:27.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:48:27 smithi047 bash[22744]: cluster 2024-09-16T12:48:26.308562+0000 mgr.a (mgr.14373) 18646 : cluster [DBG] pgmap v12934: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:48:28.522 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:48:28.523 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:48:28.523 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:48:28.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:48:28 smithi157 bash[24585]: cluster 2024-09-16T12:48:28.310849+0000 mgr.a (mgr.14373) 18647 : cluster [DBG] pgmap v12935: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:48:28.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:48:28 smithi086 bash[24289]: cluster 2024-09-16T12:48:28.310849+0000 mgr.a (mgr.14373) 18647 : cluster [DBG] pgmap v12935: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:48:28.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:48:28 smithi047 bash[22744]: cluster 2024-09-16T12:48:28.310849+0000 mgr.a (mgr.14373) 18647 : cluster [DBG] pgmap v12935: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:48:29.277 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:48:29.277 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:48:29.277 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:48:29.277 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:48:29.277 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:48:29.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:48:29 smithi157 bash[24585]: audit 2024-09-16T12:48:28.854593+0000 mgr.a (mgr.14373) 18648 : audit [DBG] from='client.399813 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:48:29.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:48:29 smithi086 bash[24289]: audit 2024-09-16T12:48:28.854593+0000 mgr.a (mgr.14373) 18648 : audit [DBG] from='client.399813 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:48:29.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:48:29 smithi047 bash[22744]: audit 2024-09-16T12:48:28.854593+0000 mgr.a (mgr.14373) 18648 : audit [DBG] from='client.399813 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:48:30.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:48:30 smithi157 bash[24585]: cluster 2024-09-16T12:48:30.311836+0000 mgr.a (mgr.14373) 18649 : cluster [DBG] pgmap v12936: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:48:30.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:48:30 smithi086 bash[24289]: cluster 2024-09-16T12:48:30.311836+0000 mgr.a (mgr.14373) 18649 : cluster [DBG] pgmap v12936: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:48:30.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:48:30 smithi047 bash[22744]: cluster 2024-09-16T12:48:30.311836+0000 mgr.a (mgr.14373) 18649 : cluster [DBG] pgmap v12936: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:48:33.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:48:33 smithi157 bash[24585]: cluster 2024-09-16T12:48:32.314040+0000 mgr.a (mgr.14373) 18650 : cluster [DBG] pgmap v12937: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:48:33.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:48:33 smithi157 bash[24585]: audit 2024-09-16T12:48:32.404243+0000 mon.b (mon.2) 1686 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T12:48:33.808 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:48:33 smithi157 bash[24585]: audit 2024-09-16T12:48:33.243012+0000 mon.b (mon.2) 1687 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T12:48:33.808 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:48:33 smithi157 bash[24585]: audit 2024-09-16T12:48:33.245183+0000 mon.b (mon.2) 1688 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T12:48:33.808 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:48:33 smithi157 bash[24585]: audit 2024-09-16T12:48:33.254243+0000 mon.a (mon.0) 1684 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:48:33.808 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:48:33 smithi157 bash[24585]: audit 2024-09-16T12:48:33.261983+0000 mon.b (mon.2) 1689 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:48:33.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:48:33 smithi086 bash[24289]: cluster 2024-09-16T12:48:32.314040+0000 mgr.a (mgr.14373) 18650 : cluster [DBG] pgmap v12937: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:48:33.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:48:33 smithi086 bash[24289]: audit 2024-09-16T12:48:32.404243+0000 mon.b (mon.2) 1686 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T12:48:33.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:48:33 smithi086 bash[24289]: audit 2024-09-16T12:48:33.243012+0000 mon.b (mon.2) 1687 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T12:48:33.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:48:33 smithi086 bash[24289]: audit 2024-09-16T12:48:33.245183+0000 mon.b (mon.2) 1688 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T12:48:33.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:48:33 smithi086 bash[24289]: audit 2024-09-16T12:48:33.254243+0000 mon.a (mon.0) 1684 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:48:33.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:48:33 smithi086 bash[24289]: audit 2024-09-16T12:48:33.261983+0000 mon.b (mon.2) 1689 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:48:33.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:48:33 smithi047 bash[22744]: cluster 2024-09-16T12:48:32.314040+0000 mgr.a (mgr.14373) 18650 : cluster [DBG] pgmap v12937: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:48:33.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:48:33 smithi047 bash[22744]: audit 2024-09-16T12:48:32.404243+0000 mon.b (mon.2) 1686 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T12:48:33.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:48:33 smithi047 bash[22744]: audit 2024-09-16T12:48:33.243012+0000 mon.b (mon.2) 1687 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T12:48:33.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:48:33 smithi047 bash[22744]: audit 2024-09-16T12:48:33.245183+0000 mon.b (mon.2) 1688 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T12:48:33.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:48:33 smithi047 bash[22744]: audit 2024-09-16T12:48:33.254243+0000 mon.a (mon.0) 1684 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:48:33.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:48:33 smithi047 bash[22744]: audit 2024-09-16T12:48:33.261983+0000 mon.b (mon.2) 1689 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:48:34.278 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:48:34.279 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:48:34.279 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:48:34.343 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 12:48:34 smithi047 bash[22994]: debug 2024-09-16T12:48:34.018+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T12:48:34.343 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 12:48:34 smithi047 bash[22994]: debug 2024-09-16T12:48:34.022+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T12:48:34.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:48:34 smithi157 bash[24585]: audit 2024-09-16T12:48:33.264360+0000 mgr.a (mgr.14373) 18651 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:48:34.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:48:34 smithi086 bash[24289]: audit 2024-09-16T12:48:33.264360+0000 mgr.a (mgr.14373) 18651 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:48:34.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:48:34 smithi047 bash[22744]: audit 2024-09-16T12:48:33.264360+0000 mgr.a (mgr.14373) 18651 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:48:35.052 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:48:35.052 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:48:35.052 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:48:35.052 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:48:35.052 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:48:35.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:48:35 smithi157 bash[24585]: audit 2024-09-16T12:48:34.021891+0000 mgr.a (mgr.14373) 18652 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T12:48:35.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:48:35 smithi157 bash[24585]: cephadm 2024-09-16T12:48:34.023893+0000 mgr.a (mgr.14373) 18653 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T12:48:35.808 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:48:35 smithi157 bash[24585]: cluster 2024-09-16T12:48:34.314910+0000 mgr.a (mgr.14373) 18654 : cluster [DBG] pgmap v12938: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:48:35.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:48:35 smithi086 bash[24289]: audit 2024-09-16T12:48:34.021891+0000 mgr.a (mgr.14373) 18652 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T12:48:35.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:48:35 smithi086 bash[24289]: cephadm 2024-09-16T12:48:34.023893+0000 mgr.a (mgr.14373) 18653 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T12:48:35.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:48:35 smithi086 bash[24289]: cluster 2024-09-16T12:48:34.314910+0000 mgr.a (mgr.14373) 18654 : cluster [DBG] pgmap v12938: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:48:35.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:48:35 smithi047 bash[22744]: audit 2024-09-16T12:48:34.021891+0000 mgr.a (mgr.14373) 18652 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T12:48:35.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:48:35 smithi047 bash[22744]: cephadm 2024-09-16T12:48:34.023893+0000 mgr.a (mgr.14373) 18653 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T12:48:35.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:48:35 smithi047 bash[22744]: cluster 2024-09-16T12:48:34.314910+0000 mgr.a (mgr.14373) 18654 : cluster [DBG] pgmap v12938: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:48:36.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:48:36 smithi157 bash[24585]: audit 2024-09-16T12:48:34.611276+0000 mgr.a (mgr.14373) 18655 : audit [DBG] from='client.399996 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:48:36.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:48:36 smithi086 bash[24289]: audit 2024-09-16T12:48:34.611276+0000 mgr.a (mgr.14373) 18655 : audit [DBG] from='client.399996 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:48:36.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:48:36 smithi047 bash[22744]: audit 2024-09-16T12:48:34.611276+0000 mgr.a (mgr.14373) 18655 : audit [DBG] from='client.399996 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:48:37.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:48:37 smithi157 bash[24585]: cluster 2024-09-16T12:48:36.315850+0000 mgr.a (mgr.14373) 18656 : cluster [DBG] pgmap v12939: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:48:37.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:48:37 smithi086 bash[24289]: cluster 2024-09-16T12:48:36.315850+0000 mgr.a (mgr.14373) 18656 : cluster [DBG] pgmap v12939: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:48:37.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:48:37 smithi047 bash[22744]: cluster 2024-09-16T12:48:36.315850+0000 mgr.a (mgr.14373) 18656 : cluster [DBG] pgmap v12939: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:48:39.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:48:39 smithi157 bash[24585]: cluster 2024-09-16T12:48:38.318109+0000 mgr.a (mgr.14373) 18657 : cluster [DBG] pgmap v12940: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:48:39.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:48:39 smithi086 bash[24289]: cluster 2024-09-16T12:48:38.318109+0000 mgr.a (mgr.14373) 18657 : cluster [DBG] pgmap v12940: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:48:39.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:48:39 smithi047 bash[22744]: cluster 2024-09-16T12:48:38.318109+0000 mgr.a (mgr.14373) 18657 : cluster [DBG] pgmap v12940: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:48:40.053 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:48:40.054 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:48:40.054 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:48:40.835 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:48:40.836 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:48:40.836 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:48:40.836 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:48:40.836 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:48:41.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:48:41 smithi157 bash[24585]: cluster 2024-09-16T12:48:40.318581+0000 mgr.a (mgr.14373) 18658 : cluster [DBG] pgmap v12941: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:48:41.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:48:41 smithi157 bash[24585]: audit 2024-09-16T12:48:40.388700+0000 mgr.a (mgr.14373) 18659 : audit [DBG] from='client.400071 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:48:41.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:48:41 smithi086 bash[24289]: cluster 2024-09-16T12:48:40.318581+0000 mgr.a (mgr.14373) 18658 : cluster [DBG] pgmap v12941: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:48:41.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:48:41 smithi086 bash[24289]: audit 2024-09-16T12:48:40.388700+0000 mgr.a (mgr.14373) 18659 : audit [DBG] from='client.400071 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:48:41.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:48:41 smithi047 bash[22744]: cluster 2024-09-16T12:48:40.318581+0000 mgr.a (mgr.14373) 18658 : cluster [DBG] pgmap v12941: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:48:41.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:48:41 smithi047 bash[22744]: audit 2024-09-16T12:48:40.388700+0000 mgr.a (mgr.14373) 18659 : audit [DBG] from='client.400071 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:48:43.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:48:43 smithi157 bash[24585]: cluster 2024-09-16T12:48:42.320799+0000 mgr.a (mgr.14373) 18660 : cluster [DBG] pgmap v12942: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 71 KiB/s rd, 426 B/s wr, 113 op/s 2024-09-16T12:48:43.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:48:43 smithi086 bash[24289]: cluster 2024-09-16T12:48:42.320799+0000 mgr.a (mgr.14373) 18660 : cluster [DBG] pgmap v12942: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 71 KiB/s rd, 426 B/s wr, 113 op/s 2024-09-16T12:48:43.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:48:43 smithi047 bash[22744]: cluster 2024-09-16T12:48:42.320799+0000 mgr.a (mgr.14373) 18660 : cluster [DBG] pgmap v12942: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 71 KiB/s rd, 426 B/s wr, 113 op/s 2024-09-16T12:48:45.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:48:45 smithi157 bash[24585]: cluster 2024-09-16T12:48:44.321587+0000 mgr.a (mgr.14373) 18661 : cluster [DBG] pgmap v12943: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 70 KiB/s rd, 426 B/s wr, 112 op/s 2024-09-16T12:48:45.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:48:45 smithi086 bash[24289]: cluster 2024-09-16T12:48:44.321587+0000 mgr.a (mgr.14373) 18661 : cluster [DBG] pgmap v12943: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 70 KiB/s rd, 426 B/s wr, 112 op/s 2024-09-16T12:48:45.837 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:48:45.838 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:48:45.838 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:48:45.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:48:45 smithi047 bash[22744]: cluster 2024-09-16T12:48:44.321587+0000 mgr.a (mgr.14373) 18661 : cluster [DBG] pgmap v12943: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 70 KiB/s rd, 426 B/s wr, 112 op/s 2024-09-16T12:48:46.588 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:48:46.589 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:48:46.589 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:48:46.589 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:48:46.589 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:48:46.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:48:46 smithi157 bash[24585]: audit 2024-09-16T12:48:46.164894+0000 mgr.a (mgr.14373) 18662 : audit [DBG] from='client.400149 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:48:46.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:48:46 smithi157 bash[24585]: cluster 2024-09-16T12:48:46.322138+0000 mgr.a (mgr.14373) 18663 : cluster [DBG] pgmap v12944: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 70 KiB/s rd, 426 B/s wr, 112 op/s 2024-09-16T12:48:46.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:48:46 smithi086 bash[24289]: audit 2024-09-16T12:48:46.164894+0000 mgr.a (mgr.14373) 18662 : audit [DBG] from='client.400149 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:48:46.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:48:46 smithi086 bash[24289]: cluster 2024-09-16T12:48:46.322138+0000 mgr.a (mgr.14373) 18663 : cluster [DBG] pgmap v12944: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 70 KiB/s rd, 426 B/s wr, 112 op/s 2024-09-16T12:48:46.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:48:46 smithi047 bash[22744]: audit 2024-09-16T12:48:46.164894+0000 mgr.a (mgr.14373) 18662 : audit [DBG] from='client.400149 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:48:46.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:48:46 smithi047 bash[22744]: cluster 2024-09-16T12:48:46.322138+0000 mgr.a (mgr.14373) 18663 : cluster [DBG] pgmap v12944: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 70 KiB/s rd, 426 B/s wr, 112 op/s 2024-09-16T12:48:49.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:48:49 smithi157 bash[24585]: cluster 2024-09-16T12:48:48.324495+0000 mgr.a (mgr.14373) 18664 : cluster [DBG] pgmap v12945: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 71 KiB/s rd, 426 B/s wr, 113 op/s 2024-09-16T12:48:49.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:48:49 smithi086 bash[24289]: cluster 2024-09-16T12:48:48.324495+0000 mgr.a (mgr.14373) 18664 : cluster [DBG] pgmap v12945: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 71 KiB/s rd, 426 B/s wr, 113 op/s 2024-09-16T12:48:49.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:48:49 smithi047 bash[22744]: cluster 2024-09-16T12:48:48.324495+0000 mgr.a (mgr.14373) 18664 : cluster [DBG] pgmap v12945: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 71 KiB/s rd, 426 B/s wr, 113 op/s 2024-09-16T12:48:51.590 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:48:51.590 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:48:51.591 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:48:51.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:48:51 smithi157 bash[24585]: cluster 2024-09-16T12:48:50.325267+0000 mgr.a (mgr.14373) 18665 : cluster [DBG] pgmap v12946: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 65 KiB/s rd, 0 B/s wr, 107 op/s 2024-09-16T12:48:51.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:48:51 smithi086 bash[24289]: cluster 2024-09-16T12:48:50.325267+0000 mgr.a (mgr.14373) 18665 : cluster [DBG] pgmap v12946: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 65 KiB/s rd, 0 B/s wr, 107 op/s 2024-09-16T12:48:51.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:48:51 smithi047 bash[22744]: cluster 2024-09-16T12:48:50.325267+0000 mgr.a (mgr.14373) 18665 : cluster [DBG] pgmap v12946: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 65 KiB/s rd, 0 B/s wr, 107 op/s 2024-09-16T12:48:52.342 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:48:52.342 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:48:52.343 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:48:52.343 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:48:52.343 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:48:53.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:48:53 smithi157 bash[24585]: audit 2024-09-16T12:48:51.924083+0000 mgr.a (mgr.14373) 18666 : audit [DBG] from='client.400224 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:48:53.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:48:53 smithi157 bash[24585]: cluster 2024-09-16T12:48:52.326779+0000 mgr.a (mgr.14373) 18667 : cluster [DBG] pgmap v12947: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 65 KiB/s rd, 0 B/s wr, 107 op/s 2024-09-16T12:48:53.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:48:53 smithi086 bash[24289]: audit 2024-09-16T12:48:51.924083+0000 mgr.a (mgr.14373) 18666 : audit [DBG] from='client.400224 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:48:53.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:48:53 smithi086 bash[24289]: cluster 2024-09-16T12:48:52.326779+0000 mgr.a (mgr.14373) 18667 : cluster [DBG] pgmap v12947: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 65 KiB/s rd, 0 B/s wr, 107 op/s 2024-09-16T12:48:53.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:48:53 smithi047 bash[22744]: audit 2024-09-16T12:48:51.924083+0000 mgr.a (mgr.14373) 18666 : audit [DBG] from='client.400224 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:48:53.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:48:53 smithi047 bash[22744]: cluster 2024-09-16T12:48:52.326779+0000 mgr.a (mgr.14373) 18667 : cluster [DBG] pgmap v12947: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 65 KiB/s rd, 0 B/s wr, 107 op/s 2024-09-16T12:48:55.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:48:55 smithi157 bash[24585]: cluster 2024-09-16T12:48:54.327517+0000 mgr.a (mgr.14373) 18668 : cluster [DBG] pgmap v12948: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T12:48:55.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:48:55 smithi086 bash[24289]: cluster 2024-09-16T12:48:54.327517+0000 mgr.a (mgr.14373) 18668 : cluster [DBG] pgmap v12948: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T12:48:55.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:48:55 smithi047 bash[22744]: cluster 2024-09-16T12:48:54.327517+0000 mgr.a (mgr.14373) 18668 : cluster [DBG] pgmap v12948: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T12:48:57.344 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:48:57.345 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:48:57.345 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:48:57.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:48:57 smithi157 bash[24585]: cluster 2024-09-16T12:48:56.328289+0000 mgr.a (mgr.14373) 18669 : cluster [DBG] pgmap v12949: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T12:48:57.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:48:57 smithi086 bash[24289]: cluster 2024-09-16T12:48:56.328289+0000 mgr.a (mgr.14373) 18669 : cluster [DBG] pgmap v12949: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T12:48:57.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:48:57 smithi047 bash[22744]: cluster 2024-09-16T12:48:56.328289+0000 mgr.a (mgr.14373) 18669 : cluster [DBG] pgmap v12949: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T12:48:58.107 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:48:58.108 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:48:58.108 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:48:58.108 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:48:58.108 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:48:59.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:48:59 smithi157 bash[24585]: audit 2024-09-16T12:48:57.675069+0000 mgr.a (mgr.14373) 18670 : audit [DBG] from='client.400302 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:48:59.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:48:59 smithi157 bash[24585]: cluster 2024-09-16T12:48:58.331240+0000 mgr.a (mgr.14373) 18671 : cluster [DBG] pgmap v12950: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:48:59.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:48:59 smithi086 bash[24289]: audit 2024-09-16T12:48:57.675069+0000 mgr.a (mgr.14373) 18670 : audit [DBG] from='client.400302 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:48:59.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:48:59 smithi086 bash[24289]: cluster 2024-09-16T12:48:58.331240+0000 mgr.a (mgr.14373) 18671 : cluster [DBG] pgmap v12950: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:48:59.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:48:59 smithi047 bash[22744]: audit 2024-09-16T12:48:57.675069+0000 mgr.a (mgr.14373) 18670 : audit [DBG] from='client.400302 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:48:59.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:48:59 smithi047 bash[22744]: cluster 2024-09-16T12:48:58.331240+0000 mgr.a (mgr.14373) 18671 : cluster [DBG] pgmap v12950: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:49:01.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:49:01 smithi157 bash[24585]: cluster 2024-09-16T12:49:00.332072+0000 mgr.a (mgr.14373) 18672 : cluster [DBG] pgmap v12951: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-16T12:49:01.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:49:01 smithi086 bash[24289]: cluster 2024-09-16T12:49:00.332072+0000 mgr.a (mgr.14373) 18672 : cluster [DBG] pgmap v12951: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-16T12:49:01.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:49:01 smithi047 bash[22744]: cluster 2024-09-16T12:49:00.332072+0000 mgr.a (mgr.14373) 18672 : cluster [DBG] pgmap v12951: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-16T12:49:03.109 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:49:03.110 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:49:03.110 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:49:03.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:49:03 smithi157 bash[24585]: cluster 2024-09-16T12:49:02.334050+0000 mgr.a (mgr.14373) 18673 : cluster [DBG] pgmap v12952: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-16T12:49:03.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:49:03 smithi086 bash[24289]: cluster 2024-09-16T12:49:02.334050+0000 mgr.a (mgr.14373) 18673 : cluster [DBG] pgmap v12952: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-16T12:49:03.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:49:03 smithi047 bash[22744]: cluster 2024-09-16T12:49:02.334050+0000 mgr.a (mgr.14373) 18673 : cluster [DBG] pgmap v12952: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-16T12:49:03.865 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:49:03.865 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:49:03.865 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:49:03.865 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:49:03.865 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:49:04.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:49:04 smithi157 bash[24585]: audit 2024-09-16T12:49:03.438860+0000 mgr.a (mgr.14373) 18674 : audit [DBG] from='client.400380 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:49:04.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:49:04 smithi157 bash[24585]: cluster 2024-09-16T12:49:04.335055+0000 mgr.a (mgr.14373) 18675 : cluster [DBG] pgmap v12953: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:49:04.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:49:04 smithi086 bash[24289]: audit 2024-09-16T12:49:03.438860+0000 mgr.a (mgr.14373) 18674 : audit [DBG] from='client.400380 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:49:04.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:49:04 smithi086 bash[24289]: cluster 2024-09-16T12:49:04.335055+0000 mgr.a (mgr.14373) 18675 : cluster [DBG] pgmap v12953: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:49:04.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:49:04 smithi047 bash[22744]: audit 2024-09-16T12:49:03.438860+0000 mgr.a (mgr.14373) 18674 : audit [DBG] from='client.400380 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:49:04.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:49:04 smithi047 bash[22744]: cluster 2024-09-16T12:49:04.335055+0000 mgr.a (mgr.14373) 18675 : cluster [DBG] pgmap v12953: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:49:07.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:49:07 smithi157 bash[24585]: cluster 2024-09-16T12:49:06.335793+0000 mgr.a (mgr.14373) 18676 : cluster [DBG] pgmap v12954: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:49:07.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:49:07 smithi086 bash[24289]: cluster 2024-09-16T12:49:06.335793+0000 mgr.a (mgr.14373) 18676 : cluster [DBG] pgmap v12954: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:49:07.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:49:07 smithi047 bash[22744]: cluster 2024-09-16T12:49:06.335793+0000 mgr.a (mgr.14373) 18676 : cluster [DBG] pgmap v12954: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:49:08.866 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:49:08.867 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:49:08.867 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:49:09.649 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:49:09.649 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:49:09.649 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:49:09.650 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:49:09.650 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:49:09.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:49:09 smithi157 bash[24585]: cluster 2024-09-16T12:49:08.338026+0000 mgr.a (mgr.14373) 18677 : cluster [DBG] pgmap v12955: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:49:09.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:49:09 smithi086 bash[24289]: cluster 2024-09-16T12:49:08.338026+0000 mgr.a (mgr.14373) 18677 : cluster [DBG] pgmap v12955: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:49:09.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:49:09 smithi047 bash[22744]: cluster 2024-09-16T12:49:08.338026+0000 mgr.a (mgr.14373) 18677 : cluster [DBG] pgmap v12955: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:49:10.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:49:10 smithi157 bash[24585]: audit 2024-09-16T12:49:09.200324+0000 mgr.a (mgr.14373) 18678 : audit [DBG] from='client.400458 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:49:10.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:49:10 smithi086 bash[24289]: audit 2024-09-16T12:49:09.200324+0000 mgr.a (mgr.14373) 18678 : audit [DBG] from='client.400458 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:49:10.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:49:10 smithi047 bash[22744]: audit 2024-09-16T12:49:09.200324+0000 mgr.a (mgr.14373) 18678 : audit [DBG] from='client.400458 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:49:11.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:49:11 smithi157 bash[24585]: cluster 2024-09-16T12:49:10.339017+0000 mgr.a (mgr.14373) 18679 : cluster [DBG] pgmap v12956: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:49:11.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:49:11 smithi086 bash[24289]: cluster 2024-09-16T12:49:10.339017+0000 mgr.a (mgr.14373) 18679 : cluster [DBG] pgmap v12956: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:49:11.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:49:11 smithi047 bash[22744]: cluster 2024-09-16T12:49:10.339017+0000 mgr.a (mgr.14373) 18679 : cluster [DBG] pgmap v12956: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:49:13.809 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:49:13 smithi157 bash[24585]: cluster 2024-09-16T12:49:12.341190+0000 mgr.a (mgr.14373) 18680 : cluster [DBG] pgmap v12957: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:49:13.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:49:13 smithi086 bash[24289]: cluster 2024-09-16T12:49:12.341190+0000 mgr.a (mgr.14373) 18680 : cluster [DBG] pgmap v12957: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:49:13.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:49:13 smithi047 bash[22744]: cluster 2024-09-16T12:49:12.341190+0000 mgr.a (mgr.14373) 18680 : cluster [DBG] pgmap v12957: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:49:14.650 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:49:14.651 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:49:14.651 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:49:14.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:49:14 smithi157 bash[24585]: cluster 2024-09-16T12:49:14.342021+0000 mgr.a (mgr.14373) 18681 : cluster [DBG] pgmap v12958: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:49:14.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:49:14 smithi086 bash[24289]: cluster 2024-09-16T12:49:14.342021+0000 mgr.a (mgr.14373) 18681 : cluster [DBG] pgmap v12958: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:49:14.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:49:14 smithi047 bash[22744]: cluster 2024-09-16T12:49:14.342021+0000 mgr.a (mgr.14373) 18681 : cluster [DBG] pgmap v12958: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:49:15.408 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:49:15.409 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:49:15.409 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:49:15.409 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:49:15.409 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:49:15.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:49:15 smithi157 bash[24585]: audit 2024-09-16T12:49:14.976229+0000 mgr.a (mgr.14373) 18682 : audit [DBG] from='client.400536 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:49:15.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:49:15 smithi086 bash[24289]: audit 2024-09-16T12:49:14.976229+0000 mgr.a (mgr.14373) 18682 : audit [DBG] from='client.400536 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:49:15.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:49:15 smithi047 bash[22744]: audit 2024-09-16T12:49:14.976229+0000 mgr.a (mgr.14373) 18682 : audit [DBG] from='client.400536 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:49:16.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:49:16 smithi157 bash[24585]: cluster 2024-09-16T12:49:16.342983+0000 mgr.a (mgr.14373) 18683 : cluster [DBG] pgmap v12959: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:49:16.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:49:16 smithi086 bash[24289]: cluster 2024-09-16T12:49:16.342983+0000 mgr.a (mgr.14373) 18683 : cluster [DBG] pgmap v12959: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:49:16.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:49:16 smithi047 bash[22744]: cluster 2024-09-16T12:49:16.342983+0000 mgr.a (mgr.14373) 18683 : cluster [DBG] pgmap v12959: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:49:19.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:49:19 smithi157 bash[24585]: cluster 2024-09-16T12:49:18.345142+0000 mgr.a (mgr.14373) 18684 : cluster [DBG] pgmap v12960: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:49:19.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:49:19 smithi086 bash[24289]: cluster 2024-09-16T12:49:18.345142+0000 mgr.a (mgr.14373) 18684 : cluster [DBG] pgmap v12960: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:49:19.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:49:19 smithi047 bash[22744]: cluster 2024-09-16T12:49:18.345142+0000 mgr.a (mgr.14373) 18684 : cluster [DBG] pgmap v12960: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:49:20.410 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:49:20.411 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:49:20.411 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:49:21.185 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:49:21.185 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:49:21.186 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:49:21.186 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:49:21.186 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:49:21.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:49:21 smithi157 bash[24585]: cluster 2024-09-16T12:49:20.345933+0000 mgr.a (mgr.14373) 18685 : cluster [DBG] pgmap v12961: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:49:21.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:49:21 smithi086 bash[24289]: cluster 2024-09-16T12:49:20.345933+0000 mgr.a (mgr.14373) 18685 : cluster [DBG] pgmap v12961: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:49:21.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:49:21 smithi047 bash[22744]: cluster 2024-09-16T12:49:20.345933+0000 mgr.a (mgr.14373) 18685 : cluster [DBG] pgmap v12961: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:49:22.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:49:22 smithi157 bash[24585]: audit 2024-09-16T12:49:20.745700+0000 mgr.a (mgr.14373) 18686 : audit [DBG] from='client.400614 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:49:22.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:49:22 smithi086 bash[24289]: audit 2024-09-16T12:49:20.745700+0000 mgr.a (mgr.14373) 18686 : audit [DBG] from='client.400614 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:49:22.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:49:22 smithi047 bash[22744]: audit 2024-09-16T12:49:20.745700+0000 mgr.a (mgr.14373) 18686 : audit [DBG] from='client.400614 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:49:23.808 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:49:23 smithi157 bash[24585]: cluster 2024-09-16T12:49:22.348221+0000 mgr.a (mgr.14373) 18687 : cluster [DBG] pgmap v12962: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:49:23.822 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:49:23 smithi086 bash[24289]: cluster 2024-09-16T12:49:22.348221+0000 mgr.a (mgr.14373) 18687 : cluster [DBG] pgmap v12962: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:49:23.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:49:23 smithi047 bash[22744]: cluster 2024-09-16T12:49:22.348221+0000 mgr.a (mgr.14373) 18687 : cluster [DBG] pgmap v12962: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:49:25.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:49:25 smithi157 bash[24585]: cluster 2024-09-16T12:49:24.348993+0000 mgr.a (mgr.14373) 18688 : cluster [DBG] pgmap v12963: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:49:25.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:49:25 smithi086 bash[24289]: cluster 2024-09-16T12:49:24.348993+0000 mgr.a (mgr.14373) 18688 : cluster [DBG] pgmap v12963: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:49:25.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:49:25 smithi047 bash[22744]: cluster 2024-09-16T12:49:24.348993+0000 mgr.a (mgr.14373) 18688 : cluster [DBG] pgmap v12963: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:49:26.187 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:49:26.187 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:49:26.188 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:49:26.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:49:26 smithi157 bash[24585]: cluster 2024-09-16T12:49:26.349558+0000 mgr.a (mgr.14373) 18689 : cluster [DBG] pgmap v12964: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:49:26.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:49:26 smithi086 bash[24289]: cluster 2024-09-16T12:49:26.349558+0000 mgr.a (mgr.14373) 18689 : cluster [DBG] pgmap v12964: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:49:26.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:49:26 smithi047 bash[22744]: cluster 2024-09-16T12:49:26.349558+0000 mgr.a (mgr.14373) 18689 : cluster [DBG] pgmap v12964: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:49:26.943 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:49:26.943 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:49:26.943 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:49:26.944 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:49:26.944 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:49:27.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:49:27 smithi157 bash[24585]: audit 2024-09-16T12:49:26.521752+0000 mgr.a (mgr.14373) 18690 : audit [DBG] from='client.400689 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:49:27.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:49:27 smithi086 bash[24289]: audit 2024-09-16T12:49:26.521752+0000 mgr.a (mgr.14373) 18690 : audit [DBG] from='client.400689 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:49:27.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:49:27 smithi047 bash[22744]: audit 2024-09-16T12:49:26.521752+0000 mgr.a (mgr.14373) 18690 : audit [DBG] from='client.400689 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:49:28.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:49:28 smithi157 bash[24585]: cluster 2024-09-16T12:49:28.352255+0000 mgr.a (mgr.14373) 18691 : cluster [DBG] pgmap v12965: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:49:28.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:49:28 smithi086 bash[24289]: cluster 2024-09-16T12:49:28.352255+0000 mgr.a (mgr.14373) 18691 : cluster [DBG] pgmap v12965: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:49:28.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:49:28 smithi047 bash[22744]: cluster 2024-09-16T12:49:28.352255+0000 mgr.a (mgr.14373) 18691 : cluster [DBG] pgmap v12965: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:49:31.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:49:31 smithi157 bash[24585]: cluster 2024-09-16T12:49:30.353059+0000 mgr.a (mgr.14373) 18692 : cluster [DBG] pgmap v12966: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:49:31.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:49:31 smithi086 bash[24289]: cluster 2024-09-16T12:49:30.353059+0000 mgr.a (mgr.14373) 18692 : cluster [DBG] pgmap v12966: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:49:31.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:49:31 smithi047 bash[22744]: cluster 2024-09-16T12:49:30.353059+0000 mgr.a (mgr.14373) 18692 : cluster [DBG] pgmap v12966: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:49:31.945 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:49:31.946 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:49:31.946 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:49:32.706 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:49:32.706 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:49:32.707 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:49:32.707 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:49:32.707 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:49:33.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:49:33 smithi157 bash[24585]: audit 2024-09-16T12:49:32.274000+0000 mgr.a (mgr.14373) 18693 : audit [DBG] from='client.400767 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:49:33.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:49:33 smithi157 bash[24585]: cluster 2024-09-16T12:49:32.355027+0000 mgr.a (mgr.14373) 18694 : cluster [DBG] pgmap v12967: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:49:33.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:49:33 smithi086 bash[24289]: audit 2024-09-16T12:49:32.274000+0000 mgr.a (mgr.14373) 18693 : audit [DBG] from='client.400767 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:49:33.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:49:33 smithi086 bash[24289]: cluster 2024-09-16T12:49:32.355027+0000 mgr.a (mgr.14373) 18694 : cluster [DBG] pgmap v12967: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:49:33.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:49:33 smithi047 bash[22744]: audit 2024-09-16T12:49:32.274000+0000 mgr.a (mgr.14373) 18693 : audit [DBG] from='client.400767 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:49:33.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:49:33 smithi047 bash[22744]: cluster 2024-09-16T12:49:32.355027+0000 mgr.a (mgr.14373) 18694 : cluster [DBG] pgmap v12967: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:49:34.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:49:34 smithi157 bash[24585]: audit 2024-09-16T12:49:34.077686+0000 mon.b (mon.2) 1690 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T12:49:34.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:49:34 smithi086 bash[24289]: audit 2024-09-16T12:49:34.077686+0000 mon.b (mon.2) 1690 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T12:49:34.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:49:34 smithi047 bash[22744]: audit 2024-09-16T12:49:34.077686+0000 mon.b (mon.2) 1690 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T12:49:35.808 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:49:35 smithi157 bash[24585]: cluster 2024-09-16T12:49:34.355913+0000 mgr.a (mgr.14373) 18695 : cluster [DBG] pgmap v12968: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:49:35.808 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:49:35 smithi157 bash[24585]: audit 2024-09-16T12:49:34.909297+0000 mon.b (mon.2) 1691 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T12:49:35.808 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:49:35 smithi157 bash[24585]: audit 2024-09-16T12:49:34.911350+0000 mon.b (mon.2) 1692 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T12:49:35.808 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:49:35 smithi157 bash[24585]: audit 2024-09-16T12:49:34.920721+0000 mon.a (mon.0) 1685 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:49:35.808 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:49:35 smithi157 bash[24585]: audit 2024-09-16T12:49:34.928051+0000 mon.b (mon.2) 1693 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:49:35.808 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:49:35 smithi157 bash[24585]: audit 2024-09-16T12:49:34.930656+0000 mgr.a (mgr.14373) 18696 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:49:35.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:49:35 smithi086 bash[24289]: cluster 2024-09-16T12:49:34.355913+0000 mgr.a (mgr.14373) 18695 : cluster [DBG] pgmap v12968: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:49:35.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:49:35 smithi086 bash[24289]: audit 2024-09-16T12:49:34.909297+0000 mon.b (mon.2) 1691 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T12:49:35.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:49:35 smithi086 bash[24289]: audit 2024-09-16T12:49:34.911350+0000 mon.b (mon.2) 1692 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T12:49:35.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:49:35 smithi086 bash[24289]: audit 2024-09-16T12:49:34.920721+0000 mon.a (mon.0) 1685 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:49:35.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:49:35 smithi086 bash[24289]: audit 2024-09-16T12:49:34.928051+0000 mon.b (mon.2) 1693 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:49:35.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:49:35 smithi086 bash[24289]: audit 2024-09-16T12:49:34.930656+0000 mgr.a (mgr.14373) 18696 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:49:35.843 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 12:49:35 smithi047 bash[22994]: debug 2024-09-16T12:49:35.664+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T12:49:35.843 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 12:49:35 smithi047 bash[22994]: debug 2024-09-16T12:49:35.668+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T12:49:35.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:49:35 smithi047 bash[22744]: cluster 2024-09-16T12:49:34.355913+0000 mgr.a (mgr.14373) 18695 : cluster [DBG] pgmap v12968: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:49:35.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:49:35 smithi047 bash[22744]: audit 2024-09-16T12:49:34.909297+0000 mon.b (mon.2) 1691 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T12:49:35.844 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:49:35 smithi047 bash[22744]: audit 2024-09-16T12:49:34.911350+0000 mon.b (mon.2) 1692 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T12:49:35.844 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:49:35 smithi047 bash[22744]: audit 2024-09-16T12:49:34.920721+0000 mon.a (mon.0) 1685 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:49:35.844 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:49:35 smithi047 bash[22744]: audit 2024-09-16T12:49:34.928051+0000 mon.b (mon.2) 1693 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:49:35.844 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:49:35 smithi047 bash[22744]: audit 2024-09-16T12:49:34.930656+0000 mgr.a (mgr.14373) 18696 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:49:36.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:49:36 smithi157 bash[24585]: audit 2024-09-16T12:49:35.669779+0000 mgr.a (mgr.14373) 18697 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T12:49:36.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:49:36 smithi157 bash[24585]: cephadm 2024-09-16T12:49:35.671695+0000 mgr.a (mgr.14373) 18698 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T12:49:36.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:49:36 smithi157 bash[24585]: cluster 2024-09-16T12:49:36.356876+0000 mgr.a (mgr.14373) 18699 : cluster [DBG] pgmap v12969: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T12:49:36.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:49:36 smithi086 bash[24289]: audit 2024-09-16T12:49:35.669779+0000 mgr.a (mgr.14373) 18697 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T12:49:36.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:49:36 smithi086 bash[24289]: cephadm 2024-09-16T12:49:35.671695+0000 mgr.a (mgr.14373) 18698 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T12:49:36.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:49:36 smithi086 bash[24289]: cluster 2024-09-16T12:49:36.356876+0000 mgr.a (mgr.14373) 18699 : cluster [DBG] pgmap v12969: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T12:49:36.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:49:36 smithi047 bash[22744]: audit 2024-09-16T12:49:35.669779+0000 mgr.a (mgr.14373) 18697 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T12:49:36.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:49:36 smithi047 bash[22744]: cephadm 2024-09-16T12:49:35.671695+0000 mgr.a (mgr.14373) 18698 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T12:49:36.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:49:36 smithi047 bash[22744]: cluster 2024-09-16T12:49:36.356876+0000 mgr.a (mgr.14373) 18699 : cluster [DBG] pgmap v12969: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T12:49:37.708 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:49:37.709 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:49:37.709 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:49:38.494 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:49:38.494 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:49:38.494 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:49:38.494 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:49:38.494 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:49:39.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:49:39 smithi157 bash[24585]: audit 2024-09-16T12:49:38.041492+0000 mgr.a (mgr.14373) 18700 : audit [DBG] from='client.400947 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:49:39.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:49:39 smithi157 bash[24585]: cluster 2024-09-16T12:49:38.358226+0000 mgr.a (mgr.14373) 18701 : cluster [DBG] pgmap v12970: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:49:39.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:49:39 smithi086 bash[24289]: audit 2024-09-16T12:49:38.041492+0000 mgr.a (mgr.14373) 18700 : audit [DBG] from='client.400947 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:49:39.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:49:39 smithi086 bash[24289]: cluster 2024-09-16T12:49:38.358226+0000 mgr.a (mgr.14373) 18701 : cluster [DBG] pgmap v12970: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:49:39.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:49:39 smithi047 bash[22744]: audit 2024-09-16T12:49:38.041492+0000 mgr.a (mgr.14373) 18700 : audit [DBG] from='client.400947 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:49:39.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:49:39 smithi047 bash[22744]: cluster 2024-09-16T12:49:38.358226+0000 mgr.a (mgr.14373) 18701 : cluster [DBG] pgmap v12970: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:49:41.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:49:41 smithi157 bash[24585]: cluster 2024-09-16T12:49:40.359105+0000 mgr.a (mgr.14373) 18702 : cluster [DBG] pgmap v12971: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:49:41.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:49:41 smithi086 bash[24289]: cluster 2024-09-16T12:49:40.359105+0000 mgr.a (mgr.14373) 18702 : cluster [DBG] pgmap v12971: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:49:41.845 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:49:41 smithi047 bash[22744]: cluster 2024-09-16T12:49:40.359105+0000 mgr.a (mgr.14373) 18702 : cluster [DBG] pgmap v12971: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:49:43.496 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:49:43.496 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:49:43.496 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:49:43.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:49:43 smithi157 bash[24585]: cluster 2024-09-16T12:49:42.361254+0000 mgr.a (mgr.14373) 18703 : cluster [DBG] pgmap v12972: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:49:43.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:49:43 smithi086 bash[24289]: cluster 2024-09-16T12:49:42.361254+0000 mgr.a (mgr.14373) 18703 : cluster [DBG] pgmap v12972: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:49:43.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:49:43 smithi047 bash[22744]: cluster 2024-09-16T12:49:42.361254+0000 mgr.a (mgr.14373) 18703 : cluster [DBG] pgmap v12972: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:49:44.238 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:49:44.239 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:49:44.239 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:49:44.239 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:49:44.239 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:49:44.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:49:44 smithi157 bash[24585]: audit 2024-09-16T12:49:43.826182+0000 mgr.a (mgr.14373) 18704 : audit [DBG] from='client.401019 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:49:44.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:49:44 smithi157 bash[24585]: cluster 2024-09-16T12:49:44.362203+0000 mgr.a (mgr.14373) 18705 : cluster [DBG] pgmap v12973: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:49:44.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:49:44 smithi086 bash[24289]: audit 2024-09-16T12:49:43.826182+0000 mgr.a (mgr.14373) 18704 : audit [DBG] from='client.401019 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:49:44.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:49:44 smithi086 bash[24289]: cluster 2024-09-16T12:49:44.362203+0000 mgr.a (mgr.14373) 18705 : cluster [DBG] pgmap v12973: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:49:44.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:49:44 smithi047 bash[22744]: audit 2024-09-16T12:49:43.826182+0000 mgr.a (mgr.14373) 18704 : audit [DBG] from='client.401019 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:49:44.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:49:44 smithi047 bash[22744]: cluster 2024-09-16T12:49:44.362203+0000 mgr.a (mgr.14373) 18705 : cluster [DBG] pgmap v12973: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:49:47.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:49:47 smithi157 bash[24585]: cluster 2024-09-16T12:49:46.363019+0000 mgr.a (mgr.14373) 18706 : cluster [DBG] pgmap v12974: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:49:47.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:49:47 smithi086 bash[24289]: cluster 2024-09-16T12:49:46.363019+0000 mgr.a (mgr.14373) 18706 : cluster [DBG] pgmap v12974: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:49:47.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:49:47 smithi047 bash[22744]: cluster 2024-09-16T12:49:46.363019+0000 mgr.a (mgr.14373) 18706 : cluster [DBG] pgmap v12974: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:49:49.240 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:49:49.241 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:49:49.241 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:49:49.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:49:49 smithi157 bash[24585]: cluster 2024-09-16T12:49:48.365296+0000 mgr.a (mgr.14373) 18707 : cluster [DBG] pgmap v12975: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:49:49.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:49:49 smithi086 bash[24289]: cluster 2024-09-16T12:49:48.365296+0000 mgr.a (mgr.14373) 18707 : cluster [DBG] pgmap v12975: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:49:49.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:49:49 smithi047 bash[22744]: cluster 2024-09-16T12:49:48.365296+0000 mgr.a (mgr.14373) 18707 : cluster [DBG] pgmap v12975: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:49:50.033 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:49:50.034 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:49:50.034 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:49:50.034 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:49:50.034 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:49:50.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:49:50 smithi157 bash[24585]: audit 2024-09-16T12:49:49.577498+0000 mgr.a (mgr.14373) 18708 : audit [DBG] from='client.401097 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:49:50.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:49:50 smithi157 bash[24585]: cluster 2024-09-16T12:49:50.366410+0000 mgr.a (mgr.14373) 18709 : cluster [DBG] pgmap v12976: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:49:50.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:49:50 smithi086 bash[24289]: audit 2024-09-16T12:49:49.577498+0000 mgr.a (mgr.14373) 18708 : audit [DBG] from='client.401097 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:49:50.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:49:50 smithi086 bash[24289]: cluster 2024-09-16T12:49:50.366410+0000 mgr.a (mgr.14373) 18709 : cluster [DBG] pgmap v12976: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:49:50.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:49:50 smithi047 bash[22744]: audit 2024-09-16T12:49:49.577498+0000 mgr.a (mgr.14373) 18708 : audit [DBG] from='client.401097 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:49:50.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:49:50 smithi047 bash[22744]: cluster 2024-09-16T12:49:50.366410+0000 mgr.a (mgr.14373) 18709 : cluster [DBG] pgmap v12976: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:49:52.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:49:52 smithi157 bash[24585]: cluster 2024-09-16T12:49:52.368577+0000 mgr.a (mgr.14373) 18710 : cluster [DBG] pgmap v12977: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:49:52.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:49:52 smithi086 bash[24289]: cluster 2024-09-16T12:49:52.368577+0000 mgr.a (mgr.14373) 18710 : cluster [DBG] pgmap v12977: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:49:52.844 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:49:52 smithi047 bash[22744]: cluster 2024-09-16T12:49:52.368577+0000 mgr.a (mgr.14373) 18710 : cluster [DBG] pgmap v12977: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:49:54.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:49:54 smithi157 bash[24585]: cluster 2024-09-16T12:49:54.369321+0000 mgr.a (mgr.14373) 18711 : cluster [DBG] pgmap v12978: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:49:54.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:49:54 smithi086 bash[24289]: cluster 2024-09-16T12:49:54.369321+0000 mgr.a (mgr.14373) 18711 : cluster [DBG] pgmap v12978: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:49:54.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:49:54 smithi047 bash[22744]: cluster 2024-09-16T12:49:54.369321+0000 mgr.a (mgr.14373) 18711 : cluster [DBG] pgmap v12978: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:49:55.035 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:49:55.036 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:49:55.036 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:49:55.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:49:55 smithi157 bash[24585]: audit 2024-09-16T12:49:55.369685+0000 mgr.a (mgr.14373) 18712 : audit [DBG] from='client.401175 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:49:55.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:49:55 smithi086 bash[24289]: audit 2024-09-16T12:49:55.369685+0000 mgr.a (mgr.14373) 18712 : audit [DBG] from='client.401175 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:49:55.821 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:49:55.821 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:49:55.821 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:49:55.821 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:49:55.821 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:49:55.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:49:55 smithi047 bash[22744]: audit 2024-09-16T12:49:55.369685+0000 mgr.a (mgr.14373) 18712 : audit [DBG] from='client.401175 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:49:56.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:49:56 smithi157 bash[24585]: cluster 2024-09-16T12:49:56.370492+0000 mgr.a (mgr.14373) 18713 : cluster [DBG] pgmap v12979: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:49:56.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:49:56 smithi086 bash[24289]: cluster 2024-09-16T12:49:56.370492+0000 mgr.a (mgr.14373) 18713 : cluster [DBG] pgmap v12979: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:49:56.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:49:56 smithi047 bash[22744]: cluster 2024-09-16T12:49:56.370492+0000 mgr.a (mgr.14373) 18713 : cluster [DBG] pgmap v12979: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:49:58.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:49:58 smithi157 bash[24585]: cluster 2024-09-16T12:49:58.372738+0000 mgr.a (mgr.14373) 18714 : cluster [DBG] pgmap v12980: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:49:58.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:49:58 smithi086 bash[24289]: cluster 2024-09-16T12:49:58.372738+0000 mgr.a (mgr.14373) 18714 : cluster [DBG] pgmap v12980: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:49:58.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:49:58 smithi047 bash[22744]: cluster 2024-09-16T12:49:58.372738+0000 mgr.a (mgr.14373) 18714 : cluster [DBG] pgmap v12980: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:50:00.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:50:00 smithi157 bash[24585]: cluster 2024-09-16T12:50:00.000149+0000 mon.a (mon.0) 1686 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-16T12:50:00.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:50:00 smithi086 bash[24289]: cluster 2024-09-16T12:50:00.000149+0000 mon.a (mon.0) 1686 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-16T12:50:00.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:50:00 smithi047 bash[22744]: cluster 2024-09-16T12:50:00.000149+0000 mon.a (mon.0) 1686 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-16T12:50:00.822 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:50:00.823 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:50:00.823 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:50:01.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:50:01 smithi086 bash[24289]: cluster 2024-09-16T12:50:00.373490+0000 mgr.a (mgr.14373) 18715 : cluster [DBG] pgmap v12981: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:50:01.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:50:01 smithi047 bash[22744]: cluster 2024-09-16T12:50:00.373490+0000 mgr.a (mgr.14373) 18715 : cluster [DBG] pgmap v12981: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:50:01.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:50:01 smithi157 bash[24585]: cluster 2024-09-16T12:50:00.373490+0000 mgr.a (mgr.14373) 18715 : cluster [DBG] pgmap v12981: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:50:01.609 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:50:01.609 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:50:01.609 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:50:01.609 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:50:01.609 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:50:02.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:50:02 smithi086 bash[24289]: audit 2024-09-16T12:50:01.161060+0000 mgr.a (mgr.14373) 18716 : audit [DBG] from='client.401253 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:50:02.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:50:02 smithi047 bash[22744]: audit 2024-09-16T12:50:01.161060+0000 mgr.a (mgr.14373) 18716 : audit [DBG] from='client.401253 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:50:02.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:50:02 smithi157 bash[24585]: audit 2024-09-16T12:50:01.161060+0000 mgr.a (mgr.14373) 18716 : audit [DBG] from='client.401253 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:50:03.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:50:03 smithi047 bash[22744]: cluster 2024-09-16T12:50:02.375895+0000 mgr.a (mgr.14373) 18717 : cluster [DBG] pgmap v12982: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:50:03.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:50:03 smithi157 bash[24585]: cluster 2024-09-16T12:50:02.375895+0000 mgr.a (mgr.14373) 18717 : cluster [DBG] pgmap v12982: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:50:03.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:50:03 smithi086 bash[24289]: cluster 2024-09-16T12:50:02.375895+0000 mgr.a (mgr.14373) 18717 : cluster [DBG] pgmap v12982: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:50:04.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:50:04 smithi157 bash[24585]: cluster 2024-09-16T12:50:04.376673+0000 mgr.a (mgr.14373) 18718 : cluster [DBG] pgmap v12983: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-16T12:50:04.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:50:04 smithi086 bash[24289]: cluster 2024-09-16T12:50:04.376673+0000 mgr.a (mgr.14373) 18718 : cluster [DBG] pgmap v12983: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-16T12:50:04.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:50:04 smithi047 bash[22744]: cluster 2024-09-16T12:50:04.376673+0000 mgr.a (mgr.14373) 18718 : cluster [DBG] pgmap v12983: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-16T12:50:06.610 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:50:06.612 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:50:06.612 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:50:06.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:50:06 smithi157 bash[24585]: cluster 2024-09-16T12:50:06.377437+0000 mgr.a (mgr.14373) 18719 : cluster [DBG] pgmap v12984: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-16T12:50:06.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:50:06 smithi086 bash[24289]: cluster 2024-09-16T12:50:06.377437+0000 mgr.a (mgr.14373) 18719 : cluster [DBG] pgmap v12984: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-16T12:50:06.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:50:06 smithi047 bash[22744]: cluster 2024-09-16T12:50:06.377437+0000 mgr.a (mgr.14373) 18719 : cluster [DBG] pgmap v12984: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-16T12:50:07.387 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:50:07.388 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:50:07.388 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:50:07.388 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:50:07.388 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:50:07.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:50:07 smithi157 bash[24585]: audit 2024-09-16T12:50:06.947962+0000 mgr.a (mgr.14373) 18720 : audit [DBG] from='client.401331 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:50:07.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:50:07 smithi086 bash[24289]: audit 2024-09-16T12:50:06.947962+0000 mgr.a (mgr.14373) 18720 : audit [DBG] from='client.401331 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:50:07.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:50:07 smithi047 bash[22744]: audit 2024-09-16T12:50:06.947962+0000 mgr.a (mgr.14373) 18720 : audit [DBG] from='client.401331 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:50:08.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:50:08 smithi157 bash[24585]: cluster 2024-09-16T12:50:08.380184+0000 mgr.a (mgr.14373) 18721 : cluster [DBG] pgmap v12985: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:50:08.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:50:08 smithi086 bash[24289]: cluster 2024-09-16T12:50:08.380184+0000 mgr.a (mgr.14373) 18721 : cluster [DBG] pgmap v12985: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:50:08.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:50:08 smithi047 bash[22744]: cluster 2024-09-16T12:50:08.380184+0000 mgr.a (mgr.14373) 18721 : cluster [DBG] pgmap v12985: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:50:10.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:50:10 smithi157 bash[24585]: cluster 2024-09-16T12:50:10.380963+0000 mgr.a (mgr.14373) 18722 : cluster [DBG] pgmap v12986: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:50:10.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:50:10 smithi086 bash[24289]: cluster 2024-09-16T12:50:10.380963+0000 mgr.a (mgr.14373) 18722 : cluster [DBG] pgmap v12986: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:50:10.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:50:10 smithi047 bash[22744]: cluster 2024-09-16T12:50:10.380963+0000 mgr.a (mgr.14373) 18722 : cluster [DBG] pgmap v12986: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:50:12.389 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:50:12.390 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:50:12.390 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:50:12.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:50:12 smithi157 bash[24585]: cluster 2024-09-16T12:50:12.382916+0000 mgr.a (mgr.14373) 18723 : cluster [DBG] pgmap v12987: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:50:12.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:50:12 smithi086 bash[24289]: cluster 2024-09-16T12:50:12.382916+0000 mgr.a (mgr.14373) 18723 : cluster [DBG] pgmap v12987: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:50:12.842 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:50:12 smithi047 bash[22744]: cluster 2024-09-16T12:50:12.382916+0000 mgr.a (mgr.14373) 18723 : cluster [DBG] pgmap v12987: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:50:13.163 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:50:13.163 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:50:13.163 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:50:13.163 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:50:13.164 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:50:13.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:50:13 smithi157 bash[24585]: audit 2024-09-16T12:50:12.725906+0000 mgr.a (mgr.14373) 18724 : audit [DBG] from='client.401400 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:50:13.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:50:13 smithi086 bash[24289]: audit 2024-09-16T12:50:12.725906+0000 mgr.a (mgr.14373) 18724 : audit [DBG] from='client.401400 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:50:13.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:50:13 smithi047 bash[22744]: audit 2024-09-16T12:50:12.725906+0000 mgr.a (mgr.14373) 18724 : audit [DBG] from='client.401400 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:50:14.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:50:14 smithi157 bash[24585]: cluster 2024-09-16T12:50:14.383929+0000 mgr.a (mgr.14373) 18725 : cluster [DBG] pgmap v12988: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-16T12:50:14.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:50:14 smithi086 bash[24289]: cluster 2024-09-16T12:50:14.383929+0000 mgr.a (mgr.14373) 18725 : cluster [DBG] pgmap v12988: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-16T12:50:14.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:50:14 smithi047 bash[22744]: cluster 2024-09-16T12:50:14.383929+0000 mgr.a (mgr.14373) 18725 : cluster [DBG] pgmap v12988: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-16T12:50:16.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:50:16 smithi157 bash[24585]: cluster 2024-09-16T12:50:16.384765+0000 mgr.a (mgr.14373) 18726 : cluster [DBG] pgmap v12989: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-16T12:50:16.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:50:16 smithi086 bash[24289]: cluster 2024-09-16T12:50:16.384765+0000 mgr.a (mgr.14373) 18726 : cluster [DBG] pgmap v12989: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-16T12:50:16.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:50:16 smithi047 bash[22744]: cluster 2024-09-16T12:50:16.384765+0000 mgr.a (mgr.14373) 18726 : cluster [DBG] pgmap v12989: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-16T12:50:18.165 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:50:18.165 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:50:18.165 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:50:18.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:50:18 smithi157 bash[24585]: cluster 2024-09-16T12:50:18.386934+0000 mgr.a (mgr.14373) 18727 : cluster [DBG] pgmap v12990: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-16T12:50:18.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:50:18 smithi086 bash[24289]: cluster 2024-09-16T12:50:18.386934+0000 mgr.a (mgr.14373) 18727 : cluster [DBG] pgmap v12990: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-16T12:50:18.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:50:18 smithi047 bash[22744]: cluster 2024-09-16T12:50:18.386934+0000 mgr.a (mgr.14373) 18727 : cluster [DBG] pgmap v12990: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-16T12:50:18.958 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:50:18.958 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:50:18.958 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:50:18.958 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:50:18.959 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:50:19.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:50:19 smithi157 bash[24585]: audit 2024-09-16T12:50:18.506335+0000 mgr.a (mgr.14373) 18728 : audit [DBG] from='client.401478 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:50:19.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:50:19 smithi086 bash[24289]: audit 2024-09-16T12:50:18.506335+0000 mgr.a (mgr.14373) 18728 : audit [DBG] from='client.401478 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:50:19.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:50:19 smithi047 bash[22744]: audit 2024-09-16T12:50:18.506335+0000 mgr.a (mgr.14373) 18728 : audit [DBG] from='client.401478 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:50:20.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:50:20 smithi157 bash[24585]: cluster 2024-09-16T12:50:20.388000+0000 mgr.a (mgr.14373) 18729 : cluster [DBG] pgmap v12991: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:50:20.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:50:20 smithi086 bash[24289]: cluster 2024-09-16T12:50:20.388000+0000 mgr.a (mgr.14373) 18729 : cluster [DBG] pgmap v12991: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:50:20.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:50:20 smithi047 bash[22744]: cluster 2024-09-16T12:50:20.388000+0000 mgr.a (mgr.14373) 18729 : cluster [DBG] pgmap v12991: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:50:22.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:50:22 smithi157 bash[24585]: cluster 2024-09-16T12:50:22.390210+0000 mgr.a (mgr.14373) 18730 : cluster [DBG] pgmap v12992: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:50:22.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:50:22 smithi086 bash[24289]: cluster 2024-09-16T12:50:22.390210+0000 mgr.a (mgr.14373) 18730 : cluster [DBG] pgmap v12992: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:50:22.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:50:22 smithi047 bash[22744]: cluster 2024-09-16T12:50:22.390210+0000 mgr.a (mgr.14373) 18730 : cluster [DBG] pgmap v12992: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:50:23.959 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:50:23.960 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:50:23.960 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:50:24.743 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:50:24.744 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:50:24.744 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:50:24.744 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:50:24.744 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:50:24.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:50:24 smithi157 bash[24585]: audit 2024-09-16T12:50:24.290116+0000 mgr.a (mgr.14373) 18731 : audit [DBG] from='client.401553 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:50:24.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:50:24 smithi157 bash[24585]: cluster 2024-09-16T12:50:24.390748+0000 mgr.a (mgr.14373) 18732 : cluster [DBG] pgmap v12993: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:50:24.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:50:24 smithi086 bash[24289]: audit 2024-09-16T12:50:24.290116+0000 mgr.a (mgr.14373) 18731 : audit [DBG] from='client.401553 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:50:24.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:50:24 smithi086 bash[24289]: cluster 2024-09-16T12:50:24.390748+0000 mgr.a (mgr.14373) 18732 : cluster [DBG] pgmap v12993: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:50:24.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:50:24 smithi047 bash[22744]: audit 2024-09-16T12:50:24.290116+0000 mgr.a (mgr.14373) 18731 : audit [DBG] from='client.401553 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:50:24.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:50:24 smithi047 bash[22744]: cluster 2024-09-16T12:50:24.390748+0000 mgr.a (mgr.14373) 18732 : cluster [DBG] pgmap v12993: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:50:26.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:50:26 smithi157 bash[24585]: cluster 2024-09-16T12:50:26.391611+0000 mgr.a (mgr.14373) 18733 : cluster [DBG] pgmap v12994: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:50:26.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:50:26 smithi086 bash[24289]: cluster 2024-09-16T12:50:26.391611+0000 mgr.a (mgr.14373) 18733 : cluster [DBG] pgmap v12994: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:50:26.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:50:26 smithi047 bash[22744]: cluster 2024-09-16T12:50:26.391611+0000 mgr.a (mgr.14373) 18733 : cluster [DBG] pgmap v12994: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:50:28.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:50:28 smithi157 bash[24585]: cluster 2024-09-16T12:50:28.393831+0000 mgr.a (mgr.14373) 18734 : cluster [DBG] pgmap v12995: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:50:28.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:50:28 smithi086 bash[24289]: cluster 2024-09-16T12:50:28.393831+0000 mgr.a (mgr.14373) 18734 : cluster [DBG] pgmap v12995: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:50:28.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:50:28 smithi047 bash[22744]: cluster 2024-09-16T12:50:28.393831+0000 mgr.a (mgr.14373) 18734 : cluster [DBG] pgmap v12995: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:50:29.745 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:50:29.746 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:50:29.746 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:50:30.510 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:50:30.510 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:50:30.510 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:50:30.510 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:50:30.510 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:50:30.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:50:30 smithi157 bash[24585]: audit 2024-09-16T12:50:30.073436+0000 mgr.a (mgr.14373) 18735 : audit [DBG] from='client.401628 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:50:30.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:50:30 smithi157 bash[24585]: cluster 2024-09-16T12:50:30.394318+0000 mgr.a (mgr.14373) 18736 : cluster [DBG] pgmap v12996: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:50:30.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:50:30 smithi086 bash[24289]: audit 2024-09-16T12:50:30.073436+0000 mgr.a (mgr.14373) 18735 : audit [DBG] from='client.401628 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:50:30.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:50:30 smithi086 bash[24289]: cluster 2024-09-16T12:50:30.394318+0000 mgr.a (mgr.14373) 18736 : cluster [DBG] pgmap v12996: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:50:30.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:50:30 smithi047 bash[22744]: audit 2024-09-16T12:50:30.073436+0000 mgr.a (mgr.14373) 18735 : audit [DBG] from='client.401628 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:50:30.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:50:30 smithi047 bash[22744]: cluster 2024-09-16T12:50:30.394318+0000 mgr.a (mgr.14373) 18736 : cluster [DBG] pgmap v12996: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:50:32.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:50:32 smithi157 bash[24585]: cluster 2024-09-16T12:50:32.396569+0000 mgr.a (mgr.14373) 18737 : cluster [DBG] pgmap v12997: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:50:32.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:50:32 smithi086 bash[24289]: cluster 2024-09-16T12:50:32.396569+0000 mgr.a (mgr.14373) 18737 : cluster [DBG] pgmap v12997: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:50:32.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:50:32 smithi047 bash[22744]: cluster 2024-09-16T12:50:32.396569+0000 mgr.a (mgr.14373) 18737 : cluster [DBG] pgmap v12997: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:50:34.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:50:34 smithi157 bash[24585]: cluster 2024-09-16T12:50:34.397330+0000 mgr.a (mgr.14373) 18738 : cluster [DBG] pgmap v12998: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:50:34.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:50:34 smithi086 bash[24289]: cluster 2024-09-16T12:50:34.397330+0000 mgr.a (mgr.14373) 18738 : cluster [DBG] pgmap v12998: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:50:34.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:50:34 smithi047 bash[22744]: cluster 2024-09-16T12:50:34.397330+0000 mgr.a (mgr.14373) 18738 : cluster [DBG] pgmap v12998: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:50:35.511 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:50:35.512 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:50:35.512 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:50:36.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:50:35 smithi157 bash[24585]: audit 2024-09-16T12:50:35.724738+0000 mon.b (mon.2) 1694 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T12:50:36.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:50:35 smithi086 bash[24289]: audit 2024-09-16T12:50:35.724738+0000 mon.b (mon.2) 1694 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T12:50:36.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:50:35 smithi047 bash[22744]: audit 2024-09-16T12:50:35.724738+0000 mon.b (mon.2) 1694 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T12:50:36.341 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:50:36.342 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:50:36.342 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:50:36.342 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:50:36.342 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:50:37.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:50:36 smithi157 bash[24585]: audit 2024-09-16T12:50:35.893676+0000 mgr.a (mgr.14373) 18739 : audit [DBG] from='client.401703 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:50:37.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:50:36 smithi157 bash[24585]: cluster 2024-09-16T12:50:36.397896+0000 mgr.a (mgr.14373) 18740 : cluster [DBG] pgmap v12999: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:50:37.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:50:36 smithi086 bash[24289]: audit 2024-09-16T12:50:35.893676+0000 mgr.a (mgr.14373) 18739 : audit [DBG] from='client.401703 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:50:37.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:50:36 smithi086 bash[24289]: cluster 2024-09-16T12:50:36.397896+0000 mgr.a (mgr.14373) 18740 : cluster [DBG] pgmap v12999: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:50:37.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:50:36 smithi047 bash[22744]: audit 2024-09-16T12:50:35.893676+0000 mgr.a (mgr.14373) 18739 : audit [DBG] from='client.401703 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:50:37.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:50:36 smithi047 bash[22744]: cluster 2024-09-16T12:50:36.397896+0000 mgr.a (mgr.14373) 18740 : cluster [DBG] pgmap v12999: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:50:38.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:50:38 smithi157 bash[24585]: cluster 2024-09-16T12:50:38.400135+0000 mgr.a (mgr.14373) 18741 : cluster [DBG] pgmap v13000: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:50:38.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:50:38 smithi086 bash[24289]: cluster 2024-09-16T12:50:38.400135+0000 mgr.a (mgr.14373) 18741 : cluster [DBG] pgmap v13000: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:50:38.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:50:38 smithi047 bash[22744]: cluster 2024-09-16T12:50:38.400135+0000 mgr.a (mgr.14373) 18741 : cluster [DBG] pgmap v13000: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:50:40.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:50:40 smithi157 bash[24585]: cluster 2024-09-16T12:50:40.400898+0000 mgr.a (mgr.14373) 18742 : cluster [DBG] pgmap v13001: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:50:40.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:50:40 smithi086 bash[24289]: cluster 2024-09-16T12:50:40.400898+0000 mgr.a (mgr.14373) 18742 : cluster [DBG] pgmap v13001: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:50:40.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:50:40 smithi047 bash[22744]: cluster 2024-09-16T12:50:40.400898+0000 mgr.a (mgr.14373) 18742 : cluster [DBG] pgmap v13001: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:50:41.343 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:50:41.344 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:50:41.344 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:50:42.100 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:50:42.100 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:50:42.100 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:50:42.100 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:50:42.100 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:50:42.308 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:50:42 smithi157 bash[24585]: audit 2024-09-16T12:50:41.039574+0000 mon.a (mon.0) 1687 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:50:42.308 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:50:42 smithi157 bash[24585]: audit 2024-09-16T12:50:41.045114+0000 mon.a (mon.0) 1688 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:50:42.308 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:50:42 smithi157 bash[24585]: audit 2024-09-16T12:50:41.058108+0000 mon.a (mon.0) 1689 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:50:42.308 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:50:42 smithi157 bash[24585]: audit 2024-09-16T12:50:41.063955+0000 mon.a (mon.0) 1690 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:50:42.308 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:50:42 smithi157 bash[24585]: audit 2024-09-16T12:50:41.118855+0000 mon.a (mon.0) 1691 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:50:42.308 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:50:42 smithi157 bash[24585]: audit 2024-09-16T12:50:41.126801+0000 mon.a (mon.0) 1692 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:50:42.308 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:50:42 smithi157 bash[24585]: audit 2024-09-16T12:50:41.883687+0000 mon.b (mon.2) 1695 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T12:50:42.308 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:50:42 smithi157 bash[24585]: audit 2024-09-16T12:50:41.884938+0000 mon.b (mon.2) 1696 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T12:50:42.309 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:50:42 smithi157 bash[24585]: audit 2024-09-16T12:50:41.891838+0000 mon.a (mon.0) 1693 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:50:42.309 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:50:42 smithi157 bash[24585]: audit 2024-09-16T12:50:41.896653+0000 mon.b (mon.2) 1697 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:50:42.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:50:42 smithi086 bash[24289]: audit 2024-09-16T12:50:41.039574+0000 mon.a (mon.0) 1687 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:50:42.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:50:42 smithi086 bash[24289]: audit 2024-09-16T12:50:41.045114+0000 mon.a (mon.0) 1688 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:50:42.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:50:42 smithi086 bash[24289]: audit 2024-09-16T12:50:41.058108+0000 mon.a (mon.0) 1689 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:50:42.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:50:42 smithi086 bash[24289]: audit 2024-09-16T12:50:41.063955+0000 mon.a (mon.0) 1690 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:50:42.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:50:42 smithi086 bash[24289]: audit 2024-09-16T12:50:41.118855+0000 mon.a (mon.0) 1691 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:50:42.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:50:42 smithi086 bash[24289]: audit 2024-09-16T12:50:41.126801+0000 mon.a (mon.0) 1692 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:50:42.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:50:42 smithi086 bash[24289]: audit 2024-09-16T12:50:41.883687+0000 mon.b (mon.2) 1695 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T12:50:42.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:50:42 smithi086 bash[24289]: audit 2024-09-16T12:50:41.884938+0000 mon.b (mon.2) 1696 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T12:50:42.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:50:42 smithi086 bash[24289]: audit 2024-09-16T12:50:41.891838+0000 mon.a (mon.0) 1693 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:50:42.322 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:50:42 smithi086 bash[24289]: audit 2024-09-16T12:50:41.896653+0000 mon.b (mon.2) 1697 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:50:42.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:50:42 smithi047 bash[22744]: audit 2024-09-16T12:50:41.039574+0000 mon.a (mon.0) 1687 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:50:42.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:50:42 smithi047 bash[22744]: audit 2024-09-16T12:50:41.045114+0000 mon.a (mon.0) 1688 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:50:42.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:50:42 smithi047 bash[22744]: audit 2024-09-16T12:50:41.058108+0000 mon.a (mon.0) 1689 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:50:42.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:50:42 smithi047 bash[22744]: audit 2024-09-16T12:50:41.063955+0000 mon.a (mon.0) 1690 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:50:42.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:50:42 smithi047 bash[22744]: audit 2024-09-16T12:50:41.118855+0000 mon.a (mon.0) 1691 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:50:42.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:50:42 smithi047 bash[22744]: audit 2024-09-16T12:50:41.126801+0000 mon.a (mon.0) 1692 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:50:42.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:50:42 smithi047 bash[22744]: audit 2024-09-16T12:50:41.883687+0000 mon.b (mon.2) 1695 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T12:50:42.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:50:42 smithi047 bash[22744]: audit 2024-09-16T12:50:41.884938+0000 mon.b (mon.2) 1696 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T12:50:42.344 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:50:42 smithi047 bash[22744]: audit 2024-09-16T12:50:41.891838+0000 mon.a (mon.0) 1693 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:50:42.344 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:50:42 smithi047 bash[22744]: audit 2024-09-16T12:50:41.896653+0000 mon.b (mon.2) 1697 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:50:43.093 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 12:50:42 smithi047 bash[22994]: debug 2024-09-16T12:50:42.803+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T12:50:43.093 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 12:50:42 smithi047 bash[22994]: debug 2024-09-16T12:50:42.807+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T12:50:43.094 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:50:43 smithi047 bash[22744]: audit 2024-09-16T12:50:41.666699+0000 mgr.a (mgr.14373) 18743 : audit [DBG] from='client.401778 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:50:43.094 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:50:43 smithi047 bash[22744]: audit 2024-09-16T12:50:41.897826+0000 mgr.a (mgr.14373) 18744 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:50:43.094 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:50:43 smithi047 bash[22744]: cluster 2024-09-16T12:50:42.402212+0000 mgr.a (mgr.14373) 18745 : cluster [DBG] pgmap v13002: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:50:43.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:50:43 smithi157 bash[24585]: audit 2024-09-16T12:50:41.666699+0000 mgr.a (mgr.14373) 18743 : audit [DBG] from='client.401778 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:50:43.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:50:43 smithi157 bash[24585]: audit 2024-09-16T12:50:41.897826+0000 mgr.a (mgr.14373) 18744 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:50:43.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:50:43 smithi157 bash[24585]: cluster 2024-09-16T12:50:42.402212+0000 mgr.a (mgr.14373) 18745 : cluster [DBG] pgmap v13002: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:50:43.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:50:43 smithi086 bash[24289]: audit 2024-09-16T12:50:41.666699+0000 mgr.a (mgr.14373) 18743 : audit [DBG] from='client.401778 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:50:43.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:50:43 smithi086 bash[24289]: audit 2024-09-16T12:50:41.897826+0000 mgr.a (mgr.14373) 18744 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:50:43.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:50:43 smithi086 bash[24289]: cluster 2024-09-16T12:50:42.402212+0000 mgr.a (mgr.14373) 18745 : cluster [DBG] pgmap v13002: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:50:44.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:50:44 smithi157 bash[24585]: audit 2024-09-16T12:50:42.808730+0000 mgr.a (mgr.14373) 18746 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T12:50:44.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:50:44 smithi157 bash[24585]: cephadm 2024-09-16T12:50:42.810875+0000 mgr.a (mgr.14373) 18747 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T12:50:44.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:50:44 smithi086 bash[24289]: audit 2024-09-16T12:50:42.808730+0000 mgr.a (mgr.14373) 18746 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T12:50:44.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:50:44 smithi086 bash[24289]: cephadm 2024-09-16T12:50:42.810875+0000 mgr.a (mgr.14373) 18747 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T12:50:44.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:50:44 smithi047 bash[22744]: audit 2024-09-16T12:50:42.808730+0000 mgr.a (mgr.14373) 18746 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T12:50:44.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:50:44 smithi047 bash[22744]: cephadm 2024-09-16T12:50:42.810875+0000 mgr.a (mgr.14373) 18747 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T12:50:45.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:50:45 smithi086 bash[24289]: cluster 2024-09-16T12:50:44.403020+0000 mgr.a (mgr.14373) 18748 : cluster [DBG] pgmap v13003: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T12:50:45.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:50:45 smithi047 bash[22744]: cluster 2024-09-16T12:50:44.403020+0000 mgr.a (mgr.14373) 18748 : cluster [DBG] pgmap v13003: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T12:50:45.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:50:45 smithi157 bash[24585]: cluster 2024-09-16T12:50:44.403020+0000 mgr.a (mgr.14373) 18748 : cluster [DBG] pgmap v13003: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T12:50:46.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:50:46 smithi157 bash[24585]: cluster 2024-09-16T12:50:46.403802+0000 mgr.a (mgr.14373) 18749 : cluster [DBG] pgmap v13004: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T12:50:46.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:50:46 smithi086 bash[24289]: cluster 2024-09-16T12:50:46.403802+0000 mgr.a (mgr.14373) 18749 : cluster [DBG] pgmap v13004: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T12:50:46.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:50:46 smithi047 bash[22744]: cluster 2024-09-16T12:50:46.403802+0000 mgr.a (mgr.14373) 18749 : cluster [DBG] pgmap v13004: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T12:50:47.101 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:50:47.102 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:50:47.102 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:50:47.808 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:50:47 smithi157 bash[24585]: audit 2024-09-16T12:50:47.435064+0000 mgr.a (mgr.14373) 18750 : audit [DBG] from='client.401961 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:50:47.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:50:47 smithi086 bash[24289]: audit 2024-09-16T12:50:47.435064+0000 mgr.a (mgr.14373) 18750 : audit [DBG] from='client.401961 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:50:47.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:50:47 smithi047 bash[22744]: audit 2024-09-16T12:50:47.435064+0000 mgr.a (mgr.14373) 18750 : audit [DBG] from='client.401961 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:50:47.890 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:50:47.890 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:50:47.890 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:50:47.890 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:50:47.890 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:50:48.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:50:48 smithi157 bash[24585]: cluster 2024-09-16T12:50:48.406712+0000 mgr.a (mgr.14373) 18751 : cluster [DBG] pgmap v13005: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:50:48.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:50:48 smithi086 bash[24289]: cluster 2024-09-16T12:50:48.406712+0000 mgr.a (mgr.14373) 18751 : cluster [DBG] pgmap v13005: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:50:48.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:50:48 smithi047 bash[22744]: cluster 2024-09-16T12:50:48.406712+0000 mgr.a (mgr.14373) 18751 : cluster [DBG] pgmap v13005: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:50:50.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:50:50 smithi157 bash[24585]: cluster 2024-09-16T12:50:50.407675+0000 mgr.a (mgr.14373) 18752 : cluster [DBG] pgmap v13006: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T12:50:50.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:50:50 smithi086 bash[24289]: cluster 2024-09-16T12:50:50.407675+0000 mgr.a (mgr.14373) 18752 : cluster [DBG] pgmap v13006: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T12:50:50.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:50:50 smithi047 bash[22744]: cluster 2024-09-16T12:50:50.407675+0000 mgr.a (mgr.14373) 18752 : cluster [DBG] pgmap v13006: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T12:50:52.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:50:52 smithi157 bash[24585]: cluster 2024-09-16T12:50:52.409740+0000 mgr.a (mgr.14373) 18753 : cluster [DBG] pgmap v13007: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:50:52.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:50:52 smithi086 bash[24289]: cluster 2024-09-16T12:50:52.409740+0000 mgr.a (mgr.14373) 18753 : cluster [DBG] pgmap v13007: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:50:52.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:50:52 smithi047 bash[22744]: cluster 2024-09-16T12:50:52.409740+0000 mgr.a (mgr.14373) 18753 : cluster [DBG] pgmap v13007: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:50:52.891 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:50:52.893 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:50:52.893 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:50:53.670 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:50:53.670 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:50:53.670 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:50:53.670 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:50:53.670 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:50:53.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:50:53 smithi157 bash[24585]: audit 2024-09-16T12:50:53.224543+0000 mgr.a (mgr.14373) 18754 : audit [DBG] from='client.402036 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:50:53.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:50:53 smithi086 bash[24289]: audit 2024-09-16T12:50:53.224543+0000 mgr.a (mgr.14373) 18754 : audit [DBG] from='client.402036 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:50:53.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:50:53 smithi047 bash[22744]: audit 2024-09-16T12:50:53.224543+0000 mgr.a (mgr.14373) 18754 : audit [DBG] from='client.402036 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:50:54.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:50:54 smithi157 bash[24585]: cluster 2024-09-16T12:50:54.410643+0000 mgr.a (mgr.14373) 18755 : cluster [DBG] pgmap v13008: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:50:54.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:50:54 smithi086 bash[24289]: cluster 2024-09-16T12:50:54.410643+0000 mgr.a (mgr.14373) 18755 : cluster [DBG] pgmap v13008: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:50:54.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:50:54 smithi047 bash[22744]: cluster 2024-09-16T12:50:54.410643+0000 mgr.a (mgr.14373) 18755 : cluster [DBG] pgmap v13008: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:50:56.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:50:56 smithi157 bash[24585]: cluster 2024-09-16T12:50:56.411385+0000 mgr.a (mgr.14373) 18756 : cluster [DBG] pgmap v13009: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:50:56.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:50:56 smithi086 bash[24289]: cluster 2024-09-16T12:50:56.411385+0000 mgr.a (mgr.14373) 18756 : cluster [DBG] pgmap v13009: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:50:56.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:50:56 smithi047 bash[22744]: cluster 2024-09-16T12:50:56.411385+0000 mgr.a (mgr.14373) 18756 : cluster [DBG] pgmap v13009: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:50:58.672 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:50:58.672 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:50:58.672 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:50:58.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:50:58 smithi157 bash[24585]: cluster 2024-09-16T12:50:58.413555+0000 mgr.a (mgr.14373) 18757 : cluster [DBG] pgmap v13010: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:50:58.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:50:58 smithi086 bash[24289]: cluster 2024-09-16T12:50:58.413555+0000 mgr.a (mgr.14373) 18757 : cluster [DBG] pgmap v13010: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:50:58.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:50:58 smithi047 bash[22744]: cluster 2024-09-16T12:50:58.413555+0000 mgr.a (mgr.14373) 18757 : cluster [DBG] pgmap v13010: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:50:59.454 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:50:59.454 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:50:59.454 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:50:59.454 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:50:59.454 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:50:59.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:50:59 smithi157 bash[24585]: audit 2024-09-16T12:50:59.007457+0000 mgr.a (mgr.14373) 18758 : audit [DBG] from='client.402114 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:50:59.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:50:59 smithi086 bash[24289]: audit 2024-09-16T12:50:59.007457+0000 mgr.a (mgr.14373) 18758 : audit [DBG] from='client.402114 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:50:59.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:50:59 smithi047 bash[22744]: audit 2024-09-16T12:50:59.007457+0000 mgr.a (mgr.14373) 18758 : audit [DBG] from='client.402114 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:51:00.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:51:00 smithi157 bash[24585]: cluster 2024-09-16T12:51:00.414629+0000 mgr.a (mgr.14373) 18759 : cluster [DBG] pgmap v13011: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:51:00.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:51:00 smithi086 bash[24289]: cluster 2024-09-16T12:51:00.414629+0000 mgr.a (mgr.14373) 18759 : cluster [DBG] pgmap v13011: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:51:00.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:51:00 smithi047 bash[22744]: cluster 2024-09-16T12:51:00.414629+0000 mgr.a (mgr.14373) 18759 : cluster [DBG] pgmap v13011: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:51:02.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:51:02 smithi157 bash[24585]: cluster 2024-09-16T12:51:02.416898+0000 mgr.a (mgr.14373) 18760 : cluster [DBG] pgmap v13012: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:51:02.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:51:02 smithi086 bash[24289]: cluster 2024-09-16T12:51:02.416898+0000 mgr.a (mgr.14373) 18760 : cluster [DBG] pgmap v13012: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:51:02.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:51:02 smithi047 bash[22744]: cluster 2024-09-16T12:51:02.416898+0000 mgr.a (mgr.14373) 18760 : cluster [DBG] pgmap v13012: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:51:04.455 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:51:04.456 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:51:04.456 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:51:04.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:51:04 smithi157 bash[24585]: cluster 2024-09-16T12:51:04.417636+0000 mgr.a (mgr.14373) 18761 : cluster [DBG] pgmap v13013: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:51:04.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:51:04 smithi086 bash[24289]: cluster 2024-09-16T12:51:04.417636+0000 mgr.a (mgr.14373) 18761 : cluster [DBG] pgmap v13013: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:51:04.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:51:04 smithi047 bash[22744]: cluster 2024-09-16T12:51:04.417636+0000 mgr.a (mgr.14373) 18761 : cluster [DBG] pgmap v13013: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:51:05.240 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:51:05.240 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:51:05.240 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:51:05.241 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:51:05.241 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:51:05.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:51:05 smithi157 bash[24585]: audit 2024-09-16T12:51:04.788461+0000 mgr.a (mgr.14373) 18762 : audit [DBG] from='client.402189 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:51:05.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:51:05 smithi086 bash[24289]: audit 2024-09-16T12:51:04.788461+0000 mgr.a (mgr.14373) 18762 : audit [DBG] from='client.402189 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:51:05.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:51:05 smithi047 bash[22744]: audit 2024-09-16T12:51:04.788461+0000 mgr.a (mgr.14373) 18762 : audit [DBG] from='client.402189 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:51:06.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:51:06 smithi157 bash[24585]: cluster 2024-09-16T12:51:06.418577+0000 mgr.a (mgr.14373) 18763 : cluster [DBG] pgmap v13014: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:51:06.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:51:06 smithi086 bash[24289]: cluster 2024-09-16T12:51:06.418577+0000 mgr.a (mgr.14373) 18763 : cluster [DBG] pgmap v13014: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:51:06.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:51:06 smithi047 bash[22744]: cluster 2024-09-16T12:51:06.418577+0000 mgr.a (mgr.14373) 18763 : cluster [DBG] pgmap v13014: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:51:08.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:51:08 smithi157 bash[24585]: cluster 2024-09-16T12:51:08.420929+0000 mgr.a (mgr.14373) 18764 : cluster [DBG] pgmap v13015: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:51:08.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:51:08 smithi086 bash[24289]: cluster 2024-09-16T12:51:08.420929+0000 mgr.a (mgr.14373) 18764 : cluster [DBG] pgmap v13015: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:51:08.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:51:08 smithi047 bash[22744]: cluster 2024-09-16T12:51:08.420929+0000 mgr.a (mgr.14373) 18764 : cluster [DBG] pgmap v13015: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:51:10.242 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:51:10.242 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:51:10.243 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:51:10.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:51:10 smithi157 bash[24585]: cluster 2024-09-16T12:51:10.421862+0000 mgr.a (mgr.14373) 18765 : cluster [DBG] pgmap v13016: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:51:10.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:51:10 smithi086 bash[24289]: cluster 2024-09-16T12:51:10.421862+0000 mgr.a (mgr.14373) 18765 : cluster [DBG] pgmap v13016: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:51:10.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:51:10 smithi047 bash[22744]: cluster 2024-09-16T12:51:10.421862+0000 mgr.a (mgr.14373) 18765 : cluster [DBG] pgmap v13016: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:51:11.013 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:51:11.014 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:51:11.014 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:51:11.014 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:51:11.014 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:51:11.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:51:11 smithi157 bash[24585]: audit 2024-09-16T12:51:10.575408+0000 mgr.a (mgr.14373) 18766 : audit [DBG] from='client.402261 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:51:11.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:51:11 smithi086 bash[24289]: audit 2024-09-16T12:51:10.575408+0000 mgr.a (mgr.14373) 18766 : audit [DBG] from='client.402261 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:51:11.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:51:11 smithi047 bash[22744]: audit 2024-09-16T12:51:10.575408+0000 mgr.a (mgr.14373) 18766 : audit [DBG] from='client.402261 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:51:12.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:51:12 smithi157 bash[24585]: cluster 2024-09-16T12:51:12.424183+0000 mgr.a (mgr.14373) 18767 : cluster [DBG] pgmap v13017: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:51:12.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:51:12 smithi086 bash[24289]: cluster 2024-09-16T12:51:12.424183+0000 mgr.a (mgr.14373) 18767 : cluster [DBG] pgmap v13017: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:51:12.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:51:12 smithi047 bash[22744]: cluster 2024-09-16T12:51:12.424183+0000 mgr.a (mgr.14373) 18767 : cluster [DBG] pgmap v13017: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:51:14.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:51:14 smithi157 bash[24585]: cluster 2024-09-16T12:51:14.424925+0000 mgr.a (mgr.14373) 18768 : cluster [DBG] pgmap v13018: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:51:14.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:51:14 smithi086 bash[24289]: cluster 2024-09-16T12:51:14.424925+0000 mgr.a (mgr.14373) 18768 : cluster [DBG] pgmap v13018: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:51:14.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:51:14 smithi047 bash[22744]: cluster 2024-09-16T12:51:14.424925+0000 mgr.a (mgr.14373) 18768 : cluster [DBG] pgmap v13018: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:51:16.015 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:51:16.016 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:51:16.016 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:51:16.795 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:51:16.796 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:51:16.796 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:51:16.796 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:51:16.796 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:51:16.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:51:16 smithi157 bash[24585]: audit 2024-09-16T12:51:16.352543+0000 mgr.a (mgr.14373) 18769 : audit [DBG] from='client.402339 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:51:16.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:51:16 smithi157 bash[24585]: cluster 2024-09-16T12:51:16.425425+0000 mgr.a (mgr.14373) 18770 : cluster [DBG] pgmap v13019: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:51:16.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:51:16 smithi086 bash[24289]: audit 2024-09-16T12:51:16.352543+0000 mgr.a (mgr.14373) 18769 : audit [DBG] from='client.402339 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:51:16.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:51:16 smithi086 bash[24289]: cluster 2024-09-16T12:51:16.425425+0000 mgr.a (mgr.14373) 18770 : cluster [DBG] pgmap v13019: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:51:16.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:51:16 smithi047 bash[22744]: audit 2024-09-16T12:51:16.352543+0000 mgr.a (mgr.14373) 18769 : audit [DBG] from='client.402339 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:51:16.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:51:16 smithi047 bash[22744]: cluster 2024-09-16T12:51:16.425425+0000 mgr.a (mgr.14373) 18770 : cluster [DBG] pgmap v13019: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:51:18.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:51:18 smithi157 bash[24585]: cluster 2024-09-16T12:51:18.428114+0000 mgr.a (mgr.14373) 18771 : cluster [DBG] pgmap v13020: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-16T12:51:18.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:51:18 smithi086 bash[24289]: cluster 2024-09-16T12:51:18.428114+0000 mgr.a (mgr.14373) 18771 : cluster [DBG] pgmap v13020: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-16T12:51:18.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:51:18 smithi047 bash[22744]: cluster 2024-09-16T12:51:18.428114+0000 mgr.a (mgr.14373) 18771 : cluster [DBG] pgmap v13020: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-16T12:51:20.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:51:20 smithi157 bash[24585]: cluster 2024-09-16T12:51:20.428869+0000 mgr.a (mgr.14373) 18772 : cluster [DBG] pgmap v13021: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-16T12:51:20.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:51:20 smithi086 bash[24289]: cluster 2024-09-16T12:51:20.428869+0000 mgr.a (mgr.14373) 18772 : cluster [DBG] pgmap v13021: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-16T12:51:20.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:51:20 smithi047 bash[22744]: cluster 2024-09-16T12:51:20.428869+0000 mgr.a (mgr.14373) 18772 : cluster [DBG] pgmap v13021: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-16T12:51:21.797 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:51:21.798 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:51:21.798 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:51:22.562 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:51:22.562 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:51:22.562 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:51:22.562 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:51:22.562 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:51:22.808 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:51:22 smithi157 bash[24585]: audit 2024-09-16T12:51:22.131243+0000 mgr.a (mgr.14373) 18773 : audit [DBG] from='client.402414 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:51:22.808 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:51:22 smithi157 bash[24585]: cluster 2024-09-16T12:51:22.430385+0000 mgr.a (mgr.14373) 18774 : cluster [DBG] pgmap v13022: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:51:22.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:51:22 smithi086 bash[24289]: audit 2024-09-16T12:51:22.131243+0000 mgr.a (mgr.14373) 18773 : audit [DBG] from='client.402414 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:51:22.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:51:22 smithi086 bash[24289]: cluster 2024-09-16T12:51:22.430385+0000 mgr.a (mgr.14373) 18774 : cluster [DBG] pgmap v13022: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:51:22.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:51:22 smithi047 bash[22744]: audit 2024-09-16T12:51:22.131243+0000 mgr.a (mgr.14373) 18773 : audit [DBG] from='client.402414 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:51:22.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:51:22 smithi047 bash[22744]: cluster 2024-09-16T12:51:22.430385+0000 mgr.a (mgr.14373) 18774 : cluster [DBG] pgmap v13022: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:51:24.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:51:24 smithi157 bash[24585]: cluster 2024-09-16T12:51:24.431189+0000 mgr.a (mgr.14373) 18775 : cluster [DBG] pgmap v13023: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T12:51:24.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:51:24 smithi086 bash[24289]: cluster 2024-09-16T12:51:24.431189+0000 mgr.a (mgr.14373) 18775 : cluster [DBG] pgmap v13023: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T12:51:24.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:51:24 smithi047 bash[22744]: cluster 2024-09-16T12:51:24.431189+0000 mgr.a (mgr.14373) 18775 : cluster [DBG] pgmap v13023: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T12:51:26.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:51:26 smithi157 bash[24585]: cluster 2024-09-16T12:51:26.431923+0000 mgr.a (mgr.14373) 18776 : cluster [DBG] pgmap v13024: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T12:51:26.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:51:26 smithi086 bash[24289]: cluster 2024-09-16T12:51:26.431923+0000 mgr.a (mgr.14373) 18776 : cluster [DBG] pgmap v13024: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T12:51:26.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:51:26 smithi047 bash[22744]: cluster 2024-09-16T12:51:26.431923+0000 mgr.a (mgr.14373) 18776 : cluster [DBG] pgmap v13024: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T12:51:27.563 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:51:27.564 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:51:27.564 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:51:28.352 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:51:28.352 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:51:28.352 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:51:28.352 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:51:28.352 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:51:28.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:51:28 smithi157 bash[24585]: audit 2024-09-16T12:51:27.900043+0000 mgr.a (mgr.14373) 18777 : audit [DBG] from='client.402492 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:51:28.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:51:28 smithi157 bash[24585]: cluster 2024-09-16T12:51:28.433368+0000 mgr.a (mgr.14373) 18778 : cluster [DBG] pgmap v13025: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:51:28.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:51:28 smithi086 bash[24289]: audit 2024-09-16T12:51:27.900043+0000 mgr.a (mgr.14373) 18777 : audit [DBG] from='client.402492 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:51:28.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:51:28 smithi086 bash[24289]: cluster 2024-09-16T12:51:28.433368+0000 mgr.a (mgr.14373) 18778 : cluster [DBG] pgmap v13025: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:51:28.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:51:28 smithi047 bash[22744]: audit 2024-09-16T12:51:27.900043+0000 mgr.a (mgr.14373) 18777 : audit [DBG] from='client.402492 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:51:28.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:51:28 smithi047 bash[22744]: cluster 2024-09-16T12:51:28.433368+0000 mgr.a (mgr.14373) 18778 : cluster [DBG] pgmap v13025: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:51:30.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:51:30 smithi157 bash[24585]: cluster 2024-09-16T12:51:30.434073+0000 mgr.a (mgr.14373) 18779 : cluster [DBG] pgmap v13026: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-16T12:51:30.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:51:30 smithi086 bash[24289]: cluster 2024-09-16T12:51:30.434073+0000 mgr.a (mgr.14373) 18779 : cluster [DBG] pgmap v13026: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-16T12:51:30.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:51:30 smithi047 bash[22744]: cluster 2024-09-16T12:51:30.434073+0000 mgr.a (mgr.14373) 18779 : cluster [DBG] pgmap v13026: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-16T12:51:32.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:51:32 smithi157 bash[24585]: cluster 2024-09-16T12:51:32.436045+0000 mgr.a (mgr.14373) 18780 : cluster [DBG] pgmap v13027: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-09-16T12:51:32.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:51:32 smithi086 bash[24289]: cluster 2024-09-16T12:51:32.436045+0000 mgr.a (mgr.14373) 18780 : cluster [DBG] pgmap v13027: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-09-16T12:51:32.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:51:32 smithi047 bash[22744]: cluster 2024-09-16T12:51:32.436045+0000 mgr.a (mgr.14373) 18780 : cluster [DBG] pgmap v13027: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-09-16T12:51:33.353 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:51:33.354 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:51:33.354 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:51:34.139 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:51:34.140 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:51:34.140 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:51:34.140 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:51:34.140 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:51:34.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:51:34 smithi157 bash[24585]: audit 2024-09-16T12:51:33.689727+0000 mgr.a (mgr.14373) 18781 : audit [DBG] from='client.402561 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:51:34.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:51:34 smithi157 bash[24585]: cluster 2024-09-16T12:51:34.437016+0000 mgr.a (mgr.14373) 18782 : cluster [DBG] pgmap v13028: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:51:34.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:51:34 smithi086 bash[24289]: audit 2024-09-16T12:51:33.689727+0000 mgr.a (mgr.14373) 18781 : audit [DBG] from='client.402561 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:51:34.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:51:34 smithi086 bash[24289]: cluster 2024-09-16T12:51:34.437016+0000 mgr.a (mgr.14373) 18782 : cluster [DBG] pgmap v13028: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:51:34.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:51:34 smithi047 bash[22744]: audit 2024-09-16T12:51:33.689727+0000 mgr.a (mgr.14373) 18781 : audit [DBG] from='client.402561 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:51:34.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:51:34 smithi047 bash[22744]: cluster 2024-09-16T12:51:34.437016+0000 mgr.a (mgr.14373) 18782 : cluster [DBG] pgmap v13028: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:51:36.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:51:36 smithi157 bash[24585]: cluster 2024-09-16T12:51:36.437825+0000 mgr.a (mgr.14373) 18783 : cluster [DBG] pgmap v13029: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:51:36.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:51:36 smithi086 bash[24289]: cluster 2024-09-16T12:51:36.437825+0000 mgr.a (mgr.14373) 18783 : cluster [DBG] pgmap v13029: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:51:36.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:51:36 smithi047 bash[22744]: cluster 2024-09-16T12:51:36.437825+0000 mgr.a (mgr.14373) 18783 : cluster [DBG] pgmap v13029: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:51:38.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:51:38 smithi157 bash[24585]: cluster 2024-09-16T12:51:38.440033+0000 mgr.a (mgr.14373) 18784 : cluster [DBG] pgmap v13030: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:51:38.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:51:38 smithi086 bash[24289]: cluster 2024-09-16T12:51:38.440033+0000 mgr.a (mgr.14373) 18784 : cluster [DBG] pgmap v13030: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:51:38.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:51:38 smithi047 bash[22744]: cluster 2024-09-16T12:51:38.440033+0000 mgr.a (mgr.14373) 18784 : cluster [DBG] pgmap v13030: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:51:39.141 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:51:39.142 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:51:39.142 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:51:39.886 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:51:39.886 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:51:39.886 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:51:39.886 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:51:39.886 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:51:40.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:51:40 smithi157 bash[24585]: audit 2024-09-16T12:51:39.473816+0000 mgr.a (mgr.14373) 18785 : audit [DBG] from='client.402636 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:51:40.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:51:40 smithi157 bash[24585]: cluster 2024-09-16T12:51:40.441027+0000 mgr.a (mgr.14373) 18786 : cluster [DBG] pgmap v13031: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:51:40.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:51:40 smithi086 bash[24289]: audit 2024-09-16T12:51:39.473816+0000 mgr.a (mgr.14373) 18785 : audit [DBG] from='client.402636 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:51:40.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:51:40 smithi086 bash[24289]: cluster 2024-09-16T12:51:40.441027+0000 mgr.a (mgr.14373) 18786 : cluster [DBG] pgmap v13031: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:51:40.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:51:40 smithi047 bash[22744]: audit 2024-09-16T12:51:39.473816+0000 mgr.a (mgr.14373) 18785 : audit [DBG] from='client.402636 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:51:40.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:51:40 smithi047 bash[22744]: cluster 2024-09-16T12:51:40.441027+0000 mgr.a (mgr.14373) 18786 : cluster [DBG] pgmap v13031: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:51:42.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:51:42 smithi157 bash[24585]: cluster 2024-09-16T12:51:42.443242+0000 mgr.a (mgr.14373) 18787 : cluster [DBG] pgmap v13032: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:51:42.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:51:42 smithi086 bash[24289]: cluster 2024-09-16T12:51:42.443242+0000 mgr.a (mgr.14373) 18787 : cluster [DBG] pgmap v13032: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:51:42.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:51:42 smithi047 bash[22744]: cluster 2024-09-16T12:51:42.443242+0000 mgr.a (mgr.14373) 18787 : cluster [DBG] pgmap v13032: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:51:43.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:51:43 smithi157 bash[24585]: audit 2024-09-16T12:51:42.861845+0000 mon.b (mon.2) 1698 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T12:51:43.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:51:43 smithi086 bash[24289]: audit 2024-09-16T12:51:42.861845+0000 mon.b (mon.2) 1698 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T12:51:43.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:51:43 smithi047 bash[22744]: audit 2024-09-16T12:51:42.861845+0000 mon.b (mon.2) 1698 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T12:51:44.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:51:44 smithi157 bash[24585]: audit 2024-09-16T12:51:43.691040+0000 mon.b (mon.2) 1699 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T12:51:44.808 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:51:44 smithi157 bash[24585]: audit 2024-09-16T12:51:43.693366+0000 mon.b (mon.2) 1700 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T12:51:44.808 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:51:44 smithi157 bash[24585]: audit 2024-09-16T12:51:43.705281+0000 mon.a (mon.0) 1694 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:51:44.808 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:51:44 smithi157 bash[24585]: audit 2024-09-16T12:51:43.710595+0000 mon.b (mon.2) 1701 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:51:44.808 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:51:44 smithi157 bash[24585]: audit 2024-09-16T12:51:43.713020+0000 mgr.a (mgr.14373) 18788 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:51:44.808 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:51:44 smithi157 bash[24585]: cluster 2024-09-16T12:51:44.444040+0000 mgr.a (mgr.14373) 18789 : cluster [DBG] pgmap v13033: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:51:44.808 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:51:44 smithi157 bash[24585]: audit 2024-09-16T12:51:44.465452+0000 mgr.a (mgr.14373) 18790 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T12:51:44.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:51:44 smithi086 bash[24289]: audit 2024-09-16T12:51:43.691040+0000 mon.b (mon.2) 1699 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T12:51:44.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:51:44 smithi086 bash[24289]: audit 2024-09-16T12:51:43.693366+0000 mon.b (mon.2) 1700 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T12:51:44.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:51:44 smithi086 bash[24289]: audit 2024-09-16T12:51:43.705281+0000 mon.a (mon.0) 1694 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:51:44.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:51:44 smithi086 bash[24289]: audit 2024-09-16T12:51:43.710595+0000 mon.b (mon.2) 1701 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:51:44.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:51:44 smithi086 bash[24289]: audit 2024-09-16T12:51:43.713020+0000 mgr.a (mgr.14373) 18788 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:51:44.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:51:44 smithi086 bash[24289]: cluster 2024-09-16T12:51:44.444040+0000 mgr.a (mgr.14373) 18789 : cluster [DBG] pgmap v13033: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:51:44.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:51:44 smithi086 bash[24289]: audit 2024-09-16T12:51:44.465452+0000 mgr.a (mgr.14373) 18790 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T12:51:44.843 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 12:51:44 smithi047 bash[22994]: debug 2024-09-16T12:51:44.462+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T12:51:44.843 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 12:51:44 smithi047 bash[22994]: debug 2024-09-16T12:51:44.466+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T12:51:44.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:51:44 smithi047 bash[22744]: audit 2024-09-16T12:51:43.691040+0000 mon.b (mon.2) 1699 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T12:51:44.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:51:44 smithi047 bash[22744]: audit 2024-09-16T12:51:43.693366+0000 mon.b (mon.2) 1700 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T12:51:44.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:51:44 smithi047 bash[22744]: audit 2024-09-16T12:51:43.705281+0000 mon.a (mon.0) 1694 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:51:44.844 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:51:44 smithi047 bash[22744]: audit 2024-09-16T12:51:43.710595+0000 mon.b (mon.2) 1701 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:51:44.844 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:51:44 smithi047 bash[22744]: audit 2024-09-16T12:51:43.713020+0000 mgr.a (mgr.14373) 18788 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:51:44.844 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:51:44 smithi047 bash[22744]: cluster 2024-09-16T12:51:44.444040+0000 mgr.a (mgr.14373) 18789 : cluster [DBG] pgmap v13033: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:51:44.844 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:51:44 smithi047 bash[22744]: audit 2024-09-16T12:51:44.465452+0000 mgr.a (mgr.14373) 18790 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T12:51:44.887 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:51:44.888 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:51:44.888 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:51:45.635 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:51:45.635 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:51:45.635 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:51:45.635 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:51:45.635 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:51:46.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:51:45 smithi157 bash[24585]: cephadm 2024-09-16T12:51:44.467796+0000 mgr.a (mgr.14373) 18791 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T12:51:46.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:51:45 smithi157 bash[24585]: audit 2024-09-16T12:51:45.219800+0000 mgr.a (mgr.14373) 18792 : audit [DBG] from='client.402822 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:51:46.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:51:45 smithi086 bash[24289]: cephadm 2024-09-16T12:51:44.467796+0000 mgr.a (mgr.14373) 18791 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T12:51:46.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:51:45 smithi086 bash[24289]: audit 2024-09-16T12:51:45.219800+0000 mgr.a (mgr.14373) 18792 : audit [DBG] from='client.402822 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:51:46.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:51:45 smithi047 bash[22744]: cephadm 2024-09-16T12:51:44.467796+0000 mgr.a (mgr.14373) 18791 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T12:51:46.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:51:45 smithi047 bash[22744]: audit 2024-09-16T12:51:45.219800+0000 mgr.a (mgr.14373) 18792 : audit [DBG] from='client.402822 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:51:47.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:51:46 smithi157 bash[24585]: cluster 2024-09-16T12:51:46.444985+0000 mgr.a (mgr.14373) 18793 : cluster [DBG] pgmap v13034: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:51:47.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:51:46 smithi086 bash[24289]: cluster 2024-09-16T12:51:46.444985+0000 mgr.a (mgr.14373) 18793 : cluster [DBG] pgmap v13034: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:51:47.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:51:46 smithi047 bash[22744]: cluster 2024-09-16T12:51:46.444985+0000 mgr.a (mgr.14373) 18793 : cluster [DBG] pgmap v13034: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:51:48.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:51:48 smithi157 bash[24585]: cluster 2024-09-16T12:51:48.447423+0000 mgr.a (mgr.14373) 18794 : cluster [DBG] pgmap v13035: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:51:48.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:51:48 smithi086 bash[24289]: cluster 2024-09-16T12:51:48.447423+0000 mgr.a (mgr.14373) 18794 : cluster [DBG] pgmap v13035: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:51:48.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:51:48 smithi047 bash[22744]: cluster 2024-09-16T12:51:48.447423+0000 mgr.a (mgr.14373) 18794 : cluster [DBG] pgmap v13035: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:51:50.637 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:51:50.637 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:51:50.638 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:51:50.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:51:50 smithi157 bash[24585]: cluster 2024-09-16T12:51:50.448374+0000 mgr.a (mgr.14373) 18795 : cluster [DBG] pgmap v13036: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:51:50.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:51:50 smithi086 bash[24289]: cluster 2024-09-16T12:51:50.448374+0000 mgr.a (mgr.14373) 18795 : cluster [DBG] pgmap v13036: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:51:50.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:51:50 smithi047 bash[22744]: cluster 2024-09-16T12:51:50.448374+0000 mgr.a (mgr.14373) 18795 : cluster [DBG] pgmap v13036: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:51:51.387 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:51:51.387 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:51:51.387 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:51:51.388 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:51:51.388 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:51:51.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:51:51 smithi157 bash[24585]: audit 2024-09-16T12:51:50.963347+0000 mgr.a (mgr.14373) 18796 : audit [DBG] from='client.402897 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:51:51.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:51:51 smithi086 bash[24289]: audit 2024-09-16T12:51:50.963347+0000 mgr.a (mgr.14373) 18796 : audit [DBG] from='client.402897 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:51:51.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:51:51 smithi047 bash[22744]: audit 2024-09-16T12:51:50.963347+0000 mgr.a (mgr.14373) 18796 : audit [DBG] from='client.402897 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:51:52.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:51:52 smithi157 bash[24585]: cluster 2024-09-16T12:51:52.450908+0000 mgr.a (mgr.14373) 18797 : cluster [DBG] pgmap v13037: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:51:52.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:51:52 smithi086 bash[24289]: cluster 2024-09-16T12:51:52.450908+0000 mgr.a (mgr.14373) 18797 : cluster [DBG] pgmap v13037: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:51:52.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:51:52 smithi047 bash[22744]: cluster 2024-09-16T12:51:52.450908+0000 mgr.a (mgr.14373) 18797 : cluster [DBG] pgmap v13037: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:51:54.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:51:54 smithi157 bash[24585]: cluster 2024-09-16T12:51:54.451901+0000 mgr.a (mgr.14373) 18798 : cluster [DBG] pgmap v13038: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:51:54.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:51:54 smithi086 bash[24289]: cluster 2024-09-16T12:51:54.451901+0000 mgr.a (mgr.14373) 18798 : cluster [DBG] pgmap v13038: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:51:54.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:51:54 smithi047 bash[22744]: cluster 2024-09-16T12:51:54.451901+0000 mgr.a (mgr.14373) 18798 : cluster [DBG] pgmap v13038: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:51:56.389 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:51:56.390 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:51:56.390 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:51:56.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:51:56 smithi157 bash[24585]: cluster 2024-09-16T12:51:56.452737+0000 mgr.a (mgr.14373) 18799 : cluster [DBG] pgmap v13039: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:51:56.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:51:56 smithi086 bash[24289]: cluster 2024-09-16T12:51:56.452737+0000 mgr.a (mgr.14373) 18799 : cluster [DBG] pgmap v13039: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:51:56.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:51:56 smithi047 bash[22744]: cluster 2024-09-16T12:51:56.452737+0000 mgr.a (mgr.14373) 18799 : cluster [DBG] pgmap v13039: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:51:57.174 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:51:57.174 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:51:57.174 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:51:57.175 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:51:57.175 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:51:57.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:51:57 smithi157 bash[24585]: audit 2024-09-16T12:51:56.724442+0000 mgr.a (mgr.14373) 18800 : audit [DBG] from='client.402975 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:51:57.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:51:57 smithi086 bash[24289]: audit 2024-09-16T12:51:56.724442+0000 mgr.a (mgr.14373) 18800 : audit [DBG] from='client.402975 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:51:57.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:51:57 smithi047 bash[22744]: audit 2024-09-16T12:51:56.724442+0000 mgr.a (mgr.14373) 18800 : audit [DBG] from='client.402975 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:51:58.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:51:58 smithi157 bash[24585]: cluster 2024-09-16T12:51:58.455578+0000 mgr.a (mgr.14373) 18801 : cluster [DBG] pgmap v13040: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:51:58.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:51:58 smithi086 bash[24289]: cluster 2024-09-16T12:51:58.455578+0000 mgr.a (mgr.14373) 18801 : cluster [DBG] pgmap v13040: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:51:58.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:51:58 smithi047 bash[22744]: cluster 2024-09-16T12:51:58.455578+0000 mgr.a (mgr.14373) 18801 : cluster [DBG] pgmap v13040: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:52:00.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:52:00 smithi157 bash[24585]: cluster 2024-09-16T12:52:00.456366+0000 mgr.a (mgr.14373) 18802 : cluster [DBG] pgmap v13041: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:52:00.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:52:00 smithi086 bash[24289]: cluster 2024-09-16T12:52:00.456366+0000 mgr.a (mgr.14373) 18802 : cluster [DBG] pgmap v13041: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:52:00.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:52:00 smithi047 bash[22744]: cluster 2024-09-16T12:52:00.456366+0000 mgr.a (mgr.14373) 18802 : cluster [DBG] pgmap v13041: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:52:02.175 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:52:02.176 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:52:02.176 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:52:02.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:52:02 smithi157 bash[24585]: cluster 2024-09-16T12:52:02.458304+0000 mgr.a (mgr.14373) 18803 : cluster [DBG] pgmap v13042: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:52:02.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:52:02 smithi086 bash[24289]: cluster 2024-09-16T12:52:02.458304+0000 mgr.a (mgr.14373) 18803 : cluster [DBG] pgmap v13042: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:52:02.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:52:02 smithi047 bash[22744]: cluster 2024-09-16T12:52:02.458304+0000 mgr.a (mgr.14373) 18803 : cluster [DBG] pgmap v13042: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:52:02.939 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:52:02.939 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:52:02.939 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:52:02.939 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:52:02.940 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:52:03.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:52:03 smithi157 bash[24585]: audit 2024-09-16T12:52:02.502509+0000 mgr.a (mgr.14373) 18804 : audit [DBG] from='client.403053 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:52:03.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:52:03 smithi086 bash[24289]: audit 2024-09-16T12:52:02.502509+0000 mgr.a (mgr.14373) 18804 : audit [DBG] from='client.403053 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:52:03.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:52:03 smithi047 bash[22744]: audit 2024-09-16T12:52:02.502509+0000 mgr.a (mgr.14373) 18804 : audit [DBG] from='client.403053 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:52:04.809 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:52:04 smithi157 bash[24585]: cluster 2024-09-16T12:52:04.459254+0000 mgr.a (mgr.14373) 18805 : cluster [DBG] pgmap v13043: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:52:04.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:52:04 smithi086 bash[24289]: cluster 2024-09-16T12:52:04.459254+0000 mgr.a (mgr.14373) 18805 : cluster [DBG] pgmap v13043: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:52:04.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:52:04 smithi047 bash[22744]: cluster 2024-09-16T12:52:04.459254+0000 mgr.a (mgr.14373) 18805 : cluster [DBG] pgmap v13043: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:52:06.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:52:06 smithi157 bash[24585]: cluster 2024-09-16T12:52:06.460024+0000 mgr.a (mgr.14373) 18806 : cluster [DBG] pgmap v13044: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T12:52:06.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:52:06 smithi086 bash[24289]: cluster 2024-09-16T12:52:06.460024+0000 mgr.a (mgr.14373) 18806 : cluster [DBG] pgmap v13044: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T12:52:06.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:52:06 smithi047 bash[22744]: cluster 2024-09-16T12:52:06.460024+0000 mgr.a (mgr.14373) 18806 : cluster [DBG] pgmap v13044: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T12:52:07.940 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:52:07.941 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:52:07.941 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:52:08.682 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:52:08.683 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:52:08.683 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:52:08.683 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:52:08.683 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:52:08.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:52:08 smithi157 bash[24585]: audit 2024-09-16T12:52:08.268589+0000 mgr.a (mgr.14373) 18807 : audit [DBG] from='client.403128 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:52:08.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:52:08 smithi157 bash[24585]: cluster 2024-09-16T12:52:08.461347+0000 mgr.a (mgr.14373) 18808 : cluster [DBG] pgmap v13045: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:52:08.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:52:08 smithi086 bash[24289]: audit 2024-09-16T12:52:08.268589+0000 mgr.a (mgr.14373) 18807 : audit [DBG] from='client.403128 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:52:08.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:52:08 smithi086 bash[24289]: cluster 2024-09-16T12:52:08.461347+0000 mgr.a (mgr.14373) 18808 : cluster [DBG] pgmap v13045: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:52:08.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:52:08 smithi047 bash[22744]: audit 2024-09-16T12:52:08.268589+0000 mgr.a (mgr.14373) 18807 : audit [DBG] from='client.403128 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:52:08.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:52:08 smithi047 bash[22744]: cluster 2024-09-16T12:52:08.461347+0000 mgr.a (mgr.14373) 18808 : cluster [DBG] pgmap v13045: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:52:10.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:52:10 smithi157 bash[24585]: cluster 2024-09-16T12:52:10.462228+0000 mgr.a (mgr.14373) 18809 : cluster [DBG] pgmap v13046: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:52:10.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:52:10 smithi086 bash[24289]: cluster 2024-09-16T12:52:10.462228+0000 mgr.a (mgr.14373) 18809 : cluster [DBG] pgmap v13046: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:52:10.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:52:10 smithi047 bash[22744]: cluster 2024-09-16T12:52:10.462228+0000 mgr.a (mgr.14373) 18809 : cluster [DBG] pgmap v13046: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:52:12.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:52:12 smithi157 bash[24585]: cluster 2024-09-16T12:52:12.464382+0000 mgr.a (mgr.14373) 18810 : cluster [DBG] pgmap v13047: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:52:12.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:52:12 smithi086 bash[24289]: cluster 2024-09-16T12:52:12.464382+0000 mgr.a (mgr.14373) 18810 : cluster [DBG] pgmap v13047: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:52:12.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:52:12 smithi047 bash[22744]: cluster 2024-09-16T12:52:12.464382+0000 mgr.a (mgr.14373) 18810 : cluster [DBG] pgmap v13047: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:52:13.684 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:52:13.685 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:52:13.685 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:52:14.462 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:52:14.462 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:52:14.463 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:52:14.463 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:52:14.463 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:52:14.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:52:14 smithi157 bash[24585]: audit 2024-09-16T12:52:14.019936+0000 mgr.a (mgr.14373) 18811 : audit [DBG] from='client.403206 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:52:14.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:52:14 smithi157 bash[24585]: cluster 2024-09-16T12:52:14.464894+0000 mgr.a (mgr.14373) 18812 : cluster [DBG] pgmap v13048: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:52:14.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:52:14 smithi086 bash[24289]: audit 2024-09-16T12:52:14.019936+0000 mgr.a (mgr.14373) 18811 : audit [DBG] from='client.403206 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:52:14.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:52:14 smithi086 bash[24289]: cluster 2024-09-16T12:52:14.464894+0000 mgr.a (mgr.14373) 18812 : cluster [DBG] pgmap v13048: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:52:14.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:52:14 smithi047 bash[22744]: audit 2024-09-16T12:52:14.019936+0000 mgr.a (mgr.14373) 18811 : audit [DBG] from='client.403206 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:52:14.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:52:14 smithi047 bash[22744]: cluster 2024-09-16T12:52:14.464894+0000 mgr.a (mgr.14373) 18812 : cluster [DBG] pgmap v13048: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:52:16.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:52:16 smithi157 bash[24585]: cluster 2024-09-16T12:52:16.465638+0000 mgr.a (mgr.14373) 18813 : cluster [DBG] pgmap v13049: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:52:16.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:52:16 smithi086 bash[24289]: cluster 2024-09-16T12:52:16.465638+0000 mgr.a (mgr.14373) 18813 : cluster [DBG] pgmap v13049: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:52:16.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:52:16 smithi047 bash[22744]: cluster 2024-09-16T12:52:16.465638+0000 mgr.a (mgr.14373) 18813 : cluster [DBG] pgmap v13049: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:52:18.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:52:18 smithi157 bash[24585]: cluster 2024-09-16T12:52:18.467923+0000 mgr.a (mgr.14373) 18814 : cluster [DBG] pgmap v13050: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:52:18.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:52:18 smithi086 bash[24289]: cluster 2024-09-16T12:52:18.467923+0000 mgr.a (mgr.14373) 18814 : cluster [DBG] pgmap v13050: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:52:18.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:52:18 smithi047 bash[22744]: cluster 2024-09-16T12:52:18.467923+0000 mgr.a (mgr.14373) 18814 : cluster [DBG] pgmap v13050: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:52:19.463 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:52:19.464 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:52:19.464 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:52:20.218 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:52:20.218 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:52:20.218 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:52:20.218 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:52:20.218 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:52:20.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:52:20 smithi157 bash[24585]: audit 2024-09-16T12:52:19.796125+0000 mgr.a (mgr.14373) 18815 : audit [DBG] from='client.403281 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:52:20.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:52:20 smithi157 bash[24585]: cluster 2024-09-16T12:52:20.468500+0000 mgr.a (mgr.14373) 18816 : cluster [DBG] pgmap v13051: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:52:20.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:52:20 smithi086 bash[24289]: audit 2024-09-16T12:52:19.796125+0000 mgr.a (mgr.14373) 18815 : audit [DBG] from='client.403281 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:52:20.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:52:20 smithi086 bash[24289]: cluster 2024-09-16T12:52:20.468500+0000 mgr.a (mgr.14373) 18816 : cluster [DBG] pgmap v13051: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:52:20.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:52:20 smithi047 bash[22744]: audit 2024-09-16T12:52:19.796125+0000 mgr.a (mgr.14373) 18815 : audit [DBG] from='client.403281 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:52:20.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:52:20 smithi047 bash[22744]: cluster 2024-09-16T12:52:20.468500+0000 mgr.a (mgr.14373) 18816 : cluster [DBG] pgmap v13051: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:52:22.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:52:22 smithi157 bash[24585]: cluster 2024-09-16T12:52:22.470834+0000 mgr.a (mgr.14373) 18817 : cluster [DBG] pgmap v13052: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:52:22.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:52:22 smithi086 bash[24289]: cluster 2024-09-16T12:52:22.470834+0000 mgr.a (mgr.14373) 18817 : cluster [DBG] pgmap v13052: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:52:22.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:52:22 smithi047 bash[22744]: cluster 2024-09-16T12:52:22.470834+0000 mgr.a (mgr.14373) 18817 : cluster [DBG] pgmap v13052: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:52:24.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:52:24 smithi157 bash[24585]: cluster 2024-09-16T12:52:24.471752+0000 mgr.a (mgr.14373) 18818 : cluster [DBG] pgmap v13053: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:52:24.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:52:24 smithi086 bash[24289]: cluster 2024-09-16T12:52:24.471752+0000 mgr.a (mgr.14373) 18818 : cluster [DBG] pgmap v13053: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:52:24.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:52:24 smithi047 bash[22744]: cluster 2024-09-16T12:52:24.471752+0000 mgr.a (mgr.14373) 18818 : cluster [DBG] pgmap v13053: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:52:25.219 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:52:25.219 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:52:25.220 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:52:25.999 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:52:25.999 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:52:26.000 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:52:26.000 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:52:26.000 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:52:26.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:52:26 smithi157 bash[24585]: audit 2024-09-16T12:52:25.550234+0000 mgr.a (mgr.14373) 18819 : audit [DBG] from='client.403359 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:52:26.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:52:26 smithi157 bash[24585]: cluster 2024-09-16T12:52:26.472740+0000 mgr.a (mgr.14373) 18820 : cluster [DBG] pgmap v13054: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:52:26.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:52:26 smithi086 bash[24289]: audit 2024-09-16T12:52:25.550234+0000 mgr.a (mgr.14373) 18819 : audit [DBG] from='client.403359 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:52:26.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:52:26 smithi086 bash[24289]: cluster 2024-09-16T12:52:26.472740+0000 mgr.a (mgr.14373) 18820 : cluster [DBG] pgmap v13054: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:52:26.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:52:26 smithi047 bash[22744]: audit 2024-09-16T12:52:25.550234+0000 mgr.a (mgr.14373) 18819 : audit [DBG] from='client.403359 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:52:26.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:52:26 smithi047 bash[22744]: cluster 2024-09-16T12:52:26.472740+0000 mgr.a (mgr.14373) 18820 : cluster [DBG] pgmap v13054: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:52:28.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:52:28 smithi157 bash[24585]: cluster 2024-09-16T12:52:28.475003+0000 mgr.a (mgr.14373) 18821 : cluster [DBG] pgmap v13055: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:52:28.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:52:28 smithi086 bash[24289]: cluster 2024-09-16T12:52:28.475003+0000 mgr.a (mgr.14373) 18821 : cluster [DBG] pgmap v13055: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:52:28.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:52:28 smithi047 bash[22744]: cluster 2024-09-16T12:52:28.475003+0000 mgr.a (mgr.14373) 18821 : cluster [DBG] pgmap v13055: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:52:30.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:52:30 smithi157 bash[24585]: cluster 2024-09-16T12:52:30.475752+0000 mgr.a (mgr.14373) 18822 : cluster [DBG] pgmap v13056: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:52:30.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:52:30 smithi086 bash[24289]: cluster 2024-09-16T12:52:30.475752+0000 mgr.a (mgr.14373) 18822 : cluster [DBG] pgmap v13056: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:52:30.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:52:30 smithi047 bash[22744]: cluster 2024-09-16T12:52:30.475752+0000 mgr.a (mgr.14373) 18822 : cluster [DBG] pgmap v13056: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:52:31.001 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:52:31.002 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:52:31.002 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:52:31.781 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:52:31.781 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:52:31.781 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:52:31.781 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:52:31.781 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:52:31.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:52:31 smithi157 bash[24585]: audit 2024-09-16T12:52:31.337684+0000 mgr.a (mgr.14373) 18823 : audit [DBG] from='client.403434 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:52:31.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:52:31 smithi086 bash[24289]: audit 2024-09-16T12:52:31.337684+0000 mgr.a (mgr.14373) 18823 : audit [DBG] from='client.403434 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:52:31.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:52:31 smithi047 bash[22744]: audit 2024-09-16T12:52:31.337684+0000 mgr.a (mgr.14373) 18823 : audit [DBG] from='client.403434 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:52:32.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:52:32 smithi157 bash[24585]: cluster 2024-09-16T12:52:32.478731+0000 mgr.a (mgr.14373) 18824 : cluster [DBG] pgmap v13057: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-16T12:52:32.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:52:32 smithi086 bash[24289]: cluster 2024-09-16T12:52:32.478731+0000 mgr.a (mgr.14373) 18824 : cluster [DBG] pgmap v13057: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-16T12:52:32.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:52:32 smithi047 bash[22744]: cluster 2024-09-16T12:52:32.478731+0000 mgr.a (mgr.14373) 18824 : cluster [DBG] pgmap v13057: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-16T12:52:34.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:52:34 smithi157 bash[24585]: cluster 2024-09-16T12:52:34.479727+0000 mgr.a (mgr.14373) 18825 : cluster [DBG] pgmap v13058: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T12:52:34.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:52:34 smithi086 bash[24289]: cluster 2024-09-16T12:52:34.479727+0000 mgr.a (mgr.14373) 18825 : cluster [DBG] pgmap v13058: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T12:52:34.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:52:34 smithi047 bash[22744]: cluster 2024-09-16T12:52:34.479727+0000 mgr.a (mgr.14373) 18825 : cluster [DBG] pgmap v13058: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T12:52:36.782 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:52:36.783 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:52:36.783 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:52:36.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:52:36 smithi157 bash[24585]: cluster 2024-09-16T12:52:36.480516+0000 mgr.a (mgr.14373) 18826 : cluster [DBG] pgmap v13059: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T12:52:36.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:52:36 smithi086 bash[24289]: cluster 2024-09-16T12:52:36.480516+0000 mgr.a (mgr.14373) 18826 : cluster [DBG] pgmap v13059: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T12:52:36.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:52:36 smithi047 bash[22744]: cluster 2024-09-16T12:52:36.480516+0000 mgr.a (mgr.14373) 18826 : cluster [DBG] pgmap v13059: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T12:52:37.554 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:52:37.554 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:52:37.555 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:52:37.555 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:52:37.555 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:52:37.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:52:37 smithi157 bash[24585]: audit 2024-09-16T12:52:37.118008+0000 mgr.a (mgr.14373) 18827 : audit [DBG] from='client.403512 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:52:37.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:52:37 smithi086 bash[24289]: audit 2024-09-16T12:52:37.118008+0000 mgr.a (mgr.14373) 18827 : audit [DBG] from='client.403512 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:52:37.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:52:37 smithi047 bash[22744]: audit 2024-09-16T12:52:37.118008+0000 mgr.a (mgr.14373) 18827 : audit [DBG] from='client.403512 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:52:39.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:52:39 smithi157 bash[24585]: cluster 2024-09-16T12:52:38.483375+0000 mgr.a (mgr.14373) 18828 : cluster [DBG] pgmap v13060: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:52:39.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:52:39 smithi086 bash[24289]: cluster 2024-09-16T12:52:38.483375+0000 mgr.a (mgr.14373) 18828 : cluster [DBG] pgmap v13060: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:52:39.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:52:39 smithi047 bash[22744]: cluster 2024-09-16T12:52:38.483375+0000 mgr.a (mgr.14373) 18828 : cluster [DBG] pgmap v13060: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:52:41.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:52:41 smithi157 bash[24585]: cluster 2024-09-16T12:52:40.484153+0000 mgr.a (mgr.14373) 18829 : cluster [DBG] pgmap v13061: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:52:41.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:52:41 smithi086 bash[24289]: cluster 2024-09-16T12:52:40.484153+0000 mgr.a (mgr.14373) 18829 : cluster [DBG] pgmap v13061: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:52:41.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:52:41 smithi047 bash[22744]: cluster 2024-09-16T12:52:40.484153+0000 mgr.a (mgr.14373) 18829 : cluster [DBG] pgmap v13061: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:52:42.556 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:52:42.557 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:52:42.557 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:52:43.332 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:52:43.332 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:52:43.332 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:52:43.332 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:52:43.332 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:52:43.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:52:43 smithi086 bash[24289]: cluster 2024-09-16T12:52:42.486174+0000 mgr.a (mgr.14373) 18830 : cluster [DBG] pgmap v13062: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:52:43.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:52:43 smithi086 bash[24289]: audit 2024-09-16T12:52:42.890688+0000 mgr.a (mgr.14373) 18831 : audit [DBG] from='client.403587 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:52:43.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:52:43 smithi047 bash[22744]: cluster 2024-09-16T12:52:42.486174+0000 mgr.a (mgr.14373) 18830 : cluster [DBG] pgmap v13062: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:52:43.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:52:43 smithi047 bash[22744]: audit 2024-09-16T12:52:42.890688+0000 mgr.a (mgr.14373) 18831 : audit [DBG] from='client.403587 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:52:44.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:52:43 smithi157 bash[24585]: cluster 2024-09-16T12:52:42.486174+0000 mgr.a (mgr.14373) 18830 : cluster [DBG] pgmap v13062: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:52:44.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:52:43 smithi157 bash[24585]: audit 2024-09-16T12:52:42.890688+0000 mgr.a (mgr.14373) 18831 : audit [DBG] from='client.403587 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:52:44.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:52:44 smithi086 bash[24289]: audit 2024-09-16T12:52:44.524992+0000 mon.b (mon.2) 1702 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T12:52:44.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:52:44 smithi047 bash[22744]: audit 2024-09-16T12:52:44.524992+0000 mon.b (mon.2) 1702 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T12:52:45.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:52:44 smithi157 bash[24585]: audit 2024-09-16T12:52:44.524992+0000 mon.b (mon.2) 1702 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T12:52:45.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:52:45 smithi086 bash[24289]: cluster 2024-09-16T12:52:44.487297+0000 mgr.a (mgr.14373) 18832 : cluster [DBG] pgmap v13063: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-16T12:52:45.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:52:45 smithi086 bash[24289]: audit 2024-09-16T12:52:45.368514+0000 mon.b (mon.2) 1703 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T12:52:45.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:52:45 smithi086 bash[24289]: audit 2024-09-16T12:52:45.370706+0000 mon.b (mon.2) 1704 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T12:52:45.822 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:52:45 smithi086 bash[24289]: audit 2024-09-16T12:52:45.382361+0000 mon.a (mon.0) 1695 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:52:45.822 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:52:45 smithi086 bash[24289]: audit 2024-09-16T12:52:45.388015+0000 mon.b (mon.2) 1705 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:52:45.822 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:52:45 smithi086 bash[24289]: audit 2024-09-16T12:52:45.390638+0000 mgr.a (mgr.14373) 18833 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:52:45.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:52:45 smithi047 bash[22744]: cluster 2024-09-16T12:52:44.487297+0000 mgr.a (mgr.14373) 18832 : cluster [DBG] pgmap v13063: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-16T12:52:45.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:52:45 smithi047 bash[22744]: audit 2024-09-16T12:52:45.368514+0000 mon.b (mon.2) 1703 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T12:52:45.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:52:45 smithi047 bash[22744]: audit 2024-09-16T12:52:45.370706+0000 mon.b (mon.2) 1704 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T12:52:45.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:52:45 smithi047 bash[22744]: audit 2024-09-16T12:52:45.382361+0000 mon.a (mon.0) 1695 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:52:45.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:52:45 smithi047 bash[22744]: audit 2024-09-16T12:52:45.388015+0000 mon.b (mon.2) 1705 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:52:45.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:52:45 smithi047 bash[22744]: audit 2024-09-16T12:52:45.390638+0000 mgr.a (mgr.14373) 18833 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:52:46.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:52:45 smithi157 bash[24585]: cluster 2024-09-16T12:52:44.487297+0000 mgr.a (mgr.14373) 18832 : cluster [DBG] pgmap v13063: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-16T12:52:46.058 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:52:45 smithi157 bash[24585]: audit 2024-09-16T12:52:45.368514+0000 mon.b (mon.2) 1703 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T12:52:46.058 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:52:45 smithi157 bash[24585]: audit 2024-09-16T12:52:45.370706+0000 mon.b (mon.2) 1704 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T12:52:46.058 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:52:45 smithi157 bash[24585]: audit 2024-09-16T12:52:45.382361+0000 mon.a (mon.0) 1695 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:52:46.058 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:52:45 smithi157 bash[24585]: audit 2024-09-16T12:52:45.388015+0000 mon.b (mon.2) 1705 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:52:46.058 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:52:45 smithi157 bash[24585]: audit 2024-09-16T12:52:45.390638+0000 mgr.a (mgr.14373) 18833 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:52:46.577 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 12:52:46 smithi047 bash[22994]: debug 2024-09-16T12:52:46.136+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T12:52:46.577 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 12:52:46 smithi047 bash[22994]: debug 2024-09-16T12:52:46.140+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T12:52:46.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:52:46 smithi047 bash[22744]: audit 2024-09-16T12:52:46.142218+0000 mgr.a (mgr.14373) 18834 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T12:52:46.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:52:46 smithi047 bash[22744]: cephadm 2024-09-16T12:52:46.144440+0000 mgr.a (mgr.14373) 18835 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T12:52:47.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:52:46 smithi157 bash[24585]: audit 2024-09-16T12:52:46.142218+0000 mgr.a (mgr.14373) 18834 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T12:52:47.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:52:46 smithi157 bash[24585]: cephadm 2024-09-16T12:52:46.144440+0000 mgr.a (mgr.14373) 18835 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T12:52:47.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:52:46 smithi086 bash[24289]: audit 2024-09-16T12:52:46.142218+0000 mgr.a (mgr.14373) 18834 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T12:52:47.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:52:46 smithi086 bash[24289]: cephadm 2024-09-16T12:52:46.144440+0000 mgr.a (mgr.14373) 18835 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T12:52:47.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:52:47 smithi047 bash[22744]: cluster 2024-09-16T12:52:46.489609+0000 mgr.a (mgr.14373) 18836 : cluster [DBG] pgmap v13064: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:52:48.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:52:47 smithi157 bash[24585]: cluster 2024-09-16T12:52:46.489609+0000 mgr.a (mgr.14373) 18836 : cluster [DBG] pgmap v13064: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:52:48.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:52:47 smithi086 bash[24289]: cluster 2024-09-16T12:52:46.489609+0000 mgr.a (mgr.14373) 18836 : cluster [DBG] pgmap v13064: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:52:48.333 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:52:48.334 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:52:48.334 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:52:49.113 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:52:49.113 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:52:49.113 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:52:49.113 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:52:49.114 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:52:49.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:52:49 smithi047 bash[22744]: cluster 2024-09-16T12:52:48.490286+0000 mgr.a (mgr.14373) 18837 : cluster [DBG] pgmap v13065: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:52:49.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:52:49 smithi047 bash[22744]: audit 2024-09-16T12:52:48.663388+0000 mgr.a (mgr.14373) 18838 : audit [DBG] from='client.403770 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:52:50.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:52:49 smithi157 bash[24585]: cluster 2024-09-16T12:52:48.490286+0000 mgr.a (mgr.14373) 18837 : cluster [DBG] pgmap v13065: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:52:50.058 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:52:49 smithi157 bash[24585]: audit 2024-09-16T12:52:48.663388+0000 mgr.a (mgr.14373) 18838 : audit [DBG] from='client.403770 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:52:50.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:52:49 smithi086 bash[24289]: cluster 2024-09-16T12:52:48.490286+0000 mgr.a (mgr.14373) 18837 : cluster [DBG] pgmap v13065: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:52:50.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:52:49 smithi086 bash[24289]: audit 2024-09-16T12:52:48.663388+0000 mgr.a (mgr.14373) 18838 : audit [DBG] from='client.403770 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:52:51.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:52:51 smithi047 bash[22744]: cluster 2024-09-16T12:52:50.491350+0000 mgr.a (mgr.14373) 18839 : cluster [DBG] pgmap v13066: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:52:52.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:52:51 smithi157 bash[24585]: cluster 2024-09-16T12:52:50.491350+0000 mgr.a (mgr.14373) 18839 : cluster [DBG] pgmap v13066: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:52:52.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:52:51 smithi086 bash[24289]: cluster 2024-09-16T12:52:50.491350+0000 mgr.a (mgr.14373) 18839 : cluster [DBG] pgmap v13066: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:52:53.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:52:53 smithi047 bash[22744]: cluster 2024-09-16T12:52:52.493765+0000 mgr.a (mgr.14373) 18840 : cluster [DBG] pgmap v13067: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:52:54.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:52:53 smithi157 bash[24585]: cluster 2024-09-16T12:52:52.493765+0000 mgr.a (mgr.14373) 18840 : cluster [DBG] pgmap v13067: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:52:54.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:52:53 smithi086 bash[24289]: cluster 2024-09-16T12:52:52.493765+0000 mgr.a (mgr.14373) 18840 : cluster [DBG] pgmap v13067: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:52:54.114 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:52:54.115 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:52:54.115 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:52:54.862 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:52:54.863 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:52:54.863 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:52:54.863 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:52:54.863 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:52:55.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:52:54 smithi157 bash[24585]: audit 2024-09-16T12:52:54.439827+0000 mgr.a (mgr.14373) 18841 : audit [DBG] from='client.403845 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:52:55.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:52:54 smithi086 bash[24289]: audit 2024-09-16T12:52:54.439827+0000 mgr.a (mgr.14373) 18841 : audit [DBG] from='client.403845 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:52:55.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:52:54 smithi047 bash[22744]: audit 2024-09-16T12:52:54.439827+0000 mgr.a (mgr.14373) 18841 : audit [DBG] from='client.403845 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:52:56.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:52:55 smithi157 bash[24585]: cluster 2024-09-16T12:52:54.495019+0000 mgr.a (mgr.14373) 18842 : cluster [DBG] pgmap v13068: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:52:56.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:52:55 smithi086 bash[24289]: cluster 2024-09-16T12:52:54.495019+0000 mgr.a (mgr.14373) 18842 : cluster [DBG] pgmap v13068: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:52:56.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:52:55 smithi047 bash[22744]: cluster 2024-09-16T12:52:54.495019+0000 mgr.a (mgr.14373) 18842 : cluster [DBG] pgmap v13068: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:52:58.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:52:57 smithi157 bash[24585]: cluster 2024-09-16T12:52:56.497295+0000 mgr.a (mgr.14373) 18843 : cluster [DBG] pgmap v13069: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:52:58.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:52:57 smithi086 bash[24289]: cluster 2024-09-16T12:52:56.497295+0000 mgr.a (mgr.14373) 18843 : cluster [DBG] pgmap v13069: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:52:58.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:52:57 smithi047 bash[22744]: cluster 2024-09-16T12:52:56.497295+0000 mgr.a (mgr.14373) 18843 : cluster [DBG] pgmap v13069: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:52:59.864 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:52:59.864 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:52:59.865 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:53:00.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:52:59 smithi157 bash[24585]: cluster 2024-09-16T12:52:58.498178+0000 mgr.a (mgr.14373) 18844 : cluster [DBG] pgmap v13070: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:53:00.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:52:59 smithi086 bash[24289]: cluster 2024-09-16T12:52:58.498178+0000 mgr.a (mgr.14373) 18844 : cluster [DBG] pgmap v13070: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:53:00.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:52:59 smithi047 bash[22744]: cluster 2024-09-16T12:52:58.498178+0000 mgr.a (mgr.14373) 18844 : cluster [DBG] pgmap v13070: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:53:00.624 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:53:00.624 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:53:00.624 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:53:00.625 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:53:00.625 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:53:01.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:53:00 smithi157 bash[24585]: audit 2024-09-16T12:53:00.197363+0000 mgr.a (mgr.14373) 18845 : audit [DBG] from='client.403920 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:53:01.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:53:00 smithi086 bash[24289]: audit 2024-09-16T12:53:00.197363+0000 mgr.a (mgr.14373) 18845 : audit [DBG] from='client.403920 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:53:01.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:53:00 smithi047 bash[22744]: audit 2024-09-16T12:53:00.197363+0000 mgr.a (mgr.14373) 18845 : audit [DBG] from='client.403920 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:53:02.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:53:01 smithi157 bash[24585]: cluster 2024-09-16T12:53:00.498678+0000 mgr.a (mgr.14373) 18846 : cluster [DBG] pgmap v13071: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:53:02.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:53:01 smithi086 bash[24289]: cluster 2024-09-16T12:53:00.498678+0000 mgr.a (mgr.14373) 18846 : cluster [DBG] pgmap v13071: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:53:02.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:53:01 smithi047 bash[22744]: cluster 2024-09-16T12:53:00.498678+0000 mgr.a (mgr.14373) 18846 : cluster [DBG] pgmap v13071: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:53:04.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:53:03 smithi157 bash[24585]: cluster 2024-09-16T12:53:02.500962+0000 mgr.a (mgr.14373) 18847 : cluster [DBG] pgmap v13072: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:53:04.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:53:03 smithi086 bash[24289]: cluster 2024-09-16T12:53:02.500962+0000 mgr.a (mgr.14373) 18847 : cluster [DBG] pgmap v13072: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:53:04.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:53:03 smithi047 bash[22744]: cluster 2024-09-16T12:53:02.500962+0000 mgr.a (mgr.14373) 18847 : cluster [DBG] pgmap v13072: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:53:05.626 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:53:05.626 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:53:05.627 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:53:06.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:53:05 smithi157 bash[24585]: cluster 2024-09-16T12:53:04.501750+0000 mgr.a (mgr.14373) 18848 : cluster [DBG] pgmap v13073: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:53:06.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:53:05 smithi086 bash[24289]: cluster 2024-09-16T12:53:04.501750+0000 mgr.a (mgr.14373) 18848 : cluster [DBG] pgmap v13073: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:53:06.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:53:05 smithi047 bash[22744]: cluster 2024-09-16T12:53:04.501750+0000 mgr.a (mgr.14373) 18848 : cluster [DBG] pgmap v13073: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:53:06.406 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:53:06.407 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:53:06.407 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:53:06.407 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:53:06.407 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:53:07.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:53:06 smithi157 bash[24585]: audit 2024-09-16T12:53:05.957160+0000 mgr.a (mgr.14373) 18849 : audit [DBG] from='client.403995 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:53:07.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:53:06 smithi086 bash[24289]: audit 2024-09-16T12:53:05.957160+0000 mgr.a (mgr.14373) 18849 : audit [DBG] from='client.403995 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:53:07.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:53:06 smithi047 bash[22744]: audit 2024-09-16T12:53:05.957160+0000 mgr.a (mgr.14373) 18849 : audit [DBG] from='client.403995 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:53:08.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:53:07 smithi157 bash[24585]: cluster 2024-09-16T12:53:06.504110+0000 mgr.a (mgr.14373) 18850 : cluster [DBG] pgmap v13074: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:53:08.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:53:07 smithi086 bash[24289]: cluster 2024-09-16T12:53:06.504110+0000 mgr.a (mgr.14373) 18850 : cluster [DBG] pgmap v13074: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:53:08.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:53:07 smithi047 bash[22744]: cluster 2024-09-16T12:53:06.504110+0000 mgr.a (mgr.14373) 18850 : cluster [DBG] pgmap v13074: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:53:10.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:53:09 smithi157 bash[24585]: cluster 2024-09-16T12:53:08.505040+0000 mgr.a (mgr.14373) 18851 : cluster [DBG] pgmap v13075: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:53:10.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:53:09 smithi086 bash[24289]: cluster 2024-09-16T12:53:08.505040+0000 mgr.a (mgr.14373) 18851 : cluster [DBG] pgmap v13075: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:53:10.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:53:09 smithi047 bash[22744]: cluster 2024-09-16T12:53:08.505040+0000 mgr.a (mgr.14373) 18851 : cluster [DBG] pgmap v13075: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:53:11.408 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:53:11.409 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:53:11.409 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:53:12.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:53:11 smithi157 bash[24585]: cluster 2024-09-16T12:53:10.505982+0000 mgr.a (mgr.14373) 18852 : cluster [DBG] pgmap v13076: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:53:12.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:53:11 smithi086 bash[24289]: cluster 2024-09-16T12:53:10.505982+0000 mgr.a (mgr.14373) 18852 : cluster [DBG] pgmap v13076: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:53:12.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:53:11 smithi047 bash[22744]: cluster 2024-09-16T12:53:10.505982+0000 mgr.a (mgr.14373) 18852 : cluster [DBG] pgmap v13076: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:53:12.162 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:53:12.163 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:53:12.163 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:53:12.163 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:53:12.163 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:53:13.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:53:12 smithi157 bash[24585]: audit 2024-09-16T12:53:11.732277+0000 mgr.a (mgr.14373) 18853 : audit [DBG] from='client.404070 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:53:13.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:53:12 smithi086 bash[24289]: audit 2024-09-16T12:53:11.732277+0000 mgr.a (mgr.14373) 18853 : audit [DBG] from='client.404070 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:53:13.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:53:12 smithi047 bash[22744]: audit 2024-09-16T12:53:11.732277+0000 mgr.a (mgr.14373) 18853 : audit [DBG] from='client.404070 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:53:14.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:53:13 smithi157 bash[24585]: cluster 2024-09-16T12:53:12.508795+0000 mgr.a (mgr.14373) 18854 : cluster [DBG] pgmap v13077: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:53:14.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:53:13 smithi086 bash[24289]: cluster 2024-09-16T12:53:12.508795+0000 mgr.a (mgr.14373) 18854 : cluster [DBG] pgmap v13077: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:53:14.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:53:13 smithi047 bash[22744]: cluster 2024-09-16T12:53:12.508795+0000 mgr.a (mgr.14373) 18854 : cluster [DBG] pgmap v13077: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:53:16.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:53:15 smithi157 bash[24585]: cluster 2024-09-16T12:53:14.509585+0000 mgr.a (mgr.14373) 18855 : cluster [DBG] pgmap v13078: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:53:16.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:53:15 smithi086 bash[24289]: cluster 2024-09-16T12:53:14.509585+0000 mgr.a (mgr.14373) 18855 : cluster [DBG] pgmap v13078: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:53:16.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:53:15 smithi047 bash[22744]: cluster 2024-09-16T12:53:14.509585+0000 mgr.a (mgr.14373) 18855 : cluster [DBG] pgmap v13078: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:53:17.164 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:53:17.165 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:53:17.165 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:53:17.925 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:53:17.926 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:53:17.926 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:53:17.926 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:53:17.926 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:53:18.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:53:17 smithi157 bash[24585]: cluster 2024-09-16T12:53:16.511599+0000 mgr.a (mgr.14373) 18856 : cluster [DBG] pgmap v13079: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:53:18.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:53:17 smithi086 bash[24289]: cluster 2024-09-16T12:53:16.511599+0000 mgr.a (mgr.14373) 18856 : cluster [DBG] pgmap v13079: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:53:18.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:53:17 smithi047 bash[22744]: cluster 2024-09-16T12:53:16.511599+0000 mgr.a (mgr.14373) 18856 : cluster [DBG] pgmap v13079: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:53:19.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:53:18 smithi157 bash[24585]: audit 2024-09-16T12:53:17.497773+0000 mgr.a (mgr.14373) 18857 : audit [DBG] from='client.404142 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:53:19.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:53:18 smithi086 bash[24289]: audit 2024-09-16T12:53:17.497773+0000 mgr.a (mgr.14373) 18857 : audit [DBG] from='client.404142 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:53:19.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:53:18 smithi047 bash[22744]: audit 2024-09-16T12:53:17.497773+0000 mgr.a (mgr.14373) 18857 : audit [DBG] from='client.404142 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:53:20.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:53:19 smithi157 bash[24585]: cluster 2024-09-16T12:53:18.512559+0000 mgr.a (mgr.14373) 18858 : cluster [DBG] pgmap v13080: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:53:20.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:53:19 smithi086 bash[24289]: cluster 2024-09-16T12:53:18.512559+0000 mgr.a (mgr.14373) 18858 : cluster [DBG] pgmap v13080: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:53:20.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:53:19 smithi047 bash[22744]: cluster 2024-09-16T12:53:18.512559+0000 mgr.a (mgr.14373) 18858 : cluster [DBG] pgmap v13080: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:53:22.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:53:21 smithi157 bash[24585]: cluster 2024-09-16T12:53:20.513342+0000 mgr.a (mgr.14373) 18859 : cluster [DBG] pgmap v13081: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T12:53:22.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:53:21 smithi086 bash[24289]: cluster 2024-09-16T12:53:20.513342+0000 mgr.a (mgr.14373) 18859 : cluster [DBG] pgmap v13081: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T12:53:22.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:53:21 smithi047 bash[22744]: cluster 2024-09-16T12:53:20.513342+0000 mgr.a (mgr.14373) 18859 : cluster [DBG] pgmap v13081: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T12:53:22.927 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:53:22.927 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:53:22.928 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:53:23.689 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:53:23.690 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:53:23.690 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:53:23.690 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:53:23.690 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:53:24.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:53:23 smithi157 bash[24585]: cluster 2024-09-16T12:53:22.515628+0000 mgr.a (mgr.14373) 18860 : cluster [DBG] pgmap v13082: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:53:24.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:53:23 smithi157 bash[24585]: audit 2024-09-16T12:53:23.259570+0000 mgr.a (mgr.14373) 18861 : audit [DBG] from='client.404217 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:53:24.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:53:23 smithi086 bash[24289]: cluster 2024-09-16T12:53:22.515628+0000 mgr.a (mgr.14373) 18860 : cluster [DBG] pgmap v13082: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:53:24.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:53:23 smithi086 bash[24289]: audit 2024-09-16T12:53:23.259570+0000 mgr.a (mgr.14373) 18861 : audit [DBG] from='client.404217 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:53:24.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:53:23 smithi047 bash[22744]: cluster 2024-09-16T12:53:22.515628+0000 mgr.a (mgr.14373) 18860 : cluster [DBG] pgmap v13082: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:53:24.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:53:23 smithi047 bash[22744]: audit 2024-09-16T12:53:23.259570+0000 mgr.a (mgr.14373) 18861 : audit [DBG] from='client.404217 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:53:26.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:53:25 smithi157 bash[24585]: cluster 2024-09-16T12:53:24.516542+0000 mgr.a (mgr.14373) 18862 : cluster [DBG] pgmap v13083: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:53:26.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:53:25 smithi086 bash[24289]: cluster 2024-09-16T12:53:24.516542+0000 mgr.a (mgr.14373) 18862 : cluster [DBG] pgmap v13083: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:53:26.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:53:25 smithi047 bash[22744]: cluster 2024-09-16T12:53:24.516542+0000 mgr.a (mgr.14373) 18862 : cluster [DBG] pgmap v13083: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:53:28.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:53:27 smithi157 bash[24585]: cluster 2024-09-16T12:53:26.518856+0000 mgr.a (mgr.14373) 18863 : cluster [DBG] pgmap v13084: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:53:28.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:53:27 smithi086 bash[24289]: cluster 2024-09-16T12:53:26.518856+0000 mgr.a (mgr.14373) 18863 : cluster [DBG] pgmap v13084: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:53:28.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:53:27 smithi047 bash[22744]: cluster 2024-09-16T12:53:26.518856+0000 mgr.a (mgr.14373) 18863 : cluster [DBG] pgmap v13084: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:53:28.691 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:53:28.692 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:53:28.692 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:53:29.476 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:53:29.476 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:53:29.477 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:53:29.477 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:53:29.477 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:53:30.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:53:29 smithi157 bash[24585]: cluster 2024-09-16T12:53:28.519660+0000 mgr.a (mgr.14373) 18864 : cluster [DBG] pgmap v13085: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:53:30.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:53:29 smithi157 bash[24585]: audit 2024-09-16T12:53:29.027151+0000 mgr.a (mgr.14373) 18865 : audit [DBG] from='client.404295 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:53:30.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:53:29 smithi086 bash[24289]: cluster 2024-09-16T12:53:28.519660+0000 mgr.a (mgr.14373) 18864 : cluster [DBG] pgmap v13085: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:53:30.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:53:29 smithi086 bash[24289]: audit 2024-09-16T12:53:29.027151+0000 mgr.a (mgr.14373) 18865 : audit [DBG] from='client.404295 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:53:30.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:53:29 smithi047 bash[22744]: cluster 2024-09-16T12:53:28.519660+0000 mgr.a (mgr.14373) 18864 : cluster [DBG] pgmap v13085: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:53:30.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:53:29 smithi047 bash[22744]: audit 2024-09-16T12:53:29.027151+0000 mgr.a (mgr.14373) 18865 : audit [DBG] from='client.404295 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:53:32.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:53:31 smithi157 bash[24585]: cluster 2024-09-16T12:53:30.520610+0000 mgr.a (mgr.14373) 18866 : cluster [DBG] pgmap v13086: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:53:32.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:53:31 smithi086 bash[24289]: cluster 2024-09-16T12:53:30.520610+0000 mgr.a (mgr.14373) 18866 : cluster [DBG] pgmap v13086: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:53:32.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:53:31 smithi047 bash[22744]: cluster 2024-09-16T12:53:30.520610+0000 mgr.a (mgr.14373) 18866 : cluster [DBG] pgmap v13086: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:53:34.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:53:33 smithi157 bash[24585]: cluster 2024-09-16T12:53:32.522902+0000 mgr.a (mgr.14373) 18867 : cluster [DBG] pgmap v13087: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:53:34.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:53:33 smithi086 bash[24289]: cluster 2024-09-16T12:53:32.522902+0000 mgr.a (mgr.14373) 18867 : cluster [DBG] pgmap v13087: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:53:34.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:53:33 smithi047 bash[22744]: cluster 2024-09-16T12:53:32.522902+0000 mgr.a (mgr.14373) 18867 : cluster [DBG] pgmap v13087: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:53:34.478 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:53:34.479 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:53:34.479 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:53:35.261 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:53:35.262 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:53:35.262 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:53:35.262 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:53:35.262 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:53:36.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:53:35 smithi157 bash[24585]: cluster 2024-09-16T12:53:34.523550+0000 mgr.a (mgr.14373) 18868 : cluster [DBG] pgmap v13088: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:53:36.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:53:35 smithi157 bash[24585]: audit 2024-09-16T12:53:34.815650+0000 mgr.a (mgr.14373) 18869 : audit [DBG] from='client.404367 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:53:36.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:53:35 smithi086 bash[24289]: cluster 2024-09-16T12:53:34.523550+0000 mgr.a (mgr.14373) 18868 : cluster [DBG] pgmap v13088: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:53:36.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:53:35 smithi086 bash[24289]: audit 2024-09-16T12:53:34.815650+0000 mgr.a (mgr.14373) 18869 : audit [DBG] from='client.404367 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:53:36.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:53:35 smithi047 bash[22744]: cluster 2024-09-16T12:53:34.523550+0000 mgr.a (mgr.14373) 18868 : cluster [DBG] pgmap v13088: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:53:36.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:53:35 smithi047 bash[22744]: audit 2024-09-16T12:53:34.815650+0000 mgr.a (mgr.14373) 18869 : audit [DBG] from='client.404367 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:53:38.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:53:37 smithi157 bash[24585]: cluster 2024-09-16T12:53:36.525777+0000 mgr.a (mgr.14373) 18870 : cluster [DBG] pgmap v13089: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:53:38.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:53:37 smithi086 bash[24289]: cluster 2024-09-16T12:53:36.525777+0000 mgr.a (mgr.14373) 18870 : cluster [DBG] pgmap v13089: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:53:38.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:53:37 smithi047 bash[22744]: cluster 2024-09-16T12:53:36.525777+0000 mgr.a (mgr.14373) 18870 : cluster [DBG] pgmap v13089: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:53:40.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:53:39 smithi157 bash[24585]: cluster 2024-09-16T12:53:38.526563+0000 mgr.a (mgr.14373) 18871 : cluster [DBG] pgmap v13090: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:53:40.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:53:39 smithi086 bash[24289]: cluster 2024-09-16T12:53:38.526563+0000 mgr.a (mgr.14373) 18871 : cluster [DBG] pgmap v13090: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:53:40.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:53:39 smithi047 bash[22744]: cluster 2024-09-16T12:53:38.526563+0000 mgr.a (mgr.14373) 18871 : cluster [DBG] pgmap v13090: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:53:40.263 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:53:40.264 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:53:40.264 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:53:41.015 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:53:41.015 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:53:41.015 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:53:41.015 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:53:41.015 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:53:42.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:53:41 smithi157 bash[24585]: cluster 2024-09-16T12:53:40.527298+0000 mgr.a (mgr.14373) 18872 : cluster [DBG] pgmap v13091: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:53:42.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:53:41 smithi157 bash[24585]: audit 2024-09-16T12:53:40.597044+0000 mgr.a (mgr.14373) 18873 : audit [DBG] from='client.404445 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:53:42.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:53:41 smithi086 bash[24289]: cluster 2024-09-16T12:53:40.527298+0000 mgr.a (mgr.14373) 18872 : cluster [DBG] pgmap v13091: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:53:42.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:53:41 smithi086 bash[24289]: audit 2024-09-16T12:53:40.597044+0000 mgr.a (mgr.14373) 18873 : audit [DBG] from='client.404445 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:53:42.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:53:41 smithi047 bash[22744]: cluster 2024-09-16T12:53:40.527298+0000 mgr.a (mgr.14373) 18872 : cluster [DBG] pgmap v13091: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:53:42.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:53:41 smithi047 bash[22744]: audit 2024-09-16T12:53:40.597044+0000 mgr.a (mgr.14373) 18873 : audit [DBG] from='client.404445 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:53:44.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:53:43 smithi157 bash[24585]: cluster 2024-09-16T12:53:42.529728+0000 mgr.a (mgr.14373) 18874 : cluster [DBG] pgmap v13092: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:53:44.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:53:43 smithi086 bash[24289]: cluster 2024-09-16T12:53:42.529728+0000 mgr.a (mgr.14373) 18874 : cluster [DBG] pgmap v13092: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:53:44.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:53:43 smithi047 bash[22744]: cluster 2024-09-16T12:53:42.529728+0000 mgr.a (mgr.14373) 18874 : cluster [DBG] pgmap v13092: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:53:46.016 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:53:46.017 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:53:46.017 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:53:46.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:53:45 smithi157 bash[24585]: cluster 2024-09-16T12:53:44.530524+0000 mgr.a (mgr.14373) 18875 : cluster [DBG] pgmap v13093: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:53:46.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:53:45 smithi086 bash[24289]: cluster 2024-09-16T12:53:44.530524+0000 mgr.a (mgr.14373) 18875 : cluster [DBG] pgmap v13093: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:53:46.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:53:45 smithi047 bash[22744]: cluster 2024-09-16T12:53:44.530524+0000 mgr.a (mgr.14373) 18875 : cluster [DBG] pgmap v13093: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:53:46.777 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:53:46.777 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:53:46.777 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:53:46.778 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:53:46.778 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:53:47.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:53:46 smithi157 bash[24585]: audit 2024-09-16T12:53:46.196021+0000 mon.b (mon.2) 1706 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T12:53:47.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:53:46 smithi157 bash[24585]: audit 2024-09-16T12:53:46.346928+0000 mgr.a (mgr.14373) 18876 : audit [DBG] from='client.404517 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:53:47.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:53:46 smithi086 bash[24289]: audit 2024-09-16T12:53:46.196021+0000 mon.b (mon.2) 1706 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T12:53:47.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:53:46 smithi086 bash[24289]: audit 2024-09-16T12:53:46.346928+0000 mgr.a (mgr.14373) 18876 : audit [DBG] from='client.404517 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:53:47.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:53:46 smithi047 bash[22744]: audit 2024-09-16T12:53:46.196021+0000 mon.b (mon.2) 1706 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T12:53:47.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:53:46 smithi047 bash[22744]: audit 2024-09-16T12:53:46.346928+0000 mgr.a (mgr.14373) 18876 : audit [DBG] from='client.404517 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:53:48.058 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:53:47 smithi157 bash[24585]: cluster 2024-09-16T12:53:46.531830+0000 mgr.a (mgr.14373) 18877 : cluster [DBG] pgmap v13094: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:53:48.058 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:53:47 smithi157 bash[24585]: audit 2024-09-16T12:53:47.013862+0000 mon.b (mon.2) 1707 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T12:53:48.058 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:53:47 smithi157 bash[24585]: audit 2024-09-16T12:53:47.016321+0000 mon.b (mon.2) 1708 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T12:53:48.058 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:53:47 smithi157 bash[24585]: audit 2024-09-16T12:53:47.027782+0000 mon.a (mon.0) 1696 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:53:48.058 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:53:47 smithi157 bash[24585]: audit 2024-09-16T12:53:47.033686+0000 mon.b (mon.2) 1709 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:53:48.058 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:53:47 smithi157 bash[24585]: audit 2024-09-16T12:53:47.036608+0000 mgr.a (mgr.14373) 18878 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:53:48.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:53:47 smithi086 bash[24289]: cluster 2024-09-16T12:53:46.531830+0000 mgr.a (mgr.14373) 18877 : cluster [DBG] pgmap v13094: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:53:48.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:53:47 smithi086 bash[24289]: audit 2024-09-16T12:53:47.013862+0000 mon.b (mon.2) 1707 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T12:53:48.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:53:47 smithi086 bash[24289]: audit 2024-09-16T12:53:47.016321+0000 mon.b (mon.2) 1708 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T12:53:48.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:53:47 smithi086 bash[24289]: audit 2024-09-16T12:53:47.027782+0000 mon.a (mon.0) 1696 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:53:48.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:53:47 smithi086 bash[24289]: audit 2024-09-16T12:53:47.033686+0000 mon.b (mon.2) 1709 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:53:48.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:53:47 smithi086 bash[24289]: audit 2024-09-16T12:53:47.036608+0000 mgr.a (mgr.14373) 18878 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:53:48.093 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 12:53:47 smithi047 bash[22994]: debug 2024-09-16T12:53:47.775+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T12:53:48.093 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 12:53:47 smithi047 bash[22994]: debug 2024-09-16T12:53:47.775+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T12:53:48.094 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:53:47 smithi047 bash[22744]: cluster 2024-09-16T12:53:46.531830+0000 mgr.a (mgr.14373) 18877 : cluster [DBG] pgmap v13094: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:53:48.094 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:53:47 smithi047 bash[22744]: audit 2024-09-16T12:53:47.013862+0000 mon.b (mon.2) 1707 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T12:53:48.094 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:53:47 smithi047 bash[22744]: audit 2024-09-16T12:53:47.016321+0000 mon.b (mon.2) 1708 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T12:53:48.094 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:53:47 smithi047 bash[22744]: audit 2024-09-16T12:53:47.027782+0000 mon.a (mon.0) 1696 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:53:48.094 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:53:47 smithi047 bash[22744]: audit 2024-09-16T12:53:47.033686+0000 mon.b (mon.2) 1709 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:53:48.094 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:53:47 smithi047 bash[22744]: audit 2024-09-16T12:53:47.036608+0000 mgr.a (mgr.14373) 18878 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:53:49.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:53:48 smithi157 bash[24585]: audit 2024-09-16T12:53:47.778869+0000 mgr.a (mgr.14373) 18879 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T12:53:49.058 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:53:48 smithi157 bash[24585]: cephadm 2024-09-16T12:53:47.780645+0000 mgr.a (mgr.14373) 18880 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T12:53:49.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:53:48 smithi086 bash[24289]: audit 2024-09-16T12:53:47.778869+0000 mgr.a (mgr.14373) 18879 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T12:53:49.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:53:48 smithi086 bash[24289]: cephadm 2024-09-16T12:53:47.780645+0000 mgr.a (mgr.14373) 18880 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T12:53:49.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:53:48 smithi047 bash[22744]: audit 2024-09-16T12:53:47.778869+0000 mgr.a (mgr.14373) 18879 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T12:53:49.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:53:48 smithi047 bash[22744]: cephadm 2024-09-16T12:53:47.780645+0000 mgr.a (mgr.14373) 18880 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T12:53:50.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:53:49 smithi157 bash[24585]: cluster 2024-09-16T12:53:48.532691+0000 mgr.a (mgr.14373) 18881 : cluster [DBG] pgmap v13095: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T12:53:50.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:53:49 smithi086 bash[24289]: cluster 2024-09-16T12:53:48.532691+0000 mgr.a (mgr.14373) 18881 : cluster [DBG] pgmap v13095: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T12:53:50.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:53:49 smithi047 bash[22744]: cluster 2024-09-16T12:53:48.532691+0000 mgr.a (mgr.14373) 18881 : cluster [DBG] pgmap v13095: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T12:53:51.779 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:53:51.779 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:53:51.780 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:53:52.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:53:51 smithi157 bash[24585]: cluster 2024-09-16T12:53:50.533449+0000 mgr.a (mgr.14373) 18882 : cluster [DBG] pgmap v13096: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T12:53:52.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:53:51 smithi086 bash[24289]: cluster 2024-09-16T12:53:50.533449+0000 mgr.a (mgr.14373) 18882 : cluster [DBG] pgmap v13096: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T12:53:52.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:53:51 smithi047 bash[22744]: cluster 2024-09-16T12:53:50.533449+0000 mgr.a (mgr.14373) 18882 : cluster [DBG] pgmap v13096: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T12:53:52.575 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:53:52.576 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:53:52.576 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:53:52.576 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:53:52.576 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:53:53.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:53:52 smithi157 bash[24585]: audit 2024-09-16T12:53:52.119333+0000 mgr.a (mgr.14373) 18883 : audit [DBG] from='client.404700 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:53:53.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:53:52 smithi086 bash[24289]: audit 2024-09-16T12:53:52.119333+0000 mgr.a (mgr.14373) 18883 : audit [DBG] from='client.404700 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:53:53.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:53:52 smithi047 bash[22744]: audit 2024-09-16T12:53:52.119333+0000 mgr.a (mgr.14373) 18883 : audit [DBG] from='client.404700 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:53:54.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:53:53 smithi157 bash[24585]: cluster 2024-09-16T12:53:52.534907+0000 mgr.a (mgr.14373) 18884 : cluster [DBG] pgmap v13097: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:53:54.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:53:53 smithi086 bash[24289]: cluster 2024-09-16T12:53:52.534907+0000 mgr.a (mgr.14373) 18884 : cluster [DBG] pgmap v13097: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:53:54.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:53:53 smithi047 bash[22744]: cluster 2024-09-16T12:53:52.534907+0000 mgr.a (mgr.14373) 18884 : cluster [DBG] pgmap v13097: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:53:56.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:53:55 smithi157 bash[24585]: cluster 2024-09-16T12:53:54.535610+0000 mgr.a (mgr.14373) 18885 : cluster [DBG] pgmap v13098: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T12:53:56.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:53:55 smithi086 bash[24289]: cluster 2024-09-16T12:53:54.535610+0000 mgr.a (mgr.14373) 18885 : cluster [DBG] pgmap v13098: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T12:53:56.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:53:55 smithi047 bash[22744]: cluster 2024-09-16T12:53:54.535610+0000 mgr.a (mgr.14373) 18885 : cluster [DBG] pgmap v13098: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T12:53:57.577 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:53:57.578 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:53:57.578 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:53:58.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:53:57 smithi157 bash[24585]: cluster 2024-09-16T12:53:56.537530+0000 mgr.a (mgr.14373) 18886 : cluster [DBG] pgmap v13099: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:53:58.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:53:57 smithi086 bash[24289]: cluster 2024-09-16T12:53:56.537530+0000 mgr.a (mgr.14373) 18886 : cluster [DBG] pgmap v13099: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:53:58.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:53:57 smithi047 bash[22744]: cluster 2024-09-16T12:53:56.537530+0000 mgr.a (mgr.14373) 18886 : cluster [DBG] pgmap v13099: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:53:58.360 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:53:58.360 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:53:58.360 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:53:58.360 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:53:58.360 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:53:59.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:53:58 smithi157 bash[24585]: audit 2024-09-16T12:53:57.910885+0000 mgr.a (mgr.14373) 18887 : audit [DBG] from='client.404772 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:53:59.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:53:58 smithi086 bash[24289]: audit 2024-09-16T12:53:57.910885+0000 mgr.a (mgr.14373) 18887 : audit [DBG] from='client.404772 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:53:59.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:53:58 smithi047 bash[22744]: audit 2024-09-16T12:53:57.910885+0000 mgr.a (mgr.14373) 18887 : audit [DBG] from='client.404772 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:54:00.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:53:59 smithi157 bash[24585]: cluster 2024-09-16T12:53:58.538534+0000 mgr.a (mgr.14373) 18888 : cluster [DBG] pgmap v13100: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:54:00.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:53:59 smithi086 bash[24289]: cluster 2024-09-16T12:53:58.538534+0000 mgr.a (mgr.14373) 18888 : cluster [DBG] pgmap v13100: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:54:00.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:53:59 smithi047 bash[22744]: cluster 2024-09-16T12:53:58.538534+0000 mgr.a (mgr.14373) 18888 : cluster [DBG] pgmap v13100: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:54:02.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:54:01 smithi157 bash[24585]: cluster 2024-09-16T12:54:00.539307+0000 mgr.a (mgr.14373) 18889 : cluster [DBG] pgmap v13101: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:54:02.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:54:01 smithi086 bash[24289]: cluster 2024-09-16T12:54:00.539307+0000 mgr.a (mgr.14373) 18889 : cluster [DBG] pgmap v13101: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:54:02.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:54:01 smithi047 bash[22744]: cluster 2024-09-16T12:54:00.539307+0000 mgr.a (mgr.14373) 18889 : cluster [DBG] pgmap v13101: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:54:03.361 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:54:03.362 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:54:03.362 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:54:04.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:54:03 smithi157 bash[24585]: cluster 2024-09-16T12:54:02.541555+0000 mgr.a (mgr.14373) 18890 : cluster [DBG] pgmap v13102: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:54:04.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:54:03 smithi086 bash[24289]: cluster 2024-09-16T12:54:02.541555+0000 mgr.a (mgr.14373) 18890 : cluster [DBG] pgmap v13102: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:54:04.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:54:03 smithi047 bash[22744]: cluster 2024-09-16T12:54:02.541555+0000 mgr.a (mgr.14373) 18890 : cluster [DBG] pgmap v13102: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:54:04.109 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:54:04.110 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:54:04.110 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:54:04.110 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:54:04.110 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:54:05.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:54:04 smithi157 bash[24585]: audit 2024-09-16T12:54:03.685067+0000 mgr.a (mgr.14373) 18891 : audit [DBG] from='client.404844 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:54:05.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:54:04 smithi086 bash[24289]: audit 2024-09-16T12:54:03.685067+0000 mgr.a (mgr.14373) 18891 : audit [DBG] from='client.404844 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:54:05.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:54:04 smithi047 bash[22744]: audit 2024-09-16T12:54:03.685067+0000 mgr.a (mgr.14373) 18891 : audit [DBG] from='client.404844 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:54:06.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:54:05 smithi157 bash[24585]: cluster 2024-09-16T12:54:04.542462+0000 mgr.a (mgr.14373) 18892 : cluster [DBG] pgmap v13103: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:54:06.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:54:05 smithi086 bash[24289]: cluster 2024-09-16T12:54:04.542462+0000 mgr.a (mgr.14373) 18892 : cluster [DBG] pgmap v13103: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:54:06.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:54:05 smithi047 bash[22744]: cluster 2024-09-16T12:54:04.542462+0000 mgr.a (mgr.14373) 18892 : cluster [DBG] pgmap v13103: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:54:08.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:54:07 smithi086 bash[24289]: cluster 2024-09-16T12:54:06.544589+0000 mgr.a (mgr.14373) 18893 : cluster [DBG] pgmap v13104: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:54:08.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:54:07 smithi047 bash[22744]: cluster 2024-09-16T12:54:06.544589+0000 mgr.a (mgr.14373) 18893 : cluster [DBG] pgmap v13104: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:54:08.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:54:07 smithi157 bash[24585]: cluster 2024-09-16T12:54:06.544589+0000 mgr.a (mgr.14373) 18893 : cluster [DBG] pgmap v13104: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:54:09.111 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:54:09.112 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:54:09.112 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:54:09.867 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:54:09.868 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:54:09.868 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:54:09.868 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:54:09.868 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:54:10.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:54:09 smithi086 bash[24289]: cluster 2024-09-16T12:54:08.545325+0000 mgr.a (mgr.14373) 18894 : cluster [DBG] pgmap v13105: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:54:10.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:54:09 smithi086 bash[24289]: audit 2024-09-16T12:54:09.438266+0000 mgr.a (mgr.14373) 18895 : audit [DBG] from='client.404922 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:54:10.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:54:09 smithi047 bash[22744]: cluster 2024-09-16T12:54:08.545325+0000 mgr.a (mgr.14373) 18894 : cluster [DBG] pgmap v13105: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:54:10.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:54:09 smithi047 bash[22744]: audit 2024-09-16T12:54:09.438266+0000 mgr.a (mgr.14373) 18895 : audit [DBG] from='client.404922 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:54:10.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:54:09 smithi157 bash[24585]: cluster 2024-09-16T12:54:08.545325+0000 mgr.a (mgr.14373) 18894 : cluster [DBG] pgmap v13105: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:54:10.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:54:09 smithi157 bash[24585]: audit 2024-09-16T12:54:09.438266+0000 mgr.a (mgr.14373) 18895 : audit [DBG] from='client.404922 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:54:12.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:54:11 smithi047 bash[22744]: cluster 2024-09-16T12:54:10.546231+0000 mgr.a (mgr.14373) 18896 : cluster [DBG] pgmap v13106: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:54:12.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:54:11 smithi157 bash[24585]: cluster 2024-09-16T12:54:10.546231+0000 mgr.a (mgr.14373) 18896 : cluster [DBG] pgmap v13106: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:54:12.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:54:11 smithi086 bash[24289]: cluster 2024-09-16T12:54:10.546231+0000 mgr.a (mgr.14373) 18896 : cluster [DBG] pgmap v13106: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:54:14.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:54:13 smithi047 bash[22744]: cluster 2024-09-16T12:54:12.548426+0000 mgr.a (mgr.14373) 18897 : cluster [DBG] pgmap v13107: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:54:14.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:54:13 smithi157 bash[24585]: cluster 2024-09-16T12:54:12.548426+0000 mgr.a (mgr.14373) 18897 : cluster [DBG] pgmap v13107: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:54:14.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:54:13 smithi086 bash[24289]: cluster 2024-09-16T12:54:12.548426+0000 mgr.a (mgr.14373) 18897 : cluster [DBG] pgmap v13107: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:54:14.869 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:54:14.870 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:54:14.870 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:54:15.635 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:54:15.635 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:54:15.636 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:54:15.636 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:54:15.636 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:54:16.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:54:15 smithi047 bash[22744]: cluster 2024-09-16T12:54:14.549198+0000 mgr.a (mgr.14373) 18898 : cluster [DBG] pgmap v13108: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:54:16.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:54:15 smithi047 bash[22744]: audit 2024-09-16T12:54:15.194688+0000 mgr.a (mgr.14373) 18899 : audit [DBG] from='client.405000 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:54:16.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:54:15 smithi157 bash[24585]: cluster 2024-09-16T12:54:14.549198+0000 mgr.a (mgr.14373) 18898 : cluster [DBG] pgmap v13108: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:54:16.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:54:15 smithi157 bash[24585]: audit 2024-09-16T12:54:15.194688+0000 mgr.a (mgr.14373) 18899 : audit [DBG] from='client.405000 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:54:16.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:54:15 smithi086 bash[24289]: cluster 2024-09-16T12:54:14.549198+0000 mgr.a (mgr.14373) 18898 : cluster [DBG] pgmap v13108: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:54:16.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:54:15 smithi086 bash[24289]: audit 2024-09-16T12:54:15.194688+0000 mgr.a (mgr.14373) 18899 : audit [DBG] from='client.405000 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:54:18.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:54:17 smithi047 bash[22744]: cluster 2024-09-16T12:54:16.551462+0000 mgr.a (mgr.14373) 18900 : cluster [DBG] pgmap v13109: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:54:18.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:54:17 smithi157 bash[24585]: cluster 2024-09-16T12:54:16.551462+0000 mgr.a (mgr.14373) 18900 : cluster [DBG] pgmap v13109: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:54:18.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:54:17 smithi086 bash[24289]: cluster 2024-09-16T12:54:16.551462+0000 mgr.a (mgr.14373) 18900 : cluster [DBG] pgmap v13109: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:54:20.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:54:19 smithi047 bash[22744]: cluster 2024-09-16T12:54:18.552259+0000 mgr.a (mgr.14373) 18901 : cluster [DBG] pgmap v13110: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:54:20.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:54:19 smithi157 bash[24585]: cluster 2024-09-16T12:54:18.552259+0000 mgr.a (mgr.14373) 18901 : cluster [DBG] pgmap v13110: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:54:20.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:54:19 smithi086 bash[24289]: cluster 2024-09-16T12:54:18.552259+0000 mgr.a (mgr.14373) 18901 : cluster [DBG] pgmap v13110: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:54:20.637 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:54:20.637 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:54:20.638 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:54:21.425 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:54:21.426 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:54:21.426 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:54:21.426 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:54:21.426 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:54:22.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:54:21 smithi047 bash[22744]: cluster 2024-09-16T12:54:20.553045+0000 mgr.a (mgr.14373) 18902 : cluster [DBG] pgmap v13111: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:54:22.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:54:21 smithi047 bash[22744]: audit 2024-09-16T12:54:20.970789+0000 mgr.a (mgr.14373) 18903 : audit [DBG] from='client.405078 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:54:22.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:54:21 smithi157 bash[24585]: cluster 2024-09-16T12:54:20.553045+0000 mgr.a (mgr.14373) 18902 : cluster [DBG] pgmap v13111: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:54:22.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:54:21 smithi157 bash[24585]: audit 2024-09-16T12:54:20.970789+0000 mgr.a (mgr.14373) 18903 : audit [DBG] from='client.405078 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:54:22.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:54:21 smithi086 bash[24289]: cluster 2024-09-16T12:54:20.553045+0000 mgr.a (mgr.14373) 18902 : cluster [DBG] pgmap v13111: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:54:22.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:54:21 smithi086 bash[24289]: audit 2024-09-16T12:54:20.970789+0000 mgr.a (mgr.14373) 18903 : audit [DBG] from='client.405078 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:54:24.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:54:23 smithi157 bash[24585]: cluster 2024-09-16T12:54:22.555401+0000 mgr.a (mgr.14373) 18904 : cluster [DBG] pgmap v13112: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:54:24.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:54:23 smithi086 bash[24289]: cluster 2024-09-16T12:54:22.555401+0000 mgr.a (mgr.14373) 18904 : cluster [DBG] pgmap v13112: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:54:24.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:54:23 smithi047 bash[22744]: cluster 2024-09-16T12:54:22.555401+0000 mgr.a (mgr.14373) 18904 : cluster [DBG] pgmap v13112: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:54:26.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:54:25 smithi157 bash[24585]: cluster 2024-09-16T12:54:24.556173+0000 mgr.a (mgr.14373) 18905 : cluster [DBG] pgmap v13113: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:54:26.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:54:25 smithi086 bash[24289]: cluster 2024-09-16T12:54:24.556173+0000 mgr.a (mgr.14373) 18905 : cluster [DBG] pgmap v13113: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:54:26.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:54:25 smithi047 bash[22744]: cluster 2024-09-16T12:54:24.556173+0000 mgr.a (mgr.14373) 18905 : cluster [DBG] pgmap v13113: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:54:26.427 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:54:26.428 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:54:26.428 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:54:27.211 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:54:27.211 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:54:27.211 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:54:27.211 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:54:27.211 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:54:28.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:54:27 smithi157 bash[24585]: cluster 2024-09-16T12:54:26.557157+0000 mgr.a (mgr.14373) 18906 : cluster [DBG] pgmap v13114: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:54:28.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:54:27 smithi157 bash[24585]: audit 2024-09-16T12:54:26.758271+0000 mgr.a (mgr.14373) 18907 : audit [DBG] from='client.405156 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:54:28.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:54:27 smithi086 bash[24289]: cluster 2024-09-16T12:54:26.557157+0000 mgr.a (mgr.14373) 18906 : cluster [DBG] pgmap v13114: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:54:28.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:54:27 smithi086 bash[24289]: audit 2024-09-16T12:54:26.758271+0000 mgr.a (mgr.14373) 18907 : audit [DBG] from='client.405156 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:54:28.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:54:27 smithi047 bash[22744]: cluster 2024-09-16T12:54:26.557157+0000 mgr.a (mgr.14373) 18906 : cluster [DBG] pgmap v13114: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:54:28.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:54:27 smithi047 bash[22744]: audit 2024-09-16T12:54:26.758271+0000 mgr.a (mgr.14373) 18907 : audit [DBG] from='client.405156 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:54:30.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:54:29 smithi157 bash[24585]: cluster 2024-09-16T12:54:28.558002+0000 mgr.a (mgr.14373) 18908 : cluster [DBG] pgmap v13115: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T12:54:30.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:54:29 smithi086 bash[24289]: cluster 2024-09-16T12:54:28.558002+0000 mgr.a (mgr.14373) 18908 : cluster [DBG] pgmap v13115: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T12:54:30.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:54:29 smithi047 bash[22744]: cluster 2024-09-16T12:54:28.558002+0000 mgr.a (mgr.14373) 18908 : cluster [DBG] pgmap v13115: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T12:54:32.213 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:54:32.213 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:54:32.214 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:54:32.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:54:31 smithi157 bash[24585]: cluster 2024-09-16T12:54:30.558788+0000 mgr.a (mgr.14373) 18909 : cluster [DBG] pgmap v13116: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T12:54:32.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:54:31 smithi086 bash[24289]: cluster 2024-09-16T12:54:30.558788+0000 mgr.a (mgr.14373) 18909 : cluster [DBG] pgmap v13116: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T12:54:32.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:54:31 smithi047 bash[22744]: cluster 2024-09-16T12:54:30.558788+0000 mgr.a (mgr.14373) 18909 : cluster [DBG] pgmap v13116: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T12:54:32.951 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:54:32.951 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:54:32.951 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:54:32.951 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:54:32.951 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:54:34.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:54:33 smithi157 bash[24585]: audit 2024-09-16T12:54:32.535870+0000 mgr.a (mgr.14373) 18910 : audit [DBG] from='client.405231 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:54:34.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:54:33 smithi157 bash[24585]: cluster 2024-09-16T12:54:32.560381+0000 mgr.a (mgr.14373) 18911 : cluster [DBG] pgmap v13117: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:54:34.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:54:33 smithi086 bash[24289]: audit 2024-09-16T12:54:32.535870+0000 mgr.a (mgr.14373) 18910 : audit [DBG] from='client.405231 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:54:34.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:54:33 smithi086 bash[24289]: cluster 2024-09-16T12:54:32.560381+0000 mgr.a (mgr.14373) 18911 : cluster [DBG] pgmap v13117: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:54:34.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:54:33 smithi047 bash[22744]: audit 2024-09-16T12:54:32.535870+0000 mgr.a (mgr.14373) 18910 : audit [DBG] from='client.405231 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:54:34.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:54:33 smithi047 bash[22744]: cluster 2024-09-16T12:54:32.560381+0000 mgr.a (mgr.14373) 18911 : cluster [DBG] pgmap v13117: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:54:36.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:54:35 smithi157 bash[24585]: cluster 2024-09-16T12:54:34.561232+0000 mgr.a (mgr.14373) 18912 : cluster [DBG] pgmap v13118: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T12:54:36.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:54:35 smithi086 bash[24289]: cluster 2024-09-16T12:54:34.561232+0000 mgr.a (mgr.14373) 18912 : cluster [DBG] pgmap v13118: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T12:54:36.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:54:35 smithi047 bash[22744]: cluster 2024-09-16T12:54:34.561232+0000 mgr.a (mgr.14373) 18912 : cluster [DBG] pgmap v13118: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T12:54:37.953 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:54:37.953 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:54:37.954 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:54:38.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:54:37 smithi157 bash[24585]: cluster 2024-09-16T12:54:36.563379+0000 mgr.a (mgr.14373) 18913 : cluster [DBG] pgmap v13119: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:54:38.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:54:37 smithi086 bash[24289]: cluster 2024-09-16T12:54:36.563379+0000 mgr.a (mgr.14373) 18913 : cluster [DBG] pgmap v13119: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:54:38.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:54:37 smithi047 bash[22744]: cluster 2024-09-16T12:54:36.563379+0000 mgr.a (mgr.14373) 18913 : cluster [DBG] pgmap v13119: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:54:38.737 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:54:38.737 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:54:38.737 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:54:38.737 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:54:38.737 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:54:39.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:54:38 smithi157 bash[24585]: audit 2024-09-16T12:54:38.286463+0000 mgr.a (mgr.14373) 18914 : audit [DBG] from='client.405309 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:54:39.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:54:38 smithi086 bash[24289]: audit 2024-09-16T12:54:38.286463+0000 mgr.a (mgr.14373) 18914 : audit [DBG] from='client.405309 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:54:39.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:54:38 smithi047 bash[22744]: audit 2024-09-16T12:54:38.286463+0000 mgr.a (mgr.14373) 18914 : audit [DBG] from='client.405309 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:54:40.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:54:39 smithi157 bash[24585]: cluster 2024-09-16T12:54:38.564040+0000 mgr.a (mgr.14373) 18915 : cluster [DBG] pgmap v13120: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:54:40.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:54:39 smithi086 bash[24289]: cluster 2024-09-16T12:54:38.564040+0000 mgr.a (mgr.14373) 18915 : cluster [DBG] pgmap v13120: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:54:40.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:54:39 smithi047 bash[22744]: cluster 2024-09-16T12:54:38.564040+0000 mgr.a (mgr.14373) 18915 : cluster [DBG] pgmap v13120: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:54:42.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:54:41 smithi157 bash[24585]: cluster 2024-09-16T12:54:40.565180+0000 mgr.a (mgr.14373) 18916 : cluster [DBG] pgmap v13121: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:54:42.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:54:41 smithi086 bash[24289]: cluster 2024-09-16T12:54:40.565180+0000 mgr.a (mgr.14373) 18916 : cluster [DBG] pgmap v13121: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:54:42.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:54:41 smithi047 bash[22744]: cluster 2024-09-16T12:54:40.565180+0000 mgr.a (mgr.14373) 18916 : cluster [DBG] pgmap v13121: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:54:43.738 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:54:43.739 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:54:43.739 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:54:44.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:54:43 smithi157 bash[24585]: cluster 2024-09-16T12:54:42.567415+0000 mgr.a (mgr.14373) 18917 : cluster [DBG] pgmap v13122: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:54:44.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:54:43 smithi086 bash[24289]: cluster 2024-09-16T12:54:42.567415+0000 mgr.a (mgr.14373) 18917 : cluster [DBG] pgmap v13122: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:54:44.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:54:43 smithi047 bash[22744]: cluster 2024-09-16T12:54:42.567415+0000 mgr.a (mgr.14373) 18917 : cluster [DBG] pgmap v13122: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:54:44.507 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:54:44.507 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:54:44.507 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:54:44.507 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:54:44.507 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:54:45.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:54:44 smithi157 bash[24585]: audit 2024-09-16T12:54:44.070641+0000 mgr.a (mgr.14373) 18918 : audit [DBG] from='client.405384 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:54:45.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:54:44 smithi086 bash[24289]: audit 2024-09-16T12:54:44.070641+0000 mgr.a (mgr.14373) 18918 : audit [DBG] from='client.405384 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:54:45.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:54:44 smithi047 bash[22744]: audit 2024-09-16T12:54:44.070641+0000 mgr.a (mgr.14373) 18918 : audit [DBG] from='client.405384 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:54:46.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:54:45 smithi157 bash[24585]: cluster 2024-09-16T12:54:44.567942+0000 mgr.a (mgr.14373) 18919 : cluster [DBG] pgmap v13123: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:54:46.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:54:45 smithi086 bash[24289]: cluster 2024-09-16T12:54:44.567942+0000 mgr.a (mgr.14373) 18919 : cluster [DBG] pgmap v13123: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:54:46.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:54:45 smithi047 bash[22744]: cluster 2024-09-16T12:54:44.567942+0000 mgr.a (mgr.14373) 18919 : cluster [DBG] pgmap v13123: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:54:48.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:54:47 smithi157 bash[24585]: cluster 2024-09-16T12:54:46.569957+0000 mgr.a (mgr.14373) 18920 : cluster [DBG] pgmap v13124: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:54:48.308 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:54:47 smithi157 bash[24585]: audit 2024-09-16T12:54:47.832553+0000 mon.b (mon.2) 1710 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T12:54:48.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:54:47 smithi086 bash[24289]: cluster 2024-09-16T12:54:46.569957+0000 mgr.a (mgr.14373) 18920 : cluster [DBG] pgmap v13124: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:54:48.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:54:47 smithi086 bash[24289]: audit 2024-09-16T12:54:47.832553+0000 mon.b (mon.2) 1710 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T12:54:48.345 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:54:47 smithi047 bash[22744]: cluster 2024-09-16T12:54:46.569957+0000 mgr.a (mgr.14373) 18920 : cluster [DBG] pgmap v13124: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:54:48.345 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:54:47 smithi047 bash[22744]: audit 2024-09-16T12:54:47.832553+0000 mon.b (mon.2) 1710 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T12:54:49.508 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:54:49.508 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:54:49.508 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:54:49.808 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:54:49 smithi157 bash[24585]: audit 2024-09-16T12:54:48.467328+0000 mon.a (mon.0) 1697 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:54:49.808 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:54:49 smithi157 bash[24585]: audit 2024-09-16T12:54:48.491829+0000 mon.a (mon.0) 1698 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:54:49.808 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:54:49 smithi157 bash[24585]: audit 2024-09-16T12:54:49.273108+0000 mon.b (mon.2) 1711 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T12:54:49.808 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:54:49 smithi157 bash[24585]: audit 2024-09-16T12:54:49.275242+0000 mon.b (mon.2) 1712 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T12:54:49.808 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:54:49 smithi157 bash[24585]: audit 2024-09-16T12:54:49.286304+0000 mon.a (mon.0) 1699 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:54:49.808 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:54:49 smithi157 bash[24585]: audit 2024-09-16T12:54:49.291994+0000 mon.b (mon.2) 1713 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:54:49.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:54:49 smithi086 bash[24289]: audit 2024-09-16T12:54:48.467328+0000 mon.a (mon.0) 1697 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:54:49.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:54:49 smithi086 bash[24289]: audit 2024-09-16T12:54:48.491829+0000 mon.a (mon.0) 1698 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:54:49.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:54:49 smithi086 bash[24289]: audit 2024-09-16T12:54:49.273108+0000 mon.b (mon.2) 1711 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T12:54:49.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:54:49 smithi086 bash[24289]: audit 2024-09-16T12:54:49.275242+0000 mon.b (mon.2) 1712 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T12:54:49.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:54:49 smithi086 bash[24289]: audit 2024-09-16T12:54:49.286304+0000 mon.a (mon.0) 1699 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:54:49.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:54:49 smithi086 bash[24289]: audit 2024-09-16T12:54:49.291994+0000 mon.b (mon.2) 1713 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:54:49.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:54:49 smithi047 bash[22744]: audit 2024-09-16T12:54:48.467328+0000 mon.a (mon.0) 1697 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:54:49.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:54:49 smithi047 bash[22744]: audit 2024-09-16T12:54:48.491829+0000 mon.a (mon.0) 1698 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:54:49.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:54:49 smithi047 bash[22744]: audit 2024-09-16T12:54:49.273108+0000 mon.b (mon.2) 1711 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T12:54:49.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:54:49 smithi047 bash[22744]: audit 2024-09-16T12:54:49.275242+0000 mon.b (mon.2) 1712 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T12:54:49.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:54:49 smithi047 bash[22744]: audit 2024-09-16T12:54:49.286304+0000 mon.a (mon.0) 1699 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:54:49.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:54:49 smithi047 bash[22744]: audit 2024-09-16T12:54:49.291994+0000 mon.b (mon.2) 1713 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:54:50.343 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 12:54:50 smithi047 bash[22994]: debug 2024-09-16T12:54:50.046+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T12:54:50.343 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 12:54:50 smithi047 bash[22994]: debug 2024-09-16T12:54:50.058+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T12:54:50.458 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:54:50.458 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:54:50.458 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:54:50.458 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:54:50.459 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:54:50.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:54:50 smithi157 bash[24585]: cluster 2024-09-16T12:54:48.570675+0000 mgr.a (mgr.14373) 18921 : cluster [DBG] pgmap v13125: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:54:50.808 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:54:50 smithi157 bash[24585]: audit 2024-09-16T12:54:49.293298+0000 mgr.a (mgr.14373) 18922 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:54:50.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:54:50 smithi086 bash[24289]: cluster 2024-09-16T12:54:48.570675+0000 mgr.a (mgr.14373) 18921 : cluster [DBG] pgmap v13125: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:54:50.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:54:50 smithi086 bash[24289]: audit 2024-09-16T12:54:49.293298+0000 mgr.a (mgr.14373) 18922 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:54:50.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:54:50 smithi047 bash[22744]: cluster 2024-09-16T12:54:48.570675+0000 mgr.a (mgr.14373) 18921 : cluster [DBG] pgmap v13125: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:54:50.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:54:50 smithi047 bash[22744]: audit 2024-09-16T12:54:49.293298+0000 mgr.a (mgr.14373) 18922 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:54:51.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:54:51 smithi157 bash[24585]: audit 2024-09-16T12:54:49.831119+0000 mgr.a (mgr.14373) 18923 : audit [DBG] from='client.405510 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:54:51.808 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:54:51 smithi157 bash[24585]: audit 2024-09-16T12:54:50.049140+0000 mgr.a (mgr.14373) 18924 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T12:54:51.808 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:54:51 smithi157 bash[24585]: cephadm 2024-09-16T12:54:50.060917+0000 mgr.a (mgr.14373) 18925 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T12:54:51.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:54:51 smithi086 bash[24289]: audit 2024-09-16T12:54:49.831119+0000 mgr.a (mgr.14373) 18923 : audit [DBG] from='client.405510 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:54:51.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:54:51 smithi086 bash[24289]: audit 2024-09-16T12:54:50.049140+0000 mgr.a (mgr.14373) 18924 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T12:54:51.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:54:51 smithi086 bash[24289]: cephadm 2024-09-16T12:54:50.060917+0000 mgr.a (mgr.14373) 18925 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T12:54:51.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:54:51 smithi047 bash[22744]: audit 2024-09-16T12:54:49.831119+0000 mgr.a (mgr.14373) 18923 : audit [DBG] from='client.405510 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:54:51.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:54:51 smithi047 bash[22744]: audit 2024-09-16T12:54:50.049140+0000 mgr.a (mgr.14373) 18924 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T12:54:51.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:54:51 smithi047 bash[22744]: cephadm 2024-09-16T12:54:50.060917+0000 mgr.a (mgr.14373) 18925 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T12:54:52.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:54:52 smithi157 bash[24585]: cluster 2024-09-16T12:54:50.571476+0000 mgr.a (mgr.14373) 18926 : cluster [DBG] pgmap v13126: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:54:52.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:54:52 smithi086 bash[24289]: cluster 2024-09-16T12:54:50.571476+0000 mgr.a (mgr.14373) 18926 : cluster [DBG] pgmap v13126: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:54:52.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:54:52 smithi047 bash[22744]: cluster 2024-09-16T12:54:50.571476+0000 mgr.a (mgr.14373) 18926 : cluster [DBG] pgmap v13126: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:54:54.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:54:54 smithi157 bash[24585]: cluster 2024-09-16T12:54:52.573692+0000 mgr.a (mgr.14373) 18927 : cluster [DBG] pgmap v13127: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:54:54.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:54:54 smithi086 bash[24289]: cluster 2024-09-16T12:54:52.573692+0000 mgr.a (mgr.14373) 18927 : cluster [DBG] pgmap v13127: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:54:54.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:54:54 smithi047 bash[22744]: cluster 2024-09-16T12:54:52.573692+0000 mgr.a (mgr.14373) 18927 : cluster [DBG] pgmap v13127: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:54:55.459 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:54:55.460 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:54:55.460 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:54:56.251 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:54:56.251 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:54:56.252 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:54:56.252 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:54:56.252 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:54:56.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:54:56 smithi157 bash[24585]: cluster 2024-09-16T12:54:54.574395+0000 mgr.a (mgr.14373) 18928 : cluster [DBG] pgmap v13128: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:54:56.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:54:56 smithi086 bash[24289]: cluster 2024-09-16T12:54:54.574395+0000 mgr.a (mgr.14373) 18928 : cluster [DBG] pgmap v13128: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:54:56.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:54:56 smithi047 bash[22744]: cluster 2024-09-16T12:54:54.574395+0000 mgr.a (mgr.14373) 18928 : cluster [DBG] pgmap v13128: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:54:57.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:54:57 smithi157 bash[24585]: audit 2024-09-16T12:54:55.798046+0000 mgr.a (mgr.14373) 18929 : audit [DBG] from='client.405645 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:54:57.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:54:57 smithi086 bash[24289]: audit 2024-09-16T12:54:55.798046+0000 mgr.a (mgr.14373) 18929 : audit [DBG] from='client.405645 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:54:57.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:54:57 smithi047 bash[22744]: audit 2024-09-16T12:54:55.798046+0000 mgr.a (mgr.14373) 18929 : audit [DBG] from='client.405645 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:54:58.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:54:58 smithi157 bash[24585]: cluster 2024-09-16T12:54:56.576668+0000 mgr.a (mgr.14373) 18930 : cluster [DBG] pgmap v13129: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:54:58.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:54:58 smithi086 bash[24289]: cluster 2024-09-16T12:54:56.576668+0000 mgr.a (mgr.14373) 18930 : cluster [DBG] pgmap v13129: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:54:58.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:54:58 smithi047 bash[22744]: cluster 2024-09-16T12:54:56.576668+0000 mgr.a (mgr.14373) 18930 : cluster [DBG] pgmap v13129: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:54:59.809 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:54:59 smithi157 bash[24585]: cluster 2024-09-16T12:54:58.577442+0000 mgr.a (mgr.14373) 18931 : cluster [DBG] pgmap v13130: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:54:59.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:54:59 smithi086 bash[24289]: cluster 2024-09-16T12:54:58.577442+0000 mgr.a (mgr.14373) 18931 : cluster [DBG] pgmap v13130: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:54:59.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:54:59 smithi047 bash[22744]: cluster 2024-09-16T12:54:58.577442+0000 mgr.a (mgr.14373) 18931 : cluster [DBG] pgmap v13130: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:55:01.254 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:55:01.254 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:55:01.254 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:55:02.001 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:55:02.002 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:55:02.002 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:55:02.002 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:55:02.002 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:55:02.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:55:01 smithi157 bash[24585]: cluster 2024-09-16T12:55:00.578227+0000 mgr.a (mgr.14373) 18932 : cluster [DBG] pgmap v13131: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:55:02.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:55:01 smithi086 bash[24289]: cluster 2024-09-16T12:55:00.578227+0000 mgr.a (mgr.14373) 18932 : cluster [DBG] pgmap v13131: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:55:02.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:55:01 smithi047 bash[22744]: cluster 2024-09-16T12:55:00.578227+0000 mgr.a (mgr.14373) 18932 : cluster [DBG] pgmap v13131: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:55:03.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:55:02 smithi157 bash[24585]: audit 2024-09-16T12:55:01.579661+0000 mgr.a (mgr.14373) 18933 : audit [DBG] from='client.405720 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:55:03.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:55:02 smithi086 bash[24289]: audit 2024-09-16T12:55:01.579661+0000 mgr.a (mgr.14373) 18933 : audit [DBG] from='client.405720 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:55:03.095 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:55:02 smithi047 bash[22744]: audit 2024-09-16T12:55:01.579661+0000 mgr.a (mgr.14373) 18933 : audit [DBG] from='client.405720 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:55:04.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:55:03 smithi157 bash[24585]: cluster 2024-09-16T12:55:02.581043+0000 mgr.a (mgr.14373) 18934 : cluster [DBG] pgmap v13132: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:55:04.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:55:03 smithi086 bash[24289]: cluster 2024-09-16T12:55:02.581043+0000 mgr.a (mgr.14373) 18934 : cluster [DBG] pgmap v13132: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:55:04.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:55:03 smithi047 bash[22744]: cluster 2024-09-16T12:55:02.581043+0000 mgr.a (mgr.14373) 18934 : cluster [DBG] pgmap v13132: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:55:06.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:55:05 smithi157 bash[24585]: cluster 2024-09-16T12:55:04.581783+0000 mgr.a (mgr.14373) 18935 : cluster [DBG] pgmap v13133: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:55:06.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:55:05 smithi086 bash[24289]: cluster 2024-09-16T12:55:04.581783+0000 mgr.a (mgr.14373) 18935 : cluster [DBG] pgmap v13133: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:55:06.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:55:05 smithi047 bash[22744]: cluster 2024-09-16T12:55:04.581783+0000 mgr.a (mgr.14373) 18935 : cluster [DBG] pgmap v13133: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:55:07.003 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:55:07.004 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:55:07.004 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:55:07.800 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:55:07.801 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:55:07.801 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:55:07.801 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:55:07.801 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:55:08.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:55:07 smithi157 bash[24585]: cluster 2024-09-16T12:55:06.583751+0000 mgr.a (mgr.14373) 18936 : cluster [DBG] pgmap v13134: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:55:08.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:55:07 smithi157 bash[24585]: audit 2024-09-16T12:55:07.343199+0000 mgr.a (mgr.14373) 18937 : audit [DBG] from='client.405798 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:55:08.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:55:07 smithi086 bash[24289]: cluster 2024-09-16T12:55:06.583751+0000 mgr.a (mgr.14373) 18936 : cluster [DBG] pgmap v13134: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:55:08.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:55:07 smithi086 bash[24289]: audit 2024-09-16T12:55:07.343199+0000 mgr.a (mgr.14373) 18937 : audit [DBG] from='client.405798 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:55:08.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:55:07 smithi047 bash[22744]: cluster 2024-09-16T12:55:06.583751+0000 mgr.a (mgr.14373) 18936 : cluster [DBG] pgmap v13134: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:55:08.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:55:07 smithi047 bash[22744]: audit 2024-09-16T12:55:07.343199+0000 mgr.a (mgr.14373) 18937 : audit [DBG] from='client.405798 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:55:10.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:55:09 smithi157 bash[24585]: cluster 2024-09-16T12:55:08.584720+0000 mgr.a (mgr.14373) 18938 : cluster [DBG] pgmap v13135: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:55:10.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:55:09 smithi086 bash[24289]: cluster 2024-09-16T12:55:08.584720+0000 mgr.a (mgr.14373) 18938 : cluster [DBG] pgmap v13135: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:55:10.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:55:09 smithi047 bash[22744]: cluster 2024-09-16T12:55:08.584720+0000 mgr.a (mgr.14373) 18938 : cluster [DBG] pgmap v13135: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:55:12.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:55:11 smithi157 bash[24585]: cluster 2024-09-16T12:55:10.585534+0000 mgr.a (mgr.14373) 18939 : cluster [DBG] pgmap v13136: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T12:55:12.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:55:11 smithi086 bash[24289]: cluster 2024-09-16T12:55:10.585534+0000 mgr.a (mgr.14373) 18939 : cluster [DBG] pgmap v13136: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T12:55:12.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:55:11 smithi047 bash[22744]: cluster 2024-09-16T12:55:10.585534+0000 mgr.a (mgr.14373) 18939 : cluster [DBG] pgmap v13136: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T12:55:12.802 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:55:12.803 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:55:12.803 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:55:13.575 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:55:13.575 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:55:13.576 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:55:13.576 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:55:13.576 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:55:14.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:55:13 smithi157 bash[24585]: cluster 2024-09-16T12:55:12.587798+0000 mgr.a (mgr.14373) 18940 : cluster [DBG] pgmap v13137: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:55:14.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:55:13 smithi157 bash[24585]: audit 2024-09-16T12:55:13.138253+0000 mgr.a (mgr.14373) 18941 : audit [DBG] from='client.405873 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:55:14.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:55:13 smithi086 bash[24289]: cluster 2024-09-16T12:55:12.587798+0000 mgr.a (mgr.14373) 18940 : cluster [DBG] pgmap v13137: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:55:14.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:55:13 smithi086 bash[24289]: audit 2024-09-16T12:55:13.138253+0000 mgr.a (mgr.14373) 18941 : audit [DBG] from='client.405873 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:55:14.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:55:13 smithi047 bash[22744]: cluster 2024-09-16T12:55:12.587798+0000 mgr.a (mgr.14373) 18940 : cluster [DBG] pgmap v13137: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:55:14.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:55:13 smithi047 bash[22744]: audit 2024-09-16T12:55:13.138253+0000 mgr.a (mgr.14373) 18941 : audit [DBG] from='client.405873 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:55:16.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:55:15 smithi157 bash[24585]: cluster 2024-09-16T12:55:14.588760+0000 mgr.a (mgr.14373) 18942 : cluster [DBG] pgmap v13138: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:55:16.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:55:15 smithi086 bash[24289]: cluster 2024-09-16T12:55:14.588760+0000 mgr.a (mgr.14373) 18942 : cluster [DBG] pgmap v13138: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:55:16.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:55:15 smithi047 bash[22744]: cluster 2024-09-16T12:55:14.588760+0000 mgr.a (mgr.14373) 18942 : cluster [DBG] pgmap v13138: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:55:18.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:55:17 smithi157 bash[24585]: cluster 2024-09-16T12:55:16.590995+0000 mgr.a (mgr.14373) 18943 : cluster [DBG] pgmap v13139: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:55:18.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:55:17 smithi086 bash[24289]: cluster 2024-09-16T12:55:16.590995+0000 mgr.a (mgr.14373) 18943 : cluster [DBG] pgmap v13139: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:55:18.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:55:17 smithi047 bash[22744]: cluster 2024-09-16T12:55:16.590995+0000 mgr.a (mgr.14373) 18943 : cluster [DBG] pgmap v13139: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:55:18.577 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:55:18.578 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:55:18.578 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:55:19.347 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:55:19.348 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:55:19.348 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:55:19.348 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:55:19.348 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:55:20.058 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:55:19 smithi157 bash[24585]: cluster 2024-09-16T12:55:18.591663+0000 mgr.a (mgr.14373) 18944 : cluster [DBG] pgmap v13140: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:55:20.058 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:55:19 smithi157 bash[24585]: audit 2024-09-16T12:55:18.909746+0000 mgr.a (mgr.14373) 18945 : audit [DBG] from='client.405951 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:55:20.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:55:19 smithi086 bash[24289]: cluster 2024-09-16T12:55:18.591663+0000 mgr.a (mgr.14373) 18944 : cluster [DBG] pgmap v13140: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:55:20.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:55:19 smithi086 bash[24289]: audit 2024-09-16T12:55:18.909746+0000 mgr.a (mgr.14373) 18945 : audit [DBG] from='client.405951 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:55:20.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:55:19 smithi047 bash[22744]: cluster 2024-09-16T12:55:18.591663+0000 mgr.a (mgr.14373) 18944 : cluster [DBG] pgmap v13140: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:55:20.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:55:19 smithi047 bash[22744]: audit 2024-09-16T12:55:18.909746+0000 mgr.a (mgr.14373) 18945 : audit [DBG] from='client.405951 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:55:22.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:55:21 smithi157 bash[24585]: cluster 2024-09-16T12:55:20.592641+0000 mgr.a (mgr.14373) 18946 : cluster [DBG] pgmap v13141: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:55:22.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:55:21 smithi086 bash[24289]: cluster 2024-09-16T12:55:20.592641+0000 mgr.a (mgr.14373) 18946 : cluster [DBG] pgmap v13141: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:55:22.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:55:21 smithi047 bash[22744]: cluster 2024-09-16T12:55:20.592641+0000 mgr.a (mgr.14373) 18946 : cluster [DBG] pgmap v13141: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:55:24.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:55:23 smithi157 bash[24585]: cluster 2024-09-16T12:55:22.594908+0000 mgr.a (mgr.14373) 18947 : cluster [DBG] pgmap v13142: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:55:24.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:55:23 smithi086 bash[24289]: cluster 2024-09-16T12:55:22.594908+0000 mgr.a (mgr.14373) 18947 : cluster [DBG] pgmap v13142: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:55:24.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:55:23 smithi047 bash[22744]: cluster 2024-09-16T12:55:22.594908+0000 mgr.a (mgr.14373) 18947 : cluster [DBG] pgmap v13142: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:55:24.349 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:55:24.350 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:55:24.350 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:55:25.125 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:55:25.126 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:55:25.126 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:55:25.126 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:55:25.126 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:55:26.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:55:25 smithi157 bash[24585]: cluster 2024-09-16T12:55:24.595620+0000 mgr.a (mgr.14373) 18948 : cluster [DBG] pgmap v13143: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:55:26.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:55:25 smithi157 bash[24585]: audit 2024-09-16T12:55:24.681430+0000 mgr.a (mgr.14373) 18949 : audit [DBG] from='client.406026 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:55:26.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:55:25 smithi086 bash[24289]: cluster 2024-09-16T12:55:24.595620+0000 mgr.a (mgr.14373) 18948 : cluster [DBG] pgmap v13143: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:55:26.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:55:25 smithi086 bash[24289]: audit 2024-09-16T12:55:24.681430+0000 mgr.a (mgr.14373) 18949 : audit [DBG] from='client.406026 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:55:26.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:55:25 smithi047 bash[22744]: cluster 2024-09-16T12:55:24.595620+0000 mgr.a (mgr.14373) 18948 : cluster [DBG] pgmap v13143: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:55:26.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:55:25 smithi047 bash[22744]: audit 2024-09-16T12:55:24.681430+0000 mgr.a (mgr.14373) 18949 : audit [DBG] from='client.406026 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:55:28.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:55:27 smithi157 bash[24585]: cluster 2024-09-16T12:55:26.597947+0000 mgr.a (mgr.14373) 18950 : cluster [DBG] pgmap v13144: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:55:28.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:55:27 smithi086 bash[24289]: cluster 2024-09-16T12:55:26.597947+0000 mgr.a (mgr.14373) 18950 : cluster [DBG] pgmap v13144: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:55:28.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:55:27 smithi047 bash[22744]: cluster 2024-09-16T12:55:26.597947+0000 mgr.a (mgr.14373) 18950 : cluster [DBG] pgmap v13144: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:55:30.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:55:29 smithi157 bash[24585]: cluster 2024-09-16T12:55:28.598757+0000 mgr.a (mgr.14373) 18951 : cluster [DBG] pgmap v13145: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:55:30.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:55:29 smithi086 bash[24289]: cluster 2024-09-16T12:55:28.598757+0000 mgr.a (mgr.14373) 18951 : cluster [DBG] pgmap v13145: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:55:30.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:55:29 smithi047 bash[22744]: cluster 2024-09-16T12:55:28.598757+0000 mgr.a (mgr.14373) 18951 : cluster [DBG] pgmap v13145: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:55:30.127 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:55:30.127 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:55:30.128 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:55:30.886 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:55:30.887 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:55:30.887 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:55:30.887 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:55:30.887 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:55:31.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:55:30 smithi157 bash[24585]: audit 2024-09-16T12:55:30.455516+0000 mgr.a (mgr.14373) 18952 : audit [DBG] from='client.406101 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:55:31.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:55:30 smithi086 bash[24289]: audit 2024-09-16T12:55:30.455516+0000 mgr.a (mgr.14373) 18952 : audit [DBG] from='client.406101 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:55:31.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:55:30 smithi047 bash[22744]: audit 2024-09-16T12:55:30.455516+0000 mgr.a (mgr.14373) 18952 : audit [DBG] from='client.406101 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:55:32.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:55:31 smithi157 bash[24585]: cluster 2024-09-16T12:55:30.599703+0000 mgr.a (mgr.14373) 18953 : cluster [DBG] pgmap v13146: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:55:32.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:55:31 smithi086 bash[24289]: cluster 2024-09-16T12:55:30.599703+0000 mgr.a (mgr.14373) 18953 : cluster [DBG] pgmap v13146: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:55:32.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:55:31 smithi047 bash[22744]: cluster 2024-09-16T12:55:30.599703+0000 mgr.a (mgr.14373) 18953 : cluster [DBG] pgmap v13146: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:55:34.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:55:33 smithi157 bash[24585]: cluster 2024-09-16T12:55:32.602084+0000 mgr.a (mgr.14373) 18954 : cluster [DBG] pgmap v13147: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:55:34.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:55:33 smithi086 bash[24289]: cluster 2024-09-16T12:55:32.602084+0000 mgr.a (mgr.14373) 18954 : cluster [DBG] pgmap v13147: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:55:34.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:55:33 smithi047 bash[22744]: cluster 2024-09-16T12:55:32.602084+0000 mgr.a (mgr.14373) 18954 : cluster [DBG] pgmap v13147: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:55:35.887 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:55:35.888 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:55:35.888 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:55:36.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:55:35 smithi157 bash[24585]: cluster 2024-09-16T12:55:34.602893+0000 mgr.a (mgr.14373) 18955 : cluster [DBG] pgmap v13148: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:55:36.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:55:35 smithi086 bash[24289]: cluster 2024-09-16T12:55:34.602893+0000 mgr.a (mgr.14373) 18955 : cluster [DBG] pgmap v13148: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:55:36.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:55:35 smithi047 bash[22744]: cluster 2024-09-16T12:55:34.602893+0000 mgr.a (mgr.14373) 18955 : cluster [DBG] pgmap v13148: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:55:36.677 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:55:36.678 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:55:36.678 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:55:36.678 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:55:36.678 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:55:37.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:55:36 smithi157 bash[24585]: audit 2024-09-16T12:55:36.224105+0000 mgr.a (mgr.14373) 18956 : audit [DBG] from='client.406179 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:55:37.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:55:36 smithi086 bash[24289]: audit 2024-09-16T12:55:36.224105+0000 mgr.a (mgr.14373) 18956 : audit [DBG] from='client.406179 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:55:37.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:55:36 smithi047 bash[22744]: audit 2024-09-16T12:55:36.224105+0000 mgr.a (mgr.14373) 18956 : audit [DBG] from='client.406179 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:55:38.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:55:37 smithi157 bash[24585]: cluster 2024-09-16T12:55:36.604207+0000 mgr.a (mgr.14373) 18957 : cluster [DBG] pgmap v13149: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-16T12:55:38.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:55:37 smithi086 bash[24289]: cluster 2024-09-16T12:55:36.604207+0000 mgr.a (mgr.14373) 18957 : cluster [DBG] pgmap v13149: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-16T12:55:38.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:55:37 smithi047 bash[22744]: cluster 2024-09-16T12:55:36.604207+0000 mgr.a (mgr.14373) 18957 : cluster [DBG] pgmap v13149: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-16T12:55:40.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:55:39 smithi157 bash[24585]: cluster 2024-09-16T12:55:38.605087+0000 mgr.a (mgr.14373) 18958 : cluster [DBG] pgmap v13150: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-16T12:55:40.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:55:39 smithi086 bash[24289]: cluster 2024-09-16T12:55:38.605087+0000 mgr.a (mgr.14373) 18958 : cluster [DBG] pgmap v13150: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-16T12:55:40.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:55:39 smithi047 bash[22744]: cluster 2024-09-16T12:55:38.605087+0000 mgr.a (mgr.14373) 18958 : cluster [DBG] pgmap v13150: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-16T12:55:41.679 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:55:41.680 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:55:41.680 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:55:42.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:55:41 smithi157 bash[24585]: cluster 2024-09-16T12:55:40.606054+0000 mgr.a (mgr.14373) 18959 : cluster [DBG] pgmap v13151: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-16T12:55:42.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:55:41 smithi086 bash[24289]: cluster 2024-09-16T12:55:40.606054+0000 mgr.a (mgr.14373) 18959 : cluster [DBG] pgmap v13151: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-16T12:55:42.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:55:41 smithi047 bash[22744]: cluster 2024-09-16T12:55:40.606054+0000 mgr.a (mgr.14373) 18959 : cluster [DBG] pgmap v13151: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-16T12:55:42.471 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:55:42.472 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:55:42.472 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:55:42.472 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:55:42.472 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:55:43.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:55:42 smithi157 bash[24585]: audit 2024-09-16T12:55:42.013546+0000 mgr.a (mgr.14373) 18960 : audit [DBG] from='client.406254 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:55:43.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:55:42 smithi086 bash[24289]: audit 2024-09-16T12:55:42.013546+0000 mgr.a (mgr.14373) 18960 : audit [DBG] from='client.406254 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:55:43.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:55:42 smithi047 bash[22744]: audit 2024-09-16T12:55:42.013546+0000 mgr.a (mgr.14373) 18960 : audit [DBG] from='client.406254 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:55:44.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:55:43 smithi157 bash[24585]: cluster 2024-09-16T12:55:42.608923+0000 mgr.a (mgr.14373) 18961 : cluster [DBG] pgmap v13152: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:55:44.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:55:43 smithi086 bash[24289]: cluster 2024-09-16T12:55:42.608923+0000 mgr.a (mgr.14373) 18961 : cluster [DBG] pgmap v13152: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:55:44.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:55:43 smithi047 bash[22744]: cluster 2024-09-16T12:55:42.608923+0000 mgr.a (mgr.14373) 18961 : cluster [DBG] pgmap v13152: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:55:46.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:55:45 smithi157 bash[24585]: cluster 2024-09-16T12:55:44.609715+0000 mgr.a (mgr.14373) 18962 : cluster [DBG] pgmap v13153: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:55:46.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:55:45 smithi086 bash[24289]: cluster 2024-09-16T12:55:44.609715+0000 mgr.a (mgr.14373) 18962 : cluster [DBG] pgmap v13153: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:55:46.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:55:45 smithi047 bash[22744]: cluster 2024-09-16T12:55:44.609715+0000 mgr.a (mgr.14373) 18962 : cluster [DBG] pgmap v13153: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:55:47.473 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:55:47.473 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:55:47.474 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:55:48.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:55:47 smithi157 bash[24585]: cluster 2024-09-16T12:55:46.611669+0000 mgr.a (mgr.14373) 18963 : cluster [DBG] pgmap v13154: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:55:48.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:55:47 smithi086 bash[24289]: cluster 2024-09-16T12:55:46.611669+0000 mgr.a (mgr.14373) 18963 : cluster [DBG] pgmap v13154: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:55:48.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:55:47 smithi047 bash[22744]: cluster 2024-09-16T12:55:46.611669+0000 mgr.a (mgr.14373) 18963 : cluster [DBG] pgmap v13154: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:55:48.226 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:55:48.226 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:55:48.226 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:55:48.226 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:55:48.226 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:55:49.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:55:48 smithi157 bash[24585]: audit 2024-09-16T12:55:47.806230+0000 mgr.a (mgr.14373) 18964 : audit [DBG] from='client.406329 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:55:49.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:55:48 smithi086 bash[24289]: audit 2024-09-16T12:55:47.806230+0000 mgr.a (mgr.14373) 18964 : audit [DBG] from='client.406329 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:55:49.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:55:48 smithi047 bash[22744]: audit 2024-09-16T12:55:47.806230+0000 mgr.a (mgr.14373) 18964 : audit [DBG] from='client.406329 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:55:50.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:55:49 smithi157 bash[24585]: cluster 2024-09-16T12:55:48.612627+0000 mgr.a (mgr.14373) 18965 : cluster [DBG] pgmap v13155: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-16T12:55:50.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:55:49 smithi086 bash[24289]: cluster 2024-09-16T12:55:48.612627+0000 mgr.a (mgr.14373) 18965 : cluster [DBG] pgmap v13155: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-16T12:55:50.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:55:49 smithi047 bash[22744]: cluster 2024-09-16T12:55:48.612627+0000 mgr.a (mgr.14373) 18965 : cluster [DBG] pgmap v13155: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-16T12:55:51.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:55:50 smithi157 bash[24585]: audit 2024-09-16T12:55:50.116290+0000 mon.b (mon.2) 1714 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T12:55:51.058 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:55:50 smithi157 bash[24585]: audit 2024-09-16T12:55:50.753348+0000 mon.a (mon.0) 1700 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:55:51.058 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:55:50 smithi157 bash[24585]: audit 2024-09-16T12:55:50.758697+0000 mon.a (mon.0) 1701 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:55:51.058 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:55:50 smithi157 bash[24585]: audit 2024-09-16T12:55:50.766592+0000 mon.a (mon.0) 1702 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:55:51.058 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:55:50 smithi157 bash[24585]: audit 2024-09-16T12:55:50.772946+0000 mon.a (mon.0) 1703 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:55:51.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:55:50 smithi086 bash[24289]: audit 2024-09-16T12:55:50.116290+0000 mon.b (mon.2) 1714 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T12:55:51.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:55:50 smithi086 bash[24289]: audit 2024-09-16T12:55:50.753348+0000 mon.a (mon.0) 1700 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:55:51.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:55:50 smithi086 bash[24289]: audit 2024-09-16T12:55:50.758697+0000 mon.a (mon.0) 1701 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:55:51.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:55:50 smithi086 bash[24289]: audit 2024-09-16T12:55:50.766592+0000 mon.a (mon.0) 1702 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:55:51.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:55:50 smithi086 bash[24289]: audit 2024-09-16T12:55:50.772946+0000 mon.a (mon.0) 1703 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:55:51.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:55:50 smithi047 bash[22744]: audit 2024-09-16T12:55:50.116290+0000 mon.b (mon.2) 1714 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T12:55:51.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:55:50 smithi047 bash[22744]: audit 2024-09-16T12:55:50.753348+0000 mon.a (mon.0) 1700 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:55:51.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:55:50 smithi047 bash[22744]: audit 2024-09-16T12:55:50.758697+0000 mon.a (mon.0) 1701 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:55:51.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:55:50 smithi047 bash[22744]: audit 2024-09-16T12:55:50.766592+0000 mon.a (mon.0) 1702 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:55:51.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:55:50 smithi047 bash[22744]: audit 2024-09-16T12:55:50.772946+0000 mon.a (mon.0) 1703 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:55:52.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:55:51 smithi157 bash[24585]: cluster 2024-09-16T12:55:50.613382+0000 mgr.a (mgr.14373) 18966 : cluster [DBG] pgmap v13156: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-16T12:55:52.058 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:55:51 smithi157 bash[24585]: audit 2024-09-16T12:55:51.464138+0000 mon.b (mon.2) 1715 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T12:55:52.058 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:55:51 smithi157 bash[24585]: audit 2024-09-16T12:55:51.466102+0000 mon.b (mon.2) 1716 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T12:55:52.058 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:55:51 smithi157 bash[24585]: audit 2024-09-16T12:55:51.477169+0000 mon.a (mon.0) 1704 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:55:52.058 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:55:51 smithi157 bash[24585]: audit 2024-09-16T12:55:51.482672+0000 mon.b (mon.2) 1717 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:55:52.058 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:55:51 smithi157 bash[24585]: audit 2024-09-16T12:55:51.484966+0000 mgr.a (mgr.14373) 18967 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:55:52.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:55:51 smithi086 bash[24289]: cluster 2024-09-16T12:55:50.613382+0000 mgr.a (mgr.14373) 18966 : cluster [DBG] pgmap v13156: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-16T12:55:52.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:55:51 smithi086 bash[24289]: audit 2024-09-16T12:55:51.464138+0000 mon.b (mon.2) 1715 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T12:55:52.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:55:51 smithi086 bash[24289]: audit 2024-09-16T12:55:51.466102+0000 mon.b (mon.2) 1716 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T12:55:52.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:55:51 smithi086 bash[24289]: audit 2024-09-16T12:55:51.477169+0000 mon.a (mon.0) 1704 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:55:52.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:55:51 smithi086 bash[24289]: audit 2024-09-16T12:55:51.482672+0000 mon.b (mon.2) 1717 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:55:52.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:55:51 smithi086 bash[24289]: audit 2024-09-16T12:55:51.484966+0000 mgr.a (mgr.14373) 18967 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:55:52.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:55:51 smithi047 bash[22744]: cluster 2024-09-16T12:55:50.613382+0000 mgr.a (mgr.14373) 18966 : cluster [DBG] pgmap v13156: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-16T12:55:52.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:55:51 smithi047 bash[22744]: audit 2024-09-16T12:55:51.464138+0000 mon.b (mon.2) 1715 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T12:55:52.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:55:51 smithi047 bash[22744]: audit 2024-09-16T12:55:51.466102+0000 mon.b (mon.2) 1716 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T12:55:52.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:55:51 smithi047 bash[22744]: audit 2024-09-16T12:55:51.477169+0000 mon.a (mon.0) 1704 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:55:52.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:55:51 smithi047 bash[22744]: audit 2024-09-16T12:55:51.482672+0000 mon.b (mon.2) 1717 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:55:52.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:55:51 smithi047 bash[22744]: audit 2024-09-16T12:55:51.484966+0000 mgr.a (mgr.14373) 18967 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:55:52.593 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 12:55:52 smithi047 bash[22994]: debug 2024-09-16T12:55:52.240+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T12:55:52.593 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 12:55:52 smithi047 bash[22994]: debug 2024-09-16T12:55:52.244+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T12:55:53.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:55:52 smithi157 bash[24585]: audit 2024-09-16T12:55:52.244383+0000 mgr.a (mgr.14373) 18968 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T12:55:53.058 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:55:52 smithi157 bash[24585]: cephadm 2024-09-16T12:55:52.246623+0000 mgr.a (mgr.14373) 18969 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T12:55:53.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:55:52 smithi086 bash[24289]: audit 2024-09-16T12:55:52.244383+0000 mgr.a (mgr.14373) 18968 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T12:55:53.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:55:52 smithi086 bash[24289]: cephadm 2024-09-16T12:55:52.246623+0000 mgr.a (mgr.14373) 18969 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T12:55:53.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:55:52 smithi047 bash[22744]: audit 2024-09-16T12:55:52.244383+0000 mgr.a (mgr.14373) 18968 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T12:55:53.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:55:52 smithi047 bash[22744]: cephadm 2024-09-16T12:55:52.246623+0000 mgr.a (mgr.14373) 18969 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T12:55:53.227 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:55:53.228 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:55:53.228 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:55:53.997 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:55:53.997 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:55:53.998 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:55:53.998 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:55:53.998 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:55:54.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:55:53 smithi157 bash[24585]: cluster 2024-09-16T12:55:52.616214+0000 mgr.a (mgr.14373) 18970 : cluster [DBG] pgmap v13157: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-09-16T12:55:54.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:55:53 smithi086 bash[24289]: cluster 2024-09-16T12:55:52.616214+0000 mgr.a (mgr.14373) 18970 : cluster [DBG] pgmap v13157: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-09-16T12:55:54.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:55:53 smithi047 bash[22744]: cluster 2024-09-16T12:55:52.616214+0000 mgr.a (mgr.14373) 18970 : cluster [DBG] pgmap v13157: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-09-16T12:55:55.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:55:54 smithi157 bash[24585]: audit 2024-09-16T12:55:53.560012+0000 mgr.a (mgr.14373) 18971 : audit [DBG] from='client.406512 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:55:55.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:55:54 smithi086 bash[24289]: audit 2024-09-16T12:55:53.560012+0000 mgr.a (mgr.14373) 18971 : audit [DBG] from='client.406512 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:55:55.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:55:54 smithi047 bash[22744]: audit 2024-09-16T12:55:53.560012+0000 mgr.a (mgr.14373) 18971 : audit [DBG] from='client.406512 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:55:56.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:55:55 smithi157 bash[24585]: cluster 2024-09-16T12:55:54.617390+0000 mgr.a (mgr.14373) 18972 : cluster [DBG] pgmap v13158: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:55:56.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:55:55 smithi086 bash[24289]: cluster 2024-09-16T12:55:54.617390+0000 mgr.a (mgr.14373) 18972 : cluster [DBG] pgmap v13158: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:55:56.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:55:55 smithi047 bash[22744]: cluster 2024-09-16T12:55:54.617390+0000 mgr.a (mgr.14373) 18972 : cluster [DBG] pgmap v13158: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:55:58.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:55:57 smithi086 bash[24289]: cluster 2024-09-16T12:55:56.619764+0000 mgr.a (mgr.14373) 18973 : cluster [DBG] pgmap v13159: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:55:58.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:55:57 smithi047 bash[22744]: cluster 2024-09-16T12:55:56.619764+0000 mgr.a (mgr.14373) 18973 : cluster [DBG] pgmap v13159: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:55:58.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:55:57 smithi157 bash[24585]: cluster 2024-09-16T12:55:56.619764+0000 mgr.a (mgr.14373) 18973 : cluster [DBG] pgmap v13159: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:55:58.999 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:55:58.999 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:55:59.000 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:55:59.758 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:55:59.758 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:55:59.758 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:55:59.758 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:55:59.758 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:56:00.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:55:59 smithi086 bash[24289]: cluster 2024-09-16T12:55:58.620719+0000 mgr.a (mgr.14373) 18974 : cluster [DBG] pgmap v13160: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:56:00.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:55:59 smithi086 bash[24289]: audit 2024-09-16T12:55:59.331564+0000 mgr.a (mgr.14373) 18975 : audit [DBG] from='client.406590 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:56:00.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:55:59 smithi047 bash[22744]: cluster 2024-09-16T12:55:58.620719+0000 mgr.a (mgr.14373) 18974 : cluster [DBG] pgmap v13160: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:56:00.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:55:59 smithi047 bash[22744]: audit 2024-09-16T12:55:59.331564+0000 mgr.a (mgr.14373) 18975 : audit [DBG] from='client.406590 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:56:00.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:55:59 smithi157 bash[24585]: cluster 2024-09-16T12:55:58.620719+0000 mgr.a (mgr.14373) 18974 : cluster [DBG] pgmap v13160: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:56:00.308 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:55:59 smithi157 bash[24585]: audit 2024-09-16T12:55:59.331564+0000 mgr.a (mgr.14373) 18975 : audit [DBG] from='client.406590 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:56:02.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:56:01 smithi086 bash[24289]: cluster 2024-09-16T12:56:00.621758+0000 mgr.a (mgr.14373) 18976 : cluster [DBG] pgmap v13161: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:56:02.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:56:01 smithi047 bash[22744]: cluster 2024-09-16T12:56:00.621758+0000 mgr.a (mgr.14373) 18976 : cluster [DBG] pgmap v13161: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:56:02.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:56:01 smithi157 bash[24585]: cluster 2024-09-16T12:56:00.621758+0000 mgr.a (mgr.14373) 18976 : cluster [DBG] pgmap v13161: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:56:04.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:56:03 smithi047 bash[22744]: cluster 2024-09-16T12:56:02.624046+0000 mgr.a (mgr.14373) 18977 : cluster [DBG] pgmap v13162: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:56:04.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:56:03 smithi157 bash[24585]: cluster 2024-09-16T12:56:02.624046+0000 mgr.a (mgr.14373) 18977 : cluster [DBG] pgmap v13162: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:56:04.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:56:03 smithi086 bash[24289]: cluster 2024-09-16T12:56:02.624046+0000 mgr.a (mgr.14373) 18977 : cluster [DBG] pgmap v13162: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:56:04.759 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:56:04.760 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:56:04.760 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:56:05.520 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:56:05.520 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:56:05.520 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:56:05.520 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:56:05.520 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:56:06.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:56:05 smithi047 bash[22744]: cluster 2024-09-16T12:56:04.624840+0000 mgr.a (mgr.14373) 18978 : cluster [DBG] pgmap v13163: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:56:06.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:56:05 smithi047 bash[22744]: audit 2024-09-16T12:56:05.092765+0000 mgr.a (mgr.14373) 18979 : audit [DBG] from='client.406665 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:56:06.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:56:05 smithi157 bash[24585]: cluster 2024-09-16T12:56:04.624840+0000 mgr.a (mgr.14373) 18978 : cluster [DBG] pgmap v13163: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:56:06.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:56:05 smithi157 bash[24585]: audit 2024-09-16T12:56:05.092765+0000 mgr.a (mgr.14373) 18979 : audit [DBG] from='client.406665 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:56:06.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:56:05 smithi086 bash[24289]: cluster 2024-09-16T12:56:04.624840+0000 mgr.a (mgr.14373) 18978 : cluster [DBG] pgmap v13163: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:56:06.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:56:05 smithi086 bash[24289]: audit 2024-09-16T12:56:05.092765+0000 mgr.a (mgr.14373) 18979 : audit [DBG] from='client.406665 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:56:08.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:56:07 smithi047 bash[22744]: cluster 2024-09-16T12:56:06.627230+0000 mgr.a (mgr.14373) 18980 : cluster [DBG] pgmap v13164: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:56:08.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:56:07 smithi157 bash[24585]: cluster 2024-09-16T12:56:06.627230+0000 mgr.a (mgr.14373) 18980 : cluster [DBG] pgmap v13164: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:56:08.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:56:07 smithi086 bash[24289]: cluster 2024-09-16T12:56:06.627230+0000 mgr.a (mgr.14373) 18980 : cluster [DBG] pgmap v13164: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:56:10.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:56:09 smithi047 bash[22744]: cluster 2024-09-16T12:56:08.628012+0000 mgr.a (mgr.14373) 18981 : cluster [DBG] pgmap v13165: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:56:10.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:56:09 smithi157 bash[24585]: cluster 2024-09-16T12:56:08.628012+0000 mgr.a (mgr.14373) 18981 : cluster [DBG] pgmap v13165: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:56:10.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:56:09 smithi086 bash[24289]: cluster 2024-09-16T12:56:08.628012+0000 mgr.a (mgr.14373) 18981 : cluster [DBG] pgmap v13165: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:56:10.521 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:56:10.522 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:56:10.522 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:56:11.313 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:56:11.313 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:56:11.313 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:56:11.313 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:56:11.313 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:56:12.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:56:11 smithi047 bash[22744]: cluster 2024-09-16T12:56:10.628501+0000 mgr.a (mgr.14373) 18982 : cluster [DBG] pgmap v13166: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:56:12.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:56:11 smithi047 bash[22744]: audit 2024-09-16T12:56:10.857327+0000 mgr.a (mgr.14373) 18983 : audit [DBG] from='client.406737 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:56:12.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:56:11 smithi157 bash[24585]: cluster 2024-09-16T12:56:10.628501+0000 mgr.a (mgr.14373) 18982 : cluster [DBG] pgmap v13166: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:56:12.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:56:11 smithi157 bash[24585]: audit 2024-09-16T12:56:10.857327+0000 mgr.a (mgr.14373) 18983 : audit [DBG] from='client.406737 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:56:12.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:56:11 smithi086 bash[24289]: cluster 2024-09-16T12:56:10.628501+0000 mgr.a (mgr.14373) 18982 : cluster [DBG] pgmap v13166: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:56:12.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:56:11 smithi086 bash[24289]: audit 2024-09-16T12:56:10.857327+0000 mgr.a (mgr.14373) 18983 : audit [DBG] from='client.406737 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:56:14.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:56:13 smithi047 bash[22744]: cluster 2024-09-16T12:56:12.630860+0000 mgr.a (mgr.14373) 18984 : cluster [DBG] pgmap v13167: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:56:14.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:56:13 smithi157 bash[24585]: cluster 2024-09-16T12:56:12.630860+0000 mgr.a (mgr.14373) 18984 : cluster [DBG] pgmap v13167: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:56:14.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:56:13 smithi086 bash[24289]: cluster 2024-09-16T12:56:12.630860+0000 mgr.a (mgr.14373) 18984 : cluster [DBG] pgmap v13167: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:56:16.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:56:15 smithi157 bash[24585]: cluster 2024-09-16T12:56:14.631649+0000 mgr.a (mgr.14373) 18985 : cluster [DBG] pgmap v13168: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:56:16.314 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:56:16.315 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:56:16.315 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:56:16.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:56:15 smithi086 bash[24289]: cluster 2024-09-16T12:56:14.631649+0000 mgr.a (mgr.14373) 18985 : cluster [DBG] pgmap v13168: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:56:16.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:56:15 smithi047 bash[22744]: cluster 2024-09-16T12:56:14.631649+0000 mgr.a (mgr.14373) 18985 : cluster [DBG] pgmap v13168: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:56:17.081 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:56:17.082 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:56:17.082 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:56:17.082 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:56:17.082 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:56:18.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:56:17 smithi157 bash[24585]: cluster 2024-09-16T12:56:16.633580+0000 mgr.a (mgr.14373) 18986 : cluster [DBG] pgmap v13169: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:56:18.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:56:17 smithi157 bash[24585]: audit 2024-09-16T12:56:16.645178+0000 mgr.a (mgr.14373) 18987 : audit [DBG] from='client.406815 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:56:18.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:56:17 smithi086 bash[24289]: cluster 2024-09-16T12:56:16.633580+0000 mgr.a (mgr.14373) 18986 : cluster [DBG] pgmap v13169: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:56:18.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:56:17 smithi086 bash[24289]: audit 2024-09-16T12:56:16.645178+0000 mgr.a (mgr.14373) 18987 : audit [DBG] from='client.406815 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:56:18.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:56:17 smithi047 bash[22744]: cluster 2024-09-16T12:56:16.633580+0000 mgr.a (mgr.14373) 18986 : cluster [DBG] pgmap v13169: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:56:18.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:56:17 smithi047 bash[22744]: audit 2024-09-16T12:56:16.645178+0000 mgr.a (mgr.14373) 18987 : audit [DBG] from='client.406815 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:56:20.308 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:56:19 smithi157 bash[24585]: cluster 2024-09-16T12:56:18.634499+0000 mgr.a (mgr.14373) 18988 : cluster [DBG] pgmap v13170: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:56:20.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:56:19 smithi086 bash[24289]: cluster 2024-09-16T12:56:18.634499+0000 mgr.a (mgr.14373) 18988 : cluster [DBG] pgmap v13170: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:56:20.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:56:19 smithi047 bash[22744]: cluster 2024-09-16T12:56:18.634499+0000 mgr.a (mgr.14373) 18988 : cluster [DBG] pgmap v13170: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:56:22.083 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:56:22.083 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:56:22.084 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:56:22.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:56:21 smithi157 bash[24585]: cluster 2024-09-16T12:56:20.635270+0000 mgr.a (mgr.14373) 18989 : cluster [DBG] pgmap v13171: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T12:56:22.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:56:21 smithi086 bash[24289]: cluster 2024-09-16T12:56:20.635270+0000 mgr.a (mgr.14373) 18989 : cluster [DBG] pgmap v13171: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T12:56:22.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:56:21 smithi047 bash[22744]: cluster 2024-09-16T12:56:20.635270+0000 mgr.a (mgr.14373) 18989 : cluster [DBG] pgmap v13171: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T12:56:22.850 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:56:22.850 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:56:22.850 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:56:22.851 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:56:22.851 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:56:23.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:56:22 smithi157 bash[24585]: audit 2024-09-16T12:56:22.411608+0000 mgr.a (mgr.14373) 18990 : audit [DBG] from='client.406890 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:56:23.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:56:22 smithi086 bash[24289]: audit 2024-09-16T12:56:22.411608+0000 mgr.a (mgr.14373) 18990 : audit [DBG] from='client.406890 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:56:23.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:56:22 smithi047 bash[22744]: audit 2024-09-16T12:56:22.411608+0000 mgr.a (mgr.14373) 18990 : audit [DBG] from='client.406890 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:56:24.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:56:23 smithi157 bash[24585]: cluster 2024-09-16T12:56:22.636475+0000 mgr.a (mgr.14373) 18991 : cluster [DBG] pgmap v13172: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:56:24.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:56:23 smithi086 bash[24289]: cluster 2024-09-16T12:56:22.636475+0000 mgr.a (mgr.14373) 18991 : cluster [DBG] pgmap v13172: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:56:24.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:56:23 smithi047 bash[22744]: cluster 2024-09-16T12:56:22.636475+0000 mgr.a (mgr.14373) 18991 : cluster [DBG] pgmap v13172: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:56:26.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:56:25 smithi157 bash[24585]: cluster 2024-09-16T12:56:24.637343+0000 mgr.a (mgr.14373) 18992 : cluster [DBG] pgmap v13173: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T12:56:26.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:56:25 smithi086 bash[24289]: cluster 2024-09-16T12:56:24.637343+0000 mgr.a (mgr.14373) 18992 : cluster [DBG] pgmap v13173: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T12:56:26.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:56:25 smithi047 bash[22744]: cluster 2024-09-16T12:56:24.637343+0000 mgr.a (mgr.14373) 18992 : cluster [DBG] pgmap v13173: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T12:56:27.852 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:56:27.852 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:56:27.853 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:56:28.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:56:27 smithi157 bash[24585]: cluster 2024-09-16T12:56:26.639591+0000 mgr.a (mgr.14373) 18993 : cluster [DBG] pgmap v13174: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:56:28.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:56:27 smithi086 bash[24289]: cluster 2024-09-16T12:56:26.639591+0000 mgr.a (mgr.14373) 18993 : cluster [DBG] pgmap v13174: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:56:28.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:56:27 smithi047 bash[22744]: cluster 2024-09-16T12:56:26.639591+0000 mgr.a (mgr.14373) 18993 : cluster [DBG] pgmap v13174: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:56:28.630 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:56:28.631 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:56:28.631 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:56:28.631 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:56:28.631 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:56:29.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:56:28 smithi157 bash[24585]: audit 2024-09-16T12:56:28.187747+0000 mgr.a (mgr.14373) 18994 : audit [DBG] from='client.406968 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:56:29.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:56:28 smithi086 bash[24289]: audit 2024-09-16T12:56:28.187747+0000 mgr.a (mgr.14373) 18994 : audit [DBG] from='client.406968 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:56:29.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:56:28 smithi047 bash[22744]: audit 2024-09-16T12:56:28.187747+0000 mgr.a (mgr.14373) 18994 : audit [DBG] from='client.406968 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:56:30.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:56:29 smithi157 bash[24585]: cluster 2024-09-16T12:56:28.640289+0000 mgr.a (mgr.14373) 18995 : cluster [DBG] pgmap v13175: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:56:30.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:56:29 smithi086 bash[24289]: cluster 2024-09-16T12:56:28.640289+0000 mgr.a (mgr.14373) 18995 : cluster [DBG] pgmap v13175: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:56:30.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:56:29 smithi047 bash[22744]: cluster 2024-09-16T12:56:28.640289+0000 mgr.a (mgr.14373) 18995 : cluster [DBG] pgmap v13175: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:56:32.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:56:31 smithi157 bash[24585]: cluster 2024-09-16T12:56:30.641045+0000 mgr.a (mgr.14373) 18996 : cluster [DBG] pgmap v13176: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:56:32.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:56:31 smithi086 bash[24289]: cluster 2024-09-16T12:56:30.641045+0000 mgr.a (mgr.14373) 18996 : cluster [DBG] pgmap v13176: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:56:32.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:56:31 smithi047 bash[22744]: cluster 2024-09-16T12:56:30.641045+0000 mgr.a (mgr.14373) 18996 : cluster [DBG] pgmap v13176: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:56:33.632 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:56:33.633 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:56:33.633 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:56:34.309 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:56:33 smithi157 bash[24585]: cluster 2024-09-16T12:56:32.643465+0000 mgr.a (mgr.14373) 18997 : cluster [DBG] pgmap v13177: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:56:34.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:56:33 smithi086 bash[24289]: cluster 2024-09-16T12:56:32.643465+0000 mgr.a (mgr.14373) 18997 : cluster [DBG] pgmap v13177: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:56:34.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:56:33 smithi047 bash[22744]: cluster 2024-09-16T12:56:32.643465+0000 mgr.a (mgr.14373) 18997 : cluster [DBG] pgmap v13177: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:56:34.403 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:56:34.403 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:56:34.403 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:56:34.403 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:56:34.403 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:56:35.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:56:34 smithi157 bash[24585]: audit 2024-09-16T12:56:33.963328+0000 mgr.a (mgr.14373) 18998 : audit [DBG] from='client.407043 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:56:35.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:56:34 smithi086 bash[24289]: audit 2024-09-16T12:56:33.963328+0000 mgr.a (mgr.14373) 18998 : audit [DBG] from='client.407043 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:56:35.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:56:34 smithi047 bash[22744]: audit 2024-09-16T12:56:33.963328+0000 mgr.a (mgr.14373) 18998 : audit [DBG] from='client.407043 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:56:36.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:56:35 smithi157 bash[24585]: cluster 2024-09-16T12:56:34.644432+0000 mgr.a (mgr.14373) 18999 : cluster [DBG] pgmap v13178: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:56:36.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:56:35 smithi086 bash[24289]: cluster 2024-09-16T12:56:34.644432+0000 mgr.a (mgr.14373) 18999 : cluster [DBG] pgmap v13178: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:56:36.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:56:35 smithi047 bash[22744]: cluster 2024-09-16T12:56:34.644432+0000 mgr.a (mgr.14373) 18999 : cluster [DBG] pgmap v13178: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:56:38.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:56:37 smithi157 bash[24585]: cluster 2024-09-16T12:56:36.646644+0000 mgr.a (mgr.14373) 19000 : cluster [DBG] pgmap v13179: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:56:38.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:56:37 smithi086 bash[24289]: cluster 2024-09-16T12:56:36.646644+0000 mgr.a (mgr.14373) 19000 : cluster [DBG] pgmap v13179: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:56:38.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:56:37 smithi047 bash[22744]: cluster 2024-09-16T12:56:36.646644+0000 mgr.a (mgr.14373) 19000 : cluster [DBG] pgmap v13179: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:56:39.404 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:56:39.405 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:56:39.405 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:56:40.189 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:56:40.189 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:56:40.189 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:56:40.189 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:56:40.189 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:56:40.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:56:39 smithi157 bash[24585]: cluster 2024-09-16T12:56:38.647419+0000 mgr.a (mgr.14373) 19001 : cluster [DBG] pgmap v13180: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:56:40.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:56:39 smithi086 bash[24289]: cluster 2024-09-16T12:56:38.647419+0000 mgr.a (mgr.14373) 19001 : cluster [DBG] pgmap v13180: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:56:40.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:56:39 smithi047 bash[22744]: cluster 2024-09-16T12:56:38.647419+0000 mgr.a (mgr.14373) 19001 : cluster [DBG] pgmap v13180: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:56:41.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:56:40 smithi157 bash[24585]: audit 2024-09-16T12:56:39.738805+0000 mgr.a (mgr.14373) 19002 : audit [DBG] from='client.407118 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:56:41.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:56:40 smithi086 bash[24289]: audit 2024-09-16T12:56:39.738805+0000 mgr.a (mgr.14373) 19002 : audit [DBG] from='client.407118 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:56:41.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:56:40 smithi047 bash[22744]: audit 2024-09-16T12:56:39.738805+0000 mgr.a (mgr.14373) 19002 : audit [DBG] from='client.407118 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:56:42.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:56:41 smithi157 bash[24585]: cluster 2024-09-16T12:56:40.648404+0000 mgr.a (mgr.14373) 19003 : cluster [DBG] pgmap v13181: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:56:42.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:56:41 smithi086 bash[24289]: cluster 2024-09-16T12:56:40.648404+0000 mgr.a (mgr.14373) 19003 : cluster [DBG] pgmap v13181: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:56:42.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:56:41 smithi047 bash[22744]: cluster 2024-09-16T12:56:40.648404+0000 mgr.a (mgr.14373) 19003 : cluster [DBG] pgmap v13181: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:56:44.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:56:43 smithi157 bash[24585]: cluster 2024-09-16T12:56:42.650671+0000 mgr.a (mgr.14373) 19004 : cluster [DBG] pgmap v13182: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:56:44.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:56:43 smithi086 bash[24289]: cluster 2024-09-16T12:56:42.650671+0000 mgr.a (mgr.14373) 19004 : cluster [DBG] pgmap v13182: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:56:44.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:56:43 smithi047 bash[22744]: cluster 2024-09-16T12:56:42.650671+0000 mgr.a (mgr.14373) 19004 : cluster [DBG] pgmap v13182: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:56:45.191 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:56:45.191 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:56:45.191 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:56:45.976 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:56:45.976 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:56:45.976 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:56:45.976 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:56:45.976 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:56:46.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:56:45 smithi157 bash[24585]: cluster 2024-09-16T12:56:44.651430+0000 mgr.a (mgr.14373) 19005 : cluster [DBG] pgmap v13183: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:56:46.308 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:56:45 smithi157 bash[24585]: audit 2024-09-16T12:56:45.523402+0000 mgr.a (mgr.14373) 19006 : audit [DBG] from='client.407196 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:56:46.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:56:45 smithi086 bash[24289]: cluster 2024-09-16T12:56:44.651430+0000 mgr.a (mgr.14373) 19005 : cluster [DBG] pgmap v13183: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:56:46.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:56:45 smithi086 bash[24289]: audit 2024-09-16T12:56:45.523402+0000 mgr.a (mgr.14373) 19006 : audit [DBG] from='client.407196 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:56:46.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:56:45 smithi047 bash[22744]: cluster 2024-09-16T12:56:44.651430+0000 mgr.a (mgr.14373) 19005 : cluster [DBG] pgmap v13183: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:56:46.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:56:45 smithi047 bash[22744]: audit 2024-09-16T12:56:45.523402+0000 mgr.a (mgr.14373) 19006 : audit [DBG] from='client.407196 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:56:48.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:56:47 smithi157 bash[24585]: cluster 2024-09-16T12:56:46.653804+0000 mgr.a (mgr.14373) 19007 : cluster [DBG] pgmap v13184: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:56:48.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:56:47 smithi086 bash[24289]: cluster 2024-09-16T12:56:46.653804+0000 mgr.a (mgr.14373) 19007 : cluster [DBG] pgmap v13184: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:56:48.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:56:47 smithi047 bash[22744]: cluster 2024-09-16T12:56:46.653804+0000 mgr.a (mgr.14373) 19007 : cluster [DBG] pgmap v13184: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:56:50.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:56:49 smithi157 bash[24585]: cluster 2024-09-16T12:56:48.654614+0000 mgr.a (mgr.14373) 19008 : cluster [DBG] pgmap v13185: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:56:50.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:56:49 smithi086 bash[24289]: cluster 2024-09-16T12:56:48.654614+0000 mgr.a (mgr.14373) 19008 : cluster [DBG] pgmap v13185: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:56:50.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:56:49 smithi047 bash[22744]: cluster 2024-09-16T12:56:48.654614+0000 mgr.a (mgr.14373) 19008 : cluster [DBG] pgmap v13185: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:56:50.977 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:56:50.978 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:56:50.978 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:56:51.736 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:56:51.736 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:56:51.736 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:56:51.736 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:56:51.736 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:56:52.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:56:51 smithi157 bash[24585]: cluster 2024-09-16T12:56:50.655360+0000 mgr.a (mgr.14373) 19009 : cluster [DBG] pgmap v13186: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:56:52.308 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:56:51 smithi157 bash[24585]: audit 2024-09-16T12:56:51.300006+0000 mgr.a (mgr.14373) 19010 : audit [DBG] from='client.407271 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:56:52.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:56:51 smithi086 bash[24289]: cluster 2024-09-16T12:56:50.655360+0000 mgr.a (mgr.14373) 19009 : cluster [DBG] pgmap v13186: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:56:52.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:56:51 smithi086 bash[24289]: audit 2024-09-16T12:56:51.300006+0000 mgr.a (mgr.14373) 19010 : audit [DBG] from='client.407271 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:56:52.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:56:51 smithi047 bash[22744]: cluster 2024-09-16T12:56:50.655360+0000 mgr.a (mgr.14373) 19009 : cluster [DBG] pgmap v13186: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:56:52.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:56:51 smithi047 bash[22744]: audit 2024-09-16T12:56:51.300006+0000 mgr.a (mgr.14373) 19010 : audit [DBG] from='client.407271 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:56:53.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:56:52 smithi157 bash[24585]: audit 2024-09-16T12:56:52.300140+0000 mon.b (mon.2) 1718 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T12:56:53.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:56:52 smithi086 bash[24289]: audit 2024-09-16T12:56:52.300140+0000 mon.b (mon.2) 1718 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T12:56:53.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:56:52 smithi047 bash[22744]: audit 2024-09-16T12:56:52.300140+0000 mon.b (mon.2) 1718 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T12:56:54.308 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:56:53 smithi157 bash[24585]: cluster 2024-09-16T12:56:52.656928+0000 mgr.a (mgr.14373) 19011 : cluster [DBG] pgmap v13187: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:56:54.308 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:56:53 smithi157 bash[24585]: audit 2024-09-16T12:56:53.132535+0000 mon.b (mon.2) 1719 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T12:56:54.308 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:56:53 smithi157 bash[24585]: audit 2024-09-16T12:56:53.134827+0000 mon.b (mon.2) 1720 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T12:56:54.308 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:56:53 smithi157 bash[24585]: audit 2024-09-16T12:56:53.146874+0000 mon.a (mon.0) 1705 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:56:54.308 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:56:53 smithi157 bash[24585]: audit 2024-09-16T12:56:53.152215+0000 mon.b (mon.2) 1721 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:56:54.308 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:56:53 smithi157 bash[24585]: audit 2024-09-16T12:56:53.154735+0000 mgr.a (mgr.14373) 19012 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:56:54.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:56:53 smithi086 bash[24289]: cluster 2024-09-16T12:56:52.656928+0000 mgr.a (mgr.14373) 19011 : cluster [DBG] pgmap v13187: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:56:54.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:56:53 smithi086 bash[24289]: audit 2024-09-16T12:56:53.132535+0000 mon.b (mon.2) 1719 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T12:56:54.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:56:53 smithi086 bash[24289]: audit 2024-09-16T12:56:53.134827+0000 mon.b (mon.2) 1720 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T12:56:54.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:56:53 smithi086 bash[24289]: audit 2024-09-16T12:56:53.146874+0000 mon.a (mon.0) 1705 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:56:54.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:56:53 smithi086 bash[24289]: audit 2024-09-16T12:56:53.152215+0000 mon.b (mon.2) 1721 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:56:54.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:56:53 smithi086 bash[24289]: audit 2024-09-16T12:56:53.154735+0000 mgr.a (mgr.14373) 19012 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:56:54.343 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 12:56:53 smithi047 bash[22994]: debug 2024-09-16T12:56:53.915+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T12:56:54.343 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 12:56:53 smithi047 bash[22994]: debug 2024-09-16T12:56:53.919+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T12:56:54.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:56:53 smithi047 bash[22744]: cluster 2024-09-16T12:56:52.656928+0000 mgr.a (mgr.14373) 19011 : cluster [DBG] pgmap v13187: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:56:54.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:56:53 smithi047 bash[22744]: audit 2024-09-16T12:56:53.132535+0000 mon.b (mon.2) 1719 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T12:56:54.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:56:53 smithi047 bash[22744]: audit 2024-09-16T12:56:53.134827+0000 mon.b (mon.2) 1720 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T12:56:54.344 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:56:53 smithi047 bash[22744]: audit 2024-09-16T12:56:53.146874+0000 mon.a (mon.0) 1705 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:56:54.344 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:56:53 smithi047 bash[22744]: audit 2024-09-16T12:56:53.152215+0000 mon.b (mon.2) 1721 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:56:54.344 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:56:53 smithi047 bash[22744]: audit 2024-09-16T12:56:53.154735+0000 mgr.a (mgr.14373) 19012 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:56:55.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:56:54 smithi157 bash[24585]: audit 2024-09-16T12:56:53.921564+0000 mgr.a (mgr.14373) 19013 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T12:56:55.308 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:56:54 smithi157 bash[24585]: cephadm 2024-09-16T12:56:53.924128+0000 mgr.a (mgr.14373) 19014 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T12:56:55.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:56:54 smithi086 bash[24289]: audit 2024-09-16T12:56:53.921564+0000 mgr.a (mgr.14373) 19013 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T12:56:55.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:56:54 smithi086 bash[24289]: cephadm 2024-09-16T12:56:53.924128+0000 mgr.a (mgr.14373) 19014 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T12:56:55.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:56:54 smithi047 bash[22744]: audit 2024-09-16T12:56:53.921564+0000 mgr.a (mgr.14373) 19013 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T12:56:55.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:56:54 smithi047 bash[22744]: cephadm 2024-09-16T12:56:53.924128+0000 mgr.a (mgr.14373) 19014 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T12:56:56.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:56:55 smithi157 bash[24585]: cluster 2024-09-16T12:56:54.657900+0000 mgr.a (mgr.14373) 19015 : cluster [DBG] pgmap v13188: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:56:56.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:56:55 smithi086 bash[24289]: cluster 2024-09-16T12:56:54.657900+0000 mgr.a (mgr.14373) 19015 : cluster [DBG] pgmap v13188: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:56:56.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:56:55 smithi047 bash[22744]: cluster 2024-09-16T12:56:54.657900+0000 mgr.a (mgr.14373) 19015 : cluster [DBG] pgmap v13188: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:56:56.737 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:56:56.738 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:56:56.738 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:56:57.518 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:56:57.518 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:56:57.518 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:56:57.518 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:56:57.518 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:56:58.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:56:57 smithi157 bash[24585]: cluster 2024-09-16T12:56:56.660086+0000 mgr.a (mgr.14373) 19016 : cluster [DBG] pgmap v13189: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:56:58.308 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:56:57 smithi157 bash[24585]: audit 2024-09-16T12:56:57.074475+0000 mgr.a (mgr.14373) 19017 : audit [DBG] from='client.407454 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:56:58.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:56:57 smithi086 bash[24289]: cluster 2024-09-16T12:56:56.660086+0000 mgr.a (mgr.14373) 19016 : cluster [DBG] pgmap v13189: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:56:58.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:56:57 smithi086 bash[24289]: audit 2024-09-16T12:56:57.074475+0000 mgr.a (mgr.14373) 19017 : audit [DBG] from='client.407454 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:56:58.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:56:57 smithi047 bash[22744]: cluster 2024-09-16T12:56:56.660086+0000 mgr.a (mgr.14373) 19016 : cluster [DBG] pgmap v13189: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:56:58.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:56:57 smithi047 bash[22744]: audit 2024-09-16T12:56:57.074475+0000 mgr.a (mgr.14373) 19017 : audit [DBG] from='client.407454 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:57:00.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:56:59 smithi157 bash[24585]: cluster 2024-09-16T12:56:58.660983+0000 mgr.a (mgr.14373) 19018 : cluster [DBG] pgmap v13190: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T12:57:00.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:56:59 smithi086 bash[24289]: cluster 2024-09-16T12:56:58.660983+0000 mgr.a (mgr.14373) 19018 : cluster [DBG] pgmap v13190: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T12:57:00.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:56:59 smithi047 bash[22744]: cluster 2024-09-16T12:56:58.660983+0000 mgr.a (mgr.14373) 19018 : cluster [DBG] pgmap v13190: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T12:57:02.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:57:01 smithi157 bash[24585]: cluster 2024-09-16T12:57:00.661775+0000 mgr.a (mgr.14373) 19019 : cluster [DBG] pgmap v13191: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T12:57:02.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:57:01 smithi086 bash[24289]: cluster 2024-09-16T12:57:00.661775+0000 mgr.a (mgr.14373) 19019 : cluster [DBG] pgmap v13191: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T12:57:02.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:57:01 smithi047 bash[22744]: cluster 2024-09-16T12:57:00.661775+0000 mgr.a (mgr.14373) 19019 : cluster [DBG] pgmap v13191: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T12:57:02.519 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:57:02.520 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:57:02.520 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:57:03.284 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:57:03.284 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:57:03.284 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:57:03.284 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:57:03.285 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:57:04.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:57:03 smithi157 bash[24585]: cluster 2024-09-16T12:57:02.662872+0000 mgr.a (mgr.14373) 19020 : cluster [DBG] pgmap v13192: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:57:04.308 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:57:03 smithi157 bash[24585]: audit 2024-09-16T12:57:02.846987+0000 mgr.a (mgr.14373) 19021 : audit [DBG] from='client.407529 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:57:04.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:57:03 smithi086 bash[24289]: cluster 2024-09-16T12:57:02.662872+0000 mgr.a (mgr.14373) 19020 : cluster [DBG] pgmap v13192: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:57:04.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:57:03 smithi086 bash[24289]: audit 2024-09-16T12:57:02.846987+0000 mgr.a (mgr.14373) 19021 : audit [DBG] from='client.407529 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:57:04.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:57:03 smithi047 bash[22744]: cluster 2024-09-16T12:57:02.662872+0000 mgr.a (mgr.14373) 19020 : cluster [DBG] pgmap v13192: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:57:04.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:57:03 smithi047 bash[22744]: audit 2024-09-16T12:57:02.846987+0000 mgr.a (mgr.14373) 19021 : audit [DBG] from='client.407529 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:57:06.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:57:05 smithi157 bash[24585]: cluster 2024-09-16T12:57:04.663733+0000 mgr.a (mgr.14373) 19022 : cluster [DBG] pgmap v13193: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:57:06.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:57:05 smithi086 bash[24289]: cluster 2024-09-16T12:57:04.663733+0000 mgr.a (mgr.14373) 19022 : cluster [DBG] pgmap v13193: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:57:06.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:57:05 smithi047 bash[22744]: cluster 2024-09-16T12:57:04.663733+0000 mgr.a (mgr.14373) 19022 : cluster [DBG] pgmap v13193: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:57:08.285 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:57:08.286 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:57:08.286 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:57:08.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:57:07 smithi157 bash[24585]: cluster 2024-09-16T12:57:06.665920+0000 mgr.a (mgr.14373) 19023 : cluster [DBG] pgmap v13194: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:57:08.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:57:07 smithi086 bash[24289]: cluster 2024-09-16T12:57:06.665920+0000 mgr.a (mgr.14373) 19023 : cluster [DBG] pgmap v13194: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:57:08.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:57:07 smithi047 bash[22744]: cluster 2024-09-16T12:57:06.665920+0000 mgr.a (mgr.14373) 19023 : cluster [DBG] pgmap v13194: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:57:09.043 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:57:09.043 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:57:09.043 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:57:09.043 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:57:09.043 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:57:10.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:57:09 smithi157 bash[24585]: audit 2024-09-16T12:57:08.617415+0000 mgr.a (mgr.14373) 19024 : audit [DBG] from='client.407607 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:57:10.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:57:09 smithi157 bash[24585]: cluster 2024-09-16T12:57:08.666681+0000 mgr.a (mgr.14373) 19025 : cluster [DBG] pgmap v13195: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:57:10.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:57:09 smithi086 bash[24289]: audit 2024-09-16T12:57:08.617415+0000 mgr.a (mgr.14373) 19024 : audit [DBG] from='client.407607 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:57:10.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:57:09 smithi086 bash[24289]: cluster 2024-09-16T12:57:08.666681+0000 mgr.a (mgr.14373) 19025 : cluster [DBG] pgmap v13195: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:57:10.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:57:09 smithi047 bash[22744]: audit 2024-09-16T12:57:08.617415+0000 mgr.a (mgr.14373) 19024 : audit [DBG] from='client.407607 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:57:10.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:57:09 smithi047 bash[22744]: cluster 2024-09-16T12:57:08.666681+0000 mgr.a (mgr.14373) 19025 : cluster [DBG] pgmap v13195: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:57:12.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:57:11 smithi157 bash[24585]: cluster 2024-09-16T12:57:10.667589+0000 mgr.a (mgr.14373) 19026 : cluster [DBG] pgmap v13196: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:57:12.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:57:11 smithi086 bash[24289]: cluster 2024-09-16T12:57:10.667589+0000 mgr.a (mgr.14373) 19026 : cluster [DBG] pgmap v13196: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:57:12.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:57:11 smithi047 bash[22744]: cluster 2024-09-16T12:57:10.667589+0000 mgr.a (mgr.14373) 19026 : cluster [DBG] pgmap v13196: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:57:14.044 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:57:14.045 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:57:14.045 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:57:14.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:57:14 smithi157 bash[24585]: cluster 2024-09-16T12:57:12.669857+0000 mgr.a (mgr.14373) 19027 : cluster [DBG] pgmap v13197: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:57:14.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:57:14 smithi086 bash[24289]: cluster 2024-09-16T12:57:12.669857+0000 mgr.a (mgr.14373) 19027 : cluster [DBG] pgmap v13197: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:57:14.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:57:14 smithi047 bash[22744]: cluster 2024-09-16T12:57:12.669857+0000 mgr.a (mgr.14373) 19027 : cluster [DBG] pgmap v13197: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:57:14.819 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:57:14.819 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:57:14.820 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:57:14.820 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:57:14.820 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:57:15.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:57:15 smithi157 bash[24585]: audit 2024-09-16T12:57:14.376050+0000 mgr.a (mgr.14373) 19028 : audit [DBG] from='client.407685 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:57:15.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:57:15 smithi086 bash[24289]: audit 2024-09-16T12:57:14.376050+0000 mgr.a (mgr.14373) 19028 : audit [DBG] from='client.407685 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:57:15.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:57:15 smithi047 bash[22744]: audit 2024-09-16T12:57:14.376050+0000 mgr.a (mgr.14373) 19028 : audit [DBG] from='client.407685 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:57:16.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:57:16 smithi157 bash[24585]: cluster 2024-09-16T12:57:14.670505+0000 mgr.a (mgr.14373) 19029 : cluster [DBG] pgmap v13198: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:57:16.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:57:16 smithi086 bash[24289]: cluster 2024-09-16T12:57:14.670505+0000 mgr.a (mgr.14373) 19029 : cluster [DBG] pgmap v13198: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:57:16.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:57:16 smithi047 bash[22744]: cluster 2024-09-16T12:57:14.670505+0000 mgr.a (mgr.14373) 19029 : cluster [DBG] pgmap v13198: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:57:18.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:57:18 smithi157 bash[24585]: cluster 2024-09-16T12:57:16.672732+0000 mgr.a (mgr.14373) 19030 : cluster [DBG] pgmap v13199: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:57:18.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:57:18 smithi086 bash[24289]: cluster 2024-09-16T12:57:16.672732+0000 mgr.a (mgr.14373) 19030 : cluster [DBG] pgmap v13199: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:57:18.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:57:18 smithi047 bash[22744]: cluster 2024-09-16T12:57:16.672732+0000 mgr.a (mgr.14373) 19030 : cluster [DBG] pgmap v13199: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:57:19.821 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:57:19.822 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:57:19.822 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:57:20.313 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:57:20 smithi157 bash[24585]: cluster 2024-09-16T12:57:18.673527+0000 mgr.a (mgr.14373) 19031 : cluster [DBG] pgmap v13200: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:57:20.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:57:20 smithi086 bash[24289]: cluster 2024-09-16T12:57:18.673527+0000 mgr.a (mgr.14373) 19031 : cluster [DBG] pgmap v13200: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:57:20.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:57:20 smithi047 bash[22744]: cluster 2024-09-16T12:57:18.673527+0000 mgr.a (mgr.14373) 19031 : cluster [DBG] pgmap v13200: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:57:20.609 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:57:20.610 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:57:20.610 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:57:20.610 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:57:20.610 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:57:21.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:57:21 smithi157 bash[24585]: audit 2024-09-16T12:57:20.158105+0000 mgr.a (mgr.14373) 19032 : audit [DBG] from='client.407760 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:57:21.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:57:21 smithi086 bash[24289]: audit 2024-09-16T12:57:20.158105+0000 mgr.a (mgr.14373) 19032 : audit [DBG] from='client.407760 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:57:21.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:57:21 smithi047 bash[22744]: audit 2024-09-16T12:57:20.158105+0000 mgr.a (mgr.14373) 19032 : audit [DBG] from='client.407760 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:57:22.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:57:22 smithi157 bash[24585]: cluster 2024-09-16T12:57:20.674538+0000 mgr.a (mgr.14373) 19033 : cluster [DBG] pgmap v13201: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:57:22.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:57:22 smithi086 bash[24289]: cluster 2024-09-16T12:57:20.674538+0000 mgr.a (mgr.14373) 19033 : cluster [DBG] pgmap v13201: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:57:22.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:57:22 smithi047 bash[22744]: cluster 2024-09-16T12:57:20.674538+0000 mgr.a (mgr.14373) 19033 : cluster [DBG] pgmap v13201: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:57:24.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:57:24 smithi157 bash[24585]: cluster 2024-09-16T12:57:22.676893+0000 mgr.a (mgr.14373) 19034 : cluster [DBG] pgmap v13202: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:57:24.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:57:24 smithi086 bash[24289]: cluster 2024-09-16T12:57:22.676893+0000 mgr.a (mgr.14373) 19034 : cluster [DBG] pgmap v13202: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:57:24.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:57:24 smithi047 bash[22744]: cluster 2024-09-16T12:57:22.676893+0000 mgr.a (mgr.14373) 19034 : cluster [DBG] pgmap v13202: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:57:25.611 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:57:25.612 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:57:25.612 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:57:26.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:57:26 smithi157 bash[24585]: cluster 2024-09-16T12:57:24.677843+0000 mgr.a (mgr.14373) 19035 : cluster [DBG] pgmap v13203: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:57:26.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:57:26 smithi086 bash[24289]: cluster 2024-09-16T12:57:24.677843+0000 mgr.a (mgr.14373) 19035 : cluster [DBG] pgmap v13203: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:57:26.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:57:26 smithi047 bash[22744]: cluster 2024-09-16T12:57:24.677843+0000 mgr.a (mgr.14373) 19035 : cluster [DBG] pgmap v13203: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:57:26.397 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:57:26.398 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:57:26.398 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:57:26.398 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:57:26.398 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:57:27.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:57:27 smithi157 bash[24585]: audit 2024-09-16T12:57:25.944138+0000 mgr.a (mgr.14373) 19036 : audit [DBG] from='client.407838 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:57:27.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:57:27 smithi086 bash[24289]: audit 2024-09-16T12:57:25.944138+0000 mgr.a (mgr.14373) 19036 : audit [DBG] from='client.407838 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:57:27.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:57:27 smithi047 bash[22744]: audit 2024-09-16T12:57:25.944138+0000 mgr.a (mgr.14373) 19036 : audit [DBG] from='client.407838 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:57:28.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:57:28 smithi157 bash[24585]: cluster 2024-09-16T12:57:26.680232+0000 mgr.a (mgr.14373) 19037 : cluster [DBG] pgmap v13204: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:57:28.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:57:28 smithi086 bash[24289]: cluster 2024-09-16T12:57:26.680232+0000 mgr.a (mgr.14373) 19037 : cluster [DBG] pgmap v13204: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:57:28.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:57:28 smithi047 bash[22744]: cluster 2024-09-16T12:57:26.680232+0000 mgr.a (mgr.14373) 19037 : cluster [DBG] pgmap v13204: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:57:30.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:57:30 smithi086 bash[24289]: cluster 2024-09-16T12:57:28.681008+0000 mgr.a (mgr.14373) 19038 : cluster [DBG] pgmap v13205: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:57:30.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:57:30 smithi047 bash[22744]: cluster 2024-09-16T12:57:28.681008+0000 mgr.a (mgr.14373) 19038 : cluster [DBG] pgmap v13205: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:57:30.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:57:30 smithi157 bash[24585]: cluster 2024-09-16T12:57:28.681008+0000 mgr.a (mgr.14373) 19038 : cluster [DBG] pgmap v13205: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:57:31.399 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:57:31.400 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:57:31.400 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:57:32.177 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:57:32.177 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:57:32.177 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:57:32.177 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:57:32.177 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:57:32.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:57:32 smithi086 bash[24289]: cluster 2024-09-16T12:57:30.681760+0000 mgr.a (mgr.14373) 19039 : cluster [DBG] pgmap v13206: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:57:32.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:57:32 smithi047 bash[22744]: cluster 2024-09-16T12:57:30.681760+0000 mgr.a (mgr.14373) 19039 : cluster [DBG] pgmap v13206: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:57:32.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:57:32 smithi157 bash[24585]: cluster 2024-09-16T12:57:30.681760+0000 mgr.a (mgr.14373) 19039 : cluster [DBG] pgmap v13206: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:57:33.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:57:33 smithi047 bash[22744]: audit 2024-09-16T12:57:31.733317+0000 mgr.a (mgr.14373) 19040 : audit [DBG] from='client.407916 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:57:33.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:57:33 smithi157 bash[24585]: audit 2024-09-16T12:57:31.733317+0000 mgr.a (mgr.14373) 19040 : audit [DBG] from='client.407916 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:57:33.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:57:33 smithi086 bash[24289]: audit 2024-09-16T12:57:31.733317+0000 mgr.a (mgr.14373) 19040 : audit [DBG] from='client.407916 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:57:34.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:57:34 smithi047 bash[22744]: cluster 2024-09-16T12:57:32.684498+0000 mgr.a (mgr.14373) 19041 : cluster [DBG] pgmap v13207: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:57:34.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:57:34 smithi157 bash[24585]: cluster 2024-09-16T12:57:32.684498+0000 mgr.a (mgr.14373) 19041 : cluster [DBG] pgmap v13207: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:57:34.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:57:34 smithi086 bash[24289]: cluster 2024-09-16T12:57:32.684498+0000 mgr.a (mgr.14373) 19041 : cluster [DBG] pgmap v13207: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:57:36.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:57:36 smithi047 bash[22744]: cluster 2024-09-16T12:57:34.685314+0000 mgr.a (mgr.14373) 19042 : cluster [DBG] pgmap v13208: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:57:36.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:57:36 smithi157 bash[24585]: cluster 2024-09-16T12:57:34.685314+0000 mgr.a (mgr.14373) 19042 : cluster [DBG] pgmap v13208: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:57:36.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:57:36 smithi086 bash[24289]: cluster 2024-09-16T12:57:34.685314+0000 mgr.a (mgr.14373) 19042 : cluster [DBG] pgmap v13208: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:57:37.178 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:57:37.179 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:57:37.179 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:57:37.972 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:57:37.972 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:57:37.972 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:57:37.972 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:57:37.972 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:57:38.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:57:38 smithi047 bash[22744]: cluster 2024-09-16T12:57:36.687296+0000 mgr.a (mgr.14373) 19043 : cluster [DBG] pgmap v13209: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:57:38.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:57:38 smithi047 bash[22744]: audit 2024-09-16T12:57:37.517390+0000 mgr.a (mgr.14373) 19044 : audit [DBG] from='client.407991 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:57:38.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:57:38 smithi157 bash[24585]: cluster 2024-09-16T12:57:36.687296+0000 mgr.a (mgr.14373) 19043 : cluster [DBG] pgmap v13209: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:57:38.558 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:57:38 smithi157 bash[24585]: audit 2024-09-16T12:57:37.517390+0000 mgr.a (mgr.14373) 19044 : audit [DBG] from='client.407991 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:57:38.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:57:38 smithi086 bash[24289]: cluster 2024-09-16T12:57:36.687296+0000 mgr.a (mgr.14373) 19043 : cluster [DBG] pgmap v13209: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:57:38.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:57:38 smithi086 bash[24289]: audit 2024-09-16T12:57:37.517390+0000 mgr.a (mgr.14373) 19044 : audit [DBG] from='client.407991 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:57:40.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:57:40 smithi047 bash[22744]: cluster 2024-09-16T12:57:38.688192+0000 mgr.a (mgr.14373) 19045 : cluster [DBG] pgmap v13210: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:57:40.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:57:40 smithi157 bash[24585]: cluster 2024-09-16T12:57:38.688192+0000 mgr.a (mgr.14373) 19045 : cluster [DBG] pgmap v13210: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:57:40.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:57:40 smithi086 bash[24289]: cluster 2024-09-16T12:57:38.688192+0000 mgr.a (mgr.14373) 19045 : cluster [DBG] pgmap v13210: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:57:42.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:57:42 smithi047 bash[22744]: cluster 2024-09-16T12:57:40.688982+0000 mgr.a (mgr.14373) 19046 : cluster [DBG] pgmap v13211: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T12:57:42.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:57:42 smithi157 bash[24585]: cluster 2024-09-16T12:57:40.688982+0000 mgr.a (mgr.14373) 19046 : cluster [DBG] pgmap v13211: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T12:57:42.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:57:42 smithi086 bash[24289]: cluster 2024-09-16T12:57:40.688982+0000 mgr.a (mgr.14373) 19046 : cluster [DBG] pgmap v13211: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T12:57:42.973 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:57:42.974 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:57:42.974 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:57:43.742 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:57:43.743 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:57:43.743 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:57:43.743 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:57:43.743 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:57:44.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:57:44 smithi157 bash[24585]: cluster 2024-09-16T12:57:42.691211+0000 mgr.a (mgr.14373) 19047 : cluster [DBG] pgmap v13212: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:57:44.558 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:57:44 smithi157 bash[24585]: audit 2024-09-16T12:57:43.310767+0000 mgr.a (mgr.14373) 19048 : audit [DBG] from='client.408069 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:57:44.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:57:44 smithi086 bash[24289]: cluster 2024-09-16T12:57:42.691211+0000 mgr.a (mgr.14373) 19047 : cluster [DBG] pgmap v13212: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:57:44.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:57:44 smithi086 bash[24289]: audit 2024-09-16T12:57:43.310767+0000 mgr.a (mgr.14373) 19048 : audit [DBG] from='client.408069 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:57:44.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:57:44 smithi047 bash[22744]: cluster 2024-09-16T12:57:42.691211+0000 mgr.a (mgr.14373) 19047 : cluster [DBG] pgmap v13212: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:57:44.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:57:44 smithi047 bash[22744]: audit 2024-09-16T12:57:43.310767+0000 mgr.a (mgr.14373) 19048 : audit [DBG] from='client.408069 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:57:46.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:57:46 smithi157 bash[24585]: cluster 2024-09-16T12:57:44.692081+0000 mgr.a (mgr.14373) 19049 : cluster [DBG] pgmap v13213: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:57:46.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:57:46 smithi086 bash[24289]: cluster 2024-09-16T12:57:44.692081+0000 mgr.a (mgr.14373) 19049 : cluster [DBG] pgmap v13213: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:57:46.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:57:46 smithi047 bash[22744]: cluster 2024-09-16T12:57:44.692081+0000 mgr.a (mgr.14373) 19049 : cluster [DBG] pgmap v13213: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:57:48.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:57:48 smithi157 bash[24585]: cluster 2024-09-16T12:57:46.694245+0000 mgr.a (mgr.14373) 19050 : cluster [DBG] pgmap v13214: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:57:48.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:57:48 smithi086 bash[24289]: cluster 2024-09-16T12:57:46.694245+0000 mgr.a (mgr.14373) 19050 : cluster [DBG] pgmap v13214: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:57:48.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:57:48 smithi047 bash[22744]: cluster 2024-09-16T12:57:46.694245+0000 mgr.a (mgr.14373) 19050 : cluster [DBG] pgmap v13214: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:57:48.744 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:57:48.744 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:57:48.745 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:57:49.489 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:57:49.489 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:57:49.489 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:57:49.489 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:57:49.489 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:57:50.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:57:50 smithi157 bash[24585]: cluster 2024-09-16T12:57:48.695048+0000 mgr.a (mgr.14373) 19051 : cluster [DBG] pgmap v13215: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:57:50.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:57:50 smithi157 bash[24585]: audit 2024-09-16T12:57:49.069159+0000 mgr.a (mgr.14373) 19052 : audit [DBG] from='client.408144 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:57:50.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:57:50 smithi086 bash[24289]: cluster 2024-09-16T12:57:48.695048+0000 mgr.a (mgr.14373) 19051 : cluster [DBG] pgmap v13215: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:57:50.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:57:50 smithi086 bash[24289]: audit 2024-09-16T12:57:49.069159+0000 mgr.a (mgr.14373) 19052 : audit [DBG] from='client.408144 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:57:50.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:57:50 smithi047 bash[22744]: cluster 2024-09-16T12:57:48.695048+0000 mgr.a (mgr.14373) 19051 : cluster [DBG] pgmap v13215: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:57:50.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:57:50 smithi047 bash[22744]: audit 2024-09-16T12:57:49.069159+0000 mgr.a (mgr.14373) 19052 : audit [DBG] from='client.408144 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:57:52.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:57:52 smithi157 bash[24585]: cluster 2024-09-16T12:57:50.695923+0000 mgr.a (mgr.14373) 19053 : cluster [DBG] pgmap v13216: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:57:52.572 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:57:52 smithi086 bash[24289]: cluster 2024-09-16T12:57:50.695923+0000 mgr.a (mgr.14373) 19053 : cluster [DBG] pgmap v13216: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:57:52.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:57:52 smithi047 bash[22744]: cluster 2024-09-16T12:57:50.695923+0000 mgr.a (mgr.14373) 19053 : cluster [DBG] pgmap v13216: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:57:54.491 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:57:54.491 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:57:54.491 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:57:54.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:57:54 smithi157 bash[24585]: cluster 2024-09-16T12:57:52.698161+0000 mgr.a (mgr.14373) 19054 : cluster [DBG] pgmap v13217: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:57:54.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:57:54 smithi157 bash[24585]: audit 2024-09-16T12:57:53.978340+0000 mon.b (mon.2) 1722 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T12:57:54.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:57:54 smithi086 bash[24289]: cluster 2024-09-16T12:57:52.698161+0000 mgr.a (mgr.14373) 19054 : cluster [DBG] pgmap v13217: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:57:54.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:57:54 smithi086 bash[24289]: audit 2024-09-16T12:57:53.978340+0000 mon.b (mon.2) 1722 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T12:57:54.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:57:54 smithi047 bash[22744]: cluster 2024-09-16T12:57:52.698161+0000 mgr.a (mgr.14373) 19054 : cluster [DBG] pgmap v13217: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:57:54.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:57:54 smithi047 bash[22744]: audit 2024-09-16T12:57:53.978340+0000 mon.b (mon.2) 1722 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T12:57:55.231 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:57:55.231 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:57:55.231 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:57:55.231 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:57:55.232 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:57:55.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:57:55 smithi157 bash[24585]: audit 2024-09-16T12:57:54.836959+0000 mon.b (mon.2) 1723 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T12:57:55.558 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:57:55 smithi157 bash[24585]: audit 2024-09-16T12:57:54.839167+0000 mon.b (mon.2) 1724 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T12:57:55.558 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:57:55 smithi157 bash[24585]: audit 2024-09-16T12:57:54.848790+0000 mon.a (mon.0) 1706 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:57:55.558 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:57:55 smithi157 bash[24585]: audit 2024-09-16T12:57:54.855498+0000 mon.b (mon.2) 1725 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:57:55.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:57:55 smithi086 bash[24289]: audit 2024-09-16T12:57:54.836959+0000 mon.b (mon.2) 1723 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T12:57:55.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:57:55 smithi086 bash[24289]: audit 2024-09-16T12:57:54.839167+0000 mon.b (mon.2) 1724 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T12:57:55.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:57:55 smithi086 bash[24289]: audit 2024-09-16T12:57:54.848790+0000 mon.a (mon.0) 1706 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:57:55.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:57:55 smithi086 bash[24289]: audit 2024-09-16T12:57:54.855498+0000 mon.b (mon.2) 1725 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:57:55.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:57:55 smithi047 bash[22744]: audit 2024-09-16T12:57:54.836959+0000 mon.b (mon.2) 1723 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T12:57:55.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:57:55 smithi047 bash[22744]: audit 2024-09-16T12:57:54.839167+0000 mon.b (mon.2) 1724 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T12:57:55.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:57:55 smithi047 bash[22744]: audit 2024-09-16T12:57:54.848790+0000 mon.a (mon.0) 1706 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:57:55.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:57:55 smithi047 bash[22744]: audit 2024-09-16T12:57:54.855498+0000 mon.b (mon.2) 1725 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:57:56.343 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 12:57:55 smithi047 bash[22994]: debug 2024-09-16T12:57:55.930+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T12:57:56.343 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 12:57:55 smithi047 bash[22994]: debug 2024-09-16T12:57:55.934+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T12:57:56.344 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:57:56 smithi047 bash[22744]: cluster 2024-09-16T12:57:54.698539+0000 mgr.a (mgr.14373) 19055 : cluster [DBG] pgmap v13218: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:57:56.344 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:57:56 smithi047 bash[22744]: audit 2024-09-16T12:57:54.809703+0000 mgr.a (mgr.14373) 19056 : audit [DBG] from='client.408222 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:57:56.344 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:57:56 smithi047 bash[22744]: audit 2024-09-16T12:57:54.857735+0000 mgr.a (mgr.14373) 19057 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:57:56.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:57:56 smithi157 bash[24585]: cluster 2024-09-16T12:57:54.698539+0000 mgr.a (mgr.14373) 19055 : cluster [DBG] pgmap v13218: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:57:56.558 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:57:56 smithi157 bash[24585]: audit 2024-09-16T12:57:54.809703+0000 mgr.a (mgr.14373) 19056 : audit [DBG] from='client.408222 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:57:56.558 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:57:56 smithi157 bash[24585]: audit 2024-09-16T12:57:54.857735+0000 mgr.a (mgr.14373) 19057 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:57:56.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:57:56 smithi086 bash[24289]: cluster 2024-09-16T12:57:54.698539+0000 mgr.a (mgr.14373) 19055 : cluster [DBG] pgmap v13218: 225 pgs: 225 active+clean; 589 KiB data, 266 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:57:56.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:57:56 smithi086 bash[24289]: audit 2024-09-16T12:57:54.809703+0000 mgr.a (mgr.14373) 19056 : audit [DBG] from='client.408222 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:57:56.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:57:56 smithi086 bash[24289]: audit 2024-09-16T12:57:54.857735+0000 mgr.a (mgr.14373) 19057 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:57:57.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:57:57 smithi157 bash[24585]: audit 2024-09-16T12:57:55.933402+0000 mgr.a (mgr.14373) 19058 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T12:57:57.558 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:57:57 smithi157 bash[24585]: cephadm 2024-09-16T12:57:55.935430+0000 mgr.a (mgr.14373) 19059 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T12:57:57.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:57:57 smithi086 bash[24289]: audit 2024-09-16T12:57:55.933402+0000 mgr.a (mgr.14373) 19058 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T12:57:57.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:57:57 smithi086 bash[24289]: cephadm 2024-09-16T12:57:55.935430+0000 mgr.a (mgr.14373) 19059 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T12:57:57.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:57:57 smithi047 bash[22744]: audit 2024-09-16T12:57:55.933402+0000 mgr.a (mgr.14373) 19058 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T12:57:57.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:57:57 smithi047 bash[22744]: cephadm 2024-09-16T12:57:55.935430+0000 mgr.a (mgr.14373) 19059 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T12:57:58.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:57:58 smithi157 bash[24585]: cluster 2024-09-16T12:57:56.700905+0000 mgr.a (mgr.14373) 19060 : cluster [DBG] pgmap v13219: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:57:58.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:57:58 smithi086 bash[24289]: cluster 2024-09-16T12:57:56.700905+0000 mgr.a (mgr.14373) 19060 : cluster [DBG] pgmap v13219: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:57:58.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:57:58 smithi047 bash[22744]: cluster 2024-09-16T12:57:56.700905+0000 mgr.a (mgr.14373) 19060 : cluster [DBG] pgmap v13219: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:58:00.233 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:58:00.234 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:58:00.234 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:58:00.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:58:00 smithi157 bash[24585]: cluster 2024-09-16T12:57:58.701723+0000 mgr.a (mgr.14373) 19061 : cluster [DBG] pgmap v13220: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:58:00.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:58:00 smithi086 bash[24289]: cluster 2024-09-16T12:57:58.701723+0000 mgr.a (mgr.14373) 19061 : cluster [DBG] pgmap v13220: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:58:00.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:58:00 smithi047 bash[22744]: cluster 2024-09-16T12:57:58.701723+0000 mgr.a (mgr.14373) 19061 : cluster [DBG] pgmap v13220: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:58:00.986 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:58:00.986 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:58:00.986 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:58:00.987 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:58:00.987 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:58:02.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:58:02 smithi157 bash[24585]: audit 2024-09-16T12:58:00.570291+0000 mgr.a (mgr.14373) 19062 : audit [DBG] from='client.408405 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:58:02.558 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:58:02 smithi157 bash[24585]: cluster 2024-09-16T12:58:00.702273+0000 mgr.a (mgr.14373) 19063 : cluster [DBG] pgmap v13221: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:58:02.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:58:02 smithi086 bash[24289]: audit 2024-09-16T12:58:00.570291+0000 mgr.a (mgr.14373) 19062 : audit [DBG] from='client.408405 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:58:02.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:58:02 smithi086 bash[24289]: cluster 2024-09-16T12:58:00.702273+0000 mgr.a (mgr.14373) 19063 : cluster [DBG] pgmap v13221: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:58:02.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:58:02 smithi047 bash[22744]: audit 2024-09-16T12:58:00.570291+0000 mgr.a (mgr.14373) 19062 : audit [DBG] from='client.408405 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:58:02.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:58:02 smithi047 bash[22744]: cluster 2024-09-16T12:58:00.702273+0000 mgr.a (mgr.14373) 19063 : cluster [DBG] pgmap v13221: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:58:04.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:58:04 smithi157 bash[24585]: cluster 2024-09-16T12:58:02.704737+0000 mgr.a (mgr.14373) 19064 : cluster [DBG] pgmap v13222: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:58:04.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:58:04 smithi086 bash[24289]: cluster 2024-09-16T12:58:02.704737+0000 mgr.a (mgr.14373) 19064 : cluster [DBG] pgmap v13222: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:58:04.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:58:04 smithi047 bash[22744]: cluster 2024-09-16T12:58:02.704737+0000 mgr.a (mgr.14373) 19064 : cluster [DBG] pgmap v13222: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:58:05.988 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:58:05.989 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:58:05.989 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:58:06.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:58:06 smithi157 bash[24585]: cluster 2024-09-16T12:58:04.705693+0000 mgr.a (mgr.14373) 19065 : cluster [DBG] pgmap v13223: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:58:06.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:58:06 smithi086 bash[24289]: cluster 2024-09-16T12:58:04.705693+0000 mgr.a (mgr.14373) 19065 : cluster [DBG] pgmap v13223: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:58:06.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:58:06 smithi047 bash[22744]: cluster 2024-09-16T12:58:04.705693+0000 mgr.a (mgr.14373) 19065 : cluster [DBG] pgmap v13223: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:58:06.767 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:58:06.767 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:58:06.767 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:58:06.767 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:58:06.768 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:58:07.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:58:07 smithi157 bash[24585]: audit 2024-09-16T12:58:06.318368+0000 mgr.a (mgr.14373) 19066 : audit [DBG] from='client.408480 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:58:07.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:58:07 smithi086 bash[24289]: audit 2024-09-16T12:58:06.318368+0000 mgr.a (mgr.14373) 19066 : audit [DBG] from='client.408480 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:58:07.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:58:07 smithi047 bash[22744]: audit 2024-09-16T12:58:06.318368+0000 mgr.a (mgr.14373) 19066 : audit [DBG] from='client.408480 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:58:08.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:58:08 smithi157 bash[24585]: cluster 2024-09-16T12:58:06.707639+0000 mgr.a (mgr.14373) 19067 : cluster [DBG] pgmap v13224: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:58:08.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:58:08 smithi086 bash[24289]: cluster 2024-09-16T12:58:06.707639+0000 mgr.a (mgr.14373) 19067 : cluster [DBG] pgmap v13224: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:58:08.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:58:08 smithi047 bash[22744]: cluster 2024-09-16T12:58:06.707639+0000 mgr.a (mgr.14373) 19067 : cluster [DBG] pgmap v13224: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:58:10.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:58:10 smithi157 bash[24585]: cluster 2024-09-16T12:58:08.708422+0000 mgr.a (mgr.14373) 19068 : cluster [DBG] pgmap v13225: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:58:10.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:58:10 smithi086 bash[24289]: cluster 2024-09-16T12:58:08.708422+0000 mgr.a (mgr.14373) 19068 : cluster [DBG] pgmap v13225: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:58:10.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:58:10 smithi047 bash[22744]: cluster 2024-09-16T12:58:08.708422+0000 mgr.a (mgr.14373) 19068 : cluster [DBG] pgmap v13225: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:58:11.769 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:58:11.770 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:58:11.770 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:58:12.526 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:58:12.526 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:58:12.526 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:58:12.527 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:58:12.527 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:58:12.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:58:12 smithi157 bash[24585]: cluster 2024-09-16T12:58:10.709181+0000 mgr.a (mgr.14373) 19069 : cluster [DBG] pgmap v13226: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T12:58:12.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:58:12 smithi086 bash[24289]: cluster 2024-09-16T12:58:10.709181+0000 mgr.a (mgr.14373) 19069 : cluster [DBG] pgmap v13226: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T12:58:12.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:58:12 smithi047 bash[22744]: cluster 2024-09-16T12:58:10.709181+0000 mgr.a (mgr.14373) 19069 : cluster [DBG] pgmap v13226: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T12:58:13.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:58:13 smithi157 bash[24585]: audit 2024-09-16T12:58:12.097841+0000 mgr.a (mgr.14373) 19070 : audit [DBG] from='client.408555 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:58:13.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:58:13 smithi086 bash[24289]: audit 2024-09-16T12:58:12.097841+0000 mgr.a (mgr.14373) 19070 : audit [DBG] from='client.408555 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:58:13.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:58:13 smithi047 bash[22744]: audit 2024-09-16T12:58:12.097841+0000 mgr.a (mgr.14373) 19070 : audit [DBG] from='client.408555 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:58:14.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:58:14 smithi157 bash[24585]: cluster 2024-09-16T12:58:12.711676+0000 mgr.a (mgr.14373) 19071 : cluster [DBG] pgmap v13227: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-16T12:58:14.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:58:14 smithi086 bash[24289]: cluster 2024-09-16T12:58:12.711676+0000 mgr.a (mgr.14373) 19071 : cluster [DBG] pgmap v13227: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-16T12:58:14.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:58:14 smithi047 bash[22744]: cluster 2024-09-16T12:58:12.711676+0000 mgr.a (mgr.14373) 19071 : cluster [DBG] pgmap v13227: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-16T12:58:16.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:58:16 smithi157 bash[24585]: cluster 2024-09-16T12:58:14.712459+0000 mgr.a (mgr.14373) 19072 : cluster [DBG] pgmap v13228: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 5.2 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-16T12:58:16.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:58:16 smithi086 bash[24289]: cluster 2024-09-16T12:58:14.712459+0000 mgr.a (mgr.14373) 19072 : cluster [DBG] pgmap v13228: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 5.2 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-16T12:58:16.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:58:16 smithi047 bash[22744]: cluster 2024-09-16T12:58:14.712459+0000 mgr.a (mgr.14373) 19072 : cluster [DBG] pgmap v13228: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 5.2 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-16T12:58:17.528 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:58:17.528 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:58:17.529 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:58:18.283 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:58:18.283 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:58:18.283 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:58:18.283 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:58:18.283 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:58:18.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:58:18 smithi157 bash[24585]: cluster 2024-09-16T12:58:16.714413+0000 mgr.a (mgr.14373) 19073 : cluster [DBG] pgmap v13229: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-16T12:58:18.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:58:18 smithi086 bash[24289]: cluster 2024-09-16T12:58:16.714413+0000 mgr.a (mgr.14373) 19073 : cluster [DBG] pgmap v13229: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-16T12:58:18.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:58:18 smithi047 bash[22744]: cluster 2024-09-16T12:58:16.714413+0000 mgr.a (mgr.14373) 19073 : cluster [DBG] pgmap v13229: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-16T12:58:19.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:58:19 smithi157 bash[24585]: audit 2024-09-16T12:58:17.859389+0000 mgr.a (mgr.14373) 19074 : audit [DBG] from='client.408633 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:58:19.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:58:19 smithi086 bash[24289]: audit 2024-09-16T12:58:17.859389+0000 mgr.a (mgr.14373) 19074 : audit [DBG] from='client.408633 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:58:19.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:58:19 smithi047 bash[22744]: audit 2024-09-16T12:58:17.859389+0000 mgr.a (mgr.14373) 19074 : audit [DBG] from='client.408633 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:58:20.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:58:20 smithi157 bash[24585]: cluster 2024-09-16T12:58:18.715330+0000 mgr.a (mgr.14373) 19075 : cluster [DBG] pgmap v13230: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-16T12:58:20.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:58:20 smithi086 bash[24289]: cluster 2024-09-16T12:58:18.715330+0000 mgr.a (mgr.14373) 19075 : cluster [DBG] pgmap v13230: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-16T12:58:20.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:58:20 smithi047 bash[22744]: cluster 2024-09-16T12:58:18.715330+0000 mgr.a (mgr.14373) 19075 : cluster [DBG] pgmap v13230: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-16T12:58:22.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:58:22 smithi157 bash[24585]: cluster 2024-09-16T12:58:20.716112+0000 mgr.a (mgr.14373) 19076 : cluster [DBG] pgmap v13231: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-16T12:58:22.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:58:22 smithi086 bash[24289]: cluster 2024-09-16T12:58:20.716112+0000 mgr.a (mgr.14373) 19076 : cluster [DBG] pgmap v13231: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-16T12:58:22.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:58:22 smithi047 bash[22744]: cluster 2024-09-16T12:58:20.716112+0000 mgr.a (mgr.14373) 19076 : cluster [DBG] pgmap v13231: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-16T12:58:23.284 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:58:23.285 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:58:23.285 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:58:24.062 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:58:24.062 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:58:24.062 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:58:24.062 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:58:24.062 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:58:24.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:58:24 smithi157 bash[24585]: cluster 2024-09-16T12:58:22.718314+0000 mgr.a (mgr.14373) 19077 : cluster [DBG] pgmap v13232: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-16T12:58:24.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:58:24 smithi086 bash[24289]: cluster 2024-09-16T12:58:22.718314+0000 mgr.a (mgr.14373) 19077 : cluster [DBG] pgmap v13232: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-16T12:58:24.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:58:24 smithi047 bash[22744]: cluster 2024-09-16T12:58:22.718314+0000 mgr.a (mgr.14373) 19077 : cluster [DBG] pgmap v13232: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-16T12:58:25.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:58:25 smithi157 bash[24585]: audit 2024-09-16T12:58:23.616143+0000 mgr.a (mgr.14373) 19078 : audit [DBG] from='client.408711 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:58:25.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:58:25 smithi086 bash[24289]: audit 2024-09-16T12:58:23.616143+0000 mgr.a (mgr.14373) 19078 : audit [DBG] from='client.408711 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:58:25.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:58:25 smithi047 bash[22744]: audit 2024-09-16T12:58:23.616143+0000 mgr.a (mgr.14373) 19078 : audit [DBG] from='client.408711 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:58:26.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:58:26 smithi157 bash[24585]: cluster 2024-09-16T12:58:24.719404+0000 mgr.a (mgr.14373) 19079 : cluster [DBG] pgmap v13233: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:58:26.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:58:26 smithi086 bash[24289]: cluster 2024-09-16T12:58:24.719404+0000 mgr.a (mgr.14373) 19079 : cluster [DBG] pgmap v13233: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:58:26.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:58:26 smithi047 bash[22744]: cluster 2024-09-16T12:58:24.719404+0000 mgr.a (mgr.14373) 19079 : cluster [DBG] pgmap v13233: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:58:28.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:58:28 smithi157 bash[24585]: cluster 2024-09-16T12:58:26.721724+0000 mgr.a (mgr.14373) 19080 : cluster [DBG] pgmap v13234: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:58:28.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:58:28 smithi086 bash[24289]: cluster 2024-09-16T12:58:26.721724+0000 mgr.a (mgr.14373) 19080 : cluster [DBG] pgmap v13234: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:58:28.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:58:28 smithi047 bash[22744]: cluster 2024-09-16T12:58:26.721724+0000 mgr.a (mgr.14373) 19080 : cluster [DBG] pgmap v13234: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:58:29.063 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:58:29.064 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:58:29.064 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:58:29.846 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:58:29.847 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:58:29.847 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:58:29.847 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:58:29.847 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:58:30.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:58:30 smithi157 bash[24585]: cluster 2024-09-16T12:58:28.722686+0000 mgr.a (mgr.14373) 19081 : cluster [DBG] pgmap v13235: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:58:30.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:58:30 smithi157 bash[24585]: audit 2024-09-16T12:58:29.403182+0000 mgr.a (mgr.14373) 19082 : audit [DBG] from='client.408786 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:58:30.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:58:30 smithi086 bash[24289]: cluster 2024-09-16T12:58:28.722686+0000 mgr.a (mgr.14373) 19081 : cluster [DBG] pgmap v13235: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:58:30.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:58:30 smithi086 bash[24289]: audit 2024-09-16T12:58:29.403182+0000 mgr.a (mgr.14373) 19082 : audit [DBG] from='client.408786 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:58:30.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:58:30 smithi047 bash[22744]: cluster 2024-09-16T12:58:28.722686+0000 mgr.a (mgr.14373) 19081 : cluster [DBG] pgmap v13235: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:58:30.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:58:30 smithi047 bash[22744]: audit 2024-09-16T12:58:29.403182+0000 mgr.a (mgr.14373) 19082 : audit [DBG] from='client.408786 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:58:32.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:58:32 smithi157 bash[24585]: cluster 2024-09-16T12:58:30.723592+0000 mgr.a (mgr.14373) 19083 : cluster [DBG] pgmap v13236: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:58:32.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:58:32 smithi086 bash[24289]: cluster 2024-09-16T12:58:30.723592+0000 mgr.a (mgr.14373) 19083 : cluster [DBG] pgmap v13236: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:58:32.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:58:32 smithi047 bash[22744]: cluster 2024-09-16T12:58:30.723592+0000 mgr.a (mgr.14373) 19083 : cluster [DBG] pgmap v13236: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:58:34.558 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:58:34 smithi157 bash[24585]: cluster 2024-09-16T12:58:32.725842+0000 mgr.a (mgr.14373) 19084 : cluster [DBG] pgmap v13237: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:58:34.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:58:34 smithi086 bash[24289]: cluster 2024-09-16T12:58:32.725842+0000 mgr.a (mgr.14373) 19084 : cluster [DBG] pgmap v13237: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:58:34.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:58:34 smithi047 bash[22744]: cluster 2024-09-16T12:58:32.725842+0000 mgr.a (mgr.14373) 19084 : cluster [DBG] pgmap v13237: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:58:34.848 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:58:34.849 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:58:34.849 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:58:35.605 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:58:35.606 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:58:35.606 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:58:35.606 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:58:35.606 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:58:36.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:58:36 smithi157 bash[24585]: cluster 2024-09-16T12:58:34.726672+0000 mgr.a (mgr.14373) 19085 : cluster [DBG] pgmap v13238: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:58:36.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:58:36 smithi157 bash[24585]: audit 2024-09-16T12:58:35.181992+0000 mgr.a (mgr.14373) 19086 : audit [DBG] from='client.408861 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:58:36.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:58:36 smithi086 bash[24289]: cluster 2024-09-16T12:58:34.726672+0000 mgr.a (mgr.14373) 19085 : cluster [DBG] pgmap v13238: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:58:36.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:58:36 smithi086 bash[24289]: audit 2024-09-16T12:58:35.181992+0000 mgr.a (mgr.14373) 19086 : audit [DBG] from='client.408861 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:58:36.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:58:36 smithi047 bash[22744]: cluster 2024-09-16T12:58:34.726672+0000 mgr.a (mgr.14373) 19085 : cluster [DBG] pgmap v13238: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:58:36.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:58:36 smithi047 bash[22744]: audit 2024-09-16T12:58:35.181992+0000 mgr.a (mgr.14373) 19086 : audit [DBG] from='client.408861 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:58:38.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:58:38 smithi157 bash[24585]: cluster 2024-09-16T12:58:36.729029+0000 mgr.a (mgr.14373) 19087 : cluster [DBG] pgmap v13239: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:58:38.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:58:38 smithi086 bash[24289]: cluster 2024-09-16T12:58:36.729029+0000 mgr.a (mgr.14373) 19087 : cluster [DBG] pgmap v13239: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:58:38.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:58:38 smithi047 bash[22744]: cluster 2024-09-16T12:58:36.729029+0000 mgr.a (mgr.14373) 19087 : cluster [DBG] pgmap v13239: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:58:40.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:58:40 smithi157 bash[24585]: cluster 2024-09-16T12:58:38.729807+0000 mgr.a (mgr.14373) 19088 : cluster [DBG] pgmap v13240: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:58:40.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:58:40 smithi086 bash[24289]: cluster 2024-09-16T12:58:38.729807+0000 mgr.a (mgr.14373) 19088 : cluster [DBG] pgmap v13240: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:58:40.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:58:40 smithi047 bash[22744]: cluster 2024-09-16T12:58:38.729807+0000 mgr.a (mgr.14373) 19088 : cluster [DBG] pgmap v13240: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:58:40.607 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:58:40.607 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:58:40.608 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:58:41.397 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:58:41.398 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:58:41.398 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:58:41.398 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:58:41.398 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:58:42.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:58:42 smithi157 bash[24585]: cluster 2024-09-16T12:58:40.730357+0000 mgr.a (mgr.14373) 19089 : cluster [DBG] pgmap v13241: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:58:42.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:58:42 smithi157 bash[24585]: audit 2024-09-16T12:58:40.949598+0000 mgr.a (mgr.14373) 19090 : audit [DBG] from='client.408939 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:58:42.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:58:42 smithi086 bash[24289]: cluster 2024-09-16T12:58:40.730357+0000 mgr.a (mgr.14373) 19089 : cluster [DBG] pgmap v13241: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:58:42.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:58:42 smithi086 bash[24289]: audit 2024-09-16T12:58:40.949598+0000 mgr.a (mgr.14373) 19090 : audit [DBG] from='client.408939 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:58:42.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:58:42 smithi047 bash[22744]: cluster 2024-09-16T12:58:40.730357+0000 mgr.a (mgr.14373) 19089 : cluster [DBG] pgmap v13241: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:58:42.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:58:42 smithi047 bash[22744]: audit 2024-09-16T12:58:40.949598+0000 mgr.a (mgr.14373) 19090 : audit [DBG] from='client.408939 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:58:44.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:58:44 smithi157 bash[24585]: cluster 2024-09-16T12:58:42.732799+0000 mgr.a (mgr.14373) 19091 : cluster [DBG] pgmap v13242: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 66 KiB/s rd, 0 B/s wr, 108 op/s 2024-09-16T12:58:44.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:58:44 smithi086 bash[24289]: cluster 2024-09-16T12:58:42.732799+0000 mgr.a (mgr.14373) 19091 : cluster [DBG] pgmap v13242: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 66 KiB/s rd, 0 B/s wr, 108 op/s 2024-09-16T12:58:44.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:58:44 smithi047 bash[22744]: cluster 2024-09-16T12:58:42.732799+0000 mgr.a (mgr.14373) 19091 : cluster [DBG] pgmap v13242: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 66 KiB/s rd, 0 B/s wr, 108 op/s 2024-09-16T12:58:46.399 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:58:46.400 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:58:46.400 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:58:46.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:58:46 smithi157 bash[24585]: cluster 2024-09-16T12:58:44.733596+0000 mgr.a (mgr.14373) 19092 : cluster [DBG] pgmap v13243: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 65 KiB/s rd, 0 B/s wr, 107 op/s 2024-09-16T12:58:46.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:58:46 smithi086 bash[24289]: cluster 2024-09-16T12:58:44.733596+0000 mgr.a (mgr.14373) 19092 : cluster [DBG] pgmap v13243: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 65 KiB/s rd, 0 B/s wr, 107 op/s 2024-09-16T12:58:46.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:58:46 smithi047 bash[22744]: cluster 2024-09-16T12:58:44.733596+0000 mgr.a (mgr.14373) 19092 : cluster [DBG] pgmap v13243: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 65 KiB/s rd, 0 B/s wr, 107 op/s 2024-09-16T12:58:47.148 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:58:47.148 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:58:47.148 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:58:47.148 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:58:47.148 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:58:48.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:58:48 smithi157 bash[24585]: audit 2024-09-16T12:58:46.728644+0000 mgr.a (mgr.14373) 19093 : audit [DBG] from='client.409017 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:58:48.558 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:58:48 smithi157 bash[24585]: cluster 2024-09-16T12:58:46.746157+0000 mgr.a (mgr.14373) 19094 : cluster [DBG] pgmap v13244: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 65 KiB/s rd, 0 B/s wr, 107 op/s 2024-09-16T12:58:48.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:58:48 smithi086 bash[24289]: audit 2024-09-16T12:58:46.728644+0000 mgr.a (mgr.14373) 19093 : audit [DBG] from='client.409017 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:58:48.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:58:48 smithi086 bash[24289]: cluster 2024-09-16T12:58:46.746157+0000 mgr.a (mgr.14373) 19094 : cluster [DBG] pgmap v13244: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 65 KiB/s rd, 0 B/s wr, 107 op/s 2024-09-16T12:58:48.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:58:48 smithi047 bash[22744]: audit 2024-09-16T12:58:46.728644+0000 mgr.a (mgr.14373) 19093 : audit [DBG] from='client.409017 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:58:48.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:58:48 smithi047 bash[22744]: cluster 2024-09-16T12:58:46.746157+0000 mgr.a (mgr.14373) 19094 : cluster [DBG] pgmap v13244: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 65 KiB/s rd, 0 B/s wr, 107 op/s 2024-09-16T12:58:50.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:58:50 smithi157 bash[24585]: cluster 2024-09-16T12:58:48.747287+0000 mgr.a (mgr.14373) 19095 : cluster [DBG] pgmap v13245: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 64 KiB/s rd, 0 B/s wr, 106 op/s 2024-09-16T12:58:50.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:58:50 smithi086 bash[24289]: cluster 2024-09-16T12:58:48.747287+0000 mgr.a (mgr.14373) 19095 : cluster [DBG] pgmap v13245: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 64 KiB/s rd, 0 B/s wr, 106 op/s 2024-09-16T12:58:50.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:58:50 smithi047 bash[22744]: cluster 2024-09-16T12:58:48.747287+0000 mgr.a (mgr.14373) 19095 : cluster [DBG] pgmap v13245: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 64 KiB/s rd, 0 B/s wr, 106 op/s 2024-09-16T12:58:52.149 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:58:52.150 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:58:52.150 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:58:52.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:58:52 smithi157 bash[24585]: cluster 2024-09-16T12:58:50.748077+0000 mgr.a (mgr.14373) 19096 : cluster [DBG] pgmap v13246: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 64 KiB/s rd, 0 B/s wr, 106 op/s 2024-09-16T12:58:52.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:58:52 smithi086 bash[24289]: cluster 2024-09-16T12:58:50.748077+0000 mgr.a (mgr.14373) 19096 : cluster [DBG] pgmap v13246: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 64 KiB/s rd, 0 B/s wr, 106 op/s 2024-09-16T12:58:52.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:58:52 smithi047 bash[22744]: cluster 2024-09-16T12:58:50.748077+0000 mgr.a (mgr.14373) 19096 : cluster [DBG] pgmap v13246: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 64 KiB/s rd, 0 B/s wr, 106 op/s 2024-09-16T12:58:52.938 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:58:52.938 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:58:52.938 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:58:52.938 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:58:52.938 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:58:53.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:58:53 smithi157 bash[24585]: audit 2024-09-16T12:58:52.480977+0000 mgr.a (mgr.14373) 19097 : audit [DBG] from='client.409092 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:58:53.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:58:53 smithi086 bash[24289]: audit 2024-09-16T12:58:52.480977+0000 mgr.a (mgr.14373) 19097 : audit [DBG] from='client.409092 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:58:53.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:58:53 smithi047 bash[22744]: audit 2024-09-16T12:58:52.480977+0000 mgr.a (mgr.14373) 19097 : audit [DBG] from='client.409092 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:58:54.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:58:54 smithi157 bash[24585]: cluster 2024-09-16T12:58:52.749470+0000 mgr.a (mgr.14373) 19098 : cluster [DBG] pgmap v13247: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 65 KiB/s rd, 0 B/s wr, 107 op/s 2024-09-16T12:58:54.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:58:54 smithi086 bash[24289]: cluster 2024-09-16T12:58:52.749470+0000 mgr.a (mgr.14373) 19098 : cluster [DBG] pgmap v13247: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 65 KiB/s rd, 0 B/s wr, 107 op/s 2024-09-16T12:58:54.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:58:54 smithi047 bash[22744]: cluster 2024-09-16T12:58:52.749470+0000 mgr.a (mgr.14373) 19098 : cluster [DBG] pgmap v13247: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 65 KiB/s rd, 0 B/s wr, 107 op/s 2024-09-16T12:58:56.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:58:56 smithi157 bash[24585]: cluster 2024-09-16T12:58:54.750303+0000 mgr.a (mgr.14373) 19099 : cluster [DBG] pgmap v13248: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:58:56.558 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:58:56 smithi157 bash[24585]: audit 2024-09-16T12:58:55.994949+0000 mon.b (mon.2) 1726 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T12:58:56.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:58:56 smithi086 bash[24289]: cluster 2024-09-16T12:58:54.750303+0000 mgr.a (mgr.14373) 19099 : cluster [DBG] pgmap v13248: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:58:56.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:58:56 smithi086 bash[24289]: audit 2024-09-16T12:58:55.994949+0000 mon.b (mon.2) 1726 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T12:58:56.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:58:56 smithi047 bash[22744]: cluster 2024-09-16T12:58:54.750303+0000 mgr.a (mgr.14373) 19099 : cluster [DBG] pgmap v13248: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:58:56.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:58:56 smithi047 bash[22744]: audit 2024-09-16T12:58:55.994949+0000 mon.b (mon.2) 1726 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T12:58:57.558 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:58:57 smithi157 bash[24585]: audit 2024-09-16T12:58:56.838676+0000 mon.b (mon.2) 1727 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T12:58:57.559 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:58:57 smithi157 bash[24585]: audit 2024-09-16T12:58:56.841116+0000 mon.b (mon.2) 1728 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T12:58:57.559 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:58:57 smithi157 bash[24585]: audit 2024-09-16T12:58:56.850933+0000 mon.a (mon.0) 1707 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:58:57.559 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:58:57 smithi157 bash[24585]: audit 2024-09-16T12:58:56.857830+0000 mon.b (mon.2) 1729 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:58:57.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:58:57 smithi086 bash[24289]: audit 2024-09-16T12:58:56.838676+0000 mon.b (mon.2) 1727 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T12:58:57.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:58:57 smithi086 bash[24289]: audit 2024-09-16T12:58:56.841116+0000 mon.b (mon.2) 1728 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T12:58:57.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:58:57 smithi086 bash[24289]: audit 2024-09-16T12:58:56.850933+0000 mon.a (mon.0) 1707 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:58:57.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:58:57 smithi086 bash[24289]: audit 2024-09-16T12:58:56.857830+0000 mon.b (mon.2) 1729 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:58:57.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:58:57 smithi047 bash[22744]: audit 2024-09-16T12:58:56.838676+0000 mon.b (mon.2) 1727 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T12:58:57.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:58:57 smithi047 bash[22744]: audit 2024-09-16T12:58:56.841116+0000 mon.b (mon.2) 1728 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T12:58:57.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:58:57 smithi047 bash[22744]: audit 2024-09-16T12:58:56.850933+0000 mon.a (mon.0) 1707 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:58:57.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:58:57 smithi047 bash[22744]: audit 2024-09-16T12:58:56.857830+0000 mon.b (mon.2) 1729 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:58:57.939 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:58:57.940 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:58:57.940 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:58:58.093 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 12:58:57 smithi047 bash[22994]: debug 2024-09-16T12:58:57.608+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T12:58:58.093 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 12:58:57 smithi047 bash[22994]: debug 2024-09-16T12:58:57.608+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T12:58:58.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:58:58 smithi157 bash[24585]: cluster 2024-09-16T12:58:56.751666+0000 mgr.a (mgr.14373) 19100 : cluster [DBG] pgmap v13249: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:58:58.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:58:58 smithi157 bash[24585]: audit 2024-09-16T12:58:56.859437+0000 mgr.a (mgr.14373) 19101 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:58:58.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:58:58 smithi086 bash[24289]: cluster 2024-09-16T12:58:56.751666+0000 mgr.a (mgr.14373) 19100 : cluster [DBG] pgmap v13249: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:58:58.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:58:58 smithi086 bash[24289]: audit 2024-09-16T12:58:56.859437+0000 mgr.a (mgr.14373) 19101 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:58:58.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:58:58 smithi047 bash[22744]: cluster 2024-09-16T12:58:56.751666+0000 mgr.a (mgr.14373) 19100 : cluster [DBG] pgmap v13249: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:58:58.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:58:58 smithi047 bash[22744]: audit 2024-09-16T12:58:56.859437+0000 mgr.a (mgr.14373) 19101 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:58:58.685 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:58:58.685 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:58:58.685 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:58:58.685 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:58:58.685 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:58:59.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:58:59 smithi157 bash[24585]: audit 2024-09-16T12:58:57.610886+0000 mgr.a (mgr.14373) 19102 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T12:58:59.558 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:58:59 smithi157 bash[24585]: cephadm 2024-09-16T12:58:57.614192+0000 mgr.a (mgr.14373) 19103 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T12:58:59.558 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:58:59 smithi157 bash[24585]: audit 2024-09-16T12:58:58.257776+0000 mgr.a (mgr.14373) 19104 : audit [DBG] from='client.409275 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:58:59.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:58:59 smithi086 bash[24289]: audit 2024-09-16T12:58:57.610886+0000 mgr.a (mgr.14373) 19102 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T12:58:59.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:58:59 smithi086 bash[24289]: cephadm 2024-09-16T12:58:57.614192+0000 mgr.a (mgr.14373) 19103 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T12:58:59.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:58:59 smithi086 bash[24289]: audit 2024-09-16T12:58:58.257776+0000 mgr.a (mgr.14373) 19104 : audit [DBG] from='client.409275 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:58:59.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:58:59 smithi047 bash[22744]: audit 2024-09-16T12:58:57.610886+0000 mgr.a (mgr.14373) 19102 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T12:58:59.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:58:59 smithi047 bash[22744]: cephadm 2024-09-16T12:58:57.614192+0000 mgr.a (mgr.14373) 19103 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T12:58:59.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:58:59 smithi047 bash[22744]: audit 2024-09-16T12:58:58.257776+0000 mgr.a (mgr.14373) 19104 : audit [DBG] from='client.409275 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:59:00.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:59:00 smithi086 bash[24289]: cluster 2024-09-16T12:58:58.752598+0000 mgr.a (mgr.14373) 19105 : cluster [DBG] pgmap v13250: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:59:00.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:59:00 smithi047 bash[22744]: cluster 2024-09-16T12:58:58.752598+0000 mgr.a (mgr.14373) 19105 : cluster [DBG] pgmap v13250: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:59:00.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:59:00 smithi157 bash[24585]: cluster 2024-09-16T12:58:58.752598+0000 mgr.a (mgr.14373) 19105 : cluster [DBG] pgmap v13250: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:59:02.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:59:02 smithi086 bash[24289]: cluster 2024-09-16T12:59:00.753387+0000 mgr.a (mgr.14373) 19106 : cluster [DBG] pgmap v13251: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:59:02.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:59:02 smithi047 bash[22744]: cluster 2024-09-16T12:59:00.753387+0000 mgr.a (mgr.14373) 19106 : cluster [DBG] pgmap v13251: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:59:02.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:59:02 smithi157 bash[24585]: cluster 2024-09-16T12:59:00.753387+0000 mgr.a (mgr.14373) 19106 : cluster [DBG] pgmap v13251: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:59:03.686 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:59:03.687 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:59:03.687 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:59:04.446 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:59:04.446 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:59:04.446 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:59:04.446 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:59:04.446 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:59:04.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:59:04 smithi086 bash[24289]: cluster 2024-09-16T12:59:02.755621+0000 mgr.a (mgr.14373) 19107 : cluster [DBG] pgmap v13252: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:59:04.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:59:04 smithi047 bash[22744]: cluster 2024-09-16T12:59:02.755621+0000 mgr.a (mgr.14373) 19107 : cluster [DBG] pgmap v13252: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:59:04.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:59:04 smithi157 bash[24585]: cluster 2024-09-16T12:59:02.755621+0000 mgr.a (mgr.14373) 19107 : cluster [DBG] pgmap v13252: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:59:05.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:59:05 smithi047 bash[22744]: audit 2024-09-16T12:59:04.017139+0000 mgr.a (mgr.14373) 19108 : audit [DBG] from='client.409353 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:59:05.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:59:05 smithi157 bash[24585]: audit 2024-09-16T12:59:04.017139+0000 mgr.a (mgr.14373) 19108 : audit [DBG] from='client.409353 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:59:05.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:59:05 smithi086 bash[24289]: audit 2024-09-16T12:59:04.017139+0000 mgr.a (mgr.14373) 19108 : audit [DBG] from='client.409353 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:59:06.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:59:06 smithi047 bash[22744]: cluster 2024-09-16T12:59:04.756556+0000 mgr.a (mgr.14373) 19109 : cluster [DBG] pgmap v13253: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:59:06.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:59:06 smithi157 bash[24585]: cluster 2024-09-16T12:59:04.756556+0000 mgr.a (mgr.14373) 19109 : cluster [DBG] pgmap v13253: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:59:06.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:59:06 smithi086 bash[24289]: cluster 2024-09-16T12:59:04.756556+0000 mgr.a (mgr.14373) 19109 : cluster [DBG] pgmap v13253: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:59:08.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:59:08 smithi047 bash[22744]: cluster 2024-09-16T12:59:06.758751+0000 mgr.a (mgr.14373) 19110 : cluster [DBG] pgmap v13254: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:59:08.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:59:08 smithi157 bash[24585]: cluster 2024-09-16T12:59:06.758751+0000 mgr.a (mgr.14373) 19110 : cluster [DBG] pgmap v13254: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:59:08.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:59:08 smithi086 bash[24289]: cluster 2024-09-16T12:59:06.758751+0000 mgr.a (mgr.14373) 19110 : cluster [DBG] pgmap v13254: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:59:09.447 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:59:09.448 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:59:09.448 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:59:10.230 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:59:10.231 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:59:10.231 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:59:10.231 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:59:10.231 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:59:10.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:59:10 smithi047 bash[22744]: cluster 2024-09-16T12:59:08.759503+0000 mgr.a (mgr.14373) 19111 : cluster [DBG] pgmap v13255: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:59:10.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:59:10 smithi157 bash[24585]: cluster 2024-09-16T12:59:08.759503+0000 mgr.a (mgr.14373) 19111 : cluster [DBG] pgmap v13255: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:59:10.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:59:10 smithi086 bash[24289]: cluster 2024-09-16T12:59:08.759503+0000 mgr.a (mgr.14373) 19111 : cluster [DBG] pgmap v13255: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:59:11.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:59:11 smithi157 bash[24585]: audit 2024-09-16T12:59:09.782854+0000 mgr.a (mgr.14373) 19112 : audit [DBG] from='client.409425 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:59:11.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:59:11 smithi086 bash[24289]: audit 2024-09-16T12:59:09.782854+0000 mgr.a (mgr.14373) 19112 : audit [DBG] from='client.409425 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:59:11.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:59:11 smithi047 bash[22744]: audit 2024-09-16T12:59:09.782854+0000 mgr.a (mgr.14373) 19112 : audit [DBG] from='client.409425 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:59:12.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:59:12 smithi157 bash[24585]: cluster 2024-09-16T12:59:10.760495+0000 mgr.a (mgr.14373) 19113 : cluster [DBG] pgmap v13256: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:59:12.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:59:12 smithi086 bash[24289]: cluster 2024-09-16T12:59:10.760495+0000 mgr.a (mgr.14373) 19113 : cluster [DBG] pgmap v13256: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:59:12.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:59:12 smithi047 bash[22744]: cluster 2024-09-16T12:59:10.760495+0000 mgr.a (mgr.14373) 19113 : cluster [DBG] pgmap v13256: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:59:14.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:59:14 smithi157 bash[24585]: cluster 2024-09-16T12:59:12.762780+0000 mgr.a (mgr.14373) 19114 : cluster [DBG] pgmap v13257: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:59:14.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:59:14 smithi086 bash[24289]: cluster 2024-09-16T12:59:12.762780+0000 mgr.a (mgr.14373) 19114 : cluster [DBG] pgmap v13257: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:59:14.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:59:14 smithi047 bash[22744]: cluster 2024-09-16T12:59:12.762780+0000 mgr.a (mgr.14373) 19114 : cluster [DBG] pgmap v13257: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T12:59:15.232 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:59:15.233 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:59:15.233 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:59:15.972 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:59:15.973 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:59:15.973 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:59:15.973 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:59:15.973 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:59:16.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:59:16 smithi157 bash[24585]: cluster 2024-09-16T12:59:14.763541+0000 mgr.a (mgr.14373) 19115 : cluster [DBG] pgmap v13258: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:59:16.808 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:59:16 smithi157 bash[24585]: audit 2024-09-16T12:59:15.565583+0000 mgr.a (mgr.14373) 19116 : audit [DBG] from='client.409497 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:59:16.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:59:16 smithi086 bash[24289]: cluster 2024-09-16T12:59:14.763541+0000 mgr.a (mgr.14373) 19115 : cluster [DBG] pgmap v13258: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:59:16.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:59:16 smithi086 bash[24289]: audit 2024-09-16T12:59:15.565583+0000 mgr.a (mgr.14373) 19116 : audit [DBG] from='client.409497 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:59:16.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:59:16 smithi047 bash[22744]: cluster 2024-09-16T12:59:14.763541+0000 mgr.a (mgr.14373) 19115 : cluster [DBG] pgmap v13258: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:59:16.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:59:16 smithi047 bash[22744]: audit 2024-09-16T12:59:15.565583+0000 mgr.a (mgr.14373) 19116 : audit [DBG] from='client.409497 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:59:18.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:59:18 smithi157 bash[24585]: cluster 2024-09-16T12:59:16.765875+0000 mgr.a (mgr.14373) 19117 : cluster [DBG] pgmap v13259: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:59:18.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:59:18 smithi086 bash[24289]: cluster 2024-09-16T12:59:16.765875+0000 mgr.a (mgr.14373) 19117 : cluster [DBG] pgmap v13259: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:59:18.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:59:18 smithi047 bash[22744]: cluster 2024-09-16T12:59:16.765875+0000 mgr.a (mgr.14373) 19117 : cluster [DBG] pgmap v13259: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:59:20.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:59:20 smithi157 bash[24585]: cluster 2024-09-16T12:59:18.766739+0000 mgr.a (mgr.14373) 19118 : cluster [DBG] pgmap v13260: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:59:20.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:59:20 smithi086 bash[24289]: cluster 2024-09-16T12:59:18.766739+0000 mgr.a (mgr.14373) 19118 : cluster [DBG] pgmap v13260: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:59:20.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:59:20 smithi047 bash[22744]: cluster 2024-09-16T12:59:18.766739+0000 mgr.a (mgr.14373) 19118 : cluster [DBG] pgmap v13260: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:59:20.974 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:59:20.975 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:59:20.975 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:59:21.730 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:59:21.730 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:59:21.730 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:59:21.731 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:59:21.731 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:59:22.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:59:22 smithi157 bash[24585]: cluster 2024-09-16T12:59:20.767521+0000 mgr.a (mgr.14373) 19119 : cluster [DBG] pgmap v13261: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:59:22.808 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:59:22 smithi157 bash[24585]: audit 2024-09-16T12:59:21.304026+0000 mgr.a (mgr.14373) 19120 : audit [DBG] from='client.409572 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:59:22.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:59:22 smithi086 bash[24289]: cluster 2024-09-16T12:59:20.767521+0000 mgr.a (mgr.14373) 19119 : cluster [DBG] pgmap v13261: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:59:22.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:59:22 smithi086 bash[24289]: audit 2024-09-16T12:59:21.304026+0000 mgr.a (mgr.14373) 19120 : audit [DBG] from='client.409572 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:59:22.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:59:22 smithi047 bash[22744]: cluster 2024-09-16T12:59:20.767521+0000 mgr.a (mgr.14373) 19119 : cluster [DBG] pgmap v13261: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:59:22.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:59:22 smithi047 bash[22744]: audit 2024-09-16T12:59:21.304026+0000 mgr.a (mgr.14373) 19120 : audit [DBG] from='client.409572 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:59:24.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:59:24 smithi157 bash[24585]: cluster 2024-09-16T12:59:22.770389+0000 mgr.a (mgr.14373) 19121 : cluster [DBG] pgmap v13262: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:59:24.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:59:24 smithi086 bash[24289]: cluster 2024-09-16T12:59:22.770389+0000 mgr.a (mgr.14373) 19121 : cluster [DBG] pgmap v13262: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:59:24.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:59:24 smithi047 bash[22744]: cluster 2024-09-16T12:59:22.770389+0000 mgr.a (mgr.14373) 19121 : cluster [DBG] pgmap v13262: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:59:26.732 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:59:26.733 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:59:26.733 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:59:26.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:59:26 smithi157 bash[24585]: cluster 2024-09-16T12:59:24.771165+0000 mgr.a (mgr.14373) 19122 : cluster [DBG] pgmap v13263: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:59:26.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:59:26 smithi086 bash[24289]: cluster 2024-09-16T12:59:24.771165+0000 mgr.a (mgr.14373) 19122 : cluster [DBG] pgmap v13263: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:59:26.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:59:26 smithi047 bash[22744]: cluster 2024-09-16T12:59:24.771165+0000 mgr.a (mgr.14373) 19122 : cluster [DBG] pgmap v13263: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:59:27.515 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:59:27.516 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:59:27.516 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:59:27.516 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:59:27.516 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:59:28.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:59:28 smithi157 bash[24585]: cluster 2024-09-16T12:59:26.773200+0000 mgr.a (mgr.14373) 19123 : cluster [DBG] pgmap v13264: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:59:28.808 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:59:28 smithi157 bash[24585]: audit 2024-09-16T12:59:27.067709+0000 mgr.a (mgr.14373) 19124 : audit [DBG] from='client.409647 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:59:28.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:59:28 smithi086 bash[24289]: cluster 2024-09-16T12:59:26.773200+0000 mgr.a (mgr.14373) 19123 : cluster [DBG] pgmap v13264: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:59:28.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:59:28 smithi086 bash[24289]: audit 2024-09-16T12:59:27.067709+0000 mgr.a (mgr.14373) 19124 : audit [DBG] from='client.409647 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:59:28.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:59:28 smithi047 bash[22744]: cluster 2024-09-16T12:59:26.773200+0000 mgr.a (mgr.14373) 19123 : cluster [DBG] pgmap v13264: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:59:28.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:59:28 smithi047 bash[22744]: audit 2024-09-16T12:59:27.067709+0000 mgr.a (mgr.14373) 19124 : audit [DBG] from='client.409647 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:59:30.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:59:30 smithi157 bash[24585]: cluster 2024-09-16T12:59:28.774144+0000 mgr.a (mgr.14373) 19125 : cluster [DBG] pgmap v13265: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:59:30.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:59:30 smithi086 bash[24289]: cluster 2024-09-16T12:59:28.774144+0000 mgr.a (mgr.14373) 19125 : cluster [DBG] pgmap v13265: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:59:30.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:59:30 smithi047 bash[22744]: cluster 2024-09-16T12:59:28.774144+0000 mgr.a (mgr.14373) 19125 : cluster [DBG] pgmap v13265: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T12:59:32.517 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:59:32.518 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:59:32.518 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:59:32.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:59:32 smithi157 bash[24585]: cluster 2024-09-16T12:59:30.774947+0000 mgr.a (mgr.14373) 19126 : cluster [DBG] pgmap v13266: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T12:59:32.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:59:32 smithi086 bash[24289]: cluster 2024-09-16T12:59:30.774947+0000 mgr.a (mgr.14373) 19126 : cluster [DBG] pgmap v13266: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T12:59:32.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:59:32 smithi047 bash[22744]: cluster 2024-09-16T12:59:30.774947+0000 mgr.a (mgr.14373) 19126 : cluster [DBG] pgmap v13266: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T12:59:33.267 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:59:33.267 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:59:33.267 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:59:33.267 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:59:33.267 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:59:34.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:59:34 smithi157 bash[24585]: cluster 2024-09-16T12:59:32.777098+0000 mgr.a (mgr.14373) 19127 : cluster [DBG] pgmap v13267: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:59:34.808 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:59:34 smithi157 bash[24585]: audit 2024-09-16T12:59:32.846350+0000 mgr.a (mgr.14373) 19128 : audit [DBG] from='client.409725 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:59:34.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:59:34 smithi086 bash[24289]: cluster 2024-09-16T12:59:32.777098+0000 mgr.a (mgr.14373) 19127 : cluster [DBG] pgmap v13267: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:59:34.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:59:34 smithi086 bash[24289]: audit 2024-09-16T12:59:32.846350+0000 mgr.a (mgr.14373) 19128 : audit [DBG] from='client.409725 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:59:34.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:59:34 smithi047 bash[22744]: cluster 2024-09-16T12:59:32.777098+0000 mgr.a (mgr.14373) 19127 : cluster [DBG] pgmap v13267: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:59:34.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:59:34 smithi047 bash[22744]: audit 2024-09-16T12:59:32.846350+0000 mgr.a (mgr.14373) 19128 : audit [DBG] from='client.409725 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:59:36.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:59:36 smithi157 bash[24585]: cluster 2024-09-16T12:59:34.778052+0000 mgr.a (mgr.14373) 19129 : cluster [DBG] pgmap v13268: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:59:36.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:59:36 smithi086 bash[24289]: cluster 2024-09-16T12:59:34.778052+0000 mgr.a (mgr.14373) 19129 : cluster [DBG] pgmap v13268: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:59:36.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:59:36 smithi047 bash[22744]: cluster 2024-09-16T12:59:34.778052+0000 mgr.a (mgr.14373) 19129 : cluster [DBG] pgmap v13268: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:59:38.268 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:59:38.269 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:59:38.269 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:59:38.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:59:38 smithi157 bash[24585]: cluster 2024-09-16T12:59:36.780232+0000 mgr.a (mgr.14373) 19130 : cluster [DBG] pgmap v13269: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:59:38.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:59:38 smithi086 bash[24289]: cluster 2024-09-16T12:59:36.780232+0000 mgr.a (mgr.14373) 19130 : cluster [DBG] pgmap v13269: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:59:38.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:59:38 smithi047 bash[22744]: cluster 2024-09-16T12:59:36.780232+0000 mgr.a (mgr.14373) 19130 : cluster [DBG] pgmap v13269: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:59:39.061 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:59:39.061 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:59:39.061 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:59:39.062 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:59:39.062 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:59:40.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:59:40 smithi157 bash[24585]: audit 2024-09-16T12:59:38.602385+0000 mgr.a (mgr.14373) 19131 : audit [DBG] from='client.409803 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:59:40.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:59:40 smithi157 bash[24585]: cluster 2024-09-16T12:59:38.780839+0000 mgr.a (mgr.14373) 19132 : cluster [DBG] pgmap v13270: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:59:40.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:59:40 smithi086 bash[24289]: audit 2024-09-16T12:59:38.602385+0000 mgr.a (mgr.14373) 19131 : audit [DBG] from='client.409803 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:59:40.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:59:40 smithi086 bash[24289]: cluster 2024-09-16T12:59:38.780839+0000 mgr.a (mgr.14373) 19132 : cluster [DBG] pgmap v13270: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:59:40.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:59:40 smithi047 bash[22744]: audit 2024-09-16T12:59:38.602385+0000 mgr.a (mgr.14373) 19131 : audit [DBG] from='client.409803 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:59:40.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:59:40 smithi047 bash[22744]: cluster 2024-09-16T12:59:38.780839+0000 mgr.a (mgr.14373) 19132 : cluster [DBG] pgmap v13270: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:59:42.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:59:42 smithi157 bash[24585]: cluster 2024-09-16T12:59:40.781726+0000 mgr.a (mgr.14373) 19133 : cluster [DBG] pgmap v13271: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:59:42.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:59:42 smithi086 bash[24289]: cluster 2024-09-16T12:59:40.781726+0000 mgr.a (mgr.14373) 19133 : cluster [DBG] pgmap v13271: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:59:42.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:59:42 smithi047 bash[22744]: cluster 2024-09-16T12:59:40.781726+0000 mgr.a (mgr.14373) 19133 : cluster [DBG] pgmap v13271: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:59:44.063 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:59:44.063 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:59:44.063 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:59:44.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:59:44 smithi157 bash[24585]: cluster 2024-09-16T12:59:42.783998+0000 mgr.a (mgr.14373) 19134 : cluster [DBG] pgmap v13272: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:59:44.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:59:44 smithi086 bash[24289]: cluster 2024-09-16T12:59:42.783998+0000 mgr.a (mgr.14373) 19134 : cluster [DBG] pgmap v13272: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:59:44.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:59:44 smithi047 bash[22744]: cluster 2024-09-16T12:59:42.783998+0000 mgr.a (mgr.14373) 19134 : cluster [DBG] pgmap v13272: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:59:44.843 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:59:44.844 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:59:44.844 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:59:44.844 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:59:44.844 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:59:45.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:59:45 smithi157 bash[24585]: audit 2024-09-16T12:59:44.395341+0000 mgr.a (mgr.14373) 19135 : audit [DBG] from='client.409878 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:59:45.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:59:45 smithi086 bash[24289]: audit 2024-09-16T12:59:44.395341+0000 mgr.a (mgr.14373) 19135 : audit [DBG] from='client.409878 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:59:45.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:59:45 smithi047 bash[22744]: audit 2024-09-16T12:59:44.395341+0000 mgr.a (mgr.14373) 19135 : audit [DBG] from='client.409878 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:59:46.809 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:59:46 smithi157 bash[24585]: cluster 2024-09-16T12:59:44.784521+0000 mgr.a (mgr.14373) 19136 : cluster [DBG] pgmap v13273: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:59:46.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:59:46 smithi086 bash[24289]: cluster 2024-09-16T12:59:44.784521+0000 mgr.a (mgr.14373) 19136 : cluster [DBG] pgmap v13273: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:59:46.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:59:46 smithi047 bash[22744]: cluster 2024-09-16T12:59:44.784521+0000 mgr.a (mgr.14373) 19136 : cluster [DBG] pgmap v13273: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:59:48.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:59:48 smithi157 bash[24585]: cluster 2024-09-16T12:59:46.786829+0000 mgr.a (mgr.14373) 19137 : cluster [DBG] pgmap v13274: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:59:48.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:59:48 smithi086 bash[24289]: cluster 2024-09-16T12:59:46.786829+0000 mgr.a (mgr.14373) 19137 : cluster [DBG] pgmap v13274: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:59:48.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:59:48 smithi047 bash[22744]: cluster 2024-09-16T12:59:46.786829+0000 mgr.a (mgr.14373) 19137 : cluster [DBG] pgmap v13274: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:59:49.845 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:59:49.846 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:59:49.846 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:59:50.634 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:59:50.634 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:59:50.634 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:59:50.634 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:59:50.634 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:59:50.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:59:50 smithi157 bash[24585]: cluster 2024-09-16T12:59:48.787773+0000 mgr.a (mgr.14373) 19138 : cluster [DBG] pgmap v13275: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:59:50.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:59:50 smithi086 bash[24289]: cluster 2024-09-16T12:59:48.787773+0000 mgr.a (mgr.14373) 19138 : cluster [DBG] pgmap v13275: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:59:50.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:59:50 smithi047 bash[22744]: cluster 2024-09-16T12:59:48.787773+0000 mgr.a (mgr.14373) 19138 : cluster [DBG] pgmap v13275: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:59:51.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:59:51 smithi157 bash[24585]: audit 2024-09-16T12:59:50.176143+0000 mgr.a (mgr.14373) 19139 : audit [DBG] from='client.409956 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:59:51.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:59:51 smithi086 bash[24289]: audit 2024-09-16T12:59:50.176143+0000 mgr.a (mgr.14373) 19139 : audit [DBG] from='client.409956 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:59:51.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:59:51 smithi047 bash[22744]: audit 2024-09-16T12:59:50.176143+0000 mgr.a (mgr.14373) 19139 : audit [DBG] from='client.409956 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:59:52.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:59:52 smithi157 bash[24585]: cluster 2024-09-16T12:59:50.788738+0000 mgr.a (mgr.14373) 19140 : cluster [DBG] pgmap v13276: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:59:52.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:59:52 smithi086 bash[24289]: cluster 2024-09-16T12:59:50.788738+0000 mgr.a (mgr.14373) 19140 : cluster [DBG] pgmap v13276: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:59:52.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:59:52 smithi047 bash[22744]: cluster 2024-09-16T12:59:50.788738+0000 mgr.a (mgr.14373) 19140 : cluster [DBG] pgmap v13276: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:59:54.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:59:54 smithi157 bash[24585]: cluster 2024-09-16T12:59:52.791033+0000 mgr.a (mgr.14373) 19141 : cluster [DBG] pgmap v13277: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:59:54.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:59:54 smithi086 bash[24289]: cluster 2024-09-16T12:59:52.791033+0000 mgr.a (mgr.14373) 19141 : cluster [DBG] pgmap v13277: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:59:54.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:59:54 smithi047 bash[22744]: cluster 2024-09-16T12:59:52.791033+0000 mgr.a (mgr.14373) 19141 : cluster [DBG] pgmap v13277: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:59:55.635 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T12:59:55.636 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T12:59:55.636 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T12:59:56.406 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T12:59:56.407 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T12:59:56.407 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T12:59:56.407 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T12:59:56.407 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T12:59:56.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:59:56 smithi157 bash[24585]: cluster 2024-09-16T12:59:54.791773+0000 mgr.a (mgr.14373) 19142 : cluster [DBG] pgmap v13278: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:59:56.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:59:56 smithi086 bash[24289]: cluster 2024-09-16T12:59:54.791773+0000 mgr.a (mgr.14373) 19142 : cluster [DBG] pgmap v13278: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:59:56.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:59:56 smithi047 bash[22744]: cluster 2024-09-16T12:59:54.791773+0000 mgr.a (mgr.14373) 19142 : cluster [DBG] pgmap v13278: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T12:59:57.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:59:57 smithi157 bash[24585]: audit 2024-09-16T12:59:55.973638+0000 mgr.a (mgr.14373) 19143 : audit [DBG] from='client.410034 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:59:57.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:59:57 smithi086 bash[24289]: audit 2024-09-16T12:59:55.973638+0000 mgr.a (mgr.14373) 19143 : audit [DBG] from='client.410034 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:59:57.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:59:57 smithi047 bash[22744]: audit 2024-09-16T12:59:55.973638+0000 mgr.a (mgr.14373) 19143 : audit [DBG] from='client.410034 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T12:59:58.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:59:58 smithi157 bash[24585]: cluster 2024-09-16T12:59:56.794074+0000 mgr.a (mgr.14373) 19144 : cluster [DBG] pgmap v13279: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:59:58.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:59:58 smithi157 bash[24585]: audit 2024-09-16T12:59:57.677990+0000 mon.b (mon.2) 1730 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T12:59:58.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:59:58 smithi086 bash[24289]: cluster 2024-09-16T12:59:56.794074+0000 mgr.a (mgr.14373) 19144 : cluster [DBG] pgmap v13279: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:59:58.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:59:58 smithi086 bash[24289]: audit 2024-09-16T12:59:57.677990+0000 mon.b (mon.2) 1730 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T12:59:58.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:59:58 smithi047 bash[22744]: cluster 2024-09-16T12:59:56.794074+0000 mgr.a (mgr.14373) 19144 : cluster [DBG] pgmap v13279: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T12:59:58.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:59:58 smithi047 bash[22744]: audit 2024-09-16T12:59:57.677990+0000 mon.b (mon.2) 1730 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T12:59:59.593 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 12:59:59 smithi047 bash[22994]: debug 2024-09-16T12:59:59.267+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T12:59:59.593 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 12:59:59 smithi047 bash[22994]: debug 2024-09-16T12:59:59.271+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T12:59:59.594 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:59:59 smithi047 bash[22744]: audit 2024-09-16T12:59:58.503203+0000 mon.b (mon.2) 1731 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T12:59:59.594 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:59:59 smithi047 bash[22744]: audit 2024-09-16T12:59:58.505188+0000 mon.b (mon.2) 1732 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T12:59:59.594 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:59:59 smithi047 bash[22744]: audit 2024-09-16T12:59:58.515986+0000 mon.a (mon.0) 1708 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:59:59.594 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:59:59 smithi047 bash[22744]: audit 2024-09-16T12:59:58.521150+0000 mon.b (mon.2) 1733 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:59:59.594 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 12:59:59 smithi047 bash[22744]: audit 2024-09-16T12:59:58.523024+0000 mgr.a (mgr.14373) 19145 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:59:59.808 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:59:59 smithi157 bash[24585]: audit 2024-09-16T12:59:58.503203+0000 mon.b (mon.2) 1731 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T12:59:59.808 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:59:59 smithi157 bash[24585]: audit 2024-09-16T12:59:58.505188+0000 mon.b (mon.2) 1732 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T12:59:59.808 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:59:59 smithi157 bash[24585]: audit 2024-09-16T12:59:58.515986+0000 mon.a (mon.0) 1708 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:59:59.808 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:59:59 smithi157 bash[24585]: audit 2024-09-16T12:59:58.521150+0000 mon.b (mon.2) 1733 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:59:59.808 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 12:59:59 smithi157 bash[24585]: audit 2024-09-16T12:59:58.523024+0000 mgr.a (mgr.14373) 19145 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:59:59.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:59:59 smithi086 bash[24289]: audit 2024-09-16T12:59:58.503203+0000 mon.b (mon.2) 1731 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T12:59:59.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:59:59 smithi086 bash[24289]: audit 2024-09-16T12:59:58.505188+0000 mon.b (mon.2) 1732 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T12:59:59.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:59:59 smithi086 bash[24289]: audit 2024-09-16T12:59:58.515986+0000 mon.a (mon.0) 1708 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T12:59:59.822 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:59:59 smithi086 bash[24289]: audit 2024-09-16T12:59:58.521150+0000 mon.b (mon.2) 1733 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T12:59:59.822 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 12:59:59 smithi086 bash[24289]: audit 2024-09-16T12:59:58.523024+0000 mgr.a (mgr.14373) 19145 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T13:00:00.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:00:00 smithi157 bash[24585]: cluster 2024-09-16T12:59:58.794619+0000 mgr.a (mgr.14373) 19146 : cluster [DBG] pgmap v13280: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:00:00.808 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:00:00 smithi157 bash[24585]: audit 2024-09-16T12:59:59.274314+0000 mgr.a (mgr.14373) 19147 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T13:00:00.808 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:00:00 smithi157 bash[24585]: cephadm 2024-09-16T12:59:59.276322+0000 mgr.a (mgr.14373) 19148 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T13:00:00.808 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:00:00 smithi157 bash[24585]: cluster 2024-09-16T13:00:00.000146+0000 mon.a (mon.0) 1709 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-16T13:00:00.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:00:00 smithi086 bash[24289]: cluster 2024-09-16T12:59:58.794619+0000 mgr.a (mgr.14373) 19146 : cluster [DBG] pgmap v13280: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:00:00.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:00:00 smithi086 bash[24289]: audit 2024-09-16T12:59:59.274314+0000 mgr.a (mgr.14373) 19147 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T13:00:00.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:00:00 smithi086 bash[24289]: cephadm 2024-09-16T12:59:59.276322+0000 mgr.a (mgr.14373) 19148 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T13:00:00.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:00:00 smithi086 bash[24289]: cluster 2024-09-16T13:00:00.000146+0000 mon.a (mon.0) 1709 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-16T13:00:00.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:00:00 smithi047 bash[22744]: cluster 2024-09-16T12:59:58.794619+0000 mgr.a (mgr.14373) 19146 : cluster [DBG] pgmap v13280: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:00:00.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:00:00 smithi047 bash[22744]: audit 2024-09-16T12:59:59.274314+0000 mgr.a (mgr.14373) 19147 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T13:00:00.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:00:00 smithi047 bash[22744]: cephadm 2024-09-16T12:59:59.276322+0000 mgr.a (mgr.14373) 19148 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T13:00:00.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:00:00 smithi047 bash[22744]: cluster 2024-09-16T13:00:00.000146+0000 mon.a (mon.0) 1709 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-16T13:00:01.408 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T13:00:01.409 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T13:00:01.409 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T13:00:02.180 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T13:00:02.181 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T13:00:02.181 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T13:00:02.181 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T13:00:02.181 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T13:00:02.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:00:02 smithi157 bash[24585]: cluster 2024-09-16T13:00:00.795634+0000 mgr.a (mgr.14373) 19149 : cluster [DBG] pgmap v13281: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:00:02.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:00:02 smithi086 bash[24289]: cluster 2024-09-16T13:00:00.795634+0000 mgr.a (mgr.14373) 19149 : cluster [DBG] pgmap v13281: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:00:02.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:00:02 smithi047 bash[22744]: cluster 2024-09-16T13:00:00.795634+0000 mgr.a (mgr.14373) 19149 : cluster [DBG] pgmap v13281: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:00:03.809 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:00:03 smithi157 bash[24585]: audit 2024-09-16T13:00:01.745302+0000 mgr.a (mgr.14373) 19150 : audit [DBG] from='client.410214 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:00:03.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:00:03 smithi086 bash[24289]: audit 2024-09-16T13:00:01.745302+0000 mgr.a (mgr.14373) 19150 : audit [DBG] from='client.410214 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:00:03.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:00:03 smithi047 bash[22744]: audit 2024-09-16T13:00:01.745302+0000 mgr.a (mgr.14373) 19150 : audit [DBG] from='client.410214 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:00:04.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:00:04 smithi157 bash[24585]: cluster 2024-09-16T13:00:02.798601+0000 mgr.a (mgr.14373) 19151 : cluster [DBG] pgmap v13282: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T13:00:04.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:00:04 smithi086 bash[24289]: cluster 2024-09-16T13:00:02.798601+0000 mgr.a (mgr.14373) 19151 : cluster [DBG] pgmap v13282: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T13:00:04.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:00:04 smithi047 bash[22744]: cluster 2024-09-16T13:00:02.798601+0000 mgr.a (mgr.14373) 19151 : cluster [DBG] pgmap v13282: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T13:00:06.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:00:06 smithi157 bash[24585]: cluster 2024-09-16T13:00:04.799392+0000 mgr.a (mgr.14373) 19152 : cluster [DBG] pgmap v13283: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T13:00:06.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:00:06 smithi086 bash[24289]: cluster 2024-09-16T13:00:04.799392+0000 mgr.a (mgr.14373) 19152 : cluster [DBG] pgmap v13283: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T13:00:06.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:00:06 smithi047 bash[22744]: cluster 2024-09-16T13:00:04.799392+0000 mgr.a (mgr.14373) 19152 : cluster [DBG] pgmap v13283: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T13:00:07.182 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T13:00:07.182 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T13:00:07.183 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T13:00:07.947 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T13:00:07.947 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T13:00:07.947 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T13:00:07.947 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T13:00:07.947 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T13:00:08.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:00:08 smithi157 bash[24585]: cluster 2024-09-16T13:00:06.801384+0000 mgr.a (mgr.14373) 19153 : cluster [DBG] pgmap v13284: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T13:00:08.808 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:00:08 smithi157 bash[24585]: audit 2024-09-16T13:00:07.514374+0000 mgr.a (mgr.14373) 19154 : audit [DBG] from='client.410289 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:00:08.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:00:08 smithi086 bash[24289]: cluster 2024-09-16T13:00:06.801384+0000 mgr.a (mgr.14373) 19153 : cluster [DBG] pgmap v13284: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T13:00:08.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:00:08 smithi086 bash[24289]: audit 2024-09-16T13:00:07.514374+0000 mgr.a (mgr.14373) 19154 : audit [DBG] from='client.410289 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:00:08.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:00:08 smithi047 bash[22744]: cluster 2024-09-16T13:00:06.801384+0000 mgr.a (mgr.14373) 19153 : cluster [DBG] pgmap v13284: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T13:00:08.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:00:08 smithi047 bash[22744]: audit 2024-09-16T13:00:07.514374+0000 mgr.a (mgr.14373) 19154 : audit [DBG] from='client.410289 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:00:10.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:00:10 smithi157 bash[24585]: cluster 2024-09-16T13:00:08.802381+0000 mgr.a (mgr.14373) 19155 : cluster [DBG] pgmap v13285: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T13:00:10.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:00:10 smithi086 bash[24289]: cluster 2024-09-16T13:00:08.802381+0000 mgr.a (mgr.14373) 19155 : cluster [DBG] pgmap v13285: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T13:00:10.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:00:10 smithi047 bash[22744]: cluster 2024-09-16T13:00:08.802381+0000 mgr.a (mgr.14373) 19155 : cluster [DBG] pgmap v13285: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T13:00:12.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:00:12 smithi157 bash[24585]: cluster 2024-09-16T13:00:10.803129+0000 mgr.a (mgr.14373) 19156 : cluster [DBG] pgmap v13286: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T13:00:12.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:00:12 smithi086 bash[24289]: cluster 2024-09-16T13:00:10.803129+0000 mgr.a (mgr.14373) 19156 : cluster [DBG] pgmap v13286: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T13:00:12.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:00:12 smithi047 bash[22744]: cluster 2024-09-16T13:00:10.803129+0000 mgr.a (mgr.14373) 19156 : cluster [DBG] pgmap v13286: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T13:00:12.948 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T13:00:12.949 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T13:00:12.949 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T13:00:13.723 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T13:00:13.724 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T13:00:13.724 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T13:00:13.724 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T13:00:13.724 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T13:00:14.808 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:00:14 smithi157 bash[24585]: cluster 2024-09-16T13:00:12.805362+0000 mgr.a (mgr.14373) 19157 : cluster [DBG] pgmap v13287: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T13:00:14.808 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:00:14 smithi157 bash[24585]: audit 2024-09-16T13:00:13.281089+0000 mgr.a (mgr.14373) 19158 : audit [DBG] from='client.410367 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:00:14.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:00:14 smithi086 bash[24289]: cluster 2024-09-16T13:00:12.805362+0000 mgr.a (mgr.14373) 19157 : cluster [DBG] pgmap v13287: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T13:00:14.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:00:14 smithi086 bash[24289]: audit 2024-09-16T13:00:13.281089+0000 mgr.a (mgr.14373) 19158 : audit [DBG] from='client.410367 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:00:14.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:00:14 smithi047 bash[22744]: cluster 2024-09-16T13:00:12.805362+0000 mgr.a (mgr.14373) 19157 : cluster [DBG] pgmap v13287: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T13:00:14.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:00:14 smithi047 bash[22744]: audit 2024-09-16T13:00:13.281089+0000 mgr.a (mgr.14373) 19158 : audit [DBG] from='client.410367 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:00:16.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:00:16 smithi086 bash[24289]: cluster 2024-09-16T13:00:14.806276+0000 mgr.a (mgr.14373) 19159 : cluster [DBG] pgmap v13288: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:00:16.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:00:16 smithi047 bash[22744]: cluster 2024-09-16T13:00:14.806276+0000 mgr.a (mgr.14373) 19159 : cluster [DBG] pgmap v13288: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:00:17.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:00:16 smithi157 bash[24585]: cluster 2024-09-16T13:00:14.806276+0000 mgr.a (mgr.14373) 19159 : cluster [DBG] pgmap v13288: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:00:18.725 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T13:00:18.726 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T13:00:18.726 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T13:00:18.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:00:18 smithi086 bash[24289]: cluster 2024-09-16T13:00:16.808486+0000 mgr.a (mgr.14373) 19160 : cluster [DBG] pgmap v13289: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T13:00:18.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:00:18 smithi047 bash[22744]: cluster 2024-09-16T13:00:16.808486+0000 mgr.a (mgr.14373) 19160 : cluster [DBG] pgmap v13289: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T13:00:19.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:00:18 smithi157 bash[24585]: cluster 2024-09-16T13:00:16.808486+0000 mgr.a (mgr.14373) 19160 : cluster [DBG] pgmap v13289: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T13:00:19.473 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T13:00:19.474 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T13:00:19.474 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T13:00:19.474 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T13:00:19.474 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T13:00:20.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:00:20 smithi086 bash[24289]: cluster 2024-09-16T13:00:18.809129+0000 mgr.a (mgr.14373) 19161 : cluster [DBG] pgmap v13290: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:00:20.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:00:20 smithi086 bash[24289]: audit 2024-09-16T13:00:19.050577+0000 mgr.a (mgr.14373) 19162 : audit [DBG] from='client.410445 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:00:20.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:00:20 smithi047 bash[22744]: cluster 2024-09-16T13:00:18.809129+0000 mgr.a (mgr.14373) 19161 : cluster [DBG] pgmap v13290: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:00:20.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:00:20 smithi047 bash[22744]: audit 2024-09-16T13:00:19.050577+0000 mgr.a (mgr.14373) 19162 : audit [DBG] from='client.410445 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:00:21.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:00:20 smithi157 bash[24585]: cluster 2024-09-16T13:00:18.809129+0000 mgr.a (mgr.14373) 19161 : cluster [DBG] pgmap v13290: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:00:21.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:00:20 smithi157 bash[24585]: audit 2024-09-16T13:00:19.050577+0000 mgr.a (mgr.14373) 19162 : audit [DBG] from='client.410445 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:00:22.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:00:22 smithi047 bash[22744]: cluster 2024-09-16T13:00:20.810056+0000 mgr.a (mgr.14373) 19163 : cluster [DBG] pgmap v13291: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:00:23.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:00:22 smithi157 bash[24585]: cluster 2024-09-16T13:00:20.810056+0000 mgr.a (mgr.14373) 19163 : cluster [DBG] pgmap v13291: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:00:23.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:00:22 smithi086 bash[24289]: cluster 2024-09-16T13:00:20.810056+0000 mgr.a (mgr.14373) 19163 : cluster [DBG] pgmap v13291: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:00:24.475 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T13:00:24.476 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T13:00:24.476 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T13:00:24.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:00:24 smithi047 bash[22744]: cluster 2024-09-16T13:00:22.812330+0000 mgr.a (mgr.14373) 19164 : cluster [DBG] pgmap v13292: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T13:00:25.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:00:24 smithi157 bash[24585]: cluster 2024-09-16T13:00:22.812330+0000 mgr.a (mgr.14373) 19164 : cluster [DBG] pgmap v13292: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T13:00:25.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:00:24 smithi086 bash[24289]: cluster 2024-09-16T13:00:22.812330+0000 mgr.a (mgr.14373) 19164 : cluster [DBG] pgmap v13292: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T13:00:25.236 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T13:00:25.236 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T13:00:25.236 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T13:00:25.236 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T13:00:25.236 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T13:00:26.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:00:26 smithi047 bash[22744]: audit 2024-09-16T13:00:24.803974+0000 mgr.a (mgr.14373) 19165 : audit [DBG] from='client.410523 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:00:26.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:00:26 smithi047 bash[22744]: cluster 2024-09-16T13:00:24.822190+0000 mgr.a (mgr.14373) 19166 : cluster [DBG] pgmap v13293: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:00:27.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:00:26 smithi157 bash[24585]: audit 2024-09-16T13:00:24.803974+0000 mgr.a (mgr.14373) 19165 : audit [DBG] from='client.410523 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:00:27.058 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:00:26 smithi157 bash[24585]: cluster 2024-09-16T13:00:24.822190+0000 mgr.a (mgr.14373) 19166 : cluster [DBG] pgmap v13293: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:00:27.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:00:26 smithi086 bash[24289]: audit 2024-09-16T13:00:24.803974+0000 mgr.a (mgr.14373) 19165 : audit [DBG] from='client.410523 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:00:27.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:00:26 smithi086 bash[24289]: cluster 2024-09-16T13:00:24.822190+0000 mgr.a (mgr.14373) 19166 : cluster [DBG] pgmap v13293: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:00:28.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:00:28 smithi047 bash[22744]: cluster 2024-09-16T13:00:26.824571+0000 mgr.a (mgr.14373) 19167 : cluster [DBG] pgmap v13294: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T13:00:29.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:00:28 smithi157 bash[24585]: cluster 2024-09-16T13:00:26.824571+0000 mgr.a (mgr.14373) 19167 : cluster [DBG] pgmap v13294: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T13:00:29.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:00:28 smithi086 bash[24289]: cluster 2024-09-16T13:00:26.824571+0000 mgr.a (mgr.14373) 19167 : cluster [DBG] pgmap v13294: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T13:00:30.237 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T13:00:30.238 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T13:00:30.238 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T13:00:30.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:00:30 smithi047 bash[22744]: cluster 2024-09-16T13:00:28.825359+0000 mgr.a (mgr.14373) 19168 : cluster [DBG] pgmap v13295: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:00:31.023 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T13:00:31.023 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T13:00:31.023 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T13:00:31.023 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T13:00:31.023 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T13:00:31.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:00:30 smithi157 bash[24585]: cluster 2024-09-16T13:00:28.825359+0000 mgr.a (mgr.14373) 19168 : cluster [DBG] pgmap v13295: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:00:31.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:00:30 smithi086 bash[24289]: cluster 2024-09-16T13:00:28.825359+0000 mgr.a (mgr.14373) 19168 : cluster [DBG] pgmap v13295: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:00:32.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:00:31 smithi157 bash[24585]: audit 2024-09-16T13:00:30.572091+0000 mgr.a (mgr.14373) 19169 : audit [DBG] from='client.410595 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:00:32.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:00:31 smithi086 bash[24289]: audit 2024-09-16T13:00:30.572091+0000 mgr.a (mgr.14373) 19169 : audit [DBG] from='client.410595 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:00:32.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:00:31 smithi047 bash[22744]: audit 2024-09-16T13:00:30.572091+0000 mgr.a (mgr.14373) 19169 : audit [DBG] from='client.410595 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:00:33.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:00:32 smithi157 bash[24585]: cluster 2024-09-16T13:00:30.826031+0000 mgr.a (mgr.14373) 19170 : cluster [DBG] pgmap v13296: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:00:33.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:00:32 smithi086 bash[24289]: cluster 2024-09-16T13:00:30.826031+0000 mgr.a (mgr.14373) 19170 : cluster [DBG] pgmap v13296: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:00:33.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:00:32 smithi047 bash[22744]: cluster 2024-09-16T13:00:30.826031+0000 mgr.a (mgr.14373) 19170 : cluster [DBG] pgmap v13296: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:00:34.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:00:33 smithi157 bash[24585]: cluster 2024-09-16T13:00:32.828456+0000 mgr.a (mgr.14373) 19171 : cluster [DBG] pgmap v13297: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T13:00:34.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:00:33 smithi086 bash[24289]: cluster 2024-09-16T13:00:32.828456+0000 mgr.a (mgr.14373) 19171 : cluster [DBG] pgmap v13297: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T13:00:34.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:00:33 smithi047 bash[22744]: cluster 2024-09-16T13:00:32.828456+0000 mgr.a (mgr.14373) 19171 : cluster [DBG] pgmap v13297: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T13:00:36.024 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T13:00:36.025 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T13:00:36.025 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T13:00:36.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:00:35 smithi157 bash[24585]: cluster 2024-09-16T13:00:34.829246+0000 mgr.a (mgr.14373) 19172 : cluster [DBG] pgmap v13298: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:00:36.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:00:35 smithi086 bash[24289]: cluster 2024-09-16T13:00:34.829246+0000 mgr.a (mgr.14373) 19172 : cluster [DBG] pgmap v13298: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:00:36.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:00:35 smithi047 bash[22744]: cluster 2024-09-16T13:00:34.829246+0000 mgr.a (mgr.14373) 19172 : cluster [DBG] pgmap v13298: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:00:36.778 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T13:00:36.778 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T13:00:36.778 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T13:00:36.778 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T13:00:36.778 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T13:00:37.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:00:36 smithi157 bash[24585]: audit 2024-09-16T13:00:36.354481+0000 mgr.a (mgr.14373) 19173 : audit [DBG] from='client.410661 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:00:37.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:00:36 smithi086 bash[24289]: audit 2024-09-16T13:00:36.354481+0000 mgr.a (mgr.14373) 19173 : audit [DBG] from='client.410661 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:00:37.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:00:36 smithi047 bash[22744]: audit 2024-09-16T13:00:36.354481+0000 mgr.a (mgr.14373) 19173 : audit [DBG] from='client.410661 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:00:38.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:00:37 smithi157 bash[24585]: cluster 2024-09-16T13:00:36.830692+0000 mgr.a (mgr.14373) 19174 : cluster [DBG] pgmap v13299: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-16T13:00:38.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:00:37 smithi086 bash[24289]: cluster 2024-09-16T13:00:36.830692+0000 mgr.a (mgr.14373) 19174 : cluster [DBG] pgmap v13299: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-16T13:00:38.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:00:37 smithi047 bash[22744]: cluster 2024-09-16T13:00:36.830692+0000 mgr.a (mgr.14373) 19174 : cluster [DBG] pgmap v13299: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-16T13:00:40.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:00:39 smithi157 bash[24585]: cluster 2024-09-16T13:00:38.831424+0000 mgr.a (mgr.14373) 19175 : cluster [DBG] pgmap v13300: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T13:00:40.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:00:39 smithi086 bash[24289]: cluster 2024-09-16T13:00:38.831424+0000 mgr.a (mgr.14373) 19175 : cluster [DBG] pgmap v13300: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T13:00:40.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:00:39 smithi047 bash[22744]: cluster 2024-09-16T13:00:38.831424+0000 mgr.a (mgr.14373) 19175 : cluster [DBG] pgmap v13300: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T13:00:41.779 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T13:00:41.780 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T13:00:41.780 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T13:00:42.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:00:41 smithi157 bash[24585]: cluster 2024-09-16T13:00:40.832188+0000 mgr.a (mgr.14373) 19176 : cluster [DBG] pgmap v13301: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T13:00:42.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:00:41 smithi086 bash[24289]: cluster 2024-09-16T13:00:40.832188+0000 mgr.a (mgr.14373) 19176 : cluster [DBG] pgmap v13301: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T13:00:42.342 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:00:41 smithi047 bash[22744]: cluster 2024-09-16T13:00:40.832188+0000 mgr.a (mgr.14373) 19176 : cluster [DBG] pgmap v13301: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T13:00:42.537 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T13:00:42.538 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T13:00:42.538 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T13:00:42.538 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T13:00:42.538 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T13:00:43.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:00:42 smithi157 bash[24585]: audit 2024-09-16T13:00:42.113374+0000 mgr.a (mgr.14373) 19177 : audit [DBG] from='client.410736 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:00:43.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:00:42 smithi086 bash[24289]: audit 2024-09-16T13:00:42.113374+0000 mgr.a (mgr.14373) 19177 : audit [DBG] from='client.410736 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:00:43.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:00:42 smithi047 bash[22744]: audit 2024-09-16T13:00:42.113374+0000 mgr.a (mgr.14373) 19177 : audit [DBG] from='client.410736 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:00:44.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:00:43 smithi157 bash[24585]: cluster 2024-09-16T13:00:42.834889+0000 mgr.a (mgr.14373) 19178 : cluster [DBG] pgmap v13302: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-16T13:00:44.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:00:43 smithi086 bash[24289]: cluster 2024-09-16T13:00:42.834889+0000 mgr.a (mgr.14373) 19178 : cluster [DBG] pgmap v13302: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-16T13:00:44.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:00:43 smithi047 bash[22744]: cluster 2024-09-16T13:00:42.834889+0000 mgr.a (mgr.14373) 19178 : cluster [DBG] pgmap v13302: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-16T13:00:46.309 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:00:45 smithi157 bash[24585]: cluster 2024-09-16T13:00:44.835661+0000 mgr.a (mgr.14373) 19179 : cluster [DBG] pgmap v13303: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T13:00:46.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:00:45 smithi086 bash[24289]: cluster 2024-09-16T13:00:44.835661+0000 mgr.a (mgr.14373) 19179 : cluster [DBG] pgmap v13303: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T13:00:46.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:00:45 smithi047 bash[22744]: cluster 2024-09-16T13:00:44.835661+0000 mgr.a (mgr.14373) 19179 : cluster [DBG] pgmap v13303: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T13:00:47.539 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T13:00:47.540 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T13:00:47.540 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T13:00:48.307 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T13:00:48.307 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T13:00:48.307 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T13:00:48.307 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T13:00:48.307 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T13:00:48.308 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:00:47 smithi157 bash[24585]: cluster 2024-09-16T13:00:46.837600+0000 mgr.a (mgr.14373) 19180 : cluster [DBG] pgmap v13304: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-16T13:00:48.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:00:47 smithi086 bash[24289]: cluster 2024-09-16T13:00:46.837600+0000 mgr.a (mgr.14373) 19180 : cluster [DBG] pgmap v13304: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-16T13:00:48.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:00:47 smithi047 bash[22744]: cluster 2024-09-16T13:00:46.837600+0000 mgr.a (mgr.14373) 19180 : cluster [DBG] pgmap v13304: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-16T13:00:49.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:00:48 smithi157 bash[24585]: audit 2024-09-16T13:00:47.875416+0000 mgr.a (mgr.14373) 19181 : audit [DBG] from='client.410814 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:00:49.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:00:48 smithi086 bash[24289]: audit 2024-09-16T13:00:47.875416+0000 mgr.a (mgr.14373) 19181 : audit [DBG] from='client.410814 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:00:49.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:00:48 smithi047 bash[22744]: audit 2024-09-16T13:00:47.875416+0000 mgr.a (mgr.14373) 19181 : audit [DBG] from='client.410814 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:00:50.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:00:49 smithi157 bash[24585]: cluster 2024-09-16T13:00:48.838572+0000 mgr.a (mgr.14373) 19182 : cluster [DBG] pgmap v13305: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:00:50.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:00:49 smithi086 bash[24289]: cluster 2024-09-16T13:00:48.838572+0000 mgr.a (mgr.14373) 19182 : cluster [DBG] pgmap v13305: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:00:50.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:00:49 smithi047 bash[22744]: cluster 2024-09-16T13:00:48.838572+0000 mgr.a (mgr.14373) 19182 : cluster [DBG] pgmap v13305: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:00:52.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:00:51 smithi157 bash[24585]: cluster 2024-09-16T13:00:50.839297+0000 mgr.a (mgr.14373) 19183 : cluster [DBG] pgmap v13306: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:00:52.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:00:51 smithi086 bash[24289]: cluster 2024-09-16T13:00:50.839297+0000 mgr.a (mgr.14373) 19183 : cluster [DBG] pgmap v13306: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:00:52.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:00:51 smithi047 bash[22744]: cluster 2024-09-16T13:00:50.839297+0000 mgr.a (mgr.14373) 19183 : cluster [DBG] pgmap v13306: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:00:53.308 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T13:00:53.309 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T13:00:53.309 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T13:00:54.093 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T13:00:54.093 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T13:00:54.093 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T13:00:54.093 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T13:00:54.093 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T13:00:54.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:00:53 smithi157 bash[24585]: cluster 2024-09-16T13:00:52.841503+0000 mgr.a (mgr.14373) 19184 : cluster [DBG] pgmap v13307: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T13:00:54.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:00:53 smithi086 bash[24289]: cluster 2024-09-16T13:00:52.841503+0000 mgr.a (mgr.14373) 19184 : cluster [DBG] pgmap v13307: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T13:00:54.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:00:53 smithi047 bash[22744]: cluster 2024-09-16T13:00:52.841503+0000 mgr.a (mgr.14373) 19184 : cluster [DBG] pgmap v13307: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T13:00:55.308 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:00:54 smithi157 bash[24585]: audit 2024-09-16T13:00:53.643979+0000 mgr.a (mgr.14373) 19185 : audit [DBG] from='client.410892 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:00:55.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:00:54 smithi086 bash[24289]: audit 2024-09-16T13:00:53.643979+0000 mgr.a (mgr.14373) 19185 : audit [DBG] from='client.410892 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:00:55.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:00:54 smithi047 bash[22744]: audit 2024-09-16T13:00:53.643979+0000 mgr.a (mgr.14373) 19185 : audit [DBG] from='client.410892 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:00:56.308 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:00:55 smithi157 bash[24585]: cluster 2024-09-16T13:00:54.842401+0000 mgr.a (mgr.14373) 19186 : cluster [DBG] pgmap v13308: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:00:56.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:00:55 smithi086 bash[24289]: cluster 2024-09-16T13:00:54.842401+0000 mgr.a (mgr.14373) 19186 : cluster [DBG] pgmap v13308: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:00:56.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:00:55 smithi047 bash[22744]: cluster 2024-09-16T13:00:54.842401+0000 mgr.a (mgr.14373) 19186 : cluster [DBG] pgmap v13308: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:00:58.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:00:57 smithi157 bash[24585]: cluster 2024-09-16T13:00:56.844552+0000 mgr.a (mgr.14373) 19187 : cluster [DBG] pgmap v13309: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T13:00:58.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:00:57 smithi086 bash[24289]: cluster 2024-09-16T13:00:56.844552+0000 mgr.a (mgr.14373) 19187 : cluster [DBG] pgmap v13309: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T13:00:58.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:00:57 smithi047 bash[22744]: cluster 2024-09-16T13:00:56.844552+0000 mgr.a (mgr.14373) 19187 : cluster [DBG] pgmap v13309: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T13:00:59.094 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T13:00:59.096 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T13:00:59.096 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T13:00:59.884 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T13:00:59.885 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T13:00:59.885 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T13:00:59.885 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T13:00:59.885 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T13:01:00.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:00:59 smithi157 bash[24585]: cluster 2024-09-16T13:00:58.845317+0000 mgr.a (mgr.14373) 19188 : cluster [DBG] pgmap v13310: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:01:00.308 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:00:59 smithi157 bash[24585]: audit 2024-09-16T13:00:59.328506+0000 mon.b (mon.2) 1734 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T13:01:00.308 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:00:59 smithi157 bash[24585]: audit 2024-09-16T13:00:59.424170+0000 mgr.a (mgr.14373) 19189 : audit [DBG] from='client.410967 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:01:00.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:00:59 smithi086 bash[24289]: cluster 2024-09-16T13:00:58.845317+0000 mgr.a (mgr.14373) 19188 : cluster [DBG] pgmap v13310: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:01:00.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:00:59 smithi086 bash[24289]: audit 2024-09-16T13:00:59.328506+0000 mon.b (mon.2) 1734 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T13:01:00.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:00:59 smithi086 bash[24289]: audit 2024-09-16T13:00:59.424170+0000 mgr.a (mgr.14373) 19189 : audit [DBG] from='client.410967 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:01:00.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:00:59 smithi047 bash[22744]: cluster 2024-09-16T13:00:58.845317+0000 mgr.a (mgr.14373) 19188 : cluster [DBG] pgmap v13310: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:01:00.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:00:59 smithi047 bash[22744]: audit 2024-09-16T13:00:59.328506+0000 mon.b (mon.2) 1734 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T13:01:00.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:00:59 smithi047 bash[22744]: audit 2024-09-16T13:00:59.424170+0000 mgr.a (mgr.14373) 19189 : audit [DBG] from='client.410967 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:01:02.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:01:01 smithi157 bash[24585]: cluster 2024-09-16T13:01:00.846214+0000 mgr.a (mgr.14373) 19190 : cluster [DBG] pgmap v13311: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:01:02.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:01:01 smithi086 bash[24289]: cluster 2024-09-16T13:01:00.846214+0000 mgr.a (mgr.14373) 19190 : cluster [DBG] pgmap v13311: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:01:02.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:01:01 smithi047 bash[22744]: cluster 2024-09-16T13:01:00.846214+0000 mgr.a (mgr.14373) 19190 : cluster [DBG] pgmap v13311: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:01:04.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:01:03 smithi157 bash[24585]: cluster 2024-09-16T13:01:02.848481+0000 mgr.a (mgr.14373) 19191 : cluster [DBG] pgmap v13312: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T13:01:04.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:01:03 smithi086 bash[24289]: cluster 2024-09-16T13:01:02.848481+0000 mgr.a (mgr.14373) 19191 : cluster [DBG] pgmap v13312: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T13:01:04.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:01:03 smithi047 bash[22744]: cluster 2024-09-16T13:01:02.848481+0000 mgr.a (mgr.14373) 19191 : cluster [DBG] pgmap v13312: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T13:01:04.886 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T13:01:04.886 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T13:01:04.886 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T13:01:05.657 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T13:01:05.658 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T13:01:05.658 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T13:01:05.658 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T13:01:05.658 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T13:01:06.058 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:01:05 smithi157 bash[24585]: audit 2024-09-16T13:01:04.668856+0000 mon.a (mon.0) 1710 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T13:01:06.058 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:01:05 smithi157 bash[24585]: audit 2024-09-16T13:01:04.681151+0000 mon.a (mon.0) 1711 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T13:01:06.058 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:01:05 smithi157 bash[24585]: audit 2024-09-16T13:01:04.701490+0000 mon.a (mon.0) 1712 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T13:01:06.058 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:01:05 smithi157 bash[24585]: audit 2024-09-16T13:01:04.706857+0000 mon.a (mon.0) 1713 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T13:01:06.058 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:01:05 smithi157 bash[24585]: audit 2024-09-16T13:01:04.773871+0000 mon.a (mon.0) 1714 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T13:01:06.058 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:01:05 smithi157 bash[24585]: audit 2024-09-16T13:01:04.781757+0000 mon.a (mon.0) 1715 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T13:01:06.059 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:01:05 smithi157 bash[24585]: cluster 2024-09-16T13:01:04.849169+0000 mgr.a (mgr.14373) 19192 : cluster [DBG] pgmap v13313: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:01:06.059 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:01:05 smithi157 bash[24585]: audit 2024-09-16T13:01:05.212704+0000 mgr.a (mgr.14373) 19193 : audit [DBG] from='client.411042 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:01:06.059 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:01:05 smithi157 bash[24585]: audit 2024-09-16T13:01:05.467756+0000 mon.b (mon.2) 1735 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T13:01:06.059 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:01:05 smithi157 bash[24585]: audit 2024-09-16T13:01:05.469446+0000 mon.b (mon.2) 1736 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T13:01:06.059 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:01:05 smithi157 bash[24585]: audit 2024-09-16T13:01:05.476411+0000 mon.a (mon.0) 1716 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T13:01:06.059 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:01:05 smithi157 bash[24585]: audit 2024-09-16T13:01:05.482411+0000 mon.b (mon.2) 1737 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T13:01:06.059 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:01:05 smithi157 bash[24585]: audit 2024-09-16T13:01:05.483667+0000 mgr.a (mgr.14373) 19194 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T13:01:06.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:01:05 smithi086 bash[24289]: audit 2024-09-16T13:01:04.668856+0000 mon.a (mon.0) 1710 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T13:01:06.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:01:05 smithi086 bash[24289]: audit 2024-09-16T13:01:04.681151+0000 mon.a (mon.0) 1711 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T13:01:06.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:01:05 smithi086 bash[24289]: audit 2024-09-16T13:01:04.701490+0000 mon.a (mon.0) 1712 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T13:01:06.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:01:05 smithi086 bash[24289]: audit 2024-09-16T13:01:04.706857+0000 mon.a (mon.0) 1713 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T13:01:06.072 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:01:05 smithi086 bash[24289]: audit 2024-09-16T13:01:04.773871+0000 mon.a (mon.0) 1714 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T13:01:06.072 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:01:05 smithi086 bash[24289]: audit 2024-09-16T13:01:04.781757+0000 mon.a (mon.0) 1715 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T13:01:06.072 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:01:05 smithi086 bash[24289]: cluster 2024-09-16T13:01:04.849169+0000 mgr.a (mgr.14373) 19192 : cluster [DBG] pgmap v13313: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:01:06.072 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:01:05 smithi086 bash[24289]: audit 2024-09-16T13:01:05.212704+0000 mgr.a (mgr.14373) 19193 : audit [DBG] from='client.411042 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:01:06.072 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:01:05 smithi086 bash[24289]: audit 2024-09-16T13:01:05.467756+0000 mon.b (mon.2) 1735 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T13:01:06.072 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:01:05 smithi086 bash[24289]: audit 2024-09-16T13:01:05.469446+0000 mon.b (mon.2) 1736 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T13:01:06.072 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:01:05 smithi086 bash[24289]: audit 2024-09-16T13:01:05.476411+0000 mon.a (mon.0) 1716 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T13:01:06.072 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:01:05 smithi086 bash[24289]: audit 2024-09-16T13:01:05.482411+0000 mon.b (mon.2) 1737 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T13:01:06.072 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:01:05 smithi086 bash[24289]: audit 2024-09-16T13:01:05.483667+0000 mgr.a (mgr.14373) 19194 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T13:01:06.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:01:05 smithi047 bash[22744]: audit 2024-09-16T13:01:04.668856+0000 mon.a (mon.0) 1710 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T13:01:06.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:01:05 smithi047 bash[22744]: audit 2024-09-16T13:01:04.681151+0000 mon.a (mon.0) 1711 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T13:01:06.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:01:05 smithi047 bash[22744]: audit 2024-09-16T13:01:04.701490+0000 mon.a (mon.0) 1712 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T13:01:06.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:01:05 smithi047 bash[22744]: audit 2024-09-16T13:01:04.706857+0000 mon.a (mon.0) 1713 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T13:01:06.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:01:05 smithi047 bash[22744]: audit 2024-09-16T13:01:04.773871+0000 mon.a (mon.0) 1714 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T13:01:06.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:01:05 smithi047 bash[22744]: audit 2024-09-16T13:01:04.781757+0000 mon.a (mon.0) 1715 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T13:01:06.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:01:05 smithi047 bash[22744]: cluster 2024-09-16T13:01:04.849169+0000 mgr.a (mgr.14373) 19192 : cluster [DBG] pgmap v13313: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:01:06.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:01:05 smithi047 bash[22744]: audit 2024-09-16T13:01:05.212704+0000 mgr.a (mgr.14373) 19193 : audit [DBG] from='client.411042 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:01:06.094 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:01:05 smithi047 bash[22744]: audit 2024-09-16T13:01:05.467756+0000 mon.b (mon.2) 1735 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T13:01:06.094 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:01:05 smithi047 bash[22744]: audit 2024-09-16T13:01:05.469446+0000 mon.b (mon.2) 1736 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T13:01:06.094 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:01:05 smithi047 bash[22744]: audit 2024-09-16T13:01:05.476411+0000 mon.a (mon.0) 1716 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T13:01:06.094 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:01:05 smithi047 bash[22744]: audit 2024-09-16T13:01:05.482411+0000 mon.b (mon.2) 1737 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T13:01:06.094 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:01:05 smithi047 bash[22744]: audit 2024-09-16T13:01:05.483667+0000 mgr.a (mgr.14373) 19194 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T13:01:06.787 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 13:01:06 smithi047 bash[22994]: debug 2024-09-16T13:01:06.378+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T13:01:06.787 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 13:01:06 smithi047 bash[22994]: debug 2024-09-16T13:01:06.382+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T13:01:07.060 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:01:06 smithi157 bash[24585]: audit 2024-09-16T13:01:06.381738+0000 mgr.a (mgr.14373) 19195 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T13:01:07.060 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:01:06 smithi157 bash[24585]: cephadm 2024-09-16T13:01:06.383971+0000 mgr.a (mgr.14373) 19196 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T13:01:07.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:01:06 smithi086 bash[24289]: audit 2024-09-16T13:01:06.381738+0000 mgr.a (mgr.14373) 19195 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T13:01:07.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:01:06 smithi086 bash[24289]: cephadm 2024-09-16T13:01:06.383971+0000 mgr.a (mgr.14373) 19196 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T13:01:07.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:01:06 smithi047 bash[22744]: audit 2024-09-16T13:01:06.381738+0000 mgr.a (mgr.14373) 19195 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T13:01:07.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:01:06 smithi047 bash[22744]: cephadm 2024-09-16T13:01:06.383971+0000 mgr.a (mgr.14373) 19196 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T13:01:08.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:01:07 smithi157 bash[24585]: cluster 2024-09-16T13:01:06.851556+0000 mgr.a (mgr.14373) 19197 : cluster [DBG] pgmap v13314: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T13:01:08.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:01:07 smithi086 bash[24289]: cluster 2024-09-16T13:01:06.851556+0000 mgr.a (mgr.14373) 19197 : cluster [DBG] pgmap v13314: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T13:01:08.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:01:07 smithi047 bash[22744]: cluster 2024-09-16T13:01:06.851556+0000 mgr.a (mgr.14373) 19197 : cluster [DBG] pgmap v13314: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T13:01:10.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:01:09 smithi157 bash[24585]: cluster 2024-09-16T13:01:08.852304+0000 mgr.a (mgr.14373) 19198 : cluster [DBG] pgmap v13315: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T13:01:10.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:01:09 smithi086 bash[24289]: cluster 2024-09-16T13:01:08.852304+0000 mgr.a (mgr.14373) 19198 : cluster [DBG] pgmap v13315: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T13:01:10.344 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:01:09 smithi047 bash[22744]: cluster 2024-09-16T13:01:08.852304+0000 mgr.a (mgr.14373) 19198 : cluster [DBG] pgmap v13315: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T13:01:10.659 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T13:01:10.660 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T13:01:10.660 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T13:01:11.443 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T13:01:11.443 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T13:01:11.443 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T13:01:11.443 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T13:01:11.444 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T13:01:12.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:01:11 smithi157 bash[24585]: cluster 2024-09-16T13:01:10.853048+0000 mgr.a (mgr.14373) 19199 : cluster [DBG] pgmap v13316: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T13:01:12.308 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:01:11 smithi157 bash[24585]: audit 2024-09-16T13:01:10.996849+0000 mgr.a (mgr.14373) 19200 : audit [DBG] from='client.411225 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:01:12.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:01:11 smithi086 bash[24289]: cluster 2024-09-16T13:01:10.853048+0000 mgr.a (mgr.14373) 19199 : cluster [DBG] pgmap v13316: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T13:01:12.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:01:11 smithi086 bash[24289]: audit 2024-09-16T13:01:10.996849+0000 mgr.a (mgr.14373) 19200 : audit [DBG] from='client.411225 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:01:12.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:01:11 smithi047 bash[22744]: cluster 2024-09-16T13:01:10.853048+0000 mgr.a (mgr.14373) 19199 : cluster [DBG] pgmap v13316: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T13:01:12.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:01:11 smithi047 bash[22744]: audit 2024-09-16T13:01:10.996849+0000 mgr.a (mgr.14373) 19200 : audit [DBG] from='client.411225 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:01:14.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:01:13 smithi157 bash[24585]: cluster 2024-09-16T13:01:12.855445+0000 mgr.a (mgr.14373) 19201 : cluster [DBG] pgmap v13317: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T13:01:14.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:01:13 smithi086 bash[24289]: cluster 2024-09-16T13:01:12.855445+0000 mgr.a (mgr.14373) 19201 : cluster [DBG] pgmap v13317: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T13:01:14.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:01:13 smithi047 bash[22744]: cluster 2024-09-16T13:01:12.855445+0000 mgr.a (mgr.14373) 19201 : cluster [DBG] pgmap v13317: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T13:01:16.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:01:15 smithi157 bash[24585]: cluster 2024-09-16T13:01:14.856255+0000 mgr.a (mgr.14373) 19202 : cluster [DBG] pgmap v13318: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T13:01:16.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:01:15 smithi086 bash[24289]: cluster 2024-09-16T13:01:14.856255+0000 mgr.a (mgr.14373) 19202 : cluster [DBG] pgmap v13318: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T13:01:16.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:01:15 smithi047 bash[22744]: cluster 2024-09-16T13:01:14.856255+0000 mgr.a (mgr.14373) 19202 : cluster [DBG] pgmap v13318: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T13:01:16.444 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T13:01:16.445 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T13:01:16.445 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T13:01:17.190 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T13:01:17.190 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T13:01:17.190 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T13:01:17.190 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T13:01:17.190 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T13:01:18.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:01:17 smithi157 bash[24585]: audit 2024-09-16T13:01:16.777754+0000 mgr.a (mgr.14373) 19203 : audit [DBG] from='client.411303 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:01:18.308 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:01:17 smithi157 bash[24585]: cluster 2024-09-16T13:01:16.857670+0000 mgr.a (mgr.14373) 19204 : cluster [DBG] pgmap v13319: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T13:01:18.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:01:17 smithi086 bash[24289]: audit 2024-09-16T13:01:16.777754+0000 mgr.a (mgr.14373) 19203 : audit [DBG] from='client.411303 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:01:18.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:01:17 smithi086 bash[24289]: cluster 2024-09-16T13:01:16.857670+0000 mgr.a (mgr.14373) 19204 : cluster [DBG] pgmap v13319: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T13:01:18.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:01:17 smithi047 bash[22744]: audit 2024-09-16T13:01:16.777754+0000 mgr.a (mgr.14373) 19203 : audit [DBG] from='client.411303 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:01:18.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:01:17 smithi047 bash[22744]: cluster 2024-09-16T13:01:16.857670+0000 mgr.a (mgr.14373) 19204 : cluster [DBG] pgmap v13319: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T13:01:20.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:01:19 smithi157 bash[24585]: cluster 2024-09-16T13:01:18.858539+0000 mgr.a (mgr.14373) 19205 : cluster [DBG] pgmap v13320: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T13:01:20.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:01:19 smithi086 bash[24289]: cluster 2024-09-16T13:01:18.858539+0000 mgr.a (mgr.14373) 19205 : cluster [DBG] pgmap v13320: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T13:01:20.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:01:19 smithi047 bash[22744]: cluster 2024-09-16T13:01:18.858539+0000 mgr.a (mgr.14373) 19205 : cluster [DBG] pgmap v13320: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T13:01:22.191 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T13:01:22.192 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T13:01:22.192 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T13:01:22.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:01:21 smithi157 bash[24585]: cluster 2024-09-16T13:01:20.859297+0000 mgr.a (mgr.14373) 19206 : cluster [DBG] pgmap v13321: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T13:01:22.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:01:21 smithi086 bash[24289]: cluster 2024-09-16T13:01:20.859297+0000 mgr.a (mgr.14373) 19206 : cluster [DBG] pgmap v13321: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T13:01:22.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:01:21 smithi047 bash[22744]: cluster 2024-09-16T13:01:20.859297+0000 mgr.a (mgr.14373) 19206 : cluster [DBG] pgmap v13321: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T13:01:22.975 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T13:01:22.975 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T13:01:22.975 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T13:01:22.975 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T13:01:22.976 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T13:01:23.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:01:22 smithi157 bash[24585]: audit 2024-09-16T13:01:22.522273+0000 mgr.a (mgr.14373) 19207 : audit [DBG] from='client.411378 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:01:23.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:01:22 smithi086 bash[24289]: audit 2024-09-16T13:01:22.522273+0000 mgr.a (mgr.14373) 19207 : audit [DBG] from='client.411378 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:01:23.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:01:22 smithi047 bash[22744]: audit 2024-09-16T13:01:22.522273+0000 mgr.a (mgr.14373) 19207 : audit [DBG] from='client.411378 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:01:24.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:01:23 smithi157 bash[24585]: cluster 2024-09-16T13:01:22.865117+0000 mgr.a (mgr.14373) 19208 : cluster [DBG] pgmap v13322: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:01:24.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:01:23 smithi086 bash[24289]: cluster 2024-09-16T13:01:22.865117+0000 mgr.a (mgr.14373) 19208 : cluster [DBG] pgmap v13322: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:01:24.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:01:23 smithi047 bash[22744]: cluster 2024-09-16T13:01:22.865117+0000 mgr.a (mgr.14373) 19208 : cluster [DBG] pgmap v13322: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:01:26.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:01:25 smithi157 bash[24585]: cluster 2024-09-16T13:01:24.865859+0000 mgr.a (mgr.14373) 19209 : cluster [DBG] pgmap v13323: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T13:01:26.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:01:25 smithi086 bash[24289]: cluster 2024-09-16T13:01:24.865859+0000 mgr.a (mgr.14373) 19209 : cluster [DBG] pgmap v13323: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T13:01:26.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:01:25 smithi047 bash[22744]: cluster 2024-09-16T13:01:24.865859+0000 mgr.a (mgr.14373) 19209 : cluster [DBG] pgmap v13323: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T13:01:27.976 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T13:01:27.977 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T13:01:27.977 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T13:01:28.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:01:27 smithi157 bash[24585]: cluster 2024-09-16T13:01:26.867805+0000 mgr.a (mgr.14373) 19210 : cluster [DBG] pgmap v13324: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:01:28.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:01:27 smithi086 bash[24289]: cluster 2024-09-16T13:01:26.867805+0000 mgr.a (mgr.14373) 19210 : cluster [DBG] pgmap v13324: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:01:28.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:01:27 smithi047 bash[22744]: cluster 2024-09-16T13:01:26.867805+0000 mgr.a (mgr.14373) 19210 : cluster [DBG] pgmap v13324: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:01:28.750 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T13:01:28.750 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T13:01:28.750 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T13:01:28.750 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T13:01:28.750 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T13:01:29.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:01:28 smithi157 bash[24585]: audit 2024-09-16T13:01:28.314759+0000 mgr.a (mgr.14373) 19211 : audit [DBG] from='client.411456 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:01:29.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:01:28 smithi086 bash[24289]: audit 2024-09-16T13:01:28.314759+0000 mgr.a (mgr.14373) 19211 : audit [DBG] from='client.411456 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:01:29.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:01:28 smithi047 bash[22744]: audit 2024-09-16T13:01:28.314759+0000 mgr.a (mgr.14373) 19211 : audit [DBG] from='client.411456 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:01:30.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:01:29 smithi157 bash[24585]: cluster 2024-09-16T13:01:28.868749+0000 mgr.a (mgr.14373) 19212 : cluster [DBG] pgmap v13325: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:01:30.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:01:29 smithi086 bash[24289]: cluster 2024-09-16T13:01:28.868749+0000 mgr.a (mgr.14373) 19212 : cluster [DBG] pgmap v13325: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:01:30.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:01:29 smithi047 bash[22744]: cluster 2024-09-16T13:01:28.868749+0000 mgr.a (mgr.14373) 19212 : cluster [DBG] pgmap v13325: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:01:32.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:01:31 smithi157 bash[24585]: cluster 2024-09-16T13:01:30.869535+0000 mgr.a (mgr.14373) 19213 : cluster [DBG] pgmap v13326: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:01:32.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:01:31 smithi086 bash[24289]: cluster 2024-09-16T13:01:30.869535+0000 mgr.a (mgr.14373) 19213 : cluster [DBG] pgmap v13326: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:01:32.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:01:31 smithi047 bash[22744]: cluster 2024-09-16T13:01:30.869535+0000 mgr.a (mgr.14373) 19213 : cluster [DBG] pgmap v13326: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:01:33.751 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T13:01:33.752 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T13:01:33.752 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T13:01:34.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:01:33 smithi157 bash[24585]: cluster 2024-09-16T13:01:32.871761+0000 mgr.a (mgr.14373) 19214 : cluster [DBG] pgmap v13327: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T13:01:34.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:01:33 smithi086 bash[24289]: cluster 2024-09-16T13:01:32.871761+0000 mgr.a (mgr.14373) 19214 : cluster [DBG] pgmap v13327: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T13:01:34.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:01:33 smithi047 bash[22744]: cluster 2024-09-16T13:01:32.871761+0000 mgr.a (mgr.14373) 19214 : cluster [DBG] pgmap v13327: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T13:01:34.503 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T13:01:34.503 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T13:01:34.503 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T13:01:34.503 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T13:01:34.504 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T13:01:35.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:01:34 smithi157 bash[24585]: audit 2024-09-16T13:01:34.078731+0000 mgr.a (mgr.14373) 19215 : audit [DBG] from='client.411531 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:01:35.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:01:34 smithi086 bash[24289]: audit 2024-09-16T13:01:34.078731+0000 mgr.a (mgr.14373) 19215 : audit [DBG] from='client.411531 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:01:35.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:01:34 smithi047 bash[22744]: audit 2024-09-16T13:01:34.078731+0000 mgr.a (mgr.14373) 19215 : audit [DBG] from='client.411531 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:01:36.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:01:35 smithi157 bash[24585]: cluster 2024-09-16T13:01:34.872771+0000 mgr.a (mgr.14373) 19216 : cluster [DBG] pgmap v13328: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:01:36.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:01:35 smithi086 bash[24289]: cluster 2024-09-16T13:01:34.872771+0000 mgr.a (mgr.14373) 19216 : cluster [DBG] pgmap v13328: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:01:36.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:01:35 smithi047 bash[22744]: cluster 2024-09-16T13:01:34.872771+0000 mgr.a (mgr.14373) 19216 : cluster [DBG] pgmap v13328: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:01:38.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:01:37 smithi157 bash[24585]: cluster 2024-09-16T13:01:36.874964+0000 mgr.a (mgr.14373) 19217 : cluster [DBG] pgmap v13329: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T13:01:38.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:01:37 smithi086 bash[24289]: cluster 2024-09-16T13:01:36.874964+0000 mgr.a (mgr.14373) 19217 : cluster [DBG] pgmap v13329: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T13:01:38.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:01:37 smithi047 bash[22744]: cluster 2024-09-16T13:01:36.874964+0000 mgr.a (mgr.14373) 19217 : cluster [DBG] pgmap v13329: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T13:01:39.505 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T13:01:39.505 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T13:01:39.505 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T13:01:40.256 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T13:01:40.256 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T13:01:40.257 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T13:01:40.257 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T13:01:40.257 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T13:01:40.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:01:39 smithi157 bash[24585]: cluster 2024-09-16T13:01:38.875716+0000 mgr.a (mgr.14373) 19218 : cluster [DBG] pgmap v13330: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:01:40.320 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:01:39 smithi086 bash[24289]: cluster 2024-09-16T13:01:38.875716+0000 mgr.a (mgr.14373) 19218 : cluster [DBG] pgmap v13330: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:01:40.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:01:39 smithi047 bash[22744]: cluster 2024-09-16T13:01:38.875716+0000 mgr.a (mgr.14373) 19218 : cluster [DBG] pgmap v13330: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:01:41.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:01:41 smithi157 bash[24585]: audit 2024-09-16T13:01:39.834931+0000 mgr.a (mgr.14373) 19219 : audit [DBG] from='client.411609 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:01:41.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:01:41 smithi086 bash[24289]: audit 2024-09-16T13:01:39.834931+0000 mgr.a (mgr.14373) 19219 : audit [DBG] from='client.411609 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:01:41.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:01:41 smithi047 bash[22744]: audit 2024-09-16T13:01:39.834931+0000 mgr.a (mgr.14373) 19219 : audit [DBG] from='client.411609 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:01:42.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:01:42 smithi157 bash[24585]: cluster 2024-09-16T13:01:40.876627+0000 mgr.a (mgr.14373) 19220 : cluster [DBG] pgmap v13331: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:01:42.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:01:42 smithi086 bash[24289]: cluster 2024-09-16T13:01:40.876627+0000 mgr.a (mgr.14373) 19220 : cluster [DBG] pgmap v13331: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:01:42.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:01:42 smithi047 bash[22744]: cluster 2024-09-16T13:01:40.876627+0000 mgr.a (mgr.14373) 19220 : cluster [DBG] pgmap v13331: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:01:44.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:01:44 smithi157 bash[24585]: cluster 2024-09-16T13:01:42.878837+0000 mgr.a (mgr.14373) 19221 : cluster [DBG] pgmap v13332: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T13:01:44.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:01:44 smithi086 bash[24289]: cluster 2024-09-16T13:01:42.878837+0000 mgr.a (mgr.14373) 19221 : cluster [DBG] pgmap v13332: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T13:01:44.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:01:44 smithi047 bash[22744]: cluster 2024-09-16T13:01:42.878837+0000 mgr.a (mgr.14373) 19221 : cluster [DBG] pgmap v13332: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T13:01:45.258 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T13:01:45.259 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T13:01:45.259 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T13:01:46.034 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T13:01:46.034 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T13:01:46.034 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T13:01:46.034 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T13:01:46.035 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T13:01:46.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:01:46 smithi157 bash[24585]: cluster 2024-09-16T13:01:44.879599+0000 mgr.a (mgr.14373) 19222 : cluster [DBG] pgmap v13333: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:01:46.308 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:01:46 smithi157 bash[24585]: audit 2024-09-16T13:01:45.596044+0000 mgr.a (mgr.14373) 19223 : audit [DBG] from='client.411687 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:01:46.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:01:46 smithi086 bash[24289]: cluster 2024-09-16T13:01:44.879599+0000 mgr.a (mgr.14373) 19222 : cluster [DBG] pgmap v13333: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:01:46.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:01:46 smithi086 bash[24289]: audit 2024-09-16T13:01:45.596044+0000 mgr.a (mgr.14373) 19223 : audit [DBG] from='client.411687 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:01:46.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:01:46 smithi047 bash[22744]: cluster 2024-09-16T13:01:44.879599+0000 mgr.a (mgr.14373) 19222 : cluster [DBG] pgmap v13333: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:01:46.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:01:46 smithi047 bash[22744]: audit 2024-09-16T13:01:45.596044+0000 mgr.a (mgr.14373) 19223 : audit [DBG] from='client.411687 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:01:48.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:01:48 smithi157 bash[24585]: cluster 2024-09-16T13:01:46.881931+0000 mgr.a (mgr.14373) 19224 : cluster [DBG] pgmap v13334: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T13:01:48.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:01:48 smithi086 bash[24289]: cluster 2024-09-16T13:01:46.881931+0000 mgr.a (mgr.14373) 19224 : cluster [DBG] pgmap v13334: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T13:01:48.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:01:48 smithi047 bash[22744]: cluster 2024-09-16T13:01:46.881931+0000 mgr.a (mgr.14373) 19224 : cluster [DBG] pgmap v13334: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T13:01:50.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:01:50 smithi157 bash[24585]: cluster 2024-09-16T13:01:48.882755+0000 mgr.a (mgr.14373) 19225 : cluster [DBG] pgmap v13335: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:01:50.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:01:50 smithi086 bash[24289]: cluster 2024-09-16T13:01:48.882755+0000 mgr.a (mgr.14373) 19225 : cluster [DBG] pgmap v13335: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:01:50.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:01:50 smithi047 bash[22744]: cluster 2024-09-16T13:01:48.882755+0000 mgr.a (mgr.14373) 19225 : cluster [DBG] pgmap v13335: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:01:51.035 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T13:01:51.036 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T13:01:51.036 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T13:01:51.789 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T13:01:51.789 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T13:01:51.789 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T13:01:51.789 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T13:01:51.789 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T13:01:52.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:01:52 smithi157 bash[24585]: cluster 2024-09-16T13:01:50.883492+0000 mgr.a (mgr.14373) 19226 : cluster [DBG] pgmap v13336: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:01:52.308 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:01:52 smithi157 bash[24585]: audit 2024-09-16T13:01:51.362391+0000 mgr.a (mgr.14373) 19227 : audit [DBG] from='client.411765 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:01:52.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:01:52 smithi086 bash[24289]: cluster 2024-09-16T13:01:50.883492+0000 mgr.a (mgr.14373) 19226 : cluster [DBG] pgmap v13336: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:01:52.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:01:52 smithi086 bash[24289]: audit 2024-09-16T13:01:51.362391+0000 mgr.a (mgr.14373) 19227 : audit [DBG] from='client.411765 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:01:52.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:01:52 smithi047 bash[22744]: cluster 2024-09-16T13:01:50.883492+0000 mgr.a (mgr.14373) 19226 : cluster [DBG] pgmap v13336: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:01:52.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:01:52 smithi047 bash[22744]: audit 2024-09-16T13:01:51.362391+0000 mgr.a (mgr.14373) 19227 : audit [DBG] from='client.411765 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:01:54.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:01:54 smithi157 bash[24585]: cluster 2024-09-16T13:01:52.886211+0000 mgr.a (mgr.14373) 19228 : cluster [DBG] pgmap v13337: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:01:54.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:01:54 smithi086 bash[24289]: cluster 2024-09-16T13:01:52.886211+0000 mgr.a (mgr.14373) 19228 : cluster [DBG] pgmap v13337: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:01:54.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:01:54 smithi047 bash[22744]: cluster 2024-09-16T13:01:52.886211+0000 mgr.a (mgr.14373) 19228 : cluster [DBG] pgmap v13337: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:01:56.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:01:56 smithi157 bash[24585]: cluster 2024-09-16T13:01:54.886965+0000 mgr.a (mgr.14373) 19229 : cluster [DBG] pgmap v13338: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T13:01:56.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:01:56 smithi086 bash[24289]: cluster 2024-09-16T13:01:54.886965+0000 mgr.a (mgr.14373) 19229 : cluster [DBG] pgmap v13338: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T13:01:56.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:01:56 smithi047 bash[22744]: cluster 2024-09-16T13:01:54.886965+0000 mgr.a (mgr.14373) 19229 : cluster [DBG] pgmap v13338: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T13:01:56.790 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T13:01:56.791 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T13:01:56.792 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T13:01:57.559 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T13:01:57.559 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T13:01:57.559 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T13:01:57.559 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T13:01:57.559 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T13:01:58.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:01:58 smithi157 bash[24585]: cluster 2024-09-16T13:01:56.887987+0000 mgr.a (mgr.14373) 19230 : cluster [DBG] pgmap v13339: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:01:58.308 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:01:58 smithi157 bash[24585]: audit 2024-09-16T13:01:57.121851+0000 mgr.a (mgr.14373) 19231 : audit [DBG] from='client.411843 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:01:58.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:01:58 smithi086 bash[24289]: cluster 2024-09-16T13:01:56.887987+0000 mgr.a (mgr.14373) 19230 : cluster [DBG] pgmap v13339: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:01:58.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:01:58 smithi086 bash[24289]: audit 2024-09-16T13:01:57.121851+0000 mgr.a (mgr.14373) 19231 : audit [DBG] from='client.411843 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:01:58.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:01:58 smithi047 bash[22744]: cluster 2024-09-16T13:01:56.887987+0000 mgr.a (mgr.14373) 19230 : cluster [DBG] pgmap v13339: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:01:58.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:01:58 smithi047 bash[22744]: audit 2024-09-16T13:01:57.121851+0000 mgr.a (mgr.14373) 19231 : audit [DBG] from='client.411843 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:02:00.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:02:00 smithi157 bash[24585]: cluster 2024-09-16T13:01:58.888842+0000 mgr.a (mgr.14373) 19232 : cluster [DBG] pgmap v13340: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T13:02:00.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:02:00 smithi086 bash[24289]: cluster 2024-09-16T13:01:58.888842+0000 mgr.a (mgr.14373) 19232 : cluster [DBG] pgmap v13340: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T13:02:00.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:02:00 smithi047 bash[22744]: cluster 2024-09-16T13:01:58.888842+0000 mgr.a (mgr.14373) 19232 : cluster [DBG] pgmap v13340: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T13:02:02.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:02:02 smithi157 bash[24585]: cluster 2024-09-16T13:02:00.889657+0000 mgr.a (mgr.14373) 19233 : cluster [DBG] pgmap v13341: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T13:02:02.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:02:02 smithi086 bash[24289]: cluster 2024-09-16T13:02:00.889657+0000 mgr.a (mgr.14373) 19233 : cluster [DBG] pgmap v13341: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T13:02:02.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:02:02 smithi047 bash[22744]: cluster 2024-09-16T13:02:00.889657+0000 mgr.a (mgr.14373) 19233 : cluster [DBG] pgmap v13341: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T13:02:02.560 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T13:02:02.561 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T13:02:02.562 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T13:02:03.327 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T13:02:03.327 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T13:02:03.327 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T13:02:03.327 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T13:02:03.327 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T13:02:04.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:02:04 smithi086 bash[24289]: audit 2024-09-16T13:02:02.890281+0000 mgr.a (mgr.14373) 19234 : audit [DBG] from='client.411921 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:02:04.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:02:04 smithi086 bash[24289]: cluster 2024-09-16T13:02:02.909038+0000 mgr.a (mgr.14373) 19235 : cluster [DBG] pgmap v13342: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:02:04.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:02:04 smithi047 bash[22744]: audit 2024-09-16T13:02:02.890281+0000 mgr.a (mgr.14373) 19234 : audit [DBG] from='client.411921 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:02:04.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:02:04 smithi047 bash[22744]: cluster 2024-09-16T13:02:02.909038+0000 mgr.a (mgr.14373) 19235 : cluster [DBG] pgmap v13342: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:02:04.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:02:04 smithi157 bash[24585]: audit 2024-09-16T13:02:02.890281+0000 mgr.a (mgr.14373) 19234 : audit [DBG] from='client.411921 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:02:04.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:02:04 smithi157 bash[24585]: cluster 2024-09-16T13:02:02.909038+0000 mgr.a (mgr.14373) 19235 : cluster [DBG] pgmap v13342: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:02:06.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:02:06 smithi086 bash[24289]: cluster 2024-09-16T13:02:04.910215+0000 mgr.a (mgr.14373) 19236 : cluster [DBG] pgmap v13343: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:02:06.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:02:06 smithi047 bash[22744]: cluster 2024-09-16T13:02:04.910215+0000 mgr.a (mgr.14373) 19236 : cluster [DBG] pgmap v13343: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:02:06.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:02:06 smithi157 bash[24585]: cluster 2024-09-16T13:02:04.910215+0000 mgr.a (mgr.14373) 19236 : cluster [DBG] pgmap v13343: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:02:07.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:02:07 smithi086 bash[24289]: audit 2024-09-16T13:02:06.438383+0000 mon.b (mon.2) 1738 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T13:02:07.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:02:07 smithi047 bash[22744]: audit 2024-09-16T13:02:06.438383+0000 mon.b (mon.2) 1738 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T13:02:07.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:02:07 smithi157 bash[24585]: audit 2024-09-16T13:02:06.438383+0000 mon.b (mon.2) 1738 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T13:02:08.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:02:08 smithi086 bash[24289]: cluster 2024-09-16T13:02:06.912453+0000 mgr.a (mgr.14373) 19237 : cluster [DBG] pgmap v13344: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T13:02:08.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:02:08 smithi086 bash[24289]: audit 2024-09-16T13:02:07.278087+0000 mon.b (mon.2) 1739 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T13:02:08.322 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:02:08 smithi086 bash[24289]: audit 2024-09-16T13:02:07.280372+0000 mon.b (mon.2) 1740 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T13:02:08.322 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:02:08 smithi086 bash[24289]: audit 2024-09-16T13:02:07.292039+0000 mon.a (mon.0) 1717 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T13:02:08.322 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:02:08 smithi086 bash[24289]: audit 2024-09-16T13:02:07.299024+0000 mon.b (mon.2) 1741 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T13:02:08.322 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:02:08 smithi086 bash[24289]: audit 2024-09-16T13:02:07.301393+0000 mgr.a (mgr.14373) 19238 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T13:02:08.328 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T13:02:08.329 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T13:02:08.329 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T13:02:08.343 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 13:02:08 smithi047 bash[22994]: debug 2024-09-16T13:02:08.060+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T13:02:08.343 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 13:02:08 smithi047 bash[22994]: debug 2024-09-16T13:02:08.060+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T13:02:08.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:02:08 smithi047 bash[22744]: cluster 2024-09-16T13:02:06.912453+0000 mgr.a (mgr.14373) 19237 : cluster [DBG] pgmap v13344: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T13:02:08.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:02:08 smithi047 bash[22744]: audit 2024-09-16T13:02:07.278087+0000 mon.b (mon.2) 1739 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T13:02:08.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:02:08 smithi047 bash[22744]: audit 2024-09-16T13:02:07.280372+0000 mon.b (mon.2) 1740 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T13:02:08.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:02:08 smithi047 bash[22744]: audit 2024-09-16T13:02:07.292039+0000 mon.a (mon.0) 1717 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T13:02:08.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:02:08 smithi047 bash[22744]: audit 2024-09-16T13:02:07.299024+0000 mon.b (mon.2) 1741 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T13:02:08.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:02:08 smithi047 bash[22744]: audit 2024-09-16T13:02:07.301393+0000 mgr.a (mgr.14373) 19238 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T13:02:08.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:02:08 smithi157 bash[24585]: cluster 2024-09-16T13:02:06.912453+0000 mgr.a (mgr.14373) 19237 : cluster [DBG] pgmap v13344: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T13:02:08.558 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:02:08 smithi157 bash[24585]: audit 2024-09-16T13:02:07.278087+0000 mon.b (mon.2) 1739 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T13:02:08.558 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:02:08 smithi157 bash[24585]: audit 2024-09-16T13:02:07.280372+0000 mon.b (mon.2) 1740 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T13:02:08.558 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:02:08 smithi157 bash[24585]: audit 2024-09-16T13:02:07.292039+0000 mon.a (mon.0) 1717 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T13:02:08.558 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:02:08 smithi157 bash[24585]: audit 2024-09-16T13:02:07.299024+0000 mon.b (mon.2) 1741 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T13:02:08.558 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:02:08 smithi157 bash[24585]: audit 2024-09-16T13:02:07.301393+0000 mgr.a (mgr.14373) 19238 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T13:02:09.090 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T13:02:09.090 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T13:02:09.090 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T13:02:09.090 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T13:02:09.090 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T13:02:09.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:02:09 smithi047 bash[22744]: audit 2024-09-16T13:02:08.062657+0000 mgr.a (mgr.14373) 19239 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T13:02:09.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:02:09 smithi047 bash[22744]: cephadm 2024-09-16T13:02:08.064925+0000 mgr.a (mgr.14373) 19240 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T13:02:09.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:02:09 smithi157 bash[24585]: audit 2024-09-16T13:02:08.062657+0000 mgr.a (mgr.14373) 19239 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T13:02:09.558 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:02:09 smithi157 bash[24585]: cephadm 2024-09-16T13:02:08.064925+0000 mgr.a (mgr.14373) 19240 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T13:02:09.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:02:09 smithi086 bash[24289]: audit 2024-09-16T13:02:08.062657+0000 mgr.a (mgr.14373) 19239 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T13:02:09.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:02:09 smithi086 bash[24289]: cephadm 2024-09-16T13:02:08.064925+0000 mgr.a (mgr.14373) 19240 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T13:02:10.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:02:10 smithi047 bash[22744]: audit 2024-09-16T13:02:08.656516+0000 mgr.a (mgr.14373) 19241 : audit [DBG] from='client.412107 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:02:10.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:02:10 smithi047 bash[22744]: cluster 2024-09-16T13:02:08.913039+0000 mgr.a (mgr.14373) 19242 : cluster [DBG] pgmap v13345: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:02:10.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:02:10 smithi157 bash[24585]: audit 2024-09-16T13:02:08.656516+0000 mgr.a (mgr.14373) 19241 : audit [DBG] from='client.412107 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:02:10.558 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:02:10 smithi157 bash[24585]: cluster 2024-09-16T13:02:08.913039+0000 mgr.a (mgr.14373) 19242 : cluster [DBG] pgmap v13345: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:02:10.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:02:10 smithi086 bash[24289]: audit 2024-09-16T13:02:08.656516+0000 mgr.a (mgr.14373) 19241 : audit [DBG] from='client.412107 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:02:10.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:02:10 smithi086 bash[24289]: cluster 2024-09-16T13:02:08.913039+0000 mgr.a (mgr.14373) 19242 : cluster [DBG] pgmap v13345: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:02:12.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:02:12 smithi047 bash[22744]: cluster 2024-09-16T13:02:10.913912+0000 mgr.a (mgr.14373) 19243 : cluster [DBG] pgmap v13346: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:02:12.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:02:12 smithi157 bash[24585]: cluster 2024-09-16T13:02:10.913912+0000 mgr.a (mgr.14373) 19243 : cluster [DBG] pgmap v13346: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:02:12.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:02:12 smithi086 bash[24289]: cluster 2024-09-16T13:02:10.913912+0000 mgr.a (mgr.14373) 19243 : cluster [DBG] pgmap v13346: 225 pgs: 225 active+clean; 589 KiB data, 274 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:02:14.090 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T13:02:14.091 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T13:02:14.091 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T13:02:14.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:02:14 smithi047 bash[22744]: cluster 2024-09-16T13:02:12.916170+0000 mgr.a (mgr.14373) 19244 : cluster [DBG] pgmap v13347: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 425 B/s wr, 7 op/s 2024-09-16T13:02:14.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:02:14 smithi157 bash[24585]: cluster 2024-09-16T13:02:12.916170+0000 mgr.a (mgr.14373) 19244 : cluster [DBG] pgmap v13347: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 425 B/s wr, 7 op/s 2024-09-16T13:02:14.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:02:14 smithi086 bash[24289]: cluster 2024-09-16T13:02:12.916170+0000 mgr.a (mgr.14373) 19244 : cluster [DBG] pgmap v13347: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 425 B/s wr, 7 op/s 2024-09-16T13:02:14.841 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T13:02:14.841 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T13:02:14.841 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T13:02:14.841 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T13:02:14.841 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T13:02:15.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:02:15 smithi157 bash[24585]: audit 2024-09-16T13:02:14.415383+0000 mgr.a (mgr.14373) 19245 : audit [DBG] from='client.412185 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:02:15.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:02:15 smithi086 bash[24289]: audit 2024-09-16T13:02:14.415383+0000 mgr.a (mgr.14373) 19245 : audit [DBG] from='client.412185 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:02:15.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:02:15 smithi047 bash[22744]: audit 2024-09-16T13:02:14.415383+0000 mgr.a (mgr.14373) 19245 : audit [DBG] from='client.412185 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:02:16.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:02:16 smithi157 bash[24585]: cluster 2024-09-16T13:02:14.917190+0000 mgr.a (mgr.14373) 19246 : cluster [DBG] pgmap v13348: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 425 B/s wr, 7 op/s 2024-09-16T13:02:16.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:02:16 smithi086 bash[24289]: cluster 2024-09-16T13:02:14.917190+0000 mgr.a (mgr.14373) 19246 : cluster [DBG] pgmap v13348: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 425 B/s wr, 7 op/s 2024-09-16T13:02:16.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:02:16 smithi047 bash[22744]: cluster 2024-09-16T13:02:14.917190+0000 mgr.a (mgr.14373) 19246 : cluster [DBG] pgmap v13348: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 425 B/s wr, 7 op/s 2024-09-16T13:02:18.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:02:18 smithi157 bash[24585]: cluster 2024-09-16T13:02:16.919418+0000 mgr.a (mgr.14373) 19247 : cluster [DBG] pgmap v13349: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T13:02:18.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:02:18 smithi086 bash[24289]: cluster 2024-09-16T13:02:16.919418+0000 mgr.a (mgr.14373) 19247 : cluster [DBG] pgmap v13349: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T13:02:18.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:02:18 smithi047 bash[22744]: cluster 2024-09-16T13:02:16.919418+0000 mgr.a (mgr.14373) 19247 : cluster [DBG] pgmap v13349: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T13:02:19.842 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T13:02:19.843 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T13:02:19.843 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T13:02:20.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:02:20 smithi157 bash[24585]: cluster 2024-09-16T13:02:18.920320+0000 mgr.a (mgr.14373) 19248 : cluster [DBG] pgmap v13350: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T13:02:20.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:02:20 smithi086 bash[24289]: cluster 2024-09-16T13:02:18.920320+0000 mgr.a (mgr.14373) 19248 : cluster [DBG] pgmap v13350: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T13:02:20.590 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T13:02:20.591 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T13:02:20.591 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T13:02:20.591 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T13:02:20.591 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T13:02:20.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:02:20 smithi047 bash[22744]: cluster 2024-09-16T13:02:18.920320+0000 mgr.a (mgr.14373) 19248 : cluster [DBG] pgmap v13350: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T13:02:21.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:02:21 smithi157 bash[24585]: audit 2024-09-16T13:02:20.167685+0000 mgr.a (mgr.14373) 19249 : audit [DBG] from='client.412263 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:02:21.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:02:21 smithi086 bash[24289]: audit 2024-09-16T13:02:20.167685+0000 mgr.a (mgr.14373) 19249 : audit [DBG] from='client.412263 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:02:21.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:02:21 smithi047 bash[22744]: audit 2024-09-16T13:02:20.167685+0000 mgr.a (mgr.14373) 19249 : audit [DBG] from='client.412263 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:02:22.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:02:22 smithi157 bash[24585]: cluster 2024-09-16T13:02:20.921299+0000 mgr.a (mgr.14373) 19250 : cluster [DBG] pgmap v13351: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T13:02:22.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:02:22 smithi086 bash[24289]: cluster 2024-09-16T13:02:20.921299+0000 mgr.a (mgr.14373) 19250 : cluster [DBG] pgmap v13351: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T13:02:22.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:02:22 smithi047 bash[22744]: cluster 2024-09-16T13:02:20.921299+0000 mgr.a (mgr.14373) 19250 : cluster [DBG] pgmap v13351: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T13:02:24.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:02:24 smithi157 bash[24585]: cluster 2024-09-16T13:02:22.923619+0000 mgr.a (mgr.14373) 19251 : cluster [DBG] pgmap v13352: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T13:02:24.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:02:24 smithi086 bash[24289]: cluster 2024-09-16T13:02:22.923619+0000 mgr.a (mgr.14373) 19251 : cluster [DBG] pgmap v13352: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T13:02:24.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:02:24 smithi047 bash[22744]: cluster 2024-09-16T13:02:22.923619+0000 mgr.a (mgr.14373) 19251 : cluster [DBG] pgmap v13352: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T13:02:25.592 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T13:02:25.592 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T13:02:25.593 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T13:02:26.375 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T13:02:26.375 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T13:02:26.375 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T13:02:26.375 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T13:02:26.375 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T13:02:26.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:02:26 smithi157 bash[24585]: cluster 2024-09-16T13:02:24.924391+0000 mgr.a (mgr.14373) 19252 : cluster [DBG] pgmap v13353: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:02:26.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:02:26 smithi086 bash[24289]: cluster 2024-09-16T13:02:24.924391+0000 mgr.a (mgr.14373) 19252 : cluster [DBG] pgmap v13353: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:02:26.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:02:26 smithi047 bash[22744]: cluster 2024-09-16T13:02:24.924391+0000 mgr.a (mgr.14373) 19252 : cluster [DBG] pgmap v13353: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:02:27.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:02:27 smithi157 bash[24585]: audit 2024-09-16T13:02:25.926866+0000 mgr.a (mgr.14373) 19253 : audit [DBG] from='client.412341 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:02:27.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:02:27 smithi086 bash[24289]: audit 2024-09-16T13:02:25.926866+0000 mgr.a (mgr.14373) 19253 : audit [DBG] from='client.412341 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:02:27.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:02:27 smithi047 bash[22744]: audit 2024-09-16T13:02:25.926866+0000 mgr.a (mgr.14373) 19253 : audit [DBG] from='client.412341 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:02:28.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:02:28 smithi157 bash[24585]: cluster 2024-09-16T13:02:26.926795+0000 mgr.a (mgr.14373) 19254 : cluster [DBG] pgmap v13354: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T13:02:28.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:02:28 smithi086 bash[24289]: cluster 2024-09-16T13:02:26.926795+0000 mgr.a (mgr.14373) 19254 : cluster [DBG] pgmap v13354: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T13:02:28.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:02:28 smithi047 bash[22744]: cluster 2024-09-16T13:02:26.926795+0000 mgr.a (mgr.14373) 19254 : cluster [DBG] pgmap v13354: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T13:02:30.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:02:30 smithi157 bash[24585]: cluster 2024-09-16T13:02:28.927554+0000 mgr.a (mgr.14373) 19255 : cluster [DBG] pgmap v13355: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:02:30.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:02:30 smithi086 bash[24289]: cluster 2024-09-16T13:02:28.927554+0000 mgr.a (mgr.14373) 19255 : cluster [DBG] pgmap v13355: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:02:30.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:02:30 smithi047 bash[22744]: cluster 2024-09-16T13:02:28.927554+0000 mgr.a (mgr.14373) 19255 : cluster [DBG] pgmap v13355: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:02:31.377 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T13:02:31.377 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T13:02:31.378 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T13:02:32.161 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T13:02:32.162 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T13:02:32.162 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T13:02:32.162 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T13:02:32.162 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T13:02:32.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:02:32 smithi157 bash[24585]: cluster 2024-09-16T13:02:30.928317+0000 mgr.a (mgr.14373) 19256 : cluster [DBG] pgmap v13356: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:02:32.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:02:32 smithi086 bash[24289]: cluster 2024-09-16T13:02:30.928317+0000 mgr.a (mgr.14373) 19256 : cluster [DBG] pgmap v13356: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:02:32.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:02:32 smithi047 bash[22744]: cluster 2024-09-16T13:02:30.928317+0000 mgr.a (mgr.14373) 19256 : cluster [DBG] pgmap v13356: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:02:33.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:02:33 smithi157 bash[24585]: audit 2024-09-16T13:02:31.709276+0000 mgr.a (mgr.14373) 19257 : audit [DBG] from='client.412419 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:02:33.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:02:33 smithi086 bash[24289]: audit 2024-09-16T13:02:31.709276+0000 mgr.a (mgr.14373) 19257 : audit [DBG] from='client.412419 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:02:33.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:02:33 smithi047 bash[22744]: audit 2024-09-16T13:02:31.709276+0000 mgr.a (mgr.14373) 19257 : audit [DBG] from='client.412419 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:02:34.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:02:34 smithi157 bash[24585]: cluster 2024-09-16T13:02:32.931220+0000 mgr.a (mgr.14373) 19258 : cluster [DBG] pgmap v13357: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:02:34.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:02:34 smithi086 bash[24289]: cluster 2024-09-16T13:02:32.931220+0000 mgr.a (mgr.14373) 19258 : cluster [DBG] pgmap v13357: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:02:34.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:02:34 smithi047 bash[22744]: cluster 2024-09-16T13:02:32.931220+0000 mgr.a (mgr.14373) 19258 : cluster [DBG] pgmap v13357: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:02:36.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:02:36 smithi157 bash[24585]: cluster 2024-09-16T13:02:34.932036+0000 mgr.a (mgr.14373) 19259 : cluster [DBG] pgmap v13358: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T13:02:36.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:02:36 smithi086 bash[24289]: cluster 2024-09-16T13:02:34.932036+0000 mgr.a (mgr.14373) 19259 : cluster [DBG] pgmap v13358: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T13:02:36.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:02:36 smithi047 bash[22744]: cluster 2024-09-16T13:02:34.932036+0000 mgr.a (mgr.14373) 19259 : cluster [DBG] pgmap v13358: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T13:02:37.162 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T13:02:37.163 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T13:02:37.164 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T13:02:37.905 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T13:02:37.905 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T13:02:37.905 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T13:02:37.905 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T13:02:37.905 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T13:02:38.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:02:38 smithi157 bash[24585]: cluster 2024-09-16T13:02:36.934015+0000 mgr.a (mgr.14373) 19260 : cluster [DBG] pgmap v13359: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:02:38.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:02:38 smithi157 bash[24585]: audit 2024-09-16T13:02:37.490275+0000 mgr.a (mgr.14373) 19261 : audit [DBG] from='client.412497 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:02:38.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:02:38 smithi086 bash[24289]: cluster 2024-09-16T13:02:36.934015+0000 mgr.a (mgr.14373) 19260 : cluster [DBG] pgmap v13359: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:02:38.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:02:38 smithi086 bash[24289]: audit 2024-09-16T13:02:37.490275+0000 mgr.a (mgr.14373) 19261 : audit [DBG] from='client.412497 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:02:38.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:02:38 smithi047 bash[22744]: cluster 2024-09-16T13:02:36.934015+0000 mgr.a (mgr.14373) 19260 : cluster [DBG] pgmap v13359: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:02:38.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:02:38 smithi047 bash[22744]: audit 2024-09-16T13:02:37.490275+0000 mgr.a (mgr.14373) 19261 : audit [DBG] from='client.412497 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:02:40.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:02:40 smithi157 bash[24585]: cluster 2024-09-16T13:02:38.935039+0000 mgr.a (mgr.14373) 19262 : cluster [DBG] pgmap v13360: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T13:02:40.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:02:40 smithi086 bash[24289]: cluster 2024-09-16T13:02:38.935039+0000 mgr.a (mgr.14373) 19262 : cluster [DBG] pgmap v13360: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T13:02:40.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:02:40 smithi047 bash[22744]: cluster 2024-09-16T13:02:38.935039+0000 mgr.a (mgr.14373) 19262 : cluster [DBG] pgmap v13360: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T13:02:42.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:02:42 smithi157 bash[24585]: cluster 2024-09-16T13:02:40.935827+0000 mgr.a (mgr.14373) 19263 : cluster [DBG] pgmap v13361: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T13:02:42.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:02:42 smithi086 bash[24289]: cluster 2024-09-16T13:02:40.935827+0000 mgr.a (mgr.14373) 19263 : cluster [DBG] pgmap v13361: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T13:02:42.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:02:42 smithi047 bash[22744]: cluster 2024-09-16T13:02:40.935827+0000 mgr.a (mgr.14373) 19263 : cluster [DBG] pgmap v13361: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T13:02:42.906 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T13:02:42.907 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T13:02:42.907 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T13:02:43.699 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T13:02:43.699 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T13:02:43.699 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T13:02:43.699 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T13:02:43.699 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T13:02:44.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:02:44 smithi157 bash[24585]: cluster 2024-09-16T13:02:42.937406+0000 mgr.a (mgr.14373) 19264 : cluster [DBG] pgmap v13362: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:02:44.558 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:02:44 smithi157 bash[24585]: audit 2024-09-16T13:02:43.247391+0000 mgr.a (mgr.14373) 19265 : audit [DBG] from='client.412575 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:02:44.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:02:44 smithi086 bash[24289]: cluster 2024-09-16T13:02:42.937406+0000 mgr.a (mgr.14373) 19264 : cluster [DBG] pgmap v13362: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:02:44.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:02:44 smithi086 bash[24289]: audit 2024-09-16T13:02:43.247391+0000 mgr.a (mgr.14373) 19265 : audit [DBG] from='client.412575 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:02:44.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:02:44 smithi047 bash[22744]: cluster 2024-09-16T13:02:42.937406+0000 mgr.a (mgr.14373) 19264 : cluster [DBG] pgmap v13362: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:02:44.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:02:44 smithi047 bash[22744]: audit 2024-09-16T13:02:43.247391+0000 mgr.a (mgr.14373) 19265 : audit [DBG] from='client.412575 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:02:46.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:02:46 smithi157 bash[24585]: cluster 2024-09-16T13:02:44.938407+0000 mgr.a (mgr.14373) 19266 : cluster [DBG] pgmap v13363: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:02:46.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:02:46 smithi086 bash[24289]: cluster 2024-09-16T13:02:44.938407+0000 mgr.a (mgr.14373) 19266 : cluster [DBG] pgmap v13363: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:02:46.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:02:46 smithi047 bash[22744]: cluster 2024-09-16T13:02:44.938407+0000 mgr.a (mgr.14373) 19266 : cluster [DBG] pgmap v13363: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:02:48.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:02:48 smithi157 bash[24585]: cluster 2024-09-16T13:02:46.940537+0000 mgr.a (mgr.14373) 19267 : cluster [DBG] pgmap v13364: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T13:02:48.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:02:48 smithi086 bash[24289]: cluster 2024-09-16T13:02:46.940537+0000 mgr.a (mgr.14373) 19267 : cluster [DBG] pgmap v13364: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T13:02:48.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:02:48 smithi047 bash[22744]: cluster 2024-09-16T13:02:46.940537+0000 mgr.a (mgr.14373) 19267 : cluster [DBG] pgmap v13364: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T13:02:48.700 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T13:02:48.701 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T13:02:48.701 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T13:02:49.446 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T13:02:49.447 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T13:02:49.447 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T13:02:49.447 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T13:02:49.447 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T13:02:50.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:02:50 smithi157 bash[24585]: cluster 2024-09-16T13:02:48.941278+0000 mgr.a (mgr.14373) 19268 : cluster [DBG] pgmap v13365: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:02:50.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:02:50 smithi157 bash[24585]: audit 2024-09-16T13:02:49.031686+0000 mgr.a (mgr.14373) 19269 : audit [DBG] from='client.412653 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:02:50.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:02:50 smithi086 bash[24289]: cluster 2024-09-16T13:02:48.941278+0000 mgr.a (mgr.14373) 19268 : cluster [DBG] pgmap v13365: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:02:50.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:02:50 smithi086 bash[24289]: audit 2024-09-16T13:02:49.031686+0000 mgr.a (mgr.14373) 19269 : audit [DBG] from='client.412653 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:02:50.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:02:50 smithi047 bash[22744]: cluster 2024-09-16T13:02:48.941278+0000 mgr.a (mgr.14373) 19268 : cluster [DBG] pgmap v13365: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:02:50.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:02:50 smithi047 bash[22744]: audit 2024-09-16T13:02:49.031686+0000 mgr.a (mgr.14373) 19269 : audit [DBG] from='client.412653 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:02:52.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:02:52 smithi157 bash[24585]: cluster 2024-09-16T13:02:50.942231+0000 mgr.a (mgr.14373) 19270 : cluster [DBG] pgmap v13366: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:02:52.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:02:52 smithi086 bash[24289]: cluster 2024-09-16T13:02:50.942231+0000 mgr.a (mgr.14373) 19270 : cluster [DBG] pgmap v13366: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:02:52.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:02:52 smithi047 bash[22744]: cluster 2024-09-16T13:02:50.942231+0000 mgr.a (mgr.14373) 19270 : cluster [DBG] pgmap v13366: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:02:54.448 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T13:02:54.449 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T13:02:54.449 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T13:02:54.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:02:54 smithi157 bash[24585]: cluster 2024-09-16T13:02:52.944484+0000 mgr.a (mgr.14373) 19271 : cluster [DBG] pgmap v13367: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T13:02:54.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:02:54 smithi086 bash[24289]: cluster 2024-09-16T13:02:52.944484+0000 mgr.a (mgr.14373) 19271 : cluster [DBG] pgmap v13367: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T13:02:54.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:02:54 smithi047 bash[22744]: cluster 2024-09-16T13:02:52.944484+0000 mgr.a (mgr.14373) 19271 : cluster [DBG] pgmap v13367: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T13:02:55.225 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T13:02:55.225 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T13:02:55.225 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T13:02:55.225 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T13:02:55.225 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T13:02:56.203 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:02:56 smithi047 bash[22744]: audit 2024-09-16T13:02:54.783915+0000 mgr.a (mgr.14373) 19272 : audit [DBG] from='client.412731 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:02:56.203 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:02:56 smithi047 bash[22744]: cluster 2024-09-16T13:02:54.945076+0000 mgr.a (mgr.14373) 19273 : cluster [DBG] pgmap v13368: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:02:56.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:02:56 smithi157 bash[24585]: audit 2024-09-16T13:02:54.783915+0000 mgr.a (mgr.14373) 19272 : audit [DBG] from='client.412731 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:02:56.558 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:02:56 smithi157 bash[24585]: cluster 2024-09-16T13:02:54.945076+0000 mgr.a (mgr.14373) 19273 : cluster [DBG] pgmap v13368: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:02:56.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:02:56 smithi086 bash[24289]: audit 2024-09-16T13:02:54.783915+0000 mgr.a (mgr.14373) 19272 : audit [DBG] from='client.412731 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:02:56.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:02:56 smithi086 bash[24289]: cluster 2024-09-16T13:02:54.945076+0000 mgr.a (mgr.14373) 19273 : cluster [DBG] pgmap v13368: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:02:58.558 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:02:58 smithi157 bash[24585]: cluster 2024-09-16T13:02:56.947453+0000 mgr.a (mgr.14373) 19274 : cluster [DBG] pgmap v13369: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T13:02:58.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:02:58 smithi086 bash[24289]: cluster 2024-09-16T13:02:56.947453+0000 mgr.a (mgr.14373) 19274 : cluster [DBG] pgmap v13369: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T13:02:58.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:02:58 smithi047 bash[22744]: cluster 2024-09-16T13:02:56.947453+0000 mgr.a (mgr.14373) 19274 : cluster [DBG] pgmap v13369: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T13:03:00.226 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T13:03:00.227 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T13:03:00.227 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T13:03:00.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:03:00 smithi157 bash[24585]: cluster 2024-09-16T13:02:58.948263+0000 mgr.a (mgr.14373) 19275 : cluster [DBG] pgmap v13370: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:03:00.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:03:00 smithi086 bash[24289]: cluster 2024-09-16T13:02:58.948263+0000 mgr.a (mgr.14373) 19275 : cluster [DBG] pgmap v13370: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:03:00.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:03:00 smithi047 bash[22744]: cluster 2024-09-16T13:02:58.948263+0000 mgr.a (mgr.14373) 19275 : cluster [DBG] pgmap v13370: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:03:01.000 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T13:03:01.000 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T13:03:01.000 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T13:03:01.000 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T13:03:01.001 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T13:03:01.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:03:01 smithi157 bash[24585]: audit 2024-09-16T13:03:00.563157+0000 mgr.a (mgr.14373) 19276 : audit [DBG] from='client.412809 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:03:01.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:03:01 smithi086 bash[24289]: audit 2024-09-16T13:03:00.563157+0000 mgr.a (mgr.14373) 19276 : audit [DBG] from='client.412809 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:03:01.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:03:01 smithi047 bash[22744]: audit 2024-09-16T13:03:00.563157+0000 mgr.a (mgr.14373) 19276 : audit [DBG] from='client.412809 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:03:02.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:03:02 smithi157 bash[24585]: cluster 2024-09-16T13:03:00.948812+0000 mgr.a (mgr.14373) 19277 : cluster [DBG] pgmap v13371: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:03:02.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:03:02 smithi086 bash[24289]: cluster 2024-09-16T13:03:00.948812+0000 mgr.a (mgr.14373) 19277 : cluster [DBG] pgmap v13371: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:03:02.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:03:02 smithi047 bash[22744]: cluster 2024-09-16T13:03:00.948812+0000 mgr.a (mgr.14373) 19277 : cluster [DBG] pgmap v13371: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:03:04.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:03:04 smithi157 bash[24585]: cluster 2024-09-16T13:03:02.951047+0000 mgr.a (mgr.14373) 19278 : cluster [DBG] pgmap v13372: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T13:03:04.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:03:04 smithi086 bash[24289]: cluster 2024-09-16T13:03:02.951047+0000 mgr.a (mgr.14373) 19278 : cluster [DBG] pgmap v13372: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T13:03:04.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:03:04 smithi047 bash[22744]: cluster 2024-09-16T13:03:02.951047+0000 mgr.a (mgr.14373) 19278 : cluster [DBG] pgmap v13372: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T13:03:06.001 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T13:03:06.002 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T13:03:06.002 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T13:03:06.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:03:06 smithi157 bash[24585]: cluster 2024-09-16T13:03:04.951780+0000 mgr.a (mgr.14373) 19279 : cluster [DBG] pgmap v13373: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:03:06.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:03:06 smithi086 bash[24289]: cluster 2024-09-16T13:03:04.951780+0000 mgr.a (mgr.14373) 19279 : cluster [DBG] pgmap v13373: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:03:06.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:03:06 smithi047 bash[22744]: cluster 2024-09-16T13:03:04.951780+0000 mgr.a (mgr.14373) 19279 : cluster [DBG] pgmap v13373: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:03:06.783 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T13:03:06.783 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T13:03:06.783 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T13:03:06.784 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T13:03:06.784 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T13:03:07.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:03:07 smithi157 bash[24585]: audit 2024-09-16T13:03:06.332315+0000 mgr.a (mgr.14373) 19280 : audit [DBG] from='client.412884 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:03:07.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:03:07 smithi086 bash[24289]: audit 2024-09-16T13:03:06.332315+0000 mgr.a (mgr.14373) 19280 : audit [DBG] from='client.412884 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:03:07.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:03:07 smithi047 bash[22744]: audit 2024-09-16T13:03:06.332315+0000 mgr.a (mgr.14373) 19280 : audit [DBG] from='client.412884 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:03:08.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:03:08 smithi157 bash[24585]: cluster 2024-09-16T13:03:06.954598+0000 mgr.a (mgr.14373) 19281 : cluster [DBG] pgmap v13374: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-16T13:03:08.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:03:08 smithi157 bash[24585]: audit 2024-09-16T13:03:08.119773+0000 mon.b (mon.2) 1742 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T13:03:08.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:03:08 smithi086 bash[24289]: cluster 2024-09-16T13:03:06.954598+0000 mgr.a (mgr.14373) 19281 : cluster [DBG] pgmap v13374: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-16T13:03:08.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:03:08 smithi086 bash[24289]: audit 2024-09-16T13:03:08.119773+0000 mon.b (mon.2) 1742 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T13:03:08.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:03:08 smithi047 bash[22744]: cluster 2024-09-16T13:03:06.954598+0000 mgr.a (mgr.14373) 19281 : cluster [DBG] pgmap v13374: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-16T13:03:08.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:03:08 smithi047 bash[22744]: audit 2024-09-16T13:03:08.119773+0000 mon.b (mon.2) 1742 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T13:03:09.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:03:09 smithi157 bash[24585]: audit 2024-09-16T13:03:08.946134+0000 mon.b (mon.2) 1743 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T13:03:09.558 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:03:09 smithi157 bash[24585]: audit 2024-09-16T13:03:08.948280+0000 mon.b (mon.2) 1744 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T13:03:09.558 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:03:09 smithi157 bash[24585]: audit 2024-09-16T13:03:08.959789+0000 mon.a (mon.0) 1718 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T13:03:09.558 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:03:09 smithi157 bash[24585]: audit 2024-09-16T13:03:08.963638+0000 mon.b (mon.2) 1745 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T13:03:09.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:03:09 smithi086 bash[24289]: audit 2024-09-16T13:03:08.946134+0000 mon.b (mon.2) 1743 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T13:03:09.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:03:09 smithi086 bash[24289]: audit 2024-09-16T13:03:08.948280+0000 mon.b (mon.2) 1744 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T13:03:09.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:03:09 smithi086 bash[24289]: audit 2024-09-16T13:03:08.959789+0000 mon.a (mon.0) 1718 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T13:03:09.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:03:09 smithi086 bash[24289]: audit 2024-09-16T13:03:08.963638+0000 mon.b (mon.2) 1745 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T13:03:09.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:03:09 smithi047 bash[22744]: audit 2024-09-16T13:03:08.946134+0000 mon.b (mon.2) 1743 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T13:03:09.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:03:09 smithi047 bash[22744]: audit 2024-09-16T13:03:08.948280+0000 mon.b (mon.2) 1744 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T13:03:09.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:03:09 smithi047 bash[22744]: audit 2024-09-16T13:03:08.959789+0000 mon.a (mon.0) 1718 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T13:03:09.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:03:09 smithi047 bash[22744]: audit 2024-09-16T13:03:08.963638+0000 mon.b (mon.2) 1745 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T13:03:10.093 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 13:03:09 smithi047 bash[22994]: debug 2024-09-16T13:03:09.703+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T13:03:10.093 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 13:03:09 smithi047 bash[22994]: debug 2024-09-16T13:03:09.707+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T13:03:10.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:03:10 smithi157 bash[24585]: cluster 2024-09-16T13:03:08.955124+0000 mgr.a (mgr.14373) 19282 : cluster [DBG] pgmap v13375: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-16T13:03:10.558 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:03:10 smithi157 bash[24585]: audit 2024-09-16T13:03:08.965052+0000 mgr.a (mgr.14373) 19283 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T13:03:10.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:03:10 smithi086 bash[24289]: cluster 2024-09-16T13:03:08.955124+0000 mgr.a (mgr.14373) 19282 : cluster [DBG] pgmap v13375: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-16T13:03:10.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:03:10 smithi086 bash[24289]: audit 2024-09-16T13:03:08.965052+0000 mgr.a (mgr.14373) 19283 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T13:03:10.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:03:10 smithi047 bash[22744]: cluster 2024-09-16T13:03:08.955124+0000 mgr.a (mgr.14373) 19282 : cluster [DBG] pgmap v13375: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-16T13:03:10.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:03:10 smithi047 bash[22744]: audit 2024-09-16T13:03:08.965052+0000 mgr.a (mgr.14373) 19283 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T13:03:11.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:03:11 smithi157 bash[24585]: audit 2024-09-16T13:03:09.708817+0000 mgr.a (mgr.14373) 19284 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T13:03:11.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:03:11 smithi157 bash[24585]: cephadm 2024-09-16T13:03:09.710854+0000 mgr.a (mgr.14373) 19285 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T13:03:11.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:03:11 smithi086 bash[24289]: audit 2024-09-16T13:03:09.708817+0000 mgr.a (mgr.14373) 19284 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T13:03:11.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:03:11 smithi086 bash[24289]: cephadm 2024-09-16T13:03:09.710854+0000 mgr.a (mgr.14373) 19285 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T13:03:11.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:03:11 smithi047 bash[22744]: audit 2024-09-16T13:03:09.708817+0000 mgr.a (mgr.14373) 19284 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T13:03:11.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:03:11 smithi047 bash[22744]: cephadm 2024-09-16T13:03:09.710854+0000 mgr.a (mgr.14373) 19285 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T13:03:11.785 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T13:03:11.786 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T13:03:11.786 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T13:03:12.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:03:12 smithi157 bash[24585]: cluster 2024-09-16T13:03:10.955981+0000 mgr.a (mgr.14373) 19286 : cluster [DBG] pgmap v13376: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-16T13:03:12.565 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T13:03:12.566 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T13:03:12.566 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T13:03:12.566 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T13:03:12.566 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T13:03:12.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:03:12 smithi086 bash[24289]: cluster 2024-09-16T13:03:10.955981+0000 mgr.a (mgr.14373) 19286 : cluster [DBG] pgmap v13376: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-16T13:03:12.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:03:12 smithi047 bash[22744]: cluster 2024-09-16T13:03:10.955981+0000 mgr.a (mgr.14373) 19286 : cluster [DBG] pgmap v13376: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-16T13:03:13.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:03:13 smithi157 bash[24585]: audit 2024-09-16T13:03:12.116245+0000 mgr.a (mgr.14373) 19287 : audit [DBG] from='client.413064 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:03:13.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:03:13 smithi086 bash[24289]: audit 2024-09-16T13:03:12.116245+0000 mgr.a (mgr.14373) 19287 : audit [DBG] from='client.413064 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:03:13.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:03:13 smithi047 bash[22744]: audit 2024-09-16T13:03:12.116245+0000 mgr.a (mgr.14373) 19287 : audit [DBG] from='client.413064 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:03:14.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:03:14 smithi157 bash[24585]: cluster 2024-09-16T13:03:12.958764+0000 mgr.a (mgr.14373) 19288 : cluster [DBG] pgmap v13377: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T13:03:14.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:03:14 smithi086 bash[24289]: cluster 2024-09-16T13:03:12.958764+0000 mgr.a (mgr.14373) 19288 : cluster [DBG] pgmap v13377: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T13:03:14.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:03:14 smithi047 bash[22744]: cluster 2024-09-16T13:03:12.958764+0000 mgr.a (mgr.14373) 19288 : cluster [DBG] pgmap v13377: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T13:03:16.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:03:16 smithi157 bash[24585]: cluster 2024-09-16T13:03:14.959554+0000 mgr.a (mgr.14373) 19289 : cluster [DBG] pgmap v13378: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T13:03:16.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:03:16 smithi086 bash[24289]: cluster 2024-09-16T13:03:14.959554+0000 mgr.a (mgr.14373) 19289 : cluster [DBG] pgmap v13378: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T13:03:16.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:03:16 smithi047 bash[22744]: cluster 2024-09-16T13:03:14.959554+0000 mgr.a (mgr.14373) 19289 : cluster [DBG] pgmap v13378: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T13:03:17.567 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T13:03:17.568 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T13:03:17.568 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T13:03:18.349 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T13:03:18.349 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T13:03:18.349 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T13:03:18.349 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T13:03:18.350 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T13:03:18.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:03:18 smithi157 bash[24585]: cluster 2024-09-16T13:03:16.961518+0000 mgr.a (mgr.14373) 19290 : cluster [DBG] pgmap v13379: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T13:03:18.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:03:18 smithi086 bash[24289]: cluster 2024-09-16T13:03:16.961518+0000 mgr.a (mgr.14373) 19290 : cluster [DBG] pgmap v13379: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T13:03:18.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:03:18 smithi047 bash[22744]: cluster 2024-09-16T13:03:16.961518+0000 mgr.a (mgr.14373) 19290 : cluster [DBG] pgmap v13379: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T13:03:19.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:03:19 smithi157 bash[24585]: audit 2024-09-16T13:03:17.905207+0000 mgr.a (mgr.14373) 19291 : audit [DBG] from='client.413142 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:03:19.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:03:19 smithi086 bash[24289]: audit 2024-09-16T13:03:17.905207+0000 mgr.a (mgr.14373) 19291 : audit [DBG] from='client.413142 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:03:19.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:03:19 smithi047 bash[22744]: audit 2024-09-16T13:03:17.905207+0000 mgr.a (mgr.14373) 19291 : audit [DBG] from='client.413142 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:03:20.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:03:20 smithi157 bash[24585]: cluster 2024-09-16T13:03:18.962637+0000 mgr.a (mgr.14373) 19292 : cluster [DBG] pgmap v13380: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 6.8 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T13:03:20.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:03:20 smithi086 bash[24289]: cluster 2024-09-16T13:03:18.962637+0000 mgr.a (mgr.14373) 19292 : cluster [DBG] pgmap v13380: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 6.8 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T13:03:20.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:03:20 smithi047 bash[22744]: cluster 2024-09-16T13:03:18.962637+0000 mgr.a (mgr.14373) 19292 : cluster [DBG] pgmap v13380: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 6.8 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T13:03:22.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:03:22 smithi157 bash[24585]: cluster 2024-09-16T13:03:20.963585+0000 mgr.a (mgr.14373) 19293 : cluster [DBG] pgmap v13381: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 6.8 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T13:03:22.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:03:22 smithi086 bash[24289]: cluster 2024-09-16T13:03:20.963585+0000 mgr.a (mgr.14373) 19293 : cluster [DBG] pgmap v13381: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 6.8 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T13:03:22.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:03:22 smithi047 bash[22744]: cluster 2024-09-16T13:03:20.963585+0000 mgr.a (mgr.14373) 19293 : cluster [DBG] pgmap v13381: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 6.8 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T13:03:23.350 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T13:03:23.351 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T13:03:23.351 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T13:03:24.135 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T13:03:24.135 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T13:03:24.135 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T13:03:24.135 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T13:03:24.135 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T13:03:24.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:03:24 smithi157 bash[24585]: cluster 2024-09-16T13:03:22.965831+0000 mgr.a (mgr.14373) 19294 : cluster [DBG] pgmap v13382: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T13:03:24.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:03:24 smithi086 bash[24289]: cluster 2024-09-16T13:03:22.965831+0000 mgr.a (mgr.14373) 19294 : cluster [DBG] pgmap v13382: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T13:03:24.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:03:24 smithi047 bash[22744]: cluster 2024-09-16T13:03:22.965831+0000 mgr.a (mgr.14373) 19294 : cluster [DBG] pgmap v13382: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T13:03:25.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:03:25 smithi157 bash[24585]: audit 2024-09-16T13:03:23.689126+0000 mgr.a (mgr.14373) 19295 : audit [DBG] from='client.413217 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:03:25.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:03:25 smithi086 bash[24289]: audit 2024-09-16T13:03:23.689126+0000 mgr.a (mgr.14373) 19295 : audit [DBG] from='client.413217 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:03:25.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:03:25 smithi047 bash[22744]: audit 2024-09-16T13:03:23.689126+0000 mgr.a (mgr.14373) 19295 : audit [DBG] from='client.413217 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:03:26.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:03:26 smithi157 bash[24585]: cluster 2024-09-16T13:03:24.966802+0000 mgr.a (mgr.14373) 19296 : cluster [DBG] pgmap v13383: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:03:26.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:03:26 smithi086 bash[24289]: cluster 2024-09-16T13:03:24.966802+0000 mgr.a (mgr.14373) 19296 : cluster [DBG] pgmap v13383: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:03:26.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:03:26 smithi047 bash[22744]: cluster 2024-09-16T13:03:24.966802+0000 mgr.a (mgr.14373) 19296 : cluster [DBG] pgmap v13383: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:03:28.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:03:28 smithi086 bash[24289]: cluster 2024-09-16T13:03:26.968915+0000 mgr.a (mgr.14373) 19297 : cluster [DBG] pgmap v13384: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T13:03:28.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:03:28 smithi047 bash[22744]: cluster 2024-09-16T13:03:26.968915+0000 mgr.a (mgr.14373) 19297 : cluster [DBG] pgmap v13384: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T13:03:28.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:03:28 smithi157 bash[24585]: cluster 2024-09-16T13:03:26.968915+0000 mgr.a (mgr.14373) 19297 : cluster [DBG] pgmap v13384: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T13:03:29.136 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T13:03:29.137 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T13:03:29.137 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T13:03:29.913 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T13:03:29.913 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T13:03:29.913 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T13:03:29.914 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T13:03:29.914 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T13:03:30.572 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:03:30 smithi086 bash[24289]: cluster 2024-09-16T13:03:28.969666+0000 mgr.a (mgr.14373) 19298 : cluster [DBG] pgmap v13385: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:03:30.572 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:03:30 smithi086 bash[24289]: audit 2024-09-16T13:03:29.467370+0000 mgr.a (mgr.14373) 19299 : audit [DBG] from='client.413289 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:03:30.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:03:30 smithi047 bash[22744]: cluster 2024-09-16T13:03:28.969666+0000 mgr.a (mgr.14373) 19298 : cluster [DBG] pgmap v13385: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:03:30.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:03:30 smithi047 bash[22744]: audit 2024-09-16T13:03:29.467370+0000 mgr.a (mgr.14373) 19299 : audit [DBG] from='client.413289 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:03:30.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:03:30 smithi157 bash[24585]: cluster 2024-09-16T13:03:28.969666+0000 mgr.a (mgr.14373) 19298 : cluster [DBG] pgmap v13385: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:03:30.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:03:30 smithi157 bash[24585]: audit 2024-09-16T13:03:29.467370+0000 mgr.a (mgr.14373) 19299 : audit [DBG] from='client.413289 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:03:32.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:03:32 smithi086 bash[24289]: cluster 2024-09-16T13:03:30.970761+0000 mgr.a (mgr.14373) 19300 : cluster [DBG] pgmap v13386: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:03:32.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:03:32 smithi047 bash[22744]: cluster 2024-09-16T13:03:30.970761+0000 mgr.a (mgr.14373) 19300 : cluster [DBG] pgmap v13386: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:03:32.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:03:32 smithi157 bash[24585]: cluster 2024-09-16T13:03:30.970761+0000 mgr.a (mgr.14373) 19300 : cluster [DBG] pgmap v13386: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:03:34.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:03:34 smithi047 bash[22744]: cluster 2024-09-16T13:03:32.973168+0000 mgr.a (mgr.14373) 19301 : cluster [DBG] pgmap v13387: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T13:03:34.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:03:34 smithi157 bash[24585]: cluster 2024-09-16T13:03:32.973168+0000 mgr.a (mgr.14373) 19301 : cluster [DBG] pgmap v13387: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T13:03:34.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:03:34 smithi086 bash[24289]: cluster 2024-09-16T13:03:32.973168+0000 mgr.a (mgr.14373) 19301 : cluster [DBG] pgmap v13387: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T13:03:34.915 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T13:03:34.915 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T13:03:34.915 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T13:03:35.701 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T13:03:35.701 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T13:03:35.701 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T13:03:35.701 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T13:03:35.701 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T13:03:36.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:03:36 smithi047 bash[22744]: cluster 2024-09-16T13:03:34.973938+0000 mgr.a (mgr.14373) 19302 : cluster [DBG] pgmap v13388: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:03:36.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:03:36 smithi047 bash[22744]: audit 2024-09-16T13:03:35.248734+0000 mgr.a (mgr.14373) 19303 : audit [DBG] from='client.413364 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:03:36.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:03:36 smithi157 bash[24585]: cluster 2024-09-16T13:03:34.973938+0000 mgr.a (mgr.14373) 19302 : cluster [DBG] pgmap v13388: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:03:36.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:03:36 smithi157 bash[24585]: audit 2024-09-16T13:03:35.248734+0000 mgr.a (mgr.14373) 19303 : audit [DBG] from='client.413364 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:03:36.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:03:36 smithi086 bash[24289]: cluster 2024-09-16T13:03:34.973938+0000 mgr.a (mgr.14373) 19302 : cluster [DBG] pgmap v13388: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:03:36.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:03:36 smithi086 bash[24289]: audit 2024-09-16T13:03:35.248734+0000 mgr.a (mgr.14373) 19303 : audit [DBG] from='client.413364 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:03:38.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:03:38 smithi047 bash[22744]: cluster 2024-09-16T13:03:36.976241+0000 mgr.a (mgr.14373) 19304 : cluster [DBG] pgmap v13389: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T13:03:38.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:03:38 smithi157 bash[24585]: cluster 2024-09-16T13:03:36.976241+0000 mgr.a (mgr.14373) 19304 : cluster [DBG] pgmap v13389: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T13:03:38.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:03:38 smithi086 bash[24289]: cluster 2024-09-16T13:03:36.976241+0000 mgr.a (mgr.14373) 19304 : cluster [DBG] pgmap v13389: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T13:03:40.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:03:40 smithi047 bash[22744]: cluster 2024-09-16T13:03:38.977002+0000 mgr.a (mgr.14373) 19305 : cluster [DBG] pgmap v13390: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:03:40.702 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T13:03:40.703 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T13:03:40.703 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T13:03:40.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:03:40 smithi157 bash[24585]: cluster 2024-09-16T13:03:38.977002+0000 mgr.a (mgr.14373) 19305 : cluster [DBG] pgmap v13390: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:03:40.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:03:40 smithi086 bash[24289]: cluster 2024-09-16T13:03:38.977002+0000 mgr.a (mgr.14373) 19305 : cluster [DBG] pgmap v13390: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:03:41.460 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T13:03:41.460 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T13:03:41.460 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T13:03:41.460 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T13:03:41.460 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T13:03:42.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:03:42 smithi047 bash[22744]: cluster 2024-09-16T13:03:40.977708+0000 mgr.a (mgr.14373) 19306 : cluster [DBG] pgmap v13391: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:03:42.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:03:42 smithi047 bash[22744]: audit 2024-09-16T13:03:41.030506+0000 mgr.a (mgr.14373) 19307 : audit [DBG] from='client.413439 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:03:42.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:03:42 smithi157 bash[24585]: cluster 2024-09-16T13:03:40.977708+0000 mgr.a (mgr.14373) 19306 : cluster [DBG] pgmap v13391: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:03:42.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:03:42 smithi157 bash[24585]: audit 2024-09-16T13:03:41.030506+0000 mgr.a (mgr.14373) 19307 : audit [DBG] from='client.413439 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:03:42.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:03:42 smithi086 bash[24289]: cluster 2024-09-16T13:03:40.977708+0000 mgr.a (mgr.14373) 19306 : cluster [DBG] pgmap v13391: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:03:42.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:03:42 smithi086 bash[24289]: audit 2024-09-16T13:03:41.030506+0000 mgr.a (mgr.14373) 19307 : audit [DBG] from='client.413439 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:03:44.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:03:44 smithi047 bash[22744]: cluster 2024-09-16T13:03:42.980021+0000 mgr.a (mgr.14373) 19308 : cluster [DBG] pgmap v13392: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T13:03:44.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:03:44 smithi157 bash[24585]: cluster 2024-09-16T13:03:42.980021+0000 mgr.a (mgr.14373) 19308 : cluster [DBG] pgmap v13392: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T13:03:44.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:03:44 smithi086 bash[24289]: cluster 2024-09-16T13:03:42.980021+0000 mgr.a (mgr.14373) 19308 : cluster [DBG] pgmap v13392: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T13:03:46.461 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T13:03:46.462 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T13:03:46.463 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T13:03:46.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:03:46 smithi157 bash[24585]: cluster 2024-09-16T13:03:44.980802+0000 mgr.a (mgr.14373) 19309 : cluster [DBG] pgmap v13393: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:03:46.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:03:46 smithi086 bash[24289]: cluster 2024-09-16T13:03:44.980802+0000 mgr.a (mgr.14373) 19309 : cluster [DBG] pgmap v13393: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:03:46.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:03:46 smithi047 bash[22744]: cluster 2024-09-16T13:03:44.980802+0000 mgr.a (mgr.14373) 19309 : cluster [DBG] pgmap v13393: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:03:47.228 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T13:03:47.228 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T13:03:47.228 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T13:03:47.228 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T13:03:47.228 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T13:03:48.808 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:03:48 smithi157 bash[24585]: audit 2024-09-16T13:03:46.792121+0000 mgr.a (mgr.14373) 19310 : audit [DBG] from='client.413517 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:03:48.808 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:03:48 smithi157 bash[24585]: cluster 2024-09-16T13:03:46.982363+0000 mgr.a (mgr.14373) 19311 : cluster [DBG] pgmap v13394: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:03:48.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:03:48 smithi086 bash[24289]: audit 2024-09-16T13:03:46.792121+0000 mgr.a (mgr.14373) 19310 : audit [DBG] from='client.413517 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:03:48.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:03:48 smithi086 bash[24289]: cluster 2024-09-16T13:03:46.982363+0000 mgr.a (mgr.14373) 19311 : cluster [DBG] pgmap v13394: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:03:48.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:03:48 smithi047 bash[22744]: audit 2024-09-16T13:03:46.792121+0000 mgr.a (mgr.14373) 19310 : audit [DBG] from='client.413517 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:03:48.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:03:48 smithi047 bash[22744]: cluster 2024-09-16T13:03:46.982363+0000 mgr.a (mgr.14373) 19311 : cluster [DBG] pgmap v13394: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:03:50.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:03:50 smithi157 bash[24585]: cluster 2024-09-16T13:03:48.983204+0000 mgr.a (mgr.14373) 19312 : cluster [DBG] pgmap v13395: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T13:03:50.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:03:50 smithi086 bash[24289]: cluster 2024-09-16T13:03:48.983204+0000 mgr.a (mgr.14373) 19312 : cluster [DBG] pgmap v13395: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T13:03:50.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:03:50 smithi047 bash[22744]: cluster 2024-09-16T13:03:48.983204+0000 mgr.a (mgr.14373) 19312 : cluster [DBG] pgmap v13395: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T13:03:52.229 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T13:03:52.230 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T13:03:52.230 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T13:03:52.808 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:03:52 smithi157 bash[24585]: cluster 2024-09-16T13:03:50.984131+0000 mgr.a (mgr.14373) 19313 : cluster [DBG] pgmap v13396: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T13:03:52.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:03:52 smithi086 bash[24289]: cluster 2024-09-16T13:03:50.984131+0000 mgr.a (mgr.14373) 19313 : cluster [DBG] pgmap v13396: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T13:03:52.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:03:52 smithi047 bash[22744]: cluster 2024-09-16T13:03:50.984131+0000 mgr.a (mgr.14373) 19313 : cluster [DBG] pgmap v13396: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T13:03:53.007 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T13:03:53.007 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T13:03:53.007 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T13:03:53.007 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T13:03:53.007 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T13:03:53.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:03:53 smithi157 bash[24585]: audit 2024-09-16T13:03:52.565690+0000 mgr.a (mgr.14373) 19314 : audit [DBG] from='client.413592 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:03:53.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:03:53 smithi086 bash[24289]: audit 2024-09-16T13:03:52.565690+0000 mgr.a (mgr.14373) 19314 : audit [DBG] from='client.413592 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:03:53.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:03:53 smithi047 bash[22744]: audit 2024-09-16T13:03:52.565690+0000 mgr.a (mgr.14373) 19314 : audit [DBG] from='client.413592 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:03:54.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:03:54 smithi157 bash[24585]: cluster 2024-09-16T13:03:52.985600+0000 mgr.a (mgr.14373) 19315 : cluster [DBG] pgmap v13397: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:03:54.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:03:54 smithi086 bash[24289]: cluster 2024-09-16T13:03:52.985600+0000 mgr.a (mgr.14373) 19315 : cluster [DBG] pgmap v13397: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:03:54.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:03:54 smithi047 bash[22744]: cluster 2024-09-16T13:03:52.985600+0000 mgr.a (mgr.14373) 19315 : cluster [DBG] pgmap v13397: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:03:56.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:03:56 smithi157 bash[24585]: cluster 2024-09-16T13:03:54.986305+0000 mgr.a (mgr.14373) 19316 : cluster [DBG] pgmap v13398: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T13:03:56.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:03:56 smithi086 bash[24289]: cluster 2024-09-16T13:03:54.986305+0000 mgr.a (mgr.14373) 19316 : cluster [DBG] pgmap v13398: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T13:03:56.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:03:56 smithi047 bash[22744]: cluster 2024-09-16T13:03:54.986305+0000 mgr.a (mgr.14373) 19316 : cluster [DBG] pgmap v13398: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T13:03:58.008 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T13:03:58.009 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T13:03:58.009 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T13:03:58.792 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T13:03:58.792 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T13:03:58.792 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T13:03:58.792 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T13:03:58.792 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T13:03:58.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:03:58 smithi157 bash[24585]: cluster 2024-09-16T13:03:56.988263+0000 mgr.a (mgr.14373) 19317 : cluster [DBG] pgmap v13399: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:03:58.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:03:58 smithi086 bash[24289]: cluster 2024-09-16T13:03:56.988263+0000 mgr.a (mgr.14373) 19317 : cluster [DBG] pgmap v13399: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:03:58.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:03:58 smithi047 bash[22744]: cluster 2024-09-16T13:03:56.988263+0000 mgr.a (mgr.14373) 19317 : cluster [DBG] pgmap v13399: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:03:59.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:03:59 smithi157 bash[24585]: audit 2024-09-16T13:03:58.345629+0000 mgr.a (mgr.14373) 19318 : audit [DBG] from='client.413670 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:03:59.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:03:59 smithi086 bash[24289]: audit 2024-09-16T13:03:58.345629+0000 mgr.a (mgr.14373) 19318 : audit [DBG] from='client.413670 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:03:59.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:03:59 smithi047 bash[22744]: audit 2024-09-16T13:03:58.345629+0000 mgr.a (mgr.14373) 19318 : audit [DBG] from='client.413670 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:04:00.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:04:00 smithi157 bash[24585]: cluster 2024-09-16T13:03:58.989269+0000 mgr.a (mgr.14373) 19319 : cluster [DBG] pgmap v13400: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:04:00.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:04:00 smithi086 bash[24289]: cluster 2024-09-16T13:03:58.989269+0000 mgr.a (mgr.14373) 19319 : cluster [DBG] pgmap v13400: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:04:00.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:04:00 smithi047 bash[22744]: cluster 2024-09-16T13:03:58.989269+0000 mgr.a (mgr.14373) 19319 : cluster [DBG] pgmap v13400: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:04:02.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:04:02 smithi157 bash[24585]: cluster 2024-09-16T13:04:00.990108+0000 mgr.a (mgr.14373) 19320 : cluster [DBG] pgmap v13401: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:04:02.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:04:02 smithi086 bash[24289]: cluster 2024-09-16T13:04:00.990108+0000 mgr.a (mgr.14373) 19320 : cluster [DBG] pgmap v13401: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:04:02.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:04:02 smithi047 bash[22744]: cluster 2024-09-16T13:04:00.990108+0000 mgr.a (mgr.14373) 19320 : cluster [DBG] pgmap v13401: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:04:03.793 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T13:04:03.794 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T13:04:03.794 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T13:04:04.545 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T13:04:04.545 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T13:04:04.546 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T13:04:04.546 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T13:04:04.546 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T13:04:04.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:04:04 smithi157 bash[24585]: cluster 2024-09-16T13:04:02.992347+0000 mgr.a (mgr.14373) 19321 : cluster [DBG] pgmap v13402: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T13:04:04.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:04:04 smithi086 bash[24289]: cluster 2024-09-16T13:04:02.992347+0000 mgr.a (mgr.14373) 19321 : cluster [DBG] pgmap v13402: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T13:04:04.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:04:04 smithi047 bash[22744]: cluster 2024-09-16T13:04:02.992347+0000 mgr.a (mgr.14373) 19321 : cluster [DBG] pgmap v13402: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T13:04:05.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:04:05 smithi157 bash[24585]: audit 2024-09-16T13:04:04.123843+0000 mgr.a (mgr.14373) 19322 : audit [DBG] from='client.413748 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:04:05.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:04:05 smithi086 bash[24289]: audit 2024-09-16T13:04:04.123843+0000 mgr.a (mgr.14373) 19322 : audit [DBG] from='client.413748 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:04:05.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:04:05 smithi047 bash[22744]: audit 2024-09-16T13:04:04.123843+0000 mgr.a (mgr.14373) 19322 : audit [DBG] from='client.413748 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:04:06.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:04:06 smithi157 bash[24585]: cluster 2024-09-16T13:04:04.993284+0000 mgr.a (mgr.14373) 19323 : cluster [DBG] pgmap v13403: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:04:06.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:04:06 smithi086 bash[24289]: cluster 2024-09-16T13:04:04.993284+0000 mgr.a (mgr.14373) 19323 : cluster [DBG] pgmap v13403: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:04:06.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:04:06 smithi047 bash[22744]: cluster 2024-09-16T13:04:04.993284+0000 mgr.a (mgr.14373) 19323 : cluster [DBG] pgmap v13403: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:04:08.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:04:08 smithi157 bash[24585]: cluster 2024-09-16T13:04:06.995508+0000 mgr.a (mgr.14373) 19324 : cluster [DBG] pgmap v13404: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T13:04:08.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:04:08 smithi086 bash[24289]: cluster 2024-09-16T13:04:06.995508+0000 mgr.a (mgr.14373) 19324 : cluster [DBG] pgmap v13404: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T13:04:08.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:04:08 smithi047 bash[22744]: cluster 2024-09-16T13:04:06.995508+0000 mgr.a (mgr.14373) 19324 : cluster [DBG] pgmap v13404: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T13:04:09.547 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T13:04:09.547 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T13:04:09.547 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T13:04:10.332 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T13:04:10.333 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T13:04:10.333 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T13:04:10.333 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T13:04:10.333 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T13:04:10.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:04:10 smithi157 bash[24585]: cluster 2024-09-16T13:04:08.996252+0000 mgr.a (mgr.14373) 19325 : cluster [DBG] pgmap v13405: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:04:10.808 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:04:10 smithi157 bash[24585]: audit 2024-09-16T13:04:09.761628+0000 mon.b (mon.2) 1746 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T13:04:10.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:04:10 smithi086 bash[24289]: cluster 2024-09-16T13:04:08.996252+0000 mgr.a (mgr.14373) 19325 : cluster [DBG] pgmap v13405: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:04:10.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:04:10 smithi086 bash[24289]: audit 2024-09-16T13:04:09.761628+0000 mon.b (mon.2) 1746 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T13:04:10.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:04:10 smithi047 bash[22744]: cluster 2024-09-16T13:04:08.996252+0000 mgr.a (mgr.14373) 19325 : cluster [DBG] pgmap v13405: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:04:10.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:04:10 smithi047 bash[22744]: audit 2024-09-16T13:04:09.761628+0000 mon.b (mon.2) 1746 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T13:04:11.808 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:04:11 smithi157 bash[24585]: audit 2024-09-16T13:04:09.878660+0000 mgr.a (mgr.14373) 19326 : audit [DBG] from='client.413823 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:04:11.808 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:04:11 smithi157 bash[24585]: audit 2024-09-16T13:04:10.580058+0000 mon.b (mon.2) 1747 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T13:04:11.808 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:04:11 smithi157 bash[24585]: audit 2024-09-16T13:04:10.582438+0000 mon.b (mon.2) 1748 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T13:04:11.808 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:04:11 smithi157 bash[24585]: audit 2024-09-16T13:04:10.595033+0000 mon.a (mon.0) 1719 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T13:04:11.808 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:04:11 smithi157 bash[24585]: audit 2024-09-16T13:04:10.600378+0000 mon.b (mon.2) 1749 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T13:04:11.808 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:04:11 smithi157 bash[24585]: audit 2024-09-16T13:04:10.603292+0000 mgr.a (mgr.14373) 19327 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T13:04:11.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:04:11 smithi086 bash[24289]: audit 2024-09-16T13:04:09.878660+0000 mgr.a (mgr.14373) 19326 : audit [DBG] from='client.413823 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:04:11.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:04:11 smithi086 bash[24289]: audit 2024-09-16T13:04:10.580058+0000 mon.b (mon.2) 1747 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T13:04:11.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:04:11 smithi086 bash[24289]: audit 2024-09-16T13:04:10.582438+0000 mon.b (mon.2) 1748 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T13:04:11.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:04:11 smithi086 bash[24289]: audit 2024-09-16T13:04:10.595033+0000 mon.a (mon.0) 1719 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T13:04:11.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:04:11 smithi086 bash[24289]: audit 2024-09-16T13:04:10.600378+0000 mon.b (mon.2) 1749 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T13:04:11.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:04:11 smithi086 bash[24289]: audit 2024-09-16T13:04:10.603292+0000 mgr.a (mgr.14373) 19327 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T13:04:11.843 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 13:04:11 smithi047 bash[22994]: debug 2024-09-16T13:04:11.342+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T13:04:11.843 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 13:04:11 smithi047 bash[22994]: debug 2024-09-16T13:04:11.342+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T13:04:11.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:04:11 smithi047 bash[22744]: audit 2024-09-16T13:04:09.878660+0000 mgr.a (mgr.14373) 19326 : audit [DBG] from='client.413823 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:04:11.844 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:04:11 smithi047 bash[22744]: audit 2024-09-16T13:04:10.580058+0000 mon.b (mon.2) 1747 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T13:04:11.844 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:04:11 smithi047 bash[22744]: audit 2024-09-16T13:04:10.582438+0000 mon.b (mon.2) 1748 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T13:04:11.844 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:04:11 smithi047 bash[22744]: audit 2024-09-16T13:04:10.595033+0000 mon.a (mon.0) 1719 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T13:04:11.844 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:04:11 smithi047 bash[22744]: audit 2024-09-16T13:04:10.600378+0000 mon.b (mon.2) 1749 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T13:04:11.844 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:04:11 smithi047 bash[22744]: audit 2024-09-16T13:04:10.603292+0000 mgr.a (mgr.14373) 19327 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T13:04:13.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:04:12 smithi157 bash[24585]: cluster 2024-09-16T13:04:10.996715+0000 mgr.a (mgr.14373) 19328 : cluster [DBG] pgmap v13406: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:04:13.058 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:04:12 smithi157 bash[24585]: audit 2024-09-16T13:04:11.343621+0000 mgr.a (mgr.14373) 19329 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T13:04:13.058 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:04:12 smithi157 bash[24585]: cephadm 2024-09-16T13:04:11.346248+0000 mgr.a (mgr.14373) 19330 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T13:04:13.072 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:04:12 smithi086 bash[24289]: cluster 2024-09-16T13:04:10.996715+0000 mgr.a (mgr.14373) 19328 : cluster [DBG] pgmap v13406: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:04:13.072 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:04:12 smithi086 bash[24289]: audit 2024-09-16T13:04:11.343621+0000 mgr.a (mgr.14373) 19329 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T13:04:13.072 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:04:12 smithi086 bash[24289]: cephadm 2024-09-16T13:04:11.346248+0000 mgr.a (mgr.14373) 19330 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T13:04:13.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:04:12 smithi047 bash[22744]: cluster 2024-09-16T13:04:10.996715+0000 mgr.a (mgr.14373) 19328 : cluster [DBG] pgmap v13406: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:04:13.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:04:12 smithi047 bash[22744]: audit 2024-09-16T13:04:11.343621+0000 mgr.a (mgr.14373) 19329 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T13:04:13.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:04:12 smithi047 bash[22744]: cephadm 2024-09-16T13:04:11.346248+0000 mgr.a (mgr.14373) 19330 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T13:04:15.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:04:14 smithi157 bash[24585]: cluster 2024-09-16T13:04:12.999035+0000 mgr.a (mgr.14373) 19331 : cluster [DBG] pgmap v13407: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T13:04:15.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:04:14 smithi086 bash[24289]: cluster 2024-09-16T13:04:12.999035+0000 mgr.a (mgr.14373) 19331 : cluster [DBG] pgmap v13407: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T13:04:15.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:04:14 smithi047 bash[22744]: cluster 2024-09-16T13:04:12.999035+0000 mgr.a (mgr.14373) 19331 : cluster [DBG] pgmap v13407: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T13:04:15.334 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T13:04:15.335 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T13:04:15.335 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T13:04:16.116 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T13:04:16.117 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T13:04:16.117 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T13:04:16.117 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T13:04:16.117 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T13:04:17.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:04:16 smithi157 bash[24585]: cluster 2024-09-16T13:04:14.999809+0000 mgr.a (mgr.14373) 19332 : cluster [DBG] pgmap v13408: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T13:04:17.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:04:16 smithi086 bash[24289]: cluster 2024-09-16T13:04:14.999809+0000 mgr.a (mgr.14373) 19332 : cluster [DBG] pgmap v13408: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T13:04:17.094 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:04:16 smithi047 bash[22744]: cluster 2024-09-16T13:04:14.999809+0000 mgr.a (mgr.14373) 19332 : cluster [DBG] pgmap v13408: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T13:04:18.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:04:17 smithi157 bash[24585]: audit 2024-09-16T13:04:15.667275+0000 mgr.a (mgr.14373) 19333 : audit [DBG] from='client.414000 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:04:18.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:04:17 smithi086 bash[24289]: audit 2024-09-16T13:04:15.667275+0000 mgr.a (mgr.14373) 19333 : audit [DBG] from='client.414000 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:04:18.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:04:17 smithi047 bash[22744]: audit 2024-09-16T13:04:15.667275+0000 mgr.a (mgr.14373) 19333 : audit [DBG] from='client.414000 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:04:19.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:04:18 smithi157 bash[24585]: cluster 2024-09-16T13:04:17.002159+0000 mgr.a (mgr.14373) 19334 : cluster [DBG] pgmap v13409: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T13:04:19.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:04:18 smithi086 bash[24289]: cluster 2024-09-16T13:04:17.002159+0000 mgr.a (mgr.14373) 19334 : cluster [DBG] pgmap v13409: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T13:04:19.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:04:18 smithi047 bash[22744]: cluster 2024-09-16T13:04:17.002159+0000 mgr.a (mgr.14373) 19334 : cluster [DBG] pgmap v13409: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T13:04:21.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:04:20 smithi157 bash[24585]: cluster 2024-09-16T13:04:19.002925+0000 mgr.a (mgr.14373) 19335 : cluster [DBG] pgmap v13410: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T13:04:21.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:04:20 smithi086 bash[24289]: cluster 2024-09-16T13:04:19.002925+0000 mgr.a (mgr.14373) 19335 : cluster [DBG] pgmap v13410: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T13:04:21.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:04:20 smithi047 bash[22744]: cluster 2024-09-16T13:04:19.002925+0000 mgr.a (mgr.14373) 19335 : cluster [DBG] pgmap v13410: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T13:04:21.118 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T13:04:21.119 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T13:04:21.119 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T13:04:21.901 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T13:04:21.901 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T13:04:21.901 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T13:04:21.901 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T13:04:21.901 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T13:04:23.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:04:22 smithi157 bash[24585]: cluster 2024-09-16T13:04:21.003708+0000 mgr.a (mgr.14373) 19336 : cluster [DBG] pgmap v13411: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T13:04:23.058 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:04:22 smithi157 bash[24585]: audit 2024-09-16T13:04:21.453728+0000 mgr.a (mgr.14373) 19337 : audit [DBG] from='client.414078 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:04:23.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:04:22 smithi086 bash[24289]: cluster 2024-09-16T13:04:21.003708+0000 mgr.a (mgr.14373) 19336 : cluster [DBG] pgmap v13411: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T13:04:23.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:04:22 smithi086 bash[24289]: audit 2024-09-16T13:04:21.453728+0000 mgr.a (mgr.14373) 19337 : audit [DBG] from='client.414078 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:04:23.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:04:22 smithi047 bash[22744]: cluster 2024-09-16T13:04:21.003708+0000 mgr.a (mgr.14373) 19336 : cluster [DBG] pgmap v13411: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T13:04:23.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:04:22 smithi047 bash[22744]: audit 2024-09-16T13:04:21.453728+0000 mgr.a (mgr.14373) 19337 : audit [DBG] from='client.414078 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:04:25.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:04:24 smithi157 bash[24585]: cluster 2024-09-16T13:04:23.006479+0000 mgr.a (mgr.14373) 19338 : cluster [DBG] pgmap v13412: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T13:04:25.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:04:24 smithi086 bash[24289]: cluster 2024-09-16T13:04:23.006479+0000 mgr.a (mgr.14373) 19338 : cluster [DBG] pgmap v13412: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T13:04:25.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:04:24 smithi047 bash[22744]: cluster 2024-09-16T13:04:23.006479+0000 mgr.a (mgr.14373) 19338 : cluster [DBG] pgmap v13412: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T13:04:26.902 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T13:04:26.903 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T13:04:26.903 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T13:04:27.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:04:26 smithi157 bash[24585]: cluster 2024-09-16T13:04:25.007239+0000 mgr.a (mgr.14373) 19339 : cluster [DBG] pgmap v13413: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T13:04:27.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:04:26 smithi086 bash[24289]: cluster 2024-09-16T13:04:25.007239+0000 mgr.a (mgr.14373) 19339 : cluster [DBG] pgmap v13413: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T13:04:27.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:04:26 smithi047 bash[22744]: cluster 2024-09-16T13:04:25.007239+0000 mgr.a (mgr.14373) 19339 : cluster [DBG] pgmap v13413: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T13:04:27.697 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T13:04:27.698 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T13:04:27.698 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T13:04:27.698 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T13:04:27.698 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T13:04:29.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:04:28 smithi157 bash[24585]: cluster 2024-09-16T13:04:27.008167+0000 mgr.a (mgr.14373) 19340 : cluster [DBG] pgmap v13414: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:04:29.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:04:28 smithi157 bash[24585]: audit 2024-09-16T13:04:27.241648+0000 mgr.a (mgr.14373) 19341 : audit [DBG] from='client.414156 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:04:29.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:04:28 smithi086 bash[24289]: cluster 2024-09-16T13:04:27.008167+0000 mgr.a (mgr.14373) 19340 : cluster [DBG] pgmap v13414: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:04:29.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:04:28 smithi086 bash[24289]: audit 2024-09-16T13:04:27.241648+0000 mgr.a (mgr.14373) 19341 : audit [DBG] from='client.414156 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:04:29.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:04:28 smithi047 bash[22744]: cluster 2024-09-16T13:04:27.008167+0000 mgr.a (mgr.14373) 19340 : cluster [DBG] pgmap v13414: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:04:29.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:04:28 smithi047 bash[22744]: audit 2024-09-16T13:04:27.241648+0000 mgr.a (mgr.14373) 19341 : audit [DBG] from='client.414156 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:04:31.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:04:30 smithi157 bash[24585]: cluster 2024-09-16T13:04:29.009145+0000 mgr.a (mgr.14373) 19342 : cluster [DBG] pgmap v13415: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T13:04:31.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:04:30 smithi086 bash[24289]: cluster 2024-09-16T13:04:29.009145+0000 mgr.a (mgr.14373) 19342 : cluster [DBG] pgmap v13415: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T13:04:31.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:04:30 smithi047 bash[22744]: cluster 2024-09-16T13:04:29.009145+0000 mgr.a (mgr.14373) 19342 : cluster [DBG] pgmap v13415: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T13:04:32.699 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T13:04:32.700 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T13:04:32.700 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T13:04:33.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:04:32 smithi157 bash[24585]: cluster 2024-09-16T13:04:31.010094+0000 mgr.a (mgr.14373) 19343 : cluster [DBG] pgmap v13416: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T13:04:33.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:04:32 smithi086 bash[24289]: cluster 2024-09-16T13:04:31.010094+0000 mgr.a (mgr.14373) 19343 : cluster [DBG] pgmap v13416: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T13:04:33.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:04:32 smithi047 bash[22744]: cluster 2024-09-16T13:04:31.010094+0000 mgr.a (mgr.14373) 19343 : cluster [DBG] pgmap v13416: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T13:04:33.495 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T13:04:33.495 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T13:04:33.496 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T13:04:33.496 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T13:04:33.496 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T13:04:35.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:04:34 smithi157 bash[24585]: cluster 2024-09-16T13:04:33.012375+0000 mgr.a (mgr.14373) 19344 : cluster [DBG] pgmap v13417: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:04:35.058 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:04:34 smithi157 bash[24585]: audit 2024-09-16T13:04:33.037124+0000 mgr.a (mgr.14373) 19345 : audit [DBG] from='client.414231 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:04:35.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:04:34 smithi086 bash[24289]: cluster 2024-09-16T13:04:33.012375+0000 mgr.a (mgr.14373) 19344 : cluster [DBG] pgmap v13417: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:04:35.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:04:34 smithi086 bash[24289]: audit 2024-09-16T13:04:33.037124+0000 mgr.a (mgr.14373) 19345 : audit [DBG] from='client.414231 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:04:35.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:04:34 smithi047 bash[22744]: cluster 2024-09-16T13:04:33.012375+0000 mgr.a (mgr.14373) 19344 : cluster [DBG] pgmap v13417: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:04:35.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:04:34 smithi047 bash[22744]: audit 2024-09-16T13:04:33.037124+0000 mgr.a (mgr.14373) 19345 : audit [DBG] from='client.414231 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:04:36.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:04:35 smithi157 bash[24585]: cluster 2024-09-16T13:04:35.013306+0000 mgr.a (mgr.14373) 19346 : cluster [DBG] pgmap v13418: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:04:36.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:04:35 smithi086 bash[24289]: cluster 2024-09-16T13:04:35.013306+0000 mgr.a (mgr.14373) 19346 : cluster [DBG] pgmap v13418: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:04:36.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:04:35 smithi047 bash[22744]: cluster 2024-09-16T13:04:35.013306+0000 mgr.a (mgr.14373) 19346 : cluster [DBG] pgmap v13418: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:04:38.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:04:38 smithi047 bash[22744]: cluster 2024-09-16T13:04:37.015462+0000 mgr.a (mgr.14373) 19347 : cluster [DBG] pgmap v13419: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T13:04:38.497 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T13:04:38.498 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T13:04:38.498 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T13:04:38.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:04:38 smithi157 bash[24585]: cluster 2024-09-16T13:04:37.015462+0000 mgr.a (mgr.14373) 19347 : cluster [DBG] pgmap v13419: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T13:04:38.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:04:38 smithi086 bash[24289]: cluster 2024-09-16T13:04:37.015462+0000 mgr.a (mgr.14373) 19347 : cluster [DBG] pgmap v13419: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T13:04:39.269 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T13:04:39.269 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T13:04:39.269 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T13:04:39.270 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T13:04:39.270 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T13:04:40.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:04:40 smithi047 bash[22744]: audit 2024-09-16T13:04:38.830764+0000 mgr.a (mgr.14373) 19348 : audit [DBG] from='client.414309 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:04:40.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:04:40 smithi047 bash[22744]: cluster 2024-09-16T13:04:39.016071+0000 mgr.a (mgr.14373) 19349 : cluster [DBG] pgmap v13420: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:04:40.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:04:40 smithi157 bash[24585]: audit 2024-09-16T13:04:38.830764+0000 mgr.a (mgr.14373) 19348 : audit [DBG] from='client.414309 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:04:40.558 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:04:40 smithi157 bash[24585]: cluster 2024-09-16T13:04:39.016071+0000 mgr.a (mgr.14373) 19349 : cluster [DBG] pgmap v13420: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:04:40.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:04:40 smithi086 bash[24289]: audit 2024-09-16T13:04:38.830764+0000 mgr.a (mgr.14373) 19348 : audit [DBG] from='client.414309 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:04:40.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:04:40 smithi086 bash[24289]: cluster 2024-09-16T13:04:39.016071+0000 mgr.a (mgr.14373) 19349 : cluster [DBG] pgmap v13420: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:04:42.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:04:42 smithi047 bash[22744]: cluster 2024-09-16T13:04:41.016923+0000 mgr.a (mgr.14373) 19350 : cluster [DBG] pgmap v13421: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:04:42.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:04:42 smithi157 bash[24585]: cluster 2024-09-16T13:04:41.016923+0000 mgr.a (mgr.14373) 19350 : cluster [DBG] pgmap v13421: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:04:42.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:04:42 smithi086 bash[24289]: cluster 2024-09-16T13:04:41.016923+0000 mgr.a (mgr.14373) 19350 : cluster [DBG] pgmap v13421: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:04:44.271 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T13:04:44.272 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T13:04:44.272 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T13:04:44.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:04:44 smithi047 bash[22744]: cluster 2024-09-16T13:04:43.019142+0000 mgr.a (mgr.14373) 19351 : cluster [DBG] pgmap v13422: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T13:04:44.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:04:44 smithi157 bash[24585]: cluster 2024-09-16T13:04:43.019142+0000 mgr.a (mgr.14373) 19351 : cluster [DBG] pgmap v13422: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T13:04:44.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:04:44 smithi086 bash[24289]: cluster 2024-09-16T13:04:43.019142+0000 mgr.a (mgr.14373) 19351 : cluster [DBG] pgmap v13422: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T13:04:45.048 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T13:04:45.049 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T13:04:45.049 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T13:04:45.049 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T13:04:45.049 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T13:04:45.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:04:45 smithi157 bash[24585]: audit 2024-09-16T13:04:44.604587+0000 mgr.a (mgr.14373) 19352 : audit [DBG] from='client.414387 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:04:45.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:04:45 smithi086 bash[24289]: audit 2024-09-16T13:04:44.604587+0000 mgr.a (mgr.14373) 19352 : audit [DBG] from='client.414387 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:04:45.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:04:45 smithi047 bash[22744]: audit 2024-09-16T13:04:44.604587+0000 mgr.a (mgr.14373) 19352 : audit [DBG] from='client.414387 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:04:46.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:04:46 smithi157 bash[24585]: cluster 2024-09-16T13:04:45.019741+0000 mgr.a (mgr.14373) 19353 : cluster [DBG] pgmap v13423: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:04:46.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:04:46 smithi086 bash[24289]: cluster 2024-09-16T13:04:45.019741+0000 mgr.a (mgr.14373) 19353 : cluster [DBG] pgmap v13423: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:04:46.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:04:46 smithi047 bash[22744]: cluster 2024-09-16T13:04:45.019741+0000 mgr.a (mgr.14373) 19353 : cluster [DBG] pgmap v13423: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:04:48.558 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:04:48 smithi157 bash[24585]: cluster 2024-09-16T13:04:47.021850+0000 mgr.a (mgr.14373) 19354 : cluster [DBG] pgmap v13424: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T13:04:48.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:04:48 smithi086 bash[24289]: cluster 2024-09-16T13:04:47.021850+0000 mgr.a (mgr.14373) 19354 : cluster [DBG] pgmap v13424: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T13:04:48.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:04:48 smithi047 bash[22744]: cluster 2024-09-16T13:04:47.021850+0000 mgr.a (mgr.14373) 19354 : cluster [DBG] pgmap v13424: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T13:04:50.050 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T13:04:50.051 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T13:04:50.051 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T13:04:50.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:04:50 smithi157 bash[24585]: cluster 2024-09-16T13:04:49.022630+0000 mgr.a (mgr.14373) 19355 : cluster [DBG] pgmap v13425: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:04:50.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:04:50 smithi086 bash[24289]: cluster 2024-09-16T13:04:49.022630+0000 mgr.a (mgr.14373) 19355 : cluster [DBG] pgmap v13425: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:04:50.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:04:50 smithi047 bash[22744]: cluster 2024-09-16T13:04:49.022630+0000 mgr.a (mgr.14373) 19355 : cluster [DBG] pgmap v13425: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:04:50.843 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T13:04:50.844 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T13:04:50.844 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T13:04:50.844 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T13:04:50.844 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T13:04:51.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:04:51 smithi157 bash[24585]: audit 2024-09-16T13:04:50.387140+0000 mgr.a (mgr.14373) 19356 : audit [DBG] from='client.414465 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:04:51.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:04:51 smithi086 bash[24289]: audit 2024-09-16T13:04:50.387140+0000 mgr.a (mgr.14373) 19356 : audit [DBG] from='client.414465 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:04:51.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:04:51 smithi047 bash[22744]: audit 2024-09-16T13:04:50.387140+0000 mgr.a (mgr.14373) 19356 : audit [DBG] from='client.414465 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:04:52.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:04:52 smithi157 bash[24585]: cluster 2024-09-16T13:04:51.023596+0000 mgr.a (mgr.14373) 19357 : cluster [DBG] pgmap v13426: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:04:52.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:04:52 smithi086 bash[24289]: cluster 2024-09-16T13:04:51.023596+0000 mgr.a (mgr.14373) 19357 : cluster [DBG] pgmap v13426: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:04:52.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:04:52 smithi047 bash[22744]: cluster 2024-09-16T13:04:51.023596+0000 mgr.a (mgr.14373) 19357 : cluster [DBG] pgmap v13426: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:04:54.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:04:54 smithi157 bash[24585]: cluster 2024-09-16T13:04:53.025871+0000 mgr.a (mgr.14373) 19358 : cluster [DBG] pgmap v13427: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T13:04:54.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:04:54 smithi086 bash[24289]: cluster 2024-09-16T13:04:53.025871+0000 mgr.a (mgr.14373) 19358 : cluster [DBG] pgmap v13427: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T13:04:54.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:04:54 smithi047 bash[22744]: cluster 2024-09-16T13:04:53.025871+0000 mgr.a (mgr.14373) 19358 : cluster [DBG] pgmap v13427: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T13:04:55.845 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T13:04:55.846 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T13:04:55.846 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T13:04:56.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:04:56 smithi157 bash[24585]: cluster 2024-09-16T13:04:55.026648+0000 mgr.a (mgr.14373) 19359 : cluster [DBG] pgmap v13428: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:04:56.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:04:56 smithi086 bash[24289]: cluster 2024-09-16T13:04:55.026648+0000 mgr.a (mgr.14373) 19359 : cluster [DBG] pgmap v13428: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:04:56.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:04:56 smithi047 bash[22744]: cluster 2024-09-16T13:04:55.026648+0000 mgr.a (mgr.14373) 19359 : cluster [DBG] pgmap v13428: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:04:56.892 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T13:04:56.892 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T13:04:56.892 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T13:04:56.892 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T13:04:56.892 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T13:04:57.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:04:57 smithi157 bash[24585]: audit 2024-09-16T13:04:56.182008+0000 mgr.a (mgr.14373) 19360 : audit [DBG] from='client.414537 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:04:57.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:04:57 smithi086 bash[24289]: audit 2024-09-16T13:04:56.182008+0000 mgr.a (mgr.14373) 19360 : audit [DBG] from='client.414537 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:04:57.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:04:57 smithi047 bash[22744]: audit 2024-09-16T13:04:56.182008+0000 mgr.a (mgr.14373) 19360 : audit [DBG] from='client.414537 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:04:58.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:04:58 smithi157 bash[24585]: cluster 2024-09-16T13:04:57.029378+0000 mgr.a (mgr.14373) 19361 : cluster [DBG] pgmap v13429: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:04:58.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:04:58 smithi086 bash[24289]: cluster 2024-09-16T13:04:57.029378+0000 mgr.a (mgr.14373) 19361 : cluster [DBG] pgmap v13429: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:04:58.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:04:58 smithi047 bash[22744]: cluster 2024-09-16T13:04:57.029378+0000 mgr.a (mgr.14373) 19361 : cluster [DBG] pgmap v13429: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:05:00.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:05:00 smithi157 bash[24585]: cluster 2024-09-16T13:04:59.030147+0000 mgr.a (mgr.14373) 19362 : cluster [DBG] pgmap v13430: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T13:05:00.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:05:00 smithi086 bash[24289]: cluster 2024-09-16T13:04:59.030147+0000 mgr.a (mgr.14373) 19362 : cluster [DBG] pgmap v13430: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T13:05:00.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:05:00 smithi047 bash[22744]: cluster 2024-09-16T13:04:59.030147+0000 mgr.a (mgr.14373) 19362 : cluster [DBG] pgmap v13430: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T13:05:01.893 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T13:05:01.894 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T13:05:01.894 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T13:05:02.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:05:02 smithi157 bash[24585]: cluster 2024-09-16T13:05:01.030896+0000 mgr.a (mgr.14373) 19363 : cluster [DBG] pgmap v13431: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T13:05:02.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:05:02 smithi086 bash[24289]: cluster 2024-09-16T13:05:01.030896+0000 mgr.a (mgr.14373) 19363 : cluster [DBG] pgmap v13431: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T13:05:02.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:05:02 smithi047 bash[22744]: cluster 2024-09-16T13:05:01.030896+0000 mgr.a (mgr.14373) 19363 : cluster [DBG] pgmap v13431: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T13:05:02.640 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T13:05:02.640 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T13:05:02.640 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T13:05:02.640 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T13:05:02.641 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T13:05:03.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:05:03 smithi157 bash[24585]: audit 2024-09-16T13:05:02.222666+0000 mgr.a (mgr.14373) 19364 : audit [DBG] from='client.414615 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:05:03.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:05:03 smithi086 bash[24289]: audit 2024-09-16T13:05:02.222666+0000 mgr.a (mgr.14373) 19364 : audit [DBG] from='client.414615 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:05:03.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:05:03 smithi047 bash[22744]: audit 2024-09-16T13:05:02.222666+0000 mgr.a (mgr.14373) 19364 : audit [DBG] from='client.414615 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:05:04.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:05:04 smithi157 bash[24585]: cluster 2024-09-16T13:05:03.033546+0000 mgr.a (mgr.14373) 19365 : cluster [DBG] pgmap v13432: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:05:04.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:05:04 smithi086 bash[24289]: cluster 2024-09-16T13:05:03.033546+0000 mgr.a (mgr.14373) 19365 : cluster [DBG] pgmap v13432: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:05:04.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:05:04 smithi047 bash[22744]: cluster 2024-09-16T13:05:03.033546+0000 mgr.a (mgr.14373) 19365 : cluster [DBG] pgmap v13432: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:05:06.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:05:06 smithi157 bash[24585]: cluster 2024-09-16T13:05:05.034321+0000 mgr.a (mgr.14373) 19366 : cluster [DBG] pgmap v13433: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T13:05:06.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:05:06 smithi086 bash[24289]: cluster 2024-09-16T13:05:05.034321+0000 mgr.a (mgr.14373) 19366 : cluster [DBG] pgmap v13433: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T13:05:06.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:05:06 smithi047 bash[22744]: cluster 2024-09-16T13:05:05.034321+0000 mgr.a (mgr.14373) 19366 : cluster [DBG] pgmap v13433: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T13:05:07.642 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T13:05:07.643 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T13:05:07.643 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T13:05:08.423 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T13:05:08.423 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T13:05:08.423 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T13:05:08.423 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T13:05:08.423 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T13:05:08.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:05:08 smithi157 bash[24585]: cluster 2024-09-16T13:05:07.036241+0000 mgr.a (mgr.14373) 19367 : cluster [DBG] pgmap v13434: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:05:08.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:05:08 smithi086 bash[24289]: cluster 2024-09-16T13:05:07.036241+0000 mgr.a (mgr.14373) 19367 : cluster [DBG] pgmap v13434: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:05:08.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:05:08 smithi047 bash[22744]: cluster 2024-09-16T13:05:07.036241+0000 mgr.a (mgr.14373) 19367 : cluster [DBG] pgmap v13434: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:05:09.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:05:09 smithi157 bash[24585]: audit 2024-09-16T13:05:07.973843+0000 mgr.a (mgr.14373) 19368 : audit [DBG] from='client.414693 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:05:09.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:05:09 smithi086 bash[24289]: audit 2024-09-16T13:05:07.973843+0000 mgr.a (mgr.14373) 19368 : audit [DBG] from='client.414693 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:05:09.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:05:09 smithi047 bash[22744]: audit 2024-09-16T13:05:07.973843+0000 mgr.a (mgr.14373) 19368 : audit [DBG] from='client.414693 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:05:10.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:05:10 smithi157 bash[24585]: cluster 2024-09-16T13:05:09.037118+0000 mgr.a (mgr.14373) 19369 : cluster [DBG] pgmap v13435: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:05:10.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:05:10 smithi086 bash[24289]: cluster 2024-09-16T13:05:09.037118+0000 mgr.a (mgr.14373) 19369 : cluster [DBG] pgmap v13435: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:05:10.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:05:10 smithi047 bash[22744]: cluster 2024-09-16T13:05:09.037118+0000 mgr.a (mgr.14373) 19369 : cluster [DBG] pgmap v13435: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:05:12.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:05:12 smithi157 bash[24585]: cluster 2024-09-16T13:05:11.037875+0000 mgr.a (mgr.14373) 19370 : cluster [DBG] pgmap v13436: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:05:12.558 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:05:12 smithi157 bash[24585]: audit 2024-09-16T13:05:11.404385+0000 mon.b (mon.2) 1750 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T13:05:12.558 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:05:12 smithi157 bash[24585]: audit 2024-09-16T13:05:12.033535+0000 mon.a (mon.0) 1720 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T13:05:12.558 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:05:12 smithi157 bash[24585]: audit 2024-09-16T13:05:12.039130+0000 mon.a (mon.0) 1721 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T13:05:12.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:05:12 smithi086 bash[24289]: cluster 2024-09-16T13:05:11.037875+0000 mgr.a (mgr.14373) 19370 : cluster [DBG] pgmap v13436: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:05:12.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:05:12 smithi086 bash[24289]: audit 2024-09-16T13:05:11.404385+0000 mon.b (mon.2) 1750 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T13:05:12.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:05:12 smithi086 bash[24289]: audit 2024-09-16T13:05:12.033535+0000 mon.a (mon.0) 1720 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T13:05:12.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:05:12 smithi086 bash[24289]: audit 2024-09-16T13:05:12.039130+0000 mon.a (mon.0) 1721 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T13:05:12.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:05:12 smithi047 bash[22744]: cluster 2024-09-16T13:05:11.037875+0000 mgr.a (mgr.14373) 19370 : cluster [DBG] pgmap v13436: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:05:12.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:05:12 smithi047 bash[22744]: audit 2024-09-16T13:05:11.404385+0000 mon.b (mon.2) 1750 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T13:05:12.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:05:12 smithi047 bash[22744]: audit 2024-09-16T13:05:12.033535+0000 mon.a (mon.0) 1720 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T13:05:12.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:05:12 smithi047 bash[22744]: audit 2024-09-16T13:05:12.039130+0000 mon.a (mon.0) 1721 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T13:05:13.424 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T13:05:13.424 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T13:05:13.424 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T13:05:13.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:05:13 smithi157 bash[24585]: audit 2024-09-16T13:05:12.846419+0000 mon.b (mon.2) 1751 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T13:05:13.558 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:05:13 smithi157 bash[24585]: audit 2024-09-16T13:05:12.848607+0000 mon.b (mon.2) 1752 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T13:05:13.558 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:05:13 smithi157 bash[24585]: audit 2024-09-16T13:05:12.859107+0000 mon.a (mon.0) 1722 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T13:05:13.558 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:05:13 smithi157 bash[24585]: audit 2024-09-16T13:05:12.862953+0000 mon.b (mon.2) 1753 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T13:05:13.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:05:13 smithi086 bash[24289]: audit 2024-09-16T13:05:12.846419+0000 mon.b (mon.2) 1751 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T13:05:13.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:05:13 smithi086 bash[24289]: audit 2024-09-16T13:05:12.848607+0000 mon.b (mon.2) 1752 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T13:05:13.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:05:13 smithi086 bash[24289]: audit 2024-09-16T13:05:12.859107+0000 mon.a (mon.0) 1722 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T13:05:13.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:05:13 smithi086 bash[24289]: audit 2024-09-16T13:05:12.862953+0000 mon.b (mon.2) 1753 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T13:05:13.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:05:13 smithi047 bash[22744]: audit 2024-09-16T13:05:12.846419+0000 mon.b (mon.2) 1751 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T13:05:13.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:05:13 smithi047 bash[22744]: audit 2024-09-16T13:05:12.848607+0000 mon.b (mon.2) 1752 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T13:05:13.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:05:13 smithi047 bash[22744]: audit 2024-09-16T13:05:12.859107+0000 mon.a (mon.0) 1722 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T13:05:13.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:05:13 smithi047 bash[22744]: audit 2024-09-16T13:05:12.862953+0000 mon.b (mon.2) 1753 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T13:05:14.093 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 13:05:13 smithi047 bash[22994]: debug 2024-09-16T13:05:13.660+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T13:05:14.093 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 13:05:13 smithi047 bash[22994]: debug 2024-09-16T13:05:13.660+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T13:05:14.163 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T13:05:14.163 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T13:05:14.163 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T13:05:14.163 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T13:05:14.163 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T13:05:14.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:05:14 smithi157 bash[24585]: audit 2024-09-16T13:05:12.864693+0000 mgr.a (mgr.14373) 19371 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T13:05:14.558 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:05:14 smithi157 bash[24585]: cluster 2024-09-16T13:05:13.039164+0000 mgr.a (mgr.14373) 19372 : cluster [DBG] pgmap v13437: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T13:05:14.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:05:14 smithi086 bash[24289]: audit 2024-09-16T13:05:12.864693+0000 mgr.a (mgr.14373) 19371 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T13:05:14.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:05:14 smithi086 bash[24289]: cluster 2024-09-16T13:05:13.039164+0000 mgr.a (mgr.14373) 19372 : cluster [DBG] pgmap v13437: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T13:05:14.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:05:14 smithi047 bash[22744]: audit 2024-09-16T13:05:12.864693+0000 mgr.a (mgr.14373) 19371 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T13:05:14.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:05:14 smithi047 bash[22744]: cluster 2024-09-16T13:05:13.039164+0000 mgr.a (mgr.14373) 19372 : cluster [DBG] pgmap v13437: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T13:05:15.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:05:15 smithi157 bash[24585]: audit 2024-09-16T13:05:13.662994+0000 mgr.a (mgr.14373) 19373 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T13:05:15.558 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:05:15 smithi157 bash[24585]: cephadm 2024-09-16T13:05:13.664810+0000 mgr.a (mgr.14373) 19374 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T13:05:15.558 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:05:15 smithi157 bash[24585]: audit 2024-09-16T13:05:13.749300+0000 mgr.a (mgr.14373) 19375 : audit [DBG] from='client.414876 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:05:15.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:05:15 smithi086 bash[24289]: audit 2024-09-16T13:05:13.662994+0000 mgr.a (mgr.14373) 19373 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T13:05:15.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:05:15 smithi086 bash[24289]: cephadm 2024-09-16T13:05:13.664810+0000 mgr.a (mgr.14373) 19374 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T13:05:15.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:05:15 smithi086 bash[24289]: audit 2024-09-16T13:05:13.749300+0000 mgr.a (mgr.14373) 19375 : audit [DBG] from='client.414876 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:05:15.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:05:15 smithi047 bash[22744]: audit 2024-09-16T13:05:13.662994+0000 mgr.a (mgr.14373) 19373 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T13:05:15.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:05:15 smithi047 bash[22744]: cephadm 2024-09-16T13:05:13.664810+0000 mgr.a (mgr.14373) 19374 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T13:05:15.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:05:15 smithi047 bash[22744]: audit 2024-09-16T13:05:13.749300+0000 mgr.a (mgr.14373) 19375 : audit [DBG] from='client.414876 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:05:16.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:05:16 smithi157 bash[24585]: cluster 2024-09-16T13:05:15.040172+0000 mgr.a (mgr.14373) 19376 : cluster [DBG] pgmap v13438: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:05:16.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:05:16 smithi086 bash[24289]: cluster 2024-09-16T13:05:15.040172+0000 mgr.a (mgr.14373) 19376 : cluster [DBG] pgmap v13438: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:05:16.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:05:16 smithi047 bash[22744]: cluster 2024-09-16T13:05:15.040172+0000 mgr.a (mgr.14373) 19376 : cluster [DBG] pgmap v13438: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:05:18.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:05:18 smithi157 bash[24585]: cluster 2024-09-16T13:05:17.042407+0000 mgr.a (mgr.14373) 19377 : cluster [DBG] pgmap v13439: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T13:05:18.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:05:18 smithi086 bash[24289]: cluster 2024-09-16T13:05:17.042407+0000 mgr.a (mgr.14373) 19377 : cluster [DBG] pgmap v13439: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T13:05:18.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:05:18 smithi047 bash[22744]: cluster 2024-09-16T13:05:17.042407+0000 mgr.a (mgr.14373) 19377 : cluster [DBG] pgmap v13439: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T13:05:19.164 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T13:05:19.165 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T13:05:19.165 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T13:05:19.920 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T13:05:19.920 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T13:05:19.920 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T13:05:19.920 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T13:05:19.920 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T13:05:20.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:05:20 smithi157 bash[24585]: cluster 2024-09-16T13:05:19.043157+0000 mgr.a (mgr.14373) 19378 : cluster [DBG] pgmap v13440: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T13:05:20.558 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:05:20 smithi157 bash[24585]: audit 2024-09-16T13:05:19.496666+0000 mgr.a (mgr.14373) 19379 : audit [DBG] from='client.414951 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:05:20.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:05:20 smithi086 bash[24289]: cluster 2024-09-16T13:05:19.043157+0000 mgr.a (mgr.14373) 19378 : cluster [DBG] pgmap v13440: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T13:05:20.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:05:20 smithi086 bash[24289]: audit 2024-09-16T13:05:19.496666+0000 mgr.a (mgr.14373) 19379 : audit [DBG] from='client.414951 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:05:20.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:05:20 smithi047 bash[22744]: cluster 2024-09-16T13:05:19.043157+0000 mgr.a (mgr.14373) 19378 : cluster [DBG] pgmap v13440: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T13:05:20.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:05:20 smithi047 bash[22744]: audit 2024-09-16T13:05:19.496666+0000 mgr.a (mgr.14373) 19379 : audit [DBG] from='client.414951 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:05:22.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:05:22 smithi157 bash[24585]: cluster 2024-09-16T13:05:21.044043+0000 mgr.a (mgr.14373) 19380 : cluster [DBG] pgmap v13441: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T13:05:22.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:05:22 smithi086 bash[24289]: cluster 2024-09-16T13:05:21.044043+0000 mgr.a (mgr.14373) 19380 : cluster [DBG] pgmap v13441: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T13:05:22.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:05:22 smithi047 bash[22744]: cluster 2024-09-16T13:05:21.044043+0000 mgr.a (mgr.14373) 19380 : cluster [DBG] pgmap v13441: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T13:05:24.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:05:24 smithi157 bash[24585]: cluster 2024-09-16T13:05:23.046294+0000 mgr.a (mgr.14373) 19381 : cluster [DBG] pgmap v13442: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T13:05:24.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:05:24 smithi086 bash[24289]: cluster 2024-09-16T13:05:23.046294+0000 mgr.a (mgr.14373) 19381 : cluster [DBG] pgmap v13442: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T13:05:24.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:05:24 smithi047 bash[22744]: cluster 2024-09-16T13:05:23.046294+0000 mgr.a (mgr.14373) 19381 : cluster [DBG] pgmap v13442: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T13:05:24.921 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T13:05:24.922 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T13:05:24.922 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T13:05:25.682 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T13:05:25.682 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T13:05:25.682 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T13:05:25.682 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T13:05:25.682 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T13:05:26.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:05:26 smithi157 bash[24585]: cluster 2024-09-16T13:05:25.046743+0000 mgr.a (mgr.14373) 19382 : cluster [DBG] pgmap v13443: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T13:05:26.558 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:05:26 smithi157 bash[24585]: audit 2024-09-16T13:05:25.254262+0000 mgr.a (mgr.14373) 19383 : audit [DBG] from='client.415026 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:05:26.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:05:26 smithi086 bash[24289]: cluster 2024-09-16T13:05:25.046743+0000 mgr.a (mgr.14373) 19382 : cluster [DBG] pgmap v13443: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T13:05:26.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:05:26 smithi086 bash[24289]: audit 2024-09-16T13:05:25.254262+0000 mgr.a (mgr.14373) 19383 : audit [DBG] from='client.415026 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:05:26.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:05:26 smithi047 bash[22744]: cluster 2024-09-16T13:05:25.046743+0000 mgr.a (mgr.14373) 19382 : cluster [DBG] pgmap v13443: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T13:05:26.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:05:26 smithi047 bash[22744]: audit 2024-09-16T13:05:25.254262+0000 mgr.a (mgr.14373) 19383 : audit [DBG] from='client.415026 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:05:28.558 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:05:28 smithi157 bash[24585]: cluster 2024-09-16T13:05:27.048948+0000 mgr.a (mgr.14373) 19384 : cluster [DBG] pgmap v13444: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T13:05:28.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:05:28 smithi086 bash[24289]: cluster 2024-09-16T13:05:27.048948+0000 mgr.a (mgr.14373) 19384 : cluster [DBG] pgmap v13444: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T13:05:28.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:05:28 smithi047 bash[22744]: cluster 2024-09-16T13:05:27.048948+0000 mgr.a (mgr.14373) 19384 : cluster [DBG] pgmap v13444: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T13:05:30.560 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:05:30 smithi157 bash[24585]: cluster 2024-09-16T13:05:29.049723+0000 mgr.a (mgr.14373) 19385 : cluster [DBG] pgmap v13445: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:05:30.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:05:30 smithi086 bash[24289]: cluster 2024-09-16T13:05:29.049723+0000 mgr.a (mgr.14373) 19385 : cluster [DBG] pgmap v13445: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:05:30.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:05:30 smithi047 bash[22744]: cluster 2024-09-16T13:05:29.049723+0000 mgr.a (mgr.14373) 19385 : cluster [DBG] pgmap v13445: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:05:30.683 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T13:05:30.684 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T13:05:30.684 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T13:05:31.472 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T13:05:31.472 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T13:05:31.472 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T13:05:31.472 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T13:05:31.472 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T13:05:32.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:05:32 smithi157 bash[24585]: audit 2024-09-16T13:05:31.018687+0000 mgr.a (mgr.14373) 19386 : audit [DBG] from='client.415104 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:05:32.558 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:05:32 smithi157 bash[24585]: cluster 2024-09-16T13:05:31.050979+0000 mgr.a (mgr.14373) 19387 : cluster [DBG] pgmap v13446: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:05:32.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:05:32 smithi086 bash[24289]: audit 2024-09-16T13:05:31.018687+0000 mgr.a (mgr.14373) 19386 : audit [DBG] from='client.415104 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:05:32.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:05:32 smithi086 bash[24289]: cluster 2024-09-16T13:05:31.050979+0000 mgr.a (mgr.14373) 19387 : cluster [DBG] pgmap v13446: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:05:32.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:05:32 smithi047 bash[22744]: audit 2024-09-16T13:05:31.018687+0000 mgr.a (mgr.14373) 19386 : audit [DBG] from='client.415104 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:05:32.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:05:32 smithi047 bash[22744]: cluster 2024-09-16T13:05:31.050979+0000 mgr.a (mgr.14373) 19387 : cluster [DBG] pgmap v13446: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:05:34.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:05:34 smithi157 bash[24585]: cluster 2024-09-16T13:05:33.053401+0000 mgr.a (mgr.14373) 19388 : cluster [DBG] pgmap v13447: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T13:05:34.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:05:34 smithi086 bash[24289]: cluster 2024-09-16T13:05:33.053401+0000 mgr.a (mgr.14373) 19388 : cluster [DBG] pgmap v13447: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T13:05:34.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:05:34 smithi047 bash[22744]: cluster 2024-09-16T13:05:33.053401+0000 mgr.a (mgr.14373) 19388 : cluster [DBG] pgmap v13447: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T13:05:36.474 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T13:05:36.474 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T13:05:36.474 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T13:05:36.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:05:36 smithi157 bash[24585]: cluster 2024-09-16T13:05:35.054171+0000 mgr.a (mgr.14373) 19389 : cluster [DBG] pgmap v13448: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:05:36.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:05:36 smithi086 bash[24289]: cluster 2024-09-16T13:05:35.054171+0000 mgr.a (mgr.14373) 19389 : cluster [DBG] pgmap v13448: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:05:36.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:05:36 smithi047 bash[22744]: cluster 2024-09-16T13:05:35.054171+0000 mgr.a (mgr.14373) 19389 : cluster [DBG] pgmap v13448: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:05:37.224 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T13:05:37.225 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T13:05:37.225 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T13:05:37.225 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T13:05:37.225 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T13:05:38.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:05:38 smithi157 bash[24585]: audit 2024-09-16T13:05:36.802210+0000 mgr.a (mgr.14373) 19390 : audit [DBG] from='client.415182 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:05:38.558 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:05:38 smithi157 bash[24585]: cluster 2024-09-16T13:05:37.055530+0000 mgr.a (mgr.14373) 19391 : cluster [DBG] pgmap v13449: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:05:38.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:05:38 smithi086 bash[24289]: audit 2024-09-16T13:05:36.802210+0000 mgr.a (mgr.14373) 19390 : audit [DBG] from='client.415182 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:05:38.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:05:38 smithi086 bash[24289]: cluster 2024-09-16T13:05:37.055530+0000 mgr.a (mgr.14373) 19391 : cluster [DBG] pgmap v13449: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:05:38.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:05:38 smithi047 bash[22744]: audit 2024-09-16T13:05:36.802210+0000 mgr.a (mgr.14373) 19390 : audit [DBG] from='client.415182 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:05:38.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:05:38 smithi047 bash[22744]: cluster 2024-09-16T13:05:37.055530+0000 mgr.a (mgr.14373) 19391 : cluster [DBG] pgmap v13449: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:05:40.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:05:40 smithi157 bash[24585]: cluster 2024-09-16T13:05:39.056366+0000 mgr.a (mgr.14373) 19392 : cluster [DBG] pgmap v13450: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T13:05:40.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:05:40 smithi086 bash[24289]: cluster 2024-09-16T13:05:39.056366+0000 mgr.a (mgr.14373) 19392 : cluster [DBG] pgmap v13450: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T13:05:40.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:05:40 smithi047 bash[22744]: cluster 2024-09-16T13:05:39.056366+0000 mgr.a (mgr.14373) 19392 : cluster [DBG] pgmap v13450: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T13:05:42.226 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T13:05:42.227 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T13:05:42.227 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T13:05:42.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:05:42 smithi157 bash[24585]: cluster 2024-09-16T13:05:41.057182+0000 mgr.a (mgr.14373) 19393 : cluster [DBG] pgmap v13451: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T13:05:42.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:05:42 smithi086 bash[24289]: cluster 2024-09-16T13:05:41.057182+0000 mgr.a (mgr.14373) 19393 : cluster [DBG] pgmap v13451: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T13:05:42.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:05:42 smithi047 bash[22744]: cluster 2024-09-16T13:05:41.057182+0000 mgr.a (mgr.14373) 19393 : cluster [DBG] pgmap v13451: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T13:05:42.974 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T13:05:42.975 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T13:05:42.975 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T13:05:42.975 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T13:05:42.975 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T13:05:43.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:05:43 smithi157 bash[24585]: audit 2024-09-16T13:05:42.557948+0000 mgr.a (mgr.14373) 19394 : audit [DBG] from='client.415260 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:05:43.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:05:43 smithi086 bash[24289]: audit 2024-09-16T13:05:42.557948+0000 mgr.a (mgr.14373) 19394 : audit [DBG] from='client.415260 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:05:43.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:05:43 smithi047 bash[22744]: audit 2024-09-16T13:05:42.557948+0000 mgr.a (mgr.14373) 19394 : audit [DBG] from='client.415260 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:05:44.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:05:44 smithi157 bash[24585]: cluster 2024-09-16T13:05:43.059876+0000 mgr.a (mgr.14373) 19395 : cluster [DBG] pgmap v13452: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:05:44.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:05:44 smithi086 bash[24289]: cluster 2024-09-16T13:05:43.059876+0000 mgr.a (mgr.14373) 19395 : cluster [DBG] pgmap v13452: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:05:44.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:05:44 smithi047 bash[22744]: cluster 2024-09-16T13:05:43.059876+0000 mgr.a (mgr.14373) 19395 : cluster [DBG] pgmap v13452: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:05:46.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:05:46 smithi157 bash[24585]: cluster 2024-09-16T13:05:45.060830+0000 mgr.a (mgr.14373) 19396 : cluster [DBG] pgmap v13453: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T13:05:46.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:05:46 smithi086 bash[24289]: cluster 2024-09-16T13:05:45.060830+0000 mgr.a (mgr.14373) 19396 : cluster [DBG] pgmap v13453: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T13:05:46.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:05:46 smithi047 bash[22744]: cluster 2024-09-16T13:05:45.060830+0000 mgr.a (mgr.14373) 19396 : cluster [DBG] pgmap v13453: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T13:05:47.976 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T13:05:47.977 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T13:05:47.977 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T13:05:48.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:05:48 smithi157 bash[24585]: cluster 2024-09-16T13:05:47.062877+0000 mgr.a (mgr.14373) 19397 : cluster [DBG] pgmap v13454: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:05:48.570 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:05:48 smithi086 bash[24289]: cluster 2024-09-16T13:05:47.062877+0000 mgr.a (mgr.14373) 19397 : cluster [DBG] pgmap v13454: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:05:48.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:05:48 smithi047 bash[22744]: cluster 2024-09-16T13:05:47.062877+0000 mgr.a (mgr.14373) 19397 : cluster [DBG] pgmap v13454: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:05:48.742 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T13:05:48.742 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T13:05:48.742 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T13:05:48.742 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T13:05:48.742 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T13:05:49.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:05:49 smithi157 bash[24585]: audit 2024-09-16T13:05:48.310184+0000 mgr.a (mgr.14373) 19398 : audit [DBG] from='client.415335 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:05:49.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:05:49 smithi086 bash[24289]: audit 2024-09-16T13:05:48.310184+0000 mgr.a (mgr.14373) 19398 : audit [DBG] from='client.415335 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:05:49.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:05:49 smithi047 bash[22744]: audit 2024-09-16T13:05:48.310184+0000 mgr.a (mgr.14373) 19398 : audit [DBG] from='client.415335 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:05:50.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:05:50 smithi157 bash[24585]: cluster 2024-09-16T13:05:49.063696+0000 mgr.a (mgr.14373) 19399 : cluster [DBG] pgmap v13455: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:05:50.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:05:50 smithi086 bash[24289]: cluster 2024-09-16T13:05:49.063696+0000 mgr.a (mgr.14373) 19399 : cluster [DBG] pgmap v13455: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:05:50.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:05:50 smithi047 bash[22744]: cluster 2024-09-16T13:05:49.063696+0000 mgr.a (mgr.14373) 19399 : cluster [DBG] pgmap v13455: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:05:52.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:05:52 smithi157 bash[24585]: cluster 2024-09-16T13:05:51.064450+0000 mgr.a (mgr.14373) 19400 : cluster [DBG] pgmap v13456: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:05:52.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:05:52 smithi086 bash[24289]: cluster 2024-09-16T13:05:51.064450+0000 mgr.a (mgr.14373) 19400 : cluster [DBG] pgmap v13456: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:05:52.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:05:52 smithi047 bash[22744]: cluster 2024-09-16T13:05:51.064450+0000 mgr.a (mgr.14373) 19400 : cluster [DBG] pgmap v13456: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:05:53.743 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T13:05:53.744 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T13:05:53.744 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T13:05:54.505 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T13:05:54.505 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T13:05:54.505 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T13:05:54.505 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T13:05:54.505 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T13:05:54.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:05:54 smithi157 bash[24585]: cluster 2024-09-16T13:05:53.066644+0000 mgr.a (mgr.14373) 19401 : cluster [DBG] pgmap v13457: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T13:05:54.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:05:54 smithi086 bash[24289]: cluster 2024-09-16T13:05:53.066644+0000 mgr.a (mgr.14373) 19401 : cluster [DBG] pgmap v13457: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T13:05:54.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:05:54 smithi047 bash[22744]: cluster 2024-09-16T13:05:53.066644+0000 mgr.a (mgr.14373) 19401 : cluster [DBG] pgmap v13457: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T13:05:55.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:05:55 smithi157 bash[24585]: audit 2024-09-16T13:05:54.076268+0000 mgr.a (mgr.14373) 19402 : audit [DBG] from='client.415413 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:05:55.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:05:55 smithi086 bash[24289]: audit 2024-09-16T13:05:54.076268+0000 mgr.a (mgr.14373) 19402 : audit [DBG] from='client.415413 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:05:55.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:05:55 smithi047 bash[22744]: audit 2024-09-16T13:05:54.076268+0000 mgr.a (mgr.14373) 19402 : audit [DBG] from='client.415413 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:05:56.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:05:56 smithi157 bash[24585]: cluster 2024-09-16T13:05:55.067574+0000 mgr.a (mgr.14373) 19403 : cluster [DBG] pgmap v13458: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:05:56.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:05:56 smithi086 bash[24289]: cluster 2024-09-16T13:05:55.067574+0000 mgr.a (mgr.14373) 19403 : cluster [DBG] pgmap v13458: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:05:56.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:05:56 smithi047 bash[22744]: cluster 2024-09-16T13:05:55.067574+0000 mgr.a (mgr.14373) 19403 : cluster [DBG] pgmap v13458: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:05:58.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:05:58 smithi086 bash[24289]: cluster 2024-09-16T13:05:57.069715+0000 mgr.a (mgr.14373) 19404 : cluster [DBG] pgmap v13459: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T13:05:58.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:05:58 smithi047 bash[22744]: cluster 2024-09-16T13:05:57.069715+0000 mgr.a (mgr.14373) 19404 : cluster [DBG] pgmap v13459: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T13:05:58.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:05:58 smithi157 bash[24585]: cluster 2024-09-16T13:05:57.069715+0000 mgr.a (mgr.14373) 19404 : cluster [DBG] pgmap v13459: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T13:05:59.506 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T13:05:59.507 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T13:05:59.508 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T13:06:00.291 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T13:06:00.292 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T13:06:00.292 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T13:06:00.292 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T13:06:00.292 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T13:06:00.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:06:00 smithi086 bash[24289]: cluster 2024-09-16T13:05:59.070486+0000 mgr.a (mgr.14373) 19405 : cluster [DBG] pgmap v13460: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:06:00.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:06:00 smithi047 bash[22744]: cluster 2024-09-16T13:05:59.070486+0000 mgr.a (mgr.14373) 19405 : cluster [DBG] pgmap v13460: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:06:00.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:06:00 smithi157 bash[24585]: cluster 2024-09-16T13:05:59.070486+0000 mgr.a (mgr.14373) 19405 : cluster [DBG] pgmap v13460: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:06:01.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:06:01 smithi047 bash[22744]: audit 2024-09-16T13:05:59.839824+0000 mgr.a (mgr.14373) 19406 : audit [DBG] from='client.415488 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:06:01.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:06:01 smithi157 bash[24585]: audit 2024-09-16T13:05:59.839824+0000 mgr.a (mgr.14373) 19406 : audit [DBG] from='client.415488 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:06:01.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:06:01 smithi086 bash[24289]: audit 2024-09-16T13:05:59.839824+0000 mgr.a (mgr.14373) 19406 : audit [DBG] from='client.415488 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:06:02.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:06:02 smithi047 bash[22744]: cluster 2024-09-16T13:06:01.071389+0000 mgr.a (mgr.14373) 19407 : cluster [DBG] pgmap v13461: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:06:02.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:06:02 smithi157 bash[24585]: cluster 2024-09-16T13:06:01.071389+0000 mgr.a (mgr.14373) 19407 : cluster [DBG] pgmap v13461: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:06:02.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:06:02 smithi086 bash[24289]: cluster 2024-09-16T13:06:01.071389+0000 mgr.a (mgr.14373) 19407 : cluster [DBG] pgmap v13461: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:06:04.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:06:03 smithi157 bash[24585]: cluster 2024-09-16T13:06:03.073647+0000 mgr.a (mgr.14373) 19408 : cluster [DBG] pgmap v13462: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T13:06:04.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:06:03 smithi086 bash[24289]: cluster 2024-09-16T13:06:03.073647+0000 mgr.a (mgr.14373) 19408 : cluster [DBG] pgmap v13462: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T13:06:04.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:06:03 smithi047 bash[22744]: cluster 2024-09-16T13:06:03.073647+0000 mgr.a (mgr.14373) 19408 : cluster [DBG] pgmap v13462: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T13:06:05.293 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T13:06:05.294 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T13:06:05.294 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T13:06:06.080 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T13:06:06.080 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T13:06:06.080 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T13:06:06.080 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T13:06:06.080 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T13:06:06.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:06:06 smithi157 bash[24585]: cluster 2024-09-16T13:06:05.074454+0000 mgr.a (mgr.14373) 19409 : cluster [DBG] pgmap v13463: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:06:06.558 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:06:06 smithi157 bash[24585]: audit 2024-09-16T13:06:05.627963+0000 mgr.a (mgr.14373) 19410 : audit [DBG] from='client.415563 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:06:06.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:06:06 smithi086 bash[24289]: cluster 2024-09-16T13:06:05.074454+0000 mgr.a (mgr.14373) 19409 : cluster [DBG] pgmap v13463: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:06:06.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:06:06 smithi086 bash[24289]: audit 2024-09-16T13:06:05.627963+0000 mgr.a (mgr.14373) 19410 : audit [DBG] from='client.415563 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:06:06.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:06:06 smithi047 bash[22744]: cluster 2024-09-16T13:06:05.074454+0000 mgr.a (mgr.14373) 19409 : cluster [DBG] pgmap v13463: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:06:06.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:06:06 smithi047 bash[22744]: audit 2024-09-16T13:06:05.627963+0000 mgr.a (mgr.14373) 19410 : audit [DBG] from='client.415563 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:06:08.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:06:08 smithi157 bash[24585]: cluster 2024-09-16T13:06:07.076801+0000 mgr.a (mgr.14373) 19411 : cluster [DBG] pgmap v13464: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T13:06:08.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:06:08 smithi086 bash[24289]: cluster 2024-09-16T13:06:07.076801+0000 mgr.a (mgr.14373) 19411 : cluster [DBG] pgmap v13464: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T13:06:08.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:06:08 smithi047 bash[22744]: cluster 2024-09-16T13:06:07.076801+0000 mgr.a (mgr.14373) 19411 : cluster [DBG] pgmap v13464: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T13:06:10.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:06:10 smithi157 bash[24585]: cluster 2024-09-16T13:06:09.077574+0000 mgr.a (mgr.14373) 19412 : cluster [DBG] pgmap v13465: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:06:10.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:06:10 smithi086 bash[24289]: cluster 2024-09-16T13:06:09.077574+0000 mgr.a (mgr.14373) 19412 : cluster [DBG] pgmap v13465: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:06:10.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:06:10 smithi047 bash[22744]: cluster 2024-09-16T13:06:09.077574+0000 mgr.a (mgr.14373) 19412 : cluster [DBG] pgmap v13465: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:06:11.081 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T13:06:11.082 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T13:06:11.082 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T13:06:11.839 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T13:06:11.839 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T13:06:11.839 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T13:06:11.839 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T13:06:11.839 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T13:06:12.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:06:12 smithi157 bash[24585]: cluster 2024-09-16T13:06:11.078389+0000 mgr.a (mgr.14373) 19413 : cluster [DBG] pgmap v13466: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:06:12.558 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:06:12 smithi157 bash[24585]: audit 2024-09-16T13:06:11.414629+0000 mgr.a (mgr.14373) 19414 : audit [DBG] from='client.415632 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:06:12.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:06:12 smithi086 bash[24289]: cluster 2024-09-16T13:06:11.078389+0000 mgr.a (mgr.14373) 19413 : cluster [DBG] pgmap v13466: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:06:12.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:06:12 smithi086 bash[24289]: audit 2024-09-16T13:06:11.414629+0000 mgr.a (mgr.14373) 19414 : audit [DBG] from='client.415632 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:06:12.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:06:12 smithi047 bash[22744]: cluster 2024-09-16T13:06:11.078389+0000 mgr.a (mgr.14373) 19413 : cluster [DBG] pgmap v13466: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:06:12.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:06:12 smithi047 bash[22744]: audit 2024-09-16T13:06:11.414629+0000 mgr.a (mgr.14373) 19414 : audit [DBG] from='client.415632 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:06:14.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:06:14 smithi157 bash[24585]: cluster 2024-09-16T13:06:13.081201+0000 mgr.a (mgr.14373) 19415 : cluster [DBG] pgmap v13467: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:06:14.558 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:06:14 smithi157 bash[24585]: audit 2024-09-16T13:06:13.728621+0000 mon.b (mon.2) 1754 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T13:06:14.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:06:14 smithi086 bash[24289]: cluster 2024-09-16T13:06:13.081201+0000 mgr.a (mgr.14373) 19415 : cluster [DBG] pgmap v13467: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:06:14.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:06:14 smithi086 bash[24289]: audit 2024-09-16T13:06:13.728621+0000 mon.b (mon.2) 1754 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T13:06:14.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:06:14 smithi047 bash[22744]: cluster 2024-09-16T13:06:13.081201+0000 mgr.a (mgr.14373) 19415 : cluster [DBG] pgmap v13467: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:06:14.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:06:14 smithi047 bash[22744]: audit 2024-09-16T13:06:13.728621+0000 mon.b (mon.2) 1754 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T13:06:15.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:06:15 smithi157 bash[24585]: audit 2024-09-16T13:06:14.350462+0000 mon.a (mon.0) 1723 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T13:06:15.808 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:06:15 smithi157 bash[24585]: audit 2024-09-16T13:06:14.357464+0000 mon.a (mon.0) 1724 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T13:06:15.808 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:06:15 smithi157 bash[24585]: audit 2024-09-16T13:06:14.364220+0000 mon.a (mon.0) 1725 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T13:06:15.808 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:06:15 smithi157 bash[24585]: audit 2024-09-16T13:06:14.370905+0000 mon.a (mon.0) 1726 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T13:06:15.808 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:06:15 smithi157 bash[24585]: audit 2024-09-16T13:06:15.056599+0000 mon.b (mon.2) 1755 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T13:06:15.808 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:06:15 smithi157 bash[24585]: audit 2024-09-16T13:06:15.058731+0000 mon.b (mon.2) 1756 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T13:06:15.808 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:06:15 smithi157 bash[24585]: audit 2024-09-16T13:06:15.070010+0000 mon.a (mon.0) 1727 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T13:06:15.808 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:06:15 smithi157 bash[24585]: audit 2024-09-16T13:06:15.075495+0000 mon.b (mon.2) 1757 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T13:06:15.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:06:15 smithi086 bash[24289]: audit 2024-09-16T13:06:14.350462+0000 mon.a (mon.0) 1723 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T13:06:15.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:06:15 smithi086 bash[24289]: audit 2024-09-16T13:06:14.357464+0000 mon.a (mon.0) 1724 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T13:06:15.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:06:15 smithi086 bash[24289]: audit 2024-09-16T13:06:14.364220+0000 mon.a (mon.0) 1725 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T13:06:15.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:06:15 smithi086 bash[24289]: audit 2024-09-16T13:06:14.370905+0000 mon.a (mon.0) 1726 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T13:06:15.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:06:15 smithi086 bash[24289]: audit 2024-09-16T13:06:15.056599+0000 mon.b (mon.2) 1755 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T13:06:15.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:06:15 smithi086 bash[24289]: audit 2024-09-16T13:06:15.058731+0000 mon.b (mon.2) 1756 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T13:06:15.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:06:15 smithi086 bash[24289]: audit 2024-09-16T13:06:15.070010+0000 mon.a (mon.0) 1727 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T13:06:15.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:06:15 smithi086 bash[24289]: audit 2024-09-16T13:06:15.075495+0000 mon.b (mon.2) 1757 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T13:06:15.827 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:06:15 smithi047 bash[22744]: audit 2024-09-16T13:06:14.350462+0000 mon.a (mon.0) 1723 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T13:06:15.828 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:06:15 smithi047 bash[22744]: audit 2024-09-16T13:06:14.357464+0000 mon.a (mon.0) 1724 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T13:06:15.828 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:06:15 smithi047 bash[22744]: audit 2024-09-16T13:06:14.364220+0000 mon.a (mon.0) 1725 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T13:06:15.828 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:06:15 smithi047 bash[22744]: audit 2024-09-16T13:06:14.370905+0000 mon.a (mon.0) 1726 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T13:06:15.828 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:06:15 smithi047 bash[22744]: audit 2024-09-16T13:06:15.056599+0000 mon.b (mon.2) 1755 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T13:06:15.828 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:06:15 smithi047 bash[22744]: audit 2024-09-16T13:06:15.058731+0000 mon.b (mon.2) 1756 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T13:06:15.828 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:06:15 smithi047 bash[22744]: audit 2024-09-16T13:06:15.070010+0000 mon.a (mon.0) 1727 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T13:06:15.828 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:06:15 smithi047 bash[22744]: audit 2024-09-16T13:06:15.075495+0000 mon.b (mon.2) 1757 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T13:06:16.093 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 13:06:15 smithi047 bash[22994]: debug 2024-09-16T13:06:15.819+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T13:06:16.094 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 13:06:15 smithi047 bash[22994]: debug 2024-09-16T13:06:15.823+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T13:06:16.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:06:16 smithi157 bash[24585]: audit 2024-09-16T13:06:15.077998+0000 mgr.a (mgr.14373) 19416 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T13:06:16.808 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:06:16 smithi157 bash[24585]: cluster 2024-09-16T13:06:15.094471+0000 mgr.a (mgr.14373) 19417 : cluster [DBG] pgmap v13468: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 936 B/s rd, 0 op/s 2024-09-16T13:06:16.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:06:16 smithi086 bash[24289]: audit 2024-09-16T13:06:15.077998+0000 mgr.a (mgr.14373) 19416 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T13:06:16.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:06:16 smithi086 bash[24289]: cluster 2024-09-16T13:06:15.094471+0000 mgr.a (mgr.14373) 19417 : cluster [DBG] pgmap v13468: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 936 B/s rd, 0 op/s 2024-09-16T13:06:16.840 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T13:06:16.841 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T13:06:16.841 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T13:06:16.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:06:16 smithi047 bash[22744]: audit 2024-09-16T13:06:15.077998+0000 mgr.a (mgr.14373) 19416 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T13:06:16.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:06:16 smithi047 bash[22744]: cluster 2024-09-16T13:06:15.094471+0000 mgr.a (mgr.14373) 19417 : cluster [DBG] pgmap v13468: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 936 B/s rd, 0 op/s 2024-09-16T13:06:17.631 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T13:06:17.632 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T13:06:17.632 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T13:06:17.632 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T13:06:17.632 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T13:06:17.808 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:06:17 smithi157 bash[24585]: audit 2024-09-16T13:06:15.825495+0000 mgr.a (mgr.14373) 19418 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T13:06:17.808 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:06:17 smithi157 bash[24585]: cephadm 2024-09-16T13:06:15.828077+0000 mgr.a (mgr.14373) 19419 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T13:06:17.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:06:17 smithi086 bash[24289]: audit 2024-09-16T13:06:15.825495+0000 mgr.a (mgr.14373) 19418 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T13:06:17.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:06:17 smithi086 bash[24289]: cephadm 2024-09-16T13:06:15.828077+0000 mgr.a (mgr.14373) 19419 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T13:06:17.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:06:17 smithi047 bash[22744]: audit 2024-09-16T13:06:15.825495+0000 mgr.a (mgr.14373) 19418 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T13:06:17.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:06:17 smithi047 bash[22744]: cephadm 2024-09-16T13:06:15.828077+0000 mgr.a (mgr.14373) 19419 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T13:06:18.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:06:18 smithi157 bash[24585]: cluster 2024-09-16T13:06:17.096918+0000 mgr.a (mgr.14373) 19420 : cluster [DBG] pgmap v13469: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 425 B/s wr, 7 op/s 2024-09-16T13:06:18.808 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:06:18 smithi157 bash[24585]: audit 2024-09-16T13:06:17.181362+0000 mgr.a (mgr.14373) 19421 : audit [DBG] from='client.415812 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:06:18.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:06:18 smithi086 bash[24289]: cluster 2024-09-16T13:06:17.096918+0000 mgr.a (mgr.14373) 19420 : cluster [DBG] pgmap v13469: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 425 B/s wr, 7 op/s 2024-09-16T13:06:18.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:06:18 smithi086 bash[24289]: audit 2024-09-16T13:06:17.181362+0000 mgr.a (mgr.14373) 19421 : audit [DBG] from='client.415812 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:06:18.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:06:18 smithi047 bash[22744]: cluster 2024-09-16T13:06:17.096918+0000 mgr.a (mgr.14373) 19420 : cluster [DBG] pgmap v13469: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 425 B/s wr, 7 op/s 2024-09-16T13:06:18.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:06:18 smithi047 bash[22744]: audit 2024-09-16T13:06:17.181362+0000 mgr.a (mgr.14373) 19421 : audit [DBG] from='client.415812 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:06:20.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:06:20 smithi157 bash[24585]: cluster 2024-09-16T13:06:19.097868+0000 mgr.a (mgr.14373) 19422 : cluster [DBG] pgmap v13470: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 425 B/s wr, 6 op/s 2024-09-16T13:06:20.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:06:20 smithi086 bash[24289]: cluster 2024-09-16T13:06:19.097868+0000 mgr.a (mgr.14373) 19422 : cluster [DBG] pgmap v13470: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 425 B/s wr, 6 op/s 2024-09-16T13:06:20.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:06:20 smithi047 bash[22744]: cluster 2024-09-16T13:06:19.097868+0000 mgr.a (mgr.14373) 19422 : cluster [DBG] pgmap v13470: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 425 B/s wr, 6 op/s 2024-09-16T13:06:22.633 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T13:06:22.634 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T13:06:22.635 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T13:06:22.809 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:06:22 smithi157 bash[24585]: cluster 2024-09-16T13:06:21.098679+0000 mgr.a (mgr.14373) 19423 : cluster [DBG] pgmap v13471: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 425 B/s wr, 6 op/s 2024-09-16T13:06:22.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:06:22 smithi086 bash[24289]: cluster 2024-09-16T13:06:21.098679+0000 mgr.a (mgr.14373) 19423 : cluster [DBG] pgmap v13471: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 425 B/s wr, 6 op/s 2024-09-16T13:06:22.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:06:22 smithi047 bash[22744]: cluster 2024-09-16T13:06:21.098679+0000 mgr.a (mgr.14373) 19423 : cluster [DBG] pgmap v13471: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 425 B/s wr, 6 op/s 2024-09-16T13:06:23.398 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T13:06:23.398 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T13:06:23.399 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T13:06:23.399 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T13:06:23.399 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T13:06:24.808 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:06:24 smithi157 bash[24585]: audit 2024-09-16T13:06:22.962845+0000 mgr.a (mgr.14373) 19424 : audit [DBG] from='client.415890 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:06:24.808 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:06:24 smithi157 bash[24585]: cluster 2024-09-16T13:06:23.101695+0000 mgr.a (mgr.14373) 19425 : cluster [DBG] pgmap v13472: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 425 B/s wr, 7 op/s 2024-09-16T13:06:24.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:06:24 smithi086 bash[24289]: audit 2024-09-16T13:06:22.962845+0000 mgr.a (mgr.14373) 19424 : audit [DBG] from='client.415890 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:06:24.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:06:24 smithi086 bash[24289]: cluster 2024-09-16T13:06:23.101695+0000 mgr.a (mgr.14373) 19425 : cluster [DBG] pgmap v13472: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 425 B/s wr, 7 op/s 2024-09-16T13:06:24.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:06:24 smithi047 bash[22744]: audit 2024-09-16T13:06:22.962845+0000 mgr.a (mgr.14373) 19424 : audit [DBG] from='client.415890 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:06:24.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:06:24 smithi047 bash[22744]: cluster 2024-09-16T13:06:23.101695+0000 mgr.a (mgr.14373) 19425 : cluster [DBG] pgmap v13472: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 425 B/s wr, 7 op/s 2024-09-16T13:06:26.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:06:26 smithi157 bash[24585]: cluster 2024-09-16T13:06:25.102638+0000 mgr.a (mgr.14373) 19426 : cluster [DBG] pgmap v13473: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 425 B/s wr, 7 op/s 2024-09-16T13:06:26.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:06:26 smithi086 bash[24289]: cluster 2024-09-16T13:06:25.102638+0000 mgr.a (mgr.14373) 19426 : cluster [DBG] pgmap v13473: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 425 B/s wr, 7 op/s 2024-09-16T13:06:26.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:06:26 smithi047 bash[22744]: cluster 2024-09-16T13:06:25.102638+0000 mgr.a (mgr.14373) 19426 : cluster [DBG] pgmap v13473: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 425 B/s wr, 7 op/s 2024-09-16T13:06:28.400 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T13:06:28.400 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T13:06:28.401 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T13:06:28.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:06:28 smithi157 bash[24585]: cluster 2024-09-16T13:06:27.104767+0000 mgr.a (mgr.14373) 19427 : cluster [DBG] pgmap v13474: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T13:06:28.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:06:28 smithi086 bash[24289]: cluster 2024-09-16T13:06:27.104767+0000 mgr.a (mgr.14373) 19427 : cluster [DBG] pgmap v13474: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T13:06:28.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:06:28 smithi047 bash[22744]: cluster 2024-09-16T13:06:27.104767+0000 mgr.a (mgr.14373) 19427 : cluster [DBG] pgmap v13474: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T13:06:29.163 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T13:06:29.163 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T13:06:29.163 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T13:06:29.163 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T13:06:29.163 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T13:06:30.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:06:30 smithi157 bash[24585]: audit 2024-09-16T13:06:28.724564+0000 mgr.a (mgr.14373) 19428 : audit [DBG] from='client.415962 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:06:30.808 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:06:30 smithi157 bash[24585]: cluster 2024-09-16T13:06:29.105416+0000 mgr.a (mgr.14373) 19429 : cluster [DBG] pgmap v13475: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:06:30.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:06:30 smithi086 bash[24289]: audit 2024-09-16T13:06:28.724564+0000 mgr.a (mgr.14373) 19428 : audit [DBG] from='client.415962 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:06:30.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:06:30 smithi086 bash[24289]: cluster 2024-09-16T13:06:29.105416+0000 mgr.a (mgr.14373) 19429 : cluster [DBG] pgmap v13475: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:06:30.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:06:30 smithi047 bash[22744]: audit 2024-09-16T13:06:28.724564+0000 mgr.a (mgr.14373) 19428 : audit [DBG] from='client.415962 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:06:30.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:06:30 smithi047 bash[22744]: cluster 2024-09-16T13:06:29.105416+0000 mgr.a (mgr.14373) 19429 : cluster [DBG] pgmap v13475: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:06:32.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:06:32 smithi157 bash[24585]: cluster 2024-09-16T13:06:31.106181+0000 mgr.a (mgr.14373) 19430 : cluster [DBG] pgmap v13476: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:06:32.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:06:32 smithi086 bash[24289]: cluster 2024-09-16T13:06:31.106181+0000 mgr.a (mgr.14373) 19430 : cluster [DBG] pgmap v13476: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:06:32.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:06:32 smithi047 bash[22744]: cluster 2024-09-16T13:06:31.106181+0000 mgr.a (mgr.14373) 19430 : cluster [DBG] pgmap v13476: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:06:34.164 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T13:06:34.165 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T13:06:34.165 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T13:06:34.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:06:34 smithi157 bash[24585]: cluster 2024-09-16T13:06:33.108390+0000 mgr.a (mgr.14373) 19431 : cluster [DBG] pgmap v13477: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T13:06:34.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:06:34 smithi086 bash[24289]: cluster 2024-09-16T13:06:33.108390+0000 mgr.a (mgr.14373) 19431 : cluster [DBG] pgmap v13477: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T13:06:34.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:06:34 smithi047 bash[22744]: cluster 2024-09-16T13:06:33.108390+0000 mgr.a (mgr.14373) 19431 : cluster [DBG] pgmap v13477: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T13:06:34.913 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T13:06:34.913 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T13:06:34.913 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T13:06:34.914 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T13:06:34.914 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T13:06:35.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:06:35 smithi157 bash[24585]: audit 2024-09-16T13:06:34.494142+0000 mgr.a (mgr.14373) 19432 : audit [DBG] from='client.416040 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:06:35.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:06:35 smithi086 bash[24289]: audit 2024-09-16T13:06:34.494142+0000 mgr.a (mgr.14373) 19432 : audit [DBG] from='client.416040 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:06:35.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:06:35 smithi047 bash[22744]: audit 2024-09-16T13:06:34.494142+0000 mgr.a (mgr.14373) 19432 : audit [DBG] from='client.416040 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:06:36.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:06:36 smithi157 bash[24585]: cluster 2024-09-16T13:06:35.109315+0000 mgr.a (mgr.14373) 19433 : cluster [DBG] pgmap v13478: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:06:36.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:06:36 smithi086 bash[24289]: cluster 2024-09-16T13:06:35.109315+0000 mgr.a (mgr.14373) 19433 : cluster [DBG] pgmap v13478: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:06:36.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:06:36 smithi047 bash[22744]: cluster 2024-09-16T13:06:35.109315+0000 mgr.a (mgr.14373) 19433 : cluster [DBG] pgmap v13478: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:06:38.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:06:38 smithi157 bash[24585]: cluster 2024-09-16T13:06:37.111502+0000 mgr.a (mgr.14373) 19434 : cluster [DBG] pgmap v13479: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T13:06:38.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:06:38 smithi086 bash[24289]: cluster 2024-09-16T13:06:37.111502+0000 mgr.a (mgr.14373) 19434 : cluster [DBG] pgmap v13479: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T13:06:38.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:06:38 smithi047 bash[22744]: cluster 2024-09-16T13:06:37.111502+0000 mgr.a (mgr.14373) 19434 : cluster [DBG] pgmap v13479: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T13:06:39.915 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T13:06:39.916 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T13:06:39.916 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T13:06:40.665 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T13:06:40.665 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T13:06:40.665 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T13:06:40.665 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T13:06:40.665 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T13:06:40.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:06:40 smithi157 bash[24585]: cluster 2024-09-16T13:06:39.112263+0000 mgr.a (mgr.14373) 19435 : cluster [DBG] pgmap v13480: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:06:40.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:06:40 smithi086 bash[24289]: cluster 2024-09-16T13:06:39.112263+0000 mgr.a (mgr.14373) 19435 : cluster [DBG] pgmap v13480: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:06:40.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:06:40 smithi047 bash[22744]: cluster 2024-09-16T13:06:39.112263+0000 mgr.a (mgr.14373) 19435 : cluster [DBG] pgmap v13480: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:06:41.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:06:41 smithi157 bash[24585]: audit 2024-09-16T13:06:40.241556+0000 mgr.a (mgr.14373) 19436 : audit [DBG] from='client.416118 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:06:41.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:06:41 smithi086 bash[24289]: audit 2024-09-16T13:06:40.241556+0000 mgr.a (mgr.14373) 19436 : audit [DBG] from='client.416118 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:06:41.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:06:41 smithi047 bash[22744]: audit 2024-09-16T13:06:40.241556+0000 mgr.a (mgr.14373) 19436 : audit [DBG] from='client.416118 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:06:42.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:06:42 smithi157 bash[24585]: cluster 2024-09-16T13:06:41.113363+0000 mgr.a (mgr.14373) 19437 : cluster [DBG] pgmap v13481: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:06:42.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:06:42 smithi086 bash[24289]: cluster 2024-09-16T13:06:41.113363+0000 mgr.a (mgr.14373) 19437 : cluster [DBG] pgmap v13481: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:06:42.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:06:42 smithi047 bash[22744]: cluster 2024-09-16T13:06:41.113363+0000 mgr.a (mgr.14373) 19437 : cluster [DBG] pgmap v13481: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:06:44.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:06:44 smithi157 bash[24585]: cluster 2024-09-16T13:06:43.115672+0000 mgr.a (mgr.14373) 19438 : cluster [DBG] pgmap v13482: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T13:06:44.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:06:44 smithi086 bash[24289]: cluster 2024-09-16T13:06:43.115672+0000 mgr.a (mgr.14373) 19438 : cluster [DBG] pgmap v13482: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T13:06:44.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:06:44 smithi047 bash[22744]: cluster 2024-09-16T13:06:43.115672+0000 mgr.a (mgr.14373) 19438 : cluster [DBG] pgmap v13482: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T13:06:45.667 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T13:06:45.667 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T13:06:45.667 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T13:06:46.444 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T13:06:46.445 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T13:06:46.445 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T13:06:46.445 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T13:06:46.445 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T13:06:46.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:06:46 smithi157 bash[24585]: cluster 2024-09-16T13:06:45.116440+0000 mgr.a (mgr.14373) 19439 : cluster [DBG] pgmap v13483: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:06:46.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:06:46 smithi086 bash[24289]: cluster 2024-09-16T13:06:45.116440+0000 mgr.a (mgr.14373) 19439 : cluster [DBG] pgmap v13483: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:06:46.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:06:46 smithi047 bash[22744]: cluster 2024-09-16T13:06:45.116440+0000 mgr.a (mgr.14373) 19439 : cluster [DBG] pgmap v13483: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:06:47.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:06:47 smithi157 bash[24585]: audit 2024-09-16T13:06:46.000339+0000 mgr.a (mgr.14373) 19440 : audit [DBG] from='client.416196 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:06:47.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:06:47 smithi086 bash[24289]: audit 2024-09-16T13:06:46.000339+0000 mgr.a (mgr.14373) 19440 : audit [DBG] from='client.416196 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:06:47.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:06:47 smithi047 bash[22744]: audit 2024-09-16T13:06:46.000339+0000 mgr.a (mgr.14373) 19440 : audit [DBG] from='client.416196 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:06:48.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:06:48 smithi157 bash[24585]: cluster 2024-09-16T13:06:47.118788+0000 mgr.a (mgr.14373) 19441 : cluster [DBG] pgmap v13484: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T13:06:48.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:06:48 smithi086 bash[24289]: cluster 2024-09-16T13:06:47.118788+0000 mgr.a (mgr.14373) 19441 : cluster [DBG] pgmap v13484: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T13:06:48.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:06:48 smithi047 bash[22744]: cluster 2024-09-16T13:06:47.118788+0000 mgr.a (mgr.14373) 19441 : cluster [DBG] pgmap v13484: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T13:06:50.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:06:50 smithi157 bash[24585]: cluster 2024-09-16T13:06:49.119570+0000 mgr.a (mgr.14373) 19442 : cluster [DBG] pgmap v13485: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:06:50.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:06:50 smithi086 bash[24289]: cluster 2024-09-16T13:06:49.119570+0000 mgr.a (mgr.14373) 19442 : cluster [DBG] pgmap v13485: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:06:50.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:06:50 smithi047 bash[22744]: cluster 2024-09-16T13:06:49.119570+0000 mgr.a (mgr.14373) 19442 : cluster [DBG] pgmap v13485: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:06:51.446 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T13:06:51.447 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T13:06:51.447 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T13:06:52.224 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T13:06:52.224 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T13:06:52.224 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T13:06:52.224 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T13:06:52.225 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T13:06:52.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:06:52 smithi157 bash[24585]: cluster 2024-09-16T13:06:51.120327+0000 mgr.a (mgr.14373) 19443 : cluster [DBG] pgmap v13486: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:06:52.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:06:52 smithi086 bash[24289]: cluster 2024-09-16T13:06:51.120327+0000 mgr.a (mgr.14373) 19443 : cluster [DBG] pgmap v13486: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:06:52.844 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:06:52 smithi047 bash[22744]: cluster 2024-09-16T13:06:51.120327+0000 mgr.a (mgr.14373) 19443 : cluster [DBG] pgmap v13486: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:06:53.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:06:53 smithi157 bash[24585]: audit 2024-09-16T13:06:51.784329+0000 mgr.a (mgr.14373) 19444 : audit [DBG] from='client.416271 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:06:53.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:06:53 smithi086 bash[24289]: audit 2024-09-16T13:06:51.784329+0000 mgr.a (mgr.14373) 19444 : audit [DBG] from='client.416271 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:06:53.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:06:53 smithi047 bash[22744]: audit 2024-09-16T13:06:51.784329+0000 mgr.a (mgr.14373) 19444 : audit [DBG] from='client.416271 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:06:54.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:06:54 smithi157 bash[24585]: cluster 2024-09-16T13:06:53.123189+0000 mgr.a (mgr.14373) 19445 : cluster [DBG] pgmap v13487: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:06:54.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:06:54 smithi086 bash[24289]: cluster 2024-09-16T13:06:53.123189+0000 mgr.a (mgr.14373) 19445 : cluster [DBG] pgmap v13487: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:06:54.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:06:54 smithi047 bash[22744]: cluster 2024-09-16T13:06:53.123189+0000 mgr.a (mgr.14373) 19445 : cluster [DBG] pgmap v13487: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:06:56.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:06:56 smithi157 bash[24585]: cluster 2024-09-16T13:06:55.123955+0000 mgr.a (mgr.14373) 19446 : cluster [DBG] pgmap v13488: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T13:06:56.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:06:56 smithi086 bash[24289]: cluster 2024-09-16T13:06:55.123955+0000 mgr.a (mgr.14373) 19446 : cluster [DBG] pgmap v13488: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T13:06:56.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:06:56 smithi047 bash[22744]: cluster 2024-09-16T13:06:55.123955+0000 mgr.a (mgr.14373) 19446 : cluster [DBG] pgmap v13488: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T13:06:57.226 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T13:06:57.226 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T13:06:57.226 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T13:06:57.998 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T13:06:57.999 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T13:06:57.999 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T13:06:57.999 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T13:06:57.999 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T13:06:58.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:06:58 smithi157 bash[24585]: cluster 2024-09-16T13:06:57.125940+0000 mgr.a (mgr.14373) 19447 : cluster [DBG] pgmap v13489: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:06:58.808 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:06:58 smithi157 bash[24585]: audit 2024-09-16T13:06:57.557171+0000 mgr.a (mgr.14373) 19448 : audit [DBG] from='client.416349 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:06:58.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:06:58 smithi086 bash[24289]: cluster 2024-09-16T13:06:57.125940+0000 mgr.a (mgr.14373) 19447 : cluster [DBG] pgmap v13489: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:06:58.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:06:58 smithi086 bash[24289]: audit 2024-09-16T13:06:57.557171+0000 mgr.a (mgr.14373) 19448 : audit [DBG] from='client.416349 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:06:58.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:06:58 smithi047 bash[22744]: cluster 2024-09-16T13:06:57.125940+0000 mgr.a (mgr.14373) 19447 : cluster [DBG] pgmap v13489: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:06:58.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:06:58 smithi047 bash[22744]: audit 2024-09-16T13:06:57.557171+0000 mgr.a (mgr.14373) 19448 : audit [DBG] from='client.416349 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:07:00.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:07:00 smithi157 bash[24585]: cluster 2024-09-16T13:06:59.126927+0000 mgr.a (mgr.14373) 19449 : cluster [DBG] pgmap v13490: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T13:07:00.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:07:00 smithi086 bash[24289]: cluster 2024-09-16T13:06:59.126927+0000 mgr.a (mgr.14373) 19449 : cluster [DBG] pgmap v13490: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T13:07:00.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:07:00 smithi047 bash[22744]: cluster 2024-09-16T13:06:59.126927+0000 mgr.a (mgr.14373) 19449 : cluster [DBG] pgmap v13490: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T13:07:02.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:07:02 smithi157 bash[24585]: cluster 2024-09-16T13:07:01.127724+0000 mgr.a (mgr.14373) 19450 : cluster [DBG] pgmap v13491: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T13:07:02.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:07:02 smithi086 bash[24289]: cluster 2024-09-16T13:07:01.127724+0000 mgr.a (mgr.14373) 19450 : cluster [DBG] pgmap v13491: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T13:07:02.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:07:02 smithi047 bash[22744]: cluster 2024-09-16T13:07:01.127724+0000 mgr.a (mgr.14373) 19450 : cluster [DBG] pgmap v13491: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T13:07:03.000 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T13:07:03.001 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T13:07:03.001 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T13:07:03.779 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T13:07:03.780 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T13:07:03.780 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T13:07:03.780 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T13:07:03.780 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T13:07:04.808 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:07:04 smithi157 bash[24585]: cluster 2024-09-16T13:07:03.128899+0000 mgr.a (mgr.14373) 19451 : cluster [DBG] pgmap v13492: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:07:04.808 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:07:04 smithi157 bash[24585]: audit 2024-09-16T13:07:03.335665+0000 mgr.a (mgr.14373) 19452 : audit [DBG] from='client.416427 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:07:04.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:07:04 smithi086 bash[24289]: cluster 2024-09-16T13:07:03.128899+0000 mgr.a (mgr.14373) 19451 : cluster [DBG] pgmap v13492: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:07:04.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:07:04 smithi086 bash[24289]: audit 2024-09-16T13:07:03.335665+0000 mgr.a (mgr.14373) 19452 : audit [DBG] from='client.416427 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:07:04.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:07:04 smithi047 bash[22744]: cluster 2024-09-16T13:07:03.128899+0000 mgr.a (mgr.14373) 19451 : cluster [DBG] pgmap v13492: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:07:04.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:07:04 smithi047 bash[22744]: audit 2024-09-16T13:07:03.335665+0000 mgr.a (mgr.14373) 19452 : audit [DBG] from='client.416427 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:07:06.808 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:07:06 smithi157 bash[24585]: cluster 2024-09-16T13:07:05.129779+0000 mgr.a (mgr.14373) 19453 : cluster [DBG] pgmap v13493: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:07:06.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:07:06 smithi086 bash[24289]: cluster 2024-09-16T13:07:05.129779+0000 mgr.a (mgr.14373) 19453 : cluster [DBG] pgmap v13493: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:07:06.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:07:06 smithi047 bash[22744]: cluster 2024-09-16T13:07:05.129779+0000 mgr.a (mgr.14373) 19453 : cluster [DBG] pgmap v13493: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:07:08.781 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T13:07:08.782 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T13:07:08.782 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T13:07:08.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:07:08 smithi157 bash[24585]: cluster 2024-09-16T13:07:07.131945+0000 mgr.a (mgr.14373) 19454 : cluster [DBG] pgmap v13494: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T13:07:08.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:07:08 smithi086 bash[24289]: cluster 2024-09-16T13:07:07.131945+0000 mgr.a (mgr.14373) 19454 : cluster [DBG] pgmap v13494: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T13:07:08.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:07:08 smithi047 bash[22744]: cluster 2024-09-16T13:07:07.131945+0000 mgr.a (mgr.14373) 19454 : cluster [DBG] pgmap v13494: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T13:07:09.560 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T13:07:09.560 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T13:07:09.560 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T13:07:09.561 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T13:07:09.561 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T13:07:10.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:07:10 smithi157 bash[24585]: audit 2024-09-16T13:07:09.110121+0000 mgr.a (mgr.14373) 19455 : audit [DBG] from='client.416505 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:07:10.808 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:07:10 smithi157 bash[24585]: cluster 2024-09-16T13:07:09.133339+0000 mgr.a (mgr.14373) 19456 : cluster [DBG] pgmap v13495: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:07:10.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:07:10 smithi086 bash[24289]: audit 2024-09-16T13:07:09.110121+0000 mgr.a (mgr.14373) 19455 : audit [DBG] from='client.416505 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:07:10.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:07:10 smithi086 bash[24289]: cluster 2024-09-16T13:07:09.133339+0000 mgr.a (mgr.14373) 19456 : cluster [DBG] pgmap v13495: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:07:10.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:07:10 smithi047 bash[22744]: audit 2024-09-16T13:07:09.110121+0000 mgr.a (mgr.14373) 19455 : audit [DBG] from='client.416505 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:07:10.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:07:10 smithi047 bash[22744]: cluster 2024-09-16T13:07:09.133339+0000 mgr.a (mgr.14373) 19456 : cluster [DBG] pgmap v13495: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:07:12.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:07:12 smithi157 bash[24585]: cluster 2024-09-16T13:07:11.134270+0000 mgr.a (mgr.14373) 19457 : cluster [DBG] pgmap v13496: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:07:12.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:07:12 smithi086 bash[24289]: cluster 2024-09-16T13:07:11.134270+0000 mgr.a (mgr.14373) 19457 : cluster [DBG] pgmap v13496: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:07:12.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:07:12 smithi047 bash[22744]: cluster 2024-09-16T13:07:11.134270+0000 mgr.a (mgr.14373) 19457 : cluster [DBG] pgmap v13496: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:07:14.562 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T13:07:14.562 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T13:07:14.563 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T13:07:14.808 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:07:14 smithi157 bash[24585]: cluster 2024-09-16T13:07:13.136550+0000 mgr.a (mgr.14373) 19458 : cluster [DBG] pgmap v13497: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T13:07:14.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:07:14 smithi086 bash[24289]: cluster 2024-09-16T13:07:13.136550+0000 mgr.a (mgr.14373) 19458 : cluster [DBG] pgmap v13497: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T13:07:14.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:07:14 smithi047 bash[22744]: cluster 2024-09-16T13:07:13.136550+0000 mgr.a (mgr.14373) 19458 : cluster [DBG] pgmap v13497: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T13:07:15.324 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T13:07:15.325 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T13:07:15.325 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T13:07:15.325 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T13:07:15.325 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T13:07:16.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:07:16 smithi157 bash[24585]: audit 2024-09-16T13:07:14.892660+0000 mgr.a (mgr.14373) 19459 : audit [DBG] from='client.416583 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:07:16.808 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:07:16 smithi157 bash[24585]: cluster 2024-09-16T13:07:15.137153+0000 mgr.a (mgr.14373) 19460 : cluster [DBG] pgmap v13498: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:07:16.808 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:07:16 smithi157 bash[24585]: audit 2024-09-16T13:07:15.881045+0000 mon.b (mon.2) 1758 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T13:07:16.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:07:16 smithi086 bash[24289]: audit 2024-09-16T13:07:14.892660+0000 mgr.a (mgr.14373) 19459 : audit [DBG] from='client.416583 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:07:16.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:07:16 smithi086 bash[24289]: cluster 2024-09-16T13:07:15.137153+0000 mgr.a (mgr.14373) 19460 : cluster [DBG] pgmap v13498: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:07:16.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:07:16 smithi086 bash[24289]: audit 2024-09-16T13:07:15.881045+0000 mon.b (mon.2) 1758 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T13:07:16.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:07:16 smithi047 bash[22744]: audit 2024-09-16T13:07:14.892660+0000 mgr.a (mgr.14373) 19459 : audit [DBG] from='client.416583 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:07:16.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:07:16 smithi047 bash[22744]: cluster 2024-09-16T13:07:15.137153+0000 mgr.a (mgr.14373) 19460 : cluster [DBG] pgmap v13498: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:07:16.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:07:16 smithi047 bash[22744]: audit 2024-09-16T13:07:15.881045+0000 mon.b (mon.2) 1758 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T13:07:17.808 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:07:17 smithi157 bash[24585]: audit 2024-09-16T13:07:16.727856+0000 mon.b (mon.2) 1759 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T13:07:17.808 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:07:17 smithi157 bash[24585]: audit 2024-09-16T13:07:16.729749+0000 mon.b (mon.2) 1760 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T13:07:17.808 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:07:17 smithi157 bash[24585]: audit 2024-09-16T13:07:16.740810+0000 mon.a (mon.0) 1728 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T13:07:17.808 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:07:17 smithi157 bash[24585]: audit 2024-09-16T13:07:16.748017+0000 mon.b (mon.2) 1761 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T13:07:17.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:07:17 smithi086 bash[24289]: audit 2024-09-16T13:07:16.727856+0000 mon.b (mon.2) 1759 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T13:07:17.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:07:17 smithi086 bash[24289]: audit 2024-09-16T13:07:16.729749+0000 mon.b (mon.2) 1760 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T13:07:17.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:07:17 smithi086 bash[24289]: audit 2024-09-16T13:07:16.740810+0000 mon.a (mon.0) 1728 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T13:07:17.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:07:17 smithi086 bash[24289]: audit 2024-09-16T13:07:16.748017+0000 mon.b (mon.2) 1761 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T13:07:17.843 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 13:07:17 smithi047 bash[22994]: debug 2024-09-16T13:07:17.493+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T13:07:17.843 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 13:07:17 smithi047 bash[22994]: debug 2024-09-16T13:07:17.497+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T13:07:17.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:07:17 smithi047 bash[22744]: audit 2024-09-16T13:07:16.727856+0000 mon.b (mon.2) 1759 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T13:07:17.844 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:07:17 smithi047 bash[22744]: audit 2024-09-16T13:07:16.729749+0000 mon.b (mon.2) 1760 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T13:07:17.844 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:07:17 smithi047 bash[22744]: audit 2024-09-16T13:07:16.740810+0000 mon.a (mon.0) 1728 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T13:07:17.844 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:07:17 smithi047 bash[22744]: audit 2024-09-16T13:07:16.748017+0000 mon.b (mon.2) 1761 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T13:07:18.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:07:18 smithi157 bash[24585]: audit 2024-09-16T13:07:16.750448+0000 mgr.a (mgr.14373) 19461 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T13:07:18.808 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:07:18 smithi157 bash[24585]: cluster 2024-09-16T13:07:17.138867+0000 mgr.a (mgr.14373) 19462 : cluster [DBG] pgmap v13499: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T13:07:18.808 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:07:18 smithi157 bash[24585]: audit 2024-09-16T13:07:17.496861+0000 mgr.a (mgr.14373) 19463 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T13:07:18.808 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:07:18 smithi157 bash[24585]: cephadm 2024-09-16T13:07:17.498976+0000 mgr.a (mgr.14373) 19464 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T13:07:18.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:07:18 smithi086 bash[24289]: audit 2024-09-16T13:07:16.750448+0000 mgr.a (mgr.14373) 19461 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T13:07:18.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:07:18 smithi086 bash[24289]: cluster 2024-09-16T13:07:17.138867+0000 mgr.a (mgr.14373) 19462 : cluster [DBG] pgmap v13499: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T13:07:18.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:07:18 smithi086 bash[24289]: audit 2024-09-16T13:07:17.496861+0000 mgr.a (mgr.14373) 19463 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T13:07:18.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:07:18 smithi086 bash[24289]: cephadm 2024-09-16T13:07:17.498976+0000 mgr.a (mgr.14373) 19464 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T13:07:18.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:07:18 smithi047 bash[22744]: audit 2024-09-16T13:07:16.750448+0000 mgr.a (mgr.14373) 19461 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T13:07:18.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:07:18 smithi047 bash[22744]: cluster 2024-09-16T13:07:17.138867+0000 mgr.a (mgr.14373) 19462 : cluster [DBG] pgmap v13499: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T13:07:18.844 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:07:18 smithi047 bash[22744]: audit 2024-09-16T13:07:17.496861+0000 mgr.a (mgr.14373) 19463 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T13:07:18.844 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:07:18 smithi047 bash[22744]: cephadm 2024-09-16T13:07:17.498976+0000 mgr.a (mgr.14373) 19464 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T13:07:20.326 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T13:07:20.327 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T13:07:20.328 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T13:07:20.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:07:20 smithi157 bash[24585]: cluster 2024-09-16T13:07:19.139701+0000 mgr.a (mgr.14373) 19465 : cluster [DBG] pgmap v13500: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:07:20.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:07:20 smithi086 bash[24289]: cluster 2024-09-16T13:07:19.139701+0000 mgr.a (mgr.14373) 19465 : cluster [DBG] pgmap v13500: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:07:20.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:07:20 smithi047 bash[22744]: cluster 2024-09-16T13:07:19.139701+0000 mgr.a (mgr.14373) 19465 : cluster [DBG] pgmap v13500: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:07:21.107 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T13:07:21.107 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T13:07:21.107 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T13:07:21.107 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T13:07:21.107 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T13:07:21.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:07:21 smithi157 bash[24585]: audit 2024-09-16T13:07:20.658550+0000 mgr.a (mgr.14373) 19466 : audit [DBG] from='client.416766 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:07:21.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:07:21 smithi086 bash[24289]: audit 2024-09-16T13:07:20.658550+0000 mgr.a (mgr.14373) 19466 : audit [DBG] from='client.416766 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:07:21.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:07:21 smithi047 bash[22744]: audit 2024-09-16T13:07:20.658550+0000 mgr.a (mgr.14373) 19466 : audit [DBG] from='client.416766 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:07:22.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:07:22 smithi157 bash[24585]: cluster 2024-09-16T13:07:21.140485+0000 mgr.a (mgr.14373) 19467 : cluster [DBG] pgmap v13501: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:07:22.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:07:22 smithi086 bash[24289]: cluster 2024-09-16T13:07:21.140485+0000 mgr.a (mgr.14373) 19467 : cluster [DBG] pgmap v13501: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:07:22.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:07:22 smithi047 bash[22744]: cluster 2024-09-16T13:07:21.140485+0000 mgr.a (mgr.14373) 19467 : cluster [DBG] pgmap v13501: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:07:24.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:07:24 smithi157 bash[24585]: cluster 2024-09-16T13:07:23.142691+0000 mgr.a (mgr.14373) 19468 : cluster [DBG] pgmap v13502: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T13:07:24.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:07:24 smithi086 bash[24289]: cluster 2024-09-16T13:07:23.142691+0000 mgr.a (mgr.14373) 19468 : cluster [DBG] pgmap v13502: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T13:07:24.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:07:24 smithi047 bash[22744]: cluster 2024-09-16T13:07:23.142691+0000 mgr.a (mgr.14373) 19468 : cluster [DBG] pgmap v13502: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T13:07:26.108 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T13:07:26.109 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T13:07:26.109 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T13:07:26.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:07:26 smithi157 bash[24585]: cluster 2024-09-16T13:07:25.143458+0000 mgr.a (mgr.14373) 19469 : cluster [DBG] pgmap v13503: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T13:07:26.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:07:26 smithi086 bash[24289]: cluster 2024-09-16T13:07:25.143458+0000 mgr.a (mgr.14373) 19469 : cluster [DBG] pgmap v13503: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T13:07:26.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:07:26 smithi047 bash[22744]: cluster 2024-09-16T13:07:25.143458+0000 mgr.a (mgr.14373) 19469 : cluster [DBG] pgmap v13503: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T13:07:26.874 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T13:07:26.875 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T13:07:26.875 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T13:07:26.875 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T13:07:26.875 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T13:07:27.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:07:27 smithi157 bash[24585]: audit 2024-09-16T13:07:26.444123+0000 mgr.a (mgr.14373) 19470 : audit [DBG] from='client.416841 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:07:27.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:07:27 smithi086 bash[24289]: audit 2024-09-16T13:07:26.444123+0000 mgr.a (mgr.14373) 19470 : audit [DBG] from='client.416841 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:07:27.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:07:27 smithi047 bash[22744]: audit 2024-09-16T13:07:26.444123+0000 mgr.a (mgr.14373) 19470 : audit [DBG] from='client.416841 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:07:28.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:07:28 smithi157 bash[24585]: cluster 2024-09-16T13:07:27.146145+0000 mgr.a (mgr.14373) 19471 : cluster [DBG] pgmap v13504: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T13:07:28.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:07:28 smithi086 bash[24289]: cluster 2024-09-16T13:07:27.146145+0000 mgr.a (mgr.14373) 19471 : cluster [DBG] pgmap v13504: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T13:07:28.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:07:28 smithi047 bash[22744]: cluster 2024-09-16T13:07:27.146145+0000 mgr.a (mgr.14373) 19471 : cluster [DBG] pgmap v13504: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T13:07:30.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:07:30 smithi157 bash[24585]: cluster 2024-09-16T13:07:29.146938+0000 mgr.a (mgr.14373) 19472 : cluster [DBG] pgmap v13505: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T13:07:30.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:07:30 smithi086 bash[24289]: cluster 2024-09-16T13:07:29.146938+0000 mgr.a (mgr.14373) 19472 : cluster [DBG] pgmap v13505: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T13:07:30.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:07:30 smithi047 bash[22744]: cluster 2024-09-16T13:07:29.146938+0000 mgr.a (mgr.14373) 19472 : cluster [DBG] pgmap v13505: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T13:07:31.876 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T13:07:31.876 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T13:07:31.877 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T13:07:32.657 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T13:07:32.657 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T13:07:32.657 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T13:07:32.658 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T13:07:32.658 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T13:07:32.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:07:32 smithi086 bash[24289]: cluster 2024-09-16T13:07:31.147700+0000 mgr.a (mgr.14373) 19473 : cluster [DBG] pgmap v13506: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T13:07:32.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:07:32 smithi047 bash[22744]: cluster 2024-09-16T13:07:31.147700+0000 mgr.a (mgr.14373) 19473 : cluster [DBG] pgmap v13506: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T13:07:33.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:07:32 smithi157 bash[24585]: cluster 2024-09-16T13:07:31.147700+0000 mgr.a (mgr.14373) 19473 : cluster [DBG] pgmap v13506: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T13:07:33.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:07:33 smithi086 bash[24289]: audit 2024-09-16T13:07:32.209299+0000 mgr.a (mgr.14373) 19474 : audit [DBG] from='client.416916 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:07:33.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:07:33 smithi047 bash[22744]: audit 2024-09-16T13:07:32.209299+0000 mgr.a (mgr.14373) 19474 : audit [DBG] from='client.416916 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:07:34.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:07:33 smithi157 bash[24585]: audit 2024-09-16T13:07:32.209299+0000 mgr.a (mgr.14373) 19474 : audit [DBG] from='client.416916 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:07:34.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:07:34 smithi086 bash[24289]: cluster 2024-09-16T13:07:33.150516+0000 mgr.a (mgr.14373) 19475 : cluster [DBG] pgmap v13507: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T13:07:34.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:07:34 smithi047 bash[22744]: cluster 2024-09-16T13:07:33.150516+0000 mgr.a (mgr.14373) 19475 : cluster [DBG] pgmap v13507: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T13:07:35.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:07:34 smithi157 bash[24585]: cluster 2024-09-16T13:07:33.150516+0000 mgr.a (mgr.14373) 19475 : cluster [DBG] pgmap v13507: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T13:07:36.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:07:36 smithi047 bash[22744]: cluster 2024-09-16T13:07:35.151294+0000 mgr.a (mgr.14373) 19476 : cluster [DBG] pgmap v13508: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T13:07:37.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:07:36 smithi157 bash[24585]: cluster 2024-09-16T13:07:35.151294+0000 mgr.a (mgr.14373) 19476 : cluster [DBG] pgmap v13508: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T13:07:37.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:07:36 smithi086 bash[24289]: cluster 2024-09-16T13:07:35.151294+0000 mgr.a (mgr.14373) 19476 : cluster [DBG] pgmap v13508: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T13:07:37.659 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T13:07:37.660 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T13:07:37.660 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T13:07:38.446 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T13:07:38.446 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T13:07:38.446 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T13:07:38.446 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T13:07:38.446 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T13:07:38.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:07:38 smithi047 bash[22744]: cluster 2024-09-16T13:07:37.153248+0000 mgr.a (mgr.14373) 19477 : cluster [DBG] pgmap v13509: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:07:39.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:07:38 smithi157 bash[24585]: cluster 2024-09-16T13:07:37.153248+0000 mgr.a (mgr.14373) 19477 : cluster [DBG] pgmap v13509: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:07:39.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:07:38 smithi086 bash[24289]: cluster 2024-09-16T13:07:37.153248+0000 mgr.a (mgr.14373) 19477 : cluster [DBG] pgmap v13509: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:07:39.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:07:39 smithi047 bash[22744]: audit 2024-09-16T13:07:37.990833+0000 mgr.a (mgr.14373) 19478 : audit [DBG] from='client.416991 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:07:40.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:07:39 smithi157 bash[24585]: audit 2024-09-16T13:07:37.990833+0000 mgr.a (mgr.14373) 19478 : audit [DBG] from='client.416991 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:07:40.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:07:39 smithi086 bash[24289]: audit 2024-09-16T13:07:37.990833+0000 mgr.a (mgr.14373) 19478 : audit [DBG] from='client.416991 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:07:40.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:07:40 smithi047 bash[22744]: cluster 2024-09-16T13:07:39.154206+0000 mgr.a (mgr.14373) 19479 : cluster [DBG] pgmap v13510: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:07:41.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:07:40 smithi157 bash[24585]: cluster 2024-09-16T13:07:39.154206+0000 mgr.a (mgr.14373) 19479 : cluster [DBG] pgmap v13510: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:07:41.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:07:40 smithi086 bash[24289]: cluster 2024-09-16T13:07:39.154206+0000 mgr.a (mgr.14373) 19479 : cluster [DBG] pgmap v13510: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:07:42.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:07:42 smithi047 bash[22744]: cluster 2024-09-16T13:07:41.154993+0000 mgr.a (mgr.14373) 19480 : cluster [DBG] pgmap v13511: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:07:43.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:07:42 smithi157 bash[24585]: cluster 2024-09-16T13:07:41.154993+0000 mgr.a (mgr.14373) 19480 : cluster [DBG] pgmap v13511: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:07:43.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:07:42 smithi086 bash[24289]: cluster 2024-09-16T13:07:41.154993+0000 mgr.a (mgr.14373) 19480 : cluster [DBG] pgmap v13511: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:07:43.447 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T13:07:43.448 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T13:07:43.449 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T13:07:44.217 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T13:07:44.217 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T13:07:44.217 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T13:07:44.217 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T13:07:44.217 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T13:07:45.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:07:44 smithi157 bash[24585]: cluster 2024-09-16T13:07:43.157162+0000 mgr.a (mgr.14373) 19481 : cluster [DBG] pgmap v13512: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T13:07:45.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:07:44 smithi086 bash[24289]: cluster 2024-09-16T13:07:43.157162+0000 mgr.a (mgr.14373) 19481 : cluster [DBG] pgmap v13512: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T13:07:45.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:07:44 smithi047 bash[22744]: cluster 2024-09-16T13:07:43.157162+0000 mgr.a (mgr.14373) 19481 : cluster [DBG] pgmap v13512: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T13:07:46.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:07:45 smithi157 bash[24585]: audit 2024-09-16T13:07:43.778439+0000 mgr.a (mgr.14373) 19482 : audit [DBG] from='client.417069 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:07:46.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:07:45 smithi086 bash[24289]: audit 2024-09-16T13:07:43.778439+0000 mgr.a (mgr.14373) 19482 : audit [DBG] from='client.417069 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:07:46.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:07:45 smithi047 bash[22744]: audit 2024-09-16T13:07:43.778439+0000 mgr.a (mgr.14373) 19482 : audit [DBG] from='client.417069 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:07:47.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:07:46 smithi157 bash[24585]: cluster 2024-09-16T13:07:45.158108+0000 mgr.a (mgr.14373) 19483 : cluster [DBG] pgmap v13513: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:07:47.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:07:46 smithi086 bash[24289]: cluster 2024-09-16T13:07:45.158108+0000 mgr.a (mgr.14373) 19483 : cluster [DBG] pgmap v13513: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:07:47.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:07:46 smithi047 bash[22744]: cluster 2024-09-16T13:07:45.158108+0000 mgr.a (mgr.14373) 19483 : cluster [DBG] pgmap v13513: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:07:49.058 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:07:48 smithi157 bash[24585]: cluster 2024-09-16T13:07:47.160331+0000 mgr.a (mgr.14373) 19484 : cluster [DBG] pgmap v13514: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T13:07:49.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:07:48 smithi086 bash[24289]: cluster 2024-09-16T13:07:47.160331+0000 mgr.a (mgr.14373) 19484 : cluster [DBG] pgmap v13514: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T13:07:49.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:07:48 smithi047 bash[22744]: cluster 2024-09-16T13:07:47.160331+0000 mgr.a (mgr.14373) 19484 : cluster [DBG] pgmap v13514: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T13:07:49.218 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T13:07:49.218 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T13:07:49.218 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T13:07:49.974 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T13:07:49.975 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T13:07:49.975 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T13:07:49.975 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T13:07:49.975 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T13:07:51.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:07:50 smithi157 bash[24585]: cluster 2024-09-16T13:07:49.161117+0000 mgr.a (mgr.14373) 19485 : cluster [DBG] pgmap v13515: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:07:51.058 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:07:50 smithi157 bash[24585]: audit 2024-09-16T13:07:49.545772+0000 mgr.a (mgr.14373) 19486 : audit [DBG] from='client.417144 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:07:51.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:07:50 smithi086 bash[24289]: cluster 2024-09-16T13:07:49.161117+0000 mgr.a (mgr.14373) 19485 : cluster [DBG] pgmap v13515: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:07:51.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:07:50 smithi086 bash[24289]: audit 2024-09-16T13:07:49.545772+0000 mgr.a (mgr.14373) 19486 : audit [DBG] from='client.417144 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:07:51.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:07:50 smithi047 bash[22744]: cluster 2024-09-16T13:07:49.161117+0000 mgr.a (mgr.14373) 19485 : cluster [DBG] pgmap v13515: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:07:51.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:07:50 smithi047 bash[22744]: audit 2024-09-16T13:07:49.545772+0000 mgr.a (mgr.14373) 19486 : audit [DBG] from='client.417144 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:07:53.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:07:52 smithi157 bash[24585]: cluster 2024-09-16T13:07:51.162032+0000 mgr.a (mgr.14373) 19487 : cluster [DBG] pgmap v13516: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:07:53.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:07:52 smithi086 bash[24289]: cluster 2024-09-16T13:07:51.162032+0000 mgr.a (mgr.14373) 19487 : cluster [DBG] pgmap v13516: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:07:53.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:07:52 smithi047 bash[22744]: cluster 2024-09-16T13:07:51.162032+0000 mgr.a (mgr.14373) 19487 : cluster [DBG] pgmap v13516: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:07:54.976 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T13:07:54.977 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T13:07:54.977 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T13:07:55.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:07:54 smithi157 bash[24585]: cluster 2024-09-16T13:07:53.164316+0000 mgr.a (mgr.14373) 19488 : cluster [DBG] pgmap v13517: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T13:07:55.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:07:54 smithi086 bash[24289]: cluster 2024-09-16T13:07:53.164316+0000 mgr.a (mgr.14373) 19488 : cluster [DBG] pgmap v13517: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T13:07:55.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:07:54 smithi047 bash[22744]: cluster 2024-09-16T13:07:53.164316+0000 mgr.a (mgr.14373) 19488 : cluster [DBG] pgmap v13517: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T13:07:55.772 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T13:07:55.773 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T13:07:55.773 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T13:07:55.773 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T13:07:55.773 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T13:07:57.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:07:56 smithi157 bash[24585]: cluster 2024-09-16T13:07:55.165058+0000 mgr.a (mgr.14373) 19489 : cluster [DBG] pgmap v13518: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:07:57.058 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:07:56 smithi157 bash[24585]: audit 2024-09-16T13:07:55.322398+0000 mgr.a (mgr.14373) 19490 : audit [DBG] from='client.417222 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:07:57.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:07:56 smithi086 bash[24289]: cluster 2024-09-16T13:07:55.165058+0000 mgr.a (mgr.14373) 19489 : cluster [DBG] pgmap v13518: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:07:57.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:07:56 smithi086 bash[24289]: audit 2024-09-16T13:07:55.322398+0000 mgr.a (mgr.14373) 19490 : audit [DBG] from='client.417222 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:07:57.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:07:56 smithi047 bash[22744]: cluster 2024-09-16T13:07:55.165058+0000 mgr.a (mgr.14373) 19489 : cluster [DBG] pgmap v13518: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:07:57.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:07:56 smithi047 bash[22744]: audit 2024-09-16T13:07:55.322398+0000 mgr.a (mgr.14373) 19490 : audit [DBG] from='client.417222 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:07:59.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:07:58 smithi157 bash[24585]: cluster 2024-09-16T13:07:57.167390+0000 mgr.a (mgr.14373) 19491 : cluster [DBG] pgmap v13519: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T13:07:59.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:07:58 smithi086 bash[24289]: cluster 2024-09-16T13:07:57.167390+0000 mgr.a (mgr.14373) 19491 : cluster [DBG] pgmap v13519: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T13:07:59.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:07:58 smithi047 bash[22744]: cluster 2024-09-16T13:07:57.167390+0000 mgr.a (mgr.14373) 19491 : cluster [DBG] pgmap v13519: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T13:08:00.774 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T13:08:00.774 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T13:08:00.775 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T13:08:01.058 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:08:00 smithi157 bash[24585]: cluster 2024-09-16T13:07:59.168175+0000 mgr.a (mgr.14373) 19492 : cluster [DBG] pgmap v13520: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:08:01.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:08:00 smithi086 bash[24289]: cluster 2024-09-16T13:07:59.168175+0000 mgr.a (mgr.14373) 19492 : cluster [DBG] pgmap v13520: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:08:01.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:08:00 smithi047 bash[22744]: cluster 2024-09-16T13:07:59.168175+0000 mgr.a (mgr.14373) 19492 : cluster [DBG] pgmap v13520: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:08:01.565 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T13:08:01.565 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T13:08:01.565 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T13:08:01.566 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T13:08:01.566 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T13:08:03.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:08:02 smithi157 bash[24585]: audit 2024-09-16T13:08:01.111141+0000 mgr.a (mgr.14373) 19493 : audit [DBG] from='client.417297 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:08:03.058 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:08:02 smithi157 bash[24585]: cluster 2024-09-16T13:08:01.169126+0000 mgr.a (mgr.14373) 19494 : cluster [DBG] pgmap v13521: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:08:03.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:08:02 smithi086 bash[24289]: audit 2024-09-16T13:08:01.111141+0000 mgr.a (mgr.14373) 19493 : audit [DBG] from='client.417297 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:08:03.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:08:02 smithi086 bash[24289]: cluster 2024-09-16T13:08:01.169126+0000 mgr.a (mgr.14373) 19494 : cluster [DBG] pgmap v13521: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:08:03.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:08:02 smithi047 bash[22744]: audit 2024-09-16T13:08:01.111141+0000 mgr.a (mgr.14373) 19493 : audit [DBG] from='client.417297 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:08:03.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:08:02 smithi047 bash[22744]: cluster 2024-09-16T13:08:01.169126+0000 mgr.a (mgr.14373) 19494 : cluster [DBG] pgmap v13521: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:08:05.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:08:04 smithi157 bash[24585]: cluster 2024-09-16T13:08:03.171873+0000 mgr.a (mgr.14373) 19495 : cluster [DBG] pgmap v13522: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-16T13:08:05.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:08:04 smithi086 bash[24289]: cluster 2024-09-16T13:08:03.171873+0000 mgr.a (mgr.14373) 19495 : cluster [DBG] pgmap v13522: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-16T13:08:05.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:08:04 smithi047 bash[22744]: cluster 2024-09-16T13:08:03.171873+0000 mgr.a (mgr.14373) 19495 : cluster [DBG] pgmap v13522: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-16T13:08:06.567 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T13:08:06.567 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T13:08:06.567 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T13:08:07.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:08:06 smithi157 bash[24585]: cluster 2024-09-16T13:08:05.172667+0000 mgr.a (mgr.14373) 19496 : cluster [DBG] pgmap v13523: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T13:08:07.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:08:06 smithi086 bash[24289]: cluster 2024-09-16T13:08:05.172667+0000 mgr.a (mgr.14373) 19496 : cluster [DBG] pgmap v13523: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T13:08:07.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:08:06 smithi047 bash[22744]: cluster 2024-09-16T13:08:05.172667+0000 mgr.a (mgr.14373) 19496 : cluster [DBG] pgmap v13523: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T13:08:07.350 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T13:08:07.350 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T13:08:07.350 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T13:08:07.350 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T13:08:07.351 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T13:08:09.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:08:08 smithi157 bash[24585]: audit 2024-09-16T13:08:06.908615+0000 mgr.a (mgr.14373) 19497 : audit [DBG] from='client.417372 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:08:09.058 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:08:08 smithi157 bash[24585]: cluster 2024-09-16T13:08:07.174052+0000 mgr.a (mgr.14373) 19498 : cluster [DBG] pgmap v13524: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:08:09.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:08:08 smithi086 bash[24289]: audit 2024-09-16T13:08:06.908615+0000 mgr.a (mgr.14373) 19497 : audit [DBG] from='client.417372 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:08:09.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:08:08 smithi086 bash[24289]: cluster 2024-09-16T13:08:07.174052+0000 mgr.a (mgr.14373) 19498 : cluster [DBG] pgmap v13524: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:08:09.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:08:08 smithi047 bash[22744]: audit 2024-09-16T13:08:06.908615+0000 mgr.a (mgr.14373) 19497 : audit [DBG] from='client.417372 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:08:09.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:08:08 smithi047 bash[22744]: cluster 2024-09-16T13:08:07.174052+0000 mgr.a (mgr.14373) 19498 : cluster [DBG] pgmap v13524: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:08:11.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:08:10 smithi157 bash[24585]: cluster 2024-09-16T13:08:09.174988+0000 mgr.a (mgr.14373) 19499 : cluster [DBG] pgmap v13525: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T13:08:11.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:08:10 smithi086 bash[24289]: cluster 2024-09-16T13:08:09.174988+0000 mgr.a (mgr.14373) 19499 : cluster [DBG] pgmap v13525: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T13:08:11.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:08:10 smithi047 bash[22744]: cluster 2024-09-16T13:08:09.174988+0000 mgr.a (mgr.14373) 19499 : cluster [DBG] pgmap v13525: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T13:08:12.352 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T13:08:12.352 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T13:08:12.352 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T13:08:13.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:08:12 smithi157 bash[24585]: cluster 2024-09-16T13:08:11.175931+0000 mgr.a (mgr.14373) 19500 : cluster [DBG] pgmap v13526: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T13:08:13.070 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:08:12 smithi086 bash[24289]: cluster 2024-09-16T13:08:11.175931+0000 mgr.a (mgr.14373) 19500 : cluster [DBG] pgmap v13526: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T13:08:13.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:08:12 smithi047 bash[22744]: cluster 2024-09-16T13:08:11.175931+0000 mgr.a (mgr.14373) 19500 : cluster [DBG] pgmap v13526: 225 pgs: 225 active+clean; 589 KiB data, 278 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T13:08:13.098 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T13:08:13.099 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T13:08:13.099 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T13:08:13.099 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T13:08:13.099 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T13:08:14.058 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:08:13 smithi157 bash[24585]: audit 2024-09-16T13:08:12.682382+0000 mgr.a (mgr.14373) 19501 : audit [DBG] from='client.417450 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:08:14.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:08:13 smithi086 bash[24289]: audit 2024-09-16T13:08:12.682382+0000 mgr.a (mgr.14373) 19501 : audit [DBG] from='client.417450 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:08:14.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:08:13 smithi047 bash[22744]: audit 2024-09-16T13:08:12.682382+0000 mgr.a (mgr.14373) 19501 : audit [DBG] from='client.417450 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:08:15.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:08:14 smithi157 bash[24585]: cluster 2024-09-16T13:08:13.178698+0000 mgr.a (mgr.14373) 19502 : cluster [DBG] pgmap v13527: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 8.1 KiB/s rd, 0 B/s wr, 12 op/s 2024-09-16T13:08:15.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:08:14 smithi086 bash[24289]: cluster 2024-09-16T13:08:13.178698+0000 mgr.a (mgr.14373) 19502 : cluster [DBG] pgmap v13527: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 8.1 KiB/s rd, 0 B/s wr, 12 op/s 2024-09-16T13:08:15.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:08:14 smithi047 bash[22744]: cluster 2024-09-16T13:08:13.178698+0000 mgr.a (mgr.14373) 19502 : cluster [DBG] pgmap v13527: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 8.1 KiB/s rd, 0 B/s wr, 12 op/s 2024-09-16T13:08:17.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:08:16 smithi157 bash[24585]: cluster 2024-09-16T13:08:15.179468+0000 mgr.a (mgr.14373) 19503 : cluster [DBG] pgmap v13528: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.8 KiB/s rd, 0 B/s wr, 11 op/s 2024-09-16T13:08:17.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:08:16 smithi086 bash[24289]: cluster 2024-09-16T13:08:15.179468+0000 mgr.a (mgr.14373) 19503 : cluster [DBG] pgmap v13528: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.8 KiB/s rd, 0 B/s wr, 11 op/s 2024-09-16T13:08:17.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:08:16 smithi047 bash[22744]: cluster 2024-09-16T13:08:15.179468+0000 mgr.a (mgr.14373) 19503 : cluster [DBG] pgmap v13528: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.8 KiB/s rd, 0 B/s wr, 11 op/s 2024-09-16T13:08:18.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:08:17 smithi157 bash[24585]: audit 2024-09-16T13:08:17.575064+0000 mon.b (mon.2) 1762 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T13:08:18.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:08:17 smithi086 bash[24289]: audit 2024-09-16T13:08:17.575064+0000 mon.b (mon.2) 1762 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T13:08:18.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:08:17 smithi047 bash[22744]: audit 2024-09-16T13:08:17.575064+0000 mon.b (mon.2) 1762 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T13:08:18.100 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T13:08:18.101 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T13:08:18.101 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T13:08:18.834 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T13:08:18.834 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T13:08:18.834 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T13:08:18.834 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T13:08:18.835 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T13:08:19.058 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:08:18 smithi157 bash[24585]: cluster 2024-09-16T13:08:17.181527+0000 mgr.a (mgr.14373) 19504 : cluster [DBG] pgmap v13529: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 8.7 KiB/s rd, 0 B/s wr, 12 op/s 2024-09-16T13:08:19.058 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:08:18 smithi157 bash[24585]: audit 2024-09-16T13:08:18.405153+0000 mon.b (mon.2) 1763 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T13:08:19.058 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:08:18 smithi157 bash[24585]: audit 2024-09-16T13:08:18.407268+0000 mon.b (mon.2) 1764 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T13:08:19.058 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:08:18 smithi157 bash[24585]: audit 2024-09-16T13:08:18.418332+0000 mon.a (mon.0) 1729 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T13:08:19.058 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:08:18 smithi157 bash[24585]: audit 2024-09-16T13:08:18.436504+0000 mon.b (mon.2) 1765 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T13:08:19.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:08:18 smithi086 bash[24289]: cluster 2024-09-16T13:08:17.181527+0000 mgr.a (mgr.14373) 19504 : cluster [DBG] pgmap v13529: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 8.7 KiB/s rd, 0 B/s wr, 12 op/s 2024-09-16T13:08:19.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:08:18 smithi086 bash[24289]: audit 2024-09-16T13:08:18.405153+0000 mon.b (mon.2) 1763 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T13:08:19.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:08:18 smithi086 bash[24289]: audit 2024-09-16T13:08:18.407268+0000 mon.b (mon.2) 1764 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T13:08:19.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:08:18 smithi086 bash[24289]: audit 2024-09-16T13:08:18.418332+0000 mon.a (mon.0) 1729 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T13:08:19.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:08:18 smithi086 bash[24289]: audit 2024-09-16T13:08:18.436504+0000 mon.b (mon.2) 1765 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T13:08:19.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:08:18 smithi047 bash[22744]: cluster 2024-09-16T13:08:17.181527+0000 mgr.a (mgr.14373) 19504 : cluster [DBG] pgmap v13529: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 8.7 KiB/s rd, 0 B/s wr, 12 op/s 2024-09-16T13:08:19.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:08:18 smithi047 bash[22744]: audit 2024-09-16T13:08:18.405153+0000 mon.b (mon.2) 1763 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T13:08:19.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:08:18 smithi047 bash[22744]: audit 2024-09-16T13:08:18.407268+0000 mon.b (mon.2) 1764 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T13:08:19.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:08:18 smithi047 bash[22744]: audit 2024-09-16T13:08:18.418332+0000 mon.a (mon.0) 1729 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T13:08:19.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:08:18 smithi047 bash[22744]: audit 2024-09-16T13:08:18.436504+0000 mon.b (mon.2) 1765 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T13:08:19.843 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 13:08:19 smithi047 bash[22994]: debug 2024-09-16T13:08:19.540+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T13:08:19.843 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 13:08:19 smithi047 bash[22994]: debug 2024-09-16T13:08:19.544+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T13:08:19.844 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:08:19 smithi047 bash[22744]: audit 2024-09-16T13:08:18.415927+0000 mgr.a (mgr.14373) 19505 : audit [DBG] from='client.417525 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:08:19.844 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:08:19 smithi047 bash[22744]: audit 2024-09-16T13:08:18.438449+0000 mgr.a (mgr.14373) 19506 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T13:08:20.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:08:19 smithi157 bash[24585]: audit 2024-09-16T13:08:18.415927+0000 mgr.a (mgr.14373) 19505 : audit [DBG] from='client.417525 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:08:20.058 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:08:19 smithi157 bash[24585]: audit 2024-09-16T13:08:18.438449+0000 mgr.a (mgr.14373) 19506 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T13:08:20.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:08:19 smithi086 bash[24289]: audit 2024-09-16T13:08:18.415927+0000 mgr.a (mgr.14373) 19505 : audit [DBG] from='client.417525 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:08:20.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:08:19 smithi086 bash[24289]: audit 2024-09-16T13:08:18.438449+0000 mgr.a (mgr.14373) 19506 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T13:08:21.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:08:20 smithi157 bash[24585]: cluster 2024-09-16T13:08:19.182057+0000 mgr.a (mgr.14373) 19507 : cluster [DBG] pgmap v13530: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 8.1 KiB/s rd, 0 B/s wr, 12 op/s 2024-09-16T13:08:21.058 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:08:20 smithi157 bash[24585]: audit 2024-09-16T13:08:19.545357+0000 mgr.a (mgr.14373) 19508 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T13:08:21.058 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:08:20 smithi157 bash[24585]: cephadm 2024-09-16T13:08:19.548077+0000 mgr.a (mgr.14373) 19509 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T13:08:21.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:08:20 smithi086 bash[24289]: cluster 2024-09-16T13:08:19.182057+0000 mgr.a (mgr.14373) 19507 : cluster [DBG] pgmap v13530: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 8.1 KiB/s rd, 0 B/s wr, 12 op/s 2024-09-16T13:08:21.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:08:20 smithi086 bash[24289]: audit 2024-09-16T13:08:19.545357+0000 mgr.a (mgr.14373) 19508 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T13:08:21.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:08:20 smithi086 bash[24289]: cephadm 2024-09-16T13:08:19.548077+0000 mgr.a (mgr.14373) 19509 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T13:08:21.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:08:20 smithi047 bash[22744]: cluster 2024-09-16T13:08:19.182057+0000 mgr.a (mgr.14373) 19507 : cluster [DBG] pgmap v13530: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 8.1 KiB/s rd, 0 B/s wr, 12 op/s 2024-09-16T13:08:21.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:08:20 smithi047 bash[22744]: audit 2024-09-16T13:08:19.545357+0000 mgr.a (mgr.14373) 19508 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T13:08:21.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:08:20 smithi047 bash[22744]: cephadm 2024-09-16T13:08:19.548077+0000 mgr.a (mgr.14373) 19509 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T13:08:22.058 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:08:21 smithi157 bash[24585]: cluster 2024-09-16T13:08:21.182956+0000 mgr.a (mgr.14373) 19510 : cluster [DBG] pgmap v13531: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 8.1 KiB/s rd, 0 B/s wr, 12 op/s 2024-09-16T13:08:22.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:08:21 smithi086 bash[24289]: cluster 2024-09-16T13:08:21.182956+0000 mgr.a (mgr.14373) 19510 : cluster [DBG] pgmap v13531: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 8.1 KiB/s rd, 0 B/s wr, 12 op/s 2024-09-16T13:08:22.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:08:21 smithi047 bash[22744]: cluster 2024-09-16T13:08:21.182956+0000 mgr.a (mgr.14373) 19510 : cluster [DBG] pgmap v13531: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 8.1 KiB/s rd, 0 B/s wr, 12 op/s 2024-09-16T13:08:23.835 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T13:08:23.836 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T13:08:23.837 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T13:08:24.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:08:24 smithi157 bash[24585]: cluster 2024-09-16T13:08:23.185206+0000 mgr.a (mgr.14373) 19511 : cluster [DBG] pgmap v13532: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 14 KiB/s rd, 426 B/s wr, 18 op/s 2024-09-16T13:08:24.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:08:24 smithi086 bash[24289]: cluster 2024-09-16T13:08:23.185206+0000 mgr.a (mgr.14373) 19511 : cluster [DBG] pgmap v13532: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 14 KiB/s rd, 426 B/s wr, 18 op/s 2024-09-16T13:08:24.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:08:24 smithi047 bash[22744]: cluster 2024-09-16T13:08:23.185206+0000 mgr.a (mgr.14373) 19511 : cluster [DBG] pgmap v13532: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 14 KiB/s rd, 426 B/s wr, 18 op/s 2024-09-16T13:08:24.597 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T13:08:24.597 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T13:08:24.597 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T13:08:24.597 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T13:08:24.597 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T13:08:25.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:08:25 smithi157 bash[24585]: audit 2024-09-16T13:08:24.168749+0000 mgr.a (mgr.14373) 19512 : audit [DBG] from='client.417708 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:08:25.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:08:25 smithi086 bash[24289]: audit 2024-09-16T13:08:24.168749+0000 mgr.a (mgr.14373) 19512 : audit [DBG] from='client.417708 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:08:25.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:08:25 smithi047 bash[22744]: audit 2024-09-16T13:08:24.168749+0000 mgr.a (mgr.14373) 19512 : audit [DBG] from='client.417708 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:08:26.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:08:26 smithi157 bash[24585]: cluster 2024-09-16T13:08:25.186137+0000 mgr.a (mgr.14373) 19513 : cluster [DBG] pgmap v13533: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T13:08:26.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:08:26 smithi086 bash[24289]: cluster 2024-09-16T13:08:25.186137+0000 mgr.a (mgr.14373) 19513 : cluster [DBG] pgmap v13533: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T13:08:26.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:08:26 smithi047 bash[22744]: cluster 2024-09-16T13:08:25.186137+0000 mgr.a (mgr.14373) 19513 : cluster [DBG] pgmap v13533: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T13:08:28.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:08:28 smithi157 bash[24585]: cluster 2024-09-16T13:08:27.188346+0000 mgr.a (mgr.14373) 19514 : cluster [DBG] pgmap v13534: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T13:08:28.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:08:28 smithi086 bash[24289]: cluster 2024-09-16T13:08:27.188346+0000 mgr.a (mgr.14373) 19514 : cluster [DBG] pgmap v13534: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T13:08:28.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:08:28 smithi047 bash[22744]: cluster 2024-09-16T13:08:27.188346+0000 mgr.a (mgr.14373) 19514 : cluster [DBG] pgmap v13534: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T13:08:29.598 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T13:08:29.599 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T13:08:29.599 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T13:08:30.360 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T13:08:30.360 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T13:08:30.360 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T13:08:30.360 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T13:08:30.360 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T13:08:30.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:08:30 smithi157 bash[24585]: cluster 2024-09-16T13:08:29.189108+0000 mgr.a (mgr.14373) 19515 : cluster [DBG] pgmap v13535: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T13:08:30.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:08:30 smithi086 bash[24289]: cluster 2024-09-16T13:08:29.189108+0000 mgr.a (mgr.14373) 19515 : cluster [DBG] pgmap v13535: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T13:08:30.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:08:30 smithi047 bash[22744]: cluster 2024-09-16T13:08:29.189108+0000 mgr.a (mgr.14373) 19515 : cluster [DBG] pgmap v13535: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T13:08:31.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:08:31 smithi157 bash[24585]: audit 2024-09-16T13:08:29.931863+0000 mgr.a (mgr.14373) 19516 : audit [DBG] from='client.417783 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:08:31.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:08:31 smithi086 bash[24289]: audit 2024-09-16T13:08:29.931863+0000 mgr.a (mgr.14373) 19516 : audit [DBG] from='client.417783 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:08:31.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:08:31 smithi047 bash[22744]: audit 2024-09-16T13:08:29.931863+0000 mgr.a (mgr.14373) 19516 : audit [DBG] from='client.417783 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:08:32.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:08:32 smithi157 bash[24585]: cluster 2024-09-16T13:08:31.190027+0000 mgr.a (mgr.14373) 19517 : cluster [DBG] pgmap v13536: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T13:08:32.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:08:32 smithi086 bash[24289]: cluster 2024-09-16T13:08:31.190027+0000 mgr.a (mgr.14373) 19517 : cluster [DBG] pgmap v13536: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T13:08:32.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:08:32 smithi047 bash[22744]: cluster 2024-09-16T13:08:31.190027+0000 mgr.a (mgr.14373) 19517 : cluster [DBG] pgmap v13536: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T13:08:34.558 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:08:34 smithi157 bash[24585]: cluster 2024-09-16T13:08:33.192312+0000 mgr.a (mgr.14373) 19518 : cluster [DBG] pgmap v13537: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T13:08:34.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:08:34 smithi086 bash[24289]: cluster 2024-09-16T13:08:33.192312+0000 mgr.a (mgr.14373) 19518 : cluster [DBG] pgmap v13537: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T13:08:34.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:08:34 smithi047 bash[22744]: cluster 2024-09-16T13:08:33.192312+0000 mgr.a (mgr.14373) 19518 : cluster [DBG] pgmap v13537: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T13:08:35.362 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T13:08:35.362 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T13:08:35.362 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T13:08:36.155 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T13:08:36.156 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T13:08:36.156 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T13:08:36.156 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T13:08:36.156 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T13:08:36.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:08:36 smithi157 bash[24585]: cluster 2024-09-16T13:08:35.193062+0000 mgr.a (mgr.14373) 19519 : cluster [DBG] pgmap v13538: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:08:36.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:08:36 smithi086 bash[24289]: cluster 2024-09-16T13:08:35.193062+0000 mgr.a (mgr.14373) 19519 : cluster [DBG] pgmap v13538: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:08:36.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:08:36 smithi047 bash[22744]: cluster 2024-09-16T13:08:35.193062+0000 mgr.a (mgr.14373) 19519 : cluster [DBG] pgmap v13538: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:08:37.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:08:37 smithi157 bash[24585]: audit 2024-09-16T13:08:35.701325+0000 mgr.a (mgr.14373) 19520 : audit [DBG] from='client.417858 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:08:37.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:08:37 smithi086 bash[24289]: audit 2024-09-16T13:08:35.701325+0000 mgr.a (mgr.14373) 19520 : audit [DBG] from='client.417858 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:08:37.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:08:37 smithi047 bash[22744]: audit 2024-09-16T13:08:35.701325+0000 mgr.a (mgr.14373) 19520 : audit [DBG] from='client.417858 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:08:38.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:08:38 smithi157 bash[24585]: cluster 2024-09-16T13:08:37.195519+0000 mgr.a (mgr.14373) 19521 : cluster [DBG] pgmap v13539: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T13:08:38.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:08:38 smithi086 bash[24289]: cluster 2024-09-16T13:08:37.195519+0000 mgr.a (mgr.14373) 19521 : cluster [DBG] pgmap v13539: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T13:08:38.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:08:38 smithi047 bash[22744]: cluster 2024-09-16T13:08:37.195519+0000 mgr.a (mgr.14373) 19521 : cluster [DBG] pgmap v13539: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T13:08:40.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:08:40 smithi157 bash[24585]: cluster 2024-09-16T13:08:39.196469+0000 mgr.a (mgr.14373) 19522 : cluster [DBG] pgmap v13540: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:08:40.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:08:40 smithi086 bash[24289]: cluster 2024-09-16T13:08:39.196469+0000 mgr.a (mgr.14373) 19522 : cluster [DBG] pgmap v13540: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:08:40.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:08:40 smithi047 bash[22744]: cluster 2024-09-16T13:08:39.196469+0000 mgr.a (mgr.14373) 19522 : cluster [DBG] pgmap v13540: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:08:41.157 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T13:08:41.158 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T13:08:41.158 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T13:08:41.961 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T13:08:41.961 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T13:08:41.961 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T13:08:41.961 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T13:08:41.961 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T13:08:42.557 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:08:42 smithi157 bash[24585]: cluster 2024-09-16T13:08:41.197265+0000 mgr.a (mgr.14373) 19523 : cluster [DBG] pgmap v13541: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:08:42.558 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:08:42 smithi157 bash[24585]: audit 2024-09-16T13:08:41.514247+0000 mgr.a (mgr.14373) 19524 : audit [DBG] from='client.417936 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:08:42.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:08:42 smithi086 bash[24289]: cluster 2024-09-16T13:08:41.197265+0000 mgr.a (mgr.14373) 19523 : cluster [DBG] pgmap v13541: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:08:42.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:08:42 smithi086 bash[24289]: audit 2024-09-16T13:08:41.514247+0000 mgr.a (mgr.14373) 19524 : audit [DBG] from='client.417936 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:08:42.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:08:42 smithi047 bash[22744]: cluster 2024-09-16T13:08:41.197265+0000 mgr.a (mgr.14373) 19523 : cluster [DBG] pgmap v13541: 225 pgs: 225 active+clean; 589 KiB data, 261 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:08:42.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:08:42 smithi047 bash[22744]: audit 2024-09-16T13:08:41.514247+0000 mgr.a (mgr.14373) 19524 : audit [DBG] from='client.417936 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:08:44.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:08:44 smithi086 bash[24289]: cluster 2024-09-16T13:08:43.200076+0000 mgr.a (mgr.14373) 19525 : cluster [DBG] pgmap v13542: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 55 KiB/s rd, 0 B/s wr, 90 op/s 2024-09-16T13:08:44.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:08:44 smithi047 bash[22744]: cluster 2024-09-16T13:08:43.200076+0000 mgr.a (mgr.14373) 19525 : cluster [DBG] pgmap v13542: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 55 KiB/s rd, 0 B/s wr, 90 op/s 2024-09-16T13:08:44.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:08:44 smithi157 bash[24585]: cluster 2024-09-16T13:08:43.200076+0000 mgr.a (mgr.14373) 19525 : cluster [DBG] pgmap v13542: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 55 KiB/s rd, 0 B/s wr, 90 op/s 2024-09-16T13:08:46.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:08:46 smithi086 bash[24289]: cluster 2024-09-16T13:08:45.200838+0000 mgr.a (mgr.14373) 19526 : cluster [DBG] pgmap v13543: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 54 KiB/s rd, 0 B/s wr, 89 op/s 2024-09-16T13:08:46.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:08:46 smithi047 bash[22744]: cluster 2024-09-16T13:08:45.200838+0000 mgr.a (mgr.14373) 19526 : cluster [DBG] pgmap v13543: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 54 KiB/s rd, 0 B/s wr, 89 op/s 2024-09-16T13:08:46.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:08:46 smithi157 bash[24585]: cluster 2024-09-16T13:08:45.200838+0000 mgr.a (mgr.14373) 19526 : cluster [DBG] pgmap v13543: 225 pgs: 225 active+clean; 589 KiB data, 270 MiB used, 268 GiB / 268 GiB avail; 54 KiB/s rd, 0 B/s wr, 89 op/s 2024-09-16T13:08:46.962 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T13:08:46.963 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T13:08:46.963 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T13:08:47.751 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T13:08:47.751 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T13:08:47.751 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T13:08:47.751 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T13:08:47.751 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T13:08:48.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:08:48 smithi086 bash[24289]: cluster 2024-09-16T13:08:47.202840+0000 mgr.a (mgr.14373) 19527 : cluster [DBG] pgmap v13544: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 65 KiB/s rd, 0 B/s wr, 107 op/s 2024-09-16T13:08:48.571 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:08:48 smithi086 bash[24289]: audit 2024-09-16T13:08:47.300769+0000 mgr.a (mgr.14373) 19528 : audit [DBG] from='client.418011 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:08:48.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:08:48 smithi047 bash[22744]: cluster 2024-09-16T13:08:47.202840+0000 mgr.a (mgr.14373) 19527 : cluster [DBG] pgmap v13544: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 65 KiB/s rd, 0 B/s wr, 107 op/s 2024-09-16T13:08:48.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:08:48 smithi047 bash[22744]: audit 2024-09-16T13:08:47.300769+0000 mgr.a (mgr.14373) 19528 : audit [DBG] from='client.418011 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:08:48.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:08:48 smithi157 bash[24585]: cluster 2024-09-16T13:08:47.202840+0000 mgr.a (mgr.14373) 19527 : cluster [DBG] pgmap v13544: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 65 KiB/s rd, 0 B/s wr, 107 op/s 2024-09-16T13:08:48.808 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:08:48 smithi157 bash[24585]: audit 2024-09-16T13:08:47.300769+0000 mgr.a (mgr.14373) 19528 : audit [DBG] from='client.418011 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:08:50.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:08:50 smithi047 bash[22744]: cluster 2024-09-16T13:08:49.203771+0000 mgr.a (mgr.14373) 19529 : cluster [DBG] pgmap v13545: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 64 KiB/s rd, 0 B/s wr, 106 op/s 2024-09-16T13:08:50.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:08:50 smithi157 bash[24585]: cluster 2024-09-16T13:08:49.203771+0000 mgr.a (mgr.14373) 19529 : cluster [DBG] pgmap v13545: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 64 KiB/s rd, 0 B/s wr, 106 op/s 2024-09-16T13:08:50.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:08:50 smithi086 bash[24289]: cluster 2024-09-16T13:08:49.203771+0000 mgr.a (mgr.14373) 19529 : cluster [DBG] pgmap v13545: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 64 KiB/s rd, 0 B/s wr, 106 op/s 2024-09-16T13:08:52.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:08:52 smithi047 bash[22744]: cluster 2024-09-16T13:08:51.204579+0000 mgr.a (mgr.14373) 19530 : cluster [DBG] pgmap v13546: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 64 KiB/s rd, 0 B/s wr, 106 op/s 2024-09-16T13:08:52.752 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T13:08:52.753 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T13:08:52.753 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T13:08:52.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:08:52 smithi157 bash[24585]: cluster 2024-09-16T13:08:51.204579+0000 mgr.a (mgr.14373) 19530 : cluster [DBG] pgmap v13546: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 64 KiB/s rd, 0 B/s wr, 106 op/s 2024-09-16T13:08:52.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:08:52 smithi086 bash[24289]: cluster 2024-09-16T13:08:51.204579+0000 mgr.a (mgr.14373) 19530 : cluster [DBG] pgmap v13546: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 64 KiB/s rd, 0 B/s wr, 106 op/s 2024-09-16T13:08:53.518 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T13:08:53.518 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T13:08:53.519 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T13:08:53.519 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T13:08:53.519 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T13:08:54.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:08:54 smithi047 bash[22744]: audit 2024-09-16T13:08:53.082137+0000 mgr.a (mgr.14373) 19531 : audit [DBG] from='client.418083 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:08:54.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:08:54 smithi047 bash[22744]: cluster 2024-09-16T13:08:53.206138+0000 mgr.a (mgr.14373) 19532 : cluster [DBG] pgmap v13547: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 65 KiB/s rd, 0 B/s wr, 107 op/s 2024-09-16T13:08:54.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:08:54 smithi157 bash[24585]: audit 2024-09-16T13:08:53.082137+0000 mgr.a (mgr.14373) 19531 : audit [DBG] from='client.418083 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:08:54.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:08:54 smithi157 bash[24585]: cluster 2024-09-16T13:08:53.206138+0000 mgr.a (mgr.14373) 19532 : cluster [DBG] pgmap v13547: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 65 KiB/s rd, 0 B/s wr, 107 op/s 2024-09-16T13:08:54.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:08:54 smithi086 bash[24289]: audit 2024-09-16T13:08:53.082137+0000 mgr.a (mgr.14373) 19531 : audit [DBG] from='client.418083 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:08:54.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:08:54 smithi086 bash[24289]: cluster 2024-09-16T13:08:53.206138+0000 mgr.a (mgr.14373) 19532 : cluster [DBG] pgmap v13547: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 65 KiB/s rd, 0 B/s wr, 107 op/s 2024-09-16T13:08:56.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:08:56 smithi047 bash[22744]: cluster 2024-09-16T13:08:55.207030+0000 mgr.a (mgr.14373) 19533 : cluster [DBG] pgmap v13548: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 12 KiB/s rd, 0 B/s wr, 18 op/s 2024-09-16T13:08:56.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:08:56 smithi157 bash[24585]: cluster 2024-09-16T13:08:55.207030+0000 mgr.a (mgr.14373) 19533 : cluster [DBG] pgmap v13548: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 12 KiB/s rd, 0 B/s wr, 18 op/s 2024-09-16T13:08:56.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:08:56 smithi086 bash[24289]: cluster 2024-09-16T13:08:55.207030+0000 mgr.a (mgr.14373) 19533 : cluster [DBG] pgmap v13548: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 12 KiB/s rd, 0 B/s wr, 18 op/s 2024-09-16T13:08:58.520 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T13:08:58.520 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T13:08:58.521 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T13:08:58.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:08:58 smithi047 bash[22744]: cluster 2024-09-16T13:08:57.209204+0000 mgr.a (mgr.14373) 19534 : cluster [DBG] pgmap v13549: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 13 KiB/s rd, 0 B/s wr, 19 op/s 2024-09-16T13:08:58.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:08:58 smithi157 bash[24585]: cluster 2024-09-16T13:08:57.209204+0000 mgr.a (mgr.14373) 19534 : cluster [DBG] pgmap v13549: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 13 KiB/s rd, 0 B/s wr, 19 op/s 2024-09-16T13:08:58.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:08:58 smithi086 bash[24289]: cluster 2024-09-16T13:08:57.209204+0000 mgr.a (mgr.14373) 19534 : cluster [DBG] pgmap v13549: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 13 KiB/s rd, 0 B/s wr, 19 op/s 2024-09-16T13:08:59.306 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T13:08:59.307 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T13:08:59.307 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T13:08:59.307 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T13:08:59.307 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T13:09:00.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:09:00 smithi047 bash[22744]: audit 2024-09-16T13:08:58.853841+0000 mgr.a (mgr.14373) 19535 : audit [DBG] from='client.418158 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:09:00.593 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:09:00 smithi047 bash[22744]: cluster 2024-09-16T13:08:59.209771+0000 mgr.a (mgr.14373) 19536 : cluster [DBG] pgmap v13550: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:09:00.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:09:00 smithi157 bash[24585]: audit 2024-09-16T13:08:58.853841+0000 mgr.a (mgr.14373) 19535 : audit [DBG] from='client.418158 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:09:00.808 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:09:00 smithi157 bash[24585]: cluster 2024-09-16T13:08:59.209771+0000 mgr.a (mgr.14373) 19536 : cluster [DBG] pgmap v13550: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:09:00.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:09:00 smithi086 bash[24289]: audit 2024-09-16T13:08:58.853841+0000 mgr.a (mgr.14373) 19535 : audit [DBG] from='client.418158 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:09:00.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:09:00 smithi086 bash[24289]: cluster 2024-09-16T13:08:59.209771+0000 mgr.a (mgr.14373) 19536 : cluster [DBG] pgmap v13550: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:09:02.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:09:02 smithi157 bash[24585]: cluster 2024-09-16T13:09:01.210508+0000 mgr.a (mgr.14373) 19537 : cluster [DBG] pgmap v13551: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:09:02.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:09:02 smithi086 bash[24289]: cluster 2024-09-16T13:09:01.210508+0000 mgr.a (mgr.14373) 19537 : cluster [DBG] pgmap v13551: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:09:02.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:09:02 smithi047 bash[22744]: cluster 2024-09-16T13:09:01.210508+0000 mgr.a (mgr.14373) 19537 : cluster [DBG] pgmap v13551: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:09:04.308 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T13:09:04.309 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T13:09:04.309 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T13:09:04.808 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:09:04 smithi157 bash[24585]: cluster 2024-09-16T13:09:03.212713+0000 mgr.a (mgr.14373) 19538 : cluster [DBG] pgmap v13552: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T13:09:04.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:09:04 smithi086 bash[24289]: cluster 2024-09-16T13:09:03.212713+0000 mgr.a (mgr.14373) 19538 : cluster [DBG] pgmap v13552: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T13:09:04.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:09:04 smithi047 bash[22744]: cluster 2024-09-16T13:09:03.212713+0000 mgr.a (mgr.14373) 19538 : cluster [DBG] pgmap v13552: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T13:09:05.073 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T13:09:05.073 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T13:09:05.074 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T13:09:05.074 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T13:09:05.074 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T13:09:05.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:09:05 smithi157 bash[24585]: audit 2024-09-16T13:09:04.638223+0000 mgr.a (mgr.14373) 19539 : audit [DBG] from='client.418233 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:09:05.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:09:05 smithi086 bash[24289]: audit 2024-09-16T13:09:04.638223+0000 mgr.a (mgr.14373) 19539 : audit [DBG] from='client.418233 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:09:05.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:09:05 smithi047 bash[22744]: audit 2024-09-16T13:09:04.638223+0000 mgr.a (mgr.14373) 19539 : audit [DBG] from='client.418233 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:09:06.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:09:06 smithi157 bash[24585]: cluster 2024-09-16T13:09:05.213581+0000 mgr.a (mgr.14373) 19540 : cluster [DBG] pgmap v13553: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:09:06.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:09:06 smithi086 bash[24289]: cluster 2024-09-16T13:09:05.213581+0000 mgr.a (mgr.14373) 19540 : cluster [DBG] pgmap v13553: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:09:06.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:09:06 smithi047 bash[22744]: cluster 2024-09-16T13:09:05.213581+0000 mgr.a (mgr.14373) 19540 : cluster [DBG] pgmap v13553: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:09:08.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:09:08 smithi157 bash[24585]: cluster 2024-09-16T13:09:07.215763+0000 mgr.a (mgr.14373) 19541 : cluster [DBG] pgmap v13554: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T13:09:08.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:09:08 smithi086 bash[24289]: cluster 2024-09-16T13:09:07.215763+0000 mgr.a (mgr.14373) 19541 : cluster [DBG] pgmap v13554: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T13:09:08.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:09:08 smithi047 bash[22744]: cluster 2024-09-16T13:09:07.215763+0000 mgr.a (mgr.14373) 19541 : cluster [DBG] pgmap v13554: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T13:09:10.075 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T13:09:10.076 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T13:09:10.076 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T13:09:10.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:09:10 smithi157 bash[24585]: cluster 2024-09-16T13:09:09.216521+0000 mgr.a (mgr.14373) 19542 : cluster [DBG] pgmap v13555: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:09:10.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:09:10 smithi086 bash[24289]: cluster 2024-09-16T13:09:09.216521+0000 mgr.a (mgr.14373) 19542 : cluster [DBG] pgmap v13555: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:09:10.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:09:10 smithi047 bash[22744]: cluster 2024-09-16T13:09:09.216521+0000 mgr.a (mgr.14373) 19542 : cluster [DBG] pgmap v13555: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:09:10.867 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T13:09:10.867 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T13:09:10.868 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T13:09:10.868 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T13:09:10.868 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T13:09:11.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:09:11 smithi157 bash[24585]: audit 2024-09-16T13:09:10.415617+0000 mgr.a (mgr.14373) 19543 : audit [DBG] from='client.418311 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:09:11.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:09:11 smithi086 bash[24289]: audit 2024-09-16T13:09:10.415617+0000 mgr.a (mgr.14373) 19543 : audit [DBG] from='client.418311 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:09:11.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:09:11 smithi047 bash[22744]: audit 2024-09-16T13:09:10.415617+0000 mgr.a (mgr.14373) 19543 : audit [DBG] from='client.418311 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:09:12.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:09:12 smithi157 bash[24585]: cluster 2024-09-16T13:09:11.217613+0000 mgr.a (mgr.14373) 19544 : cluster [DBG] pgmap v13556: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:09:12.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:09:12 smithi086 bash[24289]: cluster 2024-09-16T13:09:11.217613+0000 mgr.a (mgr.14373) 19544 : cluster [DBG] pgmap v13556: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:09:12.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:09:12 smithi047 bash[22744]: cluster 2024-09-16T13:09:11.217613+0000 mgr.a (mgr.14373) 19544 : cluster [DBG] pgmap v13556: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:09:14.808 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:09:14 smithi157 bash[24585]: cluster 2024-09-16T13:09:13.220050+0000 mgr.a (mgr.14373) 19545 : cluster [DBG] pgmap v13557: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T13:09:14.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:09:14 smithi086 bash[24289]: cluster 2024-09-16T13:09:13.220050+0000 mgr.a (mgr.14373) 19545 : cluster [DBG] pgmap v13557: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T13:09:14.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:09:14 smithi047 bash[22744]: cluster 2024-09-16T13:09:13.220050+0000 mgr.a (mgr.14373) 19545 : cluster [DBG] pgmap v13557: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T13:09:15.869 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T13:09:15.870 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T13:09:15.870 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T13:09:16.642 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T13:09:16.642 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T13:09:16.642 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T13:09:16.642 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T13:09:16.642 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T13:09:16.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:09:16 smithi157 bash[24585]: cluster 2024-09-16T13:09:15.220963+0000 mgr.a (mgr.14373) 19546 : cluster [DBG] pgmap v13558: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:09:16.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:09:16 smithi086 bash[24289]: cluster 2024-09-16T13:09:15.220963+0000 mgr.a (mgr.14373) 19546 : cluster [DBG] pgmap v13558: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:09:16.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:09:16 smithi047 bash[22744]: cluster 2024-09-16T13:09:15.220963+0000 mgr.a (mgr.14373) 19546 : cluster [DBG] pgmap v13558: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:09:17.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:09:17 smithi157 bash[24585]: audit 2024-09-16T13:09:16.202058+0000 mgr.a (mgr.14373) 19547 : audit [DBG] from='client.418389 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:09:17.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:09:17 smithi086 bash[24289]: audit 2024-09-16T13:09:16.202058+0000 mgr.a (mgr.14373) 19547 : audit [DBG] from='client.418389 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:09:17.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:09:17 smithi047 bash[22744]: audit 2024-09-16T13:09:16.202058+0000 mgr.a (mgr.14373) 19547 : audit [DBG] from='client.418389 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:09:18.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:09:18 smithi157 bash[24585]: cluster 2024-09-16T13:09:17.223700+0000 mgr.a (mgr.14373) 19548 : cluster [DBG] pgmap v13559: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-16T13:09:18.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:09:18 smithi086 bash[24289]: cluster 2024-09-16T13:09:17.223700+0000 mgr.a (mgr.14373) 19548 : cluster [DBG] pgmap v13559: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-16T13:09:18.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:09:18 smithi047 bash[22744]: cluster 2024-09-16T13:09:17.223700+0000 mgr.a (mgr.14373) 19548 : cluster [DBG] pgmap v13559: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-16T13:09:20.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:09:20 smithi157 bash[24585]: cluster 2024-09-16T13:09:19.224478+0000 mgr.a (mgr.14373) 19549 : cluster [DBG] pgmap v13560: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-16T13:09:20.808 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:09:20 smithi157 bash[24585]: audit 2024-09-16T13:09:19.599293+0000 mon.b (mon.2) 1766 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T13:09:20.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:09:20 smithi086 bash[24289]: cluster 2024-09-16T13:09:19.224478+0000 mgr.a (mgr.14373) 19549 : cluster [DBG] pgmap v13560: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-16T13:09:20.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:09:20 smithi086 bash[24289]: audit 2024-09-16T13:09:19.599293+0000 mon.b (mon.2) 1766 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T13:09:20.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:09:20 smithi047 bash[22744]: cluster 2024-09-16T13:09:19.224478+0000 mgr.a (mgr.14373) 19549 : cluster [DBG] pgmap v13560: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-16T13:09:20.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:09:20 smithi047 bash[22744]: audit 2024-09-16T13:09:19.599293+0000 mon.b (mon.2) 1766 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T13:09:21.593 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 13:09:21 smithi047 bash[22994]: debug 2024-09-16T13:09:21.215+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T13:09:21.593 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 13:09:21 smithi047 bash[22994]: debug 2024-09-16T13:09:21.215+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T13:09:21.594 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:09:21 smithi047 bash[22744]: audit 2024-09-16T13:09:20.440603+0000 mon.b (mon.2) 1767 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T13:09:21.594 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:09:21 smithi047 bash[22744]: audit 2024-09-16T13:09:20.442837+0000 mon.b (mon.2) 1768 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T13:09:21.594 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:09:21 smithi047 bash[22744]: audit 2024-09-16T13:09:20.454282+0000 mon.a (mon.0) 1730 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T13:09:21.594 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:09:21 smithi047 bash[22744]: audit 2024-09-16T13:09:20.459538+0000 mon.b (mon.2) 1769 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T13:09:21.594 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:09:21 smithi047 bash[22744]: audit 2024-09-16T13:09:20.461051+0000 mgr.a (mgr.14373) 19550 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T13:09:21.643 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T13:09:21.644 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T13:09:21.644 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T13:09:21.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:09:21 smithi157 bash[24585]: audit 2024-09-16T13:09:20.440603+0000 mon.b (mon.2) 1767 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T13:09:21.808 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:09:21 smithi157 bash[24585]: audit 2024-09-16T13:09:20.442837+0000 mon.b (mon.2) 1768 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T13:09:21.808 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:09:21 smithi157 bash[24585]: audit 2024-09-16T13:09:20.454282+0000 mon.a (mon.0) 1730 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T13:09:21.808 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:09:21 smithi157 bash[24585]: audit 2024-09-16T13:09:20.459538+0000 mon.b (mon.2) 1769 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T13:09:21.808 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:09:21 smithi157 bash[24585]: audit 2024-09-16T13:09:20.461051+0000 mgr.a (mgr.14373) 19550 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T13:09:21.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:09:21 smithi086 bash[24289]: audit 2024-09-16T13:09:20.440603+0000 mon.b (mon.2) 1767 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T13:09:21.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:09:21 smithi086 bash[24289]: audit 2024-09-16T13:09:20.442837+0000 mon.b (mon.2) 1768 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T13:09:21.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:09:21 smithi086 bash[24289]: audit 2024-09-16T13:09:20.454282+0000 mon.a (mon.0) 1730 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T13:09:21.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:09:21 smithi086 bash[24289]: audit 2024-09-16T13:09:20.459538+0000 mon.b (mon.2) 1769 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T13:09:21.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:09:21 smithi086 bash[24289]: audit 2024-09-16T13:09:20.461051+0000 mgr.a (mgr.14373) 19550 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T13:09:22.381 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T13:09:22.381 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T13:09:22.381 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T13:09:22.381 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T13:09:22.381 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T13:09:22.808 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:09:22 smithi157 bash[24585]: audit 2024-09-16T13:09:21.220088+0000 mgr.a (mgr.14373) 19551 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T13:09:22.808 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:09:22 smithi157 bash[24585]: cephadm 2024-09-16T13:09:21.221815+0000 mgr.a (mgr.14373) 19552 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T13:09:22.808 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:09:22 smithi157 bash[24585]: cluster 2024-09-16T13:09:21.224920+0000 mgr.a (mgr.14373) 19553 : cluster [DBG] pgmap v13561: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-16T13:09:22.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:09:22 smithi086 bash[24289]: audit 2024-09-16T13:09:21.220088+0000 mgr.a (mgr.14373) 19551 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T13:09:22.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:09:22 smithi086 bash[24289]: cephadm 2024-09-16T13:09:21.221815+0000 mgr.a (mgr.14373) 19552 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T13:09:22.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:09:22 smithi086 bash[24289]: cluster 2024-09-16T13:09:21.224920+0000 mgr.a (mgr.14373) 19553 : cluster [DBG] pgmap v13561: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-16T13:09:22.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:09:22 smithi047 bash[22744]: audit 2024-09-16T13:09:21.220088+0000 mgr.a (mgr.14373) 19551 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T13:09:22.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:09:22 smithi047 bash[22744]: cephadm 2024-09-16T13:09:21.221815+0000 mgr.a (mgr.14373) 19552 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T13:09:22.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:09:22 smithi047 bash[22744]: cluster 2024-09-16T13:09:21.224920+0000 mgr.a (mgr.14373) 19553 : cluster [DBG] pgmap v13561: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-16T13:09:23.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:09:23 smithi157 bash[24585]: audit 2024-09-16T13:09:21.962352+0000 mgr.a (mgr.14373) 19554 : audit [DBG] from='client.418575 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:09:23.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:09:23 smithi086 bash[24289]: audit 2024-09-16T13:09:21.962352+0000 mgr.a (mgr.14373) 19554 : audit [DBG] from='client.418575 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:09:23.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:09:23 smithi047 bash[22744]: audit 2024-09-16T13:09:21.962352+0000 mgr.a (mgr.14373) 19554 : audit [DBG] from='client.418575 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:09:24.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:09:24 smithi157 bash[24585]: cluster 2024-09-16T13:09:23.228874+0000 mgr.a (mgr.14373) 19555 : cluster [DBG] pgmap v13562: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T13:09:24.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:09:24 smithi086 bash[24289]: cluster 2024-09-16T13:09:23.228874+0000 mgr.a (mgr.14373) 19555 : cluster [DBG] pgmap v13562: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T13:09:24.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:09:24 smithi047 bash[22744]: cluster 2024-09-16T13:09:23.228874+0000 mgr.a (mgr.14373) 19555 : cluster [DBG] pgmap v13562: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T13:09:26.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:09:26 smithi157 bash[24585]: cluster 2024-09-16T13:09:25.229803+0000 mgr.a (mgr.14373) 19556 : cluster [DBG] pgmap v13563: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T13:09:26.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:09:26 smithi086 bash[24289]: cluster 2024-09-16T13:09:25.229803+0000 mgr.a (mgr.14373) 19556 : cluster [DBG] pgmap v13563: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T13:09:26.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:09:26 smithi047 bash[22744]: cluster 2024-09-16T13:09:25.229803+0000 mgr.a (mgr.14373) 19556 : cluster [DBG] pgmap v13563: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T13:09:27.383 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T13:09:27.383 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T13:09:27.384 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T13:09:28.172 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T13:09:28.172 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T13:09:28.172 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T13:09:28.172 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T13:09:28.172 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T13:09:28.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:09:28 smithi157 bash[24585]: cluster 2024-09-16T13:09:27.231841+0000 mgr.a (mgr.14373) 19557 : cluster [DBG] pgmap v13564: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T13:09:28.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:09:28 smithi086 bash[24289]: cluster 2024-09-16T13:09:27.231841+0000 mgr.a (mgr.14373) 19557 : cluster [DBG] pgmap v13564: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T13:09:28.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:09:28 smithi047 bash[22744]: cluster 2024-09-16T13:09:27.231841+0000 mgr.a (mgr.14373) 19557 : cluster [DBG] pgmap v13564: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T13:09:29.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:09:29 smithi157 bash[24585]: audit 2024-09-16T13:09:27.716203+0000 mgr.a (mgr.14373) 19558 : audit [DBG] from='client.418653 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:09:29.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:09:29 smithi086 bash[24289]: audit 2024-09-16T13:09:27.716203+0000 mgr.a (mgr.14373) 19558 : audit [DBG] from='client.418653 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:09:29.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:09:29 smithi047 bash[22744]: audit 2024-09-16T13:09:27.716203+0000 mgr.a (mgr.14373) 19558 : audit [DBG] from='client.418653 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:09:30.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:09:30 smithi157 bash[24585]: cluster 2024-09-16T13:09:29.232796+0000 mgr.a (mgr.14373) 19559 : cluster [DBG] pgmap v13565: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 6.8 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T13:09:30.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:09:30 smithi086 bash[24289]: cluster 2024-09-16T13:09:29.232796+0000 mgr.a (mgr.14373) 19559 : cluster [DBG] pgmap v13565: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 6.8 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T13:09:30.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:09:30 smithi047 bash[22744]: cluster 2024-09-16T13:09:29.232796+0000 mgr.a (mgr.14373) 19559 : cluster [DBG] pgmap v13565: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 6.8 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T13:09:32.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:09:32 smithi157 bash[24585]: cluster 2024-09-16T13:09:31.233766+0000 mgr.a (mgr.14373) 19560 : cluster [DBG] pgmap v13566: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 6.8 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T13:09:32.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:09:32 smithi086 bash[24289]: cluster 2024-09-16T13:09:31.233766+0000 mgr.a (mgr.14373) 19560 : cluster [DBG] pgmap v13566: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 6.8 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T13:09:32.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:09:32 smithi047 bash[22744]: cluster 2024-09-16T13:09:31.233766+0000 mgr.a (mgr.14373) 19560 : cluster [DBG] pgmap v13566: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 6.8 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T13:09:33.173 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T13:09:33.174 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T13:09:33.174 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T13:09:33.944 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T13:09:33.945 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T13:09:33.945 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T13:09:33.945 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T13:09:33.945 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T13:09:34.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:09:34 smithi157 bash[24585]: cluster 2024-09-16T13:09:33.236025+0000 mgr.a (mgr.14373) 19561 : cluster [DBG] pgmap v13567: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T13:09:34.808 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:09:34 smithi157 bash[24585]: audit 2024-09-16T13:09:33.503370+0000 mgr.a (mgr.14373) 19562 : audit [DBG] from='client.418725 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:09:34.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:09:34 smithi086 bash[24289]: cluster 2024-09-16T13:09:33.236025+0000 mgr.a (mgr.14373) 19561 : cluster [DBG] pgmap v13567: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T13:09:34.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:09:34 smithi086 bash[24289]: audit 2024-09-16T13:09:33.503370+0000 mgr.a (mgr.14373) 19562 : audit [DBG] from='client.418725 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:09:34.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:09:34 smithi047 bash[22744]: cluster 2024-09-16T13:09:33.236025+0000 mgr.a (mgr.14373) 19561 : cluster [DBG] pgmap v13567: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T13:09:34.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:09:34 smithi047 bash[22744]: audit 2024-09-16T13:09:33.503370+0000 mgr.a (mgr.14373) 19562 : audit [DBG] from='client.418725 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:09:36.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:09:36 smithi157 bash[24585]: cluster 2024-09-16T13:09:35.236994+0000 mgr.a (mgr.14373) 19563 : cluster [DBG] pgmap v13568: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:09:36.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:09:36 smithi086 bash[24289]: cluster 2024-09-16T13:09:35.236994+0000 mgr.a (mgr.14373) 19563 : cluster [DBG] pgmap v13568: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:09:36.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:09:36 smithi047 bash[22744]: cluster 2024-09-16T13:09:35.236994+0000 mgr.a (mgr.14373) 19563 : cluster [DBG] pgmap v13568: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:09:38.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:09:38 smithi157 bash[24585]: cluster 2024-09-16T13:09:37.239289+0000 mgr.a (mgr.14373) 19564 : cluster [DBG] pgmap v13569: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T13:09:38.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:09:38 smithi086 bash[24289]: cluster 2024-09-16T13:09:37.239289+0000 mgr.a (mgr.14373) 19564 : cluster [DBG] pgmap v13569: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T13:09:38.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:09:38 smithi047 bash[22744]: cluster 2024-09-16T13:09:37.239289+0000 mgr.a (mgr.14373) 19564 : cluster [DBG] pgmap v13569: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T13:09:38.946 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T13:09:38.947 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T13:09:38.947 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T13:09:39.727 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T13:09:39.727 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T13:09:39.727 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T13:09:39.727 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T13:09:39.727 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T13:09:40.808 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:09:40 smithi157 bash[24585]: cluster 2024-09-16T13:09:39.240045+0000 mgr.a (mgr.14373) 19565 : cluster [DBG] pgmap v13570: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:09:40.808 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:09:40 smithi157 bash[24585]: audit 2024-09-16T13:09:39.283447+0000 mgr.a (mgr.14373) 19566 : audit [DBG] from='client.418803 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:09:40.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:09:40 smithi086 bash[24289]: cluster 2024-09-16T13:09:39.240045+0000 mgr.a (mgr.14373) 19565 : cluster [DBG] pgmap v13570: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:09:40.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:09:40 smithi086 bash[24289]: audit 2024-09-16T13:09:39.283447+0000 mgr.a (mgr.14373) 19566 : audit [DBG] from='client.418803 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:09:40.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:09:40 smithi047 bash[22744]: cluster 2024-09-16T13:09:39.240045+0000 mgr.a (mgr.14373) 19565 : cluster [DBG] pgmap v13570: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:09:40.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:09:40 smithi047 bash[22744]: audit 2024-09-16T13:09:39.283447+0000 mgr.a (mgr.14373) 19566 : audit [DBG] from='client.418803 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:09:42.808 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:09:42 smithi157 bash[24585]: cluster 2024-09-16T13:09:41.241003+0000 mgr.a (mgr.14373) 19567 : cluster [DBG] pgmap v13571: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:09:42.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:09:42 smithi086 bash[24289]: cluster 2024-09-16T13:09:41.241003+0000 mgr.a (mgr.14373) 19567 : cluster [DBG] pgmap v13571: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:09:42.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:09:42 smithi047 bash[22744]: cluster 2024-09-16T13:09:41.241003+0000 mgr.a (mgr.14373) 19567 : cluster [DBG] pgmap v13571: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:09:44.728 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T13:09:44.729 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T13:09:44.729 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T13:09:44.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:09:44 smithi157 bash[24585]: cluster 2024-09-16T13:09:43.243255+0000 mgr.a (mgr.14373) 19568 : cluster [DBG] pgmap v13572: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T13:09:44.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:09:44 smithi086 bash[24289]: cluster 2024-09-16T13:09:43.243255+0000 mgr.a (mgr.14373) 19568 : cluster [DBG] pgmap v13572: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T13:09:44.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:09:44 smithi047 bash[22744]: cluster 2024-09-16T13:09:43.243255+0000 mgr.a (mgr.14373) 19568 : cluster [DBG] pgmap v13572: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T13:09:45.476 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T13:09:45.476 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T13:09:45.476 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T13:09:45.476 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T13:09:45.476 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T13:09:46.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:09:46 smithi157 bash[24585]: audit 2024-09-16T13:09:45.049505+0000 mgr.a (mgr.14373) 19569 : audit [DBG] from='client.418881 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:09:46.808 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:09:46 smithi157 bash[24585]: cluster 2024-09-16T13:09:45.243869+0000 mgr.a (mgr.14373) 19570 : cluster [DBG] pgmap v13573: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:09:46.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:09:46 smithi086 bash[24289]: audit 2024-09-16T13:09:45.049505+0000 mgr.a (mgr.14373) 19569 : audit [DBG] from='client.418881 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:09:46.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:09:46 smithi086 bash[24289]: cluster 2024-09-16T13:09:45.243869+0000 mgr.a (mgr.14373) 19570 : cluster [DBG] pgmap v13573: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:09:46.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:09:46 smithi047 bash[22744]: audit 2024-09-16T13:09:45.049505+0000 mgr.a (mgr.14373) 19569 : audit [DBG] from='client.418881 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:09:46.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:09:46 smithi047 bash[22744]: cluster 2024-09-16T13:09:45.243869+0000 mgr.a (mgr.14373) 19570 : cluster [DBG] pgmap v13573: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:09:48.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:09:48 smithi157 bash[24585]: cluster 2024-09-16T13:09:47.246236+0000 mgr.a (mgr.14373) 19571 : cluster [DBG] pgmap v13574: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T13:09:48.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:09:48 smithi086 bash[24289]: cluster 2024-09-16T13:09:47.246236+0000 mgr.a (mgr.14373) 19571 : cluster [DBG] pgmap v13574: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T13:09:48.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:09:48 smithi047 bash[22744]: cluster 2024-09-16T13:09:47.246236+0000 mgr.a (mgr.14373) 19571 : cluster [DBG] pgmap v13574: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T13:09:50.477 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T13:09:50.478 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T13:09:50.478 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T13:09:50.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:09:50 smithi157 bash[24585]: cluster 2024-09-16T13:09:49.247016+0000 mgr.a (mgr.14373) 19572 : cluster [DBG] pgmap v13575: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:09:50.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:09:50 smithi086 bash[24289]: cluster 2024-09-16T13:09:49.247016+0000 mgr.a (mgr.14373) 19572 : cluster [DBG] pgmap v13575: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:09:50.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:09:50 smithi047 bash[22744]: cluster 2024-09-16T13:09:49.247016+0000 mgr.a (mgr.14373) 19572 : cluster [DBG] pgmap v13575: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:09:51.235 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T13:09:51.235 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T13:09:51.236 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T13:09:51.236 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T13:09:51.236 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T13:09:52.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:09:52 smithi157 bash[24585]: audit 2024-09-16T13:09:50.805166+0000 mgr.a (mgr.14373) 19573 : audit [DBG] from='client.418959 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:09:52.808 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:09:52 smithi157 bash[24585]: cluster 2024-09-16T13:09:51.247731+0000 mgr.a (mgr.14373) 19574 : cluster [DBG] pgmap v13576: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:09:52.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:09:52 smithi086 bash[24289]: audit 2024-09-16T13:09:50.805166+0000 mgr.a (mgr.14373) 19573 : audit [DBG] from='client.418959 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:09:52.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:09:52 smithi086 bash[24289]: cluster 2024-09-16T13:09:51.247731+0000 mgr.a (mgr.14373) 19574 : cluster [DBG] pgmap v13576: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:09:52.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:09:52 smithi047 bash[22744]: audit 2024-09-16T13:09:50.805166+0000 mgr.a (mgr.14373) 19573 : audit [DBG] from='client.418959 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:09:52.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:09:52 smithi047 bash[22744]: cluster 2024-09-16T13:09:51.247731+0000 mgr.a (mgr.14373) 19574 : cluster [DBG] pgmap v13576: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:09:54.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:09:54 smithi157 bash[24585]: cluster 2024-09-16T13:09:53.249974+0000 mgr.a (mgr.14373) 19575 : cluster [DBG] pgmap v13577: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T13:09:54.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:09:54 smithi086 bash[24289]: cluster 2024-09-16T13:09:53.249974+0000 mgr.a (mgr.14373) 19575 : cluster [DBG] pgmap v13577: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T13:09:54.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:09:54 smithi047 bash[22744]: cluster 2024-09-16T13:09:53.249974+0000 mgr.a (mgr.14373) 19575 : cluster [DBG] pgmap v13577: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T13:09:56.237 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T13:09:56.237 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T13:09:56.238 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T13:09:56.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:09:56 smithi157 bash[24585]: cluster 2024-09-16T13:09:55.250721+0000 mgr.a (mgr.14373) 19576 : cluster [DBG] pgmap v13578: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:09:56.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:09:56 smithi086 bash[24289]: cluster 2024-09-16T13:09:55.250721+0000 mgr.a (mgr.14373) 19576 : cluster [DBG] pgmap v13578: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:09:56.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:09:56 smithi047 bash[22744]: cluster 2024-09-16T13:09:55.250721+0000 mgr.a (mgr.14373) 19576 : cluster [DBG] pgmap v13578: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:09:57.010 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T13:09:57.010 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T13:09:57.010 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T13:09:57.010 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T13:09:57.011 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T13:09:57.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:09:57 smithi157 bash[24585]: audit 2024-09-16T13:09:56.571672+0000 mgr.a (mgr.14373) 19577 : audit [DBG] from='client.419034 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:09:57.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:09:57 smithi086 bash[24289]: audit 2024-09-16T13:09:56.571672+0000 mgr.a (mgr.14373) 19577 : audit [DBG] from='client.419034 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:09:57.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:09:57 smithi047 bash[22744]: audit 2024-09-16T13:09:56.571672+0000 mgr.a (mgr.14373) 19577 : audit [DBG] from='client.419034 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:09:58.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:09:58 smithi157 bash[24585]: cluster 2024-09-16T13:09:57.253510+0000 mgr.a (mgr.14373) 19578 : cluster [DBG] pgmap v13579: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:09:58.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:09:58 smithi086 bash[24289]: cluster 2024-09-16T13:09:57.253510+0000 mgr.a (mgr.14373) 19578 : cluster [DBG] pgmap v13579: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:09:58.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:09:58 smithi047 bash[22744]: cluster 2024-09-16T13:09:57.253510+0000 mgr.a (mgr.14373) 19578 : cluster [DBG] pgmap v13579: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:10:00.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:10:00 smithi086 bash[24289]: cluster 2024-09-16T13:09:59.254308+0000 mgr.a (mgr.14373) 19579 : cluster [DBG] pgmap v13580: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T13:10:00.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:10:00 smithi086 bash[24289]: cluster 2024-09-16T13:10:00.000134+0000 mon.a (mon.0) 1731 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-16T13:10:00.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:10:00 smithi047 bash[22744]: cluster 2024-09-16T13:09:59.254308+0000 mgr.a (mgr.14373) 19579 : cluster [DBG] pgmap v13580: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T13:10:00.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:10:00 smithi047 bash[22744]: cluster 2024-09-16T13:10:00.000134+0000 mon.a (mon.0) 1731 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-16T13:10:01.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:10:00 smithi157 bash[24585]: cluster 2024-09-16T13:09:59.254308+0000 mgr.a (mgr.14373) 19579 : cluster [DBG] pgmap v13580: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T13:10:01.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:10:00 smithi157 bash[24585]: cluster 2024-09-16T13:10:00.000134+0000 mon.a (mon.0) 1731 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-09-16T13:10:02.012 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T13:10:02.012 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T13:10:02.013 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T13:10:02.804 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T13:10:02.804 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T13:10:02.804 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T13:10:02.804 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T13:10:02.804 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T13:10:02.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:10:02 smithi086 bash[24289]: cluster 2024-09-16T13:10:01.255117+0000 mgr.a (mgr.14373) 19580 : cluster [DBG] pgmap v13581: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T13:10:02.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:10:02 smithi047 bash[22744]: cluster 2024-09-16T13:10:01.255117+0000 mgr.a (mgr.14373) 19580 : cluster [DBG] pgmap v13581: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T13:10:03.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:10:02 smithi157 bash[24585]: cluster 2024-09-16T13:10:01.255117+0000 mgr.a (mgr.14373) 19580 : cluster [DBG] pgmap v13581: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T13:10:03.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:10:03 smithi086 bash[24289]: audit 2024-09-16T13:10:02.345733+0000 mgr.a (mgr.14373) 19581 : audit [DBG] from='client.419112 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:10:03.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:10:03 smithi047 bash[22744]: audit 2024-09-16T13:10:02.345733+0000 mgr.a (mgr.14373) 19581 : audit [DBG] from='client.419112 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:10:04.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:10:03 smithi157 bash[24585]: audit 2024-09-16T13:10:02.345733+0000 mgr.a (mgr.14373) 19581 : audit [DBG] from='client.419112 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:10:04.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:10:04 smithi047 bash[22744]: cluster 2024-09-16T13:10:03.257986+0000 mgr.a (mgr.14373) 19582 : cluster [DBG] pgmap v13582: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:10:05.058 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:10:04 smithi157 bash[24585]: cluster 2024-09-16T13:10:03.257986+0000 mgr.a (mgr.14373) 19582 : cluster [DBG] pgmap v13582: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:10:05.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:10:04 smithi086 bash[24289]: cluster 2024-09-16T13:10:03.257986+0000 mgr.a (mgr.14373) 19582 : cluster [DBG] pgmap v13582: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:10:06.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:10:06 smithi047 bash[22744]: cluster 2024-09-16T13:10:05.258804+0000 mgr.a (mgr.14373) 19583 : cluster [DBG] pgmap v13583: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T13:10:07.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:10:06 smithi157 bash[24585]: cluster 2024-09-16T13:10:05.258804+0000 mgr.a (mgr.14373) 19583 : cluster [DBG] pgmap v13583: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T13:10:07.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:10:06 smithi086 bash[24289]: cluster 2024-09-16T13:10:05.258804+0000 mgr.a (mgr.14373) 19583 : cluster [DBG] pgmap v13583: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T13:10:07.806 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T13:10:07.806 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T13:10:07.806 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T13:10:08.566 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T13:10:08.567 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T13:10:08.567 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T13:10:08.567 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T13:10:08.567 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T13:10:08.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:10:08 smithi047 bash[22744]: cluster 2024-09-16T13:10:07.260779+0000 mgr.a (mgr.14373) 19584 : cluster [DBG] pgmap v13584: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:10:09.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:10:08 smithi157 bash[24585]: cluster 2024-09-16T13:10:07.260779+0000 mgr.a (mgr.14373) 19584 : cluster [DBG] pgmap v13584: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:10:09.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:10:08 smithi086 bash[24289]: cluster 2024-09-16T13:10:07.260779+0000 mgr.a (mgr.14373) 19584 : cluster [DBG] pgmap v13584: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:10:09.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:10:09 smithi047 bash[22744]: audit 2024-09-16T13:10:08.135650+0000 mgr.a (mgr.14373) 19585 : audit [DBG] from='client.419187 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:10:10.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:10:09 smithi157 bash[24585]: audit 2024-09-16T13:10:08.135650+0000 mgr.a (mgr.14373) 19585 : audit [DBG] from='client.419187 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:10:10.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:10:09 smithi086 bash[24289]: audit 2024-09-16T13:10:08.135650+0000 mgr.a (mgr.14373) 19585 : audit [DBG] from='client.419187 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:10:10.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:10:10 smithi047 bash[22744]: cluster 2024-09-16T13:10:09.261759+0000 mgr.a (mgr.14373) 19586 : cluster [DBG] pgmap v13585: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:10:11.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:10:10 smithi157 bash[24585]: cluster 2024-09-16T13:10:09.261759+0000 mgr.a (mgr.14373) 19586 : cluster [DBG] pgmap v13585: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:10:11.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:10:10 smithi086 bash[24289]: cluster 2024-09-16T13:10:09.261759+0000 mgr.a (mgr.14373) 19586 : cluster [DBG] pgmap v13585: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:10:13.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:10:12 smithi157 bash[24585]: cluster 2024-09-16T13:10:11.262579+0000 mgr.a (mgr.14373) 19587 : cluster [DBG] pgmap v13586: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:10:13.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:10:12 smithi086 bash[24289]: cluster 2024-09-16T13:10:11.262579+0000 mgr.a (mgr.14373) 19587 : cluster [DBG] pgmap v13586: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:10:13.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:10:12 smithi047 bash[22744]: cluster 2024-09-16T13:10:11.262579+0000 mgr.a (mgr.14373) 19587 : cluster [DBG] pgmap v13586: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:10:13.568 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T13:10:13.569 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T13:10:13.569 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T13:10:14.310 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T13:10:14.310 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T13:10:14.310 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T13:10:14.310 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T13:10:14.310 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T13:10:15.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:10:14 smithi157 bash[24585]: cluster 2024-09-16T13:10:13.264753+0000 mgr.a (mgr.14373) 19588 : cluster [DBG] pgmap v13587: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T13:10:15.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:10:14 smithi086 bash[24289]: cluster 2024-09-16T13:10:13.264753+0000 mgr.a (mgr.14373) 19588 : cluster [DBG] pgmap v13587: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T13:10:15.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:10:14 smithi047 bash[22744]: cluster 2024-09-16T13:10:13.264753+0000 mgr.a (mgr.14373) 19588 : cluster [DBG] pgmap v13587: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T13:10:16.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:10:15 smithi157 bash[24585]: audit 2024-09-16T13:10:13.897555+0000 mgr.a (mgr.14373) 19589 : audit [DBG] from='client.419262 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:10:16.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:10:15 smithi086 bash[24289]: audit 2024-09-16T13:10:13.897555+0000 mgr.a (mgr.14373) 19589 : audit [DBG] from='client.419262 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:10:16.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:10:15 smithi047 bash[22744]: audit 2024-09-16T13:10:13.897555+0000 mgr.a (mgr.14373) 19589 : audit [DBG] from='client.419262 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:10:17.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:10:16 smithi157 bash[24585]: cluster 2024-09-16T13:10:15.265717+0000 mgr.a (mgr.14373) 19590 : cluster [DBG] pgmap v13588: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:10:17.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:10:16 smithi086 bash[24289]: cluster 2024-09-16T13:10:15.265717+0000 mgr.a (mgr.14373) 19590 : cluster [DBG] pgmap v13588: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:10:17.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:10:16 smithi047 bash[22744]: cluster 2024-09-16T13:10:15.265717+0000 mgr.a (mgr.14373) 19590 : cluster [DBG] pgmap v13588: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:10:19.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:10:18 smithi157 bash[24585]: cluster 2024-09-16T13:10:17.267967+0000 mgr.a (mgr.14373) 19591 : cluster [DBG] pgmap v13589: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T13:10:19.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:10:18 smithi086 bash[24289]: cluster 2024-09-16T13:10:17.267967+0000 mgr.a (mgr.14373) 19591 : cluster [DBG] pgmap v13589: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T13:10:19.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:10:18 smithi047 bash[22744]: cluster 2024-09-16T13:10:17.267967+0000 mgr.a (mgr.14373) 19591 : cluster [DBG] pgmap v13589: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T13:10:19.311 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T13:10:19.312 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T13:10:19.312 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T13:10:20.082 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T13:10:20.082 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T13:10:20.082 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T13:10:20.083 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T13:10:20.083 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T13:10:21.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:10:20 smithi157 bash[24585]: cluster 2024-09-16T13:10:19.268744+0000 mgr.a (mgr.14373) 19592 : cluster [DBG] pgmap v13590: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:10:21.058 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:10:20 smithi157 bash[24585]: audit 2024-09-16T13:10:19.640361+0000 mgr.a (mgr.14373) 19593 : audit [DBG] from='client.419340 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:10:21.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:10:20 smithi086 bash[24289]: cluster 2024-09-16T13:10:19.268744+0000 mgr.a (mgr.14373) 19592 : cluster [DBG] pgmap v13590: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:10:21.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:10:20 smithi086 bash[24289]: audit 2024-09-16T13:10:19.640361+0000 mgr.a (mgr.14373) 19593 : audit [DBG] from='client.419340 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:10:21.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:10:20 smithi047 bash[22744]: cluster 2024-09-16T13:10:19.268744+0000 mgr.a (mgr.14373) 19592 : cluster [DBG] pgmap v13590: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:10:21.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:10:20 smithi047 bash[22744]: audit 2024-09-16T13:10:19.640361+0000 mgr.a (mgr.14373) 19593 : audit [DBG] from='client.419340 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:10:22.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:10:21 smithi157 bash[24585]: audit 2024-09-16T13:10:21.273732+0000 mon.b (mon.2) 1770 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T13:10:22.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:10:21 smithi086 bash[24289]: audit 2024-09-16T13:10:21.273732+0000 mon.b (mon.2) 1770 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T13:10:22.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:10:21 smithi047 bash[22744]: audit 2024-09-16T13:10:21.273732+0000 mon.b (mon.2) 1770 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T13:10:22.881 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 13:10:22 smithi047 bash[22994]: debug 2024-09-16T13:10:22.873+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T13:10:22.881 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:10:22 smithi047 bash[22744]: cluster 2024-09-16T13:10:21.269708+0000 mgr.a (mgr.14373) 19594 : cluster [DBG] pgmap v13591: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:10:22.881 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:10:22 smithi047 bash[22744]: audit 2024-09-16T13:10:22.113889+0000 mon.b (mon.2) 1771 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T13:10:22.881 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:10:22 smithi047 bash[22744]: audit 2024-09-16T13:10:22.115862+0000 mon.b (mon.2) 1772 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T13:10:22.881 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:10:22 smithi047 bash[22744]: audit 2024-09-16T13:10:22.126435+0000 mon.a (mon.0) 1732 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T13:10:22.882 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:10:22 smithi047 bash[22744]: audit 2024-09-16T13:10:22.132452+0000 mon.b (mon.2) 1773 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T13:10:23.058 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:10:22 smithi157 bash[24585]: cluster 2024-09-16T13:10:21.269708+0000 mgr.a (mgr.14373) 19594 : cluster [DBG] pgmap v13591: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:10:23.058 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:10:22 smithi157 bash[24585]: audit 2024-09-16T13:10:22.113889+0000 mon.b (mon.2) 1771 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T13:10:23.058 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:10:22 smithi157 bash[24585]: audit 2024-09-16T13:10:22.115862+0000 mon.b (mon.2) 1772 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T13:10:23.058 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:10:22 smithi157 bash[24585]: audit 2024-09-16T13:10:22.126435+0000 mon.a (mon.0) 1732 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T13:10:23.058 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:10:22 smithi157 bash[24585]: audit 2024-09-16T13:10:22.132452+0000 mon.b (mon.2) 1773 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T13:10:23.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:10:22 smithi086 bash[24289]: cluster 2024-09-16T13:10:21.269708+0000 mgr.a (mgr.14373) 19594 : cluster [DBG] pgmap v13591: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:10:23.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:10:22 smithi086 bash[24289]: audit 2024-09-16T13:10:22.113889+0000 mon.b (mon.2) 1771 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T13:10:23.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:10:22 smithi086 bash[24289]: audit 2024-09-16T13:10:22.115862+0000 mon.b (mon.2) 1772 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T13:10:23.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:10:22 smithi086 bash[24289]: audit 2024-09-16T13:10:22.126435+0000 mon.a (mon.0) 1732 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T13:10:23.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:10:22 smithi086 bash[24289]: audit 2024-09-16T13:10:22.132452+0000 mon.b (mon.2) 1773 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T13:10:24.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:10:23 smithi157 bash[24585]: audit 2024-09-16T13:10:22.134916+0000 mgr.a (mgr.14373) 19595 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T13:10:24.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:10:23 smithi086 bash[24289]: audit 2024-09-16T13:10:22.134916+0000 mgr.a (mgr.14373) 19595 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T13:10:24.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:10:23 smithi047 bash[22744]: audit 2024-09-16T13:10:22.134916+0000 mgr.a (mgr.14373) 19595 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T13:10:24.093 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 13:10:22 smithi047 bash[22994]: debug 2024-09-16T13:10:22.877+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T13:10:25.058 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:10:24 smithi157 bash[24585]: audit 2024-09-16T13:10:22.877164+0000 mgr.a (mgr.14373) 19596 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T13:10:25.058 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:10:24 smithi157 bash[24585]: cephadm 2024-09-16T13:10:22.879153+0000 mgr.a (mgr.14373) 19597 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T13:10:25.058 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:10:24 smithi157 bash[24585]: cluster 2024-09-16T13:10:23.272632+0000 mgr.a (mgr.14373) 19598 : cluster [DBG] pgmap v13592: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T13:10:25.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:10:24 smithi086 bash[24289]: audit 2024-09-16T13:10:22.877164+0000 mgr.a (mgr.14373) 19596 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T13:10:25.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:10:24 smithi086 bash[24289]: cephadm 2024-09-16T13:10:22.879153+0000 mgr.a (mgr.14373) 19597 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T13:10:25.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:10:24 smithi086 bash[24289]: cluster 2024-09-16T13:10:23.272632+0000 mgr.a (mgr.14373) 19598 : cluster [DBG] pgmap v13592: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T13:10:25.083 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T13:10:25.084 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T13:10:25.084 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T13:10:25.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:10:24 smithi047 bash[22744]: audit 2024-09-16T13:10:22.877164+0000 mgr.a (mgr.14373) 19596 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T13:10:25.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:10:24 smithi047 bash[22744]: cephadm 2024-09-16T13:10:22.879153+0000 mgr.a (mgr.14373) 19597 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T13:10:25.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:10:24 smithi047 bash[22744]: cluster 2024-09-16T13:10:23.272632+0000 mgr.a (mgr.14373) 19598 : cluster [DBG] pgmap v13592: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T13:10:25.868 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T13:10:25.869 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T13:10:25.869 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T13:10:25.869 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T13:10:25.869 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T13:10:27.058 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:10:26 smithi157 bash[24585]: cluster 2024-09-16T13:10:25.273582+0000 mgr.a (mgr.14373) 19599 : cluster [DBG] pgmap v13593: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:10:27.058 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:10:26 smithi157 bash[24585]: audit 2024-09-16T13:10:25.422587+0000 mgr.a (mgr.14373) 19600 : audit [DBG] from='client.419526 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:10:27.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:10:26 smithi086 bash[24289]: cluster 2024-09-16T13:10:25.273582+0000 mgr.a (mgr.14373) 19599 : cluster [DBG] pgmap v13593: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:10:27.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:10:26 smithi086 bash[24289]: audit 2024-09-16T13:10:25.422587+0000 mgr.a (mgr.14373) 19600 : audit [DBG] from='client.419526 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:10:27.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:10:26 smithi047 bash[22744]: cluster 2024-09-16T13:10:25.273582+0000 mgr.a (mgr.14373) 19599 : cluster [DBG] pgmap v13593: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:10:27.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:10:26 smithi047 bash[22744]: audit 2024-09-16T13:10:25.422587+0000 mgr.a (mgr.14373) 19600 : audit [DBG] from='client.419526 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:10:29.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:10:28 smithi157 bash[24585]: cluster 2024-09-16T13:10:27.275986+0000 mgr.a (mgr.14373) 19601 : cluster [DBG] pgmap v13594: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T13:10:29.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:10:28 smithi086 bash[24289]: cluster 2024-09-16T13:10:27.275986+0000 mgr.a (mgr.14373) 19601 : cluster [DBG] pgmap v13594: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T13:10:29.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:10:28 smithi047 bash[22744]: cluster 2024-09-16T13:10:27.275986+0000 mgr.a (mgr.14373) 19601 : cluster [DBG] pgmap v13594: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T13:10:30.870 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T13:10:30.871 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T13:10:30.871 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T13:10:31.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:10:30 smithi157 bash[24585]: cluster 2024-09-16T13:10:29.276763+0000 mgr.a (mgr.14373) 19602 : cluster [DBG] pgmap v13595: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T13:10:31.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:10:30 smithi086 bash[24289]: cluster 2024-09-16T13:10:29.276763+0000 mgr.a (mgr.14373) 19602 : cluster [DBG] pgmap v13595: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T13:10:31.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:10:30 smithi047 bash[22744]: cluster 2024-09-16T13:10:29.276763+0000 mgr.a (mgr.14373) 19602 : cluster [DBG] pgmap v13595: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T13:10:31.613 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T13:10:31.613 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T13:10:31.614 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T13:10:31.614 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T13:10:31.614 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T13:10:33.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:10:32 smithi157 bash[24585]: audit 2024-09-16T13:10:31.192520+0000 mgr.a (mgr.14373) 19603 : audit [DBG] from='client.419604 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:10:33.058 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:10:32 smithi157 bash[24585]: cluster 2024-09-16T13:10:31.277258+0000 mgr.a (mgr.14373) 19604 : cluster [DBG] pgmap v13596: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T13:10:33.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:10:32 smithi086 bash[24289]: audit 2024-09-16T13:10:31.192520+0000 mgr.a (mgr.14373) 19603 : audit [DBG] from='client.419604 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:10:33.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:10:32 smithi086 bash[24289]: cluster 2024-09-16T13:10:31.277258+0000 mgr.a (mgr.14373) 19604 : cluster [DBG] pgmap v13596: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T13:10:33.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:10:32 smithi047 bash[22744]: audit 2024-09-16T13:10:31.192520+0000 mgr.a (mgr.14373) 19603 : audit [DBG] from='client.419604 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:10:33.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:10:32 smithi047 bash[22744]: cluster 2024-09-16T13:10:31.277258+0000 mgr.a (mgr.14373) 19604 : cluster [DBG] pgmap v13596: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T13:10:35.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:10:34 smithi157 bash[24585]: cluster 2024-09-16T13:10:33.280015+0000 mgr.a (mgr.14373) 19605 : cluster [DBG] pgmap v13597: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T13:10:35.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:10:34 smithi086 bash[24289]: cluster 2024-09-16T13:10:33.280015+0000 mgr.a (mgr.14373) 19605 : cluster [DBG] pgmap v13597: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T13:10:35.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:10:34 smithi047 bash[22744]: cluster 2024-09-16T13:10:33.280015+0000 mgr.a (mgr.14373) 19605 : cluster [DBG] pgmap v13597: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T13:10:36.615 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T13:10:36.615 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T13:10:36.615 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T13:10:37.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:10:36 smithi157 bash[24585]: cluster 2024-09-16T13:10:35.280826+0000 mgr.a (mgr.14373) 19606 : cluster [DBG] pgmap v13598: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 6.2 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T13:10:37.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:10:36 smithi086 bash[24289]: cluster 2024-09-16T13:10:35.280826+0000 mgr.a (mgr.14373) 19606 : cluster [DBG] pgmap v13598: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 6.2 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T13:10:37.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:10:36 smithi047 bash[22744]: cluster 2024-09-16T13:10:35.280826+0000 mgr.a (mgr.14373) 19606 : cluster [DBG] pgmap v13598: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 6.2 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T13:10:37.407 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T13:10:37.407 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T13:10:37.407 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T13:10:37.407 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T13:10:37.408 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T13:10:39.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:10:38 smithi157 bash[24585]: audit 2024-09-16T13:10:36.949171+0000 mgr.a (mgr.14373) 19607 : audit [DBG] from='client.419676 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:10:39.058 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:10:38 smithi157 bash[24585]: cluster 2024-09-16T13:10:37.282199+0000 mgr.a (mgr.14373) 19608 : cluster [DBG] pgmap v13599: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T13:10:39.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:10:38 smithi086 bash[24289]: audit 2024-09-16T13:10:36.949171+0000 mgr.a (mgr.14373) 19607 : audit [DBG] from='client.419676 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:10:39.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:10:38 smithi086 bash[24289]: cluster 2024-09-16T13:10:37.282199+0000 mgr.a (mgr.14373) 19608 : cluster [DBG] pgmap v13599: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T13:10:39.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:10:38 smithi047 bash[22744]: audit 2024-09-16T13:10:36.949171+0000 mgr.a (mgr.14373) 19607 : audit [DBG] from='client.419676 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:10:39.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:10:38 smithi047 bash[22744]: cluster 2024-09-16T13:10:37.282199+0000 mgr.a (mgr.14373) 19608 : cluster [DBG] pgmap v13599: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T13:10:41.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:10:40 smithi157 bash[24585]: cluster 2024-09-16T13:10:39.283445+0000 mgr.a (mgr.14373) 19609 : cluster [DBG] pgmap v13600: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T13:10:41.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:10:40 smithi086 bash[24289]: cluster 2024-09-16T13:10:39.283445+0000 mgr.a (mgr.14373) 19609 : cluster [DBG] pgmap v13600: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T13:10:41.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:10:40 smithi047 bash[22744]: cluster 2024-09-16T13:10:39.283445+0000 mgr.a (mgr.14373) 19609 : cluster [DBG] pgmap v13600: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T13:10:42.409 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T13:10:42.409 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T13:10:42.410 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T13:10:43.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:10:42 smithi157 bash[24585]: cluster 2024-09-16T13:10:41.284211+0000 mgr.a (mgr.14373) 19610 : cluster [DBG] pgmap v13601: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T13:10:43.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:10:42 smithi086 bash[24289]: cluster 2024-09-16T13:10:41.284211+0000 mgr.a (mgr.14373) 19610 : cluster [DBG] pgmap v13601: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T13:10:43.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:10:42 smithi047 bash[22744]: cluster 2024-09-16T13:10:41.284211+0000 mgr.a (mgr.14373) 19610 : cluster [DBG] pgmap v13601: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T13:10:43.201 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T13:10:43.201 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T13:10:43.201 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T13:10:43.201 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T13:10:43.201 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T13:10:45.058 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:10:44 smithi157 bash[24585]: audit 2024-09-16T13:10:42.746710+0000 mgr.a (mgr.14373) 19611 : audit [DBG] from='client.419751 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:10:45.058 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:10:44 smithi157 bash[24585]: cluster 2024-09-16T13:10:43.286916+0000 mgr.a (mgr.14373) 19612 : cluster [DBG] pgmap v13602: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:10:45.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:10:44 smithi086 bash[24289]: audit 2024-09-16T13:10:42.746710+0000 mgr.a (mgr.14373) 19611 : audit [DBG] from='client.419751 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:10:45.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:10:44 smithi086 bash[24289]: cluster 2024-09-16T13:10:43.286916+0000 mgr.a (mgr.14373) 19612 : cluster [DBG] pgmap v13602: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:10:45.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:10:44 smithi047 bash[22744]: audit 2024-09-16T13:10:42.746710+0000 mgr.a (mgr.14373) 19611 : audit [DBG] from='client.419751 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:10:45.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:10:44 smithi047 bash[22744]: cluster 2024-09-16T13:10:43.286916+0000 mgr.a (mgr.14373) 19612 : cluster [DBG] pgmap v13602: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:10:47.058 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:10:46 smithi157 bash[24585]: cluster 2024-09-16T13:10:45.287653+0000 mgr.a (mgr.14373) 19613 : cluster [DBG] pgmap v13603: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-16T13:10:47.072 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:10:46 smithi086 bash[24289]: cluster 2024-09-16T13:10:45.287653+0000 mgr.a (mgr.14373) 19613 : cluster [DBG] pgmap v13603: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-16T13:10:47.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:10:46 smithi047 bash[22744]: cluster 2024-09-16T13:10:45.287653+0000 mgr.a (mgr.14373) 19613 : cluster [DBG] pgmap v13603: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-16T13:10:48.203 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T13:10:48.204 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T13:10:48.204 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T13:10:48.951 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T13:10:48.951 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T13:10:48.951 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T13:10:48.952 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T13:10:48.952 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T13:10:49.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:10:48 smithi157 bash[24585]: cluster 2024-09-16T13:10:47.289655+0000 mgr.a (mgr.14373) 19614 : cluster [DBG] pgmap v13604: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-09-16T13:10:49.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:10:48 smithi086 bash[24289]: cluster 2024-09-16T13:10:47.289655+0000 mgr.a (mgr.14373) 19614 : cluster [DBG] pgmap v13604: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-09-16T13:10:49.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:10:48 smithi047 bash[22744]: cluster 2024-09-16T13:10:47.289655+0000 mgr.a (mgr.14373) 19614 : cluster [DBG] pgmap v13604: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-09-16T13:10:50.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:10:49 smithi157 bash[24585]: audit 2024-09-16T13:10:48.527518+0000 mgr.a (mgr.14373) 19615 : audit [DBG] from='client.419829 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:10:50.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:10:49 smithi086 bash[24289]: audit 2024-09-16T13:10:48.527518+0000 mgr.a (mgr.14373) 19615 : audit [DBG] from='client.419829 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:10:50.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:10:49 smithi047 bash[22744]: audit 2024-09-16T13:10:48.527518+0000 mgr.a (mgr.14373) 19615 : audit [DBG] from='client.419829 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:10:51.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:10:50 smithi157 bash[24585]: cluster 2024-09-16T13:10:49.290622+0000 mgr.a (mgr.14373) 19616 : cluster [DBG] pgmap v13605: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:10:51.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:10:50 smithi086 bash[24289]: cluster 2024-09-16T13:10:49.290622+0000 mgr.a (mgr.14373) 19616 : cluster [DBG] pgmap v13605: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:10:51.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:10:50 smithi047 bash[22744]: cluster 2024-09-16T13:10:49.290622+0000 mgr.a (mgr.14373) 19616 : cluster [DBG] pgmap v13605: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:10:53.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:10:52 smithi157 bash[24585]: cluster 2024-09-16T13:10:51.291414+0000 mgr.a (mgr.14373) 19617 : cluster [DBG] pgmap v13606: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:10:53.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:10:52 smithi086 bash[24289]: cluster 2024-09-16T13:10:51.291414+0000 mgr.a (mgr.14373) 19617 : cluster [DBG] pgmap v13606: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:10:53.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:10:52 smithi047 bash[22744]: cluster 2024-09-16T13:10:51.291414+0000 mgr.a (mgr.14373) 19617 : cluster [DBG] pgmap v13606: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:10:53.953 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T13:10:53.954 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T13:10:53.954 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T13:10:54.725 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T13:10:54.725 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T13:10:54.726 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T13:10:54.726 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T13:10:54.726 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T13:10:55.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:10:54 smithi157 bash[24585]: cluster 2024-09-16T13:10:53.293711+0000 mgr.a (mgr.14373) 19618 : cluster [DBG] pgmap v13607: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T13:10:55.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:10:54 smithi086 bash[24289]: cluster 2024-09-16T13:10:53.293711+0000 mgr.a (mgr.14373) 19618 : cluster [DBG] pgmap v13607: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T13:10:55.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:10:54 smithi047 bash[22744]: cluster 2024-09-16T13:10:53.293711+0000 mgr.a (mgr.14373) 19618 : cluster [DBG] pgmap v13607: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T13:10:56.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:10:55 smithi157 bash[24585]: audit 2024-09-16T13:10:54.282714+0000 mgr.a (mgr.14373) 19619 : audit [DBG] from='client.419907 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:10:56.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:10:55 smithi086 bash[24289]: audit 2024-09-16T13:10:54.282714+0000 mgr.a (mgr.14373) 19619 : audit [DBG] from='client.419907 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:10:56.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:10:55 smithi047 bash[22744]: audit 2024-09-16T13:10:54.282714+0000 mgr.a (mgr.14373) 19619 : audit [DBG] from='client.419907 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:10:57.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:10:56 smithi157 bash[24585]: cluster 2024-09-16T13:10:55.294780+0000 mgr.a (mgr.14373) 19620 : cluster [DBG] pgmap v13608: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:10:57.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:10:56 smithi086 bash[24289]: cluster 2024-09-16T13:10:55.294780+0000 mgr.a (mgr.14373) 19620 : cluster [DBG] pgmap v13608: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:10:57.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:10:56 smithi047 bash[22744]: cluster 2024-09-16T13:10:55.294780+0000 mgr.a (mgr.14373) 19620 : cluster [DBG] pgmap v13608: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:10:59.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:10:58 smithi157 bash[24585]: cluster 2024-09-16T13:10:57.297074+0000 mgr.a (mgr.14373) 19621 : cluster [DBG] pgmap v13609: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T13:10:59.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:10:58 smithi086 bash[24289]: cluster 2024-09-16T13:10:57.297074+0000 mgr.a (mgr.14373) 19621 : cluster [DBG] pgmap v13609: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T13:10:59.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:10:58 smithi047 bash[22744]: cluster 2024-09-16T13:10:57.297074+0000 mgr.a (mgr.14373) 19621 : cluster [DBG] pgmap v13609: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T13:10:59.727 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T13:10:59.728 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T13:10:59.728 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T13:11:00.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:10:59 smithi157 bash[24585]: cluster 2024-09-16T13:10:59.297855+0000 mgr.a (mgr.14373) 19622 : cluster [DBG] pgmap v13610: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:11:00.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:10:59 smithi086 bash[24289]: cluster 2024-09-16T13:10:59.297855+0000 mgr.a (mgr.14373) 19622 : cluster [DBG] pgmap v13610: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:11:00.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:10:59 smithi047 bash[22744]: cluster 2024-09-16T13:10:59.297855+0000 mgr.a (mgr.14373) 19622 : cluster [DBG] pgmap v13610: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:11:00.504 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T13:11:00.504 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T13:11:00.504 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T13:11:00.504 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T13:11:00.505 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T13:11:01.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:11:00 smithi157 bash[24585]: audit 2024-09-16T13:11:00.060416+0000 mgr.a (mgr.14373) 19623 : audit [DBG] from='client.419982 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:11:01.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:11:00 smithi086 bash[24289]: audit 2024-09-16T13:11:00.060416+0000 mgr.a (mgr.14373) 19623 : audit [DBG] from='client.419982 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:11:01.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:11:00 smithi047 bash[22744]: audit 2024-09-16T13:11:00.060416+0000 mgr.a (mgr.14373) 19623 : audit [DBG] from='client.419982 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:11:02.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:11:01 smithi157 bash[24585]: cluster 2024-09-16T13:11:01.298831+0000 mgr.a (mgr.14373) 19624 : cluster [DBG] pgmap v13611: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:11:02.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:11:01 smithi086 bash[24289]: cluster 2024-09-16T13:11:01.298831+0000 mgr.a (mgr.14373) 19624 : cluster [DBG] pgmap v13611: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:11:02.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:11:01 smithi047 bash[22744]: cluster 2024-09-16T13:11:01.298831+0000 mgr.a (mgr.14373) 19624 : cluster [DBG] pgmap v13611: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:11:04.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:11:04 smithi157 bash[24585]: cluster 2024-09-16T13:11:03.301082+0000 mgr.a (mgr.14373) 19625 : cluster [DBG] pgmap v13612: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T13:11:04.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:11:04 smithi086 bash[24289]: cluster 2024-09-16T13:11:03.301082+0000 mgr.a (mgr.14373) 19625 : cluster [DBG] pgmap v13612: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T13:11:04.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:11:04 smithi047 bash[22744]: cluster 2024-09-16T13:11:03.301082+0000 mgr.a (mgr.14373) 19625 : cluster [DBG] pgmap v13612: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T13:11:05.506 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T13:11:05.507 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T13:11:05.507 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T13:11:06.258 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T13:11:06.259 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T13:11:06.259 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T13:11:06.259 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T13:11:06.259 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T13:11:06.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:11:06 smithi157 bash[24585]: cluster 2024-09-16T13:11:05.301882+0000 mgr.a (mgr.14373) 19626 : cluster [DBG] pgmap v13613: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:11:06.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:11:06 smithi086 bash[24289]: cluster 2024-09-16T13:11:05.301882+0000 mgr.a (mgr.14373) 19626 : cluster [DBG] pgmap v13613: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:11:06.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:11:06 smithi047 bash[22744]: cluster 2024-09-16T13:11:05.301882+0000 mgr.a (mgr.14373) 19626 : cluster [DBG] pgmap v13613: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:11:07.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:11:07 smithi157 bash[24585]: audit 2024-09-16T13:11:05.834311+0000 mgr.a (mgr.14373) 19627 : audit [DBG] from='client.420060 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:11:07.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:11:07 smithi086 bash[24289]: audit 2024-09-16T13:11:05.834311+0000 mgr.a (mgr.14373) 19627 : audit [DBG] from='client.420060 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:11:07.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:11:07 smithi047 bash[22744]: audit 2024-09-16T13:11:05.834311+0000 mgr.a (mgr.14373) 19627 : audit [DBG] from='client.420060 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:11:08.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:11:08 smithi157 bash[24585]: cluster 2024-09-16T13:11:07.304212+0000 mgr.a (mgr.14373) 19628 : cluster [DBG] pgmap v13614: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T13:11:08.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:11:08 smithi086 bash[24289]: cluster 2024-09-16T13:11:07.304212+0000 mgr.a (mgr.14373) 19628 : cluster [DBG] pgmap v13614: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T13:11:08.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:11:08 smithi047 bash[22744]: cluster 2024-09-16T13:11:07.304212+0000 mgr.a (mgr.14373) 19628 : cluster [DBG] pgmap v13614: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T13:11:10.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:11:10 smithi157 bash[24585]: cluster 2024-09-16T13:11:09.305015+0000 mgr.a (mgr.14373) 19629 : cluster [DBG] pgmap v13615: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:11:10.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:11:10 smithi086 bash[24289]: cluster 2024-09-16T13:11:09.305015+0000 mgr.a (mgr.14373) 19629 : cluster [DBG] pgmap v13615: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:11:10.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:11:10 smithi047 bash[22744]: cluster 2024-09-16T13:11:09.305015+0000 mgr.a (mgr.14373) 19629 : cluster [DBG] pgmap v13615: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:11:11.260 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T13:11:11.261 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T13:11:11.261 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T13:11:12.009 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T13:11:12.009 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T13:11:12.009 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T13:11:12.009 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T13:11:12.010 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T13:11:12.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:11:12 smithi157 bash[24585]: cluster 2024-09-16T13:11:11.305584+0000 mgr.a (mgr.14373) 19630 : cluster [DBG] pgmap v13616: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:11:12.808 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:11:12 smithi157 bash[24585]: audit 2024-09-16T13:11:11.592428+0000 mgr.a (mgr.14373) 19631 : audit [DBG] from='client.420135 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:11:12.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:11:12 smithi086 bash[24289]: cluster 2024-09-16T13:11:11.305584+0000 mgr.a (mgr.14373) 19630 : cluster [DBG] pgmap v13616: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:11:12.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:11:12 smithi086 bash[24289]: audit 2024-09-16T13:11:11.592428+0000 mgr.a (mgr.14373) 19631 : audit [DBG] from='client.420135 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:11:12.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:11:12 smithi047 bash[22744]: cluster 2024-09-16T13:11:11.305584+0000 mgr.a (mgr.14373) 19630 : cluster [DBG] pgmap v13616: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:11:12.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:11:12 smithi047 bash[22744]: audit 2024-09-16T13:11:11.592428+0000 mgr.a (mgr.14373) 19631 : audit [DBG] from='client.420135 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:11:14.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:11:14 smithi157 bash[24585]: cluster 2024-09-16T13:11:13.308334+0000 mgr.a (mgr.14373) 19632 : cluster [DBG] pgmap v13617: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:11:14.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:11:14 smithi086 bash[24289]: cluster 2024-09-16T13:11:13.308334+0000 mgr.a (mgr.14373) 19632 : cluster [DBG] pgmap v13617: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:11:14.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:11:14 smithi047 bash[22744]: cluster 2024-09-16T13:11:13.308334+0000 mgr.a (mgr.14373) 19632 : cluster [DBG] pgmap v13617: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:11:16.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:11:16 smithi157 bash[24585]: cluster 2024-09-16T13:11:15.309123+0000 mgr.a (mgr.14373) 19633 : cluster [DBG] pgmap v13618: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T13:11:16.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:11:16 smithi086 bash[24289]: cluster 2024-09-16T13:11:15.309123+0000 mgr.a (mgr.14373) 19633 : cluster [DBG] pgmap v13618: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T13:11:16.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:11:16 smithi047 bash[22744]: cluster 2024-09-16T13:11:15.309123+0000 mgr.a (mgr.14373) 19633 : cluster [DBG] pgmap v13618: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T13:11:17.010 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T13:11:17.011 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T13:11:17.011 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T13:11:17.796 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T13:11:17.796 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T13:11:17.796 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T13:11:17.796 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T13:11:17.796 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T13:11:18.808 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:11:18 smithi157 bash[24585]: cluster 2024-09-16T13:11:17.311106+0000 mgr.a (mgr.14373) 19634 : cluster [DBG] pgmap v13619: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:11:18.808 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:11:18 smithi157 bash[24585]: audit 2024-09-16T13:11:17.341555+0000 mgr.a (mgr.14373) 19635 : audit [DBG] from='client.420207 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:11:18.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:11:18 smithi086 bash[24289]: cluster 2024-09-16T13:11:17.311106+0000 mgr.a (mgr.14373) 19634 : cluster [DBG] pgmap v13619: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:11:18.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:11:18 smithi086 bash[24289]: audit 2024-09-16T13:11:17.341555+0000 mgr.a (mgr.14373) 19635 : audit [DBG] from='client.420207 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:11:18.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:11:18 smithi047 bash[22744]: cluster 2024-09-16T13:11:17.311106+0000 mgr.a (mgr.14373) 19634 : cluster [DBG] pgmap v13619: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:11:18.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:11:18 smithi047 bash[22744]: audit 2024-09-16T13:11:17.341555+0000 mgr.a (mgr.14373) 19635 : audit [DBG] from='client.420207 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:11:20.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:11:20 smithi157 bash[24585]: cluster 2024-09-16T13:11:19.312029+0000 mgr.a (mgr.14373) 19636 : cluster [DBG] pgmap v13620: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T13:11:20.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:11:20 smithi086 bash[24289]: cluster 2024-09-16T13:11:19.312029+0000 mgr.a (mgr.14373) 19636 : cluster [DBG] pgmap v13620: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T13:11:20.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:11:20 smithi047 bash[22744]: cluster 2024-09-16T13:11:19.312029+0000 mgr.a (mgr.14373) 19636 : cluster [DBG] pgmap v13620: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T13:11:22.798 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T13:11:22.798 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T13:11:22.798 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T13:11:22.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:11:22 smithi157 bash[24585]: cluster 2024-09-16T13:11:21.312794+0000 mgr.a (mgr.14373) 19637 : cluster [DBG] pgmap v13621: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T13:11:22.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:11:22 smithi086 bash[24289]: cluster 2024-09-16T13:11:21.312794+0000 mgr.a (mgr.14373) 19637 : cluster [DBG] pgmap v13621: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T13:11:22.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:11:22 smithi047 bash[22744]: cluster 2024-09-16T13:11:21.312794+0000 mgr.a (mgr.14373) 19637 : cluster [DBG] pgmap v13621: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T13:11:23.568 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T13:11:23.568 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T13:11:23.568 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T13:11:23.568 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T13:11:23.568 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T13:11:23.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:11:23 smithi157 bash[24585]: audit 2024-09-16T13:11:22.931322+0000 mon.b (mon.2) 1774 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T13:11:23.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:11:23 smithi086 bash[24289]: audit 2024-09-16T13:11:22.931322+0000 mon.b (mon.2) 1774 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T13:11:23.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:11:23 smithi047 bash[22744]: audit 2024-09-16T13:11:22.931322+0000 mon.b (mon.2) 1774 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T13:11:24.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:11:24 smithi157 bash[24585]: audit 2024-09-16T13:11:23.131113+0000 mgr.a (mgr.14373) 19638 : audit [DBG] from='client.420279 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:11:24.808 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:11:24 smithi157 bash[24585]: cluster 2024-09-16T13:11:23.314191+0000 mgr.a (mgr.14373) 19639 : cluster [DBG] pgmap v13622: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:11:24.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:11:24 smithi086 bash[24289]: audit 2024-09-16T13:11:23.131113+0000 mgr.a (mgr.14373) 19638 : audit [DBG] from='client.420279 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:11:24.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:11:24 smithi086 bash[24289]: cluster 2024-09-16T13:11:23.314191+0000 mgr.a (mgr.14373) 19639 : cluster [DBG] pgmap v13622: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:11:24.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:11:24 smithi047 bash[22744]: audit 2024-09-16T13:11:23.131113+0000 mgr.a (mgr.14373) 19638 : audit [DBG] from='client.420279 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:11:24.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:11:24 smithi047 bash[22744]: cluster 2024-09-16T13:11:23.314191+0000 mgr.a (mgr.14373) 19639 : cluster [DBG] pgmap v13622: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:11:26.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:11:26 smithi157 bash[24585]: cluster 2024-09-16T13:11:25.315280+0000 mgr.a (mgr.14373) 19640 : cluster [DBG] pgmap v13623: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:11:26.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:11:26 smithi086 bash[24289]: cluster 2024-09-16T13:11:25.315280+0000 mgr.a (mgr.14373) 19640 : cluster [DBG] pgmap v13623: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:11:26.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:11:26 smithi047 bash[22744]: cluster 2024-09-16T13:11:25.315280+0000 mgr.a (mgr.14373) 19640 : cluster [DBG] pgmap v13623: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:11:28.569 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T13:11:28.569 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T13:11:28.570 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T13:11:28.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:11:28 smithi157 bash[24585]: cluster 2024-09-16T13:11:27.317670+0000 mgr.a (mgr.14373) 19641 : cluster [DBG] pgmap v13624: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T13:11:28.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:11:28 smithi157 bash[24585]: audit 2024-09-16T13:11:28.254495+0000 mon.a (mon.0) 1733 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T13:11:28.808 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:11:28 smithi157 bash[24585]: audit 2024-09-16T13:11:28.264467+0000 mon.a (mon.0) 1734 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T13:11:28.808 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:11:28 smithi157 bash[24585]: audit 2024-09-16T13:11:28.288103+0000 mon.a (mon.0) 1735 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T13:11:28.808 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:11:28 smithi157 bash[24585]: audit 2024-09-16T13:11:28.293520+0000 mon.a (mon.0) 1736 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T13:11:28.808 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:11:28 smithi157 bash[24585]: audit 2024-09-16T13:11:28.307254+0000 mon.a (mon.0) 1737 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T13:11:28.808 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:11:28 smithi157 bash[24585]: audit 2024-09-16T13:11:28.311795+0000 mon.a (mon.0) 1738 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T13:11:28.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:11:28 smithi086 bash[24289]: cluster 2024-09-16T13:11:27.317670+0000 mgr.a (mgr.14373) 19641 : cluster [DBG] pgmap v13624: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T13:11:28.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:11:28 smithi086 bash[24289]: audit 2024-09-16T13:11:28.254495+0000 mon.a (mon.0) 1733 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T13:11:28.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:11:28 smithi086 bash[24289]: audit 2024-09-16T13:11:28.264467+0000 mon.a (mon.0) 1734 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T13:11:28.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:11:28 smithi086 bash[24289]: audit 2024-09-16T13:11:28.288103+0000 mon.a (mon.0) 1735 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T13:11:28.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:11:28 smithi086 bash[24289]: audit 2024-09-16T13:11:28.293520+0000 mon.a (mon.0) 1736 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T13:11:28.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:11:28 smithi086 bash[24289]: audit 2024-09-16T13:11:28.307254+0000 mon.a (mon.0) 1737 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T13:11:28.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:11:28 smithi086 bash[24289]: audit 2024-09-16T13:11:28.311795+0000 mon.a (mon.0) 1738 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T13:11:28.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:11:28 smithi047 bash[22744]: cluster 2024-09-16T13:11:27.317670+0000 mgr.a (mgr.14373) 19641 : cluster [DBG] pgmap v13624: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T13:11:28.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:11:28 smithi047 bash[22744]: audit 2024-09-16T13:11:28.254495+0000 mon.a (mon.0) 1733 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T13:11:28.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:11:28 smithi047 bash[22744]: audit 2024-09-16T13:11:28.264467+0000 mon.a (mon.0) 1734 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T13:11:28.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:11:28 smithi047 bash[22744]: audit 2024-09-16T13:11:28.288103+0000 mon.a (mon.0) 1735 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T13:11:28.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:11:28 smithi047 bash[22744]: audit 2024-09-16T13:11:28.293520+0000 mon.a (mon.0) 1736 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T13:11:28.844 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:11:28 smithi047 bash[22744]: audit 2024-09-16T13:11:28.307254+0000 mon.a (mon.0) 1737 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T13:11:28.844 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:11:28 smithi047 bash[22744]: audit 2024-09-16T13:11:28.311795+0000 mon.a (mon.0) 1738 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T13:11:29.327 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T13:11:29.327 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T13:11:29.327 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T13:11:29.327 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T13:11:29.327 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T13:11:29.808 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:11:29 smithi157 bash[24585]: audit 2024-09-16T13:11:29.029897+0000 mon.b (mon.2) 1775 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T13:11:29.808 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:11:29 smithi157 bash[24585]: audit 2024-09-16T13:11:29.031294+0000 mon.b (mon.2) 1776 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T13:11:29.808 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:11:29 smithi157 bash[24585]: audit 2024-09-16T13:11:29.048841+0000 mon.a (mon.0) 1739 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T13:11:29.808 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:11:29 smithi157 bash[24585]: audit 2024-09-16T13:11:29.054550+0000 mon.b (mon.2) 1777 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T13:11:29.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:11:29 smithi086 bash[24289]: audit 2024-09-16T13:11:29.029897+0000 mon.b (mon.2) 1775 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T13:11:29.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:11:29 smithi086 bash[24289]: audit 2024-09-16T13:11:29.031294+0000 mon.b (mon.2) 1776 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T13:11:29.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:11:29 smithi086 bash[24289]: audit 2024-09-16T13:11:29.048841+0000 mon.a (mon.0) 1739 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T13:11:29.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:11:29 smithi086 bash[24289]: audit 2024-09-16T13:11:29.054550+0000 mon.b (mon.2) 1777 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T13:11:29.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:11:29 smithi047 bash[22744]: audit 2024-09-16T13:11:29.029897+0000 mon.b (mon.2) 1775 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T13:11:29.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:11:29 smithi047 bash[22744]: audit 2024-09-16T13:11:29.031294+0000 mon.b (mon.2) 1776 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T13:11:29.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:11:29 smithi047 bash[22744]: audit 2024-09-16T13:11:29.048841+0000 mon.a (mon.0) 1739 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T13:11:29.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:11:29 smithi047 bash[22744]: audit 2024-09-16T13:11:29.054550+0000 mon.b (mon.2) 1777 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T13:11:30.343 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 13:11:30 smithi047 bash[22994]: debug 2024-09-16T13:11:30.028+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T13:11:30.343 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 13:11:30 smithi047 bash[22994]: debug 2024-09-16T13:11:30.032+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T13:11:30.808 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:11:30 smithi157 bash[24585]: audit 2024-09-16T13:11:28.890447+0000 mgr.a (mgr.14373) 19642 : audit [DBG] from='client.420354 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:11:30.808 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:11:30 smithi157 bash[24585]: audit 2024-09-16T13:11:29.056321+0000 mgr.a (mgr.14373) 19643 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T13:11:30.808 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:11:30 smithi157 bash[24585]: cluster 2024-09-16T13:11:29.322783+0000 mgr.a (mgr.14373) 19644 : cluster [DBG] pgmap v13625: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:11:30.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:11:30 smithi086 bash[24289]: audit 2024-09-16T13:11:28.890447+0000 mgr.a (mgr.14373) 19642 : audit [DBG] from='client.420354 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:11:30.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:11:30 smithi086 bash[24289]: audit 2024-09-16T13:11:29.056321+0000 mgr.a (mgr.14373) 19643 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T13:11:30.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:11:30 smithi086 bash[24289]: cluster 2024-09-16T13:11:29.322783+0000 mgr.a (mgr.14373) 19644 : cluster [DBG] pgmap v13625: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:11:30.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:11:30 smithi047 bash[22744]: audit 2024-09-16T13:11:28.890447+0000 mgr.a (mgr.14373) 19642 : audit [DBG] from='client.420354 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:11:30.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:11:30 smithi047 bash[22744]: audit 2024-09-16T13:11:29.056321+0000 mgr.a (mgr.14373) 19643 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T13:11:30.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:11:30 smithi047 bash[22744]: cluster 2024-09-16T13:11:29.322783+0000 mgr.a (mgr.14373) 19644 : cluster [DBG] pgmap v13625: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:11:31.808 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:11:31 smithi157 bash[24585]: audit 2024-09-16T13:11:30.033888+0000 mgr.a (mgr.14373) 19645 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T13:11:31.808 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:11:31 smithi157 bash[24585]: cephadm 2024-09-16T13:11:30.035753+0000 mgr.a (mgr.14373) 19646 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T13:11:31.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:11:31 smithi086 bash[24289]: audit 2024-09-16T13:11:30.033888+0000 mgr.a (mgr.14373) 19645 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T13:11:31.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:11:31 smithi086 bash[24289]: cephadm 2024-09-16T13:11:30.035753+0000 mgr.a (mgr.14373) 19646 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T13:11:31.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:11:31 smithi047 bash[22744]: audit 2024-09-16T13:11:30.033888+0000 mgr.a (mgr.14373) 19645 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T13:11:31.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:11:31 smithi047 bash[22744]: cephadm 2024-09-16T13:11:30.035753+0000 mgr.a (mgr.14373) 19646 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T13:11:32.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:11:32 smithi157 bash[24585]: cluster 2024-09-16T13:11:31.323686+0000 mgr.a (mgr.14373) 19647 : cluster [DBG] pgmap v13626: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:11:32.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:11:32 smithi086 bash[24289]: cluster 2024-09-16T13:11:31.323686+0000 mgr.a (mgr.14373) 19647 : cluster [DBG] pgmap v13626: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:11:32.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:11:32 smithi047 bash[22744]: cluster 2024-09-16T13:11:31.323686+0000 mgr.a (mgr.14373) 19647 : cluster [DBG] pgmap v13626: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:11:34.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:11:33 smithi086 bash[24289]: cluster 2024-09-16T13:11:33.326016+0000 mgr.a (mgr.14373) 19648 : cluster [DBG] pgmap v13627: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T13:11:34.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:11:33 smithi047 bash[22744]: cluster 2024-09-16T13:11:33.326016+0000 mgr.a (mgr.14373) 19648 : cluster [DBG] pgmap v13627: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T13:11:34.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:11:33 smithi157 bash[24585]: cluster 2024-09-16T13:11:33.326016+0000 mgr.a (mgr.14373) 19648 : cluster [DBG] pgmap v13627: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T13:11:34.328 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T13:11:34.329 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T13:11:34.329 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T13:11:35.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:11:34 smithi086 bash[24289]: audit 2024-09-16T13:11:34.659542+0000 mgr.a (mgr.14373) 19649 : audit [DBG] from='client.420534 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:11:35.072 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T13:11:35.072 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T13:11:35.072 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T13:11:35.072 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T13:11:35.072 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T13:11:35.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:11:34 smithi047 bash[22744]: audit 2024-09-16T13:11:34.659542+0000 mgr.a (mgr.14373) 19649 : audit [DBG] from='client.420534 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:11:35.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:11:34 smithi157 bash[24585]: audit 2024-09-16T13:11:34.659542+0000 mgr.a (mgr.14373) 19649 : audit [DBG] from='client.420534 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:11:36.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:11:35 smithi086 bash[24289]: cluster 2024-09-16T13:11:35.327024+0000 mgr.a (mgr.14373) 19650 : cluster [DBG] pgmap v13628: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T13:11:36.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:11:35 smithi047 bash[22744]: cluster 2024-09-16T13:11:35.327024+0000 mgr.a (mgr.14373) 19650 : cluster [DBG] pgmap v13628: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T13:11:36.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:11:35 smithi157 bash[24585]: cluster 2024-09-16T13:11:35.327024+0000 mgr.a (mgr.14373) 19650 : cluster [DBG] pgmap v13628: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T13:11:38.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:11:38 smithi157 bash[24585]: cluster 2024-09-16T13:11:37.329264+0000 mgr.a (mgr.14373) 19651 : cluster [DBG] pgmap v13629: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T13:11:38.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:11:38 smithi086 bash[24289]: cluster 2024-09-16T13:11:37.329264+0000 mgr.a (mgr.14373) 19651 : cluster [DBG] pgmap v13629: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T13:11:38.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:11:38 smithi047 bash[22744]: cluster 2024-09-16T13:11:37.329264+0000 mgr.a (mgr.14373) 19651 : cluster [DBG] pgmap v13629: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T13:11:40.074 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T13:11:40.074 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T13:11:40.074 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T13:11:40.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:11:40 smithi157 bash[24585]: cluster 2024-09-16T13:11:39.330037+0000 mgr.a (mgr.14373) 19652 : cluster [DBG] pgmap v13630: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T13:11:40.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:11:40 smithi086 bash[24289]: cluster 2024-09-16T13:11:39.330037+0000 mgr.a (mgr.14373) 19652 : cluster [DBG] pgmap v13630: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T13:11:40.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:11:40 smithi047 bash[22744]: cluster 2024-09-16T13:11:39.330037+0000 mgr.a (mgr.14373) 19652 : cluster [DBG] pgmap v13630: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T13:11:40.847 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T13:11:40.848 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T13:11:40.848 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T13:11:40.848 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T13:11:40.848 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T13:11:41.808 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:11:41 smithi157 bash[24585]: audit 2024-09-16T13:11:40.408296+0000 mgr.a (mgr.14373) 19653 : audit [DBG] from='client.420612 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:11:41.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:11:41 smithi086 bash[24289]: audit 2024-09-16T13:11:40.408296+0000 mgr.a (mgr.14373) 19653 : audit [DBG] from='client.420612 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:11:41.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:11:41 smithi047 bash[22744]: audit 2024-09-16T13:11:40.408296+0000 mgr.a (mgr.14373) 19653 : audit [DBG] from='client.420612 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:11:42.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:11:42 smithi157 bash[24585]: cluster 2024-09-16T13:11:41.331004+0000 mgr.a (mgr.14373) 19654 : cluster [DBG] pgmap v13631: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T13:11:42.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:11:42 smithi086 bash[24289]: cluster 2024-09-16T13:11:41.331004+0000 mgr.a (mgr.14373) 19654 : cluster [DBG] pgmap v13631: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T13:11:42.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:11:42 smithi047 bash[22744]: cluster 2024-09-16T13:11:41.331004+0000 mgr.a (mgr.14373) 19654 : cluster [DBG] pgmap v13631: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T13:11:44.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:11:44 smithi157 bash[24585]: cluster 2024-09-16T13:11:43.333249+0000 mgr.a (mgr.14373) 19655 : cluster [DBG] pgmap v13632: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T13:11:44.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:11:44 smithi086 bash[24289]: cluster 2024-09-16T13:11:43.333249+0000 mgr.a (mgr.14373) 19655 : cluster [DBG] pgmap v13632: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T13:11:44.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:11:44 smithi047 bash[22744]: cluster 2024-09-16T13:11:43.333249+0000 mgr.a (mgr.14373) 19655 : cluster [DBG] pgmap v13632: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T13:11:45.849 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T13:11:45.850 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T13:11:45.850 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T13:11:46.613 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T13:11:46.613 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T13:11:46.614 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T13:11:46.614 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T13:11:46.614 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T13:11:46.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:11:46 smithi157 bash[24585]: cluster 2024-09-16T13:11:45.334013+0000 mgr.a (mgr.14373) 19656 : cluster [DBG] pgmap v13633: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:11:46.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:11:46 smithi086 bash[24289]: cluster 2024-09-16T13:11:45.334013+0000 mgr.a (mgr.14373) 19656 : cluster [DBG] pgmap v13633: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:11:46.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:11:46 smithi047 bash[22744]: cluster 2024-09-16T13:11:45.334013+0000 mgr.a (mgr.14373) 19656 : cluster [DBG] pgmap v13633: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:11:47.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:11:47 smithi157 bash[24585]: audit 2024-09-16T13:11:46.180188+0000 mgr.a (mgr.14373) 19657 : audit [DBG] from='client.420687 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:11:47.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:11:47 smithi086 bash[24289]: audit 2024-09-16T13:11:46.180188+0000 mgr.a (mgr.14373) 19657 : audit [DBG] from='client.420687 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:11:47.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:11:47 smithi047 bash[22744]: audit 2024-09-16T13:11:46.180188+0000 mgr.a (mgr.14373) 19657 : audit [DBG] from='client.420687 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:11:48.808 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:11:48 smithi157 bash[24585]: cluster 2024-09-16T13:11:47.336901+0000 mgr.a (mgr.14373) 19658 : cluster [DBG] pgmap v13634: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-16T13:11:48.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:11:48 smithi086 bash[24289]: cluster 2024-09-16T13:11:47.336901+0000 mgr.a (mgr.14373) 19658 : cluster [DBG] pgmap v13634: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-16T13:11:48.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:11:48 smithi047 bash[22744]: cluster 2024-09-16T13:11:47.336901+0000 mgr.a (mgr.14373) 19658 : cluster [DBG] pgmap v13634: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-09-16T13:11:50.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:11:50 smithi157 bash[24585]: cluster 2024-09-16T13:11:49.337848+0000 mgr.a (mgr.14373) 19659 : cluster [DBG] pgmap v13635: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T13:11:50.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:11:50 smithi086 bash[24289]: cluster 2024-09-16T13:11:49.337848+0000 mgr.a (mgr.14373) 19659 : cluster [DBG] pgmap v13635: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T13:11:50.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:11:50 smithi047 bash[22744]: cluster 2024-09-16T13:11:49.337848+0000 mgr.a (mgr.14373) 19659 : cluster [DBG] pgmap v13635: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T13:11:51.615 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T13:11:51.615 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T13:11:51.616 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T13:11:52.402 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T13:11:52.402 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T13:11:52.402 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T13:11:52.402 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T13:11:52.402 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T13:11:52.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:11:52 smithi157 bash[24585]: cluster 2024-09-16T13:11:51.338821+0000 mgr.a (mgr.14373) 19660 : cluster [DBG] pgmap v13636: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T13:11:52.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:11:52 smithi086 bash[24289]: cluster 2024-09-16T13:11:51.338821+0000 mgr.a (mgr.14373) 19660 : cluster [DBG] pgmap v13636: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T13:11:52.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:11:52 smithi047 bash[22744]: cluster 2024-09-16T13:11:51.338821+0000 mgr.a (mgr.14373) 19660 : cluster [DBG] pgmap v13636: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T13:11:53.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:11:53 smithi157 bash[24585]: audit 2024-09-16T13:11:51.948968+0000 mgr.a (mgr.14373) 19661 : audit [DBG] from='client.420762 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:11:53.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:11:53 smithi086 bash[24289]: audit 2024-09-16T13:11:51.948968+0000 mgr.a (mgr.14373) 19661 : audit [DBG] from='client.420762 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:11:53.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:11:53 smithi047 bash[22744]: audit 2024-09-16T13:11:51.948968+0000 mgr.a (mgr.14373) 19661 : audit [DBG] from='client.420762 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:11:54.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:11:54 smithi157 bash[24585]: cluster 2024-09-16T13:11:53.341718+0000 mgr.a (mgr.14373) 19662 : cluster [DBG] pgmap v13637: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:11:54.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:11:54 smithi086 bash[24289]: cluster 2024-09-16T13:11:53.341718+0000 mgr.a (mgr.14373) 19662 : cluster [DBG] pgmap v13637: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:11:54.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:11:54 smithi047 bash[22744]: cluster 2024-09-16T13:11:53.341718+0000 mgr.a (mgr.14373) 19662 : cluster [DBG] pgmap v13637: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:11:56.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:11:56 smithi157 bash[24585]: cluster 2024-09-16T13:11:55.342732+0000 mgr.a (mgr.14373) 19663 : cluster [DBG] pgmap v13638: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T13:11:56.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:11:56 smithi086 bash[24289]: cluster 2024-09-16T13:11:55.342732+0000 mgr.a (mgr.14373) 19663 : cluster [DBG] pgmap v13638: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T13:11:56.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:11:56 smithi047 bash[22744]: cluster 2024-09-16T13:11:55.342732+0000 mgr.a (mgr.14373) 19663 : cluster [DBG] pgmap v13638: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T13:11:57.403 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T13:11:57.404 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T13:11:57.404 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T13:11:58.196 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T13:11:58.196 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T13:11:58.196 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T13:11:58.197 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T13:11:58.197 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T13:11:58.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:11:58 smithi157 bash[24585]: cluster 2024-09-16T13:11:57.344734+0000 mgr.a (mgr.14373) 19664 : cluster [DBG] pgmap v13639: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:11:58.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:11:58 smithi157 bash[24585]: audit 2024-09-16T13:11:57.736208+0000 mgr.a (mgr.14373) 19665 : audit [DBG] from='client.420840 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:11:58.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:11:58 smithi086 bash[24289]: cluster 2024-09-16T13:11:57.344734+0000 mgr.a (mgr.14373) 19664 : cluster [DBG] pgmap v13639: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:11:58.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:11:58 smithi086 bash[24289]: audit 2024-09-16T13:11:57.736208+0000 mgr.a (mgr.14373) 19665 : audit [DBG] from='client.420840 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:11:58.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:11:58 smithi047 bash[22744]: cluster 2024-09-16T13:11:57.344734+0000 mgr.a (mgr.14373) 19664 : cluster [DBG] pgmap v13639: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:11:58.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:11:58 smithi047 bash[22744]: audit 2024-09-16T13:11:57.736208+0000 mgr.a (mgr.14373) 19665 : audit [DBG] from='client.420840 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:12:00.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:12:00 smithi157 bash[24585]: cluster 2024-09-16T13:11:59.345806+0000 mgr.a (mgr.14373) 19666 : cluster [DBG] pgmap v13640: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-16T13:12:00.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:12:00 smithi086 bash[24289]: cluster 2024-09-16T13:11:59.345806+0000 mgr.a (mgr.14373) 19666 : cluster [DBG] pgmap v13640: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-16T13:12:00.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:12:00 smithi047 bash[22744]: cluster 2024-09-16T13:11:59.345806+0000 mgr.a (mgr.14373) 19666 : cluster [DBG] pgmap v13640: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-16T13:12:02.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:12:02 smithi157 bash[24585]: cluster 2024-09-16T13:12:01.346805+0000 mgr.a (mgr.14373) 19667 : cluster [DBG] pgmap v13641: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-16T13:12:02.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:12:02 smithi086 bash[24289]: cluster 2024-09-16T13:12:01.346805+0000 mgr.a (mgr.14373) 19667 : cluster [DBG] pgmap v13641: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-16T13:12:02.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:12:02 smithi047 bash[22744]: cluster 2024-09-16T13:12:01.346805+0000 mgr.a (mgr.14373) 19667 : cluster [DBG] pgmap v13641: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-16T13:12:03.198 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T13:12:03.199 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T13:12:03.199 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T13:12:03.957 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T13:12:03.958 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T13:12:03.958 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T13:12:03.958 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T13:12:03.958 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T13:12:04.808 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:12:04 smithi157 bash[24585]: cluster 2024-09-16T13:12:03.348952+0000 mgr.a (mgr.14373) 19668 : cluster [DBG] pgmap v13642: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-16T13:12:04.808 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:12:04 smithi157 bash[24585]: audit 2024-09-16T13:12:03.531449+0000 mgr.a (mgr.14373) 19669 : audit [DBG] from='client.420915 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:12:04.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:12:04 smithi086 bash[24289]: cluster 2024-09-16T13:12:03.348952+0000 mgr.a (mgr.14373) 19668 : cluster [DBG] pgmap v13642: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-16T13:12:04.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:12:04 smithi086 bash[24289]: audit 2024-09-16T13:12:03.531449+0000 mgr.a (mgr.14373) 19669 : audit [DBG] from='client.420915 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:12:04.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:12:04 smithi047 bash[22744]: cluster 2024-09-16T13:12:03.348952+0000 mgr.a (mgr.14373) 19668 : cluster [DBG] pgmap v13642: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-16T13:12:04.844 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:12:04 smithi047 bash[22744]: audit 2024-09-16T13:12:03.531449+0000 mgr.a (mgr.14373) 19669 : audit [DBG] from='client.420915 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:12:06.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:12:06 smithi157 bash[24585]: cluster 2024-09-16T13:12:05.349834+0000 mgr.a (mgr.14373) 19670 : cluster [DBG] pgmap v13643: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:12:06.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:12:06 smithi086 bash[24289]: cluster 2024-09-16T13:12:05.349834+0000 mgr.a (mgr.14373) 19670 : cluster [DBG] pgmap v13643: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:12:06.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:12:06 smithi047 bash[22744]: cluster 2024-09-16T13:12:05.349834+0000 mgr.a (mgr.14373) 19670 : cluster [DBG] pgmap v13643: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:12:08.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:12:08 smithi157 bash[24585]: cluster 2024-09-16T13:12:07.352112+0000 mgr.a (mgr.14373) 19671 : cluster [DBG] pgmap v13644: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T13:12:08.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:12:08 smithi086 bash[24289]: cluster 2024-09-16T13:12:07.352112+0000 mgr.a (mgr.14373) 19671 : cluster [DBG] pgmap v13644: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T13:12:08.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:12:08 smithi047 bash[22744]: cluster 2024-09-16T13:12:07.352112+0000 mgr.a (mgr.14373) 19671 : cluster [DBG] pgmap v13644: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T13:12:08.959 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T13:12:08.960 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T13:12:08.960 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T13:12:09.750 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T13:12:09.750 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T13:12:09.750 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T13:12:09.750 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T13:12:09.750 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T13:12:10.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:12:10 smithi157 bash[24585]: audit 2024-09-16T13:12:09.298923+0000 mgr.a (mgr.14373) 19672 : audit [DBG] from='client.420993 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:12:10.808 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:12:10 smithi157 bash[24585]: cluster 2024-09-16T13:12:09.353127+0000 mgr.a (mgr.14373) 19673 : cluster [DBG] pgmap v13645: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:12:10.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:12:10 smithi086 bash[24289]: audit 2024-09-16T13:12:09.298923+0000 mgr.a (mgr.14373) 19672 : audit [DBG] from='client.420993 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:12:10.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:12:10 smithi086 bash[24289]: cluster 2024-09-16T13:12:09.353127+0000 mgr.a (mgr.14373) 19673 : cluster [DBG] pgmap v13645: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:12:10.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:12:10 smithi047 bash[22744]: audit 2024-09-16T13:12:09.298923+0000 mgr.a (mgr.14373) 19672 : audit [DBG] from='client.420993 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:12:10.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:12:10 smithi047 bash[22744]: cluster 2024-09-16T13:12:09.353127+0000 mgr.a (mgr.14373) 19673 : cluster [DBG] pgmap v13645: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:12:12.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:12:12 smithi157 bash[24585]: cluster 2024-09-16T13:12:11.354052+0000 mgr.a (mgr.14373) 19674 : cluster [DBG] pgmap v13646: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:12:12.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:12:12 smithi086 bash[24289]: cluster 2024-09-16T13:12:11.354052+0000 mgr.a (mgr.14373) 19674 : cluster [DBG] pgmap v13646: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:12:12.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:12:12 smithi047 bash[22744]: cluster 2024-09-16T13:12:11.354052+0000 mgr.a (mgr.14373) 19674 : cluster [DBG] pgmap v13646: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:12:14.751 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T13:12:14.752 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T13:12:14.752 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T13:12:14.808 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:12:14 smithi157 bash[24585]: cluster 2024-09-16T13:12:13.356334+0000 mgr.a (mgr.14373) 19675 : cluster [DBG] pgmap v13647: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T13:12:14.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:12:14 smithi086 bash[24289]: cluster 2024-09-16T13:12:13.356334+0000 mgr.a (mgr.14373) 19675 : cluster [DBG] pgmap v13647: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T13:12:14.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:12:14 smithi047 bash[22744]: cluster 2024-09-16T13:12:13.356334+0000 mgr.a (mgr.14373) 19675 : cluster [DBG] pgmap v13647: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T13:12:15.537 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T13:12:15.537 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T13:12:15.537 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T13:12:15.537 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T13:12:15.538 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T13:12:16.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:12:16 smithi157 bash[24585]: audit 2024-09-16T13:12:15.084961+0000 mgr.a (mgr.14373) 19676 : audit [DBG] from='client.421068 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:12:16.808 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:12:16 smithi157 bash[24585]: cluster 2024-09-16T13:12:15.356918+0000 mgr.a (mgr.14373) 19677 : cluster [DBG] pgmap v13648: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:12:16.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:12:16 smithi086 bash[24289]: audit 2024-09-16T13:12:15.084961+0000 mgr.a (mgr.14373) 19676 : audit [DBG] from='client.421068 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:12:16.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:12:16 smithi086 bash[24289]: cluster 2024-09-16T13:12:15.356918+0000 mgr.a (mgr.14373) 19677 : cluster [DBG] pgmap v13648: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:12:16.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:12:16 smithi047 bash[22744]: audit 2024-09-16T13:12:15.084961+0000 mgr.a (mgr.14373) 19676 : audit [DBG] from='client.421068 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:12:16.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:12:16 smithi047 bash[22744]: cluster 2024-09-16T13:12:15.356918+0000 mgr.a (mgr.14373) 19677 : cluster [DBG] pgmap v13648: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:12:18.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:12:18 smithi157 bash[24585]: cluster 2024-09-16T13:12:17.359270+0000 mgr.a (mgr.14373) 19678 : cluster [DBG] pgmap v13649: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T13:12:18.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:12:18 smithi086 bash[24289]: cluster 2024-09-16T13:12:17.359270+0000 mgr.a (mgr.14373) 19678 : cluster [DBG] pgmap v13649: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T13:12:18.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:12:18 smithi047 bash[22744]: cluster 2024-09-16T13:12:17.359270+0000 mgr.a (mgr.14373) 19678 : cluster [DBG] pgmap v13649: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T13:12:20.539 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T13:12:20.539 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T13:12:20.539 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T13:12:20.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:12:20 smithi157 bash[24585]: cluster 2024-09-16T13:12:19.360032+0000 mgr.a (mgr.14373) 19679 : cluster [DBG] pgmap v13650: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:12:20.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:12:20 smithi086 bash[24289]: cluster 2024-09-16T13:12:19.360032+0000 mgr.a (mgr.14373) 19679 : cluster [DBG] pgmap v13650: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:12:20.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:12:20 smithi047 bash[22744]: cluster 2024-09-16T13:12:19.360032+0000 mgr.a (mgr.14373) 19679 : cluster [DBG] pgmap v13650: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:12:21.291 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T13:12:21.291 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T13:12:21.291 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T13:12:21.291 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T13:12:21.291 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T13:12:22.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:12:22 smithi157 bash[24585]: audit 2024-09-16T13:12:20.868641+0000 mgr.a (mgr.14373) 19680 : audit [DBG] from='client.421146 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:12:22.808 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:12:22 smithi157 bash[24585]: cluster 2024-09-16T13:12:21.361007+0000 mgr.a (mgr.14373) 19681 : cluster [DBG] pgmap v13651: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:12:22.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:12:22 smithi086 bash[24289]: audit 2024-09-16T13:12:20.868641+0000 mgr.a (mgr.14373) 19680 : audit [DBG] from='client.421146 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:12:22.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:12:22 smithi086 bash[24289]: cluster 2024-09-16T13:12:21.361007+0000 mgr.a (mgr.14373) 19681 : cluster [DBG] pgmap v13651: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:12:22.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:12:22 smithi047 bash[22744]: audit 2024-09-16T13:12:20.868641+0000 mgr.a (mgr.14373) 19680 : audit [DBG] from='client.421146 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:12:22.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:12:22 smithi047 bash[22744]: cluster 2024-09-16T13:12:21.361007+0000 mgr.a (mgr.14373) 19681 : cluster [DBG] pgmap v13651: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:12:24.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:12:24 smithi157 bash[24585]: cluster 2024-09-16T13:12:23.363297+0000 mgr.a (mgr.14373) 19682 : cluster [DBG] pgmap v13652: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T13:12:24.823 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:12:24 smithi086 bash[24289]: cluster 2024-09-16T13:12:23.363297+0000 mgr.a (mgr.14373) 19682 : cluster [DBG] pgmap v13652: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T13:12:24.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:12:24 smithi047 bash[22744]: cluster 2024-09-16T13:12:23.363297+0000 mgr.a (mgr.14373) 19682 : cluster [DBG] pgmap v13652: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T13:12:26.292 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T13:12:26.293 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T13:12:26.293 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T13:12:26.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:12:26 smithi157 bash[24585]: cluster 2024-09-16T13:12:25.364061+0000 mgr.a (mgr.14373) 19683 : cluster [DBG] pgmap v13653: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:12:26.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:12:26 smithi086 bash[24289]: cluster 2024-09-16T13:12:25.364061+0000 mgr.a (mgr.14373) 19683 : cluster [DBG] pgmap v13653: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:12:26.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:12:26 smithi047 bash[22744]: cluster 2024-09-16T13:12:25.364061+0000 mgr.a (mgr.14373) 19683 : cluster [DBG] pgmap v13653: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:12:27.055 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T13:12:27.055 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T13:12:27.055 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T13:12:27.055 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T13:12:27.055 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T13:12:27.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:12:27 smithi157 bash[24585]: audit 2024-09-16T13:12:26.630379+0000 mgr.a (mgr.14373) 19684 : audit [DBG] from='client.421221 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:12:27.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:12:27 smithi086 bash[24289]: audit 2024-09-16T13:12:26.630379+0000 mgr.a (mgr.14373) 19684 : audit [DBG] from='client.421221 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:12:27.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:12:27 smithi047 bash[22744]: audit 2024-09-16T13:12:26.630379+0000 mgr.a (mgr.14373) 19684 : audit [DBG] from='client.421221 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:12:28.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:12:28 smithi157 bash[24585]: cluster 2024-09-16T13:12:27.366718+0000 mgr.a (mgr.14373) 19685 : cluster [DBG] pgmap v13654: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:12:28.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:12:28 smithi086 bash[24289]: cluster 2024-09-16T13:12:27.366718+0000 mgr.a (mgr.14373) 19685 : cluster [DBG] pgmap v13654: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:12:28.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:12:28 smithi047 bash[22744]: cluster 2024-09-16T13:12:27.366718+0000 mgr.a (mgr.14373) 19685 : cluster [DBG] pgmap v13654: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:12:30.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:12:30 smithi157 bash[24585]: cluster 2024-09-16T13:12:29.367468+0000 mgr.a (mgr.14373) 19686 : cluster [DBG] pgmap v13655: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T13:12:30.808 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:12:30 smithi157 bash[24585]: audit 2024-09-16T13:12:30.085844+0000 mon.b (mon.2) 1778 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T13:12:30.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:12:30 smithi086 bash[24289]: cluster 2024-09-16T13:12:29.367468+0000 mgr.a (mgr.14373) 19686 : cluster [DBG] pgmap v13655: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T13:12:30.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:12:30 smithi086 bash[24289]: audit 2024-09-16T13:12:30.085844+0000 mon.b (mon.2) 1778 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T13:12:30.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:12:30 smithi047 bash[22744]: cluster 2024-09-16T13:12:29.367468+0000 mgr.a (mgr.14373) 19686 : cluster [DBG] pgmap v13655: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T13:12:30.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:12:30 smithi047 bash[22744]: audit 2024-09-16T13:12:30.085844+0000 mon.b (mon.2) 1778 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T13:12:31.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:12:31 smithi157 bash[24585]: audit 2024-09-16T13:12:30.933074+0000 mon.b (mon.2) 1779 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T13:12:31.808 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:12:31 smithi157 bash[24585]: audit 2024-09-16T13:12:30.934968+0000 mon.b (mon.2) 1780 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T13:12:31.808 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:12:31 smithi157 bash[24585]: audit 2024-09-16T13:12:30.945266+0000 mon.a (mon.0) 1740 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T13:12:31.808 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:12:31 smithi157 bash[24585]: audit 2024-09-16T13:12:30.948459+0000 mon.b (mon.2) 1781 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T13:12:31.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:12:31 smithi086 bash[24289]: audit 2024-09-16T13:12:30.933074+0000 mon.b (mon.2) 1779 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T13:12:31.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:12:31 smithi086 bash[24289]: audit 2024-09-16T13:12:30.934968+0000 mon.b (mon.2) 1780 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T13:12:31.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:12:31 smithi086 bash[24289]: audit 2024-09-16T13:12:30.945266+0000 mon.a (mon.0) 1740 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T13:12:31.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:12:31 smithi086 bash[24289]: audit 2024-09-16T13:12:30.948459+0000 mon.b (mon.2) 1781 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T13:12:31.843 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 13:12:31 smithi047 bash[22994]: debug 2024-09-16T13:12:31.707+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T13:12:31.843 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 13:12:31 smithi047 bash[22994]: debug 2024-09-16T13:12:31.711+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T13:12:31.844 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:12:31 smithi047 bash[22744]: audit 2024-09-16T13:12:30.933074+0000 mon.b (mon.2) 1779 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T13:12:31.844 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:12:31 smithi047 bash[22744]: audit 2024-09-16T13:12:30.934968+0000 mon.b (mon.2) 1780 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T13:12:31.844 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:12:31 smithi047 bash[22744]: audit 2024-09-16T13:12:30.945266+0000 mon.a (mon.0) 1740 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T13:12:31.844 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:12:31 smithi047 bash[22744]: audit 2024-09-16T13:12:30.948459+0000 mon.b (mon.2) 1781 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T13:12:32.056 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T13:12:32.057 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T13:12:32.057 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T13:12:32.808 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:12:32 smithi157 bash[24585]: audit 2024-09-16T13:12:30.950853+0000 mgr.a (mgr.14373) 19687 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T13:12:32.808 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:12:32 smithi157 bash[24585]: cluster 2024-09-16T13:12:31.368003+0000 mgr.a (mgr.14373) 19688 : cluster [DBG] pgmap v13656: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T13:12:32.808 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:12:32 smithi157 bash[24585]: audit 2024-09-16T13:12:31.713556+0000 mgr.a (mgr.14373) 19689 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T13:12:32.808 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:12:32 smithi157 bash[24585]: cephadm 2024-09-16T13:12:31.715468+0000 mgr.a (mgr.14373) 19690 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T13:12:32.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:12:32 smithi086 bash[24289]: audit 2024-09-16T13:12:30.950853+0000 mgr.a (mgr.14373) 19687 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T13:12:32.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:12:32 smithi086 bash[24289]: cluster 2024-09-16T13:12:31.368003+0000 mgr.a (mgr.14373) 19688 : cluster [DBG] pgmap v13656: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T13:12:32.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:12:32 smithi086 bash[24289]: audit 2024-09-16T13:12:31.713556+0000 mgr.a (mgr.14373) 19689 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T13:12:32.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:12:32 smithi086 bash[24289]: cephadm 2024-09-16T13:12:31.715468+0000 mgr.a (mgr.14373) 19690 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T13:12:32.822 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T13:12:32.822 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T13:12:32.822 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T13:12:32.822 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T13:12:32.822 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T13:12:32.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:12:32 smithi047 bash[22744]: audit 2024-09-16T13:12:30.950853+0000 mgr.a (mgr.14373) 19687 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T13:12:32.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:12:32 smithi047 bash[22744]: cluster 2024-09-16T13:12:31.368003+0000 mgr.a (mgr.14373) 19688 : cluster [DBG] pgmap v13656: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T13:12:32.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:12:32 smithi047 bash[22744]: audit 2024-09-16T13:12:31.713556+0000 mgr.a (mgr.14373) 19689 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T13:12:32.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:12:32 smithi047 bash[22744]: cephadm 2024-09-16T13:12:31.715468+0000 mgr.a (mgr.14373) 19690 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T13:12:33.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:12:33 smithi157 bash[24585]: audit 2024-09-16T13:12:32.388683+0000 mgr.a (mgr.14373) 19691 : audit [DBG] from='client.421401 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:12:33.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:12:33 smithi086 bash[24289]: audit 2024-09-16T13:12:32.388683+0000 mgr.a (mgr.14373) 19691 : audit [DBG] from='client.421401 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:12:33.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:12:33 smithi047 bash[22744]: audit 2024-09-16T13:12:32.388683+0000 mgr.a (mgr.14373) 19691 : audit [DBG] from='client.421401 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:12:34.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:12:34 smithi157 bash[24585]: cluster 2024-09-16T13:12:33.370682+0000 mgr.a (mgr.14373) 19692 : cluster [DBG] pgmap v13657: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 3.7 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-16T13:12:34.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:12:34 smithi086 bash[24289]: cluster 2024-09-16T13:12:33.370682+0000 mgr.a (mgr.14373) 19692 : cluster [DBG] pgmap v13657: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 3.7 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-16T13:12:34.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:12:34 smithi047 bash[22744]: cluster 2024-09-16T13:12:33.370682+0000 mgr.a (mgr.14373) 19692 : cluster [DBG] pgmap v13657: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 3.7 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-16T13:12:36.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:12:36 smithi157 bash[24585]: cluster 2024-09-16T13:12:35.371456+0000 mgr.a (mgr.14373) 19693 : cluster [DBG] pgmap v13658: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.8 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-16T13:12:36.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:12:36 smithi086 bash[24289]: cluster 2024-09-16T13:12:35.371456+0000 mgr.a (mgr.14373) 19693 : cluster [DBG] pgmap v13658: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.8 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-16T13:12:36.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:12:36 smithi047 bash[22744]: cluster 2024-09-16T13:12:35.371456+0000 mgr.a (mgr.14373) 19693 : cluster [DBG] pgmap v13658: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.8 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-16T13:12:37.823 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T13:12:37.824 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T13:12:37.824 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T13:12:38.583 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T13:12:38.583 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T13:12:38.584 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T13:12:38.584 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T13:12:38.584 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T13:12:38.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:12:38 smithi157 bash[24585]: cluster 2024-09-16T13:12:37.373470+0000 mgr.a (mgr.14373) 19694 : cluster [DBG] pgmap v13659: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T13:12:38.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:12:38 smithi086 bash[24289]: cluster 2024-09-16T13:12:37.373470+0000 mgr.a (mgr.14373) 19694 : cluster [DBG] pgmap v13659: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T13:12:38.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:12:38 smithi047 bash[22744]: cluster 2024-09-16T13:12:37.373470+0000 mgr.a (mgr.14373) 19694 : cluster [DBG] pgmap v13659: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T13:12:39.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:12:39 smithi086 bash[24289]: audit 2024-09-16T13:12:38.152959+0000 mgr.a (mgr.14373) 19695 : audit [DBG] from='client.421479 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:12:39.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:12:39 smithi047 bash[22744]: audit 2024-09-16T13:12:38.152959+0000 mgr.a (mgr.14373) 19695 : audit [DBG] from='client.421479 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:12:40.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:12:39 smithi157 bash[24585]: audit 2024-09-16T13:12:38.152959+0000 mgr.a (mgr.14373) 19695 : audit [DBG] from='client.421479 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:12:40.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:12:40 smithi086 bash[24289]: cluster 2024-09-16T13:12:39.374374+0000 mgr.a (mgr.14373) 19696 : cluster [DBG] pgmap v13660: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T13:12:40.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:12:40 smithi047 bash[22744]: cluster 2024-09-16T13:12:39.374374+0000 mgr.a (mgr.14373) 19696 : cluster [DBG] pgmap v13660: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T13:12:41.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:12:40 smithi157 bash[24585]: cluster 2024-09-16T13:12:39.374374+0000 mgr.a (mgr.14373) 19696 : cluster [DBG] pgmap v13660: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T13:12:42.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:12:42 smithi047 bash[22744]: cluster 2024-09-16T13:12:41.375095+0000 mgr.a (mgr.14373) 19697 : cluster [DBG] pgmap v13661: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T13:12:43.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:12:42 smithi157 bash[24585]: cluster 2024-09-16T13:12:41.375095+0000 mgr.a (mgr.14373) 19697 : cluster [DBG] pgmap v13661: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T13:12:43.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:12:42 smithi086 bash[24289]: cluster 2024-09-16T13:12:41.375095+0000 mgr.a (mgr.14373) 19697 : cluster [DBG] pgmap v13661: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T13:12:43.585 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T13:12:43.585 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T13:12:43.585 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T13:12:44.376 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T13:12:44.376 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T13:12:44.376 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T13:12:44.377 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T13:12:44.377 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T13:12:44.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:12:44 smithi047 bash[22744]: cluster 2024-09-16T13:12:43.377281+0000 mgr.a (mgr.14373) 19698 : cluster [DBG] pgmap v13662: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T13:12:45.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:12:44 smithi157 bash[24585]: cluster 2024-09-16T13:12:43.377281+0000 mgr.a (mgr.14373) 19698 : cluster [DBG] pgmap v13662: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T13:12:45.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:12:44 smithi086 bash[24289]: cluster 2024-09-16T13:12:43.377281+0000 mgr.a (mgr.14373) 19698 : cluster [DBG] pgmap v13662: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T13:12:45.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:12:45 smithi047 bash[22744]: audit 2024-09-16T13:12:43.922002+0000 mgr.a (mgr.14373) 19699 : audit [DBG] from='client.421557 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:12:46.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:12:45 smithi157 bash[24585]: audit 2024-09-16T13:12:43.922002+0000 mgr.a (mgr.14373) 19699 : audit [DBG] from='client.421557 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:12:46.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:12:45 smithi086 bash[24289]: audit 2024-09-16T13:12:43.922002+0000 mgr.a (mgr.14373) 19699 : audit [DBG] from='client.421557 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:12:46.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:12:46 smithi047 bash[22744]: cluster 2024-09-16T13:12:45.378171+0000 mgr.a (mgr.14373) 19700 : cluster [DBG] pgmap v13663: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 5.1 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-16T13:12:47.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:12:46 smithi157 bash[24585]: cluster 2024-09-16T13:12:45.378171+0000 mgr.a (mgr.14373) 19700 : cluster [DBG] pgmap v13663: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 5.1 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-16T13:12:47.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:12:46 smithi086 bash[24289]: cluster 2024-09-16T13:12:45.378171+0000 mgr.a (mgr.14373) 19700 : cluster [DBG] pgmap v13663: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 5.1 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-16T13:12:48.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:12:48 smithi047 bash[22744]: cluster 2024-09-16T13:12:47.380427+0000 mgr.a (mgr.14373) 19701 : cluster [DBG] pgmap v13664: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 6.0 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-16T13:12:49.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:12:48 smithi157 bash[24585]: cluster 2024-09-16T13:12:47.380427+0000 mgr.a (mgr.14373) 19701 : cluster [DBG] pgmap v13664: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 6.0 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-16T13:12:49.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:12:48 smithi086 bash[24289]: cluster 2024-09-16T13:12:47.380427+0000 mgr.a (mgr.14373) 19701 : cluster [DBG] pgmap v13664: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 6.0 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-16T13:12:49.378 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T13:12:49.378 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T13:12:49.379 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T13:12:50.167 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T13:12:50.167 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T13:12:50.167 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T13:12:50.168 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T13:12:50.168 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T13:12:51.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:12:50 smithi157 bash[24585]: cluster 2024-09-16T13:12:49.381174+0000 mgr.a (mgr.14373) 19702 : cluster [DBG] pgmap v13665: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:12:51.058 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:12:50 smithi157 bash[24585]: audit 2024-09-16T13:12:49.715689+0000 mgr.a (mgr.14373) 19703 : audit [DBG] from='client.421635 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:12:51.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:12:50 smithi086 bash[24289]: cluster 2024-09-16T13:12:49.381174+0000 mgr.a (mgr.14373) 19702 : cluster [DBG] pgmap v13665: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:12:51.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:12:50 smithi086 bash[24289]: audit 2024-09-16T13:12:49.715689+0000 mgr.a (mgr.14373) 19703 : audit [DBG] from='client.421635 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:12:51.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:12:50 smithi047 bash[22744]: cluster 2024-09-16T13:12:49.381174+0000 mgr.a (mgr.14373) 19702 : cluster [DBG] pgmap v13665: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:12:51.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:12:50 smithi047 bash[22744]: audit 2024-09-16T13:12:49.715689+0000 mgr.a (mgr.14373) 19703 : audit [DBG] from='client.421635 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:12:53.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:12:52 smithi157 bash[24585]: cluster 2024-09-16T13:12:51.382051+0000 mgr.a (mgr.14373) 19704 : cluster [DBG] pgmap v13666: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:12:53.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:12:52 smithi086 bash[24289]: cluster 2024-09-16T13:12:51.382051+0000 mgr.a (mgr.14373) 19704 : cluster [DBG] pgmap v13666: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:12:53.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:12:52 smithi047 bash[22744]: cluster 2024-09-16T13:12:51.382051+0000 mgr.a (mgr.14373) 19704 : cluster [DBG] pgmap v13666: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:12:54.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:12:53 smithi047 bash[22744]: cluster 2024-09-16T13:12:53.384278+0000 mgr.a (mgr.14373) 19705 : cluster [DBG] pgmap v13667: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T13:12:54.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:12:53 smithi157 bash[24585]: cluster 2024-09-16T13:12:53.384278+0000 mgr.a (mgr.14373) 19705 : cluster [DBG] pgmap v13667: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T13:12:54.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:12:53 smithi086 bash[24289]: cluster 2024-09-16T13:12:53.384278+0000 mgr.a (mgr.14373) 19705 : cluster [DBG] pgmap v13667: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T13:12:55.169 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T13:12:55.170 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T13:12:55.170 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T13:12:55.931 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T13:12:55.931 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T13:12:55.931 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T13:12:55.931 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T13:12:55.931 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T13:12:56.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:12:56 smithi157 bash[24585]: cluster 2024-09-16T13:12:55.385035+0000 mgr.a (mgr.14373) 19706 : cluster [DBG] pgmap v13668: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:12:56.808 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:12:56 smithi157 bash[24585]: audit 2024-09-16T13:12:55.503276+0000 mgr.a (mgr.14373) 19707 : audit [DBG] from='client.421713 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:12:56.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:12:56 smithi086 bash[24289]: cluster 2024-09-16T13:12:55.385035+0000 mgr.a (mgr.14373) 19706 : cluster [DBG] pgmap v13668: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:12:56.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:12:56 smithi086 bash[24289]: audit 2024-09-16T13:12:55.503276+0000 mgr.a (mgr.14373) 19707 : audit [DBG] from='client.421713 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:12:56.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:12:56 smithi047 bash[22744]: cluster 2024-09-16T13:12:55.385035+0000 mgr.a (mgr.14373) 19706 : cluster [DBG] pgmap v13668: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:12:56.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:12:56 smithi047 bash[22744]: audit 2024-09-16T13:12:55.503276+0000 mgr.a (mgr.14373) 19707 : audit [DBG] from='client.421713 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:12:58.808 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:12:58 smithi157 bash[24585]: cluster 2024-09-16T13:12:57.387400+0000 mgr.a (mgr.14373) 19708 : cluster [DBG] pgmap v13669: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T13:12:58.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:12:58 smithi086 bash[24289]: cluster 2024-09-16T13:12:57.387400+0000 mgr.a (mgr.14373) 19708 : cluster [DBG] pgmap v13669: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T13:12:58.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:12:58 smithi047 bash[22744]: cluster 2024-09-16T13:12:57.387400+0000 mgr.a (mgr.14373) 19708 : cluster [DBG] pgmap v13669: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T13:13:00.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:13:00 smithi157 bash[24585]: cluster 2024-09-16T13:12:59.388148+0000 mgr.a (mgr.14373) 19709 : cluster [DBG] pgmap v13670: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:13:00.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:13:00 smithi086 bash[24289]: cluster 2024-09-16T13:12:59.388148+0000 mgr.a (mgr.14373) 19709 : cluster [DBG] pgmap v13670: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:13:00.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:13:00 smithi047 bash[22744]: cluster 2024-09-16T13:12:59.388148+0000 mgr.a (mgr.14373) 19709 : cluster [DBG] pgmap v13670: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:13:00.932 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T13:13:00.933 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T13:13:00.933 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T13:13:01.705 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T13:13:01.705 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T13:13:01.705 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T13:13:01.705 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T13:13:01.705 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T13:13:02.808 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:13:02 smithi157 bash[24585]: audit 2024-09-16T13:13:01.266338+0000 mgr.a (mgr.14373) 19710 : audit [DBG] from='client.421791 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:13:02.808 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:13:02 smithi157 bash[24585]: cluster 2024-09-16T13:13:01.388648+0000 mgr.a (mgr.14373) 19711 : cluster [DBG] pgmap v13671: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:13:02.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:13:02 smithi086 bash[24289]: audit 2024-09-16T13:13:01.266338+0000 mgr.a (mgr.14373) 19710 : audit [DBG] from='client.421791 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:13:02.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:13:02 smithi086 bash[24289]: cluster 2024-09-16T13:13:01.388648+0000 mgr.a (mgr.14373) 19711 : cluster [DBG] pgmap v13671: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:13:02.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:13:02 smithi047 bash[22744]: audit 2024-09-16T13:13:01.266338+0000 mgr.a (mgr.14373) 19710 : audit [DBG] from='client.421791 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:13:02.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:13:02 smithi047 bash[22744]: cluster 2024-09-16T13:13:01.388648+0000 mgr.a (mgr.14373) 19711 : cluster [DBG] pgmap v13671: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:13:04.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:13:04 smithi157 bash[24585]: cluster 2024-09-16T13:13:03.391555+0000 mgr.a (mgr.14373) 19712 : cluster [DBG] pgmap v13672: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-16T13:13:04.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:13:04 smithi086 bash[24289]: cluster 2024-09-16T13:13:03.391555+0000 mgr.a (mgr.14373) 19712 : cluster [DBG] pgmap v13672: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-16T13:13:04.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:13:04 smithi047 bash[22744]: cluster 2024-09-16T13:13:03.391555+0000 mgr.a (mgr.14373) 19712 : cluster [DBG] pgmap v13672: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-16T13:13:06.706 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T13:13:06.707 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T13:13:06.707 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T13:13:06.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:13:06 smithi157 bash[24585]: cluster 2024-09-16T13:13:05.392547+0000 mgr.a (mgr.14373) 19713 : cluster [DBG] pgmap v13673: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-16T13:13:06.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:13:06 smithi086 bash[24289]: cluster 2024-09-16T13:13:05.392547+0000 mgr.a (mgr.14373) 19713 : cluster [DBG] pgmap v13673: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-16T13:13:06.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:13:06 smithi047 bash[22744]: cluster 2024-09-16T13:13:05.392547+0000 mgr.a (mgr.14373) 19713 : cluster [DBG] pgmap v13673: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-09-16T13:13:07.489 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T13:13:07.490 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T13:13:07.490 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T13:13:07.490 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T13:13:07.490 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T13:13:08.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:13:08 smithi157 bash[24585]: audit 2024-09-16T13:13:07.040440+0000 mgr.a (mgr.14373) 19714 : audit [DBG] from='client.421863 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:13:08.808 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:13:08 smithi157 bash[24585]: cluster 2024-09-16T13:13:07.394226+0000 mgr.a (mgr.14373) 19715 : cluster [DBG] pgmap v13674: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:13:08.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:13:08 smithi086 bash[24289]: audit 2024-09-16T13:13:07.040440+0000 mgr.a (mgr.14373) 19714 : audit [DBG] from='client.421863 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:13:08.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:13:08 smithi086 bash[24289]: cluster 2024-09-16T13:13:07.394226+0000 mgr.a (mgr.14373) 19715 : cluster [DBG] pgmap v13674: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:13:08.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:13:08 smithi047 bash[22744]: audit 2024-09-16T13:13:07.040440+0000 mgr.a (mgr.14373) 19714 : audit [DBG] from='client.421863 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:13:08.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:13:08 smithi047 bash[22744]: cluster 2024-09-16T13:13:07.394226+0000 mgr.a (mgr.14373) 19715 : cluster [DBG] pgmap v13674: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:13:10.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:13:10 smithi157 bash[24585]: cluster 2024-09-16T13:13:09.394987+0000 mgr.a (mgr.14373) 19716 : cluster [DBG] pgmap v13675: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T13:13:10.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:13:10 smithi086 bash[24289]: cluster 2024-09-16T13:13:09.394987+0000 mgr.a (mgr.14373) 19716 : cluster [DBG] pgmap v13675: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T13:13:10.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:13:10 smithi047 bash[22744]: cluster 2024-09-16T13:13:09.394987+0000 mgr.a (mgr.14373) 19716 : cluster [DBG] pgmap v13675: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T13:13:12.491 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T13:13:12.491 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T13:13:12.492 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T13:13:12.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:13:12 smithi157 bash[24585]: cluster 2024-09-16T13:13:11.395737+0000 mgr.a (mgr.14373) 19717 : cluster [DBG] pgmap v13676: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T13:13:12.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:13:12 smithi086 bash[24289]: cluster 2024-09-16T13:13:11.395737+0000 mgr.a (mgr.14373) 19717 : cluster [DBG] pgmap v13676: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T13:13:12.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:13:12 smithi047 bash[22744]: cluster 2024-09-16T13:13:11.395737+0000 mgr.a (mgr.14373) 19717 : cluster [DBG] pgmap v13676: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T13:13:13.247 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T13:13:13.247 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T13:13:13.248 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T13:13:13.248 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T13:13:13.248 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T13:13:14.808 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:13:14 smithi157 bash[24585]: audit 2024-09-16T13:13:12.816118+0000 mgr.a (mgr.14373) 19718 : audit [DBG] from='client.421941 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:13:14.808 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:13:14 smithi157 bash[24585]: cluster 2024-09-16T13:13:13.398520+0000 mgr.a (mgr.14373) 19719 : cluster [DBG] pgmap v13677: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:13:14.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:13:14 smithi086 bash[24289]: audit 2024-09-16T13:13:12.816118+0000 mgr.a (mgr.14373) 19718 : audit [DBG] from='client.421941 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:13:14.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:13:14 smithi086 bash[24289]: cluster 2024-09-16T13:13:13.398520+0000 mgr.a (mgr.14373) 19719 : cluster [DBG] pgmap v13677: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:13:14.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:13:14 smithi047 bash[22744]: audit 2024-09-16T13:13:12.816118+0000 mgr.a (mgr.14373) 19718 : audit [DBG] from='client.421941 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:13:14.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:13:14 smithi047 bash[22744]: cluster 2024-09-16T13:13:13.398520+0000 mgr.a (mgr.14373) 19719 : cluster [DBG] pgmap v13677: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:13:16.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:13:16 smithi157 bash[24585]: cluster 2024-09-16T13:13:15.399256+0000 mgr.a (mgr.14373) 19720 : cluster [DBG] pgmap v13678: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-16T13:13:16.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:13:16 smithi086 bash[24289]: cluster 2024-09-16T13:13:15.399256+0000 mgr.a (mgr.14373) 19720 : cluster [DBG] pgmap v13678: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-16T13:13:16.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:13:16 smithi047 bash[22744]: cluster 2024-09-16T13:13:15.399256+0000 mgr.a (mgr.14373) 19720 : cluster [DBG] pgmap v13678: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-16T13:13:18.249 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T13:13:18.250 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T13:13:18.250 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T13:13:18.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:13:18 smithi157 bash[24585]: cluster 2024-09-16T13:13:17.401636+0000 mgr.a (mgr.14373) 19721 : cluster [DBG] pgmap v13679: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-09-16T13:13:18.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:13:18 smithi086 bash[24289]: cluster 2024-09-16T13:13:17.401636+0000 mgr.a (mgr.14373) 19721 : cluster [DBG] pgmap v13679: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-09-16T13:13:18.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:13:18 smithi047 bash[22744]: cluster 2024-09-16T13:13:17.401636+0000 mgr.a (mgr.14373) 19721 : cluster [DBG] pgmap v13679: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-09-16T13:13:19.033 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T13:13:19.033 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T13:13:19.033 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T13:13:19.033 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T13:13:19.033 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T13:13:19.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:13:19 smithi157 bash[24585]: audit 2024-09-16T13:13:18.584961+0000 mgr.a (mgr.14373) 19722 : audit [DBG] from='client.422016 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:13:19.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:13:19 smithi086 bash[24289]: audit 2024-09-16T13:13:18.584961+0000 mgr.a (mgr.14373) 19722 : audit [DBG] from='client.422016 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:13:19.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:13:19 smithi047 bash[22744]: audit 2024-09-16T13:13:18.584961+0000 mgr.a (mgr.14373) 19722 : audit [DBG] from='client.422016 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:13:20.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:13:20 smithi157 bash[24585]: cluster 2024-09-16T13:13:19.402635+0000 mgr.a (mgr.14373) 19723 : cluster [DBG] pgmap v13680: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:13:20.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:13:20 smithi086 bash[24289]: cluster 2024-09-16T13:13:19.402635+0000 mgr.a (mgr.14373) 19723 : cluster [DBG] pgmap v13680: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:13:20.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:13:20 smithi047 bash[22744]: cluster 2024-09-16T13:13:19.402635+0000 mgr.a (mgr.14373) 19723 : cluster [DBG] pgmap v13680: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:13:22.808 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:13:22 smithi157 bash[24585]: cluster 2024-09-16T13:13:21.403446+0000 mgr.a (mgr.14373) 19724 : cluster [DBG] pgmap v13681: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:13:22.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:13:22 smithi086 bash[24289]: cluster 2024-09-16T13:13:21.403446+0000 mgr.a (mgr.14373) 19724 : cluster [DBG] pgmap v13681: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:13:22.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:13:22 smithi047 bash[22744]: cluster 2024-09-16T13:13:21.403446+0000 mgr.a (mgr.14373) 19724 : cluster [DBG] pgmap v13681: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:13:24.034 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T13:13:24.035 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T13:13:24.035 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T13:13:24.787 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T13:13:24.787 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T13:13:24.787 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T13:13:24.787 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T13:13:24.787 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T13:13:24.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:13:24 smithi157 bash[24585]: cluster 2024-09-16T13:13:23.405685+0000 mgr.a (mgr.14373) 19725 : cluster [DBG] pgmap v13682: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T13:13:24.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:13:24 smithi086 bash[24289]: cluster 2024-09-16T13:13:23.405685+0000 mgr.a (mgr.14373) 19725 : cluster [DBG] pgmap v13682: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T13:13:24.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:13:24 smithi047 bash[22744]: cluster 2024-09-16T13:13:23.405685+0000 mgr.a (mgr.14373) 19725 : cluster [DBG] pgmap v13682: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T13:13:25.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:13:25 smithi157 bash[24585]: audit 2024-09-16T13:13:24.361333+0000 mgr.a (mgr.14373) 19726 : audit [DBG] from='client.422091 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:13:25.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:13:25 smithi086 bash[24289]: audit 2024-09-16T13:13:24.361333+0000 mgr.a (mgr.14373) 19726 : audit [DBG] from='client.422091 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:13:25.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:13:25 smithi047 bash[22744]: audit 2024-09-16T13:13:24.361333+0000 mgr.a (mgr.14373) 19726 : audit [DBG] from='client.422091 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:13:26.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:13:26 smithi157 bash[24585]: cluster 2024-09-16T13:13:25.406627+0000 mgr.a (mgr.14373) 19727 : cluster [DBG] pgmap v13683: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:13:26.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:13:26 smithi086 bash[24289]: cluster 2024-09-16T13:13:25.406627+0000 mgr.a (mgr.14373) 19727 : cluster [DBG] pgmap v13683: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:13:26.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:13:26 smithi047 bash[22744]: cluster 2024-09-16T13:13:25.406627+0000 mgr.a (mgr.14373) 19727 : cluster [DBG] pgmap v13683: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:13:28.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:13:28 smithi157 bash[24585]: cluster 2024-09-16T13:13:27.408884+0000 mgr.a (mgr.14373) 19728 : cluster [DBG] pgmap v13684: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T13:13:28.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:13:28 smithi086 bash[24289]: cluster 2024-09-16T13:13:27.408884+0000 mgr.a (mgr.14373) 19728 : cluster [DBG] pgmap v13684: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T13:13:28.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:13:28 smithi047 bash[22744]: cluster 2024-09-16T13:13:27.408884+0000 mgr.a (mgr.14373) 19728 : cluster [DBG] pgmap v13684: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T13:13:29.788 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T13:13:29.789 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T13:13:29.790 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T13:13:30.546 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T13:13:30.547 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T13:13:30.547 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T13:13:30.547 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T13:13:30.547 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T13:13:30.808 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:13:30 smithi157 bash[24585]: cluster 2024-09-16T13:13:29.409642+0000 mgr.a (mgr.14373) 19729 : cluster [DBG] pgmap v13685: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:13:30.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:13:30 smithi086 bash[24289]: cluster 2024-09-16T13:13:29.409642+0000 mgr.a (mgr.14373) 19729 : cluster [DBG] pgmap v13685: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:13:30.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:13:30 smithi047 bash[22744]: cluster 2024-09-16T13:13:29.409642+0000 mgr.a (mgr.14373) 19729 : cluster [DBG] pgmap v13685: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:13:31.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:13:31 smithi157 bash[24585]: audit 2024-09-16T13:13:30.120517+0000 mgr.a (mgr.14373) 19730 : audit [DBG] from='client.422166 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:13:31.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:13:31 smithi086 bash[24289]: audit 2024-09-16T13:13:30.120517+0000 mgr.a (mgr.14373) 19730 : audit [DBG] from='client.422166 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:13:31.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:13:31 smithi047 bash[22744]: audit 2024-09-16T13:13:30.120517+0000 mgr.a (mgr.14373) 19730 : audit [DBG] from='client.422166 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:13:32.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:13:32 smithi157 bash[24585]: cluster 2024-09-16T13:13:31.410579+0000 mgr.a (mgr.14373) 19731 : cluster [DBG] pgmap v13686: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:13:32.808 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:13:32 smithi157 bash[24585]: audit 2024-09-16T13:13:31.767633+0000 mon.b (mon.2) 1782 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T13:13:32.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:13:32 smithi086 bash[24289]: cluster 2024-09-16T13:13:31.410579+0000 mgr.a (mgr.14373) 19731 : cluster [DBG] pgmap v13686: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:13:32.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:13:32 smithi086 bash[24289]: audit 2024-09-16T13:13:31.767633+0000 mon.b (mon.2) 1782 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T13:13:32.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:13:32 smithi047 bash[22744]: cluster 2024-09-16T13:13:31.410579+0000 mgr.a (mgr.14373) 19731 : cluster [DBG] pgmap v13686: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:13:32.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:13:32 smithi047 bash[22744]: audit 2024-09-16T13:13:31.767633+0000 mon.b (mon.2) 1782 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T13:13:34.808 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:13:34 smithi157 bash[24585]: cluster 2024-09-16T13:13:33.412672+0000 mgr.a (mgr.14373) 19732 : cluster [DBG] pgmap v13687: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T13:13:34.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:13:34 smithi086 bash[24289]: cluster 2024-09-16T13:13:33.412672+0000 mgr.a (mgr.14373) 19732 : cluster [DBG] pgmap v13687: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T13:13:34.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:13:34 smithi047 bash[22744]: cluster 2024-09-16T13:13:33.412672+0000 mgr.a (mgr.14373) 19732 : cluster [DBG] pgmap v13687: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T13:13:35.548 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T13:13:35.549 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T13:13:35.549 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T13:13:36.315 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T13:13:36.315 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T13:13:36.315 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T13:13:36.315 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T13:13:36.315 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T13:13:36.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:13:36 smithi157 bash[24585]: cluster 2024-09-16T13:13:35.413429+0000 mgr.a (mgr.14373) 19733 : cluster [DBG] pgmap v13688: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:13:36.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:13:36 smithi086 bash[24289]: cluster 2024-09-16T13:13:35.413429+0000 mgr.a (mgr.14373) 19733 : cluster [DBG] pgmap v13688: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:13:36.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:13:36 smithi047 bash[22744]: cluster 2024-09-16T13:13:35.413429+0000 mgr.a (mgr.14373) 19733 : cluster [DBG] pgmap v13688: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:13:37.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:13:37 smithi157 bash[24585]: audit 2024-09-16T13:13:35.877809+0000 mgr.a (mgr.14373) 19734 : audit [DBG] from='client.422241 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:13:37.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:13:37 smithi086 bash[24289]: audit 2024-09-16T13:13:35.877809+0000 mgr.a (mgr.14373) 19734 : audit [DBG] from='client.422241 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:13:37.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:13:37 smithi047 bash[22744]: audit 2024-09-16T13:13:35.877809+0000 mgr.a (mgr.14373) 19734 : audit [DBG] from='client.422241 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:13:38.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:13:38 smithi086 bash[24289]: cluster 2024-09-16T13:13:37.415866+0000 mgr.a (mgr.14373) 19735 : cluster [DBG] pgmap v13689: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T13:13:38.823 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:13:38 smithi047 bash[22744]: cluster 2024-09-16T13:13:37.415866+0000 mgr.a (mgr.14373) 19735 : cluster [DBG] pgmap v13689: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T13:13:39.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:13:38 smithi157 bash[24585]: cluster 2024-09-16T13:13:37.415866+0000 mgr.a (mgr.14373) 19735 : cluster [DBG] pgmap v13689: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T13:13:40.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:13:40 smithi086 bash[24289]: cluster 2024-09-16T13:13:39.416694+0000 mgr.a (mgr.14373) 19736 : cluster [DBG] pgmap v13690: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:13:40.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:13:40 smithi047 bash[22744]: cluster 2024-09-16T13:13:39.416694+0000 mgr.a (mgr.14373) 19736 : cluster [DBG] pgmap v13690: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:13:41.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:13:40 smithi157 bash[24585]: cluster 2024-09-16T13:13:39.416694+0000 mgr.a (mgr.14373) 19736 : cluster [DBG] pgmap v13690: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:13:41.316 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T13:13:41.316 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T13:13:41.317 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T13:13:42.073 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T13:13:42.073 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T13:13:42.073 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T13:13:42.073 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T13:13:42.073 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T13:13:42.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:13:42 smithi086 bash[24289]: cluster 2024-09-16T13:13:41.417145+0000 mgr.a (mgr.14373) 19737 : cluster [DBG] pgmap v13691: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:13:42.822 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:13:42 smithi086 bash[24289]: audit 2024-09-16T13:13:41.644031+0000 mgr.a (mgr.14373) 19738 : audit [DBG] from='client.422319 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:13:42.822 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:13:42 smithi086 bash[24289]: audit 2024-09-16T13:13:42.281723+0000 mon.a (mon.0) 1741 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T13:13:42.822 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:13:42 smithi086 bash[24289]: audit 2024-09-16T13:13:42.291270+0000 mon.a (mon.0) 1742 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T13:13:42.822 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:13:42 smithi086 bash[24289]: audit 2024-09-16T13:13:42.296259+0000 mon.b (mon.2) 1783 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T13:13:42.822 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:13:42 smithi086 bash[24289]: audit 2024-09-16T13:13:42.298640+0000 mon.b (mon.2) 1784 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T13:13:42.822 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:13:42 smithi086 bash[24289]: audit 2024-09-16T13:13:42.309273+0000 mon.a (mon.0) 1743 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T13:13:42.822 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:13:42 smithi086 bash[24289]: audit 2024-09-16T13:13:42.315486+0000 mon.b (mon.2) 1785 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T13:13:42.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:13:42 smithi047 bash[22744]: cluster 2024-09-16T13:13:41.417145+0000 mgr.a (mgr.14373) 19737 : cluster [DBG] pgmap v13691: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:13:42.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:13:42 smithi047 bash[22744]: audit 2024-09-16T13:13:41.644031+0000 mgr.a (mgr.14373) 19738 : audit [DBG] from='client.422319 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:13:42.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:13:42 smithi047 bash[22744]: audit 2024-09-16T13:13:42.281723+0000 mon.a (mon.0) 1741 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T13:13:42.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:13:42 smithi047 bash[22744]: audit 2024-09-16T13:13:42.291270+0000 mon.a (mon.0) 1742 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T13:13:42.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:13:42 smithi047 bash[22744]: audit 2024-09-16T13:13:42.296259+0000 mon.b (mon.2) 1783 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T13:13:42.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:13:42 smithi047 bash[22744]: audit 2024-09-16T13:13:42.298640+0000 mon.b (mon.2) 1784 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T13:13:42.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:13:42 smithi047 bash[22744]: audit 2024-09-16T13:13:42.309273+0000 mon.a (mon.0) 1743 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T13:13:42.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:13:42 smithi047 bash[22744]: audit 2024-09-16T13:13:42.315486+0000 mon.b (mon.2) 1785 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T13:13:43.058 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:13:42 smithi157 bash[24585]: cluster 2024-09-16T13:13:41.417145+0000 mgr.a (mgr.14373) 19737 : cluster [DBG] pgmap v13691: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:13:43.058 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:13:42 smithi157 bash[24585]: audit 2024-09-16T13:13:41.644031+0000 mgr.a (mgr.14373) 19738 : audit [DBG] from='client.422319 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:13:43.058 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:13:42 smithi157 bash[24585]: audit 2024-09-16T13:13:42.281723+0000 mon.a (mon.0) 1741 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T13:13:43.058 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:13:42 smithi157 bash[24585]: audit 2024-09-16T13:13:42.291270+0000 mon.a (mon.0) 1742 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T13:13:43.058 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:13:42 smithi157 bash[24585]: audit 2024-09-16T13:13:42.296259+0000 mon.b (mon.2) 1783 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T13:13:43.058 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:13:42 smithi157 bash[24585]: audit 2024-09-16T13:13:42.298640+0000 mon.b (mon.2) 1784 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T13:13:43.058 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:13:42 smithi157 bash[24585]: audit 2024-09-16T13:13:42.309273+0000 mon.a (mon.0) 1743 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T13:13:43.058 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:13:42 smithi157 bash[24585]: audit 2024-09-16T13:13:42.315486+0000 mon.b (mon.2) 1785 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T13:13:43.343 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 13:13:43 smithi047 bash[22994]: debug 2024-09-16T13:13:43.057+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T13:13:43.343 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 13:13:43 smithi047 bash[22994]: debug 2024-09-16T13:13:43.057+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T13:13:43.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:13:43 smithi047 bash[22744]: audit 2024-09-16T13:13:42.318423+0000 mgr.a (mgr.14373) 19739 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T13:13:44.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:13:43 smithi157 bash[24585]: audit 2024-09-16T13:13:42.318423+0000 mgr.a (mgr.14373) 19739 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T13:13:44.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:13:43 smithi086 bash[24289]: audit 2024-09-16T13:13:42.318423+0000 mgr.a (mgr.14373) 19739 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T13:13:44.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:13:44 smithi047 bash[22744]: audit 2024-09-16T13:13:43.058383+0000 mgr.a (mgr.14373) 19740 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T13:13:44.844 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:13:44 smithi047 bash[22744]: cephadm 2024-09-16T13:13:43.061204+0000 mgr.a (mgr.14373) 19741 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T13:13:44.844 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:13:44 smithi047 bash[22744]: cluster 2024-09-16T13:13:43.419779+0000 mgr.a (mgr.14373) 19742 : cluster [DBG] pgmap v13692: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:13:45.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:13:44 smithi157 bash[24585]: audit 2024-09-16T13:13:43.058383+0000 mgr.a (mgr.14373) 19740 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T13:13:45.058 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:13:44 smithi157 bash[24585]: cephadm 2024-09-16T13:13:43.061204+0000 mgr.a (mgr.14373) 19741 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T13:13:45.058 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:13:44 smithi157 bash[24585]: cluster 2024-09-16T13:13:43.419779+0000 mgr.a (mgr.14373) 19742 : cluster [DBG] pgmap v13692: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:13:45.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:13:44 smithi086 bash[24289]: audit 2024-09-16T13:13:43.058383+0000 mgr.a (mgr.14373) 19740 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T13:13:45.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:13:44 smithi086 bash[24289]: cephadm 2024-09-16T13:13:43.061204+0000 mgr.a (mgr.14373) 19741 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T13:13:45.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:13:44 smithi086 bash[24289]: cluster 2024-09-16T13:13:43.419779+0000 mgr.a (mgr.14373) 19742 : cluster [DBG] pgmap v13692: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:13:46.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:13:46 smithi047 bash[22744]: cluster 2024-09-16T13:13:45.420589+0000 mgr.a (mgr.14373) 19743 : cluster [DBG] pgmap v13693: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T13:13:47.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:13:46 smithi157 bash[24585]: cluster 2024-09-16T13:13:45.420589+0000 mgr.a (mgr.14373) 19743 : cluster [DBG] pgmap v13693: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T13:13:47.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:13:46 smithi086 bash[24289]: cluster 2024-09-16T13:13:45.420589+0000 mgr.a (mgr.14373) 19743 : cluster [DBG] pgmap v13693: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T13:13:47.074 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T13:13:47.075 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T13:13:47.075 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T13:13:47.864 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T13:13:47.865 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T13:13:47.865 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T13:13:47.865 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T13:13:47.865 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T13:13:48.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:13:48 smithi047 bash[22744]: audit 2024-09-16T13:13:47.412082+0000 mgr.a (mgr.14373) 19744 : audit [DBG] from='client.422505 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:13:48.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:13:48 smithi047 bash[22744]: cluster 2024-09-16T13:13:47.429980+0000 mgr.a (mgr.14373) 19745 : cluster [DBG] pgmap v13694: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T13:13:49.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:13:48 smithi157 bash[24585]: audit 2024-09-16T13:13:47.412082+0000 mgr.a (mgr.14373) 19744 : audit [DBG] from='client.422505 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:13:49.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:13:48 smithi157 bash[24585]: cluster 2024-09-16T13:13:47.429980+0000 mgr.a (mgr.14373) 19745 : cluster [DBG] pgmap v13694: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T13:13:49.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:13:48 smithi086 bash[24289]: audit 2024-09-16T13:13:47.412082+0000 mgr.a (mgr.14373) 19744 : audit [DBG] from='client.422505 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:13:49.072 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:13:48 smithi086 bash[24289]: cluster 2024-09-16T13:13:47.429980+0000 mgr.a (mgr.14373) 19745 : cluster [DBG] pgmap v13694: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T13:13:50.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:13:50 smithi047 bash[22744]: cluster 2024-09-16T13:13:49.430894+0000 mgr.a (mgr.14373) 19746 : cluster [DBG] pgmap v13695: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T13:13:51.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:13:50 smithi157 bash[24585]: cluster 2024-09-16T13:13:49.430894+0000 mgr.a (mgr.14373) 19746 : cluster [DBG] pgmap v13695: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T13:13:51.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:13:50 smithi086 bash[24289]: cluster 2024-09-16T13:13:49.430894+0000 mgr.a (mgr.14373) 19746 : cluster [DBG] pgmap v13695: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T13:13:52.866 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T13:13:52.867 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T13:13:52.867 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T13:13:53.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:13:52 smithi157 bash[24585]: cluster 2024-09-16T13:13:51.431686+0000 mgr.a (mgr.14373) 19747 : cluster [DBG] pgmap v13696: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T13:13:53.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:13:52 smithi086 bash[24289]: cluster 2024-09-16T13:13:51.431686+0000 mgr.a (mgr.14373) 19747 : cluster [DBG] pgmap v13696: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T13:13:53.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:13:52 smithi047 bash[22744]: cluster 2024-09-16T13:13:51.431686+0000 mgr.a (mgr.14373) 19747 : cluster [DBG] pgmap v13696: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T13:13:53.654 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T13:13:53.654 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T13:13:53.654 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T13:13:53.654 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T13:13:53.654 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T13:13:55.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:13:54 smithi157 bash[24585]: audit 2024-09-16T13:13:53.206220+0000 mgr.a (mgr.14373) 19748 : audit [DBG] from='client.422580 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:13:55.058 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:13:54 smithi157 bash[24585]: cluster 2024-09-16T13:13:53.433231+0000 mgr.a (mgr.14373) 19749 : cluster [DBG] pgmap v13697: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T13:13:55.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:13:54 smithi086 bash[24289]: audit 2024-09-16T13:13:53.206220+0000 mgr.a (mgr.14373) 19748 : audit [DBG] from='client.422580 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:13:55.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:13:54 smithi086 bash[24289]: cluster 2024-09-16T13:13:53.433231+0000 mgr.a (mgr.14373) 19749 : cluster [DBG] pgmap v13697: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T13:13:55.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:13:54 smithi047 bash[22744]: audit 2024-09-16T13:13:53.206220+0000 mgr.a (mgr.14373) 19748 : audit [DBG] from='client.422580 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:13:55.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:13:54 smithi047 bash[22744]: cluster 2024-09-16T13:13:53.433231+0000 mgr.a (mgr.14373) 19749 : cluster [DBG] pgmap v13697: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T13:13:57.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:13:56 smithi157 bash[24585]: cluster 2024-09-16T13:13:55.434095+0000 mgr.a (mgr.14373) 19750 : cluster [DBG] pgmap v13698: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T13:13:57.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:13:56 smithi086 bash[24289]: cluster 2024-09-16T13:13:55.434095+0000 mgr.a (mgr.14373) 19750 : cluster [DBG] pgmap v13698: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T13:13:57.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:13:56 smithi047 bash[22744]: cluster 2024-09-16T13:13:55.434095+0000 mgr.a (mgr.14373) 19750 : cluster [DBG] pgmap v13698: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T13:13:58.655 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T13:13:58.656 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T13:13:58.656 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T13:13:59.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:13:58 smithi157 bash[24585]: cluster 2024-09-16T13:13:57.436349+0000 mgr.a (mgr.14373) 19751 : cluster [DBG] pgmap v13699: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T13:13:59.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:13:58 smithi086 bash[24289]: cluster 2024-09-16T13:13:57.436349+0000 mgr.a (mgr.14373) 19751 : cluster [DBG] pgmap v13699: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T13:13:59.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:13:58 smithi047 bash[22744]: cluster 2024-09-16T13:13:57.436349+0000 mgr.a (mgr.14373) 19751 : cluster [DBG] pgmap v13699: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T13:13:59.424 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T13:13:59.425 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T13:13:59.425 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T13:13:59.425 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T13:13:59.425 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T13:14:01.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:14:00 smithi157 bash[24585]: audit 2024-09-16T13:13:58.986377+0000 mgr.a (mgr.14373) 19752 : audit [DBG] from='client.422655 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:14:01.058 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:14:00 smithi157 bash[24585]: cluster 2024-09-16T13:13:59.437018+0000 mgr.a (mgr.14373) 19753 : cluster [DBG] pgmap v13700: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:14:01.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:14:00 smithi086 bash[24289]: audit 2024-09-16T13:13:58.986377+0000 mgr.a (mgr.14373) 19752 : audit [DBG] from='client.422655 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:14:01.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:14:00 smithi086 bash[24289]: cluster 2024-09-16T13:13:59.437018+0000 mgr.a (mgr.14373) 19753 : cluster [DBG] pgmap v13700: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:14:01.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:14:00 smithi047 bash[22744]: audit 2024-09-16T13:13:58.986377+0000 mgr.a (mgr.14373) 19752 : audit [DBG] from='client.422655 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:14:01.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:14:00 smithi047 bash[22744]: cluster 2024-09-16T13:13:59.437018+0000 mgr.a (mgr.14373) 19753 : cluster [DBG] pgmap v13700: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:14:03.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:14:02 smithi157 bash[24585]: cluster 2024-09-16T13:14:01.437742+0000 mgr.a (mgr.14373) 19754 : cluster [DBG] pgmap v13701: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:14:03.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:14:02 smithi086 bash[24289]: cluster 2024-09-16T13:14:01.437742+0000 mgr.a (mgr.14373) 19754 : cluster [DBG] pgmap v13701: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:14:03.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:14:02 smithi047 bash[22744]: cluster 2024-09-16T13:14:01.437742+0000 mgr.a (mgr.14373) 19754 : cluster [DBG] pgmap v13701: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:14:04.426 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T13:14:04.427 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T13:14:04.427 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T13:14:05.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:14:04 smithi157 bash[24585]: cluster 2024-09-16T13:14:03.440011+0000 mgr.a (mgr.14373) 19755 : cluster [DBG] pgmap v13702: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T13:14:05.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:14:04 smithi086 bash[24289]: cluster 2024-09-16T13:14:03.440011+0000 mgr.a (mgr.14373) 19755 : cluster [DBG] pgmap v13702: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T13:14:05.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:14:04 smithi047 bash[22744]: cluster 2024-09-16T13:14:03.440011+0000 mgr.a (mgr.14373) 19755 : cluster [DBG] pgmap v13702: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T13:14:05.216 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T13:14:05.216 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T13:14:05.216 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T13:14:05.216 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T13:14:05.216 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T13:14:06.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:14:05 smithi157 bash[24585]: audit 2024-09-16T13:14:04.761711+0000 mgr.a (mgr.14373) 19756 : audit [DBG] from='client.422733 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:14:06.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:14:05 smithi086 bash[24289]: audit 2024-09-16T13:14:04.761711+0000 mgr.a (mgr.14373) 19756 : audit [DBG] from='client.422733 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:14:06.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:14:05 smithi047 bash[22744]: audit 2024-09-16T13:14:04.761711+0000 mgr.a (mgr.14373) 19756 : audit [DBG] from='client.422733 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:14:07.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:14:06 smithi157 bash[24585]: cluster 2024-09-16T13:14:05.441021+0000 mgr.a (mgr.14373) 19757 : cluster [DBG] pgmap v13703: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:14:07.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:14:06 smithi086 bash[24289]: cluster 2024-09-16T13:14:05.441021+0000 mgr.a (mgr.14373) 19757 : cluster [DBG] pgmap v13703: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:14:07.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:14:06 smithi047 bash[22744]: cluster 2024-09-16T13:14:05.441021+0000 mgr.a (mgr.14373) 19757 : cluster [DBG] pgmap v13703: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:14:09.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:14:08 smithi157 bash[24585]: cluster 2024-09-16T13:14:07.443318+0000 mgr.a (mgr.14373) 19758 : cluster [DBG] pgmap v13704: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T13:14:09.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:14:08 smithi086 bash[24289]: cluster 2024-09-16T13:14:07.443318+0000 mgr.a (mgr.14373) 19758 : cluster [DBG] pgmap v13704: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T13:14:09.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:14:08 smithi047 bash[22744]: cluster 2024-09-16T13:14:07.443318+0000 mgr.a (mgr.14373) 19758 : cluster [DBG] pgmap v13704: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T13:14:10.218 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T13:14:10.218 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T13:14:10.218 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T13:14:10.961 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T13:14:10.964 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T13:14:10.964 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T13:14:10.964 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T13:14:10.964 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T13:14:11.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:14:10 smithi157 bash[24585]: cluster 2024-09-16T13:14:09.444100+0000 mgr.a (mgr.14373) 19759 : cluster [DBG] pgmap v13705: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:14:11.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:14:10 smithi086 bash[24289]: cluster 2024-09-16T13:14:09.444100+0000 mgr.a (mgr.14373) 19759 : cluster [DBG] pgmap v13705: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:14:11.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:14:10 smithi047 bash[22744]: cluster 2024-09-16T13:14:09.444100+0000 mgr.a (mgr.14373) 19759 : cluster [DBG] pgmap v13705: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:14:12.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:14:11 smithi157 bash[24585]: audit 2024-09-16T13:14:10.543133+0000 mgr.a (mgr.14373) 19760 : audit [DBG] from='client.422808 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:14:12.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:14:11 smithi086 bash[24289]: audit 2024-09-16T13:14:10.543133+0000 mgr.a (mgr.14373) 19760 : audit [DBG] from='client.422808 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:14:12.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:14:11 smithi047 bash[22744]: audit 2024-09-16T13:14:10.543133+0000 mgr.a (mgr.14373) 19760 : audit [DBG] from='client.422808 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:14:13.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:14:12 smithi157 bash[24585]: cluster 2024-09-16T13:14:11.445002+0000 mgr.a (mgr.14373) 19761 : cluster [DBG] pgmap v13706: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:14:13.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:14:12 smithi086 bash[24289]: cluster 2024-09-16T13:14:11.445002+0000 mgr.a (mgr.14373) 19761 : cluster [DBG] pgmap v13706: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:14:13.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:14:12 smithi047 bash[22744]: cluster 2024-09-16T13:14:11.445002+0000 mgr.a (mgr.14373) 19761 : cluster [DBG] pgmap v13706: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:14:15.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:14:14 smithi157 bash[24585]: cluster 2024-09-16T13:14:13.447328+0000 mgr.a (mgr.14373) 19762 : cluster [DBG] pgmap v13707: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T13:14:15.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:14:14 smithi086 bash[24289]: cluster 2024-09-16T13:14:13.447328+0000 mgr.a (mgr.14373) 19762 : cluster [DBG] pgmap v13707: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T13:14:15.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:14:14 smithi047 bash[22744]: cluster 2024-09-16T13:14:13.447328+0000 mgr.a (mgr.14373) 19762 : cluster [DBG] pgmap v13707: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T13:14:15.962 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T13:14:15.963 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T13:14:15.963 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T13:14:16.722 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T13:14:16.722 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T13:14:16.722 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T13:14:16.722 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T13:14:16.722 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T13:14:17.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:14:16 smithi157 bash[24585]: cluster 2024-09-16T13:14:15.448102+0000 mgr.a (mgr.14373) 19763 : cluster [DBG] pgmap v13708: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:14:17.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:14:16 smithi086 bash[24289]: cluster 2024-09-16T13:14:15.448102+0000 mgr.a (mgr.14373) 19763 : cluster [DBG] pgmap v13708: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:14:17.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:14:16 smithi047 bash[22744]: cluster 2024-09-16T13:14:15.448102+0000 mgr.a (mgr.14373) 19763 : cluster [DBG] pgmap v13708: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:14:18.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:14:17 smithi157 bash[24585]: audit 2024-09-16T13:14:16.289481+0000 mgr.a (mgr.14373) 19764 : audit [DBG] from='client.422886 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:14:18.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:14:17 smithi086 bash[24289]: audit 2024-09-16T13:14:16.289481+0000 mgr.a (mgr.14373) 19764 : audit [DBG] from='client.422886 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:14:18.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:14:17 smithi047 bash[22744]: audit 2024-09-16T13:14:16.289481+0000 mgr.a (mgr.14373) 19764 : audit [DBG] from='client.422886 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:14:19.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:14:18 smithi157 bash[24585]: cluster 2024-09-16T13:14:17.450928+0000 mgr.a (mgr.14373) 19765 : cluster [DBG] pgmap v13709: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:14:19.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:14:18 smithi086 bash[24289]: cluster 2024-09-16T13:14:17.450928+0000 mgr.a (mgr.14373) 19765 : cluster [DBG] pgmap v13709: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:14:19.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:14:18 smithi047 bash[22744]: cluster 2024-09-16T13:14:17.450928+0000 mgr.a (mgr.14373) 19765 : cluster [DBG] pgmap v13709: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:14:21.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:14:20 smithi157 bash[24585]: cluster 2024-09-16T13:14:19.451712+0000 mgr.a (mgr.14373) 19766 : cluster [DBG] pgmap v13710: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T13:14:21.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:14:20 smithi086 bash[24289]: cluster 2024-09-16T13:14:19.451712+0000 mgr.a (mgr.14373) 19766 : cluster [DBG] pgmap v13710: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T13:14:21.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:14:20 smithi047 bash[22744]: cluster 2024-09-16T13:14:19.451712+0000 mgr.a (mgr.14373) 19766 : cluster [DBG] pgmap v13710: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T13:14:21.723 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T13:14:21.724 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T13:14:21.724 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T13:14:22.466 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T13:14:22.466 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T13:14:22.466 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T13:14:22.466 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T13:14:22.467 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T13:14:23.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:14:22 smithi157 bash[24585]: cluster 2024-09-16T13:14:21.452896+0000 mgr.a (mgr.14373) 19767 : cluster [DBG] pgmap v13711: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-16T13:14:23.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:14:22 smithi086 bash[24289]: cluster 2024-09-16T13:14:21.452896+0000 mgr.a (mgr.14373) 19767 : cluster [DBG] pgmap v13711: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-16T13:14:23.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:14:22 smithi047 bash[22744]: cluster 2024-09-16T13:14:21.452896+0000 mgr.a (mgr.14373) 19767 : cluster [DBG] pgmap v13711: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-16T13:14:24.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:14:23 smithi157 bash[24585]: audit 2024-09-16T13:14:22.048276+0000 mgr.a (mgr.14373) 19768 : audit [DBG] from='client.422964 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:14:24.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:14:23 smithi086 bash[24289]: audit 2024-09-16T13:14:22.048276+0000 mgr.a (mgr.14373) 19768 : audit [DBG] from='client.422964 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:14:24.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:14:23 smithi047 bash[22744]: audit 2024-09-16T13:14:22.048276+0000 mgr.a (mgr.14373) 19768 : audit [DBG] from='client.422964 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:14:25.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:14:24 smithi157 bash[24585]: cluster 2024-09-16T13:14:23.455211+0000 mgr.a (mgr.14373) 19769 : cluster [DBG] pgmap v13712: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:14:25.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:14:24 smithi086 bash[24289]: cluster 2024-09-16T13:14:23.455211+0000 mgr.a (mgr.14373) 19769 : cluster [DBG] pgmap v13712: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:14:25.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:14:24 smithi047 bash[22744]: cluster 2024-09-16T13:14:23.455211+0000 mgr.a (mgr.14373) 19769 : cluster [DBG] pgmap v13712: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:14:27.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:14:26 smithi157 bash[24585]: cluster 2024-09-16T13:14:25.456001+0000 mgr.a (mgr.14373) 19770 : cluster [DBG] pgmap v13713: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T13:14:27.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:14:26 smithi086 bash[24289]: cluster 2024-09-16T13:14:25.456001+0000 mgr.a (mgr.14373) 19770 : cluster [DBG] pgmap v13713: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T13:14:27.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:14:26 smithi047 bash[22744]: cluster 2024-09-16T13:14:25.456001+0000 mgr.a (mgr.14373) 19770 : cluster [DBG] pgmap v13713: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T13:14:27.468 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T13:14:27.469 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T13:14:27.469 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T13:14:28.219 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T13:14:28.220 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T13:14:28.220 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T13:14:28.220 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T13:14:28.220 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T13:14:29.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:14:28 smithi157 bash[24585]: cluster 2024-09-16T13:14:27.458040+0000 mgr.a (mgr.14373) 19771 : cluster [DBG] pgmap v13714: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:14:29.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:14:28 smithi086 bash[24289]: cluster 2024-09-16T13:14:27.458040+0000 mgr.a (mgr.14373) 19771 : cluster [DBG] pgmap v13714: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:14:29.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:14:28 smithi047 bash[22744]: cluster 2024-09-16T13:14:27.458040+0000 mgr.a (mgr.14373) 19771 : cluster [DBG] pgmap v13714: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:14:30.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:14:29 smithi157 bash[24585]: audit 2024-09-16T13:14:27.800145+0000 mgr.a (mgr.14373) 19772 : audit [DBG] from='client.423042 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:14:30.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:14:29 smithi086 bash[24289]: audit 2024-09-16T13:14:27.800145+0000 mgr.a (mgr.14373) 19772 : audit [DBG] from='client.423042 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:14:30.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:14:29 smithi047 bash[22744]: audit 2024-09-16T13:14:27.800145+0000 mgr.a (mgr.14373) 19772 : audit [DBG] from='client.423042 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:14:31.058 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:14:30 smithi157 bash[24585]: cluster 2024-09-16T13:14:29.458964+0000 mgr.a (mgr.14373) 19773 : cluster [DBG] pgmap v13715: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:14:31.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:14:30 smithi086 bash[24289]: cluster 2024-09-16T13:14:29.458964+0000 mgr.a (mgr.14373) 19773 : cluster [DBG] pgmap v13715: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:14:31.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:14:30 smithi047 bash[22744]: cluster 2024-09-16T13:14:29.458964+0000 mgr.a (mgr.14373) 19773 : cluster [DBG] pgmap v13715: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:14:33.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:14:32 smithi157 bash[24585]: cluster 2024-09-16T13:14:31.460499+0000 mgr.a (mgr.14373) 19774 : cluster [DBG] pgmap v13716: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-16T13:14:33.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:14:32 smithi086 bash[24289]: cluster 2024-09-16T13:14:31.460499+0000 mgr.a (mgr.14373) 19774 : cluster [DBG] pgmap v13716: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-16T13:14:33.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:14:32 smithi047 bash[22744]: cluster 2024-09-16T13:14:31.460499+0000 mgr.a (mgr.14373) 19774 : cluster [DBG] pgmap v13716: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-16T13:14:33.221 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T13:14:33.221 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T13:14:33.222 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T13:14:34.002 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T13:14:34.002 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T13:14:34.002 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T13:14:34.002 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T13:14:34.003 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T13:14:35.058 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:14:34 smithi157 bash[24585]: cluster 2024-09-16T13:14:33.462139+0000 mgr.a (mgr.14373) 19775 : cluster [DBG] pgmap v13717: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T13:14:35.058 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:14:34 smithi157 bash[24585]: audit 2024-09-16T13:14:33.553869+0000 mgr.a (mgr.14373) 19776 : audit [DBG] from='client.423120 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:14:35.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:14:34 smithi086 bash[24289]: cluster 2024-09-16T13:14:33.462139+0000 mgr.a (mgr.14373) 19775 : cluster [DBG] pgmap v13717: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T13:14:35.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:14:34 smithi086 bash[24289]: audit 2024-09-16T13:14:33.553869+0000 mgr.a (mgr.14373) 19776 : audit [DBG] from='client.423120 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:14:35.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:14:34 smithi047 bash[22744]: cluster 2024-09-16T13:14:33.462139+0000 mgr.a (mgr.14373) 19775 : cluster [DBG] pgmap v13717: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T13:14:35.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:14:34 smithi047 bash[22744]: audit 2024-09-16T13:14:33.553869+0000 mgr.a (mgr.14373) 19776 : audit [DBG] from='client.423120 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:14:37.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:14:36 smithi157 bash[24585]: cluster 2024-09-16T13:14:35.463103+0000 mgr.a (mgr.14373) 19777 : cluster [DBG] pgmap v13718: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:14:37.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:14:36 smithi086 bash[24289]: cluster 2024-09-16T13:14:35.463103+0000 mgr.a (mgr.14373) 19777 : cluster [DBG] pgmap v13718: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:14:37.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:14:36 smithi047 bash[22744]: cluster 2024-09-16T13:14:35.463103+0000 mgr.a (mgr.14373) 19777 : cluster [DBG] pgmap v13718: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:14:39.004 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T13:14:39.004 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T13:14:39.004 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T13:14:39.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:14:38 smithi157 bash[24585]: cluster 2024-09-16T13:14:37.465652+0000 mgr.a (mgr.14373) 19778 : cluster [DBG] pgmap v13719: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T13:14:39.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:14:38 smithi086 bash[24289]: cluster 2024-09-16T13:14:37.465652+0000 mgr.a (mgr.14373) 19778 : cluster [DBG] pgmap v13719: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T13:14:39.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:14:38 smithi047 bash[22744]: cluster 2024-09-16T13:14:37.465652+0000 mgr.a (mgr.14373) 19778 : cluster [DBG] pgmap v13719: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T13:14:39.795 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T13:14:39.795 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T13:14:39.795 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T13:14:39.795 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T13:14:39.795 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T13:14:41.060 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:14:40 smithi157 bash[24585]: audit 2024-09-16T13:14:39.342845+0000 mgr.a (mgr.14373) 19779 : audit [DBG] from='client.423195 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:14:41.060 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:14:40 smithi157 bash[24585]: cluster 2024-09-16T13:14:39.466251+0000 mgr.a (mgr.14373) 19780 : cluster [DBG] pgmap v13720: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:14:41.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:14:40 smithi086 bash[24289]: audit 2024-09-16T13:14:39.342845+0000 mgr.a (mgr.14373) 19779 : audit [DBG] from='client.423195 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:14:41.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:14:40 smithi086 bash[24289]: cluster 2024-09-16T13:14:39.466251+0000 mgr.a (mgr.14373) 19780 : cluster [DBG] pgmap v13720: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:14:41.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:14:40 smithi047 bash[22744]: audit 2024-09-16T13:14:39.342845+0000 mgr.a (mgr.14373) 19779 : audit [DBG] from='client.423195 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:14:41.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:14:40 smithi047 bash[22744]: cluster 2024-09-16T13:14:39.466251+0000 mgr.a (mgr.14373) 19780 : cluster [DBG] pgmap v13720: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:14:43.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:14:42 smithi157 bash[24585]: cluster 2024-09-16T13:14:41.467728+0000 mgr.a (mgr.14373) 19781 : cluster [DBG] pgmap v13721: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-16T13:14:43.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:14:42 smithi086 bash[24289]: cluster 2024-09-16T13:14:41.467728+0000 mgr.a (mgr.14373) 19781 : cluster [DBG] pgmap v13721: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-16T13:14:43.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:14:42 smithi047 bash[22744]: cluster 2024-09-16T13:14:41.467728+0000 mgr.a (mgr.14373) 19781 : cluster [DBG] pgmap v13721: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-16T13:14:44.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:14:43 smithi157 bash[24585]: audit 2024-09-16T13:14:43.147249+0000 mon.b (mon.2) 1786 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T13:14:44.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:14:43 smithi086 bash[24289]: audit 2024-09-16T13:14:43.147249+0000 mon.b (mon.2) 1786 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T13:14:44.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:14:43 smithi047 bash[22744]: audit 2024-09-16T13:14:43.147249+0000 mon.b (mon.2) 1786 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T13:14:44.796 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T13:14:44.797 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T13:14:44.797 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T13:14:45.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:14:44 smithi157 bash[24585]: cluster 2024-09-16T13:14:43.469365+0000 mgr.a (mgr.14373) 19782 : cluster [DBG] pgmap v13722: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T13:14:45.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:14:44 smithi086 bash[24289]: cluster 2024-09-16T13:14:43.469365+0000 mgr.a (mgr.14373) 19782 : cluster [DBG] pgmap v13722: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T13:14:45.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:14:44 smithi047 bash[22744]: cluster 2024-09-16T13:14:43.469365+0000 mgr.a (mgr.14373) 19782 : cluster [DBG] pgmap v13722: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T13:14:45.547 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T13:14:45.548 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T13:14:45.548 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T13:14:45.548 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T13:14:45.548 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T13:14:47.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:14:46 smithi157 bash[24585]: audit 2024-09-16T13:14:45.123298+0000 mgr.a (mgr.14373) 19783 : audit [DBG] from='client.423273 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:14:47.058 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:14:46 smithi157 bash[24585]: cluster 2024-09-16T13:14:45.469902+0000 mgr.a (mgr.14373) 19784 : cluster [DBG] pgmap v13723: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:14:47.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:14:46 smithi086 bash[24289]: audit 2024-09-16T13:14:45.123298+0000 mgr.a (mgr.14373) 19783 : audit [DBG] from='client.423273 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:14:47.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:14:46 smithi086 bash[24289]: cluster 2024-09-16T13:14:45.469902+0000 mgr.a (mgr.14373) 19784 : cluster [DBG] pgmap v13723: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:14:47.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:14:46 smithi047 bash[22744]: audit 2024-09-16T13:14:45.123298+0000 mgr.a (mgr.14373) 19783 : audit [DBG] from='client.423273 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:14:47.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:14:46 smithi047 bash[22744]: cluster 2024-09-16T13:14:45.469902+0000 mgr.a (mgr.14373) 19784 : cluster [DBG] pgmap v13723: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:14:49.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:14:48 smithi157 bash[24585]: cluster 2024-09-16T13:14:47.472162+0000 mgr.a (mgr.14373) 19785 : cluster [DBG] pgmap v13724: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T13:14:49.063 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:14:48 smithi086 bash[24289]: cluster 2024-09-16T13:14:47.472162+0000 mgr.a (mgr.14373) 19785 : cluster [DBG] pgmap v13724: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T13:14:49.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:14:48 smithi047 bash[22744]: cluster 2024-09-16T13:14:47.472162+0000 mgr.a (mgr.14373) 19785 : cluster [DBG] pgmap v13724: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T13:14:50.549 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T13:14:50.550 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T13:14:50.550 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T13:14:51.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:14:50 smithi157 bash[24585]: cluster 2024-09-16T13:14:49.472937+0000 mgr.a (mgr.14373) 19786 : cluster [DBG] pgmap v13725: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:14:51.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:14:50 smithi086 bash[24289]: cluster 2024-09-16T13:14:49.472937+0000 mgr.a (mgr.14373) 19786 : cluster [DBG] pgmap v13725: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:14:51.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:14:50 smithi047 bash[22744]: cluster 2024-09-16T13:14:49.472937+0000 mgr.a (mgr.14373) 19786 : cluster [DBG] pgmap v13725: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:14:51.291 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T13:14:51.292 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T13:14:51.292 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T13:14:51.292 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T13:14:51.292 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T13:14:53.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:14:52 smithi157 bash[24585]: audit 2024-09-16T13:14:50.878777+0000 mgr.a (mgr.14373) 19787 : audit [DBG] from='client.423351 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:14:53.058 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:14:52 smithi157 bash[24585]: cluster 2024-09-16T13:14:51.474499+0000 mgr.a (mgr.14373) 19788 : cluster [DBG] pgmap v13726: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-16T13:14:53.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:14:52 smithi086 bash[24289]: audit 2024-09-16T13:14:50.878777+0000 mgr.a (mgr.14373) 19787 : audit [DBG] from='client.423351 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:14:53.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:14:52 smithi086 bash[24289]: cluster 2024-09-16T13:14:51.474499+0000 mgr.a (mgr.14373) 19788 : cluster [DBG] pgmap v13726: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-16T13:14:53.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:14:52 smithi047 bash[22744]: audit 2024-09-16T13:14:50.878777+0000 mgr.a (mgr.14373) 19787 : audit [DBG] from='client.423351 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:14:53.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:14:52 smithi047 bash[22744]: cluster 2024-09-16T13:14:51.474499+0000 mgr.a (mgr.14373) 19788 : cluster [DBG] pgmap v13726: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-16T13:14:54.593 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 13:14:54 smithi047 bash[22994]: debug 2024-09-16T13:14:54.268+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T13:14:54.593 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 13:14:54 smithi047 bash[22994]: debug 2024-09-16T13:14:54.268+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T13:14:54.594 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:14:54 smithi047 bash[22744]: audit 2024-09-16T13:14:53.452205+0000 mon.a (mon.0) 1744 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T13:14:54.594 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:14:54 smithi047 bash[22744]: audit 2024-09-16T13:14:53.463345+0000 mon.a (mon.0) 1745 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T13:14:54.594 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:14:54 smithi047 bash[22744]: audit 2024-09-16T13:14:53.466565+0000 mon.b (mon.2) 1787 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T13:14:54.594 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:14:54 smithi047 bash[22744]: audit 2024-09-16T13:14:53.468931+0000 mon.b (mon.2) 1788 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T13:14:54.594 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:14:54 smithi047 bash[22744]: cluster 2024-09-16T13:14:53.476301+0000 mgr.a (mgr.14373) 19789 : cluster [DBG] pgmap v13727: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T13:14:54.594 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:14:54 smithi047 bash[22744]: audit 2024-09-16T13:14:53.480452+0000 mon.a (mon.0) 1746 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T13:14:54.594 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:14:54 smithi047 bash[22744]: audit 2024-09-16T13:14:53.486400+0000 mon.b (mon.2) 1789 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T13:14:54.595 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:14:54 smithi047 bash[22744]: audit 2024-09-16T13:14:53.488822+0000 mgr.a (mgr.14373) 19790 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T13:14:54.808 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:14:54 smithi157 bash[24585]: audit 2024-09-16T13:14:53.452205+0000 mon.a (mon.0) 1744 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T13:14:54.808 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:14:54 smithi157 bash[24585]: audit 2024-09-16T13:14:53.463345+0000 mon.a (mon.0) 1745 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T13:14:54.808 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:14:54 smithi157 bash[24585]: audit 2024-09-16T13:14:53.466565+0000 mon.b (mon.2) 1787 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T13:14:54.808 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:14:54 smithi157 bash[24585]: audit 2024-09-16T13:14:53.468931+0000 mon.b (mon.2) 1788 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T13:14:54.808 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:14:54 smithi157 bash[24585]: cluster 2024-09-16T13:14:53.476301+0000 mgr.a (mgr.14373) 19789 : cluster [DBG] pgmap v13727: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T13:14:54.808 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:14:54 smithi157 bash[24585]: audit 2024-09-16T13:14:53.480452+0000 mon.a (mon.0) 1746 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T13:14:54.808 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:14:54 smithi157 bash[24585]: audit 2024-09-16T13:14:53.486400+0000 mon.b (mon.2) 1789 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T13:14:54.808 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:14:54 smithi157 bash[24585]: audit 2024-09-16T13:14:53.488822+0000 mgr.a (mgr.14373) 19790 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T13:14:54.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:14:54 smithi086 bash[24289]: audit 2024-09-16T13:14:53.452205+0000 mon.a (mon.0) 1744 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T13:14:54.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:14:54 smithi086 bash[24289]: audit 2024-09-16T13:14:53.463345+0000 mon.a (mon.0) 1745 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T13:14:54.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:14:54 smithi086 bash[24289]: audit 2024-09-16T13:14:53.466565+0000 mon.b (mon.2) 1787 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T13:14:54.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:14:54 smithi086 bash[24289]: audit 2024-09-16T13:14:53.468931+0000 mon.b (mon.2) 1788 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T13:14:54.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:14:54 smithi086 bash[24289]: cluster 2024-09-16T13:14:53.476301+0000 mgr.a (mgr.14373) 19789 : cluster [DBG] pgmap v13727: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T13:14:54.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:14:54 smithi086 bash[24289]: audit 2024-09-16T13:14:53.480452+0000 mon.a (mon.0) 1746 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T13:14:54.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:14:54 smithi086 bash[24289]: audit 2024-09-16T13:14:53.486400+0000 mon.b (mon.2) 1789 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T13:14:54.822 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:14:54 smithi086 bash[24289]: audit 2024-09-16T13:14:53.488822+0000 mgr.a (mgr.14373) 19790 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T13:14:55.808 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:14:55 smithi157 bash[24585]: audit 2024-09-16T13:14:54.271655+0000 mgr.a (mgr.14373) 19791 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T13:14:55.808 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:14:55 smithi157 bash[24585]: cephadm 2024-09-16T13:14:54.273886+0000 mgr.a (mgr.14373) 19792 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T13:14:55.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:14:55 smithi086 bash[24289]: audit 2024-09-16T13:14:54.271655+0000 mgr.a (mgr.14373) 19791 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T13:14:55.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:14:55 smithi086 bash[24289]: cephadm 2024-09-16T13:14:54.273886+0000 mgr.a (mgr.14373) 19792 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T13:14:55.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:14:55 smithi047 bash[22744]: audit 2024-09-16T13:14:54.271655+0000 mgr.a (mgr.14373) 19791 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T13:14:55.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:14:55 smithi047 bash[22744]: cephadm 2024-09-16T13:14:54.273886+0000 mgr.a (mgr.14373) 19792 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T13:14:56.293 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T13:14:56.294 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T13:14:56.294 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T13:14:56.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:14:56 smithi157 bash[24585]: cluster 2024-09-16T13:14:55.477176+0000 mgr.a (mgr.14373) 19793 : cluster [DBG] pgmap v13728: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:14:56.820 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:14:56 smithi086 bash[24289]: cluster 2024-09-16T13:14:55.477176+0000 mgr.a (mgr.14373) 19793 : cluster [DBG] pgmap v13728: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:14:56.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:14:56 smithi047 bash[22744]: cluster 2024-09-16T13:14:55.477176+0000 mgr.a (mgr.14373) 19793 : cluster [DBG] pgmap v13728: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:14:57.042 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T13:14:57.042 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T13:14:57.042 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T13:14:57.042 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T13:14:57.042 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T13:14:57.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:14:57 smithi157 bash[24585]: audit 2024-09-16T13:14:56.622961+0000 mgr.a (mgr.14373) 19794 : audit [DBG] from='client.423537 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:14:57.824 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:14:57 smithi086 bash[24289]: audit 2024-09-16T13:14:56.622961+0000 mgr.a (mgr.14373) 19794 : audit [DBG] from='client.423537 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:14:57.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:14:57 smithi047 bash[22744]: audit 2024-09-16T13:14:56.622961+0000 mgr.a (mgr.14373) 19794 : audit [DBG] from='client.423537 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:14:58.807 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:14:58 smithi157 bash[24585]: cluster 2024-09-16T13:14:57.479898+0000 mgr.a (mgr.14373) 19795 : cluster [DBG] pgmap v13729: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T13:14:58.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:14:58 smithi086 bash[24289]: cluster 2024-09-16T13:14:57.479898+0000 mgr.a (mgr.14373) 19795 : cluster [DBG] pgmap v13729: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T13:14:58.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:14:58 smithi047 bash[22744]: cluster 2024-09-16T13:14:57.479898+0000 mgr.a (mgr.14373) 19795 : cluster [DBG] pgmap v13729: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T13:15:00.808 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:15:00 smithi157 bash[24585]: cluster 2024-09-16T13:14:59.480677+0000 mgr.a (mgr.14373) 19796 : cluster [DBG] pgmap v13730: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T13:15:00.907 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:15:00 smithi047 bash[22744]: cluster 2024-09-16T13:14:59.480677+0000 mgr.a (mgr.14373) 19796 : cluster [DBG] pgmap v13730: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T13:15:00.907 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:15:00 smithi086 bash[24289]: cluster 2024-09-16T13:14:59.480677+0000 mgr.a (mgr.14373) 19796 : cluster [DBG] pgmap v13730: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T13:15:02.044 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T13:15:02.045 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T13:15:02.045 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T13:15:02.808 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:15:02 smithi157 bash[24585]: cluster 2024-09-16T13:15:01.481877+0000 mgr.a (mgr.14373) 19797 : cluster [DBG] pgmap v13731: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 6.2 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T13:15:02.811 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T13:15:02.811 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T13:15:02.811 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T13:15:02.811 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T13:15:02.812 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T13:15:02.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:15:02 smithi086 bash[24289]: cluster 2024-09-16T13:15:01.481877+0000 mgr.a (mgr.14373) 19797 : cluster [DBG] pgmap v13731: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 6.2 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T13:15:02.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:15:02 smithi047 bash[22744]: cluster 2024-09-16T13:15:01.481877+0000 mgr.a (mgr.14373) 19797 : cluster [DBG] pgmap v13731: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 6.2 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T13:15:03.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:15:03 smithi086 bash[24289]: audit 2024-09-16T13:15:02.378167+0000 mgr.a (mgr.14373) 19798 : audit [DBG] from='client.423612 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:15:03.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:15:03 smithi047 bash[22744]: audit 2024-09-16T13:15:02.378167+0000 mgr.a (mgr.14373) 19798 : audit [DBG] from='client.423612 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:15:04.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:15:03 smithi157 bash[24585]: audit 2024-09-16T13:15:02.378167+0000 mgr.a (mgr.14373) 19798 : audit [DBG] from='client.423612 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:15:04.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:15:04 smithi086 bash[24289]: cluster 2024-09-16T13:15:03.484199+0000 mgr.a (mgr.14373) 19799 : cluster [DBG] pgmap v13732: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 6.9 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T13:15:04.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:15:04 smithi047 bash[22744]: cluster 2024-09-16T13:15:03.484199+0000 mgr.a (mgr.14373) 19799 : cluster [DBG] pgmap v13732: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 6.9 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T13:15:05.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:15:04 smithi157 bash[24585]: cluster 2024-09-16T13:15:03.484199+0000 mgr.a (mgr.14373) 19799 : cluster [DBG] pgmap v13732: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 6.9 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T13:15:06.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:15:06 smithi047 bash[22744]: cluster 2024-09-16T13:15:05.484990+0000 mgr.a (mgr.14373) 19800 : cluster [DBG] pgmap v13733: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T13:15:07.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:15:06 smithi157 bash[24585]: cluster 2024-09-16T13:15:05.484990+0000 mgr.a (mgr.14373) 19800 : cluster [DBG] pgmap v13733: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T13:15:07.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:15:06 smithi086 bash[24289]: cluster 2024-09-16T13:15:05.484990+0000 mgr.a (mgr.14373) 19800 : cluster [DBG] pgmap v13733: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T13:15:07.813 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T13:15:07.814 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T13:15:07.814 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T13:15:08.565 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T13:15:08.566 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T13:15:08.566 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T13:15:08.566 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T13:15:08.566 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T13:15:08.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:15:08 smithi047 bash[22744]: cluster 2024-09-16T13:15:07.487057+0000 mgr.a (mgr.14373) 19801 : cluster [DBG] pgmap v13734: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T13:15:09.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:15:08 smithi157 bash[24585]: cluster 2024-09-16T13:15:07.487057+0000 mgr.a (mgr.14373) 19801 : cluster [DBG] pgmap v13734: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T13:15:09.074 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:15:08 smithi086 bash[24289]: cluster 2024-09-16T13:15:07.487057+0000 mgr.a (mgr.14373) 19801 : cluster [DBG] pgmap v13734: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T13:15:09.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:15:09 smithi047 bash[22744]: audit 2024-09-16T13:15:08.139550+0000 mgr.a (mgr.14373) 19802 : audit [DBG] from='client.423687 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:15:10.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:15:09 smithi157 bash[24585]: audit 2024-09-16T13:15:08.139550+0000 mgr.a (mgr.14373) 19802 : audit [DBG] from='client.423687 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:15:10.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:15:09 smithi086 bash[24289]: audit 2024-09-16T13:15:08.139550+0000 mgr.a (mgr.14373) 19802 : audit [DBG] from='client.423687 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:15:10.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:15:10 smithi047 bash[22744]: cluster 2024-09-16T13:15:09.487961+0000 mgr.a (mgr.14373) 19803 : cluster [DBG] pgmap v13735: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:15:11.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:15:10 smithi157 bash[24585]: cluster 2024-09-16T13:15:09.487961+0000 mgr.a (mgr.14373) 19803 : cluster [DBG] pgmap v13735: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:15:11.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:15:10 smithi086 bash[24289]: cluster 2024-09-16T13:15:09.487961+0000 mgr.a (mgr.14373) 19803 : cluster [DBG] pgmap v13735: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:15:12.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:15:12 smithi047 bash[22744]: cluster 2024-09-16T13:15:11.489345+0000 mgr.a (mgr.14373) 19804 : cluster [DBG] pgmap v13736: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-16T13:15:13.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:15:12 smithi157 bash[24585]: cluster 2024-09-16T13:15:11.489345+0000 mgr.a (mgr.14373) 19804 : cluster [DBG] pgmap v13736: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-16T13:15:13.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:15:12 smithi086 bash[24289]: cluster 2024-09-16T13:15:11.489345+0000 mgr.a (mgr.14373) 19804 : cluster [DBG] pgmap v13736: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-16T13:15:13.567 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T13:15:13.568 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T13:15:13.568 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T13:15:14.350 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T13:15:14.350 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T13:15:14.351 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T13:15:14.351 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T13:15:14.351 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T13:15:15.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:15:14 smithi157 bash[24585]: cluster 2024-09-16T13:15:13.491050+0000 mgr.a (mgr.14373) 19805 : cluster [DBG] pgmap v13737: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T13:15:15.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:15:14 smithi086 bash[24289]: cluster 2024-09-16T13:15:13.491050+0000 mgr.a (mgr.14373) 19805 : cluster [DBG] pgmap v13737: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T13:15:15.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:15:14 smithi047 bash[22744]: cluster 2024-09-16T13:15:13.491050+0000 mgr.a (mgr.14373) 19805 : cluster [DBG] pgmap v13737: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T13:15:16.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:15:15 smithi157 bash[24585]: audit 2024-09-16T13:15:13.897162+0000 mgr.a (mgr.14373) 19806 : audit [DBG] from='client.423762 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:15:16.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:15:15 smithi086 bash[24289]: audit 2024-09-16T13:15:13.897162+0000 mgr.a (mgr.14373) 19806 : audit [DBG] from='client.423762 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:15:16.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:15:15 smithi047 bash[22744]: audit 2024-09-16T13:15:13.897162+0000 mgr.a (mgr.14373) 19806 : audit [DBG] from='client.423762 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:15:17.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:15:16 smithi157 bash[24585]: cluster 2024-09-16T13:15:15.492112+0000 mgr.a (mgr.14373) 19807 : cluster [DBG] pgmap v13738: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:15:17.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:15:16 smithi086 bash[24289]: cluster 2024-09-16T13:15:15.492112+0000 mgr.a (mgr.14373) 19807 : cluster [DBG] pgmap v13738: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:15:17.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:15:16 smithi047 bash[22744]: cluster 2024-09-16T13:15:15.492112+0000 mgr.a (mgr.14373) 19807 : cluster [DBG] pgmap v13738: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:15:19.058 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:15:18 smithi157 bash[24585]: cluster 2024-09-16T13:15:17.494532+0000 mgr.a (mgr.14373) 19808 : cluster [DBG] pgmap v13739: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T13:15:19.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:15:18 smithi086 bash[24289]: cluster 2024-09-16T13:15:17.494532+0000 mgr.a (mgr.14373) 19808 : cluster [DBG] pgmap v13739: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T13:15:19.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:15:18 smithi047 bash[22744]: cluster 2024-09-16T13:15:17.494532+0000 mgr.a (mgr.14373) 19808 : cluster [DBG] pgmap v13739: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T13:15:19.352 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T13:15:19.353 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T13:15:19.353 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T13:15:20.138 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T13:15:20.139 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T13:15:20.139 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T13:15:20.139 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T13:15:20.139 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T13:15:21.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:15:20 smithi157 bash[24585]: cluster 2024-09-16T13:15:19.495097+0000 mgr.a (mgr.14373) 19809 : cluster [DBG] pgmap v13740: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:15:21.058 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:15:20 smithi157 bash[24585]: audit 2024-09-16T13:15:19.690842+0000 mgr.a (mgr.14373) 19810 : audit [DBG] from='client.423840 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:15:21.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:15:20 smithi086 bash[24289]: cluster 2024-09-16T13:15:19.495097+0000 mgr.a (mgr.14373) 19809 : cluster [DBG] pgmap v13740: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:15:21.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:15:20 smithi086 bash[24289]: audit 2024-09-16T13:15:19.690842+0000 mgr.a (mgr.14373) 19810 : audit [DBG] from='client.423840 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:15:21.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:15:20 smithi047 bash[22744]: cluster 2024-09-16T13:15:19.495097+0000 mgr.a (mgr.14373) 19809 : cluster [DBG] pgmap v13740: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:15:21.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:15:20 smithi047 bash[22744]: audit 2024-09-16T13:15:19.690842+0000 mgr.a (mgr.14373) 19810 : audit [DBG] from='client.423840 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:15:23.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:15:22 smithi157 bash[24585]: cluster 2024-09-16T13:15:21.496585+0000 mgr.a (mgr.14373) 19811 : cluster [DBG] pgmap v13741: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-16T13:15:23.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:15:22 smithi086 bash[24289]: cluster 2024-09-16T13:15:21.496585+0000 mgr.a (mgr.14373) 19811 : cluster [DBG] pgmap v13741: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-16T13:15:23.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:15:22 smithi047 bash[22744]: cluster 2024-09-16T13:15:21.496585+0000 mgr.a (mgr.14373) 19811 : cluster [DBG] pgmap v13741: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-16T13:15:25.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:15:24 smithi157 bash[24585]: cluster 2024-09-16T13:15:23.498215+0000 mgr.a (mgr.14373) 19812 : cluster [DBG] pgmap v13742: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T13:15:25.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:15:24 smithi086 bash[24289]: cluster 2024-09-16T13:15:23.498215+0000 mgr.a (mgr.14373) 19812 : cluster [DBG] pgmap v13742: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T13:15:25.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:15:24 smithi047 bash[22744]: cluster 2024-09-16T13:15:23.498215+0000 mgr.a (mgr.14373) 19812 : cluster [DBG] pgmap v13742: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T13:15:25.140 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T13:15:25.141 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T13:15:25.141 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T13:15:25.891 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T13:15:25.891 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T13:15:25.891 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T13:15:25.891 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T13:15:25.891 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T13:15:27.058 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:15:26 smithi157 bash[24585]: audit 2024-09-16T13:15:25.468230+0000 mgr.a (mgr.14373) 19813 : audit [DBG] from='client.423918 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:15:27.058 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:15:26 smithi157 bash[24585]: cluster 2024-09-16T13:15:25.498944+0000 mgr.a (mgr.14373) 19814 : cluster [DBG] pgmap v13743: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:15:27.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:15:26 smithi086 bash[24289]: audit 2024-09-16T13:15:25.468230+0000 mgr.a (mgr.14373) 19813 : audit [DBG] from='client.423918 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:15:27.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:15:26 smithi086 bash[24289]: cluster 2024-09-16T13:15:25.498944+0000 mgr.a (mgr.14373) 19814 : cluster [DBG] pgmap v13743: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:15:27.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:15:26 smithi047 bash[22744]: audit 2024-09-16T13:15:25.468230+0000 mgr.a (mgr.14373) 19813 : audit [DBG] from='client.423918 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:15:27.094 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:15:26 smithi047 bash[22744]: cluster 2024-09-16T13:15:25.498944+0000 mgr.a (mgr.14373) 19814 : cluster [DBG] pgmap v13743: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:15:29.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:15:28 smithi157 bash[24585]: cluster 2024-09-16T13:15:27.501290+0000 mgr.a (mgr.14373) 19815 : cluster [DBG] pgmap v13744: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T13:15:29.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:15:28 smithi086 bash[24289]: cluster 2024-09-16T13:15:27.501290+0000 mgr.a (mgr.14373) 19815 : cluster [DBG] pgmap v13744: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T13:15:29.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:15:28 smithi047 bash[22744]: cluster 2024-09-16T13:15:27.501290+0000 mgr.a (mgr.14373) 19815 : cluster [DBG] pgmap v13744: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T13:15:30.892 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T13:15:30.893 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T13:15:30.893 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T13:15:31.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:15:30 smithi157 bash[24585]: cluster 2024-09-16T13:15:29.502049+0000 mgr.a (mgr.14373) 19816 : cluster [DBG] pgmap v13745: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:15:31.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:15:30 smithi086 bash[24289]: cluster 2024-09-16T13:15:29.502049+0000 mgr.a (mgr.14373) 19816 : cluster [DBG] pgmap v13745: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:15:31.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:15:30 smithi047 bash[22744]: cluster 2024-09-16T13:15:29.502049+0000 mgr.a (mgr.14373) 19816 : cluster [DBG] pgmap v13745: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:15:31.670 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T13:15:31.670 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T13:15:31.671 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T13:15:31.671 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T13:15:31.671 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T13:15:33.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:15:32 smithi157 bash[24585]: audit 2024-09-16T13:15:31.226949+0000 mgr.a (mgr.14373) 19817 : audit [DBG] from='client.423993 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:15:33.058 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:15:32 smithi157 bash[24585]: cluster 2024-09-16T13:15:31.502941+0000 mgr.a (mgr.14373) 19818 : cluster [DBG] pgmap v13746: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-16T13:15:33.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:15:32 smithi086 bash[24289]: audit 2024-09-16T13:15:31.226949+0000 mgr.a (mgr.14373) 19817 : audit [DBG] from='client.423993 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:15:33.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:15:32 smithi086 bash[24289]: cluster 2024-09-16T13:15:31.502941+0000 mgr.a (mgr.14373) 19818 : cluster [DBG] pgmap v13746: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-16T13:15:33.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:15:32 smithi047 bash[22744]: audit 2024-09-16T13:15:31.226949+0000 mgr.a (mgr.14373) 19817 : audit [DBG] from='client.423993 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:15:33.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:15:32 smithi047 bash[22744]: cluster 2024-09-16T13:15:31.502941+0000 mgr.a (mgr.14373) 19818 : cluster [DBG] pgmap v13746: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-16T13:15:35.058 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:15:34 smithi157 bash[24585]: cluster 2024-09-16T13:15:33.505141+0000 mgr.a (mgr.14373) 19819 : cluster [DBG] pgmap v13747: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-16T13:15:35.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:15:34 smithi086 bash[24289]: cluster 2024-09-16T13:15:33.505141+0000 mgr.a (mgr.14373) 19819 : cluster [DBG] pgmap v13747: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-16T13:15:35.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:15:34 smithi047 bash[22744]: cluster 2024-09-16T13:15:33.505141+0000 mgr.a (mgr.14373) 19819 : cluster [DBG] pgmap v13747: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-09-16T13:15:36.672 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T13:15:36.673 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T13:15:36.673 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T13:15:37.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:15:36 smithi157 bash[24585]: cluster 2024-09-16T13:15:35.505924+0000 mgr.a (mgr.14373) 19820 : cluster [DBG] pgmap v13748: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T13:15:37.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:15:36 smithi086 bash[24289]: cluster 2024-09-16T13:15:35.505924+0000 mgr.a (mgr.14373) 19820 : cluster [DBG] pgmap v13748: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T13:15:37.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:15:36 smithi047 bash[22744]: cluster 2024-09-16T13:15:35.505924+0000 mgr.a (mgr.14373) 19820 : cluster [DBG] pgmap v13748: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-16T13:15:37.427 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T13:15:37.428 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T13:15:37.428 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T13:15:37.428 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T13:15:37.428 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T13:15:39.058 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:15:38 smithi157 bash[24585]: audit 2024-09-16T13:15:36.999670+0000 mgr.a (mgr.14373) 19821 : audit [DBG] from='client.424068 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:15:39.058 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:15:38 smithi157 bash[24585]: cluster 2024-09-16T13:15:37.508019+0000 mgr.a (mgr.14373) 19822 : cluster [DBG] pgmap v13749: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:15:39.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:15:38 smithi086 bash[24289]: audit 2024-09-16T13:15:36.999670+0000 mgr.a (mgr.14373) 19821 : audit [DBG] from='client.424068 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:15:39.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:15:38 smithi086 bash[24289]: cluster 2024-09-16T13:15:37.508019+0000 mgr.a (mgr.14373) 19822 : cluster [DBG] pgmap v13749: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:15:39.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:15:38 smithi047 bash[22744]: audit 2024-09-16T13:15:36.999670+0000 mgr.a (mgr.14373) 19821 : audit [DBG] from='client.424068 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:15:39.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:15:38 smithi047 bash[22744]: cluster 2024-09-16T13:15:37.508019+0000 mgr.a (mgr.14373) 19822 : cluster [DBG] pgmap v13749: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:15:41.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:15:40 smithi157 bash[24585]: cluster 2024-09-16T13:15:39.508801+0000 mgr.a (mgr.14373) 19823 : cluster [DBG] pgmap v13750: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T13:15:41.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:15:40 smithi086 bash[24289]: cluster 2024-09-16T13:15:39.508801+0000 mgr.a (mgr.14373) 19823 : cluster [DBG] pgmap v13750: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T13:15:41.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:15:40 smithi047 bash[22744]: cluster 2024-09-16T13:15:39.508801+0000 mgr.a (mgr.14373) 19823 : cluster [DBG] pgmap v13750: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T13:15:42.429 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T13:15:42.429 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T13:15:42.430 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T13:15:43.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:15:42 smithi157 bash[24585]: cluster 2024-09-16T13:15:41.509977+0000 mgr.a (mgr.14373) 19824 : cluster [DBG] pgmap v13751: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-16T13:15:43.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:15:42 smithi086 bash[24289]: cluster 2024-09-16T13:15:41.509977+0000 mgr.a (mgr.14373) 19824 : cluster [DBG] pgmap v13751: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-16T13:15:43.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:15:42 smithi047 bash[22744]: cluster 2024-09-16T13:15:41.509977+0000 mgr.a (mgr.14373) 19824 : cluster [DBG] pgmap v13751: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-09-16T13:15:43.204 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T13:15:43.204 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T13:15:43.205 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T13:15:43.205 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T13:15:43.205 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T13:15:44.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:15:43 smithi157 bash[24585]: audit 2024-09-16T13:15:42.762401+0000 mgr.a (mgr.14373) 19825 : audit [DBG] from='client.424143 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:15:44.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:15:43 smithi086 bash[24289]: audit 2024-09-16T13:15:42.762401+0000 mgr.a (mgr.14373) 19825 : audit [DBG] from='client.424143 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:15:44.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:15:43 smithi047 bash[22744]: audit 2024-09-16T13:15:42.762401+0000 mgr.a (mgr.14373) 19825 : audit [DBG] from='client.424143 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:15:45.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:15:44 smithi157 bash[24585]: cluster 2024-09-16T13:15:43.512199+0000 mgr.a (mgr.14373) 19826 : cluster [DBG] pgmap v13752: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-16T13:15:45.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:15:44 smithi086 bash[24289]: cluster 2024-09-16T13:15:43.512199+0000 mgr.a (mgr.14373) 19826 : cluster [DBG] pgmap v13752: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-16T13:15:45.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:15:44 smithi047 bash[22744]: cluster 2024-09-16T13:15:43.512199+0000 mgr.a (mgr.14373) 19826 : cluster [DBG] pgmap v13752: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-09-16T13:15:47.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:15:46 smithi157 bash[24585]: cluster 2024-09-16T13:15:45.513001+0000 mgr.a (mgr.14373) 19827 : cluster [DBG] pgmap v13753: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-16T13:15:47.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:15:46 smithi086 bash[24289]: cluster 2024-09-16T13:15:45.513001+0000 mgr.a (mgr.14373) 19827 : cluster [DBG] pgmap v13753: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-16T13:15:47.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:15:46 smithi047 bash[22744]: cluster 2024-09-16T13:15:45.513001+0000 mgr.a (mgr.14373) 19827 : cluster [DBG] pgmap v13753: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-16T13:15:48.206 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T13:15:48.206 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T13:15:48.206 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T13:15:49.003 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T13:15:49.003 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T13:15:49.003 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T13:15:49.003 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T13:15:49.003 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T13:15:49.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:15:48 smithi157 bash[24585]: cluster 2024-09-16T13:15:47.515068+0000 mgr.a (mgr.14373) 19828 : cluster [DBG] pgmap v13754: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-16T13:15:49.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:15:48 smithi086 bash[24289]: cluster 2024-09-16T13:15:47.515068+0000 mgr.a (mgr.14373) 19828 : cluster [DBG] pgmap v13754: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-16T13:15:49.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:15:48 smithi047 bash[22744]: cluster 2024-09-16T13:15:47.515068+0000 mgr.a (mgr.14373) 19828 : cluster [DBG] pgmap v13754: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-16T13:15:50.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:15:49 smithi157 bash[24585]: audit 2024-09-16T13:15:48.540340+0000 mgr.a (mgr.14373) 19829 : audit [DBG] from='client.424218 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:15:50.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:15:49 smithi086 bash[24289]: audit 2024-09-16T13:15:48.540340+0000 mgr.a (mgr.14373) 19829 : audit [DBG] from='client.424218 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:15:50.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:15:49 smithi047 bash[22744]: audit 2024-09-16T13:15:48.540340+0000 mgr.a (mgr.14373) 19829 : audit [DBG] from='client.424218 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:15:51.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:15:50 smithi157 bash[24585]: cluster 2024-09-16T13:15:49.515966+0000 mgr.a (mgr.14373) 19830 : cluster [DBG] pgmap v13755: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:15:51.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:15:50 smithi086 bash[24289]: cluster 2024-09-16T13:15:49.515966+0000 mgr.a (mgr.14373) 19830 : cluster [DBG] pgmap v13755: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:15:51.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:15:50 smithi047 bash[22744]: cluster 2024-09-16T13:15:49.515966+0000 mgr.a (mgr.14373) 19830 : cluster [DBG] pgmap v13755: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:15:53.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:15:52 smithi157 bash[24585]: cluster 2024-09-16T13:15:51.517404+0000 mgr.a (mgr.14373) 19831 : cluster [DBG] pgmap v13756: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-16T13:15:53.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:15:52 smithi086 bash[24289]: cluster 2024-09-16T13:15:51.517404+0000 mgr.a (mgr.14373) 19831 : cluster [DBG] pgmap v13756: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-16T13:15:53.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:15:52 smithi047 bash[22744]: cluster 2024-09-16T13:15:51.517404+0000 mgr.a (mgr.14373) 19831 : cluster [DBG] pgmap v13756: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-09-16T13:15:54.004 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T13:15:54.005 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T13:15:54.005 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T13:15:54.787 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T13:15:54.788 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T13:15:54.788 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T13:15:54.788 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T13:15:54.788 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T13:15:55.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:15:54 smithi157 bash[24585]: cluster 2024-09-16T13:15:53.519170+0000 mgr.a (mgr.14373) 19832 : cluster [DBG] pgmap v13757: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T13:15:55.058 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:15:54 smithi157 bash[24585]: audit 2024-09-16T13:15:54.344173+0000 mon.b (mon.2) 1790 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T13:15:55.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:15:54 smithi086 bash[24289]: cluster 2024-09-16T13:15:53.519170+0000 mgr.a (mgr.14373) 19832 : cluster [DBG] pgmap v13757: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T13:15:55.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:15:54 smithi086 bash[24289]: audit 2024-09-16T13:15:54.344173+0000 mon.b (mon.2) 1790 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T13:15:55.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:15:54 smithi047 bash[22744]: cluster 2024-09-16T13:15:53.519170+0000 mgr.a (mgr.14373) 19832 : cluster [DBG] pgmap v13757: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T13:15:55.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:15:54 smithi047 bash[22744]: audit 2024-09-16T13:15:54.344173+0000 mon.b (mon.2) 1790 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T13:15:56.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:15:55 smithi157 bash[24585]: audit 2024-09-16T13:15:54.344455+0000 mgr.a (mgr.14373) 19833 : audit [DBG] from='client.424296 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:15:56.058 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:15:55 smithi157 bash[24585]: audit 2024-09-16T13:15:55.113136+0000 mon.a (mon.0) 1747 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T13:15:56.058 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:15:55 smithi157 bash[24585]: audit 2024-09-16T13:15:55.124124+0000 mon.a (mon.0) 1748 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T13:15:56.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:15:55 smithi086 bash[24289]: audit 2024-09-16T13:15:54.344455+0000 mgr.a (mgr.14373) 19833 : audit [DBG] from='client.424296 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:15:56.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:15:55 smithi086 bash[24289]: audit 2024-09-16T13:15:55.113136+0000 mon.a (mon.0) 1747 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T13:15:56.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:15:55 smithi086 bash[24289]: audit 2024-09-16T13:15:55.124124+0000 mon.a (mon.0) 1748 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T13:15:56.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:15:55 smithi047 bash[22744]: audit 2024-09-16T13:15:54.344455+0000 mgr.a (mgr.14373) 19833 : audit [DBG] from='client.424296 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:15:56.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:15:55 smithi047 bash[22744]: audit 2024-09-16T13:15:55.113136+0000 mon.a (mon.0) 1747 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T13:15:56.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:15:55 smithi047 bash[22744]: audit 2024-09-16T13:15:55.124124+0000 mon.a (mon.0) 1748 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T13:15:57.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:15:56 smithi157 bash[24585]: cluster 2024-09-16T13:15:55.520035+0000 mgr.a (mgr.14373) 19834 : cluster [DBG] pgmap v13758: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:15:57.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:15:56 smithi086 bash[24289]: cluster 2024-09-16T13:15:55.520035+0000 mgr.a (mgr.14373) 19834 : cluster [DBG] pgmap v13758: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:15:57.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:15:56 smithi047 bash[22744]: cluster 2024-09-16T13:15:55.520035+0000 mgr.a (mgr.14373) 19834 : cluster [DBG] pgmap v13758: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:15:59.058 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:15:58 smithi157 bash[24585]: cluster 2024-09-16T13:15:57.522260+0000 mgr.a (mgr.14373) 19835 : cluster [DBG] pgmap v13759: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T13:15:59.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:15:58 smithi086 bash[24289]: cluster 2024-09-16T13:15:57.522260+0000 mgr.a (mgr.14373) 19835 : cluster [DBG] pgmap v13759: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T13:15:59.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:15:58 smithi047 bash[22744]: cluster 2024-09-16T13:15:57.522260+0000 mgr.a (mgr.14373) 19835 : cluster [DBG] pgmap v13759: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T13:15:59.789 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T13:15:59.790 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T13:15:59.790 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T13:16:00.539 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T13:16:00.539 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T13:16:00.539 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T13:16:00.539 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T13:16:00.539 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T13:16:01.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:16:00 smithi157 bash[24585]: cluster 2024-09-16T13:15:59.523038+0000 mgr.a (mgr.14373) 19836 : cluster [DBG] pgmap v13760: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:16:01.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:16:00 smithi086 bash[24289]: cluster 2024-09-16T13:15:59.523038+0000 mgr.a (mgr.14373) 19836 : cluster [DBG] pgmap v13760: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:16:01.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:16:00 smithi047 bash[22744]: cluster 2024-09-16T13:15:59.523038+0000 mgr.a (mgr.14373) 19836 : cluster [DBG] pgmap v13760: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:16:02.058 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:16:01 smithi157 bash[24585]: audit 2024-09-16T13:16:00.121035+0000 mgr.a (mgr.14373) 19837 : audit [DBG] from='client.424371 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:16:02.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:16:01 smithi086 bash[24289]: audit 2024-09-16T13:16:00.121035+0000 mgr.a (mgr.14373) 19837 : audit [DBG] from='client.424371 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:16:02.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:16:01 smithi047 bash[22744]: audit 2024-09-16T13:16:00.121035+0000 mgr.a (mgr.14373) 19837 : audit [DBG] from='client.424371 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:16:03.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:16:02 smithi157 bash[24585]: cluster 2024-09-16T13:16:01.524884+0000 mgr.a (mgr.14373) 19838 : cluster [DBG] pgmap v13761: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-16T13:16:03.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:16:02 smithi086 bash[24289]: cluster 2024-09-16T13:16:01.524884+0000 mgr.a (mgr.14373) 19838 : cluster [DBG] pgmap v13761: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-16T13:16:03.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:16:02 smithi047 bash[22744]: cluster 2024-09-16T13:16:01.524884+0000 mgr.a (mgr.14373) 19838 : cluster [DBG] pgmap v13761: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-16T13:16:05.058 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:16:04 smithi157 bash[24585]: cluster 2024-09-16T13:16:03.526106+0000 mgr.a (mgr.14373) 19839 : cluster [DBG] pgmap v13762: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T13:16:05.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:16:04 smithi086 bash[24289]: cluster 2024-09-16T13:16:03.526106+0000 mgr.a (mgr.14373) 19839 : cluster [DBG] pgmap v13762: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T13:16:05.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:16:04 smithi047 bash[22744]: cluster 2024-09-16T13:16:03.526106+0000 mgr.a (mgr.14373) 19839 : cluster [DBG] pgmap v13762: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T13:16:05.540 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T13:16:05.540 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T13:16:05.540 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T13:16:05.843 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 13:16:05 smithi047 bash[22994]: debug 2024-09-16T13:16:05.550+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T13:16:05.843 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 13:16:05 smithi047 bash[22994]: debug 2024-09-16T13:16:05.554+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T13:16:05.844 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:16:05 smithi047 bash[22744]: audit 2024-09-16T13:16:04.727440+0000 mon.a (mon.0) 1749 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T13:16:05.844 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:16:05 smithi047 bash[22744]: audit 2024-09-16T13:16:04.742778+0000 mon.a (mon.0) 1750 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T13:16:05.844 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:16:05 smithi047 bash[22744]: audit 2024-09-16T13:16:04.745948+0000 mon.b (mon.2) 1791 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T13:16:05.844 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:16:05 smithi047 bash[22744]: audit 2024-09-16T13:16:04.748260+0000 mon.b (mon.2) 1792 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T13:16:05.844 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:16:05 smithi047 bash[22744]: audit 2024-09-16T13:16:04.760188+0000 mon.a (mon.0) 1751 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T13:16:05.844 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:16:05 smithi047 bash[22744]: audit 2024-09-16T13:16:04.765842+0000 mon.b (mon.2) 1793 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T13:16:05.844 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:16:05 smithi047 bash[22744]: audit 2024-09-16T13:16:04.768223+0000 mgr.a (mgr.14373) 19840 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T13:16:06.058 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:16:05 smithi157 bash[24585]: audit 2024-09-16T13:16:04.727440+0000 mon.a (mon.0) 1749 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T13:16:06.058 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:16:05 smithi157 bash[24585]: audit 2024-09-16T13:16:04.742778+0000 mon.a (mon.0) 1750 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T13:16:06.058 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:16:05 smithi157 bash[24585]: audit 2024-09-16T13:16:04.745948+0000 mon.b (mon.2) 1791 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T13:16:06.058 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:16:05 smithi157 bash[24585]: audit 2024-09-16T13:16:04.748260+0000 mon.b (mon.2) 1792 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T13:16:06.058 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:16:05 smithi157 bash[24585]: audit 2024-09-16T13:16:04.760188+0000 mon.a (mon.0) 1751 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T13:16:06.058 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:16:05 smithi157 bash[24585]: audit 2024-09-16T13:16:04.765842+0000 mon.b (mon.2) 1793 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T13:16:06.058 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:16:05 smithi157 bash[24585]: audit 2024-09-16T13:16:04.768223+0000 mgr.a (mgr.14373) 19840 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T13:16:06.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:16:05 smithi086 bash[24289]: audit 2024-09-16T13:16:04.727440+0000 mon.a (mon.0) 1749 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T13:16:06.072 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:16:05 smithi086 bash[24289]: audit 2024-09-16T13:16:04.742778+0000 mon.a (mon.0) 1750 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T13:16:06.072 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:16:05 smithi086 bash[24289]: audit 2024-09-16T13:16:04.745948+0000 mon.b (mon.2) 1791 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T13:16:06.072 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:16:05 smithi086 bash[24289]: audit 2024-09-16T13:16:04.748260+0000 mon.b (mon.2) 1792 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T13:16:06.072 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:16:05 smithi086 bash[24289]: audit 2024-09-16T13:16:04.760188+0000 mon.a (mon.0) 1751 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T13:16:06.072 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:16:05 smithi086 bash[24289]: audit 2024-09-16T13:16:04.765842+0000 mon.b (mon.2) 1793 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T13:16:06.072 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:16:05 smithi086 bash[24289]: audit 2024-09-16T13:16:04.768223+0000 mgr.a (mgr.14373) 19840 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T13:16:06.291 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T13:16:06.291 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T13:16:06.291 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T13:16:06.291 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T13:16:06.291 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T13:16:07.058 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:16:06 smithi157 bash[24585]: cluster 2024-09-16T13:16:05.526760+0000 mgr.a (mgr.14373) 19841 : cluster [DBG] pgmap v13763: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:16:07.058 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:16:06 smithi157 bash[24585]: audit 2024-09-16T13:16:05.556316+0000 mgr.a (mgr.14373) 19842 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T13:16:07.058 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:16:06 smithi157 bash[24585]: cephadm 2024-09-16T13:16:05.558377+0000 mgr.a (mgr.14373) 19843 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T13:16:07.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:16:06 smithi086 bash[24289]: cluster 2024-09-16T13:16:05.526760+0000 mgr.a (mgr.14373) 19841 : cluster [DBG] pgmap v13763: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:16:07.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:16:06 smithi086 bash[24289]: audit 2024-09-16T13:16:05.556316+0000 mgr.a (mgr.14373) 19842 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T13:16:07.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:16:06 smithi086 bash[24289]: cephadm 2024-09-16T13:16:05.558377+0000 mgr.a (mgr.14373) 19843 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T13:16:07.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:16:06 smithi047 bash[22744]: cluster 2024-09-16T13:16:05.526760+0000 mgr.a (mgr.14373) 19841 : cluster [DBG] pgmap v13763: 225 pgs: 225 active+clean; 589 KiB data, 253 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:16:07.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:16:06 smithi047 bash[22744]: audit 2024-09-16T13:16:05.556316+0000 mgr.a (mgr.14373) 19842 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T13:16:07.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:16:06 smithi047 bash[22744]: cephadm 2024-09-16T13:16:05.558377+0000 mgr.a (mgr.14373) 19843 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T13:16:08.058 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:16:07 smithi157 bash[24585]: audit 2024-09-16T13:16:05.863827+0000 mgr.a (mgr.14373) 19844 : audit [DBG] from='client.424557 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:16:08.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:16:07 smithi086 bash[24289]: audit 2024-09-16T13:16:05.863827+0000 mgr.a (mgr.14373) 19844 : audit [DBG] from='client.424557 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:16:08.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:16:07 smithi047 bash[22744]: audit 2024-09-16T13:16:05.863827+0000 mgr.a (mgr.14373) 19844 : audit [DBG] from='client.424557 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:16:09.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:16:08 smithi157 bash[24585]: cluster 2024-09-16T13:16:07.529075+0000 mgr.a (mgr.14373) 19845 : cluster [DBG] pgmap v13764: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T13:16:09.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:16:08 smithi086 bash[24289]: cluster 2024-09-16T13:16:07.529075+0000 mgr.a (mgr.14373) 19845 : cluster [DBG] pgmap v13764: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T13:16:09.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:16:08 smithi047 bash[22744]: cluster 2024-09-16T13:16:07.529075+0000 mgr.a (mgr.14373) 19845 : cluster [DBG] pgmap v13764: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T13:16:11.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:16:10 smithi157 bash[24585]: cluster 2024-09-16T13:16:09.529880+0000 mgr.a (mgr.14373) 19846 : cluster [DBG] pgmap v13765: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T13:16:11.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:16:10 smithi086 bash[24289]: cluster 2024-09-16T13:16:09.529880+0000 mgr.a (mgr.14373) 19846 : cluster [DBG] pgmap v13765: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T13:16:11.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:16:10 smithi047 bash[22744]: cluster 2024-09-16T13:16:09.529880+0000 mgr.a (mgr.14373) 19846 : cluster [DBG] pgmap v13765: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T13:16:11.292 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T13:16:11.293 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T13:16:11.293 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T13:16:12.041 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T13:16:12.042 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T13:16:12.042 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T13:16:12.042 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T13:16:12.042 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T13:16:13.058 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:16:12 smithi157 bash[24585]: cluster 2024-09-16T13:16:11.531406+0000 mgr.a (mgr.14373) 19847 : cluster [DBG] pgmap v13766: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T13:16:13.058 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:16:12 smithi157 bash[24585]: audit 2024-09-16T13:16:11.621430+0000 mgr.a (mgr.14373) 19848 : audit [DBG] from='client.424632 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:16:13.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:16:12 smithi086 bash[24289]: cluster 2024-09-16T13:16:11.531406+0000 mgr.a (mgr.14373) 19847 : cluster [DBG] pgmap v13766: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T13:16:13.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:16:12 smithi086 bash[24289]: audit 2024-09-16T13:16:11.621430+0000 mgr.a (mgr.14373) 19848 : audit [DBG] from='client.424632 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:16:13.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:16:12 smithi047 bash[22744]: cluster 2024-09-16T13:16:11.531406+0000 mgr.a (mgr.14373) 19847 : cluster [DBG] pgmap v13766: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T13:16:13.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:16:12 smithi047 bash[22744]: audit 2024-09-16T13:16:11.621430+0000 mgr.a (mgr.14373) 19848 : audit [DBG] from='client.424632 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:16:15.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:16:14 smithi157 bash[24585]: cluster 2024-09-16T13:16:13.533224+0000 mgr.a (mgr.14373) 19849 : cluster [DBG] pgmap v13767: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T13:16:15.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:16:14 smithi086 bash[24289]: cluster 2024-09-16T13:16:13.533224+0000 mgr.a (mgr.14373) 19849 : cluster [DBG] pgmap v13767: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T13:16:15.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:16:14 smithi047 bash[22744]: cluster 2024-09-16T13:16:13.533224+0000 mgr.a (mgr.14373) 19849 : cluster [DBG] pgmap v13767: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T13:16:17.043 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T13:16:17.044 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T13:16:17.044 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T13:16:17.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:16:16 smithi157 bash[24585]: cluster 2024-09-16T13:16:15.534187+0000 mgr.a (mgr.14373) 19850 : cluster [DBG] pgmap v13768: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T13:16:17.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:16:16 smithi086 bash[24289]: cluster 2024-09-16T13:16:15.534187+0000 mgr.a (mgr.14373) 19850 : cluster [DBG] pgmap v13768: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T13:16:17.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:16:16 smithi047 bash[22744]: cluster 2024-09-16T13:16:15.534187+0000 mgr.a (mgr.14373) 19850 : cluster [DBG] pgmap v13768: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-16T13:16:17.821 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T13:16:17.821 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T13:16:17.822 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T13:16:17.822 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T13:16:17.822 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T13:16:19.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:16:18 smithi157 bash[24585]: audit 2024-09-16T13:16:17.379913+0000 mgr.a (mgr.14373) 19851 : audit [DBG] from='client.424704 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:16:19.058 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:16:18 smithi157 bash[24585]: cluster 2024-09-16T13:16:17.535597+0000 mgr.a (mgr.14373) 19852 : cluster [DBG] pgmap v13769: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T13:16:19.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:16:18 smithi086 bash[24289]: audit 2024-09-16T13:16:17.379913+0000 mgr.a (mgr.14373) 19851 : audit [DBG] from='client.424704 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:16:19.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:16:18 smithi086 bash[24289]: cluster 2024-09-16T13:16:17.535597+0000 mgr.a (mgr.14373) 19852 : cluster [DBG] pgmap v13769: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T13:16:19.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:16:18 smithi047 bash[22744]: audit 2024-09-16T13:16:17.379913+0000 mgr.a (mgr.14373) 19851 : audit [DBG] from='client.424704 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:16:19.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:16:18 smithi047 bash[22744]: cluster 2024-09-16T13:16:17.535597+0000 mgr.a (mgr.14373) 19852 : cluster [DBG] pgmap v13769: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T13:16:21.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:16:20 smithi157 bash[24585]: cluster 2024-09-16T13:16:19.536465+0000 mgr.a (mgr.14373) 19853 : cluster [DBG] pgmap v13770: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T13:16:21.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:16:20 smithi086 bash[24289]: cluster 2024-09-16T13:16:19.536465+0000 mgr.a (mgr.14373) 19853 : cluster [DBG] pgmap v13770: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T13:16:21.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:16:20 smithi047 bash[22744]: cluster 2024-09-16T13:16:19.536465+0000 mgr.a (mgr.14373) 19853 : cluster [DBG] pgmap v13770: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T13:16:22.823 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T13:16:22.823 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T13:16:22.824 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T13:16:23.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:16:22 smithi157 bash[24585]: cluster 2024-09-16T13:16:21.538567+0000 mgr.a (mgr.14373) 19854 : cluster [DBG] pgmap v13771: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:16:23.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:16:22 smithi086 bash[24289]: cluster 2024-09-16T13:16:21.538567+0000 mgr.a (mgr.14373) 19854 : cluster [DBG] pgmap v13771: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:16:23.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:16:22 smithi047 bash[22744]: cluster 2024-09-16T13:16:21.538567+0000 mgr.a (mgr.14373) 19854 : cluster [DBG] pgmap v13771: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:16:23.583 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T13:16:23.584 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T13:16:23.584 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T13:16:23.584 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T13:16:23.584 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T13:16:25.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:16:24 smithi157 bash[24585]: audit 2024-09-16T13:16:23.150998+0000 mgr.a (mgr.14373) 19855 : audit [DBG] from='client.424782 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:16:25.058 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:16:24 smithi157 bash[24585]: cluster 2024-09-16T13:16:23.539104+0000 mgr.a (mgr.14373) 19856 : cluster [DBG] pgmap v13772: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:16:25.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:16:24 smithi086 bash[24289]: audit 2024-09-16T13:16:23.150998+0000 mgr.a (mgr.14373) 19855 : audit [DBG] from='client.424782 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:16:25.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:16:24 smithi086 bash[24289]: cluster 2024-09-16T13:16:23.539104+0000 mgr.a (mgr.14373) 19856 : cluster [DBG] pgmap v13772: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:16:25.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:16:24 smithi047 bash[22744]: audit 2024-09-16T13:16:23.150998+0000 mgr.a (mgr.14373) 19855 : audit [DBG] from='client.424782 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:16:25.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:16:24 smithi047 bash[22744]: cluster 2024-09-16T13:16:23.539104+0000 mgr.a (mgr.14373) 19856 : cluster [DBG] pgmap v13772: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:16:27.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:16:26 smithi086 bash[24289]: cluster 2024-09-16T13:16:25.539850+0000 mgr.a (mgr.14373) 19857 : cluster [DBG] pgmap v13773: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:16:27.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:16:26 smithi047 bash[22744]: cluster 2024-09-16T13:16:25.539850+0000 mgr.a (mgr.14373) 19857 : cluster [DBG] pgmap v13773: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:16:27.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:16:26 smithi157 bash[24585]: cluster 2024-09-16T13:16:25.539850+0000 mgr.a (mgr.14373) 19857 : cluster [DBG] pgmap v13773: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:16:28.585 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T13:16:28.586 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T13:16:28.586 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T13:16:29.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:16:28 smithi086 bash[24289]: cluster 2024-09-16T13:16:27.542045+0000 mgr.a (mgr.14373) 19858 : cluster [DBG] pgmap v13774: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T13:16:29.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:16:28 smithi047 bash[22744]: cluster 2024-09-16T13:16:27.542045+0000 mgr.a (mgr.14373) 19858 : cluster [DBG] pgmap v13774: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T13:16:29.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:16:28 smithi157 bash[24585]: cluster 2024-09-16T13:16:27.542045+0000 mgr.a (mgr.14373) 19858 : cluster [DBG] pgmap v13774: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T13:16:29.352 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T13:16:29.353 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T13:16:29.353 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T13:16:29.353 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T13:16:29.353 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T13:16:31.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:16:30 smithi086 bash[24289]: audit 2024-09-16T13:16:28.918845+0000 mgr.a (mgr.14373) 19859 : audit [DBG] from='client.424860 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:16:31.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:16:30 smithi086 bash[24289]: cluster 2024-09-16T13:16:29.542929+0000 mgr.a (mgr.14373) 19860 : cluster [DBG] pgmap v13775: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:16:31.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:16:30 smithi047 bash[22744]: audit 2024-09-16T13:16:28.918845+0000 mgr.a (mgr.14373) 19859 : audit [DBG] from='client.424860 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:16:31.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:16:30 smithi047 bash[22744]: cluster 2024-09-16T13:16:29.542929+0000 mgr.a (mgr.14373) 19860 : cluster [DBG] pgmap v13775: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:16:31.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:16:30 smithi157 bash[24585]: audit 2024-09-16T13:16:28.918845+0000 mgr.a (mgr.14373) 19859 : audit [DBG] from='client.424860 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:16:31.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:16:30 smithi157 bash[24585]: cluster 2024-09-16T13:16:29.542929+0000 mgr.a (mgr.14373) 19860 : cluster [DBG] pgmap v13775: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:16:33.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:16:32 smithi047 bash[22744]: cluster 2024-09-16T13:16:31.545062+0000 mgr.a (mgr.14373) 19861 : cluster [DBG] pgmap v13776: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T13:16:33.308 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:16:32 smithi157 bash[24585]: cluster 2024-09-16T13:16:31.545062+0000 mgr.a (mgr.14373) 19861 : cluster [DBG] pgmap v13776: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T13:16:33.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:16:32 smithi086 bash[24289]: cluster 2024-09-16T13:16:31.545062+0000 mgr.a (mgr.14373) 19861 : cluster [DBG] pgmap v13776: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T13:16:34.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:16:33 smithi047 bash[22744]: cluster 2024-09-16T13:16:33.545797+0000 mgr.a (mgr.14373) 19862 : cluster [DBG] pgmap v13777: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:16:34.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:16:33 smithi157 bash[24585]: cluster 2024-09-16T13:16:33.545797+0000 mgr.a (mgr.14373) 19862 : cluster [DBG] pgmap v13777: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:16:34.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:16:33 smithi086 bash[24289]: cluster 2024-09-16T13:16:33.545797+0000 mgr.a (mgr.14373) 19862 : cluster [DBG] pgmap v13777: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:16:34.354 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T13:16:34.355 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T13:16:34.355 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T13:16:35.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:16:34 smithi047 bash[22744]: audit 2024-09-16T13:16:34.687957+0000 mgr.a (mgr.14373) 19863 : audit [DBG] from='client.424935 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:16:35.125 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T13:16:35.125 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T13:16:35.125 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T13:16:35.125 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T13:16:35.125 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T13:16:35.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:16:34 smithi157 bash[24585]: audit 2024-09-16T13:16:34.687957+0000 mgr.a (mgr.14373) 19863 : audit [DBG] from='client.424935 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:16:35.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:16:34 smithi086 bash[24289]: audit 2024-09-16T13:16:34.687957+0000 mgr.a (mgr.14373) 19863 : audit [DBG] from='client.424935 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:16:36.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:16:35 smithi047 bash[22744]: cluster 2024-09-16T13:16:35.546889+0000 mgr.a (mgr.14373) 19864 : cluster [DBG] pgmap v13778: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:16:36.307 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:16:35 smithi157 bash[24585]: cluster 2024-09-16T13:16:35.546889+0000 mgr.a (mgr.14373) 19864 : cluster [DBG] pgmap v13778: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:16:36.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:16:35 smithi086 bash[24289]: cluster 2024-09-16T13:16:35.546889+0000 mgr.a (mgr.14373) 19864 : cluster [DBG] pgmap v13778: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:16:39.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:16:38 smithi157 bash[24585]: cluster 2024-09-16T13:16:37.549230+0000 mgr.a (mgr.14373) 19865 : cluster [DBG] pgmap v13779: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T13:16:39.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:16:38 smithi086 bash[24289]: cluster 2024-09-16T13:16:37.549230+0000 mgr.a (mgr.14373) 19865 : cluster [DBG] pgmap v13779: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T13:16:39.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:16:38 smithi047 bash[22744]: cluster 2024-09-16T13:16:37.549230+0000 mgr.a (mgr.14373) 19865 : cluster [DBG] pgmap v13779: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T13:16:40.126 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T13:16:40.127 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T13:16:40.127 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T13:16:40.870 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T13:16:40.870 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T13:16:40.870 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T13:16:40.870 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T13:16:40.871 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T13:16:41.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:16:40 smithi157 bash[24585]: cluster 2024-09-16T13:16:39.550164+0000 mgr.a (mgr.14373) 19866 : cluster [DBG] pgmap v13780: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:16:41.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:16:40 smithi086 bash[24289]: cluster 2024-09-16T13:16:39.550164+0000 mgr.a (mgr.14373) 19866 : cluster [DBG] pgmap v13780: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:16:41.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:16:40 smithi047 bash[22744]: cluster 2024-09-16T13:16:39.550164+0000 mgr.a (mgr.14373) 19866 : cluster [DBG] pgmap v13780: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:16:42.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:16:41 smithi157 bash[24585]: audit 2024-09-16T13:16:40.453111+0000 mgr.a (mgr.14373) 19867 : audit [DBG] from='client.425010 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:16:42.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:16:41 smithi086 bash[24289]: audit 2024-09-16T13:16:40.453111+0000 mgr.a (mgr.14373) 19867 : audit [DBG] from='client.425010 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:16:42.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:16:41 smithi047 bash[22744]: audit 2024-09-16T13:16:40.453111+0000 mgr.a (mgr.14373) 19867 : audit [DBG] from='client.425010 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:16:43.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:16:42 smithi157 bash[24585]: cluster 2024-09-16T13:16:41.552520+0000 mgr.a (mgr.14373) 19868 : cluster [DBG] pgmap v13781: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T13:16:43.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:16:42 smithi086 bash[24289]: cluster 2024-09-16T13:16:41.552520+0000 mgr.a (mgr.14373) 19868 : cluster [DBG] pgmap v13781: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T13:16:43.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:16:42 smithi047 bash[22744]: cluster 2024-09-16T13:16:41.552520+0000 mgr.a (mgr.14373) 19868 : cluster [DBG] pgmap v13781: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T13:16:45.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:16:44 smithi157 bash[24585]: cluster 2024-09-16T13:16:43.553274+0000 mgr.a (mgr.14373) 19869 : cluster [DBG] pgmap v13782: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:16:45.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:16:44 smithi086 bash[24289]: cluster 2024-09-16T13:16:43.553274+0000 mgr.a (mgr.14373) 19869 : cluster [DBG] pgmap v13782: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:16:45.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:16:44 smithi047 bash[22744]: cluster 2024-09-16T13:16:43.553274+0000 mgr.a (mgr.14373) 19869 : cluster [DBG] pgmap v13782: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:16:45.872 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T13:16:45.873 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T13:16:45.873 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T13:16:46.622 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T13:16:46.622 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T13:16:46.622 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T13:16:46.622 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T13:16:46.623 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T13:16:47.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:16:46 smithi157 bash[24585]: cluster 2024-09-16T13:16:45.554038+0000 mgr.a (mgr.14373) 19870 : cluster [DBG] pgmap v13783: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:16:47.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:16:46 smithi086 bash[24289]: cluster 2024-09-16T13:16:45.554038+0000 mgr.a (mgr.14373) 19870 : cluster [DBG] pgmap v13783: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:16:47.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:16:46 smithi047 bash[22744]: cluster 2024-09-16T13:16:45.554038+0000 mgr.a (mgr.14373) 19870 : cluster [DBG] pgmap v13783: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:16:48.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:16:47 smithi157 bash[24585]: audit 2024-09-16T13:16:46.202977+0000 mgr.a (mgr.14373) 19871 : audit [DBG] from='client.425088 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:16:48.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:16:47 smithi086 bash[24289]: audit 2024-09-16T13:16:46.202977+0000 mgr.a (mgr.14373) 19871 : audit [DBG] from='client.425088 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:16:48.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:16:47 smithi047 bash[22744]: audit 2024-09-16T13:16:46.202977+0000 mgr.a (mgr.14373) 19871 : audit [DBG] from='client.425088 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:16:49.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:16:48 smithi157 bash[24585]: cluster 2024-09-16T13:16:47.556524+0000 mgr.a (mgr.14373) 19872 : cluster [DBG] pgmap v13784: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-16T13:16:49.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:16:48 smithi086 bash[24289]: cluster 2024-09-16T13:16:47.556524+0000 mgr.a (mgr.14373) 19872 : cluster [DBG] pgmap v13784: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-16T13:16:49.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:16:48 smithi047 bash[22744]: cluster 2024-09-16T13:16:47.556524+0000 mgr.a (mgr.14373) 19872 : cluster [DBG] pgmap v13784: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-09-16T13:16:51.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:16:50 smithi157 bash[24585]: cluster 2024-09-16T13:16:49.557304+0000 mgr.a (mgr.14373) 19873 : cluster [DBG] pgmap v13785: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T13:16:51.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:16:50 smithi086 bash[24289]: cluster 2024-09-16T13:16:49.557304+0000 mgr.a (mgr.14373) 19873 : cluster [DBG] pgmap v13785: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T13:16:51.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:16:50 smithi047 bash[22744]: cluster 2024-09-16T13:16:49.557304+0000 mgr.a (mgr.14373) 19873 : cluster [DBG] pgmap v13785: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-16T13:16:51.624 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T13:16:51.624 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T13:16:51.625 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T13:16:52.416 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T13:16:52.416 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T13:16:52.416 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T13:16:52.416 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T13:16:52.416 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T13:16:53.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:16:52 smithi157 bash[24585]: cluster 2024-09-16T13:16:51.559280+0000 mgr.a (mgr.14373) 19874 : cluster [DBG] pgmap v13786: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:16:53.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:16:52 smithi086 bash[24289]: cluster 2024-09-16T13:16:51.559280+0000 mgr.a (mgr.14373) 19874 : cluster [DBG] pgmap v13786: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:16:53.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:16:52 smithi047 bash[22744]: cluster 2024-09-16T13:16:51.559280+0000 mgr.a (mgr.14373) 19874 : cluster [DBG] pgmap v13786: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:16:54.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:16:53 smithi157 bash[24585]: audit 2024-09-16T13:16:51.960847+0000 mgr.a (mgr.14373) 19875 : audit [DBG] from='client.425166 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:16:54.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:16:53 smithi086 bash[24289]: audit 2024-09-16T13:16:51.960847+0000 mgr.a (mgr.14373) 19875 : audit [DBG] from='client.425166 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:16:54.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:16:53 smithi047 bash[22744]: audit 2024-09-16T13:16:51.960847+0000 mgr.a (mgr.14373) 19875 : audit [DBG] from='client.425166 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:16:55.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:16:54 smithi157 bash[24585]: cluster 2024-09-16T13:16:53.560249+0000 mgr.a (mgr.14373) 19876 : cluster [DBG] pgmap v13787: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T13:16:55.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:16:54 smithi086 bash[24289]: cluster 2024-09-16T13:16:53.560249+0000 mgr.a (mgr.14373) 19876 : cluster [DBG] pgmap v13787: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T13:16:55.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:16:54 smithi047 bash[22744]: cluster 2024-09-16T13:16:53.560249+0000 mgr.a (mgr.14373) 19876 : cluster [DBG] pgmap v13787: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-09-16T13:16:57.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:16:56 smithi157 bash[24585]: cluster 2024-09-16T13:16:55.561183+0000 mgr.a (mgr.14373) 19877 : cluster [DBG] pgmap v13788: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T13:16:57.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:16:56 smithi086 bash[24289]: cluster 2024-09-16T13:16:55.561183+0000 mgr.a (mgr.14373) 19877 : cluster [DBG] pgmap v13788: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T13:16:57.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:16:56 smithi047 bash[22744]: cluster 2024-09-16T13:16:55.561183+0000 mgr.a (mgr.14373) 19877 : cluster [DBG] pgmap v13788: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-09-16T13:16:57.417 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T13:16:57.418 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T13:16:57.418 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T13:16:58.183 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T13:16:58.183 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T13:16:58.184 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T13:16:58.184 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T13:16:58.184 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T13:16:59.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:16:58 smithi157 bash[24585]: cluster 2024-09-16T13:16:57.562851+0000 mgr.a (mgr.14373) 19878 : cluster [DBG] pgmap v13789: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:16:59.058 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:16:58 smithi157 bash[24585]: audit 2024-09-16T13:16:57.750184+0000 mgr.a (mgr.14373) 19879 : audit [DBG] from='client.425241 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:16:59.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:16:58 smithi086 bash[24289]: cluster 2024-09-16T13:16:57.562851+0000 mgr.a (mgr.14373) 19878 : cluster [DBG] pgmap v13789: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:16:59.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:16:58 smithi086 bash[24289]: audit 2024-09-16T13:16:57.750184+0000 mgr.a (mgr.14373) 19879 : audit [DBG] from='client.425241 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:16:59.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:16:58 smithi047 bash[22744]: cluster 2024-09-16T13:16:57.562851+0000 mgr.a (mgr.14373) 19878 : cluster [DBG] pgmap v13789: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:16:59.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:16:58 smithi047 bash[22744]: audit 2024-09-16T13:16:57.750184+0000 mgr.a (mgr.14373) 19879 : audit [DBG] from='client.425241 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:17:01.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:17:00 smithi157 bash[24585]: cluster 2024-09-16T13:16:59.563825+0000 mgr.a (mgr.14373) 19880 : cluster [DBG] pgmap v13790: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-16T13:17:01.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:17:00 smithi086 bash[24289]: cluster 2024-09-16T13:16:59.563825+0000 mgr.a (mgr.14373) 19880 : cluster [DBG] pgmap v13790: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-16T13:17:01.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:17:00 smithi047 bash[22744]: cluster 2024-09-16T13:16:59.563825+0000 mgr.a (mgr.14373) 19880 : cluster [DBG] pgmap v13790: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-09-16T13:17:03.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:17:02 smithi157 bash[24585]: cluster 2024-09-16T13:17:01.566002+0000 mgr.a (mgr.14373) 19881 : cluster [DBG] pgmap v13791: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-16T13:17:03.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:17:02 smithi086 bash[24289]: cluster 2024-09-16T13:17:01.566002+0000 mgr.a (mgr.14373) 19881 : cluster [DBG] pgmap v13791: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-16T13:17:03.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:17:02 smithi047 bash[22744]: cluster 2024-09-16T13:17:01.566002+0000 mgr.a (mgr.14373) 19881 : cluster [DBG] pgmap v13791: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-09-16T13:17:03.185 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T13:17:03.186 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T13:17:03.186 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T13:17:03.940 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T13:17:03.940 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T13:17:03.940 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T13:17:03.940 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T13:17:03.941 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T13:17:05.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:17:04 smithi157 bash[24585]: audit 2024-09-16T13:17:03.514267+0000 mgr.a (mgr.14373) 19882 : audit [DBG] from='client.425319 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:17:05.058 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:17:04 smithi157 bash[24585]: cluster 2024-09-16T13:17:03.566770+0000 mgr.a (mgr.14373) 19883 : cluster [DBG] pgmap v13792: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:17:05.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:17:04 smithi086 bash[24289]: audit 2024-09-16T13:17:03.514267+0000 mgr.a (mgr.14373) 19882 : audit [DBG] from='client.425319 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:17:05.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:17:04 smithi086 bash[24289]: cluster 2024-09-16T13:17:03.566770+0000 mgr.a (mgr.14373) 19883 : cluster [DBG] pgmap v13792: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:17:05.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:17:04 smithi047 bash[22744]: audit 2024-09-16T13:17:03.514267+0000 mgr.a (mgr.14373) 19882 : audit [DBG] from='client.425319 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:17:05.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:17:04 smithi047 bash[22744]: cluster 2024-09-16T13:17:03.566770+0000 mgr.a (mgr.14373) 19883 : cluster [DBG] pgmap v13792: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:17:06.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:17:05 smithi157 bash[24585]: audit 2024-09-16T13:17:05.614303+0000 mon.b (mon.2) 1794 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T13:17:06.072 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:17:05 smithi086 bash[24289]: audit 2024-09-16T13:17:05.614303+0000 mon.b (mon.2) 1794 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T13:17:06.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:17:05 smithi047 bash[22744]: audit 2024-09-16T13:17:05.614303+0000 mon.b (mon.2) 1794 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T13:17:07.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:17:06 smithi157 bash[24585]: cluster 2024-09-16T13:17:05.567743+0000 mgr.a (mgr.14373) 19884 : cluster [DBG] pgmap v13793: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:17:07.058 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:17:06 smithi157 bash[24585]: audit 2024-09-16T13:17:06.237012+0000 mon.a (mon.0) 1752 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T13:17:07.058 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:17:06 smithi157 bash[24585]: audit 2024-09-16T13:17:06.240632+0000 mon.a (mon.0) 1753 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T13:17:07.058 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:17:06 smithi157 bash[24585]: audit 2024-09-16T13:17:06.244639+0000 mon.a (mon.0) 1754 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T13:17:07.058 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:17:06 smithi157 bash[24585]: audit 2024-09-16T13:17:06.248575+0000 mon.a (mon.0) 1755 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T13:17:07.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:17:06 smithi086 bash[24289]: cluster 2024-09-16T13:17:05.567743+0000 mgr.a (mgr.14373) 19884 : cluster [DBG] pgmap v13793: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:17:07.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:17:06 smithi086 bash[24289]: audit 2024-09-16T13:17:06.237012+0000 mon.a (mon.0) 1752 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T13:17:07.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:17:06 smithi086 bash[24289]: audit 2024-09-16T13:17:06.240632+0000 mon.a (mon.0) 1753 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T13:17:07.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:17:06 smithi086 bash[24289]: audit 2024-09-16T13:17:06.244639+0000 mon.a (mon.0) 1754 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T13:17:07.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:17:06 smithi086 bash[24289]: audit 2024-09-16T13:17:06.248575+0000 mon.a (mon.0) 1755 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T13:17:07.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:17:06 smithi047 bash[22744]: cluster 2024-09-16T13:17:05.567743+0000 mgr.a (mgr.14373) 19884 : cluster [DBG] pgmap v13793: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:17:07.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:17:06 smithi047 bash[22744]: audit 2024-09-16T13:17:06.237012+0000 mon.a (mon.0) 1752 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T13:17:07.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:17:06 smithi047 bash[22744]: audit 2024-09-16T13:17:06.240632+0000 mon.a (mon.0) 1753 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T13:17:07.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:17:06 smithi047 bash[22744]: audit 2024-09-16T13:17:06.244639+0000 mon.a (mon.0) 1754 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T13:17:07.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:17:06 smithi047 bash[22744]: audit 2024-09-16T13:17:06.248575+0000 mon.a (mon.0) 1755 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T13:17:08.308 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:17:07 smithi157 bash[24585]: audit 2024-09-16T13:17:06.862961+0000 mon.a (mon.0) 1756 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T13:17:08.308 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:17:07 smithi157 bash[24585]: audit 2024-09-16T13:17:06.868308+0000 mon.a (mon.0) 1757 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T13:17:08.308 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:17:07 smithi157 bash[24585]: audit 2024-09-16T13:17:07.503657+0000 mon.a (mon.0) 1758 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T13:17:08.309 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:17:07 smithi157 bash[24585]: audit 2024-09-16T13:17:07.512903+0000 mon.a (mon.0) 1759 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T13:17:08.309 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:17:07 smithi157 bash[24585]: audit 2024-09-16T13:17:07.541684+0000 mon.a (mon.0) 1760 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T13:17:08.309 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:17:07 smithi157 bash[24585]: audit 2024-09-16T13:17:07.551894+0000 mon.a (mon.0) 1761 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T13:17:08.309 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:17:07 smithi157 bash[24585]: audit 2024-09-16T13:17:07.554685+0000 mon.b (mon.2) 1795 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T13:17:08.309 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:17:07 smithi157 bash[24585]: audit 2024-09-16T13:17:07.556734+0000 mon.b (mon.2) 1796 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T13:17:08.309 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:17:07 smithi157 bash[24585]: audit 2024-09-16T13:17:07.567723+0000 mon.a (mon.0) 1762 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T13:17:08.309 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:17:07 smithi157 bash[24585]: cluster 2024-09-16T13:17:07.570097+0000 mgr.a (mgr.14373) 19885 : cluster [DBG] pgmap v13794: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T13:17:08.309 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:17:07 smithi157 bash[24585]: audit 2024-09-16T13:17:07.573116+0000 mon.b (mon.2) 1797 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T13:17:08.309 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:17:07 smithi157 bash[24585]: audit 2024-09-16T13:17:07.575335+0000 mgr.a (mgr.14373) 19886 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T13:17:08.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:17:07 smithi086 bash[24289]: audit 2024-09-16T13:17:06.862961+0000 mon.a (mon.0) 1756 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T13:17:08.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:17:07 smithi086 bash[24289]: audit 2024-09-16T13:17:06.868308+0000 mon.a (mon.0) 1757 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T13:17:08.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:17:07 smithi086 bash[24289]: audit 2024-09-16T13:17:07.503657+0000 mon.a (mon.0) 1758 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T13:17:08.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:17:07 smithi086 bash[24289]: audit 2024-09-16T13:17:07.512903+0000 mon.a (mon.0) 1759 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T13:17:08.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:17:07 smithi086 bash[24289]: audit 2024-09-16T13:17:07.541684+0000 mon.a (mon.0) 1760 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T13:17:08.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:17:07 smithi086 bash[24289]: audit 2024-09-16T13:17:07.551894+0000 mon.a (mon.0) 1761 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T13:17:08.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:17:07 smithi086 bash[24289]: audit 2024-09-16T13:17:07.554685+0000 mon.b (mon.2) 1795 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T13:17:08.321 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:17:07 smithi086 bash[24289]: audit 2024-09-16T13:17:07.556734+0000 mon.b (mon.2) 1796 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T13:17:08.322 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:17:07 smithi086 bash[24289]: audit 2024-09-16T13:17:07.567723+0000 mon.a (mon.0) 1762 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T13:17:08.322 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:17:07 smithi086 bash[24289]: cluster 2024-09-16T13:17:07.570097+0000 mgr.a (mgr.14373) 19885 : cluster [DBG] pgmap v13794: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T13:17:08.322 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:17:07 smithi086 bash[24289]: audit 2024-09-16T13:17:07.573116+0000 mon.b (mon.2) 1797 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T13:17:08.322 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:17:07 smithi086 bash[24289]: audit 2024-09-16T13:17:07.575335+0000 mgr.a (mgr.14373) 19886 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T13:17:08.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:17:07 smithi047 bash[22744]: audit 2024-09-16T13:17:06.862961+0000 mon.a (mon.0) 1756 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T13:17:08.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:17:07 smithi047 bash[22744]: audit 2024-09-16T13:17:06.868308+0000 mon.a (mon.0) 1757 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T13:17:08.343 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:17:07 smithi047 bash[22744]: audit 2024-09-16T13:17:07.503657+0000 mon.a (mon.0) 1758 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T13:17:08.344 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:17:07 smithi047 bash[22744]: audit 2024-09-16T13:17:07.512903+0000 mon.a (mon.0) 1759 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T13:17:08.344 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:17:07 smithi047 bash[22744]: audit 2024-09-16T13:17:07.541684+0000 mon.a (mon.0) 1760 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T13:17:08.344 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:17:07 smithi047 bash[22744]: audit 2024-09-16T13:17:07.551894+0000 mon.a (mon.0) 1761 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T13:17:08.344 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:17:07 smithi047 bash[22744]: audit 2024-09-16T13:17:07.554685+0000 mon.b (mon.2) 1795 : audit [DBG] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T13:17:08.344 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:17:07 smithi047 bash[22744]: audit 2024-09-16T13:17:07.556734+0000 mon.b (mon.2) 1796 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T13:17:08.344 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:17:07 smithi047 bash[22744]: audit 2024-09-16T13:17:07.567723+0000 mon.a (mon.0) 1762 : audit [INF] from='mgr.14373 ' entity='mgr.a' 2024-09-16T13:17:08.344 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:17:07 smithi047 bash[22744]: cluster 2024-09-16T13:17:07.570097+0000 mgr.a (mgr.14373) 19885 : cluster [DBG] pgmap v13794: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-09-16T13:17:08.344 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:17:07 smithi047 bash[22744]: audit 2024-09-16T13:17:07.573116+0000 mon.b (mon.2) 1797 : audit [INF] from='mgr.14373 172.21.15.47:0/2888079765' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T13:17:08.344 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:17:07 smithi047 bash[22744]: audit 2024-09-16T13:17:07.575335+0000 mgr.a (mgr.14373) 19886 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: dispatch 2024-09-16T13:17:08.843 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 13:17:08 smithi047 bash[22994]: debug 2024-09-16T13:17:08.369+0000 7fa3ba9d2640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T13:17:08.844 INFO:journalctl@ceph.mgr.a.smithi047.stdout:Sep 16 13:17:08 smithi047 bash[22994]: debug 2024-09-16T13:17:08.369+0000 7fa3d2ac2640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T13:17:08.941 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T13:17:08.942 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T13:17:08.942 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T13:17:09.694 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T13:17:09.695 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T13:17:09.695 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T13:17:09.695 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T13:17:09.695 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T13:17:09.821 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:17:09 smithi086 bash[24289]: audit 2024-09-16T13:17:08.370961+0000 mgr.a (mgr.14373) 19887 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T13:17:09.822 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:17:09 smithi086 bash[24289]: cephadm 2024-09-16T13:17:08.373244+0000 mgr.a (mgr.14373) 19888 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T13:17:09.848 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:17:09 smithi047 bash[22744]: audit 2024-09-16T13:17:08.370961+0000 mgr.a (mgr.14373) 19887 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T13:17:09.848 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:17:09 smithi047 bash[22744]: cephadm 2024-09-16T13:17:08.373244+0000 mgr.a (mgr.14373) 19888 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T13:17:10.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:17:09 smithi157 bash[24585]: audit 2024-09-16T13:17:08.370961+0000 mgr.a (mgr.14373) 19887 : audit [INF] from='mon.? -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogImE2MDE0ZjI4LTllNTctNGVkYS05ZmQ3LTI4ZWM0YTU4Y2U2MCIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiMjZFUFFaVlE3TUxTWEVFTk5CUEsiLAogICAgInNlY3JldCI6ICJ3b1FFc084enJYMUk2c2w2U2hYejBEZTFoVTh0SXNLTHNNWEZySXdjIgp9", "zone_endpoints": ["http://smithi086:5500", "http://smithi157:5500"]}]: access denied 2024-09-16T13:17:10.058 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:17:09 smithi157 bash[24585]: cephadm 2024-09-16T13:17:08.373244+0000 mgr.a (mgr.14373) 19888 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-09-16T13:17:10.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:17:10 smithi047 bash[22744]: audit 2024-09-16T13:17:09.265586+0000 mgr.a (mgr.14373) 19889 : audit [DBG] from='client.425499 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:17:10.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:17:10 smithi047 bash[22744]: cluster 2024-09-16T13:17:09.570570+0000 mgr.a (mgr.14373) 19890 : cluster [DBG] pgmap v13795: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:17:11.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:17:10 smithi157 bash[24585]: audit 2024-09-16T13:17:09.265586+0000 mgr.a (mgr.14373) 19889 : audit [DBG] from='client.425499 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:17:11.058 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:17:10 smithi157 bash[24585]: cluster 2024-09-16T13:17:09.570570+0000 mgr.a (mgr.14373) 19890 : cluster [DBG] pgmap v13795: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:17:11.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:17:10 smithi086 bash[24289]: audit 2024-09-16T13:17:09.265586+0000 mgr.a (mgr.14373) 19889 : audit [DBG] from='client.425499 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:17:11.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:17:10 smithi086 bash[24289]: cluster 2024-09-16T13:17:09.570570+0000 mgr.a (mgr.14373) 19890 : cluster [DBG] pgmap v13795: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-09-16T13:17:12.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:17:12 smithi047 bash[22744]: cluster 2024-09-16T13:17:11.572783+0000 mgr.a (mgr.14373) 19891 : cluster [DBG] pgmap v13796: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T13:17:13.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:17:12 smithi157 bash[24585]: cluster 2024-09-16T13:17:11.572783+0000 mgr.a (mgr.14373) 19891 : cluster [DBG] pgmap v13796: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T13:17:13.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:17:12 smithi086 bash[24289]: cluster 2024-09-16T13:17:11.572783+0000 mgr.a (mgr.14373) 19891 : cluster [DBG] pgmap v13796: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T13:17:14.694 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T13:17:14.695 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T13:17:14.695 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T13:17:14.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:17:14 smithi047 bash[22744]: cluster 2024-09-16T13:17:13.573578+0000 mgr.a (mgr.14373) 19892 : cluster [DBG] pgmap v13797: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T13:17:15.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:17:14 smithi157 bash[24585]: cluster 2024-09-16T13:17:13.573578+0000 mgr.a (mgr.14373) 19892 : cluster [DBG] pgmap v13797: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T13:17:15.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:17:14 smithi086 bash[24289]: cluster 2024-09-16T13:17:13.573578+0000 mgr.a (mgr.14373) 19892 : cluster [DBG] pgmap v13797: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T13:17:15.448 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T13:17:15.449 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T13:17:15.449 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T13:17:15.449 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T13:17:15.449 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T13:17:16.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:17:16 smithi047 bash[22744]: audit 2024-09-16T13:17:15.024534+0000 mgr.a (mgr.14373) 19893 : audit [DBG] from='client.425577 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:17:16.843 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:17:16 smithi047 bash[22744]: cluster 2024-09-16T13:17:15.574609+0000 mgr.a (mgr.14373) 19894 : cluster [DBG] pgmap v13798: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T13:17:17.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:17:16 smithi157 bash[24585]: audit 2024-09-16T13:17:15.024534+0000 mgr.a (mgr.14373) 19893 : audit [DBG] from='client.425577 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:17:17.058 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:17:16 smithi157 bash[24585]: cluster 2024-09-16T13:17:15.574609+0000 mgr.a (mgr.14373) 19894 : cluster [DBG] pgmap v13798: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T13:17:17.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:17:16 smithi086 bash[24289]: audit 2024-09-16T13:17:15.024534+0000 mgr.a (mgr.14373) 19893 : audit [DBG] from='client.425577 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:17:17.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:17:16 smithi086 bash[24289]: cluster 2024-09-16T13:17:15.574609+0000 mgr.a (mgr.14373) 19894 : cluster [DBG] pgmap v13798: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T13:17:19.058 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:17:18 smithi157 bash[24585]: cluster 2024-09-16T13:17:17.576897+0000 mgr.a (mgr.14373) 19895 : cluster [DBG] pgmap v13799: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T13:17:19.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:17:18 smithi086 bash[24289]: cluster 2024-09-16T13:17:17.576897+0000 mgr.a (mgr.14373) 19895 : cluster [DBG] pgmap v13799: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T13:17:19.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:17:18 smithi047 bash[22744]: cluster 2024-09-16T13:17:17.576897+0000 mgr.a (mgr.14373) 19895 : cluster [DBG] pgmap v13799: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T13:17:20.450 INFO:teuthology.orchestra.run.smithi047.stderr:+ true 2024-09-16T13:17:20.451 INFO:teuthology.orchestra.run.smithi047.stderr:++ ceph rgw realm tokens 2024-09-16T13:17:20.451 INFO:teuthology.orchestra.run.smithi047.stderr:++ jq -r '.[0].token' 2024-09-16T13:17:21.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:17:20 smithi157 bash[24585]: cluster 2024-09-16T13:17:19.577675+0000 mgr.a (mgr.14373) 19896 : cluster [DBG] pgmap v13800: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T13:17:21.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:17:20 smithi086 bash[24289]: cluster 2024-09-16T13:17:19.577675+0000 mgr.a (mgr.14373) 19896 : cluster [DBG] pgmap v13800: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T13:17:21.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:17:20 smithi047 bash[22744]: cluster 2024-09-16T13:17:19.577675+0000 mgr.a (mgr.14373) 19896 : cluster [DBG] pgmap v13800: 225 pgs: 225 active+clean; 589 KiB data, 257 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T13:17:21.240 INFO:teuthology.orchestra.run.smithi047.stdout:master zone has no endpoint 2024-09-16T13:17:21.241 INFO:teuthology.orchestra.run.smithi047.stderr:+ TOKEN='master zone has no endpoint' 2024-09-16T13:17:21.241 INFO:teuthology.orchestra.run.smithi047.stderr:+ echo master zone has no endpoint 2024-09-16T13:17:21.241 INFO:teuthology.orchestra.run.smithi047.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-09-16T13:17:21.241 INFO:teuthology.orchestra.run.smithi047.stderr:+ sleep 5 2024-09-16T13:17:22.057 INFO:journalctl@ceph.mon.c.smithi157.stdout:Sep 16 13:17:21 smithi157 bash[24585]: audit 2024-09-16T13:17:20.789381+0000 mgr.a (mgr.14373) 19897 : audit [DBG] from='client.425652 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:17:22.071 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 16 13:17:21 smithi086 bash[24289]: audit 2024-09-16T13:17:20.789381+0000 mgr.a (mgr.14373) 19897 : audit [DBG] from='client.425652 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:17:22.093 INFO:journalctl@ceph.mon.a.smithi047.stdout:Sep 16 13:17:21 smithi047 bash[22744]: audit 2024-09-16T13:17:20.789381+0000 mgr.a (mgr.14373) 19897 : audit [DBG] from='client.425652 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T13:17:22.765 DEBUG:teuthology.exit:Got signal 15; running 1 handler... 2024-09-16T13:17:22.766 DEBUG:teuthology.task.console_log:Killing console logger for smithi047 2024-09-16T13:17:22.766 DEBUG:teuthology.task.console_log:Killing console logger for smithi086 2024-09-16T13:17:22.767 DEBUG:teuthology.task.console_log:Killing console logger for smithi157 2024-09-16T13:17:22.767 DEBUG:teuthology.exit:Finished running handlers